2020-04-22T13:48:18.421 INFO:root:teuthology version: 1.0.0-876b874 2020-04-22T13:48:18.422 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.zUxGsB.tmp -- --verbose --lock --description fs:basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-bitmap.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/client-recovery.yaml} --name xiubli-2020-04-22_13:44:16-fs:basic_functional-vstart_runner-distro-basic-smithi --block --owner scheduled_xiubli@teuthology --archive /home/teuthworker/archive/xiubli-2020-04-22_13:44:16-fs:basic_functional-vstart_runner-distro-basic-smithi/4975248 2020-04-22T13:48:18.471 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-04-22T13:48:18.535 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/xiubli-2020-04-22_13:44:16-fs:basic_functional-vstart_runner-distro-basic-smithi/4975248 branch: vstart_runner description: fs:basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-bitmap.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/client-recovery.yaml} email: null first_in_suite: false job_id: '4975248' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: xiubli-2020-04-22_13:44:16-fs:basic_functional-vstart_runner-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: rhel os_version: '8.1' overrides: admin_socket: branch: vstart_runner ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - evicting unresponsive client - but it is still running - slow request - MDS_CLIENT_LATE_RELEASE - t responding to mclientcaps sha1: 360f904aafdcc5437adf7f1a18be626f09ffd78d ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: sha1: 360f904aafdcc5437adf7f1a18be626f09ffd78d selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: vstart_runner sha1: 360f904aafdcc5437adf7f1a18be626f09ffd78d owner: scheduled_xiubli@teuthology priority: 110 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.1 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - client.2 - client.3 sha1: 360f904aafdcc5437adf7f1a18be626f09ffd78d sleep_before_teardown: 0 suite: fs:basic_functional suite_branch: vstart_runner suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_vstart_runner/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: 360f904aafdcc5437adf7f1a18be626f09ffd78d tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell rpm: - python3-cephfs extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - ceph: null - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_client_recovery teuthology_branch: master tube: smithi verbose: true worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.30387 2020-04-22T13:48:18.535 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_vstart_runner/qa; will attempt to use it 2020-04-22T13:48:18.536 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_vstart_runner/qa/tasks 2020-04-22T13:48:18.536 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-04-22T13:48:18.546 INFO:teuthology.task.internal:Checking packages... 2020-04-22T13:48:18.581 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'basic' and ceph hash '360f904aafdcc5437adf7f1a18be626f09ffd78d' 2020-04-22T13:48:18.581 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-04-22T13:48:18.582 INFO:teuthology.packaging:ref: None 2020-04-22T13:48:18.582 INFO:teuthology.packaging:tag: None 2020-04-22T13:48:18.582 INFO:teuthology.packaging:branch: vstart_runner 2020-04-22T13:48:18.582 INFO:teuthology.packaging:sha1: 360f904aafdcc5437adf7f1a18be626f09ffd78d 2020-04-22T13:48:18.582 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=vstart_runner 2020-04-22T13:48:18.822 INFO:teuthology.task.internal:Found packages for ceph version 16.0.0-952.g360f904 2020-04-22T13:48:18.822 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-04-22T13:48:18.833 INFO:teuthology.task.internal:no buildpackages task found 2020-04-22T13:48:18.833 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-04-22T13:48:18.848 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-04-22T13:48:18.848 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-04-22T13:48:18.901 DEBUG:teuthology.lock.ops:lock_many request: {'count': 2, 'locked_by': 'scheduled_xiubli@teuthology', 'description': '/home/teuthworker/archive/xiubli-2020-04-22_13:44:16-fs:basic_functional-vstart_runner-distro-basic-smithi/4975248', 'machine_type': 'smithi'} 2020-04-22T13:48:18.960 DEBUG:teuthology.lock.ops:locked ubuntu@smithi103.front.sepia.ceph.com, ubuntu@smithi086.front.sepia.ceph.com 2020-04-22T13:48:19.028 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-04-22T13:48:19.275 INFO:teuthology.provision.fog.smithi103:Scheduling deploy of rhel 8.1 2020-04-22T13:48:19.289 INFO:teuthology.provision.fog.smithi086:Scheduling deploy of rhel 8.1 2020-04-22T13:48:19.689 INFO:teuthology.orchestra.console:Power off smithi086 2020-04-22T13:48:19.689 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-04-22T13:48:19.714 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-22T13:48:19.732 INFO:teuthology.orchestra.console:Power off smithi103 2020-04-22T13:48:19.733 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-04-22T13:48:19.755 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-22T13:48:23.745 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-22T13:48:23.778 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-22T13:48:27.857 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-22T13:48:27.889 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-22T13:48:28.108 INFO:teuthology.orchestra.console:Power off for smithi103 completed 2020-04-22T13:48:28.212 INFO:teuthology.orchestra.console:Power on smithi103 2020-04-22T13:48:28.213 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-04-22T13:48:28.237 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-22T13:48:31.969 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-22T13:48:32.183 INFO:teuthology.orchestra.console:Power off for smithi086 completed 2020-04-22T13:48:32.266 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-22T13:48:32.284 INFO:teuthology.orchestra.console:Power on smithi086 2020-04-22T13:48:32.285 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-04-22T13:48:32.314 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-22T13:48:36.339 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-22T13:48:36.379 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-22T13:48:36.592 INFO:teuthology.orchestra.console:Power on for smithi103 completed 2020-04-22T13:48:36.694 INFO:teuthology.provision.fog.smithi103:Waiting for deploy to finish 2020-04-22T13:48:40.465 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-22T13:48:40.675 INFO:teuthology.orchestra.console:Power on for smithi086 completed 2020-04-22T13:48:40.776 INFO:teuthology.provision.fog.smithi086:Waiting for deploy to finish 2020-04-22T13:51:27.047 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi086.front.sepia.ceph.com', 'timeout': 60} 2020-04-22T13:51:36.105 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi086.front.sepia.ceph.com', 'timeout': 60} 2020-04-22T13:51:38.214 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi103.front.sepia.ceph.com', 'timeout': 60} 2020-04-22T13:51:45.165 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi086.front.sepia.ceph.com', 'timeout': 60} 2020-04-22T13:51:47.270 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi103.front.sepia.ceph.com', 'timeout': 60} 2020-04-22T13:51:54.250 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi086.front.sepia.ceph.com', 'timeout': 60} 2020-04-22T13:51:56.326 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi103.front.sepia.ceph.com', 'timeout': 60} 2020-04-22T13:52:03.302 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi086.front.sepia.ceph.com', 'timeout': 60} 2020-04-22T13:52:05.382 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi103.front.sepia.ceph.com', 'timeout': 60} 2020-04-22T13:52:12.363 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi086.front.sepia.ceph.com', 'timeout': 60} 2020-04-22T13:52:14.441 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi103.front.sepia.ceph.com', 'timeout': 60} 2020-04-22T13:52:21.418 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi086.front.sepia.ceph.com', 'timeout': 60} 2020-04-22T13:52:23.494 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi103.front.sepia.ceph.com', 'timeout': 60} 2020-04-22T13:52:30.476 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi086.front.sepia.ceph.com', 'timeout': 60} 2020-04-22T13:52:32.554 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi103.front.sepia.ceph.com', 'timeout': 60} 2020-04-22T13:52:39.564 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi086.front.sepia.ceph.com', 'timeout': 60} 2020-04-22T13:52:41.606 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi103.front.sepia.ceph.com', 'timeout': 60} 2020-04-22T13:52:50.670 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi103.front.sepia.ceph.com', 'timeout': 60} 2020-04-22T13:52:59.753 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi103.front.sepia.ceph.com', 'timeout': 60} 2020-04-22T13:53:08.810 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi103.front.sepia.ceph.com', 'timeout': 60} 2020-04-22T13:53:45.594 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi086.front.sepia.ceph.com', 'timeout': 60} 2020-04-22T13:53:45.868 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:53:46.193 INFO:teuthology.orchestra.run.smithi086:> hostname 2020-04-22T13:53:46.206 INFO:teuthology.orchestra.run.smithi086.stdout:smithi086.front.sepia.ceph.com 2020-04-22T13:53:46.207 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:53:46.260 INFO:teuthology.orchestra.run.smithi086:> grep smithi086.front.sepia.ceph.com /etc/hosts 2020-04-22T13:53:46.315 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86 smithi086.front.sepia.ceph.com smithi086 2020-04-22T13:53:46.316 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:53:46.369 INFO:teuthology.orchestra.run.smithi086:> sudo hostname smithi086 2020-04-22T13:53:46.508 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:53:46.522 INFO:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/smithi086.front.sepia.ceph.com/smithi086/g' /etc/hosts 2020-04-22T13:53:46.590 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:53:46.643 INFO:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/172.21.15.86/172.21.15.86/g' /etc/hosts 2020-04-22T13:53:46.716 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:53:46.769 INFO:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/smithi086.front.sepia.ceph.com/smithi086/g' /etc/hostname 2020-04-22T13:53:46.837 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:53:46.891 INFO:teuthology.orchestra.run.smithi086:> sudo hostname smithi086 2020-04-22T13:53:46.957 INFO:teuthology.provision.fog.smithi086:Deploy complete! 2020-04-22T13:53:46.959 DEBUG:teuthology.parallel:result is None 2020-04-22T13:54:14.834 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi103.front.sepia.ceph.com', 'timeout': 60} 2020-04-22T13:54:15.095 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:54:15.464 INFO:teuthology.orchestra.run.smithi103:> hostname 2020-04-22T13:54:15.480 INFO:teuthology.orchestra.run.smithi103.stdout:smithi103.front.sepia.ceph.com 2020-04-22T13:54:15.480 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:54:15.534 INFO:teuthology.orchestra.run.smithi103:> grep smithi103.front.sepia.ceph.com /etc/hosts 2020-04-22T13:54:15.594 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103 smithi103.front.sepia.ceph.com smithi103 2020-04-22T13:54:15.594 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:54:15.647 INFO:teuthology.orchestra.run.smithi103:> sudo hostname smithi103 2020-04-22T13:54:15.766 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:54:15.780 INFO:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi103.front.sepia.ceph.com/smithi103/g' /etc/hosts 2020-04-22T13:54:15.849 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:54:15.908 INFO:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/172.21.15.103/172.21.15.103/g' /etc/hosts 2020-04-22T13:54:15.975 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:54:16.029 INFO:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi103.front.sepia.ceph.com/smithi103/g' /etc/hostname 2020-04-22T13:54:16.097 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:54:16.152 INFO:teuthology.orchestra.run.smithi103:> sudo hostname smithi103 2020-04-22T13:54:16.218 INFO:teuthology.provision.fog.smithi103:Deploy complete! 2020-04-22T13:54:16.220 DEBUG:teuthology.parallel:result is None 2020-04-22T13:54:16.370 INFO:teuthology.lock.ops:Checking smithi103.front.sepia.ceph.com 2020-04-22T13:54:16.371 INFO:teuthology.lock.ops:New key found. Updating... 2020-04-22T13:54:16.390 INFO:teuthology.lock.ops:Checking smithi086.front.sepia.ceph.com 2020-04-22T13:54:16.390 INFO:teuthology.lock.ops:New key found. Updating... 2020-04-22T13:54:16.407 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: set os type and version on server 2020-04-22T13:54:16.408 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi103.front.sepia.ceph.com', 'timeout': 60} 2020-04-22T13:54:16.476 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:54:16.644 INFO:teuthology.orchestra.run.smithi103:> uname -m 2020-04-22T13:54:16.698 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64 2020-04-22T13:54:16.699 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:54:16.757 INFO:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2020-04-22T13:54:16.813 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="Red Hat Enterprise Linux" 2020-04-22T13:54:16.813 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="8.1 (Ootpa)" 2020-04-22T13:54:16.814 INFO:teuthology.orchestra.run.smithi103.stdout:ID="rhel" 2020-04-22T13:54:16.814 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="fedora" 2020-04-22T13:54:16.814 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="8.1" 2020-04-22T13:54:16.814 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el8" 2020-04-22T13:54:16.814 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.1 (Ootpa)" 2020-04-22T13:54:16.814 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2020-04-22T13:54:16.815 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.1:GA" 2020-04-22T13:54:16.815 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://www.redhat.com/" 2020-04-22T13:54:16.815 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-04-22T13:54:16.815 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T13:54:16.815 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-04-22T13:54:16.815 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.1 2020-04-22T13:54:16.815 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-04-22T13:54:16.815 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.1" 2020-04-22T13:54:16.817 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2020-04-22T13:54:16.833 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: set os type and version on server 2020-04-22T13:54:16.834 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi086.front.sepia.ceph.com', 'timeout': 60} 2020-04-22T13:54:16.908 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:54:17.080 INFO:teuthology.orchestra.run.smithi086:> uname -m 2020-04-22T13:54:17.139 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64 2020-04-22T13:54:17.139 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:54:17.192 INFO:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2020-04-22T13:54:17.245 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="Red Hat Enterprise Linux" 2020-04-22T13:54:17.246 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="8.1 (Ootpa)" 2020-04-22T13:54:17.246 INFO:teuthology.orchestra.run.smithi086.stdout:ID="rhel" 2020-04-22T13:54:17.246 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="fedora" 2020-04-22T13:54:17.246 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="8.1" 2020-04-22T13:54:17.246 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el8" 2020-04-22T13:54:17.247 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.1 (Ootpa)" 2020-04-22T13:54:17.247 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2020-04-22T13:54:17.247 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.1:GA" 2020-04-22T13:54:17.247 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://www.redhat.com/" 2020-04-22T13:54:17.247 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-04-22T13:54:17.247 INFO:teuthology.orchestra.run.smithi086.stdout: 2020-04-22T13:54:17.248 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-04-22T13:54:17.248 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.1 2020-04-22T13:54:17.248 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-04-22T13:54:17.248 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.1" 2020-04-22T13:54:17.249 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2020-04-22T13:54:17.262 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2020-04-22T13:54:17.301 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi086.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4sktg9rjcFLvLb1iDygji9Ajt8KQ11N7chd+8+Dm++LiCJrTjUgKnsRYhwijj/h03AaIndDyjg1lVs6Zbh7BO28f8XhRA471A2IqpWy2zMm8eVe/7nwPOm1ed3Y2OL9liGIQow3ci+hLSYkHee3RLddErUh8aXeNrj4ui/lfSxqkuMgcCOJH8Yrw6xyEUj/EqoIum/2v54M8Vn2Lk67kKCrHuakbhyLfrSf65lfNrG8Yqif3287O+nWagFI9Dn/1P9T/JvusIcbj7mzZ8h+tEs1aXGfTim8++cG1VB9708AjTiCmT0ynRi7521YzOhMZH0uCAXbZhuOmbERQY3cKKnylwvsemqYf3HprkMzR4RSubNyBLp/CK1ZV12Sh93AODblhu2u0ni1Muc72LU6V1Lginny4VpD8A8v/fR4Ao+BCZHjksDKP7xUTZJd7MijIkg4HHRR0jxpfMgPYppSuLIUbwIwm87QwPmHcW/f1+UPvdY1mxPSUlY+0EV8EKE50= smithi103.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDVdrsSP/xCgYzJyAEpLEvTe/JKb9p3U38oU3HADv2jDoD9xVWorGk57/bAVn5vPp5Bk3Nr+X+G3IFWs3XDPrlyA/rGjgVGqyr79P/Y394TseAQ2044Ne1BToFHSoe5aEQJixF5AivNiMEUDj/drVNbutFFYMPSsbKs1Nf/ZwhMfu1d+fKe8fnntroO0fQnq08HktDRbf5bhzpUXjbynvCaWQjB+T0Thn6de9wz5O1JqTAGBX+NrLoSJV2jCzQdT0pE2is2voUaBqiXvHQ9osXa4qW8iuw93DstH00tJ6Gps6qi6K1K4GaBPqVQoqW9YO1WHved5nYHJ3FBgWJJO0EWESjh0uo/hgXpyXEpg+lejuaKsSZEFmmex/foTyUA3eSPmOo349+1dB+ZrtI1m63hG70CTeldjvBotHuE2RcOXK5rb8u3AYtyYelYSGz5gsMTdOHW81RSlu5gzcfjxJTk0qvCnEmghbO6QsytLZVwlVdqK29PFKp70g/4Ts3T680= 2020-04-22T13:54:17.302 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-04-22T13:54:17.365 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-04-22T13:54:17.375 INFO:teuthology.task.internal:Saving configuration 2020-04-22T13:54:17.405 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-04-22T13:54:17.420 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-04-22T13:54:17.435 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-04-22 13:48:18.942770', u'locked_by': u'scheduled_xiubli@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi103.front.sepia.ceph.com', u'os_version': u'8.1', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'rhel', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKFDrZhIji5FUKwKvNTzv98gXMVszMurSQGlEmb4GiMZRi/6h2Ng1fyrLa0f6MhdPPEbWfB8h7wrskofzksYCkE=', u'description': u'/home/teuthworker/archive/xiubli-2020-04-22_13:44:16-fs:basic_functional-vstart_runner-distro-basic-smithi/4975248'} 2020-04-22T13:54:17.449 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-04-22 13:48:18.942749', u'locked_by': u'scheduled_xiubli@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi086.front.sepia.ceph.com', u'os_version': u'8.1', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'rhel', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGFj2rVBxvP/qu99W5ozNR7mbJ2cMCax4A161mxWx25FDdwk2vRujyh5+yFhii2IVq12bZhmJPoimhVQ3v6iaqw=', u'description': u'/home/teuthworker/archive/xiubli-2020-04-22_13:44:16-fs:basic_functional-vstart_runner-distro-basic-smithi/4975248'} 2020-04-22T13:54:17.449 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-04-22T13:54:17.459 INFO:teuthology.task.internal:roles: ubuntu@smithi103.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.1'] 2020-04-22T13:54:17.459 INFO:teuthology.task.internal:roles: ubuntu@smithi086.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.2', 'client.3'] 2020-04-22T13:54:17.459 INFO:teuthology.run_tasks:Running task console_log... 2020-04-22T13:54:17.553 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-04-22T13:54:17.554 INFO:teuthology.run_tasks:Running task internal.connect... 2020-04-22T13:54:17.563 INFO:teuthology.task.internal:Opening connections... 2020-04-22T13:54:17.564 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi103.front.sepia.ceph.com 2020-04-22T13:54:17.565 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi103.front.sepia.ceph.com', 'timeout': 60} 2020-04-22T13:54:17.640 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi086.front.sepia.ceph.com 2020-04-22T13:54:17.641 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi086.front.sepia.ceph.com', 'timeout': 60} 2020-04-22T13:54:17.714 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-04-22T13:54:17.733 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:54:17.762 INFO:teuthology.orchestra.run.smithi103:> uname -m 2020-04-22T13:54:17.815 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64 2020-04-22T13:54:17.816 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:54:17.869 INFO:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2020-04-22T13:54:17.930 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="Red Hat Enterprise Linux" 2020-04-22T13:54:17.930 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="8.1 (Ootpa)" 2020-04-22T13:54:17.930 INFO:teuthology.orchestra.run.smithi103.stdout:ID="rhel" 2020-04-22T13:54:17.930 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="fedora" 2020-04-22T13:54:17.931 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="8.1" 2020-04-22T13:54:17.931 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el8" 2020-04-22T13:54:17.931 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.1 (Ootpa)" 2020-04-22T13:54:17.931 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2020-04-22T13:54:17.931 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.1:GA" 2020-04-22T13:54:17.932 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://www.redhat.com/" 2020-04-22T13:54:17.932 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-04-22T13:54:17.932 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T13:54:17.932 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-04-22T13:54:17.932 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.1 2020-04-22T13:54:17.933 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-04-22T13:54:17.934 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.1" 2020-04-22T13:54:17.935 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2020-04-22T13:54:17.954 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:54:17.971 INFO:teuthology.orchestra.run.smithi086:> uname -m 2020-04-22T13:54:18.025 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64 2020-04-22T13:54:18.025 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:54:18.078 INFO:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2020-04-22T13:54:18.138 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="Red Hat Enterprise Linux" 2020-04-22T13:54:18.139 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="8.1 (Ootpa)" 2020-04-22T13:54:18.139 INFO:teuthology.orchestra.run.smithi086.stdout:ID="rhel" 2020-04-22T13:54:18.139 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="fedora" 2020-04-22T13:54:18.139 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="8.1" 2020-04-22T13:54:18.139 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el8" 2020-04-22T13:54:18.139 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.1 (Ootpa)" 2020-04-22T13:54:18.139 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2020-04-22T13:54:18.139 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.1:GA" 2020-04-22T13:54:18.140 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://www.redhat.com/" 2020-04-22T13:54:18.140 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-04-22T13:54:18.140 INFO:teuthology.orchestra.run.smithi086.stdout: 2020-04-22T13:54:18.140 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-04-22T13:54:18.140 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.1 2020-04-22T13:54:18.140 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-04-22T13:54:18.140 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.1" 2020-04-22T13:54:18.141 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2020-04-22T13:54:18.156 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-04-22T13:54:18.174 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-04-22T13:54:18.207 INFO:teuthology.task.internal:Checking for old test directory... 2020-04-22T13:54:18.207 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:54:18.230 INFO:teuthology.orchestra.run.smithi086:> test '!' -e /home/ubuntu/cephtest 2020-04-22T13:54:18.272 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:54:18.286 INFO:teuthology.orchestra.run.smithi103:> test '!' -e /home/ubuntu/cephtest 2020-04-22T13:54:18.340 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-04-22T13:54:18.349 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-04-22T13:54:18.349 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:54:18.362 INFO:teuthology.orchestra.run.smithi086:> test -z $(ls -A /var/lib/ceph) 2020-04-22T13:54:18.404 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:54:18.424 INFO:teuthology.orchestra.run.smithi103:> test -z $(ls -A /var/lib/ceph) 2020-04-22T13:54:18.485 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-04-22T13:54:18.528 INFO:teuthology.run_tasks:Running task kernel... 2020-04-22T13:54:18.565 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.c': {'sha1': 'distro', 'kdb': True}, 'client.0': {'sha1': 'distro', 'kdb': True}, 'mds.a': {'sha1': 'distro', 'kdb': True}, 'mds.b': {'sha1': 'distro', 'kdb': True}, 'osd.1': {'sha1': 'distro', 'kdb': True}, 'osd.0': {'sha1': 'distro', 'kdb': True}, 'osd.3': {'sha1': 'distro', 'kdb': True}, 'osd.2': {'sha1': 'distro', 'kdb': True}, 'osd.5': {'sha1': 'distro', 'kdb': True}, 'osd.4': {'sha1': 'distro', 'kdb': True}, 'osd.7': {'sha1': 'distro', 'kdb': True}, 'osd.6': {'sha1': 'distro', 'kdb': True}, 'client.3': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}, 'mgr.y': {'sha1': 'distro', 'kdb': True}, 'mgr.x': {'sha1': 'distro', 'kdb': True}, 'client.2': {'sha1': 'distro', 'kdb': True}, 'client.1': {'sha1': 'distro', 'kdb': True}} 2020-04-22T13:54:18.566 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}}, timeout 300 2020-04-22T13:54:18.566 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:54:18.581 INFO:teuthology.orchestra.run.smithi103:> uname -r 2020-04-22T13:54:18.635 INFO:teuthology.orchestra.run.smithi103.stdout:4.18.0-147.8.1.el8_1.x86_64 2020-04-22T13:54:18.635 INFO:teuthology.task.kernel:Running kernel on smithi103: 4.18.0-147.8.1.el8_1.x86_64 2020-04-22T13:54:18.636 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:54:18.692 INFO:teuthology.orchestra.run.smithi103:> sudo yum install -y kernel 2020-04-22T13:54:20.625 INFO:teuthology.orchestra.run.smithi103.stdout:Updating Subscription Management repositories. 2020-04-22T13:54:20.625 INFO:teuthology.orchestra.run.smithi103.stdout:Unable to read consumer identity 2020-04-22T13:54:20.712 INFO:teuthology.orchestra.run.smithi103.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-04-22T13:54:21.902 INFO:teuthology.orchestra.run.smithi103.stdout:Copr repo for ceph-el8 owned by ktdreyer 393 kB/s | 47 kB 00:00 2020-04-22T13:54:22.243 INFO:teuthology.orchestra.run.smithi103.stdout:Extra Packages for Enterprise Linux 20 MB/s | 6.4 MB 00:00 2020-04-22T13:54:23.499 INFO:teuthology.orchestra.run.smithi103.stdout:lab-extras 4.1 MB/s | 20 kB 00:00 2020-04-22T13:54:23.805 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problem: 2020-04-22T13:54:23.805 INFO:teuthology.orchestra.run.smithi103.stderr: 2020-04-22T13:54:23.805 INFO:teuthology.orchestra.run.smithi103.stderr: Problem: conflicting requests 2020-04-22T13:54:23.808 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64 2020-04-22T13:54:24.024 INFO:teuthology.orchestra.run.smithi103.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-04-22T13:54:24.024 INFO:teuthology.orchestra.run.smithi103.stdout:Package kernel-4.18.0-147.8.1.el8_1.x86_64 is already installed. 2020-04-22T13:54:24.119 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2020-04-22T13:54:24.120 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2020-04-22T13:54:24.120 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2020-04-22T13:54:24.311 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:54:24.324 INFO:teuthology.orchestra.run.smithi103:> echo no | sudo yum reinstall kernel || true 2020-04-22T13:54:24.696 INFO:teuthology.orchestra.run.smithi103.stdout:Updating Subscription Management repositories. 2020-04-22T13:54:24.697 INFO:teuthology.orchestra.run.smithi103.stdout:Unable to read consumer identity 2020-04-22T13:54:24.788 INFO:teuthology.orchestra.run.smithi103.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-04-22T13:54:24.933 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:00:01 ago on Wed 22 Apr 2020 01:54:23 PM UTC. 2020-04-22T13:54:24.961 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problem: 2020-04-22T13:54:24.961 INFO:teuthology.orchestra.run.smithi103.stderr: 2020-04-22T13:54:24.961 INFO:teuthology.orchestra.run.smithi103.stderr: Problem: conflicting requests 2020-04-22T13:54:24.961 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64 2020-04-22T13:54:25.054 INFO:teuthology.orchestra.run.smithi103.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-04-22T13:54:25.054 INFO:teuthology.orchestra.run.smithi103.stdout:Installed package kernel-4.18.0-147.8.1.el8_1.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2020-04-22T13:54:25.145 INFO:teuthology.orchestra.run.smithi103.stderr:Error: No packages marked for reinstall. 2020-04-22T13:54:25.237 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:54:25.253 INFO:teuthology.orchestra.run.smithi103:> sudo yum reinstall -y kernel || true 2020-04-22T13:54:25.619 INFO:teuthology.orchestra.run.smithi103.stdout:Updating Subscription Management repositories. 2020-04-22T13:54:25.619 INFO:teuthology.orchestra.run.smithi103.stdout:Unable to read consumer identity 2020-04-22T13:54:25.682 INFO:teuthology.orchestra.run.smithi103.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-04-22T13:54:25.825 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:00:02 ago on Wed 22 Apr 2020 01:54:23 PM UTC. 2020-04-22T13:54:25.853 INFO:teuthology.orchestra.run.smithi103.stderr:Modular dependency problem: 2020-04-22T13:54:25.853 INFO:teuthology.orchestra.run.smithi103.stderr: 2020-04-22T13:54:25.853 INFO:teuthology.orchestra.run.smithi103.stderr: Problem: conflicting requests 2020-04-22T13:54:25.854 INFO:teuthology.orchestra.run.smithi103.stderr: - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64 2020-04-22T13:54:25.918 INFO:teuthology.orchestra.run.smithi103.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-04-22T13:54:25.919 INFO:teuthology.orchestra.run.smithi103.stdout:Installed package kernel-4.18.0-147.8.1.el8_1.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2020-04-22T13:54:25.980 INFO:teuthology.orchestra.run.smithi103.stderr:Error: No packages marked for reinstall. 2020-04-22T13:54:26.073 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:54:26.086 INFO:teuthology.orchestra.run.smithi103:> rpm -q kernel --last | head -n 1 2020-04-22T13:54:26.189 INFO:teuthology.orchestra.run.smithi103.stdout:kernel-4.18.0-147.8.1.el8_1.x86_64 Wed 15 Apr 2020 09:40:50 PM UTC 2020-04-22T13:54:26.191 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-147.8.1.el8_1.x86_64 2020-04-22T13:54:26.191 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-04-22T13:54:26.191 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:54:26.214 INFO:teuthology.orchestra.run.smithi086:> uname -r 2020-04-22T13:54:26.270 INFO:teuthology.orchestra.run.smithi086.stdout:4.18.0-147.8.1.el8_1.x86_64 2020-04-22T13:54:26.270 INFO:teuthology.task.kernel:Running kernel on smithi086: 4.18.0-147.8.1.el8_1.x86_64 2020-04-22T13:54:26.270 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:54:26.327 INFO:teuthology.orchestra.run.smithi086:> sudo yum install -y kernel 2020-04-22T13:54:28.111 INFO:teuthology.orchestra.run.smithi086.stdout:Updating Subscription Management repositories. 2020-04-22T13:54:28.112 INFO:teuthology.orchestra.run.smithi086.stdout:Unable to read consumer identity 2020-04-22T13:54:28.257 INFO:teuthology.orchestra.run.smithi086.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-04-22T13:54:29.458 INFO:teuthology.orchestra.run.smithi086.stdout:Copr repo for ceph-el8 owned by ktdreyer 371 kB/s | 47 kB 00:00 2020-04-22T13:54:29.839 INFO:teuthology.orchestra.run.smithi086.stdout:Extra Packages for Enterprise Linux 18 MB/s | 6.4 MB 00:00 2020-04-22T13:54:31.077 INFO:teuthology.orchestra.run.smithi086.stdout:lab-extras 4.1 MB/s | 20 kB 00:00 2020-04-22T13:54:31.374 INFO:teuthology.orchestra.run.smithi086.stderr:Modular dependency problem: 2020-04-22T13:54:31.374 INFO:teuthology.orchestra.run.smithi086.stderr: 2020-04-22T13:54:31.375 INFO:teuthology.orchestra.run.smithi086.stderr: Problem: conflicting requests 2020-04-22T13:54:31.375 INFO:teuthology.orchestra.run.smithi086.stderr: - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64 2020-04-22T13:54:31.597 INFO:teuthology.orchestra.run.smithi086.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-04-22T13:54:31.598 INFO:teuthology.orchestra.run.smithi086.stdout:Package kernel-4.18.0-147.8.1.el8_1.x86_64 is already installed. 2020-04-22T13:54:31.676 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2020-04-22T13:54:31.677 INFO:teuthology.orchestra.run.smithi086.stdout:Nothing to do. 2020-04-22T13:54:31.678 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2020-04-22T13:54:31.884 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:54:31.898 INFO:teuthology.orchestra.run.smithi086:> echo no | sudo yum reinstall kernel || true 2020-04-22T13:54:32.264 INFO:teuthology.orchestra.run.smithi086.stdout:Updating Subscription Management repositories. 2020-04-22T13:54:32.264 INFO:teuthology.orchestra.run.smithi086.stdout:Unable to read consumer identity 2020-04-22T13:54:32.328 INFO:teuthology.orchestra.run.smithi086.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-04-22T13:54:32.475 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:00:01 ago on Wed 22 Apr 2020 01:54:31 PM UTC. 2020-04-22T13:54:32.503 INFO:teuthology.orchestra.run.smithi086.stderr:Modular dependency problem: 2020-04-22T13:54:32.503 INFO:teuthology.orchestra.run.smithi086.stderr: 2020-04-22T13:54:32.503 INFO:teuthology.orchestra.run.smithi086.stderr: Problem: conflicting requests 2020-04-22T13:54:32.503 INFO:teuthology.orchestra.run.smithi086.stderr: - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64 2020-04-22T13:54:32.583 INFO:teuthology.orchestra.run.smithi086.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-04-22T13:54:32.583 INFO:teuthology.orchestra.run.smithi086.stdout:Installed package kernel-4.18.0-147.8.1.el8_1.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2020-04-22T13:54:32.660 INFO:teuthology.orchestra.run.smithi086.stderr:Error: No packages marked for reinstall. 2020-04-22T13:54:32.735 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:54:32.756 INFO:teuthology.orchestra.run.smithi086:> sudo yum reinstall -y kernel || true 2020-04-22T13:54:33.124 INFO:teuthology.orchestra.run.smithi086.stdout:Updating Subscription Management repositories. 2020-04-22T13:54:33.124 INFO:teuthology.orchestra.run.smithi086.stdout:Unable to read consumer identity 2020-04-22T13:54:33.177 INFO:teuthology.orchestra.run.smithi086.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-04-22T13:54:33.317 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:00:02 ago on Wed 22 Apr 2020 01:54:31 PM UTC. 2020-04-22T13:54:33.348 INFO:teuthology.orchestra.run.smithi086.stderr:Modular dependency problem: 2020-04-22T13:54:33.348 INFO:teuthology.orchestra.run.smithi086.stderr: 2020-04-22T13:54:33.348 INFO:teuthology.orchestra.run.smithi086.stderr: Problem: conflicting requests 2020-04-22T13:54:33.348 INFO:teuthology.orchestra.run.smithi086.stderr: - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64 2020-04-22T13:54:33.432 INFO:teuthology.orchestra.run.smithi086.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-04-22T13:54:33.432 INFO:teuthology.orchestra.run.smithi086.stdout:Installed package kernel-4.18.0-147.8.1.el8_1.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2020-04-22T13:54:33.493 INFO:teuthology.orchestra.run.smithi086.stderr:Error: No packages marked for reinstall. 2020-04-22T13:54:33.571 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:54:33.584 INFO:teuthology.orchestra.run.smithi086:> rpm -q kernel --last | head -n 1 2020-04-22T13:54:33.677 INFO:teuthology.orchestra.run.smithi086.stdout:kernel-4.18.0-147.8.1.el8_1.x86_64 Wed 15 Apr 2020 09:40:50 PM UTC 2020-04-22T13:54:33.679 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-147.8.1.el8_1.x86_64 2020-04-22T13:54:33.679 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-04-22T13:54:33.679 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2020-04-22T13:54:33.679 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:54:33.695 INFO:teuthology.orchestra.run.smithi103:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-04-22T13:54:33.777 INFO:teuthology.orchestra.run.smithi103.stdout:ttyS1 2020-04-22T13:54:33.791 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2020-04-22T13:54:33.791 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:54:33.805 INFO:teuthology.orchestra.run.smithi086:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-04-22T13:54:33.884 INFO:teuthology.orchestra.run.smithi086.stdout:ttyS1 2020-04-22T13:54:33.897 INFO:teuthology.run_tasks:Running task internal.base... 2020-04-22T13:54:33.908 INFO:teuthology.task.internal:Creating test directory... 2020-04-22T13:54:33.908 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:54:33.950 INFO:teuthology.orchestra.run.smithi086:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-04-22T13:54:34.017 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:54:34.035 INFO:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-04-22T13:54:34.092 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2020-04-22T13:54:34.103 INFO:teuthology.run_tasks:Running task internal.archive... 2020-04-22T13:54:34.117 INFO:teuthology.task.internal:Creating archive directory... 2020-04-22T13:54:34.117 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:54:34.130 INFO:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-04-22T13:54:34.172 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:54:34.187 INFO:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-04-22T13:54:34.252 INFO:teuthology.run_tasks:Running task internal.coredump... 2020-04-22T13:54:34.263 INFO:teuthology.task.internal:Enabling coredump saving... 2020-04-22T13:54:34.263 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:54:34.291 INFO:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-04-22T13:54:34.333 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:54:34.349 INFO:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-04-22T13:54:34.371 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-04-22T13:54:34.384 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-04-22T13:54:34.435 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-04-22T13:54:34.451 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-04-22T13:54:34.452 INFO:teuthology.run_tasks:Running task internal.sudo... 2020-04-22T13:54:34.464 INFO:teuthology.task.internal:Configuring sudo... 2020-04-22T13:54:34.464 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:54:34.477 INFO:teuthology.orchestra.run.smithi086:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-04-22T13:54:34.519 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:54:34.534 INFO:teuthology.orchestra.run.smithi103:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-04-22T13:54:34.604 INFO:teuthology.run_tasks:Running task internal.syslog... 2020-04-22T13:54:34.616 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2020-04-22T13:54:34.616 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:54:34.629 INFO:teuthology.orchestra.run.smithi086:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-04-22T13:54:34.671 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:54:34.697 INFO:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-04-22T13:54:34.751 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:54:34.806 INFO:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-04-22T13:54:34.879 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:54:34.918 INFO:teuthology.orchestra.run.smithi103:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-04-22T13:54:35.003 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:54:35.017 INFO:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-04-22T13:54:35.090 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:54:35.127 INFO:teuthology.orchestra.run.smithi103:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-04-22T13:54:35.195 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:54:35.248 INFO:teuthology.orchestra.run.smithi103:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-04-22T13:54:35.333 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:54:35.347 INFO:teuthology.orchestra.run.smithi086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-04-22T13:54:35.419 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:54:35.459 INFO:teuthology.orchestra.run.smithi086:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-04-22T13:54:35.538 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:54:35.591 INFO:teuthology.orchestra.run.smithi086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-04-22T13:54:35.663 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:54:35.702 INFO:teuthology.orchestra.run.smithi086:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-04-22T13:54:35.769 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:54:35.822 INFO:teuthology.orchestra.run.smithi086:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-04-22T13:54:35.909 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:54:35.962 INFO:teuthology.orchestra.run.smithi086:> sudo service rsyslog restart 2020-04-22T13:54:36.004 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:54:36.019 INFO:teuthology.orchestra.run.smithi103:> sudo service rsyslog restart 2020-04-22T13:54:36.070 INFO:teuthology.orchestra.run.smithi086.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-04-22T13:54:36.133 INFO:teuthology.orchestra.run.smithi103.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-04-22T13:54:36.417 INFO:teuthology.run_tasks:Running task internal.timer... 2020-04-22T13:54:36.430 INFO:teuthology.task.internal:Starting timer... 2020-04-22T13:54:36.430 INFO:teuthology.run_tasks:Running task pcp... 2020-04-22T13:54:36.482 INFO:teuthology.run_tasks:Running task selinux... 2020-04-22T13:54:36.494 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2020-04-22T13:54:36.495 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:54:36.513 INFO:teuthology.orchestra.run.smithi086:> sudo service auditd rotate 2020-04-22T13:54:36.624 INFO:teuthology.orchestra.run.smithi086.stdout:Rotating logs: [ OK ] 2020-04-22T13:54:36.627 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:54:36.641 INFO:teuthology.orchestra.run.smithi103:> sudo service auditd rotate 2020-04-22T13:54:36.770 INFO:teuthology.orchestra.run.smithi103.stdout:Rotating logs: [ OK ] 2020-04-22T13:54:36.771 DEBUG:teuthology.task.selinux:Getting current SELinux state 2020-04-22T13:54:36.772 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:54:36.786 INFO:teuthology.orchestra.run.smithi103:> /usr/sbin/getenforce 2020-04-22T13:54:36.840 INFO:teuthology.orchestra.run.smithi103.stdout:Permissive 2020-04-22T13:54:36.840 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:54:36.858 INFO:teuthology.orchestra.run.smithi086:> /usr/sbin/getenforce 2020-04-22T13:54:36.914 INFO:teuthology.orchestra.run.smithi086.stdout:Permissive 2020-04-22T13:54:36.915 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi103.front.sepia.ceph.com': u'permissive', 'ubuntu@smithi086.front.sepia.ceph.com': u'permissive'} 2020-04-22T13:54:36.915 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:54:36.930 INFO:teuthology.orchestra.run.smithi103:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-04-22T13:54:36.999 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-04-22T13:54:36.999 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:54:37.013 INFO:teuthology.orchestra.run.smithi086:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-04-22T13:54:37.081 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-04-22T13:54:37.081 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2020-04-22T13:54:37.082 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:54:37.095 INFO:teuthology.orchestra.run.smithi103:> sudo /usr/sbin/setenforce permissive 2020-04-22T13:54:37.172 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:54:37.186 INFO:teuthology.orchestra.run.smithi086:> sudo /usr/sbin/setenforce permissive 2020-04-22T13:54:37.258 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2020-04-22T13:54:37.277 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated; assuming it is current 2020-04-22T13:54:37.278 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2020-04-22T13:54:37.296 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2020-04-22T13:54:37.299 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi103.front.sepia.ceph.com,smithi086.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2020-04-22T13:54:37.653 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2020-04-22T13:54:38.812 INFO:teuthology.task.ansible.out: [WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2020-04-22T13:54:41.954 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2020-04-22T13:54:41.971 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:54:41 +0000 (0:00:00.063) 0:00:00.063 ******* 2020-04-22T13:54:41.983 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:54:41 +0000 (0:00:00.011) 0:00:00.074 ******* 2020-04-22T13:54:44.437 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi086.front.sepia.ceph.com] 2020-04-22T13:54:44.461 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] 2020-04-22T13:54:44.566 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:54:44 +0000 (0:00:02.577) 0:00:02.651 ******* 2020-04-22T13:54:44.592 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:54:44 +0000 (0:00:00.031) 0:00:02.683 ******* 2020-04-22T13:54:44.892 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2020-04-22T13:54:44.893 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-04-22T13:54:44.938 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:54:44 +0000 (0:00:00.346) 0:00:03.030 ******* 2020-04-22T13:54:44.944 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-04-22T13:54:44.980 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:54:44 +0000 (0:00:00.041) 0:00:03.072 ******* 2020-04-22T13:54:45.546 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2020-04-22T13:54:45.547 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-04-22T13:54:45.548 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-04-22T13:54:45.592 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:54:45 +0000 (0:00:00.612) 0:00:03.684 ******* 2020-04-22T13:54:45.633 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:54:45 +0000 (0:00:00.040) 0:00:03.724 ******* 2020-04-22T13:54:45.637 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2020-04-22T13:54:45.641 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:54:45.678 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:54:45 +0000 (0:00:00.046) 0:00:03.770 ******* 2020-04-22T13:54:45.685 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:54:45.727 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:54:45 +0000 (0:00:00.048) 0:00:03.818 ******* 2020-04-22T13:54:46.037 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2020-04-22T13:54:46.039 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} ok: [smithi086.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-22T13:54:46.088 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:54:46 +0000 (0:00:00.361) 0:00:04.179 ******* 2020-04-22T13:54:46.124 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:54:46 +0000 (0:00:00.035) 0:00:04.215 ******* 2020-04-22T13:54:47.108 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2020-04-22T13:54:47.109 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1587563686.1-123923364570336/source", "state": "file", "uid": 0} changed: [smithi103.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1587563686.14-108113172095789/source", "state": "file", "uid": 0} 2020-04-22T13:54:47.149 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:54:47 +0000 (0:00:01.025) 0:00:05.240 ******* 2020-04-22T13:54:47.186 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:54:47 +0000 (0:00:00.036) 0:00:05.277 ******* 2020-04-22T13:54:47.859 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtC 2020-04-22T13:54:47.861 INFO:teuthology.task.ansible.out:toHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1 2020-04-22T13:54:47.862 INFO:teuthology.task.ansible.out:cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P 2020-04-22T13:54:47.863 INFO:teuthology.task.ansible.out:2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-04-22T13:54:48.014 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2020-04-22T13:54:48.019 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2020-04-22T13:54:48.205 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:54:48 +0000 (0:00:01.019) 0:00:06.296 ******* 2020-04-22T13:54:48.238 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:54:48 +0000 (0:00:00.033) 0:00:06.329 ******* 2020-04-22T13:54:48.848 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2020-04-22T13:54:48.850 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] 2020-04-22T13:54:48.936 INFO:teuthology.task.ansible.out: [WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. Wednesday 22 April 2020 13:54:48 +0000 (0:00:00.697) 0:00:07.027 ******* 2020-04-22T13:54:48.948 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] 2020-04-22T13:54:49.041 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:54:49 +0000 (0:00:00.104) 0:00:07.132 ******* 2020-04-22T13:54:49.609 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2020-04-22T13:54:49.610 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.237975", "end": "2020-04-22 13:54:49.580992", "rc": 0, "start": "2020-04-22 13:54:49.343017", "stderr": "", "stderr_lines": [], "stdout": "6c6e94be874b2e32f2708dec8d44a0e25f99b226", "stdout_lines": ["6c6e94be874b2e32f2708dec8d44a0e25f99b226"]} 2020-04-22T13:54:49.649 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:54:49 +0000 (0:00:00.607) 0:00:07.739 ******* 2020-04-22T13:54:49.655 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.247976", "end": "2020-04-22 13:54:49.596841", "rc": 0, "start": "2020-04-22 13:54:49.348865", "stderr": "", "stderr_lines": [], "stdout": "6c6e94be874b2e32f2708dec8d44a0e25f99b226", "stdout_lines": ["6c6e94be874b2e32f2708dec8d44a0e25f99b226"]} 2020-04-22T13:54:49.693 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:54:49 +0000 (0:00:00.044) 0:00:07.784 ******* 2020-04-22T13:54:49.881 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-04-22T13:54:49.883 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.014004", "end": "2020-04-22 13:54:49.847019", "failed_when_result": false, "rc": 0, "start": "2020-04-22 13:54:49.833015", "stderr": "", "stderr_lines": [], "stdout": "f5045e16501fc514de59d088aafd14d076981fdf", "stdout_lines": ["f5045e16501fc514de59d088aafd14d076981fdf"]} 2020-04-22T13:54:49.929 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:54:49 +0000 (0:00:00.236) 0:00:08.020 ******* 2020-04-22T13:54:49.946 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.011924", "end": "2020-04-22 13:54:49.914865", "failed_when_result": false, "rc": 0, "start": "2020-04-22 13:54:49.902941", "stderr": "", "stderr_lines": [], "stdout": "f5045e16501fc514de59d088aafd14d076981fdf", "stdout_lines": ["f5045e16501fc514de59d088aafd14d076981fdf"]} 2020-04-22T13:54:49.988 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:54:49 +0000 (0:00:00.059) 0:00:08.079 ******* 2020-04-22T13:54:49.994 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-04-22T13:54:49.994 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:54:50.047 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:54:50 +0000 (0:00:00.059) 0:00:08.139 ******* 2020-04-22T13:54:50.053 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:54:50.091 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:54:50 +0000 (0:00:00.043) 0:00:08.183 ******* 2020-04-22T13:54:50.096 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-04-22T13:54:50.098 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:54:50.137 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:54:50 +0000 (0:00:00.044) 0:00:08.227 ******* 2020-04-22T13:54:50.142 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:54:50.181 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:54:50 +0000 (0:00:00.045) 0:00:08.272 ******* 2020-04-22T13:54:50.186 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-04-22T13:54:50.187 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:54:50.226 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:54:50 +0000 (0:00:00.044) 0:00:08.317 ******* 2020-04-22T13:54:50.235 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:54:50.270 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:54:50 +0000 (0:00:00.044) 0:00:08.362 ******* 2020-04-22T13:54:50.276 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-04-22T13:54:50.276 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:54:50.316 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:54:50 +0000 (0:00:00.044) 0:00:08.407 ******* 2020-04-22T13:54:50.321 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:54:50.361 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:54:50 +0000 (0:00:00.045) 0:00:08.452 ******* 2020-04-22T13:54:50.366 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2020-04-22T13:54:50.366 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:54:50.406 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:54:50 +0000 (0:00:00.044) 0:00:08.497 ******* 2020-04-22T13:54:50.413 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:54:50.451 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:54:50 +0000 (0:00:00.044) 0:00:08.542 ******* 2020-04-22T13:54:50.615 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-04-22T13:54:50.630 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-22T13:54:50.653 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:54:50 +0000 (0:00:00.201) 0:00:08.744 ******* 2020-04-22T13:54:50.661 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-22T13:54:50.712 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:54:50 +0000 (0:00:00.059) 0:00:08.803 ******* 2020-04-22T13:54:50.894 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-04-22T13:54:50.894 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2020-04-22T13:54:50.958 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2020-04-22T13:54:51.097 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2020-04-22T13:54:51.162 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2020-04-22T13:54:51.315 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2020-04-22T13:54:51.358 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2020-04-22T13:54:51.496 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2020-04-22T13:54:51.577 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2020-04-22T13:54:51.703 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2020-04-22T13:54:51.774 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2020-04-22T13:54:51.901 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2020-04-22T13:54:51.992 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2020-04-22T13:54:52.101 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2020-04-22T13:54:52.205 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2020-04-22T13:54:52.300 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9', u'name': u'jcaratzas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2020-04-22T13:54:52.406 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9', u'name': u'jcaratzas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2020-04-22T13:54:52.501 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2020-04-22T13:54:52.609 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2020-04-22T13:54:52.713 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2020-04-22T13:54:52.819 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2020-04-22T13:54:52.924 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2020-04-22T13:54:53.032 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2020-04-22T13:54:53.121 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2020-04-22T13:54:53.229 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2020-04-22T13:54:53.316 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2020-04-22T13:54:53.429 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2020-04-22T13:54:53.521 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2020-04-22T13:54:53.630 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2020-04-22T13:54:53.725 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2020-04-22T13:54:53.842 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2020-04-22T13:54:53.924 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2020-04-22T13:54:54.036 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2020-04-22T13:54:54.132 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2020-04-22T13:54:54.238 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2020-04-22T13:54:54.353 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2020-04-22T13:54:54.455 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2020-04-22T13:54:54.556 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed', u'name': u'cmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2020-04-22T13:54:54.656 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed', u'name': u'cmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2020-04-22T13:54:54.763 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2020-04-22T13:54:54.860 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2020-04-22T13:54:54.961 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2020-04-22T13:54:55.067 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2020-04-22T13:54:55.166 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1122} 2020-04-22T13:54:55.268 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1122} 2020-04-22T13:54:55.355 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2020-04-22T13:54:55.473 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2020-04-22T13:54:55.562 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2020-04-22T13:54:55.680 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2020-04-22T13:54:55.763 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2020-04-22T13:54:55.882 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2020-04-22T13:54:55.982 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2020-04-22T13:54:56.077 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2020-04-22T13:54:56.172 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2020-04-22T13:54:56.287 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2020-04-22T13:54:56.380 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2020-04-22T13:54:56.486 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2020-04-22T13:54:56.583 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2020-04-22T13:54:56.698 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2020-04-22T13:54:56.793 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2020-04-22T13:54:56.890 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2020-04-22T13:54:57.001 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2020-04-22T13:54:57.096 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2020-04-22T13:54:57.224 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2020-04-22T13:54:57.307 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2020-04-22T13:54:57.411 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2020-04-22T13:54:57.497 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2020-04-22T13:54:57.605 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2020-04-22T13:54:57.702 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2020-04-22T13:54:57.804 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2020-04-22T13:54:57.909 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2020-04-22T13:54:58.019 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2020-04-22T13:54:58.115 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2020-04-22T13:54:58.221 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2020-04-22T13:54:58.327 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2020-04-22T13:54:58.427 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2020-04-22T13:54:58.524 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2020-04-22T13:54:58.647 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2020-04-22T13:54:58.724 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2020-04-22T13:54:58.849 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-04-22T13:54:58.928 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-04-22T13:54:59.046 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2020-04-22T13:54:59.134 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2020-04-22T13:54:59.260 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2020-04-22T13:54:59.324 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2020-04-22T13:54:59.461 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2020-04-22T13:54:59.529 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2020-04-22T13:54:59.674 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2020-04-22T13:54:59.736 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2020-04-22T13:54:59.864 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2020-04-22T13:54:59.939 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2020-04-22T13:55:00.080 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2020-04-22T13:55:00.140 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2020-04-22T13:55:00.300 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2020-04-22T13:55:00.353 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2020-04-22T13:55:00.507 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-04-22T13:55:00.548 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-04-22T13:55:00.706 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2020-04-22T13:55:00.759 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2020-04-22T13:55:00.906 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2020-04-22T13:55:00.964 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2020-04-22T13:55:01.111 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2020-04-22T13:55:01.164 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2020-04-22T13:55:01.302 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2020-04-22T13:55:01.379 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2020-04-22T13:55:01.509 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2020-04-22T13:55:01.575 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2020-04-22T13:55:01.716 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2020-04-22T13:55:01.788 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2020-04-22T13:55:01.915 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2020-04-22T13:55:01.992 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2020-04-22T13:55:02.130 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2020-04-22T13:55:02.213 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2020-04-22T13:55:02.336 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2020-04-22T13:55:02.411 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2020-04-22T13:55:02.552 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2020-04-22T13:55:02.606 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2020-04-22T13:55:02.746 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2020-04-22T13:55:02.811 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2020-04-22T13:55:02.953 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2020-04-22T13:55:03.009 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2020-04-22T13:55:03.160 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2020-04-22T13:55:03.213 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2020-04-22T13:55:03.350 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2020-04-22T13:55:03.427 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2020-04-22T13:55:03.551 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2020-04-22T13:55:03.618 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2020-04-22T13:55:03.765 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2020-04-22T13:55:03.814 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2020-04-22T13:55:03.966 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-04-22T13:55:04.021 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-04-22T13:55:04.178 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2020-04-22T13:55:04.222 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2020-04-22T13:55:04.372 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2020-04-22T13:55:04.417 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2020-04-22T13:55:04.576 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2020-04-22T13:55:04.630 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2020-04-22T13:55:04.775 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2020-04-22T13:55:04.840 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2020-04-22T13:55:04.975 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2020-04-22T13:55:05.029 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2020-04-22T13:55:05.191 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2020-04-22T13:55:05.243 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2020-04-22T13:55:05.389 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2020-04-22T13:55:05.443 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2020-04-22T13:55:05.581 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2020-04-22T13:55:05.648 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2020-04-22T13:55:05.806 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2020-04-22T13:55:05.859 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2020-04-22T13:55:06.010 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2020-04-22T13:55:06.063 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2020-04-22T13:55:06.213 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2020-04-22T13:55:06.276 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2020-04-22T13:55:06.412 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2020-04-22T13:55:06.504 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2020-04-22T13:55:06.610 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2020-04-22T13:55:06.698 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2020-04-22T13:55:06.814 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2020-04-22T13:55:07.020 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2020-04-22T13:55:07.075 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2020-04-22T13:55:07.262 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2020-04-22T13:55:07.370 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2020-04-22T13:55:07.473 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2020-04-22T13:55:07.565 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2020-04-22T13:55:07.678 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2020-04-22T13:55:07.767 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2020-04-22T13:55:07.882 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2020-04-22T13:55:07.968 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2020-04-22T13:55:08.088 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2020-04-22T13:55:08.188 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2020-04-22T13:55:08.293 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2020-04-22T13:55:08.397 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2020-04-22T13:55:08.484 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2020-04-22T13:55:08.595 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2020-04-22T13:55:08.693 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2020-04-22T13:55:08.792 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2020-04-22T13:55:08.886 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2020-04-22T13:55:08.981 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2020-04-22T13:55:09.088 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2020-04-22T13:55:09.181 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2020-04-22T13:55:09.291 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2020-04-22T13:55:09.381 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2020-04-22T13:55:09.493 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2020-04-22T13:55:09.588 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2020-04-22T13:55:09.688 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2020-04-22T13:55:09.794 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2020-04-22T13:55:09.889 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2020-04-22T13:55:09.991 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2020-04-22T13:55:10.100 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2020-04-22T13:55:10.195 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2020-04-22T13:55:10.289 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2020-04-22T13:55:10.391 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2020-04-22T13:55:10.508 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2020-04-22T13:55:10.598 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2020-04-22T13:55:10.725 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2020-04-22T13:55:10.799 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2020-04-22T13:55:10.915 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2020-04-22T13:55:10.989 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2020-04-22T13:55:11.105 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2020-04-22T13:55:11.192 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2020-04-22T13:55:11.308 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2020-04-22T13:55:11.393 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2020-04-22T13:55:11.509 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2020-04-22T13:55:11.594 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2020-04-22T13:55:11.710 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2020-04-22T13:55:11.794 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-04-22T13:55:11.911 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-04-22T13:55:12.013 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2020-04-22T13:55:12.128 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2020-04-22T13:55:12.203 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2020-04-22T13:55:12.342 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2020-04-22T13:55:12.402 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2020-04-22T13:55:12.541 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2020-04-22T13:55:12.603 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1205} 2020-04-22T13:55:12.753 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1205} 2020-04-22T13:55:12.806 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1206} 2020-04-22T13:55:12.947 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1206} 2020-04-22T13:55:13.024 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1207} 2020-04-22T13:55:13.154 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1207} 2020-04-22T13:55:13.224 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1208} 2020-04-22T13:55:13.373 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1208} 2020-04-22T13:55:13.430 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1209} 2020-04-22T13:55:13.581 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1209} 2020-04-22T13:55:13.624 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034', u'name': u'khiremat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1210} 2020-04-22T13:55:13.780 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034', u'name': u'khiremat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1210} 2020-04-22T13:55:13.844 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0', u'name': u'kapandya'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1211} 2020-04-22T13:55:13.993 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0', u'name': u'kapandya'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1211} 2020-04-22T13:55:14.049 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89', u'name': u'prasad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1212} 2020-04-22T13:55:14.221 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89', u'name': u'prasad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1212} 2020-04-22T13:55:15.604 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f', u'name': u'vikhyat'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10102, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2020-04-22T13:55:15.777 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:55:15 +0000 (0:00:25.062) 0:00:33.866 ******* 2020-04-22T13:55:15.785 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f', u'name': u'vikhyat'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10102, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2020-04-22T13:55:15.881 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-04-22T13:55:15.917 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:55:15 +0000 (0:00:00.142) 0:00:34.009 ******* 2020-04-22T13:55:15.952 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:55:15 +0000 (0:00:00.034) 0:00:34.043 ******* 2020-04-22T13:55:15.974 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-04-22T13:55:15.978 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 2020-04-22T13:55:15.979 INFO:teuthology.task.ansible.out: 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAx 2020-04-22T13:55:15.981 INFO:teuthology.task.ansible.out:j+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8ea 2020-04-22T13:55:15.990 INFO:teuthology.task.ansible.out:c8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f261 2020-04-22T13:55:15.992 INFO:teuthology.task.ansible.out:02d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomai 2020-04-22T13:55:15.993 INFO:teuthology.task.ansible.out:wang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redha 2020-04-22T13:55:15.994 INFO:teuthology.task.ansible.out:t.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {" 2020-04-22T13:55:15.995 INFO:teuthology.task.ansible.out:name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMiv 2020-04-22T13:55:15.996 INFO:teuthology.task.ansible.out:DNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "beng 2020-04-22T13:55:15.997 INFO:teuthology.task.ansible.out:land@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name" 2020-04-22T13:55:15.999 INFO:teuthology.task.ansible.out:: "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643 2020-04-22T13:55:16.000 INFO:teuthology.task.ansible.out:eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dc 2020-04-22T13:55:16.003 INFO:teuthology.task.ansible.out:d91f9034"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}]}, "changed": false} 2020-04-22T13:55:16.005 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-04-22T13:55:16.045 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:55:16 +0000 (0:00:00.092) 0:00:34.136 ******* 2020-04-22T13:55:16.081 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:55:16 +0000 (0:00:00.036) 0:00:34.172 ******* 2020-04-22T13:55:16.143 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-04-22T13:55:16.146 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 2020-04-22T13:55:16.148 INFO:teuthology.task.ansible.out: 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAx 2020-04-22T13:55:16.149 INFO:teuthology.task.ansible.out:j+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8ea 2020-04-22T13:55:16.151 INFO:teuthology.task.ansible.out:c8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f261 2020-04-22T13:55:16.152 INFO:teuthology.task.ansible.out:02d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomai 2020-04-22T13:55:16.154 INFO:teuthology.task.ansible.out:wang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redha 2020-04-22T13:55:16.155 INFO:teuthology.task.ansible.out:t.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {" 2020-04-22T13:55:16.157 INFO:teuthology.task.ansible.out:name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", 2020-04-22T13:55:16.165 INFO:teuthology.task.ansible.out:"ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawb 2020-04-22T13:55:16.166 INFO:teuthology.task.ansible.out:erryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037 2020-04-22T13:55:16.168 INFO:teuthology.task.ansible.out:bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad Uw1J 2020-04-22T13:55:16.170 INFO:teuthology.task.ansible.out:Hj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}]}, "changed": false} 2020-04-22T13:55:16.205 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:55:16 +0000 (0:00:00.123) 0:00:34.296 ******* 2020-04-22T13:55:17.041 INFO:teuthology.task.ansible.out:FAILED - RETRYING: Clone the keys repo (5 retries left). 2020-04-22T13:55:17.052 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-04-22T13:55:17.054 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com -> localhost] => {"after": "6c6e94be874b2e32f2708dec8d44a0e25f99b226", "attempts": 1, "before": "6c6e94be874b2e32f2708dec8d44a0e25f99b226", "changed": false, "remote_url_changed": false} 2020-04-22T13:55:17.119 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:55:17 +0000 (0:00:00.914) 0:00:35.210 ******* 2020-04-22T13:55:17.480 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-04-22T13:55:17.482 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2020-04-22T13:55:17.785 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2020-04-22T13:55:18.064 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2020-04-22T13:55:18.344 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqB 2020-04-22T13:55:18.345 INFO:teuthology.task.ansible.out:ZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2020-04-22T13:55:18.626 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2020-04-22T13:55:18.908 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2020-04-22T13:55:18.910 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2020-04-22T13:55:19.195 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2020-04-22T13:55:19.467 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9', u'name': u'jcaratzas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2020-04-22T13:55:19.750 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2020-04-22T13:55:19.761 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:20.046 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2020-04-22T13:55:20.047 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2020-04-22T13:55:20.057 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:20.069 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:20.070 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:20.374 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2020-04-22T13:55:20.667 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2020-04-22T13:55:20.669 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2020-04-22T13:55:20.951 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2020-04-22T13:55:21.237 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2020-04-22T13:55:21.526 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed', u'name': u'cmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2020-04-22T13:55:21.805 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2020-04-22T13:55:22.210 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2020-04-22T13:55:22.491 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2020-04-22T13:55:22.774 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhw 2020-04-22T13:55:22.776 INFO:teuthology.task.ansible.out:s1Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2020-04-22T13:55:23.067 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2020-04-22T13:55:23.068 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2020-04-22T13:55:23.342 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2020-04-22T13:55:23.634 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2020-04-22T13:55:23.923 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2020-04-22T13:55:23.925 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2020-04-22T13:55:24.196 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2020-04-22T13:55:24.494 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2020-04-22T13:55:24.776 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2020-04-22T13:55:25.057 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2020-04-22T13:55:25.348 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2020-04-22T13:55:25.651 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2020-04-22T13:55:25.652 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2020-04-22T13:55:25.942 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2020-04-22T13:55:26.226 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2020-04-22T13:55:26.513 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2020-04-22T13:55:26.796 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2020-04-22T13:55:27.077 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2020-04-22T13:55:27.380 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2020-04-22T13:55:27.667 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-04-22T13:55:27.690 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-04-22T13:55:27.691 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com -> localhost] => {"after": "6c6e94be874b2e32f2708dec8d44a0e25f99b226", "attempts": 2, "before": "6c6e94be874b2e32f2708dec8d44a0e25f99b226", "changed": false, "remote_url_changed": false} 2020-04-22T13:55:27.766 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:55:27 +0000 (0:00:10.647) 0:00:45.858 ******* 2020-04-22T13:55:27.956 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-04-22T13:55:27.957 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2020-04-22T13:55:28.148 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2020-04-22T13:55:28.232 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2020-04-22T13:55:28.448 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2020-04-22T13:55:28.535 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2020-04-22T13:55:28.537 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2020-04-22T13:55:28.735 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2020-04-22T13:55:28.851 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2020-04-22T13:55:28.853 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2020-04-22T13:55:29.020 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqB 2020-04-22T13:55:29.022 INFO:teuthology.task.ansible.out:ZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2020-04-22T13:55:29.135 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2020-04-22T13:55:29.314 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2020-04-22T13:55:29.413 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2020-04-22T13:55:29.589 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2020-04-22T13:55:29.590 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2020-04-22T13:55:29.706 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2020-04-22T13:55:29.872 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2020-04-22T13:55:29.984 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2020-04-22T13:55:29.992 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-04-22T13:55:30.175 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9', u'name': u'jcaratzas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2020-04-22T13:55:30.281 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2020-04-22T13:55:30.282 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2020-04-22T13:55:30.286 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2020-04-22T13:55:30.461 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2020-04-22T13:55:30.472 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:30.578 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2020-04-22T13:55:30.746 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2020-04-22T13:55:30.747 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2020-04-22T13:55:30.757 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:30.793 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:30.795 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:30.853 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2020-04-22T13:55:31.095 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2020-04-22T13:55:31.164 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2020-04-22T13:55:31.380 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2020-04-22T13:55:31.381 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2020-04-22T13:55:31.447 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2020-04-22T13:55:31.660 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2020-04-22T13:55:31.723 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2020-04-22T13:55:32.009 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/ 2020-04-22T13:55:32.011 INFO:teuthology.task.ansible.out:home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2020-04-22T13:55:32.080 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2020-04-22T13:55:32.302 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2020-04-22T13:55:32.372 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed', u'name': u'cmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2020-04-22T13:55:32.586 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2020-04-22T13:55:32.668 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2020-04-22T13:55:32.873 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2020-04-22T13:55:32.874 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2020-04-22T13:55:32.968 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2020-04-22T13:55:33.157 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2020-04-22T13:55:33.252 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2020-04-22T13:55:33.454 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2020-04-22T13:55:33.539 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhw 2020-04-22T13:55:33.540 INFO:teuthology.task.ansible.out:s1Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2020-04-22T13:55:33.749 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2020-04-22T13:55:33.751 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2020-04-22T13:55:33.854 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2020-04-22T13:55:33.856 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2020-04-22T13:55:34.034 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2020-04-22T13:55:34.130 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2020-04-22T13:55:34.318 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2020-04-22T13:55:34.426 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2020-04-22T13:55:34.607 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2020-04-22T13:55:34.745 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2020-04-22T13:55:34.746 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2020-04-22T13:55:34.894 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-04-22T13:55:35.034 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2020-04-22T13:55:35.162 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2020-04-22T13:55:35.310 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2020-04-22T13:55:35.456 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2020-04-22T13:55:35.614 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2020-04-22T13:55:35.735 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2020-04-22T13:55:35.905 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2020-04-22T13:55:36.019 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2020-04-22T13:55:36.187 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2020-04-22T13:55:36.300 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2020-04-22T13:55:36.510 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2020-04-22T13:55:36.516 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2020-04-22T13:55:36.593 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2020-04-22T13:55:36.787 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2020-04-22T13:55:36.882 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2020-04-22T13:55:37.072 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2020-04-22T13:55:37.176 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2020-04-22T13:55:37.367 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2020-04-22T13:55:37.450 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2020-04-22T13:55:37.654 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2020-04-22T13:55:37.733 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2020-04-22T13:55:37.950 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2020-04-22T13:55:38.015 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2020-04-22T13:55:38.224 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2020-04-22T13:55:38.298 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2020-04-22T13:55:38.507 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-04-22T13:55:38.591 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2020-04-22T13:55:38.797 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2020-04-22T13:55:38.882 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2020-04-22T13:55:39.080 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2020-04-22T13:55:39.164 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2020-04-22T13:55:39.367 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2020-04-22T13:55:39.369 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2020-04-22T13:55:39.452 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2020-04-22T13:55:39.668 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2020-04-22T13:55:39.670 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2020-04-22T13:55:39.743 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2020-04-22T13:55:39.955 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2020-04-22T13:55:40.046 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2020-04-22T13:55:40.269 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2020-04-22T13:55:40.328 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2020-04-22T13:55:40.567 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2020-04-22T13:55:40.611 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2020-04-22T13:55:40.857 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2020-04-22T13:55:40.859 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-04-22T13:55:40.901 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2020-04-22T13:55:41.146 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2020-04-22T13:55:41.148 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2020-04-22T13:55:41.149 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2020-04-22T13:55:41.198 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2020-04-22T13:55:41.200 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2020-04-22T13:55:41.443 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2020-04-22T13:55:41.486 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2020-04-22T13:55:41.487 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2020-04-22T13:55:41.727 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2020-04-22T13:55:41.790 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2020-04-22T13:55:42.011 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2020-04-22T13:55:42.064 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2020-04-22T13:55:42.308 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2020-04-22T13:55:42.361 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2020-04-22T13:55:42.582 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2020-04-22T13:55:42.636 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2020-04-22T13:55:42.866 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/ 2020-04-22T13:55:42.868 INFO:teuthology.task.ansible.out:home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2020-04-22T13:55:42.922 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2020-04-22T13:55:43.150 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2020-04-22T13:55:43.224 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2020-04-22T13:55:43.449 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2020-04-22T13:55:43.503 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2020-04-22T13:55:43.733 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2020-04-22T13:55:43.735 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2020-04-22T13:55:43.778 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2020-04-22T13:55:44.026 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2020-04-22T13:55:44.079 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2020-04-22T13:55:44.311 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2020-04-22T13:55:44.344 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2020-04-22T13:55:44.613 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2020-04-22T13:55:44.614 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2020-04-22T13:55:44.624 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2020-04-22T13:55:44.889 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2020-04-22T13:55:44.914 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2020-04-22T13:55:45.170 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2020-04-22T13:55:45.192 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2020-04-22T13:55:45.454 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2020-04-22T13:55:45.476 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2020-04-22T13:55:45.747 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-04-22T13:55:45.769 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_key 2020-04-22T13:55:45.771 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-04-22T13:55:46.032 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2020-04-22T13:55:46.091 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2020-04-22T13:55:46.312 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2020-04-22T13:55:46.381 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2020-04-22T13:55:46.596 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2020-04-22T13:55:46.673 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2020-04-22T13:55:46.875 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2020-04-22T13:55:46.958 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2020-04-22T13:55:47.166 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2020-04-22T13:55:47.237 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzVa77kg0qGGE3IpMZgSYJ+UwQiDEOg3Lji470V/sQ/R7g6/v7FZpaYqGn1wG3XeUp2gGACxNKLQfGV9EGU66NvfQYqn9A8dXRpTpZuGWN8EcKK98YrSAq0s0WzeiEzVT86RHzVHIqL6/Zn4B1p9sIeY9Hb+bfKOdtYkRBDoFELtiMRzHPFaiIJFnXl+EhH8wceYqXVNNvCuOUBMnOiDYLDtujvYdPt+ff7rvXuOzbwcAKoINFM1C4FtoUEYriKlsxJ2rr7AblfDm/WIrCZcqRBU4JcudtvZOtHhvN4uL6WgzuzuhIQFyePAeIHFUn6AiwKC/MApq7z1Qj+N3pN/Nz xiubli@fedora1", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2020-04-22T13:55:47.446 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2020-04-22T13:55:47.536 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2020-04-22T13:55:47.746 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2020-04-22T13:55:47.830 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2020-04-22T13:55:48.029 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2020-04-22T13:55:48.148 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHZ739LVtNJVfcdnwYl7dwvPpC96dHxSn7UlRIzvSbBid0B+pMxE9OZv0UlyvDe737oPZthZYrAaeicKHO9p5aQwbhhIGImvm85sd1YxiQC6h6LxebJ6iFbtzMaEQ9SJUJFvUtItc1nQ8aPpY0CkDFWbzNn6ib8AKGTfcA+wsg08eBUJNSKexebHQCLC2c3HlDmRnjSTitl72h5pSgq7vcynhCJDlkJg49YesmNhWm9QNjwih3ITRzzUC5GaQ4uODlOETRmf84J9FDX8fMaRdPl4cZwhfI8q+0T/74Qrg1J82Ska+O5DhhbzFEqBkchYpbgetTPkUNHRbfL/GlK+7/8BKiUW+Fo7NkTDVpVYBaQOQSZEWWiPq04NMLORJ1HiHo7HsT7WI/HcVbt19YWZf7VZgB06p8LAaZsZxLBO/eqtjebOLFmMoEa4UaAepBXKo8O2hddaHjb4WVrEN+bTRUexuyTlZVbeukUky3gI2MfQirP4stmci02OKuvUuP1sM= karan@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2020-04-22T13:55:48.336 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2020-04-22T13:55:48.434 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034', u'name': u'khiremat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2020-04-22T13:55:48.619 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2020-04-22T13:55:48.734 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0', u'name': u'kapandya'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDpzfLLhjb6WlU3D0D26KAzcSgy9FkG1jnU2X6PqvyGuxyqrfDfLRc6d9A/clStS6GmyKfmevMLFr0Qn17FbPguZJ98Cnx4WwTyRyDSY6M4aoHdhKJgX6zGF7EJxCgb4gJdzlVO8uWD9k1ULV5ShS6z24rkjmxtX8Q/nkDa7w6XThLXQHPXmEJZ7ZsURaMwU+A5K0Mun/RO9W1TRKBzqspvb8D8q/o5R1T4Y6nSgMI8c3fbiuikaMogbPFTzjp154VNBD08kqTpi6JFgWUbhp6Cgpi9NJprsaPLvf1hOBnPvMENy+hkLE7TKnOqFPW6NglbB7igLOlLdqZgNfalX+XSkklZgqrJX/8/eXgGAKE4AvPDerAbBd2X9H2I5P84o5Rs8cDw2vmV5zPPT0SOJP+Ge8eXanekbVxbNI3UrrEEj/o3vQz2/ng1EpknlySpy8FIEDKF1qZ/M9Gku0RcquEZTYsUlGkxl1RYh6VhSp2W6QSeAl4B8CUedv4zQ0Cqr18= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2020-04-22T13:55:48.907 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2020-04-22T13:55:49.017 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89', u'name': u'prasad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2020-04-22T13:55:49.189 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2020-04-22T13:55:49.316 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f', u'name': u'vikhyat'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2020-04-22T13:55:49.408 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:55:49 +0000 (0:00:21.641) 0:01:07.499 ******* 2020-04-22T13:55:49.468 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2020-04-22T13:55:49.586 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-04-22T13:55:49.587 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:49.597 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:49.608 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:49.619 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:49.619 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:49.630 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:49.641 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:49.652 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9', u'name': u'jcaratzas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:49.663 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:49.778 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-04-22T13:55:49.780 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2020-04-22T13:55:49.967 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-04-22T13:55:49.969 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2020-04-22T13:55:49.979 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:50.067 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-04-22T13:55:50.069 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2020-04-22T13:55:50.253 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2020-04-22T13:55:50.350 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-04-22T13:55:50.351 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2020-04-22T13:55:50.530 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2020-04-22T13:55:50.639 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-04-22T13:55:50.640 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2020-04-22T13:55:50.818 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2020-04-22T13:55:50.828 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:50.839 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:50.850 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:50.862 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:50.873 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed', u'name': u'cmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:50.886 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:50.905 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:50.906 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:50.917 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:50.928 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:50.940 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:50.941 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-04-22T13:55:50.941 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2020-04-22T13:55:50.954 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:50.964 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:50.975 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:50.975 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:50.986 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.002 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.003 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.014 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.014 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.029 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.043 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.043 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.171 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.182 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.183 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.185 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.185 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.185 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.186 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.188 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.189 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.190 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.191 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.201 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.212 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.213 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.224 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-04-22T13:55:51.224 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2020-04-22T13:55:51.226 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.236 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.238 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.249 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.259 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.270 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.281 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.282 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.293 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.304 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.321 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.336 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.337 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.348 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.369 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.371 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.381 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.392 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.403 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.414 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.415 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.426 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.437 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.450 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.461 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.474 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.478 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.484 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.496 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.506 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-04-22T13:55:51.507 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.518 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.519 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.530 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.541 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.552 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.563 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.578 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.579 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.590 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.601 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.612 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.613 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.624 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.635 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.646 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.647 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.680 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.681 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.692 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.703 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.714 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.727 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.728 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.748 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.749 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034', u'name': u'khiremat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.760 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0', u'name': u'kapandya'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.771 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89', u'name': u'prasad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.782 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'ovpn': u'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f', u'name': u'vikhyat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.802 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-04-22T13:55:51.803 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2020-04-22T13:55:51.845 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:55:51 +0000 (0:00:02.433) 0:01:09.933 ******* 2020-04-22T13:55:51.870 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-04-22T13:55:51.872 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:55:51.926 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:55:51 +0000 (0:00:00.084) 0:01:10.018 ******* 2020-04-22T13:55:52.075 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZ 2020-04-22T13:55:52.077 INFO:teuthology.task.ansible.out:ICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.localdomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2020-04-22T13:55:52.182 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi086.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2020-04-22T13:55:52.366 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-04-22T13:55:52.368 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a 2020-04-22T13:55:52.370 INFO:teuthology.task.ansible.out:15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi086.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, 2020-04-22T13:55:52.371 INFO:teuthology.task.ansible.out: "item": "aschoen", "name": "aschoen", "state": "absent"} 2020-04-22T13:55:52.572 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2020-04-22T13:55:52.646 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2020-04-22T13:55:52.765 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi086.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2020-04-22T13:55:52.941 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-04-22T13:55:52.942 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2020-04-22T13:55:52.973 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-22T13:55:52.975 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2020-04-22T13:55:53.163 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2020-04-22T13:55:53.230 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-04-22T13:55:53.232 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2020-04-22T13:55:53.364 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-22T13:55:53.366 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2020-04-22T13:55:53.526 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-04-22T13:55:53.527 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2020-04-22T13:55:53.561 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-22T13:55:53.562 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2020-04-22T13:55:53.751 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2020-04-22T13:55:53.810 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-04-22T13:55:53.812 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2020-04-22T13:55:53.958 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-22T13:55:53.960 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2020-04-22T13:55:54.095 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-04-22T13:55:54.097 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2020-04-22T13:55:54.159 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-22T13:55:54.161 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2020-04-22T13:55:54.356 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2020-04-22T13:55:54.388 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-04-22T13:55:54.390 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2020-04-22T13:55:54.557 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-22T13:55:54.558 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2020-04-22T13:55:54.673 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-04-22T13:55:54.675 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2020-04-22T13:55:54.758 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-22T13:55:54.760 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2020-04-22T13:55:54.958 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2020-04-22T13:55:54.969 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-04-22T13:55:54.970 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2020-04-22T13:55:55.159 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-22T13:55:55.161 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2020-04-22T13:55:55.267 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-04-22T13:55:55.269 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2020-04-22T13:55:55.357 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-22T13:55:55.359 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2020-04-22T13:55:55.556 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2020-04-22T13:55:55.558 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-04-22T13:55:55.558 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2020-04-22T13:55:55.757 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-22T13:55:55.759 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2020-04-22T13:55:55.865 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2020-04-22T13:55:55.957 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-22T13:55:55.959 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2020-04-22T13:55:56.157 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2020-04-22T13:55:56.158 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-04-22T13:55:56.158 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2020-04-22T13:55:56.370 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-22T13:55:56.372 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2020-04-22T13:55:56.466 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-04-22T13:55:56.468 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2020-04-22T13:55:56.556 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-22T13:55:56.558 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2020-04-22T13:55:56.755 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-04-22T13:55:56.756 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_key 2020-04-22T13:55:56.758 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi086.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2020-04-22T13:55:56.964 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2020-04-22T13:55:57.055 INFO:teuthology.task.ansible.out: 2020-04-22T13:55:57.057 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2020-04-22T13:55:57.167 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi086.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2020-04-22T13:55:57.365 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-04-22T13:55:57.365 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2020-04-22T13:55:57.367 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi086.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2020-04-22T13:55:57.566 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2020-04-22T13:55:57.652 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-04-22T13:55:57.653 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2020-04-22T13:55:57.759 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-22T13:55:57.760 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2020-04-22T13:55:57.932 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-04-22T13:55:57.934 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2020-04-22T13:55:57.955 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi086.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2020-04-22T13:55:58.154 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2020-04-22T13:55:58.228 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-04-22T13:55:58.229 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzVa77kg0qGGE3IpMZgSYJ+UwQiDEOg3Lji470V/sQ/R7g6/v7FZpaYqGn1wG3XeUp2gGACxNKLQfGV9EGU66NvfQYqn9A8dXRpTpZuGWN8EcKK98YrSAq0s0WzeiEzVT86RHzVHIqL6/Zn4B1p9sIeY9Hb+bfKOdtYkRBDoFELtiMRzHPFaiIJFnXl+EhH8wceYqXVNNvCuOUBMnOiDYLDtujvYdPt+ff7rvXuOzbwcAKoINFM1C4FtoUEYriKlsxJ2rr7AblfDm/WIrCZcqRBU4JcudtvZOtHhvN4uL6WgzuzuhIQFyePAeIHFUn6AiwKC/MApq7z1Qj+N3pN/Nz xiubli@fedora1", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2020-04-22T13:55:58.345 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-22T13:55:58.347 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2020-04-22T13:55:58.510 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2020-04-22T13:55:58.540 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-22T13:55:58.542 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2020-04-22T13:55:58.749 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2020-04-22T13:55:58.810 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-04-22T13:55:58.811 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2020-04-22T13:55:58.936 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-22T13:55:58.938 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2020-04-22T13:55:59.095 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-04-22T13:55:59.099 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHZ739LVtNJVfcdnwYl7dwvPpC96dHxSn7UlRIzvSbBid0B+pMxE9OZv0UlyvDe737oPZthZYrAaeicKHO9p5aQwbhhIGImvm85sd1YxiQC6h6LxebJ6iFbtzMaEQ9SJUJFvUtItc1nQ8aPpY0CkDFWbzNn6ib8AKGTfcA+wsg08eBUJNSKexebHQCLC2c3HlDmRnjSTitl72h5pSgq7vcynhCJDlkJg49YesmNhWm9QNjwih3ITRzzUC5GaQ4uODlOETRmf84J9FDX8fMaRdPl4cZwhfI8q+0T/74Qrg1J82Ska+O5DhhbzFEqBkchYpbgetTPkUNHRbfL/GlK+7/8BKiUW+Fo7NkTDVpVYBaQOQSZEWWiPq04NMLORJ1HiHo7HsT7WI/HcVbt19YWZf7VZgB06p8LAaZsZxLBO/eqtjebOLFmMoEa4UaAepBXKo8O2hddaHjb4WVrEN+bTRUexuyTlZVbeukUky3gI2MfQirP4stmci02OKuvUuP1sM= karan@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2020-04-22T13:55:59.137 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-22T13:55:59.139 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2020-04-22T13:55:59.342 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2020-04-22T13:55:59.375 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-04-22T13:55:59.375 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034', u'name': u'khiremat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2020-04-22T13:55:59.553 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi086.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2020-04-22T13:55:59.669 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-04-22T13:55:59.670 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0', u'name': u'kapandya'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDpzfLLhjb6WlU3D0D26KAzcSgy9FkG1jnU2X6PqvyGuxyqrfDfLRc6d9A/clStS6GmyKfmevMLFr0Qn17FbPguZJ98Cnx4WwTyRyDSY6M4aoHdhKJgX6zGF7EJxCgb4gJdzlVO8uWD9k1ULV5ShS6z24rkjmxtX8Q/nkDa7w6XThLXQHPXmEJZ7ZsURaMwU+A5K0Mun/RO9W1TRKBzqspvb8D8q/o5R1T4Y6nSgMI8c3fbiuikaMogbPFTzjp154VNBD08kqTpi6JFgWUbhp6Cgpi9NJprsaPLvf1hOBnPvMENy+hkLE7TKnOqFPW6NglbB7igLOlLdqZgNfalX+XSkklZgqrJX/8/eXgGAKE4AvPDerAbBd2X9H2I5P84o5Rs8cDw2vmV5zPPT0SOJP+Ge8eXanekbVxbNI3UrrEEj/o3vQz2/ng1EpknlySpy8FIEDKF1qZ/M9Gku0RcquEZTYsUlGkxl1RYh6VhSp2W6QSeAl4B8CUedv4zQ0Cqr18= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2020-04-22T13:55:59.744 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi086.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2020-04-22T13:55:59.958 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2020-04-22T13:55:59.959 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-04-22T13:55:59.961 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89', u'name': u'prasad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2020-04-22T13:56:00.158 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi086.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2020-04-22T13:56:00.232 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** changed: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f', u'name': u'vikhyat'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2020-04-22T13:56:00.350 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:00 +0000 (0:00:08.423) 0:01:18.441 ******* 2020-04-22T13:56:00.357 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-22T13:56:00.358 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2020-04-22T13:56:00.397 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:00.407 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:00.418 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:00.429 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:00.440 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:00.441 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:00.452 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9', u'name': u'jcaratzas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:00.463 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:00.539 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-22T13:56:00.541 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2020-04-22T13:56:00.611 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:00 +0000 (0:00:00.261) 0:01:18.703 ******* 2020-04-22T13:56:00.756 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2020-04-22T13:56:00.766 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:01.041 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2020-04-22T13:56:01.155 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-04-22T13:56:01.157 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => {"changed": true, "checksum": "f9ee21bf558da16d5cb117fdaf10268934dc9dad", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "32605c31fdd858d7857c5b5571a944e7", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1587563760.63-67147936908867/source", "state": "file", "uid": 0} 2020-04-22T13:56:01.193 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:01 +0000 (0:00:00.581) 0:01:19.284 ******* 2020-04-22T13:56:01.219 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-04-22T13:56:01.221 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => { "msg": "Host smithi086.front.sepia.ceph.com is running RedHat 8.1 (Ootpa)" } 2020-04-22T13:56:01.258 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:01 +0000 (0:00:00.065) 0:01:19.350 ******* 2020-04-22T13:56:01.297 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-04-22T13:56:01.298 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"], "rhsm_repos": ["rhel-8-for-x86_64-baseos-rpms", "rhel-8-for-x86_64-appstream-rpms"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"} 2020-04-22T13:56:01.338 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:01 +0000 (0:00:00.079) 0:01:19.429 ******* 2020-04-22T13:56:01.343 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-04-22T13:56:01.344 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2020-04-22T13:56:01.366 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-04-22T13:56:01.368 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:01.405 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:01 +0000 (0:00:00.067) 0:01:19.496 ******* 2020-04-22T13:56:01.603 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-04-22T13:56:01.604 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2020-04-22T13:56:01.615 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:01.626 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:01.626 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:01.637 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:01.649 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed', u'name': u'cmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:01.659 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:01.674 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.073154", "end": "2020-04-22 13:56:01.651519", "rc": 0, "start": "2020-04-22 13:56:01.578365", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-04-22T13:56:01.724 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:01 +0000 (0:00:00.316) 0:01:19.815 ******* 2020-04-22T13:56:01.730 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-04-22T13:56:01.731 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:01.733 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:01.735 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:01.736 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:01.747 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:01.748 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:01.759 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:01.762 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:01.801 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:01 +0000 (0:00:00.077) 0:01:19.892 ******* 2020-04-22T13:56:01.809 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:01.810 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:01.812 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:01.823 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:01.824 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:01.863 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:01 +0000 (0:00:00.062) 0:01:19.955 ******* 2020-04-22T13:56:01.871 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-04-22T13:56:01.873 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:01.874 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:01.875 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:01.886 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:01.897 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:01.925 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:01 +0000 (0:00:00.061) 0:01:20.017 ******* 2020-04-22T13:56:01.931 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-04-22T13:56:01.932 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:01.933 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:01.935 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:01.948 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:01.956 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-04-22T13:56:01.958 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:01.959 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:01.998 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:01 +0000 (0:00:00.072) 0:01:20.089 ******* 2020-04-22T13:56:02.004 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.006 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.008 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.017 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.019 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.020 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.078 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:02 +0000 (0:00:00.080) 0:01:20.169 ******* 2020-04-22T13:56:02.084 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-04-22T13:56:02.084 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.086 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.088 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.089 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.089 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.100 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.112 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.113 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** ok: [smithi086.front.sepia.ceph.com] => {"ansible_facts": {"entitlements_path": "/etc/ansible/secrets/entitlements.yml"}, "changed": false} 2020-04-22T13:56:02.171 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:02 +0000 (0:00:00.082) 0:01:20.251 ******* TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f8 2020-04-22T13:56:02.174 INFO:teuthology.task.ansible.out:48846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.184 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.215 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.216 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.216 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.217 INFO:teuthology.task.ansible.out: 2020-04-22T13:56:02.218 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** ok: [smithi086.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi086.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-22T13:56:02.219 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.258 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:02 +0000 (0:00:00.098) 0:01:20.350 ******* 2020-04-22T13:56:02.269 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.270 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.272 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.273 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.274 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.275 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.286 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.297 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": 2020-04-22T13:56:02.298 INFO:teuthology.task.ansible.out:"Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "skip_reason": "Conditional result was False"} TASK [common : Set have_entitlements] ****************************************** ok: [smithi086.front.sepia.ceph.com] => {"ansible_facts": {"have_entitlements": true}, "changed": false} 2020-04-22T13:56:02.347 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:02 +0000 (0:00:00.088) 0:01:20.439 ******* 2020-04-22T13:56:02.354 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.355 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.357 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.369 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.369 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.371 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.381 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.393 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.404 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.405 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.416 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.428 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.429 INFO:teuthology.task.ansible.out: 2020-04-22T13:56:02.439 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.451 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.474 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.475 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.486 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.488 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d"}, "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.509 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.510 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.522 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034', u'name': u'khiremat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.523 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0', u'name': u'kapandya'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.534 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89', u'name': u'prasad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.553 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'ovpn': u'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f', u'name': u'vikhyat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.614 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:02 +0000 (0:00:00.266) 0:01:20.706 ******* 2020-04-22T13:56:02.641 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-04-22T13:56:02.643 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:02.681 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:02 +0000 (0:00:00.066) 0:01:20.772 ******* 2020-04-22T13:56:02.924 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi103.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2020-04-22T13:56:03.116 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2020-04-22T13:56:03.336 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2020-04-22T13:56:03.443 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed /root/.ansible/tmp/ansible-moduletmp-1587563763.321829-hbe5l5a0/katello-ca-consumer-latest.noarchdlwbce2t.rpm"]} 2020-04-22T13:56:03.498 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:03 +0000 (0:00:00.816) 0:01:21.589 ******* 2020-04-22T13:56:03.519 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-22T13:56:03.520 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2020-04-22T13:56:03.726 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2020-04-22T13:56:03.933 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2020-04-22T13:56:04.120 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2020-04-22T13:56:04.322 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2020-04-22T13:56:04.454 INFO:teuthology.task.ansible.out: 2020-04-22T13:56:04.456 INFO:teuthology.task.ansible.out:TASK [common : Determine if node is registered with subscription-manager.] ***** fatal: [smithi086.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ...ignoring 2020-04-22T13:56:04.499 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:04 +0000 (0:00:01.001) 0:01:22.591 ******* 2020-04-22T13:56:04.534 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-22T13:56:04.536 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} TASK [common : Set rhsm_registered if we're already registered] **************** 2020-04-22T13:56:04.536 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": false}, "changed": false} 2020-04-22T13:56:04.577 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:04 +0000 (0:00:00.077) 0:01:22.669 ******* 2020-04-22T13:56:04.725 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-22T13:56:04.726 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2020-04-22T13:56:04.939 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2020-04-22T13:56:05.135 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2020-04-22T13:56:05.328 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2020-04-22T13:56:05.527 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2020-04-22T13:56:05.728 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2020-04-22T13:56:05.930 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2020-04-22T13:56:06.130 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2020-04-22T13:56:06.320 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2020-04-22T13:56:06.518 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2020-04-22T13:56:06.711 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2020-04-22T13:56:06.914 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2020-04-22T13:56:07.104 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2020-04-22T13:56:07.304 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2020-04-22T13:56:07.525 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2020-04-22T13:56:07.723 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2020-04-22T13:56:07.923 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2020-04-22T13:56:08.112 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2020-04-22T13:56:08.322 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2020-04-22T13:56:08.511 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2020-04-22T13:56:08.722 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2020-04-22T13:56:08.926 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2020-04-22T13:56:09.115 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2020-04-22T13:56:09.311 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2020-04-22T13:56:09.520 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2020-04-22T13:56:09.720 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2020-04-22T13:56:09.932 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2020-04-22T13:56:10.136 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2020-04-22T13:56:10.341 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2020-04-22T13:56:10.561 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2020-04-22T13:56:10.749 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2020-04-22T13:56:10.955 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2020-04-22T13:56:11.149 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2020-04-22T13:56:11.354 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2020-04-22T13:56:11.450 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:11 +0000 (0:00:06.870) 0:01:29.539 ******* 2020-04-22T13:56:12.032 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** changed: [smithi103.front.sepia.ceph.com] => {"changed": true, "checksum": "f9ee21bf558da16d5cb117fdaf10268934dc9dad", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "32605c31fdd858d7857c5b5571a944e7", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1587563771.47-55404850072201/source", "state": "file", "uid": 0} 2020-04-22T13:56:12.081 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:12 +0000 (0:00:00.632) 0:01:30.172 ******* 2020-04-22T13:56:12.113 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-04-22T13:56:12.114 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => { "msg": "Host smithi103.front.sepia.ceph.com is running RedHat 8.1 (Ootpa)" } 2020-04-22T13:56:12.164 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:12 +0000 (0:00:00.080) 0:01:30.252 ******* 2020-04-22T13:56:12.213 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-04-22T13:56:12.214 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"], "rhsm_repos": ["rhel-8-for-x86_64-baseos-rpms", "rhel-8-for-x86_64-appstream-rpms"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"} 2020-04-22T13:56:12.263 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:12 +0000 (0:00:00.101) 0:01:30.354 ******* 2020-04-22T13:56:12.291 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-04-22T13:56:12.301 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:12.356 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:12 +0000 (0:00:00.089) 0:01:30.443 ******* 2020-04-22T13:56:12.640 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.078438", "end": "2020-04-22 13:56:12.606295", "rc": 0, "start": "2020-04-22 13:56:12.527857", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-04-22T13:56:12.678 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:12 +0000 (0:00:00.325) 0:01:30.769 ******* 2020-04-22T13:56:12.707 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-04-22T13:56:12.708 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:12.755 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:12 +0000 (0:00:00.077) 0:01:30.846 ******* 2020-04-22T13:56:12.792 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-04-22T13:56:12.794 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:12.832 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:12 +0000 (0:00:00.077) 0:01:30.924 ******* 2020-04-22T13:56:12.859 INFO:teuthology.task.ansible.out: 2020-04-22T13:56:12.861 INFO:teuthology.task.ansible.out:TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:12.904 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:12 +0000 (0:00:00.071) 0:01:30.995 ******* 2020-04-22T13:56:12.943 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-04-22T13:56:12.944 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:12.986 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:12 +0000 (0:00:00.082) 0:01:31.077 ******* 2020-04-22T13:56:13.023 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-04-22T13:56:13.025 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:13.069 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:13 +0000 (0:00:00.083) 0:01:31.161 ******* 2020-04-22T13:56:13.117 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-04-22T13:56:13.119 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"ansible_facts": {"entitlements_path": "/etc/ansible/secrets/entitlements.yml"}, "changed": false} 2020-04-22T13:56:13.178 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:13 +0000 (0:00:00.109) 0:01:31.270 ******* 2020-04-22T13:56:13.185 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-04-22T13:56:13.186 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => {"attempts": 1, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-04-22T13:56:13.246 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:13 +0000 (0:00:00.063) 0:01:31.333 ******* 2020-04-22T13:56:13.249 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** ok: [smithi103.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-22T13:56:13.250 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-22T13:56:13.291 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:13 +0000 (0:00:00.048) 0:01:31.382 ******* 2020-04-22T13:56:13.298 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-04-22T13:56:13.298 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": true}, "changed": false} 2020-04-22T13:56:13.365 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:13 +0000 (0:00:00.073) 0:01:31.456 ******* 2020-04-22T13:56:13.373 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-04-22T13:56:13.374 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"ansible_facts": {"have_entitlements": true}, "changed": false} 2020-04-22T13:56:13.416 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:13 +0000 (0:00:00.051) 0:01:31.508 ******* 2020-04-22T13:56:14.244 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-04-22T13:56:14.245 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager release --list | grep -E '[0-9]'", "delta": "0:00:00.658858", "end": "2020-04-22 13:56:14.203405", "failed_when_result": false, "rc": 0, "start": "2020-04-22 13:56:13.544547", "stderr": "", "stderr_lines": [], "stdout": "7.4\n7.5\n7.6\n7.7\n7.8\n7Server\n8\n8.0\n8.1", "stdout_lines": ["7.4", "7.5", "7.6", "7.7", "7.8", "7Server", "8", "8.0", "8.1"]} 2020-04-22T13:56:14.289 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:14 +0000 (0:00:00.872) 0:01:32.381 ******* 2020-04-22T13:56:14.331 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-04-22T13:56:14.333 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:14.374 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:14 +0000 (0:00:00.084) 0:01:32.465 ******* 2020-04-22T13:56:14.384 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-04-22T13:56:14.385 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed /root/.ansible/tmp/ansible-moduletmp-1587563774.2165036-w8wv0q1z/katello-ca-consumer-latest.noarch6vys195u.rpm"]} 2020-04-22T13:56:14.433 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:14 +0000 (0:00:00.059) 0:01:32.524 ******* 2020-04-22T13:56:14.439 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-04-22T13:56:14.440 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:14.483 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:14 +0000 (0:00:00.049) 0:01:32.574 ******* 2020-04-22T13:56:14.510 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-04-22T13:56:14.512 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-22T13:56:14.548 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:14 +0000 (0:00:00.064) 0:01:32.639 ******* 2020-04-22T13:56:14.585 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-04-22T13:56:14.586 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:14.623 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:14 +0000 (0:00:00.075) 0:01:32.714 ******* 2020-04-22T13:56:15.420 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-04-22T13:56:15.422 INFO:teuthology.task.ansible.out:fatal: [smithi103.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ...ignoring 2020-04-22T13:56:15.467 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:15 +0000 (0:00:00.844) 0:01:33.558 ******* 2020-04-22T13:56:15.506 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** ok: [smithi103.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": false}, "changed": false} 2020-04-22T13:56:15.550 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:15 +0000 (0:00:00.083) 0:01:33.641 ******* 2020-04-22T13:56:23.678 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-04-22T13:56:23.680 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"attempts": 1, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-04-22T13:56:23.727 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:23 +0000 (0:00:08.176) 0:01:41.818 ******* 2020-04-22T13:56:23.777 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-04-22T13:56:23.779 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": true}, "changed": false} 2020-04-22T13:56:23.832 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:23 +0000 (0:00:00.101) 0:01:41.920 ******* 2020-04-22T13:56:24.361 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-04-22T13:56:24.361 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager repos --list | grep -B4 'Enabled:.*1' | grep 'Repo ID:' | sed -e 's/Repo ID:\\s*\\(.*\\)/\\1/' | sort", "delta": "0:00:09.523884", "end": "2020-04-22 13:56:24.331276", "rc": 0, "start": "2020-04-22 13:56:14.807392", "stderr": "", "stderr_lines": [], "stdout": "rhel-8-for-x86_64-appstream-rpms\nrhel-8-for-x86_64-baseos-rpms", "stdout_lines": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]} 2020-04-22T13:56:24.402 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:24 +0000 (0:00:00.572) 0:01:42.493 ******* 2020-04-22T13:56:24.453 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ ok: [smithi086.front.sepia.ceph.com] => {"ansible_facts": {"repo_list": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]}, "changed": false} 2020-04-22T13:56:24.477 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:24 +0000 (0:00:00.075) 0:01:42.569 ******* 2020-04-22T13:56:24.529 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:24.557 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:24 +0000 (0:00:00.079) 0:01:42.648 ******* 2020-04-22T13:56:24.604 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-04-22T13:56:24.605 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": false}, "changed": false} 2020-04-22T13:56:24.641 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:24 +0000 (0:00:00.084) 0:01:42.732 ******* 2020-04-22T13:56:24.678 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-04-22T13:56:24.680 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2020-04-22T13:56:24.717 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:24 +0000 (0:00:00.076) 0:01:42.808 ******* 2020-04-22T13:56:24.762 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-04-22T13:56:24.763 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager release --list | grep -E '[0-9]'", "delta": "0:00:00.723690", "end": "2020-04-22 13:56:24.731228", "failed_when_result": false, "rc": 0, "start": "2020-04-22 13:56:24.007538", "stderr": "", "stderr_lines": [], "stdout": "7.4\n7.5\n7.6\n7.7\n7.8\n7Server\n8\n8.0\n8.1", "stdout_lines": ["7.4", "7.5", "7.6", "7.7", "7.8", "7Server", "8", "8.0", "8.1"]} 2020-04-22T13:56:24.803 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:24 +0000 (0:00:00.086) 0:01:42.895 ******* 2020-04-22T13:56:24.840 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-04-22T13:56:24.842 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:24.903 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:24 +0000 (0:00:00.099) 0:01:42.994 ******* 2020-04-22T13:56:24.940 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-04-22T13:56:24.941 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:24.977 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:24 +0000 (0:00:00.074) 0:01:43.068 ******* 2020-04-22T13:56:25.003 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-04-22T13:56:25.004 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-22T13:56:25.040 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:25 +0000 (0:00:00.063) 0:01:43.131 ******* 2020-04-22T13:56:25.087 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-04-22T13:56:25.089 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:25.124 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:25 +0000 (0:00:00.083) 0:01:43.215 ******* 2020-04-22T13:56:29.566 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** changed: [smithi086.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-04-22T13:56:29.611 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:29 +0000 (0:00:04.486) 0:01:47.702 ******* 2020-04-22T13:56:34.801 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-04-22T13:56:34.802 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager repos --list | grep -B4 'Enabled:.*1' | grep 'Repo ID:' | sed -e 's/Repo ID:\\s*\\(.*\\)/\\1/' | sort", "delta": "0:00:09.458816", "end": "2020-04-22 13:56:34.774812", "rc": 0, "start": "2020-04-22 13:56:25.315996", "stderr": "", "stderr_lines": [], "stdout": "rhel-8-for-x86_64-appstream-rpms\nrhel-8-for-x86_64-baseos-rpms", "stdout_lines": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]} TASK [common : Enable necessary rhsm repos] ************************************ changed: [smithi086.front.sepia.ceph.com] => (item=rhel-8-for-x86_64-baseos-rpms) => {"ansible_loop_var": "item", "changed": true, "cmd": ["subscription-manager", "repos", "--enable", "rhel-8-for-x86_64-baseos-rpms"], "delta": "0:00:04.950524", "end": "2020-04-22 13:56:34.769074", "item": "rhel-8-for-x86_64-baseos-rpms", "rc": 0, "start": "2020-04-22 13:56:29.818550", "stderr": "", "stderr_lines": [], "stdout": "Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.", "stdout_lines": ["Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system."]} 2020-04-22T13:56:34.859 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:34 +0000 (0:00:05.243) 0:01:52.945 ******* 2020-04-22T13:56:34.902 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-04-22T13:56:34.903 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"ansible_facts": {"repo_list": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]}, "changed": false} 2020-04-22T13:56:34.947 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:34 +0000 (0:00:00.087) 0:01:53.033 ******* 2020-04-22T13:56:34.979 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-04-22T13:56:34.982 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:35.020 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:35 +0000 (0:00:00.078) 0:01:53.111 ******* 2020-04-22T13:56:35.067 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-04-22T13:56:35.069 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": false}, "changed": false} 2020-04-22T13:56:35.110 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:35 +0000 (0:00:00.089) 0:01:53.201 ******* 2020-04-22T13:56:35.147 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-04-22T13:56:35.149 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2020-04-22T13:56:35.187 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:35 +0000 (0:00:00.075) 0:01:53.276 ******* 2020-04-22T13:56:39.387 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-04-22T13:56:39.388 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => (item=rhel-8-for-x86_64-appstream-rpms) => {"ansible_loop_var": "item", "changed": true, "cmd": ["subscription-manager", "repos", "--enable", "rhel-8-for-x86_64-appstream-rpms"], "delta": "0:00:04.390653", "end": "2020-04-22 13:56:39.361875", "item": "rhel-8-for-x86_64-appstream-rpms", "rc": 0, "start": "2020-04-22 13:56:34.971222", "stderr": "", "stderr_lines": [], "stdout": "Internal Server Error): Required lock is already taken by other running tasks.\nPlease inspect their state, fix their errors and resume them.\n\nRequired lock: update\nConflicts with tasks:\n https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/af4df2e5 6b16 416a b465 97ecc98daea4\n\nRepository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system.", "stdout_lines": ["Internal Server Error): Required lock is already taken by other running tasks.", "Please inspect their state, fix their errors and resume them.", "", "Required lock: update", "Conflicts with tasks:", " https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/af4df2e5 6b16 416a b465 97ecc98daea4", "", "Repository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system."]} 2020-04-22T13:56:39.443 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:39 +0000 (0:00:04.253) 0:01:57.530 ******* 2020-04-22T13:56:39.809 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "path": "/etc/yum.repos.d/cd.repo", "state": "absent"} 2020-04-22T13:56:39.851 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:39 +0000 (0:00:00.412) 0:01:57.942 ******* 2020-04-22T13:56:40.068 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-04-22T13:56:40.069 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-22T13:56:40.112 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:40 +0000 (0:00:00.261) 0:01:58.204 ******* 2020-04-22T13:56:40.278 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-04-22T13:56:40.280 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-04-22T13:56:40.344 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:40 +0000 (0:00:00.231) 0:01:58.435 ******* 2020-04-22T13:56:40.639 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-04-22T13:56:40.641 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'enabled': u'1', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-04-22T13:56:41.159 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'enabled': 0, u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-04-22T13:56:41.215 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:41 +0000 (0:00:00.871) 0:01:59.307 ******* 2020-04-22T13:56:41.719 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-04-22T13:56:41.721 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-04-22T13:56:42.188 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-04-22T13:56:42.233 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:42 +0000 (0:00:01.017) 0:02:00.324 ******* 2020-04-22T13:56:42.271 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-04-22T13:56:42.272 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:42.318 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:42 +0000 (0:00:00.085) 0:02:00.409 ******* 2020-04-22T13:56:42.347 INFO:teuthology.task.ansible.out: 2020-04-22T13:56:42.348 INFO:teuthology.task.ansible.out:TASK [common : Get the current timezone] *************************************** 2020-04-22T13:56:42.349 INFO:teuthology.task.ansible.out: skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:42.389 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:42 +0000 (0:00:00.071) 0:02:00.481 ******* 2020-04-22T13:56:42.391 INFO:teuthology.task.ansible.out: 2020-04-22T13:56:42.418 INFO:teuthology.task.ansible.out: 2020-04-22T13:56:42.420 INFO:teuthology.task.ansible.out:TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:42.464 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:42 +0000 (0:00:00.073) 0:02:00.554 ******* 2020-04-22T13:56:42.491 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-04-22T13:56:42.492 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:42.528 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:42 +0000 (0:00:00.064) 0:02:00.619 ******* 2020-04-22T13:56:42.554 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-04-22T13:56:42.556 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:42.597 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:42 +0000 (0:00:00.064) 0:02:00.684 ******* 2020-04-22T13:56:42.638 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-04-22T13:56:42.641 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:42.689 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:42 +0000 (0:00:00.095) 0:02:00.780 ******* 2020-04-22T13:56:42.719 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-04-22T13:56:42.721 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:42.773 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:42 +0000 (0:00:00.078) 0:02:00.859 ******* 2020-04-22T13:56:42.807 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-04-22T13:56:42.809 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:42.848 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:42 +0000 (0:00:00.080) 0:02:00.939 ******* 2020-04-22T13:56:42.875 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-04-22T13:56:42.877 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:42.916 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:42 +0000 (0:00:00.067) 0:02:01.007 ******* 2020-04-22T13:56:43.528 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-04-22T13:56:43.529 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.416002", "end": "2020-04-22 13:56:43.500330", "rc": 0, "start": "2020-04-22 13:56:43.084328", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-22T13:56:43.566 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:43 +0000 (0:00:00.649) 0:02:01.657 ******* 2020-04-22T13:56:45.356 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-04-22T13:56:45.357 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item=rhel-8-for-x86_64-baseos-rpms) => {"ansible_loop_var": "item", "changed": true, "cmd": ["subscription-manager", "repos", "--enable", "rhel-8-for-x86_64-baseos-rpms"], "delta": "0:00:04.773798", "end": "2020-04-22 13:56:45.312777", "item": "rhel-8-for-x86_64-baseos-rpms", "rc": 0, "start": "2020-04-22 13:56:40.538979", "stderr": "", "stderr_lines": [], "stdout": "Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.", "stdout_lines": ["Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system."]} 2020-04-22T13:56:46.194 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-04-22T13:56:46.238 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:46 +0000 (0:00:02.672) 0:02:04.330 ******* 2020-04-22T13:56:46.269 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:46.303 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:46 +0000 (0:00:00.064) 0:02:04.394 ******* 2020-04-22T13:56:46.340 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-04-22T13:56:46.342 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:46.389 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:46 +0000 (0:00:00.085) 0:02:04.480 ******* 2020-04-22T13:56:46.416 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-04-22T13:56:46.418 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:46.462 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:46 +0000 (0:00:00.073) 0:02:04.554 ******* 2020-04-22T13:56:46.489 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-04-22T13:56:46.491 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:46.531 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:46 +0000 (0:00:00.068) 0:02:04.622 ******* 2020-04-22T13:56:47.014 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-04-22T13:56:47.014 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-04-22T13:56:47.053 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:47 +0000 (0:00:00.522) 0:02:05.144 ******* 2020-04-22T13:56:49.069 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-04-22T13:56:49.071 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-04-22T13:56:49.107 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:49 +0000 (0:00:02.054) 0:02:07.199 ******* 2020-04-22T13:56:49.606 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-04-22T13:56:49.607 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-04-22T13:56:49.831 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ changed: [smithi103.front.sepia.ceph.com] => (item=rhel-8-for-x86_64-appstream-rpms) => {"ansible_loop_var": "item", "changed": true, "cmd": ["subscription-manager", "repos", "--enable", "rhel-8-for-x86_64-appstream-rpms"], "delta": "0:00:04.282078", "end": "2020-04-22 13:56:49.797645", "item": "rhel-8-for-x86_64-appstream-rpms", "rc": 0, "start": "2020-04-22 13:56:45.515567", "stderr": "", "stderr_lines": [], "stdout": "Internal Server Error): Required lock is already taken by other running tasks.\nPlease inspect their state, fix their errors and resume them.\n\nRequired lock: update\nConflicts with tasks:\n https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/66e88d04 7d92 4564 b7a0 8f4d00c97b79\n\nRepository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system.", "stdout_lines": ["Internal Server Error): Required lock is already taken by other running tasks.", "Please inspect their state, fix their errors and resume them.", "", "Required lock: update", "Conflicts with tasks:", " https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/66e88d04 7d92 4564 b7a0 8f4d00c97b79", "", "Repository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system."]} 2020-04-22T13:56:49.882 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:49 +0000 (0:00:00.774) 0:02:07.973 ******* 2020-04-22T13:56:50.090 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi086.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} TASK [common : Remove old apt-mirror repository definition.] ******************* ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "path": "/etc/yum.repos.d/cd.repo", "state": "absent"} 2020-04-22T13:56:50.136 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:50 +0000 (0:00:00.254) 0:02:08.227 ******* 2020-04-22T13:56:50.340 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-04-22T13:56:50.341 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-22T13:56:50.390 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:50 +0000 (0:00:00.253) 0:02:08.481 ******* 2020-04-22T13:56:50.552 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi086.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-04-22T13:56:50.593 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:50 +0000 (0:00:00.202) 0:02:08.684 ******* 2020-04-22T13:56:50.784 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-04-22T13:56:50.785 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-22T13:56:50.827 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:50 +0000 (0:00:00.234) 0:02:08.919 ******* 2020-04-22T13:56:50.899 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-04-22T13:56:50.900 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'enabled': u'1', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-04-22T13:56:51.319 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-04-22T13:56:51.321 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-04-22T13:56:51.375 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-04-22T13:56:51.377 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'enabled': 0, u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-04-22T13:56:51.430 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:51 +0000 (0:00:00.602) 0:02:09.521 ******* 2020-04-22T13:56:51.813 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-04-22T13:56:51.814 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-04-22T13:56:51.928 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-04-22T13:56:51.930 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-04-22T13:56:52.249 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-04-22T13:56:52.250 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-04-22T13:56:52.297 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:52 +0000 (0:00:00.867) 0:02:10.388 ******* 2020-04-22T13:56:52.324 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-04-22T13:56:52.326 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:52.365 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:52 +0000 (0:00:00.067) 0:02:10.456 ******* 2020-04-22T13:56:52.402 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-04-22T13:56:52.402 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-04-22T13:56:52.405 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-04-22T13:56:52.406 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-04-22T13:56:52.441 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:52 +0000 (0:00:00.076) 0:02:10.533 ******* 2020-04-22T13:56:52.490 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:52 +0000 (0:00:00.047) 0:02:10.580 ******* 2020-04-22T13:56:52.525 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-04-22T13:56:52.527 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:52.563 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:52 +0000 (0:00:00.074) 0:02:10.654 ******* 2020-04-22T13:56:52.589 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-04-22T13:56:52.591 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:52.633 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:52 +0000 (0:00:00.063) 0:02:10.718 ******* 2020-04-22T13:56:52.654 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:52.705 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:52 +0000 (0:00:00.078) 0:02:10.797 ******* 2020-04-22T13:56:52.712 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-04-22T13:56:52.712 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-04-22T13:56:52.750 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:52 +0000 (0:00:00.044) 0:02:10.841 ******* 2020-04-22T13:56:52.756 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-04-22T13:56:52.757 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:52.795 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:52 +0000 (0:00:00.044) 0:02:10.886 ******* 2020-04-22T13:56:52.801 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-04-22T13:56:52.801 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-22T13:56:52.803 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-22T13:56:52.824 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-22T13:56:52.825 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:52.829 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi086.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-22T13:56:52.864 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:52 +0000 (0:00:00.069) 0:02:10.955 ******* 2020-04-22T13:56:52.901 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:52 +0000 (0:00:00.036) 0:02:10.992 ******* 2020-04-22T13:56:52.927 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-04-22T13:56:52.929 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:52.965 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:52 +0000 (0:00:00.064) 0:02:11.056 ******* 2020-04-22T13:56:52.991 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:53.028 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:53 +0000 (0:00:00.063) 0:02:11.120 ******* 2020-04-22T13:56:53.054 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-04-22T13:56:53.055 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:53.092 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:53 +0000 (0:00:00.063) 0:02:11.183 ******* 2020-04-22T13:56:53.118 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-04-22T13:56:53.119 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:53.156 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:53 +0000 (0:00:00.063) 0:02:11.247 ******* 2020-04-22T13:56:53.522 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-04-22T13:56:53.523 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.174604", "end": "2020-04-22 13:56:53.500330", "rc": 0, "start": "2020-04-22 13:56:53.325726", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-22T13:56:53.561 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:53 +0000 (0:00:00.405) 0:02:11.653 ******* 2020-04-22T13:56:55.965 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-04-22T13:56:55.967 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-04-22T13:56:56.023 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:56 +0000 (0:00:02.461) 0:02:14.114 ******* 2020-04-22T13:56:56.051 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:56.088 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:56 +0000 (0:00:00.064) 0:02:14.179 ******* 2020-04-22T13:56:56.117 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:56.152 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:56 +0000 (0:00:00.063) 0:02:14.243 ******* 2020-04-22T13:56:56.177 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-04-22T13:56:56.179 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:56.215 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:56 +0000 (0:00:00.063) 0:02:14.306 ******* 2020-04-22T13:56:56.251 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-04-22T13:56:56.253 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:56.293 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:56 +0000 (0:00:00.076) 0:02:14.383 ******* 2020-04-22T13:56:56.764 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-04-22T13:56:56.809 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:56 +0000 (0:00:00.517) 0:02:14.900 ******* 2020-04-22T13:56:58.746 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-04-22T13:56:58.748 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-04-22T13:56:58.787 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:58 +0000 (0:00:01.975) 0:02:16.876 ******* 2020-04-22T13:56:58.791 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-04-22T13:56:58.792 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load", "Installed: nrpe-4.0.2-2.el8.x86_64", "Removed: nrpe-3.2.1-9.el8.x86_64"]} 2020-04-22T13:56:58.833 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:58 +0000 (0:00:00.047) 0:02:16.924 ******* 2020-04-22T13:56:58.859 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-04-22T13:56:58.860 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:56:58.896 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:58 +0000 (0:00:00.063) 0:02:16.987 ******* 2020-04-22T13:56:59.299 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-04-22T13:56:59.300 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-04-22T13:56:59.411 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-04-22T13:56:59.411 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-04-22T13:56:59.454 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:59 +0000 (0:00:00.557) 0:02:17.545 ******* 2020-04-22T13:56:59.774 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-04-22T13:56:59.777 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-04-22T13:56:59.951 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-04-22T13:56:59.952 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-04-22T13:57:00.000 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:56:59 +0000 (0:00:00.546) 0:02:18.092 ******* 2020-04-22T13:57:00.053 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:57:00.090 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:00 +0000 (0:00:00.090) 0:02:18.182 ******* 2020-04-22T13:57:00.235 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-04-22T13:57:00.237 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-04-22T13:57:00.279 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:00 +0000 (0:00:00.188) 0:02:18.370 ******* 2020-04-22T13:57:00.306 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-04-22T13:57:00.307 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-22T13:57:00.345 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:00 +0000 (0:00:00.066) 0:02:18.436 ******* 2020-04-22T13:57:00.473 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-22T13:57:00.514 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:00 +0000 (0:00:00.167) 0:02:18.604 ******* 2020-04-22T13:57:00.589 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-04-22T13:57:00.590 INFO:teuthology.task.ansible.out:fatal: [smithi086.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-04-22T13:57:00.633 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:00 +0000 (0:00:00.114) 0:02:18.719 ******* 2020-04-22T13:57:00.655 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-04-22T13:57:00.656 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:57:00.703 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:00 +0000 (0:00:00.074) 0:02:18.793 ******* 2020-04-22T13:57:01.000 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-04-22T13:57:01.000 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-04-22T13:57:01.182 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-04-22T13:57:01.184 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2020-04-22T13:57:01.230 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:01 +0000 (0:00:00.525) 0:02:19.319 ******* 2020-04-22T13:57:01.450 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi103.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-04-22T13:57:01.893 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-04-22T13:57:01.933 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:01 +0000 (0:00:00.705) 0:02:20.025 ******* 2020-04-22T13:57:01.960 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-04-22T13:57:01.962 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:57:02.003 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:01 +0000 (0:00:00.069) 0:02:20.094 ******* 2020-04-22T13:57:02.029 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2020-04-22 13:56:55 UTC", "ActiveEnterTimestampMonotonic": "238255603", "ActiveExitTimestamp": "Wed 2020-04-22 13:56:55 UTC", "ActiveExitTimestampMonotonic": "238230303", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service var-run.mount system.slice tmp.mount sysinit.target basic.target -.mount systemd-journald.socket network.target nss-lookup.target local-fs.target time-sync.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2020-04-22 13:56:55 UTC", "AssertTimestampMonotonic": "238254906", "Before": "multi-user.target getty@tty1.service plymouth-quit.service xdm.service shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2020-04-22 13:56:55 UTC", "ConditionTimestampMonotonic": "238254906", 2020-04-22T13:57:02.031 INFO:teuthology.task.ansible.out:"ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "16786", "ExecMainStartTimestamp": "Wed 2020-04-22 13:56:55 UTC", "ExecMainStartTimestampMonotonic": "238255579", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Wed 2020-04-22 13:56:55 UTC", "InactiveEnterTimestampMonotonic": "238254273", "InactiveExitTimestamp": "Wed 2020-04-22 13:56:55 UTC", "InactiveExitTimestampMonotonic": "238255603", "InvocationID": "106f8a97821f4cb9924c28758f8de387", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control 2020-04-22T13:57:02.032 INFO:teuthology.task.ansible.out:-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127442", "LimitNPROCSoft": "127442", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127442", "LimitSIGPENDINGSoft": "127442", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "16786", "MemoryAccounting": "yes", "MemoryCurrent": "720896", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tm 2020-04-22T13:57:02.033 INFO:teuthology.task.ansible.out:p /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2020-04-22 13:56:55 UTC", "StateChangeTimestampMonotonic": "238255603", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Wed 2020-04-22 13:56:55 UTC", "WatchdogTimestampMonotonic": "238255603", "WatchdogUSec": "0"}} 2020-04-22T13:57:02.063 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:02 +0000 (0:00:00.060) 0:02:20.155 ******* 2020-04-22T13:57:02.075 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** ok: [smithi103.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-04-22T13:57:02.116 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:02 +0000 (0:00:00.050) 0:02:20.206 ******* 2020-04-22T13:57:02.302 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* changed: [smithi086.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001708", "end": "2020-04-22 13:57:02.277593", "rc": 0, "start": "2020-04-22 13:57:02.275885", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-04-22T13:57:02.347 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:02 +0000 (0:00:00.232) 0:02:20.438 ******* 2020-04-22T13:57:02.354 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-04-22T13:57:02.356 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-04-22T13:57:02.400 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:02 +0000 (0:00:00.052) 0:02:20.491 ******* 2020-04-22T13:57:02.448 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi103.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-22T13:57:02.459 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-22T13:57:02.470 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-22T13:57:02.481 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-22T13:57:02.530 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:02 +0000 (0:00:00.125) 0:02:20.617 ******* 2020-04-22T13:57:04.569 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-04-22T13:57:04.571 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-04-22T13:57:04.608 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:04 +0000 (0:00:02.082) 0:02:22.699 ******* 2020-04-22T13:57:06.861 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-04-22T13:57:06.862 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-04-22T13:57:06.906 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:06 +0000 (0:00:02.293) 0:02:24.992 ******* 2020-04-22T13:57:08.382 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-04-22T13:57:08.384 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-04-22T13:57:08.422 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:08 +0000 (0:00:01.520) 0:02:26.513 ******* 2020-04-22T13:57:08.946 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-04-22T13:57:08.946 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load", "Installed: nrpe-4.0.2-2.el8.x86_64", "Removed: nrpe-3.2.1-9.el8.x86_64"]} 2020-04-22T13:57:08.998 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:08 +0000 (0:00:00.576) 0:02:27.090 ******* 2020-04-22T13:57:09.039 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:57:09.086 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:09 +0000 (0:00:00.087) 0:02:27.177 ******* 2020-04-22T13:57:09.587 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-04-22T13:57:09.587 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-04-22T13:57:09.629 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:09 +0000 (0:00:00.543) 0:02:27.720 ******* 2020-04-22T13:57:09.639 INFO:teuthology.task.ansible.out: 2020-04-22T13:57:10.164 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-04-22T13:57:10.166 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-04-22T13:57:10.203 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:10 +0000 (0:00:00.573) 0:02:28.294 ******* 2020-04-22T13:57:10.239 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-04-22T13:57:10.241 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:57:10.276 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:10 +0000 (0:00:00.072) 0:02:28.367 ******* 2020-04-22T13:57:10.479 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* ok: [smithi103.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-22T13:57:10.515 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:10 +0000 (0:00:00.239) 0:02:28.607 ******* 2020-04-22T13:57:10.776 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-04-22T13:57:10.778 INFO:teuthology.task.ansible.out:fatal: [smithi103.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-04-22T13:57:10.821 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:10 +0000 (0:00:00.301) 0:02:28.908 ******* 2020-04-22T13:57:10.849 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-04-22T13:57:10.850 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:57:10.895 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:10 +0000 (0:00:00.075) 0:02:28.984 ******* 2020-04-22T13:57:11.370 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-04-22T13:57:11.372 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2020-04-22T13:57:11.424 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:11 +0000 (0:00:00.531) 0:02:29.515 ******* 2020-04-22T13:57:11.740 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2020-04-22 13:57:05 UTC", "ActiveEnterTimestampMonotonic": "222232871", "ActiveExitTimestamp": "Wed 2020-04-22 13:57:05 UTC", "ActiveExitTimestampMonotonic": "222206094", "ActiveState": "active", "After": "time-sync.target basic.target systemd-journald.socket system.slice nss-lookup.target local-fs.target network.target systemd-tmpfiles-setup.service var-run.mount -.mount sysinit.target tmp.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2020-04-22 13:57:05 UTC", "AssertTimestampMonotonic": "222231877", "Before": "getty@tty1.service multi-user.target shutdown.target plymouth-quit.service xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2020-04-22 13:57:05 UTC", "ConditionTimestampMonotonic": "222231876", 2020-04-22T13:57:11.741 INFO:teuthology.task.ansible.out:"ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "16798", "ExecMainStartTimestamp": "Wed 2020-04-22 13:57:05 UTC", "ExecMainStartTimestampMonotonic": "222232845", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Wed 2020-04-22 13:57:05 UTC", "InactiveEnterTimestampMonotonic": "222231293", "InactiveExitTimestamp": "Wed 2020-04-22 13:57:05 UTC", "InactiveExitTimestampMonotonic": "222232871", "InvocationID": "fb61098364f2428e8b41df7f2047e728", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control 2020-04-22T13:57:11.743 INFO:teuthology.task.ansible.out:-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127442", "LimitNPROCSoft": "127442", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127442", "LimitSIGPENDINGSoft": "127442", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "16798", "MemoryAccounting": "yes", "MemoryCurrent": "716800", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tm 2020-04-22T13:57:11.744 INFO:teuthology.task.ansible.out:p /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2020-04-22 13:57:05 UTC", "StateChangeTimestampMonotonic": "222232871", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Wed 2020-04-22 13:57:05 UTC", "WatchdogTimestampMonotonic": "222232870", "WatchdogUSec": "0"}} 2020-04-22T13:57:11.797 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:11 +0000 (0:00:00.372) 0:02:29.888 ******* 2020-04-22T13:57:12.008 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* changed: [smithi103.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001805", "end": "2020-04-22 13:57:11.982682", "rc": 0, "start": "2020-04-22 13:57:11.980877", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-04-22T13:57:12.049 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:12 +0000 (0:00:00.249) 0:02:30.138 ******* 2020-04-22T13:57:14.055 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-04-22T13:57:14.056 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-04-22T13:57:14.108 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:14 +0000 (0:00:02.061) 0:02:32.199 ******* 2020-04-22T13:57:16.148 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-04-22T13:57:16.188 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:16 +0000 (0:00:02.080) 0:02:34.279 ******* 2020-04-22T13:57:17.296 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-04-22T13:57:17.333 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:17 +0000 (0:00:01.145) 0:02:35.425 ******* 2020-04-22T13:57:24.810 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** changed: [smithi086.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.184837", "end": "2020-04-22 13:57:24.782706", "failed_when_result": false, "rc": 0, "start": "2020-04-22 13:57:08.597869", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-04-22T13:57:24.846 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:24 +0000 (0:00:07.513) 0:02:42.938 ******* 2020-04-22T13:57:25.323 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-04-22T13:57:25.323 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-04-22T13:57:25.365 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:25 +0000 (0:00:00.518) 0:02:43.456 ******* 2020-04-22T13:57:25.579 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-04-22T13:57:25.581 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.015760", "end": "2020-04-22 13:57:25.553557", "rc": 0, "start": "2020-04-22 13:57:25.537797", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-22T13:57:25.620 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:25 +0000 (0:00:00.255) 0:02:43.711 ******* 2020-04-22T13:57:25.816 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-04-22T13:57:25.818 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.001964", "end": "2020-04-22 13:57:25.792176", "rc": 0, "start": "2020-04-22 13:57:25.790212", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-22T13:57:25.855 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:25 +0000 (0:00:00.234) 0:02:43.946 ******* 2020-04-22T13:57:33.754 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** changed: [smithi103.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.214950", "end": "2020-04-22 13:57:33.719781", "failed_when_result": false, "rc": 0, "start": "2020-04-22 13:57:17.504831", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-04-22T13:57:33.794 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:33 +0000 (0:00:07.939) 0:02:51.886 ******* 2020-04-22T13:57:34.310 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-04-22T13:57:34.312 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-04-22T13:57:34.353 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:34 +0000 (0:00:00.558) 0:02:52.444 ******* 2020-04-22T13:57:34.573 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-04-22T13:57:34.575 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.026701", "end": "2020-04-22 13:57:34.552673", "rc": 0, "start": "2020-04-22 13:57:34.525972", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-22T13:57:34.613 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:34 +0000 (0:00:00.259) 0:02:52.704 ******* 2020-04-22T13:57:34.815 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** changed: [smithi103.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.008388", "end": "2020-04-22 13:57:34.795924", "rc": 0, "start": "2020-04-22 13:57:34.787536", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-22T13:57:34.852 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:34 +0000 (0:00:00.239) 0:02:52.943 ******* 2020-04-22T13:57:42.066 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-04-22T13:57:42.066 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.012695", "end": "2020-04-22 13:57:42.040329", "rc": 0, "start": "2020-04-22 13:57:26.027634", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-22T13:57:42.103 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:42 +0000 (0:00:07.250) 0:03:00.194 ******* 2020-04-22T13:57:42.320 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-04-22T13:57:42.356 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:42 +0000 (0:00:00.252) 0:03:00.447 ******* 2020-04-22T13:57:42.384 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-04-22T13:57:42.384 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-04-22T13:57:42.440 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:42 +0000 (0:00:00.084) 0:03:00.532 ******* 2020-04-22T13:57:42.493 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* ok: [smithi086.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-04-22T13:57:42.535 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:42 +0000 (0:00:00.095) 0:03:00.627 ******* 2020-04-22T13:57:42.576 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-04-22T13:57:42.578 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ktdreyer/ceph-el8"], "epel_packages": ["dbench"], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["@core", "@base", "dnf-utils", "git-all", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "podman", "podman-docker", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "autoconf", "gdb", "iozone"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"} 2020-04-22T13:57:42.618 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:42 +0000 (0:00:00.078) 0:03:00.705 ******* 2020-04-22T13:57:42.651 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-04-22T13:57:42.653 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-04-22T13:57:42.690 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:42 +0000 (0:00:00.076) 0:03:00.782 ******* 2020-04-22T13:57:42.891 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-04-22T13:57:42.893 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-04-22T13:57:42.928 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:42 +0000 (0:00:00.237) 0:03:01.019 ******* 2020-04-22T13:57:43.126 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-04-22T13:57:43.127 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "gid": 1213, "name": "ubuntu", "state": "present", "system": false} 2020-04-22T13:57:43.173 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:43 +0000 (0:00:00.245) 0:03:01.264 ******* 2020-04-22T13:57:43.200 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-04-22T13:57:43.202 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:57:43.242 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:43 +0000 (0:00:00.069) 0:03:01.334 ******* 2020-04-22T13:57:43.269 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-04-22T13:57:43.271 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:57:43.314 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:43 +0000 (0:00:00.071) 0:03:01.405 ******* 2020-04-22T13:57:43.527 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-04-22T13:57:43.529 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-04-22T13:57:43.571 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:43 +0000 (0:00:00.250) 0:03:01.656 ******* 2020-04-22T13:57:44.149 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-04-22T13:57:44.149 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-04-22T13:57:44.189 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:44 +0000 (0:00:00.623) 0:03:02.280 ******* 2020-04-22T13:57:44.225 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-04-22T13:57:44.227 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi086"}, "changed": false} 2020-04-22T13:57:44.264 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:44 +0000 (0:00:00.075) 0:03:02.356 ******* 2020-04-22T13:57:45.322 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-04-22T13:57:45.324 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi086", "ansible_hostname": "smithi086", "ansible_nodename": "smithi086"}, "changed": false, "name": "smithi086"} 2020-04-22T13:57:45.362 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:45 +0000 (0:00:01.097) 0:03:03.453 ******* 2020-04-22T13:57:45.836 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-04-22T13:57:45.838 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-04-22T13:57:45.875 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:45 +0000 (0:00:00.512) 0:03:03.966 ******* 2020-04-22T13:57:46.373 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-04-22T13:57:46.376 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-04-22T13:57:46.436 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:46 +0000 (0:00:00.561) 0:03:04.527 ******* 2020-04-22T13:57:47.080 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-04-22T13:57:47.082 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-04-22T13:57:47.135 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:47 +0000 (0:00:00.698) 0:03:05.226 ******* 2020-04-22T13:57:47.642 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-04-22T13:57:47.692 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:47 +0000 (0:00:00.556) 0:03:05.783 ******* 2020-04-22T13:57:47.902 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-04-22T13:57:47.937 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:47 +0000 (0:00:00.245) 0:03:06.028 ******* 2020-04-22T13:57:48.137 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-04-22T13:57:48.138 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-04-22T13:57:48.180 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:48 +0000 (0:00:00.242) 0:03:06.271 ******* 2020-04-22T13:57:48.396 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-04-22T13:57:48.397 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1213, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-04-22T13:57:48.436 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:48 +0000 (0:00:00.253) 0:03:06.524 ******* 2020-04-22T13:57:48.933 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-04-22T13:57:48.934 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-04-22T13:57:48.972 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:48 +0000 (0:00:00.538) 0:03:07.063 ******* 2020-04-22T13:57:49.516 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-04-22T13:57:49.520 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-04-22T13:57:49.557 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:49 +0000 (0:00:00.585) 0:03:07.649 ******* 2020-04-22T13:57:51.135 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-04-22T13:57:51.137 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.073692", "end": "2020-04-22 13:57:51.107366", "rc": 0, "start": "2020-04-22 13:57:35.033674", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-22T13:57:51.181 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:51 +0000 (0:00:01.623) 0:03:09.272 ******* 2020-04-22T13:57:51.393 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-04-22T13:57:51.433 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:51 +0000 (0:00:00.247) 0:03:09.520 ******* 2020-04-22T13:57:51.466 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-04-22T13:57:51.467 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-04-22T13:57:51.511 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:51 +0000 (0:00:00.081) 0:03:09.602 ******* 2020-04-22T13:57:51.520 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ [WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi086.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.716582", "end": "2020-04-22 13:57:51.461787", "rc": 0, "start": "2020-04-22 13:57:49.745205", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-22T13:57:51.561 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:51 +0000 (0:00:00.050) 0:03:09.653 ******* 2020-04-22T13:57:51.580 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-04-22T13:57:51.581 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-04-22T13:57:51.624 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:51 +0000 (0:00:00.062) 0:03:09.715 ******* 2020-04-22T13:57:51.630 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-04-22T13:57:51.631 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:57:51.676 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:51 +0000 (0:00:00.049) 0:03:09.764 ******* 2020-04-22T13:57:51.680 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-04-22T13:57:51.683 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ktdreyer/ceph-el8"], "epel_packages": ["dbench"], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["@core", "@base", "dnf-utils", "git-all", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "podman", "podman-docker", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "autoconf", "gdb", "iozone"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"} 2020-04-22T13:57:51.722 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:51 +0000 (0:00:00.048) 0:03:09.813 ******* 2020-04-22T13:57:51.780 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-04-22T13:57:51.782 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-04-22T13:57:51.819 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:51 +0000 (0:00:00.097) 0:03:09.911 ******* 2020-04-22T13:57:52.012 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-04-22T13:57:52.014 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-04-22T13:57:52.059 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:52 +0000 (0:00:00.234) 0:03:10.145 ******* 2020-04-22T13:57:52.209 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-04-22T13:57:52.210 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-04-22T13:57:52.288 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:52 +0000 (0:00:00.231) 0:03:10.377 ******* 2020-04-22T13:57:52.294 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-04-22T13:57:52.295 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "gid": 1213, "name": "ubuntu", "state": "present", "system": false} 2020-04-22T13:57:52.340 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:52 +0000 (0:00:00.054) 0:03:10.431 ******* 2020-04-22T13:57:52.346 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-04-22T13:57:52.395 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:52 +0000 (0:00:00.054) 0:03:10.486 ******* 2020-04-22T13:57:52.403 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-04-22T13:57:52.404 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:57:52.446 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:52 +0000 (0:00:00.050) 0:03:10.537 ******* 2020-04-22T13:57:52.472 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-04-22T13:57:52.474 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:57:52.521 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:52 +0000 (0:00:00.075) 0:03:10.612 ******* 2020-04-22T13:57:52.741 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-04-22T13:57:52.741 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-04-22T13:57:52.792 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:52 +0000 (0:00:00.270) 0:03:10.883 ******* 2020-04-22T13:57:53.352 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-04-22T13:57:53.397 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:53 +0000 (0:00:00.605) 0:03:11.489 ******* 2020-04-22T13:57:53.427 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* ok: [smithi103.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi103"}, "changed": false} 2020-04-22T13:57:53.473 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:53 +0000 (0:00:00.075) 0:03:11.565 ******* 2020-04-22T13:57:53.479 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-04-22T13:57:53.480 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => (item=ktdreyer/ceph-el8) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ktdreyer/ceph-el8"], "delta": "0:00:00.868176", "end": "2020-04-22 13:57:53.447573", "item": "ktdreyer/ceph-el8", "rc": 0, "start": "2020-04-22 13:57:52.579397", "stderr": "", "stderr_lines": [], "stdout": "Updating Subscription Management repositories.\nRepository successfully enabled.", "stdout_lines": ["Updating Subscription Management repositories.", "Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} 2020-04-22T13:57:53.482 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2020-04-22T13:57:53.525 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:53 +0000 (0:00:00.051) 0:03:11.616 ******* 2020-04-22T13:57:53.552 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-04-22T13:57:53.554 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:57:53.592 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:53 +0000 (0:00:00.067) 0:03:11.684 ******* 2020-04-22T13:57:53.631 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-04-22T13:57:53.632 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-04-22T13:57:53.632 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-04-22T13:57:53.675 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:53 +0000 (0:00:00.082) 0:03:11.766 ******* 2020-04-22T13:57:53.720 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:57:53.755 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:53 +0000 (0:00:00.079) 0:03:11.846 ******* 2020-04-22T13:57:53.782 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-22T13:57:53.783 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:57:53.819 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:53 +0000 (0:00:00.064) 0:03:11.911 ******* 2020-04-22T13:57:53.869 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-04-22T13:57:53.871 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:57:53.909 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:53 +0000 (0:00:00.089) 0:03:12.000 ******* 2020-04-22T13:57:53.953 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:57:53.998 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:53 +0000 (0:00:00.088) 0:03:12.089 ******* 2020-04-22T13:57:54.053 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-04-22T13:57:54.054 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi103", "ansible_hostname": "smithi103", "ansible_nodename": "smithi103"}, "changed": false, "name": "smithi103"} 2020-04-22T13:57:54.114 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:54 +0000 (0:00:00.115) 0:03:12.205 ******* 2020-04-22T13:57:54.211 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-04-22T13:57:54.212 INFO:teuthology.task.ansible.out:fatal: [smithi086.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006735", "end": "2020-04-22 13:57:54.186398", "msg": "non-zero return code", "rc": 1, "start": "2020-04-22 13:57:54.179663", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-04-22T13:57:54.254 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:54 +0000 (0:00:00.140) 0:03:12.345 ******* 2020-04-22T13:57:54.291 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-04-22T13:57:54.293 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:57:54.345 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:54 +0000 (0:00:00.090) 0:03:12.436 ******* 2020-04-22T13:57:54.617 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-04-22T13:57:54.618 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-04-22T13:57:54.659 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:54 +0000 (0:00:00.313) 0:03:12.750 ******* 2020-04-22T13:57:55.178 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-04-22T13:57:55.226 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:55 +0000 (0:00:00.562) 0:03:13.312 ******* 2020-04-22T13:57:55.882 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-04-22T13:57:55.884 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-04-22T13:57:55.928 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:55 +0000 (0:00:00.707) 0:03:14.019 ******* 2020-04-22T13:57:56.428 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-04-22T13:57:56.465 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:56 +0000 (0:00:00.536) 0:03:14.557 ******* 2020-04-22T13:57:56.675 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-04-22T13:57:56.676 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-04-22T13:57:56.719 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:56 +0000 (0:00:00.253) 0:03:14.810 ******* 2020-04-22T13:57:56.930 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-04-22T13:57:56.988 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:56 +0000 (0:00:00.268) 0:03:15.079 ******* 2020-04-22T13:57:57.205 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-04-22T13:57:57.206 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1213, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-04-22T13:57:57.248 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:57 +0000 (0:00:00.259) 0:03:15.339 ******* 2020-04-22T13:57:57.737 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-04-22T13:57:57.738 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-04-22T13:57:57.785 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:57 +0000 (0:00:00.537) 0:03:15.877 ******* 2020-04-22T13:57:58.283 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-04-22T13:57:58.285 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-04-22T13:57:58.324 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:58 +0000 (0:00:00.538) 0:03:16.415 ******* 2020-04-22T13:57:59.946 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ changed: [smithi086.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:2.12.0-88.module+el8.1.0+5708+85d8e057.3.x86_64"]} 2020-04-22T13:57:59.986 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:57:59 +0000 (0:00:01.662) 0:03:18.078 ******* 2020-04-22T13:58:00.297 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-04-22T13:58:00.298 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.772941", "end": "2020-04-22 13:58:00.269608", "rc": 0, "start": "2020-04-22 13:57:58.496667", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-22T13:58:00.338 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:00 +0000 (0:00:00.351) 0:03:18.429 ******* 2020-04-22T13:58:00.383 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-04-22T13:58:00.384 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:00.419 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:00 +0000 (0:00:00.080) 0:03:18.510 ******* 2020-04-22T13:58:00.934 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-04-22T13:58:00.936 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-04-22T13:58:00.977 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:00 +0000 (0:00:00.555) 0:03:19.065 ******* 2020-04-22T13:58:01.012 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-04-22T13:58:01.050 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:01 +0000 (0:00:00.075) 0:03:19.141 ******* 2020-04-22T13:58:02.096 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-04-22T13:58:02.097 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item=ktdreyer/ceph-el8) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ktdreyer/ceph-el8"], "delta": "0:00:00.826951", "end": "2020-04-22 13:58:02.062902", "item": "ktdreyer/ceph-el8", "rc": 0, "start": "2020-04-22 13:58:01.235951", "stderr": "", "stderr_lines": [], "stdout": "Updating Subscription Management repositories.\nRepository successfully enabled.", "stdout_lines": ["Updating Subscription Management repositories.", "Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} 2020-04-22T13:58:02.145 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:02 +0000 (0:00:01.095) 0:03:20.236 ******* 2020-04-22T13:58:02.186 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:02.220 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:02 +0000 (0:00:00.075) 0:03:20.312 ******* 2020-04-22T13:58:02.257 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-04-22T13:58:02.259 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-04-22T13:58:02.268 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-04-22T13:58:02.312 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:02 +0000 (0:00:00.092) 0:03:20.404 ******* 2020-04-22T13:58:02.350 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-04-22T13:58:02.351 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:02.387 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:02 +0000 (0:00:00.074) 0:03:20.478 ******* 2020-04-22T13:58:02.417 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-22T13:58:02.418 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:02.454 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:02 +0000 (0:00:00.066) 0:03:20.545 ******* 2020-04-22T13:58:02.491 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-04-22T13:58:02.493 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:02.528 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:02 +0000 (0:00:00.074) 0:03:20.619 ******* 2020-04-22T13:58:02.565 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-04-22T13:58:02.566 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:02.617 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:02 +0000 (0:00:00.088) 0:03:20.708 ******* 2020-04-22T13:58:02.827 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-04-22T13:58:02.828 INFO:teuthology.task.ansible.out:fatal: [smithi103.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006668", "end": "2020-04-22 13:58:02.803549", "msg": "non-zero return code", "rc": 1, "start": "2020-04-22 13:58:02.796881", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-04-22T13:58:02.866 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:02 +0000 (0:00:00.248) 0:03:20.957 ******* 2020-04-22T13:58:02.913 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-04-22T13:58:02.915 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:02.953 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:02 +0000 (0:00:00.087) 0:03:21.045 ******* 2020-04-22T13:58:06.196 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-04-22T13:58:06.197 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: tuned-2.12.0-3.el8_1.1.noarch", "Removed: hdparm-9.54-2.el8.x86_64", "Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64"]} 2020-04-22T13:58:06.233 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:06 +0000 (0:00:03.279) 0:03:24.324 ******* 2020-04-22T13:58:08.594 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ changed: [smithi103.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:2.12.0-88.module+el8.1.0+5708+85d8e057.3.x86_64"]} 2020-04-22T13:58:08.639 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:08 +0000 (0:00:02.403) 0:03:26.728 ******* 2020-04-22T13:58:14.594 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* changed: [smithi103.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: tuned-2.12.0-3.el8_1.1.noarch", "Removed: hdparm-9.54-2.el8.x86_64", "Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64"]} 2020-04-22T13:58:14.635 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:14 +0000 (0:00:05.998) 0:03:32.726 ******* 2020-04-22T13:58:16.767 INFO:teuthology.task.ansible.out: TASK [testnode : Base group workaround for BZ1782899] ************************** 2020-04-22T13:58:16.768 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => {"changed": true, "cmd": "dnf -y groupinstall base --nobest && dnf -y group upgrade base", "delta": "0:00:10.304032", "end": "2020-04-22 13:58:16.737266", "rc": 0, "start": "2020-04-22 13:58:06.433234", "stderr": "", "stderr_lines": [], "stdout": "Updating Subscription Management repositories.\nCopr repo for ceph-el8 owned by ktdreyer 67 kB/s | 3.3 kB 00:00 \nExtra Packages for Enterprise Linux 122 kB/s | 4.7 kB 00:00 \nlab-extras 1.2 MB/s | 2.9 kB 00:00 \nRed Hat Enterprise Linux 8 for x86_64 - AppStre 89 kB/s | 2.8 kB 00:00 \nRed Hat Enterprise Linux 8 for x86_64 - BaseOS 80 kB/s | 2.4 kB 00:00 \nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n================================================================================\nInstalling Groups:\n Base \n\nTransaction Summary\n================================================================================\n\nComplete!\nUpdating Subscription Management repositories.\nRed Hat Enterprise Linux 8 for x86_64 - AppStre 85 kB/s | 2.8 kB 00:00 \nRed Hat Enterprise Linux 8 for x86_64 - BaseOS 73 kB/s | 2.4 kB 00:00 \nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n================================================================================\nUpgrading Groups:\n Base \n\nTransaction Summary\n================================================================================\n\nComplete!", "stdout_lines": ["Updating Subscription Management repositories.", " 2020-04-22T13:58:16.770 INFO:teuthology.task.ansible.out:Copr repo for ceph-el8 owned by ktdreyer 67 kB/s | 3.3 kB 00:00 ", "Extra Packages for Enterprise Linux 122 kB/s | 4.7 kB 00:00 ", "lab-extras 1.2 MB/s | 2.9 kB 00:00 ", "Red Hat Enterprise Linux 8 for x86_64 - AppStre 89 kB/s | 2.8 kB 00:00 ", "Red Hat Enterprise Linux 8 for x86_64 - BaseOS 80 kB/s | 2.4 kB 00:00 ", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Installing Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!", "Updating Subscription Management repositories.", "Red Hat Enterprise Linux 8 for x86_64 - AppStre 85 kB/s | 2.8 kB 00:00 ", "Red Hat Enterprise Linux 8 for x86_64 - BaseOS 73 kB/s | 2.4 kB 00:00 ", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Upgrading Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!"]} 2020-04-22T13:58:16.807 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:16 +0000 (0:00:02.172) 0:03:34.899 ******* 2020-04-22T13:58:25.675 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"changed": true, "cmd": "dnf -y groupinstall base --nobest && dnf -y group upgrade base", "delta": "0:00:10.824857", "end": "2020-04-22 13:58:25.653076", "rc": 0, "start": "2020-04-22 13:58:14.828219", "stderr": "", "stderr_lines": [], "stdout": "Updating Subscription Management repositories.\nCopr repo for ceph-el8 owned by ktdreyer 78 kB/s | 3.3 kB 00:00 \nExtra Packages for Enterprise Linux 123 kB/s | 4.7 kB 00:00 \nlab-extras 1.2 MB/s | 2.9 kB 00:00 \nRed Hat Enterprise Linux 8 for x86_64 - AppStre 93 kB/s | 2.8 kB 00:00 \nRed Hat Enterprise Linux 8 for x86_64 - BaseOS 76 kB/s | 2.4 kB 00:00 \nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n================================================================================\nInstalling Groups:\n Base \n\nTransaction Summary\n================================================================================\n\nComplete!\nUpdating Subscription Management repositories.\nRed Hat Enterprise Linux 8 for x86_64 - AppStre 85 kB/s | 2.8 kB 00:00 \nRed Hat Enterprise Linux 8 for x86_64 - BaseOS 68 kB/s | 2.4 kB 00:00 \nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n================================================================================\nUpgrading Groups:\n Base \n\nTransaction Summary\n================================================================================\n\nComplete!", "stdout_lines": ["Updating Subscription Management repositories.", " 2020-04-22T13:58:25.676 INFO:teuthology.task.ansible.out:Copr repo for ceph-el8 owned by ktdreyer 78 kB/s | 3.3 kB 00:00 ", "Extra Packages for Enterprise Linux 123 kB/s | 4.7 kB 00:00 ", "lab-extras 1.2 MB/s | 2.9 kB 00:00 ", "Red Hat Enterprise Linux 8 for x86_64 - AppStre 93 kB/s | 2.8 kB 00:00 ", "Red Hat Enterprise Linux 8 for x86_64 - BaseOS 76 kB/s | 2.4 kB 00:00 ", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Installing Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!", "Updating Subscription Management repositories.", "Red Hat Enterprise Linux 8 for x86_64 - AppStre 85 kB/s | 2.8 kB 00:00 ", "Red Hat Enterprise Linux 8 for x86_64 - BaseOS 68 kB/s | 2.4 kB 00:00 ", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Upgrading Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!"]} 2020-04-22T13:58:25.716 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:25 +0000 (0:00:08.908) 0:03:43.808 ******* 2020-04-22T13:58:35.765 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* changed: [smithi086.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Group core installed.", "Group base installed.", "Installed: dnf-utils", "Installed: git-all", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: podman", "Installed: podman-docker", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: tuned-2.12.0-3.el8_1.1.noarch", "Installed: iozone-3.489-1.el8.x86_64", "Installed: hdparm-9.54-2.el8.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-88.module+el8.1.0+5708+85d8e057.3.x86_64", "Installed: boost-random-1.66.0-6.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: boost-program-options-1.66.0-6.el8.x86_64", "Installed: git-email-2.18.2-2.el8_1.noarch", "Installed: git-all-2.18.2-2.el8_1.noarch", "Installed: git-core-2.18.2-2.el8_1.x86_64", "Installed: perl-Git-SVN-2.18.2-2.el8_1.noarch", "Installed: git-gui-2.18.2-2.el8_1.noarch", "Installed: git-svn-2.18.2-2.el8_1.x86_64", "Installed: git-subtree-2.18.2-2.el8_1.x86_64", "Installed: perl-Git-2.18.2-2.el8_1.noarch", "Installed: gitweb-2.18.2-2.el8_1.noarch", "Installed: git-core-doc-2.18.2-2.el8_1.noarch", "Installed: gitk-2.18.2-2.el8_1.n 2020-04-22T13:58:35.770 INFO:teuthology.task.ansible.out:oarch", "Installed: git-instaweb-2.18.2-2.el8_1.x86_64", "Installed: git-2.18.2-2.el8_1.x86_64", "Removed: git-2.18.2-1.el8_1.x86_64", "Removed: git-all-2.18.2-1.el8_1.noarch", "Removed: git-core-2.18.2-1.el8_1.x86_64", "Removed: git-core-doc-2.18.2-1.el8_1.noarch", "Removed: git-email-2.18.2-1.el8_1.noarch", "Removed: git-gui-2.18.2-1.el8_1.noarch", "Removed: git-instaweb-2.18.2-1.el8_1.x86_64", "Removed: git-subtree-2.18.2-1.el8_1.x86_64", "Removed: git-svn-2.18.2-1.el8_1.x86_64", "Removed: gitk-2.18.2-1.el8_1.noarch", "Removed: gitweb-2.18.2-1.el8_1.noarch", "Removed: perl-Git-2.18.2-1.el8_1.noarch", "Removed: perl-Git-SVN-2.18.2-1.el8_1.noarch"]} 2020-04-22T13:58:35.800 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:35 +0000 (0:00:10.084) 0:03:53.892 ******* 2020-04-22T13:58:37.907 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: dbench"]} 2020-04-22T13:58:37.953 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:37 +0000 (0:00:02.151) 0:03:56.044 ******* 2020-04-22T13:58:40.004 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-04-22T13:58:40.006 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-04-22T13:58:40.041 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:40 +0000 (0:00:02.089) 0:03:58.133 ******* 2020-04-22T13:58:40.078 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-22T13:58:40.080 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:40.116 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:40 +0000 (0:00:00.074) 0:03:58.207 ******* 2020-04-22T13:58:40.440 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "basic.target dbus.service polkit.service sysinit.target system.slice dbus.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "iptables.service shutdown.target ebtables.service ipset.service ip6tables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": " 2020-04-22T13:58:40.441 INFO:teuthology.task.ansible.out:/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127442", "LimitNPROCSoft": "127442", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Li 2020-04-22T13:58:40.443 INFO:teuthology.task.ansible.out:mitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127442", "LimitSIGPENDINGSoft": "127442", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice dbus.socket", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWh 2020-04-22T13:58:40.444 INFO:teuthology.task.ansible.out:enUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-04-22T13:58:40.474 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:40 +0000 (0:00:00.357) 0:03:58.565 ******* 2020-04-22T13:58:40.772 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ fatal: [smithi086.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-04-22T13:58:40.815 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:40 +0000 (0:00:00.340) 0:03:58.906 ******* 2020-04-22T13:58:41.546 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-04-22T13:58:41.549 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-04-22T13:58:41.591 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:41 +0000 (0:00:00.776) 0:03:59.682 ******* 2020-04-22T13:58:41.618 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-04-22T13:58:41.620 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:41.661 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:41 +0000 (0:00:00.070) 0:03:59.752 ******* 2020-04-22T13:58:41.703 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-04-22T13:58:41.755 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:41 +0000 (0:00:00.093) 0:03:59.846 ******* 2020-04-22T13:58:41.793 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-04-22T13:58:41.794 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:41.858 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:41 +0000 (0:00:00.103) 0:03:59.950 ******* 2020-04-22T13:58:41.885 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-04-22T13:58:41.887 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:41.924 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:41 +0000 (0:00:00.065) 0:04:00.015 ******* 2020-04-22T13:58:41.962 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-04-22T13:58:41.964 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-04-22T13:58:41.973 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-04-22T13:58:42.018 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:42 +0000 (0:00:00.093) 0:04:00.109 ******* 2020-04-22T13:58:42.046 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:42.088 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:42 +0000 (0:00:00.069) 0:04:00.179 ******* 2020-04-22T13:58:42.115 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-04-22T13:58:42.159 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:42 +0000 (0:00:00.070) 0:04:00.250 ******* 2020-04-22T13:58:42.187 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:42.224 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:42 +0000 (0:00:00.065) 0:04:00.316 ******* 2020-04-22T13:58:42.251 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:42.305 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:42 +0000 (0:00:00.080) 0:04:00.396 ******* 2020-04-22T13:58:42.332 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-04-22T13:58:42.333 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:42.369 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:42 +0000 (0:00:00.063) 0:04:00.460 ******* 2020-04-22T13:58:42.396 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-22T13:58:42.398 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:42.439 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:42 +0000 (0:00:00.068) 0:04:00.528 ******* 2020-04-22T13:58:42.464 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-04-22T13:58:42.465 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:42.506 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:42 +0000 (0:00:00.068) 0:04:00.597 ******* 2020-04-22T13:58:42.533 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-04-22T13:58:42.535 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:42.573 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:42 +0000 (0:00:00.067) 0:04:00.665 ******* 2020-04-22T13:58:42.610 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-04-22T13:58:42.612 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:42.655 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:42 +0000 (0:00:00.082) 0:04:00.747 ******* 2020-04-22T13:58:42.682 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-04-22T13:58:42.684 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:42.724 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:42 +0000 (0:00:00.067) 0:04:00.814 ******* 2020-04-22T13:58:42.751 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-04-22T13:58:42.753 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:42.794 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:42 +0000 (0:00:00.070) 0:04:00.885 ******* 2020-04-22T13:58:42.821 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-04-22T13:58:42.822 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:42.858 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:42 +0000 (0:00:00.063) 0:04:00.949 ******* 2020-04-22T13:58:42.885 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-04-22T13:58:42.886 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:42.924 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:42 +0000 (0:00:00.065) 0:04:01.015 ******* 2020-04-22T13:58:42.950 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-04-22T13:58:42.952 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:42.988 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:42 +0000 (0:00:00.064) 0:04:01.080 ******* 2020-04-22T13:58:43.015 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-04-22T13:58:43.017 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:43.054 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:43 +0000 (0:00:00.065) 0:04:01.145 ******* 2020-04-22T13:58:43.080 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-04-22T13:58:43.082 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:43.117 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:43 +0000 (0:00:00.063) 0:04:01.208 ******* 2020-04-22T13:58:43.145 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-04-22T13:58:43.147 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:43.186 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:43 +0000 (0:00:00.068) 0:04:01.277 ******* 2020-04-22T13:58:43.213 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:43.258 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:43 +0000 (0:00:00.068) 0:04:01.345 ******* 2020-04-22T13:58:43.282 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-04-22T13:58:43.284 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:43.321 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:43 +0000 (0:00:00.066) 0:04:01.412 ******* 2020-04-22T13:58:43.348 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-04-22T13:58:43.350 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:43.386 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:43 +0000 (0:00:00.064) 0:04:01.477 ******* 2020-04-22T13:58:43.413 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-04-22T13:58:43.414 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:43.451 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:43 +0000 (0:00:00.064) 0:04:01.542 ******* 2020-04-22T13:58:43.477 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-04-22T13:58:43.479 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:43.514 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:43 +0000 (0:00:00.063) 0:04:01.606 ******* 2020-04-22T13:58:43.552 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-04-22T13:58:43.553 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:43.592 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:43 +0000 (0:00:00.075) 0:04:01.681 ******* 2020-04-22T13:58:43.617 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-04-22T13:58:43.618 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:43.672 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:43 +0000 (0:00:00.082) 0:04:01.764 ******* 2020-04-22T13:58:43.699 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-22T13:58:43.700 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:43.738 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:43 +0000 (0:00:00.064) 0:04:01.828 ******* 2020-04-22T13:58:43.769 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:43.802 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:43 +0000 (0:00:00.064) 0:04:01.893 ******* 2020-04-22T13:58:43.846 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:43.881 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:43 +0000 (0:00:00.078) 0:04:01.973 ******* 2020-04-22T13:58:43.909 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-22T13:58:43.910 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:43.953 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:43 +0000 (0:00:00.065) 0:04:02.039 ******* 2020-04-22T13:58:43.974 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-04-22T13:58:43.976 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:44.016 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:44 +0000 (0:00:00.068) 0:04:02.107 ******* 2020-04-22T13:58:44.042 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-04-22T13:58:44.044 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:44.090 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:44 +0000 (0:00:00.069) 0:04:02.177 ******* 2020-04-22T13:58:44.123 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-04-22T13:58:44.125 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:44.163 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:44 +0000 (0:00:00.077) 0:04:02.254 ******* 2020-04-22T13:58:44.191 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-04-22T13:58:44.192 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:44.229 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:44 +0000 (0:00:00.065) 0:04:02.320 ******* 2020-04-22T13:58:44.269 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:44.314 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:44 +0000 (0:00:00.085) 0:04:02.405 ******* 2020-04-22T13:58:44.344 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:44.382 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:44 +0000 (0:00:00.068) 0:04:02.474 ******* 2020-04-22T13:58:44.411 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:44.454 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:44 +0000 (0:00:00.067) 0:04:02.541 ******* 2020-04-22T13:58:44.477 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:44.515 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:44 +0000 (0:00:00.065) 0:04:02.606 ******* 2020-04-22T13:58:44.553 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-04-22T13:58:44.555 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:44.595 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:44 +0000 (0:00:00.079) 0:04:02.686 ******* 2020-04-22T13:58:44.622 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-04-22T13:58:44.624 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:44.665 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:44 +0000 (0:00:00.070) 0:04:02.756 ******* 2020-04-22T13:58:44.694 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:44.738 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:44 +0000 (0:00:00.072) 0:04:02.829 ******* 2020-04-22T13:58:44.770 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:44.806 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:44 +0000 (0:00:00.068) 0:04:02.897 ******* 2020-04-22T13:58:44.834 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-04-22T13:58:44.836 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:44.877 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:44 +0000 (0:00:00.070) 0:04:02.968 ******* 2020-04-22T13:58:44.903 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-04-22T13:58:44.905 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:44.940 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:44 +0000 (0:00:00.063) 0:04:03.031 ******* 2020-04-22T13:58:44.968 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:45.009 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:45 +0000 (0:00:00.067) 0:04:03.098 ******* 2020-04-22T13:58:45.033 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-04-22T13:58:45.035 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:45.070 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:45 +0000 (0:00:00.062) 0:04:03.161 ******* 2020-04-22T13:58:45.113 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:45.134 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:45 +0000 (0:00:00.063) 0:04:03.224 ******* 2020-04-22T13:58:45.175 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:45.208 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:45 +0000 (0:00:00.074) 0:04:03.299 ******* 2020-04-22T13:58:45.235 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-04-22T13:58:45.236 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Group core installed.", "Group base installed.", "Installed: dnf-utils", "Installed: git-all", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: podman", "Installed: podman-docker", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: tuned-2.12.0-3.el8_1.1.noarch", "Installed: iozone-3.489-1.el8.x86_64", "Installed: hdparm-9.54-2.el8.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-88.module+el8.1.0+5708+85d8e057.3.x86_64", "Installed: boost-random-1.66.0-6.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: boost-program-options-1.66.0-6.el8.x86_64", "Installed: git-email-2.18.2-2.el8_1.noarch", "Installed: git-all-2.18.2-2.el8_1.noarch", "Installed: git-core-2.18.2-2.el8_1.x86_64", "Installed: perl-Git-SVN-2.18.2-2.el8_1.noarch", "Installed: git-gui-2.18.2-2.el8_1.noarch", "Installed: git-svn-2.18.2-2.el8_1.x86_64", "Installed: git-subtree-2.18.2-2.el8_1.x86_64", "Installed: perl-Git-2.18.2-2.el8_1.noarch", "Installed: gitweb-2.18.2-2.el8_1.noarch", "Installed: git-core-doc-2.18.2-2.el8_1.noarch", "Installed: gitk-2.18.2-2.el8_1.noarch", "Installed: git-instaweb-2.18.2-2.el8_1.x86_64", "Installed: git-2.18.2-2.el 2020-04-22T13:58:45.237 INFO:teuthology.task.ansible.out:8_1.x86_64", "Removed: git-2.18.2-1.el8_1.x86_64", "Removed: git-all-2.18.2-1.el8_1.noarch", "Removed: git-core-2.18.2-1.el8_1.x86_64", "Removed: git-core-doc-2.18.2-1.el8_1.noarch", "Removed: git-email-2.18.2-1.el8_1.noarch", "Removed: git-gui-2.18.2-1.el8_1.noarch", "Removed: git-instaweb-2.18.2-1.el8_1.x86_64", "Removed: git-subtree-2.18.2-1.el8_1.x86_64", "Removed: git-svn-2.18.2-1.el8_1.x86_64", "Removed: gitk-2.18.2-1.el8_1.noarch", "Removed: gitweb-2.18.2-1.el8_1.noarch", "Removed: perl-Git-2.18.2-1.el8_1.noarch", "Removed: perl-Git-SVN-2.18.2-1.el8_1.noarch"]} TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:45.273 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:45 +0000 (0:00:00.065) 0:04:03.364 ******* 2020-04-22T13:58:45.315 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:45 +0000 (0:00:00.042) 0:04:03.407 ******* 2020-04-22T13:58:45.324 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:45.360 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:45 +0000 (0:00:00.044) 0:04:03.451 ******* 2020-04-22T13:58:45.387 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:45.433 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:45 +0000 (0:00:00.071) 0:04:03.523 ******* 2020-04-22T13:58:45.459 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-04-22T13:58:45.461 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:45.510 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:45 +0000 (0:00:00.078) 0:04:03.601 ******* 2020-04-22T13:58:45.537 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:45.586 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:45 +0000 (0:00:00.075) 0:04:03.677 ******* 2020-04-22T13:58:45.624 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-04-22T13:58:45.625 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:45.662 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:45 +0000 (0:00:00.076) 0:04:03.753 ******* 2020-04-22T13:58:45.689 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:45.727 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:45 +0000 (0:00:00.064) 0:04:03.818 ******* 2020-04-22T13:58:45.756 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:45.797 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:45 +0000 (0:00:00.068) 0:04:03.887 ******* 2020-04-22T13:58:45.830 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-22T13:58:45.831 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-04-22T13:58:45.887 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:45 +0000 (0:00:00.086) 0:04:03.973 ******* 2020-04-22T13:58:45.929 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-04-22T13:58:45.931 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-04-22T13:58:45.941 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-04-22T13:58:45.952 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-04-22T13:58:45.964 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} skipping: [smithi086.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-04-22T13:58:45.975 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-04-22T13:58:45.986 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-04-22T13:58:46.034 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:46 +0000 (0:00:00.151) 0:04:04.125 ******* 2020-04-22T13:58:46.187 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-04-22T13:58:46.189 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.005160", "end": "2020-04-22 13:58:46.170589", "rc": 0, "start": "2020-04-22 13:58:46.165429", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-04-22T13:58:46.235 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:46 +0000 (0:00:00.200) 0:04:04.326 ******* 2020-04-22T13:58:46.272 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-04-22T13:58:46.273 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:46.316 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:46 +0000 (0:00:00.081) 0:04:04.408 ******* 2020-04-22T13:58:46.353 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-04-22T13:58:46.355 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:46.394 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:46 +0000 (0:00:00.077) 0:04:04.485 ******* 2020-04-22T13:58:46.421 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-04-22T13:58:46.422 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:46.465 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:46 +0000 (0:00:00.065) 0:04:04.551 ******* 2020-04-22T13:58:46.486 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-04-22T13:58:46.488 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:46.534 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:46 +0000 (0:00:00.073) 0:04:04.625 ******* 2020-04-22T13:58:47.276 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: dbench"]} 2020-04-22T13:58:47.316 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:47 +0000 (0:00:00.781) 0:04:05.407 ******* 2020-04-22T13:58:48.608 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-04-22T13:58:48.609 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-04-22T13:58:48.649 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:48 +0000 (0:00:01.333) 0:04:06.741 ******* 2020-04-22T13:58:48.701 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ ok: [smithi086.front.sepia.ceph.com] => (item={u'block_used': 12917985, u'uuid': u'4c3388fe-767b-4a89-b244-838ed5539484', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227177123, u'size_available': 930517495808, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60987179, u'device': u'/dev/sda1', u'inode_used': 67797, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227177123, "block_size": 4096, "block_total": 240095108, "block_used": 12917985, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60987179, "inode_total": 61054976, "inode_used": 67797, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930517495808, "size_total": 983429562368, "uuid": "4c3388fe-767b-4a89-b244-838ed5539484"}} 2020-04-22T13:58:48.756 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:48 +0000 (0:00:00.101) 0:04:06.842 ******* 2020-04-22T13:58:48.960 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-04-22T13:58:48.961 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.004997", "end": "2020-04-22 13:58:48.930157", "rc": 0, "start": "2020-04-22 13:58:48.925160", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-22T13:58:49.012 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:49 +0000 (0:00:00.260) 0:04:07.103 ******* 2020-04-22T13:58:49.051 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-04-22T13:58:49.052 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'block_used': 12917985, u'uuid': u'4c3388fe-767b-4a89-b244-838ed5539484', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227177123, u'size_available': 930517495808, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60987179, u'device': u'/dev/sda1', u'inode_used': 67797, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227177123, "block_size": 4096, "block_total": 240095108, "block_used": 12917985, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60987179, "inode_total": 61054976, "inode_used": 67797, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930517495808, "size_total": 983429562368, "uuid": "4c3388fe-767b-4a89-b244-838ed5539484"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:49.093 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:49 +0000 (0:00:00.081) 0:04:07.184 ******* 2020-04-22T13:58:49.119 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-04-22T13:58:49.164 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:49 +0000 (0:00:00.070) 0:04:07.255 ******* 2020-04-22T13:58:49.202 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-04-22T13:58:49.203 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5LGQ8', u'wwn-0x5000c500918e8385'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5LGQ8', u'wwn': u'0x5000c500918e8385', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'4c3388fe-767b-4a89-b244-838ed5539484', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5LGQ8-part1', u'wwn-0x5000c500918e8385-part1'], u'uuids': [u'4c3388fe-767b-4a89-b244-838ed5539484']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LGQ8", "wwn-0x5000c500918e8385"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LGQ8-part1", "wwn-0x5000c500918e8385-part1"], "labels": [], "masters": [], "uuids": ["4c3388fe-767b-4a89-b244-838ed5539484"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "4c3388fe-767b-4a89-b244-838ed5539484"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5LGQ8", "size": "931.51 GB", "support_discard": "0", "vend 2020-04-22T13:58:49.205 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c500918e8385"}}, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:49.443 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-04-22T13:58:49.445 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-04-22T13:58:49.484 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:49 +0000 (0:00:00.319) 0:04:07.575 ******* 2020-04-22T13:58:49.522 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-22T13:58:49.524 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:49.562 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:49 +0000 (0:00:00.078) 0:04:07.654 ******* 2020-04-22T13:58:49.890 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-04-22T13:58:49.895 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "system.slice polkit.service basic.target dbus.socket dbus.service sysinit.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "ipset.service ip6tables.service ebtables.service shutdown.target iptables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTim 2020-04-22T13:58:49.901 INFO:teuthology.task.ansible.out:estampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127442", "LimitNPROCSoft": "127442", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127442", 2020-04-22T13:58:49.902 INFO:teuthology.task.ansible.out:"LimitSIGPENDINGSoft": "127442", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "dbus.socket system.slice sysinit.target", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3 2020-04-22T13:58:49.904 INFO:teuthology.task.ansible.out:", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-04-22T13:58:49.933 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:49 +0000 (0:00:00.371) 0:04:08.025 ******* 2020-04-22T13:58:50.231 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-04-22T13:58:50.233 INFO:teuthology.task.ansible.out:fatal: [smithi103.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-04-22T13:58:50.271 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:50 +0000 (0:00:00.337) 0:04:08.362 ******* 2020-04-22T13:58:50.558 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-04-22T13:58:50.559 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-04-22T13:58:50.600 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:50 +0000 (0:00:00.328) 0:04:08.691 ******* 2020-04-22T13:58:50.600 INFO:teuthology.task.ansible.out: 2020-04-22T13:58:50.633 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:50.671 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:50 +0000 (0:00:00.068) 0:04:08.760 ******* 2020-04-22T13:58:50.696 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-04-22T13:58:50.745 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:50 +0000 (0:00:00.071) 0:04:08.831 ******* 2020-04-22T13:58:50.766 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-04-22T13:58:50.768 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:50.812 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:50 +0000 (0:00:00.071) 0:04:08.903 ******* 2020-04-22T13:58:50.818 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-04-22T13:58:50.819 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-1mV4mF-RCJO-e6EH-7EPZ-rCti-9OMz-k27AV9', u'nvme-INTEL_SSDPEDMD400G4_PHFT620400UL400BGN', u'nvme-nvme.8086-50484654363230343030554c34303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.406310", "end": "2020-04-22 13:58:50.768751", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-1mV4mF-RCJO-e6EH-7EPZ-rCti-9OMz-k27AV9", "nvme-INTEL_SSDPEDMD400G4_PHFT620400UL400BGN", "nvme-nvme.8086-50484654363230343030554c34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-22 13:58:49.362441", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2020-04-22T13:58:50.820 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-22T13:58:50.841 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-04-22T13:58:50.843 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:50.879 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:50 +0000 (0:00:00.067) 0:04:08.970 ******* 2020-04-22T13:58:50.926 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-04-22T13:58:50.928 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-04-22T13:58:50.964 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:50 +0000 (0:00:00.085) 0:04:09.056 ******* 2020-04-22T13:58:50.991 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-04-22T13:58:50.992 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:51.029 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:51 +0000 (0:00:00.064) 0:04:09.121 ******* 2020-04-22T13:58:51.056 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-04-22T13:58:51.113 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:51 +0000 (0:00:00.083) 0:04:09.204 ******* 2020-04-22T13:58:51.145 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:51.177 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:51 +0000 (0:00:00.064) 0:04:09.269 ******* 2020-04-22T13:58:51.218 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-04-22T13:58:51.220 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:51.256 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:51 +0000 (0:00:00.078) 0:04:09.347 ******* 2020-04-22T13:58:51.292 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-04-22T13:58:51.294 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:51.330 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:51 +0000 (0:00:00.073) 0:04:09.421 ******* 2020-04-22T13:58:51.367 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-22T13:58:51.369 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:51.414 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:51 +0000 (0:00:00.083) 0:04:09.505 ******* 2020-04-22T13:58:51.440 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-04-22T13:58:51.442 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:51.479 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:51 +0000 (0:00:00.065) 0:04:09.570 ******* 2020-04-22T13:58:51.507 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-04-22T13:58:51.508 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:51.552 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:51 +0000 (0:00:00.072) 0:04:09.643 ******* 2020-04-22T13:58:51.579 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-04-22T13:58:51.581 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:51.631 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:51 +0000 (0:00:00.079) 0:04:09.722 ******* 2020-04-22T13:58:51.659 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-04-22T13:58:51.661 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:51.717 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:51 +0000 (0:00:00.086) 0:04:09.808 ******* 2020-04-22T13:58:51.743 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-04-22T13:58:51.745 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:51.786 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:51 +0000 (0:00:00.069) 0:04:09.878 ******* 2020-04-22T13:58:51.815 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:51.851 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:51 +0000 (0:00:00.064) 0:04:09.942 ******* 2020-04-22T13:58:51.886 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:51.924 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:51 +0000 (0:00:00.072) 0:04:10.015 ******* 2020-04-22T13:58:51.954 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:51.988 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:51 +0000 (0:00:00.063) 0:04:10.079 ******* 2020-04-22T13:58:52.014 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-04-22T13:58:52.015 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:52.054 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:52 +0000 (0:00:00.066) 0:04:10.145 ******* 2020-04-22T13:58:52.081 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-04-22T13:58:52.082 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Zap all non-root disks] *************************************** 2020-04-22T13:58:52.083 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-mrPLaDWmRyZ0N10zKBu1D5yHVWIcgs1laalI3GYpXJcuvio2lsQ1rTUtY5fiuQDy'], u'uuids': [u'ea994755-70bc-4be3-9221-4c7a49636fd3']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.060450", "end": "2020-04-22 13:58:52.044758", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-mrPLaDWmRyZ0N10zKBu1D5yHVWIcgs1laalI3GYpXJcuvio2lsQ1rTUtY5fiuQDy"], "labels": [], "masters": [], "uuids": ["ea994755-70bc-4be3-9221-4c7a49636fd3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-22 13:58:50.984308", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table 2020-04-22T13:58:52.084 INFO:teuthology.task.ansible.out: will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-22T13:58:52.122 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:52 +0000 (0:00:00.066) 0:04:10.212 ******* 2020-04-22T13:58:52.151 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-04-22T13:58:52.153 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:52.190 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:52 +0000 (0:00:00.069) 0:04:10.281 ******* 2020-04-22T13:58:52.216 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-04-22T13:58:52.218 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:52.255 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:52 +0000 (0:00:00.064) 0:04:10.346 ******* 2020-04-22T13:58:52.281 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-04-22T13:58:52.282 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:52.320 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:52 +0000 (0:00:00.065) 0:04:10.411 ******* 2020-04-22T13:58:52.348 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-04-22T13:58:52.349 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:52.386 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:52 +0000 (0:00:00.066) 0:04:10.478 ******* 2020-04-22T13:58:52.413 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-04-22T13:58:52.414 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:52.461 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:52 +0000 (0:00:00.065) 0:04:10.543 ******* 2020-04-22T13:58:52.478 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-04-22T13:58:52.481 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:52.516 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:52 +0000 (0:00:00.063) 0:04:10.607 ******* 2020-04-22T13:58:52.544 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-04-22T13:58:52.545 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:52.585 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:52 +0000 (0:00:00.068) 0:04:10.676 ******* 2020-04-22T13:58:52.613 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:52.650 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:52 +0000 (0:00:00.065) 0:04:10.741 ******* 2020-04-22T13:58:52.678 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-22T13:58:52.680 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:52.719 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:52 +0000 (0:00:00.068) 0:04:10.810 ******* 2020-04-22T13:58:52.721 INFO:teuthology.task.ansible.out: 2020-04-22T13:58:52.748 INFO:teuthology.task.ansible.out: 2020-04-22T13:58:52.749 INFO:teuthology.task.ansible.out:TASK [testnode : Remove packages] ********************************************** skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:52.791 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:52 +0000 (0:00:00.072) 0:04:10.883 ******* 2020-04-22T13:58:52.793 INFO:teuthology.task.ansible.out: 2020-04-22T13:58:52.828 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-04-22T13:58:52.830 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:52.867 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:52 +0000 (0:00:00.075) 0:04:10.958 ******* 2020-04-22T13:58:52.894 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-22T13:58:52.895 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:52.930 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:52 +0000 (0:00:00.063) 0:04:11.021 ******* 2020-04-22T13:58:52.977 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-04-22T13:58:52.979 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:53.019 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:53 +0000 (0:00:00.089) 0:04:11.111 ******* 2020-04-22T13:58:53.056 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-04-22T13:58:53.058 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:53.098 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:53 +0000 (0:00:00.078) 0:04:11.189 ******* 2020-04-22T13:58:53.137 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-04-22T13:58:53.138 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:53.178 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:53 +0000 (0:00:00.079) 0:04:11.269 ******* 2020-04-22T13:58:53.203 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-04-22T13:58:53.204 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:53.244 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:53 +0000 (0:00:00.066) 0:04:11.336 ******* 2020-04-22T13:58:53.281 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-04-22T13:58:53.283 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:53.322 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:53 +0000 (0:00:00.077) 0:04:11.413 ******* 2020-04-22T13:58:53.339 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-04-22T13:58:53.341 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-mrPLaDWmRyZ0N10zKBu1D5yHVWIcgs1ltZD5oW75V5c4C07XllmZXkTTbtAVwvdk'], u'uuids': [u'ed7f90bb-3014-422c-9466-558bdf46783b']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.055692", "end": "2020-04-22 13:58:53.309100", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-mrPLaDWmRyZ0N10zKBu1D5yHVWIcgs1ltZD5oW75V5c4C07XllmZXkTTbtAVwvdk"], "labels": [], "masters": [], "uuids": ["ed7f90bb-3014-422c-9466-558bdf46783b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-22 13:58:52.253408", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-22T13:58:53.353 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-04-22T13:58:53.354 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:53.393 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:53 +0000 (0:00:00.071) 0:04:11.485 ******* 2020-04-22T13:58:53.420 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-04-22T13:58:53.421 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:53.462 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:53 +0000 (0:00:00.068) 0:04:11.553 ******* 2020-04-22T13:58:53.505 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:53.547 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:53 +0000 (0:00:00.084) 0:04:11.638 ******* 2020-04-22T13:58:53.574 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:53.622 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:53 +0000 (0:00:00.074) 0:04:11.713 ******* 2020-04-22T13:58:53.648 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-04-22T13:58:53.649 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:53.687 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:53 +0000 (0:00:00.065) 0:04:11.779 ******* 2020-04-22T13:58:53.716 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:53.759 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:53 +0000 (0:00:00.071) 0:04:11.850 ******* 2020-04-22T13:58:53.789 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:53.825 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:53 +0000 (0:00:00.065) 0:04:11.916 ******* 2020-04-22T13:58:53.853 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-04-22T13:58:53.854 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:53.894 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:53 +0000 (0:00:00.068) 0:04:11.985 ******* 2020-04-22T13:58:53.924 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:53.960 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:53 +0000 (0:00:00.066) 0:04:12.052 ******* 2020-04-22T13:58:53.987 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-04-22T13:58:53.988 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:54.033 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:54 +0000 (0:00:00.072) 0:04:12.124 ******* 2020-04-22T13:58:54.060 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-04-22T13:58:54.061 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:54.104 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:54 +0000 (0:00:00.071) 0:04:12.195 ******* 2020-04-22T13:58:54.135 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-04-22T13:58:54.137 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:54.173 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:54 +0000 (0:00:00.069) 0:04:12.264 ******* 2020-04-22T13:58:54.199 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-04-22T13:58:54.201 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:54.242 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:54 +0000 (0:00:00.064) 0:04:12.329 ******* 2020-04-22T13:58:54.263 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-04-22T13:58:54.265 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:54.301 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:54 +0000 (0:00:00.064) 0:04:12.393 ******* 2020-04-22T13:58:54.329 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-04-22T13:58:54.330 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:54.368 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:54 +0000 (0:00:00.066) 0:04:12.459 ******* 2020-04-22T13:58:54.394 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-04-22T13:58:54.396 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:54.432 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:54 +0000 (0:00:00.063) 0:04:12.523 ******* 2020-04-22T13:58:54.458 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-04-22T13:58:54.460 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:54.497 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:54 +0000 (0:00:00.064) 0:04:12.588 ******* 2020-04-22T13:58:54.525 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-04-22T13:58:54.526 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:54.569 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:54 +0000 (0:00:00.068) 0:04:12.656 ******* 2020-04-22T13:58:54.593 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:54.630 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:54 +0000 (0:00:00.064) 0:04:12.721 ******* 2020-04-22T13:58:54.638 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-04-22T13:58:54.639 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-mrPLaDWmRyZ0N10zKBu1D5yHVWIcgs1laeMuEPdFN0TpzpUZkT2sBX5CpT9IbJfk'], u'uuids': [u'7ed0940d-228c-4cb5-b5ba-2b0e498f1783']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.051501", "end": "2020-04-22 13:58:54.586244", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-mrPLaDWmRyZ0N10zKBu1D5yHVWIcgs1laeMuEPdFN0TpzpUZkT2sBX5CpT9IbJfk"], "labels": [], "masters": [], "uuids": ["7ed0940d-228c-4cb5-b5ba-2b0e498f1783"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-22 13:58:53.534743", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-22T13:58:54.672 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-04-22T13:58:54.674 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:54.723 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:54 +0000 (0:00:00.092) 0:04:12.814 ******* 2020-04-22T13:58:54.760 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:54.799 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:54 +0000 (0:00:00.075) 0:04:12.890 ******* 2020-04-22T13:58:54.835 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-22T13:58:54.837 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-04-22T13:58:54.875 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:54 +0000 (0:00:00.076) 0:04:12.966 ******* 2020-04-22T13:58:54.922 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi103.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-04-22T13:58:54.937 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-04-22T13:58:54.937 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-04-22T13:58:54.949 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-04-22T13:58:54.959 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-04-22T13:58:54.960 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-04-22T13:58:54.981 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-04-22T13:58:55.023 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:55 +0000 (0:00:00.148) 0:04:13.114 ******* 2020-04-22T13:58:55.197 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** changed: [smithi103.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003965", "end": "2020-04-22 13:58:55.166804", "rc": 0, "start": "2020-04-22 13:58:55.162839", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-04-22T13:58:55.244 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:55 +0000 (0:00:00.215) 0:04:13.329 ******* 2020-04-22T13:58:55.275 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-04-22T13:58:55.277 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:55.326 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:55 +0000 (0:00:00.087) 0:04:13.417 ******* 2020-04-22T13:58:55.363 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:55.402 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:55 +0000 (0:00:00.075) 0:04:13.493 ******* 2020-04-22T13:58:55.427 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-04-22T13:58:55.429 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:55.463 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:55 +0000 (0:00:00.061) 0:04:13.555 ******* 2020-04-22T13:58:55.489 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-04-22T13:58:55.491 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:55.528 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:55 +0000 (0:00:00.064) 0:04:13.619 ******* 2020-04-22T13:58:55.888 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-04-22T13:58:55.888 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-mrPLaDWmRyZ0N10zKBu1D5yHVWIcgs1lzTduLtcIfGY45aqKGv2RFGzB8rwie71F'], u'uuids': [u'55414b51-2725-4bfb-b914-2f5305fbc136']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.059225", "end": "2020-04-22 13:58:55.852627", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-mrPLaDWmRyZ0N10zKBu1D5yHVWIcgs1lzTduLtcIfGY45aqKGv2RFGzB8rwie71F"], "labels": [], "masters": [], "uuids": ["55414b51-2725-4bfb-b914-2f5305fbc136"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-22 13:58:54.793402", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-22T13:58:57.146 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-mrPLaDWmRyZ0N10zKBu1D5yHVWIcgs1lLGA4BeIIbtgZnpQotqUPH30hqAPKlSG7'], u'uuids': [u'b42aaf4c-cb1d-4ad6-aeca-d0833fa03219']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.062862", "end": "2020-04-22 13:58:57.111135", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-mrPLaDWmRyZ0N10zKBu1D5yHVWIcgs1lLGA4BeIIbtgZnpQotqUPH30hqAPKlSG7"], "labels": [], "masters": [], "uuids": ["b42aaf4c-cb1d-4ad6-aeca-d0833fa03219"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-22 13:58:56.048273", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-22T13:58:57.201 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:57 +0000 (0:00:01.672) 0:04:15.292 ******* 2020-04-22T13:58:57.241 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-04-22T13:58:57.242 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5LGQ8', u'wwn-0x5000c500918e8385'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5LGQ8', u'wwn': u'0x5000c500918e8385', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'4c3388fe-767b-4a89-b244-838ed5539484', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5LGQ8-part1', u'wwn-0x5000c500918e8385-part1'], u'uuids': [u'4c3388fe-767b-4a89-b244-838ed5539484']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LGQ8", "wwn-0x5000c500918e8385"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LGQ8-part1", "wwn-0x5000c500918e8385-part1"], "labels": [], "masters": [], "uuids": ["4c3388fe-767b-4a89-b244-838ed5539484"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "4c3388fe-767b-4a89-b244-838ed5539484"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5LGQ8", "size": "931.51 GB", "support_discard": "0", "vend 2020-04-22T13:58:57.244 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c500918e8385"}}, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:57.476 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-1mV4mF-RCJO-e6EH-7EPZ-rCti-9OMz-k27AV9', u'nvme-INTEL_SSDPEDMD400G4_PHFT620400UL400BGN', u'nvme-nvme.8086-50484654363230343030554c34303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.037343", "end": "2020-04-22 13:58:57.447369", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-1mV4mF-RCJO-e6EH-7EPZ-rCti-9OMz-k27AV9", "nvme-INTEL_SSDPEDMD400G4_PHFT620400UL400BGN", "nvme-nvme.8086-50484654363230343030554c34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-22 13:58:57.410026", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 11 2020-04-22T13:58:57.478 INFO:teuthology.task.ansible.out:0 MiB) copied, 0.0347312 s, 3.3 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0347312 s, 3.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-04-22T13:58:57.534 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-04-22T13:58:57.578 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:57 +0000 (0:00:00.377) 0:04:15.669 ******* 2020-04-22T13:58:57.625 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-04-22T13:58:57.626 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item={u'block_used': 12917985, u'uuid': u'4c3388fe-767b-4a89-b244-838ed5539484', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227177123, u'size_available': 930517495808, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60987179, u'device': u'/dev/sda1', u'inode_used': 67797, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227177123, "block_size": 4096, "block_total": 240095108, "block_used": 12917985, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60987179, "inode_total": 61054976, "inode_used": 67797, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930517495808, "size_total": 983429562368, "uuid": "4c3388fe-767b-4a89-b244-838ed5539484"}} 2020-04-22T13:58:57.665 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:57 +0000 (0:00:00.086) 0:04:15.756 ******* 2020-04-22T13:58:57.818 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-04-22T13:58:57.819 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-mrPLaDWmRyZ0N10zKBu1D5yHVWIcgs1laalI3GYpXJcuvio2lsQ1rTUtY5fiuQDy'], u'uuids': [u'ea994755-70bc-4be3-9221-4c7a49636fd3']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.142224", "end": "2020-04-22 13:58:57.787971", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-mrPLaDWmRyZ0N10zKBu1D5yHVWIcgs1laalI3GYpXJcuvio2lsQ1rTUtY5fiuQDy"], "labels": [], "masters": [], "uuids": ["ea994755-70bc-4be3-9221-4c7a49636fd3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-22 13:58:57.645747", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.139562 s, 826 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.139562 s, 826 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-22T13:58:57.865 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi103.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005090", "end": "2020-04-22 13:58:57.843974", "rc": 0, "start": "2020-04-22 13:58:57.838884", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-22T13:58:57.922 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:57 +0000 (0:00:00.256) 0:04:16.013 ******* 2020-04-22T13:58:57.972 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-04-22T13:58:57.973 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'block_used': 12917985, u'uuid': u'4c3388fe-767b-4a89-b244-838ed5539484', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227177123, u'size_available': 930517495808, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60987179, u'device': u'/dev/sda1', u'inode_used': 67797, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227177123, "block_size": 4096, "block_total": 240095108, "block_used": 12917985, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60987179, "inode_total": 61054976, "inode_used": 67797, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930517495808, "size_total": 983429562368, "uuid": "4c3388fe-767b-4a89-b244-838ed5539484"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:58.015 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:58 +0000 (0:00:00.093) 0:04:16.106 ******* 2020-04-22T13:58:58.042 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-04-22T13:58:58.086 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:58 +0000 (0:00:00.067) 0:04:16.173 ******* 2020-04-22T13:58:58.131 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-04-22T13:58:58.132 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QBMV', u'wwn-0x5000c50091e0b337'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5QBMV', u'wwn': u'0x5000c50091e0b337', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'4c3388fe-767b-4a89-b244-838ed5539484', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QBMV-part1', u'wwn-0x5000c50091e0b337-part1'], u'uuids': [u'4c3388fe-767b-4a89-b244-838ed5539484']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QBMV", "wwn-0x5000c50091e0b337"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QBMV-part1", "wwn-0x5000c50091e0b337-part1"], "labels": [], "masters": [], "uuids": ["4c3388fe-767b-4a89-b244-838ed5539484"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "4c3388fe-767b-4a89-b244-838ed5539484"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QBMV", "size": "931.51 GB", "support_discard": "0", "vend 2020-04-22T13:58:58.134 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c50091e0b337"}}, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:58.147 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-04-22T13:58:58.148 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-mrPLaDWmRyZ0N10zKBu1D5yHVWIcgs1ltZD5oW75V5c4C07XllmZXkTTbtAVwvdk'], u'uuids': [u'ed7f90bb-3014-422c-9466-558bdf46783b']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.142408", "end": "2020-04-22 13:58:58.113909", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-mrPLaDWmRyZ0N10zKBu1D5yHVWIcgs1ltZD5oW75V5c4C07XllmZXkTTbtAVwvdk"], "labels": [], "masters": [], "uuids": ["ed7f90bb-3014-422c-9466-558bdf46783b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-22 13:58:57.971501", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.139832 s, 825 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.139832 s, 825 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-22T13:58:58.479 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-mrPLaDWmRyZ0N10zKBu1D5yHVWIcgs1laeMuEPdFN0TpzpUZkT2sBX5CpT9IbJfk'], u'uuids': [u'7ed0940d-228c-4cb5-b5ba-2b0e498f1783']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.148591", "end": "2020-04-22 13:58:58.447424", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-mrPLaDWmRyZ0N10zKBu1D5yHVWIcgs1laeMuEPdFN0TpzpUZkT2sBX5CpT9IbJfk"], "labels": [], "masters": [], "uuids": ["7ed0940d-228c-4cb5-b5ba-2b0e498f1783"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-22 13:58:58.298833", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.145975 s, 790 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.145975 s, 790 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-22T13:58:58.807 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-mrPLaDWmRyZ0N10zKBu1D5yHVWIcgs1lzTduLtcIfGY45aqKGv2RFGzB8rwie71F'], u'uuids': [u'55414b51-2725-4bfb-b914-2f5305fbc136']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.141326", "end": "2020-04-22 13:58:58.775018", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-mrPLaDWmRyZ0N10zKBu1D5yHVWIcgs1lzTduLtcIfGY45aqKGv2RFGzB8rwie71F"], "labels": [], "masters": [], "uuids": ["55414b51-2725-4bfb-b914-2f5305fbc136"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-22 13:58:58.633692", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.138781 s, 831 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.138781 s, 831 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-22T13:58:59.146 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-mrPLaDWmRyZ0N10zKBu1D5yHVWIcgs1lLGA4BeIIbtgZnpQotqUPH30hqAPKlSG7'], u'uuids': [u'b42aaf4c-cb1d-4ad6-aeca-d0833fa03219']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.149465", "end": "2020-04-22 13:58:59.120103", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-mrPLaDWmRyZ0N10zKBu1D5yHVWIcgs1lLGA4BeIIbtgZnpQotqUPH30hqAPKlSG7"], "labels": [], "masters": [], "uuids": ["b42aaf4c-cb1d-4ad6-aeca-d0833fa03219"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-22 13:58:58.970638", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.146823 s, 786 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.146823 s, 786 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-22T13:58:59.201 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:59 +0000 (0:00:01.119) 0:04:17.293 ******* 2020-04-22T13:58:59.481 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-04-22T13:58:59.482 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.076684", "end": "2020-04-22 13:58:59.450297", "rc": 0, "start": "2020-04-22 13:58:59.373613", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-22T13:58:59.519 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:59 +0000 (0:00:00.317) 0:04:17.610 ******* 2020-04-22T13:58:59.763 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** changed: [smithi086.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.048379", "end": "2020-04-22 13:58:59.738290", "rc": 0, "start": "2020-04-22 13:58:59.689911", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-22T13:58:59.800 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:59 +0000 (0:00:00.280) 0:04:17.891 ******* 2020-04-22T13:58:59.808 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-04-22T13:58:59.809 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-oPPde1-7kqf-RnVl-74ej-SL17-Y5ll-FRAdUC', u'nvme-INTEL_SSDPEDMD400G4_PHFT6204012Z400BGN', u'nvme-nvme.8086-50484654363230343031325a34303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.452741", "end": "2020-04-22 13:58:59.738444", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-oPPde1-7kqf-RnVl-74ej-SL17-Y5ll-FRAdUC", "nvme-INTEL_SSDPEDMD400G4_PHFT6204012Z400BGN", "nvme-nvme.8086-50484654363230343031325a34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-22 13:58:58.285703", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2020-04-22T13:58:59.813 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-22T13:58:59.823 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-04-22T13:58:59.898 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:59 +0000 (0:00:00.098) 0:04:17.989 ******* 2020-04-22T13:58:59.926 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-04-22T13:58:59.929 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:58:59.977 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:58:59 +0000 (0:00:00.078) 0:04:18.068 ******* 2020-04-22T13:59:00.017 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-04-22T13:59:00.019 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:00.060 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:00 +0000 (0:00:00.082) 0:04:18.150 ******* 2020-04-22T13:59:00.092 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-04-22T13:59:00.113 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:00.155 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:00 +0000 (0:00:00.096) 0:04:18.247 ******* 2020-04-22T13:59:00.184 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-04-22T13:59:00.185 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:00.234 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:00 +0000 (0:00:00.078) 0:04:18.326 ******* 2020-04-22T13:59:00.442 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-04-22T13:59:00.444 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-22T13:59:00.482 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:00 +0000 (0:00:00.247) 0:04:18.573 ******* 2020-04-22T13:59:00.540 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-04-22T13:59:00.541 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={u'block_used': 12917985, u'uuid': u'4c3388fe-767b-4a89-b244-838ed5539484', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227177123, u'size_available': 930517495808, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60987179, u'device': u'/dev/sda1', u'inode_used': 67797, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227177123, "block_size": 4096, "block_total": 240095108, "block_used": 12917985, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60987179, "inode_total": 61054976, "inode_used": 67797, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930517495808, "size_total": 983429562368, "uuid": "4c3388fe-767b-4a89-b244-838ed5539484"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:00.600 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:00 +0000 (0:00:00.118) 0:04:18.691 ******* 2020-04-22T13:59:00.627 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-04-22T13:59:00.629 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:00.669 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:00 +0000 (0:00:00.069) 0:04:18.760 ******* 2020-04-22T13:59:00.711 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:00.747 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:00 +0000 (0:00:00.077) 0:04:18.838 ******* 2020-04-22T13:59:00.775 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:00.812 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:00 +0000 (0:00:00.065) 0:04:18.904 ******* 2020-04-22T13:59:00.850 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-04-22T13:59:00.850 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:00.891 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:00 +0000 (0:00:00.078) 0:04:18.982 ******* 2020-04-22T13:59:00.932 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:00.965 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:00 +0000 (0:00:00.074) 0:04:19.057 ******* 2020-04-22T13:59:00.992 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-04-22T13:59:00.994 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:01.031 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:01 +0000 (0:00:00.065) 0:04:19.122 ******* 2020-04-22T13:59:01.037 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-04-22T13:59:01.039 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-tynSGYijzwTNfYjyqsGqfs6ZeoJc7AgNK5Vk1JRLzbgXxR4SPtHtW7YoTztObffd'], u'uuids': [u'c456cd66-1fef-45ca-9eb8-38fb5b04e823']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.045716", "end": "2020-04-22 13:59:00.978059", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-tynSGYijzwTNfYjyqsGqfs6ZeoJc7AgNK5Vk1JRLzbgXxR4SPtHtW7YoTztObffd"], "labels": [], "masters": [], "uuids": ["c456cd66-1fef-45ca-9eb8-38fb5b04e823"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-22 13:58:59.932343", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-22T13:59:01.796 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-04-22T13:59:01.798 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-04-22T13:59:01.841 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:01 +0000 (0:00:00.810) 0:04:19.932 ******* 2020-04-22T13:59:02.291 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-04-22T13:59:02.292 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-tynSGYijzwTNfYjyqsGqfs6ZeoJc7AgNXg15LYJdi98Y7c5RLgTGMU39tedAa3tz'], u'uuids': [u'1520c70a-9920-40df-ace8-563158e8acb0']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.062322", "end": "2020-04-22 13:59:02.255305", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-tynSGYijzwTNfYjyqsGqfs6ZeoJc7AgNXg15LYJdi98Y7c5RLgTGMU39tedAa3tz"], "labels": [], "masters": [], "uuids": ["1520c70a-9920-40df-ace8-563158e8acb0"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-22 13:59:01.192983", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-22T13:59:02.475 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-04-22T13:59:02.476 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-22T13:59:02.802 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-22T13:59:03.129 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-22T13:59:03.495 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-22T13:59:03.569 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-04-22T13:59:03.570 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-tynSGYijzwTNfYjyqsGqfs6ZeoJc7AgNoG5XnX5rvMT0bvBRFtWnkydFlhuwTrlk'], u'uuids': [u'5191ffce-acfa-44ab-b418-7f3c0862b9c6']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.074476", "end": "2020-04-22 13:59:03.533039", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-tynSGYijzwTNfYjyqsGqfs6ZeoJc7AgNoG5XnX5rvMT0bvBRFtWnkydFlhuwTrlk"], "labels": [], "masters": [], "uuids": ["5191ffce-acfa-44ab-b418-7f3c0862b9c6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-22 13:59:02.458563", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-22T13:59:03.859 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi086.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-22T13:59:03.902 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:03 +0000 (0:00:02.060) 0:04:21.993 ******* 2020-04-22T13:59:04.105 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [smithi086.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-04-22T13:59:04.158 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:04 +0000 (0:00:00.252) 0:04:22.245 ******* 2020-04-22T13:59:04.195 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-04-22T13:59:04.197 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:04.380 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-22T13:59:04.570 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-22T13:59:04.752 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-22T13:59:04.821 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-04-22T13:59:04.822 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-tynSGYijzwTNfYjyqsGqfs6ZeoJc7AgNMABrTQxUptvXHxv1LSV8yt1z26uce6Bp'], u'uuids': [u'85e57f7e-0a22-418e-acfe-a923f27a1451']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.057372", "end": "2020-04-22 13:59:04.788950", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-tynSGYijzwTNfYjyqsGqfs6ZeoJc7AgNMABrTQxUptvXHxv1LSV8yt1z26uce6Bp"], "labels": [], "masters": [], "uuids": ["85e57f7e-0a22-418e-acfe-a923f27a1451"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-22 13:59:03.731578", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-22T13:59:04.948 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-04-22T13:59:04.953 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-22T13:59:04.997 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:04 +0000 (0:00:00.843) 0:04:23.089 ******* 2020-04-22T13:59:05.209 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-22T13:59:05.249 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:05 +0000 (0:00:00.247) 0:04:23.337 ******* 2020-04-22T13:59:05.283 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-04-22T13:59:05.284 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:05.331 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:05 +0000 (0:00:00.085) 0:04:23.422 ******* 2020-04-22T13:59:05.941 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-04-22T13:59:05.942 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => {"changed": true} 2020-04-22T13:59:05.991 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:05 +0000 (0:00:00.659) 0:04:24.082 ******* 2020-04-22T13:59:06.076 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-04-22T13:59:06.082 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-tynSGYijzwTNfYjyqsGqfs6ZeoJc7AgNgBJCf292ckjcMzTy2hssj7GUHHhDy7Ww'], u'uuids': [u'31512a77-bf56-4f6a-b5ca-363b43b7387b']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.049827", "end": "2020-04-22 13:59:06.037879", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-tynSGYijzwTNfYjyqsGqfs6ZeoJc7AgNgBJCf292ckjcMzTy2hssj7GUHHhDy7Ww"], "labels": [], "masters": [], "uuids": ["31512a77-bf56-4f6a-b5ca-363b43b7387b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-22 13:59:04.988052", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-22T13:59:06.125 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:06 +0000 (0:00:00.134) 0:04:24.216 ******* 2020-04-22T13:59:06.180 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-04-22T13:59:06.181 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QBMV', u'wwn-0x5000c50091e0b337'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5QBMV', u'wwn': u'0x5000c50091e0b337', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'4c3388fe-767b-4a89-b244-838ed5539484', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QBMV-part1', u'wwn-0x5000c50091e0b337-part1'], u'uuids': [u'4c3388fe-767b-4a89-b244-838ed5539484']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QBMV", "wwn-0x5000c50091e0b337"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QBMV-part1", "wwn-0x5000c50091e0b337-part1"], "labels": [], "masters": [], "uuids": ["4c3388fe-767b-4a89-b244-838ed5539484"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "4c3388fe-767b-4a89-b244-838ed5539484"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QBMV", "size": "931.51 GB", "support_discard": "0", "vend 2020-04-22T13:59:06.182 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c50091e0b337"}}, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:06.415 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-oPPde1-7kqf-RnVl-74ej-SL17-Y5ll-FRAdUC', u'nvme-INTEL_SSDPEDMD400G4_PHFT6204012Z400BGN', u'nvme-nvme.8086-50484654363230343031325a34303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.036884", "end": "2020-04-22 13:59:06.377020", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-oPPde1-7kqf-RnVl-74ej-SL17-Y5ll-FRAdUC", "nvme-INTEL_SSDPEDMD400G4_PHFT6204012Z400BGN", "nvme-nvme.8086-50484654363230343031325a34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-22 13:59:06.340136", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 11 2020-04-22T13:59:06.417 INFO:teuthology.task.ansible.out:0 MiB) copied, 0.0342087 s, 3.4 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0342087 s, 3.4 GB/s"], "stdout": "", "stdout_lines": []} 2020-04-22T13:59:06.616 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-04-22T13:59:06.618 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-04-22T13:59:06.655 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:06 +0000 (0:00:00.529) 0:04:24.746 ******* 2020-04-22T13:59:06.693 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:06.731 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:06 +0000 (0:00:00.074) 0:04:24.821 ******* 2020-04-22T13:59:06.765 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-04-22T13:59:06.766 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-tynSGYijzwTNfYjyqsGqfs6ZeoJc7AgNK5Vk1JRLzbgXxR4SPtHtW7YoTztObffd'], u'uuids': [u'c456cd66-1fef-45ca-9eb8-38fb5b04e823']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.138512", "end": "2020-04-22 13:59:06.726378", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-tynSGYijzwTNfYjyqsGqfs6ZeoJc7AgNK5Vk1JRLzbgXxR4SPtHtW7YoTztObffd"], "labels": [], "masters": [], "uuids": ["c456cd66-1fef-45ca-9eb8-38fb5b04e823"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-22 13:59:06.587866", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136002 s, 848 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136002 s, 848 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-22T13:59:06.767 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:06.803 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:06 +0000 (0:00:00.073) 0:04:24.895 ******* 2020-04-22T13:59:06.830 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-04-22T13:59:06.832 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:06.878 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:06 +0000 (0:00:00.074) 0:04:24.969 ******* 2020-04-22T13:59:06.904 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-04-22T13:59:06.906 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:06.955 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:06 +0000 (0:00:00.072) 0:04:25.042 ******* 2020-04-22T13:59:06.987 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-04-22T13:59:06.989 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:07.027 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:07 +0000 (0:00:00.076) 0:04:25.118 ******* 2020-04-22T13:59:07.053 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-04-22T13:59:07.055 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:07.102 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:07 +0000 (0:00:00.074) 0:04:25.193 ******* 2020-04-22T13:59:07.109 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-04-22T13:59:07.111 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-tynSGYijzwTNfYjyqsGqfs6ZeoJc7AgNXg15LYJdi98Y7c5RLgTGMU39tedAa3tz'], u'uuids': [u'1520c70a-9920-40df-ace8-563158e8acb0']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.137707", "end": "2020-04-22 13:59:07.062452", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-tynSGYijzwTNfYjyqsGqfs6ZeoJc7AgNXg15LYJdi98Y7c5RLgTGMU39tedAa3tz"], "labels": [], "masters": [], "uuids": ["1520c70a-9920-40df-ace8-563158e8acb0"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-22 13:59:06.924745", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.135265 s, 853 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.135265 s, 853 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-22T13:59:07.133 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-04-22T13:59:07.135 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:07.173 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:07 +0000 (0:00:00.071) 0:04:25.265 ******* 2020-04-22T13:59:07.175 INFO:teuthology.task.ansible.out: 2020-04-22T13:59:07.202 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-04-22T13:59:07.203 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:07.241 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:07 +0000 (0:00:00.067) 0:04:25.332 ******* 2020-04-22T13:59:07.273 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-04-22T13:59:07.274 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:07.317 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:07 +0000 (0:00:00.075) 0:04:25.408 ******* 2020-04-22T13:59:07.346 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-04-22T13:59:07.348 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:07.397 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:07 +0000 (0:00:00.080) 0:04:25.489 ******* 2020-04-22T13:59:07.414 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-04-22T13:59:07.415 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-tynSGYijzwTNfYjyqsGqfs6ZeoJc7AgNoG5XnX5rvMT0bvBRFtWnkydFlhuwTrlk'], u'uuids': [u'5191ffce-acfa-44ab-b418-7f3c0862b9c6']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.137373", "end": "2020-04-22 13:59:07.390031", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-tynSGYijzwTNfYjyqsGqfs6ZeoJc7AgNoG5XnX5rvMT0bvBRFtWnkydFlhuwTrlk"], "labels": [], "masters": [], "uuids": ["5191ffce-acfa-44ab-b418-7f3c0862b9c6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-22 13:59:07.252658", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.134816 s, 856 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.134816 s, 856 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-22T13:59:07.427 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-04-22T13:59:07.428 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:07.466 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:07 +0000 (0:00:00.068) 0:04:25.557 ******* 2020-04-22T13:59:07.749 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi103.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-tynSGYijzwTNfYjyqsGqfs6ZeoJc7AgNMABrTQxUptvXHxv1LSV8yt1z26uce6Bp'], u'uuids': [u'85e57f7e-0a22-418e-acfe-a923f27a1451']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.139231", "end": "2020-04-22 13:59:07.711976", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-tynSGYijzwTNfYjyqsGqfs6ZeoJc7AgNMABrTQxUptvXHxv1LSV8yt1z26uce6Bp"], "labels": [], "masters": [], "uuids": ["85e57f7e-0a22-418e-acfe-a923f27a1451"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-22 13:59:07.572745", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136761 s, 843 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136761 s, 843 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-22T13:59:07.949 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-04-22T13:59:07.951 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-04-22T13:59:07.993 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:07 +0000 (0:00:00.527) 0:04:26.084 ******* 2020-04-22T13:59:08.075 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-04-22T13:59:08.076 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-tynSGYijzwTNfYjyqsGqfs6ZeoJc7AgNgBJCf292ckjcMzTy2hssj7GUHHhDy7Ww'], u'uuids': [u'31512a77-bf56-4f6a-b5ca-363b43b7387b']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.137494", "end": "2020-04-22 13:59:08.034294", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-tynSGYijzwTNfYjyqsGqfs6ZeoJc7AgNgBJCf292ckjcMzTy2hssj7GUHHhDy7Ww"], "labels": [], "masters": [], "uuids": ["31512a77-bf56-4f6a-b5ca-363b43b7387b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-22 13:59:07.896800", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.135037 s, 854 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.135037 s, 854 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-22T13:59:08.145 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:08 +0000 (0:00:00.152) 0:04:26.236 ******* 2020-04-22T13:59:08.307 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-04-22T13:59:08.309 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2020-04-22 13:53:12 UTC", "ActiveEnterTimestampMonotonic": "14913116", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sntp.service -.mount ntpd.service systemd-tmpfiles-setup.service basic.target system.slice systemd-journald.socket tmp.mount sysinit.target ntpdate.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2020-04-22 13:53:11 UTC", "AssertTimestampMonotonic": "13650560", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2020-04-22 13:53:11 UTC", "ConditionTimestampMonotonic": "13650533", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target ntpd.service systemd-timesyncd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description" 2020-04-22T13:59:08.310 INFO:teuthology.task.ansible.out:: "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2412", "ExecMainStartTimestamp": "Wed 2020-04-22 13:53:12 UTC", "ExecMainStartTimestampMonotonic": "14874693", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2020-04-22 13:53:11 UTC", "InactiveExitTimestampMonotonic": "13667972", "InvocationID": "815cfc7fc3804ff9b40d3175d34832c4", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "167772 2020-04-22T13:59:08.312 INFO:teuthology.task.ansible.out:16", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127442", "LimitNPROCSoft": "127442", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127442", "LimitSIGPENDINGSoft": "127442", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2412", "MemoryAccounting": "yes", "MemoryCurrent": "2498560", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardE 2020-04-22T13:59:08.313 INFO:teuthology.task.ansible.out:rror": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2020-04-22 13:53:12 UTC", "StateChangeTimestampMonotonic": "14913116", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Wed 2020-04-22 13:53:12 UTC", "WatchdogTimestampMonotonic": "14874707", "WatchdogUSec": "0"}} 2020-04-22T13:59:08.360 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:08 +0000 (0:00:00.214) 0:04:26.451 ******* 2020-04-22T13:59:08.399 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-04-22T13:59:08.400 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.051996", "end": "2020-04-22 13:59:08.370430", "rc": 0, "start": "2020-04-22 13:59:08.318434", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-22T13:59:08.440 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:08 +0000 (0:00:00.079) 0:04:26.531 ******* 2020-04-22T13:59:08.445 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-04-22T13:59:08.447 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:08.507 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:08 +0000 (0:00:00.067) 0:04:26.598 ******* 2020-04-22T13:59:08.534 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-04-22T13:59:08.541 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:08.572 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:08 +0000 (0:00:00.065) 0:04:26.664 ******* 2020-04-22T13:59:08.601 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:08.641 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:08 +0000 (0:00:00.068) 0:04:26.732 ******* 2020-04-22T13:59:08.686 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-04-22T13:59:08.687 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.045710", "end": "2020-04-22 13:59:08.658972", "rc": 0, "start": "2020-04-22 13:59:08.613262", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-22T13:59:08.726 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:08 +0000 (0:00:00.084) 0:04:26.817 ******* 2020-04-22T13:59:08.753 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-04-22T13:59:08.796 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:08 +0000 (0:00:00.070) 0:04:26.888 ******* 2020-04-22T13:59:08.835 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:08.875 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:08 +0000 (0:00:00.078) 0:04:26.966 ******* 2020-04-22T13:59:08.880 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-04-22T13:59:08.881 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "gid": 1213, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-04-22T13:59:08.922 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:08 +0000 (0:00:00.047) 0:04:27.013 ******* 2020-04-22T13:59:08.928 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-04-22T13:59:08.930 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:08.968 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:08 +0000 (0:00:00.045) 0:04:27.059 ******* 2020-04-22T13:59:09.010 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:09.063 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:09 +0000 (0:00:00.095) 0:04:27.154 ******* 2020-04-22T13:59:09.091 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-04-22T13:59:09.092 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:09.131 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:09 +0000 (0:00:00.068) 0:04:27.223 ******* 2020-04-22T13:59:09.333 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi103.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-22T13:59:09.367 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:09 +0000 (0:00:00.235) 0:04:27.458 ******* 2020-04-22T13:59:09.415 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-04-22T13:59:09.417 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={u'block_used': 12917985, u'uuid': u'4c3388fe-767b-4a89-b244-838ed5539484', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227177123, u'size_available': 930517495808, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60987179, u'device': u'/dev/sda1', u'inode_used': 67797, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227177123, "block_size": 4096, "block_total": 240095108, "block_used": 12917985, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60987179, "inode_total": 61054976, "inode_used": 67797, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930517495808, "size_total": 983429562368, "uuid": "4c3388fe-767b-4a89-b244-838ed5539484"}, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:09.464 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:09 +0000 (0:00:00.096) 0:04:27.555 ******* 2020-04-22T13:59:09.470 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-04-22T13:59:09.472 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1213, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-04-22T13:59:09.511 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:09 +0000 (0:00:00.046) 0:04:27.602 ******* 2020-04-22T13:59:09.518 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-04-22T13:59:09.519 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:09.559 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:09 +0000 (0:00:00.047) 0:04:27.650 ******* 2020-04-22T13:59:09.599 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:09.641 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:09 +0000 (0:00:00.081) 0:04:27.732 ******* 2020-04-22T13:59:09.678 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-22T13:59:09.679 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:09.718 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:09 +0000 (0:00:00.077) 0:04:27.809 ******* 2020-04-22T13:59:09.778 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-04-22T13:59:09.779 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:09.817 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:09 +0000 (0:00:00.098) 0:04:27.908 ******* 2020-04-22T13:59:09.844 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-04-22T13:59:09.846 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:09.885 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:09 +0000 (0:00:00.068) 0:04:27.977 ******* 2020-04-22T13:59:09.917 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:09.960 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:09 +0000 (0:00:00.075) 0:04:28.052 ******* 2020-04-22T13:59:10.431 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-04-22T13:59:10.433 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-04-22T13:59:10.473 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:10 +0000 (0:00:00.512) 0:04:28.564 ******* 2020-04-22T13:59:10.862 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-04-22T13:59:10.863 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-22T13:59:10.892 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-04-22T13:59:10.893 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-04-22T13:59:10.932 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:10 +0000 (0:00:00.458) 0:04:29.023 ******* 2020-04-22T13:59:10.960 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-04-22T13:59:10.962 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:11.001 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:11 +0000 (0:00:00.069) 0:04:29.092 ******* 2020-04-22T13:59:11.028 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-04-22T13:59:11.029 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-04-22T13:59:11.084 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:11 +0000 (0:00:00.082) 0:04:29.175 ******* 2020-04-22T13:59:11.211 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-04-22T13:59:11.213 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-22T13:59:11.279 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-04-22T13:59:11.281 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-04-22T13:59:11.328 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:11 +0000 (0:00:00.243) 0:04:29.419 ******* 2020-04-22T13:59:11.365 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-04-22T13:59:11.366 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:11.402 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:11 +0000 (0:00:00.074) 0:04:29.494 ******* 2020-04-22T13:59:11.440 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-04-22T13:59:11.441 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-04-22T13:59:11.481 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:11 +0000 (0:00:00.079) 0:04:29.573 ******* 2020-04-22T13:59:11.509 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-04-22T13:59:11.510 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:11.549 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:11 +0000 (0:00:00.067) 0:04:29.640 ******* 2020-04-22T13:59:11.582 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-04-22T13:59:11.584 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-22T13:59:11.750 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-04-22T13:59:11.752 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-04-22T13:59:11.804 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:11 +0000 (0:00:00.254) 0:04:29.894 ******* 2020-04-22T13:59:11.942 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi103.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-22T13:59:12.001 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi086.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-04-22T13:59:12.070 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:12 +0000 (0:00:00.267) 0:04:30.162 ******* 2020-04-22T13:59:12.099 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-04-22T13:59:12.100 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:12.143 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:12 +0000 (0:00:00.071) 0:04:30.233 ******* 2020-04-22T13:59:12.191 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-04-22T13:59:12.192 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi086.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-04-22T13:59:12.204 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2020-04-22T13:59:12.205 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-04-22T13:59:12.223 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-04-22T13:59:12.255 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:12 +0000 (0:00:00.112) 0:04:30.346 ******* 2020-04-22T13:59:12.285 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi103.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-22T13:59:12.342 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:12 +0000 (0:00:00.087) 0:04:30.434 ******* 2020-04-22T13:59:12.349 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-04-22T13:59:12.349 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:12.351 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:12.353 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi086.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:12.354 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:12.396 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:12 +0000 (0:00:00.053) 0:04:30.487 ******* 2020-04-22T13:59:12.434 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:12.477 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:12 +0000 (0:00:00.081) 0:04:30.568 ******* 2020-04-22T13:59:12.505 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-04-22T13:59:12.506 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:12.554 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:12 +0000 (0:00:00.076) 0:04:30.645 ******* 2020-04-22T13:59:12.560 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-04-22T13:59:12.561 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-04-22T13:59:12.606 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:12 +0000 (0:00:00.051) 0:04:30.697 ******* 2020-04-22T13:59:12.612 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-04-22T13:59:12.614 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:12.660 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:12 +0000 (0:00:00.054) 0:04:30.751 ******* 2020-04-22T13:59:12.668 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-04-22T13:59:12.669 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:12.690 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:12.735 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:12 +0000 (0:00:00.075) 0:04:30.826 ******* 2020-04-22T13:59:12.762 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-04-22T13:59:12.764 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:12.806 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:12 +0000 (0:00:00.069) 0:04:30.896 ******* 2020-04-22T13:59:12.833 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-04-22T13:59:12.834 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:12.877 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:12 +0000 (0:00:00.072) 0:04:30.969 ******* 2020-04-22T13:59:12.885 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-04-22T13:59:12.887 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-22T13:59:12.904 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-04-22T13:59:12.906 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:12.948 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:12 +0000 (0:00:00.071) 0:04:31.040 ******* 2020-04-22T13:59:12.975 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-04-22T13:59:12.977 INFO:teuthology.task.ansible.out:skipping: [smithi086.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:13.025 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:13 +0000 (0:00:00.076) 0:04:31.117 ******* 2020-04-22T13:59:13.052 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-04-22T13:59:13.054 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-22T13:59:13.263 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-22T13:59:13.265 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-04-22T13:59:13.265 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005235", "end": "2020-04-22 13:59:13.221242", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-04-22 13:59:13.216007", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-22T13:59:13.444 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.002883", "end": "2020-04-22 13:59:13.407575", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-04-22 13:59:13.404692", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-22T13:59:13.460 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi103.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-22T13:59:13.533 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:13 +0000 (0:00:00.507) 0:04:31.624 ******* 2020-04-22T13:59:13.636 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-04-22T13:59:13.637 INFO:teuthology.task.ansible.out:ok: [smithi086.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002690", "end": "2020-04-22 13:59:13.589958", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-04-22 13:59:13.587268", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-04-22T13:59:13.765 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-04-22T13:59:13.767 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-22T13:59:13.807 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:13 +0000 (0:00:00.273) 0:04:31.899 ******* 2020-04-22T13:59:13.852 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-04-22T13:59:13.853 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi086.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.022009", "end": "2020-04-22 13:59:13.811812", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-04-22 13:59:13.789803", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-22T13:59:13.900 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:13 +0000 (0:00:00.092) 0:04:31.992 ******* 2020-04-22T13:59:13.943 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:13 +0000 (0:00:00.041) 0:04:32.033 ******* 2020-04-22T13:59:13.947 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-04-22T13:59:13.985 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:13 +0000 (0:00:00.043) 0:04:32.077 ******* 2020-04-22T13:59:14.184 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-04-22T13:59:14.185 INFO:teuthology.task.ansible.out:changed: [smithi086.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-04-22T13:59:14.268 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-04-22T13:59:14.270 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"changed": true} 2020-04-22T13:59:14.304 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:14 +0000 (0:00:00.318) 0:04:32.395 ******* 2020-04-22T13:59:14.624 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-04-22T13:59:14.625 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-04-22T13:59:14.661 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:14 +0000 (0:00:00.356) 0:04:32.752 ******* 2020-04-22T13:59:14.688 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-04-22T13:59:14.689 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:14.732 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:14 +0000 (0:00:00.070) 0:04:32.823 ******* 2020-04-22T13:59:14.758 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-04-22T13:59:14.760 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:14.796 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:14 +0000 (0:00:00.064) 0:04:32.888 ******* 2020-04-22T13:59:14.822 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-04-22T13:59:14.824 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:14.859 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:14 +0000 (0:00:00.062) 0:04:32.950 ******* 2020-04-22T13:59:14.888 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-04-22T13:59:14.889 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:14.929 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:14 +0000 (0:00:00.069) 0:04:33.020 ******* 2020-04-22T13:59:15.011 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 22 April 2020 13:59:14 +0000 (0:00:00.066) 0:04:33.086 ******* 2020-04-22T13:59:15.033 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-04-22T13:59:15.035 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:15.076 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:15 +0000 (0:00:00.081) 0:04:33.168 ******* 2020-04-22T13:59:15.104 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-04-22T13:59:15.113 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:15.153 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:15 +0000 (0:00:00.074) 0:04:33.242 ******* 2020-04-22T13:59:15.185 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:15.218 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:15 +0000 (0:00:00.066) 0:04:33.309 ******* 2020-04-22T13:59:15.246 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:15.282 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:15 +0000 (0:00:00.064) 0:04:33.374 ******* 2020-04-22T13:59:15.320 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-04-22T13:59:15.322 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:15.360 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:15 +0000 (0:00:00.077) 0:04:33.452 ******* 2020-04-22T13:59:15.387 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-04-22T13:59:15.390 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:15.424 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:15 +0000 (0:00:00.062) 0:04:33.515 ******* 2020-04-22T13:59:15.908 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-04-22T13:59:15.910 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-04-22T13:59:15.946 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:15 +0000 (0:00:00.522) 0:04:34.037 ******* 2020-04-22T13:59:16.267 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2020-04-22 13:53:38 UTC", "ActiveEnterTimestampMonotonic": "14774234", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "ntpdate.service system.slice -.mount tmp.mount ntpd.service systemd-journald.socket sysinit.target systemd-tmpfiles-setup.service basic.target sntp.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2020-04-22 13:53:37 UTC", "AssertTimestampMonotonic": "13767181", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2020-04-22 13:53:37 UTC", "ConditionTimestampMonotonic": "13767157", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target ntpd.service systemd-timesyncd.service", "ControlGroup": "/system.slice/chronyd.servic 2020-04-22T13:59:16.269 INFO:teuthology.task.ansible.out:e", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2422", "ExecMainStartTimestamp": "Wed 2020-04-22 13:53:38 UTC", "ExecMainStartTimestampMonotonic": "14587539", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2020-04-22 13:53:37 UTC", "InactiveExitTimestampMonotonic": "13797763", "InvocationID": "6374b2476d78456699706e9a53a39e3c", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infini 2020-04-22T13:59:16.270 INFO:teuthology.task.ansible.out:ty", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127442", "LimitNPROCSoft": "127442", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127442", "LimitSIGPENDINGSoft": "127442", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2422", "MemoryAccounting": "yes", "MemoryCurrent": "2842624", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits" 2020-04-22T13:59:16.272 INFO:teuthology.task.ansible.out:: "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2020-04-22 13:53:38 UTC", "StateChangeTimestampMonotonic": "14774234", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Wed 2020-04-22 13:53:38 UTC", "WatchdogTimestampMonotonic": "14587553", "WatchdogUSec": "0"}} 2020-04-22T13:59:16.307 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:16 +0000 (0:00:00.360) 0:04:34.398 ******* 2020-04-22T13:59:16.333 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-04-22T13:59:16.334 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:16.373 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:16 +0000 (0:00:00.066) 0:04:34.465 ******* 2020-04-22T13:59:16.411 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-04-22T13:59:16.413 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:16.451 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:16 +0000 (0:00:00.076) 0:04:34.542 ******* 2020-04-22T13:59:16.486 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-04-22T13:59:16.488 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:16.524 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:16 +0000 (0:00:00.073) 0:04:34.615 ******* 2020-04-22T13:59:16.739 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "gid": 1213, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-04-22T13:59:16.777 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:16 +0000 (0:00:00.252) 0:04:34.868 ******* 2020-04-22T13:59:17.273 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1213, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-04-22T13:59:17.320 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:17 +0000 (0:00:00.543) 0:04:35.411 ******* 2020-04-22T13:59:18.367 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-04-22T13:59:18.368 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-04-22T13:59:18.413 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:18 +0000 (0:00:01.092) 0:04:36.504 ******* 2020-04-22T13:59:18.450 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-04-22T13:59:18.452 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:18.492 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:18 +0000 (0:00:00.079) 0:04:36.583 ******* 2020-04-22T13:59:18.526 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-04-22T13:59:18.533 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-04-22T13:59:18.570 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:18 +0000 (0:00:00.077) 0:04:36.661 ******* 2020-04-22T13:59:18.765 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-04-22T13:59:18.767 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-04-22T13:59:18.807 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:18 +0000 (0:00:00.237) 0:04:36.898 ******* 2020-04-22T13:59:18.834 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-04-22T13:59:18.835 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:18.877 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:18 +0000 (0:00:00.070) 0:04:36.968 ******* 2020-04-22T13:59:18.927 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-04-22T13:59:18.929 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-04-22T13:59:18.969 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:18 +0000 (0:00:00.092) 0:04:37.060 ******* 2020-04-22T13:59:18.995 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-04-22T13:59:18.997 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:19.034 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:19 +0000 (0:00:00.064) 0:04:37.125 ******* 2020-04-22T13:59:19.233 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-04-22T13:59:19.233 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-04-22T13:59:19.279 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:19 +0000 (0:00:00.242) 0:04:37.368 ******* 2020-04-22T13:59:19.482 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-04-22T13:59:19.483 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-04-22T13:59:19.542 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:19 +0000 (0:00:00.265) 0:04:37.633 ******* 2020-04-22T13:59:19.578 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-04-22T13:59:19.580 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:19.617 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:19 +0000 (0:00:00.075) 0:04:37.708 ******* 2020-04-22T13:59:19.654 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-04-22T13:59:19.656 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi103.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-04-22T13:59:19.666 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-04-22T13:59:19.667 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-04-22T13:59:19.682 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2020-04-22T13:59:19.727 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:19 +0000 (0:00:00.110) 0:04:37.818 ******* 2020-04-22T13:59:19.770 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-04-22T13:59:19.778 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:19.779 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:19.790 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:19.791 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:19.802 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:19.854 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:19 +0000 (0:00:00.127) 0:04:37.946 ******* 2020-04-22T13:59:19.881 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-22T13:59:19.883 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:19.924 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:19 +0000 (0:00:00.068) 0:04:38.014 ******* 2020-04-22T13:59:19.951 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-04-22T13:59:19.953 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:19.997 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:19 +0000 (0:00:00.073) 0:04:38.088 ******* 2020-04-22T13:59:20.024 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-04-22T13:59:20.026 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:20.088 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:20 +0000 (0:00:00.087) 0:04:38.176 ******* 2020-04-22T13:59:20.123 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-04-22T13:59:20.124 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:20.174 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:20 +0000 (0:00:00.089) 0:04:38.265 ******* 2020-04-22T13:59:20.217 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:20.257 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:20 +0000 (0:00:00.083) 0:04:38.348 ******* 2020-04-22T13:59:20.285 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:20.325 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:20 +0000 (0:00:00.068) 0:04:38.417 ******* 2020-04-22T13:59:20.352 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-04-22T13:59:20.354 INFO:teuthology.task.ansible.out:skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:20.393 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:20 +0000 (0:00:00.067) 0:04:38.484 ******* 2020-04-22T13:59:20.419 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi103.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-22T13:59:20.457 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:20 +0000 (0:00:00.063) 0:04:38.548 ******* 2020-04-22T13:59:20.692 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi103.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.004955", "end": "2020-04-22 13:59:20.649905", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-04-22 13:59:20.644950", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-22T13:59:20.882 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003093", "end": "2020-04-22 13:59:20.846229", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-04-22 13:59:20.843136", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-22T13:59:21.063 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002827", "end": "2020-04-22 13:59:21.029300", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-04-22 13:59:21.026473", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-04-22T13:59:21.276 INFO:teuthology.task.ansible.out:ok: [smithi103.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.030305", "end": "2020-04-22 13:59:21.243835", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-04-22 13:59:21.213530", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-22T13:59:21.318 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:21 +0000 (0:00:00.857) 0:04:39.406 ******* 2020-04-22T13:59:21.353 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-04-22T13:59:21.396 INFO:teuthology.task.ansible.out:Wednesday 22 April 2020 13:59:21 +0000 (0:00:00.075) 0:04:39.482 ******* 2020-04-22T13:59:21.588 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-04-22T13:59:21.589 INFO:teuthology.task.ansible.out:changed: [smithi103.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-04-22T13:59:21.687 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2020-04-22T13:59:21.689 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2020-04-22T13:59:21.691 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2020-04-22T13:59:21.694 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* smithi086.front.sepia.ceph.com : ok=127 changed=40 unreachable=0 failed=0 skipped=156 rescued=0 ignored=4 smithi103.front.sepia.ceph.com : ok=127 changed=40 unreachable=0 failed=0 skipped=156 rescued=0 ignored=4 Wednesday 22 April 2020 13:59:21 +0000 (0:00:00.301) 0:04:39.783 ******* =============================================================================== users : Create all admin users with sudo access. ----------------------- 25.06s users : Update authorized_keys using the keys repo --------------------- 21.64s testnode : Install packages -------------------------------------------- 10.08s common : Register with subscription-manager. ---------------------------- 8.18s common : nrpe - Remove SELinux policy package --------------------------- 7.51s common : nrpe - Load SELinux policy package ----------------------------- 7.25s testnode : Ensure ceph dependency packages are not present. ------------- 6.00s common : Get list of enabled RHSM repos --------------------------------- 4.49s common : Disable all rhsm repos ----------------------------------------- 4.25s testnode : Ensure ceph packages are not present. ------------------------ 3.28s Gathering Facts --------------------------------------------------------- 2.58s common : Install Kerberos Packages (RedHat) ----------------------------- 2.46s testnode : Base group workaround for BZ1782899 -------------------------- 2.17s common : Install nrpe package and dependencies (RHEL/CentOS) ------------ 2.08s common : nrpe - Ensure SELinux policy is up to date --------------------- 2.08s common : nrpe - Install SELinux dependencies ---------------------------- 2.06s common : Make sure smartmontools is installed --------------------------- 1.98s testnode : Make sure rpm dependencies are installed --------------------- 1.67s testnode : Rebuild rpmdb --------------------- 2020-04-22T13:59:21.696 INFO:teuthology.task.ansible.out:--------------------------- 1.66s testnode : Remove packages ---------------------------------------------- 1.33s 2020-04-22T13:59:21.986 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi103.front.sepia.ceph.com'), Remote(name='ubuntu@smithi086.front.sepia.ceph.com')] 2020-04-22T13:59:21.988 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-04-22T13:59:21.989 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi103.front.sepia.ceph.com', 'timeout': 60} 2020-04-22T13:59:22.061 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:59:22.152 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-04-22T13:59:22.153 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi086.front.sepia.ceph.com', 'timeout': 60} 2020-04-22T13:59:22.267 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:59:22.360 INFO:teuthology.run_tasks:Running task clock... 2020-04-22T13:59:22.374 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2020-04-22T13:59:22.374 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:59:22.388 INFO:teuthology.orchestra.run:Running command with timeout 60 2020-04-22T13:59:22.388 INFO:teuthology.orchestra.run.smithi103:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-04-22T13:59:22.466 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-04-22T13:59:22.483 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-04-22T13:59:22.551 INFO:teuthology.orchestra.run.smithi103.stderr:sudo: ntpd: command not found 2020-04-22T13:59:22.552 INFO:teuthology.orchestra.run.smithi103.stdout:506 Cannot talk to daemon 2020-04-22T13:59:22.554 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-04-22T13:59:22.571 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-04-22T13:59:22.638 INFO:teuthology.orchestra.run.smithi103.stderr:bash: ntpq: command not found 2020-04-22T13:59:22.670 INFO:teuthology.orchestra.run.smithi103.stdout:210 Number of sources = 4 2020-04-22T13:59:22.671 INFO:teuthology.orchestra.run.smithi103.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-04-22T13:59:22.671 INFO:teuthology.orchestra.run.smithi103.stdout:=============================================================================== 2020-04-22T13:59:22.671 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-22T13:59:22.671 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-22T13:59:22.671 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-22T13:59:22.671 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-22T13:59:22.672 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:59:22.688 INFO:teuthology.orchestra.run:Running command with timeout 60 2020-04-22T13:59:22.688 INFO:teuthology.orchestra.run.smithi086:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-04-22T13:59:22.795 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-04-22T13:59:22.795 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-04-22T13:59:22.833 INFO:teuthology.orchestra.run.smithi086.stderr:sudo: ntpd: command not found 2020-04-22T13:59:22.846 INFO:teuthology.orchestra.run.smithi086.stdout:506 Cannot talk to daemon 2020-04-22T13:59:22.868 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-04-22T13:59:22.878 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-04-22T13:59:22.943 INFO:teuthology.orchestra.run.smithi086.stderr:bash: ntpq: command not found 2020-04-22T13:59:22.962 INFO:teuthology.orchestra.run.smithi086.stdout:210 Number of sources = 4 2020-04-22T13:59:22.963 INFO:teuthology.orchestra.run.smithi086.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-04-22T13:59:22.963 INFO:teuthology.orchestra.run.smithi086.stdout:=============================================================================== 2020-04-22T13:59:22.963 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-22T13:59:22.963 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-22T13:59:22.963 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-22T13:59:22.963 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-22T13:59:22.964 INFO:teuthology.run_tasks:Running task install... 2020-04-22T13:59:22.981 DEBUG:teuthology.task.install:project ceph 2020-04-22T13:59:22.981 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '360f904aafdcc5437adf7f1a18be626f09ffd78d'}} 2020-04-22T13:59:22.981 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel']}, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'sha1': '360f904aafdcc5437adf7f1a18be626f09ffd78d'} 2020-04-22T13:59:22.981 INFO:teuthology.task.install:Using flavor: basic 2020-04-22T13:59:22.990 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2020-04-22T13:59:22.990 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']} 2020-04-22T13:59:22.991 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:59:23.005 INFO:teuthology.orchestra.run.smithi103:> sudo lsb_release -is 2020-04-22T13:59:23.081 INFO:teuthology.orchestra.run.smithi103.stdout:RedHatEnterprise 2020-04-22T13:59:23.081 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-04-22T13:59:23.082 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:59:23.083 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '360f904aafdcc5437adf7f1a18be626f09ffd78d', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel']}, 'flavor': 'basic', 'extras': None} 2020-04-22T13:59:23.083 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:59:23.096 INFO:teuthology.orchestra.run.smithi086:> sudo lsb_release -is 2020-04-22T13:59:23.135 INFO:teuthology.orchestra.run.smithi103:> sudo lsb_release -is 2020-04-22T13:59:23.172 INFO:teuthology.orchestra.run.smithi086.stdout:RedHatEnterprise 2020-04-22T13:59:23.174 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-04-22T13:59:23.175 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '360f904aafdcc5437adf7f1a18be626f09ffd78d', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel']}, 'flavor': 'basic', 'extras': None} 2020-04-22T13:59:23.175 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:59:23.211 INFO:teuthology.orchestra.run.smithi103.stdout:RedHatEnterprise 2020-04-22T13:59:23.212 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-04-22T13:59:23.212 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=360f904aafdcc5437adf7f1a18be626f09ffd78d 2020-04-22T13:59:23.229 INFO:teuthology.orchestra.run.smithi086:> sudo lsb_release -is 2020-04-22T13:59:23.305 INFO:teuthology.orchestra.run.smithi086.stdout:RedHatEnterprise 2020-04-22T13:59:23.306 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-04-22T13:59:23.306 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=360f904aafdcc5437adf7f1a18be626f09ffd78d 2020-04-22T13:59:23.457 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/vstart_runner/360f904aafdcc5437adf7f1a18be626f09ffd78d/centos/8/flavors/default/ 2020-04-22T13:59:23.458 INFO:teuthology.task.install.rpm:Package version is 16.0.0-952.g360f904 2020-04-22T13:59:23.548 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/vstart_runner/360f904aafdcc5437adf7f1a18be626f09ffd78d/centos/8/flavors/default/ 2020-04-22T13:59:23.549 INFO:teuthology.task.install.rpm:Package version is 16.0.0-952.g360f904 2020-04-22T13:59:23.642 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/vstart_runner/360f904aafdcc5437adf7f1a18be626f09ffd78d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/vstart_runner/360f904aafdcc5437adf7f1a18be626f09ffd78d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/vstart_runner/360f904aafdcc5437adf7f1a18be626f09ffd78d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-04-22T13:59:23.642 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:59:23.657 INFO:teuthology.orchestra.run.smithi103:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2020-04-22T13:59:23.725 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/vstart_runner/360f904aafdcc5437adf7f1a18be626f09ffd78d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/vstart_runner/360f904aafdcc5437adf7f1a18be626f09ffd78d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/vstart_runner/360f904aafdcc5437adf7f1a18be626f09ffd78d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-04-22T13:59:23.725 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:59:23.742 INFO:teuthology.orchestra.run.smithi086:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2020-04-22T13:59:23.743 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel on remote rpm x86_64 2020-04-22T13:59:23.743 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:59:23.796 INFO:teuthology.orchestra.run.smithi103:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/360f904aafdcc5437adf7f1a18be626f09ffd78d/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-04-22T13:59:23.827 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel on remote rpm x86_64 2020-04-22T13:59:23.827 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:59:23.865 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:59:23.880 INFO:teuthology.orchestra.run.smithi086:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/360f904aafdcc5437adf7f1a18be626f09ffd78d/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-04-22T13:59:23.918 INFO:teuthology.orchestra.run.smithi103:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-04-22T13:59:23.948 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:59:24.001 INFO:teuthology.orchestra.run.smithi086:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-04-22T13:59:24.005 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:59:24.057 INFO:teuthology.orchestra.run.smithi103:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-04-22T13:59:24.081 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:59:24.123 INFO:teuthology.orchestra.run.smithi103.stdout:check_obsoletes = 1 2020-04-22T13:59:24.125 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:59:24.135 INFO:teuthology.orchestra.run.smithi086:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-04-22T13:59:24.178 INFO:teuthology.orchestra.run.smithi103:> sudo yum clean all 2020-04-22T13:59:24.201 INFO:teuthology.orchestra.run.smithi086.stdout:check_obsoletes = 1 2020-04-22T13:59:24.202 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:59:24.255 INFO:teuthology.orchestra.run.smithi086:> sudo yum clean all 2020-04-22T13:59:24.549 INFO:teuthology.orchestra.run.smithi103.stdout:Updating Subscription Management repositories. 2020-04-22T13:59:24.621 INFO:teuthology.orchestra.run.smithi086.stdout:Updating Subscription Management repositories. 2020-04-22T13:59:25.039 INFO:teuthology.orchestra.run.smithi103.stdout:59 files removed 2020-04-22T13:59:25.081 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T13:59:25.094 INFO:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel 2020-04-22T13:59:25.127 INFO:teuthology.orchestra.run.smithi086.stdout:59 files removed 2020-04-22T13:59:25.170 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T13:59:25.187 INFO:teuthology.orchestra.run.smithi086:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel 2020-04-22T13:59:25.460 INFO:teuthology.orchestra.run.smithi103.stdout:Updating Subscription Management repositories. 2020-04-22T13:59:25.555 INFO:teuthology.orchestra.run.smithi086.stdout:Updating Subscription Management repositories. 2020-04-22T13:59:27.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph packages for x86_64 185 kB/s | 69 kB 00:00 2020-04-22T13:59:27.174 INFO:teuthology.orchestra.run.smithi086.stdout:ceph packages for x86_64 184 kB/s | 69 kB 00:00 2020-04-22T13:59:27.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph noarch packages 46 kB/s | 14 kB 00:00 2020-04-22T13:59:27.505 INFO:teuthology.orchestra.run.smithi086.stdout:ceph noarch packages 46 kB/s | 14 kB 00:00 2020-04-22T13:59:27.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph source packages 4.6 kB/s | 1.4 kB 00:00 2020-04-22T13:59:27.842 INFO:teuthology.orchestra.run.smithi086.stdout:ceph source packages 4.5 kB/s | 1.4 kB 00:00 2020-04-22T13:59:27.843 INFO:teuthology.orchestra.run.smithi103.stdout:Copr repo for ceph-el8 owned by ktdreyer 499 kB/s | 47 kB 00:00 2020-04-22T13:59:27.958 INFO:teuthology.orchestra.run.smithi086.stdout:Copr repo for ceph-el8 owned by ktdreyer 481 kB/s | 47 kB 00:00 2020-04-22T13:59:28.260 INFO:teuthology.orchestra.run.smithi103.stdout:Extra Packages for Enterprise Linux 16 MB/s | 6.4 MB 00:00 2020-04-22T13:59:29.059 INFO:teuthology.orchestra.run.smithi086.stdout:Extra Packages for Enterprise Linux 5.9 MB/s | 6.4 MB 00:01 2020-04-22T13:59:29.503 INFO:teuthology.orchestra.run.smithi103.stdout:lab-extras 4.2 MB/s | 20 kB 00:00 2020-04-22T13:59:29.726 INFO:teuthology.orchestra.run.smithi103.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 82 MB/s | 15 MB 00:00 2020-04-22T13:59:30.308 INFO:teuthology.orchestra.run.smithi086.stdout:lab-extras 4.0 MB/s | 20 kB 00:00 2020-04-22T13:59:30.526 INFO:teuthology.orchestra.run.smithi086.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 84 MB/s | 15 MB 00:00 2020-04-22T13:59:32.114 INFO:teuthology.orchestra.run.smithi103.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 88 MB/s | 15 MB 00:00 2020-04-22T13:59:32.877 INFO:teuthology.orchestra.run.smithi086.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 84 MB/s | 15 MB 00:00 2020-04-22T13:59:35.564 INFO:teuthology.orchestra.run.smithi103.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-04-22T13:59:35.564 INFO:teuthology.orchestra.run.smithi103.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-04-22T13:59:35.569 INFO:teuthology.orchestra.run.smithi103.stdout:Package NetworkManager-1:1.20.0-5.el8_1.x86_64 is already installed. 2020-04-22T13:59:35.570 INFO:teuthology.orchestra.run.smithi103.stdout:Package iproute-4.18.0-15.el8.x86_64 is already installed. 2020-04-22T13:59:35.570 INFO:teuthology.orchestra.run.smithi103.stdout:Package util-linux-2.32.1-17.el8.x86_64 is already installed. 2020-04-22T13:59:35.571 INFO:teuthology.orchestra.run.smithi103.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-04-22T13:59:35.572 INFO:teuthology.orchestra.run.smithi103.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-04-22T13:59:35.573 INFO:teuthology.orchestra.run.smithi103.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-04-22T13:59:35.574 INFO:teuthology.orchestra.run.smithi103.stdout:Package xfsprogs-5.0.0-1.el8.x86_64 is already installed. 2020-04-22T13:59:35.776 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2020-04-22T13:59:35.795 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2020-04-22T13:59:35.796 INFO:teuthology.orchestra.run.smithi103.stdout: Package ArchVersion Repository Size 2020-04-22T13:59:35.796 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2020-04-22T13:59:35.796 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2020-04-22T13:59:35.796 INFO:teuthology.orchestra.run.smithi103.stdout: ceph x86_642:16.0.0-952.g360f904.el8 ceph 6.4 k 2020-04-22T13:59:35.796 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-base x86_642:16.0.0-952.g360f904.el8 ceph 5.6 M 2020-04-22T13:59:35.796 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-fuse x86_642:16.0.0-952.g360f904.el8 ceph 573 k 2020-04-22T13:59:35.797 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-immutable-object-cache x86_642:16.0.0-952.g360f904.el8 ceph 203 k 2020-04-22T13:59:35.797 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr x86_642:16.0.0-952.g360f904.el8 ceph 1.4 M 2020-04-22T13:59:35.797 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-radosgw x86_642:16.0.0-952.g360f904.el8 ceph 10 M 2020-04-22T13:59:35.797 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-test x86_642:16.0.0-952.g360f904.el8 ceph 42 M 2020-04-22T13:59:35.797 INFO:teuthology.orchestra.run.smithi103.stdout: cephadm x86_642:16.0.0-952.g360f904.el8 ceph 40 k 2020-04-22T13:59:35.797 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs-devel x86_642:16.0.0-952.g360f904.el8 ceph 21 k 2020-04-22T13:59:35.797 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs2 x86_642:16.0.0-952.g360f904.el8 ceph 509 k 2020-04-22T13:59:35.798 INFO:teuthology.orchestra.run.smithi103.stdout: librados-devel x86_642:16.0.0-952.g360f904.el8 ceph 141 k 2020-04-22T13:59:35.798 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cephfs x86_642:16.0.0-952.g360f904.el8 ceph 162 k 2020-04-22T13:59:35.798 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rados x86_642:16.0.0-952.g360f904.el8 ceph 365 k 2020-04-22T13:59:35.798 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rbd x86_642:16.0.0-952.g360f904.el8 ceph 331 k 2020-04-22T13:59:35.798 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rgw x86_642:16.0.0-952.g360f904.el8 ceph 113 k 2020-04-22T13:59:35.798 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-fuse x86_642:16.0.0-952.g360f904.el8 ceph 72 k 2020-04-22T13:59:35.798 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-mirror x86_642:16.0.0-952.g360f904.el8 ceph 2.7 M 2020-04-22T13:59:35.799 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-nbd x86_642:16.0.0-952.g360f904.el8 ceph 141 k 2020-04-22T13:59:35.799 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-cephadm noarch2:16.0.0-952.g360f904.el8 ceph-noarch 42 k 2020-04-22T13:59:35.799 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-dashboard noarch2:16.0.0-952.g360f904.el8 ceph-noarch 3.5 M 2020-04-22T13:59:35.799 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-diskprediction-local noarch2:16.0.0-952.g360f904.el8 ceph-noarch 8.6 M 2020-04-22T13:59:35.799 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-rook noarch2:16.0.0-952.g360f904.el8 ceph-noarch 27 k 2020-04-22T13:59:35.799 INFO:teuthology.orchestra.run.smithi103.stdout: flex x86_642.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2020-04-22T13:59:35.799 INFO:teuthology.orchestra.run.smithi103.stdout: bison x86_643.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2020-04-22T13:59:35.800 INFO:teuthology.orchestra.run.smithi103.stdout: libtool x86_642.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2020-04-22T13:59:35.800 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-libelf-devel x86_640.176-5.el8 rhel-8-for-x86_64-baseos-rpms 54 k 2020-04-22T13:59:35.800 INFO:teuthology.orchestra.run.smithi103.stdout: xfsprogs-devel x86_645.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 69 k 2020-04-22T13:59:35.800 INFO:teuthology.orchestra.run.smithi103.stdout: libaio-devel x86_640.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2020-04-22T13:59:35.800 INFO:teuthology.orchestra.run.smithi103.stdout: libuuid-devel x86_642.32.1-17.el8 rhel-8-for-x86_64-baseos-rpms 95 k 2020-04-22T13:59:35.801 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-devel x86_641:1.1.1c-2.el8_1.1 rhel-8-for-x86_64-baseos-rpms 2.3 M 2020-04-22T13:59:35.801 INFO:teuthology.orchestra.run.smithi103.stdout:Upgrading: 2020-04-22T13:59:35.801 INFO:teuthology.orchestra.run.smithi103.stdout: librados2 x86_642:16.0.0-952.g360f904.el8 ceph 3.6 M 2020-04-22T13:59:35.801 INFO:teuthology.orchestra.run.smithi103.stdout: librbd1 x86_642:16.0.0-952.g360f904.el8 ceph 1.9 M 2020-04-22T13:59:35.801 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2020-04-22T13:59:35.801 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-common x86_642:16.0.0-952.g360f904.el8 ceph 21 M 2020-04-22T13:59:35.801 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mds x86_642:16.0.0-952.g360f904.el8 ceph 2.0 M 2020-04-22T13:59:35.801 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mon x86_642:16.0.0-952.g360f904.el8 ceph 4.4 M 2020-04-22T13:59:35.802 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-osd x86_642:16.0.0-952.g360f904.el8 ceph 17 M 2020-04-22T13:59:35.802 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-selinux x86_642:16.0.0-952.g360f904.el8 ceph 25 k 2020-04-22T13:59:35.802 INFO:teuthology.orchestra.run.smithi103.stdout: libradosstriper1 x86_642:16.0.0-952.g360f904.el8 ceph 377 k 2020-04-22T13:59:35.802 INFO:teuthology.orchestra.run.smithi103.stdout: librgw2 x86_642:16.0.0-952.g360f904.el8 ceph 3.2 M 2020-04-22T13:59:35.802 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-argparse x86_642:16.0.0-952.g360f904.el8 ceph 40 k 2020-04-22T13:59:35.802 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-common x86_642:16.0.0-952.g360f904.el8 ceph 64 k 2020-04-22T13:59:35.802 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-grafana-dashboards noarch2:16.0.0-952.g360f904.el8 ceph-noarch 22 k 2020-04-22T13:59:35.803 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-modules-core noarch2:16.0.0-952.g360f904.el8 ceph-noarch 167 k 2020-04-22T13:59:35.803 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-prometheus-alerts noarch2:16.0.0-952.g360f904.el8 ceph-noarch 8.7 k 2020-04-22T13:59:35.803 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cheroot noarch8.2.1-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 145 k 2020-04-22T13:59:35.803 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cherrypy noarch18.4.0-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 385 k 2020-04-22T13:59:35.803 INFO:teuthology.orchestra.run.smithi103.stdout: python3-execnet noarch1.7.1-1.el8.2 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 356 k 2020-04-22T13:59:35.803 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco noarch6.2-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 11 k 2020-04-22T13:59:35.803 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-functools noarch2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 18 k 2020-04-22T13:59:35.804 INFO:teuthology.orchestra.run.smithi103.stdout: python3-logutils noarch0.3.5-11.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 49 k 2020-04-22T13:59:35.804 INFO:teuthology.orchestra.run.smithi103.stdout: python3-more-itertools noarch7.2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 59 k 2020-04-22T13:59:35.804 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pecan noarch1.3.2-9.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 283 k 2020-04-22T13:59:35.804 INFO:teuthology.orchestra.run.smithi103.stdout: python3-portend noarch2.6-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 16 k 2020-04-22T13:59:35.804 INFO:teuthology.orchestra.run.smithi103.stdout: python3-remoto noarch1.1.4-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 48 k 2020-04-22T13:59:35.804 INFO:teuthology.orchestra.run.smithi103.stdout: python3-repoze-lru noarch0.7-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 34 k 2020-04-22T13:59:35.804 INFO:teuthology.orchestra.run.smithi103.stdout: python3-routes noarch2.4.1-12.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 197 k 2020-04-22T13:59:35.805 INFO:teuthology.orchestra.run.smithi103.stdout: python3-simplegeneric noarch0.8.1-17.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 19 k 2020-04-22T13:59:35.805 INFO:teuthology.orchestra.run.smithi103.stdout: python3-singledispatch noarch3.4.0.3-18.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 24 k 2020-04-22T13:59:35.805 INFO:teuthology.orchestra.run.smithi103.stdout: python3-tempora noarch1.14.1-5.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 30 k 2020-04-22T13:59:35.805 INFO:teuthology.orchestra.run.smithi103.stdout: python3-trustme noarch0.5.2-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 27 k 2020-04-22T13:59:35.805 INFO:teuthology.orchestra.run.smithi103.stdout: python3-zc-lockfile noarch2.0-2.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 23 k 2020-04-22T13:59:35.805 INFO:teuthology.orchestra.run.smithi103.stdout: gperftools-libs x86_642.7-6.el8 epel 315 k 2020-04-22T13:59:35.805 INFO:teuthology.orchestra.run.smithi103.stdout: leveldb x86_641.22-1.el8 epel 181 k 2020-04-22T13:59:35.806 INFO:teuthology.orchestra.run.smithi103.stdout: liboath x86_642.6.2-3.el8 epel 59 k 2020-04-22T13:59:35.806 INFO:teuthology.orchestra.run.smithi103.stdout: libunwind x86_641.3.1-3.el8 epel 75 k 2020-04-22T13:59:35.806 INFO:teuthology.orchestra.run.smithi103.stdout: python3-apipkg noarch1.5-6.el8 epel 21 k 2020-04-22T13:59:35.806 INFO:teuthology.orchestra.run.smithi103.stdout: python3-bcrypt x86_643.1.6-2.el8.1 epel 44 k 2020-04-22T13:59:35.806 INFO:teuthology.orchestra.run.smithi103.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 epel 185 k 2020-04-22T13:59:35.806 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cachetools noarch3.1.1-4.el8 epel 33 k 2020-04-22T13:59:35.806 INFO:teuthology.orchestra.run.smithi103.stdout: python3-certifi noarch2018.10.15-7.el8 epel 16 k 2020-04-22T13:59:35.807 INFO:teuthology.orchestra.run.smithi103.stdout: python3-google-auth noarch1:1.1.1-10.el8 epel 81 k 2020-04-22T13:59:35.807 INFO:teuthology.orchestra.run.smithi103.stdout: python3-kubernetes noarch10.0.1-2.el8 epel 1.1 M 2020-04-22T13:59:35.807 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rsa noarch3.4.2-12.el8 epel 73 k 2020-04-22T13:59:35.807 INFO:teuthology.orchestra.run.smithi103.stdout: python3-waitress noarch1.2.1-2.el8.1 epel 241 k 2020-04-22T13:59:35.807 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webob noarch1.8.5-1.el8.1 epel 251 k 2020-04-22T13:59:35.807 INFO:teuthology.orchestra.run.smithi103.stdout: python3-websocket-client noarch0.56.0-5.el8 epel 61 k 2020-04-22T13:59:35.807 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webtest noarch2.0.33-1.el8 epel 85 k 2020-04-22T13:59:35.808 INFO:teuthology.orchestra.run.smithi103.stdout: xmlstarlet x86_641.6.1-11.el8 epel 69 k 2020-04-22T13:59:35.808 INFO:teuthology.orchestra.run.smithi103.stdout: automake noarch1.16.1-6.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2020-04-22T13:59:35.808 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webencodings noarch0.5.1-6.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2020-04-22T13:59:35.808 INFO:teuthology.orchestra.run.smithi103.stdout: python3-lxml x86_644.2.3-1.el8 rhel-8-for-x86_64-appstream-rpms 1.5 M 2020-04-22T13:59:35.808 INFO:teuthology.orchestra.run.smithi103.stdout: jq x86_641.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2020-04-22T13:59:35.808 INFO:teuthology.orchestra.run.smithi103.stdout: python3-werkzeug noarch0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2020-04-22T13:59:35.808 INFO:teuthology.orchestra.run.smithi103.stdout: python3-mako noarch1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2020-04-22T13:59:35.809 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpatch noarch1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2020-04-22T13:59:35.809 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpointer noarch1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2020-04-22T13:59:35.809 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1 noarch0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2020-04-22T13:59:35.809 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pytz noarch2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2020-04-22T13:59:35.809 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-modules noarch0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2020-04-22T13:59:35.809 INFO:teuthology.orchestra.run.smithi103.stdout: python3-prettytable noarch0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2020-04-22T13:59:35.809 INFO:teuthology.orchestra.run.smithi103.stdout: socat x86_641.7.3.2-6.el8 rhel-8-for-x86_64-appstream-rpms 298 k 2020-04-22T13:59:35.810 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-threads x86_640.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 4.4 M 2020-04-22T13:59:35.810 INFO:teuthology.orchestra.run.smithi103.stdout: oniguruma x86_646.8.2-1.el8 rhel-8-for-x86_64-appstream-rpms 188 k 2020-04-22T13:59:35.810 INFO:teuthology.orchestra.run.smithi103.stdout: python3-markupsafe x86_640.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2020-04-22T13:59:35.810 INFO:teuthology.orchestra.run.smithi103.stdout: librdkafka x86_640.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2020-04-22T13:59:35.810 INFO:teuthology.orchestra.run.smithi103.stdout: openblas x86_640.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 4.3 M 2020-04-22T13:59:35.810 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy x86_641:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2020-04-22T13:59:35.810 INFO:teuthology.orchestra.run.smithi103.stdout: lttng-ust x86_642.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2020-04-22T13:59:35.811 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2020-04-22T13:59:35.811 INFO:teuthology.orchestra.run.smithi103.stdout: python3-scipy x86_641.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2020-04-22T13:59:35.811 INFO:teuthology.orchestra.run.smithi103.stdout: libverto-devel x86_640.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2020-04-22T13:59:35.811 INFO:teuthology.orchestra.run.smithi103.stdout: pcre2-utf32 x86_6410.32-1.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2020-04-22T13:59:35.811 INFO:teuthology.orchestra.run.smithi103.stdout: zlib-devel x86_641.2.11-10.el8 rhel-8-for-x86_64-baseos-rpms 56 k 2020-04-22T13:59:35.812 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2020-04-22T13:59:35.812 INFO:teuthology.orchestra.run.smithi103.stdout: fuse x86_642.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2020-04-22T13:59:35.812 INFO:teuthology.orchestra.run.smithi103.stdout: libxslt x86_641.1.32-3.el8 rhel-8-for-x86_64-baseos-rpms 249 k 2020-04-22T13:59:35.812 INFO:teuthology.orchestra.run.smithi103.stdout: keyutils-libs-devel x86_641.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2020-04-22T13:59:35.812 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jwt noarch1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2020-04-22T13:59:35.812 INFO:teuthology.orchestra.run.smithi103.stdout: pcre2-devel x86_6410.32-1.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2020-04-22T13:59:35.812 INFO:teuthology.orchestra.run.smithi103.stdout: librabbitmq x86_640.9.0-1.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2020-04-22T13:59:35.813 INFO:teuthology.orchestra.run.smithi103.stdout: python3-oauthlib noarch2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2020-04-22T13:59:35.813 INFO:teuthology.orchestra.run.smithi103.stdout: fuse-common x86_643.2.1-12.el8 rhel-8-for-x86_64-baseos-rpms 21 k 2020-04-22T13:59:35.813 INFO:teuthology.orchestra.run.smithi103.stdout: pcre2-utf16 x86_6410.32-1.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2020-04-22T13:59:35.813 INFO:teuthology.orchestra.run.smithi103.stdout: libsepol-devel x86_642.9-1.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2020-04-22T13:59:35.813 INFO:teuthology.orchestra.run.smithi103.stdout: libselinux-devel x86_642.9-2.1.el8 rhel-8-for-x86_64-baseos-rpms 199 k 2020-04-22T13:59:35.813 INFO:teuthology.orchestra.run.smithi103.stdout: libquadmath x86_648.3.1-4.5.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2020-04-22T13:59:35.813 INFO:teuthology.orchestra.run.smithi103.stdout: krb5-devel x86_641.17-9.el8 rhel-8-for-x86_64-baseos-rpms 549 k 2020-04-22T13:59:35.814 INFO:teuthology.orchestra.run.smithi103.stdout: libgfortran x86_648.3.1-4.5.el8 rhel-8-for-x86_64-baseos-rpms 638 k 2020-04-22T13:59:35.814 INFO:teuthology.orchestra.run.smithi103.stdout: libcom_err-devel x86_641.44.6-3.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2020-04-22T13:59:35.814 INFO:teuthology.orchestra.run.smithi103.stdout:Installing weak dependencies: 2020-04-22T13:59:35.814 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cssselect noarch0.9.2-10.el8 epel 40 k 2020-04-22T13:59:35.814 INFO:teuthology.orchestra.run.smithi103.stdout: python3-html5lib noarch1:0.999999999-6.el8 rhel-8-for-x86_64-appstream-rpms 214 k 2020-04-22T13:59:35.814 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T13:59:35.814 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2020-04-22T13:59:35.814 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2020-04-22T13:59:35.815 INFO:teuthology.orchestra.run.smithi103.stdout:Install 119 Packages 2020-04-22T13:59:35.815 INFO:teuthology.orchestra.run.smithi103.stdout:Upgrade 2 Packages 2020-04-22T13:59:35.815 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T13:59:35.815 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 174 M 2020-04-22T13:59:35.815 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2020-04-22T13:59:35.991 INFO:teuthology.orchestra.run.smithi103.stdout:(1/121): ceph-16.0.0-952.g360f904.el8.x86_64.rp 35 kB/s | 6.4 kB 00:00 2020-04-22T13:59:36.244 INFO:teuthology.orchestra.run.smithi086.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-04-22T13:59:36.245 INFO:teuthology.orchestra.run.smithi086.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-04-22T13:59:36.250 INFO:teuthology.orchestra.run.smithi086.stdout:Package NetworkManager-1:1.20.0-5.el8_1.x86_64 is already installed. 2020-04-22T13:59:36.250 INFO:teuthology.orchestra.run.smithi086.stdout:Package iproute-4.18.0-15.el8.x86_64 is already installed. 2020-04-22T13:59:36.251 INFO:teuthology.orchestra.run.smithi086.stdout:Package util-linux-2.32.1-17.el8.x86_64 is already installed. 2020-04-22T13:59:36.252 INFO:teuthology.orchestra.run.smithi086.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-04-22T13:59:36.253 INFO:teuthology.orchestra.run.smithi086.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-04-22T13:59:36.254 INFO:teuthology.orchestra.run.smithi086.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-04-22T13:59:36.255 INFO:teuthology.orchestra.run.smithi086.stdout:Package xfsprogs-5.0.0-1.el8.x86_64 is already installed. 2020-04-22T13:59:36.460 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2020-04-22T13:59:36.471 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2020-04-22T13:59:36.471 INFO:teuthology.orchestra.run.smithi086.stdout: Package ArchVersion Repository Size 2020-04-22T13:59:36.471 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2020-04-22T13:59:36.472 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2020-04-22T13:59:36.472 INFO:teuthology.orchestra.run.smithi086.stdout: ceph x86_642:16.0.0-952.g360f904.el8 ceph 6.4 k 2020-04-22T13:59:36.472 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-base x86_642:16.0.0-952.g360f904.el8 ceph 5.6 M 2020-04-22T13:59:36.472 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-fuse x86_642:16.0.0-952.g360f904.el8 ceph 573 k 2020-04-22T13:59:36.472 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-immutable-object-cache x86_642:16.0.0-952.g360f904.el8 ceph 203 k 2020-04-22T13:59:36.473 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr x86_642:16.0.0-952.g360f904.el8 ceph 1.4 M 2020-04-22T13:59:36.473 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-radosgw x86_642:16.0.0-952.g360f904.el8 ceph 10 M 2020-04-22T13:59:36.473 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-test x86_642:16.0.0-952.g360f904.el8 ceph 42 M 2020-04-22T13:59:36.473 INFO:teuthology.orchestra.run.smithi086.stdout: cephadm x86_642:16.0.0-952.g360f904.el8 ceph 40 k 2020-04-22T13:59:36.474 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs-devel x86_642:16.0.0-952.g360f904.el8 ceph 21 k 2020-04-22T13:59:36.474 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs2 x86_642:16.0.0-952.g360f904.el8 ceph 509 k 2020-04-22T13:59:36.474 INFO:teuthology.orchestra.run.smithi086.stdout: librados-devel x86_642:16.0.0-952.g360f904.el8 ceph 141 k 2020-04-22T13:59:36.474 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cephfs x86_642:16.0.0-952.g360f904.el8 ceph 162 k 2020-04-22T13:59:36.474 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rados x86_642:16.0.0-952.g360f904.el8 ceph 365 k 2020-04-22T13:59:36.474 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rbd x86_642:16.0.0-952.g360f904.el8 ceph 331 k 2020-04-22T13:59:36.475 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rgw x86_642:16.0.0-952.g360f904.el8 ceph 113 k 2020-04-22T13:59:36.475 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-fuse x86_642:16.0.0-952.g360f904.el8 ceph 72 k 2020-04-22T13:59:36.475 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-mirror x86_642:16.0.0-952.g360f904.el8 ceph 2.7 M 2020-04-22T13:59:36.475 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-nbd x86_642:16.0.0-952.g360f904.el8 ceph 141 k 2020-04-22T13:59:36.475 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-cephadm noarch2:16.0.0-952.g360f904.el8 ceph-noarch 42 k 2020-04-22T13:59:36.476 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-dashboard noarch2:16.0.0-952.g360f904.el8 ceph-noarch 3.5 M 2020-04-22T13:59:36.476 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-diskprediction-local noarch2:16.0.0-952.g360f904.el8 ceph-noarch 8.6 M 2020-04-22T13:59:36.476 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-rook noarch2:16.0.0-952.g360f904.el8 ceph-noarch 27 k 2020-04-22T13:59:36.477 INFO:teuthology.orchestra.run.smithi086.stdout: flex x86_642.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2020-04-22T13:59:36.477 INFO:teuthology.orchestra.run.smithi086.stdout: bison x86_643.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2020-04-22T13:59:36.477 INFO:teuthology.orchestra.run.smithi086.stdout: libtool x86_642.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2020-04-22T13:59:36.477 INFO:teuthology.orchestra.run.smithi086.stdout: elfutils-libelf-devel x86_640.176-5.el8 rhel-8-for-x86_64-baseos-rpms 54 k 2020-04-22T13:59:36.477 INFO:teuthology.orchestra.run.smithi086.stdout: xfsprogs-devel x86_645.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 69 k 2020-04-22T13:59:36.477 INFO:teuthology.orchestra.run.smithi086.stdout: libaio-devel x86_640.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2020-04-22T13:59:36.478 INFO:teuthology.orchestra.run.smithi086.stdout: libuuid-devel x86_642.32.1-17.el8 rhel-8-for-x86_64-baseos-rpms 95 k 2020-04-22T13:59:36.478 INFO:teuthology.orchestra.run.smithi086.stdout: openssl-devel x86_641:1.1.1c-2.el8_1.1 rhel-8-for-x86_64-baseos-rpms 2.3 M 2020-04-22T13:59:36.478 INFO:teuthology.orchestra.run.smithi086.stdout:Upgrading: 2020-04-22T13:59:36.480 INFO:teuthology.orchestra.run.smithi086.stdout: librados2 x86_642:16.0.0-952.g360f904.el8 ceph 3.6 M 2020-04-22T13:59:36.480 INFO:teuthology.orchestra.run.smithi086.stdout: librbd1 x86_642:16.0.0-952.g360f904.el8 ceph 1.9 M 2020-04-22T13:59:36.480 INFO:teuthology.orchestra.run.smithi086.stdout:Installing dependencies: 2020-04-22T13:59:36.480 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-common x86_642:16.0.0-952.g360f904.el8 ceph 21 M 2020-04-22T13:59:36.481 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mds x86_642:16.0.0-952.g360f904.el8 ceph 2.0 M 2020-04-22T13:59:36.481 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mon x86_642:16.0.0-952.g360f904.el8 ceph 4.4 M 2020-04-22T13:59:36.481 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-osd x86_642:16.0.0-952.g360f904.el8 ceph 17 M 2020-04-22T13:59:36.481 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-selinux x86_642:16.0.0-952.g360f904.el8 ceph 25 k 2020-04-22T13:59:36.481 INFO:teuthology.orchestra.run.smithi086.stdout: libradosstriper1 x86_642:16.0.0-952.g360f904.el8 ceph 377 k 2020-04-22T13:59:36.481 INFO:teuthology.orchestra.run.smithi086.stdout: librgw2 x86_642:16.0.0-952.g360f904.el8 ceph 3.2 M 2020-04-22T13:59:36.481 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-argparse x86_642:16.0.0-952.g360f904.el8 ceph 40 k 2020-04-22T13:59:36.482 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-common x86_642:16.0.0-952.g360f904.el8 ceph 64 k 2020-04-22T13:59:36.482 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-grafana-dashboards noarch2:16.0.0-952.g360f904.el8 ceph-noarch 22 k 2020-04-22T13:59:36.482 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-modules-core noarch2:16.0.0-952.g360f904.el8 ceph-noarch 167 k 2020-04-22T13:59:36.482 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-prometheus-alerts noarch2:16.0.0-952.g360f904.el8 ceph-noarch 8.7 k 2020-04-22T13:59:36.482 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cheroot noarch8.2.1-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 145 k 2020-04-22T13:59:36.483 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cherrypy noarch18.4.0-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 385 k 2020-04-22T13:59:36.483 INFO:teuthology.orchestra.run.smithi086.stdout: python3-execnet noarch1.7.1-1.el8.2 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 356 k 2020-04-22T13:59:36.483 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco noarch6.2-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 11 k 2020-04-22T13:59:36.483 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-functools noarch2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 18 k 2020-04-22T13:59:36.483 INFO:teuthology.orchestra.run.smithi086.stdout: python3-logutils noarch0.3.5-11.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 49 k 2020-04-22T13:59:36.484 INFO:teuthology.orchestra.run.smithi086.stdout: python3-more-itertools noarch7.2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 59 k 2020-04-22T13:59:36.484 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pecan noarch1.3.2-9.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 283 k 2020-04-22T13:59:36.484 INFO:teuthology.orchestra.run.smithi086.stdout: python3-portend noarch2.6-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 16 k 2020-04-22T13:59:36.484 INFO:teuthology.orchestra.run.smithi086.stdout: python3-remoto noarch1.1.4-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 48 k 2020-04-22T13:59:36.484 INFO:teuthology.orchestra.run.smithi086.stdout: python3-repoze-lru noarch0.7-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 34 k 2020-04-22T13:59:36.484 INFO:teuthology.orchestra.run.smithi086.stdout: python3-routes noarch2.4.1-12.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 197 k 2020-04-22T13:59:36.484 INFO:teuthology.orchestra.run.smithi086.stdout: python3-simplegeneric noarch0.8.1-17.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 19 k 2020-04-22T13:59:36.484 INFO:teuthology.orchestra.run.smithi086.stdout: python3-singledispatch noarch3.4.0.3-18.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 24 k 2020-04-22T13:59:36.485 INFO:teuthology.orchestra.run.smithi086.stdout: python3-tempora noarch1.14.1-5.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 30 k 2020-04-22T13:59:36.485 INFO:teuthology.orchestra.run.smithi086.stdout: python3-trustme noarch0.5.2-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 27 k 2020-04-22T13:59:36.485 INFO:teuthology.orchestra.run.smithi086.stdout: python3-zc-lockfile noarch2.0-2.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 23 k 2020-04-22T13:59:36.485 INFO:teuthology.orchestra.run.smithi086.stdout: gperftools-libs x86_642.7-6.el8 epel 315 k 2020-04-22T13:59:36.485 INFO:teuthology.orchestra.run.smithi086.stdout: leveldb x86_641.22-1.el8 epel 181 k 2020-04-22T13:59:36.485 INFO:teuthology.orchestra.run.smithi086.stdout: liboath x86_642.6.2-3.el8 epel 59 k 2020-04-22T13:59:36.486 INFO:teuthology.orchestra.run.smithi086.stdout: libunwind x86_641.3.1-3.el8 epel 75 k 2020-04-22T13:59:36.486 INFO:teuthology.orchestra.run.smithi086.stdout: python3-apipkg noarch1.5-6.el8 epel 21 k 2020-04-22T13:59:36.487 INFO:teuthology.orchestra.run.smithi086.stdout: python3-bcrypt x86_643.1.6-2.el8.1 epel 44 k 2020-04-22T13:59:36.487 INFO:teuthology.orchestra.run.smithi086.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 epel 185 k 2020-04-22T13:59:36.488 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cachetools noarch3.1.1-4.el8 epel 33 k 2020-04-22T13:59:36.488 INFO:teuthology.orchestra.run.smithi086.stdout: python3-certifi noarch2018.10.15-7.el8 epel 16 k 2020-04-22T13:59:36.488 INFO:teuthology.orchestra.run.smithi086.stdout: python3-google-auth noarch1:1.1.1-10.el8 epel 81 k 2020-04-22T13:59:36.489 INFO:teuthology.orchestra.run.smithi086.stdout: python3-kubernetes noarch10.0.1-2.el8 epel 1.1 M 2020-04-22T13:59:36.489 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rsa noarch3.4.2-12.el8 epel 73 k 2020-04-22T13:59:36.489 INFO:teuthology.orchestra.run.smithi086.stdout: python3-waitress noarch1.2.1-2.el8.1 epel 241 k 2020-04-22T13:59:36.489 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webob noarch1.8.5-1.el8.1 epel 251 k 2020-04-22T13:59:36.489 INFO:teuthology.orchestra.run.smithi086.stdout: python3-websocket-client noarch0.56.0-5.el8 epel 61 k 2020-04-22T13:59:36.489 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webtest noarch2.0.33-1.el8 epel 85 k 2020-04-22T13:59:36.489 INFO:teuthology.orchestra.run.smithi086.stdout: xmlstarlet x86_641.6.1-11.el8 epel 69 k 2020-04-22T13:59:36.490 INFO:teuthology.orchestra.run.smithi086.stdout: automake noarch1.16.1-6.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2020-04-22T13:59:36.490 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webencodings noarch0.5.1-6.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2020-04-22T13:59:36.490 INFO:teuthology.orchestra.run.smithi086.stdout: python3-lxml x86_644.2.3-1.el8 rhel-8-for-x86_64-appstream-rpms 1.5 M 2020-04-22T13:59:36.490 INFO:teuthology.orchestra.run.smithi086.stdout: jq x86_641.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2020-04-22T13:59:36.490 INFO:teuthology.orchestra.run.smithi086.stdout: python3-werkzeug noarch0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2020-04-22T13:59:36.490 INFO:teuthology.orchestra.run.smithi086.stdout: python3-mako noarch1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2020-04-22T13:59:36.490 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpatch noarch1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2020-04-22T13:59:36.491 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpointer noarch1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2020-04-22T13:59:36.491 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1 noarch0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2020-04-22T13:59:36.491 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pytz noarch2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2020-04-22T13:59:36.491 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1-modules noarch0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2020-04-22T13:59:36.491 INFO:teuthology.orchestra.run.smithi086.stdout: python3-prettytable noarch0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2020-04-22T13:59:36.491 INFO:teuthology.orchestra.run.smithi086.stdout: socat x86_641.7.3.2-6.el8 rhel-8-for-x86_64-appstream-rpms 298 k 2020-04-22T13:59:36.491 INFO:teuthology.orchestra.run.smithi086.stdout: openblas-threads x86_640.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 4.4 M 2020-04-22T13:59:36.492 INFO:teuthology.orchestra.run.smithi086.stdout: oniguruma x86_646.8.2-1.el8 rhel-8-for-x86_64-appstream-rpms 188 k 2020-04-22T13:59:36.492 INFO:teuthology.orchestra.run.smithi086.stdout: python3-markupsafe x86_640.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2020-04-22T13:59:36.492 INFO:teuthology.orchestra.run.smithi086.stdout: librdkafka x86_640.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2020-04-22T13:59:36.492 INFO:teuthology.orchestra.run.smithi086.stdout: openblas x86_640.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 4.3 M 2020-04-22T13:59:36.492 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy x86_641:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2020-04-22T13:59:36.492 INFO:teuthology.orchestra.run.smithi086.stdout: lttng-ust x86_642.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2020-04-22T13:59:36.492 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2020-04-22T13:59:36.493 INFO:teuthology.orchestra.run.smithi086.stdout: python3-scipy x86_641.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2020-04-22T13:59:36.493 INFO:teuthology.orchestra.run.smithi086.stdout: libverto-devel x86_640.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2020-04-22T13:59:36.493 INFO:teuthology.orchestra.run.smithi086.stdout: pcre2-utf32 x86_6410.32-1.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2020-04-22T13:59:36.493 INFO:teuthology.orchestra.run.smithi086.stdout: zlib-devel x86_641.2.11-10.el8 rhel-8-for-x86_64-baseos-rpms 56 k 2020-04-22T13:59:36.493 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2020-04-22T13:59:36.493 INFO:teuthology.orchestra.run.smithi086.stdout: fuse x86_642.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2020-04-22T13:59:36.494 INFO:teuthology.orchestra.run.smithi086.stdout: libxslt x86_641.1.32-3.el8 rhel-8-for-x86_64-baseos-rpms 249 k 2020-04-22T13:59:36.494 INFO:teuthology.orchestra.run.smithi086.stdout: keyutils-libs-devel x86_641.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2020-04-22T13:59:36.494 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jwt noarch1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2020-04-22T13:59:36.494 INFO:teuthology.orchestra.run.smithi086.stdout: pcre2-devel x86_6410.32-1.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2020-04-22T13:59:36.494 INFO:teuthology.orchestra.run.smithi086.stdout: librabbitmq x86_640.9.0-1.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2020-04-22T13:59:36.494 INFO:teuthology.orchestra.run.smithi086.stdout: python3-oauthlib noarch2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2020-04-22T13:59:36.494 INFO:teuthology.orchestra.run.smithi086.stdout: fuse-common x86_643.2.1-12.el8 rhel-8-for-x86_64-baseos-rpms 21 k 2020-04-22T13:59:36.494 INFO:teuthology.orchestra.run.smithi086.stdout: pcre2-utf16 x86_6410.32-1.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2020-04-22T13:59:36.495 INFO:teuthology.orchestra.run.smithi086.stdout: libsepol-devel x86_642.9-1.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2020-04-22T13:59:36.495 INFO:teuthology.orchestra.run.smithi086.stdout: libselinux-devel x86_642.9-2.1.el8 rhel-8-for-x86_64-baseos-rpms 199 k 2020-04-22T13:59:36.495 INFO:teuthology.orchestra.run.smithi086.stdout: libquadmath x86_648.3.1-4.5.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2020-04-22T13:59:36.495 INFO:teuthology.orchestra.run.smithi086.stdout: krb5-devel x86_641.17-9.el8 rhel-8-for-x86_64-baseos-rpms 549 k 2020-04-22T13:59:36.496 INFO:teuthology.orchestra.run.smithi086.stdout: libgfortran x86_648.3.1-4.5.el8 rhel-8-for-x86_64-baseos-rpms 638 k 2020-04-22T13:59:36.496 INFO:teuthology.orchestra.run.smithi086.stdout: libcom_err-devel x86_641.44.6-3.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2020-04-22T13:59:36.496 INFO:teuthology.orchestra.run.smithi086.stdout:Installing weak dependencies: 2020-04-22T13:59:36.496 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cssselect noarch0.9.2-10.el8 epel 40 k 2020-04-22T13:59:36.496 INFO:teuthology.orchestra.run.smithi086.stdout: python3-html5lib noarch1:0.999999999-6.el8 rhel-8-for-x86_64-appstream-rpms 214 k 2020-04-22T13:59:36.497 INFO:teuthology.orchestra.run.smithi086.stdout: 2020-04-22T13:59:36.497 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2020-04-22T13:59:36.497 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2020-04-22T13:59:36.498 INFO:teuthology.orchestra.run.smithi086.stdout:Install 119 Packages 2020-04-22T13:59:36.498 INFO:teuthology.orchestra.run.smithi086.stdout:Upgrade 2 Packages 2020-04-22T13:59:36.498 INFO:teuthology.orchestra.run.smithi086.stdout: 2020-04-22T13:59:36.500 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 174 M 2020-04-22T13:59:36.500 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2020-04-22T13:59:36.531 INFO:teuthology.orchestra.run.smithi103.stdout:(2/121): ceph-fuse-16.0.0-952.g360f904.el8.x86_ 1.0 MB/s | 573 kB 00:00 2020-04-22T13:59:36.706 INFO:teuthology.orchestra.run.smithi103.stdout:(3/121): ceph-immutable-object-cache-16.0.0-952 1.1 MB/s | 203 kB 00:00 2020-04-22T13:59:36.822 INFO:teuthology.orchestra.run.smithi086.stdout:(1/121): ceph-16.0.0-952.g360f904.el8.x86_64.rp 19 kB/s | 6.4 kB 00:00 2020-04-22T13:59:37.762 INFO:teuthology.orchestra.run.smithi086.stdout:(2/121): ceph-fuse-16.0.0-952.g360f904.el8.x86_ 610 kB/s | 573 kB 00:00 2020-04-22T13:59:37.990 INFO:teuthology.orchestra.run.smithi086.stdout:(3/121): ceph-immutable-object-cache-16.0.0-952 895 kB/s | 203 kB 00:00 2020-04-22T13:59:38.324 INFO:teuthology.orchestra.run.smithi103.stdout:(4/121): ceph-mds-16.0.0-952.g360f904.el8.x86_6 1.3 MB/s | 2.0 MB 00:01 2020-04-22T13:59:39.039 INFO:teuthology.orchestra.run.smithi086.stdout:(4/121): ceph-mds-16.0.0-952.g360f904.el8.x86_6 1.9 MB/s | 2.0 MB 00:01 2020-04-22T13:59:39.537 INFO:teuthology.orchestra.run.smithi103.stdout:(5/121): ceph-mgr-16.0.0-952.g360f904.el8.x86_6 1.2 MB/s | 1.4 MB 00:01 2020-04-22T13:59:39.609 INFO:teuthology.orchestra.run.smithi086.stdout:(5/121): ceph-mgr-16.0.0-952.g360f904.el8.x86_6 2.5 MB/s | 1.4 MB 00:00 2020-04-22T13:59:39.943 INFO:teuthology.orchestra.run.smithi086.stdout:(6/121): ceph-base-16.0.0-952.g360f904.el8.x86_ 1.6 MB/s | 5.6 MB 00:03 2020-04-22T13:59:40.247 INFO:teuthology.orchestra.run.smithi103.stdout:(6/121): ceph-base-16.0.0-952.g360f904.el8.x86_ 1.3 MB/s | 5.6 MB 00:04 2020-04-22T13:59:41.329 INFO:teuthology.orchestra.run.smithi086.stdout:(7/121): ceph-mon-16.0.0-952.g360f904.el8.x86_6 2.5 MB/s | 4.4 MB 00:01 2020-04-22T13:59:42.735 INFO:teuthology.orchestra.run.smithi103.stdout:(7/121): ceph-mon-16.0.0-952.g360f904.el8.x86_6 1.4 MB/s | 4.4 MB 00:03 2020-04-22T13:59:44.084 INFO:teuthology.orchestra.run.smithi086.stdout:(8/121): ceph-radosgw-16.0.0-952.g360f904.el8.x 3.6 MB/s | 10 MB 00:02 2020-04-22T13:59:44.132 INFO:teuthology.orchestra.run.smithi086.stdout:(9/121): ceph-selinux-16.0.0-952.g360f904.el8.x 517 kB/s | 25 kB 00:00 2020-04-22T13:59:44.663 INFO:teuthology.orchestra.run.smithi086.stdout:(10/121): ceph-osd-16.0.0-952.g360f904.el8.x86_ 3.5 MB/s | 17 MB 00:04 2020-04-22T13:59:44.725 INFO:teuthology.orchestra.run.smithi086.stdout:(11/121): cephadm-16.0.0-952.g360f904.el8.x86_6 653 kB/s | 40 kB 00:00 2020-04-22T13:59:44.785 INFO:teuthology.orchestra.run.smithi086.stdout:(12/121): libcephfs-devel-16.0.0-952.g360f904.e 362 kB/s | 21 kB 00:00 2020-04-22T13:59:44.977 INFO:teuthology.orchestra.run.smithi086.stdout:(13/121): libcephfs2-16.0.0-952.g360f904.el8.x8 2.6 MB/s | 509 kB 00:00 2020-04-22T13:59:45.042 INFO:teuthology.orchestra.run.smithi086.stdout:(14/121): librados-devel-16.0.0-952.g360f904.el 2.1 MB/s | 141 kB 00:00 2020-04-22T13:59:45.170 INFO:teuthology.orchestra.run.smithi086.stdout:(15/121): libradosstriper1-16.0.0-952.g360f904. 2.9 MB/s | 377 kB 00:00 2020-04-22T13:59:46.015 INFO:teuthology.orchestra.run.smithi086.stdout:(16/121): librgw2-16.0.0-952.g360f904.el8.x86_6 3.8 MB/s | 3.2 MB 00:00 2020-04-22T13:59:46.067 INFO:teuthology.orchestra.run.smithi086.stdout:(17/121): python3-ceph-argparse-16.0.0-952.g360 780 kB/s | 40 kB 00:00 2020-04-22T13:59:46.117 INFO:teuthology.orchestra.run.smithi086.stdout:(18/121): python3-ceph-common-16.0.0-952.g360f9 1.2 MB/s | 64 kB 00:00 2020-04-22T13:59:46.173 INFO:teuthology.orchestra.run.smithi086.stdout:(19/121): python3-cephfs-16.0.0-952.g360f904.el 2.8 MB/s | 162 kB 00:00 2020-04-22T13:59:46.286 INFO:teuthology.orchestra.run.smithi086.stdout:(20/121): python3-rados-16.0.0-952.g360f904.el8 3.2 MB/s | 365 kB 00:00 2020-04-22T13:59:46.398 INFO:teuthology.orchestra.run.smithi086.stdout:(21/121): python3-rbd-16.0.0-952.g360f904.el8.x 2.9 MB/s | 331 kB 00:00 2020-04-22T13:59:46.452 INFO:teuthology.orchestra.run.smithi086.stdout:(22/121): python3-rgw-16.0.0-952.g360f904.el8.x 2.0 MB/s | 113 kB 00:00 2020-04-22T13:59:46.509 INFO:teuthology.orchestra.run.smithi086.stdout:(23/121): rbd-fuse-16.0.0-952.g360f904.el8.x86_ 1.3 MB/s | 72 kB 00:00 2020-04-22T13:59:47.126 INFO:teuthology.orchestra.run.smithi086.stdout:(24/121): rbd-mirror-16.0.0-952.g360f904.el8.x8 4.4 MB/s | 2.7 MB 00:00 2020-04-22T13:59:47.179 INFO:teuthology.orchestra.run.smithi086.stdout:(25/121): rbd-nbd-16.0.0-952.g360f904.el8.x86_6 2.7 MB/s | 141 kB 00:00 2020-04-22T13:59:47.232 INFO:teuthology.orchestra.run.smithi086.stdout:(26/121): ceph-grafana-dashboards-16.0.0-952.g3 423 kB/s | 22 kB 00:00 2020-04-22T13:59:47.286 INFO:teuthology.orchestra.run.smithi086.stdout:(27/121): ceph-mgr-cephadm-16.0.0-952.g360f904. 773 kB/s | 42 kB 00:00 2020-04-22T13:59:48.047 INFO:teuthology.orchestra.run.smithi103.stdout:(8/121): ceph-radosgw-16.0.0-952.g360f904.el8.x 1.9 MB/s | 10 MB 00:05 2020-04-22T13:59:48.117 INFO:teuthology.orchestra.run.smithi086.stdout:(28/121): ceph-mgr-dashboard-16.0.0-952.g360f90 4.3 MB/s | 3.5 MB 00:00 2020-04-22T13:59:48.117 INFO:teuthology.orchestra.run.smithi103.stdout:(9/121): ceph-selinux-16.0.0-952.g360f904.el8.x 427 kB/s | 25 kB 00:00 2020-04-22T13:59:48.612 INFO:teuthology.orchestra.run.smithi103.stdout:(10/121): ceph-common-16.0.0-952.g360f904.el8.x 1.6 MB/s | 21 MB 00:12 2020-04-22T13:59:48.676 INFO:teuthology.orchestra.run.smithi103.stdout:(11/121): cephadm-16.0.0-952.g360f904.el8.x86_6 641 kB/s | 40 kB 00:00 2020-04-22T13:59:48.734 INFO:teuthology.orchestra.run.smithi103.stdout:(12/121): libcephfs-devel-16.0.0-952.g360f904.e 368 kB/s | 21 kB 00:00 2020-04-22T13:59:48.922 INFO:teuthology.orchestra.run.smithi103.stdout:(13/121): libcephfs2-16.0.0-952.g360f904.el8.x8 2.7 MB/s | 509 kB 00:00 2020-04-22T13:59:48.982 INFO:teuthology.orchestra.run.smithi103.stdout:(14/121): librados-devel-16.0.0-952.g360f904.el 2.3 MB/s | 141 kB 00:00 2020-04-22T13:59:49.153 INFO:teuthology.orchestra.run.smithi103.stdout:(15/121): ceph-osd-16.0.0-952.g360f904.el8.x86_ 1.9 MB/s | 17 MB 00:08 2020-04-22T13:59:49.156 INFO:teuthology.orchestra.run.smithi103.stdout:(16/121): libradosstriper1-16.0.0-952.g360f904. 2.1 MB/s | 377 kB 00:00 2020-04-22T13:59:49.214 INFO:teuthology.orchestra.run.smithi103.stdout:(17/121): python3-ceph-argparse-16.0.0-952.g360 700 kB/s | 40 kB 00:00 2020-04-22T13:59:49.272 INFO:teuthology.orchestra.run.smithi103.stdout:(18/121): python3-ceph-common-16.0.0-952.g360f9 1.1 MB/s | 64 kB 00:00 2020-04-22T13:59:49.334 INFO:teuthology.orchestra.run.smithi103.stdout:(19/121): python3-cephfs-16.0.0-952.g360f904.el 2.5 MB/s | 162 kB 00:00 2020-04-22T13:59:49.462 INFO:teuthology.orchestra.run.smithi103.stdout:(20/121): python3-rados-16.0.0-952.g360f904.el8 2.8 MB/s | 365 kB 00:00 2020-04-22T13:59:49.591 INFO:teuthology.orchestra.run.smithi103.stdout:(21/121): python3-rbd-16.0.0-952.g360f904.el8.x 2.5 MB/s | 331 kB 00:00 2020-04-22T13:59:49.652 INFO:teuthology.orchestra.run.smithi103.stdout:(22/121): python3-rgw-16.0.0-952.g360f904.el8.x 1.8 MB/s | 113 kB 00:00 2020-04-22T13:59:49.714 INFO:teuthology.orchestra.run.smithi103.stdout:(23/121): rbd-fuse-16.0.0-952.g360f904.el8.x86_ 1.1 MB/s | 72 kB 00:00 2020-04-22T13:59:50.103 INFO:teuthology.orchestra.run.smithi086.stdout:(29/121): ceph-mgr-diskprediction-local-16.0.0- 4.3 MB/s | 8.6 MB 00:01 2020-04-22T13:59:50.167 INFO:teuthology.orchestra.run.smithi086.stdout:(30/121): ceph-mgr-modules-core-16.0.0-952.g360 2.4 MB/s | 167 kB 00:00 2020-04-22T13:59:50.233 INFO:teuthology.orchestra.run.smithi086.stdout:(31/121): ceph-mgr-rook-16.0.0-952.g360f904.el8 414 kB/s | 27 kB 00:00 2020-04-22T13:59:50.286 INFO:teuthology.orchestra.run.smithi086.stdout:(32/121): ceph-prometheus-alerts-16.0.0-952.g36 165 kB/s | 8.7 kB 00:00 2020-04-22T13:59:50.341 INFO:teuthology.orchestra.run.smithi086.stdout:(33/121): python3-cheroot-8.2.1-1.el8.noarch.rp 2.6 MB/s | 145 kB 00:00 2020-04-22T13:59:50.363 INFO:teuthology.orchestra.run.smithi086.stdout:(34/121): python3-cherrypy-18.4.0-1.el8.noarch. 17 MB/s | 385 kB 00:00 2020-04-22T13:59:50.369 INFO:teuthology.orchestra.run.smithi103.stdout:(24/121): librgw2-16.0.0-952.g360f904.el8.x86_6 2.6 MB/s | 3.2 MB 00:01 2020-04-22T13:59:50.376 INFO:teuthology.orchestra.run.smithi086.stdout:(35/121): python3-execnet-1.7.1-1.el8.2.noarch. 27 MB/s | 356 kB 00:00 2020-04-22T13:59:50.385 INFO:teuthology.orchestra.run.smithi086.stdout:(36/121): python3-jaraco-6.2-6.el8.noarch.rpm 1.4 MB/s | 11 kB 00:00 2020-04-22T13:59:50.393 INFO:teuthology.orchestra.run.smithi086.stdout:(37/121): python3-jaraco-functools-2.0-4.el8.no 2.2 MB/s | 18 kB 00:00 2020-04-22T13:59:50.401 INFO:teuthology.orchestra.run.smithi086.stdout:(38/121): python3-logutils-0.3.5-11.el8.noarch. 5.8 MB/s | 49 kB 00:00 2020-04-22T13:59:50.410 INFO:teuthology.orchestra.run.smithi086.stdout:(39/121): python3-more-itertools-7.2.0-4.el8.no 6.7 MB/s | 59 kB 00:00 2020-04-22T13:59:50.416 INFO:teuthology.orchestra.run.smithi103.stdout:(25/121): rbd-nbd-16.0.0-952.g360f904.el8.x86_6 2.9 MB/s | 141 kB 00:00 2020-04-22T13:59:50.421 INFO:teuthology.orchestra.run.smithi086.stdout:(40/121): python3-pecan-1.3.2-9.el8.noarch.rpm 25 MB/s | 283 kB 00:00 2020-04-22T13:59:50.430 INFO:teuthology.orchestra.run.smithi086.stdout:(41/121): python3-portend-2.6-1.el8.noarch.rpm 1.9 MB/s | 16 kB 00:00 2020-04-22T13:59:50.438 INFO:teuthology.orchestra.run.smithi086.stdout:(42/121): python3-remoto-1.1.4-4.el8.noarch.rpm 5.6 MB/s | 48 kB 00:00 2020-04-22T13:59:50.447 INFO:teuthology.orchestra.run.smithi086.stdout:(43/121): python3-repoze-lru-0.7-6.el8.noarch.r 4.0 MB/s | 34 kB 00:00 2020-04-22T13:59:50.459 INFO:teuthology.orchestra.run.smithi086.stdout:(44/121): python3-routes-2.4.1-12.el8.noarch.rp 15 MB/s | 197 kB 00:00 2020-04-22T13:59:50.466 INFO:teuthology.orchestra.run.smithi103.stdout:(26/121): ceph-grafana-dashboards-16.0.0-952.g3 455 kB/s | 22 kB 00:00 2020-04-22T13:59:50.471 INFO:teuthology.orchestra.run.smithi086.stdout:(45/121): python3-simplegeneric-0.8.1-17.el8.no 1.7 MB/s | 19 kB 00:00 2020-04-22T13:59:50.479 INFO:teuthology.orchestra.run.smithi086.stdout:(46/121): python3-singledispatch-3.4.0.3-18.el8 2.9 MB/s | 24 kB 00:00 2020-04-22T13:59:50.488 INFO:teuthology.orchestra.run.smithi086.stdout:(47/121): python3-tempora-1.14.1-5.el8.noarch.r 3.5 MB/s | 30 kB 00:00 2020-04-22T13:59:50.490 INFO:teuthology.orchestra.run.smithi103.stdout:(27/121): rbd-mirror-16.0.0-952.g360f904.el8.x8 3.5 MB/s | 2.7 MB 00:00 2020-04-22T13:59:50.496 INFO:teuthology.orchestra.run.smithi086.stdout:(48/121): python3-trustme-0.5.2-4.el8.noarch.rp 3.2 MB/s | 27 kB 00:00 2020-04-22T13:59:50.504 INFO:teuthology.orchestra.run.smithi086.stdout:(49/121): python3-zc-lockfile-2.0-2.el8.noarch. 2.8 MB/s | 23 kB 00:00 2020-04-22T13:59:50.509 INFO:teuthology.orchestra.run.smithi103.stdout:(28/121): ceph-mgr-cephadm-16.0.0-952.g360f904. 965 kB/s | 42 kB 00:00 2020-04-22T13:59:50.598 INFO:teuthology.orchestra.run.smithi086.stdout:(50/121): gperftools-libs-2.7-6.el8.x86_64.rpm 3.3 MB/s | 315 kB 00:00 2020-04-22T13:59:50.615 INFO:teuthology.orchestra.run.smithi086.stdout:(51/121): leveldb-1.22-1.el8.x86_64.rpm 11 MB/s | 181 kB 00:00 2020-04-22T13:59:50.631 INFO:teuthology.orchestra.run.smithi086.stdout:(52/121): liboath-2.6.2-3.el8.x86_64.rpm 3.6 MB/s | 59 kB 00:00 2020-04-22T13:59:50.647 INFO:teuthology.orchestra.run.smithi086.stdout:(53/121): libunwind-1.3.1-3.el8.x86_64.rpm 4.5 MB/s | 75 kB 00:00 2020-04-22T13:59:50.665 INFO:teuthology.orchestra.run.smithi086.stdout:(54/121): python3-apipkg-1.5-6.el8.noarch.rpm 1.3 MB/s | 21 kB 00:00 2020-04-22T13:59:50.679 INFO:teuthology.orchestra.run.smithi086.stdout:(55/121): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 2.7 MB/s | 44 kB 00:00 2020-04-22T13:59:50.696 INFO:teuthology.orchestra.run.smithi086.stdout:(56/121): python3-beautifulsoup4-4.6.3-2.el8.1. 11 MB/s | 185 kB 00:00 2020-04-22T13:59:50.828 INFO:teuthology.orchestra.run.smithi086.stdout:(57/121): ceph-common-16.0.0-952.g360f904.el8.x 1.5 MB/s | 21 MB 00:14 2020-04-22T13:59:50.829 INFO:teuthology.orchestra.run.smithi086.stdout:(58/121): python3-cachetools-3.1.1-4.el8.noarch 247 kB/s | 33 kB 00:00 2020-04-22T13:59:50.845 INFO:teuthology.orchestra.run.smithi086.stdout:(59/121): python3-cssselect-0.9.2-10.el8.noarch 2.5 MB/s | 40 kB 00:00 2020-04-22T13:59:50.861 INFO:teuthology.orchestra.run.smithi086.stdout:(60/121): python3-google-auth-1.1.1-10.el8.noar 4.9 MB/s | 81 kB 00:00 2020-04-22T13:59:50.875 INFO:teuthology.orchestra.run.smithi086.stdout:(61/121): python3-certifi-2018.10.15-7.el8.noar 353 kB/s | 16 kB 00:00 2020-04-22T13:59:50.906 INFO:teuthology.orchestra.run.smithi086.stdout:(62/121): python3-rsa-3.4.2-12.el8.noarch.rpm 2.3 MB/s | 73 kB 00:00 2020-04-22T13:59:50.926 INFO:teuthology.orchestra.run.smithi086.stdout:(63/121): python3-kubernetes-10.0.1-2.el8.noarc 17 MB/s | 1.1 MB 00:00 2020-04-22T13:59:50.951 INFO:teuthology.orchestra.run.smithi086.stdout:(64/121): python3-waitress-1.2.1-2.el8.1.noarch 7.3 MB/s | 241 kB 00:00 2020-04-22T13:59:50.951 INFO:teuthology.orchestra.run.smithi086.stdout:(65/121): python3-webob-1.8.5-1.el8.1.noarch.rp 14 MB/s | 251 kB 00:00 2020-04-22T13:59:50.954 INFO:teuthology.orchestra.run.smithi086.stdout:(66/121): python3-websocket-client-0.56.0-5.el8 3.8 MB/s | 61 kB 00:00 2020-04-22T13:59:50.961 INFO:teuthology.orchestra.run.smithi086.stdout:(67/121): python3-webtest-2.0.33-1.el8.noarch.r 5.2 MB/s | 85 kB 00:00 2020-04-22T13:59:50.971 INFO:teuthology.orchestra.run.smithi086.stdout:(68/121): xmlstarlet-1.6.1-11.el8.x86_64.rpm 4.2 MB/s | 69 kB 00:00 2020-04-22T13:59:51.007 INFO:teuthology.orchestra.run.smithi086.stdout:(69/121): automake-1.16.1-6.el8.noarch.rpm 15 MB/s | 713 kB 00:00 2020-04-22T13:59:51.016 INFO:teuthology.orchestra.run.smithi086.stdout:(70/121): python3-webencodings-0.5.1-6.el8.noar 718 kB/s | 27 kB 00:00 2020-04-22T13:59:51.038 INFO:teuthology.orchestra.run.smithi086.stdout:(71/121): jq-1.5-12.el8.x86_64.rpm 5.3 MB/s | 161 kB 00:00 2020-04-22T13:59:51.051 INFO:teuthology.orchestra.run.smithi086.stdout:(72/121): python3-lxml-4.2.3-1.el8.x86_64.rpm 34 MB/s | 1.5 MB 00:00 2020-04-22T13:59:51.071 INFO:teuthology.orchestra.run.smithi086.stdout:(73/121): python3-werkzeug-0.12.2-4.el8.noarch. 14 MB/s | 457 kB 00:00 2020-04-22T13:59:51.079 INFO:teuthology.orchestra.run.smithi086.stdout:(74/121): python3-mako-1.0.6-13.el8.noarch.rpm 6.5 MB/s | 157 kB 00:00 2020-04-22T13:59:51.093 INFO:teuthology.orchestra.run.smithi086.stdout:(75/121): python3-jsonpatch-1.21-2.el8.noarch.r 1.2 MB/s | 27 kB 00:00 2020-04-22T13:59:51.104 INFO:teuthology.orchestra.run.smithi086.stdout:(76/121): python3-jsonpointer-1.10-11.el8.noarc 814 kB/s | 20 kB 00:00 2020-04-22T13:59:51.123 INFO:teuthology.orchestra.run.smithi086.stdout:(77/121): python3-html5lib-0.999999999-6.el8.no 7.0 MB/s | 214 kB 00:00 2020-04-22T13:59:51.131 INFO:teuthology.orchestra.run.smithi086.stdout:(78/121): python3-pyasn1-0.3.7-6.el8.noarch.rpm 4.6 MB/s | 126 kB 00:00 2020-04-22T13:59:51.150 INFO:teuthology.orchestra.run.smithi086.stdout:(79/121): python3-pytz-2017.2-9.el8.noarch.rpm 2.0 MB/s | 54 kB 00:00 2020-04-22T13:59:51.158 INFO:teuthology.orchestra.run.smithi086.stdout:(80/121): python3-pyasn1-modules-0.3.7-6.el8.no 4.0 MB/s | 110 kB 00:00 2020-04-22T13:59:51.175 INFO:teuthology.orchestra.run.smithi086.stdout:(81/121): python3-prettytable-0.7.2-14.el8.noar 1.7 MB/s | 44 kB 00:00 2020-04-22T13:59:51.184 INFO:teuthology.orchestra.run.smithi086.stdout:(82/121): socat-1.7.3.2-6.el8.x86_64.rpm 11 MB/s | 298 kB 00:00 2020-04-22T13:59:51.202 INFO:teuthology.orchestra.run.smithi103.stdout:(29/121): ceph-mgr-dashboard-16.0.0-952.g360f90 5.0 MB/s | 3.5 MB 00:00 2020-04-22T13:59:51.213 INFO:teuthology.orchestra.run.smithi086.stdout:(83/121): oniguruma-6.8.2-1.el8.x86_64.rpm 6.5 MB/s | 188 kB 00:00 2020-04-22T13:59:51.240 INFO:teuthology.orchestra.run.smithi086.stdout:(84/121): openblas-threads-0.3.3-2.el8.x86_64.r 69 MB/s | 4.4 MB 00:00 2020-04-22T13:59:51.241 INFO:teuthology.orchestra.run.smithi086.stdout:(85/121): python3-markupsafe-0.23-19.el8.x86_64 1.3 MB/s | 39 kB 00:00 2020-04-22T13:59:51.263 INFO:teuthology.orchestra.run.smithi103.stdout:(30/121): ceph-mgr-modules-core-16.0.0-952.g360 2.7 MB/s | 167 kB 00:00 2020-04-22T13:59:51.273 INFO:teuthology.orchestra.run.smithi086.stdout:(86/121): flex-2.6.1-9.el8.x86_64.rpm 9.2 MB/s | 320 kB 00:00 2020-04-22T13:59:51.278 INFO:teuthology.orchestra.run.smithi086.stdout:(87/121): librdkafka-0.11.4-1.el8.x86_64.rpm 9.6 MB/s | 353 kB 00:00 2020-04-22T13:59:51.305 INFO:teuthology.orchestra.run.smithi086.stdout:(88/121): bison-3.0.4-10.el8.x86_64.rpm 21 MB/s | 688 kB 00:00 2020-04-22T13:59:51.323 INFO:teuthology.orchestra.run.smithi103.stdout:(31/121): ceph-mgr-rook-16.0.0-952.g360f904.el8 457 kB/s | 27 kB 00:00 2020-04-22T13:59:51.333 INFO:teuthology.orchestra.run.smithi086.stdout:(89/121): libtool-2.4.6-25.el8.x86_64.rpm 25 MB/s | 709 kB 00:00 2020-04-22T13:59:51.346 INFO:teuthology.orchestra.run.smithi086.stdout:(90/121): openblas-0.3.3-2.el8.x86_64.rpm 67 MB/s | 4.3 MB 00:00 2020-04-22T13:59:51.377 INFO:teuthology.orchestra.run.smithi086.stdout:(91/121): lttng-ust-2.8.1-11.el8.x86_64.rpm 9.7 MB/s | 259 kB 00:00 2020-04-22T13:59:51.383 INFO:teuthology.orchestra.run.smithi103.stdout:(32/121): ceph-prometheus-alerts-16.0.0-952.g36 145 kB/s | 8.7 kB 00:00 2020-04-22T13:59:51.402 INFO:teuthology.orchestra.run.smithi086.stdout:(92/121): python3-numpy-1.14.3-9.el8.x86_64.rpm 54 MB/s | 3.7 MB 00:00 2020-04-22T13:59:51.403 INFO:teuthology.orchestra.run.smithi086.stdout:(93/121): python3-numpy-f2py-1.14.3-9.el8.x86_6 8.2 MB/s | 225 kB 00:00 2020-04-22T13:59:51.432 INFO:teuthology.orchestra.run.smithi086.stdout:(94/121): libverto-devel-0.3.0-5.el8.x86_64.rpm 641 kB/s | 18 kB 00:00 2020-04-22T13:59:51.442 INFO:teuthology.orchestra.run.smithi103.stdout:(33/121): python3-cheroot-8.2.1-1.el8.noarch.rp 2.4 MB/s | 145 kB 00:00 2020-04-22T13:59:51.454 INFO:teuthology.orchestra.run.smithi086.stdout:(95/121): pcre2-utf32-10.32-1.el8.x86_64.rpm 9.8 MB/s | 220 kB 00:00 2020-04-22T13:59:51.466 INFO:teuthology.orchestra.run.smithi103.stdout:(34/121): python3-cherrypy-18.4.0-1.el8.noarch. 16 MB/s | 385 kB 00:00 2020-04-22T13:59:51.476 INFO:teuthology.orchestra.run.smithi086.stdout:(96/121): zlib-devel-1.2.11-10.el8.x86_64.rpm 2.5 MB/s | 56 kB 00:00 2020-04-22T13:59:51.479 INFO:teuthology.orchestra.run.smithi103.stdout:(35/121): python3-execnet-1.7.1-1.el8.2.noarch. 27 MB/s | 356 kB 00:00 2020-04-22T13:59:51.487 INFO:teuthology.orchestra.run.smithi103.stdout:(36/121): python3-jaraco-6.2-6.el8.noarch.rpm 1.4 MB/s | 11 kB 00:00 2020-04-22T13:59:51.495 INFO:teuthology.orchestra.run.smithi103.stdout:(37/121): python3-jaraco-functools-2.0-4.el8.no 2.1 MB/s | 18 kB 00:00 2020-04-22T13:59:51.497 INFO:teuthology.orchestra.run.smithi086.stdout:(97/121): python3-requests-oauthlib-1.0.0-1.el8 2.0 MB/s | 43 kB 00:00 2020-04-22T13:59:51.504 INFO:teuthology.orchestra.run.smithi103.stdout:(38/121): python3-logutils-0.3.5-11.el8.noarch. 5.7 MB/s | 49 kB 00:00 2020-04-22T13:59:51.513 INFO:teuthology.orchestra.run.smithi103.stdout:(39/121): python3-more-itertools-7.2.0-4.el8.no 6.6 MB/s | 59 kB 00:00 2020-04-22T13:59:51.517 INFO:teuthology.orchestra.run.smithi086.stdout:(98/121): fuse-2.9.7-12.el8.x86_64.rpm 4.0 MB/s | 83 kB 00:00 2020-04-22T13:59:51.524 INFO:teuthology.orchestra.run.smithi103.stdout:(40/121): python3-pecan-1.3.2-9.el8.noarch.rpm 24 MB/s | 283 kB 00:00 2020-04-22T13:59:51.532 INFO:teuthology.orchestra.run.smithi103.stdout:(41/121): python3-portend-2.6-1.el8.noarch.rpm 2.0 MB/s | 16 kB 00:00 2020-04-22T13:59:51.541 INFO:teuthology.orchestra.run.smithi103.stdout:(42/121): python3-remoto-1.1.4-4.el8.noarch.rpm 5.6 MB/s | 48 kB 00:00 2020-04-22T13:59:51.549 INFO:teuthology.orchestra.run.smithi103.stdout:(43/121): python3-repoze-lru-0.7-6.el8.noarch.r 4.1 MB/s | 34 kB 00:00 2020-04-22T13:59:51.560 INFO:teuthology.orchestra.run.smithi103.stdout:(44/121): python3-routes-2.4.1-12.el8.noarch.rp 18 MB/s | 197 kB 00:00 2020-04-22T13:59:51.568 INFO:teuthology.orchestra.run.smithi103.stdout:(45/121): python3-simplegeneric-0.8.1-17.el8.no 2.3 MB/s | 19 kB 00:00 2020-04-22T13:59:51.576 INFO:teuthology.orchestra.run.smithi103.stdout:(46/121): python3-singledispatch-3.4.0.3-18.el8 3.0 MB/s | 24 kB 00:00 2020-04-22T13:59:51.584 INFO:teuthology.orchestra.run.smithi103.stdout:(47/121): python3-tempora-1.14.1-5.el8.noarch.r 3.6 MB/s | 30 kB 00:00 2020-04-22T13:59:51.593 INFO:teuthology.orchestra.run.smithi103.stdout:(48/121): python3-trustme-0.5.2-4.el8.noarch.rp 3.3 MB/s | 27 kB 00:00 2020-04-22T13:59:51.601 INFO:teuthology.orchestra.run.smithi103.stdout:(49/121): python3-zc-lockfile-2.0-2.el8.noarch. 2.5 MB/s | 23 kB 00:00 2020-04-22T13:59:51.612 INFO:teuthology.orchestra.run.smithi086.stdout:(99/121): python3-scipy-1.0.0-20.module+el8.1.0 69 MB/s | 15 MB 00:00 2020-04-22T13:59:51.636 INFO:teuthology.orchestra.run.smithi086.stdout:(100/121): libxslt-1.1.32-3.el8.x86_64.rpm 2.0 MB/s | 249 kB 00:00 2020-04-22T13:59:51.644 INFO:teuthology.orchestra.run.smithi086.stdout:(101/121): keyutils-libs-devel-1.5.10-6.el8.x86 1.7 MB/s | 48 kB 00:00 2020-04-22T13:59:51.658 INFO:teuthology.orchestra.run.smithi086.stdout:(102/121): python3-jwt-1.6.1-2.el8.noarch.rpm 2.0 MB/s | 43 kB 00:00 2020-04-22T13:59:51.674 INFO:teuthology.orchestra.run.smithi086.stdout:(103/121): pcre2-devel-10.32-1.el8.x86_64.rpm 20 MB/s | 605 kB 00:00 2020-04-22T13:59:51.684 INFO:teuthology.orchestra.run.smithi086.stdout:(104/121): librabbitmq-0.9.0-1.el8.x86_64.rpm 2.0 MB/s | 47 kB 00:00 2020-04-22T13:59:51.705 INFO:teuthology.orchestra.run.smithi086.stdout:(105/121): python3-oauthlib-2.1.0-1.el8.noarch. 5.5 MB/s | 155 kB 00:00 2020-04-22T13:59:51.712 INFO:teuthology.orchestra.run.smithi086.stdout:(106/121): fuse-common-3.2.1-12.el8.x86_64.rpm 777 kB/s | 21 kB 00:00 2020-04-22T13:59:51.714 INFO:teuthology.orchestra.run.smithi103.stdout:(50/121): gperftools-libs-2.7-6.el8.x86_64.rpm 2.7 MB/s | 315 kB 00:00 2020-04-22T13:59:51.732 INFO:teuthology.orchestra.run.smithi086.stdout:(107/121): pcre2-utf16-10.32-1.el8.x86_64.rpm 8.4 MB/s | 229 kB 00:00 2020-04-22T13:59:51.735 INFO:teuthology.orchestra.run.smithi103.stdout:(51/121): leveldb-1.22-1.el8.x86_64.rpm 8.8 MB/s | 181 kB 00:00 2020-04-22T13:59:51.737 INFO:teuthology.orchestra.run.smithi086.stdout:(108/121): libsepol-devel-2.9-1.el8.x86_64.rpm 3.4 MB/s | 86 kB 00:00 2020-04-22T13:59:51.754 INFO:teuthology.orchestra.run.smithi103.stdout:(52/121): liboath-2.6.2-3.el8.x86_64.rpm 3.0 MB/s | 59 kB 00:00 2020-04-22T13:59:51.760 INFO:teuthology.orchestra.run.smithi086.stdout:(109/121): libselinux-devel-2.9-2.1.el8.x86_64. 7.0 MB/s | 199 kB 00:00 2020-04-22T13:59:51.769 INFO:teuthology.orchestra.run.smithi086.stdout:(110/121): libquadmath-8.3.1-4.5.el8.x86_64.rpm 5.4 MB/s | 169 kB 00:00 2020-04-22T13:59:51.773 INFO:teuthology.orchestra.run.smithi103.stdout:(53/121): libunwind-1.3.1-3.el8.x86_64.rpm 3.8 MB/s | 75 kB 00:00 2020-04-22T13:59:51.789 INFO:teuthology.orchestra.run.smithi086.stdout:(111/121): krb5-devel-1.17-9.el8.x86_64.rpm 19 MB/s | 549 kB 00:00 2020-04-22T13:59:51.793 INFO:teuthology.orchestra.run.smithi103.stdout:(54/121): python3-apipkg-1.5-6.el8.noarch.rpm 1.1 MB/s | 21 kB 00:00 2020-04-22T13:59:51.793 INFO:teuthology.orchestra.run.smithi086.stdout:(112/121): elfutils-libelf-devel-0.176-5.el8.x8 2.1 MB/s | 54 kB 00:00 2020-04-22T13:59:51.814 INFO:teuthology.orchestra.run.smithi103.stdout:(55/121): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 2.1 MB/s | 44 kB 00:00 2020-04-22T13:59:51.815 INFO:teuthology.orchestra.run.smithi086.stdout:(113/121): xfsprogs-devel-5.0.0-1.el8.x86_64.rp 2.5 MB/s | 69 kB 00:00 2020-04-22T13:59:51.828 INFO:teuthology.orchestra.run.smithi086.stdout:(114/121): libgfortran-8.3.1-4.5.el8.x86_64.rpm 19 MB/s | 638 kB 00:00 2020-04-22T13:59:51.834 INFO:teuthology.orchestra.run.smithi103.stdout:(56/121): python3-beautifulsoup4-4.6.3-2.el8.1. 9.1 MB/s | 185 kB 00:00 2020-04-22T13:59:51.838 INFO:teuthology.orchestra.run.smithi086.stdout:(115/121): libaio-devel-0.3.112-1.el8.x86_64.rp 813 kB/s | 19 kB 00:00 2020-04-22T13:59:51.852 INFO:teuthology.orchestra.run.smithi086.stdout:(116/121): libcom_err-devel-1.44.6-3.el8.x86_64 1.7 MB/s | 38 kB 00:00 2020-04-22T13:59:51.853 INFO:teuthology.orchestra.run.smithi103.stdout:(57/121): python3-cachetools-3.1.1-4.el8.noarch 1.7 MB/s | 33 kB 00:00 2020-04-22T13:59:51.864 INFO:teuthology.orchestra.run.smithi086.stdout:(117/121): libuuid-devel-2.32.1-17.el8.x86_64.r 3.6 MB/s | 95 kB 00:00 2020-04-22T13:59:51.873 INFO:teuthology.orchestra.run.smithi103.stdout:(58/121): python3-certifi-2018.10.15-7.el8.noar 860 kB/s | 16 kB 00:00 2020-04-22T13:59:51.890 INFO:teuthology.orchestra.run.smithi086.stdout:(118/121): openssl-devel-1.1.1c-2.el8_1.1.x86_6 60 MB/s | 2.3 MB 00:00 2020-04-22T13:59:51.891 INFO:teuthology.orchestra.run.smithi103.stdout:(59/121): python3-cssselect-0.9.2-10.el8.noarch 2.0 MB/s | 40 kB 00:00 2020-04-22T13:59:51.912 INFO:teuthology.orchestra.run.smithi103.stdout:(60/121): python3-google-auth-1.1.1-10.el8.noar 4.1 MB/s | 81 kB 00:00 2020-04-22T13:59:51.989 INFO:teuthology.orchestra.run.smithi103.stdout:(61/121): python3-kubernetes-10.0.1-2.el8.noarc 14 MB/s | 1.1 MB 00:00 2020-04-22T13:59:52.008 INFO:teuthology.orchestra.run.smithi103.stdout:(62/121): python3-rsa-3.4.2-12.el8.noarch.rpm 3.7 MB/s | 73 kB 00:00 2020-04-22T13:59:52.029 INFO:teuthology.orchestra.run.smithi103.stdout:(63/121): python3-waitress-1.2.1-2.el8.1.noarch 11 MB/s | 241 kB 00:00 2020-04-22T13:59:52.049 INFO:teuthology.orchestra.run.smithi103.stdout:(64/121): python3-webob-1.8.5-1.el8.1.noarch.rp 12 MB/s | 251 kB 00:00 2020-04-22T13:59:52.069 INFO:teuthology.orchestra.run.smithi103.stdout:(65/121): python3-websocket-client-0.56.0-5.el8 3.0 MB/s | 61 kB 00:00 2020-04-22T13:59:52.093 INFO:teuthology.orchestra.run.smithi103.stdout:(66/121): python3-webtest-2.0.33-1.el8.noarch.r 4.3 MB/s | 85 kB 00:00 2020-04-22T13:59:52.116 INFO:teuthology.orchestra.run.smithi103.stdout:(67/121): xmlstarlet-1.6.1-11.el8.x86_64.rpm 3.5 MB/s | 69 kB 00:00 2020-04-22T13:59:52.146 INFO:teuthology.orchestra.run.smithi103.stdout:(68/121): automake-1.16.1-6.el8.noarch.rpm 19 MB/s | 713 kB 00:00 2020-04-22T13:59:52.166 INFO:teuthology.orchestra.run.smithi103.stdout:(69/121): python3-webencodings-0.5.1-6.el8.noar 1.3 MB/s | 27 kB 00:00 2020-04-22T13:59:52.198 INFO:teuthology.orchestra.run.smithi103.stdout:(70/121): python3-lxml-4.2.3-1.el8.x86_64.rpm 48 MB/s | 1.5 MB 00:00 2020-04-22T13:59:52.220 INFO:teuthology.orchestra.run.smithi103.stdout:(71/121): jq-1.5-12.el8.x86_64.rpm 7.2 MB/s | 161 kB 00:00 2020-04-22T13:59:52.243 INFO:teuthology.orchestra.run.smithi103.stdout:(72/121): python3-werkzeug-0.12.2-4.el8.noarch. 20 MB/s | 457 kB 00:00 2020-04-22T13:59:52.264 INFO:teuthology.orchestra.run.smithi103.stdout:(73/121): python3-mako-1.0.6-13.el8.noarch.rpm 7.3 MB/s | 157 kB 00:00 2020-04-22T13:59:52.285 INFO:teuthology.orchestra.run.smithi103.stdout:(74/121): python3-jsonpatch-1.21-2.el8.noarch.r 1.3 MB/s | 27 kB 00:00 2020-04-22T13:59:52.305 INFO:teuthology.orchestra.run.smithi103.stdout:(75/121): python3-jsonpointer-1.10-11.el8.noarc 981 kB/s | 20 kB 00:00 2020-04-22T13:59:52.330 INFO:teuthology.orchestra.run.smithi103.stdout:(76/121): python3-html5lib-0.999999999-6.el8.no 8.6 MB/s | 214 kB 00:00 2020-04-22T13:59:52.354 INFO:teuthology.orchestra.run.smithi103.stdout:(77/121): python3-pyasn1-0.3.7-6.el8.noarch.rpm 5.1 MB/s | 126 kB 00:00 2020-04-22T13:59:52.374 INFO:teuthology.orchestra.run.smithi103.stdout:(78/121): python3-pytz-2017.2-9.el8.noarch.rpm 2.6 MB/s | 54 kB 00:00 2020-04-22T13:59:52.396 INFO:teuthology.orchestra.run.smithi103.stdout:(79/121): python3-pyasn1-modules-0.3.7-6.el8.no 5.1 MB/s | 110 kB 00:00 2020-04-22T13:59:52.417 INFO:teuthology.orchestra.run.smithi103.stdout:(80/121): python3-prettytable-0.7.2-14.el8.noar 2.0 MB/s | 44 kB 00:00 2020-04-22T13:59:52.440 INFO:teuthology.orchestra.run.smithi103.stdout:(81/121): socat-1.7.3.2-6.el8.x86_64.rpm 13 MB/s | 298 kB 00:00 2020-04-22T13:59:52.488 INFO:teuthology.orchestra.run.smithi103.stdout:(82/121): openblas-threads-0.3.3-2.el8.x86_64.r 91 MB/s | 4.4 MB 00:00 2020-04-22T13:59:52.492 INFO:teuthology.orchestra.run.smithi086.stdout:(119/121): ceph-test-16.0.0-952.g360f904.el8.x8 5.1 MB/s | 42 MB 00:08 2020-04-22T13:59:52.503 INFO:teuthology.orchestra.run.smithi086.stdout:(120/121): librbd1-16.0.0-952.g360f904.el8.x86_ 3.1 MB/s | 1.9 MB 00:00 2020-04-22T13:59:52.511 INFO:teuthology.orchestra.run.smithi103.stdout:(83/121): oniguruma-6.8.2-1.el8.x86_64.rpm 8.1 MB/s | 188 kB 00:00 2020-04-22T13:59:52.533 INFO:teuthology.orchestra.run.smithi103.stdout:(84/121): python3-markupsafe-0.23-19.el8.x86_64 1.9 MB/s | 39 kB 00:00 2020-04-22T13:59:52.553 INFO:teuthology.orchestra.run.smithi103.stdout:(85/121): flex-2.6.1-9.el8.x86_64.rpm 14 MB/s | 320 kB 00:00 2020-04-22T13:59:52.575 INFO:teuthology.orchestra.run.smithi103.stdout:(86/121): librdkafka-0.11.4-1.el8.x86_64.rpm 16 MB/s | 353 kB 00:00 2020-04-22T13:59:52.600 INFO:teuthology.orchestra.run.smithi103.stdout:(87/121): bison-3.0.4-10.el8.x86_64.rpm 27 MB/s | 688 kB 00:00 2020-04-22T13:59:52.646 INFO:teuthology.orchestra.run.smithi086.stdout:(121/121): librados2-16.0.0-952.g360f904.el8.x8 4.6 MB/s | 3.6 MB 00:00 2020-04-22T13:59:52.648 INFO:teuthology.orchestra.run.smithi103.stdout:(88/121): openblas-0.3.3-2.el8.x86_64.rpm 89 MB/s | 4.3 MB 00:00 2020-04-22T13:59:52.650 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2020-04-22T13:59:52.650 INFO:teuthology.orchestra.run.smithi086.stdout:Total 11 MB/s | 174 MB 00:16 2020-04-22T13:59:52.672 INFO:teuthology.orchestra.run.smithi103.stdout:(89/121): ceph-mgr-diskprediction-local-16.0.0- 4.0 MB/s | 8.6 MB 00:02 2020-04-22T13:59:52.700 INFO:teuthology.orchestra.run.smithi103.stdout:(90/121): libtool-2.4.6-25.el8.x86_64.rpm 13 MB/s | 709 kB 00:00 2020-04-22T13:59:52.717 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2020-04-22T13:59:52.728 INFO:teuthology.orchestra.run.smithi103.stdout:(91/121): lttng-ust-2.8.1-11.el8.x86_64.rpm 11 MB/s | 259 kB 00:00 2020-04-22T13:59:52.747 INFO:teuthology.orchestra.run.smithi103.stdout:(92/121): python3-numpy-1.14.3-9.el8.x86_64.rpm 53 MB/s | 3.7 MB 00:00 2020-04-22T13:59:52.760 INFO:teuthology.orchestra.run.smithi103.stdout:(93/121): python3-numpy-f2py-1.14.3-9.el8.x86_6 7.1 MB/s | 225 kB 00:00 2020-04-22T13:59:52.784 INFO:teuthology.orchestra.run.smithi103.stdout:(94/121): libverto-devel-0.3.0-5.el8.x86_64.rpm 748 kB/s | 18 kB 00:00 2020-04-22T13:59:52.806 INFO:teuthology.orchestra.run.smithi103.stdout:(95/121): pcre2-utf32-10.32-1.el8.x86_64.rpm 9.6 MB/s | 220 kB 00:00 2020-04-22T13:59:52.825 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2020-04-22T13:59:52.825 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2020-04-22T13:59:52.828 INFO:teuthology.orchestra.run.smithi103.stdout:(96/121): zlib-devel-1.2.11-10.el8.x86_64.rpm 2.5 MB/s | 56 kB 00:00 2020-04-22T13:59:52.849 INFO:teuthology.orchestra.run.smithi103.stdout:(97/121): python3-requests-oauthlib-1.0.0-1.el8 2.1 MB/s | 43 kB 00:00 2020-04-22T13:59:52.870 INFO:teuthology.orchestra.run.smithi103.stdout:(98/121): fuse-2.9.7-12.el8.x86_64.rpm 3.8 MB/s | 83 kB 00:00 2020-04-22T13:59:52.927 INFO:teuthology.orchestra.run.smithi103.stdout:(99/121): python3-scipy-1.0.0-20.module+el8.1.0 83 MB/s | 15 MB 00:00 2020-04-22T13:59:52.952 INFO:teuthology.orchestra.run.smithi103.stdout:(100/121): libxslt-1.1.32-3.el8.x86_64.rpm 3.0 MB/s | 249 kB 00:00 2020-04-22T13:59:52.959 INFO:teuthology.orchestra.run.smithi103.stdout:(101/121): keyutils-libs-devel-1.5.10-6.el8.x86 1.7 MB/s | 48 kB 00:00 2020-04-22T13:59:52.975 INFO:teuthology.orchestra.run.smithi103.stdout:(102/121): python3-jwt-1.6.1-2.el8.noarch.rpm 2.0 MB/s | 43 kB 00:00 2020-04-22T13:59:52.995 INFO:teuthology.orchestra.run.smithi103.stdout:(103/121): pcre2-devel-10.32-1.el8.x86_64.rpm 17 MB/s | 605 kB 00:00 2020-04-22T13:59:53.002 INFO:teuthology.orchestra.run.smithi103.stdout:(104/121): librabbitmq-0.9.0-1.el8.x86_64.rpm 1.6 MB/s | 47 kB 00:00 2020-04-22T13:59:53.021 INFO:teuthology.orchestra.run.smithi103.stdout:(105/121): python3-oauthlib-2.1.0-1.el8.noarch. 5.9 MB/s | 155 kB 00:00 2020-04-22T13:59:53.029 INFO:teuthology.orchestra.run.smithi103.stdout:(106/121): fuse-common-3.2.1-12.el8.x86_64.rpm 827 kB/s | 21 kB 00:00 2020-04-22T13:59:53.047 INFO:teuthology.orchestra.run.smithi103.stdout:(107/121): pcre2-utf16-10.32-1.el8.x86_64.rpm 8.6 MB/s | 229 kB 00:00 2020-04-22T13:59:53.055 INFO:teuthology.orchestra.run.smithi103.stdout:(108/121): libsepol-devel-2.9-1.el8.x86_64.rpm 3.2 MB/s | 86 kB 00:00 2020-04-22T13:59:53.080 INFO:teuthology.orchestra.run.smithi103.stdout:(109/121): libselinux-devel-2.9-2.1.el8.x86_64. 6.0 MB/s | 199 kB 00:00 2020-04-22T13:59:53.089 INFO:teuthology.orchestra.run.smithi103.stdout:(110/121): libquadmath-8.3.1-4.5.el8.x86_64.rpm 4.9 MB/s | 169 kB 00:00 2020-04-22T13:59:53.112 INFO:teuthology.orchestra.run.smithi103.stdout:(111/121): krb5-devel-1.17-9.el8.x86_64.rpm 17 MB/s | 549 kB 00:00 2020-04-22T13:59:53.118 INFO:teuthology.orchestra.run.smithi103.stdout:(112/121): elfutils-libelf-devel-0.176-5.el8.x8 1.8 MB/s | 54 kB 00:00 2020-04-22T13:59:53.132 INFO:teuthology.orchestra.run.smithi103.stdout:(113/121): xfsprogs-devel-5.0.0-1.el8.x86_64.rp 3.2 MB/s | 69 kB 00:00 2020-04-22T13:59:53.152 INFO:teuthology.orchestra.run.smithi103.stdout:(114/121): libgfortran-8.3.1-4.5.el8.x86_64.rpm 18 MB/s | 638 kB 00:00 2020-04-22T13:59:53.160 INFO:teuthology.orchestra.run.smithi103.stdout:(115/121): libaio-devel-0.3.112-1.el8.x86_64.rp 677 kB/s | 19 kB 00:00 2020-04-22T13:59:53.174 INFO:teuthology.orchestra.run.smithi103.stdout:(116/121): libcom_err-devel-1.44.6-3.el8.x86_64 1.7 MB/s | 38 kB 00:00 2020-04-22T13:59:53.187 INFO:teuthology.orchestra.run.smithi103.stdout:(117/121): libuuid-devel-2.32.1-17.el8.x86_64.r 3.4 MB/s | 95 kB 00:00 2020-04-22T13:59:53.217 INFO:teuthology.orchestra.run.smithi103.stdout:(118/121): openssl-devel-1.1.1c-2.el8_1.1.x86_6 58 MB/s | 2.3 MB 00:00 2020-04-22T13:59:53.575 INFO:teuthology.orchestra.run.smithi103.stdout:(119/121): librbd1-16.0.0-952.g360f904.el8.x86_ 5.3 MB/s | 1.9 MB 00:00 2020-04-22T13:59:53.875 INFO:teuthology.orchestra.run.smithi103.stdout:(120/121): librados2-16.0.0-952.g360f904.el8.x8 5.2 MB/s | 3.6 MB 00:00 2020-04-22T13:59:53.995 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2020-04-22T13:59:53.996 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2020-04-22T13:59:57.191 INFO:teuthology.orchestra.run.smithi103.stdout:(121/121): ceph-test-16.0.0-952.g360f904.el8.x8 4.7 MB/s | 42 MB 00:09 2020-04-22T13:59:57.196 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2020-04-22T13:59:57.196 INFO:teuthology.orchestra.run.smithi103.stdout:Total 8.2 MB/s | 174 MB 00:21 2020-04-22T13:59:57.266 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2020-04-22T13:59:57.377 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2020-04-22T13:59:57.377 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2020-04-22T13:59:58.407 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2020-04-22T13:59:58.530 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2020-04-22T13:59:58.530 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2020-04-22T13:59:58.570 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/123 2020-04-22T13:59:58.692 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/123 2020-04-22T13:59:58.883 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 3/123 2020-04-22T13:59:59.045 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/123 2020-04-22T13:59:59.445 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/123 2020-04-22T13:59:59.616 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : librados2-2:16.0.0-952.g360f904.el8.x86_64 5/123 2020-04-22T13:59:59.835 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librados2-2:16.0.0-952.g360f904.el8.x86_64 5/123 2020-04-22T14:00:00.303 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : librbd1-2:16.0.0-952.g360f904.el8.x86_64 6/123 2020-04-22T14:00:00.417 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librbd1-2:16.0.0-952.g360f904.el8.x86_64 6/123 2020-04-22T14:00:00.569 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcephfs2-2:16.0.0-952.g360f904.el8.x86_64 7/123 2020-04-22T14:00:00.653 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libcephfs2-2:16.0.0-952.g360f904.el8.x86_64 7/123 2020-04-22T14:00:00.852 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rados-2:16.0.0-952.g360f904.el8.x86_64 8/123 2020-04-22T14:00:00.986 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 9/123 2020-04-22T14:00:01.362 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 9/123 2020-04-22T14:00:01.486 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librgw2-2:16.0.0-952.g360f904.el8.x86_64 10/123 2020-04-22T14:00:01.583 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librgw2-2:16.0.0-952.g360f904.el8.x86_64 10/123 2020-04-22T14:00:01.820 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/123 2020-04-22T14:00:01.969 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libradosstriper1-2:16.0.0-952.g360f904.el8.x86_6 12/123 2020-04-22T14:00:02.069 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libradosstriper1-2:16.0.0-952.g360f904.el8.x86_6 12/123 2020-04-22T14:00:02.186 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libquadmath-8.3.1-4.5.el8.x86_64 13/123 2020-04-22T14:00:02.320 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libquadmath-8.3.1-4.5.el8.x86_64 13/123 2020-04-22T14:00:02.486 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libgfortran-8.3.1-4.5.el8.x86_64 14/123 2020-04-22T14:00:03.030 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libgfortran-8.3.1-4.5.el8.x86_64 14/123 2020-04-22T14:00:03.128 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2020-04-22T14:00:03.169 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : openblas-threads-0.3.3-2.el8.x86_64 15/123 2020-04-22T14:00:03.302 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/123 2020-04-22T14:00:03.420 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/123 2020-04-22T14:00:03.624 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 3/123 2020-04-22T14:00:03.709 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 15/123 2020-04-22T14:00:03.836 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : openblas-0.3.3-2.el8.x86_64 16/123 2020-04-22T14:00:03.847 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/123 2020-04-22T14:00:04.238 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/123 2020-04-22T14:00:04.418 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : librados2-2:16.0.0-952.g360f904.el8.x86_64 5/123 2020-04-22T14:00:04.539 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 16/123 2020-04-22T14:00:04.655 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librados2-2:16.0.0-952.g360f904.el8.x86_64 5/123 2020-04-22T14:00:04.779 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 17/123 2020-04-22T14:00:04.835 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : librbd1-2:16.0.0-952.g360f904.el8.x86_64 6/123 2020-04-22T14:00:04.960 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 18/123 2020-04-22T14:00:04.972 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librbd1-2:16.0.0-952.g360f904.el8.x86_64 6/123 2020-04-22T14:00:05.092 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libxslt-1.1.32-3.el8.x86_64 19/123 2020-04-22T14:00:05.136 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephfs2-2:16.0.0-952.g360f904.el8.x86_64 7/123 2020-04-22T14:00:05.256 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libcephfs2-2:16.0.0-952.g360f904.el8.x86_64 7/123 2020-04-22T14:00:05.346 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : zlib-devel-1.2.11-10.el8.x86_64 20/123 2020-04-22T14:00:05.426 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rados-2:16.0.0-952.g360f904.el8.x86_64 8/123 2020-04-22T14:00:05.568 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 21/123 2020-04-22T14:00:05.592 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 9/123 2020-04-22T14:00:05.925 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 9/123 2020-04-22T14:00:06.077 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librgw2-2:16.0.0-952.g360f904.el8.x86_64 10/123 2020-04-22T14:00:06.170 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librgw2-2:16.0.0-952.g360f904.el8.x86_64 10/123 2020-04-22T14:00:06.199 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 22/123 2020-04-22T14:00:06.349 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-more-itertools-7.2.0-4.el8.noarch 23/123 2020-04-22T14:00:06.395 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/123 2020-04-22T14:00:06.471 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-ceph-argparse-2:16.0.0-952.g360f904.el8. 24/123 2020-04-22T14:00:06.519 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libradosstriper1-2:16.0.0-952.g360f904.el8.x86_6 12/123 2020-04-22T14:00:06.614 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libradosstriper1-2:16.0.0-952.g360f904.el8.x86_6 12/123 2020-04-22T14:00:06.647 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cephfs-2:16.0.0-952.g360f904.el8.x86_64 25/123 2020-04-22T14:00:06.757 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libquadmath-8.3.1-4.5.el8.x86_64 13/123 2020-04-22T14:00:06.866 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 26/123 2020-04-22T14:00:06.929 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libquadmath-8.3.1-4.5.el8.x86_64 13/123 2020-04-22T14:00:07.071 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 27/123 2020-04-22T14:00:07.331 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 28/123 2020-04-22T14:00:07.425 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libgfortran-8.3.1-4.5.el8.x86_64 14/123 2020-04-22T14:00:07.519 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 29/123 2020-04-22T14:00:08.090 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libgfortran-8.3.1-4.5.el8.x86_64 14/123 2020-04-22T14:00:08.210 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openblas-threads-0.3.3-2.el8.x86_64 15/123 2020-04-22T14:00:08.783 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 15/123 2020-04-22T14:00:08.943 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openblas-0.3.3-2.el8.x86_64 16/123 2020-04-22T14:00:09.493 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 29/123 2020-04-22T14:00:09.648 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 16/123 2020-04-22T14:00:09.783 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 30/123 2020-04-22T14:00:09.896 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 17/123 2020-04-22T14:00:09.996 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rsa-3.4.2-12.el8.noarch 31/123 2020-04-22T14:00:10.085 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 18/123 2020-04-22T14:00:10.265 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 32/123 2020-04-22T14:00:10.269 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libxslt-1.1.32-3.el8.x86_64 19/123 2020-04-22T14:00:10.458 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rgw-2:16.0.0-952.g360f904.el8.x86_64 33/123 2020-04-22T14:00:10.513 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : zlib-devel-1.2.11-10.el8.x86_64 20/123 2020-04-22T14:00:10.620 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rbd-2:16.0.0-952.g360f904.el8.x86_64 34/123 2020-04-22T14:00:10.751 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 21/123 2020-04-22T14:00:10.809 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librados-devel-2:16.0.0-952.g360f904.el8.x86_64 35/123 2020-04-22T14:00:10.947 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 22/123 2020-04-22T14:00:10.947 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libuuid-devel-2.32.1-17.el8.x86_64 36/123 2020-04-22T14:00:11.083 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcom_err-devel-1.44.6-3.el8.x86_64 37/123 2020-04-22T14:00:11.106 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-more-itertools-7.2.0-4.el8.noarch 23/123 2020-04-22T14:00:11.227 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ceph-argparse-2:16.0.0-952.g360f904.el8. 24/123 2020-04-22T14:00:11.297 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 38/123 2020-04-22T14:00:11.420 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cephfs-2:16.0.0-952.g360f904.el8.x86_64 25/123 2020-04-22T14:00:11.504 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : pcre2-utf16-10.32-1.el8.x86_64 39/123 2020-04-22T14:00:11.505 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 40/123 2020-04-22T14:00:11.505 INFO:teuthology.orchestra.run.smithi086.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-04-22T14:00:11.505 INFO:teuthology.orchestra.run.smithi086.stdout: 2020-04-22T14:00:11.669 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 26/123 2020-04-22T14:00:11.848 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 27/123 2020-04-22T14:00:11.864 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : fuse-2.9.7-12.el8.x86_64 41/123 2020-04-22T14:00:12.030 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 42/123 2020-04-22T14:00:12.107 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 28/123 2020-04-22T14:00:12.335 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 29/123 2020-04-22T14:00:12.374 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : pcre2-utf32-10.32-1.el8.x86_64 43/123 2020-04-22T14:00:12.683 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : pcre2-devel-10.32-1.el8.x86_64 44/123 2020-04-22T14:00:12.904 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libselinux-devel-2.9-2.1.el8.x86_64 45/123 2020-04-22T14:00:13.099 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 46/123 2020-04-22T14:00:13.396 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : krb5-devel-1.17-9.el8.x86_64 47/123 2020-04-22T14:00:13.654 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 48/123 2020-04-22T14:00:13.923 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 49/123 2020-04-22T14:00:14.145 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 50/123 2020-04-22T14:00:14.231 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 50/123 2020-04-22T14:00:14.293 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 29/123 2020-04-22T14:00:14.485 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : jq-1.5-12.el8.x86_64 51/123 2020-04-22T14:00:14.659 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : socat-1.7.3.2-6.el8.x86_64 52/123 2020-04-22T14:00:14.676 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 30/123 2020-04-22T14:00:14.833 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 53/123 2020-04-22T14:00:14.880 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rsa-3.4.2-12.el8.noarch 31/123 2020-04-22T14:00:14.999 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 54/123 2020-04-22T14:00:15.121 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 32/123 2020-04-22T14:00:15.226 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 55/123 2020-04-22T14:00:15.340 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rgw-2:16.0.0-952.g360f904.el8.x86_64 33/123 2020-04-22T14:00:15.405 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 56/123 2020-04-22T14:00:15.565 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rbd-2:16.0.0-952.g360f904.el8.x86_64 34/123 2020-04-22T14:00:15.711 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 57/123 2020-04-22T14:00:15.766 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librados-devel-2:16.0.0-952.g360f904.el8.x86_64 35/123 2020-04-22T14:00:15.897 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libuuid-devel-2.32.1-17.el8.x86_64 36/123 2020-04-22T14:00:16.020 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 58/123 2020-04-22T14:00:16.058 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcom_err-devel-1.44.6-3.el8.x86_64 37/123 2020-04-22T14:00:16.254 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : automake-1.16.1-6.el8.noarch 59/123 2020-04-22T14:00:16.280 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 38/123 2020-04-22T14:00:16.462 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : pcre2-utf16-10.32-1.el8.x86_64 39/123 2020-04-22T14:00:16.462 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 40/123 2020-04-22T14:00:16.462 INFO:teuthology.orchestra.run.smithi103.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-04-22T14:00:16.463 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:00:16.558 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 60/123 2020-04-22T14:00:16.745 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 61/123 2020-04-22T14:00:16.849 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : fuse-2.9.7-12.el8.x86_64 41/123 2020-04-22T14:00:17.030 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 42/123 2020-04-22T14:00:17.117 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 62/123 2020-04-22T14:00:17.387 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : pcre2-utf32-10.32-1.el8.x86_64 43/123 2020-04-22T14:00:17.406 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 63/123 2020-04-22T14:00:17.667 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : pcre2-devel-10.32-1.el8.x86_64 44/123 2020-04-22T14:00:17.709 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 64/123 2020-04-22T14:00:17.861 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libselinux-devel-2.9-2.1.el8.x86_64 45/123 2020-04-22T14:00:17.958 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 65/123 2020-04-22T14:00:18.074 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 46/123 2020-04-22T14:00:18.166 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 66/123 2020-04-22T14:00:18.355 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : krb5-devel-1.17-9.el8.x86_64 47/123 2020-04-22T14:00:18.383 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 67/123 2020-04-22T14:00:18.622 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 48/123 2020-04-22T14:00:18.897 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 49/123 2020-04-22T14:00:19.142 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 50/123 2020-04-22T14:00:19.209 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 50/123 2020-04-22T14:00:19.453 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 68/123 2020-04-22T14:00:19.475 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : jq-1.5-12.el8.x86_64 51/123 2020-04-22T14:00:19.686 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-kubernetes-10.0.1-2.el8.noarch 69/123 2020-04-22T14:00:19.718 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : socat-1.7.3.2-6.el8.x86_64 52/123 2020-04-22T14:00:19.867 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 53/123 2020-04-22T14:00:19.948 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 70/123 2020-04-22T14:00:20.050 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 54/123 2020-04-22T14:00:20.220 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 71/123 2020-04-22T14:00:20.276 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 55/123 2020-04-22T14:00:20.480 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 56/123 2020-04-22T14:00:20.500 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-execnet-1.7.1-1.el8.2.noarch 72/123 2020-04-22T14:00:20.721 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 73/123 2020-04-22T14:00:20.756 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 57/123 2020-04-22T14:00:20.994 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 74/123 2020-04-22T14:00:21.030 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 58/123 2020-04-22T14:00:21.209 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 75/123 2020-04-22T14:00:21.303 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : automake-1.16.1-6.el8.noarch 59/123 2020-04-22T14:00:21.408 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 76/123 2020-04-22T14:00:21.599 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-trustme-0.5.2-4.el8.noarch 77/123 2020-04-22T14:00:21.633 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 60/123 2020-04-22T14:00:21.805 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 78/123 2020-04-22T14:00:21.878 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 61/123 2020-04-22T14:00:21.987 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 79/123 2020-04-22T14:00:22.220 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 80/123 2020-04-22T14:00:22.267 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 62/123 2020-04-22T14:00:22.447 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 81/123 2020-04-22T14:00:22.588 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 63/123 2020-04-22T14:00:22.756 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 82/123 2020-04-22T14:00:22.825 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 64/123 2020-04-22T14:00:22.978 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 83/123 2020-04-22T14:00:23.040 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 65/123 2020-04-22T14:00:23.173 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 84/123 2020-04-22T14:00:23.256 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 66/123 2020-04-22T14:00:23.473 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 85/123 2020-04-22T14:00:23.530 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 67/123 2020-04-22T14:00:23.696 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 86/123 2020-04-22T14:00:23.873 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 87/123 2020-04-22T14:00:24.158 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-portend-2.6-1.el8.noarch 88/123 2020-04-22T14:00:24.434 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 89/123 2020-04-22T14:00:24.574 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-prometheus-alerts-2:16.0.0-952.g360f904.el8 90/123 2020-04-22T14:00:24.609 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 68/123 2020-04-22T14:00:24.783 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-grafana-dashboards-2:16.0.0-952.g360f904.el 91/123 2020-04-22T14:00:24.896 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-kubernetes-10.0.1-2.el8.noarch 69/123 2020-04-22T14:00:24.992 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-ceph-common-2:16.0.0-952.g360f904.el8.x8 92/123 2020-04-22T14:00:25.148 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 70/123 2020-04-22T14:00:25.379 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 71/123 2020-04-22T14:00:25.632 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-execnet-1.7.1-1.el8.2.noarch 72/123 2020-04-22T14:00:25.876 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 73/123 2020-04-22T14:00:26.161 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 74/123 2020-04-22T14:00:26.434 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 75/123 2020-04-22T14:00:26.642 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 76/123 2020-04-22T14:00:26.857 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-trustme-0.5.2-4.el8.noarch 77/123 2020-04-22T14:00:26.996 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 78/123 2020-04-22T14:00:27.187 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 79/123 2020-04-22T14:00:27.446 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 80/123 2020-04-22T14:00:27.704 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 81/123 2020-04-22T14:00:28.039 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 82/123 2020-04-22T14:00:28.198 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-common-2:16.0.0-952.g360f904.el8.x86_64 93/123 2020-04-22T14:00:28.336 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 83/123 2020-04-22T14:00:28.425 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-common-2:16.0.0-952.g360f904.el8.x86_64 93/123 2020-04-22T14:00:28.555 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 84/123 2020-04-22T14:00:28.882 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 85/123 2020-04-22T14:00:29.126 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-common-2:16.0.0-952.g360f904.el8.x86_64 93/123 2020-04-22T14:00:29.127 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 86/123 2020-04-22T14:00:29.363 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 87/123 2020-04-22T14:00:29.460 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-base-2:16.0.0-952.g360f904.el8.x86_64 94/123 2020-04-22T14:00:29.543 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-base-2:16.0.0-952.g360f904.el8.x86_64 94/123 2020-04-22T14:00:29.673 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-portend-2.6-1.el8.noarch 88/123 2020-04-22T14:00:29.682 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-selinux-2:16.0.0-952.g360f904.el8.x86_64 95/123 2020-04-22T14:00:29.967 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 89/123 2020-04-22T14:00:30.146 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-prometheus-alerts-2:16.0.0-952.g360f904.el8 90/123 2020-04-22T14:00:30.349 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-grafana-dashboards-2:16.0.0-952.g360f904.el 91/123 2020-04-22T14:00:30.549 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ceph-common-2:16.0.0-952.g360f904.el8.x8 92/123 2020-04-22T14:00:33.781 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-common-2:16.0.0-952.g360f904.el8.x86_64 93/123 2020-04-22T14:00:34.007 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-common-2:16.0.0-952.g360f904.el8.x86_64 93/123 2020-04-22T14:00:34.698 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-common-2:16.0.0-952.g360f904.el8.x86_64 93/123 2020-04-22T14:00:35.033 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-base-2:16.0.0-952.g360f904.el8.x86_64 94/123 2020-04-22T14:00:35.156 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-base-2:16.0.0-952.g360f904.el8.x86_64 94/123 2020-04-22T14:00:35.290 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-selinux-2:16.0.0-952.g360f904.el8.x86_64 95/123 2020-04-22T14:00:46.002 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-selinux-2:16.0.0-952.g360f904.el8.x86_64 95/123 2020-04-22T14:00:46.002 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /sys 2020-04-22T14:00:46.003 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /proc 2020-04-22T14:00:46.003 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /dev 2020-04-22T14:00:46.003 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /run 2020-04-22T14:00:46.003 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /mnt 2020-04-22T14:00:46.003 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /var/tmp 2020-04-22T14:00:46.003 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /home 2020-04-22T14:00:46.003 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /tmp 2020-04-22T14:00:46.004 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /dev 2020-04-22T14:00:46.004 INFO:teuthology.orchestra.run.smithi086.stdout: 2020-04-22T14:00:46.424 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mds-2:16.0.0-952.g360f904.el8.x86_64 96/123 2020-04-22T14:00:46.807 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mds-2:16.0.0-952.g360f904.el8.x86_64 96/123 2020-04-22T14:00:46.981 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mon-2:16.0.0-952.g360f904.el8.x86_64 97/123 2020-04-22T14:00:48.407 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mon-2:16.0.0-952.g360f904.el8.x86_64 97/123 2020-04-22T14:00:48.632 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-osd-2:16.0.0-952.g360f904.el8.x86_64 98/123 2020-04-22T14:00:48.658 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-osd-2:16.0.0-952.g360f904.el8.x86_64 98/123 2020-04-22T14:00:50.426 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: cephadm-2:16.0.0-952.g360f904.el8.x86_64 99/123 2020-04-22T14:00:50.606 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : cephadm-2:16.0.0-952.g360f904.el8.x86_64 99/123 2020-04-22T14:00:50.805 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-cephadm-2:16.0.0-952.g360f904.el8.noarc 100/123 2020-04-22T14:00:51.589 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-selinux-2:16.0.0-952.g360f904.el8.x86_64 95/123 2020-04-22T14:00:51.589 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /sys 2020-04-22T14:00:51.590 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /proc 2020-04-22T14:00:51.590 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /dev 2020-04-22T14:00:51.590 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /run 2020-04-22T14:00:51.590 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /mnt 2020-04-22T14:00:51.590 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /var/tmp 2020-04-22T14:00:51.590 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /home 2020-04-22T14:00:51.590 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /tmp 2020-04-22T14:00:51.591 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /dev 2020-04-22T14:00:51.591 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:00:51.653 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.0.0-952.g360f904.el8.noarc 100/123 2020-04-22T14:00:51.956 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-dashboard-2:16.0.0-952.g360f904.el8.noa 101/123 2020-04-22T14:00:51.963 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mds-2:16.0.0-952.g360f904.el8.x86_64 96/123 2020-04-22T14:00:52.347 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mds-2:16.0.0-952.g360f904.el8.x86_64 96/123 2020-04-22T14:00:52.555 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mon-2:16.0.0-952.g360f904.el8.x86_64 97/123 2020-04-22T14:00:52.998 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.0.0-952.g360f904.el8.noa 101/123 2020-04-22T14:00:53.237 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-diskprediction-local-2:16.0.0-952.g360f 102/123 2020-04-22T14:00:53.310 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.0.0-952.g360f 102/123 2020-04-22T14:00:53.731 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-modules-core-2:16.0.0-952.g360f904.el8. 103/123 2020-04-22T14:00:53.923 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-2:16.0.0-952.g360f904.el8.x86_64 104/123 2020-04-22T14:00:53.952 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-2:16.0.0-952.g360f904.el8.x86_64 104/123 2020-04-22T14:00:53.978 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mon-2:16.0.0-952.g360f904.el8.x86_64 97/123 2020-04-22T14:00:54.112 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-rook-2:16.0.0-952.g360f904.el8.noarch 105/123 2020-04-22T14:00:54.129 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-rook-2:16.0.0-952.g360f904.el8.noarch 105/123 2020-04-22T14:00:54.221 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-osd-2:16.0.0-952.g360f904.el8.x86_64 98/123 2020-04-22T14:00:54.247 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-osd-2:16.0.0-952.g360f904.el8.x86_64 98/123 2020-04-22T14:00:55.386 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-2:16.0.0-952.g360f904.el8.x86_64 106/123 2020-04-22T14:00:55.580 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-radosgw-2:16.0.0-952.g360f904.el8.x86_64 107/123 2020-04-22T14:00:55.918 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-radosgw-2:16.0.0-952.g360f904.el8.x86_64 107/123 2020-04-22T14:00:56.025 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: cephadm-2:16.0.0-952.g360f904.el8.x86_64 99/123 2020-04-22T14:00:56.113 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-mirror-2:16.0.0-952.g360f904.el8.x86_64 108/123 2020-04-22T14:00:56.221 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephadm-2:16.0.0-952.g360f904.el8.x86_64 99/123 2020-04-22T14:00:56.420 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-cephadm-2:16.0.0-952.g360f904.el8.noarc 100/123 2020-04-22T14:00:57.266 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.0.0-952.g360f904.el8.noarc 100/123 2020-04-22T14:00:57.588 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-dashboard-2:16.0.0-952.g360f904.el8.noa 101/123 2020-04-22T14:00:58.626 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.0.0-952.g360f904.el8.noa 101/123 2020-04-22T14:00:58.912 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-diskprediction-local-2:16.0.0-952.g360f 102/123 2020-04-22T14:00:58.989 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.0.0-952.g360f 102/123 2020-04-22T14:00:59.380 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-modules-core-2:16.0.0-952.g360f904.el8. 103/123 2020-04-22T14:00:59.604 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-2:16.0.0-952.g360f904.el8.x86_64 104/123 2020-04-22T14:00:59.633 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-2:16.0.0-952.g360f904.el8.x86_64 104/123 2020-04-22T14:00:59.845 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-rook-2:16.0.0-952.g360f904.el8.noarch 105/123 2020-04-22T14:00:59.860 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-rook-2:16.0.0-952.g360f904.el8.noarch 105/123 2020-04-22T14:01:00.266 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: rbd-mirror-2:16.0.0-952.g360f904.el8.x86_64 108/123 2020-04-22T14:01:00.903 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-2:16.0.0-952.g360f904.el8.x86_64 106/123 2020-04-22T14:01:01.266 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-radosgw-2:16.0.0-952.g360f904.el8.x86_64 107/123 2020-04-22T14:01:01.630 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-radosgw-2:16.0.0-952.g360f904.el8.x86_64 107/123 2020-04-22T14:01:01.804 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-test-2:16.0.0-952.g360f904.el8.x86_64 109/123 2020-04-22T14:01:01.857 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-mirror-2:16.0.0-952.g360f904.el8.x86_64 108/123 2020-04-22T14:01:02.028 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libtool-2.4.6-25.el8.x86_64 110/123 2020-04-22T14:01:02.733 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 110/123 2020-04-22T14:01:03.019 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 111/123 2020-04-22T14:01:03.244 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-fuse-2:16.0.0-952.g360f904.el8.x86_64 112/123 2020-04-22T14:01:03.430 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : xfsprogs-devel-5.0.0-1.el8.x86_64 113/123 2020-04-22T14:01:03.658 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcephfs-devel-2:16.0.0-952.g360f904.el8.x86_64 114/123 2020-04-22T14:01:03.802 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : elfutils-libelf-devel-0.176-5.el8.x86_64 115/123 2020-04-22T14:01:04.016 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-fuse-2:16.0.0-952.g360f904.el8.x86_64 116/123 2020-04-22T14:01:04.231 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-nbd-2:16.0.0-952.g360f904.el8.x86_64 117/123 2020-04-22T14:01:04.387 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-immutable-object-cache-2:16.0.0-952.g360f90 118/123 2020-04-22T14:01:04.415 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-952.g360f90 118/123 2020-04-22T14:01:04.651 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 119/123 2020-04-22T14:01:04.845 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : bison-3.0.4-10.el8.x86_64 120/123 2020-04-22T14:01:04.901 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 120/123 2020-04-22T14:01:05.131 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : flex-2.6.1-9.el8.x86_64 121/123 2020-04-22T14:01:05.142 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 121/123 2020-04-22T14:01:05.142 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 122/123 2020-04-22T14:01:05.364 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 122/123 2020-04-22T14:01:05.365 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 123/123 2020-04-22T14:01:05.811 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: rbd-mirror-2:16.0.0-952.g360f904.el8.x86_64 108/123 2020-04-22T14:01:06.155 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-test-2:16.0.0-952.g360f904.el8.x86_64 109/123 2020-04-22T14:01:06.298 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 123/123 2020-04-22T14:01:06.298 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-2:16.0.0-952.g360f904.el8.x86_64 1/123 2020-04-22T14:01:06.299 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-base-2:16.0.0-952.g360f904.el8.x86_64 2/123 2020-04-22T14:01:06.299 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-common-2:16.0.0-952.g360f904.el8.x86_64 3/123 2020-04-22T14:01:06.299 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-fuse-2:16.0.0-952.g360f904.el8.x86_64 4/123 2020-04-22T14:01:06.299 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-immutable-object-cache-2:16.0.0-952.g360f90 5/123 2020-04-22T14:01:06.299 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mds-2:16.0.0-952.g360f904.el8.x86_64 6/123 2020-04-22T14:01:06.302 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-2:16.0.0-952.g360f904.el8.x86_64 7/123 2020-04-22T14:01:06.302 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mon-2:16.0.0-952.g360f904.el8.x86_64 8/123 2020-04-22T14:01:06.302 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-osd-2:16.0.0-952.g360f904.el8.x86_64 9/123 2020-04-22T14:01:06.302 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-radosgw-2:16.0.0-952.g360f904.el8.x86_64 10/123 2020-04-22T14:01:06.303 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-selinux-2:16.0.0-952.g360f904.el8.x86_64 11/123 2020-04-22T14:01:06.303 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-test-2:16.0.0-952.g360f904.el8.x86_64 12/123 2020-04-22T14:01:06.303 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : cephadm-2:16.0.0-952.g360f904.el8.x86_64 13/123 2020-04-22T14:01:06.303 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcephfs-devel-2:16.0.0-952.g360f904.el8.x86_64 14/123 2020-04-22T14:01:06.303 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcephfs2-2:16.0.0-952.g360f904.el8.x86_64 15/123 2020-04-22T14:01:06.303 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados-devel-2:16.0.0-952.g360f904.el8.x86_64 16/123 2020-04-22T14:01:06.303 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libradosstriper1-2:16.0.0-952.g360f904.el8.x86_6 17/123 2020-04-22T14:01:06.303 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librgw2-2:16.0.0-952.g360f904.el8.x86_64 18/123 2020-04-22T14:01:06.304 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-ceph-argparse-2:16.0.0-952.g360f904.el8. 19/123 2020-04-22T14:01:06.304 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-ceph-common-2:16.0.0-952.g360f904.el8.x8 20/123 2020-04-22T14:01:06.304 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cephfs-2:16.0.0-952.g360f904.el8.x86_64 21/123 2020-04-22T14:01:06.304 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rados-2:16.0.0-952.g360f904.el8.x86_64 22/123 2020-04-22T14:01:06.304 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rbd-2:16.0.0-952.g360f904.el8.x86_64 23/123 2020-04-22T14:01:06.304 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rgw-2:16.0.0-952.g360f904.el8.x86_64 24/123 2020-04-22T14:01:06.304 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-fuse-2:16.0.0-952.g360f904.el8.x86_64 25/123 2020-04-22T14:01:06.305 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-mirror-2:16.0.0-952.g360f904.el8.x86_64 26/123 2020-04-22T14:01:06.305 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-nbd-2:16.0.0-952.g360f904.el8.x86_64 27/123 2020-04-22T14:01:06.305 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-952.g360f904.el 28/123 2020-04-22T14:01:06.305 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-952.g360f904.el8.noarc 29/123 2020-04-22T14:01:06.305 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-dashboard-2:16.0.0-952.g360f904.el8.noa 30/123 2020-04-22T14:01:06.305 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.0.0-952.g360f 31/123 2020-04-22T14:01:06.305 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-modules-core-2:16.0.0-952.g360f904.el8. 32/123 2020-04-22T14:01:06.306 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-rook-2:16.0.0-952.g360f904.el8.noarch 33/123 2020-04-22T14:01:06.306 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-prometheus-alerts-2:16.0.0-952.g360f904.el8 34/123 2020-04-22T14:01:06.306 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 35/123 2020-04-22T14:01:06.306 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 36/123 2020-04-22T14:01:06.306 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-execnet-1.7.1-1.el8.2.noarch 37/123 2020-04-22T14:01:06.306 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 38/123 2020-04-22T14:01:06.306 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 39/123 2020-04-22T14:01:06.307 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 40/123 2020-04-22T14:01:06.307 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-more-itertools-7.2.0-4.el8.noarch 41/123 2020-04-22T14:01:06.307 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 42/123 2020-04-22T14:01:06.307 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-portend-2.6-1.el8.noarch 43/123 2020-04-22T14:01:06.307 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 44/123 2020-04-22T14:01:06.307 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 45/123 2020-04-22T14:01:06.307 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 46/123 2020-04-22T14:01:06.308 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 47/123 2020-04-22T14:01:06.308 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 48/123 2020-04-22T14:01:06.308 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 49/123 2020-04-22T14:01:06.308 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 50/123 2020-04-22T14:01:06.308 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 51/123 2020-04-22T14:01:06.308 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 52/123 2020-04-22T14:01:06.308 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : leveldb-1.22-1.el8.x86_64 53/123 2020-04-22T14:01:06.308 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 54/123 2020-04-22T14:01:06.309 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 55/123 2020-04-22T14:01:06.309 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 56/123 2020-04-22T14:01:06.309 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 57/123 2020-04-22T14:01:06.309 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 58/123 2020-04-22T14:01:06.309 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 59/123 2020-04-22T14:01:06.309 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 60/123 2020-04-22T14:01:06.309 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 61/123 2020-04-22T14:01:06.310 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 62/123 2020-04-22T14:01:06.310 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-kubernetes-10.0.1-2.el8.noarch 63/123 2020-04-22T14:01:06.310 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rsa-3.4.2-12.el8.noarch 64/123 2020-04-22T14:01:06.310 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/123 2020-04-22T14:01:06.310 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/123 2020-04-22T14:01:06.311 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/123 2020-04-22T14:01:06.311 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/123 2020-04-22T14:01:06.311 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 69/123 2020-04-22T14:01:06.311 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : automake-1.16.1-6.el8.noarch 70/123 2020-04-22T14:01:06.311 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 71/123 2020-04-22T14:01:06.311 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 72/123 2020-04-22T14:01:06.312 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : jq-1.5-12.el8.x86_64 73/123 2020-04-22T14:01:06.312 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 74/123 2020-04-22T14:01:06.312 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 75/123 2020-04-22T14:01:06.313 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 76/123 2020-04-22T14:01:06.313 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 77/123 2020-04-22T14:01:06.313 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 78/123 2020-04-22T14:01:06.313 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 79/123 2020-04-22T14:01:06.313 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 80/123 2020-04-22T14:01:06.314 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 81/123 2020-04-22T14:01:06.314 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 82/123 2020-04-22T14:01:06.314 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 83/123 2020-04-22T14:01:06.314 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 84/123 2020-04-22T14:01:06.315 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 85/123 2020-04-22T14:01:06.315 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 86/123 2020-04-22T14:01:06.315 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : flex-2.6.1-9.el8.x86_64 87/123 2020-04-22T14:01:06.315 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 88/123 2020-04-22T14:01:06.315 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : bison-3.0.4-10.el8.x86_64 89/123 2020-04-22T14:01:06.316 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 90/123 2020-04-22T14:01:06.316 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 91/123 2020-04-22T14:01:06.316 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 92/123 2020-04-22T14:01:06.317 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 93/123 2020-04-22T14:01:06.317 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 94/123 2020-04-22T14:01:06.317 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 95/123 2020-04-22T14:01:06.317 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 96/123 2020-04-22T14:01:06.317 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : pcre2-utf32-10.32-1.el8.x86_64 97/123 2020-04-22T14:01:06.317 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : zlib-devel-1.2.11-10.el8.x86_64 98/123 2020-04-22T14:01:06.318 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 99/123 2020-04-22T14:01:06.318 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 100/123 2020-04-22T14:01:06.318 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 101/123 2020-04-22T14:01:06.318 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 102/123 2020-04-22T14:01:06.318 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 103/123 2020-04-22T14:01:06.318 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : pcre2-devel-10.32-1.el8.x86_64 104/123 2020-04-22T14:01:06.318 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 105/123 2020-04-22T14:01:06.319 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 106/123 2020-04-22T14:01:06.319 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 107/123 2020-04-22T14:01:06.319 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : pcre2-utf16-10.32-1.el8.x86_64 108/123 2020-04-22T14:01:06.319 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 109/123 2020-04-22T14:01:06.319 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libselinux-devel-2.9-2.1.el8.x86_64 110/123 2020-04-22T14:01:06.319 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libquadmath-8.3.1-4.5.el8.x86_64 111/123 2020-04-22T14:01:06.320 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : krb5-devel-1.17-9.el8.x86_64 112/123 2020-04-22T14:01:06.320 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : elfutils-libelf-devel-0.176-5.el8.x86_64 113/123 2020-04-22T14:01:06.320 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : xfsprogs-devel-5.0.0-1.el8.x86_64 114/123 2020-04-22T14:01:06.320 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libgfortran-8.3.1-4.5.el8.x86_64 115/123 2020-04-22T14:01:06.320 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 116/123 2020-04-22T14:01:06.320 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcom_err-devel-1.44.6-3.el8.x86_64 117/123 2020-04-22T14:01:06.320 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libuuid-devel-2.32.1-17.el8.x86_64 118/123 2020-04-22T14:01:06.321 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 119/123 2020-04-22T14:01:06.321 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados2-2:16.0.0-952.g360f904.el8.x86_64 120/123 2020-04-22T14:01:06.321 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 121/123 2020-04-22T14:01:06.321 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librbd1-2:16.0.0-952.g360f904.el8.x86_64 122/123 2020-04-22T14:01:06.379 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libtool-2.4.6-25.el8.x86_64 110/123 2020-04-22T14:01:07.067 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 110/123 2020-04-22T14:01:07.995 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 111/123 2020-04-22T14:01:08.199 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-fuse-2:16.0.0-952.g360f904.el8.x86_64 112/123 2020-04-22T14:01:08.317 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 123/123 2020-04-22T14:01:08.317 INFO:teuthology.orchestra.run.smithi086.stdout:Installed products updated. 2020-04-22T14:01:08.380 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : xfsprogs-devel-5.0.0-1.el8.x86_64 113/123 2020-04-22T14:01:08.589 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephfs-devel-2:16.0.0-952.g360f904.el8.x86_64 114/123 2020-04-22T14:01:08.769 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : elfutils-libelf-devel-0.176-5.el8.x86_64 115/123 2020-04-22T14:01:08.957 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-fuse-2:16.0.0-952.g360f904.el8.x86_64 116/123 2020-04-22T14:01:09.171 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-nbd-2:16.0.0-952.g360f904.el8.x86_64 117/123 2020-04-22T14:01:09.378 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-immutable-object-cache-2:16.0.0-952.g360f90 118/123 2020-04-22T14:01:09.406 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-952.g360f90 118/123 2020-04-22T14:01:09.669 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 119/123 2020-04-22T14:01:09.889 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : bison-3.0.4-10.el8.x86_64 120/123 2020-04-22T14:01:09.948 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 120/123 2020-04-22T14:01:10.152 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flex-2.6.1-9.el8.x86_64 121/123 2020-04-22T14:01:10.165 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 121/123 2020-04-22T14:01:10.165 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 122/123 2020-04-22T14:01:10.458 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 122/123 2020-04-22T14:01:10.458 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 123/123 2020-04-22T14:01:10.583 INFO:teuthology.orchestra.run.smithi086.stdout: 2020-04-22T14:01:10.583 INFO:teuthology.orchestra.run.smithi086.stdout:Upgraded: 2020-04-22T14:01:10.583 INFO:teuthology.orchestra.run.smithi086.stdout: librados2-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:10.583 INFO:teuthology.orchestra.run.smithi086.stdout: librbd1-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:10.583 INFO:teuthology.orchestra.run.smithi086.stdout: 2020-04-22T14:01:10.583 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2020-04-22T14:01:10.584 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:10.584 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-base-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:10.584 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-fuse-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:10.584 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-immutable-object-cache-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:10.584 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:10.584 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-radosgw-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:10.584 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-test-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:10.585 INFO:teuthology.orchestra.run.smithi086.stdout: cephadm-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:10.585 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs-devel-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:10.585 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs2-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:10.585 INFO:teuthology.orchestra.run.smithi086.stdout: librados-devel-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:10.585 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cephfs-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:10.585 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rados-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:10.585 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rbd-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:10.586 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rgw-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:10.586 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-fuse-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:10.586 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-mirror-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:10.586 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-nbd-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:10.586 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-cephadm-2:16.0.0-952.g360f904.el8.noarch 2020-04-22T14:01:10.586 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-dashboard-2:16.0.0-952.g360f904.el8.noarch 2020-04-22T14:01:10.586 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-diskprediction-local-2:16.0.0-952.g360f904.el8.noarch 2020-04-22T14:01:10.586 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-rook-2:16.0.0-952.g360f904.el8.noarch 2020-04-22T14:01:10.587 INFO:teuthology.orchestra.run.smithi086.stdout: flex-2.6.1-9.el8.x86_64 2020-04-22T14:01:10.587 INFO:teuthology.orchestra.run.smithi086.stdout: bison-3.0.4-10.el8.x86_64 2020-04-22T14:01:10.587 INFO:teuthology.orchestra.run.smithi086.stdout: libtool-2.4.6-25.el8.x86_64 2020-04-22T14:01:10.587 INFO:teuthology.orchestra.run.smithi086.stdout: elfutils-libelf-devel-0.176-5.el8.x86_64 2020-04-22T14:01:10.587 INFO:teuthology.orchestra.run.smithi086.stdout: xfsprogs-devel-5.0.0-1.el8.x86_64 2020-04-22T14:01:10.587 INFO:teuthology.orchestra.run.smithi086.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-04-22T14:01:10.587 INFO:teuthology.orchestra.run.smithi086.stdout: libuuid-devel-2.32.1-17.el8.x86_64 2020-04-22T14:01:10.588 INFO:teuthology.orchestra.run.smithi086.stdout: openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 2020-04-22T14:01:10.588 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-04-22T14:01:10.588 INFO:teuthology.orchestra.run.smithi086.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-04-22T14:01:10.588 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-common-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:10.588 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mds-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:10.588 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mon-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:10.588 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-osd-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:10.588 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-selinux-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:10.589 INFO:teuthology.orchestra.run.smithi086.stdout: libradosstriper1-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:10.589 INFO:teuthology.orchestra.run.smithi086.stdout: librgw2-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:10.589 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-argparse-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:10.589 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-common-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:10.589 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-grafana-dashboards-2:16.0.0-952.g360f904.el8.noarch 2020-04-22T14:01:10.589 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-modules-core-2:16.0.0-952.g360f904.el8.noarch 2020-04-22T14:01:10.589 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-prometheus-alerts-2:16.0.0-952.g360f904.el8.noarch 2020-04-22T14:01:10.590 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-04-22T14:01:10.590 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-04-22T14:01:10.590 INFO:teuthology.orchestra.run.smithi086.stdout: python3-execnet-1.7.1-1.el8.2.noarch 2020-04-22T14:01:10.590 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-6.2-6.el8.noarch 2020-04-22T14:01:10.590 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-04-22T14:01:10.590 INFO:teuthology.orchestra.run.smithi086.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-04-22T14:01:10.590 INFO:teuthology.orchestra.run.smithi086.stdout: python3-more-itertools-7.2.0-4.el8.noarch 2020-04-22T14:01:10.591 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-04-22T14:01:10.591 INFO:teuthology.orchestra.run.smithi086.stdout: python3-portend-2.6-1.el8.noarch 2020-04-22T14:01:10.591 INFO:teuthology.orchestra.run.smithi086.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-04-22T14:01:10.591 INFO:teuthology.orchestra.run.smithi086.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-04-22T14:01:10.591 INFO:teuthology.orchestra.run.smithi086.stdout: python3-routes-2.4.1-12.el8.noarch 2020-04-22T14:01:10.591 INFO:teuthology.orchestra.run.smithi086.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-04-22T14:01:10.591 INFO:teuthology.orchestra.run.smithi086.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-04-22T14:01:10.591 INFO:teuthology.orchestra.run.smithi086.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-04-22T14:01:10.592 INFO:teuthology.orchestra.run.smithi086.stdout: python3-trustme-0.5.2-4.el8.noarch 2020-04-22T14:01:10.592 INFO:teuthology.orchestra.run.smithi086.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-04-22T14:01:10.592 INFO:teuthology.orchestra.run.smithi086.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-04-22T14:01:10.592 INFO:teuthology.orchestra.run.smithi086.stdout: leveldb-1.22-1.el8.x86_64 2020-04-22T14:01:10.592 INFO:teuthology.orchestra.run.smithi086.stdout: liboath-2.6.2-3.el8.x86_64 2020-04-22T14:01:10.592 INFO:teuthology.orchestra.run.smithi086.stdout: libunwind-1.3.1-3.el8.x86_64 2020-04-22T14:01:10.592 INFO:teuthology.orchestra.run.smithi086.stdout: python3-apipkg-1.5-6.el8.noarch 2020-04-22T14:01:10.593 INFO:teuthology.orchestra.run.smithi086.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-04-22T14:01:10.593 INFO:teuthology.orchestra.run.smithi086.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-04-22T14:01:10.593 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-04-22T14:01:10.593 INFO:teuthology.orchestra.run.smithi086.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-04-22T14:01:10.593 INFO:teuthology.orchestra.run.smithi086.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-04-22T14:01:10.594 INFO:teuthology.orchestra.run.smithi086.stdout: python3-kubernetes-10.0.1-2.el8.noarch 2020-04-22T14:01:10.594 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rsa-3.4.2-12.el8.noarch 2020-04-22T14:01:10.594 INFO:teuthology.orchestra.run.smithi086.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-04-22T14:01:10.594 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-04-22T14:01:10.594 INFO:teuthology.orchestra.run.smithi086.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-04-22T14:01:10.594 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-04-22T14:01:10.594 INFO:teuthology.orchestra.run.smithi086.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2020-04-22T14:01:10.595 INFO:teuthology.orchestra.run.smithi086.stdout: automake-1.16.1-6.el8.noarch 2020-04-22T14:01:10.595 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-04-22T14:01:10.595 INFO:teuthology.orchestra.run.smithi086.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-04-22T14:01:10.595 INFO:teuthology.orchestra.run.smithi086.stdout: jq-1.5-12.el8.x86_64 2020-04-22T14:01:10.595 INFO:teuthology.orchestra.run.smithi086.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-04-22T14:01:10.595 INFO:teuthology.orchestra.run.smithi086.stdout: python3-mako-1.0.6-13.el8.noarch 2020-04-22T14:01:10.595 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-04-22T14:01:10.596 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-04-22T14:01:10.596 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-04-22T14:01:10.596 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pytz-2017.2-9.el8.noarch 2020-04-22T14:01:10.596 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-04-22T14:01:10.596 INFO:teuthology.orchestra.run.smithi086.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-04-22T14:01:10.596 INFO:teuthology.orchestra.run.smithi086.stdout: socat-1.7.3.2-6.el8.x86_64 2020-04-22T14:01:10.596 INFO:teuthology.orchestra.run.smithi086.stdout: openblas-threads-0.3.3-2.el8.x86_64 2020-04-22T14:01:10.596 INFO:teuthology.orchestra.run.smithi086.stdout: oniguruma-6.8.2-1.el8.x86_64 2020-04-22T14:01:10.597 INFO:teuthology.orchestra.run.smithi086.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-04-22T14:01:10.597 INFO:teuthology.orchestra.run.smithi086.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-04-22T14:01:10.597 INFO:teuthology.orchestra.run.smithi086.stdout: openblas-0.3.3-2.el8.x86_64 2020-04-22T14:01:10.597 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-04-22T14:01:10.597 INFO:teuthology.orchestra.run.smithi086.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-04-22T14:01:10.597 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-04-22T14:01:10.597 INFO:teuthology.orchestra.run.smithi086.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2020-04-22T14:01:10.598 INFO:teuthology.orchestra.run.smithi086.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-04-22T14:01:10.598 INFO:teuthology.orchestra.run.smithi086.stdout: pcre2-utf32-10.32-1.el8.x86_64 2020-04-22T14:01:10.598 INFO:teuthology.orchestra.run.smithi086.stdout: zlib-devel-1.2.11-10.el8.x86_64 2020-04-22T14:01:10.599 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-04-22T14:01:10.599 INFO:teuthology.orchestra.run.smithi086.stdout: fuse-2.9.7-12.el8.x86_64 2020-04-22T14:01:10.599 INFO:teuthology.orchestra.run.smithi086.stdout: libxslt-1.1.32-3.el8.x86_64 2020-04-22T14:01:10.599 INFO:teuthology.orchestra.run.smithi086.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-04-22T14:01:10.600 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-04-22T14:01:10.600 INFO:teuthology.orchestra.run.smithi086.stdout: pcre2-devel-10.32-1.el8.x86_64 2020-04-22T14:01:10.600 INFO:teuthology.orchestra.run.smithi086.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-04-22T14:01:10.600 INFO:teuthology.orchestra.run.smithi086.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-04-22T14:01:10.600 INFO:teuthology.orchestra.run.smithi086.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-04-22T14:01:10.600 INFO:teuthology.orchestra.run.smithi086.stdout: pcre2-utf16-10.32-1.el8.x86_64 2020-04-22T14:01:10.600 INFO:teuthology.orchestra.run.smithi086.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-04-22T14:01:10.601 INFO:teuthology.orchestra.run.smithi086.stdout: libselinux-devel-2.9-2.1.el8.x86_64 2020-04-22T14:01:10.601 INFO:teuthology.orchestra.run.smithi086.stdout: libquadmath-8.3.1-4.5.el8.x86_64 2020-04-22T14:01:10.601 INFO:teuthology.orchestra.run.smithi086.stdout: krb5-devel-1.17-9.el8.x86_64 2020-04-22T14:01:10.601 INFO:teuthology.orchestra.run.smithi086.stdout: libgfortran-8.3.1-4.5.el8.x86_64 2020-04-22T14:01:10.601 INFO:teuthology.orchestra.run.smithi086.stdout: libcom_err-devel-1.44.6-3.el8.x86_64 2020-04-22T14:01:10.601 INFO:teuthology.orchestra.run.smithi086.stdout: 2020-04-22T14:01:10.602 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2020-04-22T14:01:10.800 DEBUG:teuthology.parallel:result is None 2020-04-22T14:01:11.282 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 123/123 2020-04-22T14:01:11.282 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-2:16.0.0-952.g360f904.el8.x86_64 1/123 2020-04-22T14:01:11.282 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-base-2:16.0.0-952.g360f904.el8.x86_64 2/123 2020-04-22T14:01:11.282 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-common-2:16.0.0-952.g360f904.el8.x86_64 3/123 2020-04-22T14:01:11.283 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-fuse-2:16.0.0-952.g360f904.el8.x86_64 4/123 2020-04-22T14:01:11.283 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-immutable-object-cache-2:16.0.0-952.g360f90 5/123 2020-04-22T14:01:11.283 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mds-2:16.0.0-952.g360f904.el8.x86_64 6/123 2020-04-22T14:01:11.283 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-2:16.0.0-952.g360f904.el8.x86_64 7/123 2020-04-22T14:01:11.283 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mon-2:16.0.0-952.g360f904.el8.x86_64 8/123 2020-04-22T14:01:11.283 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-osd-2:16.0.0-952.g360f904.el8.x86_64 9/123 2020-04-22T14:01:11.283 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-radosgw-2:16.0.0-952.g360f904.el8.x86_64 10/123 2020-04-22T14:01:11.284 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-selinux-2:16.0.0-952.g360f904.el8.x86_64 11/123 2020-04-22T14:01:11.284 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-test-2:16.0.0-952.g360f904.el8.x86_64 12/123 2020-04-22T14:01:11.284 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephadm-2:16.0.0-952.g360f904.el8.x86_64 13/123 2020-04-22T14:01:11.284 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephfs-devel-2:16.0.0-952.g360f904.el8.x86_64 14/123 2020-04-22T14:01:11.285 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephfs2-2:16.0.0-952.g360f904.el8.x86_64 15/123 2020-04-22T14:01:11.285 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados-devel-2:16.0.0-952.g360f904.el8.x86_64 16/123 2020-04-22T14:01:11.285 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libradosstriper1-2:16.0.0-952.g360f904.el8.x86_6 17/123 2020-04-22T14:01:11.285 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librgw2-2:16.0.0-952.g360f904.el8.x86_64 18/123 2020-04-22T14:01:11.285 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ceph-argparse-2:16.0.0-952.g360f904.el8. 19/123 2020-04-22T14:01:11.285 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ceph-common-2:16.0.0-952.g360f904.el8.x8 20/123 2020-04-22T14:01:11.286 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cephfs-2:16.0.0-952.g360f904.el8.x86_64 21/123 2020-04-22T14:01:11.286 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rados-2:16.0.0-952.g360f904.el8.x86_64 22/123 2020-04-22T14:01:11.286 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rbd-2:16.0.0-952.g360f904.el8.x86_64 23/123 2020-04-22T14:01:11.286 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rgw-2:16.0.0-952.g360f904.el8.x86_64 24/123 2020-04-22T14:01:11.286 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-fuse-2:16.0.0-952.g360f904.el8.x86_64 25/123 2020-04-22T14:01:11.286 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-mirror-2:16.0.0-952.g360f904.el8.x86_64 26/123 2020-04-22T14:01:11.286 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-nbd-2:16.0.0-952.g360f904.el8.x86_64 27/123 2020-04-22T14:01:11.287 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-952.g360f904.el 28/123 2020-04-22T14:01:11.287 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-952.g360f904.el8.noarc 29/123 2020-04-22T14:01:11.287 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-dashboard-2:16.0.0-952.g360f904.el8.noa 30/123 2020-04-22T14:01:11.295 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.0.0-952.g360f 31/123 2020-04-22T14:01:11.295 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-modules-core-2:16.0.0-952.g360f904.el8. 32/123 2020-04-22T14:01:11.295 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-rook-2:16.0.0-952.g360f904.el8.noarch 33/123 2020-04-22T14:01:11.295 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-prometheus-alerts-2:16.0.0-952.g360f904.el8 34/123 2020-04-22T14:01:11.295 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 35/123 2020-04-22T14:01:11.295 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 36/123 2020-04-22T14:01:11.295 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-execnet-1.7.1-1.el8.2.noarch 37/123 2020-04-22T14:01:11.296 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 38/123 2020-04-22T14:01:11.296 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 39/123 2020-04-22T14:01:11.296 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 40/123 2020-04-22T14:01:11.296 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-more-itertools-7.2.0-4.el8.noarch 41/123 2020-04-22T14:01:11.296 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 42/123 2020-04-22T14:01:11.296 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-portend-2.6-1.el8.noarch 43/123 2020-04-22T14:01:11.296 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 44/123 2020-04-22T14:01:11.297 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 45/123 2020-04-22T14:01:11.297 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 46/123 2020-04-22T14:01:11.297 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 47/123 2020-04-22T14:01:11.297 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 48/123 2020-04-22T14:01:11.297 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 49/123 2020-04-22T14:01:11.297 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 50/123 2020-04-22T14:01:11.297 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 51/123 2020-04-22T14:01:11.298 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 52/123 2020-04-22T14:01:11.298 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : leveldb-1.22-1.el8.x86_64 53/123 2020-04-22T14:01:11.298 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 54/123 2020-04-22T14:01:11.298 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 55/123 2020-04-22T14:01:11.298 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 56/123 2020-04-22T14:01:11.298 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 57/123 2020-04-22T14:01:11.298 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 58/123 2020-04-22T14:01:11.299 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 59/123 2020-04-22T14:01:11.299 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 60/123 2020-04-22T14:01:11.299 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 61/123 2020-04-22T14:01:11.299 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 62/123 2020-04-22T14:01:11.299 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-kubernetes-10.0.1-2.el8.noarch 63/123 2020-04-22T14:01:11.299 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rsa-3.4.2-12.el8.noarch 64/123 2020-04-22T14:01:11.300 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/123 2020-04-22T14:01:11.300 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/123 2020-04-22T14:01:11.300 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/123 2020-04-22T14:01:11.300 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/123 2020-04-22T14:01:11.300 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 69/123 2020-04-22T14:01:11.300 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : automake-1.16.1-6.el8.noarch 70/123 2020-04-22T14:01:11.300 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 71/123 2020-04-22T14:01:11.301 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 72/123 2020-04-22T14:01:11.301 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : jq-1.5-12.el8.x86_64 73/123 2020-04-22T14:01:11.301 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 74/123 2020-04-22T14:01:11.301 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 75/123 2020-04-22T14:01:11.301 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 76/123 2020-04-22T14:01:11.301 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 77/123 2020-04-22T14:01:11.301 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 78/123 2020-04-22T14:01:11.302 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 79/123 2020-04-22T14:01:11.302 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 80/123 2020-04-22T14:01:11.302 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 81/123 2020-04-22T14:01:11.302 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 82/123 2020-04-22T14:01:11.302 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 83/123 2020-04-22T14:01:11.302 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 84/123 2020-04-22T14:01:11.302 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 85/123 2020-04-22T14:01:11.303 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 86/123 2020-04-22T14:01:11.303 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flex-2.6.1-9.el8.x86_64 87/123 2020-04-22T14:01:11.303 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 88/123 2020-04-22T14:01:11.303 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : bison-3.0.4-10.el8.x86_64 89/123 2020-04-22T14:01:11.303 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 90/123 2020-04-22T14:01:11.303 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 91/123 2020-04-22T14:01:11.303 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 92/123 2020-04-22T14:01:11.303 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 93/123 2020-04-22T14:01:11.304 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 94/123 2020-04-22T14:01:11.304 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 95/123 2020-04-22T14:01:11.304 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 96/123 2020-04-22T14:01:11.304 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : pcre2-utf32-10.32-1.el8.x86_64 97/123 2020-04-22T14:01:11.304 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : zlib-devel-1.2.11-10.el8.x86_64 98/123 2020-04-22T14:01:11.304 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 99/123 2020-04-22T14:01:11.305 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 100/123 2020-04-22T14:01:11.305 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 101/123 2020-04-22T14:01:11.305 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 102/123 2020-04-22T14:01:11.305 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 103/123 2020-04-22T14:01:11.305 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : pcre2-devel-10.32-1.el8.x86_64 104/123 2020-04-22T14:01:11.305 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 105/123 2020-04-22T14:01:11.305 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 106/123 2020-04-22T14:01:11.306 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 107/123 2020-04-22T14:01:11.306 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : pcre2-utf16-10.32-1.el8.x86_64 108/123 2020-04-22T14:01:11.306 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 109/123 2020-04-22T14:01:11.306 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libselinux-devel-2.9-2.1.el8.x86_64 110/123 2020-04-22T14:01:11.306 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libquadmath-8.3.1-4.5.el8.x86_64 111/123 2020-04-22T14:01:11.306 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : krb5-devel-1.17-9.el8.x86_64 112/123 2020-04-22T14:01:11.306 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : elfutils-libelf-devel-0.176-5.el8.x86_64 113/123 2020-04-22T14:01:11.307 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : xfsprogs-devel-5.0.0-1.el8.x86_64 114/123 2020-04-22T14:01:11.307 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libgfortran-8.3.1-4.5.el8.x86_64 115/123 2020-04-22T14:01:11.307 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 116/123 2020-04-22T14:01:11.307 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcom_err-devel-1.44.6-3.el8.x86_64 117/123 2020-04-22T14:01:11.307 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libuuid-devel-2.32.1-17.el8.x86_64 118/123 2020-04-22T14:01:11.307 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 119/123 2020-04-22T14:01:11.307 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados2-2:16.0.0-952.g360f904.el8.x86_64 120/123 2020-04-22T14:01:11.307 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 121/123 2020-04-22T14:01:11.308 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librbd1-2:16.0.0-952.g360f904.el8.x86_64 122/123 2020-04-22T14:01:12.955 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 123/123 2020-04-22T14:01:12.956 INFO:teuthology.orchestra.run.smithi103.stdout:Installed products updated. 2020-04-22T14:01:14.864 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:01:14.865 INFO:teuthology.orchestra.run.smithi103.stdout:Upgraded: 2020-04-22T14:01:14.865 INFO:teuthology.orchestra.run.smithi103.stdout: librados2-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:14.865 INFO:teuthology.orchestra.run.smithi103.stdout: librbd1-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:14.865 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:01:14.865 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2020-04-22T14:01:14.865 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:14.865 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-base-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:14.866 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-fuse-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:14.866 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-immutable-object-cache-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:14.866 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:14.866 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-radosgw-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:14.866 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-test-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:14.866 INFO:teuthology.orchestra.run.smithi103.stdout: cephadm-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:14.866 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs-devel-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:14.866 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs2-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:14.867 INFO:teuthology.orchestra.run.smithi103.stdout: librados-devel-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:14.867 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cephfs-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:14.867 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rados-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:14.867 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rbd-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:14.867 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rgw-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:14.868 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-fuse-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:14.868 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-mirror-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:14.868 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-nbd-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:14.868 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-cephadm-2:16.0.0-952.g360f904.el8.noarch 2020-04-22T14:01:14.868 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-dashboard-2:16.0.0-952.g360f904.el8.noarch 2020-04-22T14:01:14.868 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-diskprediction-local-2:16.0.0-952.g360f904.el8.noarch 2020-04-22T14:01:14.868 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-rook-2:16.0.0-952.g360f904.el8.noarch 2020-04-22T14:01:14.868 INFO:teuthology.orchestra.run.smithi103.stdout: flex-2.6.1-9.el8.x86_64 2020-04-22T14:01:14.869 INFO:teuthology.orchestra.run.smithi103.stdout: bison-3.0.4-10.el8.x86_64 2020-04-22T14:01:14.869 INFO:teuthology.orchestra.run.smithi103.stdout: libtool-2.4.6-25.el8.x86_64 2020-04-22T14:01:14.869 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-libelf-devel-0.176-5.el8.x86_64 2020-04-22T14:01:14.869 INFO:teuthology.orchestra.run.smithi103.stdout: xfsprogs-devel-5.0.0-1.el8.x86_64 2020-04-22T14:01:14.869 INFO:teuthology.orchestra.run.smithi103.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-04-22T14:01:14.869 INFO:teuthology.orchestra.run.smithi103.stdout: libuuid-devel-2.32.1-17.el8.x86_64 2020-04-22T14:01:14.869 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 2020-04-22T14:01:14.870 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-04-22T14:01:14.870 INFO:teuthology.orchestra.run.smithi103.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-04-22T14:01:14.870 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-common-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:14.870 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mds-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:14.870 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mon-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:14.870 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-osd-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:14.870 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-selinux-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:14.870 INFO:teuthology.orchestra.run.smithi103.stdout: libradosstriper1-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:14.871 INFO:teuthology.orchestra.run.smithi103.stdout: librgw2-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:14.871 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-argparse-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:14.871 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-common-2:16.0.0-952.g360f904.el8.x86_64 2020-04-22T14:01:14.871 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-grafana-dashboards-2:16.0.0-952.g360f904.el8.noarch 2020-04-22T14:01:14.871 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-modules-core-2:16.0.0-952.g360f904.el8.noarch 2020-04-22T14:01:14.871 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-prometheus-alerts-2:16.0.0-952.g360f904.el8.noarch 2020-04-22T14:01:14.871 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-04-22T14:01:14.872 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-04-22T14:01:14.872 INFO:teuthology.orchestra.run.smithi103.stdout: python3-execnet-1.7.1-1.el8.2.noarch 2020-04-22T14:01:14.872 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-6.2-6.el8.noarch 2020-04-22T14:01:14.872 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-04-22T14:01:14.872 INFO:teuthology.orchestra.run.smithi103.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-04-22T14:01:14.872 INFO:teuthology.orchestra.run.smithi103.stdout: python3-more-itertools-7.2.0-4.el8.noarch 2020-04-22T14:01:14.872 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-04-22T14:01:14.872 INFO:teuthology.orchestra.run.smithi103.stdout: python3-portend-2.6-1.el8.noarch 2020-04-22T14:01:14.873 INFO:teuthology.orchestra.run.smithi103.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-04-22T14:01:14.873 INFO:teuthology.orchestra.run.smithi103.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-04-22T14:01:14.873 INFO:teuthology.orchestra.run.smithi103.stdout: python3-routes-2.4.1-12.el8.noarch 2020-04-22T14:01:14.873 INFO:teuthology.orchestra.run.smithi103.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-04-22T14:01:14.873 INFO:teuthology.orchestra.run.smithi103.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-04-22T14:01:14.873 INFO:teuthology.orchestra.run.smithi103.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-04-22T14:01:14.873 INFO:teuthology.orchestra.run.smithi103.stdout: python3-trustme-0.5.2-4.el8.noarch 2020-04-22T14:01:14.873 INFO:teuthology.orchestra.run.smithi103.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-04-22T14:01:14.874 INFO:teuthology.orchestra.run.smithi103.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-04-22T14:01:14.874 INFO:teuthology.orchestra.run.smithi103.stdout: leveldb-1.22-1.el8.x86_64 2020-04-22T14:01:14.874 INFO:teuthology.orchestra.run.smithi103.stdout: liboath-2.6.2-3.el8.x86_64 2020-04-22T14:01:14.874 INFO:teuthology.orchestra.run.smithi103.stdout: libunwind-1.3.1-3.el8.x86_64 2020-04-22T14:01:14.874 INFO:teuthology.orchestra.run.smithi103.stdout: python3-apipkg-1.5-6.el8.noarch 2020-04-22T14:01:14.874 INFO:teuthology.orchestra.run.smithi103.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-04-22T14:01:14.874 INFO:teuthology.orchestra.run.smithi103.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-04-22T14:01:14.874 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-04-22T14:01:14.875 INFO:teuthology.orchestra.run.smithi103.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-04-22T14:01:14.875 INFO:teuthology.orchestra.run.smithi103.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-04-22T14:01:14.875 INFO:teuthology.orchestra.run.smithi103.stdout: python3-kubernetes-10.0.1-2.el8.noarch 2020-04-22T14:01:14.875 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rsa-3.4.2-12.el8.noarch 2020-04-22T14:01:14.875 INFO:teuthology.orchestra.run.smithi103.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-04-22T14:01:14.875 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-04-22T14:01:14.875 INFO:teuthology.orchestra.run.smithi103.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-04-22T14:01:14.875 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-04-22T14:01:14.876 INFO:teuthology.orchestra.run.smithi103.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2020-04-22T14:01:14.876 INFO:teuthology.orchestra.run.smithi103.stdout: automake-1.16.1-6.el8.noarch 2020-04-22T14:01:14.876 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-04-22T14:01:14.876 INFO:teuthology.orchestra.run.smithi103.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-04-22T14:01:14.876 INFO:teuthology.orchestra.run.smithi103.stdout: jq-1.5-12.el8.x86_64 2020-04-22T14:01:14.876 INFO:teuthology.orchestra.run.smithi103.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-04-22T14:01:14.876 INFO:teuthology.orchestra.run.smithi103.stdout: python3-mako-1.0.6-13.el8.noarch 2020-04-22T14:01:14.877 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-04-22T14:01:14.877 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-04-22T14:01:14.877 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-04-22T14:01:14.877 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pytz-2017.2-9.el8.noarch 2020-04-22T14:01:14.877 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-04-22T14:01:14.877 INFO:teuthology.orchestra.run.smithi103.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-04-22T14:01:14.878 INFO:teuthology.orchestra.run.smithi103.stdout: socat-1.7.3.2-6.el8.x86_64 2020-04-22T14:01:14.878 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-threads-0.3.3-2.el8.x86_64 2020-04-22T14:01:14.878 INFO:teuthology.orchestra.run.smithi103.stdout: oniguruma-6.8.2-1.el8.x86_64 2020-04-22T14:01:14.878 INFO:teuthology.orchestra.run.smithi103.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-04-22T14:01:14.878 INFO:teuthology.orchestra.run.smithi103.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-04-22T14:01:14.878 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-0.3.3-2.el8.x86_64 2020-04-22T14:01:14.878 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-04-22T14:01:14.879 INFO:teuthology.orchestra.run.smithi103.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-04-22T14:01:14.879 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-04-22T14:01:14.879 INFO:teuthology.orchestra.run.smithi103.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2020-04-22T14:01:14.879 INFO:teuthology.orchestra.run.smithi103.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-04-22T14:01:14.879 INFO:teuthology.orchestra.run.smithi103.stdout: pcre2-utf32-10.32-1.el8.x86_64 2020-04-22T14:01:14.879 INFO:teuthology.orchestra.run.smithi103.stdout: zlib-devel-1.2.11-10.el8.x86_64 2020-04-22T14:01:14.879 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-04-22T14:01:14.880 INFO:teuthology.orchestra.run.smithi103.stdout: fuse-2.9.7-12.el8.x86_64 2020-04-22T14:01:14.880 INFO:teuthology.orchestra.run.smithi103.stdout: libxslt-1.1.32-3.el8.x86_64 2020-04-22T14:01:14.880 INFO:teuthology.orchestra.run.smithi103.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-04-22T14:01:14.880 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-04-22T14:01:14.880 INFO:teuthology.orchestra.run.smithi103.stdout: pcre2-devel-10.32-1.el8.x86_64 2020-04-22T14:01:14.880 INFO:teuthology.orchestra.run.smithi103.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-04-22T14:01:14.880 INFO:teuthology.orchestra.run.smithi103.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-04-22T14:01:14.881 INFO:teuthology.orchestra.run.smithi103.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-04-22T14:01:14.881 INFO:teuthology.orchestra.run.smithi103.stdout: pcre2-utf16-10.32-1.el8.x86_64 2020-04-22T14:01:14.881 INFO:teuthology.orchestra.run.smithi103.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-04-22T14:01:14.881 INFO:teuthology.orchestra.run.smithi103.stdout: libselinux-devel-2.9-2.1.el8.x86_64 2020-04-22T14:01:14.881 INFO:teuthology.orchestra.run.smithi103.stdout: libquadmath-8.3.1-4.5.el8.x86_64 2020-04-22T14:01:14.881 INFO:teuthology.orchestra.run.smithi103.stdout: krb5-devel-1.17-9.el8.x86_64 2020-04-22T14:01:14.881 INFO:teuthology.orchestra.run.smithi103.stdout: libgfortran-8.3.1-4.5.el8.x86_64 2020-04-22T14:01:14.882 INFO:teuthology.orchestra.run.smithi103.stdout: libcom_err-devel-1.44.6-3.el8.x86_64 2020-04-22T14:01:14.882 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:01:14.882 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2020-04-22T14:01:15.117 DEBUG:teuthology.parallel:result is None 2020-04-22T14:01:15.117 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:15.132 INFO:teuthology.orchestra.run.smithi103:> sudo lsb_release -is 2020-04-22T14:01:15.217 INFO:teuthology.orchestra.run.smithi103.stdout:RedHatEnterprise 2020-04-22T14:01:15.218 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-04-22T14:01:15.218 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=360f904aafdcc5437adf7f1a18be626f09ffd78d 2020-04-22T14:01:15.450 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:15.464 INFO:teuthology.orchestra.run.smithi103:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-04-22T14:01:15.524 INFO:teuthology.orchestra.run.smithi103.stdout:16.0.0-952.g360f904.el8 2020-04-22T14:01:15.524 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-952.g360f904.el8 2020-04-22T14:01:15.524 INFO:teuthology.task.install:The correct ceph version 16.0.0-952.g360f904 is installed. 2020-04-22T14:01:15.525 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:15.543 INFO:teuthology.orchestra.run.smithi086:> sudo lsb_release -is 2020-04-22T14:01:15.634 INFO:teuthology.orchestra.run.smithi086.stdout:RedHatEnterprise 2020-04-22T14:01:15.635 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-04-22T14:01:15.636 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=360f904aafdcc5437adf7f1a18be626f09ffd78d 2020-04-22T14:01:15.867 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:15.883 INFO:teuthology.orchestra.run.smithi086:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-04-22T14:01:15.945 INFO:teuthology.orchestra.run.smithi086.stdout:16.0.0-952.g360f904.el8 2020-04-22T14:01:15.945 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-952.g360f904.el8 2020-04-22T14:01:15.946 INFO:teuthology.task.install:The correct ceph version 16.0.0-952.g360f904 is installed. 2020-04-22T14:01:15.946 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2020-04-22T14:01:15.946 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:15.961 INFO:teuthology.orchestra.run.smithi103:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-04-22T14:01:16.032 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:16.047 INFO:teuthology.orchestra.run.smithi086:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-04-22T14:01:16.117 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2020-04-22T14:01:16.118 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:16.132 INFO:teuthology.orchestra.run.smithi103:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-04-22T14:01:16.202 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:16.257 INFO:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-04-22T14:01:16.324 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:16.339 INFO:teuthology.orchestra.run.smithi086:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-04-22T14:01:16.426 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:16.481 INFO:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-04-22T14:01:16.550 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2020-04-22T14:01:16.551 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:16.565 INFO:teuthology.orchestra.run.smithi103:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-04-22T14:01:16.650 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:16.705 INFO:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-04-22T14:01:16.772 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:16.787 INFO:teuthology.orchestra.run.smithi086:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-04-22T14:01:16.873 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:16.928 INFO:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-04-22T14:01:16.997 INFO:teuthology.run_tasks:Running task ceph... 2020-04-22T14:01:17.073 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2020-04-22T14:01:17.074 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:17.089 INFO:teuthology.orchestra.run.smithi086:> sudo chmod 777 /var/log/ceph 2020-04-22T14:01:17.132 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:17.147 INFO:teuthology.orchestra.run.smithi103:> sudo chmod 777 /var/log/ceph 2020-04-22T14:01:17.215 INFO:tasks.ceph:Disabling ceph logrotate... 2020-04-22T14:01:17.215 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:17.230 INFO:teuthology.orchestra.run.smithi086:> sudo rm -f -- /etc/logrotate.d/ceph 2020-04-22T14:01:17.272 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:17.289 INFO:teuthology.orchestra.run.smithi103:> sudo rm -f -- /etc/logrotate.d/ceph 2020-04-22T14:01:17.357 INFO:tasks.ceph:Creating extra log directories... 2020-04-22T14:01:17.357 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:17.372 INFO:teuthology.orchestra.run.smithi086:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-04-22T14:01:17.422 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:17.436 INFO:teuthology.orchestra.run.smithi103:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-04-22T14:01:17.503 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2020-04-22T14:01:17.503 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2020-04-22T14:01:17.503 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2020-04-22T14:01:17.504 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:17.556 INFO:teuthology.orchestra.run.smithi103:> cat > /home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-04-22T14:01:17.646 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:17.700 INFO:teuthology.orchestra.run.smithi103:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-04-22T14:01:17.815 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:17.834 INFO:teuthology.orchestra.run.smithi103:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-04-22T14:01:17.915 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:17.944 INFO:teuthology.orchestra.run.smithi086:> cat > /home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-04-22T14:01:18.057 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:18.123 INFO:teuthology.orchestra.run.smithi086:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-04-22T14:01:18.249 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:18.264 INFO:teuthology.orchestra.run.smithi086:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-04-22T14:01:18.334 INFO:tasks.ceph:Creating ceph cluster ceph... 2020-04-22T14:01:18.334 INFO:tasks.ceph:config {'mon_bind_addrvec': True, 'fs': 'xfs', 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'but it is still running', 'slow request', 'MDS_CLIENT_LATE_RELEASE', 't responding to mclientcaps'], 'skip_mgr_daemons': False, 'cpu_profile': set([]), 'mkfs_options': None, 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mount_options': None, 'conf': {'mds': {'mds debug frag': True, 'mds bal split bits': 3, 'mds bal split size': 100, 'debug mds': 20, 'mds bal merge size': 5, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds op complaint time': 180, 'mds debug scatterstat': True, 'osd op complaint time': 180, 'mds verify scatter': True}, 'client': {'debug ms': 1, 'pid file': '', 'debug client': 20, 'client mount timeout': 600}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 20, 'bluestore fsck on mount': True, 'debug osd': 25, 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'debug rocksdb': 10, 'debug journal': 20, 'bluestore allocator': 'bitmap', 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'bdev async discard': True, 'osd failsafe full ratio': 0.95, 'bluestore block size': 96636764160, 'debug filestore': 20, 'bdev enable discard': True, 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon op complaint time': 120, 'debug ms': 1}}} 2020-04-22T14:01:18.335 INFO:tasks.ceph:ctx.config {'kernel': {'sha1': 'distro', 'kdb': True}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (2, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'sha1': 'distro', 'kdb': True}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel']}, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'sha1': '360f904aafdcc5437adf7f1a18be626f09ffd78d'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_client_recovery'], 'fail_on_skip': False}}], 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_vstart_runner/qa', 'sleep_before_teardown': 0, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.30387', 'owner': 'scheduled_xiubli@teuthology', 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'targets': {'smithi103.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDVdrsSP/xCgYzJyAEpLEvTe/JKb9p3U38oU3HADv2jDoD9xVWorGk57/bAVn5vPp5Bk3Nr+X+G3IFWs3XDPrlyA/rGjgVGqyr79P/Y394TseAQ2044Ne1BToFHSoe5aEQJixF5AivNiMEUDj/drVNbutFFYMPSsbKs1Nf/ZwhMfu1d+fKe8fnntroO0fQnq08HktDRbf5bhzpUXjbynvCaWQjB+T0Thn6de9wz5O1JqTAGBX+NrLoSJV2jCzQdT0pE2is2voUaBqiXvHQ9osXa4qW8iuw93DstH00tJ6Gps6qi6K1K4GaBPqVQoqW9YO1WHved5nYHJ3FBgWJJO0EWESjh0uo/hgXpyXEpg+lejuaKsSZEFmmex/foTyUA3eSPmOo349+1dB+ZrtI1m63hG70CTeldjvBotHuE2RcOXK5rb8u3AYtyYelYSGz5gsMTdOHW81RSlu5gzcfjxJTk0qvCnEmghbO6QsytLZVwlVdqK29PFKp70g/4Ts3T680=', 'smithi086.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4sktg9rjcFLvLb1iDygji9Ajt8KQ11N7chd+8+Dm++LiCJrTjUgKnsRYhwijj/h03AaIndDyjg1lVs6Zbh7BO28f8XhRA471A2IqpWy2zMm8eVe/7nwPOm1ed3Y2OL9liGIQow3ci+hLSYkHee3RLddErUh8aXeNrj4ui/lfSxqkuMgcCOJH8Yrw6xyEUj/EqoIum/2v54M8Vn2Lk67kKCrHuakbhyLfrSf65lfNrG8Yqif3287O+nWagFI9Dn/1P9T/JvusIcbj7mzZ8h+tEs1aXGfTim8++cG1VB9708AjTiCmT0ynRi7521YzOhMZH0uCAXbZhuOmbERQY3cKKnylwvsemqYf3HprkMzR4RSubNyBLp/CK1ZV12Sh93AODblhu2u0ni1Muc72LU6V1Lginny4VpD8A8v/fR4Ao+BCZHjksDKP7xUTZJd7MijIkg4HHRR0jxpfMgPYppSuLIUbwIwm87QwPmHcW/f1+UPvdY1mxPSUlY+0EV8EKE50='}, 'verbose': True, 'job_id': '4975248', 'tube': 'smithi', 'suite_branch': 'vstart_runner', 'priority': 110, 'os_version': '8.1', 'first_in_suite': False, 'branch': 'vstart_runner', 'suite': 'fs:basic_functional', 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'email': None, 'archive_path': '/home/teuthworker/archive/xiubli-2020-04-22_13:44:16-fs:basic_functional-vstart_runner-distro-basic-smithi/4975248', 'description': 'fs:basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-bitmap.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/client-recovery.yaml}', 'nuke-on-error': True, 'repo': 'git://git.ceph.com/ceph-ci.git', 'last_in_suite': False, 'machine_type': 'smithi', 'teuthology_branch': 'master', 'sha1': '360f904aafdcc5437adf7f1a18be626f09ffd78d', 'name': 'xiubli-2020-04-22_13:44:16-fs:basic_functional-vstart_runner-distro-basic-smithi', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.1'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.2', 'client.3']], 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'overrides': {'ceph': {'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'but it is still running', 'slow request', 'MDS_CLIENT_LATE_RELEASE', 't responding to mclientcaps'], 'conf': {'mds': {'mds debug frag': True, 'mds bal split bits': 3, 'mds bal split size': 100, 'debug mds': 20, 'mds bal merge size': 5, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds op complaint time': 180, 'mds debug scatterstat': True, 'osd op complaint time': 180, 'mds verify scatter': True}, 'client': {'debug ms': 1, 'pid file': '', 'debug client': 20, 'client mount timeout': 600}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 20, 'bluestore fsck on mount': True, 'debug osd': 25, 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'debug rocksdb': 10, 'debug journal': 20, 'bluestore allocator': 'bitmap', 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'bdev async discard': True, 'osd failsafe full ratio': 0.95, 'bluestore block size': 96636764160, 'debug filestore': 20, 'bdev enable discard': True, 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon op complaint time': 120, 'debug ms': 1}}, 'fs': 'xfs', 'sha1': '360f904aafdcc5437adf7f1a18be626f09ffd78d'}, 'thrashosds': {'bdev_inject_crash_probability': 0.5, 'bdev_inject_crash': 2}, 'ceph-deploy': {'fs': 'xfs', 'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'mon osd full ratio': 0.9, 'mon osd backfillfull_ratio': 0.85, 'bluestore fsck on mount': True, 'mon osd nearfull ratio': 0.8, 'debug bluestore': 20, 'debug bluefs': 20, 'osd objectstore': 'bluestore', 'bluestore block size': 96636764160, 'debug rocksdb': 10, 'bdev enable discard': True, 'osd failsafe full ratio': 0.95, 'bdev async discard': True}}}, 'install': {'ceph': {'sha1': '360f904aafdcc5437adf7f1a18be626f09ffd78d'}}, 'admin_socket': {'branch': 'vstart_runner'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'workunit': {'sha1': '360f904aafdcc5437adf7f1a18be626f09ffd78d', 'branch': 'vstart_runner'}}, 'os_type': 'rhel', 'suite_sha1': '360f904aafdcc5437adf7f1a18be626f09ffd78d'} 2020-04-22T14:01:18.335 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:18.397 INFO:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-04-22T14:01:18.439 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:18.453 INFO:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-04-22T14:01:18.507 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:18.521 INFO:teuthology.orchestra.run.smithi086:> sudo install -d -m0777 -- /var/run/ceph 2020-04-22T14:01:18.563 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:18.577 INFO:teuthology.orchestra.run.smithi103:> sudo install -d -m0777 -- /var/run/ceph 2020-04-22T14:01:18.710 DEBUG:teuthology.orchestra.remote:smithi103:/scratch_devs is 72B 2020-04-22T14:01:18.757 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2020-04-22T14:01:18.758 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:18.771 INFO:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-04-22T14:01:18.824 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-1 2020-04-22T14:01:18.825 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-22T14:01:18.825 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 6h/6d Inode: 99100 Links: 1 2020-04-22T14:01:18.825 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-22T14:01:18.825 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2020-04-22T14:01:18.826 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2020-04-22 14:01:10.947597500 +0000 2020-04-22T14:01:18.826 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2020-04-22 13:59:11.180855478 +0000 2020-04-22T14:01:18.826 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2020-04-22 13:59:11.180855478 +0000 2020-04-22T14:01:18.826 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: - 2020-04-22T14:01:18.838 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2020-04-22T14:01:18.838 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2020-04-22T14:01:18.838 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000230179 s, 2.2 MB/s 2020-04-22T14:01:18.841 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:18.894 INFO:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-04-22T14:01:18.947 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-04-22T14:01:18.947 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-22T14:01:18.948 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 6h/6d Inode: 101495 Links: 1 2020-04-22T14:01:18.948 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-22T14:01:18.948 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2020-04-22T14:01:18.948 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2020-04-22 14:01:10.947597500 +0000 2020-04-22T14:01:18.948 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2020-04-22 13:59:11.555848240 +0000 2020-04-22T14:01:18.948 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2020-04-22 13:59:11.555848240 +0000 2020-04-22T14:01:18.948 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: - 2020-04-22T14:01:18.961 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2020-04-22T14:01:18.961 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2020-04-22T14:01:18.961 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000185371 s, 2.8 MB/s 2020-04-22T14:01:18.963 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:19.016 INFO:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-04-22T14:01:19.069 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-3 2020-04-22T14:01:19.069 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-22T14:01:19.070 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 6h/6d Inode: 99973 Links: 1 2020-04-22T14:01:19.070 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-22T14:01:19.070 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2020-04-22T14:01:19.070 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2020-04-22 14:01:10.947597500 +0000 2020-04-22T14:01:19.070 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2020-04-22 13:59:11.907841386 +0000 2020-04-22T14:01:19.070 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2020-04-22 13:59:11.907841386 +0000 2020-04-22T14:01:19.070 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: - 2020-04-22T14:01:19.083 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2020-04-22T14:01:19.083 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2020-04-22T14:01:19.083 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000216137 s, 2.4 MB/s 2020-04-22T14:01:19.085 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:19.139 INFO:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-04-22T14:01:19.194 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-4 2020-04-22T14:01:19.194 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-22T14:01:19.194 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 6h/6d Inode: 100747 Links: 1 2020-04-22T14:01:19.194 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-22T14:01:19.194 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2020-04-22T14:01:19.194 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2020-04-22 14:01:10.948597481 +0000 2020-04-22T14:01:19.195 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2020-04-22 13:59:12.248834746 +0000 2020-04-22T14:01:19.195 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2020-04-22 13:59:12.248834746 +0000 2020-04-22T14:01:19.195 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: - 2020-04-22T14:01:19.207 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2020-04-22T14:01:19.207 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2020-04-22T14:01:19.207 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000203826 s, 2.5 MB/s 2020-04-22T14:01:19.209 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-22T14:01:19.229 DEBUG:teuthology.orchestra.remote:smithi086:/scratch_devs is 72B 2020-04-22T14:01:19.278 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2020-04-22T14:01:19.278 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:19.293 INFO:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-04-22T14:01:19.348 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-1 2020-04-22T14:01:19.349 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-22T14:01:19.349 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 6h/6d Inode: 97071 Links: 1 2020-04-22T14:01:19.349 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-22T14:01:19.349 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2020-04-22T14:01:19.349 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2020-04-22 14:01:05.882606342 +0000 2020-04-22T14:01:19.349 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2020-04-22 13:59:02.774221385 +0000 2020-04-22T14:01:19.349 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2020-04-22 13:59:02.774221385 +0000 2020-04-22T14:01:19.350 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: - 2020-04-22T14:01:19.363 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2020-04-22T14:01:19.364 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2020-04-22T14:01:19.364 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.00024012 s, 2.1 MB/s 2020-04-22T14:01:19.366 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:19.422 INFO:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-04-22T14:01:19.477 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-04-22T14:01:19.477 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-22T14:01:19.478 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 6h/6d Inode: 97133 Links: 1 2020-04-22T14:01:19.478 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-22T14:01:19.478 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2020-04-22T14:01:19.478 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2020-04-22 14:01:05.882606342 +0000 2020-04-22T14:01:19.478 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2020-04-22 13:59:03.105213612 +0000 2020-04-22T14:01:19.478 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2020-04-22 13:59:03.105213612 +0000 2020-04-22T14:01:19.478 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: - 2020-04-22T14:01:19.491 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2020-04-22T14:01:19.491 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2020-04-22T14:01:19.491 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000192628 s, 2.7 MB/s 2020-04-22T14:01:19.494 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:19.549 INFO:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-04-22T14:01:19.604 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-3 2020-04-22T14:01:19.604 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-22T14:01:19.604 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 6h/6d Inode: 98167 Links: 1 2020-04-22T14:01:19.604 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-22T14:01:19.605 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2020-04-22T14:01:19.605 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2020-04-22 14:01:05.883606319 +0000 2020-04-22T14:01:19.605 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2020-04-22 13:59:03.446205604 +0000 2020-04-22T14:01:19.605 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2020-04-22 13:59:03.446205604 +0000 2020-04-22T14:01:19.605 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: - 2020-04-22T14:01:19.617 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2020-04-22T14:01:19.618 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2020-04-22T14:01:19.618 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000208716 s, 2.5 MB/s 2020-04-22T14:01:19.620 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:19.681 INFO:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-04-22T14:01:19.736 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-4 2020-04-22T14:01:19.738 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-22T14:01:19.738 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 6h/6d Inode: 99997 Links: 1 2020-04-22T14:01:19.738 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-22T14:01:19.739 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2020-04-22T14:01:19.739 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2020-04-22 14:01:05.883606319 +0000 2020-04-22T14:01:19.739 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2020-04-22 13:59:03.823196750 +0000 2020-04-22T14:01:19.739 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2020-04-22 13:59:03.823196750 +0000 2020-04-22T14:01:19.739 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: - 2020-04-22T14:01:19.749 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2020-04-22T14:01:19.750 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2020-04-22T14:01:19.750 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000225089 s, 2.3 MB/s 2020-04-22T14:01:19.752 INFO:tasks.ceph:osd dev map: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-22T14:01:19.752 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi103.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi086.front.sepia.ceph.com'): {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'}} 2020-04-22T14:01:19.752 INFO:tasks.ceph:Generating config... 2020-04-22T14:01:19.754 INFO:tasks.ceph:[mds] mds debug frag = True 2020-04-22T14:01:19.754 INFO:tasks.ceph:[mds] mds bal split bits = 3 2020-04-22T14:01:19.754 INFO:tasks.ceph:[mds] mds bal split size = 100 2020-04-22T14:01:19.754 INFO:tasks.ceph:[mds] debug mds = 20 2020-04-22T14:01:19.754 INFO:tasks.ceph:[mds] mds bal merge size = 5 2020-04-22T14:01:19.754 INFO:tasks.ceph:[mds] debug ms = 1 2020-04-22T14:01:19.754 INFO:tasks.ceph:[mds] mds bal frag = True 2020-04-22T14:01:19.755 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2020-04-22T14:01:19.755 INFO:tasks.ceph:[mds] mds op complaint time = 180 2020-04-22T14:01:19.755 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2020-04-22T14:01:19.755 INFO:tasks.ceph:[mds] osd op complaint time = 180 2020-04-22T14:01:19.755 INFO:tasks.ceph:[mds] mds verify scatter = True 2020-04-22T14:01:19.755 INFO:tasks.ceph:[client] debug ms = 1 2020-04-22T14:01:19.755 INFO:tasks.ceph:[client] pid file = 2020-04-22T14:01:19.755 INFO:tasks.ceph:[client] debug client = 20 2020-04-22T14:01:19.756 INFO:tasks.ceph:[client] client mount timeout = 600 2020-04-22T14:01:19.756 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2020-04-22T14:01:19.756 INFO:tasks.ceph:[osd] debug ms = 20 2020-04-22T14:01:19.756 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2020-04-22T14:01:19.756 INFO:tasks.ceph:[osd] debug osd = 25 2020-04-22T14:01:19.756 INFO:tasks.ceph:[osd] debug bluestore = 20 2020-04-22T14:01:19.756 INFO:tasks.ceph:[osd] debug bluefs = 20 2020-04-22T14:01:19.757 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2020-04-22T14:01:19.757 INFO:tasks.ceph:[osd] debug rocksdb = 10 2020-04-22T14:01:19.757 INFO:tasks.ceph:[osd] debug journal = 20 2020-04-22T14:01:19.757 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2020-04-22T14:01:19.757 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2020-04-22T14:01:19.757 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2020-04-22T14:01:19.757 INFO:tasks.ceph:[osd] bdev async discard = True 2020-04-22T14:01:19.757 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2020-04-22T14:01:19.758 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2020-04-22T14:01:19.758 INFO:tasks.ceph:[osd] debug filestore = 20 2020-04-22T14:01:19.758 INFO:tasks.ceph:[osd] bdev enable discard = True 2020-04-22T14:01:19.758 INFO:tasks.ceph:[osd] osd op complaint time = 180 2020-04-22T14:01:19.759 INFO:tasks.ceph:[mgr] debug ms = 1 2020-04-22T14:01:19.759 INFO:tasks.ceph:[mgr] debug mgr = 20 2020-04-22T14:01:19.759 INFO:tasks.ceph:[mon] debug mon = 20 2020-04-22T14:01:19.759 INFO:tasks.ceph:[mon] debug paxos = 20 2020-04-22T14:01:19.759 INFO:tasks.ceph:[mon] mon op complaint time = 120 2020-04-22T14:01:19.759 INFO:tasks.ceph:[mon] debug ms = 1 2020-04-22T14:01:19.760 INFO:tasks.ceph:Setting up mon.a... 2020-04-22T14:01:19.760 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:19.774 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2020-04-22T14:01:19.877 INFO:teuthology.orchestra.run.smithi103.stdout:creating /etc/ceph/ceph.keyring 2020-04-22T14:01:19.879 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:19.893 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2020-04-22T14:01:19.977 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:20.032 INFO:teuthology.orchestra.run.smithi103:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-04-22T14:01:20.099 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.103'), ('mon.c', '[v2:172.21.15.86:3301,v1:172.21.15.86:6790]'), ('mon.b', '172.21.15.86')] 2020-04-22T14:01:20.099 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:20.152 INFO:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.103 --addv c '[v2:172.21.15.86:3301,v1:172.21.15.86:6790]' --add b 172.21.15.86 --print /home/ubuntu/cephtest/ceph.monmap 2020-04-22T14:01:20.229 INFO:teuthology.orchestra.run.smithi103.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2020-04-22T14:01:20.229 INFO:teuthology.orchestra.run.smithi103.stdout:monmaptool: generated fsid 6802606a-35a0-4e54-95ba-51f48cd433bb 2020-04-22T14:01:20.230 INFO:teuthology.orchestra.run.smithi103.stdout:epoch 0 2020-04-22T14:01:20.230 INFO:teuthology.orchestra.run.smithi103.stdout:fsid 6802606a-35a0-4e54-95ba-51f48cd433bb 2020-04-22T14:01:20.230 INFO:teuthology.orchestra.run.smithi103.stdout:last_changed 2020-04-22T14:01:20.228158+0000 2020-04-22T14:01:20.230 INFO:teuthology.orchestra.run.smithi103.stdout:created 2020-04-22T14:01:20.228158+0000 2020-04-22T14:01:20.230 INFO:teuthology.orchestra.run.smithi103.stdout:min_mon_release 0 (unknown) 2020-04-22T14:01:20.230 INFO:teuthology.orchestra.run.smithi103.stdout:0: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.a 2020-04-22T14:01:20.230 INFO:teuthology.orchestra.run.smithi103.stdout:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2020-04-22T14:01:20.231 INFO:teuthology.orchestra.run.smithi103.stdout:2: [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] mon.c 2020-04-22T14:01:20.231 INFO:teuthology.orchestra.run.smithi103.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2020-04-22T14:01:20.232 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 6802606a-35a0-4e54-95ba-51f48cd433bb... 2020-04-22T14:01:20.233 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:20.248 INFO:teuthology.orchestra.run.smithi086:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-04-22T14:01:20.291 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:20.305 INFO:teuthology.orchestra.run.smithi103:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-04-22T14:01:20.349 INFO:teuthology.orchestra.run.smithi086.stdout:[global] 2020-04-22T14:01:20.349 INFO:teuthology.orchestra.run.smithi086.stdout: chdir = "" 2020-04-22T14:01:20.349 INFO:teuthology.orchestra.run.smithi086.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-04-22T14:01:20.349 INFO:teuthology.orchestra.run.smithi086.stdout: auth supported = cephx 2020-04-22T14:01:20.349 INFO:teuthology.orchestra.run.smithi086.stdout: 2020-04-22T14:01:20.349 INFO:teuthology.orchestra.run.smithi086.stdout: filestore xattr use omap = true 2020-04-22T14:01:20.350 INFO:teuthology.orchestra.run.smithi086.stdout: 2020-04-22T14:01:20.350 INFO:teuthology.orchestra.run.smithi086.stdout: mon clock drift allowed = 1.000 2020-04-22T14:01:20.350 INFO:teuthology.orchestra.run.smithi086.stdout: 2020-04-22T14:01:20.350 INFO:teuthology.orchestra.run.smithi086.stdout: osd crush chooseleaf type = 0 2020-04-22T14:01:20.350 INFO:teuthology.orchestra.run.smithi086.stdout: auth debug = true 2020-04-22T14:01:20.350 INFO:teuthology.orchestra.run.smithi086.stdout: 2020-04-22T14:01:20.350 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on old message = true 2020-04-22T14:01:20.351 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on bug = true 2020-04-22T14:01:20.351 INFO:teuthology.orchestra.run.smithi086.stdout: 2020-04-22T14:01:20.351 INFO:teuthology.orchestra.run.smithi086.stdout: mon max pg per osd = 10000 # >= luminous 2020-04-22T14:01:20.351 INFO:teuthology.orchestra.run.smithi086.stdout: mon pg warn max object skew = 0 2020-04-22T14:01:20.351 INFO:teuthology.orchestra.run.smithi086.stdout: 2020-04-22T14:01:20.351 INFO:teuthology.orchestra.run.smithi086.stdout: # disable pg_autoscaler by default for new pools 2020-04-22T14:01:20.351 INFO:teuthology.orchestra.run.smithi086.stdout: osd_pool_default_pg_autoscale_mode = off 2020-04-22T14:01:20.352 INFO:teuthology.orchestra.run.smithi086.stdout: 2020-04-22T14:01:20.352 INFO:teuthology.orchestra.run.smithi086.stdout: osd pool default size = 2 2020-04-22T14:01:20.352 INFO:teuthology.orchestra.run.smithi086.stdout: 2020-04-22T14:01:20.352 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd allow primary affinity = true 2020-04-22T14:01:20.352 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd allow pg remap = true 2020-04-22T14:01:20.352 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on legacy crush tunables = false 2020-04-22T14:01:20.352 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on crush straw calc version zero = false 2020-04-22T14:01:20.352 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on no sortbitwise = false 2020-04-22T14:01:20.353 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on osd down out interval zero = false 2020-04-22T14:01:20.353 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on too few osds = false 2020-04-22T14:01:20.353 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-04-22T14:01:20.355 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_pool_no_redundancy = false 2020-04-22T14:01:20.355 INFO:teuthology.orchestra.run.smithi086.stdout: mon_allow_pool_size_one = true 2020-04-22T14:01:20.356 INFO:teuthology.orchestra.run.smithi086.stdout: 2020-04-22T14:01:20.356 INFO:teuthology.orchestra.run.smithi086.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-04-22T14:01:20.356 INFO:teuthology.orchestra.run.smithi086.stdout: 2020-04-22T14:01:20.356 INFO:teuthology.orchestra.run.smithi086.stdout: osd default data pool replay window = 5 2020-04-22T14:01:20.356 INFO:teuthology.orchestra.run.smithi086.stdout: 2020-04-22T14:01:20.356 INFO:teuthology.orchestra.run.smithi086.stdout: mon allow pool delete = true 2020-04-22T14:01:20.356 INFO:teuthology.orchestra.run.smithi086.stdout: 2020-04-22T14:01:20.357 INFO:teuthology.orchestra.run.smithi086.stdout: mon cluster log file level = debug 2020-04-22T14:01:20.357 INFO:teuthology.orchestra.run.smithi086.stdout: debug asserts on shutdown = true 2020-04-22T14:01:20.357 INFO:teuthology.orchestra.run.smithi086.stdout: mon host = "172.21.15.103,[v2:172.21.15.86:3301,v1:172.21.15.86:6790],172.21.15.86" 2020-04-22T14:01:20.357 INFO:teuthology.orchestra.run.smithi086.stdout: fsid = 6802606a-35a0-4e54-95ba-51f48cd433bb 2020-04-22T14:01:20.357 INFO:teuthology.orchestra.run.smithi086.stdout: 2020-04-22T14:01:20.357 INFO:teuthology.orchestra.run.smithi086.stdout:[osd] 2020-04-22T14:01:20.357 INFO:teuthology.orchestra.run.smithi086.stdout: osd journal size = 100 2020-04-22T14:01:20.357 INFO:teuthology.orchestra.run.smithi086.stdout: 2020-04-22T14:01:20.358 INFO:teuthology.orchestra.run.smithi086.stdout: osd scrub load threshold = 5.0 2020-04-22T14:01:20.358 INFO:teuthology.orchestra.run.smithi086.stdout: osd scrub max interval = 600 2020-04-22T14:01:20.358 INFO:teuthology.orchestra.run.smithi086.stdout: 2020-04-22T14:01:20.358 INFO:teuthology.orchestra.run.smithi086.stdout: osd recover clone overlap = true 2020-04-22T14:01:20.358 INFO:teuthology.orchestra.run.smithi086.stdout: osd recovery max chunk = 1048576 2020-04-22T14:01:20.358 INFO:teuthology.orchestra.run.smithi086.stdout: 2020-04-22T14:01:20.358 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug shutdown = true 2020-04-22T14:01:20.359 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug op order = true 2020-04-22T14:01:20.359 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug verify stray on activate = true 2020-04-22T14:01:20.359 INFO:teuthology.orchestra.run.smithi086.stdout: 2020-04-22T14:01:20.359 INFO:teuthology.orchestra.run.smithi086.stdout: osd open classes on start = true 2020-04-22T14:01:20.359 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug pg log writeout = true 2020-04-22T14:01:20.359 INFO:teuthology.orchestra.run.smithi086.stdout: 2020-04-22T14:01:20.359 INFO:teuthology.orchestra.run.smithi086.stdout: osd deep scrub update digest min age = 30 2020-04-22T14:01:20.359 INFO:teuthology.orchestra.run.smithi086.stdout: 2020-04-22T14:01:20.360 INFO:teuthology.orchestra.run.smithi086.stdout: osd map max advance = 10 2020-04-22T14:01:20.360 INFO:teuthology.orchestra.run.smithi086.stdout: 2020-04-22T14:01:20.360 INFO:teuthology.orchestra.run.smithi086.stdout: journal zero on create = true 2020-04-22T14:01:20.360 INFO:teuthology.orchestra.run.smithi086.stdout: 2020-04-22T14:01:20.360 INFO:teuthology.orchestra.run.smithi086.stdout: filestore ondisk finisher threads = 3 2020-04-22T14:01:20.360 INFO:teuthology.orchestra.run.smithi086.stdout: filestore apply finisher threads = 3 2020-04-22T14:01:20.360 INFO:teuthology.orchestra.run.smithi086.stdout: 2020-04-22T14:01:20.361 INFO:teuthology.orchestra.run.smithi086.stdout: bdev debug aio = true 2020-04-22T14:01:20.361 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug misdirected ops = true 2020-04-22T14:01:20.361 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd full ratio = 0.9 2020-04-22T14:01:20.361 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 20 2020-04-22T14:01:20.361 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore fsck on mount = True 2020-04-22T14:01:20.361 INFO:teuthology.orchestra.run.smithi086.stdout: debug osd = 25 2020-04-22T14:01:20.361 INFO:teuthology.orchestra.run.smithi086.stdout: debug bluestore = 20 2020-04-22T14:01:20.361 INFO:teuthology.orchestra.run.smithi086.stdout: debug bluefs = 20 2020-04-22T14:01:20.362 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd backfillfull_ratio = 0.85 2020-04-22T14:01:20.362 INFO:teuthology.orchestra.run.smithi086.stdout: debug rocksdb = 10 2020-04-22T14:01:20.362 INFO:teuthology.orchestra.run.smithi086.stdout: debug journal = 20 2020-04-22T14:01:20.362 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore allocator = bitmap 2020-04-22T14:01:20.362 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd nearfull ratio = 0.8 2020-04-22T14:01:20.362 INFO:teuthology.orchestra.run.smithi086.stdout: osd objectstore = bluestore 2020-04-22T14:01:20.362 INFO:teuthology.orchestra.run.smithi086.stdout: bdev async discard = True 2020-04-22T14:01:20.363 INFO:teuthology.orchestra.run.smithi086.stdout: osd failsafe full ratio = 0.95 2020-04-22T14:01:20.363 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore block size = 96636764160 2020-04-22T14:01:20.363 INFO:teuthology.orchestra.run.smithi086.stdout: debug filestore = 20 2020-04-22T14:01:20.363 INFO:teuthology.orchestra.run.smithi086.stdout: bdev enable discard = True 2020-04-22T14:01:20.363 INFO:teuthology.orchestra.run.smithi086.stdout: osd op complaint time = 180 2020-04-22T14:01:20.363 INFO:teuthology.orchestra.run.smithi086.stdout: 2020-04-22T14:01:20.364 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr] 2020-04-22T14:01:20.364 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2020-04-22T14:01:20.364 INFO:teuthology.orchestra.run.smithi086.stdout: debug mgr = 20 2020-04-22T14:01:20.364 INFO:teuthology.orchestra.run.smithi086.stdout: debug mon = 20 2020-04-22T14:01:20.364 INFO:teuthology.orchestra.run.smithi086.stdout: debug auth = 20 2020-04-22T14:01:20.365 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min pgs per osd = 4 2020-04-22T14:01:20.365 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min bytes per osd = 10 2020-04-22T14:01:20.365 INFO:teuthology.orchestra.run.smithi086.stdout: mgr/telemetry/nag = false 2020-04-22T14:01:20.365 INFO:teuthology.orchestra.run.smithi086.stdout: 2020-04-22T14:01:20.365 INFO:teuthology.orchestra.run.smithi086.stdout:[mon] 2020-04-22T14:01:20.366 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2020-04-22T14:01:20.366 INFO:teuthology.orchestra.run.smithi086.stdout: debug mon = 20 2020-04-22T14:01:20.366 INFO:teuthology.orchestra.run.smithi086.stdout: debug paxos = 20 2020-04-22T14:01:20.366 INFO:teuthology.orchestra.run.smithi086.stdout: debug auth = 20 2020-04-22T14:01:20.366 INFO:teuthology.orchestra.run.smithi086.stdout: mon data avail warn = 5 2020-04-22T14:01:20.366 INFO:teuthology.orchestra.run.smithi086.stdout: mon mgr mkfs grace = 240 2020-04-22T14:01:20.366 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min pgs per osd = 4 2020-04-22T14:01:20.366 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd reporter subtree level = osd 2020-04-22T14:01:20.367 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd prime pg temp = true 2020-04-22T14:01:20.367 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min bytes per osd = 10 2020-04-22T14:01:20.367 INFO:teuthology.orchestra.run.smithi086.stdout: mon op complaint time = 120 2020-04-22T14:01:20.367 INFO:teuthology.orchestra.run.smithi086.stdout: 2020-04-22T14:01:20.367 INFO:teuthology.orchestra.run.smithi086.stdout:[client] 2020-04-22T14:01:20.367 INFO:teuthology.orchestra.run.smithi086.stdout: rgw cache enabled = true 2020-04-22T14:01:20.367 INFO:teuthology.orchestra.run.smithi086.stdout: rgw enable ops log = true 2020-04-22T14:01:20.368 INFO:teuthology.orchestra.run.smithi086.stdout: rgw enable usage log = true 2020-04-22T14:01:20.368 INFO:teuthology.orchestra.run.smithi086.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-04-22T14:01:20.368 INFO:teuthology.orchestra.run.smithi086.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-04-22T14:01:20.368 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2020-04-22T14:01:20.368 INFO:teuthology.orchestra.run.smithi086.stdout: pid file = "" 2020-04-22T14:01:20.368 INFO:teuthology.orchestra.run.smithi086.stdout: debug client = 20 2020-04-22T14:01:20.368 INFO:teuthology.orchestra.run.smithi086.stdout: client mount timeout = 600 2020-04-22T14:01:20.368 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.a] 2020-04-22T14:01:20.369 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.c] 2020-04-22T14:01:20.369 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.b] 2020-04-22T14:01:20.369 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.a] 2020-04-22T14:01:20.369 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.b] 2020-04-22T14:01:20.369 INFO:teuthology.orchestra.run.smithi086.stdout:[mds] 2020-04-22T14:01:20.369 INFO:teuthology.orchestra.run.smithi086.stdout: mds debug frag = True 2020-04-22T14:01:20.369 INFO:teuthology.orchestra.run.smithi086.stdout: mds bal split bits = 3 2020-04-22T14:01:20.369 INFO:teuthology.orchestra.run.smithi086.stdout: mds bal split size = 100 2020-04-22T14:01:20.370 INFO:teuthology.orchestra.run.smithi086.stdout: debug mds = 20 2020-04-22T14:01:20.370 INFO:teuthology.orchestra.run.smithi086.stdout: mds bal merge size = 5 2020-04-22T14:01:20.370 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2020-04-22T14:01:20.370 INFO:teuthology.orchestra.run.smithi086.stdout: mds bal frag = True 2020-04-22T14:01:20.370 INFO:teuthology.orchestra.run.smithi086.stdout: mds bal fragment size max = 10000 2020-04-22T14:01:20.370 INFO:teuthology.orchestra.run.smithi086.stdout: mds op complaint time = 180 2020-04-22T14:01:20.370 INFO:teuthology.orchestra.run.smithi086.stdout: mds debug scatterstat = True 2020-04-22T14:01:20.370 INFO:teuthology.orchestra.run.smithi086.stdout: osd op complaint time = 180 2020-04-22T14:01:20.371 INFO:teuthology.orchestra.run.smithi086.stdout: mds verify scatter = True 2020-04-22T14:01:20.398 INFO:teuthology.orchestra.run.smithi103.stdout:[global] 2020-04-22T14:01:20.398 INFO:teuthology.orchestra.run.smithi103.stdout: chdir = "" 2020-04-22T14:01:20.398 INFO:teuthology.orchestra.run.smithi103.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-04-22T14:01:20.399 INFO:teuthology.orchestra.run.smithi103.stdout: auth supported = cephx 2020-04-22T14:01:20.399 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:01:20.399 INFO:teuthology.orchestra.run.smithi103.stdout: filestore xattr use omap = true 2020-04-22T14:01:20.399 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:01:20.399 INFO:teuthology.orchestra.run.smithi103.stdout: mon clock drift allowed = 1.000 2020-04-22T14:01:20.399 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:01:20.399 INFO:teuthology.orchestra.run.smithi103.stdout: osd crush chooseleaf type = 0 2020-04-22T14:01:20.400 INFO:teuthology.orchestra.run.smithi103.stdout: auth debug = true 2020-04-22T14:01:20.400 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:01:20.400 INFO:teuthology.orchestra.run.smithi103.stdout: ms die on old message = true 2020-04-22T14:01:20.400 INFO:teuthology.orchestra.run.smithi103.stdout: ms die on bug = true 2020-04-22T14:01:20.400 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:01:20.400 INFO:teuthology.orchestra.run.smithi103.stdout: mon max pg per osd = 10000 # >= luminous 2020-04-22T14:01:20.400 INFO:teuthology.orchestra.run.smithi103.stdout: mon pg warn max object skew = 0 2020-04-22T14:01:20.401 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:01:20.401 INFO:teuthology.orchestra.run.smithi103.stdout: # disable pg_autoscaler by default for new pools 2020-04-22T14:01:20.401 INFO:teuthology.orchestra.run.smithi103.stdout: osd_pool_default_pg_autoscale_mode = off 2020-04-22T14:01:20.401 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:01:20.401 INFO:teuthology.orchestra.run.smithi103.stdout: osd pool default size = 2 2020-04-22T14:01:20.401 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:01:20.401 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd allow primary affinity = true 2020-04-22T14:01:20.401 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd allow pg remap = true 2020-04-22T14:01:20.402 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on legacy crush tunables = false 2020-04-22T14:01:20.402 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on crush straw calc version zero = false 2020-04-22T14:01:20.402 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on no sortbitwise = false 2020-04-22T14:01:20.402 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on osd down out interval zero = false 2020-04-22T14:01:20.402 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on too few osds = false 2020-04-22T14:01:20.402 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-04-22T14:01:20.402 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_pool_no_redundancy = false 2020-04-22T14:01:20.402 INFO:teuthology.orchestra.run.smithi103.stdout: mon_allow_pool_size_one = true 2020-04-22T14:01:20.403 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:01:20.403 INFO:teuthology.orchestra.run.smithi103.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-04-22T14:01:20.410 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:01:20.410 INFO:teuthology.orchestra.run.smithi103.stdout: osd default data pool replay window = 5 2020-04-22T14:01:20.410 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:01:20.410 INFO:teuthology.orchestra.run.smithi103.stdout: mon allow pool delete = true 2020-04-22T14:01:20.411 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:01:20.411 INFO:teuthology.orchestra.run.smithi103.stdout: mon cluster log file level = debug 2020-04-22T14:01:20.411 INFO:teuthology.orchestra.run.smithi103.stdout: debug asserts on shutdown = true 2020-04-22T14:01:20.411 INFO:teuthology.orchestra.run.smithi103.stdout: mon host = "172.21.15.103,[v2:172.21.15.86:3301,v1:172.21.15.86:6790],172.21.15.86" 2020-04-22T14:01:20.411 INFO:teuthology.orchestra.run.smithi103.stdout: fsid = 6802606a-35a0-4e54-95ba-51f48cd433bb 2020-04-22T14:01:20.411 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:01:20.411 INFO:teuthology.orchestra.run.smithi103.stdout:[osd] 2020-04-22T14:01:20.412 INFO:teuthology.orchestra.run.smithi103.stdout: osd journal size = 100 2020-04-22T14:01:20.412 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:01:20.412 INFO:teuthology.orchestra.run.smithi103.stdout: osd scrub load threshold = 5.0 2020-04-22T14:01:20.412 INFO:teuthology.orchestra.run.smithi103.stdout: osd scrub max interval = 600 2020-04-22T14:01:20.412 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:01:20.412 INFO:teuthology.orchestra.run.smithi103.stdout: osd recover clone overlap = true 2020-04-22T14:01:20.412 INFO:teuthology.orchestra.run.smithi103.stdout: osd recovery max chunk = 1048576 2020-04-22T14:01:20.413 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:01:20.413 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug shutdown = true 2020-04-22T14:01:20.413 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug op order = true 2020-04-22T14:01:20.413 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug verify stray on activate = true 2020-04-22T14:01:20.413 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:01:20.413 INFO:teuthology.orchestra.run.smithi103.stdout: osd open classes on start = true 2020-04-22T14:01:20.413 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug pg log writeout = true 2020-04-22T14:01:20.413 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:01:20.414 INFO:teuthology.orchestra.run.smithi103.stdout: osd deep scrub update digest min age = 30 2020-04-22T14:01:20.414 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:01:20.414 INFO:teuthology.orchestra.run.smithi103.stdout: osd map max advance = 10 2020-04-22T14:01:20.414 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:01:20.414 INFO:teuthology.orchestra.run.smithi103.stdout: journal zero on create = true 2020-04-22T14:01:20.414 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:01:20.414 INFO:teuthology.orchestra.run.smithi103.stdout: filestore ondisk finisher threads = 3 2020-04-22T14:01:20.414 INFO:teuthology.orchestra.run.smithi103.stdout: filestore apply finisher threads = 3 2020-04-22T14:01:20.415 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:01:20.415 INFO:teuthology.orchestra.run.smithi103.stdout: bdev debug aio = true 2020-04-22T14:01:20.415 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug misdirected ops = true 2020-04-22T14:01:20.415 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd full ratio = 0.9 2020-04-22T14:01:20.415 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 20 2020-04-22T14:01:20.415 INFO:teuthology.orchestra.run.smithi103.stdout: bluestore fsck on mount = True 2020-04-22T14:01:20.415 INFO:teuthology.orchestra.run.smithi103.stdout: debug osd = 25 2020-04-22T14:01:20.416 INFO:teuthology.orchestra.run.smithi103.stdout: debug bluestore = 20 2020-04-22T14:01:20.416 INFO:teuthology.orchestra.run.smithi103.stdout: debug bluefs = 20 2020-04-22T14:01:20.416 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd backfillfull_ratio = 0.85 2020-04-22T14:01:20.416 INFO:teuthology.orchestra.run.smithi103.stdout: debug rocksdb = 10 2020-04-22T14:01:20.416 INFO:teuthology.orchestra.run.smithi103.stdout: debug journal = 20 2020-04-22T14:01:20.416 INFO:teuthology.orchestra.run.smithi103.stdout: bluestore allocator = bitmap 2020-04-22T14:01:20.416 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd nearfull ratio = 0.8 2020-04-22T14:01:20.416 INFO:teuthology.orchestra.run.smithi103.stdout: osd objectstore = bluestore 2020-04-22T14:01:20.417 INFO:teuthology.orchestra.run.smithi103.stdout: bdev async discard = True 2020-04-22T14:01:20.417 INFO:teuthology.orchestra.run.smithi103.stdout: osd failsafe full ratio = 0.95 2020-04-22T14:01:20.417 INFO:teuthology.orchestra.run.smithi103.stdout: bluestore block size = 96636764160 2020-04-22T14:01:20.417 INFO:teuthology.orchestra.run.smithi103.stdout: debug filestore = 20 2020-04-22T14:01:20.417 INFO:teuthology.orchestra.run.smithi103.stdout: bdev enable discard = True 2020-04-22T14:01:20.417 INFO:teuthology.orchestra.run.smithi103.stdout: osd op complaint time = 180 2020-04-22T14:01:20.417 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:01:20.418 INFO:teuthology.orchestra.run.smithi103.stdout:[mgr] 2020-04-22T14:01:20.418 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2020-04-22T14:01:20.418 INFO:teuthology.orchestra.run.smithi103.stdout: debug mgr = 20 2020-04-22T14:01:20.418 INFO:teuthology.orchestra.run.smithi103.stdout: debug mon = 20 2020-04-22T14:01:20.418 INFO:teuthology.orchestra.run.smithi103.stdout: debug auth = 20 2020-04-22T14:01:20.418 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min pgs per osd = 4 2020-04-22T14:01:20.418 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min bytes per osd = 10 2020-04-22T14:01:20.418 INFO:teuthology.orchestra.run.smithi103.stdout: mgr/telemetry/nag = false 2020-04-22T14:01:20.419 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:01:20.419 INFO:teuthology.orchestra.run.smithi103.stdout:[mon] 2020-04-22T14:01:20.419 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2020-04-22T14:01:20.419 INFO:teuthology.orchestra.run.smithi103.stdout: debug mon = 20 2020-04-22T14:01:20.419 INFO:teuthology.orchestra.run.smithi103.stdout: debug paxos = 20 2020-04-22T14:01:20.419 INFO:teuthology.orchestra.run.smithi103.stdout: debug auth = 20 2020-04-22T14:01:20.419 INFO:teuthology.orchestra.run.smithi103.stdout: mon data avail warn = 5 2020-04-22T14:01:20.419 INFO:teuthology.orchestra.run.smithi103.stdout: mon mgr mkfs grace = 240 2020-04-22T14:01:20.420 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min pgs per osd = 4 2020-04-22T14:01:20.420 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd reporter subtree level = osd 2020-04-22T14:01:20.420 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd prime pg temp = true 2020-04-22T14:01:20.421 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min bytes per osd = 10 2020-04-22T14:01:20.421 INFO:teuthology.orchestra.run.smithi103.stdout: mon op complaint time = 120 2020-04-22T14:01:20.421 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:01:20.421 INFO:teuthology.orchestra.run.smithi103.stdout:[client] 2020-04-22T14:01:20.421 INFO:teuthology.orchestra.run.smithi103.stdout: rgw cache enabled = true 2020-04-22T14:01:20.421 INFO:teuthology.orchestra.run.smithi103.stdout: rgw enable ops log = true 2020-04-22T14:01:20.421 INFO:teuthology.orchestra.run.smithi103.stdout: rgw enable usage log = true 2020-04-22T14:01:20.422 INFO:teuthology.orchestra.run.smithi103.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-04-22T14:01:20.422 INFO:teuthology.orchestra.run.smithi103.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-04-22T14:01:20.422 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2020-04-22T14:01:20.422 INFO:teuthology.orchestra.run.smithi103.stdout: pid file = "" 2020-04-22T14:01:20.422 INFO:teuthology.orchestra.run.smithi103.stdout: debug client = 20 2020-04-22T14:01:20.422 INFO:teuthology.orchestra.run.smithi103.stdout: client mount timeout = 600 2020-04-22T14:01:20.422 INFO:teuthology.orchestra.run.smithi103.stdout:[mon.a] 2020-04-22T14:01:20.423 INFO:teuthology.orchestra.run.smithi103.stdout:[mon.c] 2020-04-22T14:01:20.423 INFO:teuthology.orchestra.run.smithi103.stdout:[mon.b] 2020-04-22T14:01:20.423 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.a] 2020-04-22T14:01:20.423 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.b] 2020-04-22T14:01:20.423 INFO:teuthology.orchestra.run.smithi103.stdout:[mds] 2020-04-22T14:01:20.423 INFO:teuthology.orchestra.run.smithi103.stdout: mds debug frag = True 2020-04-22T14:01:20.423 INFO:teuthology.orchestra.run.smithi103.stdout: mds bal split bits = 3 2020-04-22T14:01:20.423 INFO:teuthology.orchestra.run.smithi103.stdout: mds bal split size = 100 2020-04-22T14:01:20.424 INFO:teuthology.orchestra.run.smithi103.stdout: debug mds = 20 2020-04-22T14:01:20.424 INFO:teuthology.orchestra.run.smithi103.stdout: mds bal merge size = 5 2020-04-22T14:01:20.424 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2020-04-22T14:01:20.424 INFO:teuthology.orchestra.run.smithi103.stdout: mds bal frag = True 2020-04-22T14:01:20.424 INFO:teuthology.orchestra.run.smithi103.stdout: mds bal fragment size max = 10000 2020-04-22T14:01:20.424 INFO:teuthology.orchestra.run.smithi103.stdout: mds op complaint time = 180 2020-04-22T14:01:20.424 INFO:teuthology.orchestra.run.smithi103.stdout: mds debug scatterstat = True 2020-04-22T14:01:20.424 INFO:teuthology.orchestra.run.smithi103.stdout: osd op complaint time = 180 2020-04-22T14:01:20.425 INFO:teuthology.orchestra.run.smithi103.stdout: mds verify scatter = True 2020-04-22T14:01:20.426 INFO:tasks.ceph:Creating admin key on mon.a... 2020-04-22T14:01:20.426 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:20.439 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2020-04-22T14:01:20.529 INFO:tasks.ceph:Copying monmap to all nodes... 2020-04-22T14:01:20.546 DEBUG:teuthology.orchestra.remote:smithi103:/etc/ceph/ceph.keyring is 206B 2020-04-22T14:01:20.640 DEBUG:teuthology.orchestra.remote:smithi103:/home/ubuntu/cephtest/ceph.monmap is 379B 2020-04-22T14:01:20.688 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi103.front.sepia.ceph.com 2020-04-22T14:01:20.688 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:20.709 INFO:teuthology.orchestra.run.smithi103:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-04-22T14:01:20.800 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:20.862 INFO:teuthology.orchestra.run.smithi103:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-04-22T14:01:20.945 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi086.front.sepia.ceph.com 2020-04-22T14:01:20.945 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:20.962 INFO:teuthology.orchestra.run.smithi086:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-04-22T14:01:21.062 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:21.117 INFO:teuthology.orchestra.run.smithi086:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-04-22T14:01:21.206 INFO:tasks.ceph:Setting up mon nodes... 2020-04-22T14:01:21.206 INFO:tasks.ceph:Setting up mgr nodes... 2020-04-22T14:01:21.206 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:21.226 INFO:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2020-04-22T14:01:21.321 INFO:teuthology.orchestra.run.smithi103.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2020-04-22T14:01:21.323 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:21.342 INFO:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2020-04-22T14:01:21.443 INFO:teuthology.orchestra.run.smithi086.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2020-04-22T14:01:21.446 INFO:tasks.ceph:Setting up mds nodes... 2020-04-22T14:01:21.446 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:21.460 INFO:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2020-04-22T14:01:21.554 INFO:teuthology.orchestra.run.smithi103.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2020-04-22T14:01:21.556 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:21.569 INFO:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2020-04-22T14:01:21.636 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:21.651 INFO:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2020-04-22T14:01:21.749 INFO:teuthology.orchestra.run.smithi086.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2020-04-22T14:01:21.751 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:21.764 INFO:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2020-04-22T14:01:21.831 INFO:tasks.ceph_client:Setting up client nodes... 2020-04-22T14:01:21.832 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:21.846 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2020-04-22T14:01:21.925 INFO:teuthology.orchestra.run.smithi103.stdout:creating /etc/ceph/ceph.client.0.keyring 2020-04-22T14:01:21.941 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:21.994 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2020-04-22T14:01:22.079 INFO:teuthology.orchestra.run.smithi103.stdout:creating /etc/ceph/ceph.client.1.keyring 2020-04-22T14:01:22.095 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:22.109 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2020-04-22T14:01:22.191 INFO:teuthology.orchestra.run.smithi086.stdout:creating /etc/ceph/ceph.client.2.keyring 2020-04-22T14:01:22.207 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:22.262 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2020-04-22T14:01:22.342 INFO:teuthology.orchestra.run.smithi086.stdout:creating /etc/ceph/ceph.client.3.keyring 2020-04-22T14:01:22.357 INFO:tasks.ceph:Running mkfs on osd nodes... 2020-04-22T14:01:22.358 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi103.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi086.front.sepia.ceph.com'): {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'}} 2020-04-22T14:01:22.358 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:22.372 INFO:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2020-04-22T14:01:22.443 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-22T14:01:22.443 INFO:tasks.ceph:role: osd.0 2020-04-22T14:01:22.443 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi103.front.sepia.ceph.com 2020-04-22T14:01:22.443 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:22.496 INFO:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-04-22T14:01:23.017 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-04-22T14:01:23.017 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-22T14:01:23.018 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-22T14:01:23.018 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 2020-04-22T14:01:23.018 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-22T14:01:23.018 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2020-04-22T14:01:23.018 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-22T14:01:23.018 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-22T14:01:23.018 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-22T14:01:23.019 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-22T14:01:23.020 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2020-04-22T14:01:23.020 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:23.034 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0 2020-04-22T14:01:23.175 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:23.189 INFO:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2020-04-22T14:01:23.260 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:23.313 INFO:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2020-04-22T14:01:23.381 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-22T14:01:23.381 INFO:tasks.ceph:role: osd.1 2020-04-22T14:01:23.382 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi103.front.sepia.ceph.com 2020-04-22T14:01:23.382 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:23.435 INFO:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-04-22T14:01:23.945 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-04-22T14:01:23.945 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-22T14:01:23.945 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-22T14:01:23.945 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 2020-04-22T14:01:23.946 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-22T14:01:23.946 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2020-04-22T14:01:23.946 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-22T14:01:23.946 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-22T14:01:23.946 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-22T14:01:23.946 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-22T14:01:23.947 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2020-04-22T14:01:23.947 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:23.962 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1 2020-04-22T14:01:24.074 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:24.088 INFO:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2020-04-22T14:01:24.161 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:24.215 INFO:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2020-04-22T14:01:24.283 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-22T14:01:24.283 INFO:tasks.ceph:role: osd.2 2020-04-22T14:01:24.283 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi103.front.sepia.ceph.com 2020-04-22T14:01:24.283 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:24.336 INFO:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-04-22T14:01:24.865 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-04-22T14:01:24.865 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-22T14:01:24.866 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-22T14:01:24.866 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 2020-04-22T14:01:24.866 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-22T14:01:24.866 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2020-04-22T14:01:24.866 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-22T14:01:24.866 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-22T14:01:24.866 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-22T14:01:24.867 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-22T14:01:24.867 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2020-04-22T14:01:24.868 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:24.881 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2020-04-22T14:01:25.018 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:25.032 INFO:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2020-04-22T14:01:25.102 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:25.155 INFO:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2020-04-22T14:01:25.221 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-22T14:01:25.221 INFO:tasks.ceph:role: osd.3 2020-04-22T14:01:25.222 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi103.front.sepia.ceph.com 2020-04-22T14:01:25.222 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:25.281 INFO:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-04-22T14:01:25.782 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-04-22T14:01:25.782 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-22T14:01:25.782 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-22T14:01:25.782 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 2020-04-22T14:01:25.782 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-22T14:01:25.783 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2020-04-22T14:01:25.783 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-22T14:01:25.783 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-22T14:01:25.783 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-22T14:01:25.783 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-22T14:01:25.784 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2020-04-22T14:01:25.784 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:25.797 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2020-04-22T14:01:25.899 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:25.912 INFO:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2020-04-22T14:01:25.988 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:26.042 INFO:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-22T14:01:26.125 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:01:26.123+0000 7f429feffec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2020-04-22T14:01:26.129 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:01:26.127+0000 7f429feffec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2020-04-22T14:01:26.129 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:01:26.127+0000 7f429feffec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-04-22T14:01:26.129 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:01:26.127+0000 7f429feffec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-04-22T14:01:26.129 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:01:26.127+0000 7f429feffec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-04-22T14:01:26.130 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:01:26.127+0000 7f429feffec0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2020-04-22T14:01:26.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:01:26.144+0000 7f429feffec0 -1 freelist read_size_meta_from_db missing size meta in DB 2020-04-22T14:01:28.463 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:28.479 INFO:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-04-22T14:01:28.549 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:28.605 INFO:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-22T14:01:28.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:01:28.689+0000 7fcdf2fd6ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2020-04-22T14:01:28.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:01:28.689+0000 7fcdf2fd6ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2020-04-22T14:01:28.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:01:28.689+0000 7fcdf2fd6ec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-04-22T14:01:28.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:01:28.689+0000 7fcdf2fd6ec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-04-22T14:01:28.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:01:28.689+0000 7fcdf2fd6ec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-04-22T14:01:28.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:01:28.690+0000 7fcdf2fd6ec0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2020-04-22T14:01:28.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:01:28.700+0000 7fcdf2fd6ec0 -1 freelist read_size_meta_from_db missing size meta in DB 2020-04-22T14:01:31.028 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:31.044 INFO:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-04-22T14:01:31.116 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:31.172 INFO:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-22T14:01:31.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:01:31.258+0000 7f5f4161bec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2020-04-22T14:01:31.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:01:31.258+0000 7f5f4161bec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2020-04-22T14:01:31.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:01:31.259+0000 7f5f4161bec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-04-22T14:01:31.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:01:31.259+0000 7f5f4161bec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-04-22T14:01:31.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:01:31.259+0000 7f5f4161bec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-04-22T14:01:31.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:01:31.259+0000 7f5f4161bec0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2020-04-22T14:01:31.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:01:31.274+0000 7f5f4161bec0 -1 freelist read_size_meta_from_db missing size meta in DB 2020-04-22T14:01:33.603 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:33.620 INFO:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-04-22T14:01:33.691 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:33.747 INFO:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-22T14:01:33.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:01:33.831+0000 7f3d93228ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2020-04-22T14:01:33.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:01:33.831+0000 7f3d93228ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2020-04-22T14:01:33.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:01:33.831+0000 7f3d93228ec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-04-22T14:01:33.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:01:33.831+0000 7f3d93228ec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-04-22T14:01:33.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:01:33.831+0000 7f3d93228ec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-04-22T14:01:33.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:01:33.831+0000 7f3d93228ec0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2020-04-22T14:01:33.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:01:33.846+0000 7f3d93228ec0 -1 freelist read_size_meta_from_db missing size meta in DB 2020-04-22T14:01:36.188 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:36.208 INFO:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-04-22T14:01:36.280 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:36.296 INFO:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2020-04-22T14:01:36.368 INFO:tasks.ceph:roles_to_devs: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-22T14:01:36.368 INFO:tasks.ceph:role: osd.4 2020-04-22T14:01:36.368 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi086.front.sepia.ceph.com 2020-04-22T14:01:36.368 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:36.423 INFO:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-04-22T14:01:36.954 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-04-22T14:01:36.954 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-22T14:01:36.954 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-22T14:01:36.955 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 2020-04-22T14:01:36.955 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-22T14:01:36.955 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2020-04-22T14:01:36.955 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-22T14:01:36.955 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-22T14:01:36.955 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-22T14:01:36.955 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-22T14:01:36.956 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2020-04-22T14:01:36.956 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:36.973 INFO:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4 2020-04-22T14:01:37.120 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:37.134 INFO:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2020-04-22T14:01:37.208 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:37.261 INFO:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2020-04-22T14:01:37.335 INFO:tasks.ceph:roles_to_devs: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-22T14:01:37.335 INFO:tasks.ceph:role: osd.5 2020-04-22T14:01:37.336 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi086.front.sepia.ceph.com 2020-04-22T14:01:37.337 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:37.392 INFO:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-04-22T14:01:37.911 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-04-22T14:01:37.911 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-22T14:01:37.911 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-22T14:01:37.911 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 2020-04-22T14:01:37.912 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-22T14:01:37.912 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2020-04-22T14:01:37.912 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-22T14:01:37.912 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-22T14:01:37.912 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-22T14:01:37.912 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-22T14:01:37.913 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2020-04-22T14:01:37.914 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:37.933 INFO:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5 2020-04-22T14:01:38.041 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:38.055 INFO:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2020-04-22T14:01:38.126 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:38.179 INFO:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2020-04-22T14:01:38.245 INFO:tasks.ceph:roles_to_devs: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-22T14:01:38.246 INFO:tasks.ceph:role: osd.6 2020-04-22T14:01:38.246 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi086.front.sepia.ceph.com 2020-04-22T14:01:38.246 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:38.301 INFO:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-04-22T14:01:38.824 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-04-22T14:01:38.824 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-22T14:01:38.824 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-22T14:01:38.824 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 2020-04-22T14:01:38.825 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-22T14:01:38.825 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2020-04-22T14:01:38.825 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-22T14:01:38.825 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-22T14:01:38.825 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-22T14:01:38.825 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-22T14:01:38.826 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2020-04-22T14:01:38.826 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:38.839 INFO:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2020-04-22T14:01:38.988 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:39.001 INFO:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2020-04-22T14:01:39.071 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:39.124 INFO:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2020-04-22T14:01:39.191 INFO:tasks.ceph:roles_to_devs: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-22T14:01:39.191 INFO:tasks.ceph:role: osd.7 2020-04-22T14:01:39.192 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi086.front.sepia.ceph.com 2020-04-22T14:01:39.192 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:39.244 INFO:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-04-22T14:01:39.740 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-04-22T14:01:39.740 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-22T14:01:39.740 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-22T14:01:39.740 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 2020-04-22T14:01:39.740 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-22T14:01:39.741 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2020-04-22T14:01:39.741 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-22T14:01:39.741 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-22T14:01:39.741 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-22T14:01:39.741 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-22T14:01:39.742 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2020-04-22T14:01:39.742 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:39.756 INFO:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7 2020-04-22T14:01:39.870 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:39.884 INFO:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2020-04-22T14:01:39.954 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:40.007 INFO:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-22T14:01:40.091 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:01:40.087+0000 7f7472798ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2020-04-22T14:01:40.091 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:01:40.087+0000 7f7472798ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2020-04-22T14:01:40.091 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:01:40.087+0000 7f7472798ec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-04-22T14:01:40.091 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:01:40.087+0000 7f7472798ec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-04-22T14:01:40.092 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:01:40.087+0000 7f7472798ec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-04-22T14:01:40.092 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:01:40.088+0000 7f7472798ec0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2020-04-22T14:01:40.109 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:01:40.106+0000 7f7472798ec0 -1 freelist read_size_meta_from_db missing size meta in DB 2020-04-22T14:01:42.429 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:42.485 INFO:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-04-22T14:01:42.558 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:42.613 INFO:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-22T14:01:42.702 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:01:42.699+0000 7f807f718ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2020-04-22T14:01:42.702 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:01:42.699+0000 7f807f718ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2020-04-22T14:01:42.702 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:01:42.699+0000 7f807f718ec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-04-22T14:01:42.702 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:01:42.699+0000 7f807f718ec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-04-22T14:01:42.702 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:01:42.699+0000 7f807f718ec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-04-22T14:01:42.703 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:01:42.700+0000 7f807f718ec0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2020-04-22T14:01:42.716 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:01:42.714+0000 7f807f718ec0 -1 freelist read_size_meta_from_db missing size meta in DB 2020-04-22T14:01:45.048 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:45.070 INFO:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-04-22T14:01:45.140 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:45.196 INFO:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-22T14:01:45.284 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:01:45.281+0000 7f1682ec7ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2020-04-22T14:01:45.284 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:01:45.281+0000 7f1682ec7ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2020-04-22T14:01:45.284 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:01:45.281+0000 7f1682ec7ec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-04-22T14:01:45.284 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:01:45.281+0000 7f1682ec7ec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-04-22T14:01:45.284 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:01:45.281+0000 7f1682ec7ec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-04-22T14:01:45.285 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:01:45.282+0000 7f1682ec7ec0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2020-04-22T14:01:45.299 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:01:45.297+0000 7f1682ec7ec0 -1 freelist read_size_meta_from_db missing size meta in DB 2020-04-22T14:01:47.625 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:47.641 INFO:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-04-22T14:01:47.718 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:47.774 INFO:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-22T14:01:47.867 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:01:47.859+0000 7f6055d1cec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2020-04-22T14:01:47.867 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:01:47.859+0000 7f6055d1cec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2020-04-22T14:01:47.867 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:01:47.859+0000 7f6055d1cec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-04-22T14:01:47.867 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:01:47.859+0000 7f6055d1cec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-04-22T14:01:47.867 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:01:47.859+0000 7f6055d1cec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-04-22T14:01:47.868 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:01:47.860+0000 7f6055d1cec0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2020-04-22T14:01:47.885 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:01:47.875+0000 7f6055d1cec0 -1 freelist read_size_meta_from_db missing size meta in DB 2020-04-22T14:01:48.336 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:48.353 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:01:48.395 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:48.412 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:01:50.210 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:50.226 INFO:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-04-22T14:01:50.297 INFO:tasks.ceph:Reading keys from all nodes... 2020-04-22T14:01:50.298 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:50.317 INFO:teuthology.orchestra.run.smithi103:> mktemp 2020-04-22T14:01:50.374 INFO:teuthology.orchestra.run.smithi103.stdout:/tmp/tmp.M5rpVcWPdL 2020-04-22T14:01:50.374 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:50.429 INFO:teuthology.orchestra.run.smithi103:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.M5rpVcWPdL 2020-04-22T14:01:50.501 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:50.559 INFO:teuthology.orchestra.run.smithi103:> sudo chmod 0666 /tmp/tmp.M5rpVcWPdL 2020-04-22T14:01:50.710 DEBUG:teuthology.orchestra.remote:smithi103:/tmp/tmp.M5rpVcWPdL is 56B 2020-04-22T14:01:50.758 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:50.773 INFO:teuthology.orchestra.run.smithi103:> rm -fr /tmp/tmp.M5rpVcWPdL 2020-04-22T14:01:50.827 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:50.882 INFO:teuthology.orchestra.run.smithi103:> mktemp 2020-04-22T14:01:50.936 INFO:teuthology.orchestra.run.smithi103.stdout:/tmp/tmp.irqsMI2g8p 2020-04-22T14:01:50.937 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:50.991 INFO:teuthology.orchestra.run.smithi103:> sudo cp /var/lib/ceph/mds/ceph-a/keyring /tmp/tmp.irqsMI2g8p 2020-04-22T14:01:51.062 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:51.116 INFO:teuthology.orchestra.run.smithi103:> sudo chmod 0666 /tmp/tmp.irqsMI2g8p 2020-04-22T14:01:51.241 DEBUG:teuthology.orchestra.remote:smithi103:/tmp/tmp.irqsMI2g8p is 56B 2020-04-22T14:01:51.298 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:51.311 INFO:teuthology.orchestra.run.smithi103:> rm -fr /tmp/tmp.irqsMI2g8p 2020-04-22T14:01:51.364 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:51.417 INFO:teuthology.orchestra.run.smithi103:> mktemp 2020-04-22T14:01:51.470 INFO:teuthology.orchestra.run.smithi103.stdout:/tmp/tmp.t2wUfW5oSX 2020-04-22T14:01:51.470 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:51.525 INFO:teuthology.orchestra.run.smithi103:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.t2wUfW5oSX 2020-04-22T14:01:51.592 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:51.647 INFO:teuthology.orchestra.run.smithi103:> sudo chmod 0666 /tmp/tmp.t2wUfW5oSX 2020-04-22T14:01:51.774 DEBUG:teuthology.orchestra.remote:smithi103:/tmp/tmp.t2wUfW5oSX is 56B 2020-04-22T14:01:51.822 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:51.835 INFO:teuthology.orchestra.run.smithi103:> rm -fr /tmp/tmp.t2wUfW5oSX 2020-04-22T14:01:51.889 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:51.942 INFO:teuthology.orchestra.run.smithi103:> mktemp 2020-04-22T14:01:51.995 INFO:teuthology.orchestra.run.smithi103.stdout:/tmp/tmp.OgT56fSatX 2020-04-22T14:01:51.996 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:52.050 INFO:teuthology.orchestra.run.smithi103:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.OgT56fSatX 2020-04-22T14:01:52.116 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:52.169 INFO:teuthology.orchestra.run.smithi103:> sudo chmod 0666 /tmp/tmp.OgT56fSatX 2020-04-22T14:01:52.295 DEBUG:teuthology.orchestra.remote:smithi103:/tmp/tmp.OgT56fSatX is 56B 2020-04-22T14:01:52.342 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:52.356 INFO:teuthology.orchestra.run.smithi103:> rm -fr /tmp/tmp.OgT56fSatX 2020-04-22T14:01:52.409 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:52.462 INFO:teuthology.orchestra.run.smithi103:> mktemp 2020-04-22T14:01:52.517 INFO:teuthology.orchestra.run.smithi103.stdout:/tmp/tmp.xJez7ZJp98 2020-04-22T14:01:52.517 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:52.571 INFO:teuthology.orchestra.run.smithi103:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.xJez7ZJp98 2020-04-22T14:01:52.638 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:52.691 INFO:teuthology.orchestra.run.smithi103:> sudo chmod 0666 /tmp/tmp.xJez7ZJp98 2020-04-22T14:01:52.832 DEBUG:teuthology.orchestra.remote:smithi103:/tmp/tmp.xJez7ZJp98 is 56B 2020-04-22T14:01:52.885 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:52.898 INFO:teuthology.orchestra.run.smithi103:> rm -fr /tmp/tmp.xJez7ZJp98 2020-04-22T14:01:52.967 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:53.021 INFO:teuthology.orchestra.run.smithi103:> mktemp 2020-04-22T14:01:53.079 INFO:teuthology.orchestra.run.smithi103.stdout:/tmp/tmp.LroE1lrAyc 2020-04-22T14:01:53.080 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:53.133 INFO:teuthology.orchestra.run.smithi103:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.LroE1lrAyc 2020-04-22T14:01:53.199 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:53.254 INFO:teuthology.orchestra.run.smithi103:> sudo chmod 0666 /tmp/tmp.LroE1lrAyc 2020-04-22T14:01:53.377 DEBUG:teuthology.orchestra.remote:smithi103:/tmp/tmp.LroE1lrAyc is 56B 2020-04-22T14:01:53.425 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:53.438 INFO:teuthology.orchestra.run.smithi103:> rm -fr /tmp/tmp.LroE1lrAyc 2020-04-22T14:01:53.491 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:53.507 INFO:teuthology.orchestra.run.smithi086:> mktemp 2020-04-22T14:01:53.564 INFO:teuthology.orchestra.run.smithi086.stdout:/tmp/tmp.kD9bqunmwO 2020-04-22T14:01:53.565 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:53.619 INFO:teuthology.orchestra.run.smithi086:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.kD9bqunmwO 2020-04-22T14:01:53.690 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:53.745 INFO:teuthology.orchestra.run.smithi086:> sudo chmod 0666 /tmp/tmp.kD9bqunmwO 2020-04-22T14:01:53.873 DEBUG:teuthology.orchestra.remote:smithi086:/tmp/tmp.kD9bqunmwO is 56B 2020-04-22T14:01:53.919 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:53.933 INFO:teuthology.orchestra.run.smithi086:> rm -fr /tmp/tmp.kD9bqunmwO 2020-04-22T14:01:53.990 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:54.050 INFO:teuthology.orchestra.run.smithi086:> mktemp 2020-04-22T14:01:54.104 INFO:teuthology.orchestra.run.smithi086.stdout:/tmp/tmp.E4JsvfUWSp 2020-04-22T14:01:54.105 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:54.158 INFO:teuthology.orchestra.run.smithi086:> sudo cp /var/lib/ceph/mds/ceph-b/keyring /tmp/tmp.E4JsvfUWSp 2020-04-22T14:01:54.226 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:54.291 INFO:teuthology.orchestra.run.smithi086:> sudo chmod 0666 /tmp/tmp.E4JsvfUWSp 2020-04-22T14:01:54.417 DEBUG:teuthology.orchestra.remote:smithi086:/tmp/tmp.E4JsvfUWSp is 56B 2020-04-22T14:01:54.465 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:54.478 INFO:teuthology.orchestra.run.smithi086:> rm -fr /tmp/tmp.E4JsvfUWSp 2020-04-22T14:01:54.537 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:54.592 INFO:teuthology.orchestra.run.smithi086:> mktemp 2020-04-22T14:01:54.645 INFO:teuthology.orchestra.run.smithi086.stdout:/tmp/tmp.kupTyTJUZG 2020-04-22T14:01:54.646 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:54.727 INFO:teuthology.orchestra.run.smithi086:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.kupTyTJUZG 2020-04-22T14:01:54.795 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:54.849 INFO:teuthology.orchestra.run.smithi086:> sudo chmod 0666 /tmp/tmp.kupTyTJUZG 2020-04-22T14:01:54.972 DEBUG:teuthology.orchestra.remote:smithi086:/tmp/tmp.kupTyTJUZG is 56B 2020-04-22T14:01:55.019 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:55.033 INFO:teuthology.orchestra.run.smithi086:> rm -fr /tmp/tmp.kupTyTJUZG 2020-04-22T14:01:55.088 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:55.141 INFO:teuthology.orchestra.run.smithi086:> mktemp 2020-04-22T14:01:55.196 INFO:teuthology.orchestra.run.smithi086.stdout:/tmp/tmp.4AjpRP1kjR 2020-04-22T14:01:55.196 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:55.259 INFO:teuthology.orchestra.run.smithi086:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.4AjpRP1kjR 2020-04-22T14:01:55.326 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:55.379 INFO:teuthology.orchestra.run.smithi086:> sudo chmod 0666 /tmp/tmp.4AjpRP1kjR 2020-04-22T14:01:55.542 DEBUG:teuthology.orchestra.remote:smithi086:/tmp/tmp.4AjpRP1kjR is 56B 2020-04-22T14:01:55.590 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:55.605 INFO:teuthology.orchestra.run.smithi086:> rm -fr /tmp/tmp.4AjpRP1kjR 2020-04-22T14:01:55.657 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:55.711 INFO:teuthology.orchestra.run.smithi086:> mktemp 2020-04-22T14:01:55.764 INFO:teuthology.orchestra.run.smithi086.stdout:/tmp/tmp.waItBwavx2 2020-04-22T14:01:55.765 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:55.842 INFO:teuthology.orchestra.run.smithi086:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.waItBwavx2 2020-04-22T14:01:55.913 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:55.973 INFO:teuthology.orchestra.run.smithi086:> sudo chmod 0666 /tmp/tmp.waItBwavx2 2020-04-22T14:01:56.107 DEBUG:teuthology.orchestra.remote:smithi086:/tmp/tmp.waItBwavx2 is 56B 2020-04-22T14:01:56.158 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:56.171 INFO:teuthology.orchestra.run.smithi086:> rm -fr /tmp/tmp.waItBwavx2 2020-04-22T14:01:56.226 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:56.285 INFO:teuthology.orchestra.run.smithi086:> mktemp 2020-04-22T14:01:56.353 INFO:teuthology.orchestra.run.smithi086.stdout:/tmp/tmp.LovNP5BuJf 2020-04-22T14:01:56.354 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:56.419 INFO:teuthology.orchestra.run.smithi086:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.LovNP5BuJf 2020-04-22T14:01:56.477 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:56.530 INFO:teuthology.orchestra.run.smithi086:> sudo chmod 0666 /tmp/tmp.LovNP5BuJf 2020-04-22T14:01:56.655 DEBUG:teuthology.orchestra.remote:smithi086:/tmp/tmp.LovNP5BuJf is 56B 2020-04-22T14:01:56.707 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:56.719 INFO:teuthology.orchestra.run.smithi086:> rm -fr /tmp/tmp.LovNP5BuJf 2020-04-22T14:01:56.791 DEBUG:teuthology.orchestra.remote:smithi103:/etc/ceph/ceph.client.0.keyring is 59B 2020-04-22T14:01:56.898 DEBUG:teuthology.orchestra.remote:smithi103:/etc/ceph/ceph.client.1.keyring is 59B 2020-04-22T14:01:56.944 DEBUG:teuthology.orchestra.remote:smithi086:/etc/ceph/ceph.client.2.keyring is 59B 2020-04-22T14:01:57.055 DEBUG:teuthology.orchestra.remote:smithi086:/etc/ceph/ceph.client.3.keyring is 59B 2020-04-22T14:01:57.103 INFO:tasks.ceph:Adding keys to all mons... 2020-04-22T14:01:57.104 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:57.116 INFO:teuthology.orchestra.run.smithi086:> sudo tee -a /etc/ceph/ceph.keyring 2020-04-22T14:01:57.158 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:57.174 INFO:teuthology.orchestra.run.smithi103:> sudo tee -a /etc/ceph/ceph.keyring 2020-04-22T14:01:57.217 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr.y] 2020-04-22T14:01:57.218 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQAxTqBeX8AXExAAhh/N+/ogdKlxmkveSM60+g== 2020-04-22T14:01:57.218 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.a] 2020-04-22T14:01:57.219 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQAxTqBeliD5IBAAjC7UikdEP8FeE2rKs/ympw== 2020-04-22T14:01:57.219 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.0] 2020-04-22T14:01:57.219 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQA2TqBehMJiBxAARaWo32QGx49PxImGafnOFw== 2020-04-22T14:01:57.220 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.1] 2020-04-22T14:01:57.220 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQA4TqBeiAAcKRAAEHuaqbsB+NLUTSgFOCOFZg== 2020-04-22T14:01:57.220 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.2] 2020-04-22T14:01:57.220 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQA7TqBebeRzDxAAsjRyvJektq7MQ+334kU+UQ== 2020-04-22T14:01:57.220 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.3] 2020-04-22T14:01:57.221 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQA9TqBehxmSMRAATZ0o/ZnxHp2m/tqLmv6JwA== 2020-04-22T14:01:57.221 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr.x] 2020-04-22T14:01:57.221 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQAxTqBe3YVhGhAAWAf6f9sV3bzoucBBPS3j2g== 2020-04-22T14:01:57.221 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.b] 2020-04-22T14:01:57.221 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQAxTqBepkqQLBAA4aMKXxROQugglhm4aBd1Iw== 2020-04-22T14:01:57.222 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.4] 2020-04-22T14:01:57.222 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBETqBePwJSBRAAXgMKuX3EILi3gy8QzR4cig== 2020-04-22T14:01:57.222 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.5] 2020-04-22T14:01:57.222 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBGTqBe5l++KRAAHIWG6bBnru2EVXv/drAL0g== 2020-04-22T14:01:57.222 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.6] 2020-04-22T14:01:57.222 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBJTqBe88rTEBAAO2Z78NZLTYIbBpYovBSHVQ== 2020-04-22T14:01:57.223 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.7] 2020-04-22T14:01:57.223 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBLTqBeGNFIMxAARIXhPNM6xurdnDv8+xZqUw== 2020-04-22T14:01:57.223 INFO:teuthology.orchestra.run.smithi086.stdout:[client.0] 2020-04-22T14:01:57.223 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQAxTqBe5ooUNxAA9zBtv6+i3Xl9iYtRl4xKGg== 2020-04-22T14:01:57.223 INFO:teuthology.orchestra.run.smithi086.stdout:[client.1] 2020-04-22T14:01:57.223 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQAyTqBe0bioBBAAVpoQouA/QICwqRoaFbjkiA== 2020-04-22T14:01:57.224 INFO:teuthology.orchestra.run.smithi086.stdout:[client.2] 2020-04-22T14:01:57.224 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQAyTqBemwpXCxAAObNL96zS67nMEe4MLjrEtw== 2020-04-22T14:01:57.224 INFO:teuthology.orchestra.run.smithi086.stdout:[client.3] 2020-04-22T14:01:57.224 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQAyTqBemGxNFBAAlqvB8FeZbMRwvzVjBpH/tA== 2020-04-22T14:01:57.243 INFO:teuthology.orchestra.run.smithi103.stdout:[mgr.y] 2020-04-22T14:01:57.244 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQAxTqBeX8AXExAAhh/N+/ogdKlxmkveSM60+g== 2020-04-22T14:01:57.244 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.a] 2020-04-22T14:01:57.244 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQAxTqBeliD5IBAAjC7UikdEP8FeE2rKs/ympw== 2020-04-22T14:01:57.244 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.0] 2020-04-22T14:01:57.244 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQA2TqBehMJiBxAARaWo32QGx49PxImGafnOFw== 2020-04-22T14:01:57.245 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.1] 2020-04-22T14:01:57.245 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQA4TqBeiAAcKRAAEHuaqbsB+NLUTSgFOCOFZg== 2020-04-22T14:01:57.245 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.2] 2020-04-22T14:01:57.245 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQA7TqBebeRzDxAAsjRyvJektq7MQ+334kU+UQ== 2020-04-22T14:01:57.246 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.3] 2020-04-22T14:01:57.246 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQA9TqBehxmSMRAATZ0o/ZnxHp2m/tqLmv6JwA== 2020-04-22T14:01:57.246 INFO:teuthology.orchestra.run.smithi103.stdout:[mgr.x] 2020-04-22T14:01:57.246 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQAxTqBe3YVhGhAAWAf6f9sV3bzoucBBPS3j2g== 2020-04-22T14:01:57.246 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.b] 2020-04-22T14:01:57.246 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQAxTqBepkqQLBAA4aMKXxROQugglhm4aBd1Iw== 2020-04-22T14:01:57.247 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.4] 2020-04-22T14:01:57.247 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBETqBePwJSBRAAXgMKuX3EILi3gy8QzR4cig== 2020-04-22T14:01:57.247 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.5] 2020-04-22T14:01:57.247 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBGTqBe5l++KRAAHIWG6bBnru2EVXv/drAL0g== 2020-04-22T14:01:57.248 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.6] 2020-04-22T14:01:57.248 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBJTqBe88rTEBAAO2Z78NZLTYIbBpYovBSHVQ== 2020-04-22T14:01:57.248 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.7] 2020-04-22T14:01:57.248 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBLTqBeGNFIMxAARIXhPNM6xurdnDv8+xZqUw== 2020-04-22T14:01:57.249 INFO:teuthology.orchestra.run.smithi103.stdout:[client.0] 2020-04-22T14:01:57.249 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQAxTqBe5ooUNxAA9zBtv6+i3Xl9iYtRl4xKGg== 2020-04-22T14:01:57.249 INFO:teuthology.orchestra.run.smithi103.stdout:[client.1] 2020-04-22T14:01:57.250 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQAyTqBe0bioBBAAVpoQouA/QICwqRoaFbjkiA== 2020-04-22T14:01:57.250 INFO:teuthology.orchestra.run.smithi103.stdout:[client.2] 2020-04-22T14:01:57.250 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQAyTqBemwpXCxAAObNL96zS67nMEe4MLjrEtw== 2020-04-22T14:01:57.250 INFO:teuthology.orchestra.run.smithi103.stdout:[client.3] 2020-04-22T14:01:57.251 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQAyTqBemGxNFBAAlqvB8FeZbMRwvzVjBpH/tA== 2020-04-22T14:01:57.252 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:57.282 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-04-22T14:01:57.325 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:57.341 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-04-22T14:01:57.435 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:57.449 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-04-22T14:01:57.492 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:57.507 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-04-22T14:01:57.600 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:57.614 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-22T14:01:57.658 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:57.677 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-22T14:01:57.765 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:57.779 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-22T14:01:57.822 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:57.843 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-22T14:01:57.932 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:57.946 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-22T14:01:57.988 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:58.002 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-22T14:01:58.090 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:58.104 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-22T14:01:58.147 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:58.161 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-22T14:01:58.249 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:58.263 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-04-22T14:01:58.305 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:58.319 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-04-22T14:01:58.407 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:58.421 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-04-22T14:01:58.464 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:58.478 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-04-22T14:01:58.568 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:58.584 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-22T14:01:58.626 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:58.642 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-22T14:01:58.730 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:58.744 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-22T14:01:58.786 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:58.800 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-22T14:01:58.888 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:58.902 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-22T14:01:58.944 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:58.958 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-22T14:01:59.047 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:59.060 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-22T14:01:59.104 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:59.117 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-22T14:01:59.207 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:59.221 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-04-22T14:01:59.273 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:59.291 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-04-22T14:01:59.380 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:59.394 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-04-22T14:01:59.436 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:59.450 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-04-22T14:01:59.542 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:59.555 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-04-22T14:01:59.599 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:59.612 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-04-22T14:01:59.703 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:01:59.716 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-04-22T14:01:59.772 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:59.786 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-04-22T14:01:59.877 INFO:tasks.ceph:Running mkfs on mon nodes... 2020-04-22T14:01:59.877 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:01:59.890 INFO:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2020-04-22T14:01:59.957 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:00.011 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-04-22T14:02:00.104 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:00.118 INFO:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2020-04-22T14:02:00.186 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:00.199 INFO:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2020-04-22T14:02:00.267 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:00.320 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-04-22T14:02:00.413 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:00.426 INFO:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2020-04-22T14:02:00.493 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:00.547 INFO:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2020-04-22T14:02:00.615 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:00.669 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-04-22T14:02:00.764 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:00.777 INFO:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2020-04-22T14:02:00.843 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:00.904 INFO:teuthology.orchestra.run.smithi086:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-04-22T14:02:00.946 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:00.960 INFO:teuthology.orchestra.run.smithi103:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-04-22T14:02:01.014 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2020-04-22T14:02:01.015 INFO:tasks.ceph.mon.a:Restarting daemon 2020-04-22T14:02:01.015 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:01.068 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-04-22T14:02:01.111 INFO:tasks.ceph.mon.a:Started 2020-04-22T14:02:01.111 INFO:tasks.ceph.mon.b:Restarting daemon 2020-04-22T14:02:01.112 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:01.126 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2020-04-22T14:02:01.169 INFO:tasks.ceph.mon.b:Started 2020-04-22T14:02:01.169 INFO:tasks.ceph.mon.c:Restarting daemon 2020-04-22T14:02:01.170 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:01.183 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-04-22T14:02:01.225 INFO:tasks.ceph.mon.c:Started 2020-04-22T14:02:01.225 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2020-04-22T14:02:01.226 INFO:tasks.ceph.mgr.y:Restarting daemon 2020-04-22T14:02:01.226 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:01.239 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2020-04-22T14:02:01.282 INFO:tasks.ceph.mgr.y:Started 2020-04-22T14:02:01.282 INFO:tasks.ceph.mgr.x:Restarting daemon 2020-04-22T14:02:01.282 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:01.297 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2020-04-22T14:02:01.339 INFO:tasks.ceph.mgr.x:Started 2020-04-22T14:02:01.340 INFO:tasks.ceph:Setting crush tunables to default 2020-04-22T14:02:01.340 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:01.354 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd crush tunables default 2020-04-22T14:02:06.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:01.496+0000 7f7c770f3700 1 Processor -- start 2020-04-22T14:02:06.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:01.496+0000 7f7c770f3700 1 -- start start 2020-04-22T14:02:06.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:01.497+0000 7f7c770f3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c7005b7c0 0x7f7c700af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:06.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:01.497+0000 7f7c770f3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7c700ad920 0x7f7c7007fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:06.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:01.497+0000 7f7c770f3700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c700b5630 con 0x7f7c70080020 2020-04-22T14:02:06.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:01.497+0000 7f7c770f3700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c700b58d0 con 0x7f7c700ad920 2020-04-22T14:02:06.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:01.497+0000 7f7c770f3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c700b5b70 con 0x7f7c7005b7c0 2020-04-22T14:02:06.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:01.497+0000 7f7c74e8f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7c700ad920 0x7f7c7007fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:06.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:01.497+0000 7f7c74e8f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7c700ad920 0x7f7c7007fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46456/0 (socket says 172.21.15.103:46456) 2020-04-22T14:02:06.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:01.497+0000 7f7c74e8f700 1 -- 172.21.15.103:0/1563943789 learned_addr learned my addr 172.21.15.103:0/1563943789 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:06.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:01.497+0000 7f7c74e8f700 1 -- 172.21.15.103:0/1563943789 >> v2:172.21.15.103:3300/0 conn(0x7f7c700ad920 msgr2=0x7f7c7007fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-04-22T14:02:06.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:01.497+0000 7f7c74e8f700 1 -- 172.21.15.103:0/1563943789 >> v2:172.21.15.103:3300/0 conn(0x7f7c700ad920 msgr2=0x7f7c7007fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-22T14:02:06.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:01.497+0000 7f7c74e8f700 1 --2- 172.21.15.103:0/1563943789 >> v2:172.21.15.103:3300/0 conn(0x7f7c700ad920 0x7f7c7007fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-22T14:02:06.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:01.497+0000 7f7c74e8f700 1 --2- 172.21.15.103:0/1563943789 >> v2:172.21.15.103:3300/0 conn(0x7f7c700ad920 0x7f7c7007fbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-04-22T14:02:06.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:01.497+0000 7f7c75690700 1 --2- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c7005b7c0 0x7f7c700af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:06.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:01.497+0000 7f7c75690700 1 -- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c7005b7c0 msgr2=0x7f7c700af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-04-22T14:02:06.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:01.497+0000 7f7c75690700 1 -- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c7005b7c0 msgr2=0x7f7c700af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-22T14:02:06.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:01.497+0000 7f7c75690700 1 --2- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c7005b7c0 0x7f7c700af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-22T14:02:06.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:01.497+0000 7f7c75690700 1 --2- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c7005b7c0 0x7f7c700af030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-04-22T14:02:06.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:01.698+0000 7f7c74e8f700 1 --2- 172.21.15.103:0/1563943789 >> v2:172.21.15.103:3300/0 conn(0x7f7c700ad920 0x7f7c7007fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:06.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:01.698+0000 7f7c74e8f700 1 -- 172.21.15.103:0/1563943789 >> v2:172.21.15.103:3300/0 conn(0x7f7c700ad920 msgr2=0x7f7c7007fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-04-22T14:02:06.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:01.698+0000 7f7c74e8f700 1 -- 172.21.15.103:0/1563943789 >> v2:172.21.15.103:3300/0 conn(0x7f7c700ad920 msgr2=0x7f7c7007fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-22T14:02:06.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:01.698+0000 7f7c74e8f700 1 --2- 172.21.15.103:0/1563943789 >> v2:172.21.15.103:3300/0 conn(0x7f7c700ad920 0x7f7c7007fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-22T14:02:06.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:01.698+0000 7f7c74e8f700 1 --2- 172.21.15.103:0/1563943789 >> v2:172.21.15.103:3300/0 conn(0x7f7c700ad920 0x7f7c7007fbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-04-22T14:02:06.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:01.698+0000 7f7c75690700 1 --2- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c7005b7c0 0x7f7c700af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:06.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:01.698+0000 7f7c75690700 1 -- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c7005b7c0 msgr2=0x7f7c700af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-04-22T14:02:06.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:01.698+0000 7f7c75690700 1 -- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c7005b7c0 msgr2=0x7f7c700af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-22T14:02:06.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:01.698+0000 7f7c75690700 1 --2- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c7005b7c0 0x7f7c700af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-22T14:02:06.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:01.698+0000 7f7c75690700 1 --2- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c7005b7c0 0x7f7c700af030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-04-22T14:02:06.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:02.099+0000 7f7c74e8f700 1 --2- 172.21.15.103:0/1563943789 >> v2:172.21.15.103:3300/0 conn(0x7f7c700ad920 0x7f7c7007fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:06.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:02.099+0000 7f7c75690700 1 --2- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c7005b7c0 0x7f7c700af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:06.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:02.099+0000 7f7c74e8f700 1 -- 172.21.15.103:0/1563943789 >> v2:172.21.15.103:3300/0 conn(0x7f7c700ad920 msgr2=0x7f7c7007fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-04-22T14:02:06.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:02.099+0000 7f7c74e8f700 1 -- 172.21.15.103:0/1563943789 >> v2:172.21.15.103:3300/0 conn(0x7f7c700ad920 msgr2=0x7f7c7007fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-22T14:02:06.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:02.099+0000 7f7c74e8f700 1 --2- 172.21.15.103:0/1563943789 >> v2:172.21.15.103:3300/0 conn(0x7f7c700ad920 0x7f7c7007fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-22T14:02:06.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:02.099+0000 7f7c74e8f700 1 --2- 172.21.15.103:0/1563943789 >> v2:172.21.15.103:3300/0 conn(0x7f7c700ad920 0x7f7c7007fbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-04-22T14:02:06.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:02.099+0000 7f7c75690700 1 -- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c7005b7c0 msgr2=0x7f7c700af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-04-22T14:02:06.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:02.099+0000 7f7c75690700 1 -- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c7005b7c0 msgr2=0x7f7c700af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-22T14:02:06.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:02.099+0000 7f7c75690700 1 --2- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c7005b7c0 0x7f7c700af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-22T14:02:06.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:02.099+0000 7f7c75690700 1 --2- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c7005b7c0 0x7f7c700af030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-04-22T14:02:06.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:02.497+0000 7f7c66ffd700 1 -- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c7005b7c0 msgr2=0x7f7c700af030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-04-22T14:02:06.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:02.497+0000 7f7c66ffd700 1 --2- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c7005b7c0 0x7f7c700af030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:06.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:02.497+0000 7f7c66ffd700 1 -- 172.21.15.103:0/1563943789 >> v2:172.21.15.103:3300/0 conn(0x7f7c700ad920 msgr2=0x7f7c7007fbc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-04-22T14:02:06.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:02.497+0000 7f7c66ffd700 1 --2- 172.21.15.103:0/1563943789 >> v2:172.21.15.103:3300/0 conn(0x7f7c700ad920 0x7f7c7007fbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:06.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:02.497+0000 7f7c66ffd700 1 -- 172.21.15.103:0/1563943789 >> v1:172.21.15.86:6789/0 conn(0x7f7c70080020 legacy=0x7f7c700668c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:06.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:02.497+0000 7f7c66ffd700 1 --2- 172.21.15.103:0/1563943789 >> v2:172.21.15.86:3300/0 conn(0x7f7c54007030 0x7f7c540094f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:06.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:02.497+0000 7f7c66ffd700 1 -- 172.21.15.103:0/1563943789 --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c7005bba0 con 0x7f7c540033c0 2020-04-22T14:02:06.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:02.497+0000 7f7c66ffd700 1 -- 172.21.15.103:0/1563943789 --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c700b58d0 con 0x7f7c54007030 2020-04-22T14:02:06.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:02.497+0000 7f7c74e8f700 1 --2- 172.21.15.103:0/1563943789 >> v2:172.21.15.86:3300/0 conn(0x7f7c54007030 0x7f7c540094f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:06.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:02.498+0000 7f7c74e8f700 1 -- 172.21.15.103:0/1563943789 >> v2:172.21.15.86:3300/0 conn(0x7f7c54007030 msgr2=0x7f7c540094f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-04-22T14:02:06.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:02.498+0000 7f7c74e8f700 1 -- 172.21.15.103:0/1563943789 >> v2:172.21.15.86:3300/0 conn(0x7f7c54007030 msgr2=0x7f7c540094f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-22T14:02:06.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:02.498+0000 7f7c74e8f700 1 --2- 172.21.15.103:0/1563943789 >> v2:172.21.15.86:3300/0 conn(0x7f7c54007030 0x7f7c540094f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-22T14:02:06.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:02.498+0000 7f7c74e8f700 1 --2- 172.21.15.103:0/1563943789 >> v2:172.21.15.86:3300/0 conn(0x7f7c54007030 0x7f7c540094f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-04-22T14:02:06.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:02.699+0000 7f7c74e8f700 1 --2- 172.21.15.103:0/1563943789 >> v2:172.21.15.86:3300/0 conn(0x7f7c54007030 0x7f7c540094f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:06.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:02.699+0000 7f7c74e8f700 1 -- 172.21.15.103:0/1563943789 >> v2:172.21.15.86:3300/0 conn(0x7f7c54007030 msgr2=0x7f7c540094f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-04-22T14:02:06.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:02.699+0000 7f7c74e8f700 1 -- 172.21.15.103:0/1563943789 >> v2:172.21.15.86:3300/0 conn(0x7f7c54007030 msgr2=0x7f7c540094f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-22T14:02:06.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:02.699+0000 7f7c74e8f700 1 --2- 172.21.15.103:0/1563943789 >> v2:172.21.15.86:3300/0 conn(0x7f7c54007030 0x7f7c540094f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-22T14:02:06.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:02.699+0000 7f7c74e8f700 1 --2- 172.21.15.103:0/1563943789 >> v2:172.21.15.86:3300/0 conn(0x7f7c54007030 0x7f7c540094f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-04-22T14:02:06.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:03.100+0000 7f7c74e8f700 1 --2- 172.21.15.103:0/1563943789 >> v2:172.21.15.86:3300/0 conn(0x7f7c54007030 0x7f7c540094f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:06.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:03.100+0000 7f7c74e8f700 1 -- 172.21.15.103:0/1563943789 >> v2:172.21.15.86:3300/0 conn(0x7f7c54007030 msgr2=0x7f7c540094f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-04-22T14:02:06.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:03.100+0000 7f7c74e8f700 1 -- 172.21.15.103:0/1563943789 >> v2:172.21.15.86:3300/0 conn(0x7f7c54007030 msgr2=0x7f7c540094f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-22T14:02:06.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:03.100+0000 7f7c74e8f700 1 --2- 172.21.15.103:0/1563943789 >> v2:172.21.15.86:3300/0 conn(0x7f7c54007030 0x7f7c540094f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-22T14:02:06.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:03.100+0000 7f7c74e8f700 1 --2- 172.21.15.103:0/1563943789 >> v2:172.21.15.86:3300/0 conn(0x7f7c54007030 0x7f7c540094f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-04-22T14:02:06.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:03.901+0000 7f7c74e8f700 1 --2- 172.21.15.103:0/1563943789 >> v2:172.21.15.86:3300/0 conn(0x7f7c54007030 0x7f7c540094f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:06.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:03.901+0000 7f7c74e8f700 1 -- 172.21.15.103:0/1563943789 >> v2:172.21.15.86:3300/0 conn(0x7f7c54007030 msgr2=0x7f7c540094f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-04-22T14:02:06.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:03.901+0000 7f7c74e8f700 1 -- 172.21.15.103:0/1563943789 >> v2:172.21.15.86:3300/0 conn(0x7f7c54007030 msgr2=0x7f7c540094f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-22T14:02:06.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:03.901+0000 7f7c74e8f700 1 --2- 172.21.15.103:0/1563943789 >> v2:172.21.15.86:3300/0 conn(0x7f7c54007030 0x7f7c540094f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-22T14:02:06.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:03.901+0000 7f7c74e8f700 1 --2- 172.21.15.103:0/1563943789 >> v2:172.21.15.86:3300/0 conn(0x7f7c54007030 0x7f7c540094f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-04-22T14:02:06.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:05.498+0000 7f7c66ffd700 1 -- 172.21.15.103:0/1563943789 >> v2:172.21.15.86:3300/0 conn(0x7f7c54007030 msgr2=0x7f7c540094f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-04-22T14:02:06.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:05.498+0000 7f7c66ffd700 1 --2- 172.21.15.103:0/1563943789 >> v2:172.21.15.86:3300/0 conn(0x7f7c54007030 0x7f7c540094f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:06.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:05.498+0000 7f7c66ffd700 1 -- 172.21.15.103:0/1563943789 >> v1:172.21.15.103:6789/0 conn(0x7f7c540033c0 legacy=0x7f7c54005800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:06.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:05.498+0000 7f7c66ffd700 1 --2- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c7005b7c0 0x7f7c5400fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:06.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:05.498+0000 7f7c75e91700 1 -- 172.21.15.103:0/1563943789 reap_dead start 2020-04-22T14:02:06.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:05.498+0000 7f7c66ffd700 1 -- 172.21.15.103:0/1563943789 --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c5400ab70 con 0x7f7c70080020 2020-04-22T14:02:06.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:05.498+0000 7f7c66ffd700 1 -- 172.21.15.103:0/1563943789 --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c5400a860 con 0x7f7c54009c20 2020-04-22T14:02:06.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:05.498+0000 7f7c66ffd700 1 -- 172.21.15.103:0/1563943789 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c700b58d0 con 0x7f7c7005b7c0 2020-04-22T14:02:06.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:05.498+0000 7f7c74e8f700 1 --2- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c7005b7c0 0x7f7c5400fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:06.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:05.498+0000 7f7c74e8f700 1 -- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c7005b7c0 msgr2=0x7f7c5400fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-04-22T14:02:06.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:05.498+0000 7f7c74e8f700 1 -- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c7005b7c0 msgr2=0x7f7c5400fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-22T14:02:06.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:05.498+0000 7f7c74e8f700 1 --2- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c7005b7c0 0x7f7c5400fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-22T14:02:06.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:05.498+0000 7f7c74e8f700 1 --2- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c7005b7c0 0x7f7c5400fe90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-04-22T14:02:06.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:05.699+0000 7f7c74e8f700 1 --2- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c7005b7c0 0x7f7c5400fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:06.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:05.699+0000 7f7c74e8f700 1 -- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c7005b7c0 msgr2=0x7f7c5400fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-04-22T14:02:06.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:05.699+0000 7f7c74e8f700 1 -- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c7005b7c0 msgr2=0x7f7c5400fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-22T14:02:06.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:05.699+0000 7f7c74e8f700 1 --2- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c7005b7c0 0x7f7c5400fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-22T14:02:06.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:05.699+0000 7f7c74e8f700 1 --2- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c7005b7c0 0x7f7c5400fe90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-04-22T14:02:06.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.101+0000 7f7c74e8f700 1 --2- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c7005b7c0 0x7f7c5400fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:06.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.101+0000 7f7c74e8f700 1 -- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c7005b7c0 msgr2=0x7f7c5400fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-04-22T14:02:06.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.101+0000 7f7c74e8f700 1 -- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c7005b7c0 msgr2=0x7f7c5400fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-22T14:02:06.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.101+0000 7f7c74e8f700 1 --2- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c7005b7c0 0x7f7c5400fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-22T14:02:06.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.101+0000 7f7c74e8f700 1 --2- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c7005b7c0 0x7f7c5400fe90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-04-22T14:02:06.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.510+0000 7f7c67fff700 1 -- 172.21.15.103:0/1563943789 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1713485861 0 0) 0x7f7c5400ab70 con 0x7f7c70080020 2020-04-22T14:02:06.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.510+0000 7f7c67fff700 1 -- 172.21.15.103:0/1563943789 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c5c003230 con 0x7f7c70080020 2020-04-22T14:02:06.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.510+0000 7f7c67fff700 1 -- 172.21.15.103:0/1563943789 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1502346936 0 0) 0x7f7c5400a860 con 0x7f7c54009c20 2020-04-22T14:02:06.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.510+0000 7f7c67fff700 1 -- 172.21.15.103:0/1563943789 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c5400ab70 con 0x7f7c54009c20 2020-04-22T14:02:06.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.512+0000 7f7c67fff700 1 -- 172.21.15.103:0/1563943789 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1264267268 0 0) 0x7f7c5400ab70 con 0x7f7c54009c20 2020-04-22T14:02:06.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.512+0000 7f7c67fff700 1 -- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c7005b7c0 msgr2=0x7f7c5400fe90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-04-22T14:02:06.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.512+0000 7f7c67fff700 1 --2- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c7005b7c0 0x7f7c5400fe90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:06.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.512+0000 7f7c67fff700 1 -- 172.21.15.103:0/1563943789 >> v1:172.21.15.86:6789/0 conn(0x7f7c70080020 legacy=0x7f7c54012300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:06.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.512+0000 7f7c67fff700 1 -- 172.21.15.103:0/1563943789 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c540084f0 con 0x7f7c54009c20 2020-04-22T14:02:06.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.512+0000 7f7c67fff700 1 -- 172.21.15.103:0/1563943789 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f7c60001350 con 0x7f7c54009c20 2020-04-22T14:02:06.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.512+0000 7f7c67fff700 1 -- 172.21.15.103:0/1563943789 >> v1:172.21.15.103:6789/0 conn(0x7f7c54009c20 legacy=0x7f7c5400a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:06.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.512+0000 7f7c67fff700 1 --2- 172.21.15.103:0/1563943789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c5c0038b0 0x7f7c5c003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:06.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.512+0000 7f7c67fff700 1 --2- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c7005b7c0 0x7f7c5c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:06.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.512+0000 7f7c67fff700 1 --2- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c5c004930 0x7f7c5c004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:06.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.512+0000 7f7c67fff700 1 -- 172.21.15.103:0/1563943789 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c700b58d0 con 0x7f7c5c004930 2020-04-22T14:02:06.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.512+0000 7f7c67fff700 1 -- 172.21.15.103:0/1563943789 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c0042b0 con 0x7f7c5c0038b0 2020-04-22T14:02:06.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.512+0000 7f7c67fff700 1 -- 172.21.15.103:0/1563943789 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c005210 con 0x7f7c7005b7c0 2020-04-22T14:02:06.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.512+0000 7f7c75690700 1 --2- 172.21.15.103:0/1563943789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c5c0038b0 0x7f7c5c003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:06.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.512+0000 7f7c74e8f700 1 --2- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c7005b7c0 0x7f7c5c0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:06.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.512+0000 7f7c75e91700 1 --2- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c5c004930 0x7f7c5c004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:06.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.512+0000 7f7c75690700 1 -- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c7005b7c0 msgr2=0x7f7c5c0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:06.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.512+0000 7f7c75690700 1 --2- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c7005b7c0 0x7f7c5c0044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:06.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.512+0000 7f7c75690700 1 -- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c5c004930 msgr2=0x7f7c5c004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:06.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.512+0000 7f7c75690700 1 --2- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c5c004930 0x7f7c5c004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:06.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.512+0000 7f7c75690700 1 -- 172.21.15.103:0/1563943789 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c5400ab70 con 0x7f7c5c0038b0 2020-04-22T14:02:06.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.512+0000 7f7c75e91700 1 --2- 172.21.15.103:0/1563943789 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c5c004930 0x7f7c5c004db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:02:06.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.512+0000 7f7c75690700 1 --2- 172.21.15.103:0/1563943789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c5c0038b0 0x7f7c5c003cb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7c60001120 tx=0x7f7c7005bdc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:06.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.512+0000 7f7c75690700 1 --2- 172.21.15.103:0/1563943789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c5c0038b0 0x7f7c5c003cb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7c60001120 tx=0x7f7c7005bdc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:06.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.512+0000 7f7c75690700 1 --2- 172.21.15.103:0/1563943789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c5c0038b0 0x7f7c5c003cb0 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7f7c60001120 tx=0x7f7c7005bdc0).ready entity=mon.1 client_cookie=68a0f10d99e149f8 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:06.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.512+0000 7f7c75690700 1 --2- 172.21.15.103:0/1563943789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c5c0038b0 0x7f7c5c003cb0 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f7c60001120 tx=0x7f7c7005bdc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:06.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.512+0000 7f7c67fff700 1 -- 172.21.15.103:0/1563943789 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c60007560 con 0x7f7c5c0038b0 2020-04-22T14:02:06.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.512+0000 7f7c75690700 1 --2- 172.21.15.103:0/1563943789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c5c0038b0 0x7f7c5c003cb0 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f7c60001120 tx=0x7f7c7005bdc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:06.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.512+0000 7f7c75690700 1 --2- 172.21.15.103:0/1563943789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c5c0038b0 0x7f7c5c003cb0 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f7c60001120 tx=0x7f7c7005bdc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:06.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.512+0000 7f7c67fff700 1 -- 172.21.15.103:0/1563943789 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c600058d0 con 0x7f7c5c0038b0 2020-04-22T14:02:06.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.512+0000 7f7c67fff700 1 -- 172.21.15.103:0/1563943789 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c60005c30 con 0x7f7c5c0038b0 2020-04-22T14:02:06.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.512+0000 7f7c770f3700 1 -- 172.21.15.103:0/1563943789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c5c0038b0 msgr2=0x7f7c5c003cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:06.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.512+0000 7f7c770f3700 1 --2- 172.21.15.103:0/1563943789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c5c0038b0 0x7f7c5c003cb0 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7f7c60001120 tx=0x7f7c7005bdc0).stop 2020-04-22T14:02:06.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.512+0000 7f7c75e91700 1 -- 172.21.15.103:0/1563943789 reap_dead start 2020-04-22T14:02:06.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.514+0000 7f7c770f3700 1 -- 172.21.15.103:0/1563943789 shutdown_connections 2020-04-22T14:02:06.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.514+0000 7f7c770f3700 1 -- 172.21.15.103:0/1563943789 >> 172.21.15.103:0/1563943789 conn(0x7f7c7006a0f0 msgr2=0x7f7c7005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:06.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.514+0000 7f7c770f3700 1 -- 172.21.15.103:0/1563943789 shutdown_connections 2020-04-22T14:02:06.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.514+0000 7f7c770f3700 1 -- 172.21.15.103:0/1563943789 wait complete. 2020-04-22T14:02:06.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.515+0000 7f7c770f3700 1 Processor -- start 2020-04-22T14:02:06.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.515+0000 7f7c770f3700 1 -- start start 2020-04-22T14:02:06.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.516+0000 7f7c770f3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7c70133c70 0x7f7c70065d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:06.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.516+0000 7f7c770f3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7c70134050 0x7f7c70066180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:06.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.516+0000 7f7c770f3700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c70065340 con 0x7f7c70062840 2020-04-22T14:02:06.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.516+0000 7f7c770f3700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c700655e0 con 0x7f7c70133c70 2020-04-22T14:02:06.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.516+0000 7f7c770f3700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c70065880 con 0x7f7c70134050 2020-04-22T14:02:06.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.516+0000 7f7c74e8f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7c70134050 0x7f7c70066180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:06.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.516+0000 7f7c74e8f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7c70134050 0x7f7c70066180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46540/0 (socket says 172.21.15.103:46540) 2020-04-22T14:02:06.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.516+0000 7f7c75690700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7c70133c70 0x7f7c70065d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:06.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.516+0000 7f7c74e8f700 1 -- 172.21.15.103:0/104440998 learned_addr learned my addr 172.21.15.103:0/104440998 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:06.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.517+0000 7f7c74e8f700 1 -- 172.21.15.103:0/104440998 >> v2:172.21.15.86:3300/0 conn(0x7f7c70133c70 msgr2=0x7f7c70065d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:06.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.517+0000 7f7c74e8f700 1 --2- 172.21.15.103:0/104440998 >> v2:172.21.15.86:3300/0 conn(0x7f7c70133c70 0x7f7c70065d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:06.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.517+0000 7f7c74e8f700 1 -- 172.21.15.103:0/104440998 >> v1:172.21.15.103:6789/0 conn(0x7f7c70062840 legacy=0x7f7c7013cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:06.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.517+0000 7f7c74e8f700 1 -- 172.21.15.103:0/104440998 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c70063720 con 0x7f7c70134050 2020-04-22T14:02:06.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.517+0000 7f7c75690700 1 --2- 172.21.15.103:0/104440998 >> v2:172.21.15.86:3300/0 conn(0x7f7c70133c70 0x7f7c70065d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:02:06.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.517+0000 7f7c74e8f700 1 --2- 172.21.15.103:0/104440998 >> v2:172.21.15.103:3300/0 conn(0x7f7c70134050 0x7f7c70066180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7c6c002f30 tx=0x7f7c6c00c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:06.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.517+0000 7f7c74e8f700 1 --2- 172.21.15.103:0/104440998 >> v2:172.21.15.103:3300/0 conn(0x7f7c70134050 0x7f7c70066180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7c6c002f30 tx=0x7f7c6c00c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:06.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.517+0000 7f7c74e8f700 1 --2- 172.21.15.103:0/104440998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c70134050 0x7f7c70066180 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7f7c6c002f30 tx=0x7f7c6c00c890).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:06.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.517+0000 7f7c74e8f700 1 --2- 172.21.15.103:0/104440998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c70134050 0x7f7c70066180 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f7c6c002f30 tx=0x7f7c6c00c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:06.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.517+0000 7f7c65ffb700 1 -- 172.21.15.103:0/104440998 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c6c008e10 con 0x7f7c70134050 2020-04-22T14:02:06.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.517+0000 7f7c74e8f700 1 --2- 172.21.15.103:0/104440998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c70134050 0x7f7c70066180 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f7c6c002f30 tx=0x7f7c6c00c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:06.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.517+0000 7f7c74e8f700 1 --2- 172.21.15.103:0/104440998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c70134050 0x7f7c70066180 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f7c6c002f30 tx=0x7f7c6c00c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:06.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.517+0000 7f7c65ffb700 1 -- 172.21.15.103:0/104440998 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6c0117f0 con 0x7f7c70134050 2020-04-22T14:02:06.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.517+0000 7f7c65ffb700 1 -- 172.21.15.103:0/104440998 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c6c011c10 con 0x7f7c70134050 2020-04-22T14:02:06.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.517+0000 7f7c770f3700 1 -- 172.21.15.103:0/104440998 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c70133660 con 0x7f7c70134050 2020-04-22T14:02:06.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.517+0000 7f7c770f3700 1 -- 172.21.15.103:0/104440998 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c7013d8c0 con 0x7f7c70134050 2020-04-22T14:02:06.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.518+0000 7f7c74e8f700 1 --2- 172.21.15.103:0/104440998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c70134050 0x7f7c70066180 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f7c6c002f30 tx=0x7f7c6c00c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:06.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.518+0000 7f7c65ffb700 1 -- 172.21.15.103:0/104440998 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) v1 ==== 514+0+0 (secure 0 0 0) 0x7f7c6c00b780 con 0x7f7c70134050 2020-04-22T14:02:06.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.518+0000 7f7c74e8f700 1 --2- 172.21.15.103:0/104440998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c70134050 0x7f7c70066180 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f7c6c002f30 tx=0x7f7c6c00c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:06.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.518+0000 7f7c65ffb700 1 -- 172.21.15.103:0/104440998 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f7c6c00a510 con 0x7f7c70134050 2020-04-22T14:02:06.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.518+0000 7f7c770f3700 1 -- 172.21.15.103:0/104440998 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c70063910 con 0x7f7c70134050 2020-04-22T14:02:06.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.521+0000 7f7c74e8f700 1 --2- 172.21.15.103:0/104440998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c70134050 0x7f7c70066180 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f7c6c002f30 tx=0x7f7c6c00c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:06.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.521+0000 7f7c65ffb700 1 -- 172.21.15.103:0/104440998 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67708 (secure 0 0 0) 0x7f7c70063910 con 0x7f7c70134050 2020-04-22T14:02:06.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.603+0000 7f7c770f3700 1 -- 172.21.15.103:0/104440998 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f7c70056c90 con 0x7f7c70134050 2020-04-22T14:02:06.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.607+0000 7f7c74e8f700 1 --2- 172.21.15.103:0/104440998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c70134050 0x7f7c70066180 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f7c6c002f30 tx=0x7f7c6c00c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:06.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.607+0000 7f7c65ffb700 1 -- 172.21.15.103:0/104440998 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f7c6c0056c0 con 0x7f7c70134050 2020-04-22T14:02:06.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.608+0000 7f7c770f3700 1 -- 172.21.15.103:0/104440998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c70134050 msgr2=0x7f7c70066180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:06.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.608+0000 7f7c770f3700 1 --2- 172.21.15.103:0/104440998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c70134050 0x7f7c70066180 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7f7c6c002f30 tx=0x7f7c6c00c890).stop 2020-04-22T14:02:06.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.608+0000 7f7c770f3700 1 -- 172.21.15.103:0/104440998 shutdown_connections 2020-04-22T14:02:06.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.608+0000 7f7c770f3700 1 --2- 172.21.15.103:0/104440998 >> v2:172.21.15.86:3300/0 conn(0x7f7c70133c70 0x7f7c70065d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:06.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.608+0000 7f7c770f3700 1 --2- 172.21.15.103:0/104440998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c70134050 0x7f7c70066180 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:06.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.608+0000 7f7c770f3700 1 -- 172.21.15.103:0/104440998 >> 172.21.15.103:0/104440998 conn(0x7f7c7006a0f0 msgr2=0x7f7c700b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:06.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.608+0000 7f7c770f3700 1 -- 172.21.15.103:0/104440998 shutdown_connections 2020-04-22T14:02:06.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:06.608+0000 7f7c770f3700 1 -- 172.21.15.103:0/104440998 wait complete. 2020-04-22T14:02:06.612 INFO:teuthology.orchestra.run.smithi103.stderr:adjusted tunables profile to default 2020-04-22T14:02:06.621 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2020-04-22T14:02:06.621 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:06.635 INFO:teuthology.orchestra.run.smithi103:> mktemp 2020-04-22T14:02:06.689 INFO:teuthology.orchestra.run.smithi103.stdout:/tmp/tmp.3rXyyNdZAh 2020-04-22T14:02:06.689 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:06.744 INFO:teuthology.orchestra.run.smithi103:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.3rXyyNdZAh 2020-04-22T14:02:06.811 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:06.865 INFO:teuthology.orchestra.run.smithi103:> sudo chmod 0666 /tmp/tmp.3rXyyNdZAh 2020-04-22T14:02:06.990 DEBUG:teuthology.orchestra.remote:smithi103:/tmp/tmp.3rXyyNdZAh is 37B 2020-04-22T14:02:07.037 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:07.050 INFO:teuthology.orchestra.run.smithi103:> rm -fr /tmp/tmp.3rXyyNdZAh 2020-04-22T14:02:07.113 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:07.167 INFO:teuthology.orchestra.run.smithi103:> mktemp 2020-04-22T14:02:07.220 INFO:teuthology.orchestra.run.smithi103.stdout:/tmp/tmp.urhgFEoPPy 2020-04-22T14:02:07.221 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:07.274 INFO:teuthology.orchestra.run.smithi103:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.urhgFEoPPy 2020-04-22T14:02:07.342 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:07.398 INFO:teuthology.orchestra.run.smithi103:> sudo chmod 0666 /tmp/tmp.urhgFEoPPy 2020-04-22T14:02:07.552 DEBUG:teuthology.orchestra.remote:smithi103:/tmp/tmp.urhgFEoPPy is 37B 2020-04-22T14:02:07.603 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:07.618 INFO:teuthology.orchestra.run.smithi103:> rm -fr /tmp/tmp.urhgFEoPPy 2020-04-22T14:02:07.677 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:07.730 INFO:teuthology.orchestra.run.smithi103:> mktemp 2020-04-22T14:02:07.784 INFO:teuthology.orchestra.run.smithi103.stdout:/tmp/tmp.3SXiWHD8nQ 2020-04-22T14:02:07.785 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:07.841 INFO:teuthology.orchestra.run.smithi103:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.3SXiWHD8nQ 2020-04-22T14:02:07.909 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:07.962 INFO:teuthology.orchestra.run.smithi103:> sudo chmod 0666 /tmp/tmp.3SXiWHD8nQ 2020-04-22T14:02:08.086 DEBUG:teuthology.orchestra.remote:smithi103:/tmp/tmp.3SXiWHD8nQ is 37B 2020-04-22T14:02:08.134 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:08.149 INFO:teuthology.orchestra.run.smithi103:> rm -fr /tmp/tmp.3SXiWHD8nQ 2020-04-22T14:02:08.201 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:08.256 INFO:teuthology.orchestra.run.smithi103:> mktemp 2020-04-22T14:02:08.309 INFO:teuthology.orchestra.run.smithi103.stdout:/tmp/tmp.z4SgVesJEe 2020-04-22T14:02:08.310 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:08.366 INFO:teuthology.orchestra.run.smithi103:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.z4SgVesJEe 2020-04-22T14:02:08.433 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:08.489 INFO:teuthology.orchestra.run.smithi103:> sudo chmod 0666 /tmp/tmp.z4SgVesJEe 2020-04-22T14:02:08.618 DEBUG:teuthology.orchestra.remote:smithi103:/tmp/tmp.z4SgVesJEe is 37B 2020-04-22T14:02:08.666 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:08.679 INFO:teuthology.orchestra.run.smithi103:> rm -fr /tmp/tmp.z4SgVesJEe 2020-04-22T14:02:08.735 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:08.748 INFO:teuthology.orchestra.run.smithi086:> mktemp 2020-04-22T14:02:08.803 INFO:teuthology.orchestra.run.smithi086.stdout:/tmp/tmp.2H4dqo2BSI 2020-04-22T14:02:08.804 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:08.857 INFO:teuthology.orchestra.run.smithi086:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.2H4dqo2BSI 2020-04-22T14:02:08.925 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:08.978 INFO:teuthology.orchestra.run.smithi086:> sudo chmod 0666 /tmp/tmp.2H4dqo2BSI 2020-04-22T14:02:09.102 DEBUG:teuthology.orchestra.remote:smithi086:/tmp/tmp.2H4dqo2BSI is 37B 2020-04-22T14:02:09.149 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:09.163 INFO:teuthology.orchestra.run.smithi086:> rm -fr /tmp/tmp.2H4dqo2BSI 2020-04-22T14:02:09.216 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:09.277 INFO:teuthology.orchestra.run.smithi086:> mktemp 2020-04-22T14:02:09.331 INFO:teuthology.orchestra.run.smithi086.stdout:/tmp/tmp.PM4vdRdoq5 2020-04-22T14:02:09.331 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:09.385 INFO:teuthology.orchestra.run.smithi086:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.PM4vdRdoq5 2020-04-22T14:02:09.453 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:09.506 INFO:teuthology.orchestra.run.smithi086:> sudo chmod 0666 /tmp/tmp.PM4vdRdoq5 2020-04-22T14:02:09.651 DEBUG:teuthology.orchestra.remote:smithi086:/tmp/tmp.PM4vdRdoq5 is 37B 2020-04-22T14:02:09.705 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:09.718 INFO:teuthology.orchestra.run.smithi086:> rm -fr /tmp/tmp.PM4vdRdoq5 2020-04-22T14:02:09.772 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:09.825 INFO:teuthology.orchestra.run.smithi086:> mktemp 2020-04-22T14:02:09.885 INFO:teuthology.orchestra.run.smithi086.stdout:/tmp/tmp.cBPKxwjmtx 2020-04-22T14:02:09.885 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:09.938 INFO:teuthology.orchestra.run.smithi086:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.cBPKxwjmtx 2020-04-22T14:02:10.005 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:10.058 INFO:teuthology.orchestra.run.smithi086:> sudo chmod 0666 /tmp/tmp.cBPKxwjmtx 2020-04-22T14:02:10.187 DEBUG:teuthology.orchestra.remote:smithi086:/tmp/tmp.cBPKxwjmtx is 37B 2020-04-22T14:02:10.235 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:10.261 INFO:teuthology.orchestra.run.smithi086:> rm -fr /tmp/tmp.cBPKxwjmtx 2020-04-22T14:02:10.302 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:10.355 INFO:teuthology.orchestra.run.smithi086:> mktemp 2020-04-22T14:02:10.408 INFO:teuthology.orchestra.run.smithi086.stdout:/tmp/tmp.wwj0p2jRCw 2020-04-22T14:02:10.409 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:10.462 INFO:teuthology.orchestra.run.smithi086:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.wwj0p2jRCw 2020-04-22T14:02:10.530 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:10.583 INFO:teuthology.orchestra.run.smithi086:> sudo chmod 0666 /tmp/tmp.wwj0p2jRCw 2020-04-22T14:02:10.712 DEBUG:teuthology.orchestra.remote:smithi086:/tmp/tmp.wwj0p2jRCw is 37B 2020-04-22T14:02:10.761 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:10.774 INFO:teuthology.orchestra.run.smithi086:> rm -fr /tmp/tmp.wwj0p2jRCw 2020-04-22T14:02:10.827 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:10.880 INFO:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new 3546145b-bd93-4a79-b6fe-3158153b8f05 0 2020-04-22T14:02:11.027 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.021+0000 7fa53a380700 1 Processor -- start 2020-04-22T14:02:11.028 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.021+0000 7fa53a380700 1 -- start start 2020-04-22T14:02:11.028 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.022+0000 7fa53a380700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa5340ad920 0x7fa53407fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:11.028 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.022+0000 7fa53a380700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5340b5630 con 0x7fa534080020 2020-04-22T14:02:11.028 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.022+0000 7fa53a380700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5340b58d0 con 0x7fa53405b7c0 2020-04-22T14:02:11.028 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.022+0000 7fa53a380700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5340b5b70 con 0x7fa5340ad920 2020-04-22T14:02:11.028 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.022+0000 7fa53911e700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fa534080020 0x7fa5340668c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:42288/0 (socket says 172.21.15.86:42288) 2020-04-22T14:02:11.029 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.022+0000 7fa53911e700 1 -- 172.21.15.86:0/3739789972 learned_addr learned my addr 172.21.15.86:0/3739789972 (peer_addr_for_me v1:172.21.15.86:0/0) 2020-04-22T14:02:11.029 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.022+0000 7fa533fff700 1 --2- 172.21.15.86:0/3739789972 >> v2:172.21.15.103:3300/0 conn(0x7fa5340ad920 0x7fa53407fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:11.029 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.022+0000 7fa5337fe700 1 -- 172.21.15.86:0/3739789972 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4048729114 0 0) 0x7fa5340b5630 con 0x7fa534080020 2020-04-22T14:02:11.029 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.022+0000 7fa5337fe700 1 -- 172.21.15.86:0/3739789972 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa51c003230 con 0x7fa534080020 2020-04-22T14:02:11.029 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.023+0000 7fa5337fe700 1 -- 172.21.15.86:0/3739789972 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2904874737 0 0) 0x7fa51c003230 con 0x7fa534080020 2020-04-22T14:02:11.029 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.023+0000 7fa5337fe700 1 -- 172.21.15.86:0/3739789972 >> v2:172.21.15.103:3300/0 conn(0x7fa5340ad920 msgr2=0x7fa53407fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:11.029 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.023+0000 7fa5337fe700 1 --2- 172.21.15.86:0/3739789972 >> v2:172.21.15.103:3300/0 conn(0x7fa5340ad920 0x7fa53407fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:11.030 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.023+0000 7fa5337fe700 1 -- 172.21.15.86:0/3739789972 >> v1:172.21.15.103:6789/0 conn(0x7fa53405b7c0 legacy=0x7fa5340af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:11.030 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.023+0000 7fa5337fe700 1 -- 172.21.15.86:0/3739789972 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53405bba0 con 0x7fa534080020 2020-04-22T14:02:11.030 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.023+0000 7fa5337fe700 1 -- 172.21.15.86:0/3739789972 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fa52c001a50 con 0x7fa534080020 2020-04-22T14:02:11.030 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.023+0000 7fa5337fe700 1 -- 172.21.15.86:0/3739789972 >> v1:172.21.15.86:6789/0 conn(0x7fa534080020 legacy=0x7fa5340668c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:11.030 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.023+0000 7fa5337fe700 1 --2- 172.21.15.86:0/3739789972 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa51c003720 0x7fa51c003b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:11.030 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.023+0000 7fa5337fe700 1 --2- 172.21.15.86:0/3739789972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa51c0044d0 0x7fa51c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:11.030 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.023+0000 7fa5337fe700 1 --2- 172.21.15.86:0/3739789972 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa51c004db0 0x7fa51c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:11.030 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.023+0000 7fa5337fe700 1 -- 172.21.15.86:0/3739789972 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5340b5b70 con 0x7fa51c0044d0 2020-04-22T14:02:11.031 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.023+0000 7fa5337fe700 1 -- 172.21.15.86:0/3739789972 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c0041e0 con 0x7fa51c004db0 2020-04-22T14:02:11.031 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.023+0000 7fa5337fe700 1 -- 172.21.15.86:0/3739789972 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c04fb90 con 0x7fa51c003720 2020-04-22T14:02:11.031 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.023+0000 7fa533fff700 1 --2- 172.21.15.86:0/3739789972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa51c0044d0 0x7fa51c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:11.031 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.023+0000 7fa53891d700 1 --2- 172.21.15.86:0/3739789972 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa51c003720 0x7fa51c003b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:11.031 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.023+0000 7fa53911e700 1 --2- 172.21.15.86:0/3739789972 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa51c004db0 0x7fa51c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:11.031 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.023+0000 7fa533fff700 1 -- 172.21.15.86:0/3739789972 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa51c003720 msgr2=0x7fa51c003b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:11.031 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.023+0000 7fa533fff700 1 --2- 172.21.15.86:0/3739789972 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa51c003720 0x7fa51c003b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:11.031 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.023+0000 7fa533fff700 1 -- 172.21.15.86:0/3739789972 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa51c004db0 msgr2=0x7fa51c00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:11.032 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.023+0000 7fa533fff700 1 --2- 172.21.15.86:0/3739789972 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa51c004db0 0x7fa51c00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:11.032 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.023+0000 7fa533fff700 1 -- 172.21.15.86:0/3739789972 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa51c003230 con 0x7fa51c0044d0 2020-04-22T14:02:11.032 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.023+0000 7fa53911e700 1 --2- 172.21.15.86:0/3739789972 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa51c004db0 0x7fa51c00b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:02:11.032 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.023+0000 7fa53911e700 1 -- 172.21.15.86:0/3739789972 reap_dead start 2020-04-22T14:02:11.032 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.023+0000 7fa533fff700 1 --2- 172.21.15.86:0/3739789972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa51c0044d0 0x7fa51c004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa528002f30 tx=0x7fa528010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.032 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.023+0000 7fa533fff700 1 --2- 172.21.15.86:0/3739789972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa51c0044d0 0x7fa51c004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa528002f30 tx=0x7fa528010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.032 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.023+0000 7fa533fff700 1 --2- 172.21.15.86:0/3739789972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa51c0044d0 0x7fa51c004950 secure :-1 s=READY pgs=21 cs=0 l=1 rx=0x7fa528002f30 tx=0x7fa528010020).ready entity=mon.0 client_cookie=ca759d1735658dcf server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:11.033 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.023+0000 7fa533fff700 1 --2- 172.21.15.86:0/3739789972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa51c0044d0 0x7fa51c004950 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7fa528002f30 tx=0x7fa528010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.033 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.023+0000 7fa5337fe700 1 -- 172.21.15.86:0/3739789972 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa528008d30 con 0x7fa51c0044d0 2020-04-22T14:02:11.033 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.023+0000 7fa533fff700 1 --2- 172.21.15.86:0/3739789972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa51c0044d0 0x7fa51c004950 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7fa528002f30 tx=0x7fa528010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.033 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.023+0000 7fa533fff700 1 --2- 172.21.15.86:0/3739789972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa51c0044d0 0x7fa51c004950 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7fa528002f30 tx=0x7fa528010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.033 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.023+0000 7fa5337fe700 1 -- 172.21.15.86:0/3739789972 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa528008e90 con 0x7fa51c0044d0 2020-04-22T14:02:11.033 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.023+0000 7fa5337fe700 1 -- 172.21.15.86:0/3739789972 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa528010b00 con 0x7fa51c0044d0 2020-04-22T14:02:11.033 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.023+0000 7fa53a380700 1 -- 172.21.15.86:0/3739789972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa51c0044d0 msgr2=0x7fa51c004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:11.033 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.023+0000 7fa53a380700 1 --2- 172.21.15.86:0/3739789972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa51c0044d0 0x7fa51c004950 secure :-1 s=READY pgs=21 cs=0 l=1 rx=0x7fa528002f30 tx=0x7fa528010020).stop 2020-04-22T14:02:11.034 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.024+0000 7fa53a380700 1 -- 172.21.15.86:0/3739789972 shutdown_connections 2020-04-22T14:02:11.035 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.024+0000 7fa53a380700 1 --2- 172.21.15.86:0/3739789972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa51c0044d0 0x7fa51c004950 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:11.035 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.024+0000 7fa53a380700 1 -- 172.21.15.86:0/3739789972 >> 172.21.15.86:0/3739789972 conn(0x7fa53406a0f0 msgr2=0x7fa53405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:11.036 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.024+0000 7fa53a380700 1 -- 172.21.15.86:0/3739789972 shutdown_connections 2020-04-22T14:02:11.036 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.024+0000 7fa53a380700 1 -- 172.21.15.86:0/3739789972 wait complete. 2020-04-22T14:02:11.036 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.025+0000 7fa53a380700 1 Processor -- start 2020-04-22T14:02:11.036 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.025+0000 7fa53a380700 1 -- start start 2020-04-22T14:02:11.039 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.026+0000 7fa53a380700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa534155750 0x7fa534125040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:11.039 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.026+0000 7fa53a380700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa5340b1610 0x7fa5340b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:11.039 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.026+0000 7fa53a380700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa534063700 con 0x7fa51c0044d0 2020-04-22T14:02:11.039 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.026+0000 7fa53a380700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa534155bb0 con 0x7fa534155750 2020-04-22T14:02:11.040 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.026+0000 7fa53a380700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa534062f50 con 0x7fa5340b1610 2020-04-22T14:02:11.040 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.026+0000 7fa53891d700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fa51c0044d0 0x7fa534062840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:42298/0 (socket says 172.21.15.86:42298) 2020-04-22T14:02:11.040 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.026+0000 7fa53891d700 1 -- 172.21.15.86:0/2579519486 learned_addr learned my addr 172.21.15.86:0/2579519486 (peer_addr_for_me v1:172.21.15.86:0/0) 2020-04-22T14:02:11.040 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.026+0000 7fa533fff700 1 --2- 172.21.15.86:0/2579519486 >> v2:172.21.15.86:3300/0 conn(0x7fa534155750 0x7fa534125040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:11.040 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.026+0000 7fa53911e700 1 --2- 172.21.15.86:0/2579519486 >> v2:172.21.15.103:3300/0 conn(0x7fa5340b1610 0x7fa5340b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:11.041 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.026+0000 7fa533fff700 1 -- 172.21.15.86:0/2579519486 >> v2:172.21.15.103:3300/0 conn(0x7fa5340b1610 msgr2=0x7fa5340b19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:11.041 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.026+0000 7fa533fff700 1 --2- 172.21.15.86:0/2579519486 >> v2:172.21.15.103:3300/0 conn(0x7fa5340b1610 0x7fa5340b19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:11.041 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.026+0000 7fa533fff700 1 -- 172.21.15.86:0/2579519486 >> v1:172.21.15.86:6789/0 conn(0x7fa51c0044d0 legacy=0x7fa534062840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:11.041 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.026+0000 7fa533fff700 1 -- 172.21.15.86:0/2579519486 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5340631c0 con 0x7fa534155750 2020-04-22T14:02:11.041 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.026+0000 7fa5317fa700 1 -- 172.21.15.86:0/2579519486 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2405788400 0 0) 0x7fa534063700 con 0x7fa51c0044d0 2020-04-22T14:02:11.041 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.026+0000 7fa533fff700 1 --2- 172.21.15.86:0/2579519486 >> v2:172.21.15.86:3300/0 conn(0x7fa534155750 0x7fa534125040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa528002f30 tx=0x7fa528010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.041 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.026+0000 7fa533fff700 1 --2- 172.21.15.86:0/2579519486 >> v2:172.21.15.86:3300/0 conn(0x7fa534155750 0x7fa534125040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa528002f30 tx=0x7fa528010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.042 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.026+0000 7fa533fff700 1 --2- 172.21.15.86:0/2579519486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa534155750 0x7fa534125040 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7fa528002f30 tx=0x7fa528010020).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:11.042 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.026+0000 7fa533fff700 1 --2- 172.21.15.86:0/2579519486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa534155750 0x7fa534125040 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fa528002f30 tx=0x7fa528010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.042 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.027+0000 7fa5317fa700 1 -- 172.21.15.86:0/2579519486 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa528010430 con 0x7fa534155750 2020-04-22T14:02:11.042 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.027+0000 7fa533fff700 1 --2- 172.21.15.86:0/2579519486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa534155750 0x7fa534125040 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fa528002f30 tx=0x7fa528010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.042 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.027+0000 7fa533fff700 1 --2- 172.21.15.86:0/2579519486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa534155750 0x7fa534125040 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fa528002f30 tx=0x7fa528010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.042 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.027+0000 7fa5317fa700 1 -- 172.21.15.86:0/2579519486 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa528007880 con 0x7fa534155750 2020-04-22T14:02:11.042 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.027+0000 7fa53a380700 1 -- 172.21.15.86:0/2579519486 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa534063460 con 0x7fa534155750 2020-04-22T14:02:11.043 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.027+0000 7fa5317fa700 1 -- 172.21.15.86:0/2579519486 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5280058b0 con 0x7fa534155750 2020-04-22T14:02:11.043 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.027+0000 7fa53a380700 1 -- 172.21.15.86:0/2579519486 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa534063e50 con 0x7fa534155750 2020-04-22T14:02:11.043 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.027+0000 7fa533fff700 1 --2- 172.21.15.86:0/2579519486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa534155750 0x7fa534125040 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fa528002f30 tx=0x7fa528010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.043 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.028+0000 7fa53a380700 1 -- 172.21.15.86:0/2579519486 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa534140d20 con 0x7fa534155750 2020-04-22T14:02:11.043 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.028+0000 7fa5317fa700 1 -- 172.21.15.86:0/2579519486 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 3) v1 ==== 59559+0+0 (secure 0 0 0) 0x7fa528005a10 con 0x7fa534155750 2020-04-22T14:02:11.043 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.028+0000 7fa533fff700 1 --2- 172.21.15.86:0/2579519486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa534155750 0x7fa534125040 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fa528002f30 tx=0x7fa528010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.044 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.028+0000 7fa5317fa700 1 --2- 172.21.15.86:0/2579519486 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa51404d780 0x7fa51404fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:11.044 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.028+0000 7fa5317fa700 1 -- 172.21.15.86:0/2579519486 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1130+0+0 (secure 0 0 0) 0x7fa528061500 con 0x7fa534155750 2020-04-22T14:02:11.044 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.028+0000 7fa53891d700 1 --2- 172.21.15.86:0/2579519486 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa51404d780 0x7fa51404fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:11.044 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.028+0000 7fa53891d700 1 --2- 172.21.15.86:0/2579519486 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa51404d780 0x7fa51404fc40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa5240015f0 tx=0x7fa5240039a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.044 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.028+0000 7fa53891d700 1 --2- 172.21.15.86:0/2579519486 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa51404d780 0x7fa51404fc40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa5240015f0 tx=0x7fa5240039a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.044 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.028+0000 7fa53891d700 1 --2- 172.21.15.86:0/2579519486 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa51404d780 0x7fa51404fc40 secure :-1 s=READY pgs=9 cs=0 l=1 rx=0x7fa5240015f0 tx=0x7fa5240039a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:11.044 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.031+0000 7fa533fff700 1 --2- 172.21.15.86:0/2579519486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa534155750 0x7fa534125040 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fa528002f30 tx=0x7fa528010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.045 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.031+0000 7fa5317fa700 1 -- 172.21.15.86:0/2579519486 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fa52803cae0 con 0x7fa534155750 2020-04-22T14:02:11.190 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.188+0000 7fa53a380700 1 -- 172.21.15.86:0/2579519486 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3546145b-bd93-4a79-b6fe-3158153b8f05", "id": 0} v 0) v1 -- 0x7fa534056c90 con 0x7fa534155750 2020-04-22T14:02:11.193 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.191+0000 7fa533fff700 1 --2- 172.21.15.86:0/2579519486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa534155750 0x7fa534125040 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fa528002f30 tx=0x7fa528010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.193 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.191+0000 7fa5317fa700 1 -- 172.21.15.86:0/2579519486 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3546145b-bd93-4a79-b6fe-3158153b8f05", "id": 0}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa528040100 con 0x7fa534155750 2020-04-22T14:02:11.193 INFO:teuthology.orchestra.run.smithi086.stdout:0 2020-04-22T14:02:11.195 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.192+0000 7fa53a380700 1 -- 172.21.15.86:0/2579519486 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa51404d780 msgr2=0x7fa51404fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:11.195 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.192+0000 7fa53a380700 1 --2- 172.21.15.86:0/2579519486 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa51404d780 0x7fa51404fc40 secure :-1 s=READY pgs=9 cs=0 l=1 rx=0x7fa5240015f0 tx=0x7fa5240039a0).stop 2020-04-22T14:02:11.195 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.192+0000 7fa53a380700 1 -- 172.21.15.86:0/2579519486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa534155750 msgr2=0x7fa534125040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:11.195 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.192+0000 7fa53a380700 1 --2- 172.21.15.86:0/2579519486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa534155750 0x7fa534125040 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7fa528002f30 tx=0x7fa528010020).stop 2020-04-22T14:02:11.195 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.192+0000 7fa53a380700 1 -- 172.21.15.86:0/2579519486 shutdown_connections 2020-04-22T14:02:11.195 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.193+0000 7fa53a380700 1 --2- 172.21.15.86:0/2579519486 >> v2:172.21.15.103:3300/0 conn(0x7fa5340b1610 0x7fa5340b19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:11.196 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.193+0000 7fa53a380700 1 --2- 172.21.15.86:0/2579519486 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa51404d780 0x7fa51404fc40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:11.201 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.193+0000 7fa53a380700 1 --2- 172.21.15.86:0/2579519486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa534155750 0x7fa534125040 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:11.201 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.193+0000 7fa53a380700 1 -- 172.21.15.86:0/2579519486 >> 172.21.15.86:0/2579519486 conn(0x7fa53406a0f0 msgr2=0x7fa534066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:11.201 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.193+0000 7fa53a380700 1 -- 172.21.15.86:0/2579519486 shutdown_connections 2020-04-22T14:02:11.201 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.193+0000 7fa53a380700 1 -- 172.21.15.86:0/2579519486 wait complete. 2020-04-22T14:02:11.205 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:11.218 INFO:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new 65ca5f7d-2ea6-4de6-a034-08a0a99aa80d 1 2020-04-22T14:02:11.365 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.360+0000 7f383a7a4700 1 Processor -- start 2020-04-22T14:02:11.365 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.360+0000 7f383a7a4700 1 -- start start 2020-04-22T14:02:11.366 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.360+0000 7f383a7a4700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f383405b7c0 0x7f38340af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:11.366 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.360+0000 7f383a7a4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38340802d0 0x7f38340668c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:11.366 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.360+0000 7f383a7a4700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38340b5630 con 0x7f38340ad920 2020-04-22T14:02:11.366 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.360+0000 7f383a7a4700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38340b58d0 con 0x7f383405b7c0 2020-04-22T14:02:11.366 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.360+0000 7f383a7a4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38340b5b70 con 0x7f38340802d0 2020-04-22T14:02:11.366 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.361+0000 7f3839542700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38340802d0 0x7f38340668c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:11.367 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.361+0000 7f3833fff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f38340ad920 0x7f383407fbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:42308/0 (socket says 172.21.15.86:42308) 2020-04-22T14:02:11.367 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.361+0000 7f3833fff700 1 -- 172.21.15.86:0/1045376785 learned_addr learned my addr 172.21.15.86:0/1045376785 (peer_addr_for_me v1:172.21.15.86:0/0) 2020-04-22T14:02:11.367 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.361+0000 7f3838d41700 1 --2- 172.21.15.86:0/1045376785 >> v2:172.21.15.103:3300/0 conn(0x7f383405b7c0 0x7f38340af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:11.367 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.361+0000 7f38337fe700 1 -- 172.21.15.86:0/1045376785 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3156606956 0 0) 0x7f38340b5630 con 0x7f38340ad920 2020-04-22T14:02:11.367 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.361+0000 7f38337fe700 1 -- 172.21.15.86:0/1045376785 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3820003230 con 0x7f38340ad920 2020-04-22T14:02:11.367 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.361+0000 7f3839542700 1 -- 172.21.15.86:0/1045376785 >> v2:172.21.15.103:3300/0 conn(0x7f383405b7c0 msgr2=0x7f38340af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:11.368 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.361+0000 7f3839542700 1 --2- 172.21.15.86:0/1045376785 >> v2:172.21.15.103:3300/0 conn(0x7f383405b7c0 0x7f38340af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:11.368 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.361+0000 7f3839542700 1 -- 172.21.15.86:0/1045376785 >> v1:172.21.15.86:6789/0 conn(0x7f38340ad920 legacy=0x7f383407fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:11.368 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.361+0000 7f3839542700 1 -- 172.21.15.86:0/1045376785 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f383405bba0 con 0x7f38340802d0 2020-04-22T14:02:11.368 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.361+0000 7f3839542700 1 --2- 172.21.15.86:0/1045376785 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38340802d0 0x7f38340668c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f382c0032b0 tx=0x7f382c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.368 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.361+0000 7f3839542700 1 --2- 172.21.15.86:0/1045376785 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38340802d0 0x7f38340668c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f382c0032b0 tx=0x7f382c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.368 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.361+0000 7f3839542700 1 --2- 172.21.15.86:0/1045376785 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38340802d0 0x7f38340668c0 secure :-1 s=READY pgs=8 cs=0 l=1 rx=0x7f382c0032b0 tx=0x7f382c007dc0).ready entity=mon.2 client_cookie=659cc9749a6b0d0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:11.368 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.361+0000 7f3839542700 1 --2- 172.21.15.86:0/1045376785 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38340802d0 0x7f38340668c0 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7f382c0032b0 tx=0x7f382c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.368 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.361+0000 7f38337fe700 1 -- 172.21.15.86:0/1045376785 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f382c011e20 con 0x7f38340802d0 2020-04-22T14:02:11.369 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.361+0000 7f3839542700 1 --2- 172.21.15.86:0/1045376785 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38340802d0 0x7f38340668c0 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7f382c0032b0 tx=0x7f382c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.369 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.361+0000 7f3839542700 1 --2- 172.21.15.86:0/1045376785 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38340802d0 0x7f38340668c0 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7f382c0032b0 tx=0x7f382c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.369 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.361+0000 7f38337fe700 1 -- 172.21.15.86:0/1045376785 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f382c00a180 con 0x7f38340802d0 2020-04-22T14:02:11.369 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.361+0000 7f38337fe700 1 -- 172.21.15.86:0/1045376785 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f382c00a520 con 0x7f38340802d0 2020-04-22T14:02:11.369 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.361+0000 7f383a7a4700 1 -- 172.21.15.86:0/1045376785 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38340802d0 msgr2=0x7f38340668c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:11.369 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.361+0000 7f383a7a4700 1 --2- 172.21.15.86:0/1045376785 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38340802d0 0x7f38340668c0 secure :-1 s=READY pgs=8 cs=0 l=1 rx=0x7f382c0032b0 tx=0x7f382c007dc0).stop 2020-04-22T14:02:11.369 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.362+0000 7f383a7a4700 1 -- 172.21.15.86:0/1045376785 shutdown_connections 2020-04-22T14:02:11.370 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.362+0000 7f383a7a4700 1 --2- 172.21.15.86:0/1045376785 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38340802d0 0x7f38340668c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:11.370 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.362+0000 7f383a7a4700 1 --2- 172.21.15.86:0/1045376785 >> v2:172.21.15.103:3300/0 conn(0x7f383405b7c0 0x7f38340af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:11.370 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.362+0000 7f383a7a4700 1 -- 172.21.15.86:0/1045376785 >> 172.21.15.86:0/1045376785 conn(0x7f383406a0f0 msgr2=0x7f383405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:11.370 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.362+0000 7f383a7a4700 1 -- 172.21.15.86:0/1045376785 shutdown_connections 2020-04-22T14:02:11.370 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.362+0000 7f383a7a4700 1 -- 172.21.15.86:0/1045376785 wait complete. 2020-04-22T14:02:11.370 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.363+0000 7f383a7a4700 1 Processor -- start 2020-04-22T14:02:11.370 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.363+0000 7f383a7a4700 1 -- start start 2020-04-22T14:02:11.373 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.364+0000 7f383a7a4700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f38340ad920 0x7f38340ab740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:11.374 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.364+0000 7f383a7a4700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3834131800 con 0x7f38340802d0 2020-04-22T14:02:11.374 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.364+0000 7f383a7a4700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38341561a0 con 0x7f383405b7c0 2020-04-22T14:02:11.374 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.364+0000 7f383a7a4700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3834066340 con 0x7f38340ad920 2020-04-22T14:02:11.374 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.364+0000 7f3839542700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f38340ad920 0x7f38340ab740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:11.374 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.364+0000 7f3833fff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f38340802d0 0x7f3834063a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:42316/0 (socket says 172.21.15.86:42316) 2020-04-22T14:02:11.374 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.364+0000 7f3839542700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f38340ad920 0x7f38340ab740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45238/0 (socket says 172.21.15.86:45238) 2020-04-22T14:02:11.375 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.364+0000 7f3833fff700 1 -- 172.21.15.86:0/2530416516 learned_addr learned my addr 172.21.15.86:0/2530416516 (peer_addr_for_me v1:172.21.15.86:0/0) 2020-04-22T14:02:11.375 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.364+0000 7f3839542700 1 -- 172.21.15.86:0/2530416516 >> v1:172.21.15.103:6789/0 conn(0x7f383405b7c0 legacy=0x7f3834154b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:11.375 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.364+0000 7f38317fa700 1 -- 172.21.15.86:0/2530416516 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1359015050 0 0) 0x7f3834131800 con 0x7f38340802d0 2020-04-22T14:02:11.375 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.364+0000 7f3839542700 1 -- 172.21.15.86:0/2530416516 >> v1:172.21.15.86:6789/0 conn(0x7f38340802d0 legacy=0x7f3834063a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:11.375 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.364+0000 7f3839542700 1 -- 172.21.15.86:0/2530416516 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38340665e0 con 0x7f38340ad920 2020-04-22T14:02:11.375 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.364+0000 7f3839542700 1 --2- 172.21.15.86:0/2530416516 >> v2:172.21.15.86:3300/0 conn(0x7f38340ad920 0x7f38340ab740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3834155580 tx=0x7f382c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.376 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.364+0000 7f3839542700 1 --2- 172.21.15.86:0/2530416516 >> v2:172.21.15.86:3300/0 conn(0x7f38340ad920 0x7f38340ab740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3834155580 tx=0x7f382c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.376 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.364+0000 7f3839542700 1 --2- 172.21.15.86:0/2530416516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38340ad920 0x7f38340ab740 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7f3834155580 tx=0x7f382c007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:11.376 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.364+0000 7f3839542700 1 --2- 172.21.15.86:0/2530416516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38340ad920 0x7f38340ab740 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f3834155580 tx=0x7f382c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.376 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.364+0000 7f38317fa700 1 -- 172.21.15.86:0/2530416516 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f382c005c30 con 0x7f38340ad920 2020-04-22T14:02:11.376 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.364+0000 7f3839542700 1 --2- 172.21.15.86:0/2530416516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38340ad920 0x7f38340ab740 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f3834155580 tx=0x7f382c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.376 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.364+0000 7f3839542700 1 --2- 172.21.15.86:0/2530416516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38340ad920 0x7f38340ab740 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f3834155580 tx=0x7f382c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.377 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.364+0000 7f38317fa700 1 -- 172.21.15.86:0/2530416516 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f382c005d90 con 0x7f38340ad920 2020-04-22T14:02:11.377 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.364+0000 7f38317fa700 1 -- 172.21.15.86:0/2530416516 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f382c0112c0 con 0x7f38340ad920 2020-04-22T14:02:11.377 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.364+0000 7f383a7a4700 1 -- 172.21.15.86:0/2530416516 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3834155d00 con 0x7f38340ad920 2020-04-22T14:02:11.377 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.364+0000 7f383a7a4700 1 -- 172.21.15.86:0/2530416516 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3834131040 con 0x7f38340ad920 2020-04-22T14:02:11.377 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.365+0000 7f3839542700 1 --2- 172.21.15.86:0/2530416516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38340ad920 0x7f38340ab740 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f3834155580 tx=0x7f382c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.377 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.365+0000 7f383a7a4700 1 -- 172.21.15.86:0/2530416516 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3834056c90 con 0x7f38340ad920 2020-04-22T14:02:11.377 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.365+0000 7f38317fa700 1 -- 172.21.15.86:0/2530416516 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 3) v1 ==== 59559+0+0 (secure 0 0 0) 0x7f382c0107e0 con 0x7f38340ad920 2020-04-22T14:02:11.378 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.365+0000 7f3839542700 1 --2- 172.21.15.86:0/2530416516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38340ad920 0x7f38340ab740 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f3834155580 tx=0x7f382c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.378 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.366+0000 7f38317fa700 1 --2- 172.21.15.86:0/2530416516 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f381804d7d0 0x7f381804fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:11.378 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.366+0000 7f38317fa700 1 -- 172.21.15.86:0/2530416516 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1269+0+0 (secure 0 0 0) 0x7f382c061f10 con 0x7f38340ad920 2020-04-22T14:02:11.378 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.366+0000 7f3838d41700 1 --2- 172.21.15.86:0/2530416516 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f381804d7d0 0x7f381804fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:11.378 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.366+0000 7f3838d41700 1 --2- 172.21.15.86:0/2530416516 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f381804d7d0 0x7f381804fc90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3824002f30 tx=0x7f3824008d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.378 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.366+0000 7f3838d41700 1 --2- 172.21.15.86:0/2530416516 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f381804d7d0 0x7f381804fc90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3824002f30 tx=0x7f3824008d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.378 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.366+0000 7f3838d41700 1 --2- 172.21.15.86:0/2530416516 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f381804d7d0 0x7f381804fc90 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7f3824002f30 tx=0x7f3824008d10).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:11.378 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.369+0000 7f3839542700 1 --2- 172.21.15.86:0/2530416516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38340ad920 0x7f38340ab740 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f3834155580 tx=0x7f382c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.379 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.369+0000 7f38317fa700 1 -- 172.21.15.86:0/2530416516 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f382c03d490 con 0x7f38340ad920 2020-04-22T14:02:11.532 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.529+0000 7f383a7a4700 1 -- 172.21.15.86:0/2530416516 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd new", "uuid": "65ca5f7d-2ea6-4de6-a034-08a0a99aa80d", "id": 1} v 0) v1 -- 0x7f383406a8b0 con 0x7f38340ad920 2020-04-22T14:02:11.539 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.537+0000 7f3839542700 1 --2- 172.21.15.86:0/2530416516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38340ad920 0x7f38340ab740 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f3834155580 tx=0x7f382c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.539 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.537+0000 7f38317fa700 1 -- 172.21.15.86:0/2530416516 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "65ca5f7d-2ea6-4de6-a034-08a0a99aa80d", "id": 1}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f382c040ab0 con 0x7f38340ad920 2020-04-22T14:02:11.540 INFO:teuthology.orchestra.run.smithi086.stdout:1 2020-04-22T14:02:11.541 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.539+0000 7f383a7a4700 1 -- 172.21.15.86:0/2530416516 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f381804d7d0 msgr2=0x7f381804fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:11.541 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.539+0000 7f383a7a4700 1 --2- 172.21.15.86:0/2530416516 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f381804d7d0 0x7f381804fc90 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7f3824002f30 tx=0x7f3824008d10).stop 2020-04-22T14:02:11.542 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.539+0000 7f383a7a4700 1 -- 172.21.15.86:0/2530416516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38340ad920 msgr2=0x7f38340ab740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:11.542 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.539+0000 7f383a7a4700 1 --2- 172.21.15.86:0/2530416516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38340ad920 0x7f38340ab740 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7f3834155580 tx=0x7f382c007dc0).stop 2020-04-22T14:02:11.542 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.539+0000 7f383a7a4700 1 -- 172.21.15.86:0/2530416516 shutdown_connections 2020-04-22T14:02:11.542 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.539+0000 7f383a7a4700 1 --2- 172.21.15.86:0/2530416516 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f381804d7d0 0x7f381804fc90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:11.542 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.539+0000 7f383a7a4700 1 --2- 172.21.15.86:0/2530416516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38340ad920 0x7f38340ab740 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:11.542 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.539+0000 7f383a7a4700 1 -- 172.21.15.86:0/2530416516 >> 172.21.15.86:0/2530416516 conn(0x7f383406a0f0 msgr2=0x7f3834066dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:11.542 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.539+0000 7f383a7a4700 1 -- 172.21.15.86:0/2530416516 shutdown_connections 2020-04-22T14:02:11.543 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.539+0000 7f383a7a4700 1 -- 172.21.15.86:0/2530416516 wait complete. 2020-04-22T14:02:11.551 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:11.564 INFO:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new f2e9bf44-c844-48d7-b6c2-f08ea71189b4 2 2020-04-22T14:02:11.718 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.712+0000 7fd35fad4700 1 Processor -- start 2020-04-22T14:02:11.718 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.712+0000 7fd35fad4700 1 -- start start 2020-04-22T14:02:11.718 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.713+0000 7fd35fad4700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd35805b7c0 0x7fd3580af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:11.718 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.713+0000 7fd35fad4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd3580ad920 0x7fd35807fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:11.718 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.713+0000 7fd35fad4700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd358080020 0x7fd3580668c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:11.718 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.713+0000 7fd35fad4700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3580b5630 con 0x7fd358080020 2020-04-22T14:02:11.719 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.713+0000 7fd35fad4700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3580b58d0 con 0x7fd35805b7c0 2020-04-22T14:02:11.719 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.713+0000 7fd35fad4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3580b5b70 con 0x7fd3580ad920 2020-04-22T14:02:11.719 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.713+0000 7fd35e872700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd358080020 0x7fd3580668c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:11.719 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.713+0000 7fd35e872700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd358080020 0x7fd3580668c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45242/0 (socket says 172.21.15.86:45242) 2020-04-22T14:02:11.719 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.713+0000 7fd35e872700 1 -- 172.21.15.86:0/406774236 learned_addr learned my addr 172.21.15.86:0/406774236 (peer_addr_for_me v2:172.21.15.86:0/0) 2020-04-22T14:02:11.719 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.713+0000 7fd35d870700 1 --2- 172.21.15.86:0/406774236 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd3580ad920 0x7fd35807fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:11.719 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.713+0000 7fd35e071700 1 --2- 172.21.15.86:0/406774236 >> v2:172.21.15.103:3300/0 conn(0x7fd35805b7c0 0x7fd3580af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:11.720 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.713+0000 7fd35e872700 1 -- 172.21.15.86:0/406774236 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd3580ad920 msgr2=0x7fd35807fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:11.720 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.713+0000 7fd35e872700 1 --2- 172.21.15.86:0/406774236 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd3580ad920 0x7fd35807fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:11.720 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.713+0000 7fd35e872700 1 -- 172.21.15.86:0/406774236 >> v2:172.21.15.103:3300/0 conn(0x7fd35805b7c0 msgr2=0x7fd3580af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:11.720 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.713+0000 7fd35e872700 1 --2- 172.21.15.86:0/406774236 >> v2:172.21.15.103:3300/0 conn(0x7fd35805b7c0 0x7fd3580af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:11.720 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.713+0000 7fd35e872700 1 -- 172.21.15.86:0/406774236 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd35805bba0 con 0x7fd358080020 2020-04-22T14:02:11.720 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.713+0000 7fd35e071700 1 --2- 172.21.15.86:0/406774236 >> v2:172.21.15.103:3300/0 conn(0x7fd35805b7c0 0x7fd3580af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:02:11.720 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.713+0000 7fd35d870700 1 --2- 172.21.15.86:0/406774236 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd3580ad920 0x7fd35807fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:02:11.721 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.713+0000 7fd35e872700 1 --2- 172.21.15.86:0/406774236 >> v2:172.21.15.86:3300/0 conn(0x7fd358080020 0x7fd3580668c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd3500032b0 tx=0x7fd350007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.721 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.713+0000 7fd35e872700 1 --2- 172.21.15.86:0/406774236 >> v2:172.21.15.86:3300/0 conn(0x7fd358080020 0x7fd3580668c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd3500032b0 tx=0x7fd350007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.721 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.713+0000 7fd35e872700 1 --2- 172.21.15.86:0/406774236 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd358080020 0x7fd3580668c0 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7fd3500032b0 tx=0x7fd350007dc0).ready entity=mon.0 client_cookie=ac068a089288fd9a server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:11.721 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.714+0000 7fd35e872700 1 --2- 172.21.15.86:0/406774236 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd358080020 0x7fd3580668c0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7fd3500032b0 tx=0x7fd350007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.721 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.714+0000 7fd35d06f700 1 -- 172.21.15.86:0/406774236 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd35000a180 con 0x7fd358080020 2020-04-22T14:02:11.721 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.714+0000 7fd35e872700 1 --2- 172.21.15.86:0/406774236 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd358080020 0x7fd3580668c0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7fd3500032b0 tx=0x7fd350007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.721 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.714+0000 7fd35e872700 1 --2- 172.21.15.86:0/406774236 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd358080020 0x7fd3580668c0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7fd3500032b0 tx=0x7fd350007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.721 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.714+0000 7fd35d06f700 1 -- 172.21.15.86:0/406774236 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd35000a2e0 con 0x7fd358080020 2020-04-22T14:02:11.722 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.714+0000 7fd35d06f700 1 -- 172.21.15.86:0/406774236 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd35000a700 con 0x7fd358080020 2020-04-22T14:02:11.722 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.714+0000 7fd35fad4700 1 -- 172.21.15.86:0/406774236 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd358080020 msgr2=0x7fd3580668c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:11.722 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.714+0000 7fd35fad4700 1 --2- 172.21.15.86:0/406774236 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd358080020 0x7fd3580668c0 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7fd3500032b0 tx=0x7fd350007dc0).stop 2020-04-22T14:02:11.722 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.714+0000 7fd35fad4700 1 -- 172.21.15.86:0/406774236 shutdown_connections 2020-04-22T14:02:11.722 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.714+0000 7fd35fad4700 1 --2- 172.21.15.86:0/406774236 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd358080020 0x7fd3580668c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:11.722 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.714+0000 7fd35fad4700 1 --2- 172.21.15.86:0/406774236 >> v2:172.21.15.103:3300/0 conn(0x7fd35805b7c0 0x7fd3580af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:11.722 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.714+0000 7fd35fad4700 1 --2- 172.21.15.86:0/406774236 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd3580ad920 0x7fd35807fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:11.723 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.714+0000 7fd35fad4700 1 -- 172.21.15.86:0/406774236 >> 172.21.15.86:0/406774236 conn(0x7fd35806a0f0 msgr2=0x7fd35805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:11.723 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.714+0000 7fd35fad4700 1 -- 172.21.15.86:0/406774236 shutdown_connections 2020-04-22T14:02:11.723 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.714+0000 7fd35fad4700 1 -- 172.21.15.86:0/406774236 wait complete. 2020-04-22T14:02:11.723 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.715+0000 7fd35fad4700 1 Processor -- start 2020-04-22T14:02:11.723 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.715+0000 7fd35fad4700 1 -- start start 2020-04-22T14:02:11.726 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.716+0000 7fd35fad4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd358080020 0x7fd358062eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:11.727 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.716+0000 7fd35fad4700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3580654b0 con 0x7fd35805b7c0 2020-04-22T14:02:11.727 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.716+0000 7fd35fad4700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd358065790 con 0x7fd3580ad920 2020-04-22T14:02:11.727 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.716+0000 7fd35fad4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3580652d0 con 0x7fd358080020 2020-04-22T14:02:11.727 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.716+0000 7fd35e071700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fd35805b7c0 0x7fd3581526d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:42326/0 (socket says 172.21.15.86:42326) 2020-04-22T14:02:11.727 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.716+0000 7fd35e071700 1 -- 172.21.15.86:0/2404723321 learned_addr learned my addr 172.21.15.86:0/2404723321 (peer_addr_for_me v1:172.21.15.86:0/0) 2020-04-22T14:02:11.727 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.716+0000 7fd35d870700 1 --2- 172.21.15.86:0/2404723321 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd358080020 0x7fd358062eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:11.727 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.716+0000 7fd34effd700 1 -- 172.21.15.86:0/2404723321 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1740112487 0 0) 0x7fd3580654b0 con 0x7fd35805b7c0 2020-04-22T14:02:11.728 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.716+0000 7fd34effd700 1 -- 172.21.15.86:0/2404723321 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd340003230 con 0x7fd35805b7c0 2020-04-22T14:02:11.728 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.716+0000 7fd35d870700 1 -- 172.21.15.86:0/2404723321 >> v1:172.21.15.103:6789/0 conn(0x7fd3580ad920 legacy=0x7fd358065c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:11.728 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.716+0000 7fd35d870700 1 -- 172.21.15.86:0/2404723321 >> v1:172.21.15.86:6789/0 conn(0x7fd35805b7c0 legacy=0x7fd3581526d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:11.728 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.716+0000 7fd35d870700 1 -- 172.21.15.86:0/2404723321 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd358152de0 con 0x7fd358080020 2020-04-22T14:02:11.728 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.716+0000 7fd35d870700 1 --2- 172.21.15.86:0/2404723321 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd358080020 0x7fd358062eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd358155950 tx=0x7fd348010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.728 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.717+0000 7fd35d870700 1 --2- 172.21.15.86:0/2404723321 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd358080020 0x7fd358062eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd358155950 tx=0x7fd348010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.728 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.717+0000 7fd35d870700 1 --2- 172.21.15.86:0/2404723321 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd358080020 0x7fd358062eb0 secure :-1 s=READY pgs=9 cs=0 l=1 rx=0x7fd358155950 tx=0x7fd348010d00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:11.729 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.717+0000 7fd35d870700 1 --2- 172.21.15.86:0/2404723321 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd358080020 0x7fd358062eb0 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7fd358155950 tx=0x7fd348010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.729 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.717+0000 7fd35d870700 1 --2- 172.21.15.86:0/2404723321 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd358080020 0x7fd358062eb0 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7fd358155950 tx=0x7fd348010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.729 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.717+0000 7fd34effd700 1 -- 172.21.15.86:0/2404723321 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd348007550 con 0x7fd358080020 2020-04-22T14:02:11.729 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.717+0000 7fd35d870700 1 --2- 172.21.15.86:0/2404723321 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd358080020 0x7fd358062eb0 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7fd358155950 tx=0x7fd348010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.729 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.717+0000 7fd34effd700 1 -- 172.21.15.86:0/2404723321 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34800c6d0 con 0x7fd358080020 2020-04-22T14:02:11.730 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.717+0000 7fd35fad4700 1 -- 172.21.15.86:0/2404723321 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd358131b00 con 0x7fd358080020 2020-04-22T14:02:11.730 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.717+0000 7fd34effd700 1 -- 172.21.15.86:0/2404723321 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd34800cab0 con 0x7fd358080020 2020-04-22T14:02:11.730 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.717+0000 7fd35fad4700 1 -- 172.21.15.86:0/2404723321 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd358064fa0 con 0x7fd358080020 2020-04-22T14:02:11.730 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.717+0000 7fd35d870700 1 --2- 172.21.15.86:0/2404723321 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd358080020 0x7fd358062eb0 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7fd358155950 tx=0x7fd348010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.730 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.718+0000 7fd34effd700 1 -- 172.21.15.86:0/2404723321 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 3) v1 ==== 59559+0+0 (secure 0 0 0) 0x7fd34800cc10 con 0x7fd358080020 2020-04-22T14:02:11.730 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.718+0000 7fd35d870700 1 --2- 172.21.15.86:0/2404723321 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd358080020 0x7fd358062eb0 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7fd358155950 tx=0x7fd348010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.731 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.718+0000 7fd35fad4700 1 -- 172.21.15.86:0/2404723321 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd358056c90 con 0x7fd358080020 2020-04-22T14:02:11.731 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.718+0000 7fd34effd700 1 --2- 172.21.15.86:0/2404723321 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd34004dc70 0x7fd340050130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:11.731 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.718+0000 7fd34effd700 1 -- 172.21.15.86:0/2404723321 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1384+0+0 (secure 0 0 0) 0x7fd3480614f0 con 0x7fd358080020 2020-04-22T14:02:11.731 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.718+0000 7fd35e071700 1 --2- 172.21.15.86:0/2404723321 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd34004dc70 0x7fd340050130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:11.731 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.718+0000 7fd35e071700 1 --2- 172.21.15.86:0/2404723321 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd34004dc70 0x7fd340050130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd354002f30 tx=0x7fd3540024b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.731 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.718+0000 7fd35e071700 1 --2- 172.21.15.86:0/2404723321 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd34004dc70 0x7fd340050130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd354002f30 tx=0x7fd3540024b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.731 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.718+0000 7fd35e071700 1 --2- 172.21.15.86:0/2404723321 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd34004dc70 0x7fd340050130 secure :-1 s=READY pgs=11 cs=0 l=1 rx=0x7fd354002f30 tx=0x7fd3540024b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:11.732 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.722+0000 7fd35d870700 1 --2- 172.21.15.86:0/2404723321 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd358080020 0x7fd358062eb0 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7fd358155950 tx=0x7fd348010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.732 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.722+0000 7fd34effd700 1 -- 172.21.15.86:0/2404723321 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fd34803c9b0 con 0x7fd358080020 2020-04-22T14:02:11.883 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.880+0000 7fd35fad4700 1 -- 172.21.15.86:0/2404723321 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f2e9bf44-c844-48d7-b6c2-f08ea71189b4", "id": 2} v 0) v1 -- 0x7fd35806a8b0 con 0x7fd358080020 2020-04-22T14:02:11.928 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.889+0000 7fd35d870700 1 --2- 172.21.15.86:0/2404723321 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd358080020 0x7fd358062eb0 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7fd358155950 tx=0x7fd348010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:11.928 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.889+0000 7fd34effd700 1 -- 172.21.15.86:0/2404723321 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f2e9bf44-c844-48d7-b6c2-f08ea71189b4", "id": 2}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd34803ffd0 con 0x7fd358080020 2020-04-22T14:02:11.928 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.890+0000 7fd35fad4700 1 -- 172.21.15.86:0/2404723321 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd34004dc70 msgr2=0x7fd340050130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:11.929 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.890+0000 7fd35fad4700 1 --2- 172.21.15.86:0/2404723321 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd34004dc70 0x7fd340050130 secure :-1 s=READY pgs=11 cs=0 l=1 rx=0x7fd354002f30 tx=0x7fd3540024b0).stop 2020-04-22T14:02:11.929 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.890+0000 7fd35fad4700 1 -- 172.21.15.86:0/2404723321 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd358080020 msgr2=0x7fd358062eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:11.929 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.890+0000 7fd35fad4700 1 --2- 172.21.15.86:0/2404723321 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd358080020 0x7fd358062eb0 secure :-1 s=READY pgs=9 cs=0 l=1 rx=0x7fd358155950 tx=0x7fd348010d00).stop 2020-04-22T14:02:11.929 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.890+0000 7fd35fad4700 1 -- 172.21.15.86:0/2404723321 shutdown_connections 2020-04-22T14:02:11.929 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.890+0000 7fd35fad4700 1 --2- 172.21.15.86:0/2404723321 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd34004dc70 0x7fd340050130 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:11.930 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.890+0000 7fd35fad4700 1 --2- 172.21.15.86:0/2404723321 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd358080020 0x7fd358062eb0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:11.930 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.890+0000 7fd35fad4700 1 -- 172.21.15.86:0/2404723321 >> 172.21.15.86:0/2404723321 conn(0x7fd35806a0f0 msgr2=0x7fd3580b1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:11.930 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.891+0000 7fd35fad4700 1 -- 172.21.15.86:0/2404723321 shutdown_connections 2020-04-22T14:02:11.930 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:11.891+0000 7fd35fad4700 1 -- 172.21.15.86:0/2404723321 wait complete. 2020-04-22T14:02:11.930 INFO:teuthology.orchestra.run.smithi086.stdout:2 2020-04-22T14:02:11.931 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:11.950 INFO:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new 0ab87fee-a427-4906-851a-b9bd8c2e5645 3 2020-04-22T14:02:12.097 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.092+0000 7f5a2e56c700 1 Processor -- start 2020-04-22T14:02:12.097 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.092+0000 7f5a2e56c700 1 -- start start 2020-04-22T14:02:12.097 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.092+0000 7f5a2e56c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5a2805b7c0 0x7f5a280af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:12.097 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.092+0000 7f5a2e56c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5a280ad920 0x7f5a2807fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:12.098 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.092+0000 7f5a2e56c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a280b58d0 con 0x7f5a28080020 2020-04-22T14:02:12.098 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.092+0000 7f5a2e56c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a280b56c0 con 0x7f5a2805b7c0 2020-04-22T14:02:12.098 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.092+0000 7f5a2e56c700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a280b5b70 con 0x7f5a280ad920 2020-04-22T14:02:12.098 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.093+0000 7f5a2cb09700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5a2805b7c0 0x7f5a280af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:12.098 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.093+0000 7f5a2cb09700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5a2805b7c0 0x7f5a280af030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45254/0 (socket says 172.21.15.86:45254) 2020-04-22T14:02:12.098 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.093+0000 7f5a2cb09700 1 -- 172.21.15.86:0/2146973667 learned_addr learned my addr 172.21.15.86:0/2146973667 (peer_addr_for_me v2:172.21.15.86:0/0) 2020-04-22T14:02:12.098 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.093+0000 7f5a27fff700 1 --2- 172.21.15.86:0/2146973667 >> v2:172.21.15.103:3300/0 conn(0x7f5a280ad920 0x7f5a2807fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:12.099 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.093+0000 7f5a2cb09700 1 -- 172.21.15.86:0/2146973667 >> v2:172.21.15.103:3300/0 conn(0x7f5a280ad920 msgr2=0x7f5a2807fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:12.099 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.093+0000 7f5a2cb09700 1 --2- 172.21.15.86:0/2146973667 >> v2:172.21.15.103:3300/0 conn(0x7f5a280ad920 0x7f5a2807fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:12.099 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.093+0000 7f5a2cb09700 1 -- 172.21.15.86:0/2146973667 >> v1:172.21.15.103:6789/0 conn(0x7f5a28080020 legacy=0x7f5a280668c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:12.099 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.093+0000 7f5a2cb09700 1 -- 172.21.15.86:0/2146973667 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2805bba0 con 0x7f5a2805b7c0 2020-04-22T14:02:12.099 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.093+0000 7f5a27fff700 1 --2- 172.21.15.86:0/2146973667 >> v2:172.21.15.103:3300/0 conn(0x7f5a280ad920 0x7f5a2807fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:02:12.099 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.093+0000 7f5a2cb09700 1 --2- 172.21.15.86:0/2146973667 >> v2:172.21.15.86:3300/0 conn(0x7f5a2805b7c0 0x7f5a280af030 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5a280b2f60 tx=0x7f5a18007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.099 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.093+0000 7f5a2cb09700 1 --2- 172.21.15.86:0/2146973667 >> v2:172.21.15.86:3300/0 conn(0x7f5a2805b7c0 0x7f5a280af030 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5a280b2f60 tx=0x7f5a18007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.099 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.093+0000 7f5a2cb09700 1 --2- 172.21.15.86:0/2146973667 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a2805b7c0 0x7f5a280af030 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7f5a280b2f60 tx=0x7f5a18007a40).ready entity=mon.0 client_cookie=d3a60c1c26353dae server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:12.100 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.093+0000 7f5a2cb09700 1 --2- 172.21.15.86:0/2146973667 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a2805b7c0 0x7f5a280af030 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f5a280b2f60 tx=0x7f5a18007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.100 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.093+0000 7f5a2cb09700 1 --2- 172.21.15.86:0/2146973667 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a2805b7c0 0x7f5a280af030 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f5a280b2f60 tx=0x7f5a18007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.100 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.093+0000 7f5a277fe700 1 -- 172.21.15.86:0/2146973667 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a180116e0 con 0x7f5a2805b7c0 2020-04-22T14:02:12.100 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.093+0000 7f5a2cb09700 1 --2- 172.21.15.86:0/2146973667 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a2805b7c0 0x7f5a280af030 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f5a280b2f60 tx=0x7f5a18007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.100 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.093+0000 7f5a277fe700 1 -- 172.21.15.86:0/2146973667 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a18011840 con 0x7f5a2805b7c0 2020-04-22T14:02:12.100 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.093+0000 7f5a277fe700 1 -- 172.21.15.86:0/2146973667 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a18011c20 con 0x7f5a2805b7c0 2020-04-22T14:02:12.100 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.093+0000 7f5a2e56c700 1 -- 172.21.15.86:0/2146973667 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a2805b7c0 msgr2=0x7f5a280af030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:12.101 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.093+0000 7f5a2e56c700 1 --2- 172.21.15.86:0/2146973667 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a2805b7c0 0x7f5a280af030 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7f5a280b2f60 tx=0x7f5a18007a40).stop 2020-04-22T14:02:12.101 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.094+0000 7f5a2e56c700 1 -- 172.21.15.86:0/2146973667 shutdown_connections 2020-04-22T14:02:12.101 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.094+0000 7f5a2e56c700 1 --2- 172.21.15.86:0/2146973667 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a2805b7c0 0x7f5a280af030 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:12.101 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.094+0000 7f5a2e56c700 1 --2- 172.21.15.86:0/2146973667 >> v2:172.21.15.103:3300/0 conn(0x7f5a280ad920 0x7f5a2807fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:12.101 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.094+0000 7f5a2e56c700 1 -- 172.21.15.86:0/2146973667 >> 172.21.15.86:0/2146973667 conn(0x7f5a2806a0f0 msgr2=0x7f5a2805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:12.101 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.094+0000 7f5a2e56c700 1 -- 172.21.15.86:0/2146973667 shutdown_connections 2020-04-22T14:02:12.101 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.094+0000 7f5a2e56c700 1 -- 172.21.15.86:0/2146973667 wait complete. 2020-04-22T14:02:12.102 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.095+0000 7f5a2e56c700 1 Processor -- start 2020-04-22T14:02:12.102 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.095+0000 7f5a2e56c700 1 -- start start 2020-04-22T14:02:12.105 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.096+0000 7f5a2e56c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5a2805b7c0 0x7f5a28138db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:12.105 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.096+0000 7f5a2e56c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5a28080020 0x7f5a280662a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:12.105 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.096+0000 7f5a2e56c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a280ad920 0x7f5a280616f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:12.105 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.096+0000 7f5a2e56c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a28061b50 con 0x7f5a28080020 2020-04-22T14:02:12.105 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.096+0000 7f5a2e56c700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a28139d10 con 0x7f5a2805b7c0 2020-04-22T14:02:12.105 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.096+0000 7f5a2e56c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a28156030 con 0x7f5a280ad920 2020-04-22T14:02:12.106 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.096+0000 7f5a27fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5a28080020 0x7f5a280662a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:12.106 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.096+0000 7f5a27fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5a28080020 0x7f5a280662a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45260/0 (socket says 172.21.15.86:45260) 2020-04-22T14:02:12.106 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.096+0000 7f5a2d30a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a280ad920 0x7f5a280616f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:12.106 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.096+0000 7f5a27fff700 1 -- 172.21.15.86:0/2428741760 learned_addr learned my addr 172.21.15.86:0/2428741760 (peer_addr_for_me v2:172.21.15.86:0/0) 2020-04-22T14:02:12.106 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.096+0000 7f5a2cb09700 1 --2- 172.21.15.86:0/2428741760 >> v2:172.21.15.103:3300/0 conn(0x7f5a2805b7c0 0x7f5a28138db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:12.106 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.096+0000 7f5a27fff700 1 -- 172.21.15.86:0/2428741760 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a280ad920 msgr2=0x7f5a280616f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:12.106 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.096+0000 7f5a27fff700 1 --2- 172.21.15.86:0/2428741760 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a280ad920 0x7f5a280616f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:12.107 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.096+0000 7f5a27fff700 1 -- 172.21.15.86:0/2428741760 >> v2:172.21.15.103:3300/0 conn(0x7f5a2805b7c0 msgr2=0x7f5a28138db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:12.107 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.096+0000 7f5a27fff700 1 --2- 172.21.15.86:0/2428741760 >> v2:172.21.15.103:3300/0 conn(0x7f5a2805b7c0 0x7f5a28138db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:12.107 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.096+0000 7f5a27fff700 1 -- 172.21.15.86:0/2428741760 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a28139330 con 0x7f5a28080020 2020-04-22T14:02:12.107 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.096+0000 7f5a27fff700 1 --2- 172.21.15.86:0/2428741760 >> v2:172.21.15.86:3300/0 conn(0x7f5a28080020 0x7f5a280662a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5a10002f30 tx=0x7f5a10010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.107 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.096+0000 7f5a27fff700 1 --2- 172.21.15.86:0/2428741760 >> v2:172.21.15.86:3300/0 conn(0x7f5a28080020 0x7f5a280662a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5a10002f30 tx=0x7f5a10010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.107 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.096+0000 7f5a27fff700 1 --2- 172.21.15.86:0/2428741760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a28080020 0x7f5a280662a0 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7f5a10002f30 tx=0x7f5a10010a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:12.107 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.096+0000 7f5a27fff700 1 --2- 172.21.15.86:0/2428741760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a28080020 0x7f5a280662a0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f5a10002f30 tx=0x7f5a10010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.108 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.096+0000 7f5a257fa700 1 -- 172.21.15.86:0/2428741760 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a10001190 con 0x7f5a28080020 2020-04-22T14:02:12.108 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.096+0000 7f5a27fff700 1 --2- 172.21.15.86:0/2428741760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a28080020 0x7f5a280662a0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f5a10002f30 tx=0x7f5a10010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.108 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.096+0000 7f5a27fff700 1 --2- 172.21.15.86:0/2428741760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a28080020 0x7f5a280662a0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f5a10002f30 tx=0x7f5a10010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.108 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.096+0000 7f5a257fa700 1 -- 172.21.15.86:0/2428741760 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a100012f0 con 0x7f5a28080020 2020-04-22T14:02:12.108 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.096+0000 7f5a2e56c700 1 -- 172.21.15.86:0/2428741760 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a281395d0 con 0x7f5a28080020 2020-04-22T14:02:12.108 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.096+0000 7f5a257fa700 1 -- 172.21.15.86:0/2428741760 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a100016d0 con 0x7f5a28080020 2020-04-22T14:02:12.108 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.096+0000 7f5a2e56c700 1 -- 172.21.15.86:0/2428741760 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a2807ee70 con 0x7f5a28080020 2020-04-22T14:02:12.109 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.097+0000 7f5a27fff700 1 --2- 172.21.15.86:0/2428741760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a28080020 0x7f5a280662a0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f5a10002f30 tx=0x7f5a10010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.109 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.097+0000 7f5a2e56c700 1 -- 172.21.15.86:0/2428741760 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a28139a30 con 0x7f5a28080020 2020-04-22T14:02:12.109 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.097+0000 7f5a257fa700 1 -- 172.21.15.86:0/2428741760 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 3) v1 ==== 59559+0+0 (secure 0 0 0) 0x7f5a10001940 con 0x7f5a28080020 2020-04-22T14:02:12.109 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.097+0000 7f5a27fff700 1 --2- 172.21.15.86:0/2428741760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a28080020 0x7f5a280662a0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f5a10002f30 tx=0x7f5a10010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.109 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.098+0000 7f5a257fa700 1 --2- 172.21.15.86:0/2428741760 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5a0c04d8f0 0x7f5a0c04fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:12.109 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.098+0000 7f5a257fa700 1 -- 172.21.15.86:0/2428741760 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1499+0+0 (secure 0 0 0) 0x7f5a10060ea0 con 0x7f5a28080020 2020-04-22T14:02:12.110 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.098+0000 7f5a2cb09700 1 --2- 172.21.15.86:0/2428741760 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5a0c04d8f0 0x7f5a0c04fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:12.110 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.098+0000 7f5a2cb09700 1 --2- 172.21.15.86:0/2428741760 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5a0c04d8f0 0x7f5a0c04fdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5a280b2f60 tx=0x7f5a18007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.110 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.098+0000 7f5a2cb09700 1 --2- 172.21.15.86:0/2428741760 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5a0c04d8f0 0x7f5a0c04fdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5a280b2f60 tx=0x7f5a18007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.110 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.098+0000 7f5a2cb09700 1 --2- 172.21.15.86:0/2428741760 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5a0c04d8f0 0x7f5a0c04fdb0 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7f5a280b2f60 tx=0x7f5a18007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:12.110 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.101+0000 7f5a27fff700 1 --2- 172.21.15.86:0/2428741760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a28080020 0x7f5a280662a0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f5a10002f30 tx=0x7f5a10010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.110 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.101+0000 7f5a257fa700 1 -- 172.21.15.86:0/2428741760 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f5a1003c360 con 0x7f5a28080020 2020-04-22T14:02:12.261 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.259+0000 7f5a2e56c700 1 -- 172.21.15.86:0/2428741760 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0ab87fee-a427-4906-851a-b9bd8c2e5645", "id": 3} v 0) v1 -- 0x7f5a28056c90 con 0x7f5a28080020 2020-04-22T14:02:12.269 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.267+0000 7f5a27fff700 1 --2- 172.21.15.86:0/2428741760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a28080020 0x7f5a280662a0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f5a10002f30 tx=0x7f5a10010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.269 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.267+0000 7f5a257fa700 1 -- 172.21.15.86:0/2428741760 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0ab87fee-a427-4906-851a-b9bd8c2e5645", "id": 3}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5a1003f980 con 0x7f5a28080020 2020-04-22T14:02:12.270 INFO:teuthology.orchestra.run.smithi086.stdout:3 2020-04-22T14:02:12.271 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.269+0000 7f5a2e56c700 1 -- 172.21.15.86:0/2428741760 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5a0c04d8f0 msgr2=0x7f5a0c04fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:12.271 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.269+0000 7f5a2e56c700 1 --2- 172.21.15.86:0/2428741760 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5a0c04d8f0 0x7f5a0c04fdb0 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7f5a280b2f60 tx=0x7f5a18007a40).stop 2020-04-22T14:02:12.272 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.269+0000 7f5a2e56c700 1 -- 172.21.15.86:0/2428741760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a28080020 msgr2=0x7f5a280662a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:12.272 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.269+0000 7f5a2e56c700 1 --2- 172.21.15.86:0/2428741760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a28080020 0x7f5a280662a0 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7f5a10002f30 tx=0x7f5a10010a80).stop 2020-04-22T14:02:12.272 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.269+0000 7f5a2e56c700 1 -- 172.21.15.86:0/2428741760 shutdown_connections 2020-04-22T14:02:12.272 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.269+0000 7f5a2e56c700 1 --2- 172.21.15.86:0/2428741760 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a280ad920 0x7f5a280616f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:12.272 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.269+0000 7f5a2e56c700 1 --2- 172.21.15.86:0/2428741760 >> v2:172.21.15.103:3300/0 conn(0x7f5a2805b7c0 0x7f5a28138db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:12.272 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.269+0000 7f5a2e56c700 1 --2- 172.21.15.86:0/2428741760 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5a0c04d8f0 0x7f5a0c04fdb0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:12.273 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.269+0000 7f5a2e56c700 1 --2- 172.21.15.86:0/2428741760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a28080020 0x7f5a280662a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:12.273 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.269+0000 7f5a2e56c700 1 -- 172.21.15.86:0/2428741760 >> 172.21.15.86:0/2428741760 conn(0x7f5a2806a0f0 msgr2=0x7f5a280af930 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:12.273 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.269+0000 7f5a2e56c700 1 -- 172.21.15.86:0/2428741760 shutdown_connections 2020-04-22T14:02:12.273 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.269+0000 7f5a2e56c700 1 -- 172.21.15.86:0/2428741760 wait complete. 2020-04-22T14:02:12.281 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:12.294 INFO:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new 2565df7d-2eff-484b-a3cd-ed7715e5d875 4 2020-04-22T14:02:12.439 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.434+0000 7fc5b5049700 1 Processor -- start 2020-04-22T14:02:12.439 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.435+0000 7fc5b5049700 1 -- start start 2020-04-22T14:02:12.440 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.435+0000 7fc5b5049700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc5b005b7c0 0x7fc5b00af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:12.440 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.435+0000 7fc5b5049700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5b00ad920 0x7fc5b007fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:12.440 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.435+0000 7fc5b5049700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b00b5630 con 0x7fc5b0080020 2020-04-22T14:02:12.440 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.435+0000 7fc5b5049700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b00b58d0 con 0x7fc5b005b7c0 2020-04-22T14:02:12.440 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.435+0000 7fc5b5049700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b00b5b70 con 0x7fc5b00ad920 2020-04-22T14:02:12.440 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.435+0000 7fc5aed9d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5b00ad920 0x7fc5b007fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:12.440 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.435+0000 7fc5af59e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc5b005b7c0 0x7fc5b00af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:12.441 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.435+0000 7fc5aed9d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5b00ad920 0x7fc5b007fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.86:60376/0 (socket says 172.21.15.86:60376) 2020-04-22T14:02:12.441 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.435+0000 7fc5aed9d700 1 -- 172.21.15.86:0/847605434 learned_addr learned my addr 172.21.15.86:0/847605434 (peer_addr_for_me v2:172.21.15.86:0/0) 2020-04-22T14:02:12.441 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.436+0000 7fc5aed9d700 1 -- 172.21.15.86:0/847605434 >> v2:172.21.15.86:3300/0 conn(0x7fc5b005b7c0 msgr2=0x7fc5b00af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:12.441 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.436+0000 7fc5aed9d700 1 --2- 172.21.15.86:0/847605434 >> v2:172.21.15.86:3300/0 conn(0x7fc5b005b7c0 0x7fc5b00af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:12.441 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.436+0000 7fc5aed9d700 1 -- 172.21.15.86:0/847605434 >> v1:172.21.15.103:6789/0 conn(0x7fc5b0080020 legacy=0x7fc5b00668c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:12.441 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.436+0000 7fc5aed9d700 1 -- 172.21.15.86:0/847605434 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b005bba0 con 0x7fc5b00ad920 2020-04-22T14:02:12.441 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.436+0000 7fc5af59e700 1 --2- 172.21.15.86:0/847605434 >> v2:172.21.15.86:3300/0 conn(0x7fc5b005b7c0 0x7fc5b00af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:02:12.442 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.436+0000 7fc5aed9d700 1 --2- 172.21.15.86:0/847605434 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5b00ad920 0x7fc5b007fbc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc5a4002f30 tx=0x7fc5a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.442 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.436+0000 7fc5aed9d700 1 --2- 172.21.15.86:0/847605434 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5b00ad920 0x7fc5b007fbc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc5a4002f30 tx=0x7fc5a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.442 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.436+0000 7fc5aed9d700 1 --2- 172.21.15.86:0/847605434 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5b00ad920 0x7fc5b007fbc0 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7fc5a4002f30 tx=0x7fc5a4007a40).ready entity=mon.2 client_cookie=b495a3b1c6082de1 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:12.442 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.436+0000 7fc5aed9d700 1 --2- 172.21.15.86:0/847605434 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5b00ad920 0x7fc5b007fbc0 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7fc5a4002f30 tx=0x7fc5a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.442 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.436+0000 7fc5ae59c700 1 -- 172.21.15.86:0/847605434 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5a4011670 con 0x7fc5b00ad920 2020-04-22T14:02:12.442 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.436+0000 7fc5aed9d700 1 --2- 172.21.15.86:0/847605434 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5b00ad920 0x7fc5b007fbc0 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7fc5a4002f30 tx=0x7fc5a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.442 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.436+0000 7fc5aed9d700 1 --2- 172.21.15.86:0/847605434 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5b00ad920 0x7fc5b007fbc0 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7fc5a4002f30 tx=0x7fc5a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.443 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.436+0000 7fc5ae59c700 1 -- 172.21.15.86:0/847605434 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a40117d0 con 0x7fc5b00ad920 2020-04-22T14:02:12.443 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.436+0000 7fc5ae59c700 1 -- 172.21.15.86:0/847605434 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5a4011b70 con 0x7fc5b00ad920 2020-04-22T14:02:12.443 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.436+0000 7fc5b5049700 1 -- 172.21.15.86:0/847605434 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5b00ad920 msgr2=0x7fc5b007fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:12.443 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.436+0000 7fc5b5049700 1 --2- 172.21.15.86:0/847605434 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5b00ad920 0x7fc5b007fbc0 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7fc5a4002f30 tx=0x7fc5a4007a40).stop 2020-04-22T14:02:12.443 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.436+0000 7fc5b5049700 1 -- 172.21.15.86:0/847605434 shutdown_connections 2020-04-22T14:02:12.443 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.436+0000 7fc5b5049700 1 --2- 172.21.15.86:0/847605434 >> v2:172.21.15.86:3300/0 conn(0x7fc5b005b7c0 0x7fc5b00af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:12.443 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.436+0000 7fc5b5049700 1 --2- 172.21.15.86:0/847605434 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5b00ad920 0x7fc5b007fbc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:12.443 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.436+0000 7fc5b5049700 1 -- 172.21.15.86:0/847605434 >> 172.21.15.86:0/847605434 conn(0x7fc5b006a0f0 msgr2=0x7fc5b005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:12.444 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.436+0000 7fc5b5049700 1 -- 172.21.15.86:0/847605434 shutdown_connections 2020-04-22T14:02:12.444 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.436+0000 7fc5b5049700 1 -- 172.21.15.86:0/847605434 wait complete. 2020-04-22T14:02:12.447 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.438+0000 7fc5b5049700 1 Processor -- start 2020-04-22T14:02:12.447 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.438+0000 7fc5b5049700 1 -- start start 2020-04-22T14:02:12.447 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.438+0000 7fc5b5049700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc5b0080020 0x7fc5b0155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:12.447 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.438+0000 7fc5b5049700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5b00ad920 0x7fc5b00663f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:12.447 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.438+0000 7fc5b5049700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b0063d30 con 0x7fc5b005b7c0 2020-04-22T14:02:12.448 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.438+0000 7fc5b5049700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b0156140 con 0x7fc5b0080020 2020-04-22T14:02:12.448 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.438+0000 7fc5b5049700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b0155020 con 0x7fc5b00ad920 2020-04-22T14:02:12.448 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.438+0000 7fc5aed9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc5b0080020 0x7fc5b0155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:12.448 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.438+0000 7fc5b4848700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5b00ad920 0x7fc5b00663f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:12.448 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.438+0000 7fc5af59e700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fc5b005b7c0 0x7fc5b0061390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:42350/0 (socket says 172.21.15.86:42350) 2020-04-22T14:02:12.448 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.438+0000 7fc5af59e700 1 -- 172.21.15.86:0/3833290543 learned_addr learned my addr 172.21.15.86:0/3833290543 (peer_addr_for_me v1:172.21.15.86:0/0) 2020-04-22T14:02:12.448 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.439+0000 7fc5aed9d700 1 -- 172.21.15.86:0/3833290543 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5b00ad920 msgr2=0x7fc5b00663f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:12.454 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.439+0000 7fc5aed9d700 1 --2- 172.21.15.86:0/3833290543 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5b00ad920 0x7fc5b00663f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:12.455 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.439+0000 7fc5aed9d700 1 -- 172.21.15.86:0/3833290543 >> v1:172.21.15.86:6789/0 conn(0x7fc5b005b7c0 legacy=0x7fc5b0061390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:12.455 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.439+0000 7fc597fff700 1 -- 172.21.15.86:0/3833290543 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2405291691 0 0) 0x7fc5b0063d30 con 0x7fc5b005b7c0 2020-04-22T14:02:12.456 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.439+0000 7fc5aed9d700 1 -- 172.21.15.86:0/3833290543 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b01552c0 con 0x7fc5b0080020 2020-04-22T14:02:12.456 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.439+0000 7fc5aed9d700 1 --2- 172.21.15.86:0/3833290543 >> v2:172.21.15.86:3300/0 conn(0x7fc5b0080020 0x7fc5b0155bc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc5a4002f30 tx=0x7fc5a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.456 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.439+0000 7fc5aed9d700 1 --2- 172.21.15.86:0/3833290543 >> v2:172.21.15.86:3300/0 conn(0x7fc5b0080020 0x7fc5b0155bc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc5a4002f30 tx=0x7fc5a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.456 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.439+0000 7fc5aed9d700 1 --2- 172.21.15.86:0/3833290543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5b0080020 0x7fc5b0155bc0 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7fc5a4002f30 tx=0x7fc5a4007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:12.456 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.439+0000 7fc5aed9d700 1 --2- 172.21.15.86:0/3833290543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5b0080020 0x7fc5b0155bc0 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7fc5a4002f30 tx=0x7fc5a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.456 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.439+0000 7fc597fff700 1 -- 172.21.15.86:0/3833290543 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5a4011bb0 con 0x7fc5b0080020 2020-04-22T14:02:12.457 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.439+0000 7fc5aed9d700 1 --2- 172.21.15.86:0/3833290543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5b0080020 0x7fc5b0155bc0 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7fc5a4002f30 tx=0x7fc5a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.457 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.439+0000 7fc5b5049700 1 -- 172.21.15.86:0/3833290543 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5b0061aa0 con 0x7fc5b0080020 2020-04-22T14:02:12.457 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.439+0000 7fc597fff700 1 -- 172.21.15.86:0/3833290543 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a4007170 con 0x7fc5b0080020 2020-04-22T14:02:12.457 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.439+0000 7fc5aed9d700 1 --2- 172.21.15.86:0/3833290543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5b0080020 0x7fc5b0155bc0 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7fc5a4002f30 tx=0x7fc5a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.457 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.439+0000 7fc597fff700 1 -- 172.21.15.86:0/3833290543 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5a40074d0 con 0x7fc5b0080020 2020-04-22T14:02:12.457 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.439+0000 7fc5b5049700 1 -- 172.21.15.86:0/3833290543 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5b0152ce0 con 0x7fc5b0080020 2020-04-22T14:02:12.457 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.440+0000 7fc5aed9d700 1 --2- 172.21.15.86:0/3833290543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5b0080020 0x7fc5b0155bc0 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7fc5a4002f30 tx=0x7fc5a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.458 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.440+0000 7fc5b5049700 1 -- 172.21.15.86:0/3833290543 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5b0155680 con 0x7fc5b0080020 2020-04-22T14:02:12.458 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.440+0000 7fc597fff700 1 -- 172.21.15.86:0/3833290543 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 3) v1 ==== 59559+0+0 (secure 0 0 0) 0x7fc5a40056c0 con 0x7fc5b0080020 2020-04-22T14:02:12.458 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.440+0000 7fc5aed9d700 1 --2- 172.21.15.86:0/3833290543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5b0080020 0x7fc5b0155bc0 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7fc5a4002f30 tx=0x7fc5a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.458 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.440+0000 7fc597fff700 1 --2- 172.21.15.86:0/3833290543 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc59004d750 0x7fc59004fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:12.458 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.440+0000 7fc597fff700 1 -- 172.21.15.86:0/3833290543 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1614+0+0 (secure 0 0 0) 0x7fc5a4061640 con 0x7fc5b0080020 2020-04-22T14:02:12.458 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.440+0000 7fc5af59e700 1 --2- 172.21.15.86:0/3833290543 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc59004d750 0x7fc59004fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:12.458 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.441+0000 7fc5af59e700 1 --2- 172.21.15.86:0/3833290543 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc59004d750 0x7fc59004fc10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc5a0007a80 tx=0x7fc5a0009410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.459 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.441+0000 7fc5af59e700 1 --2- 172.21.15.86:0/3833290543 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc59004d750 0x7fc59004fc10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc5a0007a80 tx=0x7fc5a0009410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.459 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.441+0000 7fc5af59e700 1 --2- 172.21.15.86:0/3833290543 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc59004d750 0x7fc59004fc10 secure :-1 s=READY pgs=13 cs=0 l=1 rx=0x7fc5a0007a80 tx=0x7fc5a0009410).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:12.459 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.444+0000 7fc5aed9d700 1 --2- 172.21.15.86:0/3833290543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5b0080020 0x7fc5b0155bc0 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7fc5a4002f30 tx=0x7fc5a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.459 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.444+0000 7fc597fff700 1 -- 172.21.15.86:0/3833290543 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fc5a403cc20 con 0x7fc5b0080020 2020-04-22T14:02:12.553 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.538+0000 7fc5aed9d700 1 --2- 172.21.15.86:0/3833290543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5b0080020 0x7fc5b0155bc0 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7fc5a4002f30 tx=0x7fc5a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.554 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.538+0000 7fc597fff700 1 -- 172.21.15.86:0/3833290543 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fc5a403cff0 con 0x7fc5b0080020 2020-04-22T14:02:12.609 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.607+0000 7fc5b5049700 1 -- 172.21.15.86:0/3833290543 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2565df7d-2eff-484b-a3cd-ed7715e5d875", "id": 4} v 0) v1 -- 0x7fc5b0056c90 con 0x7fc5b0080020 2020-04-22T14:02:12.612 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.610+0000 7fc5aed9d700 1 --2- 172.21.15.86:0/3833290543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5b0080020 0x7fc5b0155bc0 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7fc5a4002f30 tx=0x7fc5a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.612 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.610+0000 7fc597fff700 1 -- 172.21.15.86:0/3833290543 <== mon.0 v2:172.21.15.86:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2565df7d-2eff-484b-a3cd-ed7715e5d875", "id": 4}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc5a404efb0 con 0x7fc5b0080020 2020-04-22T14:02:12.612 INFO:teuthology.orchestra.run.smithi086.stdout:4 2020-04-22T14:02:12.629 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.611+0000 7fc5b5049700 1 -- 172.21.15.86:0/3833290543 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc59004d750 msgr2=0x7fc59004fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:12.630 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.611+0000 7fc5b5049700 1 --2- 172.21.15.86:0/3833290543 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc59004d750 0x7fc59004fc10 secure :-1 s=READY pgs=13 cs=0 l=1 rx=0x7fc5a0007a80 tx=0x7fc5a0009410).stop 2020-04-22T14:02:12.630 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.611+0000 7fc5b5049700 1 -- 172.21.15.86:0/3833290543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5b0080020 msgr2=0x7fc5b0155bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:12.630 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.611+0000 7fc5b5049700 1 --2- 172.21.15.86:0/3833290543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5b0080020 0x7fc5b0155bc0 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7fc5a4002f30 tx=0x7fc5a4007a40).stop 2020-04-22T14:02:12.630 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.611+0000 7fc5b5049700 1 -- 172.21.15.86:0/3833290543 shutdown_connections 2020-04-22T14:02:12.630 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.611+0000 7fc5b5049700 1 --2- 172.21.15.86:0/3833290543 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5b00ad920 0x7fc5b00663f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:12.630 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.611+0000 7fc5b5049700 1 --2- 172.21.15.86:0/3833290543 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc59004d750 0x7fc59004fc10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:12.630 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.611+0000 7fc5b5049700 1 --2- 172.21.15.86:0/3833290543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5b0080020 0x7fc5b0155bc0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:12.631 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.611+0000 7fc5b5049700 1 -- 172.21.15.86:0/3833290543 >> 172.21.15.86:0/3833290543 conn(0x7fc5b006a0f0 msgr2=0x7fc5b00b1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:12.631 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.611+0000 7fc5b5049700 1 -- 172.21.15.86:0/3833290543 shutdown_connections 2020-04-22T14:02:12.631 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.611+0000 7fc5b5049700 1 -- 172.21.15.86:0/3833290543 wait complete. 2020-04-22T14:02:12.631 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:12.646 INFO:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new bcfd7a16-6914-4152-8647-a481917fe19d 5 2020-04-22T14:02:12.793 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.788+0000 7fc3f901c700 1 Processor -- start 2020-04-22T14:02:12.793 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.788+0000 7fc3f901c700 1 -- start start 2020-04-22T14:02:12.793 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.788+0000 7fc3f901c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3f40ad920 0x7fc3f407fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:12.793 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.788+0000 7fc3f901c700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3f40b5630 con 0x7fc3f405b7c0 2020-04-22T14:02:12.794 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.788+0000 7fc3f901c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3f40b58d0 con 0x7fc3f4080020 2020-04-22T14:02:12.794 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.788+0000 7fc3f901c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f40b5b70 con 0x7fc3f40ad920 2020-04-22T14:02:12.794 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.788+0000 7fc3f359e700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fc3f405b7c0 0x7fc3f40af030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:42358/0 (socket says 172.21.15.86:42358) 2020-04-22T14:02:12.794 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.788+0000 7fc3f359e700 1 -- 172.21.15.86:0/4279977243 learned_addr learned my addr 172.21.15.86:0/4279977243 (peer_addr_for_me v1:172.21.15.86:0/0) 2020-04-22T14:02:12.794 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.788+0000 7fc3f2d9d700 1 --2- 172.21.15.86:0/4279977243 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3f40ad920 0x7fc3f407fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:12.794 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.789+0000 7fc3f259c700 1 -- 172.21.15.86:0/4279977243 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1100642411 0 0) 0x7fc3f40b5630 con 0x7fc3f405b7c0 2020-04-22T14:02:12.794 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.789+0000 7fc3f259c700 1 -- 172.21.15.86:0/4279977243 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3dc003230 con 0x7fc3f405b7c0 2020-04-22T14:02:12.794 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.789+0000 7fc3f2d9d700 1 -- 172.21.15.86:0/4279977243 >> v1:172.21.15.103:6789/0 conn(0x7fc3f4080020 legacy=0x7fc3f40668c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:12.795 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.789+0000 7fc3f2d9d700 1 -- 172.21.15.86:0/4279977243 >> v1:172.21.15.86:6789/0 conn(0x7fc3f405b7c0 legacy=0x7fc3f40af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:12.795 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.789+0000 7fc3f2d9d700 1 -- 172.21.15.86:0/4279977243 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f405bba0 con 0x7fc3f40ad920 2020-04-22T14:02:12.795 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.789+0000 7fc3f2d9d700 1 --2- 172.21.15.86:0/4279977243 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3f40ad920 0x7fc3f407fbc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc3e8002f30 tx=0x7fc3e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.795 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.789+0000 7fc3f2d9d700 1 --2- 172.21.15.86:0/4279977243 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3f40ad920 0x7fc3f407fbc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc3e8002f30 tx=0x7fc3e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.795 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.789+0000 7fc3f2d9d700 1 --2- 172.21.15.86:0/4279977243 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3f40ad920 0x7fc3f407fbc0 secure :-1 s=READY pgs=11 cs=0 l=1 rx=0x7fc3e8002f30 tx=0x7fc3e80088e0).ready entity=mon.2 client_cookie=411c3cc44543260a server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:12.795 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.789+0000 7fc3f2d9d700 1 --2- 172.21.15.86:0/4279977243 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3f40ad920 0x7fc3f407fbc0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7fc3e8002f30 tx=0x7fc3e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.795 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.789+0000 7fc3f2d9d700 1 --2- 172.21.15.86:0/4279977243 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3f40ad920 0x7fc3f407fbc0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7fc3e8002f30 tx=0x7fc3e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.796 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.789+0000 7fc3f259c700 1 -- 172.21.15.86:0/4279977243 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3e8008e40 con 0x7fc3f40ad920 2020-04-22T14:02:12.796 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.789+0000 7fc3f2d9d700 1 --2- 172.21.15.86:0/4279977243 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3f40ad920 0x7fc3f407fbc0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7fc3e8002f30 tx=0x7fc3e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.797 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.789+0000 7fc3f259c700 1 -- 172.21.15.86:0/4279977243 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e80115f0 con 0x7fc3f40ad920 2020-04-22T14:02:12.797 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.789+0000 7fc3f259c700 1 -- 172.21.15.86:0/4279977243 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3e80119d0 con 0x7fc3f40ad920 2020-04-22T14:02:12.798 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.789+0000 7fc3f901c700 1 -- 172.21.15.86:0/4279977243 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3f40ad920 msgr2=0x7fc3f407fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:12.798 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.789+0000 7fc3f901c700 1 --2- 172.21.15.86:0/4279977243 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3f40ad920 0x7fc3f407fbc0 secure :-1 s=READY pgs=11 cs=0 l=1 rx=0x7fc3e8002f30 tx=0x7fc3e80088e0).stop 2020-04-22T14:02:12.798 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.790+0000 7fc3f901c700 1 -- 172.21.15.86:0/4279977243 shutdown_connections 2020-04-22T14:02:12.798 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.790+0000 7fc3f901c700 1 --2- 172.21.15.86:0/4279977243 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3f40ad920 0x7fc3f407fbc0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:12.798 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.790+0000 7fc3f901c700 1 -- 172.21.15.86:0/4279977243 >> 172.21.15.86:0/4279977243 conn(0x7fc3f406a0f0 msgr2=0x7fc3f405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:12.798 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.790+0000 7fc3f901c700 1 -- 172.21.15.86:0/4279977243 shutdown_connections 2020-04-22T14:02:12.798 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.790+0000 7fc3f901c700 1 -- 172.21.15.86:0/4279977243 wait complete. 2020-04-22T14:02:12.799 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.791+0000 7fc3f901c700 1 Processor -- start 2020-04-22T14:02:12.799 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.791+0000 7fc3f901c700 1 -- start start 2020-04-22T14:02:12.802 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.792+0000 7fc3f901c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc3f40ad920 0x7fc3f41546d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:12.802 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.792+0000 7fc3f901c700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3f4065330 con 0x7fc3f4080020 2020-04-22T14:02:12.802 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.792+0000 7fc3f901c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3f40655d0 con 0x7fc3f405b7c0 2020-04-22T14:02:12.802 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.792+0000 7fc3f901c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3f4152f10 con 0x7fc3f40ad920 2020-04-22T14:02:12.802 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.792+0000 7fc3f881b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc3f40ad920 0x7fc3f41546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:12.803 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.792+0000 7fc3f2d9d700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fc3f4080020 0x7fc3f4131960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:42366/0 (socket says 172.21.15.86:42366) 2020-04-22T14:02:12.803 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.792+0000 7fc3f2d9d700 1 -- 172.21.15.86:0/917646599 learned_addr learned my addr 172.21.15.86:0/917646599 (peer_addr_for_me v1:172.21.15.86:0/0) 2020-04-22T14:02:12.803 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.792+0000 7fc3f881b700 1 -- 172.21.15.86:0/917646599 >> v1:172.21.15.103:6789/0 conn(0x7fc3f405b7c0 legacy=0x7fc3f4064980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:12.803 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.792+0000 7fc3f881b700 1 -- 172.21.15.86:0/917646599 >> v1:172.21.15.86:6789/0 conn(0x7fc3f4080020 legacy=0x7fc3f4131960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:12.803 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.792+0000 7fc3f881b700 1 -- 172.21.15.86:0/917646599 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f4065870 con 0x7fc3f40ad920 2020-04-22T14:02:12.803 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.792+0000 7fc3dbfff700 1 -- 172.21.15.86:0/917646599 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1298831378 0 0) 0x7fc3f4065330 con 0x7fc3f4080020 2020-04-22T14:02:12.803 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.792+0000 7fc3f881b700 1 --2- 172.21.15.86:0/917646599 >> v2:172.21.15.86:3300/0 conn(0x7fc3f40ad920 0x7fc3f41546d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc3f4155f70 tx=0x7fc3ec010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.804 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.792+0000 7fc3f881b700 1 --2- 172.21.15.86:0/917646599 >> v2:172.21.15.86:3300/0 conn(0x7fc3f40ad920 0x7fc3f41546d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc3f4155f70 tx=0x7fc3ec010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.804 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.792+0000 7fc3f881b700 1 --2- 172.21.15.86:0/917646599 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3f40ad920 0x7fc3f41546d0 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7fc3f4155f70 tx=0x7fc3ec010c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:12.804 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.792+0000 7fc3f881b700 1 --2- 172.21.15.86:0/917646599 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3f40ad920 0x7fc3f41546d0 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fc3f4155f70 tx=0x7fc3ec010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.804 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.792+0000 7fc3dbfff700 1 -- 172.21.15.86:0/917646599 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3ec0122b0 con 0x7fc3f40ad920 2020-04-22T14:02:12.804 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.792+0000 7fc3f881b700 1 --2- 172.21.15.86:0/917646599 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3f40ad920 0x7fc3f41546d0 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fc3f4155f70 tx=0x7fc3ec010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.804 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.792+0000 7fc3f881b700 1 --2- 172.21.15.86:0/917646599 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3f40ad920 0x7fc3f41546d0 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fc3f4155f70 tx=0x7fc3ec010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.805 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.792+0000 7fc3dbfff700 1 -- 172.21.15.86:0/917646599 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3ec012410 con 0x7fc3f40ad920 2020-04-22T14:02:12.805 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.792+0000 7fc3f901c700 1 -- 172.21.15.86:0/917646599 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3f4132070 con 0x7fc3f40ad920 2020-04-22T14:02:12.805 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.792+0000 7fc3dbfff700 1 -- 172.21.15.86:0/917646599 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3ec0127f0 con 0x7fc3f40ad920 2020-04-22T14:02:12.805 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.792+0000 7fc3f901c700 1 -- 172.21.15.86:0/917646599 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3f4062ca0 con 0x7fc3f40ad920 2020-04-22T14:02:12.805 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.793+0000 7fc3f881b700 1 --2- 172.21.15.86:0/917646599 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3f40ad920 0x7fc3f41546d0 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fc3f4155f70 tx=0x7fc3ec010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.805 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.793+0000 7fc3f901c700 1 -- 172.21.15.86:0/917646599 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3f4154eb0 con 0x7fc3f40ad920 2020-04-22T14:02:12.805 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.793+0000 7fc3dbfff700 1 -- 172.21.15.86:0/917646599 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fc3ec012a60 con 0x7fc3f40ad920 2020-04-22T14:02:12.806 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.793+0000 7fc3f881b700 1 --2- 172.21.15.86:0/917646599 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3f40ad920 0x7fc3f41546d0 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fc3f4155f70 tx=0x7fc3ec010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.806 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.793+0000 7fc3dbfff700 1 --2- 172.21.15.86:0/917646599 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc3d404d8c0 0x7fc3d404fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:12.806 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.794+0000 7fc3dbfff700 1 -- 172.21.15.86:0/917646599 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1729+0+0 (secure 0 0 0) 0x7fc3ec061930 con 0x7fc3f40ad920 2020-04-22T14:02:12.806 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.794+0000 7fc3f359e700 1 --2- 172.21.15.86:0/917646599 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc3d404d8c0 0x7fc3d404fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:12.806 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.794+0000 7fc3f359e700 1 --2- 172.21.15.86:0/917646599 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc3d404d8c0 0x7fc3d404fd80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc3e40010d0 tx=0x7fc3e40013c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.806 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.794+0000 7fc3f359e700 1 --2- 172.21.15.86:0/917646599 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc3d404d8c0 0x7fc3d404fd80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc3e40010d0 tx=0x7fc3e40013c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.806 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.794+0000 7fc3f359e700 1 --2- 172.21.15.86:0/917646599 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc3d404d8c0 0x7fc3d404fd80 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7fc3e40010d0 tx=0x7fc3e40013c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:12.807 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.797+0000 7fc3f881b700 1 --2- 172.21.15.86:0/917646599 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3f40ad920 0x7fc3f41546d0 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fc3f4155f70 tx=0x7fc3ec010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.807 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.797+0000 7fc3dbfff700 1 -- 172.21.15.86:0/917646599 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fc3f4154eb0 con 0x7fc3f40ad920 2020-04-22T14:02:12.957 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.955+0000 7fc3f901c700 1 -- 172.21.15.86:0/917646599 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bcfd7a16-6914-4152-8647-a481917fe19d", "id": 5} v 0) v1 -- 0x7fc3f4154eb0 con 0x7fc3f40ad920 2020-04-22T14:02:12.960 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.958+0000 7fc3f881b700 1 --2- 172.21.15.86:0/917646599 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3f40ad920 0x7fc3f41546d0 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fc3f4155f70 tx=0x7fc3ec010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:12.960 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.958+0000 7fc3dbfff700 1 -- 172.21.15.86:0/917646599 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bcfd7a16-6914-4152-8647-a481917fe19d", "id": 5}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc3f4154eb0 con 0x7fc3f40ad920 2020-04-22T14:02:12.960 INFO:teuthology.orchestra.run.smithi086.stdout:5 2020-04-22T14:02:12.962 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.960+0000 7fc3f901c700 1 -- 172.21.15.86:0/917646599 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc3d404d8c0 msgr2=0x7fc3d404fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:12.962 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.960+0000 7fc3f901c700 1 --2- 172.21.15.86:0/917646599 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc3d404d8c0 0x7fc3d404fd80 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7fc3e40010d0 tx=0x7fc3e40013c0).stop 2020-04-22T14:02:12.963 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.960+0000 7fc3f901c700 1 -- 172.21.15.86:0/917646599 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3f40ad920 msgr2=0x7fc3f41546d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:12.963 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.960+0000 7fc3f901c700 1 --2- 172.21.15.86:0/917646599 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3f40ad920 0x7fc3f41546d0 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7fc3f4155f70 tx=0x7fc3ec010c50).stop 2020-04-22T14:02:12.963 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.960+0000 7fc3f901c700 1 -- 172.21.15.86:0/917646599 shutdown_connections 2020-04-22T14:02:12.963 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.960+0000 7fc3f901c700 1 --2- 172.21.15.86:0/917646599 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc3d404d8c0 0x7fc3d404fd80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:12.963 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.960+0000 7fc3f901c700 1 --2- 172.21.15.86:0/917646599 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3f40ad920 0x7fc3f41546d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:12.963 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.960+0000 7fc3f901c700 1 -- 172.21.15.86:0/917646599 >> 172.21.15.86:0/917646599 conn(0x7fc3f406a0f0 msgr2=0x7fc3f40ac410 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:12.963 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.960+0000 7fc3f901c700 1 -- 172.21.15.86:0/917646599 shutdown_connections 2020-04-22T14:02:12.964 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:12.960+0000 7fc3f901c700 1 -- 172.21.15.86:0/917646599 wait complete. 2020-04-22T14:02:12.972 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:12.985 INFO:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new 8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050 6 2020-04-22T14:02:13.131 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.126+0000 7f7e94141700 1 Processor -- start 2020-04-22T14:02:13.132 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.126+0000 7f7e94141700 1 -- start start 2020-04-22T14:02:13.132 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.127+0000 7f7e94141700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7e8c05b7c0 0x7f7e8c0af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:13.132 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.127+0000 7f7e94141700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7e8c0802d0 0x7f7e8c0668c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:13.132 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.127+0000 7f7e94141700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e8c0b5630 con 0x7f7e8c0ad920 2020-04-22T14:02:13.132 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.127+0000 7f7e94141700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e8c0b58d0 con 0x7f7e8c0802d0 2020-04-22T14:02:13.132 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.127+0000 7f7e94141700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e8c0b5b70 con 0x7f7e8c05b7c0 2020-04-22T14:02:13.132 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.127+0000 7f7e92edf700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7e8c0802d0 0x7f7e8c0668c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:13.133 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.127+0000 7f7e92edf700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7e8c0802d0 0x7f7e8c0668c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:45292/0 (socket says 172.21.15.86:45292) 2020-04-22T14:02:13.133 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.127+0000 7f7e92edf700 1 -- 172.21.15.86:0/533598695 learned_addr learned my addr 172.21.15.86:0/533598695 (peer_addr_for_me v2:172.21.15.86:0/0) 2020-04-22T14:02:13.133 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.128+0000 7f7e92edf700 1 -- 172.21.15.86:0/533598695 >> v2:172.21.15.103:3300/0 conn(0x7f7e8c05b7c0 msgr2=0x7f7e8c0af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:13.133 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.128+0000 7f7e926de700 1 --2- 172.21.15.86:0/533598695 >> v2:172.21.15.103:3300/0 conn(0x7f7e8c05b7c0 0x7f7e8c0af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:13.133 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.128+0000 7f7e92edf700 1 --2- 172.21.15.86:0/533598695 >> v2:172.21.15.103:3300/0 conn(0x7f7e8c05b7c0 0x7f7e8c0af030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:13.133 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.128+0000 7f7e92edf700 1 -- 172.21.15.86:0/533598695 >> v1:172.21.15.103:6789/0 conn(0x7f7e8c0ad920 legacy=0x7f7e8c07fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:13.133 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.128+0000 7f7e92edf700 1 -- 172.21.15.86:0/533598695 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e8c05bba0 con 0x7f7e8c0802d0 2020-04-22T14:02:13.134 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.128+0000 7f7e92edf700 1 --2- 172.21.15.86:0/533598695 >> v2:172.21.15.86:3300/0 conn(0x7f7e8c0802d0 0x7f7e8c0668c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7e8c0b2f60 tx=0x7f7e84007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:13.134 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.128+0000 7f7e92edf700 1 --2- 172.21.15.86:0/533598695 >> v2:172.21.15.86:3300/0 conn(0x7f7e8c0802d0 0x7f7e8c0668c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7e8c0b2f60 tx=0x7f7e84007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:13.134 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.128+0000 7f7e92edf700 1 --2- 172.21.15.86:0/533598695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e8c0802d0 0x7f7e8c0668c0 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7f7e8c0b2f60 tx=0x7f7e84007dc0).ready entity=mon.0 client_cookie=d98030c4780615e4 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:13.134 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.128+0000 7f7e92edf700 1 --2- 172.21.15.86:0/533598695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e8c0802d0 0x7f7e8c0668c0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f7e8c0b2f60 tx=0x7f7e84007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:13.134 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.128+0000 7f7e92edf700 1 --2- 172.21.15.86:0/533598695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e8c0802d0 0x7f7e8c0668c0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f7e8c0b2f60 tx=0x7f7e84007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:13.134 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.128+0000 7f7e916dc700 1 -- 172.21.15.86:0/533598695 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e8400a180 con 0x7f7e8c0802d0 2020-04-22T14:02:13.134 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.128+0000 7f7e92edf700 1 --2- 172.21.15.86:0/533598695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e8c0802d0 0x7f7e8c0668c0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f7e8c0b2f60 tx=0x7f7e84007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:13.135 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.128+0000 7f7e916dc700 1 -- 172.21.15.86:0/533598695 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8400a2e0 con 0x7f7e8c0802d0 2020-04-22T14:02:13.135 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.128+0000 7f7e916dc700 1 -- 172.21.15.86:0/533598695 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e8400a6c0 con 0x7f7e8c0802d0 2020-04-22T14:02:13.135 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.128+0000 7f7e94141700 1 -- 172.21.15.86:0/533598695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e8c0802d0 msgr2=0x7f7e8c0668c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:13.135 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.128+0000 7f7e94141700 1 --2- 172.21.15.86:0/533598695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e8c0802d0 0x7f7e8c0668c0 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7f7e8c0b2f60 tx=0x7f7e84007dc0).stop 2020-04-22T14:02:13.135 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.128+0000 7f7e94141700 1 -- 172.21.15.86:0/533598695 shutdown_connections 2020-04-22T14:02:13.135 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.129+0000 7f7e94141700 1 --2- 172.21.15.86:0/533598695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e8c0802d0 0x7f7e8c0668c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:13.135 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.129+0000 7f7e94141700 1 --2- 172.21.15.86:0/533598695 >> v2:172.21.15.103:3300/0 conn(0x7f7e8c05b7c0 0x7f7e8c0af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:13.135 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.129+0000 7f7e94141700 1 -- 172.21.15.86:0/533598695 >> 172.21.15.86:0/533598695 conn(0x7f7e8c06a0f0 msgr2=0x7f7e8c05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:13.136 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.129+0000 7f7e94141700 1 -- 172.21.15.86:0/533598695 shutdown_connections 2020-04-22T14:02:13.136 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.129+0000 7f7e94141700 1 -- 172.21.15.86:0/533598695 wait complete. 2020-04-22T14:02:13.139 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.130+0000 7f7e94141700 1 Processor -- start 2020-04-22T14:02:13.140 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.130+0000 7f7e94141700 1 -- start start 2020-04-22T14:02:13.140 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.130+0000 7f7e94141700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7e8c05b7c0 0x7f7e8c063a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:13.140 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.130+0000 7f7e94141700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e8c0802d0 0x7f7e8c065fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:13.141 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.130+0000 7f7e94141700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e8c154ec0 con 0x7f7e8c0ad920 2020-04-22T14:02:13.141 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.130+0000 7f7e94141700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e8c1550f0 con 0x7f7e8c05b7c0 2020-04-22T14:02:13.141 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.130+0000 7f7e94141700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8c155460 con 0x7f7e8c0802d0 2020-04-22T14:02:13.141 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.130+0000 7f7e92edf700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f7e8c0ad920 0x7f7e8c061370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:42382/0 (socket says 172.21.15.86:42382) 2020-04-22T14:02:13.141 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.130+0000 7f7e92edf700 1 -- 172.21.15.86:0/1556359580 learned_addr learned my addr 172.21.15.86:0/1556359580 (peer_addr_for_me v1:172.21.15.86:0/0) 2020-04-22T14:02:13.141 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.130+0000 7f7e91edd700 1 --2- 172.21.15.86:0/1556359580 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e8c0802d0 0x7f7e8c065fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:13.142 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.131+0000 7f7e926de700 1 --2- 172.21.15.86:0/1556359580 >> v2:172.21.15.103:3300/0 conn(0x7f7e8c05b7c0 0x7f7e8c063a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:13.142 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.131+0000 7f7e82ffd700 1 -- 172.21.15.86:0/1556359580 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 325309347 0 0) 0x7f7e8c154ec0 con 0x7f7e8c0ad920 2020-04-22T14:02:13.142 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.131+0000 7f7e82ffd700 1 -- 172.21.15.86:0/1556359580 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e74003230 con 0x7f7e8c0ad920 2020-04-22T14:02:13.142 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.131+0000 7f7e91edd700 1 -- 172.21.15.86:0/1556359580 >> v2:172.21.15.103:3300/0 conn(0x7f7e8c05b7c0 msgr2=0x7f7e8c063a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:13.142 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.131+0000 7f7e91edd700 1 --2- 172.21.15.86:0/1556359580 >> v2:172.21.15.103:3300/0 conn(0x7f7e8c05b7c0 0x7f7e8c063a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:13.142 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.131+0000 7f7e91edd700 1 -- 172.21.15.86:0/1556359580 >> v1:172.21.15.86:6789/0 conn(0x7f7e8c0ad920 legacy=0x7f7e8c061370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:13.142 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.131+0000 7f7e91edd700 1 -- 172.21.15.86:0/1556359580 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e8c155700 con 0x7f7e8c0802d0 2020-04-22T14:02:13.142 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.131+0000 7f7e91edd700 1 --2- 172.21.15.86:0/1556359580 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e8c0802d0 0x7f7e8c065fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7e7c001f50 tx=0x7f7e7c002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:13.143 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.131+0000 7f7e91edd700 1 --2- 172.21.15.86:0/1556359580 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e8c0802d0 0x7f7e8c065fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7e7c001f50 tx=0x7f7e7c002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:13.143 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.131+0000 7f7e91edd700 1 --2- 172.21.15.86:0/1556359580 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e8c0802d0 0x7f7e8c065fe0 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7f7e7c001f50 tx=0x7f7e7c002e60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:13.143 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.131+0000 7f7e91edd700 1 --2- 172.21.15.86:0/1556359580 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e8c0802d0 0x7f7e8c065fe0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f7e7c001f50 tx=0x7f7e7c002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:13.143 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.131+0000 7f7e82ffd700 1 -- 172.21.15.86:0/1556359580 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e7c00cd10 con 0x7f7e8c0802d0 2020-04-22T14:02:13.143 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.131+0000 7f7e91edd700 1 --2- 172.21.15.86:0/1556359580 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e8c0802d0 0x7f7e8c065fe0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f7e7c001f50 tx=0x7f7e7c002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:13.143 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.131+0000 7f7e91edd700 1 --2- 172.21.15.86:0/1556359580 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e8c0802d0 0x7f7e8c065fe0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f7e7c001f50 tx=0x7f7e7c002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:13.143 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.131+0000 7f7e82ffd700 1 -- 172.21.15.86:0/1556359580 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7c00e180 con 0x7f7e8c0802d0 2020-04-22T14:02:13.144 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.131+0000 7f7e94141700 1 -- 172.21.15.86:0/1556359580 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e8c061a80 con 0x7f7e8c0802d0 2020-04-22T14:02:13.144 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.131+0000 7f7e82ffd700 1 -- 172.21.15.86:0/1556359580 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e7c00e5a0 con 0x7f7e8c0802d0 2020-04-22T14:02:13.144 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.131+0000 7f7e94141700 1 -- 172.21.15.86:0/1556359580 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e8c155fe0 con 0x7f7e8c0802d0 2020-04-22T14:02:13.144 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.132+0000 7f7e91edd700 1 --2- 172.21.15.86:0/1556359580 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e8c0802d0 0x7f7e8c065fe0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f7e7c001f50 tx=0x7f7e7c002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:13.144 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.132+0000 7f7e82ffd700 1 -- 172.21.15.86:0/1556359580 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f7e7c00e810 con 0x7f7e8c0802d0 2020-04-22T14:02:13.144 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.132+0000 7f7e91edd700 1 --2- 172.21.15.86:0/1556359580 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e8c0802d0 0x7f7e8c065fe0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f7e7c001f50 tx=0x7f7e7c002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:13.145 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.132+0000 7f7e94141700 1 -- 172.21.15.86:0/1556359580 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e8c065540 con 0x7f7e8c0802d0 2020-04-22T14:02:13.145 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.132+0000 7f7e82ffd700 1 --2- 172.21.15.86:0/1556359580 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7e7404dd10 0x7f7e740501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:13.145 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.132+0000 7f7e82ffd700 1 -- 172.21.15.86:0/1556359580 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1844+0+0 (secure 0 0 0) 0x7f7e7c0610e0 con 0x7f7e8c0802d0 2020-04-22T14:02:13.145 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.132+0000 7f7e926de700 1 --2- 172.21.15.86:0/1556359580 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7e7404dd10 0x7f7e740501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:13.145 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.132+0000 7f7e926de700 1 --2- 172.21.15.86:0/1556359580 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7e7404dd10 0x7f7e740501d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7e88002f30 tx=0x7f7e880076e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:13.145 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.133+0000 7f7e926de700 1 --2- 172.21.15.86:0/1556359580 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7e7404dd10 0x7f7e740501d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7e88002f30 tx=0x7f7e880076e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:13.145 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.133+0000 7f7e926de700 1 --2- 172.21.15.86:0/1556359580 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7e7404dd10 0x7f7e740501d0 secure :-1 s=READY pgs=15 cs=0 l=1 rx=0x7f7e88002f30 tx=0x7f7e880076e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:13.146 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.136+0000 7f7e91edd700 1 --2- 172.21.15.86:0/1556359580 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e8c0802d0 0x7f7e8c065fe0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f7e7c001f50 tx=0x7f7e7c002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:13.146 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.136+0000 7f7e82ffd700 1 -- 172.21.15.86:0/1556359580 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f7e7c03c580 con 0x7f7e8c0802d0 2020-04-22T14:02:13.321 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.291+0000 7f7e94141700 1 -- 172.21.15.86:0/1556359580 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050", "id": 6} v 0) v1 -- 0x7f7e8c056c90 con 0x7f7e8c0802d0 2020-04-22T14:02:13.321 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.294+0000 7f7e91edd700 1 --2- 172.21.15.86:0/1556359580 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e8c0802d0 0x7f7e8c065fe0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f7e7c001f50 tx=0x7f7e7c002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:13.322 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.294+0000 7f7e82ffd700 1 -- 172.21.15.86:0/1556359580 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050", "id": 6}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7e7c03fba0 con 0x7f7e8c0802d0 2020-04-22T14:02:13.322 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.296+0000 7f7e94141700 1 -- 172.21.15.86:0/1556359580 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7e7404dd10 msgr2=0x7f7e740501d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:13.322 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.296+0000 7f7e94141700 1 --2- 172.21.15.86:0/1556359580 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7e7404dd10 0x7f7e740501d0 secure :-1 s=READY pgs=15 cs=0 l=1 rx=0x7f7e88002f30 tx=0x7f7e880076e0).stop 2020-04-22T14:02:13.322 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.296+0000 7f7e94141700 1 -- 172.21.15.86:0/1556359580 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e8c0802d0 msgr2=0x7f7e8c065fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:13.322 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.296+0000 7f7e94141700 1 --2- 172.21.15.86:0/1556359580 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e8c0802d0 0x7f7e8c065fe0 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7f7e7c001f50 tx=0x7f7e7c002e60).stop 2020-04-22T14:02:13.322 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.296+0000 7f7e94141700 1 -- 172.21.15.86:0/1556359580 shutdown_connections 2020-04-22T14:02:13.322 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.296+0000 7f7e94141700 1 --2- 172.21.15.86:0/1556359580 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7e7404dd10 0x7f7e740501d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:13.322 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.296+0000 7f7e94141700 1 --2- 172.21.15.86:0/1556359580 >> v2:172.21.15.103:3300/0 conn(0x7f7e8c05b7c0 0x7f7e8c063a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:13.323 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.296+0000 7f7e94141700 1 --2- 172.21.15.86:0/1556359580 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e8c0802d0 0x7f7e8c065fe0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:13.323 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.296+0000 7f7e94141700 1 -- 172.21.15.86:0/1556359580 >> 172.21.15.86:0/1556359580 conn(0x7f7e8c06a0f0 msgr2=0x7f7e8c0ac410 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:13.323 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.296+0000 7f7e94141700 1 -- 172.21.15.86:0/1556359580 shutdown_connections 2020-04-22T14:02:13.323 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.296+0000 7f7e94141700 1 -- 172.21.15.86:0/1556359580 wait complete. 2020-04-22T14:02:13.323 INFO:teuthology.orchestra.run.smithi086.stdout:6 2020-04-22T14:02:13.323 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:13.341 INFO:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new 340eece1-4c39-47cd-b95f-9cfa5dcfe361 7 2020-04-22T14:02:13.488 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.482+0000 7f2850baa700 1 Processor -- start 2020-04-22T14:02:13.488 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.482+0000 7f2850baa700 1 -- start start 2020-04-22T14:02:13.488 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.483+0000 7f2850baa700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f284c0b09b0 0x7f284c0802d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:13.489 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.483+0000 7f2850baa700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f284c0b5630 con 0x7f284c0ad920 2020-04-22T14:02:13.489 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.483+0000 7f2850baa700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f284c0b58d0 con 0x7f284c05b7c0 2020-04-22T14:02:13.489 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.483+0000 7f2850baa700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f284c0b5b70 con 0x7f284c0b09b0 2020-04-22T14:02:13.489 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.483+0000 7f284b59e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f284c0b09b0 0x7f284c0802d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:13.489 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.483+0000 7f284a59c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f284c0ad920 0x7f284c07fbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:42386/0 (socket says 172.21.15.86:42386) 2020-04-22T14:02:13.489 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.483+0000 7f284a59c700 1 -- 172.21.15.86:0/3802189495 learned_addr learned my addr 172.21.15.86:0/3802189495 (peer_addr_for_me v1:172.21.15.86:0/0) 2020-04-22T14:02:13.489 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.484+0000 7f284b59e700 1 -- 172.21.15.86:0/3802189495 >> v1:172.21.15.103:6789/0 conn(0x7f284c05b7c0 legacy=0x7f284c0af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:13.490 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.484+0000 7f284b59e700 1 -- 172.21.15.86:0/3802189495 >> v1:172.21.15.86:6789/0 conn(0x7f284c0ad920 legacy=0x7f284c07fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:13.490 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.484+0000 7f284b59e700 1 -- 172.21.15.86:0/3802189495 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284c05bba0 con 0x7f284c0b09b0 2020-04-22T14:02:13.490 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.484+0000 7f2849d9b700 1 -- 172.21.15.86:0/3802189495 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3596113995 0 0) 0x7f284c0b5630 con 0x7f284c0ad920 2020-04-22T14:02:13.490 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.484+0000 7f284b59e700 1 --2- 172.21.15.86:0/3802189495 >> v2:172.21.15.86:3300/0 conn(0x7f284c0b09b0 0x7f284c0802d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f284c0b2fa0 tx=0x7f2844007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:13.490 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.484+0000 7f284b59e700 1 --2- 172.21.15.86:0/3802189495 >> v2:172.21.15.86:3300/0 conn(0x7f284c0b09b0 0x7f284c0802d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f284c0b2fa0 tx=0x7f2844007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:13.490 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.484+0000 7f284b59e700 1 --2- 172.21.15.86:0/3802189495 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f284c0b09b0 0x7f284c0802d0 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7f284c0b2fa0 tx=0x7f2844007dc0).ready entity=mon.0 client_cookie=442e44ec62a5fcc0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:13.490 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.484+0000 7f284b59e700 1 --2- 172.21.15.86:0/3802189495 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f284c0b09b0 0x7f284c0802d0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f284c0b2fa0 tx=0x7f2844007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:13.490 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.484+0000 7f2849d9b700 1 -- 172.21.15.86:0/3802189495 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2844011e90 con 0x7f284c0b09b0 2020-04-22T14:02:13.491 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.484+0000 7f284b59e700 1 --2- 172.21.15.86:0/3802189495 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f284c0b09b0 0x7f284c0802d0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f284c0b2fa0 tx=0x7f2844007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:13.491 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.484+0000 7f284b59e700 1 --2- 172.21.15.86:0/3802189495 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f284c0b09b0 0x7f284c0802d0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f284c0b2fa0 tx=0x7f2844007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:13.491 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.484+0000 7f2849d9b700 1 -- 172.21.15.86:0/3802189495 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284400a180 con 0x7f284c0b09b0 2020-04-22T14:02:13.491 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.484+0000 7f2849d9b700 1 -- 172.21.15.86:0/3802189495 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f284400a560 con 0x7f284c0b09b0 2020-04-22T14:02:13.492 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.484+0000 7f2850baa700 1 -- 172.21.15.86:0/3802189495 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f284c0b09b0 msgr2=0x7f284c0802d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:13.492 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.484+0000 7f2850baa700 1 --2- 172.21.15.86:0/3802189495 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f284c0b09b0 0x7f284c0802d0 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7f284c0b2fa0 tx=0x7f2844007dc0).stop 2020-04-22T14:02:13.492 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.484+0000 7f2850baa700 1 -- 172.21.15.86:0/3802189495 shutdown_connections 2020-04-22T14:02:13.492 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.484+0000 7f2850baa700 1 --2- 172.21.15.86:0/3802189495 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f284c0b09b0 0x7f284c0802d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:13.492 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.484+0000 7f2850baa700 1 -- 172.21.15.86:0/3802189495 >> 172.21.15.86:0/3802189495 conn(0x7f284c06a0f0 msgr2=0x7f284c05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:13.492 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.484+0000 7f2850baa700 1 -- 172.21.15.86:0/3802189495 shutdown_connections 2020-04-22T14:02:13.492 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.484+0000 7f2850baa700 1 -- 172.21.15.86:0/3802189495 wait complete. 2020-04-22T14:02:13.493 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.486+0000 7f2850baa700 1 Processor -- start 2020-04-22T14:02:13.493 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.486+0000 7f2850baa700 1 -- start start 2020-04-22T14:02:13.502 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.486+0000 7f2850baa700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f284c0ad920 0x7f284c12fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:13.502 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.486+0000 7f2850baa700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f284c12ff90 con 0x7f284c0b09b0 2020-04-22T14:02:13.502 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.486+0000 7f2850baa700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f284c0635a0 con 0x7f284c05b7c0 2020-04-22T14:02:13.503 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.486+0000 7f2850baa700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f284c063f80 con 0x7f284c0ad920 2020-04-22T14:02:13.503 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.486+0000 7f284b59e700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f284c0b09b0 0x7f284c064120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:42394/0 (socket says 172.21.15.86:42394) 2020-04-22T14:02:13.504 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.486+0000 7f284b59e700 1 -- 172.21.15.86:0/272319023 learned_addr learned my addr 172.21.15.86:0/272319023 (peer_addr_for_me v1:172.21.15.86:0/0) 2020-04-22T14:02:13.504 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.486+0000 7f283b7fe700 1 -- 172.21.15.86:0/272319023 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1444492274 0 0) 0x7f284c05bba0 con 0x7f284c0b09b0 2020-04-22T14:02:13.504 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.486+0000 7f283b7fe700 1 -- 172.21.15.86:0/272319023 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2830003230 con 0x7f284c0b09b0 2020-04-22T14:02:13.506 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.486+0000 7f284a59c700 1 --2- 172.21.15.86:0/272319023 >> v2:172.21.15.103:3300/0 conn(0x7f284c0ad920 0x7f284c12fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:13.506 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.487+0000 7f283b7fe700 1 -- 172.21.15.86:0/272319023 <== mon.0 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 277135193 0 0) 0x7f2830003230 con 0x7f284c0b09b0 2020-04-22T14:02:13.506 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.487+0000 7f283b7fe700 1 -- 172.21.15.86:0/272319023 --> v1:172.21.15.86:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f284c05bba0 con 0x7f284c0b09b0 2020-04-22T14:02:13.506 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.487+0000 7f283b7fe700 1 -- 172.21.15.86:0/272319023 <== mon.0 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f284400a590 con 0x7f284c0b09b0 2020-04-22T14:02:13.506 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.487+0000 7f283b7fe700 1 -- 172.21.15.86:0/272319023 >> v2:172.21.15.103:3300/0 conn(0x7f284c0ad920 msgr2=0x7f284c12fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:13.507 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.487+0000 7f283b7fe700 1 --2- 172.21.15.86:0/272319023 >> v2:172.21.15.103:3300/0 conn(0x7f284c0ad920 0x7f284c12fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:13.507 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.487+0000 7f283b7fe700 1 -- 172.21.15.86:0/272319023 >> v1:172.21.15.103:6789/0 conn(0x7f284c05b7c0 legacy=0x7f284c062db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:13.507 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.487+0000 7f283b7fe700 1 -- 172.21.15.86:0/272319023 >> v1:172.21.15.86:6789/0 conn(0x7f284c0b09b0 legacy=0x7f284c064120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:13.507 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.487+0000 7f283b7fe700 1 --2- 172.21.15.86:0/272319023 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28300037f0 0x7f2830003c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:13.507 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.487+0000 7f283b7fe700 1 --2- 172.21.15.86:0/272319023 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f28300044d0 0x7f2830004910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:13.507 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.487+0000 7f283b7fe700 1 --2- 172.21.15.86:0/272319023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2830004d70 0x7f283000b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:13.507 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.487+0000 7f283b7fe700 1 -- 172.21.15.86:0/272319023 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284c063f80 con 0x7f2830004d70 2020-04-22T14:02:13.508 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.487+0000 7f283b7fe700 1 -- 172.21.15.86:0/272319023 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2830005250 con 0x7f28300037f0 2020-04-22T14:02:13.508 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.487+0000 7f283b7fe700 1 -- 172.21.15.86:0/272319023 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f283000bb80 con 0x7f28300044d0 2020-04-22T14:02:13.508 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.487+0000 7f284b59e700 1 --2- 172.21.15.86:0/272319023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2830004d70 0x7f283000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:13.508 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.487+0000 7f284a59c700 1 --2- 172.21.15.86:0/272319023 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f28300044d0 0x7f2830004910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:13.508 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.487+0000 7f284ad9d700 1 --2- 172.21.15.86:0/272319023 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28300037f0 0x7f2830003c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:13.508 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.487+0000 7f284b59e700 1 -- 172.21.15.86:0/272319023 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f28300044d0 msgr2=0x7f2830004910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:13.508 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.487+0000 7f284b59e700 1 --2- 172.21.15.86:0/272319023 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f28300044d0 0x7f2830004910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:13.509 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.487+0000 7f284b59e700 1 -- 172.21.15.86:0/272319023 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28300037f0 msgr2=0x7f2830003c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:13.509 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.487+0000 7f284b59e700 1 --2- 172.21.15.86:0/272319023 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28300037f0 0x7f2830003c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:13.509 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.487+0000 7f284b59e700 1 -- 172.21.15.86:0/272319023 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284c063840 con 0x7f2830004d70 2020-04-22T14:02:13.509 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.487+0000 7f284b59e700 1 --2- 172.21.15.86:0/272319023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2830004d70 0x7f283000b720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2844008660 tx=0x7f2844007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:13.509 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.487+0000 7f284b59e700 1 -- 172.21.15.86:0/272319023 reap_dead start 2020-04-22T14:02:13.510 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.487+0000 7f2850baa700 1 -- 172.21.15.86:0/272319023 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f284c12fb30 con 0x7f2830004d70 2020-04-22T14:02:13.510 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.487+0000 7f284b59e700 1 --2- 172.21.15.86:0/272319023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2830004d70 0x7f283000b720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2844008660 tx=0x7f2844007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:13.510 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.487+0000 7f284b59e700 1 --2- 172.21.15.86:0/272319023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2830004d70 0x7f283000b720 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7f2844008660 tx=0x7f2844007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:13.510 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.487+0000 7f2850baa700 1 -- 172.21.15.86:0/272319023 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f284c062f70 con 0x7f2830004d70 2020-04-22T14:02:13.511 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.487+0000 7f284b59e700 1 --2- 172.21.15.86:0/272319023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2830004d70 0x7f283000b720 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f2844008660 tx=0x7f2844007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:13.511 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.487+0000 7f283b7fe700 1 -- 172.21.15.86:0/272319023 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2844005e20 con 0x7f2830004d70 2020-04-22T14:02:13.511 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.487+0000 7f284b59e700 1 --2- 172.21.15.86:0/272319023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2830004d70 0x7f283000b720 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f2844008660 tx=0x7f2844007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:13.511 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.488+0000 7f283b7fe700 1 -- 172.21.15.86:0/272319023 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2844007170 con 0x7f2830004d70 2020-04-22T14:02:13.511 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.488+0000 7f284b59e700 1 --2- 172.21.15.86:0/272319023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2830004d70 0x7f283000b720 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f2844008660 tx=0x7f2844007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:13.511 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.488+0000 7f283b7fe700 1 -- 172.21.15.86:0/272319023 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28440074d0 con 0x7f2830004d70 2020-04-22T14:02:13.511 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.488+0000 7f284b59e700 1 --2- 172.21.15.86:0/272319023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2830004d70 0x7f283000b720 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f2844008660 tx=0x7f2844007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:13.512 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.488+0000 7f2850baa700 1 -- 172.21.15.86:0/272319023 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f284c0633e0 con 0x7f2830004d70 2020-04-22T14:02:13.512 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.489+0000 7f283b7fe700 1 -- 172.21.15.86:0/272319023 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f2844007630 con 0x7f2830004d70 2020-04-22T14:02:13.512 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.489+0000 7f284b59e700 1 --2- 172.21.15.86:0/272319023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2830004d70 0x7f283000b720 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f2844008660 tx=0x7f2844007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:13.512 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.489+0000 7f283b7fe700 1 --2- 172.21.15.86:0/272319023 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2830055ba0 0x7f2830058060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:13.512 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.489+0000 7f283b7fe700 1 -- 172.21.15.86:0/272319023 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1959+0+0 (secure 0 0 0) 0x7f28440626d0 con 0x7f2830004d70 2020-04-22T14:02:13.512 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.489+0000 7f284ad9d700 1 --2- 172.21.15.86:0/272319023 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2830055ba0 0x7f2830058060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:13.512 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.489+0000 7f284ad9d700 1 --2- 172.21.15.86:0/272319023 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2830055ba0 0x7f2830058060 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f284c1554c0 tx=0x7f283c007ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:13.513 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.489+0000 7f284ad9d700 1 --2- 172.21.15.86:0/272319023 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2830055ba0 0x7f2830058060 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f284c1554c0 tx=0x7f283c007ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:13.513 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.489+0000 7f284ad9d700 1 --2- 172.21.15.86:0/272319023 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2830055ba0 0x7f2830058060 secure :-1 s=READY pgs=16 cs=0 l=1 rx=0x7f284c1554c0 tx=0x7f283c007ce0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:13.513 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.492+0000 7f284b59e700 1 --2- 172.21.15.86:0/272319023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2830004d70 0x7f283000b720 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f2844008660 tx=0x7f2844007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:13.513 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.492+0000 7f283b7fe700 1 -- 172.21.15.86:0/272319023 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f284403dbd0 con 0x7f2830004d70 2020-04-22T14:02:13.654 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.651+0000 7f2850baa700 1 -- 172.21.15.86:0/272319023 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd new", "uuid": "340eece1-4c39-47cd-b95f-9cfa5dcfe361", "id": 7} v 0) v1 -- 0x7f284c063a40 con 0x7f2830004d70 2020-04-22T14:02:13.657 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.654+0000 7f284b59e700 1 --2- 172.21.15.86:0/272319023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2830004d70 0x7f283000b720 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f2844008660 tx=0x7f2844007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:13.657 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.654+0000 7f283b7fe700 1 -- 172.21.15.86:0/272319023 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "340eece1-4c39-47cd-b95f-9cfa5dcfe361", "id": 7}]=0 v11) v1 ==== 112+0+2 (secure 0 0 0) 0x7f28440411f0 con 0x7f2830004d70 2020-04-22T14:02:13.657 INFO:teuthology.orchestra.run.smithi086.stdout:7 2020-04-22T14:02:13.659 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.656+0000 7f2850baa700 1 -- 172.21.15.86:0/272319023 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2830055ba0 msgr2=0x7f2830058060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:13.659 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.656+0000 7f2850baa700 1 --2- 172.21.15.86:0/272319023 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2830055ba0 0x7f2830058060 secure :-1 s=READY pgs=16 cs=0 l=1 rx=0x7f284c1554c0 tx=0x7f283c007ce0).stop 2020-04-22T14:02:13.659 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.656+0000 7f2850baa700 1 -- 172.21.15.86:0/272319023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2830004d70 msgr2=0x7f283000b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:13.659 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.656+0000 7f2850baa700 1 --2- 172.21.15.86:0/272319023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2830004d70 0x7f283000b720 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7f2844008660 tx=0x7f2844007e60).stop 2020-04-22T14:02:13.659 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.656+0000 7f2850baa700 1 -- 172.21.15.86:0/272319023 shutdown_connections 2020-04-22T14:02:13.660 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.656+0000 7f2850baa700 1 --2- 172.21.15.86:0/272319023 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2830055ba0 0x7f2830058060 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:13.660 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.656+0000 7f2850baa700 1 --2- 172.21.15.86:0/272319023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2830004d70 0x7f283000b720 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:13.660 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.656+0000 7f2850baa700 1 -- 172.21.15.86:0/272319023 >> 172.21.15.86:0/272319023 conn(0x7f284c06a0f0 msgr2=0x7f284c07f990 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:13.660 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.656+0000 7f2850baa700 1 -- 172.21.15.86:0/272319023 shutdown_connections 2020-04-22T14:02:13.679 INFO:teuthology.orchestra.run.smithi086.stderr:2020-04-22T14:02:13.656+0000 7f2850baa700 1 -- 172.21.15.86:0/272319023 wait complete. 2020-04-22T14:02:13.680 INFO:tasks.ceph.osd.0:Restarting daemon 2020-04-22T14:02:13.680 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:13.697 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2020-04-22T14:02:13.741 INFO:tasks.ceph.osd.0:Started 2020-04-22T14:02:13.741 INFO:tasks.ceph.osd.1:Restarting daemon 2020-04-22T14:02:13.742 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:13.759 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2020-04-22T14:02:13.801 INFO:tasks.ceph.osd.1:Started 2020-04-22T14:02:13.801 INFO:tasks.ceph.osd.2:Restarting daemon 2020-04-22T14:02:13.801 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:13.822 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2020-04-22T14:02:13.864 INFO:tasks.ceph.osd.2:Started 2020-04-22T14:02:13.864 INFO:tasks.ceph.osd.3:Restarting daemon 2020-04-22T14:02:13.865 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:13.878 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2020-04-22T14:02:13.921 INFO:tasks.ceph.osd.3:Started 2020-04-22T14:02:13.922 INFO:tasks.ceph.osd.4:Restarting daemon 2020-04-22T14:02:13.922 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:13.936 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2020-04-22T14:02:13.978 INFO:tasks.ceph.osd.4:Started 2020-04-22T14:02:13.979 INFO:tasks.ceph.osd.5:Restarting daemon 2020-04-22T14:02:13.979 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:13.992 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2020-04-22T14:02:14.034 INFO:tasks.ceph.osd.5:Started 2020-04-22T14:02:14.034 INFO:tasks.ceph.osd.6:Restarting daemon 2020-04-22T14:02:14.035 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:14.048 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2020-04-22T14:02:14.090 INFO:tasks.ceph.osd.6:Started 2020-04-22T14:02:14.091 INFO:tasks.ceph.osd.7:Restarting daemon 2020-04-22T14:02:14.091 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:14.105 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2020-04-22T14:02:14.147 INFO:tasks.ceph.osd.7:Started 2020-04-22T14:02:14.148 INFO:tasks.ceph:Waiting for OSDs to come up 2020-04-22T14:02:14.342 INFO:tasks.ceph.osd.0.smithi103.stderr:2020-04-22T14:02:14.340+0000 7f5d842e5ec0 -1 Falling back to public interface 2020-04-22T14:02:14.399 INFO:tasks.ceph.osd.1.smithi103.stderr:2020-04-22T14:02:14.397+0000 7f53e97dbec0 -1 Falling back to public interface 2020-04-22T14:02:14.453 INFO:tasks.ceph.osd.2.smithi103.stderr:2020-04-22T14:02:14.452+0000 7f19107a7ec0 -1 Falling back to public interface 2020-04-22T14:02:14.513 INFO:tasks.ceph.osd.3.smithi103.stderr:2020-04-22T14:02:14.512+0000 7f855cf2dec0 -1 Falling back to public interface 2020-04-22T14:02:14.567 INFO:tasks.ceph.osd.4.smithi086.stderr:2020-04-22T14:02:14.565+0000 7fda6f5b8ec0 -1 Falling back to public interface 2020-04-22T14:02:14.629 INFO:tasks.ceph.osd.5.smithi086.stderr:2020-04-22T14:02:14.627+0000 7fbe1c214ec0 -1 Falling back to public interface 2020-04-22T14:02:14.680 INFO:tasks.ceph.osd.6.smithi086.stderr:2020-04-22T14:02:14.678+0000 7fe311fc0ec0 -1 Falling back to public interface 2020-04-22T14:02:14.734 INFO:tasks.ceph.osd.7.smithi086.stderr:2020-04-22T14:02:14.732+0000 7f6c76824ec0 -1 Falling back to public interface 2020-04-22T14:02:14.955 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:14.969 INFO:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-04-22T14:02:15.104 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.099+0000 7fe621d03700 1 Processor -- start 2020-04-22T14:02:15.104 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.100+0000 7fe621d03700 1 -- start start 2020-04-22T14:02:15.105 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.100+0000 7fe621d03700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe61c062210 0x7fe61c0613e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:15.105 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.100+0000 7fe621d03700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe61c0611a0 con 0x7fe61c0b8e50 2020-04-22T14:02:15.105 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.100+0000 7fe621d03700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe61c060f00 con 0x7fe61c080230 2020-04-22T14:02:15.105 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.100+0000 7fe621d03700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe61c061c10 con 0x7fe61c062210 2020-04-22T14:02:15.105 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.100+0000 7fe613fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe61c062210 0x7fe61c0613e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:15.105 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.100+0000 7fe620aa1700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe61c080230 0x7fe61c0b3890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:38762/0 (socket says 172.21.15.103:38762) 2020-04-22T14:02:15.105 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.100+0000 7fe620aa1700 1 -- 172.21.15.103:0/3137508160 learned_addr learned my addr 172.21.15.103:0/3137508160 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:15.106 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.101+0000 7fe613fff700 1 -- 172.21.15.103:0/3137508160 >> v1:172.21.15.103:6789/0 conn(0x7fe61c080230 legacy=0x7fe61c0b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:15.106 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.101+0000 7fe613fff700 1 -- 172.21.15.103:0/3137508160 >> v1:172.21.15.86:6789/0 conn(0x7fe61c0b8e50 legacy=0x7fe61c0ada20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:15.106 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.101+0000 7fe613fff700 1 -- 172.21.15.103:0/3137508160 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe61c0b9230 con 0x7fe61c062210 2020-04-22T14:02:15.106 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.101+0000 7fe613fff700 1 --2- 172.21.15.103:0/3137508160 >> v2:172.21.15.103:3300/0 conn(0x7fe61c062210 0x7fe61c0613e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe604002f30 tx=0x7fe604007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:15.106 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.101+0000 7fe613fff700 1 --2- 172.21.15.103:0/3137508160 >> v2:172.21.15.103:3300/0 conn(0x7fe61c062210 0x7fe61c0613e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe604002f30 tx=0x7fe604007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:15.106 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.101+0000 7fe613fff700 1 --2- 172.21.15.103:0/3137508160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe61c062210 0x7fe61c0613e0 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7fe604002f30 tx=0x7fe604007a40).ready entity=mon.1 client_cookie=6f3ae3c449951ea4 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:15.106 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.101+0000 7fe613fff700 1 --2- 172.21.15.103:0/3137508160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe61c062210 0x7fe61c0613e0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7fe604002f30 tx=0x7fe604007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:15.107 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.101+0000 7fe613fff700 1 --2- 172.21.15.103:0/3137508160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe61c062210 0x7fe61c0613e0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7fe604002f30 tx=0x7fe604007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:15.107 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.101+0000 7fe61b7fe700 1 -- 172.21.15.103:0/3137508160 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe604011470 con 0x7fe61c062210 2020-04-22T14:02:15.107 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.101+0000 7fe613fff700 1 --2- 172.21.15.103:0/3137508160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe61c062210 0x7fe61c0613e0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7fe604002f30 tx=0x7fe604007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:15.107 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.101+0000 7fe61b7fe700 1 -- 172.21.15.103:0/3137508160 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6040115d0 con 0x7fe61c062210 2020-04-22T14:02:15.107 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.101+0000 7fe61b7fe700 1 -- 172.21.15.103:0/3137508160 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6040119f0 con 0x7fe61c062210 2020-04-22T14:02:15.107 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.101+0000 7fe621d03700 1 -- 172.21.15.103:0/3137508160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe61c062210 msgr2=0x7fe61c0613e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:15.107 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.101+0000 7fe621d03700 1 --2- 172.21.15.103:0/3137508160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe61c062210 0x7fe61c0613e0 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7fe604002f30 tx=0x7fe604007a40).stop 2020-04-22T14:02:15.107 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.101+0000 7fe621d03700 1 -- 172.21.15.103:0/3137508160 shutdown_connections 2020-04-22T14:02:15.108 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.101+0000 7fe621d03700 1 --2- 172.21.15.103:0/3137508160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe61c062210 0x7fe61c0613e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:15.108 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.101+0000 7fe621d03700 1 -- 172.21.15.103:0/3137508160 >> 172.21.15.103:0/3137508160 conn(0x7fe61c09dcd0 msgr2=0x7fe61c09e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:15.108 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.101+0000 7fe621d03700 1 -- 172.21.15.103:0/3137508160 shutdown_connections 2020-04-22T14:02:15.108 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.102+0000 7fe621d03700 1 -- 172.21.15.103:0/3137508160 wait complete. 2020-04-22T14:02:15.112 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.103+0000 7fe621d03700 1 Processor -- start 2020-04-22T14:02:15.112 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.103+0000 7fe621d03700 1 -- start start 2020-04-22T14:02:15.112 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.103+0000 7fe621d03700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe61c062210 0x7fe61c146fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:15.112 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.103+0000 7fe621d03700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe61c080230 0x7fe61c0b51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:15.112 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.103+0000 7fe621d03700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe61c0b8e50 0x7fe61c1344d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:15.112 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.103+0000 7fe621d03700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe61c137050 con 0x7fe61c0b8e50 2020-04-22T14:02:15.113 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.103+0000 7fe621d03700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe61c147440 con 0x7fe61c062210 2020-04-22T14:02:15.113 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.103+0000 7fe621d03700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c0b5650 con 0x7fe61c080230 2020-04-22T14:02:15.113 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.103+0000 7fe61bfff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe61c062210 0x7fe61c146fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:15.113 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.103+0000 7fe61bfff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe61c062210 0x7fe61c146fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46576/0 (socket says 172.21.15.103:46576) 2020-04-22T14:02:15.113 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.103+0000 7fe61bfff700 1 -- 172.21.15.103:0/1749527702 learned_addr learned my addr 172.21.15.103:0/1749527702 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:15.113 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.103+0000 7fe613fff700 1 --2- 172.21.15.103:0/1749527702 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe61c080230 0x7fe61c0b51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:15.113 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.103+0000 7fe620aa1700 1 --2- 172.21.15.103:0/1749527702 >> v2:172.21.15.86:3300/0 conn(0x7fe61c0b8e50 0x7fe61c1344d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:15.114 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.104+0000 7fe61bfff700 1 -- 172.21.15.103:0/1749527702 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe61c080230 msgr2=0x7fe61c0b51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:15.114 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.104+0000 7fe61bfff700 1 --2- 172.21.15.103:0/1749527702 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe61c080230 0x7fe61c0b51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:15.114 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.104+0000 7fe61bfff700 1 -- 172.21.15.103:0/1749527702 >> v2:172.21.15.86:3300/0 conn(0x7fe61c0b8e50 msgr2=0x7fe61c1344d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:15.114 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.104+0000 7fe61bfff700 1 --2- 172.21.15.103:0/1749527702 >> v2:172.21.15.86:3300/0 conn(0x7fe61c0b8e50 0x7fe61c1344d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:15.114 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.104+0000 7fe61bfff700 1 -- 172.21.15.103:0/1749527702 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe61c136db0 con 0x7fe61c062210 2020-04-22T14:02:15.114 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.104+0000 7fe620aa1700 1 --2- 172.21.15.103:0/1749527702 >> v2:172.21.15.86:3300/0 conn(0x7fe61c0b8e50 0x7fe61c1344d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:02:15.114 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.104+0000 7fe61bfff700 1 --2- 172.21.15.103:0/1749527702 >> v2:172.21.15.103:3300/0 conn(0x7fe61c062210 0x7fe61c146fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe61c0ad930 tx=0x7fe60c00c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:15.115 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.104+0000 7fe61bfff700 1 --2- 172.21.15.103:0/1749527702 >> v2:172.21.15.103:3300/0 conn(0x7fe61c062210 0x7fe61c146fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe61c0ad930 tx=0x7fe60c00c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:15.115 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.104+0000 7fe61bfff700 1 --2- 172.21.15.103:0/1749527702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe61c062210 0x7fe61c146fe0 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7fe61c0ad930 tx=0x7fe60c00c460).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:15.115 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.104+0000 7fe61bfff700 1 --2- 172.21.15.103:0/1749527702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe61c062210 0x7fe61c146fe0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7fe61c0ad930 tx=0x7fe60c00c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:15.115 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.104+0000 7fe61bfff700 1 --2- 172.21.15.103:0/1749527702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe61c062210 0x7fe61c146fe0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7fe61c0ad930 tx=0x7fe60c00c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:15.115 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.104+0000 7fe6197fa700 1 -- 172.21.15.103:0/1749527702 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe60c00cc20 con 0x7fe61c062210 2020-04-22T14:02:15.115 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.104+0000 7fe61bfff700 1 --2- 172.21.15.103:0/1749527702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe61c062210 0x7fe61c146fe0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7fe61c0ad930 tx=0x7fe60c00c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:15.115 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.104+0000 7fe6197fa700 1 -- 172.21.15.103:0/1749527702 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60c00cd80 con 0x7fe61c062210 2020-04-22T14:02:15.116 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.104+0000 7fe621d03700 1 -- 172.21.15.103:0/1749527702 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe61c065180 con 0x7fe61c062210 2020-04-22T14:02:15.116 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.104+0000 7fe6197fa700 1 -- 172.21.15.103:0/1749527702 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe60c011170 con 0x7fe61c062210 2020-04-22T14:02:15.116 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.104+0000 7fe621d03700 1 -- 172.21.15.103:0/1749527702 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe61c134930 con 0x7fe61c062210 2020-04-22T14:02:15.116 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.104+0000 7fe61bfff700 1 --2- 172.21.15.103:0/1749527702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe61c062210 0x7fe61c146fe0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7fe61c0ad930 tx=0x7fe60c00c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:15.116 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.105+0000 7fe621d03700 1 -- 172.21.15.103:0/1749527702 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5f4003340 con 0x7fe61c062210 2020-04-22T14:02:15.116 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.105+0000 7fe6197fa700 1 -- 172.21.15.103:0/1749527702 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fe60c0064e0 con 0x7fe61c062210 2020-04-22T14:02:15.116 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.105+0000 7fe61bfff700 1 --2- 172.21.15.103:0/1749527702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe61c062210 0x7fe61c146fe0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7fe61c0ad930 tx=0x7fe60c00c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:15.117 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.105+0000 7fe6197fa700 1 --2- 172.21.15.103:0/1749527702 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe60004d9a0 0x7fe60004fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:15.117 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.105+0000 7fe6197fa700 1 -- 172.21.15.103:0/1749527702 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2074+0+0 (secure 0 0 0) 0x7fe60c060f50 con 0x7fe61c062210 2020-04-22T14:02:15.117 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.105+0000 7fe613fff700 1 --2- 172.21.15.103:0/1749527702 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe60004d9a0 0x7fe60004fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:15.117 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.105+0000 7fe613fff700 1 --2- 172.21.15.103:0/1749527702 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe60004d9a0 0x7fe60004fe60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe604002f30 tx=0x7fe604007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:15.117 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.106+0000 7fe613fff700 1 --2- 172.21.15.103:0/1749527702 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe60004d9a0 0x7fe60004fe60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe604002f30 tx=0x7fe604007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:15.117 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.106+0000 7fe613fff700 1 --2- 172.21.15.103:0/1749527702 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe60004d9a0 0x7fe60004fe60 secure :-1 s=READY pgs=17 cs=0 l=1 rx=0x7fe604002f30 tx=0x7fe604007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:15.117 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.109+0000 7fe61bfff700 1 --2- 172.21.15.103:0/1749527702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe61c062210 0x7fe61c146fe0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7fe61c0ad930 tx=0x7fe60c00c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:15.117 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.109+0000 7fe6197fa700 1 -- 172.21.15.103:0/1749527702 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fe60c03c2d0 con 0x7fe61c062210 2020-04-22T14:02:15.259 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.257+0000 7fe621d03700 1 -- 172.21.15.103:0/1749527702 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5f40021d0 con 0x7fe61c062210 2020-04-22T14:02:15.260 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.258+0000 7fe61bfff700 1 --2- 172.21.15.103:0/1749527702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe61c062210 0x7fe61c146fe0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7fe61c0ad930 tx=0x7fe60c00c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:15.260 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.258+0000 7fe6197fa700 1 -- 172.21.15.103:0/1749527702 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+8277 (secure 0 0 0) 0x7fe60c03f8f0 con 0x7fe61c062210 2020-04-22T14:02:15.260 INFO:teuthology.misc.health.smithi103.stdout: 2020-04-22T14:02:15.261 INFO:teuthology.misc.health.smithi103.stdout:{"epoch":11,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:02:13.652980+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"4","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:02:15.262 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.259+0000 7fe621d03700 1 -- 172.21.15.103:0/1749527702 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe60004d9a0 msgr2=0x7fe60004fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:15.262 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.259+0000 7fe621d03700 1 --2- 172.21.15.103:0/1749527702 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe60004d9a0 0x7fe60004fe60 secure :-1 s=READY pgs=17 cs=0 l=1 rx=0x7fe604002f30 tx=0x7fe604007a40).stop 2020-04-22T14:02:15.262 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.259+0000 7fe621d03700 1 -- 172.21.15.103:0/1749527702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe61c062210 msgr2=0x7fe61c146fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:15.262 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.259+0000 7fe621d03700 1 --2- 172.21.15.103:0/1749527702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe61c062210 0x7fe61c146fe0 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7fe61c0ad930 tx=0x7fe60c00c460).stop 2020-04-22T14:02:15.262 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.260+0000 7fe621d03700 1 -- 172.21.15.103:0/1749527702 shutdown_connections 2020-04-22T14:02:15.262 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.260+0000 7fe621d03700 1 --2- 172.21.15.103:0/1749527702 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe60004d9a0 0x7fe60004fe60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:15.263 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.260+0000 7fe621d03700 1 --2- 172.21.15.103:0/1749527702 >> v2:172.21.15.86:3300/0 conn(0x7fe61c0b8e50 0x7fe61c1344d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:15.263 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.260+0000 7fe621d03700 1 --2- 172.21.15.103:0/1749527702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe61c062210 0x7fe61c146fe0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:15.263 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.260+0000 7fe621d03700 1 --2- 172.21.15.103:0/1749527702 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe61c080230 0x7fe61c0b51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:15.263 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.260+0000 7fe621d03700 1 -- 172.21.15.103:0/1749527702 >> 172.21.15.103:0/1749527702 conn(0x7fe61c09dcd0 msgr2=0x7fe61c0b7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:15.263 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.260+0000 7fe621d03700 1 -- 172.21.15.103:0/1749527702 shutdown_connections 2020-04-22T14:02:15.263 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:15.260+0000 7fe621d03700 1 -- 172.21.15.103:0/1749527702 wait complete. 2020-04-22T14:02:15.271 DEBUG:teuthology.misc:0 of 8 OSDs are up 2020-04-22T14:02:15.410 INFO:tasks.ceph.osd.0.smithi103.stderr:2020-04-22T14:02:15.408+0000 7f5d842e5ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-04-22T14:02:15.469 INFO:tasks.ceph.osd.1.smithi103.stderr:2020-04-22T14:02:15.467+0000 7f53e97dbec0 -1 osd.1 0 log_to_monitors {default=true} 2020-04-22T14:02:15.534 INFO:tasks.ceph.osd.2.smithi103.stderr:2020-04-22T14:02:15.532+0000 7f19107a7ec0 -1 osd.2 0 log_to_monitors {default=true} 2020-04-22T14:02:15.586 INFO:tasks.ceph.osd.3.smithi103.stderr:2020-04-22T14:02:15.584+0000 7f855cf2dec0 -1 osd.3 0 log_to_monitors {default=true} 2020-04-22T14:02:15.632 INFO:tasks.ceph.osd.4.smithi086.stderr:2020-04-22T14:02:15.629+0000 7fda6f5b8ec0 -1 osd.4 0 log_to_monitors {default=true} 2020-04-22T14:02:15.693 INFO:tasks.ceph.osd.5.smithi086.stderr:2020-04-22T14:02:15.691+0000 7fbe1c214ec0 -1 osd.5 0 log_to_monitors {default=true} 2020-04-22T14:02:15.743 INFO:tasks.ceph.osd.6.smithi086.stderr:2020-04-22T14:02:15.741+0000 7fe311fc0ec0 -1 osd.6 0 log_to_monitors {default=true} 2020-04-22T14:02:15.809 INFO:tasks.ceph.osd.7.smithi086.stderr:2020-04-22T14:02:15.800+0000 7f6c76824ec0 -1 osd.7 0 log_to_monitors {default=true} 2020-04-22T14:02:16.624 INFO:tasks.ceph.osd.2.smithi103.stderr:2020-04-22T14:02:16.622+0000 7f18f8f70700 -1 osd.2 0 waiting for initial osdmap 2020-04-22T14:02:16.625 INFO:tasks.ceph.osd.1.smithi103.stderr:2020-04-22T14:02:16.623+0000 7f53d1fa4700 -1 osd.1 0 waiting for initial osdmap 2020-04-22T14:02:16.625 INFO:tasks.ceph.osd.3.smithi103.stderr:2020-04-22T14:02:16.623+0000 7f85456f6700 -1 osd.3 0 waiting for initial osdmap 2020-04-22T14:02:16.630 INFO:tasks.ceph.osd.0.smithi103.stderr:2020-04-22T14:02:16.625+0000 7f5d6caae700 -1 osd.0 0 waiting for initial osdmap 2020-04-22T14:02:17.621 INFO:tasks.ceph.osd.6.smithi086.stderr:2020-04-22T14:02:17.618+0000 7fe2fa789700 -1 osd.6 0 waiting for initial osdmap 2020-04-22T14:02:17.622 INFO:tasks.ceph.osd.4.smithi086.stderr:2020-04-22T14:02:17.618+0000 7fda57d81700 -1 osd.4 0 waiting for initial osdmap 2020-04-22T14:02:17.622 INFO:tasks.ceph.osd.5.smithi086.stderr:2020-04-22T14:02:17.618+0000 7fbe049dd700 -1 osd.5 0 waiting for initial osdmap 2020-04-22T14:02:17.622 INFO:tasks.ceph.osd.7.smithi086.stderr:2020-04-22T14:02:17.619+0000 7f6c5efed700 -1 osd.7 0 waiting for initial osdmap 2020-04-22T14:02:18.550 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:18.567 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:02:18.624 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:18.646 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:02:22.084 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:22.100 INFO:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-04-22T14:02:22.246 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.240+0000 7ffba1481700 1 Processor -- start 2020-04-22T14:02:22.246 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.240+0000 7ffba1481700 1 -- start start 2020-04-22T14:02:22.246 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.241+0000 7ffba1481700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffb9c0b8e50 0x7ffb9c062210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:22.246 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.241+0000 7ffba1481700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb9c080230 0x7ffb9c0b3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:22.246 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.241+0000 7ffba1481700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb9c0611a0 con 0x7ffb9c0613e0 2020-04-22T14:02:22.246 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.241+0000 7ffba1481700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb9c060f00 con 0x7ffb9c0b8e50 2020-04-22T14:02:22.247 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.241+0000 7ffba1481700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9c061c10 con 0x7ffb9c080230 2020-04-22T14:02:22.247 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.241+0000 7ffb9b7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffb9c0b8e50 0x7ffb9c062210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:22.247 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.241+0000 7ffb9b7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffb9c0b8e50 0x7ffb9c062210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46786/0 (socket says 172.21.15.103:46786) 2020-04-22T14:02:22.247 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.241+0000 7ffb9b7fe700 1 -- 172.21.15.103:0/319454354 learned_addr learned my addr 172.21.15.103:0/319454354 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:22.247 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.241+0000 7ffb9bfff700 1 --2- 172.21.15.103:0/319454354 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb9c080230 0x7ffb9c0b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:22.247 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.241+0000 7ffb9b7fe700 1 -- 172.21.15.103:0/319454354 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb9c080230 msgr2=0x7ffb9c0b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:22.247 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.241+0000 7ffb9b7fe700 1 --2- 172.21.15.103:0/319454354 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb9c080230 0x7ffb9c0b3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:22.248 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.241+0000 7ffb9b7fe700 1 -- 172.21.15.103:0/319454354 >> v1:172.21.15.86:6789/0 conn(0x7ffb9c0613e0 legacy=0x7ffb9c0ada20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:22.248 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.241+0000 7ffb9b7fe700 1 -- 172.21.15.103:0/319454354 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb9c0b9230 con 0x7ffb9c0b8e50 2020-04-22T14:02:22.248 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.241+0000 7ffb9b7fe700 1 --2- 172.21.15.103:0/319454354 >> v2:172.21.15.103:3300/0 conn(0x7ffb9c0b8e50 0x7ffb9c062210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ffb8c0032b0 tx=0x7ffb8c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:22.248 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.242+0000 7ffb9b7fe700 1 --2- 172.21.15.103:0/319454354 >> v2:172.21.15.103:3300/0 conn(0x7ffb9c0b8e50 0x7ffb9c062210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ffb8c0032b0 tx=0x7ffb8c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:22.248 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.242+0000 7ffb9b7fe700 1 --2- 172.21.15.103:0/319454354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb9c0b8e50 0x7ffb9c062210 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7ffb8c0032b0 tx=0x7ffb8c007dc0).ready entity=mon.1 client_cookie=4c6993499ce484b9 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:22.248 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.242+0000 7ffb9b7fe700 1 --2- 172.21.15.103:0/319454354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb9c0b8e50 0x7ffb9c062210 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7ffb8c0032b0 tx=0x7ffb8c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:22.248 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.242+0000 7ffb9a7fc700 1 -- 172.21.15.103:0/319454354 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb8c00a180 con 0x7ffb9c0b8e50 2020-04-22T14:02:22.249 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.242+0000 7ffb9b7fe700 1 --2- 172.21.15.103:0/319454354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb9c0b8e50 0x7ffb9c062210 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7ffb8c0032b0 tx=0x7ffb8c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:22.249 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.242+0000 7ffb9b7fe700 1 --2- 172.21.15.103:0/319454354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb9c0b8e50 0x7ffb9c062210 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7ffb8c0032b0 tx=0x7ffb8c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:22.249 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.242+0000 7ffb9a7fc700 1 -- 172.21.15.103:0/319454354 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb8c00a2e0 con 0x7ffb9c0b8e50 2020-04-22T14:02:22.249 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.242+0000 7ffb9a7fc700 1 -- 172.21.15.103:0/319454354 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb8c00a680 con 0x7ffb9c0b8e50 2020-04-22T14:02:22.249 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.242+0000 7ffba1481700 1 -- 172.21.15.103:0/319454354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb9c0b8e50 msgr2=0x7ffb9c062210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:22.249 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.242+0000 7ffba1481700 1 --2- 172.21.15.103:0/319454354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb9c0b8e50 0x7ffb9c062210 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7ffb8c0032b0 tx=0x7ffb8c007dc0).stop 2020-04-22T14:02:22.249 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.242+0000 7ffba1481700 1 -- 172.21.15.103:0/319454354 shutdown_connections 2020-04-22T14:02:22.249 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.242+0000 7ffba1481700 1 --2- 172.21.15.103:0/319454354 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb9c080230 0x7ffb9c0b3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:22.250 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.242+0000 7ffba1481700 1 --2- 172.21.15.103:0/319454354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb9c0b8e50 0x7ffb9c062210 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:22.250 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.242+0000 7ffba1481700 1 -- 172.21.15.103:0/319454354 >> 172.21.15.103:0/319454354 conn(0x7ffb9c09dcd0 msgr2=0x7ffb9c09e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:22.250 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.242+0000 7ffba1481700 1 -- 172.21.15.103:0/319454354 shutdown_connections 2020-04-22T14:02:22.250 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.242+0000 7ffba1481700 1 -- 172.21.15.103:0/319454354 wait complete. 2020-04-22T14:02:22.250 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.243+0000 7ffba1481700 1 Processor -- start 2020-04-22T14:02:22.250 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.244+0000 7ffba1481700 1 -- start start 2020-04-22T14:02:22.253 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.244+0000 7ffba1481700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ffb9c0b8e50 0x7ffb9c062800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:22.254 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.244+0000 7ffba1481700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb9c144de0 con 0x7ffb9c0613e0 2020-04-22T14:02:22.254 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.244+0000 7ffba1481700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb9c144870 con 0x7ffb9c080230 2020-04-22T14:02:22.254 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.244+0000 7ffba1481700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb9c144bd0 con 0x7ffb9c0b8e50 2020-04-22T14:02:22.254 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.244+0000 7ffb9affd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ffb9c080230 0x7ffb9c064df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:38982/0 (socket says 172.21.15.103:38982) 2020-04-22T14:02:22.254 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.244+0000 7ffb9affd700 1 -- 172.21.15.103:0/650149809 learned_addr learned my addr 172.21.15.103:0/650149809 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:22.254 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.245+0000 7ffb9bfff700 1 --2- 172.21.15.103:0/650149809 >> v2:172.21.15.86:3300/0 conn(0x7ffb9c0b8e50 0x7ffb9c062800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:22.254 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.245+0000 7ffb83fff700 1 -- 172.21.15.103:0/650149809 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1011964539 0 0) 0x7ffb9c144870 con 0x7ffb9c080230 2020-04-22T14:02:22.255 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.245+0000 7ffb83fff700 1 -- 172.21.15.103:0/650149809 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb7c003230 con 0x7ffb9c080230 2020-04-22T14:02:22.255 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.245+0000 7ffb83fff700 1 -- 172.21.15.103:0/650149809 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2105205341 0 0) 0x7ffb9c144de0 con 0x7ffb9c0613e0 2020-04-22T14:02:22.255 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.245+0000 7ffb83fff700 1 -- 172.21.15.103:0/650149809 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb9c144870 con 0x7ffb9c0613e0 2020-04-22T14:02:22.255 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.245+0000 7ffb83fff700 1 -- 172.21.15.103:0/650149809 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3762470501 0 0) 0x7ffb7c003230 con 0x7ffb9c080230 2020-04-22T14:02:22.255 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.245+0000 7ffb9bfff700 1 -- 172.21.15.103:0/650149809 >> v1:172.21.15.103:6789/0 conn(0x7ffb9c080230 legacy=0x7ffb9c064df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:22.255 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.245+0000 7ffb9bfff700 1 -- 172.21.15.103:0/650149809 >> v1:172.21.15.86:6789/0 conn(0x7ffb9c0613e0 legacy=0x7ffb9c0646e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:22.255 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.245+0000 7ffb9bfff700 1 -- 172.21.15.103:0/650149809 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb9c0641d0 con 0x7ffb9c0b8e50 2020-04-22T14:02:22.255 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.245+0000 7ffb9bfff700 1 --2- 172.21.15.103:0/650149809 >> v2:172.21.15.86:3300/0 conn(0x7ffb9c0b8e50 0x7ffb9c062800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffb90001b00 tx=0x7ffb94010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:22.256 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.245+0000 7ffb9bfff700 1 --2- 172.21.15.103:0/650149809 >> v2:172.21.15.86:3300/0 conn(0x7ffb9c0b8e50 0x7ffb9c062800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffb90001b00 tx=0x7ffb94010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:22.256 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.245+0000 7ffb9bfff700 1 --2- 172.21.15.103:0/650149809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb9c0b8e50 0x7ffb9c062800 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7ffb90001b00 tx=0x7ffb94010ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:22.256 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.245+0000 7ffb9bfff700 1 --2- 172.21.15.103:0/650149809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb9c0b8e50 0x7ffb9c062800 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7ffb90001b00 tx=0x7ffb94010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:22.256 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.245+0000 7ffb83fff700 1 -- 172.21.15.103:0/650149809 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb90001960 con 0x7ffb9c0b8e50 2020-04-22T14:02:22.256 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.245+0000 7ffb9bfff700 1 --2- 172.21.15.103:0/650149809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb9c0b8e50 0x7ffb9c062800 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7ffb90001b00 tx=0x7ffb94010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:22.256 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.245+0000 7ffb9bfff700 1 --2- 172.21.15.103:0/650149809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb9c0b8e50 0x7ffb9c062800 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7ffb90001b00 tx=0x7ffb94010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:22.256 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.245+0000 7ffb83fff700 1 -- 172.21.15.103:0/650149809 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb94007360 con 0x7ffb9c0b8e50 2020-04-22T14:02:22.257 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.245+0000 7ffb83fff700 1 -- 172.21.15.103:0/650149809 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb940056c0 con 0x7ffb9c0b8e50 2020-04-22T14:02:22.257 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.245+0000 7ffba1481700 1 -- 172.21.15.103:0/650149809 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb9c066550 con 0x7ffb9c0b8e50 2020-04-22T14:02:22.257 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.245+0000 7ffba1481700 1 -- 172.21.15.103:0/650149809 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb9c0b3200 con 0x7ffb9c0b8e50 2020-04-22T14:02:22.257 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.246+0000 7ffb9bfff700 1 --2- 172.21.15.103:0/650149809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb9c0b8e50 0x7ffb9c062800 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7ffb90001b00 tx=0x7ffb94010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:22.257 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.246+0000 7ffba1481700 1 -- 172.21.15.103:0/650149809 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb9c0643c0 con 0x7ffb9c0b8e50 2020-04-22T14:02:22.257 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.246+0000 7ffb83fff700 1 -- 172.21.15.103:0/650149809 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ffb940058c0 con 0x7ffb9c0b8e50 2020-04-22T14:02:22.257 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.246+0000 7ffb9bfff700 1 --2- 172.21.15.103:0/650149809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb9c0b8e50 0x7ffb9c062800 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7ffb90001b00 tx=0x7ffb94010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:22.258 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.247+0000 7ffb83fff700 1 --2- 172.21.15.103:0/650149809 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffb7c04de30 0x7ffb7c0502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:22.258 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.247+0000 7ffb83fff700 1 -- 172.21.15.103:0/650149809 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4900+0+0 (secure 0 0 0) 0x7ffb9400d0d0 con 0x7ffb9c0b8e50 2020-04-22T14:02:22.258 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.247+0000 7ffb9b7fe700 1 --2- 172.21.15.103:0/650149809 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffb7c04de30 0x7ffb7c0502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:22.258 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.247+0000 7ffb9b7fe700 1 --2- 172.21.15.103:0/650149809 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffb7c04de30 0x7ffb7c0502f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffb8c008250 tx=0x7ffb8c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:22.258 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.247+0000 7ffb9b7fe700 1 --2- 172.21.15.103:0/650149809 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffb7c04de30 0x7ffb7c0502f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffb8c008250 tx=0x7ffb8c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:22.258 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.247+0000 7ffb9b7fe700 1 --2- 172.21.15.103:0/650149809 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffb7c04de30 0x7ffb7c0502f0 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7ffb8c008250 tx=0x7ffb8c007dc0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:22.258 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.250+0000 7ffb9bfff700 1 --2- 172.21.15.103:0/650149809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb9c0b8e50 0x7ffb9c062800 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7ffb90001b00 tx=0x7ffb94010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:22.258 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.250+0000 7ffb83fff700 1 -- 172.21.15.103:0/650149809 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ffb9403c0e0 con 0x7ffb9c0b8e50 2020-04-22T14:02:22.394 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.392+0000 7ffba1481700 1 -- 172.21.15.103:0/650149809 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb9c056c90 con 0x7ffb9c0b8e50 2020-04-22T14:02:22.395 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.393+0000 7ffb9bfff700 1 --2- 172.21.15.103:0/650149809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb9c0b8e50 0x7ffb9c062800 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7ffb90001b00 tx=0x7ffb94010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:22.395 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.393+0000 7ffb83fff700 1 -- 172.21.15.103:0/650149809 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11857 (secure 0 0 0) 0x7ffb9403f700 con 0x7ffb9c0b8e50 2020-04-22T14:02:22.396 INFO:teuthology.misc.health.smithi103.stdout: 2020-04-22T14:02:22.396 INFO:teuthology.misc.health.smithi103.stdout:{"epoch":17,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:02:20.638810+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:02:22.397 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.394+0000 7ffba1481700 1 -- 172.21.15.103:0/650149809 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffb7c04de30 msgr2=0x7ffb7c0502f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:22.397 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.394+0000 7ffba1481700 1 --2- 172.21.15.103:0/650149809 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffb7c04de30 0x7ffb7c0502f0 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7ffb8c008250 tx=0x7ffb8c007dc0).stop 2020-04-22T14:02:22.397 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.394+0000 7ffba1481700 1 -- 172.21.15.103:0/650149809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb9c0b8e50 msgr2=0x7ffb9c062800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:22.397 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.394+0000 7ffba1481700 1 --2- 172.21.15.103:0/650149809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb9c0b8e50 0x7ffb9c062800 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7ffb90001b00 tx=0x7ffb94010ac0).stop 2020-04-22T14:02:22.398 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.394+0000 7ffba1481700 1 -- 172.21.15.103:0/650149809 shutdown_connections 2020-04-22T14:02:22.398 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.394+0000 7ffba1481700 1 --2- 172.21.15.103:0/650149809 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffb7c04de30 0x7ffb7c0502f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:22.398 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.394+0000 7ffba1481700 1 --2- 172.21.15.103:0/650149809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb9c0b8e50 0x7ffb9c062800 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:22.398 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.394+0000 7ffba1481700 1 -- 172.21.15.103:0/650149809 >> 172.21.15.103:0/650149809 conn(0x7ffb9c09dcd0 msgr2=0x7ffb9c0af980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:22.398 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.395+0000 7ffba1481700 1 -- 172.21.15.103:0/650149809 shutdown_connections 2020-04-22T14:02:22.398 INFO:teuthology.misc.health.smithi103.stderr:2020-04-22T14:02:22.395+0000 7ffba1481700 1 -- 172.21.15.103:0/650149809 wait complete. 2020-04-22T14:02:22.406 DEBUG:teuthology.misc:8 of 8 OSDs are up 2020-04-22T14:02:22.406 INFO:tasks.ceph:Creating RBD pool 2020-04-22T14:02:22.406 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:22.419 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd pool create rbd 8 2020-04-22T14:02:22.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.566+0000 7fdf7f20a700 1 Processor -- start 2020-04-22T14:02:22.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.567+0000 7fdf7f20a700 1 -- start start 2020-04-22T14:02:22.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.567+0000 7fdf7f20a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdf78062170 0x7fdf780b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:22.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.567+0000 7fdf7f20a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdf780b5210 0x7fdf780adf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:22.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.567+0000 7fdf7f20a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf780b5650 con 0x7fdf78152a90 2020-04-22T14:02:22.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.567+0000 7fdf7f20a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf780614f0 con 0x7fdf78062170 2020-04-22T14:02:22.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.567+0000 7fdf7f20a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf78061790 con 0x7fdf780b5210 2020-04-22T14:02:22.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.567+0000 7fdf7dfa8700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdf780b5210 0x7fdf780adf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:22.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.568+0000 7fdf7dfa8700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdf780b5210 0x7fdf780adf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46802/0 (socket says 172.21.15.103:46802) 2020-04-22T14:02:22.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.568+0000 7fdf7dfa8700 1 -- 172.21.15.103:0/4126592891 learned_addr learned my addr 172.21.15.103:0/4126592891 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:22.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.568+0000 7fdf7cfa6700 1 --2- 172.21.15.103:0/4126592891 >> v2:172.21.15.86:3300/0 conn(0x7fdf78062170 0x7fdf780b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:22.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.568+0000 7fdf7dfa8700 1 -- 172.21.15.103:0/4126592891 >> v2:172.21.15.86:3300/0 conn(0x7fdf78062170 msgr2=0x7fdf780b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:22.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.568+0000 7fdf7dfa8700 1 --2- 172.21.15.103:0/4126592891 >> v2:172.21.15.86:3300/0 conn(0x7fdf78062170 0x7fdf780b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:22.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.568+0000 7fdf7dfa8700 1 -- 172.21.15.103:0/4126592891 >> v1:172.21.15.86:6789/0 conn(0x7fdf78152a90 legacy=0x7fdf780b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:22.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.568+0000 7fdf7dfa8700 1 -- 172.21.15.103:0/4126592891 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf78061a30 con 0x7fdf780b5210 2020-04-22T14:02:22.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.568+0000 7fdf7dfa8700 1 --2- 172.21.15.103:0/4126592891 >> v2:172.21.15.103:3300/0 conn(0x7fdf780b5210 0x7fdf780adf50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdf700032b0 tx=0x7fdf70007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:22.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.568+0000 7fdf7dfa8700 1 --2- 172.21.15.103:0/4126592891 >> v2:172.21.15.103:3300/0 conn(0x7fdf780b5210 0x7fdf780adf50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdf700032b0 tx=0x7fdf70007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:22.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.568+0000 7fdf7dfa8700 1 --2- 172.21.15.103:0/4126592891 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf780b5210 0x7fdf780adf50 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7fdf700032b0 tx=0x7fdf70007dc0).ready entity=mon.1 client_cookie=217e1299b1f69286 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:22.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.568+0000 7fdf7dfa8700 1 --2- 172.21.15.103:0/4126592891 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf780b5210 0x7fdf780adf50 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7fdf700032b0 tx=0x7fdf70007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:22.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.568+0000 7fdf6ffff700 1 -- 172.21.15.103:0/4126592891 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf7000a180 con 0x7fdf780b5210 2020-04-22T14:02:22.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.568+0000 7fdf7dfa8700 1 --2- 172.21.15.103:0/4126592891 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf780b5210 0x7fdf780adf50 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7fdf700032b0 tx=0x7fdf70007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:22.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.568+0000 7fdf7dfa8700 1 --2- 172.21.15.103:0/4126592891 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf780b5210 0x7fdf780adf50 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7fdf700032b0 tx=0x7fdf70007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:22.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.568+0000 7fdf6ffff700 1 -- 172.21.15.103:0/4126592891 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7000a2e0 con 0x7fdf780b5210 2020-04-22T14:02:22.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.568+0000 7fdf6ffff700 1 -- 172.21.15.103:0/4126592891 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf7000a700 con 0x7fdf780b5210 2020-04-22T14:02:22.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.568+0000 7fdf7f20a700 1 -- 172.21.15.103:0/4126592891 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf780b5210 msgr2=0x7fdf780adf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:22.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.568+0000 7fdf7f20a700 1 --2- 172.21.15.103:0/4126592891 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf780b5210 0x7fdf780adf50 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7fdf700032b0 tx=0x7fdf70007dc0).stop 2020-04-22T14:02:22.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.569+0000 7fdf7f20a700 1 -- 172.21.15.103:0/4126592891 shutdown_connections 2020-04-22T14:02:22.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.569+0000 7fdf7f20a700 1 --2- 172.21.15.103:0/4126592891 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf780b5210 0x7fdf780adf50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:22.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.569+0000 7fdf7f20a700 1 --2- 172.21.15.103:0/4126592891 >> v2:172.21.15.86:3300/0 conn(0x7fdf78062170 0x7fdf780b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:22.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.569+0000 7fdf7f20a700 1 -- 172.21.15.103:0/4126592891 >> 172.21.15.103:0/4126592891 conn(0x7fdf7805ad30 msgr2=0x7fdf7805b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:22.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.569+0000 7fdf7f20a700 1 -- 172.21.15.103:0/4126592891 shutdown_connections 2020-04-22T14:02:22.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.569+0000 7fdf7f20a700 1 -- 172.21.15.103:0/4126592891 wait complete. 2020-04-22T14:02:22.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.570+0000 7fdf7f20a700 1 Processor -- start 2020-04-22T14:02:22.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.570+0000 7fdf7f20a700 1 -- start start 2020-04-22T14:02:22.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.571+0000 7fdf7f20a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdf78062170 0x7fdf780b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:22.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.571+0000 7fdf7f20a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdf78152a90 0x7fdf780b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:22.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.571+0000 7fdf7f20a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf78064100 con 0x7fdf780b5210 2020-04-22T14:02:22.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.571+0000 7fdf7f20a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf78063f10 con 0x7fdf78062170 2020-04-22T14:02:22.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.571+0000 7fdf7f20a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7815d120 con 0x7fdf78152a90 2020-04-22T14:02:22.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.571+0000 7fdf7d7a7700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdf78062170 0x7fdf780b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:22.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.571+0000 7fdf7d7a7700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdf78062170 0x7fdf780b1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46804/0 (socket says 172.21.15.103:46804) 2020-04-22T14:02:22.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.571+0000 7fdf7d7a7700 1 -- 172.21.15.103:0/2415602440 learned_addr learned my addr 172.21.15.103:0/2415602440 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:22.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.571+0000 7fdf7dfa8700 1 --2- 172.21.15.103:0/2415602440 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdf78152a90 0x7fdf780b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:22.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.571+0000 7fdf7d7a7700 1 -- 172.21.15.103:0/2415602440 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdf78152a90 msgr2=0x7fdf780b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:22.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.571+0000 7fdf7d7a7700 1 --2- 172.21.15.103:0/2415602440 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdf78152a90 0x7fdf780b22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:22.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.571+0000 7fdf7d7a7700 1 -- 172.21.15.103:0/2415602440 >> v1:172.21.15.86:6789/0 conn(0x7fdf780b5210 legacy=0x7fdf780adee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:22.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.571+0000 7fdf7d7a7700 1 -- 172.21.15.103:0/2415602440 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf780ae5f0 con 0x7fdf78062170 2020-04-22T14:02:22.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.571+0000 7fdf6dffb700 1 -- 172.21.15.103:0/2415602440 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1269207516 0 0) 0x7fdf78064100 con 0x7fdf780b5210 2020-04-22T14:02:22.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.571+0000 7fdf7d7a7700 1 --2- 172.21.15.103:0/2415602440 >> v2:172.21.15.103:3300/0 conn(0x7fdf78062170 0x7fdf780b1d20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdf780ad5a0 tx=0x7fdf7400c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:22.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.571+0000 7fdf7d7a7700 1 --2- 172.21.15.103:0/2415602440 >> v2:172.21.15.103:3300/0 conn(0x7fdf78062170 0x7fdf780b1d20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdf780ad5a0 tx=0x7fdf7400c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:22.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.571+0000 7fdf7d7a7700 1 --2- 172.21.15.103:0/2415602440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf78062170 0x7fdf780b1d20 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7fdf780ad5a0 tx=0x7fdf7400c460).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:22.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.571+0000 7fdf7d7a7700 1 --2- 172.21.15.103:0/2415602440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf78062170 0x7fdf780b1d20 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7fdf780ad5a0 tx=0x7fdf7400c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:22.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.571+0000 7fdf6dffb700 1 -- 172.21.15.103:0/2415602440 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf740126d0 con 0x7fdf78062170 2020-04-22T14:02:22.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.571+0000 7fdf7d7a7700 1 --2- 172.21.15.103:0/2415602440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf78062170 0x7fdf780b1d20 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7fdf780ad5a0 tx=0x7fdf7400c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:22.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.571+0000 7fdf7f20a700 1 -- 172.21.15.103:0/2415602440 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf78152390 con 0x7fdf78062170 2020-04-22T14:02:22.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.571+0000 7fdf6dffb700 1 -- 172.21.15.103:0/2415602440 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf74012870 con 0x7fdf78062170 2020-04-22T14:02:22.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.571+0000 7fdf7d7a7700 1 --2- 172.21.15.103:0/2415602440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf78062170 0x7fdf780b1d20 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7fdf780ad5a0 tx=0x7fdf7400c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:22.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.571+0000 7fdf6dffb700 1 -- 172.21.15.103:0/2415602440 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf74012c90 con 0x7fdf78062170 2020-04-22T14:02:22.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.571+0000 7fdf7f20a700 1 -- 172.21.15.103:0/2415602440 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf780634a0 con 0x7fdf78062170 2020-04-22T14:02:22.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.572+0000 7fdf7d7a7700 1 --2- 172.21.15.103:0/2415602440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf78062170 0x7fdf780b1d20 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7fdf780ad5a0 tx=0x7fdf7400c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:22.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.572+0000 7fdf6dffb700 1 -- 172.21.15.103:0/2415602440 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fdf740064e0 con 0x7fdf78062170 2020-04-22T14:02:22.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.572+0000 7fdf7d7a7700 1 --2- 172.21.15.103:0/2415602440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf78062170 0x7fdf780b1d20 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7fdf780ad5a0 tx=0x7fdf7400c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:22.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.572+0000 7fdf7f20a700 1 -- 172.21.15.103:0/2415602440 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf78056c90 con 0x7fdf78062170 2020-04-22T14:02:22.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.573+0000 7fdf6dffb700 1 --2- 172.21.15.103:0/2415602440 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdf5804d7d0 0x7fdf5804fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:22.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.573+0000 7fdf6dffb700 1 -- 172.21.15.103:0/2415602440 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4900+0+0 (secure 0 0 0) 0x7fdf74060e80 con 0x7fdf78062170 2020-04-22T14:02:22.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.573+0000 7fdf7cfa6700 1 --2- 172.21.15.103:0/2415602440 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdf5804d7d0 0x7fdf5804fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:22.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.573+0000 7fdf7cfa6700 1 --2- 172.21.15.103:0/2415602440 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdf5804d7d0 0x7fdf5804fc90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdf68007920 tx=0x7fdf7805a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:22.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.573+0000 7fdf7cfa6700 1 --2- 172.21.15.103:0/2415602440 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdf5804d7d0 0x7fdf5804fc90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdf68007920 tx=0x7fdf7805a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:22.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.573+0000 7fdf7cfa6700 1 --2- 172.21.15.103:0/2415602440 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdf5804d7d0 0x7fdf5804fc90 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7fdf68007920 tx=0x7fdf7805a720).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:22.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.577+0000 7fdf7d7a7700 1 --2- 172.21.15.103:0/2415602440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf78062170 0x7fdf780b1d20 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7fdf780ad5a0 tx=0x7fdf7400c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:22.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.577+0000 7fdf6dffb700 1 -- 172.21.15.103:0/2415602440 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fdf7403c200 con 0x7fdf78062170 2020-04-22T14:02:22.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:22.720+0000 7fdf7f20a700 1 -- 172.21.15.103:0/2415602440 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fdf7815d290 con 0x7fdf78062170 2020-04-22T14:02:23.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.280+0000 7fdf7d7a7700 1 --2- 172.21.15.103:0/2415602440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf78062170 0x7fdf780b1d20 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7fdf780ad5a0 tx=0x7fdf7400c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:23.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.280+0000 7fdf6dffb700 1 -- 172.21.15.103:0/2415602440 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v18) v1 ==== 109+0+0 (secure 0 0 0) 0x7fdf7403f820 con 0x7fdf78062170 2020-04-22T14:02:23.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.281+0000 7fdf7f20a700 1 -- 172.21.15.103:0/2415602440 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdf5804d7d0 msgr2=0x7fdf5804fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:23.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.281+0000 7fdf7f20a700 1 --2- 172.21.15.103:0/2415602440 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdf5804d7d0 0x7fdf5804fc90 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7fdf68007920 tx=0x7fdf7805a720).stop 2020-04-22T14:02:23.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.281+0000 7fdf7f20a700 1 -- 172.21.15.103:0/2415602440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf78062170 msgr2=0x7fdf780b1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:23.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.281+0000 7fdf7f20a700 1 --2- 172.21.15.103:0/2415602440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf78062170 0x7fdf780b1d20 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7fdf780ad5a0 tx=0x7fdf7400c460).stop 2020-04-22T14:02:23.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.281+0000 7fdf7f20a700 1 -- 172.21.15.103:0/2415602440 shutdown_connections 2020-04-22T14:02:23.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.281+0000 7fdf7f20a700 1 --2- 172.21.15.103:0/2415602440 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdf5804d7d0 0x7fdf5804fc90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:23.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.281+0000 7fdf7f20a700 1 --2- 172.21.15.103:0/2415602440 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdf78152a90 0x7fdf780b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:23.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.281+0000 7fdf7f20a700 1 --2- 172.21.15.103:0/2415602440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf78062170 0x7fdf780b1d20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:23.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.281+0000 7fdf7f20a700 1 -- 172.21.15.103:0/2415602440 >> 172.21.15.103:0/2415602440 conn(0x7fdf7805ad30 msgr2=0x7fdf780b34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:23.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.281+0000 7fdf7f20a700 1 -- 172.21.15.103:0/2415602440 shutdown_connections 2020-04-22T14:02:23.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.282+0000 7fdf7f20a700 1 -- 172.21.15.103:0/2415602440 wait complete. 2020-04-22T14:02:23.285 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'rbd' created 2020-04-22T14:02:23.294 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:23.308 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2020-04-22T14:02:23.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.453+0000 7f0a8b5d3700 1 Processor -- start 2020-04-22T14:02:23.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.453+0000 7f0a8b5d3700 1 -- start start 2020-04-22T14:02:23.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.454+0000 7f0a8b5d3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0a84152a90 0x7f0a840b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:23.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.454+0000 7f0a8b5d3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0a84062170 0x7f0a840b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:23.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.454+0000 7f0a8b5d3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a840b5210 0x7f0a84156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:23.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.454+0000 7f0a8b5d3700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a840b5650 con 0x7f0a84062170 2020-04-22T14:02:23.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.454+0000 7f0a8b5d3700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a840614f0 con 0x7f0a84152a90 2020-04-22T14:02:23.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.454+0000 7f0a8b5d3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a84061790 con 0x7f0a840b5210 2020-04-22T14:02:23.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.454+0000 7f0a89b70700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0a84152a90 0x7f0a840b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:23.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.454+0000 7f0a89b70700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0a84152a90 0x7f0a840b44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46812/0 (socket says 172.21.15.103:46812) 2020-04-22T14:02:23.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.454+0000 7f0a89b70700 1 -- 172.21.15.103:0/3351288958 learned_addr learned my addr 172.21.15.103:0/3351288958 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:23.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.454+0000 7f0a8a371700 1 --2- 172.21.15.103:0/3351288958 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a840b5210 0x7f0a84156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:23.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.454+0000 7f0a8936f700 1 --2- 172.21.15.103:0/3351288958 >> v2:172.21.15.86:3300/0 conn(0x7f0a84062170 0x7f0a840b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:23.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.454+0000 7f0a89b70700 1 -- 172.21.15.103:0/3351288958 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a840b5210 msgr2=0x7f0a84156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:23.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.454+0000 7f0a89b70700 1 --2- 172.21.15.103:0/3351288958 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a840b5210 0x7f0a84156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:23.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.454+0000 7f0a89b70700 1 -- 172.21.15.103:0/3351288958 >> v2:172.21.15.86:3300/0 conn(0x7f0a84062170 msgr2=0x7f0a840b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:23.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.454+0000 7f0a89b70700 1 --2- 172.21.15.103:0/3351288958 >> v2:172.21.15.86:3300/0 conn(0x7f0a84062170 0x7f0a840b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:23.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.455+0000 7f0a89b70700 1 -- 172.21.15.103:0/3351288958 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a84061a30 con 0x7f0a84152a90 2020-04-22T14:02:23.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.455+0000 7f0a8936f700 1 --2- 172.21.15.103:0/3351288958 >> v2:172.21.15.86:3300/0 conn(0x7f0a84062170 0x7f0a840b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:02:23.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.455+0000 7f0a89b70700 1 --2- 172.21.15.103:0/3351288958 >> v2:172.21.15.103:3300/0 conn(0x7f0a84152a90 0x7f0a840b44d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0a80002f30 tx=0x7f0a80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:23.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.455+0000 7f0a89b70700 1 --2- 172.21.15.103:0/3351288958 >> v2:172.21.15.103:3300/0 conn(0x7f0a84152a90 0x7f0a840b44d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0a80002f30 tx=0x7f0a80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:23.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.455+0000 7f0a89b70700 1 --2- 172.21.15.103:0/3351288958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a84152a90 0x7f0a840b44d0 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7f0a80002f30 tx=0x7f0a80007a40).ready entity=mon.1 client_cookie=84292774c3185848 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:23.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.455+0000 7f0a89b70700 1 --2- 172.21.15.103:0/3351288958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a84152a90 0x7f0a840b44d0 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f0a80002f30 tx=0x7f0a80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:23.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.455+0000 7f0a89b70700 1 --2- 172.21.15.103:0/3351288958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a84152a90 0x7f0a840b44d0 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f0a80002f30 tx=0x7f0a80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:23.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.455+0000 7f0a89b70700 1 --2- 172.21.15.103:0/3351288958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a84152a90 0x7f0a840b44d0 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f0a80002f30 tx=0x7f0a80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:23.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.455+0000 7f0a88b6e700 1 -- 172.21.15.103:0/3351288958 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a80011670 con 0x7f0a84152a90 2020-04-22T14:02:23.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.455+0000 7f0a88b6e700 1 -- 172.21.15.103:0/3351288958 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a800117d0 con 0x7f0a84152a90 2020-04-22T14:02:23.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.455+0000 7f0a88b6e700 1 -- 172.21.15.103:0/3351288958 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a80011bf0 con 0x7f0a84152a90 2020-04-22T14:02:23.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.455+0000 7f0a8b5d3700 1 -- 172.21.15.103:0/3351288958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a84152a90 msgr2=0x7f0a840b44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:23.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.455+0000 7f0a8b5d3700 1 --2- 172.21.15.103:0/3351288958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a84152a90 0x7f0a840b44d0 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7f0a80002f30 tx=0x7f0a80007a40).stop 2020-04-22T14:02:23.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.455+0000 7f0a8b5d3700 1 -- 172.21.15.103:0/3351288958 shutdown_connections 2020-04-22T14:02:23.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.455+0000 7f0a8b5d3700 1 --2- 172.21.15.103:0/3351288958 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a840b5210 0x7f0a84156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:23.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.455+0000 7f0a8b5d3700 1 --2- 172.21.15.103:0/3351288958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a84152a90 0x7f0a840b44d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:23.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.455+0000 7f0a8b5d3700 1 --2- 172.21.15.103:0/3351288958 >> v2:172.21.15.86:3300/0 conn(0x7f0a84062170 0x7f0a840b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:23.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.455+0000 7f0a8b5d3700 1 -- 172.21.15.103:0/3351288958 >> 172.21.15.103:0/3351288958 conn(0x7f0a8405ad30 msgr2=0x7f0a8405b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:23.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.455+0000 7f0a8b5d3700 1 -- 172.21.15.103:0/3351288958 shutdown_connections 2020-04-22T14:02:23.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.455+0000 7f0a8b5d3700 1 -- 172.21.15.103:0/3351288958 wait complete. 2020-04-22T14:02:23.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.456+0000 7f0a8b5d3700 1 Processor -- start 2020-04-22T14:02:23.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.457+0000 7f0a8b5d3700 1 -- start start 2020-04-22T14:02:23.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.457+0000 7f0a8b5d3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a840b5210 0x7f0a840b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:23.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.457+0000 7f0a8b5d3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0a84152a90 0x7f0a84155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:23.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.457+0000 7f0a8b5d3700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a840b2260 con 0x7f0a84062170 2020-04-22T14:02:23.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.457+0000 7f0a8b5d3700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a84065860 con 0x7f0a84152a90 2020-04-22T14:02:23.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.457+0000 7f0a8b5d3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8407fad0 con 0x7f0a840b5210 2020-04-22T14:02:23.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.457+0000 7f0a89b70700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f0a84062170 0x7f0a84066190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39008/0 (socket says 172.21.15.103:39008) 2020-04-22T14:02:23.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.457+0000 7f0a89b70700 1 -- 172.21.15.103:0/3460522175 learned_addr learned my addr 172.21.15.103:0/3460522175 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:23.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.457+0000 7f0a7a7fc700 1 -- 172.21.15.103:0/3460522175 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3336733362 0 0) 0x7f0a84061a30 con 0x7f0a84062170 2020-04-22T14:02:23.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.458+0000 7f0a8936f700 1 --2- 172.21.15.103:0/3460522175 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a840b5210 0x7f0a840b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:23.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.458+0000 7f0a7a7fc700 1 -- 172.21.15.103:0/3460522175 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a6c003230 con 0x7f0a84062170 2020-04-22T14:02:23.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.458+0000 7f0a8a371700 1 --2- 172.21.15.103:0/3460522175 >> v2:172.21.15.86:3300/0 conn(0x7f0a84152a90 0x7f0a84155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:23.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.458+0000 7f0a7a7fc700 1 -- 172.21.15.103:0/3460522175 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1316995381 0 0) 0x7f0a6c003230 con 0x7f0a84062170 2020-04-22T14:02:23.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.458+0000 7f0a7a7fc700 1 -- 172.21.15.103:0/3460522175 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0a84061a30 con 0x7f0a84062170 2020-04-22T14:02:23.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.458+0000 7f0a7a7fc700 1 -- 172.21.15.103:0/3460522175 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f0a800085e0 con 0x7f0a84062170 2020-04-22T14:02:23.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.458+0000 7f0a7a7fc700 1 -- 172.21.15.103:0/3460522175 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a840b5210 msgr2=0x7f0a840b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:23.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.458+0000 7f0a7a7fc700 1 --2- 172.21.15.103:0/3460522175 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a840b5210 0x7f0a840b1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:23.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.458+0000 7f0a7a7fc700 1 -- 172.21.15.103:0/3460522175 >> v2:172.21.15.86:3300/0 conn(0x7f0a84152a90 msgr2=0x7f0a84155630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:23.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.458+0000 7f0a7a7fc700 1 --2- 172.21.15.103:0/3460522175 >> v2:172.21.15.86:3300/0 conn(0x7f0a84152a90 0x7f0a84155630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:23.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.458+0000 7f0a7a7fc700 1 -- 172.21.15.103:0/3460522175 >> v1:172.21.15.103:6789/0 conn(0x7f0a84062170 legacy=0x7f0a84066190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:23.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.458+0000 7f0a7a7fc700 1 --2- 172.21.15.103:0/3460522175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a6c0037f0 0x7f0a6c003c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:23.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.458+0000 7f0a7a7fc700 1 --2- 172.21.15.103:0/3460522175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a6c0044d0 0x7f0a6c004930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:23.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.458+0000 7f0a7a7fc700 1 --2- 172.21.15.103:0/3460522175 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a6c004d90 0x7f0a6c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:23.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.458+0000 7f0a7a7fc700 1 -- 172.21.15.103:0/3460522175 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8407fad0 con 0x7f0a6c0044d0 2020-04-22T14:02:23.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.458+0000 7f0a7a7fc700 1 -- 172.21.15.103:0/3460522175 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c005210 con 0x7f0a6c0037f0 2020-04-22T14:02:23.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.458+0000 7f0a7a7fc700 1 -- 172.21.15.103:0/3460522175 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c0053a0 con 0x7f0a6c004d90 2020-04-22T14:02:23.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.458+0000 7f0a8936f700 1 --2- 172.21.15.103:0/3460522175 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a840b5210 0x7f0a840b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:02:23.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.458+0000 7f0a8a371700 1 --2- 172.21.15.103:0/3460522175 >> v2:172.21.15.86:3300/0 conn(0x7f0a84152a90 0x7f0a84155630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:02:23.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.458+0000 7f0a89b70700 1 --2- 172.21.15.103:0/3460522175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a6c0037f0 0x7f0a6c003c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:23.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.458+0000 7f0a8a371700 1 --2- 172.21.15.103:0/3460522175 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a6c004d90 0x7f0a6c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:23.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.458+0000 7f0a8936f700 1 --2- 172.21.15.103:0/3460522175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a6c0044d0 0x7f0a6c004930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:23.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.458+0000 7f0a89b70700 1 -- 172.21.15.103:0/3460522175 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a6c004d90 msgr2=0x7f0a6c00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:23.475 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.458+0000 7f0a89b70700 1 --2- 172.21.15.103:0/3460522175 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a6c004d90 0x7f0a6c00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:23.475 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.458+0000 7f0a89b70700 1 -- 172.21.15.103:0/3460522175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a6c0044d0 msgr2=0x7f0a6c004930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:23.475 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.458+0000 7f0a89b70700 1 --2- 172.21.15.103:0/3460522175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a6c0044d0 0x7f0a6c004930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:23.475 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.458+0000 7f0a89b70700 1 -- 172.21.15.103:0/3460522175 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a84065a50 con 0x7f0a6c0037f0 2020-04-22T14:02:23.475 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.458+0000 7f0a8936f700 1 --2- 172.21.15.103:0/3460522175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a6c0044d0 0x7f0a6c004930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:02:23.475 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.458+0000 7f0a8b5d3700 1 -- 172.21.15.103:0/3460522175 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a84065cf0 con 0x7f0a6c0037f0 2020-04-22T14:02:23.475 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.458+0000 7f0a8a371700 1 --2- 172.21.15.103:0/3460522175 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a6c004d90 0x7f0a6c00b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:02:23.476 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.459+0000 7f0a8b5d3700 1 -- 172.21.15.103:0/3460522175 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a840b2040 con 0x7f0a6c0037f0 2020-04-22T14:02:23.476 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.459+0000 7f0a89b70700 1 --2- 172.21.15.103:0/3460522175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a6c0037f0 0x7f0a6c003c10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0a80010210 tx=0x7f0a80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:23.476 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.459+0000 7f0a89b70700 1 --2- 172.21.15.103:0/3460522175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a6c0037f0 0x7f0a6c003c10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0a80010210 tx=0x7f0a80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:23.476 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.459+0000 7f0a89b70700 1 --2- 172.21.15.103:0/3460522175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a6c0037f0 0x7f0a6c003c10 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f0a80010210 tx=0x7f0a80007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:23.476 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.459+0000 7f0a89b70700 1 --2- 172.21.15.103:0/3460522175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a6c0037f0 0x7f0a6c003c10 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f0a80010210 tx=0x7f0a80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:23.476 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.459+0000 7f0a89b70700 1 --2- 172.21.15.103:0/3460522175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a6c0037f0 0x7f0a6c003c10 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f0a80010210 tx=0x7f0a80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:23.476 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.459+0000 7f0a7a7fc700 1 -- 172.21.15.103:0/3460522175 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a80007550 con 0x7f0a6c0037f0 2020-04-22T14:02:23.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.459+0000 7f0a89b70700 1 --2- 172.21.15.103:0/3460522175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a6c0037f0 0x7f0a6c003c10 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f0a80010210 tx=0x7f0a80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:23.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.459+0000 7f0a7a7fc700 1 -- 172.21.15.103:0/3460522175 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8000f900 con 0x7f0a6c0037f0 2020-04-22T14:02:23.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.459+0000 7f0a7a7fc700 1 -- 172.21.15.103:0/3460522175 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a8000abd0 con 0x7f0a6c0037f0 2020-04-22T14:02:23.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.459+0000 7f0a89b70700 1 --2- 172.21.15.103:0/3460522175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a6c0037f0 0x7f0a6c003c10 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f0a80010210 tx=0x7f0a80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:23.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.460+0000 7f0a8b5d3700 1 -- 172.21.15.103:0/3460522175 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a60003340 con 0x7f0a6c0037f0 2020-04-22T14:02:23.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.460+0000 7f0a7a7fc700 1 -- 172.21.15.103:0/3460522175 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f0a8000ad30 con 0x7f0a6c0037f0 2020-04-22T14:02:23.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.460+0000 7f0a89b70700 1 --2- 172.21.15.103:0/3460522175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a6c0037f0 0x7f0a6c003c10 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f0a80010210 tx=0x7f0a80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:23.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.460+0000 7f0a7a7fc700 1 --2- 172.21.15.103:0/3460522175 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0a6c0561b0 0x7f0a6c058670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:23.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.460+0000 7f0a7a7fc700 1 -- 172.21.15.103:0/3460522175 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5242+0+0 (secure 0 0 0) 0x7f0a800a62f0 con 0x7f0a6c0037f0 2020-04-22T14:02:23.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.460+0000 7f0a8936f700 1 --2- 172.21.15.103:0/3460522175 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0a6c0561b0 0x7f0a6c058670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:23.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.460+0000 7f0a8936f700 1 --2- 172.21.15.103:0/3460522175 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0a6c0561b0 0x7f0a6c058670 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0a74002f30 tx=0x7f0a8405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:23.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.461+0000 7f0a8936f700 1 --2- 172.21.15.103:0/3460522175 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0a6c0561b0 0x7f0a6c058670 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0a74002f30 tx=0x7f0a8405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:23.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.461+0000 7f0a8936f700 1 --2- 172.21.15.103:0/3460522175 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0a6c0561b0 0x7f0a6c058670 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7f0a74002f30 tx=0x7f0a8405a720).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:23.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.464+0000 7f0a89b70700 1 --2- 172.21.15.103:0/3460522175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a6c0037f0 0x7f0a6c003c10 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f0a80010210 tx=0x7f0a80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:23.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.464+0000 7f0a7a7fc700 1 -- 172.21.15.103:0/3460522175 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f0a80081730 con 0x7f0a6c0037f0 2020-04-22T14:02:23.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:23.608+0000 7f0a8b5d3700 1 -- 172.21.15.103:0/3460522175 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0a60002240 con 0x7f0a6c0037f0 2020-04-22T14:02:24.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.286+0000 7f0a89b70700 1 --2- 172.21.15.103:0/3460522175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a6c0037f0 0x7f0a6c003c10 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f0a80010210 tx=0x7f0a80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:24.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.286+0000 7f0a7a7fc700 1 -- 172.21.15.103:0/3460522175 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v19) v1 ==== 173+0+0 (secure 0 0 0) 0x7f0a80084d50 con 0x7f0a6c0037f0 2020-04-22T14:02:24.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.290+0000 7f0a8b5d3700 1 -- 172.21.15.103:0/3460522175 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0a6c0561b0 msgr2=0x7f0a6c058670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:24.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.290+0000 7f0a8b5d3700 1 --2- 172.21.15.103:0/3460522175 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0a6c0561b0 0x7f0a6c058670 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7f0a74002f30 tx=0x7f0a8405a720).stop 2020-04-22T14:02:24.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.290+0000 7f0a8b5d3700 1 -- 172.21.15.103:0/3460522175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a6c0037f0 msgr2=0x7f0a6c003c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:24.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.290+0000 7f0a8b5d3700 1 --2- 172.21.15.103:0/3460522175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a6c0037f0 0x7f0a6c003c10 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f0a80010210 tx=0x7f0a80007a40).stop 2020-04-22T14:02:24.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.290+0000 7f0a8a371700 1 -- 172.21.15.103:0/3460522175 reap_dead start 2020-04-22T14:02:24.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.290+0000 7f0a8b5d3700 1 -- 172.21.15.103:0/3460522175 shutdown_connections 2020-04-22T14:02:24.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.290+0000 7f0a8b5d3700 1 --2- 172.21.15.103:0/3460522175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a6c0037f0 0x7f0a6c003c10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:24.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.290+0000 7f0a8b5d3700 1 -- 172.21.15.103:0/3460522175 >> 172.21.15.103:0/3460522175 conn(0x7f0a8405ad30 msgr2=0x7f0a840b6890 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:24.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.290+0000 7f0a8b5d3700 1 -- 172.21.15.103:0/3460522175 shutdown_connections 2020-04-22T14:02:24.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.290+0000 7f0a8b5d3700 1 -- 172.21.15.103:0/3460522175 wait complete. 2020-04-22T14:02:24.294 INFO:teuthology.orchestra.run.smithi103.stderr:enabled application 'rbd' on pool 'rbd' 2020-04-22T14:02:24.305 INFO:tasks.ceph:Setting up CephFS filesystem... 2020-04-22T14:02:24.305 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:24.320 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:02:24.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.475+0000 7f58ceea0700 1 Processor -- start 2020-04-22T14:02:24.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.475+0000 7f58ceea0700 1 -- start start 2020-04-22T14:02:24.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.476+0000 7f58ceea0700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58c80620a0 0x7f58c8142e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:24.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.476+0000 7f58ceea0700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f58c8143280 0x7f58c8146ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:24.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.476+0000 7f58ceea0700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f58c8146f30 0x7f58c8063a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:24.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.476+0000 7f58ceea0700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58c81473e0 con 0x7f58c8143280 2020-04-22T14:02:24.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.476+0000 7f58ceea0700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58c8143810 con 0x7f58c8146f30 2020-04-22T14:02:24.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.476+0000 7f58ceea0700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c8143ab0 con 0x7f58c80620a0 2020-04-22T14:02:24.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.476+0000 7f58ce69f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f58c8146f30 0x7f58c8063a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:24.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.476+0000 7f58ce69f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f58c8146f30 0x7f58c8063a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46836/0 (socket says 172.21.15.103:46836) 2020-04-22T14:02:24.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.476+0000 7f58ce69f700 1 -- 172.21.15.103:0/142934289 learned_addr learned my addr 172.21.15.103:0/142934289 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:24.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.476+0000 7f58cd69d700 1 --2- 172.21.15.103:0/142934289 >> v2:172.21.15.86:3300/0 conn(0x7f58c8143280 0x7f58c8146ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:24.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.476+0000 7f58cde9e700 1 --2- 172.21.15.103:0/142934289 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58c80620a0 0x7f58c8142e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:24.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.476+0000 7f58ce69f700 1 -- 172.21.15.103:0/142934289 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58c80620a0 msgr2=0x7f58c8142e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:24.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.476+0000 7f58ce69f700 1 --2- 172.21.15.103:0/142934289 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58c80620a0 0x7f58c8142e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:24.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.476+0000 7f58ce69f700 1 -- 172.21.15.103:0/142934289 >> v2:172.21.15.86:3300/0 conn(0x7f58c8143280 msgr2=0x7f58c8146ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:24.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.476+0000 7f58ce69f700 1 --2- 172.21.15.103:0/142934289 >> v2:172.21.15.86:3300/0 conn(0x7f58c8143280 0x7f58c8146ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:24.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.476+0000 7f58ce69f700 1 -- 172.21.15.103:0/142934289 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c8143d50 con 0x7f58c8146f30 2020-04-22T14:02:24.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.476+0000 7f58cde9e700 1 --2- 172.21.15.103:0/142934289 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58c80620a0 0x7f58c8142e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:02:24.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.476+0000 7f58ce69f700 1 --2- 172.21.15.103:0/142934289 >> v2:172.21.15.103:3300/0 conn(0x7f58c8146f30 0x7f58c8063a40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f58c00032b0 tx=0x7f58c0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:24.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.476+0000 7f58ce69f700 1 --2- 172.21.15.103:0/142934289 >> v2:172.21.15.103:3300/0 conn(0x7f58c8146f30 0x7f58c8063a40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f58c00032b0 tx=0x7f58c0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:24.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.476+0000 7f58ce69f700 1 --2- 172.21.15.103:0/142934289 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58c8146f30 0x7f58c8063a40 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7f58c00032b0 tx=0x7f58c0007dc0).ready entity=mon.1 client_cookie=4686e4e76a21f05c server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:24.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.476+0000 7f58ce69f700 1 --2- 172.21.15.103:0/142934289 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58c8146f30 0x7f58c8063a40 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f58c00032b0 tx=0x7f58c0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:24.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.476+0000 7f58cce9c700 1 -- 172.21.15.103:0/142934289 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58c0010e70 con 0x7f58c8146f30 2020-04-22T14:02:24.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.476+0000 7f58ce69f700 1 --2- 172.21.15.103:0/142934289 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58c8146f30 0x7f58c8063a40 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f58c00032b0 tx=0x7f58c0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:24.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.476+0000 7f58ce69f700 1 --2- 172.21.15.103:0/142934289 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58c8146f30 0x7f58c8063a40 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f58c00032b0 tx=0x7f58c0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:24.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.476+0000 7f58cce9c700 1 -- 172.21.15.103:0/142934289 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c00110d0 con 0x7f58c8146f30 2020-04-22T14:02:24.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.476+0000 7f58cce9c700 1 -- 172.21.15.103:0/142934289 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58c00114f0 con 0x7f58c8146f30 2020-04-22T14:02:24.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.476+0000 7f58ceea0700 1 -- 172.21.15.103:0/142934289 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58c8146f30 msgr2=0x7f58c8063a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:24.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.476+0000 7f58ceea0700 1 --2- 172.21.15.103:0/142934289 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58c8146f30 0x7f58c8063a40 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7f58c00032b0 tx=0x7f58c0007dc0).stop 2020-04-22T14:02:24.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.477+0000 7f58ceea0700 1 -- 172.21.15.103:0/142934289 shutdown_connections 2020-04-22T14:02:24.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.477+0000 7f58ceea0700 1 --2- 172.21.15.103:0/142934289 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58c8146f30 0x7f58c8063a40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:24.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.477+0000 7f58ceea0700 1 --2- 172.21.15.103:0/142934289 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58c80620a0 0x7f58c8142e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:24.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.477+0000 7f58ceea0700 1 --2- 172.21.15.103:0/142934289 >> v2:172.21.15.86:3300/0 conn(0x7f58c8143280 0x7f58c8146ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:24.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.477+0000 7f58ceea0700 1 -- 172.21.15.103:0/142934289 >> 172.21.15.103:0/142934289 conn(0x7f58c805b7c0 msgr2=0x7f58c8061610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:24.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.477+0000 7f58ceea0700 1 -- 172.21.15.103:0/142934289 shutdown_connections 2020-04-22T14:02:24.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.477+0000 7f58ceea0700 1 -- 172.21.15.103:0/142934289 wait complete. 2020-04-22T14:02:24.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.478+0000 7f58ceea0700 1 Processor -- start 2020-04-22T14:02:24.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.478+0000 7f58ceea0700 1 -- start start 2020-04-22T14:02:24.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.479+0000 7f58ceea0700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f58c8143280 0x7f58c8147970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:24.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.479+0000 7f58ceea0700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58c813f990 con 0x7f58c8146f30 2020-04-22T14:02:24.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.479+0000 7f58ceea0700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58c813fc00 con 0x7f58c80620a0 2020-04-22T14:02:24.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.479+0000 7f58ceea0700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58c813fea0 con 0x7f58c8143280 2020-04-22T14:02:24.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.479+0000 7f58cde9e700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f58c80620a0 0x7f58c812b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39028/0 (socket says 172.21.15.103:39028) 2020-04-22T14:02:24.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.479+0000 7f58cde9e700 1 -- 172.21.15.103:0/4110473732 learned_addr learned my addr 172.21.15.103:0/4110473732 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:24.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.479+0000 7f58cd69d700 1 --2- 172.21.15.103:0/4110473732 >> v2:172.21.15.103:3300/0 conn(0x7f58c8143280 0x7f58c8147970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:24.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.479+0000 7f58cd69d700 1 -- 172.21.15.103:0/4110473732 >> v1:172.21.15.103:6789/0 conn(0x7f58c80620a0 legacy=0x7f58c812b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:24.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.479+0000 7f58cd69d700 1 -- 172.21.15.103:0/4110473732 >> v1:172.21.15.86:6789/0 conn(0x7f58c8146f30 legacy=0x7f58c8141230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:24.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.479+0000 7f58baffd700 1 -- 172.21.15.103:0/4110473732 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2655245963 0 0) 0x7f58c813fc00 con 0x7f58c80620a0 2020-04-22T14:02:24.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.479+0000 7f58cd69d700 1 -- 172.21.15.103:0/4110473732 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c814d3c0 con 0x7f58c8143280 2020-04-22T14:02:24.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.479+0000 7f58cd69d700 1 --2- 172.21.15.103:0/4110473732 >> v2:172.21.15.103:3300/0 conn(0x7f58c8143280 0x7f58c8147970 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f58bc002f30 tx=0x7f58bc010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:24.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.479+0000 7f58cd69d700 1 --2- 172.21.15.103:0/4110473732 >> v2:172.21.15.103:3300/0 conn(0x7f58c8143280 0x7f58c8147970 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f58bc002f30 tx=0x7f58bc010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:24.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.479+0000 7f58cd69d700 1 --2- 172.21.15.103:0/4110473732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58c8143280 0x7f58c8147970 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7f58bc002f30 tx=0x7f58bc010c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:24.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.479+0000 7f58cd69d700 1 --2- 172.21.15.103:0/4110473732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58c8143280 0x7f58c8147970 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f58bc002f30 tx=0x7f58bc010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:24.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.479+0000 7f58baffd700 1 -- 172.21.15.103:0/4110473732 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58bc007550 con 0x7f58c8143280 2020-04-22T14:02:24.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.479+0000 7f58cd69d700 1 --2- 172.21.15.103:0/4110473732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58c8143280 0x7f58c8147970 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f58bc002f30 tx=0x7f58bc010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:24.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.479+0000 7f58baffd700 1 -- 172.21.15.103:0/4110473732 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58bc0126d0 con 0x7f58c8143280 2020-04-22T14:02:24.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.479+0000 7f58cd69d700 1 --2- 172.21.15.103:0/4110473732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58c8143280 0x7f58c8147970 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f58bc002f30 tx=0x7f58bc010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:24.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.479+0000 7f58ceea0700 1 -- 172.21.15.103:0/4110473732 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58c812c0c0 con 0x7f58c8143280 2020-04-22T14:02:24.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.479+0000 7f58baffd700 1 -- 172.21.15.103:0/4110473732 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58bc012a70 con 0x7f58c8143280 2020-04-22T14:02:24.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.479+0000 7f58ceea0700 1 -- 172.21.15.103:0/4110473732 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c813f5e0 con 0x7f58c8143280 2020-04-22T14:02:24.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.480+0000 7f58cd69d700 1 --2- 172.21.15.103:0/4110473732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58c8143280 0x7f58c8147970 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f58bc002f30 tx=0x7f58bc010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:24.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.480+0000 7f58baffd700 1 -- 172.21.15.103:0/4110473732 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f58bc012c20 con 0x7f58c8143280 2020-04-22T14:02:24.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.480+0000 7f58cd69d700 1 --2- 172.21.15.103:0/4110473732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58c8143280 0x7f58c8147970 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f58bc002f30 tx=0x7f58bc010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:24.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.480+0000 7f58ceea0700 1 -- 172.21.15.103:0/4110473732 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58c8056c90 con 0x7f58c8143280 2020-04-22T14:02:24.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.481+0000 7f58baffd700 1 --2- 172.21.15.103:0/4110473732 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f58a804d830 0x7f58a804fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:24.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.481+0000 7f58baffd700 1 -- 172.21.15.103:0/4110473732 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f58bc00d0d0 con 0x7f58c8143280 2020-04-22T14:02:24.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.481+0000 7f58cde9e700 1 --2- 172.21.15.103:0/4110473732 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f58a804d830 0x7f58a804fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:24.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.481+0000 7f58cde9e700 1 --2- 172.21.15.103:0/4110473732 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f58a804d830 0x7f58a804fcf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f58c4007a40 tx=0x7f58c4007ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:24.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.481+0000 7f58cde9e700 1 --2- 172.21.15.103:0/4110473732 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f58a804d830 0x7f58a804fcf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f58c4007a40 tx=0x7f58c4007ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:24.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.481+0000 7f58cde9e700 1 --2- 172.21.15.103:0/4110473732 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f58a804d830 0x7f58a804fcf0 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7f58c4007a40 tx=0x7f58c4007ae0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:24.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.485+0000 7f58cd69d700 1 --2- 172.21.15.103:0/4110473732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58c8143280 0x7f58c8147970 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f58bc002f30 tx=0x7f58bc010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:24.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.485+0000 7f58baffd700 1 -- 172.21.15.103:0/4110473732 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f58bc03cb30 con 0x7f58c8143280 2020-04-22T14:02:24.632 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.630+0000 7f58ceea0700 1 -- 172.21.15.103:0/4110473732 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58c80b49e0 con 0x7f58c8143280 2020-04-22T14:02:24.633 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.631+0000 7f58cd69d700 1 --2- 172.21.15.103:0/4110473732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58c8143280 0x7f58c8147970 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f58bc002f30 tx=0x7f58bc010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:24.633 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.631+0000 7f58baffd700 1 -- 172.21.15.103:0/4110473732 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+13243 (secure 0 0 0) 0x7f58bc040150 con 0x7f58c8143280 2020-04-22T14:02:24.633 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:02:24.634 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":19,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:02:24.276174+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:02:24.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.632+0000 7f58ceea0700 1 -- 172.21.15.103:0/4110473732 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f58a804d830 msgr2=0x7f58a804fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:24.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.632+0000 7f58ceea0700 1 --2- 172.21.15.103:0/4110473732 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f58a804d830 0x7f58a804fcf0 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7f58c4007a40 tx=0x7f58c4007ae0).stop 2020-04-22T14:02:24.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.632+0000 7f58ceea0700 1 -- 172.21.15.103:0/4110473732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58c8143280 msgr2=0x7f58c8147970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:24.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.632+0000 7f58ceea0700 1 --2- 172.21.15.103:0/4110473732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58c8143280 0x7f58c8147970 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7f58bc002f30 tx=0x7f58bc010c40).stop 2020-04-22T14:02:24.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.632+0000 7f58ceea0700 1 -- 172.21.15.103:0/4110473732 shutdown_connections 2020-04-22T14:02:24.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.632+0000 7f58ceea0700 1 --2- 172.21.15.103:0/4110473732 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f58a804d830 0x7f58a804fcf0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:24.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.632+0000 7f58ceea0700 1 --2- 172.21.15.103:0/4110473732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58c8143280 0x7f58c8147970 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:24.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.632+0000 7f58ceea0700 1 -- 172.21.15.103:0/4110473732 >> 172.21.15.103:0/4110473732 conn(0x7f58c805b7c0 msgr2=0x7f58c8145930 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:24.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.632+0000 7f58ceea0700 1 -- 172.21.15.103:0/4110473732 shutdown_connections 2020-04-22T14:02:24.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.632+0000 7f58ceea0700 1 -- 172.21.15.103:0/4110473732 wait complete. 2020-04-22T14:02:24.645 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool,creating', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 32769, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'19', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:02:24.646 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:24.663 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:02:24.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.809+0000 7f9959722700 1 Processor -- start 2020-04-22T14:02:24.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.809+0000 7f9959722700 1 -- start start 2020-04-22T14:02:24.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.809+0000 7f9959722700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9954061a30 0x7f99540b4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:24.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.809+0000 7f9959722700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9954141f20 0x7f99541423b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:24.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.809+0000 7f9959722700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99540af030 con 0x7f99540acb10 2020-04-22T14:02:24.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.809+0000 7f9959722700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9954060250 con 0x7f9954061a30 2020-04-22T14:02:24.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.809+0000 7f9959722700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99540623c0 con 0x7f9954141f20 2020-04-22T14:02:24.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.810+0000 7f9952ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9954061a30 0x7f99540b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:24.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.810+0000 7f9952ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9954061a30 0x7f99540b4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46846/0 (socket says 172.21.15.103:46846) 2020-04-22T14:02:24.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.810+0000 7f9952ffd700 1 -- 172.21.15.103:0/682187892 learned_addr learned my addr 172.21.15.103:0/682187892 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:24.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.810+0000 7f99537fe700 1 --2- 172.21.15.103:0/682187892 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9954141f20 0x7f99541423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:24.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.810+0000 7f9952ffd700 1 -- 172.21.15.103:0/682187892 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9954141f20 msgr2=0x7f99541423b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:24.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.810+0000 7f9952ffd700 1 --2- 172.21.15.103:0/682187892 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9954141f20 0x7f99541423b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:24.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.810+0000 7f9952ffd700 1 -- 172.21.15.103:0/682187892 >> v1:172.21.15.86:6789/0 conn(0x7f99540acb10 legacy=0x7f99540ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:24.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.810+0000 7f9952ffd700 1 -- 172.21.15.103:0/682187892 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9954062660 con 0x7f9954061a30 2020-04-22T14:02:24.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.810+0000 7f99537fe700 1 --2- 172.21.15.103:0/682187892 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9954141f20 0x7f99541423b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:02:24.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.810+0000 7f9952ffd700 1 --2- 172.21.15.103:0/682187892 >> v2:172.21.15.103:3300/0 conn(0x7f9954061a30 0x7f99540b4820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9948002f30 tx=0x7f9948007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:24.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.810+0000 7f9952ffd700 1 --2- 172.21.15.103:0/682187892 >> v2:172.21.15.103:3300/0 conn(0x7f9954061a30 0x7f99540b4820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9948002f30 tx=0x7f9948007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:24.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.810+0000 7f9952ffd700 1 --2- 172.21.15.103:0/682187892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9954061a30 0x7f99540b4820 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f9948002f30 tx=0x7f9948007a40).ready entity=mon.1 client_cookie=6dddee4cd31a0233 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:24.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.810+0000 7f9952ffd700 1 --2- 172.21.15.103:0/682187892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9954061a30 0x7f99540b4820 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f9948002f30 tx=0x7f9948007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:24.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.810+0000 7f9951ffb700 1 -- 172.21.15.103:0/682187892 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9948011720 con 0x7f9954061a30 2020-04-22T14:02:24.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.810+0000 7f9952ffd700 1 --2- 172.21.15.103:0/682187892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9954061a30 0x7f99540b4820 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f9948002f30 tx=0x7f9948007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:24.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.810+0000 7f9951ffb700 1 -- 172.21.15.103:0/682187892 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99480118c0 con 0x7f9954061a30 2020-04-22T14:02:24.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.810+0000 7f9952ffd700 1 --2- 172.21.15.103:0/682187892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9954061a30 0x7f99540b4820 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f9948002f30 tx=0x7f9948007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:24.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.810+0000 7f9951ffb700 1 -- 172.21.15.103:0/682187892 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9948011ce0 con 0x7f9954061a30 2020-04-22T14:02:24.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.810+0000 7f9959722700 1 -- 172.21.15.103:0/682187892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9954061a30 msgr2=0x7f99540b4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:24.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.810+0000 7f9959722700 1 --2- 172.21.15.103:0/682187892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9954061a30 0x7f99540b4820 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f9948002f30 tx=0x7f9948007a40).stop 2020-04-22T14:02:24.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.811+0000 7f9959722700 1 -- 172.21.15.103:0/682187892 shutdown_connections 2020-04-22T14:02:24.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.811+0000 7f9959722700 1 --2- 172.21.15.103:0/682187892 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9954141f20 0x7f99541423b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:24.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.811+0000 7f9959722700 1 --2- 172.21.15.103:0/682187892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9954061a30 0x7f99540b4820 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:24.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.811+0000 7f9959722700 1 -- 172.21.15.103:0/682187892 >> 172.21.15.103:0/682187892 conn(0x7f995405b7b0 msgr2=0x7f99540b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:24.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.811+0000 7f9959722700 1 -- 172.21.15.103:0/682187892 shutdown_connections 2020-04-22T14:02:24.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.811+0000 7f9959722700 1 -- 172.21.15.103:0/682187892 wait complete. 2020-04-22T14:02:24.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.812+0000 7f9959722700 1 Processor -- start 2020-04-22T14:02:24.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.812+0000 7f9959722700 1 -- start start 2020-04-22T14:02:24.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.812+0000 7f9959722700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9954061a30 0x7f99541396d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:24.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.812+0000 7f9959722700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9954141f20 0x7f9954065320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:24.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.812+0000 7f9959722700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9954064b90 con 0x7f99540acb10 2020-04-22T14:02:24.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.812+0000 7f9959722700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9954066ac0 con 0x7f9954141f20 2020-04-22T14:02:24.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.812+0000 7f9959722700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9954064e30 con 0x7f9954061a30 2020-04-22T14:02:24.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.813+0000 7f99527fc700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f99540acb10 0x7f99540b7ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39044/0 (socket says 172.21.15.103:39044) 2020-04-22T14:02:24.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.813+0000 7f99527fc700 1 -- 172.21.15.103:0/904090379 learned_addr learned my addr 172.21.15.103:0/904090379 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:24.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.813+0000 7f99537fe700 1 --2- 172.21.15.103:0/904090379 >> v2:172.21.15.103:3300/0 conn(0x7f9954141f20 0x7f9954065320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:24.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.813+0000 7f9952ffd700 1 --2- 172.21.15.103:0/904090379 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9954061a30 0x7f99541396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:24.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.813+0000 7f99537fe700 1 -- 172.21.15.103:0/904090379 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9954061a30 msgr2=0x7f99541396d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:24.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.813+0000 7f99537fe700 1 --2- 172.21.15.103:0/904090379 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9954061a30 0x7f99541396d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:24.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.813+0000 7f99537fe700 1 -- 172.21.15.103:0/904090379 >> v1:172.21.15.103:6789/0 conn(0x7f99540acb10 legacy=0x7f99540b7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:24.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.813+0000 7f99537fe700 1 -- 172.21.15.103:0/904090379 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99541391e0 con 0x7f9954141f20 2020-04-22T14:02:24.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.813+0000 7f9943fff700 1 -- 172.21.15.103:0/904090379 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2012611721 0 0) 0x7f9954064b90 con 0x7f99540acb10 2020-04-22T14:02:24.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.813+0000 7f99537fe700 1 --2- 172.21.15.103:0/904090379 >> v2:172.21.15.103:3300/0 conn(0x7f9954141f20 0x7f9954065320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f994c0032b0 tx=0x7f994c010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:24.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.813+0000 7f99537fe700 1 --2- 172.21.15.103:0/904090379 >> v2:172.21.15.103:3300/0 conn(0x7f9954141f20 0x7f9954065320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f994c0032b0 tx=0x7f994c010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:24.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.813+0000 7f99537fe700 1 --2- 172.21.15.103:0/904090379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9954141f20 0x7f9954065320 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f994c0032b0 tx=0x7f994c010d90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:24.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.813+0000 7f99537fe700 1 --2- 172.21.15.103:0/904090379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9954141f20 0x7f9954065320 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f994c0032b0 tx=0x7f994c010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:24.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.813+0000 7f9943fff700 1 -- 172.21.15.103:0/904090379 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f994c012c00 con 0x7f9954141f20 2020-04-22T14:02:24.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.813+0000 7f99537fe700 1 --2- 172.21.15.103:0/904090379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9954141f20 0x7f9954065320 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f994c0032b0 tx=0x7f994c010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:24.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.813+0000 7f99537fe700 1 --2- 172.21.15.103:0/904090379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9954141f20 0x7f9954065320 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f994c0032b0 tx=0x7f994c010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:24.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.813+0000 7f9943fff700 1 -- 172.21.15.103:0/904090379 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994c012d60 con 0x7f9954141f20 2020-04-22T14:02:24.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.813+0000 7f9943fff700 1 -- 172.21.15.103:0/904090379 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f994c00a370 con 0x7f9954141f20 2020-04-22T14:02:24.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.813+0000 7f9959722700 1 -- 172.21.15.103:0/904090379 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f995413c900 con 0x7f9954141f20 2020-04-22T14:02:24.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.813+0000 7f9959722700 1 -- 172.21.15.103:0/904090379 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99540667c0 con 0x7f9954141f20 2020-04-22T14:02:24.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.814+0000 7f99537fe700 1 --2- 172.21.15.103:0/904090379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9954141f20 0x7f9954065320 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f994c0032b0 tx=0x7f994c010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:24.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.814+0000 7f9959722700 1 -- 172.21.15.103:0/904090379 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9954056c90 con 0x7f9954141f20 2020-04-22T14:02:24.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.814+0000 7f9943fff700 1 -- 172.21.15.103:0/904090379 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f994c00a5a0 con 0x7f9954141f20 2020-04-22T14:02:24.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.814+0000 7f99537fe700 1 --2- 172.21.15.103:0/904090379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9954141f20 0x7f9954065320 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f994c0032b0 tx=0x7f994c010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:24.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.814+0000 7f9943fff700 1 --2- 172.21.15.103:0/904090379 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f993004d870 0x7f993004fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:24.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.814+0000 7f9943fff700 1 -- 172.21.15.103:0/904090379 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f994c061b00 con 0x7f9954141f20 2020-04-22T14:02:24.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.814+0000 7f9952ffd700 1 --2- 172.21.15.103:0/904090379 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f993004d870 0x7f993004fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:24.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.815+0000 7f9952ffd700 1 --2- 172.21.15.103:0/904090379 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f993004d870 0x7f993004fd30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9948002f30 tx=0x7f9948007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:24.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.815+0000 7f9952ffd700 1 --2- 172.21.15.103:0/904090379 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f993004d870 0x7f993004fd30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9948002f30 tx=0x7f9948007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:24.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.815+0000 7f9952ffd700 1 --2- 172.21.15.103:0/904090379 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f993004d870 0x7f993004fd30 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7f9948002f30 tx=0x7f9948007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:24.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.818+0000 7f99537fe700 1 --2- 172.21.15.103:0/904090379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9954141f20 0x7f9954065320 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f994c0032b0 tx=0x7f994c010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:24.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.818+0000 7f9943fff700 1 -- 172.21.15.103:0/904090379 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f994c03cee0 con 0x7f9954141f20 2020-04-22T14:02:24.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.960+0000 7f9959722700 1 -- 172.21.15.103:0/904090379 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f995406a960 con 0x7f9954141f20 2020-04-22T14:02:24.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.960+0000 7f99537fe700 1 --2- 172.21.15.103:0/904090379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9954141f20 0x7f9954065320 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f994c0032b0 tx=0x7f994c010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:24.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.961+0000 7f9943fff700 1 -- 172.21.15.103:0/904090379 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v19) v1 ==== 110+0+10 (secure 0 0 0) 0x7f994c040500 con 0x7f9954141f20 2020-04-22T14:02:24.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.962+0000 7f9959722700 1 -- 172.21.15.103:0/904090379 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f993004d870 msgr2=0x7f993004fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:24.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.962+0000 7f9959722700 1 --2- 172.21.15.103:0/904090379 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f993004d870 0x7f993004fd30 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7f9948002f30 tx=0x7f9948007a40).stop 2020-04-22T14:02:24.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.962+0000 7f9959722700 1 -- 172.21.15.103:0/904090379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9954141f20 msgr2=0x7f9954065320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:24.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.962+0000 7f9959722700 1 --2- 172.21.15.103:0/904090379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9954141f20 0x7f9954065320 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f994c0032b0 tx=0x7f994c010d90).stop 2020-04-22T14:02:24.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.962+0000 7f9959722700 1 -- 172.21.15.103:0/904090379 shutdown_connections 2020-04-22T14:02:24.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.962+0000 7f9959722700 1 --2- 172.21.15.103:0/904090379 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f993004d870 0x7f993004fd30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:24.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.962+0000 7f9959722700 1 --2- 172.21.15.103:0/904090379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9954141f20 0x7f9954065320 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:24.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.962+0000 7f9959722700 1 --2- 172.21.15.103:0/904090379 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9954061a30 0x7f99541396d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:24.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.962+0000 7f9959722700 1 -- 172.21.15.103:0/904090379 >> 172.21.15.103:0/904090379 conn(0x7f995405b7b0 msgr2=0x7f99540b6b10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:24.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.962+0000 7f9959722700 1 -- 172.21.15.103:0/904090379 shutdown_connections 2020-04-22T14:02:24.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:24.962+0000 7f9959722700 1 -- 172.21.15.103:0/904090379 wait complete. 2020-04-22T14:02:24.970 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:02:24.974 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:24.989 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:02:25.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.136+0000 7f7db223a700 1 Processor -- start 2020-04-22T14:02:25.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.136+0000 7f7db223a700 1 -- start start 2020-04-22T14:02:25.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.137+0000 7f7db223a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7dac061a30 0x7f7dac0b4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:25.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.137+0000 7f7db223a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7dac141f20 0x7f7dac1423b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:25.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.137+0000 7f7db223a700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dac0af030 con 0x7f7dac0acb10 2020-04-22T14:02:25.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.137+0000 7f7db223a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dac060250 con 0x7f7dac061a30 2020-04-22T14:02:25.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.137+0000 7f7db223a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dac0623c0 con 0x7f7dac141f20 2020-04-22T14:02:25.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.137+0000 7f7dabfff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7dac141f20 0x7f7dac1423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:25.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.137+0000 7f7daaffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f7dac0acb10 0x7f7dac0ae920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39052/0 (socket says 172.21.15.103:39052) 2020-04-22T14:02:25.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.137+0000 7f7daaffd700 1 -- 172.21.15.103:0/943707214 learned_addr learned my addr 172.21.15.103:0/943707214 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:25.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.137+0000 7f7dabfff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7dac141f20 0x7f7dac1423b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46864/0 (socket says 172.21.15.103:46864) 2020-04-22T14:02:25.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.137+0000 7f7dab7fe700 1 --2- 172.21.15.103:0/943707214 >> v2:172.21.15.86:3300/0 conn(0x7f7dac061a30 0x7f7dac0b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:25.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.137+0000 7f7dabfff700 1 -- 172.21.15.103:0/943707214 >> v2:172.21.15.86:3300/0 conn(0x7f7dac061a30 msgr2=0x7f7dac0b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:25.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.137+0000 7f7dabfff700 1 --2- 172.21.15.103:0/943707214 >> v2:172.21.15.86:3300/0 conn(0x7f7dac061a30 0x7f7dac0b4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:25.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.137+0000 7f7dabfff700 1 -- 172.21.15.103:0/943707214 >> v1:172.21.15.103:6789/0 conn(0x7f7dac0acb10 legacy=0x7f7dac0ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:25.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.137+0000 7f7dabfff700 1 -- 172.21.15.103:0/943707214 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dac062660 con 0x7f7dac141f20 2020-04-22T14:02:25.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.137+0000 7f7daa7fc700 1 -- 172.21.15.103:0/943707214 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1012880927 0 0) 0x7f7dac0af030 con 0x7f7dac0acb10 2020-04-22T14:02:25.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.137+0000 7f7dabfff700 1 --2- 172.21.15.103:0/943707214 >> v2:172.21.15.103:3300/0 conn(0x7f7dac141f20 0x7f7dac1423b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7da40032b0 tx=0x7f7da4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.137+0000 7f7dabfff700 1 --2- 172.21.15.103:0/943707214 >> v2:172.21.15.103:3300/0 conn(0x7f7dac141f20 0x7f7dac1423b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7da40032b0 tx=0x7f7da4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.137+0000 7f7dabfff700 1 --2- 172.21.15.103:0/943707214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7dac141f20 0x7f7dac1423b0 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f7da40032b0 tx=0x7f7da4007dc0).ready entity=mon.1 client_cookie=436946575b6e25e4 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:25.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.137+0000 7f7dabfff700 1 --2- 172.21.15.103:0/943707214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7dac141f20 0x7f7dac1423b0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f7da40032b0 tx=0x7f7da4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.137+0000 7f7daa7fc700 1 -- 172.21.15.103:0/943707214 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7da400c370 con 0x7f7dac141f20 2020-04-22T14:02:25.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.138+0000 7f7dabfff700 1 --2- 172.21.15.103:0/943707214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7dac141f20 0x7f7dac1423b0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f7da40032b0 tx=0x7f7da4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.138+0000 7f7dabfff700 1 --2- 172.21.15.103:0/943707214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7dac141f20 0x7f7dac1423b0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f7da40032b0 tx=0x7f7da4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.138+0000 7f7daa7fc700 1 -- 172.21.15.103:0/943707214 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da400c4d0 con 0x7f7dac141f20 2020-04-22T14:02:25.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.138+0000 7f7daa7fc700 1 -- 172.21.15.103:0/943707214 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7da400c8b0 con 0x7f7dac141f20 2020-04-22T14:02:25.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.138+0000 7f7db223a700 1 -- 172.21.15.103:0/943707214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7dac141f20 msgr2=0x7f7dac1423b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:25.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.138+0000 7f7db223a700 1 --2- 172.21.15.103:0/943707214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7dac141f20 0x7f7dac1423b0 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f7da40032b0 tx=0x7f7da4007dc0).stop 2020-04-22T14:02:25.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.138+0000 7f7db223a700 1 -- 172.21.15.103:0/943707214 shutdown_connections 2020-04-22T14:02:25.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.138+0000 7f7db223a700 1 --2- 172.21.15.103:0/943707214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7dac141f20 0x7f7dac1423b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:25.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.138+0000 7f7db223a700 1 --2- 172.21.15.103:0/943707214 >> v2:172.21.15.86:3300/0 conn(0x7f7dac061a30 0x7f7dac0b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:25.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.138+0000 7f7db223a700 1 -- 172.21.15.103:0/943707214 >> 172.21.15.103:0/943707214 conn(0x7f7dac05b7b0 msgr2=0x7f7dac0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:25.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.138+0000 7f7db223a700 1 -- 172.21.15.103:0/943707214 shutdown_connections 2020-04-22T14:02:25.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.138+0000 7f7db223a700 1 -- 172.21.15.103:0/943707214 wait complete. 2020-04-22T14:02:25.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.139+0000 7f7db223a700 1 Processor -- start 2020-04-22T14:02:25.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.139+0000 7f7db223a700 1 -- start start 2020-04-22T14:02:25.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.140+0000 7f7db223a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7dac0acb10 0x7f7dac152a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:25.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.140+0000 7f7db223a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dac064f70 con 0x7f7dac061a30 2020-04-22T14:02:25.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.140+0000 7f7db223a700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dac153930 con 0x7f7dac141f20 2020-04-22T14:02:25.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.140+0000 7f7db223a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dac064120 con 0x7f7dac0acb10 2020-04-22T14:02:25.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.140+0000 7f7daaffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7dac0acb10 0x7f7dac152a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:25.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.140+0000 7f7daaffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7dac0acb10 0x7f7dac152a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46866/0 (socket says 172.21.15.103:46866) 2020-04-22T14:02:25.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.140+0000 7f7dabfff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f7dac141f20 0x7f7dac0b10a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39060/0 (socket says 172.21.15.103:39060) 2020-04-22T14:02:25.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.140+0000 7f7daaffd700 1 -- 172.21.15.103:0/1962311848 learned_addr learned my addr 172.21.15.103:0/1962311848 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:25.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.140+0000 7f7daaffd700 1 -- 172.21.15.103:0/1962311848 >> v1:172.21.15.103:6789/0 conn(0x7f7dac141f20 legacy=0x7f7dac0b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:25.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.140+0000 7f7daaffd700 1 -- 172.21.15.103:0/1962311848 >> v1:172.21.15.86:6789/0 conn(0x7f7dac061a30 legacy=0x7f7dac064860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:25.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.140+0000 7f7da8ff9700 1 -- 172.21.15.103:0/1962311848 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3925230236 0 0) 0x7f7dac153930 con 0x7f7dac141f20 2020-04-22T14:02:25.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.140+0000 7f7daaffd700 1 -- 172.21.15.103:0/1962311848 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dac0643c0 con 0x7f7dac0acb10 2020-04-22T14:02:25.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.140+0000 7f7daaffd700 1 --2- 172.21.15.103:0/1962311848 >> v2:172.21.15.103:3300/0 conn(0x7f7dac0acb10 0x7f7dac152a30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7da0000b80 tx=0x7f7da0001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.140+0000 7f7daaffd700 1 --2- 172.21.15.103:0/1962311848 >> v2:172.21.15.103:3300/0 conn(0x7f7dac0acb10 0x7f7dac152a30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7da0000b80 tx=0x7f7da0001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.140+0000 7f7daaffd700 1 --2- 172.21.15.103:0/1962311848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7dac0acb10 0x7f7dac152a30 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f7da0000b80 tx=0x7f7da0001e40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:25.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.140+0000 7f7daaffd700 1 --2- 172.21.15.103:0/1962311848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7dac0acb10 0x7f7dac152a30 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f7da0000b80 tx=0x7f7da0001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.140+0000 7f7da8ff9700 1 -- 172.21.15.103:0/1962311848 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7da000ca40 con 0x7f7dac0acb10 2020-04-22T14:02:25.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.140+0000 7f7daaffd700 1 --2- 172.21.15.103:0/1962311848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7dac0acb10 0x7f7dac152a30 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f7da0000b80 tx=0x7f7da0001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.140+0000 7f7daaffd700 1 --2- 172.21.15.103:0/1962311848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7dac0acb10 0x7f7dac152a30 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f7da0000b80 tx=0x7f7da0001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.140+0000 7f7da8ff9700 1 -- 172.21.15.103:0/1962311848 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da000cba0 con 0x7f7dac0acb10 2020-04-22T14:02:25.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.141+0000 7f7da8ff9700 1 -- 172.21.15.103:0/1962311848 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7da00120e0 con 0x7f7dac0acb10 2020-04-22T14:02:25.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.141+0000 7f7db223a700 1 -- 172.21.15.103:0/1962311848 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dac145930 con 0x7f7dac0acb10 2020-04-22T14:02:25.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.141+0000 7f7db223a700 1 -- 172.21.15.103:0/1962311848 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dac0b1830 con 0x7f7dac0acb10 2020-04-22T14:02:25.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.141+0000 7f7daaffd700 1 --2- 172.21.15.103:0/1962311848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7dac0acb10 0x7f7dac152a30 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f7da0000b80 tx=0x7f7da0001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.141+0000 7f7db223a700 1 -- 172.21.15.103:0/1962311848 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dac143860 con 0x7f7dac0acb10 2020-04-22T14:02:25.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.142+0000 7f7da8ff9700 1 -- 172.21.15.103:0/1962311848 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f7da00055c0 con 0x7f7dac0acb10 2020-04-22T14:02:25.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.142+0000 7f7daaffd700 1 --2- 172.21.15.103:0/1962311848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7dac0acb10 0x7f7dac152a30 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f7da0000b80 tx=0x7f7da0001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.142+0000 7f7da8ff9700 1 --2- 172.21.15.103:0/1962311848 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7d8c04d7f0 0x7f7d8c04fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:25.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.142+0000 7f7da8ff9700 1 -- 172.21.15.103:0/1962311848 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f7da00100c0 con 0x7f7dac0acb10 2020-04-22T14:02:25.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.142+0000 7f7dab7fe700 1 --2- 172.21.15.103:0/1962311848 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7d8c04d7f0 0x7f7d8c04fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:25.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.142+0000 7f7dab7fe700 1 --2- 172.21.15.103:0/1962311848 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7d8c04d7f0 0x7f7d8c04fcb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7dac0b29e0 tx=0x7f7d9c008d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.142+0000 7f7dab7fe700 1 --2- 172.21.15.103:0/1962311848 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7d8c04d7f0 0x7f7d8c04fcb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7dac0b29e0 tx=0x7f7d9c008d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.142+0000 7f7dab7fe700 1 --2- 172.21.15.103:0/1962311848 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7d8c04d7f0 0x7f7d8c04fcb0 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f7dac0b29e0 tx=0x7f7d9c008d10).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:25.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.146+0000 7f7daaffd700 1 --2- 172.21.15.103:0/1962311848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7dac0acb10 0x7f7dac152a30 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f7da0000b80 tx=0x7f7da0001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.146+0000 7f7da8ff9700 1 -- 172.21.15.103:0/1962311848 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f7da003c5b0 con 0x7f7dac0acb10 2020-04-22T14:02:25.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.289+0000 7f7db223a700 1 -- 172.21.15.103:0/1962311848 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7dac056c90 con 0x7f7dac0acb10 2020-04-22T14:02:25.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.289+0000 7f7daaffd700 1 --2- 172.21.15.103:0/1962311848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7dac0acb10 0x7f7dac152a30 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f7da0000b80 tx=0x7f7da0001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.289+0000 7f7da8ff9700 1 -- 172.21.15.103:0/1962311848 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7da003fbd0 con 0x7f7dac0acb10 2020-04-22T14:02:25.293 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:02:25.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.291+0000 7f7db223a700 1 -- 172.21.15.103:0/1962311848 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7d8c04d7f0 msgr2=0x7f7d8c04fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:25.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.291+0000 7f7db223a700 1 --2- 172.21.15.103:0/1962311848 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7d8c04d7f0 0x7f7d8c04fcb0 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f7dac0b29e0 tx=0x7f7d9c008d10).stop 2020-04-22T14:02:25.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.291+0000 7f7db223a700 1 -- 172.21.15.103:0/1962311848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7dac0acb10 msgr2=0x7f7dac152a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:25.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.291+0000 7f7db223a700 1 --2- 172.21.15.103:0/1962311848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7dac0acb10 0x7f7dac152a30 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f7da0000b80 tx=0x7f7da0001e40).stop 2020-04-22T14:02:25.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.291+0000 7f7db223a700 1 -- 172.21.15.103:0/1962311848 shutdown_connections 2020-04-22T14:02:25.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.291+0000 7f7db223a700 1 --2- 172.21.15.103:0/1962311848 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7d8c04d7f0 0x7f7d8c04fcb0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:25.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.291+0000 7f7db223a700 1 --2- 172.21.15.103:0/1962311848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7dac0acb10 0x7f7dac152a30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:25.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.291+0000 7f7db223a700 1 -- 172.21.15.103:0/1962311848 >> 172.21.15.103:0/1962311848 conn(0x7f7dac05b7b0 msgr2=0x7f7dac0ae440 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:25.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.291+0000 7f7db223a700 1 -- 172.21.15.103:0/1962311848 shutdown_connections 2020-04-22T14:02:25.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.291+0000 7f7db223a700 1 -- 172.21.15.103:0/1962311848 wait complete. 2020-04-22T14:02:25.303 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:25.316 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-04-22T14:02:25.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.462+0000 7f1563bd7700 1 Processor -- start 2020-04-22T14:02:25.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.462+0000 7f1563bd7700 1 -- start start 2020-04-22T14:02:25.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.463+0000 7f1563bd7700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f155c05f2c0 0x7f155c1464a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:25.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.463+0000 7f1563bd7700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f155c061fe0 con 0x7f155c0b56c0 2020-04-22T14:02:25.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.463+0000 7f1563bd7700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f155c062280 con 0x7f155c1403f0 2020-04-22T14:02:25.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.463+0000 7f1563bd7700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f155c062520 con 0x7f155c05f2c0 2020-04-22T14:02:25.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.463+0000 7f1561973700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f155c1403f0 0x7f155c0629c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39064/0 (socket says 172.21.15.103:39064) 2020-04-22T14:02:25.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.463+0000 7f1561973700 1 -- 172.21.15.103:0/1660814904 learned_addr learned my addr 172.21.15.103:0/1660814904 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:25.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.463+0000 7f1561172700 1 --2- 172.21.15.103:0/1660814904 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f155c05f2c0 0x7f155c1464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:25.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.463+0000 7f1560971700 1 -- 172.21.15.103:0/1660814904 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3692992127 0 0) 0x7f155c062280 con 0x7f155c1403f0 2020-04-22T14:02:25.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.463+0000 7f1560971700 1 -- 172.21.15.103:0/1660814904 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1548003230 con 0x7f155c1403f0 2020-04-22T14:02:25.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.463+0000 7f1560971700 1 -- 172.21.15.103:0/1660814904 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 479983196 0 0) 0x7f1548003230 con 0x7f155c1403f0 2020-04-22T14:02:25.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.463+0000 7f1560971700 1 -- 172.21.15.103:0/1660814904 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f155c05f2c0 msgr2=0x7f155c1464a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:25.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.463+0000 7f1560971700 1 --2- 172.21.15.103:0/1660814904 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f155c05f2c0 0x7f155c1464a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:25.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.463+0000 7f1560971700 1 -- 172.21.15.103:0/1660814904 >> v1:172.21.15.86:6789/0 conn(0x7f155c0b56c0 legacy=0x7f155c0b3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:25.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.463+0000 7f1560971700 1 -- 172.21.15.103:0/1660814904 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155c0b51c0 con 0x7f155c1403f0 2020-04-22T14:02:25.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.463+0000 7f1560971700 1 -- 172.21.15.103:0/1660814904 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f154c001a90 con 0x7f155c1403f0 2020-04-22T14:02:25.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.464+0000 7f1560971700 1 -- 172.21.15.103:0/1660814904 >> v1:172.21.15.103:6789/0 conn(0x7f155c1403f0 legacy=0x7f155c0629c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:25.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.464+0000 7f1560971700 1 --2- 172.21.15.103:0/1660814904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1548003720 0x7f1548003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:25.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.464+0000 7f1560971700 1 --2- 172.21.15.103:0/1660814904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1548004060 0x7f1548004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:25.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.464+0000 7f1560971700 1 --2- 172.21.15.103:0/1660814904 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f155c05f2c0 0x7f1548004ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:25.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.464+0000 7f1560971700 1 -- 172.21.15.103:0/1660814904 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155c062520 con 0x7f1548004060 2020-04-22T14:02:25.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.464+0000 7f1560971700 1 -- 172.21.15.103:0/1660814904 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1548004f70 con 0x7f1548003720 2020-04-22T14:02:25.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.464+0000 7f1560971700 1 -- 172.21.15.103:0/1660814904 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1548005130 con 0x7f155c05f2c0 2020-04-22T14:02:25.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.464+0000 7f1561973700 1 --2- 172.21.15.103:0/1660814904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1548003720 0x7f1548003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:25.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.464+0000 7f1561172700 1 --2- 172.21.15.103:0/1660814904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1548004060 0x7f1548004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:25.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.464+0000 7f1562174700 1 --2- 172.21.15.103:0/1660814904 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f155c05f2c0 0x7f1548004ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:25.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.464+0000 7f1561973700 1 -- 172.21.15.103:0/1660814904 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f155c05f2c0 msgr2=0x7f1548004ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:25.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.464+0000 7f1561973700 1 --2- 172.21.15.103:0/1660814904 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f155c05f2c0 0x7f1548004ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:25.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.464+0000 7f1561973700 1 -- 172.21.15.103:0/1660814904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1548004060 msgr2=0x7f1548004530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:25.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.464+0000 7f1561973700 1 --2- 172.21.15.103:0/1660814904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1548004060 0x7f1548004530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:25.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.464+0000 7f1561973700 1 -- 172.21.15.103:0/1660814904 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1548003230 con 0x7f1548003720 2020-04-22T14:02:25.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.464+0000 7f1561973700 1 --2- 172.21.15.103:0/1660814904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1548003720 0x7f1548003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f154c0017a0 tx=0x7f155c0b5350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.464+0000 7f1561973700 1 --2- 172.21.15.103:0/1660814904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1548003720 0x7f1548003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f154c0017a0 tx=0x7f155c0b5350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.464+0000 7f1561973700 1 --2- 172.21.15.103:0/1660814904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1548003720 0x7f1548003b40 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f154c0017a0 tx=0x7f155c0b5350).ready entity=mon.1 client_cookie=24d0ff0296e8a749 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:25.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.464+0000 7f1561973700 1 --2- 172.21.15.103:0/1660814904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1548003720 0x7f1548003b40 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f154c0017a0 tx=0x7f155c0b5350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.464+0000 7f1560971700 1 -- 172.21.15.103:0/1660814904 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f154c005d40 con 0x7f1548003720 2020-04-22T14:02:25.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.464+0000 7f1561973700 1 --2- 172.21.15.103:0/1660814904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1548003720 0x7f1548003b40 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f154c0017a0 tx=0x7f155c0b5350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.464+0000 7f1560971700 1 -- 172.21.15.103:0/1660814904 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f154c004d20 con 0x7f1548003720 2020-04-22T14:02:25.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.464+0000 7f1561973700 1 --2- 172.21.15.103:0/1660814904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1548003720 0x7f1548003b40 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f154c0017a0 tx=0x7f155c0b5350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.464+0000 7f1560971700 1 -- 172.21.15.103:0/1660814904 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f154c005140 con 0x7f1548003720 2020-04-22T14:02:25.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.464+0000 7f1563bd7700 1 -- 172.21.15.103:0/1660814904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1548003720 msgr2=0x7f1548003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:25.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.464+0000 7f1563bd7700 1 --2- 172.21.15.103:0/1660814904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1548003720 0x7f1548003b40 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f154c0017a0 tx=0x7f155c0b5350).stop 2020-04-22T14:02:25.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.464+0000 7f1562174700 1 -- 172.21.15.103:0/1660814904 reap_dead start 2020-04-22T14:02:25.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.465+0000 7f1563bd7700 1 -- 172.21.15.103:0/1660814904 shutdown_connections 2020-04-22T14:02:25.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.465+0000 7f1563bd7700 1 -- 172.21.15.103:0/1660814904 >> 172.21.15.103:0/1660814904 conn(0x7f155c05ad30 msgr2=0x7f155c05b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:25.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.465+0000 7f1563bd7700 1 -- 172.21.15.103:0/1660814904 shutdown_connections 2020-04-22T14:02:25.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.465+0000 7f1563bd7700 1 -- 172.21.15.103:0/1660814904 wait complete. 2020-04-22T14:02:25.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.466+0000 7f1563bd7700 1 Processor -- start 2020-04-22T14:02:25.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.466+0000 7f1563bd7700 1 -- start start 2020-04-22T14:02:25.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.466+0000 7f1563bd7700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f155c145960 0x7f155c1539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:25.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.466+0000 7f1563bd7700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f155c142510 con 0x7f155c0aeec0 2020-04-22T14:02:25.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.466+0000 7f1563bd7700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f155c1427b0 con 0x7f155c1443d0 2020-04-22T14:02:25.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.466+0000 7f1563bd7700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f155c142a50 con 0x7f155c145960 2020-04-22T14:02:25.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.466+0000 7f1561172700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f155c1443d0 0x7f155c142ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39078/0 (socket says 172.21.15.103:39078) 2020-04-22T14:02:25.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.466+0000 7f1561172700 1 -- 172.21.15.103:0/2907684110 learned_addr learned my addr 172.21.15.103:0/2907684110 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:25.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.467+0000 7f1562174700 1 --2- 172.21.15.103:0/2907684110 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f155c145960 0x7f155c1539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:25.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.467+0000 7f1552ffd700 1 -- 172.21.15.103:0/2907684110 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3819964385 0 0) 0x7f155c1427b0 con 0x7f155c1443d0 2020-04-22T14:02:25.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.467+0000 7f1552ffd700 1 -- 172.21.15.103:0/2907684110 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f153c002fe0 con 0x7f155c1443d0 2020-04-22T14:02:25.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.467+0000 7f1552ffd700 1 -- 172.21.15.103:0/2907684110 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2810067323 0 0) 0x7f155c142510 con 0x7f155c0aeec0 2020-04-22T14:02:25.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.467+0000 7f1552ffd700 1 -- 172.21.15.103:0/2907684110 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f155c1427b0 con 0x7f155c0aeec0 2020-04-22T14:02:25.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.467+0000 7f1552ffd700 1 -- 172.21.15.103:0/2907684110 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4180238256 0 0) 0x7f153c002fe0 con 0x7f155c1443d0 2020-04-22T14:02:25.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.467+0000 7f1562174700 1 -- 172.21.15.103:0/2907684110 >> v1:172.21.15.103:6789/0 conn(0x7f155c1443d0 legacy=0x7f155c142ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:25.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.467+0000 7f1562174700 1 -- 172.21.15.103:0/2907684110 >> v1:172.21.15.86:6789/0 conn(0x7f155c0aeec0 legacy=0x7f155c133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:25.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.467+0000 7f1562174700 1 -- 172.21.15.103:0/2907684110 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155c0af2a0 con 0x7f155c145960 2020-04-22T14:02:25.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.467+0000 7f1562174700 1 --2- 172.21.15.103:0/2907684110 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f155c145960 0x7f155c1539b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f15580015f0 tx=0x7f1554010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.467+0000 7f1562174700 1 --2- 172.21.15.103:0/2907684110 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f155c145960 0x7f155c1539b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f15580015f0 tx=0x7f1554010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.467+0000 7f1562174700 1 --2- 172.21.15.103:0/2907684110 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f155c145960 0x7f155c1539b0 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7f15580015f0 tx=0x7f1554010720).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:25.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.467+0000 7f1562174700 1 --2- 172.21.15.103:0/2907684110 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f155c145960 0x7f155c1539b0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f15580015f0 tx=0x7f1554010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.467+0000 7f1552ffd700 1 -- 172.21.15.103:0/2907684110 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1558001490 con 0x7f155c145960 2020-04-22T14:02:25.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.467+0000 7f1562174700 1 --2- 172.21.15.103:0/2907684110 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f155c145960 0x7f155c1539b0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f15580015f0 tx=0x7f1554010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.467+0000 7f1562174700 1 --2- 172.21.15.103:0/2907684110 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f155c145960 0x7f155c1539b0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f15580015f0 tx=0x7f1554010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.467+0000 7f1552ffd700 1 -- 172.21.15.103:0/2907684110 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1554006ac0 con 0x7f155c145960 2020-04-22T14:02:25.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.467+0000 7f1552ffd700 1 -- 172.21.15.103:0/2907684110 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1554006e20 con 0x7f155c145960 2020-04-22T14:02:25.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.467+0000 7f1563bd7700 1 -- 172.21.15.103:0/2907684110 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f155c153e10 con 0x7f155c145960 2020-04-22T14:02:25.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.467+0000 7f1563bd7700 1 -- 172.21.15.103:0/2907684110 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f155c1343a0 con 0x7f155c145960 2020-04-22T14:02:25.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.468+0000 7f1562174700 1 --2- 172.21.15.103:0/2907684110 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f155c145960 0x7f155c1539b0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f15580015f0 tx=0x7f1554010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.468+0000 7f1552ffd700 1 -- 172.21.15.103:0/2907684110 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f15540016d0 con 0x7f155c145960 2020-04-22T14:02:25.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.468+0000 7f1562174700 1 --2- 172.21.15.103:0/2907684110 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f155c145960 0x7f155c1539b0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f15580015f0 tx=0x7f1554010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.468+0000 7f1563bd7700 1 -- 172.21.15.103:0/2907684110 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f155c056c90 con 0x7f155c145960 2020-04-22T14:02:25.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.468+0000 7f1552ffd700 1 --2- 172.21.15.103:0/2907684110 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f153c04de40 0x7f153c050300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:25.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.469+0000 7f1552ffd700 1 -- 172.21.15.103:0/2907684110 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f1554060c40 con 0x7f155c145960 2020-04-22T14:02:25.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.469+0000 7f1561973700 1 --2- 172.21.15.103:0/2907684110 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f153c04de40 0x7f153c050300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:25.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.469+0000 7f1561973700 1 --2- 172.21.15.103:0/2907684110 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f153c04de40 0x7f153c050300 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f154c00be60 tx=0x7f155c0b5350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.469+0000 7f1561973700 1 --2- 172.21.15.103:0/2907684110 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f153c04de40 0x7f153c050300 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f154c00be60 tx=0x7f155c0b5350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.469+0000 7f1561973700 1 --2- 172.21.15.103:0/2907684110 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f153c04de40 0x7f153c050300 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7f154c00be60 tx=0x7f155c0b5350).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:25.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.473+0000 7f1562174700 1 --2- 172.21.15.103:0/2907684110 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f155c145960 0x7f155c1539b0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f15580015f0 tx=0x7f1554010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.473+0000 7f1552ffd700 1 -- 172.21.15.103:0/2907684110 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f155403c080 con 0x7f155c145960 2020-04-22T14:02:25.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.615+0000 7f1563bd7700 1 -- 172.21.15.103:0/2907684110 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f155c06a8b0 con 0x7f155c145960 2020-04-22T14:02:25.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.616+0000 7f1562174700 1 --2- 172.21.15.103:0/2907684110 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f155c145960 0x7f155c1539b0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f15580015f0 tx=0x7f1554010720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.616+0000 7f1552ffd700 1 -- 172.21.15.103:0/2907684110 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) v1 ==== 84+0+143 (secure 0 0 0) 0x7f155403f6a0 con 0x7f155c145960 2020-04-22T14:02:25.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.617+0000 7f1563bd7700 1 -- 172.21.15.103:0/2907684110 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f153c04de40 msgr2=0x7f153c050300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:25.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.617+0000 7f1563bd7700 1 --2- 172.21.15.103:0/2907684110 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f153c04de40 0x7f153c050300 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7f154c00be60 tx=0x7f155c0b5350).stop 2020-04-22T14:02:25.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.617+0000 7f1563bd7700 1 -- 172.21.15.103:0/2907684110 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f155c145960 msgr2=0x7f155c1539b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:25.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.617+0000 7f1563bd7700 1 --2- 172.21.15.103:0/2907684110 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f155c145960 0x7f155c1539b0 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7f15580015f0 tx=0x7f1554010720).stop 2020-04-22T14:02:25.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.617+0000 7f1563bd7700 1 -- 172.21.15.103:0/2907684110 shutdown_connections 2020-04-22T14:02:25.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.617+0000 7f1563bd7700 1 --2- 172.21.15.103:0/2907684110 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f153c04de40 0x7f153c050300 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:25.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.617+0000 7f1563bd7700 1 --2- 172.21.15.103:0/2907684110 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f155c145960 0x7f155c1539b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:25.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.617+0000 7f1563bd7700 1 -- 172.21.15.103:0/2907684110 >> 172.21.15.103:0/2907684110 conn(0x7f155c05ad30 msgr2=0x7f155c0b8f70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:25.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.618+0000 7f1563bd7700 1 -- 172.21.15.103:0/2907684110 shutdown_connections 2020-04-22T14:02:25.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.618+0000 7f1563bd7700 1 -- 172.21.15.103:0/2907684110 wait complete. 2020-04-22T14:02:25.636 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:02:25.636 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2020-04-22T14:02:25.637 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:02:25.637 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 1, 2020-04-22T14:02:25.637 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": "device_health_metrics" 2020-04-22T14:02:25.637 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:02:25.637 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:02:25.637 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 2, 2020-04-22T14:02:25.637 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": "rbd" 2020-04-22T14:02:25.638 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:02:25.638 INFO:teuthology.orchestra.run.smithi103.stdout:] 2020-04-22T14:02:25.638 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-04-22T14:02:25.638 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:25.652 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-04-22T14:02:25.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.799+0000 7f5b19327700 1 Processor -- start 2020-04-22T14:02:25.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.799+0000 7f5b19327700 1 -- start start 2020-04-22T14:02:25.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.800+0000 7f5b19327700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5b140b9140 0x7f5b1412b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:25.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.800+0000 7f5b19327700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5b1412b670 0x7f5b14143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:25.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.800+0000 7f5b19327700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b141467e0 con 0x7f5b140ac950 2020-04-22T14:02:25.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.800+0000 7f5b19327700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b140602f0 con 0x7f5b140b9140 2020-04-22T14:02:25.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.800+0000 7f5b19327700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b14060050 con 0x7f5b1412b670 2020-04-22T14:02:25.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.800+0000 7f5b137fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5b1412b670 0x7f5b14143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:25.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.801+0000 7f5b137fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5b1412b670 0x7f5b14143090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46894/0 (socket says 172.21.15.103:46894) 2020-04-22T14:02:25.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.801+0000 7f5b137fe700 1 -- 172.21.15.103:0/3668770727 learned_addr learned my addr 172.21.15.103:0/3668770727 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:25.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.801+0000 7f5b12ffd700 1 --2- 172.21.15.103:0/3668770727 >> v2:172.21.15.86:3300/0 conn(0x7f5b140b9140 0x7f5b1412b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:25.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.801+0000 7f5b137fe700 1 -- 172.21.15.103:0/3668770727 >> v2:172.21.15.86:3300/0 conn(0x7f5b140b9140 msgr2=0x7f5b1412b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:25.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.801+0000 7f5b137fe700 1 --2- 172.21.15.103:0/3668770727 >> v2:172.21.15.86:3300/0 conn(0x7f5b140b9140 0x7f5b1412b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:25.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.801+0000 7f5b137fe700 1 -- 172.21.15.103:0/3668770727 >> v1:172.21.15.86:6789/0 conn(0x7f5b140ac950 legacy=0x7f5b14146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:25.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.801+0000 7f5b137fe700 1 -- 172.21.15.103:0/3668770727 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b140b9520 con 0x7f5b1412b670 2020-04-22T14:02:25.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.801+0000 7f5b137fe700 1 --2- 172.21.15.103:0/3668770727 >> v2:172.21.15.103:3300/0 conn(0x7f5b1412b670 0x7f5b14143090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5b0c0032b0 tx=0x7f5b0c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.801+0000 7f5b137fe700 1 --2- 172.21.15.103:0/3668770727 >> v2:172.21.15.103:3300/0 conn(0x7f5b1412b670 0x7f5b14143090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5b0c0032b0 tx=0x7f5b0c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.801+0000 7f5b137fe700 1 --2- 172.21.15.103:0/3668770727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b1412b670 0x7f5b14143090 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f5b0c0032b0 tx=0x7f5b0c007dc0).ready entity=mon.1 client_cookie=9991c63c7c96ac0e server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:25.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.801+0000 7f5b137fe700 1 --2- 172.21.15.103:0/3668770727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b1412b670 0x7f5b14143090 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f5b0c0032b0 tx=0x7f5b0c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.801+0000 7f5b11ffb700 1 -- 172.21.15.103:0/3668770727 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b0c00a180 con 0x7f5b1412b670 2020-04-22T14:02:25.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.801+0000 7f5b137fe700 1 --2- 172.21.15.103:0/3668770727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b1412b670 0x7f5b14143090 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f5b0c0032b0 tx=0x7f5b0c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.801+0000 7f5b11ffb700 1 -- 172.21.15.103:0/3668770727 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0c00a2e0 con 0x7f5b1412b670 2020-04-22T14:02:25.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.801+0000 7f5b137fe700 1 --2- 172.21.15.103:0/3668770727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b1412b670 0x7f5b14143090 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f5b0c0032b0 tx=0x7f5b0c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.801+0000 7f5b11ffb700 1 -- 172.21.15.103:0/3668770727 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b0c00a700 con 0x7f5b1412b670 2020-04-22T14:02:25.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.801+0000 7f5b19327700 1 -- 172.21.15.103:0/3668770727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b1412b670 msgr2=0x7f5b14143090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:25.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.801+0000 7f5b19327700 1 --2- 172.21.15.103:0/3668770727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b1412b670 0x7f5b14143090 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f5b0c0032b0 tx=0x7f5b0c007dc0).stop 2020-04-22T14:02:25.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.802+0000 7f5b19327700 1 -- 172.21.15.103:0/3668770727 shutdown_connections 2020-04-22T14:02:25.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.802+0000 7f5b19327700 1 --2- 172.21.15.103:0/3668770727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b1412b670 0x7f5b14143090 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:25.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.802+0000 7f5b19327700 1 --2- 172.21.15.103:0/3668770727 >> v2:172.21.15.86:3300/0 conn(0x7f5b140b9140 0x7f5b1412b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:25.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.802+0000 7f5b19327700 1 -- 172.21.15.103:0/3668770727 >> 172.21.15.103:0/3668770727 conn(0x7f5b1405b7b0 msgr2=0x7f5b140b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:25.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.802+0000 7f5b19327700 1 -- 172.21.15.103:0/3668770727 shutdown_connections 2020-04-22T14:02:25.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.802+0000 7f5b19327700 1 -- 172.21.15.103:0/3668770727 wait complete. 2020-04-22T14:02:25.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.803+0000 7f5b19327700 1 Processor -- start 2020-04-22T14:02:25.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.803+0000 7f5b19327700 1 -- start start 2020-04-22T14:02:25.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.803+0000 7f5b19327700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5b140ac950 0x7f5b140b2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:25.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.803+0000 7f5b19327700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b140b2660 con 0x7f5b1412b670 2020-04-22T14:02:25.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.803+0000 7f5b19327700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b14152120 con 0x7f5b140b9140 2020-04-22T14:02:25.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.803+0000 7f5b19327700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b141523c0 con 0x7f5b140ac950 2020-04-22T14:02:25.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.803+0000 7f5b127fc700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f5b140b9140 0x7f5b14151810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39092/0 (socket says 172.21.15.103:39092) 2020-04-22T14:02:25.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.803+0000 7f5b127fc700 1 -- 172.21.15.103:0/2280597708 learned_addr learned my addr 172.21.15.103:0/2280597708 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:25.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.804+0000 7f5b12ffd700 1 --2- 172.21.15.103:0/2280597708 >> v2:172.21.15.86:3300/0 conn(0x7f5b140ac950 0x7f5b140b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:25.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.804+0000 7f5b03fff700 1 -- 172.21.15.103:0/2280597708 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2404071968 0 0) 0x7f5b14152120 con 0x7f5b140b9140 2020-04-22T14:02:25.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.804+0000 7f5b03fff700 1 -- 172.21.15.103:0/2280597708 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5af0002fe0 con 0x7f5b140b9140 2020-04-22T14:02:25.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.804+0000 7f5b03fff700 1 -- 172.21.15.103:0/2280597708 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2887083701 0 0) 0x7f5af0002fe0 con 0x7f5b140b9140 2020-04-22T14:02:25.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.804+0000 7f5b03fff700 1 -- 172.21.15.103:0/2280597708 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5b14152120 con 0x7f5b140b9140 2020-04-22T14:02:25.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.804+0000 7f5b03fff700 1 -- 172.21.15.103:0/2280597708 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f5b04001a00 con 0x7f5b140b9140 2020-04-22T14:02:25.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.804+0000 7f5b12ffd700 1 -- 172.21.15.103:0/2280597708 >> v1:172.21.15.103:6789/0 conn(0x7f5b140b9140 legacy=0x7f5b14151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:25.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.804+0000 7f5b12ffd700 1 -- 172.21.15.103:0/2280597708 >> v1:172.21.15.86:6789/0 conn(0x7f5b1412b670 legacy=0x7f5b14145520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:25.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.804+0000 7f5b12ffd700 1 -- 172.21.15.103:0/2280597708 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b14152660 con 0x7f5b140ac950 2020-04-22T14:02:25.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.804+0000 7f5b12ffd700 1 --2- 172.21.15.103:0/2280597708 >> v2:172.21.15.86:3300/0 conn(0x7f5b140ac950 0x7f5b140b2200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5b0c008820 tx=0x7f5b08010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.804+0000 7f5b12ffd700 1 --2- 172.21.15.103:0/2280597708 >> v2:172.21.15.86:3300/0 conn(0x7f5b140ac950 0x7f5b140b2200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5b0c008820 tx=0x7f5b08010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.804+0000 7f5b12ffd700 1 --2- 172.21.15.103:0/2280597708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5b140ac950 0x7f5b140b2200 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f5b0c008820 tx=0x7f5b08010b10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:25.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.804+0000 7f5b12ffd700 1 --2- 172.21.15.103:0/2280597708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5b140ac950 0x7f5b140b2200 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f5b0c008820 tx=0x7f5b08010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.804+0000 7f5b03fff700 1 -- 172.21.15.103:0/2280597708 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b0800c570 con 0x7f5b140ac950 2020-04-22T14:02:25.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.804+0000 7f5b12ffd700 1 --2- 172.21.15.103:0/2280597708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5b140ac950 0x7f5b140b2200 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f5b0c008820 tx=0x7f5b08010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.804+0000 7f5b03fff700 1 -- 172.21.15.103:0/2280597708 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0800c6d0 con 0x7f5b140ac950 2020-04-22T14:02:25.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.804+0000 7f5b12ffd700 1 --2- 172.21.15.103:0/2280597708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5b140ac950 0x7f5b140b2200 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f5b0c008820 tx=0x7f5b08010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.804+0000 7f5b19327700 1 -- 172.21.15.103:0/2280597708 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b14154f30 con 0x7f5b140ac950 2020-04-22T14:02:25.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.804+0000 7f5b03fff700 1 -- 172.21.15.103:0/2280597708 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b0800ca70 con 0x7f5b140ac950 2020-04-22T14:02:25.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.804+0000 7f5b19327700 1 -- 172.21.15.103:0/2280597708 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b14064bd0 con 0x7f5b140ac950 2020-04-22T14:02:25.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.805+0000 7f5b12ffd700 1 --2- 172.21.15.103:0/2280597708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5b140ac950 0x7f5b140b2200 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f5b0c008820 tx=0x7f5b08010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.805+0000 7f5b19327700 1 -- 172.21.15.103:0/2280597708 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b14063780 con 0x7f5b140ac950 2020-04-22T14:02:25.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.805+0000 7f5b03fff700 1 -- 172.21.15.103:0/2280597708 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f5b0800cc70 con 0x7f5b140ac950 2020-04-22T14:02:25.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.805+0000 7f5b12ffd700 1 --2- 172.21.15.103:0/2280597708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5b140ac950 0x7f5b140b2200 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f5b0c008820 tx=0x7f5b08010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.806+0000 7f5b03fff700 1 --2- 172.21.15.103:0/2280597708 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5af004def0 0x7f5af00503b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:25.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.806+0000 7f5b03fff700 1 -- 172.21.15.103:0/2280597708 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f5b0800d0c0 con 0x7f5b140ac950 2020-04-22T14:02:25.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.806+0000 7f5b127fc700 1 --2- 172.21.15.103:0/2280597708 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5af004def0 0x7f5af00503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:25.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.806+0000 7f5b127fc700 1 --2- 172.21.15.103:0/2280597708 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5af004def0 0x7f5af00503b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5b04001710 tx=0x7f5b040095b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.806+0000 7f5b127fc700 1 --2- 172.21.15.103:0/2280597708 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5af004def0 0x7f5af00503b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5b04001710 tx=0x7f5b040095b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.806+0000 7f5b127fc700 1 --2- 172.21.15.103:0/2280597708 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5af004def0 0x7f5af00503b0 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f5b04001710 tx=0x7f5b040095b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:25.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.809+0000 7f5b12ffd700 1 --2- 172.21.15.103:0/2280597708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5b140ac950 0x7f5b140b2200 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f5b0c008820 tx=0x7f5b08010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:25.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.810+0000 7f5b03fff700 1 -- 172.21.15.103:0/2280597708 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f5b0803c040 con 0x7f5b140ac950 2020-04-22T14:02:25.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:25.950+0000 7f5b19327700 1 -- 172.21.15.103:0/2280597708 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f5b14056c90 con 0x7f5b140ac950 2020-04-22T14:02:26.297 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.295+0000 7f5b12ffd700 1 --2- 172.21.15.103:0/2280597708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5b140ac950 0x7f5b140b2200 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f5b0c008820 tx=0x7f5b08010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:26.298 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.295+0000 7f5b03fff700 1 -- 172.21.15.103:0/2280597708 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v21) v1 ==== 133+0+0 (secure 0 0 0) 0x7f5b0803f660 con 0x7f5b140ac950 2020-04-22T14:02:26.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.297+0000 7f5b19327700 1 -- 172.21.15.103:0/2280597708 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5af004def0 msgr2=0x7f5af00503b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:26.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.297+0000 7f5b19327700 1 --2- 172.21.15.103:0/2280597708 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5af004def0 0x7f5af00503b0 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f5b04001710 tx=0x7f5b040095b0).stop 2020-04-22T14:02:26.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.297+0000 7f5b19327700 1 -- 172.21.15.103:0/2280597708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5b140ac950 msgr2=0x7f5b140b2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:26.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.297+0000 7f5b19327700 1 --2- 172.21.15.103:0/2280597708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5b140ac950 0x7f5b140b2200 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f5b0c008820 tx=0x7f5b08010b10).stop 2020-04-22T14:02:26.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.297+0000 7f5b19327700 1 -- 172.21.15.103:0/2280597708 shutdown_connections 2020-04-22T14:02:26.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.297+0000 7f5b19327700 1 --2- 172.21.15.103:0/2280597708 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5af004def0 0x7f5af00503b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:26.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.297+0000 7f5b19327700 1 --2- 172.21.15.103:0/2280597708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5b140ac950 0x7f5b140b2200 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:26.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.297+0000 7f5b19327700 1 -- 172.21.15.103:0/2280597708 >> 172.21.15.103:0/2280597708 conn(0x7f5b1405b7b0 msgr2=0x7f5b14127810 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:26.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.297+0000 7f5b19327700 1 -- 172.21.15.103:0/2280597708 shutdown_connections 2020-04-22T14:02:26.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.297+0000 7f5b19327700 1 -- 172.21.15.103:0/2280597708 wait complete. 2020-04-22T14:02:26.302 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' created 2020-04-22T14:02:26.311 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:26.326 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-04-22T14:02:26.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.476+0000 7fb9f89bc700 1 Processor -- start 2020-04-22T14:02:26.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.476+0000 7fb9f89bc700 1 -- start start 2020-04-22T14:02:26.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.477+0000 7fb9f89bc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb9f40b3bd0 0x7fb9f4143650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:26.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.477+0000 7fb9f89bc700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9f4148310 con 0x7fb9f4143ab0 2020-04-22T14:02:26.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.477+0000 7fb9f89bc700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9f41485b0 con 0x7fb9f40b9140 2020-04-22T14:02:26.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.477+0000 7fb9f89bc700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9f40b9520 con 0x7fb9f40b3bd0 2020-04-22T14:02:26.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.477+0000 7fb9f1d9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb9f40b3bd0 0x7fb9f4143650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:26.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.477+0000 7fb9f1d9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb9f40b3bd0 0x7fb9f4143650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46910/0 (socket says 172.21.15.103:46910) 2020-04-22T14:02:26.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.477+0000 7fb9f1d9b700 1 -- 172.21.15.103:0/2170622408 learned_addr learned my addr 172.21.15.103:0/2170622408 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:26.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.477+0000 7fb9f259c700 1 --1- 172.21.15.103:0/2170622408 >> v1:172.21.15.103:6789/0 conn(0x7fb9f40b9140 0x7fb9f40aed90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39098/0 (socket says 172.21.15.103:39098) 2020-04-22T14:02:26.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.477+0000 7fb9f1d9b700 1 -- 172.21.15.103:0/2170622408 >> v1:172.21.15.103:6789/0 conn(0x7fb9f40b9140 legacy=0x7fb9f40aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:26.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.477+0000 7fb9f1d9b700 1 -- 172.21.15.103:0/2170622408 >> v1:172.21.15.86:6789/0 conn(0x7fb9f4143ab0 legacy=0x7fb9f4143f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:26.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.477+0000 7fb9f159a700 1 -- 172.21.15.103:0/2170622408 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3285599443 0 0) 0x7fb9f41485b0 con 0x7fb9f40b9140 2020-04-22T14:02:26.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.477+0000 7fb9f1d9b700 1 -- 172.21.15.103:0/2170622408 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f40b3050 con 0x7fb9f40b3bd0 2020-04-22T14:02:26.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.477+0000 7fb9f1d9b700 1 --2- 172.21.15.103:0/2170622408 >> v2:172.21.15.103:3300/0 conn(0x7fb9f40b3bd0 0x7fb9f4143650 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb9e4002f30 tx=0x7fb9e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:26.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.477+0000 7fb9f1d9b700 1 --2- 172.21.15.103:0/2170622408 >> v2:172.21.15.103:3300/0 conn(0x7fb9f40b3bd0 0x7fb9f4143650 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb9e4002f30 tx=0x7fb9e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:26.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.477+0000 7fb9f1d9b700 1 --2- 172.21.15.103:0/2170622408 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9f40b3bd0 0x7fb9f4143650 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7fb9e4002f30 tx=0x7fb9e4007a40).ready entity=mon.1 client_cookie=f4b4130ae1cfef52 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:26.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.477+0000 7fb9f1d9b700 1 --2- 172.21.15.103:0/2170622408 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9f40b3bd0 0x7fb9f4143650 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7fb9e4002f30 tx=0x7fb9e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:26.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.477+0000 7fb9f159a700 1 -- 172.21.15.103:0/2170622408 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9e4011720 con 0x7fb9f40b3bd0 2020-04-22T14:02:26.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.477+0000 7fb9f1d9b700 1 --2- 172.21.15.103:0/2170622408 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9f40b3bd0 0x7fb9f4143650 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7fb9e4002f30 tx=0x7fb9e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:26.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.477+0000 7fb9f1d9b700 1 --2- 172.21.15.103:0/2170622408 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9f40b3bd0 0x7fb9f4143650 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7fb9e4002f30 tx=0x7fb9e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:26.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.477+0000 7fb9f159a700 1 -- 172.21.15.103:0/2170622408 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e40118c0 con 0x7fb9f40b3bd0 2020-04-22T14:02:26.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.477+0000 7fb9f159a700 1 -- 172.21.15.103:0/2170622408 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9e4011ce0 con 0x7fb9f40b3bd0 2020-04-22T14:02:26.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.477+0000 7fb9f89bc700 1 -- 172.21.15.103:0/2170622408 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9f40b3bd0 msgr2=0x7fb9f4143650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:26.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.477+0000 7fb9f89bc700 1 --2- 172.21.15.103:0/2170622408 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9f40b3bd0 0x7fb9f4143650 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7fb9e4002f30 tx=0x7fb9e4007a40).stop 2020-04-22T14:02:26.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.478+0000 7fb9f89bc700 1 -- 172.21.15.103:0/2170622408 shutdown_connections 2020-04-22T14:02:26.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.478+0000 7fb9f89bc700 1 --2- 172.21.15.103:0/2170622408 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9f40b3bd0 0x7fb9f4143650 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:26.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.478+0000 7fb9f89bc700 1 -- 172.21.15.103:0/2170622408 >> 172.21.15.103:0/2170622408 conn(0x7fb9f405b7b0 msgr2=0x7fb9f40b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:26.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.478+0000 7fb9f89bc700 1 -- 172.21.15.103:0/2170622408 shutdown_connections 2020-04-22T14:02:26.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.478+0000 7fb9f89bc700 1 -- 172.21.15.103:0/2170622408 wait complete. 2020-04-22T14:02:26.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.479+0000 7fb9f89bc700 1 Processor -- start 2020-04-22T14:02:26.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.479+0000 7fb9f89bc700 1 -- start start 2020-04-22T14:02:26.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.480+0000 7fb9f89bc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb9f40b3bd0 0x7fb9f413faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:26.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.480+0000 7fb9f89bc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb9f40b9140 0x7fb9f4155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:26.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.480+0000 7fb9f89bc700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9f4143ab0 0x7fb9f413e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:26.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.480+0000 7fb9f89bc700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9f4146df0 con 0x7fb9f40b3bd0 2020-04-22T14:02:26.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.480+0000 7fb9f89bc700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9f4155b70 con 0x7fb9f40b9140 2020-04-22T14:02:26.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.480+0000 7fb9f89bc700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f413ed60 con 0x7fb9f4143ab0 2020-04-22T14:02:26.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.480+0000 7fb9f1d9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb9f40b9140 0x7fb9f4155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:26.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.480+0000 7fb9f1d9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb9f40b9140 0x7fb9f4155710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46916/0 (socket says 172.21.15.103:46916) 2020-04-22T14:02:26.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.480+0000 7fb9f1d9b700 1 -- 172.21.15.103:0/3016238816 learned_addr learned my addr 172.21.15.103:0/3016238816 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:26.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.480+0000 7fb9f2d9d700 1 --2- 172.21.15.103:0/3016238816 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9f4143ab0 0x7fb9f413e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:26.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.480+0000 7fb9f259c700 1 --2- 172.21.15.103:0/3016238816 >> v2:172.21.15.86:3300/0 conn(0x7fb9f40b3bd0 0x7fb9f413faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:26.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.480+0000 7fb9f1d9b700 1 -- 172.21.15.103:0/3016238816 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9f4143ab0 msgr2=0x7fb9f413e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:26.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.480+0000 7fb9f1d9b700 1 --2- 172.21.15.103:0/3016238816 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9f4143ab0 0x7fb9f413e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:26.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.480+0000 7fb9f1d9b700 1 -- 172.21.15.103:0/3016238816 >> v2:172.21.15.86:3300/0 conn(0x7fb9f40b3bd0 msgr2=0x7fb9f413faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:26.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.480+0000 7fb9f1d9b700 1 --2- 172.21.15.103:0/3016238816 >> v2:172.21.15.86:3300/0 conn(0x7fb9f40b3bd0 0x7fb9f413faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:26.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.480+0000 7fb9f1d9b700 1 -- 172.21.15.103:0/3016238816 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f4147170 con 0x7fb9f40b9140 2020-04-22T14:02:26.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.480+0000 7fb9f259c700 1 --2- 172.21.15.103:0/3016238816 >> v2:172.21.15.86:3300/0 conn(0x7fb9f40b3bd0 0x7fb9f413faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:02:26.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.480+0000 7fb9f2d9d700 1 --2- 172.21.15.103:0/3016238816 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9f4143ab0 0x7fb9f413e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:02:26.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.480+0000 7fb9f1d9b700 1 --2- 172.21.15.103:0/3016238816 >> v2:172.21.15.103:3300/0 conn(0x7fb9f40b9140 0x7fb9f4155710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb9e4002f30 tx=0x7fb9e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:26.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.480+0000 7fb9f1d9b700 1 --2- 172.21.15.103:0/3016238816 >> v2:172.21.15.103:3300/0 conn(0x7fb9f40b9140 0x7fb9f4155710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb9e4002f30 tx=0x7fb9e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:26.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.480+0000 7fb9f1d9b700 1 --2- 172.21.15.103:0/3016238816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9f40b9140 0x7fb9f4155710 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7fb9e4002f30 tx=0x7fb9e4007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:26.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.480+0000 7fb9f1d9b700 1 --2- 172.21.15.103:0/3016238816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9f40b9140 0x7fb9f4155710 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fb9e4002f30 tx=0x7fb9e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:26.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.480+0000 7fb9eb7fe700 1 -- 172.21.15.103:0/3016238816 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9e4007360 con 0x7fb9f40b9140 2020-04-22T14:02:26.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.480+0000 7fb9f1d9b700 1 --2- 172.21.15.103:0/3016238816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9f40b9140 0x7fb9f4155710 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fb9e4002f30 tx=0x7fb9e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:26.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.480+0000 7fb9f1d9b700 1 --2- 172.21.15.103:0/3016238816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9f40b9140 0x7fb9f4155710 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fb9e4002f30 tx=0x7fb9e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:26.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.480+0000 7fb9eb7fe700 1 -- 172.21.15.103:0/3016238816 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e40074c0 con 0x7fb9f40b9140 2020-04-22T14:02:26.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.480+0000 7fb9f89bc700 1 -- 172.21.15.103:0/3016238816 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f4147410 con 0x7fb9f40b9140 2020-04-22T14:02:26.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.480+0000 7fb9eb7fe700 1 -- 172.21.15.103:0/3016238816 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9e4007630 con 0x7fb9f40b9140 2020-04-22T14:02:26.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.480+0000 7fb9f89bc700 1 -- 172.21.15.103:0/3016238816 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f4147d90 con 0x7fb9f40b9140 2020-04-22T14:02:26.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.481+0000 7fb9f1d9b700 1 --2- 172.21.15.103:0/3016238816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9f40b9140 0x7fb9f4155710 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fb9e4002f30 tx=0x7fb9e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:26.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.481+0000 7fb9f1d9b700 1 --2- 172.21.15.103:0/3016238816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9f40b9140 0x7fb9f4155710 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fb9e4002f30 tx=0x7fb9e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:26.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.481+0000 7fb9eb7fe700 1 -- 172.21.15.103:0/3016238816 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fb9e40058b0 con 0x7fb9f40b9140 2020-04-22T14:02:26.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.481+0000 7fb9f89bc700 1 -- 172.21.15.103:0/3016238816 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9f4056c90 con 0x7fb9f40b9140 2020-04-22T14:02:26.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.482+0000 7fb9eb7fe700 1 --2- 172.21.15.103:0/3016238816 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb9d804da30 0x7fb9d804fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:26.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.482+0000 7fb9eb7fe700 1 -- 172.21.15.103:0/3016238816 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fb9e4061d50 con 0x7fb9f40b9140 2020-04-22T14:02:26.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.482+0000 7fb9f259c700 1 --2- 172.21.15.103:0/3016238816 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb9d804da30 0x7fb9d804fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:26.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.482+0000 7fb9f259c700 1 --2- 172.21.15.103:0/3016238816 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb9d804da30 0x7fb9d804fef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb9ec000f00 tx=0x7fb9ec001af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:26.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.482+0000 7fb9f259c700 1 --2- 172.21.15.103:0/3016238816 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb9d804da30 0x7fb9d804fef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb9ec000f00 tx=0x7fb9ec001af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:26.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.482+0000 7fb9f259c700 1 --2- 172.21.15.103:0/3016238816 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb9d804da30 0x7fb9d804fef0 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7fb9ec000f00 tx=0x7fb9ec001af0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:26.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.486+0000 7fb9f1d9b700 1 --2- 172.21.15.103:0/3016238816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9f40b9140 0x7fb9f4155710 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fb9e4002f30 tx=0x7fb9e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:26.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.486+0000 7fb9eb7fe700 1 -- 172.21.15.103:0/3016238816 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fb9e403d210 con 0x7fb9f40b9140 2020-04-22T14:02:26.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:26.629+0000 7fb9f89bc700 1 -- 172.21.15.103:0/3016238816 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fb9f406a960 con 0x7fb9f40b9140 2020-04-22T14:02:27.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.298+0000 7fb9f1d9b700 1 --2- 172.21.15.103:0/3016238816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9f40b9140 0x7fb9f4155710 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fb9e4002f30 tx=0x7fb9e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:27.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.298+0000 7fb9eb7fe700 1 -- 172.21.15.103:0/3016238816 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v22) v1 ==== 125+0+0 (secure 0 0 0) 0x7fb9e4040830 con 0x7fb9f40b9140 2020-04-22T14:02:27.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.307+0000 7fb9f89bc700 1 -- 172.21.15.103:0/3016238816 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb9d804da30 msgr2=0x7fb9d804fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:27.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.307+0000 7fb9f89bc700 1 --2- 172.21.15.103:0/3016238816 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb9d804da30 0x7fb9d804fef0 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7fb9ec000f00 tx=0x7fb9ec001af0).stop 2020-04-22T14:02:27.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.307+0000 7fb9f89bc700 1 -- 172.21.15.103:0/3016238816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9f40b9140 msgr2=0x7fb9f4155710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:27.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.307+0000 7fb9f89bc700 1 --2- 172.21.15.103:0/3016238816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9f40b9140 0x7fb9f4155710 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7fb9e4002f30 tx=0x7fb9e4007a40).stop 2020-04-22T14:02:27.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.307+0000 7fb9f89bc700 1 -- 172.21.15.103:0/3016238816 shutdown_connections 2020-04-22T14:02:27.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.307+0000 7fb9f89bc700 1 --2- 172.21.15.103:0/3016238816 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb9d804da30 0x7fb9d804fef0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:27.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.307+0000 7fb9f89bc700 1 --2- 172.21.15.103:0/3016238816 >> v2:172.21.15.86:3300/0 conn(0x7fb9f40b3bd0 0x7fb9f413faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:27.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.307+0000 7fb9f89bc700 1 --2- 172.21.15.103:0/3016238816 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9f4143ab0 0x7fb9f413e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:27.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.307+0000 7fb9f89bc700 1 --2- 172.21.15.103:0/3016238816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9f40b9140 0x7fb9f4155710 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:27.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.307+0000 7fb9f89bc700 1 -- 172.21.15.103:0/3016238816 >> 172.21.15.103:0/3016238816 conn(0x7fb9f405b7b0 msgr2=0x7fb9f4061670 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:27.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.307+0000 7fb9f89bc700 1 -- 172.21.15.103:0/3016238816 shutdown_connections 2020-04-22T14:02:27.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.307+0000 7fb9f89bc700 1 -- 172.21.15.103:0/3016238816 wait complete. 2020-04-22T14:02:27.311 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' created 2020-04-22T14:02:27.321 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:27.334 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-04-22T14:02:27.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.484+0000 7f7036f3c700 1 Processor -- start 2020-04-22T14:02:27.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.484+0000 7f7036f3c700 1 -- start start 2020-04-22T14:02:27.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.485+0000 7f7036f3c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70300b8e00 0x7f70300af010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:27.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.485+0000 7f7036f3c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f703005fed0 0x7f70300b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:27.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.485+0000 7f7036f3c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70300b29b0 con 0x7f70300b91e0 2020-04-22T14:02:27.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.485+0000 7f7036f3c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70300b4270 con 0x7f703005fed0 2020-04-22T14:02:27.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.485+0000 7f7036f3c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70300b4510 con 0x7f70300b8e00 2020-04-22T14:02:27.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.485+0000 7f7035739700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f70300b91e0 0x7f7030142f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39114/0 (socket says 172.21.15.103:39114) 2020-04-22T14:02:27.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.485+0000 7f7035739700 1 -- 172.21.15.103:0/2338012497 learned_addr learned my addr 172.21.15.103:0/2338012497 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:27.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.485+0000 7f7035f3a700 1 --2- 172.21.15.103:0/2338012497 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70300b8e00 0x7f70300af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:27.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.485+0000 7f703673b700 1 --2- 172.21.15.103:0/2338012497 >> v2:172.21.15.86:3300/0 conn(0x7f703005fed0 0x7f70300b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:27.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.485+0000 7f7034f38700 1 -- 172.21.15.103:0/2338012497 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2256592058 0 0) 0x7f70300b29b0 con 0x7f70300b91e0 2020-04-22T14:02:27.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.485+0000 7f7034f38700 1 -- 172.21.15.103:0/2338012497 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7018003230 con 0x7f70300b91e0 2020-04-22T14:02:27.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.486+0000 7f7035f3a700 1 -- 172.21.15.103:0/2338012497 >> v2:172.21.15.86:3300/0 conn(0x7f703005fed0 msgr2=0x7f70300b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:27.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.486+0000 7f7035f3a700 1 --2- 172.21.15.103:0/2338012497 >> v2:172.21.15.86:3300/0 conn(0x7f703005fed0 0x7f70300b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:27.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.486+0000 7f7035f3a700 1 -- 172.21.15.103:0/2338012497 >> v1:172.21.15.103:6789/0 conn(0x7f70300b91e0 legacy=0x7f7030142f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:27.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.486+0000 7f7035f3a700 1 -- 172.21.15.103:0/2338012497 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70300b2020 con 0x7f70300b8e00 2020-04-22T14:02:27.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.486+0000 7f7035f3a700 1 --2- 172.21.15.103:0/2338012497 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70300b8e00 0x7f70300af010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7020002f30 tx=0x7f7020007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:27.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.486+0000 7f7035f3a700 1 --2- 172.21.15.103:0/2338012497 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70300b8e00 0x7f70300af010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7020002f30 tx=0x7f7020007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:27.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.486+0000 7f7035f3a700 1 --2- 172.21.15.103:0/2338012497 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70300b8e00 0x7f70300af010 secure :-1 s=READY pgs=19 cs=0 l=1 rx=0x7f7020002f30 tx=0x7f7020007a40).ready entity=mon.2 client_cookie=dc30ac930e648dd7 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:27.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.486+0000 7f7035f3a700 1 --2- 172.21.15.103:0/2338012497 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70300b8e00 0x7f70300af010 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7f7020002f30 tx=0x7f7020007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:27.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.486+0000 7f7034f38700 1 -- 172.21.15.103:0/2338012497 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7020011310 con 0x7f70300b8e00 2020-04-22T14:02:27.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.486+0000 7f7035f3a700 1 --2- 172.21.15.103:0/2338012497 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70300b8e00 0x7f70300af010 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7f7020002f30 tx=0x7f7020007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:27.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.486+0000 7f7035f3a700 1 --2- 172.21.15.103:0/2338012497 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70300b8e00 0x7f70300af010 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7f7020002f30 tx=0x7f7020007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:27.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.486+0000 7f7034f38700 1 -- 172.21.15.103:0/2338012497 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70200114b0 con 0x7f70300b8e00 2020-04-22T14:02:27.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.486+0000 7f7034f38700 1 -- 172.21.15.103:0/2338012497 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70200118d0 con 0x7f70300b8e00 2020-04-22T14:02:27.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.486+0000 7f7036f3c700 1 -- 172.21.15.103:0/2338012497 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70300b8e00 msgr2=0x7f70300af010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:27.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.486+0000 7f7036f3c700 1 --2- 172.21.15.103:0/2338012497 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70300b8e00 0x7f70300af010 secure :-1 s=READY pgs=19 cs=0 l=1 rx=0x7f7020002f30 tx=0x7f7020007a40).stop 2020-04-22T14:02:27.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.486+0000 7f7036f3c700 1 -- 172.21.15.103:0/2338012497 shutdown_connections 2020-04-22T14:02:27.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.486+0000 7f7036f3c700 1 --2- 172.21.15.103:0/2338012497 >> v2:172.21.15.86:3300/0 conn(0x7f703005fed0 0x7f70300b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:27.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.486+0000 7f7036f3c700 1 --2- 172.21.15.103:0/2338012497 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70300b8e00 0x7f70300af010 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:27.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.486+0000 7f7036f3c700 1 -- 172.21.15.103:0/2338012497 >> 172.21.15.103:0/2338012497 conn(0x7f703005b780 msgr2=0x7f70300b8530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:27.518 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.486+0000 7f7036f3c700 1 -- 172.21.15.103:0/2338012497 shutdown_connections 2020-04-22T14:02:27.518 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.487+0000 7f7036f3c700 1 -- 172.21.15.103:0/2338012497 wait complete. 2020-04-22T14:02:27.519 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.487+0000 7f7036f3c700 1 Processor -- start 2020-04-22T14:02:27.519 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.487+0000 7f7036f3c700 1 -- start start 2020-04-22T14:02:27.519 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.488+0000 7f7036f3c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f703005fed0 0x7f70300668e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:27.519 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.488+0000 7f7036f3c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f70300b8e00 0x7f7030154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:27.519 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.488+0000 7f7036f3c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70300b91e0 0x7f7030143100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:27.519 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.488+0000 7f7036f3c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7030143560 con 0x7f70300b8e00 2020-04-22T14:02:27.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.488+0000 7f7036f3c700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70301554d0 con 0x7f703005fed0 2020-04-22T14:02:27.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.488+0000 7f7036f3c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7030155770 con 0x7f70300b91e0 2020-04-22T14:02:27.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.488+0000 7f7035f3a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f703005fed0 0x7f70300668e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:27.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.488+0000 7f7035f3a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f703005fed0 0x7f70300668e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46928/0 (socket says 172.21.15.103:46928) 2020-04-22T14:02:27.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.488+0000 7f7035f3a700 1 -- 172.21.15.103:0/2784695918 learned_addr learned my addr 172.21.15.103:0/2784695918 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:27.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.488+0000 7f703673b700 1 --2- 172.21.15.103:0/2784695918 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70300b91e0 0x7f7030143100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:27.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.488+0000 7f7035739700 1 --2- 172.21.15.103:0/2784695918 >> v2:172.21.15.86:3300/0 conn(0x7f70300b8e00 0x7f7030154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:27.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.488+0000 7f7035f3a700 1 -- 172.21.15.103:0/2784695918 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70300b91e0 msgr2=0x7f7030143100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:27.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.488+0000 7f7035f3a700 1 --2- 172.21.15.103:0/2784695918 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70300b91e0 0x7f7030143100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:27.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.488+0000 7f7035f3a700 1 -- 172.21.15.103:0/2784695918 >> v2:172.21.15.86:3300/0 conn(0x7f70300b8e00 msgr2=0x7f7030154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:27.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.488+0000 7f7035f3a700 1 --2- 172.21.15.103:0/2784695918 >> v2:172.21.15.86:3300/0 conn(0x7f70300b8e00 0x7f7030154ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:27.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.488+0000 7f7035f3a700 1 -- 172.21.15.103:0/2784695918 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7030155a10 con 0x7f703005fed0 2020-04-22T14:02:27.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.488+0000 7f703673b700 1 --2- 172.21.15.103:0/2784695918 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70300b91e0 0x7f7030143100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:02:27.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.488+0000 7f7035f3a700 1 --2- 172.21.15.103:0/2784695918 >> v2:172.21.15.103:3300/0 conn(0x7f703005fed0 0x7f70300668e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7020002f30 tx=0x7f7020007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:27.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.489+0000 7f7035f3a700 1 --2- 172.21.15.103:0/2784695918 >> v2:172.21.15.103:3300/0 conn(0x7f703005fed0 0x7f70300668e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7020002f30 tx=0x7f7020007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:27.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.489+0000 7f7035f3a700 1 --2- 172.21.15.103:0/2784695918 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f703005fed0 0x7f70300668e0 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7f7020002f30 tx=0x7f7020007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:27.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.489+0000 7f7035f3a700 1 --2- 172.21.15.103:0/2784695918 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f703005fed0 0x7f70300668e0 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f7020002f30 tx=0x7f7020007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:27.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.489+0000 7f701effd700 1 -- 172.21.15.103:0/2784695918 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7020007170 con 0x7f703005fed0 2020-04-22T14:02:27.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.489+0000 7f7035f3a700 1 --2- 172.21.15.103:0/2784695918 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f703005fed0 0x7f70300668e0 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f7020002f30 tx=0x7f7020007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:27.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.489+0000 7f7035f3a700 1 --2- 172.21.15.103:0/2784695918 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f703005fed0 0x7f70300668e0 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f7020002f30 tx=0x7f7020007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:27.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.489+0000 7f701effd700 1 -- 172.21.15.103:0/2784695918 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70200072d0 con 0x7f703005fed0 2020-04-22T14:02:27.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.489+0000 7f701effd700 1 -- 172.21.15.103:0/2784695918 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7020007500 con 0x7f703005fed0 2020-04-22T14:02:27.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.489+0000 7f7036f3c700 1 -- 172.21.15.103:0/2784695918 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7030133880 con 0x7f703005fed0 2020-04-22T14:02:27.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.489+0000 7f7036f3c700 1 -- 172.21.15.103:0/2784695918 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7030133dd0 con 0x7f703005fed0 2020-04-22T14:02:27.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.489+0000 7f7035f3a700 1 --2- 172.21.15.103:0/2784695918 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f703005fed0 0x7f70300668e0 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f7020002f30 tx=0x7f7020007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:27.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.490+0000 7f701effd700 1 -- 172.21.15.103:0/2784695918 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f70200058b0 con 0x7f703005fed0 2020-04-22T14:02:27.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.490+0000 7f7035f3a700 1 --2- 172.21.15.103:0/2784695918 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f703005fed0 0x7f70300668e0 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f7020002f30 tx=0x7f7020007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:27.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.490+0000 7f7036f3c700 1 -- 172.21.15.103:0/2784695918 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7030155300 con 0x7f703005fed0 2020-04-22T14:02:27.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.490+0000 7f701effd700 1 --2- 172.21.15.103:0/2784695918 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f701004da70 0x7f701004ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:27.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.490+0000 7f701effd700 1 -- 172.21.15.103:0/2784695918 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f7020062030 con 0x7f703005fed0 2020-04-22T14:02:27.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.490+0000 7f7035739700 1 --2- 172.21.15.103:0/2784695918 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f701004da70 0x7f701004ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:27.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.490+0000 7f7035739700 1 --2- 172.21.15.103:0/2784695918 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f701004da70 0x7f701004ff30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f702c0010d0 tx=0x7f702c001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:27.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.491+0000 7f7035739700 1 --2- 172.21.15.103:0/2784695918 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f701004da70 0x7f701004ff30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f702c0010d0 tx=0x7f702c001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:27.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.491+0000 7f7035739700 1 --2- 172.21.15.103:0/2784695918 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f701004da70 0x7f701004ff30 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f702c0010d0 tx=0x7f702c001820).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:27.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.494+0000 7f7035f3a700 1 --2- 172.21.15.103:0/2784695918 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f703005fed0 0x7f70300668e0 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f7020002f30 tx=0x7f7020007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:27.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.494+0000 7f701effd700 1 -- 172.21.15.103:0/2784695918 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f702003d530 con 0x7f703005fed0 2020-04-22T14:02:27.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.684+0000 7f7036f3c700 1 -- 172.21.15.103:0/2784695918 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f7030056c90 con 0x7f703005fed0 2020-04-22T14:02:27.687 INFO:tasks.ceph.mon.b.smithi086.stderr:2020-04-22T14:02:27.685+0000 7fbdbd07b700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-04-22T14:02:27.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.691+0000 7f7035f3a700 1 --2- 172.21.15.103:0/2784695918 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f703005fed0 0x7f70300668e0 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f7020002f30 tx=0x7f7020007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:27.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.691+0000 7f701effd700 1 -- 172.21.15.103:0/2784695918 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 3 and data pool 4 v2) v1 ==== 187+0+0 (secure 0 0 0) 0x7f7020040b50 con 0x7f703005fed0 2020-04-22T14:02:27.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.693+0000 7f7036f3c700 1 -- 172.21.15.103:0/2784695918 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f701004da70 msgr2=0x7f701004ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:27.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.693+0000 7f7036f3c700 1 --2- 172.21.15.103:0/2784695918 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f701004da70 0x7f701004ff30 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f702c0010d0 tx=0x7f702c001820).stop 2020-04-22T14:02:27.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.693+0000 7f7036f3c700 1 -- 172.21.15.103:0/2784695918 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f703005fed0 msgr2=0x7f70300668e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:27.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.694+0000 7f7036f3c700 1 --2- 172.21.15.103:0/2784695918 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f703005fed0 0x7f70300668e0 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7f7020002f30 tx=0x7f7020007a40).stop 2020-04-22T14:02:27.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.694+0000 7f7036f3c700 1 -- 172.21.15.103:0/2784695918 shutdown_connections 2020-04-22T14:02:27.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.694+0000 7f7036f3c700 1 --2- 172.21.15.103:0/2784695918 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70300b91e0 0x7f7030143100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:27.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.694+0000 7f7036f3c700 1 --2- 172.21.15.103:0/2784695918 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f703005fed0 0x7f70300668e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:27.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.694+0000 7f7036f3c700 1 --2- 172.21.15.103:0/2784695918 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f701004da70 0x7f701004ff30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:27.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.694+0000 7f7036f3c700 1 --2- 172.21.15.103:0/2784695918 >> v2:172.21.15.86:3300/0 conn(0x7f70300b8e00 0x7f7030154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:27.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.694+0000 7f7036f3c700 1 -- 172.21.15.103:0/2784695918 >> 172.21.15.103:0/2784695918 conn(0x7f703005b780 msgr2=0x7f70300b76d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:27.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.694+0000 7f7036f3c700 1 -- 172.21.15.103:0/2784695918 shutdown_connections 2020-04-22T14:02:27.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.694+0000 7f7036f3c700 1 -- 172.21.15.103:0/2784695918 wait complete. 2020-04-22T14:02:27.698 INFO:teuthology.orchestra.run.smithi103.stderr:new fs with metadata pool 3 and data pool 4 2020-04-22T14:02:27.708 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:27.721 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:02:27.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.866+0000 7f2a8f8e2700 1 Processor -- start 2020-04-22T14:02:27.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.866+0000 7f2a8f8e2700 1 -- start start 2020-04-22T14:02:27.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.867+0000 7f2a8f8e2700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2a88145960 0x7f2a88145dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:27.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.867+0000 7f2a8f8e2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2a88064fd0 0x7f2a88065460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:27.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.867+0000 7f2a8f8e2700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a880b79f0 con 0x7f2a880b0ed0 2020-04-22T14:02:27.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.867+0000 7f2a8f8e2700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a880b77f0 con 0x7f2a88064fd0 2020-04-22T14:02:27.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.867+0000 7f2a8f8e2700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a880b7c90 con 0x7f2a88145960 2020-04-22T14:02:27.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.867+0000 7f2a8de7f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2a88064fd0 0x7f2a88065460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:27.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.867+0000 7f2a8d67e700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f2a880b0ed0 0x7f2a880b70e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39126/0 (socket says 172.21.15.103:39126) 2020-04-22T14:02:27.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.867+0000 7f2a8d67e700 1 -- 172.21.15.103:0/3962600767 learned_addr learned my addr 172.21.15.103:0/3962600767 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:27.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.867+0000 7f2a8ce7d700 1 --2- 172.21.15.103:0/3962600767 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2a88145960 0x7f2a88145dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:27.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.868+0000 7f2a8de7f700 1 -- 172.21.15.103:0/3962600767 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2a88145960 msgr2=0x7f2a88145dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:27.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.868+0000 7f2a8de7f700 1 --2- 172.21.15.103:0/3962600767 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2a88145960 0x7f2a88145dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:27.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.868+0000 7f2a8de7f700 1 -- 172.21.15.103:0/3962600767 >> v1:172.21.15.103:6789/0 conn(0x7f2a880b0ed0 legacy=0x7f2a880b70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:27.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.868+0000 7f2a7bfff700 1 -- 172.21.15.103:0/3962600767 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3000114386 0 0) 0x7f2a880b79f0 con 0x7f2a880b0ed0 2020-04-22T14:02:27.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.868+0000 7f2a8de7f700 1 -- 172.21.15.103:0/3962600767 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a880b7f30 con 0x7f2a88064fd0 2020-04-22T14:02:27.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.868+0000 7f2a8de7f700 1 --2- 172.21.15.103:0/3962600767 >> v2:172.21.15.103:3300/0 conn(0x7f2a88064fd0 0x7f2a88065460 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2a800032b0 tx=0x7f2a80007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:27.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.868+0000 7f2a8de7f700 1 --2- 172.21.15.103:0/3962600767 >> v2:172.21.15.103:3300/0 conn(0x7f2a88064fd0 0x7f2a88065460 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2a800032b0 tx=0x7f2a80007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:27.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.868+0000 7f2a8de7f700 1 --2- 172.21.15.103:0/3962600767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a88064fd0 0x7f2a88065460 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7f2a800032b0 tx=0x7f2a80007dc0).ready entity=mon.1 client_cookie=e9b00ca0a35e906 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:27.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.868+0000 7f2a8de7f700 1 --2- 172.21.15.103:0/3962600767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a88064fd0 0x7f2a88065460 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f2a800032b0 tx=0x7f2a80007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:27.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.868+0000 7f2a7bfff700 1 -- 172.21.15.103:0/3962600767 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a8000a180 con 0x7f2a88064fd0 2020-04-22T14:02:27.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.868+0000 7f2a8de7f700 1 --2- 172.21.15.103:0/3962600767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a88064fd0 0x7f2a88065460 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f2a800032b0 tx=0x7f2a80007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:27.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.868+0000 7f2a7bfff700 1 -- 172.21.15.103:0/3962600767 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a8000a320 con 0x7f2a88064fd0 2020-04-22T14:02:27.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.868+0000 7f2a8de7f700 1 --2- 172.21.15.103:0/3962600767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a88064fd0 0x7f2a88065460 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f2a800032b0 tx=0x7f2a80007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:27.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.868+0000 7f2a7bfff700 1 -- 172.21.15.103:0/3962600767 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a8000a700 con 0x7f2a88064fd0 2020-04-22T14:02:27.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.868+0000 7f2a8f8e2700 1 -- 172.21.15.103:0/3962600767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a88064fd0 msgr2=0x7f2a88065460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:27.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.868+0000 7f2a8f8e2700 1 --2- 172.21.15.103:0/3962600767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a88064fd0 0x7f2a88065460 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7f2a800032b0 tx=0x7f2a80007dc0).stop 2020-04-22T14:02:27.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.868+0000 7f2a8f8e2700 1 -- 172.21.15.103:0/3962600767 shutdown_connections 2020-04-22T14:02:27.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.868+0000 7f2a8f8e2700 1 --2- 172.21.15.103:0/3962600767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a88064fd0 0x7f2a88065460 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:27.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.868+0000 7f2a8f8e2700 1 --2- 172.21.15.103:0/3962600767 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2a88145960 0x7f2a88145dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:27.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.868+0000 7f2a8f8e2700 1 -- 172.21.15.103:0/3962600767 >> 172.21.15.103:0/3962600767 conn(0x7f2a8805f2c0 msgr2=0x7f2a88061fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:27.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.868+0000 7f2a8f8e2700 1 -- 172.21.15.103:0/3962600767 shutdown_connections 2020-04-22T14:02:27.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.868+0000 7f2a8f8e2700 1 -- 172.21.15.103:0/3962600767 wait complete. 2020-04-22T14:02:27.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.869+0000 7f2a8f8e2700 1 Processor -- start 2020-04-22T14:02:27.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.869+0000 7f2a8f8e2700 1 -- start start 2020-04-22T14:02:27.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.870+0000 7f2a8f8e2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2a88064fd0 0x7f2a880b3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:27.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.870+0000 7f2a8f8e2700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2a88145960 0x7f2a880b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:27.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.870+0000 7f2a8f8e2700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a880b1e60 con 0x7f2a880b0ed0 2020-04-22T14:02:27.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.870+0000 7f2a8f8e2700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a880b49f0 con 0x7f2a88145960 2020-04-22T14:02:27.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.870+0000 7f2a8f8e2700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a881491b0 con 0x7f2a88064fd0 2020-04-22T14:02:27.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.870+0000 7f2a8d67e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2a88064fd0 0x7f2a880b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:27.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.870+0000 7f2a8d67e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2a88064fd0 0x7f2a880b3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46942/0 (socket says 172.21.15.103:46942) 2020-04-22T14:02:27.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.870+0000 7f2a8d67e700 1 -- 172.21.15.103:0/4177373155 learned_addr learned my addr 172.21.15.103:0/4177373155 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:27.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.870+0000 7f2a8d67e700 1 -- 172.21.15.103:0/4177373155 >> v2:172.21.15.86:3300/0 conn(0x7f2a88145960 msgr2=0x7f2a880b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:27.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.870+0000 7f2a8d67e700 1 --2- 172.21.15.103:0/4177373155 >> v2:172.21.15.86:3300/0 conn(0x7f2a88145960 0x7f2a880b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:27.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.870+0000 7f2a8d67e700 1 -- 172.21.15.103:0/4177373155 >> v1:172.21.15.86:6789/0 conn(0x7f2a880b0ed0 legacy=0x7f2a88145dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:27.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.870+0000 7f2a8d67e700 1 -- 172.21.15.103:0/4177373155 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a88149450 con 0x7f2a88064fd0 2020-04-22T14:02:27.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.870+0000 7f2a8d67e700 1 --2- 172.21.15.103:0/4177373155 >> v2:172.21.15.103:3300/0 conn(0x7f2a88064fd0 0x7f2a880b3630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2a880b25d0 tx=0x7f2a7c010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:27.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.871+0000 7f2a8d67e700 1 --2- 172.21.15.103:0/4177373155 >> v2:172.21.15.103:3300/0 conn(0x7f2a88064fd0 0x7f2a880b3630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2a880b25d0 tx=0x7f2a7c010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:27.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.871+0000 7f2a8d67e700 1 --2- 172.21.15.103:0/4177373155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a88064fd0 0x7f2a880b3630 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7f2a880b25d0 tx=0x7f2a7c010a10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:27.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.871+0000 7f2a8d67e700 1 --2- 172.21.15.103:0/4177373155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a88064fd0 0x7f2a880b3630 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f2a880b25d0 tx=0x7f2a7c010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:27.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.871+0000 7f2a7a7fc700 1 -- 172.21.15.103:0/4177373155 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a7c005a40 con 0x7f2a88064fd0 2020-04-22T14:02:27.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.871+0000 7f2a8d67e700 1 --2- 172.21.15.103:0/4177373155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a88064fd0 0x7f2a880b3630 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f2a880b25d0 tx=0x7f2a7c010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:27.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.871+0000 7f2a8d67e700 1 --2- 172.21.15.103:0/4177373155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a88064fd0 0x7f2a880b3630 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f2a880b25d0 tx=0x7f2a7c010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:27.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.871+0000 7f2a7a7fc700 1 -- 172.21.15.103:0/4177373155 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7c005ba0 con 0x7f2a88064fd0 2020-04-22T14:02:27.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.871+0000 7f2a8f8e2700 1 -- 172.21.15.103:0/4177373155 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a881464d0 con 0x7f2a88064fd0 2020-04-22T14:02:27.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.871+0000 7f2a7a7fc700 1 -- 172.21.15.103:0/4177373155 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a7c0047f0 con 0x7f2a88064fd0 2020-04-22T14:02:27.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.871+0000 7f2a8f8e2700 1 -- 172.21.15.103:0/4177373155 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a880b4520 con 0x7f2a88064fd0 2020-04-22T14:02:27.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.871+0000 7f2a8d67e700 1 --2- 172.21.15.103:0/4177373155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a88064fd0 0x7f2a880b3630 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f2a880b25d0 tx=0x7f2a7c010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:27.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.872+0000 7f2a7a7fc700 1 -- 172.21.15.103:0/4177373155 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f2a7c004a60 con 0x7f2a88064fd0 2020-04-22T14:02:27.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.872+0000 7f2a8d67e700 1 --2- 172.21.15.103:0/4177373155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a88064fd0 0x7f2a880b3630 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f2a880b25d0 tx=0x7f2a7c010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:27.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.872+0000 7f2a8f8e2700 1 -- 172.21.15.103:0/4177373155 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a880b4830 con 0x7f2a88064fd0 2020-04-22T14:02:27.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.872+0000 7f2a7a7fc700 1 --2- 172.21.15.103:0/4177373155 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2a6804da20 0x7f2a6804fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:27.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.872+0000 7f2a7a7fc700 1 -- 172.21.15.103:0/4177373155 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2a7c00a0b0 con 0x7f2a88064fd0 2020-04-22T14:02:27.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.872+0000 7f2a8ce7d700 1 --2- 172.21.15.103:0/4177373155 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2a6804da20 0x7f2a6804fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:27.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.872+0000 7f2a8ce7d700 1 --2- 172.21.15.103:0/4177373155 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2a6804da20 0x7f2a6804fee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2a84002f30 tx=0x7f2a84008d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:27.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.873+0000 7f2a8ce7d700 1 --2- 172.21.15.103:0/4177373155 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2a6804da20 0x7f2a6804fee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2a84002f30 tx=0x7f2a84008d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:27.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.873+0000 7f2a8ce7d700 1 --2- 172.21.15.103:0/4177373155 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2a6804da20 0x7f2a6804fee0 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7f2a84002f30 tx=0x7f2a84008d00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:27.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.876+0000 7f2a8d67e700 1 --2- 172.21.15.103:0/4177373155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a88064fd0 0x7f2a880b3630 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f2a880b25d0 tx=0x7f2a7c010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:27.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:27.876+0000 7f2a7a7fc700 1 -- 172.21.15.103:0/4177373155 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f2a7c03c3e0 con 0x7f2a88064fd0 2020-04-22T14:02:28.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.018+0000 7f2a8f8e2700 1 -- 172.21.15.103:0/4177373155 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a880b1e60 con 0x7f2a88064fd0 2020-04-22T14:02:28.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.019+0000 7f2a8d67e700 1 --2- 172.21.15.103:0/4177373155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a88064fd0 0x7f2a880b3630 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f2a880b25d0 tx=0x7f2a7c010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:28.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.019+0000 7f2a7a7fc700 1 -- 172.21.15.103:0/4177373155 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16102 (secure 0 0 0) 0x7f2a880b1e60 con 0x7f2a88064fd0 2020-04-22T14:02:28.022 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:02:28.022 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":23,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:02:27.685758+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:02:25.963043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-22T14:02:26.642611+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:02:28.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.020+0000 7f2a8f8e2700 1 -- 172.21.15.103:0/4177373155 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2a6804da20 msgr2=0x7f2a6804fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:28.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.020+0000 7f2a8f8e2700 1 --2- 172.21.15.103:0/4177373155 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2a6804da20 0x7f2a6804fee0 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7f2a84002f30 tx=0x7f2a84008d00).stop 2020-04-22T14:02:28.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.020+0000 7f2a8f8e2700 1 -- 172.21.15.103:0/4177373155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a88064fd0 msgr2=0x7f2a880b3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:28.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.020+0000 7f2a8f8e2700 1 --2- 172.21.15.103:0/4177373155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a88064fd0 0x7f2a880b3630 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7f2a880b25d0 tx=0x7f2a7c010a10).stop 2020-04-22T14:02:28.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.020+0000 7f2a8f8e2700 1 -- 172.21.15.103:0/4177373155 shutdown_connections 2020-04-22T14:02:28.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.020+0000 7f2a8f8e2700 1 --2- 172.21.15.103:0/4177373155 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2a6804da20 0x7f2a6804fee0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:28.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.020+0000 7f2a8f8e2700 1 --2- 172.21.15.103:0/4177373155 >> v2:172.21.15.86:3300/0 conn(0x7f2a88145960 0x7f2a880b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:28.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.020+0000 7f2a8f8e2700 1 --2- 172.21.15.103:0/4177373155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a88064fd0 0x7f2a880b3630 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:28.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.020+0000 7f2a8f8e2700 1 -- 172.21.15.103:0/4177373155 >> 172.21.15.103:0/4177373155 conn(0x7f2a8805f2c0 msgr2=0x7f2a880b4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:28.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.020+0000 7f2a8f8e2700 1 -- 172.21.15.103:0/4177373155 shutdown_connections 2020-04-22T14:02:28.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.020+0000 7f2a8f8e2700 1 -- 172.21.15.103:0/4177373155 wait complete. 2020-04-22T14:02:28.034 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:28.047 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:02:28.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.191+0000 7f7b3185a700 1 Processor -- start 2020-04-22T14:02:28.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.191+0000 7f7b3185a700 1 -- start start 2020-04-22T14:02:28.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.192+0000 7f7b3185a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7b2c065fe0 0x7f7b2c1464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:28.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.192+0000 7f7b3185a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7b2c063e30 0x7f7b2c0642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:28.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.192+0000 7f7b3185a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b2c143300 con 0x7f7b2c12c0d0 2020-04-22T14:02:28.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.192+0000 7f7b3185a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b2c1435a0 con 0x7f7b2c065fe0 2020-04-22T14:02:28.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.192+0000 7f7b3185a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b2c143840 con 0x7f7b2c063e30 2020-04-22T14:02:28.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.192+0000 7f7b2b7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7b2c063e30 0x7f7b2c0642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:28.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.193+0000 7f7b2b7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7b2c063e30 0x7f7b2c0642c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46950/0 (socket says 172.21.15.103:46950) 2020-04-22T14:02:28.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.193+0000 7f7b2b7fe700 1 -- 172.21.15.103:0/1782525239 learned_addr learned my addr 172.21.15.103:0/1782525239 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:28.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.193+0000 7f7b2a7fc700 1 --2- 172.21.15.103:0/1782525239 >> v2:172.21.15.86:3300/0 conn(0x7f7b2c065fe0 0x7f7b2c1464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:28.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.193+0000 7f7b2b7fe700 1 -- 172.21.15.103:0/1782525239 >> v2:172.21.15.86:3300/0 conn(0x7f7b2c065fe0 msgr2=0x7f7b2c1464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:28.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.193+0000 7f7b2b7fe700 1 --2- 172.21.15.103:0/1782525239 >> v2:172.21.15.86:3300/0 conn(0x7f7b2c065fe0 0x7f7b2c1464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:28.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.193+0000 7f7b2b7fe700 1 -- 172.21.15.103:0/1782525239 >> v1:172.21.15.86:6789/0 conn(0x7f7b2c12c0d0 legacy=0x7f7b2c05b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:28.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.193+0000 7f7b2b7fe700 1 -- 172.21.15.103:0/1782525239 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b2c05bb50 con 0x7f7b2c063e30 2020-04-22T14:02:28.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.193+0000 7f7b2b7fe700 1 --2- 172.21.15.103:0/1782525239 >> v2:172.21.15.103:3300/0 conn(0x7f7b2c063e30 0x7f7b2c0642c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7b2c0669a0 tx=0x7f7b24007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:28.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.193+0000 7f7b2b7fe700 1 --2- 172.21.15.103:0/1782525239 >> v2:172.21.15.103:3300/0 conn(0x7f7b2c063e30 0x7f7b2c0642c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7b2c0669a0 tx=0x7f7b24007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:28.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.193+0000 7f7b2b7fe700 1 --2- 172.21.15.103:0/1782525239 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b2c063e30 0x7f7b2c0642c0 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f7b2c0669a0 tx=0x7f7b24007dc0).ready entity=mon.1 client_cookie=861f4cd1c95dbe2d server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:28.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.193+0000 7f7b2b7fe700 1 --2- 172.21.15.103:0/1782525239 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b2c063e30 0x7f7b2c0642c0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f7b2c0669a0 tx=0x7f7b24007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:28.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.193+0000 7f7b29ffb700 1 -- 172.21.15.103:0/1782525239 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b2400a180 con 0x7f7b2c063e30 2020-04-22T14:02:28.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.193+0000 7f7b2b7fe700 1 --2- 172.21.15.103:0/1782525239 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b2c063e30 0x7f7b2c0642c0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f7b2c0669a0 tx=0x7f7b24007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:28.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.193+0000 7f7b2b7fe700 1 --2- 172.21.15.103:0/1782525239 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b2c063e30 0x7f7b2c0642c0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f7b2c0669a0 tx=0x7f7b24007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:28.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.193+0000 7f7b29ffb700 1 -- 172.21.15.103:0/1782525239 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2400a2e0 con 0x7f7b2c063e30 2020-04-22T14:02:28.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.193+0000 7f7b29ffb700 1 -- 172.21.15.103:0/1782525239 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b2400a6c0 con 0x7f7b2c063e30 2020-04-22T14:02:28.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.193+0000 7f7b3185a700 1 -- 172.21.15.103:0/1782525239 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b2c063e30 msgr2=0x7f7b2c0642c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:28.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.193+0000 7f7b3185a700 1 --2- 172.21.15.103:0/1782525239 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b2c063e30 0x7f7b2c0642c0 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f7b2c0669a0 tx=0x7f7b24007dc0).stop 2020-04-22T14:02:28.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.194+0000 7f7b3185a700 1 -- 172.21.15.103:0/1782525239 shutdown_connections 2020-04-22T14:02:28.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.194+0000 7f7b3185a700 1 --2- 172.21.15.103:0/1782525239 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b2c063e30 0x7f7b2c0642c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:28.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.194+0000 7f7b3185a700 1 --2- 172.21.15.103:0/1782525239 >> v2:172.21.15.86:3300/0 conn(0x7f7b2c065fe0 0x7f7b2c1464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:28.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.194+0000 7f7b3185a700 1 -- 172.21.15.103:0/1782525239 >> 172.21.15.103:0/1782525239 conn(0x7f7b2c0b9160 msgr2=0x7f7b2c05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:28.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.194+0000 7f7b3185a700 1 -- 172.21.15.103:0/1782525239 shutdown_connections 2020-04-22T14:02:28.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.194+0000 7f7b3185a700 1 -- 172.21.15.103:0/1782525239 wait complete. 2020-04-22T14:02:28.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.195+0000 7f7b3185a700 1 Processor -- start 2020-04-22T14:02:28.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.195+0000 7f7b3185a700 1 -- start start 2020-04-22T14:02:28.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.195+0000 7f7b3185a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b2c063e30 0x7f7b2c129da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:28.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.195+0000 7f7b3185a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7b2c065fe0 0x7f7b2c0b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:28.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.195+0000 7f7b3185a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7b2c12c0d0 0x7f7b2c127ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:28.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.195+0000 7f7b3185a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b2c11ad50 con 0x7f7b2c12c0d0 2020-04-22T14:02:28.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.195+0000 7f7b3185a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b2c11aff0 con 0x7f7b2c065fe0 2020-04-22T14:02:28.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.195+0000 7f7b3185a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2c11b290 con 0x7f7b2c063e30 2020-04-22T14:02:28.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.195+0000 7f7b2a7fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7b2c065fe0 0x7f7b2c0b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:28.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.195+0000 7f7b2a7fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7b2c065fe0 0x7f7b2c0b1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46956/0 (socket says 172.21.15.103:46956) 2020-04-22T14:02:28.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.195+0000 7f7b2a7fc700 1 -- 172.21.15.103:0/4202408814 learned_addr learned my addr 172.21.15.103:0/4202408814 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:28.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.196+0000 7f7b2affd700 1 --2- 172.21.15.103:0/4202408814 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b2c063e30 0x7f7b2c129da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:28.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.196+0000 7f7b2b7fe700 1 --2- 172.21.15.103:0/4202408814 >> v2:172.21.15.86:3300/0 conn(0x7f7b2c12c0d0 0x7f7b2c127ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:28.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.196+0000 7f7b2a7fc700 1 -- 172.21.15.103:0/4202408814 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b2c063e30 msgr2=0x7f7b2c129da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:28.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.196+0000 7f7b2a7fc700 1 --2- 172.21.15.103:0/4202408814 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b2c063e30 0x7f7b2c129da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:28.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.196+0000 7f7b2a7fc700 1 -- 172.21.15.103:0/4202408814 >> v2:172.21.15.86:3300/0 conn(0x7f7b2c12c0d0 msgr2=0x7f7b2c127ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:28.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.196+0000 7f7b2a7fc700 1 --2- 172.21.15.103:0/4202408814 >> v2:172.21.15.86:3300/0 conn(0x7f7b2c12c0d0 0x7f7b2c127ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:28.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.196+0000 7f7b2a7fc700 1 -- 172.21.15.103:0/4202408814 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b2c11a9d0 con 0x7f7b2c065fe0 2020-04-22T14:02:28.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.196+0000 7f7b2affd700 1 --2- 172.21.15.103:0/4202408814 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b2c063e30 0x7f7b2c129da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:02:28.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.196+0000 7f7b2b7fe700 1 --2- 172.21.15.103:0/4202408814 >> v2:172.21.15.86:3300/0 conn(0x7f7b2c12c0d0 0x7f7b2c127ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:02:28.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.196+0000 7f7b2a7fc700 1 --2- 172.21.15.103:0/4202408814 >> v2:172.21.15.103:3300/0 conn(0x7f7b2c065fe0 0x7f7b2c0b1d50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7b2c12a440 tx=0x7f7b1c010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:28.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.196+0000 7f7b2a7fc700 1 --2- 172.21.15.103:0/4202408814 >> v2:172.21.15.103:3300/0 conn(0x7f7b2c065fe0 0x7f7b2c0b1d50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7b2c12a440 tx=0x7f7b1c010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:28.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.196+0000 7f7b2a7fc700 1 --2- 172.21.15.103:0/4202408814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b2c065fe0 0x7f7b2c0b1d50 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7f7b2c12a440 tx=0x7f7b1c010ae0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:28.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.196+0000 7f7b2a7fc700 1 --2- 172.21.15.103:0/4202408814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b2c065fe0 0x7f7b2c0b1d50 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f7b2c12a440 tx=0x7f7b1c010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:28.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.196+0000 7f7b1bfff700 1 -- 172.21.15.103:0/4202408814 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b1c00a370 con 0x7f7b2c065fe0 2020-04-22T14:02:28.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.196+0000 7f7b2a7fc700 1 --2- 172.21.15.103:0/4202408814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b2c065fe0 0x7f7b2c0b1d50 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f7b2c12a440 tx=0x7f7b1c010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:28.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.196+0000 7f7b2a7fc700 1 --2- 172.21.15.103:0/4202408814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b2c065fe0 0x7f7b2c0b1d50 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f7b2c12a440 tx=0x7f7b1c010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:28.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.196+0000 7f7b1bfff700 1 -- 172.21.15.103:0/4202408814 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b1c013070 con 0x7f7b2c065fe0 2020-04-22T14:02:28.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.196+0000 7f7b3185a700 1 -- 172.21.15.103:0/4202408814 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b2c0b21b0 con 0x7f7b2c065fe0 2020-04-22T14:02:28.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.196+0000 7f7b1bfff700 1 -- 172.21.15.103:0/4202408814 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b1c00a700 con 0x7f7b2c065fe0 2020-04-22T14:02:28.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.196+0000 7f7b3185a700 1 -- 172.21.15.103:0/4202408814 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b2c1284f0 con 0x7f7b2c065fe0 2020-04-22T14:02:28.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.197+0000 7f7b2a7fc700 1 --2- 172.21.15.103:0/4202408814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b2c065fe0 0x7f7b2c0b1d50 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f7b2c12a440 tx=0x7f7b1c010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:28.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.197+0000 7f7b1bfff700 1 -- 172.21.15.103:0/4202408814 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f7b1c00a940 con 0x7f7b2c065fe0 2020-04-22T14:02:28.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.197+0000 7f7b2a7fc700 1 --2- 172.21.15.103:0/4202408814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b2c065fe0 0x7f7b2c0b1d50 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f7b2c12a440 tx=0x7f7b1c010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:28.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.197+0000 7f7b3185a700 1 -- 172.21.15.103:0/4202408814 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b2c056c90 con 0x7f7b2c065fe0 2020-04-22T14:02:28.214 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.197+0000 7f7b1bfff700 1 --2- 172.21.15.103:0/4202408814 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7b0804da20 0x7f7b0804fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:28.214 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.197+0000 7f7b1bfff700 1 -- 172.21.15.103:0/4202408814 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7b1c0615d0 con 0x7f7b2c065fe0 2020-04-22T14:02:28.214 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.197+0000 7f7b2affd700 1 --2- 172.21.15.103:0/4202408814 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7b0804da20 0x7f7b0804fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:28.214 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.198+0000 7f7b2affd700 1 --2- 172.21.15.103:0/4202408814 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7b0804da20 0x7f7b0804fee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7b20002f40 tx=0x7f7b20007c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:28.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.198+0000 7f7b2affd700 1 --2- 172.21.15.103:0/4202408814 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7b0804da20 0x7f7b0804fee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7b20002f40 tx=0x7f7b20007c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:28.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.198+0000 7f7b2affd700 1 --2- 172.21.15.103:0/4202408814 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7b0804da20 0x7f7b0804fee0 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7f7b20002f40 tx=0x7f7b20007c00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:28.216 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.201+0000 7f7b2a7fc700 1 --2- 172.21.15.103:0/4202408814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b2c065fe0 0x7f7b2c0b1d50 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f7b2c12a440 tx=0x7f7b1c010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:28.216 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.201+0000 7f7b1bfff700 1 -- 172.21.15.103:0/4202408814 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f7b1c03c9b0 con 0x7f7b2c065fe0 2020-04-22T14:02:28.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.345+0000 7f7b3185a700 1 -- 172.21.15.103:0/4202408814 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b2c11ab60 con 0x7f7b2c065fe0 2020-04-22T14:02:28.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.345+0000 7f7b2a7fc700 1 --2- 172.21.15.103:0/4202408814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b2c065fe0 0x7f7b2c0b1d50 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f7b2c12a440 tx=0x7f7b1c010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:28.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.345+0000 7f7b1bfff700 1 -- 172.21.15.103:0/4202408814 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16102 (secure 0 0 0) 0x7f7b1c03ffd0 con 0x7f7b2c065fe0 2020-04-22T14:02:28.348 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:02:28.348 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":23,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:02:27.685758+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:02:25.963043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-22T14:02:26.642611+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:02:28.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.347+0000 7f7b3185a700 1 -- 172.21.15.103:0/4202408814 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7b0804da20 msgr2=0x7f7b0804fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:28.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.347+0000 7f7b3185a700 1 --2- 172.21.15.103:0/4202408814 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7b0804da20 0x7f7b0804fee0 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7f7b20002f40 tx=0x7f7b20007c00).stop 2020-04-22T14:02:28.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.347+0000 7f7b3185a700 1 -- 172.21.15.103:0/4202408814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b2c065fe0 msgr2=0x7f7b2c0b1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:28.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.347+0000 7f7b3185a700 1 --2- 172.21.15.103:0/4202408814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b2c065fe0 0x7f7b2c0b1d50 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7f7b2c12a440 tx=0x7f7b1c010ae0).stop 2020-04-22T14:02:28.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.347+0000 7f7b3185a700 1 -- 172.21.15.103:0/4202408814 shutdown_connections 2020-04-22T14:02:28.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.347+0000 7f7b3185a700 1 --2- 172.21.15.103:0/4202408814 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7b0804da20 0x7f7b0804fee0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:28.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.347+0000 7f7b3185a700 1 --2- 172.21.15.103:0/4202408814 >> v2:172.21.15.86:3300/0 conn(0x7f7b2c12c0d0 0x7f7b2c127ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:28.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.347+0000 7f7b3185a700 1 --2- 172.21.15.103:0/4202408814 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b2c063e30 0x7f7b2c129da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:28.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.347+0000 7f7b3185a700 1 --2- 172.21.15.103:0/4202408814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b2c065fe0 0x7f7b2c0b1d50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:28.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.347+0000 7f7b3185a700 1 -- 172.21.15.103:0/4202408814 >> 172.21.15.103:0/4202408814 conn(0x7f7b2c0b9160 msgr2=0x7f7b2c064210 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:28.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.347+0000 7f7b3185a700 1 -- 172.21.15.103:0/4202408814 shutdown_connections 2020-04-22T14:02:28.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.347+0000 7f7b3185a700 1 -- 172.21.15.103:0/4202408814 wait complete. 2020-04-22T14:02:28.360 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:28.374 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-04-22T14:02:28.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.521+0000 7f8a37ed5700 1 Processor -- start 2020-04-22T14:02:28.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.521+0000 7f8a37ed5700 1 -- start start 2020-04-22T14:02:28.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.522+0000 7f8a37ed5700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8a30061a30 0x7f8a300b4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:28.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.522+0000 7f8a37ed5700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8a300acb10 0x7f8a300ae920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:28.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.522+0000 7f8a37ed5700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a30060250 con 0x7f8a300aed80 2020-04-22T14:02:28.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.522+0000 7f8a37ed5700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a300623c0 con 0x7f8a300acb10 2020-04-22T14:02:28.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.522+0000 7f8a37ed5700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a30062660 con 0x7f8a30061a30 2020-04-22T14:02:28.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.522+0000 7f8a36472700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f8a300aed80 0x7f8a300b3050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39156/0 (socket says 172.21.15.103:39156) 2020-04-22T14:02:28.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.522+0000 7f8a36472700 1 -- 172.21.15.103:0/938235326 learned_addr learned my addr 172.21.15.103:0/938235326 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:28.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.522+0000 7f8a35c71700 1 --2- 172.21.15.103:0/938235326 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8a30061a30 0x7f8a300b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:28.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.522+0000 7f8a35470700 1 --2- 172.21.15.103:0/938235326 >> v2:172.21.15.86:3300/0 conn(0x7f8a300acb10 0x7f8a300ae920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:28.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.522+0000 7f8a34c6f700 1 -- 172.21.15.103:0/938235326 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3222566224 0 0) 0x7f8a30060250 con 0x7f8a300aed80 2020-04-22T14:02:28.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.522+0000 7f8a34c6f700 1 -- 172.21.15.103:0/938235326 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a18003230 con 0x7f8a300aed80 2020-04-22T14:02:28.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.522+0000 7f8a34c6f700 1 -- 172.21.15.103:0/938235326 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4070888509 0 0) 0x7f8a18003230 con 0x7f8a300aed80 2020-04-22T14:02:28.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.522+0000 7f8a34c6f700 1 -- 172.21.15.103:0/938235326 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8a30061a30 msgr2=0x7f8a300b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:28.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.522+0000 7f8a34c6f700 1 --2- 172.21.15.103:0/938235326 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8a30061a30 0x7f8a300b4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:28.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.522+0000 7f8a34c6f700 1 -- 172.21.15.103:0/938235326 >> v2:172.21.15.86:3300/0 conn(0x7f8a300acb10 msgr2=0x7f8a300ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:28.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.522+0000 7f8a34c6f700 1 --2- 172.21.15.103:0/938235326 >> v2:172.21.15.86:3300/0 conn(0x7f8a300acb10 0x7f8a300ae920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:28.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.522+0000 7f8a34c6f700 1 -- 172.21.15.103:0/938235326 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a30061e10 con 0x7f8a300aed80 2020-04-22T14:02:28.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.522+0000 7f8a34c6f700 1 -- 172.21.15.103:0/938235326 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f8a2c0016d0 con 0x7f8a300aed80 2020-04-22T14:02:28.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.522+0000 7f8a34c6f700 1 -- 172.21.15.103:0/938235326 >> v1:172.21.15.103:6789/0 conn(0x7f8a300aed80 legacy=0x7f8a300b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:28.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.522+0000 7f8a34c6f700 1 --2- 172.21.15.103:0/938235326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a18003720 0x7f8a18003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:28.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.522+0000 7f8a34c6f700 1 --2- 172.21.15.103:0/938235326 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8a30061a30 0x7f8a180044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:28.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.522+0000 7f8a34c6f700 1 --2- 172.21.15.103:0/938235326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a18004930 0x7f8a18004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:28.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.522+0000 7f8a34c6f700 1 -- 172.21.15.103:0/938235326 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a300623c0 con 0x7f8a18003720 2020-04-22T14:02:28.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.522+0000 7f8a34c6f700 1 -- 172.21.15.103:0/938235326 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a30062660 con 0x7f8a18004930 2020-04-22T14:02:28.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.522+0000 7f8a34c6f700 1 -- 172.21.15.103:0/938235326 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a18005380 con 0x7f8a30061a30 2020-04-22T14:02:28.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.523+0000 7f8a36472700 1 --2- 172.21.15.103:0/938235326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a18004930 0x7f8a18004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:28.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.523+0000 7f8a35c71700 1 --2- 172.21.15.103:0/938235326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a18003720 0x7f8a18003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:28.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.523+0000 7f8a35470700 1 --2- 172.21.15.103:0/938235326 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8a30061a30 0x7f8a180044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:28.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.523+0000 7f8a36472700 1 -- 172.21.15.103:0/938235326 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8a30061a30 msgr2=0x7f8a180044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:28.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.523+0000 7f8a36472700 1 --2- 172.21.15.103:0/938235326 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8a30061a30 0x7f8a180044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:28.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.523+0000 7f8a36472700 1 -- 172.21.15.103:0/938235326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a18003720 msgr2=0x7f8a18003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:28.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.523+0000 7f8a36472700 1 --2- 172.21.15.103:0/938235326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a18003720 0x7f8a18003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:28.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.523+0000 7f8a36472700 1 -- 172.21.15.103:0/938235326 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a18003230 con 0x7f8a18004930 2020-04-22T14:02:28.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.523+0000 7f8a36472700 1 --2- 172.21.15.103:0/938235326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a18004930 0x7f8a18004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8a2c0013e0 tx=0x7f8a30061fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:28.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.523+0000 7f8a36472700 1 --2- 172.21.15.103:0/938235326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a18004930 0x7f8a18004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8a2c0013e0 tx=0x7f8a30061fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:28.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.523+0000 7f8a36472700 1 --2- 172.21.15.103:0/938235326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a18004930 0x7f8a18004db0 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7f8a2c0013e0 tx=0x7f8a30061fa0).ready entity=mon.1 client_cookie=577ae117aab5b945 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:28.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.523+0000 7f8a36472700 1 --2- 172.21.15.103:0/938235326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a18004930 0x7f8a18004db0 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f8a2c0013e0 tx=0x7f8a30061fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:28.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.523+0000 7f8a36472700 1 --2- 172.21.15.103:0/938235326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a18004930 0x7f8a18004db0 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f8a2c0013e0 tx=0x7f8a30061fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:28.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.523+0000 7f8a34c6f700 1 -- 172.21.15.103:0/938235326 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a2c00ce70 con 0x7f8a18004930 2020-04-22T14:02:28.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.523+0000 7f8a36472700 1 --2- 172.21.15.103:0/938235326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a18004930 0x7f8a18004db0 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f8a2c0013e0 tx=0x7f8a30061fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:28.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.523+0000 7f8a34c6f700 1 -- 172.21.15.103:0/938235326 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a2c00e370 con 0x7f8a18004930 2020-04-22T14:02:28.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.523+0000 7f8a34c6f700 1 -- 172.21.15.103:0/938235326 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a2c0100c0 con 0x7f8a18004930 2020-04-22T14:02:28.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.523+0000 7f8a37ed5700 1 -- 172.21.15.103:0/938235326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a18004930 msgr2=0x7f8a18004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:28.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.523+0000 7f8a37ed5700 1 --2- 172.21.15.103:0/938235326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a18004930 0x7f8a18004db0 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7f8a2c0013e0 tx=0x7f8a30061fa0).stop 2020-04-22T14:02:28.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.523+0000 7f8a36472700 1 -- 172.21.15.103:0/938235326 reap_dead start 2020-04-22T14:02:28.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.523+0000 7f8a37ed5700 1 -- 172.21.15.103:0/938235326 shutdown_connections 2020-04-22T14:02:28.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.523+0000 7f8a37ed5700 1 -- 172.21.15.103:0/938235326 >> 172.21.15.103:0/938235326 conn(0x7f8a3005b7b0 msgr2=0x7f8a300b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:28.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.524+0000 7f8a37ed5700 1 -- 172.21.15.103:0/938235326 shutdown_connections 2020-04-22T14:02:28.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.524+0000 7f8a37ed5700 1 -- 172.21.15.103:0/938235326 wait complete. 2020-04-22T14:02:28.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.524+0000 7f8a37ed5700 1 Processor -- start 2020-04-22T14:02:28.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.524+0000 7f8a37ed5700 1 -- start start 2020-04-22T14:02:28.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.525+0000 7f8a37ed5700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8a300b24c0 0x7f8a30062860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:28.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.525+0000 7f8a37ed5700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8a3014f6c0 0x7f8a300b0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:28.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.525+0000 7f8a37ed5700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a300af970 con 0x7f8a30063730 2020-04-22T14:02:28.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.525+0000 7f8a37ed5700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a300afc10 con 0x7f8a300b24c0 2020-04-22T14:02:28.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.525+0000 7f8a37ed5700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a300afeb0 con 0x7f8a3014f6c0 2020-04-22T14:02:28.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.525+0000 7f8a36472700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8a3014f6c0 0x7f8a300b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:28.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.525+0000 7f8a36472700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8a3014f6c0 0x7f8a300b0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46978/0 (socket says 172.21.15.103:46978) 2020-04-22T14:02:28.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.525+0000 7f8a36472700 1 -- 172.21.15.103:0/2664895824 learned_addr learned my addr 172.21.15.103:0/2664895824 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:28.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.525+0000 7f8a35470700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f8a30063730 0x7f8a30152200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39166/0 (socket says 172.21.15.103:39166) 2020-04-22T14:02:28.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.525+0000 7f8a35c71700 1 --2- 172.21.15.103:0/2664895824 >> v2:172.21.15.86:3300/0 conn(0x7f8a300b24c0 0x7f8a30062860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:28.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.525+0000 7f8a36472700 1 -- 172.21.15.103:0/2664895824 >> v2:172.21.15.86:3300/0 conn(0x7f8a300b24c0 msgr2=0x7f8a30062860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:28.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.525+0000 7f8a36472700 1 --2- 172.21.15.103:0/2664895824 >> v2:172.21.15.86:3300/0 conn(0x7f8a300b24c0 0x7f8a30062860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:28.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.525+0000 7f8a1effd700 1 -- 172.21.15.103:0/2664895824 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 725183034 0 0) 0x7f8a300af970 con 0x7f8a30063730 2020-04-22T14:02:28.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.525+0000 7f8a36472700 1 -- 172.21.15.103:0/2664895824 >> v1:172.21.15.103:6789/0 conn(0x7f8a30063730 legacy=0x7f8a30152200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:28.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.526+0000 7f8a36472700 1 -- 172.21.15.103:0/2664895824 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a300b28a0 con 0x7f8a3014f6c0 2020-04-22T14:02:28.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.526+0000 7f8a36472700 1 --2- 172.21.15.103:0/2664895824 >> v2:172.21.15.103:3300/0 conn(0x7f8a3014f6c0 0x7f8a300b0350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8a300b2cf0 tx=0x7f8a30061fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:28.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.526+0000 7f8a36472700 1 --2- 172.21.15.103:0/2664895824 >> v2:172.21.15.103:3300/0 conn(0x7f8a3014f6c0 0x7f8a300b0350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8a300b2cf0 tx=0x7f8a30061fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:28.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.526+0000 7f8a36472700 1 --2- 172.21.15.103:0/2664895824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a3014f6c0 0x7f8a300b0350 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7f8a300b2cf0 tx=0x7f8a30061fa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:28.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.526+0000 7f8a36472700 1 --2- 172.21.15.103:0/2664895824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a3014f6c0 0x7f8a300b0350 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f8a300b2cf0 tx=0x7f8a30061fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:28.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.526+0000 7f8a1effd700 1 -- 172.21.15.103:0/2664895824 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a2c00ce70 con 0x7f8a3014f6c0 2020-04-22T14:02:28.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.526+0000 7f8a36472700 1 --2- 172.21.15.103:0/2664895824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a3014f6c0 0x7f8a300b0350 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f8a300b2cf0 tx=0x7f8a30061fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:28.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.526+0000 7f8a36472700 1 --2- 172.21.15.103:0/2664895824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a3014f6c0 0x7f8a300b0350 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f8a300b2cf0 tx=0x7f8a30061fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:28.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.526+0000 7f8a1effd700 1 -- 172.21.15.103:0/2664895824 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a2c001720 con 0x7f8a3014f6c0 2020-04-22T14:02:28.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.526+0000 7f8a37ed5700 1 -- 172.21.15.103:0/2664895824 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a3014fb30 con 0x7f8a3014f6c0 2020-04-22T14:02:28.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.526+0000 7f8a1effd700 1 -- 172.21.15.103:0/2664895824 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a2c00fe40 con 0x7f8a3014f6c0 2020-04-22T14:02:28.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.526+0000 7f8a37ed5700 1 -- 172.21.15.103:0/2664895824 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a300b07b0 con 0x7f8a3014f6c0 2020-04-22T14:02:28.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.526+0000 7f8a36472700 1 --2- 172.21.15.103:0/2664895824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a3014f6c0 0x7f8a300b0350 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f8a300b2cf0 tx=0x7f8a30061fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:28.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.527+0000 7f8a1effd700 1 -- 172.21.15.103:0/2664895824 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f8a2c0106b0 con 0x7f8a3014f6c0 2020-04-22T14:02:28.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.527+0000 7f8a36472700 1 --2- 172.21.15.103:0/2664895824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a3014f6c0 0x7f8a300b0350 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f8a300b2cf0 tx=0x7f8a30061fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:28.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.527+0000 7f8a1effd700 1 --2- 172.21.15.103:0/2664895824 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8a1004d8d0 0x7f8a1004fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:28.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.527+0000 7f8a1effd700 1 -- 172.21.15.103:0/2664895824 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8a2c063360 con 0x7f8a3014f6c0 2020-04-22T14:02:28.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.527+0000 7f8a37ed5700 1 -- 172.21.15.103:0/2664895824 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a30056c90 con 0x7f8a3014f6c0 2020-04-22T14:02:28.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.527+0000 7f8a35c71700 1 --2- 172.21.15.103:0/2664895824 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8a1004d8d0 0x7f8a1004fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:28.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.527+0000 7f8a35c71700 1 --2- 172.21.15.103:0/2664895824 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8a1004d8d0 0x7f8a1004fd90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8a280032b0 tx=0x7f8a2800ce10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:28.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.528+0000 7f8a35c71700 1 --2- 172.21.15.103:0/2664895824 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8a1004d8d0 0x7f8a1004fd90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8a280032b0 tx=0x7f8a2800ce10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:28.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.528+0000 7f8a35c71700 1 --2- 172.21.15.103:0/2664895824 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8a1004d8d0 0x7f8a1004fd90 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7f8a280032b0 tx=0x7f8a2800ce10).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:28.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.531+0000 7f8a36472700 1 --2- 172.21.15.103:0/2664895824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a3014f6c0 0x7f8a300b0350 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f8a300b2cf0 tx=0x7f8a30061fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:28.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.531+0000 7f8a1effd700 1 -- 172.21.15.103:0/2664895824 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f8a2c03e860 con 0x7f8a3014f6c0 2020-04-22T14:02:28.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:28.721+0000 7f8a37ed5700 1 -- 172.21.15.103:0/2664895824 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8a300b0020 con 0x7f8a3014f6c0 2020-04-22T14:02:29.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.526+0000 7f8a36472700 1 --2- 172.21.15.103:0/2664895824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a3014f6c0 0x7f8a300b0350 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7f8a300b2cf0 tx=0x7f8a30061fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:29.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.693+0000 7f8a36472700 1 --2- 172.21.15.103:0/2664895824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a3014f6c0 0x7f8a300b0350 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f8a300b2cf0 tx=0x7f8a30061fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:29.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.693+0000 7f8a1effd700 1 -- 172.21.15.103:0/2664895824 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v3) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8a2c041e80 con 0x7f8a3014f6c0 2020-04-22T14:02:29.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.695+0000 7f8a37ed5700 1 -- 172.21.15.103:0/2664895824 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8a1004d8d0 msgr2=0x7f8a1004fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:29.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.695+0000 7f8a37ed5700 1 --2- 172.21.15.103:0/2664895824 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8a1004d8d0 0x7f8a1004fd90 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7f8a280032b0 tx=0x7f8a2800ce10).stop 2020-04-22T14:02:29.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.695+0000 7f8a37ed5700 1 -- 172.21.15.103:0/2664895824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a3014f6c0 msgr2=0x7f8a300b0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:29.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.695+0000 7f8a37ed5700 1 --2- 172.21.15.103:0/2664895824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a3014f6c0 0x7f8a300b0350 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7f8a300b2cf0 tx=0x7f8a30061fa0).stop 2020-04-22T14:02:29.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.695+0000 7f8a37ed5700 1 -- 172.21.15.103:0/2664895824 shutdown_connections 2020-04-22T14:02:29.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.695+0000 7f8a37ed5700 1 --2- 172.21.15.103:0/2664895824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a3014f6c0 0x7f8a300b0350 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:29.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.695+0000 7f8a37ed5700 1 --2- 172.21.15.103:0/2664895824 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8a1004d8d0 0x7f8a1004fd90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:29.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.695+0000 7f8a37ed5700 1 --2- 172.21.15.103:0/2664895824 >> v2:172.21.15.86:3300/0 conn(0x7f8a300b24c0 0x7f8a30062860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:29.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.695+0000 7f8a37ed5700 1 -- 172.21.15.103:0/2664895824 >> 172.21.15.103:0/2664895824 conn(0x7f8a3005b7b0 msgr2=0x7f8a300b6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:29.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.695+0000 7f8a37ed5700 1 -- 172.21.15.103:0/2664895824 shutdown_connections 2020-04-22T14:02:29.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.695+0000 7f8a37ed5700 1 -- 172.21.15.103:0/2664895824 wait complete. 2020-04-22T14:02:29.710 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:29.733 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:02:29.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.882+0000 7f48f0ffe700 1 Processor -- start 2020-04-22T14:02:29.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.882+0000 7f48f0ffe700 1 -- start start 2020-04-22T14:02:29.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.883+0000 7f48f0ffe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f48ec12c0d0 0x7f48ec1464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:29.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.883+0000 7f48f0ffe700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48ec065fe0 0x7f48ec05b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:29.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.883+0000 7f48f0ffe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f48ec05b8a0 0x7f48ec062ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:29.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.883+0000 7f48f0ffe700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48ec12c4b0 con 0x7f48ec05b8a0 2020-04-22T14:02:29.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.883+0000 7f48f0ffe700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48ec143300 con 0x7f48ec12c0d0 2020-04-22T14:02:29.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.883+0000 7f48f0ffe700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec1435a0 con 0x7f48ec065fe0 2020-04-22T14:02:29.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.883+0000 7f48ea59c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f48ec12c0d0 0x7f48ec1464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:29.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.883+0000 7f48ea59c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f48ec12c0d0 0x7f48ec1464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46982/0 (socket says 172.21.15.103:46982) 2020-04-22T14:02:29.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.883+0000 7f48ea59c700 1 -- 172.21.15.103:0/4003497418 learned_addr learned my addr 172.21.15.103:0/4003497418 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:29.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.883+0000 7f48ead9d700 1 --2- 172.21.15.103:0/4003497418 >> v2:172.21.15.86:3300/0 conn(0x7f48ec05b8a0 0x7f48ec062ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:29.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.883+0000 7f48e9d9b700 1 --2- 172.21.15.103:0/4003497418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48ec065fe0 0x7f48ec05b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:29.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.883+0000 7f48ea59c700 1 -- 172.21.15.103:0/4003497418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48ec065fe0 msgr2=0x7f48ec05b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:29.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.883+0000 7f48ea59c700 1 --2- 172.21.15.103:0/4003497418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48ec065fe0 0x7f48ec05b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:29.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.883+0000 7f48ea59c700 1 -- 172.21.15.103:0/4003497418 >> v2:172.21.15.86:3300/0 conn(0x7f48ec05b8a0 msgr2=0x7f48ec062ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:29.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.883+0000 7f48ea59c700 1 --2- 172.21.15.103:0/4003497418 >> v2:172.21.15.86:3300/0 conn(0x7f48ec05b8a0 0x7f48ec062ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:29.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.883+0000 7f48ea59c700 1 -- 172.21.15.103:0/4003497418 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ec143840 con 0x7f48ec12c0d0 2020-04-22T14:02:29.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.883+0000 7f48e9d9b700 1 --2- 172.21.15.103:0/4003497418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48ec065fe0 0x7f48ec05b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:02:29.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.883+0000 7f48ea59c700 1 --2- 172.21.15.103:0/4003497418 >> v2:172.21.15.103:3300/0 conn(0x7f48ec12c0d0 0x7f48ec1464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f48e0002f30 tx=0x7f48e0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:29.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.883+0000 7f48ea59c700 1 --2- 172.21.15.103:0/4003497418 >> v2:172.21.15.103:3300/0 conn(0x7f48ec12c0d0 0x7f48ec1464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f48e0002f30 tx=0x7f48e0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:29.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.883+0000 7f48ea59c700 1 --2- 172.21.15.103:0/4003497418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48ec12c0d0 0x7f48ec1464e0 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7f48e0002f30 tx=0x7f48e0007a40).ready entity=mon.1 client_cookie=733d2b8f9cfac46e server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:29.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.884+0000 7f48ea59c700 1 --2- 172.21.15.103:0/4003497418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48ec12c0d0 0x7f48ec1464e0 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f48e0002f30 tx=0x7f48e0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:29.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.884+0000 7f48ea59c700 1 --2- 172.21.15.103:0/4003497418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48ec12c0d0 0x7f48ec1464e0 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f48e0002f30 tx=0x7f48e0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:29.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.884+0000 7f48e959a700 1 -- 172.21.15.103:0/4003497418 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48e0011670 con 0x7f48ec12c0d0 2020-04-22T14:02:29.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.884+0000 7f48ea59c700 1 --2- 172.21.15.103:0/4003497418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48ec12c0d0 0x7f48ec1464e0 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f48e0002f30 tx=0x7f48e0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:29.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.884+0000 7f48e959a700 1 -- 172.21.15.103:0/4003497418 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e00117d0 con 0x7f48ec12c0d0 2020-04-22T14:02:29.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.884+0000 7f48e959a700 1 -- 172.21.15.103:0/4003497418 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48e0011bf0 con 0x7f48ec12c0d0 2020-04-22T14:02:29.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.884+0000 7f48f0ffe700 1 -- 172.21.15.103:0/4003497418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48ec12c0d0 msgr2=0x7f48ec1464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:29.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.884+0000 7f48f0ffe700 1 --2- 172.21.15.103:0/4003497418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48ec12c0d0 0x7f48ec1464e0 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7f48e0002f30 tx=0x7f48e0007a40).stop 2020-04-22T14:02:29.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.884+0000 7f48f0ffe700 1 -- 172.21.15.103:0/4003497418 shutdown_connections 2020-04-22T14:02:29.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.884+0000 7f48f0ffe700 1 --2- 172.21.15.103:0/4003497418 >> v2:172.21.15.86:3300/0 conn(0x7f48ec05b8a0 0x7f48ec062ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:29.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.884+0000 7f48f0ffe700 1 --2- 172.21.15.103:0/4003497418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48ec12c0d0 0x7f48ec1464e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:29.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.884+0000 7f48f0ffe700 1 --2- 172.21.15.103:0/4003497418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48ec065fe0 0x7f48ec05b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:29.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.884+0000 7f48f0ffe700 1 -- 172.21.15.103:0/4003497418 >> 172.21.15.103:0/4003497418 conn(0x7f48ec0b9160 msgr2=0x7f48ec05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:29.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.884+0000 7f48f0ffe700 1 -- 172.21.15.103:0/4003497418 shutdown_connections 2020-04-22T14:02:29.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.884+0000 7f48f0ffe700 1 -- 172.21.15.103:0/4003497418 wait complete. 2020-04-22T14:02:29.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.885+0000 7f48f0ffe700 1 Processor -- start 2020-04-22T14:02:29.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.885+0000 7f48f0ffe700 1 -- start start 2020-04-22T14:02:29.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.886+0000 7f48f0ffe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f48ec05b8a0 0x7f48ec141e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:29.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.886+0000 7f48f0ffe700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48ec065fe0 0x7f48ec1295a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:29.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.886+0000 7f48f0ffe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f48ec12c0d0 0x7f48ec1547d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:29.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.886+0000 7f48f0ffe700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48ec142360 con 0x7f48ec12c0d0 2020-04-22T14:02:29.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.886+0000 7f48f0ffe700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48ec142600 con 0x7f48ec05b8a0 2020-04-22T14:02:29.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.886+0000 7f48f0ffe700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec154c30 con 0x7f48ec065fe0 2020-04-22T14:02:29.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.886+0000 7f48ea59c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f48ec05b8a0 0x7f48ec141e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:29.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.886+0000 7f48ea59c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f48ec05b8a0 0x7f48ec141e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46990/0 (socket says 172.21.15.103:46990) 2020-04-22T14:02:29.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.886+0000 7f48ea59c700 1 -- 172.21.15.103:0/2670489395 learned_addr learned my addr 172.21.15.103:0/2670489395 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:29.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.886+0000 7f48e9d9b700 1 --2- 172.21.15.103:0/2670489395 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48ec065fe0 0x7f48ec1295a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:29.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.886+0000 7f48ead9d700 1 --2- 172.21.15.103:0/2670489395 >> v2:172.21.15.86:3300/0 conn(0x7f48ec12c0d0 0x7f48ec1547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:29.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.886+0000 7f48ea59c700 1 -- 172.21.15.103:0/2670489395 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48ec065fe0 msgr2=0x7f48ec1295a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:29.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.886+0000 7f48ea59c700 1 --2- 172.21.15.103:0/2670489395 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48ec065fe0 0x7f48ec1295a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:29.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.886+0000 7f48ea59c700 1 -- 172.21.15.103:0/2670489395 >> v2:172.21.15.86:3300/0 conn(0x7f48ec12c0d0 msgr2=0x7f48ec1547d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:29.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.886+0000 7f48ea59c700 1 --2- 172.21.15.103:0/2670489395 >> v2:172.21.15.86:3300/0 conn(0x7f48ec12c0d0 0x7f48ec1547d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:29.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.886+0000 7f48ea59c700 1 -- 172.21.15.103:0/2670489395 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ec0ad6c0 con 0x7f48ec05b8a0 2020-04-22T14:02:29.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.886+0000 7f48ea59c700 1 --2- 172.21.15.103:0/2670489395 >> v2:172.21.15.103:3300/0 conn(0x7f48ec05b8a0 0x7f48ec141e50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f48e0002f30 tx=0x7f48e0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:29.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.886+0000 7f48ea59c700 1 --2- 172.21.15.103:0/2670489395 >> v2:172.21.15.103:3300/0 conn(0x7f48ec05b8a0 0x7f48ec141e50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f48e0002f30 tx=0x7f48e0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:29.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.886+0000 7f48ea59c700 1 --2- 172.21.15.103:0/2670489395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48ec05b8a0 0x7f48ec141e50 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7f48e0002f30 tx=0x7f48e0007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:29.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.886+0000 7f48ea59c700 1 --2- 172.21.15.103:0/2670489395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48ec05b8a0 0x7f48ec141e50 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f48e0002f30 tx=0x7f48e0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:29.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.886+0000 7f48db7fe700 1 -- 172.21.15.103:0/2670489395 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48e0007170 con 0x7f48ec05b8a0 2020-04-22T14:02:29.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.886+0000 7f48ea59c700 1 --2- 172.21.15.103:0/2670489395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48ec05b8a0 0x7f48ec141e50 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f48e0002f30 tx=0x7f48e0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:29.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.886+0000 7f48ea59c700 1 --2- 172.21.15.103:0/2670489395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48ec05b8a0 0x7f48ec141e50 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f48e0002f30 tx=0x7f48e0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:29.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.886+0000 7f48db7fe700 1 -- 172.21.15.103:0/2670489395 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e00072d0 con 0x7f48ec05b8a0 2020-04-22T14:02:29.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.886+0000 7f48f0ffe700 1 -- 172.21.15.103:0/2670489395 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48ec1288b0 con 0x7f48ec05b8a0 2020-04-22T14:02:29.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.887+0000 7f48db7fe700 1 -- 172.21.15.103:0/2670489395 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48e00056c0 con 0x7f48ec05b8a0 2020-04-22T14:02:29.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.887+0000 7f48f0ffe700 1 -- 172.21.15.103:0/2670489395 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48ec128dd0 con 0x7f48ec05b8a0 2020-04-22T14:02:29.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.887+0000 7f48ea59c700 1 --2- 172.21.15.103:0/2670489395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48ec05b8a0 0x7f48ec141e50 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f48e0002f30 tx=0x7f48e0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:29.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.888+0000 7f48db7fe700 1 -- 172.21.15.103:0/2670489395 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f48e0005930 con 0x7f48ec05b8a0 2020-04-22T14:02:29.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.888+0000 7f48ea59c700 1 --2- 172.21.15.103:0/2670489395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48ec05b8a0 0x7f48ec141e50 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f48e0002f30 tx=0x7f48e0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:29.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.888+0000 7f48f0ffe700 1 -- 172.21.15.103:0/2670489395 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48ec056c90 con 0x7f48ec05b8a0 2020-04-22T14:02:29.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.888+0000 7f48db7fe700 1 --2- 172.21.15.103:0/2670489395 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f48c804da30 0x7f48c804fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:29.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.888+0000 7f48db7fe700 1 -- 172.21.15.103:0/2670489395 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f48e0061a10 con 0x7f48ec05b8a0 2020-04-22T14:02:29.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.888+0000 7f48e9d9b700 1 --2- 172.21.15.103:0/2670489395 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f48c804da30 0x7f48c804fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:29.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.888+0000 7f48e9d9b700 1 --2- 172.21.15.103:0/2670489395 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f48c804da30 0x7f48c804fef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f48dc002f30 tx=0x7f48dc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:29.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.888+0000 7f48e9d9b700 1 --2- 172.21.15.103:0/2670489395 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f48c804da30 0x7f48c804fef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f48dc002f30 tx=0x7f48dc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:29.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.889+0000 7f48e9d9b700 1 --2- 172.21.15.103:0/2670489395 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f48c804da30 0x7f48c804fef0 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7f48dc002f30 tx=0x7f48dc007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:29.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.892+0000 7f48ea59c700 1 --2- 172.21.15.103:0/2670489395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48ec05b8a0 0x7f48ec141e50 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f48e0002f30 tx=0x7f48e0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:29.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:29.892+0000 7f48db7fe700 1 -- 172.21.15.103:0/2670489395 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f48e003cf10 con 0x7f48ec05b8a0 2020-04-22T14:02:30.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.084+0000 7f48f0ffe700 1 -- 172.21.15.103:0/2670489395 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f48ec146ec0 con 0x7f48ec05b8a0 2020-04-22T14:02:30.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.084+0000 7f48ea59c700 1 --2- 172.21.15.103:0/2670489395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48ec05b8a0 0x7f48ec141e50 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f48e0002f30 tx=0x7f48e0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:30.087 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.084+0000 7f48db7fe700 1 -- 172.21.15.103:0/2670489395 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+1420 (secure 0 0 0) 0x7f48e0040530 con 0x7f48ec05b8a0 2020-04-22T14:02:30.087 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:02:30.087 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":3,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":3,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:02:27.685979+0000","modified":"2020-04-22T14:02:29.688473+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-22T14:02:30.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.085+0000 7f48f0ffe700 1 -- 172.21.15.103:0/2670489395 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f48c804da30 msgr2=0x7f48c804fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:30.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.085+0000 7f48f0ffe700 1 --2- 172.21.15.103:0/2670489395 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f48c804da30 0x7f48c804fef0 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7f48dc002f30 tx=0x7f48dc007a40).stop 2020-04-22T14:02:30.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.085+0000 7f48f0ffe700 1 -- 172.21.15.103:0/2670489395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48ec05b8a0 msgr2=0x7f48ec141e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:30.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.085+0000 7f48f0ffe700 1 --2- 172.21.15.103:0/2670489395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48ec05b8a0 0x7f48ec141e50 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7f48e0002f30 tx=0x7f48e0007a40).stop 2020-04-22T14:02:30.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.086+0000 7f48f0ffe700 1 -- 172.21.15.103:0/2670489395 shutdown_connections 2020-04-22T14:02:30.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.086+0000 7f48f0ffe700 1 --2- 172.21.15.103:0/2670489395 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f48c804da30 0x7f48c804fef0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:30.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.086+0000 7f48f0ffe700 1 --2- 172.21.15.103:0/2670489395 >> v2:172.21.15.86:3300/0 conn(0x7f48ec12c0d0 0x7f48ec1547d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:30.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.086+0000 7f48f0ffe700 1 --2- 172.21.15.103:0/2670489395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48ec05b8a0 0x7f48ec141e50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:30.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.086+0000 7f48f0ffe700 1 --2- 172.21.15.103:0/2670489395 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48ec065fe0 0x7f48ec1295a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:30.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.086+0000 7f48f0ffe700 1 -- 172.21.15.103:0/2670489395 >> 172.21.15.103:0/2670489395 conn(0x7f48ec0b9160 msgr2=0x7f48ec12afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:30.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.086+0000 7f48f0ffe700 1 -- 172.21.15.103:0/2670489395 shutdown_connections 2020-04-22T14:02:30.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.086+0000 7f48f0ffe700 1 -- 172.21.15.103:0/2670489395 wait complete. 2020-04-22T14:02:30.090 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 3 2020-04-22T14:02:30.098 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:30.123 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:02:30.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.255+0000 7f4c9bf46700 1 Processor -- start 2020-04-22T14:02:30.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.255+0000 7f4c9bf46700 1 -- start start 2020-04-22T14:02:30.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.256+0000 7f4c9bf46700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4c94067170 0x7f4c940b6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:30.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.256+0000 7f4c9bf46700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c94064ec0 con 0x7f4c940ac740 2020-04-22T14:02:30.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.256+0000 7f4c9bf46700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c94146870 con 0x7f4c941426d0 2020-04-22T14:02:30.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.256+0000 7f4c9bf46700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c94065af0 con 0x7f4c94067170 2020-04-22T14:02:30.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.256+0000 7f4c9a4e3700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f4c941426d0 0x7f4c94142b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39188/0 (socket says 172.21.15.103:39188) 2020-04-22T14:02:30.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.256+0000 7f4c9a4e3700 1 -- 172.21.15.103:0/752000366 learned_addr learned my addr 172.21.15.103:0/752000366 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:30.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.257+0000 7f4c99ce2700 1 --2- 172.21.15.103:0/752000366 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4c94067170 0x7f4c940b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:30.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.257+0000 7f4c98ce0700 1 -- 172.21.15.103:0/752000366 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2926057587 0 0) 0x7f4c94146870 con 0x7f4c941426d0 2020-04-22T14:02:30.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.257+0000 7f4c98ce0700 1 -- 172.21.15.103:0/752000366 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c7c003230 con 0x7f4c941426d0 2020-04-22T14:02:30.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.257+0000 7f4c98ce0700 1 -- 172.21.15.103:0/752000366 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 44595587 0 0) 0x7f4c7c003230 con 0x7f4c941426d0 2020-04-22T14:02:30.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.257+0000 7f4c98ce0700 1 -- 172.21.15.103:0/752000366 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4c94067170 msgr2=0x7f4c940b6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:30.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.257+0000 7f4c98ce0700 1 --2- 172.21.15.103:0/752000366 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4c94067170 0x7f4c940b6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:30.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.257+0000 7f4c98ce0700 1 -- 172.21.15.103:0/752000366 >> v1:172.21.15.86:6789/0 conn(0x7f4c940ac740 legacy=0x7f4c9413c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:30.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.257+0000 7f4c98ce0700 1 -- 172.21.15.103:0/752000366 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c94067550 con 0x7f4c941426d0 2020-04-22T14:02:30.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.257+0000 7f4c98ce0700 1 -- 172.21.15.103:0/752000366 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f4c8c001a50 con 0x7f4c941426d0 2020-04-22T14:02:30.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.257+0000 7f4c98ce0700 1 -- 172.21.15.103:0/752000366 >> v1:172.21.15.103:6789/0 conn(0x7f4c941426d0 legacy=0x7f4c94142b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:30.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.257+0000 7f4c98ce0700 1 --2- 172.21.15.103:0/752000366 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4c94067170 0x7f4c7c003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:30.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.257+0000 7f4c98ce0700 1 --2- 172.21.15.103:0/752000366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c7c003b80 0x7f4c7c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:30.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.257+0000 7f4c98ce0700 1 --2- 172.21.15.103:0/752000366 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c7c004570 0x7f4c7c0049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:30.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.257+0000 7f4c98ce0700 1 -- 172.21.15.103:0/752000366 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c94065af0 con 0x7f4c7c004570 2020-04-22T14:02:30.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.257+0000 7f4c98ce0700 1 -- 172.21.15.103:0/752000366 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c004f80 con 0x7f4c7c003b80 2020-04-22T14:02:30.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.257+0000 7f4c98ce0700 1 -- 172.21.15.103:0/752000366 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c005140 con 0x7f4c94067170 2020-04-22T14:02:30.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.257+0000 7f4c994e1700 1 --2- 172.21.15.103:0/752000366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c7c003b80 0x7f4c7c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:30.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.257+0000 7f4c99ce2700 1 --2- 172.21.15.103:0/752000366 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4c94067170 0x7f4c7c003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:30.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.257+0000 7f4c9a4e3700 1 --2- 172.21.15.103:0/752000366 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c7c004570 0x7f4c7c0049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:30.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.257+0000 7f4c994e1700 1 -- 172.21.15.103:0/752000366 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4c94067170 msgr2=0x7f4c7c003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:30.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.257+0000 7f4c994e1700 1 --2- 172.21.15.103:0/752000366 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4c94067170 0x7f4c7c003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:30.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.257+0000 7f4c994e1700 1 -- 172.21.15.103:0/752000366 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c7c004570 msgr2=0x7f4c7c0049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:30.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.257+0000 7f4c994e1700 1 --2- 172.21.15.103:0/752000366 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c7c004570 0x7f4c7c0049d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:30.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.257+0000 7f4c994e1700 1 -- 172.21.15.103:0/752000366 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7c003230 con 0x7f4c7c003b80 2020-04-22T14:02:30.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.257+0000 7f4c994e1700 1 --2- 172.21.15.103:0/752000366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c7c003b80 0x7f4c7c003fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4c900010d0 tx=0x7f4c900015b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:30.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.258+0000 7f4c994e1700 1 --2- 172.21.15.103:0/752000366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c7c003b80 0x7f4c7c003fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4c900010d0 tx=0x7f4c900015b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:30.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.258+0000 7f4c994e1700 1 --2- 172.21.15.103:0/752000366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c7c003b80 0x7f4c7c003fe0 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7f4c900010d0 tx=0x7f4c900015b0).ready entity=mon.1 client_cookie=ac2770b4f215f119 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:30.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.258+0000 7f4c994e1700 1 --2- 172.21.15.103:0/752000366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c7c003b80 0x7f4c7c003fe0 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f4c900010d0 tx=0x7f4c900015b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:30.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.258+0000 7f4c98ce0700 1 -- 172.21.15.103:0/752000366 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c900068c0 con 0x7f4c7c003b80 2020-04-22T14:02:30.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.258+0000 7f4c994e1700 1 --2- 172.21.15.103:0/752000366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c7c003b80 0x7f4c7c003fe0 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f4c900010d0 tx=0x7f4c900015b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:30.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.258+0000 7f4c98ce0700 1 -- 172.21.15.103:0/752000366 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c90006a60 con 0x7f4c7c003b80 2020-04-22T14:02:30.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.258+0000 7f4c994e1700 1 --2- 172.21.15.103:0/752000366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c7c003b80 0x7f4c7c003fe0 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f4c900010d0 tx=0x7f4c900015b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:30.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.258+0000 7f4c98ce0700 1 -- 172.21.15.103:0/752000366 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c90006e40 con 0x7f4c7c003b80 2020-04-22T14:02:30.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.258+0000 7f4c9bf46700 1 -- 172.21.15.103:0/752000366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c7c003b80 msgr2=0x7f4c7c003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:30.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.258+0000 7f4c9bf46700 1 --2- 172.21.15.103:0/752000366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c7c003b80 0x7f4c7c003fe0 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7f4c900010d0 tx=0x7f4c900015b0).stop 2020-04-22T14:02:30.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.258+0000 7f4c9a4e3700 1 -- 172.21.15.103:0/752000366 reap_dead start 2020-04-22T14:02:30.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.258+0000 7f4c9bf46700 1 -- 172.21.15.103:0/752000366 shutdown_connections 2020-04-22T14:02:30.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.258+0000 7f4c9bf46700 1 -- 172.21.15.103:0/752000366 >> 172.21.15.103:0/752000366 conn(0x7f4c940b9160 msgr2=0x7f4c9405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:30.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.258+0000 7f4c9bf46700 1 -- 172.21.15.103:0/752000366 shutdown_connections 2020-04-22T14:02:30.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.258+0000 7f4c9bf46700 1 -- 172.21.15.103:0/752000366 wait complete. 2020-04-22T14:02:30.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.259+0000 7f4c9bf46700 1 Processor -- start 2020-04-22T14:02:30.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.259+0000 7f4c9bf46700 1 -- start start 2020-04-22T14:02:30.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.260+0000 7f4c9bf46700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4c94145690 0x7f4c940aea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:30.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.260+0000 7f4c9bf46700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4c94143aa0 0x7f4c94143f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:30.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.260+0000 7f4c9bf46700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c94144360 con 0x7f4c940ad3d0 2020-04-22T14:02:30.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.260+0000 7f4c9bf46700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c940adec0 con 0x7f4c94145690 2020-04-22T14:02:30.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.260+0000 7f4c9bf46700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c940aeed0 con 0x7f4c94143aa0 2020-04-22T14:02:30.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.260+0000 7f4c994e1700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4c94145690 0x7f4c940aea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:30.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.260+0000 7f4c994e1700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4c94145690 0x7f4c940aea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47008/0 (socket says 172.21.15.103:47008) 2020-04-22T14:02:30.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.260+0000 7f4c994e1700 1 -- 172.21.15.103:0/2762006904 learned_addr learned my addr 172.21.15.103:0/2762006904 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:30.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.260+0000 7f4c9a4e3700 1 --2- 172.21.15.103:0/2762006904 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4c94143aa0 0x7f4c94143f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:30.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.260+0000 7f4c994e1700 1 -- 172.21.15.103:0/2762006904 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4c94143aa0 msgr2=0x7f4c94143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:30.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.260+0000 7f4c994e1700 1 --2- 172.21.15.103:0/2762006904 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4c94143aa0 0x7f4c94143f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:30.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.260+0000 7f4c994e1700 1 -- 172.21.15.103:0/2762006904 >> v1:172.21.15.86:6789/0 conn(0x7f4c940ad3d0 legacy=0x7f4c940ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:30.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.260+0000 7f4c994e1700 1 -- 172.21.15.103:0/2762006904 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c940b0f10 con 0x7f4c94145690 2020-04-22T14:02:30.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.260+0000 7f4c994e1700 1 --2- 172.21.15.103:0/2762006904 >> v2:172.21.15.103:3300/0 conn(0x7f4c94145690 0x7f4c940aea70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4c900010d0 tx=0x7f4c900015b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:30.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.260+0000 7f4c994e1700 1 --2- 172.21.15.103:0/2762006904 >> v2:172.21.15.103:3300/0 conn(0x7f4c94145690 0x7f4c940aea70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4c900010d0 tx=0x7f4c900015b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:30.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.260+0000 7f4c994e1700 1 --2- 172.21.15.103:0/2762006904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c94145690 0x7f4c940aea70 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7f4c900010d0 tx=0x7f4c900015b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:30.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.260+0000 7f4c994e1700 1 --2- 172.21.15.103:0/2762006904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c94145690 0x7f4c940aea70 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f4c900010d0 tx=0x7f4c900015b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:30.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.260+0000 7f4c994e1700 1 --2- 172.21.15.103:0/2762006904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c94145690 0x7f4c940aea70 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f4c900010d0 tx=0x7f4c900015b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:30.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.260+0000 7f4c82ffd700 1 -- 172.21.15.103:0/2762006904 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c90009e30 con 0x7f4c94145690 2020-04-22T14:02:30.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.260+0000 7f4c994e1700 1 --2- 172.21.15.103:0/2762006904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c94145690 0x7f4c940aea70 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f4c900010d0 tx=0x7f4c900015b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:30.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.260+0000 7f4c82ffd700 1 -- 172.21.15.103:0/2762006904 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c900066d0 con 0x7f4c94145690 2020-04-22T14:02:30.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.260+0000 7f4c9bf46700 1 -- 172.21.15.103:0/2762006904 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c940b11b0 con 0x7f4c94145690 2020-04-22T14:02:30.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.260+0000 7f4c82ffd700 1 -- 172.21.15.103:0/2762006904 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c90006af0 con 0x7f4c94145690 2020-04-22T14:02:30.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.260+0000 7f4c9bf46700 1 -- 172.21.15.103:0/2762006904 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c94142b60 con 0x7f4c94145690 2020-04-22T14:02:30.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.261+0000 7f4c994e1700 1 --2- 172.21.15.103:0/2762006904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c94145690 0x7f4c940aea70 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f4c900010d0 tx=0x7f4c900015b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:30.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.262+0000 7f4c9bf46700 1 -- 172.21.15.103:0/2762006904 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c94056c90 con 0x7f4c94145690 2020-04-22T14:02:30.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.262+0000 7f4c994e1700 1 --2- 172.21.15.103:0/2762006904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c94145690 0x7f4c940aea70 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f4c900010d0 tx=0x7f4c900015b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:30.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.262+0000 7f4c82ffd700 1 -- 172.21.15.103:0/2762006904 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f4c90006d60 con 0x7f4c94145690 2020-04-22T14:02:30.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.262+0000 7f4c82ffd700 1 --2- 172.21.15.103:0/2762006904 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4c7404da10 0x7f4c7404fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:30.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.262+0000 7f4c82ffd700 1 -- 172.21.15.103:0/2762006904 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4c90061af0 con 0x7f4c94145690 2020-04-22T14:02:30.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.262+0000 7f4c99ce2700 1 --2- 172.21.15.103:0/2762006904 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4c7404da10 0x7f4c7404fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:30.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.263+0000 7f4c99ce2700 1 --2- 172.21.15.103:0/2762006904 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4c7404da10 0x7f4c7404fed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4c941444f0 tx=0x7f4c84007700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:30.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.263+0000 7f4c99ce2700 1 --2- 172.21.15.103:0/2762006904 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4c7404da10 0x7f4c7404fed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4c941444f0 tx=0x7f4c84007700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:30.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.263+0000 7f4c99ce2700 1 --2- 172.21.15.103:0/2762006904 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4c7404da10 0x7f4c7404fed0 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7f4c941444f0 tx=0x7f4c84007700).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:30.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.266+0000 7f4c994e1700 1 --2- 172.21.15.103:0/2762006904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c94145690 0x7f4c940aea70 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f4c900010d0 tx=0x7f4c900015b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:30.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.266+0000 7f4c82ffd700 1 -- 172.21.15.103:0/2762006904 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f4c9003cef0 con 0x7f4c94145690 2020-04-22T14:02:30.412 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.410+0000 7f4c9bf46700 1 -- 172.21.15.103:0/2762006904 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c940b40c0 con 0x7f4c94145690 2020-04-22T14:02:30.413 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.411+0000 7f4c994e1700 1 --2- 172.21.15.103:0/2762006904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c94145690 0x7f4c940aea70 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f4c900010d0 tx=0x7f4c900015b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:30.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.411+0000 7f4c82ffd700 1 -- 172.21.15.103:0/2762006904 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f4c90040510 con 0x7f4c94145690 2020-04-22T14:02:30.414 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:02:30.414 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":24,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:02:28.687155+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:02:25.963043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-22T14:02:26.642611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:02:30.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.413+0000 7f4c9bf46700 1 -- 172.21.15.103:0/2762006904 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4c7404da10 msgr2=0x7f4c7404fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:30.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.413+0000 7f4c9bf46700 1 --2- 172.21.15.103:0/2762006904 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4c7404da10 0x7f4c7404fed0 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7f4c941444f0 tx=0x7f4c84007700).stop 2020-04-22T14:02:30.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.413+0000 7f4c9bf46700 1 -- 172.21.15.103:0/2762006904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c94145690 msgr2=0x7f4c940aea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:30.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.413+0000 7f4c9bf46700 1 --2- 172.21.15.103:0/2762006904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c94145690 0x7f4c940aea70 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7f4c900010d0 tx=0x7f4c900015b0).stop 2020-04-22T14:02:30.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.413+0000 7f4c9bf46700 1 -- 172.21.15.103:0/2762006904 shutdown_connections 2020-04-22T14:02:30.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.413+0000 7f4c9bf46700 1 --2- 172.21.15.103:0/2762006904 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4c7404da10 0x7f4c7404fed0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:30.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.413+0000 7f4c9bf46700 1 --2- 172.21.15.103:0/2762006904 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4c94143aa0 0x7f4c94143f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:30.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.413+0000 7f4c9bf46700 1 --2- 172.21.15.103:0/2762006904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c94145690 0x7f4c940aea70 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:30.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.413+0000 7f4c9bf46700 1 -- 172.21.15.103:0/2762006904 >> 172.21.15.103:0/2762006904 conn(0x7f4c940b9160 msgr2=0x7f4c94061670 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:30.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.413+0000 7f4c9bf46700 1 -- 172.21.15.103:0/2762006904 shutdown_connections 2020-04-22T14:02:30.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.413+0000 7f4c9bf46700 1 -- 172.21.15.103:0/2762006904 wait complete. 2020-04-22T14:02:30.428 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2020-04-22T14:02:30.428 INFO:tasks.ceph.mds.a:Restarting daemon 2020-04-22T14:02:30.429 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:30.450 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-04-22T14:02:30.492 INFO:tasks.ceph.mds.a:Started 2020-04-22T14:02:30.493 INFO:tasks.ceph.mds.b:Restarting daemon 2020-04-22T14:02:30.493 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:30.512 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-04-22T14:02:30.555 INFO:tasks.ceph.mds.b:Started 2020-04-22T14:02:30.556 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:30.557 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2020-04-22T14:02:30.565 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2020-04-22T14:02:30.570 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:02:30.635 INFO:tasks.ceph.mds.b.smithi086.stdout:starting mds.b at 2020-04-22T14:02:30.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.715+0000 7f3c73d7a700 1 Processor -- start 2020-04-22T14:02:30.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.715+0000 7f3c73d7a700 1 -- start start 2020-04-22T14:02:30.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.716+0000 7f3c73d7a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3c6c065fe0 0x7f3c6c1464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:30.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.716+0000 7f3c73d7a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3c6c063e30 0x7f3c6c0642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:30.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.716+0000 7f3c73d7a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c6c143300 con 0x7f3c6c12c0d0 2020-04-22T14:02:30.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.716+0000 7f3c73d7a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c6c1435a0 con 0x7f3c6c065fe0 2020-04-22T14:02:30.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.716+0000 7f3c73d7a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c6c143840 con 0x7f3c6c063e30 2020-04-22T14:02:30.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.716+0000 7f3c72317700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3c6c063e30 0x7f3c6c0642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:30.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.716+0000 7f3c72317700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3c6c063e30 0x7f3c6c0642c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47030/0 (socket says 172.21.15.103:47030) 2020-04-22T14:02:30.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.716+0000 7f3c72317700 1 -- 172.21.15.103:0/230383768 learned_addr learned my addr 172.21.15.103:0/230383768 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:30.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.716+0000 7f3c71315700 1 --2- 172.21.15.103:0/230383768 >> v2:172.21.15.86:3300/0 conn(0x7f3c6c065fe0 0x7f3c6c1464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:30.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.716+0000 7f3c72317700 1 -- 172.21.15.103:0/230383768 >> v2:172.21.15.86:3300/0 conn(0x7f3c6c065fe0 msgr2=0x7f3c6c1464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:30.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.716+0000 7f3c72317700 1 --2- 172.21.15.103:0/230383768 >> v2:172.21.15.86:3300/0 conn(0x7f3c6c065fe0 0x7f3c6c1464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:30.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.716+0000 7f3c72317700 1 -- 172.21.15.103:0/230383768 >> v1:172.21.15.86:6789/0 conn(0x7f3c6c12c0d0 legacy=0x7f3c6c05b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:30.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.716+0000 7f3c72317700 1 -- 172.21.15.103:0/230383768 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c6c05bb50 con 0x7f3c6c063e30 2020-04-22T14:02:30.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.716+0000 7f3c72317700 1 --2- 172.21.15.103:0/230383768 >> v2:172.21.15.103:3300/0 conn(0x7f3c6c063e30 0x7f3c6c0642c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3c68002f30 tx=0x7f3c68007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:30.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.716+0000 7f3c72317700 1 --2- 172.21.15.103:0/230383768 >> v2:172.21.15.103:3300/0 conn(0x7f3c6c063e30 0x7f3c6c0642c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3c68002f30 tx=0x7f3c68007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:30.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.716+0000 7f3c72317700 1 --2- 172.21.15.103:0/230383768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c6c063e30 0x7f3c6c0642c0 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7f3c68002f30 tx=0x7f3c68007a40).ready entity=mon.1 client_cookie=fe62e333a2dd201b server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:30.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.716+0000 7f3c72317700 1 --2- 172.21.15.103:0/230383768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c6c063e30 0x7f3c6c0642c0 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f3c68002f30 tx=0x7f3c68007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:30.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.716+0000 7f3c70b14700 1 -- 172.21.15.103:0/230383768 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c68011670 con 0x7f3c6c063e30 2020-04-22T14:02:30.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.716+0000 7f3c72317700 1 --2- 172.21.15.103:0/230383768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c6c063e30 0x7f3c6c0642c0 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f3c68002f30 tx=0x7f3c68007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:30.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.716+0000 7f3c70b14700 1 -- 172.21.15.103:0/230383768 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c680117d0 con 0x7f3c6c063e30 2020-04-22T14:02:30.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.716+0000 7f3c72317700 1 --2- 172.21.15.103:0/230383768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c6c063e30 0x7f3c6c0642c0 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f3c68002f30 tx=0x7f3c68007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:30.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.716+0000 7f3c70b14700 1 -- 172.21.15.103:0/230383768 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c68011bf0 con 0x7f3c6c063e30 2020-04-22T14:02:30.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.716+0000 7f3c73d7a700 1 -- 172.21.15.103:0/230383768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c6c063e30 msgr2=0x7f3c6c0642c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:30.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.716+0000 7f3c73d7a700 1 --2- 172.21.15.103:0/230383768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c6c063e30 0x7f3c6c0642c0 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7f3c68002f30 tx=0x7f3c68007a40).stop 2020-04-22T14:02:30.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.717+0000 7f3c73d7a700 1 -- 172.21.15.103:0/230383768 shutdown_connections 2020-04-22T14:02:30.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.717+0000 7f3c73d7a700 1 --2- 172.21.15.103:0/230383768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c6c063e30 0x7f3c6c0642c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:30.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.717+0000 7f3c73d7a700 1 --2- 172.21.15.103:0/230383768 >> v2:172.21.15.86:3300/0 conn(0x7f3c6c065fe0 0x7f3c6c1464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:30.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.717+0000 7f3c73d7a700 1 -- 172.21.15.103:0/230383768 >> 172.21.15.103:0/230383768 conn(0x7f3c6c0b9160 msgr2=0x7f3c6c05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:30.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.717+0000 7f3c73d7a700 1 -- 172.21.15.103:0/230383768 shutdown_connections 2020-04-22T14:02:30.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.717+0000 7f3c73d7a700 1 -- 172.21.15.103:0/230383768 wait complete. 2020-04-22T14:02:30.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.718+0000 7f3c73d7a700 1 Processor -- start 2020-04-22T14:02:30.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.718+0000 7f3c73d7a700 1 -- start start 2020-04-22T14:02:30.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.719+0000 7f3c73d7a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3c6c065fe0 0x7f3c6c128910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:30.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.719+0000 7f3c73d7a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c6c12c0d0 0x7f3c6c0b0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:30.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.719+0000 7f3c73d7a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c6c129130 con 0x7f3c6c063e30 2020-04-22T14:02:30.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.719+0000 7f3c73d7a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c6c128f50 con 0x7f3c6c065fe0 2020-04-22T14:02:30.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.719+0000 7f3c73d7a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c1293d0 con 0x7f3c6c12c0d0 2020-04-22T14:02:30.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.719+0000 7f3c71315700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3c6c065fe0 0x7f3c6c128910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:30.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.719+0000 7f3c71315700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3c6c065fe0 0x7f3c6c128910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:44266/0 (socket says 172.21.15.103:44266) 2020-04-22T14:02:30.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.719+0000 7f3c72317700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c6c12c0d0 0x7f3c6c0b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:30.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.719+0000 7f3c71315700 1 -- 172.21.15.103:0/3342411497 learned_addr learned my addr 172.21.15.103:0/3342411497 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:30.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.719+0000 7f3c71b16700 1 --1- 172.21.15.103:0/3342411497 >> v1:172.21.15.86:6789/0 conn(0x7f3c6c063e30 0x7f3c6c1508e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:56378/0 (socket says 172.21.15.103:56378) 2020-04-22T14:02:30.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.719+0000 7f3c72317700 1 -- 172.21.15.103:0/3342411497 >> v2:172.21.15.86:3300/0 conn(0x7f3c6c065fe0 msgr2=0x7f3c6c128910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:30.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.719+0000 7f3c72317700 1 --2- 172.21.15.103:0/3342411497 >> v2:172.21.15.86:3300/0 conn(0x7f3c6c065fe0 0x7f3c6c128910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:30.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.719+0000 7f3c72317700 1 -- 172.21.15.103:0/3342411497 >> v1:172.21.15.86:6789/0 conn(0x7f3c6c063e30 legacy=0x7f3c6c1508e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:30.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.719+0000 7f3c72317700 1 -- 172.21.15.103:0/3342411497 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c6c0b11c0 con 0x7f3c6c12c0d0 2020-04-22T14:02:30.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.719+0000 7f3c72317700 1 --2- 172.21.15.103:0/3342411497 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c6c12c0d0 0x7f3c6c0b0440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3c68002f30 tx=0x7f3c68007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:30.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.719+0000 7f3c72317700 1 --2- 172.21.15.103:0/3342411497 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c6c12c0d0 0x7f3c6c0b0440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3c68002f30 tx=0x7f3c68007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:30.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.719+0000 7f3c72317700 1 --2- 172.21.15.103:0/3342411497 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c6c12c0d0 0x7f3c6c0b0440 secure :-1 s=READY pgs=21 cs=0 l=1 rx=0x7f3c68002f30 tx=0x7f3c68007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:30.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.719+0000 7f3c72317700 1 --2- 172.21.15.103:0/3342411497 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c6c12c0d0 0x7f3c6c0b0440 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f3c68002f30 tx=0x7f3c68007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:30.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.719+0000 7f3c5effd700 1 -- 172.21.15.103:0/3342411497 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c68007170 con 0x7f3c6c12c0d0 2020-04-22T14:02:30.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.719+0000 7f3c72317700 1 --2- 172.21.15.103:0/3342411497 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c6c12c0d0 0x7f3c6c0b0440 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f3c68002f30 tx=0x7f3c68007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:30.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.719+0000 7f3c72317700 1 --2- 172.21.15.103:0/3342411497 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c6c12c0d0 0x7f3c6c0b0440 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f3c68002f30 tx=0x7f3c68007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:30.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.719+0000 7f3c5effd700 1 -- 172.21.15.103:0/3342411497 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c680072d0 con 0x7f3c6c12c0d0 2020-04-22T14:02:30.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.719+0000 7f3c73d7a700 1 -- 172.21.15.103:0/3342411497 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c6c150ff0 con 0x7f3c6c12c0d0 2020-04-22T14:02:30.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.719+0000 7f3c5effd700 1 -- 172.21.15.103:0/3342411497 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c680056c0 con 0x7f3c6c12c0d0 2020-04-22T14:02:30.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.719+0000 7f3c73d7a700 1 -- 172.21.15.103:0/3342411497 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c6c0b0ae0 con 0x7f3c6c12c0d0 2020-04-22T14:02:30.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.720+0000 7f3c72317700 1 --2- 172.21.15.103:0/3342411497 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c6c12c0d0 0x7f3c6c0b0440 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f3c68002f30 tx=0x7f3c68007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:30.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.720+0000 7f3c5effd700 1 -- 172.21.15.103:0/3342411497 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f3c680058c0 con 0x7f3c6c12c0d0 2020-04-22T14:02:30.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.720+0000 7f3c72317700 1 --2- 172.21.15.103:0/3342411497 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c6c12c0d0 0x7f3c6c0b0440 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f3c68002f30 tx=0x7f3c68007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:30.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.720+0000 7f3c73d7a700 1 -- 172.21.15.103:0/3342411497 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c6c056c90 con 0x7f3c6c12c0d0 2020-04-22T14:02:30.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.721+0000 7f3c5effd700 1 --2- 172.21.15.103:0/3342411497 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3c4c04d9c0 0x7f3c4c04fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:30.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.721+0000 7f3c5effd700 1 -- 172.21.15.103:0/3342411497 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3c68061a30 con 0x7f3c6c12c0d0 2020-04-22T14:02:30.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.721+0000 7f3c71b16700 1 --2- 172.21.15.103:0/3342411497 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3c4c04d9c0 0x7f3c4c04fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:30.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.721+0000 7f3c71b16700 1 --2- 172.21.15.103:0/3342411497 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3c4c04d9c0 0x7f3c4c04fe80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3c6c0b7e20 tx=0x7f3c640018d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:30.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.721+0000 7f3c71b16700 1 --2- 172.21.15.103:0/3342411497 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3c4c04d9c0 0x7f3c4c04fe80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3c6c0b7e20 tx=0x7f3c640018d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:30.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.721+0000 7f3c71b16700 1 --2- 172.21.15.103:0/3342411497 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3c4c04d9c0 0x7f3c4c04fe80 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7f3c6c0b7e20 tx=0x7f3c640018d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:30.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.724+0000 7f3c72317700 1 --2- 172.21.15.103:0/3342411497 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c6c12c0d0 0x7f3c6c0b0440 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f3c68002f30 tx=0x7f3c68007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:30.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.724+0000 7f3c5effd700 1 -- 172.21.15.103:0/3342411497 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f3c6803ce70 con 0x7f3c6c12c0d0 2020-04-22T14:02:30.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.868+0000 7f3c73d7a700 1 -- 172.21.15.103:0/3342411497 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c6c147360 con 0x7f3c6c12c0d0 2020-04-22T14:02:30.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.870+0000 7f3c72317700 1 --2- 172.21.15.103:0/3342411497 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c6c12c0d0 0x7f3c6c0b0440 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f3c68002f30 tx=0x7f3c68007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:30.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.870+0000 7f3c5effd700 1 -- 172.21.15.103:0/3342411497 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f3c68040490 con 0x7f3c6c12c0d0 2020-04-22T14:02:30.872 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:02:30.872 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":24,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:02:28.687155+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:02:25.963043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-22T14:02:26.642611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:02:30.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.871+0000 7f3c73d7a700 1 -- 172.21.15.103:0/3342411497 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3c4c04d9c0 msgr2=0x7f3c4c04fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:30.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.871+0000 7f3c73d7a700 1 --2- 172.21.15.103:0/3342411497 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3c4c04d9c0 0x7f3c4c04fe80 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7f3c6c0b7e20 tx=0x7f3c640018d0).stop 2020-04-22T14:02:30.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.871+0000 7f3c73d7a700 1 -- 172.21.15.103:0/3342411497 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c6c12c0d0 msgr2=0x7f3c6c0b0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:30.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.871+0000 7f3c73d7a700 1 --2- 172.21.15.103:0/3342411497 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c6c12c0d0 0x7f3c6c0b0440 secure :-1 s=READY pgs=21 cs=0 l=1 rx=0x7f3c68002f30 tx=0x7f3c68007a40).stop 2020-04-22T14:02:30.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.871+0000 7f3c73d7a700 1 -- 172.21.15.103:0/3342411497 shutdown_connections 2020-04-22T14:02:30.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.871+0000 7f3c73d7a700 1 --2- 172.21.15.103:0/3342411497 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c6c12c0d0 0x7f3c6c0b0440 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:30.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.871+0000 7f3c73d7a700 1 --2- 172.21.15.103:0/3342411497 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3c4c04d9c0 0x7f3c4c04fe80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:30.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.871+0000 7f3c73d7a700 1 --2- 172.21.15.103:0/3342411497 >> v2:172.21.15.86:3300/0 conn(0x7f3c6c065fe0 0x7f3c6c128910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:30.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.871+0000 7f3c73d7a700 1 -- 172.21.15.103:0/3342411497 >> 172.21.15.103:0/3342411497 conn(0x7f3c6c0b9160 msgr2=0x7f3c6c0615e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:30.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.871+0000 7f3c73d7a700 1 -- 172.21.15.103:0/3342411497 shutdown_connections 2020-04-22T14:02:30.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:30.871+0000 7f3c73d7a700 1 -- 172.21.15.103:0/3342411497 wait complete. 2020-04-22T14:02:30.884 INFO:tasks.ceph.ceph_manager.ceph:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:25.963043+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:26.642611+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 4, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'24', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:02:30.884 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:30.899 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:02:31.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.045+0000 7f73e59f2700 1 Processor -- start 2020-04-22T14:02:31.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.045+0000 7f73e59f2700 1 -- start start 2020-04-22T14:02:31.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.046+0000 7f73e59f2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f73e00ac950 0x7f73e0146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:31.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.046+0000 7f73e59f2700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e01467e0 con 0x7f73e01470a0 2020-04-22T14:02:31.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.046+0000 7f73e59f2700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e0060050 con 0x7f73e00b9140 2020-04-22T14:02:31.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.046+0000 7f73e59f2700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73e0147530 con 0x7f73e00ac950 2020-04-22T14:02:31.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.046+0000 7f73de7fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f73e00ac950 0x7f73e0146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:31.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.046+0000 7f73deffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f73e00b9140 0x7f73e012b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39230/0 (socket says 172.21.15.103:39230) 2020-04-22T14:02:31.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.046+0000 7f73deffd700 1 -- 172.21.15.103:0/198453986 learned_addr learned my addr 172.21.15.103:0/198453986 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:31.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.046+0000 7f73de7fc700 1 -- 172.21.15.103:0/198453986 >> v1:172.21.15.103:6789/0 conn(0x7f73e00b9140 legacy=0x7f73e012b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:31.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.046+0000 7f73de7fc700 1 -- 172.21.15.103:0/198453986 >> v1:172.21.15.86:6789/0 conn(0x7f73e01470a0 legacy=0x7f73e0143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:31.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.046+0000 7f73de7fc700 1 -- 172.21.15.103:0/198453986 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e00b9520 con 0x7f73e00ac950 2020-04-22T14:02:31.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.046+0000 7f73de7fc700 1 --2- 172.21.15.103:0/198453986 >> v2:172.21.15.103:3300/0 conn(0x7f73e00ac950 0x7f73e0146c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f73e00b6250 tx=0x7f73d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.046+0000 7f73de7fc700 1 --2- 172.21.15.103:0/198453986 >> v2:172.21.15.103:3300/0 conn(0x7f73e00ac950 0x7f73e0146c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f73e00b6250 tx=0x7f73d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.046+0000 7f73de7fc700 1 --2- 172.21.15.103:0/198453986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73e00ac950 0x7f73e0146c40 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7f73e00b6250 tx=0x7f73d0007a40).ready entity=mon.1 client_cookie=656e0e142305fe11 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:31.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.047+0000 7f73de7fc700 1 --2- 172.21.15.103:0/198453986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73e00ac950 0x7f73e0146c40 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f73e00b6250 tx=0x7f73d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.047+0000 7f73ddffb700 1 -- 172.21.15.103:0/198453986 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73d0011430 con 0x7f73e00ac950 2020-04-22T14:02:31.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.047+0000 7f73de7fc700 1 --2- 172.21.15.103:0/198453986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73e00ac950 0x7f73e0146c40 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f73e00b6250 tx=0x7f73d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.047+0000 7f73ddffb700 1 -- 172.21.15.103:0/198453986 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d0011590 con 0x7f73e00ac950 2020-04-22T14:02:31.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.047+0000 7f73de7fc700 1 --2- 172.21.15.103:0/198453986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73e00ac950 0x7f73e0146c40 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f73e00b6250 tx=0x7f73d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.047+0000 7f73ddffb700 1 -- 172.21.15.103:0/198453986 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73d00119b0 con 0x7f73e00ac950 2020-04-22T14:02:31.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.047+0000 7f73e59f2700 1 -- 172.21.15.103:0/198453986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73e00ac950 msgr2=0x7f73e0146c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:31.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.047+0000 7f73e59f2700 1 --2- 172.21.15.103:0/198453986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73e00ac950 0x7f73e0146c40 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7f73e00b6250 tx=0x7f73d0007a40).stop 2020-04-22T14:02:31.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.047+0000 7f73e59f2700 1 -- 172.21.15.103:0/198453986 shutdown_connections 2020-04-22T14:02:31.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.047+0000 7f73e59f2700 1 --2- 172.21.15.103:0/198453986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73e00ac950 0x7f73e0146c40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:31.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.047+0000 7f73e59f2700 1 -- 172.21.15.103:0/198453986 >> 172.21.15.103:0/198453986 conn(0x7f73e005b7b0 msgr2=0x7f73e00b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:31.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.047+0000 7f73e59f2700 1 -- 172.21.15.103:0/198453986 shutdown_connections 2020-04-22T14:02:31.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.047+0000 7f73e59f2700 1 -- 172.21.15.103:0/198453986 wait complete. 2020-04-22T14:02:31.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.048+0000 7f73e59f2700 1 Processor -- start 2020-04-22T14:02:31.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.048+0000 7f73e59f2700 1 -- start start 2020-04-22T14:02:31.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.049+0000 7f73e59f2700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f73e00ac950 0x7f73e0142a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:31.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.049+0000 7f73e59f2700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e00b1ea0 con 0x7f73e00b9140 2020-04-22T14:02:31.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.049+0000 7f73e59f2700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e00b2140 con 0x7f73e01470a0 2020-04-22T14:02:31.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.049+0000 7f73e59f2700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73e0155860 con 0x7f73e00ac950 2020-04-22T14:02:31.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.049+0000 7f73df7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f73e01470a0 0x7f73e013f350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39238/0 (socket says 172.21.15.103:39238) 2020-04-22T14:02:31.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.049+0000 7f73df7fe700 1 -- 172.21.15.103:0/594452023 learned_addr learned my addr 172.21.15.103:0/594452023 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:31.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.049+0000 7f73deffd700 1 --2- 172.21.15.103:0/594452023 >> v2:172.21.15.86:3300/0 conn(0x7f73e00ac950 0x7f73e0142a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:31.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.049+0000 7f73cffff700 1 -- 172.21.15.103:0/594452023 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4280451357 0 0) 0x7f73e00b2140 con 0x7f73e01470a0 2020-04-22T14:02:31.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.049+0000 7f73cffff700 1 -- 172.21.15.103:0/594452023 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73bc002fe0 con 0x7f73e01470a0 2020-04-22T14:02:31.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.049+0000 7f73cffff700 1 -- 172.21.15.103:0/594452023 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 653715182 0 0) 0x7f73bc002fe0 con 0x7f73e01470a0 2020-04-22T14:02:31.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.049+0000 7f73cffff700 1 -- 172.21.15.103:0/594452023 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f73e00b2140 con 0x7f73e01470a0 2020-04-22T14:02:31.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.049+0000 7f73cffff700 1 -- 172.21.15.103:0/594452023 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f73d8002c10 con 0x7f73e01470a0 2020-04-22T14:02:31.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.049+0000 7f73cffff700 1 -- 172.21.15.103:0/594452023 >> v2:172.21.15.86:3300/0 conn(0x7f73e00ac950 msgr2=0x7f73e0142a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:31.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.049+0000 7f73cffff700 1 --2- 172.21.15.103:0/594452023 >> v2:172.21.15.86:3300/0 conn(0x7f73e00ac950 0x7f73e0142a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:31.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.049+0000 7f73cffff700 1 -- 172.21.15.103:0/594452023 >> v1:172.21.15.103:6789/0 conn(0x7f73e01470a0 legacy=0x7f73e013f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:31.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.049+0000 7f73cffff700 1 -- 172.21.15.103:0/594452023 >> v1:172.21.15.86:6789/0 conn(0x7f73e00b9140 legacy=0x7f73e0155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:31.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.049+0000 7f73cffff700 1 --2- 172.21.15.103:0/594452023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73bc0049b0 0x7f73bc004db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:31.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.049+0000 7f73cffff700 1 --2- 172.21.15.103:0/594452023 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73bc003920 0x7f73bc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:31.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.050+0000 7f73cffff700 1 --2- 172.21.15.103:0/594452023 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f73bc004200 0x7f73bc00b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:31.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.050+0000 7f73cffff700 1 -- 172.21.15.103:0/594452023 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e0155860 con 0x7f73bc0049b0 2020-04-22T14:02:31.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.050+0000 7f73cffff700 1 -- 172.21.15.103:0/594452023 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc004790 con 0x7f73bc003920 2020-04-22T14:02:31.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.050+0000 7f73cffff700 1 -- 172.21.15.103:0/594452023 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc00bbe0 con 0x7f73bc004200 2020-04-22T14:02:31.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.050+0000 7f73de7fc700 1 --2- 172.21.15.103:0/594452023 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73bc003920 0x7f73bc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:31.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.050+0000 7f73deffd700 1 --2- 172.21.15.103:0/594452023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73bc0049b0 0x7f73bc004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:31.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.050+0000 7f73df7fe700 1 --2- 172.21.15.103:0/594452023 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f73bc004200 0x7f73bc00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:31.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.050+0000 7f73de7fc700 1 -- 172.21.15.103:0/594452023 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f73bc004200 msgr2=0x7f73bc00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:31.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.050+0000 7f73de7fc700 1 --2- 172.21.15.103:0/594452023 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f73bc004200 0x7f73bc00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:31.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.050+0000 7f73de7fc700 1 -- 172.21.15.103:0/594452023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73bc0049b0 msgr2=0x7f73bc004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:31.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.050+0000 7f73de7fc700 1 --2- 172.21.15.103:0/594452023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73bc0049b0 0x7f73bc004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:31.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.050+0000 7f73de7fc700 1 -- 172.21.15.103:0/594452023 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e0063060 con 0x7f73bc003920 2020-04-22T14:02:31.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.050+0000 7f73df7fe700 1 -- 172.21.15.103:0/594452023 reap_dead start 2020-04-22T14:02:31.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.050+0000 7f73e59f2700 1 -- 172.21.15.103:0/594452023 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e00b1a00 con 0x7f73bc003920 2020-04-22T14:02:31.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.050+0000 7f73de7fc700 1 --2- 172.21.15.103:0/594452023 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73bc003920 0x7f73bc003da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f73e00b6090 tx=0x7f73d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.050+0000 7f73e59f2700 1 -- 172.21.15.103:0/594452023 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e0142a70 con 0x7f73bc003920 2020-04-22T14:02:31.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.050+0000 7f73de7fc700 1 --2- 172.21.15.103:0/594452023 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73bc003920 0x7f73bc003da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f73e00b6090 tx=0x7f73d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.050+0000 7f73de7fc700 1 --2- 172.21.15.103:0/594452023 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73bc003920 0x7f73bc003da0 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7f73e00b6090 tx=0x7f73d0007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:31.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.050+0000 7f73de7fc700 1 --2- 172.21.15.103:0/594452023 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73bc003920 0x7f73bc003da0 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f73e00b6090 tx=0x7f73d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.050+0000 7f73cffff700 1 -- 172.21.15.103:0/594452023 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73d0007170 con 0x7f73bc003920 2020-04-22T14:02:31.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.050+0000 7f73de7fc700 1 --2- 172.21.15.103:0/594452023 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73bc003920 0x7f73bc003da0 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f73e00b6090 tx=0x7f73d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.050+0000 7f73de7fc700 1 --2- 172.21.15.103:0/594452023 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73bc003920 0x7f73bc003da0 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f73e00b6090 tx=0x7f73d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.050+0000 7f73cffff700 1 -- 172.21.15.103:0/594452023 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d00072d0 con 0x7f73bc003920 2020-04-22T14:02:31.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.050+0000 7f73cffff700 1 -- 172.21.15.103:0/594452023 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73d00056c0 con 0x7f73bc003920 2020-04-22T14:02:31.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.051+0000 7f73de7fc700 1 --2- 172.21.15.103:0/594452023 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73bc003920 0x7f73bc003da0 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f73e00b6090 tx=0x7f73d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.051+0000 7f73e59f2700 1 -- 172.21.15.103:0/594452023 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73c0003340 con 0x7f73bc003920 2020-04-22T14:02:31.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.051+0000 7f73cffff700 1 -- 172.21.15.103:0/594452023 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f73d0005820 con 0x7f73bc003920 2020-04-22T14:02:31.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.051+0000 7f73de7fc700 1 --2- 172.21.15.103:0/594452023 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73bc003920 0x7f73bc003da0 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f73e00b6090 tx=0x7f73d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.051+0000 7f73cffff700 1 --2- 172.21.15.103:0/594452023 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f73bc051990 0x7f73bc053e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:31.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.051+0000 7f73cffff700 1 -- 172.21.15.103:0/594452023 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f73d0061960 con 0x7f73bc003920 2020-04-22T14:02:31.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.051+0000 7f73deffd700 1 --2- 172.21.15.103:0/594452023 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f73bc051990 0x7f73bc053e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:31.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.052+0000 7f73deffd700 1 --2- 172.21.15.103:0/594452023 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f73bc051990 0x7f73bc053e50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f73d4000fe0 tx=0x7f73d4001150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.052+0000 7f73deffd700 1 --2- 172.21.15.103:0/594452023 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f73bc051990 0x7f73bc053e50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f73d4000fe0 tx=0x7f73d4001150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.052+0000 7f73deffd700 1 --2- 172.21.15.103:0/594452023 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f73bc051990 0x7f73bc053e50 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7f73d4000fe0 tx=0x7f73d4001150).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:31.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.055+0000 7f73de7fc700 1 --2- 172.21.15.103:0/594452023 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73bc003920 0x7f73bc003da0 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f73e00b6090 tx=0x7f73d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.055+0000 7f73cffff700 1 -- 172.21.15.103:0/594452023 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f73d003ce60 con 0x7f73bc003920 2020-04-22T14:02:31.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.196+0000 7f73e59f2700 1 -- 172.21.15.103:0/594452023 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f73c0002220 con 0x7f73bc003920 2020-04-22T14:02:31.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.197+0000 7f73de7fc700 1 --2- 172.21.15.103:0/594452023 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73bc003920 0x7f73bc003da0 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f73e00b6090 tx=0x7f73d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.197+0000 7f73cffff700 1 -- 172.21.15.103:0/594452023 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v24) v1 ==== 110+0+10 (secure 0 0 0) 0x7f73d0040480 con 0x7f73bc003920 2020-04-22T14:02:31.199 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:02:31.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.198+0000 7f73e59f2700 1 -- 172.21.15.103:0/594452023 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f73bc051990 msgr2=0x7f73bc053e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:31.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.198+0000 7f73e59f2700 1 --2- 172.21.15.103:0/594452023 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f73bc051990 0x7f73bc053e50 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7f73d4000fe0 tx=0x7f73d4001150).stop 2020-04-22T14:02:31.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.198+0000 7f73e59f2700 1 -- 172.21.15.103:0/594452023 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73bc003920 msgr2=0x7f73bc003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:31.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.198+0000 7f73e59f2700 1 --2- 172.21.15.103:0/594452023 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73bc003920 0x7f73bc003da0 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7f73e00b6090 tx=0x7f73d0007a40).stop 2020-04-22T14:02:31.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.198+0000 7f73e59f2700 1 -- 172.21.15.103:0/594452023 shutdown_connections 2020-04-22T14:02:31.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.198+0000 7f73e59f2700 1 --2- 172.21.15.103:0/594452023 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f73bc051990 0x7f73bc053e50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:31.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.198+0000 7f73e59f2700 1 --2- 172.21.15.103:0/594452023 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73bc003920 0x7f73bc003da0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:31.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.198+0000 7f73e59f2700 1 -- 172.21.15.103:0/594452023 >> 172.21.15.103:0/594452023 conn(0x7f73e005b7b0 msgr2=0x7f73e0141190 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:31.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.198+0000 7f73e59f2700 1 -- 172.21.15.103:0/594452023 shutdown_connections 2020-04-22T14:02:31.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.198+0000 7f73e59f2700 1 -- 172.21.15.103:0/594452023 wait complete. 2020-04-22T14:02:31.210 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:31.223 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:02:31.379 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.377+0000 7f85d3b6a700 1 Processor -- start 2020-04-22T14:02:31.379 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.377+0000 7f85d3b6a700 1 -- start start 2020-04-22T14:02:31.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.377+0000 7f85d3b6a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f85cc0ac950 0x7f85cc146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:31.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.378+0000 7f85d3b6a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f85cc1470a0 0x7f85cc143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:31.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.378+0000 7f85d3b6a700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85cc1467e0 con 0x7f85cc0b9140 2020-04-22T14:02:31.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.378+0000 7f85d3b6a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85cc0602f0 con 0x7f85cc1470a0 2020-04-22T14:02:31.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.378+0000 7f85d3b6a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85cc060050 con 0x7f85cc0ac950 2020-04-22T14:02:31.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.378+0000 7f85d2107700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f85cc1470a0 0x7f85cc143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:31.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.378+0000 7f85d1906700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f85cc0b9140 0x7f85cc12b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39260/0 (socket says 172.21.15.103:39260) 2020-04-22T14:02:31.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.378+0000 7f85d1906700 1 -- 172.21.15.103:0/2544465155 learned_addr learned my addr 172.21.15.103:0/2544465155 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:31.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.378+0000 7f85d1105700 1 --2- 172.21.15.103:0/2544465155 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f85cc0ac950 0x7f85cc146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:31.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.378+0000 7f85d2107700 1 -- 172.21.15.103:0/2544465155 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f85cc0ac950 msgr2=0x7f85cc146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:31.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.378+0000 7f85d2107700 1 --2- 172.21.15.103:0/2544465155 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f85cc0ac950 0x7f85cc146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:31.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.378+0000 7f85d2107700 1 -- 172.21.15.103:0/2544465155 >> v1:172.21.15.103:6789/0 conn(0x7f85cc0b9140 legacy=0x7f85cc12b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:31.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.378+0000 7f85d0904700 1 -- 172.21.15.103:0/2544465155 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 773913986 0 0) 0x7f85cc1467e0 con 0x7f85cc0b9140 2020-04-22T14:02:31.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.378+0000 7f85d2107700 1 -- 172.21.15.103:0/2544465155 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85cc0b9520 con 0x7f85cc1470a0 2020-04-22T14:02:31.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.378+0000 7f85d1105700 1 --2- 172.21.15.103:0/2544465155 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f85cc0ac950 0x7f85cc146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:02:31.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.378+0000 7f85d2107700 1 --2- 172.21.15.103:0/2544465155 >> v2:172.21.15.103:3300/0 conn(0x7f85cc1470a0 0x7f85cc143090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f85c40032b0 tx=0x7f85c4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.378+0000 7f85d2107700 1 --2- 172.21.15.103:0/2544465155 >> v2:172.21.15.103:3300/0 conn(0x7f85cc1470a0 0x7f85cc143090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f85c40032b0 tx=0x7f85c4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.378+0000 7f85d2107700 1 --2- 172.21.15.103:0/2544465155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85cc1470a0 0x7f85cc143090 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7f85c40032b0 tx=0x7f85c4007dc0).ready entity=mon.1 client_cookie=f1261b96b525c67f server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:31.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.378+0000 7f85d2107700 1 --2- 172.21.15.103:0/2544465155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85cc1470a0 0x7f85cc143090 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f85c40032b0 tx=0x7f85c4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.378+0000 7f85d0904700 1 -- 172.21.15.103:0/2544465155 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85c400a180 con 0x7f85cc1470a0 2020-04-22T14:02:31.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.378+0000 7f85d2107700 1 --2- 172.21.15.103:0/2544465155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85cc1470a0 0x7f85cc143090 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f85c40032b0 tx=0x7f85c4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.378+0000 7f85d0904700 1 -- 172.21.15.103:0/2544465155 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c400a320 con 0x7f85cc1470a0 2020-04-22T14:02:31.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.378+0000 7f85d2107700 1 --2- 172.21.15.103:0/2544465155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85cc1470a0 0x7f85cc143090 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f85c40032b0 tx=0x7f85c4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.378+0000 7f85d0904700 1 -- 172.21.15.103:0/2544465155 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85c400a700 con 0x7f85cc1470a0 2020-04-22T14:02:31.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.378+0000 7f85d3b6a700 1 -- 172.21.15.103:0/2544465155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85cc1470a0 msgr2=0x7f85cc143090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:31.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.378+0000 7f85d3b6a700 1 --2- 172.21.15.103:0/2544465155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85cc1470a0 0x7f85cc143090 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7f85c40032b0 tx=0x7f85c4007dc0).stop 2020-04-22T14:02:31.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.379+0000 7f85d3b6a700 1 -- 172.21.15.103:0/2544465155 shutdown_connections 2020-04-22T14:02:31.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.379+0000 7f85d3b6a700 1 --2- 172.21.15.103:0/2544465155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85cc1470a0 0x7f85cc143090 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:31.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.379+0000 7f85d3b6a700 1 --2- 172.21.15.103:0/2544465155 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f85cc0ac950 0x7f85cc146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:31.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.379+0000 7f85d3b6a700 1 -- 172.21.15.103:0/2544465155 >> 172.21.15.103:0/2544465155 conn(0x7f85cc05b7b0 msgr2=0x7f85cc0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:31.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.379+0000 7f85d3b6a700 1 -- 172.21.15.103:0/2544465155 shutdown_connections 2020-04-22T14:02:31.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.379+0000 7f85d3b6a700 1 -- 172.21.15.103:0/2544465155 wait complete. 2020-04-22T14:02:31.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.380+0000 7f85d3b6a700 1 Processor -- start 2020-04-22T14:02:31.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.380+0000 7f85d3b6a700 1 -- start start 2020-04-22T14:02:31.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.380+0000 7f85d3b6a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f85cc0ac950 0x7f85cc144880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:31.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.380+0000 7f85d3b6a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f85cc1470a0 0x7f85cc125f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:31.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.380+0000 7f85d3b6a700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85cc144ce0 con 0x7f85cc0b9140 2020-04-22T14:02:31.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.380+0000 7f85d3b6a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85cc126a90 con 0x7f85cc0ac950 2020-04-22T14:02:31.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.380+0000 7f85d3b6a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85cc126d30 con 0x7f85cc1470a0 2020-04-22T14:02:31.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.381+0000 7f85d1105700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f85cc0b9140 0x7f85cc065ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39268/0 (socket says 172.21.15.103:39268) 2020-04-22T14:02:31.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.381+0000 7f85d1105700 1 -- 172.21.15.103:0/4131179427 learned_addr learned my addr 172.21.15.103:0/4131179427 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:31.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.381+0000 7f85d2107700 1 --2- 172.21.15.103:0/4131179427 >> v2:172.21.15.103:3300/0 conn(0x7f85cc1470a0 0x7f85cc125f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:31.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.381+0000 7f85d1906700 1 --2- 172.21.15.103:0/4131179427 >> v2:172.21.15.86:3300/0 conn(0x7f85cc0ac950 0x7f85cc144880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:31.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.381+0000 7f85caffd700 1 -- 172.21.15.103:0/4131179427 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4214994190 0 0) 0x7f85c0001ec0 con 0x7f85cc0b9140 2020-04-22T14:02:31.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.381+0000 7f85caffd700 1 -- 172.21.15.103:0/4131179427 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85ac002fe0 con 0x7f85cc0b9140 2020-04-22T14:02:31.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.381+0000 7f85d2107700 1 -- 172.21.15.103:0/4131179427 >> v2:172.21.15.86:3300/0 conn(0x7f85cc0ac950 msgr2=0x7f85cc144880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:31.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.381+0000 7f85d2107700 1 --2- 172.21.15.103:0/4131179427 >> v2:172.21.15.86:3300/0 conn(0x7f85cc0ac950 0x7f85cc144880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:31.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.381+0000 7f85d2107700 1 -- 172.21.15.103:0/4131179427 >> v1:172.21.15.103:6789/0 conn(0x7f85cc0b9140 legacy=0x7f85cc065ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:31.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.381+0000 7f85d2107700 1 -- 172.21.15.103:0/4131179427 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85cc126fd0 con 0x7f85cc1470a0 2020-04-22T14:02:31.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.381+0000 7f85d2107700 1 --2- 172.21.15.103:0/4131179427 >> v2:172.21.15.103:3300/0 conn(0x7f85cc1470a0 0x7f85cc125f60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f85c40032b0 tx=0x7f85c4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.381+0000 7f85d2107700 1 --2- 172.21.15.103:0/4131179427 >> v2:172.21.15.103:3300/0 conn(0x7f85cc1470a0 0x7f85cc125f60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f85c40032b0 tx=0x7f85c4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.381+0000 7f85d2107700 1 --2- 172.21.15.103:0/4131179427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85cc1470a0 0x7f85cc125f60 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7f85c40032b0 tx=0x7f85c4007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:31.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.381+0000 7f85d2107700 1 --2- 172.21.15.103:0/4131179427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85cc1470a0 0x7f85cc125f60 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f85c40032b0 tx=0x7f85c4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.381+0000 7f85caffd700 1 -- 172.21.15.103:0/4131179427 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85c4005c30 con 0x7f85cc1470a0 2020-04-22T14:02:31.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.381+0000 7f85d2107700 1 --2- 172.21.15.103:0/4131179427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85cc1470a0 0x7f85cc125f60 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f85c40032b0 tx=0x7f85c4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.381+0000 7f85d2107700 1 --2- 172.21.15.103:0/4131179427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85cc1470a0 0x7f85cc125f60 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f85c40032b0 tx=0x7f85c4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.381+0000 7f85caffd700 1 -- 172.21.15.103:0/4131179427 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c4005d90 con 0x7f85cc1470a0 2020-04-22T14:02:31.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.381+0000 7f85caffd700 1 -- 172.21.15.103:0/4131179427 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85c400f590 con 0x7f85cc1470a0 2020-04-22T14:02:31.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.381+0000 7f85d3b6a700 1 -- 172.21.15.103:0/4131179427 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85cc0b5e60 con 0x7f85cc1470a0 2020-04-22T14:02:31.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.381+0000 7f85d3b6a700 1 -- 172.21.15.103:0/4131179427 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85cc126600 con 0x7f85cc1470a0 2020-04-22T14:02:31.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.382+0000 7f85d2107700 1 --2- 172.21.15.103:0/4131179427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85cc1470a0 0x7f85cc125f60 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f85c40032b0 tx=0x7f85c4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.382+0000 7f85d3b6a700 1 -- 172.21.15.103:0/4131179427 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85cc127160 con 0x7f85cc1470a0 2020-04-22T14:02:31.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.382+0000 7f85caffd700 1 -- 172.21.15.103:0/4131179427 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f85c400f800 con 0x7f85cc1470a0 2020-04-22T14:02:31.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.382+0000 7f85d2107700 1 --2- 172.21.15.103:0/4131179427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85cc1470a0 0x7f85cc125f60 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f85c40032b0 tx=0x7f85c4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.383+0000 7f85caffd700 1 --2- 172.21.15.103:0/4131179427 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f85ac04dd00 0x7f85ac0501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:31.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.383+0000 7f85caffd700 1 -- 172.21.15.103:0/4131179427 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f85c40622e0 con 0x7f85cc1470a0 2020-04-22T14:02:31.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.383+0000 7f85d1906700 1 --2- 172.21.15.103:0/4131179427 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f85ac04dd00 0x7f85ac0501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:31.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.383+0000 7f85d1906700 1 --2- 172.21.15.103:0/4131179427 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f85ac04dd00 0x7f85ac0501c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f85bc000b80 tx=0x7f85bc001800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.383+0000 7f85d1906700 1 --2- 172.21.15.103:0/4131179427 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f85ac04dd00 0x7f85ac0501c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f85bc000b80 tx=0x7f85bc001800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.383+0000 7f85d1906700 1 --2- 172.21.15.103:0/4131179427 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f85ac04dd00 0x7f85ac0501c0 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7f85bc000b80 tx=0x7f85bc001800).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:31.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.387+0000 7f85d2107700 1 --2- 172.21.15.103:0/4131179427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85cc1470a0 0x7f85cc125f60 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f85c40032b0 tx=0x7f85c4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.387+0000 7f85caffd700 1 -- 172.21.15.103:0/4131179427 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f85c403d6c0 con 0x7f85cc1470a0 2020-04-22T14:02:31.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.528+0000 7f85d3b6a700 1 -- 172.21.15.103:0/4131179427 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f85cc056c90 con 0x7f85cc1470a0 2020-04-22T14:02:31.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.529+0000 7f85d2107700 1 --2- 172.21.15.103:0/4131179427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85cc1470a0 0x7f85cc125f60 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f85c40032b0 tx=0x7f85c4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.529+0000 7f85caffd700 1 -- 172.21.15.103:0/4131179427 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f85c4040ce0 con 0x7f85cc1470a0 2020-04-22T14:02:31.531 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:02:31.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.530+0000 7f85d3b6a700 1 -- 172.21.15.103:0/4131179427 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f85ac04dd00 msgr2=0x7f85ac0501c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:31.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.530+0000 7f85d3b6a700 1 --2- 172.21.15.103:0/4131179427 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f85ac04dd00 0x7f85ac0501c0 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7f85bc000b80 tx=0x7f85bc001800).stop 2020-04-22T14:02:31.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.530+0000 7f85d3b6a700 1 -- 172.21.15.103:0/4131179427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85cc1470a0 msgr2=0x7f85cc125f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:31.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.530+0000 7f85d3b6a700 1 --2- 172.21.15.103:0/4131179427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85cc1470a0 0x7f85cc125f60 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7f85c40032b0 tx=0x7f85c4007dc0).stop 2020-04-22T14:02:31.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.530+0000 7f85d3b6a700 1 -- 172.21.15.103:0/4131179427 shutdown_connections 2020-04-22T14:02:31.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.530+0000 7f85d3b6a700 1 --2- 172.21.15.103:0/4131179427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85cc1470a0 0x7f85cc125f60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:31.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.530+0000 7f85d3b6a700 1 --2- 172.21.15.103:0/4131179427 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f85ac04dd00 0x7f85ac0501c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:31.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.530+0000 7f85d3b6a700 1 --2- 172.21.15.103:0/4131179427 >> v2:172.21.15.86:3300/0 conn(0x7f85cc0ac950 0x7f85cc144880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:31.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.530+0000 7f85d3b6a700 1 -- 172.21.15.103:0/4131179427 >> 172.21.15.103:0/4131179427 conn(0x7f85cc05b7b0 msgr2=0x7f85cc0b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:31.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.530+0000 7f85d3b6a700 1 -- 172.21.15.103:0/4131179427 shutdown_connections 2020-04-22T14:02:31.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.530+0000 7f85d3b6a700 1 -- 172.21.15.103:0/4131179427 wait complete. 2020-04-22T14:02:31.551 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:31.565 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-22T14:02:31.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.712+0000 7f43c759e700 1 Processor -- start 2020-04-22T14:02:31.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.712+0000 7f43c759e700 1 -- start start 2020-04-22T14:02:31.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.713+0000 7f43c759e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f43c80bcc50 0x7f43c8146f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:31.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.713+0000 7f43c759e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f43c812c5d0 0x7f43c814a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:31.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.713+0000 7f43c759e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c8146560 con 0x7f43c805fc70 2020-04-22T14:02:31.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.713+0000 7f43c759e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c8146370 con 0x7f43c812c5d0 2020-04-22T14:02:31.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.713+0000 7f43c759e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c8146800 con 0x7f43c80bcc50 2020-04-22T14:02:31.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.713+0000 7f43c659c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f43c80bcc50 0x7f43c8146f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:31.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.713+0000 7f43c5d9b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f43c805fc70 0x7f43c812bec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39274/0 (socket says 172.21.15.103:39274) 2020-04-22T14:02:31.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.713+0000 7f43c5d9b700 1 -- 172.21.15.103:0/3811500716 learned_addr learned my addr 172.21.15.103:0/3811500716 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:31.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.714+0000 7f43c6d9d700 1 --2- 172.21.15.103:0/3811500716 >> v2:172.21.15.86:3300/0 conn(0x7f43c812c5d0 0x7f43c814a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:31.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.714+0000 7f43c659c700 1 -- 172.21.15.103:0/3811500716 >> v2:172.21.15.86:3300/0 conn(0x7f43c812c5d0 msgr2=0x7f43c814a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:31.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.714+0000 7f43c659c700 1 --2- 172.21.15.103:0/3811500716 >> v2:172.21.15.86:3300/0 conn(0x7f43c812c5d0 0x7f43c814a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:31.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.714+0000 7f43c659c700 1 -- 172.21.15.103:0/3811500716 >> v1:172.21.15.103:6789/0 conn(0x7f43c805fc70 legacy=0x7f43c812bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:31.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.714+0000 7f43c659c700 1 -- 172.21.15.103:0/3811500716 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c8146aa0 con 0x7f43c80bcc50 2020-04-22T14:02:31.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.714+0000 7f43c559a700 1 -- 172.21.15.103:0/3811500716 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 244381451 0 0) 0x7f43c8146560 con 0x7f43c805fc70 2020-04-22T14:02:31.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.714+0000 7f43c659c700 1 --2- 172.21.15.103:0/3811500716 >> v2:172.21.15.103:3300/0 conn(0x7f43c80bcc50 0x7f43c8146f40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f43b8002f30 tx=0x7f43b8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.714+0000 7f43c659c700 1 --2- 172.21.15.103:0/3811500716 >> v2:172.21.15.103:3300/0 conn(0x7f43c80bcc50 0x7f43c8146f40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f43b8002f30 tx=0x7f43b8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.714+0000 7f43c659c700 1 --2- 172.21.15.103:0/3811500716 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43c80bcc50 0x7f43c8146f40 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7f43b8002f30 tx=0x7f43b8007a40).ready entity=mon.1 client_cookie=8af93797b37ef263 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:31.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.714+0000 7f43c659c700 1 --2- 172.21.15.103:0/3811500716 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43c80bcc50 0x7f43c8146f40 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7f43b8002f30 tx=0x7f43b8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.714+0000 7f43c559a700 1 -- 172.21.15.103:0/3811500716 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43b8011470 con 0x7f43c80bcc50 2020-04-22T14:02:31.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.714+0000 7f43c659c700 1 --2- 172.21.15.103:0/3811500716 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43c80bcc50 0x7f43c8146f40 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7f43b8002f30 tx=0x7f43b8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.714+0000 7f43c559a700 1 -- 172.21.15.103:0/3811500716 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b80115d0 con 0x7f43c80bcc50 2020-04-22T14:02:31.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.714+0000 7f43c659c700 1 --2- 172.21.15.103:0/3811500716 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43c80bcc50 0x7f43c8146f40 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7f43b8002f30 tx=0x7f43b8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.714+0000 7f43c559a700 1 -- 172.21.15.103:0/3811500716 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43b80119b0 con 0x7f43c80bcc50 2020-04-22T14:02:31.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.714+0000 7f43c759e700 1 -- 172.21.15.103:0/3811500716 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43c80bcc50 msgr2=0x7f43c8146f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:31.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.714+0000 7f43c759e700 1 --2- 172.21.15.103:0/3811500716 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43c80bcc50 0x7f43c8146f40 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7f43b8002f30 tx=0x7f43b8007a40).stop 2020-04-22T14:02:31.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.715+0000 7f43c759e700 1 -- 172.21.15.103:0/3811500716 shutdown_connections 2020-04-22T14:02:31.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.715+0000 7f43c759e700 1 --2- 172.21.15.103:0/3811500716 >> v2:172.21.15.86:3300/0 conn(0x7f43c812c5d0 0x7f43c814a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:31.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.715+0000 7f43c759e700 1 --2- 172.21.15.103:0/3811500716 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43c80bcc50 0x7f43c8146f40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:31.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.715+0000 7f43c759e700 1 -- 172.21.15.103:0/3811500716 >> 172.21.15.103:0/3811500716 conn(0x7f43c8065af0 msgr2=0x7f43c8065f00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:31.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.715+0000 7f43c759e700 1 -- 172.21.15.103:0/3811500716 shutdown_connections 2020-04-22T14:02:31.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.715+0000 7f43c759e700 1 -- 172.21.15.103:0/3811500716 wait complete. 2020-04-22T14:02:31.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.716+0000 7f43c759e700 1 Processor -- start 2020-04-22T14:02:31.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.716+0000 7f43c759e700 1 -- start start 2020-04-22T14:02:31.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.716+0000 7f43c759e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f43c805fc70 0x7f43c81490b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:31.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.716+0000 7f43c759e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f43c812c5d0 0x7f43c8157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:31.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.716+0000 7f43c759e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c8149c10 con 0x7f43c80bcc50 2020-04-22T14:02:31.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.716+0000 7f43c759e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c814a2e0 con 0x7f43c805fc70 2020-04-22T14:02:31.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.716+0000 7f43c759e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c8149e40 con 0x7f43c812c5d0 2020-04-22T14:02:31.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.716+0000 7f43c6d9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f43c812c5d0 0x7f43c8157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:31.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.716+0000 7f43c6d9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f43c812c5d0 0x7f43c8157a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47094/0 (socket says 172.21.15.103:47094) 2020-04-22T14:02:31.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.716+0000 7f43c6d9d700 1 -- 172.21.15.103:0/629135130 learned_addr learned my addr 172.21.15.103:0/629135130 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:31.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.716+0000 7f43c659c700 1 --2- 172.21.15.103:0/629135130 >> v2:172.21.15.86:3300/0 conn(0x7f43c805fc70 0x7f43c81490b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:31.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.717+0000 7f43c6d9d700 1 -- 172.21.15.103:0/629135130 >> v2:172.21.15.86:3300/0 conn(0x7f43c805fc70 msgr2=0x7f43c81490b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:31.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.717+0000 7f43c6d9d700 1 --2- 172.21.15.103:0/629135130 >> v2:172.21.15.86:3300/0 conn(0x7f43c805fc70 0x7f43c81490b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:31.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.717+0000 7f43c6d9d700 1 -- 172.21.15.103:0/629135130 >> v1:172.21.15.86:6789/0 conn(0x7f43c80bcc50 legacy=0x7f43c81572f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:31.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.717+0000 7f43c6d9d700 1 -- 172.21.15.103:0/629135130 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c812f340 con 0x7f43c812c5d0 2020-04-22T14:02:31.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.717+0000 7f43c6d9d700 1 --2- 172.21.15.103:0/629135130 >> v2:172.21.15.103:3300/0 conn(0x7f43c812c5d0 0x7f43c8157a00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f43c00032b0 tx=0x7f43c0010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.717+0000 7f43c6d9d700 1 --2- 172.21.15.103:0/629135130 >> v2:172.21.15.103:3300/0 conn(0x7f43c812c5d0 0x7f43c8157a00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f43c00032b0 tx=0x7f43c0010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.717+0000 7f43c6d9d700 1 --2- 172.21.15.103:0/629135130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43c812c5d0 0x7f43c8157a00 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7f43c00032b0 tx=0x7f43c0010ef0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:31.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.717+0000 7f43c6d9d700 1 --2- 172.21.15.103:0/629135130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43c812c5d0 0x7f43c8157a00 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f43c00032b0 tx=0x7f43c0010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.717+0000 7f43bf7fe700 1 -- 172.21.15.103:0/629135130 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43c0005e30 con 0x7f43c812c5d0 2020-04-22T14:02:31.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.717+0000 7f43c6d9d700 1 --2- 172.21.15.103:0/629135130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43c812c5d0 0x7f43c8157a00 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f43c00032b0 tx=0x7f43c0010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.717+0000 7f43c6d9d700 1 --2- 172.21.15.103:0/629135130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43c812c5d0 0x7f43c8157a00 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f43c00032b0 tx=0x7f43c0010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.717+0000 7f43bf7fe700 1 -- 172.21.15.103:0/629135130 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c0007560 con 0x7f43c812c5d0 2020-04-22T14:02:31.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.717+0000 7f43c759e700 1 -- 172.21.15.103:0/629135130 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c812f650 con 0x7f43c812c5d0 2020-04-22T14:02:31.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.717+0000 7f43bf7fe700 1 -- 172.21.15.103:0/629135130 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43c0007900 con 0x7f43c812c5d0 2020-04-22T14:02:31.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.717+0000 7f43c759e700 1 -- 172.21.15.103:0/629135130 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c80b3490 con 0x7f43c812c5d0 2020-04-22T14:02:31.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.718+0000 7f43c6d9d700 1 --2- 172.21.15.103:0/629135130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43c812c5d0 0x7f43c8157a00 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f43c00032b0 tx=0x7f43c0010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.718+0000 7f43bf7fe700 1 -- 172.21.15.103:0/629135130 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f43c00101a0 con 0x7f43c812c5d0 2020-04-22T14:02:31.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.718+0000 7f43c6d9d700 1 --2- 172.21.15.103:0/629135130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43c812c5d0 0x7f43c8157a00 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f43c00032b0 tx=0x7f43c0010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.718+0000 7f43c759e700 1 -- 172.21.15.103:0/629135130 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c8056c90 con 0x7f43c812c5d0 2020-04-22T14:02:31.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.718+0000 7f43bf7fe700 1 --2- 172.21.15.103:0/629135130 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f43ac04d930 0x7f43ac04fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:31.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.718+0000 7f43bf7fe700 1 -- 172.21.15.103:0/629135130 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f43c00614f0 con 0x7f43c812c5d0 2020-04-22T14:02:31.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.718+0000 7f43c659c700 1 --2- 172.21.15.103:0/629135130 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f43ac04d930 0x7f43ac04fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:31.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.719+0000 7f43c659c700 1 --2- 172.21.15.103:0/629135130 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f43ac04d930 0x7f43ac04fdf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f43b8002f30 tx=0x7f43b8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.719+0000 7f43c659c700 1 --2- 172.21.15.103:0/629135130 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f43ac04d930 0x7f43ac04fdf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f43b8002f30 tx=0x7f43b8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.719+0000 7f43c659c700 1 --2- 172.21.15.103:0/629135130 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f43ac04d930 0x7f43ac04fdf0 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7f43b8002f30 tx=0x7f43b8007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:31.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.722+0000 7f43c6d9d700 1 --2- 172.21.15.103:0/629135130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43c812c5d0 0x7f43c8157a00 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f43c00032b0 tx=0x7f43c0010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.722+0000 7f43bf7fe700 1 -- 172.21.15.103:0/629135130 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f43c003c870 con 0x7f43c812c5d0 2020-04-22T14:02:31.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.864+0000 7f43c759e700 1 -- 172.21.15.103:0/629135130 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f43c80bbf50 con 0x7f43c812c5d0 2020-04-22T14:02:31.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.864+0000 7f43c6d9d700 1 --2- 172.21.15.103:0/629135130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43c812c5d0 0x7f43c8157a00 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f43c00032b0 tx=0x7f43c0010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:31.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.864+0000 7f43bf7fe700 1 -- 172.21.15.103:0/629135130 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7f43c003fe90 con 0x7f43c812c5d0 2020-04-22T14:02:31.867 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:02:31.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.865+0000 7f43c759e700 1 -- 172.21.15.103:0/629135130 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f43ac04d930 msgr2=0x7f43ac04fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:31.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.865+0000 7f43c759e700 1 --2- 172.21.15.103:0/629135130 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f43ac04d930 0x7f43ac04fdf0 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7f43b8002f30 tx=0x7f43b8007a40).stop 2020-04-22T14:02:31.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.865+0000 7f43c759e700 1 -- 172.21.15.103:0/629135130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43c812c5d0 msgr2=0x7f43c8157a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:31.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.865+0000 7f43c759e700 1 --2- 172.21.15.103:0/629135130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43c812c5d0 0x7f43c8157a00 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7f43c00032b0 tx=0x7f43c0010ef0).stop 2020-04-22T14:02:31.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.865+0000 7f43c759e700 1 -- 172.21.15.103:0/629135130 shutdown_connections 2020-04-22T14:02:31.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.865+0000 7f43c759e700 1 --2- 172.21.15.103:0/629135130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43c812c5d0 0x7f43c8157a00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:31.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.865+0000 7f43c759e700 1 --2- 172.21.15.103:0/629135130 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f43ac04d930 0x7f43ac04fdf0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:31.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.865+0000 7f43c759e700 1 --2- 172.21.15.103:0/629135130 >> v2:172.21.15.86:3300/0 conn(0x7f43c805fc70 0x7f43c81490b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:31.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.866+0000 7f43c759e700 1 -- 172.21.15.103:0/629135130 >> 172.21.15.103:0/629135130 conn(0x7f43c8065af0 msgr2=0x7f43c812b400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:31.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.866+0000 7f43c759e700 1 -- 172.21.15.103:0/629135130 shutdown_connections 2020-04-22T14:02:31.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:31.866+0000 7f43c759e700 1 -- 172.21.15.103:0/629135130 wait complete. 2020-04-22T14:02:31.878 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:31.891 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-22T14:02:32.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.038+0000 7f5e3ae75700 1 Processor -- start 2020-04-22T14:02:32.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.038+0000 7f5e3ae75700 1 -- start start 2020-04-22T14:02:32.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.039+0000 7f5e3ae75700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5e340b8e00 0x7f5e340af010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:32.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.039+0000 7f5e3ae75700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e340b91e0 0x7f5e34142f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:32.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.039+0000 7f5e3ae75700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5e3405fed0 0x7f5e340b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:32.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.039+0000 7f5e3ae75700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e340b29b0 con 0x7f5e340b8e00 2020-04-22T14:02:32.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.039+0000 7f5e3ae75700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e340b4270 con 0x7f5e3405fed0 2020-04-22T14:02:32.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.039+0000 7f5e3ae75700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e340b4510 con 0x7f5e340b91e0 2020-04-22T14:02:32.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.039+0000 7f5e3a674700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5e3405fed0 0x7f5e340b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:32.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.039+0000 7f5e3a674700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5e3405fed0 0x7f5e340b1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47098/0 (socket says 172.21.15.103:47098) 2020-04-22T14:02:32.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.039+0000 7f5e3a674700 1 -- 172.21.15.103:0/2551950147 learned_addr learned my addr 172.21.15.103:0/2551950147 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:32.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.039+0000 7f5e39672700 1 --2- 172.21.15.103:0/2551950147 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e340b91e0 0x7f5e34142f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:32.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.039+0000 7f5e39e73700 1 --2- 172.21.15.103:0/2551950147 >> v2:172.21.15.86:3300/0 conn(0x7f5e340b8e00 0x7f5e340af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:32.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.039+0000 7f5e3a674700 1 -- 172.21.15.103:0/2551950147 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e340b91e0 msgr2=0x7f5e34142f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:32.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.039+0000 7f5e3a674700 1 --2- 172.21.15.103:0/2551950147 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e340b91e0 0x7f5e34142f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:32.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.039+0000 7f5e3a674700 1 -- 172.21.15.103:0/2551950147 >> v2:172.21.15.86:3300/0 conn(0x7f5e340b8e00 msgr2=0x7f5e340af010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:32.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.039+0000 7f5e3a674700 1 --2- 172.21.15.103:0/2551950147 >> v2:172.21.15.86:3300/0 conn(0x7f5e340b8e00 0x7f5e340af010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:32.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.039+0000 7f5e3a674700 1 -- 172.21.15.103:0/2551950147 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e341433c0 con 0x7f5e3405fed0 2020-04-22T14:02:32.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.039+0000 7f5e39672700 1 --2- 172.21.15.103:0/2551950147 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e340b91e0 0x7f5e34142f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:02:32.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.039+0000 7f5e3a674700 1 --2- 172.21.15.103:0/2551950147 >> v2:172.21.15.103:3300/0 conn(0x7f5e3405fed0 0x7f5e340b1bc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5e30002f30 tx=0x7f5e30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.040+0000 7f5e3a674700 1 --2- 172.21.15.103:0/2551950147 >> v2:172.21.15.103:3300/0 conn(0x7f5e3405fed0 0x7f5e340b1bc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5e30002f30 tx=0x7f5e30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.040+0000 7f5e3a674700 1 --2- 172.21.15.103:0/2551950147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e3405fed0 0x7f5e340b1bc0 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7f5e30002f30 tx=0x7f5e30007a40).ready entity=mon.1 client_cookie=7052af07c7796bc6 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:32.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.040+0000 7f5e3a674700 1 --2- 172.21.15.103:0/2551950147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e3405fed0 0x7f5e340b1bc0 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f5e30002f30 tx=0x7f5e30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.040+0000 7f5e38e71700 1 -- 172.21.15.103:0/2551950147 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e30011720 con 0x7f5e3405fed0 2020-04-22T14:02:32.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.040+0000 7f5e3a674700 1 --2- 172.21.15.103:0/2551950147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e3405fed0 0x7f5e340b1bc0 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f5e30002f30 tx=0x7f5e30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.040+0000 7f5e3a674700 1 --2- 172.21.15.103:0/2551950147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e3405fed0 0x7f5e340b1bc0 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f5e30002f30 tx=0x7f5e30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.040+0000 7f5e38e71700 1 -- 172.21.15.103:0/2551950147 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e30011880 con 0x7f5e3405fed0 2020-04-22T14:02:32.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.040+0000 7f5e38e71700 1 -- 172.21.15.103:0/2551950147 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e30011ca0 con 0x7f5e3405fed0 2020-04-22T14:02:32.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.040+0000 7f5e3ae75700 1 -- 172.21.15.103:0/2551950147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e3405fed0 msgr2=0x7f5e340b1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:32.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.040+0000 7f5e3ae75700 1 --2- 172.21.15.103:0/2551950147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e3405fed0 0x7f5e340b1bc0 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7f5e30002f30 tx=0x7f5e30007a40).stop 2020-04-22T14:02:32.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.040+0000 7f5e3ae75700 1 -- 172.21.15.103:0/2551950147 shutdown_connections 2020-04-22T14:02:32.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.040+0000 7f5e3ae75700 1 --2- 172.21.15.103:0/2551950147 >> v2:172.21.15.86:3300/0 conn(0x7f5e340b8e00 0x7f5e340af010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:32.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.040+0000 7f5e3ae75700 1 --2- 172.21.15.103:0/2551950147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e3405fed0 0x7f5e340b1bc0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:32.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.040+0000 7f5e3ae75700 1 --2- 172.21.15.103:0/2551950147 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e340b91e0 0x7f5e34142f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:32.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.040+0000 7f5e3ae75700 1 -- 172.21.15.103:0/2551950147 >> 172.21.15.103:0/2551950147 conn(0x7f5e3405b780 msgr2=0x7f5e340b8530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:32.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.040+0000 7f5e3ae75700 1 -- 172.21.15.103:0/2551950147 shutdown_connections 2020-04-22T14:02:32.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.040+0000 7f5e3ae75700 1 -- 172.21.15.103:0/2551950147 wait complete. 2020-04-22T14:02:32.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.041+0000 7f5e3ae75700 1 Processor -- start 2020-04-22T14:02:32.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.041+0000 7f5e3ae75700 1 -- start start 2020-04-22T14:02:32.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.042+0000 7f5e3ae75700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5e340b8e00 0x7f5e340663f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:32.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.042+0000 7f5e3ae75700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e340b91e0 0x7f5e341505b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:32.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.042+0000 7f5e3ae75700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e34140e80 con 0x7f5e3405fed0 2020-04-22T14:02:32.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.042+0000 7f5e3ae75700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e34150a10 con 0x7f5e340b8e00 2020-04-22T14:02:32.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.042+0000 7f5e3ae75700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e34141120 con 0x7f5e340b91e0 2020-04-22T14:02:32.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.042+0000 7f5e39672700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5e340b8e00 0x7f5e340663f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:32.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.042+0000 7f5e39e73700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f5e3405fed0 0x7f5e341336b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39296/0 (socket says 172.21.15.103:39296) 2020-04-22T14:02:32.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.042+0000 7f5e39672700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5e340b8e00 0x7f5e340663f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47104/0 (socket says 172.21.15.103:47104) 2020-04-22T14:02:32.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.042+0000 7f5e39e73700 1 -- 172.21.15.103:0/3828493992 learned_addr learned my addr 172.21.15.103:0/3828493992 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:32.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.042+0000 7f5e3a674700 1 --2- 172.21.15.103:0/3828493992 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e340b91e0 0x7f5e341505b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:32.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.042+0000 7f5e26ffd700 1 -- 172.21.15.103:0/3828493992 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4097392185 0 0) 0x7f5e34140e80 con 0x7f5e3405fed0 2020-04-22T14:02:32.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.042+0000 7f5e26ffd700 1 -- 172.21.15.103:0/3828493992 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e14002fe0 con 0x7f5e3405fed0 2020-04-22T14:02:32.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.042+0000 7f5e39672700 1 -- 172.21.15.103:0/3828493992 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e340b91e0 msgr2=0x7f5e341505b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:32.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.042+0000 7f5e39672700 1 --2- 172.21.15.103:0/3828493992 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e340b91e0 0x7f5e341505b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:32.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.042+0000 7f5e39672700 1 -- 172.21.15.103:0/3828493992 >> v1:172.21.15.103:6789/0 conn(0x7f5e3405fed0 legacy=0x7f5e341336b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:32.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.042+0000 7f5e39672700 1 -- 172.21.15.103:0/3828493992 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e341413c0 con 0x7f5e340b8e00 2020-04-22T14:02:32.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.042+0000 7f5e39672700 1 --2- 172.21.15.103:0/3828493992 >> v2:172.21.15.103:3300/0 conn(0x7f5e340b8e00 0x7f5e340663f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5e28002f30 tx=0x7f5e28012c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.043+0000 7f5e39672700 1 --2- 172.21.15.103:0/3828493992 >> v2:172.21.15.103:3300/0 conn(0x7f5e340b8e00 0x7f5e340663f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5e28002f30 tx=0x7f5e28012c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.043+0000 7f5e39672700 1 --2- 172.21.15.103:0/3828493992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e340b8e00 0x7f5e340663f0 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7f5e28002f30 tx=0x7f5e28012c20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:32.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.043+0000 7f5e39672700 1 --2- 172.21.15.103:0/3828493992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e340b8e00 0x7f5e340663f0 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f5e28002f30 tx=0x7f5e28012c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.043+0000 7f5e26ffd700 1 -- 172.21.15.103:0/3828493992 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e28005e90 con 0x7f5e340b8e00 2020-04-22T14:02:32.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.043+0000 7f5e39672700 1 --2- 172.21.15.103:0/3828493992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e340b8e00 0x7f5e340663f0 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f5e28002f30 tx=0x7f5e28012c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.043+0000 7f5e39672700 1 --2- 172.21.15.103:0/3828493992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e340b8e00 0x7f5e340663f0 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f5e28002f30 tx=0x7f5e28012c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.043+0000 7f5e26ffd700 1 -- 172.21.15.103:0/3828493992 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e28007180 con 0x7f5e340b8e00 2020-04-22T14:02:32.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.043+0000 7f5e3ae75700 1 -- 172.21.15.103:0/3828493992 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e34140b70 con 0x7f5e340b8e00 2020-04-22T14:02:32.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.043+0000 7f5e26ffd700 1 -- 172.21.15.103:0/3828493992 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e28007560 con 0x7f5e340b8e00 2020-04-22T14:02:32.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.043+0000 7f5e3ae75700 1 -- 172.21.15.103:0/3828493992 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e34133dc0 con 0x7f5e340b8e00 2020-04-22T14:02:32.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.043+0000 7f5e39672700 1 --2- 172.21.15.103:0/3828493992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e340b8e00 0x7f5e340663f0 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f5e28002f30 tx=0x7f5e28012c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.044+0000 7f5e3ae75700 1 -- 172.21.15.103:0/3828493992 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e34056c90 con 0x7f5e340b8e00 2020-04-22T14:02:32.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.044+0000 7f5e26ffd700 1 -- 172.21.15.103:0/3828493992 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f5e280141d0 con 0x7f5e340b8e00 2020-04-22T14:02:32.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.044+0000 7f5e39672700 1 --2- 172.21.15.103:0/3828493992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e340b8e00 0x7f5e340663f0 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f5e28002f30 tx=0x7f5e28012c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.044+0000 7f5e26ffd700 1 --2- 172.21.15.103:0/3828493992 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5e1404dd10 0x7f5e140501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:32.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.044+0000 7f5e26ffd700 1 -- 172.21.15.103:0/3828493992 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5e280635b0 con 0x7f5e340b8e00 2020-04-22T14:02:32.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.044+0000 7f5e39e73700 1 --2- 172.21.15.103:0/3828493992 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5e1404dd10 0x7f5e140501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:32.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.044+0000 7f5e39e73700 1 --2- 172.21.15.103:0/3828493992 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5e1404dd10 0x7f5e140501d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5e2c0032b0 tx=0x7f5e2c0026c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.045+0000 7f5e39e73700 1 --2- 172.21.15.103:0/3828493992 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5e1404dd10 0x7f5e140501d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5e2c0032b0 tx=0x7f5e2c0026c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.045+0000 7f5e39e73700 1 --2- 172.21.15.103:0/3828493992 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5e1404dd10 0x7f5e140501d0 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f5e2c0032b0 tx=0x7f5e2c0026c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:32.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.048+0000 7f5e39672700 1 --2- 172.21.15.103:0/3828493992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e340b8e00 0x7f5e340663f0 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f5e28002f30 tx=0x7f5e28012c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.048+0000 7f5e26ffd700 1 -- 172.21.15.103:0/3828493992 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f5e2803e930 con 0x7f5e340b8e00 2020-04-22T14:02:32.193 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.191+0000 7f5e3ae75700 1 -- 172.21.15.103:0/3828493992 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5e34111ac0 con 0x7f5e340b8e00 2020-04-22T14:02:32.193 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.191+0000 7f5e39672700 1 --2- 172.21.15.103:0/3828493992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e340b8e00 0x7f5e340663f0 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f5e28002f30 tx=0x7f5e28012c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.193 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.191+0000 7f5e26ffd700 1 -- 172.21.15.103:0/3828493992 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7f5e28041f50 con 0x7f5e340b8e00 2020-04-22T14:02:32.194 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:02:32.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.192+0000 7f5e3ae75700 1 -- 172.21.15.103:0/3828493992 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5e1404dd10 msgr2=0x7f5e140501d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:32.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.192+0000 7f5e3ae75700 1 --2- 172.21.15.103:0/3828493992 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5e1404dd10 0x7f5e140501d0 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f5e2c0032b0 tx=0x7f5e2c0026c0).stop 2020-04-22T14:02:32.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.192+0000 7f5e3ae75700 1 -- 172.21.15.103:0/3828493992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e340b8e00 msgr2=0x7f5e340663f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:32.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.192+0000 7f5e3ae75700 1 --2- 172.21.15.103:0/3828493992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e340b8e00 0x7f5e340663f0 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7f5e28002f30 tx=0x7f5e28012c20).stop 2020-04-22T14:02:32.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.192+0000 7f5e3ae75700 1 -- 172.21.15.103:0/3828493992 shutdown_connections 2020-04-22T14:02:32.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.192+0000 7f5e3ae75700 1 --2- 172.21.15.103:0/3828493992 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5e1404dd10 0x7f5e140501d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:32.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.192+0000 7f5e3ae75700 1 --2- 172.21.15.103:0/3828493992 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e340b91e0 0x7f5e341505b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:32.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.192+0000 7f5e3ae75700 1 --2- 172.21.15.103:0/3828493992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e340b8e00 0x7f5e340663f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:32.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.193+0000 7f5e3ae75700 1 -- 172.21.15.103:0/3828493992 >> 172.21.15.103:0/3828493992 conn(0x7f5e3405b780 msgr2=0x7f5e3405c590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:32.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.193+0000 7f5e3ae75700 1 -- 172.21.15.103:0/3828493992 shutdown_connections 2020-04-22T14:02:32.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.193+0000 7f5e3ae75700 1 -- 172.21.15.103:0/3828493992 wait complete. 2020-04-22T14:02:32.205 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2020-04-22T14:02:32.205 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2020-04-22T14:02:32.206 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:32.220 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mgr dump --format=json 2020-04-22T14:02:32.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.365+0000 7fbb46b96700 1 Processor -- start 2020-04-22T14:02:32.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.365+0000 7fbb46b96700 1 -- start start 2020-04-22T14:02:32.378 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.366+0000 7fbb46b96700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbb4012c0d0 0x7fbb401464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:32.378 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.366+0000 7fbb46b96700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb40065fe0 0x7fbb4005b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:32.378 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.366+0000 7fbb46b96700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbb4005b8a0 0x7fbb40062ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:32.378 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.366+0000 7fbb46b96700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb4012c4b0 con 0x7fbb4012c0d0 2020-04-22T14:02:32.378 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.366+0000 7fbb46b96700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb40143300 con 0x7fbb4005b8a0 2020-04-22T14:02:32.378 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.366+0000 7fbb46b96700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb401435a0 con 0x7fbb40065fe0 2020-04-22T14:02:32.378 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.366+0000 7fbb45133700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbb4005b8a0 0x7fbb40062ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:32.379 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.366+0000 7fbb45133700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbb4005b8a0 0x7fbb40062ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47116/0 (socket says 172.21.15.103:47116) 2020-04-22T14:02:32.379 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.366+0000 7fbb45133700 1 -- 172.21.15.103:0/2445740203 learned_addr learned my addr 172.21.15.103:0/2445740203 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:32.379 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.366+0000 7fbb3ffff700 1 --2- 172.21.15.103:0/2445740203 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb40065fe0 0x7fbb4005b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:32.379 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.366+0000 7fbb44932700 1 --2- 172.21.15.103:0/2445740203 >> v2:172.21.15.86:3300/0 conn(0x7fbb4012c0d0 0x7fbb401464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:32.379 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.366+0000 7fbb45133700 1 -- 172.21.15.103:0/2445740203 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb40065fe0 msgr2=0x7fbb4005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:32.379 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.366+0000 7fbb45133700 1 --2- 172.21.15.103:0/2445740203 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb40065fe0 0x7fbb4005b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:32.379 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.366+0000 7fbb45133700 1 -- 172.21.15.103:0/2445740203 >> v2:172.21.15.86:3300/0 conn(0x7fbb4012c0d0 msgr2=0x7fbb401464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:32.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.366+0000 7fbb45133700 1 --2- 172.21.15.103:0/2445740203 >> v2:172.21.15.86:3300/0 conn(0x7fbb4012c0d0 0x7fbb401464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:32.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.366+0000 7fbb45133700 1 -- 172.21.15.103:0/2445740203 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb40143840 con 0x7fbb4005b8a0 2020-04-22T14:02:32.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.366+0000 7fbb45133700 1 --2- 172.21.15.103:0/2445740203 >> v2:172.21.15.103:3300/0 conn(0x7fbb4005b8a0 0x7fbb40062ab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbb40067620 tx=0x7fbb38008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.366+0000 7fbb45133700 1 --2- 172.21.15.103:0/2445740203 >> v2:172.21.15.103:3300/0 conn(0x7fbb4005b8a0 0x7fbb40062ab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbb40067620 tx=0x7fbb38008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.366+0000 7fbb45133700 1 --2- 172.21.15.103:0/2445740203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb4005b8a0 0x7fbb40062ab0 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7fbb40067620 tx=0x7fbb38008c60).ready entity=mon.1 client_cookie=bbee1a3caa439a98 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:32.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.366+0000 7fbb45133700 1 --2- 172.21.15.103:0/2445740203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb4005b8a0 0x7fbb40062ab0 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7fbb40067620 tx=0x7fbb38008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.367+0000 7fbb3f7fe700 1 -- 172.21.15.103:0/2445740203 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb38011e30 con 0x7fbb4005b8a0 2020-04-22T14:02:32.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.367+0000 7fbb45133700 1 --2- 172.21.15.103:0/2445740203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb4005b8a0 0x7fbb40062ab0 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7fbb40067620 tx=0x7fbb38008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.367+0000 7fbb3f7fe700 1 -- 172.21.15.103:0/2445740203 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb3800a180 con 0x7fbb4005b8a0 2020-04-22T14:02:32.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.367+0000 7fbb45133700 1 --2- 172.21.15.103:0/2445740203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb4005b8a0 0x7fbb40062ab0 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7fbb40067620 tx=0x7fbb38008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.367+0000 7fbb3f7fe700 1 -- 172.21.15.103:0/2445740203 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb3800a5a0 con 0x7fbb4005b8a0 2020-04-22T14:02:32.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.367+0000 7fbb46b96700 1 -- 172.21.15.103:0/2445740203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb4005b8a0 msgr2=0x7fbb40062ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:32.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.367+0000 7fbb46b96700 1 --2- 172.21.15.103:0/2445740203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb4005b8a0 0x7fbb40062ab0 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7fbb40067620 tx=0x7fbb38008c60).stop 2020-04-22T14:02:32.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.367+0000 7fbb46b96700 1 -- 172.21.15.103:0/2445740203 shutdown_connections 2020-04-22T14:02:32.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.367+0000 7fbb46b96700 1 --2- 172.21.15.103:0/2445740203 >> v2:172.21.15.86:3300/0 conn(0x7fbb4012c0d0 0x7fbb401464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:32.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.367+0000 7fbb46b96700 1 --2- 172.21.15.103:0/2445740203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb4005b8a0 0x7fbb40062ab0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:32.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.367+0000 7fbb46b96700 1 --2- 172.21.15.103:0/2445740203 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb40065fe0 0x7fbb4005b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:32.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.367+0000 7fbb46b96700 1 -- 172.21.15.103:0/2445740203 >> 172.21.15.103:0/2445740203 conn(0x7fbb400b9160 msgr2=0x7fbb4005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:32.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.367+0000 7fbb46b96700 1 -- 172.21.15.103:0/2445740203 shutdown_connections 2020-04-22T14:02:32.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.367+0000 7fbb46b96700 1 -- 172.21.15.103:0/2445740203 wait complete. 2020-04-22T14:02:32.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.368+0000 7fbb46b96700 1 Processor -- start 2020-04-22T14:02:32.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.368+0000 7fbb46b96700 1 -- start start 2020-04-22T14:02:32.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.369+0000 7fbb46b96700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb4005b8a0 0x7fbb401475a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:32.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.369+0000 7fbb46b96700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbb4012c0d0 0x7fbb400b5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:32.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.369+0000 7fbb46b96700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb40121b30 con 0x7fbb40065fe0 2020-04-22T14:02:32.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.369+0000 7fbb46b96700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb40063bc0 con 0x7fbb4012c0d0 2020-04-22T14:02:32.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.369+0000 7fbb46b96700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb400b5a70 con 0x7fbb4005b8a0 2020-04-22T14:02:32.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.369+0000 7fbb3ffff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fbb40065fe0 0x7fbb401420e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39310/0 (socket says 172.21.15.103:39310) 2020-04-22T14:02:32.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.369+0000 7fbb3ffff700 1 -- 172.21.15.103:0/1630114331 learned_addr learned my addr 172.21.15.103:0/1630114331 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:32.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.369+0000 7fbb44932700 1 --2- 172.21.15.103:0/1630114331 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb4005b8a0 0x7fbb401475a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:32.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.369+0000 7fbb45133700 1 --2- 172.21.15.103:0/1630114331 >> v2:172.21.15.103:3300/0 conn(0x7fbb4012c0d0 0x7fbb400b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:32.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.369+0000 7fbb3dffb700 1 -- 172.21.15.103:0/1630114331 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3983886398 0 0) 0x7fbb40121b30 con 0x7fbb40065fe0 2020-04-22T14:02:32.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.369+0000 7fbb3dffb700 1 -- 172.21.15.103:0/1630114331 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb28002fe0 con 0x7fbb40065fe0 2020-04-22T14:02:32.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.369+0000 7fbb45133700 1 -- 172.21.15.103:0/1630114331 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb4005b8a0 msgr2=0x7fbb401475a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:32.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.369+0000 7fbb45133700 1 --2- 172.21.15.103:0/1630114331 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb4005b8a0 0x7fbb401475a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:32.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.369+0000 7fbb45133700 1 -- 172.21.15.103:0/1630114331 >> v1:172.21.15.103:6789/0 conn(0x7fbb40065fe0 legacy=0x7fbb401420e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:32.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.369+0000 7fbb45133700 1 -- 172.21.15.103:0/1630114331 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb40121d60 con 0x7fbb4012c0d0 2020-04-22T14:02:32.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.369+0000 7fbb44932700 1 --2- 172.21.15.103:0/1630114331 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb4005b8a0 0x7fbb401475a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:02:32.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.369+0000 7fbb45133700 1 --2- 172.21.15.103:0/1630114331 >> v2:172.21.15.103:3300/0 conn(0x7fbb4012c0d0 0x7fbb400b5610 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbb40067620 tx=0x7fbb380116f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.369+0000 7fbb45133700 1 --2- 172.21.15.103:0/1630114331 >> v2:172.21.15.103:3300/0 conn(0x7fbb4012c0d0 0x7fbb400b5610 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbb40067620 tx=0x7fbb380116f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.369+0000 7fbb45133700 1 --2- 172.21.15.103:0/1630114331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb4012c0d0 0x7fbb400b5610 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7fbb40067620 tx=0x7fbb380116f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:32.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.370+0000 7fbb45133700 1 --2- 172.21.15.103:0/1630114331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb4012c0d0 0x7fbb400b5610 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7fbb40067620 tx=0x7fbb380116f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.370+0000 7fbb3dffb700 1 -- 172.21.15.103:0/1630114331 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb38005c30 con 0x7fbb4012c0d0 2020-04-22T14:02:32.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.370+0000 7fbb45133700 1 --2- 172.21.15.103:0/1630114331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb4012c0d0 0x7fbb400b5610 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7fbb40067620 tx=0x7fbb380116f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.370+0000 7fbb45133700 1 --2- 172.21.15.103:0/1630114331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb4012c0d0 0x7fbb400b5610 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7fbb40067620 tx=0x7fbb380116f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.370+0000 7fbb3dffb700 1 -- 172.21.15.103:0/1630114331 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb38005d90 con 0x7fbb4012c0d0 2020-04-22T14:02:32.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.370+0000 7fbb46b96700 1 -- 172.21.15.103:0/1630114331 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb40145e50 con 0x7fbb4012c0d0 2020-04-22T14:02:32.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.370+0000 7fbb3dffb700 1 -- 172.21.15.103:0/1630114331 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb38007360 con 0x7fbb4012c0d0 2020-04-22T14:02:32.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.370+0000 7fbb46b96700 1 -- 172.21.15.103:0/1630114331 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb4011f970 con 0x7fbb4012c0d0 2020-04-22T14:02:32.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.370+0000 7fbb45133700 1 --2- 172.21.15.103:0/1630114331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb4012c0d0 0x7fbb400b5610 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7fbb40067620 tx=0x7fbb380116f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.371+0000 7fbb3dffb700 1 -- 172.21.15.103:0/1630114331 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fbb38007590 con 0x7fbb4012c0d0 2020-04-22T14:02:32.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.371+0000 7fbb45133700 1 --2- 172.21.15.103:0/1630114331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb4012c0d0 0x7fbb400b5610 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7fbb40067620 tx=0x7fbb380116f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.371+0000 7fbb46b96700 1 -- 172.21.15.103:0/1630114331 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb4011fc80 con 0x7fbb4012c0d0 2020-04-22T14:02:32.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.371+0000 7fbb3dffb700 1 --2- 172.21.15.103:0/1630114331 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbb2804dd40 0x7fbb28050200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:32.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.371+0000 7fbb3dffb700 1 -- 172.21.15.103:0/1630114331 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbb38062130 con 0x7fbb4012c0d0 2020-04-22T14:02:32.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.371+0000 7fbb44932700 1 --2- 172.21.15.103:0/1630114331 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbb2804dd40 0x7fbb28050200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:32.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.371+0000 7fbb44932700 1 --2- 172.21.15.103:0/1630114331 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbb2804dd40 0x7fbb28050200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbb34002f30 tx=0x7fbb34007c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.371+0000 7fbb44932700 1 --2- 172.21.15.103:0/1630114331 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbb2804dd40 0x7fbb28050200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbb34002f30 tx=0x7fbb34007c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.371+0000 7fbb44932700 1 --2- 172.21.15.103:0/1630114331 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbb2804dd40 0x7fbb28050200 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7fbb34002f30 tx=0x7fbb34007c50).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:32.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.375+0000 7fbb45133700 1 --2- 172.21.15.103:0/1630114331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb4012c0d0 0x7fbb400b5610 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7fbb40067620 tx=0x7fbb380116f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.375+0000 7fbb3dffb700 1 -- 172.21.15.103:0/1630114331 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fbb3803d570 con 0x7fbb4012c0d0 2020-04-22T14:02:32.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.560+0000 7fbb46b96700 1 -- 172.21.15.103:0/1630114331 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fbb40056c90 con 0x7fbb4012c0d0 2020-04-22T14:02:32.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.563+0000 7fbb45133700 1 --2- 172.21.15.103:0/1630114331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb4012c0d0 0x7fbb400b5610 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7fbb40067620 tx=0x7fbb380116f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.563+0000 7fbb3dffb700 1 -- 172.21.15.103:0/1630114331 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+120035 (secure 0 0 0) 0x7fbb38040b90 con 0x7fbb4012c0d0 2020-04-22T14:02:32.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.564+0000 7fbb46b96700 1 -- 172.21.15.103:0/1630114331 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbb2804dd40 msgr2=0x7fbb28050200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:32.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.564+0000 7fbb46b96700 1 --2- 172.21.15.103:0/1630114331 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbb2804dd40 0x7fbb28050200 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7fbb34002f30 tx=0x7fbb34007c50).stop 2020-04-22T14:02:32.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.564+0000 7fbb46b96700 1 -- 172.21.15.103:0/1630114331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb4012c0d0 msgr2=0x7fbb400b5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:32.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.564+0000 7fbb46b96700 1 --2- 172.21.15.103:0/1630114331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb4012c0d0 0x7fbb400b5610 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7fbb40067620 tx=0x7fbb380116f0).stop 2020-04-22T14:02:32.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.565+0000 7fbb46b96700 1 -- 172.21.15.103:0/1630114331 shutdown_connections 2020-04-22T14:02:32.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.565+0000 7fbb46b96700 1 --2- 172.21.15.103:0/1630114331 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbb2804dd40 0x7fbb28050200 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:32.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.565+0000 7fbb46b96700 1 --2- 172.21.15.103:0/1630114331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb4012c0d0 0x7fbb400b5610 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:32.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.565+0000 7fbb46b96700 1 --2- 172.21.15.103:0/1630114331 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb4005b8a0 0x7fbb401475a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:32.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.565+0000 7fbb46b96700 1 -- 172.21.15.103:0/1630114331 >> 172.21.15.103:0/1630114331 conn(0x7fbb400b9160 msgr2=0x7fbb40146330 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:32.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.565+0000 7fbb46b96700 1 -- 172.21.15.103:0/1630114331 shutdown_connections 2020-04-22T14:02:32.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.565+0000 7fbb46b96700 1 -- 172.21.15.103:0/1630114331 wait complete. 2020-04-22T14:02:32.569 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:02:32.578 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":4,"active_gid":4107,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":32242},{"type":"v1","addr":"172.21.15.86:6801","nonce":32242}]},"active_addr":"172.21.15.86:6801/32242","active_change":"2020-04-22T14:02:09.542374+0000","active_mgr_features":4540138292837744639,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540138292837744639,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","osd_support","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","osd_support","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":4134951106}]},{"addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":2600813990}]},{"addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":3800165031}]}]}} 2020-04-22T14:02:32.586 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2020-04-22T14:02:32.586 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-04-22T14:02:32.586 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:32.600 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:02:32.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.744+0000 7f212ec60700 1 Processor -- start 2020-04-22T14:02:32.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.744+0000 7f212ec60700 1 -- start start 2020-04-22T14:02:32.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.745+0000 7f212ec60700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2128145cc0 0x7f212805b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:32.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.745+0000 7f212ec60700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2128149880 0x7f21280b1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:32.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.745+0000 7f212ec60700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f21280b55b0 0x7f21280b5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:32.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.745+0000 7f212ec60700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21280b5e80 con 0x7f21280b55b0 2020-04-22T14:02:32.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.745+0000 7f212ec60700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21280b0c20 con 0x7f2128149880 2020-04-22T14:02:32.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.745+0000 7f212ec60700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21280b0ec0 con 0x7f2128145cc0 2020-04-22T14:02:32.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.745+0000 7f212d45d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2128149880 0x7f21280b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:32.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.745+0000 7f212d45d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2128149880 0x7f21280b1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47126/0 (socket says 172.21.15.103:47126) 2020-04-22T14:02:32.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.745+0000 7f212d45d700 1 -- 172.21.15.103:0/4025538070 learned_addr learned my addr 172.21.15.103:0/4025538070 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:32.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.745+0000 7f212e45f700 1 --2- 172.21.15.103:0/4025538070 >> v2:172.21.15.86:3300/0 conn(0x7f21280b55b0 0x7f21280b5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:32.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.745+0000 7f212dc5e700 1 --2- 172.21.15.103:0/4025538070 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2128145cc0 0x7f212805b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:32.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.745+0000 7f212d45d700 1 -- 172.21.15.103:0/4025538070 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2128145cc0 msgr2=0x7f212805b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:32.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.745+0000 7f212d45d700 1 --2- 172.21.15.103:0/4025538070 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2128145cc0 0x7f212805b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:32.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.745+0000 7f212d45d700 1 -- 172.21.15.103:0/4025538070 >> v2:172.21.15.86:3300/0 conn(0x7f21280b55b0 msgr2=0x7f21280b5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:32.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.745+0000 7f212d45d700 1 --2- 172.21.15.103:0/4025538070 >> v2:172.21.15.86:3300/0 conn(0x7f21280b55b0 0x7f21280b5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:32.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.745+0000 7f212d45d700 1 -- 172.21.15.103:0/4025538070 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21280b1160 con 0x7f2128149880 2020-04-22T14:02:32.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.745+0000 7f212d45d700 1 --2- 172.21.15.103:0/4025538070 >> v2:172.21.15.103:3300/0 conn(0x7f2128149880 0x7f21280b1600 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2118002f30 tx=0x7f2118007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.745+0000 7f212d45d700 1 --2- 172.21.15.103:0/4025538070 >> v2:172.21.15.103:3300/0 conn(0x7f2128149880 0x7f21280b1600 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2118002f30 tx=0x7f2118007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.745+0000 7f212d45d700 1 --2- 172.21.15.103:0/4025538070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2128149880 0x7f21280b1600 secure :-1 s=READY pgs=116 cs=0 l=1 rx=0x7f2118002f30 tx=0x7f2118007a40).ready entity=mon.1 client_cookie=424c0d3014bcaa7a server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:32.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.745+0000 7f212d45d700 1 --2- 172.21.15.103:0/4025538070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2128149880 0x7f21280b1600 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7f2118002f30 tx=0x7f2118007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.745+0000 7f212cc5c700 1 -- 172.21.15.103:0/4025538070 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21180115c0 con 0x7f2128149880 2020-04-22T14:02:32.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.745+0000 7f212d45d700 1 --2- 172.21.15.103:0/4025538070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2128149880 0x7f21280b1600 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7f2118002f30 tx=0x7f2118007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.745+0000 7f212cc5c700 1 -- 172.21.15.103:0/4025538070 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2118011720 con 0x7f2128149880 2020-04-22T14:02:32.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.745+0000 7f212d45d700 1 --2- 172.21.15.103:0/4025538070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2128149880 0x7f21280b1600 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7f2118002f30 tx=0x7f2118007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.745+0000 7f212cc5c700 1 -- 172.21.15.103:0/4025538070 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2118011b40 con 0x7f2128149880 2020-04-22T14:02:32.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.745+0000 7f212ec60700 1 -- 172.21.15.103:0/4025538070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2128149880 msgr2=0x7f21280b1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:32.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.745+0000 7f212ec60700 1 --2- 172.21.15.103:0/4025538070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2128149880 0x7f21280b1600 secure :-1 s=READY pgs=116 cs=0 l=1 rx=0x7f2118002f30 tx=0x7f2118007a40).stop 2020-04-22T14:02:32.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.746+0000 7f212ec60700 1 -- 172.21.15.103:0/4025538070 shutdown_connections 2020-04-22T14:02:32.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.746+0000 7f212ec60700 1 --2- 172.21.15.103:0/4025538070 >> v2:172.21.15.86:3300/0 conn(0x7f21280b55b0 0x7f21280b5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:32.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.746+0000 7f212ec60700 1 --2- 172.21.15.103:0/4025538070 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2128145cc0 0x7f212805b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:32.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.746+0000 7f212ec60700 1 --2- 172.21.15.103:0/4025538070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2128149880 0x7f21280b1600 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:32.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.746+0000 7f212ec60700 1 -- 172.21.15.103:0/4025538070 >> 172.21.15.103:0/4025538070 conn(0x7f21280601e0 msgr2=0x7f212805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:32.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.746+0000 7f212ec60700 1 -- 172.21.15.103:0/4025538070 shutdown_connections 2020-04-22T14:02:32.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.746+0000 7f212ec60700 1 -- 172.21.15.103:0/4025538070 wait complete. 2020-04-22T14:02:32.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.747+0000 7f212ec60700 1 Processor -- start 2020-04-22T14:02:32.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.747+0000 7f212ec60700 1 -- start start 2020-04-22T14:02:32.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.747+0000 7f212ec60700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2128145cc0 0x7f21280ae340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:32.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.747+0000 7f212ec60700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2128149880 0x7f2128144de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:32.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.747+0000 7f212ec60700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2128145240 con 0x7f21280b55b0 2020-04-22T14:02:32.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.747+0000 7f212ec60700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21280ad4d0 con 0x7f2128145cc0 2020-04-22T14:02:32.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.747+0000 7f212ec60700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21280ad770 con 0x7f2128149880 2020-04-22T14:02:32.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.748+0000 7f212e45f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2128149880 0x7f2128144de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:32.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.748+0000 7f212d45d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2128145cc0 0x7f21280ae340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:32.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.748+0000 7f212e45f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2128149880 0x7f2128144de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:60144/0 (socket says 172.21.15.103:60144) 2020-04-22T14:02:32.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.748+0000 7f212e45f700 1 -- 172.21.15.103:0/790920239 learned_addr learned my addr 172.21.15.103:0/790920239 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:32.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.748+0000 7f212e45f700 1 -- 172.21.15.103:0/790920239 >> v2:172.21.15.86:3300/0 conn(0x7f2128145cc0 msgr2=0x7f21280ae340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:32.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.748+0000 7f212e45f700 1 --2- 172.21.15.103:0/790920239 >> v2:172.21.15.86:3300/0 conn(0x7f2128145cc0 0x7f21280ae340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:32.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.748+0000 7f212e45f700 1 -- 172.21.15.103:0/790920239 >> v1:172.21.15.86:6789/0 conn(0x7f21280b55b0 legacy=0x7f2128140570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:32.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.748+0000 7f212e45f700 1 -- 172.21.15.103:0/790920239 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21280ada10 con 0x7f2128149880 2020-04-22T14:02:32.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.748+0000 7f212e45f700 1 --2- 172.21.15.103:0/790920239 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2128149880 0x7f2128144de0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f21200032b0 tx=0x7f2120010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.748+0000 7f212e45f700 1 --2- 172.21.15.103:0/790920239 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2128149880 0x7f2128144de0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f21200032b0 tx=0x7f2120010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.748+0000 7f212e45f700 1 --2- 172.21.15.103:0/790920239 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2128149880 0x7f2128144de0 secure :-1 s=READY pgs=22 cs=0 l=1 rx=0x7f21200032b0 tx=0x7f2120010f30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:32.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.748+0000 7f212e45f700 1 --2- 172.21.15.103:0/790920239 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2128149880 0x7f2128144de0 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f21200032b0 tx=0x7f2120010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.748+0000 7f2116ffd700 1 -- 172.21.15.103:0/790920239 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f212000e370 con 0x7f2128149880 2020-04-22T14:02:32.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.748+0000 7f212e45f700 1 --2- 172.21.15.103:0/790920239 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2128149880 0x7f2128144de0 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f21200032b0 tx=0x7f2120010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.748+0000 7f2116ffd700 1 -- 172.21.15.103:0/790920239 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2120005c30 con 0x7f2128149880 2020-04-22T14:02:32.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.748+0000 7f212e45f700 1 --2- 172.21.15.103:0/790920239 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2128149880 0x7f2128144de0 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f21200032b0 tx=0x7f2120010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.748+0000 7f212ec60700 1 -- 172.21.15.103:0/790920239 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21280ad150 con 0x7f2128149880 2020-04-22T14:02:32.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.748+0000 7f2116ffd700 1 -- 172.21.15.103:0/790920239 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2120005e60 con 0x7f2128149880 2020-04-22T14:02:32.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.748+0000 7f212ec60700 1 -- 172.21.15.103:0/790920239 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2128140c80 con 0x7f2128149880 2020-04-22T14:02:32.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.749+0000 7f212e45f700 1 --2- 172.21.15.103:0/790920239 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2128149880 0x7f2128144de0 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f21200032b0 tx=0x7f2120010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.749+0000 7f2116ffd700 1 -- 172.21.15.103:0/790920239 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f2120012bb0 con 0x7f2128149880 2020-04-22T14:02:32.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.749+0000 7f212e45f700 1 --2- 172.21.15.103:0/790920239 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2128149880 0x7f2128144de0 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f21200032b0 tx=0x7f2120010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.749+0000 7f212ec60700 1 -- 172.21.15.103:0/790920239 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2128056c90 con 0x7f2128149880 2020-04-22T14:02:32.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.750+0000 7f2116ffd700 1 --2- 172.21.15.103:0/790920239 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f210804d970 0x7f210804fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:32.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.750+0000 7f2116ffd700 1 -- 172.21.15.103:0/790920239 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2120061450 con 0x7f2128149880 2020-04-22T14:02:32.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.750+0000 7f212dc5e700 1 --2- 172.21.15.103:0/790920239 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f210804d970 0x7f210804fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:32.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.750+0000 7f212dc5e700 1 --2- 172.21.15.103:0/790920239 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f210804d970 0x7f210804fe30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f21281412a0 tx=0x7f2124007700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.750+0000 7f212dc5e700 1 --2- 172.21.15.103:0/790920239 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f210804d970 0x7f210804fe30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f21281412a0 tx=0x7f2124007700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.750+0000 7f212dc5e700 1 --2- 172.21.15.103:0/790920239 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f210804d970 0x7f210804fe30 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7f21281412a0 tx=0x7f2124007700).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:32.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.753+0000 7f212e45f700 1 --2- 172.21.15.103:0/790920239 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2128149880 0x7f2128144de0 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f21200032b0 tx=0x7f2120010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.753+0000 7f2116ffd700 1 -- 172.21.15.103:0/790920239 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f212003c830 con 0x7f2128149880 2020-04-22T14:02:32.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.895+0000 7f212ec60700 1 -- 172.21.15.103:0/790920239 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2128067230 con 0x7f2128149880 2020-04-22T14:02:32.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.896+0000 7f212e45f700 1 --2- 172.21.15.103:0/790920239 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2128149880 0x7f2128144de0 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f21200032b0 tx=0x7f2120010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:32.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.896+0000 7f2116ffd700 1 -- 172.21.15.103:0/790920239 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f212003fe50 con 0x7f2128149880 2020-04-22T14:02:32.900 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:02:32.900 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":24,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:02:28.687155+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:02:25.963043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-22T14:02:26.642611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:02:32.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.897+0000 7f212ec60700 1 -- 172.21.15.103:0/790920239 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f210804d970 msgr2=0x7f210804fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:32.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.897+0000 7f212ec60700 1 --2- 172.21.15.103:0/790920239 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f210804d970 0x7f210804fe30 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7f21281412a0 tx=0x7f2124007700).stop 2020-04-22T14:02:32.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.897+0000 7f212ec60700 1 -- 172.21.15.103:0/790920239 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2128149880 msgr2=0x7f2128144de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:32.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.897+0000 7f212ec60700 1 --2- 172.21.15.103:0/790920239 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2128149880 0x7f2128144de0 secure :-1 s=READY pgs=22 cs=0 l=1 rx=0x7f21200032b0 tx=0x7f2120010f30).stop 2020-04-22T14:02:32.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.897+0000 7f212ec60700 1 -- 172.21.15.103:0/790920239 shutdown_connections 2020-04-22T14:02:32.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.897+0000 7f212ec60700 1 --2- 172.21.15.103:0/790920239 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2128149880 0x7f2128144de0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:32.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.897+0000 7f212ec60700 1 --2- 172.21.15.103:0/790920239 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f210804d970 0x7f210804fe30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:32.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.897+0000 7f212ec60700 1 --2- 172.21.15.103:0/790920239 >> v2:172.21.15.86:3300/0 conn(0x7f2128145cc0 0x7f21280ae340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:32.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.897+0000 7f212ec60700 1 -- 172.21.15.103:0/790920239 >> 172.21.15.103:0/790920239 conn(0x7f21280601e0 msgr2=0x7f21280b3740 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:32.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.897+0000 7f212ec60700 1 -- 172.21.15.103:0/790920239 shutdown_connections 2020-04-22T14:02:32.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:32.897+0000 7f212ec60700 1 -- 172.21.15.103:0/790920239 wait complete. 2020-04-22T14:02:32.911 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-04-22T14:02:32.911 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:32.925 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:02:33.070 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.068+0000 7f1c16e0a700 1 Processor -- start 2020-04-22T14:02:33.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.068+0000 7f1c16e0a700 1 -- start start 2020-04-22T14:02:33.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.068+0000 7f1c16e0a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1c1012c0d0 0x7f1c101464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:33.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.068+0000 7f1c16e0a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1c10063e30 0x7f1c100642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:33.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.068+0000 7f1c16e0a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c10143300 con 0x7f1c10065fe0 2020-04-22T14:02:33.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.068+0000 7f1c16e0a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c101435a0 con 0x7f1c1012c0d0 2020-04-22T14:02:33.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.068+0000 7f1c16e0a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c10143840 con 0x7f1c10063e30 2020-04-22T14:02:33.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.068+0000 7f1c153a7700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1c10063e30 0x7f1c100642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:33.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.069+0000 7f1c153a7700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1c10063e30 0x7f1c100642c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47138/0 (socket says 172.21.15.103:47138) 2020-04-22T14:02:33.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.069+0000 7f1c153a7700 1 -- 172.21.15.103:0/2629913212 learned_addr learned my addr 172.21.15.103:0/2629913212 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:33.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.069+0000 7f1c14ba6700 1 --2- 172.21.15.103:0/2629913212 >> v2:172.21.15.86:3300/0 conn(0x7f1c1012c0d0 0x7f1c101464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:33.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.069+0000 7f1c153a7700 1 -- 172.21.15.103:0/2629913212 >> v2:172.21.15.86:3300/0 conn(0x7f1c1012c0d0 msgr2=0x7f1c101464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:33.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.069+0000 7f1c153a7700 1 --2- 172.21.15.103:0/2629913212 >> v2:172.21.15.86:3300/0 conn(0x7f1c1012c0d0 0x7f1c101464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:33.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.069+0000 7f1c153a7700 1 -- 172.21.15.103:0/2629913212 >> v1:172.21.15.86:6789/0 conn(0x7f1c10065fe0 legacy=0x7f1c1005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:33.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.069+0000 7f1c153a7700 1 -- 172.21.15.103:0/2629913212 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c1005bb50 con 0x7f1c10063e30 2020-04-22T14:02:33.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.069+0000 7f1c153a7700 1 --2- 172.21.15.103:0/2629913212 >> v2:172.21.15.103:3300/0 conn(0x7f1c10063e30 0x7f1c100642c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1c080032b0 tx=0x7f1c08007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.069+0000 7f1c153a7700 1 --2- 172.21.15.103:0/2629913212 >> v2:172.21.15.103:3300/0 conn(0x7f1c10063e30 0x7f1c100642c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1c080032b0 tx=0x7f1c08007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.069+0000 7f1c153a7700 1 --2- 172.21.15.103:0/2629913212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c10063e30 0x7f1c100642c0 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7f1c080032b0 tx=0x7f1c08007dc0).ready entity=mon.1 client_cookie=9ae9376f1eca7f2d server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:33.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.069+0000 7f1c153a7700 1 --2- 172.21.15.103:0/2629913212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c10063e30 0x7f1c100642c0 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f1c080032b0 tx=0x7f1c08007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.069+0000 7f1c0f7fe700 1 -- 172.21.15.103:0/2629913212 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c0800a180 con 0x7f1c10063e30 2020-04-22T14:02:33.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.069+0000 7f1c153a7700 1 --2- 172.21.15.103:0/2629913212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c10063e30 0x7f1c100642c0 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f1c080032b0 tx=0x7f1c08007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.069+0000 7f1c153a7700 1 --2- 172.21.15.103:0/2629913212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c10063e30 0x7f1c100642c0 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f1c080032b0 tx=0x7f1c08007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.069+0000 7f1c0f7fe700 1 -- 172.21.15.103:0/2629913212 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0800a2e0 con 0x7f1c10063e30 2020-04-22T14:02:33.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.069+0000 7f1c0f7fe700 1 -- 172.21.15.103:0/2629913212 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c0800a700 con 0x7f1c10063e30 2020-04-22T14:02:33.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.069+0000 7f1c16e0a700 1 -- 172.21.15.103:0/2629913212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c10063e30 msgr2=0x7f1c100642c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:33.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.069+0000 7f1c16e0a700 1 --2- 172.21.15.103:0/2629913212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c10063e30 0x7f1c100642c0 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7f1c080032b0 tx=0x7f1c08007dc0).stop 2020-04-22T14:02:33.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.070+0000 7f1c16e0a700 1 -- 172.21.15.103:0/2629913212 shutdown_connections 2020-04-22T14:02:33.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.070+0000 7f1c16e0a700 1 --2- 172.21.15.103:0/2629913212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c10063e30 0x7f1c100642c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:33.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.070+0000 7f1c16e0a700 1 --2- 172.21.15.103:0/2629913212 >> v2:172.21.15.86:3300/0 conn(0x7f1c1012c0d0 0x7f1c101464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:33.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.070+0000 7f1c16e0a700 1 -- 172.21.15.103:0/2629913212 >> 172.21.15.103:0/2629913212 conn(0x7f1c100b9160 msgr2=0x7f1c1005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:33.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.070+0000 7f1c16e0a700 1 -- 172.21.15.103:0/2629913212 shutdown_connections 2020-04-22T14:02:33.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.070+0000 7f1c16e0a700 1 -- 172.21.15.103:0/2629913212 wait complete. 2020-04-22T14:02:33.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.071+0000 7f1c16e0a700 1 Processor -- start 2020-04-22T14:02:33.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.071+0000 7f1c16e0a700 1 -- start start 2020-04-22T14:02:33.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.071+0000 7f1c16e0a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1c10065fe0 0x7f1c10129fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:33.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.071+0000 7f1c16e0a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c1012c0d0 0x7f1c100b7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:33.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.071+0000 7f1c16e0a700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c101529e0 con 0x7f1c10063e30 2020-04-22T14:02:33.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.071+0000 7f1c16e0a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c10155e90 con 0x7f1c10065fe0 2020-04-22T14:02:33.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.071+0000 7f1c16e0a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c10151b90 con 0x7f1c1012c0d0 2020-04-22T14:02:33.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.071+0000 7f1c14ba6700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f1c10063e30 0x7f1c101522d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39332/0 (socket says 172.21.15.103:39332) 2020-04-22T14:02:33.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.071+0000 7f1c14ba6700 1 -- 172.21.15.103:0/734829188 learned_addr learned my addr 172.21.15.103:0/734829188 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:33.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.072+0000 7f1c0ffff700 1 --2- 172.21.15.103:0/734829188 >> v2:172.21.15.86:3300/0 conn(0x7f1c10065fe0 0x7f1c10129fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:33.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.072+0000 7f1c153a7700 1 --2- 172.21.15.103:0/734829188 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c1012c0d0 0x7f1c100b7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:33.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.072+0000 7f1c0dffb700 1 -- 172.21.15.103:0/734829188 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1659186510 0 0) 0x7f1c101529e0 con 0x7f1c10063e30 2020-04-22T14:02:33.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.072+0000 7f1c0dffb700 1 -- 172.21.15.103:0/734829188 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bf0002fe0 con 0x7f1c10063e30 2020-04-22T14:02:33.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.072+0000 7f1c0ffff700 1 -- 172.21.15.103:0/734829188 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c1012c0d0 msgr2=0x7f1c100b7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:33.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.072+0000 7f1c0ffff700 1 --2- 172.21.15.103:0/734829188 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c1012c0d0 0x7f1c100b7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:33.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.072+0000 7f1c0ffff700 1 -- 172.21.15.103:0/734829188 >> v1:172.21.15.103:6789/0 conn(0x7f1c10063e30 legacy=0x7f1c101522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:33.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.072+0000 7f1c0ffff700 1 -- 172.21.15.103:0/734829188 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c10151e30 con 0x7f1c10065fe0 2020-04-22T14:02:33.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.072+0000 7f1c0ffff700 1 --2- 172.21.15.103:0/734829188 >> v2:172.21.15.86:3300/0 conn(0x7f1c10065fe0 0x7f1c10129fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1c100669a0 tx=0x7f1c040108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.072+0000 7f1c0ffff700 1 --2- 172.21.15.103:0/734829188 >> v2:172.21.15.86:3300/0 conn(0x7f1c10065fe0 0x7f1c10129fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1c100669a0 tx=0x7f1c040108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.072+0000 7f1c0ffff700 1 --2- 172.21.15.103:0/734829188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c10065fe0 0x7f1c10129fa0 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7f1c100669a0 tx=0x7f1c040108e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:33.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.072+0000 7f1c0ffff700 1 --2- 172.21.15.103:0/734829188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c10065fe0 0x7f1c10129fa0 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f1c100669a0 tx=0x7f1c040108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.072+0000 7f1c0dffb700 1 -- 172.21.15.103:0/734829188 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c0400cc00 con 0x7f1c10065fe0 2020-04-22T14:02:33.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.072+0000 7f1c0ffff700 1 --2- 172.21.15.103:0/734829188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c10065fe0 0x7f1c10129fa0 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f1c100669a0 tx=0x7f1c040108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.072+0000 7f1c0dffb700 1 -- 172.21.15.103:0/734829188 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c04011e90 con 0x7f1c10065fe0 2020-04-22T14:02:33.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.072+0000 7f1c16e0a700 1 -- 172.21.15.103:0/734829188 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c100afd90 con 0x7f1c10065fe0 2020-04-22T14:02:33.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.072+0000 7f1c0ffff700 1 --2- 172.21.15.103:0/734829188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c10065fe0 0x7f1c10129fa0 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f1c100669a0 tx=0x7f1c040108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.072+0000 7f1c0dffb700 1 -- 172.21.15.103:0/734829188 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c04010e20 con 0x7f1c10065fe0 2020-04-22T14:02:33.087 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.072+0000 7f1c16e0a700 1 -- 172.21.15.103:0/734829188 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c10155c20 con 0x7f1c10065fe0 2020-04-22T14:02:33.087 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.073+0000 7f1c0ffff700 1 --2- 172.21.15.103:0/734829188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c10065fe0 0x7f1c10129fa0 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f1c100669a0 tx=0x7f1c040108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.087 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.073+0000 7f1c16e0a700 1 -- 172.21.15.103:0/734829188 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c10151fc0 con 0x7f1c10065fe0 2020-04-22T14:02:33.087 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.073+0000 7f1c0dffb700 1 -- 172.21.15.103:0/734829188 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f1c040064e0 con 0x7f1c10065fe0 2020-04-22T14:02:33.087 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.073+0000 7f1c0ffff700 1 --2- 172.21.15.103:0/734829188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c10065fe0 0x7f1c10129fa0 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f1c100669a0 tx=0x7f1c040108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.087 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.074+0000 7f1c0dffb700 1 --2- 172.21.15.103:0/734829188 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1bf004dc60 0x7f1bf0050120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:33.087 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.074+0000 7f1c0dffb700 1 -- 172.21.15.103:0/734829188 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1c04060e40 con 0x7f1c10065fe0 2020-04-22T14:02:33.087 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.074+0000 7f1c14ba6700 1 --2- 172.21.15.103:0/734829188 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1bf004dc60 0x7f1bf0050120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:33.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.074+0000 7f1c14ba6700 1 --2- 172.21.15.103:0/734829188 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1bf004dc60 0x7f1bf0050120 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1c00002f30 tx=0x7f1c000090b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.074+0000 7f1c14ba6700 1 --2- 172.21.15.103:0/734829188 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1bf004dc60 0x7f1bf0050120 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1c00002f30 tx=0x7f1c000090b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.074+0000 7f1c14ba6700 1 --2- 172.21.15.103:0/734829188 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1bf004dc60 0x7f1bf0050120 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7f1c00002f30 tx=0x7f1c000090b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:33.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.077+0000 7f1c0ffff700 1 --2- 172.21.15.103:0/734829188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c10065fe0 0x7f1c10129fa0 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f1c100669a0 tx=0x7f1c040108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.077+0000 7f1c0dffb700 1 -- 172.21.15.103:0/734829188 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f1c0403c1c0 con 0x7f1c10065fe0 2020-04-22T14:02:33.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.220+0000 7f1c16e0a700 1 -- 172.21.15.103:0/734829188 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c10056c90 con 0x7f1c10065fe0 2020-04-22T14:02:33.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.221+0000 7f1c0ffff700 1 --2- 172.21.15.103:0/734829188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c10065fe0 0x7f1c10129fa0 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f1c100669a0 tx=0x7f1c040108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.221+0000 7f1c0dffb700 1 -- 172.21.15.103:0/734829188 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f1c0403f7e0 con 0x7f1c10065fe0 2020-04-22T14:02:33.225 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:02:33.225 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":24,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:02:28.687155+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:02:25.963043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-22T14:02:26.642611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:02:33.226 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.222+0000 7f1c16e0a700 1 -- 172.21.15.103:0/734829188 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1bf004dc60 msgr2=0x7f1bf0050120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:33.226 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.222+0000 7f1c16e0a700 1 --2- 172.21.15.103:0/734829188 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1bf004dc60 0x7f1bf0050120 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7f1c00002f30 tx=0x7f1c000090b0).stop 2020-04-22T14:02:33.226 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.222+0000 7f1c16e0a700 1 -- 172.21.15.103:0/734829188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c10065fe0 msgr2=0x7f1c10129fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:33.226 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.222+0000 7f1c16e0a700 1 --2- 172.21.15.103:0/734829188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c10065fe0 0x7f1c10129fa0 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7f1c100669a0 tx=0x7f1c040108e0).stop 2020-04-22T14:02:33.227 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.222+0000 7f1c16e0a700 1 -- 172.21.15.103:0/734829188 shutdown_connections 2020-04-22T14:02:33.227 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.222+0000 7f1c16e0a700 1 --2- 172.21.15.103:0/734829188 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c1012c0d0 0x7f1c100b7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:33.227 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.222+0000 7f1c16e0a700 1 --2- 172.21.15.103:0/734829188 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1bf004dc60 0x7f1bf0050120 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:33.227 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.222+0000 7f1c16e0a700 1 --2- 172.21.15.103:0/734829188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c10065fe0 0x7f1c10129fa0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:33.227 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.222+0000 7f1c16e0a700 1 -- 172.21.15.103:0/734829188 >> 172.21.15.103:0/734829188 conn(0x7f1c100b9160 msgr2=0x7f1c10061770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:33.227 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.222+0000 7f1c16e0a700 1 -- 172.21.15.103:0/734829188 shutdown_connections 2020-04-22T14:02:33.227 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.222+0000 7f1c16e0a700 1 -- 172.21.15.103:0/734829188 wait complete. 2020-04-22T14:02:33.237 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:33.251 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.0 flush_pg_stats 2020-04-22T14:02:33.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.395+0000 7f49c75bc700 1 Processor -- start 2020-04-22T14:02:33.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.395+0000 7f49c75bc700 1 -- start start 2020-04-22T14:02:33.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.396+0000 7f49c75bc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f49c00b2530 0x7f49c00b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:33.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.396+0000 7f49c75bc700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49c00b0e90 con 0x7f49c00b4700 2020-04-22T14:02:33.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.396+0000 7f49c75bc700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49c00b1130 con 0x7f49c00b4320 2020-04-22T14:02:33.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.396+0000 7f49c75bc700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49c00b2a90 con 0x7f49c00b2530 2020-04-22T14:02:33.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.396+0000 7f49c5b59700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f49c00b2530 0x7f49c00b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:33.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.396+0000 7f49c5358700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f49c00b4320 0x7f49c00b15d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39340/0 (socket says 172.21.15.103:39340) 2020-04-22T14:02:33.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.396+0000 7f49c5358700 1 -- 172.21.15.103:0/706288098 learned_addr learned my addr 172.21.15.103:0/706288098 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:33.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.397+0000 7f49c5b59700 1 -- 172.21.15.103:0/706288098 >> v1:172.21.15.103:6789/0 conn(0x7f49c00b4320 legacy=0x7f49c00b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:33.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.397+0000 7f49c5b59700 1 -- 172.21.15.103:0/706288098 >> v1:172.21.15.86:6789/0 conn(0x7f49c00b4700 legacy=0x7f49c00afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:33.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.397+0000 7f49c5b59700 1 -- 172.21.15.103:0/706288098 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c00b1ce0 con 0x7f49c00b2530 2020-04-22T14:02:33.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.397+0000 7f49c5b59700 1 --2- 172.21.15.103:0/706288098 >> v2:172.21.15.103:3300/0 conn(0x7f49c00b2530 0x7f49c00b0170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f49b80032b0 tx=0x7f49b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.397+0000 7f49c5b59700 1 --2- 172.21.15.103:0/706288098 >> v2:172.21.15.103:3300/0 conn(0x7f49c00b2530 0x7f49c00b0170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f49b80032b0 tx=0x7f49b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.397+0000 7f49c5b59700 1 --2- 172.21.15.103:0/706288098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49c00b2530 0x7f49c00b0170 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7f49b80032b0 tx=0x7f49b8007dc0).ready entity=mon.1 client_cookie=565b9c695786922d server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:33.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.397+0000 7f49c5b59700 1 --2- 172.21.15.103:0/706288098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49c00b2530 0x7f49c00b0170 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7f49b80032b0 tx=0x7f49b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.397+0000 7f49b3fff700 1 -- 172.21.15.103:0/706288098 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49b800a180 con 0x7f49c00b2530 2020-04-22T14:02:33.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.397+0000 7f49c5b59700 1 --2- 172.21.15.103:0/706288098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49c00b2530 0x7f49c00b0170 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7f49b80032b0 tx=0x7f49b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.397+0000 7f49c5b59700 1 --2- 172.21.15.103:0/706288098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49c00b2530 0x7f49c00b0170 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7f49b80032b0 tx=0x7f49b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.397+0000 7f49b3fff700 1 -- 172.21.15.103:0/706288098 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b800a2e0 con 0x7f49c00b2530 2020-04-22T14:02:33.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.397+0000 7f49b3fff700 1 -- 172.21.15.103:0/706288098 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49b800a700 con 0x7f49c00b2530 2020-04-22T14:02:33.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.397+0000 7f49c75bc700 1 -- 172.21.15.103:0/706288098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49c00b2530 msgr2=0x7f49c00b0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:33.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.397+0000 7f49c75bc700 1 --2- 172.21.15.103:0/706288098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49c00b2530 0x7f49c00b0170 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7f49b80032b0 tx=0x7f49b8007dc0).stop 2020-04-22T14:02:33.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.397+0000 7f49c75bc700 1 -- 172.21.15.103:0/706288098 shutdown_connections 2020-04-22T14:02:33.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.397+0000 7f49c75bc700 1 --2- 172.21.15.103:0/706288098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49c00b2530 0x7f49c00b0170 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:33.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.397+0000 7f49c75bc700 1 -- 172.21.15.103:0/706288098 >> 172.21.15.103:0/706288098 conn(0x7f49c00b86b0 msgr2=0x7f49c00b8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:33.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.398+0000 7f49c75bc700 1 -- 172.21.15.103:0/706288098 shutdown_connections 2020-04-22T14:02:33.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.398+0000 7f49c75bc700 1 -- 172.21.15.103:0/706288098 wait complete. 2020-04-22T14:02:33.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.398+0000 7f49c75bc700 1 Processor -- start 2020-04-22T14:02:33.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.399+0000 7f49c75bc700 1 -- start start 2020-04-22T14:02:33.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.399+0000 7f49c75bc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f49c00b4320 0x7f49c01354e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:33.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.399+0000 7f49c75bc700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49c0157250 con 0x7f49c00b4700 2020-04-22T14:02:33.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.399+0000 7f49c75bc700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49c01574f0 con 0x7f49c00b2530 2020-04-22T14:02:33.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.399+0000 7f49c75bc700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49c0157790 con 0x7f49c00b4320 2020-04-22T14:02:33.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.399+0000 7f49c5358700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f49c00b2530 0x7f49c0131eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39344/0 (socket says 172.21.15.103:39344) 2020-04-22T14:02:33.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.399+0000 7f49c5358700 1 -- 172.21.15.103:0/206591967 learned_addr learned my addr 172.21.15.103:0/206591967 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:33.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.399+0000 7f49c4b57700 1 --2- 172.21.15.103:0/206591967 >> v2:172.21.15.103:3300/0 conn(0x7f49c00b4320 0x7f49c01354e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:33.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.399+0000 7f49b27fc700 1 -- 172.21.15.103:0/206591967 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3277472234 0 0) 0x7f49c01574f0 con 0x7f49c00b2530 2020-04-22T14:02:33.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.399+0000 7f49b27fc700 1 -- 172.21.15.103:0/206591967 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49a0002fe0 con 0x7f49c00b2530 2020-04-22T14:02:33.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.400+0000 7f49c4b57700 1 -- 172.21.15.103:0/206591967 >> v1:172.21.15.103:6789/0 conn(0x7f49c00b2530 legacy=0x7f49c0131eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:33.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.400+0000 7f49c4b57700 1 -- 172.21.15.103:0/206591967 >> v1:172.21.15.86:6789/0 conn(0x7f49c00b4700 legacy=0x7f49c0143ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:33.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.400+0000 7f49c4b57700 1 -- 172.21.15.103:0/206591967 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c01351f0 con 0x7f49c00b4320 2020-04-22T14:02:33.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.400+0000 7f49c4b57700 1 --2- 172.21.15.103:0/206591967 >> v2:172.21.15.103:3300/0 conn(0x7f49c00b4320 0x7f49c01354e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f49bc0013f0 tx=0x7f49bc010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.400+0000 7f49c4b57700 1 --2- 172.21.15.103:0/206591967 >> v2:172.21.15.103:3300/0 conn(0x7f49c00b4320 0x7f49c01354e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f49bc0013f0 tx=0x7f49bc010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.400+0000 7f49c4b57700 1 --2- 172.21.15.103:0/206591967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49c00b4320 0x7f49c01354e0 secure :-1 s=READY pgs=122 cs=0 l=1 rx=0x7f49bc0013f0 tx=0x7f49bc010910).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:33.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.400+0000 7f49c4b57700 1 --2- 172.21.15.103:0/206591967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49c00b4320 0x7f49c01354e0 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f49bc0013f0 tx=0x7f49bc010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.400+0000 7f49b27fc700 1 -- 172.21.15.103:0/206591967 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49bc00cc00 con 0x7f49c00b4320 2020-04-22T14:02:33.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.400+0000 7f49c4b57700 1 --2- 172.21.15.103:0/206591967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49c00b4320 0x7f49c01354e0 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f49bc0013f0 tx=0x7f49bc010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.400+0000 7f49c4b57700 1 --2- 172.21.15.103:0/206591967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49c00b4320 0x7f49c01354e0 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f49bc0013f0 tx=0x7f49bc010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.400+0000 7f49b27fc700 1 -- 172.21.15.103:0/206591967 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49bc00cda0 con 0x7f49c00b4320 2020-04-22T14:02:33.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.400+0000 7f49c75bc700 1 -- 172.21.15.103:0/206591967 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c01325c0 con 0x7f49c00b4320 2020-04-22T14:02:33.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.400+0000 7f49b27fc700 1 -- 172.21.15.103:0/206591967 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49bc0110b0 con 0x7f49c00b4320 2020-04-22T14:02:33.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.400+0000 7f49c75bc700 1 -- 172.21.15.103:0/206591967 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c0153d80 con 0x7f49c00b4320 2020-04-22T14:02:33.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.400+0000 7f49c4b57700 1 --2- 172.21.15.103:0/206591967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49c00b4320 0x7f49c01354e0 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f49bc0013f0 tx=0x7f49bc010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.401+0000 7f49c75bc700 1 -- 172.21.15.103:0/206591967 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f49c0056c90 con 0x7f49c00b4320 2020-04-22T14:02:33.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.401+0000 7f49b27fc700 1 -- 172.21.15.103:0/206591967 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f49bc0064e0 con 0x7f49c00b4320 2020-04-22T14:02:33.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.401+0000 7f49c4b57700 1 --2- 172.21.15.103:0/206591967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49c00b4320 0x7f49c01354e0 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f49bc0013f0 tx=0x7f49bc010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.401+0000 7f49c4b57700 1 --2- 172.21.15.103:0/206591967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49c00b4320 0x7f49c01354e0 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7f49bc0013f0 tx=0x7f49bc010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.401+0000 7f49b27fc700 1 --2- 172.21.15.103:0/206591967 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f49a004dcf0 0x7f49a00501b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:33.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.401+0000 7f49b27fc700 1 -- 172.21.15.103:0/206591967 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f49bc060f60 con 0x7f49c00b4320 2020-04-22T14:02:33.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.401+0000 7f49b27fc700 1 --2- 172.21.15.103:0/206591967 >> [v2:172.21.15.103:6800/33072,v1:172.21.15.103:6801/33072] conn(0x7f49a0054860 0x7f49a0056c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:33.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.401+0000 7f49b27fc700 1 -- 172.21.15.103:0/206591967 --> [v2:172.21.15.103:6800/33072,v1:172.21.15.103:6801/33072] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f49a0057240 con 0x7f49a0054860 2020-04-22T14:02:33.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.401+0000 7f49b27fc700 1 -- 172.21.15.103:0/206591967 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f49bc062340 con 0x7f49c00b4320 2020-04-22T14:02:33.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.401+0000 7f49c5358700 1 --2- 172.21.15.103:0/206591967 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f49a004dcf0 0x7f49a00501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:33.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.401+0000 7f49c5b59700 1 --2- 172.21.15.103:0/206591967 >> [v2:172.21.15.103:6800/33072,v1:172.21.15.103:6801/33072] conn(0x7f49a0054860 0x7f49a0056c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:33.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.401+0000 7f49c5358700 1 --2- 172.21.15.103:0/206591967 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f49a004dcf0 0x7f49a00501b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f49b4000eb0 tx=0x7f49b4001660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.402+0000 7f49c5358700 1 --2- 172.21.15.103:0/206591967 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f49a004dcf0 0x7f49a00501b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f49b4000eb0 tx=0x7f49b4001660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.402+0000 7f49c5358700 1 --2- 172.21.15.103:0/206591967 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f49a004dcf0 0x7f49a00501b0 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7f49b4000eb0 tx=0x7f49b4001660).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:33.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.402+0000 7f49c5b59700 1 --2- 172.21.15.103:0/206591967 >> [v2:172.21.15.103:6800/33072,v1:172.21.15.103:6801/33072] conn(0x7f49a0054860 0x7f49a0056c80 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:33.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.402+0000 7f49b27fc700 1 -- 172.21.15.103:0/206591967 <== osd.0 v2:172.21.15.103:6800/33072 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f49a0057240 con 0x7f49a0054860 2020-04-22T14:02:33.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.420+0000 7f49c75bc700 1 -- 172.21.15.103:0/206591967 --> [v2:172.21.15.103:6800/33072,v1:172.21.15.103:6801/33072] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f49c0157fb0 con 0x7f49a0054860 2020-04-22T14:02:33.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.420+0000 7f49b27fc700 1 -- 172.21.15.103:0/206591967 <== osd.0 v2:172.21.15.103:6800/33072 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f49c0157fb0 con 0x7f49a0054860 2020-04-22T14:02:33.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.420+0000 7f49c75bc700 1 -- 172.21.15.103:0/206591967 >> [v2:172.21.15.103:6800/33072,v1:172.21.15.103:6801/33072] conn(0x7f49a0054860 msgr2=0x7f49a0056c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:33.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.420+0000 7f49c75bc700 1 --2- 172.21.15.103:0/206591967 >> [v2:172.21.15.103:6800/33072,v1:172.21.15.103:6801/33072] conn(0x7f49a0054860 0x7f49a0056c80 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:33.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.421+0000 7f49c75bc700 1 -- 172.21.15.103:0/206591967 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f49a004dcf0 msgr2=0x7f49a00501b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:33.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.421+0000 7f49c75bc700 1 --2- 172.21.15.103:0/206591967 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f49a004dcf0 0x7f49a00501b0 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7f49b4000eb0 tx=0x7f49b4001660).stop 2020-04-22T14:02:33.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.421+0000 7f49c75bc700 1 -- 172.21.15.103:0/206591967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49c00b4320 msgr2=0x7f49c01354e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:33.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.421+0000 7f49c75bc700 1 --2- 172.21.15.103:0/206591967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49c00b4320 0x7f49c01354e0 secure :-1 s=READY pgs=122 cs=0 l=1 rx=0x7f49bc0013f0 tx=0x7f49bc010910).stop 2020-04-22T14:02:33.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.421+0000 7f49c5b59700 1 -- 172.21.15.103:0/206591967 reap_dead start 2020-04-22T14:02:33.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.421+0000 7f49c75bc700 1 -- 172.21.15.103:0/206591967 shutdown_connections 2020-04-22T14:02:33.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.421+0000 7f49c75bc700 1 --2- 172.21.15.103:0/206591967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49c00b4320 0x7f49c01354e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:33.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.421+0000 7f49c75bc700 1 -- 172.21.15.103:0/206591967 >> 172.21.15.103:0/206591967 conn(0x7f49c00b86b0 msgr2=0x7f49c00ad040 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:33.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.421+0000 7f49c75bc700 1 -- 172.21.15.103:0/206591967 shutdown_connections 2020-04-22T14:02:33.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.421+0000 7f49c75bc700 1 -- 172.21.15.103:0/206591967 wait complete. 2020-04-22T14:02:33.433 INFO:teuthology.orchestra.run.smithi103.stdout:60129542149 2020-04-22T14:02:33.433 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:33.447 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 flush_pg_stats 2020-04-22T14:02:33.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.592+0000 7f80986d8700 1 Processor -- start 2020-04-22T14:02:33.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.592+0000 7f80986d8700 1 -- start start 2020-04-22T14:02:33.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.593+0000 7f80986d8700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f80900b4320 0x7f80900b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:33.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.593+0000 7f80986d8700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80900b0e90 con 0x7f80900b4700 2020-04-22T14:02:33.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.593+0000 7f80986d8700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80900b1130 con 0x7f80900b2530 2020-04-22T14:02:33.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.593+0000 7f80986d8700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80900b2a90 con 0x7f80900b4320 2020-04-22T14:02:33.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.593+0000 7f8096c75700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f80900b2530 0x7f809013c940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39358/0 (socket says 172.21.15.103:39358) 2020-04-22T14:02:33.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.593+0000 7f8096c75700 1 -- 172.21.15.103:0/871845796 learned_addr learned my addr 172.21.15.103:0/871845796 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:33.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.594+0000 7f8096474700 1 --2- 172.21.15.103:0/871845796 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f80900b4320 0x7f80900b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:33.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.594+0000 7f8095472700 1 -- 172.21.15.103:0/871845796 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2854676691 0 0) 0x7f80900b1130 con 0x7f80900b2530 2020-04-22T14:02:33.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.594+0000 7f8095472700 1 -- 172.21.15.103:0/871845796 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8078003230 con 0x7f80900b2530 2020-04-22T14:02:33.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.594+0000 7f8095472700 1 -- 172.21.15.103:0/871845796 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1561377953 0 0) 0x7f8078003230 con 0x7f80900b2530 2020-04-22T14:02:33.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.594+0000 7f8095472700 1 -- 172.21.15.103:0/871845796 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f80900b4320 msgr2=0x7f80900b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:33.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.594+0000 7f8095472700 1 --2- 172.21.15.103:0/871845796 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f80900b4320 0x7f80900b15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:33.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.594+0000 7f8095472700 1 -- 172.21.15.103:0/871845796 >> v1:172.21.15.86:6789/0 conn(0x7f80900b4700 legacy=0x7f80900afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:33.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.594+0000 7f8095472700 1 -- 172.21.15.103:0/871845796 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80900ae500 con 0x7f80900b2530 2020-04-22T14:02:33.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.594+0000 7f8095472700 1 -- 172.21.15.103:0/871845796 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f8088001a50 con 0x7f80900b2530 2020-04-22T14:02:33.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.594+0000 7f8095472700 1 -- 172.21.15.103:0/871845796 >> v1:172.21.15.103:6789/0 conn(0x7f80900b2530 legacy=0x7f809013c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:33.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.594+0000 7f8095472700 1 --2- 172.21.15.103:0/871845796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8078003720 0x7f8078003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:33.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.594+0000 7f8095472700 1 --2- 172.21.15.103:0/871845796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8078004060 0x7f8078004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:33.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.594+0000 7f8095472700 1 --2- 172.21.15.103:0/871845796 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f80900b4320 0x7f8078004ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:33.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.594+0000 7f8095472700 1 -- 172.21.15.103:0/871845796 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80900b2a90 con 0x7f8078003720 2020-04-22T14:02:33.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.594+0000 7f8095472700 1 -- 172.21.15.103:0/871845796 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8078004f70 con 0x7f8078004060 2020-04-22T14:02:33.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.594+0000 7f8095472700 1 -- 172.21.15.103:0/871845796 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8078005130 con 0x7f80900b4320 2020-04-22T14:02:33.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.594+0000 7f8095c73700 1 --2- 172.21.15.103:0/871845796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8078004060 0x7f8078004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:33.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.594+0000 7f8096474700 1 --2- 172.21.15.103:0/871845796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8078003720 0x7f8078003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:33.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.594+0000 7f8096c75700 1 --2- 172.21.15.103:0/871845796 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f80900b4320 0x7f8078004ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:33.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.594+0000 7f8095c73700 1 -- 172.21.15.103:0/871845796 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f80900b4320 msgr2=0x7f8078004ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:33.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.594+0000 7f8095c73700 1 --2- 172.21.15.103:0/871845796 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f80900b4320 0x7f8078004ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:33.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.594+0000 7f8095c73700 1 -- 172.21.15.103:0/871845796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8078003720 msgr2=0x7f8078003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:33.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.594+0000 7f8095c73700 1 --2- 172.21.15.103:0/871845796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8078003720 0x7f8078003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:33.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.594+0000 7f8095c73700 1 -- 172.21.15.103:0/871845796 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8078003230 con 0x7f8078004060 2020-04-22T14:02:33.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.594+0000 7f8095c73700 1 --2- 172.21.15.103:0/871845796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8078004060 0x7f8078004530 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f80900b0db0 tx=0x7f808c011ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.594+0000 7f8095c73700 1 --2- 172.21.15.103:0/871845796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8078004060 0x7f8078004530 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f80900b0db0 tx=0x7f808c011ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.594+0000 7f8095c73700 1 --2- 172.21.15.103:0/871845796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8078004060 0x7f8078004530 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7f80900b0db0 tx=0x7f808c011ef0).ready entity=mon.1 client_cookie=4566433063f249a8 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:33.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.595+0000 7f8095c73700 1 --2- 172.21.15.103:0/871845796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8078004060 0x7f8078004530 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f80900b0db0 tx=0x7f808c011ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.595+0000 7f8095472700 1 -- 172.21.15.103:0/871845796 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f808c003560 con 0x7f8078004060 2020-04-22T14:02:33.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.595+0000 7f8095c73700 1 --2- 172.21.15.103:0/871845796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8078004060 0x7f8078004530 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f80900b0db0 tx=0x7f808c011ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.595+0000 7f8095c73700 1 --2- 172.21.15.103:0/871845796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8078004060 0x7f8078004530 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f80900b0db0 tx=0x7f808c011ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.595+0000 7f8095472700 1 -- 172.21.15.103:0/871845796 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808c003700 con 0x7f8078004060 2020-04-22T14:02:33.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.595+0000 7f8095472700 1 -- 172.21.15.103:0/871845796 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f808c003b20 con 0x7f8078004060 2020-04-22T14:02:33.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.595+0000 7f80986d8700 1 -- 172.21.15.103:0/871845796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8078004060 msgr2=0x7f8078004530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:33.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.595+0000 7f80986d8700 1 --2- 172.21.15.103:0/871845796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8078004060 0x7f8078004530 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7f80900b0db0 tx=0x7f808c011ef0).stop 2020-04-22T14:02:33.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.595+0000 7f8096c75700 1 -- 172.21.15.103:0/871845796 reap_dead start 2020-04-22T14:02:33.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.595+0000 7f80986d8700 1 -- 172.21.15.103:0/871845796 shutdown_connections 2020-04-22T14:02:33.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.595+0000 7f80986d8700 1 -- 172.21.15.103:0/871845796 >> 172.21.15.103:0/871845796 conn(0x7f80900b86b0 msgr2=0x7f80900b8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:33.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.595+0000 7f80986d8700 1 -- 172.21.15.103:0/871845796 shutdown_connections 2020-04-22T14:02:33.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.595+0000 7f80986d8700 1 -- 172.21.15.103:0/871845796 wait complete. 2020-04-22T14:02:33.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.596+0000 7f80986d8700 1 Processor -- start 2020-04-22T14:02:33.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.596+0000 7f80986d8700 1 -- start start 2020-04-22T14:02:33.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.597+0000 7f80986d8700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8090065e40 0x7f80901570f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:33.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.597+0000 7f80986d8700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f80901396e0 0x7f809013d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:33.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.597+0000 7f80986d8700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8090157a00 con 0x7f8090157550 2020-04-22T14:02:33.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.597+0000 7f80986d8700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8090157ca0 con 0x7f8090065e40 2020-04-22T14:02:33.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.597+0000 7f80986d8700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8090157f40 con 0x7f80901396e0 2020-04-22T14:02:33.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.597+0000 7f8096474700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8090065e40 0x7f80901570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:33.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.597+0000 7f8096474700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8090065e40 0x7f80901570f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47176/0 (socket says 172.21.15.103:47176) 2020-04-22T14:02:33.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.597+0000 7f8096474700 1 -- 172.21.15.103:0/1697623006 learned_addr learned my addr 172.21.15.103:0/1697623006 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:33.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.597+0000 7f8096c75700 1 --2- 172.21.15.103:0/1697623006 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f80901396e0 0x7f809013d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:33.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.597+0000 7f8096474700 1 -- 172.21.15.103:0/1697623006 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f80901396e0 msgr2=0x7f809013d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:33.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.597+0000 7f8096474700 1 --2- 172.21.15.103:0/1697623006 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f80901396e0 0x7f809013d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:33.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.597+0000 7f8096474700 1 -- 172.21.15.103:0/1697623006 >> v1:172.21.15.86:6789/0 conn(0x7f8090157550 legacy=0x7f8090138fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:33.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.597+0000 7f8096474700 1 -- 172.21.15.103:0/1697623006 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8090066220 con 0x7f8090065e40 2020-04-22T14:02:33.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.597+0000 7f8096474700 1 --2- 172.21.15.103:0/1697623006 >> v2:172.21.15.103:3300/0 conn(0x7f8090065e40 0x7f80901570f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8080003070 tx=0x7f8080010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.597+0000 7f8096474700 1 --2- 172.21.15.103:0/1697623006 >> v2:172.21.15.103:3300/0 conn(0x7f8090065e40 0x7f80901570f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8080003070 tx=0x7f8080010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.597+0000 7f8096474700 1 --2- 172.21.15.103:0/1697623006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8090065e40 0x7f80901570f0 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7f8080003070 tx=0x7f8080010ce0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:33.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.597+0000 7f8096474700 1 --2- 172.21.15.103:0/1697623006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8090065e40 0x7f80901570f0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f8080003070 tx=0x7f8080010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.597+0000 7f8096474700 1 --2- 172.21.15.103:0/1697623006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8090065e40 0x7f80901570f0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f8080003070 tx=0x7f8080010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.597+0000 7f8096474700 1 --2- 172.21.15.103:0/1697623006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8090065e40 0x7f80901570f0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f8080003070 tx=0x7f8080010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.597+0000 7f807f7fe700 1 -- 172.21.15.103:0/1697623006 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8080005e90 con 0x7f8090065e40 2020-04-22T14:02:33.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.597+0000 7f807f7fe700 1 -- 172.21.15.103:0/1697623006 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8080007180 con 0x7f8090065e40 2020-04-22T14:02:33.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.597+0000 7f80986d8700 1 -- 172.21.15.103:0/1697623006 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f809013ebc0 con 0x7f8090065e40 2020-04-22T14:02:33.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.597+0000 7f807f7fe700 1 -- 172.21.15.103:0/1697623006 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8080007560 con 0x7f8090065e40 2020-04-22T14:02:33.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.597+0000 7f80986d8700 1 -- 172.21.15.103:0/1697623006 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f809013dd70 con 0x7f8090065e40 2020-04-22T14:02:33.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.598+0000 7f8096474700 1 --2- 172.21.15.103:0/1697623006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8090065e40 0x7f80901570f0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f8080003070 tx=0x7f8080010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.598+0000 7f80986d8700 1 -- 172.21.15.103:0/1697623006 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8090056c90 con 0x7f8090065e40 2020-04-22T14:02:33.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.598+0000 7f807f7fe700 1 -- 172.21.15.103:0/1697623006 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f8080009490 con 0x7f8090065e40 2020-04-22T14:02:33.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.598+0000 7f8096474700 1 --2- 172.21.15.103:0/1697623006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8090065e40 0x7f80901570f0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f8080003070 tx=0x7f8080010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.599+0000 7f8096474700 1 --2- 172.21.15.103:0/1697623006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8090065e40 0x7f80901570f0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f8080003070 tx=0x7f8080010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.599+0000 7f807f7fe700 1 --2- 172.21.15.103:0/1697623006 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f807004d940 0x7f807004fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:33.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.599+0000 7f807f7fe700 1 -- 172.21.15.103:0/1697623006 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f80800617a0 con 0x7f8090065e40 2020-04-22T14:02:33.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.599+0000 7f807f7fe700 1 --2- 172.21.15.103:0/1697623006 >> [v2:172.21.15.103:6808/33103,v1:172.21.15.103:6809/33103] conn(0x7f80700543b0 0x7f80700567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:33.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.599+0000 7f807f7fe700 1 -- 172.21.15.103:0/1697623006 --> [v2:172.21.15.103:6808/33103,v1:172.21.15.103:6809/33103] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8070056d90 con 0x7f80700543b0 2020-04-22T14:02:33.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.599+0000 7f807f7fe700 1 -- 172.21.15.103:0/1697623006 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8080062ba0 con 0x7f8090065e40 2020-04-22T14:02:33.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.599+0000 7f8095c73700 1 --2- 172.21.15.103:0/1697623006 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f807004d940 0x7f807004fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:33.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.599+0000 7f8096c75700 1 --2- 172.21.15.103:0/1697623006 >> [v2:172.21.15.103:6808/33103,v1:172.21.15.103:6809/33103] conn(0x7f80700543b0 0x7f80700567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:33.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.599+0000 7f8095c73700 1 --2- 172.21.15.103:0/1697623006 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f807004d940 0x7f807004fe00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8090142ed0 tx=0x7f808c011ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.599+0000 7f8095c73700 1 --2- 172.21.15.103:0/1697623006 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f807004d940 0x7f807004fe00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8090142ed0 tx=0x7f808c011ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.599+0000 7f8095c73700 1 --2- 172.21.15.103:0/1697623006 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f807004d940 0x7f807004fe00 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f8090142ed0 tx=0x7f808c011ef0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:33.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.599+0000 7f8096c75700 1 --2- 172.21.15.103:0/1697623006 >> [v2:172.21.15.103:6808/33103,v1:172.21.15.103:6809/33103] conn(0x7f80700543b0 0x7f80700567d0 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:33.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.600+0000 7f807f7fe700 1 -- 172.21.15.103:0/1697623006 <== osd.1 v2:172.21.15.103:6808/33103 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f8070056d90 con 0x7f80700543b0 2020-04-22T14:02:33.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.618+0000 7f80986d8700 1 -- 172.21.15.103:0/1697623006 --> [v2:172.21.15.103:6808/33103,v1:172.21.15.103:6809/33103] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f809013e690 con 0x7f80700543b0 2020-04-22T14:02:33.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.618+0000 7f807f7fe700 1 -- 172.21.15.103:0/1697623006 <== osd.1 v2:172.21.15.103:6808/33103 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f809013e690 con 0x7f80700543b0 2020-04-22T14:02:33.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.618+0000 7f80986d8700 1 -- 172.21.15.103:0/1697623006 >> [v2:172.21.15.103:6808/33103,v1:172.21.15.103:6809/33103] conn(0x7f80700543b0 msgr2=0x7f80700567d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:33.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.618+0000 7f80986d8700 1 --2- 172.21.15.103:0/1697623006 >> [v2:172.21.15.103:6808/33103,v1:172.21.15.103:6809/33103] conn(0x7f80700543b0 0x7f80700567d0 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:33.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.619+0000 7f80986d8700 1 -- 172.21.15.103:0/1697623006 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f807004d940 msgr2=0x7f807004fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:33.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.619+0000 7f80986d8700 1 --2- 172.21.15.103:0/1697623006 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f807004d940 0x7f807004fe00 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f8090142ed0 tx=0x7f808c011ef0).stop 2020-04-22T14:02:33.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.619+0000 7f80986d8700 1 -- 172.21.15.103:0/1697623006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8090065e40 msgr2=0x7f80901570f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:33.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.619+0000 7f80986d8700 1 --2- 172.21.15.103:0/1697623006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8090065e40 0x7f80901570f0 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7f8080003070 tx=0x7f8080010ce0).stop 2020-04-22T14:02:33.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.619+0000 7f8096c75700 1 -- 172.21.15.103:0/1697623006 reap_dead start 2020-04-22T14:02:33.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.619+0000 7f80986d8700 1 -- 172.21.15.103:0/1697623006 shutdown_connections 2020-04-22T14:02:33.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.619+0000 7f80986d8700 1 --2- 172.21.15.103:0/1697623006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8090065e40 0x7f80901570f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:33.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.619+0000 7f80986d8700 1 -- 172.21.15.103:0/1697623006 >> 172.21.15.103:0/1697623006 conn(0x7f80900b86b0 msgr2=0x7f8090140200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:33.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.619+0000 7f80986d8700 1 -- 172.21.15.103:0/1697623006 shutdown_connections 2020-04-22T14:02:33.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.619+0000 7f80986d8700 1 -- 172.21.15.103:0/1697623006 wait complete. 2020-04-22T14:02:33.652 INFO:teuthology.orchestra.run.smithi103.stdout:60129542150 2020-04-22T14:02:33.652 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:33.666 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.2 flush_pg_stats 2020-04-22T14:02:33.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.812+0000 7fe9af1f3700 1 Processor -- start 2020-04-22T14:02:33.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.812+0000 7fe9af1f3700 1 -- start start 2020-04-22T14:02:33.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.813+0000 7fe9af1f3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe9a80b86a0 0x7fe9a805b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:33.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.813+0000 7fe9af1f3700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9a814ab90 con 0x7fe9a8143a50 2020-04-22T14:02:33.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.813+0000 7fe9af1f3700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9a8146a20 con 0x7fe9a805b0b0 2020-04-22T14:02:33.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.813+0000 7fe9af1f3700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9a8146830 con 0x7fe9a80b86a0 2020-04-22T14:02:33.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.813+0000 7fe9a7fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe9a80b86a0 0x7fe9a805b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:33.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.813+0000 7fe9acf8f700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe9a805b0b0 0x7fe9a805f800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39376/0 (socket says 172.21.15.103:39376) 2020-04-22T14:02:33.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.813+0000 7fe9acf8f700 1 -- 172.21.15.103:0/2834284751 learned_addr learned my addr 172.21.15.103:0/2834284751 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:33.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.813+0000 7fe9a7fff700 1 -- 172.21.15.103:0/2834284751 >> v1:172.21.15.103:6789/0 conn(0x7fe9a805b0b0 legacy=0x7fe9a805f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:33.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.813+0000 7fe9a7fff700 1 -- 172.21.15.103:0/2834284751 >> v1:172.21.15.86:6789/0 conn(0x7fe9a8143a50 legacy=0x7fe9a8146ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:33.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.813+0000 7fe9a77fe700 1 -- 172.21.15.103:0/2834284751 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2600587363 0 0) 0x7fe9a8146a20 con 0x7fe9a805b0b0 2020-04-22T14:02:33.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.813+0000 7fe9a7fff700 1 -- 172.21.15.103:0/2834284751 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a805ff10 con 0x7fe9a80b86a0 2020-04-22T14:02:33.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.813+0000 7fe9a7fff700 1 --2- 172.21.15.103:0/2834284751 >> v2:172.21.15.103:3300/0 conn(0x7fe9a80b86a0 0x7fe9a805b490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe9a8060ab0 tx=0x7fe9900088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.813+0000 7fe9a7fff700 1 --2- 172.21.15.103:0/2834284751 >> v2:172.21.15.103:3300/0 conn(0x7fe9a80b86a0 0x7fe9a805b490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe9a8060ab0 tx=0x7fe9900088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.813+0000 7fe9a7fff700 1 --2- 172.21.15.103:0/2834284751 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9a80b86a0 0x7fe9a805b490 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7fe9a8060ab0 tx=0x7fe9900088e0).ready entity=mon.1 client_cookie=e778d0cbbbc83ce4 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:33.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.813+0000 7fe9a7fff700 1 --2- 172.21.15.103:0/2834284751 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9a80b86a0 0x7fe9a805b490 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fe9a8060ab0 tx=0x7fe9900088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.813+0000 7fe9a77fe700 1 -- 172.21.15.103:0/2834284751 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe990008e40 con 0x7fe9a80b86a0 2020-04-22T14:02:33.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.813+0000 7fe9a7fff700 1 --2- 172.21.15.103:0/2834284751 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9a80b86a0 0x7fe9a805b490 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fe9a8060ab0 tx=0x7fe9900088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.813+0000 7fe9a7fff700 1 --2- 172.21.15.103:0/2834284751 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9a80b86a0 0x7fe9a805b490 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fe9a8060ab0 tx=0x7fe9900088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.813+0000 7fe9a77fe700 1 -- 172.21.15.103:0/2834284751 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe990011660 con 0x7fe9a80b86a0 2020-04-22T14:02:33.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.813+0000 7fe9a77fe700 1 -- 172.21.15.103:0/2834284751 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe990011a80 con 0x7fe9a80b86a0 2020-04-22T14:02:33.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.813+0000 7fe9af1f3700 1 -- 172.21.15.103:0/2834284751 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9a80b86a0 msgr2=0x7fe9a805b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:33.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.813+0000 7fe9af1f3700 1 --2- 172.21.15.103:0/2834284751 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9a80b86a0 0x7fe9a805b490 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7fe9a8060ab0 tx=0x7fe9900088e0).stop 2020-04-22T14:02:33.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.814+0000 7fe9af1f3700 1 -- 172.21.15.103:0/2834284751 shutdown_connections 2020-04-22T14:02:33.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.814+0000 7fe9af1f3700 1 --2- 172.21.15.103:0/2834284751 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9a80b86a0 0x7fe9a805b490 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:33.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.814+0000 7fe9af1f3700 1 -- 172.21.15.103:0/2834284751 >> 172.21.15.103:0/2834284751 conn(0x7fe9a80bcae0 msgr2=0x7fe9a80bcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:33.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.814+0000 7fe9af1f3700 1 -- 172.21.15.103:0/2834284751 shutdown_connections 2020-04-22T14:02:33.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.814+0000 7fe9af1f3700 1 -- 172.21.15.103:0/2834284751 wait complete. 2020-04-22T14:02:33.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.815+0000 7fe9af1f3700 1 Processor -- start 2020-04-22T14:02:33.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.815+0000 7fe9af1f3700 1 -- start start 2020-04-22T14:02:33.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.816+0000 7fe9af1f3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9a805b0b0 0x7fe9a8148d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:33.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.816+0000 7fe9af1f3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe9a8143a50 0x7fe9a8153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:33.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.816+0000 7fe9af1f3700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9a8147480 con 0x7fe9a80b86a0 2020-04-22T14:02:33.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.816+0000 7fe9af1f3700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9a80ae6d0 con 0x7fe9a8143a50 2020-04-22T14:02:33.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.816+0000 7fe9af1f3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a8147720 con 0x7fe9a805b0b0 2020-04-22T14:02:33.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.816+0000 7fe9acf8f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9a805b0b0 0x7fe9a8148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:33.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.816+0000 7fe9ad790700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe9a8143a50 0x7fe9a8153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:33.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.816+0000 7fe9acf8f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9a805b0b0 0x7fe9a8148d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:60202/0 (socket says 172.21.15.103:60202) 2020-04-22T14:02:33.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.816+0000 7fe9acf8f700 1 -- 172.21.15.103:0/4162236896 learned_addr learned my addr 172.21.15.103:0/4162236896 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:33.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.816+0000 7fe9acf8f700 1 -- 172.21.15.103:0/4162236896 >> v2:172.21.15.86:3300/0 conn(0x7fe9a8143a50 msgr2=0x7fe9a8153af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:33.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.816+0000 7fe9acf8f700 1 --2- 172.21.15.103:0/4162236896 >> v2:172.21.15.86:3300/0 conn(0x7fe9a8143a50 0x7fe9a8153af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:33.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.816+0000 7fe9acf8f700 1 -- 172.21.15.103:0/4162236896 >> v1:172.21.15.86:6789/0 conn(0x7fe9a80b86a0 legacy=0x7fe9a8154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:33.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.816+0000 7fe9acf8f700 1 -- 172.21.15.103:0/4162236896 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a81479c0 con 0x7fe9a805b0b0 2020-04-22T14:02:33.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.816+0000 7fe9acf8f700 1 --2- 172.21.15.103:0/4162236896 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9a805b0b0 0x7fe9a8148d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe998000b80 tx=0x7fe998010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.816+0000 7fe9acf8f700 1 --2- 172.21.15.103:0/4162236896 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9a805b0b0 0x7fe9a8148d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe998000b80 tx=0x7fe998010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.816+0000 7fe9acf8f700 1 --2- 172.21.15.103:0/4162236896 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9a805b0b0 0x7fe9a8148d60 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7fe998000b80 tx=0x7fe998010960).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:33.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.816+0000 7fe9acf8f700 1 --2- 172.21.15.103:0/4162236896 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9a805b0b0 0x7fe9a8148d60 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fe998000b80 tx=0x7fe998010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.816+0000 7fe9a5ffb700 1 -- 172.21.15.103:0/4162236896 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe998005ca0 con 0x7fe9a805b0b0 2020-04-22T14:02:33.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.816+0000 7fe9acf8f700 1 --2- 172.21.15.103:0/4162236896 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9a805b0b0 0x7fe9a8148d60 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fe998000b80 tx=0x7fe998010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.816+0000 7fe9a5ffb700 1 -- 172.21.15.103:0/4162236896 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe998005e00 con 0x7fe9a805b0b0 2020-04-22T14:02:33.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.817+0000 7fe9af1f3700 1 -- 172.21.15.103:0/4162236896 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9a8154960 con 0x7fe9a805b0b0 2020-04-22T14:02:33.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.817+0000 7fe9acf8f700 1 --2- 172.21.15.103:0/4162236896 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9a805b0b0 0x7fe9a8148d60 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fe998000b80 tx=0x7fe998010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.817+0000 7fe9a5ffb700 1 -- 172.21.15.103:0/4162236896 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9980062c0 con 0x7fe9a805b0b0 2020-04-22T14:02:33.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.817+0000 7fe9af1f3700 1 -- 172.21.15.103:0/4162236896 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a8146fa0 con 0x7fe9a805b0b0 2020-04-22T14:02:33.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.817+0000 7fe9acf8f700 1 --2- 172.21.15.103:0/4162236896 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9a805b0b0 0x7fe9a8148d60 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fe998000b80 tx=0x7fe998010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.817+0000 7fe9af1f3700 1 -- 172.21.15.103:0/4162236896 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe9a8147300 con 0x7fe9a805b0b0 2020-04-22T14:02:33.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.818+0000 7fe9a5ffb700 1 -- 172.21.15.103:0/4162236896 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fe998006540 con 0x7fe9a805b0b0 2020-04-22T14:02:33.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.818+0000 7fe9acf8f700 1 --2- 172.21.15.103:0/4162236896 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9a805b0b0 0x7fe9a8148d60 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fe998000b80 tx=0x7fe998010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.818+0000 7fe9acf8f700 1 --2- 172.21.15.103:0/4162236896 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9a805b0b0 0x7fe9a8148d60 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fe998000b80 tx=0x7fe998010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.818+0000 7fe9a5ffb700 1 --2- 172.21.15.103:0/4162236896 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe98c04d8a0 0x7fe98c04fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:33.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.818+0000 7fe9a5ffb700 1 -- 172.21.15.103:0/4162236896 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe9980090c0 con 0x7fe9a805b0b0 2020-04-22T14:02:33.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.818+0000 7fe9a5ffb700 1 --2- 172.21.15.103:0/4162236896 >> [v2:172.21.15.103:6816/33153,v1:172.21.15.103:6817/33153] conn(0x7fe98c054480 0x7fe98c0568a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:33.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.818+0000 7fe9a5ffb700 1 -- 172.21.15.103:0/4162236896 --> [v2:172.21.15.103:6816/33153,v1:172.21.15.103:6817/33153] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe98c056e60 con 0x7fe98c054480 2020-04-22T14:02:33.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.818+0000 7fe9a5ffb700 1 -- 172.21.15.103:0/4162236896 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe998062910 con 0x7fe9a805b0b0 2020-04-22T14:02:33.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.818+0000 7fe9a7fff700 1 --2- 172.21.15.103:0/4162236896 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe98c04d8a0 0x7fe98c04fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:33.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.818+0000 7fe9ad790700 1 --2- 172.21.15.103:0/4162236896 >> [v2:172.21.15.103:6816/33153,v1:172.21.15.103:6817/33153] conn(0x7fe98c054480 0x7fe98c0568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:33.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.818+0000 7fe9a7fff700 1 --2- 172.21.15.103:0/4162236896 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe98c04d8a0 0x7fe98c04fd60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe9a8148140 tx=0x7fe9a805f760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.818+0000 7fe9a7fff700 1 --2- 172.21.15.103:0/4162236896 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe98c04d8a0 0x7fe98c04fd60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe9a8148140 tx=0x7fe9a805f760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:33.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.818+0000 7fe9a7fff700 1 --2- 172.21.15.103:0/4162236896 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe98c04d8a0 0x7fe98c04fd60 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7fe9a8148140 tx=0x7fe9a805f760).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:33.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.818+0000 7fe9ad790700 1 --2- 172.21.15.103:0/4162236896 >> [v2:172.21.15.103:6816/33153,v1:172.21.15.103:6817/33153] conn(0x7fe98c054480 0x7fe98c0568a0 crc :-1 s=READY pgs=6 cs=0 l=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:33.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.819+0000 7fe9a5ffb700 1 -- 172.21.15.103:0/4162236896 <== osd.2 v2:172.21.15.103:6816/33153 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7fe98c056e60 con 0x7fe98c054480 2020-04-22T14:02:33.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.836+0000 7fe9af1f3700 1 -- 172.21.15.103:0/4162236896 --> [v2:172.21.15.103:6816/33153,v1:172.21.15.103:6817/33153] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe9a8154af0 con 0x7fe98c054480 2020-04-22T14:02:33.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.837+0000 7fe9a5ffb700 1 -- 172.21.15.103:0/4162236896 <== osd.2 v2:172.21.15.103:6816/33153 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe9a8154af0 con 0x7fe98c054480 2020-04-22T14:02:33.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.837+0000 7fe9af1f3700 1 -- 172.21.15.103:0/4162236896 >> [v2:172.21.15.103:6816/33153,v1:172.21.15.103:6817/33153] conn(0x7fe98c054480 msgr2=0x7fe98c0568a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:33.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.837+0000 7fe9af1f3700 1 --2- 172.21.15.103:0/4162236896 >> [v2:172.21.15.103:6816/33153,v1:172.21.15.103:6817/33153] conn(0x7fe98c054480 0x7fe98c0568a0 crc :-1 s=READY pgs=6 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:33.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.837+0000 7fe9af1f3700 1 -- 172.21.15.103:0/4162236896 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe98c04d8a0 msgr2=0x7fe98c04fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:33.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.837+0000 7fe9af1f3700 1 --2- 172.21.15.103:0/4162236896 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe98c04d8a0 0x7fe98c04fd60 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7fe9a8148140 tx=0x7fe9a805f760).stop 2020-04-22T14:02:33.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.837+0000 7fe9af1f3700 1 -- 172.21.15.103:0/4162236896 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9a805b0b0 msgr2=0x7fe9a8148d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:33.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.837+0000 7fe9af1f3700 1 --2- 172.21.15.103:0/4162236896 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9a805b0b0 0x7fe9a8148d60 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7fe998000b80 tx=0x7fe998010960).stop 2020-04-22T14:02:33.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.837+0000 7fe9ad790700 1 -- 172.21.15.103:0/4162236896 reap_dead start 2020-04-22T14:02:33.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.837+0000 7fe9af1f3700 1 -- 172.21.15.103:0/4162236896 shutdown_connections 2020-04-22T14:02:33.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.837+0000 7fe9af1f3700 1 -- 172.21.15.103:0/4162236896 >> 172.21.15.103:0/4162236896 conn(0x7fe9a80bcae0 msgr2=0x7fe9a80b66b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:33.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.837+0000 7fe9af1f3700 1 -- 172.21.15.103:0/4162236896 shutdown_connections 2020-04-22T14:02:33.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:33.837+0000 7fe9af1f3700 1 -- 172.21.15.103:0/4162236896 wait complete. 2020-04-22T14:02:33.850 INFO:teuthology.orchestra.run.smithi103.stdout:60129542149 2020-04-22T14:02:33.850 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:33.864 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.3 flush_pg_stats 2020-04-22T14:02:34.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.007+0000 7fec0175c700 1 Processor -- start 2020-04-22T14:02:34.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.008+0000 7fec0175c700 1 -- start start 2020-04-22T14:02:34.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.008+0000 7fec0175c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7febfc146210 0x7febfc1465f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:34.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.008+0000 7fec0175c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7febfc142400 0x7febfc0ac740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:34.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.008+0000 7fec0175c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febfc0b3a60 con 0x7febfc0af280 2020-04-22T14:02:34.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.008+0000 7fec0175c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febfc0b4ea0 con 0x7febfc146210 2020-04-22T14:02:34.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.008+0000 7fec0175c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febfc0adad0 con 0x7febfc142400 2020-04-22T14:02:34.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.009+0000 7febfa7fc700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7febfc0af280 0x7febfc141cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39394/0 (socket says 172.21.15.103:39394) 2020-04-22T14:02:34.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.009+0000 7febfa7fc700 1 -- 172.21.15.103:0/3503417691 learned_addr learned my addr 172.21.15.103:0/3503417691 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:34.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.009+0000 7febfb7fe700 1 --2- 172.21.15.103:0/3503417691 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7febfc142400 0x7febfc0ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:34.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.009+0000 7febfaffd700 1 --2- 172.21.15.103:0/3503417691 >> v2:172.21.15.86:3300/0 conn(0x7febfc146210 0x7febfc1465f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:34.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.009+0000 7febf9ffb700 1 -- 172.21.15.103:0/3503417691 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497207029 0 0) 0x7febfc0b3a60 con 0x7febfc0af280 2020-04-22T14:02:34.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.009+0000 7febf9ffb700 1 -- 172.21.15.103:0/3503417691 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febe0003230 con 0x7febfc0af280 2020-04-22T14:02:34.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.009+0000 7febf9ffb700 1 -- 172.21.15.103:0/3503417691 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 615579662 0 0) 0x7febe0003230 con 0x7febfc0af280 2020-04-22T14:02:34.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.009+0000 7febfb7fe700 1 -- 172.21.15.103:0/3503417691 >> v2:172.21.15.86:3300/0 conn(0x7febfc146210 msgr2=0x7febfc1465f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:34.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.009+0000 7febfb7fe700 1 --2- 172.21.15.103:0/3503417691 >> v2:172.21.15.86:3300/0 conn(0x7febfc146210 0x7febfc1465f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:34.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.009+0000 7febfb7fe700 1 -- 172.21.15.103:0/3503417691 >> v1:172.21.15.103:6789/0 conn(0x7febfc0af280 legacy=0x7febfc141cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:34.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.009+0000 7febfb7fe700 1 -- 172.21.15.103:0/3503417691 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febfc0add70 con 0x7febfc142400 2020-04-22T14:02:34.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.009+0000 7febfaffd700 1 --2- 172.21.15.103:0/3503417691 >> v2:172.21.15.86:3300/0 conn(0x7febfc146210 0x7febfc1465f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:02:34.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.009+0000 7febfb7fe700 1 --2- 172.21.15.103:0/3503417691 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7febfc142400 0x7febfc0ac740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7febec001870 tx=0x7febf4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.009+0000 7febfb7fe700 1 --2- 172.21.15.103:0/3503417691 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7febfc142400 0x7febfc0ac740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7febec001870 tx=0x7febf4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.009+0000 7febfb7fe700 1 --2- 172.21.15.103:0/3503417691 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7febfc142400 0x7febfc0ac740 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7febec001870 tx=0x7febf4007dc0).ready entity=mon.2 client_cookie=74a2c6cf82cb665d server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:34.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.009+0000 7febfb7fe700 1 --2- 172.21.15.103:0/3503417691 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7febfc142400 0x7febfc0ac740 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7febec001870 tx=0x7febf4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.009+0000 7febf9ffb700 1 -- 172.21.15.103:0/3503417691 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febec0016d0 con 0x7febfc142400 2020-04-22T14:02:34.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.009+0000 7febfb7fe700 1 --2- 172.21.15.103:0/3503417691 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7febfc142400 0x7febfc0ac740 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7febec001870 tx=0x7febf4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.009+0000 7febf9ffb700 1 -- 172.21.15.103:0/3503417691 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf4010a10 con 0x7febfc142400 2020-04-22T14:02:34.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.009+0000 7febfb7fe700 1 --2- 172.21.15.103:0/3503417691 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7febfc142400 0x7febfc0ac740 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7febec001870 tx=0x7febf4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.009+0000 7febf9ffb700 1 -- 172.21.15.103:0/3503417691 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febf4010db0 con 0x7febfc142400 2020-04-22T14:02:34.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.009+0000 7fec0175c700 1 -- 172.21.15.103:0/3503417691 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7febfc142400 msgr2=0x7febfc0ac740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:34.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.009+0000 7fec0175c700 1 --2- 172.21.15.103:0/3503417691 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7febfc142400 0x7febfc0ac740 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7febec001870 tx=0x7febf4007dc0).stop 2020-04-22T14:02:34.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.010+0000 7fec0175c700 1 -- 172.21.15.103:0/3503417691 shutdown_connections 2020-04-22T14:02:34.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.010+0000 7fec0175c700 1 --2- 172.21.15.103:0/3503417691 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7febfc142400 0x7febfc0ac740 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:34.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.010+0000 7fec0175c700 1 --2- 172.21.15.103:0/3503417691 >> v2:172.21.15.86:3300/0 conn(0x7febfc146210 0x7febfc1465f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:34.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.010+0000 7fec0175c700 1 -- 172.21.15.103:0/3503417691 >> 172.21.15.103:0/3503417691 conn(0x7febfc0b86b0 msgr2=0x7febfc0b8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:34.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.010+0000 7fec0175c700 1 -- 172.21.15.103:0/3503417691 shutdown_connections 2020-04-22T14:02:34.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.010+0000 7fec0175c700 1 -- 172.21.15.103:0/3503417691 wait complete. 2020-04-22T14:02:34.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.011+0000 7fec0175c700 1 Processor -- start 2020-04-22T14:02:34.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.011+0000 7fec0175c700 1 -- start start 2020-04-22T14:02:34.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.012+0000 7fec0175c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7febfc0af280 0x7febfc111700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:34.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.012+0000 7fec0175c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7febfc146210 0x7febfc143330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:34.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.012+0000 7fec0175c700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febfc140610 con 0x7febfc142400 2020-04-22T14:02:34.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.012+0000 7fec0175c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febfc1408b0 con 0x7febfc0af280 2020-04-22T14:02:34.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.012+0000 7fec0175c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febfc13df70 con 0x7febfc146210 2020-04-22T14:02:34.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.012+0000 7febfaffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7febfc0af280 0x7febfc111700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:34.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.012+0000 7febfb7fe700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7febfc146210 0x7febfc143330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:34.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.012+0000 7febfaffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7febfc0af280 0x7febfc111700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:44440/0 (socket says 172.21.15.103:44440) 2020-04-22T14:02:34.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.012+0000 7febfaffd700 1 -- 172.21.15.103:0/1938312530 learned_addr learned my addr 172.21.15.103:0/1938312530 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:34.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.012+0000 7febfa7fc700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7febfc142400 0x7febfc140d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:56556/0 (socket says 172.21.15.103:56556) 2020-04-22T14:02:34.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.012+0000 7febfb7fe700 1 -- 172.21.15.103:0/1938312530 >> v2:172.21.15.86:3300/0 conn(0x7febfc0af280 msgr2=0x7febfc111700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:34.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.012+0000 7febfb7fe700 1 --2- 172.21.15.103:0/1938312530 >> v2:172.21.15.86:3300/0 conn(0x7febfc0af280 0x7febfc111700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:34.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.012+0000 7febfb7fe700 1 -- 172.21.15.103:0/1938312530 >> v1:172.21.15.86:6789/0 conn(0x7febfc142400 legacy=0x7febfc140d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:34.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.012+0000 7febfb7fe700 1 -- 172.21.15.103:0/1938312530 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febfc143790 con 0x7febfc146210 2020-04-22T14:02:34.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.012+0000 7febfb7fe700 1 --2- 172.21.15.103:0/1938312530 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7febfc146210 0x7febfc143330 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7febec001870 tx=0x7febf4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.012+0000 7febfb7fe700 1 --2- 172.21.15.103:0/1938312530 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7febfc146210 0x7febfc143330 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7febec001870 tx=0x7febf4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.012+0000 7febfb7fe700 1 --2- 172.21.15.103:0/1938312530 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7febfc146210 0x7febfc143330 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7febec001870 tx=0x7febf4007dc0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:34.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.013+0000 7febfb7fe700 1 --2- 172.21.15.103:0/1938312530 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7febfc146210 0x7febfc143330 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7febec001870 tx=0x7febf4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.013+0000 7febebfff700 1 -- 172.21.15.103:0/1938312530 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febf4005a40 con 0x7febfc146210 2020-04-22T14:02:34.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.013+0000 7febfb7fe700 1 --2- 172.21.15.103:0/1938312530 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7febfc146210 0x7febfc143330 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7febec001870 tx=0x7febf4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.013+0000 7febebfff700 1 -- 172.21.15.103:0/1938312530 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf4005ba0 con 0x7febfc146210 2020-04-22T14:02:34.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.013+0000 7febfb7fe700 1 --2- 172.21.15.103:0/1938312530 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7febfc146210 0x7febfc143330 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7febec001870 tx=0x7febf4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.013+0000 7febebfff700 1 -- 172.21.15.103:0/1938312530 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febf4007180 con 0x7febfc146210 2020-04-22T14:02:34.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.013+0000 7fec0175c700 1 -- 172.21.15.103:0/1938312530 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febfc065ac0 con 0x7febfc146210 2020-04-22T14:02:34.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.013+0000 7fec0175c700 1 -- 172.21.15.103:0/1938312530 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febfc066010 con 0x7febfc146210 2020-04-22T14:02:34.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.013+0000 7febfb7fe700 1 --2- 172.21.15.103:0/1938312530 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7febfc146210 0x7febfc143330 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7febec001870 tx=0x7febf4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.013+0000 7fec0175c700 1 -- 172.21.15.103:0/1938312530 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7febfc143920 con 0x7febfc146210 2020-04-22T14:02:34.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.014+0000 7febebfff700 1 -- 172.21.15.103:0/1938312530 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7febf4007380 con 0x7febfc146210 2020-04-22T14:02:34.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.014+0000 7febfb7fe700 1 --2- 172.21.15.103:0/1938312530 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7febfc146210 0x7febfc143330 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7febec001870 tx=0x7febf4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.014+0000 7febfb7fe700 1 --2- 172.21.15.103:0/1938312530 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7febfc146210 0x7febfc143330 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7febec001870 tx=0x7febf4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.014+0000 7febebfff700 1 --2- 172.21.15.103:0/1938312530 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7febd804d8a0 0x7febd804fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:34.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.014+0000 7febebfff700 1 -- 172.21.15.103:0/1938312530 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7febf4061390 con 0x7febfc146210 2020-04-22T14:02:34.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.014+0000 7febebfff700 1 --2- 172.21.15.103:0/1938312530 >> [v2:172.21.15.103:6824/33183,v1:172.21.15.103:6825/33183] conn(0x7febd8054480 0x7febd80568a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:34.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.014+0000 7febebfff700 1 -- 172.21.15.103:0/1938312530 --> [v2:172.21.15.103:6824/33183,v1:172.21.15.103:6825/33183] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7febd8056e60 con 0x7febd8054480 2020-04-22T14:02:34.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.014+0000 7febfaffd700 1 --2- 172.21.15.103:0/1938312530 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7febd804d8a0 0x7febd804fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:34.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.014+0000 7febebfff700 1 -- 172.21.15.103:0/1938312530 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7febf4062810 con 0x7febfc146210 2020-04-22T14:02:34.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.014+0000 7febfa7fc700 1 --2- 172.21.15.103:0/1938312530 >> [v2:172.21.15.103:6824/33183,v1:172.21.15.103:6825/33183] conn(0x7febd8054480 0x7febd80568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:34.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.014+0000 7febfaffd700 1 --2- 172.21.15.103:0/1938312530 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7febd804d8a0 0x7febd804fd60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7febf0002ef0 tx=0x7febf000dd10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.014+0000 7febfaffd700 1 --2- 172.21.15.103:0/1938312530 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7febd804d8a0 0x7febd804fd60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7febf0002ef0 tx=0x7febf000dd10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.014+0000 7febfaffd700 1 --2- 172.21.15.103:0/1938312530 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7febd804d8a0 0x7febd804fd60 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7febf0002ef0 tx=0x7febf000dd10).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:34.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.015+0000 7febfa7fc700 1 --2- 172.21.15.103:0/1938312530 >> [v2:172.21.15.103:6824/33183,v1:172.21.15.103:6825/33183] conn(0x7febd8054480 0x7febd80568a0 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:34.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.015+0000 7febebfff700 1 -- 172.21.15.103:0/1938312530 <== osd.3 v2:172.21.15.103:6824/33183 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7febd8056e60 con 0x7febd8054480 2020-04-22T14:02:34.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.033+0000 7fec0175c700 1 -- 172.21.15.103:0/1938312530 --> [v2:172.21.15.103:6824/33183,v1:172.21.15.103:6825/33183] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7febfc056c90 con 0x7febd8054480 2020-04-22T14:02:34.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.033+0000 7febebfff700 1 -- 172.21.15.103:0/1938312530 <== osd.3 v2:172.21.15.103:6824/33183 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7febfc056c90 con 0x7febd8054480 2020-04-22T14:02:34.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.033+0000 7fec0175c700 1 -- 172.21.15.103:0/1938312530 >> [v2:172.21.15.103:6824/33183,v1:172.21.15.103:6825/33183] conn(0x7febd8054480 msgr2=0x7febd80568a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:34.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.033+0000 7fec0175c700 1 --2- 172.21.15.103:0/1938312530 >> [v2:172.21.15.103:6824/33183,v1:172.21.15.103:6825/33183] conn(0x7febd8054480 0x7febd80568a0 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:34.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.033+0000 7fec0175c700 1 -- 172.21.15.103:0/1938312530 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7febd804d8a0 msgr2=0x7febd804fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:34.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.033+0000 7fec0175c700 1 --2- 172.21.15.103:0/1938312530 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7febd804d8a0 0x7febd804fd60 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7febf0002ef0 tx=0x7febf000dd10).stop 2020-04-22T14:02:34.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.033+0000 7fec0175c700 1 -- 172.21.15.103:0/1938312530 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7febfc146210 msgr2=0x7febfc143330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:34.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.034+0000 7fec0175c700 1 --2- 172.21.15.103:0/1938312530 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7febfc146210 0x7febfc143330 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7febec001870 tx=0x7febf4007dc0).stop 2020-04-22T14:02:34.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.034+0000 7febfb7fe700 1 -- 172.21.15.103:0/1938312530 reap_dead start 2020-04-22T14:02:34.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.034+0000 7fec0175c700 1 -- 172.21.15.103:0/1938312530 shutdown_connections 2020-04-22T14:02:34.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.034+0000 7fec0175c700 1 -- 172.21.15.103:0/1938312530 >> 172.21.15.103:0/1938312530 conn(0x7febfc0b86b0 msgr2=0x7febfc0b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:34.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.034+0000 7fec0175c700 1 -- 172.21.15.103:0/1938312530 shutdown_connections 2020-04-22T14:02:34.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.034+0000 7fec0175c700 1 -- 172.21.15.103:0/1938312530 wait complete. 2020-04-22T14:02:34.046 INFO:teuthology.orchestra.run.smithi103.stdout:60129542150 2020-04-22T14:02:34.046 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:34.060 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.4 flush_pg_stats 2020-04-22T14:02:34.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.205+0000 7f2cc0141700 1 Processor -- start 2020-04-22T14:02:34.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.205+0000 7f2cc0141700 1 -- start start 2020-04-22T14:02:34.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.206+0000 7f2cc0141700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2cb80b4320 0x7f2cb80b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:34.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.206+0000 7f2cc0141700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2cb80b4700 0x7f2cb80b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:34.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.206+0000 7f2cc0141700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb80b0e90 con 0x7f2cb80b2530 2020-04-22T14:02:34.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.206+0000 7f2cc0141700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb80b2a90 con 0x7f2cb80b4320 2020-04-22T14:02:34.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.206+0000 7f2cc0141700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb80b1130 con 0x7f2cb80b4700 2020-04-22T14:02:34.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.206+0000 7f2cbe6de700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f2cb80b2530 0x7f2cb80afa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39412/0 (socket says 172.21.15.103:39412) 2020-04-22T14:02:34.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.206+0000 7f2cbe6de700 1 -- 172.21.15.103:0/1163272473 learned_addr learned my addr 172.21.15.103:0/1163272473 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:34.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.206+0000 7f2cbdedd700 1 --2- 172.21.15.103:0/1163272473 >> v2:172.21.15.86:3300/0 conn(0x7f2cb80b4320 0x7f2cb80b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:34.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.206+0000 7f2cbd6dc700 1 --2- 172.21.15.103:0/1163272473 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2cb80b4700 0x7f2cb80b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:34.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.206+0000 7f2cbcedb700 1 -- 172.21.15.103:0/1163272473 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2374154885 0 0) 0x7f2cb80b0e90 con 0x7f2cb80b2530 2020-04-22T14:02:34.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.206+0000 7f2cbcedb700 1 -- 172.21.15.103:0/1163272473 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ca0003230 con 0x7f2cb80b2530 2020-04-22T14:02:34.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.206+0000 7f2cbcedb700 1 -- 172.21.15.103:0/1163272473 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 170474377 0 0) 0x7f2ca0003230 con 0x7f2cb80b2530 2020-04-22T14:02:34.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.206+0000 7f2cbcedb700 1 -- 172.21.15.103:0/1163272473 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2cb80b4700 msgr2=0x7f2cb80b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:34.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.206+0000 7f2cbcedb700 1 --2- 172.21.15.103:0/1163272473 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2cb80b4700 0x7f2cb80b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:34.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.206+0000 7f2cbcedb700 1 -- 172.21.15.103:0/1163272473 >> v2:172.21.15.86:3300/0 conn(0x7f2cb80b4320 msgr2=0x7f2cb80b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:34.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.206+0000 7f2cbcedb700 1 --2- 172.21.15.103:0/1163272473 >> v2:172.21.15.86:3300/0 conn(0x7f2cb80b4320 0x7f2cb80b15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:34.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.206+0000 7f2cbcedb700 1 -- 172.21.15.103:0/1163272473 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb80ae500 con 0x7f2cb80b2530 2020-04-22T14:02:34.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.206+0000 7f2cbcedb700 1 -- 172.21.15.103:0/1163272473 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f2cb0001a50 con 0x7f2cb80b2530 2020-04-22T14:02:34.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.206+0000 7f2cbcedb700 1 -- 172.21.15.103:0/1163272473 >> v1:172.21.15.103:6789/0 conn(0x7f2cb80b2530 legacy=0x7f2cb80afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:34.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.206+0000 7f2cbcedb700 1 --2- 172.21.15.103:0/1163272473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ca0003720 0x7f2ca0003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:34.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.206+0000 7f2cbcedb700 1 --2- 172.21.15.103:0/1163272473 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ca0004060 0x7f2ca0004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:34.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.206+0000 7f2cbcedb700 1 --2- 172.21.15.103:0/1163272473 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2ca0004aa0 0x7f2ca0004f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:34.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.206+0000 7f2cbcedb700 1 -- 172.21.15.103:0/1163272473 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb80b2a90 con 0x7f2ca0004060 2020-04-22T14:02:34.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.206+0000 7f2cbcedb700 1 -- 172.21.15.103:0/1163272473 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb80b1130 con 0x7f2ca0003720 2020-04-22T14:02:34.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.206+0000 7f2cbcedb700 1 -- 172.21.15.103:0/1163272473 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca000b860 con 0x7f2ca0004aa0 2020-04-22T14:02:34.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.206+0000 7f2cbd6dc700 1 --2- 172.21.15.103:0/1163272473 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2cb80b4700 0x7f2cb80b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:02:34.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.206+0000 7f2cbdedd700 1 --2- 172.21.15.103:0/1163272473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ca0003720 0x7f2ca0003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:34.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.207+0000 7f2cbe6de700 1 --2- 172.21.15.103:0/1163272473 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2ca0004aa0 0x7f2ca0004f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:34.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.207+0000 7f2cbd6dc700 1 --2- 172.21.15.103:0/1163272473 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ca0004060 0x7f2ca0004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:34.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.207+0000 7f2cbdedd700 1 -- 172.21.15.103:0/1163272473 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2ca0004aa0 msgr2=0x7f2ca0004f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:34.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.207+0000 7f2cbdedd700 1 --2- 172.21.15.103:0/1163272473 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2ca0004aa0 0x7f2ca0004f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:34.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.207+0000 7f2cbdedd700 1 -- 172.21.15.103:0/1163272473 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ca0004060 msgr2=0x7f2ca0004530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:34.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.207+0000 7f2cbdedd700 1 --2- 172.21.15.103:0/1163272473 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ca0004060 0x7f2ca0004530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:34.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.207+0000 7f2cbdedd700 1 -- 172.21.15.103:0/1163272473 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca0003230 con 0x7f2ca0003720 2020-04-22T14:02:34.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.207+0000 7f2cbe6de700 1 --2- 172.21.15.103:0/1163272473 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2ca0004aa0 0x7f2ca0004f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:02:34.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.207+0000 7f2cbdedd700 1 --2- 172.21.15.103:0/1163272473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ca0003720 0x7f2ca0003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2ca8002f30 tx=0x7f2ca80100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.207+0000 7f2cbdedd700 1 --2- 172.21.15.103:0/1163272473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ca0003720 0x7f2ca0003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2ca8002f30 tx=0x7f2ca80100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.207+0000 7f2cbdedd700 1 --2- 172.21.15.103:0/1163272473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ca0003720 0x7f2ca0003b40 secure :-1 s=READY pgs=130 cs=0 l=1 rx=0x7f2ca8002f30 tx=0x7f2ca80100d0).ready entity=mon.1 client_cookie=67bcf181ac34c696 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:34.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.207+0000 7f2cbdedd700 1 --2- 172.21.15.103:0/1163272473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ca0003720 0x7f2ca0003b40 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f2ca8002f30 tx=0x7f2ca80100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.207+0000 7f2cbcedb700 1 -- 172.21.15.103:0/1163272473 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ca8010e80 con 0x7f2ca0003720 2020-04-22T14:02:34.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.207+0000 7f2cbdedd700 1 --2- 172.21.15.103:0/1163272473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ca0003720 0x7f2ca0003b40 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f2ca8002f30 tx=0x7f2ca80100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.207+0000 7f2cbdedd700 1 --2- 172.21.15.103:0/1163272473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ca0003720 0x7f2ca0003b40 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f2ca8002f30 tx=0x7f2ca80100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.207+0000 7f2cbcedb700 1 -- 172.21.15.103:0/1163272473 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca8008970 con 0x7f2ca0003720 2020-04-22T14:02:34.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.207+0000 7f2cbcedb700 1 -- 172.21.15.103:0/1163272473 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ca8008d50 con 0x7f2ca0003720 2020-04-22T14:02:34.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.207+0000 7f2cc0141700 1 -- 172.21.15.103:0/1163272473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ca0003720 msgr2=0x7f2ca0003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:34.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.207+0000 7f2cc0141700 1 --2- 172.21.15.103:0/1163272473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ca0003720 0x7f2ca0003b40 secure :-1 s=READY pgs=130 cs=0 l=1 rx=0x7f2ca8002f30 tx=0x7f2ca80100d0).stop 2020-04-22T14:02:34.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.207+0000 7f2cbe6de700 1 -- 172.21.15.103:0/1163272473 reap_dead start 2020-04-22T14:02:34.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.207+0000 7f2cc0141700 1 -- 172.21.15.103:0/1163272473 shutdown_connections 2020-04-22T14:02:34.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.207+0000 7f2cc0141700 1 -- 172.21.15.103:0/1163272473 >> 172.21.15.103:0/1163272473 conn(0x7f2cb80b86b0 msgr2=0x7f2cb80b8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:34.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.208+0000 7f2cc0141700 1 -- 172.21.15.103:0/1163272473 shutdown_connections 2020-04-22T14:02:34.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.208+0000 7f2cc0141700 1 -- 172.21.15.103:0/1163272473 wait complete. 2020-04-22T14:02:34.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.208+0000 7f2cc0141700 1 Processor -- start 2020-04-22T14:02:34.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.208+0000 7f2cc0141700 1 -- start start 2020-04-22T14:02:34.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.209+0000 7f2cc0141700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2cb8065520 0x7f2cb8152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:34.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.209+0000 7f2cc0141700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb8151770 con 0x7f2cb814eaa0 2020-04-22T14:02:34.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.209+0000 7f2cc0141700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb8151a10 con 0x7f2cb80afdb0 2020-04-22T14:02:34.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.209+0000 7f2cc0141700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb81525b0 con 0x7f2cb8065520 2020-04-22T14:02:34.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.209+0000 7f2cbe6de700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f2cb80afdb0 0x7f2cb80638c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39424/0 (socket says 172.21.15.103:39424) 2020-04-22T14:02:34.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.209+0000 7f2cbe6de700 1 -- 172.21.15.103:0/441790801 learned_addr learned my addr 172.21.15.103:0/441790801 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:34.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.209+0000 7f2cbd6dc700 1 --2- 172.21.15.103:0/441790801 >> v2:172.21.15.86:3300/0 conn(0x7f2cb8065520 0x7f2cb8152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:34.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.209+0000 7f2ca6ffd700 1 -- 172.21.15.103:0/441790801 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3271439890 0 0) 0x7f2cb8151a10 con 0x7f2cb80afdb0 2020-04-22T14:02:34.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.209+0000 7f2ca6ffd700 1 -- 172.21.15.103:0/441790801 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c98002fe0 con 0x7f2cb80afdb0 2020-04-22T14:02:34.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.209+0000 7f2ca6ffd700 1 -- 172.21.15.103:0/441790801 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2526481158 0 0) 0x7f2cb8151770 con 0x7f2cb814eaa0 2020-04-22T14:02:34.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.210+0000 7f2ca6ffd700 1 -- 172.21.15.103:0/441790801 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cb8151a10 con 0x7f2cb814eaa0 2020-04-22T14:02:34.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.210+0000 7f2ca6ffd700 1 -- 172.21.15.103:0/441790801 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 734863985 0 0) 0x7f2c98002fe0 con 0x7f2cb80afdb0 2020-04-22T14:02:34.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.210+0000 7f2ca6ffd700 1 -- 172.21.15.103:0/441790801 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2cb8151770 con 0x7f2cb80afdb0 2020-04-22T14:02:34.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.210+0000 7f2ca6ffd700 1 -- 172.21.15.103:0/441790801 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f2cb0004b20 con 0x7f2cb80afdb0 2020-04-22T14:02:34.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.210+0000 7f2cbd6dc700 1 -- 172.21.15.103:0/441790801 >> v1:172.21.15.103:6789/0 conn(0x7f2cb80afdb0 legacy=0x7f2cb80638c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:34.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.210+0000 7f2cbd6dc700 1 -- 172.21.15.103:0/441790801 >> v1:172.21.15.86:6789/0 conn(0x7f2cb814eaa0 legacy=0x7f2cb8155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:34.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.210+0000 7f2cbd6dc700 1 -- 172.21.15.103:0/441790801 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb8151cb0 con 0x7f2cb8065520 2020-04-22T14:02:34.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.210+0000 7f2cbd6dc700 1 --2- 172.21.15.103:0/441790801 >> v2:172.21.15.86:3300/0 conn(0x7f2cb8065520 0x7f2cb8152150 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2cb4002f30 tx=0x7f2cb4010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.210+0000 7f2cbd6dc700 1 --2- 172.21.15.103:0/441790801 >> v2:172.21.15.86:3300/0 conn(0x7f2cb8065520 0x7f2cb8152150 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2cb4002f30 tx=0x7f2cb4010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.210+0000 7f2cbd6dc700 1 --2- 172.21.15.103:0/441790801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2cb8065520 0x7f2cb8152150 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7f2cb4002f30 tx=0x7f2cb4010a30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:34.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.210+0000 7f2cbd6dc700 1 --2- 172.21.15.103:0/441790801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2cb8065520 0x7f2cb8152150 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f2cb4002f30 tx=0x7f2cb4010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.210+0000 7f2ca6ffd700 1 -- 172.21.15.103:0/441790801 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cb4007560 con 0x7f2cb8065520 2020-04-22T14:02:34.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.210+0000 7f2cbd6dc700 1 --2- 172.21.15.103:0/441790801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2cb8065520 0x7f2cb8152150 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f2cb4002f30 tx=0x7f2cb4010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.263 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.210+0000 7f2cbd6dc700 1 --2- 172.21.15.103:0/441790801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2cb8065520 0x7f2cb8152150 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f2cb4002f30 tx=0x7f2cb4010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.263 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.210+0000 7f2ca6ffd700 1 -- 172.21.15.103:0/441790801 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb40058a0 con 0x7f2cb8065520 2020-04-22T14:02:34.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.210+0000 7f2ca6ffd700 1 -- 172.21.15.103:0/441790801 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cb4005c00 con 0x7f2cb8065520 2020-04-22T14:02:34.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.210+0000 7f2cc0141700 1 -- 172.21.15.103:0/441790801 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb814ee80 con 0x7f2cb8065520 2020-04-22T14:02:34.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.210+0000 7f2cc0141700 1 -- 172.21.15.103:0/441790801 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb80b04a0 con 0x7f2cb8065520 2020-04-22T14:02:34.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.211+0000 7f2cbd6dc700 1 --2- 172.21.15.103:0/441790801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2cb8065520 0x7f2cb8152150 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f2cb4002f30 tx=0x7f2cb4010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.211+0000 7f2cc0141700 1 -- 172.21.15.103:0/441790801 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2cb8151eb0 con 0x7f2cb8065520 2020-04-22T14:02:34.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.211+0000 7f2ca6ffd700 1 -- 172.21.15.103:0/441790801 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f2cb4005d60 con 0x7f2cb8065520 2020-04-22T14:02:34.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.211+0000 7f2cbd6dc700 1 --2- 172.21.15.103:0/441790801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2cb8065520 0x7f2cb8152150 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f2cb4002f30 tx=0x7f2cb4010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.212+0000 7f2cbd6dc700 1 --2- 172.21.15.103:0/441790801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2cb8065520 0x7f2cb8152150 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f2cb4002f30 tx=0x7f2cb4010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.212+0000 7f2ca6ffd700 1 --2- 172.21.15.103:0/441790801 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2c9804e050 0x7f2c98050510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:34.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.212+0000 7f2ca6ffd700 1 -- 172.21.15.103:0/441790801 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2cb4060e50 con 0x7f2cb8065520 2020-04-22T14:02:34.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.212+0000 7f2ca6ffd700 1 --2- 172.21.15.103:0/441790801 >> [v2:172.21.15.86:6802/33506,v1:172.21.15.86:6803/33506] conn(0x7f2c98054bc0 0x7f2c98056fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:34.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.212+0000 7f2ca6ffd700 1 -- 172.21.15.103:0/441790801 --> [v2:172.21.15.86:6802/33506,v1:172.21.15.86:6803/33506] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2c980575a0 con 0x7f2c98054bc0 2020-04-22T14:02:34.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.212+0000 7f2ca6ffd700 1 -- 172.21.15.103:0/441790801 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2cb40611c0 con 0x7f2cb8065520 2020-04-22T14:02:34.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.212+0000 7f2cbdedd700 1 --2- 172.21.15.103:0/441790801 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2c9804e050 0x7f2c98050510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:34.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.212+0000 7f2cbdedd700 1 --2- 172.21.15.103:0/441790801 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2c9804e050 0x7f2c98050510 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2ca8007ed0 tx=0x7f2ca80100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.212+0000 7f2cbe6de700 1 --2- 172.21.15.103:0/441790801 >> [v2:172.21.15.86:6802/33506,v1:172.21.15.86:6803/33506] conn(0x7f2c98054bc0 0x7f2c98056fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:34.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.212+0000 7f2cbdedd700 1 --2- 172.21.15.103:0/441790801 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2c9804e050 0x7f2c98050510 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2ca8007ed0 tx=0x7f2ca80100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.212+0000 7f2cbdedd700 1 --2- 172.21.15.103:0/441790801 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2c9804e050 0x7f2c98050510 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7f2ca8007ed0 tx=0x7f2ca80100d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:34.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.212+0000 7f2cbe6de700 1 --2- 172.21.15.103:0/441790801 >> [v2:172.21.15.86:6802/33506,v1:172.21.15.86:6803/33506] conn(0x7f2c98054bc0 0x7f2c98056fe0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:34.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.213+0000 7f2ca6ffd700 1 -- 172.21.15.103:0/441790801 <== osd.4 v2:172.21.15.86:6802/33506 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f2c980575a0 con 0x7f2c98054bc0 2020-04-22T14:02:34.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.231+0000 7f2cc0141700 1 -- 172.21.15.103:0/441790801 --> [v2:172.21.15.86:6802/33506,v1:172.21.15.86:6803/33506] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2cb8064590 con 0x7f2c98054bc0 2020-04-22T14:02:34.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.231+0000 7f2ca6ffd700 1 -- 172.21.15.103:0/441790801 <== osd.4 v2:172.21.15.86:6802/33506 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2cb8064590 con 0x7f2c98054bc0 2020-04-22T14:02:34.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.232+0000 7f2cc0141700 1 -- 172.21.15.103:0/441790801 >> [v2:172.21.15.86:6802/33506,v1:172.21.15.86:6803/33506] conn(0x7f2c98054bc0 msgr2=0x7f2c98056fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:34.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.232+0000 7f2cc0141700 1 --2- 172.21.15.103:0/441790801 >> [v2:172.21.15.86:6802/33506,v1:172.21.15.86:6803/33506] conn(0x7f2c98054bc0 0x7f2c98056fe0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:34.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.232+0000 7f2cc0141700 1 -- 172.21.15.103:0/441790801 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2c9804e050 msgr2=0x7f2c98050510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:34.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.232+0000 7f2cc0141700 1 --2- 172.21.15.103:0/441790801 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2c9804e050 0x7f2c98050510 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7f2ca8007ed0 tx=0x7f2ca80100d0).stop 2020-04-22T14:02:34.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.232+0000 7f2cc0141700 1 -- 172.21.15.103:0/441790801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2cb8065520 msgr2=0x7f2cb8152150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:34.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.232+0000 7f2cc0141700 1 --2- 172.21.15.103:0/441790801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2cb8065520 0x7f2cb8152150 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7f2cb4002f30 tx=0x7f2cb4010a30).stop 2020-04-22T14:02:34.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.232+0000 7f2cbe6de700 1 -- 172.21.15.103:0/441790801 reap_dead start 2020-04-22T14:02:34.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.232+0000 7f2cc0141700 1 -- 172.21.15.103:0/441790801 shutdown_connections 2020-04-22T14:02:34.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.232+0000 7f2cc0141700 1 --2- 172.21.15.103:0/441790801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2cb8065520 0x7f2cb8152150 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:34.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.232+0000 7f2cc0141700 1 -- 172.21.15.103:0/441790801 >> 172.21.15.103:0/441790801 conn(0x7f2cb80b86b0 msgr2=0x7f2cb813d100 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:34.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.232+0000 7f2cc0141700 1 -- 172.21.15.103:0/441790801 shutdown_connections 2020-04-22T14:02:34.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.232+0000 7f2cc0141700 1 -- 172.21.15.103:0/441790801 wait complete. 2020-04-22T14:02:34.269 INFO:teuthology.orchestra.run.smithi103.stdout:64424509444 2020-04-22T14:02:34.269 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:34.283 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.5 flush_pg_stats 2020-04-22T14:02:34.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.428+0000 7fe434968700 1 Processor -- start 2020-04-22T14:02:34.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.428+0000 7fe434968700 1 -- start start 2020-04-22T14:02:34.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.429+0000 7fe434968700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe4300b4880 0x7fe430060910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:34.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.429+0000 7fe434968700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe4300b0d80 0x7fe4300b1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:34.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.429+0000 7fe434968700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe430149a70 con 0x7fe430060d70 2020-04-22T14:02:34.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.429+0000 7fe434968700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4300b1670 con 0x7fe4300b0d80 2020-04-22T14:02:34.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.429+0000 7fe434968700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe430149cd0 con 0x7fe4300b4880 2020-04-22T14:02:34.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.429+0000 7fe42e59c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe4300b4880 0x7fe430060910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:34.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.429+0000 7fe42e59c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe4300b4880 0x7fe430060910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47240/0 (socket says 172.21.15.103:47240) 2020-04-22T14:02:34.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.429+0000 7fe42e59c700 1 -- 172.21.15.103:0/2869818047 learned_addr learned my addr 172.21.15.103:0/2869818047 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:34.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.430+0000 7fe42ed9d700 1 --2- 172.21.15.103:0/2869818047 >> v2:172.21.15.86:3300/0 conn(0x7fe4300b0d80 0x7fe4300b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:34.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.430+0000 7fe42e59c700 1 -- 172.21.15.103:0/2869818047 >> v2:172.21.15.86:3300/0 conn(0x7fe4300b0d80 msgr2=0x7fe4300b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:34.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.430+0000 7fe42e59c700 1 --2- 172.21.15.103:0/2869818047 >> v2:172.21.15.86:3300/0 conn(0x7fe4300b0d80 0x7fe4300b1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:34.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.430+0000 7fe42e59c700 1 -- 172.21.15.103:0/2869818047 >> v1:172.21.15.86:6789/0 conn(0x7fe430060d70 legacy=0x7fe43014a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:34.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.430+0000 7fe42e59c700 1 -- 172.21.15.103:0/2869818047 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4300b4c60 con 0x7fe4300b4880 2020-04-22T14:02:34.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.430+0000 7fe42ed9d700 1 --2- 172.21.15.103:0/2869818047 >> v2:172.21.15.86:3300/0 conn(0x7fe4300b0d80 0x7fe4300b1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:02:34.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.430+0000 7fe42e59c700 1 --2- 172.21.15.103:0/2869818047 >> v2:172.21.15.103:3300/0 conn(0x7fe4300b4880 0x7fe430060910 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe430060860 tx=0x7fe420007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.430+0000 7fe42e59c700 1 --2- 172.21.15.103:0/2869818047 >> v2:172.21.15.103:3300/0 conn(0x7fe4300b4880 0x7fe430060910 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe430060860 tx=0x7fe420007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.430+0000 7fe42e59c700 1 --2- 172.21.15.103:0/2869818047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4300b4880 0x7fe430060910 secure :-1 s=READY pgs=132 cs=0 l=1 rx=0x7fe430060860 tx=0x7fe420007a40).ready entity=mon.1 client_cookie=52e9e2d826b17615 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:34.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.430+0000 7fe42e59c700 1 --2- 172.21.15.103:0/2869818047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4300b4880 0x7fe430060910 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7fe430060860 tx=0x7fe420007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.430+0000 7fe42d59a700 1 -- 172.21.15.103:0/2869818047 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe420008e10 con 0x7fe4300b4880 2020-04-22T14:02:34.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.430+0000 7fe42e59c700 1 --2- 172.21.15.103:0/2869818047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4300b4880 0x7fe430060910 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7fe430060860 tx=0x7fe420007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.430+0000 7fe42e59c700 1 --2- 172.21.15.103:0/2869818047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4300b4880 0x7fe430060910 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7fe430060860 tx=0x7fe420007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.430+0000 7fe42d59a700 1 -- 172.21.15.103:0/2869818047 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe420010780 con 0x7fe4300b4880 2020-04-22T14:02:34.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.430+0000 7fe42d59a700 1 -- 172.21.15.103:0/2869818047 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe420010ba0 con 0x7fe4300b4880 2020-04-22T14:02:34.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.430+0000 7fe434968700 1 -- 172.21.15.103:0/2869818047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4300b4880 msgr2=0x7fe430060910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:34.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.430+0000 7fe434968700 1 --2- 172.21.15.103:0/2869818047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4300b4880 0x7fe430060910 secure :-1 s=READY pgs=132 cs=0 l=1 rx=0x7fe430060860 tx=0x7fe420007a40).stop 2020-04-22T14:02:34.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.431+0000 7fe434968700 1 -- 172.21.15.103:0/2869818047 shutdown_connections 2020-04-22T14:02:34.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.431+0000 7fe434968700 1 --2- 172.21.15.103:0/2869818047 >> v2:172.21.15.86:3300/0 conn(0x7fe4300b0d80 0x7fe4300b1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:34.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.431+0000 7fe434968700 1 --2- 172.21.15.103:0/2869818047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4300b4880 0x7fe430060910 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:34.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.431+0000 7fe434968700 1 -- 172.21.15.103:0/2869818047 >> 172.21.15.103:0/2869818047 conn(0x7fe4300ba8d0 msgr2=0x7fe4300bace0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:34.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.431+0000 7fe434968700 1 -- 172.21.15.103:0/2869818047 shutdown_connections 2020-04-22T14:02:34.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.431+0000 7fe434968700 1 -- 172.21.15.103:0/2869818047 wait complete. 2020-04-22T14:02:34.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.431+0000 7fe434968700 1 Processor -- start 2020-04-22T14:02:34.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.432+0000 7fe434968700 1 -- start start 2020-04-22T14:02:34.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.432+0000 7fe434968700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe430060d70 0x7fe430146ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:34.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.432+0000 7fe434968700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe4300b0d80 0x7fe4300b9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:34.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.432+0000 7fe434968700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4300663b0 con 0x7fe4300b4880 2020-04-22T14:02:34.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.432+0000 7fe434968700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4300ba060 con 0x7fe430060d70 2020-04-22T14:02:34.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.432+0000 7fe434968700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe430065e70 con 0x7fe4300b0d80 2020-04-22T14:02:34.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.432+0000 7fe42e59c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe430060d70 0x7fe430146ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:34.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.432+0000 7fe42ed9d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe4300b4880 0x7fe4301411f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39440/0 (socket says 172.21.15.103:39440) 2020-04-22T14:02:34.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.432+0000 7fe42e59c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe430060d70 0x7fe430146ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47246/0 (socket says 172.21.15.103:47246) 2020-04-22T14:02:34.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.432+0000 7fe42ed9d700 1 -- 172.21.15.103:0/3244684756 learned_addr learned my addr 172.21.15.103:0/3244684756 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:34.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.432+0000 7fe42dd9b700 1 --2- 172.21.15.103:0/3244684756 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe4300b0d80 0x7fe4300b9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:34.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.432+0000 7fe42e59c700 1 -- 172.21.15.103:0/3244684756 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe4300b0d80 msgr2=0x7fe4300b9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:34.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.432+0000 7fe42e59c700 1 --2- 172.21.15.103:0/3244684756 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe4300b0d80 0x7fe4300b9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:34.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.432+0000 7fe42e59c700 1 -- 172.21.15.103:0/3244684756 >> v1:172.21.15.103:6789/0 conn(0x7fe4300b4880 legacy=0x7fe4301411f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:34.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.432+0000 7fe4277fe700 1 -- 172.21.15.103:0/3244684756 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1182189265 0 0) 0x7fe4300663b0 con 0x7fe4300b4880 2020-04-22T14:02:34.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.432+0000 7fe42e59c700 1 -- 172.21.15.103:0/3244684756 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe430066110 con 0x7fe430060d70 2020-04-22T14:02:34.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.433+0000 7fe42dd9b700 1 --2- 172.21.15.103:0/3244684756 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe4300b0d80 0x7fe4300b9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:02:34.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.433+0000 7fe42e59c700 1 --2- 172.21.15.103:0/3244684756 >> v2:172.21.15.103:3300/0 conn(0x7fe430060d70 0x7fe430146ee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe430060860 tx=0x7fe420007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.433+0000 7fe42e59c700 1 --2- 172.21.15.103:0/3244684756 >> v2:172.21.15.103:3300/0 conn(0x7fe430060d70 0x7fe430146ee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe430060860 tx=0x7fe420007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.433+0000 7fe42e59c700 1 --2- 172.21.15.103:0/3244684756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe430060d70 0x7fe430146ee0 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7fe430060860 tx=0x7fe420007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:34.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.433+0000 7fe42e59c700 1 --2- 172.21.15.103:0/3244684756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe430060d70 0x7fe430146ee0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fe430060860 tx=0x7fe420007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.433+0000 7fe4277fe700 1 -- 172.21.15.103:0/3244684756 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe42000f740 con 0x7fe430060d70 2020-04-22T14:02:34.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.433+0000 7fe42e59c700 1 --2- 172.21.15.103:0/3244684756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe430060d70 0x7fe430146ee0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fe430060860 tx=0x7fe420007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.433+0000 7fe42e59c700 1 --2- 172.21.15.103:0/3244684756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe430060d70 0x7fe430146ee0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fe430060860 tx=0x7fe420007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.433+0000 7fe4277fe700 1 -- 172.21.15.103:0/3244684756 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42000f8a0 con 0x7fe430060d70 2020-04-22T14:02:34.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.433+0000 7fe434968700 1 -- 172.21.15.103:0/3244684756 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe430141900 con 0x7fe430060d70 2020-04-22T14:02:34.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.433+0000 7fe4277fe700 1 -- 172.21.15.103:0/3244684756 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe420007370 con 0x7fe430060d70 2020-04-22T14:02:34.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.433+0000 7fe434968700 1 -- 172.21.15.103:0/3244684756 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe430148f00 con 0x7fe430060d70 2020-04-22T14:02:34.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.433+0000 7fe42e59c700 1 --2- 172.21.15.103:0/3244684756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe430060d70 0x7fe430146ee0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fe430060860 tx=0x7fe420007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.434+0000 7fe434968700 1 -- 172.21.15.103:0/3244684756 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe430056c90 con 0x7fe430060d70 2020-04-22T14:02:34.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.434+0000 7fe4277fe700 1 -- 172.21.15.103:0/3244684756 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fe4200056c0 con 0x7fe430060d70 2020-04-22T14:02:34.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.434+0000 7fe42e59c700 1 --2- 172.21.15.103:0/3244684756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe430060d70 0x7fe430146ee0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fe430060860 tx=0x7fe420007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.434+0000 7fe42e59c700 1 --2- 172.21.15.103:0/3244684756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe430060d70 0x7fe430146ee0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fe430060860 tx=0x7fe420007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.434+0000 7fe4277fe700 1 --2- 172.21.15.103:0/3244684756 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe41404d830 0x7fe41404fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:34.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.434+0000 7fe4277fe700 1 -- 172.21.15.103:0/3244684756 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe4200612f0 con 0x7fe430060d70 2020-04-22T14:02:34.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.434+0000 7fe4277fe700 1 --2- 172.21.15.103:0/3244684756 >> [v2:172.21.15.86:6810/33554,v1:172.21.15.86:6811/33554] conn(0x7fe414054410 0x7fe414056830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:34.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.434+0000 7fe4277fe700 1 -- 172.21.15.103:0/3244684756 --> [v2:172.21.15.86:6810/33554,v1:172.21.15.86:6811/33554] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe414056df0 con 0x7fe414054410 2020-04-22T14:02:34.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.434+0000 7fe4277fe700 1 -- 172.21.15.103:0/3244684756 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe4200626f0 con 0x7fe430060d70 2020-04-22T14:02:34.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.434+0000 7fe42dd9b700 1 --2- 172.21.15.103:0/3244684756 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe41404d830 0x7fe41404fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:34.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.435+0000 7fe42ed9d700 1 --2- 172.21.15.103:0/3244684756 >> [v2:172.21.15.86:6810/33554,v1:172.21.15.86:6811/33554] conn(0x7fe414054410 0x7fe414056830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:34.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.435+0000 7fe42dd9b700 1 --2- 172.21.15.103:0/3244684756 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe41404d830 0x7fe41404fcf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe43005f6a0 tx=0x7fe418001810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.435+0000 7fe42dd9b700 1 --2- 172.21.15.103:0/3244684756 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe41404d830 0x7fe41404fcf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe43005f6a0 tx=0x7fe418001810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.435+0000 7fe42dd9b700 1 --2- 172.21.15.103:0/3244684756 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe41404d830 0x7fe41404fcf0 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7fe43005f6a0 tx=0x7fe418001810).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:34.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.435+0000 7fe42ed9d700 1 --2- 172.21.15.103:0/3244684756 >> [v2:172.21.15.86:6810/33554,v1:172.21.15.86:6811/33554] conn(0x7fe414054410 0x7fe414056830 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:34.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.436+0000 7fe4277fe700 1 -- 172.21.15.103:0/3244684756 <== osd.5 v2:172.21.15.86:6810/33554 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7fe414056df0 con 0x7fe414054410 2020-04-22T14:02:34.456 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.453+0000 7fe434968700 1 -- 172.21.15.103:0/3244684756 --> [v2:172.21.15.86:6810/33554,v1:172.21.15.86:6811/33554] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe430157e20 con 0x7fe414054410 2020-04-22T14:02:34.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.454+0000 7fe4277fe700 1 -- 172.21.15.103:0/3244684756 <== osd.5 v2:172.21.15.86:6810/33554 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe430157e20 con 0x7fe414054410 2020-04-22T14:02:34.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.455+0000 7fe434968700 1 -- 172.21.15.103:0/3244684756 >> [v2:172.21.15.86:6810/33554,v1:172.21.15.86:6811/33554] conn(0x7fe414054410 msgr2=0x7fe414056830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:34.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.455+0000 7fe434968700 1 --2- 172.21.15.103:0/3244684756 >> [v2:172.21.15.86:6810/33554,v1:172.21.15.86:6811/33554] conn(0x7fe414054410 0x7fe414056830 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:34.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.455+0000 7fe434968700 1 -- 172.21.15.103:0/3244684756 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe41404d830 msgr2=0x7fe41404fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:34.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.455+0000 7fe434968700 1 --2- 172.21.15.103:0/3244684756 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe41404d830 0x7fe41404fcf0 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7fe43005f6a0 tx=0x7fe418001810).stop 2020-04-22T14:02:34.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.455+0000 7fe434968700 1 -- 172.21.15.103:0/3244684756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe430060d70 msgr2=0x7fe430146ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:34.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.455+0000 7fe434968700 1 --2- 172.21.15.103:0/3244684756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe430060d70 0x7fe430146ee0 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7fe430060860 tx=0x7fe420007a40).stop 2020-04-22T14:02:34.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.455+0000 7fe42ed9d700 1 -- 172.21.15.103:0/3244684756 reap_dead start 2020-04-22T14:02:34.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.455+0000 7fe434968700 1 -- 172.21.15.103:0/3244684756 shutdown_connections 2020-04-22T14:02:34.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.455+0000 7fe434968700 1 --2- 172.21.15.103:0/3244684756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe430060d70 0x7fe430146ee0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:34.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.455+0000 7fe434968700 1 -- 172.21.15.103:0/3244684756 >> 172.21.15.103:0/3244684756 conn(0x7fe4300ba8d0 msgr2=0x7fe430143360 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:34.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.455+0000 7fe434968700 1 -- 172.21.15.103:0/3244684756 shutdown_connections 2020-04-22T14:02:34.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.455+0000 7fe434968700 1 -- 172.21.15.103:0/3244684756 wait complete. 2020-04-22T14:02:34.467 INFO:teuthology.orchestra.run.smithi103.stdout:64424509445 2020-04-22T14:02:34.468 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:34.481 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.6 flush_pg_stats 2020-04-22T14:02:34.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.625+0000 7f68c0b67700 1 Processor -- start 2020-04-22T14:02:34.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.625+0000 7f68c0b67700 1 -- start start 2020-04-22T14:02:34.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.626+0000 7f68c0b67700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f68bc146210 0x7f68bc1465f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:34.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.626+0000 7f68c0b67700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68bc0b3a60 con 0x7f68bc142400 2020-04-22T14:02:34.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.626+0000 7f68c0b67700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68bc0b4ea0 con 0x7f68bc0af280 2020-04-22T14:02:34.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.626+0000 7f68c0b67700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68bc0adad0 con 0x7f68bc146210 2020-04-22T14:02:34.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.626+0000 7f68b9d9b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f68bc0af280 0x7f68bc141cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39446/0 (socket says 172.21.15.103:39446) 2020-04-22T14:02:34.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.626+0000 7f68b9d9b700 1 -- 172.21.15.103:0/957072923 learned_addr learned my addr 172.21.15.103:0/957072923 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:34.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.627+0000 7f68b959a700 1 -- 172.21.15.103:0/957072923 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1090115482 0 0) 0x7f68bc0b4ea0 con 0x7f68bc0af280 2020-04-22T14:02:34.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.627+0000 7f68ba59c700 1 --2- 172.21.15.103:0/957072923 >> v2:172.21.15.86:3300/0 conn(0x7f68bc146210 0x7f68bc1465f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:34.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.627+0000 7f68b959a700 1 -- 172.21.15.103:0/957072923 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f689c003230 con 0x7f68bc0af280 2020-04-22T14:02:34.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.627+0000 7f68b959a700 1 -- 172.21.15.103:0/957072923 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2303716730 0 0) 0x7f689c003230 con 0x7f68bc0af280 2020-04-22T14:02:34.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.627+0000 7f68b959a700 1 -- 172.21.15.103:0/957072923 >> v2:172.21.15.86:3300/0 conn(0x7f68bc146210 msgr2=0x7f68bc1465f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:34.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.627+0000 7f68b959a700 1 --2- 172.21.15.103:0/957072923 >> v2:172.21.15.86:3300/0 conn(0x7f68bc146210 0x7f68bc1465f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:34.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.627+0000 7f68b959a700 1 -- 172.21.15.103:0/957072923 >> v1:172.21.15.86:6789/0 conn(0x7f68bc142400 legacy=0x7f68bc0ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:34.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.627+0000 7f68b959a700 1 -- 172.21.15.103:0/957072923 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68bc0add70 con 0x7f68bc0af280 2020-04-22T14:02:34.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.627+0000 7f68b959a700 1 -- 172.21.15.103:0/957072923 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f68a40016d0 con 0x7f68bc0af280 2020-04-22T14:02:34.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.627+0000 7f68b959a700 1 -- 172.21.15.103:0/957072923 >> v1:172.21.15.103:6789/0 conn(0x7f68bc0af280 legacy=0x7f68bc141cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:34.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.627+0000 7f68b959a700 1 --2- 172.21.15.103:0/957072923 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f689c003720 0x7f689c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:34.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.627+0000 7f68b959a700 1 --2- 172.21.15.103:0/957072923 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f689c0044d0 0x7f689c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:34.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.627+0000 7f68b959a700 1 --2- 172.21.15.103:0/957072923 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f689c004db0 0x7f689c00d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:34.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.627+0000 7f68b959a700 1 -- 172.21.15.103:0/957072923 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68bc0adad0 con 0x7f689c003720 2020-04-22T14:02:34.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.627+0000 7f68b959a700 1 -- 172.21.15.103:0/957072923 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689c0041c0 con 0x7f689c004db0 2020-04-22T14:02:34.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.627+0000 7f68b959a700 1 -- 172.21.15.103:0/957072923 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f689c009710 con 0x7f689c0044d0 2020-04-22T14:02:34.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.627+0000 7f68bad9d700 1 --2- 172.21.15.103:0/957072923 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f689c004db0 0x7f689c00d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:34.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.627+0000 7f68b9d9b700 1 --2- 172.21.15.103:0/957072923 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f689c0044d0 0x7f689c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:34.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.627+0000 7f68ba59c700 1 --2- 172.21.15.103:0/957072923 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f689c003720 0x7f689c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:34.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.627+0000 7f68bad9d700 1 -- 172.21.15.103:0/957072923 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f689c0044d0 msgr2=0x7f689c004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:34.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.627+0000 7f68bad9d700 1 --2- 172.21.15.103:0/957072923 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f689c0044d0 0x7f689c004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:34.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.627+0000 7f68bad9d700 1 -- 172.21.15.103:0/957072923 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f689c003720 msgr2=0x7f689c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:34.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.627+0000 7f68bad9d700 1 --2- 172.21.15.103:0/957072923 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f689c003720 0x7f689c003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:34.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.627+0000 7f68bad9d700 1 -- 172.21.15.103:0/957072923 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f689c003230 con 0x7f689c004db0 2020-04-22T14:02:34.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.627+0000 7f68b9d9b700 1 --2- 172.21.15.103:0/957072923 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f689c0044d0 0x7f689c004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:02:34.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.627+0000 7f68bad9d700 1 --2- 172.21.15.103:0/957072923 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f689c004db0 0x7f689c00d930 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f689c0054a0 tx=0x7f68b40100a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.627+0000 7f68bad9d700 1 -- 172.21.15.103:0/957072923 reap_dead start 2020-04-22T14:02:34.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.627+0000 7f68bad9d700 1 --2- 172.21.15.103:0/957072923 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f689c004db0 0x7f689c00d930 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f689c0054a0 tx=0x7f68b40100a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.627+0000 7f68bad9d700 1 --2- 172.21.15.103:0/957072923 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f689c004db0 0x7f689c00d930 secure :-1 s=READY pgs=136 cs=0 l=1 rx=0x7f689c0054a0 tx=0x7f68b40100a0).ready entity=mon.1 client_cookie=77e2937e98fa2148 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:34.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.627+0000 7f68bad9d700 1 --2- 172.21.15.103:0/957072923 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f689c004db0 0x7f689c00d930 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f689c0054a0 tx=0x7f68b40100a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.627+0000 7f68bad9d700 1 --2- 172.21.15.103:0/957072923 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f689c004db0 0x7f689c00d930 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f689c0054a0 tx=0x7f68b40100a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.627+0000 7f68b959a700 1 -- 172.21.15.103:0/957072923 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68b4006c40 con 0x7f689c004db0 2020-04-22T14:02:34.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.627+0000 7f68bad9d700 1 --2- 172.21.15.103:0/957072923 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f689c004db0 0x7f689c00d930 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f689c0054a0 tx=0x7f68b40100a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.627+0000 7f68b959a700 1 -- 172.21.15.103:0/957072923 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b4006da0 con 0x7f689c004db0 2020-04-22T14:02:34.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.627+0000 7f68b959a700 1 -- 172.21.15.103:0/957072923 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68b4002640 con 0x7f689c004db0 2020-04-22T14:02:34.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.627+0000 7f68c0b67700 1 -- 172.21.15.103:0/957072923 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f689c004db0 msgr2=0x7f689c00d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:34.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.627+0000 7f68c0b67700 1 --2- 172.21.15.103:0/957072923 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f689c004db0 0x7f689c00d930 secure :-1 s=READY pgs=136 cs=0 l=1 rx=0x7f689c0054a0 tx=0x7f68b40100a0).stop 2020-04-22T14:02:34.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.628+0000 7f68c0b67700 1 -- 172.21.15.103:0/957072923 shutdown_connections 2020-04-22T14:02:34.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.628+0000 7f68c0b67700 1 --2- 172.21.15.103:0/957072923 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f689c004db0 0x7f689c00d930 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:34.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.628+0000 7f68c0b67700 1 -- 172.21.15.103:0/957072923 >> 172.21.15.103:0/957072923 conn(0x7f68bc0b86b0 msgr2=0x7f68bc0b8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:34.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.628+0000 7f68c0b67700 1 -- 172.21.15.103:0/957072923 shutdown_connections 2020-04-22T14:02:34.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.628+0000 7f68c0b67700 1 -- 172.21.15.103:0/957072923 wait complete. 2020-04-22T14:02:34.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.629+0000 7f68c0b67700 1 Processor -- start 2020-04-22T14:02:34.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.629+0000 7f68c0b67700 1 -- start start 2020-04-22T14:02:34.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.630+0000 7f68c0b67700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f689c004db0 0x7f68bc0662f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:34.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.630+0000 7f68c0b67700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f68bc065370 0x7f68bc140f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:34.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.630+0000 7f68c0b67700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68bc065a10 con 0x7f68bc141380 2020-04-22T14:02:34.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.630+0000 7f68c0b67700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68bc0657f0 con 0x7f68bc065370 2020-04-22T14:02:34.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.630+0000 7f68c0b67700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68bc141830 con 0x7f689c004db0 2020-04-22T14:02:34.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.630+0000 7f68ba59c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f689c004db0 0x7f68bc0662f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:34.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.630+0000 7f68bad9d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f68bc141380 0x7f68bc1442a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39462/0 (socket says 172.21.15.103:39462) 2020-04-22T14:02:34.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.630+0000 7f68ba59c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f689c004db0 0x7f68bc0662f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47268/0 (socket says 172.21.15.103:47268) 2020-04-22T14:02:34.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.630+0000 7f68bad9d700 1 -- 172.21.15.103:0/149344033 learned_addr learned my addr 172.21.15.103:0/149344033 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:34.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.630+0000 7f68b9d9b700 1 --2- 172.21.15.103:0/149344033 >> v2:172.21.15.86:3300/0 conn(0x7f68bc065370 0x7f68bc140f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:34.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.630+0000 7f68ba59c700 1 -- 172.21.15.103:0/149344033 >> v2:172.21.15.86:3300/0 conn(0x7f68bc065370 msgr2=0x7f68bc140f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:34.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.630+0000 7f68ba59c700 1 --2- 172.21.15.103:0/149344033 >> v2:172.21.15.86:3300/0 conn(0x7f68bc065370 0x7f68bc140f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:34.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.630+0000 7f68b37fe700 1 -- 172.21.15.103:0/149344033 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2866405315 0 0) 0x7f68bc065a10 con 0x7f68bc141380 2020-04-22T14:02:34.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.630+0000 7f68ba59c700 1 -- 172.21.15.103:0/149344033 >> v1:172.21.15.103:6789/0 conn(0x7f68bc141380 legacy=0x7f68bc1442a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:34.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.630+0000 7f68ba59c700 1 -- 172.21.15.103:0/149344033 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68bc063b60 con 0x7f689c004db0 2020-04-22T14:02:34.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.630+0000 7f68ba59c700 1 --2- 172.21.15.103:0/149344033 >> v2:172.21.15.103:3300/0 conn(0x7f689c004db0 0x7f68bc0662f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f68ac002f30 tx=0x7f68ac010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.630+0000 7f68ba59c700 1 --2- 172.21.15.103:0/149344033 >> v2:172.21.15.103:3300/0 conn(0x7f689c004db0 0x7f68bc0662f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f68ac002f30 tx=0x7f68ac010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.630+0000 7f68ba59c700 1 --2- 172.21.15.103:0/149344033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f689c004db0 0x7f68bc0662f0 secure :-1 s=READY pgs=138 cs=0 l=1 rx=0x7f68ac002f30 tx=0x7f68ac010b40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:34.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.630+0000 7f68ba59c700 1 --2- 172.21.15.103:0/149344033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f689c004db0 0x7f68bc0662f0 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f68ac002f30 tx=0x7f68ac010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.630+0000 7f68b37fe700 1 -- 172.21.15.103:0/149344033 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68ac005e90 con 0x7f689c004db0 2020-04-22T14:02:34.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.630+0000 7f68ba59c700 1 --2- 172.21.15.103:0/149344033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f689c004db0 0x7f68bc0662f0 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f68ac002f30 tx=0x7f68ac010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.630+0000 7f68ba59c700 1 --2- 172.21.15.103:0/149344033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f689c004db0 0x7f68bc0662f0 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f68ac002f30 tx=0x7f68ac010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.630+0000 7f68b37fe700 1 -- 172.21.15.103:0/149344033 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ac007180 con 0x7f689c004db0 2020-04-22T14:02:34.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.630+0000 7f68c0b67700 1 -- 172.21.15.103:0/149344033 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68bc065c70 con 0x7f689c004db0 2020-04-22T14:02:34.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.630+0000 7f68b37fe700 1 -- 172.21.15.103:0/149344033 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68ac007520 con 0x7f689c004db0 2020-04-22T14:02:34.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.630+0000 7f68c0b67700 1 -- 172.21.15.103:0/149344033 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68bc14f280 con 0x7f689c004db0 2020-04-22T14:02:34.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.631+0000 7f68ba59c700 1 --2- 172.21.15.103:0/149344033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f689c004db0 0x7f68bc0662f0 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f68ac002f30 tx=0x7f68ac010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.631+0000 7f68c0b67700 1 -- 172.21.15.103:0/149344033 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f68bc065e00 con 0x7f689c004db0 2020-04-22T14:02:34.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.631+0000 7f68b37fe700 1 -- 172.21.15.103:0/149344033 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f68ac009490 con 0x7f689c004db0 2020-04-22T14:02:34.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.632+0000 7f68ba59c700 1 --2- 172.21.15.103:0/149344033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f689c004db0 0x7f68bc0662f0 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f68ac002f30 tx=0x7f68ac010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.632+0000 7f68ba59c700 1 --2- 172.21.15.103:0/149344033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f689c004db0 0x7f68bc0662f0 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f68ac002f30 tx=0x7f68ac010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.632+0000 7f68b37fe700 1 --2- 172.21.15.103:0/149344033 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f68a004d950 0x7f68a004fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:34.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.632+0000 7f68b37fe700 1 -- 172.21.15.103:0/149344033 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f68ac061540 con 0x7f689c004db0 2020-04-22T14:02:34.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.632+0000 7f68b37fe700 1 --2- 172.21.15.103:0/149344033 >> [v2:172.21.15.86:6818/33601,v1:172.21.15.86:6819/33601] conn(0x7f68a00543c0 0x7f68a00567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:34.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.632+0000 7f68b37fe700 1 -- 172.21.15.103:0/149344033 --> [v2:172.21.15.86:6818/33601,v1:172.21.15.86:6819/33601] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f68a0056da0 con 0x7f68a00543c0 2020-04-22T14:02:34.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.632+0000 7f68b37fe700 1 -- 172.21.15.103:0/149344033 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68ac062940 con 0x7f689c004db0 2020-04-22T14:02:34.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.632+0000 7f68b9d9b700 1 --2- 172.21.15.103:0/149344033 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f68a004d950 0x7f68a004fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:34.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.632+0000 7f68b9d9b700 1 --2- 172.21.15.103:0/149344033 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f68a004d950 0x7f68a004fe10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f68a40013e0 tx=0x7f68a4001340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.632+0000 7f68bad9d700 1 --2- 172.21.15.103:0/149344033 >> [v2:172.21.15.86:6818/33601,v1:172.21.15.86:6819/33601] conn(0x7f68a00543c0 0x7f68a00567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:34.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.632+0000 7f68b9d9b700 1 --2- 172.21.15.103:0/149344033 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f68a004d950 0x7f68a004fe10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f68a40013e0 tx=0x7f68a4001340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.632+0000 7f68b9d9b700 1 --2- 172.21.15.103:0/149344033 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f68a004d950 0x7f68a004fe10 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7f68a40013e0 tx=0x7f68a4001340).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:34.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.633+0000 7f68bad9d700 1 --2- 172.21.15.103:0/149344033 >> [v2:172.21.15.86:6818/33601,v1:172.21.15.86:6819/33601] conn(0x7f68a00543c0 0x7f68a00567e0 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:34.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.633+0000 7f68b37fe700 1 -- 172.21.15.103:0/149344033 <== osd.6 v2:172.21.15.86:6818/33601 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f68a0056da0 con 0x7f68a00543c0 2020-04-22T14:02:34.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.651+0000 7f68c0b67700 1 -- 172.21.15.103:0/149344033 --> [v2:172.21.15.86:6818/33601,v1:172.21.15.86:6819/33601] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f68bc0b3290 con 0x7f68a00543c0 2020-04-22T14:02:34.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.652+0000 7f68b37fe700 1 -- 172.21.15.103:0/149344033 <== osd.6 v2:172.21.15.86:6818/33601 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f68bc0b3290 con 0x7f68a00543c0 2020-04-22T14:02:34.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.652+0000 7f68c0b67700 1 -- 172.21.15.103:0/149344033 >> [v2:172.21.15.86:6818/33601,v1:172.21.15.86:6819/33601] conn(0x7f68a00543c0 msgr2=0x7f68a00567e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:34.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.652+0000 7f68c0b67700 1 --2- 172.21.15.103:0/149344033 >> [v2:172.21.15.86:6818/33601,v1:172.21.15.86:6819/33601] conn(0x7f68a00543c0 0x7f68a00567e0 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:34.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.652+0000 7f68c0b67700 1 -- 172.21.15.103:0/149344033 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f68a004d950 msgr2=0x7f68a004fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:34.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.652+0000 7f68c0b67700 1 --2- 172.21.15.103:0/149344033 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f68a004d950 0x7f68a004fe10 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7f68a40013e0 tx=0x7f68a4001340).stop 2020-04-22T14:02:34.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.652+0000 7f68c0b67700 1 -- 172.21.15.103:0/149344033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f689c004db0 msgr2=0x7f68bc0662f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:34.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.652+0000 7f68c0b67700 1 --2- 172.21.15.103:0/149344033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f689c004db0 0x7f68bc0662f0 secure :-1 s=READY pgs=138 cs=0 l=1 rx=0x7f68ac002f30 tx=0x7f68ac010b40).stop 2020-04-22T14:02:34.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.652+0000 7f68bad9d700 1 -- 172.21.15.103:0/149344033 reap_dead start 2020-04-22T14:02:34.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.653+0000 7f68c0b67700 1 -- 172.21.15.103:0/149344033 shutdown_connections 2020-04-22T14:02:34.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.653+0000 7f68c0b67700 1 --2- 172.21.15.103:0/149344033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f689c004db0 0x7f68bc0662f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:34.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.653+0000 7f68c0b67700 1 -- 172.21.15.103:0/149344033 >> 172.21.15.103:0/149344033 conn(0x7f68bc0b86b0 msgr2=0x7f68bc05c690 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:34.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.653+0000 7f68c0b67700 1 -- 172.21.15.103:0/149344033 shutdown_connections 2020-04-22T14:02:34.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.653+0000 7f68c0b67700 1 -- 172.21.15.103:0/149344033 wait complete. 2020-04-22T14:02:34.665 INFO:teuthology.orchestra.run.smithi103.stdout:64424509445 2020-04-22T14:02:34.666 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:34.680 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.7 flush_pg_stats 2020-04-22T14:02:34.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.826+0000 7fb485096700 1 Processor -- start 2020-04-22T14:02:34.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.826+0000 7fb485096700 1 -- start start 2020-04-22T14:02:34.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.827+0000 7fb485096700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb4800b4320 0x7fb4800b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:34.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.827+0000 7fb485096700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb4800b2530 0x7fb4800b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:34.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.827+0000 7fb485096700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4800b0e90 con 0x7fb4800b4700 2020-04-22T14:02:34.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.827+0000 7fb485096700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4800b1130 con 0x7fb4800b2530 2020-04-22T14:02:34.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.827+0000 7fb485096700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4800ae500 con 0x7fb4800b4320 2020-04-22T14:02:34.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.827+0000 7fb47ed9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb4800b4320 0x7fb4800b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:34.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.827+0000 7fb47ed9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb4800b4320 0x7fb4800b15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47278/0 (socket says 172.21.15.103:47278) 2020-04-22T14:02:34.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.827+0000 7fb47ed9d700 1 -- 172.21.15.103:0/3965201703 learned_addr learned my addr 172.21.15.103:0/3965201703 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:34.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.827+0000 7fb47f59e700 1 --2- 172.21.15.103:0/3965201703 >> v2:172.21.15.86:3300/0 conn(0x7fb4800b2530 0x7fb4800b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:34.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.827+0000 7fb47ed9d700 1 -- 172.21.15.103:0/3965201703 >> v2:172.21.15.86:3300/0 conn(0x7fb4800b2530 msgr2=0x7fb4800b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:34.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.827+0000 7fb47ed9d700 1 --2- 172.21.15.103:0/3965201703 >> v2:172.21.15.86:3300/0 conn(0x7fb4800b2530 0x7fb4800b0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:34.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.827+0000 7fb47ed9d700 1 -- 172.21.15.103:0/3965201703 >> v1:172.21.15.86:6789/0 conn(0x7fb4800b4700 legacy=0x7fb4800afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:34.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.828+0000 7fb47ed9d700 1 -- 172.21.15.103:0/3965201703 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4800b1a30 con 0x7fb4800b4320 2020-04-22T14:02:34.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.828+0000 7fb47ed9d700 1 --2- 172.21.15.103:0/3965201703 >> v2:172.21.15.103:3300/0 conn(0x7fb4800b4320 0x7fb4800b15d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb4800af970 tx=0x7fb468007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.828+0000 7fb47ed9d700 1 --2- 172.21.15.103:0/3965201703 >> v2:172.21.15.103:3300/0 conn(0x7fb4800b4320 0x7fb4800b15d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb4800af970 tx=0x7fb468007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.828+0000 7fb47ed9d700 1 --2- 172.21.15.103:0/3965201703 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4800b4320 0x7fb4800b15d0 secure :-1 s=READY pgs=139 cs=0 l=1 rx=0x7fb4800af970 tx=0x7fb468007a40).ready entity=mon.1 client_cookie=69a7bbfa5faf3a88 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:34.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.828+0000 7fb47ed9d700 1 --2- 172.21.15.103:0/3965201703 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4800b4320 0x7fb4800b15d0 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7fb4800af970 tx=0x7fb468007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.828+0000 7fb47dd9b700 1 -- 172.21.15.103:0/3965201703 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4680116e0 con 0x7fb4800b4320 2020-04-22T14:02:34.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.828+0000 7fb47ed9d700 1 --2- 172.21.15.103:0/3965201703 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4800b4320 0x7fb4800b15d0 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7fb4800af970 tx=0x7fb468007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.828+0000 7fb47dd9b700 1 -- 172.21.15.103:0/3965201703 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb468011840 con 0x7fb4800b4320 2020-04-22T14:02:34.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.828+0000 7fb47ed9d700 1 --2- 172.21.15.103:0/3965201703 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4800b4320 0x7fb4800b15d0 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7fb4800af970 tx=0x7fb468007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.828+0000 7fb47dd9b700 1 -- 172.21.15.103:0/3965201703 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb468011c20 con 0x7fb4800b4320 2020-04-22T14:02:34.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.828+0000 7fb485096700 1 -- 172.21.15.103:0/3965201703 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4800b4320 msgr2=0x7fb4800b15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:34.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.828+0000 7fb485096700 1 --2- 172.21.15.103:0/3965201703 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4800b4320 0x7fb4800b15d0 secure :-1 s=READY pgs=139 cs=0 l=1 rx=0x7fb4800af970 tx=0x7fb468007a40).stop 2020-04-22T14:02:34.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.828+0000 7fb485096700 1 -- 172.21.15.103:0/3965201703 shutdown_connections 2020-04-22T14:02:34.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.828+0000 7fb485096700 1 --2- 172.21.15.103:0/3965201703 >> v2:172.21.15.86:3300/0 conn(0x7fb4800b2530 0x7fb4800b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:34.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.828+0000 7fb485096700 1 --2- 172.21.15.103:0/3965201703 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4800b4320 0x7fb4800b15d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:34.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.828+0000 7fb485096700 1 -- 172.21.15.103:0/3965201703 >> 172.21.15.103:0/3965201703 conn(0x7fb4800b86b0 msgr2=0x7fb4800b8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:34.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.828+0000 7fb485096700 1 -- 172.21.15.103:0/3965201703 shutdown_connections 2020-04-22T14:02:34.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.828+0000 7fb485096700 1 -- 172.21.15.103:0/3965201703 wait complete. 2020-04-22T14:02:34.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.829+0000 7fb485096700 1 Processor -- start 2020-04-22T14:02:34.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.829+0000 7fb485096700 1 -- start start 2020-04-22T14:02:34.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.830+0000 7fb485096700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4800b2530 0x7fb480153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:34.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.830+0000 7fb485096700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb4800b4320 0x7fb480140ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:34.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.830+0000 7fb485096700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb4800b4700 0x7fb480062c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:34.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.830+0000 7fb485096700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb480063080 con 0x7fb4800b4320 2020-04-22T14:02:34.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.830+0000 7fb485096700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb480141c40 con 0x7fb4800b4700 2020-04-22T14:02:34.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.830+0000 7fb485096700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb480143140 con 0x7fb4800b2530 2020-04-22T14:02:34.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.830+0000 7fb47f59e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb4800b4700 0x7fb480062c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:34.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.830+0000 7fb47f59e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb4800b4700 0x7fb480062c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47286/0 (socket says 172.21.15.103:47286) 2020-04-22T14:02:34.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.830+0000 7fb47f59e700 1 -- 172.21.15.103:0/1917134426 learned_addr learned my addr 172.21.15.103:0/1917134426 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:34.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.830+0000 7fb47ed9d700 1 --2- 172.21.15.103:0/1917134426 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4800b2530 0x7fb480153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:34.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.830+0000 7fb47e59c700 1 --2- 172.21.15.103:0/1917134426 >> v2:172.21.15.86:3300/0 conn(0x7fb4800b4320 0x7fb480140ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:34.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.830+0000 7fb47f59e700 1 -- 172.21.15.103:0/1917134426 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4800b2530 msgr2=0x7fb480153ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:34.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.830+0000 7fb47f59e700 1 --2- 172.21.15.103:0/1917134426 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4800b2530 0x7fb480153ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:34.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.830+0000 7fb47f59e700 1 -- 172.21.15.103:0/1917134426 >> v2:172.21.15.86:3300/0 conn(0x7fb4800b4320 msgr2=0x7fb480140ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:34.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.830+0000 7fb47f59e700 1 --2- 172.21.15.103:0/1917134426 >> v2:172.21.15.86:3300/0 conn(0x7fb4800b4320 0x7fb480140ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:34.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.830+0000 7fb47f59e700 1 -- 172.21.15.103:0/1917134426 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4801433e0 con 0x7fb4800b4700 2020-04-22T14:02:34.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.830+0000 7fb47ed9d700 1 --2- 172.21.15.103:0/1917134426 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4800b2530 0x7fb480153ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:02:34.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.830+0000 7fb47e59c700 1 --2- 172.21.15.103:0/1917134426 >> v2:172.21.15.86:3300/0 conn(0x7fb4800b4320 0x7fb480140ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:02:34.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.830+0000 7fb47f59e700 1 --2- 172.21.15.103:0/1917134426 >> v2:172.21.15.103:3300/0 conn(0x7fb4800b4700 0x7fb480062c20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb4780032b0 tx=0x7fb478010fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.830+0000 7fb47f59e700 1 --2- 172.21.15.103:0/1917134426 >> v2:172.21.15.103:3300/0 conn(0x7fb4800b4700 0x7fb480062c20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb4780032b0 tx=0x7fb478010fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.830+0000 7fb47f59e700 1 --2- 172.21.15.103:0/1917134426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4800b4700 0x7fb480062c20 secure :-1 s=READY pgs=140 cs=0 l=1 rx=0x7fb4780032b0 tx=0x7fb478010fa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:34.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.831+0000 7fb47f59e700 1 --2- 172.21.15.103:0/1917134426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4800b4700 0x7fb480062c20 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7fb4780032b0 tx=0x7fb478010fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.831+0000 7fb477fff700 1 -- 172.21.15.103:0/1917134426 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb478005e30 con 0x7fb4800b4700 2020-04-22T14:02:34.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.831+0000 7fb47f59e700 1 --2- 172.21.15.103:0/1917134426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4800b4700 0x7fb480062c20 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7fb4780032b0 tx=0x7fb478010fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.831+0000 7fb47f59e700 1 --2- 172.21.15.103:0/1917134426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4800b4700 0x7fb480062c20 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7fb4780032b0 tx=0x7fb478010fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.831+0000 7fb477fff700 1 -- 172.21.15.103:0/1917134426 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb478007560 con 0x7fb4800b4700 2020-04-22T14:02:34.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.831+0000 7fb485096700 1 -- 172.21.15.103:0/1917134426 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb480143680 con 0x7fb4800b4700 2020-04-22T14:02:34.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.831+0000 7fb477fff700 1 -- 172.21.15.103:0/1917134426 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4780078c0 con 0x7fb4800b4700 2020-04-22T14:02:34.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.831+0000 7fb485096700 1 -- 172.21.15.103:0/1917134426 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb480143ce0 con 0x7fb4800b4700 2020-04-22T14:02:34.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.831+0000 7fb47f59e700 1 --2- 172.21.15.103:0/1917134426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4800b4700 0x7fb480062c20 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7fb4780032b0 tx=0x7fb478010fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.831+0000 7fb485096700 1 -- 172.21.15.103:0/1917134426 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb4800b0800 con 0x7fb4800b4700 2020-04-22T14:02:34.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.832+0000 7fb477fff700 1 -- 172.21.15.103:0/1917134426 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fb4780101a0 con 0x7fb4800b4700 2020-04-22T14:02:34.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.832+0000 7fb47f59e700 1 --2- 172.21.15.103:0/1917134426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4800b4700 0x7fb480062c20 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7fb4780032b0 tx=0x7fb478010fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.832+0000 7fb47f59e700 1 --2- 172.21.15.103:0/1917134426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4800b4700 0x7fb480062c20 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7fb4780032b0 tx=0x7fb478010fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.832+0000 7fb477fff700 1 --2- 172.21.15.103:0/1917134426 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb46404d940 0x7fb46404fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:34.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.832+0000 7fb477fff700 1 -- 172.21.15.103:0/1917134426 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb4780614a0 con 0x7fb4800b4700 2020-04-22T14:02:34.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.832+0000 7fb477fff700 1 --2- 172.21.15.103:0/1917134426 >> [v2:172.21.15.86:6826/33629,v1:172.21.15.86:6827/33629] conn(0x7fb4640545a0 0x7fb4640569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:34.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.832+0000 7fb477fff700 1 -- 172.21.15.103:0/1917134426 --> [v2:172.21.15.86:6826/33629,v1:172.21.15.86:6827/33629] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb464056f80 con 0x7fb4640545a0 2020-04-22T14:02:34.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.832+0000 7fb477fff700 1 -- 172.21.15.103:0/1917134426 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4780628a0 con 0x7fb4800b4700 2020-04-22T14:02:34.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.832+0000 7fb47ed9d700 1 --2- 172.21.15.103:0/1917134426 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb46404d940 0x7fb46404fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:34.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.832+0000 7fb47ed9d700 1 --2- 172.21.15.103:0/1917134426 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb46404d940 0x7fb46404fe00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb4800af970 tx=0x7fb468007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.832+0000 7fb47e59c700 1 --2- 172.21.15.103:0/1917134426 >> [v2:172.21.15.86:6826/33629,v1:172.21.15.86:6827/33629] conn(0x7fb4640545a0 0x7fb4640569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:34.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.832+0000 7fb47ed9d700 1 --2- 172.21.15.103:0/1917134426 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb46404d940 0x7fb46404fe00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb4800af970 tx=0x7fb468007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:34.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.832+0000 7fb47ed9d700 1 --2- 172.21.15.103:0/1917134426 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb46404d940 0x7fb46404fe00 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7fb4800af970 tx=0x7fb468007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:34.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.833+0000 7fb47e59c700 1 --2- 172.21.15.103:0/1917134426 >> [v2:172.21.15.86:6826/33629,v1:172.21.15.86:6827/33629] conn(0x7fb4640545a0 0x7fb4640569c0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:34.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.834+0000 7fb477fff700 1 -- 172.21.15.103:0/1917134426 <== osd.7 v2:172.21.15.86:6826/33629 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7fb464056f80 con 0x7fb4640545a0 2020-04-22T14:02:34.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.852+0000 7fb485096700 1 -- 172.21.15.103:0/1917134426 --> [v2:172.21.15.86:6826/33629,v1:172.21.15.86:6827/33629] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb480143840 con 0x7fb4640545a0 2020-04-22T14:02:34.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.852+0000 7fb477fff700 1 -- 172.21.15.103:0/1917134426 <== osd.7 v2:172.21.15.86:6826/33629 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb480143840 con 0x7fb4640545a0 2020-04-22T14:02:34.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.853+0000 7fb485096700 1 -- 172.21.15.103:0/1917134426 >> [v2:172.21.15.86:6826/33629,v1:172.21.15.86:6827/33629] conn(0x7fb4640545a0 msgr2=0x7fb4640569c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:34.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.853+0000 7fb485096700 1 --2- 172.21.15.103:0/1917134426 >> [v2:172.21.15.86:6826/33629,v1:172.21.15.86:6827/33629] conn(0x7fb4640545a0 0x7fb4640569c0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:34.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.853+0000 7fb485096700 1 -- 172.21.15.103:0/1917134426 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb46404d940 msgr2=0x7fb46404fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:34.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.853+0000 7fb485096700 1 --2- 172.21.15.103:0/1917134426 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb46404d940 0x7fb46404fe00 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7fb4800af970 tx=0x7fb468007a40).stop 2020-04-22T14:02:34.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.853+0000 7fb485096700 1 -- 172.21.15.103:0/1917134426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4800b4700 msgr2=0x7fb480062c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:34.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.853+0000 7fb485096700 1 --2- 172.21.15.103:0/1917134426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4800b4700 0x7fb480062c20 secure :-1 s=READY pgs=140 cs=0 l=1 rx=0x7fb4780032b0 tx=0x7fb478010fa0).stop 2020-04-22T14:02:34.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.853+0000 7fb47f59e700 1 -- 172.21.15.103:0/1917134426 reap_dead start 2020-04-22T14:02:34.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.853+0000 7fb485096700 1 -- 172.21.15.103:0/1917134426 shutdown_connections 2020-04-22T14:02:34.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.853+0000 7fb485096700 1 --2- 172.21.15.103:0/1917134426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4800b4700 0x7fb480062c20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:34.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.853+0000 7fb485096700 1 -- 172.21.15.103:0/1917134426 >> 172.21.15.103:0/1917134426 conn(0x7fb4800b86b0 msgr2=0x7fb4800ac740 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:34.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.853+0000 7fb485096700 1 -- 172.21.15.103:0/1917134426 shutdown_connections 2020-04-22T14:02:34.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:34.853+0000 7fb485096700 1 -- 172.21.15.103:0/1917134426 wait complete. 2020-04-22T14:02:34.904 INFO:teuthology.orchestra.run.smithi103.stdout:64424509446 2020-04-22T14:02:34.904 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:34.918 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.0 2020-04-22T14:02:35.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.063+0000 7ffa24808700 1 Processor -- start 2020-04-22T14:02:35.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.063+0000 7ffa24808700 1 -- start start 2020-04-22T14:02:35.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.063+0000 7ffa24808700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ffa20142690 0x7ffa20142af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:35.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.063+0000 7ffa24808700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffa200b2e90 0x7ffa200b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:35.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.063+0000 7ffa24808700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa20142f50 con 0x7ffa20067110 2020-04-22T14:02:35.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.063+0000 7ffa24808700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa200afb20 con 0x7ffa20142690 2020-04-22T14:02:35.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.063+0000 7ffa24808700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa200afdc0 con 0x7ffa200b2e90 2020-04-22T14:02:35.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.064+0000 7ffa1ffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffa200b2e90 0x7ffa200b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:35.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.064+0000 7ffa1f7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ffa20067110 0x7ffa200aee80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39484/0 (socket says 172.21.15.103:39484) 2020-04-22T14:02:35.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.064+0000 7ffa1f7fe700 1 -- 172.21.15.103:0/87140901 learned_addr learned my addr 172.21.15.103:0/87140901 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:35.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.064+0000 7ffa1effd700 1 --2- 172.21.15.103:0/87140901 >> v2:172.21.15.86:3300/0 conn(0x7ffa20142690 0x7ffa20142af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:35.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.064+0000 7ffa1ffff700 1 -- 172.21.15.103:0/87140901 >> v2:172.21.15.86:3300/0 conn(0x7ffa20142690 msgr2=0x7ffa20142af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:35.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.064+0000 7ffa1ffff700 1 --2- 172.21.15.103:0/87140901 >> v2:172.21.15.86:3300/0 conn(0x7ffa20142690 0x7ffa20142af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:35.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.064+0000 7ffa1ffff700 1 -- 172.21.15.103:0/87140901 >> v1:172.21.15.103:6789/0 conn(0x7ffa20067110 legacy=0x7ffa200aee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:35.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.064+0000 7ffa1ffff700 1 -- 172.21.15.103:0/87140901 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa200b0060 con 0x7ffa200b2e90 2020-04-22T14:02:35.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.064+0000 7ffa1e7fc700 1 -- 172.21.15.103:0/87140901 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 100731688 0 0) 0x7ffa20142f50 con 0x7ffa20067110 2020-04-22T14:02:35.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.064+0000 7ffa1ffff700 1 --2- 172.21.15.103:0/87140901 >> v2:172.21.15.103:3300/0 conn(0x7ffa200b2e90 0x7ffa200b32b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ffa18002f30 tx=0x7ffa18007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:35.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.064+0000 7ffa1ffff700 1 --2- 172.21.15.103:0/87140901 >> v2:172.21.15.103:3300/0 conn(0x7ffa200b2e90 0x7ffa200b32b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ffa18002f30 tx=0x7ffa18007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:35.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.064+0000 7ffa1ffff700 1 --2- 172.21.15.103:0/87140901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa200b2e90 0x7ffa200b32b0 secure :-1 s=READY pgs=142 cs=0 l=1 rx=0x7ffa18002f30 tx=0x7ffa18007a40).ready entity=mon.1 client_cookie=5c276817cda9c410 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:35.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.064+0000 7ffa1ffff700 1 --2- 172.21.15.103:0/87140901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa200b2e90 0x7ffa200b32b0 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7ffa18002f30 tx=0x7ffa18007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:35.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.064+0000 7ffa1e7fc700 1 -- 172.21.15.103:0/87140901 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa180113c0 con 0x7ffa200b2e90 2020-04-22T14:02:35.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.064+0000 7ffa1ffff700 1 --2- 172.21.15.103:0/87140901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa200b2e90 0x7ffa200b32b0 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7ffa18002f30 tx=0x7ffa18007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:35.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.064+0000 7ffa1ffff700 1 --2- 172.21.15.103:0/87140901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa200b2e90 0x7ffa200b32b0 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7ffa18002f30 tx=0x7ffa18007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:35.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.064+0000 7ffa1e7fc700 1 -- 172.21.15.103:0/87140901 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa18011520 con 0x7ffa200b2e90 2020-04-22T14:02:35.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.064+0000 7ffa1e7fc700 1 -- 172.21.15.103:0/87140901 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa18011900 con 0x7ffa200b2e90 2020-04-22T14:02:35.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.064+0000 7ffa24808700 1 -- 172.21.15.103:0/87140901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa200b2e90 msgr2=0x7ffa200b32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:35.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.064+0000 7ffa24808700 1 --2- 172.21.15.103:0/87140901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa200b2e90 0x7ffa200b32b0 secure :-1 s=READY pgs=142 cs=0 l=1 rx=0x7ffa18002f30 tx=0x7ffa18007a40).stop 2020-04-22T14:02:35.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.065+0000 7ffa24808700 1 -- 172.21.15.103:0/87140901 shutdown_connections 2020-04-22T14:02:35.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.065+0000 7ffa24808700 1 --2- 172.21.15.103:0/87140901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa200b2e90 0x7ffa200b32b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:35.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.065+0000 7ffa24808700 1 --2- 172.21.15.103:0/87140901 >> v2:172.21.15.86:3300/0 conn(0x7ffa20142690 0x7ffa20142af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:35.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.065+0000 7ffa24808700 1 -- 172.21.15.103:0/87140901 >> 172.21.15.103:0/87140901 conn(0x7ffa2005ad30 msgr2=0x7ffa2005b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:35.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.065+0000 7ffa24808700 1 -- 172.21.15.103:0/87140901 shutdown_connections 2020-04-22T14:02:35.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.065+0000 7ffa24808700 1 -- 172.21.15.103:0/87140901 wait complete. 2020-04-22T14:02:35.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.065+0000 7ffa24808700 1 Processor -- start 2020-04-22T14:02:35.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.066+0000 7ffa24808700 1 -- start start 2020-04-22T14:02:35.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.066+0000 7ffa24808700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffa20142690 0x7ffa200618a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:35.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.066+0000 7ffa24808700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa20061d00 con 0x7ffa200b2e90 2020-04-22T14:02:35.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.066+0000 7ffa24808700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa2013f590 con 0x7ffa20067110 2020-04-22T14:02:35.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.066+0000 7ffa24808700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2013f830 con 0x7ffa20142690 2020-04-22T14:02:35.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.066+0000 7ffa1f7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ffa20067110 0x7ffa20137fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39490/0 (socket says 172.21.15.103:39490) 2020-04-22T14:02:35.080 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.066+0000 7ffa1f7fe700 1 -- 172.21.15.103:0/91995120 learned_addr learned my addr 172.21.15.103:0/91995120 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:35.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.067+0000 7ffa1ffff700 1 --2- 172.21.15.103:0/91995120 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffa20142690 0x7ffa200618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:35.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.067+0000 7ffa1cff9700 1 -- 172.21.15.103:0/91995120 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3277644126 0 0) 0x7ffa2013f590 con 0x7ffa20067110 2020-04-22T14:02:35.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.067+0000 7ffa1cff9700 1 -- 172.21.15.103:0/91995120 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa04002fe0 con 0x7ffa20067110 2020-04-22T14:02:35.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.067+0000 7ffa1cff9700 1 -- 172.21.15.103:0/91995120 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 92958413 0 0) 0x7ffa08001ec0 con 0x7ffa200b2e90 2020-04-22T14:02:35.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.067+0000 7ffa1cff9700 1 -- 172.21.15.103:0/91995120 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa2013f590 con 0x7ffa200b2e90 2020-04-22T14:02:35.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.067+0000 7ffa1cff9700 1 -- 172.21.15.103:0/91995120 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4023865283 0 0) 0x7ffa04002fe0 con 0x7ffa20067110 2020-04-22T14:02:35.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.067+0000 7ffa1cff9700 1 -- 172.21.15.103:0/91995120 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ffa08001ec0 con 0x7ffa20067110 2020-04-22T14:02:35.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.067+0000 7ffa1cff9700 1 -- 172.21.15.103:0/91995120 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7ffa10001be0 con 0x7ffa20067110 2020-04-22T14:02:35.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.067+0000 7ffa1cff9700 1 -- 172.21.15.103:0/91995120 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffa20142690 msgr2=0x7ffa200618a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:35.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.067+0000 7ffa1cff9700 1 --2- 172.21.15.103:0/91995120 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffa20142690 0x7ffa200618a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:35.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.067+0000 7ffa1cff9700 1 -- 172.21.15.103:0/91995120 >> v1:172.21.15.103:6789/0 conn(0x7ffa20067110 legacy=0x7ffa20137fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:35.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.067+0000 7ffa1cff9700 1 -- 172.21.15.103:0/91995120 >> v1:172.21.15.86:6789/0 conn(0x7ffa200b2e90 legacy=0x7ffa2013e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:35.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.067+0000 7ffa1cff9700 1 --2- 172.21.15.103:0/91995120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffa04004b20 0x7ffa04004f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:35.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.067+0000 7ffa1cff9700 1 --2- 172.21.15.103:0/91995120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa04003ab0 0x7ffa04003f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:35.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.067+0000 7ffa1cff9700 1 --2- 172.21.15.103:0/91995120 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffa04004370 0x7ffa0400b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:35.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.067+0000 7ffa1cff9700 1 -- 172.21.15.103:0/91995120 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2013f830 con 0x7ffa04004b20 2020-04-22T14:02:35.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.067+0000 7ffa1cff9700 1 -- 172.21.15.103:0/91995120 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa040048e0 con 0x7ffa04003ab0 2020-04-22T14:02:35.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.067+0000 7ffa1cff9700 1 -- 172.21.15.103:0/91995120 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0400bbb0 con 0x7ffa04004370 2020-04-22T14:02:35.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.067+0000 7ffa1ffff700 1 --2- 172.21.15.103:0/91995120 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffa20142690 0x7ffa200618a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:02:35.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.067+0000 7ffa1effd700 1 --2- 172.21.15.103:0/91995120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa04003ab0 0x7ffa04003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:35.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.067+0000 7ffa1f7fe700 1 --2- 172.21.15.103:0/91995120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffa04004b20 0x7ffa04004f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:35.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.067+0000 7ffa1ffff700 1 --2- 172.21.15.103:0/91995120 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffa04004370 0x7ffa0400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:35.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.067+0000 7ffa1effd700 1 -- 172.21.15.103:0/91995120 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffa04004370 msgr2=0x7ffa0400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:35.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.067+0000 7ffa1effd700 1 --2- 172.21.15.103:0/91995120 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffa04004370 0x7ffa0400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:35.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.067+0000 7ffa1effd700 1 -- 172.21.15.103:0/91995120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffa04004b20 msgr2=0x7ffa04004f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:35.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.067+0000 7ffa1effd700 1 --2- 172.21.15.103:0/91995120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffa04004b20 0x7ffa04004f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:35.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.067+0000 7ffa1effd700 1 -- 172.21.15.103:0/91995120 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa2013fad0 con 0x7ffa04003ab0 2020-04-22T14:02:35.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.067+0000 7ffa24808700 1 -- 172.21.15.103:0/91995120 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa201386f0 con 0x7ffa04003ab0 2020-04-22T14:02:35.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.067+0000 7ffa1ffff700 1 --2- 172.21.15.103:0/91995120 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffa04004370 0x7ffa0400b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:02:35.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.067+0000 7ffa1effd700 1 --2- 172.21.15.103:0/91995120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa04003ab0 0x7ffa04003f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffa08002ef0 tx=0x7ffa08010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:35.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.067+0000 7ffa24808700 1 -- 172.21.15.103:0/91995120 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa200618a0 con 0x7ffa04003ab0 2020-04-22T14:02:35.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.067+0000 7ffa1effd700 1 --2- 172.21.15.103:0/91995120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa04003ab0 0x7ffa04003f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffa08002ef0 tx=0x7ffa08010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:35.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.067+0000 7ffa1effd700 1 --2- 172.21.15.103:0/91995120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa04003ab0 0x7ffa04003f10 secure :-1 s=READY pgs=144 cs=0 l=1 rx=0x7ffa08002ef0 tx=0x7ffa08010f00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:35.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.068+0000 7ffa1effd700 1 --2- 172.21.15.103:0/91995120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa04003ab0 0x7ffa04003f10 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7ffa08002ef0 tx=0x7ffa08010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:35.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.068+0000 7ffa1cff9700 1 -- 172.21.15.103:0/91995120 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa08011c70 con 0x7ffa04003ab0 2020-04-22T14:02:35.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.068+0000 7ffa1effd700 1 --2- 172.21.15.103:0/91995120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa04003ab0 0x7ffa04003f10 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7ffa08002ef0 tx=0x7ffa08010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:35.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.068+0000 7ffa1cff9700 1 -- 172.21.15.103:0/91995120 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa08011dd0 con 0x7ffa04003ab0 2020-04-22T14:02:35.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.068+0000 7ffa1effd700 1 --2- 172.21.15.103:0/91995120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa04003ab0 0x7ffa04003f10 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7ffa08002ef0 tx=0x7ffa08010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:35.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.068+0000 7ffa1cff9700 1 -- 172.21.15.103:0/91995120 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa080058b0 con 0x7ffa04003ab0 2020-04-22T14:02:35.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.068+0000 7ffa1effd700 1 --2- 172.21.15.103:0/91995120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa04003ab0 0x7ffa04003f10 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7ffa08002ef0 tx=0x7ffa08010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:35.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.068+0000 7ffa24808700 1 -- 172.21.15.103:0/91995120 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9f8003340 con 0x7ffa04003ab0 2020-04-22T14:02:35.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.069+0000 7ffa1cff9700 1 -- 172.21.15.103:0/91995120 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ffa08005a10 con 0x7ffa04003ab0 2020-04-22T14:02:35.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.069+0000 7ffa1effd700 1 --2- 172.21.15.103:0/91995120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa04003ab0 0x7ffa04003f10 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7ffa08002ef0 tx=0x7ffa08010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:35.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.069+0000 7ffa1cff9700 1 --2- 172.21.15.103:0/91995120 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffa04056310 0x7ffa040587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:35.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.069+0000 7ffa1cff9700 1 -- 172.21.15.103:0/91995120 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ffa08061180 con 0x7ffa04003ab0 2020-04-22T14:02:35.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.069+0000 7ffa1f7fe700 1 --2- 172.21.15.103:0/91995120 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffa04056310 0x7ffa040587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:35.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.069+0000 7ffa1f7fe700 1 --2- 172.21.15.103:0/91995120 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffa04056310 0x7ffa040587d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffa10005900 tx=0x7ffa10005940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:35.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.069+0000 7ffa1f7fe700 1 --2- 172.21.15.103:0/91995120 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffa04056310 0x7ffa040587d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffa10005900 tx=0x7ffa10005940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:35.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.069+0000 7ffa1f7fe700 1 --2- 172.21.15.103:0/91995120 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffa04056310 0x7ffa040587d0 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7ffa10005900 tx=0x7ffa10005940).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:35.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.073+0000 7ffa1effd700 1 --2- 172.21.15.103:0/91995120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa04003ab0 0x7ffa04003f10 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7ffa08002ef0 tx=0x7ffa08010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:35.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.073+0000 7ffa1cff9700 1 -- 172.21.15.103:0/91995120 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ffa0803c5c0 con 0x7ffa04003ab0 2020-04-22T14:02:35.222 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.214+0000 7ffa24808700 1 -- 172.21.15.103:0/91995120 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff9f80021d0 con 0x7ffa04003ab0 2020-04-22T14:02:35.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.214+0000 7ffa1effd700 1 --2- 172.21.15.103:0/91995120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa04003ab0 0x7ffa04003f10 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7ffa08002ef0 tx=0x7ffa08010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:35.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.214+0000 7ffa1cff9700 1 -- 172.21.15.103:0/91995120 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffa0803fbe0 con 0x7ffa04003ab0 2020-04-22T14:02:35.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.215+0000 7ffa24808700 1 -- 172.21.15.103:0/91995120 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffa04056310 msgr2=0x7ffa040587d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:35.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.215+0000 7ffa24808700 1 --2- 172.21.15.103:0/91995120 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffa04056310 0x7ffa040587d0 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7ffa10005900 tx=0x7ffa10005940).stop 2020-04-22T14:02:35.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.215+0000 7ffa24808700 1 -- 172.21.15.103:0/91995120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa04003ab0 msgr2=0x7ffa04003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:35.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.215+0000 7ffa24808700 1 --2- 172.21.15.103:0/91995120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa04003ab0 0x7ffa04003f10 secure :-1 s=READY pgs=144 cs=0 l=1 rx=0x7ffa08002ef0 tx=0x7ffa08010f00).stop 2020-04-22T14:02:35.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.215+0000 7ffa1ffff700 1 -- 172.21.15.103:0/91995120 reap_dead start 2020-04-22T14:02:35.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.215+0000 7ffa24808700 1 -- 172.21.15.103:0/91995120 shutdown_connections 2020-04-22T14:02:35.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.215+0000 7ffa24808700 1 -- 172.21.15.103:0/91995120 >> 172.21.15.103:0/91995120 conn(0x7ffa2005ad30 msgr2=0x7ffa200b3390 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:35.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.215+0000 7ffa24808700 1 -- 172.21.15.103:0/91995120 shutdown_connections 2020-04-22T14:02:35.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.215+0000 7ffa24808700 1 -- 172.21.15.103:0/91995120 wait complete. 2020-04-22T14:02:35.224 INFO:teuthology.orchestra.run.smithi103.stdout:60129542149 2020-04-22T14:02:35.229 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.0 2020-04-22T14:02:35.229 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:35.243 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.1 2020-04-22T14:02:35.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.390+0000 7fa7c7033700 1 Processor -- start 2020-04-22T14:02:35.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.390+0000 7fa7c7033700 1 -- start start 2020-04-22T14:02:35.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.391+0000 7fa7c7033700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa7c00af280 0x7fa7c0142400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:35.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.391+0000 7fa7c7033700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7c00b3a60 con 0x7fa7c01465f0 2020-04-22T14:02:35.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.391+0000 7fa7c7033700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7c00b4ea0 con 0x7fa7c0146210 2020-04-22T14:02:35.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.391+0000 7fa7c7033700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7c00adad0 con 0x7fa7c00af280 2020-04-22T14:02:35.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.391+0000 7fa7c4dcf700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa7c0146210 0x7fa7c0141cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39504/0 (socket says 172.21.15.103:39504) 2020-04-22T14:02:35.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.391+0000 7fa7c4dcf700 1 -- 172.21.15.103:0/1032191402 learned_addr learned my addr 172.21.15.103:0/1032191402 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:35.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.391+0000 7fa7bf7fe700 1 -- 172.21.15.103:0/1032191402 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2067362822 0 0) 0x7fa7c00b4ea0 con 0x7fa7c0146210 2020-04-22T14:02:35.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.391+0000 7fa7bf7fe700 1 -- 172.21.15.103:0/1032191402 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7ac003230 con 0x7fa7c0146210 2020-04-22T14:02:35.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.391+0000 7fa7bffff700 1 --2- 172.21.15.103:0/1032191402 >> v2:172.21.15.86:3300/0 conn(0x7fa7c00af280 0x7fa7c0142400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:35.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.391+0000 7fa7bf7fe700 1 -- 172.21.15.103:0/1032191402 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1271622387 0 0) 0x7fa7ac003230 con 0x7fa7c0146210 2020-04-22T14:02:35.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.391+0000 7fa7bf7fe700 1 -- 172.21.15.103:0/1032191402 >> v2:172.21.15.86:3300/0 conn(0x7fa7c00af280 msgr2=0x7fa7c0142400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:35.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.391+0000 7fa7bf7fe700 1 --2- 172.21.15.103:0/1032191402 >> v2:172.21.15.86:3300/0 conn(0x7fa7c00af280 0x7fa7c0142400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:35.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.391+0000 7fa7bf7fe700 1 -- 172.21.15.103:0/1032191402 >> v1:172.21.15.86:6789/0 conn(0x7fa7c01465f0 legacy=0x7fa7c00ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:35.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.391+0000 7fa7bf7fe700 1 -- 172.21.15.103:0/1032191402 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c00add70 con 0x7fa7c0146210 2020-04-22T14:02:35.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.391+0000 7fa7bf7fe700 1 -- 172.21.15.103:0/1032191402 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fa7b00016d0 con 0x7fa7c0146210 2020-04-22T14:02:35.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.391+0000 7fa7bffff700 1 --2- 172.21.15.103:0/1032191402 >> v2:172.21.15.86:3300/0 conn(0x7fa7c00af280 0x7fa7c0142400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:02:35.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.391+0000 7fa7bf7fe700 1 -- 172.21.15.103:0/1032191402 >> v1:172.21.15.103:6789/0 conn(0x7fa7c0146210 legacy=0x7fa7c0141cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:35.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.391+0000 7fa7bf7fe700 1 --2- 172.21.15.103:0/1032191402 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7ac003720 0x7fa7ac003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:35.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.391+0000 7fa7bf7fe700 1 --2- 172.21.15.103:0/1032191402 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7ac0044d0 0x7fa7ac004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:35.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.391+0000 7fa7bf7fe700 1 --2- 172.21.15.103:0/1032191402 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7ac004db0 0x7fa7ac00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:35.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.391+0000 7fa7bf7fe700 1 -- 172.21.15.103:0/1032191402 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c00adad0 con 0x7fa7ac003720 2020-04-22T14:02:35.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.391+0000 7fa7bf7fe700 1 -- 172.21.15.103:0/1032191402 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac0041c0 con 0x7fa7ac004db0 2020-04-22T14:02:35.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.391+0000 7fa7bf7fe700 1 -- 172.21.15.103:0/1032191402 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac00dd90 con 0x7fa7ac0044d0 2020-04-22T14:02:35.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.391+0000 7fa7c55d0700 1 --2- 172.21.15.103:0/1032191402 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7ac004db0 0x7fa7ac00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:35.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.391+0000 7fa7c4dcf700 1 --2- 172.21.15.103:0/1032191402 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7ac003720 0x7fa7ac003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:35.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.391+0000 7fa7bffff700 1 --2- 172.21.15.103:0/1032191402 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7ac0044d0 0x7fa7ac004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:35.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.392+0000 7fa7c55d0700 1 -- 172.21.15.103:0/1032191402 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7ac0044d0 msgr2=0x7fa7ac004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:35.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.392+0000 7fa7c55d0700 1 --2- 172.21.15.103:0/1032191402 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7ac0044d0 0x7fa7ac004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:35.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.392+0000 7fa7c55d0700 1 -- 172.21.15.103:0/1032191402 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7ac003720 msgr2=0x7fa7ac003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:35.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.392+0000 7fa7c55d0700 1 --2- 172.21.15.103:0/1032191402 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7ac003720 0x7fa7ac003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:35.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.392+0000 7fa7c55d0700 1 -- 172.21.15.103:0/1032191402 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ac003230 con 0x7fa7ac004db0 2020-04-22T14:02:35.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.392+0000 7fa7c55d0700 1 --2- 172.21.15.103:0/1032191402 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7ac004db0 0x7fa7ac00b720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa7ac0054a0 tx=0x7fa7b80100a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:35.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.392+0000 7fa7c55d0700 1 -- 172.21.15.103:0/1032191402 reap_dead start 2020-04-22T14:02:35.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.392+0000 7fa7c55d0700 1 --2- 172.21.15.103:0/1032191402 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7ac004db0 0x7fa7ac00b720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa7ac0054a0 tx=0x7fa7b80100a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:35.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.392+0000 7fa7c55d0700 1 --2- 172.21.15.103:0/1032191402 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7ac004db0 0x7fa7ac00b720 secure :-1 s=READY pgs=146 cs=0 l=1 rx=0x7fa7ac0054a0 tx=0x7fa7b80100a0).ready entity=mon.1 client_cookie=93b8d4be484d5da3 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:35.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.392+0000 7fa7c55d0700 1 --2- 172.21.15.103:0/1032191402 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7ac004db0 0x7fa7ac00b720 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7fa7ac0054a0 tx=0x7fa7b80100a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:35.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.392+0000 7fa7bf7fe700 1 -- 172.21.15.103:0/1032191402 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7b8006c40 con 0x7fa7ac004db0 2020-04-22T14:02:35.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.392+0000 7fa7c55d0700 1 --2- 172.21.15.103:0/1032191402 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7ac004db0 0x7fa7ac00b720 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7fa7ac0054a0 tx=0x7fa7b80100a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:35.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.392+0000 7fa7c55d0700 1 --2- 172.21.15.103:0/1032191402 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7ac004db0 0x7fa7ac00b720 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7fa7ac0054a0 tx=0x7fa7b80100a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:35.451 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.392+0000 7fa7bf7fe700 1 -- 172.21.15.103:0/1032191402 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b8006da0 con 0x7fa7ac004db0 2020-04-22T14:02:35.451 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.392+0000 7fa7bf7fe700 1 -- 172.21.15.103:0/1032191402 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7b8002640 con 0x7fa7ac004db0 2020-04-22T14:02:35.451 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.392+0000 7fa7c7033700 1 -- 172.21.15.103:0/1032191402 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7ac004db0 msgr2=0x7fa7ac00b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:35.451 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.392+0000 7fa7c7033700 1 --2- 172.21.15.103:0/1032191402 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7ac004db0 0x7fa7ac00b720 secure :-1 s=READY pgs=146 cs=0 l=1 rx=0x7fa7ac0054a0 tx=0x7fa7b80100a0).stop 2020-04-22T14:02:35.451 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.393+0000 7fa7c7033700 1 -- 172.21.15.103:0/1032191402 shutdown_connections 2020-04-22T14:02:35.451 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.393+0000 7fa7c7033700 1 --2- 172.21.15.103:0/1032191402 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7ac004db0 0x7fa7ac00b720 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:35.452 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.393+0000 7fa7c7033700 1 -- 172.21.15.103:0/1032191402 >> 172.21.15.103:0/1032191402 conn(0x7fa7c00b86b0 msgr2=0x7fa7c00b8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:35.452 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.393+0000 7fa7c7033700 1 -- 172.21.15.103:0/1032191402 shutdown_connections 2020-04-22T14:02:35.452 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.393+0000 7fa7c7033700 1 -- 172.21.15.103:0/1032191402 wait complete. 2020-04-22T14:02:35.452 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.394+0000 7fa7c7033700 1 Processor -- start 2020-04-22T14:02:35.452 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.394+0000 7fa7c7033700 1 -- start start 2020-04-22T14:02:35.452 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.394+0000 7fa7c7033700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa7ac004db0 0x7fa7c0066330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:35.452 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.394+0000 7fa7c7033700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7c00626c0 0x7fa7c01442d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:35.453 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.394+0000 7fa7c7033700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7c00660f0 con 0x7fa7c00653b0 2020-04-22T14:02:35.453 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.394+0000 7fa7c7033700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7c0062c40 con 0x7fa7ac004db0 2020-04-22T14:02:35.453 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.394+0000 7fa7c7033700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c0065c50 con 0x7fa7c00626c0 2020-04-22T14:02:35.453 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.395+0000 7fa7bffff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa7c00653b0 0x7fa7c0140f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39518/0 (socket says 172.21.15.103:39518) 2020-04-22T14:02:35.454 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.395+0000 7fa7bffff700 1 -- 172.21.15.103:0/3309429570 learned_addr learned my addr 172.21.15.103:0/3309429570 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:35.454 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.395+0000 7fa7c4dcf700 1 --2- 172.21.15.103:0/3309429570 >> v2:172.21.15.86:3300/0 conn(0x7fa7ac004db0 0x7fa7c0066330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:35.454 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.395+0000 7fa7c55d0700 1 --2- 172.21.15.103:0/3309429570 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7c00626c0 0x7fa7c01442d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:35.455 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.395+0000 7fa7bdffb700 1 -- 172.21.15.103:0/3309429570 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3648860825 0 0) 0x7fa7c00660f0 con 0x7fa7c00653b0 2020-04-22T14:02:35.455 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.395+0000 7fa7bdffb700 1 -- 172.21.15.103:0/3309429570 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7a0002fe0 con 0x7fa7c00653b0 2020-04-22T14:02:35.456 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.395+0000 7fa7c4dcf700 1 -- 172.21.15.103:0/3309429570 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7c00626c0 msgr2=0x7fa7c01442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:35.456 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.395+0000 7fa7c4dcf700 1 --2- 172.21.15.103:0/3309429570 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7c00626c0 0x7fa7c01442d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:35.456 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.395+0000 7fa7c4dcf700 1 -- 172.21.15.103:0/3309429570 >> v1:172.21.15.103:6789/0 conn(0x7fa7c00653b0 legacy=0x7fa7c0140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:35.456 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.395+0000 7fa7c4dcf700 1 -- 172.21.15.103:0/3309429570 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c014f260 con 0x7fa7ac004db0 2020-04-22T14:02:35.456 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.395+0000 7fa7c4dcf700 1 --2- 172.21.15.103:0/3309429570 >> v2:172.21.15.86:3300/0 conn(0x7fa7ac004db0 0x7fa7c0066330 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa7b00013e0 tx=0x7fa7b0009460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:35.457 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.395+0000 7fa7c4dcf700 1 --2- 172.21.15.103:0/3309429570 >> v2:172.21.15.86:3300/0 conn(0x7fa7ac004db0 0x7fa7c0066330 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa7b00013e0 tx=0x7fa7b0009460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:35.457 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.395+0000 7fa7c4dcf700 1 --2- 172.21.15.103:0/3309429570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7ac004db0 0x7fa7c0066330 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7fa7b00013e0 tx=0x7fa7b0009460).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:35.457 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.395+0000 7fa7c4dcf700 1 --2- 172.21.15.103:0/3309429570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7ac004db0 0x7fa7c0066330 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fa7b00013e0 tx=0x7fa7b0009460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:35.457 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.395+0000 7fa7bdffb700 1 -- 172.21.15.103:0/3309429570 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7b000cbe0 con 0x7fa7ac004db0 2020-04-22T14:02:35.457 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.395+0000 7fa7c4dcf700 1 --2- 172.21.15.103:0/3309429570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7ac004db0 0x7fa7c0066330 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fa7b00013e0 tx=0x7fa7b0009460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:35.457 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.395+0000 7fa7bdffb700 1 -- 172.21.15.103:0/3309429570 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b000cd40 con 0x7fa7ac004db0 2020-04-22T14:02:35.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.395+0000 7fa7c7033700 1 -- 172.21.15.103:0/3309429570 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7c0065860 con 0x7fa7ac004db0 2020-04-22T14:02:35.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.395+0000 7fa7c4dcf700 1 --2- 172.21.15.103:0/3309429570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7ac004db0 0x7fa7c0066330 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fa7b00013e0 tx=0x7fa7b0009460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:35.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.395+0000 7fa7bdffb700 1 -- 172.21.15.103:0/3309429570 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7b0012930 con 0x7fa7ac004db0 2020-04-22T14:02:35.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.395+0000 7fa7c7033700 1 -- 172.21.15.103:0/3309429570 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7c0144730 con 0x7fa7ac004db0 2020-04-22T14:02:35.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.396+0000 7fa7c4dcf700 1 --2- 172.21.15.103:0/3309429570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7ac004db0 0x7fa7c0066330 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fa7b00013e0 tx=0x7fa7b0009460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:35.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.396+0000 7fa7c7033700 1 -- 172.21.15.103:0/3309429570 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7c0056c90 con 0x7fa7ac004db0 2020-04-22T14:02:35.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.396+0000 7fa7bdffb700 1 -- 172.21.15.103:0/3309429570 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fa7b0013070 con 0x7fa7ac004db0 2020-04-22T14:02:35.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.396+0000 7fa7c4dcf700 1 --2- 172.21.15.103:0/3309429570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7ac004db0 0x7fa7c0066330 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fa7b00013e0 tx=0x7fa7b0009460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:35.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.397+0000 7fa7bdffb700 1 --2- 172.21.15.103:0/3309429570 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa7a004dc60 0x7fa7a0050120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:35.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.397+0000 7fa7bdffb700 1 -- 172.21.15.103:0/3309429570 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa7b0060fd0 con 0x7fa7ac004db0 2020-04-22T14:02:35.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.397+0000 7fa7bffff700 1 --2- 172.21.15.103:0/3309429570 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa7a004dc60 0x7fa7a0050120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:35.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.397+0000 7fa7bffff700 1 --2- 172.21.15.103:0/3309429570 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa7a004dc60 0x7fa7a0050120 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa7b40080d0 tx=0x7fa7b4007c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:35.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.397+0000 7fa7bffff700 1 --2- 172.21.15.103:0/3309429570 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa7a004dc60 0x7fa7a0050120 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa7b40080d0 tx=0x7fa7b4007c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:35.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.397+0000 7fa7bffff700 1 --2- 172.21.15.103:0/3309429570 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa7a004dc60 0x7fa7a0050120 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7fa7b40080d0 tx=0x7fa7b4007c80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:35.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.400+0000 7fa7c4dcf700 1 --2- 172.21.15.103:0/3309429570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7ac004db0 0x7fa7c0066330 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fa7b00013e0 tx=0x7fa7b0009460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:35.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.400+0000 7fa7bdffb700 1 -- 172.21.15.103:0/3309429570 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fa7b003c410 con 0x7fa7ac004db0 2020-04-22T14:02:35.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.542+0000 7fa7c7033700 1 -- 172.21.15.103:0/3309429570 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa7c0065dc0 con 0x7fa7ac004db0 2020-04-22T14:02:35.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.542+0000 7fa7c4dcf700 1 --2- 172.21.15.103:0/3309429570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7ac004db0 0x7fa7c0066330 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fa7b00013e0 tx=0x7fa7b0009460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:35.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.542+0000 7fa7bdffb700 1 -- 172.21.15.103:0/3309429570 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa7b003fa30 con 0x7fa7ac004db0 2020-04-22T14:02:35.546 INFO:teuthology.orchestra.run.smithi103.stdout:60129542149 2020-04-22T14:02:35.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.544+0000 7fa7c7033700 1 -- 172.21.15.103:0/3309429570 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa7a004dc60 msgr2=0x7fa7a0050120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:35.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.544+0000 7fa7c7033700 1 --2- 172.21.15.103:0/3309429570 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa7a004dc60 0x7fa7a0050120 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7fa7b40080d0 tx=0x7fa7b4007c80).stop 2020-04-22T14:02:35.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.544+0000 7fa7c7033700 1 -- 172.21.15.103:0/3309429570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7ac004db0 msgr2=0x7fa7c0066330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:35.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.544+0000 7fa7c7033700 1 --2- 172.21.15.103:0/3309429570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7ac004db0 0x7fa7c0066330 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7fa7b00013e0 tx=0x7fa7b0009460).stop 2020-04-22T14:02:35.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.544+0000 7fa7c7033700 1 -- 172.21.15.103:0/3309429570 shutdown_connections 2020-04-22T14:02:35.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.544+0000 7fa7c7033700 1 --2- 172.21.15.103:0/3309429570 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7c00626c0 0x7fa7c01442d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:35.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.544+0000 7fa7c7033700 1 --2- 172.21.15.103:0/3309429570 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa7a004dc60 0x7fa7a0050120 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:35.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.544+0000 7fa7c7033700 1 --2- 172.21.15.103:0/3309429570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7ac004db0 0x7fa7c0066330 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:35.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.544+0000 7fa7c7033700 1 -- 172.21.15.103:0/3309429570 >> 172.21.15.103:0/3309429570 conn(0x7fa7c00b86b0 msgr2=0x7fa7c00b3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:35.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.544+0000 7fa7c7033700 1 -- 172.21.15.103:0/3309429570 shutdown_connections 2020-04-22T14:02:35.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:35.544+0000 7fa7c7033700 1 -- 172.21.15.103:0/3309429570 wait complete. 2020-04-22T14:02:35.558 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.1 2020-04-22T14:02:36.559 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:36.579 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.1 2020-04-22T14:02:36.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.732+0000 7f6db7089700 1 Processor -- start 2020-04-22T14:02:36.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.732+0000 7f6db7089700 1 -- start start 2020-04-22T14:02:36.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.733+0000 7f6db7089700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6db00b4320 0x7f6db00b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:36.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.733+0000 7f6db7089700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6db00b4700 0x7f6db00b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:36.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.733+0000 7f6db7089700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6db00b0e90 con 0x7f6db00b2530 2020-04-22T14:02:36.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.733+0000 7f6db7089700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6db00b2a90 con 0x7f6db00b4320 2020-04-22T14:02:36.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.733+0000 7f6db7089700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db00b1130 con 0x7f6db00b4700 2020-04-22T14:02:36.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.733+0000 7f6db4e25700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6db00b4320 0x7f6db00b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:36.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.733+0000 7f6db4e25700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6db00b4320 0x7f6db00b15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47334/0 (socket says 172.21.15.103:47334) 2020-04-22T14:02:36.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.733+0000 7f6db4e25700 1 -- 172.21.15.103:0/421079668 learned_addr learned my addr 172.21.15.103:0/421079668 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:36.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.733+0000 7f6daffff700 1 --2- 172.21.15.103:0/421079668 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6db00b4700 0x7f6db00b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:36.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.733+0000 7f6db4e25700 1 -- 172.21.15.103:0/421079668 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6db00b4700 msgr2=0x7f6db00b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:36.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.733+0000 7f6db4e25700 1 --2- 172.21.15.103:0/421079668 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6db00b4700 0x7f6db00b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:36.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.733+0000 7f6db4e25700 1 -- 172.21.15.103:0/421079668 >> v1:172.21.15.86:6789/0 conn(0x7f6db00b2530 legacy=0x7f6db00afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:36.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.733+0000 7f6db4e25700 1 -- 172.21.15.103:0/421079668 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db00ae500 con 0x7f6db00b4320 2020-04-22T14:02:36.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.733+0000 7f6db4e25700 1 --2- 172.21.15.103:0/421079668 >> v2:172.21.15.103:3300/0 conn(0x7f6db00b4320 0x7f6db00b15d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6db00b1ec0 tx=0x7f6da00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:36.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.734+0000 7f6db4e25700 1 --2- 172.21.15.103:0/421079668 >> v2:172.21.15.103:3300/0 conn(0x7f6db00b4320 0x7f6db00b15d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6db00b1ec0 tx=0x7f6da00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:36.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.734+0000 7f6db4e25700 1 --2- 172.21.15.103:0/421079668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db00b4320 0x7f6db00b15d0 secure :-1 s=READY pgs=148 cs=0 l=1 rx=0x7f6db00b1ec0 tx=0x7f6da00088e0).ready entity=mon.1 client_cookie=a6a2f1d58cdce055 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:36.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.734+0000 7f6db4e25700 1 --2- 172.21.15.103:0/421079668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db00b4320 0x7f6db00b15d0 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7f6db00b1ec0 tx=0x7f6da00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:36.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.734+0000 7f6daf7fe700 1 -- 172.21.15.103:0/421079668 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6da0011670 con 0x7f6db00b4320 2020-04-22T14:02:36.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.734+0000 7f6db4e25700 1 --2- 172.21.15.103:0/421079668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db00b4320 0x7f6db00b15d0 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7f6db00b1ec0 tx=0x7f6da00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:36.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.734+0000 7f6db4e25700 1 --2- 172.21.15.103:0/421079668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db00b4320 0x7f6db00b15d0 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7f6db00b1ec0 tx=0x7f6da00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:36.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.734+0000 7f6daf7fe700 1 -- 172.21.15.103:0/421079668 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da0011810 con 0x7f6db00b4320 2020-04-22T14:02:36.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.734+0000 7f6daf7fe700 1 -- 172.21.15.103:0/421079668 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6da0011c30 con 0x7f6db00b4320 2020-04-22T14:02:36.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.734+0000 7f6db7089700 1 -- 172.21.15.103:0/421079668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db00b4320 msgr2=0x7f6db00b15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:36.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.734+0000 7f6db7089700 1 --2- 172.21.15.103:0/421079668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db00b4320 0x7f6db00b15d0 secure :-1 s=READY pgs=148 cs=0 l=1 rx=0x7f6db00b1ec0 tx=0x7f6da00088e0).stop 2020-04-22T14:02:36.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.734+0000 7f6db7089700 1 -- 172.21.15.103:0/421079668 shutdown_connections 2020-04-22T14:02:36.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.734+0000 7f6db7089700 1 --2- 172.21.15.103:0/421079668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db00b4320 0x7f6db00b15d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:36.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.734+0000 7f6db7089700 1 --2- 172.21.15.103:0/421079668 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6db00b4700 0x7f6db00b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:36.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.734+0000 7f6db7089700 1 -- 172.21.15.103:0/421079668 >> 172.21.15.103:0/421079668 conn(0x7f6db00b86b0 msgr2=0x7f6db00b8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:36.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.734+0000 7f6db7089700 1 -- 172.21.15.103:0/421079668 shutdown_connections 2020-04-22T14:02:36.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.734+0000 7f6db7089700 1 -- 172.21.15.103:0/421079668 wait complete. 2020-04-22T14:02:36.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.735+0000 7f6db7089700 1 Processor -- start 2020-04-22T14:02:36.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.735+0000 7f6db7089700 1 -- start start 2020-04-22T14:02:36.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.736+0000 7f6db7089700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6db00b2530 0x7f6db01456a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:36.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.736+0000 7f6db7089700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6db00b4320 0x7f6db0062b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:36.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.736+0000 7f6db7089700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6db00630f0 con 0x7f6db00b4700 2020-04-22T14:02:36.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.736+0000 7f6db7089700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6db0063390 con 0x7f6db00b4320 2020-04-22T14:02:36.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.736+0000 7f6db7089700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db0063630 con 0x7f6db00b2530 2020-04-22T14:02:36.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.736+0000 7f6daffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6db00b4320 0x7f6db0062b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:36.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.736+0000 7f6daffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6db00b4320 0x7f6db0062b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47342/0 (socket says 172.21.15.103:47342) 2020-04-22T14:02:36.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.736+0000 7f6daffff700 1 -- 172.21.15.103:0/264400383 learned_addr learned my addr 172.21.15.103:0/264400383 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:36.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.736+0000 7f6db4e25700 1 --2- 172.21.15.103:0/264400383 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6db00b2530 0x7f6db01456a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:36.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.736+0000 7f6daffff700 1 -- 172.21.15.103:0/264400383 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6db00b2530 msgr2=0x7f6db01456a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:36.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.736+0000 7f6daffff700 1 --2- 172.21.15.103:0/264400383 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6db00b2530 0x7f6db01456a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:36.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.736+0000 7f6daffff700 1 -- 172.21.15.103:0/264400383 >> v1:172.21.15.86:6789/0 conn(0x7f6db00b4700 legacy=0x7f6db0135ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:36.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.736+0000 7f6daffff700 1 -- 172.21.15.103:0/264400383 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db01365f0 con 0x7f6db00b4320 2020-04-22T14:02:36.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.736+0000 7f6db4e25700 1 --2- 172.21.15.103:0/264400383 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6db00b2530 0x7f6db01456a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:02:36.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.736+0000 7f6daffff700 1 --2- 172.21.15.103:0/264400383 >> v2:172.21.15.103:3300/0 conn(0x7f6db00b4320 0x7f6db0062b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6db0065db0 tx=0x7f6da4010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:36.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.737+0000 7f6daffff700 1 --2- 172.21.15.103:0/264400383 >> v2:172.21.15.103:3300/0 conn(0x7f6db00b4320 0x7f6db0062b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6db0065db0 tx=0x7f6da4010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:36.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.737+0000 7f6daffff700 1 --2- 172.21.15.103:0/264400383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db00b4320 0x7f6db0062b70 secure :-1 s=READY pgs=149 cs=0 l=1 rx=0x7f6db0065db0 tx=0x7f6da4010d80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:36.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.737+0000 7f6daffff700 1 --2- 172.21.15.103:0/264400383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db00b4320 0x7f6db0062b70 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f6db0065db0 tx=0x7f6da4010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:36.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.737+0000 7f6dadffb700 1 -- 172.21.15.103:0/264400383 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6da4005e90 con 0x7f6db00b4320 2020-04-22T14:02:36.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.737+0000 7f6daffff700 1 --2- 172.21.15.103:0/264400383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db00b4320 0x7f6db0062b70 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f6db0065db0 tx=0x7f6da4010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:36.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.737+0000 7f6daffff700 1 --2- 172.21.15.103:0/264400383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db00b4320 0x7f6db0062b70 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f6db0065db0 tx=0x7f6da4010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:36.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.737+0000 7f6dadffb700 1 -- 172.21.15.103:0/264400383 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da4007180 con 0x7f6db00b4320 2020-04-22T14:02:36.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.737+0000 7f6db7089700 1 -- 172.21.15.103:0/264400383 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6db01367e0 con 0x7f6db00b4320 2020-04-22T14:02:36.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.737+0000 7f6dadffb700 1 -- 172.21.15.103:0/264400383 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6da4012360 con 0x7f6db00b4320 2020-04-22T14:02:36.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.737+0000 7f6db7089700 1 -- 172.21.15.103:0/264400383 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db013faf0 con 0x7f6db00b4320 2020-04-22T14:02:36.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.737+0000 7f6daffff700 1 --2- 172.21.15.103:0/264400383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db00b4320 0x7f6db0062b70 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f6db0065db0 tx=0x7f6da4010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:36.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.738+0000 7f6db7089700 1 -- 172.21.15.103:0/264400383 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db0056c90 con 0x7f6db00b4320 2020-04-22T14:02:36.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.738+0000 7f6dadffb700 1 -- 172.21.15.103:0/264400383 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f6da40124c0 con 0x7f6db00b4320 2020-04-22T14:02:36.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.738+0000 7f6daffff700 1 --2- 172.21.15.103:0/264400383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db00b4320 0x7f6db0062b70 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f6db0065db0 tx=0x7f6da4010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:36.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.738+0000 7f6dadffb700 1 --2- 172.21.15.103:0/264400383 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6d9004da70 0x7f6d9004ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:36.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.738+0000 7f6dadffb700 1 -- 172.21.15.103:0/264400383 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6da4061af0 con 0x7f6db00b4320 2020-04-22T14:02:36.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.738+0000 7f6db4e25700 1 --2- 172.21.15.103:0/264400383 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6d9004da70 0x7f6d9004ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:36.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.738+0000 7f6db4e25700 1 --2- 172.21.15.103:0/264400383 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6d9004da70 0x7f6d9004ff30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6db00b1ec0 tx=0x7f6db00ae690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:36.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.739+0000 7f6db4e25700 1 --2- 172.21.15.103:0/264400383 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6d9004da70 0x7f6d9004ff30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6db00b1ec0 tx=0x7f6db00ae690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:36.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.739+0000 7f6db4e25700 1 --2- 172.21.15.103:0/264400383 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6d9004da70 0x7f6d9004ff30 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f6db00b1ec0 tx=0x7f6db00ae690).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:36.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.742+0000 7f6daffff700 1 --2- 172.21.15.103:0/264400383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db00b4320 0x7f6db0062b70 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f6db0065db0 tx=0x7f6da4010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:36.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.742+0000 7f6dadffb700 1 -- 172.21.15.103:0/264400383 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f6da403ce70 con 0x7f6db00b4320 2020-04-22T14:02:36.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.885+0000 7f6db7089700 1 -- 172.21.15.103:0/264400383 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6db00637a0 con 0x7f6db00b4320 2020-04-22T14:02:36.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.885+0000 7f6daffff700 1 --2- 172.21.15.103:0/264400383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db00b4320 0x7f6db0062b70 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f6db0065db0 tx=0x7f6da4010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:36.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.885+0000 7f6dadffb700 1 -- 172.21.15.103:0/264400383 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6da4040490 con 0x7f6db00b4320 2020-04-22T14:02:36.890 INFO:teuthology.orchestra.run.smithi103.stdout:60129542150 2020-04-22T14:02:36.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.886+0000 7f6db7089700 1 -- 172.21.15.103:0/264400383 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6d9004da70 msgr2=0x7f6d9004ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:36.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.886+0000 7f6db7089700 1 --2- 172.21.15.103:0/264400383 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6d9004da70 0x7f6d9004ff30 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f6db00b1ec0 tx=0x7f6db00ae690).stop 2020-04-22T14:02:36.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.886+0000 7f6db7089700 1 -- 172.21.15.103:0/264400383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db00b4320 msgr2=0x7f6db0062b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:36.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.887+0000 7f6db7089700 1 --2- 172.21.15.103:0/264400383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db00b4320 0x7f6db0062b70 secure :-1 s=READY pgs=149 cs=0 l=1 rx=0x7f6db0065db0 tx=0x7f6da4010d80).stop 2020-04-22T14:02:36.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.887+0000 7f6db7089700 1 -- 172.21.15.103:0/264400383 shutdown_connections 2020-04-22T14:02:36.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.887+0000 7f6db7089700 1 --2- 172.21.15.103:0/264400383 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6d9004da70 0x7f6d9004ff30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:36.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.887+0000 7f6db7089700 1 --2- 172.21.15.103:0/264400383 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6db00b2530 0x7f6db01456a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:36.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.887+0000 7f6db7089700 1 --2- 172.21.15.103:0/264400383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db00b4320 0x7f6db0062b70 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:36.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.887+0000 7f6db7089700 1 -- 172.21.15.103:0/264400383 >> 172.21.15.103:0/264400383 conn(0x7f6db00b86b0 msgr2=0x7f6db00b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:36.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.887+0000 7f6db7089700 1 -- 172.21.15.103:0/264400383 shutdown_connections 2020-04-22T14:02:36.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:36.887+0000 7f6db7089700 1 -- 172.21.15.103:0/264400383 wait complete. 2020-04-22T14:02:36.899 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.1 2020-04-22T14:02:36.900 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:36.913 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.2 2020-04-22T14:02:37.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.056+0000 7f9cd6ff4700 1 Processor -- start 2020-04-22T14:02:37.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.056+0000 7f9cd6ff4700 1 -- start start 2020-04-22T14:02:37.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.057+0000 7f9cd6ff4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9cd00b4320 0x7f9cd00b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:37.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.057+0000 7f9cd6ff4700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9cd00b4700 0x7f9cd00b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:37.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.057+0000 7f9cd6ff4700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cd00b0e90 con 0x7f9cd00b2530 2020-04-22T14:02:37.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.057+0000 7f9cd6ff4700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cd00b2a90 con 0x7f9cd00b4700 2020-04-22T14:02:37.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.057+0000 7f9cd6ff4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd00b1130 con 0x7f9cd00b4320 2020-04-22T14:02:37.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.057+0000 7f9ccffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9cd00b4700 0x7f9cd00b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:37.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.057+0000 7f9ccffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9cd00b4700 0x7f9cd00b1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47350/0 (socket says 172.21.15.103:47350) 2020-04-22T14:02:37.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.057+0000 7f9ccffff700 1 -- 172.21.15.103:0/1592530490 learned_addr learned my addr 172.21.15.103:0/1592530490 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:37.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.058+0000 7f9cd4d90700 1 --2- 172.21.15.103:0/1592530490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9cd00b4320 0x7f9cd00b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:37.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.058+0000 7f9ccffff700 1 -- 172.21.15.103:0/1592530490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9cd00b4320 msgr2=0x7f9cd00b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:37.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.058+0000 7f9ccffff700 1 --2- 172.21.15.103:0/1592530490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9cd00b4320 0x7f9cd00b15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:37.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.058+0000 7f9ccffff700 1 -- 172.21.15.103:0/1592530490 >> v1:172.21.15.86:6789/0 conn(0x7f9cd00b2530 legacy=0x7f9cd00afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:37.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.058+0000 7f9ccffff700 1 -- 172.21.15.103:0/1592530490 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd00ae500 con 0x7f9cd00b4700 2020-04-22T14:02:37.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.058+0000 7f9ccffff700 1 --2- 172.21.15.103:0/1592530490 >> v2:172.21.15.103:3300/0 conn(0x7f9cd00b4700 0x7f9cd00b1a30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9cc4002f30 tx=0x7f9cc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.058+0000 7f9ccffff700 1 --2- 172.21.15.103:0/1592530490 >> v2:172.21.15.103:3300/0 conn(0x7f9cd00b4700 0x7f9cd00b1a30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9cc4002f30 tx=0x7f9cc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.070 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.058+0000 7f9ccffff700 1 --2- 172.21.15.103:0/1592530490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cd00b4700 0x7f9cd00b1a30 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7f9cc4002f30 tx=0x7f9cc4007a40).ready entity=mon.1 client_cookie=2812b9042a17338f server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:37.070 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.058+0000 7f9ccffff700 1 --2- 172.21.15.103:0/1592530490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cd00b4700 0x7f9cd00b1a30 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f9cc4002f30 tx=0x7f9cc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.070 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.058+0000 7f9ccffff700 1 --2- 172.21.15.103:0/1592530490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cd00b4700 0x7f9cd00b1a30 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f9cc4002f30 tx=0x7f9cc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.070 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.058+0000 7f9ccf7fe700 1 -- 172.21.15.103:0/1592530490 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9cc4011720 con 0x7f9cd00b4700 2020-04-22T14:02:37.070 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.058+0000 7f9ccffff700 1 --2- 172.21.15.103:0/1592530490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cd00b4700 0x7f9cd00b1a30 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f9cc4002f30 tx=0x7f9cc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.070 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.058+0000 7f9ccf7fe700 1 -- 172.21.15.103:0/1592530490 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc40118c0 con 0x7f9cd00b4700 2020-04-22T14:02:37.070 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.058+0000 7f9ccf7fe700 1 -- 172.21.15.103:0/1592530490 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9cc4011ce0 con 0x7f9cd00b4700 2020-04-22T14:02:37.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.058+0000 7f9cd6ff4700 1 -- 172.21.15.103:0/1592530490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cd00b4700 msgr2=0x7f9cd00b1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:37.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.058+0000 7f9cd6ff4700 1 --2- 172.21.15.103:0/1592530490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cd00b4700 0x7f9cd00b1a30 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7f9cc4002f30 tx=0x7f9cc4007a40).stop 2020-04-22T14:02:37.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.058+0000 7f9cd6ff4700 1 -- 172.21.15.103:0/1592530490 shutdown_connections 2020-04-22T14:02:37.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.058+0000 7f9cd6ff4700 1 --2- 172.21.15.103:0/1592530490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9cd00b4320 0x7f9cd00b15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:37.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.058+0000 7f9cd6ff4700 1 --2- 172.21.15.103:0/1592530490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cd00b4700 0x7f9cd00b1a30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:37.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.058+0000 7f9cd6ff4700 1 -- 172.21.15.103:0/1592530490 >> 172.21.15.103:0/1592530490 conn(0x7f9cd00b86b0 msgr2=0x7f9cd00b8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:37.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.058+0000 7f9cd6ff4700 1 -- 172.21.15.103:0/1592530490 shutdown_connections 2020-04-22T14:02:37.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.058+0000 7f9cd6ff4700 1 -- 172.21.15.103:0/1592530490 wait complete. 2020-04-22T14:02:37.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.059+0000 7f9cd6ff4700 1 Processor -- start 2020-04-22T14:02:37.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.059+0000 7f9cd6ff4700 1 -- start start 2020-04-22T14:02:37.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.060+0000 7f9cd6ff4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9cd00b2530 0x7f9cd0138be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:37.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.060+0000 7f9cd6ff4700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9cd00b4320 0x7f9cd0065dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:37.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.060+0000 7f9cd6ff4700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cd0066220 con 0x7f9cd00b4700 2020-04-22T14:02:37.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.060+0000 7f9cd6ff4700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cd014b6d0 con 0x7f9cd00b4320 2020-04-22T14:02:37.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.060+0000 7f9cd6ff4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd014b970 con 0x7f9cd00b2530 2020-04-22T14:02:37.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.060+0000 7f9cd4d90700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9cd00b2530 0x7f9cd0138be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:37.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.060+0000 7f9ccffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9cd00b4320 0x7f9cd0065dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:37.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.060+0000 7f9ccffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9cd00b4320 0x7f9cd0065dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:44588/0 (socket says 172.21.15.103:44588) 2020-04-22T14:02:37.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.060+0000 7f9cd4d90700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9cd00b2530 0x7f9cd0138be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:60364/0 (socket says 172.21.15.103:60364) 2020-04-22T14:02:37.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.060+0000 7f9ccffff700 1 -- 172.21.15.103:0/2628171093 learned_addr learned my addr 172.21.15.103:0/2628171093 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:37.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.061+0000 7f9ccffff700 1 -- 172.21.15.103:0/2628171093 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9cd00b2530 msgr2=0x7f9cd0138be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:37.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.061+0000 7f9ccffff700 1 --2- 172.21.15.103:0/2628171093 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9cd00b2530 0x7f9cd0138be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:37.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.061+0000 7f9ccffff700 1 -- 172.21.15.103:0/2628171093 >> v1:172.21.15.86:6789/0 conn(0x7f9cd00b4700 legacy=0x7f9cd01352b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:37.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.061+0000 7f9ccdffb700 1 -- 172.21.15.103:0/2628171093 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3197015812 0 0) 0x7f9cd00b0e90 con 0x7f9cd00b4700 2020-04-22T14:02:37.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.061+0000 7f9ccffff700 1 -- 172.21.15.103:0/2628171093 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd0147800 con 0x7f9cd00b4320 2020-04-22T14:02:37.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.061+0000 7f9cd4d90700 1 --2- 172.21.15.103:0/2628171093 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9cd00b2530 0x7f9cd0138be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:02:37.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.061+0000 7f9ccffff700 1 --2- 172.21.15.103:0/2628171093 >> v2:172.21.15.86:3300/0 conn(0x7f9cd00b4320 0x7f9cd0065dc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9cc4002f30 tx=0x7f9cc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.061+0000 7f9ccffff700 1 --2- 172.21.15.103:0/2628171093 >> v2:172.21.15.86:3300/0 conn(0x7f9cd00b4320 0x7f9cd0065dc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9cc4002f30 tx=0x7f9cc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.061+0000 7f9ccffff700 1 --2- 172.21.15.103:0/2628171093 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cd00b4320 0x7f9cd0065dc0 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7f9cc4002f30 tx=0x7f9cc4007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:37.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.061+0000 7f9ccffff700 1 --2- 172.21.15.103:0/2628171093 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cd00b4320 0x7f9cd0065dc0 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f9cc4002f30 tx=0x7f9cc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.061+0000 7f9ccdffb700 1 -- 172.21.15.103:0/2628171093 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9cc4011d60 con 0x7f9cd00b4320 2020-04-22T14:02:37.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.061+0000 7f9ccffff700 1 --2- 172.21.15.103:0/2628171093 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cd00b4320 0x7f9cd0065dc0 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f9cc4002f30 tx=0x7f9cc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.061+0000 7f9ccdffb700 1 -- 172.21.15.103:0/2628171093 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc4007360 con 0x7f9cd00b4320 2020-04-22T14:02:37.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.061+0000 7f9ccffff700 1 --2- 172.21.15.103:0/2628171093 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cd00b4320 0x7f9cd0065dc0 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f9cc4002f30 tx=0x7f9cc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.061+0000 7f9cd6ff4700 1 -- 172.21.15.103:0/2628171093 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cd01359c0 con 0x7f9cd00b4320 2020-04-22T14:02:37.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.061+0000 7f9ccdffb700 1 -- 172.21.15.103:0/2628171093 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9cc40056c0 con 0x7f9cd00b4320 2020-04-22T14:02:37.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.061+0000 7f9cd6ff4700 1 -- 172.21.15.103:0/2628171093 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cd014b2a0 con 0x7f9cd00b4320 2020-04-22T14:02:37.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.062+0000 7f9ccffff700 1 --2- 172.21.15.103:0/2628171093 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cd00b4320 0x7f9cd0065dc0 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f9cc4002f30 tx=0x7f9cc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.062+0000 7f9cd6ff4700 1 -- 172.21.15.103:0/2628171093 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cd0147990 con 0x7f9cd00b4320 2020-04-22T14:02:37.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.062+0000 7f9ccdffb700 1 -- 172.21.15.103:0/2628171093 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f9cc40058c0 con 0x7f9cd00b4320 2020-04-22T14:02:37.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.062+0000 7f9ccffff700 1 --2- 172.21.15.103:0/2628171093 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cd00b4320 0x7f9cd0065dc0 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f9cc4002f30 tx=0x7f9cc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.062+0000 7f9ccdffb700 1 --2- 172.21.15.103:0/2628171093 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9cb004d7f0 0x7f9cb004fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:37.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.063+0000 7f9ccdffb700 1 -- 172.21.15.103:0/2628171093 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9cc4061cc0 con 0x7f9cd00b4320 2020-04-22T14:02:37.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.063+0000 7f9cd4d90700 1 --2- 172.21.15.103:0/2628171093 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9cb004d7f0 0x7f9cb004fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:37.080 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.063+0000 7f9cd4d90700 1 --2- 172.21.15.103:0/2628171093 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9cb004d7f0 0x7f9cb004fcb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9cc0002f30 tx=0x7f9cc000b460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.080 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.063+0000 7f9cd4d90700 1 --2- 172.21.15.103:0/2628171093 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9cb004d7f0 0x7f9cb004fcb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9cc0002f30 tx=0x7f9cc000b460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.080 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.063+0000 7f9cd4d90700 1 --2- 172.21.15.103:0/2628171093 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9cb004d7f0 0x7f9cb004fcb0 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f9cc0002f30 tx=0x7f9cc000b460).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:37.081 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.066+0000 7f9ccffff700 1 --2- 172.21.15.103:0/2628171093 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cd00b4320 0x7f9cd0065dc0 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f9cc4002f30 tx=0x7f9cc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.081 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.066+0000 7f9ccdffb700 1 -- 172.21.15.103:0/2628171093 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f9cc403d160 con 0x7f9cd00b4320 2020-04-22T14:02:37.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.208+0000 7f9cd6ff4700 1 -- 172.21.15.103:0/2628171093 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9cd0056c90 con 0x7f9cd00b4320 2020-04-22T14:02:37.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.209+0000 7f9ccffff700 1 --2- 172.21.15.103:0/2628171093 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cd00b4320 0x7f9cd0065dc0 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f9cc4002f30 tx=0x7f9cc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.209+0000 7f9ccdffb700 1 -- 172.21.15.103:0/2628171093 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9cc4040780 con 0x7f9cd00b4320 2020-04-22T14:02:37.212 INFO:teuthology.orchestra.run.smithi103.stdout:60129542149 2020-04-22T14:02:37.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.210+0000 7f9cd6ff4700 1 -- 172.21.15.103:0/2628171093 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9cb004d7f0 msgr2=0x7f9cb004fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:37.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.210+0000 7f9cd6ff4700 1 --2- 172.21.15.103:0/2628171093 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9cb004d7f0 0x7f9cb004fcb0 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f9cc0002f30 tx=0x7f9cc000b460).stop 2020-04-22T14:02:37.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.210+0000 7f9cd6ff4700 1 -- 172.21.15.103:0/2628171093 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cd00b4320 msgr2=0x7f9cd0065dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:37.216 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.210+0000 7f9cd6ff4700 1 --2- 172.21.15.103:0/2628171093 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cd00b4320 0x7f9cd0065dc0 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7f9cc4002f30 tx=0x7f9cc4007a40).stop 2020-04-22T14:02:37.216 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.210+0000 7f9cd6ff4700 1 -- 172.21.15.103:0/2628171093 shutdown_connections 2020-04-22T14:02:37.216 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.210+0000 7f9cd6ff4700 1 --2- 172.21.15.103:0/2628171093 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9cd00b2530 0x7f9cd0138be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:37.216 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.210+0000 7f9cd6ff4700 1 --2- 172.21.15.103:0/2628171093 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9cb004d7f0 0x7f9cb004fcb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:37.216 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.210+0000 7f9cd6ff4700 1 --2- 172.21.15.103:0/2628171093 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cd00b4320 0x7f9cd0065dc0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:37.216 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.210+0000 7f9cd6ff4700 1 -- 172.21.15.103:0/2628171093 >> 172.21.15.103:0/2628171093 conn(0x7f9cd00b86b0 msgr2=0x7f9cd005fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:37.216 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.210+0000 7f9cd6ff4700 1 -- 172.21.15.103:0/2628171093 shutdown_connections 2020-04-22T14:02:37.217 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.210+0000 7f9cd6ff4700 1 -- 172.21.15.103:0/2628171093 wait complete. 2020-04-22T14:02:37.223 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.2 2020-04-22T14:02:37.223 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:37.237 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.3 2020-04-22T14:02:37.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.382+0000 7faf79b0e700 1 Processor -- start 2020-04-22T14:02:37.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.382+0000 7faf79b0e700 1 -- start start 2020-04-22T14:02:37.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.383+0000 7faf79b0e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faf740b4320 0x7faf740b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:37.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.383+0000 7faf79b0e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7faf740b4700 0x7faf740b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:37.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.383+0000 7faf79b0e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf740b0e90 con 0x7faf740b2530 2020-04-22T14:02:37.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.383+0000 7faf79b0e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf740b2a90 con 0x7faf740b4700 2020-04-22T14:02:37.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.383+0000 7faf79b0e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf740b1130 con 0x7faf740b4320 2020-04-22T14:02:37.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.383+0000 7faf72ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7faf740b4700 0x7faf740b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:37.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.383+0000 7faf72ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7faf740b4700 0x7faf740b1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47362/0 (socket says 172.21.15.103:47362) 2020-04-22T14:02:37.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.383+0000 7faf72ffd700 1 -- 172.21.15.103:0/544585710 learned_addr learned my addr 172.21.15.103:0/544585710 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:37.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.383+0000 7faf737fe700 1 --2- 172.21.15.103:0/544585710 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faf740b4320 0x7faf740b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:37.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.383+0000 7faf72ffd700 1 -- 172.21.15.103:0/544585710 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faf740b4320 msgr2=0x7faf740b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:37.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.383+0000 7faf72ffd700 1 --2- 172.21.15.103:0/544585710 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faf740b4320 0x7faf740b15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:37.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.383+0000 7faf72ffd700 1 -- 172.21.15.103:0/544585710 >> v1:172.21.15.86:6789/0 conn(0x7faf740b2530 legacy=0x7faf740afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:37.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.383+0000 7faf72ffd700 1 -- 172.21.15.103:0/544585710 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf740ae500 con 0x7faf740b4700 2020-04-22T14:02:37.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.383+0000 7faf737fe700 1 --2- 172.21.15.103:0/544585710 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faf740b4320 0x7faf740b15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:02:37.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.383+0000 7faf72ffd700 1 --2- 172.21.15.103:0/544585710 >> v2:172.21.15.103:3300/0 conn(0x7faf740b4700 0x7faf740b1a30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7faf740b0db0 tx=0x7faf68007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.384+0000 7faf72ffd700 1 --2- 172.21.15.103:0/544585710 >> v2:172.21.15.103:3300/0 conn(0x7faf740b4700 0x7faf740b1a30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7faf740b0db0 tx=0x7faf68007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.384+0000 7faf72ffd700 1 --2- 172.21.15.103:0/544585710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf740b4700 0x7faf740b1a30 secure :-1 s=READY pgs=151 cs=0 l=1 rx=0x7faf740b0db0 tx=0x7faf68007a40).ready entity=mon.1 client_cookie=31944036b1b72968 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:37.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.384+0000 7faf72ffd700 1 --2- 172.21.15.103:0/544585710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf740b4700 0x7faf740b1a30 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7faf740b0db0 tx=0x7faf68007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.384+0000 7faf727fc700 1 -- 172.21.15.103:0/544585710 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf680116e0 con 0x7faf740b4700 2020-04-22T14:02:37.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.384+0000 7faf72ffd700 1 --2- 172.21.15.103:0/544585710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf740b4700 0x7faf740b1a30 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7faf740b0db0 tx=0x7faf68007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.384+0000 7faf727fc700 1 -- 172.21.15.103:0/544585710 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf68011840 con 0x7faf740b4700 2020-04-22T14:02:37.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.384+0000 7faf72ffd700 1 --2- 172.21.15.103:0/544585710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf740b4700 0x7faf740b1a30 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7faf740b0db0 tx=0x7faf68007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.384+0000 7faf727fc700 1 -- 172.21.15.103:0/544585710 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf68011c60 con 0x7faf740b4700 2020-04-22T14:02:37.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.384+0000 7faf79b0e700 1 -- 172.21.15.103:0/544585710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf740b4700 msgr2=0x7faf740b1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:37.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.384+0000 7faf79b0e700 1 --2- 172.21.15.103:0/544585710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf740b4700 0x7faf740b1a30 secure :-1 s=READY pgs=151 cs=0 l=1 rx=0x7faf740b0db0 tx=0x7faf68007a40).stop 2020-04-22T14:02:37.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.384+0000 7faf79b0e700 1 -- 172.21.15.103:0/544585710 shutdown_connections 2020-04-22T14:02:37.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.384+0000 7faf79b0e700 1 --2- 172.21.15.103:0/544585710 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faf740b4320 0x7faf740b15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:37.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.384+0000 7faf79b0e700 1 --2- 172.21.15.103:0/544585710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf740b4700 0x7faf740b1a30 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:37.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.384+0000 7faf79b0e700 1 -- 172.21.15.103:0/544585710 >> 172.21.15.103:0/544585710 conn(0x7faf740b86b0 msgr2=0x7faf740b8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:37.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.384+0000 7faf79b0e700 1 -- 172.21.15.103:0/544585710 shutdown_connections 2020-04-22T14:02:37.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.384+0000 7faf79b0e700 1 -- 172.21.15.103:0/544585710 wait complete. 2020-04-22T14:02:37.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.385+0000 7faf79b0e700 1 Processor -- start 2020-04-22T14:02:37.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.385+0000 7faf79b0e700 1 -- start start 2020-04-22T14:02:37.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.386+0000 7faf79b0e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7faf740b2530 0x7faf740b7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:37.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.386+0000 7faf79b0e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7faf740b4320 0x7faf74065b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:37.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.386+0000 7faf79b0e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faf740b4700 0x7faf7412cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:37.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.386+0000 7faf79b0e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf740b81f0 con 0x7faf740b2530 2020-04-22T14:02:37.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.386+0000 7faf79b0e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf74066490 con 0x7faf740b4320 2020-04-22T14:02:37.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.386+0000 7faf79b0e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf74062070 con 0x7faf740b4700 2020-04-22T14:02:37.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.386+0000 7faf72ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7faf740b4320 0x7faf74065b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:37.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.386+0000 7faf72ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7faf740b4320 0x7faf74065b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47368/0 (socket says 172.21.15.103:47368) 2020-04-22T14:02:37.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.386+0000 7faf72ffd700 1 -- 172.21.15.103:0/2387476998 learned_addr learned my addr 172.21.15.103:0/2387476998 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:37.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.386+0000 7faf737fe700 1 --2- 172.21.15.103:0/2387476998 >> v2:172.21.15.86:3300/0 conn(0x7faf740b2530 0x7faf740b7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:37.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.386+0000 7faf73fff700 1 --2- 172.21.15.103:0/2387476998 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faf740b4700 0x7faf7412cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:37.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.386+0000 7faf72ffd700 1 -- 172.21.15.103:0/2387476998 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faf740b4700 msgr2=0x7faf7412cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:37.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.386+0000 7faf72ffd700 1 --2- 172.21.15.103:0/2387476998 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faf740b4700 0x7faf7412cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:37.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.386+0000 7faf72ffd700 1 -- 172.21.15.103:0/2387476998 >> v2:172.21.15.86:3300/0 conn(0x7faf740b2530 msgr2=0x7faf740b7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:37.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.386+0000 7faf72ffd700 1 --2- 172.21.15.103:0/2387476998 >> v2:172.21.15.86:3300/0 conn(0x7faf740b2530 0x7faf740b7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:37.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.386+0000 7faf72ffd700 1 -- 172.21.15.103:0/2387476998 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf7413abb0 con 0x7faf740b4320 2020-04-22T14:02:37.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.386+0000 7faf73fff700 1 --2- 172.21.15.103:0/2387476998 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faf740b4700 0x7faf7412cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:02:37.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.386+0000 7faf72ffd700 1 --2- 172.21.15.103:0/2387476998 >> v2:172.21.15.103:3300/0 conn(0x7faf740b4320 0x7faf74065b50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faf740b0db0 tx=0x7faf68007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.387+0000 7faf72ffd700 1 --2- 172.21.15.103:0/2387476998 >> v2:172.21.15.103:3300/0 conn(0x7faf740b4320 0x7faf74065b50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faf740b0db0 tx=0x7faf68007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.387+0000 7faf72ffd700 1 --2- 172.21.15.103:0/2387476998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf740b4320 0x7faf74065b50 secure :-1 s=READY pgs=152 cs=0 l=1 rx=0x7faf740b0db0 tx=0x7faf68007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:37.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.387+0000 7faf72ffd700 1 --2- 172.21.15.103:0/2387476998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf740b4320 0x7faf74065b50 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7faf740b0db0 tx=0x7faf68007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.387+0000 7faf72ffd700 1 --2- 172.21.15.103:0/2387476998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf740b4320 0x7faf74065b50 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7faf740b0db0 tx=0x7faf68007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.387+0000 7faf72ffd700 1 --2- 172.21.15.103:0/2387476998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf740b4320 0x7faf74065b50 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7faf740b0db0 tx=0x7faf68007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.387+0000 7faf70ff9700 1 -- 172.21.15.103:0/2387476998 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf68007170 con 0x7faf740b4320 2020-04-22T14:02:37.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.387+0000 7faf70ff9700 1 -- 172.21.15.103:0/2387476998 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf680072d0 con 0x7faf740b4320 2020-04-22T14:02:37.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.387+0000 7faf70ff9700 1 -- 172.21.15.103:0/2387476998 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf680056c0 con 0x7faf740b4320 2020-04-22T14:02:37.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.387+0000 7faf79b0e700 1 -- 172.21.15.103:0/2387476998 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf74065fb0 con 0x7faf740b4320 2020-04-22T14:02:37.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.387+0000 7faf79b0e700 1 -- 172.21.15.103:0/2387476998 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf7412d380 con 0x7faf740b4320 2020-04-22T14:02:37.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.387+0000 7faf72ffd700 1 --2- 172.21.15.103:0/2387476998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf740b4320 0x7faf74065b50 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7faf740b0db0 tx=0x7faf68007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.388+0000 7faf79b0e700 1 -- 172.21.15.103:0/2387476998 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf740662c0 con 0x7faf740b4320 2020-04-22T14:02:37.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.388+0000 7faf70ff9700 1 -- 172.21.15.103:0/2387476998 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7faf68005930 con 0x7faf740b4320 2020-04-22T14:02:37.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.388+0000 7faf72ffd700 1 --2- 172.21.15.103:0/2387476998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf740b4320 0x7faf74065b50 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7faf740b0db0 tx=0x7faf68007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.388+0000 7faf70ff9700 1 --2- 172.21.15.103:0/2387476998 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faf5404da00 0x7faf5404fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:37.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.388+0000 7faf70ff9700 1 -- 172.21.15.103:0/2387476998 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7faf68061d20 con 0x7faf740b4320 2020-04-22T14:02:37.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.388+0000 7faf737fe700 1 --2- 172.21.15.103:0/2387476998 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faf5404da00 0x7faf5404fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:37.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.388+0000 7faf737fe700 1 --2- 172.21.15.103:0/2387476998 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faf5404da00 0x7faf5404fec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faf640032b0 tx=0x7faf6400e510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.389+0000 7faf737fe700 1 --2- 172.21.15.103:0/2387476998 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faf5404da00 0x7faf5404fec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faf640032b0 tx=0x7faf6400e510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.389+0000 7faf737fe700 1 --2- 172.21.15.103:0/2387476998 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faf5404da00 0x7faf5404fec0 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7faf640032b0 tx=0x7faf6400e510).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:37.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.392+0000 7faf72ffd700 1 --2- 172.21.15.103:0/2387476998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf740b4320 0x7faf74065b50 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7faf740b0db0 tx=0x7faf68007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.392+0000 7faf70ff9700 1 -- 172.21.15.103:0/2387476998 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7faf6803d220 con 0x7faf740b4320 2020-04-22T14:02:37.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.534+0000 7faf79b0e700 1 -- 172.21.15.103:0/2387476998 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7faf74056c90 con 0x7faf740b4320 2020-04-22T14:02:37.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.534+0000 7faf72ffd700 1 --2- 172.21.15.103:0/2387476998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf740b4320 0x7faf74065b50 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7faf740b0db0 tx=0x7faf68007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.534+0000 7faf70ff9700 1 -- 172.21.15.103:0/2387476998 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faf68040840 con 0x7faf740b4320 2020-04-22T14:02:37.538 INFO:teuthology.orchestra.run.smithi103.stdout:60129542150 2020-04-22T14:02:37.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.535+0000 7faf79b0e700 1 -- 172.21.15.103:0/2387476998 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faf5404da00 msgr2=0x7faf5404fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:37.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.535+0000 7faf79b0e700 1 --2- 172.21.15.103:0/2387476998 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faf5404da00 0x7faf5404fec0 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7faf640032b0 tx=0x7faf6400e510).stop 2020-04-22T14:02:37.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.535+0000 7faf79b0e700 1 -- 172.21.15.103:0/2387476998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf740b4320 msgr2=0x7faf74065b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:37.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.535+0000 7faf79b0e700 1 --2- 172.21.15.103:0/2387476998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf740b4320 0x7faf74065b50 secure :-1 s=READY pgs=152 cs=0 l=1 rx=0x7faf740b0db0 tx=0x7faf68007a40).stop 2020-04-22T14:02:37.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.535+0000 7faf79b0e700 1 -- 172.21.15.103:0/2387476998 shutdown_connections 2020-04-22T14:02:37.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.535+0000 7faf79b0e700 1 --2- 172.21.15.103:0/2387476998 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faf5404da00 0x7faf5404fec0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:37.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.535+0000 7faf79b0e700 1 --2- 172.21.15.103:0/2387476998 >> v2:172.21.15.86:3300/0 conn(0x7faf740b2530 0x7faf740b7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:37.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.535+0000 7faf79b0e700 1 --2- 172.21.15.103:0/2387476998 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faf740b4700 0x7faf7412cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:37.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.535+0000 7faf79b0e700 1 --2- 172.21.15.103:0/2387476998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf740b4320 0x7faf74065b50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:37.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.536+0000 7faf79b0e700 1 -- 172.21.15.103:0/2387476998 >> 172.21.15.103:0/2387476998 conn(0x7faf740b86b0 msgr2=0x7faf740b14f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:37.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.536+0000 7faf79b0e700 1 -- 172.21.15.103:0/2387476998 shutdown_connections 2020-04-22T14:02:37.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.536+0000 7faf79b0e700 1 -- 172.21.15.103:0/2387476998 wait complete. 2020-04-22T14:02:37.552 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.3 2020-04-22T14:02:37.552 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:37.574 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.4 2020-04-22T14:02:37.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.720+0000 7f82802dc700 1 Processor -- start 2020-04-22T14:02:37.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.720+0000 7f82802dc700 1 -- start start 2020-04-22T14:02:37.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.721+0000 7f82802dc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f82780622c0 0x7f8278067110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:37.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.721+0000 7f82802dc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f82780b3920 0x7f8278143730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:37.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.721+0000 7f82802dc700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82780630c0 con 0x7f8278143b90 2020-04-22T14:02:37.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.721+0000 7f82802dc700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82780b3140 con 0x7f82780622c0 2020-04-22T14:02:37.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.721+0000 7f82802dc700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8278144020 con 0x7f82780b3920 2020-04-22T14:02:37.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.721+0000 7f827d877700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f82780b3920 0x7f8278143730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:37.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.721+0000 7f827e879700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f8278143b90 0x7f8278147870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39564/0 (socket says 172.21.15.103:39564) 2020-04-22T14:02:37.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.721+0000 7f827e879700 1 -- 172.21.15.103:0/1667134376 learned_addr learned my addr 172.21.15.103:0/1667134376 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:37.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.721+0000 7f827e078700 1 --2- 172.21.15.103:0/1667134376 >> v2:172.21.15.86:3300/0 conn(0x7f82780622c0 0x7f8278067110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:37.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.722+0000 7f827d877700 1 -- 172.21.15.103:0/1667134376 >> v2:172.21.15.86:3300/0 conn(0x7f82780622c0 msgr2=0x7f8278067110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:37.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.722+0000 7f827d877700 1 --2- 172.21.15.103:0/1667134376 >> v2:172.21.15.86:3300/0 conn(0x7f82780622c0 0x7f8278067110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:37.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.722+0000 7f827d877700 1 -- 172.21.15.103:0/1667134376 >> v1:172.21.15.103:6789/0 conn(0x7f8278143b90 legacy=0x7f8278147870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:37.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.722+0000 7f827d877700 1 -- 172.21.15.103:0/1667134376 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82780626a0 con 0x7f82780b3920 2020-04-22T14:02:37.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.722+0000 7f827d076700 1 -- 172.21.15.103:0/1667134376 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2485984203 0 0) 0x7f82780630c0 con 0x7f8278143b90 2020-04-22T14:02:37.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.722+0000 7f827d877700 1 --2- 172.21.15.103:0/1667134376 >> v2:172.21.15.103:3300/0 conn(0x7f82780b3920 0x7f8278143730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f827805ff90 tx=0x7f826c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.722+0000 7f827d877700 1 --2- 172.21.15.103:0/1667134376 >> v2:172.21.15.103:3300/0 conn(0x7f82780b3920 0x7f8278143730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f827805ff90 tx=0x7f826c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.722+0000 7f827d877700 1 --2- 172.21.15.103:0/1667134376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82780b3920 0x7f8278143730 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7f827805ff90 tx=0x7f826c007a40).ready entity=mon.1 client_cookie=a4eaf71a686071de server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:37.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.722+0000 7f827d877700 1 --2- 172.21.15.103:0/1667134376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82780b3920 0x7f8278143730 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f827805ff90 tx=0x7f826c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.722+0000 7f827d076700 1 -- 172.21.15.103:0/1667134376 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f826c011380 con 0x7f82780b3920 2020-04-22T14:02:37.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.722+0000 7f827d877700 1 --2- 172.21.15.103:0/1667134376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82780b3920 0x7f8278143730 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f827805ff90 tx=0x7f826c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.722+0000 7f827d877700 1 --2- 172.21.15.103:0/1667134376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82780b3920 0x7f8278143730 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f827805ff90 tx=0x7f826c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.722+0000 7f827d076700 1 -- 172.21.15.103:0/1667134376 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f826c011520 con 0x7f82780b3920 2020-04-22T14:02:37.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.722+0000 7f827d076700 1 -- 172.21.15.103:0/1667134376 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f826c011900 con 0x7f82780b3920 2020-04-22T14:02:37.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.722+0000 7f82802dc700 1 -- 172.21.15.103:0/1667134376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82780b3920 msgr2=0x7f8278143730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:37.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.722+0000 7f82802dc700 1 --2- 172.21.15.103:0/1667134376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82780b3920 0x7f8278143730 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7f827805ff90 tx=0x7f826c007a40).stop 2020-04-22T14:02:37.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.722+0000 7f82802dc700 1 -- 172.21.15.103:0/1667134376 shutdown_connections 2020-04-22T14:02:37.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.722+0000 7f82802dc700 1 --2- 172.21.15.103:0/1667134376 >> v2:172.21.15.86:3300/0 conn(0x7f82780622c0 0x7f8278067110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:37.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.722+0000 7f82802dc700 1 --2- 172.21.15.103:0/1667134376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82780b3920 0x7f8278143730 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:37.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.722+0000 7f82802dc700 1 -- 172.21.15.103:0/1667134376 >> 172.21.15.103:0/1667134376 conn(0x7f827805ad30 msgr2=0x7f827805f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:37.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.722+0000 7f82802dc700 1 -- 172.21.15.103:0/1667134376 shutdown_connections 2020-04-22T14:02:37.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.722+0000 7f82802dc700 1 -- 172.21.15.103:0/1667134376 wait complete. 2020-04-22T14:02:37.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.723+0000 7f82802dc700 1 Processor -- start 2020-04-22T14:02:37.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.723+0000 7f82802dc700 1 -- start start 2020-04-22T14:02:37.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.724+0000 7f82802dc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f82780622c0 0x7f8278135c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:37.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.724+0000 7f82802dc700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f82780b3920 0x7f8278112ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:37.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.724+0000 7f82802dc700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82781133d0 con 0x7f8278143b90 2020-04-22T14:02:37.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.724+0000 7f82802dc700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8278113670 con 0x7f82780622c0 2020-04-22T14:02:37.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.724+0000 7f82802dc700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8278113910 con 0x7f82780b3920 2020-04-22T14:02:37.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.724+0000 7f827d877700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f82780b3920 0x7f8278112ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:37.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.724+0000 7f827e078700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f82780622c0 0x7f8278135c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:37.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.724+0000 7f827d877700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f82780b3920 0x7f8278112ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:60390/0 (socket says 172.21.15.103:60390) 2020-04-22T14:02:37.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.724+0000 7f827d877700 1 -- 172.21.15.103:0/3739673469 learned_addr learned my addr 172.21.15.103:0/3739673469 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:37.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.724+0000 7f827e879700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f8278143b90 0x7f82780ace80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:56728/0 (socket says 172.21.15.103:56728) 2020-04-22T14:02:37.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.724+0000 7f827e078700 1 -- 172.21.15.103:0/3739673469 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f82780b3920 msgr2=0x7f8278112ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:37.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.724+0000 7f827e078700 1 --2- 172.21.15.103:0/3739673469 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f82780b3920 0x7f8278112ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:37.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.724+0000 7f827e078700 1 -- 172.21.15.103:0/3739673469 >> v1:172.21.15.86:6789/0 conn(0x7f8278143b90 legacy=0x7f82780ace80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:37.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.724+0000 7f827e078700 1 -- 172.21.15.103:0/3739673469 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82780ad590 con 0x7f82780622c0 2020-04-22T14:02:37.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.724+0000 7f826b7fe700 1 -- 172.21.15.103:0/3739673469 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3908300498 0 0) 0x7f82781133d0 con 0x7f8278143b90 2020-04-22T14:02:37.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.725+0000 7f827d877700 1 --2- 172.21.15.103:0/3739673469 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f82780b3920 0x7f8278112ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:02:37.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.725+0000 7f827e078700 1 --2- 172.21.15.103:0/3739673469 >> v2:172.21.15.86:3300/0 conn(0x7f82780622c0 0x7f8278135c10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8274002f30 tx=0x7f8274010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.725+0000 7f827e078700 1 --2- 172.21.15.103:0/3739673469 >> v2:172.21.15.86:3300/0 conn(0x7f82780622c0 0x7f8278135c10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8274002f30 tx=0x7f8274010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.725+0000 7f827e078700 1 --2- 172.21.15.103:0/3739673469 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82780622c0 0x7f8278135c10 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7f8274002f30 tx=0x7f8274010b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:37.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.725+0000 7f827e078700 1 --2- 172.21.15.103:0/3739673469 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82780622c0 0x7f8278135c10 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f8274002f30 tx=0x7f8274010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.725+0000 7f826b7fe700 1 -- 172.21.15.103:0/3739673469 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8274007550 con 0x7f82780622c0 2020-04-22T14:02:37.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.725+0000 7f827e078700 1 --2- 172.21.15.103:0/3739673469 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82780622c0 0x7f8278135c10 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f8274002f30 tx=0x7f8274010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.725+0000 7f826b7fe700 1 -- 172.21.15.103:0/3739673469 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82740056c0 con 0x7f82780622c0 2020-04-22T14:02:37.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.725+0000 7f82802dc700 1 -- 172.21.15.103:0/3739673469 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8278112f20 con 0x7f82780622c0 2020-04-22T14:02:37.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.725+0000 7f827e078700 1 --2- 172.21.15.103:0/3739673469 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82780622c0 0x7f8278135c10 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f8274002f30 tx=0x7f8274010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.725+0000 7f826b7fe700 1 -- 172.21.15.103:0/3739673469 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8274005a60 con 0x7f82780622c0 2020-04-22T14:02:37.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.725+0000 7f82802dc700 1 -- 172.21.15.103:0/3739673469 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82780b22d0 con 0x7f82780622c0 2020-04-22T14:02:37.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.726+0000 7f827e078700 1 --2- 172.21.15.103:0/3739673469 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82780622c0 0x7f8278135c10 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f8274002f30 tx=0x7f8274010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.726+0000 7f82802dc700 1 -- 172.21.15.103:0/3739673469 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8278113200 con 0x7f82780622c0 2020-04-22T14:02:37.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.726+0000 7f826b7fe700 1 -- 172.21.15.103:0/3739673469 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f8274005c10 con 0x7f82780622c0 2020-04-22T14:02:37.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.726+0000 7f827e078700 1 --2- 172.21.15.103:0/3739673469 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82780622c0 0x7f8278135c10 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f8274002f30 tx=0x7f8274010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.726+0000 7f826b7fe700 1 --2- 172.21.15.103:0/3739673469 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f825804d8b0 0x7f825804fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:37.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.726+0000 7f826b7fe700 1 -- 172.21.15.103:0/3739673469 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f827400d0d0 con 0x7f82780622c0 2020-04-22T14:02:37.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.727+0000 7f827d877700 1 --2- 172.21.15.103:0/3739673469 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f825804d8b0 0x7f825804fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:37.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.727+0000 7f827d877700 1 --2- 172.21.15.103:0/3739673469 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f825804d8b0 0x7f825804fd70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f827805ff90 tx=0x7f826c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.727+0000 7f827d877700 1 --2- 172.21.15.103:0/3739673469 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f825804d8b0 0x7f825804fd70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f827805ff90 tx=0x7f826c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.727+0000 7f827d877700 1 --2- 172.21.15.103:0/3739673469 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f825804d8b0 0x7f825804fd70 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7f827805ff90 tx=0x7f826c007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:37.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.730+0000 7f827e078700 1 --2- 172.21.15.103:0/3739673469 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82780622c0 0x7f8278135c10 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f8274002f30 tx=0x7f8274010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.730+0000 7f826b7fe700 1 -- 172.21.15.103:0/3739673469 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f827403c8f0 con 0x7f82780622c0 2020-04-22T14:02:37.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.873+0000 7f82802dc700 1 -- 172.21.15.103:0/3739673469 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f8278113ab0 con 0x7f82780622c0 2020-04-22T14:02:37.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.874+0000 7f827e078700 1 --2- 172.21.15.103:0/3739673469 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82780622c0 0x7f8278135c10 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f8274002f30 tx=0x7f8274010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:37.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.874+0000 7f826b7fe700 1 -- 172.21.15.103:0/3739673469 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f827403ff10 con 0x7f82780622c0 2020-04-22T14:02:37.877 INFO:teuthology.orchestra.run.smithi103.stdout:64424509445 2020-04-22T14:02:37.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.875+0000 7f82802dc700 1 -- 172.21.15.103:0/3739673469 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f825804d8b0 msgr2=0x7f825804fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:37.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.875+0000 7f82802dc700 1 --2- 172.21.15.103:0/3739673469 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f825804d8b0 0x7f825804fd70 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7f827805ff90 tx=0x7f826c007a40).stop 2020-04-22T14:02:37.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.875+0000 7f82802dc700 1 -- 172.21.15.103:0/3739673469 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82780622c0 msgr2=0x7f8278135c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:37.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.875+0000 7f82802dc700 1 --2- 172.21.15.103:0/3739673469 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82780622c0 0x7f8278135c10 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7f8274002f30 tx=0x7f8274010b90).stop 2020-04-22T14:02:37.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.875+0000 7f82802dc700 1 -- 172.21.15.103:0/3739673469 shutdown_connections 2020-04-22T14:02:37.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.875+0000 7f82802dc700 1 --2- 172.21.15.103:0/3739673469 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f825804d8b0 0x7f825804fd70 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:37.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.875+0000 7f82802dc700 1 --2- 172.21.15.103:0/3739673469 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82780622c0 0x7f8278135c10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:37.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.875+0000 7f82802dc700 1 --2- 172.21.15.103:0/3739673469 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f82780b3920 0x7f8278112ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:37.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.875+0000 7f82802dc700 1 -- 172.21.15.103:0/3739673469 >> 172.21.15.103:0/3739673469 conn(0x7f827805ad30 msgr2=0x7f827805f260 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:37.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.875+0000 7f82802dc700 1 -- 172.21.15.103:0/3739673469 shutdown_connections 2020-04-22T14:02:37.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:37.875+0000 7f82802dc700 1 -- 172.21.15.103:0/3739673469 wait complete. 2020-04-22T14:02:37.888 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509445 for osd.4 2020-04-22T14:02:37.888 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:37.908 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.5 2020-04-22T14:02:38.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.047+0000 7fc482881700 1 Processor -- start 2020-04-22T14:02:38.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.047+0000 7fc482881700 1 -- start start 2020-04-22T14:02:38.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.047+0000 7fc482881700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc47c147e60 0x7fc47c0af750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:38.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.047+0000 7fc482881700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc47c14b480 0x7fc47c14b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:38.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.047+0000 7fc482881700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc47c14a800 con 0x7fc47c0ad360 2020-04-22T14:02:38.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.047+0000 7fc482881700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc47c14aaa0 con 0x7fc47c147e60 2020-04-22T14:02:38.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.047+0000 7fc482881700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc47c14ad40 con 0x7fc47c14b480 2020-04-22T14:02:38.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.048+0000 7fc480e1e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc47c14b480 0x7fc47c14b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:38.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.048+0000 7fc480e1e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc47c14b480 0x7fc47c14b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47388/0 (socket says 172.21.15.103:47388) 2020-04-22T14:02:38.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.048+0000 7fc47b7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc47c0ad360 0x7fc47c0ae9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39580/0 (socket says 172.21.15.103:39580) 2020-04-22T14:02:38.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.048+0000 7fc480e1e700 1 -- 172.21.15.103:0/703420855 learned_addr learned my addr 172.21.15.103:0/703420855 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:38.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.048+0000 7fc47bfff700 1 --2- 172.21.15.103:0/703420855 >> v2:172.21.15.86:3300/0 conn(0x7fc47c147e60 0x7fc47c0af750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:38.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.048+0000 7fc480e1e700 1 -- 172.21.15.103:0/703420855 >> v2:172.21.15.86:3300/0 conn(0x7fc47c147e60 msgr2=0x7fc47c0af750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:38.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.048+0000 7fc480e1e700 1 --2- 172.21.15.103:0/703420855 >> v2:172.21.15.86:3300/0 conn(0x7fc47c147e60 0x7fc47c0af750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:38.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.048+0000 7fc480e1e700 1 -- 172.21.15.103:0/703420855 >> v1:172.21.15.103:6789/0 conn(0x7fc47c0ad360 legacy=0x7fc47c0ae9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:38.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.048+0000 7fc480e1e700 1 -- 172.21.15.103:0/703420855 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47c14afe0 con 0x7fc47c14b480 2020-04-22T14:02:38.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.048+0000 7fc47affd700 1 -- 172.21.15.103:0/703420855 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3462477713 0 0) 0x7fc47c14a800 con 0x7fc47c0ad360 2020-04-22T14:02:38.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.048+0000 7fc47bfff700 1 --2- 172.21.15.103:0/703420855 >> v2:172.21.15.86:3300/0 conn(0x7fc47c147e60 0x7fc47c0af750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:02:38.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.048+0000 7fc480e1e700 1 --2- 172.21.15.103:0/703420855 >> v2:172.21.15.103:3300/0 conn(0x7fc47c14b480 0x7fc47c14b9d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc4740032b0 tx=0x7fc474007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.048+0000 7fc480e1e700 1 --2- 172.21.15.103:0/703420855 >> v2:172.21.15.103:3300/0 conn(0x7fc47c14b480 0x7fc47c14b9d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc4740032b0 tx=0x7fc474007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.048+0000 7fc480e1e700 1 --2- 172.21.15.103:0/703420855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc47c14b480 0x7fc47c14b9d0 secure :-1 s=READY pgs=156 cs=0 l=1 rx=0x7fc4740032b0 tx=0x7fc474007dc0).ready entity=mon.1 client_cookie=ba939fd7797a475d server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:38.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.048+0000 7fc480e1e700 1 --2- 172.21.15.103:0/703420855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc47c14b480 0x7fc47c14b9d0 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7fc4740032b0 tx=0x7fc474007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.048+0000 7fc47affd700 1 -- 172.21.15.103:0/703420855 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc47400a180 con 0x7fc47c14b480 2020-04-22T14:02:38.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.048+0000 7fc480e1e700 1 --2- 172.21.15.103:0/703420855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc47c14b480 0x7fc47c14b9d0 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7fc4740032b0 tx=0x7fc474007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.048+0000 7fc480e1e700 1 --2- 172.21.15.103:0/703420855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc47c14b480 0x7fc47c14b9d0 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7fc4740032b0 tx=0x7fc474007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.048+0000 7fc47affd700 1 -- 172.21.15.103:0/703420855 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47400a2e0 con 0x7fc47c14b480 2020-04-22T14:02:38.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.048+0000 7fc47affd700 1 -- 172.21.15.103:0/703420855 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc47400a6c0 con 0x7fc47c14b480 2020-04-22T14:02:38.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.048+0000 7fc482881700 1 -- 172.21.15.103:0/703420855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc47c14b480 msgr2=0x7fc47c14b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:38.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.048+0000 7fc482881700 1 --2- 172.21.15.103:0/703420855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc47c14b480 0x7fc47c14b9d0 secure :-1 s=READY pgs=156 cs=0 l=1 rx=0x7fc4740032b0 tx=0x7fc474007dc0).stop 2020-04-22T14:02:38.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.049+0000 7fc482881700 1 -- 172.21.15.103:0/703420855 shutdown_connections 2020-04-22T14:02:38.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.049+0000 7fc482881700 1 --2- 172.21.15.103:0/703420855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc47c14b480 0x7fc47c14b9d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:38.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.049+0000 7fc482881700 1 --2- 172.21.15.103:0/703420855 >> v2:172.21.15.86:3300/0 conn(0x7fc47c147e60 0x7fc47c0af750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:38.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.049+0000 7fc482881700 1 -- 172.21.15.103:0/703420855 >> 172.21.15.103:0/703420855 conn(0x7fc47c0b86b0 msgr2=0x7fc47c0b8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:38.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.049+0000 7fc482881700 1 -- 172.21.15.103:0/703420855 shutdown_connections 2020-04-22T14:02:38.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.049+0000 7fc482881700 1 -- 172.21.15.103:0/703420855 wait complete. 2020-04-22T14:02:38.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.050+0000 7fc482881700 1 Processor -- start 2020-04-22T14:02:38.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.050+0000 7fc482881700 1 -- start start 2020-04-22T14:02:38.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.051+0000 7fc482881700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc47c0ad360 0x7fc47c15b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:38.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.051+0000 7fc482881700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc47c14b480 0x7fc47c1427c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:38.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.051+0000 7fc482881700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc47c15bda0 con 0x7fc47c147e60 2020-04-22T14:02:38.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.051+0000 7fc482881700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc47c0630c0 con 0x7fc47c14b480 2020-04-22T14:02:38.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.051+0000 7fc482881700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc47c063360 con 0x7fc47c0ad360 2020-04-22T14:02:38.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.051+0000 7fc47bfff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc47c0ad360 0x7fc47c15b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:38.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.051+0000 7fc47bfff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc47c0ad360 0x7fc47c15b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47392/0 (socket says 172.21.15.103:47392) 2020-04-22T14:02:38.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.051+0000 7fc47bfff700 1 -- 172.21.15.103:0/2201976969 learned_addr learned my addr 172.21.15.103:0/2201976969 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:38.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.051+0000 7fc480e1e700 1 --2- 172.21.15.103:0/2201976969 >> v2:172.21.15.86:3300/0 conn(0x7fc47c14b480 0x7fc47c1427c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:38.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.051+0000 7fc47bfff700 1 -- 172.21.15.103:0/2201976969 >> v2:172.21.15.86:3300/0 conn(0x7fc47c14b480 msgr2=0x7fc47c1427c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:38.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.051+0000 7fc47bfff700 1 --2- 172.21.15.103:0/2201976969 >> v2:172.21.15.86:3300/0 conn(0x7fc47c14b480 0x7fc47c1427c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:38.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.051+0000 7fc47bfff700 1 -- 172.21.15.103:0/2201976969 >> v1:172.21.15.86:6789/0 conn(0x7fc47c147e60 legacy=0x7fc47c144690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:38.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.051+0000 7fc47bfff700 1 -- 172.21.15.103:0/2201976969 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47c063600 con 0x7fc47c0ad360 2020-04-22T14:02:38.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.051+0000 7fc480e1e700 1 --2- 172.21.15.103:0/2201976969 >> v2:172.21.15.86:3300/0 conn(0x7fc47c14b480 0x7fc47c1427c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:02:38.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.051+0000 7fc47bfff700 1 --2- 172.21.15.103:0/2201976969 >> v2:172.21.15.103:3300/0 conn(0x7fc47c0ad360 0x7fc47c15b940 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc47c143a70 tx=0x7fc46c010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.051+0000 7fc47bfff700 1 --2- 172.21.15.103:0/2201976969 >> v2:172.21.15.103:3300/0 conn(0x7fc47c0ad360 0x7fc47c15b940 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc47c143a70 tx=0x7fc46c010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.051+0000 7fc47bfff700 1 --2- 172.21.15.103:0/2201976969 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc47c0ad360 0x7fc47c15b940 secure :-1 s=READY pgs=157 cs=0 l=1 rx=0x7fc47c143a70 tx=0x7fc46c010c00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:38.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.051+0000 7fc47bfff700 1 --2- 172.21.15.103:0/2201976969 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc47c0ad360 0x7fc47c15b940 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7fc47c143a70 tx=0x7fc46c010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.051+0000 7fc47bfff700 1 --2- 172.21.15.103:0/2201976969 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc47c0ad360 0x7fc47c15b940 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7fc47c143a70 tx=0x7fc46c010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.051+0000 7fc4797fa700 1 -- 172.21.15.103:0/2201976969 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc46c005e90 con 0x7fc47c0ad360 2020-04-22T14:02:38.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.051+0000 7fc47bfff700 1 --2- 172.21.15.103:0/2201976969 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc47c0ad360 0x7fc47c15b940 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7fc47c143a70 tx=0x7fc46c010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.051+0000 7fc4797fa700 1 -- 172.21.15.103:0/2201976969 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc46c007180 con 0x7fc47c0ad360 2020-04-22T14:02:38.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.051+0000 7fc4797fa700 1 -- 172.21.15.103:0/2201976969 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc46c007520 con 0x7fc47c0ad360 2020-04-22T14:02:38.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.051+0000 7fc482881700 1 -- 172.21.15.103:0/2201976969 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc47c15c080 con 0x7fc47c0ad360 2020-04-22T14:02:38.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.051+0000 7fc482881700 1 -- 172.21.15.103:0/2201976969 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc47c142de0 con 0x7fc47c0ad360 2020-04-22T14:02:38.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.052+0000 7fc47bfff700 1 --2- 172.21.15.103:0/2201976969 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc47c0ad360 0x7fc47c15b940 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7fc47c143a70 tx=0x7fc46c010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.052+0000 7fc482881700 1 -- 172.21.15.103:0/2201976969 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc47c056c90 con 0x7fc47c0ad360 2020-04-22T14:02:38.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.052+0000 7fc4797fa700 1 -- 172.21.15.103:0/2201976969 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fc46c0122b0 con 0x7fc47c0ad360 2020-04-22T14:02:38.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.052+0000 7fc47bfff700 1 --2- 172.21.15.103:0/2201976969 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc47c0ad360 0x7fc47c15b940 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7fc47c143a70 tx=0x7fc46c010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.052+0000 7fc4797fa700 1 --2- 172.21.15.103:0/2201976969 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc45c04da70 0x7fc45c04ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:38.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.053+0000 7fc4797fa700 1 -- 172.21.15.103:0/2201976969 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc46c007e40 con 0x7fc47c0ad360 2020-04-22T14:02:38.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.053+0000 7fc47b7fe700 1 --2- 172.21.15.103:0/2201976969 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc45c04da70 0x7fc45c04ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:38.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.053+0000 7fc47b7fe700 1 --2- 172.21.15.103:0/2201976969 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc45c04da70 0x7fc45c04ff30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc470000fa0 tx=0x7fc470001510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.053+0000 7fc47b7fe700 1 --2- 172.21.15.103:0/2201976969 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc45c04da70 0x7fc45c04ff30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc470000fa0 tx=0x7fc470001510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.053+0000 7fc47b7fe700 1 --2- 172.21.15.103:0/2201976969 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc45c04da70 0x7fc45c04ff30 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7fc470000fa0 tx=0x7fc470001510).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:38.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.057+0000 7fc47bfff700 1 --2- 172.21.15.103:0/2201976969 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc47c0ad360 0x7fc47c15b940 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7fc47c143a70 tx=0x7fc46c010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.057+0000 7fc4797fa700 1 -- 172.21.15.103:0/2201976969 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fc46c03c870 con 0x7fc47c0ad360 2020-04-22T14:02:38.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.199+0000 7fc482881700 1 -- 172.21.15.103:0/2201976969 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fc47c15bda0 con 0x7fc47c0ad360 2020-04-22T14:02:38.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.199+0000 7fc47bfff700 1 --2- 172.21.15.103:0/2201976969 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc47c0ad360 0x7fc47c15b940 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7fc47c143a70 tx=0x7fc46c010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.199+0000 7fc4797fa700 1 -- 172.21.15.103:0/2201976969 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc47c15bda0 con 0x7fc47c0ad360 2020-04-22T14:02:38.203 INFO:teuthology.orchestra.run.smithi103.stdout:64424509446 2020-04-22T14:02:38.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.201+0000 7fc482881700 1 -- 172.21.15.103:0/2201976969 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc45c04da70 msgr2=0x7fc45c04ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:38.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.201+0000 7fc482881700 1 --2- 172.21.15.103:0/2201976969 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc45c04da70 0x7fc45c04ff30 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7fc470000fa0 tx=0x7fc470001510).stop 2020-04-22T14:02:38.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.201+0000 7fc482881700 1 -- 172.21.15.103:0/2201976969 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc47c0ad360 msgr2=0x7fc47c15b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:38.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.201+0000 7fc482881700 1 --2- 172.21.15.103:0/2201976969 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc47c0ad360 0x7fc47c15b940 secure :-1 s=READY pgs=157 cs=0 l=1 rx=0x7fc47c143a70 tx=0x7fc46c010c00).stop 2020-04-22T14:02:38.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.201+0000 7fc482881700 1 -- 172.21.15.103:0/2201976969 shutdown_connections 2020-04-22T14:02:38.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.201+0000 7fc482881700 1 --2- 172.21.15.103:0/2201976969 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc45c04da70 0x7fc45c04ff30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:38.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.201+0000 7fc482881700 1 --2- 172.21.15.103:0/2201976969 >> v2:172.21.15.86:3300/0 conn(0x7fc47c14b480 0x7fc47c1427c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:38.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.201+0000 7fc482881700 1 --2- 172.21.15.103:0/2201976969 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc47c0ad360 0x7fc47c15b940 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:38.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.201+0000 7fc482881700 1 -- 172.21.15.103:0/2201976969 >> 172.21.15.103:0/2201976969 conn(0x7fc47c0b86b0 msgr2=0x7fc47c0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:38.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.201+0000 7fc482881700 1 -- 172.21.15.103:0/2201976969 shutdown_connections 2020-04-22T14:02:38.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.201+0000 7fc482881700 1 -- 172.21.15.103:0/2201976969 wait complete. 2020-04-22T14:02:38.217 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509446 for osd.5 2020-04-22T14:02:38.218 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:38.232 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.6 2020-04-22T14:02:38.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.377+0000 7fcf027d3700 1 Processor -- start 2020-04-22T14:02:38.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.377+0000 7fcf027d3700 1 -- start start 2020-04-22T14:02:38.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.378+0000 7fcf027d3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcefc060ea0 0x7fcefc1461d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:38.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.378+0000 7fcf027d3700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcefc14a5e0 con 0x7fcefc0b3790 2020-04-22T14:02:38.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.378+0000 7fcf027d3700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcefc14a840 con 0x7fcefc05b0b0 2020-04-22T14:02:38.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.378+0000 7fcf027d3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcefc0b4eb0 con 0x7fcefc060ea0 2020-04-22T14:02:38.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.378+0000 7fcefbfff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fcefc05b0b0 0x7fcefc145ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39590/0 (socket says 172.21.15.103:39590) 2020-04-22T14:02:38.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.378+0000 7fcefbfff700 1 -- 172.21.15.103:0/3096314608 learned_addr learned my addr 172.21.15.103:0/3096314608 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:38.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.378+0000 7fcefb7fe700 1 --2- 172.21.15.103:0/3096314608 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcefc060ea0 0x7fcefc1461d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:38.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.378+0000 7fcefaffd700 1 -- 172.21.15.103:0/3096314608 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 442392822 0 0) 0x7fcefc14a840 con 0x7fcefc05b0b0 2020-04-22T14:02:38.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.378+0000 7fcefaffd700 1 -- 172.21.15.103:0/3096314608 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcee8003230 con 0x7fcefc05b0b0 2020-04-22T14:02:38.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.378+0000 7fcefaffd700 1 -- 172.21.15.103:0/3096314608 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2526216126 0 0) 0x7fcefc14a5e0 con 0x7fcefc0b3790 2020-04-22T14:02:38.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.379+0000 7fcefaffd700 1 -- 172.21.15.103:0/3096314608 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcefc14a840 con 0x7fcefc0b3790 2020-04-22T14:02:38.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.379+0000 7fcefb7fe700 1 -- 172.21.15.103:0/3096314608 >> v1:172.21.15.103:6789/0 conn(0x7fcefc05b0b0 legacy=0x7fcefc145ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:38.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.379+0000 7fcefaffd700 1 -- 172.21.15.103:0/3096314608 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2855614797 0 0) 0x7fcee8003230 con 0x7fcefc05b0b0 2020-04-22T14:02:38.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.379+0000 7fcefb7fe700 1 -- 172.21.15.103:0/3096314608 >> v1:172.21.15.86:6789/0 conn(0x7fcefc0b3790 legacy=0x7fcefc0629d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:38.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.379+0000 7fcefb7fe700 1 -- 172.21.15.103:0/3096314608 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcefc05b490 con 0x7fcefc060ea0 2020-04-22T14:02:38.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.379+0000 7fcefb7fe700 1 --2- 172.21.15.103:0/3096314608 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcefc060ea0 0x7fcefc1461d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fceec0010d0 tx=0x7fcef00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.379+0000 7fcefb7fe700 1 --2- 172.21.15.103:0/3096314608 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcefc060ea0 0x7fcefc1461d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fceec0010d0 tx=0x7fcef00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.379+0000 7fcefb7fe700 1 --2- 172.21.15.103:0/3096314608 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcefc060ea0 0x7fcefc1461d0 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7fceec0010d0 tx=0x7fcef00088e0).ready entity=mon.2 client_cookie=b10c1d5b608911bf server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:38.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.379+0000 7fcefb7fe700 1 --2- 172.21.15.103:0/3096314608 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcefc060ea0 0x7fcefc1461d0 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7fceec0010d0 tx=0x7fcef00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.379+0000 7fcefaffd700 1 -- 172.21.15.103:0/3096314608 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fceec0016d0 con 0x7fcefc060ea0 2020-04-22T14:02:38.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.379+0000 7fcefb7fe700 1 --2- 172.21.15.103:0/3096314608 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcefc060ea0 0x7fcefc1461d0 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7fceec0010d0 tx=0x7fcef00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.379+0000 7fcefb7fe700 1 --2- 172.21.15.103:0/3096314608 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcefc060ea0 0x7fcefc1461d0 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7fceec0010d0 tx=0x7fcef00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.379+0000 7fcefaffd700 1 -- 172.21.15.103:0/3096314608 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef0008e40 con 0x7fcefc060ea0 2020-04-22T14:02:38.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.379+0000 7fcefaffd700 1 -- 172.21.15.103:0/3096314608 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcef0011400 con 0x7fcefc060ea0 2020-04-22T14:02:38.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.379+0000 7fcf027d3700 1 -- 172.21.15.103:0/3096314608 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcefc060ea0 msgr2=0x7fcefc1461d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:38.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.379+0000 7fcf027d3700 1 --2- 172.21.15.103:0/3096314608 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcefc060ea0 0x7fcefc1461d0 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7fceec0010d0 tx=0x7fcef00088e0).stop 2020-04-22T14:02:38.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.379+0000 7fcf027d3700 1 -- 172.21.15.103:0/3096314608 shutdown_connections 2020-04-22T14:02:38.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.379+0000 7fcf027d3700 1 --2- 172.21.15.103:0/3096314608 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcefc060ea0 0x7fcefc1461d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:38.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.379+0000 7fcf027d3700 1 -- 172.21.15.103:0/3096314608 >> 172.21.15.103:0/3096314608 conn(0x7fcefc05fd90 msgr2=0x7fcefc060580 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:38.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.379+0000 7fcf027d3700 1 -- 172.21.15.103:0/3096314608 shutdown_connections 2020-04-22T14:02:38.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.379+0000 7fcf027d3700 1 -- 172.21.15.103:0/3096314608 wait complete. 2020-04-22T14:02:38.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.380+0000 7fcf027d3700 1 Processor -- start 2020-04-22T14:02:38.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.380+0000 7fcf027d3700 1 -- start start 2020-04-22T14:02:38.395 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.381+0000 7fcf027d3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcefc060ea0 0x7fcefc1460e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:38.395 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.381+0000 7fcf027d3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcefc0b3790 0x7fcefc0af580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:38.395 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.381+0000 7fcf027d3700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcefc0af9e0 con 0x7fcefc05b0b0 2020-04-22T14:02:38.395 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.381+0000 7fcf027d3700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcefc0ada50 con 0x7fcefc0b3790 2020-04-22T14:02:38.395 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.381+0000 7fcf027d3700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcefc0adcf0 con 0x7fcefc060ea0 2020-04-22T14:02:38.395 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.381+0000 7fcefb7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcefc060ea0 0x7fcefc1460e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:38.395 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.381+0000 7fcefb7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcefc060ea0 0x7fcefc1460e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47408/0 (socket says 172.21.15.103:47408) 2020-04-22T14:02:38.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.381+0000 7fcefb7fe700 1 -- 172.21.15.103:0/894541834 learned_addr learned my addr 172.21.15.103:0/894541834 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:38.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.381+0000 7fcf00d70700 1 --2- 172.21.15.103:0/894541834 >> v2:172.21.15.86:3300/0 conn(0x7fcefc0b3790 0x7fcefc0af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:38.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.382+0000 7fcefb7fe700 1 -- 172.21.15.103:0/894541834 >> v2:172.21.15.86:3300/0 conn(0x7fcefc0b3790 msgr2=0x7fcefc0af580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:38.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.382+0000 7fcefb7fe700 1 --2- 172.21.15.103:0/894541834 >> v2:172.21.15.86:3300/0 conn(0x7fcefc0b3790 0x7fcefc0af580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:38.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.382+0000 7fcefb7fe700 1 -- 172.21.15.103:0/894541834 >> v1:172.21.15.86:6789/0 conn(0x7fcefc05b0b0 legacy=0x7fcefc143280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:38.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.382+0000 7fcefb7fe700 1 -- 172.21.15.103:0/894541834 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcefc0adf90 con 0x7fcefc060ea0 2020-04-22T14:02:38.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.382+0000 7fcf00d70700 1 --2- 172.21.15.103:0/894541834 >> v2:172.21.15.86:3300/0 conn(0x7fcefc0b3790 0x7fcefc0af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:02:38.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.382+0000 7fcefb7fe700 1 --2- 172.21.15.103:0/894541834 >> v2:172.21.15.103:3300/0 conn(0x7fcefc060ea0 0x7fcefc1460e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fceec0010d0 tx=0x7fcefc05b620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.397 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.382+0000 7fcefb7fe700 1 --2- 172.21.15.103:0/894541834 >> v2:172.21.15.103:3300/0 conn(0x7fcefc060ea0 0x7fcefc1460e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fceec0010d0 tx=0x7fcefc05b620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.397 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.382+0000 7fcefb7fe700 1 --2- 172.21.15.103:0/894541834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcefc060ea0 0x7fcefc1460e0 secure :-1 s=READY pgs=159 cs=0 l=1 rx=0x7fceec0010d0 tx=0x7fcefc05b620).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:38.397 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.382+0000 7fcefb7fe700 1 --2- 172.21.15.103:0/894541834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcefc060ea0 0x7fcefc1460e0 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7fceec0010d0 tx=0x7fcefc05b620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.397 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.382+0000 7fcef97fa700 1 -- 172.21.15.103:0/894541834 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcef0007360 con 0x7fcefc060ea0 2020-04-22T14:02:38.397 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.382+0000 7fcefb7fe700 1 --2- 172.21.15.103:0/894541834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcefc060ea0 0x7fcefc1460e0 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7fceec0010d0 tx=0x7fcefc05b620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.397 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.382+0000 7fcf027d3700 1 -- 172.21.15.103:0/894541834 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcefc143990 con 0x7fcefc060ea0 2020-04-22T14:02:38.397 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.382+0000 7fcef97fa700 1 -- 172.21.15.103:0/894541834 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef00074c0 con 0x7fcefc060ea0 2020-04-22T14:02:38.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.382+0000 7fcefb7fe700 1 --2- 172.21.15.103:0/894541834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcefc060ea0 0x7fcefc1460e0 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7fceec0010d0 tx=0x7fcefc05b620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.382+0000 7fcef97fa700 1 -- 172.21.15.103:0/894541834 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcef0011bf0 con 0x7fcefc060ea0 2020-04-22T14:02:38.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.382+0000 7fcf027d3700 1 -- 172.21.15.103:0/894541834 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcefc0ad490 con 0x7fcefc060ea0 2020-04-22T14:02:38.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.382+0000 7fcefb7fe700 1 --2- 172.21.15.103:0/894541834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcefc060ea0 0x7fcefc1460e0 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7fceec0010d0 tx=0x7fcefc05b620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.383+0000 7fcf027d3700 1 -- 172.21.15.103:0/894541834 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcefc056c90 con 0x7fcefc060ea0 2020-04-22T14:02:38.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.383+0000 7fcef97fa700 1 -- 172.21.15.103:0/894541834 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fcef00056c0 con 0x7fcefc060ea0 2020-04-22T14:02:38.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.383+0000 7fcefb7fe700 1 --2- 172.21.15.103:0/894541834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcefc060ea0 0x7fcefc1460e0 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7fceec0010d0 tx=0x7fcefc05b620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.383+0000 7fcef97fa700 1 --2- 172.21.15.103:0/894541834 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcedc04d840 0x7fcedc04fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:38.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.383+0000 7fcef97fa700 1 -- 172.21.15.103:0/894541834 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcef0061ea0 con 0x7fcefc060ea0 2020-04-22T14:02:38.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.383+0000 7fcefbfff700 1 --2- 172.21.15.103:0/894541834 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcedc04d840 0x7fcedc04fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:38.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.383+0000 7fcefbfff700 1 --2- 172.21.15.103:0/894541834 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcedc04d840 0x7fcedc04fd00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcefc0ae310 tx=0x7fceec001340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.384+0000 7fcefbfff700 1 --2- 172.21.15.103:0/894541834 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcedc04d840 0x7fcedc04fd00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcefc0ae310 tx=0x7fceec001340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.384+0000 7fcefbfff700 1 --2- 172.21.15.103:0/894541834 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcedc04d840 0x7fcedc04fd00 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7fcefc0ae310 tx=0x7fceec001340).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:38.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.387+0000 7fcefb7fe700 1 --2- 172.21.15.103:0/894541834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcefc060ea0 0x7fcefc1460e0 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7fceec0010d0 tx=0x7fcefc05b620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.387+0000 7fcef97fa700 1 -- 172.21.15.103:0/894541834 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fcef003d280 con 0x7fcefc060ea0 2020-04-22T14:02:38.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.528+0000 7fcf027d3700 1 -- 172.21.15.103:0/894541834 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fcefc0b7280 con 0x7fcefc060ea0 2020-04-22T14:02:38.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.529+0000 7fcefb7fe700 1 --2- 172.21.15.103:0/894541834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcefc060ea0 0x7fcefc1460e0 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7fceec0010d0 tx=0x7fcefc05b620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.529+0000 7fcef97fa700 1 -- 172.21.15.103:0/894541834 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcef00408a0 con 0x7fcefc060ea0 2020-04-22T14:02:38.533 INFO:teuthology.orchestra.run.smithi103.stdout:64424509445 2020-04-22T14:02:38.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.530+0000 7fcf027d3700 1 -- 172.21.15.103:0/894541834 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcedc04d840 msgr2=0x7fcedc04fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:38.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.530+0000 7fcf027d3700 1 --2- 172.21.15.103:0/894541834 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcedc04d840 0x7fcedc04fd00 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7fcefc0ae310 tx=0x7fceec001340).stop 2020-04-22T14:02:38.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.530+0000 7fcf027d3700 1 -- 172.21.15.103:0/894541834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcefc060ea0 msgr2=0x7fcefc1460e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:38.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.530+0000 7fcf027d3700 1 --2- 172.21.15.103:0/894541834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcefc060ea0 0x7fcefc1460e0 secure :-1 s=READY pgs=159 cs=0 l=1 rx=0x7fceec0010d0 tx=0x7fcefc05b620).stop 2020-04-22T14:02:38.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.530+0000 7fcf027d3700 1 -- 172.21.15.103:0/894541834 shutdown_connections 2020-04-22T14:02:38.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.530+0000 7fcf027d3700 1 --2- 172.21.15.103:0/894541834 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcedc04d840 0x7fcedc04fd00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:38.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.530+0000 7fcf027d3700 1 --2- 172.21.15.103:0/894541834 >> v2:172.21.15.86:3300/0 conn(0x7fcefc0b3790 0x7fcefc0af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:38.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.530+0000 7fcf027d3700 1 --2- 172.21.15.103:0/894541834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcefc060ea0 0x7fcefc1460e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:38.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.530+0000 7fcf027d3700 1 -- 172.21.15.103:0/894541834 >> 172.21.15.103:0/894541834 conn(0x7fcefc05fd90 msgr2=0x7fcefc0b0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:38.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.530+0000 7fcf027d3700 1 -- 172.21.15.103:0/894541834 shutdown_connections 2020-04-22T14:02:38.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.530+0000 7fcf027d3700 1 -- 172.21.15.103:0/894541834 wait complete. 2020-04-22T14:02:38.544 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.6 2020-04-22T14:02:38.544 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:38.557 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.7 2020-04-22T14:02:38.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.702+0000 7f5ee6eca700 1 Processor -- start 2020-04-22T14:02:38.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.702+0000 7f5ee6eca700 1 -- start start 2020-04-22T14:02:38.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.703+0000 7f5ee6eca700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5ee00b4700 0x7f5ee00afa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:38.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.703+0000 7f5ee6eca700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5ee00b2530 0x7f5ee00afec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:38.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.703+0000 7f5ee6eca700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee00b0e90 con 0x7f5ee00b4320 2020-04-22T14:02:38.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.703+0000 7f5ee6eca700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee00b1130 con 0x7f5ee00b2530 2020-04-22T14:02:38.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.703+0000 7f5ee6eca700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee00b1ce0 con 0x7f5ee00b4700 2020-04-22T14:02:38.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.703+0000 7f5edffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5ee00b4700 0x7f5ee00afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:38.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.703+0000 7f5edffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5ee00b4700 0x7f5ee00afa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47414/0 (socket says 172.21.15.103:47414) 2020-04-22T14:02:38.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.703+0000 7f5edffff700 1 -- 172.21.15.103:0/4094125053 learned_addr learned my addr 172.21.15.103:0/4094125053 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:38.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.703+0000 7f5ee5467700 1 --2- 172.21.15.103:0/4094125053 >> v2:172.21.15.86:3300/0 conn(0x7f5ee00b2530 0x7f5ee00afec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:38.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.703+0000 7f5edffff700 1 -- 172.21.15.103:0/4094125053 >> v2:172.21.15.86:3300/0 conn(0x7f5ee00b2530 msgr2=0x7f5ee00afec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:38.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.703+0000 7f5edffff700 1 --2- 172.21.15.103:0/4094125053 >> v2:172.21.15.86:3300/0 conn(0x7f5ee00b2530 0x7f5ee00afec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:38.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.703+0000 7f5edffff700 1 -- 172.21.15.103:0/4094125053 >> v1:172.21.15.86:6789/0 conn(0x7f5ee00b4320 legacy=0x7f5ee00b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:38.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.703+0000 7f5edffff700 1 -- 172.21.15.103:0/4094125053 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee00ae500 con 0x7f5ee00b4700 2020-04-22T14:02:38.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.703+0000 7f5edffff700 1 --2- 172.21.15.103:0/4094125053 >> v2:172.21.15.103:3300/0 conn(0x7f5ee00b4700 0x7f5ee00afa60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5ee00af970 tx=0x7f5ed4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.703+0000 7f5edffff700 1 --2- 172.21.15.103:0/4094125053 >> v2:172.21.15.103:3300/0 conn(0x7f5ee00b4700 0x7f5ee00afa60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5ee00af970 tx=0x7f5ed4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.703+0000 7f5edffff700 1 --2- 172.21.15.103:0/4094125053 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ee00b4700 0x7f5ee00afa60 secure :-1 s=READY pgs=160 cs=0 l=1 rx=0x7f5ee00af970 tx=0x7f5ed4007a40).ready entity=mon.1 client_cookie=fa564f0b07694d19 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:38.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.704+0000 7f5edffff700 1 --2- 172.21.15.103:0/4094125053 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ee00b4700 0x7f5ee00afa60 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f5ee00af970 tx=0x7f5ed4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.704+0000 7f5edf7fe700 1 -- 172.21.15.103:0/4094125053 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ed40116e0 con 0x7f5ee00b4700 2020-04-22T14:02:38.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.704+0000 7f5edffff700 1 --2- 172.21.15.103:0/4094125053 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ee00b4700 0x7f5ee00afa60 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f5ee00af970 tx=0x7f5ed4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.704+0000 7f5edf7fe700 1 -- 172.21.15.103:0/4094125053 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed4011840 con 0x7f5ee00b4700 2020-04-22T14:02:38.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.704+0000 7f5edffff700 1 --2- 172.21.15.103:0/4094125053 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ee00b4700 0x7f5ee00afa60 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f5ee00af970 tx=0x7f5ed4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.704+0000 7f5edf7fe700 1 -- 172.21.15.103:0/4094125053 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ed4011c20 con 0x7f5ee00b4700 2020-04-22T14:02:38.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.704+0000 7f5ee6eca700 1 -- 172.21.15.103:0/4094125053 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ee00b4700 msgr2=0x7f5ee00afa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:38.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.704+0000 7f5ee6eca700 1 --2- 172.21.15.103:0/4094125053 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ee00b4700 0x7f5ee00afa60 secure :-1 s=READY pgs=160 cs=0 l=1 rx=0x7f5ee00af970 tx=0x7f5ed4007a40).stop 2020-04-22T14:02:38.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.704+0000 7f5ee6eca700 1 -- 172.21.15.103:0/4094125053 shutdown_connections 2020-04-22T14:02:38.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.704+0000 7f5ee6eca700 1 --2- 172.21.15.103:0/4094125053 >> v2:172.21.15.86:3300/0 conn(0x7f5ee00b2530 0x7f5ee00afec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:38.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.704+0000 7f5ee6eca700 1 --2- 172.21.15.103:0/4094125053 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ee00b4700 0x7f5ee00afa60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:38.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.704+0000 7f5ee6eca700 1 -- 172.21.15.103:0/4094125053 >> 172.21.15.103:0/4094125053 conn(0x7f5ee00b86b0 msgr2=0x7f5ee00b8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:38.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.704+0000 7f5ee6eca700 1 -- 172.21.15.103:0/4094125053 shutdown_connections 2020-04-22T14:02:38.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.704+0000 7f5ee6eca700 1 -- 172.21.15.103:0/4094125053 wait complete. 2020-04-22T14:02:38.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.705+0000 7f5ee6eca700 1 Processor -- start 2020-04-22T14:02:38.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.705+0000 7f5ee6eca700 1 -- start start 2020-04-22T14:02:38.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.706+0000 7f5ee6eca700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5ee00b4700 0x7f5ee0141770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:38.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.706+0000 7f5ee6eca700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee01516b0 con 0x7f5ee00b4320 2020-04-22T14:02:38.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.706+0000 7f5ee6eca700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee0151440 con 0x7f5ee00b2530 2020-04-22T14:02:38.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.706+0000 7f5ee6eca700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee0065c10 con 0x7f5ee00b4700 2020-04-22T14:02:38.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.706+0000 7f5ee4c66700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f5ee00b2530 0x7f5ee0150d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39610/0 (socket says 172.21.15.103:39610) 2020-04-22T14:02:38.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.706+0000 7f5ee4c66700 1 -- 172.21.15.103:0/1528060513 learned_addr learned my addr 172.21.15.103:0/1528060513 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:38.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.706+0000 7f5ee5467700 1 --2- 172.21.15.103:0/1528060513 >> v2:172.21.15.103:3300/0 conn(0x7f5ee00b4700 0x7f5ee0141770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:38.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.706+0000 7f5ee5467700 1 -- 172.21.15.103:0/1528060513 >> v1:172.21.15.103:6789/0 conn(0x7f5ee00b2530 legacy=0x7f5ee0150d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:38.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.706+0000 7f5ee5467700 1 -- 172.21.15.103:0/1528060513 >> v1:172.21.15.86:6789/0 conn(0x7f5ee00b4320 legacy=0x7f5ee012a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:38.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.706+0000 7f5ee5467700 1 -- 172.21.15.103:0/1528060513 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee0065eb0 con 0x7f5ee00b4700 2020-04-22T14:02:38.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.706+0000 7f5eddffb700 1 -- 172.21.15.103:0/1528060513 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4081742704 0 0) 0x7f5ee0151440 con 0x7f5ee00b2530 2020-04-22T14:02:38.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.706+0000 7f5ee5467700 1 --2- 172.21.15.103:0/1528060513 >> v2:172.21.15.103:3300/0 conn(0x7f5ee00b4700 0x7f5ee0141770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5ed0002f30 tx=0x7f5ed0010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.706+0000 7f5ee5467700 1 --2- 172.21.15.103:0/1528060513 >> v2:172.21.15.103:3300/0 conn(0x7f5ee00b4700 0x7f5ee0141770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5ed0002f30 tx=0x7f5ed0010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.706+0000 7f5ee5467700 1 --2- 172.21.15.103:0/1528060513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ee00b4700 0x7f5ee0141770 secure :-1 s=READY pgs=162 cs=0 l=1 rx=0x7f5ed0002f30 tx=0x7f5ed0010b70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:38.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.706+0000 7f5ee5467700 1 --2- 172.21.15.103:0/1528060513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ee00b4700 0x7f5ee0141770 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f5ed0002f30 tx=0x7f5ed0010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.706+0000 7f5eddffb700 1 -- 172.21.15.103:0/1528060513 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ed0005aa0 con 0x7f5ee00b4700 2020-04-22T14:02:38.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.707+0000 7f5ee5467700 1 --2- 172.21.15.103:0/1528060513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ee00b4700 0x7f5ee0141770 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f5ed0002f30 tx=0x7f5ed0010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.707+0000 7f5ee5467700 1 --2- 172.21.15.103:0/1528060513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ee00b4700 0x7f5ee0141770 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f5ed0002f30 tx=0x7f5ed0010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.707+0000 7f5eddffb700 1 -- 172.21.15.103:0/1528060513 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed0005c00 con 0x7f5ee00b4700 2020-04-22T14:02:38.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.707+0000 7f5ee6eca700 1 -- 172.21.15.103:0/1528060513 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee012a720 con 0x7f5ee00b4700 2020-04-22T14:02:38.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.707+0000 7f5eddffb700 1 -- 172.21.15.103:0/1528060513 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ed0012650 con 0x7f5ee00b4700 2020-04-22T14:02:38.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.707+0000 7f5ee6eca700 1 -- 172.21.15.103:0/1528060513 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee0066350 con 0x7f5ee00b4700 2020-04-22T14:02:38.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.707+0000 7f5ee5467700 1 --2- 172.21.15.103:0/1528060513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ee00b4700 0x7f5ee0141770 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f5ed0002f30 tx=0x7f5ed0010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.707+0000 7f5ee6eca700 1 -- 172.21.15.103:0/1528060513 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ee0056c90 con 0x7f5ee00b4700 2020-04-22T14:02:38.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.708+0000 7f5eddffb700 1 -- 172.21.15.103:0/1528060513 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f5ed00071a0 con 0x7f5ee00b4700 2020-04-22T14:02:38.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.708+0000 7f5ee5467700 1 --2- 172.21.15.103:0/1528060513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ee00b4700 0x7f5ee0141770 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f5ed0002f30 tx=0x7f5ed0010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.708+0000 7f5eddffb700 1 --2- 172.21.15.103:0/1528060513 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5ec004d7d0 0x7f5ec004fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:38.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.708+0000 7f5eddffb700 1 -- 172.21.15.103:0/1528060513 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5ed00614d0 con 0x7f5ee00b4700 2020-04-22T14:02:38.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.708+0000 7f5ee4c66700 1 --2- 172.21.15.103:0/1528060513 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5ec004d7d0 0x7f5ec004fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:38.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.708+0000 7f5ee4c66700 1 --2- 172.21.15.103:0/1528060513 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5ec004d7d0 0x7f5ec004fc90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5ed80025e0 tx=0x7f5ed8002b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.708+0000 7f5ee4c66700 1 --2- 172.21.15.103:0/1528060513 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5ec004d7d0 0x7f5ec004fc90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5ed80025e0 tx=0x7f5ed8002b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.708+0000 7f5ee4c66700 1 --2- 172.21.15.103:0/1528060513 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5ec004d7d0 0x7f5ec004fc90 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7f5ed80025e0 tx=0x7f5ed8002b40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:38.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.712+0000 7f5ee5467700 1 --2- 172.21.15.103:0/1528060513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ee00b4700 0x7f5ee0141770 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f5ed0002f30 tx=0x7f5ed0010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.712+0000 7f5eddffb700 1 -- 172.21.15.103:0/1528060513 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f5ed003c910 con 0x7f5ee00b4700 2020-04-22T14:02:38.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.854+0000 7f5ee6eca700 1 -- 172.21.15.103:0/1528060513 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f5ee005a640 con 0x7f5ee00b4700 2020-04-22T14:02:38.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.855+0000 7f5ee5467700 1 --2- 172.21.15.103:0/1528060513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ee00b4700 0x7f5ee0141770 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f5ed0002f30 tx=0x7f5ed0010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:38.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.855+0000 7f5eddffb700 1 -- 172.21.15.103:0/1528060513 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5ed003ff30 con 0x7f5ee00b4700 2020-04-22T14:02:38.859 INFO:teuthology.orchestra.run.smithi103.stdout:64424509446 2020-04-22T14:02:38.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.856+0000 7f5ee6eca700 1 -- 172.21.15.103:0/1528060513 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5ec004d7d0 msgr2=0x7f5ec004fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:38.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.856+0000 7f5ee6eca700 1 --2- 172.21.15.103:0/1528060513 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5ec004d7d0 0x7f5ec004fc90 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7f5ed80025e0 tx=0x7f5ed8002b40).stop 2020-04-22T14:02:38.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.856+0000 7f5ee6eca700 1 -- 172.21.15.103:0/1528060513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ee00b4700 msgr2=0x7f5ee0141770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:38.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.856+0000 7f5ee6eca700 1 --2- 172.21.15.103:0/1528060513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ee00b4700 0x7f5ee0141770 secure :-1 s=READY pgs=162 cs=0 l=1 rx=0x7f5ed0002f30 tx=0x7f5ed0010b70).stop 2020-04-22T14:02:38.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.856+0000 7f5ee6eca700 1 -- 172.21.15.103:0/1528060513 shutdown_connections 2020-04-22T14:02:38.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.856+0000 7f5ee6eca700 1 --2- 172.21.15.103:0/1528060513 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5ec004d7d0 0x7f5ec004fc90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:38.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.856+0000 7f5ee6eca700 1 --2- 172.21.15.103:0/1528060513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ee00b4700 0x7f5ee0141770 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:38.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.856+0000 7f5ee6eca700 1 -- 172.21.15.103:0/1528060513 >> 172.21.15.103:0/1528060513 conn(0x7f5ee00b86b0 msgr2=0x7f5ee00b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:38.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.856+0000 7f5ee6eca700 1 -- 172.21.15.103:0/1528060513 shutdown_connections 2020-04-22T14:02:38.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:38.856+0000 7f5ee6eca700 1 -- 172.21.15.103:0/1528060513 wait complete. 2020-04-22T14:02:38.870 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.7 2020-04-22T14:02:38.870 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-04-22T14:02:38.871 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:38.884 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-04-22T14:02:39.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.026+0000 7f0c63f26700 1 Processor -- start 2020-04-22T14:02:39.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.027+0000 7f0c63f26700 1 -- start start 2020-04-22T14:02:39.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.027+0000 7f0c63f26700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0c5c067170 0x7f0c5c0b6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:39.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.027+0000 7f0c63f26700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0c5c0ac740 0x7f0c5c13c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:39.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.027+0000 7f0c63f26700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0c5c13c7e0 0x7f0c5c0b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:39.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.027+0000 7f0c63f26700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c5c065af0 con 0x7f0c5c13c7e0 2020-04-22T14:02:39.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.027+0000 7f0c63f26700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c5c064ec0 con 0x7f0c5c067170 2020-04-22T14:02:39.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.027+0000 7f0c63f26700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c146870 con 0x7f0c5c0ac740 2020-04-22T14:02:39.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.028+0000 7f0c61cc2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0c5c067170 0x7f0c5c0b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:39.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.028+0000 7f0c61cc2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0c5c067170 0x7f0c5c0b6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47426/0 (socket says 172.21.15.103:47426) 2020-04-22T14:02:39.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.028+0000 7f0c61cc2700 1 -- 172.21.15.103:0/1451169450 learned_addr learned my addr 172.21.15.103:0/1451169450 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:39.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.028+0000 7f0c624c3700 1 --2- 172.21.15.103:0/1451169450 >> v2:172.21.15.86:3300/0 conn(0x7f0c5c13c7e0 0x7f0c5c0b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:39.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.028+0000 7f0c61cc2700 1 -- 172.21.15.103:0/1451169450 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0c5c0ac740 msgr2=0x7f0c5c13c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:39.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.028+0000 7f0c614c1700 1 --2- 172.21.15.103:0/1451169450 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0c5c0ac740 0x7f0c5c13c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:39.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.028+0000 7f0c61cc2700 1 --2- 172.21.15.103:0/1451169450 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0c5c0ac740 0x7f0c5c13c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:39.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.028+0000 7f0c61cc2700 1 -- 172.21.15.103:0/1451169450 >> v2:172.21.15.86:3300/0 conn(0x7f0c5c13c7e0 msgr2=0x7f0c5c0b4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:39.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.028+0000 7f0c61cc2700 1 --2- 172.21.15.103:0/1451169450 >> v2:172.21.15.86:3300/0 conn(0x7f0c5c13c7e0 0x7f0c5c0b4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:39.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.028+0000 7f0c61cc2700 1 -- 172.21.15.103:0/1451169450 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c5c067550 con 0x7f0c5c067170 2020-04-22T14:02:39.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.028+0000 7f0c61cc2700 1 --2- 172.21.15.103:0/1451169450 >> v2:172.21.15.103:3300/0 conn(0x7f0c5c067170 0x7f0c5c0b6040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0c58002f30 tx=0x7f0c58007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.028+0000 7f0c61cc2700 1 --2- 172.21.15.103:0/1451169450 >> v2:172.21.15.103:3300/0 conn(0x7f0c5c067170 0x7f0c5c0b6040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0c58002f30 tx=0x7f0c58007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.028+0000 7f0c61cc2700 1 --2- 172.21.15.103:0/1451169450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c5c067170 0x7f0c5c0b6040 secure :-1 s=READY pgs=163 cs=0 l=1 rx=0x7f0c58002f30 tx=0x7f0c58007a40).ready entity=mon.1 client_cookie=26752887119b76c5 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:39.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.028+0000 7f0c61cc2700 1 --2- 172.21.15.103:0/1451169450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c5c067170 0x7f0c5c0b6040 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f0c58002f30 tx=0x7f0c58007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.028+0000 7f0c60cc0700 1 -- 172.21.15.103:0/1451169450 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c58011720 con 0x7f0c5c067170 2020-04-22T14:02:39.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.028+0000 7f0c61cc2700 1 --2- 172.21.15.103:0/1451169450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c5c067170 0x7f0c5c0b6040 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f0c58002f30 tx=0x7f0c58007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.028+0000 7f0c61cc2700 1 --2- 172.21.15.103:0/1451169450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c5c067170 0x7f0c5c0b6040 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f0c58002f30 tx=0x7f0c58007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.028+0000 7f0c60cc0700 1 -- 172.21.15.103:0/1451169450 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c58011880 con 0x7f0c5c067170 2020-04-22T14:02:39.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.028+0000 7f0c60cc0700 1 -- 172.21.15.103:0/1451169450 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c58011ca0 con 0x7f0c5c067170 2020-04-22T14:02:39.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.028+0000 7f0c63f26700 1 -- 172.21.15.103:0/1451169450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c5c067170 msgr2=0x7f0c5c0b6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:39.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.028+0000 7f0c63f26700 1 --2- 172.21.15.103:0/1451169450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c5c067170 0x7f0c5c0b6040 secure :-1 s=READY pgs=163 cs=0 l=1 rx=0x7f0c58002f30 tx=0x7f0c58007a40).stop 2020-04-22T14:02:39.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.029+0000 7f0c63f26700 1 -- 172.21.15.103:0/1451169450 shutdown_connections 2020-04-22T14:02:39.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.029+0000 7f0c63f26700 1 --2- 172.21.15.103:0/1451169450 >> v2:172.21.15.86:3300/0 conn(0x7f0c5c13c7e0 0x7f0c5c0b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:39.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.029+0000 7f0c63f26700 1 --2- 172.21.15.103:0/1451169450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c5c067170 0x7f0c5c0b6040 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:39.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.029+0000 7f0c63f26700 1 --2- 172.21.15.103:0/1451169450 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0c5c0ac740 0x7f0c5c13c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:39.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.029+0000 7f0c63f26700 1 -- 172.21.15.103:0/1451169450 >> 172.21.15.103:0/1451169450 conn(0x7f0c5c0b9160 msgr2=0x7f0c5c05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:39.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.029+0000 7f0c63f26700 1 -- 172.21.15.103:0/1451169450 shutdown_connections 2020-04-22T14:02:39.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.029+0000 7f0c63f26700 1 -- 172.21.15.103:0/1451169450 wait complete. 2020-04-22T14:02:39.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.030+0000 7f0c63f26700 1 Processor -- start 2020-04-22T14:02:39.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.030+0000 7f0c63f26700 1 -- start start 2020-04-22T14:02:39.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.030+0000 7f0c63f26700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0c5c13c7e0 0x7f0c5c1470e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:39.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.030+0000 7f0c63f26700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c5c132be0 con 0x7f0c5c067170 2020-04-22T14:02:39.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.030+0000 7f0c63f26700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c5c134080 con 0x7f0c5c0ac740 2020-04-22T14:02:39.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.030+0000 7f0c63f26700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c5c149860 con 0x7f0c5c13c7e0 2020-04-22T14:02:39.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.030+0000 7f0c614c1700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f0c5c0ac740 0x7f0c5c134cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39624/0 (socket says 172.21.15.103:39624) 2020-04-22T14:02:39.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.030+0000 7f0c614c1700 1 -- 172.21.15.103:0/2825290741 learned_addr learned my addr 172.21.15.103:0/2825290741 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:39.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.030+0000 7f0c4effd700 1 -- 172.21.15.103:0/2825290741 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 77338393 0 0) 0x7f0c5c134080 con 0x7f0c5c0ac740 2020-04-22T14:02:39.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.030+0000 7f0c4effd700 1 -- 172.21.15.103:0/2825290741 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c3c002fe0 con 0x7f0c5c0ac740 2020-04-22T14:02:39.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.031+0000 7f0c624c3700 1 --2- 172.21.15.103:0/2825290741 >> v2:172.21.15.86:3300/0 conn(0x7f0c5c13c7e0 0x7f0c5c1470e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:39.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.031+0000 7f0c4effd700 1 -- 172.21.15.103:0/2825290741 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2832756175 0 0) 0x7f0c3c002fe0 con 0x7f0c5c0ac740 2020-04-22T14:02:39.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.031+0000 7f0c4effd700 1 -- 172.21.15.103:0/2825290741 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0c5c134080 con 0x7f0c5c0ac740 2020-04-22T14:02:39.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.031+0000 7f0c4effd700 1 -- 172.21.15.103:0/2825290741 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f0c50002710 con 0x7f0c5c0ac740 2020-04-22T14:02:39.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.031+0000 7f0c4effd700 1 -- 172.21.15.103:0/2825290741 >> v2:172.21.15.86:3300/0 conn(0x7f0c5c13c7e0 msgr2=0x7f0c5c1470e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:39.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.031+0000 7f0c4effd700 1 --2- 172.21.15.103:0/2825290741 >> v2:172.21.15.86:3300/0 conn(0x7f0c5c13c7e0 0x7f0c5c1470e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:39.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.031+0000 7f0c4effd700 1 -- 172.21.15.103:0/2825290741 >> v1:172.21.15.103:6789/0 conn(0x7f0c5c0ac740 legacy=0x7f0c5c134cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:39.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.031+0000 7f0c4effd700 1 -- 172.21.15.103:0/2825290741 >> v1:172.21.15.86:6789/0 conn(0x7f0c5c067170 legacy=0x7f0c5c131d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:39.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.031+0000 7f0c4effd700 1 --2- 172.21.15.103:0/2825290741 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c3c0049b0 0x7f0c3c004db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:39.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.031+0000 7f0c4effd700 1 --2- 172.21.15.103:0/2825290741 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0c3c003920 0x7f0c3c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:39.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.031+0000 7f0c4effd700 1 --2- 172.21.15.103:0/2825290741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c3c0041e0 0x7f0c3c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:39.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.031+0000 7f0c4effd700 1 -- 172.21.15.103:0/2825290741 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c149860 con 0x7f0c3c0041e0 2020-04-22T14:02:39.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.031+0000 7f0c4effd700 1 -- 172.21.15.103:0/2825290741 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c0046f0 con 0x7f0c3c0049b0 2020-04-22T14:02:39.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.031+0000 7f0c4effd700 1 -- 172.21.15.103:0/2825290741 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c00bbb0 con 0x7f0c3c003920 2020-04-22T14:02:39.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.031+0000 7f0c61cc2700 1 --2- 172.21.15.103:0/2825290741 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c3c0049b0 0x7f0c3c004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:39.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.031+0000 7f0c614c1700 1 --2- 172.21.15.103:0/2825290741 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0c3c003920 0x7f0c3c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:39.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.031+0000 7f0c624c3700 1 --2- 172.21.15.103:0/2825290741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c3c0041e0 0x7f0c3c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:39.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.031+0000 7f0c61cc2700 1 -- 172.21.15.103:0/2825290741 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0c3c003920 msgr2=0x7f0c3c003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:39.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.031+0000 7f0c61cc2700 1 --2- 172.21.15.103:0/2825290741 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0c3c003920 0x7f0c3c003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:39.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.031+0000 7f0c61cc2700 1 -- 172.21.15.103:0/2825290741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c3c0041e0 msgr2=0x7f0c3c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:39.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.031+0000 7f0c61cc2700 1 --2- 172.21.15.103:0/2825290741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c3c0041e0 0x7f0c3c00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:39.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.031+0000 7f0c61cc2700 1 -- 172.21.15.103:0/2825290741 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c5c1499a0 con 0x7f0c3c0049b0 2020-04-22T14:02:39.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.031+0000 7f0c624c3700 1 -- 172.21.15.103:0/2825290741 reap_dead start 2020-04-22T14:02:39.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.031+0000 7f0c63f26700 1 -- 172.21.15.103:0/2825290741 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c5c133860 con 0x7f0c3c0049b0 2020-04-22T14:02:39.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.031+0000 7f0c63f26700 1 -- 172.21.15.103:0/2825290741 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c5c1470e0 con 0x7f0c3c0049b0 2020-04-22T14:02:39.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.031+0000 7f0c61cc2700 1 --2- 172.21.15.103:0/2825290741 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c3c0049b0 0x7f0c3c004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0c5c1347c0 tx=0x7f0c58007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.031+0000 7f0c61cc2700 1 --2- 172.21.15.103:0/2825290741 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c3c0049b0 0x7f0c3c004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0c5c1347c0 tx=0x7f0c58007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.031+0000 7f0c61cc2700 1 --2- 172.21.15.103:0/2825290741 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c3c0049b0 0x7f0c3c004db0 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7f0c5c1347c0 tx=0x7f0c58007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:39.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.032+0000 7f0c61cc2700 1 --2- 172.21.15.103:0/2825290741 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c3c0049b0 0x7f0c3c004db0 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f0c5c1347c0 tx=0x7f0c58007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.032+0000 7f0c61cc2700 1 --2- 172.21.15.103:0/2825290741 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c3c0049b0 0x7f0c3c004db0 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f0c5c1347c0 tx=0x7f0c58007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.032+0000 7f0c61cc2700 1 --2- 172.21.15.103:0/2825290741 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c3c0049b0 0x7f0c3c004db0 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f0c5c1347c0 tx=0x7f0c58007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.032+0000 7f0c4effd700 1 -- 172.21.15.103:0/2825290741 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c58007170 con 0x7f0c3c0049b0 2020-04-22T14:02:39.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.032+0000 7f0c4effd700 1 -- 172.21.15.103:0/2825290741 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c580072d0 con 0x7f0c3c0049b0 2020-04-22T14:02:39.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.032+0000 7f0c4effd700 1 -- 172.21.15.103:0/2825290741 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c580056c0 con 0x7f0c3c0049b0 2020-04-22T14:02:39.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.032+0000 7f0c61cc2700 1 --2- 172.21.15.103:0/2825290741 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c3c0049b0 0x7f0c3c004db0 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f0c5c1347c0 tx=0x7f0c58007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.032+0000 7f0c63f26700 1 -- 172.21.15.103:0/2825290741 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c38003340 con 0x7f0c3c0049b0 2020-04-22T14:02:39.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.032+0000 7f0c4effd700 1 -- 172.21.15.103:0/2825290741 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f0c58005820 con 0x7f0c3c0049b0 2020-04-22T14:02:39.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.033+0000 7f0c61cc2700 1 --2- 172.21.15.103:0/2825290741 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c3c0049b0 0x7f0c3c004db0 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f0c5c1347c0 tx=0x7f0c58007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.033+0000 7f0c4effd700 1 --2- 172.21.15.103:0/2825290741 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0c3c051840 0x7f0c3c053d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:39.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.033+0000 7f0c4effd700 1 -- 172.21.15.103:0/2825290741 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0c58061ab0 con 0x7f0c3c0049b0 2020-04-22T14:02:39.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.033+0000 7f0c614c1700 1 --2- 172.21.15.103:0/2825290741 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0c3c051840 0x7f0c3c053d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:39.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.033+0000 7f0c614c1700 1 --2- 172.21.15.103:0/2825290741 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0c3c051840 0x7f0c3c053d00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0c500024a0 tx=0x7f0c50002db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.033+0000 7f0c614c1700 1 --2- 172.21.15.103:0/2825290741 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0c3c051840 0x7f0c3c053d00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0c500024a0 tx=0x7f0c50002db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.033+0000 7f0c614c1700 1 --2- 172.21.15.103:0/2825290741 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0c3c051840 0x7f0c3c053d00 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f0c500024a0 tx=0x7f0c50002db0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:39.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.037+0000 7f0c61cc2700 1 --2- 172.21.15.103:0/2825290741 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c3c0049b0 0x7f0c3c004db0 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f0c5c1347c0 tx=0x7f0c58007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.037+0000 7f0c4effd700 1 -- 172.21.15.103:0/2825290741 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f0c5803cfd0 con 0x7f0c3c0049b0 2020-04-22T14:02:39.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.175+0000 7f0c63f26700 1 -- 172.21.15.103:0/2825290741 --> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0c380021a0 con 0x7f0c3c051840 2020-04-22T14:02:39.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.178+0000 7f0c614c1700 1 --2- 172.21.15.103:0/2825290741 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0c3c051840 0x7f0c3c053d00 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f0c500024a0 tx=0x7f0c50002db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.178+0000 7f0c4effd700 1 -- 172.21.15.103:0/2825290741 <== mgr.4107 v2:172.21.15.86:6800/32242 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82233 (secure 0 0 0) 0x7f0c380021a0 con 0x7f0c3c051840 2020-04-22T14:02:39.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.179+0000 7f0c63f26700 1 -- 172.21.15.103:0/2825290741 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0c3c051840 msgr2=0x7f0c3c053d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:39.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.179+0000 7f0c63f26700 1 --2- 172.21.15.103:0/2825290741 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0c3c051840 0x7f0c3c053d00 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f0c500024a0 tx=0x7f0c50002db0).stop 2020-04-22T14:02:39.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.179+0000 7f0c63f26700 1 -- 172.21.15.103:0/2825290741 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c3c0049b0 msgr2=0x7f0c3c004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:39.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.179+0000 7f0c63f26700 1 --2- 172.21.15.103:0/2825290741 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c3c0049b0 0x7f0c3c004db0 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7f0c5c1347c0 tx=0x7f0c58007a40).stop 2020-04-22T14:02:39.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.180+0000 7f0c63f26700 1 -- 172.21.15.103:0/2825290741 shutdown_connections 2020-04-22T14:02:39.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.180+0000 7f0c63f26700 1 --2- 172.21.15.103:0/2825290741 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0c3c051840 0x7f0c3c053d00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:39.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.180+0000 7f0c63f26700 1 --2- 172.21.15.103:0/2825290741 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c3c0049b0 0x7f0c3c004db0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:39.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.180+0000 7f0c63f26700 1 -- 172.21.15.103:0/2825290741 >> 172.21.15.103:0/2825290741 conn(0x7f0c5c0b9160 msgr2=0x7f0c5c061670 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:39.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.180+0000 7f0c63f26700 1 -- 172.21.15.103:0/2825290741 shutdown_connections 2020-04-22T14:02:39.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.180+0000 7f0c63f26700 1 -- 172.21.15.103:0/2825290741 wait complete. 2020-04-22T14:02:39.187 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:02:39.188 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2020-04-22T14:02:39.198 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2020-04-22T14:02:37.551342+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390656,"kb_used_data":1984,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584064,"statfs":{"total":773094113280,"available":764502081536,"internally_reserved":8589934592,"allocated":2031616,"data_stored":764100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.863746"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"9","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-22T14:02:27.698261+0000","last_change":"2020-04-22T14:02:27.697820+0000","last_active":"2020-04-22T14:02:27.698261+0000","last_peered":"2020-04-22T14:02:27.698261+0000","last_clean":"2020-04-22T14:02:27.698261+0000","last_became_active":"2020-04-22T14:02:27.697396+0000","last_became_peered":"2020-04-22T14:02:27.697396+0000","last_unstale":"2020-04-22T14:02:27.698261+0000","last_undegraded":"2020-04-22T14:02:27.698261+0000","last_fullsized":"2020-04-22T14:02:27.698261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:27.293036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:27.293036+0000","last_clean_scrub_stamp":"2020-04-22T14:02:27.293036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-22T14:02:27.694539+0000","last_change":"2020-04-22T14:02:24.517988+0000","last_active":"2020-04-22T14:02:27.694539+0000","last_peered":"2020-04-22T14:02:27.694539+0000","last_clean":"2020-04-22T14:02:27.694539+0000","last_became_active":"2020-04-22T14:02:24.517695+0000","last_became_peered":"2020-04-22T14:02:24.517695+0000","last_unstale":"2020-04-22T14:02:27.694539+0000","last_undegraded":"2020-04-22T14:02:27.694539+0000","last_fullsized":"2020-04-22T14:02:27.694539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:23.271699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:23.271699+0000","last_clean_scrub_stamp":"2020-04-22T14:02:23.271699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"24'6","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-04-22T14:02:31.285565+0000","last_change":"2020-04-22T14:02:27.306196+0000","last_active":"2020-04-22T14:02:31.285565+0000","last_peered":"2020-04-22T14:02:31.285565+0000","last_clean":"2020-04-22T14:02:31.285565+0000","last_became_active":"2020-04-22T14:02:27.305812+0000","last_became_peered":"2020-04-22T14:02:27.305812+0000","last_unstale":"2020-04-22T14:02:31.285565+0000","last_undegraded":"2020-04-22T14:02:31.285565+0000","last_fullsized":"2020-04-22T14:02:31.285565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:26.288702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:26.288702+0000","last_clean_scrub_stamp":"2020-04-22T14:02:26.288702+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"9","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-22T14:02:27.696255+0000","last_change":"2020-04-22T14:02:27.695857+0000","last_active":"2020-04-22T14:02:27.696255+0000","last_peered":"2020-04-22T14:02:27.696255+0000","last_clean":"2020-04-22T14:02:27.696255+0000","last_became_active":"2020-04-22T14:02:27.695494+0000","last_became_peered":"2020-04-22T14:02:27.695494+0000","last_unstale":"2020-04-22T14:02:27.696255+0000","last_undegraded":"2020-04-22T14:02:27.696255+0000","last_fullsized":"2020-04-22T14:02:27.696255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:27.293036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:27.293036+0000","last_clean_scrub_stamp":"2020-04-22T14:02:27.293036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-22T14:02:27.696552+0000","last_change":"2020-04-22T14:02:24.292109+0000","last_active":"2020-04-22T14:02:27.696552+0000","last_peered":"2020-04-22T14:02:27.696552+0000","last_clean":"2020-04-22T14:02:27.696552+0000","last_became_active":"2020-04-22T14:02:24.291674+0000","last_became_peered":"2020-04-22T14:02:24.291674+0000","last_unstale":"2020-04-22T14:02:27.696552+0000","last_undegraded":"2020-04-22T14:02:27.696552+0000","last_fullsized":"2020-04-22T14:02:27.696552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:23.271699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:23.271699+0000","last_clean_scrub_stamp":"2020-04-22T14:02:23.271699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"24'5","reported_seq":"15","reported_epoch":"24","state":"active+clean","last_fresh":"2020-04-22T14:02:31.284543+0000","last_change":"2020-04-22T14:02:27.308515+0000","last_active":"2020-04-22T14:02:31.284543+0000","last_peered":"2020-04-22T14:02:31.284543+0000","last_clean":"2020-04-22T14:02:31.284543+0000","last_became_active":"2020-04-22T14:02:27.308084+0000","last_became_peered":"2020-04-22T14:02:27.308084+0000","last_unstale":"2020-04-22T14:02:31.284543+0000","last_undegraded":"2020-04-22T14:02:31.284543+0000","last_fullsized":"2020-04-22T14:02:31.284543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:26.288702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:26.288702+0000","last_clean_scrub_stamp":"2020-04-22T14:02:26.288702+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"9","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-22T14:02:27.698265+0000","last_change":"2020-04-22T14:02:27.697914+0000","last_active":"2020-04-22T14:02:27.698265+0000","last_peered":"2020-04-22T14:02:27.698265+0000","last_clean":"2020-04-22T14:02:27.698265+0000","last_became_active":"2020-04-22T14:02:27.697565+0000","last_became_peered":"2020-04-22T14:02:27.697565+0000","last_unstale":"2020-04-22T14:02:27.698265+0000","last_undegraded":"2020-04-22T14:02:27.698265+0000","last_fullsized":"2020-04-22T14:02:27.698265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:27.293036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:27.293036+0000","last_clean_scrub_stamp":"2020-04-22T14:02:27.293036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-22T14:02:27.690626+0000","last_change":"2020-04-22T14:02:24.448234+0000","last_active":"2020-04-22T14:02:27.690626+0000","last_peered":"2020-04-22T14:02:27.690626+0000","last_clean":"2020-04-22T14:02:27.690626+0000","last_became_active":"2020-04-22T14:02:24.447820+0000","last_became_peered":"2020-04-22T14:02:24.447820+0000","last_unstale":"2020-04-22T14:02:27.690626+0000","last_undegraded":"2020-04-22T14:02:27.690626+0000","last_fullsized":"2020-04-22T14:02:27.690626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:23.271699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:23.271699+0000","last_clean_scrub_stamp":"2020-04-22T14:02:23.271699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"24'8","reported_seq":"18","reported_epoch":"24","state":"active+clean","last_fresh":"2020-04-22T14:02:31.287938+0000","last_change":"2020-04-22T14:02:27.306105+0000","last_active":"2020-04-22T14:02:31.287938+0000","last_peered":"2020-04-22T14:02:31.287938+0000","last_clean":"2020-04-22T14:02:31.287938+0000","last_became_active":"2020-04-22T14:02:27.305684+0000","last_became_peered":"2020-04-22T14:02:27.305684+0000","last_unstale":"2020-04-22T14:02:31.287938+0000","last_undegraded":"2020-04-22T14:02:31.287938+0000","last_fullsized":"2020-04-22T14:02:31.287938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:26.288702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:26.288702+0000","last_clean_scrub_stamp":"2020-04-22T14:02:26.288702+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"9","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-22T14:02:27.693661+0000","last_change":"2020-04-22T14:02:27.693379+0000","last_active":"2020-04-22T14:02:27.693661+0000","last_peered":"2020-04-22T14:02:27.693661+0000","last_clean":"2020-04-22T14:02:27.693661+0000","last_became_active":"2020-04-22T14:02:27.693010+0000","last_became_peered":"2020-04-22T14:02:27.693010+0000","last_unstale":"2020-04-22T14:02:27.693661+0000","last_undegraded":"2020-04-22T14:02:27.693661+0000","last_fullsized":"2020-04-22T14:02:27.693661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:27.293036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:27.293036+0000","last_clean_scrub_stamp":"2020-04-22T14:02:27.293036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-22T14:02:27.696583+0000","last_change":"2020-04-22T14:02:24.290971+0000","last_active":"2020-04-22T14:02:27.696583+0000","last_peered":"2020-04-22T14:02:27.696583+0000","last_clean":"2020-04-22T14:02:27.696583+0000","last_became_active":"2020-04-22T14:02:24.290567+0000","last_became_peered":"2020-04-22T14:02:24.290567+0000","last_unstale":"2020-04-22T14:02:27.696583+0000","last_undegraded":"2020-04-22T14:02:27.696583+0000","last_fullsized":"2020-04-22T14:02:27.696583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:23.271699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:23.271699+0000","last_clean_scrub_stamp":"2020-04-22T14:02:23.271699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"18","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-22T14:02:27.968705+0000","last_change":"2020-04-22T14:02:19.736062+0000","last_active":"2020-04-22T14:02:27.968705+0000","last_peered":"2020-04-22T14:02:27.968705+0000","last_clean":"2020-04-22T14:02:27.968705+0000","last_became_active":"2020-04-22T14:02:19.735354+0000","last_became_peered":"2020-04-22T14:02:19.735354+0000","last_unstale":"2020-04-22T14:02:27.968705+0000","last_undegraded":"2020-04-22T14:02:27.968705+0000","last_fullsized":"2020-04-22T14:02:27.968705+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":3,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:10.544834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:10.544834+0000","last_clean_scrub_stamp":"2020-04-22T14:02:10.544834+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"24'1","reported_seq":"11","reported_epoch":"24","state":"active+clean","last_fresh":"2020-04-22T14:02:28.990305+0000","last_change":"2020-04-22T14:02:27.305067+0000","last_active":"2020-04-22T14:02:28.990305+0000","last_peered":"2020-04-22T14:02:28.990305+0000","last_clean":"2020-04-22T14:02:28.990305+0000","last_became_active":"2020-04-22T14:02:27.304462+0000","last_became_peered":"2020-04-22T14:02:27.304462+0000","last_unstale":"2020-04-22T14:02:28.990305+0000","last_undegraded":"2020-04-22T14:02:28.990305+0000","last_fullsized":"2020-04-22T14:02:28.990305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:26.288702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:26.288702+0000","last_clean_scrub_stamp":"2020-04-22T14:02:26.288702+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"9","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-22T14:02:27.696178+0000","last_change":"2020-04-22T14:02:27.695782+0000","last_active":"2020-04-22T14:02:27.696178+0000","last_peered":"2020-04-22T14:02:27.696178+0000","last_clean":"2020-04-22T14:02:27.696178+0000","last_became_active":"2020-04-22T14:02:27.695395+0000","last_became_peered":"2020-04-22T14:02:27.695395+0000","last_unstale":"2020-04-22T14:02:27.696178+0000","last_undegraded":"2020-04-22T14:02:27.696178+0000","last_fullsized":"2020-04-22T14:02:27.696178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:27.293036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:27.293036+0000","last_clean_scrub_stamp":"2020-04-22T14:02:27.293036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-22T14:02:27.969181+0000","last_change":"2020-04-22T14:02:24.291380+0000","last_active":"2020-04-22T14:02:27.969181+0000","last_peered":"2020-04-22T14:02:27.969181+0000","last_clean":"2020-04-22T14:02:27.969181+0000","last_became_active":"2020-04-22T14:02:24.290971+0000","last_became_peered":"2020-04-22T14:02:24.290971+0000","last_unstale":"2020-04-22T14:02:27.969181+0000","last_undegraded":"2020-04-22T14:02:27.969181+0000","last_fullsized":"2020-04-22T14:02:27.969181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:23.271699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:23.271699+0000","last_clean_scrub_stamp":"2020-04-22T14:02:23.271699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-22T14:02:27.693668+0000","last_change":"2020-04-22T14:02:27.305141+0000","last_active":"2020-04-22T14:02:27.693668+0000","last_peered":"2020-04-22T14:02:27.693668+0000","last_clean":"2020-04-22T14:02:27.693668+0000","last_became_active":"2020-04-22T14:02:27.304770+0000","last_became_peered":"2020-04-22T14:02:27.304770+0000","last_unstale":"2020-04-22T14:02:27.693668+0000","last_undegraded":"2020-04-22T14:02:27.693668+0000","last_fullsized":"2020-04-22T14:02:27.693668+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:26.288702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:26.288702+0000","last_clean_scrub_stamp":"2020-04-22T14:02:26.288702+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"9","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-22T14:02:27.698246+0000","last_change":"2020-04-22T14:02:27.697902+0000","last_active":"2020-04-22T14:02:27.698246+0000","last_peered":"2020-04-22T14:02:27.698246+0000","last_clean":"2020-04-22T14:02:27.698246+0000","last_became_active":"2020-04-22T14:02:27.697490+0000","last_became_peered":"2020-04-22T14:02:27.697490+0000","last_unstale":"2020-04-22T14:02:27.698246+0000","last_undegraded":"2020-04-22T14:02:27.698246+0000","last_fullsized":"2020-04-22T14:02:27.698246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:27.293036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:27.293036+0000","last_clean_scrub_stamp":"2020-04-22T14:02:27.293036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-22T14:02:27.968735+0000","last_change":"2020-04-22T14:02:24.518323+0000","last_active":"2020-04-22T14:02:27.968735+0000","last_peered":"2020-04-22T14:02:27.968735+0000","last_clean":"2020-04-22T14:02:27.968735+0000","last_became_active":"2020-04-22T14:02:24.517938+0000","last_became_peered":"2020-04-22T14:02:24.517938+0000","last_unstale":"2020-04-22T14:02:27.968735+0000","last_undegraded":"2020-04-22T14:02:27.968735+0000","last_fullsized":"2020-04-22T14:02:27.968735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:23.271699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:23.271699+0000","last_clean_scrub_stamp":"2020-04-22T14:02:23.271699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"24'8","reported_seq":"18","reported_epoch":"24","state":"active+clean","last_fresh":"2020-04-22T14:02:31.287772+0000","last_change":"2020-04-22T14:02:27.306602+0000","last_active":"2020-04-22T14:02:31.287772+0000","last_peered":"2020-04-22T14:02:31.287772+0000","last_clean":"2020-04-22T14:02:31.287772+0000","last_became_active":"2020-04-22T14:02:27.306222+0000","last_became_peered":"2020-04-22T14:02:27.306222+0000","last_unstale":"2020-04-22T14:02:31.287772+0000","last_undegraded":"2020-04-22T14:02:31.287772+0000","last_fullsized":"2020-04-22T14:02:31.287772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:26.288702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:26.288702+0000","last_clean_scrub_stamp":"2020-04-22T14:02:26.288702+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"9","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-22T14:02:27.970856+0000","last_change":"2020-04-22T14:02:27.970624+0000","last_active":"2020-04-22T14:02:27.970856+0000","last_peered":"2020-04-22T14:02:27.970856+0000","last_clean":"2020-04-22T14:02:27.970856+0000","last_became_active":"2020-04-22T14:02:27.970277+0000","last_became_peered":"2020-04-22T14:02:27.970277+0000","last_unstale":"2020-04-22T14:02:27.970856+0000","last_undegraded":"2020-04-22T14:02:27.970856+0000","last_fullsized":"2020-04-22T14:02:27.970856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:27.293036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:27.293036+0000","last_clean_scrub_stamp":"2020-04-22T14:02:27.293036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"24'7","reported_seq":"17","reported_epoch":"24","state":"active+clean","last_fresh":"2020-04-22T14:02:31.285742+0000","last_change":"2020-04-22T14:02:27.302844+0000","last_active":"2020-04-22T14:02:31.285742+0000","last_peered":"2020-04-22T14:02:31.285742+0000","last_clean":"2020-04-22T14:02:31.285742+0000","last_became_active":"2020-04-22T14:02:27.302441+0000","last_became_peered":"2020-04-22T14:02:27.302441+0000","last_unstale":"2020-04-22T14:02:31.285742+0000","last_undegraded":"2020-04-22T14:02:31.285742+0000","last_fullsized":"2020-04-22T14:02:31.285742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:26.288702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:26.288702+0000","last_clean_scrub_stamp":"2020-04-22T14:02:26.288702+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-22T14:02:27.693320+0000","last_change":"2020-04-22T14:02:24.293373+0000","last_active":"2020-04-22T14:02:27.693320+0000","last_peered":"2020-04-22T14:02:27.693320+0000","last_clean":"2020-04-22T14:02:27.693320+0000","last_became_active":"2020-04-22T14:02:24.293010+0000","last_became_peered":"2020-04-22T14:02:24.293010+0000","last_unstale":"2020-04-22T14:02:27.693320+0000","last_undegraded":"2020-04-22T14:02:27.693320+0000","last_fullsized":"2020-04-22T14:02:27.693320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:23.271699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:23.271699+0000","last_clean_scrub_stamp":"2020-04-22T14:02:23.271699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"9","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-22T14:02:27.698611+0000","last_change":"2020-04-22T14:02:27.697874+0000","last_active":"2020-04-22T14:02:27.698611+0000","last_peered":"2020-04-22T14:02:27.698611+0000","last_clean":"2020-04-22T14:02:27.698611+0000","last_became_active":"2020-04-22T14:02:27.697468+0000","last_became_peered":"2020-04-22T14:02:27.697468+0000","last_unstale":"2020-04-22T14:02:27.698611+0000","last_undegraded":"2020-04-22T14:02:27.698611+0000","last_fullsized":"2020-04-22T14:02:27.698611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:27.293036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:27.293036+0000","last_clean_scrub_stamp":"2020-04-22T14:02:27.293036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-22T14:02:27.689082+0000","last_change":"2020-04-22T14:02:24.290364+0000","last_active":"2020-04-22T14:02:27.689082+0000","last_peered":"2020-04-22T14:02:27.689082+0000","last_clean":"2020-04-22T14:02:27.689082+0000","last_became_active":"2020-04-22T14:02:24.289869+0000","last_became_peered":"2020-04-22T14:02:24.289869+0000","last_unstale":"2020-04-22T14:02:27.689082+0000","last_undegraded":"2020-04-22T14:02:27.689082+0000","last_fullsized":"2020-04-22T14:02:27.689082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:23.271699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:23.271699+0000","last_clean_scrub_stamp":"2020-04-22T14:02:23.271699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'3","reported_seq":"13","reported_epoch":"24","state":"active+clean","last_fresh":"2020-04-22T14:02:31.283984+0000","last_change":"2020-04-22T14:02:27.305911+0000","last_active":"2020-04-22T14:02:31.283984+0000","last_peered":"2020-04-22T14:02:31.283984+0000","last_clean":"2020-04-22T14:02:31.283984+0000","last_became_active":"2020-04-22T14:02:27.305573+0000","last_became_peered":"2020-04-22T14:02:27.305573+0000","last_unstale":"2020-04-22T14:02:31.283984+0000","last_undegraded":"2020-04-22T14:02:31.283984+0000","last_fullsized":"2020-04-22T14:02:31.283984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:26.288702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:26.288702+0000","last_clean_scrub_stamp":"2020-04-22T14:02:26.288702+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":95507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2090000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5}]}]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048824,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323016,"statfs":{"total":96636764160,"available":95562768384,"internally_reserved":1073741824,"allocated":245760,"data_stored":94941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3}]}]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048836,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323004,"statfs":{"total":96636764160,"available":95562756096,"internally_reserved":1073741824,"allocated":258048,"data_stored":96467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.522}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.605}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.639}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]}]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":94975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3859999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4490000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3680000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4299999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048836,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323004,"statfs":{"total":96636764160,"available":95562756096,"internally_reserved":1073741824,"allocated":258048,"data_stored":96467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.518}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]}]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":262144,"data_stored":95667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.355}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.409}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]}]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":94975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.286}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.589}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":95101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2509999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6399999999999999}]}]}]}} 2020-04-22T14:02:39.202 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:39.216 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-04-22T14:02:39.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.378+0000 7f245634b700 1 Processor -- start 2020-04-22T14:02:39.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.378+0000 7f245634b700 1 -- start start 2020-04-22T14:02:39.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.378+0000 7f245634b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24500620a0 0x7f24500ac740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:39.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.378+0000 7f245634b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2450144650 0x7f2450144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:39.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.378+0000 7f245634b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2450066120 0x7f24500665d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:39.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.378+0000 7f245634b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2450066a30 con 0x7f2450066120 2020-04-22T14:02:39.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.378+0000 7f245634b700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2450148270 con 0x7f2450144650 2020-04-22T14:02:39.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.378+0000 7f245634b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2450143f10 con 0x7f24500620a0 2020-04-22T14:02:39.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.379+0000 7f2454b48700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2450144650 0x7f2450144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:39.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.379+0000 7f2454b48700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2450144650 0x7f2450144ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47450/0 (socket says 172.21.15.103:47450) 2020-04-22T14:02:39.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.379+0000 7f2454b48700 1 -- 172.21.15.103:0/3736549175 learned_addr learned my addr 172.21.15.103:0/3736549175 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:39.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.379+0000 7f2455b4a700 1 --2- 172.21.15.103:0/3736549175 >> v2:172.21.15.86:3300/0 conn(0x7f2450066120 0x7f24500665d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:39.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.379+0000 7f2455349700 1 --2- 172.21.15.103:0/3736549175 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24500620a0 0x7f24500ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:39.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.379+0000 7f2454b48700 1 -- 172.21.15.103:0/3736549175 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24500620a0 msgr2=0x7f24500ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:39.395 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.379+0000 7f2454b48700 1 --2- 172.21.15.103:0/3736549175 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24500620a0 0x7f24500ac740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:39.395 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.379+0000 7f2454b48700 1 -- 172.21.15.103:0/3736549175 >> v2:172.21.15.86:3300/0 conn(0x7f2450066120 msgr2=0x7f24500665d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:39.395 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.379+0000 7f2454b48700 1 --2- 172.21.15.103:0/3736549175 >> v2:172.21.15.86:3300/0 conn(0x7f2450066120 0x7f24500665d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:39.395 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.379+0000 7f2454b48700 1 -- 172.21.15.103:0/3736549175 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24501441b0 con 0x7f2450144650 2020-04-22T14:02:39.395 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.379+0000 7f2455b4a700 1 --2- 172.21.15.103:0/3736549175 >> v2:172.21.15.86:3300/0 conn(0x7f2450066120 0x7f24500665d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:02:39.395 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.379+0000 7f2455349700 1 --2- 172.21.15.103:0/3736549175 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24500620a0 0x7f24500ac740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:02:39.395 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.379+0000 7f2454b48700 1 --2- 172.21.15.103:0/3736549175 >> v2:172.21.15.103:3300/0 conn(0x7f2450144650 0x7f2450144ad0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f244c002f30 tx=0x7f244c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.379+0000 7f2454b48700 1 --2- 172.21.15.103:0/3736549175 >> v2:172.21.15.103:3300/0 conn(0x7f2450144650 0x7f2450144ad0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f244c002f30 tx=0x7f244c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.379+0000 7f2454b48700 1 --2- 172.21.15.103:0/3736549175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2450144650 0x7f2450144ad0 secure :-1 s=READY pgs=166 cs=0 l=1 rx=0x7f244c002f30 tx=0x7f244c007a40).ready entity=mon.1 client_cookie=4adebef6a01caa26 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:39.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.379+0000 7f2454b48700 1 --2- 172.21.15.103:0/3736549175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2450144650 0x7f2450144ad0 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f244c002f30 tx=0x7f244c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.379+0000 7f2454b48700 1 --2- 172.21.15.103:0/3736549175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2450144650 0x7f2450144ad0 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f244c002f30 tx=0x7f244c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.379+0000 7f243ffff700 1 -- 172.21.15.103:0/3736549175 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f244c011720 con 0x7f2450144650 2020-04-22T14:02:39.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.379+0000 7f2454b48700 1 --2- 172.21.15.103:0/3736549175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2450144650 0x7f2450144ad0 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f244c002f30 tx=0x7f244c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.379+0000 7f243ffff700 1 -- 172.21.15.103:0/3736549175 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244c011880 con 0x7f2450144650 2020-04-22T14:02:39.397 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.379+0000 7f243ffff700 1 -- 172.21.15.103:0/3736549175 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f244c011ca0 con 0x7f2450144650 2020-04-22T14:02:39.397 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.379+0000 7f245634b700 1 -- 172.21.15.103:0/3736549175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2450144650 msgr2=0x7f2450144ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:39.397 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.379+0000 7f245634b700 1 --2- 172.21.15.103:0/3736549175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2450144650 0x7f2450144ad0 secure :-1 s=READY pgs=166 cs=0 l=1 rx=0x7f244c002f30 tx=0x7f244c007a40).stop 2020-04-22T14:02:39.397 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.380+0000 7f245634b700 1 -- 172.21.15.103:0/3736549175 shutdown_connections 2020-04-22T14:02:39.397 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.380+0000 7f245634b700 1 --2- 172.21.15.103:0/3736549175 >> v2:172.21.15.86:3300/0 conn(0x7f2450066120 0x7f24500665d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:39.397 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.380+0000 7f245634b700 1 --2- 172.21.15.103:0/3736549175 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24500620a0 0x7f24500ac740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:39.397 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.380+0000 7f245634b700 1 --2- 172.21.15.103:0/3736549175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2450144650 0x7f2450144ad0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:39.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.380+0000 7f245634b700 1 -- 172.21.15.103:0/3736549175 >> 172.21.15.103:0/3736549175 conn(0x7f245005b7c0 msgr2=0x7f2450061610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:39.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.380+0000 7f245634b700 1 -- 172.21.15.103:0/3736549175 shutdown_connections 2020-04-22T14:02:39.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.380+0000 7f245634b700 1 -- 172.21.15.103:0/3736549175 wait complete. 2020-04-22T14:02:39.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.381+0000 7f245634b700 1 Processor -- start 2020-04-22T14:02:39.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.381+0000 7f245634b700 1 -- start start 2020-04-22T14:02:39.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.382+0000 7f245634b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2450066120 0x7f245012c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:39.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.382+0000 7f245634b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24500b6500 con 0x7f24500620a0 2020-04-22T14:02:39.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.382+0000 7f245634b700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24500b67a0 con 0x7f2450144650 2020-04-22T14:02:39.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.382+0000 7f245634b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24500b62f0 con 0x7f2450066120 2020-04-22T14:02:39.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.382+0000 7f2455b4a700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f2450144650 0x7f2450143360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39646/0 (socket says 172.21.15.103:39646) 2020-04-22T14:02:39.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.382+0000 7f2455b4a700 1 -- 172.21.15.103:0/2161752879 learned_addr learned my addr 172.21.15.103:0/2161752879 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:39.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.382+0000 7f243e7fc700 1 -- 172.21.15.103:0/2161752879 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1953315410 0 0) 0x7f24500b67a0 con 0x7f2450144650 2020-04-22T14:02:39.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.382+0000 7f243e7fc700 1 -- 172.21.15.103:0/2161752879 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2430002fe0 con 0x7f2450144650 2020-04-22T14:02:39.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.382+0000 7f2454b48700 1 --2- 172.21.15.103:0/2161752879 >> v2:172.21.15.86:3300/0 conn(0x7f2450066120 0x7f245012c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:39.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.382+0000 7f243e7fc700 1 -- 172.21.15.103:0/2161752879 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 685699509 0 0) 0x7f2430002fe0 con 0x7f2450144650 2020-04-22T14:02:39.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.382+0000 7f243e7fc700 1 -- 172.21.15.103:0/2161752879 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f24500b67a0 con 0x7f2450144650 2020-04-22T14:02:39.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.382+0000 7f243e7fc700 1 -- 172.21.15.103:0/2161752879 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f2448001960 con 0x7f2450144650 2020-04-22T14:02:39.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.382+0000 7f243e7fc700 1 -- 172.21.15.103:0/2161752879 >> v2:172.21.15.86:3300/0 conn(0x7f2450066120 msgr2=0x7f245012c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:39.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.382+0000 7f243e7fc700 1 --2- 172.21.15.103:0/2161752879 >> v2:172.21.15.86:3300/0 conn(0x7f2450066120 0x7f245012c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:39.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.382+0000 7f243e7fc700 1 -- 172.21.15.103:0/2161752879 >> v1:172.21.15.103:6789/0 conn(0x7f2450144650 legacy=0x7f2450143360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:39.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.382+0000 7f243e7fc700 1 -- 172.21.15.103:0/2161752879 >> v1:172.21.15.86:6789/0 conn(0x7f24500620a0 legacy=0x7f24500b18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:39.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.382+0000 7f243e7fc700 1 --2- 172.21.15.103:0/2161752879 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2430004a00 0x7f2430004de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:39.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.382+0000 7f243e7fc700 1 --2- 172.21.15.103:0/2161752879 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2430003920 0x7f2430003da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:39.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.382+0000 7f243e7fc700 1 --2- 172.21.15.103:0/2161752879 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2430004200 0x7f243000b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:39.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.382+0000 7f243e7fc700 1 -- 172.21.15.103:0/2161752879 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24500b62f0 con 0x7f2430003920 2020-04-22T14:02:39.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.382+0000 7f243e7fc700 1 -- 172.21.15.103:0/2161752879 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24300046e0 con 0x7f2430004a00 2020-04-22T14:02:39.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.382+0000 7f243e7fc700 1 -- 172.21.15.103:0/2161752879 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f243000bbb0 con 0x7f2430004200 2020-04-22T14:02:39.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.382+0000 7f2455349700 1 --2- 172.21.15.103:0/2161752879 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2430004a00 0x7f2430004de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:39.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.382+0000 7f2454b48700 1 --2- 172.21.15.103:0/2161752879 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2430003920 0x7f2430003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:39.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.382+0000 7f2455b4a700 1 --2- 172.21.15.103:0/2161752879 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2430004200 0x7f243000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:39.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.383+0000 7f2455349700 1 -- 172.21.15.103:0/2161752879 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2430004200 msgr2=0x7f243000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:39.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.383+0000 7f2455349700 1 --2- 172.21.15.103:0/2161752879 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2430004200 0x7f243000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:39.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.383+0000 7f2455349700 1 -- 172.21.15.103:0/2161752879 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2430003920 msgr2=0x7f2430003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:39.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.383+0000 7f2455349700 1 --2- 172.21.15.103:0/2161752879 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2430003920 0x7f2430003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:39.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.383+0000 7f2455b4a700 1 -- 172.21.15.103:0/2161752879 reap_dead start 2020-04-22T14:02:39.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.383+0000 7f2455349700 1 -- 172.21.15.103:0/2161752879 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24500b1fc0 con 0x7f2430004a00 2020-04-22T14:02:39.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.383+0000 7f245634b700 1 -- 172.21.15.103:0/2161752879 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24500b5dc0 con 0x7f2430004a00 2020-04-22T14:02:39.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.383+0000 7f2455349700 1 --2- 172.21.15.103:0/2161752879 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2430004a00 0x7f2430004de0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f24300048f0 tx=0x7f2440007760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.383+0000 7f2455349700 1 --2- 172.21.15.103:0/2161752879 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2430004a00 0x7f2430004de0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f24300048f0 tx=0x7f2440007760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.383+0000 7f2455349700 1 --2- 172.21.15.103:0/2161752879 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2430004a00 0x7f2430004de0 secure :-1 s=READY pgs=168 cs=0 l=1 rx=0x7f24300048f0 tx=0x7f2440007760).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:39.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.383+0000 7f2455349700 1 --2- 172.21.15.103:0/2161752879 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2430004a00 0x7f2430004de0 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f24300048f0 tx=0x7f2440007760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.383+0000 7f2455349700 1 --2- 172.21.15.103:0/2161752879 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2430004a00 0x7f2430004de0 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f24300048f0 tx=0x7f2440007760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.383+0000 7f245634b700 1 -- 172.21.15.103:0/2161752879 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f245012c3a0 con 0x7f2430004a00 2020-04-22T14:02:39.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.383+0000 7f243e7fc700 1 -- 172.21.15.103:0/2161752879 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2440007560 con 0x7f2430004a00 2020-04-22T14:02:39.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.383+0000 7f2455349700 1 --2- 172.21.15.103:0/2161752879 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2430004a00 0x7f2430004de0 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f24300048f0 tx=0x7f2440007760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.383+0000 7f243e7fc700 1 -- 172.21.15.103:0/2161752879 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24400058d0 con 0x7f2430004a00 2020-04-22T14:02:39.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.383+0000 7f243e7fc700 1 -- 172.21.15.103:0/2161752879 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2440005cf0 con 0x7f2430004a00 2020-04-22T14:02:39.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.383+0000 7f2455349700 1 --2- 172.21.15.103:0/2161752879 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2430004a00 0x7f2430004de0 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f24300048f0 tx=0x7f2440007760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.384+0000 7f243e7fc700 1 -- 172.21.15.103:0/2161752879 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f244000a1a0 con 0x7f2430004a00 2020-04-22T14:02:39.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.384+0000 7f2455349700 1 --2- 172.21.15.103:0/2161752879 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2430004a00 0x7f2430004de0 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f24300048f0 tx=0x7f2440007760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.384+0000 7f245634b700 1 -- 172.21.15.103:0/2161752879 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2450056c90 con 0x7f2430004a00 2020-04-22T14:02:39.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.384+0000 7f243e7fc700 1 --2- 172.21.15.103:0/2161752879 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2430051910 0x7f2430053dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:39.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.384+0000 7f243e7fc700 1 -- 172.21.15.103:0/2161752879 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2440060d40 con 0x7f2430004a00 2020-04-22T14:02:39.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.384+0000 7f2454b48700 1 --2- 172.21.15.103:0/2161752879 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2430051910 0x7f2430053dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:39.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.384+0000 7f2454b48700 1 --2- 172.21.15.103:0/2161752879 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2430051910 0x7f2430053dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f244c002f30 tx=0x7f244c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.385+0000 7f2454b48700 1 --2- 172.21.15.103:0/2161752879 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2430051910 0x7f2430053dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f244c002f30 tx=0x7f244c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.385+0000 7f2454b48700 1 --2- 172.21.15.103:0/2161752879 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2430051910 0x7f2430053dd0 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7f244c002f30 tx=0x7f244c007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:39.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.388+0000 7f2455349700 1 --2- 172.21.15.103:0/2161752879 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2430004a00 0x7f2430004de0 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f24300048f0 tx=0x7f2440007760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.388+0000 7f243e7fc700 1 -- 172.21.15.103:0/2161752879 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f244003c120 con 0x7f2430004a00 2020-04-22T14:02:39.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.524+0000 7f245634b700 1 -- 172.21.15.103:0/2161752879 --> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2450061a00 con 0x7f2430051910 2020-04-22T14:02:39.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.528+0000 7f2454b48700 1 --2- 172.21.15.103:0/2161752879 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2430051910 0x7f2430053dd0 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f244c002f30 tx=0x7f244c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.528+0000 7f243e7fc700 1 -- 172.21.15.103:0/2161752879 <== mgr.4107 v2:172.21.15.86:6800/32242 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82233 (secure 0 0 0) 0x7f2450061a00 con 0x7f2430051910 2020-04-22T14:02:39.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.530+0000 7f245634b700 1 -- 172.21.15.103:0/2161752879 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2430051910 msgr2=0x7f2430053dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:39.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.530+0000 7f245634b700 1 --2- 172.21.15.103:0/2161752879 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2430051910 0x7f2430053dd0 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7f244c002f30 tx=0x7f244c007a40).stop 2020-04-22T14:02:39.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.530+0000 7f245634b700 1 -- 172.21.15.103:0/2161752879 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2430004a00 msgr2=0x7f2430004de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:39.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.530+0000 7f245634b700 1 --2- 172.21.15.103:0/2161752879 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2430004a00 0x7f2430004de0 secure :-1 s=READY pgs=168 cs=0 l=1 rx=0x7f24300048f0 tx=0x7f2440007760).stop 2020-04-22T14:02:39.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.530+0000 7f245634b700 1 -- 172.21.15.103:0/2161752879 shutdown_connections 2020-04-22T14:02:39.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.530+0000 7f245634b700 1 --2- 172.21.15.103:0/2161752879 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2430051910 0x7f2430053dd0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:39.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.530+0000 7f245634b700 1 --2- 172.21.15.103:0/2161752879 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2430004a00 0x7f2430004de0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:39.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.530+0000 7f245634b700 1 -- 172.21.15.103:0/2161752879 >> 172.21.15.103:0/2161752879 conn(0x7f245005b7c0 msgr2=0x7f2450144fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:39.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.530+0000 7f245634b700 1 -- 172.21.15.103:0/2161752879 shutdown_connections 2020-04-22T14:02:39.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.530+0000 7f245634b700 1 -- 172.21.15.103:0/2161752879 wait complete. 2020-04-22T14:02:39.535 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:02:39.536 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2020-04-22T14:02:39.543 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2020-04-22T14:02:37.551342+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390656,"kb_used_data":1984,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584064,"statfs":{"total":773094113280,"available":764502081536,"internally_reserved":8589934592,"allocated":2031616,"data_stored":764100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.863746"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"9","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-22T14:02:27.698261+0000","last_change":"2020-04-22T14:02:27.697820+0000","last_active":"2020-04-22T14:02:27.698261+0000","last_peered":"2020-04-22T14:02:27.698261+0000","last_clean":"2020-04-22T14:02:27.698261+0000","last_became_active":"2020-04-22T14:02:27.697396+0000","last_became_peered":"2020-04-22T14:02:27.697396+0000","last_unstale":"2020-04-22T14:02:27.698261+0000","last_undegraded":"2020-04-22T14:02:27.698261+0000","last_fullsized":"2020-04-22T14:02:27.698261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:27.293036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:27.293036+0000","last_clean_scrub_stamp":"2020-04-22T14:02:27.293036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-22T14:02:27.694539+0000","last_change":"2020-04-22T14:02:24.517988+0000","last_active":"2020-04-22T14:02:27.694539+0000","last_peered":"2020-04-22T14:02:27.694539+0000","last_clean":"2020-04-22T14:02:27.694539+0000","last_became_active":"2020-04-22T14:02:24.517695+0000","last_became_peered":"2020-04-22T14:02:24.517695+0000","last_unstale":"2020-04-22T14:02:27.694539+0000","last_undegraded":"2020-04-22T14:02:27.694539+0000","last_fullsized":"2020-04-22T14:02:27.694539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:23.271699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:23.271699+0000","last_clean_scrub_stamp":"2020-04-22T14:02:23.271699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"24'6","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-04-22T14:02:31.285565+0000","last_change":"2020-04-22T14:02:27.306196+0000","last_active":"2020-04-22T14:02:31.285565+0000","last_peered":"2020-04-22T14:02:31.285565+0000","last_clean":"2020-04-22T14:02:31.285565+0000","last_became_active":"2020-04-22T14:02:27.305812+0000","last_became_peered":"2020-04-22T14:02:27.305812+0000","last_unstale":"2020-04-22T14:02:31.285565+0000","last_undegraded":"2020-04-22T14:02:31.285565+0000","last_fullsized":"2020-04-22T14:02:31.285565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:26.288702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:26.288702+0000","last_clean_scrub_stamp":"2020-04-22T14:02:26.288702+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"9","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-22T14:02:27.696255+0000","last_change":"2020-04-22T14:02:27.695857+0000","last_active":"2020-04-22T14:02:27.696255+0000","last_peered":"2020-04-22T14:02:27.696255+0000","last_clean":"2020-04-22T14:02:27.696255+0000","last_became_active":"2020-04-22T14:02:27.695494+0000","last_became_peered":"2020-04-22T14:02:27.695494+0000","last_unstale":"2020-04-22T14:02:27.696255+0000","last_undegraded":"2020-04-22T14:02:27.696255+0000","last_fullsized":"2020-04-22T14:02:27.696255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:27.293036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:27.293036+0000","last_clean_scrub_stamp":"2020-04-22T14:02:27.293036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-22T14:02:27.696552+0000","last_change":"2020-04-22T14:02:24.292109+0000","last_active":"2020-04-22T14:02:27.696552+0000","last_peered":"2020-04-22T14:02:27.696552+0000","last_clean":"2020-04-22T14:02:27.696552+0000","last_became_active":"2020-04-22T14:02:24.291674+0000","last_became_peered":"2020-04-22T14:02:24.291674+0000","last_unstale":"2020-04-22T14:02:27.696552+0000","last_undegraded":"2020-04-22T14:02:27.696552+0000","last_fullsized":"2020-04-22T14:02:27.696552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:23.271699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:23.271699+0000","last_clean_scrub_stamp":"2020-04-22T14:02:23.271699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"24'5","reported_seq":"15","reported_epoch":"24","state":"active+clean","last_fresh":"2020-04-22T14:02:31.284543+0000","last_change":"2020-04-22T14:02:27.308515+0000","last_active":"2020-04-22T14:02:31.284543+0000","last_peered":"2020-04-22T14:02:31.284543+0000","last_clean":"2020-04-22T14:02:31.284543+0000","last_became_active":"2020-04-22T14:02:27.308084+0000","last_became_peered":"2020-04-22T14:02:27.308084+0000","last_unstale":"2020-04-22T14:02:31.284543+0000","last_undegraded":"2020-04-22T14:02:31.284543+0000","last_fullsized":"2020-04-22T14:02:31.284543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:26.288702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:26.288702+0000","last_clean_scrub_stamp":"2020-04-22T14:02:26.288702+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"9","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-22T14:02:27.698265+0000","last_change":"2020-04-22T14:02:27.697914+0000","last_active":"2020-04-22T14:02:27.698265+0000","last_peered":"2020-04-22T14:02:27.698265+0000","last_clean":"2020-04-22T14:02:27.698265+0000","last_became_active":"2020-04-22T14:02:27.697565+0000","last_became_peered":"2020-04-22T14:02:27.697565+0000","last_unstale":"2020-04-22T14:02:27.698265+0000","last_undegraded":"2020-04-22T14:02:27.698265+0000","last_fullsized":"2020-04-22T14:02:27.698265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:27.293036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:27.293036+0000","last_clean_scrub_stamp":"2020-04-22T14:02:27.293036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-22T14:02:27.690626+0000","last_change":"2020-04-22T14:02:24.448234+0000","last_active":"2020-04-22T14:02:27.690626+0000","last_peered":"2020-04-22T14:02:27.690626+0000","last_clean":"2020-04-22T14:02:27.690626+0000","last_became_active":"2020-04-22T14:02:24.447820+0000","last_became_peered":"2020-04-22T14:02:24.447820+0000","last_unstale":"2020-04-22T14:02:27.690626+0000","last_undegraded":"2020-04-22T14:02:27.690626+0000","last_fullsized":"2020-04-22T14:02:27.690626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:23.271699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:23.271699+0000","last_clean_scrub_stamp":"2020-04-22T14:02:23.271699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"24'8","reported_seq":"18","reported_epoch":"24","state":"active+clean","last_fresh":"2020-04-22T14:02:31.287938+0000","last_change":"2020-04-22T14:02:27.306105+0000","last_active":"2020-04-22T14:02:31.287938+0000","last_peered":"2020-04-22T14:02:31.287938+0000","last_clean":"2020-04-22T14:02:31.287938+0000","last_became_active":"2020-04-22T14:02:27.305684+0000","last_became_peered":"2020-04-22T14:02:27.305684+0000","last_unstale":"2020-04-22T14:02:31.287938+0000","last_undegraded":"2020-04-22T14:02:31.287938+0000","last_fullsized":"2020-04-22T14:02:31.287938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:26.288702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:26.288702+0000","last_clean_scrub_stamp":"2020-04-22T14:02:26.288702+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"9","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-22T14:02:27.693661+0000","last_change":"2020-04-22T14:02:27.693379+0000","last_active":"2020-04-22T14:02:27.693661+0000","last_peered":"2020-04-22T14:02:27.693661+0000","last_clean":"2020-04-22T14:02:27.693661+0000","last_became_active":"2020-04-22T14:02:27.693010+0000","last_became_peered":"2020-04-22T14:02:27.693010+0000","last_unstale":"2020-04-22T14:02:27.693661+0000","last_undegraded":"2020-04-22T14:02:27.693661+0000","last_fullsized":"2020-04-22T14:02:27.693661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:27.293036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:27.293036+0000","last_clean_scrub_stamp":"2020-04-22T14:02:27.293036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-22T14:02:27.696583+0000","last_change":"2020-04-22T14:02:24.290971+0000","last_active":"2020-04-22T14:02:27.696583+0000","last_peered":"2020-04-22T14:02:27.696583+0000","last_clean":"2020-04-22T14:02:27.696583+0000","last_became_active":"2020-04-22T14:02:24.290567+0000","last_became_peered":"2020-04-22T14:02:24.290567+0000","last_unstale":"2020-04-22T14:02:27.696583+0000","last_undegraded":"2020-04-22T14:02:27.696583+0000","last_fullsized":"2020-04-22T14:02:27.696583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:23.271699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:23.271699+0000","last_clean_scrub_stamp":"2020-04-22T14:02:23.271699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"18","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-22T14:02:27.968705+0000","last_change":"2020-04-22T14:02:19.736062+0000","last_active":"2020-04-22T14:02:27.968705+0000","last_peered":"2020-04-22T14:02:27.968705+0000","last_clean":"2020-04-22T14:02:27.968705+0000","last_became_active":"2020-04-22T14:02:19.735354+0000","last_became_peered":"2020-04-22T14:02:19.735354+0000","last_unstale":"2020-04-22T14:02:27.968705+0000","last_undegraded":"2020-04-22T14:02:27.968705+0000","last_fullsized":"2020-04-22T14:02:27.968705+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":3,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:10.544834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:10.544834+0000","last_clean_scrub_stamp":"2020-04-22T14:02:10.544834+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"24'1","reported_seq":"11","reported_epoch":"24","state":"active+clean","last_fresh":"2020-04-22T14:02:28.990305+0000","last_change":"2020-04-22T14:02:27.305067+0000","last_active":"2020-04-22T14:02:28.990305+0000","last_peered":"2020-04-22T14:02:28.990305+0000","last_clean":"2020-04-22T14:02:28.990305+0000","last_became_active":"2020-04-22T14:02:27.304462+0000","last_became_peered":"2020-04-22T14:02:27.304462+0000","last_unstale":"2020-04-22T14:02:28.990305+0000","last_undegraded":"2020-04-22T14:02:28.990305+0000","last_fullsized":"2020-04-22T14:02:28.990305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:26.288702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:26.288702+0000","last_clean_scrub_stamp":"2020-04-22T14:02:26.288702+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"9","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-22T14:02:27.696178+0000","last_change":"2020-04-22T14:02:27.695782+0000","last_active":"2020-04-22T14:02:27.696178+0000","last_peered":"2020-04-22T14:02:27.696178+0000","last_clean":"2020-04-22T14:02:27.696178+0000","last_became_active":"2020-04-22T14:02:27.695395+0000","last_became_peered":"2020-04-22T14:02:27.695395+0000","last_unstale":"2020-04-22T14:02:27.696178+0000","last_undegraded":"2020-04-22T14:02:27.696178+0000","last_fullsized":"2020-04-22T14:02:27.696178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:27.293036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:27.293036+0000","last_clean_scrub_stamp":"2020-04-22T14:02:27.293036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-22T14:02:27.969181+0000","last_change":"2020-04-22T14:02:24.291380+0000","last_active":"2020-04-22T14:02:27.969181+0000","last_peered":"2020-04-22T14:02:27.969181+0000","last_clean":"2020-04-22T14:02:27.969181+0000","last_became_active":"2020-04-22T14:02:24.290971+0000","last_became_peered":"2020-04-22T14:02:24.290971+0000","last_unstale":"2020-04-22T14:02:27.969181+0000","last_undegraded":"2020-04-22T14:02:27.969181+0000","last_fullsized":"2020-04-22T14:02:27.969181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:23.271699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:23.271699+0000","last_clean_scrub_stamp":"2020-04-22T14:02:23.271699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"10","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-22T14:02:27.693668+0000","last_change":"2020-04-22T14:02:27.305141+0000","last_active":"2020-04-22T14:02:27.693668+0000","last_peered":"2020-04-22T14:02:27.693668+0000","last_clean":"2020-04-22T14:02:27.693668+0000","last_became_active":"2020-04-22T14:02:27.304770+0000","last_became_peered":"2020-04-22T14:02:27.304770+0000","last_unstale":"2020-04-22T14:02:27.693668+0000","last_undegraded":"2020-04-22T14:02:27.693668+0000","last_fullsized":"2020-04-22T14:02:27.693668+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:26.288702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:26.288702+0000","last_clean_scrub_stamp":"2020-04-22T14:02:26.288702+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"9","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-22T14:02:27.698246+0000","last_change":"2020-04-22T14:02:27.697902+0000","last_active":"2020-04-22T14:02:27.698246+0000","last_peered":"2020-04-22T14:02:27.698246+0000","last_clean":"2020-04-22T14:02:27.698246+0000","last_became_active":"2020-04-22T14:02:27.697490+0000","last_became_peered":"2020-04-22T14:02:27.697490+0000","last_unstale":"2020-04-22T14:02:27.698246+0000","last_undegraded":"2020-04-22T14:02:27.698246+0000","last_fullsized":"2020-04-22T14:02:27.698246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:27.293036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:27.293036+0000","last_clean_scrub_stamp":"2020-04-22T14:02:27.293036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-22T14:02:27.968735+0000","last_change":"2020-04-22T14:02:24.518323+0000","last_active":"2020-04-22T14:02:27.968735+0000","last_peered":"2020-04-22T14:02:27.968735+0000","last_clean":"2020-04-22T14:02:27.968735+0000","last_became_active":"2020-04-22T14:02:24.517938+0000","last_became_peered":"2020-04-22T14:02:24.517938+0000","last_unstale":"2020-04-22T14:02:27.968735+0000","last_undegraded":"2020-04-22T14:02:27.968735+0000","last_fullsized":"2020-04-22T14:02:27.968735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:23.271699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:23.271699+0000","last_clean_scrub_stamp":"2020-04-22T14:02:23.271699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"24'8","reported_seq":"18","reported_epoch":"24","state":"active+clean","last_fresh":"2020-04-22T14:02:31.287772+0000","last_change":"2020-04-22T14:02:27.306602+0000","last_active":"2020-04-22T14:02:31.287772+0000","last_peered":"2020-04-22T14:02:31.287772+0000","last_clean":"2020-04-22T14:02:31.287772+0000","last_became_active":"2020-04-22T14:02:27.306222+0000","last_became_peered":"2020-04-22T14:02:27.306222+0000","last_unstale":"2020-04-22T14:02:31.287772+0000","last_undegraded":"2020-04-22T14:02:31.287772+0000","last_fullsized":"2020-04-22T14:02:31.287772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:26.288702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:26.288702+0000","last_clean_scrub_stamp":"2020-04-22T14:02:26.288702+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"9","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-22T14:02:27.970856+0000","last_change":"2020-04-22T14:02:27.970624+0000","last_active":"2020-04-22T14:02:27.970856+0000","last_peered":"2020-04-22T14:02:27.970856+0000","last_clean":"2020-04-22T14:02:27.970856+0000","last_became_active":"2020-04-22T14:02:27.970277+0000","last_became_peered":"2020-04-22T14:02:27.970277+0000","last_unstale":"2020-04-22T14:02:27.970856+0000","last_undegraded":"2020-04-22T14:02:27.970856+0000","last_fullsized":"2020-04-22T14:02:27.970856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:27.293036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:27.293036+0000","last_clean_scrub_stamp":"2020-04-22T14:02:27.293036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"24'7","reported_seq":"17","reported_epoch":"24","state":"active+clean","last_fresh":"2020-04-22T14:02:31.285742+0000","last_change":"2020-04-22T14:02:27.302844+0000","last_active":"2020-04-22T14:02:31.285742+0000","last_peered":"2020-04-22T14:02:31.285742+0000","last_clean":"2020-04-22T14:02:31.285742+0000","last_became_active":"2020-04-22T14:02:27.302441+0000","last_became_peered":"2020-04-22T14:02:27.302441+0000","last_unstale":"2020-04-22T14:02:31.285742+0000","last_undegraded":"2020-04-22T14:02:31.285742+0000","last_fullsized":"2020-04-22T14:02:31.285742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:26.288702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:26.288702+0000","last_clean_scrub_stamp":"2020-04-22T14:02:26.288702+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-22T14:02:27.693320+0000","last_change":"2020-04-22T14:02:24.293373+0000","last_active":"2020-04-22T14:02:27.693320+0000","last_peered":"2020-04-22T14:02:27.693320+0000","last_clean":"2020-04-22T14:02:27.693320+0000","last_became_active":"2020-04-22T14:02:24.293010+0000","last_became_peered":"2020-04-22T14:02:24.293010+0000","last_unstale":"2020-04-22T14:02:27.693320+0000","last_undegraded":"2020-04-22T14:02:27.693320+0000","last_fullsized":"2020-04-22T14:02:27.693320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:23.271699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:23.271699+0000","last_clean_scrub_stamp":"2020-04-22T14:02:23.271699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"9","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-22T14:02:27.698611+0000","last_change":"2020-04-22T14:02:27.697874+0000","last_active":"2020-04-22T14:02:27.698611+0000","last_peered":"2020-04-22T14:02:27.698611+0000","last_clean":"2020-04-22T14:02:27.698611+0000","last_became_active":"2020-04-22T14:02:27.697468+0000","last_became_peered":"2020-04-22T14:02:27.697468+0000","last_unstale":"2020-04-22T14:02:27.698611+0000","last_undegraded":"2020-04-22T14:02:27.698611+0000","last_fullsized":"2020-04-22T14:02:27.698611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:27.293036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:27.293036+0000","last_clean_scrub_stamp":"2020-04-22T14:02:27.293036+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-04-22T14:02:27.689082+0000","last_change":"2020-04-22T14:02:24.290364+0000","last_active":"2020-04-22T14:02:27.689082+0000","last_peered":"2020-04-22T14:02:27.689082+0000","last_clean":"2020-04-22T14:02:27.689082+0000","last_became_active":"2020-04-22T14:02:24.289869+0000","last_became_peered":"2020-04-22T14:02:24.289869+0000","last_unstale":"2020-04-22T14:02:27.689082+0000","last_undegraded":"2020-04-22T14:02:27.689082+0000","last_fullsized":"2020-04-22T14:02:27.689082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:23.271699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:23.271699+0000","last_clean_scrub_stamp":"2020-04-22T14:02:23.271699+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'3","reported_seq":"13","reported_epoch":"24","state":"active+clean","last_fresh":"2020-04-22T14:02:31.283984+0000","last_change":"2020-04-22T14:02:27.305911+0000","last_active":"2020-04-22T14:02:31.283984+0000","last_peered":"2020-04-22T14:02:31.283984+0000","last_clean":"2020-04-22T14:02:31.283984+0000","last_became_active":"2020-04-22T14:02:27.305573+0000","last_became_peered":"2020-04-22T14:02:27.305573+0000","last_unstale":"2020-04-22T14:02:31.283984+0000","last_undegraded":"2020-04-22T14:02:31.283984+0000","last_fullsized":"2020-04-22T14:02:31.283984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-22T14:02:26.288702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-22T14:02:26.288702+0000","last_clean_scrub_stamp":"2020-04-22T14:02:26.288702+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":95507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2090000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5}]}]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048824,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323016,"statfs":{"total":96636764160,"available":95562768384,"internally_reserved":1073741824,"allocated":245760,"data_stored":94941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3}]}]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048836,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323004,"statfs":{"total":96636764160,"available":95562756096,"internally_reserved":1073741824,"allocated":258048,"data_stored":96467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.522}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.605}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.639}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]}]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":94975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3859999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4490000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3680000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4299999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048836,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323004,"statfs":{"total":96636764160,"available":95562756096,"internally_reserved":1073741824,"allocated":258048,"data_stored":96467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.518}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]}]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":262144,"data_stored":95667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.355}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.409}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]}]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":94975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.286}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.589}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":95101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2509999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6399999999999999}]}]}]}} 2020-04-22T14:02:39.547 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-04-22T14:02:39.547 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2020-04-22T14:02:39.547 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2020-04-22T14:02:39.547 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:39.573 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early health --format=json 2020-04-22T14:02:39.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.715+0000 7f75b6f9d700 1 Processor -- start 2020-04-22T14:02:39.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.716+0000 7f75b6f9d700 1 -- start start 2020-04-22T14:02:39.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.716+0000 7f75b6f9d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75b00adc00 0x7f75b00b4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:39.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.716+0000 7f75b6f9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f75b00ace50 0x7f75b00ad270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:39.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.716+0000 7f75b6f9d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75b00b39a0 con 0x7f75b00b26b0 2020-04-22T14:02:39.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.716+0000 7f75b6f9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75b00b3c40 con 0x7f75b00ace50 2020-04-22T14:02:39.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.716+0000 7f75b6f9d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b00b3ee0 con 0x7f75b00adc00 2020-04-22T14:02:39.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.716+0000 7f75b579a700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f75b00b26b0 0x7f75b00ac740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39656/0 (socket says 172.21.15.103:39656) 2020-04-22T14:02:39.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.717+0000 7f75b579a700 1 -- 172.21.15.103:0/1638067648 learned_addr learned my addr 172.21.15.103:0/1638067648 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:39.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.717+0000 7f75b679c700 1 --2- 172.21.15.103:0/1638067648 >> v2:172.21.15.86:3300/0 conn(0x7f75b00ace50 0x7f75b00ad270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:39.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.717+0000 7f75b5f9b700 1 --2- 172.21.15.103:0/1638067648 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75b00adc00 0x7f75b00b4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:39.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.717+0000 7f75b4f99700 1 -- 172.21.15.103:0/1638067648 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2836282454 0 0) 0x7f75b00b39a0 con 0x7f75b00b26b0 2020-04-22T14:02:39.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.717+0000 7f75b4f99700 1 -- 172.21.15.103:0/1638067648 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7598003230 con 0x7f75b00b26b0 2020-04-22T14:02:39.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.717+0000 7f75b679c700 1 -- 172.21.15.103:0/1638067648 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75b00adc00 msgr2=0x7f75b00b4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:39.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.717+0000 7f75b679c700 1 --2- 172.21.15.103:0/1638067648 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75b00adc00 0x7f75b00b4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:39.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.717+0000 7f75b4f99700 1 -- 172.21.15.103:0/1638067648 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2494411695 0 0) 0x7f7598003230 con 0x7f75b00b26b0 2020-04-22T14:02:39.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.717+0000 7f75b679c700 1 -- 172.21.15.103:0/1638067648 >> v1:172.21.15.103:6789/0 conn(0x7f75b00b26b0 legacy=0x7f75b00ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:39.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.717+0000 7f75b679c700 1 -- 172.21.15.103:0/1638067648 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b00adfe0 con 0x7f75b00ace50 2020-04-22T14:02:39.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.717+0000 7f75b679c700 1 --2- 172.21.15.103:0/1638067648 >> v2:172.21.15.86:3300/0 conn(0x7f75b00ace50 0x7f75b00ad270 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f75ac001870 tx=0x7f75a8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.717+0000 7f75b679c700 1 --2- 172.21.15.103:0/1638067648 >> v2:172.21.15.86:3300/0 conn(0x7f75b00ace50 0x7f75b00ad270 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f75ac001870 tx=0x7f75a8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.717+0000 7f75b679c700 1 --2- 172.21.15.103:0/1638067648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75b00ace50 0x7f75b00ad270 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7f75ac001870 tx=0x7f75a8007dc0).ready entity=mon.0 client_cookie=4cab65b9de9cf84 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:39.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.717+0000 7f75b679c700 1 --2- 172.21.15.103:0/1638067648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75b00ace50 0x7f75b00ad270 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7f75ac001870 tx=0x7f75a8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.717+0000 7f75b4f99700 1 -- 172.21.15.103:0/1638067648 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75ac0016d0 con 0x7f75b00ace50 2020-04-22T14:02:39.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.717+0000 7f75b679c700 1 --2- 172.21.15.103:0/1638067648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75b00ace50 0x7f75b00ad270 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7f75ac001870 tx=0x7f75a8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.717+0000 7f75b4f99700 1 -- 172.21.15.103:0/1638067648 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a8010a10 con 0x7f75b00ace50 2020-04-22T14:02:39.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.717+0000 7f75b679c700 1 --2- 172.21.15.103:0/1638067648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75b00ace50 0x7f75b00ad270 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7f75ac001870 tx=0x7f75a8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.717+0000 7f75b4f99700 1 -- 172.21.15.103:0/1638067648 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75a8010db0 con 0x7f75b00ace50 2020-04-22T14:02:39.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.717+0000 7f75b6f9d700 1 -- 172.21.15.103:0/1638067648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75b00ace50 msgr2=0x7f75b00ad270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:39.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.717+0000 7f75b6f9d700 1 --2- 172.21.15.103:0/1638067648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75b00ace50 0x7f75b00ad270 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7f75ac001870 tx=0x7f75a8007dc0).stop 2020-04-22T14:02:39.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.718+0000 7f75b6f9d700 1 -- 172.21.15.103:0/1638067648 shutdown_connections 2020-04-22T14:02:39.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.718+0000 7f75b6f9d700 1 --2- 172.21.15.103:0/1638067648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75b00ace50 0x7f75b00ad270 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:39.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.718+0000 7f75b6f9d700 1 --2- 172.21.15.103:0/1638067648 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75b00adc00 0x7f75b00b4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:39.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.718+0000 7f75b6f9d700 1 -- 172.21.15.103:0/1638067648 >> 172.21.15.103:0/1638067648 conn(0x7f75b005f2c0 msgr2=0x7f75b005b180 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:39.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.718+0000 7f75b6f9d700 1 -- 172.21.15.103:0/1638067648 shutdown_connections 2020-04-22T14:02:39.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.718+0000 7f75b6f9d700 1 -- 172.21.15.103:0/1638067648 wait complete. 2020-04-22T14:02:39.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.719+0000 7f75b6f9d700 1 Processor -- start 2020-04-22T14:02:39.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.719+0000 7f75b6f9d700 1 -- start start 2020-04-22T14:02:39.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.719+0000 7f75b6f9d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75b00adc00 0x7f75b00b1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:39.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.719+0000 7f75b6f9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f75b00b26b0 0x7f75b0128d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:39.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.719+0000 7f75b6f9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75b00b1770 con 0x7f75b00ace50 2020-04-22T14:02:39.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.719+0000 7f75b6f9d700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75b0129180 con 0x7f75b00b26b0 2020-04-22T14:02:39.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.719+0000 7f75b6f9d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b0064910 con 0x7f75b00adc00 2020-04-22T14:02:39.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.720+0000 7f75b679c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f75b00b26b0 0x7f75b0128d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:39.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.720+0000 7f75b679c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f75b00b26b0 0x7f75b0128d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47472/0 (socket says 172.21.15.103:47472) 2020-04-22T14:02:39.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.720+0000 7f75b679c700 1 -- 172.21.15.103:0/1358587784 learned_addr learned my addr 172.21.15.103:0/1358587784 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:39.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.720+0000 7f75b579a700 1 --2- 172.21.15.103:0/1358587784 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75b00adc00 0x7f75b00b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:39.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.720+0000 7f75b679c700 1 -- 172.21.15.103:0/1358587784 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75b00adc00 msgr2=0x7f75b00b1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:39.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.720+0000 7f75b679c700 1 --2- 172.21.15.103:0/1358587784 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75b00adc00 0x7f75b00b1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:39.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.720+0000 7f75b679c700 1 -- 172.21.15.103:0/1358587784 >> v1:172.21.15.86:6789/0 conn(0x7f75b00ace50 legacy=0x7f75b0061330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:39.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.720+0000 7f75b679c700 1 -- 172.21.15.103:0/1358587784 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b0064bb0 con 0x7f75b00b26b0 2020-04-22T14:02:39.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.720+0000 7f75b579a700 1 --2- 172.21.15.103:0/1358587784 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75b00adc00 0x7f75b00b1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:02:39.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.720+0000 7f75b679c700 1 --2- 172.21.15.103:0/1358587784 >> v2:172.21.15.103:3300/0 conn(0x7f75b00b26b0 0x7f75b0128d20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f75ac001870 tx=0x7f75a8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.720+0000 7f75b679c700 1 --2- 172.21.15.103:0/1358587784 >> v2:172.21.15.103:3300/0 conn(0x7f75b00b26b0 0x7f75b0128d20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f75ac001870 tx=0x7f75a8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.720+0000 7f75b679c700 1 --2- 172.21.15.103:0/1358587784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75b00b26b0 0x7f75b0128d20 secure :-1 s=READY pgs=170 cs=0 l=1 rx=0x7f75ac001870 tx=0x7f75a8007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:39.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.720+0000 7f75b679c700 1 --2- 172.21.15.103:0/1358587784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75b00b26b0 0x7f75b0128d20 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f75ac001870 tx=0x7f75a8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.720+0000 7f759effd700 1 -- 172.21.15.103:0/1358587784 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75a8005c30 con 0x7f75b00b26b0 2020-04-22T14:02:39.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.720+0000 7f75b679c700 1 --2- 172.21.15.103:0/1358587784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75b00b26b0 0x7f75b0128d20 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f75ac001870 tx=0x7f75a8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.720+0000 7f75b679c700 1 --2- 172.21.15.103:0/1358587784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75b00b26b0 0x7f75b0128d20 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f75ac001870 tx=0x7f75a8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.720+0000 7f759effd700 1 -- 172.21.15.103:0/1358587784 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a8005d90 con 0x7f75b00b26b0 2020-04-22T14:02:39.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.720+0000 7f759effd700 1 -- 172.21.15.103:0/1358587784 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75a8007370 con 0x7f75b00b26b0 2020-04-22T14:02:39.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.720+0000 7f75b6f9d700 1 -- 172.21.15.103:0/1358587784 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b012aa40 con 0x7f75b00b26b0 2020-04-22T14:02:39.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.720+0000 7f75b6f9d700 1 -- 172.21.15.103:0/1358587784 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75b0065290 con 0x7f75b00b26b0 2020-04-22T14:02:39.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.721+0000 7f75b679c700 1 --2- 172.21.15.103:0/1358587784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75b00b26b0 0x7f75b0128d20 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f75ac001870 tx=0x7f75a8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.721+0000 7f759effd700 1 -- 172.21.15.103:0/1358587784 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f75a80075f0 con 0x7f75b00b26b0 2020-04-22T14:02:39.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.721+0000 7f75b679c700 1 --2- 172.21.15.103:0/1358587784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75b00b26b0 0x7f75b0128d20 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f75ac001870 tx=0x7f75a8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.721+0000 7f75b6f9d700 1 -- 172.21.15.103:0/1358587784 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75b00b4a90 con 0x7f75b00b26b0 2020-04-22T14:02:39.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.721+0000 7f759effd700 1 --2- 172.21.15.103:0/1358587784 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f759004d950 0x7f759004fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:39.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.721+0000 7f759effd700 1 -- 172.21.15.103:0/1358587784 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f75a8061960 con 0x7f75b00b26b0 2020-04-22T14:02:39.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.722+0000 7f75b5f9b700 1 --2- 172.21.15.103:0/1358587784 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f759004d950 0x7f759004fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:39.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.722+0000 7f75b5f9b700 1 --2- 172.21.15.103:0/1358587784 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f759004d950 0x7f759004fe10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f75b00b1fc0 tx=0x7f75a0007700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.722+0000 7f75b5f9b700 1 --2- 172.21.15.103:0/1358587784 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f759004d950 0x7f759004fe10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f75b00b1fc0 tx=0x7f75a0007700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.722+0000 7f75b5f9b700 1 --2- 172.21.15.103:0/1358587784 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f759004d950 0x7f759004fe10 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7f75b00b1fc0 tx=0x7f75a0007700).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:39.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.725+0000 7f75b679c700 1 --2- 172.21.15.103:0/1358587784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75b00b26b0 0x7f75b0128d20 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f75ac001870 tx=0x7f75a8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.725+0000 7f759effd700 1 -- 172.21.15.103:0/1358587784 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f75a803cda0 con 0x7f75b00b26b0 2020-04-22T14:02:39.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.922+0000 7f75b6f9d700 1 -- 172.21.15.103:0/1358587784 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f75b012abd0 con 0x7f75b00b26b0 2020-04-22T14:02:39.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.923+0000 7f75b679c700 1 --2- 172.21.15.103:0/1358587784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75b00b26b0 0x7f75b0128d20 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f75ac001870 tx=0x7f75a8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:39.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.923+0000 7f759effd700 1 -- 172.21.15.103:0/1358587784 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f75a80150d0 con 0x7f75b00b26b0 2020-04-22T14:02:39.926 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:02:39.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.924+0000 7f75b6f9d700 1 -- 172.21.15.103:0/1358587784 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f759004d950 msgr2=0x7f759004fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:39.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.924+0000 7f75b6f9d700 1 --2- 172.21.15.103:0/1358587784 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f759004d950 0x7f759004fe10 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7f75b00b1fc0 tx=0x7f75a0007700).stop 2020-04-22T14:02:39.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.924+0000 7f75b6f9d700 1 -- 172.21.15.103:0/1358587784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75b00b26b0 msgr2=0x7f75b0128d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:39.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.924+0000 7f75b6f9d700 1 --2- 172.21.15.103:0/1358587784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75b00b26b0 0x7f75b0128d20 secure :-1 s=READY pgs=170 cs=0 l=1 rx=0x7f75ac001870 tx=0x7f75a8007dc0).stop 2020-04-22T14:02:39.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.924+0000 7f75b6f9d700 1 -- 172.21.15.103:0/1358587784 shutdown_connections 2020-04-22T14:02:39.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.924+0000 7f75b6f9d700 1 --2- 172.21.15.103:0/1358587784 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f759004d950 0x7f759004fe10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:39.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.924+0000 7f75b6f9d700 1 --2- 172.21.15.103:0/1358587784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75b00b26b0 0x7f75b0128d20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:39.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.924+0000 7f75b6f9d700 1 --2- 172.21.15.103:0/1358587784 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75b00adc00 0x7f75b00b1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:39.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.924+0000 7f75b6f9d700 1 -- 172.21.15.103:0/1358587784 >> 172.21.15.103:0/1358587784 conn(0x7f75b005f2c0 msgr2=0x7f75b00b63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:39.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.924+0000 7f75b6f9d700 1 -- 172.21.15.103:0/1358587784 shutdown_connections 2020-04-22T14:02:39.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:39.924+0000 7f75b6f9d700 1 -- 172.21.15.103:0/1358587784 wait complete. 2020-04-22T14:02:39.937 INFO:teuthology.orchestra.run.smithi103.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2020-04-22T14:02:39.938 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2020-04-22T14:02:39.938 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:39.952 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:02:40.098 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.095+0000 7fc00b255700 1 Processor -- start 2020-04-22T14:02:40.099 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.095+0000 7fc00b255700 1 -- start start 2020-04-22T14:02:40.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.096+0000 7fc00b255700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc004140320 0x7fc0040ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:40.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.096+0000 7fc00b255700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc00414a710 con 0x7fc00414a2b0 2020-04-22T14:02:40.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.096+0000 7fc00b255700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0041462f0 con 0x7fc0040bd1b0 2020-04-22T14:02:40.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.096+0000 7fc00b255700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc004146590 con 0x7fc004140320 2020-04-22T14:02:40.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.096+0000 7fc0097f2700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc0040bd1b0 0x7fc0040ac740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39668/0 (socket says 172.21.15.103:39668) 2020-04-22T14:02:40.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.096+0000 7fc0097f2700 1 -- 172.21.15.103:0/1823208412 learned_addr learned my addr 172.21.15.103:0/1823208412 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:40.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.097+0000 7fc008ff1700 1 --2- 172.21.15.103:0/1823208412 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc004140320 0x7fc0040ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:40.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.097+0000 7fc0037fe700 1 -- 172.21.15.103:0/1823208412 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2314589968 0 0) 0x7fc0041462f0 con 0x7fc0040bd1b0 2020-04-22T14:02:40.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.097+0000 7fc0037fe700 1 -- 172.21.15.103:0/1823208412 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbff0003230 con 0x7fc0040bd1b0 2020-04-22T14:02:40.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.097+0000 7fc0037fe700 1 -- 172.21.15.103:0/1823208412 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 434583066 0 0) 0x7fc00414a710 con 0x7fc00414a2b0 2020-04-22T14:02:40.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.097+0000 7fc0037fe700 1 -- 172.21.15.103:0/1823208412 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0041462f0 con 0x7fc00414a2b0 2020-04-22T14:02:40.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.097+0000 7fc0037fe700 1 -- 172.21.15.103:0/1823208412 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1466252819 0 0) 0x7fbff0003230 con 0x7fc0040bd1b0 2020-04-22T14:02:40.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.097+0000 7fc008ff1700 1 -- 172.21.15.103:0/1823208412 >> v1:172.21.15.103:6789/0 conn(0x7fc0040bd1b0 legacy=0x7fc0040ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:40.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.097+0000 7fc008ff1700 1 -- 172.21.15.103:0/1823208412 >> v1:172.21.15.86:6789/0 conn(0x7fc00414a2b0 legacy=0x7fc004146cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:40.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.097+0000 7fc008ff1700 1 -- 172.21.15.103:0/1823208412 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc004146830 con 0x7fc004140320 2020-04-22T14:02:40.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.097+0000 7fc008ff1700 1 --2- 172.21.15.103:0/1823208412 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc004140320 0x7fc0040ae1a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbffc001450 tx=0x7fbff40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.097+0000 7fc008ff1700 1 --2- 172.21.15.103:0/1823208412 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc004140320 0x7fc0040ae1a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbffc001450 tx=0x7fbff40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.097+0000 7fc008ff1700 1 --2- 172.21.15.103:0/1823208412 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc004140320 0x7fc0040ae1a0 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7fbffc001450 tx=0x7fbff40088e0).ready entity=mon.2 client_cookie=8c0abce1f9c5e2d server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:40.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.097+0000 7fc008ff1700 1 --2- 172.21.15.103:0/1823208412 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc004140320 0x7fc0040ae1a0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7fbffc001450 tx=0x7fbff40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.097+0000 7fc0037fe700 1 -- 172.21.15.103:0/1823208412 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbffc001a50 con 0x7fc004140320 2020-04-22T14:02:40.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.097+0000 7fc008ff1700 1 --2- 172.21.15.103:0/1823208412 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc004140320 0x7fc0040ae1a0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7fbffc001450 tx=0x7fbff40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.097+0000 7fc008ff1700 1 --2- 172.21.15.103:0/1823208412 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc004140320 0x7fc0040ae1a0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7fbffc001450 tx=0x7fbff40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.097+0000 7fc0037fe700 1 -- 172.21.15.103:0/1823208412 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff4011210 con 0x7fc004140320 2020-04-22T14:02:40.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.097+0000 7fc0037fe700 1 -- 172.21.15.103:0/1823208412 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbff40115f0 con 0x7fc004140320 2020-04-22T14:02:40.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.097+0000 7fc00b255700 1 -- 172.21.15.103:0/1823208412 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc004140320 msgr2=0x7fc0040ae1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:40.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.097+0000 7fc00b255700 1 --2- 172.21.15.103:0/1823208412 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc004140320 0x7fc0040ae1a0 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7fbffc001450 tx=0x7fbff40088e0).stop 2020-04-22T14:02:40.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.098+0000 7fc00b255700 1 -- 172.21.15.103:0/1823208412 shutdown_connections 2020-04-22T14:02:40.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.098+0000 7fc00b255700 1 --2- 172.21.15.103:0/1823208412 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc004140320 0x7fc0040ae1a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:40.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.098+0000 7fc00b255700 1 -- 172.21.15.103:0/1823208412 >> 172.21.15.103:0/1823208412 conn(0x7fc00405f2c0 msgr2=0x7fc0040bcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:40.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.098+0000 7fc00b255700 1 -- 172.21.15.103:0/1823208412 shutdown_connections 2020-04-22T14:02:40.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.098+0000 7fc00b255700 1 -- 172.21.15.103:0/1823208412 wait complete. 2020-04-22T14:02:40.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.099+0000 7fc00b255700 1 Processor -- start 2020-04-22T14:02:40.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.099+0000 7fc00b255700 1 -- start start 2020-04-22T14:02:40.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.099+0000 7fc00b255700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc004140320 0x7fc004130df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:40.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.099+0000 7fc00b255700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc00414a2b0 0x7fc0040bbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:40.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.100+0000 7fc00b255700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0040bc110 con 0x7fc0040bd1b0 2020-04-22T14:02:40.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.100+0000 7fc00b255700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc004131400 con 0x7fc00414a2b0 2020-04-22T14:02:40.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.100+0000 7fc00b255700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0041316a0 con 0x7fc004140320 2020-04-22T14:02:40.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.100+0000 7fc008ff1700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc0040bd1b0 0x7fc00413f310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39674/0 (socket says 172.21.15.103:39674) 2020-04-22T14:02:40.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.100+0000 7fc008ff1700 1 -- 172.21.15.103:0/95182814 learned_addr learned my addr 172.21.15.103:0/95182814 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:40.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.100+0000 7fc003fff700 1 --2- 172.21.15.103:0/95182814 >> v2:172.21.15.103:3300/0 conn(0x7fc004140320 0x7fc004130df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:40.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.100+0000 7fc0097f2700 1 --2- 172.21.15.103:0/95182814 >> v2:172.21.15.86:3300/0 conn(0x7fc00414a2b0 0x7fc0040bbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:40.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.100+0000 7fc001ffb700 1 -- 172.21.15.103:0/95182814 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1704324393 0 0) 0x7fc004146830 con 0x7fc0040bd1b0 2020-04-22T14:02:40.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.100+0000 7fc001ffb700 1 -- 172.21.15.103:0/95182814 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfe4002fe0 con 0x7fc0040bd1b0 2020-04-22T14:02:40.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.100+0000 7fc003fff700 1 -- 172.21.15.103:0/95182814 >> v2:172.21.15.86:3300/0 conn(0x7fc00414a2b0 msgr2=0x7fc0040bbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:40.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.100+0000 7fc003fff700 1 --2- 172.21.15.103:0/95182814 >> v2:172.21.15.86:3300/0 conn(0x7fc00414a2b0 0x7fc0040bbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:40.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.100+0000 7fc003fff700 1 -- 172.21.15.103:0/95182814 >> v1:172.21.15.103:6789/0 conn(0x7fc0040bd1b0 legacy=0x7fc00413f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:40.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.100+0000 7fc003fff700 1 -- 172.21.15.103:0/95182814 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc004131940 con 0x7fc004140320 2020-04-22T14:02:40.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.100+0000 7fc003fff700 1 --2- 172.21.15.103:0/95182814 >> v2:172.21.15.103:3300/0 conn(0x7fc004140320 0x7fc004130df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc004153c00 tx=0x7fbff8001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.100+0000 7fc003fff700 1 --2- 172.21.15.103:0/95182814 >> v2:172.21.15.103:3300/0 conn(0x7fc004140320 0x7fc004130df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc004153c00 tx=0x7fbff8001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.100+0000 7fc003fff700 1 --2- 172.21.15.103:0/95182814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc004140320 0x7fc004130df0 secure :-1 s=READY pgs=173 cs=0 l=1 rx=0x7fc004153c00 tx=0x7fbff8001e40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:40.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.100+0000 7fc003fff700 1 --2- 172.21.15.103:0/95182814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc004140320 0x7fc004130df0 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7fc004153c00 tx=0x7fbff8001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.100+0000 7fc001ffb700 1 -- 172.21.15.103:0/95182814 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbff800cc20 con 0x7fc004140320 2020-04-22T14:02:40.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.100+0000 7fc003fff700 1 --2- 172.21.15.103:0/95182814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc004140320 0x7fc004130df0 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7fc004153c00 tx=0x7fbff8001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.100+0000 7fc001ffb700 1 -- 172.21.15.103:0/95182814 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff800cd80 con 0x7fc004140320 2020-04-22T14:02:40.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.100+0000 7fc003fff700 1 --2- 172.21.15.103:0/95182814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc004140320 0x7fc004130df0 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7fc004153c00 tx=0x7fbff8001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.100+0000 7fc00b255700 1 -- 172.21.15.103:0/95182814 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc00413fa20 con 0x7fc004140320 2020-04-22T14:02:40.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.100+0000 7fc001ffb700 1 -- 172.21.15.103:0/95182814 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbff800e370 con 0x7fc004140320 2020-04-22T14:02:40.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.100+0000 7fc00b255700 1 -- 172.21.15.103:0/95182814 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0041426a0 con 0x7fc004140320 2020-04-22T14:02:40.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.101+0000 7fc003fff700 1 --2- 172.21.15.103:0/95182814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc004140320 0x7fc004130df0 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7fc004153c00 tx=0x7fbff8001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.101+0000 7fc00b255700 1 -- 172.21.15.103:0/95182814 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc004056c90 con 0x7fc004140320 2020-04-22T14:02:40.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.101+0000 7fc001ffb700 1 -- 172.21.15.103:0/95182814 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fbff800e5f0 con 0x7fc004140320 2020-04-22T14:02:40.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.101+0000 7fc003fff700 1 --2- 172.21.15.103:0/95182814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc004140320 0x7fc004130df0 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7fc004153c00 tx=0x7fbff8001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.102+0000 7fc001ffb700 1 --2- 172.21.15.103:0/95182814 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbfe404dcc0 0x7fbfe4050180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:40.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.102+0000 7fc001ffb700 1 -- 172.21.15.103:0/95182814 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbff8061190 con 0x7fc004140320 2020-04-22T14:02:40.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.102+0000 7fc008ff1700 1 --2- 172.21.15.103:0/95182814 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbfe404dcc0 0x7fbfe4050180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:40.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.102+0000 7fc008ff1700 1 --2- 172.21.15.103:0/95182814 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbfe404dcc0 0x7fbfe4050180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbff40082e0 tx=0x7fc004143ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.102+0000 7fc008ff1700 1 --2- 172.21.15.103:0/95182814 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbfe404dcc0 0x7fbfe4050180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbff40082e0 tx=0x7fc004143ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.102+0000 7fc008ff1700 1 --2- 172.21.15.103:0/95182814 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbfe404dcc0 0x7fbfe4050180 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7fbff40082e0 tx=0x7fc004143ee0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:40.117 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.106+0000 7fc003fff700 1 --2- 172.21.15.103:0/95182814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc004140320 0x7fc004130df0 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7fc004153c00 tx=0x7fbff8001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.117 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.106+0000 7fc001ffb700 1 -- 172.21.15.103:0/95182814 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fbff803c510 con 0x7fc004140320 2020-04-22T14:02:40.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.247+0000 7fc00b255700 1 -- 172.21.15.103:0/95182814 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc004061690 con 0x7fc004140320 2020-04-22T14:02:40.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.248+0000 7fc003fff700 1 --2- 172.21.15.103:0/95182814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc004140320 0x7fc004130df0 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7fc004153c00 tx=0x7fbff8001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.248+0000 7fc001ffb700 1 -- 172.21.15.103:0/95182814 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16089 (secure 0 0 0) 0x7fbff803fb30 con 0x7fc004140320 2020-04-22T14:02:40.251 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:02:40.252 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":24,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:02:28.687155+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:02:25.963043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-22T14:02:26.642611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:02:40.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.249+0000 7fc00b255700 1 -- 172.21.15.103:0/95182814 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbfe404dcc0 msgr2=0x7fbfe4050180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:40.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.249+0000 7fc00b255700 1 --2- 172.21.15.103:0/95182814 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbfe404dcc0 0x7fbfe4050180 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7fbff40082e0 tx=0x7fc004143ee0).stop 2020-04-22T14:02:40.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.249+0000 7fc00b255700 1 -- 172.21.15.103:0/95182814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc004140320 msgr2=0x7fc004130df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:40.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.249+0000 7fc00b255700 1 --2- 172.21.15.103:0/95182814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc004140320 0x7fc004130df0 secure :-1 s=READY pgs=173 cs=0 l=1 rx=0x7fc004153c00 tx=0x7fbff8001e40).stop 2020-04-22T14:02:40.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.249+0000 7fc00b255700 1 -- 172.21.15.103:0/95182814 shutdown_connections 2020-04-22T14:02:40.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.249+0000 7fc00b255700 1 --2- 172.21.15.103:0/95182814 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbfe404dcc0 0x7fbfe4050180 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:40.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.249+0000 7fc00b255700 1 --2- 172.21.15.103:0/95182814 >> v2:172.21.15.86:3300/0 conn(0x7fc00414a2b0 0x7fc0040bbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:40.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.249+0000 7fc00b255700 1 --2- 172.21.15.103:0/95182814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc004140320 0x7fc004130df0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:40.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.249+0000 7fc00b255700 1 -- 172.21.15.103:0/95182814 >> 172.21.15.103:0/95182814 conn(0x7fc00405f2c0 msgr2=0x7fc004148d10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:40.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.249+0000 7fc00b255700 1 -- 172.21.15.103:0/95182814 shutdown_connections 2020-04-22T14:02:40.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.249+0000 7fc00b255700 1 -- 172.21.15.103:0/95182814 wait complete. 2020-04-22T14:02:40.264 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:25.963043+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:26.642611+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 4, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'24', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:02:40.265 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:40.279 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:02:40.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.425+0000 7ff102e63700 1 Processor -- start 2020-04-22T14:02:40.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.425+0000 7ff102e63700 1 -- start start 2020-04-22T14:02:40.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.426+0000 7ff102e63700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0fc05fed0 0x7ff0fc0af010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:40.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.426+0000 7ff102e63700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0fc0b29b0 con 0x7ff0fc0b8e00 2020-04-22T14:02:40.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.426+0000 7ff102e63700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0fc0b4270 con 0x7ff0fc0b91e0 2020-04-22T14:02:40.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.426+0000 7ff102e63700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc0b4510 con 0x7ff0fc05fed0 2020-04-22T14:02:40.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.426+0000 7ff101660700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff0fc0b91e0 0x7ff0fc0b1bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39682/0 (socket says 172.21.15.103:39682) 2020-04-22T14:02:40.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.426+0000 7ff101660700 1 -- 172.21.15.103:0/3785565091 learned_addr learned my addr 172.21.15.103:0/3785565091 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:40.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.426+0000 7ff102662700 1 --2- 172.21.15.103:0/3785565091 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0fc05fed0 0x7ff0fc0af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:40.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.426+0000 7ff100e5f700 1 -- 172.21.15.103:0/3785565091 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1791379240 0 0) 0x7ff0fc0b4270 con 0x7ff0fc0b91e0 2020-04-22T14:02:40.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.426+0000 7ff100e5f700 1 -- 172.21.15.103:0/3785565091 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0e4003230 con 0x7ff0fc0b91e0 2020-04-22T14:02:40.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.427+0000 7ff100e5f700 1 -- 172.21.15.103:0/3785565091 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1501897344 0 0) 0x7ff0fc0b29b0 con 0x7ff0fc0b8e00 2020-04-22T14:02:40.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.427+0000 7ff100e5f700 1 -- 172.21.15.103:0/3785565091 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0fc0b4270 con 0x7ff0fc0b8e00 2020-04-22T14:02:40.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.427+0000 7ff100e5f700 1 -- 172.21.15.103:0/3785565091 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2371824271 0 0) 0x7ff0e4003230 con 0x7ff0fc0b91e0 2020-04-22T14:02:40.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.427+0000 7ff100e5f700 1 -- 172.21.15.103:0/3785565091 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0fc05fed0 msgr2=0x7ff0fc0af010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:40.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.427+0000 7ff100e5f700 1 --2- 172.21.15.103:0/3785565091 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0fc05fed0 0x7ff0fc0af010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:40.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.427+0000 7ff100e5f700 1 -- 172.21.15.103:0/3785565091 >> v1:172.21.15.86:6789/0 conn(0x7ff0fc0b8e00 legacy=0x7ff0fc142f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:40.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.427+0000 7ff100e5f700 1 -- 172.21.15.103:0/3785565091 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0fc0b22d0 con 0x7ff0fc0b91e0 2020-04-22T14:02:40.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.427+0000 7ff100e5f700 1 -- 172.21.15.103:0/3785565091 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7ff0f80016d0 con 0x7ff0fc0b91e0 2020-04-22T14:02:40.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.427+0000 7ff102662700 1 --2- 172.21.15.103:0/3785565091 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0fc05fed0 0x7ff0fc0af010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:02:40.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.427+0000 7ff100e5f700 1 -- 172.21.15.103:0/3785565091 >> v1:172.21.15.103:6789/0 conn(0x7ff0fc0b91e0 legacy=0x7ff0fc0b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:40.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.427+0000 7ff100e5f700 1 --2- 172.21.15.103:0/3785565091 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0fc05fed0 0x7ff0e40038b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:40.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.427+0000 7ff100e5f700 1 --2- 172.21.15.103:0/3785565091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0e4003d10 0x7ff0e40044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:40.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.427+0000 7ff100e5f700 1 --2- 172.21.15.103:0/3785565091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0e4004930 0x7ff0e4004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:40.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.427+0000 7ff100e5f700 1 -- 172.21.15.103:0/3785565091 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc0b4510 con 0x7ff0e4004930 2020-04-22T14:02:40.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.427+0000 7ff100e5f700 1 -- 172.21.15.103:0/3785565091 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e4005210 con 0x7ff0e4003d10 2020-04-22T14:02:40.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.427+0000 7ff100e5f700 1 -- 172.21.15.103:0/3785565091 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e400b720 con 0x7ff0fc05fed0 2020-04-22T14:02:40.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.427+0000 7ff101660700 1 --2- 172.21.15.103:0/3785565091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0e4003d10 0x7ff0e40044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:40.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.427+0000 7ff101e61700 1 --2- 172.21.15.103:0/3785565091 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0fc05fed0 0x7ff0e40038b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:40.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.427+0000 7ff102662700 1 --2- 172.21.15.103:0/3785565091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0e4004930 0x7ff0e4004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:40.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.427+0000 7ff101660700 1 -- 172.21.15.103:0/3785565091 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0fc05fed0 msgr2=0x7ff0e40038b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:40.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.427+0000 7ff101660700 1 --2- 172.21.15.103:0/3785565091 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0fc05fed0 0x7ff0e40038b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:40.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.427+0000 7ff101660700 1 -- 172.21.15.103:0/3785565091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0e4004930 msgr2=0x7ff0e4004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:40.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.427+0000 7ff101660700 1 --2- 172.21.15.103:0/3785565091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0e4004930 0x7ff0e4004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:40.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.427+0000 7ff101660700 1 -- 172.21.15.103:0/3785565091 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e4003230 con 0x7ff0e4003d10 2020-04-22T14:02:40.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.427+0000 7ff101660700 1 --2- 172.21.15.103:0/3785565091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0e4003d10 0x7ff0e40044d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff0f80014a0 tx=0x7ff0fc0b24c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.427+0000 7ff101660700 1 --2- 172.21.15.103:0/3785565091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0e4003d10 0x7ff0e40044d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff0f80014a0 tx=0x7ff0fc0b24c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.427+0000 7ff101660700 1 --2- 172.21.15.103:0/3785565091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0e4003d10 0x7ff0e40044d0 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7ff0f80014a0 tx=0x7ff0fc0b24c0).ready entity=mon.1 client_cookie=82638da32243ab68 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:40.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.427+0000 7ff101660700 1 --2- 172.21.15.103:0/3785565091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0e4003d10 0x7ff0e40044d0 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7ff0f80014a0 tx=0x7ff0fc0b24c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.427+0000 7ff100e5f700 1 -- 172.21.15.103:0/3785565091 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0f8010db0 con 0x7ff0e4003d10 2020-04-22T14:02:40.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.427+0000 7ff101660700 1 --2- 172.21.15.103:0/3785565091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0e4003d10 0x7ff0e40044d0 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7ff0f80014a0 tx=0x7ff0fc0b24c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.427+0000 7ff100e5f700 1 -- 172.21.15.103:0/3785565091 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f80101c0 con 0x7ff0e4003d10 2020-04-22T14:02:40.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.427+0000 7ff101660700 1 --2- 172.21.15.103:0/3785565091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0e4003d10 0x7ff0e40044d0 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7ff0f80014a0 tx=0x7ff0fc0b24c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.427+0000 7ff100e5f700 1 -- 172.21.15.103:0/3785565091 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0f8010560 con 0x7ff0e4003d10 2020-04-22T14:02:40.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.427+0000 7ff102e63700 1 -- 172.21.15.103:0/3785565091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0e4003d10 msgr2=0x7ff0e40044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:40.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.427+0000 7ff102e63700 1 --2- 172.21.15.103:0/3785565091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0e4003d10 0x7ff0e40044d0 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7ff0f80014a0 tx=0x7ff0fc0b24c0).stop 2020-04-22T14:02:40.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.427+0000 7ff102662700 1 -- 172.21.15.103:0/3785565091 reap_dead start 2020-04-22T14:02:40.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.428+0000 7ff102e63700 1 -- 172.21.15.103:0/3785565091 shutdown_connections 2020-04-22T14:02:40.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.428+0000 7ff102e63700 1 -- 172.21.15.103:0/3785565091 >> 172.21.15.103:0/3785565091 conn(0x7ff0fc05b780 msgr2=0x7ff0fc0b8530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:40.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.428+0000 7ff102e63700 1 -- 172.21.15.103:0/3785565091 shutdown_connections 2020-04-22T14:02:40.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.428+0000 7ff102e63700 1 -- 172.21.15.103:0/3785565091 wait complete. 2020-04-22T14:02:40.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.429+0000 7ff102e63700 1 Processor -- start 2020-04-22T14:02:40.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.429+0000 7ff102e63700 1 -- start start 2020-04-22T14:02:40.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.430+0000 7ff102e63700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff0fc1461c0 0x7ff0fc063a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:40.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.430+0000 7ff102e63700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0fc1453d0 con 0x7ff0fc1512a0 2020-04-22T14:02:40.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.430+0000 7ff102e63700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0fc145670 con 0x7ff0fc142db0 2020-04-22T14:02:40.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.430+0000 7ff102e63700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0fc062bd0 con 0x7ff0fc1461c0 2020-04-22T14:02:40.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.430+0000 7ff102662700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff0fc142db0 0x7ff0fc154fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39696/0 (socket says 172.21.15.103:39696) 2020-04-22T14:02:40.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.430+0000 7ff102662700 1 -- 172.21.15.103:0/2099627560 learned_addr learned my addr 172.21.15.103:0/2099627560 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:40.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.430+0000 7ff101660700 1 --2- 172.21.15.103:0/2099627560 >> v2:172.21.15.86:3300/0 conn(0x7ff0fc1461c0 0x7ff0fc063a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:40.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.430+0000 7ff0eaffd700 1 -- 172.21.15.103:0/2099627560 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1606738864 0 0) 0x7ff0fc145670 con 0x7ff0fc142db0 2020-04-22T14:02:40.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.430+0000 7ff0eaffd700 1 -- 172.21.15.103:0/2099627560 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0dc002fe0 con 0x7ff0fc142db0 2020-04-22T14:02:40.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.430+0000 7ff0eaffd700 1 -- 172.21.15.103:0/2099627560 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2823586934 0 0) 0x7ff0fc1453d0 con 0x7ff0fc1512a0 2020-04-22T14:02:40.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.430+0000 7ff101660700 1 -- 172.21.15.103:0/2099627560 >> v1:172.21.15.103:6789/0 conn(0x7ff0fc142db0 legacy=0x7ff0fc154fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:40.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.430+0000 7ff101660700 1 -- 172.21.15.103:0/2099627560 >> v1:172.21.15.86:6789/0 conn(0x7ff0fc1512a0 legacy=0x7ff0fc151680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:40.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.430+0000 7ff101660700 1 -- 172.21.15.103:0/2099627560 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0fc145910 con 0x7ff0fc1461c0 2020-04-22T14:02:40.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.430+0000 7ff101660700 1 --2- 172.21.15.103:0/2099627560 >> v2:172.21.15.86:3300/0 conn(0x7ff0fc1461c0 0x7ff0fc063a10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff0f80014a0 tx=0x7ff0fc0b24c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.430+0000 7ff101660700 1 --2- 172.21.15.103:0/2099627560 >> v2:172.21.15.86:3300/0 conn(0x7ff0fc1461c0 0x7ff0fc063a10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff0f80014a0 tx=0x7ff0fc0b24c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.430+0000 7ff101660700 1 --2- 172.21.15.103:0/2099627560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0fc1461c0 0x7ff0fc063a10 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7ff0f80014a0 tx=0x7ff0fc0b24c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:40.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.430+0000 7ff101660700 1 --2- 172.21.15.103:0/2099627560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0fc1461c0 0x7ff0fc063a10 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7ff0f80014a0 tx=0x7ff0fc0b24c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.430+0000 7ff0eaffd700 1 -- 172.21.15.103:0/2099627560 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0f8000e90 con 0x7ff0fc1461c0 2020-04-22T14:02:40.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.430+0000 7ff101660700 1 --2- 172.21.15.103:0/2099627560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0fc1461c0 0x7ff0fc063a10 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7ff0f80014a0 tx=0x7ff0fc0b24c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.430+0000 7ff0eaffd700 1 -- 172.21.15.103:0/2099627560 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f800b370 con 0x7ff0fc1461c0 2020-04-22T14:02:40.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.430+0000 7ff101660700 1 --2- 172.21.15.103:0/2099627560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0fc1461c0 0x7ff0fc063a10 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7ff0f80014a0 tx=0x7ff0fc0b24c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.430+0000 7ff102e63700 1 -- 172.21.15.103:0/2099627560 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0fc143220 con 0x7ff0fc1461c0 2020-04-22T14:02:40.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.430+0000 7ff0eaffd700 1 -- 172.21.15.103:0/2099627560 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0f800a2c0 con 0x7ff0fc1461c0 2020-04-22T14:02:40.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.431+0000 7ff102e63700 1 -- 172.21.15.103:0/2099627560 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0fc1556f0 con 0x7ff0fc1461c0 2020-04-22T14:02:40.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.431+0000 7ff101660700 1 --2- 172.21.15.103:0/2099627560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0fc1461c0 0x7ff0fc063a10 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7ff0f80014a0 tx=0x7ff0fc0b24c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.432+0000 7ff102e63700 1 -- 172.21.15.103:0/2099627560 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0fc056c90 con 0x7ff0fc1461c0 2020-04-22T14:02:40.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.432+0000 7ff0eaffd700 1 -- 172.21.15.103:0/2099627560 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ff0f80045b0 con 0x7ff0fc1461c0 2020-04-22T14:02:40.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.432+0000 7ff101660700 1 --2- 172.21.15.103:0/2099627560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0fc1461c0 0x7ff0fc063a10 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7ff0f80014a0 tx=0x7ff0fc0b24c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.432+0000 7ff0eaffd700 1 --2- 172.21.15.103:0/2099627560 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff0dc04dc40 0x7ff0dc050100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:40.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.432+0000 7ff0eaffd700 1 -- 172.21.15.103:0/2099627560 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff0f8061230 con 0x7ff0fc1461c0 2020-04-22T14:02:40.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.432+0000 7ff101e61700 1 --2- 172.21.15.103:0/2099627560 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff0dc04dc40 0x7ff0dc050100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:40.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.432+0000 7ff101e61700 1 --2- 172.21.15.103:0/2099627560 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff0dc04dc40 0x7ff0dc050100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff0ec0012b0 tx=0x7ff0ec00ca20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.432+0000 7ff101e61700 1 --2- 172.21.15.103:0/2099627560 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff0dc04dc40 0x7ff0dc050100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff0ec0012b0 tx=0x7ff0ec00ca20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.432+0000 7ff101e61700 1 --2- 172.21.15.103:0/2099627560 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff0dc04dc40 0x7ff0dc050100 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7ff0ec0012b0 tx=0x7ff0ec00ca20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:40.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.435+0000 7ff101660700 1 --2- 172.21.15.103:0/2099627560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0fc1461c0 0x7ff0fc063a10 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7ff0f80014a0 tx=0x7ff0fc0b24c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.435+0000 7ff0eaffd700 1 -- 172.21.15.103:0/2099627560 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ff0f803c6d0 con 0x7ff0fc1461c0 2020-04-22T14:02:40.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.578+0000 7ff102e63700 1 -- 172.21.15.103:0/2099627560 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff0fc0b6c00 con 0x7ff0fc1461c0 2020-04-22T14:02:40.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.580+0000 7ff101660700 1 --2- 172.21.15.103:0/2099627560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0fc1461c0 0x7ff0fc063a10 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7ff0f80014a0 tx=0x7ff0fc0b24c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.580+0000 7ff0eaffd700 1 -- 172.21.15.103:0/2099627560 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v24) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff0f803fcf0 con 0x7ff0fc1461c0 2020-04-22T14:02:40.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.580+0000 7ff102e63700 1 -- 172.21.15.103:0/2099627560 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff0dc04dc40 msgr2=0x7ff0dc050100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:40.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.580+0000 7ff102e63700 1 --2- 172.21.15.103:0/2099627560 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff0dc04dc40 0x7ff0dc050100 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7ff0ec0012b0 tx=0x7ff0ec00ca20).stop 2020-04-22T14:02:40.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.580+0000 7ff102e63700 1 -- 172.21.15.103:0/2099627560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0fc1461c0 msgr2=0x7ff0fc063a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:40.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.580+0000 7ff102e63700 1 --2- 172.21.15.103:0/2099627560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0fc1461c0 0x7ff0fc063a10 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7ff0f80014a0 tx=0x7ff0fc0b24c0).stop 2020-04-22T14:02:40.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.580+0000 7ff102e63700 1 -- 172.21.15.103:0/2099627560 shutdown_connections 2020-04-22T14:02:40.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.580+0000 7ff102e63700 1 --2- 172.21.15.103:0/2099627560 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff0dc04dc40 0x7ff0dc050100 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:40.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.580+0000 7ff102e63700 1 --2- 172.21.15.103:0/2099627560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0fc1461c0 0x7ff0fc063a10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:40.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.581+0000 7ff102e63700 1 -- 172.21.15.103:0/2099627560 >> 172.21.15.103:0/2099627560 conn(0x7ff0fc05b780 msgr2=0x7ff0fc0b1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:40.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.581+0000 7ff102e63700 1 -- 172.21.15.103:0/2099627560 shutdown_connections 2020-04-22T14:02:40.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.581+0000 7ff102e63700 1 -- 172.21.15.103:0/2099627560 wait complete. 2020-04-22T14:02:40.589 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:02:40.593 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:40.613 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:02:40.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.759+0000 7f3a90c3d700 1 Processor -- start 2020-04-22T14:02:40.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.759+0000 7f3a90c3d700 1 -- start start 2020-04-22T14:02:40.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.760+0000 7f3a90c3d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3a8c0b4820 0x7f3a8c0acb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:40.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.760+0000 7f3a90c3d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3a8c141f20 0x7f3a8c142380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:40.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.760+0000 7f3a90c3d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a8c0af030 con 0x7f3a8c061a30 2020-04-22T14:02:40.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.760+0000 7f3a90c3d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a8c060250 con 0x7f3a8c141f20 2020-04-22T14:02:40.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.760+0000 7f3a90c3d700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a8c0623c0 con 0x7f3a8c0b4820 2020-04-22T14:02:40.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.760+0000 7f3a89d9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3a8c0b4820 0x7f3a8c0acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:40.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.760+0000 7f3a89d9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3a8c0b4820 0x7f3a8c0acb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47514/0 (socket says 172.21.15.103:47514) 2020-04-22T14:02:40.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.761+0000 7f3a89d9b700 1 -- 172.21.15.103:0/2133211812 learned_addr learned my addr 172.21.15.103:0/2133211812 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:40.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.761+0000 7f3a8ad9d700 1 --2- 172.21.15.103:0/2133211812 >> v2:172.21.15.86:3300/0 conn(0x7f3a8c141f20 0x7f3a8c142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:40.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.761+0000 7f3a89d9b700 1 -- 172.21.15.103:0/2133211812 >> v2:172.21.15.86:3300/0 conn(0x7f3a8c141f20 msgr2=0x7f3a8c142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:40.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.761+0000 7f3a89d9b700 1 --2- 172.21.15.103:0/2133211812 >> v2:172.21.15.86:3300/0 conn(0x7f3a8c141f20 0x7f3a8c142380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:40.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.761+0000 7f3a89d9b700 1 -- 172.21.15.103:0/2133211812 >> v1:172.21.15.86:6789/0 conn(0x7f3a8c061a30 legacy=0x7f3a8c0ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:40.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.761+0000 7f3a89d9b700 1 -- 172.21.15.103:0/2133211812 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8c062660 con 0x7f3a8c0b4820 2020-04-22T14:02:40.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.761+0000 7f3a8ad9d700 1 --2- 172.21.15.103:0/2133211812 >> v2:172.21.15.86:3300/0 conn(0x7f3a8c141f20 0x7f3a8c142380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:02:40.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.761+0000 7f3a89d9b700 1 --2- 172.21.15.103:0/2133211812 >> v2:172.21.15.103:3300/0 conn(0x7f3a8c0b4820 0x7f3a8c0acb10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3a7c002f30 tx=0x7f3a7c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.761+0000 7f3a89d9b700 1 --2- 172.21.15.103:0/2133211812 >> v2:172.21.15.103:3300/0 conn(0x7f3a8c0b4820 0x7f3a8c0acb10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3a7c002f30 tx=0x7f3a7c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.761+0000 7f3a89d9b700 1 --2- 172.21.15.103:0/2133211812 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a8c0b4820 0x7f3a8c0acb10 secure :-1 s=READY pgs=177 cs=0 l=1 rx=0x7f3a7c002f30 tx=0x7f3a7c007a40).ready entity=mon.1 client_cookie=d235e3d7d72ecc8d server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:40.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.761+0000 7f3a89d9b700 1 --2- 172.21.15.103:0/2133211812 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a8c0b4820 0x7f3a8c0acb10 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f3a7c002f30 tx=0x7f3a7c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.761+0000 7f3a89d9b700 1 --2- 172.21.15.103:0/2133211812 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a8c0b4820 0x7f3a8c0acb10 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f3a7c002f30 tx=0x7f3a7c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.761+0000 7f3a8959a700 1 -- 172.21.15.103:0/2133211812 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a7c011720 con 0x7f3a8c0b4820 2020-04-22T14:02:40.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.761+0000 7f3a89d9b700 1 --2- 172.21.15.103:0/2133211812 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a8c0b4820 0x7f3a8c0acb10 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f3a7c002f30 tx=0x7f3a7c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.761+0000 7f3a8959a700 1 -- 172.21.15.103:0/2133211812 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7c011880 con 0x7f3a8c0b4820 2020-04-22T14:02:40.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.761+0000 7f3a8959a700 1 -- 172.21.15.103:0/2133211812 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a7c011ca0 con 0x7f3a8c0b4820 2020-04-22T14:02:40.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.761+0000 7f3a90c3d700 1 -- 172.21.15.103:0/2133211812 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a8c0b4820 msgr2=0x7f3a8c0acb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:40.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.761+0000 7f3a90c3d700 1 --2- 172.21.15.103:0/2133211812 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a8c0b4820 0x7f3a8c0acb10 secure :-1 s=READY pgs=177 cs=0 l=1 rx=0x7f3a7c002f30 tx=0x7f3a7c007a40).stop 2020-04-22T14:02:40.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.762+0000 7f3a90c3d700 1 -- 172.21.15.103:0/2133211812 shutdown_connections 2020-04-22T14:02:40.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.762+0000 7f3a90c3d700 1 --2- 172.21.15.103:0/2133211812 >> v2:172.21.15.86:3300/0 conn(0x7f3a8c141f20 0x7f3a8c142380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:40.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.762+0000 7f3a90c3d700 1 --2- 172.21.15.103:0/2133211812 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a8c0b4820 0x7f3a8c0acb10 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:40.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.762+0000 7f3a90c3d700 1 -- 172.21.15.103:0/2133211812 >> 172.21.15.103:0/2133211812 conn(0x7f3a8c05b7b0 msgr2=0x7f3a8c0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:40.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.762+0000 7f3a90c3d700 1 -- 172.21.15.103:0/2133211812 shutdown_connections 2020-04-22T14:02:40.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.762+0000 7f3a90c3d700 1 -- 172.21.15.103:0/2133211812 wait complete. 2020-04-22T14:02:40.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.763+0000 7f3a90c3d700 1 Processor -- start 2020-04-22T14:02:40.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.763+0000 7f3a90c3d700 1 -- start start 2020-04-22T14:02:40.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.763+0000 7f3a90c3d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3a8c061a30 0x7f3a8c1444a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:40.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.763+0000 7f3a90c3d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3a8c141f20 0x7f3a8c0b2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:40.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.763+0000 7f3a90c3d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a8c144230 con 0x7f3a8c0b4820 2020-04-22T14:02:40.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.763+0000 7f3a90c3d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a8c0b0c80 con 0x7f3a8c141f20 2020-04-22T14:02:40.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.763+0000 7f3a90c3d700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a8c0b02a0 con 0x7f3a8c061a30 2020-04-22T14:02:40.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.763+0000 7f3a8a59c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3a8c061a30 0x7f3a8c1444a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:40.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.763+0000 7f3a89d9b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f3a8c0b4820 0x7f3a8c137db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39708/0 (socket says 172.21.15.103:39708) 2020-04-22T14:02:40.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.763+0000 7f3a89d9b700 1 -- 172.21.15.103:0/391767194 learned_addr learned my addr 172.21.15.103:0/391767194 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:40.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.763+0000 7f3a8ad9d700 1 --2- 172.21.15.103:0/391767194 >> v2:172.21.15.86:3300/0 conn(0x7f3a8c141f20 0x7f3a8c0b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:40.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.764+0000 7f3a8a59c700 1 -- 172.21.15.103:0/391767194 >> v2:172.21.15.86:3300/0 conn(0x7f3a8c141f20 msgr2=0x7f3a8c0b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:40.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.764+0000 7f3a8a59c700 1 --2- 172.21.15.103:0/391767194 >> v2:172.21.15.86:3300/0 conn(0x7f3a8c141f20 0x7f3a8c0b2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:40.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.764+0000 7f3a8a59c700 1 -- 172.21.15.103:0/391767194 >> v1:172.21.15.103:6789/0 conn(0x7f3a8c0b4820 legacy=0x7f3a8c137db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:40.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.764+0000 7f3a7b7fe700 1 -- 172.21.15.103:0/391767194 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 688496315 0 0) 0x7f3a8c144230 con 0x7f3a8c0b4820 2020-04-22T14:02:40.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.764+0000 7f3a8a59c700 1 -- 172.21.15.103:0/391767194 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8c0b0540 con 0x7f3a8c061a30 2020-04-22T14:02:40.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.764+0000 7f3a8a59c700 1 --2- 172.21.15.103:0/391767194 >> v2:172.21.15.103:3300/0 conn(0x7f3a8c061a30 0x7f3a8c1444a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3a8c05bc40 tx=0x7f3a80010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.764+0000 7f3a8a59c700 1 --2- 172.21.15.103:0/391767194 >> v2:172.21.15.103:3300/0 conn(0x7f3a8c061a30 0x7f3a8c1444a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3a8c05bc40 tx=0x7f3a80010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.764+0000 7f3a8a59c700 1 --2- 172.21.15.103:0/391767194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a8c061a30 0x7f3a8c1444a0 secure :-1 s=READY pgs=179 cs=0 l=1 rx=0x7f3a8c05bc40 tx=0x7f3a80010930).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:40.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.764+0000 7f3a8a59c700 1 --2- 172.21.15.103:0/391767194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a8c061a30 0x7f3a8c1444a0 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f3a8c05bc40 tx=0x7f3a80010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.764+0000 7f3a7b7fe700 1 -- 172.21.15.103:0/391767194 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a80006bc0 con 0x7f3a8c061a30 2020-04-22T14:02:40.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.764+0000 7f3a8a59c700 1 --2- 172.21.15.103:0/391767194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a8c061a30 0x7f3a8c1444a0 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f3a8c05bc40 tx=0x7f3a80010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.764+0000 7f3a8a59c700 1 --2- 172.21.15.103:0/391767194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a8c061a30 0x7f3a8c1444a0 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f3a8c05bc40 tx=0x7f3a80010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.764+0000 7f3a7b7fe700 1 -- 172.21.15.103:0/391767194 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a80006d60 con 0x7f3a8c061a30 2020-04-22T14:02:40.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.764+0000 7f3a90c3d700 1 -- 172.21.15.103:0/391767194 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a8c0b07e0 con 0x7f3a8c061a30 2020-04-22T14:02:40.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.764+0000 7f3a7b7fe700 1 -- 172.21.15.103:0/391767194 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a80011150 con 0x7f3a8c061a30 2020-04-22T14:02:40.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.764+0000 7f3a90c3d700 1 -- 172.21.15.103:0/391767194 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a8c138760 con 0x7f3a8c061a30 2020-04-22T14:02:40.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.764+0000 7f3a8a59c700 1 --2- 172.21.15.103:0/391767194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a8c061a30 0x7f3a8c1444a0 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f3a8c05bc40 tx=0x7f3a80010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.765+0000 7f3a7b7fe700 1 -- 172.21.15.103:0/391767194 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f3a80011350 con 0x7f3a8c061a30 2020-04-22T14:02:40.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.765+0000 7f3a8a59c700 1 --2- 172.21.15.103:0/391767194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a8c061a30 0x7f3a8c1444a0 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f3a8c05bc40 tx=0x7f3a80010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.765+0000 7f3a90c3d700 1 -- 172.21.15.103:0/391767194 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a8c056c90 con 0x7f3a8c061a30 2020-04-22T14:02:40.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.765+0000 7f3a7b7fe700 1 --2- 172.21.15.103:0/391767194 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3a6804d830 0x7f3a6804fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:40.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.765+0000 7f3a7b7fe700 1 -- 172.21.15.103:0/391767194 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3a800613d0 con 0x7f3a8c061a30 2020-04-22T14:02:40.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.765+0000 7f3a89d9b700 1 --2- 172.21.15.103:0/391767194 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3a6804d830 0x7f3a6804fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:40.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.766+0000 7f3a89d9b700 1 --2- 172.21.15.103:0/391767194 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3a6804d830 0x7f3a6804fcf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3a7c008320 tx=0x7f3a7c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.766+0000 7f3a89d9b700 1 --2- 172.21.15.103:0/391767194 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3a6804d830 0x7f3a6804fcf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3a7c008320 tx=0x7f3a7c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.766+0000 7f3a89d9b700 1 --2- 172.21.15.103:0/391767194 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3a6804d830 0x7f3a6804fcf0 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7f3a7c008320 tx=0x7f3a7c007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:40.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.769+0000 7f3a8a59c700 1 --2- 172.21.15.103:0/391767194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a8c061a30 0x7f3a8c1444a0 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f3a8c05bc40 tx=0x7f3a80010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.769+0000 7f3a7b7fe700 1 -- 172.21.15.103:0/391767194 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f3a8003c750 con 0x7f3a8c061a30 2020-04-22T14:02:40.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.912+0000 7f3a90c3d700 1 -- 172.21.15.103:0/391767194 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3a8c06a960 con 0x7f3a8c061a30 2020-04-22T14:02:40.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.913+0000 7f3a8a59c700 1 --2- 172.21.15.103:0/391767194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a8c061a30 0x7f3a8c1444a0 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f3a8c05bc40 tx=0x7f3a80010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:40.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.913+0000 7f3a7b7fe700 1 -- 172.21.15.103:0/391767194 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3a8003fd70 con 0x7f3a8c061a30 2020-04-22T14:02:40.916 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:02:40.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.914+0000 7f3a90c3d700 1 -- 172.21.15.103:0/391767194 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3a6804d830 msgr2=0x7f3a6804fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:40.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.914+0000 7f3a90c3d700 1 --2- 172.21.15.103:0/391767194 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3a6804d830 0x7f3a6804fcf0 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7f3a7c008320 tx=0x7f3a7c007a40).stop 2020-04-22T14:02:40.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.914+0000 7f3a90c3d700 1 -- 172.21.15.103:0/391767194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a8c061a30 msgr2=0x7f3a8c1444a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:40.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.914+0000 7f3a90c3d700 1 --2- 172.21.15.103:0/391767194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a8c061a30 0x7f3a8c1444a0 secure :-1 s=READY pgs=179 cs=0 l=1 rx=0x7f3a8c05bc40 tx=0x7f3a80010930).stop 2020-04-22T14:02:40.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.914+0000 7f3a90c3d700 1 -- 172.21.15.103:0/391767194 shutdown_connections 2020-04-22T14:02:40.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.914+0000 7f3a90c3d700 1 --2- 172.21.15.103:0/391767194 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3a6804d830 0x7f3a6804fcf0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:40.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.914+0000 7f3a90c3d700 1 --2- 172.21.15.103:0/391767194 >> v2:172.21.15.86:3300/0 conn(0x7f3a8c141f20 0x7f3a8c0b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:40.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.914+0000 7f3a90c3d700 1 --2- 172.21.15.103:0/391767194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a8c061a30 0x7f3a8c1444a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:40.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.914+0000 7f3a90c3d700 1 -- 172.21.15.103:0/391767194 >> 172.21.15.103:0/391767194 conn(0x7f3a8c05b7b0 msgr2=0x7f3a8c0b7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:40.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.914+0000 7f3a90c3d700 1 -- 172.21.15.103:0/391767194 shutdown_connections 2020-04-22T14:02:40.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:40.914+0000 7f3a90c3d700 1 -- 172.21.15.103:0/391767194 wait complete. 2020-04-22T14:02:40.928 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:40.943 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-22T14:02:41.098 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.095+0000 7fcdd1887700 1 Processor -- start 2020-04-22T14:02:41.099 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.095+0000 7fcdd1887700 1 -- start start 2020-04-22T14:02:41.101 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.096+0000 7fcdd1887700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcdcc0b8fc0 0x7fcdcc0b2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:41.101 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.096+0000 7fcdd1887700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcdcc1444a0 0x7fcdcc0616f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:41.101 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.096+0000 7fcdd1887700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdcc144990 con 0x7fcdcc144040 2020-04-22T14:02:41.101 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.096+0000 7fcdd1887700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdcc144c30 con 0x7fcdcc1444a0 2020-04-22T14:02:41.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.096+0000 7fcdd1887700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc144ed0 con 0x7fcdcc0b8fc0 2020-04-22T14:02:41.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.096+0000 7fcdd1086700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcdcc1444a0 0x7fcdcc0616f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:41.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.096+0000 7fcdd1086700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcdcc1444a0 0x7fcdcc0616f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47528/0 (socket says 172.21.15.103:47528) 2020-04-22T14:02:41.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.096+0000 7fcdd1086700 1 -- 172.21.15.103:0/4241145585 learned_addr learned my addr 172.21.15.103:0/4241145585 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:41.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.096+0000 7fcdd0885700 1 --2- 172.21.15.103:0/4241145585 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcdcc0b8fc0 0x7fcdcc0b2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:41.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.097+0000 7fcdd1086700 1 -- 172.21.15.103:0/4241145585 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcdcc0b8fc0 msgr2=0x7fcdcc0b2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:41.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.097+0000 7fcdd1086700 1 --2- 172.21.15.103:0/4241145585 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcdcc0b8fc0 0x7fcdcc0b2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:41.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.097+0000 7fcdd1086700 1 -- 172.21.15.103:0/4241145585 >> v1:172.21.15.86:6789/0 conn(0x7fcdcc144040 legacy=0x7fcdcc13dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:41.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.097+0000 7fcdd1086700 1 -- 172.21.15.103:0/4241145585 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdcc0b93a0 con 0x7fcdcc1444a0 2020-04-22T14:02:41.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.097+0000 7fcdd1086700 1 --2- 172.21.15.103:0/4241145585 >> v2:172.21.15.103:3300/0 conn(0x7fcdcc1444a0 0x7fcdcc0616f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcdc40032b0 tx=0x7fcdc4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.097+0000 7fcdd1086700 1 --2- 172.21.15.103:0/4241145585 >> v2:172.21.15.103:3300/0 conn(0x7fcdcc1444a0 0x7fcdcc0616f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcdc40032b0 tx=0x7fcdc4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.097+0000 7fcdd1086700 1 --2- 172.21.15.103:0/4241145585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcdcc1444a0 0x7fcdcc0616f0 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7fcdc40032b0 tx=0x7fcdc4007dc0).ready entity=mon.1 client_cookie=e043fbca1d82de91 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:41.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.097+0000 7fcdd1086700 1 --2- 172.21.15.103:0/4241145585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcdcc1444a0 0x7fcdcc0616f0 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7fcdc40032b0 tx=0x7fcdc4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.097+0000 7fcdcb7fe700 1 -- 172.21.15.103:0/4241145585 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdc400a180 con 0x7fcdcc1444a0 2020-04-22T14:02:41.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.097+0000 7fcdd1086700 1 --2- 172.21.15.103:0/4241145585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcdcc1444a0 0x7fcdcc0616f0 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7fcdc40032b0 tx=0x7fcdc4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.097+0000 7fcdcb7fe700 1 -- 172.21.15.103:0/4241145585 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc400a320 con 0x7fcdcc1444a0 2020-04-22T14:02:41.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.097+0000 7fcdd1086700 1 --2- 172.21.15.103:0/4241145585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcdcc1444a0 0x7fcdcc0616f0 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7fcdc40032b0 tx=0x7fcdc4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.097+0000 7fcdcb7fe700 1 -- 172.21.15.103:0/4241145585 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdc400a740 con 0x7fcdcc1444a0 2020-04-22T14:02:41.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.097+0000 7fcdd1887700 1 -- 172.21.15.103:0/4241145585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcdcc1444a0 msgr2=0x7fcdcc0616f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:41.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.097+0000 7fcdd1887700 1 --2- 172.21.15.103:0/4241145585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcdcc1444a0 0x7fcdcc0616f0 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7fcdc40032b0 tx=0x7fcdc4007dc0).stop 2020-04-22T14:02:41.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.097+0000 7fcdd1887700 1 -- 172.21.15.103:0/4241145585 shutdown_connections 2020-04-22T14:02:41.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.097+0000 7fcdd1887700 1 --2- 172.21.15.103:0/4241145585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcdcc1444a0 0x7fcdcc0616f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:41.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.097+0000 7fcdd1887700 1 --2- 172.21.15.103:0/4241145585 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcdcc0b8fc0 0x7fcdcc0b2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:41.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.097+0000 7fcdd1887700 1 -- 172.21.15.103:0/4241145585 >> 172.21.15.103:0/4241145585 conn(0x7fcdcc05b780 msgr2=0x7fcdcc0b8530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:41.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.097+0000 7fcdd1887700 1 -- 172.21.15.103:0/4241145585 shutdown_connections 2020-04-22T14:02:41.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.097+0000 7fcdd1887700 1 -- 172.21.15.103:0/4241145585 wait complete. 2020-04-22T14:02:41.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.098+0000 7fcdd1887700 1 Processor -- start 2020-04-22T14:02:41.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.098+0000 7fcdd1887700 1 -- start start 2020-04-22T14:02:41.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.099+0000 7fcdd1887700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcdcc144040 0x7fcdcc13c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:41.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.099+0000 7fcdd1887700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcdcc1444a0 0x7fcdcc13a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:41.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.099+0000 7fcdd1887700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdcc13cc90 con 0x7fcdcc0b8fc0 2020-04-22T14:02:41.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.099+0000 7fcdd1887700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdcc0b8910 con 0x7fcdcc1444a0 2020-04-22T14:02:41.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.099+0000 7fcdd1887700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc157a30 con 0x7fcdcc144040 2020-04-22T14:02:41.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.099+0000 7fcdd0885700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fcdcc0b8fc0 0x7fcdcc157200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39720/0 (socket says 172.21.15.103:39720) 2020-04-22T14:02:41.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.099+0000 7fcdd0885700 1 -- 172.21.15.103:0/445702488 learned_addr learned my addr 172.21.15.103:0/445702488 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:41.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.099+0000 7fcdd1086700 1 --2- 172.21.15.103:0/445702488 >> v2:172.21.15.103:3300/0 conn(0x7fcdcc1444a0 0x7fcdcc13a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:41.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.099+0000 7fcdc9ffb700 1 -- 172.21.15.103:0/445702488 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1850370881 0 0) 0x7fcdbc001f40 con 0x7fcdcc0b8fc0 2020-04-22T14:02:41.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.099+0000 7fcdcbfff700 1 --2- 172.21.15.103:0/445702488 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcdcc144040 0x7fcdcc13c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:41.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.099+0000 7fcdc9ffb700 1 -- 172.21.15.103:0/445702488 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdac002fe0 con 0x7fcdcc0b8fc0 2020-04-22T14:02:41.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.099+0000 7fcdd1086700 1 -- 172.21.15.103:0/445702488 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcdcc144040 msgr2=0x7fcdcc13c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:41.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.099+0000 7fcdd1086700 1 --2- 172.21.15.103:0/445702488 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcdcc144040 0x7fcdcc13c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:41.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.099+0000 7fcdd1086700 1 -- 172.21.15.103:0/445702488 >> v1:172.21.15.103:6789/0 conn(0x7fcdcc0b8fc0 legacy=0x7fcdcc157200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:41.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.099+0000 7fcdd1086700 1 -- 172.21.15.103:0/445702488 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdcc157cd0 con 0x7fcdcc1444a0 2020-04-22T14:02:41.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.100+0000 7fcdcbfff700 1 --2- 172.21.15.103:0/445702488 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcdcc144040 0x7fcdcc13c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:02:41.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.100+0000 7fcdd1086700 1 --2- 172.21.15.103:0/445702488 >> v2:172.21.15.103:3300/0 conn(0x7fcdcc1444a0 0x7fcdcc13a0d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcdc40032b0 tx=0x7fcdc4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.100+0000 7fcdd1086700 1 --2- 172.21.15.103:0/445702488 >> v2:172.21.15.103:3300/0 conn(0x7fcdcc1444a0 0x7fcdcc13a0d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcdc40032b0 tx=0x7fcdc4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.100+0000 7fcdd1086700 1 --2- 172.21.15.103:0/445702488 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcdcc1444a0 0x7fcdcc13a0d0 secure :-1 s=READY pgs=182 cs=0 l=1 rx=0x7fcdc40032b0 tx=0x7fcdc4007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:41.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.100+0000 7fcdd1086700 1 --2- 172.21.15.103:0/445702488 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcdcc1444a0 0x7fcdcc13a0d0 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7fcdc40032b0 tx=0x7fcdc4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.100+0000 7fcdc9ffb700 1 -- 172.21.15.103:0/445702488 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdc400aea0 con 0x7fcdcc1444a0 2020-04-22T14:02:41.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.100+0000 7fcdd1086700 1 --2- 172.21.15.103:0/445702488 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcdcc1444a0 0x7fcdcc13a0d0 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7fcdc40032b0 tx=0x7fcdc4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.100+0000 7fcdd1086700 1 --2- 172.21.15.103:0/445702488 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcdcc1444a0 0x7fcdcc13a0d0 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7fcdc40032b0 tx=0x7fcdc4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.100+0000 7fcdc9ffb700 1 -- 172.21.15.103:0/445702488 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc400a7a0 con 0x7fcdcc1444a0 2020-04-22T14:02:41.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.100+0000 7fcdd1887700 1 -- 172.21.15.103:0/445702488 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdcc0b0270 con 0x7fcdcc1444a0 2020-04-22T14:02:41.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.100+0000 7fcdc9ffb700 1 -- 172.21.15.103:0/445702488 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdc4005e20 con 0x7fcdcc1444a0 2020-04-22T14:02:41.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.100+0000 7fcdd1887700 1 -- 172.21.15.103:0/445702488 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdcc153f50 con 0x7fcdcc1444a0 2020-04-22T14:02:41.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.100+0000 7fcdd1086700 1 --2- 172.21.15.103:0/445702488 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcdcc1444a0 0x7fcdcc13a0d0 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7fcdc40032b0 tx=0x7fcdc4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.101+0000 7fcdd1887700 1 -- 172.21.15.103:0/445702488 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdcc158140 con 0x7fcdcc1444a0 2020-04-22T14:02:41.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.101+0000 7fcdc9ffb700 1 -- 172.21.15.103:0/445702488 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fcdc400f5b0 con 0x7fcdcc1444a0 2020-04-22T14:02:41.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.101+0000 7fcdd1086700 1 --2- 172.21.15.103:0/445702488 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcdcc1444a0 0x7fcdcc13a0d0 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7fcdc40032b0 tx=0x7fcdc4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.101+0000 7fcdc9ffb700 1 --2- 172.21.15.103:0/445702488 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcdac04dca0 0x7fcdac050160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:41.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.101+0000 7fcdc9ffb700 1 -- 172.21.15.103:0/445702488 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcdc4062360 con 0x7fcdcc1444a0 2020-04-22T14:02:41.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.101+0000 7fcdd0885700 1 --2- 172.21.15.103:0/445702488 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcdac04dca0 0x7fcdac050160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:41.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.101+0000 7fcdd0885700 1 --2- 172.21.15.103:0/445702488 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcdac04dca0 0x7fcdac050160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcdbc002f30 tx=0x7fcdbc0024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.102+0000 7fcdd0885700 1 --2- 172.21.15.103:0/445702488 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcdac04dca0 0x7fcdac050160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcdbc002f30 tx=0x7fcdbc0024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.102+0000 7fcdd0885700 1 --2- 172.21.15.103:0/445702488 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcdac04dca0 0x7fcdac050160 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7fcdbc002f30 tx=0x7fcdbc0024d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:41.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.105+0000 7fcdd1086700 1 --2- 172.21.15.103:0/445702488 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcdcc1444a0 0x7fcdcc13a0d0 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7fcdc40032b0 tx=0x7fcdc4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.105+0000 7fcdc9ffb700 1 -- 172.21.15.103:0/445702488 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fcdc403d6e0 con 0x7fcdcc1444a0 2020-04-22T14:02:41.249 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.246+0000 7fcdd1887700 1 -- 172.21.15.103:0/445702488 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcdcc056c90 con 0x7fcdcc1444a0 2020-04-22T14:02:41.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.246+0000 7fcdd1086700 1 --2- 172.21.15.103:0/445702488 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcdcc1444a0 0x7fcdcc13a0d0 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7fcdc40032b0 tx=0x7fcdc4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.246+0000 7fcdc9ffb700 1 -- 172.21.15.103:0/445702488 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7fcdc4040d00 con 0x7fcdcc1444a0 2020-04-22T14:02:41.250 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:02:41.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.247+0000 7fcdd1887700 1 -- 172.21.15.103:0/445702488 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcdac04dca0 msgr2=0x7fcdac050160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:41.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.247+0000 7fcdd1887700 1 --2- 172.21.15.103:0/445702488 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcdac04dca0 0x7fcdac050160 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7fcdbc002f30 tx=0x7fcdbc0024d0).stop 2020-04-22T14:02:41.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.247+0000 7fcdd1887700 1 -- 172.21.15.103:0/445702488 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcdcc1444a0 msgr2=0x7fcdcc13a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:41.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.247+0000 7fcdd1887700 1 --2- 172.21.15.103:0/445702488 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcdcc1444a0 0x7fcdcc13a0d0 secure :-1 s=READY pgs=182 cs=0 l=1 rx=0x7fcdc40032b0 tx=0x7fcdc4007dc0).stop 2020-04-22T14:02:41.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.247+0000 7fcdd1887700 1 -- 172.21.15.103:0/445702488 shutdown_connections 2020-04-22T14:02:41.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.247+0000 7fcdd1887700 1 --2- 172.21.15.103:0/445702488 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcdac04dca0 0x7fcdac050160 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:41.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.247+0000 7fcdd1887700 1 --2- 172.21.15.103:0/445702488 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcdcc1444a0 0x7fcdcc13a0d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:41.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.247+0000 7fcdd1887700 1 --2- 172.21.15.103:0/445702488 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcdcc144040 0x7fcdcc13c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:41.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.247+0000 7fcdd1887700 1 -- 172.21.15.103:0/445702488 >> 172.21.15.103:0/445702488 conn(0x7fcdcc05b780 msgr2=0x7fcdcc0b3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:41.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.247+0000 7fcdd1887700 1 -- 172.21.15.103:0/445702488 shutdown_connections 2020-04-22T14:02:41.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.247+0000 7fcdd1887700 1 -- 172.21.15.103:0/445702488 wait complete. 2020-04-22T14:02:41.263 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:41.281 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-22T14:02:41.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.428+0000 7f592c440700 1 Processor -- start 2020-04-22T14:02:41.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.428+0000 7f592c440700 1 -- start start 2020-04-22T14:02:41.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.429+0000 7f592c440700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f59240b9890 0x7f5924146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:41.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.429+0000 7f592c440700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59240b6eb0 con 0x7f59241434b0 2020-04-22T14:02:41.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.429+0000 7f592c440700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f592414a810 con 0x7f5924143910 2020-04-22T14:02:41.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.429+0000 7f592c440700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f592405fbc0 con 0x7f59240b9890 2020-04-22T14:02:41.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.429+0000 7f592a1dc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f59240b9890 0x7f5924146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:41.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.429+0000 7f592a9dd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f5924143910 0x7f592414a100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39732/0 (socket says 172.21.15.103:39732) 2020-04-22T14:02:41.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.429+0000 7f592a9dd700 1 -- 172.21.15.103:0/2235407378 learned_addr learned my addr 172.21.15.103:0/2235407378 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:41.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.429+0000 7f592a1dc700 1 -- 172.21.15.103:0/2235407378 >> v1:172.21.15.103:6789/0 conn(0x7f5924143910 legacy=0x7f592414a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:41.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.429+0000 7f592a1dc700 1 -- 172.21.15.103:0/2235407378 >> v1:172.21.15.86:6789/0 conn(0x7f59241434b0 legacy=0x7f59241499f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:41.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.429+0000 7f592a1dc700 1 -- 172.21.15.103:0/2235407378 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592405fe60 con 0x7f59240b9890 2020-04-22T14:02:41.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.429+0000 7f592a1dc700 1 --2- 172.21.15.103:0/2235407378 >> v2:172.21.15.103:3300/0 conn(0x7f59240b9890 0x7f5924146fc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f592405ee00 tx=0x7f591c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.429+0000 7f592a1dc700 1 --2- 172.21.15.103:0/2235407378 >> v2:172.21.15.103:3300/0 conn(0x7f59240b9890 0x7f5924146fc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f592405ee00 tx=0x7f591c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.429+0000 7f592a1dc700 1 --2- 172.21.15.103:0/2235407378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59240b9890 0x7f5924146fc0 secure :-1 s=READY pgs=184 cs=0 l=1 rx=0x7f592405ee00 tx=0x7f591c007dc0).ready entity=mon.1 client_cookie=f7924bcc6d175eb2 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:41.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.429+0000 7f592a1dc700 1 --2- 172.21.15.103:0/2235407378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59240b9890 0x7f5924146fc0 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f592405ee00 tx=0x7f591c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.429+0000 7f59291da700 1 -- 172.21.15.103:0/2235407378 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f591c011e90 con 0x7f59240b9890 2020-04-22T14:02:41.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.429+0000 7f592a1dc700 1 --2- 172.21.15.103:0/2235407378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59240b9890 0x7f5924146fc0 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f592405ee00 tx=0x7f591c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.429+0000 7f59291da700 1 -- 172.21.15.103:0/2235407378 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591c00a180 con 0x7f59240b9890 2020-04-22T14:02:41.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.429+0000 7f592a1dc700 1 --2- 172.21.15.103:0/2235407378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59240b9890 0x7f5924146fc0 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f592405ee00 tx=0x7f591c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.429+0000 7f592c440700 1 -- 172.21.15.103:0/2235407378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59240b9890 msgr2=0x7f5924146fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:41.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.429+0000 7f59291da700 1 -- 172.21.15.103:0/2235407378 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f591c00a5a0 con 0x7f59240b9890 2020-04-22T14:02:41.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.429+0000 7f592c440700 1 --2- 172.21.15.103:0/2235407378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59240b9890 0x7f5924146fc0 secure :-1 s=READY pgs=184 cs=0 l=1 rx=0x7f592405ee00 tx=0x7f591c007dc0).stop 2020-04-22T14:02:41.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.430+0000 7f592c440700 1 -- 172.21.15.103:0/2235407378 shutdown_connections 2020-04-22T14:02:41.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.430+0000 7f592c440700 1 --2- 172.21.15.103:0/2235407378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59240b9890 0x7f5924146fc0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:41.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.430+0000 7f592c440700 1 -- 172.21.15.103:0/2235407378 >> 172.21.15.103:0/2235407378 conn(0x7f592405ad30 msgr2=0x7f592405b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:41.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.430+0000 7f592c440700 1 -- 172.21.15.103:0/2235407378 shutdown_connections 2020-04-22T14:02:41.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.430+0000 7f592c440700 1 -- 172.21.15.103:0/2235407378 wait complete. 2020-04-22T14:02:41.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.431+0000 7f592c440700 1 Processor -- start 2020-04-22T14:02:41.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.431+0000 7f592c440700 1 -- start start 2020-04-22T14:02:41.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.432+0000 7f592c440700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f59240b9890 0x7f59241491b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:41.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.432+0000 7f592c440700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f59241434b0 0x7f5924157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:41.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.432+0000 7f592c440700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5924143910 0x7f592412cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:41.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.432+0000 7f592c440700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59240ad9a0 con 0x7f59241434b0 2020-04-22T14:02:41.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.432+0000 7f592c440700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f592412ec10 con 0x7f59240b9890 2020-04-22T14:02:41.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.432+0000 7f592c440700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59240adb90 con 0x7f5924143910 2020-04-22T14:02:41.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.432+0000 7f592a1dc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f59240b9890 0x7f59241491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:41.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.432+0000 7f592a1dc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f59240b9890 0x7f59241491b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47544/0 (socket says 172.21.15.103:47544) 2020-04-22T14:02:41.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.432+0000 7f592a1dc700 1 -- 172.21.15.103:0/1196604741 learned_addr learned my addr 172.21.15.103:0/1196604741 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:41.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.432+0000 7f592a9dd700 1 --2- 172.21.15.103:0/1196604741 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5924143910 0x7f592412cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:41.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.432+0000 7f59299db700 1 --2- 172.21.15.103:0/1196604741 >> v2:172.21.15.86:3300/0 conn(0x7f59241434b0 0x7f5924157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:41.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.432+0000 7f592a1dc700 1 -- 172.21.15.103:0/1196604741 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5924143910 msgr2=0x7f592412cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:41.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.432+0000 7f592a1dc700 1 --2- 172.21.15.103:0/1196604741 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5924143910 0x7f592412cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:41.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.432+0000 7f592a1dc700 1 -- 172.21.15.103:0/1196604741 >> v2:172.21.15.86:3300/0 conn(0x7f59241434b0 msgr2=0x7f5924157ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:41.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.432+0000 7f592a1dc700 1 --2- 172.21.15.103:0/1196604741 >> v2:172.21.15.86:3300/0 conn(0x7f59241434b0 0x7f5924157ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:41.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.432+0000 7f592a1dc700 1 -- 172.21.15.103:0/1196604741 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59240ade30 con 0x7f59240b9890 2020-04-22T14:02:41.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.432+0000 7f592a1dc700 1 --2- 172.21.15.103:0/1196604741 >> v2:172.21.15.103:3300/0 conn(0x7f59240b9890 0x7f59241491b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f592405ee00 tx=0x7f591c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.432+0000 7f592a1dc700 1 --2- 172.21.15.103:0/1196604741 >> v2:172.21.15.103:3300/0 conn(0x7f59240b9890 0x7f59241491b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f592405ee00 tx=0x7f591c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.432+0000 7f592a1dc700 1 --2- 172.21.15.103:0/1196604741 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59240b9890 0x7f59241491b0 secure :-1 s=READY pgs=185 cs=0 l=1 rx=0x7f592405ee00 tx=0x7f591c007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:41.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.432+0000 7f592a1dc700 1 --2- 172.21.15.103:0/1196604741 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59240b9890 0x7f59241491b0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f592405ee00 tx=0x7f591c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.432+0000 7f59177fe700 1 -- 172.21.15.103:0/1196604741 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f591c005c30 con 0x7f59240b9890 2020-04-22T14:02:41.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.432+0000 7f592a1dc700 1 --2- 172.21.15.103:0/1196604741 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59240b9890 0x7f59241491b0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f592405ee00 tx=0x7f591c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.432+0000 7f592a1dc700 1 --2- 172.21.15.103:0/1196604741 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59240b9890 0x7f59241491b0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f592405ee00 tx=0x7f591c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.432+0000 7f59177fe700 1 -- 172.21.15.103:0/1196604741 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591c005d90 con 0x7f59240b9890 2020-04-22T14:02:41.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.432+0000 7f592c440700 1 -- 172.21.15.103:0/1196604741 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f592412f640 con 0x7f59240b9890 2020-04-22T14:02:41.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.432+0000 7f59177fe700 1 -- 172.21.15.103:0/1196604741 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f591c00f7a0 con 0x7f59240b9890 2020-04-22T14:02:41.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.432+0000 7f592c440700 1 -- 172.21.15.103:0/1196604741 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59241451a0 con 0x7f59240b9890 2020-04-22T14:02:41.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.433+0000 7f592a1dc700 1 --2- 172.21.15.103:0/1196604741 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59240b9890 0x7f59241491b0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f592405ee00 tx=0x7f591c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.433+0000 7f59177fe700 1 -- 172.21.15.103:0/1196604741 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f591c00fa20 con 0x7f59240b9890 2020-04-22T14:02:41.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.433+0000 7f592a1dc700 1 --2- 172.21.15.103:0/1196604741 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59240b9890 0x7f59241491b0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f592405ee00 tx=0x7f591c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.433+0000 7f592c440700 1 -- 172.21.15.103:0/1196604741 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5924056c90 con 0x7f59240b9890 2020-04-22T14:02:41.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.434+0000 7f59177fe700 1 --2- 172.21.15.103:0/1196604741 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f590404da70 0x7f590404ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:41.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.434+0000 7f59177fe700 1 -- 172.21.15.103:0/1196604741 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f591c062700 con 0x7f59240b9890 2020-04-22T14:02:41.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.434+0000 7f59299db700 1 --2- 172.21.15.103:0/1196604741 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f590404da70 0x7f590404ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:41.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.434+0000 7f59299db700 1 --2- 172.21.15.103:0/1196604741 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f590404da70 0x7f590404ff30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5918002f40 tx=0x7f5918007da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.434+0000 7f59299db700 1 --2- 172.21.15.103:0/1196604741 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f590404da70 0x7f590404ff30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5918002f40 tx=0x7f5918007da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.434+0000 7f59299db700 1 --2- 172.21.15.103:0/1196604741 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f590404da70 0x7f590404ff30 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7f5918002f40 tx=0x7f5918007da0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:41.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.438+0000 7f592a1dc700 1 --2- 172.21.15.103:0/1196604741 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59240b9890 0x7f59241491b0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f592405ee00 tx=0x7f591c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.438+0000 7f59177fe700 1 -- 172.21.15.103:0/1196604741 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f591c03dc00 con 0x7f59240b9890 2020-04-22T14:02:41.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.581+0000 7f592c440700 1 -- 172.21.15.103:0/1196604741 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f59240b39e0 con 0x7f59240b9890 2020-04-22T14:02:41.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.582+0000 7f592a1dc700 1 --2- 172.21.15.103:0/1196604741 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59240b9890 0x7f59241491b0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f592405ee00 tx=0x7f591c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.582+0000 7f59177fe700 1 -- 172.21.15.103:0/1196604741 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7f591c041220 con 0x7f59240b9890 2020-04-22T14:02:41.586 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:02:41.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.583+0000 7f592c440700 1 -- 172.21.15.103:0/1196604741 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f590404da70 msgr2=0x7f590404ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:41.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.583+0000 7f592c440700 1 --2- 172.21.15.103:0/1196604741 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f590404da70 0x7f590404ff30 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7f5918002f40 tx=0x7f5918007da0).stop 2020-04-22T14:02:41.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.583+0000 7f592c440700 1 -- 172.21.15.103:0/1196604741 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59240b9890 msgr2=0x7f59241491b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:41.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.583+0000 7f592c440700 1 --2- 172.21.15.103:0/1196604741 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59240b9890 0x7f59241491b0 secure :-1 s=READY pgs=185 cs=0 l=1 rx=0x7f592405ee00 tx=0x7f591c007dc0).stop 2020-04-22T14:02:41.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.583+0000 7f592c440700 1 -- 172.21.15.103:0/1196604741 shutdown_connections 2020-04-22T14:02:41.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.583+0000 7f592c440700 1 --2- 172.21.15.103:0/1196604741 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5924143910 0x7f592412cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:41.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.583+0000 7f592c440700 1 --2- 172.21.15.103:0/1196604741 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59240b9890 0x7f59241491b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:41.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.583+0000 7f592c440700 1 --2- 172.21.15.103:0/1196604741 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f590404da70 0x7f590404ff30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:41.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.583+0000 7f592c440700 1 --2- 172.21.15.103:0/1196604741 >> v2:172.21.15.86:3300/0 conn(0x7f59241434b0 0x7f5924157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:41.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.583+0000 7f592c440700 1 -- 172.21.15.103:0/1196604741 >> 172.21.15.103:0/1196604741 conn(0x7f592405ad30 msgr2=0x7f592405b240 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:41.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.583+0000 7f592c440700 1 -- 172.21.15.103:0/1196604741 shutdown_connections 2020-04-22T14:02:41.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.583+0000 7f592c440700 1 -- 172.21.15.103:0/1196604741 wait complete. 2020-04-22T14:02:41.604 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:41.618 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:02:41.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.762+0000 7f25f6fcc700 1 Processor -- start 2020-04-22T14:02:41.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.762+0000 7f25f6fcc700 1 -- start start 2020-04-22T14:02:41.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.762+0000 7f25f6fcc700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25f01464e0 0x7f25f0064540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:41.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.762+0000 7f25f6fcc700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25f0143300 con 0x7f25f012c0d0 2020-04-22T14:02:41.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.762+0000 7f25f6fcc700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25f01435a0 con 0x7f25f0065fe0 2020-04-22T14:02:41.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.762+0000 7f25f6fcc700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f0143840 con 0x7f25f01464e0 2020-04-22T14:02:41.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.762+0000 7f25effff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f25f0065fe0 0x7f25f0063e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39746/0 (socket says 172.21.15.103:39746) 2020-04-22T14:02:41.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.763+0000 7f25effff700 1 -- 172.21.15.103:0/3923014907 learned_addr learned my addr 172.21.15.103:0/3923014907 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:41.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.763+0000 7f25f5569700 1 --2- 172.21.15.103:0/3923014907 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25f01464e0 0x7f25f0064540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:41.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.763+0000 7f25ef7fe700 1 -- 172.21.15.103:0/3923014907 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1412321389 0 0) 0x7f25f01435a0 con 0x7f25f0065fe0 2020-04-22T14:02:41.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.763+0000 7f25ef7fe700 1 -- 172.21.15.103:0/3923014907 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25dc003230 con 0x7f25f0065fe0 2020-04-22T14:02:41.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.763+0000 7f25ef7fe700 1 -- 172.21.15.103:0/3923014907 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1902340194 0 0) 0x7f25f0143300 con 0x7f25f012c0d0 2020-04-22T14:02:41.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.763+0000 7f25ef7fe700 1 -- 172.21.15.103:0/3923014907 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25f01435a0 con 0x7f25f012c0d0 2020-04-22T14:02:41.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.763+0000 7f25f5569700 1 -- 172.21.15.103:0/3923014907 >> v1:172.21.15.103:6789/0 conn(0x7f25f0065fe0 legacy=0x7f25f0063e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:41.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.763+0000 7f25f5569700 1 -- 172.21.15.103:0/3923014907 >> v1:172.21.15.86:6789/0 conn(0x7f25f012c0d0 legacy=0x7f25f005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:41.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.763+0000 7f25f5569700 1 -- 172.21.15.103:0/3923014907 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f005bb50 con 0x7f25f01464e0 2020-04-22T14:02:41.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.763+0000 7f25f5569700 1 --2- 172.21.15.103:0/3923014907 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25f01464e0 0x7f25f0064540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f25f0067620 tx=0x7f25e8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.763+0000 7f25f5569700 1 --2- 172.21.15.103:0/3923014907 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25f01464e0 0x7f25f0064540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f25f0067620 tx=0x7f25e8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.763+0000 7f25f5569700 1 --2- 172.21.15.103:0/3923014907 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25f01464e0 0x7f25f0064540 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7f25f0067620 tx=0x7f25e8008c60).ready entity=mon.2 client_cookie=ac0458aa72a39e6c server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:41.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.763+0000 7f25f5569700 1 --2- 172.21.15.103:0/3923014907 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25f01464e0 0x7f25f0064540 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f25f0067620 tx=0x7f25e8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.763+0000 7f25ef7fe700 1 -- 172.21.15.103:0/3923014907 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25e8011d70 con 0x7f25f01464e0 2020-04-22T14:02:41.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.763+0000 7f25f5569700 1 --2- 172.21.15.103:0/3923014907 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25f01464e0 0x7f25f0064540 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f25f0067620 tx=0x7f25e8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.763+0000 7f25ef7fe700 1 -- 172.21.15.103:0/3923014907 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e800a180 con 0x7f25f01464e0 2020-04-22T14:02:41.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.763+0000 7f25f5569700 1 --2- 172.21.15.103:0/3923014907 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25f01464e0 0x7f25f0064540 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f25f0067620 tx=0x7f25e8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.763+0000 7f25f6fcc700 1 -- 172.21.15.103:0/3923014907 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25f01464e0 msgr2=0x7f25f0064540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:41.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.763+0000 7f25ef7fe700 1 -- 172.21.15.103:0/3923014907 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25e800a520 con 0x7f25f01464e0 2020-04-22T14:02:41.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.763+0000 7f25f6fcc700 1 --2- 172.21.15.103:0/3923014907 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25f01464e0 0x7f25f0064540 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7f25f0067620 tx=0x7f25e8008c60).stop 2020-04-22T14:02:41.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.764+0000 7f25f6fcc700 1 -- 172.21.15.103:0/3923014907 shutdown_connections 2020-04-22T14:02:41.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.764+0000 7f25f6fcc700 1 --2- 172.21.15.103:0/3923014907 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25f01464e0 0x7f25f0064540 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:41.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.764+0000 7f25f6fcc700 1 -- 172.21.15.103:0/3923014907 >> 172.21.15.103:0/3923014907 conn(0x7f25f00b9160 msgr2=0x7f25f005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:41.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.764+0000 7f25f6fcc700 1 -- 172.21.15.103:0/3923014907 shutdown_connections 2020-04-22T14:02:41.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.764+0000 7f25f6fcc700 1 -- 172.21.15.103:0/3923014907 wait complete. 2020-04-22T14:02:41.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.765+0000 7f25f6fcc700 1 Processor -- start 2020-04-22T14:02:41.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.765+0000 7f25f6fcc700 1 -- start start 2020-04-22T14:02:41.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.766+0000 7f25f6fcc700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25f0065fe0 0x7f25f00b7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:41.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.766+0000 7f25f6fcc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f25f012c0d0 0x7f25f0141cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:41.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.766+0000 7f25f6fcc700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25f00b8040 con 0x7f25f01464e0 2020-04-22T14:02:41.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.766+0000 7f25f6fcc700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25f014d650 con 0x7f25f012c0d0 2020-04-22T14:02:41.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.766+0000 7f25f6fcc700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f014d8f0 con 0x7f25f0065fe0 2020-04-22T14:02:41.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.766+0000 7f25effff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f25f012c0d0 0x7f25f0141cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:41.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.766+0000 7f25effff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f25f012c0d0 0x7f25f0141cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47560/0 (socket says 172.21.15.103:47560) 2020-04-22T14:02:41.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.766+0000 7f25effff700 1 -- 172.21.15.103:0/1481695338 learned_addr learned my addr 172.21.15.103:0/1481695338 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:41.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.766+0000 7f25f4d68700 1 --2- 172.21.15.103:0/1481695338 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25f0065fe0 0x7f25f00b7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:41.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.766+0000 7f25effff700 1 -- 172.21.15.103:0/1481695338 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25f0065fe0 msgr2=0x7f25f00b7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:41.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.766+0000 7f25effff700 1 --2- 172.21.15.103:0/1481695338 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25f0065fe0 0x7f25f00b7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:41.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.766+0000 7f25effff700 1 -- 172.21.15.103:0/1481695338 >> v1:172.21.15.86:6789/0 conn(0x7f25f01464e0 legacy=0x7f25f0148330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:41.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.766+0000 7f25effff700 1 -- 172.21.15.103:0/1481695338 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f0142150 con 0x7f25f012c0d0 2020-04-22T14:02:41.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.766+0000 7f25effff700 1 --2- 172.21.15.103:0/1481695338 >> v2:172.21.15.103:3300/0 conn(0x7f25f012c0d0 0x7f25f0141cf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f25e40010d0 tx=0x7f25e4001e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.766+0000 7f25effff700 1 --2- 172.21.15.103:0/1481695338 >> v2:172.21.15.103:3300/0 conn(0x7f25f012c0d0 0x7f25f0141cf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f25e40010d0 tx=0x7f25e4001e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.766+0000 7f25effff700 1 --2- 172.21.15.103:0/1481695338 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25f012c0d0 0x7f25f0141cf0 secure :-1 s=READY pgs=187 cs=0 l=1 rx=0x7f25e40010d0 tx=0x7f25e4001e60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:41.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.766+0000 7f25effff700 1 --2- 172.21.15.103:0/1481695338 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25f012c0d0 0x7f25f0141cf0 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7f25e40010d0 tx=0x7f25e4001e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.766+0000 7f25edffb700 1 -- 172.21.15.103:0/1481695338 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25e400cd10 con 0x7f25f012c0d0 2020-04-22T14:02:41.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.766+0000 7f25effff700 1 --2- 172.21.15.103:0/1481695338 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25f012c0d0 0x7f25f0141cf0 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7f25e40010d0 tx=0x7f25e4001e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.766+0000 7f25edffb700 1 -- 172.21.15.103:0/1481695338 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e400ce70 con 0x7f25f012c0d0 2020-04-22T14:02:41.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.766+0000 7f25effff700 1 --2- 172.21.15.103:0/1481695338 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25f012c0d0 0x7f25f0141cf0 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7f25e40010d0 tx=0x7f25e4001e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.766+0000 7f25f6fcc700 1 -- 172.21.15.103:0/1481695338 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25f0142590 con 0x7f25f012c0d0 2020-04-22T14:02:41.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.766+0000 7f25edffb700 1 -- 172.21.15.103:0/1481695338 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25e400e370 con 0x7f25f012c0d0 2020-04-22T14:02:41.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.767+0000 7f25f6fcc700 1 -- 172.21.15.103:0/1481695338 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25f012a820 con 0x7f25f012c0d0 2020-04-22T14:02:41.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.767+0000 7f25effff700 1 --2- 172.21.15.103:0/1481695338 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25f012c0d0 0x7f25f0141cf0 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7f25e40010d0 tx=0x7f25e4001e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.767+0000 7f25f6fcc700 1 -- 172.21.15.103:0/1481695338 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25f0056c90 con 0x7f25f012c0d0 2020-04-22T14:02:41.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.767+0000 7f25edffb700 1 -- 172.21.15.103:0/1481695338 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f25e4010350 con 0x7f25f012c0d0 2020-04-22T14:02:41.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.768+0000 7f25effff700 1 --2- 172.21.15.103:0/1481695338 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25f012c0d0 0x7f25f0141cf0 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7f25e40010d0 tx=0x7f25e4001e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.768+0000 7f25edffb700 1 --2- 172.21.15.103:0/1481695338 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f25d004d930 0x7f25d004fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:41.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.768+0000 7f25edffb700 1 -- 172.21.15.103:0/1481695338 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f25e40610e0 con 0x7f25f012c0d0 2020-04-22T14:02:41.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.768+0000 7f25f4d68700 1 --2- 172.21.15.103:0/1481695338 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f25d004d930 0x7f25d004fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:41.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.768+0000 7f25f4d68700 1 --2- 172.21.15.103:0/1481695338 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f25d004d930 0x7f25d004fdf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f25e00010d0 tx=0x7f25e0001070).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.768+0000 7f25f4d68700 1 --2- 172.21.15.103:0/1481695338 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f25d004d930 0x7f25d004fdf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f25e00010d0 tx=0x7f25e0001070).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.768+0000 7f25f4d68700 1 --2- 172.21.15.103:0/1481695338 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f25d004d930 0x7f25d004fdf0 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7f25e00010d0 tx=0x7f25e0001070).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:41.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.772+0000 7f25effff700 1 --2- 172.21.15.103:0/1481695338 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25f012c0d0 0x7f25f0141cf0 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7f25e40010d0 tx=0x7f25e4001e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.772+0000 7f25edffb700 1 -- 172.21.15.103:0/1481695338 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f25e403c580 con 0x7f25f012c0d0 2020-04-22T14:02:41.965 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.962+0000 7f25f6fcc700 1 -- 172.21.15.103:0/1481695338 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25f0147360 con 0x7f25f012c0d0 2020-04-22T14:02:41.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.963+0000 7f25effff700 1 --2- 172.21.15.103:0/1481695338 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25f012c0d0 0x7f25f0141cf0 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7f25e40010d0 tx=0x7f25e4001e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:41.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.963+0000 7f25edffb700 1 -- 172.21.15.103:0/1481695338 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2137 (secure 0 0 0) 0x7f25e403fba0 con 0x7f25f012c0d0 2020-04-22T14:02:41.967 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:02:41.967 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/3739398122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3739398122},{"type":"v1","addr":"172.21.15.86:6835","nonce":3739398122}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":6}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:02:27.685979+0000","modified":"2020-04-22T14:02:32.276953+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4357},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4357":{"gid":4357,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.103:6833/1765986263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1765986263},{"type":"v1","addr":"172.21.15.103:6833","nonce":1765986263}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-22T14:02:41.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.964+0000 7f25f6fcc700 1 -- 172.21.15.103:0/1481695338 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f25d004d930 msgr2=0x7f25d004fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:41.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.964+0000 7f25f6fcc700 1 --2- 172.21.15.103:0/1481695338 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f25d004d930 0x7f25d004fdf0 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7f25e00010d0 tx=0x7f25e0001070).stop 2020-04-22T14:02:41.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.964+0000 7f25f6fcc700 1 -- 172.21.15.103:0/1481695338 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25f012c0d0 msgr2=0x7f25f0141cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:41.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.964+0000 7f25f6fcc700 1 --2- 172.21.15.103:0/1481695338 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25f012c0d0 0x7f25f0141cf0 secure :-1 s=READY pgs=187 cs=0 l=1 rx=0x7f25e40010d0 tx=0x7f25e4001e60).stop 2020-04-22T14:02:41.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.964+0000 7f25f6fcc700 1 -- 172.21.15.103:0/1481695338 shutdown_connections 2020-04-22T14:02:41.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.964+0000 7f25f6fcc700 1 --2- 172.21.15.103:0/1481695338 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f25d004d930 0x7f25d004fdf0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:41.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.964+0000 7f25f6fcc700 1 --2- 172.21.15.103:0/1481695338 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25f0065fe0 0x7f25f00b7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:41.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.964+0000 7f25f6fcc700 1 --2- 172.21.15.103:0/1481695338 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25f012c0d0 0x7f25f0141cf0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:41.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.964+0000 7f25f6fcc700 1 -- 172.21.15.103:0/1481695338 >> 172.21.15.103:0/1481695338 conn(0x7f25f00b9160 msgr2=0x7f25f00615e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:41.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.964+0000 7f25f6fcc700 1 -- 172.21.15.103:0/1481695338 shutdown_connections 2020-04-22T14:02:41.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:41.964+0000 7f25f6fcc700 1 -- 172.21.15.103:0/1481695338 wait complete. 2020-04-22T14:02:41.969 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 6 2020-04-22T14:02:42.189 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4357}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 3, u'failed': [], u'epoch': 5, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [4], u'info': {u'gid_4357': {u'export_targets': [], u'name': u'a', u'incarnation': 4, u'state_seq': 2, u'state': u'up:active', u'gid': 4357, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 1765986263, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 1765986263, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/1765986263'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:02:27.685979+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:02:32.276953+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:02:42.190 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:02:42.190 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:42.204 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:02:42.365 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:02:42.366 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:02:42.366 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:02:42.366 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4357, 2020-04-22T14:02:42.366 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:02:42.366 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:02:42.366 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 11.091510324, 2020-04-22T14:02:42.366 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 5, 2020-04-22T14:02:42.367 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 24, 2020-04-22T14:02:42.367 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 24, 2020-04-22T14:02:42.367 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 11.797955034999999 2020-04-22T14:02:42.367 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:02:42.374 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 4357, "want_state": "up:active", "state": "up:active", "rank_uptime": 11.091510324, "mdsmap_epoch": 5, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "uptime": 11.797955034999999 } 2020-04-22T14:02:42.374 INFO:teuthology.run_tasks:Running task ceph-fuse... 2020-04-22T14:02:42.412 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2020-04-22T14:02:42.412 INFO:tasks.ceph_fuse:config is None 2020-04-22T14:02:42.412 INFO:tasks.ceph_fuse:new config is {'client.3': None, 'client.2': None, 'client.1': None, 'client.0': None} 2020-04-22T14:02:42.413 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:42.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:42.430 INFO:teuthology.orchestra.run.smithi086:> bash -c 'cat /etc/os-release' 2020-04-22T14:02:42.489 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="Red Hat Enterprise Linux" 2020-04-22T14:02:42.489 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="8.1 (Ootpa)" 2020-04-22T14:02:42.489 INFO:teuthology.orchestra.run.smithi086.stdout:ID="rhel" 2020-04-22T14:02:42.489 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="fedora" 2020-04-22T14:02:42.490 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="8.1" 2020-04-22T14:02:42.490 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el8" 2020-04-22T14:02:42.490 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.1 (Ootpa)" 2020-04-22T14:02:42.490 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2020-04-22T14:02:42.490 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.1:GA" 2020-04-22T14:02:42.490 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://www.redhat.com/" 2020-04-22T14:02:42.491 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-04-22T14:02:42.491 INFO:teuthology.orchestra.run.smithi086.stdout: 2020-04-22T14:02:42.491 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-04-22T14:02:42.491 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.1 2020-04-22T14:02:42.491 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-04-22T14:02:42.492 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.1" 2020-04-22T14:02:42.492 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:42.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:42.546 INFO:teuthology.orchestra.run.smithi086:> bash -c 'cat /etc/os-release' 2020-04-22T14:02:42.605 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="Red Hat Enterprise Linux" 2020-04-22T14:02:42.605 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="8.1 (Ootpa)" 2020-04-22T14:02:42.605 INFO:teuthology.orchestra.run.smithi086.stdout:ID="rhel" 2020-04-22T14:02:42.605 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="fedora" 2020-04-22T14:02:42.605 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="8.1" 2020-04-22T14:02:42.606 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el8" 2020-04-22T14:02:42.606 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.1 (Ootpa)" 2020-04-22T14:02:42.606 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2020-04-22T14:02:42.606 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.1:GA" 2020-04-22T14:02:42.606 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://www.redhat.com/" 2020-04-22T14:02:42.606 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-04-22T14:02:42.606 INFO:teuthology.orchestra.run.smithi086.stdout: 2020-04-22T14:02:42.606 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-04-22T14:02:42.607 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.1 2020-04-22T14:02:42.607 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-04-22T14:02:42.607 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.1" 2020-04-22T14:02:42.607 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:42.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:42.621 INFO:teuthology.orchestra.run.smithi103:> bash -c 'cat /etc/os-release' 2020-04-22T14:02:42.681 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="Red Hat Enterprise Linux" 2020-04-22T14:02:42.681 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="8.1 (Ootpa)" 2020-04-22T14:02:42.681 INFO:teuthology.orchestra.run.smithi103.stdout:ID="rhel" 2020-04-22T14:02:42.681 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="fedora" 2020-04-22T14:02:42.681 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="8.1" 2020-04-22T14:02:42.681 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el8" 2020-04-22T14:02:42.682 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.1 (Ootpa)" 2020-04-22T14:02:42.682 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2020-04-22T14:02:42.682 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.1:GA" 2020-04-22T14:02:42.682 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://www.redhat.com/" 2020-04-22T14:02:42.682 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-04-22T14:02:42.682 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:02:42.682 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-04-22T14:02:42.683 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.1 2020-04-22T14:02:42.683 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-04-22T14:02:42.684 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.1" 2020-04-22T14:02:42.684 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:42.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:42.731 INFO:teuthology.orchestra.run.smithi103:> bash -c 'cat /etc/os-release' 2020-04-22T14:02:42.792 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="Red Hat Enterprise Linux" 2020-04-22T14:02:42.793 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="8.1 (Ootpa)" 2020-04-22T14:02:42.793 INFO:teuthology.orchestra.run.smithi103.stdout:ID="rhel" 2020-04-22T14:02:42.793 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="fedora" 2020-04-22T14:02:42.793 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="8.1" 2020-04-22T14:02:42.793 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el8" 2020-04-22T14:02:42.793 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.1 (Ootpa)" 2020-04-22T14:02:42.794 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2020-04-22T14:02:42.794 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.1:GA" 2020-04-22T14:02:42.794 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://www.redhat.com/" 2020-04-22T14:02:42.794 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-04-22T14:02:42.794 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:02:42.794 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-04-22T14:02:42.794 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.1 2020-04-22T14:02:42.794 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-04-22T14:02:42.795 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.1" 2020-04-22T14:02:42.795 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2020-04-22T14:02:42.795 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:42.845 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:02:42.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.990+0000 7fe0c4f12700 1 Processor -- start 2020-04-22T14:02:42.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.990+0000 7fe0c4f12700 1 -- start start 2020-04-22T14:02:42.996 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.991+0000 7fe0c4f12700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe0c0065fe0 0x7fe0c01464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:42.997 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.991+0000 7fe0c4f12700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe0c0063e30 0x7fe0c00642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:42.997 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.991+0000 7fe0c4f12700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c0143300 con 0x7fe0c012c0d0 2020-04-22T14:02:42.997 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.991+0000 7fe0c4f12700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c01435a0 con 0x7fe0c0063e30 2020-04-22T14:02:42.997 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.991+0000 7fe0c4f12700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c0143840 con 0x7fe0c0065fe0 2020-04-22T14:02:42.997 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.991+0000 7fe0bdd9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe0c0065fe0 0x7fe0c01464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:43.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.991+0000 7fe0bdd9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe0c0065fe0 0x7fe0c01464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47566/0 (socket says 172.21.15.103:47566) 2020-04-22T14:02:43.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.991+0000 7fe0bdd9b700 1 -- 172.21.15.103:0/464022488 learned_addr learned my addr 172.21.15.103:0/464022488 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:43.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.992+0000 7fe0bed9d700 1 --2- 172.21.15.103:0/464022488 >> v2:172.21.15.86:3300/0 conn(0x7fe0c0063e30 0x7fe0c00642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:43.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.992+0000 7fe0bdd9b700 1 -- 172.21.15.103:0/464022488 >> v2:172.21.15.86:3300/0 conn(0x7fe0c0063e30 msgr2=0x7fe0c00642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:43.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.992+0000 7fe0bdd9b700 1 --2- 172.21.15.103:0/464022488 >> v2:172.21.15.86:3300/0 conn(0x7fe0c0063e30 0x7fe0c00642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:43.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.992+0000 7fe0bdd9b700 1 -- 172.21.15.103:0/464022488 >> v1:172.21.15.86:6789/0 conn(0x7fe0c012c0d0 legacy=0x7fe0c005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:43.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.992+0000 7fe0bdd9b700 1 -- 172.21.15.103:0/464022488 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c005bb50 con 0x7fe0c0065fe0 2020-04-22T14:02:43.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.992+0000 7fe0bed9d700 1 --2- 172.21.15.103:0/464022488 >> v2:172.21.15.86:3300/0 conn(0x7fe0c0063e30 0x7fe0c00642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:02:43.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.992+0000 7fe0bdd9b700 1 --2- 172.21.15.103:0/464022488 >> v2:172.21.15.103:3300/0 conn(0x7fe0c0065fe0 0x7fe0c01464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe0c00669a0 tx=0x7fe0b0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.992+0000 7fe0bdd9b700 1 --2- 172.21.15.103:0/464022488 >> v2:172.21.15.103:3300/0 conn(0x7fe0c0065fe0 0x7fe0c01464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe0c00669a0 tx=0x7fe0b0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.992+0000 7fe0bdd9b700 1 --2- 172.21.15.103:0/464022488 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0c0065fe0 0x7fe0c01464e0 secure :-1 s=READY pgs=188 cs=0 l=1 rx=0x7fe0c00669a0 tx=0x7fe0b0007a40).ready entity=mon.1 client_cookie=a69fd413f3bc41e3 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:43.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.992+0000 7fe0bdd9b700 1 --2- 172.21.15.103:0/464022488 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0c0065fe0 0x7fe0c01464e0 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7fe0c00669a0 tx=0x7fe0b0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.992+0000 7fe0bd59a700 1 -- 172.21.15.103:0/464022488 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0b00116e0 con 0x7fe0c0065fe0 2020-04-22T14:02:43.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.992+0000 7fe0bdd9b700 1 --2- 172.21.15.103:0/464022488 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0c0065fe0 0x7fe0c01464e0 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7fe0c00669a0 tx=0x7fe0b0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.992+0000 7fe0bdd9b700 1 --2- 172.21.15.103:0/464022488 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0c0065fe0 0x7fe0c01464e0 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7fe0c00669a0 tx=0x7fe0b0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.992+0000 7fe0bd59a700 1 -- 172.21.15.103:0/464022488 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b0011840 con 0x7fe0c0065fe0 2020-04-22T14:02:43.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.992+0000 7fe0bd59a700 1 -- 172.21.15.103:0/464022488 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0b0011c20 con 0x7fe0c0065fe0 2020-04-22T14:02:43.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.992+0000 7fe0c4f12700 1 -- 172.21.15.103:0/464022488 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0c0065fe0 msgr2=0x7fe0c01464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:43.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.992+0000 7fe0c4f12700 1 --2- 172.21.15.103:0/464022488 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0c0065fe0 0x7fe0c01464e0 secure :-1 s=READY pgs=188 cs=0 l=1 rx=0x7fe0c00669a0 tx=0x7fe0b0007a40).stop 2020-04-22T14:02:43.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.993+0000 7fe0c4f12700 1 -- 172.21.15.103:0/464022488 shutdown_connections 2020-04-22T14:02:43.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.993+0000 7fe0c4f12700 1 --2- 172.21.15.103:0/464022488 >> v2:172.21.15.86:3300/0 conn(0x7fe0c0063e30 0x7fe0c00642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:43.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.993+0000 7fe0c4f12700 1 --2- 172.21.15.103:0/464022488 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0c0065fe0 0x7fe0c01464e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:43.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.993+0000 7fe0c4f12700 1 -- 172.21.15.103:0/464022488 >> 172.21.15.103:0/464022488 conn(0x7fe0c00b9160 msgr2=0x7fe0c005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:43.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.993+0000 7fe0c4f12700 1 -- 172.21.15.103:0/464022488 shutdown_connections 2020-04-22T14:02:43.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.993+0000 7fe0c4f12700 1 -- 172.21.15.103:0/464022488 wait complete. 2020-04-22T14:02:43.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.994+0000 7fe0c4f12700 1 Processor -- start 2020-04-22T14:02:43.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.994+0000 7fe0c4f12700 1 -- start start 2020-04-22T14:02:43.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.994+0000 7fe0c4f12700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe0c0063e30 0x7fe0c00b4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:43.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.994+0000 7fe0c4f12700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe0c0065fe0 0x7fe0c0127540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:43.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.994+0000 7fe0c4f12700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe0c012c0d0 0x7fe0c0155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:43.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.994+0000 7fe0c4f12700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c0155ab0 con 0x7fe0c0063e30 2020-04-22T14:02:43.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.994+0000 7fe0c4f12700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c0155d50 con 0x7fe0c012c0d0 2020-04-22T14:02:43.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.994+0000 7fe0c4f12700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c0155ff0 con 0x7fe0c0065fe0 2020-04-22T14:02:43.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.994+0000 7fe0bed9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe0c012c0d0 0x7fe0c0155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:43.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.994+0000 7fe0bed9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe0c012c0d0 0x7fe0c0155480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47574/0 (socket says 172.21.15.103:47574) 2020-04-22T14:02:43.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.994+0000 7fe0bed9d700 1 -- 172.21.15.103:0/465791581 learned_addr learned my addr 172.21.15.103:0/465791581 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:43.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.994+0000 7fe0bdd9b700 1 --2- 172.21.15.103:0/465791581 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe0c0065fe0 0x7fe0c0127540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:43.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.994+0000 7fe0be59c700 1 --2- 172.21.15.103:0/465791581 >> v2:172.21.15.86:3300/0 conn(0x7fe0c0063e30 0x7fe0c00b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:43.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.995+0000 7fe0bed9d700 1 -- 172.21.15.103:0/465791581 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe0c0065fe0 msgr2=0x7fe0c0127540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:43.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.995+0000 7fe0bed9d700 1 --2- 172.21.15.103:0/465791581 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe0c0065fe0 0x7fe0c0127540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:43.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.995+0000 7fe0bed9d700 1 -- 172.21.15.103:0/465791581 >> v2:172.21.15.86:3300/0 conn(0x7fe0c0063e30 msgr2=0x7fe0c00b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:43.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.995+0000 7fe0bed9d700 1 --2- 172.21.15.103:0/465791581 >> v2:172.21.15.86:3300/0 conn(0x7fe0c0063e30 0x7fe0c00b4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:43.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.995+0000 7fe0bed9d700 1 -- 172.21.15.103:0/465791581 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c00b5140 con 0x7fe0c012c0d0 2020-04-22T14:02:43.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.995+0000 7fe0bed9d700 1 --2- 172.21.15.103:0/465791581 >> v2:172.21.15.103:3300/0 conn(0x7fe0c012c0d0 0x7fe0c0155480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe0b8003270 tx=0x7fe0b8010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.995+0000 7fe0bed9d700 1 --2- 172.21.15.103:0/465791581 >> v2:172.21.15.103:3300/0 conn(0x7fe0c012c0d0 0x7fe0c0155480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe0b8003270 tx=0x7fe0b8010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.995+0000 7fe0bed9d700 1 --2- 172.21.15.103:0/465791581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0c012c0d0 0x7fe0c0155480 secure :-1 s=READY pgs=189 cs=0 l=1 rx=0x7fe0b8003270 tx=0x7fe0b8010dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:43.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.995+0000 7fe0bed9d700 1 --2- 172.21.15.103:0/465791581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0c012c0d0 0x7fe0c0155480 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7fe0b8003270 tx=0x7fe0b8010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.995+0000 7fe0bed9d700 1 --2- 172.21.15.103:0/465791581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0c012c0d0 0x7fe0c0155480 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7fe0b8003270 tx=0x7fe0b8010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.995+0000 7fe0b77fe700 1 -- 172.21.15.103:0/465791581 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0b8007370 con 0x7fe0c012c0d0 2020-04-22T14:02:43.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.995+0000 7fe0bed9d700 1 --2- 172.21.15.103:0/465791581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0c012c0d0 0x7fe0c0155480 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7fe0b8003270 tx=0x7fe0b8010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.995+0000 7fe0b77fe700 1 -- 172.21.15.103:0/465791581 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b80074d0 con 0x7fe0c012c0d0 2020-04-22T14:02:43.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.995+0000 7fe0c4f12700 1 -- 172.21.15.103:0/465791581 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0c00b53f0 con 0x7fe0c012c0d0 2020-04-22T14:02:43.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.995+0000 7fe0b77fe700 1 -- 172.21.15.103:0/465791581 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0b80078b0 con 0x7fe0c012c0d0 2020-04-22T14:02:43.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.995+0000 7fe0c4f12700 1 -- 172.21.15.103:0/465791581 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0c00b58c0 con 0x7fe0c012c0d0 2020-04-22T14:02:43.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.995+0000 7fe0bed9d700 1 --2- 172.21.15.103:0/465791581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0c012c0d0 0x7fe0c0155480 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7fe0b8003270 tx=0x7fe0b8010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.996+0000 7fe0b77fe700 1 -- 172.21.15.103:0/465791581 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fe0b8012370 con 0x7fe0c012c0d0 2020-04-22T14:02:43.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.996+0000 7fe0bed9d700 1 --2- 172.21.15.103:0/465791581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0c012c0d0 0x7fe0c0155480 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7fe0b8003270 tx=0x7fe0b8010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.996+0000 7fe0c4f12700 1 -- 172.21.15.103:0/465791581 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0c01558e0 con 0x7fe0c012c0d0 2020-04-22T14:02:43.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.996+0000 7fe0b77fe700 1 --2- 172.21.15.103:0/465791581 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe0a404d940 0x7fe0a404fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:43.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.996+0000 7fe0b77fe700 1 -- 172.21.15.103:0/465791581 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe0b8061800 con 0x7fe0c012c0d0 2020-04-22T14:02:43.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.996+0000 7fe0be59c700 1 --2- 172.21.15.103:0/465791581 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe0a404d940 0x7fe0a404fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:43.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.997+0000 7fe0be59c700 1 --2- 172.21.15.103:0/465791581 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe0a404d940 0x7fe0a404fe00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe0a8001f50 tx=0x7fe0a8003960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.997+0000 7fe0be59c700 1 --2- 172.21.15.103:0/465791581 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe0a404d940 0x7fe0a404fe00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe0a8001f50 tx=0x7fe0a8003960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:42.997+0000 7fe0be59c700 1 --2- 172.21.15.103:0/465791581 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe0a404d940 0x7fe0a404fe00 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7fe0a8001f50 tx=0x7fe0a8003960).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:43.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.000+0000 7fe0bed9d700 1 --2- 172.21.15.103:0/465791581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0c012c0d0 0x7fe0c0155480 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7fe0b8003270 tx=0x7fe0b8010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.000+0000 7fe0b77fe700 1 -- 172.21.15.103:0/465791581 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fe0b803cbe0 con 0x7fe0c012c0d0 2020-04-22T14:02:43.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.142+0000 7fe0c4f12700 1 -- 172.21.15.103:0/465791581 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0c0056c90 con 0x7fe0c012c0d0 2020-04-22T14:02:43.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.143+0000 7fe0bed9d700 1 --2- 172.21.15.103:0/465791581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0c012c0d0 0x7fe0c0155480 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7fe0b8003270 tx=0x7fe0b8010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.143+0000 7fe0b77fe700 1 -- 172.21.15.103:0/465791581 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16089 (secure 0 0 0) 0x7fe0b8040200 con 0x7fe0c012c0d0 2020-04-22T14:02:43.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.145+0000 7fe0c4f12700 1 -- 172.21.15.103:0/465791581 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe0a404d940 msgr2=0x7fe0a404fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:43.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.145+0000 7fe0c4f12700 1 --2- 172.21.15.103:0/465791581 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe0a404d940 0x7fe0a404fe00 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7fe0a8001f50 tx=0x7fe0a8003960).stop 2020-04-22T14:02:43.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.145+0000 7fe0c4f12700 1 -- 172.21.15.103:0/465791581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0c012c0d0 msgr2=0x7fe0c0155480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:43.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.145+0000 7fe0c4f12700 1 --2- 172.21.15.103:0/465791581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0c012c0d0 0x7fe0c0155480 secure :-1 s=READY pgs=189 cs=0 l=1 rx=0x7fe0b8003270 tx=0x7fe0b8010dc0).stop 2020-04-22T14:02:43.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.145+0000 7fe0c4f12700 1 -- 172.21.15.103:0/465791581 shutdown_connections 2020-04-22T14:02:43.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.145+0000 7fe0c4f12700 1 --2- 172.21.15.103:0/465791581 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe0a404d940 0x7fe0a404fe00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:43.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.145+0000 7fe0c4f12700 1 --2- 172.21.15.103:0/465791581 >> v2:172.21.15.86:3300/0 conn(0x7fe0c0063e30 0x7fe0c00b4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:43.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.145+0000 7fe0c4f12700 1 --2- 172.21.15.103:0/465791581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0c012c0d0 0x7fe0c0155480 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:43.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.145+0000 7fe0c4f12700 1 --2- 172.21.15.103:0/465791581 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe0c0065fe0 0x7fe0c0127540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:43.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.145+0000 7fe0c4f12700 1 -- 172.21.15.103:0/465791581 >> 172.21.15.103:0/465791581 conn(0x7fe0c00b9160 msgr2=0x7fe0c00615e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:43.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.145+0000 7fe0c4f12700 1 -- 172.21.15.103:0/465791581 shutdown_connections 2020-04-22T14:02:43.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.145+0000 7fe0c4f12700 1 -- 172.21.15.103:0/465791581 wait complete. 2020-04-22T14:02:43.156 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:02:43.156 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":24,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:02:28.687155+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:02:25.963043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-22T14:02:26.642611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:02:43.158 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:25.963043+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:26.642611+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 4, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'24', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:02:43.159 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:43.173 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:02:43.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.319+0000 7ff20bf0e700 1 Processor -- start 2020-04-22T14:02:43.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.320+0000 7ff20bf0e700 1 -- start start 2020-04-22T14:02:43.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.320+0000 7ff20bf0e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff204061a30 0x7ff2040b4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:43.326 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.320+0000 7ff20bf0e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff2040acb10 0x7ff2040ae920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:43.326 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.320+0000 7ff20bf0e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff204060250 con 0x7ff2040aed80 2020-04-22T14:02:43.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.320+0000 7ff20bf0e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2040b94d0 con 0x7ff204061a30 2020-04-22T14:02:43.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.320+0000 7ff20bf0e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2040623c0 con 0x7ff2040acb10 2020-04-22T14:02:43.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.320+0000 7ff2094a9700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff2040acb10 0x7ff2040ae920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:43.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.320+0000 7ff20a4ab700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff2040aed80 0x7ff2040b8dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39770/0 (socket says 172.21.15.103:39770) 2020-04-22T14:02:43.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.320+0000 7ff20a4ab700 1 -- 172.21.15.103:0/608806029 learned_addr learned my addr 172.21.15.103:0/608806029 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:43.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.321+0000 7ff209caa700 1 --2- 172.21.15.103:0/608806029 >> v2:172.21.15.86:3300/0 conn(0x7ff204061a30 0x7ff2040b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:43.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.321+0000 7ff2094a9700 1 -- 172.21.15.103:0/608806029 >> v2:172.21.15.86:3300/0 conn(0x7ff204061a30 msgr2=0x7ff2040b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:43.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.321+0000 7ff2094a9700 1 --2- 172.21.15.103:0/608806029 >> v2:172.21.15.86:3300/0 conn(0x7ff204061a30 0x7ff2040b4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:43.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.321+0000 7ff2094a9700 1 -- 172.21.15.103:0/608806029 >> v1:172.21.15.103:6789/0 conn(0x7ff2040aed80 legacy=0x7ff2040b8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:43.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.321+0000 7ff2094a9700 1 -- 172.21.15.103:0/608806029 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff204062660 con 0x7ff2040acb10 2020-04-22T14:02:43.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.321+0000 7ff208ca8700 1 -- 172.21.15.103:0/608806029 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2992023401 0 0) 0x7ff204060250 con 0x7ff2040aed80 2020-04-22T14:02:43.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.321+0000 7ff2094a9700 1 --2- 172.21.15.103:0/608806029 >> v2:172.21.15.103:3300/0 conn(0x7ff2040acb10 0x7ff2040ae920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff1f8002f30 tx=0x7ff1f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.321+0000 7ff2094a9700 1 --2- 172.21.15.103:0/608806029 >> v2:172.21.15.103:3300/0 conn(0x7ff2040acb10 0x7ff2040ae920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff1f8002f30 tx=0x7ff1f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.321+0000 7ff2094a9700 1 --2- 172.21.15.103:0/608806029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2040acb10 0x7ff2040ae920 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7ff1f8002f30 tx=0x7ff1f8007a40).ready entity=mon.1 client_cookie=7f84011968ba28ea server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:43.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.321+0000 7ff2094a9700 1 --2- 172.21.15.103:0/608806029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2040acb10 0x7ff2040ae920 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7ff1f8002f30 tx=0x7ff1f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.321+0000 7ff208ca8700 1 -- 172.21.15.103:0/608806029 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1f8011470 con 0x7ff2040acb10 2020-04-22T14:02:43.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.321+0000 7ff2094a9700 1 --2- 172.21.15.103:0/608806029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2040acb10 0x7ff2040ae920 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7ff1f8002f30 tx=0x7ff1f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.321+0000 7ff2094a9700 1 --2- 172.21.15.103:0/608806029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2040acb10 0x7ff2040ae920 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7ff1f8002f30 tx=0x7ff1f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.321+0000 7ff208ca8700 1 -- 172.21.15.103:0/608806029 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f80115d0 con 0x7ff2040acb10 2020-04-22T14:02:43.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.321+0000 7ff208ca8700 1 -- 172.21.15.103:0/608806029 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1f80119b0 con 0x7ff2040acb10 2020-04-22T14:02:43.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.321+0000 7ff20bf0e700 1 -- 172.21.15.103:0/608806029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2040acb10 msgr2=0x7ff2040ae920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:43.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.321+0000 7ff20bf0e700 1 --2- 172.21.15.103:0/608806029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2040acb10 0x7ff2040ae920 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7ff1f8002f30 tx=0x7ff1f8007a40).stop 2020-04-22T14:02:43.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.321+0000 7ff20bf0e700 1 -- 172.21.15.103:0/608806029 shutdown_connections 2020-04-22T14:02:43.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.321+0000 7ff20bf0e700 1 --2- 172.21.15.103:0/608806029 >> v2:172.21.15.86:3300/0 conn(0x7ff204061a30 0x7ff2040b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:43.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.321+0000 7ff20bf0e700 1 --2- 172.21.15.103:0/608806029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2040acb10 0x7ff2040ae920 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:43.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.322+0000 7ff20bf0e700 1 -- 172.21.15.103:0/608806029 >> 172.21.15.103:0/608806029 conn(0x7ff20405b7b0 msgr2=0x7ff2040b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:43.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.322+0000 7ff20bf0e700 1 -- 172.21.15.103:0/608806029 shutdown_connections 2020-04-22T14:02:43.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.322+0000 7ff20bf0e700 1 -- 172.21.15.103:0/608806029 wait complete. 2020-04-22T14:02:43.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.323+0000 7ff20bf0e700 1 Processor -- start 2020-04-22T14:02:43.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.323+0000 7ff20bf0e700 1 -- start start 2020-04-22T14:02:43.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.323+0000 7ff20bf0e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff204061a30 0x7ff2040b1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:43.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.323+0000 7ff20bf0e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff2040acb10 0x7ff204153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:43.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.323+0000 7ff20bf0e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff2040aed80 0x7ff2041541e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:43.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.323+0000 7ff20bf0e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff204141ab0 con 0x7ff2040acb10 2020-04-22T14:02:43.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.323+0000 7ff20bf0e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2040b02a0 con 0x7ff204061a30 2020-04-22T14:02:43.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.323+0000 7ff20bf0e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2040b0500 con 0x7ff2040aed80 2020-04-22T14:02:43.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.323+0000 7ff209caa700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff204061a30 0x7ff2040b1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:43.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.323+0000 7ff209caa700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff204061a30 0x7ff2040b1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47584/0 (socket says 172.21.15.103:47584) 2020-04-22T14:02:43.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.323+0000 7ff209caa700 1 -- 172.21.15.103:0/2401636690 learned_addr learned my addr 172.21.15.103:0/2401636690 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:43.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.323+0000 7ff2094a9700 1 --2- 172.21.15.103:0/2401636690 >> v2:172.21.15.86:3300/0 conn(0x7ff2040acb10 0x7ff204153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:43.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.323+0000 7ff20a4ab700 1 --2- 172.21.15.103:0/2401636690 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff2040aed80 0x7ff2041541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:43.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.324+0000 7ff209caa700 1 -- 172.21.15.103:0/2401636690 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff2040aed80 msgr2=0x7ff2041541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:43.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.324+0000 7ff209caa700 1 --2- 172.21.15.103:0/2401636690 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff2040aed80 0x7ff2041541e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:43.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.324+0000 7ff209caa700 1 -- 172.21.15.103:0/2401636690 >> v2:172.21.15.86:3300/0 conn(0x7ff2040acb10 msgr2=0x7ff204153d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:43.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.324+0000 7ff209caa700 1 --2- 172.21.15.103:0/2401636690 >> v2:172.21.15.86:3300/0 conn(0x7ff2040acb10 0x7ff204153d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:43.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.324+0000 7ff209caa700 1 -- 172.21.15.103:0/2401636690 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff204154640 con 0x7ff204061a30 2020-04-22T14:02:43.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.324+0000 7ff209caa700 1 --2- 172.21.15.103:0/2401636690 >> v2:172.21.15.103:3300/0 conn(0x7ff204061a30 0x7ff2040b1620 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff200002f30 tx=0x7ff200010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.324+0000 7ff209caa700 1 --2- 172.21.15.103:0/2401636690 >> v2:172.21.15.103:3300/0 conn(0x7ff204061a30 0x7ff2040b1620 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff200002f30 tx=0x7ff200010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.324+0000 7ff209caa700 1 --2- 172.21.15.103:0/2401636690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff204061a30 0x7ff2040b1620 secure :-1 s=READY pgs=192 cs=0 l=1 rx=0x7ff200002f30 tx=0x7ff200010c30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:43.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.324+0000 7ff209caa700 1 --2- 172.21.15.103:0/2401636690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff204061a30 0x7ff2040b1620 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7ff200002f30 tx=0x7ff200010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.324+0000 7ff209caa700 1 --2- 172.21.15.103:0/2401636690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff204061a30 0x7ff2040b1620 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7ff200002f30 tx=0x7ff200010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.324+0000 7ff1f6ffd700 1 -- 172.21.15.103:0/2401636690 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2000129f0 con 0x7ff204061a30 2020-04-22T14:02:43.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.324+0000 7ff209caa700 1 --2- 172.21.15.103:0/2401636690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff204061a30 0x7ff2040b1620 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7ff200002f30 tx=0x7ff200010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.324+0000 7ff1f6ffd700 1 -- 172.21.15.103:0/2401636690 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff200012b50 con 0x7ff204061a30 2020-04-22T14:02:43.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.324+0000 7ff20bf0e700 1 -- 172.21.15.103:0/2401636690 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2040b09a0 con 0x7ff204061a30 2020-04-22T14:02:43.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.324+0000 7ff1f6ffd700 1 -- 172.21.15.103:0/2401636690 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2000091c0 con 0x7ff204061a30 2020-04-22T14:02:43.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.324+0000 7ff20bf0e700 1 -- 172.21.15.103:0/2401636690 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff204066350 con 0x7ff204061a30 2020-04-22T14:02:43.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.324+0000 7ff209caa700 1 --2- 172.21.15.103:0/2401636690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff204061a30 0x7ff2040b1620 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7ff200002f30 tx=0x7ff200010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.325+0000 7ff1f6ffd700 1 -- 172.21.15.103:0/2401636690 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ff200007190 con 0x7ff204061a30 2020-04-22T14:02:43.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.325+0000 7ff209caa700 1 --2- 172.21.15.103:0/2401636690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff204061a30 0x7ff2040b1620 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7ff200002f30 tx=0x7ff200010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.325+0000 7ff20bf0e700 1 -- 172.21.15.103:0/2401636690 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff204056c90 con 0x7ff204061a30 2020-04-22T14:02:43.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.325+0000 7ff1f6ffd700 1 --2- 172.21.15.103:0/2401636690 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff1e404da70 0x7ff1e404ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:43.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.325+0000 7ff1f6ffd700 1 -- 172.21.15.103:0/2401636690 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff2000616e0 con 0x7ff204061a30 2020-04-22T14:02:43.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.325+0000 7ff2094a9700 1 --2- 172.21.15.103:0/2401636690 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff1e404da70 0x7ff1e404ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:43.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.325+0000 7ff2094a9700 1 --2- 172.21.15.103:0/2401636690 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff1e404da70 0x7ff1e404ff30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff1f8002f30 tx=0x7ff1f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.326+0000 7ff2094a9700 1 --2- 172.21.15.103:0/2401636690 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff1e404da70 0x7ff1e404ff30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff1f8002f30 tx=0x7ff1f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.326+0000 7ff2094a9700 1 --2- 172.21.15.103:0/2401636690 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff1e404da70 0x7ff1e404ff30 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7ff1f8002f30 tx=0x7ff1f8007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:43.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.329+0000 7ff209caa700 1 --2- 172.21.15.103:0/2401636690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff204061a30 0x7ff2040b1620 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7ff200002f30 tx=0x7ff200010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.329+0000 7ff1f6ffd700 1 -- 172.21.15.103:0/2401636690 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ff20003cac0 con 0x7ff204061a30 2020-04-22T14:02:43.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.470+0000 7ff20bf0e700 1 -- 172.21.15.103:0/2401636690 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff2040b0670 con 0x7ff204061a30 2020-04-22T14:02:43.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.471+0000 7ff209caa700 1 --2- 172.21.15.103:0/2401636690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff204061a30 0x7ff2040b1620 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7ff200002f30 tx=0x7ff200010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.471+0000 7ff1f6ffd700 1 -- 172.21.15.103:0/2401636690 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v24) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff2000400e0 con 0x7ff204061a30 2020-04-22T14:02:43.474 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:02:43.476 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.472+0000 7ff20bf0e700 1 -- 172.21.15.103:0/2401636690 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff1e404da70 msgr2=0x7ff1e404ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:43.476 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.472+0000 7ff20bf0e700 1 --2- 172.21.15.103:0/2401636690 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff1e404da70 0x7ff1e404ff30 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7ff1f8002f30 tx=0x7ff1f8007a40).stop 2020-04-22T14:02:43.476 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.472+0000 7ff20bf0e700 1 -- 172.21.15.103:0/2401636690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff204061a30 msgr2=0x7ff2040b1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:43.476 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.472+0000 7ff20bf0e700 1 --2- 172.21.15.103:0/2401636690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff204061a30 0x7ff2040b1620 secure :-1 s=READY pgs=192 cs=0 l=1 rx=0x7ff200002f30 tx=0x7ff200010c30).stop 2020-04-22T14:02:43.476 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.472+0000 7ff20bf0e700 1 -- 172.21.15.103:0/2401636690 shutdown_connections 2020-04-22T14:02:43.476 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.472+0000 7ff20bf0e700 1 --2- 172.21.15.103:0/2401636690 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff2040aed80 0x7ff2041541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:43.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.472+0000 7ff20bf0e700 1 --2- 172.21.15.103:0/2401636690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff204061a30 0x7ff2040b1620 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:43.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.472+0000 7ff20bf0e700 1 --2- 172.21.15.103:0/2401636690 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff1e404da70 0x7ff1e404ff30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:43.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.472+0000 7ff20bf0e700 1 --2- 172.21.15.103:0/2401636690 >> v2:172.21.15.86:3300/0 conn(0x7ff2040acb10 0x7ff204153d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:43.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.472+0000 7ff20bf0e700 1 -- 172.21.15.103:0/2401636690 >> 172.21.15.103:0/2401636690 conn(0x7ff20405b7b0 msgr2=0x7ff2041440d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:43.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.472+0000 7ff20bf0e700 1 -- 172.21.15.103:0/2401636690 shutdown_connections 2020-04-22T14:02:43.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.472+0000 7ff20bf0e700 1 -- 172.21.15.103:0/2401636690 wait complete. 2020-04-22T14:02:43.485 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:43.499 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:02:43.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.644+0000 7f5c28a89700 1 Processor -- start 2020-04-22T14:02:43.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.644+0000 7f5c28a89700 1 -- start start 2020-04-22T14:02:43.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.645+0000 7f5c28a89700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5c240ac950 0x7f5c24146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:43.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.645+0000 7f5c28a89700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c241467e0 con 0x7f5c240b9140 2020-04-22T14:02:43.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.645+0000 7f5c28a89700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c24060050 con 0x7f5c241470a0 2020-04-22T14:02:43.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.645+0000 7f5c28a89700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c24147530 con 0x7f5c240ac950 2020-04-22T14:02:43.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.645+0000 7f5c21d9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5c240ac950 0x7f5c24146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:43.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.645+0000 7f5c22d9d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f5c241470a0 0x7f5c24143090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39782/0 (socket says 172.21.15.103:39782) 2020-04-22T14:02:43.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.645+0000 7f5c22d9d700 1 -- 172.21.15.103:0/2314729813 learned_addr learned my addr 172.21.15.103:0/2314729813 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:43.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.645+0000 7f5c21d9b700 1 -- 172.21.15.103:0/2314729813 >> v1:172.21.15.103:6789/0 conn(0x7f5c241470a0 legacy=0x7f5c24143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:43.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.645+0000 7f5c21d9b700 1 -- 172.21.15.103:0/2314729813 >> v1:172.21.15.86:6789/0 conn(0x7f5c240b9140 legacy=0x7f5c2412b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:43.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.645+0000 7f5c2159a700 1 -- 172.21.15.103:0/2314729813 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1318321513 0 0) 0x7f5c24060050 con 0x7f5c241470a0 2020-04-22T14:02:43.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.645+0000 7f5c21d9b700 1 -- 172.21.15.103:0/2314729813 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c240b9520 con 0x7f5c240ac950 2020-04-22T14:02:43.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.645+0000 7f5c21d9b700 1 --2- 172.21.15.103:0/2314729813 >> v2:172.21.15.103:3300/0 conn(0x7f5c240ac950 0x7f5c24146c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5c14002f30 tx=0x7f5c14007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.646+0000 7f5c21d9b700 1 --2- 172.21.15.103:0/2314729813 >> v2:172.21.15.103:3300/0 conn(0x7f5c240ac950 0x7f5c24146c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5c14002f30 tx=0x7f5c14007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.646+0000 7f5c21d9b700 1 --2- 172.21.15.103:0/2314729813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c240ac950 0x7f5c24146c40 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7f5c14002f30 tx=0x7f5c14007a40).ready entity=mon.1 client_cookie=f99bf134f385aa7e server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:43.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.646+0000 7f5c21d9b700 1 --2- 172.21.15.103:0/2314729813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c240ac950 0x7f5c24146c40 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f5c14002f30 tx=0x7f5c14007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.646+0000 7f5c2159a700 1 -- 172.21.15.103:0/2314729813 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c14011470 con 0x7f5c240ac950 2020-04-22T14:02:43.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.646+0000 7f5c21d9b700 1 --2- 172.21.15.103:0/2314729813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c240ac950 0x7f5c24146c40 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f5c14002f30 tx=0x7f5c14007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.646+0000 7f5c21d9b700 1 --2- 172.21.15.103:0/2314729813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c240ac950 0x7f5c24146c40 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f5c14002f30 tx=0x7f5c14007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.646+0000 7f5c2159a700 1 -- 172.21.15.103:0/2314729813 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c140115d0 con 0x7f5c240ac950 2020-04-22T14:02:43.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.646+0000 7f5c2159a700 1 -- 172.21.15.103:0/2314729813 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c140119f0 con 0x7f5c240ac950 2020-04-22T14:02:43.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.646+0000 7f5c28a89700 1 -- 172.21.15.103:0/2314729813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c240ac950 msgr2=0x7f5c24146c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:43.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.646+0000 7f5c28a89700 1 --2- 172.21.15.103:0/2314729813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c240ac950 0x7f5c24146c40 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7f5c14002f30 tx=0x7f5c14007a40).stop 2020-04-22T14:02:43.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.646+0000 7f5c28a89700 1 -- 172.21.15.103:0/2314729813 shutdown_connections 2020-04-22T14:02:43.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.646+0000 7f5c28a89700 1 --2- 172.21.15.103:0/2314729813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c240ac950 0x7f5c24146c40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:43.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.646+0000 7f5c28a89700 1 -- 172.21.15.103:0/2314729813 >> 172.21.15.103:0/2314729813 conn(0x7f5c2405b7b0 msgr2=0x7f5c240b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:43.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.646+0000 7f5c28a89700 1 -- 172.21.15.103:0/2314729813 shutdown_connections 2020-04-22T14:02:43.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.646+0000 7f5c28a89700 1 -- 172.21.15.103:0/2314729813 wait complete. 2020-04-22T14:02:43.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.647+0000 7f5c28a89700 1 Processor -- start 2020-04-22T14:02:43.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.647+0000 7f5c28a89700 1 -- start start 2020-04-22T14:02:43.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.648+0000 7f5c28a89700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5c240b9140 0x7f5c240b2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:43.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.648+0000 7f5c28a89700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c241470a0 0x7f5c240b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:43.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.648+0000 7f5c28a89700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c240af890 con 0x7f5c240ac950 2020-04-22T14:02:43.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.648+0000 7f5c28a89700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c240b7570 con 0x7f5c240b9140 2020-04-22T14:02:43.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.648+0000 7f5c28a89700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c240afac0 con 0x7f5c241470a0 2020-04-22T14:02:43.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.648+0000 7f5c2259c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f5c240ac950 0x7f5c241453a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39786/0 (socket says 172.21.15.103:39786) 2020-04-22T14:02:43.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.648+0000 7f5c2259c700 1 -- 172.21.15.103:0/1792408982 learned_addr learned my addr 172.21.15.103:0/1792408982 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:43.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.648+0000 7f5c22d9d700 1 --2- 172.21.15.103:0/1792408982 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c241470a0 0x7f5c240b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:43.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.648+0000 7f5c21d9b700 1 --2- 172.21.15.103:0/1792408982 >> v2:172.21.15.86:3300/0 conn(0x7f5c240b9140 0x7f5c240b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:43.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.648+0000 7f5c1b7fe700 1 -- 172.21.15.103:0/1792408982 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1655103245 0 0) 0x7f5c240af890 con 0x7f5c240ac950 2020-04-22T14:02:43.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.648+0000 7f5c1b7fe700 1 -- 172.21.15.103:0/1792408982 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c08002fe0 con 0x7f5c240ac950 2020-04-22T14:02:43.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.648+0000 7f5c1b7fe700 1 -- 172.21.15.103:0/1792408982 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 716693933 0 0) 0x7f5c08002fe0 con 0x7f5c240ac950 2020-04-22T14:02:43.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.648+0000 7f5c1b7fe700 1 -- 172.21.15.103:0/1792408982 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5c240af890 con 0x7f5c240ac950 2020-04-22T14:02:43.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.648+0000 7f5c1b7fe700 1 -- 172.21.15.103:0/1792408982 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f5c0c001930 con 0x7f5c240ac950 2020-04-22T14:02:43.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.649+0000 7f5c1b7fe700 1 -- 172.21.15.103:0/1792408982 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c241470a0 msgr2=0x7f5c240b7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:43.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.649+0000 7f5c1b7fe700 1 --2- 172.21.15.103:0/1792408982 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c241470a0 0x7f5c240b7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:43.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.649+0000 7f5c1b7fe700 1 -- 172.21.15.103:0/1792408982 >> v2:172.21.15.86:3300/0 conn(0x7f5c240b9140 msgr2=0x7f5c240b2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:43.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.649+0000 7f5c1b7fe700 1 --2- 172.21.15.103:0/1792408982 >> v2:172.21.15.86:3300/0 conn(0x7f5c240b9140 0x7f5c240b2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:43.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.649+0000 7f5c1b7fe700 1 -- 172.21.15.103:0/1792408982 >> v1:172.21.15.103:6789/0 conn(0x7f5c240ac950 legacy=0x7f5c241453a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:43.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.649+0000 7f5c1b7fe700 1 --2- 172.21.15.103:0/1792408982 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c241470a0 0x7f5c080049b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:43.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.649+0000 7f5c1b7fe700 1 --2- 172.21.15.103:0/1792408982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c08004e10 0x7f5c08005230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:43.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.649+0000 7f5c1b7fe700 1 --2- 172.21.15.103:0/1792408982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c08003a30 0x7f5c08003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:43.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.649+0000 7f5c1b7fe700 1 -- 172.21.15.103:0/1792408982 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c240b7570 con 0x7f5c08004e10 2020-04-22T14:02:43.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.649+0000 7f5c1b7fe700 1 -- 172.21.15.103:0/1792408982 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c240afac0 con 0x7f5c08003a30 2020-04-22T14:02:43.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.649+0000 7f5c1b7fe700 1 -- 172.21.15.103:0/1792408982 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c08004570 con 0x7f5c241470a0 2020-04-22T14:02:43.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.649+0000 7f5c22d9d700 1 --2- 172.21.15.103:0/1792408982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c08003a30 0x7f5c08003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:43.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.649+0000 7f5c2259c700 1 --2- 172.21.15.103:0/1792408982 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c241470a0 0x7f5c080049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:43.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.649+0000 7f5c21d9b700 1 --2- 172.21.15.103:0/1792408982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c08004e10 0x7f5c08005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:43.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.649+0000 7f5c22d9d700 1 -- 172.21.15.103:0/1792408982 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c241470a0 msgr2=0x7f5c080049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:43.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.649+0000 7f5c22d9d700 1 --2- 172.21.15.103:0/1792408982 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c241470a0 0x7f5c080049b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:43.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.649+0000 7f5c22d9d700 1 -- 172.21.15.103:0/1792408982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c08004e10 msgr2=0x7f5c08005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:43.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.649+0000 7f5c22d9d700 1 --2- 172.21.15.103:0/1792408982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c08004e10 0x7f5c08005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:43.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.649+0000 7f5c22d9d700 1 -- 172.21.15.103:0/1792408982 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c240afd60 con 0x7f5c08003a30 2020-04-22T14:02:43.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.649+0000 7f5c28a89700 1 -- 172.21.15.103:0/1792408982 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c240b7110 con 0x7f5c08003a30 2020-04-22T14:02:43.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.649+0000 7f5c22d9d700 1 --2- 172.21.15.103:0/1792408982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c08003a30 0x7f5c08003eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5c1c000f00 tx=0x7f5c1c013170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.649+0000 7f5c28a89700 1 -- 172.21.15.103:0/1792408982 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c24126f50 con 0x7f5c08003a30 2020-04-22T14:02:43.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.649+0000 7f5c22d9d700 1 --2- 172.21.15.103:0/1792408982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c08003a30 0x7f5c08003eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5c1c000f00 tx=0x7f5c1c013170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.649+0000 7f5c22d9d700 1 --2- 172.21.15.103:0/1792408982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c08003a30 0x7f5c08003eb0 secure :-1 s=READY pgs=196 cs=0 l=1 rx=0x7f5c1c000f00 tx=0x7f5c1c013170).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:43.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.649+0000 7f5c22d9d700 1 --2- 172.21.15.103:0/1792408982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c08003a30 0x7f5c08003eb0 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7f5c1c000f00 tx=0x7f5c1c013170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.649+0000 7f5c22d9d700 1 --2- 172.21.15.103:0/1792408982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c08003a30 0x7f5c08003eb0 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7f5c1c000f00 tx=0x7f5c1c013170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.649+0000 7f5c1b7fe700 1 -- 172.21.15.103:0/1792408982 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c1c013dd0 con 0x7f5c08003a30 2020-04-22T14:02:43.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.649+0000 7f5c22d9d700 1 --2- 172.21.15.103:0/1792408982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c08003a30 0x7f5c08003eb0 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7f5c1c000f00 tx=0x7f5c1c013170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.649+0000 7f5c1b7fe700 1 -- 172.21.15.103:0/1792408982 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c1c00c9b0 con 0x7f5c08003a30 2020-04-22T14:02:43.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.649+0000 7f5c1b7fe700 1 -- 172.21.15.103:0/1792408982 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c1c00cd90 con 0x7f5c08003a30 2020-04-22T14:02:43.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.650+0000 7f5c22d9d700 1 --2- 172.21.15.103:0/1792408982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c08003a30 0x7f5c08003eb0 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7f5c1c000f00 tx=0x7f5c1c013170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.650+0000 7f5c28a89700 1 -- 172.21.15.103:0/1792408982 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c24056c90 con 0x7f5c08003a30 2020-04-22T14:02:43.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.650+0000 7f5c1b7fe700 1 -- 172.21.15.103:0/1792408982 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f5c1c005940 con 0x7f5c08003a30 2020-04-22T14:02:43.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.650+0000 7f5c22d9d700 1 --2- 172.21.15.103:0/1792408982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c08003a30 0x7f5c08003eb0 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7f5c1c000f00 tx=0x7f5c1c013170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.650+0000 7f5c1b7fe700 1 --2- 172.21.15.103:0/1792408982 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5c08055b80 0x7f5c08058040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:43.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.650+0000 7f5c1b7fe700 1 -- 172.21.15.103:0/1792408982 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5c1c063320 con 0x7f5c08003a30 2020-04-22T14:02:43.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.651+0000 7f5c2259c700 1 --2- 172.21.15.103:0/1792408982 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5c08055b80 0x7f5c08058040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:43.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.651+0000 7f5c2259c700 1 --2- 172.21.15.103:0/1792408982 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5c08055b80 0x7f5c08058040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5c0c001640 tx=0x7f5c0c0054d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.651+0000 7f5c2259c700 1 --2- 172.21.15.103:0/1792408982 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5c08055b80 0x7f5c08058040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5c0c001640 tx=0x7f5c0c0054d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.651+0000 7f5c2259c700 1 --2- 172.21.15.103:0/1792408982 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5c08055b80 0x7f5c08058040 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7f5c0c001640 tx=0x7f5c0c0054d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:43.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.654+0000 7f5c22d9d700 1 --2- 172.21.15.103:0/1792408982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c08003a30 0x7f5c08003eb0 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7f5c1c000f00 tx=0x7f5c1c013170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.654+0000 7f5c1b7fe700 1 -- 172.21.15.103:0/1792408982 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f5c1c03e700 con 0x7f5c08003a30 2020-04-22T14:02:43.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.800+0000 7f5c28a89700 1 -- 172.21.15.103:0/1792408982 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5c241275e0 con 0x7f5c08003a30 2020-04-22T14:02:43.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.800+0000 7f5c22d9d700 1 --2- 172.21.15.103:0/1792408982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c08003a30 0x7f5c08003eb0 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7f5c1c000f00 tx=0x7f5c1c013170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:43.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.800+0000 7f5c1b7fe700 1 -- 172.21.15.103:0/1792408982 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5c1c041d20 con 0x7f5c08003a30 2020-04-22T14:02:43.804 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:02:43.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.801+0000 7f5c28a89700 1 -- 172.21.15.103:0/1792408982 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5c08055b80 msgr2=0x7f5c08058040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:43.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.801+0000 7f5c28a89700 1 --2- 172.21.15.103:0/1792408982 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5c08055b80 0x7f5c08058040 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7f5c0c001640 tx=0x7f5c0c0054d0).stop 2020-04-22T14:02:43.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.802+0000 7f5c28a89700 1 -- 172.21.15.103:0/1792408982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c08003a30 msgr2=0x7f5c08003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:43.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.802+0000 7f5c28a89700 1 --2- 172.21.15.103:0/1792408982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c08003a30 0x7f5c08003eb0 secure :-1 s=READY pgs=196 cs=0 l=1 rx=0x7f5c1c000f00 tx=0x7f5c1c013170).stop 2020-04-22T14:02:43.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.802+0000 7f5c22d9d700 1 -- 172.21.15.103:0/1792408982 reap_dead start 2020-04-22T14:02:43.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.802+0000 7f5c22d9d700 1 -- 172.21.15.103:0/1792408982 reap_dead start 2020-04-22T14:02:43.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.802+0000 7f5c28a89700 1 -- 172.21.15.103:0/1792408982 shutdown_connections 2020-04-22T14:02:43.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.802+0000 7f5c28a89700 1 -- 172.21.15.103:0/1792408982 >> 172.21.15.103:0/1792408982 conn(0x7f5c2405b7b0 msgr2=0x7f5c24140f30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:43.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.802+0000 7f5c28a89700 1 -- 172.21.15.103:0/1792408982 shutdown_connections 2020-04-22T14:02:43.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.802+0000 7f5c28a89700 1 -- 172.21.15.103:0/1792408982 wait complete. 2020-04-22T14:02:43.815 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:43.848 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-22T14:02:43.997 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.994+0000 7f5515e8a700 1 Processor -- start 2020-04-22T14:02:43.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.994+0000 7f5515e8a700 1 -- start start 2020-04-22T14:02:44.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.995+0000 7f5515e8a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5510146fc0 0x7f55100b65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:44.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.995+0000 7f5515e8a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f551005fbc0 con 0x7f55100b9890 2020-04-22T14:02:44.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.995+0000 7f5515e8a700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f551005fe60 con 0x7f5510143bc0 2020-04-22T14:02:44.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.995+0000 7f5515e8a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5510060100 con 0x7f5510146fc0 2020-04-22T14:02:44.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.995+0000 7f550effd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f5510143bc0 0x7f55100b5ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39802/0 (socket says 172.21.15.103:39802) 2020-04-22T14:02:44.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.995+0000 7f550effd700 1 -- 172.21.15.103:0/1341821934 learned_addr learned my addr 172.21.15.103:0/1341821934 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:44.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.995+0000 7f550ffff700 1 --2- 172.21.15.103:0/1341821934 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5510146fc0 0x7f55100b65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:44.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.995+0000 7f550e7fc700 1 -- 172.21.15.103:0/1341821934 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2252183378 0 0) 0x7f551005fe60 con 0x7f5510143bc0 2020-04-22T14:02:44.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.995+0000 7f550e7fc700 1 -- 172.21.15.103:0/1341821934 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54fc003230 con 0x7f5510143bc0 2020-04-22T14:02:44.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.996+0000 7f550e7fc700 1 -- 172.21.15.103:0/1341821934 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1492379610 0 0) 0x7f551005fbc0 con 0x7f55100b9890 2020-04-22T14:02:44.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.996+0000 7f550e7fc700 1 -- 172.21.15.103:0/1341821934 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f551005fe60 con 0x7f55100b9890 2020-04-22T14:02:44.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.996+0000 7f550ffff700 1 -- 172.21.15.103:0/1341821934 >> v1:172.21.15.103:6789/0 conn(0x7f5510143bc0 legacy=0x7f55100b5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:44.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.996+0000 7f550e7fc700 1 -- 172.21.15.103:0/1341821934 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 540211418 0 0) 0x7f54fc003230 con 0x7f5510143bc0 2020-04-22T14:02:44.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.996+0000 7f550ffff700 1 -- 172.21.15.103:0/1341821934 >> v1:172.21.15.86:6789/0 conn(0x7f55100b9890 legacy=0x7f55101434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:44.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.996+0000 7f550ffff700 1 -- 172.21.15.103:0/1341821934 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55100b9c70 con 0x7f5510146fc0 2020-04-22T14:02:44.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.996+0000 7f550ffff700 1 --2- 172.21.15.103:0/1341821934 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5510146fc0 0x7f55100b65b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f55040010d0 tx=0x7f5508008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.996+0000 7f550ffff700 1 --2- 172.21.15.103:0/1341821934 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5510146fc0 0x7f55100b65b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f55040010d0 tx=0x7f5508008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.996+0000 7f550ffff700 1 --2- 172.21.15.103:0/1341821934 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5510146fc0 0x7f55100b65b0 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f55040010d0 tx=0x7f5508008c60).ready entity=mon.2 client_cookie=6f8ec7ae4f7955c server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:44.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.996+0000 7f550ffff700 1 --2- 172.21.15.103:0/1341821934 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5510146fc0 0x7f55100b65b0 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f55040010d0 tx=0x7f5508008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.996+0000 7f550e7fc700 1 -- 172.21.15.103:0/1341821934 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55040016d0 con 0x7f5510146fc0 2020-04-22T14:02:44.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.996+0000 7f550ffff700 1 --2- 172.21.15.103:0/1341821934 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5510146fc0 0x7f55100b65b0 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f55040010d0 tx=0x7f5508008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.996+0000 7f550e7fc700 1 -- 172.21.15.103:0/1341821934 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5508011b70 con 0x7f5510146fc0 2020-04-22T14:02:44.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.996+0000 7f550ffff700 1 --2- 172.21.15.103:0/1341821934 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5510146fc0 0x7f55100b65b0 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f55040010d0 tx=0x7f5508008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.996+0000 7f550e7fc700 1 -- 172.21.15.103:0/1341821934 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f550800a180 con 0x7f5510146fc0 2020-04-22T14:02:44.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.996+0000 7f5515e8a700 1 -- 172.21.15.103:0/1341821934 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5510146fc0 msgr2=0x7f55100b65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:44.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.996+0000 7f5515e8a700 1 --2- 172.21.15.103:0/1341821934 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5510146fc0 0x7f55100b65b0 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f55040010d0 tx=0x7f5508008c60).stop 2020-04-22T14:02:44.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.996+0000 7f5515e8a700 1 -- 172.21.15.103:0/1341821934 shutdown_connections 2020-04-22T14:02:44.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.996+0000 7f5515e8a700 1 --2- 172.21.15.103:0/1341821934 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5510146fc0 0x7f55100b65b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:44.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.996+0000 7f5515e8a700 1 -- 172.21.15.103:0/1341821934 >> 172.21.15.103:0/1341821934 conn(0x7f551005ad30 msgr2=0x7f551005b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:44.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.997+0000 7f5515e8a700 1 -- 172.21.15.103:0/1341821934 shutdown_connections 2020-04-22T14:02:44.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.997+0000 7f5515e8a700 1 -- 172.21.15.103:0/1341821934 wait complete. 2020-04-22T14:02:44.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.997+0000 7f5515e8a700 1 Processor -- start 2020-04-22T14:02:44.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.998+0000 7f5515e8a700 1 -- start start 2020-04-22T14:02:44.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.998+0000 7f5515e8a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5510143bc0 0x7f55101481f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:44.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.998+0000 7f5515e8a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5510146fc0 0x7f551012dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:44.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.998+0000 7f5515e8a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5510148650 con 0x7f55100b9890 2020-04-22T14:02:44.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.998+0000 7f5515e8a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5510145eb0 con 0x7f5510146fc0 2020-04-22T14:02:44.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.998+0000 7f5515e8a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55101454d0 con 0x7f5510143bc0 2020-04-22T14:02:44.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.998+0000 7f550effd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5510143bc0 0x7f55101481f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:44.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.998+0000 7f550effd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5510143bc0 0x7f55101481f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47618/0 (socket says 172.21.15.103:47618) 2020-04-22T14:02:44.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.998+0000 7f550effd700 1 -- 172.21.15.103:0/2699863622 learned_addr learned my addr 172.21.15.103:0/2699863622 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:44.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.998+0000 7f550ffff700 1 --2- 172.21.15.103:0/2699863622 >> v2:172.21.15.86:3300/0 conn(0x7f5510146fc0 0x7f551012dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:44.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.999+0000 7f550effd700 1 -- 172.21.15.103:0/2699863622 >> v2:172.21.15.86:3300/0 conn(0x7f5510146fc0 msgr2=0x7f551012dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:44.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.999+0000 7f550effd700 1 --2- 172.21.15.103:0/2699863622 >> v2:172.21.15.86:3300/0 conn(0x7f5510146fc0 0x7f551012dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:44.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.999+0000 7f550effd700 1 -- 172.21.15.103:0/2699863622 >> v1:172.21.15.86:6789/0 conn(0x7f55100b9890 legacy=0x7f551012ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:44.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.999+0000 7f550effd700 1 -- 172.21.15.103:0/2699863622 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5510145770 con 0x7f5510143bc0 2020-04-22T14:02:44.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.999+0000 7f550effd700 1 --2- 172.21.15.103:0/2699863622 >> v2:172.21.15.103:3300/0 conn(0x7f5510143bc0 0x7f55101481f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5504000fa0 tx=0x7f5504010e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.999+0000 7f550effd700 1 --2- 172.21.15.103:0/2699863622 >> v2:172.21.15.103:3300/0 conn(0x7f5510143bc0 0x7f55101481f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5504000fa0 tx=0x7f5504010e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.999+0000 7f550effd700 1 --2- 172.21.15.103:0/2699863622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5510143bc0 0x7f55101481f0 secure :-1 s=READY pgs=198 cs=0 l=1 rx=0x7f5504000fa0 tx=0x7f5504010e00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:44.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.999+0000 7f550effd700 1 --2- 172.21.15.103:0/2699863622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5510143bc0 0x7f55101481f0 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7f5504000fa0 tx=0x7f5504010e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.999+0000 7f550cff9700 1 -- 172.21.15.103:0/2699863622 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f550400c920 con 0x7f5510143bc0 2020-04-22T14:02:44.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.999+0000 7f550effd700 1 --2- 172.21.15.103:0/2699863622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5510143bc0 0x7f55101481f0 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7f5504000fa0 tx=0x7f5504010e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.999+0000 7f550effd700 1 --2- 172.21.15.103:0/2699863622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5510143bc0 0x7f55101481f0 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7f5504000fa0 tx=0x7f5504010e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.999+0000 7f550cff9700 1 -- 172.21.15.103:0/2699863622 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550400ca80 con 0x7f5510143bc0 2020-04-22T14:02:44.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.999+0000 7f5515e8a700 1 -- 172.21.15.103:0/2699863622 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5510145a10 con 0x7f5510143bc0 2020-04-22T14:02:44.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.999+0000 7f550cff9700 1 -- 172.21.15.103:0/2699863622 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f550400ce60 con 0x7f5510143bc0 2020-04-22T14:02:44.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:43.999+0000 7f5515e8a700 1 -- 172.21.15.103:0/2699863622 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f551012e3a0 con 0x7f5510143bc0 2020-04-22T14:02:44.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.000+0000 7f550effd700 1 --2- 172.21.15.103:0/2699863622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5510143bc0 0x7f55101481f0 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7f5504000fa0 tx=0x7f5504010e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.000+0000 7f5515e8a700 1 -- 172.21.15.103:0/2699863622 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5510056c90 con 0x7f5510143bc0 2020-04-22T14:02:44.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.000+0000 7f550cff9700 1 -- 172.21.15.103:0/2699863622 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f55040055e0 con 0x7f5510143bc0 2020-04-22T14:02:44.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.000+0000 7f550effd700 1 --2- 172.21.15.103:0/2699863622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5510143bc0 0x7f55101481f0 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7f5504000fa0 tx=0x7f5504010e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.000+0000 7f550cff9700 1 --2- 172.21.15.103:0/2699863622 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f54f004d9b0 0x7f54f004fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:44.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.000+0000 7f550cff9700 1 -- 172.21.15.103:0/2699863622 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f55040100c0 con 0x7f5510143bc0 2020-04-22T14:02:44.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.000+0000 7f550f7fe700 1 --2- 172.21.15.103:0/2699863622 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f54f004d9b0 0x7f54f004fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:44.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.001+0000 7f550f7fe700 1 --2- 172.21.15.103:0/2699863622 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f54f004d9b0 0x7f54f004fe70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5510149080 tx=0x7f5500002560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.001+0000 7f550f7fe700 1 --2- 172.21.15.103:0/2699863622 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f54f004d9b0 0x7f54f004fe70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5510149080 tx=0x7f5500002560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.001+0000 7f550f7fe700 1 --2- 172.21.15.103:0/2699863622 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f54f004d9b0 0x7f54f004fe70 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7f5510149080 tx=0x7f5500002560).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:44.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.004+0000 7f550effd700 1 --2- 172.21.15.103:0/2699863622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5510143bc0 0x7f55101481f0 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7f5504000fa0 tx=0x7f5504010e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.004+0000 7f550cff9700 1 -- 172.21.15.103:0/2699863622 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f550403c8c0 con 0x7f5510143bc0 2020-04-22T14:02:44.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.146+0000 7f5515e8a700 1 -- 172.21.15.103:0/2699863622 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f55100b39e0 con 0x7f5510143bc0 2020-04-22T14:02:44.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.147+0000 7f550effd700 1 --2- 172.21.15.103:0/2699863622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5510143bc0 0x7f55101481f0 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7f5504000fa0 tx=0x7f5504010e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.147+0000 7f550cff9700 1 -- 172.21.15.103:0/2699863622 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7f550403fee0 con 0x7f5510143bc0 2020-04-22T14:02:44.151 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:02:44.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.148+0000 7f5515e8a700 1 -- 172.21.15.103:0/2699863622 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f54f004d9b0 msgr2=0x7f54f004fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:44.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.148+0000 7f5515e8a700 1 --2- 172.21.15.103:0/2699863622 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f54f004d9b0 0x7f54f004fe70 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7f5510149080 tx=0x7f5500002560).stop 2020-04-22T14:02:44.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.148+0000 7f5515e8a700 1 -- 172.21.15.103:0/2699863622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5510143bc0 msgr2=0x7f55101481f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:44.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.148+0000 7f5515e8a700 1 --2- 172.21.15.103:0/2699863622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5510143bc0 0x7f55101481f0 secure :-1 s=READY pgs=198 cs=0 l=1 rx=0x7f5504000fa0 tx=0x7f5504010e00).stop 2020-04-22T14:02:44.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.148+0000 7f5515e8a700 1 -- 172.21.15.103:0/2699863622 shutdown_connections 2020-04-22T14:02:44.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.148+0000 7f5515e8a700 1 --2- 172.21.15.103:0/2699863622 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f54f004d9b0 0x7f54f004fe70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:44.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.148+0000 7f5515e8a700 1 --2- 172.21.15.103:0/2699863622 >> v2:172.21.15.86:3300/0 conn(0x7f5510146fc0 0x7f551012dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:44.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.148+0000 7f5515e8a700 1 --2- 172.21.15.103:0/2699863622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5510143bc0 0x7f55101481f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:44.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.148+0000 7f5515e8a700 1 -- 172.21.15.103:0/2699863622 >> 172.21.15.103:0/2699863622 conn(0x7f551005ad30 msgr2=0x7f551005c690 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:44.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.148+0000 7f5515e8a700 1 -- 172.21.15.103:0/2699863622 shutdown_connections 2020-04-22T14:02:44.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.148+0000 7f5515e8a700 1 -- 172.21.15.103:0/2699863622 wait complete. 2020-04-22T14:02:44.162 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:44.175 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-22T14:02:44.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.322+0000 7f3c2041c700 1 Processor -- start 2020-04-22T14:02:44.326 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.322+0000 7f3c2041c700 1 -- start start 2020-04-22T14:02:44.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.323+0000 7f3c2041c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c180b9140 0x7f3c1812b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:44.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.323+0000 7f3c2041c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3c1812b670 0x7f3c18143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:44.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.323+0000 7f3c2041c700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c181467e0 con 0x7f3c180ac950 2020-04-22T14:02:44.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.323+0000 7f3c2041c700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c180602f0 con 0x7f3c1812b670 2020-04-22T14:02:44.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.323+0000 7f3c2041c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c18060050 con 0x7f3c180b9140 2020-04-22T14:02:44.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.323+0000 7f3c1e9b9700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3c1812b670 0x7f3c18143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:44.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.324+0000 7f3c1e9b9700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3c1812b670 0x7f3c18143090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47624/0 (socket says 172.21.15.103:47624) 2020-04-22T14:02:44.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.324+0000 7f3c1e9b9700 1 -- 172.21.15.103:0/2861878125 learned_addr learned my addr 172.21.15.103:0/2861878125 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:44.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.324+0000 7f3c1e1b8700 1 --2- 172.21.15.103:0/2861878125 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c180b9140 0x7f3c1812b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:44.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.324+0000 7f3c1e9b9700 1 -- 172.21.15.103:0/2861878125 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c180b9140 msgr2=0x7f3c1812b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:44.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.324+0000 7f3c1e9b9700 1 --2- 172.21.15.103:0/2861878125 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c180b9140 0x7f3c1812b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:44.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.324+0000 7f3c1e9b9700 1 -- 172.21.15.103:0/2861878125 >> v1:172.21.15.86:6789/0 conn(0x7f3c180ac950 legacy=0x7f3c18146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:44.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.324+0000 7f3c1e9b9700 1 -- 172.21.15.103:0/2861878125 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c180b9520 con 0x7f3c1812b670 2020-04-22T14:02:44.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.324+0000 7f3c1e9b9700 1 --2- 172.21.15.103:0/2861878125 >> v2:172.21.15.103:3300/0 conn(0x7f3c1812b670 0x7f3c18143090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3c18060f70 tx=0x7f3c10007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.324+0000 7f3c1e9b9700 1 --2- 172.21.15.103:0/2861878125 >> v2:172.21.15.103:3300/0 conn(0x7f3c1812b670 0x7f3c18143090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3c18060f70 tx=0x7f3c10007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.324+0000 7f3c1e9b9700 1 --2- 172.21.15.103:0/2861878125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c1812b670 0x7f3c18143090 secure :-1 s=READY pgs=199 cs=0 l=1 rx=0x7f3c18060f70 tx=0x7f3c10007dc0).ready entity=mon.1 client_cookie=2eb8a6f5fed15bb server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:44.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.324+0000 7f3c1e9b9700 1 --2- 172.21.15.103:0/2861878125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c1812b670 0x7f3c18143090 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f3c18060f70 tx=0x7f3c10007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.324+0000 7f3c1d1b6700 1 -- 172.21.15.103:0/2861878125 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c1000a180 con 0x7f3c1812b670 2020-04-22T14:02:44.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.324+0000 7f3c1e9b9700 1 --2- 172.21.15.103:0/2861878125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c1812b670 0x7f3c18143090 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f3c18060f70 tx=0x7f3c10007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.324+0000 7f3c1e9b9700 1 --2- 172.21.15.103:0/2861878125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c1812b670 0x7f3c18143090 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f3c18060f70 tx=0x7f3c10007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.324+0000 7f3c1d1b6700 1 -- 172.21.15.103:0/2861878125 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1000a2e0 con 0x7f3c1812b670 2020-04-22T14:02:44.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.324+0000 7f3c1d1b6700 1 -- 172.21.15.103:0/2861878125 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c1000a700 con 0x7f3c1812b670 2020-04-22T14:02:44.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.324+0000 7f3c2041c700 1 -- 172.21.15.103:0/2861878125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c1812b670 msgr2=0x7f3c18143090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:44.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.324+0000 7f3c2041c700 1 --2- 172.21.15.103:0/2861878125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c1812b670 0x7f3c18143090 secure :-1 s=READY pgs=199 cs=0 l=1 rx=0x7f3c18060f70 tx=0x7f3c10007dc0).stop 2020-04-22T14:02:44.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.325+0000 7f3c2041c700 1 -- 172.21.15.103:0/2861878125 shutdown_connections 2020-04-22T14:02:44.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.325+0000 7f3c2041c700 1 --2- 172.21.15.103:0/2861878125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c1812b670 0x7f3c18143090 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:44.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.325+0000 7f3c2041c700 1 --2- 172.21.15.103:0/2861878125 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c180b9140 0x7f3c1812b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:44.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.325+0000 7f3c2041c700 1 -- 172.21.15.103:0/2861878125 >> 172.21.15.103:0/2861878125 conn(0x7f3c1805b7b0 msgr2=0x7f3c180b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:44.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.325+0000 7f3c2041c700 1 -- 172.21.15.103:0/2861878125 shutdown_connections 2020-04-22T14:02:44.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.325+0000 7f3c2041c700 1 -- 172.21.15.103:0/2861878125 wait complete. 2020-04-22T14:02:44.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.326+0000 7f3c2041c700 1 Processor -- start 2020-04-22T14:02:44.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.326+0000 7f3c2041c700 1 -- start start 2020-04-22T14:02:44.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.326+0000 7f3c2041c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c180ac950 0x7f3c180666f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:44.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.326+0000 7f3c2041c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3c1812b670 0x7f3c181545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:44.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.326+0000 7f3c2041c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c18065e70 con 0x7f3c180b9140 2020-04-22T14:02:44.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.326+0000 7f3c2041c700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c18065020 con 0x7f3c1812b670 2020-04-22T14:02:44.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.326+0000 7f3c2041c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c180652c0 con 0x7f3c180ac950 2020-04-22T14:02:44.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.326+0000 7f3c1e9b9700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3c1812b670 0x7f3c181545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:44.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.326+0000 7f3c1e9b9700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3c1812b670 0x7f3c181545d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47632/0 (socket says 172.21.15.103:47632) 2020-04-22T14:02:44.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.326+0000 7f3c1e9b9700 1 -- 172.21.15.103:0/980812935 learned_addr learned my addr 172.21.15.103:0/980812935 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:44.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.326+0000 7f3c1d9b7700 1 --1- 172.21.15.103:0/980812935 >> v1:172.21.15.103:6789/0 conn(0x7f3c180b9140 0x7f3c18065760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39820/0 (socket says 172.21.15.103:39820) 2020-04-22T14:02:44.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.327+0000 7f3c1e1b8700 1 --2- 172.21.15.103:0/980812935 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c180ac950 0x7f3c180666f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:44.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.327+0000 7f3c1e9b9700 1 -- 172.21.15.103:0/980812935 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c180ac950 msgr2=0x7f3c180666f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:44.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.327+0000 7f3c1e9b9700 1 --2- 172.21.15.103:0/980812935 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c180ac950 0x7f3c180666f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:44.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.327+0000 7f3c1e9b9700 1 -- 172.21.15.103:0/980812935 >> v1:172.21.15.103:6789/0 conn(0x7f3c180b9140 legacy=0x7f3c18065760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:44.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.327+0000 7f3c077fe700 1 -- 172.21.15.103:0/980812935 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1078490682 0 0) 0x7f3c18065e70 con 0x7f3c180b9140 2020-04-22T14:02:44.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.327+0000 7f3c1e9b9700 1 -- 172.21.15.103:0/980812935 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c18143630 con 0x7f3c1812b670 2020-04-22T14:02:44.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.327+0000 7f3c1e1b8700 1 --2- 172.21.15.103:0/980812935 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c180ac950 0x7f3c180666f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:02:44.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.327+0000 7f3c1e9b9700 1 --2- 172.21.15.103:0/980812935 >> v2:172.21.15.103:3300/0 conn(0x7f3c1812b670 0x7f3c181545d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3c18060f70 tx=0x7f3c10007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.327+0000 7f3c1e9b9700 1 --2- 172.21.15.103:0/980812935 >> v2:172.21.15.103:3300/0 conn(0x7f3c1812b670 0x7f3c181545d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3c18060f70 tx=0x7f3c10007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.327+0000 7f3c1e9b9700 1 --2- 172.21.15.103:0/980812935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c1812b670 0x7f3c181545d0 secure :-1 s=READY pgs=201 cs=0 l=1 rx=0x7f3c18060f70 tx=0x7f3c10007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:44.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.327+0000 7f3c1e9b9700 1 --2- 172.21.15.103:0/980812935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c1812b670 0x7f3c181545d0 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7f3c18060f70 tx=0x7f3c10007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.327+0000 7f3c077fe700 1 -- 172.21.15.103:0/980812935 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c100115c0 con 0x7f3c1812b670 2020-04-22T14:02:44.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.327+0000 7f3c1e9b9700 1 --2- 172.21.15.103:0/980812935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c1812b670 0x7f3c181545d0 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7f3c18060f70 tx=0x7f3c10007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.327+0000 7f3c1e9b9700 1 --2- 172.21.15.103:0/980812935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c1812b670 0x7f3c181545d0 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7f3c18060f70 tx=0x7f3c10007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.327+0000 7f3c077fe700 1 -- 172.21.15.103:0/980812935 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c10005a40 con 0x7f3c1812b670 2020-04-22T14:02:44.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.327+0000 7f3c2041c700 1 -- 172.21.15.103:0/980812935 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c180aea00 con 0x7f3c1812b670 2020-04-22T14:02:44.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.327+0000 7f3c077fe700 1 -- 172.21.15.103:0/980812935 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c10005da0 con 0x7f3c1812b670 2020-04-22T14:02:44.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.327+0000 7f3c2041c700 1 -- 172.21.15.103:0/980812935 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c18127be0 con 0x7f3c1812b670 2020-04-22T14:02:44.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.328+0000 7f3c1e9b9700 1 --2- 172.21.15.103:0/980812935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c1812b670 0x7f3c181545d0 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7f3c18060f70 tx=0x7f3c10007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.328+0000 7f3c077fe700 1 -- 172.21.15.103:0/980812935 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f3c10010700 con 0x7f3c1812b670 2020-04-22T14:02:44.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.328+0000 7f3c1e9b9700 1 --2- 172.21.15.103:0/980812935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c1812b670 0x7f3c181545d0 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7f3c18060f70 tx=0x7f3c10007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.329+0000 7f3c077fe700 1 --2- 172.21.15.103:0/980812935 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3bf804d8f0 0x7f3bf804fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:44.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.329+0000 7f3c2041c700 1 -- 172.21.15.103:0/980812935 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c18064e50 con 0x7f3c1812b670 2020-04-22T14:02:44.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.329+0000 7f3c077fe700 1 -- 172.21.15.103:0/980812935 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3c100645c0 con 0x7f3c1812b670 2020-04-22T14:02:44.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.329+0000 7f3c1e1b8700 1 --2- 172.21.15.103:0/980812935 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3bf804d8f0 0x7f3bf804fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:44.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.329+0000 7f3c1e1b8700 1 --2- 172.21.15.103:0/980812935 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3bf804d8f0 0x7f3bf804fdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3c08002f30 tx=0x7f3c08007ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.329+0000 7f3c1e1b8700 1 --2- 172.21.15.103:0/980812935 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3bf804d8f0 0x7f3bf804fdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3c08002f30 tx=0x7f3c08007ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.329+0000 7f3c1e1b8700 1 --2- 172.21.15.103:0/980812935 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3bf804d8f0 0x7f3bf804fdb0 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7f3c08002f30 tx=0x7f3c08007ea0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:44.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.333+0000 7f3c1e9b9700 1 --2- 172.21.15.103:0/980812935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c1812b670 0x7f3c181545d0 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7f3c18060f70 tx=0x7f3c10007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.333+0000 7f3c077fe700 1 -- 172.21.15.103:0/980812935 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f3c1003fac0 con 0x7f3c1812b670 2020-04-22T14:02:44.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.476+0000 7f3c2041c700 1 -- 172.21.15.103:0/980812935 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3c18056c90 con 0x7f3c1812b670 2020-04-22T14:02:44.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.476+0000 7f3c1e9b9700 1 --2- 172.21.15.103:0/980812935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c1812b670 0x7f3c181545d0 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7f3c18060f70 tx=0x7f3c10007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.476+0000 7f3c077fe700 1 -- 172.21.15.103:0/980812935 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7f3c100430e0 con 0x7f3c1812b670 2020-04-22T14:02:44.480 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:02:44.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.478+0000 7f3c2041c700 1 -- 172.21.15.103:0/980812935 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3bf804d8f0 msgr2=0x7f3bf804fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:44.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.478+0000 7f3c2041c700 1 --2- 172.21.15.103:0/980812935 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3bf804d8f0 0x7f3bf804fdb0 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7f3c08002f30 tx=0x7f3c08007ea0).stop 2020-04-22T14:02:44.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.478+0000 7f3c2041c700 1 -- 172.21.15.103:0/980812935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c1812b670 msgr2=0x7f3c181545d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:44.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.478+0000 7f3c2041c700 1 --2- 172.21.15.103:0/980812935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c1812b670 0x7f3c181545d0 secure :-1 s=READY pgs=201 cs=0 l=1 rx=0x7f3c18060f70 tx=0x7f3c10007dc0).stop 2020-04-22T14:02:44.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.478+0000 7f3c2041c700 1 -- 172.21.15.103:0/980812935 shutdown_connections 2020-04-22T14:02:44.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.478+0000 7f3c2041c700 1 --2- 172.21.15.103:0/980812935 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3bf804d8f0 0x7f3bf804fdb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:44.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.478+0000 7f3c2041c700 1 --2- 172.21.15.103:0/980812935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c1812b670 0x7f3c181545d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:44.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.478+0000 7f3c2041c700 1 --2- 172.21.15.103:0/980812935 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c180ac950 0x7f3c180666f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:44.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.478+0000 7f3c2041c700 1 -- 172.21.15.103:0/980812935 >> 172.21.15.103:0/980812935 conn(0x7f3c1805b7b0 msgr2=0x7f3c180b5060 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:44.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.478+0000 7f3c2041c700 1 -- 172.21.15.103:0/980812935 shutdown_connections 2020-04-22T14:02:44.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.478+0000 7f3c2041c700 1 -- 172.21.15.103:0/980812935 wait complete. 2020-04-22T14:02:44.491 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-04-22T14:02:44.492 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:44.506 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:02:44.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.650+0000 7f8e9ee3b700 1 Processor -- start 2020-04-22T14:02:44.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.650+0000 7f8e9ee3b700 1 -- start start 2020-04-22T14:02:44.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.650+0000 7f8e9ee3b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8e98065fe0 0x7f8e981464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:44.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.650+0000 7f8e9ee3b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8e98063e30 0x7f8e980642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:44.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.650+0000 7f8e9ee3b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e98143300 con 0x7f8e9812c0d0 2020-04-22T14:02:44.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.650+0000 7f8e9ee3b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e981435a0 con 0x7f8e98065fe0 2020-04-22T14:02:44.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.650+0000 7f8e9ee3b700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e98143840 con 0x7f8e98063e30 2020-04-22T14:02:44.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.651+0000 7f8e9d3d8700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8e98063e30 0x7f8e980642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:44.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.651+0000 7f8e9d3d8700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8e98063e30 0x7f8e980642c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47636/0 (socket says 172.21.15.103:47636) 2020-04-22T14:02:44.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.651+0000 7f8e9d3d8700 1 -- 172.21.15.103:0/3139738345 learned_addr learned my addr 172.21.15.103:0/3139738345 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:44.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.651+0000 7f8e8ffff700 1 --2- 172.21.15.103:0/3139738345 >> v2:172.21.15.86:3300/0 conn(0x7f8e98065fe0 0x7f8e981464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:44.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.651+0000 7f8e9d3d8700 1 -- 172.21.15.103:0/3139738345 >> v2:172.21.15.86:3300/0 conn(0x7f8e98065fe0 msgr2=0x7f8e981464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:44.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.651+0000 7f8e9d3d8700 1 --2- 172.21.15.103:0/3139738345 >> v2:172.21.15.86:3300/0 conn(0x7f8e98065fe0 0x7f8e981464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:44.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.651+0000 7f8e9d3d8700 1 -- 172.21.15.103:0/3139738345 >> v1:172.21.15.86:6789/0 conn(0x7f8e9812c0d0 legacy=0x7f8e9805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:44.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.651+0000 7f8e9d3d8700 1 -- 172.21.15.103:0/3139738345 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9805bb50 con 0x7f8e98063e30 2020-04-22T14:02:44.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.651+0000 7f8e9d3d8700 1 --2- 172.21.15.103:0/3139738345 >> v2:172.21.15.103:3300/0 conn(0x7f8e98063e30 0x7f8e980642c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8e980669a0 tx=0x7f8e90007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.651+0000 7f8e9d3d8700 1 --2- 172.21.15.103:0/3139738345 >> v2:172.21.15.103:3300/0 conn(0x7f8e98063e30 0x7f8e980642c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8e980669a0 tx=0x7f8e90007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.651+0000 7f8e9d3d8700 1 --2- 172.21.15.103:0/3139738345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e98063e30 0x7f8e980642c0 secure :-1 s=READY pgs=202 cs=0 l=1 rx=0x7f8e980669a0 tx=0x7f8e90007dc0).ready entity=mon.1 client_cookie=56de7804f3bb238 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:44.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.651+0000 7f8e9d3d8700 1 --2- 172.21.15.103:0/3139738345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e98063e30 0x7f8e980642c0 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7f8e980669a0 tx=0x7f8e90007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.651+0000 7f8e9d3d8700 1 --2- 172.21.15.103:0/3139738345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e98063e30 0x7f8e980642c0 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7f8e980669a0 tx=0x7f8e90007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.651+0000 7f8e8f7fe700 1 -- 172.21.15.103:0/3139738345 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e9000a180 con 0x7f8e98063e30 2020-04-22T14:02:44.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.651+0000 7f8e9d3d8700 1 --2- 172.21.15.103:0/3139738345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e98063e30 0x7f8e980642c0 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7f8e980669a0 tx=0x7f8e90007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.651+0000 7f8e8f7fe700 1 -- 172.21.15.103:0/3139738345 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9000a2e0 con 0x7f8e98063e30 2020-04-22T14:02:44.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.651+0000 7f8e8f7fe700 1 -- 172.21.15.103:0/3139738345 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e9000a6c0 con 0x7f8e98063e30 2020-04-22T14:02:44.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.651+0000 7f8e9ee3b700 1 -- 172.21.15.103:0/3139738345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e98063e30 msgr2=0x7f8e980642c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:44.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.651+0000 7f8e9ee3b700 1 --2- 172.21.15.103:0/3139738345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e98063e30 0x7f8e980642c0 secure :-1 s=READY pgs=202 cs=0 l=1 rx=0x7f8e980669a0 tx=0x7f8e90007dc0).stop 2020-04-22T14:02:44.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.652+0000 7f8e9ee3b700 1 -- 172.21.15.103:0/3139738345 shutdown_connections 2020-04-22T14:02:44.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.652+0000 7f8e9ee3b700 1 --2- 172.21.15.103:0/3139738345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e98063e30 0x7f8e980642c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:44.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.652+0000 7f8e9ee3b700 1 --2- 172.21.15.103:0/3139738345 >> v2:172.21.15.86:3300/0 conn(0x7f8e98065fe0 0x7f8e981464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:44.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.652+0000 7f8e9ee3b700 1 -- 172.21.15.103:0/3139738345 >> 172.21.15.103:0/3139738345 conn(0x7f8e980b9160 msgr2=0x7f8e9805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:44.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.652+0000 7f8e9ee3b700 1 -- 172.21.15.103:0/3139738345 shutdown_connections 2020-04-22T14:02:44.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.652+0000 7f8e9ee3b700 1 -- 172.21.15.103:0/3139738345 wait complete. 2020-04-22T14:02:44.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.653+0000 7f8e9ee3b700 1 Processor -- start 2020-04-22T14:02:44.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.653+0000 7f8e9ee3b700 1 -- start start 2020-04-22T14:02:44.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.653+0000 7f8e9ee3b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8e9812c0d0 0x7f8e980b3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:44.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.653+0000 7f8e9ee3b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e980b1c50 con 0x7f8e98065fe0 2020-04-22T14:02:44.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.653+0000 7f8e9ee3b700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e980b1ef0 con 0x7f8e98063e30 2020-04-22T14:02:44.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.653+0000 7f8e9ee3b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e980b1a60 con 0x7f8e9812c0d0 2020-04-22T14:02:44.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.654+0000 7f8e9cbd7700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f8e98063e30 0x7f8e98129800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39828/0 (socket says 172.21.15.103:39828) 2020-04-22T14:02:44.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.654+0000 7f8e9cbd7700 1 -- 172.21.15.103:0/3778291556 learned_addr learned my addr 172.21.15.103:0/3778291556 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:44.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.654+0000 7f8e9d3d8700 1 --2- 172.21.15.103:0/3778291556 >> v2:172.21.15.86:3300/0 conn(0x7f8e9812c0d0 0x7f8e980b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:44.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.654+0000 7f8e8dffb700 1 -- 172.21.15.103:0/3778291556 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 979633120 0 0) 0x7f8e980b1ef0 con 0x7f8e98063e30 2020-04-22T14:02:44.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.654+0000 7f8e8dffb700 1 -- 172.21.15.103:0/3778291556 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e78002fe0 con 0x7f8e98063e30 2020-04-22T14:02:44.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.654+0000 7f8e8dffb700 1 -- 172.21.15.103:0/3778291556 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4089650929 0 0) 0x7f8e78002fe0 con 0x7f8e98063e30 2020-04-22T14:02:44.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.654+0000 7f8e9d3d8700 1 -- 172.21.15.103:0/3778291556 >> v1:172.21.15.103:6789/0 conn(0x7f8e98063e30 legacy=0x7f8e98129800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:44.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.654+0000 7f8e9d3d8700 1 -- 172.21.15.103:0/3778291556 >> v1:172.21.15.86:6789/0 conn(0x7f8e98065fe0 legacy=0x7f8e9812a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:44.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.654+0000 7f8e9d3d8700 1 -- 172.21.15.103:0/3778291556 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e980b2190 con 0x7f8e9812c0d0 2020-04-22T14:02:44.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.654+0000 7f8e9d3d8700 1 --2- 172.21.15.103:0/3778291556 >> v2:172.21.15.86:3300/0 conn(0x7f8e9812c0d0 0x7f8e980b3640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8e88007720 tx=0x7f8e90007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.654+0000 7f8e9d3d8700 1 --2- 172.21.15.103:0/3778291556 >> v2:172.21.15.86:3300/0 conn(0x7f8e9812c0d0 0x7f8e980b3640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8e88007720 tx=0x7f8e90007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.654+0000 7f8e9d3d8700 1 --2- 172.21.15.103:0/3778291556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e9812c0d0 0x7f8e980b3640 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7f8e88007720 tx=0x7f8e90007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:44.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.654+0000 7f8e9d3d8700 1 --2- 172.21.15.103:0/3778291556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e9812c0d0 0x7f8e980b3640 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f8e88007720 tx=0x7f8e90007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.654+0000 7f8e8dffb700 1 -- 172.21.15.103:0/3778291556 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e94002910 con 0x7f8e9812c0d0 2020-04-22T14:02:44.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.654+0000 7f8e9d3d8700 1 --2- 172.21.15.103:0/3778291556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e9812c0d0 0x7f8e980b3640 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f8e88007720 tx=0x7f8e90007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.654+0000 7f8e8dffb700 1 -- 172.21.15.103:0/3778291556 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9000a730 con 0x7f8e9812c0d0 2020-04-22T14:02:44.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.654+0000 7f8e9d3d8700 1 --2- 172.21.15.103:0/3778291556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e9812c0d0 0x7f8e980b3640 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f8e88007720 tx=0x7f8e90007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.654+0000 7f8e9ee3b700 1 -- 172.21.15.103:0/3778291556 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e9812aa10 con 0x7f8e9812c0d0 2020-04-22T14:02:44.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.654+0000 7f8e8dffb700 1 -- 172.21.15.103:0/3778291556 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e90005c30 con 0x7f8e9812c0d0 2020-04-22T14:02:44.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.654+0000 7f8e9ee3b700 1 -- 172.21.15.103:0/3778291556 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e98153a30 con 0x7f8e9812c0d0 2020-04-22T14:02:44.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.655+0000 7f8e9d3d8700 1 --2- 172.21.15.103:0/3778291556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e9812c0d0 0x7f8e980b3640 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f8e88007720 tx=0x7f8e90007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.655+0000 7f8e9ee3b700 1 -- 172.21.15.103:0/3778291556 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e98153f00 con 0x7f8e9812c0d0 2020-04-22T14:02:44.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.655+0000 7f8e8dffb700 1 -- 172.21.15.103:0/3778291556 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f8e900110d0 con 0x7f8e9812c0d0 2020-04-22T14:02:44.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.655+0000 7f8e9d3d8700 1 --2- 172.21.15.103:0/3778291556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e9812c0d0 0x7f8e980b3640 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f8e88007720 tx=0x7f8e90007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.656+0000 7f8e8dffb700 1 --2- 172.21.15.103:0/3778291556 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8e7804dc80 0x7f8e78050140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:44.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.656+0000 7f8e8dffb700 1 -- 172.21.15.103:0/3778291556 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8e900618f0 con 0x7f8e9812c0d0 2020-04-22T14:02:44.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.656+0000 7f8e9cbd7700 1 --2- 172.21.15.103:0/3778291556 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8e7804dc80 0x7f8e78050140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:44.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.656+0000 7f8e9cbd7700 1 --2- 172.21.15.103:0/3778291556 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8e7804dc80 0x7f8e78050140 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8e94002a70 tx=0x7f8e94009d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.656+0000 7f8e9cbd7700 1 --2- 172.21.15.103:0/3778291556 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8e7804dc80 0x7f8e78050140 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8e94002a70 tx=0x7f8e94009d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.656+0000 7f8e9cbd7700 1 --2- 172.21.15.103:0/3778291556 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8e7804dc80 0x7f8e78050140 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7f8e94002a70 tx=0x7f8e94009d60).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:44.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.659+0000 7f8e9d3d8700 1 --2- 172.21.15.103:0/3778291556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e9812c0d0 0x7f8e980b3640 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f8e88007720 tx=0x7f8e90007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.659+0000 7f8e8dffb700 1 -- 172.21.15.103:0/3778291556 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f8e98153f00 con 0x7f8e9812c0d0 2020-04-22T14:02:44.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.850+0000 7f8e9ee3b700 1 -- 172.21.15.103:0/3778291556 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e98153f00 con 0x7f8e9812c0d0 2020-04-22T14:02:44.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.852+0000 7f8e9d3d8700 1 --2- 172.21.15.103:0/3778291556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e9812c0d0 0x7f8e980b3640 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f8e88007720 tx=0x7f8e90007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:44.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.852+0000 7f8e8dffb700 1 -- 172.21.15.103:0/3778291556 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2137 (secure 0 0 0) 0x7f8e98153f00 con 0x7f8e9812c0d0 2020-04-22T14:02:44.855 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:02:44.855 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/3739398122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3739398122},{"type":"v1","addr":"172.21.15.86:6835","nonce":3739398122}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":6}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:02:27.685979+0000","modified":"2020-04-22T14:02:32.276953+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4357},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4357":{"gid":4357,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.103:6833/1765986263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1765986263},{"type":"v1","addr":"172.21.15.103:6833","nonce":1765986263}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-22T14:02:44.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.852+0000 7f8e9ee3b700 1 -- 172.21.15.103:0/3778291556 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8e7804dc80 msgr2=0x7f8e78050140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:44.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.852+0000 7f8e9ee3b700 1 --2- 172.21.15.103:0/3778291556 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8e7804dc80 0x7f8e78050140 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7f8e94002a70 tx=0x7f8e94009d60).stop 2020-04-22T14:02:44.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.852+0000 7f8e9ee3b700 1 -- 172.21.15.103:0/3778291556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e9812c0d0 msgr2=0x7f8e980b3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:44.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.852+0000 7f8e9ee3b700 1 --2- 172.21.15.103:0/3778291556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e9812c0d0 0x7f8e980b3640 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7f8e88007720 tx=0x7f8e90007dc0).stop 2020-04-22T14:02:44.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.853+0000 7f8e9ee3b700 1 -- 172.21.15.103:0/3778291556 shutdown_connections 2020-04-22T14:02:44.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.853+0000 7f8e9ee3b700 1 --2- 172.21.15.103:0/3778291556 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8e7804dc80 0x7f8e78050140 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:44.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.853+0000 7f8e9ee3b700 1 --2- 172.21.15.103:0/3778291556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e9812c0d0 0x7f8e980b3640 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:44.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.853+0000 7f8e9ee3b700 1 -- 172.21.15.103:0/3778291556 >> 172.21.15.103:0/3778291556 conn(0x7f8e980b9160 msgr2=0x7f8e980b4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:44.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.853+0000 7f8e9ee3b700 1 -- 172.21.15.103:0/3778291556 shutdown_connections 2020-04-22T14:02:44.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:44.853+0000 7f8e9ee3b700 1 -- 172.21.15.103:0/3778291556 wait complete. 2020-04-22T14:02:44.858 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 6 2020-04-22T14:02:45.068 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4357}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 3, u'failed': [], u'epoch': 5, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [4], u'info': {u'gid_4357': {u'export_targets': [], u'name': u'a', u'incarnation': 4, u'state_seq': 2, u'state': u'up:active', u'gid': 4357, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 1765986263, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 1765986263, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/1765986263'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:02:27.685979+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:02:32.276953+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:02:45.069 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:02:45.069 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:45.083 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:02:45.243 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:02:45.243 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:02:45.243 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:02:45.243 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4357, 2020-04-22T14:02:45.244 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:02:45.244 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:02:45.244 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 13.969201619, 2020-04-22T14:02:45.244 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 5, 2020-04-22T14:02:45.244 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 24, 2020-04-22T14:02:45.244 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 24, 2020-04-22T14:02:45.244 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 14.675643083000001 2020-04-22T14:02:45.245 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:02:45.252 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 4357, "want_state": "up:active", "state": "up:active", "rank_uptime": 13.969201619, "mdsmap_epoch": 5, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "uptime": 14.675643083000001 } 2020-04-22T14:02:45.252 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-04-22T14:02:45.252 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2020-04-22T14:02:45.252 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:45.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:45.266 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:02:45.327 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:02:45.327 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:02:45.327 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:02:45.327 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:02:45.328 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:02:45.328 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:02:45.328 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:02:45.328 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:02:45.328 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:02:45.328 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:02:45.328 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:02:45.329 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:02:45.329 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:02:45.329 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:02:45.329 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:02:45.329 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42675sec preferred_lft 42675sec 2020-04-22T14:02:45.329 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:02:45.329 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:02:45.330 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-04-22T14:02:45.330 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:45.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:45.377 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:02:45.457 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:45.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:45.513 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge con-name ceph-brx ifname ceph-brx stp no' 2020-04-22T14:02:45.633 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' (98ad9f03-62d2-4cb3-8b6b-776130ad88fa) successfully added. 2020-04-22T14:02:45.633 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:45.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:45.657 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection modify ceph-brx ipv4.addresses 192.168.255.254/16 ipv4.method manual' 2020-04-22T14:02:45.773 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:45.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:45.791 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up ceph-brx' 2020-04-22T14:02:45.909 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (master waiting for slaves) (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/4) 2020-04-22T14:02:45.910 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:45.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:45.924 INFO:teuthology.orchestra.run.smithi103:> touch /tmp/python-ceph-brx 2020-04-22T14:02:45.992 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:46.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:46.054 INFO:teuthology.orchestra.run.smithi103:> cat /proc/sys/net/ipv4/ip_forward 2020-04-22T14:02:46.122 INFO:teuthology.orchestra.run.smithi103.stdout:0 2020-04-22T14:02:46.123 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:46.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:46.172 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 0 > /tmp/python-ceph-brx' 2020-04-22T14:02:46.252 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:46.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:46.295 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 1 > /proc/sys/net/ipv4/ip_forward' 2020-04-22T14:02:46.373 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:46.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:46.417 INFO:teuthology.orchestra.run.smithi103:> route 2020-04-22T14:02:46.528 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2020-04-22T14:02:46.528 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-04-22T14:02:46.528 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 102 0 0 enp3s0f1 2020-04-22T14:02:46.528 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 102 0 0 enp3s0f1 2020-04-22T14:02:46.528 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 425 0 0 ceph-brx 2020-04-22T14:02:46.529 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:46.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:46.549 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-04-22T14:02:46.714 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:46.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:46.731 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-04-22T14:02:46.819 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:46.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:46.857 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-04-22T14:02:47.015 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:47.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:47.031 INFO:teuthology.orchestra.run.smithi103:> ip netns list 2020-04-22T14:02:47.090 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:47.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:47.145 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:02:47.206 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:47.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:47.253 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:02:47.328 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:47.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:47.399 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0' 2020-04-22T14:02:47.477 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2020-04-22T14:02:47.477 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:47.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:47.522 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0' 2020-04-22T14:02:47.634 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:47.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:47.658 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0' 2020-04-22T14:02:47.770 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:47.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:47.785 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up' 2020-04-22T14:02:47.897 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:47.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:47.910 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up' 2020-04-22T14:02:48.010 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:48.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:48.057 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254' 2020-04-22T14:02:48.152 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:48.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:48.460 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:02:48.498 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:48.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:48.551 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge-slave con-name brx.0 ifname brx.0 master ceph-brx' 2020-04-22T14:02:48.659 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.0' (a361587c-5aa9-48c5-b1b7-1a94dc2bbca9) successfully added. 2020-04-22T14:02:48.660 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:48.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:48.689 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up brx.0' 2020-04-22T14:02:48.753 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:48.771 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:02:48.814 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:48.828 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:02:48.849 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/5) 2020-04-22T14:02:48.899 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2020-04-22T14:02:48.899 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi103.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2020-04-22T14:02:48.899 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:48.961 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:02:48.961 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:02:49.030 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:49.070 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:02:49.070 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:02:49.139 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:02:49.145 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: mount point does not exist. 2020-04-22T14:02:49.146 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:49.192 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:02:49.192 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:02:49.246 DEBUG:teuthology.orchestra.run:got remote process result: 2 2020-04-22T14:02:49.251 INFO:teuthology.orchestra.run.smithi103.stderr:ls: cannot access '/sys/fs/fuse/connections': No such file or directory 2020-04-22T14:02:49.251 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-04-22T14:02:49.251 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:49.301 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:02:49.346 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:49.360 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:02:49.361 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:02:49.430 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:02:49.438 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: mount point does not exist. 2020-04-22T14:02:49.438 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:49.454 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:2020-04-22T14:02:49.451+0000 7f78b44be1c0 -1 init, newargv = 0x559bb1377f20 newargc=9 2020-04-22T14:02:49.455 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[38250]: starting ceph client 2020-04-22T14:02:49.468 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:02:49.469 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:02:49.478 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[38250]: starting fuse 2020-04-22T14:02:50.601 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:50.619 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:02:50.619 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:02:50.709 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:50.749 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:02:50.749 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:02:50.809 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:02:50.809 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2020-04-22T14:02:50.809 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:50.863 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:02:50.863 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:02:50.863 INFO:teuthology.orchestra.run.smithi103:> import glob 2020-04-22T14:02:50.863 INFO:teuthology.orchestra.run.smithi103:> import re 2020-04-22T14:02:50.863 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:02:50.874 INFO:teuthology.orchestra.run.smithi103:> import subprocess 2020-04-22T14:02:50.874 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:02:50.874 INFO:teuthology.orchestra.run.smithi103:> def find_socket(client_name): 2020-04-22T14:02:50.874 INFO:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2020-04-22T14:02:50.874 INFO:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2020-04-22T14:02:50.874 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:02:50.874 INFO:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2020-04-22T14:02:50.875 INFO:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2020-04-22T14:02:50.875 INFO:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2020-04-22T14:02:50.875 INFO:teuthology.orchestra.run.smithi103:> return files[0] 2020-04-22T14:02:50.875 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:02:50.875 INFO:teuthology.orchestra.run.smithi103:> for f in files: 2020-04-22T14:02:50.875 INFO:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:02:50.875 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:02:50.875 INFO:teuthology.orchestra.run.smithi103:> return f 2020-04-22T14:02:50.876 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:02:50.876 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:02:50.876 INFO:teuthology.orchestra.run.smithi103:> print(find_socket("client.1")) 2020-04-22T14:02:50.876 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:02:50.971 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.1.38250.asok 2020-04-22T14:02:51.025 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.38250.asok 2020-04-22T14:02:51.025 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:51.042 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:02:51.043 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.38250.asok status 2020-04-22T14:02:51.203 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:02:51.203 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2020-04-22T14:02:51.203 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:02:51.203 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:02:51.203 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "1", 2020-04-22T14:02:51.204 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:02:51.204 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2020-04-22T14:02:51.204 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "38250", 2020-04-22T14:02:51.204 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:02:51.205 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:02:51.205 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2020-04-22T14:02:51.205 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2020-04-22T14:02:51.205 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4678, 2020-04-22T14:02:51.205 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2020-04-22T14:02:51.205 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:02:51.205 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:02:51.206 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4678 2020-04-22T14:02:51.206 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:02:51.206 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:02:51.206 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:02:51.206 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:02:51.206 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 2814567221 2020-04-22T14:02:51.207 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:02:51.207 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:02:51.207 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:02:51.207 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:02:51.208 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:02:51.208 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 2814567221 2020-04-22T14:02:51.208 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:02:51.208 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.4678 192.168.0.1:0/2814567221", 2020-04-22T14:02:51.208 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.1:0/2814567221", 2020-04-22T14:02:51.209 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2020-04-22T14:02:51.209 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 5, 2020-04-22T14:02:51.209 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 24, 2020-04-22T14:02:51.209 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2020-04-22T14:02:51.209 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklisted": false 2020-04-22T14:02:51.209 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:02:51.210 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:51.224 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:02:51.379 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.368+0000 7f645ad9d700 1 Processor -- start 2020-04-22T14:02:51.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.368+0000 7f645ad9d700 1 -- start start 2020-04-22T14:02:51.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.369+0000 7f645ad9d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f64540ad150 0x7f64540664a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:51.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.369+0000 7f645ad9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6454141c10 0x7f6454142070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:51.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.369+0000 7f645ad9d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6454066a20 con 0x7f64541424d0 2020-04-22T14:02:51.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.369+0000 7f645ad9d700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64540adf30 con 0x7f6454141c10 2020-04-22T14:02:51.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.369+0000 7f645ad9d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64540ad7f0 con 0x7f64540ad150 2020-04-22T14:02:51.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.369+0000 7f645959a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6454141c10 0x7f6454142070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:51.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.369+0000 7f645959a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6454141c10 0x7f6454142070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47658/0 (socket says 172.21.15.103:47658) 2020-04-22T14:02:51.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.369+0000 7f645959a700 1 -- 172.21.15.103:0/594367127 learned_addr learned my addr 172.21.15.103:0/594367127 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:51.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.370+0000 7f6459d9b700 1 --2- 172.21.15.103:0/594367127 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f64540ad150 0x7f64540664a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:51.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.370+0000 7f645959a700 1 -- 172.21.15.103:0/594367127 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f64540ad150 msgr2=0x7f64540664a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:51.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.370+0000 7f645959a700 1 --2- 172.21.15.103:0/594367127 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f64540ad150 0x7f64540664a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:51.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.370+0000 7f645959a700 1 -- 172.21.15.103:0/594367127 >> v1:172.21.15.86:6789/0 conn(0x7f64541424d0 legacy=0x7f6454063340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:51.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.370+0000 7f645959a700 1 -- 172.21.15.103:0/594367127 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64540ada90 con 0x7f6454141c10 2020-04-22T14:02:51.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.370+0000 7f645959a700 1 --2- 172.21.15.103:0/594367127 >> v2:172.21.15.103:3300/0 conn(0x7f6454141c10 0x7f6454142070 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f645406a000 tx=0x7f6448007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:51.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.370+0000 7f645959a700 1 --2- 172.21.15.103:0/594367127 >> v2:172.21.15.103:3300/0 conn(0x7f6454141c10 0x7f6454142070 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f645406a000 tx=0x7f6448007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:51.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.370+0000 7f645959a700 1 --2- 172.21.15.103:0/594367127 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6454141c10 0x7f6454142070 secure :-1 s=READY pgs=207 cs=0 l=1 rx=0x7f645406a000 tx=0x7f6448007a40).ready entity=mon.1 client_cookie=fb594c3f59d9e6c server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:51.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.371+0000 7f645959a700 1 --2- 172.21.15.103:0/594367127 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6454141c10 0x7f6454142070 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7f645406a000 tx=0x7f6448007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:51.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.371+0000 7f645959a700 1 --2- 172.21.15.103:0/594367127 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6454141c10 0x7f6454142070 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7f645406a000 tx=0x7f6448007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:51.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.371+0000 7f6458d99700 1 -- 172.21.15.103:0/594367127 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64480116e0 con 0x7f6454141c10 2020-04-22T14:02:51.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.371+0000 7f645959a700 1 --2- 172.21.15.103:0/594367127 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6454141c10 0x7f6454142070 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7f645406a000 tx=0x7f6448007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:51.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.371+0000 7f6458d99700 1 -- 172.21.15.103:0/594367127 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6448011840 con 0x7f6454141c10 2020-04-22T14:02:51.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.371+0000 7f6458d99700 1 -- 172.21.15.103:0/594367127 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6448011c60 con 0x7f6454141c10 2020-04-22T14:02:51.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.371+0000 7f645ad9d700 1 -- 172.21.15.103:0/594367127 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6454141c10 msgr2=0x7f6454142070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:51.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.371+0000 7f645ad9d700 1 --2- 172.21.15.103:0/594367127 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6454141c10 0x7f6454142070 secure :-1 s=READY pgs=207 cs=0 l=1 rx=0x7f645406a000 tx=0x7f6448007a40).stop 2020-04-22T14:02:51.395 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.372+0000 7f645ad9d700 1 -- 172.21.15.103:0/594367127 shutdown_connections 2020-04-22T14:02:51.395 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.372+0000 7f645ad9d700 1 --2- 172.21.15.103:0/594367127 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f64540ad150 0x7f64540664a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:51.395 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.372+0000 7f645ad9d700 1 --2- 172.21.15.103:0/594367127 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6454141c10 0x7f6454142070 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:51.395 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.372+0000 7f645ad9d700 1 -- 172.21.15.103:0/594367127 >> 172.21.15.103:0/594367127 conn(0x7f645405b7c0 msgr2=0x7f6454061610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:51.395 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.372+0000 7f645ad9d700 1 -- 172.21.15.103:0/594367127 shutdown_connections 2020-04-22T14:02:51.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.372+0000 7f645ad9d700 1 -- 172.21.15.103:0/594367127 wait complete. 2020-04-22T14:02:51.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.373+0000 7f645ad9d700 1 Processor -- start 2020-04-22T14:02:51.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.373+0000 7f645ad9d700 1 -- start start 2020-04-22T14:02:51.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.373+0000 7f645ad9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f64540ad150 0x7f645412dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:51.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.374+0000 7f645ad9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6454141c10 0x7f64540b55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:51.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.374+0000 7f645ad9d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64540b5a20 con 0x7f64541424d0 2020-04-22T14:02:51.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.374+0000 7f645ad9d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f645412fe90 con 0x7f6454141c10 2020-04-22T14:02:51.397 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.374+0000 7f645ad9d700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6454137840 con 0x7f64540ad150 2020-04-22T14:02:51.397 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.374+0000 7f6459d9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f64540ad150 0x7f645412dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:51.397 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.374+0000 7f6459d9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f64540ad150 0x7f645412dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47664/0 (socket says 172.21.15.103:47664) 2020-04-22T14:02:51.397 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.374+0000 7f6459d9b700 1 -- 172.21.15.103:0/577435537 learned_addr learned my addr 172.21.15.103:0/577435537 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:51.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.374+0000 7f645a59c700 1 --1- 172.21.15.103:0/577435537 >> v1:172.21.15.103:6789/0 conn(0x7f64541424d0 0x7f645412f780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39858/0 (socket says 172.21.15.103:39858) 2020-04-22T14:02:51.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.374+0000 7f645959a700 1 --2- 172.21.15.103:0/577435537 >> v2:172.21.15.86:3300/0 conn(0x7f6454141c10 0x7f64540b55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:51.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.374+0000 7f6459d9b700 1 -- 172.21.15.103:0/577435537 >> v2:172.21.15.86:3300/0 conn(0x7f6454141c10 msgr2=0x7f64540b55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:51.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.374+0000 7f6459d9b700 1 --2- 172.21.15.103:0/577435537 >> v2:172.21.15.86:3300/0 conn(0x7f6454141c10 0x7f64540b55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:51.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.374+0000 7f6459d9b700 1 -- 172.21.15.103:0/577435537 >> v1:172.21.15.103:6789/0 conn(0x7f64541424d0 legacy=0x7f645412f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:51.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.374+0000 7f6459d9b700 1 -- 172.21.15.103:0/577435537 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6454133ae0 con 0x7f64540ad150 2020-04-22T14:02:51.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.374+0000 7f6446ffd700 1 -- 172.21.15.103:0/577435537 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3997102908 0 0) 0x7f644c002390 con 0x7f64541424d0 2020-04-22T14:02:51.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.374+0000 7f6459d9b700 1 --2- 172.21.15.103:0/577435537 >> v2:172.21.15.103:3300/0 conn(0x7f64540ad150 0x7f645412dc80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6450002f30 tx=0x7f6450010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:51.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.374+0000 7f6459d9b700 1 --2- 172.21.15.103:0/577435537 >> v2:172.21.15.103:3300/0 conn(0x7f64540ad150 0x7f645412dc80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6450002f30 tx=0x7f6450010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:51.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.374+0000 7f6459d9b700 1 --2- 172.21.15.103:0/577435537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64540ad150 0x7f645412dc80 secure :-1 s=READY pgs=209 cs=0 l=1 rx=0x7f6450002f30 tx=0x7f6450010c30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:51.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.374+0000 7f6459d9b700 1 --2- 172.21.15.103:0/577435537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64540ad150 0x7f645412dc80 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7f6450002f30 tx=0x7f6450010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:51.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.374+0000 7f6446ffd700 1 -- 172.21.15.103:0/577435537 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6450012aa0 con 0x7f64540ad150 2020-04-22T14:02:51.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.374+0000 7f6459d9b700 1 --2- 172.21.15.103:0/577435537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64540ad150 0x7f645412dc80 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7f6450002f30 tx=0x7f6450010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:51.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.374+0000 7f6459d9b700 1 --2- 172.21.15.103:0/577435537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64540ad150 0x7f645412dc80 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7f6450002f30 tx=0x7f6450010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:51.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.374+0000 7f6446ffd700 1 -- 172.21.15.103:0/577435537 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6450012c00 con 0x7f64540ad150 2020-04-22T14:02:51.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.374+0000 7f645ad9d700 1 -- 172.21.15.103:0/577435537 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6454133f80 con 0x7f64540ad150 2020-04-22T14:02:51.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.374+0000 7f6446ffd700 1 -- 172.21.15.103:0/577435537 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64500091c0 con 0x7f64540ad150 2020-04-22T14:02:51.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.374+0000 7f645ad9d700 1 -- 172.21.15.103:0/577435537 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6454134270 con 0x7f64540ad150 2020-04-22T14:02:51.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.375+0000 7f6459d9b700 1 --2- 172.21.15.103:0/577435537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64540ad150 0x7f645412dc80 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7f6450002f30 tx=0x7f6450010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:51.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.375+0000 7f6446ffd700 1 -- 172.21.15.103:0/577435537 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f6450007190 con 0x7f64540ad150 2020-04-22T14:02:51.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.375+0000 7f6459d9b700 1 --2- 172.21.15.103:0/577435537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64540ad150 0x7f645412dc80 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7f6450002f30 tx=0x7f6450010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:51.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.375+0000 7f645ad9d700 1 -- 172.21.15.103:0/577435537 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6454056c90 con 0x7f64540ad150 2020-04-22T14:02:51.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.376+0000 7f6446ffd700 1 --2- 172.21.15.103:0/577435537 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f643404d900 0x7f643404fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:51.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.376+0000 7f6446ffd700 1 -- 172.21.15.103:0/577435537 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6450061920 con 0x7f64540ad150 2020-04-22T14:02:51.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.376+0000 7f645959a700 1 --2- 172.21.15.103:0/577435537 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f643404d900 0x7f643404fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:51.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.376+0000 7f645959a700 1 --2- 172.21.15.103:0/577435537 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f643404d900 0x7f643404fdc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f645406a000 tx=0x7f6448007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:51.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.376+0000 7f645959a700 1 --2- 172.21.15.103:0/577435537 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f643404d900 0x7f643404fdc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f645406a000 tx=0x7f6448007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:51.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.376+0000 7f645959a700 1 --2- 172.21.15.103:0/577435537 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f643404d900 0x7f643404fdc0 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f645406a000 tx=0x7f6448007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:51.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.380+0000 7f6459d9b700 1 --2- 172.21.15.103:0/577435537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64540ad150 0x7f645412dc80 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7f6450002f30 tx=0x7f6450010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:51.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.380+0000 7f6446ffd700 1 -- 172.21.15.103:0/577435537 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f645003cca0 con 0x7f64540ad150 2020-04-22T14:02:51.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.523+0000 7f645ad9d700 1 -- 172.21.15.103:0/577435537 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6454137980 con 0x7f64540ad150 2020-04-22T14:02:51.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.524+0000 7f6459d9b700 1 --2- 172.21.15.103:0/577435537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64540ad150 0x7f645412dc80 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7f6450002f30 tx=0x7f6450010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:51.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.524+0000 7f6446ffd700 1 -- 172.21.15.103:0/577435537 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f64500402c0 con 0x7f64540ad150 2020-04-22T14:02:51.528 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:02:51.529 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":24,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:02:28.687155+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:02:25.963043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-22T14:02:26.642611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:02:51.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.525+0000 7f645ad9d700 1 -- 172.21.15.103:0/577435537 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f643404d900 msgr2=0x7f643404fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:51.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.525+0000 7f645ad9d700 1 --2- 172.21.15.103:0/577435537 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f643404d900 0x7f643404fdc0 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f645406a000 tx=0x7f6448007a40).stop 2020-04-22T14:02:51.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.525+0000 7f645ad9d700 1 -- 172.21.15.103:0/577435537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64540ad150 msgr2=0x7f645412dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:51.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.525+0000 7f645ad9d700 1 --2- 172.21.15.103:0/577435537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64540ad150 0x7f645412dc80 secure :-1 s=READY pgs=209 cs=0 l=1 rx=0x7f6450002f30 tx=0x7f6450010c30).stop 2020-04-22T14:02:51.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.525+0000 7f645ad9d700 1 -- 172.21.15.103:0/577435537 shutdown_connections 2020-04-22T14:02:51.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.525+0000 7f645ad9d700 1 --2- 172.21.15.103:0/577435537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64540ad150 0x7f645412dc80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:51.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.525+0000 7f645ad9d700 1 --2- 172.21.15.103:0/577435537 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f643404d900 0x7f643404fdc0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:51.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.525+0000 7f645ad9d700 1 --2- 172.21.15.103:0/577435537 >> v2:172.21.15.86:3300/0 conn(0x7f6454141c10 0x7f64540b55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:51.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.525+0000 7f645ad9d700 1 -- 172.21.15.103:0/577435537 >> 172.21.15.103:0/577435537 conn(0x7f645405b7c0 msgr2=0x7f64540b67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:51.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.525+0000 7f645ad9d700 1 -- 172.21.15.103:0/577435537 shutdown_connections 2020-04-22T14:02:51.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.525+0000 7f645ad9d700 1 -- 172.21.15.103:0/577435537 wait complete. 2020-04-22T14:02:51.539 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:25.963043+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:26.642611+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 4, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'24', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:02:51.540 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:51.555 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:02:51.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.700+0000 7ff1451fd700 1 Processor -- start 2020-04-22T14:02:51.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.700+0000 7ff1451fd700 1 -- start start 2020-04-22T14:02:51.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.701+0000 7ff1451fd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff1400b6560 0x7ff140066b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:51.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.701+0000 7ff1451fd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff1400ac860 0x7ff1401478d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:51.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.701+0000 7ff1451fd700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff140148050 con 0x7ff1400ad110 2020-04-22T14:02:51.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.701+0000 7ff1451fd700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1401482f0 con 0x7ff1400b6560 2020-04-22T14:02:51.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.701+0000 7ff1451fd700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff140148590 con 0x7ff1400ac860 2020-04-22T14:02:51.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.701+0000 7ff13ed9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff1400b6560 0x7ff140066b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:51.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.701+0000 7ff13ed9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff1400b6560 0x7ff140066b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47672/0 (socket says 172.21.15.103:47672) 2020-04-22T14:02:51.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.701+0000 7ff13ed9d700 1 -- 172.21.15.103:0/1966170033 learned_addr learned my addr 172.21.15.103:0/1966170033 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:51.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.702+0000 7ff13e59c700 1 --2- 172.21.15.103:0/1966170033 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff1400ac860 0x7ff1401478d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:51.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.702+0000 7ff13ed9d700 1 -- 172.21.15.103:0/1966170033 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff1400ac860 msgr2=0x7ff1401478d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:51.714 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.702+0000 7ff13ed9d700 1 --2- 172.21.15.103:0/1966170033 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff1400ac860 0x7ff1401478d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:51.714 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.702+0000 7ff13ed9d700 1 -- 172.21.15.103:0/1966170033 >> v1:172.21.15.86:6789/0 conn(0x7ff1400ad110 legacy=0x7ff14013da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:51.714 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.702+0000 7ff13ed9d700 1 -- 172.21.15.103:0/1966170033 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1400b6940 con 0x7ff1400b6560 2020-04-22T14:02:51.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.702+0000 7ff13e59c700 1 --2- 172.21.15.103:0/1966170033 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff1400ac860 0x7ff1401478d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:02:51.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.702+0000 7ff13ed9d700 1 --2- 172.21.15.103:0/1966170033 >> v2:172.21.15.103:3300/0 conn(0x7ff1400b6560 0x7ff140066b80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff138002f30 tx=0x7ff138007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:51.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.702+0000 7ff13ed9d700 1 --2- 172.21.15.103:0/1966170033 >> v2:172.21.15.103:3300/0 conn(0x7ff1400b6560 0x7ff140066b80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff138002f30 tx=0x7ff138007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:51.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.702+0000 7ff13ed9d700 1 --2- 172.21.15.103:0/1966170033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1400b6560 0x7ff140066b80 secure :-1 s=READY pgs=210 cs=0 l=1 rx=0x7ff138002f30 tx=0x7ff138007a40).ready entity=mon.1 client_cookie=7cdebb13121ed678 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:51.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.702+0000 7ff13ed9d700 1 --2- 172.21.15.103:0/1966170033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1400b6560 0x7ff140066b80 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7ff138002f30 tx=0x7ff138007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:51.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.702+0000 7ff13dd9b700 1 -- 172.21.15.103:0/1966170033 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff138011720 con 0x7ff1400b6560 2020-04-22T14:02:51.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.702+0000 7ff13ed9d700 1 --2- 172.21.15.103:0/1966170033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1400b6560 0x7ff140066b80 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7ff138002f30 tx=0x7ff138007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:51.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.702+0000 7ff13dd9b700 1 -- 172.21.15.103:0/1966170033 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1380118c0 con 0x7ff1400b6560 2020-04-22T14:02:51.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.702+0000 7ff13ed9d700 1 --2- 172.21.15.103:0/1966170033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1400b6560 0x7ff140066b80 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7ff138002f30 tx=0x7ff138007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:51.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.702+0000 7ff13dd9b700 1 -- 172.21.15.103:0/1966170033 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff138011ce0 con 0x7ff1400b6560 2020-04-22T14:02:51.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.702+0000 7ff1451fd700 1 -- 172.21.15.103:0/1966170033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1400b6560 msgr2=0x7ff140066b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:51.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.702+0000 7ff1451fd700 1 --2- 172.21.15.103:0/1966170033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1400b6560 0x7ff140066b80 secure :-1 s=READY pgs=210 cs=0 l=1 rx=0x7ff138002f30 tx=0x7ff138007a40).stop 2020-04-22T14:02:51.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.703+0000 7ff1451fd700 1 -- 172.21.15.103:0/1966170033 shutdown_connections 2020-04-22T14:02:51.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.703+0000 7ff1451fd700 1 --2- 172.21.15.103:0/1966170033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1400b6560 0x7ff140066b80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:51.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.703+0000 7ff1451fd700 1 --2- 172.21.15.103:0/1966170033 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff1400ac860 0x7ff1401478d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:51.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.703+0000 7ff1451fd700 1 -- 172.21.15.103:0/1966170033 >> 172.21.15.103:0/1966170033 conn(0x7ff1400610c0 msgr2=0x7ff14005f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:51.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.703+0000 7ff1451fd700 1 -- 172.21.15.103:0/1966170033 shutdown_connections 2020-04-22T14:02:51.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.703+0000 7ff1451fd700 1 -- 172.21.15.103:0/1966170033 wait complete. 2020-04-22T14:02:51.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.704+0000 7ff1451fd700 1 Processor -- start 2020-04-22T14:02:51.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.704+0000 7ff1451fd700 1 -- start start 2020-04-22T14:02:51.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.704+0000 7ff1451fd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff1401437a0 0x7ff1400627e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:51.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.704+0000 7ff1451fd700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff140157c70 con 0x7ff1400b6560 2020-04-22T14:02:51.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.704+0000 7ff1451fd700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff140157f10 con 0x7ff1400ad110 2020-04-22T14:02:51.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.704+0000 7ff1451fd700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff140064b80 con 0x7ff1401437a0 2020-04-22T14:02:51.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.704+0000 7ff13ed9d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff1400ad110 0x7ff140143090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39868/0 (socket says 172.21.15.103:39868) 2020-04-22T14:02:51.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.704+0000 7ff13ed9d700 1 -- 172.21.15.103:0/3643656135 learned_addr learned my addr 172.21.15.103:0/3643656135 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:51.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.704+0000 7ff13f59e700 1 --2- 172.21.15.103:0/3643656135 >> v2:172.21.15.103:3300/0 conn(0x7ff1401437a0 0x7ff1400627e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:51.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.705+0000 7ff12ffff700 1 -- 172.21.15.103:0/3643656135 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1355108209 0 0) 0x7ff140157f10 con 0x7ff1400ad110 2020-04-22T14:02:51.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.705+0000 7ff12ffff700 1 -- 172.21.15.103:0/3643656135 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff11c002fe0 con 0x7ff1400ad110 2020-04-22T14:02:51.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.705+0000 7ff13f59e700 1 -- 172.21.15.103:0/3643656135 >> v1:172.21.15.103:6789/0 conn(0x7ff1400ad110 legacy=0x7ff140143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:51.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.705+0000 7ff13f59e700 1 -- 172.21.15.103:0/3643656135 >> v1:172.21.15.86:6789/0 conn(0x7ff1400b6560 legacy=0x7ff140065090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:51.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.705+0000 7ff13f59e700 1 -- 172.21.15.103:0/3643656135 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff140062f60 con 0x7ff1401437a0 2020-04-22T14:02:51.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.705+0000 7ff13f59e700 1 --2- 172.21.15.103:0/3643656135 >> v2:172.21.15.103:3300/0 conn(0x7ff1401437a0 0x7ff1400627e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff14005be00 tx=0x7ff130010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:51.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.705+0000 7ff13f59e700 1 --2- 172.21.15.103:0/3643656135 >> v2:172.21.15.103:3300/0 conn(0x7ff1401437a0 0x7ff1400627e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff14005be00 tx=0x7ff130010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:51.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.705+0000 7ff13f59e700 1 --2- 172.21.15.103:0/3643656135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1401437a0 0x7ff1400627e0 secure :-1 s=READY pgs=212 cs=0 l=1 rx=0x7ff14005be00 tx=0x7ff130010820).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:51.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.705+0000 7ff13f59e700 1 --2- 172.21.15.103:0/3643656135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1401437a0 0x7ff1400627e0 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7ff14005be00 tx=0x7ff130010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:51.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.705+0000 7ff12ffff700 1 -- 172.21.15.103:0/3643656135 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff130006bc0 con 0x7ff1401437a0 2020-04-22T14:02:51.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.705+0000 7ff13f59e700 1 --2- 172.21.15.103:0/3643656135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1401437a0 0x7ff1400627e0 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7ff14005be00 tx=0x7ff130010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:51.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.705+0000 7ff13f59e700 1 --2- 172.21.15.103:0/3643656135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1401437a0 0x7ff1400627e0 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7ff14005be00 tx=0x7ff130010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:51.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.705+0000 7ff12ffff700 1 -- 172.21.15.103:0/3643656135 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff130006d60 con 0x7ff1401437a0 2020-04-22T14:02:51.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.705+0000 7ff1451fd700 1 -- 172.21.15.103:0/3643656135 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff140063210 con 0x7ff1401437a0 2020-04-22T14:02:51.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.705+0000 7ff12ffff700 1 -- 172.21.15.103:0/3643656135 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff130011040 con 0x7ff1401437a0 2020-04-22T14:02:51.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.705+0000 7ff1451fd700 1 -- 172.21.15.103:0/3643656135 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1400b18c0 con 0x7ff1401437a0 2020-04-22T14:02:51.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.706+0000 7ff13f59e700 1 --2- 172.21.15.103:0/3643656135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1401437a0 0x7ff1400627e0 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7ff14005be00 tx=0x7ff130010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:51.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.706+0000 7ff1451fd700 1 -- 172.21.15.103:0/3643656135 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff140056c90 con 0x7ff1401437a0 2020-04-22T14:02:51.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.706+0000 7ff12ffff700 1 -- 172.21.15.103:0/3643656135 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ff1300111a0 con 0x7ff1401437a0 2020-04-22T14:02:51.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.706+0000 7ff13f59e700 1 --2- 172.21.15.103:0/3643656135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1401437a0 0x7ff1400627e0 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7ff14005be00 tx=0x7ff130010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:51.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.706+0000 7ff12ffff700 1 --2- 172.21.15.103:0/3643656135 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff11c04dcf0 0x7ff11c0501b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:51.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.706+0000 7ff12ffff700 1 -- 172.21.15.103:0/3643656135 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff130061320 con 0x7ff1401437a0 2020-04-22T14:02:51.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.707+0000 7ff13ed9d700 1 --2- 172.21.15.103:0/3643656135 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff11c04dcf0 0x7ff11c0501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:51.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.707+0000 7ff13ed9d700 1 --2- 172.21.15.103:0/3643656135 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff11c04dcf0 0x7ff11c0501b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff138000b80 tx=0x7ff138007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:51.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.707+0000 7ff13ed9d700 1 --2- 172.21.15.103:0/3643656135 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff11c04dcf0 0x7ff11c0501b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff138000b80 tx=0x7ff138007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:51.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.707+0000 7ff13ed9d700 1 --2- 172.21.15.103:0/3643656135 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff11c04dcf0 0x7ff11c0501b0 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7ff138000b80 tx=0x7ff138007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:51.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.710+0000 7ff13f59e700 1 --2- 172.21.15.103:0/3643656135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1401437a0 0x7ff1400627e0 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7ff14005be00 tx=0x7ff130010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:51.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.710+0000 7ff12ffff700 1 -- 172.21.15.103:0/3643656135 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ff13003c700 con 0x7ff1401437a0 2020-04-22T14:02:51.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.851+0000 7ff1451fd700 1 -- 172.21.15.103:0/3643656135 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff1400b5fc0 con 0x7ff1401437a0 2020-04-22T14:02:51.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.852+0000 7ff13f59e700 1 --2- 172.21.15.103:0/3643656135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1401437a0 0x7ff1400627e0 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7ff14005be00 tx=0x7ff130010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:51.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.852+0000 7ff12ffff700 1 -- 172.21.15.103:0/3643656135 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v24) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff13003fd20 con 0x7ff1401437a0 2020-04-22T14:02:51.856 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:02:51.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.853+0000 7ff1451fd700 1 -- 172.21.15.103:0/3643656135 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff11c04dcf0 msgr2=0x7ff11c0501b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:51.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.853+0000 7ff1451fd700 1 --2- 172.21.15.103:0/3643656135 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff11c04dcf0 0x7ff11c0501b0 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7ff138000b80 tx=0x7ff138007a40).stop 2020-04-22T14:02:51.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.853+0000 7ff1451fd700 1 -- 172.21.15.103:0/3643656135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1401437a0 msgr2=0x7ff1400627e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:51.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.853+0000 7ff1451fd700 1 --2- 172.21.15.103:0/3643656135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1401437a0 0x7ff1400627e0 secure :-1 s=READY pgs=212 cs=0 l=1 rx=0x7ff14005be00 tx=0x7ff130010820).stop 2020-04-22T14:02:51.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.853+0000 7ff1451fd700 1 -- 172.21.15.103:0/3643656135 shutdown_connections 2020-04-22T14:02:51.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.853+0000 7ff1451fd700 1 --2- 172.21.15.103:0/3643656135 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff11c04dcf0 0x7ff11c0501b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:51.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.853+0000 7ff1451fd700 1 --2- 172.21.15.103:0/3643656135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1401437a0 0x7ff1400627e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:51.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.853+0000 7ff1451fd700 1 -- 172.21.15.103:0/3643656135 >> 172.21.15.103:0/3643656135 conn(0x7ff1400610c0 msgr2=0x7ff1400af500 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:51.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.853+0000 7ff1451fd700 1 -- 172.21.15.103:0/3643656135 shutdown_connections 2020-04-22T14:02:51.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:51.853+0000 7ff1451fd700 1 -- 172.21.15.103:0/3643656135 wait complete. 2020-04-22T14:02:51.866 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:51.880 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:02:52.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.025+0000 7fefcfed5700 1 Processor -- start 2020-04-22T14:02:52.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.026+0000 7fefcfed5700 1 -- start start 2020-04-22T14:02:52.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.026+0000 7fefcfed5700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fefc8061a30 0x7fefc80b4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:52.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.026+0000 7fefcfed5700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fefc80acb10 0x7fefc80ae920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:52.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.026+0000 7fefcfed5700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fefc80aed80 0x7fefc80b3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:52.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.026+0000 7fefcfed5700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefc8060250 con 0x7fefc8061a30 2020-04-22T14:02:52.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.026+0000 7fefcfed5700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefc80623c0 con 0x7fefc80acb10 2020-04-22T14:02:52.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.026+0000 7fefcfed5700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefc8062660 con 0x7fefc80aed80 2020-04-22T14:02:52.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.026+0000 7fefcd470700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fefc80acb10 0x7fefc80ae920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:52.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.026+0000 7fefcd470700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fefc80acb10 0x7fefc80ae920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47686/0 (socket says 172.21.15.103:47686) 2020-04-22T14:02:52.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.026+0000 7fefcd470700 1 -- 172.21.15.103:0/2077576226 learned_addr learned my addr 172.21.15.103:0/2077576226 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:52.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.027+0000 7fefce472700 1 --2- 172.21.15.103:0/2077576226 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fefc80aed80 0x7fefc80b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:52.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.027+0000 7fefcdc71700 1 --2- 172.21.15.103:0/2077576226 >> v2:172.21.15.86:3300/0 conn(0x7fefc8061a30 0x7fefc80b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:52.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.027+0000 7fefcd470700 1 -- 172.21.15.103:0/2077576226 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fefc80aed80 msgr2=0x7fefc80b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:52.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.027+0000 7fefcd470700 1 --2- 172.21.15.103:0/2077576226 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fefc80aed80 0x7fefc80b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:52.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.027+0000 7fefcd470700 1 -- 172.21.15.103:0/2077576226 >> v2:172.21.15.86:3300/0 conn(0x7fefc8061a30 msgr2=0x7fefc80b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:52.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.027+0000 7fefcd470700 1 --2- 172.21.15.103:0/2077576226 >> v2:172.21.15.86:3300/0 conn(0x7fefc8061a30 0x7fefc80b4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:52.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.027+0000 7fefcd470700 1 -- 172.21.15.103:0/2077576226 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc80acfc0 con 0x7fefc80acb10 2020-04-22T14:02:52.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.027+0000 7fefce472700 1 --2- 172.21.15.103:0/2077576226 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fefc80aed80 0x7fefc80b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:02:52.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.027+0000 7fefcd470700 1 --2- 172.21.15.103:0/2077576226 >> v2:172.21.15.103:3300/0 conn(0x7fefc80acb10 0x7fefc80ae920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fefc4002f30 tx=0x7fefc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.027+0000 7fefcd470700 1 --2- 172.21.15.103:0/2077576226 >> v2:172.21.15.103:3300/0 conn(0x7fefc80acb10 0x7fefc80ae920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fefc4002f30 tx=0x7fefc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.027+0000 7fefcd470700 1 --2- 172.21.15.103:0/2077576226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefc80acb10 0x7fefc80ae920 secure :-1 s=READY pgs=213 cs=0 l=1 rx=0x7fefc4002f30 tx=0x7fefc4007a40).ready entity=mon.1 client_cookie=cb9a7f61e9db59aa server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:52.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.027+0000 7fefcd470700 1 --2- 172.21.15.103:0/2077576226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefc80acb10 0x7fefc80ae920 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7fefc4002f30 tx=0x7fefc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.080 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.027+0000 7fefccc6f700 1 -- 172.21.15.103:0/2077576226 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefc4011720 con 0x7fefc80acb10 2020-04-22T14:02:52.080 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.027+0000 7fefcd470700 1 --2- 172.21.15.103:0/2077576226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefc80acb10 0x7fefc80ae920 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7fefc4002f30 tx=0x7fefc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.080 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.027+0000 7fefcd470700 1 --2- 172.21.15.103:0/2077576226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefc80acb10 0x7fefc80ae920 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7fefc4002f30 tx=0x7fefc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.080 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.027+0000 7fefccc6f700 1 -- 172.21.15.103:0/2077576226 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc4011880 con 0x7fefc80acb10 2020-04-22T14:02:52.081 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.027+0000 7fefccc6f700 1 -- 172.21.15.103:0/2077576226 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefc4011ca0 con 0x7fefc80acb10 2020-04-22T14:02:52.081 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.027+0000 7fefcfed5700 1 -- 172.21.15.103:0/2077576226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefc80acb10 msgr2=0x7fefc80ae920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:52.081 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.027+0000 7fefcfed5700 1 --2- 172.21.15.103:0/2077576226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefc80acb10 0x7fefc80ae920 secure :-1 s=READY pgs=213 cs=0 l=1 rx=0x7fefc4002f30 tx=0x7fefc4007a40).stop 2020-04-22T14:02:52.081 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.028+0000 7fefcfed5700 1 -- 172.21.15.103:0/2077576226 shutdown_connections 2020-04-22T14:02:52.081 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.028+0000 7fefcfed5700 1 --2- 172.21.15.103:0/2077576226 >> v2:172.21.15.86:3300/0 conn(0x7fefc8061a30 0x7fefc80b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:52.082 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.028+0000 7fefcfed5700 1 --2- 172.21.15.103:0/2077576226 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fefc80aed80 0x7fefc80b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:52.082 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.028+0000 7fefcfed5700 1 --2- 172.21.15.103:0/2077576226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefc80acb10 0x7fefc80ae920 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:52.082 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.028+0000 7fefcfed5700 1 -- 172.21.15.103:0/2077576226 >> 172.21.15.103:0/2077576226 conn(0x7fefc805b7b0 msgr2=0x7fefc80b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:52.082 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.028+0000 7fefcfed5700 1 -- 172.21.15.103:0/2077576226 shutdown_connections 2020-04-22T14:02:52.082 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.028+0000 7fefcfed5700 1 -- 172.21.15.103:0/2077576226 wait complete. 2020-04-22T14:02:52.082 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.029+0000 7fefcfed5700 1 Processor -- start 2020-04-22T14:02:52.082 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.029+0000 7fefcfed5700 1 -- start start 2020-04-22T14:02:52.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.029+0000 7fefcfed5700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fefc8061a30 0x7fefc81380d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:52.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.029+0000 7fefcfed5700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fefc80acb10 0x7fefc813a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:52.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.029+0000 7fefcfed5700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefc8138530 con 0x7fefc80aed80 2020-04-22T14:02:52.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.029+0000 7fefcfed5700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefc813a9e0 con 0x7fefc80acb10 2020-04-22T14:02:52.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.029+0000 7fefcfed5700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefc813ac80 con 0x7fefc8061a30 2020-04-22T14:02:52.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.029+0000 7fefcd470700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fefc80acb10 0x7fefc813a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:52.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.029+0000 7fefce472700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fefc80aed80 0x7fefc8141190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39884/0 (socket says 172.21.15.103:39884) 2020-04-22T14:02:52.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.029+0000 7fefce472700 1 -- 172.21.15.103:0/2405741169 learned_addr learned my addr 172.21.15.103:0/2405741169 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:52.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.029+0000 7fefcd470700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fefc80acb10 0x7fefc813a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47692/0 (socket says 172.21.15.103:47692) 2020-04-22T14:02:52.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.029+0000 7fefcdc71700 1 --2- 172.21.15.103:0/2405741169 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fefc8061a30 0x7fefc81380d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:52.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.030+0000 7fefcd470700 1 -- 172.21.15.103:0/2405741169 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fefc8061a30 msgr2=0x7fefc81380d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:52.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.030+0000 7fefcd470700 1 --2- 172.21.15.103:0/2405741169 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fefc8061a30 0x7fefc81380d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:52.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.030+0000 7fefcd470700 1 -- 172.21.15.103:0/2405741169 >> v1:172.21.15.103:6789/0 conn(0x7fefc80aed80 legacy=0x7fefc8141190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:52.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.030+0000 7fefb6ffd700 1 -- 172.21.15.103:0/2405741169 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2514365211 0 0) 0x7fefc8138530 con 0x7fefc80aed80 2020-04-22T14:02:52.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.030+0000 7fefcd470700 1 -- 172.21.15.103:0/2405741169 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc8156f20 con 0x7fefc80acb10 2020-04-22T14:02:52.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.030+0000 7fefcd470700 1 --2- 172.21.15.103:0/2405741169 >> v2:172.21.15.103:3300/0 conn(0x7fefc80acb10 0x7fefc813a0d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fefc4002f30 tx=0x7fefc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.030+0000 7fefcd470700 1 --2- 172.21.15.103:0/2405741169 >> v2:172.21.15.103:3300/0 conn(0x7fefc80acb10 0x7fefc813a0d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fefc4002f30 tx=0x7fefc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.030+0000 7fefcd470700 1 --2- 172.21.15.103:0/2405741169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefc80acb10 0x7fefc813a0d0 secure :-1 s=READY pgs=215 cs=0 l=1 rx=0x7fefc4002f30 tx=0x7fefc4007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:52.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.030+0000 7fefcd470700 1 --2- 172.21.15.103:0/2405741169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefc80acb10 0x7fefc813a0d0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7fefc4002f30 tx=0x7fefc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.030+0000 7fefb6ffd700 1 -- 172.21.15.103:0/2405741169 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefc4007170 con 0x7fefc80acb10 2020-04-22T14:02:52.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.030+0000 7fefcd470700 1 --2- 172.21.15.103:0/2405741169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefc80acb10 0x7fefc813a0d0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7fefc4002f30 tx=0x7fefc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.030+0000 7fefcd470700 1 --2- 172.21.15.103:0/2405741169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefc80acb10 0x7fefc813a0d0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7fefc4002f30 tx=0x7fefc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.087 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.030+0000 7fefb6ffd700 1 -- 172.21.15.103:0/2405741169 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc40072d0 con 0x7fefc80acb10 2020-04-22T14:02:52.087 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.030+0000 7fefb6ffd700 1 -- 172.21.15.103:0/2405741169 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefc40056c0 con 0x7fefc80acb10 2020-04-22T14:02:52.087 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.030+0000 7fefcfed5700 1 -- 172.21.15.103:0/2405741169 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefc81418a0 con 0x7fefc80acb10 2020-04-22T14:02:52.087 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.030+0000 7fefcfed5700 1 -- 172.21.15.103:0/2405741169 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefc813a530 con 0x7fefc80acb10 2020-04-22T14:02:52.087 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.031+0000 7fefcd470700 1 --2- 172.21.15.103:0/2405741169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefc80acb10 0x7fefc813a0d0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7fefc4002f30 tx=0x7fefc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.087 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.031+0000 7fefb6ffd700 1 -- 172.21.15.103:0/2405741169 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fefc4005930 con 0x7fefc80acb10 2020-04-22T14:02:52.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.031+0000 7fefcd470700 1 --2- 172.21.15.103:0/2405741169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefc80acb10 0x7fefc813a0d0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7fefc4002f30 tx=0x7fefc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.031+0000 7fefcfed5700 1 -- 172.21.15.103:0/2405741169 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefc813a7e0 con 0x7fefc80acb10 2020-04-22T14:02:52.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.031+0000 7fefb6ffd700 1 --2- 172.21.15.103:0/2405741169 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fefa804d830 0x7fefa804fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:52.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.031+0000 7fefb6ffd700 1 -- 172.21.15.103:0/2405741169 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fefc4061c20 con 0x7fefc80acb10 2020-04-22T14:02:52.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.031+0000 7fefcdc71700 1 --2- 172.21.15.103:0/2405741169 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fefa804d830 0x7fefa804fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:52.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.032+0000 7fefcdc71700 1 --2- 172.21.15.103:0/2405741169 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fefa804d830 0x7fefa804fcf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fefb8002f30 tx=0x7fefb800d710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.032+0000 7fefcdc71700 1 --2- 172.21.15.103:0/2405741169 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fefa804d830 0x7fefa804fcf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fefb8002f30 tx=0x7fefb800d710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.032+0000 7fefcdc71700 1 --2- 172.21.15.103:0/2405741169 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fefa804d830 0x7fefa804fcf0 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7fefb8002f30 tx=0x7fefb800d710).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:52.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.035+0000 7fefcd470700 1 --2- 172.21.15.103:0/2405741169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefc80acb10 0x7fefc813a0d0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7fefc4002f30 tx=0x7fefc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.035+0000 7fefb6ffd700 1 -- 172.21.15.103:0/2405741169 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fefc403d0c0 con 0x7fefc80acb10 2020-04-22T14:02:52.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.176+0000 7fefcfed5700 1 -- 172.21.15.103:0/2405741169 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fefc8056c90 con 0x7fefc80acb10 2020-04-22T14:02:52.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.177+0000 7fefcd470700 1 --2- 172.21.15.103:0/2405741169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefc80acb10 0x7fefc813a0d0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7fefc4002f30 tx=0x7fefc4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.177+0000 7fefb6ffd700 1 -- 172.21.15.103:0/2405741169 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fefc40406e0 con 0x7fefc80acb10 2020-04-22T14:02:52.180 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:02:52.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.178+0000 7fefcfed5700 1 -- 172.21.15.103:0/2405741169 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fefa804d830 msgr2=0x7fefa804fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:52.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.178+0000 7fefcfed5700 1 --2- 172.21.15.103:0/2405741169 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fefa804d830 0x7fefa804fcf0 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7fefb8002f30 tx=0x7fefb800d710).stop 2020-04-22T14:02:52.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.178+0000 7fefcfed5700 1 -- 172.21.15.103:0/2405741169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefc80acb10 msgr2=0x7fefc813a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:52.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.178+0000 7fefcfed5700 1 --2- 172.21.15.103:0/2405741169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefc80acb10 0x7fefc813a0d0 secure :-1 s=READY pgs=215 cs=0 l=1 rx=0x7fefc4002f30 tx=0x7fefc4007a40).stop 2020-04-22T14:02:52.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.178+0000 7fefcfed5700 1 -- 172.21.15.103:0/2405741169 shutdown_connections 2020-04-22T14:02:52.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.178+0000 7fefcfed5700 1 --2- 172.21.15.103:0/2405741169 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fefa804d830 0x7fefa804fcf0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:52.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.178+0000 7fefcfed5700 1 --2- 172.21.15.103:0/2405741169 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fefc8061a30 0x7fefc81380d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:52.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.178+0000 7fefcfed5700 1 --2- 172.21.15.103:0/2405741169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefc80acb10 0x7fefc813a0d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:52.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.178+0000 7fefcfed5700 1 -- 172.21.15.103:0/2405741169 >> 172.21.15.103:0/2405741169 conn(0x7fefc805b7b0 msgr2=0x7fefc80b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:52.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.178+0000 7fefcfed5700 1 -- 172.21.15.103:0/2405741169 shutdown_connections 2020-04-22T14:02:52.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.178+0000 7fefcfed5700 1 -- 172.21.15.103:0/2405741169 wait complete. 2020-04-22T14:02:52.191 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:52.205 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-22T14:02:52.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.350+0000 7fb97c883700 1 Processor -- start 2020-04-22T14:02:52.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.351+0000 7fb97c883700 1 -- start start 2020-04-22T14:02:52.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.351+0000 7fb97c883700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb9780bcc50 0x7fb978146f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:52.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.351+0000 7fb97c883700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb97805fc70 0x7fb97814a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:52.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.351+0000 7fb97c883700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb97812bec0 0x7fb97812c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:52.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.351+0000 7fb97c883700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb978146370 con 0x7fb9780bcc50 2020-04-22T14:02:52.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.351+0000 7fb97c883700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb978146560 con 0x7fb97812bec0 2020-04-22T14:02:52.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.351+0000 7fb97c883700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb978146800 con 0x7fb97805fc70 2020-04-22T14:02:52.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.352+0000 7fb97759e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb97812bec0 0x7fb97812c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:52.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.352+0000 7fb976d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb9780bcc50 0x7fb978146f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:52.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.352+0000 7fb97759e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb97812bec0 0x7fb97812c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47700/0 (socket says 172.21.15.103:47700) 2020-04-22T14:02:52.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.352+0000 7fb976d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb9780bcc50 0x7fb978146f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:44930/0 (socket says 172.21.15.103:44930) 2020-04-22T14:02:52.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.352+0000 7fb97759e700 1 -- 172.21.15.103:0/3997014813 learned_addr learned my addr 172.21.15.103:0/3997014813 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:52.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.352+0000 7fb97659c700 1 --2- 172.21.15.103:0/3997014813 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb97805fc70 0x7fb97814a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:52.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.352+0000 7fb97759e700 1 -- 172.21.15.103:0/3997014813 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb97805fc70 msgr2=0x7fb97814a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:52.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.352+0000 7fb97759e700 1 --2- 172.21.15.103:0/3997014813 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb97805fc70 0x7fb97814a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:52.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.352+0000 7fb97759e700 1 -- 172.21.15.103:0/3997014813 >> v2:172.21.15.86:3300/0 conn(0x7fb9780bcc50 msgr2=0x7fb978146f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:52.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.352+0000 7fb97759e700 1 --2- 172.21.15.103:0/3997014813 >> v2:172.21.15.86:3300/0 conn(0x7fb9780bcc50 0x7fb978146f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:52.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.352+0000 7fb97759e700 1 -- 172.21.15.103:0/3997014813 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb978146aa0 con 0x7fb97812bec0 2020-04-22T14:02:52.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.352+0000 7fb97759e700 1 --2- 172.21.15.103:0/3997014813 >> v2:172.21.15.103:3300/0 conn(0x7fb97812bec0 0x7fb97812c300 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb9700032b0 tx=0x7fb970007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.352+0000 7fb97759e700 1 --2- 172.21.15.103:0/3997014813 >> v2:172.21.15.103:3300/0 conn(0x7fb97812bec0 0x7fb97812c300 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb9700032b0 tx=0x7fb970007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.352+0000 7fb97759e700 1 --2- 172.21.15.103:0/3997014813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb97812bec0 0x7fb97812c300 secure :-1 s=READY pgs=216 cs=0 l=1 rx=0x7fb9700032b0 tx=0x7fb970007dc0).ready entity=mon.1 client_cookie=25baa9606ca20165 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:52.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.352+0000 7fb97759e700 1 --2- 172.21.15.103:0/3997014813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb97812bec0 0x7fb97812c300 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7fb9700032b0 tx=0x7fb970007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.352+0000 7fb975d9b700 1 -- 172.21.15.103:0/3997014813 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb970011e30 con 0x7fb97812bec0 2020-04-22T14:02:52.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.352+0000 7fb97759e700 1 --2- 172.21.15.103:0/3997014813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb97812bec0 0x7fb97812c300 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7fb9700032b0 tx=0x7fb970007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.352+0000 7fb975d9b700 1 -- 172.21.15.103:0/3997014813 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb97000a180 con 0x7fb97812bec0 2020-04-22T14:02:52.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.352+0000 7fb97759e700 1 --2- 172.21.15.103:0/3997014813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb97812bec0 0x7fb97812c300 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7fb9700032b0 tx=0x7fb970007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.352+0000 7fb975d9b700 1 -- 172.21.15.103:0/3997014813 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb97000a5a0 con 0x7fb97812bec0 2020-04-22T14:02:52.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.352+0000 7fb97c883700 1 -- 172.21.15.103:0/3997014813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb97812bec0 msgr2=0x7fb97812c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:52.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.352+0000 7fb97c883700 1 --2- 172.21.15.103:0/3997014813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb97812bec0 0x7fb97812c300 secure :-1 s=READY pgs=216 cs=0 l=1 rx=0x7fb9700032b0 tx=0x7fb970007dc0).stop 2020-04-22T14:02:52.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.353+0000 7fb97c883700 1 -- 172.21.15.103:0/3997014813 shutdown_connections 2020-04-22T14:02:52.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.353+0000 7fb97c883700 1 --2- 172.21.15.103:0/3997014813 >> v2:172.21.15.86:3300/0 conn(0x7fb9780bcc50 0x7fb978146f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:52.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.353+0000 7fb97c883700 1 --2- 172.21.15.103:0/3997014813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb97812bec0 0x7fb97812c300 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:52.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.353+0000 7fb97c883700 1 --2- 172.21.15.103:0/3997014813 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb97805fc70 0x7fb97814a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:52.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.353+0000 7fb97c883700 1 -- 172.21.15.103:0/3997014813 >> 172.21.15.103:0/3997014813 conn(0x7fb978065af0 msgr2=0x7fb978065f00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:52.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.353+0000 7fb97c883700 1 -- 172.21.15.103:0/3997014813 shutdown_connections 2020-04-22T14:02:52.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.353+0000 7fb97c883700 1 -- 172.21.15.103:0/3997014813 wait complete. 2020-04-22T14:02:52.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.354+0000 7fb97c883700 1 Processor -- start 2020-04-22T14:02:52.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.354+0000 7fb97c883700 1 -- start start 2020-04-22T14:02:52.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.354+0000 7fb97c883700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9780bcc50 0x7fb978156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:52.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.354+0000 7fb97c883700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9780ae6b0 con 0x7fb97805fc70 2020-04-22T14:02:52.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.354+0000 7fb97c883700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb978157380 con 0x7fb97812bec0 2020-04-22T14:02:52.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.354+0000 7fb97c883700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9780ae8e0 con 0x7fb9780bcc50 2020-04-22T14:02:52.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.355+0000 7fb97759e700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb97812bec0 0x7fb97812de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39896/0 (socket says 172.21.15.103:39896) 2020-04-22T14:02:52.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.355+0000 7fb97759e700 1 -- 172.21.15.103:0/705168176 learned_addr learned my addr 172.21.15.103:0/705168176 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:52.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.355+0000 7fb97659c700 1 --2- 172.21.15.103:0/705168176 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9780bcc50 0x7fb978156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:52.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.355+0000 7fb967fff700 1 -- 172.21.15.103:0/705168176 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 92788275 0 0) 0x7fb978146aa0 con 0x7fb97812bec0 2020-04-22T14:02:52.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.355+0000 7fb967fff700 1 -- 172.21.15.103:0/705168176 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb954002fe0 con 0x7fb97812bec0 2020-04-22T14:02:52.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.355+0000 7fb967fff700 1 -- 172.21.15.103:0/705168176 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3347980523 0 0) 0x7fb9780ae6b0 con 0x7fb97805fc70 2020-04-22T14:02:52.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.355+0000 7fb967fff700 1 -- 172.21.15.103:0/705168176 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb978146aa0 con 0x7fb97805fc70 2020-04-22T14:02:52.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.355+0000 7fb97659c700 1 -- 172.21.15.103:0/705168176 >> v1:172.21.15.103:6789/0 conn(0x7fb97812bec0 legacy=0x7fb97812de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:52.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.355+0000 7fb97659c700 1 -- 172.21.15.103:0/705168176 >> v1:172.21.15.86:6789/0 conn(0x7fb97805fc70 legacy=0x7fb97812eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:52.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.355+0000 7fb97659c700 1 -- 172.21.15.103:0/705168176 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9780aeb80 con 0x7fb9780bcc50 2020-04-22T14:02:52.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.355+0000 7fb97659c700 1 --2- 172.21.15.103:0/705168176 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9780bcc50 0x7fb978156f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb96c002f30 tx=0x7fb96c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.355+0000 7fb97659c700 1 --2- 172.21.15.103:0/705168176 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9780bcc50 0x7fb978156f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb96c002f30 tx=0x7fb96c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.355+0000 7fb97659c700 1 --2- 172.21.15.103:0/705168176 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9780bcc50 0x7fb978156f20 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7fb96c002f30 tx=0x7fb96c010c50).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:52.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.355+0000 7fb97659c700 1 --2- 172.21.15.103:0/705168176 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9780bcc50 0x7fb978156f20 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fb96c002f30 tx=0x7fb96c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.355+0000 7fb967fff700 1 -- 172.21.15.103:0/705168176 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb96c007550 con 0x7fb9780bcc50 2020-04-22T14:02:52.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.355+0000 7fb97659c700 1 --2- 172.21.15.103:0/705168176 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9780bcc50 0x7fb978156f20 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fb96c002f30 tx=0x7fb96c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.355+0000 7fb967fff700 1 -- 172.21.15.103:0/705168176 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb96c0056c0 con 0x7fb9780bcc50 2020-04-22T14:02:52.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.355+0000 7fb97c883700 1 -- 172.21.15.103:0/705168176 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9780aee20 con 0x7fb9780bcc50 2020-04-22T14:02:52.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.355+0000 7fb97659c700 1 --2- 172.21.15.103:0/705168176 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9780bcc50 0x7fb978156f20 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fb96c002f30 tx=0x7fb96c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.355+0000 7fb967fff700 1 -- 172.21.15.103:0/705168176 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb96c005a20 con 0x7fb9780bcc50 2020-04-22T14:02:52.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.355+0000 7fb97c883700 1 -- 172.21.15.103:0/705168176 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb97812e510 con 0x7fb9780bcc50 2020-04-22T14:02:52.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.356+0000 7fb97659c700 1 --2- 172.21.15.103:0/705168176 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9780bcc50 0x7fb978156f20 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fb96c002f30 tx=0x7fb96c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.356+0000 7fb97c883700 1 -- 172.21.15.103:0/705168176 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb978056c90 con 0x7fb9780bcc50 2020-04-22T14:02:52.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.357+0000 7fb967fff700 1 -- 172.21.15.103:0/705168176 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fb96c005c20 con 0x7fb9780bcc50 2020-04-22T14:02:52.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.357+0000 7fb97659c700 1 --2- 172.21.15.103:0/705168176 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9780bcc50 0x7fb978156f20 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fb96c002f30 tx=0x7fb96c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.357+0000 7fb967fff700 1 --2- 172.21.15.103:0/705168176 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb95404de00 0x7fb9540502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:52.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.357+0000 7fb967fff700 1 -- 172.21.15.103:0/705168176 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb96c00d0d0 con 0x7fb9780bcc50 2020-04-22T14:02:52.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.357+0000 7fb976d9d700 1 --2- 172.21.15.103:0/705168176 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb95404de00 0x7fb9540502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:52.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.357+0000 7fb976d9d700 1 --2- 172.21.15.103:0/705168176 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb95404de00 0x7fb9540502c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb968002ef0 tx=0x7fb96800c880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.357+0000 7fb976d9d700 1 --2- 172.21.15.103:0/705168176 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb95404de00 0x7fb9540502c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb968002ef0 tx=0x7fb96800c880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.357+0000 7fb976d9d700 1 --2- 172.21.15.103:0/705168176 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb95404de00 0x7fb9540502c0 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7fb968002ef0 tx=0x7fb96800c880).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:52.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.361+0000 7fb97659c700 1 --2- 172.21.15.103:0/705168176 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9780bcc50 0x7fb978156f20 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fb96c002f30 tx=0x7fb96c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.361+0000 7fb967fff700 1 -- 172.21.15.103:0/705168176 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fb96c03ca70 con 0x7fb9780bcc50 2020-04-22T14:02:52.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.504+0000 7fb97c883700 1 -- 172.21.15.103:0/705168176 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb97806a8b0 con 0x7fb9780bcc50 2020-04-22T14:02:52.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.505+0000 7fb97659c700 1 --2- 172.21.15.103:0/705168176 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9780bcc50 0x7fb978156f20 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fb96c002f30 tx=0x7fb96c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.505+0000 7fb967fff700 1 -- 172.21.15.103:0/705168176 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7fb96c040090 con 0x7fb9780bcc50 2020-04-22T14:02:52.508 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:02:52.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.506+0000 7fb97c883700 1 -- 172.21.15.103:0/705168176 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb95404de00 msgr2=0x7fb9540502c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:52.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.506+0000 7fb97c883700 1 --2- 172.21.15.103:0/705168176 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb95404de00 0x7fb9540502c0 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7fb968002ef0 tx=0x7fb96800c880).stop 2020-04-22T14:02:52.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.506+0000 7fb97c883700 1 -- 172.21.15.103:0/705168176 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9780bcc50 msgr2=0x7fb978156f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:52.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.506+0000 7fb97c883700 1 --2- 172.21.15.103:0/705168176 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9780bcc50 0x7fb978156f20 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7fb96c002f30 tx=0x7fb96c010c50).stop 2020-04-22T14:02:52.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.506+0000 7fb97c883700 1 -- 172.21.15.103:0/705168176 shutdown_connections 2020-04-22T14:02:52.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.506+0000 7fb97c883700 1 --2- 172.21.15.103:0/705168176 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb95404de00 0x7fb9540502c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:52.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.506+0000 7fb97c883700 1 --2- 172.21.15.103:0/705168176 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9780bcc50 0x7fb978156f20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:52.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.506+0000 7fb97c883700 1 -- 172.21.15.103:0/705168176 >> 172.21.15.103:0/705168176 conn(0x7fb978065af0 msgr2=0x7fb9780b72e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:52.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.506+0000 7fb97c883700 1 -- 172.21.15.103:0/705168176 shutdown_connections 2020-04-22T14:02:52.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.506+0000 7fb97c883700 1 -- 172.21.15.103:0/705168176 wait complete. 2020-04-22T14:02:52.519 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:52.534 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-22T14:02:52.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.679+0000 7f7b0c7b9700 1 Processor -- start 2020-04-22T14:02:52.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.680+0000 7f7b0c7b9700 1 -- start start 2020-04-22T14:02:52.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.680+0000 7f7b0c7b9700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b040b3bd0 0x7f7b04143650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:52.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.680+0000 7f7b0c7b9700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7b04143ab0 0x7f7b04143f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:52.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.680+0000 7f7b0c7b9700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b04148310 con 0x7f7b040b9140 2020-04-22T14:02:52.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.680+0000 7f7b0c7b9700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b041485b0 con 0x7f7b04143ab0 2020-04-22T14:02:52.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.680+0000 7f7b0c7b9700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b040b9520 con 0x7f7b040b3bd0 2020-04-22T14:02:52.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.681+0000 7f7b0ad56700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7b04143ab0 0x7f7b04143f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:52.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.681+0000 7f7b0ad56700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7b04143ab0 0x7f7b04143f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47712/0 (socket says 172.21.15.103:47712) 2020-04-22T14:02:52.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.681+0000 7f7b0ad56700 1 -- 172.21.15.103:0/2947638167 learned_addr learned my addr 172.21.15.103:0/2947638167 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:52.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.681+0000 7f7b09d54700 1 --2- 172.21.15.103:0/2947638167 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b040b3bd0 0x7f7b04143650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:52.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.681+0000 7f7b0ad56700 1 -- 172.21.15.103:0/2947638167 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b040b3bd0 msgr2=0x7f7b04143650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:52.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.681+0000 7f7b0ad56700 1 --2- 172.21.15.103:0/2947638167 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b040b3bd0 0x7f7b04143650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:52.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.681+0000 7f7b0ad56700 1 -- 172.21.15.103:0/2947638167 >> v1:172.21.15.86:6789/0 conn(0x7f7b040b9140 legacy=0x7f7b040aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:52.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.681+0000 7f7b0ad56700 1 -- 172.21.15.103:0/2947638167 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b040b3050 con 0x7f7b04143ab0 2020-04-22T14:02:52.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.681+0000 7f7b09d54700 1 --2- 172.21.15.103:0/2947638167 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b040b3bd0 0x7f7b04143650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:02:52.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.681+0000 7f7b0ad56700 1 --2- 172.21.15.103:0/2947638167 >> v2:172.21.15.103:3300/0 conn(0x7f7b04143ab0 0x7f7b04143f60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7afc0032b0 tx=0x7f7afc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.681+0000 7f7b0ad56700 1 --2- 172.21.15.103:0/2947638167 >> v2:172.21.15.103:3300/0 conn(0x7f7b04143ab0 0x7f7b04143f60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7afc0032b0 tx=0x7f7afc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.681+0000 7f7b0ad56700 1 --2- 172.21.15.103:0/2947638167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b04143ab0 0x7f7b04143f60 secure :-1 s=READY pgs=218 cs=0 l=1 rx=0x7f7afc0032b0 tx=0x7f7afc007dc0).ready entity=mon.1 client_cookie=b14a4a60438ba471 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:52.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.681+0000 7f7b0ad56700 1 --2- 172.21.15.103:0/2947638167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b04143ab0 0x7f7b04143f60 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7f7afc0032b0 tx=0x7f7afc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.681+0000 7f7b0ad56700 1 --2- 172.21.15.103:0/2947638167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b04143ab0 0x7f7b04143f60 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7f7afc0032b0 tx=0x7f7afc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.681+0000 7f7b09553700 1 -- 172.21.15.103:0/2947638167 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7afc00a180 con 0x7f7b04143ab0 2020-04-22T14:02:52.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.681+0000 7f7b0ad56700 1 --2- 172.21.15.103:0/2947638167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b04143ab0 0x7f7b04143f60 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7f7afc0032b0 tx=0x7f7afc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.681+0000 7f7b09553700 1 -- 172.21.15.103:0/2947638167 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7afc00a320 con 0x7f7b04143ab0 2020-04-22T14:02:52.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.681+0000 7f7b09553700 1 -- 172.21.15.103:0/2947638167 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7afc00a740 con 0x7f7b04143ab0 2020-04-22T14:02:52.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.681+0000 7f7b0c7b9700 1 -- 172.21.15.103:0/2947638167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b04143ab0 msgr2=0x7f7b04143f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:52.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.681+0000 7f7b0c7b9700 1 --2- 172.21.15.103:0/2947638167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b04143ab0 0x7f7b04143f60 secure :-1 s=READY pgs=218 cs=0 l=1 rx=0x7f7afc0032b0 tx=0x7f7afc007dc0).stop 2020-04-22T14:02:52.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.682+0000 7f7b0c7b9700 1 -- 172.21.15.103:0/2947638167 shutdown_connections 2020-04-22T14:02:52.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.682+0000 7f7b0c7b9700 1 --2- 172.21.15.103:0/2947638167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b04143ab0 0x7f7b04143f60 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:52.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.682+0000 7f7b0c7b9700 1 --2- 172.21.15.103:0/2947638167 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b040b3bd0 0x7f7b04143650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:52.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.682+0000 7f7b0c7b9700 1 -- 172.21.15.103:0/2947638167 >> 172.21.15.103:0/2947638167 conn(0x7f7b0405b7b0 msgr2=0x7f7b040b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:52.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.682+0000 7f7b0c7b9700 1 -- 172.21.15.103:0/2947638167 shutdown_connections 2020-04-22T14:02:52.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.682+0000 7f7b0c7b9700 1 -- 172.21.15.103:0/2947638167 wait complete. 2020-04-22T14:02:52.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.683+0000 7f7b0c7b9700 1 Processor -- start 2020-04-22T14:02:52.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.683+0000 7f7b0c7b9700 1 -- start start 2020-04-22T14:02:52.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.683+0000 7f7b0c7b9700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7b040b3bd0 0x7f7b041477c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:52.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.683+0000 7f7b0c7b9700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b040b9140 0x7f7b041550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:52.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.683+0000 7f7b0c7b9700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b040b1510 con 0x7f7b04143ab0 2020-04-22T14:02:52.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.683+0000 7f7b0c7b9700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b040b17b0 con 0x7f7b040b3bd0 2020-04-22T14:02:52.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.683+0000 7f7b0c7b9700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b040b1a50 con 0x7f7b040b9140 2020-04-22T14:02:52.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.683+0000 7f7b0a555700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7b040b3bd0 0x7f7b041477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:52.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.684+0000 7f7b0a555700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7b040b3bd0 0x7f7b041477c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47718/0 (socket says 172.21.15.103:47718) 2020-04-22T14:02:52.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.684+0000 7f7b0a555700 1 -- 172.21.15.103:0/2399829940 learned_addr learned my addr 172.21.15.103:0/2399829940 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:52.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.684+0000 7f7b09d54700 1 --2- 172.21.15.103:0/2399829940 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b040b9140 0x7f7b041550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:52.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.684+0000 7f7b0a555700 1 -- 172.21.15.103:0/2399829940 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b040b9140 msgr2=0x7f7b041550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:52.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.684+0000 7f7b0a555700 1 --2- 172.21.15.103:0/2399829940 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b040b9140 0x7f7b041550a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:52.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.684+0000 7f7b0a555700 1 -- 172.21.15.103:0/2399829940 >> v1:172.21.15.103:6789/0 conn(0x7f7b04143ab0 legacy=0x7f7b04139080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:52.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.684+0000 7f7b0a555700 1 -- 172.21.15.103:0/2399829940 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b041461f0 con 0x7f7b040b3bd0 2020-04-22T14:02:52.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.684+0000 7f7b0a555700 1 --2- 172.21.15.103:0/2399829940 >> v2:172.21.15.103:3300/0 conn(0x7f7b040b3bd0 0x7f7b041477c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7b040b6250 tx=0x7f7b0000c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.684+0000 7f7af77fe700 1 -- 172.21.15.103:0/2399829940 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1150401670 0 0) 0x7f7b040b1510 con 0x7f7b04143ab0 2020-04-22T14:02:52.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.684+0000 7f7b0a555700 1 --2- 172.21.15.103:0/2399829940 >> v2:172.21.15.103:3300/0 conn(0x7f7b040b3bd0 0x7f7b041477c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7b040b6250 tx=0x7f7b0000c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.684+0000 7f7b0a555700 1 --2- 172.21.15.103:0/2399829940 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b040b3bd0 0x7f7b041477c0 secure :-1 s=READY pgs=220 cs=0 l=1 rx=0x7f7b040b6250 tx=0x7f7b0000c460).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:52.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.684+0000 7f7b0a555700 1 --2- 172.21.15.103:0/2399829940 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b040b3bd0 0x7f7b041477c0 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7f7b040b6250 tx=0x7f7b0000c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.684+0000 7f7af77fe700 1 -- 172.21.15.103:0/2399829940 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b000126d0 con 0x7f7b040b3bd0 2020-04-22T14:02:52.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.684+0000 7f7b0a555700 1 --2- 172.21.15.103:0/2399829940 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b040b3bd0 0x7f7b041477c0 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7f7b040b6250 tx=0x7f7b0000c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.684+0000 7f7b0a555700 1 --2- 172.21.15.103:0/2399829940 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b040b3bd0 0x7f7b041477c0 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7f7b040b6250 tx=0x7f7b0000c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.684+0000 7f7af77fe700 1 -- 172.21.15.103:0/2399829940 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b00012870 con 0x7f7b040b3bd0 2020-04-22T14:02:52.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.684+0000 7f7b0c7b9700 1 -- 172.21.15.103:0/2399829940 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b040b1150 con 0x7f7b040b3bd0 2020-04-22T14:02:52.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.684+0000 7f7af77fe700 1 -- 172.21.15.103:0/2399829940 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b00012c90 con 0x7f7b040b3bd0 2020-04-22T14:02:52.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.684+0000 7f7b0c7b9700 1 -- 172.21.15.103:0/2399829940 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b041399d0 con 0x7f7b040b3bd0 2020-04-22T14:02:52.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.685+0000 7f7b0a555700 1 --2- 172.21.15.103:0/2399829940 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b040b3bd0 0x7f7b041477c0 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7f7b040b6250 tx=0x7f7b0000c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.685+0000 7f7af77fe700 1 -- 172.21.15.103:0/2399829940 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f7b000064e0 con 0x7f7b040b3bd0 2020-04-22T14:02:52.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.686+0000 7f7b0c7b9700 1 -- 172.21.15.103:0/2399829940 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b04056c90 con 0x7f7b040b3bd0 2020-04-22T14:02:52.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.686+0000 7f7b0a555700 1 --2- 172.21.15.103:0/2399829940 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b040b3bd0 0x7f7b041477c0 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7f7b040b6250 tx=0x7f7b0000c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.686+0000 7f7af77fe700 1 --2- 172.21.15.103:0/2399829940 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7ae404d8a0 0x7f7ae404fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:52.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.686+0000 7f7af77fe700 1 -- 172.21.15.103:0/2399829940 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7b00060e20 con 0x7f7b040b3bd0 2020-04-22T14:02:52.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.686+0000 7f7b09d54700 1 --2- 172.21.15.103:0/2399829940 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7ae404d8a0 0x7f7ae404fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:52.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.686+0000 7f7b09d54700 1 --2- 172.21.15.103:0/2399829940 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7ae404d8a0 0x7f7ae404fd60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7af8002f30 tx=0x7f7af8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.686+0000 7f7b09d54700 1 --2- 172.21.15.103:0/2399829940 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7ae404d8a0 0x7f7ae404fd60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7af8002f30 tx=0x7f7af8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.686+0000 7f7b09d54700 1 --2- 172.21.15.103:0/2399829940 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7ae404d8a0 0x7f7ae404fd60 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7f7af8002f30 tx=0x7f7af8007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:52.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.690+0000 7f7b0a555700 1 --2- 172.21.15.103:0/2399829940 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b040b3bd0 0x7f7b041477c0 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7f7b040b6250 tx=0x7f7b0000c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.690+0000 7f7af77fe700 1 -- 172.21.15.103:0/2399829940 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f7b0003c200 con 0x7f7b040b3bd0 2020-04-22T14:02:52.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.833+0000 7f7b0c7b9700 1 -- 172.21.15.103:0/2399829940 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7b040b1b90 con 0x7f7b040b3bd0 2020-04-22T14:02:52.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.833+0000 7f7b0a555700 1 --2- 172.21.15.103:0/2399829940 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b040b3bd0 0x7f7b041477c0 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7f7b040b6250 tx=0x7f7b0000c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:52.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.833+0000 7f7af77fe700 1 -- 172.21.15.103:0/2399829940 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7f7b0003f820 con 0x7f7b040b3bd0 2020-04-22T14:02:52.839 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:02:52.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.834+0000 7f7b0c7b9700 1 -- 172.21.15.103:0/2399829940 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7ae404d8a0 msgr2=0x7f7ae404fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:52.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.834+0000 7f7b0c7b9700 1 --2- 172.21.15.103:0/2399829940 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7ae404d8a0 0x7f7ae404fd60 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7f7af8002f30 tx=0x7f7af8007a40).stop 2020-04-22T14:02:52.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.834+0000 7f7b0c7b9700 1 -- 172.21.15.103:0/2399829940 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b040b3bd0 msgr2=0x7f7b041477c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:52.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.834+0000 7f7b0c7b9700 1 --2- 172.21.15.103:0/2399829940 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b040b3bd0 0x7f7b041477c0 secure :-1 s=READY pgs=220 cs=0 l=1 rx=0x7f7b040b6250 tx=0x7f7b0000c460).stop 2020-04-22T14:02:52.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.834+0000 7f7b0c7b9700 1 -- 172.21.15.103:0/2399829940 shutdown_connections 2020-04-22T14:02:52.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.834+0000 7f7b0c7b9700 1 --2- 172.21.15.103:0/2399829940 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7ae404d8a0 0x7f7ae404fd60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:52.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.834+0000 7f7b0c7b9700 1 --2- 172.21.15.103:0/2399829940 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b040b3bd0 0x7f7b041477c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:52.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.834+0000 7f7b0c7b9700 1 --2- 172.21.15.103:0/2399829940 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b040b9140 0x7f7b041550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:52.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.834+0000 7f7b0c7b9700 1 -- 172.21.15.103:0/2399829940 >> 172.21.15.103:0/2399829940 conn(0x7f7b0405b7b0 msgr2=0x7f7b0413b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:52.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.835+0000 7f7b0c7b9700 1 -- 172.21.15.103:0/2399829940 shutdown_connections 2020-04-22T14:02:52.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:52.835+0000 7f7b0c7b9700 1 -- 172.21.15.103:0/2399829940 wait complete. 2020-04-22T14:02:52.851 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-04-22T14:02:52.851 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:52.867 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:02:53.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.022+0000 7f060e6f6700 1 Processor -- start 2020-04-22T14:02:53.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.022+0000 7f060e6f6700 1 -- start start 2020-04-22T14:02:53.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.023+0000 7f060e6f6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0608143f90 0x7f06080b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:53.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.023+0000 7f060e6f6700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f060805f3e0 0x7f06081448d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:53.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.023+0000 7f060e6f6700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0608062950 con 0x7f06080b2940 2020-04-22T14:02:53.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.023+0000 7f060e6f6700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0608062bf0 con 0x7f060805f3e0 2020-04-22T14:02:53.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.023+0000 7f060e6f6700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0608144430 con 0x7f0608143f90 2020-04-22T14:02:53.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.023+0000 7f060cc93700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f060805f3e0 0x7f06081448d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:53.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.023+0000 7f0607fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f06080b2940 0x7f0608143880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39916/0 (socket says 172.21.15.103:39916) 2020-04-22T14:02:53.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.023+0000 7f0607fff700 1 -- 172.21.15.103:0/4088202777 learned_addr learned my addr 172.21.15.103:0/4088202777 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:53.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.024+0000 7f06077fe700 1 --2- 172.21.15.103:0/4088202777 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0608143f90 0x7f06080b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:53.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.024+0000 7f060cc93700 1 -- 172.21.15.103:0/4088202777 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0608143f90 msgr2=0x7f06080b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:53.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.024+0000 7f060cc93700 1 --2- 172.21.15.103:0/4088202777 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0608143f90 0x7f06080b40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:53.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.024+0000 7f060cc93700 1 -- 172.21.15.103:0/4088202777 >> v1:172.21.15.103:6789/0 conn(0x7f06080b2940 legacy=0x7f0608143880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:53.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.024+0000 7f060cc93700 1 -- 172.21.15.103:0/4088202777 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06080b2d20 con 0x7f060805f3e0 2020-04-22T14:02:53.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.024+0000 7f0606ffd700 1 -- 172.21.15.103:0/4088202777 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2097553494 0 0) 0x7f0608062950 con 0x7f06080b2940 2020-04-22T14:02:53.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.024+0000 7f060cc93700 1 --2- 172.21.15.103:0/4088202777 >> v2:172.21.15.103:3300/0 conn(0x7f060805f3e0 0x7f06081448d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f06000032b0 tx=0x7f0600007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:53.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.024+0000 7f060cc93700 1 --2- 172.21.15.103:0/4088202777 >> v2:172.21.15.103:3300/0 conn(0x7f060805f3e0 0x7f06081448d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f06000032b0 tx=0x7f0600007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:53.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.024+0000 7f060cc93700 1 --2- 172.21.15.103:0/4088202777 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f060805f3e0 0x7f06081448d0 secure :-1 s=READY pgs=222 cs=0 l=1 rx=0x7f06000032b0 tx=0x7f0600007dc0).ready entity=mon.1 client_cookie=221e5af3e5518b2e server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:53.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.024+0000 7f060cc93700 1 --2- 172.21.15.103:0/4088202777 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f060805f3e0 0x7f06081448d0 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f06000032b0 tx=0x7f0600007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:53.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.024+0000 7f0606ffd700 1 -- 172.21.15.103:0/4088202777 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0600011e20 con 0x7f060805f3e0 2020-04-22T14:02:53.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.024+0000 7f060cc93700 1 --2- 172.21.15.103:0/4088202777 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f060805f3e0 0x7f06081448d0 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f06000032b0 tx=0x7f0600007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:53.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.024+0000 7f060cc93700 1 --2- 172.21.15.103:0/4088202777 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f060805f3e0 0x7f06081448d0 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f06000032b0 tx=0x7f0600007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:53.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.024+0000 7f0606ffd700 1 -- 172.21.15.103:0/4088202777 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f060000a180 con 0x7f060805f3e0 2020-04-22T14:02:53.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.024+0000 7f0606ffd700 1 -- 172.21.15.103:0/4088202777 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f060000a520 con 0x7f060805f3e0 2020-04-22T14:02:53.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.024+0000 7f060e6f6700 1 -- 172.21.15.103:0/4088202777 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f060805f3e0 msgr2=0x7f06081448d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:53.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.024+0000 7f060e6f6700 1 --2- 172.21.15.103:0/4088202777 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f060805f3e0 0x7f06081448d0 secure :-1 s=READY pgs=222 cs=0 l=1 rx=0x7f06000032b0 tx=0x7f0600007dc0).stop 2020-04-22T14:02:53.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.025+0000 7f060e6f6700 1 -- 172.21.15.103:0/4088202777 shutdown_connections 2020-04-22T14:02:53.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.025+0000 7f060e6f6700 1 --2- 172.21.15.103:0/4088202777 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f060805f3e0 0x7f06081448d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:53.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.025+0000 7f060e6f6700 1 --2- 172.21.15.103:0/4088202777 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0608143f90 0x7f06080b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:53.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.025+0000 7f060e6f6700 1 -- 172.21.15.103:0/4088202777 >> 172.21.15.103:0/4088202777 conn(0x7f060805ad30 msgr2=0x7f060805b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:53.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.025+0000 7f060e6f6700 1 -- 172.21.15.103:0/4088202777 shutdown_connections 2020-04-22T14:02:53.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.025+0000 7f060e6f6700 1 -- 172.21.15.103:0/4088202777 wait complete. 2020-04-22T14:02:53.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.025+0000 7f060e6f6700 1 Processor -- start 2020-04-22T14:02:53.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.026+0000 7f060e6f6700 1 -- start start 2020-04-22T14:02:53.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.026+0000 7f060e6f6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0608143f90 0x7f0608063030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:53.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.026+0000 7f060e6f6700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06080b9580 con 0x7f06080b2940 2020-04-22T14:02:53.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.026+0000 7f060e6f6700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06080b9820 con 0x7f060805f3e0 2020-04-22T14:02:53.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.026+0000 7f060e6f6700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06080b9f60 con 0x7f0608143f90 2020-04-22T14:02:53.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.026+0000 7f0607fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f060805f3e0 0x7f06080b1b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39920/0 (socket says 172.21.15.103:39920) 2020-04-22T14:02:53.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.026+0000 7f0607fff700 1 -- 172.21.15.103:0/1055573989 learned_addr learned my addr 172.21.15.103:0/1055573989 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:53.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.027+0000 7f060cc93700 1 --2- 172.21.15.103:0/1055573989 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0608143f90 0x7f0608063030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:53.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.027+0000 7f06057fa700 1 -- 172.21.15.103:0/1055573989 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2321320189 0 0) 0x7f06080b9820 con 0x7f060805f3e0 2020-04-22T14:02:53.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.027+0000 7f06057fa700 1 -- 172.21.15.103:0/1055573989 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05e8002fe0 con 0x7f060805f3e0 2020-04-22T14:02:53.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.027+0000 7f06057fa700 1 -- 172.21.15.103:0/1055573989 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 626315518 0 0) 0x7f05e8002fe0 con 0x7f060805f3e0 2020-04-22T14:02:53.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.027+0000 7f06057fa700 1 -- 172.21.15.103:0/1055573989 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f06080b9820 con 0x7f060805f3e0 2020-04-22T14:02:53.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.027+0000 7f06057fa700 1 -- 172.21.15.103:0/1055573989 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f05f8001920 con 0x7f060805f3e0 2020-04-22T14:02:53.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.027+0000 7f06057fa700 1 -- 172.21.15.103:0/1055573989 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0608143f90 msgr2=0x7f0608063030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:53.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.027+0000 7f06057fa700 1 --2- 172.21.15.103:0/1055573989 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0608143f90 0x7f0608063030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:53.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.027+0000 7f06057fa700 1 -- 172.21.15.103:0/1055573989 >> v1:172.21.15.103:6789/0 conn(0x7f060805f3e0 legacy=0x7f06080b1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:53.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.027+0000 7f06057fa700 1 -- 172.21.15.103:0/1055573989 >> v1:172.21.15.86:6789/0 conn(0x7f06080b2940 legacy=0x7f0608153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:53.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.027+0000 7f06057fa700 1 --2- 172.21.15.103:0/1055573989 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f05e80049b0 0x7f05e8004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:53.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.027+0000 7f06057fa700 1 --2- 172.21.15.103:0/1055573989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05e80051f0 0x7f05e8003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:53.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.027+0000 7f06057fa700 1 --2- 172.21.15.103:0/1055573989 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05e8003ea0 0x7f05e8004350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:53.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.027+0000 7f06057fa700 1 -- 172.21.15.103:0/1055573989 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e800b780 con 0x7f05e8003ea0 2020-04-22T14:02:53.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.027+0000 7f06057fa700 1 -- 172.21.15.103:0/1055573989 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e800b8f0 con 0x7f05e80051f0 2020-04-22T14:02:53.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.027+0000 7f06057fa700 1 -- 172.21.15.103:0/1055573989 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e800bab0 con 0x7f05e80049b0 2020-04-22T14:02:53.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.027+0000 7f060cc93700 1 --2- 172.21.15.103:0/1055573989 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0608143f90 0x7f0608063030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:02:53.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.027+0000 7f06077fe700 1 --2- 172.21.15.103:0/1055573989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05e80051f0 0x7f05e8003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:53.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.027+0000 7f0607fff700 1 --2- 172.21.15.103:0/1055573989 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f05e80049b0 0x7f05e8004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:53.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.027+0000 7f060cc93700 1 --2- 172.21.15.103:0/1055573989 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05e8003ea0 0x7f05e8004350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:53.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.027+0000 7f06077fe700 1 -- 172.21.15.103:0/1055573989 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f05e80049b0 msgr2=0x7f05e8004d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:53.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.027+0000 7f06077fe700 1 --2- 172.21.15.103:0/1055573989 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f05e80049b0 0x7f05e8004d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:53.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.027+0000 7f06077fe700 1 -- 172.21.15.103:0/1055573989 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05e8003ea0 msgr2=0x7f05e8004350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:53.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.027+0000 7f06077fe700 1 --2- 172.21.15.103:0/1055573989 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05e8003ea0 0x7f05e8004350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:53.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.027+0000 7f06077fe700 1 -- 172.21.15.103:0/1055573989 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06080b9ac0 con 0x7f05e80051f0 2020-04-22T14:02:53.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.027+0000 7f060e6f6700 1 -- 172.21.15.103:0/1055573989 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06080b03b0 con 0x7f05e80051f0 2020-04-22T14:02:53.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.027+0000 7f06077fe700 1 --2- 172.21.15.103:0/1055573989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05e80051f0 0x7f05e8003920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f05fc007920 tx=0x7f05fc010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:53.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.027+0000 7f060cc93700 1 --2- 172.21.15.103:0/1055573989 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05e8003ea0 0x7f05e8004350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:02:53.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.028+0000 7f060e6f6700 1 -- 172.21.15.103:0/1055573989 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06080b6e70 con 0x7f05e80051f0 2020-04-22T14:02:53.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.028+0000 7f06077fe700 1 --2- 172.21.15.103:0/1055573989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05e80051f0 0x7f05e8003920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f05fc007920 tx=0x7f05fc010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:53.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.028+0000 7f06077fe700 1 --2- 172.21.15.103:0/1055573989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05e80051f0 0x7f05e8003920 secure :-1 s=READY pgs=224 cs=0 l=1 rx=0x7f05fc007920 tx=0x7f05fc010cd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:53.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.028+0000 7f06077fe700 1 --2- 172.21.15.103:0/1055573989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05e80051f0 0x7f05e8003920 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7f05fc007920 tx=0x7f05fc010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:53.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.028+0000 7f06057fa700 1 -- 172.21.15.103:0/1055573989 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05fc0127b0 con 0x7f05e80051f0 2020-04-22T14:02:53.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.028+0000 7f06077fe700 1 --2- 172.21.15.103:0/1055573989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05e80051f0 0x7f05e8003920 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7f05fc007920 tx=0x7f05fc010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:53.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.028+0000 7f06077fe700 1 --2- 172.21.15.103:0/1055573989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05e80051f0 0x7f05e8003920 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7f05fc007920 tx=0x7f05fc010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:53.087 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.028+0000 7f06057fa700 1 -- 172.21.15.103:0/1055573989 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05fc012910 con 0x7f05e80051f0 2020-04-22T14:02:53.087 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.028+0000 7f06057fa700 1 -- 172.21.15.103:0/1055573989 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05fc012cb0 con 0x7f05e80051f0 2020-04-22T14:02:53.087 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.028+0000 7f06077fe700 1 --2- 172.21.15.103:0/1055573989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05e80051f0 0x7f05e8003920 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7f05fc007920 tx=0x7f05fc010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:53.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.028+0000 7f060e6f6700 1 -- 172.21.15.103:0/1055573989 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05e4003340 con 0x7f05e80051f0 2020-04-22T14:02:53.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.029+0000 7f06057fa700 1 -- 172.21.15.103:0/1055573989 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f05fc0056c0 con 0x7f05e80051f0 2020-04-22T14:02:53.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.029+0000 7f06077fe700 1 --2- 172.21.15.103:0/1055573989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05e80051f0 0x7f05e8003920 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7f05fc007920 tx=0x7f05fc010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:53.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.029+0000 7f06057fa700 1 --2- 172.21.15.103:0/1055573989 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f05e8056220 0x7f05e80586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:53.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.029+0000 7f06057fa700 1 -- 172.21.15.103:0/1055573989 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f05fc061af0 con 0x7f05e80051f0 2020-04-22T14:02:53.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.029+0000 7f0607fff700 1 --2- 172.21.15.103:0/1055573989 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f05e8056220 0x7f05e80586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:53.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.029+0000 7f0607fff700 1 --2- 172.21.15.103:0/1055573989 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f05e8056220 0x7f05e80586e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f05f8001170 tx=0x7f05f800fb20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:53.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.029+0000 7f0607fff700 1 --2- 172.21.15.103:0/1055573989 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f05e8056220 0x7f05e80586e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f05f8001170 tx=0x7f05f800fb20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:53.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.029+0000 7f0607fff700 1 --2- 172.21.15.103:0/1055573989 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f05e8056220 0x7f05e80586e0 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7f05f8001170 tx=0x7f05f800fb20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:53.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.033+0000 7f06077fe700 1 --2- 172.21.15.103:0/1055573989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05e80051f0 0x7f05e8003920 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7f05fc007920 tx=0x7f05fc010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:53.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.033+0000 7f06057fa700 1 -- 172.21.15.103:0/1055573989 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f05fc03cf30 con 0x7f05e80051f0 2020-04-22T14:02:53.227 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.224+0000 7f060e6f6700 1 -- 172.21.15.103:0/1055573989 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05e40036e0 con 0x7f05e80051f0 2020-04-22T14:02:53.228 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.224+0000 7f06077fe700 1 --2- 172.21.15.103:0/1055573989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05e80051f0 0x7f05e8003920 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7f05fc007920 tx=0x7f05fc010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:53.228 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.224+0000 7f06057fa700 1 -- 172.21.15.103:0/1055573989 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2137 (secure 0 0 0) 0x7f05fc040550 con 0x7f05e80051f0 2020-04-22T14:02:53.228 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:02:53.228 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/3739398122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3739398122},{"type":"v1","addr":"172.21.15.86:6835","nonce":3739398122}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":6}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:02:27.685979+0000","modified":"2020-04-22T14:02:32.276953+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4357},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4357":{"gid":4357,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.103:6833/1765986263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1765986263},{"type":"v1","addr":"172.21.15.103:6833","nonce":1765986263}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-22T14:02:53.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.225+0000 7f060e6f6700 1 -- 172.21.15.103:0/1055573989 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f05e8056220 msgr2=0x7f05e80586e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:53.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.225+0000 7f060e6f6700 1 --2- 172.21.15.103:0/1055573989 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f05e8056220 0x7f05e80586e0 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7f05f8001170 tx=0x7f05f800fb20).stop 2020-04-22T14:02:53.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.225+0000 7f060e6f6700 1 -- 172.21.15.103:0/1055573989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05e80051f0 msgr2=0x7f05e8003920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:53.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.225+0000 7f060e6f6700 1 --2- 172.21.15.103:0/1055573989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05e80051f0 0x7f05e8003920 secure :-1 s=READY pgs=224 cs=0 l=1 rx=0x7f05fc007920 tx=0x7f05fc010cd0).stop 2020-04-22T14:02:53.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.225+0000 7f060cc93700 1 -- 172.21.15.103:0/1055573989 reap_dead start 2020-04-22T14:02:53.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.225+0000 7f060cc93700 1 -- 172.21.15.103:0/1055573989 reap_dead start 2020-04-22T14:02:53.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.225+0000 7f060e6f6700 1 -- 172.21.15.103:0/1055573989 shutdown_connections 2020-04-22T14:02:53.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.225+0000 7f060e6f6700 1 -- 172.21.15.103:0/1055573989 >> 172.21.15.103:0/1055573989 conn(0x7f060805ad30 msgr2=0x7f06080b6210 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:53.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.225+0000 7f060e6f6700 1 -- 172.21.15.103:0/1055573989 shutdown_connections 2020-04-22T14:02:53.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:53.225+0000 7f060e6f6700 1 -- 172.21.15.103:0/1055573989 wait complete. 2020-04-22T14:02:53.231 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 6 2020-04-22T14:02:53.442 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4357}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 3, u'failed': [], u'epoch': 5, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [4], u'info': {u'gid_4357': {u'export_targets': [], u'name': u'a', u'incarnation': 4, u'state_seq': 2, u'state': u'up:active', u'gid': 4357, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 1765986263, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 1765986263, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/1765986263'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:02:27.685979+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:02:32.276953+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:02:53.443 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:02:53.443 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:53.465 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:02:53.637 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:02:53.638 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:02:53.638 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:02:53.638 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4357, 2020-04-22T14:02:53.638 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:02:53.638 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:02:53.638 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 22.363906839999999, 2020-04-22T14:02:53.639 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 5, 2020-04-22T14:02:53.639 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 24, 2020-04-22T14:02:53.639 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 24, 2020-04-22T14:02:53.639 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 23.070349449999998 2020-04-22T14:02:53.639 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:02:53.646 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 4357, "want_state": "up:active", "state": "up:active", "rank_uptime": 22.363906839999999, "mdsmap_epoch": 5, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "uptime": 23.070349449999998 } 2020-04-22T14:02:53.646 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-04-22T14:02:53.646 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:02:53.646 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:53.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:53.661 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:02:53.720 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:02:53.720 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:02:53.721 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:02:53.721 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:02:53.721 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:02:53.721 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:02:53.721 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:02:53.721 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:02:53.722 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:02:53.722 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:02:53.722 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:02:53.722 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:02:53.722 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:02:53.722 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:02:53.722 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:02:53.722 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42667sec preferred_lft 42667sec 2020-04-22T14:02:53.723 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:02:53.723 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:02:53.723 INFO:teuthology.orchestra.run.smithi103.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:02:53.723 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 3e:08:3e:0d:9c:69 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:02:53.723 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:02:53.723 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:02:53.723 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::9821:a50f:5aef:14af/64 scope link noprefixroute 2020-04-22T14:02:53.724 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:02:53.724 INFO:teuthology.orchestra.run.smithi103.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-04-22T14:02:53.724 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 3e:08:3e:0d:9c:69 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2020-04-22T14:02:53.724 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:53.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:53.770 INFO:teuthology.orchestra.run.smithi103:> ip netns list 2020-04-22T14:02:53.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2020-04-22T14:02:53.835 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:53.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:53.881 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:02:53.945 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2020-04-22T14:02:53.946 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:53.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:53.994 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:02:54.053 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2020-04-22T14:02:54.053 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:54.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:54.101 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:02:54.186 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:54.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:54.225 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 1' 2020-04-22T14:02:54.304 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:54.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:54.347 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr' 2020-04-22T14:02:54.455 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:02:54.455 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:02:54.455 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:02:54.455 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:02:54.456 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:02:54.456 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:02:54.456 INFO:teuthology.orchestra.run.smithi103.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:02:54.456 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 12:34:6c:d0:01:9e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:02:54.456 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2020-04-22T14:02:54.456 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:02:54.456 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::1034:6cff:fed0:19e/64 scope link 2020-04-22T14:02:54.457 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:02:54.457 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:54.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:54.489 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr' 2020-04-22T14:02:54.565 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:02:54.565 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:02:54.566 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:02:54.566 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:02:54.566 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:02:54.566 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:02:54.566 INFO:teuthology.orchestra.run.smithi103.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:02:54.567 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 12:34:6c:d0:01:9e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:02:54.567 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2020-04-22T14:02:54.568 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:02:54.568 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::1034:6cff:fed0:19e/64 scope link 2020-04-22T14:02:54.568 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:02:54.598 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.2/16 2020-04-22T14:02:54.598 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:54.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:54.637 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.1' 2020-04-22T14:02:54.716 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:54.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:54.766 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0' 2020-04-22T14:02:54.876 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:54.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:54.890 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up' 2020-04-22T14:02:54.999 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:55.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:55.020 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up' 2020-04-22T14:02:55.127 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:55.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:55.140 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254' 2020-04-22T14:02:55.249 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:55.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:55.263 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:02:55.338 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:55.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:55.390 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge-slave con-name brx.1 ifname brx.1 master ceph-brx' 2020-04-22T14:02:55.497 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.1' (b7338bd6-7982-4cad-a1d2-1d41a176da88) successfully added. 2020-04-22T14:02:55.498 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:55.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:55.537 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up brx.1' 2020-04-22T14:02:55.704 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/6) 2020-04-22T14:02:55.755 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-04-22T14:02:55.755 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi103.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-04-22T14:02:55.755 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:55.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:02:55.770 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:02:55.832 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:55.883 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:02:55.883 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:02:55.950 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:02:55.959 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:02:55.959 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:56.004 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:02:56.005 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:02:56.066 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:02:56.066 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [47] 2020-04-22T14:02:56.066 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:56.116 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:02:56.159 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:56.173 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:02:56.173 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:02:56.242 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:02:56.248 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:02:56.248 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:56.249 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:2020-04-22T14:02:56.246+0000 7f19680bb1c0 -1 init, newargv = 0x559efef90b90 newargc=9 2020-04-22T14:02:56.249 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[39508]: starting ceph client 2020-04-22T14:02:56.253 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[39508]: starting fuse 2020-04-22T14:02:56.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:02:56.266 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:02:56.326 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:02:56.326 INFO:teuthology.orchestra.run.smithi103.stdout:49 2020-04-22T14:02:56.326 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47, 49] 2020-04-22T14:02:56.327 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:56.375 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:02:56.375 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:02:56.375 INFO:teuthology.orchestra.run.smithi103:> import glob 2020-04-22T14:02:56.375 INFO:teuthology.orchestra.run.smithi103:> import re 2020-04-22T14:02:56.375 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:02:56.375 INFO:teuthology.orchestra.run.smithi103:> import subprocess 2020-04-22T14:02:56.376 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:02:56.376 INFO:teuthology.orchestra.run.smithi103:> def find_socket(client_name): 2020-04-22T14:02:56.376 INFO:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-04-22T14:02:56.376 INFO:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2020-04-22T14:02:56.376 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:02:56.376 INFO:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2020-04-22T14:02:56.376 INFO:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2020-04-22T14:02:56.376 INFO:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2020-04-22T14:02:56.377 INFO:teuthology.orchestra.run.smithi103:> return files[0] 2020-04-22T14:02:56.377 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:02:56.377 INFO:teuthology.orchestra.run.smithi103:> for f in files: 2020-04-22T14:02:56.377 INFO:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:02:56.377 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:02:56.377 INFO:teuthology.orchestra.run.smithi103:> return f 2020-04-22T14:02:56.377 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:02:56.377 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:02:56.378 INFO:teuthology.orchestra.run.smithi103:> print(find_socket("client.0")) 2020-04-22T14:02:56.378 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:02:56.483 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.0.39508.asok 2020-04-22T14:02:56.483 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.39508.asok 2020-04-22T14:02:56.483 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:56.497 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:02:56.497 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.39508.asok status 2020-04-22T14:02:56.661 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:02:56.662 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2020-04-22T14:02:56.662 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:02:56.662 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:02:56.662 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "0", 2020-04-22T14:02:56.662 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:02:56.662 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-04-22T14:02:56.663 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "39508", 2020-04-22T14:02:56.663 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:02:56.663 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:02:56.663 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2020-04-22T14:02:56.663 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2020-04-22T14:02:56.663 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4397, 2020-04-22T14:02:56.663 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2020-04-22T14:02:56.664 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:02:56.664 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:02:56.664 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4397 2020-04-22T14:02:56.664 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:02:56.664 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:02:56.664 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:02:56.664 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:0", 2020-04-22T14:02:56.677 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 2543624848 2020-04-22T14:02:56.677 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:02:56.677 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:02:56.678 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:02:56.678 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:02:56.679 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:0", 2020-04-22T14:02:56.679 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 2543624848 2020-04-22T14:02:56.679 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:02:56.680 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.4397 172.21.15.103:0/2543624848", 2020-04-22T14:02:56.680 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "172.21.15.103:0/2543624848", 2020-04-22T14:02:56.680 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2020-04-22T14:02:56.680 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 5, 2020-04-22T14:02:56.680 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 24, 2020-04-22T14:02:56.680 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2020-04-22T14:02:56.680 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklisted": false 2020-04-22T14:02:56.681 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:02:56.682 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:56.698 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:02:56.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.843+0000 7ff0c4963700 1 Processor -- start 2020-04-22T14:02:56.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.843+0000 7ff0c4963700 1 -- start start 2020-04-22T14:02:56.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.844+0000 7ff0c4963700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff0c012c0d0 0x7ff0c01464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:56.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.844+0000 7ff0c4963700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0c0143300 con 0x7ff0c0065fe0 2020-04-22T14:02:56.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.844+0000 7ff0c4963700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0c01435a0 con 0x7ff0c0063e30 2020-04-22T14:02:56.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.844+0000 7ff0c4963700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0c0143840 con 0x7ff0c012c0d0 2020-04-22T14:02:56.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.844+0000 7ff0be59c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff0c012c0d0 0x7ff0c01464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:56.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.844+0000 7ff0bed9d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff0c0063e30 0x7ff0c00642c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39952/0 (socket says 172.21.15.103:39952) 2020-04-22T14:02:56.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.844+0000 7ff0be59c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff0c012c0d0 0x7ff0c01464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47758/0 (socket says 172.21.15.103:47758) 2020-04-22T14:02:56.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.844+0000 7ff0bed9d700 1 -- 172.21.15.103:0/1023477619 learned_addr learned my addr 172.21.15.103:0/1023477619 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:56.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.844+0000 7ff0be59c700 1 -- 172.21.15.103:0/1023477619 >> v1:172.21.15.103:6789/0 conn(0x7ff0c0063e30 legacy=0x7ff0c00642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:56.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.844+0000 7ff0be59c700 1 -- 172.21.15.103:0/1023477619 >> v1:172.21.15.86:6789/0 conn(0x7ff0c0065fe0 legacy=0x7ff0c005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:56.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.844+0000 7ff0bd59a700 1 -- 172.21.15.103:0/1023477619 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2322665100 0 0) 0x7ff0c01435a0 con 0x7ff0c0063e30 2020-04-22T14:02:56.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.844+0000 7ff0be59c700 1 -- 172.21.15.103:0/1023477619 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c005bb50 con 0x7ff0c012c0d0 2020-04-22T14:02:56.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.844+0000 7ff0be59c700 1 --2- 172.21.15.103:0/1023477619 >> v2:172.21.15.103:3300/0 conn(0x7ff0c012c0d0 0x7ff0c01464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff0b80032b0 tx=0x7ff0b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:56.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.844+0000 7ff0be59c700 1 --2- 172.21.15.103:0/1023477619 >> v2:172.21.15.103:3300/0 conn(0x7ff0c012c0d0 0x7ff0c01464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff0b80032b0 tx=0x7ff0b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:56.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.844+0000 7ff0be59c700 1 --2- 172.21.15.103:0/1023477619 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0c012c0d0 0x7ff0c01464e0 secure :-1 s=READY pgs=228 cs=0 l=1 rx=0x7ff0b80032b0 tx=0x7ff0b8007dc0).ready entity=mon.1 client_cookie=eba72a50a8fd30a0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:56.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.844+0000 7ff0be59c700 1 --2- 172.21.15.103:0/1023477619 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0c012c0d0 0x7ff0c01464e0 secure :-1 s=THROTTLE_DONE pgs=228 cs=0 l=1 rx=0x7ff0b80032b0 tx=0x7ff0b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:56.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.844+0000 7ff0bd59a700 1 -- 172.21.15.103:0/1023477619 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0b800a180 con 0x7ff0c012c0d0 2020-04-22T14:02:56.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.844+0000 7ff0be59c700 1 --2- 172.21.15.103:0/1023477619 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0c012c0d0 0x7ff0c01464e0 secure :-1 s=THROTTLE_DONE pgs=228 cs=0 l=1 rx=0x7ff0b80032b0 tx=0x7ff0b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:56.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.844+0000 7ff0be59c700 1 --2- 172.21.15.103:0/1023477619 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0c012c0d0 0x7ff0c01464e0 secure :-1 s=THROTTLE_DONE pgs=228 cs=0 l=1 rx=0x7ff0b80032b0 tx=0x7ff0b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:56.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.844+0000 7ff0bd59a700 1 -- 172.21.15.103:0/1023477619 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b800a2e0 con 0x7ff0c012c0d0 2020-04-22T14:02:56.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.844+0000 7ff0bd59a700 1 -- 172.21.15.103:0/1023477619 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0b800a700 con 0x7ff0c012c0d0 2020-04-22T14:02:56.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.844+0000 7ff0c4963700 1 -- 172.21.15.103:0/1023477619 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0c012c0d0 msgr2=0x7ff0c01464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:56.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.844+0000 7ff0c4963700 1 --2- 172.21.15.103:0/1023477619 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0c012c0d0 0x7ff0c01464e0 secure :-1 s=READY pgs=228 cs=0 l=1 rx=0x7ff0b80032b0 tx=0x7ff0b8007dc0).stop 2020-04-22T14:02:56.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.845+0000 7ff0c4963700 1 -- 172.21.15.103:0/1023477619 shutdown_connections 2020-04-22T14:02:56.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.845+0000 7ff0c4963700 1 --2- 172.21.15.103:0/1023477619 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0c012c0d0 0x7ff0c01464e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:56.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.845+0000 7ff0c4963700 1 -- 172.21.15.103:0/1023477619 >> 172.21.15.103:0/1023477619 conn(0x7ff0c00b9160 msgr2=0x7ff0c005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:56.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.845+0000 7ff0c4963700 1 -- 172.21.15.103:0/1023477619 shutdown_connections 2020-04-22T14:02:56.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.845+0000 7ff0c4963700 1 -- 172.21.15.103:0/1023477619 wait complete. 2020-04-22T14:02:56.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.846+0000 7ff0c4963700 1 Processor -- start 2020-04-22T14:02:56.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.846+0000 7ff0c4963700 1 -- start start 2020-04-22T14:02:56.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.847+0000 7ff0c4963700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0c0063e30 0x7ff0c00b8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:56.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.847+0000 7ff0c4963700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff0c012c0d0 0x7ff0c01202a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:56.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.847+0000 7ff0c4963700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0c013ccc0 con 0x7ff0c0065fe0 2020-04-22T14:02:56.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.847+0000 7ff0c4963700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0c013ed90 con 0x7ff0c012c0d0 2020-04-22T14:02:56.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.847+0000 7ff0c4963700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c0120c40 con 0x7ff0c0063e30 2020-04-22T14:02:56.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.847+0000 7ff0bdd9b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff0c0065fe0 0x7ff0c00b76f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39956/0 (socket says 172.21.15.103:39956) 2020-04-22T14:02:56.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.847+0000 7ff0bdd9b700 1 -- 172.21.15.103:0/2761393071 learned_addr learned my addr 172.21.15.103:0/2761393071 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:56.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.847+0000 7ff0bed9d700 1 --2- 172.21.15.103:0/2761393071 >> v2:172.21.15.86:3300/0 conn(0x7ff0c012c0d0 0x7ff0c01202a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:56.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.847+0000 7ff0be59c700 1 --2- 172.21.15.103:0/2761393071 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0c0063e30 0x7ff0c00b8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:56.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.847+0000 7ff0b77fe700 1 -- 172.21.15.103:0/2761393071 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2358149041 0 0) 0x7ff0c013ccc0 con 0x7ff0c0065fe0 2020-04-22T14:02:56.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.847+0000 7ff0b77fe700 1 -- 172.21.15.103:0/2761393071 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0a4002fe0 con 0x7ff0c0065fe0 2020-04-22T14:02:56.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.847+0000 7ff0b77fe700 1 -- 172.21.15.103:0/2761393071 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2031918261 0 0) 0x7ff0a4002fe0 con 0x7ff0c0065fe0 2020-04-22T14:02:56.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.847+0000 7ff0b77fe700 1 -- 172.21.15.103:0/2761393071 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff0c013ccc0 con 0x7ff0c0065fe0 2020-04-22T14:02:56.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.847+0000 7ff0b77fe700 1 -- 172.21.15.103:0/2761393071 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7ff0a8001960 con 0x7ff0c0065fe0 2020-04-22T14:02:56.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.847+0000 7ff0b77fe700 1 -- 172.21.15.103:0/2761393071 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0c0063e30 msgr2=0x7ff0c00b8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:56.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.847+0000 7ff0b77fe700 1 --2- 172.21.15.103:0/2761393071 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0c0063e30 0x7ff0c00b8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:56.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.847+0000 7ff0b77fe700 1 -- 172.21.15.103:0/2761393071 >> v2:172.21.15.86:3300/0 conn(0x7ff0c012c0d0 msgr2=0x7ff0c01202a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:56.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.847+0000 7ff0b77fe700 1 --2- 172.21.15.103:0/2761393071 >> v2:172.21.15.86:3300/0 conn(0x7ff0c012c0d0 0x7ff0c01202a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:56.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.847+0000 7ff0b77fe700 1 -- 172.21.15.103:0/2761393071 >> v1:172.21.15.103:6789/0 conn(0x7ff0c0065fe0 legacy=0x7ff0c00b76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:56.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.847+0000 7ff0b77fe700 1 --2- 172.21.15.103:0/2761393071 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0a40049b0 0x7ff0a4004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:56.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.847+0000 7ff0b77fe700 1 --2- 172.21.15.103:0/2761393071 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0a40052a0 0x7ff0a4003980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:56.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.847+0000 7ff0b77fe700 1 --2- 172.21.15.103:0/2761393071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0a4004010 0x7ff0a4004490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:56.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.847+0000 7ff0b77fe700 1 -- 172.21.15.103:0/2761393071 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c013ed90 con 0x7ff0a4004010 2020-04-22T14:02:56.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.847+0000 7ff0b77fe700 1 -- 172.21.15.103:0/2761393071 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c0120c40 con 0x7ff0a40052a0 2020-04-22T14:02:56.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.847+0000 7ff0b77fe700 1 -- 172.21.15.103:0/2761393071 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a400ba20 con 0x7ff0a40049b0 2020-04-22T14:02:56.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.847+0000 7ff0be59c700 1 --2- 172.21.15.103:0/2761393071 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0c0063e30 0x7ff0c00b8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:02:56.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.847+0000 7ff0bdd9b700 1 --2- 172.21.15.103:0/2761393071 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0a40052a0 0x7ff0a4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:56.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.848+0000 7ff0bed9d700 1 --2- 172.21.15.103:0/2761393071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0a4004010 0x7ff0a4004490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:56.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.848+0000 7ff0be59c700 1 --2- 172.21.15.103:0/2761393071 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0a40049b0 0x7ff0a4004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:56.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.848+0000 7ff0bdd9b700 1 -- 172.21.15.103:0/2761393071 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0a40049b0 msgr2=0x7ff0a4004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:56.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.848+0000 7ff0bdd9b700 1 --2- 172.21.15.103:0/2761393071 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0a40049b0 0x7ff0a4004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:56.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.848+0000 7ff0bdd9b700 1 -- 172.21.15.103:0/2761393071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0a4004010 msgr2=0x7ff0a4004490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:56.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.848+0000 7ff0bdd9b700 1 --2- 172.21.15.103:0/2761393071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0a4004010 0x7ff0a4004490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:56.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.848+0000 7ff0bdd9b700 1 -- 172.21.15.103:0/2761393071 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c013d080 con 0x7ff0a40052a0 2020-04-22T14:02:56.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.848+0000 7ff0c4963700 1 -- 172.21.15.103:0/2761393071 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0c0120700 con 0x7ff0a40052a0 2020-04-22T14:02:56.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.848+0000 7ff0bdd9b700 1 --2- 172.21.15.103:0/2761393071 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0a40052a0 0x7ff0a4003980 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff0a8001670 tx=0x7ff0a8011480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:56.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.848+0000 7ff0c4963700 1 -- 172.21.15.103:0/2761393071 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0c00b83a0 con 0x7ff0a40052a0 2020-04-22T14:02:56.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.848+0000 7ff0bdd9b700 1 --2- 172.21.15.103:0/2761393071 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0a40052a0 0x7ff0a4003980 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff0a8001670 tx=0x7ff0a8011480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:56.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.848+0000 7ff0bdd9b700 1 --2- 172.21.15.103:0/2761393071 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0a40052a0 0x7ff0a4003980 secure :-1 s=READY pgs=230 cs=0 l=1 rx=0x7ff0a8001670 tx=0x7ff0a8011480).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:56.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.848+0000 7ff0bdd9b700 1 --2- 172.21.15.103:0/2761393071 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0a40052a0 0x7ff0a4003980 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7ff0a8001670 tx=0x7ff0a8011480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:56.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.848+0000 7ff0b77fe700 1 -- 172.21.15.103:0/2761393071 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0a8011de0 con 0x7ff0a40052a0 2020-04-22T14:02:56.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.848+0000 7ff0bdd9b700 1 --2- 172.21.15.103:0/2761393071 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0a40052a0 0x7ff0a4003980 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7ff0a8001670 tx=0x7ff0a8011480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:56.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.848+0000 7ff0bdd9b700 1 --2- 172.21.15.103:0/2761393071 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0a40052a0 0x7ff0a4003980 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7ff0a8001670 tx=0x7ff0a8011480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:56.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.849+0000 7ff0bdd9b700 1 --2- 172.21.15.103:0/2761393071 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0a40052a0 0x7ff0a4003980 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7ff0a8001670 tx=0x7ff0a8011480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:56.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.849+0000 7ff0b77fe700 1 -- 172.21.15.103:0/2761393071 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a80054d0 con 0x7ff0a40052a0 2020-04-22T14:02:56.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.849+0000 7ff0b77fe700 1 -- 172.21.15.103:0/2761393071 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0a8005870 con 0x7ff0a40052a0 2020-04-22T14:02:56.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.849+0000 7ff0c4963700 1 -- 172.21.15.103:0/2761393071 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0c0120e40 con 0x7ff0a40052a0 2020-04-22T14:02:56.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.849+0000 7ff0b77fe700 1 -- 172.21.15.103:0/2761393071 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ff0a8005a90 con 0x7ff0a40052a0 2020-04-22T14:02:56.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.849+0000 7ff0bdd9b700 1 --2- 172.21.15.103:0/2761393071 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0a40052a0 0x7ff0a4003980 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7ff0a8001670 tx=0x7ff0a8011480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:56.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.849+0000 7ff0b77fe700 1 --2- 172.21.15.103:0/2761393071 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff0a4056180 0x7ff0a4058640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:56.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.849+0000 7ff0b77fe700 1 -- 172.21.15.103:0/2761393071 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff0a8061610 con 0x7ff0a40052a0 2020-04-22T14:02:56.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.849+0000 7ff0be59c700 1 --2- 172.21.15.103:0/2761393071 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff0a4056180 0x7ff0a4058640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:56.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.850+0000 7ff0be59c700 1 --2- 172.21.15.103:0/2761393071 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff0a4056180 0x7ff0a4058640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff0b80032b0 tx=0x7ff0b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:56.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.850+0000 7ff0be59c700 1 --2- 172.21.15.103:0/2761393071 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff0a4056180 0x7ff0a4058640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff0b80032b0 tx=0x7ff0b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:56.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.850+0000 7ff0be59c700 1 --2- 172.21.15.103:0/2761393071 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff0a4056180 0x7ff0a4058640 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7ff0b80032b0 tx=0x7ff0b8007dc0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:56.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.853+0000 7ff0bdd9b700 1 --2- 172.21.15.103:0/2761393071 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0a40052a0 0x7ff0a4003980 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7ff0a8001670 tx=0x7ff0a8011480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:56.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.853+0000 7ff0b77fe700 1 -- 172.21.15.103:0/2761393071 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ff0a803cbd0 con 0x7ff0a40052a0 2020-04-22T14:02:57.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.998+0000 7ff0c4963700 1 -- 172.21.15.103:0/2761393071 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0c013d440 con 0x7ff0a40052a0 2020-04-22T14:02:57.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.999+0000 7ff0bdd9b700 1 --2- 172.21.15.103:0/2761393071 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0a40052a0 0x7ff0a4003980 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7ff0a8001670 tx=0x7ff0a8011480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:56.999+0000 7ff0b77fe700 1 -- 172.21.15.103:0/2761393071 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16089 (secure 0 0 0) 0x7ff0a80401f0 con 0x7ff0a40052a0 2020-04-22T14:02:57.002 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:02:57.002 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":24,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:02:28.687155+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:02:25.963043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-22T14:02:26.642611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:02:57.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.000+0000 7ff0c4963700 1 -- 172.21.15.103:0/2761393071 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff0a4056180 msgr2=0x7ff0a4058640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:57.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.000+0000 7ff0c4963700 1 --2- 172.21.15.103:0/2761393071 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff0a4056180 0x7ff0a4058640 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7ff0b80032b0 tx=0x7ff0b8007dc0).stop 2020-04-22T14:02:57.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.000+0000 7ff0c4963700 1 -- 172.21.15.103:0/2761393071 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0a40052a0 msgr2=0x7ff0a4003980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:57.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.000+0000 7ff0c4963700 1 --2- 172.21.15.103:0/2761393071 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0a40052a0 0x7ff0a4003980 secure :-1 s=READY pgs=230 cs=0 l=1 rx=0x7ff0a8001670 tx=0x7ff0a8011480).stop 2020-04-22T14:02:57.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.000+0000 7ff0bed9d700 1 -- 172.21.15.103:0/2761393071 reap_dead start 2020-04-22T14:02:57.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.000+0000 7ff0c4963700 1 -- 172.21.15.103:0/2761393071 shutdown_connections 2020-04-22T14:02:57.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.000+0000 7ff0c4963700 1 -- 172.21.15.103:0/2761393071 >> 172.21.15.103:0/2761393071 conn(0x7ff0c00b9160 msgr2=0x7ff0c00b4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:57.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.000+0000 7ff0c4963700 1 -- 172.21.15.103:0/2761393071 shutdown_connections 2020-04-22T14:02:57.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.000+0000 7ff0c4963700 1 -- 172.21.15.103:0/2761393071 wait complete. 2020-04-22T14:02:57.014 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:25.963043+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:26.642611+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 4, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'24', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:02:57.015 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:57.029 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:02:57.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.176+0000 7fbc3932a700 1 Processor -- start 2020-04-22T14:02:57.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.176+0000 7fbc3932a700 1 -- start start 2020-04-22T14:02:57.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.176+0000 7fbc3932a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbc340b9140 0x7fbc3412b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:57.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.177+0000 7fbc3932a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbc3412b670 0x7fbc34143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:57.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.177+0000 7fbc3932a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc341467e0 con 0x7fbc340ac950 2020-04-22T14:02:57.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.177+0000 7fbc3932a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc340602f0 con 0x7fbc340b9140 2020-04-22T14:02:57.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.177+0000 7fbc3932a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc34060050 con 0x7fbc3412b670 2020-04-22T14:02:57.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.177+0000 7fbc32ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbc340b9140 0x7fbc3412b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:57.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.177+0000 7fbc32ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbc340b9140 0x7fbc3412b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47778/0 (socket says 172.21.15.103:47778) 2020-04-22T14:02:57.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.177+0000 7fbc32ffd700 1 -- 172.21.15.103:0/3874314148 learned_addr learned my addr 172.21.15.103:0/3874314148 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:57.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.177+0000 7fbc337fe700 1 --2- 172.21.15.103:0/3874314148 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbc3412b670 0x7fbc34143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:57.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.177+0000 7fbc32ffd700 1 -- 172.21.15.103:0/3874314148 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbc3412b670 msgr2=0x7fbc34143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:57.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.177+0000 7fbc32ffd700 1 --2- 172.21.15.103:0/3874314148 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbc3412b670 0x7fbc34143090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:57.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.177+0000 7fbc32ffd700 1 -- 172.21.15.103:0/3874314148 >> v1:172.21.15.86:6789/0 conn(0x7fbc340ac950 legacy=0x7fbc34146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:57.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.177+0000 7fbc32ffd700 1 -- 172.21.15.103:0/3874314148 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc340b9520 con 0x7fbc340b9140 2020-04-22T14:02:57.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.177+0000 7fbc32ffd700 1 --2- 172.21.15.103:0/3874314148 >> v2:172.21.15.103:3300/0 conn(0x7fbc340b9140 0x7fbc3412b210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbc340b6250 tx=0x7fbc1c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.177+0000 7fbc32ffd700 1 --2- 172.21.15.103:0/3874314148 >> v2:172.21.15.103:3300/0 conn(0x7fbc340b9140 0x7fbc3412b210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbc340b6250 tx=0x7fbc1c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.177+0000 7fbc32ffd700 1 --2- 172.21.15.103:0/3874314148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbc340b9140 0x7fbc3412b210 secure :-1 s=READY pgs=231 cs=0 l=1 rx=0x7fbc340b6250 tx=0x7fbc1c007a40).ready entity=mon.1 client_cookie=ce554236458a29be server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:57.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.177+0000 7fbc32ffd700 1 --2- 172.21.15.103:0/3874314148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbc340b9140 0x7fbc3412b210 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7fbc340b6250 tx=0x7fbc1c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.177+0000 7fbc31ffb700 1 -- 172.21.15.103:0/3874314148 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc1c0116e0 con 0x7fbc340b9140 2020-04-22T14:02:57.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.177+0000 7fbc32ffd700 1 --2- 172.21.15.103:0/3874314148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbc340b9140 0x7fbc3412b210 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7fbc340b6250 tx=0x7fbc1c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.177+0000 7fbc32ffd700 1 --2- 172.21.15.103:0/3874314148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbc340b9140 0x7fbc3412b210 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7fbc340b6250 tx=0x7fbc1c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.177+0000 7fbc31ffb700 1 -- 172.21.15.103:0/3874314148 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc1c011840 con 0x7fbc340b9140 2020-04-22T14:02:57.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.177+0000 7fbc31ffb700 1 -- 172.21.15.103:0/3874314148 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc1c011c60 con 0x7fbc340b9140 2020-04-22T14:02:57.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.177+0000 7fbc3932a700 1 -- 172.21.15.103:0/3874314148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbc340b9140 msgr2=0x7fbc3412b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:57.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.177+0000 7fbc3932a700 1 --2- 172.21.15.103:0/3874314148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbc340b9140 0x7fbc3412b210 secure :-1 s=READY pgs=231 cs=0 l=1 rx=0x7fbc340b6250 tx=0x7fbc1c007a40).stop 2020-04-22T14:02:57.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.178+0000 7fbc3932a700 1 -- 172.21.15.103:0/3874314148 shutdown_connections 2020-04-22T14:02:57.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.178+0000 7fbc3932a700 1 --2- 172.21.15.103:0/3874314148 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbc3412b670 0x7fbc34143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:57.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.178+0000 7fbc3932a700 1 --2- 172.21.15.103:0/3874314148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbc340b9140 0x7fbc3412b210 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:57.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.178+0000 7fbc3932a700 1 -- 172.21.15.103:0/3874314148 >> 172.21.15.103:0/3874314148 conn(0x7fbc3405b7b0 msgr2=0x7fbc340b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:57.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.178+0000 7fbc3932a700 1 -- 172.21.15.103:0/3874314148 shutdown_connections 2020-04-22T14:02:57.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.178+0000 7fbc3932a700 1 -- 172.21.15.103:0/3874314148 wait complete. 2020-04-22T14:02:57.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.179+0000 7fbc3932a700 1 Processor -- start 2020-04-22T14:02:57.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.179+0000 7fbc3932a700 1 -- start start 2020-04-22T14:02:57.190 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.180+0000 7fbc3932a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbc340ac950 0x7fbc34062a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:57.190 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.180+0000 7fbc3932a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbc3412b670 0x7fbc340b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:57.190 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.180+0000 7fbc3932a700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc34063590 con 0x7fbc340b9140 2020-04-22T14:02:57.190 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.180+0000 7fbc3932a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc340b5a40 con 0x7fbc340ac950 2020-04-22T14:02:57.190 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.180+0000 7fbc3932a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc340661a0 con 0x7fbc3412b670 2020-04-22T14:02:57.190 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.180+0000 7fbc327fc700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fbc340b9140 0x7fbc34143020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39976/0 (socket says 172.21.15.103:39976) 2020-04-22T14:02:57.191 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.180+0000 7fbc327fc700 1 -- 172.21.15.103:0/1707417848 learned_addr learned my addr 172.21.15.103:0/1707417848 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:57.191 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.180+0000 7fbc337fe700 1 --2- 172.21.15.103:0/1707417848 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbc3412b670 0x7fbc340b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:57.191 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.180+0000 7fbc32ffd700 1 --2- 172.21.15.103:0/1707417848 >> v2:172.21.15.86:3300/0 conn(0x7fbc340ac950 0x7fbc34062a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:57.191 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.180+0000 7fbc2bfff700 1 -- 172.21.15.103:0/1707417848 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3114652449 0 0) 0x7fbc34063590 con 0x7fbc340b9140 2020-04-22T14:02:57.191 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.180+0000 7fbc2bfff700 1 -- 172.21.15.103:0/1707417848 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc18002fe0 con 0x7fbc340b9140 2020-04-22T14:02:57.191 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.180+0000 7fbc32ffd700 1 -- 172.21.15.103:0/1707417848 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbc3412b670 msgr2=0x7fbc340b55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:57.191 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.180+0000 7fbc2bfff700 1 -- 172.21.15.103:0/1707417848 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3133207671 0 0) 0x7fbc18002fe0 con 0x7fbc340b9140 2020-04-22T14:02:57.191 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.180+0000 7fbc32ffd700 1 --2- 172.21.15.103:0/1707417848 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbc3412b670 0x7fbc340b55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:57.192 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.180+0000 7fbc32ffd700 1 -- 172.21.15.103:0/1707417848 >> v1:172.21.15.103:6789/0 conn(0x7fbc340b9140 legacy=0x7fbc34143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:57.192 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.180+0000 7fbc32ffd700 1 -- 172.21.15.103:0/1707417848 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc340637c0 con 0x7fbc340ac950 2020-04-22T14:02:57.192 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.180+0000 7fbc337fe700 1 --2- 172.21.15.103:0/1707417848 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbc3412b670 0x7fbc340b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:02:57.192 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.180+0000 7fbc32ffd700 1 --2- 172.21.15.103:0/1707417848 >> v2:172.21.15.86:3300/0 conn(0x7fbc340ac950 0x7fbc34062a70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbc24002b40 tx=0x7fbc1c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.192 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.180+0000 7fbc32ffd700 1 --2- 172.21.15.103:0/1707417848 >> v2:172.21.15.86:3300/0 conn(0x7fbc340ac950 0x7fbc34062a70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbc24002b40 tx=0x7fbc1c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.192 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.180+0000 7fbc32ffd700 1 --2- 172.21.15.103:0/1707417848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc340ac950 0x7fbc34062a70 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7fbc24002b40 tx=0x7fbc1c007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:57.192 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.180+0000 7fbc32ffd700 1 --2- 172.21.15.103:0/1707417848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc340ac950 0x7fbc34062a70 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fbc24002b40 tx=0x7fbc1c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.193 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.180+0000 7fbc2bfff700 1 -- 172.21.15.103:0/1707417848 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc240029a0 con 0x7fbc340ac950 2020-04-22T14:02:57.193 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.180+0000 7fbc32ffd700 1 --2- 172.21.15.103:0/1707417848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc340ac950 0x7fbc34062a70 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fbc24002b40 tx=0x7fbc1c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.193 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.180+0000 7fbc2bfff700 1 -- 172.21.15.103:0/1707417848 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc1c011b30 con 0x7fbc340ac950 2020-04-22T14:02:57.193 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.180+0000 7fbc32ffd700 1 --2- 172.21.15.103:0/1707417848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc340ac950 0x7fbc34062a70 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fbc24002b40 tx=0x7fbc1c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.193 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.180+0000 7fbc2bfff700 1 -- 172.21.15.103:0/1707417848 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc1c011e90 con 0x7fbc340ac950 2020-04-22T14:02:57.193 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.180+0000 7fbc3932a700 1 -- 172.21.15.103:0/1707417848 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc34063a60 con 0x7fbc340ac950 2020-04-22T14:02:57.193 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.181+0000 7fbc3932a700 1 -- 172.21.15.103:0/1707417848 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc34151be0 con 0x7fbc340ac950 2020-04-22T14:02:57.194 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.181+0000 7fbc32ffd700 1 --2- 172.21.15.103:0/1707417848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc340ac950 0x7fbc34062a70 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fbc24002b40 tx=0x7fbc1c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.194 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.181+0000 7fbc3932a700 1 -- 172.21.15.103:0/1707417848 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc34063bf0 con 0x7fbc340ac950 2020-04-22T14:02:57.194 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.182+0000 7fbc2bfff700 1 -- 172.21.15.103:0/1707417848 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fbc1c007170 con 0x7fbc340ac950 2020-04-22T14:02:57.194 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.182+0000 7fbc32ffd700 1 --2- 172.21.15.103:0/1707417848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc340ac950 0x7fbc34062a70 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fbc24002b40 tx=0x7fbc1c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.194 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.182+0000 7fbc2bfff700 1 --2- 172.21.15.103:0/1707417848 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbc1804dc90 0x7fbc18050150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:57.194 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.182+0000 7fbc2bfff700 1 -- 172.21.15.103:0/1707417848 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbc1c061520 con 0x7fbc340ac950 2020-04-22T14:02:57.194 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.182+0000 7fbc327fc700 1 --2- 172.21.15.103:0/1707417848 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbc1804dc90 0x7fbc18050150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:57.194 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.182+0000 7fbc327fc700 1 --2- 172.21.15.103:0/1707417848 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbc1804dc90 0x7fbc18050150 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbc24002b80 tx=0x7fbc24009610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.182+0000 7fbc327fc700 1 --2- 172.21.15.103:0/1707417848 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbc1804dc90 0x7fbc18050150 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbc24002b80 tx=0x7fbc24009610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.182+0000 7fbc327fc700 1 --2- 172.21.15.103:0/1707417848 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbc1804dc90 0x7fbc18050150 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7fbc24002b80 tx=0x7fbc24009610).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:57.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.186+0000 7fbc32ffd700 1 --2- 172.21.15.103:0/1707417848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc340ac950 0x7fbc34062a70 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fbc24002b40 tx=0x7fbc1c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.186+0000 7fbc2bfff700 1 -- 172.21.15.103:0/1707417848 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fbc1c03c9c0 con 0x7fbc340ac950 2020-04-22T14:02:57.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.330+0000 7fbc3932a700 1 -- 172.21.15.103:0/1707417848 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fbc340615f0 con 0x7fbc340ac950 2020-04-22T14:02:57.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.330+0000 7fbc32ffd700 1 --2- 172.21.15.103:0/1707417848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc340ac950 0x7fbc34062a70 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fbc24002b40 tx=0x7fbc1c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.330+0000 7fbc2bfff700 1 -- 172.21.15.103:0/1707417848 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v24) v1 ==== 110+0+10 (secure 0 0 0) 0x7fbc340615f0 con 0x7fbc340ac950 2020-04-22T14:02:57.334 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:02:57.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.332+0000 7fbc3932a700 1 -- 172.21.15.103:0/1707417848 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbc1804dc90 msgr2=0x7fbc18050150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:57.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.332+0000 7fbc3932a700 1 --2- 172.21.15.103:0/1707417848 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbc1804dc90 0x7fbc18050150 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7fbc24002b80 tx=0x7fbc24009610).stop 2020-04-22T14:02:57.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.332+0000 7fbc3932a700 1 -- 172.21.15.103:0/1707417848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc340ac950 msgr2=0x7fbc34062a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:57.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.332+0000 7fbc3932a700 1 --2- 172.21.15.103:0/1707417848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc340ac950 0x7fbc34062a70 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7fbc24002b40 tx=0x7fbc1c007a40).stop 2020-04-22T14:02:57.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.332+0000 7fbc3932a700 1 -- 172.21.15.103:0/1707417848 shutdown_connections 2020-04-22T14:02:57.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.332+0000 7fbc3932a700 1 --2- 172.21.15.103:0/1707417848 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbc3412b670 0x7fbc340b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:57.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.332+0000 7fbc3932a700 1 --2- 172.21.15.103:0/1707417848 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbc1804dc90 0x7fbc18050150 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:57.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.332+0000 7fbc3932a700 1 --2- 172.21.15.103:0/1707417848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc340ac950 0x7fbc34062a70 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:57.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.332+0000 7fbc3932a700 1 -- 172.21.15.103:0/1707417848 >> 172.21.15.103:0/1707417848 conn(0x7fbc3405b7b0 msgr2=0x7fbc3412a120 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:57.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.332+0000 7fbc3932a700 1 -- 172.21.15.103:0/1707417848 shutdown_connections 2020-04-22T14:02:57.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.332+0000 7fbc3932a700 1 -- 172.21.15.103:0/1707417848 wait complete. 2020-04-22T14:02:57.351 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:57.364 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:02:57.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.510+0000 7f3d65a24700 1 Processor -- start 2020-04-22T14:02:57.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.511+0000 7f3d65a24700 1 -- start start 2020-04-22T14:02:57.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.511+0000 7f3d65a24700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3d600b3bd0 0x7f3d60143650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:57.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.511+0000 7f3d65a24700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d60148310 con 0x7f3d600b9140 2020-04-22T14:02:57.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.511+0000 7f3d65a24700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d601485b0 con 0x7f3d60143ab0 2020-04-22T14:02:57.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.511+0000 7f3d65a24700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d600b9520 con 0x7f3d600b3bd0 2020-04-22T14:02:57.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.512+0000 7f3d5f7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f3d60143ab0 0x7f3d60143f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39982/0 (socket says 172.21.15.103:39982) 2020-04-22T14:02:57.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.512+0000 7f3d5f7fe700 1 -- 172.21.15.103:0/3380391503 learned_addr learned my addr 172.21.15.103:0/3380391503 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:57.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.512+0000 7f3d5e7fc700 1 --2- 172.21.15.103:0/3380391503 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3d600b3bd0 0x7f3d60143650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:57.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.512+0000 7f3d5dffb700 1 -- 172.21.15.103:0/3380391503 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3651675806 0 0) 0x7f3d601485b0 con 0x7f3d60143ab0 2020-04-22T14:02:57.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.512+0000 7f3d5dffb700 1 -- 172.21.15.103:0/3380391503 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d40003230 con 0x7f3d60143ab0 2020-04-22T14:02:57.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.512+0000 7f3d5dffb700 1 -- 172.21.15.103:0/3380391503 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3129018649 0 0) 0x7f3d40003230 con 0x7f3d60143ab0 2020-04-22T14:02:57.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.512+0000 7f3d5dffb700 1 -- 172.21.15.103:0/3380391503 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3d600b3bd0 msgr2=0x7f3d60143650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:57.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.512+0000 7f3d5dffb700 1 --2- 172.21.15.103:0/3380391503 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3d600b3bd0 0x7f3d60143650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:57.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.512+0000 7f3d5dffb700 1 -- 172.21.15.103:0/3380391503 >> v1:172.21.15.86:6789/0 conn(0x7f3d600b9140 legacy=0x7f3d600aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:57.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.512+0000 7f3d5dffb700 1 -- 172.21.15.103:0/3380391503 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d600b3050 con 0x7f3d60143ab0 2020-04-22T14:02:57.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.512+0000 7f3d5dffb700 1 -- 172.21.15.103:0/3380391503 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f3d58001a50 con 0x7f3d60143ab0 2020-04-22T14:02:57.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.512+0000 7f3d5dffb700 1 -- 172.21.15.103:0/3380391503 >> v1:172.21.15.103:6789/0 conn(0x7f3d60143ab0 legacy=0x7f3d60143f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:57.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.512+0000 7f3d5dffb700 1 --2- 172.21.15.103:0/3380391503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d40003720 0x7f3d40003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:57.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.512+0000 7f3d5dffb700 1 --2- 172.21.15.103:0/3380391503 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3d600b3bd0 0x7f3d40003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:57.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.512+0000 7f3d5dffb700 1 --2- 172.21.15.103:0/3380391503 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d40004520 0x7f3d400049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:57.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.512+0000 7f3d5dffb700 1 -- 172.21.15.103:0/3380391503 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d600b9520 con 0x7f3d40004520 2020-04-22T14:02:57.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.512+0000 7f3d5dffb700 1 -- 172.21.15.103:0/3380391503 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d40004ef0 con 0x7f3d40003720 2020-04-22T14:02:57.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.512+0000 7f3d5dffb700 1 -- 172.21.15.103:0/3380391503 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d400050b0 con 0x7f3d600b3bd0 2020-04-22T14:02:57.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.512+0000 7f3d5effd700 1 --2- 172.21.15.103:0/3380391503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d40003720 0x7f3d40003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:57.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.512+0000 7f3d5f7fe700 1 --2- 172.21.15.103:0/3380391503 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d40004520 0x7f3d400049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:57.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.512+0000 7f3d5e7fc700 1 --2- 172.21.15.103:0/3380391503 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3d600b3bd0 0x7f3d40003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:57.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.513+0000 7f3d5effd700 1 -- 172.21.15.103:0/3380391503 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3d600b3bd0 msgr2=0x7f3d40003ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:57.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.513+0000 7f3d5effd700 1 --2- 172.21.15.103:0/3380391503 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3d600b3bd0 0x7f3d40003ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:57.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.513+0000 7f3d5effd700 1 -- 172.21.15.103:0/3380391503 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d40004520 msgr2=0x7f3d400049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:57.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.513+0000 7f3d5effd700 1 --2- 172.21.15.103:0/3380391503 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d40004520 0x7f3d400049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:57.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.513+0000 7f3d5effd700 1 -- 172.21.15.103:0/3380391503 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d40003230 con 0x7f3d40003720 2020-04-22T14:02:57.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.513+0000 7f3d5effd700 1 --2- 172.21.15.103:0/3380391503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d40003720 0x7f3d40003b00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3d48000fe0 tx=0x7f3d4800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.513+0000 7f3d5effd700 1 --2- 172.21.15.103:0/3380391503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d40003720 0x7f3d40003b00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3d48000fe0 tx=0x7f3d4800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.513+0000 7f3d5effd700 1 --2- 172.21.15.103:0/3380391503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d40003720 0x7f3d40003b00 secure :-1 s=READY pgs=234 cs=0 l=1 rx=0x7f3d48000fe0 tx=0x7f3d4800fde0).ready entity=mon.1 client_cookie=16e1a17f12dd04d5 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:57.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.513+0000 7f3d5effd700 1 --2- 172.21.15.103:0/3380391503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d40003720 0x7f3d40003b00 secure :-1 s=THROTTLE_DONE pgs=234 cs=0 l=1 rx=0x7f3d48000fe0 tx=0x7f3d4800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.513+0000 7f3d5dffb700 1 -- 172.21.15.103:0/3380391503 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d48003560 con 0x7f3d40003720 2020-04-22T14:02:57.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.513+0000 7f3d5effd700 1 --2- 172.21.15.103:0/3380391503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d40003720 0x7f3d40003b00 secure :-1 s=THROTTLE_DONE pgs=234 cs=0 l=1 rx=0x7f3d48000fe0 tx=0x7f3d4800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.513+0000 7f3d5dffb700 1 -- 172.21.15.103:0/3380391503 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d48003700 con 0x7f3d40003720 2020-04-22T14:02:57.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.513+0000 7f3d5effd700 1 --2- 172.21.15.103:0/3380391503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d40003720 0x7f3d40003b00 secure :-1 s=THROTTLE_DONE pgs=234 cs=0 l=1 rx=0x7f3d48000fe0 tx=0x7f3d4800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.513+0000 7f3d5dffb700 1 -- 172.21.15.103:0/3380391503 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d48003b20 con 0x7f3d40003720 2020-04-22T14:02:57.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.513+0000 7f3d65a24700 1 -- 172.21.15.103:0/3380391503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d40003720 msgr2=0x7f3d40003b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:57.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.513+0000 7f3d65a24700 1 --2- 172.21.15.103:0/3380391503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d40003720 0x7f3d40003b00 secure :-1 s=READY pgs=234 cs=0 l=1 rx=0x7f3d48000fe0 tx=0x7f3d4800fde0).stop 2020-04-22T14:02:57.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.513+0000 7f3d5f7fe700 1 -- 172.21.15.103:0/3380391503 reap_dead start 2020-04-22T14:02:57.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.513+0000 7f3d65a24700 1 -- 172.21.15.103:0/3380391503 shutdown_connections 2020-04-22T14:02:57.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.513+0000 7f3d65a24700 1 -- 172.21.15.103:0/3380391503 >> 172.21.15.103:0/3380391503 conn(0x7f3d6005b7b0 msgr2=0x7f3d600b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:57.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.513+0000 7f3d65a24700 1 -- 172.21.15.103:0/3380391503 shutdown_connections 2020-04-22T14:02:57.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.513+0000 7f3d65a24700 1 -- 172.21.15.103:0/3380391503 wait complete. 2020-04-22T14:02:57.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.514+0000 7f3d65a24700 1 Processor -- start 2020-04-22T14:02:57.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.514+0000 7f3d65a24700 1 -- start start 2020-04-22T14:02:57.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.515+0000 7f3d65a24700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3d600664a0 0x7f3d601344b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:57.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.515+0000 7f3d65a24700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3d60064990 0x7f3d60133680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:57.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.515+0000 7f3d65a24700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3d60133ae0 0x7f3d600ad4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:57.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.515+0000 7f3d65a24700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d600acac0 con 0x7f3d60064990 2020-04-22T14:02:57.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.515+0000 7f3d65a24700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d600acd60 con 0x7f3d600664a0 2020-04-22T14:02:57.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.515+0000 7f3d65a24700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d600ad000 con 0x7f3d60133ae0 2020-04-22T14:02:57.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.515+0000 7f3d5effd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3d600664a0 0x7f3d601344b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:57.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.515+0000 7f3d5effd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3d600664a0 0x7f3d601344b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47802/0 (socket says 172.21.15.103:47802) 2020-04-22T14:02:57.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.515+0000 7f3d5effd700 1 -- 172.21.15.103:0/1604699311 learned_addr learned my addr 172.21.15.103:0/1604699311 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:57.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.515+0000 7f3d5e7fc700 1 --2- 172.21.15.103:0/1604699311 >> v2:172.21.15.86:3300/0 conn(0x7f3d60064990 0x7f3d60133680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:57.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.515+0000 7f3d5f7fe700 1 --2- 172.21.15.103:0/1604699311 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3d60133ae0 0x7f3d600ad4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:57.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.515+0000 7f3d5effd700 1 -- 172.21.15.103:0/1604699311 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3d60133ae0 msgr2=0x7f3d600ad4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:57.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.515+0000 7f3d5effd700 1 --2- 172.21.15.103:0/1604699311 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3d60133ae0 0x7f3d600ad4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:57.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.515+0000 7f3d5effd700 1 -- 172.21.15.103:0/1604699311 >> v2:172.21.15.86:3300/0 conn(0x7f3d60064990 msgr2=0x7f3d60133680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:57.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.515+0000 7f3d5effd700 1 --2- 172.21.15.103:0/1604699311 >> v2:172.21.15.86:3300/0 conn(0x7f3d60064990 0x7f3d60133680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:57.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.515+0000 7f3d5effd700 1 -- 172.21.15.103:0/1604699311 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d60066880 con 0x7f3d600664a0 2020-04-22T14:02:57.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.515+0000 7f3d5f7fe700 1 --2- 172.21.15.103:0/1604699311 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3d60133ae0 0x7f3d600ad4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:02:57.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.515+0000 7f3d5effd700 1 --2- 172.21.15.103:0/1604699311 >> v2:172.21.15.103:3300/0 conn(0x7f3d600664a0 0x7f3d601344b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3d48000fe0 tx=0x7f3d4800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.516+0000 7f3d5effd700 1 --2- 172.21.15.103:0/1604699311 >> v2:172.21.15.103:3300/0 conn(0x7f3d600664a0 0x7f3d601344b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3d48000fe0 tx=0x7f3d4800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.516+0000 7f3d5effd700 1 --2- 172.21.15.103:0/1604699311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d600664a0 0x7f3d601344b0 secure :-1 s=READY pgs=235 cs=0 l=1 rx=0x7f3d48000fe0 tx=0x7f3d4800fde0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:57.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.516+0000 7f3d5effd700 1 --2- 172.21.15.103:0/1604699311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d600664a0 0x7f3d601344b0 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f3d48000fe0 tx=0x7f3d4800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.516+0000 7f3d57fff700 1 -- 172.21.15.103:0/1604699311 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d48008370 con 0x7f3d600664a0 2020-04-22T14:02:57.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.516+0000 7f3d5effd700 1 --2- 172.21.15.103:0/1604699311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d600664a0 0x7f3d601344b0 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f3d48000fe0 tx=0x7f3d4800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.516+0000 7f3d5effd700 1 --2- 172.21.15.103:0/1604699311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d600664a0 0x7f3d601344b0 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f3d48000fe0 tx=0x7f3d4800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.516+0000 7f3d57fff700 1 -- 172.21.15.103:0/1604699311 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d48008a80 con 0x7f3d600664a0 2020-04-22T14:02:57.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.516+0000 7f3d57fff700 1 -- 172.21.15.103:0/1604699311 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d48008e60 con 0x7f3d600664a0 2020-04-22T14:02:57.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.516+0000 7f3d65a24700 1 -- 172.21.15.103:0/1604699311 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d60133f40 con 0x7f3d600664a0 2020-04-22T14:02:57.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.516+0000 7f3d65a24700 1 -- 172.21.15.103:0/1604699311 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d60111a60 con 0x7f3d600664a0 2020-04-22T14:02:57.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.516+0000 7f3d5effd700 1 --2- 172.21.15.103:0/1604699311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d600664a0 0x7f3d601344b0 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f3d48000fe0 tx=0x7f3d4800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.517+0000 7f3d65a24700 1 -- 172.21.15.103:0/1604699311 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d600ac900 con 0x7f3d600664a0 2020-04-22T14:02:57.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.517+0000 7f3d57fff700 1 -- 172.21.15.103:0/1604699311 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f3d480064e0 con 0x7f3d600664a0 2020-04-22T14:02:57.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.517+0000 7f3d5effd700 1 --2- 172.21.15.103:0/1604699311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d600664a0 0x7f3d601344b0 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f3d48000fe0 tx=0x7f3d4800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.517+0000 7f3d57fff700 1 --2- 172.21.15.103:0/1604699311 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3d4404d930 0x7f3d4404fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:57.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.517+0000 7f3d57fff700 1 -- 172.21.15.103:0/1604699311 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3d480619d0 con 0x7f3d600664a0 2020-04-22T14:02:57.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.517+0000 7f3d5e7fc700 1 --2- 172.21.15.103:0/1604699311 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3d4404d930 0x7f3d4404fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:57.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.518+0000 7f3d5e7fc700 1 --2- 172.21.15.103:0/1604699311 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3d4404d930 0x7f3d4404fdf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3d50002f30 tx=0x7f3d5000cb40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.518+0000 7f3d5e7fc700 1 --2- 172.21.15.103:0/1604699311 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3d4404d930 0x7f3d4404fdf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3d50002f30 tx=0x7f3d5000cb40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.518+0000 7f3d5e7fc700 1 --2- 172.21.15.103:0/1604699311 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3d4404d930 0x7f3d4404fdf0 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7f3d50002f30 tx=0x7f3d5000cb40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:57.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.521+0000 7f3d5effd700 1 --2- 172.21.15.103:0/1604699311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d600664a0 0x7f3d601344b0 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f3d48000fe0 tx=0x7f3d4800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.521+0000 7f3d57fff700 1 -- 172.21.15.103:0/1604699311 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f3d4803ce70 con 0x7f3d600664a0 2020-04-22T14:02:57.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.664+0000 7f3d65a24700 1 -- 172.21.15.103:0/1604699311 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3d60056c90 con 0x7f3d600664a0 2020-04-22T14:02:57.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.664+0000 7f3d5effd700 1 --2- 172.21.15.103:0/1604699311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d600664a0 0x7f3d601344b0 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f3d48000fe0 tx=0x7f3d4800fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.664+0000 7f3d57fff700 1 -- 172.21.15.103:0/1604699311 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3d48040490 con 0x7f3d600664a0 2020-04-22T14:02:57.668 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:02:57.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.665+0000 7f3d65a24700 1 -- 172.21.15.103:0/1604699311 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3d4404d930 msgr2=0x7f3d4404fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:57.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.665+0000 7f3d65a24700 1 --2- 172.21.15.103:0/1604699311 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3d4404d930 0x7f3d4404fdf0 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7f3d50002f30 tx=0x7f3d5000cb40).stop 2020-04-22T14:02:57.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.665+0000 7f3d65a24700 1 -- 172.21.15.103:0/1604699311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d600664a0 msgr2=0x7f3d601344b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:57.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.665+0000 7f3d65a24700 1 --2- 172.21.15.103:0/1604699311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d600664a0 0x7f3d601344b0 secure :-1 s=READY pgs=235 cs=0 l=1 rx=0x7f3d48000fe0 tx=0x7f3d4800fde0).stop 2020-04-22T14:02:57.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.665+0000 7f3d65a24700 1 -- 172.21.15.103:0/1604699311 shutdown_connections 2020-04-22T14:02:57.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.665+0000 7f3d65a24700 1 --2- 172.21.15.103:0/1604699311 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3d60133ae0 0x7f3d600ad4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:57.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.665+0000 7f3d65a24700 1 --2- 172.21.15.103:0/1604699311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d600664a0 0x7f3d601344b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:57.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.665+0000 7f3d65a24700 1 --2- 172.21.15.103:0/1604699311 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3d4404d930 0x7f3d4404fdf0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:57.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.665+0000 7f3d65a24700 1 --2- 172.21.15.103:0/1604699311 >> v2:172.21.15.86:3300/0 conn(0x7f3d60064990 0x7f3d60133680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:57.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.665+0000 7f3d65a24700 1 -- 172.21.15.103:0/1604699311 >> 172.21.15.103:0/1604699311 conn(0x7f3d6005b7b0 msgr2=0x7f3d600b8580 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:57.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.665+0000 7f3d65a24700 1 -- 172.21.15.103:0/1604699311 shutdown_connections 2020-04-22T14:02:57.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.665+0000 7f3d65a24700 1 -- 172.21.15.103:0/1604699311 wait complete. 2020-04-22T14:02:57.678 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:57.692 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-22T14:02:57.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.837+0000 7f4cf0bbe700 1 Processor -- start 2020-04-22T14:02:57.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.837+0000 7f4cf0bbe700 1 -- start start 2020-04-22T14:02:57.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.838+0000 7f4cf0bbe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4cec0b2590 0x7f4cec0620c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:57.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.838+0000 7f4cf0bbe700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cec0af250 con 0x7f4cec1463e0 2020-04-22T14:02:57.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.838+0000 7f4cf0bbe700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cec0af4f0 con 0x7f4cec061870 2020-04-22T14:02:57.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.838+0000 7f4cf0bbe700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cec061c50 con 0x7f4cec0b2590 2020-04-22T14:02:57.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.838+0000 7f4ceaffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4cec0b2590 0x7f4cec0620c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:57.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.838+0000 7f4ceb7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f4cec061870 0x7f4cec145cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39998/0 (socket says 172.21.15.103:39998) 2020-04-22T14:02:57.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.838+0000 7f4ceb7fe700 1 -- 172.21.15.103:0/1197235461 learned_addr learned my addr 172.21.15.103:0/1197235461 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:57.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.838+0000 7f4ceaffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4cec0b2590 0x7f4cec0620c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47810/0 (socket says 172.21.15.103:47810) 2020-04-22T14:02:57.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.839+0000 7f4ceaffd700 1 -- 172.21.15.103:0/1197235461 >> v1:172.21.15.103:6789/0 conn(0x7f4cec061870 legacy=0x7f4cec145cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:57.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.839+0000 7f4ceaffd700 1 -- 172.21.15.103:0/1197235461 >> v1:172.21.15.86:6789/0 conn(0x7f4cec1463e0 legacy=0x7f4cec142ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:57.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.839+0000 7f4ceaffd700 1 -- 172.21.15.103:0/1197235461 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cec0ad360 con 0x7f4cec0b2590 2020-04-22T14:02:57.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.839+0000 7f4ceaffd700 1 --2- 172.21.15.103:0/1197235461 >> v2:172.21.15.103:3300/0 conn(0x7f4cec0b2590 0x7f4cec0620c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4cec0b6130 tx=0x7f4ce0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.839+0000 7f4ceaffd700 1 --2- 172.21.15.103:0/1197235461 >> v2:172.21.15.103:3300/0 conn(0x7f4cec0b2590 0x7f4cec0620c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4cec0b6130 tx=0x7f4ce0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.839+0000 7f4ceaffd700 1 --2- 172.21.15.103:0/1197235461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cec0b2590 0x7f4cec0620c0 secure :-1 s=READY pgs=237 cs=0 l=1 rx=0x7f4cec0b6130 tx=0x7f4ce0007a40).ready entity=mon.1 client_cookie=1b16af8a7062faf9 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:57.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.839+0000 7f4ceaffd700 1 --2- 172.21.15.103:0/1197235461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cec0b2590 0x7f4cec0620c0 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7f4cec0b6130 tx=0x7f4ce0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.839+0000 7f4cea7fc700 1 -- 172.21.15.103:0/1197235461 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ce0011430 con 0x7f4cec0b2590 2020-04-22T14:02:57.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.839+0000 7f4ceaffd700 1 --2- 172.21.15.103:0/1197235461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cec0b2590 0x7f4cec0620c0 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7f4cec0b6130 tx=0x7f4ce0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.839+0000 7f4ceaffd700 1 --2- 172.21.15.103:0/1197235461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cec0b2590 0x7f4cec0620c0 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7f4cec0b6130 tx=0x7f4ce0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.839+0000 7f4cea7fc700 1 -- 172.21.15.103:0/1197235461 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce0011590 con 0x7f4cec0b2590 2020-04-22T14:02:57.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.839+0000 7f4cea7fc700 1 -- 172.21.15.103:0/1197235461 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ce00119b0 con 0x7f4cec0b2590 2020-04-22T14:02:57.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.839+0000 7f4cf0bbe700 1 -- 172.21.15.103:0/1197235461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cec0b2590 msgr2=0x7f4cec0620c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:57.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.839+0000 7f4cf0bbe700 1 --2- 172.21.15.103:0/1197235461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cec0b2590 0x7f4cec0620c0 secure :-1 s=READY pgs=237 cs=0 l=1 rx=0x7f4cec0b6130 tx=0x7f4ce0007a40).stop 2020-04-22T14:02:57.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.839+0000 7f4cf0bbe700 1 -- 172.21.15.103:0/1197235461 shutdown_connections 2020-04-22T14:02:57.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.839+0000 7f4cf0bbe700 1 --2- 172.21.15.103:0/1197235461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cec0b2590 0x7f4cec0620c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:57.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.839+0000 7f4cf0bbe700 1 -- 172.21.15.103:0/1197235461 >> 172.21.15.103:0/1197235461 conn(0x7f4cec05b780 msgr2=0x7f4cec0b8530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:57.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.839+0000 7f4cf0bbe700 1 -- 172.21.15.103:0/1197235461 shutdown_connections 2020-04-22T14:02:57.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.839+0000 7f4cf0bbe700 1 -- 172.21.15.103:0/1197235461 wait complete. 2020-04-22T14:02:57.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.840+0000 7f4cf0bbe700 1 Processor -- start 2020-04-22T14:02:57.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.841+0000 7f4cf0bbe700 1 -- start start 2020-04-22T14:02:57.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.841+0000 7f4cf0bbe700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4cec061870 0x7f4cec153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:57.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.841+0000 7f4cf0bbe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4cec1463e0 0x7f4cec1547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:57.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.841+0000 7f4cf0bbe700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cec0647c0 con 0x7f4cec0b2590 2020-04-22T14:02:57.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.841+0000 7f4cf0bbe700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cec154c40 con 0x7f4cec1463e0 2020-04-22T14:02:57.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.841+0000 7f4cf0bbe700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec063de0 con 0x7f4cec061870 2020-04-22T14:02:57.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.842+0000 7f4cebfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4cec1463e0 0x7f4cec1547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:57.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.842+0000 7f4ceb7fe700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4cec061870 0x7f4cec153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:57.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.842+0000 7f4cebfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4cec1463e0 0x7f4cec1547e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:45050/0 (socket says 172.21.15.103:45050) 2020-04-22T14:02:57.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.842+0000 7f4cebfff700 1 -- 172.21.15.103:0/1543165019 learned_addr learned my addr 172.21.15.103:0/1543165019 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:57.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.842+0000 7f4cebfff700 1 -- 172.21.15.103:0/1543165019 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4cec061870 msgr2=0x7f4cec153c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:57.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.842+0000 7f4cebfff700 1 --2- 172.21.15.103:0/1543165019 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4cec061870 0x7f4cec153c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:57.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.842+0000 7f4cebfff700 1 -- 172.21.15.103:0/1543165019 >> v1:172.21.15.86:6789/0 conn(0x7f4cec0b2590 legacy=0x7f4cec1391c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:57.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.842+0000 7f4cebfff700 1 -- 172.21.15.103:0/1543165019 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cec064080 con 0x7f4cec1463e0 2020-04-22T14:02:57.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.842+0000 7f4ce8ff9700 1 -- 172.21.15.103:0/1543165019 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3312759358 0 0) 0x7f4cec0647c0 con 0x7f4cec0b2590 2020-04-22T14:02:57.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.842+0000 7f4cebfff700 1 --2- 172.21.15.103:0/1543165019 >> v2:172.21.15.86:3300/0 conn(0x7f4cec1463e0 0x7f4cec1547e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4ce40022d0 tx=0x7f4ce4010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.842+0000 7f4cebfff700 1 --2- 172.21.15.103:0/1543165019 >> v2:172.21.15.86:3300/0 conn(0x7f4cec1463e0 0x7f4cec1547e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4ce40022d0 tx=0x7f4ce4010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.842+0000 7f4cebfff700 1 --2- 172.21.15.103:0/1543165019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cec1463e0 0x7f4cec1547e0 secure :-1 s=READY pgs=149 cs=0 l=1 rx=0x7f4ce40022d0 tx=0x7f4ce4010c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:57.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.842+0000 7f4cebfff700 1 --2- 172.21.15.103:0/1543165019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cec1463e0 0x7f4cec1547e0 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f4ce40022d0 tx=0x7f4ce4010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.842+0000 7f4ce8ff9700 1 -- 172.21.15.103:0/1543165019 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ce40122b0 con 0x7f4cec1463e0 2020-04-22T14:02:57.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.842+0000 7f4cebfff700 1 --2- 172.21.15.103:0/1543165019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cec1463e0 0x7f4cec1547e0 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f4ce40022d0 tx=0x7f4ce4010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.842+0000 7f4cebfff700 1 --2- 172.21.15.103:0/1543165019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cec1463e0 0x7f4cec1547e0 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f4ce40022d0 tx=0x7f4ce4010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.842+0000 7f4ce8ff9700 1 -- 172.21.15.103:0/1543165019 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce4012410 con 0x7f4cec1463e0 2020-04-22T14:02:57.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.842+0000 7f4cf0bbe700 1 -- 172.21.15.103:0/1543165019 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cec064320 con 0x7f4cec1463e0 2020-04-22T14:02:57.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.842+0000 7f4ce8ff9700 1 -- 172.21.15.103:0/1543165019 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ce40127f0 con 0x7f4cec1463e0 2020-04-22T14:02:57.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.843+0000 7f4cf0bbe700 1 -- 172.21.15.103:0/1543165019 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cec063740 con 0x7f4cec1463e0 2020-04-22T14:02:57.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.843+0000 7f4cebfff700 1 --2- 172.21.15.103:0/1543165019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cec1463e0 0x7f4cec1547e0 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f4ce40022d0 tx=0x7f4ce4010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.843+0000 7f4cf0bbe700 1 -- 172.21.15.103:0/1543165019 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cec063be0 con 0x7f4cec1463e0 2020-04-22T14:02:57.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.844+0000 7f4ce8ff9700 1 -- 172.21.15.103:0/1543165019 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f4ce4012a60 con 0x7f4cec1463e0 2020-04-22T14:02:57.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.844+0000 7f4cebfff700 1 --2- 172.21.15.103:0/1543165019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cec1463e0 0x7f4cec1547e0 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f4ce40022d0 tx=0x7f4ce4010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.844+0000 7f4ce8ff9700 1 --2- 172.21.15.103:0/1543165019 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4ccc04d870 0x7f4ccc04fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:57.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.844+0000 7f4ce8ff9700 1 -- 172.21.15.103:0/1543165019 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4ce4061ae0 con 0x7f4cec1463e0 2020-04-22T14:02:57.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.844+0000 7f4ceb7fe700 1 --2- 172.21.15.103:0/1543165019 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4ccc04d870 0x7f4ccc04fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:57.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.844+0000 7f4ceb7fe700 1 --2- 172.21.15.103:0/1543165019 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4ccc04d870 0x7f4ccc04fd30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4cec0b2aa0 tx=0x7f4cdc001890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.844+0000 7f4ceb7fe700 1 --2- 172.21.15.103:0/1543165019 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4ccc04d870 0x7f4ccc04fd30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4cec0b2aa0 tx=0x7f4cdc001890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.844+0000 7f4ceb7fe700 1 --2- 172.21.15.103:0/1543165019 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4ccc04d870 0x7f4ccc04fd30 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7f4cec0b2aa0 tx=0x7f4cdc001890).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:57.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.848+0000 7f4cebfff700 1 --2- 172.21.15.103:0/1543165019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cec1463e0 0x7f4cec1547e0 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f4ce40022d0 tx=0x7f4ce4010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.848+0000 7f4ce8ff9700 1 -- 172.21.15.103:0/1543165019 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f4ce403ce60 con 0x7f4cec1463e0 2020-04-22T14:02:57.991 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.987+0000 7f4cf0bbe700 1 -- 172.21.15.103:0/1543165019 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4cec056c90 con 0x7f4cec1463e0 2020-04-22T14:02:57.991 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.988+0000 7f4cebfff700 1 --2- 172.21.15.103:0/1543165019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cec1463e0 0x7f4cec1547e0 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f4ce40022d0 tx=0x7f4ce4010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:57.991 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.988+0000 7f4ce8ff9700 1 -- 172.21.15.103:0/1543165019 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7f4ce4040480 con 0x7f4cec1463e0 2020-04-22T14:02:57.992 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:02:57.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.989+0000 7f4cf0bbe700 1 -- 172.21.15.103:0/1543165019 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4ccc04d870 msgr2=0x7f4ccc04fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:57.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.989+0000 7f4cf0bbe700 1 --2- 172.21.15.103:0/1543165019 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4ccc04d870 0x7f4ccc04fd30 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7f4cec0b2aa0 tx=0x7f4cdc001890).stop 2020-04-22T14:02:57.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.989+0000 7f4cf0bbe700 1 -- 172.21.15.103:0/1543165019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cec1463e0 msgr2=0x7f4cec1547e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:57.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.989+0000 7f4cf0bbe700 1 --2- 172.21.15.103:0/1543165019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cec1463e0 0x7f4cec1547e0 secure :-1 s=READY pgs=149 cs=0 l=1 rx=0x7f4ce40022d0 tx=0x7f4ce4010c10).stop 2020-04-22T14:02:57.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.989+0000 7f4cf0bbe700 1 -- 172.21.15.103:0/1543165019 shutdown_connections 2020-04-22T14:02:57.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.989+0000 7f4cf0bbe700 1 --2- 172.21.15.103:0/1543165019 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4ccc04d870 0x7f4ccc04fd30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:57.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.989+0000 7f4cf0bbe700 1 --2- 172.21.15.103:0/1543165019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cec1463e0 0x7f4cec1547e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:57.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.989+0000 7f4cf0bbe700 1 --2- 172.21.15.103:0/1543165019 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4cec061870 0x7f4cec153c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:57.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.989+0000 7f4cf0bbe700 1 -- 172.21.15.103:0/1543165019 >> 172.21.15.103:0/1543165019 conn(0x7f4cec05b780 msgr2=0x7f4cec0b4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:57.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.990+0000 7f4cf0bbe700 1 -- 172.21.15.103:0/1543165019 shutdown_connections 2020-04-22T14:02:57.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:57.990+0000 7f4cf0bbe700 1 -- 172.21.15.103:0/1543165019 wait complete. 2020-04-22T14:02:58.003 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:58.016 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-22T14:02:58.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.161+0000 7f1cb7b15700 1 Processor -- start 2020-04-22T14:02:58.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.161+0000 7f1cb7b15700 1 -- start start 2020-04-22T14:02:58.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.162+0000 7f1cb7b15700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cb00acb10 0x7f1cb0142630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:58.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.162+0000 7f1cb7b15700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cb00af030 con 0x7f1cb00b4820 2020-04-22T14:02:58.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.162+0000 7f1cb7b15700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cb0060250 con 0x7f1cb0061a30 2020-04-22T14:02:58.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.162+0000 7f1cb7b15700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb00623c0 con 0x7f1cb00acb10 2020-04-22T14:02:58.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.162+0000 7f1cb58b1700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f1cb0061a30 0x7f1cb00ae920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40012/0 (socket says 172.21.15.103:40012) 2020-04-22T14:02:58.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.162+0000 7f1cb58b1700 1 -- 172.21.15.103:0/1302775948 learned_addr learned my addr 172.21.15.103:0/1302775948 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:58.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.162+0000 7f1cb60b2700 1 --2- 172.21.15.103:0/1302775948 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cb00acb10 0x7f1cb0142630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:58.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.163+0000 7f1cb48af700 1 -- 172.21.15.103:0/1302775948 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1178883862 0 0) 0x7f1cb0060250 con 0x7f1cb0061a30 2020-04-22T14:02:58.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.163+0000 7f1cb48af700 1 -- 172.21.15.103:0/1302775948 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c98003230 con 0x7f1cb0061a30 2020-04-22T14:02:58.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.163+0000 7f1cb48af700 1 -- 172.21.15.103:0/1302775948 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3346409130 0 0) 0x7f1cb00af030 con 0x7f1cb00b4820 2020-04-22T14:02:58.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.163+0000 7f1cb48af700 1 -- 172.21.15.103:0/1302775948 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cb0060250 con 0x7f1cb00b4820 2020-04-22T14:02:58.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.163+0000 7f1cb60b2700 1 -- 172.21.15.103:0/1302775948 >> v1:172.21.15.103:6789/0 conn(0x7f1cb0061a30 legacy=0x7f1cb00ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:58.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.163+0000 7f1cb60b2700 1 -- 172.21.15.103:0/1302775948 >> v1:172.21.15.86:6789/0 conn(0x7f1cb00b4820 legacy=0x7f1cb0141f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:58.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.163+0000 7f1cb60b2700 1 -- 172.21.15.103:0/1302775948 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb0062660 con 0x7f1cb00acb10 2020-04-22T14:02:58.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.163+0000 7f1cb60b2700 1 --2- 172.21.15.103:0/1302775948 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cb00acb10 0x7f1cb0142630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1ca80032b0 tx=0x7f1ca8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:58.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.163+0000 7f1cb60b2700 1 --2- 172.21.15.103:0/1302775948 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cb00acb10 0x7f1cb0142630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1ca80032b0 tx=0x7f1ca8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:58.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.163+0000 7f1cb60b2700 1 --2- 172.21.15.103:0/1302775948 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cb00acb10 0x7f1cb0142630 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7f1ca80032b0 tx=0x7f1ca8008c60).ready entity=mon.2 client_cookie=9b2f548913f336f9 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:58.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.163+0000 7f1cb60b2700 1 --2- 172.21.15.103:0/1302775948 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cb00acb10 0x7f1cb0142630 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f1ca80032b0 tx=0x7f1ca8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:58.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.163+0000 7f1cb48af700 1 -- 172.21.15.103:0/1302775948 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ca8011db0 con 0x7f1cb00acb10 2020-04-22T14:02:58.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.163+0000 7f1cb60b2700 1 --2- 172.21.15.103:0/1302775948 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cb00acb10 0x7f1cb0142630 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f1ca80032b0 tx=0x7f1ca8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:58.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.163+0000 7f1cb60b2700 1 --2- 172.21.15.103:0/1302775948 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cb00acb10 0x7f1cb0142630 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f1ca80032b0 tx=0x7f1ca8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:58.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.163+0000 7f1cb48af700 1 -- 172.21.15.103:0/1302775948 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca800a180 con 0x7f1cb00acb10 2020-04-22T14:02:58.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.163+0000 7f1cb48af700 1 -- 172.21.15.103:0/1302775948 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ca800a5a0 con 0x7f1cb00acb10 2020-04-22T14:02:58.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.163+0000 7f1cb7b15700 1 -- 172.21.15.103:0/1302775948 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cb00acb10 msgr2=0x7f1cb0142630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:58.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.163+0000 7f1cb7b15700 1 --2- 172.21.15.103:0/1302775948 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cb00acb10 0x7f1cb0142630 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7f1ca80032b0 tx=0x7f1ca8008c60).stop 2020-04-22T14:02:58.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.164+0000 7f1cb7b15700 1 -- 172.21.15.103:0/1302775948 shutdown_connections 2020-04-22T14:02:58.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.164+0000 7f1cb7b15700 1 --2- 172.21.15.103:0/1302775948 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cb00acb10 0x7f1cb0142630 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:58.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.164+0000 7f1cb7b15700 1 -- 172.21.15.103:0/1302775948 >> 172.21.15.103:0/1302775948 conn(0x7f1cb005b7b0 msgr2=0x7f1cb00b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:58.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.164+0000 7f1cb7b15700 1 -- 172.21.15.103:0/1302775948 shutdown_connections 2020-04-22T14:02:58.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.164+0000 7f1cb7b15700 1 -- 172.21.15.103:0/1302775948 wait complete. 2020-04-22T14:02:58.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.165+0000 7f1cb7b15700 1 Processor -- start 2020-04-22T14:02:58.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.165+0000 7f1cb7b15700 1 -- start start 2020-04-22T14:02:58.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.165+0000 7f1cb7b15700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cb0061a30 0x7f1cb0157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:58.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.165+0000 7f1cb7b15700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cb0114350 con 0x7f1cb00b4820 2020-04-22T14:02:58.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.165+0000 7f1cb7b15700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cb01145b0 con 0x7f1cb00acb10 2020-04-22T14:02:58.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.165+0000 7f1cb7b15700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb0114850 con 0x7f1cb0061a30 2020-04-22T14:02:58.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.165+0000 7f1cb50b0700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f1cb00acb10 0x7f1cb0156f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40018/0 (socket says 172.21.15.103:40018) 2020-04-22T14:02:58.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.165+0000 7f1cb50b0700 1 -- 172.21.15.103:0/913258674 learned_addr learned my addr 172.21.15.103:0/913258674 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:02:58.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.166+0000 7f1cb58b1700 1 --2- 172.21.15.103:0/913258674 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cb0061a30 0x7f1cb0157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:58.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.165+0000 7f1c9effd700 1 -- 172.21.15.103:0/913258674 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3991930483 0 0) 0x7f1cb01145b0 con 0x7f1cb00acb10 2020-04-22T14:02:58.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.166+0000 7f1c9effd700 1 -- 172.21.15.103:0/913258674 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c90002fe0 con 0x7f1cb00acb10 2020-04-22T14:02:58.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.166+0000 7f1c9effd700 1 -- 172.21.15.103:0/913258674 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1436794167 0 0) 0x7f1c90002fe0 con 0x7f1cb00acb10 2020-04-22T14:02:58.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.166+0000 7f1c9effd700 1 -- 172.21.15.103:0/913258674 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1cb01145b0 con 0x7f1cb00acb10 2020-04-22T14:02:58.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.166+0000 7f1c9effd700 1 -- 172.21.15.103:0/913258674 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f1cac001a00 con 0x7f1cb00acb10 2020-04-22T14:02:58.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.166+0000 7f1c9effd700 1 -- 172.21.15.103:0/913258674 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cb0061a30 msgr2=0x7f1cb0157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:58.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.166+0000 7f1c9effd700 1 --2- 172.21.15.103:0/913258674 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cb0061a30 0x7f1cb0157910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:58.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.166+0000 7f1c9effd700 1 -- 172.21.15.103:0/913258674 >> v1:172.21.15.103:6789/0 conn(0x7f1cb00acb10 legacy=0x7f1cb0156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:58.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.166+0000 7f1c9effd700 1 -- 172.21.15.103:0/913258674 >> v1:172.21.15.86:6789/0 conn(0x7f1cb00b4820 legacy=0x7f1cb0153280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:58.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.166+0000 7f1c9effd700 1 --2- 172.21.15.103:0/913258674 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cb0061a30 0x7f1c900049b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:58.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.166+0000 7f1c9effd700 1 --2- 172.21.15.103:0/913258674 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c90004e10 0x7f1c90005230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:58.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.166+0000 7f1c9effd700 1 --2- 172.21.15.103:0/913258674 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c900039e0 0x7f1c90003e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:58.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.166+0000 7f1c9effd700 1 -- 172.21.15.103:0/913258674 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb0114850 con 0x7f1c900039e0 2020-04-22T14:02:58.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.166+0000 7f1c9effd700 1 -- 172.21.15.103:0/913258674 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c90004410 con 0x7f1c90004e10 2020-04-22T14:02:58.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.166+0000 7f1c9effd700 1 -- 172.21.15.103:0/913258674 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c900045d0 con 0x7f1cb0061a30 2020-04-22T14:02:58.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.166+0000 7f1cb50b0700 1 --2- 172.21.15.103:0/913258674 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c90004e10 0x7f1c90005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:58.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.166+0000 7f1cb58b1700 1 --2- 172.21.15.103:0/913258674 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cb0061a30 0x7f1c900049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:58.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.166+0000 7f1cb60b2700 1 --2- 172.21.15.103:0/913258674 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c900039e0 0x7f1c90003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:58.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.166+0000 7f1cb50b0700 1 -- 172.21.15.103:0/913258674 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cb0061a30 msgr2=0x7f1c900049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:58.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.166+0000 7f1cb50b0700 1 --2- 172.21.15.103:0/913258674 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cb0061a30 0x7f1c900049b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:58.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.166+0000 7f1cb50b0700 1 -- 172.21.15.103:0/913258674 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c900039e0 msgr2=0x7f1c90003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:58.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.166+0000 7f1cb50b0700 1 --2- 172.21.15.103:0/913258674 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c900039e0 0x7f1c90003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:58.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.166+0000 7f1cb50b0700 1 -- 172.21.15.103:0/913258674 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb0157d70 con 0x7f1c90004e10 2020-04-22T14:02:58.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.166+0000 7f1cb7b15700 1 -- 172.21.15.103:0/913258674 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cb0157630 con 0x7f1c90004e10 2020-04-22T14:02:58.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.166+0000 7f1cb50b0700 1 --2- 172.21.15.103:0/913258674 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c90004e10 0x7f1c90005230 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1cac001710 tx=0x7f1cac0114c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:58.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.166+0000 7f1cb7b15700 1 -- 172.21.15.103:0/913258674 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cb01124f0 con 0x7f1c90004e10 2020-04-22T14:02:58.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.166+0000 7f1cb50b0700 1 --2- 172.21.15.103:0/913258674 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c90004e10 0x7f1c90005230 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1cac001710 tx=0x7f1cac0114c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:58.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.166+0000 7f1cb50b0700 1 --2- 172.21.15.103:0/913258674 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c90004e10 0x7f1c90005230 secure :-1 s=READY pgs=240 cs=0 l=1 rx=0x7f1cac001710 tx=0x7f1cac0114c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:58.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.167+0000 7f1cb50b0700 1 --2- 172.21.15.103:0/913258674 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c90004e10 0x7f1c90005230 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7f1cac001710 tx=0x7f1cac0114c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:58.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.167+0000 7f1c9effd700 1 -- 172.21.15.103:0/913258674 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cac011e20 con 0x7f1c90004e10 2020-04-22T14:02:58.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.167+0000 7f1cb50b0700 1 --2- 172.21.15.103:0/913258674 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c90004e10 0x7f1c90005230 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7f1cac001710 tx=0x7f1cac0114c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:58.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.167+0000 7f1cb50b0700 1 --2- 172.21.15.103:0/913258674 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c90004e10 0x7f1c90005230 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7f1cac001710 tx=0x7f1cac0114c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:58.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.167+0000 7f1c9effd700 1 -- 172.21.15.103:0/913258674 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cac00b080 con 0x7f1c90004e10 2020-04-22T14:02:58.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.167+0000 7f1c9effd700 1 -- 172.21.15.103:0/913258674 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cac00b3e0 con 0x7f1c90004e10 2020-04-22T14:02:58.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.167+0000 7f1cb50b0700 1 --2- 172.21.15.103:0/913258674 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c90004e10 0x7f1c90005230 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7f1cac001710 tx=0x7f1cac0114c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:58.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.167+0000 7f1cb7b15700 1 -- 172.21.15.103:0/913258674 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cb005f020 con 0x7f1c90004e10 2020-04-22T14:02:58.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.168+0000 7f1c9effd700 1 -- 172.21.15.103:0/913258674 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f1cac00a6c0 con 0x7f1c90004e10 2020-04-22T14:02:58.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.168+0000 7f1cb50b0700 1 --2- 172.21.15.103:0/913258674 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c90004e10 0x7f1c90005230 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7f1cac001710 tx=0x7f1cac0114c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:58.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.168+0000 7f1c9effd700 1 --2- 172.21.15.103:0/913258674 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1c90055ae0 0x7f1c90057fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:58.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.168+0000 7f1c9effd700 1 -- 172.21.15.103:0/913258674 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1cac061500 con 0x7f1c90004e10 2020-04-22T14:02:58.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.168+0000 7f1cb58b1700 1 --2- 172.21.15.103:0/913258674 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1c90055ae0 0x7f1c90057fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:58.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.168+0000 7f1cb58b1700 1 --2- 172.21.15.103:0/913258674 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1c90055ae0 0x7f1c90057fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1ca00010d0 tx=0x7f1ca000ca50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:58.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.168+0000 7f1cb58b1700 1 --2- 172.21.15.103:0/913258674 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1c90055ae0 0x7f1c90057fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1ca00010d0 tx=0x7f1ca000ca50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:58.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.168+0000 7f1cb58b1700 1 --2- 172.21.15.103:0/913258674 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1c90055ae0 0x7f1c90057fa0 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7f1ca00010d0 tx=0x7f1ca000ca50).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:58.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.172+0000 7f1cb50b0700 1 --2- 172.21.15.103:0/913258674 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c90004e10 0x7f1c90005230 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7f1cac001710 tx=0x7f1cac0114c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:58.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.172+0000 7f1c9effd700 1 -- 172.21.15.103:0/913258674 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f1cac03c940 con 0x7f1c90004e10 2020-04-22T14:02:58.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.313+0000 7f1cb7b15700 1 -- 172.21.15.103:0/913258674 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1cb0114a50 con 0x7f1c90004e10 2020-04-22T14:02:58.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.313+0000 7f1cb50b0700 1 --2- 172.21.15.103:0/913258674 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c90004e10 0x7f1c90005230 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7f1cac001710 tx=0x7f1cac0114c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:58.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.313+0000 7f1c9effd700 1 -- 172.21.15.103:0/913258674 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7f1cac03ff60 con 0x7f1c90004e10 2020-04-22T14:02:58.317 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:02:58.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.315+0000 7f1cb7b15700 1 -- 172.21.15.103:0/913258674 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1c90055ae0 msgr2=0x7f1c90057fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:58.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.315+0000 7f1cb7b15700 1 --2- 172.21.15.103:0/913258674 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1c90055ae0 0x7f1c90057fa0 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7f1ca00010d0 tx=0x7f1ca000ca50).stop 2020-04-22T14:02:58.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.315+0000 7f1cb7b15700 1 -- 172.21.15.103:0/913258674 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c90004e10 msgr2=0x7f1c90005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:58.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.315+0000 7f1cb7b15700 1 --2- 172.21.15.103:0/913258674 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c90004e10 0x7f1c90005230 secure :-1 s=READY pgs=240 cs=0 l=1 rx=0x7f1cac001710 tx=0x7f1cac0114c0).stop 2020-04-22T14:02:58.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.315+0000 7f1cb60b2700 1 -- 172.21.15.103:0/913258674 reap_dead start 2020-04-22T14:02:58.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.315+0000 7f1cb7b15700 1 -- 172.21.15.103:0/913258674 shutdown_connections 2020-04-22T14:02:58.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.315+0000 7f1cb7b15700 1 --2- 172.21.15.103:0/913258674 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c90004e10 0x7f1c90005230 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:58.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.315+0000 7f1cb7b15700 1 -- 172.21.15.103:0/913258674 >> 172.21.15.103:0/913258674 conn(0x7f1cb005b7b0 msgr2=0x7f1cb0141220 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:58.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.315+0000 7f1cb7b15700 1 -- 172.21.15.103:0/913258674 shutdown_connections 2020-04-22T14:02:58.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.315+0000 7f1cb7b15700 1 -- 172.21.15.103:0/913258674 wait complete. 2020-04-22T14:02:58.328 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-04-22T14:02:58.328 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:58.343 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:02:58.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.486+0000 7f4399146700 1 Processor -- start 2020-04-22T14:02:58.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.486+0000 7f4399146700 1 -- start start 2020-04-22T14:02:58.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.487+0000 7f4399146700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f439412c0d0 0x7f43941464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:58.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.487+0000 7f4399146700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4394065fe0 0x7f439405b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:58.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.487+0000 7f4399146700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f439405b8a0 0x7f4394062ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:02:58.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.487+0000 7f4399146700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f439412c4b0 con 0x7f4394065fe0 2020-04-22T14:02:58.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.487+0000 7f4399146700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4394143300 con 0x7f439412c0d0 2020-04-22T14:02:58.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.487+0000 7f4399146700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43941435a0 con 0x7f439405b8a0 2020-04-22T14:02:58.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.487+0000 7f4392d9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f439412c0d0 0x7f43941464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:58.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.487+0000 7f4392d9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f439412c0d0 0x7f43941464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47840/0 (socket says 172.21.15.103:47840) 2020-04-22T14:02:58.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.487+0000 7f4392d9d700 1 -- 172.21.15.103:0/893103620 learned_addr learned my addr 172.21.15.103:0/893103620 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:58.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.487+0000 7f439259c700 1 --2- 172.21.15.103:0/893103620 >> v2:172.21.15.86:3300/0 conn(0x7f4394065fe0 0x7f439405b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:58.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.487+0000 7f439359e700 1 --2- 172.21.15.103:0/893103620 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f439405b8a0 0x7f4394062ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:58.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.488+0000 7f4392d9d700 1 -- 172.21.15.103:0/893103620 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f439405b8a0 msgr2=0x7f4394062ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:58.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.488+0000 7f4392d9d700 1 --2- 172.21.15.103:0/893103620 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f439405b8a0 0x7f4394062ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:58.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.488+0000 7f4392d9d700 1 -- 172.21.15.103:0/893103620 >> v2:172.21.15.86:3300/0 conn(0x7f4394065fe0 msgr2=0x7f439405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:02:58.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.488+0000 7f4392d9d700 1 --2- 172.21.15.103:0/893103620 >> v2:172.21.15.86:3300/0 conn(0x7f4394065fe0 0x7f439405b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:58.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.488+0000 7f4392d9d700 1 -- 172.21.15.103:0/893103620 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4394143840 con 0x7f439412c0d0 2020-04-22T14:02:58.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.488+0000 7f439259c700 1 --2- 172.21.15.103:0/893103620 >> v2:172.21.15.86:3300/0 conn(0x7f4394065fe0 0x7f439405b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:02:58.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.488+0000 7f439359e700 1 --2- 172.21.15.103:0/893103620 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f439405b8a0 0x7f4394062ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:02:58.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.488+0000 7f4392d9d700 1 --2- 172.21.15.103:0/893103620 >> v2:172.21.15.103:3300/0 conn(0x7f439412c0d0 0x7f43941464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f437c002f30 tx=0x7f437c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:58.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.488+0000 7f4392d9d700 1 --2- 172.21.15.103:0/893103620 >> v2:172.21.15.103:3300/0 conn(0x7f439412c0d0 0x7f43941464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f437c002f30 tx=0x7f437c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:58.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.488+0000 7f4392d9d700 1 --2- 172.21.15.103:0/893103620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f439412c0d0 0x7f43941464e0 secure :-1 s=READY pgs=241 cs=0 l=1 rx=0x7f437c002f30 tx=0x7f437c007a40).ready entity=mon.1 client_cookie=a089e56ef8468f4d server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:58.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.488+0000 7f4392d9d700 1 --2- 172.21.15.103:0/893103620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f439412c0d0 0x7f43941464e0 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7f437c002f30 tx=0x7f437c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:58.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.488+0000 7f4391d9b700 1 -- 172.21.15.103:0/893103620 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f437c011720 con 0x7f439412c0d0 2020-04-22T14:02:58.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.488+0000 7f4392d9d700 1 --2- 172.21.15.103:0/893103620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f439412c0d0 0x7f43941464e0 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7f437c002f30 tx=0x7f437c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:58.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.488+0000 7f4392d9d700 1 --2- 172.21.15.103:0/893103620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f439412c0d0 0x7f43941464e0 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7f437c002f30 tx=0x7f437c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:58.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.488+0000 7f4391d9b700 1 -- 172.21.15.103:0/893103620 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f437c011880 con 0x7f439412c0d0 2020-04-22T14:02:58.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.488+0000 7f4391d9b700 1 -- 172.21.15.103:0/893103620 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f437c011ca0 con 0x7f439412c0d0 2020-04-22T14:02:58.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.488+0000 7f4399146700 1 -- 172.21.15.103:0/893103620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f439412c0d0 msgr2=0x7f43941464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:58.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.488+0000 7f4399146700 1 --2- 172.21.15.103:0/893103620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f439412c0d0 0x7f43941464e0 secure :-1 s=READY pgs=241 cs=0 l=1 rx=0x7f437c002f30 tx=0x7f437c007a40).stop 2020-04-22T14:02:58.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.488+0000 7f4399146700 1 -- 172.21.15.103:0/893103620 shutdown_connections 2020-04-22T14:02:58.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.488+0000 7f4399146700 1 --2- 172.21.15.103:0/893103620 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f439405b8a0 0x7f4394062ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:58.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.488+0000 7f4399146700 1 --2- 172.21.15.103:0/893103620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f439412c0d0 0x7f43941464e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:58.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.488+0000 7f4399146700 1 --2- 172.21.15.103:0/893103620 >> v2:172.21.15.86:3300/0 conn(0x7f4394065fe0 0x7f439405b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:02:58.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.488+0000 7f4399146700 1 -- 172.21.15.103:0/893103620 >> 172.21.15.103:0/893103620 conn(0x7f43940b9160 msgr2=0x7f439405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:58.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.488+0000 7f4399146700 1 -- 172.21.15.103:0/893103620 shutdown_connections 2020-04-22T14:02:58.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.489+0000 7f4399146700 1 -- 172.21.15.103:0/893103620 wait complete. 2020-04-22T14:02:58.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.489+0000 7f4399146700 1 Processor -- start 2020-04-22T14:02:58.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.489+0000 7f4399146700 1 -- start start 2020-04-22T14:02:58.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.490+0000 7f4399146700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f439405b8a0 0x7f4394128a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:58.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.490+0000 7f4399146700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4394129c30 con 0x7f4394065fe0 2020-04-22T14:02:58.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.490+0000 7f4399146700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4394129ed0 con 0x7f439412c0d0 2020-04-22T14:02:58.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.490+0000 7f4399146700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f439412a170 con 0x7f439405b8a0 2020-04-22T14:02:58.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.490+0000 7f4392d9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f439405b8a0 0x7f4394128a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:58.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.490+0000 7f4392d9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f439405b8a0 0x7f4394128a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47846/0 (socket says 172.21.15.103:47846) 2020-04-22T14:02:58.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.490+0000 7f4392d9d700 1 -- 172.21.15.103:0/2120849057 learned_addr learned my addr 172.21.15.103:0/2120849057 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:02:58.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.490+0000 7f4392d9d700 1 -- 172.21.15.103:0/2120849057 >> v1:172.21.15.103:6789/0 conn(0x7f439412c0d0 legacy=0x7f43940ac820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:58.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.490+0000 7f4392d9d700 1 -- 172.21.15.103:0/2120849057 >> v1:172.21.15.86:6789/0 conn(0x7f4394065fe0 legacy=0x7f43941199a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:58.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.490+0000 7f438bfff700 1 -- 172.21.15.103:0/2120849057 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4083285089 0 0) 0x7f4394129ed0 con 0x7f439412c0d0 2020-04-22T14:02:58.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.490+0000 7f4392d9d700 1 -- 172.21.15.103:0/2120849057 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f439411a0b0 con 0x7f439405b8a0 2020-04-22T14:02:58.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.491+0000 7f4392d9d700 1 --2- 172.21.15.103:0/2120849057 >> v2:172.21.15.103:3300/0 conn(0x7f439405b8a0 0x7f4394128a00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f43940b1130 tx=0x7f437c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:58.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.491+0000 7f4392d9d700 1 --2- 172.21.15.103:0/2120849057 >> v2:172.21.15.103:3300/0 conn(0x7f439405b8a0 0x7f4394128a00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f43940b1130 tx=0x7f437c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:58.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.491+0000 7f4392d9d700 1 --2- 172.21.15.103:0/2120849057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f439405b8a0 0x7f4394128a00 secure :-1 s=READY pgs=243 cs=0 l=1 rx=0x7f43940b1130 tx=0x7f437c007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:58.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.491+0000 7f4392d9d700 1 --2- 172.21.15.103:0/2120849057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f439405b8a0 0x7f4394128a00 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f43940b1130 tx=0x7f437c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:58.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.491+0000 7f438bfff700 1 -- 172.21.15.103:0/2120849057 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f437c007170 con 0x7f439405b8a0 2020-04-22T14:02:58.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.491+0000 7f4392d9d700 1 --2- 172.21.15.103:0/2120849057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f439405b8a0 0x7f4394128a00 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f43940b1130 tx=0x7f437c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:58.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.491+0000 7f4392d9d700 1 --2- 172.21.15.103:0/2120849057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f439405b8a0 0x7f4394128a00 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f43940b1130 tx=0x7f437c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:58.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.491+0000 7f438bfff700 1 -- 172.21.15.103:0/2120849057 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f437c0072d0 con 0x7f439405b8a0 2020-04-22T14:02:58.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.491+0000 7f438bfff700 1 -- 172.21.15.103:0/2120849057 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f437c0056c0 con 0x7f439405b8a0 2020-04-22T14:02:58.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.491+0000 7f4399146700 1 -- 172.21.15.103:0/2120849057 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43941298f0 con 0x7f439405b8a0 2020-04-22T14:02:58.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.491+0000 7f4399146700 1 -- 172.21.15.103:0/2120849057 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43940aed40 con 0x7f439405b8a0 2020-04-22T14:02:58.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.491+0000 7f4392d9d700 1 --2- 172.21.15.103:0/2120849057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f439405b8a0 0x7f4394128a00 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f43940b1130 tx=0x7f437c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:58.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.492+0000 7f4399146700 1 -- 172.21.15.103:0/2120849057 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4394056c90 con 0x7f439405b8a0 2020-04-22T14:02:58.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.492+0000 7f438bfff700 1 -- 172.21.15.103:0/2120849057 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f437c005820 con 0x7f439405b8a0 2020-04-22T14:02:58.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.492+0000 7f4392d9d700 1 --2- 172.21.15.103:0/2120849057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f439405b8a0 0x7f4394128a00 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f43940b1130 tx=0x7f437c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:58.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.492+0000 7f438bfff700 1 --2- 172.21.15.103:0/2120849057 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f437804d870 0x7f437804fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:02:58.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.492+0000 7f438bfff700 1 -- 172.21.15.103:0/2120849057 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f437c061be0 con 0x7f439405b8a0 2020-04-22T14:02:58.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.492+0000 7f439259c700 1 --2- 172.21.15.103:0/2120849057 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f437804d870 0x7f437804fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:02:58.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.493+0000 7f439259c700 1 --2- 172.21.15.103:0/2120849057 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f437804d870 0x7f437804fd30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4384002f30 tx=0x7f4384008d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:58.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.493+0000 7f439259c700 1 --2- 172.21.15.103:0/2120849057 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f437804d870 0x7f437804fd30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4384002f30 tx=0x7f4384008d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:58.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.493+0000 7f439259c700 1 --2- 172.21.15.103:0/2120849057 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f437804d870 0x7f437804fd30 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7f4384002f30 tx=0x7f4384008d70).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:02:58.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.496+0000 7f4392d9d700 1 --2- 172.21.15.103:0/2120849057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f439405b8a0 0x7f4394128a00 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f43940b1130 tx=0x7f437c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:58.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.496+0000 7f438bfff700 1 -- 172.21.15.103:0/2120849057 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f437c03d080 con 0x7f439405b8a0 2020-04-22T14:02:58.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.684+0000 7f4399146700 1 -- 172.21.15.103:0/2120849057 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f43940b47c0 con 0x7f439405b8a0 2020-04-22T14:02:58.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.685+0000 7f4392d9d700 1 --2- 172.21.15.103:0/2120849057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f439405b8a0 0x7f4394128a00 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f43940b1130 tx=0x7f437c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:02:58.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.685+0000 7f438bfff700 1 -- 172.21.15.103:0/2120849057 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2137 (secure 0 0 0) 0x7f437c0406a0 con 0x7f439405b8a0 2020-04-22T14:02:58.689 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:02:58.689 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/3739398122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3739398122},{"type":"v1","addr":"172.21.15.86:6835","nonce":3739398122}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":6}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:02:27.685979+0000","modified":"2020-04-22T14:02:32.276953+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4357},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4357":{"gid":4357,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.103:6833/1765986263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1765986263},{"type":"v1","addr":"172.21.15.103:6833","nonce":1765986263}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-22T14:02:58.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.686+0000 7f4399146700 1 -- 172.21.15.103:0/2120849057 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f437804d870 msgr2=0x7f437804fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:58.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.686+0000 7f4399146700 1 --2- 172.21.15.103:0/2120849057 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f437804d870 0x7f437804fd30 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7f4384002f30 tx=0x7f4384008d70).stop 2020-04-22T14:02:58.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.686+0000 7f4399146700 1 -- 172.21.15.103:0/2120849057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f439405b8a0 msgr2=0x7f4394128a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:02:58.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.686+0000 7f4399146700 1 --2- 172.21.15.103:0/2120849057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f439405b8a0 0x7f4394128a00 secure :-1 s=READY pgs=243 cs=0 l=1 rx=0x7f43940b1130 tx=0x7f437c007a40).stop 2020-04-22T14:02:58.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.686+0000 7f4399146700 1 -- 172.21.15.103:0/2120849057 shutdown_connections 2020-04-22T14:02:58.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.686+0000 7f4399146700 1 --2- 172.21.15.103:0/2120849057 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f437804d870 0x7f437804fd30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:58.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.686+0000 7f4399146700 1 --2- 172.21.15.103:0/2120849057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f439405b8a0 0x7f4394128a00 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:02:58.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.686+0000 7f4399146700 1 -- 172.21.15.103:0/2120849057 >> 172.21.15.103:0/2120849057 conn(0x7f43940b9160 msgr2=0x7f43940b65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:02:58.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.686+0000 7f4399146700 1 -- 172.21.15.103:0/2120849057 shutdown_connections 2020-04-22T14:02:58.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:02:58.686+0000 7f4399146700 1 -- 172.21.15.103:0/2120849057 wait complete. 2020-04-22T14:02:58.691 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 6 2020-04-22T14:02:58.901 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4357}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 3, u'failed': [], u'epoch': 5, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [4], u'info': {u'gid_4357': {u'export_targets': [], u'name': u'a', u'incarnation': 4, u'state_seq': 2, u'state': u'up:active', u'gid': 4357, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 1765986263, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 1765986263, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/1765986263'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:02:27.685979+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:02:32.276953+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:02:58.901 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:02:58.903 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:02:58.916 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:02:59.074 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:02:59.075 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:02:59.075 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:02:59.075 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4357, 2020-04-22T14:02:59.075 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:02:59.075 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:02:59.075 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 27.800605595, 2020-04-22T14:02:59.075 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 5, 2020-04-22T14:02:59.075 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 24, 2020-04-22T14:02:59.076 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 24, 2020-04-22T14:02:59.076 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 28.507049761000001 2020-04-22T14:02:59.076 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:02:59.083 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 4357, "want_state": "up:active", "state": "up:active", "rank_uptime": 27.800605595, "mdsmap_epoch": 5, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "uptime": 28.507049761000001 } 2020-04-22T14:02:59.083 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-04-22T14:02:59.083 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2020-04-22T14:02:59.083 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:59.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:59.100 INFO:teuthology.orchestra.run.smithi086:> ip addr 2020-04-22T14:02:59.167 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:02:59.167 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:02:59.167 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:02:59.167 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:02:59.167 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2020-04-22T14:02:59.168 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:02:59.168 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:02:59.168 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:02:59.168 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:02:59.168 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:02:59.168 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:02:59.169 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:02:59.169 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:02:59.169 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:02:59.169 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:02:59.169 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 42635sec preferred_lft 42635sec 2020-04-22T14:02:59.169 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2020-04-22T14:02:59.169 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:02:59.173 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-04-22T14:02:59.173 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:59.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:59.223 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:02:59.307 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:59.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:59.358 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'nmcli connection add type bridge con-name ceph-brx ifname ceph-brx stp no' 2020-04-22T14:02:59.517 INFO:teuthology.orchestra.run.smithi086.stdout:Connection 'ceph-brx' (8d9e7874-59bc-4ab5-9322-66e8d608582b) successfully added. 2020-04-22T14:02:59.517 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:59.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:59.534 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'nmcli connection modify ceph-brx ipv4.addresses 192.168.255.254/16 ipv4.method manual' 2020-04-22T14:02:59.646 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:59.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:59.669 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'nmcli connection up ceph-brx' 2020-04-22T14:02:59.784 INFO:teuthology.orchestra.run.smithi086.stdout:Connection successfully activated (master waiting for slaves) (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/4) 2020-04-22T14:02:59.784 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:59.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:59.801 INFO:teuthology.orchestra.run.smithi086:> touch /tmp/python-ceph-brx 2020-04-22T14:02:59.862 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:02:59.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:02:59.909 INFO:teuthology.orchestra.run.smithi086:> cat /proc/sys/net/ipv4/ip_forward 2020-04-22T14:02:59.969 INFO:teuthology.orchestra.run.smithi086.stdout:0 2020-04-22T14:02:59.970 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:00.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:00.016 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'echo 0 > /tmp/python-ceph-brx' 2020-04-22T14:03:00.107 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:00.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:00.144 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'echo 1 > /proc/sys/net/ipv4/ip_forward' 2020-04-22T14:03:00.221 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:00.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:00.264 INFO:teuthology.orchestra.run.smithi086:> route 2020-04-22T14:03:00.341 INFO:teuthology.orchestra.run.smithi086.stdout:Kernel IP routing table 2020-04-22T14:03:00.342 INFO:teuthology.orchestra.run.smithi086.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-04-22T14:03:00.342 INFO:teuthology.orchestra.run.smithi086.stdout:default _gateway 0.0.0.0 UG 102 0 0 enp3s0f1 2020-04-22T14:03:00.342 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 102 0 0 enp3s0f1 2020-04-22T14:03:00.342 INFO:teuthology.orchestra.run.smithi086.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 425 0 0 ceph-brx 2020-04-22T14:03:00.343 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:00.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:00.389 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-04-22T14:03:00.555 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:00.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:00.572 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-04-22T14:03:00.647 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:00.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:00.693 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-04-22T14:03:00.861 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:00.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:00.878 INFO:teuthology.orchestra.run.smithi086:> ip netns list 2020-04-22T14:03:00.937 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:00.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:00.988 INFO:teuthology.orchestra.run.smithi086:> ip netns list-id 2020-04-22T14:03:01.053 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:01.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:01.096 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3' 2020-04-22T14:03:01.176 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:01.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:01.220 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 0' 2020-04-22T14:03:01.297 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.1/16 2020-04-22T14:03:01.297 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:01.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:01.342 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.0' 2020-04-22T14:03:01.434 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:01.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:01.475 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0' 2020-04-22T14:03:01.597 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:01.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:01.626 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up' 2020-04-22T14:03:01.733 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:01.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:01.747 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up' 2020-04-22T14:03:01.854 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:01.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:01.883 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254' 2020-04-22T14:03:01.998 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:02.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:02.012 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:03:02.090 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:02.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:02.140 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'nmcli connection add type bridge-slave con-name brx.0 ifname brx.0 master ceph-brx' 2020-04-22T14:03:02.248 INFO:teuthology.orchestra.run.smithi086.stdout:Connection 'brx.0' (5c137a92-5a36-47f6-aefc-25f68ee80ed5) successfully added. 2020-04-22T14:03:02.249 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:02.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:02.279 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'nmcli connection up brx.0' 2020-04-22T14:03:02.440 INFO:teuthology.orchestra.run.smithi086.stdout:Connection successfully activated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/5) 2020-04-22T14:03:02.496 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2020-04-22T14:03:02.496 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.3 at ubuntu@smithi086.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.3... 2020-04-22T14:03:02.496 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:02.526 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:02.526 INFO:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.3) 2020-04-22T14:03:02.587 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:02.642 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:02.643 INFO:teuthology.orchestra.run.smithi086:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:03:02.712 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:03:02.719 INFO:teuthology.orchestra.run.smithi086.stderr:mount: /sys/fs/fuse/connections: mount point does not exist. 2020-04-22T14:03:02.720 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:02.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:02.767 INFO:teuthology.orchestra.run.smithi086:> ls /sys/fs/fuse/connections 2020-04-22T14:03:02.821 DEBUG:teuthology.orchestra.run:got remote process result: 2 2020-04-22T14:03:02.825 INFO:teuthology.orchestra.run.smithi086.stderr:ls: cannot access '/sys/fs/fuse/connections': No such file or directory 2020-04-22T14:03:02.826 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-04-22T14:03:02.827 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:02.877 INFO:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.3 /home/ubuntu/cephtest/mnt.3) 2020-04-22T14:03:02.919 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:02.932 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:02.932 INFO:teuthology.orchestra.run.smithi086:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:03:03.006 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:03:03.015 INFO:teuthology.orchestra.run.smithi086.stderr:mount: /sys/fs/fuse/connections: mount point does not exist. 2020-04-22T14:03:03.016 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:03.021 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi086.stderr:2020-04-22T14:03:03.017+0000 7f8d003781c0 -1 init, newargv = 0x5624c5a8fdf0 newargc=9 2020-04-22T14:03:03.022 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi086.stderr:ceph-fuse[35322]: starting ceph client 2020-04-22T14:03:03.034 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:03.034 INFO:teuthology.orchestra.run.smithi086:> ls /sys/fs/fuse/connections 2020-04-22T14:03:03.060 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi086.stderr:ceph-fuse[35322]: starting fuse 2020-04-22T14:03:04.181 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:04.198 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:04.198 INFO:teuthology.orchestra.run.smithi086:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:03:04.290 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:04.331 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:04.331 INFO:teuthology.orchestra.run.smithi086:> ls /sys/fs/fuse/connections 2020-04-22T14:03:04.393 INFO:teuthology.orchestra.run.smithi086.stdout:47 2020-04-22T14:03:04.394 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2020-04-22T14:03:04.394 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:04.444 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:04.445 INFO:teuthology.orchestra.run.smithi086:> sudo python3 -c ' 2020-04-22T14:03:04.445 INFO:teuthology.orchestra.run.smithi086:> import glob 2020-04-22T14:03:04.445 INFO:teuthology.orchestra.run.smithi086:> import re 2020-04-22T14:03:04.445 INFO:teuthology.orchestra.run.smithi086:> import os 2020-04-22T14:03:04.445 INFO:teuthology.orchestra.run.smithi086:> import subprocess 2020-04-22T14:03:04.446 INFO:teuthology.orchestra.run.smithi086:> 2020-04-22T14:03:04.446 INFO:teuthology.orchestra.run.smithi086:> def find_socket(client_name): 2020-04-22T14:03:04.446 INFO:teuthology.orchestra.run.smithi086:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2020-04-22T14:03:04.446 INFO:teuthology.orchestra.run.smithi086:> files = glob.glob(asok_path) 2020-04-22T14:03:04.446 INFO:teuthology.orchestra.run.smithi086:> 2020-04-22T14:03:04.446 INFO:teuthology.orchestra.run.smithi086:> # Given a non-glob path, it better be there 2020-04-22T14:03:04.447 INFO:teuthology.orchestra.run.smithi086:> if "*" not in asok_path: 2020-04-22T14:03:04.447 INFO:teuthology.orchestra.run.smithi086:> assert(len(files) == 1) 2020-04-22T14:03:04.447 INFO:teuthology.orchestra.run.smithi086:> return files[0] 2020-04-22T14:03:04.447 INFO:teuthology.orchestra.run.smithi086:> 2020-04-22T14:03:04.448 INFO:teuthology.orchestra.run.smithi086:> for f in files: 2020-04-22T14:03:04.448 INFO:teuthology.orchestra.run.smithi086:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:03:04.448 INFO:teuthology.orchestra.run.smithi086:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:03:04.448 INFO:teuthology.orchestra.run.smithi086:> return f 2020-04-22T14:03:04.448 INFO:teuthology.orchestra.run.smithi086:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:03:04.448 INFO:teuthology.orchestra.run.smithi086:> 2020-04-22T14:03:04.448 INFO:teuthology.orchestra.run.smithi086:> print(find_socket("client.3")) 2020-04-22T14:03:04.449 INFO:teuthology.orchestra.run.smithi086:> ' 2020-04-22T14:03:04.554 INFO:teuthology.orchestra.run.smithi086.stdout:/var/run/ceph/ceph-client.3.35322.asok 2020-04-22T14:03:04.554 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.35322.asok 2020-04-22T14:03:04.554 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:04.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:04.576 INFO:teuthology.orchestra.run.smithi086:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.35322.asok status 2020-04-22T14:03:04.737 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2020-04-22T14:03:04.737 INFO:teuthology.orchestra.run.smithi086.stdout: "metadata": { 2020-04-22T14:03:04.737 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:03:04.737 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:03:04.737 INFO:teuthology.orchestra.run.smithi086.stdout: "entity_id": "3", 2020-04-22T14:03:04.738 INFO:teuthology.orchestra.run.smithi086.stdout: "hostname": "smithi086", 2020-04-22T14:03:04.738 INFO:teuthology.orchestra.run.smithi086.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2020-04-22T14:03:04.738 INFO:teuthology.orchestra.run.smithi086.stdout: "pid": "35322", 2020-04-22T14:03:04.738 INFO:teuthology.orchestra.run.smithi086.stdout: "root": "/" 2020-04-22T14:03:04.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2020-04-22T14:03:04.738 INFO:teuthology.orchestra.run.smithi086.stdout: "dentry_count": 0, 2020-04-22T14:03:04.738 INFO:teuthology.orchestra.run.smithi086.stdout: "dentry_pinned_count": 0, 2020-04-22T14:03:04.739 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 4695, 2020-04-22T14:03:04.739 INFO:teuthology.orchestra.run.smithi086.stdout: "inst": { 2020-04-22T14:03:04.739 INFO:teuthology.orchestra.run.smithi086.stdout: "name": { 2020-04-22T14:03:04.739 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "client", 2020-04-22T14:03:04.739 INFO:teuthology.orchestra.run.smithi086.stdout: "num": 4695 2020-04-22T14:03:04.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2020-04-22T14:03:04.740 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": { 2020-04-22T14:03:04.740 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "v1", 2020-04-22T14:03:04.741 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:03:04.741 INFO:teuthology.orchestra.run.smithi086.stdout: "nonce": 982092225 2020-04-22T14:03:04.741 INFO:teuthology.orchestra.run.smithi086.stdout: } 2020-04-22T14:03:04.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2020-04-22T14:03:04.741 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": { 2020-04-22T14:03:04.741 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "v1", 2020-04-22T14:03:04.742 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:03:04.742 INFO:teuthology.orchestra.run.smithi086.stdout: "nonce": 982092225 2020-04-22T14:03:04.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2020-04-22T14:03:04.742 INFO:teuthology.orchestra.run.smithi086.stdout: "inst_str": "client.4695 192.168.0.1:0/982092225", 2020-04-22T14:03:04.742 INFO:teuthology.orchestra.run.smithi086.stdout: "addr_str": "192.168.0.1:0/982092225", 2020-04-22T14:03:04.743 INFO:teuthology.orchestra.run.smithi086.stdout: "inode_count": 1, 2020-04-22T14:03:04.743 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_epoch": 5, 2020-04-22T14:03:04.743 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_epoch": 24, 2020-04-22T14:03:04.743 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_epoch_barrier": 0, 2020-04-22T14:03:04.743 INFO:teuthology.orchestra.run.smithi086.stdout: "blacklisted": false 2020-04-22T14:03:04.743 INFO:teuthology.orchestra.run.smithi086.stdout:} 2020-04-22T14:03:04.744 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:04.761 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:03:04.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.916+0000 7fe82c2f7700 1 Processor -- start 2020-04-22T14:03:04.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.916+0000 7fe82c2f7700 1 -- start start 2020-04-22T14:03:04.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.917+0000 7fe82c2f7700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe824065fe0 0x7fe8241464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:04.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.917+0000 7fe82c2f7700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe824063e30 0x7fe8240642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:04.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.917+0000 7fe82c2f7700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe824143300 con 0x7fe82412c0d0 2020-04-22T14:03:04.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.917+0000 7fe82c2f7700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8241435a0 con 0x7fe824065fe0 2020-04-22T14:03:04.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.917+0000 7fe82c2f7700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe824143840 con 0x7fe824063e30 2020-04-22T14:03:04.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.917+0000 7fe829892700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe824065fe0 0x7fe8241464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:04.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.918+0000 7fe82a894700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe824063e30 0x7fe8240642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:04.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.918+0000 7fe829892700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe824065fe0 0x7fe8241464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:45086/0 (socket says 172.21.15.103:45086) 2020-04-22T14:03:04.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.918+0000 7fe829892700 1 -- 172.21.15.103:0/556865600 learned_addr learned my addr 172.21.15.103:0/556865600 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:04.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.918+0000 7fe82a894700 1 -- 172.21.15.103:0/556865600 >> v2:172.21.15.86:3300/0 conn(0x7fe824065fe0 msgr2=0x7fe8241464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:04.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.918+0000 7fe82a894700 1 --2- 172.21.15.103:0/556865600 >> v2:172.21.15.86:3300/0 conn(0x7fe824065fe0 0x7fe8241464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:04.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.918+0000 7fe82a894700 1 -- 172.21.15.103:0/556865600 >> v1:172.21.15.86:6789/0 conn(0x7fe82412c0d0 legacy=0x7fe82405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:04.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.918+0000 7fe82a894700 1 -- 172.21.15.103:0/556865600 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe82405bb50 con 0x7fe824063e30 2020-04-22T14:03:04.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.918+0000 7fe829091700 1 -- 172.21.15.103:0/556865600 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2376274272 0 0) 0x7fe824143300 con 0x7fe82412c0d0 2020-04-22T14:03:04.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.918+0000 7fe829892700 1 --2- 172.21.15.103:0/556865600 >> v2:172.21.15.86:3300/0 conn(0x7fe824065fe0 0x7fe8241464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:03:04.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.918+0000 7fe82a894700 1 --2- 172.21.15.103:0/556865600 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe824063e30 0x7fe8240642c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe81c0032b0 tx=0x7fe81c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:04.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.918+0000 7fe82a894700 1 --2- 172.21.15.103:0/556865600 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe824063e30 0x7fe8240642c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe81c0032b0 tx=0x7fe81c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:04.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.918+0000 7fe82a894700 1 --2- 172.21.15.103:0/556865600 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe824063e30 0x7fe8240642c0 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7fe81c0032b0 tx=0x7fe81c007dc0).ready entity=mon.2 client_cookie=187dc94272598f7f server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:04.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.918+0000 7fe82a894700 1 --2- 172.21.15.103:0/556865600 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe824063e30 0x7fe8240642c0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7fe81c0032b0 tx=0x7fe81c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:04.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.918+0000 7fe829091700 1 -- 172.21.15.103:0/556865600 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe81c011e20 con 0x7fe824063e30 2020-04-22T14:03:04.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.918+0000 7fe82a894700 1 --2- 172.21.15.103:0/556865600 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe824063e30 0x7fe8240642c0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7fe81c0032b0 tx=0x7fe81c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:04.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.918+0000 7fe82a894700 1 --2- 172.21.15.103:0/556865600 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe824063e30 0x7fe8240642c0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7fe81c0032b0 tx=0x7fe81c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:04.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.918+0000 7fe829091700 1 -- 172.21.15.103:0/556865600 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe81c00a180 con 0x7fe824063e30 2020-04-22T14:03:04.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.918+0000 7fe829091700 1 -- 172.21.15.103:0/556865600 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe81c00a520 con 0x7fe824063e30 2020-04-22T14:03:04.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.918+0000 7fe82c2f7700 1 -- 172.21.15.103:0/556865600 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe824063e30 msgr2=0x7fe8240642c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:04.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.918+0000 7fe82c2f7700 1 --2- 172.21.15.103:0/556865600 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe824063e30 0x7fe8240642c0 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7fe81c0032b0 tx=0x7fe81c007dc0).stop 2020-04-22T14:03:04.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.919+0000 7fe82c2f7700 1 -- 172.21.15.103:0/556865600 shutdown_connections 2020-04-22T14:03:04.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.919+0000 7fe82c2f7700 1 --2- 172.21.15.103:0/556865600 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe824063e30 0x7fe8240642c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:04.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.919+0000 7fe82c2f7700 1 --2- 172.21.15.103:0/556865600 >> v2:172.21.15.86:3300/0 conn(0x7fe824065fe0 0x7fe8241464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:04.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.919+0000 7fe82c2f7700 1 -- 172.21.15.103:0/556865600 >> 172.21.15.103:0/556865600 conn(0x7fe8240b9160 msgr2=0x7fe82405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:04.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.919+0000 7fe82c2f7700 1 -- 172.21.15.103:0/556865600 shutdown_connections 2020-04-22T14:03:04.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.919+0000 7fe82c2f7700 1 -- 172.21.15.103:0/556865600 wait complete. 2020-04-22T14:03:04.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.920+0000 7fe82c2f7700 1 Processor -- start 2020-04-22T14:03:04.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.920+0000 7fe82c2f7700 1 -- start start 2020-04-22T14:03:04.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.920+0000 7fe82c2f7700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe824065fe0 0x7fe824155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:04.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.920+0000 7fe82c2f7700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe82412c0d0 0x7fe8241556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:04.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.920+0000 7fe82c2f7700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe824148d10 con 0x7fe824063e30 2020-04-22T14:03:04.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.920+0000 7fe82c2f7700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe824148330 con 0x7fe82412c0d0 2020-04-22T14:03:04.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.920+0000 7fe82c2f7700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8241485d0 con 0x7fe824065fe0 2020-04-22T14:03:04.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.921+0000 7fe829892700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe824065fe0 0x7fe824155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:04.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.921+0000 7fe829892700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe824065fe0 0x7fe824155270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47862/0 (socket says 172.21.15.103:47862) 2020-04-22T14:03:04.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.921+0000 7fe829892700 1 -- 172.21.15.103:0/3379491934 learned_addr learned my addr 172.21.15.103:0/3379491934 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:04.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.921+0000 7fe82a894700 1 --2- 172.21.15.103:0/3379491934 >> v2:172.21.15.86:3300/0 conn(0x7fe82412c0d0 0x7fe8241556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:04.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.921+0000 7fe829892700 1 -- 172.21.15.103:0/3379491934 >> v2:172.21.15.86:3300/0 conn(0x7fe82412c0d0 msgr2=0x7fe8241556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:04.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.921+0000 7fe829892700 1 --2- 172.21.15.103:0/3379491934 >> v2:172.21.15.86:3300/0 conn(0x7fe82412c0d0 0x7fe8241556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:04.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.921+0000 7fe829892700 1 -- 172.21.15.103:0/3379491934 >> v1:172.21.15.86:6789/0 conn(0x7fe824063e30 legacy=0x7fe82412afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:04.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.921+0000 7fe829892700 1 -- 172.21.15.103:0/3379491934 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe824148870 con 0x7fe824065fe0 2020-04-22T14:03:04.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.921+0000 7fe829892700 1 --2- 172.21.15.103:0/3379491934 >> v2:172.21.15.103:3300/0 conn(0x7fe824065fe0 0x7fe824155270 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe820002f30 tx=0x7fe820010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:04.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.921+0000 7fe829892700 1 --2- 172.21.15.103:0/3379491934 >> v2:172.21.15.103:3300/0 conn(0x7fe824065fe0 0x7fe824155270 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe820002f30 tx=0x7fe820010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:04.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.921+0000 7fe829892700 1 --2- 172.21.15.103:0/3379491934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe824065fe0 0x7fe824155270 secure :-1 s=READY pgs=244 cs=0 l=1 rx=0x7fe820002f30 tx=0x7fe820010e60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:04.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.921+0000 7fe829892700 1 --2- 172.21.15.103:0/3379491934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe824065fe0 0x7fe824155270 secure :-1 s=THROTTLE_DONE pgs=244 cs=0 l=1 rx=0x7fe820002f30 tx=0x7fe820010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:04.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.921+0000 7fe8137fe700 1 -- 172.21.15.103:0/3379491934 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe82000e370 con 0x7fe824065fe0 2020-04-22T14:03:04.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.921+0000 7fe829892700 1 --2- 172.21.15.103:0/3379491934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe824065fe0 0x7fe824155270 secure :-1 s=THROTTLE_DONE pgs=244 cs=0 l=1 rx=0x7fe820002f30 tx=0x7fe820010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:04.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.921+0000 7fe8137fe700 1 -- 172.21.15.103:0/3379491934 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe820012a00 con 0x7fe824065fe0 2020-04-22T14:03:04.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.921+0000 7fe829892700 1 --2- 172.21.15.103:0/3379491934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe824065fe0 0x7fe824155270 secure :-1 s=THROTTLE_DONE pgs=244 cs=0 l=1 rx=0x7fe820002f30 tx=0x7fe820010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:04.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.921+0000 7fe82c2f7700 1 -- 172.21.15.103:0/3379491934 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe824155b30 con 0x7fe824065fe0 2020-04-22T14:03:04.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.921+0000 7fe8137fe700 1 -- 172.21.15.103:0/3379491934 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe820012e20 con 0x7fe824065fe0 2020-04-22T14:03:04.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.921+0000 7fe82c2f7700 1 -- 172.21.15.103:0/3379491934 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe824147f70 con 0x7fe824065fe0 2020-04-22T14:03:04.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.922+0000 7fe829892700 1 --2- 172.21.15.103:0/3379491934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe824065fe0 0x7fe824155270 secure :-1 s=THROTTLE_DONE pgs=244 cs=0 l=1 rx=0x7fe820002f30 tx=0x7fe820010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:04.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.922+0000 7fe8137fe700 1 -- 172.21.15.103:0/3379491934 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fe8200071a0 con 0x7fe824065fe0 2020-04-22T14:03:04.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.922+0000 7fe829892700 1 --2- 172.21.15.103:0/3379491934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe824065fe0 0x7fe824155270 secure :-1 s=THROTTLE_DONE pgs=244 cs=0 l=1 rx=0x7fe820002f30 tx=0x7fe820010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:04.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.922+0000 7fe82c2f7700 1 -- 172.21.15.103:0/3379491934 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe824148a00 con 0x7fe824065fe0 2020-04-22T14:03:04.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.923+0000 7fe8137fe700 1 --2- 172.21.15.103:0/3379491934 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe80404d8a0 0x7fe80404fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:04.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.923+0000 7fe8137fe700 1 -- 172.21.15.103:0/3379491934 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe820061300 con 0x7fe824065fe0 2020-04-22T14:03:04.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.923+0000 7fe82a093700 1 --2- 172.21.15.103:0/3379491934 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe80404d8a0 0x7fe80404fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:04.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.923+0000 7fe82a093700 1 --2- 172.21.15.103:0/3379491934 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe80404d8a0 0x7fe80404fd60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe824148f30 tx=0x7fe814002580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:04.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.923+0000 7fe82a093700 1 --2- 172.21.15.103:0/3379491934 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe80404d8a0 0x7fe80404fd60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe824148f30 tx=0x7fe814002580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:04.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.923+0000 7fe82a093700 1 --2- 172.21.15.103:0/3379491934 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe80404d8a0 0x7fe80404fd60 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7fe824148f30 tx=0x7fe814002580).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:04.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.927+0000 7fe829892700 1 --2- 172.21.15.103:0/3379491934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe824065fe0 0x7fe824155270 secure :-1 s=THROTTLE_DONE pgs=244 cs=0 l=1 rx=0x7fe820002f30 tx=0x7fe820010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:04.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:04.927+0000 7fe8137fe700 1 -- 172.21.15.103:0/3379491934 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fe82003c680 con 0x7fe824065fe0 2020-04-22T14:03:05.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.069+0000 7fe82c2f7700 1 -- 172.21.15.103:0/3379491934 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe824056c90 con 0x7fe824065fe0 2020-04-22T14:03:05.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.070+0000 7fe829892700 1 --2- 172.21.15.103:0/3379491934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe824065fe0 0x7fe824155270 secure :-1 s=THROTTLE_DONE pgs=244 cs=0 l=1 rx=0x7fe820002f30 tx=0x7fe820010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.070+0000 7fe8137fe700 1 -- 172.21.15.103:0/3379491934 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16089 (secure 0 0 0) 0x7fe82003fca0 con 0x7fe824065fe0 2020-04-22T14:03:05.072 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:03:05.072 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":24,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:02:28.687155+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:02:25.963043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-22T14:02:26.642611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:03:05.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.071+0000 7fe82c2f7700 1 -- 172.21.15.103:0/3379491934 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe80404d8a0 msgr2=0x7fe80404fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:05.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.071+0000 7fe82c2f7700 1 --2- 172.21.15.103:0/3379491934 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe80404d8a0 0x7fe80404fd60 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7fe824148f30 tx=0x7fe814002580).stop 2020-04-22T14:03:05.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.071+0000 7fe82c2f7700 1 -- 172.21.15.103:0/3379491934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe824065fe0 msgr2=0x7fe824155270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:05.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.071+0000 7fe82c2f7700 1 --2- 172.21.15.103:0/3379491934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe824065fe0 0x7fe824155270 secure :-1 s=READY pgs=244 cs=0 l=1 rx=0x7fe820002f30 tx=0x7fe820010e60).stop 2020-04-22T14:03:05.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.071+0000 7fe82c2f7700 1 -- 172.21.15.103:0/3379491934 shutdown_connections 2020-04-22T14:03:05.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.071+0000 7fe82c2f7700 1 --2- 172.21.15.103:0/3379491934 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe80404d8a0 0x7fe80404fd60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:05.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.071+0000 7fe82c2f7700 1 --2- 172.21.15.103:0/3379491934 >> v2:172.21.15.86:3300/0 conn(0x7fe82412c0d0 0x7fe8241556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:05.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.071+0000 7fe82c2f7700 1 --2- 172.21.15.103:0/3379491934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe824065fe0 0x7fe824155270 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:05.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.071+0000 7fe82c2f7700 1 -- 172.21.15.103:0/3379491934 >> 172.21.15.103:0/3379491934 conn(0x7fe8240b9160 msgr2=0x7fe8240b4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:05.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.071+0000 7fe82c2f7700 1 -- 172.21.15.103:0/3379491934 shutdown_connections 2020-04-22T14:03:05.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.071+0000 7fe82c2f7700 1 -- 172.21.15.103:0/3379491934 wait complete. 2020-04-22T14:03:05.084 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:25.963043+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:26.642611+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 4, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'24', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:03:05.085 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:05.099 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:03:05.246 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.244+0000 7f842d696700 1 Processor -- start 2020-04-22T14:03:05.247 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.244+0000 7f842d696700 1 -- start start 2020-04-22T14:03:05.249 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.245+0000 7f842d696700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f84280b4820 0x7f84280acb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:05.249 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.245+0000 7f842d696700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84280af030 con 0x7f8428061a30 2020-04-22T14:03:05.249 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.245+0000 7f842d696700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8428060250 con 0x7f8428141f20 2020-04-22T14:03:05.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.245+0000 7f842d696700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84280623c0 con 0x7f84280b4820 2020-04-22T14:03:05.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.246+0000 7f84277fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f8428141f20 0x7f8428142380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40062/0 (socket says 172.21.15.103:40062) 2020-04-22T14:03:05.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.246+0000 7f84277fe700 1 -- 172.21.15.103:0/660916781 learned_addr learned my addr 172.21.15.103:0/660916781 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:05.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.246+0000 7f84267fc700 1 --2- 172.21.15.103:0/660916781 >> v2:172.21.15.86:3300/0 conn(0x7f84280b4820 0x7f84280acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:05.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.246+0000 7f8425ffb700 1 -- 172.21.15.103:0/660916781 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 293448739 0 0) 0x7f8428060250 con 0x7f8428141f20 2020-04-22T14:03:05.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.246+0000 7f8425ffb700 1 -- 172.21.15.103:0/660916781 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f840c003230 con 0x7f8428141f20 2020-04-22T14:03:05.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.246+0000 7f84267fc700 1 -- 172.21.15.103:0/660916781 >> v1:172.21.15.103:6789/0 conn(0x7f8428141f20 legacy=0x7f8428142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:05.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.246+0000 7f84267fc700 1 -- 172.21.15.103:0/660916781 >> v1:172.21.15.86:6789/0 conn(0x7f8428061a30 legacy=0x7f84280ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:05.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.246+0000 7f8425ffb700 1 -- 172.21.15.103:0/660916781 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2304193290 0 0) 0x7f84280af030 con 0x7f8428061a30 2020-04-22T14:03:05.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.246+0000 7f84267fc700 1 -- 172.21.15.103:0/660916781 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8428062660 con 0x7f84280b4820 2020-04-22T14:03:05.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.246+0000 7f84267fc700 1 --2- 172.21.15.103:0/660916781 >> v2:172.21.15.86:3300/0 conn(0x7f84280b4820 0x7f84280acb10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8418002f30 tx=0x7f8418007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.246+0000 7f84267fc700 1 --2- 172.21.15.103:0/660916781 >> v2:172.21.15.86:3300/0 conn(0x7f84280b4820 0x7f84280acb10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8418002f30 tx=0x7f8418007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.246+0000 7f84267fc700 1 --2- 172.21.15.103:0/660916781 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84280b4820 0x7f84280acb10 secure :-1 s=READY pgs=158 cs=0 l=1 rx=0x7f8418002f30 tx=0x7f8418007a40).ready entity=mon.0 client_cookie=6abd59e3bfbd1bfe server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:05.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.246+0000 7f84267fc700 1 --2- 172.21.15.103:0/660916781 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84280b4820 0x7f84280acb10 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7f8418002f30 tx=0x7f8418007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.246+0000 7f8425ffb700 1 -- 172.21.15.103:0/660916781 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84180113c0 con 0x7f84280b4820 2020-04-22T14:03:05.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.246+0000 7f84267fc700 1 --2- 172.21.15.103:0/660916781 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84280b4820 0x7f84280acb10 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7f8418002f30 tx=0x7f8418007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.246+0000 7f84267fc700 1 --2- 172.21.15.103:0/660916781 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84280b4820 0x7f84280acb10 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7f8418002f30 tx=0x7f8418007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.246+0000 7f8425ffb700 1 -- 172.21.15.103:0/660916781 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8418011520 con 0x7f84280b4820 2020-04-22T14:03:05.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.246+0000 7f8425ffb700 1 -- 172.21.15.103:0/660916781 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84180118c0 con 0x7f84280b4820 2020-04-22T14:03:05.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.246+0000 7f842d696700 1 -- 172.21.15.103:0/660916781 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84280b4820 msgr2=0x7f84280acb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:05.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.246+0000 7f842d696700 1 --2- 172.21.15.103:0/660916781 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84280b4820 0x7f84280acb10 secure :-1 s=READY pgs=158 cs=0 l=1 rx=0x7f8418002f30 tx=0x7f8418007a40).stop 2020-04-22T14:03:05.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.247+0000 7f842d696700 1 -- 172.21.15.103:0/660916781 shutdown_connections 2020-04-22T14:03:05.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.247+0000 7f842d696700 1 --2- 172.21.15.103:0/660916781 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84280b4820 0x7f84280acb10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:05.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.247+0000 7f842d696700 1 -- 172.21.15.103:0/660916781 >> 172.21.15.103:0/660916781 conn(0x7f842805b7b0 msgr2=0x7f84280b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:05.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.247+0000 7f842d696700 1 -- 172.21.15.103:0/660916781 shutdown_connections 2020-04-22T14:03:05.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.247+0000 7f842d696700 1 -- 172.21.15.103:0/660916781 wait complete. 2020-04-22T14:03:05.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.248+0000 7f842d696700 1 Processor -- start 2020-04-22T14:03:05.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.248+0000 7f842d696700 1 -- start start 2020-04-22T14:03:05.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.248+0000 7f842d696700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8428061a30 0x7f8428153a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:05.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.249+0000 7f842d696700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f84280b4820 0x7f8428066170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:05.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.249+0000 7f842d696700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84280665d0 con 0x7f8428141f20 2020-04-22T14:03:05.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.249+0000 7f842d696700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f842813f3d0 con 0x7f8428061a30 2020-04-22T14:03:05.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.249+0000 7f842d696700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84280b0b00 con 0x7f84280b4820 2020-04-22T14:03:05.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.249+0000 7f84267fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f84280b4820 0x7f8428066170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:05.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.249+0000 7f84267fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f84280b4820 0x7f8428066170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47876/0 (socket says 172.21.15.103:47876) 2020-04-22T14:03:05.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.249+0000 7f84267fc700 1 -- 172.21.15.103:0/968861555 learned_addr learned my addr 172.21.15.103:0/968861555 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:05.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.249+0000 7f8426ffd700 1 --2- 172.21.15.103:0/968861555 >> v2:172.21.15.86:3300/0 conn(0x7f8428061a30 0x7f8428153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:05.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.249+0000 7f84267fc700 1 -- 172.21.15.103:0/968861555 >> v2:172.21.15.86:3300/0 conn(0x7f8428061a30 msgr2=0x7f8428153a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:05.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.249+0000 7f84267fc700 1 --2- 172.21.15.103:0/968861555 >> v2:172.21.15.86:3300/0 conn(0x7f8428061a30 0x7f8428153a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:05.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.249+0000 7f84267fc700 1 -- 172.21.15.103:0/968861555 >> v1:172.21.15.86:6789/0 conn(0x7f8428141f20 legacy=0x7f842813ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:05.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.249+0000 7f84267fc700 1 -- 172.21.15.103:0/968861555 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84280b0da0 con 0x7f84280b4820 2020-04-22T14:03:05.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.249+0000 7f84267fc700 1 --2- 172.21.15.103:0/968861555 >> v2:172.21.15.103:3300/0 conn(0x7f84280b4820 0x7f8428066170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8418002f30 tx=0x7f8418007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.249+0000 7f84267fc700 1 --2- 172.21.15.103:0/968861555 >> v2:172.21.15.103:3300/0 conn(0x7f84280b4820 0x7f8428066170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8418002f30 tx=0x7f8418007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.249+0000 7f84267fc700 1 --2- 172.21.15.103:0/968861555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84280b4820 0x7f8428066170 secure :-1 s=READY pgs=246 cs=0 l=1 rx=0x7f8418002f30 tx=0x7f8418007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:05.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.249+0000 7f84267fc700 1 --2- 172.21.15.103:0/968861555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84280b4820 0x7f8428066170 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7f8418002f30 tx=0x7f8418007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.249+0000 7f84267fc700 1 --2- 172.21.15.103:0/968861555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84280b4820 0x7f8428066170 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7f8418002f30 tx=0x7f8418007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.249+0000 7f84267fc700 1 --2- 172.21.15.103:0/968861555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84280b4820 0x7f8428066170 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7f8418002f30 tx=0x7f8418007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.249+0000 7f8417fff700 1 -- 172.21.15.103:0/968861555 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f841800f830 con 0x7f84280b4820 2020-04-22T14:03:05.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.249+0000 7f8417fff700 1 -- 172.21.15.103:0/968861555 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8418007360 con 0x7f84280b4820 2020-04-22T14:03:05.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.249+0000 7f8417fff700 1 -- 172.21.15.103:0/968861555 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84180056c0 con 0x7f84280b4820 2020-04-22T14:03:05.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.249+0000 7f842d696700 1 -- 172.21.15.103:0/968861555 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84280b1040 con 0x7f84280b4820 2020-04-22T14:03:05.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.249+0000 7f842d696700 1 -- 172.21.15.103:0/968861555 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8428141410 con 0x7f84280b4820 2020-04-22T14:03:05.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.250+0000 7f84267fc700 1 --2- 172.21.15.103:0/968861555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84280b4820 0x7f8428066170 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7f8418002f30 tx=0x7f8418007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.250+0000 7f842d696700 1 -- 172.21.15.103:0/968861555 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8428056c90 con 0x7f84280b4820 2020-04-22T14:03:05.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.250+0000 7f8417fff700 1 -- 172.21.15.103:0/968861555 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f8418005820 con 0x7f84280b4820 2020-04-22T14:03:05.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.251+0000 7f84267fc700 1 --2- 172.21.15.103:0/968861555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84280b4820 0x7f8428066170 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7f8418002f30 tx=0x7f8418007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.251+0000 7f8417fff700 1 --2- 172.21.15.103:0/968861555 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f840404da70 0x7f840404ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:05.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.251+0000 7f8417fff700 1 -- 172.21.15.103:0/968861555 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8418062130 con 0x7f84280b4820 2020-04-22T14:03:05.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.251+0000 7f8426ffd700 1 --2- 172.21.15.103:0/968861555 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f840404da70 0x7f840404ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:05.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.251+0000 7f8426ffd700 1 --2- 172.21.15.103:0/968861555 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f840404da70 0x7f840404ff30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f841c000b80 tx=0x7f841c003960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.251+0000 7f8426ffd700 1 --2- 172.21.15.103:0/968861555 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f840404da70 0x7f840404ff30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f841c000b80 tx=0x7f841c003960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.251+0000 7f8426ffd700 1 --2- 172.21.15.103:0/968861555 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f840404da70 0x7f840404ff30 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7f841c000b80 tx=0x7f841c003960).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:05.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.255+0000 7f84267fc700 1 --2- 172.21.15.103:0/968861555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84280b4820 0x7f8428066170 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7f8418002f30 tx=0x7f8418007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.255+0000 7f8417fff700 1 -- 172.21.15.103:0/968861555 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f841803d510 con 0x7f84280b4820 2020-04-22T14:03:05.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.396+0000 7f842d696700 1 -- 172.21.15.103:0/968861555 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f84280ad010 con 0x7f84280b4820 2020-04-22T14:03:05.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.396+0000 7f84267fc700 1 --2- 172.21.15.103:0/968861555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84280b4820 0x7f8428066170 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7f8418002f30 tx=0x7f8418007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.396+0000 7f8417fff700 1 -- 172.21.15.103:0/968861555 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v24) v1 ==== 110+0+10 (secure 0 0 0) 0x7f8418042020 con 0x7f84280b4820 2020-04-22T14:03:05.399 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:03:05.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.397+0000 7f842d696700 1 -- 172.21.15.103:0/968861555 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f840404da70 msgr2=0x7f840404ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:05.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.397+0000 7f842d696700 1 --2- 172.21.15.103:0/968861555 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f840404da70 0x7f840404ff30 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7f841c000b80 tx=0x7f841c003960).stop 2020-04-22T14:03:05.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.397+0000 7f842d696700 1 -- 172.21.15.103:0/968861555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84280b4820 msgr2=0x7f8428066170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:05.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.397+0000 7f842d696700 1 --2- 172.21.15.103:0/968861555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84280b4820 0x7f8428066170 secure :-1 s=READY pgs=246 cs=0 l=1 rx=0x7f8418002f30 tx=0x7f8418007a40).stop 2020-04-22T14:03:05.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.397+0000 7f842d696700 1 -- 172.21.15.103:0/968861555 shutdown_connections 2020-04-22T14:03:05.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.397+0000 7f842d696700 1 --2- 172.21.15.103:0/968861555 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f840404da70 0x7f840404ff30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:05.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.397+0000 7f842d696700 1 --2- 172.21.15.103:0/968861555 >> v2:172.21.15.86:3300/0 conn(0x7f8428061a30 0x7f8428153a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:05.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.397+0000 7f842d696700 1 --2- 172.21.15.103:0/968861555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84280b4820 0x7f8428066170 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:05.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.397+0000 7f842d696700 1 -- 172.21.15.103:0/968861555 >> 172.21.15.103:0/968861555 conn(0x7f842805b7b0 msgr2=0x7f84280b3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:05.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.397+0000 7f842d696700 1 -- 172.21.15.103:0/968861555 shutdown_connections 2020-04-22T14:03:05.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.398+0000 7f842d696700 1 -- 172.21.15.103:0/968861555 wait complete. 2020-04-22T14:03:05.411 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:05.424 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:03:05.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.572+0000 7f2aa84f3700 1 Processor -- start 2020-04-22T14:03:05.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.572+0000 7f2aa84f3700 1 -- start start 2020-04-22T14:03:05.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.573+0000 7f2aa84f3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2aa0143090 0x7f2aa0143520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:05.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.573+0000 7f2aa84f3700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa01467e0 con 0x7f2aa00ac950 2020-04-22T14:03:05.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.573+0000 7f2aa84f3700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa0060050 con 0x7f2aa00b9140 2020-04-22T14:03:05.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.573+0000 7f2aa84f3700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aa00602f0 con 0x7f2aa0143090 2020-04-22T14:03:05.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.574+0000 7f2aa6a90700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2aa0143090 0x7f2aa0143520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:05.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.574+0000 7f2aa628f700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f2aa00b9140 0x7f2aa012b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40072/0 (socket says 172.21.15.103:40072) 2020-04-22T14:03:05.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.574+0000 7f2aa6a90700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2aa0143090 0x7f2aa0143520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47886/0 (socket says 172.21.15.103:47886) 2020-04-22T14:03:05.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.574+0000 7f2aa628f700 1 -- 172.21.15.103:0/322244615 learned_addr learned my addr 172.21.15.103:0/322244615 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:05.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.574+0000 7f2aa6a90700 1 -- 172.21.15.103:0/322244615 >> v1:172.21.15.103:6789/0 conn(0x7f2aa00b9140 legacy=0x7f2aa012b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:05.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.574+0000 7f2aa6a90700 1 -- 172.21.15.103:0/322244615 >> v1:172.21.15.86:6789/0 conn(0x7f2aa00ac950 legacy=0x7f2aa0146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:05.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.574+0000 7f2aa6a90700 1 -- 172.21.15.103:0/322244615 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa00b9520 con 0x7f2aa0143090 2020-04-22T14:03:05.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.574+0000 7f2aa6a90700 1 --2- 172.21.15.103:0/322244615 >> v2:172.21.15.103:3300/0 conn(0x7f2aa0143090 0x7f2aa0143520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2a980032b0 tx=0x7f2a98007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.574+0000 7f2aa6a90700 1 --2- 172.21.15.103:0/322244615 >> v2:172.21.15.103:3300/0 conn(0x7f2aa0143090 0x7f2aa0143520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2a980032b0 tx=0x7f2a98007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.574+0000 7f2aa6a90700 1 --2- 172.21.15.103:0/322244615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2aa0143090 0x7f2aa0143520 secure :-1 s=READY pgs=248 cs=0 l=1 rx=0x7f2a980032b0 tx=0x7f2a98007dc0).ready entity=mon.1 client_cookie=e28570cdc34f7e64 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:05.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.574+0000 7f2aa6a90700 1 --2- 172.21.15.103:0/322244615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2aa0143090 0x7f2aa0143520 secure :-1 s=THROTTLE_DONE pgs=248 cs=0 l=1 rx=0x7f2a980032b0 tx=0x7f2a98007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.574+0000 7f2aa528d700 1 -- 172.21.15.103:0/322244615 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a9800a180 con 0x7f2aa0143090 2020-04-22T14:03:05.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.574+0000 7f2aa6a90700 1 --2- 172.21.15.103:0/322244615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2aa0143090 0x7f2aa0143520 secure :-1 s=THROTTLE_DONE pgs=248 cs=0 l=1 rx=0x7f2a980032b0 tx=0x7f2a98007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.574+0000 7f2aa6a90700 1 --2- 172.21.15.103:0/322244615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2aa0143090 0x7f2aa0143520 secure :-1 s=THROTTLE_DONE pgs=248 cs=0 l=1 rx=0x7f2a980032b0 tx=0x7f2a98007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.574+0000 7f2aa528d700 1 -- 172.21.15.103:0/322244615 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9800a2e0 con 0x7f2aa0143090 2020-04-22T14:03:05.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.574+0000 7f2aa528d700 1 -- 172.21.15.103:0/322244615 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a9800a700 con 0x7f2aa0143090 2020-04-22T14:03:05.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.574+0000 7f2aa84f3700 1 -- 172.21.15.103:0/322244615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2aa0143090 msgr2=0x7f2aa0143520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:05.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.574+0000 7f2aa84f3700 1 --2- 172.21.15.103:0/322244615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2aa0143090 0x7f2aa0143520 secure :-1 s=READY pgs=248 cs=0 l=1 rx=0x7f2a980032b0 tx=0x7f2a98007dc0).stop 2020-04-22T14:03:05.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.575+0000 7f2aa84f3700 1 -- 172.21.15.103:0/322244615 shutdown_connections 2020-04-22T14:03:05.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.575+0000 7f2aa84f3700 1 --2- 172.21.15.103:0/322244615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2aa0143090 0x7f2aa0143520 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:05.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.575+0000 7f2aa84f3700 1 -- 172.21.15.103:0/322244615 >> 172.21.15.103:0/322244615 conn(0x7f2aa005b7b0 msgr2=0x7f2aa00b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:05.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.575+0000 7f2aa84f3700 1 -- 172.21.15.103:0/322244615 shutdown_connections 2020-04-22T14:03:05.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.575+0000 7f2aa84f3700 1 -- 172.21.15.103:0/322244615 wait complete. 2020-04-22T14:03:05.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.576+0000 7f2aa84f3700 1 Processor -- start 2020-04-22T14:03:05.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.576+0000 7f2aa84f3700 1 -- start start 2020-04-22T14:03:05.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.576+0000 7f2aa84f3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2aa00ac950 0x7f2aa0141d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:05.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.576+0000 7f2aa84f3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2aa0143090 0x7f2aa0154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:05.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.576+0000 7f2aa84f3700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa00b4300 con 0x7f2aa00b9140 2020-04-22T14:03:05.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.576+0000 7f2aa84f3700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aa0154c70 con 0x7f2aa0143090 2020-04-22T14:03:05.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.576+0000 7f2aa84f3700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aa00b2830 con 0x7f2aa00ac950 2020-04-22T14:03:05.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.576+0000 7f2aa628f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2aa00ac950 0x7f2aa0141d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:05.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.576+0000 7f2aa628f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2aa00ac950 0x7f2aa0141d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47888/0 (socket says 172.21.15.103:47888) 2020-04-22T14:03:05.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.577+0000 7f2aa628f700 1 -- 172.21.15.103:0/2930591109 learned_addr learned my addr 172.21.15.103:0/2930591109 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:05.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.576+0000 7f2aa5a8e700 1 --1- 172.21.15.103:0/2930591109 >> v1:172.21.15.103:6789/0 conn(0x7f2aa00b9140 0x7f2aa0127e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40080/0 (socket says 172.21.15.103:40080) 2020-04-22T14:03:05.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.577+0000 7f2aa6a90700 1 --2- 172.21.15.103:0/2930591109 >> v2:172.21.15.86:3300/0 conn(0x7f2aa0143090 0x7f2aa0154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:05.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.577+0000 7f2aa628f700 1 -- 172.21.15.103:0/2930591109 >> v2:172.21.15.86:3300/0 conn(0x7f2aa0143090 msgr2=0x7f2aa0154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:05.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.577+0000 7f2aa628f700 1 --2- 172.21.15.103:0/2930591109 >> v2:172.21.15.86:3300/0 conn(0x7f2aa0143090 0x7f2aa0154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:05.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.577+0000 7f2aa628f700 1 -- 172.21.15.103:0/2930591109 >> v1:172.21.15.103:6789/0 conn(0x7f2aa00b9140 legacy=0x7f2aa0127e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:05.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.577+0000 7f2a937fe700 1 -- 172.21.15.103:0/2930591109 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3422705733 0 0) 0x7f2aa00b4300 con 0x7f2aa00b9140 2020-04-22T14:03:05.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.577+0000 7f2aa628f700 1 -- 172.21.15.103:0/2930591109 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa01416d0 con 0x7f2aa00ac950 2020-04-22T14:03:05.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.577+0000 7f2aa628f700 1 --2- 172.21.15.103:0/2930591109 >> v2:172.21.15.103:3300/0 conn(0x7f2aa00ac950 0x7f2aa0141d00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2a9c000fe0 tx=0x7f2a9c010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.577+0000 7f2aa628f700 1 --2- 172.21.15.103:0/2930591109 >> v2:172.21.15.103:3300/0 conn(0x7f2aa00ac950 0x7f2aa0141d00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2a9c000fe0 tx=0x7f2a9c010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.577+0000 7f2aa628f700 1 --2- 172.21.15.103:0/2930591109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2aa00ac950 0x7f2aa0141d00 secure :-1 s=READY pgs=250 cs=0 l=1 rx=0x7f2a9c000fe0 tx=0x7f2a9c010930).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:05.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.577+0000 7f2aa628f700 1 --2- 172.21.15.103:0/2930591109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2aa00ac950 0x7f2aa0141d00 secure :-1 s=THROTTLE_DONE pgs=250 cs=0 l=1 rx=0x7f2a9c000fe0 tx=0x7f2a9c010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.577+0000 7f2a937fe700 1 -- 172.21.15.103:0/2930591109 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a9c005ca0 con 0x7f2aa00ac950 2020-04-22T14:03:05.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.577+0000 7f2aa628f700 1 --2- 172.21.15.103:0/2930591109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2aa00ac950 0x7f2aa0141d00 secure :-1 s=THROTTLE_DONE pgs=250 cs=0 l=1 rx=0x7f2a9c000fe0 tx=0x7f2a9c010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.577+0000 7f2a937fe700 1 -- 172.21.15.103:0/2930591109 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9c005e00 con 0x7f2aa00ac950 2020-04-22T14:03:05.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.577+0000 7f2aa628f700 1 --2- 172.21.15.103:0/2930591109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2aa00ac950 0x7f2aa0141d00 secure :-1 s=THROTTLE_DONE pgs=250 cs=0 l=1 rx=0x7f2a9c000fe0 tx=0x7f2a9c010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.577+0000 7f2aa84f3700 1 -- 172.21.15.103:0/2930591109 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aa0141970 con 0x7f2aa00ac950 2020-04-22T14:03:05.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.577+0000 7f2a937fe700 1 -- 172.21.15.103:0/2930591109 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a9c0062c0 con 0x7f2aa00ac950 2020-04-22T14:03:05.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.577+0000 7f2aa84f3700 1 -- 172.21.15.103:0/2930591109 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aa0128570 con 0x7f2aa00ac950 2020-04-22T14:03:05.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.578+0000 7f2aa628f700 1 --2- 172.21.15.103:0/2930591109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2aa00ac950 0x7f2aa0141d00 secure :-1 s=THROTTLE_DONE pgs=250 cs=0 l=1 rx=0x7f2a9c000fe0 tx=0x7f2a9c010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.578+0000 7f2a937fe700 1 -- 172.21.15.103:0/2930591109 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f2a9c006500 con 0x7f2aa00ac950 2020-04-22T14:03:05.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.578+0000 7f2aa628f700 1 --2- 172.21.15.103:0/2930591109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2aa00ac950 0x7f2aa0141d00 secure :-1 s=THROTTLE_DONE pgs=250 cs=0 l=1 rx=0x7f2a9c000fe0 tx=0x7f2a9c010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.578+0000 7f2aa84f3700 1 -- 172.21.15.103:0/2930591109 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aa0056c90 con 0x7f2aa00ac950 2020-04-22T14:03:05.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.578+0000 7f2a937fe700 1 --2- 172.21.15.103:0/2930591109 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2a8004d860 0x7f2a8004fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:05.590 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.578+0000 7f2a937fe700 1 -- 172.21.15.103:0/2930591109 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2a9c0090c0 con 0x7f2aa00ac950 2020-04-22T14:03:05.590 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.579+0000 7f2aa5a8e700 1 --2- 172.21.15.103:0/2930591109 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2a8004d860 0x7f2a8004fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:05.590 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.579+0000 7f2aa5a8e700 1 --2- 172.21.15.103:0/2930591109 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2a8004d860 0x7f2a8004fd20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2a94001260 tx=0x7f2a940017b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.590 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.579+0000 7f2aa5a8e700 1 --2- 172.21.15.103:0/2930591109 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2a8004d860 0x7f2a8004fd20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2a94001260 tx=0x7f2a940017b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.590 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.579+0000 7f2aa5a8e700 1 --2- 172.21.15.103:0/2930591109 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2a8004d860 0x7f2a8004fd20 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7f2a94001260 tx=0x7f2a940017b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:05.590 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.582+0000 7f2aa628f700 1 --2- 172.21.15.103:0/2930591109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2aa00ac950 0x7f2aa0141d00 secure :-1 s=THROTTLE_DONE pgs=250 cs=0 l=1 rx=0x7f2a9c000fe0 tx=0x7f2a9c010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.590 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.582+0000 7f2a937fe700 1 -- 172.21.15.103:0/2930591109 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f2a9c03c940 con 0x7f2aa00ac950 2020-04-22T14:03:05.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.730+0000 7f2aa84f3700 1 -- 172.21.15.103:0/2930591109 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2aa006a960 con 0x7f2aa00ac950 2020-04-22T14:03:05.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.730+0000 7f2aa628f700 1 --2- 172.21.15.103:0/2930591109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2aa00ac950 0x7f2aa0141d00 secure :-1 s=THROTTLE_DONE pgs=250 cs=0 l=1 rx=0x7f2a9c000fe0 tx=0x7f2a9c010930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.730+0000 7f2a937fe700 1 -- 172.21.15.103:0/2930591109 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2a9c03ff60 con 0x7f2aa00ac950 2020-04-22T14:03:05.733 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:03:05.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.732+0000 7f2aa84f3700 1 -- 172.21.15.103:0/2930591109 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2a8004d860 msgr2=0x7f2a8004fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:05.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.732+0000 7f2aa84f3700 1 --2- 172.21.15.103:0/2930591109 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2a8004d860 0x7f2a8004fd20 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7f2a94001260 tx=0x7f2a940017b0).stop 2020-04-22T14:03:05.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.732+0000 7f2aa84f3700 1 -- 172.21.15.103:0/2930591109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2aa00ac950 msgr2=0x7f2aa0141d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:05.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.732+0000 7f2aa84f3700 1 --2- 172.21.15.103:0/2930591109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2aa00ac950 0x7f2aa0141d00 secure :-1 s=READY pgs=250 cs=0 l=1 rx=0x7f2a9c000fe0 tx=0x7f2a9c010930).stop 2020-04-22T14:03:05.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.732+0000 7f2aa84f3700 1 -- 172.21.15.103:0/2930591109 shutdown_connections 2020-04-22T14:03:05.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.732+0000 7f2aa84f3700 1 --2- 172.21.15.103:0/2930591109 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2a8004d860 0x7f2a8004fd20 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:05.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.732+0000 7f2aa84f3700 1 --2- 172.21.15.103:0/2930591109 >> v2:172.21.15.86:3300/0 conn(0x7f2aa0143090 0x7f2aa0154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:05.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.732+0000 7f2aa84f3700 1 --2- 172.21.15.103:0/2930591109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2aa00ac950 0x7f2aa0141d00 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:05.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.732+0000 7f2aa84f3700 1 -- 172.21.15.103:0/2930591109 >> 172.21.15.103:0/2930591109 conn(0x7f2aa005b7b0 msgr2=0x7f2aa0129490 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:05.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.732+0000 7f2aa84f3700 1 -- 172.21.15.103:0/2930591109 shutdown_connections 2020-04-22T14:03:05.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.732+0000 7f2aa84f3700 1 -- 172.21.15.103:0/2930591109 wait complete. 2020-04-22T14:03:05.745 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:05.759 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-22T14:03:05.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.905+0000 7f5a499df700 1 Processor -- start 2020-04-22T14:03:05.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.905+0000 7f5a499df700 1 -- start start 2020-04-22T14:03:05.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.906+0000 7f5a499df700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a44143840 0x7f5a44146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:05.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.906+0000 7f5a499df700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5a440bc820 0x7f5a440bcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:05.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.906+0000 7f5a499df700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a44143c20 con 0x7f5a4405fdd0 2020-04-22T14:03:05.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.906+0000 7f5a499df700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a440b5ba0 con 0x7f5a440bc820 2020-04-22T14:03:05.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.906+0000 7f5a499df700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a440b5e40 con 0x7f5a44143840 2020-04-22T14:03:05.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.906+0000 7f5a437fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5a440bc820 0x7f5a440bcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:05.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.906+0000 7f5a437fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5a440bc820 0x7f5a440bcc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47900/0 (socket says 172.21.15.103:47900) 2020-04-22T14:03:05.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.906+0000 7f5a437fe700 1 -- 172.21.15.103:0/2532609355 learned_addr learned my addr 172.21.15.103:0/2532609355 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:05.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.907+0000 7f5a42ffd700 1 --2- 172.21.15.103:0/2532609355 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a44143840 0x7f5a44146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:05.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.907+0000 7f5a437fe700 1 -- 172.21.15.103:0/2532609355 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a44143840 msgr2=0x7f5a44146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:05.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.907+0000 7f5a437fe700 1 --2- 172.21.15.103:0/2532609355 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a44143840 0x7f5a44146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:05.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.907+0000 7f5a437fe700 1 -- 172.21.15.103:0/2532609355 >> v1:172.21.15.86:6789/0 conn(0x7f5a4405fdd0 legacy=0x7f5a440b6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:05.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.907+0000 7f5a437fe700 1 -- 172.21.15.103:0/2532609355 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a440b60e0 con 0x7f5a440bc820 2020-04-22T14:03:05.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.907+0000 7f5a42ffd700 1 --2- 172.21.15.103:0/2532609355 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a44143840 0x7f5a44146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:03:05.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.907+0000 7f5a437fe700 1 --2- 172.21.15.103:0/2532609355 >> v2:172.21.15.103:3300/0 conn(0x7f5a440bc820 0x7f5a440bcc70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5a3c0032b0 tx=0x7f5a3c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.907+0000 7f5a437fe700 1 --2- 172.21.15.103:0/2532609355 >> v2:172.21.15.103:3300/0 conn(0x7f5a440bc820 0x7f5a440bcc70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5a3c0032b0 tx=0x7f5a3c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.907+0000 7f5a437fe700 1 --2- 172.21.15.103:0/2532609355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a440bc820 0x7f5a440bcc70 secure :-1 s=READY pgs=251 cs=0 l=1 rx=0x7f5a3c0032b0 tx=0x7f5a3c007dc0).ready entity=mon.1 client_cookie=6e62bfc1f0ad6d8d server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:05.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.907+0000 7f5a437fe700 1 --2- 172.21.15.103:0/2532609355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a440bc820 0x7f5a440bcc70 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7f5a3c0032b0 tx=0x7f5a3c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.907+0000 7f5a41ffb700 1 -- 172.21.15.103:0/2532609355 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a3c00a180 con 0x7f5a440bc820 2020-04-22T14:03:05.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.907+0000 7f5a437fe700 1 --2- 172.21.15.103:0/2532609355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a440bc820 0x7f5a440bcc70 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7f5a3c0032b0 tx=0x7f5a3c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.907+0000 7f5a41ffb700 1 -- 172.21.15.103:0/2532609355 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3c00a320 con 0x7f5a440bc820 2020-04-22T14:03:05.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.907+0000 7f5a437fe700 1 --2- 172.21.15.103:0/2532609355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a440bc820 0x7f5a440bcc70 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7f5a3c0032b0 tx=0x7f5a3c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.907+0000 7f5a499df700 1 -- 172.21.15.103:0/2532609355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a440bc820 msgr2=0x7f5a440bcc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:05.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.907+0000 7f5a41ffb700 1 -- 172.21.15.103:0/2532609355 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a3c00a740 con 0x7f5a440bc820 2020-04-22T14:03:05.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.907+0000 7f5a499df700 1 --2- 172.21.15.103:0/2532609355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a440bc820 0x7f5a440bcc70 secure :-1 s=READY pgs=251 cs=0 l=1 rx=0x7f5a3c0032b0 tx=0x7f5a3c007dc0).stop 2020-04-22T14:03:05.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.908+0000 7f5a499df700 1 -- 172.21.15.103:0/2532609355 shutdown_connections 2020-04-22T14:03:05.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.908+0000 7f5a499df700 1 --2- 172.21.15.103:0/2532609355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a440bc820 0x7f5a440bcc70 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:05.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.908+0000 7f5a499df700 1 --2- 172.21.15.103:0/2532609355 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a44143840 0x7f5a44146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:05.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.908+0000 7f5a499df700 1 -- 172.21.15.103:0/2532609355 >> 172.21.15.103:0/2532609355 conn(0x7f5a44065af0 msgr2=0x7f5a44065f00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:05.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.908+0000 7f5a499df700 1 -- 172.21.15.103:0/2532609355 shutdown_connections 2020-04-22T14:03:05.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.908+0000 7f5a499df700 1 -- 172.21.15.103:0/2532609355 wait complete. 2020-04-22T14:03:05.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.909+0000 7f5a499df700 1 Processor -- start 2020-04-22T14:03:05.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.909+0000 7f5a499df700 1 -- start start 2020-04-22T14:03:05.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.909+0000 7f5a499df700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5a440bc820 0x7f5a4412ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:05.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.909+0000 7f5a499df700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5a44143840 0x7f5a440b0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:05.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.909+0000 7f5a499df700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a440b04f0 con 0x7f5a4405fdd0 2020-04-22T14:03:05.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.909+0000 7f5a499df700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a440af6b0 con 0x7f5a440bc820 2020-04-22T14:03:05.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.909+0000 7f5a499df700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a440af950 con 0x7f5a44143840 2020-04-22T14:03:05.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.909+0000 7f5a437fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5a44143840 0x7f5a440b0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:05.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.909+0000 7f5a437fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5a44143840 0x7f5a440b0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47906/0 (socket says 172.21.15.103:47906) 2020-04-22T14:03:05.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.909+0000 7f5a437fe700 1 -- 172.21.15.103:0/3096738613 learned_addr learned my addr 172.21.15.103:0/3096738613 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:05.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.909+0000 7f5a427fc700 1 --2- 172.21.15.103:0/3096738613 >> v2:172.21.15.86:3300/0 conn(0x7f5a440bc820 0x7f5a4412ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:05.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.910+0000 7f5a437fe700 1 -- 172.21.15.103:0/3096738613 >> v2:172.21.15.86:3300/0 conn(0x7f5a440bc820 msgr2=0x7f5a4412ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:05.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.910+0000 7f5a437fe700 1 --2- 172.21.15.103:0/3096738613 >> v2:172.21.15.86:3300/0 conn(0x7f5a440bc820 0x7f5a4412ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:05.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.910+0000 7f5a437fe700 1 -- 172.21.15.103:0/3096738613 >> v1:172.21.15.86:6789/0 conn(0x7f5a4405fdd0 legacy=0x7f5a440aee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:05.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.910+0000 7f5a437fe700 1 -- 172.21.15.103:0/3096738613 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a440afbf0 con 0x7f5a44143840 2020-04-22T14:03:05.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.910+0000 7f5a437fe700 1 --2- 172.21.15.103:0/3096738613 >> v2:172.21.15.103:3300/0 conn(0x7f5a44143840 0x7f5a440b0090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5a3c0032b0 tx=0x7f5a3c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.910+0000 7f5a437fe700 1 --2- 172.21.15.103:0/3096738613 >> v2:172.21.15.103:3300/0 conn(0x7f5a44143840 0x7f5a440b0090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5a3c0032b0 tx=0x7f5a3c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.910+0000 7f5a437fe700 1 --2- 172.21.15.103:0/3096738613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a44143840 0x7f5a440b0090 secure :-1 s=READY pgs=252 cs=0 l=1 rx=0x7f5a3c0032b0 tx=0x7f5a3c007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:05.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.910+0000 7f5a437fe700 1 --2- 172.21.15.103:0/3096738613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a44143840 0x7f5a440b0090 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7f5a3c0032b0 tx=0x7f5a3c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.910+0000 7f5a3bfff700 1 -- 172.21.15.103:0/3096738613 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a3c00a7e0 con 0x7f5a44143840 2020-04-22T14:03:05.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.910+0000 7f5a437fe700 1 --2- 172.21.15.103:0/3096738613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a44143840 0x7f5a440b0090 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7f5a3c0032b0 tx=0x7f5a3c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.910+0000 7f5a3bfff700 1 -- 172.21.15.103:0/3096738613 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3c005c30 con 0x7f5a44143840 2020-04-22T14:03:05.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.910+0000 7f5a437fe700 1 --2- 172.21.15.103:0/3096738613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a44143840 0x7f5a440b0090 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7f5a3c0032b0 tx=0x7f5a3c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.910+0000 7f5a3bfff700 1 -- 172.21.15.103:0/3096738613 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a3c005da0 con 0x7f5a44143840 2020-04-22T14:03:05.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.910+0000 7f5a499df700 1 -- 172.21.15.103:0/3096738613 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a4412fc50 con 0x7f5a44143840 2020-04-22T14:03:05.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.910+0000 7f5a499df700 1 -- 172.21.15.103:0/3096738613 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a440b0fe0 con 0x7f5a44143840 2020-04-22T14:03:05.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.911+0000 7f5a437fe700 1 --2- 172.21.15.103:0/3096738613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a44143840 0x7f5a440b0090 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7f5a3c0032b0 tx=0x7f5a3c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.911+0000 7f5a499df700 1 -- 172.21.15.103:0/3096738613 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a440afda0 con 0x7f5a44143840 2020-04-22T14:03:05.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.911+0000 7f5a3bfff700 1 -- 172.21.15.103:0/3096738613 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f5a3c00f7a0 con 0x7f5a44143840 2020-04-22T14:03:05.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.911+0000 7f5a437fe700 1 --2- 172.21.15.103:0/3096738613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a44143840 0x7f5a440b0090 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7f5a3c0032b0 tx=0x7f5a3c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.911+0000 7f5a3bfff700 1 --2- 172.21.15.103:0/3096738613 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5a2804d9d0 0x7f5a2804fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:05.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.911+0000 7f5a3bfff700 1 -- 172.21.15.103:0/3096738613 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5a3c062430 con 0x7f5a44143840 2020-04-22T14:03:05.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.911+0000 7f5a42ffd700 1 --2- 172.21.15.103:0/3096738613 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5a2804d9d0 0x7f5a2804fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:05.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.912+0000 7f5a42ffd700 1 --2- 172.21.15.103:0/3096738613 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5a2804d9d0 0x7f5a2804fe90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5a440ae1f0 tx=0x7f5a34008d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.912+0000 7f5a42ffd700 1 --2- 172.21.15.103:0/3096738613 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5a2804d9d0 0x7f5a2804fe90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5a440ae1f0 tx=0x7f5a34008d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.912+0000 7f5a42ffd700 1 --2- 172.21.15.103:0/3096738613 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5a2804d9d0 0x7f5a2804fe90 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7f5a440ae1f0 tx=0x7f5a34008d70).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:05.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.915+0000 7f5a437fe700 1 --2- 172.21.15.103:0/3096738613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a44143840 0x7f5a440b0090 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7f5a3c0032b0 tx=0x7f5a3c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:05.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:05.915+0000 7f5a3bfff700 1 -- 172.21.15.103:0/3096738613 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f5a3c03d930 con 0x7f5a44143840 2020-04-22T14:03:06.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.056+0000 7f5a499df700 1 -- 172.21.15.103:0/3096738613 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5a44056c90 con 0x7f5a44143840 2020-04-22T14:03:06.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.056+0000 7f5a437fe700 1 --2- 172.21.15.103:0/3096738613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a44143840 0x7f5a440b0090 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7f5a3c0032b0 tx=0x7f5a3c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:06.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.056+0000 7f5a3bfff700 1 -- 172.21.15.103:0/3096738613 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7f5a3c040f50 con 0x7f5a44143840 2020-04-22T14:03:06.059 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:03:06.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.057+0000 7f5a499df700 1 -- 172.21.15.103:0/3096738613 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5a2804d9d0 msgr2=0x7f5a2804fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:06.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.057+0000 7f5a499df700 1 --2- 172.21.15.103:0/3096738613 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5a2804d9d0 0x7f5a2804fe90 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7f5a440ae1f0 tx=0x7f5a34008d70).stop 2020-04-22T14:03:06.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.057+0000 7f5a499df700 1 -- 172.21.15.103:0/3096738613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a44143840 msgr2=0x7f5a440b0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:06.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.057+0000 7f5a499df700 1 --2- 172.21.15.103:0/3096738613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a44143840 0x7f5a440b0090 secure :-1 s=READY pgs=252 cs=0 l=1 rx=0x7f5a3c0032b0 tx=0x7f5a3c007dc0).stop 2020-04-22T14:03:06.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.057+0000 7f5a499df700 1 -- 172.21.15.103:0/3096738613 shutdown_connections 2020-04-22T14:03:06.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.057+0000 7f5a499df700 1 --2- 172.21.15.103:0/3096738613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a44143840 0x7f5a440b0090 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:06.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.057+0000 7f5a499df700 1 --2- 172.21.15.103:0/3096738613 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5a2804d9d0 0x7f5a2804fe90 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:06.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.057+0000 7f5a499df700 1 --2- 172.21.15.103:0/3096738613 >> v2:172.21.15.86:3300/0 conn(0x7f5a440bc820 0x7f5a4412ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:06.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.057+0000 7f5a499df700 1 -- 172.21.15.103:0/3096738613 >> 172.21.15.103:0/3096738613 conn(0x7f5a44065af0 msgr2=0x7f5a440b6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:06.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.057+0000 7f5a499df700 1 -- 172.21.15.103:0/3096738613 shutdown_connections 2020-04-22T14:03:06.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.058+0000 7f5a499df700 1 -- 172.21.15.103:0/3096738613 wait complete. 2020-04-22T14:03:06.073 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:06.110 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-22T14:03:06.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.260+0000 7f3bbdb7a700 1 Processor -- start 2020-04-22T14:03:06.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.260+0000 7f3bbdb7a700 1 -- start start 2020-04-22T14:03:06.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.260+0000 7f3bbdb7a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3bb8143bc0 0x7f3bb8146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:06.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.260+0000 7f3bbdb7a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3bb80b5ea0 0x7f3bb80b6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:06.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.260+0000 7f3bbdb7a700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bb805fbc0 con 0x7f3bb80b9890 2020-04-22T14:03:06.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.260+0000 7f3bbdb7a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bb805fe60 con 0x7f3bb80b5ea0 2020-04-22T14:03:06.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.260+0000 7f3bbdb7a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bb8060100 con 0x7f3bb8143bc0 2020-04-22T14:03:06.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.260+0000 7f3bb6ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3bb8143bc0 0x7f3bb8146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:06.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.261+0000 7f3bb77fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f3bb80b9890 0x7f3bb81434b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40100/0 (socket says 172.21.15.103:40100) 2020-04-22T14:03:06.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.261+0000 7f3bb77fe700 1 -- 172.21.15.103:0/4045052400 learned_addr learned my addr 172.21.15.103:0/4045052400 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:06.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.261+0000 7f3bb6ffd700 1 -- 172.21.15.103:0/4045052400 >> v2:172.21.15.86:3300/0 conn(0x7f3bb80b5ea0 msgr2=0x7f3bb80b6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:06.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.261+0000 7f3bb7fff700 1 --2- 172.21.15.103:0/4045052400 >> v2:172.21.15.86:3300/0 conn(0x7f3bb80b5ea0 0x7f3bb80b6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:06.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.261+0000 7f3bb6ffd700 1 --2- 172.21.15.103:0/4045052400 >> v2:172.21.15.86:3300/0 conn(0x7f3bb80b5ea0 0x7f3bb80b6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:06.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.261+0000 7f3bb67fc700 1 -- 172.21.15.103:0/4045052400 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1290285576 0 0) 0x7f3bb805fbc0 con 0x7f3bb80b9890 2020-04-22T14:03:06.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.261+0000 7f3bb6ffd700 1 -- 172.21.15.103:0/4045052400 >> v1:172.21.15.103:6789/0 conn(0x7f3bb80b9890 legacy=0x7f3bb81434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:06.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.261+0000 7f3bb6ffd700 1 -- 172.21.15.103:0/4045052400 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb80b9c70 con 0x7f3bb8143bc0 2020-04-22T14:03:06.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.261+0000 7f3bb6ffd700 1 --2- 172.21.15.103:0/4045052400 >> v2:172.21.15.103:3300/0 conn(0x7f3bb8143bc0 0x7f3bb8146fc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3bac002f30 tx=0x7f3bac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:06.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.261+0000 7f3bb6ffd700 1 --2- 172.21.15.103:0/4045052400 >> v2:172.21.15.103:3300/0 conn(0x7f3bb8143bc0 0x7f3bb8146fc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3bac002f30 tx=0x7f3bac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:06.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.261+0000 7f3bb6ffd700 1 --2- 172.21.15.103:0/4045052400 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bb8143bc0 0x7f3bb8146fc0 secure :-1 s=READY pgs=254 cs=0 l=1 rx=0x7f3bac002f30 tx=0x7f3bac007a40).ready entity=mon.1 client_cookie=816c488cd26f2e69 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:06.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.261+0000 7f3bb6ffd700 1 --2- 172.21.15.103:0/4045052400 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bb8143bc0 0x7f3bb8146fc0 secure :-1 s=THROTTLE_DONE pgs=254 cs=0 l=1 rx=0x7f3bac002f30 tx=0x7f3bac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:06.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.261+0000 7f3bb67fc700 1 -- 172.21.15.103:0/4045052400 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bac011470 con 0x7f3bb8143bc0 2020-04-22T14:03:06.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.261+0000 7f3bb6ffd700 1 --2- 172.21.15.103:0/4045052400 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bb8143bc0 0x7f3bb8146fc0 secure :-1 s=THROTTLE_DONE pgs=254 cs=0 l=1 rx=0x7f3bac002f30 tx=0x7f3bac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:06.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.261+0000 7f3bb67fc700 1 -- 172.21.15.103:0/4045052400 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bac0115d0 con 0x7f3bb8143bc0 2020-04-22T14:03:06.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.261+0000 7f3bb6ffd700 1 --2- 172.21.15.103:0/4045052400 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bb8143bc0 0x7f3bb8146fc0 secure :-1 s=THROTTLE_DONE pgs=254 cs=0 l=1 rx=0x7f3bac002f30 tx=0x7f3bac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:06.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.261+0000 7f3bb67fc700 1 -- 172.21.15.103:0/4045052400 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bac0119b0 con 0x7f3bb8143bc0 2020-04-22T14:03:06.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.261+0000 7f3bbdb7a700 1 -- 172.21.15.103:0/4045052400 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bb8143bc0 msgr2=0x7f3bb8146fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:06.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.261+0000 7f3bbdb7a700 1 --2- 172.21.15.103:0/4045052400 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bb8143bc0 0x7f3bb8146fc0 secure :-1 s=READY pgs=254 cs=0 l=1 rx=0x7f3bac002f30 tx=0x7f3bac007a40).stop 2020-04-22T14:03:06.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.262+0000 7f3bbdb7a700 1 -- 172.21.15.103:0/4045052400 shutdown_connections 2020-04-22T14:03:06.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.262+0000 7f3bbdb7a700 1 --2- 172.21.15.103:0/4045052400 >> v2:172.21.15.86:3300/0 conn(0x7f3bb80b5ea0 0x7f3bb80b6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:06.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.262+0000 7f3bbdb7a700 1 --2- 172.21.15.103:0/4045052400 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bb8143bc0 0x7f3bb8146fc0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:06.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.262+0000 7f3bbdb7a700 1 -- 172.21.15.103:0/4045052400 >> 172.21.15.103:0/4045052400 conn(0x7f3bb805ad30 msgr2=0x7f3bb805b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:06.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.262+0000 7f3bbdb7a700 1 -- 172.21.15.103:0/4045052400 shutdown_connections 2020-04-22T14:03:06.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.262+0000 7f3bbdb7a700 1 -- 172.21.15.103:0/4045052400 wait complete. 2020-04-22T14:03:06.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.263+0000 7f3bbdb7a700 1 Processor -- start 2020-04-22T14:03:06.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.263+0000 7f3bbdb7a700 1 -- start start 2020-04-22T14:03:06.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.263+0000 7f3bbdb7a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3bb80b5ea0 0x7f3bb80bc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:06.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.263+0000 7f3bbdb7a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bb8158090 con 0x7f3bb80b9890 2020-04-22T14:03:06.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.264+0000 7f3bbdb7a700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bb812e280 con 0x7f3bb8143bc0 2020-04-22T14:03:06.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.264+0000 7f3bbdb7a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bb812e520 con 0x7f3bb80b5ea0 2020-04-22T14:03:06.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.264+0000 7f3bb77fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3bb80b5ea0 0x7f3bb80bc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:06.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.264+0000 7f3bb7fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f3bb8143bc0 0x7f3bb812a5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40110/0 (socket says 172.21.15.103:40110) 2020-04-22T14:03:06.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.264+0000 7f3bb7fff700 1 -- 172.21.15.103:0/4145778522 learned_addr learned my addr 172.21.15.103:0/4145778522 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:06.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.264+0000 7f3bb77fe700 1 --2- 172.21.15.103:0/4145778522 >> v2:172.21.15.103:3300/0 conn(0x7f3bb80b5ea0 0x7f3bb80bc550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47916/0 (socket says 172.21.15.103:47916) 2020-04-22T14:03:06.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.264+0000 7f3bb77fe700 1 -- 172.21.15.103:0/4145778522 >> v1:172.21.15.103:6789/0 conn(0x7f3bb8143bc0 legacy=0x7f3bb812a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:06.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.264+0000 7f3bb77fe700 1 -- 172.21.15.103:0/4145778522 >> v1:172.21.15.86:6789/0 conn(0x7f3bb80b9890 legacy=0x7f3bb8157660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:06.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.264+0000 7f3bb4ff9700 1 -- 172.21.15.103:0/4145778522 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1880597056 0 0) 0x7f3bb812e280 con 0x7f3bb8143bc0 2020-04-22T14:03:06.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.264+0000 7f3bb77fe700 1 -- 172.21.15.103:0/4145778522 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb8157d70 con 0x7f3bb80b5ea0 2020-04-22T14:03:06.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.264+0000 7f3bb77fe700 1 --2- 172.21.15.103:0/4145778522 >> v2:172.21.15.103:3300/0 conn(0x7f3bb80b5ea0 0x7f3bb80bc550 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3bb8153d80 tx=0x7f3ba80109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:06.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.264+0000 7f3bb77fe700 1 --2- 172.21.15.103:0/4145778522 >> v2:172.21.15.103:3300/0 conn(0x7f3bb80b5ea0 0x7f3bb80bc550 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3bb8153d80 tx=0x7f3ba80109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:06.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.264+0000 7f3bb77fe700 1 --2- 172.21.15.103:0/4145778522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bb80b5ea0 0x7f3bb80bc550 secure :-1 s=READY pgs=256 cs=0 l=1 rx=0x7f3bb8153d80 tx=0x7f3ba80109b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:06.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.264+0000 7f3bb77fe700 1 --2- 172.21.15.103:0/4145778522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bb80b5ea0 0x7f3bb80bc550 secure :-1 s=THROTTLE_DONE pgs=256 cs=0 l=1 rx=0x7f3bb8153d80 tx=0x7f3ba80109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:06.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.264+0000 7f3bb4ff9700 1 -- 172.21.15.103:0/4145778522 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ba8005ca0 con 0x7f3bb80b5ea0 2020-04-22T14:03:06.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.264+0000 7f3bb77fe700 1 --2- 172.21.15.103:0/4145778522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bb80b5ea0 0x7f3bb80bc550 secure :-1 s=THROTTLE_DONE pgs=256 cs=0 l=1 rx=0x7f3bb8153d80 tx=0x7f3ba80109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:06.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.264+0000 7f3bb4ff9700 1 -- 172.21.15.103:0/4145778522 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba8005e00 con 0x7f3bb80b5ea0 2020-04-22T14:03:06.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.264+0000 7f3bb77fe700 1 --2- 172.21.15.103:0/4145778522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bb80b5ea0 0x7f3bb80bc550 secure :-1 s=THROTTLE_DONE pgs=256 cs=0 l=1 rx=0x7f3bb8153d80 tx=0x7f3ba80109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:06.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.264+0000 7f3bb4ff9700 1 -- 172.21.15.103:0/4145778522 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ba80062c0 con 0x7f3bb80b5ea0 2020-04-22T14:03:06.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.264+0000 7f3bbdb7a700 1 -- 172.21.15.103:0/4145778522 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb80bce10 con 0x7f3bb80b5ea0 2020-04-22T14:03:06.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.264+0000 7f3bbdb7a700 1 -- 172.21.15.103:0/4145778522 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb812ad00 con 0x7f3bb80b5ea0 2020-04-22T14:03:06.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.265+0000 7f3bb77fe700 1 --2- 172.21.15.103:0/4145778522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bb80b5ea0 0x7f3bb80bc550 secure :-1 s=THROTTLE_DONE pgs=256 cs=0 l=1 rx=0x7f3bb8153d80 tx=0x7f3ba80109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:06.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.265+0000 7f3bbdb7a700 1 -- 172.21.15.103:0/4145778522 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb8056c90 con 0x7f3bb80b5ea0 2020-04-22T14:03:06.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.265+0000 7f3bb4ff9700 1 -- 172.21.15.103:0/4145778522 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f3ba8006500 con 0x7f3bb80b5ea0 2020-04-22T14:03:06.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.265+0000 7f3bb77fe700 1 --2- 172.21.15.103:0/4145778522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bb80b5ea0 0x7f3bb80bc550 secure :-1 s=THROTTLE_DONE pgs=256 cs=0 l=1 rx=0x7f3bb8153d80 tx=0x7f3ba80109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:06.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.265+0000 7f3bb4ff9700 1 --2- 172.21.15.103:0/4145778522 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3b9804d830 0x7f3b9804fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:06.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.265+0000 7f3bb4ff9700 1 -- 172.21.15.103:0/4145778522 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3ba80090c0 con 0x7f3bb80b5ea0 2020-04-22T14:03:06.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.266+0000 7f3bb6ffd700 1 --2- 172.21.15.103:0/4145778522 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3b9804d830 0x7f3b9804fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:06.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.266+0000 7f3bb6ffd700 1 --2- 172.21.15.103:0/4145778522 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3b9804d830 0x7f3b9804fcf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3bb812d520 tx=0x7f3bac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:06.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.266+0000 7f3bb6ffd700 1 --2- 172.21.15.103:0/4145778522 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3b9804d830 0x7f3b9804fcf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3bb812d520 tx=0x7f3bac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:06.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.266+0000 7f3bb6ffd700 1 --2- 172.21.15.103:0/4145778522 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3b9804d830 0x7f3b9804fcf0 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7f3bb812d520 tx=0x7f3bac007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:06.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.269+0000 7f3bb77fe700 1 --2- 172.21.15.103:0/4145778522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bb80b5ea0 0x7f3bb80bc550 secure :-1 s=THROTTLE_DONE pgs=256 cs=0 l=1 rx=0x7f3bb8153d80 tx=0x7f3ba80109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:06.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.269+0000 7f3bb4ff9700 1 -- 172.21.15.103:0/4145778522 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f3ba803c940 con 0x7f3bb80b5ea0 2020-04-22T14:03:06.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.414+0000 7f3bbdb7a700 1 -- 172.21.15.103:0/4145778522 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3bb80bcbf0 con 0x7f3bb80b5ea0 2020-04-22T14:03:06.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.418+0000 7f3bb77fe700 1 --2- 172.21.15.103:0/4145778522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bb80b5ea0 0x7f3bb80bc550 secure :-1 s=THROTTLE_DONE pgs=256 cs=0 l=1 rx=0x7f3bb8153d80 tx=0x7f3ba80109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:06.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.418+0000 7f3bb4ff9700 1 -- 172.21.15.103:0/4145778522 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7f3ba803ff60 con 0x7f3bb80b5ea0 2020-04-22T14:03:06.421 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:03:06.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.420+0000 7f3bbdb7a700 1 -- 172.21.15.103:0/4145778522 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3b9804d830 msgr2=0x7f3b9804fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:06.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.420+0000 7f3bbdb7a700 1 --2- 172.21.15.103:0/4145778522 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3b9804d830 0x7f3b9804fcf0 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7f3bb812d520 tx=0x7f3bac007a40).stop 2020-04-22T14:03:06.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.420+0000 7f3bbdb7a700 1 -- 172.21.15.103:0/4145778522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bb80b5ea0 msgr2=0x7f3bb80bc550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:06.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.420+0000 7f3bbdb7a700 1 --2- 172.21.15.103:0/4145778522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bb80b5ea0 0x7f3bb80bc550 secure :-1 s=READY pgs=256 cs=0 l=1 rx=0x7f3bb8153d80 tx=0x7f3ba80109b0).stop 2020-04-22T14:03:06.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.420+0000 7f3bbdb7a700 1 -- 172.21.15.103:0/4145778522 shutdown_connections 2020-04-22T14:03:06.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.420+0000 7f3bbdb7a700 1 --2- 172.21.15.103:0/4145778522 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3b9804d830 0x7f3b9804fcf0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:06.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.420+0000 7f3bbdb7a700 1 --2- 172.21.15.103:0/4145778522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bb80b5ea0 0x7f3bb80bc550 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:06.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.420+0000 7f3bbdb7a700 1 -- 172.21.15.103:0/4145778522 >> 172.21.15.103:0/4145778522 conn(0x7f3bb805ad30 msgr2=0x7f3bb80b4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:06.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.420+0000 7f3bbdb7a700 1 -- 172.21.15.103:0/4145778522 shutdown_connections 2020-04-22T14:03:06.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.420+0000 7f3bbdb7a700 1 -- 172.21.15.103:0/4145778522 wait complete. 2020-04-22T14:03:06.432 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-04-22T14:03:06.432 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:06.450 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:03:06.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.595+0000 7fec9de27700 1 Processor -- start 2020-04-22T14:03:06.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.596+0000 7fec9de27700 1 -- start start 2020-04-22T14:03:06.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.596+0000 7fec9de27700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fec980b0ed0 0x7fec980b70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:06.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.596+0000 7fec9de27700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fec980b7540 0x7fec98145960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:06.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.596+0000 7fec9de27700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec98146240 con 0x7fec98145dc0 2020-04-22T14:03:06.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.596+0000 7fec9de27700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec980b79f0 con 0x7fec980b7540 2020-04-22T14:03:06.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.596+0000 7fec9de27700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec980b7c90 con 0x7fec980b0ed0 2020-04-22T14:03:06.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.596+0000 7fec977fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fec980b0ed0 0x7fec980b70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:06.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.596+0000 7fec977fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fec980b0ed0 0x7fec980b70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47924/0 (socket says 172.21.15.103:47924) 2020-04-22T14:03:06.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.596+0000 7fec977fe700 1 -- 172.21.15.103:0/2480127507 learned_addr learned my addr 172.21.15.103:0/2480127507 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:06.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.597+0000 7fec96ffd700 1 --2- 172.21.15.103:0/2480127507 >> v2:172.21.15.86:3300/0 conn(0x7fec980b7540 0x7fec98145960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:06.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.597+0000 7fec977fe700 1 -- 172.21.15.103:0/2480127507 >> v2:172.21.15.86:3300/0 conn(0x7fec980b7540 msgr2=0x7fec98145960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:06.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.597+0000 7fec977fe700 1 --2- 172.21.15.103:0/2480127507 >> v2:172.21.15.86:3300/0 conn(0x7fec980b7540 0x7fec98145960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:06.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.597+0000 7fec977fe700 1 -- 172.21.15.103:0/2480127507 >> v1:172.21.15.86:6789/0 conn(0x7fec98145dc0 legacy=0x7fec9805fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:06.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.597+0000 7fec977fe700 1 -- 172.21.15.103:0/2480127507 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec980b7f30 con 0x7fec980b0ed0 2020-04-22T14:03:06.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.597+0000 7fec977fe700 1 --2- 172.21.15.103:0/2480127507 >> v2:172.21.15.103:3300/0 conn(0x7fec980b0ed0 0x7fec980b70e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fec88002f30 tx=0x7fec88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:06.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.597+0000 7fec977fe700 1 --2- 172.21.15.103:0/2480127507 >> v2:172.21.15.103:3300/0 conn(0x7fec980b0ed0 0x7fec980b70e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fec88002f30 tx=0x7fec88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:06.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.597+0000 7fec977fe700 1 --2- 172.21.15.103:0/2480127507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec980b0ed0 0x7fec980b70e0 secure :-1 s=READY pgs=257 cs=0 l=1 rx=0x7fec88002f30 tx=0x7fec88007a40).ready entity=mon.1 client_cookie=14a6ad7742f2a1f server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:06.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.597+0000 7fec977fe700 1 --2- 172.21.15.103:0/2480127507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec980b0ed0 0x7fec980b70e0 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7fec88002f30 tx=0x7fec88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:06.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.597+0000 7fec977fe700 1 --2- 172.21.15.103:0/2480127507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec980b0ed0 0x7fec980b70e0 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7fec88002f30 tx=0x7fec88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:06.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.597+0000 7fec977fe700 1 --2- 172.21.15.103:0/2480127507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec980b0ed0 0x7fec980b70e0 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7fec88002f30 tx=0x7fec88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:06.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.597+0000 7fec967fc700 1 -- 172.21.15.103:0/2480127507 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec88011720 con 0x7fec980b0ed0 2020-04-22T14:03:06.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.597+0000 7fec967fc700 1 -- 172.21.15.103:0/2480127507 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec88011880 con 0x7fec980b0ed0 2020-04-22T14:03:06.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.597+0000 7fec967fc700 1 -- 172.21.15.103:0/2480127507 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec88011ca0 con 0x7fec980b0ed0 2020-04-22T14:03:06.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.597+0000 7fec9de27700 1 -- 172.21.15.103:0/2480127507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec980b0ed0 msgr2=0x7fec980b70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:06.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.597+0000 7fec9de27700 1 --2- 172.21.15.103:0/2480127507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec980b0ed0 0x7fec980b70e0 secure :-1 s=READY pgs=257 cs=0 l=1 rx=0x7fec88002f30 tx=0x7fec88007a40).stop 2020-04-22T14:03:06.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.598+0000 7fec9de27700 1 -- 172.21.15.103:0/2480127507 shutdown_connections 2020-04-22T14:03:06.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.598+0000 7fec9de27700 1 --2- 172.21.15.103:0/2480127507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec980b0ed0 0x7fec980b70e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:06.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.598+0000 7fec9de27700 1 --2- 172.21.15.103:0/2480127507 >> v2:172.21.15.86:3300/0 conn(0x7fec980b7540 0x7fec98145960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:06.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.598+0000 7fec9de27700 1 -- 172.21.15.103:0/2480127507 >> 172.21.15.103:0/2480127507 conn(0x7fec9805f2c0 msgr2=0x7fec98061fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:06.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.598+0000 7fec9de27700 1 -- 172.21.15.103:0/2480127507 shutdown_connections 2020-04-22T14:03:06.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.598+0000 7fec9de27700 1 -- 172.21.15.103:0/2480127507 wait complete. 2020-04-22T14:03:06.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.598+0000 7fec9de27700 1 Processor -- start 2020-04-22T14:03:06.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.599+0000 7fec9de27700 1 -- start start 2020-04-22T14:03:06.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.599+0000 7fec9de27700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fec980b0ed0 0x7fec98147ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:06.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.599+0000 7fec9de27700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fec98145dc0 0x7fec9814a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:06.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.599+0000 7fec9de27700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec98148300 con 0x7fec980b7540 2020-04-22T14:03:06.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.599+0000 7fec9de27700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec980b66e0 con 0x7fec980b0ed0 2020-04-22T14:03:06.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.599+0000 7fec9de27700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec980b5890 con 0x7fec98145dc0 2020-04-22T14:03:06.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.599+0000 7fec977fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fec980b0ed0 0x7fec98147ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:06.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.599+0000 7fec977fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fec980b0ed0 0x7fec98147ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47930/0 (socket says 172.21.15.103:47930) 2020-04-22T14:03:06.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.599+0000 7fec977fe700 1 -- 172.21.15.103:0/1880291712 learned_addr learned my addr 172.21.15.103:0/1880291712 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:06.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.600+0000 7fec97fff700 1 --2- 172.21.15.103:0/1880291712 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fec98145dc0 0x7fec9814a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:06.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.600+0000 7fec977fe700 1 -- 172.21.15.103:0/1880291712 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fec98145dc0 msgr2=0x7fec9814a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:06.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.600+0000 7fec977fe700 1 --2- 172.21.15.103:0/1880291712 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fec98145dc0 0x7fec9814a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:06.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.600+0000 7fec977fe700 1 -- 172.21.15.103:0/1880291712 >> v1:172.21.15.86:6789/0 conn(0x7fec980b7540 legacy=0x7fec980b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:06.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.600+0000 7fec977fe700 1 -- 172.21.15.103:0/1880291712 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec980b5b30 con 0x7fec980b0ed0 2020-04-22T14:03:06.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.600+0000 7fec97fff700 1 --2- 172.21.15.103:0/1880291712 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fec98145dc0 0x7fec9814a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:03:06.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.600+0000 7fec977fe700 1 --2- 172.21.15.103:0/1880291712 >> v2:172.21.15.103:3300/0 conn(0x7fec980b0ed0 0x7fec98147ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fec88002f30 tx=0x7fec88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:06.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.600+0000 7fec977fe700 1 --2- 172.21.15.103:0/1880291712 >> v2:172.21.15.103:3300/0 conn(0x7fec980b0ed0 0x7fec98147ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fec88002f30 tx=0x7fec88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:06.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.600+0000 7fec977fe700 1 --2- 172.21.15.103:0/1880291712 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec980b0ed0 0x7fec98147ea0 secure :-1 s=READY pgs=258 cs=0 l=1 rx=0x7fec88002f30 tx=0x7fec88007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:06.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.600+0000 7fec977fe700 1 --2- 172.21.15.103:0/1880291712 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec980b0ed0 0x7fec98147ea0 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7fec88002f30 tx=0x7fec88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:06.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.600+0000 7fec94ff9700 1 -- 172.21.15.103:0/1880291712 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec88007170 con 0x7fec980b0ed0 2020-04-22T14:03:06.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.600+0000 7fec977fe700 1 --2- 172.21.15.103:0/1880291712 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec980b0ed0 0x7fec98147ea0 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7fec88002f30 tx=0x7fec88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:06.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.600+0000 7fec977fe700 1 --2- 172.21.15.103:0/1880291712 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec980b0ed0 0x7fec98147ea0 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7fec88002f30 tx=0x7fec88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:06.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.600+0000 7fec94ff9700 1 -- 172.21.15.103:0/1880291712 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec880072d0 con 0x7fec980b0ed0 2020-04-22T14:03:06.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.600+0000 7fec9de27700 1 -- 172.21.15.103:0/1880291712 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec9814b250 con 0x7fec980b0ed0 2020-04-22T14:03:06.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.600+0000 7fec94ff9700 1 -- 172.21.15.103:0/1880291712 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec880056c0 con 0x7fec980b0ed0 2020-04-22T14:03:06.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.600+0000 7fec9de27700 1 -- 172.21.15.103:0/1880291712 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec9814ade0 con 0x7fec980b0ed0 2020-04-22T14:03:06.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.601+0000 7fec977fe700 1 --2- 172.21.15.103:0/1880291712 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec980b0ed0 0x7fec98147ea0 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7fec88002f30 tx=0x7fec88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:06.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.601+0000 7fec9de27700 1 -- 172.21.15.103:0/1880291712 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec98061220 con 0x7fec980b0ed0 2020-04-22T14:03:06.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.601+0000 7fec94ff9700 1 -- 172.21.15.103:0/1880291712 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fec88005900 con 0x7fec980b0ed0 2020-04-22T14:03:06.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.601+0000 7fec977fe700 1 --2- 172.21.15.103:0/1880291712 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec980b0ed0 0x7fec98147ea0 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7fec88002f30 tx=0x7fec88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:06.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.601+0000 7fec94ff9700 1 --2- 172.21.15.103:0/1880291712 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fec7c04d980 0x7fec7c04fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:06.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.601+0000 7fec94ff9700 1 -- 172.21.15.103:0/1880291712 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fec88061ca0 con 0x7fec980b0ed0 2020-04-22T14:03:06.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.601+0000 7fec96ffd700 1 --2- 172.21.15.103:0/1880291712 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fec7c04d980 0x7fec7c04fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:06.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.602+0000 7fec96ffd700 1 --2- 172.21.15.103:0/1880291712 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fec7c04d980 0x7fec7c04fe40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fec98148a20 tx=0x7fec80008d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:06.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.602+0000 7fec96ffd700 1 --2- 172.21.15.103:0/1880291712 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fec7c04d980 0x7fec7c04fe40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fec98148a20 tx=0x7fec80008d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:06.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.602+0000 7fec96ffd700 1 --2- 172.21.15.103:0/1880291712 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fec7c04d980 0x7fec7c04fe40 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7fec98148a20 tx=0x7fec80008d00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:06.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.605+0000 7fec977fe700 1 --2- 172.21.15.103:0/1880291712 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec980b0ed0 0x7fec98147ea0 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7fec88002f30 tx=0x7fec88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:06.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.605+0000 7fec94ff9700 1 -- 172.21.15.103:0/1880291712 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fec8803d1a0 con 0x7fec980b0ed0 2020-04-22T14:03:06.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.793+0000 7fec9de27700 1 -- 172.21.15.103:0/1880291712 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec980b5cc0 con 0x7fec980b0ed0 2020-04-22T14:03:06.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.793+0000 7fec977fe700 1 --2- 172.21.15.103:0/1880291712 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec980b0ed0 0x7fec98147ea0 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7fec88002f30 tx=0x7fec88007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:06.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.793+0000 7fec94ff9700 1 -- 172.21.15.103:0/1880291712 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2137 (secure 0 0 0) 0x7fec880407c0 con 0x7fec980b0ed0 2020-04-22T14:03:06.796 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:03:06.796 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/3739398122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3739398122},{"type":"v1","addr":"172.21.15.86:6835","nonce":3739398122}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":6}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:02:27.685979+0000","modified":"2020-04-22T14:02:32.276953+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4357},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4357":{"gid":4357,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.103:6833/1765986263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1765986263},{"type":"v1","addr":"172.21.15.103:6833","nonce":1765986263}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-22T14:03:06.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.794+0000 7fec9de27700 1 -- 172.21.15.103:0/1880291712 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fec7c04d980 msgr2=0x7fec7c04fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:06.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.794+0000 7fec9de27700 1 --2- 172.21.15.103:0/1880291712 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fec7c04d980 0x7fec7c04fe40 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7fec98148a20 tx=0x7fec80008d00).stop 2020-04-22T14:03:06.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.794+0000 7fec9de27700 1 -- 172.21.15.103:0/1880291712 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec980b0ed0 msgr2=0x7fec98147ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:06.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.794+0000 7fec9de27700 1 --2- 172.21.15.103:0/1880291712 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec980b0ed0 0x7fec98147ea0 secure :-1 s=READY pgs=258 cs=0 l=1 rx=0x7fec88002f30 tx=0x7fec88007a40).stop 2020-04-22T14:03:06.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.794+0000 7fec9de27700 1 -- 172.21.15.103:0/1880291712 shutdown_connections 2020-04-22T14:03:06.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.794+0000 7fec9de27700 1 --2- 172.21.15.103:0/1880291712 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fec7c04d980 0x7fec7c04fe40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:06.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.794+0000 7fec9de27700 1 --2- 172.21.15.103:0/1880291712 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fec98145dc0 0x7fec9814a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:06.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.794+0000 7fec9de27700 1 --2- 172.21.15.103:0/1880291712 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec980b0ed0 0x7fec98147ea0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:06.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.794+0000 7fec9de27700 1 -- 172.21.15.103:0/1880291712 >> 172.21.15.103:0/1880291712 conn(0x7fec9805f2c0 msgr2=0x7fec9805faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:06.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.794+0000 7fec9de27700 1 -- 172.21.15.103:0/1880291712 shutdown_connections 2020-04-22T14:03:06.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:06.794+0000 7fec9de27700 1 -- 172.21.15.103:0/1880291712 wait complete. 2020-04-22T14:03:06.798 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 6 2020-04-22T14:03:07.008 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4357}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 3, u'failed': [], u'epoch': 5, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [4], u'info': {u'gid_4357': {u'export_targets': [], u'name': u'a', u'incarnation': 4, u'state_seq': 2, u'state': u'up:active', u'gid': 4357, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 1765986263, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 1765986263, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/1765986263'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:02:27.685979+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:02:32.276953+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:03:07.008 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:03:07.009 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:07.022 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:03:07.181 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:03:07.181 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:03:07.181 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:03:07.181 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4357, 2020-04-22T14:03:07.181 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:03:07.181 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:03:07.182 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 35.907058001000003, 2020-04-22T14:03:07.182 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 5, 2020-04-22T14:03:07.182 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 24, 2020-04-22T14:03:07.182 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 24, 2020-04-22T14:03:07.182 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 36.613500516000002 2020-04-22T14:03:07.182 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:03:07.189 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 4357, "want_state": "up:active", "state": "up:active", "rank_uptime": 35.907058001000003, "mdsmap_epoch": 5, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "uptime": 36.613500516000002 } 2020-04-22T14:03:07.190 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-04-22T14:03:07.190 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2020-04-22T14:03:07.190 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:07.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:07.215 INFO:teuthology.orchestra.run.smithi086:> ip addr 2020-04-22T14:03:07.281 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:03:07.281 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:03:07.281 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:03:07.282 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:07.282 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2020-04-22T14:03:07.282 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:07.282 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:03:07.282 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:07.282 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:03:07.282 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:07.283 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:03:07.283 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:07.283 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:03:07.283 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:07.283 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:03:07.283 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 42627sec preferred_lft 42627sec 2020-04-22T14:03:07.283 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2020-04-22T14:03:07.284 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:07.284 INFO:teuthology.orchestra.run.smithi086.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:03:07.284 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 2a:6a:eb:ac:a8:de brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:07.284 INFO:teuthology.orchestra.run.smithi086.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:03:07.284 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:07.284 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::fc4f:8d1:211e:2a28/64 scope link noprefixroute 2020-04-22T14:03:07.284 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:07.285 INFO:teuthology.orchestra.run.smithi086.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-04-22T14:03:07.285 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 2a:6a:eb:ac:a8:de brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2020-04-22T14:03:07.285 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:07.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:07.328 INFO:teuthology.orchestra.run.smithi086:> ip netns list 2020-04-22T14:03:07.388 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 0) 2020-04-22T14:03:07.389 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:07.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:07.440 INFO:teuthology.orchestra.run.smithi086:> ip netns list-id 2020-04-22T14:03:07.502 INFO:teuthology.orchestra.run.smithi086.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.3) 2020-04-22T14:03:07.502 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:07.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:07.555 INFO:teuthology.orchestra.run.smithi086:> ip netns list-id 2020-04-22T14:03:07.613 INFO:teuthology.orchestra.run.smithi086.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.3) 2020-04-22T14:03:07.613 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:07.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:07.666 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2' 2020-04-22T14:03:07.745 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:07.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:07.795 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1' 2020-04-22T14:03:07.876 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:07.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:07.926 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr' 2020-04-22T14:03:08.028 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:03:08.029 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:03:08.029 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:03:08.029 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:08.029 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2020-04-22T14:03:08.029 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:08.029 INFO:teuthology.orchestra.run.smithi086.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:03:08.029 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether ce:15:28:6c:17:e2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:03:08.030 INFO:teuthology.orchestra.run.smithi086.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2020-04-22T14:03:08.030 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:08.030 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::cc15:28ff:fe6c:17e2/64 scope link 2020-04-22T14:03:08.030 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:08.030 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:08.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:08.075 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr' 2020-04-22T14:03:08.182 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:03:08.183 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:03:08.183 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:03:08.183 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:08.183 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2020-04-22T14:03:08.183 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:08.183 INFO:teuthology.orchestra.run.smithi086.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:03:08.184 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether ce:15:28:6c:17:e2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:03:08.184 INFO:teuthology.orchestra.run.smithi086.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2020-04-22T14:03:08.184 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:08.184 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::cc15:28ff:fe6c:17e2/64 scope link 2020-04-22T14:03:08.184 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:08.184 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2020-04-22T14:03:08.185 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:08.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:08.217 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1' 2020-04-22T14:03:08.292 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:08.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:08.339 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0' 2020-04-22T14:03:08.448 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:08.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:08.462 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up' 2020-04-22T14:03:08.570 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:08.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:08.585 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up' 2020-04-22T14:03:08.694 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:08.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:08.722 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254' 2020-04-22T14:03:08.833 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:08.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:08.887 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:03:08.965 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:09.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:09.014 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'nmcli connection add type bridge-slave con-name brx.1 ifname brx.1 master ceph-brx' 2020-04-22T14:03:09.129 INFO:teuthology.orchestra.run.smithi086.stdout:Connection 'brx.1' (1584808d-123c-4e91-8a33-42a2964351cf) successfully added. 2020-04-22T14:03:09.129 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:09.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:09.154 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'nmcli connection up brx.1' 2020-04-22T14:03:09.325 INFO:teuthology.orchestra.run.smithi086.stdout:Connection successfully activated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/6) 2020-04-22T14:03:09.375 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2020-04-22T14:03:09.375 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.2 at ubuntu@smithi086.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.2... 2020-04-22T14:03:09.376 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:09.391 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:09.391 INFO:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.2) 2020-04-22T14:03:09.449 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:09.510 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:09.510 INFO:teuthology.orchestra.run.smithi086:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:03:09.579 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:03:09.591 INFO:teuthology.orchestra.run.smithi086.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:03:09.591 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:09.638 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:09.638 INFO:teuthology.orchestra.run.smithi086:> ls /sys/fs/fuse/connections 2020-04-22T14:03:09.693 INFO:teuthology.orchestra.run.smithi086.stdout:47 2020-04-22T14:03:09.693 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [47] 2020-04-22T14:03:09.693 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:09.745 INFO:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.2 /home/ubuntu/cephtest/mnt.2) 2020-04-22T14:03:09.787 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:09.801 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:09.801 INFO:teuthology.orchestra.run.smithi086:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:03:09.871 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:03:09.876 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi086.stderr:2020-04-22T14:03:09.873+0000 7fc068db31c0 -1 init, newargv = 0x562d4ba38530 newargc=9 2020-04-22T14:03:09.876 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi086.stderr:ceph-fuse[36191]: starting ceph client 2020-04-22T14:03:09.881 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi086.stderr:ceph-fuse[36191]: starting fuse 2020-04-22T14:03:09.887 INFO:teuthology.orchestra.run.smithi086.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:03:09.888 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:09.907 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:09.907 INFO:teuthology.orchestra.run.smithi086:> ls /sys/fs/fuse/connections 2020-04-22T14:03:09.961 INFO:teuthology.orchestra.run.smithi086.stdout:47 2020-04-22T14:03:09.962 INFO:teuthology.orchestra.run.smithi086.stdout:49 2020-04-22T14:03:09.962 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47, 49] 2020-04-22T14:03:09.963 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:10.015 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:10.015 INFO:teuthology.orchestra.run.smithi086:> sudo python3 -c ' 2020-04-22T14:03:10.016 INFO:teuthology.orchestra.run.smithi086:> import glob 2020-04-22T14:03:10.016 INFO:teuthology.orchestra.run.smithi086:> import re 2020-04-22T14:03:10.016 INFO:teuthology.orchestra.run.smithi086:> import os 2020-04-22T14:03:10.016 INFO:teuthology.orchestra.run.smithi086:> import subprocess 2020-04-22T14:03:10.016 INFO:teuthology.orchestra.run.smithi086:> 2020-04-22T14:03:10.016 INFO:teuthology.orchestra.run.smithi086:> def find_socket(client_name): 2020-04-22T14:03:10.016 INFO:teuthology.orchestra.run.smithi086:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2020-04-22T14:03:10.016 INFO:teuthology.orchestra.run.smithi086:> files = glob.glob(asok_path) 2020-04-22T14:03:10.017 INFO:teuthology.orchestra.run.smithi086:> 2020-04-22T14:03:10.017 INFO:teuthology.orchestra.run.smithi086:> # Given a non-glob path, it better be there 2020-04-22T14:03:10.017 INFO:teuthology.orchestra.run.smithi086:> if "*" not in asok_path: 2020-04-22T14:03:10.017 INFO:teuthology.orchestra.run.smithi086:> assert(len(files) == 1) 2020-04-22T14:03:10.017 INFO:teuthology.orchestra.run.smithi086:> return files[0] 2020-04-22T14:03:10.017 INFO:teuthology.orchestra.run.smithi086:> 2020-04-22T14:03:10.017 INFO:teuthology.orchestra.run.smithi086:> for f in files: 2020-04-22T14:03:10.017 INFO:teuthology.orchestra.run.smithi086:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:03:10.018 INFO:teuthology.orchestra.run.smithi086:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:03:10.018 INFO:teuthology.orchestra.run.smithi086:> return f 2020-04-22T14:03:10.018 INFO:teuthology.orchestra.run.smithi086:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:03:10.018 INFO:teuthology.orchestra.run.smithi086:> 2020-04-22T14:03:10.018 INFO:teuthology.orchestra.run.smithi086:> print(find_socket("client.2")) 2020-04-22T14:03:10.018 INFO:teuthology.orchestra.run.smithi086:> ' 2020-04-22T14:03:10.128 INFO:teuthology.orchestra.run.smithi086.stdout:/var/run/ceph/ceph-client.2.36191.asok 2020-04-22T14:03:10.129 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.36191.asok 2020-04-22T14:03:10.129 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:10.144 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:10.144 INFO:teuthology.orchestra.run.smithi086:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.36191.asok status 2020-04-22T14:03:10.303 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2020-04-22T14:03:10.303 INFO:teuthology.orchestra.run.smithi086.stdout: "metadata": { 2020-04-22T14:03:10.304 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:03:10.304 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:03:10.304 INFO:teuthology.orchestra.run.smithi086.stdout: "entity_id": "2", 2020-04-22T14:03:10.304 INFO:teuthology.orchestra.run.smithi086.stdout: "hostname": "smithi086", 2020-04-22T14:03:10.304 INFO:teuthology.orchestra.run.smithi086.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2020-04-22T14:03:10.304 INFO:teuthology.orchestra.run.smithi086.stdout: "pid": "36191", 2020-04-22T14:03:10.304 INFO:teuthology.orchestra.run.smithi086.stdout: "root": "/" 2020-04-22T14:03:10.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2020-04-22T14:03:10.305 INFO:teuthology.orchestra.run.smithi086.stdout: "dentry_count": 0, 2020-04-22T14:03:10.305 INFO:teuthology.orchestra.run.smithi086.stdout: "dentry_pinned_count": 0, 2020-04-22T14:03:10.305 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 4752, 2020-04-22T14:03:10.305 INFO:teuthology.orchestra.run.smithi086.stdout: "inst": { 2020-04-22T14:03:10.305 INFO:teuthology.orchestra.run.smithi086.stdout: "name": { 2020-04-22T14:03:10.305 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "client", 2020-04-22T14:03:10.306 INFO:teuthology.orchestra.run.smithi086.stdout: "num": 4752 2020-04-22T14:03:10.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2020-04-22T14:03:10.306 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": { 2020-04-22T14:03:10.306 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "v1", 2020-04-22T14:03:10.306 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": "192.168.0.2:0", 2020-04-22T14:03:10.306 INFO:teuthology.orchestra.run.smithi086.stdout: "nonce": 159346415 2020-04-22T14:03:10.306 INFO:teuthology.orchestra.run.smithi086.stdout: } 2020-04-22T14:03:10.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2020-04-22T14:03:10.307 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": { 2020-04-22T14:03:10.307 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "v1", 2020-04-22T14:03:10.307 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": "192.168.0.2:0", 2020-04-22T14:03:10.307 INFO:teuthology.orchestra.run.smithi086.stdout: "nonce": 159346415 2020-04-22T14:03:10.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2020-04-22T14:03:10.307 INFO:teuthology.orchestra.run.smithi086.stdout: "inst_str": "client.4752 192.168.0.2:0/159346415", 2020-04-22T14:03:10.307 INFO:teuthology.orchestra.run.smithi086.stdout: "addr_str": "192.168.0.2:0/159346415", 2020-04-22T14:03:10.308 INFO:teuthology.orchestra.run.smithi086.stdout: "inode_count": 1, 2020-04-22T14:03:10.308 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_epoch": 5, 2020-04-22T14:03:10.308 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_epoch": 24, 2020-04-22T14:03:10.308 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_epoch_barrier": 0, 2020-04-22T14:03:10.308 INFO:teuthology.orchestra.run.smithi086.stdout: "blacklisted": false 2020-04-22T14:03:10.308 INFO:teuthology.orchestra.run.smithi086.stdout:} 2020-04-22T14:03:10.309 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:10.325 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:10.325 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-22T14:03:10.325 INFO:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:03:10.387 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2020-04-22T14:03:10.387 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-04-22T14:03:10.388 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:10.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:10.440 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:03:10.518 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:10.568 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:10.568 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-22T14:03:10.569 INFO:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:03:10.631 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2020-04-22T14:03:10.631 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-04-22T14:03:10.631 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:10.706 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:10.706 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:03:10.787 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:10.808 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:10.808 INFO:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-22T14:03:10.809 INFO:teuthology.orchestra.run.smithi086:> ' -- /home/ubuntu/cephtest/mnt.3) 2020-04-22T14:03:10.868 INFO:teuthology.orchestra.run.smithi086.stdout:fuseblk 2020-04-22T14:03:10.868 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2020-04-22T14:03:10.868 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:10.917 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:10.918 INFO:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.3) 2020-04-22T14:03:11.000 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:11.045 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:11.046 INFO:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-22T14:03:11.046 INFO:teuthology.orchestra.run.smithi086:> ' -- /home/ubuntu/cephtest/mnt.2) 2020-04-22T14:03:11.104 INFO:teuthology.orchestra.run.smithi086.stdout:fuseblk 2020-04-22T14:03:11.105 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2020-04-22T14:03:11.105 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:11.154 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:11.154 INFO:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.2) 2020-04-22T14:03:11.233 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2020-04-22T14:03:11.260 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:11.281 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:03:11.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.446+0000 7fdc89f79700 1 Processor -- start 2020-04-22T14:03:11.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.446+0000 7fdc89f79700 1 -- start start 2020-04-22T14:03:11.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.447+0000 7fdc89f79700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdc8412c0d0 0x7fdc841464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:11.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.447+0000 7fdc89f79700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc84063e30 0x7fdc840642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:11.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.447+0000 7fdc89f79700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc84143300 con 0x7fdc84065fe0 2020-04-22T14:03:11.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.447+0000 7fdc89f79700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc841435a0 con 0x7fdc8412c0d0 2020-04-22T14:03:11.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.447+0000 7fdc89f79700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc84143840 con 0x7fdc84063e30 2020-04-22T14:03:11.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.447+0000 7fdc82ffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fdc84065fe0 0x7fdc8405b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40128/0 (socket says 172.21.15.103:40128) 2020-04-22T14:03:11.466 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.447+0000 7fdc82ffd700 1 -- 172.21.15.103:0/1099669418 learned_addr learned my addr 172.21.15.103:0/1099669418 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:11.466 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.448+0000 7fdc83fff700 1 --2- 172.21.15.103:0/1099669418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc84063e30 0x7fdc840642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:11.466 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.448+0000 7fdc837fe700 1 --2- 172.21.15.103:0/1099669418 >> v2:172.21.15.86:3300/0 conn(0x7fdc8412c0d0 0x7fdc841464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:11.466 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.448+0000 7fdc827fc700 1 -- 172.21.15.103:0/1099669418 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1421197370 0 0) 0x7fdc84143300 con 0x7fdc84065fe0 2020-04-22T14:03:11.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.448+0000 7fdc827fc700 1 -- 172.21.15.103:0/1099669418 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc70003230 con 0x7fdc84065fe0 2020-04-22T14:03:11.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.448+0000 7fdc827fc700 1 -- 172.21.15.103:0/1099669418 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 658846389 0 0) 0x7fdc70003230 con 0x7fdc84065fe0 2020-04-22T14:03:11.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.448+0000 7fdc827fc700 1 -- 172.21.15.103:0/1099669418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc84063e30 msgr2=0x7fdc840642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:11.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.448+0000 7fdc827fc700 1 --2- 172.21.15.103:0/1099669418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc84063e30 0x7fdc840642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:11.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.448+0000 7fdc827fc700 1 -- 172.21.15.103:0/1099669418 >> v2:172.21.15.86:3300/0 conn(0x7fdc8412c0d0 msgr2=0x7fdc841464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:11.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.448+0000 7fdc827fc700 1 --2- 172.21.15.103:0/1099669418 >> v2:172.21.15.86:3300/0 conn(0x7fdc8412c0d0 0x7fdc841464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:11.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.448+0000 7fdc827fc700 1 -- 172.21.15.103:0/1099669418 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc8405bb50 con 0x7fdc84065fe0 2020-04-22T14:03:11.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.448+0000 7fdc827fc700 1 -- 172.21.15.103:0/1099669418 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fdc780016d0 con 0x7fdc84065fe0 2020-04-22T14:03:11.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.448+0000 7fdc827fc700 1 -- 172.21.15.103:0/1099669418 >> v1:172.21.15.103:6789/0 conn(0x7fdc84065fe0 legacy=0x7fdc8405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:11.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.448+0000 7fdc827fc700 1 --2- 172.21.15.103:0/1099669418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc70003720 0x7fdc70003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:11.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.448+0000 7fdc827fc700 1 --2- 172.21.15.103:0/1099669418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc84063e30 0x7fdc700044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:11.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.448+0000 7fdc827fc700 1 --2- 172.21.15.103:0/1099669418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc70004930 0x7fdc70004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:11.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.448+0000 7fdc827fc700 1 -- 172.21.15.103:0/1099669418 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc841435a0 con 0x7fdc70004930 2020-04-22T14:03:11.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.448+0000 7fdc827fc700 1 -- 172.21.15.103:0/1099669418 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc84143840 con 0x7fdc70003720 2020-04-22T14:03:11.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.448+0000 7fdc827fc700 1 -- 172.21.15.103:0/1099669418 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc700040f0 con 0x7fdc84063e30 2020-04-22T14:03:11.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.448+0000 7fdc837fe700 1 --2- 172.21.15.103:0/1099669418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc70003720 0x7fdc70003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:11.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.448+0000 7fdc83fff700 1 --2- 172.21.15.103:0/1099669418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc70004930 0x7fdc70004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:11.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.448+0000 7fdc82ffd700 1 --2- 172.21.15.103:0/1099669418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc84063e30 0x7fdc700044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:11.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.448+0000 7fdc837fe700 1 -- 172.21.15.103:0/1099669418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc84063e30 msgr2=0x7fdc700044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:11.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.448+0000 7fdc837fe700 1 --2- 172.21.15.103:0/1099669418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc84063e30 0x7fdc700044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:11.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.448+0000 7fdc837fe700 1 -- 172.21.15.103:0/1099669418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc70004930 msgr2=0x7fdc70004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:11.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.448+0000 7fdc837fe700 1 --2- 172.21.15.103:0/1099669418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc70004930 0x7fdc70004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:11.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.448+0000 7fdc837fe700 1 -- 172.21.15.103:0/1099669418 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc70003230 con 0x7fdc70003720 2020-04-22T14:03:11.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.448+0000 7fdc837fe700 1 --2- 172.21.15.103:0/1099669418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc70003720 0x7fdc70003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdc74002f30 tx=0x7fdc74010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:11.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.448+0000 7fdc837fe700 1 --2- 172.21.15.103:0/1099669418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc70003720 0x7fdc70003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdc74002f30 tx=0x7fdc74010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:11.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.448+0000 7fdc837fe700 1 --2- 172.21.15.103:0/1099669418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc70003720 0x7fdc70003b40 secure :-1 s=READY pgs=260 cs=0 l=1 rx=0x7fdc74002f30 tx=0x7fdc74010020).ready entity=mon.1 client_cookie=424e56f7c12714a7 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:11.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.449+0000 7fdc837fe700 1 --2- 172.21.15.103:0/1099669418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc70003720 0x7fdc70003b40 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7fdc74002f30 tx=0x7fdc74010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:11.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.449+0000 7fdc827fc700 1 -- 172.21.15.103:0/1099669418 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc74008df0 con 0x7fdc70003720 2020-04-22T14:03:11.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.449+0000 7fdc837fe700 1 --2- 172.21.15.103:0/1099669418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc70003720 0x7fdc70003b40 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7fdc74002f30 tx=0x7fdc74010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:11.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.449+0000 7fdc837fe700 1 --2- 172.21.15.103:0/1099669418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc70003720 0x7fdc70003b40 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7fdc74002f30 tx=0x7fdc74010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:11.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.449+0000 7fdc827fc700 1 -- 172.21.15.103:0/1099669418 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc740108a0 con 0x7fdc70003720 2020-04-22T14:03:11.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.449+0000 7fdc827fc700 1 -- 172.21.15.103:0/1099669418 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc74010c80 con 0x7fdc70003720 2020-04-22T14:03:11.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.449+0000 7fdc89f79700 1 -- 172.21.15.103:0/1099669418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc70003720 msgr2=0x7fdc70003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:11.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.449+0000 7fdc89f79700 1 --2- 172.21.15.103:0/1099669418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc70003720 0x7fdc70003b40 secure :-1 s=READY pgs=260 cs=0 l=1 rx=0x7fdc74002f30 tx=0x7fdc74010020).stop 2020-04-22T14:03:11.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.449+0000 7fdc83fff700 1 -- 172.21.15.103:0/1099669418 reap_dead start 2020-04-22T14:03:11.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.449+0000 7fdc89f79700 1 -- 172.21.15.103:0/1099669418 shutdown_connections 2020-04-22T14:03:11.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.449+0000 7fdc89f79700 1 -- 172.21.15.103:0/1099669418 >> 172.21.15.103:0/1099669418 conn(0x7fdc840b9160 msgr2=0x7fdc8405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:11.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.449+0000 7fdc89f79700 1 -- 172.21.15.103:0/1099669418 shutdown_connections 2020-04-22T14:03:11.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.449+0000 7fdc89f79700 1 -- 172.21.15.103:0/1099669418 wait complete. 2020-04-22T14:03:11.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.450+0000 7fdc89f79700 1 Processor -- start 2020-04-22T14:03:11.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.450+0000 7fdc89f79700 1 -- start start 2020-04-22T14:03:11.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.451+0000 7fdc89f79700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc84153070 0x7fdc840b32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:11.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.451+0000 7fdc89f79700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdc840b5db0 0x7fdc840b2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:11.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.451+0000 7fdc89f79700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc840b6230 con 0x7fdc840b25c0 2020-04-22T14:03:11.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.451+0000 7fdc89f79700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc84153780 con 0x7fdc840b5db0 2020-04-22T14:03:11.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.451+0000 7fdc89f79700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc84153a20 con 0x7fdc84153070 2020-04-22T14:03:11.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.451+0000 7fdc837fe700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc84153070 0x7fdc840b32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:11.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.451+0000 7fdc82ffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdc840b5db0 0x7fdc840b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:11.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.451+0000 7fdc837fe700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc84153070 0x7fdc840b32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:60960/0 (socket says 172.21.15.103:60960) 2020-04-22T14:03:11.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.451+0000 7fdc837fe700 1 -- 172.21.15.103:0/205013346 learned_addr learned my addr 172.21.15.103:0/205013346 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:11.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.452+0000 7fdc837fe700 1 -- 172.21.15.103:0/205013346 >> v2:172.21.15.86:3300/0 conn(0x7fdc840b5db0 msgr2=0x7fdc840b2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:11.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.452+0000 7fdc837fe700 1 --2- 172.21.15.103:0/205013346 >> v2:172.21.15.86:3300/0 conn(0x7fdc840b5db0 0x7fdc840b2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:11.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.452+0000 7fdc837fe700 1 -- 172.21.15.103:0/205013346 >> v1:172.21.15.86:6789/0 conn(0x7fdc840b25c0 legacy=0x7fdc8412acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:11.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.452+0000 7fdc837fe700 1 -- 172.21.15.103:0/205013346 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc84153450 con 0x7fdc84153070 2020-04-22T14:03:11.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.452+0000 7fdc837fe700 1 --2- 172.21.15.103:0/205013346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc84153070 0x7fdc840b32a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdc74002f30 tx=0x7fdc74010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:11.475 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.452+0000 7fdc837fe700 1 --2- 172.21.15.103:0/205013346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc84153070 0x7fdc840b32a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdc74002f30 tx=0x7fdc74010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:11.475 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.452+0000 7fdc837fe700 1 --2- 172.21.15.103:0/205013346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc84153070 0x7fdc840b32a0 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7fdc74002f30 tx=0x7fdc74010020).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:11.475 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.452+0000 7fdc837fe700 1 --2- 172.21.15.103:0/205013346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc84153070 0x7fdc840b32a0 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fdc74002f30 tx=0x7fdc74010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:11.475 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.452+0000 7fdc80ff9700 1 -- 172.21.15.103:0/205013346 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc74007fa0 con 0x7fdc84153070 2020-04-22T14:03:11.475 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.452+0000 7fdc837fe700 1 --2- 172.21.15.103:0/205013346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc84153070 0x7fdc840b32a0 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fdc74002f30 tx=0x7fdc74010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:11.475 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.452+0000 7fdc837fe700 1 --2- 172.21.15.103:0/205013346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc84153070 0x7fdc840b32a0 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fdc74002f30 tx=0x7fdc74010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:11.475 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.452+0000 7fdc80ff9700 1 -- 172.21.15.103:0/205013346 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc740078a0 con 0x7fdc84153070 2020-04-22T14:03:11.475 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.452+0000 7fdc89f79700 1 -- 172.21.15.103:0/205013346 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc8412b3e0 con 0x7fdc84153070 2020-04-22T14:03:11.476 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.452+0000 7fdc80ff9700 1 -- 172.21.15.103:0/205013346 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc74007360 con 0x7fdc84153070 2020-04-22T14:03:11.476 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.452+0000 7fdc89f79700 1 -- 172.21.15.103:0/205013346 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc840ae990 con 0x7fdc84153070 2020-04-22T14:03:11.476 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.453+0000 7fdc837fe700 1 --2- 172.21.15.103:0/205013346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc84153070 0x7fdc840b32a0 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fdc74002f30 tx=0x7fdc74010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:11.476 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.453+0000 7fdc89f79700 1 -- 172.21.15.103:0/205013346 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc84056c90 con 0x7fdc84153070 2020-04-22T14:03:11.476 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.453+0000 7fdc80ff9700 1 -- 172.21.15.103:0/205013346 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fdc740056c0 con 0x7fdc84153070 2020-04-22T14:03:11.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.453+0000 7fdc837fe700 1 --2- 172.21.15.103:0/205013346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc84153070 0x7fdc840b32a0 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fdc74002f30 tx=0x7fdc74010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:11.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.453+0000 7fdc80ff9700 1 --2- 172.21.15.103:0/205013346 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdc6404d840 0x7fdc6404fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:11.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.453+0000 7fdc80ff9700 1 -- 172.21.15.103:0/205013346 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdc740615a0 con 0x7fdc84153070 2020-04-22T14:03:11.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.453+0000 7fdc82ffd700 1 --2- 172.21.15.103:0/205013346 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdc6404d840 0x7fdc6404fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:11.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.454+0000 7fdc82ffd700 1 --2- 172.21.15.103:0/205013346 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdc6404d840 0x7fdc6404fd00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdc780013e0 tx=0x7fdc8405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:11.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.454+0000 7fdc82ffd700 1 --2- 172.21.15.103:0/205013346 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdc6404d840 0x7fdc6404fd00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdc780013e0 tx=0x7fdc8405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:11.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.454+0000 7fdc82ffd700 1 --2- 172.21.15.103:0/205013346 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdc6404d840 0x7fdc6404fd00 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7fdc780013e0 tx=0x7fdc8405bce0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:11.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.457+0000 7fdc837fe700 1 --2- 172.21.15.103:0/205013346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc84153070 0x7fdc840b32a0 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fdc74002f30 tx=0x7fdc74010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:11.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.457+0000 7fdc80ff9700 1 -- 172.21.15.103:0/205013346 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fdc7403caa0 con 0x7fdc84153070 2020-04-22T14:03:11.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.598+0000 7fdc89f79700 1 -- 172.21.15.103:0/205013346 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc84147360 con 0x7fdc84153070 2020-04-22T14:03:11.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.599+0000 7fdc837fe700 1 --2- 172.21.15.103:0/205013346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc84153070 0x7fdc840b32a0 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fdc74002f30 tx=0x7fdc74010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:11.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.599+0000 7fdc80ff9700 1 -- 172.21.15.103:0/205013346 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16089 (secure 0 0 0) 0x7fdc740400c0 con 0x7fdc84153070 2020-04-22T14:03:11.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.600+0000 7fdc89f79700 1 -- 172.21.15.103:0/205013346 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdc6404d840 msgr2=0x7fdc6404fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:11.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.600+0000 7fdc89f79700 1 --2- 172.21.15.103:0/205013346 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdc6404d840 0x7fdc6404fd00 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7fdc780013e0 tx=0x7fdc8405bce0).stop 2020-04-22T14:03:11.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.600+0000 7fdc89f79700 1 -- 172.21.15.103:0/205013346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc84153070 msgr2=0x7fdc840b32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:11.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.600+0000 7fdc89f79700 1 --2- 172.21.15.103:0/205013346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc84153070 0x7fdc840b32a0 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7fdc74002f30 tx=0x7fdc74010020).stop 2020-04-22T14:03:11.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.601+0000 7fdc89f79700 1 -- 172.21.15.103:0/205013346 shutdown_connections 2020-04-22T14:03:11.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.601+0000 7fdc89f79700 1 --2- 172.21.15.103:0/205013346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc84153070 0x7fdc840b32a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:11.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.601+0000 7fdc89f79700 1 --2- 172.21.15.103:0/205013346 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdc6404d840 0x7fdc6404fd00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:11.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.601+0000 7fdc89f79700 1 --2- 172.21.15.103:0/205013346 >> v2:172.21.15.86:3300/0 conn(0x7fdc840b5db0 0x7fdc840b2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:11.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.601+0000 7fdc89f79700 1 -- 172.21.15.103:0/205013346 >> 172.21.15.103:0/205013346 conn(0x7fdc840b9160 msgr2=0x7fdc8405ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:11.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.601+0000 7fdc89f79700 1 -- 172.21.15.103:0/205013346 shutdown_connections 2020-04-22T14:03:11.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.601+0000 7fdc89f79700 1 -- 172.21.15.103:0/205013346 wait complete. 2020-04-22T14:03:11.607 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:03:11.607 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":24,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:02:28.687155+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:02:25.963043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-22T14:02:26.642611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:03:11.615 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:25.963043+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:26.642611+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 4, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'24', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:03:11.616 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:11.630 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:03:11.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.775+0000 7f78c19f3700 1 Processor -- start 2020-04-22T14:03:11.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.775+0000 7f78c19f3700 1 -- start start 2020-04-22T14:03:11.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.776+0000 7f78c19f3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f78bc066d30 0x7f78bc0aefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:11.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.776+0000 7f78c19f3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78bc067110 0x7f78bc142e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:11.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.776+0000 7f78c19f3700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78bc1432b0 con 0x7f78bc0af650 2020-04-22T14:03:11.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.776+0000 7f78c19f3700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78bc0afaf0 con 0x7f78bc066d30 2020-04-22T14:03:11.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.776+0000 7f78c19f3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc0afd90 con 0x7f78bc067110 2020-04-22T14:03:11.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.776+0000 7f78bb7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f78bc0af650 0x7f78bc13c7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40148/0 (socket says 172.21.15.103:40148) 2020-04-22T14:03:11.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.776+0000 7f78bb7fe700 1 -- 172.21.15.103:0/4217258922 learned_addr learned my addr 172.21.15.103:0/4217258922 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:11.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.777+0000 7f78b9ffb700 1 -- 172.21.15.103:0/4217258922 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1283322037 0 0) 0x7f78bc1432b0 con 0x7f78bc0af650 2020-04-22T14:03:11.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.777+0000 7f78b9ffb700 1 -- 172.21.15.103:0/4217258922 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78a0003230 con 0x7f78bc0af650 2020-04-22T14:03:11.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.777+0000 7f78b9ffb700 1 -- 172.21.15.103:0/4217258922 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1736954924 0 0) 0x7f78a0003230 con 0x7f78bc0af650 2020-04-22T14:03:11.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.777+0000 7f78b9ffb700 1 -- 172.21.15.103:0/4217258922 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78bc067110 msgr2=0x7f78bc142e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:11.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.777+0000 7f78b9ffb700 1 --2- 172.21.15.103:0/4217258922 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78bc067110 0x7f78bc142e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:11.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.777+0000 7f78b9ffb700 1 -- 172.21.15.103:0/4217258922 >> v2:172.21.15.86:3300/0 conn(0x7f78bc066d30 msgr2=0x7f78bc0aefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:11.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.777+0000 7f78b9ffb700 1 --2- 172.21.15.103:0/4217258922 >> v2:172.21.15.86:3300/0 conn(0x7f78bc066d30 0x7f78bc0aefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:11.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.777+0000 7f78b9ffb700 1 -- 172.21.15.103:0/4217258922 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78bc0b0030 con 0x7f78bc0af650 2020-04-22T14:03:11.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.777+0000 7f78b9ffb700 1 -- 172.21.15.103:0/4217258922 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f78b4001a50 con 0x7f78bc0af650 2020-04-22T14:03:11.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.777+0000 7f78b9ffb700 1 -- 172.21.15.103:0/4217258922 >> v1:172.21.15.103:6789/0 conn(0x7f78bc0af650 legacy=0x7f78bc13c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:11.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.777+0000 7f78b9ffb700 1 --2- 172.21.15.103:0/4217258922 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78a0003720 0x7f78a0003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:11.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.777+0000 7f78b9ffb700 1 --2- 172.21.15.103:0/4217258922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78a0004060 0x7f78a0004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:11.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.777+0000 7f78b9ffb700 1 --2- 172.21.15.103:0/4217258922 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78bc067110 0x7f78a0004b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:11.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.777+0000 7f78b9ffb700 1 -- 172.21.15.103:0/4217258922 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc0afaf0 con 0x7f78a0003720 2020-04-22T14:03:11.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.777+0000 7f78b9ffb700 1 -- 172.21.15.103:0/4217258922 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc0afd90 con 0x7f78a0004060 2020-04-22T14:03:11.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.777+0000 7f78b9ffb700 1 -- 172.21.15.103:0/4217258922 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a00050c0 con 0x7f78bc067110 2020-04-22T14:03:11.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.777+0000 7f78ba7fc700 1 --2- 172.21.15.103:0/4217258922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78a0004060 0x7f78a0004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:11.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.777+0000 7f78baffd700 1 --2- 172.21.15.103:0/4217258922 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78a0003720 0x7f78a0003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:11.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.777+0000 7f78bb7fe700 1 --2- 172.21.15.103:0/4217258922 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78bc067110 0x7f78a0004b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:11.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.777+0000 7f78ba7fc700 1 -- 172.21.15.103:0/4217258922 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78bc067110 msgr2=0x7f78a0004b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:11.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.777+0000 7f78ba7fc700 1 --2- 172.21.15.103:0/4217258922 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78bc067110 0x7f78a0004b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:11.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.777+0000 7f78ba7fc700 1 -- 172.21.15.103:0/4217258922 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78a0003720 msgr2=0x7f78a0003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:11.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.777+0000 7f78ba7fc700 1 --2- 172.21.15.103:0/4217258922 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78a0003720 0x7f78a0003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:11.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.777+0000 7f78ba7fc700 1 -- 172.21.15.103:0/4217258922 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a0003230 con 0x7f78a0004060 2020-04-22T14:03:11.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.777+0000 7f78ba7fc700 1 --2- 172.21.15.103:0/4217258922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78a0004060 0x7f78a0004530 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f78ac002f30 tx=0x7f78ac00fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:11.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.777+0000 7f78ba7fc700 1 --2- 172.21.15.103:0/4217258922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78a0004060 0x7f78a0004530 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f78ac002f30 tx=0x7f78ac00fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:11.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.777+0000 7f78ba7fc700 1 --2- 172.21.15.103:0/4217258922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78a0004060 0x7f78a0004530 secure :-1 s=READY pgs=262 cs=0 l=1 rx=0x7f78ac002f30 tx=0x7f78ac00fcf0).ready entity=mon.1 client_cookie=bb89aebdaa3d9e5 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:11.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.778+0000 7f78ba7fc700 1 --2- 172.21.15.103:0/4217258922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78a0004060 0x7f78a0004530 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7f78ac002f30 tx=0x7f78ac00fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:11.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.778+0000 7f78ba7fc700 1 --2- 172.21.15.103:0/4217258922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78a0004060 0x7f78a0004530 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7f78ac002f30 tx=0x7f78ac00fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:11.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.778+0000 7f78b9ffb700 1 -- 172.21.15.103:0/4217258922 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78ac005df0 con 0x7f78a0004060 2020-04-22T14:03:11.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.778+0000 7f78ba7fc700 1 --2- 172.21.15.103:0/4217258922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78a0004060 0x7f78a0004530 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7f78ac002f30 tx=0x7f78ac00fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:11.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.778+0000 7f78b9ffb700 1 -- 172.21.15.103:0/4217258922 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ac008980 con 0x7f78a0004060 2020-04-22T14:03:11.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.778+0000 7f78b9ffb700 1 -- 172.21.15.103:0/4217258922 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78ac008da0 con 0x7f78a0004060 2020-04-22T14:03:11.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.778+0000 7f78c19f3700 1 -- 172.21.15.103:0/4217258922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78a0004060 msgr2=0x7f78a0004530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:11.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.778+0000 7f78c19f3700 1 --2- 172.21.15.103:0/4217258922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78a0004060 0x7f78a0004530 secure :-1 s=READY pgs=262 cs=0 l=1 rx=0x7f78ac002f30 tx=0x7f78ac00fcf0).stop 2020-04-22T14:03:11.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.778+0000 7f78bb7fe700 1 -- 172.21.15.103:0/4217258922 reap_dead start 2020-04-22T14:03:11.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.778+0000 7f78c19f3700 1 -- 172.21.15.103:0/4217258922 shutdown_connections 2020-04-22T14:03:11.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.778+0000 7f78c19f3700 1 -- 172.21.15.103:0/4217258922 >> 172.21.15.103:0/4217258922 conn(0x7f78bc069f30 msgr2=0x7f78bc05b180 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:11.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.778+0000 7f78c19f3700 1 -- 172.21.15.103:0/4217258922 shutdown_connections 2020-04-22T14:03:11.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.778+0000 7f78c19f3700 1 -- 172.21.15.103:0/4217258922 wait complete. 2020-04-22T14:03:11.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.779+0000 7f78c19f3700 1 Processor -- start 2020-04-22T14:03:11.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.779+0000 7f78c19f3700 1 -- start start 2020-04-22T14:03:11.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.780+0000 7f78c19f3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78bc0b0230 0x7f78bc13fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:11.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.780+0000 7f78c19f3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f78bc140160 0x7f78bc0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:11.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.780+0000 7f78c19f3700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78bc064040 con 0x7f78bc145270 2020-04-22T14:03:11.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.780+0000 7f78c19f3700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78bc063e50 con 0x7f78bc140160 2020-04-22T14:03:11.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.780+0000 7f78c19f3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc0642e0 con 0x7f78bc0b0230 2020-04-22T14:03:11.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.780+0000 7f78ba7fc700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78bc0b0230 0x7f78bc13fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:11.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.780+0000 7f78baffd700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f78bc145270 0x7f78bc064a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:57314/0 (socket says 172.21.15.103:57314) 2020-04-22T14:03:11.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.780+0000 7f78ba7fc700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78bc0b0230 0x7f78bc13fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:60980/0 (socket says 172.21.15.103:60980) 2020-04-22T14:03:11.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.780+0000 7f78baffd700 1 -- 172.21.15.103:0/581694353 learned_addr learned my addr 172.21.15.103:0/581694353 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:11.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.780+0000 7f78bb7fe700 1 --2- 172.21.15.103:0/581694353 >> v2:172.21.15.86:3300/0 conn(0x7f78bc140160 0x7f78bc0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:11.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.780+0000 7f78ba7fc700 1 -- 172.21.15.103:0/581694353 >> v2:172.21.15.86:3300/0 conn(0x7f78bc140160 msgr2=0x7f78bc0b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:11.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.780+0000 7f78ba7fc700 1 --2- 172.21.15.103:0/581694353 >> v2:172.21.15.86:3300/0 conn(0x7f78bc140160 0x7f78bc0b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:11.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.780+0000 7f78ba7fc700 1 -- 172.21.15.103:0/581694353 >> v1:172.21.15.86:6789/0 conn(0x7f78bc145270 legacy=0x7f78bc064a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:11.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.780+0000 7f78ba7fc700 1 -- 172.21.15.103:0/581694353 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78bc064580 con 0x7f78bc0b0230 2020-04-22T14:03:11.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.780+0000 7f78ba7fc700 1 --2- 172.21.15.103:0/581694353 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78bc0b0230 0x7f78bc13fd00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f78ac002f30 tx=0x7f78ac00fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:11.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.780+0000 7f78ba7fc700 1 --2- 172.21.15.103:0/581694353 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78bc0b0230 0x7f78bc13fd00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f78ac002f30 tx=0x7f78ac00fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:11.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.780+0000 7f78ba7fc700 1 --2- 172.21.15.103:0/581694353 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78bc0b0230 0x7f78bc13fd00 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7f78ac002f30 tx=0x7f78ac00fcf0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:11.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.780+0000 7f78ba7fc700 1 --2- 172.21.15.103:0/581694353 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78bc0b0230 0x7f78bc13fd00 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f78ac002f30 tx=0x7f78ac00fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:11.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.780+0000 7f78abfff700 1 -- 172.21.15.103:0/581694353 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78ac008e80 con 0x7f78bc0b0230 2020-04-22T14:03:11.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.781+0000 7f78ba7fc700 1 --2- 172.21.15.103:0/581694353 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78bc0b0230 0x7f78bc13fd00 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f78ac002f30 tx=0x7f78ac00fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:11.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.781+0000 7f78ba7fc700 1 --2- 172.21.15.103:0/581694353 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78bc0b0230 0x7f78bc13fd00 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f78ac002f30 tx=0x7f78ac00fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:11.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.781+0000 7f78abfff700 1 -- 172.21.15.103:0/581694353 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ac000e90 con 0x7f78bc0b0230 2020-04-22T14:03:11.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.781+0000 7f78c19f3700 1 -- 172.21.15.103:0/581694353 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78bc145650 con 0x7f78bc0b0230 2020-04-22T14:03:11.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.781+0000 7f78abfff700 1 -- 172.21.15.103:0/581694353 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78ac00f800 con 0x7f78bc0b0230 2020-04-22T14:03:11.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.781+0000 7f78c19f3700 1 -- 172.21.15.103:0/581694353 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78bc1405f0 con 0x7f78bc0b0230 2020-04-22T14:03:11.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.781+0000 7f78ba7fc700 1 --2- 172.21.15.103:0/581694353 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78bc0b0230 0x7f78bc13fd00 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f78ac002f30 tx=0x7f78ac00fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:11.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.782+0000 7f78abfff700 1 -- 172.21.15.103:0/581694353 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f78ac0112e0 con 0x7f78bc0b0230 2020-04-22T14:03:11.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.782+0000 7f78ba7fc700 1 --2- 172.21.15.103:0/581694353 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78bc0b0230 0x7f78bc13fd00 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f78ac002f30 tx=0x7f78ac00fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:11.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.782+0000 7f78c19f3700 1 -- 172.21.15.103:0/581694353 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78bc0b1c00 con 0x7f78bc0b0230 2020-04-22T14:03:11.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.782+0000 7f78abfff700 1 --2- 172.21.15.103:0/581694353 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f789804da20 0x7f789804fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:11.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.782+0000 7f78abfff700 1 -- 172.21.15.103:0/581694353 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f78ac061b30 con 0x7f78bc0b0230 2020-04-22T14:03:11.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.782+0000 7f78baffd700 1 --2- 172.21.15.103:0/581694353 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f789804da20 0x7f789804fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:11.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.782+0000 7f78baffd700 1 --2- 172.21.15.103:0/581694353 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f789804da20 0x7f789804fee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f78bc145cf0 tx=0x7f78b0007ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:11.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.782+0000 7f78baffd700 1 --2- 172.21.15.103:0/581694353 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f789804da20 0x7f789804fee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f78bc145cf0 tx=0x7f78b0007ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:11.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.782+0000 7f78baffd700 1 --2- 172.21.15.103:0/581694353 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f789804da20 0x7f789804fee0 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7f78bc145cf0 tx=0x7f78b0007ee0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:11.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.785+0000 7f78ba7fc700 1 --2- 172.21.15.103:0/581694353 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78bc0b0230 0x7f78bc13fd00 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f78ac002f30 tx=0x7f78ac00fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:11.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.785+0000 7f78abfff700 1 -- 172.21.15.103:0/581694353 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f78ac03cfd0 con 0x7f78bc0b0230 2020-04-22T14:03:11.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.927+0000 7f78c19f3700 1 -- 172.21.15.103:0/581694353 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f78bc064710 con 0x7f78bc0b0230 2020-04-22T14:03:11.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.927+0000 7f78ba7fc700 1 --2- 172.21.15.103:0/581694353 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78bc0b0230 0x7f78bc13fd00 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f78ac002f30 tx=0x7f78ac00fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:11.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.927+0000 7f78abfff700 1 -- 172.21.15.103:0/581694353 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v24) v1 ==== 110+0+10 (secure 0 0 0) 0x7f78ac0405f0 con 0x7f78bc0b0230 2020-04-22T14:03:11.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.929+0000 7f78c19f3700 1 -- 172.21.15.103:0/581694353 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f789804da20 msgr2=0x7f789804fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:11.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.929+0000 7f78c19f3700 1 --2- 172.21.15.103:0/581694353 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f789804da20 0x7f789804fee0 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7f78bc145cf0 tx=0x7f78b0007ee0).stop 2020-04-22T14:03:11.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.929+0000 7f78c19f3700 1 -- 172.21.15.103:0/581694353 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78bc0b0230 msgr2=0x7f78bc13fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:11.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.929+0000 7f78c19f3700 1 --2- 172.21.15.103:0/581694353 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78bc0b0230 0x7f78bc13fd00 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7f78ac002f30 tx=0x7f78ac00fcf0).stop 2020-04-22T14:03:11.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.929+0000 7f78c19f3700 1 -- 172.21.15.103:0/581694353 shutdown_connections 2020-04-22T14:03:11.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.929+0000 7f78c19f3700 1 --2- 172.21.15.103:0/581694353 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f789804da20 0x7f789804fee0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:11.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.929+0000 7f78c19f3700 1 --2- 172.21.15.103:0/581694353 >> v2:172.21.15.86:3300/0 conn(0x7f78bc140160 0x7f78bc0b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:11.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.929+0000 7f78c19f3700 1 --2- 172.21.15.103:0/581694353 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78bc0b0230 0x7f78bc13fd00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:11.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.929+0000 7f78c19f3700 1 -- 172.21.15.103:0/581694353 >> 172.21.15.103:0/581694353 conn(0x7f78bc069f30 msgr2=0x7f78bc142b80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:11.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.929+0000 7f78c19f3700 1 -- 172.21.15.103:0/581694353 shutdown_connections 2020-04-22T14:03:11.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:11.929+0000 7f78c19f3700 1 -- 172.21.15.103:0/581694353 wait complete. 2020-04-22T14:03:11.934 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:03:11.945 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:11.964 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:03:12.120 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.118+0000 7f7125c83700 1 Processor -- start 2020-04-22T14:03:12.120 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.118+0000 7f7125c83700 1 -- start start 2020-04-22T14:03:12.134 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.119+0000 7f7125c83700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7120061a30 0x7f71200b4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:12.135 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.119+0000 7f7125c83700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7120141f20 0x7f71201423b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:12.135 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.119+0000 7f7125c83700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71200af030 con 0x7f71200acb10 2020-04-22T14:03:12.135 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.119+0000 7f7125c83700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7120060250 con 0x7f7120141f20 2020-04-22T14:03:12.135 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.119+0000 7f7125c83700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71200623c0 con 0x7f7120061a30 2020-04-22T14:03:12.135 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.119+0000 7f711ffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7120141f20 0x7f71201423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:12.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.119+0000 7f711ffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7120141f20 0x7f71201423b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47978/0 (socket says 172.21.15.103:47978) 2020-04-22T14:03:12.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.119+0000 7f711ffff700 1 -- 172.21.15.103:0/3770281965 learned_addr learned my addr 172.21.15.103:0/3770281965 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:12.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.119+0000 7f711f7fe700 1 --2- 172.21.15.103:0/3770281965 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7120061a30 0x7f71200b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:12.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.120+0000 7f711ffff700 1 -- 172.21.15.103:0/3770281965 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7120061a30 msgr2=0x7f71200b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:12.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.120+0000 7f711ffff700 1 --2- 172.21.15.103:0/3770281965 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7120061a30 0x7f71200b4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:12.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.120+0000 7f711ffff700 1 -- 172.21.15.103:0/3770281965 >> v1:172.21.15.86:6789/0 conn(0x7f71200acb10 legacy=0x7f71200ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:12.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.120+0000 7f711ffff700 1 -- 172.21.15.103:0/3770281965 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7120062660 con 0x7f7120141f20 2020-04-22T14:03:12.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.120+0000 7f711e7fc700 1 -- 172.21.15.103:0/3770281965 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4112832262 0 0) 0x7f71200af030 con 0x7f71200acb10 2020-04-22T14:03:12.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.120+0000 7f711ffff700 1 --2- 172.21.15.103:0/3770281965 >> v2:172.21.15.103:3300/0 conn(0x7f7120141f20 0x7f71201423b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7118002f30 tx=0x7f7118007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.120+0000 7f711ffff700 1 --2- 172.21.15.103:0/3770281965 >> v2:172.21.15.103:3300/0 conn(0x7f7120141f20 0x7f71201423b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7118002f30 tx=0x7f7118007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.120+0000 7f711ffff700 1 --2- 172.21.15.103:0/3770281965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7120141f20 0x7f71201423b0 secure :-1 s=READY pgs=263 cs=0 l=1 rx=0x7f7118002f30 tx=0x7f7118007a40).ready entity=mon.1 client_cookie=7f74b1e58ec5e978 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:12.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.120+0000 7f711ffff700 1 --2- 172.21.15.103:0/3770281965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7120141f20 0x7f71201423b0 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7f7118002f30 tx=0x7f7118007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.120+0000 7f711e7fc700 1 -- 172.21.15.103:0/3770281965 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7118009e40 con 0x7f7120141f20 2020-04-22T14:03:12.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.120+0000 7f711ffff700 1 --2- 172.21.15.103:0/3770281965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7120141f20 0x7f71201423b0 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7f7118002f30 tx=0x7f7118007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.120+0000 7f711e7fc700 1 -- 172.21.15.103:0/3770281965 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7118012970 con 0x7f7120141f20 2020-04-22T14:03:12.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.120+0000 7f711ffff700 1 --2- 172.21.15.103:0/3770281965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7120141f20 0x7f71201423b0 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7f7118002f30 tx=0x7f7118007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.120+0000 7f711e7fc700 1 -- 172.21.15.103:0/3770281965 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7118012d50 con 0x7f7120141f20 2020-04-22T14:03:12.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.120+0000 7f7125c83700 1 -- 172.21.15.103:0/3770281965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7120141f20 msgr2=0x7f71201423b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:12.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.120+0000 7f7125c83700 1 --2- 172.21.15.103:0/3770281965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7120141f20 0x7f71201423b0 secure :-1 s=READY pgs=263 cs=0 l=1 rx=0x7f7118002f30 tx=0x7f7118007a40).stop 2020-04-22T14:03:12.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.120+0000 7f7125c83700 1 -- 172.21.15.103:0/3770281965 shutdown_connections 2020-04-22T14:03:12.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.120+0000 7f7125c83700 1 --2- 172.21.15.103:0/3770281965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7120141f20 0x7f71201423b0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:12.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.120+0000 7f7125c83700 1 --2- 172.21.15.103:0/3770281965 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7120061a30 0x7f71200b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:12.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.120+0000 7f7125c83700 1 -- 172.21.15.103:0/3770281965 >> 172.21.15.103:0/3770281965 conn(0x7f712005b7b0 msgr2=0x7f71200b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:12.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.120+0000 7f7125c83700 1 -- 172.21.15.103:0/3770281965 shutdown_connections 2020-04-22T14:03:12.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.120+0000 7f7125c83700 1 -- 172.21.15.103:0/3770281965 wait complete. 2020-04-22T14:03:12.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.121+0000 7f7125c83700 1 Processor -- start 2020-04-22T14:03:12.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.121+0000 7f7125c83700 1 -- start start 2020-04-22T14:03:12.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.122+0000 7f7125c83700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7120061a30 0x7f7120062860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:12.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.122+0000 7f7125c83700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7120141f20 0x7f7120143640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:12.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.122+0000 7f7125c83700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7120145be0 con 0x7f71200acb10 2020-04-22T14:03:12.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.122+0000 7f7125c83700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7120153580 con 0x7f7120141f20 2020-04-22T14:03:12.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.122+0000 7f7125c83700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7120143aa0 con 0x7f7120061a30 2020-04-22T14:03:12.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.122+0000 7f711ffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7120141f20 0x7f7120143640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:12.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.122+0000 7f711f7fe700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7120061a30 0x7f7120062860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:12.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.122+0000 7f711ffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7120141f20 0x7f7120143640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:45216/0 (socket says 172.21.15.103:45216) 2020-04-22T14:03:12.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.122+0000 7f711ffff700 1 -- 172.21.15.103:0/802932911 learned_addr learned my addr 172.21.15.103:0/802932911 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:12.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.123+0000 7f711f7fe700 1 -- 172.21.15.103:0/802932911 >> v2:172.21.15.86:3300/0 conn(0x7f7120141f20 msgr2=0x7f7120143640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:12.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.123+0000 7f711f7fe700 1 --2- 172.21.15.103:0/802932911 >> v2:172.21.15.86:3300/0 conn(0x7f7120141f20 0x7f7120143640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:12.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.123+0000 7f711f7fe700 1 -- 172.21.15.103:0/802932911 >> v1:172.21.15.86:6789/0 conn(0x7f71200acb10 legacy=0x7f7120152e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:12.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.123+0000 7f711f7fe700 1 -- 172.21.15.103:0/802932911 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71201456a0 con 0x7f7120061a30 2020-04-22T14:03:12.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.123+0000 7f711f7fe700 1 --2- 172.21.15.103:0/802932911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7120061a30 0x7f7120062860 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f71100032b0 tx=0x7f7110010f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.123+0000 7f711f7fe700 1 --2- 172.21.15.103:0/802932911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7120061a30 0x7f7120062860 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f71100032b0 tx=0x7f7110010f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.123+0000 7f711f7fe700 1 --2- 172.21.15.103:0/802932911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7120061a30 0x7f7120062860 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7f71100032b0 tx=0x7f7110010f10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:12.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.123+0000 7f711f7fe700 1 --2- 172.21.15.103:0/802932911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7120061a30 0x7f7120062860 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f71100032b0 tx=0x7f7110010f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.123+0000 7f711cff9700 1 -- 172.21.15.103:0/802932911 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f711000e370 con 0x7f7120061a30 2020-04-22T14:03:12.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.123+0000 7f711f7fe700 1 --2- 172.21.15.103:0/802932911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7120061a30 0x7f7120062860 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f71100032b0 tx=0x7f7110010f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.123+0000 7f711f7fe700 1 --2- 172.21.15.103:0/802932911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7120061a30 0x7f7120062860 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f71100032b0 tx=0x7f7110010f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.123+0000 7f711cff9700 1 -- 172.21.15.103:0/802932911 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7110005c30 con 0x7f7120061a30 2020-04-22T14:03:12.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.123+0000 7f7125c83700 1 -- 172.21.15.103:0/802932911 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7120145940 con 0x7f7120061a30 2020-04-22T14:03:12.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.123+0000 7f711cff9700 1 -- 172.21.15.103:0/802932911 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7110005e20 con 0x7f7120061a30 2020-04-22T14:03:12.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.123+0000 7f7125c83700 1 -- 172.21.15.103:0/802932911 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7120063950 con 0x7f7120061a30 2020-04-22T14:03:12.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.124+0000 7f711f7fe700 1 --2- 172.21.15.103:0/802932911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7120061a30 0x7f7120062860 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f71100032b0 tx=0x7f7110010f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.124+0000 7f7125c83700 1 -- 172.21.15.103:0/802932911 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7120056c90 con 0x7f7120061a30 2020-04-22T14:03:12.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.124+0000 7f711cff9700 1 -- 172.21.15.103:0/802932911 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f7110012b90 con 0x7f7120061a30 2020-04-22T14:03:12.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.124+0000 7f711f7fe700 1 --2- 172.21.15.103:0/802932911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7120061a30 0x7f7120062860 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f71100032b0 tx=0x7f7110010f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.124+0000 7f711cff9700 1 --2- 172.21.15.103:0/802932911 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f710004da50 0x7f710004ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:12.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.124+0000 7f711cff9700 1 -- 172.21.15.103:0/802932911 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7110061400 con 0x7f7120061a30 2020-04-22T14:03:12.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.124+0000 7f711effd700 1 --2- 172.21.15.103:0/802932911 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f710004da50 0x7f710004ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:12.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.125+0000 7f711effd700 1 --2- 172.21.15.103:0/802932911 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f710004da50 0x7f710004ff10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7120065af0 tx=0x7f7114002610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.125+0000 7f711effd700 1 --2- 172.21.15.103:0/802932911 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f710004da50 0x7f710004ff10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7120065af0 tx=0x7f7114002610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.125+0000 7f711effd700 1 --2- 172.21.15.103:0/802932911 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f710004da50 0x7f710004ff10 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7f7120065af0 tx=0x7f7114002610).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:12.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.128+0000 7f711f7fe700 1 --2- 172.21.15.103:0/802932911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7120061a30 0x7f7120062860 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f71100032b0 tx=0x7f7110010f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.128+0000 7f711cff9700 1 -- 172.21.15.103:0/802932911 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f711003c780 con 0x7f7120061a30 2020-04-22T14:03:12.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.269+0000 7f7125c83700 1 -- 172.21.15.103:0/802932911 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f71200b2b30 con 0x7f7120061a30 2020-04-22T14:03:12.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.269+0000 7f711f7fe700 1 --2- 172.21.15.103:0/802932911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7120061a30 0x7f7120062860 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f71100032b0 tx=0x7f7110010f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.270+0000 7f711cff9700 1 -- 172.21.15.103:0/802932911 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f711003fda0 con 0x7f7120061a30 2020-04-22T14:03:12.272 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:03:12.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.271+0000 7f7125c83700 1 -- 172.21.15.103:0/802932911 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f710004da50 msgr2=0x7f710004ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:12.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.271+0000 7f7125c83700 1 --2- 172.21.15.103:0/802932911 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f710004da50 0x7f710004ff10 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7f7120065af0 tx=0x7f7114002610).stop 2020-04-22T14:03:12.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.271+0000 7f7125c83700 1 -- 172.21.15.103:0/802932911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7120061a30 msgr2=0x7f7120062860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:12.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.271+0000 7f7125c83700 1 --2- 172.21.15.103:0/802932911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7120061a30 0x7f7120062860 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7f71100032b0 tx=0x7f7110010f10).stop 2020-04-22T14:03:12.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.271+0000 7f7125c83700 1 -- 172.21.15.103:0/802932911 shutdown_connections 2020-04-22T14:03:12.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.271+0000 7f7125c83700 1 --2- 172.21.15.103:0/802932911 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f710004da50 0x7f710004ff10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:12.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.271+0000 7f7125c83700 1 --2- 172.21.15.103:0/802932911 >> v2:172.21.15.86:3300/0 conn(0x7f7120141f20 0x7f7120143640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:12.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.271+0000 7f7125c83700 1 --2- 172.21.15.103:0/802932911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7120061a30 0x7f7120062860 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:12.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.271+0000 7f7125c83700 1 -- 172.21.15.103:0/802932911 >> 172.21.15.103:0/802932911 conn(0x7f712005b7b0 msgr2=0x7f71200b7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:12.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.271+0000 7f7125c83700 1 -- 172.21.15.103:0/802932911 shutdown_connections 2020-04-22T14:03:12.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.271+0000 7f7125c83700 1 -- 172.21.15.103:0/802932911 wait complete. 2020-04-22T14:03:12.284 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:12.298 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-22T14:03:12.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.446+0000 7f889507e700 1 Processor -- start 2020-04-22T14:03:12.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.446+0000 7f889507e700 1 -- start start 2020-04-22T14:03:12.457 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.446+0000 7f889507e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f88900b9140 0x7f889012b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:12.457 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.446+0000 7f889507e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f889012b670 0x7f8890143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:12.457 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.446+0000 7f889507e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88901467e0 con 0x7f88900ac950 2020-04-22T14:03:12.457 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.446+0000 7f889507e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88900602f0 con 0x7f88900b9140 2020-04-22T14:03:12.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.446+0000 7f889507e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8890060050 con 0x7f889012b670 2020-04-22T14:03:12.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.447+0000 7f888ed9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f88900b9140 0x7f889012b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:12.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.447+0000 7f888e59c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f88900ac950 0x7f8890146c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40178/0 (socket says 172.21.15.103:40178) 2020-04-22T14:03:12.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.447+0000 7f888e59c700 1 -- 172.21.15.103:0/3198579099 learned_addr learned my addr 172.21.15.103:0/3198579099 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:12.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.447+0000 7f888ed9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f88900b9140 0x7f889012b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47988/0 (socket says 172.21.15.103:47988) 2020-04-22T14:03:12.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.447+0000 7f888f59e700 1 --2- 172.21.15.103:0/3198579099 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f889012b670 0x7f8890143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:12.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.447+0000 7f888ed9d700 1 -- 172.21.15.103:0/3198579099 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f889012b670 msgr2=0x7f8890143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:12.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.447+0000 7f888ed9d700 1 --2- 172.21.15.103:0/3198579099 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f889012b670 0x7f8890143090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:12.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.447+0000 7f888ed9d700 1 -- 172.21.15.103:0/3198579099 >> v1:172.21.15.103:6789/0 conn(0x7f88900ac950 legacy=0x7f8890146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:12.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.447+0000 7f888dd9b700 1 -- 172.21.15.103:0/3198579099 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2410436095 0 0) 0x7f88901467e0 con 0x7f88900ac950 2020-04-22T14:03:12.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.447+0000 7f888ed9d700 1 -- 172.21.15.103:0/3198579099 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88900b9520 con 0x7f88900b9140 2020-04-22T14:03:12.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.447+0000 7f888f59e700 1 --2- 172.21.15.103:0/3198579099 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f889012b670 0x7f8890143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:03:12.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.447+0000 7f888ed9d700 1 --2- 172.21.15.103:0/3198579099 >> v2:172.21.15.103:3300/0 conn(0x7f88900b9140 0x7f889012b210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8878002f30 tx=0x7f8878007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.447+0000 7f888ed9d700 1 --2- 172.21.15.103:0/3198579099 >> v2:172.21.15.103:3300/0 conn(0x7f88900b9140 0x7f889012b210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8878002f30 tx=0x7f8878007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.447+0000 7f888ed9d700 1 --2- 172.21.15.103:0/3198579099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88900b9140 0x7f889012b210 secure :-1 s=READY pgs=265 cs=0 l=1 rx=0x7f8878002f30 tx=0x7f8878007a40).ready entity=mon.1 client_cookie=cc977023222bb577 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:12.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.447+0000 7f888ed9d700 1 --2- 172.21.15.103:0/3198579099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88900b9140 0x7f889012b210 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7f8878002f30 tx=0x7f8878007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.447+0000 7f888dd9b700 1 -- 172.21.15.103:0/3198579099 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8878011470 con 0x7f88900b9140 2020-04-22T14:03:12.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.447+0000 7f888ed9d700 1 --2- 172.21.15.103:0/3198579099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88900b9140 0x7f889012b210 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7f8878002f30 tx=0x7f8878007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.447+0000 7f888ed9d700 1 --2- 172.21.15.103:0/3198579099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88900b9140 0x7f889012b210 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7f8878002f30 tx=0x7f8878007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.447+0000 7f888dd9b700 1 -- 172.21.15.103:0/3198579099 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8878011610 con 0x7f88900b9140 2020-04-22T14:03:12.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.447+0000 7f888dd9b700 1 -- 172.21.15.103:0/3198579099 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88780119f0 con 0x7f88900b9140 2020-04-22T14:03:12.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.447+0000 7f889507e700 1 -- 172.21.15.103:0/3198579099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88900b9140 msgr2=0x7f889012b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:12.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.447+0000 7f889507e700 1 --2- 172.21.15.103:0/3198579099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88900b9140 0x7f889012b210 secure :-1 s=READY pgs=265 cs=0 l=1 rx=0x7f8878002f30 tx=0x7f8878007a40).stop 2020-04-22T14:03:12.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.448+0000 7f889507e700 1 -- 172.21.15.103:0/3198579099 shutdown_connections 2020-04-22T14:03:12.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.448+0000 7f889507e700 1 --2- 172.21.15.103:0/3198579099 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f889012b670 0x7f8890143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:12.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.448+0000 7f889507e700 1 --2- 172.21.15.103:0/3198579099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88900b9140 0x7f889012b210 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:12.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.448+0000 7f889507e700 1 -- 172.21.15.103:0/3198579099 >> 172.21.15.103:0/3198579099 conn(0x7f889005b7b0 msgr2=0x7f88900b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:12.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.448+0000 7f889507e700 1 -- 172.21.15.103:0/3198579099 shutdown_connections 2020-04-22T14:03:12.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.448+0000 7f889507e700 1 -- 172.21.15.103:0/3198579099 wait complete. 2020-04-22T14:03:12.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.449+0000 7f889507e700 1 Processor -- start 2020-04-22T14:03:12.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.449+0000 7f889507e700 1 -- start start 2020-04-22T14:03:12.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.450+0000 7f889507e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88900b9140 0x7f889012a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:12.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.450+0000 7f889507e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f889012b670 0x7f8890066750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:12.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.450+0000 7f889507e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8890066bb0 con 0x7f88900ac950 2020-04-22T14:03:12.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.450+0000 7f889507e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8890154e90 con 0x7f889012b670 2020-04-22T14:03:12.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.450+0000 7f889507e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8890155130 con 0x7f88900b9140 2020-04-22T14:03:12.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.450+0000 7f888f59e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f889012b670 0x7f8890066750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:12.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.450+0000 7f888f59e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f889012b670 0x7f8890066750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47996/0 (socket says 172.21.15.103:47996) 2020-04-22T14:03:12.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.450+0000 7f888f59e700 1 -- 172.21.15.103:0/761359272 learned_addr learned my addr 172.21.15.103:0/761359272 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:12.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.450+0000 7f888e59c700 1 --2- 172.21.15.103:0/761359272 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88900b9140 0x7f889012a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:12.466 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.450+0000 7f888f59e700 1 -- 172.21.15.103:0/761359272 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88900b9140 msgr2=0x7f889012a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:12.466 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.450+0000 7f888f59e700 1 --2- 172.21.15.103:0/761359272 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88900b9140 0x7f889012a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:12.466 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.450+0000 7f888f59e700 1 -- 172.21.15.103:0/761359272 >> v1:172.21.15.86:6789/0 conn(0x7f88900ac950 legacy=0x7f889014e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:12.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.450+0000 7f888f59e700 1 -- 172.21.15.103:0/761359272 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88901553d0 con 0x7f889012b670 2020-04-22T14:03:12.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.450+0000 7f888e59c700 1 --2- 172.21.15.103:0/761359272 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88900b9140 0x7f889012a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:03:12.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.450+0000 7f888f59e700 1 --2- 172.21.15.103:0/761359272 >> v2:172.21.15.103:3300/0 conn(0x7f889012b670 0x7f8890066750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f88880032b0 tx=0x7f8888010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.450+0000 7f888f59e700 1 --2- 172.21.15.103:0/761359272 >> v2:172.21.15.103:3300/0 conn(0x7f889012b670 0x7f8890066750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f88880032b0 tx=0x7f8888010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.450+0000 7f888f59e700 1 --2- 172.21.15.103:0/761359272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f889012b670 0x7f8890066750 secure :-1 s=READY pgs=266 cs=0 l=1 rx=0x7f88880032b0 tx=0x7f8888010e90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:12.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.450+0000 7f888f59e700 1 --2- 172.21.15.103:0/761359272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f889012b670 0x7f8890066750 secure :-1 s=THROTTLE_DONE pgs=266 cs=0 l=1 rx=0x7f88880032b0 tx=0x7f8888010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.450+0000 7f8887fff700 1 -- 172.21.15.103:0/761359272 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8888012c10 con 0x7f889012b670 2020-04-22T14:03:12.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.450+0000 7f888f59e700 1 --2- 172.21.15.103:0/761359272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f889012b670 0x7f8890066750 secure :-1 s=THROTTLE_DONE pgs=266 cs=0 l=1 rx=0x7f88880032b0 tx=0x7f8888010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.450+0000 7f888f59e700 1 --2- 172.21.15.103:0/761359272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f889012b670 0x7f8890066750 secure :-1 s=THROTTLE_DONE pgs=266 cs=0 l=1 rx=0x7f88880032b0 tx=0x7f8888010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.450+0000 7f8887fff700 1 -- 172.21.15.103:0/761359272 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8888012db0 con 0x7f889012b670 2020-04-22T14:03:12.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.450+0000 7f8887fff700 1 -- 172.21.15.103:0/761359272 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f888800a370 con 0x7f889012b670 2020-04-22T14:03:12.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.450+0000 7f889507e700 1 -- 172.21.15.103:0/761359272 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8890154b80 con 0x7f889012b670 2020-04-22T14:03:12.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.450+0000 7f889507e700 1 -- 172.21.15.103:0/761359272 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f889014ee80 con 0x7f889012b670 2020-04-22T14:03:12.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.451+0000 7f888f59e700 1 --2- 172.21.15.103:0/761359272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f889012b670 0x7f8890066750 secure :-1 s=THROTTLE_DONE pgs=266 cs=0 l=1 rx=0x7f88880032b0 tx=0x7f8888010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.451+0000 7f889507e700 1 -- 172.21.15.103:0/761359272 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8890155560 con 0x7f889012b670 2020-04-22T14:03:12.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.451+0000 7f8887fff700 1 -- 172.21.15.103:0/761359272 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f888800a5e0 con 0x7f889012b670 2020-04-22T14:03:12.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.451+0000 7f888f59e700 1 --2- 172.21.15.103:0/761359272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f889012b670 0x7f8890066750 secure :-1 s=THROTTLE_DONE pgs=266 cs=0 l=1 rx=0x7f88880032b0 tx=0x7f8888010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.452+0000 7f8887fff700 1 --2- 172.21.15.103:0/761359272 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f887404d990 0x7f887404fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:12.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.452+0000 7f8887fff700 1 -- 172.21.15.103:0/761359272 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8888061ce0 con 0x7f889012b670 2020-04-22T14:03:12.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.452+0000 7f888ed9d700 1 --2- 172.21.15.103:0/761359272 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f887404d990 0x7f887404fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:12.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.452+0000 7f888ed9d700 1 --2- 172.21.15.103:0/761359272 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f887404d990 0x7f887404fe50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f88900b1f00 tx=0x7f8878007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.452+0000 7f888ed9d700 1 --2- 172.21.15.103:0/761359272 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f887404d990 0x7f887404fe50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f88900b1f00 tx=0x7f8878007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.452+0000 7f888ed9d700 1 --2- 172.21.15.103:0/761359272 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f887404d990 0x7f887404fe50 secure :-1 s=READY pgs=116 cs=0 l=1 rx=0x7f88900b1f00 tx=0x7f8878007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:12.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.456+0000 7f888f59e700 1 --2- 172.21.15.103:0/761359272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f889012b670 0x7f8890066750 secure :-1 s=THROTTLE_DONE pgs=266 cs=0 l=1 rx=0x7f88880032b0 tx=0x7f8888010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.456+0000 7f8887fff700 1 -- 172.21.15.103:0/761359272 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f888803d0c0 con 0x7f889012b670 2020-04-22T14:03:12.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.599+0000 7f889507e700 1 -- 172.21.15.103:0/761359272 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8890056c90 con 0x7f889012b670 2020-04-22T14:03:12.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.600+0000 7f888f59e700 1 --2- 172.21.15.103:0/761359272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f889012b670 0x7f8890066750 secure :-1 s=THROTTLE_DONE pgs=266 cs=0 l=1 rx=0x7f88880032b0 tx=0x7f8888010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.600+0000 7f8887fff700 1 -- 172.21.15.103:0/761359272 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7f88880406e0 con 0x7f889012b670 2020-04-22T14:03:12.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.601+0000 7f889507e700 1 -- 172.21.15.103:0/761359272 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f887404d990 msgr2=0x7f887404fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:12.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.601+0000 7f889507e700 1 --2- 172.21.15.103:0/761359272 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f887404d990 0x7f887404fe50 secure :-1 s=READY pgs=116 cs=0 l=1 rx=0x7f88900b1f00 tx=0x7f8878007a40).stop 2020-04-22T14:03:12.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.601+0000 7f889507e700 1 -- 172.21.15.103:0/761359272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f889012b670 msgr2=0x7f8890066750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:12.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.601+0000 7f889507e700 1 --2- 172.21.15.103:0/761359272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f889012b670 0x7f8890066750 secure :-1 s=READY pgs=266 cs=0 l=1 rx=0x7f88880032b0 tx=0x7f8888010e90).stop 2020-04-22T14:03:12.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.601+0000 7f889507e700 1 -- 172.21.15.103:0/761359272 shutdown_connections 2020-04-22T14:03:12.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.601+0000 7f889507e700 1 --2- 172.21.15.103:0/761359272 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f887404d990 0x7f887404fe50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:12.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.601+0000 7f889507e700 1 --2- 172.21.15.103:0/761359272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f889012b670 0x7f8890066750 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:12.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.601+0000 7f889507e700 1 --2- 172.21.15.103:0/761359272 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88900b9140 0x7f889012a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:12.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.601+0000 7f889507e700 1 -- 172.21.15.103:0/761359272 >> 172.21.15.103:0/761359272 conn(0x7f889005b7b0 msgr2=0x7f88900b6660 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:12.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.601+0000 7f889507e700 1 -- 172.21.15.103:0/761359272 shutdown_connections 2020-04-22T14:03:12.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.601+0000 7f889507e700 1 -- 172.21.15.103:0/761359272 wait complete. 2020-04-22T14:03:12.608 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:03:12.626 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:12.643 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-22T14:03:12.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.790+0000 7fd3c8d49700 1 Processor -- start 2020-04-22T14:03:12.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.790+0000 7fd3c8d49700 1 -- start start 2020-04-22T14:03:12.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.791+0000 7fd3c8d49700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd3c40ac950 0x7fd3c4146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:12.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.791+0000 7fd3c8d49700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c41467e0 con 0x7fd3c41470a0 2020-04-22T14:03:12.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.791+0000 7fd3c8d49700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c4060050 con 0x7fd3c40b9140 2020-04-22T14:03:12.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.791+0000 7fd3c8d49700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3c4147530 con 0x7fd3c40ac950 2020-04-22T14:03:12.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.791+0000 7fd3c259c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd3c40b9140 0x7fd3c412b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40190/0 (socket says 172.21.15.103:40190) 2020-04-22T14:03:12.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.791+0000 7fd3c259c700 1 -- 172.21.15.103:0/2992956805 learned_addr learned my addr 172.21.15.103:0/2992956805 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:12.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.791+0000 7fd3c1d9b700 1 --2- 172.21.15.103:0/2992956805 >> v2:172.21.15.86:3300/0 conn(0x7fd3c40ac950 0x7fd3c4146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:12.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.791+0000 7fd3c159a700 1 -- 172.21.15.103:0/2992956805 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2735263938 0 0) 0x7fd3c4060050 con 0x7fd3c40b9140 2020-04-22T14:03:12.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.791+0000 7fd3c159a700 1 -- 172.21.15.103:0/2992956805 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3a4003230 con 0x7fd3c40b9140 2020-04-22T14:03:12.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.791+0000 7fd3c159a700 1 -- 172.21.15.103:0/2992956805 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4142216797 0 0) 0x7fd3c41467e0 con 0x7fd3c41470a0 2020-04-22T14:03:12.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.791+0000 7fd3c159a700 1 -- 172.21.15.103:0/2992956805 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3c4060050 con 0x7fd3c41470a0 2020-04-22T14:03:12.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.791+0000 7fd3c159a700 1 -- 172.21.15.103:0/2992956805 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1932002525 0 0) 0x7fd3a4003230 con 0x7fd3c40b9140 2020-04-22T14:03:12.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.791+0000 7fd3c159a700 1 -- 172.21.15.103:0/2992956805 >> v2:172.21.15.86:3300/0 conn(0x7fd3c40ac950 msgr2=0x7fd3c4146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:12.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.791+0000 7fd3c159a700 1 --2- 172.21.15.103:0/2992956805 >> v2:172.21.15.86:3300/0 conn(0x7fd3c40ac950 0x7fd3c4146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:12.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.791+0000 7fd3c159a700 1 -- 172.21.15.103:0/2992956805 >> v1:172.21.15.86:6789/0 conn(0x7fd3c41470a0 legacy=0x7fd3c4143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:12.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.791+0000 7fd3c159a700 1 -- 172.21.15.103:0/2992956805 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c40b9520 con 0x7fd3c40b9140 2020-04-22T14:03:12.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.791+0000 7fd3c159a700 1 -- 172.21.15.103:0/2992956805 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fd3ac001710 con 0x7fd3c40b9140 2020-04-22T14:03:12.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.791+0000 7fd3c159a700 1 -- 172.21.15.103:0/2992956805 >> v1:172.21.15.103:6789/0 conn(0x7fd3c40b9140 legacy=0x7fd3c412b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:12.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.791+0000 7fd3c159a700 1 --2- 172.21.15.103:0/2992956805 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3a40038b0 0x7fd3a4003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:12.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.791+0000 7fd3c159a700 1 --2- 172.21.15.103:0/2992956805 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd3a40044d0 0x7fd3a4004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:12.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.791+0000 7fd3c159a700 1 --2- 172.21.15.103:0/2992956805 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3a4004db0 0x7fd3a400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:12.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.791+0000 7fd3c159a700 1 -- 172.21.15.103:0/2992956805 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a4005370 con 0x7fd3a40038b0 2020-04-22T14:03:12.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.791+0000 7fd3c159a700 1 -- 172.21.15.103:0/2992956805 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a400bb80 con 0x7fd3a4004db0 2020-04-22T14:03:12.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.791+0000 7fd3c159a700 1 -- 172.21.15.103:0/2992956805 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a400bd40 con 0x7fd3a40044d0 2020-04-22T14:03:12.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.792+0000 7fd3c2d9d700 1 --2- 172.21.15.103:0/2992956805 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3a4004db0 0x7fd3a400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:12.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.792+0000 7fd3c259c700 1 --2- 172.21.15.103:0/2992956805 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3a40038b0 0x7fd3a4003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:12.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.792+0000 7fd3c1d9b700 1 --2- 172.21.15.103:0/2992956805 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd3a40044d0 0x7fd3a4004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:12.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.792+0000 7fd3c2d9d700 1 -- 172.21.15.103:0/2992956805 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd3a40044d0 msgr2=0x7fd3a4004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:12.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.792+0000 7fd3c2d9d700 1 --2- 172.21.15.103:0/2992956805 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd3a40044d0 0x7fd3a4004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:12.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.792+0000 7fd3c2d9d700 1 -- 172.21.15.103:0/2992956805 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3a40038b0 msgr2=0x7fd3a4003cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:12.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.792+0000 7fd3c2d9d700 1 --2- 172.21.15.103:0/2992956805 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3a40038b0 0x7fd3a4003cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:12.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.792+0000 7fd3c2d9d700 1 -- 172.21.15.103:0/2992956805 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a4003230 con 0x7fd3a4004db0 2020-04-22T14:03:12.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.792+0000 7fd3c2d9d700 1 --2- 172.21.15.103:0/2992956805 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3a4004db0 0x7fd3a400b720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd3bc001450 tx=0x7fd3bc0123e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.792+0000 7fd3c2d9d700 1 -- 172.21.15.103:0/2992956805 reap_dead start 2020-04-22T14:03:12.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.792+0000 7fd3c2d9d700 1 --2- 172.21.15.103:0/2992956805 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3a4004db0 0x7fd3a400b720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd3bc001450 tx=0x7fd3bc0123e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.792+0000 7fd3c2d9d700 1 --2- 172.21.15.103:0/2992956805 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3a4004db0 0x7fd3a400b720 secure :-1 s=READY pgs=268 cs=0 l=1 rx=0x7fd3bc001450 tx=0x7fd3bc0123e0).ready entity=mon.1 client_cookie=74fa951b8abdecaf server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:12.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.792+0000 7fd3c2d9d700 1 --2- 172.21.15.103:0/2992956805 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3a4004db0 0x7fd3a400b720 secure :-1 s=THROTTLE_DONE pgs=268 cs=0 l=1 rx=0x7fd3bc001450 tx=0x7fd3bc0123e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.792+0000 7fd3c2d9d700 1 --2- 172.21.15.103:0/2992956805 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3a4004db0 0x7fd3a400b720 secure :-1 s=THROTTLE_DONE pgs=268 cs=0 l=1 rx=0x7fd3bc001450 tx=0x7fd3bc0123e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.792+0000 7fd3c159a700 1 -- 172.21.15.103:0/2992956805 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3bc006860 con 0x7fd3a4004db0 2020-04-22T14:03:12.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.792+0000 7fd3c2d9d700 1 --2- 172.21.15.103:0/2992956805 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3a4004db0 0x7fd3a400b720 secure :-1 s=THROTTLE_DONE pgs=268 cs=0 l=1 rx=0x7fd3bc001450 tx=0x7fd3bc0123e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.792+0000 7fd3c159a700 1 -- 172.21.15.103:0/2992956805 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3bc0069c0 con 0x7fd3a4004db0 2020-04-22T14:03:12.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.792+0000 7fd3c159a700 1 -- 172.21.15.103:0/2992956805 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3bc006d20 con 0x7fd3a4004db0 2020-04-22T14:03:12.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.792+0000 7fd3c8d49700 1 -- 172.21.15.103:0/2992956805 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3a4004db0 msgr2=0x7fd3a400b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:12.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.792+0000 7fd3c8d49700 1 --2- 172.21.15.103:0/2992956805 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3a4004db0 0x7fd3a400b720 secure :-1 s=READY pgs=268 cs=0 l=1 rx=0x7fd3bc001450 tx=0x7fd3bc0123e0).stop 2020-04-22T14:03:12.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.793+0000 7fd3c8d49700 1 -- 172.21.15.103:0/2992956805 shutdown_connections 2020-04-22T14:03:12.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.793+0000 7fd3c8d49700 1 --2- 172.21.15.103:0/2992956805 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3a4004db0 0x7fd3a400b720 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:12.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.793+0000 7fd3c8d49700 1 -- 172.21.15.103:0/2992956805 >> 172.21.15.103:0/2992956805 conn(0x7fd3c405b7b0 msgr2=0x7fd3c40b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:12.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.793+0000 7fd3c8d49700 1 -- 172.21.15.103:0/2992956805 shutdown_connections 2020-04-22T14:03:12.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.793+0000 7fd3c8d49700 1 -- 172.21.15.103:0/2992956805 wait complete. 2020-04-22T14:03:12.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.794+0000 7fd3c8d49700 1 Processor -- start 2020-04-22T14:03:12.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.794+0000 7fd3c8d49700 1 -- start start 2020-04-22T14:03:12.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.794+0000 7fd3c8d49700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd3c414fd60 0x7fd3c40b4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:12.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.794+0000 7fd3c8d49700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd3c40b5810 0x7fd3c41416e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:12.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.794+0000 7fd3c8d49700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c40b5f90 con 0x7fd3a4004db0 2020-04-22T14:03:12.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.794+0000 7fd3c8d49700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3c40b4860 con 0x7fd3c40b5810 2020-04-22T14:03:12.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.794+0000 7fd3c8d49700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c4061400 con 0x7fd3c414fd60 2020-04-22T14:03:12.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.794+0000 7fd3c2d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd3c40b5810 0x7fd3c41416e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:12.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.795+0000 7fd3c1d9b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd3c414fd60 0x7fd3c40b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:12.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.795+0000 7fd3c259c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fd3a4004db0 0x7fd3c4061b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:57358/0 (socket says 172.21.15.103:57358) 2020-04-22T14:03:12.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.795+0000 7fd3c259c700 1 -- 172.21.15.103:0/3583301916 learned_addr learned my addr 172.21.15.103:0/3583301916 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:12.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.795+0000 7fd3c2d9d700 1 -- 172.21.15.103:0/3583301916 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd3c414fd60 msgr2=0x7fd3c40b4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:12.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.795+0000 7fd3c2d9d700 1 --2- 172.21.15.103:0/3583301916 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd3c414fd60 0x7fd3c40b4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:12.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.795+0000 7fd3c2d9d700 1 -- 172.21.15.103:0/3583301916 >> v1:172.21.15.86:6789/0 conn(0x7fd3a4004db0 legacy=0x7fd3c4061b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:12.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.795+0000 7fd3c2d9d700 1 -- 172.21.15.103:0/3583301916 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c40616a0 con 0x7fd3c40b5810 2020-04-22T14:03:12.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.795+0000 7fd3bb7fe700 1 -- 172.21.15.103:0/3583301916 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 528918658 0 0) 0x7fd3c40b5f90 con 0x7fd3a4004db0 2020-04-22T14:03:12.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.795+0000 7fd3c1d9b700 1 --2- 172.21.15.103:0/3583301916 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd3c414fd60 0x7fd3c40b4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:03:12.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.795+0000 7fd3c2d9d700 1 --2- 172.21.15.103:0/3583301916 >> v2:172.21.15.86:3300/0 conn(0x7fd3c40b5810 0x7fd3c41416e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd3bc001450 tx=0x7fd3bc0123e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.795+0000 7fd3c2d9d700 1 --2- 172.21.15.103:0/3583301916 >> v2:172.21.15.86:3300/0 conn(0x7fd3c40b5810 0x7fd3c41416e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd3bc001450 tx=0x7fd3bc0123e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.795+0000 7fd3c2d9d700 1 --2- 172.21.15.103:0/3583301916 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3c40b5810 0x7fd3c41416e0 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7fd3bc001450 tx=0x7fd3bc0123e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:12.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.795+0000 7fd3c2d9d700 1 --2- 172.21.15.103:0/3583301916 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3c40b5810 0x7fd3c41416e0 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7fd3bc001450 tx=0x7fd3bc0123e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.795+0000 7fd3bb7fe700 1 -- 172.21.15.103:0/3583301916 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3bc00e4d0 con 0x7fd3c40b5810 2020-04-22T14:03:12.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.795+0000 7fd3c2d9d700 1 --2- 172.21.15.103:0/3583301916 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3c40b5810 0x7fd3c41416e0 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7fd3bc001450 tx=0x7fd3bc0123e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.795+0000 7fd3c2d9d700 1 --2- 172.21.15.103:0/3583301916 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3c40b5810 0x7fd3c41416e0 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7fd3bc001450 tx=0x7fd3bc0123e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.795+0000 7fd3bb7fe700 1 -- 172.21.15.103:0/3583301916 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3bc00e630 con 0x7fd3c40b5810 2020-04-22T14:03:12.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.795+0000 7fd3c8d49700 1 -- 172.21.15.103:0/3583301916 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3c4062250 con 0x7fd3c40b5810 2020-04-22T14:03:12.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.795+0000 7fd3bb7fe700 1 -- 172.21.15.103:0/3583301916 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3bc00e9d0 con 0x7fd3c40b5810 2020-04-22T14:03:12.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.795+0000 7fd3c8d49700 1 -- 172.21.15.103:0/3583301916 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c4141b40 con 0x7fd3c40b5810 2020-04-22T14:03:12.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.796+0000 7fd3c2d9d700 1 --2- 172.21.15.103:0/3583301916 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3c40b5810 0x7fd3c41416e0 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7fd3bc001450 tx=0x7fd3bc0123e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.796+0000 7fd3c8d49700 1 -- 172.21.15.103:0/3583301916 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3c4061830 con 0x7fd3c40b5810 2020-04-22T14:03:12.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.796+0000 7fd3bb7fe700 1 -- 172.21.15.103:0/3583301916 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fd3bc00b0b0 con 0x7fd3c40b5810 2020-04-22T14:03:12.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.796+0000 7fd3c2d9d700 1 --2- 172.21.15.103:0/3583301916 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3c40b5810 0x7fd3c41416e0 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7fd3bc001450 tx=0x7fd3bc0123e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.797+0000 7fd3bb7fe700 1 --2- 172.21.15.103:0/3583301916 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd3a804d7a0 0x7fd3a804fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:12.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.797+0000 7fd3bb7fe700 1 -- 172.21.15.103:0/3583301916 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd3bc063a40 con 0x7fd3c40b5810 2020-04-22T14:03:12.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.797+0000 7fd3c259c700 1 --2- 172.21.15.103:0/3583301916 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd3a804d7a0 0x7fd3a804fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:12.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.797+0000 7fd3c259c700 1 --2- 172.21.15.103:0/3583301916 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd3a804d7a0 0x7fd3a804fc60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd3ac0044f0 tx=0x7fd3c40b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.797+0000 7fd3c259c700 1 --2- 172.21.15.103:0/3583301916 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd3a804d7a0 0x7fd3a804fc60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd3ac0044f0 tx=0x7fd3c40b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.797+0000 7fd3c259c700 1 --2- 172.21.15.103:0/3583301916 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd3a804d7a0 0x7fd3a804fc60 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7fd3ac0044f0 tx=0x7fd3c40b96b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:12.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.800+0000 7fd3c2d9d700 1 --2- 172.21.15.103:0/3583301916 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3c40b5810 0x7fd3c41416e0 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7fd3bc001450 tx=0x7fd3bc0123e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.800+0000 7fd3bb7fe700 1 -- 172.21.15.103:0/3583301916 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fd3bc03ef40 con 0x7fd3c40b5810 2020-04-22T14:03:12.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.944+0000 7fd3c8d49700 1 -- 172.21.15.103:0/3583301916 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd3c4056c90 con 0x7fd3c40b5810 2020-04-22T14:03:12.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.945+0000 7fd3c2d9d700 1 --2- 172.21.15.103:0/3583301916 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3c40b5810 0x7fd3c41416e0 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7fd3bc001450 tx=0x7fd3bc0123e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:12.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.945+0000 7fd3bb7fe700 1 -- 172.21.15.103:0/3583301916 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7fd3bc042560 con 0x7fd3c40b5810 2020-04-22T14:03:12.947 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:03:12.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.946+0000 7fd3c8d49700 1 -- 172.21.15.103:0/3583301916 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd3a804d7a0 msgr2=0x7fd3a804fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:12.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.946+0000 7fd3c8d49700 1 --2- 172.21.15.103:0/3583301916 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd3a804d7a0 0x7fd3a804fc60 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7fd3ac0044f0 tx=0x7fd3c40b96b0).stop 2020-04-22T14:03:12.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.946+0000 7fd3c8d49700 1 -- 172.21.15.103:0/3583301916 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3c40b5810 msgr2=0x7fd3c41416e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:12.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.946+0000 7fd3c8d49700 1 --2- 172.21.15.103:0/3583301916 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3c40b5810 0x7fd3c41416e0 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7fd3bc001450 tx=0x7fd3bc0123e0).stop 2020-04-22T14:03:12.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.947+0000 7fd3c8d49700 1 -- 172.21.15.103:0/3583301916 shutdown_connections 2020-04-22T14:03:12.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.947+0000 7fd3c8d49700 1 --2- 172.21.15.103:0/3583301916 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd3a804d7a0 0x7fd3a804fc60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:12.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.947+0000 7fd3c8d49700 1 --2- 172.21.15.103:0/3583301916 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3c40b5810 0x7fd3c41416e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:12.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.947+0000 7fd3c8d49700 1 --2- 172.21.15.103:0/3583301916 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd3c414fd60 0x7fd3c40b4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:12.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.947+0000 7fd3c8d49700 1 -- 172.21.15.103:0/3583301916 >> 172.21.15.103:0/3583301916 conn(0x7fd3c405b7b0 msgr2=0x7fd3c4144da0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:12.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.947+0000 7fd3c8d49700 1 -- 172.21.15.103:0/3583301916 shutdown_connections 2020-04-22T14:03:12.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:12.947+0000 7fd3c8d49700 1 -- 172.21.15.103:0/3583301916 wait complete. 2020-04-22T14:03:12.959 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:12.973 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:03:13.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.117+0000 7f66fb59e700 1 Processor -- start 2020-04-22T14:03:13.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.117+0000 7f66fb59e700 1 -- start start 2020-04-22T14:03:13.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.118+0000 7f66fb59e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f66fc0ae130 0x7f66fc0bbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:13.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.118+0000 7f66fb59e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66fc060730 0x7f66fc060b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:13.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.118+0000 7f66fb59e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66fc14a480 con 0x7f66fc0bcc00 2020-04-22T14:03:13.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.118+0000 7f66fb59e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66fc060290 con 0x7f66fc0ae130 2020-04-22T14:03:13.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.118+0000 7f66fb59e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc0bcfe0 con 0x7f66fc060730 2020-04-22T14:03:13.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.118+0000 7f66f3fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f66fc0ae130 0x7f66fc0bbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:13.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.118+0000 7f66f3fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f66fc0ae130 0x7f66fc0bbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48022/0 (socket says 172.21.15.103:48022) 2020-04-22T14:03:13.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.118+0000 7f66f3fff700 1 -- 172.21.15.103:0/2451547894 learned_addr learned my addr 172.21.15.103:0/2451547894 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:13.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.118+0000 7f66fad9d700 1 --2- 172.21.15.103:0/2451547894 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66fc060730 0x7f66fc060b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:13.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.118+0000 7f66f3fff700 1 -- 172.21.15.103:0/2451547894 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66fc060730 msgr2=0x7f66fc060b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:13.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.118+0000 7f66f3fff700 1 --2- 172.21.15.103:0/2451547894 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66fc060730 0x7f66fc060b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:13.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.118+0000 7f66f3fff700 1 -- 172.21.15.103:0/2451547894 >> v1:172.21.15.86:6789/0 conn(0x7f66fc0bcc00 legacy=0x7f66fc0ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:13.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.118+0000 7f66f3fff700 1 -- 172.21.15.103:0/2451547894 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66fc0ace50 con 0x7f66fc0ae130 2020-04-22T14:03:13.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.118+0000 7f66fad9d700 1 --2- 172.21.15.103:0/2451547894 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66fc060730 0x7f66fc060b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:03:13.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.118+0000 7f66f3fff700 1 --2- 172.21.15.103:0/2451547894 >> v2:172.21.15.103:3300/0 conn(0x7f66fc0ae130 0x7f66fc0bbdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f66e4002f30 tx=0x7f66e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.118+0000 7f66f3fff700 1 --2- 172.21.15.103:0/2451547894 >> v2:172.21.15.103:3300/0 conn(0x7f66fc0ae130 0x7f66fc0bbdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f66e4002f30 tx=0x7f66e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.118+0000 7f66f3fff700 1 --2- 172.21.15.103:0/2451547894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66fc0ae130 0x7f66fc0bbdb0 secure :-1 s=READY pgs=269 cs=0 l=1 rx=0x7f66e4002f30 tx=0x7f66e4007a40).ready entity=mon.1 client_cookie=16d8c4b1074fc740 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:13.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.118+0000 7f66f3fff700 1 --2- 172.21.15.103:0/2451547894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66fc0ae130 0x7f66fc0bbdb0 secure :-1 s=THROTTLE_DONE pgs=269 cs=0 l=1 rx=0x7f66e4002f30 tx=0x7f66e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.118+0000 7f66f9d9b700 1 -- 172.21.15.103:0/2451547894 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66e4011720 con 0x7f66fc0ae130 2020-04-22T14:03:13.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.118+0000 7f66f3fff700 1 --2- 172.21.15.103:0/2451547894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66fc0ae130 0x7f66fc0bbdb0 secure :-1 s=THROTTLE_DONE pgs=269 cs=0 l=1 rx=0x7f66e4002f30 tx=0x7f66e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.118+0000 7f66f9d9b700 1 -- 172.21.15.103:0/2451547894 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e40118c0 con 0x7f66fc0ae130 2020-04-22T14:03:13.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.118+0000 7f66f3fff700 1 --2- 172.21.15.103:0/2451547894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66fc0ae130 0x7f66fc0bbdb0 secure :-1 s=THROTTLE_DONE pgs=269 cs=0 l=1 rx=0x7f66e4002f30 tx=0x7f66e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.118+0000 7f66f9d9b700 1 -- 172.21.15.103:0/2451547894 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66e4011ce0 con 0x7f66fc0ae130 2020-04-22T14:03:13.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.118+0000 7f66fb59e700 1 -- 172.21.15.103:0/2451547894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66fc0ae130 msgr2=0x7f66fc0bbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:13.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.118+0000 7f66fb59e700 1 --2- 172.21.15.103:0/2451547894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66fc0ae130 0x7f66fc0bbdb0 secure :-1 s=READY pgs=269 cs=0 l=1 rx=0x7f66e4002f30 tx=0x7f66e4007a40).stop 2020-04-22T14:03:13.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.119+0000 7f66fb59e700 1 -- 172.21.15.103:0/2451547894 shutdown_connections 2020-04-22T14:03:13.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.119+0000 7f66fb59e700 1 --2- 172.21.15.103:0/2451547894 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66fc060730 0x7f66fc060b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:13.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.119+0000 7f66fb59e700 1 --2- 172.21.15.103:0/2451547894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66fc0ae130 0x7f66fc0bbdb0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:13.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.119+0000 7f66fb59e700 1 -- 172.21.15.103:0/2451547894 >> 172.21.15.103:0/2451547894 conn(0x7f66fc069f30 msgr2=0x7f66fc06a340 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:13.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.119+0000 7f66fb59e700 1 -- 172.21.15.103:0/2451547894 shutdown_connections 2020-04-22T14:03:13.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.119+0000 7f66fb59e700 1 -- 172.21.15.103:0/2451547894 wait complete. 2020-04-22T14:03:13.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.120+0000 7f66fb59e700 1 Processor -- start 2020-04-22T14:03:13.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.120+0000 7f66fb59e700 1 -- start start 2020-04-22T14:03:13.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.121+0000 7f66fb59e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66fc0ae130 0x7f66fc157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:13.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.121+0000 7f66fb59e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f66fc0bcc00 0x7f66fc0b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:13.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.121+0000 7f66fb59e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66fc0b5270 con 0x7f66fc060730 2020-04-22T14:03:13.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.121+0000 7f66fb59e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66fc0b5510 con 0x7f66fc0bcc00 2020-04-22T14:03:13.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.121+0000 7f66fb59e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc0b4e80 con 0x7f66fc0ae130 2020-04-22T14:03:13.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.121+0000 7f66fa59c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f66fc060730 0x7f66fc0b3070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40216/0 (socket says 172.21.15.103:40216) 2020-04-22T14:03:13.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.121+0000 7f66fa59c700 1 -- 172.21.15.103:0/4034032802 learned_addr learned my addr 172.21.15.103:0/4034032802 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:13.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.121+0000 7f66fad9d700 1 --2- 172.21.15.103:0/4034032802 >> v2:172.21.15.86:3300/0 conn(0x7f66fc0bcc00 0x7f66fc0b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:13.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.121+0000 7f66f3fff700 1 --2- 172.21.15.103:0/4034032802 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66fc0ae130 0x7f66fc157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:13.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.121+0000 7f66f37fe700 1 -- 172.21.15.103:0/4034032802 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2164140845 0 0) 0x7f66fc0b5270 con 0x7f66fc060730 2020-04-22T14:03:13.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.121+0000 7f66f37fe700 1 -- 172.21.15.103:0/4034032802 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66e0002fe0 con 0x7f66fc060730 2020-04-22T14:03:13.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.121+0000 7f66f37fe700 1 -- 172.21.15.103:0/4034032802 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1690749050 0 0) 0x7f66e0002fe0 con 0x7f66fc060730 2020-04-22T14:03:13.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.121+0000 7f66fad9d700 1 -- 172.21.15.103:0/4034032802 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66fc0ae130 msgr2=0x7f66fc157020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:13.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.121+0000 7f66fad9d700 1 --2- 172.21.15.103:0/4034032802 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66fc0ae130 0x7f66fc157020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:13.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.121+0000 7f66fad9d700 1 -- 172.21.15.103:0/4034032802 >> v1:172.21.15.103:6789/0 conn(0x7f66fc060730 legacy=0x7f66fc0b3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:13.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.121+0000 7f66fad9d700 1 -- 172.21.15.103:0/4034032802 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66fc0b4ff0 con 0x7f66fc0bcc00 2020-04-22T14:03:13.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.121+0000 7f66f3fff700 1 --2- 172.21.15.103:0/4034032802 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66fc0ae130 0x7f66fc157020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:03:13.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.121+0000 7f66fad9d700 1 --2- 172.21.15.103:0/4034032802 >> v2:172.21.15.86:3300/0 conn(0x7f66fc0bcc00 0x7f66fc0b5c50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f66ec001ad0 tx=0x7f66f4010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.121+0000 7f66fad9d700 1 --2- 172.21.15.103:0/4034032802 >> v2:172.21.15.86:3300/0 conn(0x7f66fc0bcc00 0x7f66fc0b5c50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f66ec001ad0 tx=0x7f66f4010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.121+0000 7f66fad9d700 1 --2- 172.21.15.103:0/4034032802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66fc0bcc00 0x7f66fc0b5c50 secure :-1 s=READY pgs=177 cs=0 l=1 rx=0x7f66ec001ad0 tx=0x7f66f4010d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:13.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.121+0000 7f66fad9d700 1 --2- 172.21.15.103:0/4034032802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66fc0bcc00 0x7f66fc0b5c50 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f66ec001ad0 tx=0x7f66f4010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.121+0000 7f66f37fe700 1 -- 172.21.15.103:0/4034032802 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66ec001930 con 0x7f66fc0bcc00 2020-04-22T14:03:13.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.121+0000 7f66fad9d700 1 --2- 172.21.15.103:0/4034032802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66fc0bcc00 0x7f66fc0b5c50 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f66ec001ad0 tx=0x7f66f4010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.121+0000 7f66f37fe700 1 -- 172.21.15.103:0/4034032802 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f4005e30 con 0x7f66fc0bcc00 2020-04-22T14:03:13.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.121+0000 7f66fad9d700 1 --2- 172.21.15.103:0/4034032802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66fc0bcc00 0x7f66fc0b5c50 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f66ec001ad0 tx=0x7f66f4010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.121+0000 7f66fb59e700 1 -- 172.21.15.103:0/4034032802 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66fc12b000 con 0x7f66fc0bcc00 2020-04-22T14:03:13.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.121+0000 7f66f37fe700 1 -- 172.21.15.103:0/4034032802 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66f4007560 con 0x7f66fc0bcc00 2020-04-22T14:03:13.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.122+0000 7f66fb59e700 1 -- 172.21.15.103:0/4034032802 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66fc1578c0 con 0x7f66fc0bcc00 2020-04-22T14:03:13.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.122+0000 7f66fad9d700 1 --2- 172.21.15.103:0/4034032802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66fc0bcc00 0x7f66fc0b5c50 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f66ec001ad0 tx=0x7f66f4010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.123+0000 7f66fb59e700 1 -- 172.21.15.103:0/4034032802 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66fc157f50 con 0x7f66fc0bcc00 2020-04-22T14:03:13.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.123+0000 7f66f37fe700 1 -- 172.21.15.103:0/4034032802 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f66f40077a0 con 0x7f66fc0bcc00 2020-04-22T14:03:13.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.123+0000 7f66fad9d700 1 --2- 172.21.15.103:0/4034032802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66fc0bcc00 0x7f66fc0b5c50 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f66ec001ad0 tx=0x7f66f4010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.123+0000 7f66f37fe700 1 --2- 172.21.15.103:0/4034032802 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f66e004dca0 0x7f66e0050160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:13.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.123+0000 7f66f37fe700 1 -- 172.21.15.103:0/4034032802 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f66f4061560 con 0x7f66fc0bcc00 2020-04-22T14:03:13.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.123+0000 7f66fa59c700 1 --2- 172.21.15.103:0/4034032802 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f66e004dca0 0x7f66e0050160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:13.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.123+0000 7f66fa59c700 1 --2- 172.21.15.103:0/4034032802 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f66e004dca0 0x7f66e0050160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f66ec0011d0 tx=0x7f66ec009550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.123+0000 7f66fa59c700 1 --2- 172.21.15.103:0/4034032802 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f66e004dca0 0x7f66e0050160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f66ec0011d0 tx=0x7f66ec009550).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.123+0000 7f66fa59c700 1 --2- 172.21.15.103:0/4034032802 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f66e004dca0 0x7f66e0050160 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7f66ec0011d0 tx=0x7f66ec009550).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:13.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.127+0000 7f66fad9d700 1 --2- 172.21.15.103:0/4034032802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66fc0bcc00 0x7f66fc0b5c50 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f66ec001ad0 tx=0x7f66f4010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.127+0000 7f66f37fe700 1 -- 172.21.15.103:0/4034032802 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f66f403ca00 con 0x7f66fc0bcc00 2020-04-22T14:03:13.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.272+0000 7f66fb59e700 1 -- 172.21.15.103:0/4034032802 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66fc056c90 con 0x7f66fc0bcc00 2020-04-22T14:03:13.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.273+0000 7f66fad9d700 1 --2- 172.21.15.103:0/4034032802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66fc0bcc00 0x7f66fc0b5c50 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f66ec001ad0 tx=0x7f66f4010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.273+0000 7f66f37fe700 1 -- 172.21.15.103:0/4034032802 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f66f4040020 con 0x7f66fc0bcc00 2020-04-22T14:03:13.276 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:03:13.276 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":24,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:02:28.687155+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:02:25.963043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-22T14:02:26.642611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:03:13.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.274+0000 7f66fb59e700 1 -- 172.21.15.103:0/4034032802 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f66e004dca0 msgr2=0x7f66e0050160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:13.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.274+0000 7f66fb59e700 1 --2- 172.21.15.103:0/4034032802 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f66e004dca0 0x7f66e0050160 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7f66ec0011d0 tx=0x7f66ec009550).stop 2020-04-22T14:03:13.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.274+0000 7f66fb59e700 1 -- 172.21.15.103:0/4034032802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66fc0bcc00 msgr2=0x7f66fc0b5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:13.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.274+0000 7f66fb59e700 1 --2- 172.21.15.103:0/4034032802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66fc0bcc00 0x7f66fc0b5c50 secure :-1 s=READY pgs=177 cs=0 l=1 rx=0x7f66ec001ad0 tx=0x7f66f4010d20).stop 2020-04-22T14:03:13.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.274+0000 7f66fb59e700 1 -- 172.21.15.103:0/4034032802 shutdown_connections 2020-04-22T14:03:13.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.274+0000 7f66fb59e700 1 --2- 172.21.15.103:0/4034032802 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f66e004dca0 0x7f66e0050160 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:13.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.274+0000 7f66fb59e700 1 --2- 172.21.15.103:0/4034032802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66fc0bcc00 0x7f66fc0b5c50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:13.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.274+0000 7f66fb59e700 1 --2- 172.21.15.103:0/4034032802 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66fc0ae130 0x7f66fc157020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:13.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.274+0000 7f66fb59e700 1 -- 172.21.15.103:0/4034032802 >> 172.21.15.103:0/4034032802 conn(0x7f66fc069f30 msgr2=0x7f66fc05c740 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:13.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.274+0000 7f66fb59e700 1 -- 172.21.15.103:0/4034032802 shutdown_connections 2020-04-22T14:03:13.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.274+0000 7f66fb59e700 1 -- 172.21.15.103:0/4034032802 wait complete. 2020-04-22T14:03:13.287 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:25.963043+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:26.642611+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 4, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'24', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:03:13.288 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:13.304 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:03:13.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.452+0000 7fb2dabf7700 1 Processor -- start 2020-04-22T14:03:13.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.452+0000 7fb2dabf7700 1 -- start start 2020-04-22T14:03:13.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.452+0000 7fb2dabf7700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb2d40b3bd0 0x7fb2d4143650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:13.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.452+0000 7fb2dabf7700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb2d4143ab0 0x7fb2d4143f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:13.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.452+0000 7fb2dabf7700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d4148310 con 0x7fb2d40b9140 2020-04-22T14:03:13.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.452+0000 7fb2dabf7700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d41485b0 con 0x7fb2d4143ab0 2020-04-22T14:03:13.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.452+0000 7fb2dabf7700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d40b9520 con 0x7fb2d40b3bd0 2020-04-22T14:03:13.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.452+0000 7fb2d3fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb2d40b3bd0 0x7fb2d4143650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:13.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.453+0000 7fb2d3fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb2d40b3bd0 0x7fb2d4143650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48036/0 (socket says 172.21.15.103:48036) 2020-04-22T14:03:13.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.453+0000 7fb2d3fff700 1 -- 172.21.15.103:0/2597805508 learned_addr learned my addr 172.21.15.103:0/2597805508 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:13.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.453+0000 7fb2d3fff700 1 -- 172.21.15.103:0/2597805508 >> v2:172.21.15.86:3300/0 conn(0x7fb2d4143ab0 msgr2=0x7fb2d4143f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:13.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.453+0000 7fb2d3fff700 1 --2- 172.21.15.103:0/2597805508 >> v2:172.21.15.86:3300/0 conn(0x7fb2d4143ab0 0x7fb2d4143f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:13.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.453+0000 7fb2d3fff700 1 -- 172.21.15.103:0/2597805508 >> v1:172.21.15.86:6789/0 conn(0x7fb2d40b9140 legacy=0x7fb2d40aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:13.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.453+0000 7fb2d3fff700 1 -- 172.21.15.103:0/2597805508 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d40b3050 con 0x7fb2d40b3bd0 2020-04-22T14:03:13.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.453+0000 7fb2d3fff700 1 --2- 172.21.15.103:0/2597805508 >> v2:172.21.15.103:3300/0 conn(0x7fb2d40b3bd0 0x7fb2d4143650 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb2d4067530 tx=0x7fb2c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.453+0000 7fb2d3fff700 1 --2- 172.21.15.103:0/2597805508 >> v2:172.21.15.103:3300/0 conn(0x7fb2d40b3bd0 0x7fb2d4143650 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb2d4067530 tx=0x7fb2c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.453+0000 7fb2d3fff700 1 --2- 172.21.15.103:0/2597805508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2d40b3bd0 0x7fb2d4143650 secure :-1 s=READY pgs=271 cs=0 l=1 rx=0x7fb2d4067530 tx=0x7fb2c0007a40).ready entity=mon.1 client_cookie=2c6d059fa164ef79 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:13.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.453+0000 7fb2d3fff700 1 --2- 172.21.15.103:0/2597805508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2d40b3bd0 0x7fb2d4143650 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7fb2d4067530 tx=0x7fb2c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.453+0000 7fb2d37fe700 1 -- 172.21.15.103:0/2597805508 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2c00116e0 con 0x7fb2d40b3bd0 2020-04-22T14:03:13.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.453+0000 7fb2d3fff700 1 --2- 172.21.15.103:0/2597805508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2d40b3bd0 0x7fb2d4143650 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7fb2d4067530 tx=0x7fb2c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.453+0000 7fb2d3fff700 1 --2- 172.21.15.103:0/2597805508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2d40b3bd0 0x7fb2d4143650 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7fb2d4067530 tx=0x7fb2c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.453+0000 7fb2d37fe700 1 -- 172.21.15.103:0/2597805508 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c0011840 con 0x7fb2d40b3bd0 2020-04-22T14:03:13.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.453+0000 7fb2d37fe700 1 -- 172.21.15.103:0/2597805508 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2c0011c20 con 0x7fb2d40b3bd0 2020-04-22T14:03:13.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.453+0000 7fb2dabf7700 1 -- 172.21.15.103:0/2597805508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2d40b3bd0 msgr2=0x7fb2d4143650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:13.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.453+0000 7fb2dabf7700 1 --2- 172.21.15.103:0/2597805508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2d40b3bd0 0x7fb2d4143650 secure :-1 s=READY pgs=271 cs=0 l=1 rx=0x7fb2d4067530 tx=0x7fb2c0007a40).stop 2020-04-22T14:03:13.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.454+0000 7fb2dabf7700 1 -- 172.21.15.103:0/2597805508 shutdown_connections 2020-04-22T14:03:13.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.454+0000 7fb2dabf7700 1 --2- 172.21.15.103:0/2597805508 >> v2:172.21.15.86:3300/0 conn(0x7fb2d4143ab0 0x7fb2d4143f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:13.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.454+0000 7fb2dabf7700 1 --2- 172.21.15.103:0/2597805508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2d40b3bd0 0x7fb2d4143650 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:13.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.454+0000 7fb2dabf7700 1 -- 172.21.15.103:0/2597805508 >> 172.21.15.103:0/2597805508 conn(0x7fb2d405b7b0 msgr2=0x7fb2d40b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:13.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.454+0000 7fb2dabf7700 1 -- 172.21.15.103:0/2597805508 shutdown_connections 2020-04-22T14:03:13.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.454+0000 7fb2dabf7700 1 -- 172.21.15.103:0/2597805508 wait complete. 2020-04-22T14:03:13.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.455+0000 7fb2dabf7700 1 Processor -- start 2020-04-22T14:03:13.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.455+0000 7fb2dabf7700 1 -- start start 2020-04-22T14:03:13.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.455+0000 7fb2dabf7700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb2d40b3bd0 0x7fb2d41554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:13.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.455+0000 7fb2dabf7700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb2d40b9140 0x7fb2d4155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:13.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.455+0000 7fb2dabf7700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d4142a10 con 0x7fb2d4143ab0 2020-04-22T14:03:13.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.455+0000 7fb2dabf7700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d4066580 con 0x7fb2d40b9140 2020-04-22T14:03:13.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.455+0000 7fb2dabf7700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d4142770 con 0x7fb2d40b3bd0 2020-04-22T14:03:13.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.455+0000 7fb2d8993700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb2d40b3bd0 0x7fb2d41554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:13.475 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.456+0000 7fb2d8993700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb2d40b3bd0 0x7fb2d41554e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48040/0 (socket says 172.21.15.103:48040) 2020-04-22T14:03:13.475 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.456+0000 7fb2d8993700 1 -- 172.21.15.103:0/3828290789 learned_addr learned my addr 172.21.15.103:0/3828290789 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:13.475 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.456+0000 7fb2d3fff700 1 --2- 172.21.15.103:0/3828290789 >> v2:172.21.15.86:3300/0 conn(0x7fb2d40b9140 0x7fb2d4155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:13.475 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.456+0000 7fb2d8993700 1 -- 172.21.15.103:0/3828290789 >> v2:172.21.15.86:3300/0 conn(0x7fb2d40b9140 msgr2=0x7fb2d4155940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:13.476 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.456+0000 7fb2d8993700 1 --2- 172.21.15.103:0/3828290789 >> v2:172.21.15.86:3300/0 conn(0x7fb2d40b9140 0x7fb2d4155940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:13.476 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.456+0000 7fb2d8993700 1 -- 172.21.15.103:0/3828290789 >> v1:172.21.15.86:6789/0 conn(0x7fb2d4143ab0 legacy=0x7fb2d413eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:13.476 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.456+0000 7fb2d8993700 1 -- 172.21.15.103:0/3828290789 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d4155da0 con 0x7fb2d40b3bd0 2020-04-22T14:03:13.476 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.456+0000 7fb2d8993700 1 --2- 172.21.15.103:0/3828290789 >> v2:172.21.15.103:3300/0 conn(0x7fb2d40b3bd0 0x7fb2d41554e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb2d4141be0 tx=0x7fb2c40109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.476 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.456+0000 7fb2d8993700 1 --2- 172.21.15.103:0/3828290789 >> v2:172.21.15.103:3300/0 conn(0x7fb2d40b3bd0 0x7fb2d41554e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb2d4141be0 tx=0x7fb2c40109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.476 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.456+0000 7fb2d8993700 1 --2- 172.21.15.103:0/3828290789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2d40b3bd0 0x7fb2d41554e0 secure :-1 s=READY pgs=272 cs=0 l=1 rx=0x7fb2d4141be0 tx=0x7fb2c40109f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:13.476 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.456+0000 7fb2d8993700 1 --2- 172.21.15.103:0/3828290789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2d40b3bd0 0x7fb2d41554e0 secure :-1 s=THROTTLE_DONE pgs=272 cs=0 l=1 rx=0x7fb2d4141be0 tx=0x7fb2c40109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.456+0000 7fb2d8993700 1 --2- 172.21.15.103:0/3828290789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2d40b3bd0 0x7fb2d41554e0 secure :-1 s=THROTTLE_DONE pgs=272 cs=0 l=1 rx=0x7fb2d4141be0 tx=0x7fb2c40109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.456+0000 7fb2d1ffb700 1 -- 172.21.15.103:0/3828290789 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2c400cc00 con 0x7fb2d40b3bd0 2020-04-22T14:03:13.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.456+0000 7fb2d8993700 1 --2- 172.21.15.103:0/3828290789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2d40b3bd0 0x7fb2d41554e0 secure :-1 s=THROTTLE_DONE pgs=272 cs=0 l=1 rx=0x7fb2d4141be0 tx=0x7fb2c40109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.456+0000 7fb2d1ffb700 1 -- 172.21.15.103:0/3828290789 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c400cd60 con 0x7fb2d40b3bd0 2020-04-22T14:03:13.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.456+0000 7fb2dabf7700 1 -- 172.21.15.103:0/3828290789 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d4062df0 con 0x7fb2d40b3bd0 2020-04-22T14:03:13.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.456+0000 7fb2d1ffb700 1 -- 172.21.15.103:0/3828290789 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2c4012240 con 0x7fb2d40b3bd0 2020-04-22T14:03:13.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.456+0000 7fb2dabf7700 1 -- 172.21.15.103:0/3828290789 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d41422d0 con 0x7fb2d40b3bd0 2020-04-22T14:03:13.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.457+0000 7fb2d8993700 1 --2- 172.21.15.103:0/3828290789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2d40b3bd0 0x7fb2d41554e0 secure :-1 s=THROTTLE_DONE pgs=272 cs=0 l=1 rx=0x7fb2d4141be0 tx=0x7fb2c40109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.457+0000 7fb2dabf7700 1 -- 172.21.15.103:0/3828290789 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2d4142580 con 0x7fb2d40b3bd0 2020-04-22T14:03:13.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.457+0000 7fb2d1ffb700 1 -- 172.21.15.103:0/3828290789 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fb2c40064c0 con 0x7fb2d40b3bd0 2020-04-22T14:03:13.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.457+0000 7fb2d8993700 1 --2- 172.21.15.103:0/3828290789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2d40b3bd0 0x7fb2d41554e0 secure :-1 s=THROTTLE_DONE pgs=272 cs=0 l=1 rx=0x7fb2d4141be0 tx=0x7fb2c40109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.457+0000 7fb2d1ffb700 1 --2- 172.21.15.103:0/3828290789 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb2b004da60 0x7fb2b004ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:13.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.457+0000 7fb2d1ffb700 1 -- 172.21.15.103:0/3828290789 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb2c4060f80 con 0x7fb2d40b3bd0 2020-04-22T14:03:13.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.458+0000 7fb2d3fff700 1 --2- 172.21.15.103:0/3828290789 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb2b004da60 0x7fb2b004ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:13.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.458+0000 7fb2d3fff700 1 --2- 172.21.15.103:0/3828290789 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb2b004da60 0x7fb2b004ff20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb2d4067530 tx=0x7fb2c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.458+0000 7fb2d3fff700 1 --2- 172.21.15.103:0/3828290789 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb2b004da60 0x7fb2b004ff20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb2d4067530 tx=0x7fb2c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.458+0000 7fb2d3fff700 1 --2- 172.21.15.103:0/3828290789 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb2b004da60 0x7fb2b004ff20 secure :-1 s=READY pgs=119 cs=0 l=1 rx=0x7fb2d4067530 tx=0x7fb2c0007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:13.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.461+0000 7fb2d8993700 1 --2- 172.21.15.103:0/3828290789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2d40b3bd0 0x7fb2d41554e0 secure :-1 s=THROTTLE_DONE pgs=272 cs=0 l=1 rx=0x7fb2d4141be0 tx=0x7fb2c40109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.461+0000 7fb2d1ffb700 1 -- 172.21.15.103:0/3828290789 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fb2c403c360 con 0x7fb2d40b3bd0 2020-04-22T14:03:13.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.601+0000 7fb2dabf7700 1 -- 172.21.15.103:0/3828290789 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb2d4056c90 con 0x7fb2d40b3bd0 2020-04-22T14:03:13.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.601+0000 7fb2d8993700 1 --2- 172.21.15.103:0/3828290789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2d40b3bd0 0x7fb2d41554e0 secure :-1 s=THROTTLE_DONE pgs=272 cs=0 l=1 rx=0x7fb2d4141be0 tx=0x7fb2c40109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.601+0000 7fb2d1ffb700 1 -- 172.21.15.103:0/3828290789 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v24) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb2c403f980 con 0x7fb2d40b3bd0 2020-04-22T14:03:13.653 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:03:13.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.603+0000 7fb2dabf7700 1 -- 172.21.15.103:0/3828290789 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb2b004da60 msgr2=0x7fb2b004ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:13.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.603+0000 7fb2dabf7700 1 --2- 172.21.15.103:0/3828290789 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb2b004da60 0x7fb2b004ff20 secure :-1 s=READY pgs=119 cs=0 l=1 rx=0x7fb2d4067530 tx=0x7fb2c0007a40).stop 2020-04-22T14:03:13.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.603+0000 7fb2dabf7700 1 -- 172.21.15.103:0/3828290789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2d40b3bd0 msgr2=0x7fb2d41554e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:13.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.603+0000 7fb2dabf7700 1 --2- 172.21.15.103:0/3828290789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2d40b3bd0 0x7fb2d41554e0 secure :-1 s=READY pgs=272 cs=0 l=1 rx=0x7fb2d4141be0 tx=0x7fb2c40109f0).stop 2020-04-22T14:03:13.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.603+0000 7fb2dabf7700 1 -- 172.21.15.103:0/3828290789 shutdown_connections 2020-04-22T14:03:13.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.603+0000 7fb2dabf7700 1 --2- 172.21.15.103:0/3828290789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2d40b3bd0 0x7fb2d41554e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:13.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.603+0000 7fb2dabf7700 1 --2- 172.21.15.103:0/3828290789 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb2b004da60 0x7fb2b004ff20 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:13.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.603+0000 7fb2dabf7700 1 --2- 172.21.15.103:0/3828290789 >> v2:172.21.15.86:3300/0 conn(0x7fb2d40b9140 0x7fb2d4155940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:13.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.603+0000 7fb2dabf7700 1 -- 172.21.15.103:0/3828290789 >> 172.21.15.103:0/3828290789 conn(0x7fb2d405b7b0 msgr2=0x7fb2d40b0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:13.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.603+0000 7fb2dabf7700 1 -- 172.21.15.103:0/3828290789 shutdown_connections 2020-04-22T14:03:13.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.603+0000 7fb2dabf7700 1 -- 172.21.15.103:0/3828290789 wait complete. 2020-04-22T14:03:13.657 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:13.672 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:03:13.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.820+0000 7f591f7c5700 1 Processor -- start 2020-04-22T14:03:13.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.821+0000 7f591f7c5700 1 -- start start 2020-04-22T14:03:13.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.821+0000 7f591f7c5700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f59180b9140 0x7f59180aed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:13.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.821+0000 7f591f7c5700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59180b3bd0 0x7f59180af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:13.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.821+0000 7f591f7c5700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5918148310 con 0x7f59180616b0 2020-04-22T14:03:13.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.821+0000 7f591f7c5700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59180af650 con 0x7f59180b9140 2020-04-22T14:03:13.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.821+0000 7f591f7c5700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59181485b0 con 0x7f59180b3bd0 2020-04-22T14:03:13.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.822+0000 7f591d561700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f59180b9140 0x7f59180aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:13.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.822+0000 7f591d561700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f59180b9140 0x7f59180aed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48048/0 (socket says 172.21.15.103:48048) 2020-04-22T14:03:13.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.822+0000 7f591d561700 1 -- 172.21.15.103:0/40185117 learned_addr learned my addr 172.21.15.103:0/40185117 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:13.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.822+0000 7f591cd60700 1 --2- 172.21.15.103:0/40185117 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59180b3bd0 0x7f59180af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:13.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.822+0000 7f591d561700 1 -- 172.21.15.103:0/40185117 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59180b3bd0 msgr2=0x7f59180af1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:13.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.822+0000 7f591d561700 1 --2- 172.21.15.103:0/40185117 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59180b3bd0 0x7f59180af1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:13.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.822+0000 7f591d561700 1 -- 172.21.15.103:0/40185117 >> v1:172.21.15.86:6789/0 conn(0x7f59180616b0 legacy=0x7f5918061b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:13.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.822+0000 7f591d561700 1 -- 172.21.15.103:0/40185117 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59180b9520 con 0x7f59180b9140 2020-04-22T14:03:13.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.822+0000 7f591d561700 1 --2- 172.21.15.103:0/40185117 >> v2:172.21.15.103:3300/0 conn(0x7f59180b9140 0x7f59180aed90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f59180b6250 tx=0x7f5914007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.822+0000 7f591d561700 1 --2- 172.21.15.103:0/40185117 >> v2:172.21.15.103:3300/0 conn(0x7f59180b9140 0x7f59180aed90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f59180b6250 tx=0x7f5914007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.822+0000 7f591d561700 1 --2- 172.21.15.103:0/40185117 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59180b9140 0x7f59180aed90 secure :-1 s=READY pgs=273 cs=0 l=1 rx=0x7f59180b6250 tx=0x7f5914007a40).ready entity=mon.1 client_cookie=a1a9164741497889 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:13.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.822+0000 7f591d561700 1 --2- 172.21.15.103:0/40185117 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59180b9140 0x7f59180aed90 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7f59180b6250 tx=0x7f5914007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.822+0000 7f590bfff700 1 -- 172.21.15.103:0/40185117 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59140116e0 con 0x7f59180b9140 2020-04-22T14:03:13.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.822+0000 7f591d561700 1 --2- 172.21.15.103:0/40185117 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59180b9140 0x7f59180aed90 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7f59180b6250 tx=0x7f5914007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.822+0000 7f590bfff700 1 -- 172.21.15.103:0/40185117 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5914011840 con 0x7f59180b9140 2020-04-22T14:03:13.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.822+0000 7f591d561700 1 --2- 172.21.15.103:0/40185117 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59180b9140 0x7f59180aed90 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7f59180b6250 tx=0x7f5914007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.822+0000 7f590bfff700 1 -- 172.21.15.103:0/40185117 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5914011c60 con 0x7f59180b9140 2020-04-22T14:03:13.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.822+0000 7f591f7c5700 1 -- 172.21.15.103:0/40185117 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59180b9140 msgr2=0x7f59180aed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:13.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.822+0000 7f591f7c5700 1 --2- 172.21.15.103:0/40185117 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59180b9140 0x7f59180aed90 secure :-1 s=READY pgs=273 cs=0 l=1 rx=0x7f59180b6250 tx=0x7f5914007a40).stop 2020-04-22T14:03:13.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.823+0000 7f591f7c5700 1 -- 172.21.15.103:0/40185117 shutdown_connections 2020-04-22T14:03:13.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.823+0000 7f591f7c5700 1 --2- 172.21.15.103:0/40185117 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59180b9140 0x7f59180aed90 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:13.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.823+0000 7f591f7c5700 1 --2- 172.21.15.103:0/40185117 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59180b3bd0 0x7f59180af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:13.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.823+0000 7f591f7c5700 1 -- 172.21.15.103:0/40185117 >> 172.21.15.103:0/40185117 conn(0x7f591805b7b0 msgr2=0x7f59180b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:13.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.823+0000 7f591f7c5700 1 -- 172.21.15.103:0/40185117 shutdown_connections 2020-04-22T14:03:13.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.823+0000 7f591f7c5700 1 -- 172.21.15.103:0/40185117 wait complete. 2020-04-22T14:03:13.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.824+0000 7f591f7c5700 1 Processor -- start 2020-04-22T14:03:13.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.824+0000 7f591f7c5700 1 -- start start 2020-04-22T14:03:13.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.824+0000 7f591f7c5700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f59180616b0 0x7f591813fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:13.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.824+0000 7f591f7c5700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5918140050 con 0x7f59180b3bd0 2020-04-22T14:03:13.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.824+0000 7f591f7c5700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5918144eb0 con 0x7f59180b9140 2020-04-22T14:03:13.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.824+0000 7f591f7c5700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5918145150 con 0x7f59180616b0 2020-04-22T14:03:13.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.825+0000 7f591dd62700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f59180b9140 0x7f59181455f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40246/0 (socket says 172.21.15.103:40246) 2020-04-22T14:03:13.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.825+0000 7f591dd62700 1 -- 172.21.15.103:0/3221662479 learned_addr learned my addr 172.21.15.103:0/3221662479 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:13.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.825+0000 7f591d561700 1 --2- 172.21.15.103:0/3221662479 >> v2:172.21.15.86:3300/0 conn(0x7f59180616b0 0x7f591813fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:13.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.825+0000 7f590a7fc700 1 -- 172.21.15.103:0/3221662479 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3476709418 0 0) 0x7f5918144eb0 con 0x7f59180b9140 2020-04-22T14:03:13.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.825+0000 7f590a7fc700 1 -- 172.21.15.103:0/3221662479 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58f8002fe0 con 0x7f59180b9140 2020-04-22T14:03:13.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.825+0000 7f591d561700 1 -- 172.21.15.103:0/3221662479 >> v1:172.21.15.103:6789/0 conn(0x7f59180b9140 legacy=0x7f59181455f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:13.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.825+0000 7f591d561700 1 -- 172.21.15.103:0/3221662479 >> v1:172.21.15.86:6789/0 conn(0x7f59180b3bd0 legacy=0x7f5918139270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:13.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.825+0000 7f590a7fc700 1 -- 172.21.15.103:0/3221662479 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4246005023 0 0) 0x7f5918140050 con 0x7f59180b3bd0 2020-04-22T14:03:13.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.825+0000 7f591d561700 1 -- 172.21.15.103:0/3221662479 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5918139980 con 0x7f59180616b0 2020-04-22T14:03:13.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.825+0000 7f591d561700 1 --2- 172.21.15.103:0/3221662479 >> v2:172.21.15.86:3300/0 conn(0x7f59180616b0 0x7f591813fad0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5910001820 tx=0x7f5914007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.825+0000 7f591d561700 1 --2- 172.21.15.103:0/3221662479 >> v2:172.21.15.86:3300/0 conn(0x7f59180616b0 0x7f591813fad0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5910001820 tx=0x7f5914007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.825+0000 7f591d561700 1 --2- 172.21.15.103:0/3221662479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59180616b0 0x7f591813fad0 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7f5910001820 tx=0x7f5914007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:13.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.825+0000 7f591d561700 1 --2- 172.21.15.103:0/3221662479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59180616b0 0x7f591813fad0 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f5910001820 tx=0x7f5914007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.825+0000 7f590a7fc700 1 -- 172.21.15.103:0/3221662479 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5914007170 con 0x7f59180616b0 2020-04-22T14:03:13.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.825+0000 7f591d561700 1 --2- 172.21.15.103:0/3221662479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59180616b0 0x7f591813fad0 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f5910001820 tx=0x7f5914007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.825+0000 7f590a7fc700 1 -- 172.21.15.103:0/3221662479 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59140072d0 con 0x7f59180616b0 2020-04-22T14:03:13.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.825+0000 7f591d561700 1 --2- 172.21.15.103:0/3221662479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59180616b0 0x7f591813fad0 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f5910001820 tx=0x7f5914007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.825+0000 7f591f7c5700 1 -- 172.21.15.103:0/3221662479 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5918145d00 con 0x7f59180616b0 2020-04-22T14:03:13.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.825+0000 7f590a7fc700 1 -- 172.21.15.103:0/3221662479 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59140056c0 con 0x7f59180616b0 2020-04-22T14:03:13.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.826+0000 7f591f7c5700 1 -- 172.21.15.103:0/3221662479 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59180b26a0 con 0x7f59180616b0 2020-04-22T14:03:13.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.826+0000 7f591d561700 1 --2- 172.21.15.103:0/3221662479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59180616b0 0x7f591813fad0 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f5910001820 tx=0x7f5914007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.826+0000 7f591f7c5700 1 -- 172.21.15.103:0/3221662479 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5918056c90 con 0x7f59180616b0 2020-04-22T14:03:13.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.827+0000 7f590a7fc700 1 -- 172.21.15.103:0/3221662479 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f59140058c0 con 0x7f59180616b0 2020-04-22T14:03:13.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.827+0000 7f591d561700 1 --2- 172.21.15.103:0/3221662479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59180616b0 0x7f591813fad0 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f5910001820 tx=0x7f5914007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.827+0000 7f590a7fc700 1 --2- 172.21.15.103:0/3221662479 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f58f804dc10 0x7f58f80500d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:13.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.827+0000 7f590a7fc700 1 -- 172.21.15.103:0/3221662479 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5914061b30 con 0x7f59180616b0 2020-04-22T14:03:13.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.827+0000 7f591cd60700 1 --2- 172.21.15.103:0/3221662479 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f58f804dc10 0x7f58f80500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:13.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.827+0000 7f591cd60700 1 --2- 172.21.15.103:0/3221662479 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f58f804dc10 0x7f58f80500d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f590c003070 tx=0x7f590c002490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.827+0000 7f591cd60700 1 --2- 172.21.15.103:0/3221662479 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f58f804dc10 0x7f58f80500d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f590c003070 tx=0x7f590c002490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.827+0000 7f591cd60700 1 --2- 172.21.15.103:0/3221662479 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f58f804dc10 0x7f58f80500d0 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7f590c003070 tx=0x7f590c002490).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:13.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.831+0000 7f591d561700 1 --2- 172.21.15.103:0/3221662479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59180616b0 0x7f591813fad0 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f5910001820 tx=0x7f5914007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.831+0000 7f590a7fc700 1 -- 172.21.15.103:0/3221662479 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f591403d030 con 0x7f59180616b0 2020-04-22T14:03:13.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.971+0000 7f591f7c5700 1 -- 172.21.15.103:0/3221662479 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f59180b6f30 con 0x7f59180616b0 2020-04-22T14:03:13.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.972+0000 7f591d561700 1 --2- 172.21.15.103:0/3221662479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59180616b0 0x7f591813fad0 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f5910001820 tx=0x7f5914007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:13.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.972+0000 7f590a7fc700 1 -- 172.21.15.103:0/3221662479 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5914040650 con 0x7f59180616b0 2020-04-22T14:03:13.974 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:03:13.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.973+0000 7f591f7c5700 1 -- 172.21.15.103:0/3221662479 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f58f804dc10 msgr2=0x7f58f80500d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:13.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.973+0000 7f591f7c5700 1 --2- 172.21.15.103:0/3221662479 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f58f804dc10 0x7f58f80500d0 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7f590c003070 tx=0x7f590c002490).stop 2020-04-22T14:03:13.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.973+0000 7f591f7c5700 1 -- 172.21.15.103:0/3221662479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59180616b0 msgr2=0x7f591813fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:13.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.973+0000 7f591f7c5700 1 --2- 172.21.15.103:0/3221662479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59180616b0 0x7f591813fad0 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7f5910001820 tx=0x7f5914007a40).stop 2020-04-22T14:03:13.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.973+0000 7f591f7c5700 1 -- 172.21.15.103:0/3221662479 shutdown_connections 2020-04-22T14:03:13.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.973+0000 7f591f7c5700 1 --2- 172.21.15.103:0/3221662479 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f58f804dc10 0x7f58f80500d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:13.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.973+0000 7f591f7c5700 1 --2- 172.21.15.103:0/3221662479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59180616b0 0x7f591813fad0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:13.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.973+0000 7f591f7c5700 1 -- 172.21.15.103:0/3221662479 >> 172.21.15.103:0/3221662479 conn(0x7f591805b7b0 msgr2=0x7f59180b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:13.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.973+0000 7f591f7c5700 1 -- 172.21.15.103:0/3221662479 shutdown_connections 2020-04-22T14:03:13.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:13.973+0000 7f591f7c5700 1 -- 172.21.15.103:0/3221662479 wait complete. 2020-04-22T14:03:13.985 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:14.000 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-22T14:03:14.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.146+0000 7f696328c700 1 Processor -- start 2020-04-22T14:03:14.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.146+0000 7f696328c700 1 -- start start 2020-04-22T14:03:14.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.147+0000 7f696328c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f695c0ac950 0x7f695c146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:14.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.147+0000 7f696328c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f695c1470a0 0x7f695c143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:14.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.147+0000 7f696328c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f695c1467e0 con 0x7f695c0b9140 2020-04-22T14:03:14.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.147+0000 7f696328c700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f695c0602f0 con 0x7f695c0ac950 2020-04-22T14:03:14.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.147+0000 7f696328c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f695c060050 con 0x7f695c1470a0 2020-04-22T14:03:14.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.147+0000 7f6960827700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f695c0ac950 0x7f695c146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:14.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.147+0000 7f6961028700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f695c0b9140 0x7f695c12b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40250/0 (socket says 172.21.15.103:40250) 2020-04-22T14:03:14.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.147+0000 7f6960827700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f695c0ac950 0x7f695c146c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48064/0 (socket says 172.21.15.103:48064) 2020-04-22T14:03:14.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.147+0000 7f6961028700 1 -- 172.21.15.103:0/1514728524 learned_addr learned my addr 172.21.15.103:0/1514728524 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:14.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.147+0000 7f6961829700 1 --2- 172.21.15.103:0/1514728524 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f695c1470a0 0x7f695c143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:14.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.147+0000 7f6960827700 1 -- 172.21.15.103:0/1514728524 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f695c1470a0 msgr2=0x7f695c143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:14.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.147+0000 7f6960827700 1 --2- 172.21.15.103:0/1514728524 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f695c1470a0 0x7f695c143090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:14.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.147+0000 7f694bfff700 1 -- 172.21.15.103:0/1514728524 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 585174272 0 0) 0x7f695c1467e0 con 0x7f695c0b9140 2020-04-22T14:03:14.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.147+0000 7f6960827700 1 -- 172.21.15.103:0/1514728524 >> v1:172.21.15.103:6789/0 conn(0x7f695c0b9140 legacy=0x7f695c12b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:14.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.147+0000 7f6960827700 1 -- 172.21.15.103:0/1514728524 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695c0b9520 con 0x7f695c0ac950 2020-04-22T14:03:14.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.147+0000 7f6961829700 1 --2- 172.21.15.103:0/1514728524 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f695c1470a0 0x7f695c143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:03:14.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.147+0000 7f6960827700 1 --2- 172.21.15.103:0/1514728524 >> v2:172.21.15.103:3300/0 conn(0x7f695c0ac950 0x7f695c146c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f694c002f30 tx=0x7f694c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.147+0000 7f6960827700 1 --2- 172.21.15.103:0/1514728524 >> v2:172.21.15.103:3300/0 conn(0x7f695c0ac950 0x7f695c146c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f694c002f30 tx=0x7f694c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.147+0000 7f6960827700 1 --2- 172.21.15.103:0/1514728524 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f695c0ac950 0x7f695c146c40 secure :-1 s=READY pgs=276 cs=0 l=1 rx=0x7f694c002f30 tx=0x7f694c007a40).ready entity=mon.1 client_cookie=9537618478eb6267 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:14.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.147+0000 7f6960827700 1 --2- 172.21.15.103:0/1514728524 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f695c0ac950 0x7f695c146c40 secure :-1 s=THROTTLE_DONE pgs=276 cs=0 l=1 rx=0x7f694c002f30 tx=0x7f694c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.147+0000 7f694bfff700 1 -- 172.21.15.103:0/1514728524 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f694c011470 con 0x7f695c0ac950 2020-04-22T14:03:14.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.147+0000 7f6960827700 1 --2- 172.21.15.103:0/1514728524 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f695c0ac950 0x7f695c146c40 secure :-1 s=THROTTLE_DONE pgs=276 cs=0 l=1 rx=0x7f694c002f30 tx=0x7f694c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.147+0000 7f6960827700 1 --2- 172.21.15.103:0/1514728524 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f695c0ac950 0x7f695c146c40 secure :-1 s=THROTTLE_DONE pgs=276 cs=0 l=1 rx=0x7f694c002f30 tx=0x7f694c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.147+0000 7f694bfff700 1 -- 172.21.15.103:0/1514728524 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694c011610 con 0x7f695c0ac950 2020-04-22T14:03:14.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.147+0000 7f694bfff700 1 -- 172.21.15.103:0/1514728524 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f694c0119f0 con 0x7f695c0ac950 2020-04-22T14:03:14.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.147+0000 7f696328c700 1 -- 172.21.15.103:0/1514728524 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f695c0ac950 msgr2=0x7f695c146c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:14.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.147+0000 7f696328c700 1 --2- 172.21.15.103:0/1514728524 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f695c0ac950 0x7f695c146c40 secure :-1 s=READY pgs=276 cs=0 l=1 rx=0x7f694c002f30 tx=0x7f694c007a40).stop 2020-04-22T14:03:14.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.148+0000 7f696328c700 1 -- 172.21.15.103:0/1514728524 shutdown_connections 2020-04-22T14:03:14.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.148+0000 7f696328c700 1 --2- 172.21.15.103:0/1514728524 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f695c1470a0 0x7f695c143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:14.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.148+0000 7f696328c700 1 --2- 172.21.15.103:0/1514728524 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f695c0ac950 0x7f695c146c40 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:14.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.148+0000 7f696328c700 1 -- 172.21.15.103:0/1514728524 >> 172.21.15.103:0/1514728524 conn(0x7f695c05b7b0 msgr2=0x7f695c0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:14.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.148+0000 7f696328c700 1 -- 172.21.15.103:0/1514728524 shutdown_connections 2020-04-22T14:03:14.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.148+0000 7f696328c700 1 -- 172.21.15.103:0/1514728524 wait complete. 2020-04-22T14:03:14.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.149+0000 7f696328c700 1 Processor -- start 2020-04-22T14:03:14.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.149+0000 7f696328c700 1 -- start start 2020-04-22T14:03:14.162 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.150+0000 7f696328c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f695c0b9140 0x7f695c063000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:14.162 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.150+0000 7f696328c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f695c1470a0 0x7f695c0b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:14.162 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.150+0000 7f696328c700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f695c14ccd0 con 0x7f695c0ac950 2020-04-22T14:03:14.162 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.150+0000 7f696328c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f695c063460 con 0x7f695c0b9140 2020-04-22T14:03:14.162 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.150+0000 7f696328c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f695c14d980 con 0x7f695c1470a0 2020-04-22T14:03:14.162 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.150+0000 7f6961829700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f695c1470a0 0x7f695c0b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:14.162 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.150+0000 7f6960827700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f695c0b9140 0x7f695c063000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:14.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.150+0000 7f6961028700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f695c0ac950 0x7f695c145b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:57412/0 (socket says 172.21.15.103:57412) 2020-04-22T14:03:14.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.150+0000 7f6961028700 1 -- 172.21.15.103:0/1892781762 learned_addr learned my addr 172.21.15.103:0/1892781762 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:14.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.150+0000 7f6960827700 1 -- 172.21.15.103:0/1892781762 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f695c1470a0 msgr2=0x7f695c0b0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:14.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.150+0000 7f6960827700 1 --2- 172.21.15.103:0/1892781762 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f695c1470a0 0x7f695c0b0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:14.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.150+0000 7f6960827700 1 -- 172.21.15.103:0/1892781762 >> v1:172.21.15.86:6789/0 conn(0x7f695c0ac950 legacy=0x7f695c145b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:14.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.150+0000 7f694a7fc700 1 -- 172.21.15.103:0/1892781762 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2109827089 0 0) 0x7f695c14ccd0 con 0x7f695c0ac950 2020-04-22T14:03:14.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.150+0000 7f6960827700 1 -- 172.21.15.103:0/1892781762 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695c14dc20 con 0x7f695c0b9140 2020-04-22T14:03:14.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.150+0000 7f6960827700 1 --2- 172.21.15.103:0/1892781762 >> v2:172.21.15.86:3300/0 conn(0x7f695c0b9140 0x7f695c063000 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f694c002f30 tx=0x7f694c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.150+0000 7f6960827700 1 --2- 172.21.15.103:0/1892781762 >> v2:172.21.15.86:3300/0 conn(0x7f695c0b9140 0x7f695c063000 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f694c002f30 tx=0x7f694c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.150+0000 7f6960827700 1 --2- 172.21.15.103:0/1892781762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f695c0b9140 0x7f695c063000 secure :-1 s=READY pgs=182 cs=0 l=1 rx=0x7f694c002f30 tx=0x7f694c007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:14.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.151+0000 7f6960827700 1 --2- 172.21.15.103:0/1892781762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f695c0b9140 0x7f695c063000 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f694c002f30 tx=0x7f694c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.151+0000 7f694a7fc700 1 -- 172.21.15.103:0/1892781762 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f694c007170 con 0x7f695c0b9140 2020-04-22T14:03:14.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.151+0000 7f6960827700 1 --2- 172.21.15.103:0/1892781762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f695c0b9140 0x7f695c063000 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f694c002f30 tx=0x7f694c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.151+0000 7f6960827700 1 --2- 172.21.15.103:0/1892781762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f695c0b9140 0x7f695c063000 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f694c002f30 tx=0x7f694c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.151+0000 7f694a7fc700 1 -- 172.21.15.103:0/1892781762 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694c0072d0 con 0x7f695c0b9140 2020-04-22T14:03:14.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.151+0000 7f696328c700 1 -- 172.21.15.103:0/1892781762 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f695c14c950 con 0x7f695c0b9140 2020-04-22T14:03:14.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.151+0000 7f694a7fc700 1 -- 172.21.15.103:0/1892781762 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f694c0056c0 con 0x7f695c0b9140 2020-04-22T14:03:14.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.151+0000 7f696328c700 1 -- 172.21.15.103:0/1892781762 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f695c065e20 con 0x7f695c0b9140 2020-04-22T14:03:14.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.151+0000 7f6960827700 1 --2- 172.21.15.103:0/1892781762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f695c0b9140 0x7f695c063000 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f694c002f30 tx=0x7f694c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.152+0000 7f696328c700 1 -- 172.21.15.103:0/1892781762 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f695c056c90 con 0x7f695c0b9140 2020-04-22T14:03:14.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.152+0000 7f694a7fc700 1 -- 172.21.15.103:0/1892781762 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f694c0058f0 con 0x7f695c0b9140 2020-04-22T14:03:14.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.152+0000 7f6960827700 1 --2- 172.21.15.103:0/1892781762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f695c0b9140 0x7f695c063000 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f694c002f30 tx=0x7f694c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.152+0000 7f694a7fc700 1 --2- 172.21.15.103:0/1892781762 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f693c04d8d0 0x7f693c04fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:14.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.152+0000 7f694a7fc700 1 -- 172.21.15.103:0/1892781762 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f694c061b00 con 0x7f695c0b9140 2020-04-22T14:03:14.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.152+0000 7f6961028700 1 --2- 172.21.15.103:0/1892781762 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f693c04d8d0 0x7f693c04fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:14.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.153+0000 7f6961028700 1 --2- 172.21.15.103:0/1892781762 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f693c04d8d0 0x7f693c04fd90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f69540015e0 tx=0x7f6954001aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.153+0000 7f6961028700 1 --2- 172.21.15.103:0/1892781762 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f693c04d8d0 0x7f693c04fd90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f69540015e0 tx=0x7f6954001aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.153+0000 7f6961028700 1 --2- 172.21.15.103:0/1892781762 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f693c04d8d0 0x7f693c04fd90 secure :-1 s=READY pgs=121 cs=0 l=1 rx=0x7f69540015e0 tx=0x7f6954001aa0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:14.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.156+0000 7f6960827700 1 --2- 172.21.15.103:0/1892781762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f695c0b9140 0x7f695c063000 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f694c002f30 tx=0x7f694c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.156+0000 7f694a7fc700 1 -- 172.21.15.103:0/1892781762 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f694c03d000 con 0x7f695c0b9140 2020-04-22T14:03:14.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.298+0000 7f696328c700 1 -- 172.21.15.103:0/1892781762 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f695c14cae0 con 0x7f695c0b9140 2020-04-22T14:03:14.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.299+0000 7f6960827700 1 --2- 172.21.15.103:0/1892781762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f695c0b9140 0x7f695c063000 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f694c002f30 tx=0x7f694c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.299+0000 7f694a7fc700 1 -- 172.21.15.103:0/1892781762 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7f694c040620 con 0x7f695c0b9140 2020-04-22T14:03:14.301 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:03:14.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.300+0000 7f696328c700 1 -- 172.21.15.103:0/1892781762 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f693c04d8d0 msgr2=0x7f693c04fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:14.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.300+0000 7f696328c700 1 --2- 172.21.15.103:0/1892781762 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f693c04d8d0 0x7f693c04fd90 secure :-1 s=READY pgs=121 cs=0 l=1 rx=0x7f69540015e0 tx=0x7f6954001aa0).stop 2020-04-22T14:03:14.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.300+0000 7f696328c700 1 -- 172.21.15.103:0/1892781762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f695c0b9140 msgr2=0x7f695c063000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:14.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.300+0000 7f696328c700 1 --2- 172.21.15.103:0/1892781762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f695c0b9140 0x7f695c063000 secure :-1 s=READY pgs=182 cs=0 l=1 rx=0x7f694c002f30 tx=0x7f694c007a40).stop 2020-04-22T14:03:14.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.300+0000 7f696328c700 1 -- 172.21.15.103:0/1892781762 shutdown_connections 2020-04-22T14:03:14.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.300+0000 7f696328c700 1 --2- 172.21.15.103:0/1892781762 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f695c1470a0 0x7f695c0b0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:14.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.300+0000 7f696328c700 1 --2- 172.21.15.103:0/1892781762 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f693c04d8d0 0x7f693c04fd90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:14.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.300+0000 7f696328c700 1 --2- 172.21.15.103:0/1892781762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f695c0b9140 0x7f695c063000 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:14.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.300+0000 7f696328c700 1 -- 172.21.15.103:0/1892781762 >> 172.21.15.103:0/1892781762 conn(0x7f695c05b7b0 msgr2=0x7f695c0612f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:14.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.300+0000 7f696328c700 1 -- 172.21.15.103:0/1892781762 shutdown_connections 2020-04-22T14:03:14.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.301+0000 7f696328c700 1 -- 172.21.15.103:0/1892781762 wait complete. 2020-04-22T14:03:14.312 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:14.326 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-22T14:03:14.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.475+0000 7fa88eb32700 1 Processor -- start 2020-04-22T14:03:14.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.475+0000 7fa88eb32700 1 -- start start 2020-04-22T14:03:14.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.475+0000 7fa88eb32700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8880b9140 0x7fa8880b4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:14.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.476+0000 7fa88eb32700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa8880af390 0x7fa888061f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:14.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.476+0000 7fa88eb32700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa88814ddb0 0x7fa88814e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:14.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.476+0000 7fa88eb32700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8880b49d0 con 0x7fa88814ddb0 2020-04-22T14:03:14.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.476+0000 7fa88eb32700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa888061830 con 0x7fa8880af390 2020-04-22T14:03:14.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.476+0000 7fa88eb32700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa888061ad0 con 0x7fa8880b9140 2020-04-22T14:03:14.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.476+0000 7fa87ffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa8880af390 0x7fa888061f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:14.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.476+0000 7fa87ffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa8880af390 0x7fa888061f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48076/0 (socket says 172.21.15.103:48076) 2020-04-22T14:03:14.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.476+0000 7fa87ffff700 1 -- 172.21.15.103:0/712733874 learned_addr learned my addr 172.21.15.103:0/712733874 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:14.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.476+0000 7fa88d0cf700 1 --2- 172.21.15.103:0/712733874 >> v2:172.21.15.86:3300/0 conn(0x7fa88814ddb0 0x7fa88814e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:14.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.476+0000 7fa87ffff700 1 -- 172.21.15.103:0/712733874 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8880b9140 msgr2=0x7fa8880b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:14.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.476+0000 7fa88c8ce700 1 --2- 172.21.15.103:0/712733874 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8880b9140 0x7fa8880b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:14.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.476+0000 7fa87ffff700 1 --2- 172.21.15.103:0/712733874 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8880b9140 0x7fa8880b4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:14.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.476+0000 7fa87ffff700 1 -- 172.21.15.103:0/712733874 >> v2:172.21.15.86:3300/0 conn(0x7fa88814ddb0 msgr2=0x7fa88814e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:14.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.476+0000 7fa87ffff700 1 --2- 172.21.15.103:0/712733874 >> v2:172.21.15.86:3300/0 conn(0x7fa88814ddb0 0x7fa88814e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:14.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.476+0000 7fa87ffff700 1 -- 172.21.15.103:0/712733874 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8880b9520 con 0x7fa8880af390 2020-04-22T14:03:14.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.476+0000 7fa88d0cf700 1 --2- 172.21.15.103:0/712733874 >> v2:172.21.15.86:3300/0 conn(0x7fa88814ddb0 0x7fa88814e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:03:14.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.476+0000 7fa87ffff700 1 --2- 172.21.15.103:0/712733874 >> v2:172.21.15.103:3300/0 conn(0x7fa8880af390 0x7fa888061f70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa878002f30 tx=0x7fa878007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.476+0000 7fa87ffff700 1 --2- 172.21.15.103:0/712733874 >> v2:172.21.15.103:3300/0 conn(0x7fa8880af390 0x7fa888061f70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa878002f30 tx=0x7fa878007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.476+0000 7fa87ffff700 1 --2- 172.21.15.103:0/712733874 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8880af390 0x7fa888061f70 secure :-1 s=READY pgs=277 cs=0 l=1 rx=0x7fa878002f30 tx=0x7fa878007a40).ready entity=mon.1 client_cookie=6f550df3b4bb5d54 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:14.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.476+0000 7fa87ffff700 1 --2- 172.21.15.103:0/712733874 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8880af390 0x7fa888061f70 secure :-1 s=THROTTLE_DONE pgs=277 cs=0 l=1 rx=0x7fa878002f30 tx=0x7fa878007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.476+0000 7fa87ffff700 1 --2- 172.21.15.103:0/712733874 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8880af390 0x7fa888061f70 secure :-1 s=THROTTLE_DONE pgs=277 cs=0 l=1 rx=0x7fa878002f30 tx=0x7fa878007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.476+0000 7fa87f7fe700 1 -- 172.21.15.103:0/712733874 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa878011720 con 0x7fa8880af390 2020-04-22T14:03:14.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.476+0000 7fa87ffff700 1 --2- 172.21.15.103:0/712733874 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8880af390 0x7fa888061f70 secure :-1 s=THROTTLE_DONE pgs=277 cs=0 l=1 rx=0x7fa878002f30 tx=0x7fa878007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.476+0000 7fa87f7fe700 1 -- 172.21.15.103:0/712733874 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa878011880 con 0x7fa8880af390 2020-04-22T14:03:14.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.476+0000 7fa87f7fe700 1 -- 172.21.15.103:0/712733874 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa878011ca0 con 0x7fa8880af390 2020-04-22T14:03:14.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.476+0000 7fa88eb32700 1 -- 172.21.15.103:0/712733874 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8880af390 msgr2=0x7fa888061f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:14.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.476+0000 7fa88eb32700 1 --2- 172.21.15.103:0/712733874 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8880af390 0x7fa888061f70 secure :-1 s=READY pgs=277 cs=0 l=1 rx=0x7fa878002f30 tx=0x7fa878007a40).stop 2020-04-22T14:03:14.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.477+0000 7fa88eb32700 1 -- 172.21.15.103:0/712733874 shutdown_connections 2020-04-22T14:03:14.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.477+0000 7fa88eb32700 1 --2- 172.21.15.103:0/712733874 >> v2:172.21.15.86:3300/0 conn(0x7fa88814ddb0 0x7fa88814e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:14.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.477+0000 7fa88eb32700 1 --2- 172.21.15.103:0/712733874 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8880b9140 0x7fa8880b4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:14.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.477+0000 7fa88eb32700 1 --2- 172.21.15.103:0/712733874 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8880af390 0x7fa888061f70 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:14.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.477+0000 7fa88eb32700 1 -- 172.21.15.103:0/712733874 >> 172.21.15.103:0/712733874 conn(0x7fa88805b7b0 msgr2=0x7fa8880b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:14.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.477+0000 7fa88eb32700 1 -- 172.21.15.103:0/712733874 shutdown_connections 2020-04-22T14:03:14.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.477+0000 7fa88eb32700 1 -- 172.21.15.103:0/712733874 wait complete. 2020-04-22T14:03:14.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.478+0000 7fa88eb32700 1 Processor -- start 2020-04-22T14:03:14.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.478+0000 7fa88eb32700 1 -- start start 2020-04-22T14:03:14.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.479+0000 7fa88eb32700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8880af390 0x7fa8880b16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:14.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.479+0000 7fa88eb32700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa8880b9140 0x7fa8880b0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:14.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.479+0000 7fa88eb32700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8880b1e50 con 0x7fa88814ddb0 2020-04-22T14:03:14.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.479+0000 7fa88eb32700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8880b1c40 con 0x7fa8880b9140 2020-04-22T14:03:14.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.479+0000 7fa88eb32700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8881499c0 con 0x7fa8880af390 2020-04-22T14:03:14.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.479+0000 7fa87ffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa8880b9140 0x7fa8880b0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:14.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.479+0000 7fa88c8ce700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8880af390 0x7fa8880b16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:14.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.479+0000 7fa88d0cf700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fa88814ddb0 0x7fa888114ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:57428/0 (socket says 172.21.15.103:57428) 2020-04-22T14:03:14.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.479+0000 7fa87ffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa8880b9140 0x7fa8880b0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:45314/0 (socket says 172.21.15.103:45314) 2020-04-22T14:03:14.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.479+0000 7fa88d0cf700 1 -- 172.21.15.103:0/3704533011 learned_addr learned my addr 172.21.15.103:0/3704533011 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:14.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.479+0000 7fa87ffff700 1 -- 172.21.15.103:0/3704533011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8880af390 msgr2=0x7fa8880b16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:14.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.479+0000 7fa87ffff700 1 --2- 172.21.15.103:0/3704533011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8880af390 0x7fa8880b16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:14.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.479+0000 7fa87ffff700 1 -- 172.21.15.103:0/3704533011 >> v1:172.21.15.86:6789/0 conn(0x7fa88814ddb0 legacy=0x7fa888114ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:14.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.479+0000 7fa87dffb700 1 -- 172.21.15.103:0/3704533011 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2168146790 0 0) 0x7fa8880b1e50 con 0x7fa88814ddb0 2020-04-22T14:03:14.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.479+0000 7fa87ffff700 1 -- 172.21.15.103:0/3704533011 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8881151c0 con 0x7fa8880b9140 2020-04-22T14:03:14.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.479+0000 7fa87ffff700 1 --2- 172.21.15.103:0/3704533011 >> v2:172.21.15.86:3300/0 conn(0x7fa8880b9140 0x7fa8880b0780 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa878002f30 tx=0x7fa878007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.479+0000 7fa87ffff700 1 --2- 172.21.15.103:0/3704533011 >> v2:172.21.15.86:3300/0 conn(0x7fa8880b9140 0x7fa8880b0780 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa878002f30 tx=0x7fa878007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.479+0000 7fa87ffff700 1 --2- 172.21.15.103:0/3704533011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8880b9140 0x7fa8880b0780 secure :-1 s=READY pgs=184 cs=0 l=1 rx=0x7fa878002f30 tx=0x7fa878007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:14.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.480+0000 7fa87ffff700 1 --2- 172.21.15.103:0/3704533011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8880b9140 0x7fa8880b0780 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7fa878002f30 tx=0x7fa878007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.480+0000 7fa87dffb700 1 -- 172.21.15.103:0/3704533011 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa878011e50 con 0x7fa8880b9140 2020-04-22T14:03:14.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.480+0000 7fa87ffff700 1 --2- 172.21.15.103:0/3704533011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8880b9140 0x7fa8880b0780 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7fa878002f30 tx=0x7fa878007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.480+0000 7fa87dffb700 1 -- 172.21.15.103:0/3704533011 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa878007360 con 0x7fa8880b9140 2020-04-22T14:03:14.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.480+0000 7fa87ffff700 1 --2- 172.21.15.103:0/3704533011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8880b9140 0x7fa8880b0780 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7fa878002f30 tx=0x7fa878007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.480+0000 7fa87dffb700 1 -- 172.21.15.103:0/3704533011 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8780056c0 con 0x7fa8880b9140 2020-04-22T14:03:14.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.480+0000 7fa88eb32700 1 -- 172.21.15.103:0/3704533011 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa88814c210 con 0x7fa8880b9140 2020-04-22T14:03:14.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.480+0000 7fa88eb32700 1 -- 172.21.15.103:0/3704533011 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa888146710 con 0x7fa8880b9140 2020-04-22T14:03:14.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.480+0000 7fa87ffff700 1 --2- 172.21.15.103:0/3704533011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8880b9140 0x7fa8880b0780 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7fa878002f30 tx=0x7fa878007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.481+0000 7fa88eb32700 1 -- 172.21.15.103:0/3704533011 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa888056c90 con 0x7fa8880b9140 2020-04-22T14:03:14.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.481+0000 7fa87dffb700 1 -- 172.21.15.103:0/3704533011 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fa878005870 con 0x7fa8880b9140 2020-04-22T14:03:14.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.481+0000 7fa87ffff700 1 --2- 172.21.15.103:0/3704533011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8880b9140 0x7fa8880b0780 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7fa878002f30 tx=0x7fa878007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.481+0000 7fa87dffb700 1 --2- 172.21.15.103:0/3704533011 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa86804d930 0x7fa86804fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:14.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.481+0000 7fa87dffb700 1 -- 172.21.15.103:0/3704533011 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa878061c10 con 0x7fa8880b9140 2020-04-22T14:03:14.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.481+0000 7fa88c8ce700 1 --2- 172.21.15.103:0/3704533011 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa86804d930 0x7fa86804fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:14.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.481+0000 7fa88c8ce700 1 --2- 172.21.15.103:0/3704533011 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa86804d930 0x7fa86804fdf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa884002f30 tx=0x7fa8840076e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.481+0000 7fa88c8ce700 1 --2- 172.21.15.103:0/3704533011 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa86804d930 0x7fa86804fdf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa884002f30 tx=0x7fa8840076e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.481+0000 7fa88c8ce700 1 --2- 172.21.15.103:0/3704533011 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa86804d930 0x7fa86804fdf0 secure :-1 s=READY pgs=122 cs=0 l=1 rx=0x7fa884002f30 tx=0x7fa8840076e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:14.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.485+0000 7fa87ffff700 1 --2- 172.21.15.103:0/3704533011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8880b9140 0x7fa8880b0780 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7fa878002f30 tx=0x7fa878007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.485+0000 7fa87dffb700 1 -- 172.21.15.103:0/3704533011 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fa87803d0b0 con 0x7fa8880b9140 2020-04-22T14:03:14.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.625+0000 7fa88eb32700 1 -- 172.21.15.103:0/3704533011 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa888115530 con 0x7fa8880b9140 2020-04-22T14:03:14.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.625+0000 7fa87ffff700 1 --2- 172.21.15.103:0/3704533011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8880b9140 0x7fa8880b0780 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7fa878002f30 tx=0x7fa878007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.625+0000 7fa87dffb700 1 -- 172.21.15.103:0/3704533011 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7fa8780406d0 con 0x7fa8880b9140 2020-04-22T14:03:14.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.626+0000 7fa88eb32700 1 -- 172.21.15.103:0/3704533011 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa86804d930 msgr2=0x7fa86804fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:14.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.626+0000 7fa88eb32700 1 --2- 172.21.15.103:0/3704533011 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa86804d930 0x7fa86804fdf0 secure :-1 s=READY pgs=122 cs=0 l=1 rx=0x7fa884002f30 tx=0x7fa8840076e0).stop 2020-04-22T14:03:14.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.626+0000 7fa88eb32700 1 -- 172.21.15.103:0/3704533011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8880b9140 msgr2=0x7fa8880b0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:14.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.626+0000 7fa88eb32700 1 --2- 172.21.15.103:0/3704533011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8880b9140 0x7fa8880b0780 secure :-1 s=READY pgs=184 cs=0 l=1 rx=0x7fa878002f30 tx=0x7fa878007a40).stop 2020-04-22T14:03:14.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.626+0000 7fa88eb32700 1 -- 172.21.15.103:0/3704533011 shutdown_connections 2020-04-22T14:03:14.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.627+0000 7fa88eb32700 1 --2- 172.21.15.103:0/3704533011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8880af390 0x7fa8880b16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:14.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.627+0000 7fa88eb32700 1 --2- 172.21.15.103:0/3704533011 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa86804d930 0x7fa86804fdf0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:14.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.627+0000 7fa88eb32700 1 --2- 172.21.15.103:0/3704533011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8880b9140 0x7fa8880b0780 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:14.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.627+0000 7fa88eb32700 1 -- 172.21.15.103:0/3704533011 >> 172.21.15.103:0/3704533011 conn(0x7fa88805b7b0 msgr2=0x7fa8880b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:14.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.627+0000 7fa88eb32700 1 -- 172.21.15.103:0/3704533011 shutdown_connections 2020-04-22T14:03:14.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.627+0000 7fa88eb32700 1 -- 172.21.15.103:0/3704533011 wait complete. 2020-04-22T14:03:14.631 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:03:14.639 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:14.656 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:03:14.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.800+0000 7f7d293d1700 1 Processor -- start 2020-04-22T14:03:14.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.800+0000 7f7d293d1700 1 -- start start 2020-04-22T14:03:14.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.801+0000 7f7d293d1700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7d2412c0d0 0x7f7d241464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:14.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.801+0000 7f7d293d1700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7d24065fe0 0x7f7d2405b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:14.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.801+0000 7f7d293d1700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d24143300 con 0x7f7d2405b8a0 2020-04-22T14:03:14.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.801+0000 7f7d293d1700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d2412c4b0 con 0x7f7d24065fe0 2020-04-22T14:03:14.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.801+0000 7f7d293d1700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d241435a0 con 0x7f7d2412c0d0 2020-04-22T14:03:14.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.801+0000 7f7d227fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7d24065fe0 0x7f7d2405b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:14.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.801+0000 7f7d227fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7d24065fe0 0x7f7d2405b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48088/0 (socket says 172.21.15.103:48088) 2020-04-22T14:03:14.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.801+0000 7f7d227fc700 1 -- 172.21.15.103:0/1609228093 learned_addr learned my addr 172.21.15.103:0/1609228093 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:14.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.801+0000 7f7d237fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f7d2405b8a0 0x7f7d24062ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40278/0 (socket says 172.21.15.103:40278) 2020-04-22T14:03:14.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.801+0000 7f7d22ffd700 1 --2- 172.21.15.103:0/1609228093 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7d2412c0d0 0x7f7d241464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:14.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.802+0000 7f7d227fc700 1 -- 172.21.15.103:0/1609228093 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7d2412c0d0 msgr2=0x7f7d241464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:14.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.802+0000 7f7d227fc700 1 --2- 172.21.15.103:0/1609228093 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7d2412c0d0 0x7f7d241464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:14.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.802+0000 7f7d227fc700 1 -- 172.21.15.103:0/1609228093 >> v1:172.21.15.103:6789/0 conn(0x7f7d2405b8a0 legacy=0x7f7d24062ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:14.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.802+0000 7f7d227fc700 1 -- 172.21.15.103:0/1609228093 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d24143840 con 0x7f7d24065fe0 2020-04-22T14:03:14.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.802+0000 7f7d21ffb700 1 -- 172.21.15.103:0/1609228093 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3444895962 0 0) 0x7f7d24143300 con 0x7f7d2405b8a0 2020-04-22T14:03:14.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.802+0000 7f7d227fc700 1 --2- 172.21.15.103:0/1609228093 >> v2:172.21.15.103:3300/0 conn(0x7f7d24065fe0 0x7f7d2405b440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7d14002f30 tx=0x7f7d14007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.802+0000 7f7d227fc700 1 --2- 172.21.15.103:0/1609228093 >> v2:172.21.15.103:3300/0 conn(0x7f7d24065fe0 0x7f7d2405b440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7d14002f30 tx=0x7f7d14007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.802+0000 7f7d227fc700 1 --2- 172.21.15.103:0/1609228093 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d24065fe0 0x7f7d2405b440 secure :-1 s=READY pgs=279 cs=0 l=1 rx=0x7f7d14002f30 tx=0x7f7d14007a40).ready entity=mon.1 client_cookie=b77076ed136070dc server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:14.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.802+0000 7f7d227fc700 1 --2- 172.21.15.103:0/1609228093 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d24065fe0 0x7f7d2405b440 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7f7d14002f30 tx=0x7f7d14007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.802+0000 7f7d21ffb700 1 -- 172.21.15.103:0/1609228093 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d14013e20 con 0x7f7d24065fe0 2020-04-22T14:03:14.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.802+0000 7f7d227fc700 1 --2- 172.21.15.103:0/1609228093 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d24065fe0 0x7f7d2405b440 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7f7d14002f30 tx=0x7f7d14007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.802+0000 7f7d227fc700 1 --2- 172.21.15.103:0/1609228093 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d24065fe0 0x7f7d2405b440 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7f7d14002f30 tx=0x7f7d14007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.802+0000 7f7d21ffb700 1 -- 172.21.15.103:0/1609228093 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d1400c180 con 0x7f7d24065fe0 2020-04-22T14:03:14.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.802+0000 7f7d21ffb700 1 -- 172.21.15.103:0/1609228093 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d1400c520 con 0x7f7d24065fe0 2020-04-22T14:03:14.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.802+0000 7f7d293d1700 1 -- 172.21.15.103:0/1609228093 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d24065fe0 msgr2=0x7f7d2405b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:14.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.802+0000 7f7d293d1700 1 --2- 172.21.15.103:0/1609228093 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d24065fe0 0x7f7d2405b440 secure :-1 s=READY pgs=279 cs=0 l=1 rx=0x7f7d14002f30 tx=0x7f7d14007a40).stop 2020-04-22T14:03:14.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.802+0000 7f7d293d1700 1 -- 172.21.15.103:0/1609228093 shutdown_connections 2020-04-22T14:03:14.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.802+0000 7f7d293d1700 1 --2- 172.21.15.103:0/1609228093 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7d2412c0d0 0x7f7d241464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:14.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.802+0000 7f7d293d1700 1 --2- 172.21.15.103:0/1609228093 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d24065fe0 0x7f7d2405b440 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:14.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.802+0000 7f7d293d1700 1 -- 172.21.15.103:0/1609228093 >> 172.21.15.103:0/1609228093 conn(0x7f7d240b9160 msgr2=0x7f7d2405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:14.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.802+0000 7f7d293d1700 1 -- 172.21.15.103:0/1609228093 shutdown_connections 2020-04-22T14:03:14.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.802+0000 7f7d293d1700 1 -- 172.21.15.103:0/1609228093 wait complete. 2020-04-22T14:03:14.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.803+0000 7f7d293d1700 1 Processor -- start 2020-04-22T14:03:14.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.803+0000 7f7d293d1700 1 -- start start 2020-04-22T14:03:14.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.804+0000 7f7d293d1700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7d2405b8a0 0x7f7d240b34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:14.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.804+0000 7f7d293d1700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7d24065fe0 0x7f7d240b2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:14.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.804+0000 7f7d293d1700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7d2412c0d0 0x7f7d240b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:14.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.804+0000 7f7d293d1700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d240b7610 con 0x7f7d2412c0d0 2020-04-22T14:03:14.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.804+0000 7f7d293d1700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d240afe10 con 0x7f7d2405b8a0 2020-04-22T14:03:14.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.804+0000 7f7d293d1700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d240b3a20 con 0x7f7d24065fe0 2020-04-22T14:03:14.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.804+0000 7f7d22ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7d2405b8a0 0x7f7d240b34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:14.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.804+0000 7f7d22ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7d2405b8a0 0x7f7d240b34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48092/0 (socket says 172.21.15.103:48092) 2020-04-22T14:03:14.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.804+0000 7f7d22ffd700 1 -- 172.21.15.103:0/2925912253 learned_addr learned my addr 172.21.15.103:0/2925912253 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:14.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.804+0000 7f7d237fe700 1 --2- 172.21.15.103:0/2925912253 >> v2:172.21.15.86:3300/0 conn(0x7f7d2412c0d0 0x7f7d240b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:14.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.804+0000 7f7d227fc700 1 --2- 172.21.15.103:0/2925912253 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7d24065fe0 0x7f7d240b2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:14.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.804+0000 7f7d22ffd700 1 -- 172.21.15.103:0/2925912253 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7d24065fe0 msgr2=0x7f7d240b2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:14.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.804+0000 7f7d22ffd700 1 --2- 172.21.15.103:0/2925912253 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7d24065fe0 0x7f7d240b2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:14.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.804+0000 7f7d22ffd700 1 -- 172.21.15.103:0/2925912253 >> v2:172.21.15.86:3300/0 conn(0x7f7d2412c0d0 msgr2=0x7f7d240b71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:14.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.804+0000 7f7d22ffd700 1 --2- 172.21.15.103:0/2925912253 >> v2:172.21.15.86:3300/0 conn(0x7f7d2412c0d0 0x7f7d240b71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:14.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.804+0000 7f7d22ffd700 1 -- 172.21.15.103:0/2925912253 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d240b3cc0 con 0x7f7d2405b8a0 2020-04-22T14:03:14.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.805+0000 7f7d22ffd700 1 --2- 172.21.15.103:0/2925912253 >> v2:172.21.15.103:3300/0 conn(0x7f7d2405b8a0 0x7f7d240b34a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7d18002f30 tx=0x7f7d18010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.805+0000 7f7d22ffd700 1 --2- 172.21.15.103:0/2925912253 >> v2:172.21.15.103:3300/0 conn(0x7f7d2405b8a0 0x7f7d240b34a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7d18002f30 tx=0x7f7d18010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.805+0000 7f7d22ffd700 1 --2- 172.21.15.103:0/2925912253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d2405b8a0 0x7f7d240b34a0 secure :-1 s=READY pgs=280 cs=0 l=1 rx=0x7f7d18002f30 tx=0x7f7d18010ce0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:14.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.805+0000 7f7d22ffd700 1 --2- 172.21.15.103:0/2925912253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d2405b8a0 0x7f7d240b34a0 secure :-1 s=THROTTLE_DONE pgs=280 cs=0 l=1 rx=0x7f7d18002f30 tx=0x7f7d18010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.805+0000 7f7d13fff700 1 -- 172.21.15.103:0/2925912253 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d18012b50 con 0x7f7d2405b8a0 2020-04-22T14:03:14.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.805+0000 7f7d22ffd700 1 --2- 172.21.15.103:0/2925912253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d2405b8a0 0x7f7d240b34a0 secure :-1 s=THROTTLE_DONE pgs=280 cs=0 l=1 rx=0x7f7d18002f30 tx=0x7f7d18010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.805+0000 7f7d22ffd700 1 --2- 172.21.15.103:0/2925912253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d2405b8a0 0x7f7d240b34a0 secure :-1 s=THROTTLE_DONE pgs=280 cs=0 l=1 rx=0x7f7d18002f30 tx=0x7f7d18010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.805+0000 7f7d13fff700 1 -- 172.21.15.103:0/2925912253 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d18012cb0 con 0x7f7d2405b8a0 2020-04-22T14:03:14.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.805+0000 7f7d13fff700 1 -- 172.21.15.103:0/2925912253 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d18012e60 con 0x7f7d2405b8a0 2020-04-22T14:03:14.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.805+0000 7f7d293d1700 1 -- 172.21.15.103:0/2925912253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d240b3f60 con 0x7f7d2405b8a0 2020-04-22T14:03:14.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.805+0000 7f7d293d1700 1 -- 172.21.15.103:0/2925912253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d240b4640 con 0x7f7d2405b8a0 2020-04-22T14:03:14.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.805+0000 7f7d22ffd700 1 --2- 172.21.15.103:0/2925912253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d2405b8a0 0x7f7d240b34a0 secure :-1 s=THROTTLE_DONE pgs=280 cs=0 l=1 rx=0x7f7d18002f30 tx=0x7f7d18010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.806+0000 7f7d293d1700 1 -- 172.21.15.103:0/2925912253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d24056c90 con 0x7f7d2405b8a0 2020-04-22T14:03:14.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.806+0000 7f7d13fff700 1 -- 172.21.15.103:0/2925912253 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f7d18007190 con 0x7f7d2405b8a0 2020-04-22T14:03:14.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.806+0000 7f7d22ffd700 1 --2- 172.21.15.103:0/2925912253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d2405b8a0 0x7f7d240b34a0 secure :-1 s=THROTTLE_DONE pgs=280 cs=0 l=1 rx=0x7f7d18002f30 tx=0x7f7d18010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.806+0000 7f7d13fff700 1 --2- 172.21.15.103:0/2925912253 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7d0004dac0 0x7f7d0004ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:14.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.806+0000 7f7d13fff700 1 -- 172.21.15.103:0/2925912253 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7d18061a50 con 0x7f7d2405b8a0 2020-04-22T14:03:14.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.806+0000 7f7d227fc700 1 --2- 172.21.15.103:0/2925912253 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7d0004dac0 0x7f7d0004ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:14.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.806+0000 7f7d227fc700 1 --2- 172.21.15.103:0/2925912253 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7d0004dac0 0x7f7d0004ff80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7d14002f30 tx=0x7f7d14007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.806+0000 7f7d227fc700 1 --2- 172.21.15.103:0/2925912253 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7d0004dac0 0x7f7d0004ff80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7d14002f30 tx=0x7f7d14007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.806+0000 7f7d227fc700 1 --2- 172.21.15.103:0/2925912253 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7d0004dac0 0x7f7d0004ff80 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7f7d14002f30 tx=0x7f7d14007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:14.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.810+0000 7f7d22ffd700 1 --2- 172.21.15.103:0/2925912253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d2405b8a0 0x7f7d240b34a0 secure :-1 s=THROTTLE_DONE pgs=280 cs=0 l=1 rx=0x7f7d18002f30 tx=0x7f7d18010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.810+0000 7f7d13fff700 1 -- 172.21.15.103:0/2925912253 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f7d1803cdd0 con 0x7f7d2405b8a0 2020-04-22T14:03:14.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.951+0000 7f7d293d1700 1 -- 172.21.15.103:0/2925912253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d24147360 con 0x7f7d2405b8a0 2020-04-22T14:03:14.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.952+0000 7f7d22ffd700 1 --2- 172.21.15.103:0/2925912253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d2405b8a0 0x7f7d240b34a0 secure :-1 s=THROTTLE_DONE pgs=280 cs=0 l=1 rx=0x7f7d18002f30 tx=0x7f7d18010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:14.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.952+0000 7f7d13fff700 1 -- 172.21.15.103:0/2925912253 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f7d180403f0 con 0x7f7d2405b8a0 2020-04-22T14:03:14.954 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:03:14.955 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":24,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:02:28.687155+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:02:25.963043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-22T14:02:26.642611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:03:14.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.953+0000 7f7d293d1700 1 -- 172.21.15.103:0/2925912253 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7d0004dac0 msgr2=0x7f7d0004ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:14.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.953+0000 7f7d293d1700 1 --2- 172.21.15.103:0/2925912253 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7d0004dac0 0x7f7d0004ff80 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7f7d14002f30 tx=0x7f7d14007a40).stop 2020-04-22T14:03:14.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.953+0000 7f7d293d1700 1 -- 172.21.15.103:0/2925912253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d2405b8a0 msgr2=0x7f7d240b34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:14.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.953+0000 7f7d293d1700 1 --2- 172.21.15.103:0/2925912253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d2405b8a0 0x7f7d240b34a0 secure :-1 s=READY pgs=280 cs=0 l=1 rx=0x7f7d18002f30 tx=0x7f7d18010ce0).stop 2020-04-22T14:03:14.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.954+0000 7f7d293d1700 1 -- 172.21.15.103:0/2925912253 shutdown_connections 2020-04-22T14:03:14.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.954+0000 7f7d293d1700 1 --2- 172.21.15.103:0/2925912253 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7d0004dac0 0x7f7d0004ff80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:14.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.954+0000 7f7d293d1700 1 --2- 172.21.15.103:0/2925912253 >> v2:172.21.15.86:3300/0 conn(0x7f7d2412c0d0 0x7f7d240b71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:14.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.954+0000 7f7d293d1700 1 --2- 172.21.15.103:0/2925912253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d2405b8a0 0x7f7d240b34a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:14.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.954+0000 7f7d293d1700 1 --2- 172.21.15.103:0/2925912253 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7d24065fe0 0x7f7d240b2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:14.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.954+0000 7f7d293d1700 1 -- 172.21.15.103:0/2925912253 >> 172.21.15.103:0/2925912253 conn(0x7f7d240b9160 msgr2=0x7f7d24064ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:14.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.954+0000 7f7d293d1700 1 -- 172.21.15.103:0/2925912253 shutdown_connections 2020-04-22T14:03:14.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:14.954+0000 7f7d293d1700 1 -- 172.21.15.103:0/2925912253 wait complete. 2020-04-22T14:03:14.966 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:25.963043+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:26.642611+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 4, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'24', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:03:14.967 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:14.980 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:03:15.130 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.128+0000 7f8159dd9700 1 Processor -- start 2020-04-22T14:03:15.130 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.128+0000 7f8159dd9700 1 -- start start 2020-04-22T14:03:15.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.129+0000 7f8159dd9700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f81540b9140 0x7f815412b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:15.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.129+0000 7f8159dd9700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f81540ac950 0x7f815412b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:15.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.129+0000 7f8159dd9700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8154146c40 0x7f81541470f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:15.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.129+0000 7f8159dd9700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81540602f0 con 0x7f81540b9140 2020-04-22T14:03:15.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.129+0000 7f8159dd9700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81541467e0 con 0x7f81540ac950 2020-04-22T14:03:15.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.129+0000 7f8159dd9700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8154060050 con 0x7f8154146c40 2020-04-22T14:03:15.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.129+0000 7f8152ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f81540ac950 0x7f815412b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:15.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.129+0000 7f8152ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f81540ac950 0x7f815412b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48100/0 (socket says 172.21.15.103:48100) 2020-04-22T14:03:15.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.129+0000 7f8152ffd700 1 -- 172.21.15.103:0/2152586998 learned_addr learned my addr 172.21.15.103:0/2152586998 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:15.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.129+0000 7f81537fe700 1 --2- 172.21.15.103:0/2152586998 >> v2:172.21.15.86:3300/0 conn(0x7f81540b9140 0x7f815412b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:15.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.129+0000 7f8153fff700 1 --2- 172.21.15.103:0/2152586998 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8154146c40 0x7f81541470f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:15.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.129+0000 7f8152ffd700 1 -- 172.21.15.103:0/2152586998 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8154146c40 msgr2=0x7f81541470f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:15.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.129+0000 7f8152ffd700 1 --2- 172.21.15.103:0/2152586998 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8154146c40 0x7f81541470f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:15.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.129+0000 7f8152ffd700 1 -- 172.21.15.103:0/2152586998 >> v2:172.21.15.86:3300/0 conn(0x7f81540b9140 msgr2=0x7f815412b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:15.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.129+0000 7f8152ffd700 1 --2- 172.21.15.103:0/2152586998 >> v2:172.21.15.86:3300/0 conn(0x7f81540b9140 0x7f815412b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:15.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.129+0000 7f8152ffd700 1 -- 172.21.15.103:0/2152586998 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81540b9520 con 0x7f81540ac950 2020-04-22T14:03:15.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.129+0000 7f8152ffd700 1 --2- 172.21.15.103:0/2152586998 >> v2:172.21.15.103:3300/0 conn(0x7f81540ac950 0x7f815412b670 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f813c002f30 tx=0x7f813c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.129+0000 7f8152ffd700 1 --2- 172.21.15.103:0/2152586998 >> v2:172.21.15.103:3300/0 conn(0x7f81540ac950 0x7f815412b670 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f813c002f30 tx=0x7f813c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.129+0000 7f8152ffd700 1 --2- 172.21.15.103:0/2152586998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81540ac950 0x7f815412b670 secure :-1 s=READY pgs=281 cs=0 l=1 rx=0x7f813c002f30 tx=0x7f813c007a40).ready entity=mon.1 client_cookie=47aab342911428d5 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:15.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.129+0000 7f8152ffd700 1 --2- 172.21.15.103:0/2152586998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81540ac950 0x7f815412b670 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7f813c002f30 tx=0x7f813c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.129+0000 7f81527fc700 1 -- 172.21.15.103:0/2152586998 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f813c011720 con 0x7f81540ac950 2020-04-22T14:03:15.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.129+0000 7f8152ffd700 1 --2- 172.21.15.103:0/2152586998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81540ac950 0x7f815412b670 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7f813c002f30 tx=0x7f813c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.129+0000 7f8152ffd700 1 --2- 172.21.15.103:0/2152586998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81540ac950 0x7f815412b670 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7f813c002f30 tx=0x7f813c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.129+0000 7f81527fc700 1 -- 172.21.15.103:0/2152586998 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f813c011880 con 0x7f81540ac950 2020-04-22T14:03:15.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.129+0000 7f81527fc700 1 -- 172.21.15.103:0/2152586998 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f813c011ca0 con 0x7f81540ac950 2020-04-22T14:03:15.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.129+0000 7f8159dd9700 1 -- 172.21.15.103:0/2152586998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81540ac950 msgr2=0x7f815412b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:15.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.129+0000 7f8159dd9700 1 --2- 172.21.15.103:0/2152586998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81540ac950 0x7f815412b670 secure :-1 s=READY pgs=281 cs=0 l=1 rx=0x7f813c002f30 tx=0x7f813c007a40).stop 2020-04-22T14:03:15.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.130+0000 7f8159dd9700 1 -- 172.21.15.103:0/2152586998 shutdown_connections 2020-04-22T14:03:15.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.130+0000 7f8159dd9700 1 --2- 172.21.15.103:0/2152586998 >> v2:172.21.15.86:3300/0 conn(0x7f81540b9140 0x7f815412b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:15.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.130+0000 7f8159dd9700 1 --2- 172.21.15.103:0/2152586998 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8154146c40 0x7f81541470f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:15.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.130+0000 7f8159dd9700 1 --2- 172.21.15.103:0/2152586998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81540ac950 0x7f815412b670 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:15.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.130+0000 7f8159dd9700 1 -- 172.21.15.103:0/2152586998 >> 172.21.15.103:0/2152586998 conn(0x7f815405b7b0 msgr2=0x7f81540b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:15.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.130+0000 7f8159dd9700 1 -- 172.21.15.103:0/2152586998 shutdown_connections 2020-04-22T14:03:15.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.130+0000 7f8159dd9700 1 -- 172.21.15.103:0/2152586998 wait complete. 2020-04-22T14:03:15.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.131+0000 7f8159dd9700 1 Processor -- start 2020-04-22T14:03:15.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.131+0000 7f8159dd9700 1 -- start start 2020-04-22T14:03:15.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.132+0000 7f8159dd9700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8154146c40 0x7f81540b2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:15.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.132+0000 7f8159dd9700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81540b15a0 con 0x7f81540ac950 2020-04-22T14:03:15.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.132+0000 7f8159dd9700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8154142a10 con 0x7f81540b9140 2020-04-22T14:03:15.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.132+0000 7f8159dd9700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8154142cb0 con 0x7f8154146c40 2020-04-22T14:03:15.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.132+0000 7f8152ffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f81540b9140 0x7f81540b0e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40298/0 (socket says 172.21.15.103:40298) 2020-04-22T14:03:15.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.132+0000 7f8152ffd700 1 -- 172.21.15.103:0/1284527730 learned_addr learned my addr 172.21.15.103:0/1284527730 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:15.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.132+0000 7f8153fff700 1 --2- 172.21.15.103:0/1284527730 >> v2:172.21.15.86:3300/0 conn(0x7f8154146c40 0x7f81540b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:15.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.132+0000 7f8150ff9700 1 -- 172.21.15.103:0/1284527730 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3997950128 0 0) 0x7f8154142a10 con 0x7f81540b9140 2020-04-22T14:03:15.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.132+0000 7f8150ff9700 1 -- 172.21.15.103:0/1284527730 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8138002fe0 con 0x7f81540b9140 2020-04-22T14:03:15.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.132+0000 7f8150ff9700 1 -- 172.21.15.103:0/1284527730 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3175302734 0 0) 0x7f8138002fe0 con 0x7f81540b9140 2020-04-22T14:03:15.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.132+0000 7f8150ff9700 1 -- 172.21.15.103:0/1284527730 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8154142a10 con 0x7f81540b9140 2020-04-22T14:03:15.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.132+0000 7f8150ff9700 1 -- 172.21.15.103:0/1284527730 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f813c008660 con 0x7f81540b9140 2020-04-22T14:03:15.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.132+0000 7f8150ff9700 1 -- 172.21.15.103:0/1284527730 >> v2:172.21.15.86:3300/0 conn(0x7f8154146c40 msgr2=0x7f81540b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:15.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.132+0000 7f8150ff9700 1 --2- 172.21.15.103:0/1284527730 >> v2:172.21.15.86:3300/0 conn(0x7f8154146c40 0x7f81540b2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:15.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.132+0000 7f8150ff9700 1 -- 172.21.15.103:0/1284527730 >> v1:172.21.15.103:6789/0 conn(0x7f81540b9140 legacy=0x7f81540b0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:15.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.132+0000 7f8150ff9700 1 -- 172.21.15.103:0/1284527730 >> v1:172.21.15.86:6789/0 conn(0x7f81540ac950 legacy=0x7f81540b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:15.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.132+0000 7f8150ff9700 1 --2- 172.21.15.103:0/1284527730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81380049b0 0x7f8138004db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:15.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.132+0000 7f8150ff9700 1 --2- 172.21.15.103:0/1284527730 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8138003920 0x7f8138003d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:15.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.132+0000 7f8150ff9700 1 --2- 172.21.15.103:0/1284527730 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f81380041e0 0x7f813800b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:15.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.132+0000 7f8150ff9700 1 -- 172.21.15.103:0/1284527730 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8154142cb0 con 0x7f8138003920 2020-04-22T14:03:15.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.132+0000 7f8150ff9700 1 -- 172.21.15.103:0/1284527730 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8138004780 con 0x7f81380049b0 2020-04-22T14:03:15.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.132+0000 7f8150ff9700 1 -- 172.21.15.103:0/1284527730 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f813800bbb0 con 0x7f81380041e0 2020-04-22T14:03:15.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.132+0000 7f81537fe700 1 --2- 172.21.15.103:0/1284527730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81380049b0 0x7f8138004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:15.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.133+0000 7f8152ffd700 1 --2- 172.21.15.103:0/1284527730 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8138003920 0x7f8138003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:15.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.133+0000 7f8153fff700 1 --2- 172.21.15.103:0/1284527730 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f81380041e0 0x7f813800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:15.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.133+0000 7f81537fe700 1 -- 172.21.15.103:0/1284527730 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f81380041e0 msgr2=0x7f813800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:15.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.133+0000 7f81537fe700 1 --2- 172.21.15.103:0/1284527730 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f81380041e0 0x7f813800b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:15.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.133+0000 7f81537fe700 1 -- 172.21.15.103:0/1284527730 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8138003920 msgr2=0x7f8138003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:15.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.133+0000 7f81537fe700 1 --2- 172.21.15.103:0/1284527730 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8138003920 0x7f8138003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:15.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.133+0000 7f81537fe700 1 -- 172.21.15.103:0/1284527730 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8154142f50 con 0x7f81380049b0 2020-04-22T14:03:15.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.133+0000 7f8153fff700 1 -- 172.21.15.103:0/1284527730 reap_dead start 2020-04-22T14:03:15.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.133+0000 7f8159dd9700 1 -- 172.21.15.103:0/1284527730 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81540b2220 con 0x7f81380049b0 2020-04-22T14:03:15.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.133+0000 7f81537fe700 1 --2- 172.21.15.103:0/1284527730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81380049b0 0x7f8138004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f81380048f0 tx=0x7f8144010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.133+0000 7f8159dd9700 1 -- 172.21.15.103:0/1284527730 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8154061b10 con 0x7f81380049b0 2020-04-22T14:03:15.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.133+0000 7f81537fe700 1 --2- 172.21.15.103:0/1284527730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81380049b0 0x7f8138004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f81380048f0 tx=0x7f8144010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.133+0000 7f81537fe700 1 --2- 172.21.15.103:0/1284527730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81380049b0 0x7f8138004db0 secure :-1 s=READY pgs=283 cs=0 l=1 rx=0x7f81380048f0 tx=0x7f8144010d40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:15.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.133+0000 7f81537fe700 1 --2- 172.21.15.103:0/1284527730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81380049b0 0x7f8138004db0 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7f81380048f0 tx=0x7f8144010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.133+0000 7f8150ff9700 1 -- 172.21.15.103:0/1284527730 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8144005e20 con 0x7f81380049b0 2020-04-22T14:03:15.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.133+0000 7f81537fe700 1 --2- 172.21.15.103:0/1284527730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81380049b0 0x7f8138004db0 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7f81380048f0 tx=0x7f8144010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.133+0000 7f81537fe700 1 --2- 172.21.15.103:0/1284527730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81380049b0 0x7f8138004db0 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7f81380048f0 tx=0x7f8144010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.133+0000 7f8150ff9700 1 -- 172.21.15.103:0/1284527730 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8144012680 con 0x7f81380049b0 2020-04-22T14:03:15.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.133+0000 7f8150ff9700 1 -- 172.21.15.103:0/1284527730 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8144012a60 con 0x7f81380049b0 2020-04-22T14:03:15.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.134+0000 7f81537fe700 1 --2- 172.21.15.103:0/1284527730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81380049b0 0x7f8138004db0 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7f81380048f0 tx=0x7f8144010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.134+0000 7f8159dd9700 1 -- 172.21.15.103:0/1284527730 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f812c003340 con 0x7f81380049b0 2020-04-22T14:03:15.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.134+0000 7f8150ff9700 1 -- 172.21.15.103:0/1284527730 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f8144012bc0 con 0x7f81380049b0 2020-04-22T14:03:15.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.134+0000 7f81537fe700 1 --2- 172.21.15.103:0/1284527730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81380049b0 0x7f8138004db0 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7f81380048f0 tx=0x7f8144010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.134+0000 7f8150ff9700 1 --2- 172.21.15.103:0/1284527730 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f81380519a0 0x7f8138053e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:15.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.134+0000 7f8150ff9700 1 -- 172.21.15.103:0/1284527730 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8144061980 con 0x7f81380049b0 2020-04-22T14:03:15.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.135+0000 7f8152ffd700 1 --2- 172.21.15.103:0/1284527730 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f81380519a0 0x7f8138053e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:15.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.135+0000 7f8152ffd700 1 --2- 172.21.15.103:0/1284527730 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f81380519a0 0x7f8138053e60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f813c008320 tx=0x7f813c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.135+0000 7f8152ffd700 1 --2- 172.21.15.103:0/1284527730 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f81380519a0 0x7f8138053e60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f813c008320 tx=0x7f813c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.135+0000 7f8152ffd700 1 --2- 172.21.15.103:0/1284527730 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f81380519a0 0x7f8138053e60 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7f813c008320 tx=0x7f813c007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:15.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.138+0000 7f81537fe700 1 --2- 172.21.15.103:0/1284527730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81380049b0 0x7f8138004db0 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7f81380048f0 tx=0x7f8144010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.138+0000 7f8150ff9700 1 -- 172.21.15.103:0/1284527730 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f814403ce20 con 0x7f81380049b0 2020-04-22T14:03:15.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.279+0000 7f8159dd9700 1 -- 172.21.15.103:0/1284527730 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f812c002220 con 0x7f81380049b0 2020-04-22T14:03:15.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.280+0000 7f81537fe700 1 --2- 172.21.15.103:0/1284527730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81380049b0 0x7f8138004db0 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7f81380048f0 tx=0x7f8144010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.280+0000 7f8150ff9700 1 -- 172.21.15.103:0/1284527730 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v24) v1 ==== 110+0+10 (secure 0 0 0) 0x7f8144040440 con 0x7f81380049b0 2020-04-22T14:03:15.284 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:03:15.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.281+0000 7f8159dd9700 1 -- 172.21.15.103:0/1284527730 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f81380519a0 msgr2=0x7f8138053e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:15.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.281+0000 7f8159dd9700 1 --2- 172.21.15.103:0/1284527730 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f81380519a0 0x7f8138053e60 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7f813c008320 tx=0x7f813c007a40).stop 2020-04-22T14:03:15.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.281+0000 7f8159dd9700 1 -- 172.21.15.103:0/1284527730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81380049b0 msgr2=0x7f8138004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:15.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.281+0000 7f8159dd9700 1 --2- 172.21.15.103:0/1284527730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81380049b0 0x7f8138004db0 secure :-1 s=READY pgs=283 cs=0 l=1 rx=0x7f81380048f0 tx=0x7f8144010d40).stop 2020-04-22T14:03:15.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.281+0000 7f8159dd9700 1 -- 172.21.15.103:0/1284527730 shutdown_connections 2020-04-22T14:03:15.286 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.281+0000 7f8159dd9700 1 --2- 172.21.15.103:0/1284527730 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f81380519a0 0x7f8138053e60 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:15.286 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.281+0000 7f8159dd9700 1 --2- 172.21.15.103:0/1284527730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81380049b0 0x7f8138004db0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:15.286 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.281+0000 7f8159dd9700 1 -- 172.21.15.103:0/1284527730 >> 172.21.15.103:0/1284527730 conn(0x7f815405b7b0 msgr2=0x7f81541278a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:15.286 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.281+0000 7f8159dd9700 1 -- 172.21.15.103:0/1284527730 shutdown_connections 2020-04-22T14:03:15.286 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.281+0000 7f8159dd9700 1 -- 172.21.15.103:0/1284527730 wait complete. 2020-04-22T14:03:15.294 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:15.335 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:03:15.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.494+0000 7fe538c3f700 1 Processor -- start 2020-04-22T14:03:15.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.495+0000 7fe538c3f700 1 -- start start 2020-04-22T14:03:15.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.495+0000 7fe538c3f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe5340b9140 0x7fe53412b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:15.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.495+0000 7fe538c3f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe53412b670 0x7fe534143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:15.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.495+0000 7fe538c3f700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5341467e0 con 0x7fe5340ac950 2020-04-22T14:03:15.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.495+0000 7fe538c3f700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5340602f0 con 0x7fe5340b9140 2020-04-22T14:03:15.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.495+0000 7fe538c3f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe534060050 con 0x7fe53412b670 2020-04-22T14:03:15.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.496+0000 7fe532d9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe53412b670 0x7fe534143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:15.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.496+0000 7fe532d9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe53412b670 0x7fe534143090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48120/0 (socket says 172.21.15.103:48120) 2020-04-22T14:03:15.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.496+0000 7fe531d9b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe5340ac950 0x7fe534146c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40310/0 (socket says 172.21.15.103:40310) 2020-04-22T14:03:15.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.496+0000 7fe532d9d700 1 -- 172.21.15.103:0/4051266196 learned_addr learned my addr 172.21.15.103:0/4051266196 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:15.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.496+0000 7fe532d9d700 1 -- 172.21.15.103:0/4051266196 >> v2:172.21.15.86:3300/0 conn(0x7fe5340b9140 msgr2=0x7fe53412b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:15.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.496+0000 7fe53259c700 1 --2- 172.21.15.103:0/4051266196 >> v2:172.21.15.86:3300/0 conn(0x7fe5340b9140 0x7fe53412b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:15.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.496+0000 7fe532d9d700 1 --2- 172.21.15.103:0/4051266196 >> v2:172.21.15.86:3300/0 conn(0x7fe5340b9140 0x7fe53412b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:15.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.496+0000 7fe53159a700 1 -- 172.21.15.103:0/4051266196 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1141937860 0 0) 0x7fe5341467e0 con 0x7fe5340ac950 2020-04-22T14:03:15.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.496+0000 7fe532d9d700 1 -- 172.21.15.103:0/4051266196 >> v1:172.21.15.103:6789/0 conn(0x7fe5340ac950 legacy=0x7fe534146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:15.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.496+0000 7fe532d9d700 1 -- 172.21.15.103:0/4051266196 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5340b9520 con 0x7fe53412b670 2020-04-22T14:03:15.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.496+0000 7fe532d9d700 1 --2- 172.21.15.103:0/4051266196 >> v2:172.21.15.103:3300/0 conn(0x7fe53412b670 0x7fe534143090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe52c0032b0 tx=0x7fe52c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.496+0000 7fe532d9d700 1 --2- 172.21.15.103:0/4051266196 >> v2:172.21.15.103:3300/0 conn(0x7fe53412b670 0x7fe534143090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe52c0032b0 tx=0x7fe52c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.496+0000 7fe532d9d700 1 --2- 172.21.15.103:0/4051266196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe53412b670 0x7fe534143090 secure :-1 s=READY pgs=285 cs=0 l=1 rx=0x7fe52c0032b0 tx=0x7fe52c007dc0).ready entity=mon.1 client_cookie=79466aff171d2f5a server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:15.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.496+0000 7fe532d9d700 1 --2- 172.21.15.103:0/4051266196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe53412b670 0x7fe534143090 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7fe52c0032b0 tx=0x7fe52c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.496+0000 7fe53159a700 1 -- 172.21.15.103:0/4051266196 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe52c00a180 con 0x7fe53412b670 2020-04-22T14:03:15.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.496+0000 7fe532d9d700 1 --2- 172.21.15.103:0/4051266196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe53412b670 0x7fe534143090 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7fe52c0032b0 tx=0x7fe52c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.496+0000 7fe53159a700 1 -- 172.21.15.103:0/4051266196 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52c00a2e0 con 0x7fe53412b670 2020-04-22T14:03:15.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.496+0000 7fe532d9d700 1 --2- 172.21.15.103:0/4051266196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe53412b670 0x7fe534143090 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7fe52c0032b0 tx=0x7fe52c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.496+0000 7fe53159a700 1 -- 172.21.15.103:0/4051266196 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe52c00a6c0 con 0x7fe53412b670 2020-04-22T14:03:15.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.496+0000 7fe538c3f700 1 -- 172.21.15.103:0/4051266196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe53412b670 msgr2=0x7fe534143090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:15.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.496+0000 7fe538c3f700 1 --2- 172.21.15.103:0/4051266196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe53412b670 0x7fe534143090 secure :-1 s=READY pgs=285 cs=0 l=1 rx=0x7fe52c0032b0 tx=0x7fe52c007dc0).stop 2020-04-22T14:03:15.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.497+0000 7fe538c3f700 1 -- 172.21.15.103:0/4051266196 shutdown_connections 2020-04-22T14:03:15.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.497+0000 7fe538c3f700 1 --2- 172.21.15.103:0/4051266196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe53412b670 0x7fe534143090 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:15.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.497+0000 7fe538c3f700 1 --2- 172.21.15.103:0/4051266196 >> v2:172.21.15.86:3300/0 conn(0x7fe5340b9140 0x7fe53412b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:15.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.497+0000 7fe538c3f700 1 -- 172.21.15.103:0/4051266196 >> 172.21.15.103:0/4051266196 conn(0x7fe53405b7b0 msgr2=0x7fe5340b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:15.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.497+0000 7fe538c3f700 1 -- 172.21.15.103:0/4051266196 shutdown_connections 2020-04-22T14:03:15.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.497+0000 7fe538c3f700 1 -- 172.21.15.103:0/4051266196 wait complete. 2020-04-22T14:03:15.517 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.498+0000 7fe538c3f700 1 Processor -- start 2020-04-22T14:03:15.517 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.498+0000 7fe538c3f700 1 -- start start 2020-04-22T14:03:15.518 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.498+0000 7fe538c3f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe5340b9140 0x7fe5341296f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:15.518 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.498+0000 7fe538c3f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe53412b670 0x7fe534143310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:15.518 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.498+0000 7fe538c3f700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe534129b50 con 0x7fe5340ac950 2020-04-22T14:03:15.518 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.498+0000 7fe538c3f700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5340653e0 con 0x7fe5340b9140 2020-04-22T14:03:15.518 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.498+0000 7fe538c3f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe534150e30 con 0x7fe53412b670 2020-04-22T14:03:15.518 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.499+0000 7fe532d9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe53412b670 0x7fe534143310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:15.519 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.499+0000 7fe532d9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe53412b670 0x7fe534143310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48130/0 (socket says 172.21.15.103:48130) 2020-04-22T14:03:15.519 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.499+0000 7fe532d9d700 1 -- 172.21.15.103:0/2655882112 learned_addr learned my addr 172.21.15.103:0/2655882112 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:15.519 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.499+0000 7fe531d9b700 1 --2- 172.21.15.103:0/2655882112 >> v2:172.21.15.86:3300/0 conn(0x7fe5340b9140 0x7fe5341296f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:15.519 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.499+0000 7fe532d9d700 1 -- 172.21.15.103:0/2655882112 >> v2:172.21.15.86:3300/0 conn(0x7fe5340b9140 msgr2=0x7fe5341296f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:15.519 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.499+0000 7fe532d9d700 1 --2- 172.21.15.103:0/2655882112 >> v2:172.21.15.86:3300/0 conn(0x7fe5340b9140 0x7fe5341296f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:15.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.499+0000 7fe532d9d700 1 -- 172.21.15.103:0/2655882112 >> v1:172.21.15.86:6789/0 conn(0x7fe5340ac950 legacy=0x7fe534150590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:15.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.499+0000 7fe532d9d700 1 -- 172.21.15.103:0/2655882112 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5341510d0 con 0x7fe53412b670 2020-04-22T14:03:15.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.499+0000 7fe532d9d700 1 --2- 172.21.15.103:0/2655882112 >> v2:172.21.15.103:3300/0 conn(0x7fe53412b670 0x7fe534143310 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe52c0032b0 tx=0x7fe52c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.499+0000 7fe532d9d700 1 --2- 172.21.15.103:0/2655882112 >> v2:172.21.15.103:3300/0 conn(0x7fe53412b670 0x7fe534143310 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe52c0032b0 tx=0x7fe52c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.499+0000 7fe532d9d700 1 --2- 172.21.15.103:0/2655882112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe53412b670 0x7fe534143310 secure :-1 s=READY pgs=286 cs=0 l=1 rx=0x7fe52c0032b0 tx=0x7fe52c007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:15.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.499+0000 7fe532d9d700 1 --2- 172.21.15.103:0/2655882112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe53412b670 0x7fe534143310 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7fe52c0032b0 tx=0x7fe52c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.499+0000 7fe52b7fe700 1 -- 172.21.15.103:0/2655882112 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe52c005c30 con 0x7fe53412b670 2020-04-22T14:03:15.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.499+0000 7fe532d9d700 1 --2- 172.21.15.103:0/2655882112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe53412b670 0x7fe534143310 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7fe52c0032b0 tx=0x7fe52c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.499+0000 7fe532d9d700 1 --2- 172.21.15.103:0/2655882112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe53412b670 0x7fe534143310 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7fe52c0032b0 tx=0x7fe52c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.499+0000 7fe52b7fe700 1 -- 172.21.15.103:0/2655882112 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52c005d90 con 0x7fe53412b670 2020-04-22T14:03:15.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.499+0000 7fe52b7fe700 1 -- 172.21.15.103:0/2655882112 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe52c00f7a0 con 0x7fe53412b670 2020-04-22T14:03:15.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.499+0000 7fe538c3f700 1 -- 172.21.15.103:0/2655882112 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe534151370 con 0x7fe53412b670 2020-04-22T14:03:15.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.499+0000 7fe538c3f700 1 -- 172.21.15.103:0/2655882112 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe534062f60 con 0x7fe53412b670 2020-04-22T14:03:15.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.500+0000 7fe532d9d700 1 --2- 172.21.15.103:0/2655882112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe53412b670 0x7fe534143310 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7fe52c0032b0 tx=0x7fe52c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.500+0000 7fe52b7fe700 1 -- 172.21.15.103:0/2655882112 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fe52c00f9a0 con 0x7fe53412b670 2020-04-22T14:03:15.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.500+0000 7fe532d9d700 1 --2- 172.21.15.103:0/2655882112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe53412b670 0x7fe534143310 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7fe52c0032b0 tx=0x7fe52c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.500+0000 7fe538c3f700 1 -- 172.21.15.103:0/2655882112 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe534056c90 con 0x7fe53412b670 2020-04-22T14:03:15.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.501+0000 7fe52b7fe700 1 --2- 172.21.15.103:0/2655882112 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe51804da00 0x7fe51804fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:15.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.501+0000 7fe52b7fe700 1 -- 172.21.15.103:0/2655882112 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe52c062650 con 0x7fe53412b670 2020-04-22T14:03:15.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.501+0000 7fe53259c700 1 --2- 172.21.15.103:0/2655882112 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe51804da00 0x7fe51804fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:15.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.501+0000 7fe53259c700 1 --2- 172.21.15.103:0/2655882112 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe51804da00 0x7fe51804fec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe5340b2bf0 tx=0x7fe5240022f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.501+0000 7fe53259c700 1 --2- 172.21.15.103:0/2655882112 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe51804da00 0x7fe51804fec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe5340b2bf0 tx=0x7fe5240022f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.501+0000 7fe53259c700 1 --2- 172.21.15.103:0/2655882112 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe51804da00 0x7fe51804fec0 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7fe5340b2bf0 tx=0x7fe5240022f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:15.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.505+0000 7fe532d9d700 1 --2- 172.21.15.103:0/2655882112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe53412b670 0x7fe534143310 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7fe52c0032b0 tx=0x7fe52c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.505+0000 7fe52b7fe700 1 -- 172.21.15.103:0/2655882112 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fe52c03daf0 con 0x7fe53412b670 2020-04-22T14:03:15.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.648+0000 7fe538c3f700 1 -- 172.21.15.103:0/2655882112 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe53406a960 con 0x7fe53412b670 2020-04-22T14:03:15.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.648+0000 7fe532d9d700 1 --2- 172.21.15.103:0/2655882112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe53412b670 0x7fe534143310 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7fe52c0032b0 tx=0x7fe52c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.648+0000 7fe52b7fe700 1 -- 172.21.15.103:0/2655882112 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe52c041110 con 0x7fe53412b670 2020-04-22T14:03:15.651 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:03:15.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.650+0000 7fe538c3f700 1 -- 172.21.15.103:0/2655882112 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe51804da00 msgr2=0x7fe51804fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:15.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.650+0000 7fe538c3f700 1 --2- 172.21.15.103:0/2655882112 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe51804da00 0x7fe51804fec0 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7fe5340b2bf0 tx=0x7fe5240022f0).stop 2020-04-22T14:03:15.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.650+0000 7fe538c3f700 1 -- 172.21.15.103:0/2655882112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe53412b670 msgr2=0x7fe534143310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:15.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.650+0000 7fe538c3f700 1 --2- 172.21.15.103:0/2655882112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe53412b670 0x7fe534143310 secure :-1 s=READY pgs=286 cs=0 l=1 rx=0x7fe52c0032b0 tx=0x7fe52c007dc0).stop 2020-04-22T14:03:15.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.650+0000 7fe538c3f700 1 -- 172.21.15.103:0/2655882112 shutdown_connections 2020-04-22T14:03:15.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.650+0000 7fe538c3f700 1 --2- 172.21.15.103:0/2655882112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe53412b670 0x7fe534143310 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:15.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.650+0000 7fe538c3f700 1 --2- 172.21.15.103:0/2655882112 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe51804da00 0x7fe51804fec0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:15.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.650+0000 7fe538c3f700 1 --2- 172.21.15.103:0/2655882112 >> v2:172.21.15.86:3300/0 conn(0x7fe5340b9140 0x7fe5341296f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:15.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.650+0000 7fe538c3f700 1 -- 172.21.15.103:0/2655882112 >> 172.21.15.103:0/2655882112 conn(0x7fe53405b7b0 msgr2=0x7fe5340b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:15.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.650+0000 7fe538c3f700 1 -- 172.21.15.103:0/2655882112 shutdown_connections 2020-04-22T14:03:15.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.650+0000 7fe538c3f700 1 -- 172.21.15.103:0/2655882112 wait complete. 2020-04-22T14:03:15.662 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:15.677 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-22T14:03:15.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.826+0000 7f1352335700 1 Processor -- start 2020-04-22T14:03:15.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.827+0000 7f1352335700 1 -- start start 2020-04-22T14:03:15.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.827+0000 7f1352335700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f134c146fc0 0x7f134c0b65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:15.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.827+0000 7f1352335700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f134c05fbc0 con 0x7f134c0b9890 2020-04-22T14:03:15.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.827+0000 7f1352335700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f134c05fe60 con 0x7f134c143bc0 2020-04-22T14:03:15.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.827+0000 7f1352335700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f134c060100 con 0x7f134c146fc0 2020-04-22T14:03:15.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.827+0000 7f13508d2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f134c146fc0 0x7f134c0b65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:15.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.827+0000 7f13508d2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f134c146fc0 0x7f134c0b65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48138/0 (socket says 172.21.15.103:48138) 2020-04-22T14:03:15.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.827+0000 7f13508d2700 1 -- 172.21.15.103:0/1666726450 learned_addr learned my addr 172.21.15.103:0/1666726450 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:15.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.828+0000 7f13508d2700 1 -- 172.21.15.103:0/1666726450 >> v1:172.21.15.103:6789/0 conn(0x7f134c143bc0 legacy=0x7f134c0b5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:15.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.828+0000 7f13508d2700 1 -- 172.21.15.103:0/1666726450 >> v1:172.21.15.86:6789/0 conn(0x7f134c0b9890 legacy=0x7f134c1434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:15.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.828+0000 7f134b7fe700 1 -- 172.21.15.103:0/1666726450 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2617469383 0 0) 0x7f134c05fe60 con 0x7f134c143bc0 2020-04-22T14:03:15.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.828+0000 7f13508d2700 1 -- 172.21.15.103:0/1666726450 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f134c0b9c70 con 0x7f134c146fc0 2020-04-22T14:03:15.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.828+0000 7f13508d2700 1 --2- 172.21.15.103:0/1666726450 >> v2:172.21.15.103:3300/0 conn(0x7f134c146fc0 0x7f134c0b65b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f13440032b0 tx=0x7f1344007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.828+0000 7f13508d2700 1 --2- 172.21.15.103:0/1666726450 >> v2:172.21.15.103:3300/0 conn(0x7f134c146fc0 0x7f134c0b65b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f13440032b0 tx=0x7f1344007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.828+0000 7f13508d2700 1 --2- 172.21.15.103:0/1666726450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f134c146fc0 0x7f134c0b65b0 secure :-1 s=READY pgs=288 cs=0 l=1 rx=0x7f13440032b0 tx=0x7f1344007dc0).ready entity=mon.1 client_cookie=3f98c9d511735cc0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:15.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.828+0000 7f13508d2700 1 --2- 172.21.15.103:0/1666726450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f134c146fc0 0x7f134c0b65b0 secure :-1 s=THROTTLE_DONE pgs=288 cs=0 l=1 rx=0x7f13440032b0 tx=0x7f1344007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.828+0000 7f134b7fe700 1 -- 172.21.15.103:0/1666726450 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f134400a180 con 0x7f134c146fc0 2020-04-22T14:03:15.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.828+0000 7f13508d2700 1 --2- 172.21.15.103:0/1666726450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f134c146fc0 0x7f134c0b65b0 secure :-1 s=THROTTLE_DONE pgs=288 cs=0 l=1 rx=0x7f13440032b0 tx=0x7f1344007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.828+0000 7f13508d2700 1 --2- 172.21.15.103:0/1666726450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f134c146fc0 0x7f134c0b65b0 secure :-1 s=THROTTLE_DONE pgs=288 cs=0 l=1 rx=0x7f13440032b0 tx=0x7f1344007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.828+0000 7f134b7fe700 1 -- 172.21.15.103:0/1666726450 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f134400a320 con 0x7f134c146fc0 2020-04-22T14:03:15.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.828+0000 7f134b7fe700 1 -- 172.21.15.103:0/1666726450 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f134400a740 con 0x7f134c146fc0 2020-04-22T14:03:15.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.828+0000 7f1352335700 1 -- 172.21.15.103:0/1666726450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f134c146fc0 msgr2=0x7f134c0b65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:15.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.828+0000 7f1352335700 1 --2- 172.21.15.103:0/1666726450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f134c146fc0 0x7f134c0b65b0 secure :-1 s=READY pgs=288 cs=0 l=1 rx=0x7f13440032b0 tx=0x7f1344007dc0).stop 2020-04-22T14:03:15.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.829+0000 7f1352335700 1 -- 172.21.15.103:0/1666726450 shutdown_connections 2020-04-22T14:03:15.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.829+0000 7f1352335700 1 --2- 172.21.15.103:0/1666726450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f134c146fc0 0x7f134c0b65b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:15.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.829+0000 7f1352335700 1 -- 172.21.15.103:0/1666726450 >> 172.21.15.103:0/1666726450 conn(0x7f134c05ad30 msgr2=0x7f134c05b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:15.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.829+0000 7f1352335700 1 -- 172.21.15.103:0/1666726450 shutdown_connections 2020-04-22T14:03:15.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.829+0000 7f1352335700 1 -- 172.21.15.103:0/1666726450 wait complete. 2020-04-22T14:03:15.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.830+0000 7f1352335700 1 Processor -- start 2020-04-22T14:03:15.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.830+0000 7f1352335700 1 -- start start 2020-04-22T14:03:15.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.830+0000 7f1352335700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f134c0b9890 0x7f134c147990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:15.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.830+0000 7f1352335700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f134c143bc0 0x7f134c0ac740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:15.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.830+0000 7f1352335700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f134c12ba10 con 0x7f134c146fc0 2020-04-22T14:03:15.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.830+0000 7f1352335700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f134c0acba0 con 0x7f134c143bc0 2020-04-22T14:03:15.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.830+0000 7f1352335700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f134c154310 con 0x7f134c0b9890 2020-04-22T14:03:15.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.830+0000 7f13508d2700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f134c146fc0 0x7f134c12ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:57488/0 (socket says 172.21.15.103:57488) 2020-04-22T14:03:15.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.830+0000 7f13508d2700 1 -- 172.21.15.103:0/4142826906 learned_addr learned my addr 172.21.15.103:0/4142826906 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:15.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.830+0000 7f1343fff700 1 --2- 172.21.15.103:0/4142826906 >> v2:172.21.15.86:3300/0 conn(0x7f134c143bc0 0x7f134c0ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:15.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.831+0000 7f134bfff700 1 --2- 172.21.15.103:0/4142826906 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f134c0b9890 0x7f134c147990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:15.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.831+0000 7f1349ffb700 1 -- 172.21.15.103:0/4142826906 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 708081553 0 0) 0x7f134c0b9c70 con 0x7f134c146fc0 2020-04-22T14:03:15.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.831+0000 7f1349ffb700 1 -- 172.21.15.103:0/4142826906 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1330002fe0 con 0x7f134c146fc0 2020-04-22T14:03:15.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.831+0000 7f1343fff700 1 -- 172.21.15.103:0/4142826906 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f134c0b9890 msgr2=0x7f134c147990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:15.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.831+0000 7f1343fff700 1 --2- 172.21.15.103:0/4142826906 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f134c0b9890 0x7f134c147990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:15.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.831+0000 7f1343fff700 1 -- 172.21.15.103:0/4142826906 >> v1:172.21.15.86:6789/0 conn(0x7f134c146fc0 legacy=0x7f134c12ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:15.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.831+0000 7f1343fff700 1 -- 172.21.15.103:0/4142826906 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f134c1545b0 con 0x7f134c143bc0 2020-04-22T14:03:15.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.831+0000 7f1343fff700 1 --2- 172.21.15.103:0/4142826906 >> v2:172.21.15.86:3300/0 conn(0x7f134c143bc0 0x7f134c0ac740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1334000b80 tx=0x7f1334001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.831+0000 7f1343fff700 1 --2- 172.21.15.103:0/4142826906 >> v2:172.21.15.86:3300/0 conn(0x7f134c143bc0 0x7f134c0ac740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1334000b80 tx=0x7f1334001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.831+0000 7f1343fff700 1 --2- 172.21.15.103:0/4142826906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f134c143bc0 0x7f134c0ac740 secure :-1 s=READY pgs=189 cs=0 l=1 rx=0x7f1334000b80 tx=0x7f1334001e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:15.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.831+0000 7f1343fff700 1 --2- 172.21.15.103:0/4142826906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f134c143bc0 0x7f134c0ac740 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f1334000b80 tx=0x7f1334001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.831+0000 7f1349ffb700 1 -- 172.21.15.103:0/4142826906 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f133400cd10 con 0x7f134c143bc0 2020-04-22T14:03:15.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.831+0000 7f1343fff700 1 --2- 172.21.15.103:0/4142826906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f134c143bc0 0x7f134c0ac740 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f1334000b80 tx=0x7f1334001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.831+0000 7f1352335700 1 -- 172.21.15.103:0/4142826906 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f134c0acde0 con 0x7f134c143bc0 2020-04-22T14:03:15.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.831+0000 7f1349ffb700 1 -- 172.21.15.103:0/4142826906 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133400ce70 con 0x7f134c143bc0 2020-04-22T14:03:15.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.831+0000 7f1343fff700 1 --2- 172.21.15.103:0/4142826906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f134c143bc0 0x7f134c0ac740 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f1334000b80 tx=0x7f1334001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.831+0000 7f1349ffb700 1 -- 172.21.15.103:0/4142826906 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1334010ff0 con 0x7f134c143bc0 2020-04-22T14:03:15.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.831+0000 7f1352335700 1 -- 172.21.15.103:0/4142826906 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f134c154c90 con 0x7f134c143bc0 2020-04-22T14:03:15.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.832+0000 7f1343fff700 1 --2- 172.21.15.103:0/4142826906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f134c143bc0 0x7f134c0ac740 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f1334000b80 tx=0x7f1334001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.832+0000 7f1352335700 1 -- 172.21.15.103:0/4142826906 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f134c056c90 con 0x7f134c143bc0 2020-04-22T14:03:15.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.833+0000 7f1349ffb700 1 -- 172.21.15.103:0/4142826906 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f13340064e0 con 0x7f134c143bc0 2020-04-22T14:03:15.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.833+0000 7f1343fff700 1 --2- 172.21.15.103:0/4142826906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f134c143bc0 0x7f134c0ac740 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f1334000b80 tx=0x7f1334001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.833+0000 7f1349ffb700 1 --2- 172.21.15.103:0/4142826906 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f133004dcc0 0x7f1330050180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:15.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.833+0000 7f1349ffb700 1 -- 172.21.15.103:0/4142826906 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1334060f10 con 0x7f134c143bc0 2020-04-22T14:03:15.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.833+0000 7f134bfff700 1 --2- 172.21.15.103:0/4142826906 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f133004dcc0 0x7f1330050180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:15.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.833+0000 7f134bfff700 1 --2- 172.21.15.103:0/4142826906 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f133004dcc0 0x7f1330050180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f134c0b4ba0 tx=0x7f133c003e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.833+0000 7f134bfff700 1 --2- 172.21.15.103:0/4142826906 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f133004dcc0 0x7f1330050180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f134c0b4ba0 tx=0x7f133c003e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.833+0000 7f134bfff700 1 --2- 172.21.15.103:0/4142826906 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f133004dcc0 0x7f1330050180 secure :-1 s=READY pgs=126 cs=0 l=1 rx=0x7f134c0b4ba0 tx=0x7f133c003e00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:15.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.836+0000 7f1343fff700 1 --2- 172.21.15.103:0/4142826906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f134c143bc0 0x7f134c0ac740 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f1334000b80 tx=0x7f1334001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.836+0000 7f1349ffb700 1 -- 172.21.15.103:0/4142826906 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f133403c290 con 0x7f134c143bc0 2020-04-22T14:03:15.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.977+0000 7f1352335700 1 -- 172.21.15.103:0/4142826906 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f134c1469c0 con 0x7f134c143bc0 2020-04-22T14:03:15.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.978+0000 7f1343fff700 1 --2- 172.21.15.103:0/4142826906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f134c143bc0 0x7f134c0ac740 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f1334000b80 tx=0x7f1334001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:15.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.978+0000 7f1349ffb700 1 -- 172.21.15.103:0/4142826906 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7f133403f8b0 con 0x7f134c143bc0 2020-04-22T14:03:15.981 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:03:15.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.979+0000 7f1352335700 1 -- 172.21.15.103:0/4142826906 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f133004dcc0 msgr2=0x7f1330050180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:15.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.979+0000 7f1352335700 1 --2- 172.21.15.103:0/4142826906 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f133004dcc0 0x7f1330050180 secure :-1 s=READY pgs=126 cs=0 l=1 rx=0x7f134c0b4ba0 tx=0x7f133c003e00).stop 2020-04-22T14:03:15.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.979+0000 7f1352335700 1 -- 172.21.15.103:0/4142826906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f134c143bc0 msgr2=0x7f134c0ac740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:15.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.979+0000 7f1352335700 1 --2- 172.21.15.103:0/4142826906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f134c143bc0 0x7f134c0ac740 secure :-1 s=READY pgs=189 cs=0 l=1 rx=0x7f1334000b80 tx=0x7f1334001e40).stop 2020-04-22T14:03:15.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.979+0000 7f1352335700 1 -- 172.21.15.103:0/4142826906 shutdown_connections 2020-04-22T14:03:15.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.979+0000 7f1352335700 1 --2- 172.21.15.103:0/4142826906 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f134c0b9890 0x7f134c147990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:15.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.979+0000 7f1352335700 1 --2- 172.21.15.103:0/4142826906 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f133004dcc0 0x7f1330050180 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:15.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.979+0000 7f1352335700 1 --2- 172.21.15.103:0/4142826906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f134c143bc0 0x7f134c0ac740 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:15.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.979+0000 7f1352335700 1 -- 172.21.15.103:0/4142826906 >> 172.21.15.103:0/4142826906 conn(0x7f134c05ad30 msgr2=0x7f134c143280 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:15.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.979+0000 7f1352335700 1 -- 172.21.15.103:0/4142826906 shutdown_connections 2020-04-22T14:03:15.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:15.979+0000 7f1352335700 1 -- 172.21.15.103:0/4142826906 wait complete. 2020-04-22T14:03:15.993 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:16.009 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-22T14:03:16.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.157+0000 7f8507e22700 1 Processor -- start 2020-04-22T14:03:16.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.158+0000 7f8507e22700 1 -- start start 2020-04-22T14:03:16.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.158+0000 7f8507e22700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f85000acb10 0x7f8500142630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:16.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.158+0000 7f8507e22700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85000af030 con 0x7f85000b4820 2020-04-22T14:03:16.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.158+0000 7f8507e22700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8500060250 con 0x7f8500061a30 2020-04-22T14:03:16.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.158+0000 7f8507e22700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85000623c0 con 0x7f85000acb10 2020-04-22T14:03:16.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.158+0000 7f8505bbe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f8500061a30 0x7f85000ae920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40338/0 (socket says 172.21.15.103:40338) 2020-04-22T14:03:16.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.158+0000 7f8505bbe700 1 -- 172.21.15.103:0/548984870 learned_addr learned my addr 172.21.15.103:0/548984870 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:16.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.159+0000 7f8504bbc700 1 -- 172.21.15.103:0/548984870 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 355151549 0 0) 0x7f8500060250 con 0x7f8500061a30 2020-04-22T14:03:16.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.159+0000 7f85063bf700 1 --2- 172.21.15.103:0/548984870 >> v2:172.21.15.86:3300/0 conn(0x7f85000acb10 0x7f8500142630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:16.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.159+0000 7f8504bbc700 1 -- 172.21.15.103:0/548984870 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84e8003230 con 0x7f8500061a30 2020-04-22T14:03:16.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.159+0000 7f8504bbc700 1 -- 172.21.15.103:0/548984870 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2262891726 0 0) 0x7f84e8003230 con 0x7f8500061a30 2020-04-22T14:03:16.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.159+0000 7f8504bbc700 1 -- 172.21.15.103:0/548984870 >> v2:172.21.15.86:3300/0 conn(0x7f85000acb10 msgr2=0x7f8500142630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:16.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.159+0000 7f8504bbc700 1 --2- 172.21.15.103:0/548984870 >> v2:172.21.15.86:3300/0 conn(0x7f85000acb10 0x7f8500142630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:16.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.159+0000 7f8504bbc700 1 -- 172.21.15.103:0/548984870 >> v1:172.21.15.86:6789/0 conn(0x7f85000b4820 legacy=0x7f8500141f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:16.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.159+0000 7f8504bbc700 1 -- 172.21.15.103:0/548984870 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8500062660 con 0x7f8500061a30 2020-04-22T14:03:16.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.159+0000 7f8504bbc700 1 -- 172.21.15.103:0/548984870 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f84f00016d0 con 0x7f8500061a30 2020-04-22T14:03:16.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.159+0000 7f85063bf700 1 --2- 172.21.15.103:0/548984870 >> v2:172.21.15.86:3300/0 conn(0x7f85000acb10 0x7f8500142630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:03:16.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.159+0000 7f8504bbc700 1 -- 172.21.15.103:0/548984870 >> v1:172.21.15.103:6789/0 conn(0x7f8500061a30 legacy=0x7f85000ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:16.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.159+0000 7f8504bbc700 1 --2- 172.21.15.103:0/548984870 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f84e8003720 0x7f84e8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:16.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.159+0000 7f8504bbc700 1 --2- 172.21.15.103:0/548984870 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84e80044d0 0x7f84e8004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:16.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.159+0000 7f8504bbc700 1 --2- 172.21.15.103:0/548984870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84e8004db0 0x7f84e800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:16.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.159+0000 7f8504bbc700 1 -- 172.21.15.103:0/548984870 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85000623c0 con 0x7f84e80044d0 2020-04-22T14:03:16.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.159+0000 7f8504bbc700 1 -- 172.21.15.103:0/548984870 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e80041c0 con 0x7f84e8004db0 2020-04-22T14:03:16.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.159+0000 7f8504bbc700 1 -- 172.21.15.103:0/548984870 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e800bb80 con 0x7f84e8003720 2020-04-22T14:03:16.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.159+0000 7f85063bf700 1 --2- 172.21.15.103:0/548984870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84e8004db0 0x7f84e800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:16.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.159+0000 7f8505bbe700 1 --2- 172.21.15.103:0/548984870 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f84e8003720 0x7f84e8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:16.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.159+0000 7f85053bd700 1 --2- 172.21.15.103:0/548984870 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84e80044d0 0x7f84e8004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:16.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.159+0000 7f85063bf700 1 -- 172.21.15.103:0/548984870 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f84e8003720 msgr2=0x7f84e8003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:16.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.159+0000 7f85063bf700 1 --2- 172.21.15.103:0/548984870 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f84e8003720 0x7f84e8003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:16.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.159+0000 7f85063bf700 1 -- 172.21.15.103:0/548984870 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84e80044d0 msgr2=0x7f84e8004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:16.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.159+0000 7f85063bf700 1 --2- 172.21.15.103:0/548984870 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84e80044d0 0x7f84e8004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:16.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.159+0000 7f85063bf700 1 -- 172.21.15.103:0/548984870 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e8003230 con 0x7f84e8004db0 2020-04-22T14:03:16.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.159+0000 7f85063bf700 1 --2- 172.21.15.103:0/548984870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84e8004db0 0x7f84e800b720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f84e80054a0 tx=0x7f84f8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.159+0000 7f85063bf700 1 -- 172.21.15.103:0/548984870 reap_dead start 2020-04-22T14:03:16.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.160+0000 7f85063bf700 1 --2- 172.21.15.103:0/548984870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84e8004db0 0x7f84e800b720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f84e80054a0 tx=0x7f84f8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.160+0000 7f85063bf700 1 --2- 172.21.15.103:0/548984870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84e8004db0 0x7f84e800b720 secure :-1 s=READY pgs=290 cs=0 l=1 rx=0x7f84e80054a0 tx=0x7f84f8010280).ready entity=mon.1 client_cookie=86319f242ec9c199 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:16.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.160+0000 7f85063bf700 1 --2- 172.21.15.103:0/548984870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84e8004db0 0x7f84e800b720 secure :-1 s=THROTTLE_DONE pgs=290 cs=0 l=1 rx=0x7f84e80054a0 tx=0x7f84f8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.160+0000 7f85063bf700 1 --2- 172.21.15.103:0/548984870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84e8004db0 0x7f84e800b720 secure :-1 s=THROTTLE_DONE pgs=290 cs=0 l=1 rx=0x7f84e80054a0 tx=0x7f84f8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.160+0000 7f8504bbc700 1 -- 172.21.15.103:0/548984870 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84f8007f50 con 0x7f84e8004db0 2020-04-22T14:03:16.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.160+0000 7f85063bf700 1 --2- 172.21.15.103:0/548984870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84e8004db0 0x7f84e800b720 secure :-1 s=THROTTLE_DONE pgs=290 cs=0 l=1 rx=0x7f84e80054a0 tx=0x7f84f8010280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.160+0000 7f8504bbc700 1 -- 172.21.15.103:0/548984870 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f8005a40 con 0x7f84e8004db0 2020-04-22T14:03:16.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.160+0000 7f8504bbc700 1 -- 172.21.15.103:0/548984870 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84f8005e40 con 0x7f84e8004db0 2020-04-22T14:03:16.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.160+0000 7f8507e22700 1 -- 172.21.15.103:0/548984870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84e8004db0 msgr2=0x7f84e800b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:16.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.160+0000 7f8507e22700 1 --2- 172.21.15.103:0/548984870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84e8004db0 0x7f84e800b720 secure :-1 s=READY pgs=290 cs=0 l=1 rx=0x7f84e80054a0 tx=0x7f84f8010280).stop 2020-04-22T14:03:16.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.160+0000 7f8507e22700 1 -- 172.21.15.103:0/548984870 shutdown_connections 2020-04-22T14:03:16.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.160+0000 7f8507e22700 1 --2- 172.21.15.103:0/548984870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84e8004db0 0x7f84e800b720 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:16.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.160+0000 7f8507e22700 1 -- 172.21.15.103:0/548984870 >> 172.21.15.103:0/548984870 conn(0x7f850005b7b0 msgr2=0x7f85000b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:16.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.160+0000 7f8507e22700 1 -- 172.21.15.103:0/548984870 shutdown_connections 2020-04-22T14:03:16.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.160+0000 7f8507e22700 1 -- 172.21.15.103:0/548984870 wait complete. 2020-04-22T14:03:16.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.161+0000 7f8507e22700 1 Processor -- start 2020-04-22T14:03:16.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.161+0000 7f8507e22700 1 -- start start 2020-04-22T14:03:16.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.162+0000 7f8507e22700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f84e8004db0 0x7f850013f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:16.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.162+0000 7f8507e22700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8500141540 con 0x7f85001452c0 2020-04-22T14:03:16.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.162+0000 7f8507e22700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85001417e0 con 0x7f850013d4f0 2020-04-22T14:03:16.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.162+0000 7f8507e22700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8500141a80 con 0x7f84e8004db0 2020-04-22T14:03:16.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.162+0000 7f8505bbe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f84e8004db0 0x7f850013f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:16.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.162+0000 7f85063bf700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f850013d4f0 0x7f850015a880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40354/0 (socket says 172.21.15.103:40354) 2020-04-22T14:03:16.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.162+0000 7f85063bf700 1 -- 172.21.15.103:0/2239646135 learned_addr learned my addr 172.21.15.103:0/2239646135 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:16.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.162+0000 7f8505bbe700 1 -- 172.21.15.103:0/2239646135 >> v1:172.21.15.103:6789/0 conn(0x7f850013d4f0 legacy=0x7f850015a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:16.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.162+0000 7f8505bbe700 1 -- 172.21.15.103:0/2239646135 >> v1:172.21.15.86:6789/0 conn(0x7f85001452c0 legacy=0x7f850013a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:16.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.162+0000 7f84eeffd700 1 -- 172.21.15.103:0/2239646135 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1791063723 0 0) 0x7f85001417e0 con 0x7f850013d4f0 2020-04-22T14:03:16.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.162+0000 7f8505bbe700 1 -- 172.21.15.103:0/2239646135 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f850013abc0 con 0x7f84e8004db0 2020-04-22T14:03:16.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.162+0000 7f8505bbe700 1 --2- 172.21.15.103:0/2239646135 >> v2:172.21.15.103:3300/0 conn(0x7f84e8004db0 0x7f850013f440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f84f00013e0 tx=0x7f84f00094d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.162+0000 7f8505bbe700 1 --2- 172.21.15.103:0/2239646135 >> v2:172.21.15.103:3300/0 conn(0x7f84e8004db0 0x7f850013f440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f84f00013e0 tx=0x7f84f00094d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.162+0000 7f8505bbe700 1 --2- 172.21.15.103:0/2239646135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84e8004db0 0x7f850013f440 secure :-1 s=READY pgs=292 cs=0 l=1 rx=0x7f84f00013e0 tx=0x7f84f00094d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:16.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.163+0000 7f8505bbe700 1 --2- 172.21.15.103:0/2239646135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84e8004db0 0x7f850013f440 secure :-1 s=THROTTLE_DONE pgs=292 cs=0 l=1 rx=0x7f84f00013e0 tx=0x7f84f00094d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.163+0000 7f84eeffd700 1 -- 172.21.15.103:0/2239646135 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84f0011c20 con 0x7f84e8004db0 2020-04-22T14:03:16.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.163+0000 7f8505bbe700 1 --2- 172.21.15.103:0/2239646135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84e8004db0 0x7f850013f440 secure :-1 s=THROTTLE_DONE pgs=292 cs=0 l=1 rx=0x7f84f00013e0 tx=0x7f84f00094d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.163+0000 7f84eeffd700 1 -- 172.21.15.103:0/2239646135 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f0011d80 con 0x7f84e8004db0 2020-04-22T14:03:16.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.163+0000 7f8507e22700 1 -- 172.21.15.103:0/2239646135 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85000b7e70 con 0x7f84e8004db0 2020-04-22T14:03:16.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.163+0000 7f8505bbe700 1 --2- 172.21.15.103:0/2239646135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84e8004db0 0x7f850013f440 secure :-1 s=THROTTLE_DONE pgs=292 cs=0 l=1 rx=0x7f84f00013e0 tx=0x7f84f00094d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.163+0000 7f84eeffd700 1 -- 172.21.15.103:0/2239646135 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84f000c9f0 con 0x7f84e8004db0 2020-04-22T14:03:16.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.163+0000 7f8507e22700 1 -- 172.21.15.103:0/2239646135 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f850015bfa0 con 0x7f84e8004db0 2020-04-22T14:03:16.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.163+0000 7f8505bbe700 1 --2- 172.21.15.103:0/2239646135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84e8004db0 0x7f850013f440 secure :-1 s=THROTTLE_DONE pgs=292 cs=0 l=1 rx=0x7f84f00013e0 tx=0x7f84f00094d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.164+0000 7f84eeffd700 1 -- 172.21.15.103:0/2239646135 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f84f000cbf0 con 0x7f84e8004db0 2020-04-22T14:03:16.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.164+0000 7f8505bbe700 1 --2- 172.21.15.103:0/2239646135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84e8004db0 0x7f850013f440 secure :-1 s=THROTTLE_DONE pgs=292 cs=0 l=1 rx=0x7f84f00013e0 tx=0x7f84f00094d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.164+0000 7f8507e22700 1 -- 172.21.15.103:0/2239646135 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8500056c90 con 0x7f84e8004db0 2020-04-22T14:03:16.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.164+0000 7f84eeffd700 1 --2- 172.21.15.103:0/2239646135 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f84e004d790 0x7f84e004fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:16.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.164+0000 7f84eeffd700 1 -- 172.21.15.103:0/2239646135 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f84f0060f90 con 0x7f84e8004db0 2020-04-22T14:03:16.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.164+0000 7f85053bd700 1 --2- 172.21.15.103:0/2239646135 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f84e004d790 0x7f84e004fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:16.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.164+0000 7f85053bd700 1 --2- 172.21.15.103:0/2239646135 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f84e004d790 0x7f84e004fc50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f850013fe70 tx=0x7f84fc003690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.164+0000 7f85053bd700 1 --2- 172.21.15.103:0/2239646135 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f84e004d790 0x7f84e004fc50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f850013fe70 tx=0x7f84fc003690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.164+0000 7f85053bd700 1 --2- 172.21.15.103:0/2239646135 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f84e004d790 0x7f84e004fc50 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7f850013fe70 tx=0x7f84fc003690).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:16.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.168+0000 7f8505bbe700 1 --2- 172.21.15.103:0/2239646135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84e8004db0 0x7f850013f440 secure :-1 s=THROTTLE_DONE pgs=292 cs=0 l=1 rx=0x7f84f00013e0 tx=0x7f84f00094d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.168+0000 7f84eeffd700 1 -- 172.21.15.103:0/2239646135 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f84f003c430 con 0x7f84e8004db0 2020-04-22T14:03:16.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.312+0000 7f8507e22700 1 -- 172.21.15.103:0/2239646135 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f850013adb0 con 0x7f84e8004db0 2020-04-22T14:03:16.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.313+0000 7f8505bbe700 1 --2- 172.21.15.103:0/2239646135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84e8004db0 0x7f850013f440 secure :-1 s=THROTTLE_DONE pgs=292 cs=0 l=1 rx=0x7f84f00013e0 tx=0x7f84f00094d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.313+0000 7f84eeffd700 1 -- 172.21.15.103:0/2239646135 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7f84f003fa50 con 0x7f84e8004db0 2020-04-22T14:03:16.315 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:03:16.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.314+0000 7f8507e22700 1 -- 172.21.15.103:0/2239646135 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f84e004d790 msgr2=0x7f84e004fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:16.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.314+0000 7f8507e22700 1 --2- 172.21.15.103:0/2239646135 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f84e004d790 0x7f84e004fc50 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7f850013fe70 tx=0x7f84fc003690).stop 2020-04-22T14:03:16.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.314+0000 7f8507e22700 1 -- 172.21.15.103:0/2239646135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84e8004db0 msgr2=0x7f850013f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:16.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.314+0000 7f8507e22700 1 --2- 172.21.15.103:0/2239646135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84e8004db0 0x7f850013f440 secure :-1 s=READY pgs=292 cs=0 l=1 rx=0x7f84f00013e0 tx=0x7f84f00094d0).stop 2020-04-22T14:03:16.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.314+0000 7f8507e22700 1 -- 172.21.15.103:0/2239646135 shutdown_connections 2020-04-22T14:03:16.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.314+0000 7f8507e22700 1 --2- 172.21.15.103:0/2239646135 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f84e004d790 0x7f84e004fc50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:16.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.314+0000 7f8507e22700 1 --2- 172.21.15.103:0/2239646135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84e8004db0 0x7f850013f440 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:16.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.314+0000 7f8507e22700 1 -- 172.21.15.103:0/2239646135 >> 172.21.15.103:0/2239646135 conn(0x7f850005b7b0 msgr2=0x7f85000b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:16.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.314+0000 7f8507e22700 1 -- 172.21.15.103:0/2239646135 shutdown_connections 2020-04-22T14:03:16.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.314+0000 7f8507e22700 1 -- 172.21.15.103:0/2239646135 wait complete. 2020-04-22T14:03:16.326 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:16.345 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:03:16.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.492+0000 7fe925169700 1 Processor -- start 2020-04-22T14:03:16.517 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.492+0000 7fe925169700 1 -- start start 2020-04-22T14:03:16.517 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.493+0000 7fe925169700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe92012c0d0 0x7fe9201464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:16.517 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.493+0000 7fe925169700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe920143300 con 0x7fe920063e30 2020-04-22T14:03:16.517 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.493+0000 7fe925169700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9201435a0 con 0x7fe920065fe0 2020-04-22T14:03:16.517 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.493+0000 7fe925169700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe920143840 con 0x7fe92012c0d0 2020-04-22T14:03:16.518 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.493+0000 7fe91e59c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe920065fe0 0x7fe92005b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40360/0 (socket says 172.21.15.103:40360) 2020-04-22T14:03:16.518 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.493+0000 7fe91e59c700 1 -- 172.21.15.103:0/526594810 learned_addr learned my addr 172.21.15.103:0/526594810 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:16.518 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.493+0000 7fe91dd9b700 1 -- 172.21.15.103:0/526594810 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2192339265 0 0) 0x7fe9201435a0 con 0x7fe920065fe0 2020-04-22T14:03:16.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.493+0000 7fe91dd9b700 1 -- 172.21.15.103:0/526594810 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe904003230 con 0x7fe920065fe0 2020-04-22T14:03:16.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.493+0000 7fe91ed9d700 1 --2- 172.21.15.103:0/526594810 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe92012c0d0 0x7fe9201464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:16.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.493+0000 7fe91dd9b700 1 -- 172.21.15.103:0/526594810 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1321629183 0 0) 0x7fe904003230 con 0x7fe920065fe0 2020-04-22T14:03:16.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.493+0000 7fe91dd9b700 1 -- 172.21.15.103:0/526594810 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe92012c0d0 msgr2=0x7fe9201464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:16.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.493+0000 7fe91dd9b700 1 --2- 172.21.15.103:0/526594810 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe92012c0d0 0x7fe9201464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:16.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.493+0000 7fe91dd9b700 1 -- 172.21.15.103:0/526594810 >> v1:172.21.15.86:6789/0 conn(0x7fe920063e30 legacy=0x7fe9200642a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:16.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.493+0000 7fe91dd9b700 1 -- 172.21.15.103:0/526594810 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92005bb50 con 0x7fe920065fe0 2020-04-22T14:03:16.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.493+0000 7fe91dd9b700 1 -- 172.21.15.103:0/526594810 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fe9140016d0 con 0x7fe920065fe0 2020-04-22T14:03:16.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.493+0000 7fe91dd9b700 1 -- 172.21.15.103:0/526594810 >> v1:172.21.15.103:6789/0 conn(0x7fe920065fe0 legacy=0x7fe92005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:16.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.494+0000 7fe91dd9b700 1 --2- 172.21.15.103:0/526594810 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe92012c0d0 0x7fe904003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:16.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.494+0000 7fe91dd9b700 1 --2- 172.21.15.103:0/526594810 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe904003b80 0x7fe904003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:16.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.494+0000 7fe91dd9b700 1 --2- 172.21.15.103:0/526594810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9040045c0 0x7fe904004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:16.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.494+0000 7fe91dd9b700 1 -- 172.21.15.103:0/526594810 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe920143840 con 0x7fe904003b80 2020-04-22T14:03:16.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.494+0000 7fe91dd9b700 1 -- 172.21.15.103:0/526594810 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe904004fd0 con 0x7fe9040045c0 2020-04-22T14:03:16.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.494+0000 7fe91dd9b700 1 -- 172.21.15.103:0/526594810 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe904005190 con 0x7fe92012c0d0 2020-04-22T14:03:16.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.494+0000 7fe91f59e700 1 --2- 172.21.15.103:0/526594810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9040045c0 0x7fe904004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:16.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.494+0000 7fe91ed9d700 1 --2- 172.21.15.103:0/526594810 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe92012c0d0 0x7fe904003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:16.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.494+0000 7fe91e59c700 1 --2- 172.21.15.103:0/526594810 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe904003b80 0x7fe904003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:16.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.494+0000 7fe91f59e700 1 -- 172.21.15.103:0/526594810 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe92012c0d0 msgr2=0x7fe904003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:16.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.494+0000 7fe91f59e700 1 --2- 172.21.15.103:0/526594810 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe92012c0d0 0x7fe904003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:16.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.494+0000 7fe91f59e700 1 -- 172.21.15.103:0/526594810 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe904003b80 msgr2=0x7fe904003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:16.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.494+0000 7fe91f59e700 1 --2- 172.21.15.103:0/526594810 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe904003b80 0x7fe904003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:16.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.494+0000 7fe91f59e700 1 -- 172.21.15.103:0/526594810 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe904003230 con 0x7fe9040045c0 2020-04-22T14:03:16.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.494+0000 7fe91f59e700 1 --2- 172.21.15.103:0/526594810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9040045c0 0x7fe904004a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe9200669a0 tx=0x7fe910011f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.494+0000 7fe91f59e700 1 --2- 172.21.15.103:0/526594810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9040045c0 0x7fe904004a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe9200669a0 tx=0x7fe910011f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.494+0000 7fe91f59e700 1 --2- 172.21.15.103:0/526594810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9040045c0 0x7fe904004a20 secure :-1 s=READY pgs=294 cs=0 l=1 rx=0x7fe9200669a0 tx=0x7fe910011f00).ready entity=mon.1 client_cookie=154aaf98df7264b8 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:16.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.494+0000 7fe91f59e700 1 --2- 172.21.15.103:0/526594810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9040045c0 0x7fe904004a20 secure :-1 s=THROTTLE_DONE pgs=294 cs=0 l=1 rx=0x7fe9200669a0 tx=0x7fe910011f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.494+0000 7fe91f59e700 1 --2- 172.21.15.103:0/526594810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9040045c0 0x7fe904004a20 secure :-1 s=THROTTLE_DONE pgs=294 cs=0 l=1 rx=0x7fe9200669a0 tx=0x7fe910011f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.494+0000 7fe91dd9b700 1 -- 172.21.15.103:0/526594810 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe910003560 con 0x7fe9040045c0 2020-04-22T14:03:16.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.494+0000 7fe91f59e700 1 --2- 172.21.15.103:0/526594810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9040045c0 0x7fe904004a20 secure :-1 s=THROTTLE_DONE pgs=294 cs=0 l=1 rx=0x7fe9200669a0 tx=0x7fe910011f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.494+0000 7fe91dd9b700 1 -- 172.21.15.103:0/526594810 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe910003700 con 0x7fe9040045c0 2020-04-22T14:03:16.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.494+0000 7fe91dd9b700 1 -- 172.21.15.103:0/526594810 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe910003ae0 con 0x7fe9040045c0 2020-04-22T14:03:16.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.494+0000 7fe925169700 1 -- 172.21.15.103:0/526594810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9040045c0 msgr2=0x7fe904004a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:16.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.494+0000 7fe925169700 1 --2- 172.21.15.103:0/526594810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9040045c0 0x7fe904004a20 secure :-1 s=READY pgs=294 cs=0 l=1 rx=0x7fe9200669a0 tx=0x7fe910011f00).stop 2020-04-22T14:03:16.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.494+0000 7fe91f59e700 1 -- 172.21.15.103:0/526594810 reap_dead start 2020-04-22T14:03:16.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.495+0000 7fe925169700 1 -- 172.21.15.103:0/526594810 shutdown_connections 2020-04-22T14:03:16.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.495+0000 7fe925169700 1 -- 172.21.15.103:0/526594810 >> 172.21.15.103:0/526594810 conn(0x7fe9200b9160 msgr2=0x7fe92005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:16.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.495+0000 7fe925169700 1 -- 172.21.15.103:0/526594810 shutdown_connections 2020-04-22T14:03:16.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.495+0000 7fe925169700 1 -- 172.21.15.103:0/526594810 wait complete. 2020-04-22T14:03:16.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.496+0000 7fe925169700 1 Processor -- start 2020-04-22T14:03:16.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.496+0000 7fe925169700 1 -- start start 2020-04-22T14:03:16.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.496+0000 7fe925169700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe920141f10 0x7fe9200b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:16.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.496+0000 7fe925169700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe920157690 0x7fe920154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:16.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.496+0000 7fe925169700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe920157be0 con 0x7fe920157230 2020-04-22T14:03:16.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.496+0000 7fe925169700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe920157e80 con 0x7fe920157690 2020-04-22T14:03:16.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.496+0000 7fe925169700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe920153b30 con 0x7fe920141f10 2020-04-22T14:03:16.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.497+0000 7fe91e59c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe920157230 0x7fe920061ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40370/0 (socket says 172.21.15.103:40370) 2020-04-22T14:03:16.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.497+0000 7fe91e59c700 1 -- 172.21.15.103:0/592349877 learned_addr learned my addr 172.21.15.103:0/592349877 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:16.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.497+0000 7fe91ed9d700 1 --2- 172.21.15.103:0/592349877 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe920141f10 0x7fe9200b0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:16.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.497+0000 7fe91f59e700 1 --2- 172.21.15.103:0/592349877 >> v2:172.21.15.86:3300/0 conn(0x7fe920157690 0x7fe920154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:16.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.497+0000 7fe90ffff700 1 -- 172.21.15.103:0/592349877 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2848266255 0 0) 0x7fe920157be0 con 0x7fe920157230 2020-04-22T14:03:16.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.497+0000 7fe90ffff700 1 -- 172.21.15.103:0/592349877 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8fc002fe0 con 0x7fe920157230 2020-04-22T14:03:16.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.497+0000 7fe90ffff700 1 -- 172.21.15.103:0/592349877 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 453883411 0 0) 0x7fe8fc002fe0 con 0x7fe920157230 2020-04-22T14:03:16.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.497+0000 7fe91ed9d700 1 -- 172.21.15.103:0/592349877 >> v2:172.21.15.86:3300/0 conn(0x7fe920157690 msgr2=0x7fe920154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:16.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.497+0000 7fe91ed9d700 1 --2- 172.21.15.103:0/592349877 >> v2:172.21.15.86:3300/0 conn(0x7fe920157690 0x7fe920154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:16.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.497+0000 7fe91ed9d700 1 -- 172.21.15.103:0/592349877 >> v1:172.21.15.103:6789/0 conn(0x7fe920157230 legacy=0x7fe920061ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:16.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.497+0000 7fe91ed9d700 1 -- 172.21.15.103:0/592349877 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9200621e0 con 0x7fe920141f10 2020-04-22T14:03:16.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.497+0000 7fe91ed9d700 1 --2- 172.21.15.103:0/592349877 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe920141f10 0x7fe9200b0b50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe9140019c0 tx=0x7fe918010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.497+0000 7fe91ed9d700 1 --2- 172.21.15.103:0/592349877 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe920141f10 0x7fe9200b0b50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe9140019c0 tx=0x7fe918010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.497+0000 7fe91ed9d700 1 --2- 172.21.15.103:0/592349877 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe920141f10 0x7fe9200b0b50 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7fe9140019c0 tx=0x7fe918010f60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:16.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.497+0000 7fe91ed9d700 1 --2- 172.21.15.103:0/592349877 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe920141f10 0x7fe9200b0b50 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fe9140019c0 tx=0x7fe918010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.497+0000 7fe90ffff700 1 -- 172.21.15.103:0/592349877 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9140016d0 con 0x7fe920141f10 2020-04-22T14:03:16.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.497+0000 7fe91ed9d700 1 --2- 172.21.15.103:0/592349877 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe920141f10 0x7fe9200b0b50 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fe9140019c0 tx=0x7fe918010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.497+0000 7fe91ed9d700 1 --2- 172.21.15.103:0/592349877 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe920141f10 0x7fe9200b0b50 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fe9140019c0 tx=0x7fe918010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.497+0000 7fe90ffff700 1 -- 172.21.15.103:0/592349877 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe918005e30 con 0x7fe920141f10 2020-04-22T14:03:16.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.497+0000 7fe925169700 1 -- 172.21.15.103:0/592349877 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9200b1f10 con 0x7fe920141f10 2020-04-22T14:03:16.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.497+0000 7fe90ffff700 1 -- 172.21.15.103:0/592349877 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe918007560 con 0x7fe920141f10 2020-04-22T14:03:16.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.497+0000 7fe925169700 1 -- 172.21.15.103:0/592349877 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9200b1170 con 0x7fe920141f10 2020-04-22T14:03:16.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.498+0000 7fe91ed9d700 1 --2- 172.21.15.103:0/592349877 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe920141f10 0x7fe9200b0b50 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fe9140019c0 tx=0x7fe918010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.498+0000 7fe925169700 1 -- 172.21.15.103:0/592349877 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe920056c90 con 0x7fe920141f10 2020-04-22T14:03:16.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.499+0000 7fe90ffff700 1 -- 172.21.15.103:0/592349877 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fe9180076c0 con 0x7fe920141f10 2020-04-22T14:03:16.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.499+0000 7fe91ed9d700 1 --2- 172.21.15.103:0/592349877 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe920141f10 0x7fe9200b0b50 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fe9140019c0 tx=0x7fe918010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.499+0000 7fe90ffff700 1 --2- 172.21.15.103:0/592349877 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe8fc04dc70 0x7fe8fc050130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:16.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.499+0000 7fe90ffff700 1 -- 172.21.15.103:0/592349877 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe918060fa0 con 0x7fe920141f10 2020-04-22T14:03:16.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.499+0000 7fe91e59c700 1 --2- 172.21.15.103:0/592349877 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe8fc04dc70 0x7fe8fc050130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:16.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.499+0000 7fe91e59c700 1 --2- 172.21.15.103:0/592349877 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe8fc04dc70 0x7fe8fc050130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe91400fa40 tx=0x7fe91400fa80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.499+0000 7fe91e59c700 1 --2- 172.21.15.103:0/592349877 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe8fc04dc70 0x7fe8fc050130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe91400fa40 tx=0x7fe91400fa80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.499+0000 7fe91e59c700 1 --2- 172.21.15.103:0/592349877 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe8fc04dc70 0x7fe8fc050130 secure :-1 s=READY pgs=128 cs=0 l=1 rx=0x7fe91400fa40 tx=0x7fe91400fa80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:16.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.503+0000 7fe91ed9d700 1 --2- 172.21.15.103:0/592349877 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe920141f10 0x7fe9200b0b50 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fe9140019c0 tx=0x7fe918010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.503+0000 7fe90ffff700 1 -- 172.21.15.103:0/592349877 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fe91803c320 con 0x7fe920141f10 2020-04-22T14:03:16.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.645+0000 7fe925169700 1 -- 172.21.15.103:0/592349877 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe920147360 con 0x7fe920141f10 2020-04-22T14:03:16.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.647+0000 7fe91ed9d700 1 --2- 172.21.15.103:0/592349877 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe920141f10 0x7fe9200b0b50 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fe9140019c0 tx=0x7fe918010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.647+0000 7fe90ffff700 1 -- 172.21.15.103:0/592349877 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16089 (secure 0 0 0) 0x7fe91803f940 con 0x7fe920141f10 2020-04-22T14:03:16.650 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:03:16.650 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":24,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:02:28.687155+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:02:25.963043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-22T14:02:26.642611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:03:16.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.648+0000 7fe925169700 1 -- 172.21.15.103:0/592349877 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe8fc04dc70 msgr2=0x7fe8fc050130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:16.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.648+0000 7fe925169700 1 --2- 172.21.15.103:0/592349877 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe8fc04dc70 0x7fe8fc050130 secure :-1 s=READY pgs=128 cs=0 l=1 rx=0x7fe91400fa40 tx=0x7fe91400fa80).stop 2020-04-22T14:03:16.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.648+0000 7fe925169700 1 -- 172.21.15.103:0/592349877 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe920141f10 msgr2=0x7fe9200b0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:16.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.648+0000 7fe925169700 1 --2- 172.21.15.103:0/592349877 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe920141f10 0x7fe9200b0b50 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7fe9140019c0 tx=0x7fe918010f60).stop 2020-04-22T14:03:16.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.648+0000 7fe925169700 1 -- 172.21.15.103:0/592349877 shutdown_connections 2020-04-22T14:03:16.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.648+0000 7fe925169700 1 --2- 172.21.15.103:0/592349877 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe8fc04dc70 0x7fe8fc050130 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:16.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.648+0000 7fe925169700 1 --2- 172.21.15.103:0/592349877 >> v2:172.21.15.86:3300/0 conn(0x7fe920157690 0x7fe920154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:16.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.648+0000 7fe925169700 1 --2- 172.21.15.103:0/592349877 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe920141f10 0x7fe9200b0b50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:16.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.648+0000 7fe925169700 1 -- 172.21.15.103:0/592349877 >> 172.21.15.103:0/592349877 conn(0x7fe9200b9160 msgr2=0x7fe92012afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:16.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.648+0000 7fe925169700 1 -- 172.21.15.103:0/592349877 shutdown_connections 2020-04-22T14:03:16.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.648+0000 7fe925169700 1 -- 172.21.15.103:0/592349877 wait complete. 2020-04-22T14:03:16.666 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:25.963043+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:26.642611+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 4, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'24', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:03:16.667 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:16.680 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:03:16.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.828+0000 7fa50bacd700 1 Processor -- start 2020-04-22T14:03:16.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.828+0000 7fa50bacd700 1 -- start start 2020-04-22T14:03:16.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.829+0000 7fa50bacd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa5040b9140 0x7fa50412b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:16.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.829+0000 7fa50bacd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5040ac950 0x7fa50412b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:16.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.829+0000 7fa50bacd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa504146c40 0x7fa5041470f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:16.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.829+0000 7fa50bacd700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5040602f0 con 0x7fa5040b9140 2020-04-22T14:03:16.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.829+0000 7fa50bacd700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5041467e0 con 0x7fa504146c40 2020-04-22T14:03:16.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.829+0000 7fa50bacd700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa504060050 con 0x7fa5040ac950 2020-04-22T14:03:16.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.829+0000 7fa50a06a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa504146c40 0x7fa5041470f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:16.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.829+0000 7fa50a06a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa504146c40 0x7fa5041470f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48188/0 (socket says 172.21.15.103:48188) 2020-04-22T14:03:16.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.829+0000 7fa50a06a700 1 -- 172.21.15.103:0/531592128 learned_addr learned my addr 172.21.15.103:0/531592128 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:16.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.829+0000 7fa509068700 1 --2- 172.21.15.103:0/531592128 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5040ac950 0x7fa50412b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:16.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.829+0000 7fa509869700 1 --2- 172.21.15.103:0/531592128 >> v2:172.21.15.86:3300/0 conn(0x7fa5040b9140 0x7fa50412b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:16.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.829+0000 7fa50a06a700 1 -- 172.21.15.103:0/531592128 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5040ac950 msgr2=0x7fa50412b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:16.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.829+0000 7fa50a06a700 1 --2- 172.21.15.103:0/531592128 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5040ac950 0x7fa50412b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:16.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.829+0000 7fa50a06a700 1 -- 172.21.15.103:0/531592128 >> v2:172.21.15.86:3300/0 conn(0x7fa5040b9140 msgr2=0x7fa50412b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:16.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.830+0000 7fa50a06a700 1 --2- 172.21.15.103:0/531592128 >> v2:172.21.15.86:3300/0 conn(0x7fa5040b9140 0x7fa50412b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:16.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.830+0000 7fa50a06a700 1 -- 172.21.15.103:0/531592128 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5040b9520 con 0x7fa504146c40 2020-04-22T14:03:16.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.830+0000 7fa50a06a700 1 --2- 172.21.15.103:0/531592128 >> v2:172.21.15.103:3300/0 conn(0x7fa504146c40 0x7fa5041470f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa4fc0032b0 tx=0x7fa4fc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.830+0000 7fa50a06a700 1 --2- 172.21.15.103:0/531592128 >> v2:172.21.15.103:3300/0 conn(0x7fa504146c40 0x7fa5041470f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa4fc0032b0 tx=0x7fa4fc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.830+0000 7fa50a06a700 1 --2- 172.21.15.103:0/531592128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa504146c40 0x7fa5041470f0 secure :-1 s=READY pgs=296 cs=0 l=1 rx=0x7fa4fc0032b0 tx=0x7fa4fc007dc0).ready entity=mon.1 client_cookie=f5f3a7c5c74c9fa8 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:16.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.830+0000 7fa50a06a700 1 --2- 172.21.15.103:0/531592128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa504146c40 0x7fa5041470f0 secure :-1 s=THROTTLE_DONE pgs=296 cs=0 l=1 rx=0x7fa4fc0032b0 tx=0x7fa4fc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.830+0000 7fa508867700 1 -- 172.21.15.103:0/531592128 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4fc011e30 con 0x7fa504146c40 2020-04-22T14:03:16.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.830+0000 7fa50a06a700 1 --2- 172.21.15.103:0/531592128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa504146c40 0x7fa5041470f0 secure :-1 s=THROTTLE_DONE pgs=296 cs=0 l=1 rx=0x7fa4fc0032b0 tx=0x7fa4fc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.830+0000 7fa50a06a700 1 --2- 172.21.15.103:0/531592128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa504146c40 0x7fa5041470f0 secure :-1 s=THROTTLE_DONE pgs=296 cs=0 l=1 rx=0x7fa4fc0032b0 tx=0x7fa4fc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.830+0000 7fa508867700 1 -- 172.21.15.103:0/531592128 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4fc00a180 con 0x7fa504146c40 2020-04-22T14:03:16.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.830+0000 7fa508867700 1 -- 172.21.15.103:0/531592128 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4fc00a5a0 con 0x7fa504146c40 2020-04-22T14:03:16.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.830+0000 7fa50bacd700 1 -- 172.21.15.103:0/531592128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa504146c40 msgr2=0x7fa5041470f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:16.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.830+0000 7fa50bacd700 1 --2- 172.21.15.103:0/531592128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa504146c40 0x7fa5041470f0 secure :-1 s=READY pgs=296 cs=0 l=1 rx=0x7fa4fc0032b0 tx=0x7fa4fc007dc0).stop 2020-04-22T14:03:16.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.830+0000 7fa50bacd700 1 -- 172.21.15.103:0/531592128 shutdown_connections 2020-04-22T14:03:16.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.830+0000 7fa50bacd700 1 --2- 172.21.15.103:0/531592128 >> v2:172.21.15.86:3300/0 conn(0x7fa5040b9140 0x7fa50412b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:16.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.830+0000 7fa50bacd700 1 --2- 172.21.15.103:0/531592128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa504146c40 0x7fa5041470f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:16.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.830+0000 7fa50bacd700 1 --2- 172.21.15.103:0/531592128 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5040ac950 0x7fa50412b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:16.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.830+0000 7fa50bacd700 1 -- 172.21.15.103:0/531592128 >> 172.21.15.103:0/531592128 conn(0x7fa50405b7b0 msgr2=0x7fa5040b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:16.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.830+0000 7fa50bacd700 1 -- 172.21.15.103:0/531592128 shutdown_connections 2020-04-22T14:03:16.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.830+0000 7fa50bacd700 1 -- 172.21.15.103:0/531592128 wait complete. 2020-04-22T14:03:16.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.831+0000 7fa50bacd700 1 Processor -- start 2020-04-22T14:03:16.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.831+0000 7fa50bacd700 1 -- start start 2020-04-22T14:03:16.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.832+0000 7fa50bacd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5040b9140 0x7fa5041507f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:16.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.832+0000 7fa50bacd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa504146c40 0x7fa504150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:16.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.832+0000 7fa50bacd700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5040b43e0 con 0x7fa5040ac950 2020-04-22T14:03:16.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.832+0000 7fa50bacd700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5040b5b40 con 0x7fa504146c40 2020-04-22T14:03:16.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.832+0000 7fa50bacd700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5040b5de0 con 0x7fa5040b9140 2020-04-22T14:03:16.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.832+0000 7fa509869700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa5040ac950 0x7fa504062a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40384/0 (socket says 172.21.15.103:40384) 2020-04-22T14:03:16.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.832+0000 7fa509869700 1 -- 172.21.15.103:0/2954415090 learned_addr learned my addr 172.21.15.103:0/2954415090 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:16.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.832+0000 7fa50a06a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa504146c40 0x7fa504150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:16.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.832+0000 7fa509068700 1 --2- 172.21.15.103:0/2954415090 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5040b9140 0x7fa5041507f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:16.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.832+0000 7fa50a06a700 1 -- 172.21.15.103:0/2954415090 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5040b9140 msgr2=0x7fa5041507f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:16.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.832+0000 7fa50a06a700 1 --2- 172.21.15.103:0/2954415090 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5040b9140 0x7fa5041507f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:16.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.832+0000 7fa4f2ffd700 1 -- 172.21.15.103:0/2954415090 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 699000169 0 0) 0x7fa5040b43e0 con 0x7fa5040ac950 2020-04-22T14:03:16.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.832+0000 7fa50a06a700 1 -- 172.21.15.103:0/2954415090 >> v1:172.21.15.103:6789/0 conn(0x7fa5040ac950 legacy=0x7fa504062a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:16.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.832+0000 7fa50a06a700 1 -- 172.21.15.103:0/2954415090 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5040b5830 con 0x7fa504146c40 2020-04-22T14:03:16.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.833+0000 7fa50a06a700 1 --2- 172.21.15.103:0/2954415090 >> v2:172.21.15.103:3300/0 conn(0x7fa504146c40 0x7fa504150c50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa4fc0032b0 tx=0x7fa4fc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.833+0000 7fa50a06a700 1 --2- 172.21.15.103:0/2954415090 >> v2:172.21.15.103:3300/0 conn(0x7fa504146c40 0x7fa504150c50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa4fc0032b0 tx=0x7fa4fc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.833+0000 7fa50a06a700 1 --2- 172.21.15.103:0/2954415090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa504146c40 0x7fa504150c50 secure :-1 s=READY pgs=298 cs=0 l=1 rx=0x7fa4fc0032b0 tx=0x7fa4fc007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:16.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.833+0000 7fa50a06a700 1 --2- 172.21.15.103:0/2954415090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa504146c40 0x7fa504150c50 secure :-1 s=THROTTLE_DONE pgs=298 cs=0 l=1 rx=0x7fa4fc0032b0 tx=0x7fa4fc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.833+0000 7fa4f2ffd700 1 -- 172.21.15.103:0/2954415090 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4fc0114d0 con 0x7fa504146c40 2020-04-22T14:03:16.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.833+0000 7fa50a06a700 1 --2- 172.21.15.103:0/2954415090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa504146c40 0x7fa504150c50 secure :-1 s=THROTTLE_DONE pgs=298 cs=0 l=1 rx=0x7fa4fc0032b0 tx=0x7fa4fc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.833+0000 7fa50a06a700 1 --2- 172.21.15.103:0/2954415090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa504146c40 0x7fa504150c50 secure :-1 s=THROTTLE_DONE pgs=298 cs=0 l=1 rx=0x7fa4fc0032b0 tx=0x7fa4fc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.833+0000 7fa4f2ffd700 1 -- 172.21.15.103:0/2954415090 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4fc005a40 con 0x7fa504146c40 2020-04-22T14:03:16.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.833+0000 7fa50bacd700 1 -- 172.21.15.103:0/2954415090 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa504063140 con 0x7fa504146c40 2020-04-22T14:03:16.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.833+0000 7fa4f2ffd700 1 -- 172.21.15.103:0/2954415090 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4fc005da0 con 0x7fa504146c40 2020-04-22T14:03:16.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.833+0000 7fa50bacd700 1 -- 172.21.15.103:0/2954415090 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5040b15c0 con 0x7fa504146c40 2020-04-22T14:03:16.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.833+0000 7fa50a06a700 1 --2- 172.21.15.103:0/2954415090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa504146c40 0x7fa504150c50 secure :-1 s=THROTTLE_DONE pgs=298 cs=0 l=1 rx=0x7fa4fc0032b0 tx=0x7fa4fc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.834+0000 7fa4f2ffd700 1 -- 172.21.15.103:0/2954415090 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fa4fc0105e0 con 0x7fa504146c40 2020-04-22T14:03:16.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.834+0000 7fa50a06a700 1 --2- 172.21.15.103:0/2954415090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa504146c40 0x7fa504150c50 secure :-1 s=THROTTLE_DONE pgs=298 cs=0 l=1 rx=0x7fa4fc0032b0 tx=0x7fa4fc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.834+0000 7fa50bacd700 1 -- 172.21.15.103:0/2954415090 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa504056c90 con 0x7fa504146c40 2020-04-22T14:03:16.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.834+0000 7fa4f2ffd700 1 --2- 172.21.15.103:0/2954415090 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa4e404d830 0x7fa4e404fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:16.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.834+0000 7fa4f2ffd700 1 -- 172.21.15.103:0/2954415090 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa4fc0641d0 con 0x7fa504146c40 2020-04-22T14:03:16.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.834+0000 7fa509869700 1 --2- 172.21.15.103:0/2954415090 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa4e404d830 0x7fa4e404fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:16.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.835+0000 7fa509869700 1 --2- 172.21.15.103:0/2954415090 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa4e404d830 0x7fa4e404fcf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa4f4007a90 tx=0x7fa4f40098a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.835+0000 7fa509869700 1 --2- 172.21.15.103:0/2954415090 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa4e404d830 0x7fa4e404fcf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa4f4007a90 tx=0x7fa4f40098a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.835+0000 7fa509869700 1 --2- 172.21.15.103:0/2954415090 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa4e404d830 0x7fa4e404fcf0 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7fa4f4007a90 tx=0x7fa4f40098a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:16.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.838+0000 7fa50a06a700 1 --2- 172.21.15.103:0/2954415090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa504146c40 0x7fa504150c50 secure :-1 s=THROTTLE_DONE pgs=298 cs=0 l=1 rx=0x7fa4fc0032b0 tx=0x7fa4fc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.838+0000 7fa4f2ffd700 1 -- 172.21.15.103:0/2954415090 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fa4fc03f610 con 0x7fa504146c40 2020-04-22T14:03:16.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.980+0000 7fa50bacd700 1 -- 172.21.15.103:0/2954415090 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fa5040b5f20 con 0x7fa504146c40 2020-04-22T14:03:16.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.981+0000 7fa50a06a700 1 --2- 172.21.15.103:0/2954415090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa504146c40 0x7fa504150c50 secure :-1 s=THROTTLE_DONE pgs=298 cs=0 l=1 rx=0x7fa4fc0032b0 tx=0x7fa4fc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:16.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.981+0000 7fa4f2ffd700 1 -- 172.21.15.103:0/2954415090 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v24) v1 ==== 110+0+10 (secure 0 0 0) 0x7fa4fc042c30 con 0x7fa504146c40 2020-04-22T14:03:16.983 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:03:16.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.982+0000 7fa50bacd700 1 -- 172.21.15.103:0/2954415090 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa4e404d830 msgr2=0x7fa4e404fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:16.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.982+0000 7fa50bacd700 1 --2- 172.21.15.103:0/2954415090 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa4e404d830 0x7fa4e404fcf0 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7fa4f4007a90 tx=0x7fa4f40098a0).stop 2020-04-22T14:03:16.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.982+0000 7fa50bacd700 1 -- 172.21.15.103:0/2954415090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa504146c40 msgr2=0x7fa504150c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:16.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.982+0000 7fa50bacd700 1 --2- 172.21.15.103:0/2954415090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa504146c40 0x7fa504150c50 secure :-1 s=READY pgs=298 cs=0 l=1 rx=0x7fa4fc0032b0 tx=0x7fa4fc007dc0).stop 2020-04-22T14:03:16.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.982+0000 7fa50bacd700 1 -- 172.21.15.103:0/2954415090 shutdown_connections 2020-04-22T14:03:16.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.982+0000 7fa50bacd700 1 --2- 172.21.15.103:0/2954415090 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa4e404d830 0x7fa4e404fcf0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:16.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.982+0000 7fa50bacd700 1 --2- 172.21.15.103:0/2954415090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa504146c40 0x7fa504150c50 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:16.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.982+0000 7fa50bacd700 1 --2- 172.21.15.103:0/2954415090 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5040b9140 0x7fa5041507f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:16.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.982+0000 7fa50bacd700 1 -- 172.21.15.103:0/2954415090 >> 172.21.15.103:0/2954415090 conn(0x7fa50405b7b0 msgr2=0x7fa504143e50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:16.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.982+0000 7fa50bacd700 1 -- 172.21.15.103:0/2954415090 shutdown_connections 2020-04-22T14:03:16.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:16.982+0000 7fa50bacd700 1 -- 172.21.15.103:0/2954415090 wait complete. 2020-04-22T14:03:16.994 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:17.011 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:03:17.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.158+0000 7fdebb60b700 1 Processor -- start 2020-04-22T14:03:17.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.158+0000 7fdebb60b700 1 -- start start 2020-04-22T14:03:17.162 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.159+0000 7fdebb60b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdeb4143090 0x7fdeb4143520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:17.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.159+0000 7fdebb60b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeb41467e0 con 0x7fdeb40b9140 2020-04-22T14:03:17.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.159+0000 7fdebb60b700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeb4060050 con 0x7fdeb40ac950 2020-04-22T14:03:17.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.159+0000 7fdebb60b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeb40602f0 con 0x7fdeb4143090 2020-04-22T14:03:17.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.159+0000 7fdeb8ba6700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fdeb40ac950 0x7fdeb4146c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40394/0 (socket says 172.21.15.103:40394) 2020-04-22T14:03:17.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.159+0000 7fdeb8ba6700 1 -- 172.21.15.103:0/858197338 learned_addr learned my addr 172.21.15.103:0/858197338 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:17.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.159+0000 7fdeb9ba8700 1 --2- 172.21.15.103:0/858197338 >> v2:172.21.15.86:3300/0 conn(0x7fdeb4143090 0x7fdeb4143520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:17.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.159+0000 7fdea3fff700 1 -- 172.21.15.103:0/858197338 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1391905610 0 0) 0x7fdeb4060050 con 0x7fdeb40ac950 2020-04-22T14:03:17.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.159+0000 7fdea3fff700 1 -- 172.21.15.103:0/858197338 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde9c003230 con 0x7fdeb40ac950 2020-04-22T14:03:17.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.159+0000 7fdeb9ba8700 1 -- 172.21.15.103:0/858197338 >> v1:172.21.15.103:6789/0 conn(0x7fdeb40ac950 legacy=0x7fdeb4146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:17.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.159+0000 7fdeb9ba8700 1 -- 172.21.15.103:0/858197338 >> v1:172.21.15.86:6789/0 conn(0x7fdeb40b9140 legacy=0x7fdeb412b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:17.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.159+0000 7fdeb9ba8700 1 -- 172.21.15.103:0/858197338 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb40b9520 con 0x7fdeb4143090 2020-04-22T14:03:17.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.159+0000 7fdeb9ba8700 1 --2- 172.21.15.103:0/858197338 >> v2:172.21.15.86:3300/0 conn(0x7fdeb4143090 0x7fdeb4143520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdea40010d0 tx=0x7fdeac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.160+0000 7fdeb9ba8700 1 --2- 172.21.15.103:0/858197338 >> v2:172.21.15.86:3300/0 conn(0x7fdeb4143090 0x7fdeb4143520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdea40010d0 tx=0x7fdeac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.160+0000 7fdeb9ba8700 1 --2- 172.21.15.103:0/858197338 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdeb4143090 0x7fdeb4143520 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7fdea40010d0 tx=0x7fdeac007dc0).ready entity=mon.0 client_cookie=fd9c2981b8655bdb server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:17.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.160+0000 7fdeb9ba8700 1 --2- 172.21.15.103:0/858197338 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdeb4143090 0x7fdeb4143520 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7fdea40010d0 tx=0x7fdeac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.160+0000 7fdea3fff700 1 -- 172.21.15.103:0/858197338 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdeac010cb0 con 0x7fdeb4143090 2020-04-22T14:03:17.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.160+0000 7fdeb9ba8700 1 --2- 172.21.15.103:0/858197338 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdeb4143090 0x7fdeb4143520 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7fdea40010d0 tx=0x7fdeac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.160+0000 7fdeb9ba8700 1 --2- 172.21.15.103:0/858197338 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdeb4143090 0x7fdeb4143520 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7fdea40010d0 tx=0x7fdeac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.160+0000 7fdea3fff700 1 -- 172.21.15.103:0/858197338 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeac010e10 con 0x7fdeb4143090 2020-04-22T14:03:17.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.160+0000 7fdea3fff700 1 -- 172.21.15.103:0/858197338 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdeac0112c0 con 0x7fdeb4143090 2020-04-22T14:03:17.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.160+0000 7fdebb60b700 1 -- 172.21.15.103:0/858197338 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdeb4143090 msgr2=0x7fdeb4143520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:17.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.160+0000 7fdebb60b700 1 --2- 172.21.15.103:0/858197338 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdeb4143090 0x7fdeb4143520 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7fdea40010d0 tx=0x7fdeac007dc0).stop 2020-04-22T14:03:17.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.160+0000 7fdebb60b700 1 -- 172.21.15.103:0/858197338 shutdown_connections 2020-04-22T14:03:17.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.160+0000 7fdebb60b700 1 --2- 172.21.15.103:0/858197338 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdeb4143090 0x7fdeb4143520 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:17.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.160+0000 7fdebb60b700 1 -- 172.21.15.103:0/858197338 >> 172.21.15.103:0/858197338 conn(0x7fdeb405b7b0 msgr2=0x7fdeb40b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:17.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.160+0000 7fdebb60b700 1 -- 172.21.15.103:0/858197338 shutdown_connections 2020-04-22T14:03:17.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.160+0000 7fdebb60b700 1 -- 172.21.15.103:0/858197338 wait complete. 2020-04-22T14:03:17.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.161+0000 7fdebb60b700 1 Processor -- start 2020-04-22T14:03:17.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.161+0000 7fdebb60b700 1 -- start start 2020-04-22T14:03:17.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.162+0000 7fdebb60b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdeb40b9140 0x7fdeb4136a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:17.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.162+0000 7fdebb60b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdeb4143090 0x7fdeb4157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:17.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.162+0000 7fdebb60b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeb40b0800 con 0x7fdeb40ac950 2020-04-22T14:03:17.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.162+0000 7fdebb60b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeb4136ee0 con 0x7fdeb4143090 2020-04-22T14:03:17.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.162+0000 7fdebb60b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb40b0a30 con 0x7fdeb40b9140 2020-04-22T14:03:17.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.162+0000 7fdeb9ba8700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdeb4143090 0x7fdeb4157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:17.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.162+0000 7fdeb8ba6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdeb40b9140 0x7fdeb4136a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:17.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.162+0000 7fdeb9ba8700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdeb4143090 0x7fdeb4157f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:45444/0 (socket says 172.21.15.103:45444) 2020-04-22T14:03:17.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.162+0000 7fdeb9ba8700 1 -- 172.21.15.103:0/3139613183 learned_addr learned my addr 172.21.15.103:0/3139613183 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:17.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.162+0000 7fdeb93a7700 1 --1- 172.21.15.103:0/3139613183 >> v1:172.21.15.86:6789/0 conn(0x7fdeb40ac950 0x7fdeb41577f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:57554/0 (socket says 172.21.15.103:57554) 2020-04-22T14:03:17.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.163+0000 7fdeb8ba6700 1 -- 172.21.15.103:0/3139613183 >> v2:172.21.15.86:3300/0 conn(0x7fdeb4143090 msgr2=0x7fdeb4157f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:17.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.163+0000 7fdeb8ba6700 1 --2- 172.21.15.103:0/3139613183 >> v2:172.21.15.86:3300/0 conn(0x7fdeb4143090 0x7fdeb4157f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:17.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.163+0000 7fdeb8ba6700 1 -- 172.21.15.103:0/3139613183 >> v1:172.21.15.86:6789/0 conn(0x7fdeb40ac950 legacy=0x7fdeb41577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:17.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.163+0000 7fdeb8ba6700 1 -- 172.21.15.103:0/3139613183 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb40b2a10 con 0x7fdeb40b9140 2020-04-22T14:03:17.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.163+0000 7fdeb9ba8700 1 --2- 172.21.15.103:0/3139613183 >> v2:172.21.15.86:3300/0 conn(0x7fdeb4143090 0x7fdeb4157f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:03:17.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.163+0000 7fdeb8ba6700 1 --2- 172.21.15.103:0/3139613183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdeb40b9140 0x7fdeb4136a80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdeb0001110 tx=0x7fdeb00108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.163+0000 7fdeb8ba6700 1 --2- 172.21.15.103:0/3139613183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdeb40b9140 0x7fdeb4136a80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdeb0001110 tx=0x7fdeb00108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.163+0000 7fdeb8ba6700 1 --2- 172.21.15.103:0/3139613183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdeb40b9140 0x7fdeb4136a80 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7fdeb0001110 tx=0x7fdeb00108b0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:17.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.163+0000 7fdeb8ba6700 1 --2- 172.21.15.103:0/3139613183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdeb40b9140 0x7fdeb4136a80 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fdeb0001110 tx=0x7fdeb00108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.163+0000 7fdea27fc700 1 -- 172.21.15.103:0/3139613183 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdeb0005cc0 con 0x7fdeb40b9140 2020-04-22T14:03:17.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.163+0000 7fdeb8ba6700 1 --2- 172.21.15.103:0/3139613183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdeb40b9140 0x7fdeb4136a80 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fdeb0001110 tx=0x7fdeb00108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.163+0000 7fdea27fc700 1 -- 172.21.15.103:0/3139613183 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb0005e20 con 0x7fdeb40b9140 2020-04-22T14:03:17.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.163+0000 7fdeb8ba6700 1 --2- 172.21.15.103:0/3139613183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdeb40b9140 0x7fdeb4136a80 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fdeb0001110 tx=0x7fdeb00108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.163+0000 7fdebb60b700 1 -- 172.21.15.103:0/3139613183 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeb40b2540 con 0x7fdeb40b9140 2020-04-22T14:03:17.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.163+0000 7fdea27fc700 1 -- 172.21.15.103:0/3139613183 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdeb00062c0 con 0x7fdeb40b9140 2020-04-22T14:03:17.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.163+0000 7fdebb60b700 1 -- 172.21.15.103:0/3139613183 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeb4142660 con 0x7fdeb40b9140 2020-04-22T14:03:17.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.164+0000 7fdeb8ba6700 1 --2- 172.21.15.103:0/3139613183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdeb40b9140 0x7fdeb4136a80 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fdeb0001110 tx=0x7fdeb00108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.164+0000 7fdebb60b700 1 -- 172.21.15.103:0/3139613183 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeb4056c90 con 0x7fdeb40b9140 2020-04-22T14:03:17.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.164+0000 7fdea27fc700 1 -- 172.21.15.103:0/3139613183 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fdeb0006500 con 0x7fdeb40b9140 2020-04-22T14:03:17.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.164+0000 7fdeb8ba6700 1 --2- 172.21.15.103:0/3139613183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdeb40b9140 0x7fdeb4136a80 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fdeb0001110 tx=0x7fdeb00108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.164+0000 7fdea27fc700 1 --2- 172.21.15.103:0/3139613183 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fde9404d930 0x7fde9404fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:17.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.164+0000 7fdea27fc700 1 -- 172.21.15.103:0/3139613183 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdeb00090c0 con 0x7fdeb40b9140 2020-04-22T14:03:17.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.164+0000 7fdeb93a7700 1 --2- 172.21.15.103:0/3139613183 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fde9404d930 0x7fde9404fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:17.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.165+0000 7fdeb93a7700 1 --2- 172.21.15.103:0/3139613183 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fde9404d930 0x7fde9404fdf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdeb40b0cd0 tx=0x7fdea4000fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.165+0000 7fdeb93a7700 1 --2- 172.21.15.103:0/3139613183 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fde9404d930 0x7fde9404fdf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdeb40b0cd0 tx=0x7fdea4000fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.165+0000 7fdeb93a7700 1 --2- 172.21.15.103:0/3139613183 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fde9404d930 0x7fde9404fdf0 secure :-1 s=READY pgs=130 cs=0 l=1 rx=0x7fdeb40b0cd0 tx=0x7fdea4000fe0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:17.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.168+0000 7fdeb8ba6700 1 --2- 172.21.15.103:0/3139613183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdeb40b9140 0x7fdeb4136a80 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fdeb0001110 tx=0x7fdeb00108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.168+0000 7fdea27fc700 1 -- 172.21.15.103:0/3139613183 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fdeb003c830 con 0x7fdeb40b9140 2020-04-22T14:03:17.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.312+0000 7fdebb60b700 1 -- 172.21.15.103:0/3139613183 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdeb4066ce0 con 0x7fdeb40b9140 2020-04-22T14:03:17.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.312+0000 7fdeb8ba6700 1 --2- 172.21.15.103:0/3139613183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdeb40b9140 0x7fdeb4136a80 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fdeb0001110 tx=0x7fdeb00108b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.313+0000 7fdea27fc700 1 -- 172.21.15.103:0/3139613183 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdeb003fe50 con 0x7fdeb40b9140 2020-04-22T14:03:17.315 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:03:17.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.314+0000 7fdebb60b700 1 -- 172.21.15.103:0/3139613183 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fde9404d930 msgr2=0x7fde9404fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:17.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.314+0000 7fdebb60b700 1 --2- 172.21.15.103:0/3139613183 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fde9404d930 0x7fde9404fdf0 secure :-1 s=READY pgs=130 cs=0 l=1 rx=0x7fdeb40b0cd0 tx=0x7fdea4000fe0).stop 2020-04-22T14:03:17.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.314+0000 7fdebb60b700 1 -- 172.21.15.103:0/3139613183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdeb40b9140 msgr2=0x7fdeb4136a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:17.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.314+0000 7fdebb60b700 1 --2- 172.21.15.103:0/3139613183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdeb40b9140 0x7fdeb4136a80 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7fdeb0001110 tx=0x7fdeb00108b0).stop 2020-04-22T14:03:17.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.314+0000 7fdebb60b700 1 -- 172.21.15.103:0/3139613183 shutdown_connections 2020-04-22T14:03:17.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.314+0000 7fdebb60b700 1 --2- 172.21.15.103:0/3139613183 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fde9404d930 0x7fde9404fdf0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:17.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.314+0000 7fdebb60b700 1 --2- 172.21.15.103:0/3139613183 >> v2:172.21.15.86:3300/0 conn(0x7fdeb4143090 0x7fdeb4157f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:17.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.314+0000 7fdebb60b700 1 --2- 172.21.15.103:0/3139613183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdeb40b9140 0x7fdeb4136a80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:17.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.314+0000 7fdebb60b700 1 -- 172.21.15.103:0/3139613183 >> 172.21.15.103:0/3139613183 conn(0x7fdeb405b7b0 msgr2=0x7fdeb40b7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:17.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.314+0000 7fdebb60b700 1 -- 172.21.15.103:0/3139613183 shutdown_connections 2020-04-22T14:03:17.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.314+0000 7fdebb60b700 1 -- 172.21.15.103:0/3139613183 wait complete. 2020-04-22T14:03:17.326 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:17.339 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-22T14:03:17.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.488+0000 7f7824af0700 1 Processor -- start 2020-04-22T14:03:17.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.488+0000 7f7824af0700 1 -- start start 2020-04-22T14:03:17.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.489+0000 7f7824af0700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f78200ac950 0x7f7820146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:17.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.489+0000 7f7824af0700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78201467e0 con 0x7f78200b9140 2020-04-22T14:03:17.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.489+0000 7f7824af0700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7820060050 con 0x7f78201470a0 2020-04-22T14:03:17.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.489+0000 7f7824af0700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7820147530 con 0x7f78200ac950 2020-04-22T14:03:17.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.489+0000 7f781ed9d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f78201470a0 0x7f7820143090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40408/0 (socket says 172.21.15.103:40408) 2020-04-22T14:03:17.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.489+0000 7f781ed9d700 1 -- 172.21.15.103:0/2214071596 learned_addr learned my addr 172.21.15.103:0/2214071596 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:17.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.489+0000 7f781dd9b700 1 --2- 172.21.15.103:0/2214071596 >> v2:172.21.15.86:3300/0 conn(0x7f78200ac950 0x7f7820146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:17.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.489+0000 7f781d59a700 1 -- 172.21.15.103:0/2214071596 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2426549817 0 0) 0x7f7820060050 con 0x7f78201470a0 2020-04-22T14:03:17.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.489+0000 7f781d59a700 1 -- 172.21.15.103:0/2214071596 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7800003230 con 0x7f78201470a0 2020-04-22T14:03:17.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.489+0000 7f781d59a700 1 -- 172.21.15.103:0/2214071596 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 221228934 0 0) 0x7f78201467e0 con 0x7f78200b9140 2020-04-22T14:03:17.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.489+0000 7f781d59a700 1 -- 172.21.15.103:0/2214071596 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7820060050 con 0x7f78200b9140 2020-04-22T14:03:17.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.489+0000 7f781d59a700 1 -- 172.21.15.103:0/2214071596 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3987190910 0 0) 0x7f7800003230 con 0x7f78201470a0 2020-04-22T14:03:17.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.489+0000 7f781d59a700 1 -- 172.21.15.103:0/2214071596 >> v2:172.21.15.86:3300/0 conn(0x7f78200ac950 msgr2=0x7f7820146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:17.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.489+0000 7f781d59a700 1 --2- 172.21.15.103:0/2214071596 >> v2:172.21.15.86:3300/0 conn(0x7f78200ac950 0x7f7820146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:17.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.489+0000 7f781d59a700 1 -- 172.21.15.103:0/2214071596 >> v1:172.21.15.86:6789/0 conn(0x7f78200b9140 legacy=0x7f782012b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:17.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.489+0000 7f781d59a700 1 -- 172.21.15.103:0/2214071596 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78200b9520 con 0x7f78201470a0 2020-04-22T14:03:17.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.489+0000 7f781d59a700 1 -- 172.21.15.103:0/2214071596 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f7810001710 con 0x7f78201470a0 2020-04-22T14:03:17.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.489+0000 7f781dd9b700 1 --2- 172.21.15.103:0/2214071596 >> v2:172.21.15.86:3300/0 conn(0x7f78200ac950 0x7f7820146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:03:17.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.489+0000 7f781d59a700 1 -- 172.21.15.103:0/2214071596 >> v1:172.21.15.103:6789/0 conn(0x7f78201470a0 legacy=0x7f7820143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:17.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.489+0000 7f781d59a700 1 --2- 172.21.15.103:0/2214071596 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78000038b0 0x7f7800003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:17.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.489+0000 7f781d59a700 1 --2- 172.21.15.103:0/2214071596 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78000044d0 0x7f7800004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:17.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.489+0000 7f781d59a700 1 --2- 172.21.15.103:0/2214071596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7800004db0 0x7f780000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:17.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.489+0000 7f781d59a700 1 -- 172.21.15.103:0/2214071596 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7800005370 con 0x7f7800004db0 2020-04-22T14:03:17.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.489+0000 7f781d59a700 1 -- 172.21.15.103:0/2214071596 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780000bb80 con 0x7f78000044d0 2020-04-22T14:03:17.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.489+0000 7f781d59a700 1 -- 172.21.15.103:0/2214071596 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780000bd40 con 0x7f78000038b0 2020-04-22T14:03:17.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.490+0000 7f781dd9b700 1 --2- 172.21.15.103:0/2214071596 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78000044d0 0x7f7800004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:17.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.490+0000 7f781ed9d700 1 --2- 172.21.15.103:0/2214071596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7800004db0 0x7f780000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:17.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.490+0000 7f781e59c700 1 --2- 172.21.15.103:0/2214071596 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78000038b0 0x7f7800003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:17.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.490+0000 7f781dd9b700 1 -- 172.21.15.103:0/2214071596 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78000038b0 msgr2=0x7f7800003cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:17.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.490+0000 7f781dd9b700 1 --2- 172.21.15.103:0/2214071596 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78000038b0 0x7f7800003cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:17.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.490+0000 7f781dd9b700 1 -- 172.21.15.103:0/2214071596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7800004db0 msgr2=0x7f780000b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:17.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.490+0000 7f781dd9b700 1 --2- 172.21.15.103:0/2214071596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7800004db0 0x7f780000b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:17.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.490+0000 7f781dd9b700 1 -- 172.21.15.103:0/2214071596 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7800003230 con 0x7f78000044d0 2020-04-22T14:03:17.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.490+0000 7f781ed9d700 1 -- 172.21.15.103:0/2214071596 reap_dead start 2020-04-22T14:03:17.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.490+0000 7f781dd9b700 1 --2- 172.21.15.103:0/2214071596 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78000044d0 0x7f7800004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7808002f30 tx=0x7f780800bea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.490+0000 7f781dd9b700 1 --2- 172.21.15.103:0/2214071596 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78000044d0 0x7f7800004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7808002f30 tx=0x7f780800bea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.490+0000 7f781dd9b700 1 --2- 172.21.15.103:0/2214071596 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78000044d0 0x7f7800004950 secure :-1 s=READY pgs=301 cs=0 l=1 rx=0x7f7808002f30 tx=0x7f780800bea0).ready entity=mon.1 client_cookie=3fe622d43c5993c5 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:17.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.490+0000 7f781dd9b700 1 --2- 172.21.15.103:0/2214071596 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78000044d0 0x7f7800004950 secure :-1 s=THROTTLE_DONE pgs=301 cs=0 l=1 rx=0x7f7808002f30 tx=0x7f780800bea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.490+0000 7f781d59a700 1 -- 172.21.15.103:0/2214071596 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f780800e720 con 0x7f78000044d0 2020-04-22T14:03:17.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.490+0000 7f781dd9b700 1 --2- 172.21.15.103:0/2214071596 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78000044d0 0x7f7800004950 secure :-1 s=THROTTLE_DONE pgs=301 cs=0 l=1 rx=0x7f7808002f30 tx=0x7f780800bea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.490+0000 7f781dd9b700 1 --2- 172.21.15.103:0/2214071596 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78000044d0 0x7f7800004950 secure :-1 s=THROTTLE_DONE pgs=301 cs=0 l=1 rx=0x7f7808002f30 tx=0x7f780800bea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.490+0000 7f781d59a700 1 -- 172.21.15.103:0/2214071596 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780800e880 con 0x7f78000044d0 2020-04-22T14:03:17.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.490+0000 7f781d59a700 1 -- 172.21.15.103:0/2214071596 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f780800ec20 con 0x7f78000044d0 2020-04-22T14:03:17.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.490+0000 7f7824af0700 1 -- 172.21.15.103:0/2214071596 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78000044d0 msgr2=0x7f7800004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:17.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.490+0000 7f7824af0700 1 --2- 172.21.15.103:0/2214071596 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78000044d0 0x7f7800004950 secure :-1 s=READY pgs=301 cs=0 l=1 rx=0x7f7808002f30 tx=0x7f780800bea0).stop 2020-04-22T14:03:17.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.491+0000 7f7824af0700 1 -- 172.21.15.103:0/2214071596 shutdown_connections 2020-04-22T14:03:17.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.491+0000 7f7824af0700 1 --2- 172.21.15.103:0/2214071596 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78000044d0 0x7f7800004950 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:17.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.491+0000 7f7824af0700 1 -- 172.21.15.103:0/2214071596 >> 172.21.15.103:0/2214071596 conn(0x7f782005b7b0 msgr2=0x7f78200b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:17.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.491+0000 7f7824af0700 1 -- 172.21.15.103:0/2214071596 shutdown_connections 2020-04-22T14:03:17.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.491+0000 7f7824af0700 1 -- 172.21.15.103:0/2214071596 wait complete. 2020-04-22T14:03:17.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.492+0000 7f7824af0700 1 Processor -- start 2020-04-22T14:03:17.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.492+0000 7f7824af0700 1 -- start start 2020-04-22T14:03:17.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.492+0000 7f7824af0700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f78000044d0 0x7f7820141f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:17.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.492+0000 7f7824af0700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f78201501e0 0x7f7820150650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:17.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.492+0000 7f7824af0700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f782014f120 con 0x7f782014fb00 2020-04-22T14:03:17.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.492+0000 7f7824af0700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f782014f3c0 con 0x7f78201501e0 2020-04-22T14:03:17.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.492+0000 7f7824af0700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f782014f660 con 0x7f78000044d0 2020-04-22T14:03:17.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.492+0000 7f781e59c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f78000044d0 0x7f7820141f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:17.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.492+0000 7f781dd9b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f782014fb00 0x7f78200afa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40422/0 (socket says 172.21.15.103:40422) 2020-04-22T14:03:17.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.492+0000 7f781e59c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f78000044d0 0x7f7820141f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48228/0 (socket says 172.21.15.103:48228) 2020-04-22T14:03:17.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.492+0000 7f781dd9b700 1 -- 172.21.15.103:0/2844066373 learned_addr learned my addr 172.21.15.103:0/2844066373 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:17.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.493+0000 7f781ed9d700 1 --2- 172.21.15.103:0/2844066373 >> v2:172.21.15.86:3300/0 conn(0x7f78201501e0 0x7f7820150650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:17.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.493+0000 7f781e59c700 1 -- 172.21.15.103:0/2844066373 >> v2:172.21.15.86:3300/0 conn(0x7f78201501e0 msgr2=0x7f7820150650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:17.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.493+0000 7f781e59c700 1 --2- 172.21.15.103:0/2844066373 >> v2:172.21.15.86:3300/0 conn(0x7f78201501e0 0x7f7820150650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:17.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.493+0000 7f781e59c700 1 -- 172.21.15.103:0/2844066373 >> v1:172.21.15.103:6789/0 conn(0x7f782014fb00 legacy=0x7f78200afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:17.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.493+0000 7f78177fe700 1 -- 172.21.15.103:0/2844066373 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4239364878 0 0) 0x7f782014f120 con 0x7f782014fb00 2020-04-22T14:03:17.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.493+0000 7f781e59c700 1 -- 172.21.15.103:0/2844066373 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f782014ff60 con 0x7f78000044d0 2020-04-22T14:03:17.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.493+0000 7f781e59c700 1 --2- 172.21.15.103:0/2844066373 >> v2:172.21.15.103:3300/0 conn(0x7f78000044d0 0x7f7820141f50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7818001450 tx=0x7f7818011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.493+0000 7f781e59c700 1 --2- 172.21.15.103:0/2844066373 >> v2:172.21.15.103:3300/0 conn(0x7f78000044d0 0x7f7820141f50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7818001450 tx=0x7f7818011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.493+0000 7f781e59c700 1 --2- 172.21.15.103:0/2844066373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78000044d0 0x7f7820141f50 secure :-1 s=READY pgs=303 cs=0 l=1 rx=0x7f7818001450 tx=0x7f7818011020).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:17.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.493+0000 7f781e59c700 1 --2- 172.21.15.103:0/2844066373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78000044d0 0x7f7820141f50 secure :-1 s=THROTTLE_DONE pgs=303 cs=0 l=1 rx=0x7f7818001450 tx=0x7f7818011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.493+0000 7f78177fe700 1 -- 172.21.15.103:0/2844066373 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f781800ce70 con 0x7f78000044d0 2020-04-22T14:03:17.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.493+0000 7f781e59c700 1 --2- 172.21.15.103:0/2844066373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78000044d0 0x7f7820141f50 secure :-1 s=THROTTLE_DONE pgs=303 cs=0 l=1 rx=0x7f7818001450 tx=0x7f7818011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.493+0000 7f78177fe700 1 -- 172.21.15.103:0/2844066373 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78180128b0 con 0x7f78000044d0 2020-04-22T14:03:17.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.493+0000 7f781e59c700 1 --2- 172.21.15.103:0/2844066373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78000044d0 0x7f7820141f50 secure :-1 s=THROTTLE_DONE pgs=303 cs=0 l=1 rx=0x7f7818001450 tx=0x7f7818011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.493+0000 7f7824af0700 1 -- 172.21.15.103:0/2844066373 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7820150ab0 con 0x7f78000044d0 2020-04-22T14:03:17.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.493+0000 7f78177fe700 1 -- 172.21.15.103:0/2844066373 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7818012c90 con 0x7f78000044d0 2020-04-22T14:03:17.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.493+0000 7f7824af0700 1 -- 172.21.15.103:0/2844066373 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78201525e0 con 0x7f78000044d0 2020-04-22T14:03:17.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.494+0000 7f781e59c700 1 --2- 172.21.15.103:0/2844066373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78000044d0 0x7f7820141f50 secure :-1 s=THROTTLE_DONE pgs=303 cs=0 l=1 rx=0x7f7818001450 tx=0x7f7818011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.494+0000 7f78177fe700 1 -- 172.21.15.103:0/2844066373 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f7818006860 con 0x7f78000044d0 2020-04-22T14:03:17.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.494+0000 7f781e59c700 1 --2- 172.21.15.103:0/2844066373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78000044d0 0x7f7820141f50 secure :-1 s=THROTTLE_DONE pgs=303 cs=0 l=1 rx=0x7f7818001450 tx=0x7f7818011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.494+0000 7f7824af0700 1 -- 172.21.15.103:0/2844066373 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7820056c90 con 0x7f78000044d0 2020-04-22T14:03:17.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.494+0000 7f78177fe700 1 --2- 172.21.15.103:0/2844066373 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f780404d860 0x7f780404fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:17.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.494+0000 7f78177fe700 1 -- 172.21.15.103:0/2844066373 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f78180615c0 con 0x7f78000044d0 2020-04-22T14:03:17.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.495+0000 7f781dd9b700 1 --2- 172.21.15.103:0/2844066373 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f780404d860 0x7f780404fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:17.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.495+0000 7f781dd9b700 1 --2- 172.21.15.103:0/2844066373 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f780404d860 0x7f780404fd20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7808002ed0 tx=0x7f780800bea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.495+0000 7f781dd9b700 1 --2- 172.21.15.103:0/2844066373 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f780404d860 0x7f780404fd20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7808002ed0 tx=0x7f780800bea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.495+0000 7f781dd9b700 1 --2- 172.21.15.103:0/2844066373 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f780404d860 0x7f780404fd20 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7f7808002ed0 tx=0x7f780800bea0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:17.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.498+0000 7f781e59c700 1 --2- 172.21.15.103:0/2844066373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78000044d0 0x7f7820141f50 secure :-1 s=THROTTLE_DONE pgs=303 cs=0 l=1 rx=0x7f7818001450 tx=0x7f7818011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.498+0000 7f78177fe700 1 -- 172.21.15.103:0/2844066373 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f781803c9a0 con 0x7f78000044d0 2020-04-22T14:03:17.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.639+0000 7f7824af0700 1 -- 172.21.15.103:0/2844066373 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f782014f7a0 con 0x7f78000044d0 2020-04-22T14:03:17.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.640+0000 7f781e59c700 1 --2- 172.21.15.103:0/2844066373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78000044d0 0x7f7820141f50 secure :-1 s=THROTTLE_DONE pgs=303 cs=0 l=1 rx=0x7f7818001450 tx=0x7f7818011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.640+0000 7f78177fe700 1 -- 172.21.15.103:0/2844066373 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7f781803ffc0 con 0x7f78000044d0 2020-04-22T14:03:17.642 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:03:17.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.641+0000 7f7824af0700 1 -- 172.21.15.103:0/2844066373 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f780404d860 msgr2=0x7f780404fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:17.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.641+0000 7f7824af0700 1 --2- 172.21.15.103:0/2844066373 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f780404d860 0x7f780404fd20 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7f7808002ed0 tx=0x7f780800bea0).stop 2020-04-22T14:03:17.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.641+0000 7f7824af0700 1 -- 172.21.15.103:0/2844066373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78000044d0 msgr2=0x7f7820141f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:17.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.641+0000 7f7824af0700 1 --2- 172.21.15.103:0/2844066373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78000044d0 0x7f7820141f50 secure :-1 s=READY pgs=303 cs=0 l=1 rx=0x7f7818001450 tx=0x7f7818011020).stop 2020-04-22T14:03:17.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.641+0000 7f7824af0700 1 -- 172.21.15.103:0/2844066373 shutdown_connections 2020-04-22T14:03:17.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.641+0000 7f7824af0700 1 --2- 172.21.15.103:0/2844066373 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f780404d860 0x7f780404fd20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:17.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.641+0000 7f7824af0700 1 --2- 172.21.15.103:0/2844066373 >> v2:172.21.15.86:3300/0 conn(0x7f78201501e0 0x7f7820150650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:17.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.641+0000 7f7824af0700 1 --2- 172.21.15.103:0/2844066373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78000044d0 0x7f7820141f50 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:17.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.641+0000 7f7824af0700 1 -- 172.21.15.103:0/2844066373 >> 172.21.15.103:0/2844066373 conn(0x7f782005b7b0 msgr2=0x7f7820143c60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:17.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.642+0000 7f7824af0700 1 -- 172.21.15.103:0/2844066373 shutdown_connections 2020-04-22T14:03:17.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.642+0000 7f7824af0700 1 -- 172.21.15.103:0/2844066373 wait complete. 2020-04-22T14:03:17.653 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:17.667 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-22T14:03:17.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.815+0000 7ff70ad7f700 1 Processor -- start 2020-04-22T14:03:17.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.815+0000 7ff70ad7f700 1 -- start start 2020-04-22T14:03:17.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.816+0000 7ff70ad7f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff704143090 0x7ff704143540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:17.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.816+0000 7ff70ad7f700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7041467e0 con 0x7ff7040b9140 2020-04-22T14:03:17.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.816+0000 7ff70ad7f700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff704060050 con 0x7ff7040ac950 2020-04-22T14:03:17.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.816+0000 7ff70ad7f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7041439a0 con 0x7ff704143090 2020-04-22T14:03:17.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.816+0000 7ff703fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff7040ac950 0x7ff704146c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40428/0 (socket says 172.21.15.103:40428) 2020-04-22T14:03:17.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.816+0000 7ff703fff700 1 -- 172.21.15.103:0/2430373383 learned_addr learned my addr 172.21.15.103:0/2430373383 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:17.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.816+0000 7ff70931c700 1 --2- 172.21.15.103:0/2430373383 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff704143090 0x7ff704143540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:17.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.816+0000 7ff7037fe700 1 -- 172.21.15.103:0/2430373383 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 511303654 0 0) 0x7ff704060050 con 0x7ff7040ac950 2020-04-22T14:03:17.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.816+0000 7ff7037fe700 1 -- 172.21.15.103:0/2430373383 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6f0003230 con 0x7ff7040ac950 2020-04-22T14:03:17.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.816+0000 7ff7037fe700 1 -- 172.21.15.103:0/2430373383 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2488687889 0 0) 0x7ff7041467e0 con 0x7ff7040b9140 2020-04-22T14:03:17.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.816+0000 7ff70931c700 1 -- 172.21.15.103:0/2430373383 >> v1:172.21.15.103:6789/0 conn(0x7ff7040ac950 legacy=0x7ff704146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:17.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.816+0000 7ff70931c700 1 -- 172.21.15.103:0/2430373383 >> v1:172.21.15.86:6789/0 conn(0x7ff7040b9140 legacy=0x7ff70412b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:17.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.816+0000 7ff70931c700 1 -- 172.21.15.103:0/2430373383 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7040b9520 con 0x7ff704143090 2020-04-22T14:03:17.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.816+0000 7ff70931c700 1 --2- 172.21.15.103:0/2430373383 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff704143090 0x7ff704143540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff6f4002f30 tx=0x7ff6f40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.817+0000 7ff70931c700 1 --2- 172.21.15.103:0/2430373383 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff704143090 0x7ff704143540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff6f4002f30 tx=0x7ff6f40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.817+0000 7ff70931c700 1 --2- 172.21.15.103:0/2430373383 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff704143090 0x7ff704143540 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7ff6f4002f30 tx=0x7ff6f40088e0).ready entity=mon.2 client_cookie=1aef2074a6bb9e1a server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:17.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.817+0000 7ff70931c700 1 --2- 172.21.15.103:0/2430373383 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff704143090 0x7ff704143540 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7ff6f4002f30 tx=0x7ff6f40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.817+0000 7ff7037fe700 1 -- 172.21.15.103:0/2430373383 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6f4008e40 con 0x7ff704143090 2020-04-22T14:03:17.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.817+0000 7ff70931c700 1 --2- 172.21.15.103:0/2430373383 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff704143090 0x7ff704143540 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7ff6f4002f30 tx=0x7ff6f40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.817+0000 7ff70931c700 1 --2- 172.21.15.103:0/2430373383 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff704143090 0x7ff704143540 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7ff6f4002f30 tx=0x7ff6f40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.817+0000 7ff7037fe700 1 -- 172.21.15.103:0/2430373383 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f40115f0 con 0x7ff704143090 2020-04-22T14:03:17.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.817+0000 7ff7037fe700 1 -- 172.21.15.103:0/2430373383 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6f4011950 con 0x7ff704143090 2020-04-22T14:03:17.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.817+0000 7ff70ad7f700 1 -- 172.21.15.103:0/2430373383 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff704143090 msgr2=0x7ff704143540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:17.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.817+0000 7ff70ad7f700 1 --2- 172.21.15.103:0/2430373383 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff704143090 0x7ff704143540 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7ff6f4002f30 tx=0x7ff6f40088e0).stop 2020-04-22T14:03:17.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.817+0000 7ff70ad7f700 1 -- 172.21.15.103:0/2430373383 shutdown_connections 2020-04-22T14:03:17.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.817+0000 7ff70ad7f700 1 --2- 172.21.15.103:0/2430373383 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff704143090 0x7ff704143540 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:17.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.817+0000 7ff70ad7f700 1 -- 172.21.15.103:0/2430373383 >> 172.21.15.103:0/2430373383 conn(0x7ff70405b7b0 msgr2=0x7ff7040b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:17.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.817+0000 7ff70ad7f700 1 -- 172.21.15.103:0/2430373383 shutdown_connections 2020-04-22T14:03:17.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.817+0000 7ff70ad7f700 1 -- 172.21.15.103:0/2430373383 wait complete. 2020-04-22T14:03:17.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.818+0000 7ff70ad7f700 1 Processor -- start 2020-04-22T14:03:17.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.818+0000 7ff70ad7f700 1 -- start start 2020-04-22T14:03:17.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.819+0000 7ff70ad7f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff7040ac950 0x7ff7040b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:17.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.819+0000 7ff70ad7f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff7040b9140 0x7ff704062a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:17.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.819+0000 7ff70ad7f700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7040b3850 con 0x7ff704143090 2020-04-22T14:03:17.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.819+0000 7ff70ad7f700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7040630a0 con 0x7ff7040b9140 2020-04-22T14:03:17.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.819+0000 7ff70ad7f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff704063340 con 0x7ff7040ac950 2020-04-22T14:03:17.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.819+0000 7ff708b1b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff7040ac950 0x7ff7040b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:17.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.819+0000 7ff70931c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff704143090 0x7ff704153b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40436/0 (socket says 172.21.15.103:40436) 2020-04-22T14:03:17.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.819+0000 7ff70931c700 1 -- 172.21.15.103:0/3970980581 learned_addr learned my addr 172.21.15.103:0/3970980581 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:17.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.819+0000 7ff703fff700 1 --2- 172.21.15.103:0/3970980581 >> v2:172.21.15.86:3300/0 conn(0x7ff7040b9140 0x7ff704062a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:17.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.819+0000 7ff708b1b700 1 -- 172.21.15.103:0/3970980581 >> v2:172.21.15.86:3300/0 conn(0x7ff7040b9140 msgr2=0x7ff704062a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:17.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.819+0000 7ff708b1b700 1 --2- 172.21.15.103:0/3970980581 >> v2:172.21.15.86:3300/0 conn(0x7ff7040b9140 0x7ff704062a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:17.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.819+0000 7ff708b1b700 1 -- 172.21.15.103:0/3970980581 >> v1:172.21.15.103:6789/0 conn(0x7ff704143090 legacy=0x7ff704153b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:17.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.819+0000 7ff701ffb700 1 -- 172.21.15.103:0/3970980581 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1625486046 0 0) 0x7ff7040b3850 con 0x7ff704143090 2020-04-22T14:03:17.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.819+0000 7ff708b1b700 1 -- 172.21.15.103:0/3970980581 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff704154230 con 0x7ff7040ac950 2020-04-22T14:03:17.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.819+0000 7ff703fff700 1 --2- 172.21.15.103:0/3970980581 >> v2:172.21.15.86:3300/0 conn(0x7ff7040b9140 0x7ff704062a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:03:17.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.819+0000 7ff708b1b700 1 --2- 172.21.15.103:0/3970980581 >> v2:172.21.15.103:3300/0 conn(0x7ff7040ac950 0x7ff7040b5b00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff6fc000f00 tx=0x7ff6fc010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.819+0000 7ff708b1b700 1 --2- 172.21.15.103:0/3970980581 >> v2:172.21.15.103:3300/0 conn(0x7ff7040ac950 0x7ff7040b5b00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff6fc000f00 tx=0x7ff6fc010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.820+0000 7ff708b1b700 1 --2- 172.21.15.103:0/3970980581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7040ac950 0x7ff7040b5b00 secure :-1 s=READY pgs=306 cs=0 l=1 rx=0x7ff6fc000f00 tx=0x7ff6fc010ca0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:17.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.820+0000 7ff708b1b700 1 --2- 172.21.15.103:0/3970980581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7040ac950 0x7ff7040b5b00 secure :-1 s=THROTTLE_DONE pgs=306 cs=0 l=1 rx=0x7ff6fc000f00 tx=0x7ff6fc010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.820+0000 7ff701ffb700 1 -- 172.21.15.103:0/3970980581 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6fc012340 con 0x7ff7040ac950 2020-04-22T14:03:17.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.820+0000 7ff708b1b700 1 --2- 172.21.15.103:0/3970980581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7040ac950 0x7ff7040b5b00 secure :-1 s=THROTTLE_DONE pgs=306 cs=0 l=1 rx=0x7ff6fc000f00 tx=0x7ff6fc010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.820+0000 7ff70ad7f700 1 -- 172.21.15.103:0/3970980581 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7040b1b70 con 0x7ff7040ac950 2020-04-22T14:03:17.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.820+0000 7ff701ffb700 1 -- 172.21.15.103:0/3970980581 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6fc0124a0 con 0x7ff7040ac950 2020-04-22T14:03:17.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.820+0000 7ff708b1b700 1 --2- 172.21.15.103:0/3970980581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7040ac950 0x7ff7040b5b00 secure :-1 s=THROTTLE_DONE pgs=306 cs=0 l=1 rx=0x7ff6fc000f00 tx=0x7ff6fc010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.820+0000 7ff701ffb700 1 -- 172.21.15.103:0/3970980581 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6fc0128c0 con 0x7ff7040ac950 2020-04-22T14:03:17.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.820+0000 7ff70ad7f700 1 -- 172.21.15.103:0/3970980581 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff704145920 con 0x7ff7040ac950 2020-04-22T14:03:17.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.820+0000 7ff708b1b700 1 --2- 172.21.15.103:0/3970980581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7040ac950 0x7ff7040b5b00 secure :-1 s=THROTTLE_DONE pgs=306 cs=0 l=1 rx=0x7ff6fc000f00 tx=0x7ff6fc010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.821+0000 7ff70ad7f700 1 -- 172.21.15.103:0/3970980581 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff704062ed0 con 0x7ff7040ac950 2020-04-22T14:03:17.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.821+0000 7ff701ffb700 1 -- 172.21.15.103:0/3970980581 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ff6fc012b80 con 0x7ff7040ac950 2020-04-22T14:03:17.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.821+0000 7ff708b1b700 1 --2- 172.21.15.103:0/3970980581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7040ac950 0x7ff7040b5b00 secure :-1 s=THROTTLE_DONE pgs=306 cs=0 l=1 rx=0x7ff6fc000f00 tx=0x7ff6fc010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.821+0000 7ff701ffb700 1 --2- 172.21.15.103:0/3970980581 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff6e404d860 0x7ff6e404fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:17.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.821+0000 7ff701ffb700 1 -- 172.21.15.103:0/3970980581 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff6fc061b90 con 0x7ff7040ac950 2020-04-22T14:03:17.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.821+0000 7ff703fff700 1 --2- 172.21.15.103:0/3970980581 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff6e404d860 0x7ff6e404fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:17.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.821+0000 7ff703fff700 1 --2- 172.21.15.103:0/3970980581 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff6e404d860 0x7ff6e404fd20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff6f8001110 tx=0x7ff6f8001620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.821+0000 7ff703fff700 1 --2- 172.21.15.103:0/3970980581 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff6e404d860 0x7ff6e404fd20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff6f8001110 tx=0x7ff6f8001620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.821+0000 7ff703fff700 1 --2- 172.21.15.103:0/3970980581 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff6e404d860 0x7ff6e404fd20 secure :-1 s=READY pgs=132 cs=0 l=1 rx=0x7ff6f8001110 tx=0x7ff6f8001620).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:17.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.825+0000 7ff708b1b700 1 --2- 172.21.15.103:0/3970980581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7040ac950 0x7ff7040b5b00 secure :-1 s=THROTTLE_DONE pgs=306 cs=0 l=1 rx=0x7ff6fc000f00 tx=0x7ff6fc010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.825+0000 7ff701ffb700 1 -- 172.21.15.103:0/3970980581 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ff6fc03cf70 con 0x7ff7040ac950 2020-04-22T14:03:17.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.968+0000 7ff70ad7f700 1 -- 172.21.15.103:0/3970980581 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff704056c90 con 0x7ff7040ac950 2020-04-22T14:03:17.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.969+0000 7ff708b1b700 1 --2- 172.21.15.103:0/3970980581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7040ac950 0x7ff7040b5b00 secure :-1 s=THROTTLE_DONE pgs=306 cs=0 l=1 rx=0x7ff6fc000f00 tx=0x7ff6fc010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:17.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.969+0000 7ff701ffb700 1 -- 172.21.15.103:0/3970980581 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7ff6fc040590 con 0x7ff7040ac950 2020-04-22T14:03:17.971 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:03:17.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.970+0000 7ff70ad7f700 1 -- 172.21.15.103:0/3970980581 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff6e404d860 msgr2=0x7ff6e404fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:17.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.970+0000 7ff70ad7f700 1 --2- 172.21.15.103:0/3970980581 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff6e404d860 0x7ff6e404fd20 secure :-1 s=READY pgs=132 cs=0 l=1 rx=0x7ff6f8001110 tx=0x7ff6f8001620).stop 2020-04-22T14:03:17.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.970+0000 7ff70ad7f700 1 -- 172.21.15.103:0/3970980581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7040ac950 msgr2=0x7ff7040b5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:17.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.970+0000 7ff70ad7f700 1 --2- 172.21.15.103:0/3970980581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7040ac950 0x7ff7040b5b00 secure :-1 s=READY pgs=306 cs=0 l=1 rx=0x7ff6fc000f00 tx=0x7ff6fc010ca0).stop 2020-04-22T14:03:17.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.970+0000 7ff70ad7f700 1 -- 172.21.15.103:0/3970980581 shutdown_connections 2020-04-22T14:03:17.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.970+0000 7ff70ad7f700 1 --2- 172.21.15.103:0/3970980581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7040ac950 0x7ff7040b5b00 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:17.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.970+0000 7ff70ad7f700 1 --2- 172.21.15.103:0/3970980581 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff6e404d860 0x7ff6e404fd20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:17.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.970+0000 7ff70ad7f700 1 --2- 172.21.15.103:0/3970980581 >> v2:172.21.15.86:3300/0 conn(0x7ff7040b9140 0x7ff704062a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:17.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.970+0000 7ff70ad7f700 1 -- 172.21.15.103:0/3970980581 >> 172.21.15.103:0/3970980581 conn(0x7ff70405b7b0 msgr2=0x7ff70412a730 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:17.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.970+0000 7ff70ad7f700 1 -- 172.21.15.103:0/3970980581 shutdown_connections 2020-04-22T14:03:17.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:17.970+0000 7ff70ad7f700 1 -- 172.21.15.103:0/3970980581 wait complete. 2020-04-22T14:03:17.991 INFO:tasks.cephfs_test_runner:Starting test: test_network_death (tasks.cephfs.test_client_recovery.TestClientNetworkRecovery) 2020-04-22T14:03:17.992 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:18.006 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_client_recovery.TestClientNetworkRecovery.test_network_death' 2020-04-22T14:03:18.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.150+0000 7ff5deedd700 1 Processor -- start 2020-04-22T14:03:18.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.150+0000 7ff5deedd700 1 -- start start 2020-04-22T14:03:18.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.151+0000 7ff5deedd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff5d80b6040 0x7ff5d80ac740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:18.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.151+0000 7ff5deedd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff5d81426d0 0x7ff5d8142b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:18.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.151+0000 7ff5deedd700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d8064ec0 con 0x7ff5d8067170 2020-04-22T14:03:18.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.151+0000 7ff5deedd700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d8065af0 con 0x7ff5d81426d0 2020-04-22T14:03:18.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.151+0000 7ff5deedd700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d8146870 con 0x7ff5d80b6040 2020-04-22T14:03:18.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.151+0000 7ff5d7fff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff5d80b6040 0x7ff5d80ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:18.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.151+0000 7ff5dd47a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff5d81426d0 0x7ff5d8142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:18.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.151+0000 7ff5dd47a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff5d81426d0 0x7ff5d8142b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:45484/0 (socket says 172.21.15.103:45484) 2020-04-22T14:03:18.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.151+0000 7ff5d7fff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff5d80b6040 0x7ff5d80ac740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:33030/0 (socket says 172.21.15.103:33030) 2020-04-22T14:03:18.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.151+0000 7ff5dd47a700 1 -- 172.21.15.103:0/4076020354 learned_addr learned my addr 172.21.15.103:0/4076020354 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:18.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.151+0000 7ff5dcc79700 1 --1- 172.21.15.103:0/4076020354 >> v1:172.21.15.86:6789/0 conn(0x7ff5d8067170 0x7ff5d813c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:57596/0 (socket says 172.21.15.103:57596) 2020-04-22T14:03:18.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.151+0000 7ff5dd47a700 1 -- 172.21.15.103:0/4076020354 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff5d80b6040 msgr2=0x7ff5d80ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:18.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.151+0000 7ff5dd47a700 1 --2- 172.21.15.103:0/4076020354 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff5d80b6040 0x7ff5d80ac740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:18.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.151+0000 7ff5dd47a700 1 -- 172.21.15.103:0/4076020354 >> v1:172.21.15.86:6789/0 conn(0x7ff5d8067170 legacy=0x7ff5d813c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:18.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.151+0000 7ff5dd47a700 1 -- 172.21.15.103:0/4076020354 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d8067550 con 0x7ff5d81426d0 2020-04-22T14:03:18.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.151+0000 7ff5d7fff700 1 --2- 172.21.15.103:0/4076020354 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff5d80b6040 0x7ff5d80ac740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:03:18.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.151+0000 7ff5dd47a700 1 --2- 172.21.15.103:0/4076020354 >> v2:172.21.15.86:3300/0 conn(0x7ff5d81426d0 0x7ff5d8142b80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff5c8002f30 tx=0x7ff5c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:18.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.151+0000 7ff5dd47a700 1 --2- 172.21.15.103:0/4076020354 >> v2:172.21.15.86:3300/0 conn(0x7ff5d81426d0 0x7ff5d8142b80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff5c8002f30 tx=0x7ff5c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:18.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.151+0000 7ff5dd47a700 1 --2- 172.21.15.103:0/4076020354 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5d81426d0 0x7ff5d8142b80 secure :-1 s=READY pgs=199 cs=0 l=1 rx=0x7ff5c8002f30 tx=0x7ff5c8007a40).ready entity=mon.0 client_cookie=24de57c9ef326782 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:18.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.151+0000 7ff5dd47a700 1 --2- 172.21.15.103:0/4076020354 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5d81426d0 0x7ff5d8142b80 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7ff5c8002f30 tx=0x7ff5c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:18.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.152+0000 7ff5d77fe700 1 -- 172.21.15.103:0/4076020354 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5c8011670 con 0x7ff5d81426d0 2020-04-22T14:03:18.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.152+0000 7ff5dd47a700 1 --2- 172.21.15.103:0/4076020354 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5d81426d0 0x7ff5d8142b80 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7ff5c8002f30 tx=0x7ff5c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:18.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.152+0000 7ff5dd47a700 1 --2- 172.21.15.103:0/4076020354 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5d81426d0 0x7ff5d8142b80 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7ff5c8002f30 tx=0x7ff5c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:18.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.152+0000 7ff5d77fe700 1 -- 172.21.15.103:0/4076020354 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c8011810 con 0x7ff5d81426d0 2020-04-22T14:03:18.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.152+0000 7ff5d77fe700 1 -- 172.21.15.103:0/4076020354 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5c8011c30 con 0x7ff5d81426d0 2020-04-22T14:03:18.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.152+0000 7ff5deedd700 1 -- 172.21.15.103:0/4076020354 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5d81426d0 msgr2=0x7ff5d8142b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:18.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.152+0000 7ff5deedd700 1 --2- 172.21.15.103:0/4076020354 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5d81426d0 0x7ff5d8142b80 secure :-1 s=READY pgs=199 cs=0 l=1 rx=0x7ff5c8002f30 tx=0x7ff5c8007a40).stop 2020-04-22T14:03:18.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.152+0000 7ff5deedd700 1 -- 172.21.15.103:0/4076020354 shutdown_connections 2020-04-22T14:03:18.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.152+0000 7ff5deedd700 1 --2- 172.21.15.103:0/4076020354 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5d81426d0 0x7ff5d8142b80 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:18.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.152+0000 7ff5deedd700 1 --2- 172.21.15.103:0/4076020354 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff5d80b6040 0x7ff5d80ac740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:18.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.152+0000 7ff5deedd700 1 -- 172.21.15.103:0/4076020354 >> 172.21.15.103:0/4076020354 conn(0x7ff5d80b9160 msgr2=0x7ff5d805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:18.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.152+0000 7ff5deedd700 1 -- 172.21.15.103:0/4076020354 shutdown_connections 2020-04-22T14:03:18.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.152+0000 7ff5deedd700 1 -- 172.21.15.103:0/4076020354 wait complete. 2020-04-22T14:03:18.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.153+0000 7ff5deedd700 1 Processor -- start 2020-04-22T14:03:18.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.153+0000 7ff5deedd700 1 -- start start 2020-04-22T14:03:18.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.154+0000 7ff5deedd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff5d8067170 0x7ff5d8144a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:18.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.154+0000 7ff5deedd700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d81455c0 con 0x7ff5d80b6040 2020-04-22T14:03:18.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.154+0000 7ff5deedd700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d81371e0 con 0x7ff5d81426d0 2020-04-22T14:03:18.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.154+0000 7ff5deedd700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d8143bf0 con 0x7ff5d8067170 2020-04-22T14:03:18.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.154+0000 7ff5dd47a700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff5d81426d0 0x7ff5d8136ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40450/0 (socket says 172.21.15.103:40450) 2020-04-22T14:03:18.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.154+0000 7ff5dd47a700 1 -- 172.21.15.103:0/1220728791 learned_addr learned my addr 172.21.15.103:0/1220728791 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:18.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.154+0000 7ff5dcc79700 1 --2- 172.21.15.103:0/1220728791 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff5d8067170 0x7ff5d8144a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:18.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.154+0000 7ff5d5ffb700 1 -- 172.21.15.103:0/1220728791 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1776050692 0 0) 0x7ff5d81371e0 con 0x7ff5d81426d0 2020-04-22T14:03:18.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.154+0000 7ff5d5ffb700 1 -- 172.21.15.103:0/1220728791 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5b8002fe0 con 0x7ff5d81426d0 2020-04-22T14:03:18.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.154+0000 7ff5d5ffb700 1 -- 172.21.15.103:0/1220728791 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 755845410 0 0) 0x7ff5b8002fe0 con 0x7ff5d81426d0 2020-04-22T14:03:18.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.154+0000 7ff5d5ffb700 1 -- 172.21.15.103:0/1220728791 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff5d81371e0 con 0x7ff5d81426d0 2020-04-22T14:03:18.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.154+0000 7ff5d5ffb700 1 -- 172.21.15.103:0/1220728791 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7ff5c8011ea0 con 0x7ff5d81426d0 2020-04-22T14:03:18.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.155+0000 7ff5d5ffb700 1 -- 172.21.15.103:0/1220728791 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff5d8067170 msgr2=0x7ff5d8144a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:18.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.155+0000 7ff5d5ffb700 1 --2- 172.21.15.103:0/1220728791 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff5d8067170 0x7ff5d8144a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:18.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.155+0000 7ff5d5ffb700 1 -- 172.21.15.103:0/1220728791 >> v1:172.21.15.103:6789/0 conn(0x7ff5d81426d0 legacy=0x7ff5d8136ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:18.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.155+0000 7ff5d5ffb700 1 -- 172.21.15.103:0/1220728791 >> v1:172.21.15.86:6789/0 conn(0x7ff5d80b6040 legacy=0x7ff5d81363c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:18.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.155+0000 7ff5d5ffb700 1 --2- 172.21.15.103:0/1220728791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5b80049b0 0x7ff5b8004db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:18.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.155+0000 7ff5d5ffb700 1 --2- 172.21.15.103:0/1220728791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5b8003920 0x7ff5b8003d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:18.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.155+0000 7ff5d5ffb700 1 --2- 172.21.15.103:0/1220728791 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff5d8067170 0x7ff5b80041e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:18.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.155+0000 7ff5d5ffb700 1 -- 172.21.15.103:0/1220728791 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d8143bf0 con 0x7ff5b80049b0 2020-04-22T14:03:18.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.155+0000 7ff5d5ffb700 1 -- 172.21.15.103:0/1220728791 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b80054e0 con 0x7ff5b8003920 2020-04-22T14:03:18.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.155+0000 7ff5d5ffb700 1 -- 172.21.15.103:0/1220728791 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b8004670 con 0x7ff5d8067170 2020-04-22T14:03:18.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.155+0000 7ff5d7fff700 1 --2- 172.21.15.103:0/1220728791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5b8003920 0x7ff5b8003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:18.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.155+0000 7ff5dcc79700 1 --2- 172.21.15.103:0/1220728791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5b80049b0 0x7ff5b8004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:18.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.155+0000 7ff5dd47a700 1 --2- 172.21.15.103:0/1220728791 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff5d8067170 0x7ff5b80041e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:18.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.155+0000 7ff5d7fff700 1 -- 172.21.15.103:0/1220728791 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff5d8067170 msgr2=0x7ff5b80041e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:18.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.155+0000 7ff5d7fff700 1 --2- 172.21.15.103:0/1220728791 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff5d8067170 0x7ff5b80041e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:18.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.155+0000 7ff5d7fff700 1 -- 172.21.15.103:0/1220728791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5b80049b0 msgr2=0x7ff5b8004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:18.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.155+0000 7ff5d7fff700 1 --2- 172.21.15.103:0/1220728791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5b80049b0 0x7ff5b8004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:18.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.155+0000 7ff5d7fff700 1 -- 172.21.15.103:0/1220728791 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d81457f0 con 0x7ff5b8003920 2020-04-22T14:03:18.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.155+0000 7ff5deedd700 1 -- 172.21.15.103:0/1220728791 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d81434b0 con 0x7ff5b8003920 2020-04-22T14:03:18.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.155+0000 7ff5d7fff700 1 --2- 172.21.15.103:0/1220728791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5b8003920 0x7ff5b8003d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff5d8064ab0 tx=0x7ff5cc010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:18.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.155+0000 7ff5deedd700 1 -- 172.21.15.103:0/1220728791 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d81397f0 con 0x7ff5b8003920 2020-04-22T14:03:18.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.155+0000 7ff5d7fff700 1 --2- 172.21.15.103:0/1220728791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5b8003920 0x7ff5b8003d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff5d8064ab0 tx=0x7ff5cc010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:18.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.155+0000 7ff5d7fff700 1 --2- 172.21.15.103:0/1220728791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5b8003920 0x7ff5b8003d80 secure :-1 s=READY pgs=308 cs=0 l=1 rx=0x7ff5d8064ab0 tx=0x7ff5cc010d50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:18.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.155+0000 7ff5d7fff700 1 --2- 172.21.15.103:0/1220728791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5b8003920 0x7ff5b8003d80 secure :-1 s=THROTTLE_DONE pgs=308 cs=0 l=1 rx=0x7ff5d8064ab0 tx=0x7ff5cc010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:18.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.155+0000 7ff5d5ffb700 1 -- 172.21.15.103:0/1220728791 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5cc007370 con 0x7ff5b8003920 2020-04-22T14:03:18.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.155+0000 7ff5d7fff700 1 --2- 172.21.15.103:0/1220728791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5b8003920 0x7ff5b8003d80 secure :-1 s=THROTTLE_DONE pgs=308 cs=0 l=1 rx=0x7ff5d8064ab0 tx=0x7ff5cc010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:18.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.155+0000 7ff5d5ffb700 1 -- 172.21.15.103:0/1220728791 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5cc0074d0 con 0x7ff5b8003920 2020-04-22T14:03:18.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.155+0000 7ff5d7fff700 1 --2- 172.21.15.103:0/1220728791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5b8003920 0x7ff5b8003d80 secure :-1 s=THROTTLE_DONE pgs=308 cs=0 l=1 rx=0x7ff5d8064ab0 tx=0x7ff5cc010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:18.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.155+0000 7ff5d5ffb700 1 -- 172.21.15.103:0/1220728791 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5cc005bb0 con 0x7ff5b8003920 2020-04-22T14:03:18.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.156+0000 7ff5d7fff700 1 --2- 172.21.15.103:0/1220728791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5b8003920 0x7ff5b8003d80 secure :-1 s=THROTTLE_DONE pgs=308 cs=0 l=1 rx=0x7ff5d8064ab0 tx=0x7ff5cc010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:18.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.156+0000 7ff5deedd700 1 -- 172.21.15.103:0/1220728791 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5b4003340 con 0x7ff5b8003920 2020-04-22T14:03:18.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.156+0000 7ff5d5ffb700 1 -- 172.21.15.103:0/1220728791 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ff5cc005d10 con 0x7ff5b8003920 2020-04-22T14:03:18.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.156+0000 7ff5d7fff700 1 --2- 172.21.15.103:0/1220728791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5b8003920 0x7ff5b8003d80 secure :-1 s=THROTTLE_DONE pgs=308 cs=0 l=1 rx=0x7ff5d8064ab0 tx=0x7ff5cc010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:18.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.157+0000 7ff5d5ffb700 1 --2- 172.21.15.103:0/1220728791 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff5b8055c10 0x7ff5b80580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:18.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.157+0000 7ff5d5ffb700 1 -- 172.21.15.103:0/1220728791 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff5cc0613e0 con 0x7ff5b8003920 2020-04-22T14:03:18.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.157+0000 7ff5dcc79700 1 --2- 172.21.15.103:0/1220728791 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff5b8055c10 0x7ff5b80580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:18.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.157+0000 7ff5dcc79700 1 --2- 172.21.15.103:0/1220728791 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff5b8055c10 0x7ff5b80580d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff5d80663d0 tx=0x7ff5d000cd50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:18.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.157+0000 7ff5dcc79700 1 --2- 172.21.15.103:0/1220728791 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff5b8055c10 0x7ff5b80580d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff5d80663d0 tx=0x7ff5d000cd50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:18.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.157+0000 7ff5dcc79700 1 --2- 172.21.15.103:0/1220728791 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff5b8055c10 0x7ff5b80580d0 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7ff5d80663d0 tx=0x7ff5d000cd50).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:18.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.161+0000 7ff5d7fff700 1 --2- 172.21.15.103:0/1220728791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5b8003920 0x7ff5b8003d80 secure :-1 s=THROTTLE_DONE pgs=308 cs=0 l=1 rx=0x7ff5d8064ab0 tx=0x7ff5cc010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:18.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.161+0000 7ff5d5ffb700 1 -- 172.21.15.103:0/1220728791 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ff5cc03c820 con 0x7ff5b8003920 2020-04-22T14:03:18.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.360+0000 7ff5deedd700 1 -- 172.21.15.103:0/1220728791 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientNetworkRecovery.test_network_death"]} v 0) v1 -- 0x7ff5b4002280 con 0x7ff5b8003920 2020-04-22T14:03:18.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.458+0000 7ff5d7fff700 1 --2- 172.21.15.103:0/1220728791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5b8003920 0x7ff5b8003d80 secure :-1 s=THROTTLE_DONE pgs=308 cs=0 l=1 rx=0x7ff5d8064ab0 tx=0x7ff5cc010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:18.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.458+0000 7ff5d5ffb700 1 -- 172.21.15.103:0/1220728791 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientNetworkRecovery.test_network_death"]}]=0 v61) v1 ==== 160+0+0 (secure 0 0 0) 0x7ff5cc03fe40 con 0x7ff5b8003920 2020-04-22T14:03:18.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.459+0000 7ff5deedd700 1 -- 172.21.15.103:0/1220728791 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff5b8055c10 msgr2=0x7ff5b80580d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:18.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.459+0000 7ff5deedd700 1 --2- 172.21.15.103:0/1220728791 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff5b8055c10 0x7ff5b80580d0 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7ff5d80663d0 tx=0x7ff5d000cd50).stop 2020-04-22T14:03:18.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.459+0000 7ff5deedd700 1 -- 172.21.15.103:0/1220728791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5b8003920 msgr2=0x7ff5b8003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:18.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.460+0000 7ff5deedd700 1 --2- 172.21.15.103:0/1220728791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5b8003920 0x7ff5b8003d80 secure :-1 s=READY pgs=308 cs=0 l=1 rx=0x7ff5d8064ab0 tx=0x7ff5cc010d50).stop 2020-04-22T14:03:18.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.460+0000 7ff5dd47a700 1 -- 172.21.15.103:0/1220728791 reap_dead start 2020-04-22T14:03:18.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.460+0000 7ff5dd47a700 1 -- 172.21.15.103:0/1220728791 reap_dead start 2020-04-22T14:03:18.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.460+0000 7ff5deedd700 1 -- 172.21.15.103:0/1220728791 shutdown_connections 2020-04-22T14:03:18.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.460+0000 7ff5deedd700 1 -- 172.21.15.103:0/1220728791 >> 172.21.15.103:0/1220728791 conn(0x7ff5d80b9160 msgr2=0x7ff5d8062960 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:18.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.460+0000 7ff5deedd700 1 -- 172.21.15.103:0/1220728791 shutdown_connections 2020-04-22T14:03:18.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.460+0000 7ff5deedd700 1 -- 172.21.15.103:0/1220728791 wait complete. 2020-04-22T14:03:18.472 INFO:tasks.cephfs_test_runner:test_network_death (tasks.cephfs.test_client_recovery.TestClientNetworkRecovery) ... skipped 'Require first client to be on separate server from MDSs' 2020-04-22T14:03:18.472 INFO:tasks.cephfs_test_runner:Starting test: test_abort_conn (tasks.cephfs.test_client_recovery.TestClientRecovery) 2020-04-22T14:03:18.472 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:18.486 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_abort_conn' 2020-04-22T14:03:18.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.635+0000 7fa6cf246700 1 Processor -- start 2020-04-22T14:03:18.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.635+0000 7fa6cf246700 1 -- start start 2020-04-22T14:03:18.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.636+0000 7fa6cf246700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa6c805b7c0 0x7fa6c80b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:18.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.636+0000 7fa6cf246700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa6c81441f0 0x7fa6c8144820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:18.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.636+0000 7fa6cf246700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6c80ae860 con 0x7fa6c8144c80 2020-04-22T14:03:18.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.636+0000 7fa6cf246700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6c80b5900 con 0x7fa6c81441f0 2020-04-22T14:03:18.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.636+0000 7fa6cf246700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c80b5ba0 con 0x7fa6c805b7c0 2020-04-22T14:03:18.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.636+0000 7fa6c7fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa6c81441f0 0x7fa6c8144820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:18.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.636+0000 7fa6c7fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa6c81441f0 0x7fa6c8144820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48270/0 (socket says 172.21.15.103:48270) 2020-04-22T14:03:18.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.636+0000 7fa6c7fff700 1 -- 172.21.15.103:0/1431244025 learned_addr learned my addr 172.21.15.103:0/1431244025 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:18.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.637+0000 7fa6ccfe2700 1 --2- 172.21.15.103:0/1431244025 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa6c805b7c0 0x7fa6c80b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:18.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.637+0000 7fa6c7fff700 1 -- 172.21.15.103:0/1431244025 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa6c805b7c0 msgr2=0x7fa6c80b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:18.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.637+0000 7fa6c7fff700 1 --2- 172.21.15.103:0/1431244025 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa6c805b7c0 0x7fa6c80b50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:18.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.637+0000 7fa6c7fff700 1 -- 172.21.15.103:0/1431244025 >> v1:172.21.15.86:6789/0 conn(0x7fa6c8144c80 legacy=0x7fa6c8147670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:18.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.637+0000 7fa6c7fff700 1 -- 172.21.15.103:0/1431244025 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c80b5e40 con 0x7fa6c81441f0 2020-04-22T14:03:18.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.637+0000 7fa6ccfe2700 1 --2- 172.21.15.103:0/1431244025 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa6c805b7c0 0x7fa6c80b50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:03:18.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.637+0000 7fa6c7fff700 1 --2- 172.21.15.103:0/1431244025 >> v2:172.21.15.103:3300/0 conn(0x7fa6c81441f0 0x7fa6c8144820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa6c80613e0 tx=0x7fa6bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:18.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.637+0000 7fa6c7fff700 1 --2- 172.21.15.103:0/1431244025 >> v2:172.21.15.103:3300/0 conn(0x7fa6c81441f0 0x7fa6c8144820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa6c80613e0 tx=0x7fa6bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:18.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.637+0000 7fa6c7fff700 1 --2- 172.21.15.103:0/1431244025 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6c81441f0 0x7fa6c8144820 secure :-1 s=READY pgs=309 cs=0 l=1 rx=0x7fa6c80613e0 tx=0x7fa6bc007a40).ready entity=mon.1 client_cookie=cb9766bc53598950 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:18.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.637+0000 7fa6c7fff700 1 --2- 172.21.15.103:0/1431244025 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6c81441f0 0x7fa6c8144820 secure :-1 s=THROTTLE_DONE pgs=309 cs=0 l=1 rx=0x7fa6c80613e0 tx=0x7fa6bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:18.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.637+0000 7fa6c7fff700 1 --2- 172.21.15.103:0/1431244025 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6c81441f0 0x7fa6c8144820 secure :-1 s=THROTTLE_DONE pgs=309 cs=0 l=1 rx=0x7fa6c80613e0 tx=0x7fa6bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:18.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.637+0000 7fa6c77fe700 1 -- 172.21.15.103:0/1431244025 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6bc008e10 con 0x7fa6c81441f0 2020-04-22T14:03:18.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.637+0000 7fa6c7fff700 1 --2- 172.21.15.103:0/1431244025 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6c81441f0 0x7fa6c8144820 secure :-1 s=THROTTLE_DONE pgs=309 cs=0 l=1 rx=0x7fa6c80613e0 tx=0x7fa6bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:18.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.637+0000 7fa6c77fe700 1 -- 172.21.15.103:0/1431244025 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6bc010780 con 0x7fa6c81441f0 2020-04-22T14:03:18.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.637+0000 7fa6c77fe700 1 -- 172.21.15.103:0/1431244025 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6bc010b60 con 0x7fa6c81441f0 2020-04-22T14:03:18.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.637+0000 7fa6cf246700 1 -- 172.21.15.103:0/1431244025 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6c81441f0 msgr2=0x7fa6c8144820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:18.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.637+0000 7fa6cf246700 1 --2- 172.21.15.103:0/1431244025 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6c81441f0 0x7fa6c8144820 secure :-1 s=READY pgs=309 cs=0 l=1 rx=0x7fa6c80613e0 tx=0x7fa6bc007a40).stop 2020-04-22T14:03:18.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.637+0000 7fa6cf246700 1 -- 172.21.15.103:0/1431244025 shutdown_connections 2020-04-22T14:03:18.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.637+0000 7fa6cf246700 1 --2- 172.21.15.103:0/1431244025 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa6c805b7c0 0x7fa6c80b50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:18.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.637+0000 7fa6cf246700 1 --2- 172.21.15.103:0/1431244025 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6c81441f0 0x7fa6c8144820 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:18.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.637+0000 7fa6cf246700 1 -- 172.21.15.103:0/1431244025 >> 172.21.15.103:0/1431244025 conn(0x7fa6c80b9160 msgr2=0x7fa6c805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:18.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.638+0000 7fa6cf246700 1 -- 172.21.15.103:0/1431244025 shutdown_connections 2020-04-22T14:03:18.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.638+0000 7fa6cf246700 1 -- 172.21.15.103:0/1431244025 wait complete. 2020-04-22T14:03:18.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.638+0000 7fa6cf246700 1 Processor -- start 2020-04-22T14:03:18.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.639+0000 7fa6cf246700 1 -- start start 2020-04-22T14:03:18.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.639+0000 7fa6cf246700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa6c8144c80 0x7fa6c8067030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:18.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.639+0000 7fa6cf246700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6c80aeb00 con 0x7fa6c81441f0 2020-04-22T14:03:18.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.639+0000 7fa6cf246700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6c80aeda0 con 0x7fa6c805b7c0 2020-04-22T14:03:18.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.639+0000 7fa6cf246700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6c80af040 con 0x7fa6c8144c80 2020-04-22T14:03:18.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.639+0000 7fa6ccfe2700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa6c805b7c0 0x7fa6c813cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40466/0 (socket says 172.21.15.103:40466) 2020-04-22T14:03:18.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.639+0000 7fa6ccfe2700 1 -- 172.21.15.103:0/2970024056 learned_addr learned my addr 172.21.15.103:0/2970024056 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:18.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.640+0000 7fa6cd7e3700 1 --2- 172.21.15.103:0/2970024056 >> v2:172.21.15.86:3300/0 conn(0x7fa6c8144c80 0x7fa6c8067030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:18.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.640+0000 7fa6c5ffb700 1 -- 172.21.15.103:0/2970024056 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 388651408 0 0) 0x7fa6c80aeda0 con 0x7fa6c805b7c0 2020-04-22T14:03:18.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.640+0000 7fa6c5ffb700 1 -- 172.21.15.103:0/2970024056 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6a8002fe0 con 0x7fa6c805b7c0 2020-04-22T14:03:18.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.640+0000 7fa6c5ffb700 1 -- 172.21.15.103:0/2970024056 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2666916896 0 0) 0x7fa6a8002fe0 con 0x7fa6c805b7c0 2020-04-22T14:03:18.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.640+0000 7fa6cd7e3700 1 -- 172.21.15.103:0/2970024056 >> v1:172.21.15.103:6789/0 conn(0x7fa6c805b7c0 legacy=0x7fa6c813cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:18.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.640+0000 7fa6cd7e3700 1 -- 172.21.15.103:0/2970024056 >> v1:172.21.15.86:6789/0 conn(0x7fa6c81441f0 legacy=0x7fa6c8063460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:18.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.640+0000 7fa6cd7e3700 1 -- 172.21.15.103:0/2970024056 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c80af4e0 con 0x7fa6c8144c80 2020-04-22T14:03:18.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.640+0000 7fa6cd7e3700 1 --2- 172.21.15.103:0/2970024056 >> v2:172.21.15.86:3300/0 conn(0x7fa6c8144c80 0x7fa6c8067030 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa6bc0084c0 tx=0x7fa6c0010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:18.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.640+0000 7fa6cd7e3700 1 --2- 172.21.15.103:0/2970024056 >> v2:172.21.15.86:3300/0 conn(0x7fa6c8144c80 0x7fa6c8067030 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa6bc0084c0 tx=0x7fa6c0010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:18.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.640+0000 7fa6cd7e3700 1 --2- 172.21.15.103:0/2970024056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6c8144c80 0x7fa6c8067030 secure :-1 s=READY pgs=203 cs=0 l=1 rx=0x7fa6bc0084c0 tx=0x7fa6c0010b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:18.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.640+0000 7fa6cd7e3700 1 --2- 172.21.15.103:0/2970024056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6c8144c80 0x7fa6c8067030 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7fa6bc0084c0 tx=0x7fa6c0010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:18.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.640+0000 7fa6c5ffb700 1 -- 172.21.15.103:0/2970024056 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6b80081a0 con 0x7fa6c8144c80 2020-04-22T14:03:18.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.640+0000 7fa6cd7e3700 1 --2- 172.21.15.103:0/2970024056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6c8144c80 0x7fa6c8067030 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7fa6bc0084c0 tx=0x7fa6c0010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:18.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.640+0000 7fa6cd7e3700 1 --2- 172.21.15.103:0/2970024056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6c8144c80 0x7fa6c8067030 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7fa6bc0084c0 tx=0x7fa6c0010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:18.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.640+0000 7fa6c5ffb700 1 -- 172.21.15.103:0/2970024056 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c0006e40 con 0x7fa6c8144c80 2020-04-22T14:03:18.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.640+0000 7fa6c5ffb700 1 -- 172.21.15.103:0/2970024056 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6c0008370 con 0x7fa6c8144c80 2020-04-22T14:03:18.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.640+0000 7fa6cf246700 1 -- 172.21.15.103:0/2970024056 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6c813d5b0 con 0x7fa6c8144c80 2020-04-22T14:03:18.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.640+0000 7fa6cf246700 1 -- 172.21.15.103:0/2970024056 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6c8143490 con 0x7fa6c8144c80 2020-04-22T14:03:18.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.641+0000 7fa6cd7e3700 1 --2- 172.21.15.103:0/2970024056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6c8144c80 0x7fa6c8067030 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7fa6bc0084c0 tx=0x7fa6c0010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:18.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.641+0000 7fa6cf246700 1 -- 172.21.15.103:0/2970024056 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6c8056c90 con 0x7fa6c8144c80 2020-04-22T14:03:18.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.641+0000 7fa6c5ffb700 1 -- 172.21.15.103:0/2970024056 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fa6c00085e0 con 0x7fa6c8144c80 2020-04-22T14:03:18.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.641+0000 7fa6cd7e3700 1 --2- 172.21.15.103:0/2970024056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6c8144c80 0x7fa6c8067030 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7fa6bc0084c0 tx=0x7fa6c0010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:18.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.642+0000 7fa6c5ffb700 1 --2- 172.21.15.103:0/2970024056 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa6a804dc10 0x7fa6a80500d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:18.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.642+0000 7fa6c5ffb700 1 -- 172.21.15.103:0/2970024056 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa6c00612c0 con 0x7fa6c8144c80 2020-04-22T14:03:18.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.642+0000 7fa6ccfe2700 1 --2- 172.21.15.103:0/2970024056 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa6a804dc10 0x7fa6a80500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:18.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.642+0000 7fa6ccfe2700 1 --2- 172.21.15.103:0/2970024056 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa6a804dc10 0x7fa6a80500d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa6b8003070 tx=0x7fa6b8011520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:18.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.642+0000 7fa6ccfe2700 1 --2- 172.21.15.103:0/2970024056 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa6a804dc10 0x7fa6a80500d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa6b8003070 tx=0x7fa6b8011520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:18.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.642+0000 7fa6ccfe2700 1 --2- 172.21.15.103:0/2970024056 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa6a804dc10 0x7fa6a80500d0 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7fa6b8003070 tx=0x7fa6b8011520).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:18.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.646+0000 7fa6cd7e3700 1 --2- 172.21.15.103:0/2970024056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6c8144c80 0x7fa6c8067030 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7fa6bc0084c0 tx=0x7fa6c0010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:18.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.646+0000 7fa6c5ffb700 1 -- 172.21.15.103:0/2970024056 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fa6c003c700 con 0x7fa6c8144c80 2020-04-22T14:03:18.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:18.854+0000 7fa6cf246700 1 -- 172.21.15.103:0/2970024056 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_abort_conn"]} v 0) v1 -- 0x7fa6c80af6d0 con 0x7fa6c8144c80 2020-04-22T14:03:18.910 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:18.928 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:03:18.970 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:18.984 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:03:19.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:19.460+0000 7fa6cd7e3700 1 --2- 172.21.15.103:0/2970024056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6c8144c80 0x7fa6c8067030 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7fa6bc0084c0 tx=0x7fa6c0010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:19.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:19.460+0000 7fa6c5ffb700 1 -- 172.21.15.103:0/2970024056 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_abort_conn"]}]=0 v62) v1 ==== 150+0+0 (secure 0 0 0) 0x7fa6c003fd20 con 0x7fa6c8144c80 2020-04-22T14:03:19.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:19.462+0000 7fa6cf246700 1 -- 172.21.15.103:0/2970024056 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa6a804dc10 msgr2=0x7fa6a80500d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:19.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:19.462+0000 7fa6cf246700 1 --2- 172.21.15.103:0/2970024056 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa6a804dc10 0x7fa6a80500d0 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7fa6b8003070 tx=0x7fa6b8011520).stop 2020-04-22T14:03:19.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:19.462+0000 7fa6cf246700 1 -- 172.21.15.103:0/2970024056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6c8144c80 msgr2=0x7fa6c8067030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:19.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:19.462+0000 7fa6cf246700 1 --2- 172.21.15.103:0/2970024056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6c8144c80 0x7fa6c8067030 secure :-1 s=READY pgs=203 cs=0 l=1 rx=0x7fa6bc0084c0 tx=0x7fa6c0010b50).stop 2020-04-22T14:03:19.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:19.462+0000 7fa6cf246700 1 -- 172.21.15.103:0/2970024056 shutdown_connections 2020-04-22T14:03:19.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:19.462+0000 7fa6cf246700 1 --2- 172.21.15.103:0/2970024056 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa6a804dc10 0x7fa6a80500d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:19.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:19.462+0000 7fa6cf246700 1 --2- 172.21.15.103:0/2970024056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6c8144c80 0x7fa6c8067030 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:19.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:19.462+0000 7fa6cf246700 1 -- 172.21.15.103:0/2970024056 >> 172.21.15.103:0/2970024056 conn(0x7fa6c80b9160 msgr2=0x7fa6c8061740 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:19.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:19.462+0000 7fa6cf246700 1 -- 172.21.15.103:0/2970024056 shutdown_connections 2020-04-22T14:03:19.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:19.462+0000 7fa6cf246700 1 -- 172.21.15.103:0/2970024056 wait complete. 2020-04-22T14:03:19.474 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-04-22T14:03:19.474 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:19.490 INFO:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:03:19.583 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:19.597 INFO:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:03:19.689 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-04-22T14:03:19.690 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2020-04-22T14:03:19.690 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:19.706 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-04-22T14:03:19.706 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:03:19.820 INFO:teuthology.orchestra.run:waiting for 900 2020-04-22T14:03:19.821 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:03:19.821 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:03:19.821 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:19.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:19.838 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:03:19.914 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:19.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:19.963 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down brx.1' 2020-04-22T14:03:20.121 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.1' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/6) 2020-04-22T14:03:20.172 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:20.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:20.185 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete brx.1' 2020-04-22T14:03:20.305 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.1' (b7338bd6-7982-4cad-a1d2-1d41a176da88) successfully deleted. 2020-04-22T14:03:20.306 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:20.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:20.332 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:03:20.440 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:20.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:20.463 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:03:20.522 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:03:20.522 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:03:20.522 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:03:20.522 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:20.523 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:03:20.523 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:20.523 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:03:20.523 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:20.523 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:03:20.523 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:20.523 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:03:20.524 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:20.524 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:03:20.524 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:20.524 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:03:20.524 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42640sec preferred_lft 42640sec 2020-04-22T14:03:20.524 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:03:20.524 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:20.525 INFO:teuthology.orchestra.run.smithi103.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:03:20.525 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 3e:08:3e:0d:9c:69 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:20.525 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:03:20.525 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:20.525 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::9821:a50f:5aef:14af/64 scope link noprefixroute 2020-04-22T14:03:20.525 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:20.525 INFO:teuthology.orchestra.run.smithi103.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-04-22T14:03:20.526 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 3e:08:3e:0d:9c:69 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2020-04-22T14:03:20.526 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:20.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:20.573 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:03:20.648 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:20.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:20.699 INFO:teuthology.orchestra.run.smithi103:> nmcli connection show 2020-04-22T14:03:20.808 INFO:teuthology.orchestra.run.smithi103.stdout:NAME UUID TYPE DEVICE 2020-04-22T14:03:20.809 INFO:teuthology.orchestra.run.smithi103.stdout:System enp3s0f1 b0a308d1-bd90-60af-eb7c-0183bb425a1a ethernet enp3s0f1 2020-04-22T14:03:20.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-brx 98ad9f03-62d2-4cb3-8b6b-776130ad88fa bridge ceph-brx 2020-04-22T14:03:20.809 INFO:teuthology.orchestra.run.smithi103.stdout:brx.0 a361587c-5aa9-48c5-b1b7-1a94dc2bbca9 ethernet brx.0 2020-04-22T14:03:20.809 INFO:teuthology.orchestra.run.smithi103.stdout:eno1 206ad60d-195e-4d4b-a9fe-a5dd1f33a67d ethernet -- 2020-04-22T14:03:20.809 INFO:teuthology.orchestra.run.smithi103.stdout:eno2 894a7dd2-d329-4985-9ef9-84a92c6e1c6c ethernet -- 2020-04-22T14:03:20.810 INFO:teuthology.orchestra.run.smithi103.stdout:enp3s0f0 5a3237ce-06ab-4ae0-818b-45bdf036cb08 ethernet -- 2020-04-22T14:03:20.810 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:20.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:20.830 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:03:20.889 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2020-04-22T14:03:20.890 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:20.939 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-04-22T14:03:20.939 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:03:21.021 INFO:teuthology.orchestra.run:waiting for 900 2020-04-22T14:03:21.022 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-04-22T14:03:21.022 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:03:21.022 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:21.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:21.071 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:03:21.146 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:21.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:21.197 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down brx.0' 2020-04-22T14:03:21.356 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.0' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/5) 2020-04-22T14:03:21.357 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:21.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:21.373 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete brx.0' 2020-04-22T14:03:21.480 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.0' (a361587c-5aa9-48c5-b1b7-1a94dc2bbca9) successfully deleted. 2020-04-22T14:03:21.480 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:21.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:21.510 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:03:21.617 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:21.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:21.639 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:03:21.698 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:03:21.698 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:03:21.698 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:03:21.699 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:21.699 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:03:21.699 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:21.699 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:03:21.699 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:21.699 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:03:21.699 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:21.700 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:03:21.700 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:21.700 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:03:21.700 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:21.700 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:03:21.700 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42639sec preferred_lft 42639sec 2020-04-22T14:03:21.700 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:03:21.701 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:21.701 INFO:teuthology.orchestra.run.smithi103.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:03:21.701 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:21.701 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:03:21.701 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:21.701 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::9821:a50f:5aef:14af/64 scope link noprefixroute 2020-04-22T14:03:21.701 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:21.702 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:21.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:21.746 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:03:21.830 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:21.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:21.872 INFO:teuthology.orchestra.run.smithi103:> nmcli connection show 2020-04-22T14:03:21.947 INFO:teuthology.orchestra.run.smithi103.stdout:NAME UUID TYPE DEVICE 2020-04-22T14:03:21.947 INFO:teuthology.orchestra.run.smithi103.stdout:System enp3s0f1 b0a308d1-bd90-60af-eb7c-0183bb425a1a ethernet enp3s0f1 2020-04-22T14:03:21.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-brx 98ad9f03-62d2-4cb3-8b6b-776130ad88fa bridge ceph-brx 2020-04-22T14:03:21.947 INFO:teuthology.orchestra.run.smithi103.stdout:eno1 206ad60d-195e-4d4b-a9fe-a5dd1f33a67d ethernet -- 2020-04-22T14:03:21.948 INFO:teuthology.orchestra.run.smithi103.stdout:eno2 894a7dd2-d329-4985-9ef9-84a92c6e1c6c ethernet -- 2020-04-22T14:03:21.948 INFO:teuthology.orchestra.run.smithi103.stdout:enp3s0f0 5a3237ce-06ab-4ae0-818b-45bdf036cb08 ethernet -- 2020-04-22T14:03:21.948 INFO:tasks.cephfs.mount:Removing the 'ceph-brx' 2020-04-22T14:03:21.948 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:21.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:21.992 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down ceph-brx' 2020-04-22T14:03:22.154 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/4) 2020-04-22T14:03:22.155 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:22.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:22.168 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete ceph-brx' 2020-04-22T14:03:22.275 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' (98ad9f03-62d2-4cb3-8b6b-776130ad88fa) successfully deleted. 2020-04-22T14:03:22.276 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:22.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:22.289 INFO:teuthology.orchestra.run.smithi103:> route 2020-04-22T14:03:22.348 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2020-04-22T14:03:22.348 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-04-22T14:03:22.348 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 102 0 0 enp3s0f1 2020-04-22T14:03:22.348 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 102 0 0 enp3s0f1 2020-04-22T14:03:22.349 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:22.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:22.398 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -D FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-04-22T14:03:22.505 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:22.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:22.531 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -D FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-04-22T14:03:22.638 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:22.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:22.663 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -t nat -D POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-04-22T14:03:22.770 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:22.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:22.800 INFO:teuthology.orchestra.run.smithi103:> cat /tmp/python-ceph-brx 2020-04-22T14:03:22.863 INFO:teuthology.orchestra.run.smithi103.stdout:0 2020-04-22T14:03:22.864 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:22.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:22.907 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 0 > /proc/sys/net/ipv4/ip_forward' 2020-04-22T14:03:22.983 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:23.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:23.031 INFO:teuthology.orchestra.run.smithi103:> rm -f /tmp/python-ceph-brx 2020-04-22T14:03:23.089 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:23.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:23.137 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:03:23.199 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi086.front.sepia.ceph.com... 2020-04-22T14:03:23.199 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:23.216 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-04-22T14:03:23.217 INFO:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.2) 2020-04-22T14:03:23.325 INFO:teuthology.orchestra.run:waiting for 900 2020-04-22T14:03:23.325 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.2' netns for '/home/ubuntu/cephtest/mnt.2' 2020-04-22T14:03:23.325 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' 2020-04-22T14:03:23.326 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:23.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:23.352 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:03:23.427 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:23.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:23.482 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'nmcli connection down brx.1' 2020-04-22T14:03:23.641 INFO:teuthology.orchestra.run.smithi086.stdout:Connection 'brx.1' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/6) 2020-04-22T14:03:23.641 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:23.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:23.655 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'nmcli connection delete brx.1' 2020-04-22T14:03:23.761 INFO:teuthology.orchestra.run.smithi086.stdout:Connection 'brx.1' (1584808d-123c-4e91-8a33-42a2964351cf) successfully deleted. 2020-04-22T14:03:23.762 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:23.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:23.775 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2' 2020-04-22T14:03:23.883 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:23.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:23.910 INFO:teuthology.orchestra.run.smithi086:> ip addr 2020-04-22T14:03:23.969 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:03:23.969 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:03:23.969 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:03:23.970 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:23.970 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2020-04-22T14:03:23.970 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:23.970 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:03:23.970 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:23.970 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:03:23.970 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:23.971 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:03:23.971 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:23.971 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:03:23.971 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:23.971 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:03:23.971 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 42610sec preferred_lft 42610sec 2020-04-22T14:03:23.971 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2020-04-22T14:03:23.971 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:23.972 INFO:teuthology.orchestra.run.smithi086.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:03:23.972 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 2a:6a:eb:ac:a8:de brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:23.972 INFO:teuthology.orchestra.run.smithi086.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:03:23.972 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:23.972 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::fc4f:8d1:211e:2a28/64 scope link noprefixroute 2020-04-22T14:03:23.972 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:23.972 INFO:teuthology.orchestra.run.smithi086.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-04-22T14:03:23.973 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 2a:6a:eb:ac:a8:de brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2020-04-22T14:03:23.973 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:24.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:24.018 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:03:24.095 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:24.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:24.147 INFO:teuthology.orchestra.run.smithi086:> nmcli connection show 2020-04-22T14:03:24.255 INFO:teuthology.orchestra.run.smithi086.stdout:NAME UUID TYPE DEVICE 2020-04-22T14:03:24.256 INFO:teuthology.orchestra.run.smithi086.stdout:System enp3s0f1 b0a308d1-bd90-60af-eb7c-0183bb425a1a ethernet enp3s0f1 2020-04-22T14:03:24.256 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-brx 8d9e7874-59bc-4ab5-9322-66e8d608582b bridge ceph-brx 2020-04-22T14:03:24.256 INFO:teuthology.orchestra.run.smithi086.stdout:brx.0 5c137a92-5a36-47f6-aefc-25f68ee80ed5 ethernet brx.0 2020-04-22T14:03:24.256 INFO:teuthology.orchestra.run.smithi086.stdout:eno1 206ad60d-195e-4d4b-a9fe-a5dd1f33a67d ethernet -- 2020-04-22T14:03:24.256 INFO:teuthology.orchestra.run.smithi086.stdout:eno2 894a7dd2-d329-4985-9ef9-84a92c6e1c6c ethernet -- 2020-04-22T14:03:24.256 INFO:teuthology.orchestra.run.smithi086.stdout:enp3s0f0 5a3237ce-06ab-4ae0-818b-45bdf036cb08 ethernet -- 2020-04-22T14:03:24.257 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:24.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:24.271 INFO:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2020-04-22T14:03:24.329 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi086.front.sepia.ceph.com... 2020-04-22T14:03:24.329 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:24.379 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-04-22T14:03:24.380 INFO:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.3) 2020-04-22T14:03:24.487 INFO:teuthology.orchestra.run:waiting for 900 2020-04-22T14:03:24.487 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.3' netns for '/home/ubuntu/cephtest/mnt.3' 2020-04-22T14:03:24.487 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' 2020-04-22T14:03:24.487 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:24.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:24.513 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:03:24.596 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:24.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:24.639 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'nmcli connection down brx.0' 2020-04-22T14:03:24.847 INFO:teuthology.orchestra.run.smithi086.stdout:Connection 'brx.0' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/5) 2020-04-22T14:03:24.848 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:24.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:24.861 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'nmcli connection delete brx.0' 2020-04-22T14:03:24.974 INFO:teuthology.orchestra.run.smithi086.stdout:Connection 'brx.0' (5c137a92-5a36-47f6-aefc-25f68ee80ed5) successfully deleted. 2020-04-22T14:03:24.975 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:25.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:25.002 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3' 2020-04-22T14:03:25.110 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:25.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:25.139 INFO:teuthology.orchestra.run.smithi086:> ip addr 2020-04-22T14:03:25.197 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:03:25.197 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:03:25.197 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:03:25.197 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:25.198 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2020-04-22T14:03:25.198 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:25.198 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:03:25.198 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:25.198 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:03:25.198 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:25.198 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:03:25.199 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:25.199 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:03:25.199 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:25.199 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:03:25.199 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 42609sec preferred_lft 42609sec 2020-04-22T14:03:25.199 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2020-04-22T14:03:25.199 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:25.200 INFO:teuthology.orchestra.run.smithi086.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:03:25.200 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:25.200 INFO:teuthology.orchestra.run.smithi086.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:03:25.200 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:25.200 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::fc4f:8d1:211e:2a28/64 scope link noprefixroute 2020-04-22T14:03:25.200 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:25.201 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:25.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:25.246 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:03:25.321 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:25.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:25.372 INFO:teuthology.orchestra.run.smithi086:> nmcli connection show 2020-04-22T14:03:25.449 INFO:teuthology.orchestra.run.smithi086.stdout:NAME UUID TYPE DEVICE 2020-04-22T14:03:25.449 INFO:teuthology.orchestra.run.smithi086.stdout:System enp3s0f1 b0a308d1-bd90-60af-eb7c-0183bb425a1a ethernet enp3s0f1 2020-04-22T14:03:25.450 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-brx 8d9e7874-59bc-4ab5-9322-66e8d608582b bridge ceph-brx 2020-04-22T14:03:25.450 INFO:teuthology.orchestra.run.smithi086.stdout:eno1 206ad60d-195e-4d4b-a9fe-a5dd1f33a67d ethernet -- 2020-04-22T14:03:25.450 INFO:teuthology.orchestra.run.smithi086.stdout:eno2 894a7dd2-d329-4985-9ef9-84a92c6e1c6c ethernet -- 2020-04-22T14:03:25.450 INFO:teuthology.orchestra.run.smithi086.stdout:enp3s0f0 5a3237ce-06ab-4ae0-818b-45bdf036cb08 ethernet -- 2020-04-22T14:03:25.450 INFO:tasks.cephfs.mount:Removing the 'ceph-brx' 2020-04-22T14:03:25.450 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:25.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:25.495 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'nmcli connection down ceph-brx' 2020-04-22T14:03:25.657 INFO:teuthology.orchestra.run.smithi086.stdout:Connection 'ceph-brx' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/4) 2020-04-22T14:03:25.657 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:25.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:25.673 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'nmcli connection delete ceph-brx' 2020-04-22T14:03:25.783 INFO:teuthology.orchestra.run.smithi086.stdout:Connection 'ceph-brx' (8d9e7874-59bc-4ab5-9322-66e8d608582b) successfully deleted. 2020-04-22T14:03:25.784 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:25.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:25.823 INFO:teuthology.orchestra.run.smithi086:> route 2020-04-22T14:03:25.877 INFO:teuthology.orchestra.run.smithi086.stdout:Kernel IP routing table 2020-04-22T14:03:25.877 INFO:teuthology.orchestra.run.smithi086.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-04-22T14:03:25.878 INFO:teuthology.orchestra.run.smithi086.stdout:default _gateway 0.0.0.0 UG 102 0 0 enp3s0f1 2020-04-22T14:03:25.878 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 102 0 0 enp3s0f1 2020-04-22T14:03:25.878 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:25.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:25.929 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'iptables -D FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-04-22T14:03:26.011 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:26.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:26.063 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'iptables -D FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-04-22T14:03:26.173 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:26.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:26.194 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'iptables -t nat -D POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-04-22T14:03:26.275 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:26.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:26.324 INFO:teuthology.orchestra.run.smithi086:> cat /tmp/python-ceph-brx 2020-04-22T14:03:26.383 INFO:teuthology.orchestra.run.smithi086.stdout:0 2020-04-22T14:03:26.383 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:26.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:26.431 INFO:teuthology.orchestra.run.smithi086:> sudo bash -c 'echo 0 > /proc/sys/net/ipv4/ip_forward' 2020-04-22T14:03:26.507 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:26.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:26.559 INFO:teuthology.orchestra.run.smithi086:> rm -f /tmp/python-ceph-brx 2020-04-22T14:03:26.618 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:26.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:26.666 INFO:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2020-04-22T14:03:26.723 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:26.740 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2020-04-22T14:03:26.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.893+0000 7f3dc49ee700 1 Processor -- start 2020-04-22T14:03:26.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.893+0000 7f3dc49ee700 1 -- start start 2020-04-22T14:03:26.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.894+0000 7f3dc49ee700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3dc012c0d0 0x7f3dc01464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:26.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.894+0000 7f3dc49ee700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dc0143300 con 0x7f3dc0063e30 2020-04-22T14:03:26.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.894+0000 7f3dc49ee700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dc01435a0 con 0x7f3dc0065fe0 2020-04-22T14:03:26.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.894+0000 7f3dc49ee700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc0143840 con 0x7f3dc012c0d0 2020-04-22T14:03:26.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.895+0000 7f3dbdd9b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f3dc0065fe0 0x7f3dc005b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40476/0 (socket says 172.21.15.103:40476) 2020-04-22T14:03:26.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.895+0000 7f3dbdd9b700 1 -- 172.21.15.103:0/2207824985 learned_addr learned my addr 172.21.15.103:0/2207824985 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:26.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.895+0000 7f3dbe59c700 1 --2- 172.21.15.103:0/2207824985 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3dc012c0d0 0x7f3dc01464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:26.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.895+0000 7f3dbd59a700 1 -- 172.21.15.103:0/2207824985 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 661326705 0 0) 0x7f3dc01435a0 con 0x7f3dc0065fe0 2020-04-22T14:03:26.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.895+0000 7f3dbd59a700 1 -- 172.21.15.103:0/2207824985 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3da0003230 con 0x7f3dc0065fe0 2020-04-22T14:03:26.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.895+0000 7f3dbd59a700 1 -- 172.21.15.103:0/2207824985 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1398943141 0 0) 0x7f3dc0143300 con 0x7f3dc0063e30 2020-04-22T14:03:26.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.895+0000 7f3dbe59c700 1 -- 172.21.15.103:0/2207824985 >> v1:172.21.15.103:6789/0 conn(0x7f3dc0065fe0 legacy=0x7f3dc005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:26.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.895+0000 7f3dbe59c700 1 -- 172.21.15.103:0/2207824985 >> v1:172.21.15.86:6789/0 conn(0x7f3dc0063e30 legacy=0x7f3dc00642a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:26.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.895+0000 7f3dbe59c700 1 -- 172.21.15.103:0/2207824985 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc005bb50 con 0x7f3dc012c0d0 2020-04-22T14:03:26.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.895+0000 7f3dbe59c700 1 --2- 172.21.15.103:0/2207824985 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3dc012c0d0 0x7f3dc01464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3db00017f0 tx=0x7f3da80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:26.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.895+0000 7f3dbe59c700 1 --2- 172.21.15.103:0/2207824985 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3dc012c0d0 0x7f3dc01464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3db00017f0 tx=0x7f3da80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:26.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.895+0000 7f3dbe59c700 1 --2- 172.21.15.103:0/2207824985 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3dc012c0d0 0x7f3dc01464e0 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7f3db00017f0 tx=0x7f3da80088e0).ready entity=mon.2 client_cookie=8ba83fa977387e4b server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:26.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.895+0000 7f3dbe59c700 1 --2- 172.21.15.103:0/2207824985 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3dc012c0d0 0x7f3dc01464e0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f3db00017f0 tx=0x7f3da80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:26.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.895+0000 7f3dbd59a700 1 -- 172.21.15.103:0/2207824985 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3db0001650 con 0x7f3dc012c0d0 2020-04-22T14:03:26.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.895+0000 7f3dbe59c700 1 --2- 172.21.15.103:0/2207824985 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3dc012c0d0 0x7f3dc01464e0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f3db00017f0 tx=0x7f3da80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:26.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.895+0000 7f3dbd59a700 1 -- 172.21.15.103:0/2207824985 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da8008d40 con 0x7f3dc012c0d0 2020-04-22T14:03:26.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.895+0000 7f3dbe59c700 1 --2- 172.21.15.103:0/2207824985 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3dc012c0d0 0x7f3dc01464e0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f3db00017f0 tx=0x7f3da80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:26.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.895+0000 7f3dbd59a700 1 -- 172.21.15.103:0/2207824985 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3da80114b0 con 0x7f3dc012c0d0 2020-04-22T14:03:26.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.895+0000 7f3dc49ee700 1 -- 172.21.15.103:0/2207824985 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3dc012c0d0 msgr2=0x7f3dc01464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:26.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.895+0000 7f3dc49ee700 1 --2- 172.21.15.103:0/2207824985 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3dc012c0d0 0x7f3dc01464e0 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7f3db00017f0 tx=0x7f3da80088e0).stop 2020-04-22T14:03:26.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.896+0000 7f3dc49ee700 1 -- 172.21.15.103:0/2207824985 shutdown_connections 2020-04-22T14:03:26.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.896+0000 7f3dc49ee700 1 --2- 172.21.15.103:0/2207824985 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3dc012c0d0 0x7f3dc01464e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:26.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.896+0000 7f3dc49ee700 1 -- 172.21.15.103:0/2207824985 >> 172.21.15.103:0/2207824985 conn(0x7f3dc00b9160 msgr2=0x7f3dc005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:26.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.896+0000 7f3dc49ee700 1 -- 172.21.15.103:0/2207824985 shutdown_connections 2020-04-22T14:03:26.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.896+0000 7f3dc49ee700 1 -- 172.21.15.103:0/2207824985 wait complete. 2020-04-22T14:03:26.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.897+0000 7f3dc49ee700 1 Processor -- start 2020-04-22T14:03:26.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.897+0000 7f3dc49ee700 1 -- start start 2020-04-22T14:03:26.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.898+0000 7f3dc49ee700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3dc012c0d0 0x7f3dc01239d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:26.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.898+0000 7f3dc49ee700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dc0123e30 con 0x7f3dc0065fe0 2020-04-22T14:03:26.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.898+0000 7f3dc49ee700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dc0145640 con 0x7f3dc0063e30 2020-04-22T14:03:26.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.898+0000 7f3dc49ee700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc0143f10 con 0x7f3dc012c0d0 2020-04-22T14:03:26.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.898+0000 7f3dbe59c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f3dc0063e30 0x7f3dc0144f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40480/0 (socket says 172.21.15.103:40480) 2020-04-22T14:03:26.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.898+0000 7f3dbe59c700 1 -- 172.21.15.103:0/922245365 learned_addr learned my addr 172.21.15.103:0/922245365 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:26.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.898+0000 7f3db77fe700 1 -- 172.21.15.103:0/922245365 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3716911076 0 0) 0x7f3dc0145640 con 0x7f3dc0063e30 2020-04-22T14:03:26.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.898+0000 7f3db77fe700 1 -- 172.21.15.103:0/922245365 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3da4002fe0 con 0x7f3dc0063e30 2020-04-22T14:03:26.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.898+0000 7f3dbed9d700 1 --2- 172.21.15.103:0/922245365 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3dc012c0d0 0x7f3dc01239d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:26.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.898+0000 7f3db77fe700 1 -- 172.21.15.103:0/922245365 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 913572857 0 0) 0x7f3da4002fe0 con 0x7f3dc0063e30 2020-04-22T14:03:26.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.898+0000 7f3db77fe700 1 -- 172.21.15.103:0/922245365 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3dc0145640 con 0x7f3dc0063e30 2020-04-22T14:03:26.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.898+0000 7f3db77fe700 1 -- 172.21.15.103:0/922245365 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f3da8008660 con 0x7f3dc0063e30 2020-04-22T14:03:26.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.898+0000 7f3db77fe700 1 -- 172.21.15.103:0/922245365 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3dc012c0d0 msgr2=0x7f3dc01239d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:26.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.898+0000 7f3db77fe700 1 --2- 172.21.15.103:0/922245365 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3dc012c0d0 0x7f3dc01239d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:26.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.898+0000 7f3db77fe700 1 -- 172.21.15.103:0/922245365 >> v1:172.21.15.103:6789/0 conn(0x7f3dc0063e30 legacy=0x7f3dc0144f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:26.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.898+0000 7f3db77fe700 1 -- 172.21.15.103:0/922245365 >> v1:172.21.15.86:6789/0 conn(0x7f3dc0065fe0 legacy=0x7f3dc0142100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:26.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.898+0000 7f3db77fe700 1 --2- 172.21.15.103:0/922245365 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3dc012c0d0 0x7f3da40049b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:26.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.898+0000 7f3db77fe700 1 --2- 172.21.15.103:0/922245365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3da4004e10 0x7f3da4005230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:26.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.898+0000 7f3db77fe700 1 --2- 172.21.15.103:0/922245365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3da40039e0 0x7f3da4003e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:26.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.898+0000 7f3db77fe700 1 -- 172.21.15.103:0/922245365 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc0143f10 con 0x7f3da40039e0 2020-04-22T14:03:26.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.898+0000 7f3db77fe700 1 -- 172.21.15.103:0/922245365 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da4004410 con 0x7f3da4004e10 2020-04-22T14:03:26.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.898+0000 7f3db77fe700 1 -- 172.21.15.103:0/922245365 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da40045d0 con 0x7f3dc012c0d0 2020-04-22T14:03:26.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.898+0000 7f3dbdd9b700 1 --2- 172.21.15.103:0/922245365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3da4004e10 0x7f3da4005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:26.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.898+0000 7f3dbe59c700 1 --2- 172.21.15.103:0/922245365 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3dc012c0d0 0x7f3da40049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:26.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.898+0000 7f3dbed9d700 1 --2- 172.21.15.103:0/922245365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3da40039e0 0x7f3da4003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:26.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.899+0000 7f3dbdd9b700 1 -- 172.21.15.103:0/922245365 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3dc012c0d0 msgr2=0x7f3da40049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:26.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.899+0000 7f3dbdd9b700 1 --2- 172.21.15.103:0/922245365 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3dc012c0d0 0x7f3da40049b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:26.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.899+0000 7f3dbdd9b700 1 -- 172.21.15.103:0/922245365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3da40039e0 msgr2=0x7f3da4003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:26.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.899+0000 7f3dbdd9b700 1 --2- 172.21.15.103:0/922245365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3da40039e0 0x7f3da4003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:26.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.899+0000 7f3dbdd9b700 1 -- 172.21.15.103:0/922245365 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc01441b0 con 0x7f3da4004e10 2020-04-22T14:03:26.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.899+0000 7f3dc49ee700 1 -- 172.21.15.103:0/922245365 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dc0144450 con 0x7f3da4004e10 2020-04-22T14:03:26.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.899+0000 7f3dbdd9b700 1 --2- 172.21.15.103:0/922245365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3da4004e10 0x7f3da4005230 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3db0000fa0 tx=0x7f3db0010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:26.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.899+0000 7f3dbe59c700 1 --2- 172.21.15.103:0/922245365 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3dc012c0d0 0x7f3da40049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:03:26.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.899+0000 7f3dc49ee700 1 -- 172.21.15.103:0/922245365 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dc0142810 con 0x7f3da4004e10 2020-04-22T14:03:26.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.899+0000 7f3dbdd9b700 1 --2- 172.21.15.103:0/922245365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3da4004e10 0x7f3da4005230 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3db0000fa0 tx=0x7f3db0010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:26.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.899+0000 7f3dbdd9b700 1 --2- 172.21.15.103:0/922245365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3da4004e10 0x7f3da4005230 secure :-1 s=READY pgs=313 cs=0 l=1 rx=0x7f3db0000fa0 tx=0x7f3db0010e30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:26.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.899+0000 7f3dbdd9b700 1 --2- 172.21.15.103:0/922245365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3da4004e10 0x7f3da4005230 secure :-1 s=THROTTLE_DONE pgs=313 cs=0 l=1 rx=0x7f3db0000fa0 tx=0x7f3db0010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:26.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.899+0000 7f3db77fe700 1 -- 172.21.15.103:0/922245365 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3db000cd40 con 0x7f3da4004e10 2020-04-22T14:03:26.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.899+0000 7f3dbdd9b700 1 --2- 172.21.15.103:0/922245365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3da4004e10 0x7f3da4005230 secure :-1 s=THROTTLE_DONE pgs=313 cs=0 l=1 rx=0x7f3db0000fa0 tx=0x7f3db0010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:26.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.899+0000 7f3dbdd9b700 1 --2- 172.21.15.103:0/922245365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3da4004e10 0x7f3da4005230 secure :-1 s=THROTTLE_DONE pgs=313 cs=0 l=1 rx=0x7f3db0000fa0 tx=0x7f3db0010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:26.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.899+0000 7f3db77fe700 1 -- 172.21.15.103:0/922245365 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db00044f0 con 0x7f3da4004e10 2020-04-22T14:03:26.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.899+0000 7f3db77fe700 1 -- 172.21.15.103:0/922245365 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3db00048d0 con 0x7f3da4004e10 2020-04-22T14:03:26.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.899+0000 7f3dbdd9b700 1 --2- 172.21.15.103:0/922245365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3da4004e10 0x7f3da4005230 secure :-1 s=THROTTLE_DONE pgs=313 cs=0 l=1 rx=0x7f3db0000fa0 tx=0x7f3db0010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:26.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.900+0000 7f3dc49ee700 1 -- 172.21.15.103:0/922245365 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dc0056c90 con 0x7f3da4004e10 2020-04-22T14:03:26.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.900+0000 7f3db77fe700 1 -- 172.21.15.103:0/922245365 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f3db0004a30 con 0x7f3da4004e10 2020-04-22T14:03:26.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.900+0000 7f3dbdd9b700 1 --2- 172.21.15.103:0/922245365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3da4004e10 0x7f3da4005230 secure :-1 s=THROTTLE_DONE pgs=313 cs=0 l=1 rx=0x7f3db0000fa0 tx=0x7f3db0010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:26.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.900+0000 7f3db77fe700 1 --2- 172.21.15.103:0/922245365 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3da4055990 0x7f3da4057e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:26.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.900+0000 7f3db77fe700 1 -- 172.21.15.103:0/922245365 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3db0061400 con 0x7f3da4004e10 2020-04-22T14:03:26.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.900+0000 7f3dbe59c700 1 --2- 172.21.15.103:0/922245365 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3da4055990 0x7f3da4057e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:26.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.901+0000 7f3dbe59c700 1 --2- 172.21.15.103:0/922245365 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3da4055990 0x7f3da4057e50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3da8008320 tx=0x7f3dc005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:26.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.901+0000 7f3dbe59c700 1 --2- 172.21.15.103:0/922245365 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3da4055990 0x7f3da4057e50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3da8008320 tx=0x7f3dc005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:26.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.901+0000 7f3dbe59c700 1 --2- 172.21.15.103:0/922245365 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3da4055990 0x7f3da4057e50 secure :-1 s=READY pgs=135 cs=0 l=1 rx=0x7f3da8008320 tx=0x7f3dc005bce0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:26.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.904+0000 7f3dbdd9b700 1 --2- 172.21.15.103:0/922245365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3da4004e10 0x7f3da4005230 secure :-1 s=THROTTLE_DONE pgs=313 cs=0 l=1 rx=0x7f3db0000fa0 tx=0x7f3db0010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:26.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:26.904+0000 7f3db77fe700 1 -- 172.21.15.103:0/922245365 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f3db003c780 con 0x7f3da4004e10 2020-04-22T14:03:27.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.045+0000 7f3dc49ee700 1 -- 172.21.15.103:0/922245365 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f3dc006a810 con 0x7f3da4004e10 2020-04-22T14:03:27.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.046+0000 7f3dbdd9b700 1 --2- 172.21.15.103:0/922245365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3da4004e10 0x7f3da4005230 secure :-1 s=THROTTLE_DONE pgs=313 cs=0 l=1 rx=0x7f3db0000fa0 tx=0x7f3db0010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:27.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.046+0000 7f3db77fe700 1 -- 172.21.15.103:0/922245365 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v24) v1 ==== 81+0+33696 (secure 0 0 0) 0x7f3db003fda0 con 0x7f3da4004e10 2020-04-22T14:03:27.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.048+0000 7f3dc49ee700 1 -- 172.21.15.103:0/922245365 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3da4055990 msgr2=0x7f3da4057e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:27.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.048+0000 7f3dc49ee700 1 --2- 172.21.15.103:0/922245365 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3da4055990 0x7f3da4057e50 secure :-1 s=READY pgs=135 cs=0 l=1 rx=0x7f3da8008320 tx=0x7f3dc005bce0).stop 2020-04-22T14:03:27.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.048+0000 7f3dc49ee700 1 -- 172.21.15.103:0/922245365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3da4004e10 msgr2=0x7f3da4005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:27.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.048+0000 7f3dc49ee700 1 --2- 172.21.15.103:0/922245365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3da4004e10 0x7f3da4005230 secure :-1 s=READY pgs=313 cs=0 l=1 rx=0x7f3db0000fa0 tx=0x7f3db0010e30).stop 2020-04-22T14:03:27.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.048+0000 7f3dbed9d700 1 -- 172.21.15.103:0/922245365 reap_dead start 2020-04-22T14:03:27.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.048+0000 7f3dc49ee700 1 -- 172.21.15.103:0/922245365 shutdown_connections 2020-04-22T14:03:27.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.048+0000 7f3dc49ee700 1 --2- 172.21.15.103:0/922245365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3da4004e10 0x7f3da4005230 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:27.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.048+0000 7f3dc49ee700 1 -- 172.21.15.103:0/922245365 >> 172.21.15.103:0/922245365 conn(0x7f3dc00b9160 msgr2=0x7f3dc00642a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:27.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.048+0000 7f3dc49ee700 1 -- 172.21.15.103:0/922245365 shutdown_connections 2020-04-22T14:03:27.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.048+0000 7f3dc49ee700 1 -- 172.21.15.103:0/922245365 wait complete. 2020-04-22T14:03:27.051 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:03:27.052 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:03:27.052 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 24, 2020-04-22T14:03:27.052 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:03:27.052 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2020-04-22T14:02:06.484738+0000", 2020-04-22T14:03:27.052 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2020-04-22T14:02:28.687155+0000", 2020-04-22T14:03:27.052 INFO:teuthology.orchestra.run.smithi103.stdout: "last_up_change": "2020-04-22T14:02:18.623774+0000", 2020-04-22T14:03:27.052 INFO:teuthology.orchestra.run.smithi103.stdout: "last_in_change": "2020-04-22T14:02:18.623774+0000", 2020-04-22T14:03:27.053 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-04-22T14:03:27.053 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_num": 5799936, 2020-04-22T14:03:27.053 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_set": [ 2020-04-22T14:03:27.053 INFO:teuthology.orchestra.run.smithi103.stdout: "pglog_hardlimit", 2020-04-22T14:03:27.053 INFO:teuthology.orchestra.run.smithi103.stdout: "purged_snapdirs", 2020-04-22T14:03:27.053 INFO:teuthology.orchestra.run.smithi103.stdout: "recovery_deletes", 2020-04-22T14:03:27.053 INFO:teuthology.orchestra.run.smithi103.stdout: "sortbitwise" 2020-04-22T14:03:27.054 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:03:27.054 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_version": 5, 2020-04-22T14:03:27.054 INFO:teuthology.orchestra.run.smithi103.stdout: "full_ratio": 0.94999998807907104, 2020-04-22T14:03:27.054 INFO:teuthology.orchestra.run.smithi103.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-04-22T14:03:27.054 INFO:teuthology.orchestra.run.smithi103.stdout: "nearfull_ratio": 0.85000002384185791, 2020-04-22T14:03:27.054 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_snapshot": "", 2020-04-22T14:03:27.054 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_max": 4, 2020-04-22T14:03:27.054 INFO:teuthology.orchestra.run.smithi103.stdout: "max_osd": 8, 2020-04-22T14:03:27.055 INFO:teuthology.orchestra.run.smithi103.stdout: "require_min_compat_client": "luminous", 2020-04-22T14:03:27.055 INFO:teuthology.orchestra.run.smithi103.stdout: "min_compat_client": "jewel", 2020-04-22T14:03:27.055 INFO:teuthology.orchestra.run.smithi103.stdout: "require_osd_release": "pacific", 2020-04-22T14:03:27.055 INFO:teuthology.orchestra.run.smithi103.stdout: "pools": [ 2020-04-22T14:03:27.055 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.055 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 1, 2020-04-22T14:03:27.055 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "device_health_metrics", 2020-04-22T14:03:27.056 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:02:09.565655+0000", 2020-04-22T14:03:27.056 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:03:27.056 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:03:27.056 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:03:27.056 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:03:27.056 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:03:27.056 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:03:27.057 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:03:27.057 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:03:27.057 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 1, 2020-04-22T14:03:27.057 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 1, 2020-04-22T14:03:27.057 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 1, 2020-04-22T14:03:27.058 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 1, 2020-04-22T14:03:27.058 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 1, 2020-04-22T14:03:27.058 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:03:27.059 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:03:27.059 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:03:27.059 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:03:27.059 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:03:27.059 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:03:27.060 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:03:27.060 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.060 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "17", 2020-04-22T14:03:27.060 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:03:27.060 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:03:27.060 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:03:27.060 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:03:27.061 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:03:27.061 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:03:27.061 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:03:27.061 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:03:27.061 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:03:27.061 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:03:27.061 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:03:27.061 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:03:27.062 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:03:27.062 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:03:27.062 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:03:27.062 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:03:27.062 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:03:27.062 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:03:27.062 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:03:27.062 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:03:27.063 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:03:27.063 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:03:27.063 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:03:27.063 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:03:27.063 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:03:27.063 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:03:27.063 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.064 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:03:27.064 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:03:27.064 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:03:27.064 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:03:27.064 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:03:27.065 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:03:27.065 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:03:27.065 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:03:27.065 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:03:27.065 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:03:27.066 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:03:27.066 INFO:teuthology.orchestra.run.smithi103.stdout: "options": { 2020-04-22T14:03:27.066 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_min": 1 2020-04-22T14:03:27.066 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.066 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:03:27.067 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_devicehealth": {} 2020-04-22T14:03:27.067 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.067 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.067 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.067 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 2, 2020-04-22T14:03:27.067 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "rbd", 2020-04-22T14:03:27.067 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:02:22.733031+0000", 2020-04-22T14:03:27.067 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:03:27.068 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:03:27.068 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:03:27.068 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:03:27.068 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:03:27.068 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:03:27.068 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:03:27.069 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:03:27.069 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 8, 2020-04-22T14:03:27.069 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 8, 2020-04-22T14:03:27.070 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 8, 2020-04-22T14:03:27.070 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 8, 2020-04-22T14:03:27.070 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 8, 2020-04-22T14:03:27.070 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:03:27.070 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:03:27.070 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:03:27.070 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:03:27.071 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:03:27.071 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:03:27.071 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:03:27.071 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.071 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "20", 2020-04-22T14:03:27.071 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:03:27.071 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:03:27.072 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:03:27.072 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:03:27.072 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:03:27.072 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:03:27.072 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:03:27.073 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:03:27.073 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:03:27.073 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:03:27.073 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:03:27.073 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:03:27.073 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:03:27.073 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:03:27.074 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:03:27.074 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:03:27.074 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:03:27.074 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:03:27.074 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:03:27.074 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:03:27.074 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:03:27.074 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:03:27.075 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:03:27.075 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:03:27.075 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:03:27.075 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:03:27.075 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.075 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:03:27.075 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:03:27.075 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:03:27.076 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:03:27.077 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:03:27.077 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:03:27.077 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:03:27.077 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:03:27.077 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:03:27.077 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:03:27.077 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:03:27.078 INFO:teuthology.orchestra.run.smithi103.stdout: "options": {}, 2020-04-22T14:03:27.078 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:03:27.078 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd": {} 2020-04-22T14:03:27.078 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.078 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.078 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.078 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 3, 2020-04-22T14:03:27.079 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "cephfs_metadata", 2020-04-22T14:03:27.079 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:02:25.963043+0000", 2020-04-22T14:03:27.079 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:03:27.079 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:03:27.079 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:03:27.079 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:03:27.079 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:03:27.080 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:03:27.080 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:03:27.080 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:03:27.080 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 8, 2020-04-22T14:03:27.093 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 8, 2020-04-22T14:03:27.094 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 8, 2020-04-22T14:03:27.094 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 8, 2020-04-22T14:03:27.094 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 8, 2020-04-22T14:03:27.094 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:03:27.094 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:03:27.094 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:03:27.095 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:03:27.095 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:03:27.095 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:03:27.095 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:03:27.095 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.095 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "23", 2020-04-22T14:03:27.095 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:03:27.096 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:03:27.096 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:03:27.096 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:03:27.096 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:03:27.096 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:03:27.097 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:03:27.097 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:03:27.097 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:03:27.097 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:03:27.097 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:03:27.097 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:03:27.097 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:03:27.098 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:03:27.098 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:03:27.098 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:03:27.098 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:03:27.098 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:03:27.098 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:03:27.098 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:03:27.099 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:03:27.099 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:03:27.099 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:03:27.099 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:03:27.099 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:03:27.099 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:03:27.099 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.099 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:03:27.100 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:03:27.100 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:03:27.100 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:03:27.100 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:03:27.100 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:03:27.100 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:03:27.100 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:03:27.101 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:03:27.101 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:03:27.101 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:03:27.101 INFO:teuthology.orchestra.run.smithi103.stdout: "options": { 2020-04-22T14:03:27.101 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_bias": 4, 2020-04-22T14:03:27.101 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_min": 16, 2020-04-22T14:03:27.101 INFO:teuthology.orchestra.run.smithi103.stdout: "recovery_priority": 5 2020-04-22T14:03:27.102 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.102 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:03:27.102 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs": { 2020-04-22T14:03:27.102 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": "cephfs" 2020-04-22T14:03:27.102 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.102 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.102 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.103 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.103 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 4, 2020-04-22T14:03:27.103 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "cephfs_data", 2020-04-22T14:03:27.104 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:02:26.642611+0000", 2020-04-22T14:03:27.104 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:03:27.104 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:03:27.104 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:03:27.104 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:03:27.104 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:03:27.104 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:03:27.105 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:03:27.105 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:03:27.105 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 8, 2020-04-22T14:03:27.105 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 8, 2020-04-22T14:03:27.105 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 8, 2020-04-22T14:03:27.105 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 8, 2020-04-22T14:03:27.105 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 8, 2020-04-22T14:03:27.106 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:03:27.106 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:03:27.106 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:03:27.106 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:03:27.106 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:03:27.107 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:03:27.108 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:03:27.108 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.108 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "24", 2020-04-22T14:03:27.108 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:03:27.109 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:03:27.109 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:03:27.109 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:03:27.109 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:03:27.109 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:03:27.109 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:03:27.109 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:03:27.110 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:03:27.110 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:03:27.110 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:03:27.110 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:03:27.110 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:03:27.110 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:03:27.110 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:03:27.111 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:03:27.111 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:03:27.111 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:03:27.111 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:03:27.111 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:03:27.111 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:03:27.111 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:03:27.111 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:03:27.112 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:03:27.112 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:03:27.112 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:03:27.112 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.112 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:03:27.112 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:03:27.113 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:03:27.113 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:03:27.113 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:03:27.113 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:03:27.114 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:03:27.114 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:03:27.114 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:03:27.114 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:03:27.114 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:03:27.114 INFO:teuthology.orchestra.run.smithi103.stdout: "options": {}, 2020-04-22T14:03:27.114 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:03:27.115 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs": { 2020-04-22T14:03:27.115 INFO:teuthology.orchestra.run.smithi103.stdout: "data": "cephfs" 2020-04-22T14:03:27.115 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.115 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.115 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.115 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:03:27.115 INFO:teuthology.orchestra.run.smithi103.stdout: "osds": [ 2020-04-22T14:03:27.116 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.116 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 0, 2020-04-22T14:03:27.116 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "3546145b-bd93-4a79-b6fe-3158153b8f05", 2020-04-22T14:03:27.116 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:03:27.116 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:03:27.116 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:03:27.116 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:03:27.117 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:03:27.117 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:03:27.117 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:03:27.117 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 22, 2020-04-22T14:03:27.117 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:03:27.118 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:03:27.118 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:03:27.118 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:03:27.118 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.118 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:03:27.118 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6800", 2020-04-22T14:03:27.118 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:03:27.119 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.119 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.119 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:03:27.119 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6801", 2020-04-22T14:03:27.119 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:03:27.119 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.119 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:03:27.120 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.120 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:03:27.120 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:03:27.120 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.120 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:03:27.120 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6802", 2020-04-22T14:03:27.120 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:03:27.121 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.121 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.121 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:03:27.121 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6803", 2020-04-22T14:03:27.121 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:03:27.121 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.121 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:03:27.121 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.122 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:03:27.122 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:03:27.122 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.122 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:03:27.122 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6806", 2020-04-22T14:03:27.122 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:03:27.122 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.123 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.123 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:03:27.123 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6807", 2020-04-22T14:03:27.123 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:03:27.123 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.124 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:03:27.124 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.124 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:03:27.124 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:03:27.124 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.125 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:03:27.125 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6804", 2020-04-22T14:03:27.125 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:03:27.125 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.125 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.125 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:03:27.125 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6805", 2020-04-22T14:03:27.126 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:03:27.126 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.126 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:03:27.126 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.126 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6801/33072", 2020-04-22T14:03:27.126 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6803/33072", 2020-04-22T14:03:27.126 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6807/33072", 2020-04-22T14:03:27.127 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6805/33072", 2020-04-22T14:03:27.127 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:03:27.127 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:03:27.127 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:03:27.128 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:03:27.128 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.128 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.128 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 1, 2020-04-22T14:03:27.128 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "65ca5f7d-2ea6-4de6-a034-08a0a99aa80d", 2020-04-22T14:03:27.128 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:03:27.128 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:03:27.129 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:03:27.129 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:03:27.129 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:03:27.129 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:03:27.129 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:03:27.129 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 22, 2020-04-22T14:03:27.129 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:03:27.130 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:03:27.130 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:03:27.130 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:03:27.130 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.130 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:03:27.130 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6808", 2020-04-22T14:03:27.130 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:03:27.131 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.131 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.131 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:03:27.131 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6809", 2020-04-22T14:03:27.131 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:03:27.131 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.131 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:03:27.131 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.132 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:03:27.132 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:03:27.132 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.132 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:03:27.132 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6810", 2020-04-22T14:03:27.132 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:03:27.132 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.133 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.133 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:03:27.133 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6811", 2020-04-22T14:03:27.133 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:03:27.133 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.133 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:03:27.133 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.134 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:03:27.134 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:03:27.134 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.134 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:03:27.135 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6814", 2020-04-22T14:03:27.135 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:03:27.135 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.135 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.135 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:03:27.135 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6815", 2020-04-22T14:03:27.135 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:03:27.136 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.136 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:03:27.136 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.136 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:03:27.136 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:03:27.136 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.136 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:03:27.137 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6812", 2020-04-22T14:03:27.137 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:03:27.137 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.137 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.137 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:03:27.137 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6813", 2020-04-22T14:03:27.137 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:03:27.138 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.138 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:03:27.138 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.138 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6809/33103", 2020-04-22T14:03:27.138 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6811/33103", 2020-04-22T14:03:27.139 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6815/33103", 2020-04-22T14:03:27.139 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6813/33103", 2020-04-22T14:03:27.139 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:03:27.139 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:03:27.139 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:03:27.139 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:03:27.139 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.140 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.140 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 2, 2020-04-22T14:03:27.140 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "f2e9bf44-c844-48d7-b6c2-f08ea71189b4", 2020-04-22T14:03:27.140 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:03:27.140 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:03:27.140 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:03:27.140 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:03:27.140 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:03:27.141 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:03:27.141 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:03:27.141 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 18, 2020-04-22T14:03:27.141 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:03:27.141 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:03:27.141 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:03:27.141 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:03:27.142 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.142 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:03:27.142 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6816", 2020-04-22T14:03:27.142 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:03:27.142 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.142 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.142 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:03:27.142 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6817", 2020-04-22T14:03:27.143 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:03:27.143 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.143 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:03:27.143 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.143 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:03:27.143 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:03:27.143 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.144 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:03:27.144 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6818", 2020-04-22T14:03:27.144 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:03:27.144 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.144 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.145 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:03:27.145 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6819", 2020-04-22T14:03:27.145 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:03:27.145 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.145 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:03:27.145 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.145 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:03:27.146 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:03:27.146 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.146 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:03:27.146 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6822", 2020-04-22T14:03:27.146 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:03:27.146 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.146 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.147 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:03:27.147 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6823", 2020-04-22T14:03:27.147 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:03:27.147 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.147 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:03:27.147 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.147 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:03:27.148 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:03:27.148 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.148 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:03:27.148 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6820", 2020-04-22T14:03:27.148 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:03:27.149 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.149 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.149 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:03:27.149 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6821", 2020-04-22T14:03:27.149 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:03:27.149 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.150 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:03:27.150 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.150 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6817/33153", 2020-04-22T14:03:27.150 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6819/33153", 2020-04-22T14:03:27.150 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6823/33153", 2020-04-22T14:03:27.150 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6821/33153", 2020-04-22T14:03:27.150 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:03:27.151 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:03:27.151 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:03:27.151 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:03:27.151 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.151 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.151 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 3, 2020-04-22T14:03:27.151 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "0ab87fee-a427-4906-851a-b9bd8c2e5645", 2020-04-22T14:03:27.151 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:03:27.152 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:03:27.152 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:03:27.152 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:03:27.152 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:03:27.152 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:03:27.152 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:03:27.152 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 22, 2020-04-22T14:03:27.153 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:03:27.153 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:03:27.153 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:03:27.153 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:03:27.153 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.153 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:03:27.153 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6824", 2020-04-22T14:03:27.154 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:03:27.154 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.154 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.154 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:03:27.154 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6825", 2020-04-22T14:03:27.154 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:03:27.155 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.155 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:03:27.155 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.155 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:03:27.155 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:03:27.155 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.156 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:03:27.156 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6826", 2020-04-22T14:03:27.156 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:03:27.156 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.156 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.156 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:03:27.156 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6827", 2020-04-22T14:03:27.157 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:03:27.157 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.157 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:03:27.157 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.157 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:03:27.157 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:03:27.157 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.158 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:03:27.158 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6830", 2020-04-22T14:03:27.158 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:03:27.158 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.158 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.158 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:03:27.158 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6831", 2020-04-22T14:03:27.159 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:03:27.159 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.159 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:03:27.159 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.159 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:03:27.159 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:03:27.160 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.160 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:03:27.160 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6828", 2020-04-22T14:03:27.160 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:03:27.160 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.160 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.161 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:03:27.161 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6829", 2020-04-22T14:03:27.161 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:03:27.161 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.161 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:03:27.161 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.161 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6825/33183", 2020-04-22T14:03:27.162 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6827/33183", 2020-04-22T14:03:27.162 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6831/33183", 2020-04-22T14:03:27.162 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6829/33183", 2020-04-22T14:03:27.162 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:03:27.162 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:03:27.162 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:03:27.162 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:03:27.163 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.163 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.163 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 4, 2020-04-22T14:03:27.163 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "2565df7d-2eff-484b-a3cd-ed7715e5d875", 2020-04-22T14:03:27.163 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:03:27.163 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:03:27.163 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:03:27.164 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:03:27.164 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:03:27.164 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:03:27.164 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:03:27.164 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 22, 2020-04-22T14:03:27.164 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:03:27.164 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:03:27.164 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:03:27.165 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:03:27.165 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.165 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:03:27.165 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6802", 2020-04-22T14:03:27.165 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:03:27.165 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.165 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.166 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:03:27.166 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6803", 2020-04-22T14:03:27.166 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:03:27.166 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.166 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:03:27.166 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.166 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:03:27.166 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:03:27.167 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.167 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:03:27.167 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6804", 2020-04-22T14:03:27.167 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:03:27.167 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.167 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.167 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:03:27.168 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6805", 2020-04-22T14:03:27.168 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:03:27.168 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.168 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:03:27.168 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.168 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:03:27.168 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:03:27.168 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.169 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:03:27.169 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6808", 2020-04-22T14:03:27.169 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:03:27.169 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.169 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.170 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:03:27.170 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6809", 2020-04-22T14:03:27.170 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:03:27.170 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.170 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:03:27.170 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.170 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:03:27.171 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:03:27.171 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.171 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:03:27.171 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6806", 2020-04-22T14:03:27.171 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:03:27.171 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.172 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.172 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:03:27.172 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6807", 2020-04-22T14:03:27.172 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:03:27.172 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.172 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:03:27.172 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.173 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6803/33506", 2020-04-22T14:03:27.173 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6805/33506", 2020-04-22T14:03:27.173 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6809/33506", 2020-04-22T14:03:27.173 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6807/33506", 2020-04-22T14:03:27.173 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:03:27.173 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:03:27.173 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:03:27.174 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:03:27.174 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.174 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.174 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 5, 2020-04-22T14:03:27.174 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "bcfd7a16-6914-4152-8647-a481917fe19d", 2020-04-22T14:03:27.174 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:03:27.174 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:03:27.175 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:03:27.175 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:03:27.175 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:03:27.175 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:03:27.175 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:03:27.175 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 21, 2020-04-22T14:03:27.175 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:03:27.175 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:03:27.176 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:03:27.176 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:03:27.176 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.176 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:03:27.176 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6810", 2020-04-22T14:03:27.176 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:03:27.176 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.177 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.177 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:03:27.177 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6811", 2020-04-22T14:03:27.177 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:03:27.177 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.177 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:03:27.177 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.177 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:03:27.178 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:03:27.178 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.178 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:03:27.178 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6812", 2020-04-22T14:03:27.178 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:03:27.179 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.179 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.179 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:03:27.179 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6813", 2020-04-22T14:03:27.179 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:03:27.179 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.179 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:03:27.179 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.180 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:03:27.180 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:03:27.180 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.180 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:03:27.180 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6816", 2020-04-22T14:03:27.180 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:03:27.180 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.181 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.181 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:03:27.181 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6817", 2020-04-22T14:03:27.181 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:03:27.181 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.181 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:03:27.181 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.182 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:03:27.182 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:03:27.182 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.182 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:03:27.182 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6814", 2020-04-22T14:03:27.182 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:03:27.182 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.182 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.183 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:03:27.183 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6815", 2020-04-22T14:03:27.183 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:03:27.183 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.183 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:03:27.183 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.183 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6811/33554", 2020-04-22T14:03:27.184 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6813/33554", 2020-04-22T14:03:27.184 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6817/33554", 2020-04-22T14:03:27.184 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6815/33554", 2020-04-22T14:03:27.184 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:03:27.184 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:03:27.184 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:03:27.184 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:03:27.185 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.185 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.185 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 6, 2020-04-22T14:03:27.185 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050", 2020-04-22T14:03:27.185 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:03:27.185 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:03:27.185 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:03:27.187 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:03:27.187 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:03:27.188 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:03:27.188 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:03:27.188 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 22, 2020-04-22T14:03:27.188 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:03:27.188 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:03:27.188 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:03:27.188 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:03:27.189 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.189 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:03:27.189 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6818", 2020-04-22T14:03:27.189 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:03:27.189 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.189 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.189 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:03:27.190 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6819", 2020-04-22T14:03:27.190 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:03:27.190 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.190 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:03:27.190 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.190 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:03:27.190 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:03:27.190 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.191 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:03:27.191 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6820", 2020-04-22T14:03:27.191 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:03:27.191 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.191 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.191 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:03:27.191 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6821", 2020-04-22T14:03:27.192 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:03:27.192 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.192 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:03:27.192 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.192 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:03:27.192 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:03:27.192 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.193 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:03:27.194 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6824", 2020-04-22T14:03:27.194 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:03:27.194 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.194 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.194 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:03:27.194 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6825", 2020-04-22T14:03:27.195 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:03:27.195 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.195 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:03:27.195 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.195 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:03:27.195 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:03:27.195 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.196 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:03:27.196 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6822", 2020-04-22T14:03:27.196 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:03:27.196 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.196 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.196 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:03:27.196 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6823", 2020-04-22T14:03:27.197 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:03:27.197 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.197 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:03:27.197 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.197 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6819/33601", 2020-04-22T14:03:27.198 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6821/33601", 2020-04-22T14:03:27.198 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6825/33601", 2020-04-22T14:03:27.198 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6823/33601", 2020-04-22T14:03:27.198 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:03:27.198 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:03:27.198 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:03:27.198 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:03:27.199 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.199 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.199 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 7, 2020-04-22T14:03:27.199 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "340eece1-4c39-47cd-b95f-9cfa5dcfe361", 2020-04-22T14:03:27.199 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:03:27.199 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:03:27.199 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:03:27.199 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:03:27.200 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:03:27.200 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:03:27.200 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:03:27.200 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 18, 2020-04-22T14:03:27.200 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:03:27.200 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:03:27.200 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:03:27.201 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:03:27.201 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.201 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:03:27.201 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6826", 2020-04-22T14:03:27.201 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:03:27.201 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.201 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.201 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:03:27.202 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6827", 2020-04-22T14:03:27.202 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:03:27.202 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.202 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:03:27.202 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.203 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:03:27.203 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:03:27.203 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.203 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:03:27.203 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6828", 2020-04-22T14:03:27.204 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:03:27.204 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.204 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.204 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:03:27.204 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6829", 2020-04-22T14:03:27.204 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:03:27.204 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.205 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:03:27.205 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.205 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:03:27.205 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:03:27.205 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.205 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:03:27.205 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6832", 2020-04-22T14:03:27.205 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:03:27.206 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.206 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.206 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:03:27.206 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6833", 2020-04-22T14:03:27.206 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:03:27.206 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.206 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:03:27.206 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.207 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:03:27.207 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:03:27.207 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.207 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:03:27.207 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6830", 2020-04-22T14:03:27.207 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:03:27.207 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.208 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.208 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:03:27.208 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6831", 2020-04-22T14:03:27.208 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:03:27.208 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.208 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:03:27.208 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.208 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6827/33629", 2020-04-22T14:03:27.209 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6829/33629", 2020-04-22T14:03:27.209 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6833/33629", 2020-04-22T14:03:27.209 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6831/33629", 2020-04-22T14:03:27.209 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:03:27.209 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:03:27.209 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:03:27.209 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:03:27.210 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.210 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:03:27.210 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_xinfo": [ 2020-04-22T14:03:27.210 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.210 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 0, 2020-04-22T14:03:27.210 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:03:27.210 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:03:27.211 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:03:27.211 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:03:27.211 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:03:27.211 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.384360+0000", 2020-04-22T14:03:27.211 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:03:27.211 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.215 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.215 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 1, 2020-04-22T14:03:27.215 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:03:27.215 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:03:27.215 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:03:27.216 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:03:27.216 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:03:27.216 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.503590+0000", 2020-04-22T14:03:27.216 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:03:27.216 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.216 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.216 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 2, 2020-04-22T14:03:27.217 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:03:27.217 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:03:27.217 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:03:27.217 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:03:27.217 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:03:27.217 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.525058+0000", 2020-04-22T14:03:27.218 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:03:27.218 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.218 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.218 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 3, 2020-04-22T14:03:27.218 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:03:27.218 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:03:27.218 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:03:27.219 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:03:27.219 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:03:27.219 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.599729+0000", 2020-04-22T14:03:27.219 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:03:27.219 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.219 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.219 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 4, 2020-04-22T14:03:27.219 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:03:27.220 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:03:27.220 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:03:27.220 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:03:27.220 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:03:27.220 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.600919+0000", 2020-04-22T14:03:27.221 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:03:27.221 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.222 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.222 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 5, 2020-04-22T14:03:27.222 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:03:27.222 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:03:27.222 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:03:27.222 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:03:27.223 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:03:27.223 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.654718+0000", 2020-04-22T14:03:27.223 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:03:27.223 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.223 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.223 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 6, 2020-04-22T14:03:27.223 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:03:27.224 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:03:27.224 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:03:27.224 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:03:27.224 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:03:27.224 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.718342+0000", 2020-04-22T14:03:27.224 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:03:27.224 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.225 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:27.225 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 7, 2020-04-22T14:03:27.225 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:03:27.225 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:03:27.225 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:03:27.225 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:03:27.225 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:03:27.226 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.839089+0000", 2020-04-22T14:03:27.226 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:03:27.226 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.226 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:03:27.226 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_upmap": [], 2020-04-22T14:03:27.227 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_upmap_items": [], 2020-04-22T14:03:27.227 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_temp": [], 2020-04-22T14:03:27.227 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_temp": [], 2020-04-22T14:03:27.227 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklist": {}, 2020-04-22T14:03:27.227 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profiles": { 2020-04-22T14:03:27.228 INFO:teuthology.orchestra.run.smithi103.stdout: "default": { 2020-04-22T14:03:27.228 INFO:teuthology.orchestra.run.smithi103.stdout: "crush-failure-domain": "osd", 2020-04-22T14:03:27.228 INFO:teuthology.orchestra.run.smithi103.stdout: "k": "2", 2020-04-22T14:03:27.228 INFO:teuthology.orchestra.run.smithi103.stdout: "m": "1", 2020-04-22T14:03:27.228 INFO:teuthology.orchestra.run.smithi103.stdout: "plugin": "jerasure", 2020-04-22T14:03:27.229 INFO:teuthology.orchestra.run.smithi103.stdout: "ruleset-failure-domain": "osd", 2020-04-22T14:03:27.229 INFO:teuthology.orchestra.run.smithi103.stdout: "technique": "reed_sol_van" 2020-04-22T14:03:27.231 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:27.231 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:27.231 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps_queue": [], 2020-04-22T14:03:27.231 INFO:teuthology.orchestra.run.smithi103.stdout: "new_removed_snaps": [], 2020-04-22T14:03:27.231 INFO:teuthology.orchestra.run.smithi103.stdout: "new_purged_snaps": [], 2020-04-22T14:03:27.232 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_node_flags": {}, 2020-04-22T14:03:27.233 INFO:teuthology.orchestra.run.smithi103.stdout: "device_class_flags": {} 2020-04-22T14:03:27.233 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:03:27.236 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:27.250 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:03:27.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.393+0000 7fd4704be700 1 Processor -- start 2020-04-22T14:03:27.397 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.393+0000 7fd4704be700 1 -- start start 2020-04-22T14:03:27.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.394+0000 7fd4704be700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd46812c0d0 0x7fd4681464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:27.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.394+0000 7fd4704be700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd468065fe0 0x7fd46805b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:27.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.394+0000 7fd4704be700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd468143300 con 0x7fd46805b8a0 2020-04-22T14:03:27.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.394+0000 7fd4704be700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd46812c4b0 con 0x7fd46812c0d0 2020-04-22T14:03:27.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.394+0000 7fd4704be700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4681435a0 con 0x7fd468065fe0 2020-04-22T14:03:27.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.394+0000 7fd46e25a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd46812c0d0 0x7fd4681464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:27.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.394+0000 7fd46e25a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd46812c0d0 0x7fd4681464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48304/0 (socket says 172.21.15.103:48304) 2020-04-22T14:03:27.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.394+0000 7fd46e25a700 1 -- 172.21.15.103:0/3650857762 learned_addr learned my addr 172.21.15.103:0/3650857762 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:27.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.394+0000 7fd46da59700 1 --2- 172.21.15.103:0/3650857762 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd468065fe0 0x7fd46805b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:27.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.394+0000 7fd46e25a700 1 -- 172.21.15.103:0/3650857762 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd468065fe0 msgr2=0x7fd46805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:27.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.394+0000 7fd46e25a700 1 --2- 172.21.15.103:0/3650857762 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd468065fe0 0x7fd46805b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:27.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.394+0000 7fd46e25a700 1 -- 172.21.15.103:0/3650857762 >> v1:172.21.15.86:6789/0 conn(0x7fd46805b8a0 legacy=0x7fd468062ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:27.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.394+0000 7fd46e25a700 1 -- 172.21.15.103:0/3650857762 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd468143840 con 0x7fd46812c0d0 2020-04-22T14:03:27.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.394+0000 7fd46e25a700 1 --2- 172.21.15.103:0/3650857762 >> v2:172.21.15.103:3300/0 conn(0x7fd46812c0d0 0x7fd4681464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd458002f30 tx=0x7fd458007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:27.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.394+0000 7fd46e25a700 1 --2- 172.21.15.103:0/3650857762 >> v2:172.21.15.103:3300/0 conn(0x7fd46812c0d0 0x7fd4681464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd458002f30 tx=0x7fd458007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:27.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.394+0000 7fd46e25a700 1 --2- 172.21.15.103:0/3650857762 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd46812c0d0 0x7fd4681464e0 secure :-1 s=READY pgs=314 cs=0 l=1 rx=0x7fd458002f30 tx=0x7fd458007a40).ready entity=mon.1 client_cookie=a33cfd35e5364698 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:27.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.395+0000 7fd46e25a700 1 --2- 172.21.15.103:0/3650857762 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd46812c0d0 0x7fd4681464e0 secure :-1 s=THROTTLE_DONE pgs=314 cs=0 l=1 rx=0x7fd458002f30 tx=0x7fd458007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:27.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.395+0000 7fd46d258700 1 -- 172.21.15.103:0/3650857762 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd458011670 con 0x7fd46812c0d0 2020-04-22T14:03:27.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.395+0000 7fd46e25a700 1 --2- 172.21.15.103:0/3650857762 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd46812c0d0 0x7fd4681464e0 secure :-1 s=THROTTLE_DONE pgs=314 cs=0 l=1 rx=0x7fd458002f30 tx=0x7fd458007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:27.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.395+0000 7fd46e25a700 1 --2- 172.21.15.103:0/3650857762 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd46812c0d0 0x7fd4681464e0 secure :-1 s=THROTTLE_DONE pgs=314 cs=0 l=1 rx=0x7fd458002f30 tx=0x7fd458007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:27.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.395+0000 7fd46d258700 1 -- 172.21.15.103:0/3650857762 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd458011810 con 0x7fd46812c0d0 2020-04-22T14:03:27.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.395+0000 7fd46d258700 1 -- 172.21.15.103:0/3650857762 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd458011c30 con 0x7fd46812c0d0 2020-04-22T14:03:27.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.395+0000 7fd4704be700 1 -- 172.21.15.103:0/3650857762 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd46812c0d0 msgr2=0x7fd4681464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:27.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.395+0000 7fd4704be700 1 --2- 172.21.15.103:0/3650857762 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd46812c0d0 0x7fd4681464e0 secure :-1 s=READY pgs=314 cs=0 l=1 rx=0x7fd458002f30 tx=0x7fd458007a40).stop 2020-04-22T14:03:27.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.395+0000 7fd4704be700 1 -- 172.21.15.103:0/3650857762 shutdown_connections 2020-04-22T14:03:27.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.395+0000 7fd4704be700 1 --2- 172.21.15.103:0/3650857762 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd46812c0d0 0x7fd4681464e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:27.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.395+0000 7fd4704be700 1 --2- 172.21.15.103:0/3650857762 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd468065fe0 0x7fd46805b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:27.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.395+0000 7fd4704be700 1 -- 172.21.15.103:0/3650857762 >> 172.21.15.103:0/3650857762 conn(0x7fd4680b9160 msgr2=0x7fd46805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:27.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.395+0000 7fd4704be700 1 -- 172.21.15.103:0/3650857762 shutdown_connections 2020-04-22T14:03:27.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.395+0000 7fd4704be700 1 -- 172.21.15.103:0/3650857762 wait complete. 2020-04-22T14:03:27.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.396+0000 7fd4704be700 1 Processor -- start 2020-04-22T14:03:27.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.396+0000 7fd4704be700 1 -- start start 2020-04-22T14:03:27.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.397+0000 7fd4704be700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd46805b8a0 0x7fd4680b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:27.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.397+0000 7fd4704be700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4680b5920 con 0x7fd46812c0d0 2020-04-22T14:03:27.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.397+0000 7fd4704be700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd468129350 con 0x7fd468065fe0 2020-04-22T14:03:27.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.397+0000 7fd4704be700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4680b8200 con 0x7fd46805b8a0 2020-04-22T14:03:27.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.397+0000 7fd46e25a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd46805b8a0 0x7fd4680b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:27.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.397+0000 7fd46e25a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd46805b8a0 0x7fd4680b54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48310/0 (socket says 172.21.15.103:48310) 2020-04-22T14:03:27.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.397+0000 7fd46da59700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd468065fe0 0x7fd4680b1d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40502/0 (socket says 172.21.15.103:40502) 2020-04-22T14:03:27.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.397+0000 7fd46e25a700 1 -- 172.21.15.103:0/371253761 learned_addr learned my addr 172.21.15.103:0/371253761 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:27.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.397+0000 7fd46e25a700 1 -- 172.21.15.103:0/371253761 >> v1:172.21.15.103:6789/0 conn(0x7fd468065fe0 legacy=0x7fd4680b1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:27.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.397+0000 7fd4577fe700 1 -- 172.21.15.103:0/371253761 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3013856372 0 0) 0x7fd464001ec0 con 0x7fd468065fe0 2020-04-22T14:03:27.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.397+0000 7fd46e25a700 1 -- 172.21.15.103:0/371253761 >> v1:172.21.15.86:6789/0 conn(0x7fd46812c0d0 legacy=0x7fd468142100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:27.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.397+0000 7fd46e25a700 1 -- 172.21.15.103:0/371253761 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd468129590 con 0x7fd46805b8a0 2020-04-22T14:03:27.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.397+0000 7fd46e25a700 1 --2- 172.21.15.103:0/371253761 >> v2:172.21.15.103:3300/0 conn(0x7fd46805b8a0 0x7fd4680b54c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd4680b11d0 tx=0x7fd458007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:27.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.397+0000 7fd46e25a700 1 --2- 172.21.15.103:0/371253761 >> v2:172.21.15.103:3300/0 conn(0x7fd46805b8a0 0x7fd4680b54c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd4680b11d0 tx=0x7fd458007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:27.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.397+0000 7fd46e25a700 1 --2- 172.21.15.103:0/371253761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd46805b8a0 0x7fd4680b54c0 secure :-1 s=READY pgs=316 cs=0 l=1 rx=0x7fd4680b11d0 tx=0x7fd458007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:27.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.397+0000 7fd46e25a700 1 --2- 172.21.15.103:0/371253761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd46805b8a0 0x7fd4680b54c0 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7fd4680b11d0 tx=0x7fd458007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:27.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.397+0000 7fd4577fe700 1 -- 172.21.15.103:0/371253761 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd458007360 con 0x7fd46805b8a0 2020-04-22T14:03:27.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.397+0000 7fd46e25a700 1 --2- 172.21.15.103:0/371253761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd46805b8a0 0x7fd4680b54c0 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7fd4680b11d0 tx=0x7fd458007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:27.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.397+0000 7fd4577fe700 1 -- 172.21.15.103:0/371253761 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4580074c0 con 0x7fd46805b8a0 2020-04-22T14:03:27.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.397+0000 7fd46e25a700 1 --2- 172.21.15.103:0/371253761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd46805b8a0 0x7fd4680b54c0 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7fd4680b11d0 tx=0x7fd458007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:27.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.397+0000 7fd4704be700 1 -- 172.21.15.103:0/371253761 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd468129830 con 0x7fd46805b8a0 2020-04-22T14:03:27.412 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.397+0000 7fd4577fe700 1 -- 172.21.15.103:0/371253761 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4580058b0 con 0x7fd46805b8a0 2020-04-22T14:03:27.412 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.397+0000 7fd4704be700 1 -- 172.21.15.103:0/371253761 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd468128b00 con 0x7fd46805b8a0 2020-04-22T14:03:27.412 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.398+0000 7fd46e25a700 1 --2- 172.21.15.103:0/371253761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd46805b8a0 0x7fd4680b54c0 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7fd4680b11d0 tx=0x7fd458007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:27.412 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.398+0000 7fd4577fe700 1 -- 172.21.15.103:0/371253761 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fd458005ae0 con 0x7fd46805b8a0 2020-04-22T14:03:27.412 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.398+0000 7fd46e25a700 1 --2- 172.21.15.103:0/371253761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd46805b8a0 0x7fd4680b54c0 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7fd4680b11d0 tx=0x7fd458007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:27.412 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.398+0000 7fd4704be700 1 -- 172.21.15.103:0/371253761 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd468056c90 con 0x7fd46805b8a0 2020-04-22T14:03:27.412 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.399+0000 7fd4577fe700 1 --2- 172.21.15.103:0/371253761 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd44804d880 0x7fd44804fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:27.413 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.399+0000 7fd4577fe700 1 -- 172.21.15.103:0/371253761 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd458061cd0 con 0x7fd46805b8a0 2020-04-22T14:03:27.413 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.399+0000 7fd46da59700 1 --2- 172.21.15.103:0/371253761 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd44804d880 0x7fd44804fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:27.413 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.399+0000 7fd46da59700 1 --2- 172.21.15.103:0/371253761 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd44804d880 0x7fd44804fd40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd464007920 tx=0x7fd464002950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:27.413 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.399+0000 7fd46da59700 1 --2- 172.21.15.103:0/371253761 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd44804d880 0x7fd44804fd40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd464007920 tx=0x7fd464002950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:27.413 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.399+0000 7fd46da59700 1 --2- 172.21.15.103:0/371253761 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd44804d880 0x7fd44804fd40 secure :-1 s=READY pgs=136 cs=0 l=1 rx=0x7fd464007920 tx=0x7fd464002950).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:27.413 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.403+0000 7fd46e25a700 1 --2- 172.21.15.103:0/371253761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd46805b8a0 0x7fd4680b54c0 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7fd4680b11d0 tx=0x7fd458007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:27.413 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.403+0000 7fd4577fe700 1 -- 172.21.15.103:0/371253761 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fd45803d110 con 0x7fd46805b8a0 2020-04-22T14:03:27.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.592+0000 7fd4704be700 1 -- 172.21.15.103:0/371253761 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd468147360 con 0x7fd46805b8a0 2020-04-22T14:03:27.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.593+0000 7fd46e25a700 1 --2- 172.21.15.103:0/371253761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd46805b8a0 0x7fd4680b54c0 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7fd4680b11d0 tx=0x7fd458007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:27.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.593+0000 7fd4577fe700 1 -- 172.21.15.103:0/371253761 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2137 (secure 0 0 0) 0x7fd458040730 con 0x7fd46805b8a0 2020-04-22T14:03:27.597 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:03:27.597 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/3739398122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3739398122},{"type":"v1","addr":"172.21.15.86:6835","nonce":3739398122}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":6}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:02:27.685979+0000","modified":"2020-04-22T14:02:32.276953+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4357},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4357":{"gid":4357,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.103:6833/1765986263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1765986263},{"type":"v1","addr":"172.21.15.103:6833","nonce":1765986263}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-22T14:03:27.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.594+0000 7fd4704be700 1 -- 172.21.15.103:0/371253761 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd44804d880 msgr2=0x7fd44804fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:27.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.594+0000 7fd4704be700 1 --2- 172.21.15.103:0/371253761 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd44804d880 0x7fd44804fd40 secure :-1 s=READY pgs=136 cs=0 l=1 rx=0x7fd464007920 tx=0x7fd464002950).stop 2020-04-22T14:03:27.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.594+0000 7fd4704be700 1 -- 172.21.15.103:0/371253761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd46805b8a0 msgr2=0x7fd4680b54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:27.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.594+0000 7fd4704be700 1 --2- 172.21.15.103:0/371253761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd46805b8a0 0x7fd4680b54c0 secure :-1 s=READY pgs=316 cs=0 l=1 rx=0x7fd4680b11d0 tx=0x7fd458007a40).stop 2020-04-22T14:03:27.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.594+0000 7fd4704be700 1 -- 172.21.15.103:0/371253761 shutdown_connections 2020-04-22T14:03:27.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.594+0000 7fd4704be700 1 --2- 172.21.15.103:0/371253761 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd44804d880 0x7fd44804fd40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:27.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.594+0000 7fd4704be700 1 --2- 172.21.15.103:0/371253761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd46805b8a0 0x7fd4680b54c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:27.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.594+0000 7fd4704be700 1 -- 172.21.15.103:0/371253761 >> 172.21.15.103:0/371253761 conn(0x7fd4680b9160 msgr2=0x7fd46812b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:27.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.594+0000 7fd4704be700 1 -- 172.21.15.103:0/371253761 shutdown_connections 2020-04-22T14:03:27.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.594+0000 7fd4704be700 1 -- 172.21.15.103:0/371253761 wait complete. 2020-04-22T14:03:27.600 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 6 2020-04-22T14:03:27.609 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:27.623 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2020-04-22T14:03:27.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.766+0000 7f4f09d33700 1 Processor -- start 2020-04-22T14:03:27.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.766+0000 7f4f09d33700 1 -- start start 2020-04-22T14:03:27.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.767+0000 7f4f09d33700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4f040b4320 0x7f4f040b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:27.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.767+0000 7f4f09d33700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4f040b2530 0x7f4f040b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:27.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.767+0000 7f4f09d33700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f040b0e90 con 0x7f4f040b4700 2020-04-22T14:03:27.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.767+0000 7f4f09d33700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f040b1130 con 0x7f4f040b4320 2020-04-22T14:03:27.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.767+0000 7f4f09d33700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f040ae500 con 0x7f4f040b2530 2020-04-22T14:03:27.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.767+0000 7f4f03fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4f040b2530 0x7f4f040b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:27.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.767+0000 7f4f02ffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f4f040b4700 0x7f4f040afa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40508/0 (socket says 172.21.15.103:40508) 2020-04-22T14:03:27.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.767+0000 7f4f02ffd700 1 -- 172.21.15.103:0/4131163455 learned_addr learned my addr 172.21.15.103:0/4131163455 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:27.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.767+0000 7f4f03fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4f040b2530 0x7f4f040b0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48318/0 (socket says 172.21.15.103:48318) 2020-04-22T14:03:27.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.767+0000 7f4f037fe700 1 --2- 172.21.15.103:0/4131163455 >> v2:172.21.15.86:3300/0 conn(0x7f4f040b4320 0x7f4f040b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:27.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.768+0000 7f4f03fff700 1 -- 172.21.15.103:0/4131163455 >> v2:172.21.15.86:3300/0 conn(0x7f4f040b4320 msgr2=0x7f4f040b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:27.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.768+0000 7f4f03fff700 1 --2- 172.21.15.103:0/4131163455 >> v2:172.21.15.86:3300/0 conn(0x7f4f040b4320 0x7f4f040b15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:27.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.768+0000 7f4f03fff700 1 -- 172.21.15.103:0/4131163455 >> v1:172.21.15.103:6789/0 conn(0x7f4f040b4700 legacy=0x7f4f040afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:27.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.768+0000 7f4f027fc700 1 -- 172.21.15.103:0/4131163455 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4060871236 0 0) 0x7f4f040b0e90 con 0x7f4f040b4700 2020-04-22T14:03:27.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.768+0000 7f4f03fff700 1 -- 172.21.15.103:0/4131163455 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f040b1a30 con 0x7f4f040b2530 2020-04-22T14:03:27.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.768+0000 7f4f03fff700 1 --2- 172.21.15.103:0/4131163455 >> v2:172.21.15.103:3300/0 conn(0x7f4f040b2530 0x7f4f040b0170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4efc002f30 tx=0x7f4efc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:27.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.768+0000 7f4f03fff700 1 --2- 172.21.15.103:0/4131163455 >> v2:172.21.15.103:3300/0 conn(0x7f4f040b2530 0x7f4f040b0170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4efc002f30 tx=0x7f4efc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:27.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.768+0000 7f4f03fff700 1 --2- 172.21.15.103:0/4131163455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f040b2530 0x7f4f040b0170 secure :-1 s=READY pgs=318 cs=0 l=1 rx=0x7f4efc002f30 tx=0x7f4efc007a40).ready entity=mon.1 client_cookie=25411c9d9677878a server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:27.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.768+0000 7f4f03fff700 1 --2- 172.21.15.103:0/4131163455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f040b2530 0x7f4f040b0170 secure :-1 s=THROTTLE_DONE pgs=318 cs=0 l=1 rx=0x7f4efc002f30 tx=0x7f4efc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:27.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.768+0000 7f4f027fc700 1 -- 172.21.15.103:0/4131163455 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4efc011470 con 0x7f4f040b2530 2020-04-22T14:03:27.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.768+0000 7f4f03fff700 1 --2- 172.21.15.103:0/4131163455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f040b2530 0x7f4f040b0170 secure :-1 s=THROTTLE_DONE pgs=318 cs=0 l=1 rx=0x7f4efc002f30 tx=0x7f4efc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:27.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.768+0000 7f4f027fc700 1 -- 172.21.15.103:0/4131163455 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4efc0115d0 con 0x7f4f040b2530 2020-04-22T14:03:27.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.768+0000 7f4f03fff700 1 --2- 172.21.15.103:0/4131163455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f040b2530 0x7f4f040b0170 secure :-1 s=THROTTLE_DONE pgs=318 cs=0 l=1 rx=0x7f4efc002f30 tx=0x7f4efc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:27.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.768+0000 7f4f027fc700 1 -- 172.21.15.103:0/4131163455 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4efc0119b0 con 0x7f4f040b2530 2020-04-22T14:03:27.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.768+0000 7f4f09d33700 1 -- 172.21.15.103:0/4131163455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f040b2530 msgr2=0x7f4f040b0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:27.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.768+0000 7f4f09d33700 1 --2- 172.21.15.103:0/4131163455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f040b2530 0x7f4f040b0170 secure :-1 s=READY pgs=318 cs=0 l=1 rx=0x7f4efc002f30 tx=0x7f4efc007a40).stop 2020-04-22T14:03:27.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.768+0000 7f4f09d33700 1 -- 172.21.15.103:0/4131163455 shutdown_connections 2020-04-22T14:03:27.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.768+0000 7f4f09d33700 1 --2- 172.21.15.103:0/4131163455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f040b2530 0x7f4f040b0170 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:27.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.768+0000 7f4f09d33700 1 --2- 172.21.15.103:0/4131163455 >> v2:172.21.15.86:3300/0 conn(0x7f4f040b4320 0x7f4f040b15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:27.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.768+0000 7f4f09d33700 1 -- 172.21.15.103:0/4131163455 >> 172.21.15.103:0/4131163455 conn(0x7f4f040b86b0 msgr2=0x7f4f040b8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:27.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.768+0000 7f4f09d33700 1 -- 172.21.15.103:0/4131163455 shutdown_connections 2020-04-22T14:03:27.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.768+0000 7f4f09d33700 1 -- 172.21.15.103:0/4131163455 wait complete. 2020-04-22T14:03:27.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.769+0000 7f4f09d33700 1 Processor -- start 2020-04-22T14:03:27.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.770+0000 7f4f09d33700 1 -- start start 2020-04-22T14:03:27.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.770+0000 7f4f09d33700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4f040b4320 0x7f4f040619f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:27.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.770+0000 7f4f09d33700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4f040b4700 0x7f4f040635f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:27.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.770+0000 7f4f09d33700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f04062020 con 0x7f4f040b2530 2020-04-22T14:03:27.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.770+0000 7f4f09d33700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f041501c0 con 0x7f4f040b4320 2020-04-22T14:03:27.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.770+0000 7f4f09d33700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f04153a00 con 0x7f4f040b4700 2020-04-22T14:03:27.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.770+0000 7f4f03fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4f040b4700 0x7f4f040635f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:27.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.770+0000 7f4f03fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4f040b4700 0x7f4f040635f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48326/0 (socket says 172.21.15.103:48326) 2020-04-22T14:03:27.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.770+0000 7f4f03fff700 1 -- 172.21.15.103:0/882141356 learned_addr learned my addr 172.21.15.103:0/882141356 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:27.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.771+0000 7f4f02ffd700 1 --2- 172.21.15.103:0/882141356 >> v2:172.21.15.86:3300/0 conn(0x7f4f040b4320 0x7f4f040619f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:27.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.771+0000 7f4f03fff700 1 -- 172.21.15.103:0/882141356 >> v2:172.21.15.86:3300/0 conn(0x7f4f040b4320 msgr2=0x7f4f040619f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:27.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.771+0000 7f4f03fff700 1 --2- 172.21.15.103:0/882141356 >> v2:172.21.15.86:3300/0 conn(0x7f4f040b4320 0x7f4f040619f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:27.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.771+0000 7f4f03fff700 1 -- 172.21.15.103:0/882141356 >> v1:172.21.15.86:6789/0 conn(0x7f4f040b2530 legacy=0x7f4f0413aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:27.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.771+0000 7f4f03fff700 1 -- 172.21.15.103:0/882141356 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0413b600 con 0x7f4f040b4700 2020-04-22T14:03:27.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.771+0000 7f4f03fff700 1 --2- 172.21.15.103:0/882141356 >> v2:172.21.15.103:3300/0 conn(0x7f4f040b4700 0x7f4f040635f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4f0413bad0 tx=0x7f4efc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:27.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.771+0000 7f4f03fff700 1 --2- 172.21.15.103:0/882141356 >> v2:172.21.15.103:3300/0 conn(0x7f4f040b4700 0x7f4f040635f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4f0413bad0 tx=0x7f4efc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:27.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.771+0000 7f4f03fff700 1 --2- 172.21.15.103:0/882141356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f040b4700 0x7f4f040635f0 secure :-1 s=READY pgs=319 cs=0 l=1 rx=0x7f4f0413bad0 tx=0x7f4efc007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:27.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.771+0000 7f4f03fff700 1 --2- 172.21.15.103:0/882141356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f040b4700 0x7f4f040635f0 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f4f0413bad0 tx=0x7f4efc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:27.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.771+0000 7f4f00ff9700 1 -- 172.21.15.103:0/882141356 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4efc007170 con 0x7f4f040b4700 2020-04-22T14:03:27.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.771+0000 7f4f03fff700 1 --2- 172.21.15.103:0/882141356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f040b4700 0x7f4f040635f0 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f4f0413bad0 tx=0x7f4efc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:27.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.771+0000 7f4f03fff700 1 --2- 172.21.15.103:0/882141356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f040b4700 0x7f4f040635f0 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f4f0413bad0 tx=0x7f4efc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:27.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.771+0000 7f4f00ff9700 1 -- 172.21.15.103:0/882141356 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4efc0072d0 con 0x7f4f040b4700 2020-04-22T14:03:27.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.771+0000 7f4f00ff9700 1 -- 172.21.15.103:0/882141356 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4efc0056c0 con 0x7f4f040b4700 2020-04-22T14:03:27.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.771+0000 7f4f09d33700 1 -- 172.21.15.103:0/882141356 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f04063a50 con 0x7f4f040b4700 2020-04-22T14:03:27.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.771+0000 7f4f09d33700 1 -- 172.21.15.103:0/882141356 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f041508f0 con 0x7f4f040b4700 2020-04-22T14:03:27.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.772+0000 7f4f03fff700 1 --2- 172.21.15.103:0/882141356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f040b4700 0x7f4f040635f0 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f4f0413bad0 tx=0x7f4efc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:27.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.772+0000 7f4f09d33700 1 -- 172.21.15.103:0/882141356 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f04062220 con 0x7f4f040b4700 2020-04-22T14:03:27.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.772+0000 7f4f00ff9700 1 -- 172.21.15.103:0/882141356 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f4efc005930 con 0x7f4f040b4700 2020-04-22T14:03:27.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.772+0000 7f4f03fff700 1 --2- 172.21.15.103:0/882141356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f040b4700 0x7f4f040635f0 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f4f0413bad0 tx=0x7f4efc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:27.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.772+0000 7f4f00ff9700 1 --2- 172.21.15.103:0/882141356 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4ee404d9a0 0x7f4ee404fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:27.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.772+0000 7f4f00ff9700 1 -- 172.21.15.103:0/882141356 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4efc061b50 con 0x7f4f040b4700 2020-04-22T14:03:27.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.772+0000 7f4f037fe700 1 --2- 172.21.15.103:0/882141356 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4ee404d9a0 0x7f4ee404fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:27.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.773+0000 7f4f037fe700 1 --2- 172.21.15.103:0/882141356 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4ee404d9a0 0x7f4ee404fe60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4ef40032b0 tx=0x7f4ef4009090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:27.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.773+0000 7f4f037fe700 1 --2- 172.21.15.103:0/882141356 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4ee404d9a0 0x7f4ee404fe60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4ef40032b0 tx=0x7f4ef4009090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:27.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.773+0000 7f4f037fe700 1 --2- 172.21.15.103:0/882141356 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4ee404d9a0 0x7f4ee404fe60 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7f4ef40032b0 tx=0x7f4ef4009090).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:27.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.776+0000 7f4f03fff700 1 --2- 172.21.15.103:0/882141356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f040b4700 0x7f4f040635f0 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f4f0413bad0 tx=0x7f4efc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:27.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.776+0000 7f4f00ff9700 1 -- 172.21.15.103:0/882141356 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f4efc03cf90 con 0x7f4f040b4700 2020-04-22T14:03:27.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:27.965+0000 7f4f09d33700 1 -- 172.21.15.103:0/882141356 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4f04061e50 con 0x7f4f040b4700 2020-04-22T14:03:28.478 INFO:tasks.ceph.mon.b.smithi086.stderr:2020-04-22T14:03:28.476+0000 7fbdbf880700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-04-22T14:03:28.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.481+0000 7f4f03fff700 1 --2- 172.21.15.103:0/882141356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f040b4700 0x7f4f040635f0 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f4f0413bad0 tx=0x7f4efc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:28.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.481+0000 7f4f00ff9700 1 -- 172.21.15.103:0/882141356 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4efc0405b0 con 0x7f4f040b4700 2020-04-22T14:03:28.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.483+0000 7f4f09d33700 1 -- 172.21.15.103:0/882141356 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4ee404d9a0 msgr2=0x7f4ee404fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:28.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.483+0000 7f4f09d33700 1 --2- 172.21.15.103:0/882141356 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4ee404d9a0 0x7f4ee404fe60 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7f4ef40032b0 tx=0x7f4ef4009090).stop 2020-04-22T14:03:28.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.483+0000 7f4f09d33700 1 -- 172.21.15.103:0/882141356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f040b4700 msgr2=0x7f4f040635f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:28.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.483+0000 7f4f09d33700 1 --2- 172.21.15.103:0/882141356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f040b4700 0x7f4f040635f0 secure :-1 s=READY pgs=319 cs=0 l=1 rx=0x7f4f0413bad0 tx=0x7f4efc007a40).stop 2020-04-22T14:03:28.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.483+0000 7f4f09d33700 1 -- 172.21.15.103:0/882141356 shutdown_connections 2020-04-22T14:03:28.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.483+0000 7f4f09d33700 1 --2- 172.21.15.103:0/882141356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f040b4700 0x7f4f040635f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:28.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.483+0000 7f4f09d33700 1 --2- 172.21.15.103:0/882141356 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4ee404d9a0 0x7f4ee404fe60 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:28.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.483+0000 7f4f09d33700 1 --2- 172.21.15.103:0/882141356 >> v2:172.21.15.86:3300/0 conn(0x7f4f040b4320 0x7f4f040619f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:28.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.483+0000 7f4f09d33700 1 -- 172.21.15.103:0/882141356 >> 172.21.15.103:0/882141356 conn(0x7f4f040b86b0 msgr2=0x7f4f0413c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:28.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.483+0000 7f4f09d33700 1 -- 172.21.15.103:0/882141356 shutdown_connections 2020-04-22T14:03:28.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.483+0000 7f4f09d33700 1 -- 172.21.15.103:0/882141356 wait complete. 2020-04-22T14:03:28.488 INFO:teuthology.orchestra.run.smithi103.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2020-04-22T14:03:28.497 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:28.505 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2020-04-22T14:03:28.518 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:03:28.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.662+0000 7f0f4fd32700 1 Processor -- start 2020-04-22T14:03:28.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.662+0000 7f0f4fd32700 1 -- start start 2020-04-22T14:03:28.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.663+0000 7f0f4fd32700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f48065fe0 0x7f0f481464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:28.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.663+0000 7f0f4fd32700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0f48063e30 0x7f0f480642a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:28.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.663+0000 7f0f4fd32700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f48143300 con 0x7f0f4812c0d0 2020-04-22T14:03:28.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.663+0000 7f0f4fd32700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f481435a0 con 0x7f0f48063e30 2020-04-22T14:03:28.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.663+0000 7f0f4fd32700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f48143840 con 0x7f0f48065fe0 2020-04-22T14:03:28.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.663+0000 7f0f4e2cf700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0f48063e30 0x7f0f480642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:28.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.663+0000 7f0f4e2cf700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0f48063e30 0x7f0f480642a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48346/0 (socket says 172.21.15.103:48346) 2020-04-22T14:03:28.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.663+0000 7f0f4dace700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f0f4812c0d0 0x7f0f4805b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40532/0 (socket says 172.21.15.103:40532) 2020-04-22T14:03:28.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.663+0000 7f0f4e2cf700 1 -- 172.21.15.103:0/284461845 learned_addr learned my addr 172.21.15.103:0/284461845 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:28.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.663+0000 7f0f4d2cd700 1 --2- 172.21.15.103:0/284461845 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f48065fe0 0x7f0f481464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:28.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.663+0000 7f0f4e2cf700 1 -- 172.21.15.103:0/284461845 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f48065fe0 msgr2=0x7f0f481464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:28.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.663+0000 7f0f4e2cf700 1 --2- 172.21.15.103:0/284461845 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f48065fe0 0x7f0f481464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:28.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.663+0000 7f0f4e2cf700 1 -- 172.21.15.103:0/284461845 >> v1:172.21.15.103:6789/0 conn(0x7f0f4812c0d0 legacy=0x7f0f4805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:28.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.663+0000 7f0f4e2cf700 1 -- 172.21.15.103:0/284461845 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f4805bb50 con 0x7f0f48063e30 2020-04-22T14:03:28.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.663+0000 7f0f4cacc700 1 -- 172.21.15.103:0/284461845 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 262079042 0 0) 0x7f0f48143300 con 0x7f0f4812c0d0 2020-04-22T14:03:28.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.663+0000 7f0f4e2cf700 1 --2- 172.21.15.103:0/284461845 >> v2:172.21.15.103:3300/0 conn(0x7f0f48063e30 0x7f0f480642a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0f400032b0 tx=0x7f0f40007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:28.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.664+0000 7f0f4e2cf700 1 --2- 172.21.15.103:0/284461845 >> v2:172.21.15.103:3300/0 conn(0x7f0f48063e30 0x7f0f480642a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0f400032b0 tx=0x7f0f40007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:28.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.664+0000 7f0f4e2cf700 1 --2- 172.21.15.103:0/284461845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f48063e30 0x7f0f480642a0 secure :-1 s=READY pgs=324 cs=0 l=1 rx=0x7f0f400032b0 tx=0x7f0f40007dc0).ready entity=mon.1 client_cookie=be5883d1510d1f7f server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:28.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.664+0000 7f0f4e2cf700 1 --2- 172.21.15.103:0/284461845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f48063e30 0x7f0f480642a0 secure :-1 s=THROTTLE_DONE pgs=324 cs=0 l=1 rx=0x7f0f400032b0 tx=0x7f0f40007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:28.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.664+0000 7f0f4cacc700 1 -- 172.21.15.103:0/284461845 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f4000a180 con 0x7f0f48063e30 2020-04-22T14:03:28.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.664+0000 7f0f4e2cf700 1 --2- 172.21.15.103:0/284461845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f48063e30 0x7f0f480642a0 secure :-1 s=THROTTLE_DONE pgs=324 cs=0 l=1 rx=0x7f0f400032b0 tx=0x7f0f40007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:28.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.664+0000 7f0f4e2cf700 1 --2- 172.21.15.103:0/284461845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f48063e30 0x7f0f480642a0 secure :-1 s=THROTTLE_DONE pgs=324 cs=0 l=1 rx=0x7f0f400032b0 tx=0x7f0f40007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:28.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.664+0000 7f0f4cacc700 1 -- 172.21.15.103:0/284461845 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4000a320 con 0x7f0f48063e30 2020-04-22T14:03:28.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.664+0000 7f0f4cacc700 1 -- 172.21.15.103:0/284461845 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f4000a700 con 0x7f0f48063e30 2020-04-22T14:03:28.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.664+0000 7f0f4fd32700 1 -- 172.21.15.103:0/284461845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f48063e30 msgr2=0x7f0f480642a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:28.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.664+0000 7f0f4fd32700 1 --2- 172.21.15.103:0/284461845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f48063e30 0x7f0f480642a0 secure :-1 s=READY pgs=324 cs=0 l=1 rx=0x7f0f400032b0 tx=0x7f0f40007dc0).stop 2020-04-22T14:03:28.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.664+0000 7f0f4fd32700 1 -- 172.21.15.103:0/284461845 shutdown_connections 2020-04-22T14:03:28.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.664+0000 7f0f4fd32700 1 --2- 172.21.15.103:0/284461845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f48063e30 0x7f0f480642a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:28.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.664+0000 7f0f4fd32700 1 --2- 172.21.15.103:0/284461845 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f48065fe0 0x7f0f481464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:28.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.664+0000 7f0f4fd32700 1 -- 172.21.15.103:0/284461845 >> 172.21.15.103:0/284461845 conn(0x7f0f480b9160 msgr2=0x7f0f4805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:28.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.664+0000 7f0f4fd32700 1 -- 172.21.15.103:0/284461845 shutdown_connections 2020-04-22T14:03:28.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.664+0000 7f0f4fd32700 1 -- 172.21.15.103:0/284461845 wait complete. 2020-04-22T14:03:28.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.665+0000 7f0f4fd32700 1 Processor -- start 2020-04-22T14:03:28.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.665+0000 7f0f4fd32700 1 -- start start 2020-04-22T14:03:28.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.666+0000 7f0f4fd32700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0f48065fe0 0x7f0f480b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:28.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.666+0000 7f0f4fd32700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0f4812c0d0 0x7f0f480b5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:28.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.666+0000 7f0f4fd32700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f48151c60 con 0x7f0f48063e30 2020-04-22T14:03:28.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.666+0000 7f0f4fd32700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f480b37a0 con 0x7f0f48065fe0 2020-04-22T14:03:28.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.666+0000 7f0f4fd32700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f48154f20 con 0x7f0f4812c0d0 2020-04-22T14:03:28.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.666+0000 7f0f4dace700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f0f48063e30 0x7f0f480b3090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40538/0 (socket says 172.21.15.103:40538) 2020-04-22T14:03:28.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.666+0000 7f0f4dace700 1 -- 172.21.15.103:0/569924974 learned_addr learned my addr 172.21.15.103:0/569924974 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:28.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.666+0000 7f0f4e2cf700 1 --2- 172.21.15.103:0/569924974 >> v2:172.21.15.103:3300/0 conn(0x7f0f4812c0d0 0x7f0f480b5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:28.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.666+0000 7f0f36ffd700 1 -- 172.21.15.103:0/569924974 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1209828182 0 0) 0x7f0f48151c60 con 0x7f0f48063e30 2020-04-22T14:03:28.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.666+0000 7f0f36ffd700 1 -- 172.21.15.103:0/569924974 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f28002fe0 con 0x7f0f48063e30 2020-04-22T14:03:28.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.666+0000 7f0f4d2cd700 1 --2- 172.21.15.103:0/569924974 >> v2:172.21.15.86:3300/0 conn(0x7f0f48065fe0 0x7f0f480b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:28.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.666+0000 7f0f4e2cf700 1 -- 172.21.15.103:0/569924974 >> v2:172.21.15.86:3300/0 conn(0x7f0f48065fe0 msgr2=0x7f0f480b54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:28.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.666+0000 7f0f4e2cf700 1 --2- 172.21.15.103:0/569924974 >> v2:172.21.15.86:3300/0 conn(0x7f0f48065fe0 0x7f0f480b54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:28.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.666+0000 7f0f4e2cf700 1 -- 172.21.15.103:0/569924974 >> v1:172.21.15.103:6789/0 conn(0x7f0f48063e30 legacy=0x7f0f480b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:28.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.666+0000 7f0f4e2cf700 1 -- 172.21.15.103:0/569924974 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f48151990 con 0x7f0f4812c0d0 2020-04-22T14:03:28.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.666+0000 7f0f4e2cf700 1 --2- 172.21.15.103:0/569924974 >> v2:172.21.15.103:3300/0 conn(0x7f0f4812c0d0 0x7f0f480b5920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0f400032b0 tx=0x7f0f40007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:28.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.666+0000 7f0f4e2cf700 1 --2- 172.21.15.103:0/569924974 >> v2:172.21.15.103:3300/0 conn(0x7f0f4812c0d0 0x7f0f480b5920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0f400032b0 tx=0x7f0f40007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:28.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.666+0000 7f0f4e2cf700 1 --2- 172.21.15.103:0/569924974 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f4812c0d0 0x7f0f480b5920 secure :-1 s=READY pgs=326 cs=0 l=1 rx=0x7f0f400032b0 tx=0x7f0f40007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:28.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.667+0000 7f0f4e2cf700 1 --2- 172.21.15.103:0/569924974 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f4812c0d0 0x7f0f480b5920 secure :-1 s=THROTTLE_DONE pgs=326 cs=0 l=1 rx=0x7f0f400032b0 tx=0x7f0f40007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:28.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.667+0000 7f0f36ffd700 1 -- 172.21.15.103:0/569924974 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f4000a7a0 con 0x7f0f4812c0d0 2020-04-22T14:03:28.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.667+0000 7f0f4e2cf700 1 --2- 172.21.15.103:0/569924974 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f4812c0d0 0x7f0f480b5920 secure :-1 s=THROTTLE_DONE pgs=326 cs=0 l=1 rx=0x7f0f400032b0 tx=0x7f0f40007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:28.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.667+0000 7f0f4e2cf700 1 --2- 172.21.15.103:0/569924974 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f4812c0d0 0x7f0f480b5920 secure :-1 s=THROTTLE_DONE pgs=326 cs=0 l=1 rx=0x7f0f400032b0 tx=0x7f0f40007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:28.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.667+0000 7f0f36ffd700 1 -- 172.21.15.103:0/569924974 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f400114d0 con 0x7f0f4812c0d0 2020-04-22T14:03:28.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.667+0000 7f0f4fd32700 1 -- 172.21.15.103:0/569924974 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f480b0450 con 0x7f0f4812c0d0 2020-04-22T14:03:28.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.667+0000 7f0f36ffd700 1 -- 172.21.15.103:0/569924974 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f400116c0 con 0x7f0f4812c0d0 2020-04-22T14:03:28.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.667+0000 7f0f4fd32700 1 -- 172.21.15.103:0/569924974 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f480b4520 con 0x7f0f4812c0d0 2020-04-22T14:03:28.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.667+0000 7f0f4e2cf700 1 --2- 172.21.15.103:0/569924974 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f4812c0d0 0x7f0f480b5920 secure :-1 s=THROTTLE_DONE pgs=326 cs=0 l=1 rx=0x7f0f400032b0 tx=0x7f0f40007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:28.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.668+0000 7f0f36ffd700 1 -- 172.21.15.103:0/569924974 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f0f40005c30 con 0x7f0f4812c0d0 2020-04-22T14:03:28.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.668+0000 7f0f4e2cf700 1 --2- 172.21.15.103:0/569924974 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f4812c0d0 0x7f0f480b5920 secure :-1 s=THROTTLE_DONE pgs=326 cs=0 l=1 rx=0x7f0f400032b0 tx=0x7f0f40007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:28.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.668+0000 7f0f4fd32700 1 -- 172.21.15.103:0/569924974 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f48155120 con 0x7f0f4812c0d0 2020-04-22T14:03:28.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.668+0000 7f0f36ffd700 1 --2- 172.21.15.103:0/569924974 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0f2804dd00 0x7f0f280501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:28.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.668+0000 7f0f36ffd700 1 -- 172.21.15.103:0/569924974 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f0f40061d40 con 0x7f0f4812c0d0 2020-04-22T14:03:28.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.668+0000 7f0f4dace700 1 --2- 172.21.15.103:0/569924974 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0f2804dd00 0x7f0f280501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:28.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.669+0000 7f0f4dace700 1 --2- 172.21.15.103:0/569924974 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0f2804dd00 0x7f0f280501c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0f38000ff0 tx=0x7f0f38001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:28.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.669+0000 7f0f4dace700 1 --2- 172.21.15.103:0/569924974 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0f2804dd00 0x7f0f280501c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0f38000ff0 tx=0x7f0f38001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:28.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.669+0000 7f0f4dace700 1 --2- 172.21.15.103:0/569924974 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0f2804dd00 0x7f0f280501c0 secure :-1 s=READY pgs=138 cs=0 l=1 rx=0x7f0f38000ff0 tx=0x7f0f38001780).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:28.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.672+0000 7f0f4e2cf700 1 --2- 172.21.15.103:0/569924974 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f4812c0d0 0x7f0f480b5920 secure :-1 s=THROTTLE_DONE pgs=326 cs=0 l=1 rx=0x7f0f400032b0 tx=0x7f0f40007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:28.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.672+0000 7f0f36ffd700 1 -- 172.21.15.103:0/569924974 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f0f48155120 con 0x7f0f4812c0d0 2020-04-22T14:03:28.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.863+0000 7f0f4fd32700 1 -- 172.21.15.103:0/569924974 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0f48155120 con 0x7f0f4812c0d0 2020-04-22T14:03:28.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.863+0000 7f0f4e2cf700 1 --2- 172.21.15.103:0/569924974 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f4812c0d0 0x7f0f480b5920 secure :-1 s=THROTTLE_DONE pgs=326 cs=0 l=1 rx=0x7f0f400032b0 tx=0x7f0f40007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:28.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.863+0000 7f0f36ffd700 1 -- 172.21.15.103:0/569924974 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+1774 (secure 0 0 0) 0x7f0f48155120 con 0x7f0f4812c0d0 2020-04-22T14:03:28.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.865+0000 7f0f4fd32700 1 -- 172.21.15.103:0/569924974 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0f2804dd00 msgr2=0x7f0f280501c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:28.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.865+0000 7f0f4fd32700 1 --2- 172.21.15.103:0/569924974 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0f2804dd00 0x7f0f280501c0 secure :-1 s=READY pgs=138 cs=0 l=1 rx=0x7f0f38000ff0 tx=0x7f0f38001780).stop 2020-04-22T14:03:28.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.865+0000 7f0f4fd32700 1 -- 172.21.15.103:0/569924974 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f4812c0d0 msgr2=0x7f0f480b5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:28.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.865+0000 7f0f4fd32700 1 --2- 172.21.15.103:0/569924974 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f4812c0d0 0x7f0f480b5920 secure :-1 s=READY pgs=326 cs=0 l=1 rx=0x7f0f400032b0 tx=0x7f0f40007dc0).stop 2020-04-22T14:03:28.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.865+0000 7f0f4fd32700 1 -- 172.21.15.103:0/569924974 shutdown_connections 2020-04-22T14:03:28.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.865+0000 7f0f4fd32700 1 --2- 172.21.15.103:0/569924974 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f4812c0d0 0x7f0f480b5920 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:28.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.865+0000 7f0f4fd32700 1 --2- 172.21.15.103:0/569924974 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0f2804dd00 0x7f0f280501c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:28.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.865+0000 7f0f4fd32700 1 --2- 172.21.15.103:0/569924974 >> v2:172.21.15.86:3300/0 conn(0x7f0f48065fe0 0x7f0f480b54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:28.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.865+0000 7f0f4fd32700 1 -- 172.21.15.103:0/569924974 >> 172.21.15.103:0/569924974 conn(0x7f0f480b9160 msgr2=0x7f0f4812b110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:28.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.865+0000 7f0f4fd32700 1 -- 172.21.15.103:0/569924974 shutdown_connections 2020-04-22T14:03:28.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:28.865+0000 7f0f4fd32700 1 -- 172.21.15.103:0/569924974 wait complete. 2020-04-22T14:03:28.870 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:03:28.871 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/3739398122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3739398122},{"type":"v1","addr":"172.21.15.86:6835","nonce":3739398122}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":6}],"filesystems":[{"mdsmap":{"epoch":7,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:02:27.685979+0000","modified":"2020-04-22T14:03:28.477012+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-22T14:03:28.871 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 7 2020-04-22T14:03:28.878 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:28.894 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-04-22T14:03:29.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.039+0000 7f4c53090700 1 Processor -- start 2020-04-22T14:03:29.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.039+0000 7f4c53090700 1 -- start start 2020-04-22T14:03:29.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.040+0000 7f4c53090700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4c4c0b9140 0x7f4c4c12b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:29.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.040+0000 7f4c53090700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4c4c12b670 0x7f4c4c143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:29.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.040+0000 7f4c53090700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c4c1467e0 con 0x7f4c4c0ac950 2020-04-22T14:03:29.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.040+0000 7f4c53090700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c4c0602f0 con 0x7f4c4c0b9140 2020-04-22T14:03:29.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.040+0000 7f4c53090700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4c060050 con 0x7f4c4c12b670 2020-04-22T14:03:29.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.040+0000 7f4c50e2c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4c4c0b9140 0x7f4c4c12b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:29.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.040+0000 7f4c4bfff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f4c4c0ac950 0x7f4c4c146c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40546/0 (socket says 172.21.15.103:40546) 2020-04-22T14:03:29.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.040+0000 7f4c4bfff700 1 -- 172.21.15.103:0/3265788392 learned_addr learned my addr 172.21.15.103:0/3265788392 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:29.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.040+0000 7f4c5162d700 1 --2- 172.21.15.103:0/3265788392 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4c4c12b670 0x7f4c4c143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:29.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.040+0000 7f4c50e2c700 1 -- 172.21.15.103:0/3265788392 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4c4c12b670 msgr2=0x7f4c4c143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:29.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.040+0000 7f4c50e2c700 1 --2- 172.21.15.103:0/3265788392 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4c4c12b670 0x7f4c4c143090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:29.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.040+0000 7f4c50e2c700 1 -- 172.21.15.103:0/3265788392 >> v1:172.21.15.103:6789/0 conn(0x7f4c4c0ac950 legacy=0x7f4c4c146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:29.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.040+0000 7f4c4b7fe700 1 -- 172.21.15.103:0/3265788392 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 689966324 0 0) 0x7f4c4c1467e0 con 0x7f4c4c0ac950 2020-04-22T14:03:29.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.040+0000 7f4c50e2c700 1 -- 172.21.15.103:0/3265788392 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c4c0b9520 con 0x7f4c4c0b9140 2020-04-22T14:03:29.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.040+0000 7f4c50e2c700 1 --2- 172.21.15.103:0/3265788392 >> v2:172.21.15.103:3300/0 conn(0x7f4c4c0b9140 0x7f4c4c12b210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4c3c002f30 tx=0x7f4c3c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:29.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.040+0000 7f4c50e2c700 1 --2- 172.21.15.103:0/3265788392 >> v2:172.21.15.103:3300/0 conn(0x7f4c4c0b9140 0x7f4c4c12b210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4c3c002f30 tx=0x7f4c3c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:29.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.040+0000 7f4c50e2c700 1 --2- 172.21.15.103:0/3265788392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c4c0b9140 0x7f4c4c12b210 secure :-1 s=READY pgs=328 cs=0 l=1 rx=0x7f4c3c002f30 tx=0x7f4c3c007a40).ready entity=mon.1 client_cookie=2d153f2c6778b9e8 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:29.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.041+0000 7f4c50e2c700 1 --2- 172.21.15.103:0/3265788392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c4c0b9140 0x7f4c4c12b210 secure :-1 s=THROTTLE_DONE pgs=328 cs=0 l=1 rx=0x7f4c3c002f30 tx=0x7f4c3c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:29.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.041+0000 7f4c4b7fe700 1 -- 172.21.15.103:0/3265788392 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c3c011470 con 0x7f4c4c0b9140 2020-04-22T14:03:29.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.041+0000 7f4c50e2c700 1 --2- 172.21.15.103:0/3265788392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c4c0b9140 0x7f4c4c12b210 secure :-1 s=THROTTLE_DONE pgs=328 cs=0 l=1 rx=0x7f4c3c002f30 tx=0x7f4c3c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:29.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.041+0000 7f4c50e2c700 1 --2- 172.21.15.103:0/3265788392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c4c0b9140 0x7f4c4c12b210 secure :-1 s=THROTTLE_DONE pgs=328 cs=0 l=1 rx=0x7f4c3c002f30 tx=0x7f4c3c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:29.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.041+0000 7f4c4b7fe700 1 -- 172.21.15.103:0/3265788392 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3c011610 con 0x7f4c4c0b9140 2020-04-22T14:03:29.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.041+0000 7f4c4b7fe700 1 -- 172.21.15.103:0/3265788392 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c3c0119f0 con 0x7f4c4c0b9140 2020-04-22T14:03:29.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.041+0000 7f4c53090700 1 -- 172.21.15.103:0/3265788392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c4c0b9140 msgr2=0x7f4c4c12b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:29.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.041+0000 7f4c53090700 1 --2- 172.21.15.103:0/3265788392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c4c0b9140 0x7f4c4c12b210 secure :-1 s=READY pgs=328 cs=0 l=1 rx=0x7f4c3c002f30 tx=0x7f4c3c007a40).stop 2020-04-22T14:03:29.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.041+0000 7f4c53090700 1 -- 172.21.15.103:0/3265788392 shutdown_connections 2020-04-22T14:03:29.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.041+0000 7f4c53090700 1 --2- 172.21.15.103:0/3265788392 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4c4c12b670 0x7f4c4c143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:29.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.041+0000 7f4c53090700 1 --2- 172.21.15.103:0/3265788392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c4c0b9140 0x7f4c4c12b210 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:29.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.041+0000 7f4c53090700 1 -- 172.21.15.103:0/3265788392 >> 172.21.15.103:0/3265788392 conn(0x7f4c4c05b7b0 msgr2=0x7f4c4c0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:29.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.041+0000 7f4c53090700 1 -- 172.21.15.103:0/3265788392 shutdown_connections 2020-04-22T14:03:29.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.041+0000 7f4c53090700 1 -- 172.21.15.103:0/3265788392 wait complete. 2020-04-22T14:03:29.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.042+0000 7f4c53090700 1 Processor -- start 2020-04-22T14:03:29.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.042+0000 7f4c53090700 1 -- start start 2020-04-22T14:03:29.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.043+0000 7f4c53090700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4c4c0ac950 0x7f4c4c0637a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:29.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.043+0000 7f4c53090700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4c4c12b670 0x7f4c4c062a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:29.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.043+0000 7f4c53090700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c4c065c00 con 0x7f4c4c0b9140 2020-04-22T14:03:29.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.043+0000 7f4c53090700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c4c0634d0 con 0x7f4c4c0ac950 2020-04-22T14:03:29.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.043+0000 7f4c53090700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4c065ea0 con 0x7f4c4c12b670 2020-04-22T14:03:29.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.043+0000 7f4c50e2c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4c4c0ac950 0x7f4c4c0637a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:29.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.043+0000 7f4c50e2c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4c4c0ac950 0x7f4c4c0637a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48364/0 (socket says 172.21.15.103:48364) 2020-04-22T14:03:29.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.043+0000 7f4c50e2c700 1 -- 172.21.15.103:0/3964901056 learned_addr learned my addr 172.21.15.103:0/3964901056 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:29.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.043+0000 7f4c5162d700 1 --2- 172.21.15.103:0/3964901056 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4c4c12b670 0x7f4c4c062a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:29.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.043+0000 7f4c50e2c700 1 -- 172.21.15.103:0/3964901056 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4c4c12b670 msgr2=0x7f4c4c062a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:29.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.043+0000 7f4c50e2c700 1 --2- 172.21.15.103:0/3964901056 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4c4c12b670 0x7f4c4c062a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:29.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.043+0000 7f4c50e2c700 1 -- 172.21.15.103:0/3964901056 >> v1:172.21.15.86:6789/0 conn(0x7f4c4c0b9140 legacy=0x7f4c4c127e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:29.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.043+0000 7f4c50e2c700 1 -- 172.21.15.103:0/3964901056 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c4c066140 con 0x7f4c4c0ac950 2020-04-22T14:03:29.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.043+0000 7f4c50e2c700 1 --2- 172.21.15.103:0/3964901056 >> v2:172.21.15.103:3300/0 conn(0x7f4c4c0ac950 0x7f4c4c0637a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4c3c002f30 tx=0x7f4c3c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:29.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.043+0000 7f4c50e2c700 1 --2- 172.21.15.103:0/3964901056 >> v2:172.21.15.103:3300/0 conn(0x7f4c4c0ac950 0x7f4c4c0637a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4c3c002f30 tx=0x7f4c3c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:29.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.043+0000 7f4c50e2c700 1 --2- 172.21.15.103:0/3964901056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c4c0ac950 0x7f4c4c0637a0 secure :-1 s=READY pgs=329 cs=0 l=1 rx=0x7f4c3c002f30 tx=0x7f4c3c007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:29.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.044+0000 7f4c50e2c700 1 --2- 172.21.15.103:0/3964901056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c4c0ac950 0x7f4c4c0637a0 secure :-1 s=THROTTLE_DONE pgs=329 cs=0 l=1 rx=0x7f4c3c002f30 tx=0x7f4c3c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:29.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.044+0000 7f4c49ffb700 1 -- 172.21.15.103:0/3964901056 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c3c007170 con 0x7f4c4c0ac950 2020-04-22T14:03:29.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.044+0000 7f4c50e2c700 1 --2- 172.21.15.103:0/3964901056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c4c0ac950 0x7f4c4c0637a0 secure :-1 s=THROTTLE_DONE pgs=329 cs=0 l=1 rx=0x7f4c3c002f30 tx=0x7f4c3c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:29.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.044+0000 7f4c50e2c700 1 --2- 172.21.15.103:0/3964901056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c4c0ac950 0x7f4c4c0637a0 secure :-1 s=THROTTLE_DONE pgs=329 cs=0 l=1 rx=0x7f4c3c002f30 tx=0x7f4c3c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:29.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.044+0000 7f4c49ffb700 1 -- 172.21.15.103:0/3964901056 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3c0072d0 con 0x7f4c4c0ac950 2020-04-22T14:03:29.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.044+0000 7f4c49ffb700 1 -- 172.21.15.103:0/3964901056 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c3c007670 con 0x7f4c4c0ac950 2020-04-22T14:03:29.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.044+0000 7f4c53090700 1 -- 172.21.15.103:0/3964901056 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c4c128520 con 0x7f4c4c0ac950 2020-04-22T14:03:29.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.044+0000 7f4c53090700 1 -- 172.21.15.103:0/3964901056 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c4c0b1800 con 0x7f4c4c0ac950 2020-04-22T14:03:29.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.044+0000 7f4c50e2c700 1 --2- 172.21.15.103:0/3964901056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c4c0ac950 0x7f4c4c0637a0 secure :-1 s=THROTTLE_DONE pgs=329 cs=0 l=1 rx=0x7f4c3c002f30 tx=0x7f4c3c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:29.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.045+0000 7f4c53090700 1 -- 172.21.15.103:0/3964901056 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c4c065a40 con 0x7f4c4c0ac950 2020-04-22T14:03:29.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.045+0000 7f4c49ffb700 1 -- 172.21.15.103:0/3964901056 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f4c3c0056c0 con 0x7f4c4c0ac950 2020-04-22T14:03:29.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.045+0000 7f4c50e2c700 1 --2- 172.21.15.103:0/3964901056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c4c0ac950 0x7f4c4c0637a0 secure :-1 s=THROTTLE_DONE pgs=329 cs=0 l=1 rx=0x7f4c3c002f30 tx=0x7f4c3c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:29.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.045+0000 7f4c49ffb700 1 --2- 172.21.15.103:0/3964901056 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4c2c04d940 0x7f4c2c04fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:29.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.045+0000 7f4c49ffb700 1 -- 172.21.15.103:0/3964901056 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f4c3c061bd0 con 0x7f4c4c0ac950 2020-04-22T14:03:29.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.045+0000 7f4c4bfff700 1 --2- 172.21.15.103:0/3964901056 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4c2c04d940 0x7f4c2c04fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:29.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.045+0000 7f4c4bfff700 1 --2- 172.21.15.103:0/3964901056 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4c2c04d940 0x7f4c2c04fe00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4c4c062780 tx=0x7f4c400014f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:29.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.045+0000 7f4c4bfff700 1 --2- 172.21.15.103:0/3964901056 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4c2c04d940 0x7f4c2c04fe00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4c4c062780 tx=0x7f4c400014f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:29.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.045+0000 7f4c4bfff700 1 --2- 172.21.15.103:0/3964901056 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4c2c04d940 0x7f4c2c04fe00 secure :-1 s=READY pgs=139 cs=0 l=1 rx=0x7f4c4c062780 tx=0x7f4c400014f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:29.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.049+0000 7f4c50e2c700 1 --2- 172.21.15.103:0/3964901056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c4c0ac950 0x7f4c4c0637a0 secure :-1 s=THROTTLE_DONE pgs=329 cs=0 l=1 rx=0x7f4c3c002f30 tx=0x7f4c3c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:29.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.049+0000 7f4c49ffb700 1 -- 172.21.15.103:0/3964901056 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f4c3c03d010 con 0x7f4c4c0ac950 2020-04-22T14:03:29.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.239+0000 7f4c53090700 1 -- 172.21.15.103:0/3964901056 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4c4c056c90 con 0x7f4c4c0ac950 2020-04-22T14:03:29.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.485+0000 7f4c50e2c700 1 --2- 172.21.15.103:0/3964901056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c4c0ac950 0x7f4c4c0637a0 secure :-1 s=THROTTLE_DONE pgs=329 cs=0 l=1 rx=0x7f4c3c002f30 tx=0x7f4c3c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:29.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.485+0000 7f4c49ffb700 1 -- 172.21.15.103:0/3964901056 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4c3c040630 con 0x7f4c4c0ac950 2020-04-22T14:03:29.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.486+0000 7f4c53090700 1 -- 172.21.15.103:0/3964901056 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4c2c04d940 msgr2=0x7f4c2c04fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:29.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.486+0000 7f4c53090700 1 --2- 172.21.15.103:0/3964901056 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4c2c04d940 0x7f4c2c04fe00 secure :-1 s=READY pgs=139 cs=0 l=1 rx=0x7f4c4c062780 tx=0x7f4c400014f0).stop 2020-04-22T14:03:29.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.486+0000 7f4c53090700 1 -- 172.21.15.103:0/3964901056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c4c0ac950 msgr2=0x7f4c4c0637a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:29.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.486+0000 7f4c53090700 1 --2- 172.21.15.103:0/3964901056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c4c0ac950 0x7f4c4c0637a0 secure :-1 s=READY pgs=329 cs=0 l=1 rx=0x7f4c3c002f30 tx=0x7f4c3c007a40).stop 2020-04-22T14:03:29.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.486+0000 7f4c53090700 1 -- 172.21.15.103:0/3964901056 shutdown_connections 2020-04-22T14:03:29.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.486+0000 7f4c53090700 1 --2- 172.21.15.103:0/3964901056 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4c2c04d940 0x7f4c2c04fe00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:29.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.486+0000 7f4c53090700 1 --2- 172.21.15.103:0/3964901056 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4c4c12b670 0x7f4c4c062a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:29.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.486+0000 7f4c53090700 1 --2- 172.21.15.103:0/3964901056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c4c0ac950 0x7f4c4c0637a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:29.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.486+0000 7f4c53090700 1 -- 172.21.15.103:0/3964901056 >> 172.21.15.103:0/3964901056 conn(0x7f4c4c05b7b0 msgr2=0x7f4c4c129fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:29.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.487+0000 7f4c53090700 1 -- 172.21.15.103:0/3964901056 shutdown_connections 2020-04-22T14:03:29.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.487+0000 7f4c53090700 1 -- 172.21.15.103:0/3964901056 wait complete. 2020-04-22T14:03:29.500 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:29.513 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-04-22T14:03:29.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.660+0000 7f0f96b9b700 1 Processor -- start 2020-04-22T14:03:29.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.660+0000 7f0f96b9b700 1 -- start start 2020-04-22T14:03:29.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.661+0000 7f0f96b9b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f90143090 0x7f0f90143540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:29.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.661+0000 7f0f96b9b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f901467e0 con 0x7f0f900ac950 2020-04-22T14:03:29.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.661+0000 7f0f96b9b700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f90060050 con 0x7f0f900b9140 2020-04-22T14:03:29.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.661+0000 7f0f96b9b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f901439a0 con 0x7f0f90143090 2020-04-22T14:03:29.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.661+0000 7f0f94937700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f0f900b9140 0x7f0f9012b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40562/0 (socket says 172.21.15.103:40562) 2020-04-22T14:03:29.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.661+0000 7f0f94937700 1 -- 172.21.15.103:0/4096762018 learned_addr learned my addr 172.21.15.103:0/4096762018 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:29.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.661+0000 7f0f95138700 1 --2- 172.21.15.103:0/4096762018 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f90143090 0x7f0f90143540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:29.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.661+0000 7f0f8f7fe700 1 -- 172.21.15.103:0/4096762018 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3396914963 0 0) 0x7f0f90060050 con 0x7f0f900b9140 2020-04-22T14:03:29.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.661+0000 7f0f8f7fe700 1 -- 172.21.15.103:0/4096762018 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f7c003230 con 0x7f0f900b9140 2020-04-22T14:03:29.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.662+0000 7f0f8f7fe700 1 -- 172.21.15.103:0/4096762018 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 157454514 0 0) 0x7f0f901467e0 con 0x7f0f900ac950 2020-04-22T14:03:29.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.662+0000 7f0f8f7fe700 1 -- 172.21.15.103:0/4096762018 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f90060050 con 0x7f0f900ac950 2020-04-22T14:03:29.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.662+0000 7f0f8f7fe700 1 -- 172.21.15.103:0/4096762018 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 569654277 0 0) 0x7f0f7c003230 con 0x7f0f900b9140 2020-04-22T14:03:29.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.662+0000 7f0f95138700 1 -- 172.21.15.103:0/4096762018 >> v1:172.21.15.103:6789/0 conn(0x7f0f900b9140 legacy=0x7f0f9012b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:29.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.662+0000 7f0f95138700 1 -- 172.21.15.103:0/4096762018 >> v1:172.21.15.86:6789/0 conn(0x7f0f900ac950 legacy=0x7f0f90146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:29.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.662+0000 7f0f95138700 1 -- 172.21.15.103:0/4096762018 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f900b9520 con 0x7f0f90143090 2020-04-22T14:03:29.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.662+0000 7f0f95138700 1 --2- 172.21.15.103:0/4096762018 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f90143090 0x7f0f90143540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0f80001110 tx=0x7f0f88008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:29.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.662+0000 7f0f95138700 1 --2- 172.21.15.103:0/4096762018 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f90143090 0x7f0f90143540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0f80001110 tx=0x7f0f88008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:29.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.662+0000 7f0f95138700 1 --2- 172.21.15.103:0/4096762018 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f90143090 0x7f0f90143540 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f0f80001110 tx=0x7f0f88008c60).ready entity=mon.2 client_cookie=39e202f762de198 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:29.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.662+0000 7f0f95138700 1 --2- 172.21.15.103:0/4096762018 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f90143090 0x7f0f90143540 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f0f80001110 tx=0x7f0f88008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:29.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.662+0000 7f0f8f7fe700 1 -- 172.21.15.103:0/4096762018 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f80001710 con 0x7f0f90143090 2020-04-22T14:03:29.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.662+0000 7f0f95138700 1 --2- 172.21.15.103:0/4096762018 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f90143090 0x7f0f90143540 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f0f80001110 tx=0x7f0f88008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:29.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.662+0000 7f0f95138700 1 --2- 172.21.15.103:0/4096762018 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f90143090 0x7f0f90143540 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f0f80001110 tx=0x7f0f88008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:29.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.662+0000 7f0f8f7fe700 1 -- 172.21.15.103:0/4096762018 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f88011a80 con 0x7f0f90143090 2020-04-22T14:03:29.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.662+0000 7f0f8f7fe700 1 -- 172.21.15.103:0/4096762018 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f88011de0 con 0x7f0f90143090 2020-04-22T14:03:29.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.662+0000 7f0f96b9b700 1 -- 172.21.15.103:0/4096762018 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f90143090 msgr2=0x7f0f90143540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:29.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.662+0000 7f0f96b9b700 1 --2- 172.21.15.103:0/4096762018 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f90143090 0x7f0f90143540 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f0f80001110 tx=0x7f0f88008c60).stop 2020-04-22T14:03:29.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.662+0000 7f0f96b9b700 1 -- 172.21.15.103:0/4096762018 shutdown_connections 2020-04-22T14:03:29.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.662+0000 7f0f96b9b700 1 --2- 172.21.15.103:0/4096762018 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f90143090 0x7f0f90143540 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:29.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.662+0000 7f0f96b9b700 1 -- 172.21.15.103:0/4096762018 >> 172.21.15.103:0/4096762018 conn(0x7f0f9005b7b0 msgr2=0x7f0f900b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:29.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.662+0000 7f0f96b9b700 1 -- 172.21.15.103:0/4096762018 shutdown_connections 2020-04-22T14:03:29.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.662+0000 7f0f96b9b700 1 -- 172.21.15.103:0/4096762018 wait complete. 2020-04-22T14:03:29.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.663+0000 7f0f96b9b700 1 Processor -- start 2020-04-22T14:03:29.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.663+0000 7f0f96b9b700 1 -- start start 2020-04-22T14:03:29.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.664+0000 7f0f96b9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0f900ac950 0x7f0f90127c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:29.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.664+0000 7f0f96b9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0f900b9140 0x7f0f90144df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:29.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.664+0000 7f0f96b9b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f90063800 con 0x7f0f90143090 2020-04-22T14:03:29.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.664+0000 7f0f96b9b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f900af890 con 0x7f0f900ac950 2020-04-22T14:03:29.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.664+0000 7f0f96b9b700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f900afb30 con 0x7f0f900b9140 2020-04-22T14:03:29.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.664+0000 7f0f8ffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0f900b9140 0x7f0f90144df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:29.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.664+0000 7f0f8ffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0f900b9140 0x7f0f90144df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48380/0 (socket says 172.21.15.103:48380) 2020-04-22T14:03:29.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.664+0000 7f0f8ffff700 1 -- 172.21.15.103:0/2648243938 learned_addr learned my addr 172.21.15.103:0/2648243938 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:29.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.664+0000 7f0f94937700 1 --2- 172.21.15.103:0/2648243938 >> v2:172.21.15.86:3300/0 conn(0x7f0f900ac950 0x7f0f90127c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:29.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.665+0000 7f0f8ffff700 1 -- 172.21.15.103:0/2648243938 >> v2:172.21.15.86:3300/0 conn(0x7f0f900ac950 msgr2=0x7f0f90127c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:29.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.665+0000 7f0f8ffff700 1 --2- 172.21.15.103:0/2648243938 >> v2:172.21.15.86:3300/0 conn(0x7f0f900ac950 0x7f0f90127c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:29.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.665+0000 7f0f8ffff700 1 -- 172.21.15.103:0/2648243938 >> v1:172.21.15.86:6789/0 conn(0x7f0f90143090 legacy=0x7f0f900affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:29.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.665+0000 7f0f8ffff700 1 -- 172.21.15.103:0/2648243938 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f90063440 con 0x7f0f900b9140 2020-04-22T14:03:29.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.665+0000 7f0f8ffff700 1 --2- 172.21.15.103:0/2648243938 >> v2:172.21.15.103:3300/0 conn(0x7f0f900b9140 0x7f0f90144df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0f84001090 tx=0x7f0f8400c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:29.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.665+0000 7f0f8ffff700 1 --2- 172.21.15.103:0/2648243938 >> v2:172.21.15.103:3300/0 conn(0x7f0f900b9140 0x7f0f90144df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0f84001090 tx=0x7f0f8400c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:29.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.665+0000 7f0f8ffff700 1 --2- 172.21.15.103:0/2648243938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f900b9140 0x7f0f90144df0 secure :-1 s=READY pgs=331 cs=0 l=1 rx=0x7f0f84001090 tx=0x7f0f8400c460).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:29.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.665+0000 7f0f8ffff700 1 --2- 172.21.15.103:0/2648243938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f900b9140 0x7f0f90144df0 secure :-1 s=THROTTLE_DONE pgs=331 cs=0 l=1 rx=0x7f0f84001090 tx=0x7f0f8400c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:29.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.665+0000 7f0f8dffb700 1 -- 172.21.15.103:0/2648243938 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f8400cc20 con 0x7f0f900b9140 2020-04-22T14:03:29.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.665+0000 7f0f8ffff700 1 --2- 172.21.15.103:0/2648243938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f900b9140 0x7f0f90144df0 secure :-1 s=THROTTLE_DONE pgs=331 cs=0 l=1 rx=0x7f0f84001090 tx=0x7f0f8400c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:29.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.665+0000 7f0f8ffff700 1 --2- 172.21.15.103:0/2648243938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f900b9140 0x7f0f90144df0 secure :-1 s=THROTTLE_DONE pgs=331 cs=0 l=1 rx=0x7f0f84001090 tx=0x7f0f8400c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:29.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.665+0000 7f0f8dffb700 1 -- 172.21.15.103:0/2648243938 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8400cd80 con 0x7f0f900b9140 2020-04-22T14:03:29.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.665+0000 7f0f96b9b700 1 -- 172.21.15.103:0/2648243938 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f900b06e0 con 0x7f0f900b9140 2020-04-22T14:03:29.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.665+0000 7f0f8dffb700 1 -- 172.21.15.103:0/2648243938 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f8400e370 con 0x7f0f900b9140 2020-04-22T14:03:29.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.665+0000 7f0f96b9b700 1 -- 172.21.15.103:0/2648243938 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f900662f0 con 0x7f0f900b9140 2020-04-22T14:03:29.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.666+0000 7f0f8ffff700 1 --2- 172.21.15.103:0/2648243938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f900b9140 0x7f0f90144df0 secure :-1 s=THROTTLE_DONE pgs=331 cs=0 l=1 rx=0x7f0f84001090 tx=0x7f0f8400c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:29.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.666+0000 7f0f96b9b700 1 -- 172.21.15.103:0/2648243938 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f90056c90 con 0x7f0f900b9140 2020-04-22T14:03:29.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.666+0000 7f0f8dffb700 1 -- 172.21.15.103:0/2648243938 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f0f8400e5b0 con 0x7f0f900b9140 2020-04-22T14:03:29.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.666+0000 7f0f8ffff700 1 --2- 172.21.15.103:0/2648243938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f900b9140 0x7f0f90144df0 secure :-1 s=THROTTLE_DONE pgs=331 cs=0 l=1 rx=0x7f0f84001090 tx=0x7f0f8400c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:29.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.666+0000 7f0f8dffb700 1 --2- 172.21.15.103:0/2648243938 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0f7004d900 0x7f0f7004fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:29.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.666+0000 7f0f8dffb700 1 -- 172.21.15.103:0/2648243938 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f0f84061190 con 0x7f0f900b9140 2020-04-22T14:03:29.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.666+0000 7f0f94937700 1 --2- 172.21.15.103:0/2648243938 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0f7004d900 0x7f0f7004fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:29.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.667+0000 7f0f94937700 1 --2- 172.21.15.103:0/2648243938 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0f7004d900 0x7f0f7004fdc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0f80000fa0 tx=0x7f0f8000cb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:29.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.667+0000 7f0f94937700 1 --2- 172.21.15.103:0/2648243938 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0f7004d900 0x7f0f7004fdc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0f80000fa0 tx=0x7f0f8000cb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:29.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.667+0000 7f0f94937700 1 --2- 172.21.15.103:0/2648243938 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0f7004d900 0x7f0f7004fdc0 secure :-1 s=READY pgs=141 cs=0 l=1 rx=0x7f0f80000fa0 tx=0x7f0f8000cb00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:29.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.670+0000 7f0f8ffff700 1 --2- 172.21.15.103:0/2648243938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f900b9140 0x7f0f90144df0 secure :-1 s=THROTTLE_DONE pgs=331 cs=0 l=1 rx=0x7f0f84001090 tx=0x7f0f8400c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:29.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.670+0000 7f0f8dffb700 1 -- 172.21.15.103:0/2648243938 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f0f8403c570 con 0x7f0f900b9140 2020-04-22T14:03:29.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:29.813+0000 7f0f96b9b700 1 -- 172.21.15.103:0/2648243938 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0f90128aa0 con 0x7f0f900b9140 2020-04-22T14:03:30.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.491+0000 7f0f8ffff700 1 --2- 172.21.15.103:0/2648243938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f900b9140 0x7f0f90144df0 secure :-1 s=THROTTLE_DONE pgs=331 cs=0 l=1 rx=0x7f0f84001090 tx=0x7f0f8400c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:30.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.491+0000 7f0f8dffb700 1 -- 172.21.15.103:0/2648243938 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v26) v1 ==== 185+0+0 (secure 0 0 0) 0x7f0f8403fb90 con 0x7f0f900b9140 2020-04-22T14:03:30.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.494+0000 7f0f96b9b700 1 -- 172.21.15.103:0/2648243938 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0f7004d900 msgr2=0x7f0f7004fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:30.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.494+0000 7f0f96b9b700 1 --2- 172.21.15.103:0/2648243938 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0f7004d900 0x7f0f7004fdc0 secure :-1 s=READY pgs=141 cs=0 l=1 rx=0x7f0f80000fa0 tx=0x7f0f8000cb00).stop 2020-04-22T14:03:30.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.494+0000 7f0f96b9b700 1 -- 172.21.15.103:0/2648243938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f900b9140 msgr2=0x7f0f90144df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:30.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.494+0000 7f0f96b9b700 1 --2- 172.21.15.103:0/2648243938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f900b9140 0x7f0f90144df0 secure :-1 s=READY pgs=331 cs=0 l=1 rx=0x7f0f84001090 tx=0x7f0f8400c460).stop 2020-04-22T14:03:30.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.494+0000 7f0f96b9b700 1 -- 172.21.15.103:0/2648243938 shutdown_connections 2020-04-22T14:03:30.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.494+0000 7f0f96b9b700 1 --2- 172.21.15.103:0/2648243938 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0f7004d900 0x7f0f7004fdc0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:30.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.494+0000 7f0f96b9b700 1 --2- 172.21.15.103:0/2648243938 >> v2:172.21.15.86:3300/0 conn(0x7f0f900ac950 0x7f0f90127c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:30.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.494+0000 7f0f96b9b700 1 --2- 172.21.15.103:0/2648243938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f900b9140 0x7f0f90144df0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:30.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.494+0000 7f0f96b9b700 1 -- 172.21.15.103:0/2648243938 >> 172.21.15.103:0/2648243938 conn(0x7f0f9005b7b0 msgr2=0x7f0f9012a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:30.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.494+0000 7f0f96b9b700 1 -- 172.21.15.103:0/2648243938 shutdown_connections 2020-04-22T14:03:30.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.494+0000 7f0f96b9b700 1 -- 172.21.15.103:0/2648243938 wait complete. 2020-04-22T14:03:30.499 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' removed 2020-04-22T14:03:30.516 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:30.531 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2020-04-22T14:03:30.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.686+0000 7fe4859b0700 1 Processor -- start 2020-04-22T14:03:30.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.686+0000 7fe4859b0700 1 -- start start 2020-04-22T14:03:30.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.687+0000 7fe4859b0700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe4800acb10 0x7fe480142630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:30.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.687+0000 7fe4859b0700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4800af030 con 0x7fe4800b4820 2020-04-22T14:03:30.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.687+0000 7fe4859b0700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe480060250 con 0x7fe480061a30 2020-04-22T14:03:30.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.687+0000 7fe4859b0700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4800623c0 con 0x7fe4800acb10 2020-04-22T14:03:30.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.687+0000 7fe47effd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe480061a30 0x7fe4800ae920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40576/0 (socket says 172.21.15.103:40576) 2020-04-22T14:03:30.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.687+0000 7fe47effd700 1 -- 172.21.15.103:0/2882359590 learned_addr learned my addr 172.21.15.103:0/2882359590 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:30.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.687+0000 7fe47f7fe700 1 --2- 172.21.15.103:0/2882359590 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe4800acb10 0x7fe480142630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:30.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.687+0000 7fe47e7fc700 1 -- 172.21.15.103:0/2882359590 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2249582772 0 0) 0x7fe480060250 con 0x7fe480061a30 2020-04-22T14:03:30.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.687+0000 7fe47e7fc700 1 -- 172.21.15.103:0/2882359590 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe460003230 con 0x7fe480061a30 2020-04-22T14:03:30.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.687+0000 7fe47e7fc700 1 -- 172.21.15.103:0/2882359590 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 806707997 0 0) 0x7fe460003230 con 0x7fe480061a30 2020-04-22T14:03:30.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.687+0000 7fe47e7fc700 1 -- 172.21.15.103:0/2882359590 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe4800acb10 msgr2=0x7fe480142630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:30.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.687+0000 7fe47e7fc700 1 --2- 172.21.15.103:0/2882359590 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe4800acb10 0x7fe480142630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:30.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.687+0000 7fe47e7fc700 1 -- 172.21.15.103:0/2882359590 >> v1:172.21.15.86:6789/0 conn(0x7fe4800b4820 legacy=0x7fe480141f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:30.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.687+0000 7fe47e7fc700 1 -- 172.21.15.103:0/2882359590 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe480062660 con 0x7fe480061a30 2020-04-22T14:03:30.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.687+0000 7fe47e7fc700 1 -- 172.21.15.103:0/2882359590 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fe4700016d0 con 0x7fe480061a30 2020-04-22T14:03:30.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.687+0000 7fe47e7fc700 1 -- 172.21.15.103:0/2882359590 >> v1:172.21.15.103:6789/0 conn(0x7fe480061a30 legacy=0x7fe4800ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:30.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.687+0000 7fe47e7fc700 1 --2- 172.21.15.103:0/2882359590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe460003720 0x7fe460003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:30.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.687+0000 7fe47e7fc700 1 --2- 172.21.15.103:0/2882359590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe460003fd0 0x7fe4600044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:30.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.687+0000 7fe47e7fc700 1 --2- 172.21.15.103:0/2882359590 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe4800acb10 0x7fe460004a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:30.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.688+0000 7fe47e7fc700 1 -- 172.21.15.103:0/2882359590 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4800623c0 con 0x7fe460003fd0 2020-04-22T14:03:30.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.688+0000 7fe47e7fc700 1 -- 172.21.15.103:0/2882359590 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe460004f20 con 0x7fe460003720 2020-04-22T14:03:30.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.688+0000 7fe47e7fc700 1 -- 172.21.15.103:0/2882359590 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4600050e0 con 0x7fe4800acb10 2020-04-22T14:03:30.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.688+0000 7fe47effd700 1 --2- 172.21.15.103:0/2882359590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe460003720 0x7fe460003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:30.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.688+0000 7fe47f7fe700 1 --2- 172.21.15.103:0/2882359590 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe4800acb10 0x7fe460004a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:30.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.688+0000 7fe477fff700 1 --2- 172.21.15.103:0/2882359590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe460003fd0 0x7fe4600044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:30.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.688+0000 7fe47effd700 1 -- 172.21.15.103:0/2882359590 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe4800acb10 msgr2=0x7fe460004a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:30.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.688+0000 7fe47effd700 1 --2- 172.21.15.103:0/2882359590 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe4800acb10 0x7fe460004a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:30.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.688+0000 7fe47effd700 1 -- 172.21.15.103:0/2882359590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe460003fd0 msgr2=0x7fe4600044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:30.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.688+0000 7fe47effd700 1 --2- 172.21.15.103:0/2882359590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe460003fd0 0x7fe4600044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:30.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.688+0000 7fe47effd700 1 -- 172.21.15.103:0/2882359590 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe460003230 con 0x7fe460003720 2020-04-22T14:03:30.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.688+0000 7fe47effd700 1 --2- 172.21.15.103:0/2882359590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe460003720 0x7fe460003b00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe4700013e0 tx=0x7fe480066ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:30.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.688+0000 7fe47effd700 1 --2- 172.21.15.103:0/2882359590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe460003720 0x7fe460003b00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe4700013e0 tx=0x7fe480066ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:30.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.688+0000 7fe47effd700 1 --2- 172.21.15.103:0/2882359590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe460003720 0x7fe460003b00 secure :-1 s=READY pgs=333 cs=0 l=1 rx=0x7fe4700013e0 tx=0x7fe480066ea0).ready entity=mon.1 client_cookie=45067ac0c4b14a8b server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:30.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.688+0000 7fe47effd700 1 --2- 172.21.15.103:0/2882359590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe460003720 0x7fe460003b00 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7fe4700013e0 tx=0x7fe480066ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:30.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.688+0000 7fe47e7fc700 1 -- 172.21.15.103:0/2882359590 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe47000e180 con 0x7fe460003720 2020-04-22T14:03:30.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.688+0000 7fe47effd700 1 --2- 172.21.15.103:0/2882359590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe460003720 0x7fe460003b00 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7fe4700013e0 tx=0x7fe480066ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:30.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.688+0000 7fe47e7fc700 1 -- 172.21.15.103:0/2882359590 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47000e2e0 con 0x7fe460003720 2020-04-22T14:03:30.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.688+0000 7fe47effd700 1 --2- 172.21.15.103:0/2882359590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe460003720 0x7fe460003b00 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7fe4700013e0 tx=0x7fe480066ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:30.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.688+0000 7fe4859b0700 1 -- 172.21.15.103:0/2882359590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe460003720 msgr2=0x7fe460003b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:30.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.688+0000 7fe47e7fc700 1 -- 172.21.15.103:0/2882359590 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4700100c0 con 0x7fe460003720 2020-04-22T14:03:30.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.688+0000 7fe4859b0700 1 --2- 172.21.15.103:0/2882359590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe460003720 0x7fe460003b00 secure :-1 s=READY pgs=333 cs=0 l=1 rx=0x7fe4700013e0 tx=0x7fe480066ea0).stop 2020-04-22T14:03:30.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.688+0000 7fe47f7fe700 1 -- 172.21.15.103:0/2882359590 reap_dead start 2020-04-22T14:03:30.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.689+0000 7fe4859b0700 1 -- 172.21.15.103:0/2882359590 shutdown_connections 2020-04-22T14:03:30.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.689+0000 7fe4859b0700 1 -- 172.21.15.103:0/2882359590 >> 172.21.15.103:0/2882359590 conn(0x7fe48005b7b0 msgr2=0x7fe4800b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:30.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.689+0000 7fe4859b0700 1 -- 172.21.15.103:0/2882359590 shutdown_connections 2020-04-22T14:03:30.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.689+0000 7fe4859b0700 1 -- 172.21.15.103:0/2882359590 wait complete. 2020-04-22T14:03:30.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.690+0000 7fe4859b0700 1 Processor -- start 2020-04-22T14:03:30.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.690+0000 7fe4859b0700 1 -- start start 2020-04-22T14:03:30.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.690+0000 7fe4859b0700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe480062da0 0x7fe4801441b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:30.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.690+0000 7fe4859b0700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe480063180 0x7fe480153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:30.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.690+0000 7fe4859b0700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe4801538f0 0x7fe4800658d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:30.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.690+0000 7fe4859b0700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe480154140 con 0x7fe480062da0 2020-04-22T14:03:30.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.690+0000 7fe4859b0700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4801543e0 con 0x7fe4801538f0 2020-04-22T14:03:30.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.690+0000 7fe4859b0700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe480144800 con 0x7fe480063180 2020-04-22T14:03:30.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.690+0000 7fe47f7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe4801538f0 0x7fe4800658d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:30.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.690+0000 7fe47f7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe4801538f0 0x7fe4800658d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48402/0 (socket says 172.21.15.103:48402) 2020-04-22T14:03:30.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.690+0000 7fe47f7fe700 1 -- 172.21.15.103:0/322685060 learned_addr learned my addr 172.21.15.103:0/322685060 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:30.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.690+0000 7fe477fff700 1 --2- 172.21.15.103:0/322685060 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe480063180 0x7fe480153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:30.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.690+0000 7fe47effd700 1 --2- 172.21.15.103:0/322685060 >> v2:172.21.15.86:3300/0 conn(0x7fe480062da0 0x7fe4801441b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:30.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.691+0000 7fe47f7fe700 1 -- 172.21.15.103:0/322685060 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe480063180 msgr2=0x7fe480153490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:30.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.691+0000 7fe47f7fe700 1 --2- 172.21.15.103:0/322685060 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe480063180 0x7fe480153490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:30.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.691+0000 7fe47f7fe700 1 -- 172.21.15.103:0/322685060 >> v2:172.21.15.86:3300/0 conn(0x7fe480062da0 msgr2=0x7fe4801441b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:30.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.691+0000 7fe47f7fe700 1 --2- 172.21.15.103:0/322685060 >> v2:172.21.15.86:3300/0 conn(0x7fe480062da0 0x7fe4801441b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:30.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.691+0000 7fe47f7fe700 1 -- 172.21.15.103:0/322685060 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4800635e0 con 0x7fe4801538f0 2020-04-22T14:03:30.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.691+0000 7fe47f7fe700 1 --2- 172.21.15.103:0/322685060 >> v2:172.21.15.103:3300/0 conn(0x7fe4801538f0 0x7fe4800658d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe4700010d0 tx=0x7fe478010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:30.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.691+0000 7fe47f7fe700 1 --2- 172.21.15.103:0/322685060 >> v2:172.21.15.103:3300/0 conn(0x7fe4801538f0 0x7fe4800658d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe4700010d0 tx=0x7fe478010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:30.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.691+0000 7fe47f7fe700 1 --2- 172.21.15.103:0/322685060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4801538f0 0x7fe4800658d0 secure :-1 s=READY pgs=334 cs=0 l=1 rx=0x7fe4700010d0 tx=0x7fe478010da0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:30.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.691+0000 7fe47f7fe700 1 --2- 172.21.15.103:0/322685060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4801538f0 0x7fe4800658d0 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7fe4700010d0 tx=0x7fe478010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:30.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.691+0000 7fe47f7fe700 1 --2- 172.21.15.103:0/322685060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4801538f0 0x7fe4800658d0 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7fe4700010d0 tx=0x7fe478010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:30.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.691+0000 7fe47cff9700 1 -- 172.21.15.103:0/322685060 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe478005e20 con 0x7fe4801538f0 2020-04-22T14:03:30.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.691+0000 7fe47f7fe700 1 --2- 172.21.15.103:0/322685060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4801538f0 0x7fe4800658d0 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7fe4700010d0 tx=0x7fe478010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:30.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.691+0000 7fe47cff9700 1 -- 172.21.15.103:0/322685060 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe478008750 con 0x7fe4801538f0 2020-04-22T14:03:30.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.691+0000 7fe4859b0700 1 -- 172.21.15.103:0/322685060 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe480144ca0 con 0x7fe4801538f0 2020-04-22T14:03:30.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.691+0000 7fe47cff9700 1 -- 172.21.15.103:0/322685060 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe478008b30 con 0x7fe4801538f0 2020-04-22T14:03:30.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.691+0000 7fe4859b0700 1 -- 172.21.15.103:0/322685060 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe480065d30 con 0x7fe4801538f0 2020-04-22T14:03:30.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.692+0000 7fe47f7fe700 1 --2- 172.21.15.103:0/322685060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4801538f0 0x7fe4800658d0 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7fe4700010d0 tx=0x7fe478010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:30.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.692+0000 7fe4859b0700 1 -- 172.21.15.103:0/322685060 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe480153f80 con 0x7fe4801538f0 2020-04-22T14:03:30.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.692+0000 7fe47cff9700 1 -- 172.21.15.103:0/322685060 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fe4780120d0 con 0x7fe4801538f0 2020-04-22T14:03:30.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.692+0000 7fe47f7fe700 1 --2- 172.21.15.103:0/322685060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4801538f0 0x7fe4800658d0 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7fe4700010d0 tx=0x7fe478010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:30.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.692+0000 7fe47cff9700 1 --2- 172.21.15.103:0/322685060 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe46404d8e0 0x7fe46404fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:30.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.693+0000 7fe47cff9700 1 -- 172.21.15.103:0/322685060 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5721+0+0 (secure 0 0 0) 0x7fe478060f70 con 0x7fe4801538f0 2020-04-22T14:03:30.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.693+0000 7fe47effd700 1 --2- 172.21.15.103:0/322685060 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe46404d8e0 0x7fe46404fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:30.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.693+0000 7fe47effd700 1 --2- 172.21.15.103:0/322685060 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe46404d8e0 0x7fe46404fda0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe4700013e0 tx=0x7fe480066ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:30.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.693+0000 7fe47effd700 1 --2- 172.21.15.103:0/322685060 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe46404d8e0 0x7fe46404fda0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe4700013e0 tx=0x7fe480066ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:30.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.693+0000 7fe47effd700 1 --2- 172.21.15.103:0/322685060 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe46404d8e0 0x7fe46404fda0 secure :-1 s=READY pgs=142 cs=0 l=1 rx=0x7fe4700013e0 tx=0x7fe480066ea0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:30.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.697+0000 7fe47f7fe700 1 --2- 172.21.15.103:0/322685060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4801538f0 0x7fe4800658d0 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7fe4700010d0 tx=0x7fe478010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:30.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.697+0000 7fe47cff9700 1 -- 172.21.15.103:0/322685060 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fe47803c3b0 con 0x7fe4801538f0 2020-04-22T14:03:30.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:30.838+0000 7fe4859b0700 1 -- 172.21.15.103:0/322685060 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe480056c90 con 0x7fe4801538f0 2020-04-22T14:03:31.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.496+0000 7fe47f7fe700 1 --2- 172.21.15.103:0/322685060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4801538f0 0x7fe4800658d0 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7fe4700010d0 tx=0x7fe478010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:31.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.496+0000 7fe47cff9700 1 -- 172.21.15.103:0/322685060 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v27) v1 ==== 173+0+0 (secure 0 0 0) 0x7fe47803f9d0 con 0x7fe4801538f0 2020-04-22T14:03:31.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.498+0000 7fe4859b0700 1 -- 172.21.15.103:0/322685060 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe46404d8e0 msgr2=0x7fe46404fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:31.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.498+0000 7fe4859b0700 1 --2- 172.21.15.103:0/322685060 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe46404d8e0 0x7fe46404fda0 secure :-1 s=READY pgs=142 cs=0 l=1 rx=0x7fe4700013e0 tx=0x7fe480066ea0).stop 2020-04-22T14:03:31.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.498+0000 7fe4859b0700 1 -- 172.21.15.103:0/322685060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4801538f0 msgr2=0x7fe4800658d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:31.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.498+0000 7fe4859b0700 1 --2- 172.21.15.103:0/322685060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4801538f0 0x7fe4800658d0 secure :-1 s=READY pgs=334 cs=0 l=1 rx=0x7fe4700010d0 tx=0x7fe478010da0).stop 2020-04-22T14:03:31.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.498+0000 7fe4859b0700 1 -- 172.21.15.103:0/322685060 shutdown_connections 2020-04-22T14:03:31.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.499+0000 7fe4859b0700 1 --2- 172.21.15.103:0/322685060 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe46404d8e0 0x7fe46404fda0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:31.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.499+0000 7fe4859b0700 1 --2- 172.21.15.103:0/322685060 >> v2:172.21.15.86:3300/0 conn(0x7fe480062da0 0x7fe4801441b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:31.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.499+0000 7fe4859b0700 1 --2- 172.21.15.103:0/322685060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4801538f0 0x7fe4800658d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:31.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.499+0000 7fe4859b0700 1 --2- 172.21.15.103:0/322685060 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe480063180 0x7fe480153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:31.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.499+0000 7fe4859b0700 1 -- 172.21.15.103:0/322685060 >> 172.21.15.103:0/322685060 conn(0x7fe48005b7b0 msgr2=0x7fe4800b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:31.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.499+0000 7fe4859b0700 1 -- 172.21.15.103:0/322685060 shutdown_connections 2020-04-22T14:03:31.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.499+0000 7fe4859b0700 1 -- 172.21.15.103:0/322685060 wait complete. 2020-04-22T14:03:31.504 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' removed 2020-04-22T14:03:31.515 INFO:tasks.ceph.mds.a:Restarting daemon 2020-04-22T14:03:31.515 INFO:tasks.ceph.mds.a:Stopping old one... 2020-04-22T14:03:31.515 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-04-22T14:03:31.515 INFO:teuthology.orchestra.run:waiting for 300 2020-04-22T14:03:31.515 INFO:tasks.ceph.mds.b:Restarting daemon 2020-04-22T14:03:31.516 INFO:tasks.ceph.mds.b:Stopping old one... 2020-04-22T14:03:31.516 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-04-22T14:03:31.516 INFO:teuthology.orchestra.run:waiting for 300 2020-04-22T14:03:31.524 INFO:tasks.ceph.mds.a:Stopped 2020-04-22T14:03:31.524 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:31.525 INFO:tasks.ceph.mds.b:Stopped 2020-04-22T14:03:31.525 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:31.578 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-04-22T14:03:31.580 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-04-22T14:03:31.621 INFO:tasks.ceph.mds.a:Started 2020-04-22T14:03:31.622 DEBUG:teuthology.parallel:result is None 2020-04-22T14:03:31.628 INFO:tasks.ceph.mds.b:Started 2020-04-22T14:03:31.628 DEBUG:teuthology.parallel:result is None 2020-04-22T14:03:31.629 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:31.643 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2020-04-22T14:03:31.700 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2020-04-22T14:03:31.703 INFO:tasks.ceph.mds.b.smithi086.stdout:starting mds.b at 2020-04-22T14:03:31.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.792+0000 7eff1a0cd700 1 Processor -- start 2020-04-22T14:03:31.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.792+0000 7eff1a0cd700 1 -- start start 2020-04-22T14:03:31.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.792+0000 7eff1a0cd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7eff140b25d0 0x7eff140b0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:31.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.792+0000 7eff1a0cd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7eff140b1080 0x7eff141437f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:31.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.792+0000 7eff1a0cd700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff140b1530 con 0x7eff14143c50 2020-04-22T14:03:31.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.792+0000 7eff1a0cd700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff140b17d0 con 0x7eff140b25d0 2020-04-22T14:03:31.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.792+0000 7eff1a0cd700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff140b1a70 con 0x7eff140b1080 2020-04-22T14:03:31.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.793+0000 7eff0bfff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7eff140b1080 0x7eff141437f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:31.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.793+0000 7eff0bfff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7eff140b1080 0x7eff141437f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48416/0 (socket says 172.21.15.103:48416) 2020-04-22T14:03:31.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.793+0000 7eff0bfff700 1 -- 172.21.15.103:0/3699003373 learned_addr learned my addr 172.21.15.103:0/3699003373 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:31.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.793+0000 7eff137fe700 1 --2- 172.21.15.103:0/3699003373 >> v2:172.21.15.86:3300/0 conn(0x7eff140b25d0 0x7eff140b0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:31.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.793+0000 7eff0bfff700 1 -- 172.21.15.103:0/3699003373 >> v2:172.21.15.86:3300/0 conn(0x7eff140b25d0 msgr2=0x7eff140b0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:31.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.793+0000 7eff0bfff700 1 --2- 172.21.15.103:0/3699003373 >> v2:172.21.15.86:3300/0 conn(0x7eff140b25d0 0x7eff140b0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:31.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.793+0000 7eff0bfff700 1 -- 172.21.15.103:0/3699003373 >> v1:172.21.15.86:6789/0 conn(0x7eff14143c50 legacy=0x7eff140b50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:31.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.793+0000 7eff0bfff700 1 -- 172.21.15.103:0/3699003373 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff14144090 con 0x7eff140b1080 2020-04-22T14:03:31.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.793+0000 7eff0bfff700 1 --2- 172.21.15.103:0/3699003373 >> v2:172.21.15.103:3300/0 conn(0x7eff140b1080 0x7eff141437f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efefc002f30 tx=0x7efefc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:31.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.793+0000 7eff0bfff700 1 --2- 172.21.15.103:0/3699003373 >> v2:172.21.15.103:3300/0 conn(0x7eff140b1080 0x7eff141437f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efefc002f30 tx=0x7efefc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:31.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.793+0000 7eff0bfff700 1 --2- 172.21.15.103:0/3699003373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff140b1080 0x7eff141437f0 secure :-1 s=READY pgs=341 cs=0 l=1 rx=0x7efefc002f30 tx=0x7efefc007a40).ready entity=mon.1 client_cookie=3d6466939f84250e server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:31.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.793+0000 7eff0bfff700 1 --2- 172.21.15.103:0/3699003373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff140b1080 0x7eff141437f0 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7efefc002f30 tx=0x7efefc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:31.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.793+0000 7eff0bfff700 1 --2- 172.21.15.103:0/3699003373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff140b1080 0x7eff141437f0 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7efefc002f30 tx=0x7efefc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:31.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.793+0000 7eff12ffd700 1 -- 172.21.15.103:0/3699003373 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efefc011670 con 0x7eff140b1080 2020-04-22T14:03:31.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.793+0000 7eff0bfff700 1 --2- 172.21.15.103:0/3699003373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff140b1080 0x7eff141437f0 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7efefc002f30 tx=0x7efefc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:31.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.793+0000 7eff12ffd700 1 -- 172.21.15.103:0/3699003373 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efefc0117d0 con 0x7eff140b1080 2020-04-22T14:03:31.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.793+0000 7eff12ffd700 1 -- 172.21.15.103:0/3699003373 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efefc011bf0 con 0x7eff140b1080 2020-04-22T14:03:31.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.793+0000 7eff1a0cd700 1 -- 172.21.15.103:0/3699003373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff140b1080 msgr2=0x7eff141437f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:31.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.793+0000 7eff1a0cd700 1 --2- 172.21.15.103:0/3699003373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff140b1080 0x7eff141437f0 secure :-1 s=READY pgs=341 cs=0 l=1 rx=0x7efefc002f30 tx=0x7efefc007a40).stop 2020-04-22T14:03:31.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.794+0000 7eff1a0cd700 1 -- 172.21.15.103:0/3699003373 shutdown_connections 2020-04-22T14:03:31.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.794+0000 7eff1a0cd700 1 --2- 172.21.15.103:0/3699003373 >> v2:172.21.15.86:3300/0 conn(0x7eff140b25d0 0x7eff140b0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:31.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.794+0000 7eff1a0cd700 1 --2- 172.21.15.103:0/3699003373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff140b1080 0x7eff141437f0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:31.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.794+0000 7eff1a0cd700 1 -- 172.21.15.103:0/3699003373 >> 172.21.15.103:0/3699003373 conn(0x7eff140b86b0 msgr2=0x7eff140b8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:31.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.794+0000 7eff1a0cd700 1 -- 172.21.15.103:0/3699003373 shutdown_connections 2020-04-22T14:03:31.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.794+0000 7eff1a0cd700 1 -- 172.21.15.103:0/3699003373 wait complete. 2020-04-22T14:03:31.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.795+0000 7eff1a0cd700 1 Processor -- start 2020-04-22T14:03:31.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.795+0000 7eff1a0cd700 1 -- start start 2020-04-22T14:03:31.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.795+0000 7eff1a0cd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff140b25d0 0x7eff140650d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:31.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.795+0000 7eff1a0cd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7eff14143c50 0x7eff1413e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:31.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.795+0000 7eff1a0cd700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff14061bf0 con 0x7eff140b1080 2020-04-22T14:03:31.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.795+0000 7eff1a0cd700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff14061e90 con 0x7eff14143c50 2020-04-22T14:03:31.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.795+0000 7eff1a0cd700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff14062130 con 0x7eff140b25d0 2020-04-22T14:03:31.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.795+0000 7eff137fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7eff140b1080 0x7eff140b7540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40612/0 (socket says 172.21.15.103:40612) 2020-04-22T14:03:31.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.795+0000 7eff137fe700 1 -- 172.21.15.103:0/835190338 learned_addr learned my addr 172.21.15.103:0/835190338 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:31.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.796+0000 7eff0bfff700 1 --2- 172.21.15.103:0/835190338 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff140b25d0 0x7eff140650d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:31.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.796+0000 7eff13fff700 1 --2- 172.21.15.103:0/835190338 >> v2:172.21.15.86:3300/0 conn(0x7eff14143c50 0x7eff1413e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:31.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.796+0000 7eff117fa700 1 -- 172.21.15.103:0/835190338 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2543823703 0 0) 0x7eff14061bf0 con 0x7eff140b1080 2020-04-22T14:03:31.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.796+0000 7eff117fa700 1 -- 172.21.15.103:0/835190338 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efef8002fe0 con 0x7eff140b1080 2020-04-22T14:03:31.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.796+0000 7eff0bfff700 1 -- 172.21.15.103:0/835190338 >> v2:172.21.15.86:3300/0 conn(0x7eff14143c50 msgr2=0x7eff1413e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:31.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.796+0000 7eff0bfff700 1 --2- 172.21.15.103:0/835190338 >> v2:172.21.15.86:3300/0 conn(0x7eff14143c50 0x7eff1413e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:31.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.796+0000 7eff0bfff700 1 -- 172.21.15.103:0/835190338 >> v1:172.21.15.103:6789/0 conn(0x7eff140b1080 legacy=0x7eff140b7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:31.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.796+0000 7eff0bfff700 1 -- 172.21.15.103:0/835190338 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff14064370 con 0x7eff140b25d0 2020-04-22T14:03:31.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.796+0000 7eff0bfff700 1 --2- 172.21.15.103:0/835190338 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff140b25d0 0x7eff140650d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7eff14144560 tx=0x7efefc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:31.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.796+0000 7eff0bfff700 1 --2- 172.21.15.103:0/835190338 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff140b25d0 0x7eff140650d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7eff14144560 tx=0x7efefc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:31.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.796+0000 7eff0bfff700 1 --2- 172.21.15.103:0/835190338 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff140b25d0 0x7eff140650d0 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7eff14144560 tx=0x7efefc007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:31.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.796+0000 7eff0bfff700 1 --2- 172.21.15.103:0/835190338 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff140b25d0 0x7eff140650d0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7eff14144560 tx=0x7efefc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:31.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.796+0000 7eff117fa700 1 -- 172.21.15.103:0/835190338 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efefc010230 con 0x7eff140b25d0 2020-04-22T14:03:31.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.796+0000 7eff0bfff700 1 --2- 172.21.15.103:0/835190338 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff140b25d0 0x7eff140650d0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7eff14144560 tx=0x7efefc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:31.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.796+0000 7eff0bfff700 1 --2- 172.21.15.103:0/835190338 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff140b25d0 0x7eff140650d0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7eff14144560 tx=0x7efefc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:31.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.796+0000 7eff117fa700 1 -- 172.21.15.103:0/835190338 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efefc007170 con 0x7eff140b25d0 2020-04-22T14:03:31.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.796+0000 7eff1a0cd700 1 -- 172.21.15.103:0/835190338 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff140b7c50 con 0x7eff140b25d0 2020-04-22T14:03:31.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.796+0000 7eff117fa700 1 -- 172.21.15.103:0/835190338 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efefc007550 con 0x7eff140b25d0 2020-04-22T14:03:31.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.796+0000 7eff1a0cd700 1 -- 172.21.15.103:0/835190338 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff140614e0 con 0x7eff140b25d0 2020-04-22T14:03:31.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.797+0000 7eff0bfff700 1 --2- 172.21.15.103:0/835190338 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff140b25d0 0x7eff140650d0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7eff14144560 tx=0x7efefc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:31.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.797+0000 7eff117fa700 1 -- 172.21.15.103:0/835190338 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7efefc0056c0 con 0x7eff140b25d0 2020-04-22T14:03:31.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.797+0000 7eff0bfff700 1 --2- 172.21.15.103:0/835190338 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff140b25d0 0x7eff140650d0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7eff14144560 tx=0x7efefc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:31.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.797+0000 7eff1a0cd700 1 -- 172.21.15.103:0/835190338 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff14061a00 con 0x7eff140b25d0 2020-04-22T14:03:31.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.797+0000 7eff117fa700 1 --2- 172.21.15.103:0/835190338 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efef804dcc0 0x7efef8050180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:31.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.797+0000 7eff117fa700 1 -- 172.21.15.103:0/835190338 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5339+0+0 (secure 0 0 0) 0x7efefc061ac0 con 0x7eff140b25d0 2020-04-22T14:03:31.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.798+0000 7eff137fe700 1 --2- 172.21.15.103:0/835190338 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efef804dcc0 0x7efef8050180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:31.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.798+0000 7eff137fe700 1 --2- 172.21.15.103:0/835190338 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efef804dcc0 0x7efef8050180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7eff04002f30 tx=0x7eff040090d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:31.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.798+0000 7eff137fe700 1 --2- 172.21.15.103:0/835190338 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efef804dcc0 0x7efef8050180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7eff04002f30 tx=0x7eff040090d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:31.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.798+0000 7eff137fe700 1 --2- 172.21.15.103:0/835190338 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efef804dcc0 0x7efef8050180 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7eff04002f30 tx=0x7eff040090d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:31.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.801+0000 7eff0bfff700 1 --2- 172.21.15.103:0/835190338 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff140b25d0 0x7eff140650d0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7eff14144560 tx=0x7efefc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:31.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.801+0000 7eff117fa700 1 -- 172.21.15.103:0/835190338 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7efefc03cf00 con 0x7eff140b25d0 2020-04-22T14:03:31.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:31.964+0000 7eff1a0cd700 1 -- 172.21.15.103:0/835190338 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7eff14056c90 con 0x7eff140b25d0 2020-04-22T14:03:32.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.724+0000 7eff0bfff700 1 --2- 172.21.15.103:0/835190338 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff140b25d0 0x7eff140650d0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7eff14144560 tx=0x7efefc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:32.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.724+0000 7eff117fa700 1 -- 172.21.15.103:0/835190338 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v29) v1 ==== 97+0+0 (secure 0 0 0) 0x7efefc040520 con 0x7eff140b25d0 2020-04-22T14:03:32.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.726+0000 7eff1a0cd700 1 -- 172.21.15.103:0/835190338 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efef804dcc0 msgr2=0x7efef8050180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:32.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.726+0000 7eff1a0cd700 1 --2- 172.21.15.103:0/835190338 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efef804dcc0 0x7efef8050180 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7eff04002f30 tx=0x7eff040090d0).stop 2020-04-22T14:03:32.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.726+0000 7eff1a0cd700 1 -- 172.21.15.103:0/835190338 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff140b25d0 msgr2=0x7eff140650d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:32.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.726+0000 7eff1a0cd700 1 --2- 172.21.15.103:0/835190338 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff140b25d0 0x7eff140650d0 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7eff14144560 tx=0x7efefc007a40).stop 2020-04-22T14:03:32.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.726+0000 7eff1a0cd700 1 -- 172.21.15.103:0/835190338 shutdown_connections 2020-04-22T14:03:32.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.726+0000 7eff1a0cd700 1 --2- 172.21.15.103:0/835190338 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efef804dcc0 0x7efef8050180 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:32.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.726+0000 7eff1a0cd700 1 --2- 172.21.15.103:0/835190338 >> v2:172.21.15.86:3300/0 conn(0x7eff14143c50 0x7eff1413e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:32.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.726+0000 7eff1a0cd700 1 --2- 172.21.15.103:0/835190338 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff140b25d0 0x7eff140650d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:32.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.726+0000 7eff1a0cd700 1 -- 172.21.15.103:0/835190338 >> 172.21.15.103:0/835190338 conn(0x7eff140b86b0 msgr2=0x7eff14142980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:32.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.726+0000 7eff1a0cd700 1 -- 172.21.15.103:0/835190338 shutdown_connections 2020-04-22T14:03:32.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.726+0000 7eff1a0cd700 1 -- 172.21.15.103:0/835190338 wait complete. 2020-04-22T14:03:32.731 INFO:teuthology.orchestra.run.smithi103.stderr: removed all blacklist entries 2020-04-22T14:03:32.740 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2020-04-22T14:03:32.740 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:32.795 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2020-04-22T14:03:32.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.939+0000 7f009e4e8700 1 Processor -- start 2020-04-22T14:03:32.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.939+0000 7f009e4e8700 1 -- start start 2020-04-22T14:03:32.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.940+0000 7f009e4e8700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f009812c0d0 0x7f00981464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:32.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.940+0000 7f009e4e8700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0098143300 con 0x7f0098063e30 2020-04-22T14:03:32.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.940+0000 7f009e4e8700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00981435a0 con 0x7f0098065fe0 2020-04-22T14:03:32.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.940+0000 7f009e4e8700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0098143840 con 0x7f009812c0d0 2020-04-22T14:03:32.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.940+0000 7f00977fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f0098065fe0 0x7f009805b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40622/0 (socket says 172.21.15.103:40622) 2020-04-22T14:03:32.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.940+0000 7f00977fe700 1 -- 172.21.15.103:0/4005837231 learned_addr learned my addr 172.21.15.103:0/4005837231 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:32.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.940+0000 7f0096ffd700 1 -- 172.21.15.103:0/4005837231 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2681924379 0 0) 0x7f00981435a0 con 0x7f0098065fe0 2020-04-22T14:03:32.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.940+0000 7f0096ffd700 1 -- 172.21.15.103:0/4005837231 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0084003230 con 0x7f0098065fe0 2020-04-22T14:03:32.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.940+0000 7f0097fff700 1 --2- 172.21.15.103:0/4005837231 >> v2:172.21.15.86:3300/0 conn(0x7f009812c0d0 0x7f00981464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:32.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.940+0000 7f0096ffd700 1 -- 172.21.15.103:0/4005837231 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2573000502 0 0) 0x7f0084003230 con 0x7f0098065fe0 2020-04-22T14:03:32.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.940+0000 7f0096ffd700 1 -- 172.21.15.103:0/4005837231 >> v2:172.21.15.86:3300/0 conn(0x7f009812c0d0 msgr2=0x7f00981464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:32.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.940+0000 7f0096ffd700 1 --2- 172.21.15.103:0/4005837231 >> v2:172.21.15.86:3300/0 conn(0x7f009812c0d0 0x7f00981464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:32.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.940+0000 7f0096ffd700 1 -- 172.21.15.103:0/4005837231 >> v1:172.21.15.86:6789/0 conn(0x7f0098063e30 legacy=0x7f00980642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:32.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.940+0000 7f0096ffd700 1 -- 172.21.15.103:0/4005837231 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f009805bb50 con 0x7f0098065fe0 2020-04-22T14:03:32.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.940+0000 7f0096ffd700 1 -- 172.21.15.103:0/4005837231 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f008c0016d0 con 0x7f0098065fe0 2020-04-22T14:03:32.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.940+0000 7f0096ffd700 1 -- 172.21.15.103:0/4005837231 >> v1:172.21.15.103:6789/0 conn(0x7f0098065fe0 legacy=0x7f009805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:32.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.940+0000 7f0096ffd700 1 --2- 172.21.15.103:0/4005837231 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0084003720 0x7f0084003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:32.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.940+0000 7f0096ffd700 1 --2- 172.21.15.103:0/4005837231 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00840044d0 0x7f0084004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:32.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.940+0000 7f0096ffd700 1 --2- 172.21.15.103:0/4005837231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0084004db0 0x7f008400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:32.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.940+0000 7f0096ffd700 1 -- 172.21.15.103:0/4005837231 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0098143840 con 0x7f00840044d0 2020-04-22T14:03:32.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.940+0000 7f0096ffd700 1 -- 172.21.15.103:0/4005837231 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00840041c0 con 0x7f0084004db0 2020-04-22T14:03:32.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.940+0000 7f0096ffd700 1 -- 172.21.15.103:0/4005837231 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f008400bb80 con 0x7f0084003720 2020-04-22T14:03:32.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.940+0000 7f0097fff700 1 --2- 172.21.15.103:0/4005837231 >> v2:172.21.15.86:3300/0 conn(0x7f009812c0d0 0x7f00981464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:03:32.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.940+0000 7f009ca85700 1 --2- 172.21.15.103:0/4005837231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0084004db0 0x7f008400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:32.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.941+0000 7f00977fe700 1 --2- 172.21.15.103:0/4005837231 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00840044d0 0x7f0084004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:32.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.941+0000 7f0097fff700 1 --2- 172.21.15.103:0/4005837231 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0084003720 0x7f0084003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:32.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.941+0000 7f009ca85700 1 -- 172.21.15.103:0/4005837231 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0084003720 msgr2=0x7f0084003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:32.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.941+0000 7f009ca85700 1 --2- 172.21.15.103:0/4005837231 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0084003720 0x7f0084003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:32.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.941+0000 7f009ca85700 1 -- 172.21.15.103:0/4005837231 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00840044d0 msgr2=0x7f0084004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:32.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.941+0000 7f009ca85700 1 --2- 172.21.15.103:0/4005837231 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00840044d0 0x7f0084004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:32.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.941+0000 7f009ca85700 1 -- 172.21.15.103:0/4005837231 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0084003230 con 0x7f0084004db0 2020-04-22T14:03:32.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.941+0000 7f009ca85700 1 --2- 172.21.15.103:0/4005837231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0084004db0 0x7f008400b720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f00840054a0 tx=0x7f00900100a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:32.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.941+0000 7f009ca85700 1 -- 172.21.15.103:0/4005837231 reap_dead start 2020-04-22T14:03:32.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.941+0000 7f009ca85700 1 --2- 172.21.15.103:0/4005837231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0084004db0 0x7f008400b720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f00840054a0 tx=0x7f00900100a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:32.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.941+0000 7f009ca85700 1 --2- 172.21.15.103:0/4005837231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0084004db0 0x7f008400b720 secure :-1 s=READY pgs=344 cs=0 l=1 rx=0x7f00840054a0 tx=0x7f00900100a0).ready entity=mon.1 client_cookie=cfdcbed68b7a5335 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:32.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.941+0000 7f009ca85700 1 --2- 172.21.15.103:0/4005837231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0084004db0 0x7f008400b720 secure :-1 s=THROTTLE_DONE pgs=344 cs=0 l=1 rx=0x7f00840054a0 tx=0x7f00900100a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:32.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.941+0000 7f0096ffd700 1 -- 172.21.15.103:0/4005837231 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0090006c40 con 0x7f0084004db0 2020-04-22T14:03:32.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.941+0000 7f009ca85700 1 --2- 172.21.15.103:0/4005837231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0084004db0 0x7f008400b720 secure :-1 s=THROTTLE_DONE pgs=344 cs=0 l=1 rx=0x7f00840054a0 tx=0x7f00900100a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:32.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.941+0000 7f009ca85700 1 --2- 172.21.15.103:0/4005837231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0084004db0 0x7f008400b720 secure :-1 s=THROTTLE_DONE pgs=344 cs=0 l=1 rx=0x7f00840054a0 tx=0x7f00900100a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:32.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.941+0000 7f0096ffd700 1 -- 172.21.15.103:0/4005837231 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0090006da0 con 0x7f0084004db0 2020-04-22T14:03:32.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.941+0000 7f0096ffd700 1 -- 172.21.15.103:0/4005837231 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0090002640 con 0x7f0084004db0 2020-04-22T14:03:32.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.941+0000 7f009e4e8700 1 -- 172.21.15.103:0/4005837231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0084004db0 msgr2=0x7f008400b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:32.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.941+0000 7f009e4e8700 1 --2- 172.21.15.103:0/4005837231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0084004db0 0x7f008400b720 secure :-1 s=READY pgs=344 cs=0 l=1 rx=0x7f00840054a0 tx=0x7f00900100a0).stop 2020-04-22T14:03:32.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.942+0000 7f009e4e8700 1 -- 172.21.15.103:0/4005837231 shutdown_connections 2020-04-22T14:03:32.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.942+0000 7f009e4e8700 1 --2- 172.21.15.103:0/4005837231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0084004db0 0x7f008400b720 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:32.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.942+0000 7f009e4e8700 1 -- 172.21.15.103:0/4005837231 >> 172.21.15.103:0/4005837231 conn(0x7f00980b9160 msgr2=0x7f009805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:32.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.942+0000 7f009e4e8700 1 -- 172.21.15.103:0/4005837231 shutdown_connections 2020-04-22T14:03:32.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.942+0000 7f009e4e8700 1 -- 172.21.15.103:0/4005837231 wait complete. 2020-04-22T14:03:32.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.942+0000 7f009e4e8700 1 Processor -- start 2020-04-22T14:03:32.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.943+0000 7f009e4e8700 1 -- start start 2020-04-22T14:03:32.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.943+0000 7f009e4e8700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f00980ae3e0 0x7f00980af010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:32.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.943+0000 7f009e4e8700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00981425c0 0x7f0098152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:32.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.943+0000 7f009e4e8700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00980adca0 con 0x7f0084004db0 2020-04-22T14:03:32.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.943+0000 7f009e4e8700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00980adf40 con 0x7f00980ae3e0 2020-04-22T14:03:32.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.943+0000 7f009e4e8700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0098153330 con 0x7f00981425c0 2020-04-22T14:03:32.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.943+0000 7f0097fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f0084004db0 0x7f0098141eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40634/0 (socket says 172.21.15.103:40634) 2020-04-22T14:03:32.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.943+0000 7f0097fff700 1 -- 172.21.15.103:0/2343280464 learned_addr learned my addr 172.21.15.103:0/2343280464 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:32.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.943+0000 7f009ca85700 1 --2- 172.21.15.103:0/2343280464 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00981425c0 0x7f0098152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:32.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.944+0000 7f00977fe700 1 --2- 172.21.15.103:0/2343280464 >> v2:172.21.15.86:3300/0 conn(0x7f00980ae3e0 0x7f00980af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:32.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.944+0000 7f00957fa700 1 -- 172.21.15.103:0/2343280464 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 210315857 0 0) 0x7f00980adca0 con 0x7f0084004db0 2020-04-22T14:03:32.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.944+0000 7f00957fa700 1 -- 172.21.15.103:0/2343280464 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0078002fe0 con 0x7f0084004db0 2020-04-22T14:03:32.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.944+0000 7f00957fa700 1 -- 172.21.15.103:0/2343280464 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 824801892 0 0) 0x7f0078002fe0 con 0x7f0084004db0 2020-04-22T14:03:32.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.944+0000 7f00957fa700 1 -- 172.21.15.103:0/2343280464 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f00980adca0 con 0x7f0084004db0 2020-04-22T14:03:32.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.944+0000 7f00957fa700 1 -- 172.21.15.103:0/2343280464 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f00880012a0 con 0x7f0084004db0 2020-04-22T14:03:32.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.944+0000 7f00957fa700 1 -- 172.21.15.103:0/2343280464 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00981425c0 msgr2=0x7f0098152ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:32.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.944+0000 7f00957fa700 1 --2- 172.21.15.103:0/2343280464 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00981425c0 0x7f0098152ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:32.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.944+0000 7f00957fa700 1 -- 172.21.15.103:0/2343280464 >> v2:172.21.15.86:3300/0 conn(0x7f00980ae3e0 msgr2=0x7f00980af010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:32.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.944+0000 7f00957fa700 1 --2- 172.21.15.103:0/2343280464 >> v2:172.21.15.86:3300/0 conn(0x7f00980ae3e0 0x7f00980af010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:32.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.944+0000 7f00957fa700 1 -- 172.21.15.103:0/2343280464 >> v1:172.21.15.103:6789/0 conn(0x7f0084004db0 legacy=0x7f0098141eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:32.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.944+0000 7f00957fa700 1 --2- 172.21.15.103:0/2343280464 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00780049b0 0x7f0078004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:32.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.944+0000 7f00957fa700 1 --2- 172.21.15.103:0/2343280464 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0078005260 0x7f0078003980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:32.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.944+0000 7f00957fa700 1 --2- 172.21.15.103:0/2343280464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0078003fc0 0x7f0078004440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:32.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.944+0000 7f00957fa700 1 -- 172.21.15.103:0/2343280464 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00980adf40 con 0x7f00780049b0 2020-04-22T14:03:32.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.944+0000 7f00957fa700 1 -- 172.21.15.103:0/2343280464 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0098153330 con 0x7f0078003fc0 2020-04-22T14:03:32.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.944+0000 7f00957fa700 1 -- 172.21.15.103:0/2343280464 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f007800b980 con 0x7f0078005260 2020-04-22T14:03:32.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.944+0000 7f00977fe700 1 --2- 172.21.15.103:0/2343280464 >> v2:172.21.15.86:3300/0 conn(0x7f00980ae3e0 0x7f00980af010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:03:32.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.944+0000 7f009ca85700 1 --2- 172.21.15.103:0/2343280464 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00981425c0 0x7f0098152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:03:32.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.944+0000 7f0097fff700 1 --2- 172.21.15.103:0/2343280464 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00780049b0 0x7f0078004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:32.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.944+0000 7f009ca85700 1 --2- 172.21.15.103:0/2343280464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0078003fc0 0x7f0078004440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:32.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.944+0000 7f00977fe700 1 --2- 172.21.15.103:0/2343280464 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0078005260 0x7f0078003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:32.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.944+0000 7f009ca85700 1 -- 172.21.15.103:0/2343280464 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0078005260 msgr2=0x7f0078003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:32.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.944+0000 7f009ca85700 1 --2- 172.21.15.103:0/2343280464 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0078005260 0x7f0078003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:32.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.944+0000 7f009ca85700 1 -- 172.21.15.103:0/2343280464 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00780049b0 msgr2=0x7f0078004d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:32.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.944+0000 7f009ca85700 1 --2- 172.21.15.103:0/2343280464 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00780049b0 0x7f0078004d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:32.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.944+0000 7f009ca85700 1 -- 172.21.15.103:0/2343280464 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00981534a0 con 0x7f0078003fc0 2020-04-22T14:03:32.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.944+0000 7f009e4e8700 1 -- 172.21.15.103:0/2343280464 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00981536f0 con 0x7f0078003fc0 2020-04-22T14:03:32.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.944+0000 7f009ca85700 1 --2- 172.21.15.103:0/2343280464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0078003fc0 0x7f0078004440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f00980603e0 tx=0x7f00900100a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:32.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.944+0000 7f009e4e8700 1 -- 172.21.15.103:0/2343280464 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0098152ed0 con 0x7f0078003fc0 2020-04-22T14:03:32.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.944+0000 7f009ca85700 1 --2- 172.21.15.103:0/2343280464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0078003fc0 0x7f0078004440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f00980603e0 tx=0x7f00900100a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:32.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.944+0000 7f009ca85700 1 --2- 172.21.15.103:0/2343280464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0078003fc0 0x7f0078004440 secure :-1 s=READY pgs=346 cs=0 l=1 rx=0x7f00980603e0 tx=0x7f00900100a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:32.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.945+0000 7f009ca85700 1 --2- 172.21.15.103:0/2343280464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0078003fc0 0x7f0078004440 secure :-1 s=THROTTLE_DONE pgs=346 cs=0 l=1 rx=0x7f00980603e0 tx=0x7f00900100a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:32.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.945+0000 7f009ca85700 1 --2- 172.21.15.103:0/2343280464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0078003fc0 0x7f0078004440 secure :-1 s=THROTTLE_DONE pgs=346 cs=0 l=1 rx=0x7f00980603e0 tx=0x7f00900100a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:32.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.945+0000 7f009ca85700 1 --2- 172.21.15.103:0/2343280464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0078003fc0 0x7f0078004440 secure :-1 s=THROTTLE_DONE pgs=346 cs=0 l=1 rx=0x7f00980603e0 tx=0x7f00900100a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:32.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.945+0000 7f00957fa700 1 -- 172.21.15.103:0/2343280464 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0090011ea0 con 0x7f0078003fc0 2020-04-22T14:03:32.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.945+0000 7f00957fa700 1 -- 172.21.15.103:0/2343280464 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0090006a50 con 0x7f0078003fc0 2020-04-22T14:03:32.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.945+0000 7f00957fa700 1 -- 172.21.15.103:0/2343280464 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0090006e70 con 0x7f0078003fc0 2020-04-22T14:03:32.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.945+0000 7f009ca85700 1 --2- 172.21.15.103:0/2343280464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0078003fc0 0x7f0078004440 secure :-1 s=THROTTLE_DONE pgs=346 cs=0 l=1 rx=0x7f00980603e0 tx=0x7f00900100a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:32.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.945+0000 7f009e4e8700 1 -- 172.21.15.103:0/2343280464 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0074003340 con 0x7f0078003fc0 2020-04-22T14:03:32.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.946+0000 7f00957fa700 1 -- 172.21.15.103:0/2343280464 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f0090009170 con 0x7f0078003fc0 2020-04-22T14:03:32.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.946+0000 7f009ca85700 1 --2- 172.21.15.103:0/2343280464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0078003fc0 0x7f0078004440 secure :-1 s=THROTTLE_DONE pgs=346 cs=0 l=1 rx=0x7f00980603e0 tx=0x7f00900100a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:32.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.946+0000 7f00957fa700 1 --2- 172.21.15.103:0/2343280464 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f00780560e0 0x7f00780585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:32.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.946+0000 7f00957fa700 1 -- 172.21.15.103:0/2343280464 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f009000b0d0 con 0x7f0078003fc0 2020-04-22T14:03:32.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.946+0000 7f0097fff700 1 --2- 172.21.15.103:0/2343280464 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f00780560e0 0x7f00780585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:32.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.946+0000 7f0097fff700 1 --2- 172.21.15.103:0/2343280464 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f00780560e0 0x7f00780585a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0088008110 tx=0x7f0088001e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:32.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.946+0000 7f0097fff700 1 --2- 172.21.15.103:0/2343280464 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f00780560e0 0x7f00780585a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0088008110 tx=0x7f0088001e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:32.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.946+0000 7f0097fff700 1 --2- 172.21.15.103:0/2343280464 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f00780560e0 0x7f00780585a0 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7f0088008110 tx=0x7f0088001e10).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:32.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.950+0000 7f009ca85700 1 --2- 172.21.15.103:0/2343280464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0078003fc0 0x7f0078004440 secure :-1 s=THROTTLE_DONE pgs=346 cs=0 l=1 rx=0x7f00980603e0 tx=0x7f00900100a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:32.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:32.950+0000 7f00957fa700 1 -- 172.21.15.103:0/2343280464 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f009003d0f0 con 0x7f0078003fc0 2020-04-22T14:03:33.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.142+0000 7f009e4e8700 1 -- 172.21.15.103:0/2343280464 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f00740021d0 con 0x7f0078003fc0 2020-04-22T14:03:33.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.143+0000 7f009ca85700 1 --2- 172.21.15.103:0/2343280464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0078003fc0 0x7f0078004440 secure :-1 s=THROTTLE_DONE pgs=346 cs=0 l=1 rx=0x7f00980603e0 tx=0x7f00900100a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:33.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.143+0000 7f00957fa700 1 -- 172.21.15.103:0/2343280464 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+5917 (secure 0 0 0) 0x7f0090040710 con 0x7f0078003fc0 2020-04-22T14:03:33.146 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:03:33.147 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:03:33.147 INFO:teuthology.orchestra.run.smithi103.stdout: "auth_dump": [ 2020-04-22T14:03:33.147 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:33.147 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.a", 2020-04-22T14:03:33.147 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBeliD5IBAAjC7UikdEP8FeE2rKs/ympw==", 2020-04-22T14:03:33.147 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:03:33.147 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:03:33.147 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:03:33.148 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:03:33.148 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:03:33.148 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:33.148 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:33.148 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:33.148 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.b", 2020-04-22T14:03:33.148 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBepkqQLBAA4aMKXxROQugglhm4aBd1Iw==", 2020-04-22T14:03:33.149 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:03:33.149 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:03:33.149 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:03:33.149 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:03:33.149 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:03:33.149 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:33.149 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:33.149 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:33.150 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.0", 2020-04-22T14:03:33.150 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA2TqBehMJiBxAARaWo32QGx49PxImGafnOFw==", 2020-04-22T14:03:33.150 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:03:33.150 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:03:33.150 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:03:33.150 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:03:33.150 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:33.151 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:33.151 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:33.151 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.1", 2020-04-22T14:03:33.151 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA4TqBeiAAcKRAAEHuaqbsB+NLUTSgFOCOFZg==", 2020-04-22T14:03:33.151 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:03:33.151 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:03:33.151 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:03:33.151 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:03:33.152 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:33.152 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:33.152 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:33.152 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.2", 2020-04-22T14:03:33.152 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA7TqBebeRzDxAAsjRyvJektq7MQ+334kU+UQ==", 2020-04-22T14:03:33.152 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:03:33.152 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:03:33.153 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:03:33.153 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:03:33.153 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:33.153 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:33.153 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:33.153 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.3", 2020-04-22T14:03:33.154 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA9TqBehxmSMRAATZ0o/ZnxHp2m/tqLmv6JwA==", 2020-04-22T14:03:33.154 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:03:33.154 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:03:33.154 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:03:33.154 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:03:33.154 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:33.154 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:33.155 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:33.155 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.4", 2020-04-22T14:03:33.155 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBETqBePwJSBRAAXgMKuX3EILi3gy8QzR4cig==", 2020-04-22T14:03:33.155 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:03:33.155 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:03:33.155 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:03:33.155 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:03:33.155 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:33.156 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:33.156 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:33.156 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.5", 2020-04-22T14:03:33.156 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBGTqBe5l++KRAAHIWG6bBnru2EVXv/drAL0g==", 2020-04-22T14:03:33.156 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:03:33.156 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:03:33.156 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:03:33.166 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:03:33.166 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:33.166 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:33.166 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:33.166 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.6", 2020-04-22T14:03:33.167 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBJTqBe88rTEBAAO2Z78NZLTYIbBpYovBSHVQ==", 2020-04-22T14:03:33.167 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:03:33.167 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:03:33.167 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:03:33.167 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:03:33.167 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:33.167 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:33.167 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:33.168 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.7", 2020-04-22T14:03:33.168 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBLTqBeGNFIMxAARIXhPNM6xurdnDv8+xZqUw==", 2020-04-22T14:03:33.168 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:03:33.168 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:03:33.168 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:03:33.168 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:03:33.168 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:33.169 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:33.169 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:33.169 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.0", 2020-04-22T14:03:33.169 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBe5ooUNxAA9zBtv6+i3Xl9iYtRl4xKGg==", 2020-04-22T14:03:33.169 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:03:33.169 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:03:33.169 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow r", 2020-04-22T14:03:33.169 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow rw", 2020-04-22T14:03:33.170 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rwx" 2020-04-22T14:03:33.170 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:33.170 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:33.170 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:33.170 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.1", 2020-04-22T14:03:33.170 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAyTqBe0bioBBAAVpoQouA/QICwqRoaFbjkiA==", 2020-04-22T14:03:33.170 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:03:33.171 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:03:33.171 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow r", 2020-04-22T14:03:33.171 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow rw", 2020-04-22T14:03:33.171 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rwx" 2020-04-22T14:03:33.171 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:33.171 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:33.171 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:33.171 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.2", 2020-04-22T14:03:33.172 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAyTqBemwpXCxAAObNL96zS67nMEe4MLjrEtw==", 2020-04-22T14:03:33.172 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:03:33.172 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:03:33.172 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow r", 2020-04-22T14:03:33.172 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow rw", 2020-04-22T14:03:33.172 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rwx" 2020-04-22T14:03:33.172 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:33.173 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:33.173 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:33.173 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.3", 2020-04-22T14:03:33.173 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAyTqBemGxNFBAAlqvB8FeZbMRwvzVjBpH/tA==", 2020-04-22T14:03:33.173 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:03:33.173 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:03:33.173 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow r", 2020-04-22T14:03:33.174 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow rw", 2020-04-22T14:03:33.174 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rwx" 2020-04-22T14:03:33.174 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:33.174 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:33.174 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:33.174 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.admin", 2020-04-22T14:03:33.174 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAwTqBeSx5dHxAAH0jPkaiWEwpr66ROWwbU8Q==", 2020-04-22T14:03:33.174 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:03:33.175 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2020-04-22T14:03:33.175 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:03:33.175 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:03:33.175 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:03:33.175 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:33.175 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:33.175 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:33.175 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.bootstrap-mds", 2020-04-22T14:03:33.176 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBeTqBeZpHwHBAAoMZbIbYtRnLoFj3HP8Cn2w==", 2020-04-22T14:03:33.176 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:03:33.176 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile bootstrap-mds" 2020-04-22T14:03:33.176 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:33.176 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:33.176 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:33.176 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.bootstrap-mgr", 2020-04-22T14:03:33.177 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBeTqBeEJvwHBAAFC/Ek8YhfpUauN4tc4FqNA==", 2020-04-22T14:03:33.177 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:03:33.177 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile bootstrap-mgr" 2020-04-22T14:03:33.177 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:33.177 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:33.177 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:33.177 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.bootstrap-osd", 2020-04-22T14:03:33.177 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBeTqBeRqPwHBAAAGmS0BCcpBTktI6gu+7W4w==", 2020-04-22T14:03:33.178 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:03:33.178 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile bootstrap-osd" 2020-04-22T14:03:33.178 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:33.178 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:33.178 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:33.178 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.bootstrap-rbd", 2020-04-22T14:03:33.178 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBeTqBer6/wHBAAse3zLqNwSMFDH8wahQ69rw==", 2020-04-22T14:03:33.178 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:03:33.179 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile bootstrap-rbd" 2020-04-22T14:03:33.179 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:33.179 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:33.179 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:33.179 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.bootstrap-rbd-mirror", 2020-04-22T14:03:33.179 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBeTqBe6rjwHBAAu49vxuCLKfdUITAx4Pyb3w==", 2020-04-22T14:03:33.179 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:03:33.180 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2020-04-22T14:03:33.180 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:33.180 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:33.180 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:33.180 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.bootstrap-rgw", 2020-04-22T14:03:33.180 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBeTqBexMHwHBAA78B2RCQSmyP4nyEGRTqG0w==", 2020-04-22T14:03:33.180 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:03:33.181 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile bootstrap-rgw" 2020-04-22T14:03:33.181 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:33.181 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:33.181 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:33.181 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mgr.x", 2020-04-22T14:03:33.181 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBe3YVhGhAAWAf6f9sV3bzoucBBPS3j2g==", 2020-04-22T14:03:33.181 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:03:33.182 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2020-04-22T14:03:33.182 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile mgr", 2020-04-22T14:03:33.182 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:03:33.182 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:33.182 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:33.182 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:33.182 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mgr.y", 2020-04-22T14:03:33.182 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBeX8AXExAAhh/N+/ogdKlxmkveSM60+g==", 2020-04-22T14:03:33.183 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:03:33.183 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2020-04-22T14:03:33.183 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile mgr", 2020-04-22T14:03:33.183 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:03:33.183 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:33.183 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:33.183 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:03:33.183 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:03:33.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.144+0000 7f009e4e8700 1 -- 172.21.15.103:0/2343280464 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f00780560e0 msgr2=0x7f00780585a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:33.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.144+0000 7f009e4e8700 1 --2- 172.21.15.103:0/2343280464 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f00780560e0 0x7f00780585a0 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7f0088008110 tx=0x7f0088001e10).stop 2020-04-22T14:03:33.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.144+0000 7f009e4e8700 1 -- 172.21.15.103:0/2343280464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0078003fc0 msgr2=0x7f0078004440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:33.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.144+0000 7f009e4e8700 1 --2- 172.21.15.103:0/2343280464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0078003fc0 0x7f0078004440 secure :-1 s=READY pgs=346 cs=0 l=1 rx=0x7f00980603e0 tx=0x7f00900100a0).stop 2020-04-22T14:03:33.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.144+0000 7f009ca85700 1 -- 172.21.15.103:0/2343280464 reap_dead start 2020-04-22T14:03:33.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.144+0000 7f009e4e8700 1 -- 172.21.15.103:0/2343280464 shutdown_connections 2020-04-22T14:03:33.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.144+0000 7f009e4e8700 1 --2- 172.21.15.103:0/2343280464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0078003fc0 0x7f0078004440 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:33.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.144+0000 7f009e4e8700 1 -- 172.21.15.103:0/2343280464 >> 172.21.15.103:0/2343280464 conn(0x7f00980b9160 msgr2=0x7f009805ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:33.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.144+0000 7f009e4e8700 1 -- 172.21.15.103:0/2343280464 shutdown_connections 2020-04-22T14:03:33.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.144+0000 7f009e4e8700 1 -- 172.21.15.103:0/2343280464 wait complete. 2020-04-22T14:03:33.187 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:33.200 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth del client.bootstrap-mds 2020-04-22T14:03:33.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.344+0000 7f7bd20b4700 1 Processor -- start 2020-04-22T14:03:33.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.344+0000 7f7bd20b4700 1 -- start start 2020-04-22T14:03:33.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.345+0000 7f7bd20b4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7bcc0b4320 0x7f7bcc0b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:33.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.345+0000 7f7bd20b4700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bcc0b0e90 con 0x7f7bcc0b2530 2020-04-22T14:03:33.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.345+0000 7f7bd20b4700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bcc0b1130 con 0x7f7bcc0b4700 2020-04-22T14:03:33.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.345+0000 7f7bd20b4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bcc0b2a90 con 0x7f7bcc0b4320 2020-04-22T14:03:33.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.345+0000 7f7bcaffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f7bcc0b4700 0x7f7bcc0afa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40648/0 (socket says 172.21.15.103:40648) 2020-04-22T14:03:33.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.345+0000 7f7bcaffd700 1 -- 172.21.15.103:0/195119662 learned_addr learned my addr 172.21.15.103:0/195119662 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:33.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.345+0000 7f7bcb7fe700 1 --2- 172.21.15.103:0/195119662 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7bcc0b4320 0x7f7bcc0b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:33.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.345+0000 7f7bca7fc700 1 -- 172.21.15.103:0/195119662 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4067805876 0 0) 0x7f7bcc0b1130 con 0x7f7bcc0b4700 2020-04-22T14:03:33.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.345+0000 7f7bca7fc700 1 -- 172.21.15.103:0/195119662 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bb8003230 con 0x7f7bcc0b4700 2020-04-22T14:03:33.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.345+0000 7f7bca7fc700 1 -- 172.21.15.103:0/195119662 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3142167281 0 0) 0x7f7bb8003230 con 0x7f7bcc0b4700 2020-04-22T14:03:33.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.345+0000 7f7bca7fc700 1 -- 172.21.15.103:0/195119662 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7bcc0b4320 msgr2=0x7f7bcc0b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:33.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.345+0000 7f7bca7fc700 1 --2- 172.21.15.103:0/195119662 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7bcc0b4320 0x7f7bcc0b15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:33.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.345+0000 7f7bca7fc700 1 -- 172.21.15.103:0/195119662 >> v1:172.21.15.86:6789/0 conn(0x7f7bcc0b2530 legacy=0x7f7bcc13c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:33.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.345+0000 7f7bca7fc700 1 -- 172.21.15.103:0/195119662 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bcc0ae500 con 0x7f7bcc0b4700 2020-04-22T14:03:33.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.345+0000 7f7bca7fc700 1 -- 172.21.15.103:0/195119662 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f7bc00016d0 con 0x7f7bcc0b4700 2020-04-22T14:03:33.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.346+0000 7f7bca7fc700 1 -- 172.21.15.103:0/195119662 >> v1:172.21.15.103:6789/0 conn(0x7f7bcc0b4700 legacy=0x7f7bcc0afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:33.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.346+0000 7f7bca7fc700 1 --2- 172.21.15.103:0/195119662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7bb8003720 0x7f7bb8003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:33.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.346+0000 7f7bca7fc700 1 --2- 172.21.15.103:0/195119662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bb8003fd0 0x7f7bb80044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:33.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.346+0000 7f7bca7fc700 1 --2- 172.21.15.103:0/195119662 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7bcc0b4320 0x7f7bb8004a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:33.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.346+0000 7f7bca7fc700 1 -- 172.21.15.103:0/195119662 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bcc0b2a90 con 0x7f7bb8003720 2020-04-22T14:03:33.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.346+0000 7f7bca7fc700 1 -- 172.21.15.103:0/195119662 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb8004ef0 con 0x7f7bb8003fd0 2020-04-22T14:03:33.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.346+0000 7f7bca7fc700 1 -- 172.21.15.103:0/195119662 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb80050b0 con 0x7f7bcc0b4320 2020-04-22T14:03:33.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.346+0000 7f7bcaffd700 1 --2- 172.21.15.103:0/195119662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bb8003fd0 0x7f7bb80044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:33.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.346+0000 7f7bcb7fe700 1 --2- 172.21.15.103:0/195119662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7bb8003720 0x7f7bb8003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:33.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.346+0000 7f7bcbfff700 1 --2- 172.21.15.103:0/195119662 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7bcc0b4320 0x7f7bb8004a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:33.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.346+0000 7f7bcaffd700 1 -- 172.21.15.103:0/195119662 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7bcc0b4320 msgr2=0x7f7bb8004a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:33.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.346+0000 7f7bcaffd700 1 --2- 172.21.15.103:0/195119662 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7bcc0b4320 0x7f7bb8004a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:33.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.346+0000 7f7bcaffd700 1 -- 172.21.15.103:0/195119662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7bb8003720 msgr2=0x7f7bb8003b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:33.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.346+0000 7f7bcaffd700 1 --2- 172.21.15.103:0/195119662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7bb8003720 0x7f7bb8003b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:33.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.346+0000 7f7bcaffd700 1 -- 172.21.15.103:0/195119662 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb8003230 con 0x7f7bb8003fd0 2020-04-22T14:03:33.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.346+0000 7f7bcaffd700 1 --2- 172.21.15.103:0/195119662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bb8003fd0 0x7f7bb80044d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7bc00013e0 tx=0x7f7bcc0ae690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:33.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.346+0000 7f7bcaffd700 1 --2- 172.21.15.103:0/195119662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bb8003fd0 0x7f7bb80044d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7bc00013e0 tx=0x7f7bcc0ae690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:33.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.346+0000 7f7bcaffd700 1 --2- 172.21.15.103:0/195119662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bb8003fd0 0x7f7bb80044d0 secure :-1 s=READY pgs=348 cs=0 l=1 rx=0x7f7bc00013e0 tx=0x7f7bcc0ae690).ready entity=mon.1 client_cookie=10430a5681ab92d6 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:33.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.346+0000 7f7bcaffd700 1 --2- 172.21.15.103:0/195119662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bb8003fd0 0x7f7bb80044d0 secure :-1 s=THROTTLE_DONE pgs=348 cs=0 l=1 rx=0x7f7bc00013e0 tx=0x7f7bcc0ae690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:33.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.346+0000 7f7bca7fc700 1 -- 172.21.15.103:0/195119662 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bc000ce70 con 0x7f7bb8003fd0 2020-04-22T14:03:33.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.346+0000 7f7bcaffd700 1 --2- 172.21.15.103:0/195119662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bb8003fd0 0x7f7bb80044d0 secure :-1 s=THROTTLE_DONE pgs=348 cs=0 l=1 rx=0x7f7bc00013e0 tx=0x7f7bcc0ae690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:33.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.346+0000 7f7bcaffd700 1 --2- 172.21.15.103:0/195119662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bb8003fd0 0x7f7bb80044d0 secure :-1 s=THROTTLE_DONE pgs=348 cs=0 l=1 rx=0x7f7bc00013e0 tx=0x7f7bcc0ae690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:33.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.346+0000 7f7bca7fc700 1 -- 172.21.15.103:0/195119662 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc000e370 con 0x7f7bb8003fd0 2020-04-22T14:03:33.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.346+0000 7f7bca7fc700 1 -- 172.21.15.103:0/195119662 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bc00100c0 con 0x7f7bb8003fd0 2020-04-22T14:03:33.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.346+0000 7f7bd20b4700 1 -- 172.21.15.103:0/195119662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bb8003fd0 msgr2=0x7f7bb80044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:33.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.346+0000 7f7bd20b4700 1 --2- 172.21.15.103:0/195119662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bb8003fd0 0x7f7bb80044d0 secure :-1 s=READY pgs=348 cs=0 l=1 rx=0x7f7bc00013e0 tx=0x7f7bcc0ae690).stop 2020-04-22T14:03:33.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.346+0000 7f7bcbfff700 1 -- 172.21.15.103:0/195119662 reap_dead start 2020-04-22T14:03:33.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.347+0000 7f7bd20b4700 1 -- 172.21.15.103:0/195119662 shutdown_connections 2020-04-22T14:03:33.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.347+0000 7f7bd20b4700 1 -- 172.21.15.103:0/195119662 >> 172.21.15.103:0/195119662 conn(0x7f7bcc0b86b0 msgr2=0x7f7bcc0b8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:33.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.347+0000 7f7bd20b4700 1 -- 172.21.15.103:0/195119662 shutdown_connections 2020-04-22T14:03:33.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.347+0000 7f7bd20b4700 1 -- 172.21.15.103:0/195119662 wait complete. 2020-04-22T14:03:33.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.348+0000 7f7bd20b4700 1 Processor -- start 2020-04-22T14:03:33.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.348+0000 7f7bd20b4700 1 -- start start 2020-04-22T14:03:33.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.348+0000 7f7bd20b4700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7bcc0b78c0 0x7f7bcc1402c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:33.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.349+0000 7f7bd20b4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7bcc13c1e0 0x7f7bcc1419b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:33.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.349+0000 7f7bd20b4700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bcc13f050 con 0x7f7bcc141e10 2020-04-22T14:03:33.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.349+0000 7f7bd20b4700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bcc13f310 con 0x7f7bcc0b78c0 2020-04-22T14:03:33.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.349+0000 7f7bd20b4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bcc13f5b0 con 0x7f7bcc13c1e0 2020-04-22T14:03:33.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.349+0000 7f7bcb7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7bcc0b78c0 0x7f7bcc1402c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:33.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.349+0000 7f7bcbfff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f7bcc141e10 0x7f7bcc065c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40664/0 (socket says 172.21.15.103:40664) 2020-04-22T14:03:33.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.349+0000 7f7bcbfff700 1 -- 172.21.15.103:0/3351975740 learned_addr learned my addr 172.21.15.103:0/3351975740 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:33.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.349+0000 7f7bcb7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7bcc0b78c0 0x7f7bcc1402c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48470/0 (socket says 172.21.15.103:48470) 2020-04-22T14:03:33.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.349+0000 7f7bcaffd700 1 --2- 172.21.15.103:0/3351975740 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7bcc13c1e0 0x7f7bcc1419b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:33.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.349+0000 7f7bcb7fe700 1 -- 172.21.15.103:0/3351975740 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7bcc13c1e0 msgr2=0x7f7bcc1419b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:33.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.349+0000 7f7bcb7fe700 1 --2- 172.21.15.103:0/3351975740 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7bcc13c1e0 0x7f7bcc1419b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:33.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.349+0000 7f7bc8ff9700 1 -- 172.21.15.103:0/3351975740 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3730961831 0 0) 0x7f7bcc13f050 con 0x7f7bcc141e10 2020-04-22T14:03:33.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.349+0000 7f7bcb7fe700 1 -- 172.21.15.103:0/3351975740 >> v1:172.21.15.103:6789/0 conn(0x7f7bcc141e10 legacy=0x7f7bcc065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:33.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.349+0000 7f7bcb7fe700 1 -- 172.21.15.103:0/3351975740 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bcc0b7ca0 con 0x7f7bcc0b78c0 2020-04-22T14:03:33.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.349+0000 7f7bcb7fe700 1 --2- 172.21.15.103:0/3351975740 >> v2:172.21.15.103:3300/0 conn(0x7f7bcc0b78c0 0x7f7bcc1402c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7bbc002f30 tx=0x7f7bbc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:33.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.349+0000 7f7bcb7fe700 1 --2- 172.21.15.103:0/3351975740 >> v2:172.21.15.103:3300/0 conn(0x7f7bcc0b78c0 0x7f7bcc1402c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7bbc002f30 tx=0x7f7bbc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:33.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.349+0000 7f7bcb7fe700 1 --2- 172.21.15.103:0/3351975740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bcc0b78c0 0x7f7bcc1402c0 secure :-1 s=READY pgs=350 cs=0 l=1 rx=0x7f7bbc002f30 tx=0x7f7bbc010ba0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:33.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.349+0000 7f7bcb7fe700 1 --2- 172.21.15.103:0/3351975740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bcc0b78c0 0x7f7bcc1402c0 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f7bbc002f30 tx=0x7f7bbc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:33.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.349+0000 7f7bc8ff9700 1 -- 172.21.15.103:0/3351975740 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bbc005e90 con 0x7f7bcc0b78c0 2020-04-22T14:03:33.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.349+0000 7f7bcb7fe700 1 --2- 172.21.15.103:0/3351975740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bcc0b78c0 0x7f7bcc1402c0 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f7bbc002f30 tx=0x7f7bbc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:33.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.349+0000 7f7bcb7fe700 1 --2- 172.21.15.103:0/3351975740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bcc0b78c0 0x7f7bcc1402c0 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f7bbc002f30 tx=0x7f7bbc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:33.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.349+0000 7f7bc8ff9700 1 -- 172.21.15.103:0/3351975740 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bbc007180 con 0x7f7bcc0b78c0 2020-04-22T14:03:33.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.349+0000 7f7bd20b4700 1 -- 172.21.15.103:0/3351975740 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bcc13ecd0 con 0x7f7bcc0b78c0 2020-04-22T14:03:33.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.349+0000 7f7bc8ff9700 1 -- 172.21.15.103:0/3351975740 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bbc007520 con 0x7f7bcc0b78c0 2020-04-22T14:03:33.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.349+0000 7f7bd20b4700 1 -- 172.21.15.103:0/3351975740 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bcc1527d0 con 0x7f7bcc0b78c0 2020-04-22T14:03:33.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.350+0000 7f7bcb7fe700 1 --2- 172.21.15.103:0/3351975740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bcc0b78c0 0x7f7bcc1402c0 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f7bbc002f30 tx=0x7f7bbc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:33.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.350+0000 7f7bd20b4700 1 -- 172.21.15.103:0/3351975740 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bcc065af0 con 0x7f7bcc0b78c0 2020-04-22T14:03:33.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.350+0000 7f7bc8ff9700 1 -- 172.21.15.103:0/3351975740 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f7bbc009490 con 0x7f7bcc0b78c0 2020-04-22T14:03:33.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.350+0000 7f7bcb7fe700 1 --2- 172.21.15.103:0/3351975740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bcc0b78c0 0x7f7bcc1402c0 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f7bbc002f30 tx=0x7f7bbc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:33.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.350+0000 7f7bc8ff9700 1 --2- 172.21.15.103:0/3351975740 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7bac04d890 0x7f7bac04fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:33.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.350+0000 7f7bc8ff9700 1 -- 172.21.15.103:0/3351975740 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f7bbc061490 con 0x7f7bcc0b78c0 2020-04-22T14:03:33.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.351+0000 7f7bcaffd700 1 --2- 172.21.15.103:0/3351975740 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7bac04d890 0x7f7bac04fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:33.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.351+0000 7f7bcaffd700 1 --2- 172.21.15.103:0/3351975740 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7bac04d890 0x7f7bac04fd50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7bc00013e0 tx=0x7f7bcc0ae690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:33.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.351+0000 7f7bcaffd700 1 --2- 172.21.15.103:0/3351975740 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7bac04d890 0x7f7bac04fd50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7bc00013e0 tx=0x7f7bcc0ae690).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:33.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.351+0000 7f7bcaffd700 1 --2- 172.21.15.103:0/3351975740 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7bac04d890 0x7f7bac04fd50 secure :-1 s=READY pgs=146 cs=0 l=1 rx=0x7f7bc00013e0 tx=0x7f7bcc0ae690).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:33.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.354+0000 7f7bcb7fe700 1 --2- 172.21.15.103:0/3351975740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bcc0b78c0 0x7f7bcc1402c0 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f7bbc002f30 tx=0x7f7bbc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:33.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.354+0000 7f7bc8ff9700 1 -- 172.21.15.103:0/3351975740 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f7bbc03c8d0 con 0x7f7bcc0b78c0 2020-04-22T14:03:33.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.548+0000 7f7bd20b4700 1 -- 172.21.15.103:0/3351975740 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f7bcc056c90 con 0x7f7bcc0b78c0 2020-04-22T14:03:33.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.552+0000 7f7bcb7fe700 1 --2- 172.21.15.103:0/3351975740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bcc0b78c0 0x7f7bcc1402c0 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f7bbc002f30 tx=0x7f7bbc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:33.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.552+0000 7f7bc8ff9700 1 -- 172.21.15.103:0/3351975740 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 updated v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7bbc03fef0 con 0x7f7bcc0b78c0 2020-04-22T14:03:33.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.553+0000 7f7bd20b4700 1 -- 172.21.15.103:0/3351975740 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7bac04d890 msgr2=0x7f7bac04fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:33.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.553+0000 7f7bd20b4700 1 --2- 172.21.15.103:0/3351975740 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7bac04d890 0x7f7bac04fd50 secure :-1 s=READY pgs=146 cs=0 l=1 rx=0x7f7bc00013e0 tx=0x7f7bcc0ae690).stop 2020-04-22T14:03:33.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.553+0000 7f7bd20b4700 1 -- 172.21.15.103:0/3351975740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bcc0b78c0 msgr2=0x7f7bcc1402c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:33.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.553+0000 7f7bd20b4700 1 --2- 172.21.15.103:0/3351975740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bcc0b78c0 0x7f7bcc1402c0 secure :-1 s=READY pgs=350 cs=0 l=1 rx=0x7f7bbc002f30 tx=0x7f7bbc010ba0).stop 2020-04-22T14:03:33.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.554+0000 7f7bd20b4700 1 -- 172.21.15.103:0/3351975740 shutdown_connections 2020-04-22T14:03:33.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.554+0000 7f7bd20b4700 1 --2- 172.21.15.103:0/3351975740 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7bac04d890 0x7f7bac04fd50 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:33.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.554+0000 7f7bd20b4700 1 --2- 172.21.15.103:0/3351975740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bcc0b78c0 0x7f7bcc1402c0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:33.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.554+0000 7f7bd20b4700 1 --2- 172.21.15.103:0/3351975740 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7bcc13c1e0 0x7f7bcc1419b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:33.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.554+0000 7f7bd20b4700 1 -- 172.21.15.103:0/3351975740 >> 172.21.15.103:0/3351975740 conn(0x7f7bcc0b86b0 msgr2=0x7f7bcc05fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:33.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.554+0000 7f7bd20b4700 1 -- 172.21.15.103:0/3351975740 shutdown_connections 2020-04-22T14:03:33.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.554+0000 7f7bd20b4700 1 -- 172.21.15.103:0/3351975740 wait complete. 2020-04-22T14:03:33.559 INFO:teuthology.orchestra.run.smithi103.stderr:updated 2020-04-22T14:03:33.567 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:33.594 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth del client.bootstrap-mgr 2020-04-22T14:03:33.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.750+0000 7f4d86b51700 1 Processor -- start 2020-04-22T14:03:33.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.750+0000 7f4d86b51700 1 -- start start 2020-04-22T14:03:33.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.751+0000 7f4d86b51700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4d800b86a0 0x7f4d8005b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:33.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.751+0000 7f4d86b51700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4d80143a50 0x7f4d80143f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:33.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.751+0000 7f4d86b51700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d8014ab90 con 0x7f4d8005b0b0 2020-04-22T14:03:33.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.751+0000 7f4d86b51700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d80146830 con 0x7f4d800b86a0 2020-04-22T14:03:33.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.751+0000 7f4d86b51700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d80146a20 con 0x7f4d80143a50 2020-04-22T14:03:33.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.751+0000 7f4d850ee700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4d80143a50 0x7f4d80143f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:33.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.751+0000 7f4d848ed700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f4d8005b0b0 0x7f4d8005f800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40668/0 (socket says 172.21.15.103:40668) 2020-04-22T14:03:33.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.751+0000 7f4d848ed700 1 -- 172.21.15.103:0/3342892028 learned_addr learned my addr 172.21.15.103:0/3342892028 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:33.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.751+0000 7f4d7ffff700 1 --2- 172.21.15.103:0/3342892028 >> v2:172.21.15.86:3300/0 conn(0x7f4d800b86a0 0x7f4d8005b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:33.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.751+0000 7f4d850ee700 1 -- 172.21.15.103:0/3342892028 >> v2:172.21.15.86:3300/0 conn(0x7f4d800b86a0 msgr2=0x7f4d8005b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:33.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.751+0000 7f4d850ee700 1 --2- 172.21.15.103:0/3342892028 >> v2:172.21.15.86:3300/0 conn(0x7f4d800b86a0 0x7f4d8005b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:33.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.751+0000 7f4d850ee700 1 -- 172.21.15.103:0/3342892028 >> v1:172.21.15.103:6789/0 conn(0x7f4d8005b0b0 legacy=0x7f4d8005f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:33.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.751+0000 7f4d850ee700 1 -- 172.21.15.103:0/3342892028 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8005ff10 con 0x7f4d80143a50 2020-04-22T14:03:33.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.751+0000 7f4d7ffff700 1 --2- 172.21.15.103:0/3342892028 >> v2:172.21.15.86:3300/0 conn(0x7f4d800b86a0 0x7f4d8005b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:03:33.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.751+0000 7f4d850ee700 1 --2- 172.21.15.103:0/3342892028 >> v2:172.21.15.103:3300/0 conn(0x7f4d80143a50 0x7f4d80143f00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4d80060ab0 tx=0x7f4d78007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:33.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.751+0000 7f4d850ee700 1 --2- 172.21.15.103:0/3342892028 >> v2:172.21.15.103:3300/0 conn(0x7f4d80143a50 0x7f4d80143f00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4d80060ab0 tx=0x7f4d78007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:33.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.751+0000 7f4d850ee700 1 --2- 172.21.15.103:0/3342892028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d80143a50 0x7f4d80143f00 secure :-1 s=READY pgs=352 cs=0 l=1 rx=0x7f4d80060ab0 tx=0x7f4d78007dc0).ready entity=mon.1 client_cookie=7fc760a376176513 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:33.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.751+0000 7f4d850ee700 1 --2- 172.21.15.103:0/3342892028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d80143a50 0x7f4d80143f00 secure :-1 s=THROTTLE_DONE pgs=352 cs=0 l=1 rx=0x7f4d80060ab0 tx=0x7f4d78007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:33.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.752+0000 7f4d7f7fe700 1 -- 172.21.15.103:0/3342892028 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d78011e90 con 0x7f4d80143a50 2020-04-22T14:03:33.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.752+0000 7f4d850ee700 1 --2- 172.21.15.103:0/3342892028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d80143a50 0x7f4d80143f00 secure :-1 s=THROTTLE_DONE pgs=352 cs=0 l=1 rx=0x7f4d80060ab0 tx=0x7f4d78007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:33.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.752+0000 7f4d850ee700 1 --2- 172.21.15.103:0/3342892028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d80143a50 0x7f4d80143f00 secure :-1 s=THROTTLE_DONE pgs=352 cs=0 l=1 rx=0x7f4d80060ab0 tx=0x7f4d78007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:33.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.752+0000 7f4d7f7fe700 1 -- 172.21.15.103:0/3342892028 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7800a180 con 0x7f4d80143a50 2020-04-22T14:03:33.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.752+0000 7f4d7f7fe700 1 -- 172.21.15.103:0/3342892028 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d7800a5a0 con 0x7f4d80143a50 2020-04-22T14:03:33.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.752+0000 7f4d86b51700 1 -- 172.21.15.103:0/3342892028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d80143a50 msgr2=0x7f4d80143f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:33.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.752+0000 7f4d86b51700 1 --2- 172.21.15.103:0/3342892028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d80143a50 0x7f4d80143f00 secure :-1 s=READY pgs=352 cs=0 l=1 rx=0x7f4d80060ab0 tx=0x7f4d78007dc0).stop 2020-04-22T14:03:33.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.752+0000 7f4d86b51700 1 -- 172.21.15.103:0/3342892028 shutdown_connections 2020-04-22T14:03:33.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.752+0000 7f4d86b51700 1 --2- 172.21.15.103:0/3342892028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d80143a50 0x7f4d80143f00 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:33.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.752+0000 7f4d86b51700 1 --2- 172.21.15.103:0/3342892028 >> v2:172.21.15.86:3300/0 conn(0x7f4d800b86a0 0x7f4d8005b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:33.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.752+0000 7f4d86b51700 1 -- 172.21.15.103:0/3342892028 >> 172.21.15.103:0/3342892028 conn(0x7f4d800bcae0 msgr2=0x7f4d800bcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:33.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.752+0000 7f4d86b51700 1 -- 172.21.15.103:0/3342892028 shutdown_connections 2020-04-22T14:03:33.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.752+0000 7f4d86b51700 1 -- 172.21.15.103:0/3342892028 wait complete. 2020-04-22T14:03:33.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.753+0000 7f4d86b51700 1 Processor -- start 2020-04-22T14:03:33.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.753+0000 7f4d86b51700 1 -- start start 2020-04-22T14:03:33.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.754+0000 7f4d86b51700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d8005b0b0 0x7f4d800ae530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:33.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.754+0000 7f4d86b51700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4d800b86a0 0x7f4d800b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:33.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.754+0000 7f4d86b51700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4d80143a50 0x7f4d800b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:33.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.754+0000 7f4d86b51700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d800b10e0 con 0x7f4d80143a50 2020-04-22T14:03:33.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.754+0000 7f4d86b51700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d800b0ba0 con 0x7f4d800b86a0 2020-04-22T14:03:33.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.754+0000 7f4d86b51700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d800b0e40 con 0x7f4d8005b0b0 2020-04-22T14:03:33.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.754+0000 7f4d7ffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4d800b86a0 0x7f4d800b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:33.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.754+0000 7f4d7ffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4d800b86a0 0x7f4d800b0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48482/0 (socket says 172.21.15.103:48482) 2020-04-22T14:03:33.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.754+0000 7f4d7ffff700 1 -- 172.21.15.103:0/2218949870 learned_addr learned my addr 172.21.15.103:0/2218949870 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:33.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.754+0000 7f4d850ee700 1 --2- 172.21.15.103:0/2218949870 >> v2:172.21.15.86:3300/0 conn(0x7f4d80143a50 0x7f4d800b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:33.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.754+0000 7f4d848ed700 1 --2- 172.21.15.103:0/2218949870 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d8005b0b0 0x7f4d800ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:33.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.754+0000 7f4d7ffff700 1 -- 172.21.15.103:0/2218949870 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d8005b0b0 msgr2=0x7f4d800ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:33.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.754+0000 7f4d7ffff700 1 --2- 172.21.15.103:0/2218949870 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d8005b0b0 0x7f4d800ae530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:33.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.754+0000 7f4d7ffff700 1 -- 172.21.15.103:0/2218949870 >> v2:172.21.15.86:3300/0 conn(0x7f4d80143a50 msgr2=0x7f4d800b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:33.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.754+0000 7f4d7ffff700 1 --2- 172.21.15.103:0/2218949870 >> v2:172.21.15.86:3300/0 conn(0x7f4d80143a50 0x7f4d800b12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:33.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.754+0000 7f4d7ffff700 1 -- 172.21.15.103:0/2218949870 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d800b07a0 con 0x7f4d800b86a0 2020-04-22T14:03:33.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.754+0000 7f4d850ee700 1 --2- 172.21.15.103:0/2218949870 >> v2:172.21.15.86:3300/0 conn(0x7f4d80143a50 0x7f4d800b12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:03:33.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.754+0000 7f4d848ed700 1 --2- 172.21.15.103:0/2218949870 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d8005b0b0 0x7f4d800ae530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:03:33.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.754+0000 7f4d7ffff700 1 --2- 172.21.15.103:0/2218949870 >> v2:172.21.15.103:3300/0 conn(0x7f4d800b86a0 0x7f4d800b0340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4d74002f30 tx=0x7f4d74010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:33.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.754+0000 7f4d7ffff700 1 --2- 172.21.15.103:0/2218949870 >> v2:172.21.15.103:3300/0 conn(0x7f4d800b86a0 0x7f4d800b0340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4d74002f30 tx=0x7f4d74010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:33.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.754+0000 7f4d7ffff700 1 --2- 172.21.15.103:0/2218949870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d800b86a0 0x7f4d800b0340 secure :-1 s=READY pgs=353 cs=0 l=1 rx=0x7f4d74002f30 tx=0x7f4d74010b70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:33.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.754+0000 7f4d7ffff700 1 --2- 172.21.15.103:0/2218949870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d800b86a0 0x7f4d800b0340 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7f4d74002f30 tx=0x7f4d74010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:33.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.754+0000 7f4d7dffb700 1 -- 172.21.15.103:0/2218949870 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d74008e80 con 0x7f4d800b86a0 2020-04-22T14:03:33.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.754+0000 7f4d7ffff700 1 --2- 172.21.15.103:0/2218949870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d800b86a0 0x7f4d800b0340 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7f4d74002f30 tx=0x7f4d74010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:33.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.754+0000 7f4d7ffff700 1 --2- 172.21.15.103:0/2218949870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d800b86a0 0x7f4d800b0340 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7f4d74002f30 tx=0x7f4d74010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:33.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.755+0000 7f4d7dffb700 1 -- 172.21.15.103:0/2218949870 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d74007180 con 0x7f4d800b86a0 2020-04-22T14:03:33.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.755+0000 7f4d86b51700 1 -- 172.21.15.103:0/2218949870 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d800b1720 con 0x7f4d800b86a0 2020-04-22T14:03:33.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.755+0000 7f4d7dffb700 1 -- 172.21.15.103:0/2218949870 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d74007560 con 0x7f4d800b86a0 2020-04-22T14:03:33.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.755+0000 7f4d86b51700 1 -- 172.21.15.103:0/2218949870 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d800b3130 con 0x7f4d800b86a0 2020-04-22T14:03:33.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.755+0000 7f4d7ffff700 1 --2- 172.21.15.103:0/2218949870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d800b86a0 0x7f4d800b0340 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7f4d74002f30 tx=0x7f4d74010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:33.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.755+0000 7f4d86b51700 1 -- 172.21.15.103:0/2218949870 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d800b09f0 con 0x7f4d800b86a0 2020-04-22T14:03:33.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.756+0000 7f4d7dffb700 1 -- 172.21.15.103:0/2218949870 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f4d740059c0 con 0x7f4d800b86a0 2020-04-22T14:03:33.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.756+0000 7f4d7ffff700 1 --2- 172.21.15.103:0/2218949870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d800b86a0 0x7f4d800b0340 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7f4d74002f30 tx=0x7f4d74010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:33.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.756+0000 7f4d7dffb700 1 --2- 172.21.15.103:0/2218949870 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4d6004d9d0 0x7f4d6004fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:33.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.756+0000 7f4d7dffb700 1 -- 172.21.15.103:0/2218949870 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f4d74061320 con 0x7f4d800b86a0 2020-04-22T14:03:33.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.756+0000 7f4d848ed700 1 --2- 172.21.15.103:0/2218949870 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4d6004d9d0 0x7f4d6004fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:33.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.756+0000 7f4d848ed700 1 --2- 172.21.15.103:0/2218949870 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4d6004d9d0 0x7f4d6004fe90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4d80146da0 tx=0x7f4d700016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:33.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.756+0000 7f4d848ed700 1 --2- 172.21.15.103:0/2218949870 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4d6004d9d0 0x7f4d6004fe90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4d80146da0 tx=0x7f4d700016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:33.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.756+0000 7f4d848ed700 1 --2- 172.21.15.103:0/2218949870 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4d6004d9d0 0x7f4d6004fe90 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7f4d80146da0 tx=0x7f4d700016e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:33.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.760+0000 7f4d7ffff700 1 --2- 172.21.15.103:0/2218949870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d800b86a0 0x7f4d800b0340 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7f4d74002f30 tx=0x7f4d74010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:33.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.760+0000 7f4d7dffb700 1 -- 172.21.15.103:0/2218949870 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f4d7403c760 con 0x7f4d800b86a0 2020-04-22T14:03:33.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.953+0000 7f4d86b51700 1 -- 172.21.15.103:0/2218949870 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f4d80056c90 con 0x7f4d800b86a0 2020-04-22T14:03:33.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.959+0000 7f4d7ffff700 1 --2- 172.21.15.103:0/2218949870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d800b86a0 0x7f4d800b0340 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7f4d74002f30 tx=0x7f4d74010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:33.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.959+0000 7f4d7dffb700 1 -- 172.21.15.103:0/2218949870 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 updated v8) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4d7403fd80 con 0x7f4d800b86a0 2020-04-22T14:03:33.965 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.961+0000 7f4d86b51700 1 -- 172.21.15.103:0/2218949870 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4d6004d9d0 msgr2=0x7f4d6004fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:33.965 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.961+0000 7f4d86b51700 1 --2- 172.21.15.103:0/2218949870 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4d6004d9d0 0x7f4d6004fe90 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7f4d80146da0 tx=0x7f4d700016e0).stop 2020-04-22T14:03:33.965 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.961+0000 7f4d86b51700 1 -- 172.21.15.103:0/2218949870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d800b86a0 msgr2=0x7f4d800b0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:33.965 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.961+0000 7f4d86b51700 1 --2- 172.21.15.103:0/2218949870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d800b86a0 0x7f4d800b0340 secure :-1 s=READY pgs=353 cs=0 l=1 rx=0x7f4d74002f30 tx=0x7f4d74010b70).stop 2020-04-22T14:03:33.965 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.961+0000 7f4d86b51700 1 -- 172.21.15.103:0/2218949870 shutdown_connections 2020-04-22T14:03:33.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.961+0000 7f4d86b51700 1 --2- 172.21.15.103:0/2218949870 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4d6004d9d0 0x7f4d6004fe90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:33.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.961+0000 7f4d86b51700 1 --2- 172.21.15.103:0/2218949870 >> v2:172.21.15.86:3300/0 conn(0x7f4d80143a50 0x7f4d800b12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:33.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.961+0000 7f4d86b51700 1 --2- 172.21.15.103:0/2218949870 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d8005b0b0 0x7f4d800ae530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:33.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.961+0000 7f4d86b51700 1 --2- 172.21.15.103:0/2218949870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d800b86a0 0x7f4d800b0340 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:33.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.961+0000 7f4d86b51700 1 -- 172.21.15.103:0/2218949870 >> 172.21.15.103:0/2218949870 conn(0x7f4d800bcae0 msgr2=0x7f4d80148670 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:33.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.961+0000 7f4d86b51700 1 -- 172.21.15.103:0/2218949870 shutdown_connections 2020-04-22T14:03:33.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:33.961+0000 7f4d86b51700 1 -- 172.21.15.103:0/2218949870 wait complete. 2020-04-22T14:03:33.967 INFO:teuthology.orchestra.run.smithi103.stderr:updated 2020-04-22T14:03:33.974 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:33.991 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth del client.bootstrap-osd 2020-04-22T14:03:34.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.135+0000 7f02b6b8b700 1 Processor -- start 2020-04-22T14:03:34.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.135+0000 7f02b6b8b700 1 -- start start 2020-04-22T14:03:34.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.136+0000 7f02b6b8b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f02b00bcc00 0x7f02b005fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:34.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.136+0000 7f02b6b8b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f02b014a460 0x7f02b0146d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:34.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.136+0000 7f02b6b8b700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02b014a930 con 0x7f02b01471d0 2020-04-22T14:03:34.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.136+0000 7f02b6b8b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b0146630 con 0x7f02b014a460 2020-04-22T14:03:34.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.136+0000 7f02b6b8b700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b01468d0 con 0x7f02b00bcc00 2020-04-22T14:03:34.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.136+0000 7f02b5b89700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f02b00bcc00 0x7f02b005fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:34.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.136+0000 7f02b638a700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f02b01471d0 0x7f02b0143640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40684/0 (socket says 172.21.15.103:40684) 2020-04-22T14:03:34.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.136+0000 7f02b638a700 1 -- 172.21.15.103:0/2545935801 learned_addr learned my addr 172.21.15.103:0/2545935801 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:34.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.136+0000 7f02b5388700 1 --2- 172.21.15.103:0/2545935801 >> v2:172.21.15.86:3300/0 conn(0x7f02b014a460 0x7f02b0146d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:34.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.136+0000 7f02b5b89700 1 -- 172.21.15.103:0/2545935801 >> v2:172.21.15.86:3300/0 conn(0x7f02b014a460 msgr2=0x7f02b0146d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:34.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.136+0000 7f02b5b89700 1 --2- 172.21.15.103:0/2545935801 >> v2:172.21.15.86:3300/0 conn(0x7f02b014a460 0x7f02b0146d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:34.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.136+0000 7f02b5b89700 1 -- 172.21.15.103:0/2545935801 >> v1:172.21.15.103:6789/0 conn(0x7f02b01471d0 legacy=0x7f02b0143640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:34.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.136+0000 7f02b4b87700 1 -- 172.21.15.103:0/2545935801 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3645097861 0 0) 0x7f02b014a930 con 0x7f02b01471d0 2020-04-22T14:03:34.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.136+0000 7f02b5b89700 1 -- 172.21.15.103:0/2545935801 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b00bcfe0 con 0x7f02b00bcc00 2020-04-22T14:03:34.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.136+0000 7f02b5b89700 1 --2- 172.21.15.103:0/2545935801 >> v2:172.21.15.103:3300/0 conn(0x7f02b00bcc00 0x7f02b005fdf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f02a80032b0 tx=0x7f02a8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.136+0000 7f02b5b89700 1 --2- 172.21.15.103:0/2545935801 >> v2:172.21.15.103:3300/0 conn(0x7f02b00bcc00 0x7f02b005fdf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f02a80032b0 tx=0x7f02a8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.136+0000 7f02b5b89700 1 --2- 172.21.15.103:0/2545935801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02b00bcc00 0x7f02b005fdf0 secure :-1 s=READY pgs=355 cs=0 l=1 rx=0x7f02a80032b0 tx=0x7f02a8007dc0).ready entity=mon.1 client_cookie=b1d4d169ceb08a3e server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:34.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.136+0000 7f02b5b89700 1 --2- 172.21.15.103:0/2545935801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02b00bcc00 0x7f02b005fdf0 secure :-1 s=THROTTLE_DONE pgs=355 cs=0 l=1 rx=0x7f02a80032b0 tx=0x7f02a8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.136+0000 7f02b4b87700 1 -- 172.21.15.103:0/2545935801 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02a8011e20 con 0x7f02b00bcc00 2020-04-22T14:03:34.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.136+0000 7f02b5b89700 1 --2- 172.21.15.103:0/2545935801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02b00bcc00 0x7f02b005fdf0 secure :-1 s=THROTTLE_DONE pgs=355 cs=0 l=1 rx=0x7f02a80032b0 tx=0x7f02a8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.136+0000 7f02b4b87700 1 -- 172.21.15.103:0/2545935801 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a800a180 con 0x7f02b00bcc00 2020-04-22T14:03:34.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.136+0000 7f02b5b89700 1 --2- 172.21.15.103:0/2545935801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02b00bcc00 0x7f02b005fdf0 secure :-1 s=THROTTLE_DONE pgs=355 cs=0 l=1 rx=0x7f02a80032b0 tx=0x7f02a8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.136+0000 7f02b4b87700 1 -- 172.21.15.103:0/2545935801 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02a800a560 con 0x7f02b00bcc00 2020-04-22T14:03:34.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.136+0000 7f02b6b8b700 1 -- 172.21.15.103:0/2545935801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02b00bcc00 msgr2=0x7f02b005fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:34.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.136+0000 7f02b6b8b700 1 --2- 172.21.15.103:0/2545935801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02b00bcc00 0x7f02b005fdf0 secure :-1 s=READY pgs=355 cs=0 l=1 rx=0x7f02a80032b0 tx=0x7f02a8007dc0).stop 2020-04-22T14:03:34.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.137+0000 7f02b6b8b700 1 -- 172.21.15.103:0/2545935801 shutdown_connections 2020-04-22T14:03:34.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.137+0000 7f02b6b8b700 1 --2- 172.21.15.103:0/2545935801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02b00bcc00 0x7f02b005fdf0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:34.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.137+0000 7f02b6b8b700 1 --2- 172.21.15.103:0/2545935801 >> v2:172.21.15.86:3300/0 conn(0x7f02b014a460 0x7f02b0146d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:34.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.137+0000 7f02b6b8b700 1 -- 172.21.15.103:0/2545935801 >> 172.21.15.103:0/2545935801 conn(0x7f02b0069f30 msgr2=0x7f02b00658e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:34.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.137+0000 7f02b6b8b700 1 -- 172.21.15.103:0/2545935801 shutdown_connections 2020-04-22T14:03:34.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.137+0000 7f02b6b8b700 1 -- 172.21.15.103:0/2545935801 wait complete. 2020-04-22T14:03:34.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.138+0000 7f02b6b8b700 1 Processor -- start 2020-04-22T14:03:34.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.138+0000 7f02b6b8b700 1 -- start start 2020-04-22T14:03:34.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.139+0000 7f02b6b8b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f02b00bcc00 0x7f02b00ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:34.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.139+0000 7f02b6b8b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f02b012d380 0x7f02b012e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:34.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.139+0000 7f02b6b8b700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02b012e610 con 0x7f02b014a460 2020-04-22T14:03:34.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.139+0000 7f02b6b8b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b0143790 con 0x7f02b012d380 2020-04-22T14:03:34.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.139+0000 7f02b6b8b700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b0143a30 con 0x7f02b00bcc00 2020-04-22T14:03:34.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.139+0000 7f02b5b89700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f02b00bcc00 0x7f02b00ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:34.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.139+0000 7f02b5b89700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f02b00bcc00 0x7f02b00ad5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48496/0 (socket says 172.21.15.103:48496) 2020-04-22T14:03:34.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.139+0000 7f02b5b89700 1 -- 172.21.15.103:0/2428599552 learned_addr learned my addr 172.21.15.103:0/2428599552 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:34.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.139+0000 7f02b5388700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f02b014a460 0x7f02b012cc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40688/0 (socket says 172.21.15.103:40688) 2020-04-22T14:03:34.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.139+0000 7f02b638a700 1 --2- 172.21.15.103:0/2428599552 >> v2:172.21.15.86:3300/0 conn(0x7f02b012d380 0x7f02b012e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:34.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.139+0000 7f02b5b89700 1 -- 172.21.15.103:0/2428599552 >> v2:172.21.15.86:3300/0 conn(0x7f02b012d380 msgr2=0x7f02b012e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:34.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.139+0000 7f02b5b89700 1 --2- 172.21.15.103:0/2428599552 >> v2:172.21.15.86:3300/0 conn(0x7f02b012d380 0x7f02b012e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:34.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.139+0000 7f02b5b89700 1 -- 172.21.15.103:0/2428599552 >> v1:172.21.15.103:6789/0 conn(0x7f02b014a460 legacy=0x7f02b012cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:34.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.139+0000 7f02a2ffd700 1 -- 172.21.15.103:0/2428599552 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2084334525 0 0) 0x7f02a4001ec0 con 0x7f02b014a460 2020-04-22T14:03:34.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.139+0000 7f02b5b89700 1 -- 172.21.15.103:0/2428599552 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b0143cd0 con 0x7f02b00bcc00 2020-04-22T14:03:34.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.139+0000 7f02b5b89700 1 --2- 172.21.15.103:0/2428599552 >> v2:172.21.15.103:3300/0 conn(0x7f02b00bcc00 0x7f02b00ad5f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f02b0145720 tx=0x7f02a8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.139+0000 7f02b5b89700 1 --2- 172.21.15.103:0/2428599552 >> v2:172.21.15.103:3300/0 conn(0x7f02b00bcc00 0x7f02b00ad5f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f02b0145720 tx=0x7f02a8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.139+0000 7f02b5b89700 1 --2- 172.21.15.103:0/2428599552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02b00bcc00 0x7f02b00ad5f0 secure :-1 s=READY pgs=357 cs=0 l=1 rx=0x7f02b0145720 tx=0x7f02a8007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:34.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.139+0000 7f02b5b89700 1 --2- 172.21.15.103:0/2428599552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02b00bcc00 0x7f02b00ad5f0 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7f02b0145720 tx=0x7f02a8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.139+0000 7f02a2ffd700 1 -- 172.21.15.103:0/2428599552 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02a8005c30 con 0x7f02b00bcc00 2020-04-22T14:03:34.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.139+0000 7f02b5b89700 1 --2- 172.21.15.103:0/2428599552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02b00bcc00 0x7f02b00ad5f0 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7f02b0145720 tx=0x7f02a8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.139+0000 7f02a2ffd700 1 -- 172.21.15.103:0/2428599552 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a8005d90 con 0x7f02b00bcc00 2020-04-22T14:03:34.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.139+0000 7f02b5b89700 1 --2- 172.21.15.103:0/2428599552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02b00bcc00 0x7f02b00ad5f0 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7f02b0145720 tx=0x7f02a8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.139+0000 7f02b6b8b700 1 -- 172.21.15.103:0/2428599552 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02b0153ba0 con 0x7f02b00bcc00 2020-04-22T14:03:34.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.139+0000 7f02a2ffd700 1 -- 172.21.15.103:0/2428599552 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02a800f7a0 con 0x7f02b00bcc00 2020-04-22T14:03:34.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.139+0000 7f02b6b8b700 1 -- 172.21.15.103:0/2428599552 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02b0148a50 con 0x7f02b00bcc00 2020-04-22T14:03:34.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.140+0000 7f02b5b89700 1 --2- 172.21.15.103:0/2428599552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02b00bcc00 0x7f02b00ad5f0 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7f02b0145720 tx=0x7f02a8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.162 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.140+0000 7f02a2ffd700 1 -- 172.21.15.103:0/2428599552 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f02a800f9a0 con 0x7f02b00bcc00 2020-04-22T14:03:34.162 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.140+0000 7f02b5b89700 1 --2- 172.21.15.103:0/2428599552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02b00bcc00 0x7f02b00ad5f0 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7f02b0145720 tx=0x7f02a8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.162 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.140+0000 7f02b6b8b700 1 -- 172.21.15.103:0/2428599552 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02b0056c90 con 0x7f02b00bcc00 2020-04-22T14:03:34.162 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.141+0000 7f02a2ffd700 1 --2- 172.21.15.103:0/2428599552 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f029004d870 0x7f029004fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:34.162 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.141+0000 7f02a2ffd700 1 -- 172.21.15.103:0/2428599552 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f02a8062540 con 0x7f02b00bcc00 2020-04-22T14:03:34.162 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.141+0000 7f02b5388700 1 --2- 172.21.15.103:0/2428599552 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f029004d870 0x7f029004fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:34.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.141+0000 7f02b5388700 1 --2- 172.21.15.103:0/2428599552 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f029004d870 0x7f029004fd30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f02a4003070 tx=0x7f02a4002100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.141+0000 7f02b5388700 1 --2- 172.21.15.103:0/2428599552 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f029004d870 0x7f029004fd30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f02a4003070 tx=0x7f02a4002100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.141+0000 7f02b5388700 1 --2- 172.21.15.103:0/2428599552 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f029004d870 0x7f029004fd30 secure :-1 s=READY pgs=148 cs=0 l=1 rx=0x7f02a4003070 tx=0x7f02a4002100).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:34.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.145+0000 7f02b5b89700 1 --2- 172.21.15.103:0/2428599552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02b00bcc00 0x7f02b00ad5f0 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7f02b0145720 tx=0x7f02a8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.145+0000 7f02a2ffd700 1 -- 172.21.15.103:0/2428599552 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f02a803da40 con 0x7f02b00bcc00 2020-04-22T14:03:34.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.336+0000 7f02b6b8b700 1 -- 172.21.15.103:0/2428599552 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f02b00b7a80 con 0x7f02b00bcc00 2020-04-22T14:03:34.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.343+0000 7f02b5b89700 1 --2- 172.21.15.103:0/2428599552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02b00bcc00 0x7f02b00ad5f0 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7f02b0145720 tx=0x7f02a8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.343+0000 7f02a2ffd700 1 -- 172.21.15.103:0/2428599552 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 updated v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f02a8041060 con 0x7f02b00bcc00 2020-04-22T14:03:34.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.344+0000 7f02b6b8b700 1 -- 172.21.15.103:0/2428599552 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f029004d870 msgr2=0x7f029004fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:34.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.344+0000 7f02b6b8b700 1 --2- 172.21.15.103:0/2428599552 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f029004d870 0x7f029004fd30 secure :-1 s=READY pgs=148 cs=0 l=1 rx=0x7f02a4003070 tx=0x7f02a4002100).stop 2020-04-22T14:03:34.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.344+0000 7f02b6b8b700 1 -- 172.21.15.103:0/2428599552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02b00bcc00 msgr2=0x7f02b00ad5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:34.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.344+0000 7f02b6b8b700 1 --2- 172.21.15.103:0/2428599552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02b00bcc00 0x7f02b00ad5f0 secure :-1 s=READY pgs=357 cs=0 l=1 rx=0x7f02b0145720 tx=0x7f02a8007dc0).stop 2020-04-22T14:03:34.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.344+0000 7f02b6b8b700 1 -- 172.21.15.103:0/2428599552 shutdown_connections 2020-04-22T14:03:34.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.344+0000 7f02b6b8b700 1 --2- 172.21.15.103:0/2428599552 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f029004d870 0x7f029004fd30 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:34.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.344+0000 7f02b6b8b700 1 --2- 172.21.15.103:0/2428599552 >> v2:172.21.15.86:3300/0 conn(0x7f02b012d380 0x7f02b012e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:34.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.344+0000 7f02b6b8b700 1 --2- 172.21.15.103:0/2428599552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02b00bcc00 0x7f02b00ad5f0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:34.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.344+0000 7f02b6b8b700 1 -- 172.21.15.103:0/2428599552 >> 172.21.15.103:0/2428599552 conn(0x7f02b0069f30 msgr2=0x7f02b012f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:34.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.344+0000 7f02b6b8b700 1 -- 172.21.15.103:0/2428599552 shutdown_connections 2020-04-22T14:03:34.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.344+0000 7f02b6b8b700 1 -- 172.21.15.103:0/2428599552 wait complete. 2020-04-22T14:03:34.349 INFO:teuthology.orchestra.run.smithi103.stderr:updated 2020-04-22T14:03:34.357 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:34.371 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth del client.bootstrap-rbd 2020-04-22T14:03:34.517 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.514+0000 7f935142e700 1 Processor -- start 2020-04-22T14:03:34.517 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.514+0000 7f935142e700 1 -- start start 2020-04-22T14:03:34.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.515+0000 7f935142e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f934c05b0b0 0x7f934c0b86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:34.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.515+0000 7f935142e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f934c05b490 0x7f934c05f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:34.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.515+0000 7f935142e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f934c05b920 con 0x7f934c05fc60 2020-04-22T14:03:34.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.515+0000 7f935142e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f934c146830 con 0x7f934c05b0b0 2020-04-22T14:03:34.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.515+0000 7f935142e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f934c14ab90 con 0x7f934c05b490 2020-04-22T14:03:34.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.515+0000 7f934a7fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f934c05b490 0x7f934c05f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:34.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.515+0000 7f934a7fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f934c05b490 0x7f934c05f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48504/0 (socket says 172.21.15.103:48504) 2020-04-22T14:03:34.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.515+0000 7f934a7fc700 1 -- 172.21.15.103:0/1325662980 learned_addr learned my addr 172.21.15.103:0/1325662980 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:34.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.515+0000 7f934affd700 1 --2- 172.21.15.103:0/1325662980 >> v2:172.21.15.86:3300/0 conn(0x7f934c05b0b0 0x7f934c0b86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:34.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.516+0000 7f934a7fc700 1 -- 172.21.15.103:0/1325662980 >> v2:172.21.15.86:3300/0 conn(0x7f934c05b0b0 msgr2=0x7f934c0b86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:34.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.516+0000 7f934a7fc700 1 --2- 172.21.15.103:0/1325662980 >> v2:172.21.15.86:3300/0 conn(0x7f934c05b0b0 0x7f934c0b86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:34.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.516+0000 7f934a7fc700 1 -- 172.21.15.103:0/1325662980 >> v1:172.21.15.86:6789/0 conn(0x7f934c05fc60 legacy=0x7f934c143a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:34.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.516+0000 7f934a7fc700 1 -- 172.21.15.103:0/1325662980 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934c146a20 con 0x7f934c05b490 2020-04-22T14:03:34.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.516+0000 7f934a7fc700 1 --2- 172.21.15.103:0/1325662980 >> v2:172.21.15.103:3300/0 conn(0x7f934c05b490 0x7f934c05f800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f934c060ab0 tx=0x7f9334007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.516+0000 7f934a7fc700 1 --2- 172.21.15.103:0/1325662980 >> v2:172.21.15.103:3300/0 conn(0x7f934c05b490 0x7f934c05f800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f934c060ab0 tx=0x7f9334007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.516+0000 7f934a7fc700 1 --2- 172.21.15.103:0/1325662980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f934c05b490 0x7f934c05f800 secure :-1 s=READY pgs=358 cs=0 l=1 rx=0x7f934c060ab0 tx=0x7f9334007a40).ready entity=mon.1 client_cookie=81ba1c0bbc284e6f server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:34.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.516+0000 7f934a7fc700 1 --2- 172.21.15.103:0/1325662980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f934c05b490 0x7f934c05f800 secure :-1 s=THROTTLE_DONE pgs=358 cs=0 l=1 rx=0x7f934c060ab0 tx=0x7f9334007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.516+0000 7f934a7fc700 1 --2- 172.21.15.103:0/1325662980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f934c05b490 0x7f934c05f800 secure :-1 s=THROTTLE_DONE pgs=358 cs=0 l=1 rx=0x7f934c060ab0 tx=0x7f9334007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.516+0000 7f9349ffb700 1 -- 172.21.15.103:0/1325662980 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9334011630 con 0x7f934c05b490 2020-04-22T14:03:34.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.516+0000 7f934a7fc700 1 --2- 172.21.15.103:0/1325662980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f934c05b490 0x7f934c05f800 secure :-1 s=THROTTLE_DONE pgs=358 cs=0 l=1 rx=0x7f934c060ab0 tx=0x7f9334007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.516+0000 7f9349ffb700 1 -- 172.21.15.103:0/1325662980 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93340117d0 con 0x7f934c05b490 2020-04-22T14:03:34.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.516+0000 7f9349ffb700 1 -- 172.21.15.103:0/1325662980 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9334011bf0 con 0x7f934c05b490 2020-04-22T14:03:34.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.516+0000 7f935142e700 1 -- 172.21.15.103:0/1325662980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f934c05b490 msgr2=0x7f934c05f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:34.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.516+0000 7f935142e700 1 --2- 172.21.15.103:0/1325662980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f934c05b490 0x7f934c05f800 secure :-1 s=READY pgs=358 cs=0 l=1 rx=0x7f934c060ab0 tx=0x7f9334007a40).stop 2020-04-22T14:03:34.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.516+0000 7f935142e700 1 -- 172.21.15.103:0/1325662980 shutdown_connections 2020-04-22T14:03:34.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.516+0000 7f935142e700 1 --2- 172.21.15.103:0/1325662980 >> v2:172.21.15.86:3300/0 conn(0x7f934c05b0b0 0x7f934c0b86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:34.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.516+0000 7f935142e700 1 --2- 172.21.15.103:0/1325662980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f934c05b490 0x7f934c05f800 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:34.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.516+0000 7f935142e700 1 -- 172.21.15.103:0/1325662980 >> 172.21.15.103:0/1325662980 conn(0x7f934c0bcae0 msgr2=0x7f934c0bcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:34.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.516+0000 7f935142e700 1 -- 172.21.15.103:0/1325662980 shutdown_connections 2020-04-22T14:03:34.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.516+0000 7f935142e700 1 -- 172.21.15.103:0/1325662980 wait complete. 2020-04-22T14:03:34.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.517+0000 7f935142e700 1 Processor -- start 2020-04-22T14:03:34.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.517+0000 7f935142e700 1 -- start start 2020-04-22T14:03:34.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.518+0000 7f935142e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f934c05b490 0x7f934c142ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:34.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.518+0000 7f935142e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f934c157530 con 0x7f934c05fc60 2020-04-22T14:03:34.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.518+0000 7f935142e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f934c1577d0 con 0x7f934c05b0b0 2020-04-22T14:03:34.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.518+0000 7f935142e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f934c157a70 con 0x7f934c05b490 2020-04-22T14:03:34.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.518+0000 7f934affd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f934c05b0b0 0x7f934c0bbcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40700/0 (socket says 172.21.15.103:40700) 2020-04-22T14:03:34.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.518+0000 7f934affd700 1 -- 172.21.15.103:0/3845816918 learned_addr learned my addr 172.21.15.103:0/3845816918 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:34.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.518+0000 7f934a7fc700 1 --2- 172.21.15.103:0/3845816918 >> v2:172.21.15.86:3300/0 conn(0x7f934c05b490 0x7f934c142ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:34.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.518+0000 7f9343fff700 1 -- 172.21.15.103:0/3845816918 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4225722779 0 0) 0x7f934c1577d0 con 0x7f934c05b0b0 2020-04-22T14:03:34.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.518+0000 7f9343fff700 1 -- 172.21.15.103:0/3845816918 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9330002fe0 con 0x7f934c05b0b0 2020-04-22T14:03:34.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.519+0000 7f9343fff700 1 -- 172.21.15.103:0/3845816918 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1931623280 0 0) 0x7f9330002fe0 con 0x7f934c05b0b0 2020-04-22T14:03:34.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.519+0000 7f934a7fc700 1 -- 172.21.15.103:0/3845816918 >> v1:172.21.15.103:6789/0 conn(0x7f934c05b0b0 legacy=0x7f934c0bbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:34.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.519+0000 7f934a7fc700 1 -- 172.21.15.103:0/3845816918 >> v1:172.21.15.86:6789/0 conn(0x7f934c05fc60 legacy=0x7f934c0afe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:34.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.519+0000 7f934a7fc700 1 -- 172.21.15.103:0/3845816918 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934c157d10 con 0x7f934c05b490 2020-04-22T14:03:34.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.519+0000 7f934a7fc700 1 --2- 172.21.15.103:0/3845816918 >> v2:172.21.15.86:3300/0 conn(0x7f934c05b490 0x7f934c142ba0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f933c000fe0 tx=0x7f9334007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.519+0000 7f934a7fc700 1 --2- 172.21.15.103:0/3845816918 >> v2:172.21.15.86:3300/0 conn(0x7f934c05b490 0x7f934c142ba0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f933c000fe0 tx=0x7f9334007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.519+0000 7f934a7fc700 1 --2- 172.21.15.103:0/3845816918 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f934c05b490 0x7f934c142ba0 secure :-1 s=READY pgs=220 cs=0 l=1 rx=0x7f933c000fe0 tx=0x7f9334007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:34.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.519+0000 7f934a7fc700 1 --2- 172.21.15.103:0/3845816918 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f934c05b490 0x7f934c142ba0 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7f933c000fe0 tx=0x7f9334007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.519+0000 7f9343fff700 1 -- 172.21.15.103:0/3845816918 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9344001810 con 0x7f934c05b490 2020-04-22T14:03:34.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.519+0000 7f934a7fc700 1 --2- 172.21.15.103:0/3845816918 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f934c05b490 0x7f934c142ba0 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7f933c000fe0 tx=0x7f9334007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.519+0000 7f934a7fc700 1 --2- 172.21.15.103:0/3845816918 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f934c05b490 0x7f934c142ba0 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7f933c000fe0 tx=0x7f9334007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.519+0000 7f9343fff700 1 -- 172.21.15.103:0/3845816918 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9334011b30 con 0x7f934c05b490 2020-04-22T14:03:34.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.519+0000 7f935142e700 1 -- 172.21.15.103:0/3845816918 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f934c0bc3c0 con 0x7f934c05b490 2020-04-22T14:03:34.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.519+0000 7f9343fff700 1 -- 172.21.15.103:0/3845816918 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9334011ca0 con 0x7f934c05b490 2020-04-22T14:03:34.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.519+0000 7f935142e700 1 -- 172.21.15.103:0/3845816918 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f934c1581b0 con 0x7f934c05b490 2020-04-22T14:03:34.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.520+0000 7f934a7fc700 1 --2- 172.21.15.103:0/3845816918 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f934c05b490 0x7f934c142ba0 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7f933c000fe0 tx=0x7f9334007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.520+0000 7f935142e700 1 -- 172.21.15.103:0/3845816918 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f934c056c90 con 0x7f934c05b490 2020-04-22T14:03:34.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.520+0000 7f9343fff700 1 -- 172.21.15.103:0/3845816918 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f9334007360 con 0x7f934c05b490 2020-04-22T14:03:34.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.520+0000 7f934a7fc700 1 --2- 172.21.15.103:0/3845816918 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f934c05b490 0x7f934c142ba0 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7f933c000fe0 tx=0x7f9334007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.520+0000 7f9343fff700 1 --2- 172.21.15.103:0/3845816918 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f933004dc30 0x7f93300500f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:34.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.520+0000 7f9343fff700 1 -- 172.21.15.103:0/3845816918 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f93340614c0 con 0x7f934c05b490 2020-04-22T14:03:34.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.521+0000 7f934affd700 1 --2- 172.21.15.103:0/3845816918 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f933004dc30 0x7f93300500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:34.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.521+0000 7f934affd700 1 --2- 172.21.15.103:0/3845816918 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f933004dc30 0x7f93300500f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9344007e80 tx=0x7f9344001b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.521+0000 7f934affd700 1 --2- 172.21.15.103:0/3845816918 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f933004dc30 0x7f93300500f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9344007e80 tx=0x7f9344001b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.521+0000 7f934affd700 1 --2- 172.21.15.103:0/3845816918 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f933004dc30 0x7f93300500f0 secure :-1 s=READY pgs=149 cs=0 l=1 rx=0x7f9344007e80 tx=0x7f9344001b80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:34.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.524+0000 7f934a7fc700 1 --2- 172.21.15.103:0/3845816918 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f934c05b490 0x7f934c142ba0 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7f933c000fe0 tx=0x7f9334007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.524+0000 7f9343fff700 1 -- 172.21.15.103:0/3845816918 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f933403c960 con 0x7f934c05b490 2020-04-22T14:03:34.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.719+0000 7f935142e700 1 -- 172.21.15.103:0/3845816918 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f934c148650 con 0x7f934c05b490 2020-04-22T14:03:34.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.722+0000 7f934a7fc700 1 --2- 172.21.15.103:0/3845816918 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f934c05b490 0x7f934c142ba0 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7f933c000fe0 tx=0x7f9334007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.722+0000 7f9343fff700 1 -- 172.21.15.103:0/3845816918 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 updated v10) v1 ==== 97+0+0 (secure 0 0 0) 0x7f933403ff80 con 0x7f934c05b490 2020-04-22T14:03:34.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.724+0000 7f935142e700 1 -- 172.21.15.103:0/3845816918 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f933004dc30 msgr2=0x7f93300500f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:34.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.724+0000 7f935142e700 1 --2- 172.21.15.103:0/3845816918 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f933004dc30 0x7f93300500f0 secure :-1 s=READY pgs=149 cs=0 l=1 rx=0x7f9344007e80 tx=0x7f9344001b80).stop 2020-04-22T14:03:34.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.724+0000 7f935142e700 1 -- 172.21.15.103:0/3845816918 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f934c05b490 msgr2=0x7f934c142ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:34.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.724+0000 7f935142e700 1 --2- 172.21.15.103:0/3845816918 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f934c05b490 0x7f934c142ba0 secure :-1 s=READY pgs=220 cs=0 l=1 rx=0x7f933c000fe0 tx=0x7f9334007a40).stop 2020-04-22T14:03:34.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.724+0000 7f935142e700 1 -- 172.21.15.103:0/3845816918 shutdown_connections 2020-04-22T14:03:34.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.724+0000 7f935142e700 1 --2- 172.21.15.103:0/3845816918 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f933004dc30 0x7f93300500f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:34.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.724+0000 7f935142e700 1 --2- 172.21.15.103:0/3845816918 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f934c05b490 0x7f934c142ba0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:34.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.724+0000 7f935142e700 1 -- 172.21.15.103:0/3845816918 >> 172.21.15.103:0/3845816918 conn(0x7f934c0bcae0 msgr2=0x7f934c0ba9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:34.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.724+0000 7f935142e700 1 -- 172.21.15.103:0/3845816918 shutdown_connections 2020-04-22T14:03:34.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.724+0000 7f935142e700 1 -- 172.21.15.103:0/3845816918 wait complete. 2020-04-22T14:03:34.735 INFO:teuthology.orchestra.run.smithi103.stderr:updated 2020-04-22T14:03:34.737 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:34.750 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth del client.bootstrap-rbd-mirror 2020-04-22T14:03:34.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.899+0000 7f237b0d3700 1 Processor -- start 2020-04-22T14:03:34.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.899+0000 7f237b0d3700 1 -- start start 2020-04-22T14:03:34.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.900+0000 7f237b0d3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f23740b4320 0x7f23740b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:34.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.900+0000 7f237b0d3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23740b2530 0x7f23740b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:34.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.900+0000 7f237b0d3700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23740b0e90 con 0x7f23740b4700 2020-04-22T14:03:34.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.900+0000 7f237b0d3700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23740b2ac0 con 0x7f23740b4320 2020-04-22T14:03:34.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.900+0000 7f237b0d3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23740b1130 con 0x7f23740b2530 2020-04-22T14:03:34.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.900+0000 7f2378e6f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f23740b4320 0x7f23740b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:34.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.900+0000 7f2378e6f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f23740b4320 0x7f23740b15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48518/0 (socket says 172.21.15.103:48518) 2020-04-22T14:03:34.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.900+0000 7f2378e6f700 1 -- 172.21.15.103:0/4154061192 learned_addr learned my addr 172.21.15.103:0/4154061192 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:34.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.901+0000 7f2379670700 1 --2- 172.21.15.103:0/4154061192 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23740b2530 0x7f23740b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:34.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.901+0000 7f2378e6f700 1 -- 172.21.15.103:0/4154061192 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23740b2530 msgr2=0x7f23740b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:34.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.901+0000 7f2378e6f700 1 --2- 172.21.15.103:0/4154061192 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23740b2530 0x7f23740b0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:34.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.901+0000 7f2378e6f700 1 -- 172.21.15.103:0/4154061192 >> v1:172.21.15.86:6789/0 conn(0x7f23740b4700 legacy=0x7f23740afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:34.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.901+0000 7f2378e6f700 1 -- 172.21.15.103:0/4154061192 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23740ae500 con 0x7f23740b4320 2020-04-22T14:03:34.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.901+0000 7f2378e6f700 1 --2- 172.21.15.103:0/4154061192 >> v2:172.21.15.103:3300/0 conn(0x7f23740b4320 0x7f23740b15d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2364002f30 tx=0x7f2364007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.901+0000 7f2378e6f700 1 --2- 172.21.15.103:0/4154061192 >> v2:172.21.15.103:3300/0 conn(0x7f23740b4320 0x7f23740b15d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2364002f30 tx=0x7f2364007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.901+0000 7f2378e6f700 1 --2- 172.21.15.103:0/4154061192 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23740b4320 0x7f23740b15d0 secure :-1 s=READY pgs=360 cs=0 l=1 rx=0x7f2364002f30 tx=0x7f2364007a40).ready entity=mon.1 client_cookie=9db5c4929a2478cf server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:34.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.901+0000 7f2378e6f700 1 --2- 172.21.15.103:0/4154061192 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23740b4320 0x7f23740b15d0 secure :-1 s=THROTTLE_DONE pgs=360 cs=0 l=1 rx=0x7f2364002f30 tx=0x7f2364007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.901+0000 7f23737fe700 1 -- 172.21.15.103:0/4154061192 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2364011720 con 0x7f23740b4320 2020-04-22T14:03:34.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.901+0000 7f2378e6f700 1 --2- 172.21.15.103:0/4154061192 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23740b4320 0x7f23740b15d0 secure :-1 s=THROTTLE_DONE pgs=360 cs=0 l=1 rx=0x7f2364002f30 tx=0x7f2364007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.901+0000 7f2378e6f700 1 --2- 172.21.15.103:0/4154061192 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23740b4320 0x7f23740b15d0 secure :-1 s=THROTTLE_DONE pgs=360 cs=0 l=1 rx=0x7f2364002f30 tx=0x7f2364007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.901+0000 7f23737fe700 1 -- 172.21.15.103:0/4154061192 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23640118c0 con 0x7f23740b4320 2020-04-22T14:03:34.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.901+0000 7f23737fe700 1 -- 172.21.15.103:0/4154061192 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2364011ce0 con 0x7f23740b4320 2020-04-22T14:03:34.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.901+0000 7f237b0d3700 1 -- 172.21.15.103:0/4154061192 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23740b4320 msgr2=0x7f23740b15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:34.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.901+0000 7f237b0d3700 1 --2- 172.21.15.103:0/4154061192 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23740b4320 0x7f23740b15d0 secure :-1 s=READY pgs=360 cs=0 l=1 rx=0x7f2364002f30 tx=0x7f2364007a40).stop 2020-04-22T14:03:34.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.901+0000 7f237b0d3700 1 -- 172.21.15.103:0/4154061192 shutdown_connections 2020-04-22T14:03:34.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.901+0000 7f237b0d3700 1 --2- 172.21.15.103:0/4154061192 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23740b2530 0x7f23740b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:34.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.901+0000 7f237b0d3700 1 --2- 172.21.15.103:0/4154061192 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23740b4320 0x7f23740b15d0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:34.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.901+0000 7f237b0d3700 1 -- 172.21.15.103:0/4154061192 >> 172.21.15.103:0/4154061192 conn(0x7f23740b86b0 msgr2=0x7f23740b8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:34.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.901+0000 7f237b0d3700 1 -- 172.21.15.103:0/4154061192 shutdown_connections 2020-04-22T14:03:34.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.901+0000 7f237b0d3700 1 -- 172.21.15.103:0/4154061192 wait complete. 2020-04-22T14:03:34.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.902+0000 7f237b0d3700 1 Processor -- start 2020-04-22T14:03:34.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.902+0000 7f237b0d3700 1 -- start start 2020-04-22T14:03:34.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.903+0000 7f237b0d3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f23740b4700 0x7f23740650c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:34.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.903+0000 7f237b0d3700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23740644f0 con 0x7f23740b2530 2020-04-22T14:03:34.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.903+0000 7f237b0d3700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23741434a0 con 0x7f23740b4320 2020-04-22T14:03:34.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.903+0000 7f237b0d3700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2374064200 con 0x7f23740b4700 2020-04-22T14:03:34.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.903+0000 7f2379670700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f23740b4700 0x7f23740650c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:34.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.903+0000 7f2379670700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f23740b4700 0x7f23740650c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48526/0 (socket says 172.21.15.103:48526) 2020-04-22T14:03:34.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.903+0000 7f2373fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f23740b4320 0x7f237413c660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40714/0 (socket says 172.21.15.103:40714) 2020-04-22T14:03:34.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.903+0000 7f2379670700 1 -- 172.21.15.103:0/2859975605 learned_addr learned my addr 172.21.15.103:0/2859975605 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:34.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.904+0000 7f2379670700 1 -- 172.21.15.103:0/2859975605 >> v1:172.21.15.103:6789/0 conn(0x7f23740b4320 legacy=0x7f237413c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:34.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.904+0000 7f2379670700 1 -- 172.21.15.103:0/2859975605 >> v1:172.21.15.86:6789/0 conn(0x7f23740b2530 legacy=0x7f23741446b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:34.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.904+0000 7f2379670700 1 -- 172.21.15.103:0/2859975605 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f237413cd70 con 0x7f23740b4700 2020-04-22T14:03:34.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.904+0000 7f2371ffb700 1 -- 172.21.15.103:0/2859975605 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 129006864 0 0) 0x7f23741434a0 con 0x7f23740b4320 2020-04-22T14:03:34.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.904+0000 7f2379670700 1 --2- 172.21.15.103:0/2859975605 >> v2:172.21.15.103:3300/0 conn(0x7f23740b4700 0x7f23740650c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f236c0032b0 tx=0x7f236c010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.904+0000 7f2379670700 1 --2- 172.21.15.103:0/2859975605 >> v2:172.21.15.103:3300/0 conn(0x7f23740b4700 0x7f23740650c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f236c0032b0 tx=0x7f236c010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.904+0000 7f2379670700 1 --2- 172.21.15.103:0/2859975605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23740b4700 0x7f23740650c0 secure :-1 s=READY pgs=362 cs=0 l=1 rx=0x7f236c0032b0 tx=0x7f236c010f40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:34.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.904+0000 7f2379670700 1 --2- 172.21.15.103:0/2859975605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23740b4700 0x7f23740650c0 secure :-1 s=THROTTLE_DONE pgs=362 cs=0 l=1 rx=0x7f236c0032b0 tx=0x7f236c010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.904+0000 7f2371ffb700 1 -- 172.21.15.103:0/2859975605 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f236c005e80 con 0x7f23740b4700 2020-04-22T14:03:34.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.904+0000 7f2379670700 1 --2- 172.21.15.103:0/2859975605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23740b4700 0x7f23740650c0 secure :-1 s=THROTTLE_DONE pgs=362 cs=0 l=1 rx=0x7f236c0032b0 tx=0x7f236c010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.904+0000 7f2379670700 1 --2- 172.21.15.103:0/2859975605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23740b4700 0x7f23740650c0 secure :-1 s=THROTTLE_DONE pgs=362 cs=0 l=1 rx=0x7f236c0032b0 tx=0x7f236c010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.904+0000 7f2371ffb700 1 -- 172.21.15.103:0/2859975605 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236c007560 con 0x7f23740b4700 2020-04-22T14:03:34.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.904+0000 7f237b0d3700 1 -- 172.21.15.103:0/2859975605 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2374140ca0 con 0x7f23740b4700 2020-04-22T14:03:34.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.904+0000 7f2371ffb700 1 -- 172.21.15.103:0/2859975605 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f236c007900 con 0x7f23740b4700 2020-04-22T14:03:34.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.904+0000 7f237b0d3700 1 -- 172.21.15.103:0/2859975605 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23740b33d0 con 0x7f23740b4700 2020-04-22T14:03:34.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.904+0000 7f2379670700 1 --2- 172.21.15.103:0/2859975605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23740b4700 0x7f23740650c0 secure :-1 s=THROTTLE_DONE pgs=362 cs=0 l=1 rx=0x7f236c0032b0 tx=0x7f236c010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.905+0000 7f2371ffb700 1 -- 172.21.15.103:0/2859975605 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f236c0101a0 con 0x7f23740b4700 2020-04-22T14:03:34.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.905+0000 7f2379670700 1 --2- 172.21.15.103:0/2859975605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23740b4700 0x7f23740650c0 secure :-1 s=THROTTLE_DONE pgs=362 cs=0 l=1 rx=0x7f236c0032b0 tx=0x7f236c010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.905+0000 7f237b0d3700 1 -- 172.21.15.103:0/2859975605 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2374064340 con 0x7f23740b4700 2020-04-22T14:03:34.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.905+0000 7f2371ffb700 1 --2- 172.21.15.103:0/2859975605 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f235404d900 0x7f235404fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:34.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.905+0000 7f2371ffb700 1 -- 172.21.15.103:0/2859975605 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f236c061480 con 0x7f23740b4700 2020-04-22T14:03:34.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.905+0000 7f2378e6f700 1 --2- 172.21.15.103:0/2859975605 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f235404d900 0x7f235404fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:34.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.905+0000 7f2378e6f700 1 --2- 172.21.15.103:0/2859975605 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f235404d900 0x7f235404fdc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f23740b3ce0 tx=0x7f2364007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.906+0000 7f2378e6f700 1 --2- 172.21.15.103:0/2859975605 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f235404d900 0x7f235404fdc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f23740b3ce0 tx=0x7f2364007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.906+0000 7f2378e6f700 1 --2- 172.21.15.103:0/2859975605 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f235404d900 0x7f235404fdc0 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7f23740b3ce0 tx=0x7f2364007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:34.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.909+0000 7f2379670700 1 --2- 172.21.15.103:0/2859975605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23740b4700 0x7f23740650c0 secure :-1 s=THROTTLE_DONE pgs=362 cs=0 l=1 rx=0x7f236c0032b0 tx=0x7f236c010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:34.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:34.909+0000 7f2371ffb700 1 -- 172.21.15.103:0/2859975605 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f236c03c860 con 0x7f23740b4700 2020-04-22T14:03:35.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.103+0000 7f237b0d3700 1 -- 172.21.15.103:0/2859975605 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f2374143630 con 0x7f23740b4700 2020-04-22T14:03:35.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.107+0000 7f2379670700 1 --2- 172.21.15.103:0/2859975605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23740b4700 0x7f23740650c0 secure :-1 s=THROTTLE_DONE pgs=362 cs=0 l=1 rx=0x7f236c0032b0 tx=0x7f236c010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:35.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.107+0000 7f2371ffb700 1 -- 172.21.15.103:0/2859975605 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 updated v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f236c03fe80 con 0x7f23740b4700 2020-04-22T14:03:35.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.109+0000 7f237b0d3700 1 -- 172.21.15.103:0/2859975605 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f235404d900 msgr2=0x7f235404fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:35.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.109+0000 7f237b0d3700 1 --2- 172.21.15.103:0/2859975605 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f235404d900 0x7f235404fdc0 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7f23740b3ce0 tx=0x7f2364007a40).stop 2020-04-22T14:03:35.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.109+0000 7f237b0d3700 1 -- 172.21.15.103:0/2859975605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23740b4700 msgr2=0x7f23740650c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:35.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.109+0000 7f237b0d3700 1 --2- 172.21.15.103:0/2859975605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23740b4700 0x7f23740650c0 secure :-1 s=READY pgs=362 cs=0 l=1 rx=0x7f236c0032b0 tx=0x7f236c010f40).stop 2020-04-22T14:03:35.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.109+0000 7f237b0d3700 1 -- 172.21.15.103:0/2859975605 shutdown_connections 2020-04-22T14:03:35.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.109+0000 7f237b0d3700 1 --2- 172.21.15.103:0/2859975605 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f235404d900 0x7f235404fdc0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:35.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.109+0000 7f237b0d3700 1 --2- 172.21.15.103:0/2859975605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23740b4700 0x7f23740650c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:35.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.109+0000 7f237b0d3700 1 -- 172.21.15.103:0/2859975605 >> 172.21.15.103:0/2859975605 conn(0x7f23740b86b0 msgr2=0x7f23740addc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:35.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.109+0000 7f237b0d3700 1 -- 172.21.15.103:0/2859975605 shutdown_connections 2020-04-22T14:03:35.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.109+0000 7f237b0d3700 1 -- 172.21.15.103:0/2859975605 wait complete. 2020-04-22T14:03:35.114 INFO:teuthology.orchestra.run.smithi103.stderr:updated 2020-04-22T14:03:35.122 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:35.141 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth del client.bootstrap-rgw 2020-04-22T14:03:35.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.284+0000 7f33e416f700 1 Processor -- start 2020-04-22T14:03:35.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.284+0000 7f33e416f700 1 -- start start 2020-04-22T14:03:35.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.285+0000 7f33e416f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f33dc146210 0x7f33dc1465f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:35.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.285+0000 7f33e416f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f33dc142400 0x7f33dc0ac740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:35.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.285+0000 7f33e416f700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33dc0b3a60 con 0x7f33dc0af280 2020-04-22T14:03:35.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.285+0000 7f33e416f700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33dc0b4ea0 con 0x7f33dc142400 2020-04-22T14:03:35.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.285+0000 7f33e416f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33dc0adad0 con 0x7f33dc146210 2020-04-22T14:03:35.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.286+0000 7f33e1f0b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f33dc146210 0x7f33dc1465f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:35.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.286+0000 7f33e1f0b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f33dc146210 0x7f33dc1465f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:33308/0 (socket says 172.21.15.103:33308) 2020-04-22T14:03:35.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.286+0000 7f33e1f0b700 1 -- 172.21.15.103:0/3096209314 learned_addr learned my addr 172.21.15.103:0/3096209314 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:35.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.286+0000 7f33e270c700 1 --2- 172.21.15.103:0/3096209314 >> v2:172.21.15.86:3300/0 conn(0x7f33dc142400 0x7f33dc0ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:35.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.286+0000 7f33e1f0b700 1 -- 172.21.15.103:0/3096209314 >> v2:172.21.15.86:3300/0 conn(0x7f33dc142400 msgr2=0x7f33dc0ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:35.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.286+0000 7f33e1f0b700 1 --2- 172.21.15.103:0/3096209314 >> v2:172.21.15.86:3300/0 conn(0x7f33dc142400 0x7f33dc0ac740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:35.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.286+0000 7f33e1f0b700 1 -- 172.21.15.103:0/3096209314 >> v1:172.21.15.86:6789/0 conn(0x7f33dc0af280 legacy=0x7f33dc141cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:35.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.286+0000 7f33e1f0b700 1 -- 172.21.15.103:0/3096209314 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33dc0add70 con 0x7f33dc146210 2020-04-22T14:03:35.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.286+0000 7f33e1f0b700 1 --2- 172.21.15.103:0/3096209314 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f33dc146210 0x7f33dc1465f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f33cc002f30 tx=0x7f33cc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:35.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.286+0000 7f33e1f0b700 1 --2- 172.21.15.103:0/3096209314 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f33dc146210 0x7f33dc1465f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f33cc002f30 tx=0x7f33cc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:35.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.286+0000 7f33e1f0b700 1 --2- 172.21.15.103:0/3096209314 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f33dc146210 0x7f33dc1465f0 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f33cc002f30 tx=0x7f33cc007a40).ready entity=mon.2 client_cookie=7ee51830e99bdb92 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:35.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.286+0000 7f33e1f0b700 1 --2- 172.21.15.103:0/3096209314 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f33dc146210 0x7f33dc1465f0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f33cc002f30 tx=0x7f33cc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:35.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.286+0000 7f33e0f09700 1 -- 172.21.15.103:0/3096209314 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33cc0099c0 con 0x7f33dc146210 2020-04-22T14:03:35.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.286+0000 7f33e1f0b700 1 --2- 172.21.15.103:0/3096209314 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f33dc146210 0x7f33dc1465f0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f33cc002f30 tx=0x7f33cc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:35.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.286+0000 7f33e1f0b700 1 --2- 172.21.15.103:0/3096209314 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f33dc146210 0x7f33dc1465f0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f33cc002f30 tx=0x7f33cc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:35.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.286+0000 7f33e0f09700 1 -- 172.21.15.103:0/3096209314 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33cc009b60 con 0x7f33dc146210 2020-04-22T14:03:35.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.286+0000 7f33e0f09700 1 -- 172.21.15.103:0/3096209314 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33cc00b490 con 0x7f33dc146210 2020-04-22T14:03:35.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.286+0000 7f33e416f700 1 -- 172.21.15.103:0/3096209314 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f33dc146210 msgr2=0x7f33dc1465f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:35.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.286+0000 7f33e416f700 1 --2- 172.21.15.103:0/3096209314 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f33dc146210 0x7f33dc1465f0 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f33cc002f30 tx=0x7f33cc007a40).stop 2020-04-22T14:03:35.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.287+0000 7f33e416f700 1 -- 172.21.15.103:0/3096209314 shutdown_connections 2020-04-22T14:03:35.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.287+0000 7f33e416f700 1 --2- 172.21.15.103:0/3096209314 >> v2:172.21.15.86:3300/0 conn(0x7f33dc142400 0x7f33dc0ac740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:35.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.287+0000 7f33e416f700 1 --2- 172.21.15.103:0/3096209314 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f33dc146210 0x7f33dc1465f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:35.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.287+0000 7f33e416f700 1 -- 172.21.15.103:0/3096209314 >> 172.21.15.103:0/3096209314 conn(0x7f33dc0b86b0 msgr2=0x7f33dc0b8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:35.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.287+0000 7f33e416f700 1 -- 172.21.15.103:0/3096209314 shutdown_connections 2020-04-22T14:03:35.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.287+0000 7f33e416f700 1 -- 172.21.15.103:0/3096209314 wait complete. 2020-04-22T14:03:35.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.288+0000 7f33e416f700 1 Processor -- start 2020-04-22T14:03:35.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.288+0000 7f33e416f700 1 -- start start 2020-04-22T14:03:35.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.289+0000 7f33e416f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f33dc146210 0x7f33dc13fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:35.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.289+0000 7f33e416f700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33dc1450d0 con 0x7f33dc142400 2020-04-22T14:03:35.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.289+0000 7f33e416f700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33dc145370 con 0x7f33dc0af280 2020-04-22T14:03:35.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.289+0000 7f33e416f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33dc1458b0 con 0x7f33dc146210 2020-04-22T14:03:35.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.289+0000 7f33e1f0b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f33dc0af280 0x7f33dc1438c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40726/0 (socket says 172.21.15.103:40726) 2020-04-22T14:03:35.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.289+0000 7f33e270c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f33dc146210 0x7f33dc13fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:35.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.289+0000 7f33e1f0b700 1 -- 172.21.15.103:0/2097177252 learned_addr learned my addr 172.21.15.103:0/2097177252 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:35.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.289+0000 7f33e270c700 1 -- 172.21.15.103:0/2097177252 >> v1:172.21.15.103:6789/0 conn(0x7f33dc0af280 legacy=0x7f33dc1438c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:35.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.289+0000 7f33e270c700 1 -- 172.21.15.103:0/2097177252 >> v1:172.21.15.86:6789/0 conn(0x7f33dc142400 legacy=0x7f33dc0658e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:35.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.289+0000 7f33caffd700 1 -- 172.21.15.103:0/2097177252 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3578395141 0 0) 0x7f33dc145370 con 0x7f33dc0af280 2020-04-22T14:03:35.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.289+0000 7f33e270c700 1 -- 172.21.15.103:0/2097177252 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33dc145610 con 0x7f33dc146210 2020-04-22T14:03:35.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.289+0000 7f33e270c700 1 --2- 172.21.15.103:0/2097177252 >> v2:172.21.15.103:3300/0 conn(0x7f33dc146210 0x7f33dc13fc20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f33d40032b0 tx=0x7f33d4010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:35.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.289+0000 7f33e270c700 1 --2- 172.21.15.103:0/2097177252 >> v2:172.21.15.103:3300/0 conn(0x7f33dc146210 0x7f33dc13fc20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f33d40032b0 tx=0x7f33d4010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:35.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.289+0000 7f33e270c700 1 --2- 172.21.15.103:0/2097177252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33dc146210 0x7f33dc13fc20 secure :-1 s=READY pgs=364 cs=0 l=1 rx=0x7f33d40032b0 tx=0x7f33d4010f70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:35.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.289+0000 7f33e270c700 1 --2- 172.21.15.103:0/2097177252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33dc146210 0x7f33dc13fc20 secure :-1 s=THROTTLE_DONE pgs=364 cs=0 l=1 rx=0x7f33d40032b0 tx=0x7f33d4010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:35.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.289+0000 7f33caffd700 1 -- 172.21.15.103:0/2097177252 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33d400e370 con 0x7f33dc146210 2020-04-22T14:03:35.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.289+0000 7f33e270c700 1 --2- 172.21.15.103:0/2097177252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33dc146210 0x7f33dc13fc20 secure :-1 s=THROTTLE_DONE pgs=364 cs=0 l=1 rx=0x7f33d40032b0 tx=0x7f33d4010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:35.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.289+0000 7f33caffd700 1 -- 172.21.15.103:0/2097177252 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d4005c30 con 0x7f33dc146210 2020-04-22T14:03:35.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.289+0000 7f33e270c700 1 --2- 172.21.15.103:0/2097177252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33dc146210 0x7f33dc13fc20 secure :-1 s=THROTTLE_DONE pgs=364 cs=0 l=1 rx=0x7f33d40032b0 tx=0x7f33d4010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:35.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.289+0000 7f33e416f700 1 -- 172.21.15.103:0/2097177252 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33dc065ff0 con 0x7f33dc146210 2020-04-22T14:03:35.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.289+0000 7f33caffd700 1 -- 172.21.15.103:0/2097177252 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33d4005da0 con 0x7f33dc146210 2020-04-22T14:03:35.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.289+0000 7f33e416f700 1 -- 172.21.15.103:0/2097177252 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33dc141520 con 0x7f33dc146210 2020-04-22T14:03:35.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.290+0000 7f33e270c700 1 --2- 172.21.15.103:0/2097177252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33dc146210 0x7f33dc13fc20 secure :-1 s=THROTTLE_DONE pgs=364 cs=0 l=1 rx=0x7f33d40032b0 tx=0x7f33d4010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:35.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.290+0000 7f33caffd700 1 -- 172.21.15.103:0/2097177252 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f33d4012bb0 con 0x7f33dc146210 2020-04-22T14:03:35.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.290+0000 7f33e270c700 1 --2- 172.21.15.103:0/2097177252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33dc146210 0x7f33dc13fc20 secure :-1 s=THROTTLE_DONE pgs=364 cs=0 l=1 rx=0x7f33d40032b0 tx=0x7f33d4010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:35.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.290+0000 7f33e416f700 1 -- 172.21.15.103:0/2097177252 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33dc056c90 con 0x7f33dc146210 2020-04-22T14:03:35.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.291+0000 7f33caffd700 1 --2- 172.21.15.103:0/2097177252 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f33bc04d7d0 0x7f33bc04fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:35.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.291+0000 7f33caffd700 1 -- 172.21.15.103:0/2097177252 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f33d4061470 con 0x7f33dc146210 2020-04-22T14:03:35.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.291+0000 7f33e1f0b700 1 --2- 172.21.15.103:0/2097177252 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f33bc04d7d0 0x7f33bc04fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:35.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.291+0000 7f33e1f0b700 1 --2- 172.21.15.103:0/2097177252 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f33bc04d7d0 0x7f33bc04fc90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f33cc008320 tx=0x7f33cc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:35.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.291+0000 7f33e1f0b700 1 --2- 172.21.15.103:0/2097177252 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f33bc04d7d0 0x7f33bc04fc90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f33cc008320 tx=0x7f33cc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:35.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.291+0000 7f33e1f0b700 1 --2- 172.21.15.103:0/2097177252 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f33bc04d7d0 0x7f33bc04fc90 secure :-1 s=READY pgs=151 cs=0 l=1 rx=0x7f33cc008320 tx=0x7f33cc007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:35.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.295+0000 7f33e270c700 1 --2- 172.21.15.103:0/2097177252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33dc146210 0x7f33dc13fc20 secure :-1 s=THROTTLE_DONE pgs=364 cs=0 l=1 rx=0x7f33d40032b0 tx=0x7f33d4010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:35.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.295+0000 7f33caffd700 1 -- 172.21.15.103:0/2097177252 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f33d403c7f0 con 0x7f33dc146210 2020-04-22T14:03:35.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.486+0000 7f33e416f700 1 -- 172.21.15.103:0/2097177252 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f33dc066ac0 con 0x7f33dc146210 2020-04-22T14:03:35.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.491+0000 7f33e270c700 1 --2- 172.21.15.103:0/2097177252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33dc146210 0x7f33dc13fc20 secure :-1 s=THROTTLE_DONE pgs=364 cs=0 l=1 rx=0x7f33d40032b0 tx=0x7f33d4010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:35.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.491+0000 7f33caffd700 1 -- 172.21.15.103:0/2097177252 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 updated v12) v1 ==== 97+0+0 (secure 0 0 0) 0x7f33d403fe10 con 0x7f33dc146210 2020-04-22T14:03:35.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.492+0000 7f33e416f700 1 -- 172.21.15.103:0/2097177252 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f33bc04d7d0 msgr2=0x7f33bc04fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:35.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.492+0000 7f33e416f700 1 --2- 172.21.15.103:0/2097177252 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f33bc04d7d0 0x7f33bc04fc90 secure :-1 s=READY pgs=151 cs=0 l=1 rx=0x7f33cc008320 tx=0x7f33cc007a40).stop 2020-04-22T14:03:35.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.492+0000 7f33e416f700 1 -- 172.21.15.103:0/2097177252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33dc146210 msgr2=0x7f33dc13fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:35.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.492+0000 7f33e416f700 1 --2- 172.21.15.103:0/2097177252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33dc146210 0x7f33dc13fc20 secure :-1 s=READY pgs=364 cs=0 l=1 rx=0x7f33d40032b0 tx=0x7f33d4010f70).stop 2020-04-22T14:03:35.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.493+0000 7f33e416f700 1 -- 172.21.15.103:0/2097177252 shutdown_connections 2020-04-22T14:03:35.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.493+0000 7f33e416f700 1 --2- 172.21.15.103:0/2097177252 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f33bc04d7d0 0x7f33bc04fc90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:35.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.493+0000 7f33e416f700 1 --2- 172.21.15.103:0/2097177252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33dc146210 0x7f33dc13fc20 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:35.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.493+0000 7f33e416f700 1 -- 172.21.15.103:0/2097177252 >> 172.21.15.103:0/2097177252 conn(0x7f33dc0b86b0 msgr2=0x7f33dc0b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:35.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.493+0000 7f33e416f700 1 -- 172.21.15.103:0/2097177252 shutdown_connections 2020-04-22T14:03:35.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.493+0000 7f33e416f700 1 -- 172.21.15.103:0/2097177252 wait complete. 2020-04-22T14:03:35.497 INFO:teuthology.orchestra.run.smithi103.stderr:updated 2020-04-22T14:03:35.506 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:35.519 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:03:35.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.668+0000 7ffa9e87f700 1 Processor -- start 2020-04-22T14:03:35.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.668+0000 7ffa9e87f700 1 -- start start 2020-04-22T14:03:35.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.668+0000 7ffa9e87f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffa9812c0d0 0x7ffa981464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:35.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.668+0000 7ffa9e87f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffa98065fe0 0x7ffa9805b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:35.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.668+0000 7ffa9e87f700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa98143300 con 0x7ffa9805b8a0 2020-04-22T14:03:35.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.668+0000 7ffa9e87f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa9812c4b0 con 0x7ffa98065fe0 2020-04-22T14:03:35.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.668+0000 7ffa9e87f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa981435a0 con 0x7ffa9812c0d0 2020-04-22T14:03:35.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.669+0000 7ffa977fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffa98065fe0 0x7ffa9805b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:35.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.669+0000 7ffa977fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffa98065fe0 0x7ffa9805b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48544/0 (socket says 172.21.15.103:48544) 2020-04-22T14:03:35.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.669+0000 7ffa977fe700 1 -- 172.21.15.103:0/113605105 learned_addr learned my addr 172.21.15.103:0/113605105 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:35.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.669+0000 7ffa977fe700 1 -- 172.21.15.103:0/113605105 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffa9812c0d0 msgr2=0x7ffa981464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:35.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.669+0000 7ffa97fff700 1 --2- 172.21.15.103:0/113605105 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffa9812c0d0 0x7ffa981464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:35.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.669+0000 7ffa977fe700 1 --2- 172.21.15.103:0/113605105 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffa9812c0d0 0x7ffa981464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:35.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.669+0000 7ffa977fe700 1 -- 172.21.15.103:0/113605105 >> v1:172.21.15.86:6789/0 conn(0x7ffa9805b8a0 legacy=0x7ffa98062ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:35.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.669+0000 7ffa977fe700 1 -- 172.21.15.103:0/113605105 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa98143840 con 0x7ffa98065fe0 2020-04-22T14:03:35.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.669+0000 7ffa97fff700 1 --2- 172.21.15.103:0/113605105 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffa9812c0d0 0x7ffa981464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:03:35.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.669+0000 7ffa977fe700 1 --2- 172.21.15.103:0/113605105 >> v2:172.21.15.103:3300/0 conn(0x7ffa98065fe0 0x7ffa9805b440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ffa980669a0 tx=0x7ffa8c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:35.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.669+0000 7ffa977fe700 1 --2- 172.21.15.103:0/113605105 >> v2:172.21.15.103:3300/0 conn(0x7ffa98065fe0 0x7ffa9805b440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ffa980669a0 tx=0x7ffa8c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:35.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.669+0000 7ffa977fe700 1 --2- 172.21.15.103:0/113605105 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa98065fe0 0x7ffa9805b440 secure :-1 s=READY pgs=365 cs=0 l=1 rx=0x7ffa980669a0 tx=0x7ffa8c007a40).ready entity=mon.1 client_cookie=fc207ecd824e353 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:35.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.669+0000 7ffa977fe700 1 --2- 172.21.15.103:0/113605105 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa98065fe0 0x7ffa9805b440 secure :-1 s=THROTTLE_DONE pgs=365 cs=0 l=1 rx=0x7ffa980669a0 tx=0x7ffa8c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:35.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.669+0000 7ffa977fe700 1 --2- 172.21.15.103:0/113605105 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa98065fe0 0x7ffa9805b440 secure :-1 s=THROTTLE_DONE pgs=365 cs=0 l=1 rx=0x7ffa980669a0 tx=0x7ffa8c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:35.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.669+0000 7ffa96ffd700 1 -- 172.21.15.103:0/113605105 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa8c0116e0 con 0x7ffa98065fe0 2020-04-22T14:03:35.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.669+0000 7ffa977fe700 1 --2- 172.21.15.103:0/113605105 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa98065fe0 0x7ffa9805b440 secure :-1 s=THROTTLE_DONE pgs=365 cs=0 l=1 rx=0x7ffa980669a0 tx=0x7ffa8c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:35.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.669+0000 7ffa96ffd700 1 -- 172.21.15.103:0/113605105 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8c011840 con 0x7ffa98065fe0 2020-04-22T14:03:35.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.669+0000 7ffa96ffd700 1 -- 172.21.15.103:0/113605105 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa8c011c60 con 0x7ffa98065fe0 2020-04-22T14:03:35.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.669+0000 7ffa9e87f700 1 -- 172.21.15.103:0/113605105 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa98065fe0 msgr2=0x7ffa9805b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:35.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.669+0000 7ffa9e87f700 1 --2- 172.21.15.103:0/113605105 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa98065fe0 0x7ffa9805b440 secure :-1 s=READY pgs=365 cs=0 l=1 rx=0x7ffa980669a0 tx=0x7ffa8c007a40).stop 2020-04-22T14:03:35.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.670+0000 7ffa9e87f700 1 -- 172.21.15.103:0/113605105 shutdown_connections 2020-04-22T14:03:35.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.670+0000 7ffa9e87f700 1 --2- 172.21.15.103:0/113605105 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffa9812c0d0 0x7ffa981464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:35.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.670+0000 7ffa9e87f700 1 --2- 172.21.15.103:0/113605105 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa98065fe0 0x7ffa9805b440 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:35.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.670+0000 7ffa9e87f700 1 -- 172.21.15.103:0/113605105 >> 172.21.15.103:0/113605105 conn(0x7ffa980b9160 msgr2=0x7ffa9805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:35.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.670+0000 7ffa9e87f700 1 -- 172.21.15.103:0/113605105 shutdown_connections 2020-04-22T14:03:35.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.670+0000 7ffa9e87f700 1 -- 172.21.15.103:0/113605105 wait complete. 2020-04-22T14:03:35.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.671+0000 7ffa9e87f700 1 Processor -- start 2020-04-22T14:03:35.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.671+0000 7ffa9e87f700 1 -- start start 2020-04-22T14:03:35.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.672+0000 7ffa9e87f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffa9812c0d0 0x7ffa981426b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:35.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.672+0000 7ffa9e87f700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa980b4920 con 0x7ffa9805b8a0 2020-04-22T14:03:35.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.672+0000 7ffa9e87f700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa980637c0 con 0x7ffa98065fe0 2020-04-22T14:03:35.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.672+0000 7ffa9e87f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa98152970 con 0x7ffa9812c0d0 2020-04-22T14:03:35.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.672+0000 7ffa977fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ffa98065fe0 0x7ffa98141fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40740/0 (socket says 172.21.15.103:40740) 2020-04-22T14:03:35.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.672+0000 7ffa977fe700 1 -- 172.21.15.103:0/929632043 learned_addr learned my addr 172.21.15.103:0/929632043 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:35.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.672+0000 7ffa957fa700 1 -- 172.21.15.103:0/929632043 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3703110487 0 0) 0x7ffa980637c0 con 0x7ffa98065fe0 2020-04-22T14:03:35.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.672+0000 7ffa957fa700 1 -- 172.21.15.103:0/929632043 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa78002fe0 con 0x7ffa98065fe0 2020-04-22T14:03:35.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.672+0000 7ffa9ce1c700 1 --2- 172.21.15.103:0/929632043 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffa9812c0d0 0x7ffa981426b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:35.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.672+0000 7ffa957fa700 1 -- 172.21.15.103:0/929632043 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3051598007 0 0) 0x7ffa78002fe0 con 0x7ffa98065fe0 2020-04-22T14:03:35.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.672+0000 7ffa957fa700 1 -- 172.21.15.103:0/929632043 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ffa980637c0 con 0x7ffa98065fe0 2020-04-22T14:03:35.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.672+0000 7ffa957fa700 1 -- 172.21.15.103:0/929632043 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7ffa8c0085e0 con 0x7ffa98065fe0 2020-04-22T14:03:35.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.672+0000 7ffa957fa700 1 -- 172.21.15.103:0/929632043 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffa9812c0d0 msgr2=0x7ffa981426b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:35.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.672+0000 7ffa957fa700 1 --2- 172.21.15.103:0/929632043 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffa9812c0d0 0x7ffa981426b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:35.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.672+0000 7ffa957fa700 1 -- 172.21.15.103:0/929632043 >> v1:172.21.15.103:6789/0 conn(0x7ffa98065fe0 legacy=0x7ffa98141fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:35.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.672+0000 7ffa957fa700 1 -- 172.21.15.103:0/929632043 >> v1:172.21.15.86:6789/0 conn(0x7ffa9805b8a0 legacy=0x7ffa98152260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:35.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.672+0000 7ffa957fa700 1 --2- 172.21.15.103:0/929632043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa780049b0 0x7ffa78004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:35.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.672+0000 7ffa957fa700 1 --2- 172.21.15.103:0/929632043 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffa9812c0d0 0x7ffa78005210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:35.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.672+0000 7ffa957fa700 1 --2- 172.21.15.103:0/929632043 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffa78003970 0x7ffa78003df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:35.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.672+0000 7ffa957fa700 1 -- 172.21.15.103:0/929632043 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa98152970 con 0x7ffa78003970 2020-04-22T14:03:35.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.672+0000 7ffa957fa700 1 -- 172.21.15.103:0/929632043 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa780043a0 con 0x7ffa780049b0 2020-04-22T14:03:35.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.672+0000 7ffa957fa700 1 -- 172.21.15.103:0/929632043 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa78004560 con 0x7ffa9812c0d0 2020-04-22T14:03:35.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.672+0000 7ffa97fff700 1 --2- 172.21.15.103:0/929632043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa780049b0 0x7ffa78004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:35.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.672+0000 7ffa9ce1c700 1 --2- 172.21.15.103:0/929632043 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffa78003970 0x7ffa78003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:35.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.673+0000 7ffa977fe700 1 --2- 172.21.15.103:0/929632043 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffa9812c0d0 0x7ffa78005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:35.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.673+0000 7ffa97fff700 1 -- 172.21.15.103:0/929632043 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffa9812c0d0 msgr2=0x7ffa78005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:35.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.673+0000 7ffa97fff700 1 --2- 172.21.15.103:0/929632043 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffa9812c0d0 0x7ffa78005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:35.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.673+0000 7ffa97fff700 1 -- 172.21.15.103:0/929632043 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffa78003970 msgr2=0x7ffa78003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:35.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.673+0000 7ffa97fff700 1 --2- 172.21.15.103:0/929632043 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffa78003970 0x7ffa78003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:35.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.673+0000 7ffa97fff700 1 -- 172.21.15.103:0/929632043 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa98151b20 con 0x7ffa780049b0 2020-04-22T14:03:35.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.673+0000 7ffa9e87f700 1 -- 172.21.15.103:0/929632043 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa98151dc0 con 0x7ffa780049b0 2020-04-22T14:03:35.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.673+0000 7ffa97fff700 1 --2- 172.21.15.103:0/929632043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa780049b0 0x7ffa78004d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffa88003070 tx=0x7ffa88010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:35.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.673+0000 7ffa9e87f700 1 -- 172.21.15.103:0/929632043 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa98063240 con 0x7ffa780049b0 2020-04-22T14:03:35.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.673+0000 7ffa97fff700 1 --2- 172.21.15.103:0/929632043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa780049b0 0x7ffa78004d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffa88003070 tx=0x7ffa88010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:35.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.673+0000 7ffa97fff700 1 --2- 172.21.15.103:0/929632043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa780049b0 0x7ffa78004d90 secure :-1 s=READY pgs=367 cs=0 l=1 rx=0x7ffa88003070 tx=0x7ffa88010be0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:35.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.673+0000 7ffa97fff700 1 --2- 172.21.15.103:0/929632043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa780049b0 0x7ffa78004d90 secure :-1 s=THROTTLE_DONE pgs=367 cs=0 l=1 rx=0x7ffa88003070 tx=0x7ffa88010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:35.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.673+0000 7ffa957fa700 1 -- 172.21.15.103:0/929632043 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa88005aa0 con 0x7ffa780049b0 2020-04-22T14:03:35.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.674+0000 7ffa97fff700 1 --2- 172.21.15.103:0/929632043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa780049b0 0x7ffa78004d90 secure :-1 s=THROTTLE_DONE pgs=367 cs=0 l=1 rx=0x7ffa88003070 tx=0x7ffa88010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:35.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.674+0000 7ffa97fff700 1 --2- 172.21.15.103:0/929632043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa780049b0 0x7ffa78004d90 secure :-1 s=THROTTLE_DONE pgs=367 cs=0 l=1 rx=0x7ffa88003070 tx=0x7ffa88010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:35.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.674+0000 7ffa957fa700 1 -- 172.21.15.103:0/929632043 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa88005c40 con 0x7ffa780049b0 2020-04-22T14:03:35.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.674+0000 7ffa957fa700 1 -- 172.21.15.103:0/929632043 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa88005db0 con 0x7ffa780049b0 2020-04-22T14:03:35.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.674+0000 7ffa97fff700 1 --2- 172.21.15.103:0/929632043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa780049b0 0x7ffa78004d90 secure :-1 s=THROTTLE_DONE pgs=367 cs=0 l=1 rx=0x7ffa88003070 tx=0x7ffa88010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:35.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.674+0000 7ffa9e87f700 1 -- 172.21.15.103:0/929632043 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa74003340 con 0x7ffa780049b0 2020-04-22T14:03:35.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.674+0000 7ffa957fa700 1 -- 172.21.15.103:0/929632043 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ffa880125b0 con 0x7ffa780049b0 2020-04-22T14:03:35.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.674+0000 7ffa97fff700 1 --2- 172.21.15.103:0/929632043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa780049b0 0x7ffa78004d90 secure :-1 s=THROTTLE_DONE pgs=367 cs=0 l=1 rx=0x7ffa88003070 tx=0x7ffa88010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:35.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.674+0000 7ffa957fa700 1 --2- 172.21.15.103:0/929632043 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffa78055b60 0x7ffa78058020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:35.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.675+0000 7ffa957fa700 1 -- 172.21.15.103:0/929632043 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7ffa88061120 con 0x7ffa780049b0 2020-04-22T14:03:35.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.675+0000 7ffa977fe700 1 --2- 172.21.15.103:0/929632043 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffa78055b60 0x7ffa78058020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:35.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.675+0000 7ffa977fe700 1 --2- 172.21.15.103:0/929632043 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffa78055b60 0x7ffa78058020 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffa8c0088e0 tx=0x7ffa8c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:35.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.675+0000 7ffa977fe700 1 --2- 172.21.15.103:0/929632043 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffa78055b60 0x7ffa78058020 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffa8c0088e0 tx=0x7ffa8c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:35.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.675+0000 7ffa977fe700 1 --2- 172.21.15.103:0/929632043 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffa78055b60 0x7ffa78058020 secure :-1 s=READY pgs=152 cs=0 l=1 rx=0x7ffa8c0088e0 tx=0x7ffa8c007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:35.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.678+0000 7ffa97fff700 1 --2- 172.21.15.103:0/929632043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa780049b0 0x7ffa78004d90 secure :-1 s=THROTTLE_DONE pgs=367 cs=0 l=1 rx=0x7ffa88003070 tx=0x7ffa88010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:35.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.678+0000 7ffa957fa700 1 -- 172.21.15.103:0/929632043 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ffa8803c520 con 0x7ffa780049b0 2020-04-22T14:03:35.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.823+0000 7ffa9e87f700 1 -- 172.21.15.103:0/929632043 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa740021d0 con 0x7ffa780049b0 2020-04-22T14:03:35.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.824+0000 7ffa97fff700 1 --2- 172.21.15.103:0/929632043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa780049b0 0x7ffa78004d90 secure :-1 s=THROTTLE_DONE pgs=367 cs=0 l=1 rx=0x7ffa88003070 tx=0x7ffa88010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:35.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.824+0000 7ffa957fa700 1 -- 172.21.15.103:0/929632043 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+13232 (secure 0 0 0) 0x7ffa8803fb40 con 0x7ffa780049b0 2020-04-22T14:03:35.827 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:03:35.827 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":30,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:03:35.729311+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:03:35.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.825+0000 7ffa9e87f700 1 -- 172.21.15.103:0/929632043 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffa78055b60 msgr2=0x7ffa78058020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:35.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.825+0000 7ffa9e87f700 1 --2- 172.21.15.103:0/929632043 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffa78055b60 0x7ffa78058020 secure :-1 s=READY pgs=152 cs=0 l=1 rx=0x7ffa8c0088e0 tx=0x7ffa8c007a40).stop 2020-04-22T14:03:35.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.825+0000 7ffa9e87f700 1 -- 172.21.15.103:0/929632043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa780049b0 msgr2=0x7ffa78004d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:35.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.825+0000 7ffa9e87f700 1 --2- 172.21.15.103:0/929632043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa780049b0 0x7ffa78004d90 secure :-1 s=READY pgs=367 cs=0 l=1 rx=0x7ffa88003070 tx=0x7ffa88010be0).stop 2020-04-22T14:03:35.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.825+0000 7ffa9ce1c700 1 -- 172.21.15.103:0/929632043 reap_dead start 2020-04-22T14:03:35.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.825+0000 7ffa9ce1c700 1 -- 172.21.15.103:0/929632043 reap_dead start 2020-04-22T14:03:35.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.825+0000 7ffa9e87f700 1 -- 172.21.15.103:0/929632043 shutdown_connections 2020-04-22T14:03:35.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.825+0000 7ffa9e87f700 1 -- 172.21.15.103:0/929632043 >> 172.21.15.103:0/929632043 conn(0x7ffa980b9160 msgr2=0x7ffa98063ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:35.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.825+0000 7ffa9e87f700 1 -- 172.21.15.103:0/929632043 shutdown_connections 2020-04-22T14:03:35.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:35.825+0000 7ffa9e87f700 1 -- 172.21.15.103:0/929632043 wait complete. 2020-04-22T14:03:35.842 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:03:35.843 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:35.856 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:03:36.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.002+0000 7f6fc1c55700 1 Processor -- start 2020-04-22T14:03:36.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.002+0000 7f6fc1c55700 1 -- start start 2020-04-22T14:03:36.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.003+0000 7f6fc1c55700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6fbc061a30 0x7f6fbc0b4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:36.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.003+0000 7f6fc1c55700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6fbc0acb10 0x7f6fbc0ae920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:36.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.003+0000 7f6fc1c55700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fbc060250 con 0x7f6fbc0aed80 2020-04-22T14:03:36.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.003+0000 7f6fc1c55700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fbc0623c0 con 0x7f6fbc0acb10 2020-04-22T14:03:36.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.003+0000 7f6fc1c55700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fbc062660 con 0x7f6fbc061a30 2020-04-22T14:03:36.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.003+0000 7f6fbb7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6fbc061a30 0x7f6fbc0b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:36.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.003+0000 7f6fbbfff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f6fbc0aed80 0x7f6fbc0b3050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40752/0 (socket says 172.21.15.103:40752) 2020-04-22T14:03:36.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.003+0000 7f6fbbfff700 1 -- 172.21.15.103:0/2071197643 learned_addr learned my addr 172.21.15.103:0/2071197643 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:36.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.003+0000 7f6fbb7fe700 1 --2- 172.21.15.103:0/2071197643 >> v2:172.21.15.103:3300/0 conn(0x7f6fbc061a30 0x7f6fbc0b4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48562/0 (socket says 172.21.15.103:48562) 2020-04-22T14:03:36.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.003+0000 7f6fbaffd700 1 --2- 172.21.15.103:0/2071197643 >> v2:172.21.15.86:3300/0 conn(0x7f6fbc0acb10 0x7f6fbc0ae920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:36.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.003+0000 7f6fbb7fe700 1 -- 172.21.15.103:0/2071197643 >> v2:172.21.15.86:3300/0 conn(0x7f6fbc0acb10 msgr2=0x7f6fbc0ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:36.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.003+0000 7f6fbb7fe700 1 --2- 172.21.15.103:0/2071197643 >> v2:172.21.15.86:3300/0 conn(0x7f6fbc0acb10 0x7f6fbc0ae920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:36.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.003+0000 7f6fbb7fe700 1 -- 172.21.15.103:0/2071197643 >> v1:172.21.15.103:6789/0 conn(0x7f6fbc0aed80 legacy=0x7f6fbc0b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:36.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.003+0000 7f6fbb7fe700 1 -- 172.21.15.103:0/2071197643 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fbc0acfc0 con 0x7f6fbc061a30 2020-04-22T14:03:36.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.003+0000 7f6fba7fc700 1 -- 172.21.15.103:0/2071197643 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 987814946 0 0) 0x7f6fbc060250 con 0x7f6fbc0aed80 2020-04-22T14:03:36.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.003+0000 7f6fbb7fe700 1 --2- 172.21.15.103:0/2071197643 >> v2:172.21.15.103:3300/0 conn(0x7f6fbc061a30 0x7f6fbc0b4820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6fac002f30 tx=0x7f6fac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.003+0000 7f6fbb7fe700 1 --2- 172.21.15.103:0/2071197643 >> v2:172.21.15.103:3300/0 conn(0x7f6fbc061a30 0x7f6fbc0b4820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6fac002f30 tx=0x7f6fac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.003+0000 7f6fbb7fe700 1 --2- 172.21.15.103:0/2071197643 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fbc061a30 0x7f6fbc0b4820 secure :-1 s=READY pgs=369 cs=0 l=1 rx=0x7f6fac002f30 tx=0x7f6fac007a40).ready entity=mon.1 client_cookie=f4238cacc349cfc server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:36.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.004+0000 7f6fbb7fe700 1 --2- 172.21.15.103:0/2071197643 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fbc061a30 0x7f6fbc0b4820 secure :-1 s=THROTTLE_DONE pgs=369 cs=0 l=1 rx=0x7f6fac002f30 tx=0x7f6fac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.004+0000 7f6fba7fc700 1 -- 172.21.15.103:0/2071197643 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fac011470 con 0x7f6fbc061a30 2020-04-22T14:03:36.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.004+0000 7f6fbb7fe700 1 --2- 172.21.15.103:0/2071197643 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fbc061a30 0x7f6fbc0b4820 secure :-1 s=THROTTLE_DONE pgs=369 cs=0 l=1 rx=0x7f6fac002f30 tx=0x7f6fac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.004+0000 7f6fba7fc700 1 -- 172.21.15.103:0/2071197643 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fac0115d0 con 0x7f6fbc061a30 2020-04-22T14:03:36.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.004+0000 7f6fbb7fe700 1 --2- 172.21.15.103:0/2071197643 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fbc061a30 0x7f6fbc0b4820 secure :-1 s=THROTTLE_DONE pgs=369 cs=0 l=1 rx=0x7f6fac002f30 tx=0x7f6fac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.004+0000 7f6fba7fc700 1 -- 172.21.15.103:0/2071197643 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fac0119b0 con 0x7f6fbc061a30 2020-04-22T14:03:36.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.004+0000 7f6fc1c55700 1 -- 172.21.15.103:0/2071197643 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fbc061a30 msgr2=0x7f6fbc0b4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:36.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.004+0000 7f6fc1c55700 1 --2- 172.21.15.103:0/2071197643 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fbc061a30 0x7f6fbc0b4820 secure :-1 s=READY pgs=369 cs=0 l=1 rx=0x7f6fac002f30 tx=0x7f6fac007a40).stop 2020-04-22T14:03:36.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.004+0000 7f6fc1c55700 1 -- 172.21.15.103:0/2071197643 shutdown_connections 2020-04-22T14:03:36.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.004+0000 7f6fc1c55700 1 --2- 172.21.15.103:0/2071197643 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fbc061a30 0x7f6fbc0b4820 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:36.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.004+0000 7f6fc1c55700 1 --2- 172.21.15.103:0/2071197643 >> v2:172.21.15.86:3300/0 conn(0x7f6fbc0acb10 0x7f6fbc0ae920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:36.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.004+0000 7f6fc1c55700 1 -- 172.21.15.103:0/2071197643 >> 172.21.15.103:0/2071197643 conn(0x7f6fbc05b7b0 msgr2=0x7f6fbc0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:36.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.004+0000 7f6fc1c55700 1 -- 172.21.15.103:0/2071197643 shutdown_connections 2020-04-22T14:03:36.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.004+0000 7f6fc1c55700 1 -- 172.21.15.103:0/2071197643 wait complete. 2020-04-22T14:03:36.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.005+0000 7f6fc1c55700 1 Processor -- start 2020-04-22T14:03:36.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.005+0000 7f6fc1c55700 1 -- start start 2020-04-22T14:03:36.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.006+0000 7f6fc1c55700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6fbc0acb10 0x7f6fbc14df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:36.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.006+0000 7f6fc1c55700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6fbc0aed80 0x7f6fbc142610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:36.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.006+0000 7f6fc1c55700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fbc142a70 con 0x7f6fbc061a30 2020-04-22T14:03:36.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.006+0000 7f6fc1c55700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fbc14e3b0 con 0x7f6fbc0acb10 2020-04-22T14:03:36.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.006+0000 7f6fc1c55700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fbc151d50 con 0x7f6fbc0aed80 2020-04-22T14:03:36.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.006+0000 7f6fbaffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6fbc0acb10 0x7f6fbc14df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:36.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.006+0000 7f6fbaffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6fbc0acb10 0x7f6fbc14df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:45800/0 (socket says 172.21.15.103:45800) 2020-04-22T14:03:36.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.006+0000 7f6fbb7fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f6fbc061a30 0x7f6fbc1514b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:57912/0 (socket says 172.21.15.103:57912) 2020-04-22T14:03:36.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.006+0000 7f6fbaffd700 1 -- 172.21.15.103:0/122298912 learned_addr learned my addr 172.21.15.103:0/122298912 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:36.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.006+0000 7f6fbbfff700 1 --2- 172.21.15.103:0/122298912 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6fbc0aed80 0x7f6fbc142610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:36.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.006+0000 7f6fbaffd700 1 -- 172.21.15.103:0/122298912 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6fbc0aed80 msgr2=0x7f6fbc142610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:36.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.006+0000 7f6fbaffd700 1 --2- 172.21.15.103:0/122298912 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6fbc0aed80 0x7f6fbc142610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:36.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.007+0000 7f6fbaffd700 1 -- 172.21.15.103:0/122298912 >> v1:172.21.15.86:6789/0 conn(0x7f6fbc061a30 legacy=0x7f6fbc1514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:36.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.006+0000 7f6fb8ff9700 1 -- 172.21.15.103:0/122298912 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3392288981 0 0) 0x7f6fbc0acfc0 con 0x7f6fbc061a30 2020-04-22T14:03:36.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.007+0000 7f6fbaffd700 1 -- 172.21.15.103:0/122298912 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fbc151ff0 con 0x7f6fbc0acb10 2020-04-22T14:03:36.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.007+0000 7f6fbaffd700 1 --2- 172.21.15.103:0/122298912 >> v2:172.21.15.86:3300/0 conn(0x7f6fbc0acb10 0x7f6fbc14df50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6fb0003070 tx=0x7f6fb0010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.007+0000 7f6fbaffd700 1 --2- 172.21.15.103:0/122298912 >> v2:172.21.15.86:3300/0 conn(0x7f6fbc0acb10 0x7f6fbc14df50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6fb0003070 tx=0x7f6fb0010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.007+0000 7f6fbaffd700 1 --2- 172.21.15.103:0/122298912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fbc0acb10 0x7f6fbc14df50 secure :-1 s=READY pgs=228 cs=0 l=1 rx=0x7f6fb0003070 tx=0x7f6fb0010c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:36.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.007+0000 7f6fbaffd700 1 --2- 172.21.15.103:0/122298912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fbc0acb10 0x7f6fbc14df50 secure :-1 s=THROTTLE_DONE pgs=228 cs=0 l=1 rx=0x7f6fb0003070 tx=0x7f6fb0010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.007+0000 7f6fb8ff9700 1 -- 172.21.15.103:0/122298912 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fb0012a80 con 0x7f6fbc0acb10 2020-04-22T14:03:36.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.007+0000 7f6fbaffd700 1 --2- 172.21.15.103:0/122298912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fbc0acb10 0x7f6fbc14df50 secure :-1 s=THROTTLE_DONE pgs=228 cs=0 l=1 rx=0x7f6fb0003070 tx=0x7f6fb0010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.007+0000 7f6fb8ff9700 1 -- 172.21.15.103:0/122298912 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb0012be0 con 0x7f6fbc0acb10 2020-04-22T14:03:36.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.007+0000 7f6fc1c55700 1 -- 172.21.15.103:0/122298912 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fbc152290 con 0x7f6fbc0acb10 2020-04-22T14:03:36.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.007+0000 7f6fbaffd700 1 --2- 172.21.15.103:0/122298912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fbc0acb10 0x7f6fbc14df50 secure :-1 s=THROTTLE_DONE pgs=228 cs=0 l=1 rx=0x7f6fb0003070 tx=0x7f6fb0010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.007+0000 7f6fb8ff9700 1 -- 172.21.15.103:0/122298912 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fb00091c0 con 0x7f6fbc0acb10 2020-04-22T14:03:36.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.007+0000 7f6fc1c55700 1 -- 172.21.15.103:0/122298912 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fbc066a20 con 0x7f6fbc0acb10 2020-04-22T14:03:36.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.008+0000 7f6fbaffd700 1 --2- 172.21.15.103:0/122298912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fbc0acb10 0x7f6fbc14df50 secure :-1 s=THROTTLE_DONE pgs=228 cs=0 l=1 rx=0x7f6fb0003070 tx=0x7f6fb0010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.008+0000 7f6fc1c55700 1 -- 172.21.15.103:0/122298912 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fbc056c90 con 0x7f6fbc0acb10 2020-04-22T14:03:36.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.008+0000 7f6fb8ff9700 1 -- 172.21.15.103:0/122298912 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f6fb0007190 con 0x7f6fbc0acb10 2020-04-22T14:03:36.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.008+0000 7f6fbaffd700 1 --2- 172.21.15.103:0/122298912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fbc0acb10 0x7f6fbc14df50 secure :-1 s=THROTTLE_DONE pgs=228 cs=0 l=1 rx=0x7f6fb0003070 tx=0x7f6fb0010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.008+0000 7f6fb8ff9700 1 --2- 172.21.15.103:0/122298912 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6f9c04d8d0 0x7f6f9c04fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:36.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.008+0000 7f6fb8ff9700 1 -- 172.21.15.103:0/122298912 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f6fb0061710 con 0x7f6fbc0acb10 2020-04-22T14:03:36.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.008+0000 7f6fbb7fe700 1 --2- 172.21.15.103:0/122298912 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6f9c04d8d0 0x7f6f9c04fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:36.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.009+0000 7f6fbb7fe700 1 --2- 172.21.15.103:0/122298912 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6f9c04d8d0 0x7f6f9c04fd90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6fac0084c0 tx=0x7f6fac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.009+0000 7f6fbb7fe700 1 --2- 172.21.15.103:0/122298912 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6f9c04d8d0 0x7f6f9c04fd90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6fac0084c0 tx=0x7f6fac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.009+0000 7f6fbb7fe700 1 --2- 172.21.15.103:0/122298912 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6f9c04d8d0 0x7f6f9c04fd90 secure :-1 s=READY pgs=153 cs=0 l=1 rx=0x7f6fac0084c0 tx=0x7f6fac007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:36.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.012+0000 7f6fbaffd700 1 --2- 172.21.15.103:0/122298912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fbc0acb10 0x7f6fbc14df50 secure :-1 s=THROTTLE_DONE pgs=228 cs=0 l=1 rx=0x7f6fb0003070 tx=0x7f6fb0010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.012+0000 7f6fb8ff9700 1 -- 172.21.15.103:0/122298912 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f6fb003cb50 con 0x7f6fbc0acb10 2020-04-22T14:03:36.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.154+0000 7f6fc1c55700 1 -- 172.21.15.103:0/122298912 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f6fbc06a960 con 0x7f6fbc0acb10 2020-04-22T14:03:36.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.155+0000 7f6fbaffd700 1 --2- 172.21.15.103:0/122298912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fbc0acb10 0x7f6fbc14df50 secure :-1 s=THROTTLE_DONE pgs=228 cs=0 l=1 rx=0x7f6fb0003070 tx=0x7f6fb0010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.155+0000 7f6fb8ff9700 1 -- 172.21.15.103:0/122298912 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v30) v1 ==== 110+0+10 (secure 0 0 0) 0x7f6fb0040170 con 0x7f6fbc0acb10 2020-04-22T14:03:36.158 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:03:36.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.156+0000 7f6fc1c55700 1 -- 172.21.15.103:0/122298912 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6f9c04d8d0 msgr2=0x7f6f9c04fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:36.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.156+0000 7f6fc1c55700 1 --2- 172.21.15.103:0/122298912 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6f9c04d8d0 0x7f6f9c04fd90 secure :-1 s=READY pgs=153 cs=0 l=1 rx=0x7f6fac0084c0 tx=0x7f6fac007a40).stop 2020-04-22T14:03:36.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.156+0000 7f6fc1c55700 1 -- 172.21.15.103:0/122298912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fbc0acb10 msgr2=0x7f6fbc14df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:36.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.156+0000 7f6fc1c55700 1 --2- 172.21.15.103:0/122298912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fbc0acb10 0x7f6fbc14df50 secure :-1 s=READY pgs=228 cs=0 l=1 rx=0x7f6fb0003070 tx=0x7f6fb0010c90).stop 2020-04-22T14:03:36.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.156+0000 7f6fc1c55700 1 -- 172.21.15.103:0/122298912 shutdown_connections 2020-04-22T14:03:36.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.156+0000 7f6fc1c55700 1 --2- 172.21.15.103:0/122298912 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6fbc0aed80 0x7f6fbc142610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:36.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.156+0000 7f6fc1c55700 1 --2- 172.21.15.103:0/122298912 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6f9c04d8d0 0x7f6f9c04fd90 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:36.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.156+0000 7f6fc1c55700 1 --2- 172.21.15.103:0/122298912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fbc0acb10 0x7f6fbc14df50 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:36.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.156+0000 7f6fc1c55700 1 -- 172.21.15.103:0/122298912 >> 172.21.15.103:0/122298912 conn(0x7f6fbc05b7b0 msgr2=0x7f6fbc139360 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:36.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.156+0000 7f6fc1c55700 1 -- 172.21.15.103:0/122298912 shutdown_connections 2020-04-22T14:03:36.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.156+0000 7f6fc1c55700 1 -- 172.21.15.103:0/122298912 wait complete. 2020-04-22T14:03:36.169 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:36.182 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:03:36.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.333+0000 7f753b605700 1 Processor -- start 2020-04-22T14:03:36.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.334+0000 7f753b605700 1 -- start start 2020-04-22T14:03:36.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.334+0000 7f753b605700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f75340ac950 0x7f7534146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:36.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.334+0000 7f753b605700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75341467e0 con 0x7f75341470a0 2020-04-22T14:03:36.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.334+0000 7f753b605700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7534060050 con 0x7f75340b9140 2020-04-22T14:03:36.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.334+0000 7f753b605700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7534147530 con 0x7f75340ac950 2020-04-22T14:03:36.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.335+0000 7f7538ba0700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f75340ac950 0x7f7534146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:36.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.335+0000 7f7538ba0700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f75340ac950 0x7f7534146c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48576/0 (socket says 172.21.15.103:48576) 2020-04-22T14:03:36.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.335+0000 7f75393a1700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f75340b9140 0x7f753412b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40764/0 (socket says 172.21.15.103:40764) 2020-04-22T14:03:36.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.335+0000 7f7538ba0700 1 -- 172.21.15.103:0/2633814172 learned_addr learned my addr 172.21.15.103:0/2633814172 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:36.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.335+0000 7f7538ba0700 1 -- 172.21.15.103:0/2633814172 >> v1:172.21.15.103:6789/0 conn(0x7f75340b9140 legacy=0x7f753412b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:36.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.335+0000 7f7538ba0700 1 -- 172.21.15.103:0/2633814172 >> v1:172.21.15.86:6789/0 conn(0x7f75341470a0 legacy=0x7f7534143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:36.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.335+0000 7f7527fff700 1 -- 172.21.15.103:0/2633814172 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2966935114 0 0) 0x7f7534060050 con 0x7f75340b9140 2020-04-22T14:03:36.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.335+0000 7f7538ba0700 1 -- 172.21.15.103:0/2633814172 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75340b9520 con 0x7f75340ac950 2020-04-22T14:03:36.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.335+0000 7f7538ba0700 1 --2- 172.21.15.103:0/2633814172 >> v2:172.21.15.103:3300/0 conn(0x7f75340ac950 0x7f7534146c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7530002f30 tx=0x7f7530007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.335+0000 7f7538ba0700 1 --2- 172.21.15.103:0/2633814172 >> v2:172.21.15.103:3300/0 conn(0x7f75340ac950 0x7f7534146c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7530002f30 tx=0x7f7530007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.335+0000 7f7538ba0700 1 --2- 172.21.15.103:0/2633814172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75340ac950 0x7f7534146c40 secure :-1 s=READY pgs=371 cs=0 l=1 rx=0x7f7530002f30 tx=0x7f7530007a40).ready entity=mon.1 client_cookie=fa515f6eff5f35fc server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:36.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.335+0000 7f7538ba0700 1 --2- 172.21.15.103:0/2633814172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75340ac950 0x7f7534146c40 secure :-1 s=THROTTLE_DONE pgs=371 cs=0 l=1 rx=0x7f7530002f30 tx=0x7f7530007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.335+0000 7f7527fff700 1 -- 172.21.15.103:0/2633814172 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7530011720 con 0x7f75340ac950 2020-04-22T14:03:36.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.335+0000 7f7538ba0700 1 --2- 172.21.15.103:0/2633814172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75340ac950 0x7f7534146c40 secure :-1 s=THROTTLE_DONE pgs=371 cs=0 l=1 rx=0x7f7530002f30 tx=0x7f7530007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.335+0000 7f7527fff700 1 -- 172.21.15.103:0/2633814172 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75300118c0 con 0x7f75340ac950 2020-04-22T14:03:36.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.335+0000 7f7538ba0700 1 --2- 172.21.15.103:0/2633814172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75340ac950 0x7f7534146c40 secure :-1 s=THROTTLE_DONE pgs=371 cs=0 l=1 rx=0x7f7530002f30 tx=0x7f7530007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.335+0000 7f7527fff700 1 -- 172.21.15.103:0/2633814172 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7530011ce0 con 0x7f75340ac950 2020-04-22T14:03:36.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.335+0000 7f753b605700 1 -- 172.21.15.103:0/2633814172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75340ac950 msgr2=0x7f7534146c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:36.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.335+0000 7f753b605700 1 --2- 172.21.15.103:0/2633814172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75340ac950 0x7f7534146c40 secure :-1 s=READY pgs=371 cs=0 l=1 rx=0x7f7530002f30 tx=0x7f7530007a40).stop 2020-04-22T14:03:36.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.336+0000 7f753b605700 1 -- 172.21.15.103:0/2633814172 shutdown_connections 2020-04-22T14:03:36.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.336+0000 7f753b605700 1 --2- 172.21.15.103:0/2633814172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75340ac950 0x7f7534146c40 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:36.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.336+0000 7f753b605700 1 -- 172.21.15.103:0/2633814172 >> 172.21.15.103:0/2633814172 conn(0x7f753405b7b0 msgr2=0x7f75340b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:36.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.336+0000 7f753b605700 1 -- 172.21.15.103:0/2633814172 shutdown_connections 2020-04-22T14:03:36.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.336+0000 7f753b605700 1 -- 172.21.15.103:0/2633814172 wait complete. 2020-04-22T14:03:36.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.337+0000 7f753b605700 1 Processor -- start 2020-04-22T14:03:36.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.337+0000 7f753b605700 1 -- start start 2020-04-22T14:03:36.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.337+0000 7f753b605700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75340b9140 0x7f75340afe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:36.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.337+0000 7f753b605700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75340b02c0 con 0x7f75340ac950 2020-04-22T14:03:36.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.337+0000 7f753b605700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7534147830 con 0x7f75341470a0 2020-04-22T14:03:36.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.337+0000 7f753b605700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7534147ad0 con 0x7f75340b9140 2020-04-22T14:03:36.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.337+0000 7f7539ba2700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f75341470a0 0x7f7534064570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40774/0 (socket says 172.21.15.103:40774) 2020-04-22T14:03:36.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.337+0000 7f7539ba2700 1 -- 172.21.15.103:0/1507157346 learned_addr learned my addr 172.21.15.103:0/1507157346 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:36.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.338+0000 7f7538ba0700 1 --2- 172.21.15.103:0/1507157346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75340b9140 0x7f75340afe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:36.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.338+0000 7f75267fc700 1 -- 172.21.15.103:0/1507157346 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1103911246 0 0) 0x7f7534147830 con 0x7f75341470a0 2020-04-22T14:03:36.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.338+0000 7f75267fc700 1 -- 172.21.15.103:0/1507157346 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7514002fe0 con 0x7f75341470a0 2020-04-22T14:03:36.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.338+0000 7f75267fc700 1 -- 172.21.15.103:0/1507157346 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 954313542 0 0) 0x7f7528000fa0 con 0x7f75340ac950 2020-04-22T14:03:36.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.338+0000 7f75267fc700 1 -- 172.21.15.103:0/1507157346 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7534147830 con 0x7f75340ac950 2020-04-22T14:03:36.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.338+0000 7f75267fc700 1 -- 172.21.15.103:0/1507157346 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2766715440 0 0) 0x7f7514002fe0 con 0x7f75341470a0 2020-04-22T14:03:36.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.338+0000 7f75267fc700 1 -- 172.21.15.103:0/1507157346 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7528000fa0 con 0x7f75341470a0 2020-04-22T14:03:36.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.338+0000 7f75267fc700 1 -- 172.21.15.103:0/1507157346 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f752c001c30 con 0x7f75341470a0 2020-04-22T14:03:36.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.338+0000 7f7538ba0700 1 -- 172.21.15.103:0/1507157346 >> v1:172.21.15.103:6789/0 conn(0x7f75341470a0 legacy=0x7f7534064570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:36.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.338+0000 7f7538ba0700 1 -- 172.21.15.103:0/1507157346 >> v1:172.21.15.86:6789/0 conn(0x7f75340ac950 legacy=0x7f7534066250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:36.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.338+0000 7f7538ba0700 1 -- 172.21.15.103:0/1507157346 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7534147d70 con 0x7f75340b9140 2020-04-22T14:03:36.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.338+0000 7f7538ba0700 1 --2- 172.21.15.103:0/1507157346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75340b9140 0x7f75340afe60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7530002f30 tx=0x7f7530007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.338+0000 7f7538ba0700 1 --2- 172.21.15.103:0/1507157346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75340b9140 0x7f75340afe60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7530002f30 tx=0x7f7530007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.338+0000 7f7538ba0700 1 --2- 172.21.15.103:0/1507157346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75340b9140 0x7f75340afe60 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7f7530002f30 tx=0x7f7530007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:36.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.338+0000 7f7538ba0700 1 --2- 172.21.15.103:0/1507157346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75340b9140 0x7f75340afe60 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f7530002f30 tx=0x7f7530007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.338+0000 7f75267fc700 1 -- 172.21.15.103:0/1507157346 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7530011d60 con 0x7f75340b9140 2020-04-22T14:03:36.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.338+0000 7f7538ba0700 1 --2- 172.21.15.103:0/1507157346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75340b9140 0x7f75340afe60 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f7530002f30 tx=0x7f7530007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.338+0000 7f75267fc700 1 -- 172.21.15.103:0/1507157346 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7530007170 con 0x7f75340b9140 2020-04-22T14:03:36.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.338+0000 7f7538ba0700 1 --2- 172.21.15.103:0/1507157346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75340b9140 0x7f75340afe60 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f7530002f30 tx=0x7f7530007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.338+0000 7f753b605700 1 -- 172.21.15.103:0/1507157346 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75340b2850 con 0x7f75340b9140 2020-04-22T14:03:36.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.338+0000 7f75267fc700 1 -- 172.21.15.103:0/1507157346 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75300074d0 con 0x7f75340b9140 2020-04-22T14:03:36.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.338+0000 7f753b605700 1 -- 172.21.15.103:0/1507157346 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7534145b40 con 0x7f75340b9140 2020-04-22T14:03:36.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.339+0000 7f7538ba0700 1 --2- 172.21.15.103:0/1507157346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75340b9140 0x7f75340afe60 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f7530002f30 tx=0x7f7530007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.339+0000 7f75267fc700 1 -- 172.21.15.103:0/1507157346 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f75300056c0 con 0x7f75340b9140 2020-04-22T14:03:36.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.339+0000 7f7538ba0700 1 --2- 172.21.15.103:0/1507157346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75340b9140 0x7f75340afe60 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f7530002f30 tx=0x7f7530007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.339+0000 7f753b605700 1 -- 172.21.15.103:0/1507157346 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7534066090 con 0x7f75340b9140 2020-04-22T14:03:36.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.339+0000 7f75267fc700 1 --2- 172.21.15.103:0/1507157346 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f751404e0e0 0x7f75140505a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:36.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.340+0000 7f75267fc700 1 -- 172.21.15.103:0/1507157346 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f75300618b0 con 0x7f75340b9140 2020-04-22T14:03:36.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.340+0000 7f75393a1700 1 --2- 172.21.15.103:0/1507157346 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f751404e0e0 0x7f75140505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:36.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.340+0000 7f75393a1700 1 --2- 172.21.15.103:0/1507157346 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f751404e0e0 0x7f75140505a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7528001130 tx=0x7f7528001810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.340+0000 7f75393a1700 1 --2- 172.21.15.103:0/1507157346 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f751404e0e0 0x7f75140505a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7528001130 tx=0x7f7528001810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.340+0000 7f75393a1700 1 --2- 172.21.15.103:0/1507157346 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f751404e0e0 0x7f75140505a0 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7f7528001130 tx=0x7f7528001810).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:36.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.343+0000 7f7538ba0700 1 --2- 172.21.15.103:0/1507157346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75340b9140 0x7f75340afe60 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f7530002f30 tx=0x7f7530007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.343+0000 7f75267fc700 1 -- 172.21.15.103:0/1507157346 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f753003cc90 con 0x7f75340b9140 2020-04-22T14:03:36.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.487+0000 7f753b605700 1 -- 172.21.15.103:0/1507157346 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7534056c90 con 0x7f75340b9140 2020-04-22T14:03:36.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.488+0000 7f7538ba0700 1 --2- 172.21.15.103:0/1507157346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75340b9140 0x7f75340afe60 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f7530002f30 tx=0x7f7530007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.488+0000 7f75267fc700 1 -- 172.21.15.103:0/1507157346 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f75300402b0 con 0x7f75340b9140 2020-04-22T14:03:36.492 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:03:36.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.489+0000 7f753b605700 1 -- 172.21.15.103:0/1507157346 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f751404e0e0 msgr2=0x7f75140505a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:36.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.489+0000 7f753b605700 1 --2- 172.21.15.103:0/1507157346 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f751404e0e0 0x7f75140505a0 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7f7528001130 tx=0x7f7528001810).stop 2020-04-22T14:03:36.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.489+0000 7f753b605700 1 -- 172.21.15.103:0/1507157346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75340b9140 msgr2=0x7f75340afe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:36.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.489+0000 7f753b605700 1 --2- 172.21.15.103:0/1507157346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75340b9140 0x7f75340afe60 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7f7530002f30 tx=0x7f7530007a40).stop 2020-04-22T14:03:36.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.489+0000 7f753b605700 1 -- 172.21.15.103:0/1507157346 shutdown_connections 2020-04-22T14:03:36.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.489+0000 7f753b605700 1 --2- 172.21.15.103:0/1507157346 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f751404e0e0 0x7f75140505a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:36.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.489+0000 7f753b605700 1 --2- 172.21.15.103:0/1507157346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75340b9140 0x7f75340afe60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:36.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.489+0000 7f753b605700 1 -- 172.21.15.103:0/1507157346 >> 172.21.15.103:0/1507157346 conn(0x7f753405b7b0 msgr2=0x7f75340b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:36.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.489+0000 7f753b605700 1 -- 172.21.15.103:0/1507157346 shutdown_connections 2020-04-22T14:03:36.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.489+0000 7f753b605700 1 -- 172.21.15.103:0/1507157346 wait complete. 2020-04-22T14:03:36.502 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:36.519 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-04-22T14:03:36.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.662+0000 7fcf5a4f6700 1 Processor -- start 2020-04-22T14:03:36.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.662+0000 7fcf5a4f6700 1 -- start start 2020-04-22T14:03:36.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.663+0000 7fcf5a4f6700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcf5412c0d0 0x7fcf541464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:36.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.663+0000 7fcf5a4f6700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf54143300 con 0x7fcf54063e30 2020-04-22T14:03:36.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.663+0000 7fcf5a4f6700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf541435a0 con 0x7fcf54065fe0 2020-04-22T14:03:36.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.663+0000 7fcf5a4f6700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf54143840 con 0x7fcf5412c0d0 2020-04-22T14:03:36.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.663+0000 7fcf537fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fcf54065fe0 0x7fcf5405b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40778/0 (socket says 172.21.15.103:40778) 2020-04-22T14:03:36.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.663+0000 7fcf537fe700 1 -- 172.21.15.103:0/2836556336 learned_addr learned my addr 172.21.15.103:0/2836556336 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:36.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.663+0000 7fcf53fff700 1 --2- 172.21.15.103:0/2836556336 >> v2:172.21.15.86:3300/0 conn(0x7fcf5412c0d0 0x7fcf541464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:36.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.663+0000 7fcf52ffd700 1 -- 172.21.15.103:0/2836556336 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2234376279 0 0) 0x7fcf541435a0 con 0x7fcf54065fe0 2020-04-22T14:03:36.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.663+0000 7fcf52ffd700 1 -- 172.21.15.103:0/2836556336 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf40003230 con 0x7fcf54065fe0 2020-04-22T14:03:36.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.664+0000 7fcf53fff700 1 -- 172.21.15.103:0/2836556336 >> v1:172.21.15.103:6789/0 conn(0x7fcf54065fe0 legacy=0x7fcf5405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:36.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.664+0000 7fcf53fff700 1 -- 172.21.15.103:0/2836556336 >> v1:172.21.15.86:6789/0 conn(0x7fcf54063e30 legacy=0x7fcf540642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:36.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.664+0000 7fcf52ffd700 1 -- 172.21.15.103:0/2836556336 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4209637739 0 0) 0x7fcf54143300 con 0x7fcf54063e30 2020-04-22T14:03:36.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.664+0000 7fcf53fff700 1 -- 172.21.15.103:0/2836556336 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5405bb50 con 0x7fcf5412c0d0 2020-04-22T14:03:36.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.664+0000 7fcf53fff700 1 --2- 172.21.15.103:0/2836556336 >> v2:172.21.15.86:3300/0 conn(0x7fcf5412c0d0 0x7fcf541464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcf44002f30 tx=0x7fcf44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.664+0000 7fcf53fff700 1 --2- 172.21.15.103:0/2836556336 >> v2:172.21.15.86:3300/0 conn(0x7fcf5412c0d0 0x7fcf541464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcf44002f30 tx=0x7fcf44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.664+0000 7fcf53fff700 1 --2- 172.21.15.103:0/2836556336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcf5412c0d0 0x7fcf541464e0 secure :-1 s=READY pgs=232 cs=0 l=1 rx=0x7fcf44002f30 tx=0x7fcf44007a40).ready entity=mon.0 client_cookie=8451bade92423316 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:36.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.664+0000 7fcf53fff700 1 --2- 172.21.15.103:0/2836556336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcf5412c0d0 0x7fcf541464e0 secure :-1 s=THROTTLE_DONE pgs=232 cs=0 l=1 rx=0x7fcf44002f30 tx=0x7fcf44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.664+0000 7fcf52ffd700 1 -- 172.21.15.103:0/2836556336 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf440113c0 con 0x7fcf5412c0d0 2020-04-22T14:03:36.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.664+0000 7fcf53fff700 1 --2- 172.21.15.103:0/2836556336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcf5412c0d0 0x7fcf541464e0 secure :-1 s=THROTTLE_DONE pgs=232 cs=0 l=1 rx=0x7fcf44002f30 tx=0x7fcf44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.664+0000 7fcf53fff700 1 --2- 172.21.15.103:0/2836556336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcf5412c0d0 0x7fcf541464e0 secure :-1 s=THROTTLE_DONE pgs=232 cs=0 l=1 rx=0x7fcf44002f30 tx=0x7fcf44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.664+0000 7fcf52ffd700 1 -- 172.21.15.103:0/2836556336 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf44011520 con 0x7fcf5412c0d0 2020-04-22T14:03:36.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.664+0000 7fcf52ffd700 1 -- 172.21.15.103:0/2836556336 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf440118c0 con 0x7fcf5412c0d0 2020-04-22T14:03:36.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.664+0000 7fcf5a4f6700 1 -- 172.21.15.103:0/2836556336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcf5412c0d0 msgr2=0x7fcf541464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:36.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.664+0000 7fcf5a4f6700 1 --2- 172.21.15.103:0/2836556336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcf5412c0d0 0x7fcf541464e0 secure :-1 s=READY pgs=232 cs=0 l=1 rx=0x7fcf44002f30 tx=0x7fcf44007a40).stop 2020-04-22T14:03:36.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.664+0000 7fcf5a4f6700 1 -- 172.21.15.103:0/2836556336 shutdown_connections 2020-04-22T14:03:36.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.664+0000 7fcf5a4f6700 1 --2- 172.21.15.103:0/2836556336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcf5412c0d0 0x7fcf541464e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:36.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.664+0000 7fcf5a4f6700 1 -- 172.21.15.103:0/2836556336 >> 172.21.15.103:0/2836556336 conn(0x7fcf540b9160 msgr2=0x7fcf5405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:36.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.664+0000 7fcf5a4f6700 1 -- 172.21.15.103:0/2836556336 shutdown_connections 2020-04-22T14:03:36.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.664+0000 7fcf5a4f6700 1 -- 172.21.15.103:0/2836556336 wait complete. 2020-04-22T14:03:36.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.665+0000 7fcf5a4f6700 1 Processor -- start 2020-04-22T14:03:36.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.665+0000 7fcf5a4f6700 1 -- start start 2020-04-22T14:03:36.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.666+0000 7fcf5a4f6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcf5412c0d0 0x7fcf540b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:36.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.666+0000 7fcf5a4f6700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf540b3840 con 0x7fcf54065fe0 2020-04-22T14:03:36.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.666+0000 7fcf5a4f6700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf541402f0 con 0x7fcf54063e30 2020-04-22T14:03:36.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.666+0000 7fcf5a4f6700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf54140590 con 0x7fcf5412c0d0 2020-04-22T14:03:36.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.666+0000 7fcf53fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fcf54063e30 0x7fcf54064f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40782/0 (socket says 172.21.15.103:40782) 2020-04-22T14:03:36.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.666+0000 7fcf53fff700 1 -- 172.21.15.103:0/3787379262 learned_addr learned my addr 172.21.15.103:0/3787379262 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:36.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.666+0000 7fcf517fa700 1 -- 172.21.15.103:0/3787379262 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3645722790 0 0) 0x7fcf541402f0 con 0x7fcf54063e30 2020-04-22T14:03:36.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.666+0000 7fcf517fa700 1 -- 172.21.15.103:0/3787379262 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf34002fe0 con 0x7fcf54063e30 2020-04-22T14:03:36.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.667+0000 7fcf58a93700 1 --2- 172.21.15.103:0/3787379262 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcf5412c0d0 0x7fcf540b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:36.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.667+0000 7fcf517fa700 1 -- 172.21.15.103:0/3787379262 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1367805881 0 0) 0x7fcf34002fe0 con 0x7fcf54063e30 2020-04-22T14:03:36.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.667+0000 7fcf517fa700 1 -- 172.21.15.103:0/3787379262 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcf541402f0 con 0x7fcf54063e30 2020-04-22T14:03:36.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.667+0000 7fcf517fa700 1 -- 172.21.15.103:0/3787379262 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fcf44011e80 con 0x7fcf54063e30 2020-04-22T14:03:36.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.667+0000 7fcf517fa700 1 -- 172.21.15.103:0/3787379262 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcf5412c0d0 msgr2=0x7fcf540b33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:36.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.667+0000 7fcf517fa700 1 --2- 172.21.15.103:0/3787379262 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcf5412c0d0 0x7fcf540b33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:36.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.667+0000 7fcf517fa700 1 -- 172.21.15.103:0/3787379262 >> v1:172.21.15.103:6789/0 conn(0x7fcf54063e30 legacy=0x7fcf54064f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:36.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.667+0000 7fcf517fa700 1 -- 172.21.15.103:0/3787379262 >> v1:172.21.15.86:6789/0 conn(0x7fcf54065fe0 legacy=0x7fcf540b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:36.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.667+0000 7fcf517fa700 1 --2- 172.21.15.103:0/3787379262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf340049b0 0x7fcf34004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:36.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.667+0000 7fcf517fa700 1 --2- 172.21.15.103:0/3787379262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcf340051f0 0x7fcf34003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:36.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.667+0000 7fcf517fa700 1 --2- 172.21.15.103:0/3787379262 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcf5412c0d0 0x7fcf34003f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:36.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.667+0000 7fcf517fa700 1 -- 172.21.15.103:0/3787379262 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf54140590 con 0x7fcf340051f0 2020-04-22T14:03:36.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.667+0000 7fcf517fa700 1 -- 172.21.15.103:0/3787379262 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf340043d0 con 0x7fcf340049b0 2020-04-22T14:03:36.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.667+0000 7fcf517fa700 1 -- 172.21.15.103:0/3787379262 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf34004590 con 0x7fcf5412c0d0 2020-04-22T14:03:36.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.667+0000 7fcf53fff700 1 --2- 172.21.15.103:0/3787379262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf340049b0 0x7fcf34004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:36.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.667+0000 7fcf58a93700 1 --2- 172.21.15.103:0/3787379262 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcf5412c0d0 0x7fcf34003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:36.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.667+0000 7fcf537fe700 1 --2- 172.21.15.103:0/3787379262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcf340051f0 0x7fcf34003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:36.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.667+0000 7fcf53fff700 1 -- 172.21.15.103:0/3787379262 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcf5412c0d0 msgr2=0x7fcf34003f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:36.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.667+0000 7fcf53fff700 1 --2- 172.21.15.103:0/3787379262 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcf5412c0d0 0x7fcf34003f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:36.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.667+0000 7fcf53fff700 1 -- 172.21.15.103:0/3787379262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcf340051f0 msgr2=0x7fcf34003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:36.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.667+0000 7fcf53fff700 1 --2- 172.21.15.103:0/3787379262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcf340051f0 0x7fcf34003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:36.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.667+0000 7fcf53fff700 1 -- 172.21.15.103:0/3787379262 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf540b2050 con 0x7fcf340049b0 2020-04-22T14:03:36.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.667+0000 7fcf5a4f6700 1 -- 172.21.15.103:0/3787379262 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf5413ffe0 con 0x7fcf340049b0 2020-04-22T14:03:36.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.667+0000 7fcf537fe700 1 --2- 172.21.15.103:0/3787379262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcf340051f0 0x7fcf34003920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:03:36.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.667+0000 7fcf53fff700 1 --2- 172.21.15.103:0/3787379262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf340049b0 0x7fcf34004d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcf44010150 tx=0x7fcf44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.667+0000 7fcf5a4f6700 1 -- 172.21.15.103:0/3787379262 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf54142140 con 0x7fcf340049b0 2020-04-22T14:03:36.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.667+0000 7fcf53fff700 1 --2- 172.21.15.103:0/3787379262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf340049b0 0x7fcf34004d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcf44010150 tx=0x7fcf44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.667+0000 7fcf53fff700 1 --2- 172.21.15.103:0/3787379262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf340049b0 0x7fcf34004d90 secure :-1 s=READY pgs=375 cs=0 l=1 rx=0x7fcf44010150 tx=0x7fcf44007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:36.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.667+0000 7fcf53fff700 1 --2- 172.21.15.103:0/3787379262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf340049b0 0x7fcf34004d90 secure :-1 s=THROTTLE_DONE pgs=375 cs=0 l=1 rx=0x7fcf44010150 tx=0x7fcf44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.667+0000 7fcf517fa700 1 -- 172.21.15.103:0/3787379262 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf44007550 con 0x7fcf340049b0 2020-04-22T14:03:36.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.668+0000 7fcf53fff700 1 --2- 172.21.15.103:0/3787379262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf340049b0 0x7fcf34004d90 secure :-1 s=THROTTLE_DONE pgs=375 cs=0 l=1 rx=0x7fcf44010150 tx=0x7fcf44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.668+0000 7fcf53fff700 1 --2- 172.21.15.103:0/3787379262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf340049b0 0x7fcf34004d90 secure :-1 s=THROTTLE_DONE pgs=375 cs=0 l=1 rx=0x7fcf44010150 tx=0x7fcf44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.668+0000 7fcf517fa700 1 -- 172.21.15.103:0/3787379262 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4400a700 con 0x7fcf340049b0 2020-04-22T14:03:36.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.668+0000 7fcf517fa700 1 -- 172.21.15.103:0/3787379262 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf4400ab20 con 0x7fcf340049b0 2020-04-22T14:03:36.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.668+0000 7fcf53fff700 1 --2- 172.21.15.103:0/3787379262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf340049b0 0x7fcf34004d90 secure :-1 s=THROTTLE_DONE pgs=375 cs=0 l=1 rx=0x7fcf44010150 tx=0x7fcf44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.668+0000 7fcf5a4f6700 1 -- 172.21.15.103:0/3787379262 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf30003340 con 0x7fcf340049b0 2020-04-22T14:03:36.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.668+0000 7fcf517fa700 1 -- 172.21.15.103:0/3787379262 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fcf4400ac80 con 0x7fcf340049b0 2020-04-22T14:03:36.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.668+0000 7fcf53fff700 1 --2- 172.21.15.103:0/3787379262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf340049b0 0x7fcf34004d90 secure :-1 s=THROTTLE_DONE pgs=375 cs=0 l=1 rx=0x7fcf44010150 tx=0x7fcf44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.669+0000 7fcf517fa700 1 --2- 172.21.15.103:0/3787379262 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcf34055b50 0x7fcf34058010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:36.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.669+0000 7fcf517fa700 1 -- 172.21.15.103:0/3787379262 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fcf44062620 con 0x7fcf340049b0 2020-04-22T14:03:36.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.669+0000 7fcf537fe700 1 --2- 172.21.15.103:0/3787379262 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcf34055b50 0x7fcf34058010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:36.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.669+0000 7fcf537fe700 1 --2- 172.21.15.103:0/3787379262 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcf34055b50 0x7fcf34058010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcf48001190 tx=0x7fcf48001920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.669+0000 7fcf537fe700 1 --2- 172.21.15.103:0/3787379262 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcf34055b50 0x7fcf34058010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcf48001190 tx=0x7fcf48001920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.669+0000 7fcf537fe700 1 --2- 172.21.15.103:0/3787379262 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcf34055b50 0x7fcf34058010 secure :-1 s=READY pgs=156 cs=0 l=1 rx=0x7fcf48001190 tx=0x7fcf48001920).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:36.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.673+0000 7fcf53fff700 1 --2- 172.21.15.103:0/3787379262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf340049b0 0x7fcf34004d90 secure :-1 s=THROTTLE_DONE pgs=375 cs=0 l=1 rx=0x7fcf44010150 tx=0x7fcf44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.673+0000 7fcf517fa700 1 -- 172.21.15.103:0/3787379262 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fcf4403db20 con 0x7fcf340049b0 2020-04-22T14:03:36.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.818+0000 7fcf5a4f6700 1 -- 172.21.15.103:0/3787379262 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fcf300021d0 con 0x7fcf340049b0 2020-04-22T14:03:36.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.819+0000 7fcf53fff700 1 --2- 172.21.15.103:0/3787379262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf340049b0 0x7fcf34004d90 secure :-1 s=THROTTLE_DONE pgs=375 cs=0 l=1 rx=0x7fcf44010150 tx=0x7fcf44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:36.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.819+0000 7fcf517fa700 1 -- 172.21.15.103:0/3787379262 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+143 (secure 0 0 0) 0x7fcf44041140 con 0x7fcf340049b0 2020-04-22T14:03:36.822 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:03:36.822 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2020-04-22T14:03:36.822 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:36.823 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 1, 2020-04-22T14:03:36.823 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": "device_health_metrics" 2020-04-22T14:03:36.823 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:36.823 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:03:36.823 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 2, 2020-04-22T14:03:36.823 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": "rbd" 2020-04-22T14:03:36.823 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:36.824 INFO:teuthology.orchestra.run.smithi103.stdout:] 2020-04-22T14:03:36.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.820+0000 7fcf5a4f6700 1 -- 172.21.15.103:0/3787379262 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcf34055b50 msgr2=0x7fcf34058010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:36.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.820+0000 7fcf5a4f6700 1 --2- 172.21.15.103:0/3787379262 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcf34055b50 0x7fcf34058010 secure :-1 s=READY pgs=156 cs=0 l=1 rx=0x7fcf48001190 tx=0x7fcf48001920).stop 2020-04-22T14:03:36.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.820+0000 7fcf5a4f6700 1 -- 172.21.15.103:0/3787379262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf340049b0 msgr2=0x7fcf34004d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:36.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.820+0000 7fcf58a93700 1 -- 172.21.15.103:0/3787379262 reap_dead start 2020-04-22T14:03:36.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.820+0000 7fcf5a4f6700 1 --2- 172.21.15.103:0/3787379262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf340049b0 0x7fcf34004d90 secure :-1 s=READY pgs=375 cs=0 l=1 rx=0x7fcf44010150 tx=0x7fcf44007a40).stop 2020-04-22T14:03:36.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.820+0000 7fcf5a4f6700 1 -- 172.21.15.103:0/3787379262 shutdown_connections 2020-04-22T14:03:36.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.820+0000 7fcf5a4f6700 1 --2- 172.21.15.103:0/3787379262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf340049b0 0x7fcf34004d90 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:36.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.820+0000 7fcf5a4f6700 1 -- 172.21.15.103:0/3787379262 >> 172.21.15.103:0/3787379262 conn(0x7fcf540b9160 msgr2=0x7fcf540b4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:36.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.820+0000 7fcf5a4f6700 1 -- 172.21.15.103:0/3787379262 shutdown_connections 2020-04-22T14:03:36.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.820+0000 7fcf5a4f6700 1 -- 172.21.15.103:0/3787379262 wait complete. 2020-04-22T14:03:36.833 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-04-22T14:03:36.834 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:36.847 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-04-22T14:03:36.996 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.993+0000 7fd73dd13700 1 Processor -- start 2020-04-22T14:03:36.996 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.993+0000 7fd73dd13700 1 -- start start 2020-04-22T14:03:37.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.994+0000 7fd73dd13700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd7380b9140 0x7fd73812b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:37.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.994+0000 7fd73dd13700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd7380ac950 0x7fd73812b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:37.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.994+0000 7fd73dd13700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd738146c40 0x7fd7381470f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:37.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.994+0000 7fd73dd13700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7380602f0 con 0x7fd7380ac950 2020-04-22T14:03:37.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.994+0000 7fd73dd13700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7381467e0 con 0x7fd7380b9140 2020-04-22T14:03:37.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.994+0000 7fd73dd13700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd738060050 con 0x7fd738146c40 2020-04-22T14:03:37.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.994+0000 7fd7377fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd7380b9140 0x7fd73812b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:37.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.994+0000 7fd7377fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd7380b9140 0x7fd73812b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48606/0 (socket says 172.21.15.103:48606) 2020-04-22T14:03:37.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.994+0000 7fd7377fe700 1 -- 172.21.15.103:0/819452508 learned_addr learned my addr 172.21.15.103:0/819452508 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:37.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.994+0000 7fd737fff700 1 --2- 172.21.15.103:0/819452508 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd738146c40 0x7fd7381470f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:37.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.994+0000 7fd736ffd700 1 --2- 172.21.15.103:0/819452508 >> v2:172.21.15.86:3300/0 conn(0x7fd7380ac950 0x7fd73812b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:37.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.994+0000 7fd7377fe700 1 -- 172.21.15.103:0/819452508 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd738146c40 msgr2=0x7fd7381470f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:37.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.994+0000 7fd7377fe700 1 --2- 172.21.15.103:0/819452508 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd738146c40 0x7fd7381470f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:37.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.994+0000 7fd7377fe700 1 -- 172.21.15.103:0/819452508 >> v2:172.21.15.86:3300/0 conn(0x7fd7380ac950 msgr2=0x7fd73812b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:37.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.994+0000 7fd7377fe700 1 --2- 172.21.15.103:0/819452508 >> v2:172.21.15.86:3300/0 conn(0x7fd7380ac950 0x7fd73812b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:37.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.994+0000 7fd7377fe700 1 -- 172.21.15.103:0/819452508 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7380b9520 con 0x7fd7380b9140 2020-04-22T14:03:37.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.994+0000 7fd7377fe700 1 --2- 172.21.15.103:0/819452508 >> v2:172.21.15.103:3300/0 conn(0x7fd7380b9140 0x7fd73812b210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd7280032b0 tx=0x7fd728007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:37.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.994+0000 7fd7377fe700 1 --2- 172.21.15.103:0/819452508 >> v2:172.21.15.103:3300/0 conn(0x7fd7380b9140 0x7fd73812b210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd7280032b0 tx=0x7fd728007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:37.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.994+0000 7fd7377fe700 1 --2- 172.21.15.103:0/819452508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7380b9140 0x7fd73812b210 secure :-1 s=READY pgs=376 cs=0 l=1 rx=0x7fd7280032b0 tx=0x7fd728007dc0).ready entity=mon.1 client_cookie=e33ddf29d91879b9 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:37.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.994+0000 7fd7377fe700 1 --2- 172.21.15.103:0/819452508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7380b9140 0x7fd73812b210 secure :-1 s=THROTTLE_DONE pgs=376 cs=0 l=1 rx=0x7fd7280032b0 tx=0x7fd728007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:37.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.994+0000 7fd7367fc700 1 -- 172.21.15.103:0/819452508 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd728011e30 con 0x7fd7380b9140 2020-04-22T14:03:37.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.995+0000 7fd7377fe700 1 --2- 172.21.15.103:0/819452508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7380b9140 0x7fd73812b210 secure :-1 s=THROTTLE_DONE pgs=376 cs=0 l=1 rx=0x7fd7280032b0 tx=0x7fd728007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:37.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.995+0000 7fd7377fe700 1 --2- 172.21.15.103:0/819452508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7380b9140 0x7fd73812b210 secure :-1 s=THROTTLE_DONE pgs=376 cs=0 l=1 rx=0x7fd7280032b0 tx=0x7fd728007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:37.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.995+0000 7fd7367fc700 1 -- 172.21.15.103:0/819452508 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd72800a180 con 0x7fd7380b9140 2020-04-22T14:03:37.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.995+0000 7fd7367fc700 1 -- 172.21.15.103:0/819452508 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd72800a5a0 con 0x7fd7380b9140 2020-04-22T14:03:37.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.995+0000 7fd73dd13700 1 -- 172.21.15.103:0/819452508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7380b9140 msgr2=0x7fd73812b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:37.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.995+0000 7fd73dd13700 1 --2- 172.21.15.103:0/819452508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7380b9140 0x7fd73812b210 secure :-1 s=READY pgs=376 cs=0 l=1 rx=0x7fd7280032b0 tx=0x7fd728007dc0).stop 2020-04-22T14:03:37.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.995+0000 7fd73dd13700 1 -- 172.21.15.103:0/819452508 shutdown_connections 2020-04-22T14:03:37.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.995+0000 7fd73dd13700 1 --2- 172.21.15.103:0/819452508 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd738146c40 0x7fd7381470f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:37.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.995+0000 7fd73dd13700 1 --2- 172.21.15.103:0/819452508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7380b9140 0x7fd73812b210 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:37.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.995+0000 7fd73dd13700 1 --2- 172.21.15.103:0/819452508 >> v2:172.21.15.86:3300/0 conn(0x7fd7380ac950 0x7fd73812b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:37.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.995+0000 7fd73dd13700 1 -- 172.21.15.103:0/819452508 >> 172.21.15.103:0/819452508 conn(0x7fd73805b7b0 msgr2=0x7fd7380b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:37.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.995+0000 7fd73dd13700 1 -- 172.21.15.103:0/819452508 shutdown_connections 2020-04-22T14:03:37.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.995+0000 7fd73dd13700 1 -- 172.21.15.103:0/819452508 wait complete. 2020-04-22T14:03:37.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.996+0000 7fd73dd13700 1 Processor -- start 2020-04-22T14:03:37.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.996+0000 7fd73dd13700 1 -- start start 2020-04-22T14:03:37.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.997+0000 7fd73dd13700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd7380ac950 0x7fd7381514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:37.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.997+0000 7fd73dd13700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd738146c40 0x7fd738061b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:37.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.997+0000 7fd73dd13700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd738061f70 con 0x7fd7380b9140 2020-04-22T14:03:37.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.997+0000 7fd73dd13700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7380aff00 con 0x7fd738146c40 2020-04-22T14:03:37.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.997+0000 7fd73dd13700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7380b01a0 con 0x7fd7380ac950 2020-04-22T14:03:37.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.997+0000 7fd736ffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd7380b9140 0x7fd738151c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40804/0 (socket says 172.21.15.103:40804) 2020-04-22T14:03:37.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.997+0000 7fd736ffd700 1 -- 172.21.15.103:0/3907684518 learned_addr learned my addr 172.21.15.103:0/3907684518 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:37.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.997+0000 7fd7377fe700 1 --2- 172.21.15.103:0/3907684518 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd7380ac950 0x7fd7381514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:37.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.997+0000 7fd737fff700 1 --2- 172.21.15.103:0/3907684518 >> v2:172.21.15.86:3300/0 conn(0x7fd738146c40 0x7fd738061b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:37.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.997+0000 7fd734ff9700 1 -- 172.21.15.103:0/3907684518 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2732699678 0 0) 0x7fd738061f70 con 0x7fd7380b9140 2020-04-22T14:03:37.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.997+0000 7fd734ff9700 1 -- 172.21.15.103:0/3907684518 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd718002fe0 con 0x7fd7380b9140 2020-04-22T14:03:37.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.997+0000 7fd7377fe700 1 -- 172.21.15.103:0/3907684518 >> v2:172.21.15.86:3300/0 conn(0x7fd738146c40 msgr2=0x7fd738061b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:37.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.997+0000 7fd7377fe700 1 --2- 172.21.15.103:0/3907684518 >> v2:172.21.15.86:3300/0 conn(0x7fd738146c40 0x7fd738061b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:37.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.997+0000 7fd7377fe700 1 -- 172.21.15.103:0/3907684518 >> v1:172.21.15.103:6789/0 conn(0x7fd7380b9140 legacy=0x7fd738151c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:37.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.997+0000 7fd7377fe700 1 -- 172.21.15.103:0/3907684518 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7380b0440 con 0x7fd7380ac950 2020-04-22T14:03:37.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.997+0000 7fd7377fe700 1 --2- 172.21.15.103:0/3907684518 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd7380ac950 0x7fd7381514c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd7280032b0 tx=0x7fd728007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:37.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.998+0000 7fd7377fe700 1 --2- 172.21.15.103:0/3907684518 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd7380ac950 0x7fd7381514c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd7280032b0 tx=0x7fd728007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:37.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.998+0000 7fd7377fe700 1 --2- 172.21.15.103:0/3907684518 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd7380ac950 0x7fd7381514c0 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7fd7280032b0 tx=0x7fd728007dc0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:37.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.998+0000 7fd7377fe700 1 --2- 172.21.15.103:0/3907684518 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd7380ac950 0x7fd7381514c0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fd7280032b0 tx=0x7fd728007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:37.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.998+0000 7fd734ff9700 1 -- 172.21.15.103:0/3907684518 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd72800fc40 con 0x7fd7380ac950 2020-04-22T14:03:37.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.998+0000 7fd7377fe700 1 --2- 172.21.15.103:0/3907684518 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd7380ac950 0x7fd7381514c0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fd7280032b0 tx=0x7fd728007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:37.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.998+0000 7fd734ff9700 1 -- 172.21.15.103:0/3907684518 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd728005c30 con 0x7fd7380ac950 2020-04-22T14:03:37.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.998+0000 7fd7377fe700 1 --2- 172.21.15.103:0/3907684518 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd7380ac950 0x7fd7381514c0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fd7280032b0 tx=0x7fd728007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:37.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.998+0000 7fd73dd13700 1 -- 172.21.15.103:0/3907684518 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd738152350 con 0x7fd7380ac950 2020-04-22T14:03:37.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.998+0000 7fd734ff9700 1 -- 172.21.15.103:0/3907684518 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd728007170 con 0x7fd7380ac950 2020-04-22T14:03:37.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.998+0000 7fd73dd13700 1 -- 172.21.15.103:0/3907684518 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7380afa30 con 0x7fd7380ac950 2020-04-22T14:03:37.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.998+0000 7fd7377fe700 1 --2- 172.21.15.103:0/3907684518 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd7380ac950 0x7fd7381514c0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fd7280032b0 tx=0x7fd728007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:37.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.999+0000 7fd73dd13700 1 -- 172.21.15.103:0/3907684518 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7380afd40 con 0x7fd7380ac950 2020-04-22T14:03:37.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.999+0000 7fd734ff9700 1 -- 172.21.15.103:0/3907684518 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fd728007370 con 0x7fd7380ac950 2020-04-22T14:03:37.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.999+0000 7fd7377fe700 1 --2- 172.21.15.103:0/3907684518 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd7380ac950 0x7fd7381514c0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fd7280032b0 tx=0x7fd728007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:37.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.999+0000 7fd734ff9700 1 --2- 172.21.15.103:0/3907684518 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd71804dd40 0x7fd718050200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:37.016 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.999+0000 7fd734ff9700 1 -- 172.21.15.103:0/3907684518 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fd728061e70 con 0x7fd7380ac950 2020-04-22T14:03:37.016 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.999+0000 7fd736ffd700 1 --2- 172.21.15.103:0/3907684518 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd71804dd40 0x7fd718050200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:37.016 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.999+0000 7fd736ffd700 1 --2- 172.21.15.103:0/3907684518 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd71804dd40 0x7fd718050200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd72c002f30 tx=0x7fd72c0098b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:37.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.999+0000 7fd736ffd700 1 --2- 172.21.15.103:0/3907684518 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd71804dd40 0x7fd718050200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd72c002f30 tx=0x7fd72c0098b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:37.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:36.999+0000 7fd736ffd700 1 --2- 172.21.15.103:0/3907684518 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd71804dd40 0x7fd718050200 secure :-1 s=READY pgs=157 cs=0 l=1 rx=0x7fd72c002f30 tx=0x7fd72c0098b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:37.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.003+0000 7fd7377fe700 1 --2- 172.21.15.103:0/3907684518 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd7380ac950 0x7fd7381514c0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fd7280032b0 tx=0x7fd728007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:37.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.003+0000 7fd734ff9700 1 -- 172.21.15.103:0/3907684518 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fd72803d2b0 con 0x7fd7380ac950 2020-04-22T14:03:37.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.147+0000 7fd73dd13700 1 -- 172.21.15.103:0/3907684518 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fd738056c90 con 0x7fd7380ac950 2020-04-22T14:03:37.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.532+0000 7fd7377fe700 1 --2- 172.21.15.103:0/3907684518 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd7380ac950 0x7fd7381514c0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fd7280032b0 tx=0x7fd728007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:37.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.532+0000 7fd734ff9700 1 -- 172.21.15.103:0/3907684518 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v31) v1 ==== 133+0+0 (secure 0 0 0) 0x7fd7280408d0 con 0x7fd7380ac950 2020-04-22T14:03:37.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.534+0000 7fd73dd13700 1 -- 172.21.15.103:0/3907684518 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd71804dd40 msgr2=0x7fd718050200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:37.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.534+0000 7fd73dd13700 1 --2- 172.21.15.103:0/3907684518 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd71804dd40 0x7fd718050200 secure :-1 s=READY pgs=157 cs=0 l=1 rx=0x7fd72c002f30 tx=0x7fd72c0098b0).stop 2020-04-22T14:03:37.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.534+0000 7fd73dd13700 1 -- 172.21.15.103:0/3907684518 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd7380ac950 msgr2=0x7fd7381514c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:37.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.534+0000 7fd73dd13700 1 --2- 172.21.15.103:0/3907684518 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd7380ac950 0x7fd7381514c0 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7fd7280032b0 tx=0x7fd728007dc0).stop 2020-04-22T14:03:37.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.534+0000 7fd73dd13700 1 -- 172.21.15.103:0/3907684518 shutdown_connections 2020-04-22T14:03:37.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.534+0000 7fd73dd13700 1 --2- 172.21.15.103:0/3907684518 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd71804dd40 0x7fd718050200 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:37.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.534+0000 7fd73dd13700 1 --2- 172.21.15.103:0/3907684518 >> v2:172.21.15.86:3300/0 conn(0x7fd738146c40 0x7fd738061b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:37.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.534+0000 7fd73dd13700 1 --2- 172.21.15.103:0/3907684518 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd7380ac950 0x7fd7381514c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:37.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.534+0000 7fd73dd13700 1 -- 172.21.15.103:0/3907684518 >> 172.21.15.103:0/3907684518 conn(0x7fd73805b7b0 msgr2=0x7fd738144eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:37.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.535+0000 7fd73dd13700 1 -- 172.21.15.103:0/3907684518 shutdown_connections 2020-04-22T14:03:37.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.535+0000 7fd73dd13700 1 -- 172.21.15.103:0/3907684518 wait complete. 2020-04-22T14:03:37.539 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' created 2020-04-22T14:03:37.548 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:37.562 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-04-22T14:03:37.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.710+0000 7f789759e700 1 Processor -- start 2020-04-22T14:03:37.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.710+0000 7f789759e700 1 -- start start 2020-04-22T14:03:37.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.710+0000 7f789759e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7898061870 0x7f78980b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:37.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.711+0000 7f789759e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78980af250 con 0x7f78980620c0 2020-04-22T14:03:37.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.711+0000 7f789759e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78980af4f0 con 0x7f78981463e0 2020-04-22T14:03:37.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.711+0000 7f789759e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7898061c50 con 0x7f7898061870 2020-04-22T14:03:37.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.711+0000 7f789659c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7898061870 0x7f78980b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:37.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.711+0000 7f7896d9d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f78981463e0 0x7f7898142ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40810/0 (socket says 172.21.15.103:40810) 2020-04-22T14:03:37.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.711+0000 7f7896d9d700 1 -- 172.21.15.103:0/716834992 learned_addr learned my addr 172.21.15.103:0/716834992 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:37.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.711+0000 7f789659c700 1 -- 172.21.15.103:0/716834992 >> v1:172.21.15.103:6789/0 conn(0x7f78981463e0 legacy=0x7f7898142ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:37.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.711+0000 7f789659c700 1 -- 172.21.15.103:0/716834992 >> v1:172.21.15.86:6789/0 conn(0x7f78980620c0 legacy=0x7f7898145cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:37.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.711+0000 7f789659c700 1 -- 172.21.15.103:0/716834992 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78980ad360 con 0x7f7898061870 2020-04-22T14:03:37.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.711+0000 7f789659c700 1 --2- 172.21.15.103:0/716834992 >> v2:172.21.15.103:3300/0 conn(0x7f7898061870 0x7f78980b2590 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f78980b6130 tx=0x7f7888007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:37.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.711+0000 7f789659c700 1 --2- 172.21.15.103:0/716834992 >> v2:172.21.15.103:3300/0 conn(0x7f7898061870 0x7f78980b2590 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f78980b6130 tx=0x7f7888007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:37.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.711+0000 7f789659c700 1 --2- 172.21.15.103:0/716834992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7898061870 0x7f78980b2590 secure :-1 s=READY pgs=379 cs=0 l=1 rx=0x7f78980b6130 tx=0x7f7888007a40).ready entity=mon.1 client_cookie=870a5f7e57df6a7b server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:37.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.711+0000 7f789659c700 1 --2- 172.21.15.103:0/716834992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7898061870 0x7f78980b2590 secure :-1 s=THROTTLE_DONE pgs=379 cs=0 l=1 rx=0x7f78980b6130 tx=0x7f7888007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:37.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.711+0000 7f789559a700 1 -- 172.21.15.103:0/716834992 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7888011430 con 0x7f7898061870 2020-04-22T14:03:37.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.711+0000 7f789659c700 1 --2- 172.21.15.103:0/716834992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7898061870 0x7f78980b2590 secure :-1 s=THROTTLE_DONE pgs=379 cs=0 l=1 rx=0x7f78980b6130 tx=0x7f7888007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:37.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.711+0000 7f789659c700 1 --2- 172.21.15.103:0/716834992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7898061870 0x7f78980b2590 secure :-1 s=THROTTLE_DONE pgs=379 cs=0 l=1 rx=0x7f78980b6130 tx=0x7f7888007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:37.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.711+0000 7f789559a700 1 -- 172.21.15.103:0/716834992 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7888011590 con 0x7f7898061870 2020-04-22T14:03:37.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.711+0000 7f789559a700 1 -- 172.21.15.103:0/716834992 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78880119b0 con 0x7f7898061870 2020-04-22T14:03:37.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.711+0000 7f789759e700 1 -- 172.21.15.103:0/716834992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7898061870 msgr2=0x7f78980b2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:37.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.711+0000 7f789759e700 1 --2- 172.21.15.103:0/716834992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7898061870 0x7f78980b2590 secure :-1 s=READY pgs=379 cs=0 l=1 rx=0x7f78980b6130 tx=0x7f7888007a40).stop 2020-04-22T14:03:37.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.712+0000 7f789759e700 1 -- 172.21.15.103:0/716834992 shutdown_connections 2020-04-22T14:03:37.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.712+0000 7f789759e700 1 --2- 172.21.15.103:0/716834992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7898061870 0x7f78980b2590 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:37.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.712+0000 7f789759e700 1 -- 172.21.15.103:0/716834992 >> 172.21.15.103:0/716834992 conn(0x7f789805b780 msgr2=0x7f78980b8530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:37.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.712+0000 7f789759e700 1 -- 172.21.15.103:0/716834992 shutdown_connections 2020-04-22T14:03:37.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.712+0000 7f789759e700 1 -- 172.21.15.103:0/716834992 wait complete. 2020-04-22T14:03:37.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.713+0000 7f789759e700 1 Processor -- start 2020-04-22T14:03:37.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.713+0000 7f789759e700 1 -- start start 2020-04-22T14:03:37.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.713+0000 7f789759e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7898061870 0x7f7898062d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:37.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.713+0000 7f789759e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78980620c0 0x7f7898138260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:37.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.713+0000 7f789759e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f78981463e0 0x7f78981522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:37.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.713+0000 7f789759e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78981386c0 con 0x7f7898061870 2020-04-22T14:03:37.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.713+0000 7f789759e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7898151b60 con 0x7f78981463e0 2020-04-22T14:03:37.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.713+0000 7f789759e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7898151e00 con 0x7f78980620c0 2020-04-22T14:03:37.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.713+0000 7f7896d9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f78981463e0 0x7f78981522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:37.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.714+0000 7f7896d9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f78981463e0 0x7f78981522a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48628/0 (socket says 172.21.15.103:48628) 2020-04-22T14:03:37.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.714+0000 7f7896d9d700 1 -- 172.21.15.103:0/1244731833 learned_addr learned my addr 172.21.15.103:0/1244731833 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:37.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.714+0000 7f789659c700 1 --2- 172.21.15.103:0/1244731833 >> v2:172.21.15.86:3300/0 conn(0x7f7898061870 0x7f7898062d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:37.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.714+0000 7f7895d9b700 1 --2- 172.21.15.103:0/1244731833 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78980620c0 0x7f7898138260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:37.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.714+0000 7f7896d9d700 1 -- 172.21.15.103:0/1244731833 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78980620c0 msgr2=0x7f7898138260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:37.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.714+0000 7f7896d9d700 1 --2- 172.21.15.103:0/1244731833 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78980620c0 0x7f7898138260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:37.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.714+0000 7f7896d9d700 1 -- 172.21.15.103:0/1244731833 >> v2:172.21.15.86:3300/0 conn(0x7f7898061870 msgr2=0x7f7898062d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:37.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.714+0000 7f7896d9d700 1 --2- 172.21.15.103:0/1244731833 >> v2:172.21.15.86:3300/0 conn(0x7f7898061870 0x7f7898062d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:37.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.714+0000 7f7896d9d700 1 -- 172.21.15.103:0/1244731833 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7898145520 con 0x7f78981463e0 2020-04-22T14:03:37.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.714+0000 7f7896d9d700 1 --2- 172.21.15.103:0/1244731833 >> v2:172.21.15.103:3300/0 conn(0x7f78981463e0 0x7f78981522a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f78980b2aa0 tx=0x7f7890010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:37.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.714+0000 7f7896d9d700 1 --2- 172.21.15.103:0/1244731833 >> v2:172.21.15.103:3300/0 conn(0x7f78981463e0 0x7f78981522a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f78980b2aa0 tx=0x7f7890010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:37.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.714+0000 7f7896d9d700 1 --2- 172.21.15.103:0/1244731833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78981463e0 0x7f78981522a0 secure :-1 s=READY pgs=380 cs=0 l=1 rx=0x7f78980b2aa0 tx=0x7f7890010d00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:37.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.714+0000 7f7896d9d700 1 --2- 172.21.15.103:0/1244731833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78981463e0 0x7f78981522a0 secure :-1 s=THROTTLE_DONE pgs=380 cs=0 l=1 rx=0x7f78980b2aa0 tx=0x7f7890010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:37.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.714+0000 7f7896d9d700 1 --2- 172.21.15.103:0/1244731833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78981463e0 0x7f78981522a0 secure :-1 s=THROTTLE_DONE pgs=380 cs=0 l=1 rx=0x7f78980b2aa0 tx=0x7f7890010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:37.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.714+0000 7f788f7fe700 1 -- 172.21.15.103:0/1244731833 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78900123a0 con 0x7f78981463e0 2020-04-22T14:03:37.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.714+0000 7f7896d9d700 1 --2- 172.21.15.103:0/1244731833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78981463e0 0x7f78981522a0 secure :-1 s=THROTTLE_DONE pgs=380 cs=0 l=1 rx=0x7f78980b2aa0 tx=0x7f7890010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:37.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.714+0000 7f788f7fe700 1 -- 172.21.15.103:0/1244731833 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7890012540 con 0x7f78981463e0 2020-04-22T14:03:37.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.714+0000 7f789759e700 1 -- 172.21.15.103:0/1244731833 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7898155980 con 0x7f78981463e0 2020-04-22T14:03:37.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.714+0000 7f788f7fe700 1 -- 172.21.15.103:0/1244731833 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7890012960 con 0x7f78981463e0 2020-04-22T14:03:37.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.714+0000 7f789759e700 1 -- 172.21.15.103:0/1244731833 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78981528c0 con 0x7f78981463e0 2020-04-22T14:03:37.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.715+0000 7f7896d9d700 1 --2- 172.21.15.103:0/1244731833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78981463e0 0x7f78981522a0 secure :-1 s=THROTTLE_DONE pgs=380 cs=0 l=1 rx=0x7f78980b2aa0 tx=0x7f7890010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:37.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.715+0000 7f788f7fe700 1 -- 172.21.15.103:0/1244731833 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f7890012bd0 con 0x7f78981463e0 2020-04-22T14:03:37.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.715+0000 7f7896d9d700 1 --2- 172.21.15.103:0/1244731833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78981463e0 0x7f78981522a0 secure :-1 s=THROTTLE_DONE pgs=380 cs=0 l=1 rx=0x7f78980b2aa0 tx=0x7f7890010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:37.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.715+0000 7f789759e700 1 -- 172.21.15.103:0/1244731833 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7898155c90 con 0x7f78981463e0 2020-04-22T14:03:37.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.716+0000 7f788f7fe700 1 --2- 172.21.15.103:0/1244731833 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f787c04da30 0x7f787c04fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:37.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.716+0000 7f788f7fe700 1 -- 172.21.15.103:0/1244731833 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f78900090c0 con 0x7f78981463e0 2020-04-22T14:03:37.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.716+0000 7f789659c700 1 --2- 172.21.15.103:0/1244731833 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f787c04da30 0x7f787c04fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:37.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.716+0000 7f789659c700 1 --2- 172.21.15.103:0/1244731833 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f787c04da30 0x7f787c04fef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f78980b6130 tx=0x7f7888007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:37.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.716+0000 7f789659c700 1 --2- 172.21.15.103:0/1244731833 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f787c04da30 0x7f787c04fef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f78980b6130 tx=0x7f7888007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:37.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.716+0000 7f789659c700 1 --2- 172.21.15.103:0/1244731833 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f787c04da30 0x7f787c04fef0 secure :-1 s=READY pgs=158 cs=0 l=1 rx=0x7f78980b6130 tx=0x7f7888007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:37.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.720+0000 7f7896d9d700 1 --2- 172.21.15.103:0/1244731833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78981463e0 0x7f78981522a0 secure :-1 s=THROTTLE_DONE pgs=380 cs=0 l=1 rx=0x7f78980b2aa0 tx=0x7f7890010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:37.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.720+0000 7f788f7fe700 1 -- 172.21.15.103:0/1244731833 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f789003d030 con 0x7f78981463e0 2020-04-22T14:03:37.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:37.864+0000 7f789759e700 1 -- 172.21.15.103:0/1244731833 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f7898056c90 con 0x7f78981463e0 2020-04-22T14:03:38.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.537+0000 7f7896d9d700 1 --2- 172.21.15.103:0/1244731833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78981463e0 0x7f78981522a0 secure :-1 s=THROTTLE_DONE pgs=380 cs=0 l=1 rx=0x7f78980b2aa0 tx=0x7f7890010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:38.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.537+0000 7f788f7fe700 1 -- 172.21.15.103:0/1244731833 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v32) v1 ==== 125+0+0 (secure 0 0 0) 0x7f7890040650 con 0x7f78981463e0 2020-04-22T14:03:38.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.542+0000 7f789759e700 1 -- 172.21.15.103:0/1244731833 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f787c04da30 msgr2=0x7f787c04fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:38.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.542+0000 7f789759e700 1 --2- 172.21.15.103:0/1244731833 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f787c04da30 0x7f787c04fef0 secure :-1 s=READY pgs=158 cs=0 l=1 rx=0x7f78980b6130 tx=0x7f7888007a40).stop 2020-04-22T14:03:38.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.542+0000 7f789759e700 1 -- 172.21.15.103:0/1244731833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78981463e0 msgr2=0x7f78981522a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:38.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.542+0000 7f789759e700 1 --2- 172.21.15.103:0/1244731833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78981463e0 0x7f78981522a0 secure :-1 s=READY pgs=380 cs=0 l=1 rx=0x7f78980b2aa0 tx=0x7f7890010d00).stop 2020-04-22T14:03:38.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.542+0000 7f789759e700 1 -- 172.21.15.103:0/1244731833 shutdown_connections 2020-04-22T14:03:38.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.542+0000 7f789759e700 1 --2- 172.21.15.103:0/1244731833 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f787c04da30 0x7f787c04fef0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:38.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.542+0000 7f789759e700 1 --2- 172.21.15.103:0/1244731833 >> v2:172.21.15.86:3300/0 conn(0x7f7898061870 0x7f7898062d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:38.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.542+0000 7f789759e700 1 --2- 172.21.15.103:0/1244731833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78981463e0 0x7f78981522a0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:38.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.542+0000 7f789759e700 1 --2- 172.21.15.103:0/1244731833 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78980620c0 0x7f7898138260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:38.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.542+0000 7f789759e700 1 -- 172.21.15.103:0/1244731833 >> 172.21.15.103:0/1244731833 conn(0x7f789805b780 msgr2=0x7f78980b7a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:38.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.543+0000 7f789759e700 1 -- 172.21.15.103:0/1244731833 shutdown_connections 2020-04-22T14:03:38.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.543+0000 7f789759e700 1 -- 172.21.15.103:0/1244731833 wait complete. 2020-04-22T14:03:38.547 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' created 2020-04-22T14:03:38.560 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:38.579 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-04-22T14:03:38.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.732+0000 7f96b8463700 1 Processor -- start 2020-04-22T14:03:38.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.732+0000 7f96b8463700 1 -- start start 2020-04-22T14:03:38.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.733+0000 7f96b8463700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f96b00b9140 0x7f96b012b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:38.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.733+0000 7f96b8463700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96b00ac950 0x7f96b012b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:38.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.733+0000 7f96b8463700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96b01467e0 con 0x7f96b0146c40 2020-04-22T14:03:38.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.733+0000 7f96b8463700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96b00602f0 con 0x7f96b00b9140 2020-04-22T14:03:38.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.733+0000 7f96b8463700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b0060050 con 0x7f96b00ac950 2020-04-22T14:03:38.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.733+0000 7f96b61ff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f96b00b9140 0x7f96b012b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:38.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.733+0000 7f96b6a00700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f96b0146c40 0x7f96b0143090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40822/0 (socket says 172.21.15.103:40822) 2020-04-22T14:03:38.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.733+0000 7f96b6a00700 1 -- 172.21.15.103:0/883228893 learned_addr learned my addr 172.21.15.103:0/883228893 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:38.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.734+0000 7f96b59fe700 1 --2- 172.21.15.103:0/883228893 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96b00ac950 0x7f96b012b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:38.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.734+0000 7f96b61ff700 1 -- 172.21.15.103:0/883228893 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96b00ac950 msgr2=0x7f96b012b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:38.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.734+0000 7f96b61ff700 1 --2- 172.21.15.103:0/883228893 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96b00ac950 0x7f96b012b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:38.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.734+0000 7f96b61ff700 1 -- 172.21.15.103:0/883228893 >> v1:172.21.15.103:6789/0 conn(0x7f96b0146c40 legacy=0x7f96b0143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:38.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.734+0000 7f96b61ff700 1 -- 172.21.15.103:0/883228893 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b00b9520 con 0x7f96b00b9140 2020-04-22T14:03:38.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.734+0000 7f96b51fd700 1 -- 172.21.15.103:0/883228893 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3599469489 0 0) 0x7f96b01467e0 con 0x7f96b0146c40 2020-04-22T14:03:38.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.734+0000 7f96b59fe700 1 --2- 172.21.15.103:0/883228893 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96b00ac950 0x7f96b012b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:03:38.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.734+0000 7f96b61ff700 1 --2- 172.21.15.103:0/883228893 >> v2:172.21.15.103:3300/0 conn(0x7f96b00b9140 0x7f96b012b210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f96ac002f30 tx=0x7f96ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:38.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.734+0000 7f96b61ff700 1 --2- 172.21.15.103:0/883228893 >> v2:172.21.15.103:3300/0 conn(0x7f96b00b9140 0x7f96b012b210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f96ac002f30 tx=0x7f96ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:38.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.734+0000 7f96b61ff700 1 --2- 172.21.15.103:0/883228893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96b00b9140 0x7f96b012b210 secure :-1 s=READY pgs=382 cs=0 l=1 rx=0x7f96ac002f30 tx=0x7f96ac007a40).ready entity=mon.1 client_cookie=44ade7175786deb1 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:38.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.734+0000 7f96b61ff700 1 --2- 172.21.15.103:0/883228893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96b00b9140 0x7f96b012b210 secure :-1 s=THROTTLE_DONE pgs=382 cs=0 l=1 rx=0x7f96ac002f30 tx=0x7f96ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:38.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.734+0000 7f96b51fd700 1 -- 172.21.15.103:0/883228893 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96ac011470 con 0x7f96b00b9140 2020-04-22T14:03:38.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.734+0000 7f96b61ff700 1 --2- 172.21.15.103:0/883228893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96b00b9140 0x7f96b012b210 secure :-1 s=THROTTLE_DONE pgs=382 cs=0 l=1 rx=0x7f96ac002f30 tx=0x7f96ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:38.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.734+0000 7f96b61ff700 1 --2- 172.21.15.103:0/883228893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96b00b9140 0x7f96b012b210 secure :-1 s=THROTTLE_DONE pgs=382 cs=0 l=1 rx=0x7f96ac002f30 tx=0x7f96ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:38.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.734+0000 7f96b51fd700 1 -- 172.21.15.103:0/883228893 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96ac011610 con 0x7f96b00b9140 2020-04-22T14:03:38.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.734+0000 7f96b51fd700 1 -- 172.21.15.103:0/883228893 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96ac0119f0 con 0x7f96b00b9140 2020-04-22T14:03:38.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.734+0000 7f96b8463700 1 -- 172.21.15.103:0/883228893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96b00b9140 msgr2=0x7f96b012b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:38.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.734+0000 7f96b8463700 1 --2- 172.21.15.103:0/883228893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96b00b9140 0x7f96b012b210 secure :-1 s=READY pgs=382 cs=0 l=1 rx=0x7f96ac002f30 tx=0x7f96ac007a40).stop 2020-04-22T14:03:38.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.735+0000 7f96b8463700 1 -- 172.21.15.103:0/883228893 shutdown_connections 2020-04-22T14:03:38.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.735+0000 7f96b8463700 1 --2- 172.21.15.103:0/883228893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96b00b9140 0x7f96b012b210 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:38.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.735+0000 7f96b8463700 1 --2- 172.21.15.103:0/883228893 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96b00ac950 0x7f96b012b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:38.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.735+0000 7f96b8463700 1 -- 172.21.15.103:0/883228893 >> 172.21.15.103:0/883228893 conn(0x7f96b005b7b0 msgr2=0x7f96b00b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:38.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.735+0000 7f96b8463700 1 -- 172.21.15.103:0/883228893 shutdown_connections 2020-04-22T14:03:38.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.735+0000 7f96b8463700 1 -- 172.21.15.103:0/883228893 wait complete. 2020-04-22T14:03:38.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.736+0000 7f96b8463700 1 Processor -- start 2020-04-22T14:03:38.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.736+0000 7f96b8463700 1 -- start start 2020-04-22T14:03:38.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.736+0000 7f96b8463700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f96b00ac950 0x7f96b00b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:38.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.736+0000 7f96b8463700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96b00b9140 0x7f96b01550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:38.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.736+0000 7f96b8463700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f96b0146c40 0x7f96b0155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:38.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.736+0000 7f96b8463700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96b00b5950 con 0x7f96b0146c40 2020-04-22T14:03:38.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.736+0000 7f96b8463700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96b00b4f70 con 0x7f96b00ac950 2020-04-22T14:03:38.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.736+0000 7f96b8463700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b00b5210 con 0x7f96b00b9140 2020-04-22T14:03:38.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.736+0000 7f96b61ff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f96b00ac950 0x7f96b00b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:38.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.736+0000 7f96b61ff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f96b00ac950 0x7f96b00b49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48636/0 (socket says 172.21.15.103:48636) 2020-04-22T14:03:38.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.736+0000 7f96b61ff700 1 -- 172.21.15.103:0/1098700333 learned_addr learned my addr 172.21.15.103:0/1098700333 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:38.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.737+0000 7f96b59fe700 1 --2- 172.21.15.103:0/1098700333 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96b00b9140 0x7f96b01550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:38.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.737+0000 7f96b6a00700 1 --2- 172.21.15.103:0/1098700333 >> v2:172.21.15.86:3300/0 conn(0x7f96b0146c40 0x7f96b0155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:38.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.737+0000 7f96b61ff700 1 -- 172.21.15.103:0/1098700333 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96b00b9140 msgr2=0x7f96b01550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:38.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.737+0000 7f96b61ff700 1 --2- 172.21.15.103:0/1098700333 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96b00b9140 0x7f96b01550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:38.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.737+0000 7f96b61ff700 1 -- 172.21.15.103:0/1098700333 >> v2:172.21.15.86:3300/0 conn(0x7f96b0146c40 msgr2=0x7f96b0155550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:38.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.737+0000 7f96b61ff700 1 --2- 172.21.15.103:0/1098700333 >> v2:172.21.15.86:3300/0 conn(0x7f96b0146c40 0x7f96b0155550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:38.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.737+0000 7f96b61ff700 1 -- 172.21.15.103:0/1098700333 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b00b54b0 con 0x7f96b00ac950 2020-04-22T14:03:38.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.737+0000 7f96b61ff700 1 --2- 172.21.15.103:0/1098700333 >> v2:172.21.15.103:3300/0 conn(0x7f96b00ac950 0x7f96b00b49b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f96ac002f30 tx=0x7f96ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:38.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.737+0000 7f96b61ff700 1 --2- 172.21.15.103:0/1098700333 >> v2:172.21.15.103:3300/0 conn(0x7f96b00ac950 0x7f96b00b49b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f96ac002f30 tx=0x7f96ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:38.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.737+0000 7f96b61ff700 1 --2- 172.21.15.103:0/1098700333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96b00ac950 0x7f96b00b49b0 secure :-1 s=READY pgs=383 cs=0 l=1 rx=0x7f96ac002f30 tx=0x7f96ac007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:38.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.737+0000 7f96b61ff700 1 --2- 172.21.15.103:0/1098700333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96b00ac950 0x7f96b00b49b0 secure :-1 s=THROTTLE_DONE pgs=383 cs=0 l=1 rx=0x7f96ac002f30 tx=0x7f96ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:38.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.737+0000 7f969f7fe700 1 -- 172.21.15.103:0/1098700333 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96ac007360 con 0x7f96b00ac950 2020-04-22T14:03:38.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.737+0000 7f96b61ff700 1 --2- 172.21.15.103:0/1098700333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96b00ac950 0x7f96b00b49b0 secure :-1 s=THROTTLE_DONE pgs=383 cs=0 l=1 rx=0x7f96ac002f30 tx=0x7f96ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:38.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.737+0000 7f96b61ff700 1 --2- 172.21.15.103:0/1098700333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96b00ac950 0x7f96b00b49b0 secure :-1 s=THROTTLE_DONE pgs=383 cs=0 l=1 rx=0x7f96ac002f30 tx=0x7f96ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:38.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.737+0000 7f969f7fe700 1 -- 172.21.15.103:0/1098700333 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96ac0074c0 con 0x7f96b00ac950 2020-04-22T14:03:38.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.737+0000 7f96b8463700 1 -- 172.21.15.103:0/1098700333 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b01559b0 con 0x7f96b00ac950 2020-04-22T14:03:38.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.737+0000 7f969f7fe700 1 -- 172.21.15.103:0/1098700333 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96ac0058b0 con 0x7f96b00ac950 2020-04-22T14:03:38.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.737+0000 7f96b8463700 1 -- 172.21.15.103:0/1098700333 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b0145ac0 con 0x7f96b00ac950 2020-04-22T14:03:38.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.738+0000 7f96b61ff700 1 --2- 172.21.15.103:0/1098700333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96b00ac950 0x7f96b00b49b0 secure :-1 s=THROTTLE_DONE pgs=383 cs=0 l=1 rx=0x7f96ac002f30 tx=0x7f96ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:38.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.738+0000 7f969f7fe700 1 -- 172.21.15.103:0/1098700333 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f96ac005af0 con 0x7f96b00ac950 2020-04-22T14:03:38.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.738+0000 7f96b61ff700 1 --2- 172.21.15.103:0/1098700333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96b00ac950 0x7f96b00b49b0 secure :-1 s=THROTTLE_DONE pgs=383 cs=0 l=1 rx=0x7f96ac002f30 tx=0x7f96ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:38.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.738+0000 7f96b8463700 1 -- 172.21.15.103:0/1098700333 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96b0056c90 con 0x7f96b00ac950 2020-04-22T14:03:38.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.738+0000 7f969f7fe700 1 --2- 172.21.15.103:0/1098700333 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f969004da20 0x7f969004fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:38.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.739+0000 7f969f7fe700 1 -- 172.21.15.103:0/1098700333 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f96ac061ac0 con 0x7f96b00ac950 2020-04-22T14:03:38.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.739+0000 7f96b59fe700 1 --2- 172.21.15.103:0/1098700333 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f969004da20 0x7f969004fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:38.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.739+0000 7f96b59fe700 1 --2- 172.21.15.103:0/1098700333 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f969004da20 0x7f969004fee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f96a0002f30 tx=0x7f96a000f1c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:38.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.739+0000 7f96b59fe700 1 --2- 172.21.15.103:0/1098700333 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f969004da20 0x7f969004fee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f96a0002f30 tx=0x7f96a000f1c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:38.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.739+0000 7f96b59fe700 1 --2- 172.21.15.103:0/1098700333 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f969004da20 0x7f969004fee0 secure :-1 s=READY pgs=159 cs=0 l=1 rx=0x7f96a0002f30 tx=0x7f96a000f1c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:38.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.743+0000 7f96b61ff700 1 --2- 172.21.15.103:0/1098700333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96b00ac950 0x7f96b00b49b0 secure :-1 s=THROTTLE_DONE pgs=383 cs=0 l=1 rx=0x7f96ac002f30 tx=0x7f96ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:38.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.743+0000 7f969f7fe700 1 -- 172.21.15.103:0/1098700333 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f96ac03cfc0 con 0x7f96b00ac950 2020-04-22T14:03:38.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.932+0000 7f96b8463700 1 -- 172.21.15.103:0/1098700333 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f96b006a960 con 0x7f96b00ac950 2020-04-22T14:03:38.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.941+0000 7f96b61ff700 1 --2- 172.21.15.103:0/1098700333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96b00ac950 0x7f96b00b49b0 secure :-1 s=THROTTLE_DONE pgs=383 cs=0 l=1 rx=0x7f96ac002f30 tx=0x7f96ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:38.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.941+0000 7f969f7fe700 1 -- 172.21.15.103:0/1098700333 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 5 and data pool 6 v11) v1 ==== 187+0+0 (secure 0 0 0) 0x7f96ac0405e0 con 0x7f96b00ac950 2020-04-22T14:03:38.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.945+0000 7f96b8463700 1 -- 172.21.15.103:0/1098700333 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f969004da20 msgr2=0x7f969004fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:38.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.945+0000 7f96b8463700 1 --2- 172.21.15.103:0/1098700333 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f969004da20 0x7f969004fee0 secure :-1 s=READY pgs=159 cs=0 l=1 rx=0x7f96a0002f30 tx=0x7f96a000f1c0).stop 2020-04-22T14:03:38.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.945+0000 7f96b8463700 1 -- 172.21.15.103:0/1098700333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96b00ac950 msgr2=0x7f96b00b49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:38.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.945+0000 7f96b8463700 1 --2- 172.21.15.103:0/1098700333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96b00ac950 0x7f96b00b49b0 secure :-1 s=READY pgs=383 cs=0 l=1 rx=0x7f96ac002f30 tx=0x7f96ac007a40).stop 2020-04-22T14:03:38.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.945+0000 7f96b8463700 1 -- 172.21.15.103:0/1098700333 shutdown_connections 2020-04-22T14:03:38.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.945+0000 7f96b8463700 1 --2- 172.21.15.103:0/1098700333 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f969004da20 0x7f969004fee0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:38.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.945+0000 7f96b8463700 1 --2- 172.21.15.103:0/1098700333 >> v2:172.21.15.86:3300/0 conn(0x7f96b0146c40 0x7f96b0155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:38.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.945+0000 7f96b8463700 1 --2- 172.21.15.103:0/1098700333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96b00ac950 0x7f96b00b49b0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:38.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.945+0000 7f96b8463700 1 --2- 172.21.15.103:0/1098700333 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96b00b9140 0x7f96b01550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:38.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.945+0000 7f96b8463700 1 -- 172.21.15.103:0/1098700333 >> 172.21.15.103:0/1098700333 conn(0x7f96b005b7b0 msgr2=0x7f96b00b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:38.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.946+0000 7f96b8463700 1 -- 172.21.15.103:0/1098700333 shutdown_connections 2020-04-22T14:03:38.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:38.946+0000 7f96b8463700 1 -- 172.21.15.103:0/1098700333 wait complete. 2020-04-22T14:03:38.952 INFO:teuthology.orchestra.run.smithi103.stderr:new fs with metadata pool 5 and data pool 6 2020-04-22T14:03:38.961 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:38.975 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:03:39.125 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.122+0000 7f7e51244700 1 Processor -- start 2020-04-22T14:03:39.125 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.122+0000 7f7e51244700 1 -- start start 2020-04-22T14:03:39.131 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.122+0000 7f7e51244700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e4c1440a0 0x7f7e4c066280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:39.131 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.122+0000 7f7e51244700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e4c061ae0 con 0x7f7e4c141680 2020-04-22T14:03:39.131 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.122+0000 7f7e51244700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e4c061d80 con 0x7f7e4c0666e0 2020-04-22T14:03:39.131 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.122+0000 7f7e51244700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4c062020 con 0x7f7e4c1440a0 2020-04-22T14:03:39.131 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.123+0000 7f7e4b59e700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f7e4c0666e0 0x7f7e4c066b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40850/0 (socket says 172.21.15.103:40850) 2020-04-22T14:03:39.131 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.123+0000 7f7e4b59e700 1 -- 172.21.15.103:0/3310426853 learned_addr learned my addr 172.21.15.103:0/3310426853 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:39.132 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.123+0000 7f7e49d9b700 1 -- 172.21.15.103:0/3310426853 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1211435504 0 0) 0x7f7e4c061d80 con 0x7f7e4c0666e0 2020-04-22T14:03:39.132 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.123+0000 7f7e49d9b700 1 -- 172.21.15.103:0/3310426853 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e30003230 con 0x7f7e4c0666e0 2020-04-22T14:03:39.132 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.123+0000 7f7e4a59c700 1 --2- 172.21.15.103:0/3310426853 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e4c1440a0 0x7f7e4c066280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:39.132 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.123+0000 7f7e49d9b700 1 -- 172.21.15.103:0/3310426853 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1295352662 0 0) 0x7f7e30003230 con 0x7f7e4c0666e0 2020-04-22T14:03:39.132 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.123+0000 7f7e49d9b700 1 -- 172.21.15.103:0/3310426853 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e4c1440a0 msgr2=0x7f7e4c066280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:39.132 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.123+0000 7f7e49d9b700 1 --2- 172.21.15.103:0/3310426853 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e4c1440a0 0x7f7e4c066280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:39.133 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.123+0000 7f7e49d9b700 1 -- 172.21.15.103:0/3310426853 >> v1:172.21.15.86:6789/0 conn(0x7f7e4c141680 legacy=0x7f7e4c0b50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:39.133 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.123+0000 7f7e49d9b700 1 -- 172.21.15.103:0/3310426853 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e4c0672a0 con 0x7f7e4c0666e0 2020-04-22T14:03:39.133 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.123+0000 7f7e49d9b700 1 -- 172.21.15.103:0/3310426853 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f7e3c0016d0 con 0x7f7e4c0666e0 2020-04-22T14:03:39.133 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.123+0000 7f7e49d9b700 1 -- 172.21.15.103:0/3310426853 >> v1:172.21.15.103:6789/0 conn(0x7f7e4c0666e0 legacy=0x7f7e4c066b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:39.133 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.123+0000 7f7e49d9b700 1 --2- 172.21.15.103:0/3310426853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e30003720 0x7f7e30003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:39.133 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.123+0000 7f7e49d9b700 1 --2- 172.21.15.103:0/3310426853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e30004060 0x7f7e30004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:39.133 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.123+0000 7f7e49d9b700 1 --2- 172.21.15.103:0/3310426853 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e4c1440a0 0x7f7e30004ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:39.133 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.123+0000 7f7e49d9b700 1 -- 172.21.15.103:0/3310426853 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4c062020 con 0x7f7e30004060 2020-04-22T14:03:39.134 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.123+0000 7f7e49d9b700 1 -- 172.21.15.103:0/3310426853 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e30004f70 con 0x7f7e30003720 2020-04-22T14:03:39.134 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.123+0000 7f7e49d9b700 1 -- 172.21.15.103:0/3310426853 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e30005130 con 0x7f7e4c1440a0 2020-04-22T14:03:39.134 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.123+0000 7f7e4ad9d700 1 --2- 172.21.15.103:0/3310426853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e30003720 0x7f7e30003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:39.134 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.123+0000 7f7e4b59e700 1 --2- 172.21.15.103:0/3310426853 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e4c1440a0 0x7f7e30004ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:39.134 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.123+0000 7f7e4a59c700 1 --2- 172.21.15.103:0/3310426853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e30004060 0x7f7e30004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:39.134 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.124+0000 7f7e4ad9d700 1 -- 172.21.15.103:0/3310426853 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e4c1440a0 msgr2=0x7f7e30004ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:39.134 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.124+0000 7f7e4ad9d700 1 --2- 172.21.15.103:0/3310426853 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e4c1440a0 0x7f7e30004ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:39.135 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.124+0000 7f7e4ad9d700 1 -- 172.21.15.103:0/3310426853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e30004060 msgr2=0x7f7e30004530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:39.135 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.124+0000 7f7e4ad9d700 1 --2- 172.21.15.103:0/3310426853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e30004060 0x7f7e30004530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:39.135 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.124+0000 7f7e4ad9d700 1 -- 172.21.15.103:0/3310426853 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e30003230 con 0x7f7e30003720 2020-04-22T14:03:39.135 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.124+0000 7f7e4ad9d700 1 --2- 172.21.15.103:0/3310426853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e30003720 0x7f7e30003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7e4c0b5d00 tx=0x7f7e44010070).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.135 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.124+0000 7f7e4ad9d700 1 --2- 172.21.15.103:0/3310426853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e30003720 0x7f7e30003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7e4c0b5d00 tx=0x7f7e44010070).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.135 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.124+0000 7f7e4ad9d700 1 --2- 172.21.15.103:0/3310426853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e30003720 0x7f7e30003b40 secure :-1 s=READY pgs=385 cs=0 l=1 rx=0x7f7e4c0b5d00 tx=0x7f7e44010070).ready entity=mon.1 client_cookie=66c56248b65b341e server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:39.135 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.124+0000 7f7e4ad9d700 1 --2- 172.21.15.103:0/3310426853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e30003720 0x7f7e30003b40 secure :-1 s=THROTTLE_DONE pgs=385 cs=0 l=1 rx=0x7f7e4c0b5d00 tx=0x7f7e44010070).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.135 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.124+0000 7f7e49d9b700 1 -- 172.21.15.103:0/3310426853 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e44006c40 con 0x7f7e30003720 2020-04-22T14:03:39.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.124+0000 7f7e4ad9d700 1 --2- 172.21.15.103:0/3310426853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e30003720 0x7f7e30003b40 secure :-1 s=THROTTLE_DONE pgs=385 cs=0 l=1 rx=0x7f7e4c0b5d00 tx=0x7f7e44010070).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.124+0000 7f7e4ad9d700 1 --2- 172.21.15.103:0/3310426853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e30003720 0x7f7e30003b40 secure :-1 s=THROTTLE_DONE pgs=385 cs=0 l=1 rx=0x7f7e4c0b5d00 tx=0x7f7e44010070).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.124+0000 7f7e49d9b700 1 -- 172.21.15.103:0/3310426853 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e44006de0 con 0x7f7e30003720 2020-04-22T14:03:39.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.124+0000 7f7e49d9b700 1 -- 172.21.15.103:0/3310426853 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e44002730 con 0x7f7e30003720 2020-04-22T14:03:39.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.124+0000 7f7e51244700 1 -- 172.21.15.103:0/3310426853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e30003720 msgr2=0x7f7e30003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:39.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.124+0000 7f7e51244700 1 --2- 172.21.15.103:0/3310426853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e30003720 0x7f7e30003b40 secure :-1 s=READY pgs=385 cs=0 l=1 rx=0x7f7e4c0b5d00 tx=0x7f7e44010070).stop 2020-04-22T14:03:39.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.124+0000 7f7e4b59e700 1 -- 172.21.15.103:0/3310426853 reap_dead start 2020-04-22T14:03:39.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.124+0000 7f7e51244700 1 -- 172.21.15.103:0/3310426853 shutdown_connections 2020-04-22T14:03:39.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.124+0000 7f7e51244700 1 -- 172.21.15.103:0/3310426853 >> 172.21.15.103:0/3310426853 conn(0x7f7e4c05ad30 msgr2=0x7f7e4c05b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:39.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.124+0000 7f7e51244700 1 -- 172.21.15.103:0/3310426853 shutdown_connections 2020-04-22T14:03:39.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.124+0000 7f7e51244700 1 -- 172.21.15.103:0/3310426853 wait complete. 2020-04-22T14:03:39.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.125+0000 7f7e51244700 1 Processor -- start 2020-04-22T14:03:39.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.125+0000 7f7e51244700 1 -- start start 2020-04-22T14:03:39.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.126+0000 7f7e51244700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7e4c142f60 0x7f7e4c12d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:39.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.126+0000 7f7e51244700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7e4c12b9f0 0x7f7e4c0b1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:39.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.126+0000 7f7e51244700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e4c140600 con 0x7f7e4c12b560 2020-04-22T14:03:39.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.126+0000 7f7e51244700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e4c12be40 con 0x7f7e4c142f60 2020-04-22T14:03:39.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.126+0000 7f7e51244700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e4c0b3cd0 con 0x7f7e4c12b9f0 2020-04-22T14:03:39.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.126+0000 7f7e4b59e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7e4c12b9f0 0x7f7e4c0b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:39.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.126+0000 7f7e4b59e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7e4c12b9f0 0x7f7e4c0b1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48672/0 (socket says 172.21.15.103:48672) 2020-04-22T14:03:39.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.126+0000 7f7e4b59e700 1 -- 172.21.15.103:0/855773435 learned_addr learned my addr 172.21.15.103:0/855773435 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:39.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.126+0000 7f7e4ad9d700 1 --2- 172.21.15.103:0/855773435 >> v2:172.21.15.86:3300/0 conn(0x7f7e4c142f60 0x7f7e4c12d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:39.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.126+0000 7f7e4b59e700 1 -- 172.21.15.103:0/855773435 >> v2:172.21.15.86:3300/0 conn(0x7f7e4c142f60 msgr2=0x7f7e4c12d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:39.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.126+0000 7f7e4b59e700 1 --2- 172.21.15.103:0/855773435 >> v2:172.21.15.86:3300/0 conn(0x7f7e4c142f60 0x7f7e4c12d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:39.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.126+0000 7f7e4b59e700 1 -- 172.21.15.103:0/855773435 >> v1:172.21.15.86:6789/0 conn(0x7f7e4c12b560 legacy=0x7f7e4c0b0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:39.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.126+0000 7f7e4b59e700 1 -- 172.21.15.103:0/855773435 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e4c0b2400 con 0x7f7e4c12b9f0 2020-04-22T14:03:39.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.127+0000 7f7e4b59e700 1 --2- 172.21.15.103:0/855773435 >> v2:172.21.15.103:3300/0 conn(0x7f7e4c12b9f0 0x7f7e4c0b1260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7e44001290 tx=0x7f7e4c12d8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.127+0000 7f7e4b59e700 1 --2- 172.21.15.103:0/855773435 >> v2:172.21.15.103:3300/0 conn(0x7f7e4c12b9f0 0x7f7e4c0b1260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7e44001290 tx=0x7f7e4c12d8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.127+0000 7f7e4b59e700 1 --2- 172.21.15.103:0/855773435 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e4c12b9f0 0x7f7e4c0b1260 secure :-1 s=READY pgs=386 cs=0 l=1 rx=0x7f7e44001290 tx=0x7f7e4c12d8f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:39.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.127+0000 7f7e4b59e700 1 --2- 172.21.15.103:0/855773435 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e4c12b9f0 0x7f7e4c0b1260 secure :-1 s=THROTTLE_DONE pgs=386 cs=0 l=1 rx=0x7f7e44001290 tx=0x7f7e4c12d8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.127+0000 7f7e3bfff700 1 -- 172.21.15.103:0/855773435 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e3c00e550 con 0x7f7e4c12b9f0 2020-04-22T14:03:39.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.127+0000 7f7e4b59e700 1 --2- 172.21.15.103:0/855773435 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e4c12b9f0 0x7f7e4c0b1260 secure :-1 s=THROTTLE_DONE pgs=386 cs=0 l=1 rx=0x7f7e44001290 tx=0x7f7e4c12d8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.127+0000 7f7e4b59e700 1 --2- 172.21.15.103:0/855773435 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e4c12b9f0 0x7f7e4c0b1260 secure :-1 s=THROTTLE_DONE pgs=386 cs=0 l=1 rx=0x7f7e44001290 tx=0x7f7e4c12d8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.127+0000 7f7e3bfff700 1 -- 172.21.15.103:0/855773435 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3c00e6b0 con 0x7f7e4c12b9f0 2020-04-22T14:03:39.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.127+0000 7f7e51244700 1 -- 172.21.15.103:0/855773435 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e4c0b26a0 con 0x7f7e4c12b9f0 2020-04-22T14:03:39.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.127+0000 7f7e3bfff700 1 -- 172.21.15.103:0/855773435 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e3c00c9f0 con 0x7f7e4c12b9f0 2020-04-22T14:03:39.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.127+0000 7f7e51244700 1 -- 172.21.15.103:0/855773435 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e4c143340 con 0x7f7e4c12b9f0 2020-04-22T14:03:39.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.127+0000 7f7e4b59e700 1 --2- 172.21.15.103:0/855773435 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e4c12b9f0 0x7f7e4c0b1260 secure :-1 s=THROTTLE_DONE pgs=386 cs=0 l=1 rx=0x7f7e44001290 tx=0x7f7e4c12d8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.128+0000 7f7e3bfff700 1 -- 172.21.15.103:0/855773435 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f7e3c00cb50 con 0x7f7e4c12b9f0 2020-04-22T14:03:39.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.128+0000 7f7e4b59e700 1 --2- 172.21.15.103:0/855773435 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e4c12b9f0 0x7f7e4c0b1260 secure :-1 s=THROTTLE_DONE pgs=386 cs=0 l=1 rx=0x7f7e44001290 tx=0x7f7e4c12d8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.128+0000 7f7e51244700 1 -- 172.21.15.103:0/855773435 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e4c140a50 con 0x7f7e4c12b9f0 2020-04-22T14:03:39.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.128+0000 7f7e3bfff700 1 --2- 172.21.15.103:0/855773435 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7e2804da50 0x7f7e2804ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:39.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.128+0000 7f7e3bfff700 1 -- 172.21.15.103:0/855773435 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7e3c0612e0 con 0x7f7e4c12b9f0 2020-04-22T14:03:39.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.128+0000 7f7e4ad9d700 1 --2- 172.21.15.103:0/855773435 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7e2804da50 0x7f7e2804ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:39.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.128+0000 7f7e4ad9d700 1 --2- 172.21.15.103:0/855773435 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7e2804da50 0x7f7e2804ff10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7e4c0b5d00 tx=0x7f7e44010070).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.129+0000 7f7e4ad9d700 1 --2- 172.21.15.103:0/855773435 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7e2804da50 0x7f7e2804ff10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7e4c0b5d00 tx=0x7f7e44010070).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.129+0000 7f7e4ad9d700 1 --2- 172.21.15.103:0/855773435 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7e2804da50 0x7f7e2804ff10 secure :-1 s=READY pgs=160 cs=0 l=1 rx=0x7f7e4c0b5d00 tx=0x7f7e44010070).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:39.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.132+0000 7f7e4b59e700 1 --2- 172.21.15.103:0/855773435 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e4c12b9f0 0x7f7e4c0b1260 secure :-1 s=THROTTLE_DONE pgs=386 cs=0 l=1 rx=0x7f7e44001290 tx=0x7f7e4c12d8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.132+0000 7f7e3bfff700 1 -- 172.21.15.103:0/855773435 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f7e3c03c6c0 con 0x7f7e4c12b9f0 2020-04-22T14:03:39.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.274+0000 7f7e51244700 1 -- 172.21.15.103:0/855773435 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e4c148490 con 0x7f7e4c12b9f0 2020-04-22T14:03:39.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.275+0000 7f7e4b59e700 1 --2- 172.21.15.103:0/855773435 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e4c12b9f0 0x7f7e4c0b1260 secure :-1 s=THROTTLE_DONE pgs=386 cs=0 l=1 rx=0x7f7e44001290 tx=0x7f7e4c12d8f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.275+0000 7f7e3bfff700 1 -- 172.21.15.103:0/855773435 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16115 (secure 0 0 0) 0x7f7e3c03fce0 con 0x7f7e4c12b9f0 2020-04-22T14:03:39.278 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:03:39.278 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":33,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:03:38.935232+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:03:37.161048+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2020-04-22T14:03:37.878823+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:03:39.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.276+0000 7f7e51244700 1 -- 172.21.15.103:0/855773435 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7e2804da50 msgr2=0x7f7e2804ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:39.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.276+0000 7f7e51244700 1 --2- 172.21.15.103:0/855773435 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7e2804da50 0x7f7e2804ff10 secure :-1 s=READY pgs=160 cs=0 l=1 rx=0x7f7e4c0b5d00 tx=0x7f7e44010070).stop 2020-04-22T14:03:39.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.276+0000 7f7e51244700 1 -- 172.21.15.103:0/855773435 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e4c12b9f0 msgr2=0x7f7e4c0b1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:39.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.276+0000 7f7e51244700 1 --2- 172.21.15.103:0/855773435 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e4c12b9f0 0x7f7e4c0b1260 secure :-1 s=READY pgs=386 cs=0 l=1 rx=0x7f7e44001290 tx=0x7f7e4c12d8f0).stop 2020-04-22T14:03:39.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.276+0000 7f7e51244700 1 -- 172.21.15.103:0/855773435 shutdown_connections 2020-04-22T14:03:39.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.276+0000 7f7e51244700 1 --2- 172.21.15.103:0/855773435 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e4c12b9f0 0x7f7e4c0b1260 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:39.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.276+0000 7f7e51244700 1 --2- 172.21.15.103:0/855773435 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7e2804da50 0x7f7e2804ff10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:39.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.276+0000 7f7e51244700 1 --2- 172.21.15.103:0/855773435 >> v2:172.21.15.86:3300/0 conn(0x7f7e4c142f60 0x7f7e4c12d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:39.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.276+0000 7f7e51244700 1 -- 172.21.15.103:0/855773435 >> 172.21.15.103:0/855773435 conn(0x7f7e4c05ad30 msgr2=0x7f7e4c12c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:39.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.276+0000 7f7e51244700 1 -- 172.21.15.103:0/855773435 shutdown_connections 2020-04-22T14:03:39.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.276+0000 7f7e51244700 1 -- 172.21.15.103:0/855773435 wait complete. 2020-04-22T14:03:39.294 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:39.309 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:03:39.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.453+0000 7f6b6e0e4700 1 Processor -- start 2020-04-22T14:03:39.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.453+0000 7f6b6e0e4700 1 -- start start 2020-04-22T14:03:39.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.454+0000 7f6b6e0e4700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6b6812c0d0 0x7f6b681464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:39.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.454+0000 7f6b6e0e4700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6b68065fe0 0x7f6b6805b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:39.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.454+0000 7f6b6e0e4700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b68143300 con 0x7f6b6805b8a0 2020-04-22T14:03:39.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.454+0000 7f6b6e0e4700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b6812c4b0 con 0x7f6b6812c0d0 2020-04-22T14:03:39.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.454+0000 7f6b6e0e4700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b681435a0 con 0x7f6b68065fe0 2020-04-22T14:03:39.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.454+0000 7f6b66ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6b68065fe0 0x7f6b6805b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:39.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.454+0000 7f6b67fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f6b6805b8a0 0x7f6b68062ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40870/0 (socket says 172.21.15.103:40870) 2020-04-22T14:03:39.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.454+0000 7f6b67fff700 1 -- 172.21.15.103:0/1784075117 learned_addr learned my addr 172.21.15.103:0/1784075117 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:39.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.454+0000 7f6b677fe700 1 --2- 172.21.15.103:0/1784075117 >> v2:172.21.15.86:3300/0 conn(0x7f6b6812c0d0 0x7f6b681464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:39.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.454+0000 7f6b66ffd700 1 -- 172.21.15.103:0/1784075117 >> v2:172.21.15.86:3300/0 conn(0x7f6b6812c0d0 msgr2=0x7f6b681464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:39.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.454+0000 7f6b66ffd700 1 --2- 172.21.15.103:0/1784075117 >> v2:172.21.15.86:3300/0 conn(0x7f6b6812c0d0 0x7f6b681464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:39.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.454+0000 7f6b66ffd700 1 -- 172.21.15.103:0/1784075117 >> v1:172.21.15.103:6789/0 conn(0x7f6b6805b8a0 legacy=0x7f6b68062ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:39.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.454+0000 7f6b66ffd700 1 -- 172.21.15.103:0/1784075117 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b68143840 con 0x7f6b68065fe0 2020-04-22T14:03:39.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.454+0000 7f6b667fc700 1 -- 172.21.15.103:0/1784075117 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2383348333 0 0) 0x7f6b68143300 con 0x7f6b6805b8a0 2020-04-22T14:03:39.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.454+0000 7f6b66ffd700 1 --2- 172.21.15.103:0/1784075117 >> v2:172.21.15.103:3300/0 conn(0x7f6b68065fe0 0x7f6b6805b440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6b5c002f30 tx=0x7f6b5c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.454+0000 7f6b66ffd700 1 --2- 172.21.15.103:0/1784075117 >> v2:172.21.15.103:3300/0 conn(0x7f6b68065fe0 0x7f6b6805b440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6b5c002f30 tx=0x7f6b5c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.454+0000 7f6b66ffd700 1 --2- 172.21.15.103:0/1784075117 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b68065fe0 0x7f6b6805b440 secure :-1 s=READY pgs=388 cs=0 l=1 rx=0x7f6b5c002f30 tx=0x7f6b5c007a40).ready entity=mon.1 client_cookie=87dd8f9ba68a6c5b server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:39.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.454+0000 7f6b66ffd700 1 --2- 172.21.15.103:0/1784075117 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b68065fe0 0x7f6b6805b440 secure :-1 s=THROTTLE_DONE pgs=388 cs=0 l=1 rx=0x7f6b5c002f30 tx=0x7f6b5c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.454+0000 7f6b667fc700 1 -- 172.21.15.103:0/1784075117 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b5c011470 con 0x7f6b68065fe0 2020-04-22T14:03:39.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.454+0000 7f6b66ffd700 1 --2- 172.21.15.103:0/1784075117 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b68065fe0 0x7f6b6805b440 secure :-1 s=THROTTLE_DONE pgs=388 cs=0 l=1 rx=0x7f6b5c002f30 tx=0x7f6b5c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.454+0000 7f6b667fc700 1 -- 172.21.15.103:0/1784075117 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b5c0115d0 con 0x7f6b68065fe0 2020-04-22T14:03:39.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.454+0000 7f6b66ffd700 1 --2- 172.21.15.103:0/1784075117 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b68065fe0 0x7f6b6805b440 secure :-1 s=THROTTLE_DONE pgs=388 cs=0 l=1 rx=0x7f6b5c002f30 tx=0x7f6b5c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.454+0000 7f6b667fc700 1 -- 172.21.15.103:0/1784075117 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b5c0119b0 con 0x7f6b68065fe0 2020-04-22T14:03:39.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.454+0000 7f6b6e0e4700 1 -- 172.21.15.103:0/1784075117 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b68065fe0 msgr2=0x7f6b6805b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:39.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.454+0000 7f6b6e0e4700 1 --2- 172.21.15.103:0/1784075117 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b68065fe0 0x7f6b6805b440 secure :-1 s=READY pgs=388 cs=0 l=1 rx=0x7f6b5c002f30 tx=0x7f6b5c007a40).stop 2020-04-22T14:03:39.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.455+0000 7f6b6e0e4700 1 -- 172.21.15.103:0/1784075117 shutdown_connections 2020-04-22T14:03:39.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.455+0000 7f6b6e0e4700 1 --2- 172.21.15.103:0/1784075117 >> v2:172.21.15.86:3300/0 conn(0x7f6b6812c0d0 0x7f6b681464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:39.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.455+0000 7f6b6e0e4700 1 --2- 172.21.15.103:0/1784075117 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b68065fe0 0x7f6b6805b440 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:39.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.455+0000 7f6b6e0e4700 1 -- 172.21.15.103:0/1784075117 >> 172.21.15.103:0/1784075117 conn(0x7f6b680b9160 msgr2=0x7f6b6805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:39.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.455+0000 7f6b6e0e4700 1 -- 172.21.15.103:0/1784075117 shutdown_connections 2020-04-22T14:03:39.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.455+0000 7f6b6e0e4700 1 -- 172.21.15.103:0/1784075117 wait complete. 2020-04-22T14:03:39.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.456+0000 7f6b6e0e4700 1 Processor -- start 2020-04-22T14:03:39.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.456+0000 7f6b6e0e4700 1 -- start start 2020-04-22T14:03:39.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.457+0000 7f6b6e0e4700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6b6805b8a0 0x7f6b680b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:39.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.457+0000 7f6b6e0e4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b6812c0d0 0x7f6b68127e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:39.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.457+0000 7f6b6e0e4700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b680b5920 con 0x7f6b68065fe0 2020-04-22T14:03:39.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.457+0000 7f6b6e0e4700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b680b3f70 con 0x7f6b6805b8a0 2020-04-22T14:03:39.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.457+0000 7f6b6e0e4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b680b4210 con 0x7f6b6812c0d0 2020-04-22T14:03:39.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.457+0000 7f6b677fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6b6805b8a0 0x7f6b680b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:39.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.457+0000 7f6b677fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6b6805b8a0 0x7f6b680b54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48682/0 (socket says 172.21.15.103:48682) 2020-04-22T14:03:39.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.457+0000 7f6b677fe700 1 -- 172.21.15.103:0/96364854 learned_addr learned my addr 172.21.15.103:0/96364854 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:39.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.457+0000 7f6b67fff700 1 --2- 172.21.15.103:0/96364854 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b6812c0d0 0x7f6b68127e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:39.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.457+0000 7f6b677fe700 1 -- 172.21.15.103:0/96364854 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b6812c0d0 msgr2=0x7f6b68127e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:39.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.457+0000 7f6b677fe700 1 --2- 172.21.15.103:0/96364854 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b6812c0d0 0x7f6b68127e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:39.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.457+0000 7f6b677fe700 1 -- 172.21.15.103:0/96364854 >> v1:172.21.15.86:6789/0 conn(0x7f6b68065fe0 legacy=0x7f6b680b2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:39.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.457+0000 7f6b677fe700 1 -- 172.21.15.103:0/96364854 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b680b44b0 con 0x7f6b6805b8a0 2020-04-22T14:03:39.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.457+0000 7f6b67fff700 1 --2- 172.21.15.103:0/96364854 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b6812c0d0 0x7f6b68127e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:03:39.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.457+0000 7f6b677fe700 1 --2- 172.21.15.103:0/96364854 >> v2:172.21.15.103:3300/0 conn(0x7f6b6805b8a0 0x7f6b680b54c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6b68066d50 tx=0x7f6b58010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.457+0000 7f6b677fe700 1 --2- 172.21.15.103:0/96364854 >> v2:172.21.15.103:3300/0 conn(0x7f6b6805b8a0 0x7f6b680b54c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6b68066d50 tx=0x7f6b58010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.457+0000 7f6b677fe700 1 --2- 172.21.15.103:0/96364854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b6805b8a0 0x7f6b680b54c0 secure :-1 s=READY pgs=389 cs=0 l=1 rx=0x7f6b68066d50 tx=0x7f6b58010af0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:39.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.457+0000 7f6b677fe700 1 --2- 172.21.15.103:0/96364854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b6805b8a0 0x7f6b680b54c0 secure :-1 s=THROTTLE_DONE pgs=389 cs=0 l=1 rx=0x7f6b68066d50 tx=0x7f6b58010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.457+0000 7f6b677fe700 1 --2- 172.21.15.103:0/96364854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b6805b8a0 0x7f6b680b54c0 secure :-1 s=THROTTLE_DONE pgs=389 cs=0 l=1 rx=0x7f6b68066d50 tx=0x7f6b58010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.457+0000 7f6b677fe700 1 --2- 172.21.15.103:0/96364854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b6805b8a0 0x7f6b680b54c0 secure :-1 s=THROTTLE_DONE pgs=389 cs=0 l=1 rx=0x7f6b68066d50 tx=0x7f6b58010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.457+0000 7f6b64ff9700 1 -- 172.21.15.103:0/96364854 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b58007360 con 0x7f6b6805b8a0 2020-04-22T14:03:39.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.457+0000 7f6b64ff9700 1 -- 172.21.15.103:0/96364854 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b58007500 con 0x7f6b6805b8a0 2020-04-22T14:03:39.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.457+0000 7f6b6e0e4700 1 -- 172.21.15.103:0/96364854 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b680ae950 con 0x7f6b6805b8a0 2020-04-22T14:03:39.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.457+0000 7f6b64ff9700 1 -- 172.21.15.103:0/96364854 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b580058b0 con 0x7f6b6805b8a0 2020-04-22T14:03:39.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.458+0000 7f6b6e0e4700 1 -- 172.21.15.103:0/96364854 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b680b3c90 con 0x7f6b6805b8a0 2020-04-22T14:03:39.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.458+0000 7f6b677fe700 1 --2- 172.21.15.103:0/96364854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b6805b8a0 0x7f6b680b54c0 secure :-1 s=THROTTLE_DONE pgs=389 cs=0 l=1 rx=0x7f6b68066d50 tx=0x7f6b58010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.458+0000 7f6b6e0e4700 1 -- 172.21.15.103:0/96364854 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b68056c90 con 0x7f6b6805b8a0 2020-04-22T14:03:39.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.459+0000 7f6b64ff9700 1 -- 172.21.15.103:0/96364854 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f6b58005a10 con 0x7f6b6805b8a0 2020-04-22T14:03:39.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.459+0000 7f6b677fe700 1 --2- 172.21.15.103:0/96364854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b6805b8a0 0x7f6b680b54c0 secure :-1 s=THROTTLE_DONE pgs=389 cs=0 l=1 rx=0x7f6b68066d50 tx=0x7f6b58010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.459+0000 7f6b64ff9700 1 --2- 172.21.15.103:0/96364854 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6b4804dac0 0x7f6b4804ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:39.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.459+0000 7f6b64ff9700 1 -- 172.21.15.103:0/96364854 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6b58061020 con 0x7f6b6805b8a0 2020-04-22T14:03:39.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.459+0000 7f6b66ffd700 1 --2- 172.21.15.103:0/96364854 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6b4804dac0 0x7f6b4804ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:39.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.459+0000 7f6b66ffd700 1 --2- 172.21.15.103:0/96364854 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6b4804dac0 0x7f6b4804ff80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6b5c002f30 tx=0x7f6b5c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.459+0000 7f6b66ffd700 1 --2- 172.21.15.103:0/96364854 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6b4804dac0 0x7f6b4804ff80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6b5c002f30 tx=0x7f6b5c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.459+0000 7f6b66ffd700 1 --2- 172.21.15.103:0/96364854 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6b4804dac0 0x7f6b4804ff80 secure :-1 s=READY pgs=161 cs=0 l=1 rx=0x7f6b5c002f30 tx=0x7f6b5c007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:39.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.463+0000 7f6b677fe700 1 --2- 172.21.15.103:0/96364854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b6805b8a0 0x7f6b680b54c0 secure :-1 s=THROTTLE_DONE pgs=389 cs=0 l=1 rx=0x7f6b68066d50 tx=0x7f6b58010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.463+0000 7f6b64ff9700 1 -- 172.21.15.103:0/96364854 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f6b5803c460 con 0x7f6b6805b8a0 2020-04-22T14:03:39.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.608+0000 7f6b6e0e4700 1 -- 172.21.15.103:0/96364854 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b680b5920 con 0x7f6b6805b8a0 2020-04-22T14:03:39.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.609+0000 7f6b677fe700 1 --2- 172.21.15.103:0/96364854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b6805b8a0 0x7f6b680b54c0 secure :-1 s=THROTTLE_DONE pgs=389 cs=0 l=1 rx=0x7f6b68066d50 tx=0x7f6b58010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.609+0000 7f6b64ff9700 1 -- 172.21.15.103:0/96364854 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16115 (secure 0 0 0) 0x7f6b680b5920 con 0x7f6b6805b8a0 2020-04-22T14:03:39.612 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:03:39.612 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":33,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:03:38.935232+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:03:37.161048+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2020-04-22T14:03:37.878823+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:03:39.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.610+0000 7f6b6e0e4700 1 -- 172.21.15.103:0/96364854 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6b4804dac0 msgr2=0x7f6b4804ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:39.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.610+0000 7f6b6e0e4700 1 --2- 172.21.15.103:0/96364854 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6b4804dac0 0x7f6b4804ff80 secure :-1 s=READY pgs=161 cs=0 l=1 rx=0x7f6b5c002f30 tx=0x7f6b5c007a40).stop 2020-04-22T14:03:39.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.610+0000 7f6b6e0e4700 1 -- 172.21.15.103:0/96364854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b6805b8a0 msgr2=0x7f6b680b54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:39.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.610+0000 7f6b6e0e4700 1 --2- 172.21.15.103:0/96364854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b6805b8a0 0x7f6b680b54c0 secure :-1 s=READY pgs=389 cs=0 l=1 rx=0x7f6b68066d50 tx=0x7f6b58010af0).stop 2020-04-22T14:03:39.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.610+0000 7f6b6e0e4700 1 -- 172.21.15.103:0/96364854 shutdown_connections 2020-04-22T14:03:39.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.610+0000 7f6b6e0e4700 1 --2- 172.21.15.103:0/96364854 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6b4804dac0 0x7f6b4804ff80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:39.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.610+0000 7f6b6e0e4700 1 --2- 172.21.15.103:0/96364854 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b6812c0d0 0x7f6b68127e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:39.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.610+0000 7f6b6e0e4700 1 --2- 172.21.15.103:0/96364854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b6805b8a0 0x7f6b680b54c0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:39.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.610+0000 7f6b6e0e4700 1 -- 172.21.15.103:0/96364854 >> 172.21.15.103:0/96364854 conn(0x7f6b680b9160 msgr2=0x7f6b6805ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:39.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.610+0000 7f6b6e0e4700 1 -- 172.21.15.103:0/96364854 shutdown_connections 2020-04-22T14:03:39.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.610+0000 7f6b6e0e4700 1 -- 172.21.15.103:0/96364854 wait complete. 2020-04-22T14:03:39.624 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:39.637 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-04-22T14:03:39.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.784+0000 7f87f3aa3700 1 Processor -- start 2020-04-22T14:03:39.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.784+0000 7f87f3aa3700 1 -- start start 2020-04-22T14:03:39.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.785+0000 7f87f3aa3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f87ec0b4820 0x7f87ec0acb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:39.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.785+0000 7f87f3aa3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f87ec141f20 0x7f87ec142380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:39.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.785+0000 7f87f3aa3700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87ec0af030 con 0x7f87ec061a30 2020-04-22T14:03:39.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.785+0000 7f87f3aa3700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87ec060250 con 0x7f87ec141f20 2020-04-22T14:03:39.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.785+0000 7f87f3aa3700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87ec0623c0 con 0x7f87ec0b4820 2020-04-22T14:03:39.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.785+0000 7f87f103e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f87ec0b4820 0x7f87ec0acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:39.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.785+0000 7f87f103e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f87ec0b4820 0x7f87ec0acb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48692/0 (socket says 172.21.15.103:48692) 2020-04-22T14:03:39.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.785+0000 7f87f103e700 1 -- 172.21.15.103:0/436265980 learned_addr learned my addr 172.21.15.103:0/436265980 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:39.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.785+0000 7f87f2040700 1 --2- 172.21.15.103:0/436265980 >> v2:172.21.15.86:3300/0 conn(0x7f87ec141f20 0x7f87ec142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:39.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.785+0000 7f87f103e700 1 -- 172.21.15.103:0/436265980 >> v2:172.21.15.86:3300/0 conn(0x7f87ec141f20 msgr2=0x7f87ec142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:39.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.785+0000 7f87f103e700 1 --2- 172.21.15.103:0/436265980 >> v2:172.21.15.86:3300/0 conn(0x7f87ec141f20 0x7f87ec142380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:39.792 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.785+0000 7f87f103e700 1 -- 172.21.15.103:0/436265980 >> v1:172.21.15.86:6789/0 conn(0x7f87ec061a30 legacy=0x7f87ec0ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:39.792 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.785+0000 7f87f103e700 1 -- 172.21.15.103:0/436265980 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ec062660 con 0x7f87ec0b4820 2020-04-22T14:03:39.792 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.785+0000 7f87f2040700 1 --2- 172.21.15.103:0/436265980 >> v2:172.21.15.86:3300/0 conn(0x7f87ec141f20 0x7f87ec142380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:03:39.792 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.786+0000 7f87f103e700 1 --2- 172.21.15.103:0/436265980 >> v2:172.21.15.103:3300/0 conn(0x7f87ec0b4820 0x7f87ec0acb10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f87e8002f30 tx=0x7f87e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.792 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.786+0000 7f87f103e700 1 --2- 172.21.15.103:0/436265980 >> v2:172.21.15.103:3300/0 conn(0x7f87ec0b4820 0x7f87ec0acb10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f87e8002f30 tx=0x7f87e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.792 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.786+0000 7f87f103e700 1 --2- 172.21.15.103:0/436265980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87ec0b4820 0x7f87ec0acb10 secure :-1 s=READY pgs=390 cs=0 l=1 rx=0x7f87e8002f30 tx=0x7f87e8007a40).ready entity=mon.1 client_cookie=d14866508b4c2bee server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:39.792 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.786+0000 7f87f103e700 1 --2- 172.21.15.103:0/436265980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87ec0b4820 0x7f87ec0acb10 secure :-1 s=THROTTLE_DONE pgs=390 cs=0 l=1 rx=0x7f87e8002f30 tx=0x7f87e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.786+0000 7f87f083d700 1 -- 172.21.15.103:0/436265980 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87e8011720 con 0x7f87ec0b4820 2020-04-22T14:03:39.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.786+0000 7f87f103e700 1 --2- 172.21.15.103:0/436265980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87ec0b4820 0x7f87ec0acb10 secure :-1 s=THROTTLE_DONE pgs=390 cs=0 l=1 rx=0x7f87e8002f30 tx=0x7f87e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.786+0000 7f87f083d700 1 -- 172.21.15.103:0/436265980 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e8011880 con 0x7f87ec0b4820 2020-04-22T14:03:39.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.786+0000 7f87f103e700 1 --2- 172.21.15.103:0/436265980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87ec0b4820 0x7f87ec0acb10 secure :-1 s=THROTTLE_DONE pgs=390 cs=0 l=1 rx=0x7f87e8002f30 tx=0x7f87e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.786+0000 7f87f083d700 1 -- 172.21.15.103:0/436265980 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87e8011ca0 con 0x7f87ec0b4820 2020-04-22T14:03:39.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.786+0000 7f87f3aa3700 1 -- 172.21.15.103:0/436265980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87ec0b4820 msgr2=0x7f87ec0acb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:39.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.786+0000 7f87f3aa3700 1 --2- 172.21.15.103:0/436265980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87ec0b4820 0x7f87ec0acb10 secure :-1 s=READY pgs=390 cs=0 l=1 rx=0x7f87e8002f30 tx=0x7f87e8007a40).stop 2020-04-22T14:03:39.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.786+0000 7f87f3aa3700 1 -- 172.21.15.103:0/436265980 shutdown_connections 2020-04-22T14:03:39.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.786+0000 7f87f3aa3700 1 --2- 172.21.15.103:0/436265980 >> v2:172.21.15.86:3300/0 conn(0x7f87ec141f20 0x7f87ec142380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:39.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.786+0000 7f87f3aa3700 1 --2- 172.21.15.103:0/436265980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87ec0b4820 0x7f87ec0acb10 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:39.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.786+0000 7f87f3aa3700 1 -- 172.21.15.103:0/436265980 >> 172.21.15.103:0/436265980 conn(0x7f87ec05b7b0 msgr2=0x7f87ec0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:39.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.786+0000 7f87f3aa3700 1 -- 172.21.15.103:0/436265980 shutdown_connections 2020-04-22T14:03:39.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.786+0000 7f87f3aa3700 1 -- 172.21.15.103:0/436265980 wait complete. 2020-04-22T14:03:39.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.787+0000 7f87f3aa3700 1 Processor -- start 2020-04-22T14:03:39.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.787+0000 7f87f3aa3700 1 -- start start 2020-04-22T14:03:39.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.788+0000 7f87f3aa3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87ec061a30 0x7f87ec1444a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:39.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.788+0000 7f87f3aa3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f87ec141f20 0x7f87ec0b2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:39.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.788+0000 7f87f3aa3700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87ec144230 con 0x7f87ec0b4820 2020-04-22T14:03:39.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.788+0000 7f87f3aa3700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87ec0b0c80 con 0x7f87ec141f20 2020-04-22T14:03:39.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.788+0000 7f87f3aa3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec0b02a0 con 0x7f87ec061a30 2020-04-22T14:03:39.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.788+0000 7f87f103e700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f87ec0b4820 0x7f87ec137db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40888/0 (socket says 172.21.15.103:40888) 2020-04-22T14:03:39.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.788+0000 7f87f103e700 1 -- 172.21.15.103:0/3345270002 learned_addr learned my addr 172.21.15.103:0/3345270002 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:39.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.788+0000 7f87daffd700 1 -- 172.21.15.103:0/3345270002 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2950417639 0 0) 0x7f87ec144230 con 0x7f87ec0b4820 2020-04-22T14:03:39.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.788+0000 7f87daffd700 1 -- 172.21.15.103:0/3345270002 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87cc002fe0 con 0x7f87ec0b4820 2020-04-22T14:03:39.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.788+0000 7f87f2040700 1 --2- 172.21.15.103:0/3345270002 >> v2:172.21.15.86:3300/0 conn(0x7f87ec141f20 0x7f87ec0b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:39.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.788+0000 7f87f183f700 1 --2- 172.21.15.103:0/3345270002 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87ec061a30 0x7f87ec1444a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:39.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.789+0000 7f87daffd700 1 -- 172.21.15.103:0/3345270002 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4181619880 0 0) 0x7f87cc002fe0 con 0x7f87ec0b4820 2020-04-22T14:03:39.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.789+0000 7f87daffd700 1 -- 172.21.15.103:0/3345270002 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f87ec144230 con 0x7f87ec0b4820 2020-04-22T14:03:39.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.789+0000 7f87daffd700 1 -- 172.21.15.103:0/3345270002 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f87e80085e0 con 0x7f87ec0b4820 2020-04-22T14:03:39.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.789+0000 7f87daffd700 1 -- 172.21.15.103:0/3345270002 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87ec061a30 msgr2=0x7f87ec1444a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:39.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.789+0000 7f87daffd700 1 --2- 172.21.15.103:0/3345270002 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87ec061a30 0x7f87ec1444a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:39.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.789+0000 7f87daffd700 1 -- 172.21.15.103:0/3345270002 >> v2:172.21.15.86:3300/0 conn(0x7f87ec141f20 msgr2=0x7f87ec0b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:39.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.789+0000 7f87daffd700 1 --2- 172.21.15.103:0/3345270002 >> v2:172.21.15.86:3300/0 conn(0x7f87ec141f20 0x7f87ec0b2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:39.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.789+0000 7f87daffd700 1 -- 172.21.15.103:0/3345270002 >> v1:172.21.15.103:6789/0 conn(0x7f87ec0b4820 legacy=0x7f87ec137db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:39.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.789+0000 7f87daffd700 1 --2- 172.21.15.103:0/3345270002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87cc0049b0 0x7f87cc004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:39.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.789+0000 7f87daffd700 1 --2- 172.21.15.103:0/3345270002 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87cc0052b0 0x7f87cc0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:39.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.789+0000 7f87daffd700 1 --2- 172.21.15.103:0/3345270002 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87ec061a30 0x7f87cc004010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:39.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.789+0000 7f87daffd700 1 -- 172.21.15.103:0/3345270002 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec0b0c80 con 0x7f87cc0052b0 2020-04-22T14:03:39.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.789+0000 7f87daffd700 1 -- 172.21.15.103:0/3345270002 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec0b02a0 con 0x7f87cc0049b0 2020-04-22T14:03:39.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.789+0000 7f87daffd700 1 -- 172.21.15.103:0/3345270002 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87cc004540 con 0x7f87ec061a30 2020-04-22T14:03:39.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.789+0000 7f87f183f700 1 --2- 172.21.15.103:0/3345270002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87cc0049b0 0x7f87cc004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:39.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.789+0000 7f87f103e700 1 --2- 172.21.15.103:0/3345270002 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87cc0052b0 0x7f87cc0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:39.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.789+0000 7f87f2040700 1 --2- 172.21.15.103:0/3345270002 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87ec061a30 0x7f87cc004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:39.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.789+0000 7f87f183f700 1 -- 172.21.15.103:0/3345270002 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87ec061a30 msgr2=0x7f87cc004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:39.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.789+0000 7f87f183f700 1 --2- 172.21.15.103:0/3345270002 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87ec061a30 0x7f87cc004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:39.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.789+0000 7f87f183f700 1 -- 172.21.15.103:0/3345270002 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87cc0052b0 msgr2=0x7f87cc0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:39.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.789+0000 7f87f183f700 1 --2- 172.21.15.103:0/3345270002 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87cc0052b0 0x7f87cc0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:39.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.789+0000 7f87f183f700 1 -- 172.21.15.103:0/3345270002 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ec0b0540 con 0x7f87cc0049b0 2020-04-22T14:03:39.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.789+0000 7f87f2040700 1 --2- 172.21.15.103:0/3345270002 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87ec061a30 0x7f87cc004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:03:39.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.789+0000 7f87f3aa3700 1 -- 172.21.15.103:0/3345270002 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87ec0b07e0 con 0x7f87cc0049b0 2020-04-22T14:03:39.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.789+0000 7f87f183f700 1 --2- 172.21.15.103:0/3345270002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87cc0049b0 0x7f87cc004d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f87ec05bc40 tx=0x7f87dc010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.789+0000 7f87f103e700 1 --2- 172.21.15.103:0/3345270002 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87cc0052b0 0x7f87cc0039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:03:39.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.789+0000 7f87f3aa3700 1 -- 172.21.15.103:0/3345270002 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87ec138700 con 0x7f87cc0049b0 2020-04-22T14:03:39.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.789+0000 7f87f183f700 1 --2- 172.21.15.103:0/3345270002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87cc0049b0 0x7f87cc004d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f87ec05bc40 tx=0x7f87dc010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.789+0000 7f87f183f700 1 --2- 172.21.15.103:0/3345270002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87cc0049b0 0x7f87cc004d90 secure :-1 s=READY pgs=392 cs=0 l=1 rx=0x7f87ec05bc40 tx=0x7f87dc010ca0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:39.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.789+0000 7f87f183f700 1 --2- 172.21.15.103:0/3345270002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87cc0049b0 0x7f87cc004d90 secure :-1 s=THROTTLE_DONE pgs=392 cs=0 l=1 rx=0x7f87ec05bc40 tx=0x7f87dc010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.789+0000 7f87daffd700 1 -- 172.21.15.103:0/3345270002 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87dc001e90 con 0x7f87cc0049b0 2020-04-22T14:03:39.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.789+0000 7f87f183f700 1 --2- 172.21.15.103:0/3345270002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87cc0049b0 0x7f87cc004d90 secure :-1 s=THROTTLE_DONE pgs=392 cs=0 l=1 rx=0x7f87ec05bc40 tx=0x7f87dc010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.789+0000 7f87f183f700 1 --2- 172.21.15.103:0/3345270002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87cc0049b0 0x7f87cc004d90 secure :-1 s=THROTTLE_DONE pgs=392 cs=0 l=1 rx=0x7f87ec05bc40 tx=0x7f87dc010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.789+0000 7f87daffd700 1 -- 172.21.15.103:0/3345270002 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87dc0066d0 con 0x7f87cc0049b0 2020-04-22T14:03:39.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.789+0000 7f87daffd700 1 -- 172.21.15.103:0/3345270002 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87dc006ab0 con 0x7f87cc0049b0 2020-04-22T14:03:39.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.790+0000 7f87f183f700 1 --2- 172.21.15.103:0/3345270002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87cc0049b0 0x7f87cc004d90 secure :-1 s=THROTTLE_DONE pgs=392 cs=0 l=1 rx=0x7f87ec05bc40 tx=0x7f87dc010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.790+0000 7f87daffd700 1 -- 172.21.15.103:0/3345270002 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f87dc006c10 con 0x7f87cc0049b0 2020-04-22T14:03:39.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.790+0000 7f87f3aa3700 1 -- 172.21.15.103:0/3345270002 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87ec056c90 con 0x7f87cc0049b0 2020-04-22T14:03:39.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.790+0000 7f87f183f700 1 --2- 172.21.15.103:0/3345270002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87cc0049b0 0x7f87cc004d90 secure :-1 s=THROTTLE_DONE pgs=392 cs=0 l=1 rx=0x7f87ec05bc40 tx=0x7f87dc010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.791+0000 7f87daffd700 1 --2- 172.21.15.103:0/3345270002 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f87cc055b90 0x7f87cc058050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:39.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.791+0000 7f87daffd700 1 -- 172.21.15.103:0/3345270002 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f87dc0613c0 con 0x7f87cc0049b0 2020-04-22T14:03:39.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.791+0000 7f87f103e700 1 --2- 172.21.15.103:0/3345270002 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f87cc055b90 0x7f87cc058050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:39.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.791+0000 7f87f103e700 1 --2- 172.21.15.103:0/3345270002 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f87cc055b90 0x7f87cc058050 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f87e80102c0 tx=0x7f87e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.791+0000 7f87f103e700 1 --2- 172.21.15.103:0/3345270002 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f87cc055b90 0x7f87cc058050 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f87e80102c0 tx=0x7f87e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.791+0000 7f87f103e700 1 --2- 172.21.15.103:0/3345270002 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f87cc055b90 0x7f87cc058050 secure :-1 s=READY pgs=162 cs=0 l=1 rx=0x7f87e80102c0 tx=0x7f87e8007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:39.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.795+0000 7f87f183f700 1 --2- 172.21.15.103:0/3345270002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87cc0049b0 0x7f87cc004d90 secure :-1 s=THROTTLE_DONE pgs=392 cs=0 l=1 rx=0x7f87ec05bc40 tx=0x7f87dc010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:39.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.795+0000 7f87daffd700 1 -- 172.21.15.103:0/3345270002 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f87dc03c860 con 0x7f87cc0049b0 2020-04-22T14:03:39.996 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:39.989+0000 7f87f3aa3700 1 -- 172.21.15.103:0/3345270002 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f87ec06a960 con 0x7f87cc0049b0 2020-04-22T14:03:40.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:40.788+0000 7f87f183f700 1 --2- 172.21.15.103:0/3345270002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87cc0049b0 0x7f87cc004d90 secure :-1 s=READY pgs=392 cs=0 l=1 rx=0x7f87ec05bc40 tx=0x7f87dc010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:40.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:40.954+0000 7f87f183f700 1 --2- 172.21.15.103:0/3345270002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87cc0049b0 0x7f87cc004d90 secure :-1 s=THROTTLE_DONE pgs=392 cs=0 l=1 rx=0x7f87ec05bc40 tx=0x7f87dc010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:40.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:40.954+0000 7f87daffd700 1 -- 172.21.15.103:0/3345270002 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7f87dc03fe80 con 0x7f87cc0049b0 2020-04-22T14:03:40.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:40.956+0000 7f87f3aa3700 1 -- 172.21.15.103:0/3345270002 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f87cc055b90 msgr2=0x7f87cc058050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:40.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:40.956+0000 7f87f3aa3700 1 --2- 172.21.15.103:0/3345270002 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f87cc055b90 0x7f87cc058050 secure :-1 s=READY pgs=162 cs=0 l=1 rx=0x7f87e80102c0 tx=0x7f87e8007a40).stop 2020-04-22T14:03:40.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:40.956+0000 7f87f3aa3700 1 -- 172.21.15.103:0/3345270002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87cc0049b0 msgr2=0x7f87cc004d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:40.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:40.956+0000 7f87f3aa3700 1 --2- 172.21.15.103:0/3345270002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87cc0049b0 0x7f87cc004d90 secure :-1 s=READY pgs=392 cs=0 l=1 rx=0x7f87ec05bc40 tx=0x7f87dc010ca0).stop 2020-04-22T14:03:40.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:40.956+0000 7f87f2040700 1 -- 172.21.15.103:0/3345270002 reap_dead start 2020-04-22T14:03:40.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:40.956+0000 7f87f2040700 1 -- 172.21.15.103:0/3345270002 reap_dead start 2020-04-22T14:03:40.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:40.956+0000 7f87f3aa3700 1 -- 172.21.15.103:0/3345270002 shutdown_connections 2020-04-22T14:03:40.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:40.956+0000 7f87f3aa3700 1 -- 172.21.15.103:0/3345270002 >> 172.21.15.103:0/3345270002 conn(0x7f87ec05b7b0 msgr2=0x7f87ec0b7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:40.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:40.956+0000 7f87f3aa3700 1 -- 172.21.15.103:0/3345270002 shutdown_connections 2020-04-22T14:03:40.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:40.956+0000 7f87f3aa3700 1 -- 172.21.15.103:0/3345270002 wait complete. 2020-04-22T14:03:40.971 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:40.991 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:03:41.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.141+0000 7efc605d4700 1 Processor -- start 2020-04-22T14:03:41.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.141+0000 7efc605d4700 1 -- start start 2020-04-22T14:03:41.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.142+0000 7efc605d4700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7efc580ac740 0x7efc580b5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:41.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.142+0000 7efc605d4700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7efc58064a10 0x7efc581421f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:41.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.142+0000 7efc605d4700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc580b51e0 con 0x7efc581282c0 2020-04-22T14:03:41.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.142+0000 7efc605d4700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc581286a0 con 0x7efc58064a10 2020-04-22T14:03:41.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.142+0000 7efc605d4700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc580b6020 con 0x7efc580ac740 2020-04-22T14:03:41.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.142+0000 7efc5db6f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7efc580ac740 0x7efc580b5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:41.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.142+0000 7efc5db6f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7efc580ac740 0x7efc580b5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48712/0 (socket says 172.21.15.103:48712) 2020-04-22T14:03:41.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.142+0000 7efc5db6f700 1 -- 172.21.15.103:0/3866316702 learned_addr learned my addr 172.21.15.103:0/3866316702 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:41.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.142+0000 7efc5eb71700 1 --2- 172.21.15.103:0/3866316702 >> v2:172.21.15.86:3300/0 conn(0x7efc58064a10 0x7efc581421f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:41.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.142+0000 7efc5db6f700 1 -- 172.21.15.103:0/3866316702 >> v2:172.21.15.86:3300/0 conn(0x7efc58064a10 msgr2=0x7efc581421f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:41.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.142+0000 7efc5db6f700 1 --2- 172.21.15.103:0/3866316702 >> v2:172.21.15.86:3300/0 conn(0x7efc58064a10 0x7efc581421f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:41.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.142+0000 7efc5db6f700 1 -- 172.21.15.103:0/3866316702 >> v1:172.21.15.86:6789/0 conn(0x7efc581282c0 legacy=0x7efc5805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:41.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.142+0000 7efc5db6f700 1 -- 172.21.15.103:0/3866316702 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc580b5480 con 0x7efc580ac740 2020-04-22T14:03:41.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.142+0000 7efc5db6f700 1 --2- 172.21.15.103:0/3866316702 >> v2:172.21.15.103:3300/0 conn(0x7efc580ac740 0x7efc580b5bc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efc48002f30 tx=0x7efc48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.142+0000 7efc5db6f700 1 --2- 172.21.15.103:0/3866316702 >> v2:172.21.15.103:3300/0 conn(0x7efc580ac740 0x7efc580b5bc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efc48002f30 tx=0x7efc48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.142+0000 7efc5db6f700 1 --2- 172.21.15.103:0/3866316702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc580ac740 0x7efc580b5bc0 secure :-1 s=READY pgs=393 cs=0 l=1 rx=0x7efc48002f30 tx=0x7efc48007a40).ready entity=mon.1 client_cookie=7e540d56872129fa server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:41.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.142+0000 7efc5db6f700 1 --2- 172.21.15.103:0/3866316702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc580ac740 0x7efc580b5bc0 secure :-1 s=THROTTLE_DONE pgs=393 cs=0 l=1 rx=0x7efc48002f30 tx=0x7efc48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.142+0000 7efc5d36e700 1 -- 172.21.15.103:0/3866316702 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc48011720 con 0x7efc580ac740 2020-04-22T14:03:41.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.143+0000 7efc5db6f700 1 --2- 172.21.15.103:0/3866316702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc580ac740 0x7efc580b5bc0 secure :-1 s=THROTTLE_DONE pgs=393 cs=0 l=1 rx=0x7efc48002f30 tx=0x7efc48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.143+0000 7efc5db6f700 1 --2- 172.21.15.103:0/3866316702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc580ac740 0x7efc580b5bc0 secure :-1 s=THROTTLE_DONE pgs=393 cs=0 l=1 rx=0x7efc48002f30 tx=0x7efc48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.143+0000 7efc5d36e700 1 -- 172.21.15.103:0/3866316702 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc48011880 con 0x7efc580ac740 2020-04-22T14:03:41.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.143+0000 7efc5d36e700 1 -- 172.21.15.103:0/3866316702 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc48011ca0 con 0x7efc580ac740 2020-04-22T14:03:41.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.143+0000 7efc605d4700 1 -- 172.21.15.103:0/3866316702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc580ac740 msgr2=0x7efc580b5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:41.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.143+0000 7efc605d4700 1 --2- 172.21.15.103:0/3866316702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc580ac740 0x7efc580b5bc0 secure :-1 s=READY pgs=393 cs=0 l=1 rx=0x7efc48002f30 tx=0x7efc48007a40).stop 2020-04-22T14:03:41.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.143+0000 7efc605d4700 1 -- 172.21.15.103:0/3866316702 shutdown_connections 2020-04-22T14:03:41.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.143+0000 7efc605d4700 1 --2- 172.21.15.103:0/3866316702 >> v2:172.21.15.86:3300/0 conn(0x7efc58064a10 0x7efc581421f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:41.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.143+0000 7efc605d4700 1 --2- 172.21.15.103:0/3866316702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc580ac740 0x7efc580b5bc0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:41.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.143+0000 7efc605d4700 1 -- 172.21.15.103:0/3866316702 >> 172.21.15.103:0/3866316702 conn(0x7efc580b9160 msgr2=0x7efc5805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:41.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.143+0000 7efc605d4700 1 -- 172.21.15.103:0/3866316702 shutdown_connections 2020-04-22T14:03:41.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.143+0000 7efc605d4700 1 -- 172.21.15.103:0/3866316702 wait complete. 2020-04-22T14:03:41.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.144+0000 7efc605d4700 1 Processor -- start 2020-04-22T14:03:41.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.144+0000 7efc605d4700 1 -- start start 2020-04-22T14:03:41.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.145+0000 7efc605d4700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7efc580ac740 0x7efc58126f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:41.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.145+0000 7efc605d4700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc5813e310 con 0x7efc58064a10 2020-04-22T14:03:41.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.145+0000 7efc605d4700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc5813e5b0 con 0x7efc581282c0 2020-04-22T14:03:41.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.145+0000 7efc605d4700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc581243d0 con 0x7efc580ac740 2020-04-22T14:03:41.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.145+0000 7efc5db6f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7efc580ac740 0x7efc58126f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:41.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.145+0000 7efc5eb71700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7efc581282c0 0x7efc58124c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40910/0 (socket says 172.21.15.103:40910) 2020-04-22T14:03:41.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.145+0000 7efc5db6f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7efc580ac740 0x7efc58126f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48718/0 (socket says 172.21.15.103:48718) 2020-04-22T14:03:41.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.145+0000 7efc5eb71700 1 -- 172.21.15.103:0/4270632954 learned_addr learned my addr 172.21.15.103:0/4270632954 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:41.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.145+0000 7efc5db6f700 1 -- 172.21.15.103:0/4270632954 >> v1:172.21.15.103:6789/0 conn(0x7efc581282c0 legacy=0x7efc58124c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:41.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.145+0000 7efc5db6f700 1 -- 172.21.15.103:0/4270632954 >> v1:172.21.15.86:6789/0 conn(0x7efc58064a10 legacy=0x7efc5813bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:41.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.145+0000 7efc477fe700 1 -- 172.21.15.103:0/4270632954 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2161804573 0 0) 0x7efc5813e5b0 con 0x7efc581282c0 2020-04-22T14:03:41.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.145+0000 7efc5db6f700 1 -- 172.21.15.103:0/4270632954 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc5813e850 con 0x7efc580ac740 2020-04-22T14:03:41.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.145+0000 7efc5db6f700 1 --2- 172.21.15.103:0/4270632954 >> v2:172.21.15.103:3300/0 conn(0x7efc580ac740 0x7efc58126f60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efc48002f30 tx=0x7efc48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.145+0000 7efc5db6f700 1 --2- 172.21.15.103:0/4270632954 >> v2:172.21.15.103:3300/0 conn(0x7efc580ac740 0x7efc58126f60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efc48002f30 tx=0x7efc48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.145+0000 7efc5db6f700 1 --2- 172.21.15.103:0/4270632954 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc580ac740 0x7efc58126f60 secure :-1 s=READY pgs=395 cs=0 l=1 rx=0x7efc48002f30 tx=0x7efc48007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:41.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.145+0000 7efc5db6f700 1 --2- 172.21.15.103:0/4270632954 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc580ac740 0x7efc58126f60 secure :-1 s=THROTTLE_DONE pgs=395 cs=0 l=1 rx=0x7efc48002f30 tx=0x7efc48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.145+0000 7efc477fe700 1 -- 172.21.15.103:0/4270632954 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc48011d10 con 0x7efc580ac740 2020-04-22T14:03:41.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.145+0000 7efc5db6f700 1 --2- 172.21.15.103:0/4270632954 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc580ac740 0x7efc58126f60 secure :-1 s=THROTTLE_DONE pgs=395 cs=0 l=1 rx=0x7efc48002f30 tx=0x7efc48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.145+0000 7efc477fe700 1 -- 172.21.15.103:0/4270632954 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc48007360 con 0x7efc580ac740 2020-04-22T14:03:41.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.145+0000 7efc5db6f700 1 --2- 172.21.15.103:0/4270632954 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc580ac740 0x7efc58126f60 secure :-1 s=THROTTLE_DONE pgs=395 cs=0 l=1 rx=0x7efc48002f30 tx=0x7efc48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.145+0000 7efc605d4700 1 -- 172.21.15.103:0/4270632954 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc5813ecf0 con 0x7efc580ac740 2020-04-22T14:03:41.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.145+0000 7efc477fe700 1 -- 172.21.15.103:0/4270632954 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc480056c0 con 0x7efc580ac740 2020-04-22T14:03:41.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.145+0000 7efc605d4700 1 -- 172.21.15.103:0/4270632954 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc5813c8a0 con 0x7efc580ac740 2020-04-22T14:03:41.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.146+0000 7efc5db6f700 1 --2- 172.21.15.103:0/4270632954 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc580ac740 0x7efc58126f60 secure :-1 s=THROTTLE_DONE pgs=395 cs=0 l=1 rx=0x7efc48002f30 tx=0x7efc48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.146+0000 7efc477fe700 1 -- 172.21.15.103:0/4270632954 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7efc48005870 con 0x7efc580ac740 2020-04-22T14:03:41.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.146+0000 7efc5db6f700 1 --2- 172.21.15.103:0/4270632954 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc580ac740 0x7efc58126f60 secure :-1 s=THROTTLE_DONE pgs=395 cs=0 l=1 rx=0x7efc48002f30 tx=0x7efc48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.146+0000 7efc605d4700 1 -- 172.21.15.103:0/4270632954 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc5813e9e0 con 0x7efc580ac740 2020-04-22T14:03:41.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.147+0000 7efc477fe700 1 --2- 172.21.15.103:0/4270632954 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efc3804d880 0x7efc3804fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:41.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.147+0000 7efc477fe700 1 -- 172.21.15.103:0/4270632954 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efc48061be0 con 0x7efc580ac740 2020-04-22T14:03:41.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.147+0000 7efc5e370700 1 --2- 172.21.15.103:0/4270632954 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efc3804d880 0x7efc3804fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:41.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.147+0000 7efc5e370700 1 --2- 172.21.15.103:0/4270632954 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efc3804d880 0x7efc3804fd40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efc581249c0 tx=0x7efc54002580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.147+0000 7efc5e370700 1 --2- 172.21.15.103:0/4270632954 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efc3804d880 0x7efc3804fd40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efc581249c0 tx=0x7efc54002580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.147+0000 7efc5e370700 1 --2- 172.21.15.103:0/4270632954 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efc3804d880 0x7efc3804fd40 secure :-1 s=READY pgs=163 cs=0 l=1 rx=0x7efc581249c0 tx=0x7efc54002580).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:41.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.151+0000 7efc5db6f700 1 --2- 172.21.15.103:0/4270632954 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc580ac740 0x7efc58126f60 secure :-1 s=THROTTLE_DONE pgs=395 cs=0 l=1 rx=0x7efc48002f30 tx=0x7efc48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.151+0000 7efc477fe700 1 -- 172.21.15.103:0/4270632954 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7efc4803d0e0 con 0x7efc580ac740 2020-04-22T14:03:41.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.343+0000 7efc605d4700 1 -- 172.21.15.103:0/4270632954 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc58056c90 con 0x7efc580ac740 2020-04-22T14:03:41.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.344+0000 7efc5db6f700 1 --2- 172.21.15.103:0/4270632954 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc580ac740 0x7efc58126f60 secure :-1 s=THROTTLE_DONE pgs=395 cs=0 l=1 rx=0x7efc48002f30 tx=0x7efc48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.344+0000 7efc477fe700 1 -- 172.21.15.103:0/4270632954 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2141 (secure 0 0 0) 0x7efc48040700 con 0x7efc580ac740 2020-04-22T14:03:41.347 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:03:41.347 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4956,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/2333777975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2333777975},{"type":"v1","addr":"172.21.15.86:6835","nonce":2333777975}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:03:38.935462+0000","modified":"2020-04-22T14:03:40.946647+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5050},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5050":{"gid":5050,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/3282872682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3282872682},{"type":"v1","addr":"172.21.15.103:6833","nonce":3282872682}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2020-04-22T14:03:41.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.345+0000 7efc605d4700 1 -- 172.21.15.103:0/4270632954 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efc3804d880 msgr2=0x7efc3804fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:41.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.345+0000 7efc605d4700 1 --2- 172.21.15.103:0/4270632954 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efc3804d880 0x7efc3804fd40 secure :-1 s=READY pgs=163 cs=0 l=1 rx=0x7efc581249c0 tx=0x7efc54002580).stop 2020-04-22T14:03:41.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.345+0000 7efc605d4700 1 -- 172.21.15.103:0/4270632954 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc580ac740 msgr2=0x7efc58126f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:41.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.345+0000 7efc605d4700 1 --2- 172.21.15.103:0/4270632954 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc580ac740 0x7efc58126f60 secure :-1 s=READY pgs=395 cs=0 l=1 rx=0x7efc48002f30 tx=0x7efc48007a40).stop 2020-04-22T14:03:41.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.345+0000 7efc605d4700 1 -- 172.21.15.103:0/4270632954 shutdown_connections 2020-04-22T14:03:41.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.345+0000 7efc605d4700 1 --2- 172.21.15.103:0/4270632954 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efc3804d880 0x7efc3804fd40 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:41.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.345+0000 7efc605d4700 1 --2- 172.21.15.103:0/4270632954 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc580ac740 0x7efc58126f60 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:41.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.345+0000 7efc605d4700 1 -- 172.21.15.103:0/4270632954 >> 172.21.15.103:0/4270632954 conn(0x7efc580b9160 msgr2=0x7efc58063ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:41.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.345+0000 7efc605d4700 1 -- 172.21.15.103:0/4270632954 shutdown_connections 2020-04-22T14:03:41.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.345+0000 7efc605d4700 1 -- 172.21.15.103:0/4270632954 wait complete. 2020-04-22T14:03:41.350 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 14 2020-04-22T14:03:41.359 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:41.373 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:03:41.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.517+0000 7fbf1f926700 1 Processor -- start 2020-04-22T14:03:41.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.517+0000 7fbf1f926700 1 -- start start 2020-04-22T14:03:41.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.518+0000 7fbf1f926700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbf18067170 0x7fbf180b6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:41.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.518+0000 7fbf1f926700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf18064ec0 con 0x7fbf181426d0 2020-04-22T14:03:41.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.518+0000 7fbf1f926700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf18146870 con 0x7fbf180ac740 2020-04-22T14:03:41.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.518+0000 7fbf1f926700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf18065af0 con 0x7fbf18067170 2020-04-22T14:03:41.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.518+0000 7fbf1d6c2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbf18067170 0x7fbf180b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:41.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.518+0000 7fbf1cec1700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fbf180ac740 0x7fbf1813c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40914/0 (socket says 172.21.15.103:40914) 2020-04-22T14:03:41.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.518+0000 7fbf1cec1700 1 -- 172.21.15.103:0/516376895 learned_addr learned my addr 172.21.15.103:0/516376895 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:41.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.518+0000 7fbf1d6c2700 1 -- 172.21.15.103:0/516376895 >> v1:172.21.15.103:6789/0 conn(0x7fbf180ac740 legacy=0x7fbf1813c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:41.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.518+0000 7fbf1d6c2700 1 -- 172.21.15.103:0/516376895 >> v1:172.21.15.86:6789/0 conn(0x7fbf181426d0 legacy=0x7fbf18142b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:41.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.518+0000 7fbf1d6c2700 1 -- 172.21.15.103:0/516376895 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf18067550 con 0x7fbf18067170 2020-04-22T14:03:41.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.518+0000 7fbf1d6c2700 1 --2- 172.21.15.103:0/516376895 >> v2:172.21.15.103:3300/0 conn(0x7fbf18067170 0x7fbf180b6040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbf18066db0 tx=0x7fbf080088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.518+0000 7fbf1d6c2700 1 --2- 172.21.15.103:0/516376895 >> v2:172.21.15.103:3300/0 conn(0x7fbf18067170 0x7fbf180b6040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbf18066db0 tx=0x7fbf080088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.518+0000 7fbf1d6c2700 1 --2- 172.21.15.103:0/516376895 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf18067170 0x7fbf180b6040 secure :-1 s=READY pgs=397 cs=0 l=1 rx=0x7fbf18066db0 tx=0x7fbf080088e0).ready entity=mon.1 client_cookie=698ba15375ec1125 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:41.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.518+0000 7fbf1d6c2700 1 --2- 172.21.15.103:0/516376895 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf18067170 0x7fbf180b6040 secure :-1 s=THROTTLE_DONE pgs=397 cs=0 l=1 rx=0x7fbf18066db0 tx=0x7fbf080088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.518+0000 7fbf07fff700 1 -- 172.21.15.103:0/516376895 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf08008e40 con 0x7fbf18067170 2020-04-22T14:03:41.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.518+0000 7fbf1d6c2700 1 --2- 172.21.15.103:0/516376895 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf18067170 0x7fbf180b6040 secure :-1 s=THROTTLE_DONE pgs=397 cs=0 l=1 rx=0x7fbf18066db0 tx=0x7fbf080088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.518+0000 7fbf1d6c2700 1 --2- 172.21.15.103:0/516376895 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf18067170 0x7fbf180b6040 secure :-1 s=THROTTLE_DONE pgs=397 cs=0 l=1 rx=0x7fbf18066db0 tx=0x7fbf080088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.518+0000 7fbf07fff700 1 -- 172.21.15.103:0/516376895 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf08011620 con 0x7fbf18067170 2020-04-22T14:03:41.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.518+0000 7fbf07fff700 1 -- 172.21.15.103:0/516376895 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf08011a40 con 0x7fbf18067170 2020-04-22T14:03:41.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.518+0000 7fbf1f926700 1 -- 172.21.15.103:0/516376895 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf18067170 msgr2=0x7fbf180b6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:41.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.518+0000 7fbf1f926700 1 --2- 172.21.15.103:0/516376895 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf18067170 0x7fbf180b6040 secure :-1 s=READY pgs=397 cs=0 l=1 rx=0x7fbf18066db0 tx=0x7fbf080088e0).stop 2020-04-22T14:03:41.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.519+0000 7fbf1f926700 1 -- 172.21.15.103:0/516376895 shutdown_connections 2020-04-22T14:03:41.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.519+0000 7fbf1f926700 1 --2- 172.21.15.103:0/516376895 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf18067170 0x7fbf180b6040 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:41.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.519+0000 7fbf1f926700 1 -- 172.21.15.103:0/516376895 >> 172.21.15.103:0/516376895 conn(0x7fbf180b9160 msgr2=0x7fbf1805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:41.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.519+0000 7fbf1f926700 1 -- 172.21.15.103:0/516376895 shutdown_connections 2020-04-22T14:03:41.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.519+0000 7fbf1f926700 1 -- 172.21.15.103:0/516376895 wait complete. 2020-04-22T14:03:41.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.520+0000 7fbf1f926700 1 Processor -- start 2020-04-22T14:03:41.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.520+0000 7fbf1f926700 1 -- start start 2020-04-22T14:03:41.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.520+0000 7fbf1f926700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbf180ac740 0x7fbf1813ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:41.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.520+0000 7fbf1f926700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf1813fec0 con 0x7fbf181426d0 2020-04-22T14:03:41.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.520+0000 7fbf1f926700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf180b1e30 con 0x7fbf18067170 2020-04-22T14:03:41.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.520+0000 7fbf1f926700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf180b20d0 con 0x7fbf180ac740 2020-04-22T14:03:41.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.521+0000 7fbf1d6c2700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fbf18067170 0x7fbf18144b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40920/0 (socket says 172.21.15.103:40920) 2020-04-22T14:03:41.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.521+0000 7fbf1cec1700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbf180ac740 0x7fbf1813ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:41.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.521+0000 7fbf1d6c2700 1 -- 172.21.15.103:0/2931187454 learned_addr learned my addr 172.21.15.103:0/2931187454 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:41.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.521+0000 7fbf1cec1700 1 -- 172.21.15.103:0/2931187454 >> v1:172.21.15.103:6789/0 conn(0x7fbf18067170 legacy=0x7fbf18144b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:41.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.521+0000 7fbf1cec1700 1 -- 172.21.15.103:0/2931187454 >> v1:172.21.15.86:6789/0 conn(0x7fbf181426d0 legacy=0x7fbf180b2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:41.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.521+0000 7fbf1cec1700 1 -- 172.21.15.103:0/2931187454 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1813fbb0 con 0x7fbf180ac740 2020-04-22T14:03:41.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.521+0000 7fbf1cec1700 1 --2- 172.21.15.103:0/2931187454 >> v2:172.21.15.103:3300/0 conn(0x7fbf180ac740 0x7fbf1813ba50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbf181418a0 tx=0x7fbf14010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.521+0000 7fbf1cec1700 1 --2- 172.21.15.103:0/2931187454 >> v2:172.21.15.103:3300/0 conn(0x7fbf180ac740 0x7fbf1813ba50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbf181418a0 tx=0x7fbf14010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.521+0000 7fbf1cec1700 1 --2- 172.21.15.103:0/2931187454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf180ac740 0x7fbf1813ba50 secure :-1 s=READY pgs=399 cs=0 l=1 rx=0x7fbf181418a0 tx=0x7fbf14010900).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:41.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.521+0000 7fbf1cec1700 1 --2- 172.21.15.103:0/2931187454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf180ac740 0x7fbf1813ba50 secure :-1 s=THROTTLE_DONE pgs=399 cs=0 l=1 rx=0x7fbf181418a0 tx=0x7fbf14010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.521+0000 7fbf067fc700 1 -- 172.21.15.103:0/2931187454 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf14005d90 con 0x7fbf180ac740 2020-04-22T14:03:41.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.521+0000 7fbf1cec1700 1 --2- 172.21.15.103:0/2931187454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf180ac740 0x7fbf1813ba50 secure :-1 s=THROTTLE_DONE pgs=399 cs=0 l=1 rx=0x7fbf181418a0 tx=0x7fbf14010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.521+0000 7fbf1cec1700 1 --2- 172.21.15.103:0/2931187454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf180ac740 0x7fbf1813ba50 secure :-1 s=THROTTLE_DONE pgs=399 cs=0 l=1 rx=0x7fbf181418a0 tx=0x7fbf14010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.521+0000 7fbf067fc700 1 -- 172.21.15.103:0/2931187454 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf140060d0 con 0x7fbf180ac740 2020-04-22T14:03:41.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.521+0000 7fbf067fc700 1 -- 172.21.15.103:0/2931187454 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf14006470 con 0x7fbf180ac740 2020-04-22T14:03:41.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.521+0000 7fbf1f926700 1 -- 172.21.15.103:0/2931187454 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf18145220 con 0x7fbf180ac740 2020-04-22T14:03:41.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.521+0000 7fbf1f926700 1 -- 172.21.15.103:0/2931187454 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf1813f950 con 0x7fbf180ac740 2020-04-22T14:03:41.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.522+0000 7fbf1cec1700 1 --2- 172.21.15.103:0/2931187454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf180ac740 0x7fbf1813ba50 secure :-1 s=THROTTLE_DONE pgs=399 cs=0 l=1 rx=0x7fbf181418a0 tx=0x7fbf14010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.522+0000 7fbf067fc700 1 -- 172.21.15.103:0/2931187454 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fbf140066e0 con 0x7fbf180ac740 2020-04-22T14:03:41.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.522+0000 7fbf1cec1700 1 --2- 172.21.15.103:0/2931187454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf180ac740 0x7fbf1813ba50 secure :-1 s=THROTTLE_DONE pgs=399 cs=0 l=1 rx=0x7fbf181418a0 tx=0x7fbf14010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.522+0000 7fbf1f926700 1 -- 172.21.15.103:0/2931187454 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf18056c90 con 0x7fbf180ac740 2020-04-22T14:03:41.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.522+0000 7fbf067fc700 1 --2- 172.21.15.103:0/2931187454 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbef804d960 0x7fbef804fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:41.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.522+0000 7fbf067fc700 1 -- 172.21.15.103:0/2931187454 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbf140090c0 con 0x7fbf180ac740 2020-04-22T14:03:41.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.523+0000 7fbf1d6c2700 1 --2- 172.21.15.103:0/2931187454 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbef804d960 0x7fbef804fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:41.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.523+0000 7fbf1d6c2700 1 --2- 172.21.15.103:0/2931187454 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbef804d960 0x7fbef804fe20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbf08008320 tx=0x7fbf180676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.523+0000 7fbf1d6c2700 1 --2- 172.21.15.103:0/2931187454 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbef804d960 0x7fbef804fe20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbf08008320 tx=0x7fbf180676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.523+0000 7fbf1d6c2700 1 --2- 172.21.15.103:0/2931187454 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbef804d960 0x7fbef804fe20 secure :-1 s=READY pgs=164 cs=0 l=1 rx=0x7fbf08008320 tx=0x7fbf180676e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:41.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.526+0000 7fbf1cec1700 1 --2- 172.21.15.103:0/2931187454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf180ac740 0x7fbf1813ba50 secure :-1 s=THROTTLE_DONE pgs=399 cs=0 l=1 rx=0x7fbf181418a0 tx=0x7fbf14010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.526+0000 7fbf067fc700 1 -- 172.21.15.103:0/2931187454 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fbf1403c810 con 0x7fbf180ac740 2020-04-22T14:03:41.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.668+0000 7fbf1f926700 1 -- 172.21.15.103:0/2931187454 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf180b62b0 con 0x7fbf180ac740 2020-04-22T14:03:41.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.669+0000 7fbf1cec1700 1 --2- 172.21.15.103:0/2931187454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf180ac740 0x7fbf1813ba50 secure :-1 s=THROTTLE_DONE pgs=399 cs=0 l=1 rx=0x7fbf181418a0 tx=0x7fbf14010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.669+0000 7fbf067fc700 1 -- 172.21.15.103:0/2931187454 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16089 (secure 0 0 0) 0x7fbf1403fe30 con 0x7fbf180ac740 2020-04-22T14:03:41.673 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:03:41.673 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":35,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:03:40.946120+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:03:37.161048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2020-04-22T14:03:37.878823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:03:41.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.670+0000 7fbf1f926700 1 -- 172.21.15.103:0/2931187454 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbef804d960 msgr2=0x7fbef804fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:41.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.670+0000 7fbf1f926700 1 --2- 172.21.15.103:0/2931187454 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbef804d960 0x7fbef804fe20 secure :-1 s=READY pgs=164 cs=0 l=1 rx=0x7fbf08008320 tx=0x7fbf180676e0).stop 2020-04-22T14:03:41.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.670+0000 7fbf1f926700 1 -- 172.21.15.103:0/2931187454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf180ac740 msgr2=0x7fbf1813ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:41.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.670+0000 7fbf1f926700 1 --2- 172.21.15.103:0/2931187454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf180ac740 0x7fbf1813ba50 secure :-1 s=READY pgs=399 cs=0 l=1 rx=0x7fbf181418a0 tx=0x7fbf14010900).stop 2020-04-22T14:03:41.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.671+0000 7fbf1f926700 1 -- 172.21.15.103:0/2931187454 shutdown_connections 2020-04-22T14:03:41.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.671+0000 7fbf1f926700 1 --2- 172.21.15.103:0/2931187454 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbef804d960 0x7fbef804fe20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:41.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.671+0000 7fbf1f926700 1 --2- 172.21.15.103:0/2931187454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf180ac740 0x7fbf1813ba50 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:41.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.671+0000 7fbf1f926700 1 -- 172.21.15.103:0/2931187454 >> 172.21.15.103:0/2931187454 conn(0x7fbf180b9160 msgr2=0x7fbf180b7770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:41.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.671+0000 7fbf1f926700 1 -- 172.21.15.103:0/2931187454 shutdown_connections 2020-04-22T14:03:41.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.671+0000 7fbf1f926700 1 -- 172.21.15.103:0/2931187454 wait complete. 2020-04-22T14:03:41.685 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:41.699 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:03:41.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.848+0000 7fd0c7328700 1 Processor -- start 2020-04-22T14:03:41.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.849+0000 7fd0c7328700 1 -- start start 2020-04-22T14:03:41.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.849+0000 7fd0c7328700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd0c0062170 0x7fd0c00b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:41.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.849+0000 7fd0c7328700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd0c00b5210 0x7fd0c00adf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:41.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.849+0000 7fd0c7328700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0c00b5650 con 0x7fd0c0152a90 2020-04-22T14:03:41.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.849+0000 7fd0c7328700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0c00614f0 con 0x7fd0c0062170 2020-04-22T14:03:41.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.849+0000 7fd0c7328700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0c0061790 con 0x7fd0c00b5210 2020-04-22T14:03:41.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.849+0000 7fd0c60c6700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd0c00b5210 0x7fd0c00adf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:41.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.849+0000 7fd0c60c6700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd0c00b5210 0x7fd0c00adf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48738/0 (socket says 172.21.15.103:48738) 2020-04-22T14:03:41.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.849+0000 7fd0c60c6700 1 -- 172.21.15.103:0/3551674299 learned_addr learned my addr 172.21.15.103:0/3551674299 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:41.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.850+0000 7fd0c50c4700 1 --2- 172.21.15.103:0/3551674299 >> v2:172.21.15.86:3300/0 conn(0x7fd0c0062170 0x7fd0c00b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:41.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.850+0000 7fd0c60c6700 1 -- 172.21.15.103:0/3551674299 >> v2:172.21.15.86:3300/0 conn(0x7fd0c0062170 msgr2=0x7fd0c00b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:41.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.850+0000 7fd0c60c6700 1 --2- 172.21.15.103:0/3551674299 >> v2:172.21.15.86:3300/0 conn(0x7fd0c0062170 0x7fd0c00b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:41.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.850+0000 7fd0c60c6700 1 -- 172.21.15.103:0/3551674299 >> v1:172.21.15.86:6789/0 conn(0x7fd0c0152a90 legacy=0x7fd0c00b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:41.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.850+0000 7fd0c60c6700 1 -- 172.21.15.103:0/3551674299 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c0061a30 con 0x7fd0c00b5210 2020-04-22T14:03:41.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.850+0000 7fd0c50c4700 1 --2- 172.21.15.103:0/3551674299 >> v2:172.21.15.86:3300/0 conn(0x7fd0c0062170 0x7fd0c00b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:03:41.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.850+0000 7fd0c60c6700 1 --2- 172.21.15.103:0/3551674299 >> v2:172.21.15.103:3300/0 conn(0x7fd0c00b5210 0x7fd0c00adf50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd0b80032b0 tx=0x7fd0b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.850+0000 7fd0c60c6700 1 --2- 172.21.15.103:0/3551674299 >> v2:172.21.15.103:3300/0 conn(0x7fd0c00b5210 0x7fd0c00adf50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd0b80032b0 tx=0x7fd0b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.850+0000 7fd0c60c6700 1 --2- 172.21.15.103:0/3551674299 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0c00b5210 0x7fd0c00adf50 secure :-1 s=READY pgs=400 cs=0 l=1 rx=0x7fd0b80032b0 tx=0x7fd0b8007dc0).ready entity=mon.1 client_cookie=6f3c418cfcf7d41a server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:41.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.850+0000 7fd0c60c6700 1 --2- 172.21.15.103:0/3551674299 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0c00b5210 0x7fd0c00adf50 secure :-1 s=THROTTLE_DONE pgs=400 cs=0 l=1 rx=0x7fd0b80032b0 tx=0x7fd0b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.850+0000 7fd0c48c3700 1 -- 172.21.15.103:0/3551674299 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0b800a180 con 0x7fd0c00b5210 2020-04-22T14:03:41.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.850+0000 7fd0c60c6700 1 --2- 172.21.15.103:0/3551674299 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0c00b5210 0x7fd0c00adf50 secure :-1 s=THROTTLE_DONE pgs=400 cs=0 l=1 rx=0x7fd0b80032b0 tx=0x7fd0b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.850+0000 7fd0c60c6700 1 --2- 172.21.15.103:0/3551674299 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0c00b5210 0x7fd0c00adf50 secure :-1 s=THROTTLE_DONE pgs=400 cs=0 l=1 rx=0x7fd0b80032b0 tx=0x7fd0b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.850+0000 7fd0c48c3700 1 -- 172.21.15.103:0/3551674299 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b800a2e0 con 0x7fd0c00b5210 2020-04-22T14:03:41.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.850+0000 7fd0c48c3700 1 -- 172.21.15.103:0/3551674299 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0b800a700 con 0x7fd0c00b5210 2020-04-22T14:03:41.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.850+0000 7fd0c7328700 1 -- 172.21.15.103:0/3551674299 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0c00b5210 msgr2=0x7fd0c00adf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:41.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.850+0000 7fd0c7328700 1 --2- 172.21.15.103:0/3551674299 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0c00b5210 0x7fd0c00adf50 secure :-1 s=READY pgs=400 cs=0 l=1 rx=0x7fd0b80032b0 tx=0x7fd0b8007dc0).stop 2020-04-22T14:03:41.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.850+0000 7fd0c7328700 1 -- 172.21.15.103:0/3551674299 shutdown_connections 2020-04-22T14:03:41.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.850+0000 7fd0c7328700 1 --2- 172.21.15.103:0/3551674299 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0c00b5210 0x7fd0c00adf50 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:41.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.850+0000 7fd0c7328700 1 --2- 172.21.15.103:0/3551674299 >> v2:172.21.15.86:3300/0 conn(0x7fd0c0062170 0x7fd0c00b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:41.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.850+0000 7fd0c7328700 1 -- 172.21.15.103:0/3551674299 >> 172.21.15.103:0/3551674299 conn(0x7fd0c005ad30 msgr2=0x7fd0c005b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:41.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.851+0000 7fd0c7328700 1 -- 172.21.15.103:0/3551674299 shutdown_connections 2020-04-22T14:03:41.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.851+0000 7fd0c7328700 1 -- 172.21.15.103:0/3551674299 wait complete. 2020-04-22T14:03:41.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.852+0000 7fd0c7328700 1 Processor -- start 2020-04-22T14:03:41.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.852+0000 7fd0c7328700 1 -- start start 2020-04-22T14:03:41.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.852+0000 7fd0c7328700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd0c00b5210 0x7fd0c013a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:41.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.852+0000 7fd0c7328700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd0c0152a90 0x7fd0c013ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:41.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.852+0000 7fd0c7328700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0c0122ca0 con 0x7fd0c0062170 2020-04-22T14:03:41.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.852+0000 7fd0c7328700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0c0122f40 con 0x7fd0c0152a90 2020-04-22T14:03:41.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.852+0000 7fd0c7328700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c01231e0 con 0x7fd0c00b5210 2020-04-22T14:03:41.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.852+0000 7fd0c58c5700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd0c0062170 0x7fd0c00b0080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40934/0 (socket says 172.21.15.103:40934) 2020-04-22T14:03:41.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.852+0000 7fd0c58c5700 1 -- 172.21.15.103:0/3781499262 learned_addr learned my addr 172.21.15.103:0/3781499262 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:41.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.853+0000 7fd0c50c4700 1 --2- 172.21.15.103:0/3781499262 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd0c00b5210 0x7fd0c013a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:41.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.853+0000 7fd0c60c6700 1 --2- 172.21.15.103:0/3781499262 >> v2:172.21.15.86:3300/0 conn(0x7fd0c0152a90 0x7fd0c013ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:41.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.853+0000 7fd0b67fc700 1 -- 172.21.15.103:0/3781499262 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2200822817 0 0) 0x7fd0c0122ca0 con 0x7fd0c0062170 2020-04-22T14:03:41.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.853+0000 7fd0b67fc700 1 -- 172.21.15.103:0/3781499262 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0a8003230 con 0x7fd0c0062170 2020-04-22T14:03:41.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.853+0000 7fd0b67fc700 1 -- 172.21.15.103:0/3781499262 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1944489593 0 0) 0x7fd0a8003230 con 0x7fd0c0062170 2020-04-22T14:03:41.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.853+0000 7fd0b67fc700 1 -- 172.21.15.103:0/3781499262 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd0c0122ca0 con 0x7fd0c0062170 2020-04-22T14:03:41.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.853+0000 7fd0b67fc700 1 -- 172.21.15.103:0/3781499262 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fd0bc001930 con 0x7fd0c0062170 2020-04-22T14:03:41.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.853+0000 7fd0c50c4700 1 -- 172.21.15.103:0/3781499262 >> v2:172.21.15.86:3300/0 conn(0x7fd0c0152a90 msgr2=0x7fd0c013ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:41.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.853+0000 7fd0c50c4700 1 --2- 172.21.15.103:0/3781499262 >> v2:172.21.15.86:3300/0 conn(0x7fd0c0152a90 0x7fd0c013ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:41.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.853+0000 7fd0c50c4700 1 -- 172.21.15.103:0/3781499262 >> v1:172.21.15.103:6789/0 conn(0x7fd0c0062170 legacy=0x7fd0c00b0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:41.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.853+0000 7fd0c50c4700 1 -- 172.21.15.103:0/3781499262 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c013f160 con 0x7fd0c00b5210 2020-04-22T14:03:41.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.853+0000 7fd0c50c4700 1 --2- 172.21.15.103:0/3781499262 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd0c00b5210 0x7fd0c013a7e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd0b0002f30 tx=0x7fd0c005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.853+0000 7fd0c50c4700 1 --2- 172.21.15.103:0/3781499262 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd0c00b5210 0x7fd0c013a7e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd0b0002f30 tx=0x7fd0c005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.853+0000 7fd0c50c4700 1 --2- 172.21.15.103:0/3781499262 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd0c00b5210 0x7fd0c013a7e0 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7fd0b0002f30 tx=0x7fd0c005a720).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:41.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.853+0000 7fd0c50c4700 1 --2- 172.21.15.103:0/3781499262 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd0c00b5210 0x7fd0c013a7e0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7fd0b0002f30 tx=0x7fd0c005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.853+0000 7fd0b67fc700 1 -- 172.21.15.103:0/3781499262 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0b000f0c0 con 0x7fd0c00b5210 2020-04-22T14:03:41.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.853+0000 7fd0c50c4700 1 --2- 172.21.15.103:0/3781499262 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd0c00b5210 0x7fd0c013a7e0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7fd0b0002f30 tx=0x7fd0c005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.853+0000 7fd0c50c4700 1 --2- 172.21.15.103:0/3781499262 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd0c00b5210 0x7fd0c013a7e0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7fd0b0002f30 tx=0x7fd0c005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.853+0000 7fd0b67fc700 1 -- 172.21.15.103:0/3781499262 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b0007560 con 0x7fd0c00b5210 2020-04-22T14:03:41.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.853+0000 7fd0c7328700 1 -- 172.21.15.103:0/3781499262 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0c00b0790 con 0x7fd0c00b5210 2020-04-22T14:03:41.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.853+0000 7fd0b67fc700 1 -- 172.21.15.103:0/3781499262 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0b00059a0 con 0x7fd0c00b5210 2020-04-22T14:03:41.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.853+0000 7fd0c7328700 1 -- 172.21.15.103:0/3781499262 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0c01227c0 con 0x7fd0c00b5210 2020-04-22T14:03:41.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.854+0000 7fd0c50c4700 1 --2- 172.21.15.103:0/3781499262 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd0c00b5210 0x7fd0c013a7e0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7fd0b0002f30 tx=0x7fd0c005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.854+0000 7fd0b67fc700 1 -- 172.21.15.103:0/3781499262 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fd0b0005be0 con 0x7fd0c00b5210 2020-04-22T14:03:41.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.854+0000 7fd0c50c4700 1 --2- 172.21.15.103:0/3781499262 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd0c00b5210 0x7fd0c013a7e0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7fd0b0002f30 tx=0x7fd0c005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.854+0000 7fd0c7328700 1 -- 172.21.15.103:0/3781499262 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0c0056c90 con 0x7fd0c00b5210 2020-04-22T14:03:41.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.855+0000 7fd0b67fc700 1 --2- 172.21.15.103:0/3781499262 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd0a804dfd0 0x7fd0a8050490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:41.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.855+0000 7fd0b67fc700 1 -- 172.21.15.103:0/3781499262 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd0b0060c00 con 0x7fd0c00b5210 2020-04-22T14:03:41.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.855+0000 7fd0c58c5700 1 --2- 172.21.15.103:0/3781499262 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd0a804dfd0 0x7fd0a8050490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:41.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.855+0000 7fd0c58c5700 1 --2- 172.21.15.103:0/3781499262 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd0a804dfd0 0x7fd0a8050490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd0bc001640 tx=0x7fd0bc009d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.855+0000 7fd0c58c5700 1 --2- 172.21.15.103:0/3781499262 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd0a804dfd0 0x7fd0a8050490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd0bc001640 tx=0x7fd0bc009d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.855+0000 7fd0c58c5700 1 --2- 172.21.15.103:0/3781499262 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd0a804dfd0 0x7fd0a8050490 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7fd0bc001640 tx=0x7fd0bc009d10).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:41.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.858+0000 7fd0c50c4700 1 --2- 172.21.15.103:0/3781499262 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd0c00b5210 0x7fd0c013a7e0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7fd0b0002f30 tx=0x7fd0c005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:41.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:41.858+0000 7fd0b67fc700 1 -- 172.21.15.103:0/3781499262 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fd0b003bfe0 con 0x7fd0c00b5210 2020-04-22T14:03:42.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.054+0000 7fd0c7328700 1 -- 172.21.15.103:0/3781499262 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fd0c0062f60 con 0x7fd0c00b5210 2020-04-22T14:03:42.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.059+0000 7fd0c50c4700 1 --2- 172.21.15.103:0/3781499262 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd0c00b5210 0x7fd0c013a7e0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7fd0b0002f30 tx=0x7fd0c005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:42.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.059+0000 7fd0b67fc700 1 -- 172.21.15.103:0/3781499262 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v13) v1 ==== 184+0+0 (secure 0 0 0) 0x7fd0b003f600 con 0x7fd0c00b5210 2020-04-22T14:03:42.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.060+0000 7fd0c7328700 1 -- 172.21.15.103:0/3781499262 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd0a804dfd0 msgr2=0x7fd0a8050490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:42.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.060+0000 7fd0c7328700 1 --2- 172.21.15.103:0/3781499262 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd0a804dfd0 0x7fd0a8050490 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7fd0bc001640 tx=0x7fd0bc009d10).stop 2020-04-22T14:03:42.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.060+0000 7fd0c7328700 1 -- 172.21.15.103:0/3781499262 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd0c00b5210 msgr2=0x7fd0c013a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:42.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.060+0000 7fd0c7328700 1 --2- 172.21.15.103:0/3781499262 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd0c00b5210 0x7fd0c013a7e0 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7fd0b0002f30 tx=0x7fd0c005a720).stop 2020-04-22T14:03:42.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.060+0000 7fd0c7328700 1 -- 172.21.15.103:0/3781499262 shutdown_connections 2020-04-22T14:03:42.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.060+0000 7fd0c7328700 1 --2- 172.21.15.103:0/3781499262 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd0a804dfd0 0x7fd0a8050490 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:42.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.060+0000 7fd0c7328700 1 --2- 172.21.15.103:0/3781499262 >> v2:172.21.15.86:3300/0 conn(0x7fd0c0152a90 0x7fd0c013ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:42.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.060+0000 7fd0c7328700 1 --2- 172.21.15.103:0/3781499262 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd0c00b5210 0x7fd0c013a7e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:42.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.060+0000 7fd0c7328700 1 -- 172.21.15.103:0/3781499262 >> 172.21.15.103:0/3781499262 conn(0x7fd0c005ad30 msgr2=0x7fd0c0130310 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:42.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.060+0000 7fd0c7328700 1 -- 172.21.15.103:0/3781499262 shutdown_connections 2020-04-22T14:03:42.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.060+0000 7fd0c7328700 1 -- 172.21.15.103:0/3781499262 wait complete. 2020-04-22T14:03:42.065 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.0 2020-04-22T14:03:42.081 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:42.095 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:03:42.249 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.244+0000 7f2df0ddd700 1 Processor -- start 2020-04-22T14:03:42.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.244+0000 7f2df0ddd700 1 -- start start 2020-04-22T14:03:42.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.244+0000 7f2df0ddd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2dec0b6600 0x7f2dec0b6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:42.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.245+0000 7f2df0ddd700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dec025b90 con 0x7f2dec0666e0 2020-04-22T14:03:42.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.245+0000 7f2df0ddd700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dec066ac0 con 0x7f2dec0633c0 2020-04-22T14:03:42.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.245+0000 7f2df0ddd700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dec024ea0 con 0x7f2dec0b6600 2020-04-22T14:03:42.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.245+0000 7f2df203f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2dec0b6600 0x7f2dec0b6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:42.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.245+0000 7f2de3fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f2dec0633c0 0x7f2dec0b5ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40942/0 (socket says 172.21.15.103:40942) 2020-04-22T14:03:42.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.245+0000 7f2de3fff700 1 -- 172.21.15.103:0/3010654040 learned_addr learned my addr 172.21.15.103:0/3010654040 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:42.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.245+0000 7f2df203f700 1 -- 172.21.15.103:0/3010654040 >> v1:172.21.15.103:6789/0 conn(0x7f2dec0633c0 legacy=0x7f2dec0b5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:42.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.245+0000 7f2df203f700 1 -- 172.21.15.103:0/3010654040 >> v1:172.21.15.86:6789/0 conn(0x7f2dec0666e0 legacy=0x7f2dec0b9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:42.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.245+0000 7f2deb7fe700 1 -- 172.21.15.103:0/3010654040 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3000216328 0 0) 0x7f2dec066ac0 con 0x7f2dec0633c0 2020-04-22T14:03:42.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.245+0000 7f2df203f700 1 -- 172.21.15.103:0/3010654040 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dec155ff0 con 0x7f2dec0b6600 2020-04-22T14:03:42.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.245+0000 7f2df203f700 1 --2- 172.21.15.103:0/3010654040 >> v2:172.21.15.103:3300/0 conn(0x7f2dec0b6600 0x7f2dec0b6a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2de40032b0 tx=0x7f2de4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:42.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.245+0000 7f2df203f700 1 --2- 172.21.15.103:0/3010654040 >> v2:172.21.15.103:3300/0 conn(0x7f2dec0b6600 0x7f2dec0b6a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2de40032b0 tx=0x7f2de4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:42.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.245+0000 7f2df203f700 1 --2- 172.21.15.103:0/3010654040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2dec0b6600 0x7f2dec0b6a20 secure :-1 s=READY pgs=403 cs=0 l=1 rx=0x7f2de40032b0 tx=0x7f2de4007dc0).ready entity=mon.1 client_cookie=ed4a8cffbdb745e4 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:42.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.245+0000 7f2df203f700 1 --2- 172.21.15.103:0/3010654040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2dec0b6600 0x7f2dec0b6a20 secure :-1 s=THROTTLE_DONE pgs=403 cs=0 l=1 rx=0x7f2de40032b0 tx=0x7f2de4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:42.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.245+0000 7f2deb7fe700 1 -- 172.21.15.103:0/3010654040 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2de400a180 con 0x7f2dec0b6600 2020-04-22T14:03:42.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.245+0000 7f2df203f700 1 --2- 172.21.15.103:0/3010654040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2dec0b6600 0x7f2dec0b6a20 secure :-1 s=THROTTLE_DONE pgs=403 cs=0 l=1 rx=0x7f2de40032b0 tx=0x7f2de4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:42.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.245+0000 7f2df203f700 1 --2- 172.21.15.103:0/3010654040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2dec0b6600 0x7f2dec0b6a20 secure :-1 s=THROTTLE_DONE pgs=403 cs=0 l=1 rx=0x7f2de40032b0 tx=0x7f2de4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:42.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.245+0000 7f2deb7fe700 1 -- 172.21.15.103:0/3010654040 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de400a2e0 con 0x7f2dec0b6600 2020-04-22T14:03:42.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.245+0000 7f2deb7fe700 1 -- 172.21.15.103:0/3010654040 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2de400a700 con 0x7f2dec0b6600 2020-04-22T14:03:42.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.245+0000 7f2df0ddd700 1 -- 172.21.15.103:0/3010654040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2dec0b6600 msgr2=0x7f2dec0b6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:42.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.245+0000 7f2df0ddd700 1 --2- 172.21.15.103:0/3010654040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2dec0b6600 0x7f2dec0b6a20 secure :-1 s=READY pgs=403 cs=0 l=1 rx=0x7f2de40032b0 tx=0x7f2de4007dc0).stop 2020-04-22T14:03:42.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.246+0000 7f2df0ddd700 1 -- 172.21.15.103:0/3010654040 shutdown_connections 2020-04-22T14:03:42.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.246+0000 7f2df0ddd700 1 --2- 172.21.15.103:0/3010654040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2dec0b6600 0x7f2dec0b6a20 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:42.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.246+0000 7f2df0ddd700 1 -- 172.21.15.103:0/3010654040 >> 172.21.15.103:0/3010654040 conn(0x7f2dec060930 msgr2=0x7f2dec060d40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:42.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.246+0000 7f2df0ddd700 1 -- 172.21.15.103:0/3010654040 shutdown_connections 2020-04-22T14:03:42.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.246+0000 7f2df0ddd700 1 -- 172.21.15.103:0/3010654040 wait complete. 2020-04-22T14:03:42.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.247+0000 7f2df0ddd700 1 Processor -- start 2020-04-22T14:03:42.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.247+0000 7f2df0ddd700 1 -- start start 2020-04-22T14:03:42.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.248+0000 7f2df0ddd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2dec0633c0 0x7f2dec0b3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:42.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.248+0000 7f2df0ddd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2dec0b6600 0x7f2dec0acd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:42.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.248+0000 7f2df0ddd700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dec0ad330 con 0x7f2dec0666e0 2020-04-22T14:03:42.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.248+0000 7f2df0ddd700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dec0ad5d0 con 0x7f2dec0633c0 2020-04-22T14:03:42.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.248+0000 7f2df0ddd700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dec0ad870 con 0x7f2dec0b6600 2020-04-22T14:03:42.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.248+0000 7f2df203f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2dec0b6600 0x7f2dec0acd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:42.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.248+0000 7f2df203f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2dec0b6600 0x7f2dec0acd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48760/0 (socket says 172.21.15.103:48760) 2020-04-22T14:03:42.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.248+0000 7f2df203f700 1 -- 172.21.15.103:0/860642317 learned_addr learned my addr 172.21.15.103:0/860642317 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:42.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.248+0000 7f2debfff700 1 --2- 172.21.15.103:0/860642317 >> v2:172.21.15.86:3300/0 conn(0x7f2dec0633c0 0x7f2dec0b3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:42.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.248+0000 7f2df203f700 1 -- 172.21.15.103:0/860642317 >> v2:172.21.15.86:3300/0 conn(0x7f2dec0633c0 msgr2=0x7f2dec0b3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:42.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.248+0000 7f2df203f700 1 --2- 172.21.15.103:0/860642317 >> v2:172.21.15.86:3300/0 conn(0x7f2dec0633c0 0x7f2dec0b3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:42.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.248+0000 7f2df203f700 1 -- 172.21.15.103:0/860642317 >> v1:172.21.15.86:6789/0 conn(0x7f2dec0666e0 legacy=0x7f2dec11bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:42.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.248+0000 7f2df203f700 1 -- 172.21.15.103:0/860642317 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dec0aeed0 con 0x7f2dec0b6600 2020-04-22T14:03:42.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.248+0000 7f2debfff700 1 --2- 172.21.15.103:0/860642317 >> v2:172.21.15.86:3300/0 conn(0x7f2dec0633c0 0x7f2dec0b3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:03:42.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.248+0000 7f2df203f700 1 --2- 172.21.15.103:0/860642317 >> v2:172.21.15.103:3300/0 conn(0x7f2dec0b6600 0x7f2dec0acd00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2dec0ae280 tx=0x7f2de4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:42.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.248+0000 7f2df203f700 1 --2- 172.21.15.103:0/860642317 >> v2:172.21.15.103:3300/0 conn(0x7f2dec0b6600 0x7f2dec0acd00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2dec0ae280 tx=0x7f2de4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:42.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.248+0000 7f2df203f700 1 --2- 172.21.15.103:0/860642317 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2dec0b6600 0x7f2dec0acd00 secure :-1 s=READY pgs=404 cs=0 l=1 rx=0x7f2dec0ae280 tx=0x7f2de4007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:42.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.248+0000 7f2df203f700 1 --2- 172.21.15.103:0/860642317 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2dec0b6600 0x7f2dec0acd00 secure :-1 s=THROTTLE_DONE pgs=404 cs=0 l=1 rx=0x7f2dec0ae280 tx=0x7f2de4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:42.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.248+0000 7f2df203f700 1 --2- 172.21.15.103:0/860642317 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2dec0b6600 0x7f2dec0acd00 secure :-1 s=THROTTLE_DONE pgs=404 cs=0 l=1 rx=0x7f2dec0ae280 tx=0x7f2de4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:42.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.248+0000 7f2de97fa700 1 -- 172.21.15.103:0/860642317 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2de40115c0 con 0x7f2dec0b6600 2020-04-22T14:03:42.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.248+0000 7f2df203f700 1 --2- 172.21.15.103:0/860642317 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2dec0b6600 0x7f2dec0acd00 secure :-1 s=THROTTLE_DONE pgs=404 cs=0 l=1 rx=0x7f2dec0ae280 tx=0x7f2de4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:42.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.248+0000 7f2de97fa700 1 -- 172.21.15.103:0/860642317 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de4005a40 con 0x7f2dec0b6600 2020-04-22T14:03:42.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.248+0000 7f2df0ddd700 1 -- 172.21.15.103:0/860642317 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dec0af120 con 0x7f2dec0b6600 2020-04-22T14:03:42.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.248+0000 7f2de97fa700 1 -- 172.21.15.103:0/860642317 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2de4005de0 con 0x7f2dec0b6600 2020-04-22T14:03:42.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.248+0000 7f2df0ddd700 1 -- 172.21.15.103:0/860642317 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dec0b2d20 con 0x7f2dec0b6600 2020-04-22T14:03:42.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.249+0000 7f2df203f700 1 --2- 172.21.15.103:0/860642317 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2dec0b6600 0x7f2dec0acd00 secure :-1 s=THROTTLE_DONE pgs=404 cs=0 l=1 rx=0x7f2dec0ae280 tx=0x7f2de4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:42.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.249+0000 7f2df0ddd700 1 -- 172.21.15.103:0/860642317 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dec0ad160 con 0x7f2dec0b6600 2020-04-22T14:03:42.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.249+0000 7f2de97fa700 1 -- 172.21.15.103:0/860642317 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f2de4010680 con 0x7f2dec0b6600 2020-04-22T14:03:42.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.249+0000 7f2df203f700 1 --2- 172.21.15.103:0/860642317 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2dec0b6600 0x7f2dec0acd00 secure :-1 s=THROTTLE_DONE pgs=404 cs=0 l=1 rx=0x7f2dec0ae280 tx=0x7f2de4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:42.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.250+0000 7f2de97fa700 1 --2- 172.21.15.103:0/860642317 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2dd004d9d0 0x7f2dd004fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:42.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.250+0000 7f2de97fa700 1 -- 172.21.15.103:0/860642317 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2de40620b0 con 0x7f2dec0b6600 2020-04-22T14:03:42.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.250+0000 7f2debfff700 1 --2- 172.21.15.103:0/860642317 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2dd004d9d0 0x7f2dd004fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:42.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.250+0000 7f2debfff700 1 --2- 172.21.15.103:0/860642317 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2dd004d9d0 0x7f2dd004fe90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2dec0ba430 tx=0x7f2ddc001640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:42.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.250+0000 7f2debfff700 1 --2- 172.21.15.103:0/860642317 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2dd004d9d0 0x7f2dd004fe90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2dec0ba430 tx=0x7f2ddc001640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:42.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.250+0000 7f2debfff700 1 --2- 172.21.15.103:0/860642317 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2dd004d9d0 0x7f2dd004fe90 secure :-1 s=READY pgs=166 cs=0 l=1 rx=0x7f2dec0ba430 tx=0x7f2ddc001640).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:42.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.254+0000 7f2df203f700 1 --2- 172.21.15.103:0/860642317 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2dec0b6600 0x7f2dec0acd00 secure :-1 s=THROTTLE_DONE pgs=404 cs=0 l=1 rx=0x7f2dec0ae280 tx=0x7f2de4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:42.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.254+0000 7f2de97fa700 1 -- 172.21.15.103:0/860642317 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f2de403d5b0 con 0x7f2dec0b6600 2020-04-22T14:03:42.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.446+0000 7f2df0ddd700 1 -- 172.21.15.103:0/860642317 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f2dec056c90 con 0x7f2dec0b6600 2020-04-22T14:03:42.455 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.453+0000 7f2df203f700 1 --2- 172.21.15.103:0/860642317 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2dec0b6600 0x7f2dec0acd00 secure :-1 s=THROTTLE_DONE pgs=404 cs=0 l=1 rx=0x7f2dec0ae280 tx=0x7f2de4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:42.456 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.453+0000 7f2de97fa700 1 -- 172.21.15.103:0/860642317 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v14) v1 ==== 184+0+0 (secure 0 0 0) 0x7f2de4040bd0 con 0x7f2dec0b6600 2020-04-22T14:03:42.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.454+0000 7f2df0ddd700 1 -- 172.21.15.103:0/860642317 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2dd004d9d0 msgr2=0x7f2dd004fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:42.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.454+0000 7f2df0ddd700 1 --2- 172.21.15.103:0/860642317 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2dd004d9d0 0x7f2dd004fe90 secure :-1 s=READY pgs=166 cs=0 l=1 rx=0x7f2dec0ba430 tx=0x7f2ddc001640).stop 2020-04-22T14:03:42.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.454+0000 7f2df0ddd700 1 -- 172.21.15.103:0/860642317 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2dec0b6600 msgr2=0x7f2dec0acd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:42.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.454+0000 7f2df0ddd700 1 --2- 172.21.15.103:0/860642317 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2dec0b6600 0x7f2dec0acd00 secure :-1 s=READY pgs=404 cs=0 l=1 rx=0x7f2dec0ae280 tx=0x7f2de4007dc0).stop 2020-04-22T14:03:42.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.454+0000 7f2df0ddd700 1 -- 172.21.15.103:0/860642317 shutdown_connections 2020-04-22T14:03:42.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.454+0000 7f2df0ddd700 1 --2- 172.21.15.103:0/860642317 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2dec0b6600 0x7f2dec0acd00 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:42.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.454+0000 7f2df0ddd700 1 --2- 172.21.15.103:0/860642317 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2dd004d9d0 0x7f2dd004fe90 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:42.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.454+0000 7f2df0ddd700 1 --2- 172.21.15.103:0/860642317 >> v2:172.21.15.86:3300/0 conn(0x7f2dec0633c0 0x7f2dec0b3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:42.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.454+0000 7f2df0ddd700 1 -- 172.21.15.103:0/860642317 >> 172.21.15.103:0/860642317 conn(0x7f2dec060930 msgr2=0x7f2dec024fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:42.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.454+0000 7f2df0ddd700 1 -- 172.21.15.103:0/860642317 shutdown_connections 2020-04-22T14:03:42.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.454+0000 7f2df0ddd700 1 -- 172.21.15.103:0/860642317 wait complete. 2020-04-22T14:03:42.460 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.1 2020-04-22T14:03:42.467 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:42.490 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:03:42.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.639+0000 7f7d8a284700 1 Processor -- start 2020-04-22T14:03:42.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.639+0000 7f7d8a284700 1 -- start start 2020-04-22T14:03:42.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.640+0000 7f7d8a284700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7d84062170 0x7f7d840b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:42.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.640+0000 7f7d8a284700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7d840b5210 0x7f7d840adf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:42.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.640+0000 7f7d8a284700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d840b5680 con 0x7f7d84152a90 2020-04-22T14:03:42.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.640+0000 7f7d8a284700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d840614f0 con 0x7f7d84062170 2020-04-22T14:03:42.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.640+0000 7f7d8a284700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d84061790 con 0x7f7d840b5210 2020-04-22T14:03:42.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.640+0000 7f7d83fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7d84062170 0x7f7d840b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:42.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.640+0000 7f7d89022700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7d840b5210 0x7f7d840adf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:42.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.640+0000 7f7d89022700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7d840b5210 0x7f7d840adf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:33542/0 (socket says 172.21.15.103:33542) 2020-04-22T14:03:42.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.640+0000 7f7d89022700 1 -- 172.21.15.103:0/1754654894 learned_addr learned my addr 172.21.15.103:0/1754654894 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:42.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.641+0000 7f7d83fff700 1 -- 172.21.15.103:0/1754654894 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7d840b5210 msgr2=0x7f7d840adf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:42.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.641+0000 7f7d83fff700 1 --2- 172.21.15.103:0/1754654894 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7d840b5210 0x7f7d840adf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:42.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.641+0000 7f7d83fff700 1 -- 172.21.15.103:0/1754654894 >> v1:172.21.15.86:6789/0 conn(0x7f7d84152a90 legacy=0x7f7d840b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:42.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.641+0000 7f7d83fff700 1 -- 172.21.15.103:0/1754654894 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d84061a30 con 0x7f7d84062170 2020-04-22T14:03:42.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.641+0000 7f7d89022700 1 --2- 172.21.15.103:0/1754654894 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7d840b5210 0x7f7d840adf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:03:42.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.641+0000 7f7d83fff700 1 --2- 172.21.15.103:0/1754654894 >> v2:172.21.15.86:3300/0 conn(0x7f7d84062170 0x7f7d840b4db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7d78002f30 tx=0x7f7d8405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:42.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.641+0000 7f7d83fff700 1 --2- 172.21.15.103:0/1754654894 >> v2:172.21.15.86:3300/0 conn(0x7f7d84062170 0x7f7d840b4db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7d78002f30 tx=0x7f7d8405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:42.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.641+0000 7f7d83fff700 1 --2- 172.21.15.103:0/1754654894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d84062170 0x7f7d840b4db0 secure :-1 s=READY pgs=245 cs=0 l=1 rx=0x7f7d78002f30 tx=0x7f7d8405a720).ready entity=mon.0 client_cookie=f87644a1d7528dd3 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:42.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.641+0000 7f7d83fff700 1 --2- 172.21.15.103:0/1754654894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d84062170 0x7f7d840b4db0 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7f7d78002f30 tx=0x7f7d8405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:42.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.641+0000 7f7d837fe700 1 -- 172.21.15.103:0/1754654894 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d780113c0 con 0x7f7d84062170 2020-04-22T14:03:42.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.641+0000 7f7d83fff700 1 --2- 172.21.15.103:0/1754654894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d84062170 0x7f7d840b4db0 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7f7d78002f30 tx=0x7f7d8405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:42.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.641+0000 7f7d83fff700 1 --2- 172.21.15.103:0/1754654894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d84062170 0x7f7d840b4db0 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7f7d78002f30 tx=0x7f7d8405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:42.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.641+0000 7f7d837fe700 1 -- 172.21.15.103:0/1754654894 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d78011560 con 0x7f7d84062170 2020-04-22T14:03:42.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.641+0000 7f7d837fe700 1 -- 172.21.15.103:0/1754654894 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d78011980 con 0x7f7d84062170 2020-04-22T14:03:42.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.641+0000 7f7d8a284700 1 -- 172.21.15.103:0/1754654894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d84062170 msgr2=0x7f7d840b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:42.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.641+0000 7f7d8a284700 1 --2- 172.21.15.103:0/1754654894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d84062170 0x7f7d840b4db0 secure :-1 s=READY pgs=245 cs=0 l=1 rx=0x7f7d78002f30 tx=0x7f7d8405a720).stop 2020-04-22T14:03:42.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.641+0000 7f7d8a284700 1 -- 172.21.15.103:0/1754654894 shutdown_connections 2020-04-22T14:03:42.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.641+0000 7f7d8a284700 1 --2- 172.21.15.103:0/1754654894 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7d840b5210 0x7f7d840adf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:42.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.641+0000 7f7d8a284700 1 --2- 172.21.15.103:0/1754654894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d84062170 0x7f7d840b4db0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:42.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.641+0000 7f7d8a284700 1 -- 172.21.15.103:0/1754654894 >> 172.21.15.103:0/1754654894 conn(0x7f7d8405ad30 msgr2=0x7f7d8405b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:42.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.641+0000 7f7d8a284700 1 -- 172.21.15.103:0/1754654894 shutdown_connections 2020-04-22T14:03:42.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.642+0000 7f7d8a284700 1 -- 172.21.15.103:0/1754654894 wait complete. 2020-04-22T14:03:42.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.643+0000 7f7d8a284700 1 Processor -- start 2020-04-22T14:03:42.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.643+0000 7f7d8a284700 1 -- start start 2020-04-22T14:03:42.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.643+0000 7f7d8a284700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7d840b5210 0x7f7d84154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:42.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.643+0000 7f7d8a284700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d841540c0 con 0x7f7d84062170 2020-04-22T14:03:42.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.643+0000 7f7d8a284700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d84154360 con 0x7f7d84152a90 2020-04-22T14:03:42.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.643+0000 7f7d8a284700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d84154600 con 0x7f7d840b5210 2020-04-22T14:03:42.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.644+0000 7f7d83fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7d840b5210 0x7f7d84154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:42.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.644+0000 7f7d89022700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f7d84152a90 0x7f7d840adee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40964/0 (socket says 172.21.15.103:40964) 2020-04-22T14:03:42.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.644+0000 7f7d89022700 1 -- 172.21.15.103:0/3745072472 learned_addr learned my addr 172.21.15.103:0/3745072472 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:42.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.644+0000 7f7d83fff700 1 -- 172.21.15.103:0/3745072472 >> v1:172.21.15.103:6789/0 conn(0x7f7d84152a90 legacy=0x7f7d840adee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:42.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.644+0000 7f7d83fff700 1 -- 172.21.15.103:0/3745072472 >> v1:172.21.15.86:6789/0 conn(0x7f7d84062170 legacy=0x7f7d84063440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:42.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.644+0000 7f7d817fa700 1 -- 172.21.15.103:0/3745072472 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2590992120 0 0) 0x7f7d84154360 con 0x7f7d84152a90 2020-04-22T14:03:42.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.644+0000 7f7d83fff700 1 -- 172.21.15.103:0/3745072472 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d84154f00 con 0x7f7d840b5210 2020-04-22T14:03:42.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.644+0000 7f7d83fff700 1 --2- 172.21.15.103:0/3745072472 >> v2:172.21.15.103:3300/0 conn(0x7f7d840b5210 0x7f7d84154aa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7d78002f30 tx=0x7f7d8405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:42.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.644+0000 7f7d83fff700 1 --2- 172.21.15.103:0/3745072472 >> v2:172.21.15.103:3300/0 conn(0x7f7d840b5210 0x7f7d84154aa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7d78002f30 tx=0x7f7d8405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:42.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.644+0000 7f7d83fff700 1 --2- 172.21.15.103:0/3745072472 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d840b5210 0x7f7d84154aa0 secure :-1 s=READY pgs=406 cs=0 l=1 rx=0x7f7d78002f30 tx=0x7f7d8405a720).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:42.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.644+0000 7f7d83fff700 1 --2- 172.21.15.103:0/3745072472 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d840b5210 0x7f7d84154aa0 secure :-1 s=THROTTLE_DONE pgs=406 cs=0 l=1 rx=0x7f7d78002f30 tx=0x7f7d8405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:42.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.644+0000 7f7d817fa700 1 -- 172.21.15.103:0/3745072472 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d7800f860 con 0x7f7d840b5210 2020-04-22T14:03:42.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.644+0000 7f7d83fff700 1 --2- 172.21.15.103:0/3745072472 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d840b5210 0x7f7d84154aa0 secure :-1 s=THROTTLE_DONE pgs=406 cs=0 l=1 rx=0x7f7d78002f30 tx=0x7f7d8405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:42.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.644+0000 7f7d817fa700 1 -- 172.21.15.103:0/3745072472 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d78011a10 con 0x7f7d840b5210 2020-04-22T14:03:42.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.644+0000 7f7d83fff700 1 --2- 172.21.15.103:0/3745072472 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d840b5210 0x7f7d84154aa0 secure :-1 s=THROTTLE_DONE pgs=406 cs=0 l=1 rx=0x7f7d78002f30 tx=0x7f7d8405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:42.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.644+0000 7f7d8a284700 1 -- 172.21.15.103:0/3745072472 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d84153db0 con 0x7f7d840b5210 2020-04-22T14:03:42.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.644+0000 7f7d817fa700 1 -- 172.21.15.103:0/3745072472 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d78007550 con 0x7f7d840b5210 2020-04-22T14:03:42.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.644+0000 7f7d8a284700 1 -- 172.21.15.103:0/3745072472 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d84066310 con 0x7f7d840b5210 2020-04-22T14:03:42.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.645+0000 7f7d83fff700 1 --2- 172.21.15.103:0/3745072472 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d840b5210 0x7f7d84154aa0 secure :-1 s=THROTTLE_DONE pgs=406 cs=0 l=1 rx=0x7f7d78002f30 tx=0x7f7d8405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:42.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.645+0000 7f7d817fa700 1 -- 172.21.15.103:0/3745072472 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f7d780056c0 con 0x7f7d840b5210 2020-04-22T14:03:42.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.645+0000 7f7d8a284700 1 -- 172.21.15.103:0/3745072472 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d84056c90 con 0x7f7d840b5210 2020-04-22T14:03:42.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.645+0000 7f7d83fff700 1 --2- 172.21.15.103:0/3745072472 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d840b5210 0x7f7d84154aa0 secure :-1 s=THROTTLE_DONE pgs=406 cs=0 l=1 rx=0x7f7d78002f30 tx=0x7f7d8405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:42.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.645+0000 7f7d817fa700 1 --2- 172.21.15.103:0/3745072472 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7d6404d820 0x7f7d6404fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:42.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.646+0000 7f7d817fa700 1 -- 172.21.15.103:0/3745072472 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7d780a5be0 con 0x7f7d840b5210 2020-04-22T14:03:42.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.646+0000 7f7d88821700 1 --2- 172.21.15.103:0/3745072472 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7d6404d820 0x7f7d6404fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:42.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.646+0000 7f7d88821700 1 --2- 172.21.15.103:0/3745072472 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7d6404d820 0x7f7d6404fce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7d840b2790 tx=0x7f7d74002560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:42.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.646+0000 7f7d88821700 1 --2- 172.21.15.103:0/3745072472 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7d6404d820 0x7f7d6404fce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7d840b2790 tx=0x7f7d74002560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:42.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.646+0000 7f7d88821700 1 --2- 172.21.15.103:0/3745072472 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7d6404d820 0x7f7d6404fce0 secure :-1 s=READY pgs=167 cs=0 l=1 rx=0x7f7d840b2790 tx=0x7f7d74002560).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:42.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.649+0000 7f7d83fff700 1 --2- 172.21.15.103:0/3745072472 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d840b5210 0x7f7d84154aa0 secure :-1 s=THROTTLE_DONE pgs=406 cs=0 l=1 rx=0x7f7d78002f30 tx=0x7f7d8405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:42.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.649+0000 7f7d817fa700 1 -- 172.21.15.103:0/3745072472 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f7d780810e0 con 0x7f7d840b5210 2020-04-22T14:03:42.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.842+0000 7f7d8a284700 1 -- 172.21.15.103:0/3745072472 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f7d84063fa0 con 0x7f7d840b5210 2020-04-22T14:03:42.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.848+0000 7f7d83fff700 1 --2- 172.21.15.103:0/3745072472 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d840b5210 0x7f7d84154aa0 secure :-1 s=THROTTLE_DONE pgs=406 cs=0 l=1 rx=0x7f7d78002f30 tx=0x7f7d8405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:42.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.848+0000 7f7d817fa700 1 -- 172.21.15.103:0/3745072472 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v15) v1 ==== 184+0+0 (secure 0 0 0) 0x7f7d78084700 con 0x7f7d840b5210 2020-04-22T14:03:42.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.849+0000 7f7d8a284700 1 -- 172.21.15.103:0/3745072472 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7d6404d820 msgr2=0x7f7d6404fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:42.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.849+0000 7f7d8a284700 1 --2- 172.21.15.103:0/3745072472 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7d6404d820 0x7f7d6404fce0 secure :-1 s=READY pgs=167 cs=0 l=1 rx=0x7f7d840b2790 tx=0x7f7d74002560).stop 2020-04-22T14:03:42.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.849+0000 7f7d8a284700 1 -- 172.21.15.103:0/3745072472 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d840b5210 msgr2=0x7f7d84154aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:42.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.849+0000 7f7d8a284700 1 --2- 172.21.15.103:0/3745072472 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d840b5210 0x7f7d84154aa0 secure :-1 s=READY pgs=406 cs=0 l=1 rx=0x7f7d78002f30 tx=0x7f7d8405a720).stop 2020-04-22T14:03:42.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.850+0000 7f7d8a284700 1 -- 172.21.15.103:0/3745072472 shutdown_connections 2020-04-22T14:03:42.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.850+0000 7f7d8a284700 1 --2- 172.21.15.103:0/3745072472 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7d6404d820 0x7f7d6404fce0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:42.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.850+0000 7f7d8a284700 1 --2- 172.21.15.103:0/3745072472 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d840b5210 0x7f7d84154aa0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:42.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.850+0000 7f7d8a284700 1 -- 172.21.15.103:0/3745072472 >> 172.21.15.103:0/3745072472 conn(0x7f7d8405ad30 msgr2=0x7f7d8405c640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:42.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.850+0000 7f7d8a284700 1 -- 172.21.15.103:0/3745072472 shutdown_connections 2020-04-22T14:03:42.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:42.850+0000 7f7d8a284700 1 -- 172.21.15.103:0/3745072472 wait complete. 2020-04-22T14:03:42.854 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.2 2020-04-22T14:03:42.862 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:42.876 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:03:43.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.031+0000 7fc2d786f700 1 Processor -- start 2020-04-22T14:03:43.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.031+0000 7fc2d786f700 1 -- start start 2020-04-22T14:03:43.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.032+0000 7fc2d786f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc2d0152a90 0x7fc2d00b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:43.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.032+0000 7fc2d786f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc2d0062170 0x7fc2d00b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:43.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.032+0000 7fc2d786f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2d00b5210 0x7fc2d0156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:43.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.032+0000 7fc2d786f700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2d00b5650 con 0x7fc2d0062170 2020-04-22T14:03:43.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.032+0000 7fc2d786f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2d00614f0 con 0x7fc2d0152a90 2020-04-22T14:03:43.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.032+0000 7fc2d786f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d0061790 con 0x7fc2d00b5210 2020-04-22T14:03:43.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.032+0000 7fc2d5e0c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc2d0152a90 0x7fc2d00b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:43.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.032+0000 7fc2d5e0c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc2d0152a90 0x7fc2d00b44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48778/0 (socket says 172.21.15.103:48778) 2020-04-22T14:03:43.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.032+0000 7fc2d5e0c700 1 -- 172.21.15.103:0/3874168068 learned_addr learned my addr 172.21.15.103:0/3874168068 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:43.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.032+0000 7fc2d660d700 1 --2- 172.21.15.103:0/3874168068 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2d00b5210 0x7fc2d0156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:43.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.032+0000 7fc2d5e0c700 1 -- 172.21.15.103:0/3874168068 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2d00b5210 msgr2=0x7fc2d0156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:43.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.032+0000 7fc2d5e0c700 1 --2- 172.21.15.103:0/3874168068 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2d00b5210 0x7fc2d0156500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:43.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.032+0000 7fc2d560b700 1 --2- 172.21.15.103:0/3874168068 >> v2:172.21.15.86:3300/0 conn(0x7fc2d0062170 0x7fc2d00b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:43.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.032+0000 7fc2d5e0c700 1 -- 172.21.15.103:0/3874168068 >> v2:172.21.15.86:3300/0 conn(0x7fc2d0062170 msgr2=0x7fc2d00b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:43.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.032+0000 7fc2d5e0c700 1 --2- 172.21.15.103:0/3874168068 >> v2:172.21.15.86:3300/0 conn(0x7fc2d0062170 0x7fc2d00b4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:43.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.032+0000 7fc2d5e0c700 1 -- 172.21.15.103:0/3874168068 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d0061a30 con 0x7fc2d0152a90 2020-04-22T14:03:43.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.032+0000 7fc2d5e0c700 1 --2- 172.21.15.103:0/3874168068 >> v2:172.21.15.103:3300/0 conn(0x7fc2d0152a90 0x7fc2d00b44d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc2c4002f30 tx=0x7fc2c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:43.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.032+0000 7fc2d5e0c700 1 --2- 172.21.15.103:0/3874168068 >> v2:172.21.15.103:3300/0 conn(0x7fc2d0152a90 0x7fc2d00b44d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc2c4002f30 tx=0x7fc2c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:43.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.032+0000 7fc2d5e0c700 1 --2- 172.21.15.103:0/3874168068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2d0152a90 0x7fc2d00b44d0 secure :-1 s=READY pgs=407 cs=0 l=1 rx=0x7fc2c4002f30 tx=0x7fc2c4007a40).ready entity=mon.1 client_cookie=ffc556aaea6866ec server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:43.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.032+0000 7fc2d5e0c700 1 --2- 172.21.15.103:0/3874168068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2d0152a90 0x7fc2d00b44d0 secure :-1 s=THROTTLE_DONE pgs=407 cs=0 l=1 rx=0x7fc2c4002f30 tx=0x7fc2c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:43.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.032+0000 7fc2d4e0a700 1 -- 172.21.15.103:0/3874168068 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2c4011720 con 0x7fc2d0152a90 2020-04-22T14:03:43.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.032+0000 7fc2d5e0c700 1 --2- 172.21.15.103:0/3874168068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2d0152a90 0x7fc2d00b44d0 secure :-1 s=THROTTLE_DONE pgs=407 cs=0 l=1 rx=0x7fc2c4002f30 tx=0x7fc2c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:43.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.032+0000 7fc2d5e0c700 1 --2- 172.21.15.103:0/3874168068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2d0152a90 0x7fc2d00b44d0 secure :-1 s=THROTTLE_DONE pgs=407 cs=0 l=1 rx=0x7fc2c4002f30 tx=0x7fc2c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:43.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.032+0000 7fc2d4e0a700 1 -- 172.21.15.103:0/3874168068 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c4011880 con 0x7fc2d0152a90 2020-04-22T14:03:43.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.032+0000 7fc2d4e0a700 1 -- 172.21.15.103:0/3874168068 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2c4011ca0 con 0x7fc2d0152a90 2020-04-22T14:03:43.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.032+0000 7fc2d786f700 1 -- 172.21.15.103:0/3874168068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2d0152a90 msgr2=0x7fc2d00b44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:43.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.032+0000 7fc2d786f700 1 --2- 172.21.15.103:0/3874168068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2d0152a90 0x7fc2d00b44d0 secure :-1 s=READY pgs=407 cs=0 l=1 rx=0x7fc2c4002f30 tx=0x7fc2c4007a40).stop 2020-04-22T14:03:43.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.033+0000 7fc2d786f700 1 -- 172.21.15.103:0/3874168068 shutdown_connections 2020-04-22T14:03:43.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.033+0000 7fc2d786f700 1 --2- 172.21.15.103:0/3874168068 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2d00b5210 0x7fc2d0156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:43.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.033+0000 7fc2d786f700 1 --2- 172.21.15.103:0/3874168068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2d0152a90 0x7fc2d00b44d0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:43.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.033+0000 7fc2d786f700 1 --2- 172.21.15.103:0/3874168068 >> v2:172.21.15.86:3300/0 conn(0x7fc2d0062170 0x7fc2d00b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:43.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.033+0000 7fc2d786f700 1 -- 172.21.15.103:0/3874168068 >> 172.21.15.103:0/3874168068 conn(0x7fc2d005ad30 msgr2=0x7fc2d005b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:43.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.033+0000 7fc2d786f700 1 -- 172.21.15.103:0/3874168068 shutdown_connections 2020-04-22T14:03:43.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.033+0000 7fc2d786f700 1 -- 172.21.15.103:0/3874168068 wait complete. 2020-04-22T14:03:43.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.034+0000 7fc2d786f700 1 Processor -- start 2020-04-22T14:03:43.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.034+0000 7fc2d786f700 1 -- start start 2020-04-22T14:03:43.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.035+0000 7fc2d786f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc2d0062170 0x7fc2d0155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:43.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.035+0000 7fc2d786f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc2d00b5210 0x7fc2d0130100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:43.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.035+0000 7fc2d786f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2d0152a90 0x7fc2d006fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:43.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.035+0000 7fc2d786f700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2d012ed80 con 0x7fc2d00b5210 2020-04-22T14:03:43.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.035+0000 7fc2d786f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2d0130560 con 0x7fc2d0062170 2020-04-22T14:03:43.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.035+0000 7fc2d786f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d0154af0 con 0x7fc2d0152a90 2020-04-22T14:03:43.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.035+0000 7fc2d5e0c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc2d0062170 0x7fc2d0155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:43.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.035+0000 7fc2d5e0c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc2d0062170 0x7fc2d0155f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48784/0 (socket says 172.21.15.103:48784) 2020-04-22T14:03:43.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.035+0000 7fc2d5e0c700 1 -- 172.21.15.103:0/2558910448 learned_addr learned my addr 172.21.15.103:0/2558910448 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:43.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.035+0000 7fc2d560b700 1 --2- 172.21.15.103:0/2558910448 >> v2:172.21.15.86:3300/0 conn(0x7fc2d00b5210 0x7fc2d0130100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:43.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.035+0000 7fc2d660d700 1 --2- 172.21.15.103:0/2558910448 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2d0152a90 0x7fc2d006fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:43.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.035+0000 7fc2d5e0c700 1 -- 172.21.15.103:0/2558910448 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2d0152a90 msgr2=0x7fc2d006fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:43.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.035+0000 7fc2d5e0c700 1 --2- 172.21.15.103:0/2558910448 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2d0152a90 0x7fc2d006fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:43.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.035+0000 7fc2d5e0c700 1 -- 172.21.15.103:0/2558910448 >> v2:172.21.15.86:3300/0 conn(0x7fc2d00b5210 msgr2=0x7fc2d0130100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:43.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.035+0000 7fc2d5e0c700 1 --2- 172.21.15.103:0/2558910448 >> v2:172.21.15.86:3300/0 conn(0x7fc2d00b5210 0x7fc2d0130100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:43.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.035+0000 7fc2d5e0c700 1 -- 172.21.15.103:0/2558910448 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d01545c0 con 0x7fc2d0062170 2020-04-22T14:03:43.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.035+0000 7fc2d5e0c700 1 --2- 172.21.15.103:0/2558910448 >> v2:172.21.15.103:3300/0 conn(0x7fc2d0062170 0x7fc2d0155f00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc2d012fb40 tx=0x7fc2c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:43.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.035+0000 7fc2d5e0c700 1 --2- 172.21.15.103:0/2558910448 >> v2:172.21.15.103:3300/0 conn(0x7fc2d0062170 0x7fc2d0155f00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc2d012fb40 tx=0x7fc2c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:43.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.035+0000 7fc2d5e0c700 1 --2- 172.21.15.103:0/2558910448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2d0062170 0x7fc2d0155f00 secure :-1 s=READY pgs=408 cs=0 l=1 rx=0x7fc2d012fb40 tx=0x7fc2c4007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:43.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.035+0000 7fc2d5e0c700 1 --2- 172.21.15.103:0/2558910448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2d0062170 0x7fc2d0155f00 secure :-1 s=THROTTLE_DONE pgs=408 cs=0 l=1 rx=0x7fc2d012fb40 tx=0x7fc2c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:43.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.035+0000 7fc2d5e0c700 1 --2- 172.21.15.103:0/2558910448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2d0062170 0x7fc2d0155f00 secure :-1 s=THROTTLE_DONE pgs=408 cs=0 l=1 rx=0x7fc2d012fb40 tx=0x7fc2c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:43.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.035+0000 7fc2d5e0c700 1 --2- 172.21.15.103:0/2558910448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2d0062170 0x7fc2d0155f00 secure :-1 s=THROTTLE_DONE pgs=408 cs=0 l=1 rx=0x7fc2d012fb40 tx=0x7fc2c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:43.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.035+0000 7fc2c27fc700 1 -- 172.21.15.103:0/2558910448 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2c4007170 con 0x7fc2d0062170 2020-04-22T14:03:43.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.035+0000 7fc2c27fc700 1 -- 172.21.15.103:0/2558910448 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c40072d0 con 0x7fc2d0062170 2020-04-22T14:03:43.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.035+0000 7fc2c27fc700 1 -- 172.21.15.103:0/2558910448 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2c40056c0 con 0x7fc2d0062170 2020-04-22T14:03:43.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.035+0000 7fc2d786f700 1 -- 172.21.15.103:0/2558910448 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d006f970 con 0x7fc2d0062170 2020-04-22T14:03:43.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.036+0000 7fc2d786f700 1 -- 172.21.15.103:0/2558910448 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d0153c00 con 0x7fc2d0062170 2020-04-22T14:03:43.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.036+0000 7fc2d5e0c700 1 --2- 172.21.15.103:0/2558910448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2d0062170 0x7fc2d0155f00 secure :-1 s=THROTTLE_DONE pgs=408 cs=0 l=1 rx=0x7fc2d012fb40 tx=0x7fc2c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:43.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.037+0000 7fc2c27fc700 1 -- 172.21.15.103:0/2558910448 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fc2c4005930 con 0x7fc2d0062170 2020-04-22T14:03:43.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.037+0000 7fc2d5e0c700 1 --2- 172.21.15.103:0/2558910448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2d0062170 0x7fc2d0155f00 secure :-1 s=THROTTLE_DONE pgs=408 cs=0 l=1 rx=0x7fc2d012fb40 tx=0x7fc2c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:43.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.037+0000 7fc2d786f700 1 -- 172.21.15.103:0/2558910448 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2d0056c90 con 0x7fc2d0062170 2020-04-22T14:03:43.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.037+0000 7fc2c27fc700 1 --2- 172.21.15.103:0/2558910448 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc2b804db50 0x7fc2b8050010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:43.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.037+0000 7fc2c27fc700 1 -- 172.21.15.103:0/2558910448 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc2c4061c80 con 0x7fc2d0062170 2020-04-22T14:03:43.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.037+0000 7fc2d560b700 1 --2- 172.21.15.103:0/2558910448 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc2b804db50 0x7fc2b8050010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:43.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.037+0000 7fc2d560b700 1 --2- 172.21.15.103:0/2558910448 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc2b804db50 0x7fc2b8050010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc2cc002f30 tx=0x7fc2d005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:43.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.037+0000 7fc2d560b700 1 --2- 172.21.15.103:0/2558910448 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc2b804db50 0x7fc2b8050010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc2cc002f30 tx=0x7fc2d005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:43.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.037+0000 7fc2d560b700 1 --2- 172.21.15.103:0/2558910448 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc2b804db50 0x7fc2b8050010 secure :-1 s=READY pgs=168 cs=0 l=1 rx=0x7fc2cc002f30 tx=0x7fc2d005a720).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:43.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.041+0000 7fc2d5e0c700 1 --2- 172.21.15.103:0/2558910448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2d0062170 0x7fc2d0155f00 secure :-1 s=THROTTLE_DONE pgs=408 cs=0 l=1 rx=0x7fc2d012fb40 tx=0x7fc2c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:43.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.041+0000 7fc2c27fc700 1 -- 172.21.15.103:0/2558910448 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fc2c403d180 con 0x7fc2d0062170 2020-04-22T14:03:43.237 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.235+0000 7fc2d786f700 1 -- 172.21.15.103:0/2558910448 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fc2d006a8b0 con 0x7fc2d0062170 2020-04-22T14:03:43.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.239+0000 7fc2d5e0c700 1 --2- 172.21.15.103:0/2558910448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2d0062170 0x7fc2d0155f00 secure :-1 s=THROTTLE_DONE pgs=408 cs=0 l=1 rx=0x7fc2d012fb40 tx=0x7fc2c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:43.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.239+0000 7fc2c27fc700 1 -- 172.21.15.103:0/2558910448 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v16) v1 ==== 184+0+0 (secure 0 0 0) 0x7fc2c40407a0 con 0x7fc2d0062170 2020-04-22T14:03:43.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.240+0000 7fc2d786f700 1 -- 172.21.15.103:0/2558910448 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc2b804db50 msgr2=0x7fc2b8050010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:43.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.240+0000 7fc2d786f700 1 --2- 172.21.15.103:0/2558910448 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc2b804db50 0x7fc2b8050010 secure :-1 s=READY pgs=168 cs=0 l=1 rx=0x7fc2cc002f30 tx=0x7fc2d005a720).stop 2020-04-22T14:03:43.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.240+0000 7fc2d786f700 1 -- 172.21.15.103:0/2558910448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2d0062170 msgr2=0x7fc2d0155f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:43.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.240+0000 7fc2d786f700 1 --2- 172.21.15.103:0/2558910448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2d0062170 0x7fc2d0155f00 secure :-1 s=READY pgs=408 cs=0 l=1 rx=0x7fc2d012fb40 tx=0x7fc2c4007a40).stop 2020-04-22T14:03:43.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.240+0000 7fc2d786f700 1 -- 172.21.15.103:0/2558910448 shutdown_connections 2020-04-22T14:03:43.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.240+0000 7fc2d786f700 1 --2- 172.21.15.103:0/2558910448 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2d0152a90 0x7fc2d006fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:43.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.240+0000 7fc2d786f700 1 --2- 172.21.15.103:0/2558910448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2d0062170 0x7fc2d0155f00 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:43.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.240+0000 7fc2d786f700 1 --2- 172.21.15.103:0/2558910448 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc2b804db50 0x7fc2b8050010 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:43.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.240+0000 7fc2d786f700 1 --2- 172.21.15.103:0/2558910448 >> v2:172.21.15.86:3300/0 conn(0x7fc2d00b5210 0x7fc2d0130100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:43.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.240+0000 7fc2d786f700 1 -- 172.21.15.103:0/2558910448 >> 172.21.15.103:0/2558910448 conn(0x7fc2d005ad30 msgr2=0x7fc2d005c640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:43.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.240+0000 7fc2d786f700 1 -- 172.21.15.103:0/2558910448 shutdown_connections 2020-04-22T14:03:43.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.240+0000 7fc2d786f700 1 -- 172.21.15.103:0/2558910448 wait complete. 2020-04-22T14:03:43.252 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.3 2020-04-22T14:03:43.253 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:43.267 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:03:43.413 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.410+0000 7f03f9fe3700 1 Processor -- start 2020-04-22T14:03:43.413 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.410+0000 7f03f9fe3700 1 -- start start 2020-04-22T14:03:43.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.411+0000 7f03f9fe3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f03f4065fe0 0x7f03f41464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:43.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.411+0000 7f03f9fe3700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f4143300 con 0x7f03f4063e30 2020-04-22T14:03:43.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.411+0000 7f03f9fe3700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f41435a0 con 0x7f03f412c0d0 2020-04-22T14:03:43.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.411+0000 7f03f9fe3700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f4143840 con 0x7f03f4065fe0 2020-04-22T14:03:43.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.411+0000 7f03f2ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f03f4065fe0 0x7f03f41464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:43.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.411+0000 7f03f37fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f03f412c0d0 0x7f03f405b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40982/0 (socket says 172.21.15.103:40982) 2020-04-22T14:03:43.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.411+0000 7f03f37fe700 1 -- 172.21.15.103:0/265442814 learned_addr learned my addr 172.21.15.103:0/265442814 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:43.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.411+0000 7f03f2ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f03f4065fe0 0x7f03f41464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48796/0 (socket says 172.21.15.103:48796) 2020-04-22T14:03:43.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.411+0000 7f03f2ffd700 1 -- 172.21.15.103:0/265442814 >> v1:172.21.15.103:6789/0 conn(0x7f03f412c0d0 legacy=0x7f03f405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:43.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.411+0000 7f03f2ffd700 1 -- 172.21.15.103:0/265442814 >> v1:172.21.15.86:6789/0 conn(0x7f03f4063e30 legacy=0x7f03f40642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:43.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.411+0000 7f03f2ffd700 1 -- 172.21.15.103:0/265442814 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f405bb50 con 0x7f03f4065fe0 2020-04-22T14:03:43.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.412+0000 7f03f2ffd700 1 --2- 172.21.15.103:0/265442814 >> v2:172.21.15.103:3300/0 conn(0x7f03f4065fe0 0x7f03f41464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f03e8002f30 tx=0x7f03e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:43.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.412+0000 7f03f2ffd700 1 --2- 172.21.15.103:0/265442814 >> v2:172.21.15.103:3300/0 conn(0x7f03f4065fe0 0x7f03f41464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f03e8002f30 tx=0x7f03e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:43.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.412+0000 7f03f2ffd700 1 --2- 172.21.15.103:0/265442814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03f4065fe0 0x7f03f41464e0 secure :-1 s=READY pgs=410 cs=0 l=1 rx=0x7f03e8002f30 tx=0x7f03e8007a40).ready entity=mon.1 client_cookie=60b28de2523954c2 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:43.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.412+0000 7f03f2ffd700 1 --2- 172.21.15.103:0/265442814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03f4065fe0 0x7f03f41464e0 secure :-1 s=THROTTLE_DONE pgs=410 cs=0 l=1 rx=0x7f03e8002f30 tx=0x7f03e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:43.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.412+0000 7f03f2ffd700 1 --2- 172.21.15.103:0/265442814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03f4065fe0 0x7f03f41464e0 secure :-1 s=THROTTLE_DONE pgs=410 cs=0 l=1 rx=0x7f03e8002f30 tx=0x7f03e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:43.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.412+0000 7f03f27fc700 1 -- 172.21.15.103:0/265442814 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03e8013680 con 0x7f03f4065fe0 2020-04-22T14:03:43.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.412+0000 7f03f2ffd700 1 --2- 172.21.15.103:0/265442814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03f4065fe0 0x7f03f41464e0 secure :-1 s=THROTTLE_DONE pgs=410 cs=0 l=1 rx=0x7f03e8002f30 tx=0x7f03e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:43.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.412+0000 7f03f27fc700 1 -- 172.21.15.103:0/265442814 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e80137e0 con 0x7f03f4065fe0 2020-04-22T14:03:43.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.412+0000 7f03f27fc700 1 -- 172.21.15.103:0/265442814 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03e8013c00 con 0x7f03f4065fe0 2020-04-22T14:03:43.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.412+0000 7f03f9fe3700 1 -- 172.21.15.103:0/265442814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03f4065fe0 msgr2=0x7f03f41464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:43.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.412+0000 7f03f9fe3700 1 --2- 172.21.15.103:0/265442814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03f4065fe0 0x7f03f41464e0 secure :-1 s=READY pgs=410 cs=0 l=1 rx=0x7f03e8002f30 tx=0x7f03e8007a40).stop 2020-04-22T14:03:43.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.412+0000 7f03f9fe3700 1 -- 172.21.15.103:0/265442814 shutdown_connections 2020-04-22T14:03:43.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.412+0000 7f03f9fe3700 1 --2- 172.21.15.103:0/265442814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03f4065fe0 0x7f03f41464e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:43.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.412+0000 7f03f9fe3700 1 -- 172.21.15.103:0/265442814 >> 172.21.15.103:0/265442814 conn(0x7f03f40b9160 msgr2=0x7f03f405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:43.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.412+0000 7f03f9fe3700 1 -- 172.21.15.103:0/265442814 shutdown_connections 2020-04-22T14:03:43.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.412+0000 7f03f9fe3700 1 -- 172.21.15.103:0/265442814 wait complete. 2020-04-22T14:03:43.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.413+0000 7f03f9fe3700 1 Processor -- start 2020-04-22T14:03:43.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.414+0000 7f03f9fe3700 1 -- start start 2020-04-22T14:03:43.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.414+0000 7f03f9fe3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03f412c0d0 0x7f03f412b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:43.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.414+0000 7f03f9fe3700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f40afe80 con 0x7f03f4063e30 2020-04-22T14:03:43.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.414+0000 7f03f9fe3700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f40b0120 con 0x7f03f4065fe0 2020-04-22T14:03:43.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.414+0000 7f03f9fe3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f40ae940 con 0x7f03f412c0d0 2020-04-22T14:03:43.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.414+0000 7f03f2ffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f03f4065fe0 0x7f03f40ac740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40990/0 (socket says 172.21.15.103:40990) 2020-04-22T14:03:43.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.414+0000 7f03f2ffd700 1 -- 172.21.15.103:0/2677806788 learned_addr learned my addr 172.21.15.103:0/2677806788 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:43.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.414+0000 7f03f0ff9700 1 -- 172.21.15.103:0/2677806788 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 79786595 0 0) 0x7f03f40b0120 con 0x7f03f4065fe0 2020-04-22T14:03:43.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.414+0000 7f03f0ff9700 1 -- 172.21.15.103:0/2677806788 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03d4002fe0 con 0x7f03f4065fe0 2020-04-22T14:03:43.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.414+0000 7f03f3fff700 1 --2- 172.21.15.103:0/2677806788 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03f412c0d0 0x7f03f412b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:43.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.415+0000 7f03f0ff9700 1 -- 172.21.15.103:0/2677806788 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1961916762 0 0) 0x7f03d4002fe0 con 0x7f03f4065fe0 2020-04-22T14:03:43.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.415+0000 7f03f0ff9700 1 -- 172.21.15.103:0/2677806788 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f03f40b0120 con 0x7f03f4065fe0 2020-04-22T14:03:43.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.415+0000 7f03f0ff9700 1 -- 172.21.15.103:0/2677806788 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f03e8008e10 con 0x7f03f4065fe0 2020-04-22T14:03:43.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.415+0000 7f03f0ff9700 1 -- 172.21.15.103:0/2677806788 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03f412c0d0 msgr2=0x7f03f412b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:43.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.415+0000 7f03f0ff9700 1 --2- 172.21.15.103:0/2677806788 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03f412c0d0 0x7f03f412b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:43.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.415+0000 7f03f0ff9700 1 -- 172.21.15.103:0/2677806788 >> v1:172.21.15.103:6789/0 conn(0x7f03f4065fe0 legacy=0x7f03f40ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:43.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.415+0000 7f03f0ff9700 1 -- 172.21.15.103:0/2677806788 >> v1:172.21.15.86:6789/0 conn(0x7f03f4063e30 legacy=0x7f03f40b05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:43.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.415+0000 7f03f0ff9700 1 --2- 172.21.15.103:0/2677806788 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03d40049b0 0x7f03d4004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:43.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.415+0000 7f03f0ff9700 1 --2- 172.21.15.103:0/2677806788 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03d4005250 0x7f03d4003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:43.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.415+0000 7f03f0ff9700 1 --2- 172.21.15.103:0/2677806788 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03f412c0d0 0x7f03d4003f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:43.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.415+0000 7f03f0ff9700 1 -- 172.21.15.103:0/2677806788 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f40ae940 con 0x7f03d40049b0 2020-04-22T14:03:43.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.415+0000 7f03f0ff9700 1 -- 172.21.15.103:0/2677806788 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d40043f0 con 0x7f03d4005250 2020-04-22T14:03:43.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.415+0000 7f03f0ff9700 1 -- 172.21.15.103:0/2677806788 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03d40045b0 con 0x7f03f412c0d0 2020-04-22T14:03:43.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.415+0000 7f03f2ffd700 1 --2- 172.21.15.103:0/2677806788 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03d4005250 0x7f03d4003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:43.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.415+0000 7f03f37fe700 1 --2- 172.21.15.103:0/2677806788 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03d40049b0 0x7f03d4004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:43.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.415+0000 7f03f3fff700 1 --2- 172.21.15.103:0/2677806788 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03f412c0d0 0x7f03d4003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:43.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.415+0000 7f03f2ffd700 1 -- 172.21.15.103:0/2677806788 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03f412c0d0 msgr2=0x7f03d4003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:43.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.415+0000 7f03f2ffd700 1 --2- 172.21.15.103:0/2677806788 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03f412c0d0 0x7f03d4003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:43.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.415+0000 7f03f2ffd700 1 -- 172.21.15.103:0/2677806788 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03d40049b0 msgr2=0x7f03d4004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:43.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.415+0000 7f03f2ffd700 1 --2- 172.21.15.103:0/2677806788 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03d40049b0 0x7f03d4004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:43.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.415+0000 7f03f2ffd700 1 -- 172.21.15.103:0/2677806788 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d4002fe0 con 0x7f03d4005250 2020-04-22T14:03:43.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.415+0000 7f03f9fe3700 1 -- 172.21.15.103:0/2677806788 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f40b0d30 con 0x7f03d4005250 2020-04-22T14:03:43.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.415+0000 7f03f2ffd700 1 --2- 172.21.15.103:0/2677806788 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03d4005250 0x7f03d4003920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f03e80084c0 tx=0x7f03e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:43.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.415+0000 7f03f9fe3700 1 -- 172.21.15.103:0/2677806788 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f412b3f0 con 0x7f03d4005250 2020-04-22T14:03:43.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.415+0000 7f03f2ffd700 1 --2- 172.21.15.103:0/2677806788 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03d4005250 0x7f03d4003920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f03e80084c0 tx=0x7f03e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:43.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.415+0000 7f03f2ffd700 1 --2- 172.21.15.103:0/2677806788 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03d4005250 0x7f03d4003920 secure :-1 s=READY pgs=412 cs=0 l=1 rx=0x7f03e80084c0 tx=0x7f03e8007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:43.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.415+0000 7f03f2ffd700 1 --2- 172.21.15.103:0/2677806788 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03d4005250 0x7f03d4003920 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7f03e80084c0 tx=0x7f03e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:43.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.415+0000 7f03f2ffd700 1 --2- 172.21.15.103:0/2677806788 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03d4005250 0x7f03d4003920 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7f03e80084c0 tx=0x7f03e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:43.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.415+0000 7f03f0ff9700 1 -- 172.21.15.103:0/2677806788 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03e800f800 con 0x7f03d4005250 2020-04-22T14:03:43.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.415+0000 7f03f2ffd700 1 --2- 172.21.15.103:0/2677806788 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03d4005250 0x7f03d4003920 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7f03e80084c0 tx=0x7f03e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:43.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.415+0000 7f03f0ff9700 1 -- 172.21.15.103:0/2677806788 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e8007170 con 0x7f03d4005250 2020-04-22T14:03:43.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.415+0000 7f03f0ff9700 1 -- 172.21.15.103:0/2677806788 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03e8007510 con 0x7f03d4005250 2020-04-22T14:03:43.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.416+0000 7f03f2ffd700 1 --2- 172.21.15.103:0/2677806788 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03d4005250 0x7f03d4003920 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7f03e80084c0 tx=0x7f03e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:43.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.416+0000 7f03f9fe3700 1 -- 172.21.15.103:0/2677806788 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03d0003340 con 0x7f03d4005250 2020-04-22T14:03:43.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.416+0000 7f03f0ff9700 1 -- 172.21.15.103:0/2677806788 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f03e80056c0 con 0x7f03d4005250 2020-04-22T14:03:43.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.416+0000 7f03f2ffd700 1 --2- 172.21.15.103:0/2677806788 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03d4005250 0x7f03d4003920 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7f03e80084c0 tx=0x7f03e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:43.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.417+0000 7f03f0ff9700 1 --2- 172.21.15.103:0/2677806788 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f03d4055a50 0x7f03d4057f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:43.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.417+0000 7f03f0ff9700 1 -- 172.21.15.103:0/2677806788 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f03e80646e0 con 0x7f03d4005250 2020-04-22T14:03:43.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.417+0000 7f03f37fe700 1 --2- 172.21.15.103:0/2677806788 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f03d4055a50 0x7f03d4057f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:43.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.417+0000 7f03f37fe700 1 --2- 172.21.15.103:0/2677806788 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f03d4055a50 0x7f03d4057f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f03f4129450 tx=0x7f03e4001cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:43.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.417+0000 7f03f37fe700 1 --2- 172.21.15.103:0/2677806788 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f03d4055a50 0x7f03d4057f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f03f4129450 tx=0x7f03e4001cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:43.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.417+0000 7f03f37fe700 1 --2- 172.21.15.103:0/2677806788 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f03d4055a50 0x7f03d4057f10 secure :-1 s=READY pgs=169 cs=0 l=1 rx=0x7f03f4129450 tx=0x7f03e4001cd0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:43.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.420+0000 7f03f2ffd700 1 --2- 172.21.15.103:0/2677806788 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03d4005250 0x7f03d4003920 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7f03e80084c0 tx=0x7f03e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:43.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.421+0000 7f03f0ff9700 1 -- 172.21.15.103:0/2677806788 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f03e803fbe0 con 0x7f03d4005250 2020-04-22T14:03:43.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.610+0000 7f03f9fe3700 1 -- 172.21.15.103:0/2677806788 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03d00036e0 con 0x7f03d4005250 2020-04-22T14:03:43.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.611+0000 7f03f2ffd700 1 --2- 172.21.15.103:0/2677806788 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03d4005250 0x7f03d4003920 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7f03e80084c0 tx=0x7f03e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:43.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.611+0000 7f03f0ff9700 1 -- 172.21.15.103:0/2677806788 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2141 (secure 0 0 0) 0x7f03e8043200 con 0x7f03d4005250 2020-04-22T14:03:43.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.612+0000 7f03f9fe3700 1 -- 172.21.15.103:0/2677806788 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f03d4055a50 msgr2=0x7f03d4057f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:43.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.612+0000 7f03f9fe3700 1 --2- 172.21.15.103:0/2677806788 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f03d4055a50 0x7f03d4057f10 secure :-1 s=READY pgs=169 cs=0 l=1 rx=0x7f03f4129450 tx=0x7f03e4001cd0).stop 2020-04-22T14:03:43.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.612+0000 7f03f9fe3700 1 -- 172.21.15.103:0/2677806788 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03d4005250 msgr2=0x7f03d4003920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:43.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.612+0000 7f03f9fe3700 1 --2- 172.21.15.103:0/2677806788 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03d4005250 0x7f03d4003920 secure :-1 s=READY pgs=412 cs=0 l=1 rx=0x7f03e80084c0 tx=0x7f03e8007a40).stop 2020-04-22T14:03:43.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.612+0000 7f03f3fff700 1 -- 172.21.15.103:0/2677806788 reap_dead start 2020-04-22T14:03:43.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.612+0000 7f03f9fe3700 1 -- 172.21.15.103:0/2677806788 shutdown_connections 2020-04-22T14:03:43.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.612+0000 7f03f9fe3700 1 -- 172.21.15.103:0/2677806788 >> 172.21.15.103:0/2677806788 conn(0x7f03f40b9160 msgr2=0x7f03f4061b30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:43.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.612+0000 7f03f9fe3700 1 -- 172.21.15.103:0/2677806788 shutdown_connections 2020-04-22T14:03:43.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:43.612+0000 7f03f9fe3700 1 -- 172.21.15.103:0/2677806788 wait complete. 2020-04-22T14:03:43.622 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 14 2020-04-22T14:03:43.622 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:03:43.623 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4956,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/2333777975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2333777975},{"type":"v1","addr":"172.21.15.86:6835","nonce":2333777975}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:03:38.935462+0000","modified":"2020-04-22T14:03:40.946647+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5050},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5050":{"gid":5050,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/3282872682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3282872682},{"type":"v1","addr":"172.21.15.103:6833","nonce":3282872682}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2020-04-22T14:03:43.827 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 5050}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 5, u'failed': [], u'epoch': 14, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [6], u'info': {u'gid_5050': {u'export_targets': [], u'name': u'a', u'incarnation': 11, u'state_seq': 3, u'state': u'up:active', u'gid': 5050, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 3282872682, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 3282872682, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/3282872682'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:03:38.935462+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:03:40.946647+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:03:43.827 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:03:43.828 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:43.842 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:03:44.001 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:03:44.002 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:03:44.002 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:03:44.002 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 5050, 2020-04-22T14:03:44.002 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:03:44.002 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:03:44.002 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 5.0607641890000004, 2020-04-22T14:03:44.002 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 14, 2020-04-22T14:03:44.003 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 35, 2020-04-22T14:03:44.003 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 35, 2020-04-22T14:03:44.003 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 12.300063572999999 2020-04-22T14:03:44.003 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:03:44.017 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 5050, "want_state": "up:active", "state": "up:active", "rank_uptime": 5.0607641890000004, "mdsmap_epoch": 14, "osdmap_epoch": 35, "osdmap_epoch_barrier": 35, "uptime": 12.300063572999999 } 2020-04-22T14:03:44.017 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:44.032 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:03:44.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.175+0000 7ff3ff0bf700 1 Processor -- start 2020-04-22T14:03:44.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.175+0000 7ff3ff0bf700 1 -- start start 2020-04-22T14:03:44.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.176+0000 7ff3ff0bf700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff3f8065fe0 0x7ff3f81464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:44.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.176+0000 7ff3ff0bf700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3f8143300 con 0x7ff3f8063e30 2020-04-22T14:03:44.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.176+0000 7ff3ff0bf700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3f81435a0 con 0x7ff3f812c0d0 2020-04-22T14:03:44.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.176+0000 7ff3ff0bf700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3f8143840 con 0x7ff3f8065fe0 2020-04-22T14:03:44.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.176+0000 7ff3fce5b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff3f812c0d0 0x7ff3f805b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41002/0 (socket says 172.21.15.103:41002) 2020-04-22T14:03:44.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.176+0000 7ff3fce5b700 1 -- 172.21.15.103:0/3675484755 learned_addr learned my addr 172.21.15.103:0/3675484755 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:44.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.176+0000 7ff3f7fff700 1 --2- 172.21.15.103:0/3675484755 >> v2:172.21.15.86:3300/0 conn(0x7ff3f8065fe0 0x7ff3f81464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:44.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.176+0000 7ff3f77fe700 1 -- 172.21.15.103:0/3675484755 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 283561205 0 0) 0x7ff3f81435a0 con 0x7ff3f812c0d0 2020-04-22T14:03:44.188 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.176+0000 7ff3f77fe700 1 -- 172.21.15.103:0/3675484755 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3e4003230 con 0x7ff3f812c0d0 2020-04-22T14:03:44.188 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.176+0000 7ff3f77fe700 1 -- 172.21.15.103:0/3675484755 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1224555874 0 0) 0x7ff3e4003230 con 0x7ff3f812c0d0 2020-04-22T14:03:44.188 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.176+0000 7ff3f77fe700 1 -- 172.21.15.103:0/3675484755 >> v2:172.21.15.86:3300/0 conn(0x7ff3f8065fe0 msgr2=0x7ff3f81464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:44.188 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.176+0000 7ff3f77fe700 1 --2- 172.21.15.103:0/3675484755 >> v2:172.21.15.86:3300/0 conn(0x7ff3f8065fe0 0x7ff3f81464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:44.188 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.176+0000 7ff3f77fe700 1 -- 172.21.15.103:0/3675484755 >> v1:172.21.15.86:6789/0 conn(0x7ff3f8063e30 legacy=0x7ff3f80642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:44.188 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.176+0000 7ff3f77fe700 1 -- 172.21.15.103:0/3675484755 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f805bb50 con 0x7ff3f812c0d0 2020-04-22T14:03:44.188 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.176+0000 7ff3f77fe700 1 -- 172.21.15.103:0/3675484755 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7ff3f0001a50 con 0x7ff3f812c0d0 2020-04-22T14:03:44.189 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.176+0000 7ff3f77fe700 1 -- 172.21.15.103:0/3675484755 >> v1:172.21.15.103:6789/0 conn(0x7ff3f812c0d0 legacy=0x7ff3f805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:44.189 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.176+0000 7ff3f77fe700 1 --2- 172.21.15.103:0/3675484755 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3e4003720 0x7ff3e4003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:44.189 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.176+0000 7ff3f77fe700 1 --2- 172.21.15.103:0/3675484755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3e4004020 0x7ff3e40044f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:44.189 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.176+0000 7ff3f77fe700 1 --2- 172.21.15.103:0/3675484755 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3e4004a60 0x7ff3e4004f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:44.189 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.176+0000 7ff3f77fe700 1 -- 172.21.15.103:0/3675484755 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f8143840 con 0x7ff3e4004a60 2020-04-22T14:03:44.189 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.176+0000 7ff3f77fe700 1 -- 172.21.15.103:0/3675484755 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e400b830 con 0x7ff3e4004020 2020-04-22T14:03:44.190 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.176+0000 7ff3f77fe700 1 -- 172.21.15.103:0/3675484755 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e400b9f0 con 0x7ff3e4003720 2020-04-22T14:03:44.190 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.176+0000 7ff3f7fff700 1 --2- 172.21.15.103:0/3675484755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3e4004020 0x7ff3e40044f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:44.190 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.177+0000 7ff3fce5b700 1 --2- 172.21.15.103:0/3675484755 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3e4003720 0x7ff3e4003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:44.190 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.177+0000 7ff3fd65c700 1 --2- 172.21.15.103:0/3675484755 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3e4004a60 0x7ff3e4004f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:44.190 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.177+0000 7ff3f7fff700 1 -- 172.21.15.103:0/3675484755 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3e4003720 msgr2=0x7ff3e4003b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:44.191 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.177+0000 7ff3f7fff700 1 --2- 172.21.15.103:0/3675484755 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3e4003720 0x7ff3e4003b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:44.191 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.177+0000 7ff3f7fff700 1 -- 172.21.15.103:0/3675484755 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3e4004a60 msgr2=0x7ff3e4004f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:44.191 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.177+0000 7ff3f7fff700 1 --2- 172.21.15.103:0/3675484755 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3e4004a60 0x7ff3e4004f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:44.191 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.177+0000 7ff3f7fff700 1 -- 172.21.15.103:0/3675484755 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e4003230 con 0x7ff3e4004020 2020-04-22T14:03:44.191 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.177+0000 7ff3fd65c700 1 -- 172.21.15.103:0/3675484755 reap_dead start 2020-04-22T14:03:44.192 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.177+0000 7ff3f7fff700 1 --2- 172.21.15.103:0/3675484755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3e4004020 0x7ff3e40044f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff3ec002f30 tx=0x7ff3ec010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.192 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.177+0000 7ff3f7fff700 1 --2- 172.21.15.103:0/3675484755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3e4004020 0x7ff3e40044f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff3ec002f30 tx=0x7ff3ec010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.192 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.177+0000 7ff3f7fff700 1 --2- 172.21.15.103:0/3675484755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3e4004020 0x7ff3e40044f0 secure :-1 s=READY pgs=414 cs=0 l=1 rx=0x7ff3ec002f30 tx=0x7ff3ec010020).ready entity=mon.1 client_cookie=2cc402d63e1d0513 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:44.192 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.177+0000 7ff3f7fff700 1 --2- 172.21.15.103:0/3675484755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3e4004020 0x7ff3e40044f0 secure :-1 s=THROTTLE_DONE pgs=414 cs=0 l=1 rx=0x7ff3ec002f30 tx=0x7ff3ec010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.192 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.177+0000 7ff3f77fe700 1 -- 172.21.15.103:0/3675484755 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3ec008d30 con 0x7ff3e4004020 2020-04-22T14:03:44.192 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.177+0000 7ff3f7fff700 1 --2- 172.21.15.103:0/3675484755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3e4004020 0x7ff3e40044f0 secure :-1 s=THROTTLE_DONE pgs=414 cs=0 l=1 rx=0x7ff3ec002f30 tx=0x7ff3ec010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.193 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.177+0000 7ff3f7fff700 1 --2- 172.21.15.103:0/3675484755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3e4004020 0x7ff3e40044f0 secure :-1 s=THROTTLE_DONE pgs=414 cs=0 l=1 rx=0x7ff3ec002f30 tx=0x7ff3ec010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.193 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.177+0000 7ff3f77fe700 1 -- 172.21.15.103:0/3675484755 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3ec008e90 con 0x7ff3e4004020 2020-04-22T14:03:44.193 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.177+0000 7ff3f77fe700 1 -- 172.21.15.103:0/3675484755 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3ec010a90 con 0x7ff3e4004020 2020-04-22T14:03:44.193 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.177+0000 7ff3ff0bf700 1 -- 172.21.15.103:0/3675484755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3e4004020 msgr2=0x7ff3e40044f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:44.193 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.177+0000 7ff3ff0bf700 1 --2- 172.21.15.103:0/3675484755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3e4004020 0x7ff3e40044f0 secure :-1 s=READY pgs=414 cs=0 l=1 rx=0x7ff3ec002f30 tx=0x7ff3ec010020).stop 2020-04-22T14:03:44.193 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.177+0000 7ff3ff0bf700 1 -- 172.21.15.103:0/3675484755 shutdown_connections 2020-04-22T14:03:44.193 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.177+0000 7ff3ff0bf700 1 --2- 172.21.15.103:0/3675484755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3e4004020 0x7ff3e40044f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:44.194 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.177+0000 7ff3ff0bf700 1 -- 172.21.15.103:0/3675484755 >> 172.21.15.103:0/3675484755 conn(0x7ff3f80b9160 msgr2=0x7ff3f805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:44.194 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.178+0000 7ff3ff0bf700 1 -- 172.21.15.103:0/3675484755 shutdown_connections 2020-04-22T14:03:44.194 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.178+0000 7ff3ff0bf700 1 -- 172.21.15.103:0/3675484755 wait complete. 2020-04-22T14:03:44.194 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.178+0000 7ff3ff0bf700 1 Processor -- start 2020-04-22T14:03:44.194 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.179+0000 7ff3ff0bf700 1 -- start start 2020-04-22T14:03:44.194 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.179+0000 7ff3ff0bf700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff3f8128f50 0x7ff3f80b0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:44.194 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.179+0000 7ff3ff0bf700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3f80b0f70 0x7ff3f80ad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:44.194 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.179+0000 7ff3ff0bf700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3f80ac740 con 0x7ff3e4004020 2020-04-22T14:03:44.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.179+0000 7ff3ff0bf700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3f81293d0 con 0x7ff3f8128f50 2020-04-22T14:03:44.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.179+0000 7ff3ff0bf700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f80ac970 con 0x7ff3f80b0f70 2020-04-22T14:03:44.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.179+0000 7ff3f7fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff3f8128f50 0x7ff3f80b0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:44.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.179+0000 7ff3f7fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff3f8128f50 0x7ff3f80b0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48828/0 (socket says 172.21.15.103:48828) 2020-04-22T14:03:44.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.179+0000 7ff3f7fff700 1 -- 172.21.15.103:0/2080169802 learned_addr learned my addr 172.21.15.103:0/2080169802 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:44.197 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.179+0000 7ff3fd65c700 1 --2- 172.21.15.103:0/2080169802 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3f80b0f70 0x7ff3f80ad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:44.197 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.180+0000 7ff3f7fff700 1 -- 172.21.15.103:0/2080169802 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3f80b0f70 msgr2=0x7ff3f80ad0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:44.197 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.180+0000 7ff3f7fff700 1 --2- 172.21.15.103:0/2080169802 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3f80b0f70 0x7ff3f80ad0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:44.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.180+0000 7ff3f7fff700 1 -- 172.21.15.103:0/2080169802 >> v1:172.21.15.86:6789/0 conn(0x7ff3e4004020 legacy=0x7ff3f80afad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:44.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.180+0000 7ff3f7fff700 1 -- 172.21.15.103:0/2080169802 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f80acc10 con 0x7ff3f8128f50 2020-04-22T14:03:44.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.180+0000 7ff3f7fff700 1 --2- 172.21.15.103:0/2080169802 >> v2:172.21.15.103:3300/0 conn(0x7ff3f8128f50 0x7ff3f80b0b10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff3ec002f30 tx=0x7ff3ec010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.180+0000 7ff3f7fff700 1 --2- 172.21.15.103:0/2080169802 >> v2:172.21.15.103:3300/0 conn(0x7ff3f8128f50 0x7ff3f80b0b10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff3ec002f30 tx=0x7ff3ec010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.180+0000 7ff3f7fff700 1 --2- 172.21.15.103:0/2080169802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3f8128f50 0x7ff3f80b0b10 secure :-1 s=READY pgs=415 cs=0 l=1 rx=0x7ff3ec002f30 tx=0x7ff3ec010020).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:44.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.180+0000 7ff3f7fff700 1 --2- 172.21.15.103:0/2080169802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3f8128f50 0x7ff3f80b0b10 secure :-1 s=THROTTLE_DONE pgs=415 cs=0 l=1 rx=0x7ff3ec002f30 tx=0x7ff3ec010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.180+0000 7ff3f7fff700 1 --2- 172.21.15.103:0/2080169802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3f8128f50 0x7ff3f80b0b10 secure :-1 s=THROTTLE_DONE pgs=415 cs=0 l=1 rx=0x7ff3ec002f30 tx=0x7ff3ec010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.180+0000 7ff3f5ffb700 1 -- 172.21.15.103:0/2080169802 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3ec0058b0 con 0x7ff3f8128f50 2020-04-22T14:03:44.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.180+0000 7ff3f7fff700 1 --2- 172.21.15.103:0/2080169802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3f8128f50 0x7ff3f80b0b10 secure :-1 s=THROTTLE_DONE pgs=415 cs=0 l=1 rx=0x7ff3ec002f30 tx=0x7ff3ec010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.180+0000 7ff3f5ffb700 1 -- 172.21.15.103:0/2080169802 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3ec005a10 con 0x7ff3f8128f50 2020-04-22T14:03:44.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.180+0000 7ff3ff0bf700 1 -- 172.21.15.103:0/2080169802 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3f80b3ac0 con 0x7ff3f8128f50 2020-04-22T14:03:44.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.180+0000 7ff3f5ffb700 1 -- 172.21.15.103:0/2080169802 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3ec005db0 con 0x7ff3f8128f50 2020-04-22T14:03:44.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.180+0000 7ff3ff0bf700 1 -- 172.21.15.103:0/2080169802 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3f80ad510 con 0x7ff3f8128f50 2020-04-22T14:03:44.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.181+0000 7ff3f7fff700 1 --2- 172.21.15.103:0/2080169802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3f8128f50 0x7ff3f80b0b10 secure :-1 s=THROTTLE_DONE pgs=415 cs=0 l=1 rx=0x7ff3ec002f30 tx=0x7ff3ec010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.181+0000 7ff3ff0bf700 1 -- 172.21.15.103:0/2080169802 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3f80b02a0 con 0x7ff3f8128f50 2020-04-22T14:03:44.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.181+0000 7ff3f5ffb700 1 -- 172.21.15.103:0/2080169802 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ff3ec014240 con 0x7ff3f8128f50 2020-04-22T14:03:44.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.181+0000 7ff3f7fff700 1 --2- 172.21.15.103:0/2080169802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3f8128f50 0x7ff3f80b0b10 secure :-1 s=THROTTLE_DONE pgs=415 cs=0 l=1 rx=0x7ff3ec002f30 tx=0x7ff3ec010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.181+0000 7ff3f5ffb700 1 --2- 172.21.15.103:0/2080169802 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff3d804daa0 0x7ff3d804ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:44.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.181+0000 7ff3f5ffb700 1 -- 172.21.15.103:0/2080169802 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff3ec061640 con 0x7ff3f8128f50 2020-04-22T14:03:44.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.181+0000 7ff3fce5b700 1 --2- 172.21.15.103:0/2080169802 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff3d804daa0 0x7ff3d804ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:44.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.182+0000 7ff3fce5b700 1 --2- 172.21.15.103:0/2080169802 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff3d804daa0 0x7ff3d804ff60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff3f8063820 tx=0x7ff3f805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.182+0000 7ff3fce5b700 1 --2- 172.21.15.103:0/2080169802 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff3d804daa0 0x7ff3d804ff60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff3f8063820 tx=0x7ff3f805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.182+0000 7ff3fce5b700 1 --2- 172.21.15.103:0/2080169802 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff3d804daa0 0x7ff3d804ff60 secure :-1 s=READY pgs=170 cs=0 l=1 rx=0x7ff3f8063820 tx=0x7ff3f805bce0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:44.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.185+0000 7ff3f7fff700 1 --2- 172.21.15.103:0/2080169802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3f8128f50 0x7ff3f80b0b10 secure :-1 s=THROTTLE_DONE pgs=415 cs=0 l=1 rx=0x7ff3ec002f30 tx=0x7ff3ec010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.185+0000 7ff3f5ffb700 1 -- 172.21.15.103:0/2080169802 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ff3ec03cae0 con 0x7ff3f8128f50 2020-04-22T14:03:44.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.329+0000 7ff3ff0bf700 1 -- 172.21.15.103:0/2080169802 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3f80acda0 con 0x7ff3f8128f50 2020-04-22T14:03:44.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.330+0000 7ff3f7fff700 1 --2- 172.21.15.103:0/2080169802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3f8128f50 0x7ff3f80b0b10 secure :-1 s=THROTTLE_DONE pgs=415 cs=0 l=1 rx=0x7ff3ec002f30 tx=0x7ff3ec010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.330+0000 7ff3f5ffb700 1 -- 172.21.15.103:0/2080169802 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16089 (secure 0 0 0) 0x7ff3ec040100 con 0x7ff3f8128f50 2020-04-22T14:03:44.334 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:03:44.334 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":35,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:03:40.946120+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:03:37.161048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2020-04-22T14:03:37.878823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:03:44.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.332+0000 7ff3ff0bf700 1 -- 172.21.15.103:0/2080169802 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff3d804daa0 msgr2=0x7ff3d804ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:44.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.332+0000 7ff3ff0bf700 1 --2- 172.21.15.103:0/2080169802 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff3d804daa0 0x7ff3d804ff60 secure :-1 s=READY pgs=170 cs=0 l=1 rx=0x7ff3f8063820 tx=0x7ff3f805bce0).stop 2020-04-22T14:03:44.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.332+0000 7ff3ff0bf700 1 -- 172.21.15.103:0/2080169802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3f8128f50 msgr2=0x7ff3f80b0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:44.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.332+0000 7ff3ff0bf700 1 --2- 172.21.15.103:0/2080169802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3f8128f50 0x7ff3f80b0b10 secure :-1 s=READY pgs=415 cs=0 l=1 rx=0x7ff3ec002f30 tx=0x7ff3ec010020).stop 2020-04-22T14:03:44.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.332+0000 7ff3ff0bf700 1 -- 172.21.15.103:0/2080169802 shutdown_connections 2020-04-22T14:03:44.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.332+0000 7ff3ff0bf700 1 --2- 172.21.15.103:0/2080169802 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff3d804daa0 0x7ff3d804ff60 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:44.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.332+0000 7ff3ff0bf700 1 --2- 172.21.15.103:0/2080169802 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3f80b0f70 0x7ff3f80ad0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:44.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.332+0000 7ff3ff0bf700 1 --2- 172.21.15.103:0/2080169802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3f8128f50 0x7ff3f80b0b10 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:44.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.332+0000 7ff3ff0bf700 1 -- 172.21.15.103:0/2080169802 >> 172.21.15.103:0/2080169802 conn(0x7ff3f80b9160 msgr2=0x7ff3f80b7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:44.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.332+0000 7ff3ff0bf700 1 -- 172.21.15.103:0/2080169802 shutdown_connections 2020-04-22T14:03:44.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.332+0000 7ff3ff0bf700 1 -- 172.21.15.103:0/2080169802 wait complete. 2020-04-22T14:03:44.345 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:03:37.161048+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 5, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'34', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:03:37.878823+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 6, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'35', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:03:44.346 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:44.359 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:03:44.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.506+0000 7fae08284700 1 Processor -- start 2020-04-22T14:03:44.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.506+0000 7fae08284700 1 -- start start 2020-04-22T14:03:44.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.507+0000 7fae08284700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fae00061a30 0x7fae000b4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:44.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.507+0000 7fae08284700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fae00141f20 0x7fae001423b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:44.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.507+0000 7fae08284700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae000af030 con 0x7fae000acb10 2020-04-22T14:03:44.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.507+0000 7fae08284700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae00060250 con 0x7fae00141f20 2020-04-22T14:03:44.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.507+0000 7fae08284700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae000623c0 con 0x7fae00061a30 2020-04-22T14:03:44.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.507+0000 7fae06020700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fae00061a30 0x7fae000b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:44.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.507+0000 7fae06020700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fae00061a30 0x7fae000b4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48832/0 (socket says 172.21.15.103:48832) 2020-04-22T14:03:44.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.507+0000 7fae06020700 1 -- 172.21.15.103:0/1208490116 learned_addr learned my addr 172.21.15.103:0/1208490116 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:44.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.507+0000 7fae06821700 1 --2- 172.21.15.103:0/1208490116 >> v2:172.21.15.86:3300/0 conn(0x7fae00141f20 0x7fae001423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:44.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.507+0000 7fae06020700 1 -- 172.21.15.103:0/1208490116 >> v2:172.21.15.86:3300/0 conn(0x7fae00141f20 msgr2=0x7fae001423b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:44.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.507+0000 7fae06020700 1 --2- 172.21.15.103:0/1208490116 >> v2:172.21.15.86:3300/0 conn(0x7fae00141f20 0x7fae001423b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:44.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.507+0000 7fae06020700 1 -- 172.21.15.103:0/1208490116 >> v1:172.21.15.86:6789/0 conn(0x7fae000acb10 legacy=0x7fae000ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:44.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.507+0000 7fae06020700 1 -- 172.21.15.103:0/1208490116 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae00062660 con 0x7fae00061a30 2020-04-22T14:03:44.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.507+0000 7fae06020700 1 --2- 172.21.15.103:0/1208490116 >> v2:172.21.15.103:3300/0 conn(0x7fae00061a30 0x7fae000b4820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fadf0002f30 tx=0x7fadf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.507+0000 7fae06020700 1 --2- 172.21.15.103:0/1208490116 >> v2:172.21.15.103:3300/0 conn(0x7fae00061a30 0x7fae000b4820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fadf0002f30 tx=0x7fadf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.507+0000 7fae06020700 1 --2- 172.21.15.103:0/1208490116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae00061a30 0x7fae000b4820 secure :-1 s=READY pgs=416 cs=0 l=1 rx=0x7fadf0002f30 tx=0x7fadf0007a40).ready entity=mon.1 client_cookie=4e93a6c6c5072013 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:44.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.507+0000 7fae06020700 1 --2- 172.21.15.103:0/1208490116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae00061a30 0x7fae000b4820 secure :-1 s=THROTTLE_DONE pgs=416 cs=0 l=1 rx=0x7fadf0002f30 tx=0x7fadf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.507+0000 7fae0501e700 1 -- 172.21.15.103:0/1208490116 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadf0011670 con 0x7fae00061a30 2020-04-22T14:03:44.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.507+0000 7fae06020700 1 --2- 172.21.15.103:0/1208490116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae00061a30 0x7fae000b4820 secure :-1 s=THROTTLE_DONE pgs=416 cs=0 l=1 rx=0x7fadf0002f30 tx=0x7fadf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.507+0000 7fae06020700 1 --2- 172.21.15.103:0/1208490116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae00061a30 0x7fae000b4820 secure :-1 s=THROTTLE_DONE pgs=416 cs=0 l=1 rx=0x7fadf0002f30 tx=0x7fadf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.508+0000 7fae0501e700 1 -- 172.21.15.103:0/1208490116 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf00117d0 con 0x7fae00061a30 2020-04-22T14:03:44.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.508+0000 7fae0501e700 1 -- 172.21.15.103:0/1208490116 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadf0011bf0 con 0x7fae00061a30 2020-04-22T14:03:44.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.508+0000 7fae08284700 1 -- 172.21.15.103:0/1208490116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae00061a30 msgr2=0x7fae000b4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:44.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.508+0000 7fae08284700 1 --2- 172.21.15.103:0/1208490116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae00061a30 0x7fae000b4820 secure :-1 s=READY pgs=416 cs=0 l=1 rx=0x7fadf0002f30 tx=0x7fadf0007a40).stop 2020-04-22T14:03:44.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.508+0000 7fae08284700 1 -- 172.21.15.103:0/1208490116 shutdown_connections 2020-04-22T14:03:44.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.508+0000 7fae08284700 1 --2- 172.21.15.103:0/1208490116 >> v2:172.21.15.86:3300/0 conn(0x7fae00141f20 0x7fae001423b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:44.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.508+0000 7fae08284700 1 --2- 172.21.15.103:0/1208490116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae00061a30 0x7fae000b4820 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:44.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.508+0000 7fae08284700 1 -- 172.21.15.103:0/1208490116 >> 172.21.15.103:0/1208490116 conn(0x7fae0005b7b0 msgr2=0x7fae000b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:44.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.508+0000 7fae08284700 1 -- 172.21.15.103:0/1208490116 shutdown_connections 2020-04-22T14:03:44.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.508+0000 7fae08284700 1 -- 172.21.15.103:0/1208490116 wait complete. 2020-04-22T14:03:44.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.509+0000 7fae08284700 1 Processor -- start 2020-04-22T14:03:44.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.509+0000 7fae08284700 1 -- start start 2020-04-22T14:03:44.519 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.510+0000 7fae08284700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fae000acb10 0x7fae00141820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:44.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.510+0000 7fae08284700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fae00141f20 0x7fae000b2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:44.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.510+0000 7fae08284700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae00065ef0 con 0x7fae00061a30 2020-04-22T14:03:44.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.510+0000 7fae08284700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae00066150 con 0x7fae00141f20 2020-04-22T14:03:44.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.510+0000 7fae08284700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae00066590 con 0x7fae000acb10 2020-04-22T14:03:44.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.510+0000 7fae0581f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fae000acb10 0x7fae00141820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:44.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.510+0000 7fae0581f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fae000acb10 0x7fae00141820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48840/0 (socket says 172.21.15.103:48840) 2020-04-22T14:03:44.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.510+0000 7fae0581f700 1 -- 172.21.15.103:0/1962026666 learned_addr learned my addr 172.21.15.103:0/1962026666 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:44.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.510+0000 7fae06821700 1 --2- 172.21.15.103:0/1962026666 >> v2:172.21.15.86:3300/0 conn(0x7fae00141f20 0x7fae000b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:44.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.510+0000 7fae0581f700 1 -- 172.21.15.103:0/1962026666 >> v2:172.21.15.86:3300/0 conn(0x7fae00141f20 msgr2=0x7fae000b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:44.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.510+0000 7fae0581f700 1 --2- 172.21.15.103:0/1962026666 >> v2:172.21.15.86:3300/0 conn(0x7fae00141f20 0x7fae000b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:44.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.510+0000 7fae0581f700 1 -- 172.21.15.103:0/1962026666 >> v1:172.21.15.86:6789/0 conn(0x7fae00061a30 legacy=0x7fae00141110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:44.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.510+0000 7fae0581f700 1 -- 172.21.15.103:0/1962026666 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae00066830 con 0x7fae000acb10 2020-04-22T14:03:44.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.510+0000 7fae0581f700 1 --2- 172.21.15.103:0/1962026666 >> v2:172.21.15.103:3300/0 conn(0x7fae000acb10 0x7fae00141820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fae00064310 tx=0x7fadfc010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.510+0000 7fae0581f700 1 --2- 172.21.15.103:0/1962026666 >> v2:172.21.15.103:3300/0 conn(0x7fae000acb10 0x7fae00141820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fae00064310 tx=0x7fadfc010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.510+0000 7fae0581f700 1 --2- 172.21.15.103:0/1962026666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae000acb10 0x7fae00141820 secure :-1 s=READY pgs=417 cs=0 l=1 rx=0x7fae00064310 tx=0x7fadfc010a70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:44.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.510+0000 7fae0581f700 1 --2- 172.21.15.103:0/1962026666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae000acb10 0x7fae00141820 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7fae00064310 tx=0x7fadfc010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.510+0000 7fadef7fe700 1 -- 172.21.15.103:0/1962026666 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadfc001ea0 con 0x7fae000acb10 2020-04-22T14:03:44.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.510+0000 7fae0581f700 1 --2- 172.21.15.103:0/1962026666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae000acb10 0x7fae00141820 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7fae00064310 tx=0x7fadfc010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.510+0000 7fae0581f700 1 --2- 172.21.15.103:0/1962026666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae000acb10 0x7fae00141820 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7fae00064310 tx=0x7fadfc010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.510+0000 7fadef7fe700 1 -- 172.21.15.103:0/1962026666 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadfc00cbf0 con 0x7fae000acb10 2020-04-22T14:03:44.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.510+0000 7fae08284700 1 -- 172.21.15.103:0/1962026666 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae001383a0 con 0x7fae000acb10 2020-04-22T14:03:44.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.510+0000 7fadef7fe700 1 -- 172.21.15.103:0/1962026666 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadfc00ce20 con 0x7fae000acb10 2020-04-22T14:03:44.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.510+0000 7fae08284700 1 -- 172.21.15.103:0/1962026666 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae000b0f90 con 0x7fae000acb10 2020-04-22T14:03:44.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.511+0000 7fae0581f700 1 --2- 172.21.15.103:0/1962026666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae000acb10 0x7fae00141820 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7fae00064310 tx=0x7fadfc010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.511+0000 7fadef7fe700 1 -- 172.21.15.103:0/1962026666 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fadfc0064e0 con 0x7fae000acb10 2020-04-22T14:03:44.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.511+0000 7fae0581f700 1 --2- 172.21.15.103:0/1962026666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae000acb10 0x7fae00141820 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7fae00064310 tx=0x7fadfc010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.511+0000 7fae08284700 1 -- 172.21.15.103:0/1962026666 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae00056c90 con 0x7fae000acb10 2020-04-22T14:03:44.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.512+0000 7fadef7fe700 1 --2- 172.21.15.103:0/1962026666 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fade004d9c0 0x7fade004fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:44.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.512+0000 7fadef7fe700 1 -- 172.21.15.103:0/1962026666 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fadfc060eb0 con 0x7fae000acb10 2020-04-22T14:03:44.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.512+0000 7fae06020700 1 --2- 172.21.15.103:0/1962026666 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fade004d9c0 0x7fade004fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:44.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.512+0000 7fae06020700 1 --2- 172.21.15.103:0/1962026666 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fade004d9c0 0x7fade004fe80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fadf0002f30 tx=0x7fadf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.512+0000 7fae06020700 1 --2- 172.21.15.103:0/1962026666 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fade004d9c0 0x7fade004fe80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fadf0002f30 tx=0x7fadf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.512+0000 7fae06020700 1 --2- 172.21.15.103:0/1962026666 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fade004d9c0 0x7fade004fe80 secure :-1 s=READY pgs=171 cs=0 l=1 rx=0x7fadf0002f30 tx=0x7fadf0007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:44.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.516+0000 7fae0581f700 1 --2- 172.21.15.103:0/1962026666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae000acb10 0x7fae00141820 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7fae00064310 tx=0x7fadfc010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.516+0000 7fadef7fe700 1 -- 172.21.15.103:0/1962026666 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fadfc03c290 con 0x7fae000acb10 2020-04-22T14:03:44.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.659+0000 7fae08284700 1 -- 172.21.15.103:0/1962026666 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fae0006a960 con 0x7fae000acb10 2020-04-22T14:03:44.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.659+0000 7fae0581f700 1 --2- 172.21.15.103:0/1962026666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae000acb10 0x7fae00141820 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7fae00064310 tx=0x7fadfc010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.659+0000 7fadef7fe700 1 -- 172.21.15.103:0/1962026666 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v35) v1 ==== 110+0+10 (secure 0 0 0) 0x7fadfc03f8b0 con 0x7fae000acb10 2020-04-22T14:03:44.663 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:03:44.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.661+0000 7fae08284700 1 -- 172.21.15.103:0/1962026666 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fade004d9c0 msgr2=0x7fade004fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:44.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.661+0000 7fae08284700 1 --2- 172.21.15.103:0/1962026666 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fade004d9c0 0x7fade004fe80 secure :-1 s=READY pgs=171 cs=0 l=1 rx=0x7fadf0002f30 tx=0x7fadf0007a40).stop 2020-04-22T14:03:44.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.661+0000 7fae08284700 1 -- 172.21.15.103:0/1962026666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae000acb10 msgr2=0x7fae00141820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:44.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.661+0000 7fae08284700 1 --2- 172.21.15.103:0/1962026666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae000acb10 0x7fae00141820 secure :-1 s=READY pgs=417 cs=0 l=1 rx=0x7fae00064310 tx=0x7fadfc010a70).stop 2020-04-22T14:03:44.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.661+0000 7fae08284700 1 -- 172.21.15.103:0/1962026666 shutdown_connections 2020-04-22T14:03:44.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.661+0000 7fae08284700 1 --2- 172.21.15.103:0/1962026666 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fade004d9c0 0x7fade004fe80 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:44.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.661+0000 7fae08284700 1 --2- 172.21.15.103:0/1962026666 >> v2:172.21.15.86:3300/0 conn(0x7fae00141f20 0x7fae000b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:44.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.661+0000 7fae08284700 1 --2- 172.21.15.103:0/1962026666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae000acb10 0x7fae00141820 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:44.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.661+0000 7fae08284700 1 -- 172.21.15.103:0/1962026666 >> 172.21.15.103:0/1962026666 conn(0x7fae0005b7b0 msgr2=0x7fae000b7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:44.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.661+0000 7fae08284700 1 -- 172.21.15.103:0/1962026666 shutdown_connections 2020-04-22T14:03:44.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.661+0000 7fae08284700 1 -- 172.21.15.103:0/1962026666 wait complete. 2020-04-22T14:03:44.674 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:44.688 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:03:44.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.833+0000 7f0f8ab7b700 1 Processor -- start 2020-04-22T14:03:44.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.833+0000 7f0f8ab7b700 1 -- start start 2020-04-22T14:03:44.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.834+0000 7f0f8ab7b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0f840b4820 0x7f0f840acb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:44.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.834+0000 7f0f8ab7b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f84141f20 0x7f0f84142380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:44.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.834+0000 7f0f8ab7b700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f840af030 con 0x7f0f84061a30 2020-04-22T14:03:44.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.834+0000 7f0f8ab7b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f84060250 con 0x7f0f840b4820 2020-04-22T14:03:44.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.834+0000 7f0f8ab7b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f840623c0 con 0x7f0f84141f20 2020-04-22T14:03:44.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.834+0000 7f0f88917700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f0f84061a30 0x7f0f840ae920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41036/0 (socket says 172.21.15.103:41036) 2020-04-22T14:03:44.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.834+0000 7f0f88917700 1 -- 172.21.15.103:0/2463238231 learned_addr learned my addr 172.21.15.103:0/2463238231 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:44.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.834+0000 7f0f89118700 1 --2- 172.21.15.103:0/2463238231 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f84141f20 0x7f0f84142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:44.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.834+0000 7f0f83fff700 1 --2- 172.21.15.103:0/2463238231 >> v2:172.21.15.86:3300/0 conn(0x7f0f840b4820 0x7f0f840acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:44.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.834+0000 7f0f837fe700 1 -- 172.21.15.103:0/2463238231 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1030116620 0 0) 0x7f0f840af030 con 0x7f0f84061a30 2020-04-22T14:03:44.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.834+0000 7f0f837fe700 1 -- 172.21.15.103:0/2463238231 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f70003230 con 0x7f0f84061a30 2020-04-22T14:03:44.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.835+0000 7f0f837fe700 1 -- 172.21.15.103:0/2463238231 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2524141347 0 0) 0x7f0f70003230 con 0x7f0f84061a30 2020-04-22T14:03:44.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.835+0000 7f0f837fe700 1 -- 172.21.15.103:0/2463238231 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f84141f20 msgr2=0x7f0f84142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:44.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.835+0000 7f0f837fe700 1 --2- 172.21.15.103:0/2463238231 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f84141f20 0x7f0f84142380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:44.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.835+0000 7f0f837fe700 1 -- 172.21.15.103:0/2463238231 >> v2:172.21.15.86:3300/0 conn(0x7f0f840b4820 msgr2=0x7f0f840acb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:44.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.835+0000 7f0f837fe700 1 --2- 172.21.15.103:0/2463238231 >> v2:172.21.15.86:3300/0 conn(0x7f0f840b4820 0x7f0f840acb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:44.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.835+0000 7f0f837fe700 1 -- 172.21.15.103:0/2463238231 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f84062660 con 0x7f0f84061a30 2020-04-22T14:03:44.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.835+0000 7f0f837fe700 1 -- 172.21.15.103:0/2463238231 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f0f740016d0 con 0x7f0f84061a30 2020-04-22T14:03:44.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.835+0000 7f0f837fe700 1 -- 172.21.15.103:0/2463238231 >> v1:172.21.15.103:6789/0 conn(0x7f0f84061a30 legacy=0x7f0f840ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:44.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.835+0000 7f0f837fe700 1 --2- 172.21.15.103:0/2463238231 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f84141f20 0x7f0f70003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:44.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.835+0000 7f0f837fe700 1 --2- 172.21.15.103:0/2463238231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f70003b80 0x7f0f70004000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:44.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.835+0000 7f0f837fe700 1 --2- 172.21.15.103:0/2463238231 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f700045c0 0x7f0f70004a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:44.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.835+0000 7f0f837fe700 1 -- 172.21.15.103:0/2463238231 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f84060250 con 0x7f0f700045c0 2020-04-22T14:03:44.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.835+0000 7f0f837fe700 1 -- 172.21.15.103:0/2463238231 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f840623c0 con 0x7f0f70003b80 2020-04-22T14:03:44.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.835+0000 7f0f837fe700 1 -- 172.21.15.103:0/2463238231 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f70005070 con 0x7f0f84141f20 2020-04-22T14:03:44.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.835+0000 7f0f83fff700 1 --2- 172.21.15.103:0/2463238231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f70003b80 0x7f0f70004000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:44.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.835+0000 7f0f88917700 1 --2- 172.21.15.103:0/2463238231 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f84141f20 0x7f0f70003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:44.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.835+0000 7f0f89118700 1 --2- 172.21.15.103:0/2463238231 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f700045c0 0x7f0f70004a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:44.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.835+0000 7f0f83fff700 1 -- 172.21.15.103:0/2463238231 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f84141f20 msgr2=0x7f0f70003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:44.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.835+0000 7f0f83fff700 1 --2- 172.21.15.103:0/2463238231 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f84141f20 0x7f0f70003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:44.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.835+0000 7f0f83fff700 1 -- 172.21.15.103:0/2463238231 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f700045c0 msgr2=0x7f0f70004a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:44.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.835+0000 7f0f83fff700 1 --2- 172.21.15.103:0/2463238231 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f700045c0 0x7f0f70004a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:44.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.835+0000 7f0f83fff700 1 -- 172.21.15.103:0/2463238231 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f70003230 con 0x7f0f70003b80 2020-04-22T14:03:44.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.835+0000 7f0f89118700 1 --2- 172.21.15.103:0/2463238231 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f700045c0 0x7f0f70004a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:03:44.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.835+0000 7f0f83fff700 1 --2- 172.21.15.103:0/2463238231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f70003b80 0x7f0f70004000 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0f78008910 tx=0x7f0f78010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.835+0000 7f0f83fff700 1 --2- 172.21.15.103:0/2463238231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f70003b80 0x7f0f70004000 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0f78008910 tx=0x7f0f78010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.835+0000 7f0f83fff700 1 --2- 172.21.15.103:0/2463238231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f70003b80 0x7f0f70004000 secure :-1 s=READY pgs=419 cs=0 l=1 rx=0x7f0f78008910 tx=0x7f0f78010050).ready entity=mon.1 client_cookie=bbd3e4b4394b4788 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:44.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.835+0000 7f0f83fff700 1 --2- 172.21.15.103:0/2463238231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f70003b80 0x7f0f70004000 secure :-1 s=THROTTLE_DONE pgs=419 cs=0 l=1 rx=0x7f0f78008910 tx=0x7f0f78010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.835+0000 7f0f837fe700 1 -- 172.21.15.103:0/2463238231 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f78008df0 con 0x7f0f70003b80 2020-04-22T14:03:44.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.835+0000 7f0f83fff700 1 --2- 172.21.15.103:0/2463238231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f70003b80 0x7f0f70004000 secure :-1 s=THROTTLE_DONE pgs=419 cs=0 l=1 rx=0x7f0f78008910 tx=0x7f0f78010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.835+0000 7f0f837fe700 1 -- 172.21.15.103:0/2463238231 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f78010940 con 0x7f0f70003b80 2020-04-22T14:03:44.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.835+0000 7f0f83fff700 1 --2- 172.21.15.103:0/2463238231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f70003b80 0x7f0f70004000 secure :-1 s=THROTTLE_DONE pgs=419 cs=0 l=1 rx=0x7f0f78008910 tx=0x7f0f78010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.835+0000 7f0f8ab7b700 1 -- 172.21.15.103:0/2463238231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f70003b80 msgr2=0x7f0f70004000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:44.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.835+0000 7f0f837fe700 1 -- 172.21.15.103:0/2463238231 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f78010ca0 con 0x7f0f70003b80 2020-04-22T14:03:44.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.835+0000 7f0f8ab7b700 1 --2- 172.21.15.103:0/2463238231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f70003b80 0x7f0f70004000 secure :-1 s=READY pgs=419 cs=0 l=1 rx=0x7f0f78008910 tx=0x7f0f78010050).stop 2020-04-22T14:03:44.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.835+0000 7f0f89118700 1 -- 172.21.15.103:0/2463238231 reap_dead start 2020-04-22T14:03:44.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.836+0000 7f0f8ab7b700 1 -- 172.21.15.103:0/2463238231 shutdown_connections 2020-04-22T14:03:44.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.836+0000 7f0f8ab7b700 1 -- 172.21.15.103:0/2463238231 >> 172.21.15.103:0/2463238231 conn(0x7f0f8405b7b0 msgr2=0x7f0f840b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:44.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.836+0000 7f0f8ab7b700 1 -- 172.21.15.103:0/2463238231 shutdown_connections 2020-04-22T14:03:44.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.836+0000 7f0f8ab7b700 1 -- 172.21.15.103:0/2463238231 wait complete. 2020-04-22T14:03:44.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.837+0000 7f0f8ab7b700 1 Processor -- start 2020-04-22T14:03:44.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.837+0000 7f0f8ab7b700 1 -- start start 2020-04-22T14:03:44.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.838+0000 7f0f8ab7b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0f840b7890 0x7f0f8413b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:44.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.838+0000 7f0f8ab7b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0f84143870 0x7f0f84143ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:44.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.838+0000 7f0f8ab7b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f841416e0 con 0x7f0f84141240 2020-04-22T14:03:44.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.838+0000 7f0f8ab7b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f84143480 con 0x7f0f840b7890 2020-04-22T14:03:44.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.838+0000 7f0f8ab7b700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f84141980 con 0x7f0f84143870 2020-04-22T14:03:44.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.838+0000 7f0f89118700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0f84143870 0x7f0f84143ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:44.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.838+0000 7f0f89118700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0f84143870 0x7f0f84143ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48860/0 (socket says 172.21.15.103:48860) 2020-04-22T14:03:44.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.838+0000 7f0f89118700 1 -- 172.21.15.103:0/1287210669 learned_addr learned my addr 172.21.15.103:0/1287210669 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:44.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.838+0000 7f0f88917700 1 --2- 172.21.15.103:0/1287210669 >> v2:172.21.15.86:3300/0 conn(0x7f0f840b7890 0x7f0f8413b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:44.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.838+0000 7f0f89118700 1 -- 172.21.15.103:0/1287210669 >> v2:172.21.15.86:3300/0 conn(0x7f0f840b7890 msgr2=0x7f0f8413b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:44.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.838+0000 7f0f89118700 1 --2- 172.21.15.103:0/1287210669 >> v2:172.21.15.86:3300/0 conn(0x7f0f840b7890 0x7f0f8413b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:44.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.838+0000 7f0f89118700 1 -- 172.21.15.103:0/1287210669 >> v1:172.21.15.86:6789/0 conn(0x7f0f84141240 legacy=0x7f0f84065840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:44.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.838+0000 7f0f89118700 1 -- 172.21.15.103:0/1287210669 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f840b7c70 con 0x7f0f84143870 2020-04-22T14:03:44.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.838+0000 7f0f89118700 1 --2- 172.21.15.103:0/1287210669 >> v2:172.21.15.103:3300/0 conn(0x7f0f84143870 0x7f0f84143ce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0f740010d0 tx=0x7f0f7c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.838+0000 7f0f89118700 1 --2- 172.21.15.103:0/1287210669 >> v2:172.21.15.103:3300/0 conn(0x7f0f84143870 0x7f0f84143ce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0f740010d0 tx=0x7f0f7c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.838+0000 7f0f89118700 1 --2- 172.21.15.103:0/1287210669 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f84143870 0x7f0f84143ce0 secure :-1 s=READY pgs=420 cs=0 l=1 rx=0x7f0f740010d0 tx=0x7f0f7c010a90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:44.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.838+0000 7f0f89118700 1 --2- 172.21.15.103:0/1287210669 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f84143870 0x7f0f84143ce0 secure :-1 s=THROTTLE_DONE pgs=420 cs=0 l=1 rx=0x7f0f740010d0 tx=0x7f0f7c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.838+0000 7f0f81ffb700 1 -- 172.21.15.103:0/1287210669 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f7c008800 con 0x7f0f84143870 2020-04-22T14:03:44.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.838+0000 7f0f89118700 1 --2- 172.21.15.103:0/1287210669 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f84143870 0x7f0f84143ce0 secure :-1 s=THROTTLE_DONE pgs=420 cs=0 l=1 rx=0x7f0f740010d0 tx=0x7f0f7c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.838+0000 7f0f89118700 1 --2- 172.21.15.103:0/1287210669 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f84143870 0x7f0f84143ce0 secure :-1 s=THROTTLE_DONE pgs=420 cs=0 l=1 rx=0x7f0f740010d0 tx=0x7f0f7c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.838+0000 7f0f81ffb700 1 -- 172.21.15.103:0/1287210669 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7c008960 con 0x7f0f84143870 2020-04-22T14:03:44.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.838+0000 7f0f81ffb700 1 -- 172.21.15.103:0/1287210669 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f7c008cc0 con 0x7f0f84143870 2020-04-22T14:03:44.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.838+0000 7f0f8ab7b700 1 -- 172.21.15.103:0/1287210669 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f84064360 con 0x7f0f84143870 2020-04-22T14:03:44.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.838+0000 7f0f8ab7b700 1 -- 172.21.15.103:0/1287210669 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f84144380 con 0x7f0f84143870 2020-04-22T14:03:44.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.839+0000 7f0f89118700 1 --2- 172.21.15.103:0/1287210669 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f84143870 0x7f0f84143ce0 secure :-1 s=THROTTLE_DONE pgs=420 cs=0 l=1 rx=0x7f0f740010d0 tx=0x7f0f7c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.839+0000 7f0f89118700 1 --2- 172.21.15.103:0/1287210669 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f84143870 0x7f0f84143ce0 secure :-1 s=THROTTLE_DONE pgs=420 cs=0 l=1 rx=0x7f0f740010d0 tx=0x7f0f7c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.839+0000 7f0f81ffb700 1 -- 172.21.15.103:0/1287210669 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f0f7c00c430 con 0x7f0f84143870 2020-04-22T14:03:44.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.839+0000 7f0f8ab7b700 1 -- 172.21.15.103:0/1287210669 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f84056c90 con 0x7f0f84143870 2020-04-22T14:03:44.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.840+0000 7f0f81ffb700 1 --2- 172.21.15.103:0/1287210669 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0f6404d900 0x7f0f6404fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:44.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.840+0000 7f0f81ffb700 1 -- 172.21.15.103:0/1287210669 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0f7c060ba0 con 0x7f0f84143870 2020-04-22T14:03:44.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.840+0000 7f0f88917700 1 --2- 172.21.15.103:0/1287210669 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0f6404d900 0x7f0f6404fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:44.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.840+0000 7f0f88917700 1 --2- 172.21.15.103:0/1287210669 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0f6404d900 0x7f0f6404fdc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0f740013e0 tx=0x7f0f84067710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.840+0000 7f0f88917700 1 --2- 172.21.15.103:0/1287210669 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0f6404d900 0x7f0f6404fdc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0f740013e0 tx=0x7f0f84067710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.840+0000 7f0f88917700 1 --2- 172.21.15.103:0/1287210669 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0f6404d900 0x7f0f6404fdc0 secure :-1 s=READY pgs=172 cs=0 l=1 rx=0x7f0f740013e0 tx=0x7f0f84067710).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:44.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.844+0000 7f0f89118700 1 --2- 172.21.15.103:0/1287210669 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f84143870 0x7f0f84143ce0 secure :-1 s=THROTTLE_DONE pgs=420 cs=0 l=1 rx=0x7f0f740010d0 tx=0x7f0f7c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.844+0000 7f0f81ffb700 1 -- 172.21.15.103:0/1287210669 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f0f7c03bee0 con 0x7f0f84143870 2020-04-22T14:03:44.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.984+0000 7f0f8ab7b700 1 -- 172.21.15.103:0/1287210669 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0f84145640 con 0x7f0f84143870 2020-04-22T14:03:44.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.985+0000 7f0f89118700 1 --2- 172.21.15.103:0/1287210669 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f84143870 0x7f0f84143ce0 secure :-1 s=THROTTLE_DONE pgs=420 cs=0 l=1 rx=0x7f0f740010d0 tx=0x7f0f7c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:44.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.985+0000 7f0f81ffb700 1 -- 172.21.15.103:0/1287210669 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v35) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0f7c03f500 con 0x7f0f84143870 2020-04-22T14:03:44.988 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:03:44.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.986+0000 7f0f8ab7b700 1 -- 172.21.15.103:0/1287210669 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0f6404d900 msgr2=0x7f0f6404fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:44.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.986+0000 7f0f8ab7b700 1 --2- 172.21.15.103:0/1287210669 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0f6404d900 0x7f0f6404fdc0 secure :-1 s=READY pgs=172 cs=0 l=1 rx=0x7f0f740013e0 tx=0x7f0f84067710).stop 2020-04-22T14:03:44.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.986+0000 7f0f8ab7b700 1 -- 172.21.15.103:0/1287210669 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f84143870 msgr2=0x7f0f84143ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:44.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.986+0000 7f0f8ab7b700 1 --2- 172.21.15.103:0/1287210669 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f84143870 0x7f0f84143ce0 secure :-1 s=READY pgs=420 cs=0 l=1 rx=0x7f0f740010d0 tx=0x7f0f7c010a90).stop 2020-04-22T14:03:44.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.986+0000 7f0f8ab7b700 1 -- 172.21.15.103:0/1287210669 shutdown_connections 2020-04-22T14:03:44.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.986+0000 7f0f8ab7b700 1 --2- 172.21.15.103:0/1287210669 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f84143870 0x7f0f84143ce0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:44.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.986+0000 7f0f8ab7b700 1 --2- 172.21.15.103:0/1287210669 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0f6404d900 0x7f0f6404fdc0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:44.991 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.986+0000 7f0f8ab7b700 1 --2- 172.21.15.103:0/1287210669 >> v2:172.21.15.86:3300/0 conn(0x7f0f840b7890 0x7f0f8413b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:44.991 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.986+0000 7f0f8ab7b700 1 -- 172.21.15.103:0/1287210669 >> 172.21.15.103:0/1287210669 conn(0x7f0f8405b7b0 msgr2=0x7f0f840b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:44.991 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.986+0000 7f0f8ab7b700 1 -- 172.21.15.103:0/1287210669 shutdown_connections 2020-04-22T14:03:44.991 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:44.986+0000 7f0f8ab7b700 1 -- 172.21.15.103:0/1287210669 wait complete. 2020-04-22T14:03:44.999 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:45.012 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-22T14:03:45.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.158+0000 7f46d5f0a700 1 Processor -- start 2020-04-22T14:03:45.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.158+0000 7f46d5f0a700 1 -- start start 2020-04-22T14:03:45.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.159+0000 7f46d5f0a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f46d00b9140 0x7f46d012b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:45.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.159+0000 7f46d5f0a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f46d00ac950 0x7f46d012b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:45.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.159+0000 7f46d5f0a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46d01467e0 con 0x7f46d0146c40 2020-04-22T14:03:45.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.159+0000 7f46d5f0a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46d00602f0 con 0x7f46d00ac950 2020-04-22T14:03:45.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.159+0000 7f46d5f0a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46d0060050 con 0x7f46d00b9140 2020-04-22T14:03:45.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.159+0000 7f46ceffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f46d00ac950 0x7f46d012b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:45.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.159+0000 7f46ceffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f46d00ac950 0x7f46d012b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48864/0 (socket says 172.21.15.103:48864) 2020-04-22T14:03:45.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.159+0000 7f46ceffd700 1 -- 172.21.15.103:0/1899580921 learned_addr learned my addr 172.21.15.103:0/1899580921 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:45.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.159+0000 7f46cf7fe700 1 --2- 172.21.15.103:0/1899580921 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f46d00b9140 0x7f46d012b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:45.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.159+0000 7f46ceffd700 1 -- 172.21.15.103:0/1899580921 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f46d00b9140 msgr2=0x7f46d012b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:45.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.159+0000 7f46ceffd700 1 --2- 172.21.15.103:0/1899580921 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f46d00b9140 0x7f46d012b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:45.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.159+0000 7f46ceffd700 1 -- 172.21.15.103:0/1899580921 >> v1:172.21.15.86:6789/0 conn(0x7f46d0146c40 legacy=0x7f46d0143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:45.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.159+0000 7f46ceffd700 1 -- 172.21.15.103:0/1899580921 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d00b9520 con 0x7f46d00ac950 2020-04-22T14:03:45.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.160+0000 7f46ceffd700 1 --2- 172.21.15.103:0/1899580921 >> v2:172.21.15.103:3300/0 conn(0x7f46d00ac950 0x7f46d012b670 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f46c4002f30 tx=0x7f46c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.160+0000 7f46ceffd700 1 --2- 172.21.15.103:0/1899580921 >> v2:172.21.15.103:3300/0 conn(0x7f46d00ac950 0x7f46d012b670 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f46c4002f30 tx=0x7f46c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.160+0000 7f46ceffd700 1 --2- 172.21.15.103:0/1899580921 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46d00ac950 0x7f46d012b670 secure :-1 s=READY pgs=421 cs=0 l=1 rx=0x7f46c4002f30 tx=0x7f46c4007a40).ready entity=mon.1 client_cookie=79a39613df1762cc server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:45.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.160+0000 7f46ceffd700 1 --2- 172.21.15.103:0/1899580921 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46d00ac950 0x7f46d012b670 secure :-1 s=THROTTLE_DONE pgs=421 cs=0 l=1 rx=0x7f46c4002f30 tx=0x7f46c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.160+0000 7f46ce7fc700 1 -- 172.21.15.103:0/1899580921 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46c4011670 con 0x7f46d00ac950 2020-04-22T14:03:45.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.160+0000 7f46ceffd700 1 --2- 172.21.15.103:0/1899580921 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46d00ac950 0x7f46d012b670 secure :-1 s=THROTTLE_DONE pgs=421 cs=0 l=1 rx=0x7f46c4002f30 tx=0x7f46c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.160+0000 7f46ceffd700 1 --2- 172.21.15.103:0/1899580921 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46d00ac950 0x7f46d012b670 secure :-1 s=THROTTLE_DONE pgs=421 cs=0 l=1 rx=0x7f46c4002f30 tx=0x7f46c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.160+0000 7f46ce7fc700 1 -- 172.21.15.103:0/1899580921 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46c4011810 con 0x7f46d00ac950 2020-04-22T14:03:45.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.160+0000 7f46ce7fc700 1 -- 172.21.15.103:0/1899580921 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46c4011c30 con 0x7f46d00ac950 2020-04-22T14:03:45.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.160+0000 7f46d5f0a700 1 -- 172.21.15.103:0/1899580921 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46d00ac950 msgr2=0x7f46d012b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:45.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.160+0000 7f46d5f0a700 1 --2- 172.21.15.103:0/1899580921 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46d00ac950 0x7f46d012b670 secure :-1 s=READY pgs=421 cs=0 l=1 rx=0x7f46c4002f30 tx=0x7f46c4007a40).stop 2020-04-22T14:03:45.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.160+0000 7f46d5f0a700 1 -- 172.21.15.103:0/1899580921 shutdown_connections 2020-04-22T14:03:45.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.160+0000 7f46d5f0a700 1 --2- 172.21.15.103:0/1899580921 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f46d00b9140 0x7f46d012b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:45.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.160+0000 7f46d5f0a700 1 --2- 172.21.15.103:0/1899580921 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46d00ac950 0x7f46d012b670 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:45.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.160+0000 7f46d5f0a700 1 -- 172.21.15.103:0/1899580921 >> 172.21.15.103:0/1899580921 conn(0x7f46d005b7b0 msgr2=0x7f46d00b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:45.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.160+0000 7f46d5f0a700 1 -- 172.21.15.103:0/1899580921 shutdown_connections 2020-04-22T14:03:45.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.160+0000 7f46d5f0a700 1 -- 172.21.15.103:0/1899580921 wait complete. 2020-04-22T14:03:45.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.161+0000 7f46d5f0a700 1 Processor -- start 2020-04-22T14:03:45.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.161+0000 7f46d5f0a700 1 -- start start 2020-04-22T14:03:45.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.162+0000 7f46d5f0a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f46d00ac950 0x7f46d0141570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:45.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.162+0000 7f46d5f0a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f46d00b9140 0x7f46d012a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:45.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.162+0000 7f46d5f0a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f46d0146c40 0x7f46d0151870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:45.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.162+0000 7f46d5f0a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46d00b5000 con 0x7f46d0146c40 2020-04-22T14:03:45.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.162+0000 7f46d5f0a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46d012a6f0 con 0x7f46d00b9140 2020-04-22T14:03:45.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.162+0000 7f46d5f0a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46d00b2710 con 0x7f46d00ac950 2020-04-22T14:03:45.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.162+0000 7f46ceffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f46d00b9140 0x7f46d012a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:45.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.162+0000 7f46ceffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f46d00b9140 0x7f46d012a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48870/0 (socket says 172.21.15.103:48870) 2020-04-22T14:03:45.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.162+0000 7f46ceffd700 1 -- 172.21.15.103:0/3169743183 learned_addr learned my addr 172.21.15.103:0/3169743183 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:45.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.162+0000 7f46cf7fe700 1 --2- 172.21.15.103:0/3169743183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f46d00ac950 0x7f46d0141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:45.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.163+0000 7f46cffff700 1 --2- 172.21.15.103:0/3169743183 >> v2:172.21.15.86:3300/0 conn(0x7f46d0146c40 0x7f46d0151870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:45.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.163+0000 7f46ceffd700 1 -- 172.21.15.103:0/3169743183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f46d00ac950 msgr2=0x7f46d0141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:45.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.163+0000 7f46ceffd700 1 --2- 172.21.15.103:0/3169743183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f46d00ac950 0x7f46d0141570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:45.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.163+0000 7f46ceffd700 1 -- 172.21.15.103:0/3169743183 >> v2:172.21.15.86:3300/0 conn(0x7f46d0146c40 msgr2=0x7f46d0151870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:45.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.163+0000 7f46ceffd700 1 --2- 172.21.15.103:0/3169743183 >> v2:172.21.15.86:3300/0 conn(0x7f46d0146c40 0x7f46d0151870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:45.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.163+0000 7f46ceffd700 1 -- 172.21.15.103:0/3169743183 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d01406b0 con 0x7f46d00b9140 2020-04-22T14:03:45.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.163+0000 7f46cf7fe700 1 --2- 172.21.15.103:0/3169743183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f46d00ac950 0x7f46d0141570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:03:45.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.163+0000 7f46cffff700 1 --2- 172.21.15.103:0/3169743183 >> v2:172.21.15.86:3300/0 conn(0x7f46d0146c40 0x7f46d0151870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:03:45.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.163+0000 7f46ceffd700 1 --2- 172.21.15.103:0/3169743183 >> v2:172.21.15.103:3300/0 conn(0x7f46d00b9140 0x7f46d012a290 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f46c4002f30 tx=0x7f46c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.163+0000 7f46ceffd700 1 --2- 172.21.15.103:0/3169743183 >> v2:172.21.15.103:3300/0 conn(0x7f46d00b9140 0x7f46d012a290 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f46c4002f30 tx=0x7f46c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.163+0000 7f46ceffd700 1 --2- 172.21.15.103:0/3169743183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46d00b9140 0x7f46d012a290 secure :-1 s=READY pgs=422 cs=0 l=1 rx=0x7f46c4002f30 tx=0x7f46c4007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:45.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.163+0000 7f46ceffd700 1 --2- 172.21.15.103:0/3169743183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46d00b9140 0x7f46d012a290 secure :-1 s=THROTTLE_DONE pgs=422 cs=0 l=1 rx=0x7f46c4002f30 tx=0x7f46c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.163+0000 7f46ccff9700 1 -- 172.21.15.103:0/3169743183 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46c4010210 con 0x7f46d00b9140 2020-04-22T14:03:45.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.163+0000 7f46ceffd700 1 --2- 172.21.15.103:0/3169743183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46d00b9140 0x7f46d012a290 secure :-1 s=THROTTLE_DONE pgs=422 cs=0 l=1 rx=0x7f46c4002f30 tx=0x7f46c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.163+0000 7f46ceffd700 1 --2- 172.21.15.103:0/3169743183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46d00b9140 0x7f46d012a290 secure :-1 s=THROTTLE_DONE pgs=422 cs=0 l=1 rx=0x7f46c4002f30 tx=0x7f46c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.163+0000 7f46ccff9700 1 -- 172.21.15.103:0/3169743183 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46c4007360 con 0x7f46d00b9140 2020-04-22T14:03:45.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.163+0000 7f46ccff9700 1 -- 172.21.15.103:0/3169743183 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46c40056c0 con 0x7f46d00b9140 2020-04-22T14:03:45.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.163+0000 7f46d5f0a700 1 -- 172.21.15.103:0/3169743183 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46d00b51f0 con 0x7f46d00b9140 2020-04-22T14:03:45.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.163+0000 7f46d5f0a700 1 -- 172.21.15.103:0/3169743183 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46d00b3880 con 0x7f46d00b9140 2020-04-22T14:03:45.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.163+0000 7f46ceffd700 1 --2- 172.21.15.103:0/3169743183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46d00b9140 0x7f46d012a290 secure :-1 s=THROTTLE_DONE pgs=422 cs=0 l=1 rx=0x7f46c4002f30 tx=0x7f46c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.164+0000 7f46d5f0a700 1 -- 172.21.15.103:0/3169743183 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46d0056c90 con 0x7f46d00b9140 2020-04-22T14:03:45.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.164+0000 7f46ccff9700 1 -- 172.21.15.103:0/3169743183 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f46c4005900 con 0x7f46d00b9140 2020-04-22T14:03:45.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.164+0000 7f46ceffd700 1 --2- 172.21.15.103:0/3169743183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46d00b9140 0x7f46d012a290 secure :-1 s=THROTTLE_DONE pgs=422 cs=0 l=1 rx=0x7f46c4002f30 tx=0x7f46c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.164+0000 7f46ccff9700 1 --2- 172.21.15.103:0/3169743183 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f46b004d990 0x7f46b004fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:45.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.164+0000 7f46ccff9700 1 -- 172.21.15.103:0/3169743183 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f46c4061bb0 con 0x7f46d00b9140 2020-04-22T14:03:45.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.164+0000 7f46cf7fe700 1 --2- 172.21.15.103:0/3169743183 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f46b004d990 0x7f46b004fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:45.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.164+0000 7f46cf7fe700 1 --2- 172.21.15.103:0/3169743183 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f46b004d990 0x7f46b004fe50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f46c0002f30 tx=0x7f46c000c7f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.165+0000 7f46cf7fe700 1 --2- 172.21.15.103:0/3169743183 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f46b004d990 0x7f46b004fe50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f46c0002f30 tx=0x7f46c000c7f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.165+0000 7f46cf7fe700 1 --2- 172.21.15.103:0/3169743183 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f46b004d990 0x7f46b004fe50 secure :-1 s=READY pgs=173 cs=0 l=1 rx=0x7f46c0002f30 tx=0x7f46c000c7f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:45.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.168+0000 7f46ceffd700 1 --2- 172.21.15.103:0/3169743183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46d00b9140 0x7f46d012a290 secure :-1 s=THROTTLE_DONE pgs=422 cs=0 l=1 rx=0x7f46c4002f30 tx=0x7f46c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.168+0000 7f46ccff9700 1 -- 172.21.15.103:0/3169743183 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f46c403d050 con 0x7f46d00b9140 2020-04-22T14:03:45.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.311+0000 7f46d5f0a700 1 -- 172.21.15.103:0/3169743183 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f46d006a960 con 0x7f46d00b9140 2020-04-22T14:03:45.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.312+0000 7f46ceffd700 1 --2- 172.21.15.103:0/3169743183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46d00b9140 0x7f46d012a290 secure :-1 s=THROTTLE_DONE pgs=422 cs=0 l=1 rx=0x7f46c4002f30 tx=0x7f46c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.312+0000 7f46ccff9700 1 -- 172.21.15.103:0/3169743183 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+10 (secure 0 0 0) 0x7f46c4040670 con 0x7f46d00b9140 2020-04-22T14:03:45.315 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:03:45.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.313+0000 7f46d5f0a700 1 -- 172.21.15.103:0/3169743183 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f46b004d990 msgr2=0x7f46b004fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:45.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.313+0000 7f46d5f0a700 1 --2- 172.21.15.103:0/3169743183 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f46b004d990 0x7f46b004fe50 secure :-1 s=READY pgs=173 cs=0 l=1 rx=0x7f46c0002f30 tx=0x7f46c000c7f0).stop 2020-04-22T14:03:45.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.313+0000 7f46d5f0a700 1 -- 172.21.15.103:0/3169743183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46d00b9140 msgr2=0x7f46d012a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:45.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.313+0000 7f46d5f0a700 1 --2- 172.21.15.103:0/3169743183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46d00b9140 0x7f46d012a290 secure :-1 s=READY pgs=422 cs=0 l=1 rx=0x7f46c4002f30 tx=0x7f46c4007a40).stop 2020-04-22T14:03:45.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.313+0000 7f46d5f0a700 1 -- 172.21.15.103:0/3169743183 shutdown_connections 2020-04-22T14:03:45.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.313+0000 7f46d5f0a700 1 --2- 172.21.15.103:0/3169743183 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f46b004d990 0x7f46b004fe50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:45.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.313+0000 7f46d5f0a700 1 --2- 172.21.15.103:0/3169743183 >> v2:172.21.15.86:3300/0 conn(0x7f46d0146c40 0x7f46d0151870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:45.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.313+0000 7f46d5f0a700 1 --2- 172.21.15.103:0/3169743183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f46d00ac950 0x7f46d0141570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:45.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.313+0000 7f46d5f0a700 1 --2- 172.21.15.103:0/3169743183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46d00b9140 0x7f46d012a290 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:45.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.313+0000 7f46d5f0a700 1 -- 172.21.15.103:0/3169743183 >> 172.21.15.103:0/3169743183 conn(0x7f46d005b7b0 msgr2=0x7f46d00b8420 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:45.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.313+0000 7f46d5f0a700 1 -- 172.21.15.103:0/3169743183 shutdown_connections 2020-04-22T14:03:45.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.313+0000 7f46d5f0a700 1 -- 172.21.15.103:0/3169743183 wait complete. 2020-04-22T14:03:45.326 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:45.339 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-22T14:03:45.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.485+0000 7f7c2f2ab700 1 Processor -- start 2020-04-22T14:03:45.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.485+0000 7f7c2f2ab700 1 -- start start 2020-04-22T14:03:45.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.486+0000 7f7c2f2ab700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7c280b8e00 0x7f7c280af010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:45.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.486+0000 7f7c2f2ab700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c2805fed0 0x7f7c280b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:45.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.486+0000 7f7c2f2ab700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c280b29b0 con 0x7f7c280b91e0 2020-04-22T14:03:45.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.486+0000 7f7c2f2ab700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c280b4270 con 0x7f7c280b8e00 2020-04-22T14:03:45.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.486+0000 7f7c2f2ab700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c280b4510 con 0x7f7c2805fed0 2020-04-22T14:03:45.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.486+0000 7f7c2daa8700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f7c280b91e0 0x7f7c28142f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41066/0 (socket says 172.21.15.103:41066) 2020-04-22T14:03:45.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.486+0000 7f7c2daa8700 1 -- 172.21.15.103:0/3101103817 learned_addr learned my addr 172.21.15.103:0/3101103817 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:45.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.487+0000 7f7c2eaaa700 1 --2- 172.21.15.103:0/3101103817 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c2805fed0 0x7f7c280b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:45.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.487+0000 7f7c2e2a9700 1 --2- 172.21.15.103:0/3101103817 >> v2:172.21.15.86:3300/0 conn(0x7f7c280b8e00 0x7f7c280af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:45.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.487+0000 7f7c2d2a7700 1 -- 172.21.15.103:0/3101103817 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3125475335 0 0) 0x7f7c280b29b0 con 0x7f7c280b91e0 2020-04-22T14:03:45.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.487+0000 7f7c2d2a7700 1 -- 172.21.15.103:0/3101103817 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c10003230 con 0x7f7c280b91e0 2020-04-22T14:03:45.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.487+0000 7f7c2d2a7700 1 -- 172.21.15.103:0/3101103817 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3625728130 0 0) 0x7f7c10003230 con 0x7f7c280b91e0 2020-04-22T14:03:45.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.487+0000 7f7c2d2a7700 1 -- 172.21.15.103:0/3101103817 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c2805fed0 msgr2=0x7f7c280b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:45.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.487+0000 7f7c2d2a7700 1 --2- 172.21.15.103:0/3101103817 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c2805fed0 0x7f7c280b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:45.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.487+0000 7f7c2d2a7700 1 -- 172.21.15.103:0/3101103817 >> v2:172.21.15.86:3300/0 conn(0x7f7c280b8e00 msgr2=0x7f7c280af010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:45.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.487+0000 7f7c2d2a7700 1 --2- 172.21.15.103:0/3101103817 >> v2:172.21.15.86:3300/0 conn(0x7f7c280b8e00 0x7f7c280af010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:45.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.487+0000 7f7c2d2a7700 1 -- 172.21.15.103:0/3101103817 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c280b2020 con 0x7f7c280b91e0 2020-04-22T14:03:45.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.487+0000 7f7c2d2a7700 1 -- 172.21.15.103:0/3101103817 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f7c240016d0 con 0x7f7c280b91e0 2020-04-22T14:03:45.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.487+0000 7f7c2d2a7700 1 -- 172.21.15.103:0/3101103817 >> v1:172.21.15.103:6789/0 conn(0x7f7c280b91e0 legacy=0x7f7c28142f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:45.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.487+0000 7f7c2d2a7700 1 --2- 172.21.15.103:0/3101103817 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c10003720 0x7f7c10003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:45.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.487+0000 7f7c2d2a7700 1 --2- 172.21.15.103:0/3101103817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c10004060 0x7f7c10004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:45.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.487+0000 7f7c2d2a7700 1 --2- 172.21.15.103:0/3101103817 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c2805fed0 0x7f7c10004ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:45.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.487+0000 7f7c2d2a7700 1 -- 172.21.15.103:0/3101103817 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c280b4270 con 0x7f7c10004060 2020-04-22T14:03:45.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.487+0000 7f7c2d2a7700 1 -- 172.21.15.103:0/3101103817 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c280b4510 con 0x7f7c10003720 2020-04-22T14:03:45.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.487+0000 7f7c2d2a7700 1 -- 172.21.15.103:0/3101103817 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c10004ff0 con 0x7f7c2805fed0 2020-04-22T14:03:45.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.487+0000 7f7c2e2a9700 1 --2- 172.21.15.103:0/3101103817 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c10003720 0x7f7c10003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:45.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.487+0000 7f7c2daa8700 1 --2- 172.21.15.103:0/3101103817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c10004060 0x7f7c10004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:45.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.487+0000 7f7c2eaaa700 1 --2- 172.21.15.103:0/3101103817 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c2805fed0 0x7f7c10004ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:45.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.487+0000 7f7c2e2a9700 1 -- 172.21.15.103:0/3101103817 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c2805fed0 msgr2=0x7f7c10004ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:45.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.487+0000 7f7c2e2a9700 1 --2- 172.21.15.103:0/3101103817 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c2805fed0 0x7f7c10004ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:45.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.487+0000 7f7c2e2a9700 1 -- 172.21.15.103:0/3101103817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c10004060 msgr2=0x7f7c10004530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:45.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.487+0000 7f7c2e2a9700 1 --2- 172.21.15.103:0/3101103817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c10004060 0x7f7c10004530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:45.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.487+0000 7f7c2e2a9700 1 -- 172.21.15.103:0/3101103817 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c10003230 con 0x7f7c10003720 2020-04-22T14:03:45.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.487+0000 7f7c2eaaa700 1 --2- 172.21.15.103:0/3101103817 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c2805fed0 0x7f7c10004ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:03:45.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.487+0000 7f7c2daa8700 1 --2- 172.21.15.103:0/3101103817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c10004060 0x7f7c10004530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:03:45.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.487+0000 7f7c2e2a9700 1 --2- 172.21.15.103:0/3101103817 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c10003720 0x7f7c10003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7c18002f30 tx=0x7f7c180100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.487+0000 7f7c2e2a9700 1 --2- 172.21.15.103:0/3101103817 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c10003720 0x7f7c10003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7c18002f30 tx=0x7f7c180100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.487+0000 7f7c2e2a9700 1 --2- 172.21.15.103:0/3101103817 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c10003720 0x7f7c10003b40 secure :-1 s=READY pgs=424 cs=0 l=1 rx=0x7f7c18002f30 tx=0x7f7c180100d0).ready entity=mon.1 client_cookie=9f9de1cd6e31dd2c server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:45.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.488+0000 7f7c2e2a9700 1 --2- 172.21.15.103:0/3101103817 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c10003720 0x7f7c10003b40 secure :-1 s=THROTTLE_DONE pgs=424 cs=0 l=1 rx=0x7f7c18002f30 tx=0x7f7c180100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.488+0000 7f7c2d2a7700 1 -- 172.21.15.103:0/3101103817 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c18010e80 con 0x7f7c10003720 2020-04-22T14:03:45.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.488+0000 7f7c2e2a9700 1 --2- 172.21.15.103:0/3101103817 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c10003720 0x7f7c10003b40 secure :-1 s=THROTTLE_DONE pgs=424 cs=0 l=1 rx=0x7f7c18002f30 tx=0x7f7c180100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.488+0000 7f7c2e2a9700 1 --2- 172.21.15.103:0/3101103817 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c10003720 0x7f7c10003b40 secure :-1 s=THROTTLE_DONE pgs=424 cs=0 l=1 rx=0x7f7c18002f30 tx=0x7f7c180100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.488+0000 7f7c2d2a7700 1 -- 172.21.15.103:0/3101103817 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c18008970 con 0x7f7c10003720 2020-04-22T14:03:45.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.488+0000 7f7c2d2a7700 1 -- 172.21.15.103:0/3101103817 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c18008d10 con 0x7f7c10003720 2020-04-22T14:03:45.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.488+0000 7f7c2f2ab700 1 -- 172.21.15.103:0/3101103817 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c10003720 msgr2=0x7f7c10003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:45.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.488+0000 7f7c2f2ab700 1 --2- 172.21.15.103:0/3101103817 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c10003720 0x7f7c10003b40 secure :-1 s=READY pgs=424 cs=0 l=1 rx=0x7f7c18002f30 tx=0x7f7c180100d0).stop 2020-04-22T14:03:45.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.488+0000 7f7c2eaaa700 1 -- 172.21.15.103:0/3101103817 reap_dead start 2020-04-22T14:03:45.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.488+0000 7f7c2f2ab700 1 -- 172.21.15.103:0/3101103817 shutdown_connections 2020-04-22T14:03:45.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.488+0000 7f7c2f2ab700 1 -- 172.21.15.103:0/3101103817 >> 172.21.15.103:0/3101103817 conn(0x7f7c2805b780 msgr2=0x7f7c280b8530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:45.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.488+0000 7f7c2f2ab700 1 -- 172.21.15.103:0/3101103817 shutdown_connections 2020-04-22T14:03:45.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.488+0000 7f7c2f2ab700 1 -- 172.21.15.103:0/3101103817 wait complete. 2020-04-22T14:03:45.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.489+0000 7f7c2f2ab700 1 Processor -- start 2020-04-22T14:03:45.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.489+0000 7f7c2f2ab700 1 -- start start 2020-04-22T14:03:45.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.490+0000 7f7c2f2ab700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c28141db0 0x7f7c280b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:45.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.490+0000 7f7c2f2ab700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7c28140570 0x7f7c28065290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:45.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.490+0000 7f7c2f2ab700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c28066ae0 con 0x7f7c280b0380 2020-04-22T14:03:45.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.490+0000 7f7c2f2ab700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c280b0e20 con 0x7f7c28140570 2020-04-22T14:03:45.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.490+0000 7f7c2f2ab700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c280b10c0 con 0x7f7c28141db0 2020-04-22T14:03:45.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.490+0000 7f7c2daa8700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f7c280b0380 0x7f7c2813fe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41078/0 (socket says 172.21.15.103:41078) 2020-04-22T14:03:45.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.490+0000 7f7c2eaaa700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7c28140570 0x7f7c28065290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:45.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.490+0000 7f7c2daa8700 1 -- 172.21.15.103:0/1535122684 learned_addr learned my addr 172.21.15.103:0/1535122684 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:45.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.490+0000 7f7c2e2a9700 1 --2- 172.21.15.103:0/1535122684 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c28141db0 0x7f7c280b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:45.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.490+0000 7f7c2eaaa700 1 -- 172.21.15.103:0/1535122684 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c28141db0 msgr2=0x7f7c280b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:45.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.490+0000 7f7c2eaaa700 1 --2- 172.21.15.103:0/1535122684 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c28141db0 0x7f7c280b18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:45.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.490+0000 7f7c2eaaa700 1 -- 172.21.15.103:0/1535122684 >> v1:172.21.15.103:6789/0 conn(0x7f7c280b0380 legacy=0x7f7c2813fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:45.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.490+0000 7f7c2eaaa700 1 -- 172.21.15.103:0/1535122684 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c28142190 con 0x7f7c28140570 2020-04-22T14:03:45.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.490+0000 7f7c177fe700 1 -- 172.21.15.103:0/1535122684 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1888720307 0 0) 0x7f7c28066ae0 con 0x7f7c280b0380 2020-04-22T14:03:45.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.490+0000 7f7c2eaaa700 1 --2- 172.21.15.103:0/1535122684 >> v2:172.21.15.103:3300/0 conn(0x7f7c28140570 0x7f7c28065290 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7c24001930 tx=0x7f7c20010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.490+0000 7f7c2eaaa700 1 --2- 172.21.15.103:0/1535122684 >> v2:172.21.15.103:3300/0 conn(0x7f7c28140570 0x7f7c28065290 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7c24001930 tx=0x7f7c20010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.490+0000 7f7c2eaaa700 1 --2- 172.21.15.103:0/1535122684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c28140570 0x7f7c28065290 secure :-1 s=READY pgs=426 cs=0 l=1 rx=0x7f7c24001930 tx=0x7f7c20010b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:45.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.490+0000 7f7c2eaaa700 1 --2- 172.21.15.103:0/1535122684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c28140570 0x7f7c28065290 secure :-1 s=THROTTLE_DONE pgs=426 cs=0 l=1 rx=0x7f7c24001930 tx=0x7f7c20010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.490+0000 7f7c177fe700 1 -- 172.21.15.103:0/1535122684 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c20005e20 con 0x7f7c28140570 2020-04-22T14:03:45.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.490+0000 7f7c2eaaa700 1 --2- 172.21.15.103:0/1535122684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c28140570 0x7f7c28065290 secure :-1 s=THROTTLE_DONE pgs=426 cs=0 l=1 rx=0x7f7c24001930 tx=0x7f7c20010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.490+0000 7f7c2eaaa700 1 --2- 172.21.15.103:0/1535122684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c28140570 0x7f7c28065290 secure :-1 s=THROTTLE_DONE pgs=426 cs=0 l=1 rx=0x7f7c24001930 tx=0x7f7c20010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.490+0000 7f7c177fe700 1 -- 172.21.15.103:0/1535122684 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c200125f0 con 0x7f7c28140570 2020-04-22T14:03:45.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.490+0000 7f7c2f2ab700 1 -- 172.21.15.103:0/1535122684 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c280b0940 con 0x7f7c28140570 2020-04-22T14:03:45.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.490+0000 7f7c177fe700 1 -- 172.21.15.103:0/1535122684 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c200129d0 con 0x7f7c28140570 2020-04-22T14:03:45.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.490+0000 7f7c2f2ab700 1 -- 172.21.15.103:0/1535122684 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c28065930 con 0x7f7c28140570 2020-04-22T14:03:45.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.491+0000 7f7c2eaaa700 1 --2- 172.21.15.103:0/1535122684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c28140570 0x7f7c28065290 secure :-1 s=THROTTLE_DONE pgs=426 cs=0 l=1 rx=0x7f7c24001930 tx=0x7f7c20010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.491+0000 7f7c2eaaa700 1 --2- 172.21.15.103:0/1535122684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c28140570 0x7f7c28065290 secure :-1 s=THROTTLE_DONE pgs=426 cs=0 l=1 rx=0x7f7c24001930 tx=0x7f7c20010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.517 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.491+0000 7f7c177fe700 1 -- 172.21.15.103:0/1535122684 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f7c20012b30 con 0x7f7c28140570 2020-04-22T14:03:45.517 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.492+0000 7f7c2f2ab700 1 -- 172.21.15.103:0/1535122684 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c28056c90 con 0x7f7c28140570 2020-04-22T14:03:45.517 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.492+0000 7f7c177fe700 1 --2- 172.21.15.103:0/1535122684 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7c0804d870 0x7f7c0804fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:45.517 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.492+0000 7f7c177fe700 1 -- 172.21.15.103:0/1535122684 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7c20060ed0 con 0x7f7c28140570 2020-04-22T14:03:45.517 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.492+0000 7f7c2e2a9700 1 --2- 172.21.15.103:0/1535122684 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7c0804d870 0x7f7c0804fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:45.517 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.492+0000 7f7c2e2a9700 1 --2- 172.21.15.103:0/1535122684 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7c0804d870 0x7f7c0804fd30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7c18002f30 tx=0x7f7c180100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.517 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.492+0000 7f7c2e2a9700 1 --2- 172.21.15.103:0/1535122684 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7c0804d870 0x7f7c0804fd30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7c18002f30 tx=0x7f7c180100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.517 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.492+0000 7f7c2e2a9700 1 --2- 172.21.15.103:0/1535122684 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7c0804d870 0x7f7c0804fd30 secure :-1 s=READY pgs=174 cs=0 l=1 rx=0x7f7c18002f30 tx=0x7f7c180100d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:45.518 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.496+0000 7f7c2eaaa700 1 --2- 172.21.15.103:0/1535122684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c28140570 0x7f7c28065290 secure :-1 s=THROTTLE_DONE pgs=426 cs=0 l=1 rx=0x7f7c24001930 tx=0x7f7c20010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.518 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.496+0000 7f7c177fe700 1 -- 172.21.15.103:0/1535122684 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f7c2003c270 con 0x7f7c28140570 2020-04-22T14:03:45.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.637+0000 7f7c2f2ab700 1 -- 172.21.15.103:0/1535122684 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7c280624c0 con 0x7f7c28140570 2020-04-22T14:03:45.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.638+0000 7f7c2eaaa700 1 --2- 172.21.15.103:0/1535122684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c28140570 0x7f7c28065290 secure :-1 s=THROTTLE_DONE pgs=426 cs=0 l=1 rx=0x7f7c24001930 tx=0x7f7c20010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.638+0000 7f7c177fe700 1 -- 172.21.15.103:0/1535122684 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+10 (secure 0 0 0) 0x7f7c2003f890 con 0x7f7c28140570 2020-04-22T14:03:45.641 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:03:45.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.639+0000 7f7c2f2ab700 1 -- 172.21.15.103:0/1535122684 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7c0804d870 msgr2=0x7f7c0804fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:45.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.639+0000 7f7c2f2ab700 1 --2- 172.21.15.103:0/1535122684 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7c0804d870 0x7f7c0804fd30 secure :-1 s=READY pgs=174 cs=0 l=1 rx=0x7f7c18002f30 tx=0x7f7c180100d0).stop 2020-04-22T14:03:45.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.639+0000 7f7c2f2ab700 1 -- 172.21.15.103:0/1535122684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c28140570 msgr2=0x7f7c28065290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:45.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.639+0000 7f7c2f2ab700 1 --2- 172.21.15.103:0/1535122684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c28140570 0x7f7c28065290 secure :-1 s=READY pgs=426 cs=0 l=1 rx=0x7f7c24001930 tx=0x7f7c20010b90).stop 2020-04-22T14:03:45.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.639+0000 7f7c2f2ab700 1 -- 172.21.15.103:0/1535122684 shutdown_connections 2020-04-22T14:03:45.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.639+0000 7f7c2f2ab700 1 --2- 172.21.15.103:0/1535122684 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7c0804d870 0x7f7c0804fd30 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:45.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.639+0000 7f7c2f2ab700 1 --2- 172.21.15.103:0/1535122684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c28140570 0x7f7c28065290 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:45.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.639+0000 7f7c2f2ab700 1 --2- 172.21.15.103:0/1535122684 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c28141db0 0x7f7c280b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:45.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.639+0000 7f7c2f2ab700 1 -- 172.21.15.103:0/1535122684 >> 172.21.15.103:0/1535122684 conn(0x7f7c2805b780 msgr2=0x7f7c280b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:45.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.639+0000 7f7c2f2ab700 1 -- 172.21.15.103:0/1535122684 shutdown_connections 2020-04-22T14:03:45.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.639+0000 7f7c2f2ab700 1 -- 172.21.15.103:0/1535122684 wait complete. 2020-04-22T14:03:45.653 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-04-22T14:03:45.653 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:45.667 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:03:45.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.811+0000 7fc933cdd700 1 Processor -- start 2020-04-22T14:03:45.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.811+0000 7fc933cdd700 1 -- start start 2020-04-22T14:03:45.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.812+0000 7fc933cdd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc92c1441f0 0x7fc92c144820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:45.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.812+0000 7fc933cdd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc92c144c80 0x7fc92c0ad850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:45.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.812+0000 7fc933cdd700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc92c0b5900 con 0x7fc92c05b7c0 2020-04-22T14:03:45.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.812+0000 7fc933cdd700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc92c0b5ba0 con 0x7fc92c1441f0 2020-04-22T14:03:45.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.812+0000 7fc933cdd700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c0b5e40 con 0x7fc92c144c80 2020-04-22T14:03:45.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.812+0000 7fc931a79700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc92c05b7c0 0x7fc92c0b50d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41084/0 (socket says 172.21.15.103:41084) 2020-04-22T14:03:45.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.812+0000 7fc931a79700 1 -- 172.21.15.103:0/1223452371 learned_addr learned my addr 172.21.15.103:0/1223452371 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:45.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.812+0000 7fc931278700 1 --2- 172.21.15.103:0/1223452371 >> v2:172.21.15.86:3300/0 conn(0x7fc92c1441f0 0x7fc92c144820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:45.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.812+0000 7fc93227a700 1 --2- 172.21.15.103:0/1223452371 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc92c144c80 0x7fc92c0ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:45.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.812+0000 7fc930a77700 1 -- 172.21.15.103:0/1223452371 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4289835226 0 0) 0x7fc92c0b5900 con 0x7fc92c05b7c0 2020-04-22T14:03:45.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.812+0000 7fc930a77700 1 -- 172.21.15.103:0/1223452371 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc914003230 con 0x7fc92c05b7c0 2020-04-22T14:03:45.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.813+0000 7fc931278700 1 -- 172.21.15.103:0/1223452371 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc92c144c80 msgr2=0x7fc92c0ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:45.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.813+0000 7fc931278700 1 --2- 172.21.15.103:0/1223452371 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc92c144c80 0x7fc92c0ad850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:45.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.813+0000 7fc931278700 1 -- 172.21.15.103:0/1223452371 >> v1:172.21.15.103:6789/0 conn(0x7fc92c05b7c0 legacy=0x7fc92c0b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:45.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.813+0000 7fc931278700 1 -- 172.21.15.103:0/1223452371 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc92c05bba0 con 0x7fc92c1441f0 2020-04-22T14:03:45.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.813+0000 7fc93227a700 1 --2- 172.21.15.103:0/1223452371 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc92c144c80 0x7fc92c0ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:03:45.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.813+0000 7fc931278700 1 --2- 172.21.15.103:0/1223452371 >> v2:172.21.15.86:3300/0 conn(0x7fc92c1441f0 0x7fc92c144820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc928002f30 tx=0x7fc928007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.813+0000 7fc931278700 1 --2- 172.21.15.103:0/1223452371 >> v2:172.21.15.86:3300/0 conn(0x7fc92c1441f0 0x7fc92c144820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc928002f30 tx=0x7fc928007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.813+0000 7fc931278700 1 --2- 172.21.15.103:0/1223452371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc92c1441f0 0x7fc92c144820 secure :-1 s=READY pgs=254 cs=0 l=1 rx=0x7fc928002f30 tx=0x7fc928007a40).ready entity=mon.0 client_cookie=c7b6c385c0e5326f server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:45.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.813+0000 7fc931278700 1 --2- 172.21.15.103:0/1223452371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc92c1441f0 0x7fc92c144820 secure :-1 s=THROTTLE_DONE pgs=254 cs=0 l=1 rx=0x7fc928002f30 tx=0x7fc928007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.813+0000 7fc930a77700 1 -- 172.21.15.103:0/1223452371 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc928008d00 con 0x7fc92c1441f0 2020-04-22T14:03:45.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.813+0000 7fc931278700 1 --2- 172.21.15.103:0/1223452371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc92c1441f0 0x7fc92c144820 secure :-1 s=THROTTLE_DONE pgs=254 cs=0 l=1 rx=0x7fc928002f30 tx=0x7fc928007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.813+0000 7fc930a77700 1 -- 172.21.15.103:0/1223452371 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9280116a0 con 0x7fc92c1441f0 2020-04-22T14:03:45.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.813+0000 7fc931278700 1 --2- 172.21.15.103:0/1223452371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc92c1441f0 0x7fc92c144820 secure :-1 s=THROTTLE_DONE pgs=254 cs=0 l=1 rx=0x7fc928002f30 tx=0x7fc928007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.813+0000 7fc930a77700 1 -- 172.21.15.103:0/1223452371 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc928008ea0 con 0x7fc92c1441f0 2020-04-22T14:03:45.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.813+0000 7fc933cdd700 1 -- 172.21.15.103:0/1223452371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc92c1441f0 msgr2=0x7fc92c144820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:45.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.813+0000 7fc933cdd700 1 --2- 172.21.15.103:0/1223452371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc92c1441f0 0x7fc92c144820 secure :-1 s=READY pgs=254 cs=0 l=1 rx=0x7fc928002f30 tx=0x7fc928007a40).stop 2020-04-22T14:03:45.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.813+0000 7fc933cdd700 1 -- 172.21.15.103:0/1223452371 shutdown_connections 2020-04-22T14:03:45.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.813+0000 7fc933cdd700 1 --2- 172.21.15.103:0/1223452371 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc92c144c80 0x7fc92c0ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:45.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.813+0000 7fc933cdd700 1 --2- 172.21.15.103:0/1223452371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc92c1441f0 0x7fc92c144820 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:45.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.813+0000 7fc933cdd700 1 -- 172.21.15.103:0/1223452371 >> 172.21.15.103:0/1223452371 conn(0x7fc92c0b9160 msgr2=0x7fc92c05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:45.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.813+0000 7fc933cdd700 1 -- 172.21.15.103:0/1223452371 shutdown_connections 2020-04-22T14:03:45.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.813+0000 7fc933cdd700 1 -- 172.21.15.103:0/1223452371 wait complete. 2020-04-22T14:03:45.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.814+0000 7fc933cdd700 1 Processor -- start 2020-04-22T14:03:45.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.814+0000 7fc933cdd700 1 -- start start 2020-04-22T14:03:45.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.815+0000 7fc933cdd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc92c05b7c0 0x7fc92c0b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:45.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.815+0000 7fc933cdd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc92c1441f0 0x7fc92c0b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:45.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.815+0000 7fc933cdd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc92c144c80 0x7fc92c140f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:45.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.815+0000 7fc933cdd700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc92c1485a0 con 0x7fc92c05b7c0 2020-04-22T14:03:45.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.815+0000 7fc933cdd700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc92c141380 con 0x7fc92c1441f0 2020-04-22T14:03:45.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.815+0000 7fc933cdd700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c0b4590 con 0x7fc92c144c80 2020-04-22T14:03:45.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.815+0000 7fc931278700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc92c1441f0 0x7fc92c0b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:45.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.815+0000 7fc931278700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc92c1441f0 0x7fc92c0b3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48900/0 (socket says 172.21.15.103:48900) 2020-04-22T14:03:45.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.815+0000 7fc931278700 1 -- 172.21.15.103:0/3009178256 learned_addr learned my addr 172.21.15.103:0/3009178256 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:45.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.815+0000 7fc93227a700 1 --2- 172.21.15.103:0/3009178256 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc92c144c80 0x7fc92c140f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:45.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.815+0000 7fc931a79700 1 --2- 172.21.15.103:0/3009178256 >> v2:172.21.15.86:3300/0 conn(0x7fc92c05b7c0 0x7fc92c0b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:45.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.815+0000 7fc931278700 1 -- 172.21.15.103:0/3009178256 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc92c144c80 msgr2=0x7fc92c140f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:45.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.815+0000 7fc931278700 1 --2- 172.21.15.103:0/3009178256 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc92c144c80 0x7fc92c140f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:45.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.815+0000 7fc931278700 1 -- 172.21.15.103:0/3009178256 >> v2:172.21.15.86:3300/0 conn(0x7fc92c05b7c0 msgr2=0x7fc92c0b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:45.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.815+0000 7fc931278700 1 --2- 172.21.15.103:0/3009178256 >> v2:172.21.15.86:3300/0 conn(0x7fc92c05b7c0 0x7fc92c0b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:45.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.815+0000 7fc931278700 1 -- 172.21.15.103:0/3009178256 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc92c0ad810 con 0x7fc92c1441f0 2020-04-22T14:03:45.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.816+0000 7fc931278700 1 --2- 172.21.15.103:0/3009178256 >> v2:172.21.15.103:3300/0 conn(0x7fc92c1441f0 0x7fc92c0b3f60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc928002f30 tx=0x7fc928007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.816+0000 7fc931278700 1 --2- 172.21.15.103:0/3009178256 >> v2:172.21.15.103:3300/0 conn(0x7fc92c1441f0 0x7fc92c0b3f60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc928002f30 tx=0x7fc928007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.816+0000 7fc931278700 1 --2- 172.21.15.103:0/3009178256 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc92c1441f0 0x7fc92c0b3f60 secure :-1 s=READY pgs=428 cs=0 l=1 rx=0x7fc928002f30 tx=0x7fc928007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:45.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.816+0000 7fc931278700 1 --2- 172.21.15.103:0/3009178256 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc92c1441f0 0x7fc92c0b3f60 secure :-1 s=THROTTLE_DONE pgs=428 cs=0 l=1 rx=0x7fc928002f30 tx=0x7fc928007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.816+0000 7fc91affd700 1 -- 172.21.15.103:0/3009178256 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc92800f740 con 0x7fc92c1441f0 2020-04-22T14:03:45.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.816+0000 7fc931278700 1 --2- 172.21.15.103:0/3009178256 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc92c1441f0 0x7fc92c0b3f60 secure :-1 s=THROTTLE_DONE pgs=428 cs=0 l=1 rx=0x7fc928002f30 tx=0x7fc928007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.816+0000 7fc91affd700 1 -- 172.21.15.103:0/3009178256 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc928007170 con 0x7fc92c1441f0 2020-04-22T14:03:45.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.816+0000 7fc931278700 1 --2- 172.21.15.103:0/3009178256 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc92c1441f0 0x7fc92c0b3f60 secure :-1 s=THROTTLE_DONE pgs=428 cs=0 l=1 rx=0x7fc928002f30 tx=0x7fc928007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.816+0000 7fc933cdd700 1 -- 172.21.15.103:0/3009178256 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc92c0adab0 con 0x7fc92c1441f0 2020-04-22T14:03:45.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.816+0000 7fc91affd700 1 -- 172.21.15.103:0/3009178256 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc928007550 con 0x7fc92c1441f0 2020-04-22T14:03:45.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.816+0000 7fc933cdd700 1 -- 172.21.15.103:0/3009178256 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc92c0ae190 con 0x7fc92c1441f0 2020-04-22T14:03:45.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.816+0000 7fc931278700 1 --2- 172.21.15.103:0/3009178256 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc92c1441f0 0x7fc92c0b3f60 secure :-1 s=THROTTLE_DONE pgs=428 cs=0 l=1 rx=0x7fc928002f30 tx=0x7fc928007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.817+0000 7fc91affd700 1 -- 172.21.15.103:0/3009178256 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fc9280056c0 con 0x7fc92c1441f0 2020-04-22T14:03:45.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.817+0000 7fc931278700 1 --2- 172.21.15.103:0/3009178256 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc92c1441f0 0x7fc92c0b3f60 secure :-1 s=THROTTLE_DONE pgs=428 cs=0 l=1 rx=0x7fc928002f30 tx=0x7fc928007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.817+0000 7fc933cdd700 1 -- 172.21.15.103:0/3009178256 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc92c056c90 con 0x7fc92c1441f0 2020-04-22T14:03:45.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.817+0000 7fc91affd700 1 --2- 172.21.15.103:0/3009178256 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc90c04d960 0x7fc90c04fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:45.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.817+0000 7fc91affd700 1 -- 172.21.15.103:0/3009178256 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc928061b80 con 0x7fc92c1441f0 2020-04-22T14:03:45.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.817+0000 7fc931a79700 1 --2- 172.21.15.103:0/3009178256 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc90c04d960 0x7fc90c04fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:45.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.817+0000 7fc931a79700 1 --2- 172.21.15.103:0/3009178256 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc90c04d960 0x7fc90c04fe20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc91c0010d0 tx=0x7fc91c001750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.817+0000 7fc931a79700 1 --2- 172.21.15.103:0/3009178256 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc90c04d960 0x7fc90c04fe20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc91c0010d0 tx=0x7fc91c001750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.817+0000 7fc931a79700 1 --2- 172.21.15.103:0/3009178256 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc90c04d960 0x7fc90c04fe20 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7fc91c0010d0 tx=0x7fc91c001750).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:45.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.821+0000 7fc931278700 1 --2- 172.21.15.103:0/3009178256 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc92c1441f0 0x7fc92c0b3f60 secure :-1 s=THROTTLE_DONE pgs=428 cs=0 l=1 rx=0x7fc928002f30 tx=0x7fc928007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:45.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:45.821+0000 7fc91affd700 1 -- 172.21.15.103:0/3009178256 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fc92803cfc0 con 0x7fc92c1441f0 2020-04-22T14:03:46.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:46.011+0000 7fc933cdd700 1 -- 172.21.15.103:0/3009178256 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc92c0b4eb0 con 0x7fc92c1441f0 2020-04-22T14:03:46.015 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:46.012+0000 7fc931278700 1 --2- 172.21.15.103:0/3009178256 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc92c1441f0 0x7fc92c0b3f60 secure :-1 s=THROTTLE_DONE pgs=428 cs=0 l=1 rx=0x7fc928002f30 tx=0x7fc928007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:46.015 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:46.012+0000 7fc91affd700 1 -- 172.21.15.103:0/3009178256 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2141 (secure 0 0 0) 0x7fc9280405e0 con 0x7fc92c1441f0 2020-04-22T14:03:46.015 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:03:46.016 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4956,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/2333777975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2333777975},{"type":"v1","addr":"172.21.15.86:6835","nonce":2333777975}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:03:38.935462+0000","modified":"2020-04-22T14:03:40.946647+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5050},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5050":{"gid":5050,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/3282872682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3282872682},{"type":"v1","addr":"172.21.15.103:6833","nonce":3282872682}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2020-04-22T14:03:46.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:46.013+0000 7fc933cdd700 1 -- 172.21.15.103:0/3009178256 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc90c04d960 msgr2=0x7fc90c04fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:46.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:46.013+0000 7fc933cdd700 1 --2- 172.21.15.103:0/3009178256 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc90c04d960 0x7fc90c04fe20 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7fc91c0010d0 tx=0x7fc91c001750).stop 2020-04-22T14:03:46.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:46.013+0000 7fc933cdd700 1 -- 172.21.15.103:0/3009178256 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc92c1441f0 msgr2=0x7fc92c0b3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:46.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:46.013+0000 7fc933cdd700 1 --2- 172.21.15.103:0/3009178256 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc92c1441f0 0x7fc92c0b3f60 secure :-1 s=READY pgs=428 cs=0 l=1 rx=0x7fc928002f30 tx=0x7fc928007a40).stop 2020-04-22T14:03:46.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:46.013+0000 7fc933cdd700 1 -- 172.21.15.103:0/3009178256 shutdown_connections 2020-04-22T14:03:46.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:46.013+0000 7fc933cdd700 1 --2- 172.21.15.103:0/3009178256 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc90c04d960 0x7fc90c04fe20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:46.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:46.013+0000 7fc933cdd700 1 --2- 172.21.15.103:0/3009178256 >> v2:172.21.15.86:3300/0 conn(0x7fc92c05b7c0 0x7fc92c0b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:46.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:46.013+0000 7fc933cdd700 1 --2- 172.21.15.103:0/3009178256 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc92c144c80 0x7fc92c140f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:46.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:46.013+0000 7fc933cdd700 1 --2- 172.21.15.103:0/3009178256 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc92c1441f0 0x7fc92c0b3f60 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:46.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:46.013+0000 7fc933cdd700 1 -- 172.21.15.103:0/3009178256 >> 172.21.15.103:0/3009178256 conn(0x7fc92c0b9160 msgr2=0x7fc92c05c770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:46.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:46.013+0000 7fc933cdd700 1 -- 172.21.15.103:0/3009178256 shutdown_connections 2020-04-22T14:03:46.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:46.013+0000 7fc933cdd700 1 -- 172.21.15.103:0/3009178256 wait complete. 2020-04-22T14:03:46.019 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 14 2020-04-22T14:03:46.233 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 5050}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 5, u'failed': [], u'epoch': 14, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [6], u'info': {u'gid_5050': {u'export_targets': [], u'name': u'a', u'incarnation': 11, u'state_seq': 3, u'state': u'up:active', u'gid': 5050, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 3282872682, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 3282872682, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/3282872682'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:03:38.935462+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:03:40.946647+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:03:46.234 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:03:46.234 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:46.255 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:03:46.424 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:03:46.424 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:03:46.425 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:03:46.425 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 5050, 2020-04-22T14:03:46.425 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:03:46.425 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:03:46.425 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 7.4834814820000002, 2020-04-22T14:03:46.425 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 14, 2020-04-22T14:03:46.426 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 35, 2020-04-22T14:03:46.426 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 35, 2020-04-22T14:03:46.426 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 14.722779574 2020-04-22T14:03:46.426 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:03:46.434 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 5050, "want_state": "up:active", "state": "up:active", "rank_uptime": 7.4834814820000002, "mdsmap_epoch": 14, "osdmap_epoch": 35, "osdmap_epoch_barrier": 35, "uptime": 14.722779574 } 2020-04-22T14:03:46.435 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-04-22T14:03:46.435 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:03:46.435 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:46.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:46.456 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:03:46.546 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:03:46.546 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:03:46.546 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:03:46.546 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:46.546 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:03:46.547 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:46.547 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:03:46.547 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:46.547 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:03:46.547 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:46.547 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:03:46.547 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:46.547 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:03:46.548 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:46.548 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:03:46.548 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42614sec preferred_lft 42614sec 2020-04-22T14:03:46.548 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:03:46.548 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:46.548 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-04-22T14:03:46.549 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:46.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:46.588 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:03:46.672 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:46.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:46.720 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge con-name ceph-brx ifname ceph-brx stp no' 2020-04-22T14:03:46.829 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' (a4692aa6-6ed6-43e9-ba6f-d4aca06d15e9) successfully added. 2020-04-22T14:03:46.829 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:46.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:46.844 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection modify ceph-brx ipv4.addresses 192.168.255.254/16 ipv4.method manual' 2020-04-22T14:03:46.953 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:46.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:46.988 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up ceph-brx' 2020-04-22T14:03:47.096 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (master waiting for slaves) (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/8) 2020-04-22T14:03:47.096 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:47.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:47.115 INFO:teuthology.orchestra.run.smithi103:> touch /tmp/python-ceph-brx 2020-04-22T14:03:47.169 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:47.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:47.218 INFO:teuthology.orchestra.run.smithi103:> cat /proc/sys/net/ipv4/ip_forward 2020-04-22T14:03:47.279 INFO:teuthology.orchestra.run.smithi103.stdout:0 2020-04-22T14:03:47.279 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:47.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:47.326 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 0 > /tmp/python-ceph-brx' 2020-04-22T14:03:47.404 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:47.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:47.448 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 1 > /proc/sys/net/ipv4/ip_forward' 2020-04-22T14:03:47.534 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:47.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:47.575 INFO:teuthology.orchestra.run.smithi103:> route 2020-04-22T14:03:47.635 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2020-04-22T14:03:47.635 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-04-22T14:03:47.635 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 102 0 0 enp3s0f1 2020-04-22T14:03:47.635 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 102 0 0 enp3s0f1 2020-04-22T14:03:47.635 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 425 0 0 ceph-brx 2020-04-22T14:03:47.636 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:47.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:47.686 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-04-22T14:03:47.778 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:47.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:47.817 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-04-22T14:03:47.894 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:47.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:47.939 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-04-22T14:03:48.014 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:48.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:48.061 INFO:teuthology.orchestra.run.smithi103:> ip netns list 2020-04-22T14:03:48.124 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:48.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:48.175 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:03:48.234 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:48.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:48.283 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:03:48.358 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:48.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:48.407 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0' 2020-04-22T14:03:48.482 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-04-22T14:03:48.482 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:48.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:48.528 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0' 2020-04-22T14:03:48.602 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:48.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:48.660 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0' 2020-04-22T14:03:48.769 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:48.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:48.783 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up' 2020-04-22T14:03:48.891 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:48.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:48.904 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up' 2020-04-22T14:03:49.013 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:49.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:49.050 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254' 2020-04-22T14:03:49.099 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:03:49.116 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:03:49.159 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:49.163 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:49.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:49.172 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:03:49.184 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:03:49.261 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:49.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:49.320 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge-slave con-name brx.0 ifname brx.0 master ceph-brx' 2020-04-22T14:03:49.433 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.0' (67eea279-a82c-4e35-b760-55f58d2b9f7e) successfully added. 2020-04-22T14:03:49.433 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:49.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:49.463 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up brx.0' 2020-04-22T14:03:49.623 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/9) 2020-04-22T14:03:49.681 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-04-22T14:03:49.681 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi103.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-04-22T14:03:49.681 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:49.695 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:49.695 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:03:49.754 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:49.801 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:49.802 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:03:49.870 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:03:49.877 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:03:49.878 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:49.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:49.926 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:03:49.985 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-04-22T14:03:49.985 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:50.034 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:03:50.079 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:50.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:50.093 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:03:50.161 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:03:50.167 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:2020-04-22T14:03:50.164+0000 7f4c48eb21c0 -1 init, newargv = 0x558009e9b260 newargc=9 2020-04-22T14:03:50.167 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[46220]: starting ceph client 2020-04-22T14:03:50.168 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:03:50.169 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:50.172 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[46220]: starting fuse 2020-04-22T14:03:50.186 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:50.186 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:03:50.245 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:03:50.245 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2020-04-22T14:03:50.246 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:50.293 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:50.293 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:03:50.293 INFO:teuthology.orchestra.run.smithi103:> import glob 2020-04-22T14:03:50.294 INFO:teuthology.orchestra.run.smithi103:> import re 2020-04-22T14:03:50.294 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:03:50.294 INFO:teuthology.orchestra.run.smithi103:> import subprocess 2020-04-22T14:03:50.294 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:03:50.294 INFO:teuthology.orchestra.run.smithi103:> def find_socket(client_name): 2020-04-22T14:03:50.294 INFO:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-04-22T14:03:50.294 INFO:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2020-04-22T14:03:50.294 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:03:50.295 INFO:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2020-04-22T14:03:50.295 INFO:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2020-04-22T14:03:50.295 INFO:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2020-04-22T14:03:50.295 INFO:teuthology.orchestra.run.smithi103:> return files[0] 2020-04-22T14:03:50.295 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:03:50.295 INFO:teuthology.orchestra.run.smithi103:> for f in files: 2020-04-22T14:03:50.295 INFO:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:03:50.295 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:03:50.296 INFO:teuthology.orchestra.run.smithi103:> return f 2020-04-22T14:03:50.296 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:03:50.296 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:03:50.296 INFO:teuthology.orchestra.run.smithi103:> print(find_socket("client.0")) 2020-04-22T14:03:50.296 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:03:50.409 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.0.46220.asok 2020-04-22T14:03:50.409 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.46220.asok 2020-04-22T14:03:50.410 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:50.423 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:50.423 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.46220.asok status 2020-04-22T14:03:50.585 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:03:50.585 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2020-04-22T14:03:50.585 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:03:50.586 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:03:50.586 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "0", 2020-04-22T14:03:50.586 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:03:50.586 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-04-22T14:03:50.586 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "46220", 2020-04-22T14:03:50.586 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:03:50.586 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:50.586 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2020-04-22T14:03:50.587 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2020-04-22T14:03:50.587 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4661, 2020-04-22T14:03:50.587 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2020-04-22T14:03:50.587 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:03:50.587 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:03:50.587 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4661 2020-04-22T14:03:50.587 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:50.588 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:03:50.588 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:03:50.588 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:0", 2020-04-22T14:03:50.588 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1140042316 2020-04-22T14:03:50.588 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:50.588 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:50.588 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:03:50.589 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:03:50.589 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:0", 2020-04-22T14:03:50.589 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1140042316 2020-04-22T14:03:50.589 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:50.589 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.4661 172.21.15.103:0/1140042316", 2020-04-22T14:03:50.589 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "172.21.15.103:0/1140042316", 2020-04-22T14:03:50.589 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2020-04-22T14:03:50.589 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 14, 2020-04-22T14:03:50.590 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 35, 2020-04-22T14:03:50.590 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2020-04-22T14:03:50.590 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklisted": false 2020-04-22T14:03:50.590 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:03:50.590 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:50.605 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:50.606 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-22T14:03:50.606 INFO:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:03:50.664 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2020-04-22T14:03:50.664 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-04-22T14:03:50.665 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:50.714 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:50.714 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:03:50.793 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:50.838 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:03:50.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.981+0000 7f4f41163700 1 Processor -- start 2020-04-22T14:03:50.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.981+0000 7f4f41163700 1 -- start start 2020-04-22T14:03:50.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.982+0000 7f4f41163700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f3c0620a0 0x7f4f3c14a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:50.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.982+0000 7f4f41163700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4f3c062930 0x7f4f3c062d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:50.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.982+0000 7f4f41163700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f3c144a20 con 0x7f4f3c0ac740 2020-04-22T14:03:50.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.982+0000 7f4f41163700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f3c0661d0 con 0x7f4f3c062930 2020-04-22T14:03:50.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.982+0000 7f4f41163700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c0acd70 con 0x7f4f3c0620a0 2020-04-22T14:03:50.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.982+0000 7f4f40962700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4f3c062930 0x7f4f3c062d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:50.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.982+0000 7f4f40962700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4f3c062930 0x7f4f3c062d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48924/0 (socket says 172.21.15.103:48924) 2020-04-22T14:03:50.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.982+0000 7f4f40962700 1 -- 172.21.15.103:0/3307474261 learned_addr learned my addr 172.21.15.103:0/3307474261 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:50.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.982+0000 7f4f3bfff700 1 --2- 172.21.15.103:0/3307474261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f3c0620a0 0x7f4f3c14a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:50.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.982+0000 7f4f40962700 1 -- 172.21.15.103:0/3307474261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f3c0620a0 msgr2=0x7f4f3c14a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:50.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.982+0000 7f4f40962700 1 --2- 172.21.15.103:0/3307474261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f3c0620a0 0x7f4f3c14a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:50.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.982+0000 7f4f40962700 1 -- 172.21.15.103:0/3307474261 >> v1:172.21.15.86:6789/0 conn(0x7f4f3c0ac740 legacy=0x7f4f3c14ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:50.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.982+0000 7f4f40962700 1 -- 172.21.15.103:0/3307474261 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3c0ad010 con 0x7f4f3c062930 2020-04-22T14:03:50.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.982+0000 7f4f3bfff700 1 --2- 172.21.15.103:0/3307474261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f3c0620a0 0x7f4f3c14a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:03:50.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.982+0000 7f4f40962700 1 --2- 172.21.15.103:0/3307474261 >> v2:172.21.15.103:3300/0 conn(0x7f4f3c062930 0x7f4f3c062d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4f3c062770 tx=0x7f4f34007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:50.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.982+0000 7f4f40962700 1 --2- 172.21.15.103:0/3307474261 >> v2:172.21.15.103:3300/0 conn(0x7f4f3c062930 0x7f4f3c062d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4f3c062770 tx=0x7f4f34007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:50.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.982+0000 7f4f40962700 1 --2- 172.21.15.103:0/3307474261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f3c062930 0x7f4f3c062d70 secure :-1 s=READY pgs=430 cs=0 l=1 rx=0x7f4f3c062770 tx=0x7f4f34007dc0).ready entity=mon.1 client_cookie=d6c52a8d79c82231 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:50.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.982+0000 7f4f40962700 1 --2- 172.21.15.103:0/3307474261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f3c062930 0x7f4f3c062d70 secure :-1 s=THROTTLE_DONE pgs=430 cs=0 l=1 rx=0x7f4f3c062770 tx=0x7f4f34007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:50.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.983+0000 7f4f3b7fe700 1 -- 172.21.15.103:0/3307474261 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f3400a180 con 0x7f4f3c062930 2020-04-22T14:03:50.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.983+0000 7f4f40962700 1 --2- 172.21.15.103:0/3307474261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f3c062930 0x7f4f3c062d70 secure :-1 s=THROTTLE_DONE pgs=430 cs=0 l=1 rx=0x7f4f3c062770 tx=0x7f4f34007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:50.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.983+0000 7f4f40962700 1 --2- 172.21.15.103:0/3307474261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f3c062930 0x7f4f3c062d70 secure :-1 s=THROTTLE_DONE pgs=430 cs=0 l=1 rx=0x7f4f3c062770 tx=0x7f4f34007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:50.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.983+0000 7f4f3b7fe700 1 -- 172.21.15.103:0/3307474261 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3400a2e0 con 0x7f4f3c062930 2020-04-22T14:03:50.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.983+0000 7f4f3b7fe700 1 -- 172.21.15.103:0/3307474261 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f3400a700 con 0x7f4f3c062930 2020-04-22T14:03:50.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.983+0000 7f4f41163700 1 -- 172.21.15.103:0/3307474261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f3c062930 msgr2=0x7f4f3c062d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:50.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.983+0000 7f4f41163700 1 --2- 172.21.15.103:0/3307474261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f3c062930 0x7f4f3c062d70 secure :-1 s=READY pgs=430 cs=0 l=1 rx=0x7f4f3c062770 tx=0x7f4f34007dc0).stop 2020-04-22T14:03:50.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.983+0000 7f4f41163700 1 -- 172.21.15.103:0/3307474261 shutdown_connections 2020-04-22T14:03:50.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.983+0000 7f4f41163700 1 --2- 172.21.15.103:0/3307474261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f3c062930 0x7f4f3c062d70 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:50.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.983+0000 7f4f41163700 1 --2- 172.21.15.103:0/3307474261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f3c0620a0 0x7f4f3c14a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:50.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.983+0000 7f4f41163700 1 -- 172.21.15.103:0/3307474261 >> 172.21.15.103:0/3307474261 conn(0x7f4f3c05b7c0 msgr2=0x7f4f3c061610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:50.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.983+0000 7f4f41163700 1 -- 172.21.15.103:0/3307474261 shutdown_connections 2020-04-22T14:03:50.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.983+0000 7f4f41163700 1 -- 172.21.15.103:0/3307474261 wait complete. 2020-04-22T14:03:50.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.984+0000 7f4f41163700 1 Processor -- start 2020-04-22T14:03:50.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.984+0000 7f4f41163700 1 -- start start 2020-04-22T14:03:50.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.985+0000 7f4f41163700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4f3c0ac740 0x7f4f3c15c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:50.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.985+0000 7f4f41163700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f3c0adc90 con 0x7f4f3c0620a0 2020-04-22T14:03:50.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.985+0000 7f4f41163700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f3c0adf30 con 0x7f4f3c062930 2020-04-22T14:03:50.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.985+0000 7f4f41163700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f3c0ae1d0 con 0x7f4f3c0ac740 2020-04-22T14:03:51.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.985+0000 7f4f40962700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4f3c0ac740 0x7f4f3c15c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:51.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.985+0000 7f4f40962700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4f3c0ac740 0x7f4f3c15c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48930/0 (socket says 172.21.15.103:48930) 2020-04-22T14:03:51.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.985+0000 7f4f33fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f4f3c062930 0x7f4f3c0b2ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41118/0 (socket says 172.21.15.103:41118) 2020-04-22T14:03:51.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.985+0000 7f4f40962700 1 -- 172.21.15.103:0/2364492226 learned_addr learned my addr 172.21.15.103:0/2364492226 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:51.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.985+0000 7f4f40962700 1 -- 172.21.15.103:0/2364492226 >> v1:172.21.15.103:6789/0 conn(0x7f4f3c062930 legacy=0x7f4f3c0b2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:51.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.985+0000 7f4f40962700 1 -- 172.21.15.103:0/2364492226 >> v1:172.21.15.86:6789/0 conn(0x7f4f3c0620a0 legacy=0x7f4f3c12f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:51.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.985+0000 7f4f40962700 1 -- 172.21.15.103:0/2364492226 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3c0b4430 con 0x7f4f3c0ac740 2020-04-22T14:03:51.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.985+0000 7f4f40962700 1 --2- 172.21.15.103:0/2364492226 >> v2:172.21.15.103:3300/0 conn(0x7f4f3c0ac740 0x7f4f3c15c1a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4f240020a0 tx=0x7f4f34007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.985+0000 7f4f40962700 1 --2- 172.21.15.103:0/2364492226 >> v2:172.21.15.103:3300/0 conn(0x7f4f3c0ac740 0x7f4f3c15c1a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4f240020a0 tx=0x7f4f34007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.985+0000 7f4f40962700 1 --2- 172.21.15.103:0/2364492226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f3c0ac740 0x7f4f3c15c1a0 secure :-1 s=READY pgs=432 cs=0 l=1 rx=0x7f4f240020a0 tx=0x7f4f34007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:51.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.985+0000 7f4f40962700 1 --2- 172.21.15.103:0/2364492226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f3c0ac740 0x7f4f3c15c1a0 secure :-1 s=THROTTLE_DONE pgs=432 cs=0 l=1 rx=0x7f4f240020a0 tx=0x7f4f34007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.985+0000 7f4f39ffb700 1 -- 172.21.15.103:0/2364492226 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f3400a790 con 0x7f4f3c0ac740 2020-04-22T14:03:51.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.985+0000 7f4f40962700 1 --2- 172.21.15.103:0/2364492226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f3c0ac740 0x7f4f3c15c1a0 secure :-1 s=THROTTLE_DONE pgs=432 cs=0 l=1 rx=0x7f4f240020a0 tx=0x7f4f34007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.985+0000 7f4f40962700 1 --2- 172.21.15.103:0/2364492226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f3c0ac740 0x7f4f3c15c1a0 secure :-1 s=THROTTLE_DONE pgs=432 cs=0 l=1 rx=0x7f4f240020a0 tx=0x7f4f34007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.985+0000 7f4f39ffb700 1 -- 172.21.15.103:0/2364492226 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f34005c30 con 0x7f4f3c0ac740 2020-04-22T14:03:51.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.985+0000 7f4f41163700 1 -- 172.21.15.103:0/2364492226 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f3c12fd70 con 0x7f4f3c0ac740 2020-04-22T14:03:51.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.985+0000 7f4f39ffb700 1 -- 172.21.15.103:0/2364492226 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f3400f5b0 con 0x7f4f3c0ac740 2020-04-22T14:03:51.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.985+0000 7f4f41163700 1 -- 172.21.15.103:0/2364492226 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f3c0ad7f0 con 0x7f4f3c0ac740 2020-04-22T14:03:51.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.986+0000 7f4f40962700 1 --2- 172.21.15.103:0/2364492226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f3c0ac740 0x7f4f3c15c1a0 secure :-1 s=THROTTLE_DONE pgs=432 cs=0 l=1 rx=0x7f4f240020a0 tx=0x7f4f34007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.986+0000 7f4f41163700 1 -- 172.21.15.103:0/2364492226 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f3c0adb00 con 0x7f4f3c0ac740 2020-04-22T14:03:51.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.986+0000 7f4f39ffb700 1 -- 172.21.15.103:0/2364492226 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f4f3400f7b0 con 0x7f4f3c0ac740 2020-04-22T14:03:51.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.986+0000 7f4f40962700 1 --2- 172.21.15.103:0/2364492226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f3c0ac740 0x7f4f3c15c1a0 secure :-1 s=THROTTLE_DONE pgs=432 cs=0 l=1 rx=0x7f4f240020a0 tx=0x7f4f34007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.987+0000 7f4f39ffb700 1 --2- 172.21.15.103:0/2364492226 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4f2004d970 0x7f4f2004fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:51.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.987+0000 7f4f39ffb700 1 -- 172.21.15.103:0/2364492226 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4f340624d0 con 0x7f4f3c0ac740 2020-04-22T14:03:51.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.987+0000 7f4f3bfff700 1 --2- 172.21.15.103:0/2364492226 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4f2004d970 0x7f4f2004fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:51.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.987+0000 7f4f3bfff700 1 --2- 172.21.15.103:0/2364492226 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4f2004d970 0x7f4f2004fe30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4f3c133420 tx=0x7f4f2c0011d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.987+0000 7f4f3bfff700 1 --2- 172.21.15.103:0/2364492226 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4f2004d970 0x7f4f2004fe30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4f3c133420 tx=0x7f4f2c0011d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.987+0000 7f4f3bfff700 1 --2- 172.21.15.103:0/2364492226 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4f2004d970 0x7f4f2004fe30 secure :-1 s=READY pgs=176 cs=0 l=1 rx=0x7f4f3c133420 tx=0x7f4f2c0011d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:51.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.991+0000 7f4f40962700 1 --2- 172.21.15.103:0/2364492226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f3c0ac740 0x7f4f3c15c1a0 secure :-1 s=THROTTLE_DONE pgs=432 cs=0 l=1 rx=0x7f4f240020a0 tx=0x7f4f34007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:50.991+0000 7f4f39ffb700 1 -- 172.21.15.103:0/2364492226 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f4f3403d970 con 0x7f4f3c0ac740 2020-04-22T14:03:51.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.132+0000 7f4f41163700 1 -- 172.21.15.103:0/2364492226 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f3c056c90 con 0x7f4f3c0ac740 2020-04-22T14:03:51.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.133+0000 7f4f40962700 1 --2- 172.21.15.103:0/2364492226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f3c0ac740 0x7f4f3c15c1a0 secure :-1 s=THROTTLE_DONE pgs=432 cs=0 l=1 rx=0x7f4f240020a0 tx=0x7f4f34007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.133+0000 7f4f39ffb700 1 -- 172.21.15.103:0/2364492226 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f4f34040f90 con 0x7f4f3c0ac740 2020-04-22T14:03:51.137 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:03:51.137 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":35,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:03:40.946120+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:03:37.161048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2020-04-22T14:03:37.878823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:03:51.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.134+0000 7f4f41163700 1 -- 172.21.15.103:0/2364492226 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4f2004d970 msgr2=0x7f4f2004fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:51.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.134+0000 7f4f41163700 1 --2- 172.21.15.103:0/2364492226 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4f2004d970 0x7f4f2004fe30 secure :-1 s=READY pgs=176 cs=0 l=1 rx=0x7f4f3c133420 tx=0x7f4f2c0011d0).stop 2020-04-22T14:03:51.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.135+0000 7f4f41163700 1 -- 172.21.15.103:0/2364492226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f3c0ac740 msgr2=0x7f4f3c15c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:51.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.135+0000 7f4f41163700 1 --2- 172.21.15.103:0/2364492226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f3c0ac740 0x7f4f3c15c1a0 secure :-1 s=READY pgs=432 cs=0 l=1 rx=0x7f4f240020a0 tx=0x7f4f34007dc0).stop 2020-04-22T14:03:51.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.135+0000 7f4f41163700 1 -- 172.21.15.103:0/2364492226 shutdown_connections 2020-04-22T14:03:51.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.135+0000 7f4f41163700 1 --2- 172.21.15.103:0/2364492226 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4f2004d970 0x7f4f2004fe30 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:51.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.135+0000 7f4f41163700 1 --2- 172.21.15.103:0/2364492226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f3c0ac740 0x7f4f3c15c1a0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:51.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.135+0000 7f4f41163700 1 -- 172.21.15.103:0/2364492226 >> 172.21.15.103:0/2364492226 conn(0x7f4f3c05b7c0 msgr2=0x7f4f3c14da40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:51.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.135+0000 7f4f41163700 1 -- 172.21.15.103:0/2364492226 shutdown_connections 2020-04-22T14:03:51.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.135+0000 7f4f41163700 1 -- 172.21.15.103:0/2364492226 wait complete. 2020-04-22T14:03:51.148 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:03:37.161048+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 5, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'34', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:03:37.878823+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 6, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'35', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:03:51.149 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:51.163 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:03:51.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.309+0000 7f881b8aa700 1 Processor -- start 2020-04-22T14:03:51.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.309+0000 7f881b8aa700 1 -- start start 2020-04-22T14:03:51.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.310+0000 7f881b8aa700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88140b9140 0x7f881412b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:51.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.310+0000 7f881b8aa700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f881412b670 0x7f8814143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:51.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.310+0000 7f881b8aa700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88141467e0 con 0x7f88140ac950 2020-04-22T14:03:51.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.310+0000 7f881b8aa700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88140602f0 con 0x7f881412b670 2020-04-22T14:03:51.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.310+0000 7f881b8aa700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8814060050 con 0x7f88140b9140 2020-04-22T14:03:51.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.310+0000 7f8818e45700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f88140ac950 0x7f8814146c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41124/0 (socket says 172.21.15.103:41124) 2020-04-22T14:03:51.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.310+0000 7f8818e45700 1 -- 172.21.15.103:0/1068895461 learned_addr learned my addr 172.21.15.103:0/1068895461 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:51.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.310+0000 7f8807fff700 1 -- 172.21.15.103:0/1068895461 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3399065506 0 0) 0x7f88141467e0 con 0x7f88140ac950 2020-04-22T14:03:51.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.310+0000 7f8819e47700 1 --2- 172.21.15.103:0/1068895461 >> v2:172.21.15.86:3300/0 conn(0x7f881412b670 0x7f8814143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:51.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.310+0000 7f8807fff700 1 -- 172.21.15.103:0/1068895461 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87fc003230 con 0x7f88140ac950 2020-04-22T14:03:51.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.310+0000 7f8819646700 1 --2- 172.21.15.103:0/1068895461 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88140b9140 0x7f881412b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:51.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.310+0000 7f8807fff700 1 -- 172.21.15.103:0/1068895461 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3948061363 0 0) 0x7f87fc003230 con 0x7f88140ac950 2020-04-22T14:03:51.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.310+0000 7f8807fff700 1 -- 172.21.15.103:0/1068895461 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88140b9140 msgr2=0x7f881412b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:51.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.310+0000 7f8807fff700 1 --2- 172.21.15.103:0/1068895461 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88140b9140 0x7f881412b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:51.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.310+0000 7f8807fff700 1 -- 172.21.15.103:0/1068895461 >> v2:172.21.15.86:3300/0 conn(0x7f881412b670 msgr2=0x7f8814143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:51.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.310+0000 7f8807fff700 1 --2- 172.21.15.103:0/1068895461 >> v2:172.21.15.86:3300/0 conn(0x7f881412b670 0x7f8814143090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:51.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.310+0000 7f8807fff700 1 -- 172.21.15.103:0/1068895461 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88140b9520 con 0x7f88140ac950 2020-04-22T14:03:51.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.310+0000 7f8807fff700 1 -- 172.21.15.103:0/1068895461 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f88100016d0 con 0x7f88140ac950 2020-04-22T14:03:51.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.310+0000 7f8807fff700 1 -- 172.21.15.103:0/1068895461 >> v1:172.21.15.103:6789/0 conn(0x7f88140ac950 legacy=0x7f8814146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:51.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.310+0000 7f8807fff700 1 --2- 172.21.15.103:0/1068895461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87fc003720 0x7f87fc003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:51.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.310+0000 7f8807fff700 1 --2- 172.21.15.103:0/1068895461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87fc004060 0x7f87fc004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:51.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.311+0000 7f8807fff700 1 --2- 172.21.15.103:0/1068895461 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88140b9140 0x7f87fc004ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:51.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.311+0000 7f8807fff700 1 -- 172.21.15.103:0/1068895461 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88140602f0 con 0x7f87fc004060 2020-04-22T14:03:51.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.311+0000 7f8807fff700 1 -- 172.21.15.103:0/1068895461 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8814060050 con 0x7f87fc003720 2020-04-22T14:03:51.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.311+0000 7f8807fff700 1 -- 172.21.15.103:0/1068895461 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc004f20 con 0x7f88140b9140 2020-04-22T14:03:51.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.311+0000 7f8819646700 1 --2- 172.21.15.103:0/1068895461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87fc003720 0x7f87fc003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:51.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.311+0000 7f8818e45700 1 --2- 172.21.15.103:0/1068895461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87fc004060 0x7f87fc004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:51.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.311+0000 7f8819e47700 1 --2- 172.21.15.103:0/1068895461 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88140b9140 0x7f87fc004ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:51.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.311+0000 7f8819646700 1 -- 172.21.15.103:0/1068895461 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88140b9140 msgr2=0x7f87fc004ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:51.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.311+0000 7f8819646700 1 --2- 172.21.15.103:0/1068895461 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88140b9140 0x7f87fc004ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:51.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.311+0000 7f8819646700 1 -- 172.21.15.103:0/1068895461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87fc004060 msgr2=0x7f87fc004530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:51.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.311+0000 7f8819646700 1 --2- 172.21.15.103:0/1068895461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87fc004060 0x7f87fc004530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:51.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.311+0000 7f8819646700 1 -- 172.21.15.103:0/1068895461 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87fc003230 con 0x7f87fc003720 2020-04-22T14:03:51.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.311+0000 7f8819646700 1 --2- 172.21.15.103:0/1068895461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87fc003720 0x7f87fc003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8808002f30 tx=0x7f8808010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.311+0000 7f8819646700 1 --2- 172.21.15.103:0/1068895461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87fc003720 0x7f87fc003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8808002f30 tx=0x7f8808010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.311+0000 7f8819646700 1 --2- 172.21.15.103:0/1068895461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87fc003720 0x7f87fc003b40 secure :-1 s=READY pgs=434 cs=0 l=1 rx=0x7f8808002f30 tx=0x7f8808010020).ready entity=mon.1 client_cookie=1ce1f09b776f7eba server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:51.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.311+0000 7f8819646700 1 --2- 172.21.15.103:0/1068895461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87fc003720 0x7f87fc003b40 secure :-1 s=THROTTLE_DONE pgs=434 cs=0 l=1 rx=0x7f8808002f30 tx=0x7f8808010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.311+0000 7f8807fff700 1 -- 172.21.15.103:0/1068895461 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8808008d30 con 0x7f87fc003720 2020-04-22T14:03:51.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.311+0000 7f8819646700 1 --2- 172.21.15.103:0/1068895461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87fc003720 0x7f87fc003b40 secure :-1 s=THROTTLE_DONE pgs=434 cs=0 l=1 rx=0x7f8808002f30 tx=0x7f8808010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.311+0000 7f8819646700 1 --2- 172.21.15.103:0/1068895461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87fc003720 0x7f87fc003b40 secure :-1 s=THROTTLE_DONE pgs=434 cs=0 l=1 rx=0x7f8808002f30 tx=0x7f8808010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.311+0000 7f8807fff700 1 -- 172.21.15.103:0/1068895461 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8808008e90 con 0x7f87fc003720 2020-04-22T14:03:51.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.311+0000 7f8807fff700 1 -- 172.21.15.103:0/1068895461 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8808010a90 con 0x7f87fc003720 2020-04-22T14:03:51.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.311+0000 7f881b8aa700 1 -- 172.21.15.103:0/1068895461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87fc003720 msgr2=0x7f87fc003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:51.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.311+0000 7f881b8aa700 1 --2- 172.21.15.103:0/1068895461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87fc003720 0x7f87fc003b40 secure :-1 s=READY pgs=434 cs=0 l=1 rx=0x7f8808002f30 tx=0x7f8808010020).stop 2020-04-22T14:03:51.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.311+0000 7f8819e47700 1 -- 172.21.15.103:0/1068895461 reap_dead start 2020-04-22T14:03:51.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.312+0000 7f881b8aa700 1 -- 172.21.15.103:0/1068895461 shutdown_connections 2020-04-22T14:03:51.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.312+0000 7f881b8aa700 1 -- 172.21.15.103:0/1068895461 >> 172.21.15.103:0/1068895461 conn(0x7f881405b7b0 msgr2=0x7f88140b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:51.324 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.312+0000 7f881b8aa700 1 -- 172.21.15.103:0/1068895461 shutdown_connections 2020-04-22T14:03:51.324 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.312+0000 7f881b8aa700 1 -- 172.21.15.103:0/1068895461 wait complete. 2020-04-22T14:03:51.324 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.313+0000 7f881b8aa700 1 Processor -- start 2020-04-22T14:03:51.324 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.313+0000 7f881b8aa700 1 -- start start 2020-04-22T14:03:51.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.313+0000 7f881b8aa700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8814127fc0 0x7f88140b2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:51.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.313+0000 7f881b8aa700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f88141418f0 0x7f8814141d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:51.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.313+0000 7f881b8aa700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8814143aa0 con 0x7f8814127be0 2020-04-22T14:03:51.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.313+0000 7f881b8aa700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88140b0100 con 0x7f88141418f0 2020-04-22T14:03:51.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.313+0000 7f881b8aa700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88140b03a0 con 0x7f8814127fc0 2020-04-22T14:03:51.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.313+0000 7f8819646700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f8814127be0 0x7f88140b13c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41134/0 (socket says 172.21.15.103:41134) 2020-04-22T14:03:51.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.313+0000 7f8819646700 1 -- 172.21.15.103:0/3534028704 learned_addr learned my addr 172.21.15.103:0/3534028704 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:51.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.314+0000 7f8818e45700 1 --2- 172.21.15.103:0/3534028704 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8814127fc0 0x7f88140b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:51.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.314+0000 7f8819e47700 1 --2- 172.21.15.103:0/3534028704 >> v2:172.21.15.86:3300/0 conn(0x7f88141418f0 0x7f8814141d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:51.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.314+0000 7f88067fc700 1 -- 172.21.15.103:0/3534028704 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3142095041 0 0) 0x7f8814143aa0 con 0x7f8814127be0 2020-04-22T14:03:51.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.314+0000 7f88067fc700 1 -- 172.21.15.103:0/3534028704 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87f4002fe0 con 0x7f8814127be0 2020-04-22T14:03:51.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.314+0000 7f88067fc700 1 -- 172.21.15.103:0/3534028704 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 254019322 0 0) 0x7f87f4002fe0 con 0x7f8814127be0 2020-04-22T14:03:51.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.314+0000 7f88067fc700 1 -- 172.21.15.103:0/3534028704 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8814143aa0 con 0x7f8814127be0 2020-04-22T14:03:51.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.314+0000 7f88067fc700 1 -- 172.21.15.103:0/3534028704 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f88080078a0 con 0x7f8814127be0 2020-04-22T14:03:51.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.314+0000 7f88067fc700 1 -- 172.21.15.103:0/3534028704 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8814127fc0 msgr2=0x7f88140b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:51.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.314+0000 7f88067fc700 1 --2- 172.21.15.103:0/3534028704 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8814127fc0 0x7f88140b2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:51.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.314+0000 7f88067fc700 1 -- 172.21.15.103:0/3534028704 >> v2:172.21.15.86:3300/0 conn(0x7f88141418f0 msgr2=0x7f8814141d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:51.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.314+0000 7f88067fc700 1 --2- 172.21.15.103:0/3534028704 >> v2:172.21.15.86:3300/0 conn(0x7f88141418f0 0x7f8814141d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:51.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.314+0000 7f88067fc700 1 -- 172.21.15.103:0/3534028704 >> v1:172.21.15.103:6789/0 conn(0x7f8814127be0 legacy=0x7f88140b13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:51.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.314+0000 7f88067fc700 1 --2- 172.21.15.103:0/3534028704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87f40049b0 0x7f87f4004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:51.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.314+0000 7f88067fc700 1 --2- 172.21.15.103:0/3534028704 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87f4005250 0x7f87f4003960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:51.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.314+0000 7f88067fc700 1 --2- 172.21.15.103:0/3534028704 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8814127fc0 0x7f87f4003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:51.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.314+0000 7f88067fc700 1 -- 172.21.15.103:0/3534028704 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88140b0100 con 0x7f87f4005250 2020-04-22T14:03:51.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.314+0000 7f88067fc700 1 -- 172.21.15.103:0/3534028704 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88140b03a0 con 0x7f87f40049b0 2020-04-22T14:03:51.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.314+0000 7f88067fc700 1 -- 172.21.15.103:0/3534028704 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f4004420 con 0x7f8814127fc0 2020-04-22T14:03:51.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.314+0000 7f8819646700 1 --2- 172.21.15.103:0/3534028704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87f40049b0 0x7f87f4004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:51.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.314+0000 7f8818e45700 1 --2- 172.21.15.103:0/3534028704 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87f4005250 0x7f87f4003960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:51.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.314+0000 7f8819e47700 1 --2- 172.21.15.103:0/3534028704 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8814127fc0 0x7f87f4003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:51.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.314+0000 7f8819646700 1 -- 172.21.15.103:0/3534028704 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8814127fc0 msgr2=0x7f87f4003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:51.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.314+0000 7f8819646700 1 --2- 172.21.15.103:0/3534028704 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8814127fc0 0x7f87f4003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:51.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.314+0000 7f8819646700 1 -- 172.21.15.103:0/3534028704 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87f4005250 msgr2=0x7f87f4003960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:51.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.314+0000 7f8819646700 1 --2- 172.21.15.103:0/3534028704 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87f4005250 0x7f87f4003960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:51.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.314+0000 7f8819646700 1 -- 172.21.15.103:0/3534028704 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88140b20a0 con 0x7f87f40049b0 2020-04-22T14:03:51.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.314+0000 7f881b8aa700 1 -- 172.21.15.103:0/3534028704 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8814142170 con 0x7f87f40049b0 2020-04-22T14:03:51.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.314+0000 7f8819646700 1 --2- 172.21.15.103:0/3534028704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87f40049b0 0x7f87f4004dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8808008360 tx=0x7f8808010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.315+0000 7f8819646700 1 --2- 172.21.15.103:0/3534028704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87f40049b0 0x7f87f4004dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8808008360 tx=0x7f8808010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.315+0000 7f8819646700 1 --2- 172.21.15.103:0/3534028704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87f40049b0 0x7f87f4004dd0 secure :-1 s=READY pgs=436 cs=0 l=1 rx=0x7f8808008360 tx=0x7f8808010020).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:51.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.315+0000 7f8819646700 1 --2- 172.21.15.103:0/3534028704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87f40049b0 0x7f87f4004dd0 secure :-1 s=THROTTLE_DONE pgs=436 cs=0 l=1 rx=0x7f8808008360 tx=0x7f8808010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.315+0000 7f88067fc700 1 -- 172.21.15.103:0/3534028704 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8808005aa0 con 0x7f87f40049b0 2020-04-22T14:03:51.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.315+0000 7f8819646700 1 --2- 172.21.15.103:0/3534028704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87f40049b0 0x7f87f4004dd0 secure :-1 s=THROTTLE_DONE pgs=436 cs=0 l=1 rx=0x7f8808008360 tx=0x7f8808010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.315+0000 7f8819646700 1 --2- 172.21.15.103:0/3534028704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87f40049b0 0x7f87f4004dd0 secure :-1 s=THROTTLE_DONE pgs=436 cs=0 l=1 rx=0x7f8808008360 tx=0x7f8808010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.315+0000 7f88067fc700 1 -- 172.21.15.103:0/3534028704 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8808005c00 con 0x7f87f40049b0 2020-04-22T14:03:51.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.315+0000 7f881b8aa700 1 -- 172.21.15.103:0/3534028704 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88140b26d0 con 0x7f87f40049b0 2020-04-22T14:03:51.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.315+0000 7f88067fc700 1 -- 172.21.15.103:0/3534028704 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8808011460 con 0x7f87f40049b0 2020-04-22T14:03:51.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.315+0000 7f8819646700 1 --2- 172.21.15.103:0/3534028704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87f40049b0 0x7f87f4004dd0 secure :-1 s=THROTTLE_DONE pgs=436 cs=0 l=1 rx=0x7f8808008360 tx=0x7f8808010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.316+0000 7f88067fc700 1 -- 172.21.15.103:0/3534028704 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f88080115c0 con 0x7f87f40049b0 2020-04-22T14:03:51.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.316+0000 7f881b8aa700 1 -- 172.21.15.103:0/3534028704 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8814056c90 con 0x7f87f40049b0 2020-04-22T14:03:51.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.316+0000 7f8819646700 1 --2- 172.21.15.103:0/3534028704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87f40049b0 0x7f87f4004dd0 secure :-1 s=THROTTLE_DONE pgs=436 cs=0 l=1 rx=0x7f8808008360 tx=0x7f8808010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.316+0000 7f88067fc700 1 --2- 172.21.15.103:0/3534028704 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f87f40559f0 0x7f87f4057eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:51.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.316+0000 7f88067fc700 1 -- 172.21.15.103:0/3534028704 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8808061d70 con 0x7f87f40049b0 2020-04-22T14:03:51.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.316+0000 7f8818e45700 1 --2- 172.21.15.103:0/3534028704 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f87f40559f0 0x7f87f4057eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:51.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.316+0000 7f8818e45700 1 --2- 172.21.15.103:0/3534028704 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f87f40559f0 0x7f87f4057eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f88100013e0 tx=0x7f88140b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.316+0000 7f8818e45700 1 --2- 172.21.15.103:0/3534028704 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f87f40559f0 0x7f87f4057eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f88100013e0 tx=0x7f88140b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.316+0000 7f8818e45700 1 --2- 172.21.15.103:0/3534028704 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f87f40559f0 0x7f87f4057eb0 secure :-1 s=READY pgs=177 cs=0 l=1 rx=0x7f88100013e0 tx=0x7f88140b96b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:51.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.320+0000 7f8819646700 1 --2- 172.21.15.103:0/3534028704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87f40049b0 0x7f87f4004dd0 secure :-1 s=THROTTLE_DONE pgs=436 cs=0 l=1 rx=0x7f8808008360 tx=0x7f8808010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.320+0000 7f88067fc700 1 -- 172.21.15.103:0/3534028704 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f880803d210 con 0x7f87f40049b0 2020-04-22T14:03:51.466 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.463+0000 7f881b8aa700 1 -- 172.21.15.103:0/3534028704 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f881406a960 con 0x7f87f40049b0 2020-04-22T14:03:51.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.464+0000 7f8819646700 1 --2- 172.21.15.103:0/3534028704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87f40049b0 0x7f87f4004dd0 secure :-1 s=THROTTLE_DONE pgs=436 cs=0 l=1 rx=0x7f8808008360 tx=0x7f8808010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.464+0000 7f88067fc700 1 -- 172.21.15.103:0/3534028704 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v35) v1 ==== 110+0+10 (secure 0 0 0) 0x7f8808040830 con 0x7f87f40049b0 2020-04-22T14:03:51.467 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:03:51.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.465+0000 7f881b8aa700 1 -- 172.21.15.103:0/3534028704 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f87f40559f0 msgr2=0x7f87f4057eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:51.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.465+0000 7f881b8aa700 1 --2- 172.21.15.103:0/3534028704 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f87f40559f0 0x7f87f4057eb0 secure :-1 s=READY pgs=177 cs=0 l=1 rx=0x7f88100013e0 tx=0x7f88140b96b0).stop 2020-04-22T14:03:51.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.465+0000 7f881b8aa700 1 -- 172.21.15.103:0/3534028704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87f40049b0 msgr2=0x7f87f4004dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:51.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.465+0000 7f881b8aa700 1 --2- 172.21.15.103:0/3534028704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87f40049b0 0x7f87f4004dd0 secure :-1 s=READY pgs=436 cs=0 l=1 rx=0x7f8808008360 tx=0x7f8808010020).stop 2020-04-22T14:03:51.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.465+0000 7f8819e47700 1 -- 172.21.15.103:0/3534028704 reap_dead start 2020-04-22T14:03:51.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.465+0000 7f8819e47700 1 -- 172.21.15.103:0/3534028704 reap_dead start 2020-04-22T14:03:51.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.465+0000 7f881b8aa700 1 -- 172.21.15.103:0/3534028704 shutdown_connections 2020-04-22T14:03:51.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.465+0000 7f881b8aa700 1 -- 172.21.15.103:0/3534028704 >> 172.21.15.103:0/3534028704 conn(0x7f881405b7b0 msgr2=0x7f8814143e90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:51.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.465+0000 7f881b8aa700 1 -- 172.21.15.103:0/3534028704 shutdown_connections 2020-04-22T14:03:51.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.465+0000 7f881b8aa700 1 -- 172.21.15.103:0/3534028704 wait complete. 2020-04-22T14:03:51.479 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:51.492 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:03:51.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.639+0000 7f2e4d818700 1 Processor -- start 2020-04-22T14:03:51.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.639+0000 7f2e4d818700 1 -- start start 2020-04-22T14:03:51.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.640+0000 7f2e4d818700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2e480b9140 0x7f2e4812b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:51.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.640+0000 7f2e4d818700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2e480ac950 0x7f2e4812b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:51.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.640+0000 7f2e4d818700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e481467e0 con 0x7f2e48146c40 2020-04-22T14:03:51.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.640+0000 7f2e4d818700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e480602f0 con 0x7f2e480b9140 2020-04-22T14:03:51.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.640+0000 7f2e4d818700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e48060050 con 0x7f2e480ac950 2020-04-22T14:03:51.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.640+0000 7f2e46ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2e480b9140 0x7f2e4812b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:51.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.640+0000 7f2e477fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f2e48146c40 0x7f2e48143090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41148/0 (socket says 172.21.15.103:41148) 2020-04-22T14:03:51.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.640+0000 7f2e477fe700 1 -- 172.21.15.103:0/2724649961 learned_addr learned my addr 172.21.15.103:0/2724649961 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:51.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.640+0000 7f2e467fc700 1 --2- 172.21.15.103:0/2724649961 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2e480ac950 0x7f2e4812b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:51.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.640+0000 7f2e46ffd700 1 -- 172.21.15.103:0/2724649961 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2e480ac950 msgr2=0x7f2e4812b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:51.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.640+0000 7f2e46ffd700 1 --2- 172.21.15.103:0/2724649961 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2e480ac950 0x7f2e4812b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:51.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.640+0000 7f2e45ffb700 1 -- 172.21.15.103:0/2724649961 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1835750184 0 0) 0x7f2e481467e0 con 0x7f2e48146c40 2020-04-22T14:03:51.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.640+0000 7f2e46ffd700 1 -- 172.21.15.103:0/2724649961 >> v1:172.21.15.103:6789/0 conn(0x7f2e48146c40 legacy=0x7f2e48143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:51.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.640+0000 7f2e46ffd700 1 -- 172.21.15.103:0/2724649961 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e480b9520 con 0x7f2e480b9140 2020-04-22T14:03:51.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.641+0000 7f2e46ffd700 1 --2- 172.21.15.103:0/2724649961 >> v2:172.21.15.103:3300/0 conn(0x7f2e480b9140 0x7f2e4812b210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2e3c002f30 tx=0x7f2e3c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.641+0000 7f2e46ffd700 1 --2- 172.21.15.103:0/2724649961 >> v2:172.21.15.103:3300/0 conn(0x7f2e480b9140 0x7f2e4812b210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2e3c002f30 tx=0x7f2e3c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.641+0000 7f2e46ffd700 1 --2- 172.21.15.103:0/2724649961 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e480b9140 0x7f2e4812b210 secure :-1 s=READY pgs=438 cs=0 l=1 rx=0x7f2e3c002f30 tx=0x7f2e3c007a40).ready entity=mon.1 client_cookie=223919a89ca34a9c server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:51.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.641+0000 7f2e46ffd700 1 --2- 172.21.15.103:0/2724649961 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e480b9140 0x7f2e4812b210 secure :-1 s=THROTTLE_DONE pgs=438 cs=0 l=1 rx=0x7f2e3c002f30 tx=0x7f2e3c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.641+0000 7f2e45ffb700 1 -- 172.21.15.103:0/2724649961 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e3c0113c0 con 0x7f2e480b9140 2020-04-22T14:03:51.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.641+0000 7f2e46ffd700 1 --2- 172.21.15.103:0/2724649961 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e480b9140 0x7f2e4812b210 secure :-1 s=THROTTLE_DONE pgs=438 cs=0 l=1 rx=0x7f2e3c002f30 tx=0x7f2e3c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.641+0000 7f2e45ffb700 1 -- 172.21.15.103:0/2724649961 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e3c011560 con 0x7f2e480b9140 2020-04-22T14:03:51.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.641+0000 7f2e46ffd700 1 --2- 172.21.15.103:0/2724649961 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e480b9140 0x7f2e4812b210 secure :-1 s=THROTTLE_DONE pgs=438 cs=0 l=1 rx=0x7f2e3c002f30 tx=0x7f2e3c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.641+0000 7f2e45ffb700 1 -- 172.21.15.103:0/2724649961 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e3c011940 con 0x7f2e480b9140 2020-04-22T14:03:51.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.641+0000 7f2e4d818700 1 -- 172.21.15.103:0/2724649961 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e480b9140 msgr2=0x7f2e4812b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:51.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.641+0000 7f2e4d818700 1 --2- 172.21.15.103:0/2724649961 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e480b9140 0x7f2e4812b210 secure :-1 s=READY pgs=438 cs=0 l=1 rx=0x7f2e3c002f30 tx=0x7f2e3c007a40).stop 2020-04-22T14:03:51.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.641+0000 7f2e4d818700 1 -- 172.21.15.103:0/2724649961 shutdown_connections 2020-04-22T14:03:51.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.641+0000 7f2e4d818700 1 --2- 172.21.15.103:0/2724649961 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e480b9140 0x7f2e4812b210 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:51.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.641+0000 7f2e4d818700 1 --2- 172.21.15.103:0/2724649961 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2e480ac950 0x7f2e4812b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:51.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.641+0000 7f2e4d818700 1 -- 172.21.15.103:0/2724649961 >> 172.21.15.103:0/2724649961 conn(0x7f2e4805b7b0 msgr2=0x7f2e480b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:51.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.641+0000 7f2e4d818700 1 -- 172.21.15.103:0/2724649961 shutdown_connections 2020-04-22T14:03:51.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.641+0000 7f2e4d818700 1 -- 172.21.15.103:0/2724649961 wait complete. 2020-04-22T14:03:51.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.642+0000 7f2e4d818700 1 Processor -- start 2020-04-22T14:03:51.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.642+0000 7f2e4d818700 1 -- start start 2020-04-22T14:03:51.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.643+0000 7f2e4d818700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2e480ac950 0x7f2e48147af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:51.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.643+0000 7f2e4d818700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2e480b9140 0x7f2e48154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:51.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.643+0000 7f2e4d818700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2e48146c40 0x7f2e48155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:51.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.643+0000 7f2e4d818700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e48148450 con 0x7f2e480ac950 2020-04-22T14:03:51.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.643+0000 7f2e4d818700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e480659f0 con 0x7f2e480b9140 2020-04-22T14:03:51.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.643+0000 7f2e4d818700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e48148a70 con 0x7f2e48146c40 2020-04-22T14:03:51.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.643+0000 7f2e467fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2e480b9140 0x7f2e48154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:51.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.643+0000 7f2e467fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2e480b9140 0x7f2e48154ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48966/0 (socket says 172.21.15.103:48966) 2020-04-22T14:03:51.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.643+0000 7f2e467fc700 1 -- 172.21.15.103:0/2230898145 learned_addr learned my addr 172.21.15.103:0/2230898145 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:51.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.643+0000 7f2e477fe700 1 --2- 172.21.15.103:0/2230898145 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2e48146c40 0x7f2e48155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:51.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.643+0000 7f2e46ffd700 1 --2- 172.21.15.103:0/2230898145 >> v2:172.21.15.86:3300/0 conn(0x7f2e480ac950 0x7f2e48147af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:51.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.643+0000 7f2e467fc700 1 -- 172.21.15.103:0/2230898145 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2e48146c40 msgr2=0x7f2e48155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:51.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.643+0000 7f2e467fc700 1 --2- 172.21.15.103:0/2230898145 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2e48146c40 0x7f2e48155100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:51.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.643+0000 7f2e467fc700 1 -- 172.21.15.103:0/2230898145 >> v2:172.21.15.86:3300/0 conn(0x7f2e480ac950 msgr2=0x7f2e48147af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:51.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.643+0000 7f2e467fc700 1 --2- 172.21.15.103:0/2230898145 >> v2:172.21.15.86:3300/0 conn(0x7f2e480ac950 0x7f2e48147af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:51.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.643+0000 7f2e467fc700 1 -- 172.21.15.103:0/2230898145 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e48147f50 con 0x7f2e480b9140 2020-04-22T14:03:51.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.643+0000 7f2e477fe700 1 --2- 172.21.15.103:0/2230898145 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2e48146c40 0x7f2e48155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:03:51.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.643+0000 7f2e46ffd700 1 --2- 172.21.15.103:0/2230898145 >> v2:172.21.15.86:3300/0 conn(0x7f2e480ac950 0x7f2e48147af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:03:51.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.643+0000 7f2e467fc700 1 --2- 172.21.15.103:0/2230898145 >> v2:172.21.15.103:3300/0 conn(0x7f2e480b9140 0x7f2e48154ca0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2e38003070 tx=0x7f2e38010e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.643+0000 7f2e467fc700 1 --2- 172.21.15.103:0/2230898145 >> v2:172.21.15.103:3300/0 conn(0x7f2e480b9140 0x7f2e48154ca0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2e38003070 tx=0x7f2e38010e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.643+0000 7f2e467fc700 1 --2- 172.21.15.103:0/2230898145 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e480b9140 0x7f2e48154ca0 secure :-1 s=READY pgs=439 cs=0 l=1 rx=0x7f2e38003070 tx=0x7f2e38010e00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:51.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.644+0000 7f2e467fc700 1 --2- 172.21.15.103:0/2230898145 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e480b9140 0x7f2e48154ca0 secure :-1 s=THROTTLE_DONE pgs=439 cs=0 l=1 rx=0x7f2e38003070 tx=0x7f2e38010e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.644+0000 7f2e467fc700 1 --2- 172.21.15.103:0/2230898145 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e480b9140 0x7f2e48154ca0 secure :-1 s=THROTTLE_DONE pgs=439 cs=0 l=1 rx=0x7f2e38003070 tx=0x7f2e38010e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.644+0000 7f2e37fff700 1 -- 172.21.15.103:0/2230898145 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e38005e90 con 0x7f2e480b9140 2020-04-22T14:03:51.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.644+0000 7f2e467fc700 1 --2- 172.21.15.103:0/2230898145 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e480b9140 0x7f2e48154ca0 secure :-1 s=THROTTLE_DONE pgs=439 cs=0 l=1 rx=0x7f2e38003070 tx=0x7f2e38010e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.644+0000 7f2e37fff700 1 -- 172.21.15.103:0/2230898145 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e38007180 con 0x7f2e480b9140 2020-04-22T14:03:51.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.644+0000 7f2e4d818700 1 -- 172.21.15.103:0/2230898145 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e48155560 con 0x7f2e480b9140 2020-04-22T14:03:51.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.644+0000 7f2e37fff700 1 -- 172.21.15.103:0/2230898145 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e38012420 con 0x7f2e480b9140 2020-04-22T14:03:51.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.644+0000 7f2e4d818700 1 -- 172.21.15.103:0/2230898145 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e48155a30 con 0x7f2e480b9140 2020-04-22T14:03:51.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.644+0000 7f2e467fc700 1 --2- 172.21.15.103:0/2230898145 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e480b9140 0x7f2e48154ca0 secure :-1 s=THROTTLE_DONE pgs=439 cs=0 l=1 rx=0x7f2e38003070 tx=0x7f2e38010e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.645+0000 7f2e37fff700 1 -- 172.21.15.103:0/2230898145 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f2e38010190 con 0x7f2e480b9140 2020-04-22T14:03:51.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.645+0000 7f2e467fc700 1 --2- 172.21.15.103:0/2230898145 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e480b9140 0x7f2e48154ca0 secure :-1 s=THROTTLE_DONE pgs=439 cs=0 l=1 rx=0x7f2e38003070 tx=0x7f2e38010e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.645+0000 7f2e4d818700 1 -- 172.21.15.103:0/2230898145 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e481487f0 con 0x7f2e480b9140 2020-04-22T14:03:51.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.645+0000 7f2e37fff700 1 --2- 172.21.15.103:0/2230898145 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2e2404da00 0x7f2e2404fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:51.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.645+0000 7f2e37fff700 1 -- 172.21.15.103:0/2230898145 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2e380613c0 con 0x7f2e480b9140 2020-04-22T14:03:51.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.645+0000 7f2e46ffd700 1 --2- 172.21.15.103:0/2230898145 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2e2404da00 0x7f2e2404fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:51.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.646+0000 7f2e46ffd700 1 --2- 172.21.15.103:0/2230898145 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2e2404da00 0x7f2e2404fec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2e3c002f30 tx=0x7f2e3c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.646+0000 7f2e46ffd700 1 --2- 172.21.15.103:0/2230898145 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2e2404da00 0x7f2e2404fec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2e3c002f30 tx=0x7f2e3c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.646+0000 7f2e46ffd700 1 --2- 172.21.15.103:0/2230898145 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2e2404da00 0x7f2e2404fec0 secure :-1 s=READY pgs=178 cs=0 l=1 rx=0x7f2e3c002f30 tx=0x7f2e3c007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:51.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.650+0000 7f2e467fc700 1 --2- 172.21.15.103:0/2230898145 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e480b9140 0x7f2e48154ca0 secure :-1 s=THROTTLE_DONE pgs=439 cs=0 l=1 rx=0x7f2e38003070 tx=0x7f2e38010e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.650+0000 7f2e37fff700 1 -- 172.21.15.103:0/2230898145 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f2e3803c7a0 con 0x7f2e480b9140 2020-04-22T14:03:51.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.791+0000 7f2e4d818700 1 -- 172.21.15.103:0/2230898145 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2e48056c90 con 0x7f2e480b9140 2020-04-22T14:03:51.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.792+0000 7f2e467fc700 1 --2- 172.21.15.103:0/2230898145 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e480b9140 0x7f2e48154ca0 secure :-1 s=THROTTLE_DONE pgs=439 cs=0 l=1 rx=0x7f2e38003070 tx=0x7f2e38010e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.792+0000 7f2e37fff700 1 -- 172.21.15.103:0/2230898145 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v35) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2e3803fdc0 con 0x7f2e480b9140 2020-04-22T14:03:51.796 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:03:51.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.793+0000 7f2e4d818700 1 -- 172.21.15.103:0/2230898145 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2e2404da00 msgr2=0x7f2e2404fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:51.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.793+0000 7f2e4d818700 1 --2- 172.21.15.103:0/2230898145 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2e2404da00 0x7f2e2404fec0 secure :-1 s=READY pgs=178 cs=0 l=1 rx=0x7f2e3c002f30 tx=0x7f2e3c007a40).stop 2020-04-22T14:03:51.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.793+0000 7f2e4d818700 1 -- 172.21.15.103:0/2230898145 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e480b9140 msgr2=0x7f2e48154ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:51.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.793+0000 7f2e4d818700 1 --2- 172.21.15.103:0/2230898145 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e480b9140 0x7f2e48154ca0 secure :-1 s=READY pgs=439 cs=0 l=1 rx=0x7f2e38003070 tx=0x7f2e38010e00).stop 2020-04-22T14:03:51.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.793+0000 7f2e4d818700 1 -- 172.21.15.103:0/2230898145 shutdown_connections 2020-04-22T14:03:51.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.793+0000 7f2e4d818700 1 --2- 172.21.15.103:0/2230898145 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2e2404da00 0x7f2e2404fec0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:51.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.793+0000 7f2e4d818700 1 --2- 172.21.15.103:0/2230898145 >> v2:172.21.15.86:3300/0 conn(0x7f2e480ac950 0x7f2e48147af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:51.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.793+0000 7f2e4d818700 1 --2- 172.21.15.103:0/2230898145 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2e48146c40 0x7f2e48155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:51.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.793+0000 7f2e4d818700 1 --2- 172.21.15.103:0/2230898145 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e480b9140 0x7f2e48154ca0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:51.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.793+0000 7f2e4d818700 1 -- 172.21.15.103:0/2230898145 >> 172.21.15.103:0/2230898145 conn(0x7f2e4805b7b0 msgr2=0x7f2e480b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:51.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.793+0000 7f2e4d818700 1 -- 172.21.15.103:0/2230898145 shutdown_connections 2020-04-22T14:03:51.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.793+0000 7f2e4d818700 1 -- 172.21.15.103:0/2230898145 wait complete. 2020-04-22T14:03:51.806 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:51.819 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-22T14:03:51.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.966+0000 7f084ab31700 1 Processor -- start 2020-04-22T14:03:51.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.966+0000 7f084ab31700 1 -- start start 2020-04-22T14:03:51.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.966+0000 7f084ab31700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f08440bcc50 0x7f0844146f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:51.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.966+0000 7f084ab31700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f084412c5d0 0x7f084414a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:51.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.966+0000 7f084ab31700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0844146560 con 0x7f084405fc70 2020-04-22T14:03:51.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.966+0000 7f084ab31700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0844146370 con 0x7f08440bcc50 2020-04-22T14:03:51.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.966+0000 7f084ab31700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0844146800 con 0x7f084412c5d0 2020-04-22T14:03:51.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.966+0000 7f084a330700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f084412c5d0 0x7f084414a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:51.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.966+0000 7f084a330700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f084412c5d0 0x7f084414a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48972/0 (socket says 172.21.15.103:48972) 2020-04-22T14:03:51.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.966+0000 7f084a330700 1 -- 172.21.15.103:0/2145612924 learned_addr learned my addr 172.21.15.103:0/2145612924 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:51.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.967+0000 7f0849b2f700 1 --2- 172.21.15.103:0/2145612924 >> v2:172.21.15.86:3300/0 conn(0x7f08440bcc50 0x7f0844146f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:51.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.967+0000 7f084a330700 1 -- 172.21.15.103:0/2145612924 >> v2:172.21.15.86:3300/0 conn(0x7f08440bcc50 msgr2=0x7f0844146f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:51.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.967+0000 7f084a330700 1 --2- 172.21.15.103:0/2145612924 >> v2:172.21.15.86:3300/0 conn(0x7f08440bcc50 0x7f0844146f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:51.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.967+0000 7f084a330700 1 -- 172.21.15.103:0/2145612924 >> v1:172.21.15.86:6789/0 conn(0x7f084405fc70 legacy=0x7f084412bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:51.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.967+0000 7f084a330700 1 -- 172.21.15.103:0/2145612924 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0844146aa0 con 0x7f084412c5d0 2020-04-22T14:03:51.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.967+0000 7f0849b2f700 1 --2- 172.21.15.103:0/2145612924 >> v2:172.21.15.86:3300/0 conn(0x7f08440bcc50 0x7f0844146f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:03:51.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.967+0000 7f084a330700 1 --2- 172.21.15.103:0/2145612924 >> v2:172.21.15.103:3300/0 conn(0x7f084412c5d0 0x7f084414a350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f08440b8c50 tx=0x7f0838007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.967+0000 7f084a330700 1 --2- 172.21.15.103:0/2145612924 >> v2:172.21.15.103:3300/0 conn(0x7f084412c5d0 0x7f084414a350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f08440b8c50 tx=0x7f0838007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.967+0000 7f084a330700 1 --2- 172.21.15.103:0/2145612924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f084412c5d0 0x7f084414a350 secure :-1 s=READY pgs=440 cs=0 l=1 rx=0x7f08440b8c50 tx=0x7f0838007a40).ready entity=mon.1 client_cookie=b031743c3cc90f5 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:51.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.967+0000 7f084a330700 1 --2- 172.21.15.103:0/2145612924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f084412c5d0 0x7f084414a350 secure :-1 s=THROTTLE_DONE pgs=440 cs=0 l=1 rx=0x7f08440b8c50 tx=0x7f0838007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.967+0000 7f0848b2d700 1 -- 172.21.15.103:0/2145612924 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08380116e0 con 0x7f084412c5d0 2020-04-22T14:03:51.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.967+0000 7f084a330700 1 --2- 172.21.15.103:0/2145612924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f084412c5d0 0x7f084414a350 secure :-1 s=THROTTLE_DONE pgs=440 cs=0 l=1 rx=0x7f08440b8c50 tx=0x7f0838007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.967+0000 7f084a330700 1 --2- 172.21.15.103:0/2145612924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f084412c5d0 0x7f084414a350 secure :-1 s=THROTTLE_DONE pgs=440 cs=0 l=1 rx=0x7f08440b8c50 tx=0x7f0838007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.967+0000 7f0848b2d700 1 -- 172.21.15.103:0/2145612924 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0838011840 con 0x7f084412c5d0 2020-04-22T14:03:51.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.967+0000 7f0848b2d700 1 -- 172.21.15.103:0/2145612924 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0838011c20 con 0x7f084412c5d0 2020-04-22T14:03:51.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.967+0000 7f084ab31700 1 -- 172.21.15.103:0/2145612924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f084412c5d0 msgr2=0x7f084414a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:51.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.967+0000 7f084ab31700 1 --2- 172.21.15.103:0/2145612924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f084412c5d0 0x7f084414a350 secure :-1 s=READY pgs=440 cs=0 l=1 rx=0x7f08440b8c50 tx=0x7f0838007a40).stop 2020-04-22T14:03:51.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.968+0000 7f084ab31700 1 -- 172.21.15.103:0/2145612924 shutdown_connections 2020-04-22T14:03:51.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.968+0000 7f084ab31700 1 --2- 172.21.15.103:0/2145612924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f084412c5d0 0x7f084414a350 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:51.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.968+0000 7f084ab31700 1 --2- 172.21.15.103:0/2145612924 >> v2:172.21.15.86:3300/0 conn(0x7f08440bcc50 0x7f0844146f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:51.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.968+0000 7f084ab31700 1 -- 172.21.15.103:0/2145612924 >> 172.21.15.103:0/2145612924 conn(0x7f0844065af0 msgr2=0x7f0844065f00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:51.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.968+0000 7f084ab31700 1 -- 172.21.15.103:0/2145612924 shutdown_connections 2020-04-22T14:03:51.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.968+0000 7f084ab31700 1 -- 172.21.15.103:0/2145612924 wait complete. 2020-04-22T14:03:51.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.969+0000 7f084ab31700 1 Processor -- start 2020-04-22T14:03:51.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.969+0000 7f084ab31700 1 -- start start 2020-04-22T14:03:51.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.969+0000 7f084ab31700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f084405fc70 0x7f08441459b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:51.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.969+0000 7f084ab31700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f08440bcc50 0x7f084412dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:51.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.969+0000 7f084ab31700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f084412d5e0 con 0x7f084412c5d0 2020-04-22T14:03:51.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.969+0000 7f084ab31700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f084412d880 con 0x7f084405fc70 2020-04-22T14:03:51.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.969+0000 7f084ab31700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f084412db20 con 0x7f08440bcc50 2020-04-22T14:03:51.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.970+0000 7f0849b2f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f084405fc70 0x7f08441459b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:51.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.970+0000 7f084a330700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f084412c5d0 0x7f084412a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41172/0 (socket says 172.21.15.103:41172) 2020-04-22T14:03:51.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.970+0000 7f084a330700 1 -- 172.21.15.103:0/930265870 learned_addr learned my addr 172.21.15.103:0/930265870 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:51.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.970+0000 7f084932e700 1 --2- 172.21.15.103:0/930265870 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f08440bcc50 0x7f084412dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:51.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.970+0000 7f0849b2f700 1 -- 172.21.15.103:0/930265870 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f08440bcc50 msgr2=0x7f084412dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:51.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.970+0000 7f0849b2f700 1 --2- 172.21.15.103:0/930265870 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f08440bcc50 0x7f084412dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:51.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.970+0000 7f0849b2f700 1 -- 172.21.15.103:0/930265870 >> v1:172.21.15.103:6789/0 conn(0x7f084412c5d0 legacy=0x7f084412a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:51.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.970+0000 7f0836ffd700 1 -- 172.21.15.103:0/930265870 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3133407716 0 0) 0x7f084412d5e0 con 0x7f084412c5d0 2020-04-22T14:03:51.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.970+0000 7f0849b2f700 1 -- 172.21.15.103:0/930265870 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f084412b240 con 0x7f084405fc70 2020-04-22T14:03:51.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.970+0000 7f0849b2f700 1 --2- 172.21.15.103:0/930265870 >> v2:172.21.15.103:3300/0 conn(0x7f084405fc70 0x7f08441459b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f083c0032b0 tx=0x7f083c010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.970+0000 7f0849b2f700 1 --2- 172.21.15.103:0/930265870 >> v2:172.21.15.103:3300/0 conn(0x7f084405fc70 0x7f08441459b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f083c0032b0 tx=0x7f083c010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.970+0000 7f0849b2f700 1 --2- 172.21.15.103:0/930265870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f084405fc70 0x7f08441459b0 secure :-1 s=READY pgs=442 cs=0 l=1 rx=0x7f083c0032b0 tx=0x7f083c010d80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:51.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.970+0000 7f0849b2f700 1 --2- 172.21.15.103:0/930265870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f084405fc70 0x7f08441459b0 secure :-1 s=THROTTLE_DONE pgs=442 cs=0 l=1 rx=0x7f083c0032b0 tx=0x7f083c010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.970+0000 7f0836ffd700 1 -- 172.21.15.103:0/930265870 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f083c012bf0 con 0x7f084405fc70 2020-04-22T14:03:51.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.970+0000 7f0849b2f700 1 --2- 172.21.15.103:0/930265870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f084405fc70 0x7f08441459b0 secure :-1 s=THROTTLE_DONE pgs=442 cs=0 l=1 rx=0x7f083c0032b0 tx=0x7f083c010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.970+0000 7f0836ffd700 1 -- 172.21.15.103:0/930265870 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f083c012d50 con 0x7f084405fc70 2020-04-22T14:03:51.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.970+0000 7f0849b2f700 1 --2- 172.21.15.103:0/930265870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f084405fc70 0x7f08441459b0 secure :-1 s=THROTTLE_DONE pgs=442 cs=0 l=1 rx=0x7f083c0032b0 tx=0x7f083c010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.970+0000 7f084ab31700 1 -- 172.21.15.103:0/930265870 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0844148410 con 0x7f084405fc70 2020-04-22T14:03:51.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.970+0000 7f0836ffd700 1 -- 172.21.15.103:0/930265870 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f083c0093b0 con 0x7f084405fc70 2020-04-22T14:03:51.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.970+0000 7f084ab31700 1 -- 172.21.15.103:0/930265870 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08441488e0 con 0x7f084405fc70 2020-04-22T14:03:51.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.971+0000 7f0849b2f700 1 --2- 172.21.15.103:0/930265870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f084405fc70 0x7f08441459b0 secure :-1 s=THROTTLE_DONE pgs=442 cs=0 l=1 rx=0x7f083c0032b0 tx=0x7f083c010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:51.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.971+0000 7f0836ffd700 1 -- 172.21.15.103:0/930265870 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f083c005a40 con 0x7f084405fc70 2020-04-22T14:03:52.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.971+0000 7f0849b2f700 1 --2- 172.21.15.103:0/930265870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f084405fc70 0x7f08441459b0 secure :-1 s=THROTTLE_DONE pgs=442 cs=0 l=1 rx=0x7f083c0032b0 tx=0x7f083c010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:52.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.971+0000 7f084ab31700 1 -- 172.21.15.103:0/930265870 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f084412d410 con 0x7f084405fc70 2020-04-22T14:03:52.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.971+0000 7f0836ffd700 1 --2- 172.21.15.103:0/930265870 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f082404d8b0 0x7f082404fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:52.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.971+0000 7f0836ffd700 1 -- 172.21.15.103:0/930265870 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f083c061490 con 0x7f084405fc70 2020-04-22T14:03:52.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.972+0000 7f084932e700 1 --2- 172.21.15.103:0/930265870 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f082404d8b0 0x7f082404fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:52.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.972+0000 7f084932e700 1 --2- 172.21.15.103:0/930265870 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f082404d8b0 0x7f082404fd70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0840001f50 tx=0x7f08400023e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:52.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.972+0000 7f084932e700 1 --2- 172.21.15.103:0/930265870 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f082404d8b0 0x7f082404fd70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0840001f50 tx=0x7f08400023e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:52.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.972+0000 7f084932e700 1 --2- 172.21.15.103:0/930265870 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f082404d8b0 0x7f082404fd70 secure :-1 s=READY pgs=179 cs=0 l=1 rx=0x7f0840001f50 tx=0x7f08400023e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:52.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.975+0000 7f0849b2f700 1 --2- 172.21.15.103:0/930265870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f084405fc70 0x7f08441459b0 secure :-1 s=THROTTLE_DONE pgs=442 cs=0 l=1 rx=0x7f083c0032b0 tx=0x7f083c010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:52.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:51.976+0000 7f0836ffd700 1 -- 172.21.15.103:0/930265870 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f083c03c8d0 con 0x7f084405fc70 2020-04-22T14:03:52.121 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.116+0000 7f084ab31700 1 -- 172.21.15.103:0/930265870 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0844056c90 con 0x7f084405fc70 2020-04-22T14:03:52.121 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.117+0000 7f0849b2f700 1 --2- 172.21.15.103:0/930265870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f084405fc70 0x7f08441459b0 secure :-1 s=THROTTLE_DONE pgs=442 cs=0 l=1 rx=0x7f083c0032b0 tx=0x7f083c010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:52.121 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.117+0000 7f0836ffd700 1 -- 172.21.15.103:0/930265870 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+10 (secure 0 0 0) 0x7f083c03fef0 con 0x7f084405fc70 2020-04-22T14:03:52.121 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:03:52.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.118+0000 7f084ab31700 1 -- 172.21.15.103:0/930265870 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f082404d8b0 msgr2=0x7f082404fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:52.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.118+0000 7f084ab31700 1 --2- 172.21.15.103:0/930265870 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f082404d8b0 0x7f082404fd70 secure :-1 s=READY pgs=179 cs=0 l=1 rx=0x7f0840001f50 tx=0x7f08400023e0).stop 2020-04-22T14:03:52.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.118+0000 7f084ab31700 1 -- 172.21.15.103:0/930265870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f084405fc70 msgr2=0x7f08441459b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:52.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.118+0000 7f084ab31700 1 --2- 172.21.15.103:0/930265870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f084405fc70 0x7f08441459b0 secure :-1 s=READY pgs=442 cs=0 l=1 rx=0x7f083c0032b0 tx=0x7f083c010d80).stop 2020-04-22T14:03:52.124 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.118+0000 7f084ab31700 1 -- 172.21.15.103:0/930265870 shutdown_connections 2020-04-22T14:03:52.124 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.118+0000 7f084ab31700 1 --2- 172.21.15.103:0/930265870 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f082404d8b0 0x7f082404fd70 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:52.124 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.118+0000 7f084ab31700 1 --2- 172.21.15.103:0/930265870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f084405fc70 0x7f08441459b0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:52.124 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.118+0000 7f084ab31700 1 --2- 172.21.15.103:0/930265870 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f08440bcc50 0x7f084412dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:52.124 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.118+0000 7f084ab31700 1 -- 172.21.15.103:0/930265870 >> 172.21.15.103:0/930265870 conn(0x7f0844065af0 msgr2=0x7f08440b92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:52.124 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.118+0000 7f084ab31700 1 -- 172.21.15.103:0/930265870 shutdown_connections 2020-04-22T14:03:52.125 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.118+0000 7f084ab31700 1 -- 172.21.15.103:0/930265870 wait complete. 2020-04-22T14:03:52.132 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:52.146 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-22T14:03:52.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.292+0000 7fe657129700 1 Processor -- start 2020-04-22T14:03:52.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.292+0000 7fe657129700 1 -- start start 2020-04-22T14:03:52.298 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.293+0000 7fe657129700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe6500ac950 0x7fe650146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:52.298 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.293+0000 7fe657129700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe6501470a0 0x7fe650143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:52.298 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.293+0000 7fe657129700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6501467e0 con 0x7fe6500b9140 2020-04-22T14:03:52.298 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.293+0000 7fe657129700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe650147530 con 0x7fe6501470a0 2020-04-22T14:03:52.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.293+0000 7fe657129700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6500602f0 con 0x7fe6500ac950 2020-04-22T14:03:52.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.293+0000 7fe64ffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe6500ac950 0x7fe650146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:52.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.293+0000 7fe654ec5700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe6500b9140 0x7fe65012b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41176/0 (socket says 172.21.15.103:41176) 2020-04-22T14:03:52.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.293+0000 7fe654ec5700 1 -- 172.21.15.103:0/1729404782 learned_addr learned my addr 172.21.15.103:0/1729404782 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:52.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.293+0000 7fe6556c6700 1 --2- 172.21.15.103:0/1729404782 >> v2:172.21.15.86:3300/0 conn(0x7fe6501470a0 0x7fe650143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:52.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.293+0000 7fe64ffff700 1 -- 172.21.15.103:0/1729404782 >> v2:172.21.15.86:3300/0 conn(0x7fe6501470a0 msgr2=0x7fe650143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:52.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.293+0000 7fe64ffff700 1 --2- 172.21.15.103:0/1729404782 >> v2:172.21.15.86:3300/0 conn(0x7fe6501470a0 0x7fe650143090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:52.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.293+0000 7fe64ffff700 1 -- 172.21.15.103:0/1729404782 >> v1:172.21.15.103:6789/0 conn(0x7fe6500b9140 legacy=0x7fe65012b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:52.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.293+0000 7fe64ffff700 1 -- 172.21.15.103:0/1729404782 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe650060050 con 0x7fe6500ac950 2020-04-22T14:03:52.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.294+0000 7fe64ffff700 1 --2- 172.21.15.103:0/1729404782 >> v2:172.21.15.103:3300/0 conn(0x7fe6500ac950 0x7fe650146c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe63c002f30 tx=0x7fe63c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:52.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.294+0000 7fe64ffff700 1 --2- 172.21.15.103:0/1729404782 >> v2:172.21.15.103:3300/0 conn(0x7fe6500ac950 0x7fe650146c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe63c002f30 tx=0x7fe63c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:52.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.294+0000 7fe64ffff700 1 --2- 172.21.15.103:0/1729404782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6500ac950 0x7fe650146c40 secure :-1 s=READY pgs=444 cs=0 l=1 rx=0x7fe63c002f30 tx=0x7fe63c007a40).ready entity=mon.1 client_cookie=39e9ac9850deac49 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:52.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.294+0000 7fe64ffff700 1 --2- 172.21.15.103:0/1729404782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6500ac950 0x7fe650146c40 secure :-1 s=THROTTLE_DONE pgs=444 cs=0 l=1 rx=0x7fe63c002f30 tx=0x7fe63c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:52.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.294+0000 7fe64f7fe700 1 -- 172.21.15.103:0/1729404782 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe63c0135d0 con 0x7fe6500ac950 2020-04-22T14:03:52.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.294+0000 7fe64ffff700 1 --2- 172.21.15.103:0/1729404782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6500ac950 0x7fe650146c40 secure :-1 s=THROTTLE_DONE pgs=444 cs=0 l=1 rx=0x7fe63c002f30 tx=0x7fe63c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:52.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.294+0000 7fe64ffff700 1 --2- 172.21.15.103:0/1729404782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6500ac950 0x7fe650146c40 secure :-1 s=THROTTLE_DONE pgs=444 cs=0 l=1 rx=0x7fe63c002f30 tx=0x7fe63c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:52.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.294+0000 7fe64f7fe700 1 -- 172.21.15.103:0/1729404782 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63c013730 con 0x7fe6500ac950 2020-04-22T14:03:52.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.294+0000 7fe64f7fe700 1 -- 172.21.15.103:0/1729404782 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe63c013b50 con 0x7fe6500ac950 2020-04-22T14:03:52.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.294+0000 7fe657129700 1 -- 172.21.15.103:0/1729404782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6500ac950 msgr2=0x7fe650146c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:52.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.294+0000 7fe657129700 1 --2- 172.21.15.103:0/1729404782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6500ac950 0x7fe650146c40 secure :-1 s=READY pgs=444 cs=0 l=1 rx=0x7fe63c002f30 tx=0x7fe63c007a40).stop 2020-04-22T14:03:52.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.295+0000 7fe657129700 1 -- 172.21.15.103:0/1729404782 shutdown_connections 2020-04-22T14:03:52.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.295+0000 7fe657129700 1 --2- 172.21.15.103:0/1729404782 >> v2:172.21.15.86:3300/0 conn(0x7fe6501470a0 0x7fe650143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:52.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.295+0000 7fe657129700 1 --2- 172.21.15.103:0/1729404782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6500ac950 0x7fe650146c40 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:52.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.295+0000 7fe657129700 1 -- 172.21.15.103:0/1729404782 >> 172.21.15.103:0/1729404782 conn(0x7fe65005b7b0 msgr2=0x7fe6500b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:52.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.295+0000 7fe657129700 1 -- 172.21.15.103:0/1729404782 shutdown_connections 2020-04-22T14:03:52.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.295+0000 7fe657129700 1 -- 172.21.15.103:0/1729404782 wait complete. 2020-04-22T14:03:52.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.296+0000 7fe657129700 1 Processor -- start 2020-04-22T14:03:52.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.296+0000 7fe657129700 1 -- start start 2020-04-22T14:03:52.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.297+0000 7fe657129700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6501470a0 0x7fe65012b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:52.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.297+0000 7fe657129700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6500b5e80 con 0x7fe6500b9140 2020-04-22T14:03:52.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.297+0000 7fe657129700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe65012b160 con 0x7fe6500ac950 2020-04-22T14:03:52.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.297+0000 7fe657129700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe65012bd00 con 0x7fe6501470a0 2020-04-22T14:03:52.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.297+0000 7fe654ec5700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe6500ac950 0x7fe6500b5770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41182/0 (socket says 172.21.15.103:41182) 2020-04-22T14:03:52.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.297+0000 7fe654ec5700 1 -- 172.21.15.103:0/4193365511 learned_addr learned my addr 172.21.15.103:0/4193365511 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:52.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.297+0000 7fe6556c6700 1 --2- 172.21.15.103:0/4193365511 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6501470a0 0x7fe65012b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:52.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.297+0000 7fe64dffb700 1 -- 172.21.15.103:0/4193365511 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4010684424 0 0) 0x7fe65012b160 con 0x7fe6500ac950 2020-04-22T14:03:52.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.297+0000 7fe64dffb700 1 -- 172.21.15.103:0/4193365511 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe638002fe0 con 0x7fe6500ac950 2020-04-22T14:03:52.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.297+0000 7fe64dffb700 1 -- 172.21.15.103:0/4193365511 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3255047368 0 0) 0x7fe6500b5e80 con 0x7fe6500b9140 2020-04-22T14:03:52.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.297+0000 7fe64dffb700 1 -- 172.21.15.103:0/4193365511 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe65012b160 con 0x7fe6500b9140 2020-04-22T14:03:52.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.297+0000 7fe6556c6700 1 -- 172.21.15.103:0/4193365511 >> v1:172.21.15.103:6789/0 conn(0x7fe6500ac950 legacy=0x7fe6500b5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:52.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.297+0000 7fe64dffb700 1 -- 172.21.15.103:0/4193365511 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1398138342 0 0) 0x7fe638002fe0 con 0x7fe6500ac950 2020-04-22T14:03:52.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.297+0000 7fe6556c6700 1 -- 172.21.15.103:0/4193365511 >> v1:172.21.15.86:6789/0 conn(0x7fe6500b9140 legacy=0x7fe650065700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:52.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.297+0000 7fe6556c6700 1 -- 172.21.15.103:0/4193365511 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65012b400 con 0x7fe6501470a0 2020-04-22T14:03:52.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.297+0000 7fe6556c6700 1 --2- 172.21.15.103:0/4193365511 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6501470a0 0x7fe65012b8a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe6480032b0 tx=0x7fe648010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:52.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.297+0000 7fe6556c6700 1 --2- 172.21.15.103:0/4193365511 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6501470a0 0x7fe65012b8a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe6480032b0 tx=0x7fe648010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:52.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.297+0000 7fe6556c6700 1 --2- 172.21.15.103:0/4193365511 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6501470a0 0x7fe65012b8a0 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7fe6480032b0 tx=0x7fe648010f20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:52.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.297+0000 7fe6556c6700 1 --2- 172.21.15.103:0/4193365511 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6501470a0 0x7fe65012b8a0 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7fe6480032b0 tx=0x7fe648010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:52.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.297+0000 7fe64dffb700 1 -- 172.21.15.103:0/4193365511 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe64800e370 con 0x7fe6501470a0 2020-04-22T14:03:52.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.297+0000 7fe6556c6700 1 --2- 172.21.15.103:0/4193365511 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6501470a0 0x7fe65012b8a0 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7fe6480032b0 tx=0x7fe648010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:52.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.297+0000 7fe64dffb700 1 -- 172.21.15.103:0/4193365511 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe648005c30 con 0x7fe6501470a0 2020-04-22T14:03:52.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.297+0000 7fe6556c6700 1 --2- 172.21.15.103:0/4193365511 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6501470a0 0x7fe65012b8a0 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7fe6480032b0 tx=0x7fe648010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:52.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.297+0000 7fe657129700 1 -- 172.21.15.103:0/4193365511 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe650140e30 con 0x7fe6501470a0 2020-04-22T14:03:52.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.297+0000 7fe64dffb700 1 -- 172.21.15.103:0/4193365511 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe64800c900 con 0x7fe6501470a0 2020-04-22T14:03:52.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.298+0000 7fe657129700 1 -- 172.21.15.103:0/4193365511 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6501282f0 con 0x7fe6501470a0 2020-04-22T14:03:52.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.298+0000 7fe6556c6700 1 --2- 172.21.15.103:0/4193365511 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6501470a0 0x7fe65012b8a0 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7fe6480032b0 tx=0x7fe648010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:52.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.298+0000 7fe64dffb700 1 -- 172.21.15.103:0/4193365511 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fe64800cb80 con 0x7fe6501470a0 2020-04-22T14:03:52.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.298+0000 7fe6556c6700 1 --2- 172.21.15.103:0/4193365511 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6501470a0 0x7fe65012b8a0 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7fe6480032b0 tx=0x7fe648010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:52.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.298+0000 7fe657129700 1 -- 172.21.15.103:0/4193365511 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe65012afc0 con 0x7fe6501470a0 2020-04-22T14:03:52.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.299+0000 7fe64dffb700 1 --2- 172.21.15.103:0/4193365511 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe63804dde0 0x7fe6380502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:52.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.299+0000 7fe64dffb700 1 -- 172.21.15.103:0/4193365511 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe6480611e0 con 0x7fe6501470a0 2020-04-22T14:03:52.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.299+0000 7fe654ec5700 1 --2- 172.21.15.103:0/4193365511 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe63804dde0 0x7fe6380502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:52.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.299+0000 7fe654ec5700 1 --2- 172.21.15.103:0/4193365511 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe63804dde0 0x7fe6380502a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe644000ef0 tx=0x7fe644001b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:52.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.299+0000 7fe654ec5700 1 --2- 172.21.15.103:0/4193365511 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe63804dde0 0x7fe6380502a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe644000ef0 tx=0x7fe644001b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:52.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.299+0000 7fe654ec5700 1 --2- 172.21.15.103:0/4193365511 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe63804dde0 0x7fe6380502a0 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7fe644000ef0 tx=0x7fe644001b70).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:52.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.303+0000 7fe6556c6700 1 --2- 172.21.15.103:0/4193365511 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6501470a0 0x7fe65012b8a0 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7fe6480032b0 tx=0x7fe648010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:52.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.303+0000 7fe64dffb700 1 -- 172.21.15.103:0/4193365511 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fe65012afc0 con 0x7fe6501470a0 2020-04-22T14:03:52.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.444+0000 7fe657129700 1 -- 172.21.15.103:0/4193365511 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe65012afc0 con 0x7fe6501470a0 2020-04-22T14:03:52.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.445+0000 7fe6556c6700 1 --2- 172.21.15.103:0/4193365511 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6501470a0 0x7fe65012b8a0 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7fe6480032b0 tx=0x7fe648010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:52.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.445+0000 7fe64dffb700 1 -- 172.21.15.103:0/4193365511 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+10 (secure 0 0 0) 0x7fe65012afc0 con 0x7fe6501470a0 2020-04-22T14:03:52.449 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:03:52.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.447+0000 7fe657129700 1 -- 172.21.15.103:0/4193365511 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe63804dde0 msgr2=0x7fe6380502a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:52.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.447+0000 7fe657129700 1 --2- 172.21.15.103:0/4193365511 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe63804dde0 0x7fe6380502a0 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7fe644000ef0 tx=0x7fe644001b70).stop 2020-04-22T14:03:52.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.447+0000 7fe657129700 1 -- 172.21.15.103:0/4193365511 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6501470a0 msgr2=0x7fe65012b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:52.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.447+0000 7fe657129700 1 --2- 172.21.15.103:0/4193365511 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6501470a0 0x7fe65012b8a0 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7fe6480032b0 tx=0x7fe648010f20).stop 2020-04-22T14:03:52.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.447+0000 7fe657129700 1 -- 172.21.15.103:0/4193365511 shutdown_connections 2020-04-22T14:03:52.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.447+0000 7fe657129700 1 --2- 172.21.15.103:0/4193365511 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe63804dde0 0x7fe6380502a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:52.451 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.447+0000 7fe657129700 1 --2- 172.21.15.103:0/4193365511 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6501470a0 0x7fe65012b8a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:52.451 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.447+0000 7fe657129700 1 -- 172.21.15.103:0/4193365511 >> 172.21.15.103:0/4193365511 conn(0x7fe65005b7b0 msgr2=0x7fe650145b10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:52.452 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.447+0000 7fe657129700 1 -- 172.21.15.103:0/4193365511 shutdown_connections 2020-04-22T14:03:52.452 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.447+0000 7fe657129700 1 -- 172.21.15.103:0/4193365511 wait complete. 2020-04-22T14:03:52.472 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-04-22T14:03:52.472 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:52.487 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:03:52.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.633+0000 7f76a54bd700 1 Processor -- start 2020-04-22T14:03:52.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.633+0000 7f76a54bd700 1 -- start start 2020-04-22T14:03:52.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.633+0000 7f76a54bd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f76a0146f50 0x7f76a00ae010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:52.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.633+0000 7f76a54bd700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76a0143810 con 0x7f76a00620a0 2020-04-22T14:03:52.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.633+0000 7f76a54bd700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76a0143ab0 con 0x7f76a0146ad0 2020-04-22T14:03:52.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.633+0000 7f76a54bd700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76a01473e0 con 0x7f76a0146f50 2020-04-22T14:03:52.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.634+0000 7f76a4cbc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f76a0146f50 0x7f76a00ae010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:52.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.634+0000 7f769f7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f76a0146ad0 0x7f76a00ad900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41190/0 (socket says 172.21.15.103:41190) 2020-04-22T14:03:52.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.634+0000 7f76a4cbc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f76a0146f50 0x7f76a00ae010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49000/0 (socket says 172.21.15.103:49000) 2020-04-22T14:03:52.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.634+0000 7f769f7fe700 1 -- 172.21.15.103:0/719193522 learned_addr learned my addr 172.21.15.103:0/719193522 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:52.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.634+0000 7f76a4cbc700 1 -- 172.21.15.103:0/719193522 >> v1:172.21.15.103:6789/0 conn(0x7f76a0146ad0 legacy=0x7f76a00ad900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:52.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.634+0000 7f76a4cbc700 1 -- 172.21.15.103:0/719193522 >> v1:172.21.15.86:6789/0 conn(0x7f76a00620a0 legacy=0x7f76a0142e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:52.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.634+0000 7f769effd700 1 -- 172.21.15.103:0/719193522 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1187658178 0 0) 0x7f76a0143ab0 con 0x7f76a0146ad0 2020-04-22T14:03:52.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.634+0000 7f76a4cbc700 1 -- 172.21.15.103:0/719193522 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a0143d50 con 0x7f76a0146f50 2020-04-22T14:03:52.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.634+0000 7f76a4cbc700 1 --2- 172.21.15.103:0/719193522 >> v2:172.21.15.103:3300/0 conn(0x7f76a0146f50 0x7f76a00ae010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f76980032b0 tx=0x7f7698007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:52.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.634+0000 7f76a4cbc700 1 --2- 172.21.15.103:0/719193522 >> v2:172.21.15.103:3300/0 conn(0x7f76a0146f50 0x7f76a00ae010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f76980032b0 tx=0x7f7698007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:52.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.634+0000 7f76a4cbc700 1 --2- 172.21.15.103:0/719193522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76a0146f50 0x7f76a00ae010 secure :-1 s=READY pgs=447 cs=0 l=1 rx=0x7f76980032b0 tx=0x7f7698007dc0).ready entity=mon.1 client_cookie=e273d5f53bfbf23d server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:52.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.634+0000 7f76a4cbc700 1 --2- 172.21.15.103:0/719193522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76a0146f50 0x7f76a00ae010 secure :-1 s=THROTTLE_DONE pgs=447 cs=0 l=1 rx=0x7f76980032b0 tx=0x7f7698007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:52.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.634+0000 7f769effd700 1 -- 172.21.15.103:0/719193522 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76980110d0 con 0x7f76a0146f50 2020-04-22T14:03:52.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.634+0000 7f76a4cbc700 1 --2- 172.21.15.103:0/719193522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76a0146f50 0x7f76a00ae010 secure :-1 s=THROTTLE_DONE pgs=447 cs=0 l=1 rx=0x7f76980032b0 tx=0x7f7698007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:52.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.634+0000 7f769effd700 1 -- 172.21.15.103:0/719193522 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7698011270 con 0x7f76a0146f50 2020-04-22T14:03:52.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.634+0000 7f76a4cbc700 1 --2- 172.21.15.103:0/719193522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76a0146f50 0x7f76a00ae010 secure :-1 s=THROTTLE_DONE pgs=447 cs=0 l=1 rx=0x7f76980032b0 tx=0x7f7698007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:52.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.634+0000 7f769effd700 1 -- 172.21.15.103:0/719193522 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7698011690 con 0x7f76a0146f50 2020-04-22T14:03:52.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.634+0000 7f76a54bd700 1 -- 172.21.15.103:0/719193522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76a0146f50 msgr2=0x7f76a00ae010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:52.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.634+0000 7f76a54bd700 1 --2- 172.21.15.103:0/719193522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76a0146f50 0x7f76a00ae010 secure :-1 s=READY pgs=447 cs=0 l=1 rx=0x7f76980032b0 tx=0x7f7698007dc0).stop 2020-04-22T14:03:52.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.635+0000 7f76a54bd700 1 -- 172.21.15.103:0/719193522 shutdown_connections 2020-04-22T14:03:52.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.635+0000 7f76a54bd700 1 --2- 172.21.15.103:0/719193522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76a0146f50 0x7f76a00ae010 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:52.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.635+0000 7f76a54bd700 1 -- 172.21.15.103:0/719193522 >> 172.21.15.103:0/719193522 conn(0x7f76a005b7c0 msgr2=0x7f76a0061610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:52.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.635+0000 7f76a54bd700 1 -- 172.21.15.103:0/719193522 shutdown_connections 2020-04-22T14:03:52.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.635+0000 7f76a54bd700 1 -- 172.21.15.103:0/719193522 wait complete. 2020-04-22T14:03:52.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.636+0000 7f76a54bd700 1 Processor -- start 2020-04-22T14:03:52.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.636+0000 7f76a54bd700 1 -- start start 2020-04-22T14:03:52.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.637+0000 7f76a54bd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f76a00620a0 0x7f76a0142890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:52.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.637+0000 7f76a54bd700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76a00b03a0 con 0x7f76a0146ad0 2020-04-22T14:03:52.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.637+0000 7f76a54bd700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76a00b0640 con 0x7f76a0146f50 2020-04-22T14:03:52.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.637+0000 7f76a54bd700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a01423f0 con 0x7f76a00620a0 2020-04-22T14:03:52.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.637+0000 7f76a4cbc700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f76a0146f50 0x7f76a00b3520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41198/0 (socket says 172.21.15.103:41198) 2020-04-22T14:03:52.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.637+0000 7f76a4cbc700 1 -- 172.21.15.103:0/2433880892 learned_addr learned my addr 172.21.15.103:0/2433880892 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:52.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.637+0000 7f769ffff700 1 --2- 172.21.15.103:0/2433880892 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f76a00620a0 0x7f76a0142890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:52.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.637+0000 7f769d7fa700 1 -- 172.21.15.103:0/2433880892 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2693863879 0 0) 0x7f76a00b0640 con 0x7f76a0146f50 2020-04-22T14:03:52.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.637+0000 7f769d7fa700 1 -- 172.21.15.103:0/2433880892 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7680002fe0 con 0x7f76a0146f50 2020-04-22T14:03:52.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.637+0000 7f769d7fa700 1 -- 172.21.15.103:0/2433880892 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2361133502 0 0) 0x7f76a00b03a0 con 0x7f76a0146ad0 2020-04-22T14:03:52.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.637+0000 7f769d7fa700 1 -- 172.21.15.103:0/2433880892 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76a00b0640 con 0x7f76a0146ad0 2020-04-22T14:03:52.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.637+0000 7f769ffff700 1 -- 172.21.15.103:0/2433880892 >> v1:172.21.15.103:6789/0 conn(0x7f76a0146f50 legacy=0x7f76a00b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:52.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.637+0000 7f769d7fa700 1 -- 172.21.15.103:0/2433880892 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1864175916 0 0) 0x7f7680002fe0 con 0x7f76a0146f50 2020-04-22T14:03:52.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.637+0000 7f769ffff700 1 -- 172.21.15.103:0/2433880892 >> v1:172.21.15.86:6789/0 conn(0x7f76a0146ad0 legacy=0x7f76a00ae220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:52.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.637+0000 7f769ffff700 1 -- 172.21.15.103:0/2433880892 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a00b0020 con 0x7f76a00620a0 2020-04-22T14:03:52.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.637+0000 7f769ffff700 1 --2- 172.21.15.103:0/2433880892 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f76a00620a0 0x7f76a0142890 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7698008b40 tx=0x7f76900107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:52.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.637+0000 7f769ffff700 1 --2- 172.21.15.103:0/2433880892 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f76a00620a0 0x7f76a0142890 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7698008b40 tx=0x7f76900107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:52.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.637+0000 7f769ffff700 1 --2- 172.21.15.103:0/2433880892 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f76a00620a0 0x7f76a0142890 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7f7698008b40 tx=0x7f76900107e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:52.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.638+0000 7f769ffff700 1 --2- 172.21.15.103:0/2433880892 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f76a00620a0 0x7f76a0142890 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f7698008b40 tx=0x7f76900107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:52.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.638+0000 7f769d7fa700 1 -- 172.21.15.103:0/2433880892 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7690001ea0 con 0x7f76a00620a0 2020-04-22T14:03:52.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.638+0000 7f769ffff700 1 --2- 172.21.15.103:0/2433880892 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f76a00620a0 0x7f76a0142890 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f7698008b40 tx=0x7f76900107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:52.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.638+0000 7f769d7fa700 1 -- 172.21.15.103:0/2433880892 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7690006ac0 con 0x7f76a00620a0 2020-04-22T14:03:52.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.638+0000 7f769ffff700 1 --2- 172.21.15.103:0/2433880892 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f76a00620a0 0x7f76a0142890 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f7698008b40 tx=0x7f76900107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:52.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.638+0000 7f76a54bd700 1 -- 172.21.15.103:0/2433880892 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76a00ae930 con 0x7f76a00620a0 2020-04-22T14:03:52.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.638+0000 7f769d7fa700 1 -- 172.21.15.103:0/2433880892 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76980089e0 con 0x7f76a00620a0 2020-04-22T14:03:52.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.638+0000 7f76a54bd700 1 -- 172.21.15.103:0/2433880892 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a00b3c30 con 0x7f76a00620a0 2020-04-22T14:03:52.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.638+0000 7f769ffff700 1 --2- 172.21.15.103:0/2433880892 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f76a00620a0 0x7f76a0142890 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f7698008b40 tx=0x7f76900107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:52.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.639+0000 7f76a54bd700 1 -- 172.21.15.103:0/2433880892 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76a0056c90 con 0x7f76a00620a0 2020-04-22T14:03:52.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.639+0000 7f769d7fa700 1 -- 172.21.15.103:0/2433880892 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f769000a2b0 con 0x7f76a00620a0 2020-04-22T14:03:52.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.639+0000 7f769ffff700 1 --2- 172.21.15.103:0/2433880892 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f76a00620a0 0x7f76a0142890 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f7698008b40 tx=0x7f76900107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:52.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.639+0000 7f769d7fa700 1 --2- 172.21.15.103:0/2433880892 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f768004dde0 0x7f76800502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:52.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.639+0000 7f769d7fa700 1 -- 172.21.15.103:0/2433880892 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7690060d60 con 0x7f76a00620a0 2020-04-22T14:03:52.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.639+0000 7f769f7fe700 1 --2- 172.21.15.103:0/2433880892 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f768004dde0 0x7f76800502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:52.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.639+0000 7f769f7fe700 1 --2- 172.21.15.103:0/2433880892 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f768004dde0 0x7f76800502a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7694000ee0 tx=0x7f7694001640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:52.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.640+0000 7f769f7fe700 1 --2- 172.21.15.103:0/2433880892 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f768004dde0 0x7f76800502a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7694000ee0 tx=0x7f7694001640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:52.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.640+0000 7f769f7fe700 1 --2- 172.21.15.103:0/2433880892 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f768004dde0 0x7f76800502a0 secure :-1 s=READY pgs=181 cs=0 l=1 rx=0x7f7694000ee0 tx=0x7f7694001640).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:52.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.643+0000 7f769ffff700 1 --2- 172.21.15.103:0/2433880892 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f76a00620a0 0x7f76a0142890 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f7698008b40 tx=0x7f76900107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:52.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.643+0000 7f769d7fa700 1 -- 172.21.15.103:0/2433880892 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f769003c140 con 0x7f76a00620a0 2020-04-22T14:03:52.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.831+0000 7f76a54bd700 1 -- 172.21.15.103:0/2433880892 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76a00b01b0 con 0x7f76a00620a0 2020-04-22T14:03:52.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.831+0000 7f769ffff700 1 --2- 172.21.15.103:0/2433880892 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f76a00620a0 0x7f76a0142890 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f7698008b40 tx=0x7f76900107e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:52.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.831+0000 7f769d7fa700 1 -- 172.21.15.103:0/2433880892 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2141 (secure 0 0 0) 0x7f7690006e60 con 0x7f76a00620a0 2020-04-22T14:03:52.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.832+0000 7f76a54bd700 1 -- 172.21.15.103:0/2433880892 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f768004dde0 msgr2=0x7f76800502a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:52.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.832+0000 7f76a54bd700 1 --2- 172.21.15.103:0/2433880892 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f768004dde0 0x7f76800502a0 secure :-1 s=READY pgs=181 cs=0 l=1 rx=0x7f7694000ee0 tx=0x7f7694001640).stop 2020-04-22T14:03:52.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.832+0000 7f76a54bd700 1 -- 172.21.15.103:0/2433880892 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f76a00620a0 msgr2=0x7f76a0142890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:52.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.832+0000 7f76a54bd700 1 --2- 172.21.15.103:0/2433880892 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f76a00620a0 0x7f76a0142890 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7f7698008b40 tx=0x7f76900107e0).stop 2020-04-22T14:03:52.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.833+0000 7f76a54bd700 1 -- 172.21.15.103:0/2433880892 shutdown_connections 2020-04-22T14:03:52.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.833+0000 7f76a54bd700 1 --2- 172.21.15.103:0/2433880892 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f768004dde0 0x7f76800502a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:52.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.833+0000 7f76a54bd700 1 --2- 172.21.15.103:0/2433880892 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f76a00620a0 0x7f76a0142890 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:52.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.833+0000 7f76a54bd700 1 -- 172.21.15.103:0/2433880892 >> 172.21.15.103:0/2433880892 conn(0x7f76a005b7c0 msgr2=0x7f76a012be90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:52.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.833+0000 7f76a54bd700 1 -- 172.21.15.103:0/2433880892 shutdown_connections 2020-04-22T14:03:52.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:52.833+0000 7f76a54bd700 1 -- 172.21.15.103:0/2433880892 wait complete. 2020-04-22T14:03:52.839 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 14 2020-04-22T14:03:52.840 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:03:52.840 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4956,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/2333777975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2333777975},{"type":"v1","addr":"172.21.15.86:6835","nonce":2333777975}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:03:38.935462+0000","modified":"2020-04-22T14:03:40.946647+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5050},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5050":{"gid":5050,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/3282872682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3282872682},{"type":"v1","addr":"172.21.15.103:6833","nonce":3282872682}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2020-04-22T14:03:53.046 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 5050}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 5, u'failed': [], u'epoch': 14, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [6], u'info': {u'gid_5050': {u'export_targets': [], u'name': u'a', u'incarnation': 11, u'state_seq': 3, u'state': u'up:active', u'gid': 5050, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 3282872682, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 3282872682, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/3282872682'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:03:38.935462+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:03:40.946647+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:03:53.046 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:03:53.047 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:53.061 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:03:53.219 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:03:53.219 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:03:53.220 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:03:53.220 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 5050, 2020-04-22T14:03:53.220 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:03:53.220 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:03:53.220 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 14.278714023999999, 2020-04-22T14:03:53.220 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 14, 2020-04-22T14:03:53.221 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 35, 2020-04-22T14:03:53.221 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 35, 2020-04-22T14:03:53.221 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 21.518014696000002 2020-04-22T14:03:53.221 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:03:53.228 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 5050, "want_state": "up:active", "state": "up:active", "rank_uptime": 14.278714023999999, "mdsmap_epoch": 14, "osdmap_epoch": 35, "osdmap_epoch_barrier": 35, "uptime": 21.518014696000002 } 2020-04-22T14:03:53.228 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-04-22T14:03:53.228 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-04-22T14:03:53.228 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:53.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:53.242 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:03:53.301 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:03:53.301 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:03:53.302 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:03:53.302 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:53.302 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:03:53.302 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:53.302 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:03:53.302 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:53.302 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:03:53.303 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:53.303 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:03:53.303 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:53.303 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:03:53.303 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:53.303 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:03:53.303 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42607sec preferred_lft 42607sec 2020-04-22T14:03:53.304 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:03:53.304 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:53.304 INFO:teuthology.orchestra.run.smithi103.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:03:53.304 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether e2:85:04:2a:37:bb brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:53.304 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:03:53.305 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:53.305 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::d0d0:5166:401f:3825/64 scope link noprefixroute 2020-04-22T14:03:53.305 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:53.305 INFO:teuthology.orchestra.run.smithi103.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-04-22T14:03:53.306 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether e2:85:04:2a:37:bb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2020-04-22T14:03:53.306 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:53.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:53.354 INFO:teuthology.orchestra.run.smithi103:> ip netns list 2020-04-22T14:03:53.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2020-04-22T14:03:53.413 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:53.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:53.462 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:03:53.517 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2020-04-22T14:03:53.517 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:53.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:53.574 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:03:53.634 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2020-04-22T14:03:53.634 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:53.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:53.683 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:03:53.761 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:53.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:53.805 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 1' 2020-04-22T14:03:53.886 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:53.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:53.929 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr' 2020-04-22T14:03:54.041 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:03:54.041 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:03:54.041 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:03:54.041 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:54.041 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:03:54.042 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:54.042 INFO:teuthology.orchestra.run.smithi103.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:03:54.042 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 5e:7b:33:6e:77:52 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:03:54.042 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2020-04-22T14:03:54.042 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:54.042 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::5c7b:33ff:fe6e:7752/64 scope link 2020-04-22T14:03:54.042 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:54.043 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:54.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:54.070 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr' 2020-04-22T14:03:54.183 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:03:54.183 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:03:54.183 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:03:54.183 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:54.184 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:03:54.184 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:54.184 INFO:teuthology.orchestra.run.smithi103.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:03:54.184 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 5e:7b:33:6e:77:52 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:03:54.184 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2020-04-22T14:03:54.184 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:54.184 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::5c7b:33ff:fe6e:7752/64 scope link 2020-04-22T14:03:54.185 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:54.185 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.2/16 2020-04-22T14:03:54.185 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:54.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:54.212 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.1' 2020-04-22T14:03:54.300 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:54.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:54.338 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0' 2020-04-22T14:03:54.452 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:54.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:54.480 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up' 2020-04-22T14:03:54.596 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:54.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:54.611 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up' 2020-04-22T14:03:54.735 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:54.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:54.748 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254' 2020-04-22T14:03:54.860 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:54.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:54.883 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:03:54.957 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:55.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:55.009 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge-slave con-name brx.1 ifname brx.1 master ceph-brx' 2020-04-22T14:03:55.116 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.1' (58b499b1-b397-46f5-ba0f-982e5d02d150) successfully added. 2020-04-22T14:03:55.117 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:55.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:55.158 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up brx.1' 2020-04-22T14:03:55.319 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/10) 2020-04-22T14:03:55.319 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2020-04-22T14:03:55.320 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi103.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2020-04-22T14:03:55.320 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:55.333 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:55.333 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:03:55.392 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:55.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:55.440 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:03:55.521 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:03:55.547 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:03:55.549 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:55.577 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:55.577 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:03:55.636 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:03:55.637 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [47] 2020-04-22T14:03:55.637 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:55.685 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:03:55.727 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:55.739 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:55.740 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:03:55.811 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:03:55.815 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:03:55.816 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:55.817 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:2020-04-22T14:03:55.814+0000 7f40673c31c0 -1 init, newargv = 0x55d79ba78f70 newargc=9 2020-04-22T14:03:55.817 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[47478]: starting ceph client 2020-04-22T14:03:55.821 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[47478]: starting fuse 2020-04-22T14:03:55.831 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:55.831 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:03:55.889 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:03:55.889 INFO:teuthology.orchestra.run.smithi103.stdout:49 2020-04-22T14:03:55.890 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47, 49] 2020-04-22T14:03:55.890 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:55.945 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:55.945 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:03:55.946 INFO:teuthology.orchestra.run.smithi103:> import glob 2020-04-22T14:03:55.946 INFO:teuthology.orchestra.run.smithi103:> import re 2020-04-22T14:03:55.946 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:03:55.946 INFO:teuthology.orchestra.run.smithi103:> import subprocess 2020-04-22T14:03:55.946 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:03:55.946 INFO:teuthology.orchestra.run.smithi103:> def find_socket(client_name): 2020-04-22T14:03:55.946 INFO:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2020-04-22T14:03:55.946 INFO:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2020-04-22T14:03:55.947 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:03:55.947 INFO:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2020-04-22T14:03:55.947 INFO:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2020-04-22T14:03:55.947 INFO:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2020-04-22T14:03:55.947 INFO:teuthology.orchestra.run.smithi103:> return files[0] 2020-04-22T14:03:55.947 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:03:55.947 INFO:teuthology.orchestra.run.smithi103:> for f in files: 2020-04-22T14:03:55.947 INFO:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:03:55.948 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:03:55.948 INFO:teuthology.orchestra.run.smithi103:> return f 2020-04-22T14:03:55.948 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:03:55.948 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:03:55.948 INFO:teuthology.orchestra.run.smithi103:> print(find_socket("client.1")) 2020-04-22T14:03:55.948 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:03:56.057 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.1.47478.asok 2020-04-22T14:03:56.059 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.47478.asok 2020-04-22T14:03:56.059 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:56.080 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:56.080 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.47478.asok status 2020-04-22T14:03:56.238 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:03:56.238 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2020-04-22T14:03:56.238 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:03:56.238 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:03:56.238 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "1", 2020-04-22T14:03:56.239 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:03:56.239 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2020-04-22T14:03:56.239 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "47478", 2020-04-22T14:03:56.239 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:03:56.239 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:56.239 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2020-04-22T14:03:56.239 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2020-04-22T14:03:56.239 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4685, 2020-04-22T14:03:56.240 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2020-04-22T14:03:56.240 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:03:56.240 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:03:56.240 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4685 2020-04-22T14:03:56.240 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:56.240 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:03:56.240 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:03:56.241 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:0", 2020-04-22T14:03:56.241 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 39023032 2020-04-22T14:03:56.241 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:03:56.241 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:56.241 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:03:56.241 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:03:56.241 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:0", 2020-04-22T14:03:56.242 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 39023032 2020-04-22T14:03:56.242 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:03:56.242 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.4685 172.21.15.103:0/39023032", 2020-04-22T14:03:56.242 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "172.21.15.103:0/39023032", 2020-04-22T14:03:56.242 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2020-04-22T14:03:56.242 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 14, 2020-04-22T14:03:56.243 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 35, 2020-04-22T14:03:56.243 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2020-04-22T14:03:56.243 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklisted": false 2020-04-22T14:03:56.243 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:03:56.243 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:56.257 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:56.257 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-22T14:03:56.258 INFO:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:03:56.316 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2020-04-22T14:03:56.317 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-04-22T14:03:56.317 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:56.366 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:03:56.366 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:03:56.440 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:56.487 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok config get mds_reconnect_timeout 2020-04-22T14:03:56.641 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:03:56.641 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_reconnect_timeout": "45.000000" 2020-04-22T14:03:56.641 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:03:56.649 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_reconnect_timeout": "45.000000" } 2020-04-22T14:03:56.649 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:56.665 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok config get ms_max_backoff 2020-04-22T14:03:56.818 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:03:56.818 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_max_backoff": "15.000000" 2020-04-22T14:03:56.818 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:03:56.828 INFO:tasks.cephfs.filesystem:_json_asok output: { "ms_max_backoff": "15.000000" } 2020-04-22T14:03:56.828 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:56.844 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:03:56.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.988+0000 7f532a790700 1 Processor -- start 2020-04-22T14:03:56.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.988+0000 7f532a790700 1 -- start start 2020-04-22T14:03:56.991 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.989+0000 7f532a790700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f532412c0d0 0x7f53241464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:56.991 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.989+0000 7f532a790700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5324063e30 0x7f53240642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:56.991 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.989+0000 7f532a790700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5324143300 con 0x7f5324065fe0 2020-04-22T14:03:56.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.989+0000 7f532a790700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53241435a0 con 0x7f532412c0d0 2020-04-22T14:03:56.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.989+0000 7f532a790700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5324143840 con 0x7f5324063e30 2020-04-22T14:03:56.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.989+0000 7f5323fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f532412c0d0 0x7f53241464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:56.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.989+0000 7f5328d2d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5324063e30 0x7f53240642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:56.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.989+0000 7f53237fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f5324065fe0 0x7f532405b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:58374/0 (socket says 172.21.15.103:58374) 2020-04-22T14:03:56.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.989+0000 7f53237fe700 1 -- 172.21.15.103:0/1753126158 learned_addr learned my addr 172.21.15.103:0/1753126158 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:03:56.997 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.990+0000 7f5323fff700 1 -- 172.21.15.103:0/1753126158 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5324063e30 msgr2=0x7f53240642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:56.997 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.990+0000 7f5323fff700 1 --2- 172.21.15.103:0/1753126158 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5324063e30 0x7f53240642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:56.997 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.990+0000 7f5323fff700 1 -- 172.21.15.103:0/1753126158 >> v1:172.21.15.86:6789/0 conn(0x7f5324065fe0 legacy=0x7f532405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:56.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.990+0000 7f5323fff700 1 -- 172.21.15.103:0/1753126158 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f532405bb50 con 0x7f532412c0d0 2020-04-22T14:03:56.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.990+0000 7f5328d2d700 1 --2- 172.21.15.103:0/1753126158 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5324063e30 0x7f53240642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:03:56.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.990+0000 7f5323fff700 1 --2- 172.21.15.103:0/1753126158 >> v2:172.21.15.86:3300/0 conn(0x7f532412c0d0 0x7f53241464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5314002f30 tx=0x7f5314007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:56.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.990+0000 7f5323fff700 1 --2- 172.21.15.103:0/1753126158 >> v2:172.21.15.86:3300/0 conn(0x7f532412c0d0 0x7f53241464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5314002f30 tx=0x7f5314007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:56.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.990+0000 7f5323fff700 1 --2- 172.21.15.103:0/1753126158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f532412c0d0 0x7f53241464e0 secure :-1 s=READY pgs=265 cs=0 l=1 rx=0x7f5314002f30 tx=0x7f5314007a40).ready entity=mon.0 client_cookie=7df8dcdac2f6fa1 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:56.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.990+0000 7f5323fff700 1 --2- 172.21.15.103:0/1753126158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f532412c0d0 0x7f53241464e0 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7f5314002f30 tx=0x7f5314007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:56.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.990+0000 7f5322ffd700 1 -- 172.21.15.103:0/1753126158 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53140113c0 con 0x7f532412c0d0 2020-04-22T14:03:56.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.990+0000 7f5323fff700 1 --2- 172.21.15.103:0/1753126158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f532412c0d0 0x7f53241464e0 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7f5314002f30 tx=0x7f5314007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:56.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.990+0000 7f5322ffd700 1 -- 172.21.15.103:0/1753126158 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5314011560 con 0x7f532412c0d0 2020-04-22T14:03:56.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.990+0000 7f5323fff700 1 --2- 172.21.15.103:0/1753126158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f532412c0d0 0x7f53241464e0 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7f5314002f30 tx=0x7f5314007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:56.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.990+0000 7f5322ffd700 1 -- 172.21.15.103:0/1753126158 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5314011980 con 0x7f532412c0d0 2020-04-22T14:03:56.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.990+0000 7f532a790700 1 -- 172.21.15.103:0/1753126158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f532412c0d0 msgr2=0x7f53241464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:56.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.990+0000 7f532a790700 1 --2- 172.21.15.103:0/1753126158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f532412c0d0 0x7f53241464e0 secure :-1 s=READY pgs=265 cs=0 l=1 rx=0x7f5314002f30 tx=0x7f5314007a40).stop 2020-04-22T14:03:56.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.991+0000 7f532a790700 1 -- 172.21.15.103:0/1753126158 shutdown_connections 2020-04-22T14:03:56.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.991+0000 7f532a790700 1 --2- 172.21.15.103:0/1753126158 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5324063e30 0x7f53240642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:57.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.991+0000 7f532a790700 1 --2- 172.21.15.103:0/1753126158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f532412c0d0 0x7f53241464e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:57.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.991+0000 7f532a790700 1 -- 172.21.15.103:0/1753126158 >> 172.21.15.103:0/1753126158 conn(0x7f53240b9160 msgr2=0x7f532405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:57.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.991+0000 7f532a790700 1 -- 172.21.15.103:0/1753126158 shutdown_connections 2020-04-22T14:03:57.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.991+0000 7f532a790700 1 -- 172.21.15.103:0/1753126158 wait complete. 2020-04-22T14:03:57.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.992+0000 7f532a790700 1 Processor -- start 2020-04-22T14:03:57.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.992+0000 7f532a790700 1 -- start start 2020-04-22T14:03:57.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.992+0000 7f532a790700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5324063e30 0x7f53240b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:57.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.992+0000 7f532a790700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f532412c0d0 0x7f53240ac740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:57.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.992+0000 7f532a790700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53240b7db0 con 0x7f5324065fe0 2020-04-22T14:03:57.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.992+0000 7f532a790700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53240acba0 con 0x7f532412c0d0 2020-04-22T14:03:57.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.993+0000 7f532a790700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53240ae3c0 con 0x7f5324063e30 2020-04-22T14:03:57.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.993+0000 7f5328d2d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f532412c0d0 0x7f53240ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:57.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.993+0000 7f5328d2d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f532412c0d0 0x7f53240ac740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49036/0 (socket says 172.21.15.103:49036) 2020-04-22T14:03:57.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.993+0000 7f5328d2d700 1 -- 172.21.15.103:0/1735683064 learned_addr learned my addr 172.21.15.103:0/1735683064 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:57.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.993+0000 7f5323fff700 1 --2- 172.21.15.103:0/1735683064 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5324063e30 0x7f53240b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:57.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.993+0000 7f5328d2d700 1 -- 172.21.15.103:0/1735683064 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5324063e30 msgr2=0x7f53240b7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:57.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.993+0000 7f5328d2d700 1 --2- 172.21.15.103:0/1735683064 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5324063e30 0x7f53240b7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:57.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.993+0000 7f5328d2d700 1 -- 172.21.15.103:0/1735683064 >> v1:172.21.15.86:6789/0 conn(0x7f5324065fe0 legacy=0x7f53240ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:57.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.993+0000 7f5328d2d700 1 -- 172.21.15.103:0/1735683064 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53240ae660 con 0x7f532412c0d0 2020-04-22T14:03:57.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.993+0000 7f5323fff700 1 --2- 172.21.15.103:0/1735683064 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5324063e30 0x7f53240b7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:03:57.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.993+0000 7f5328d2d700 1 --2- 172.21.15.103:0/1735683064 >> v2:172.21.15.103:3300/0 conn(0x7f532412c0d0 0x7f53240ac740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f531c0033f0 tx=0x7f531c0111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:57.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.993+0000 7f5328d2d700 1 --2- 172.21.15.103:0/1735683064 >> v2:172.21.15.103:3300/0 conn(0x7f532412c0d0 0x7f53240ac740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f531c0033f0 tx=0x7f531c0111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:57.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.993+0000 7f5328d2d700 1 --2- 172.21.15.103:0/1735683064 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f532412c0d0 0x7f53240ac740 secure :-1 s=READY pgs=450 cs=0 l=1 rx=0x7f531c0033f0 tx=0x7f531c0111e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:57.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.993+0000 7f5328d2d700 1 --2- 172.21.15.103:0/1735683064 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f532412c0d0 0x7f53240ac740 secure :-1 s=THROTTLE_DONE pgs=450 cs=0 l=1 rx=0x7f531c0033f0 tx=0x7f531c0111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:57.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.993+0000 7f53217fa700 1 -- 172.21.15.103:0/1735683064 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f531c005e30 con 0x7f532412c0d0 2020-04-22T14:03:57.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.993+0000 7f5328d2d700 1 --2- 172.21.15.103:0/1735683064 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f532412c0d0 0x7f53240ac740 secure :-1 s=THROTTLE_DONE pgs=450 cs=0 l=1 rx=0x7f531c0033f0 tx=0x7f531c0111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:57.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.993+0000 7f5328d2d700 1 --2- 172.21.15.103:0/1735683064 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f532412c0d0 0x7f53240ac740 secure :-1 s=THROTTLE_DONE pgs=450 cs=0 l=1 rx=0x7f531c0033f0 tx=0x7f531c0111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:57.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.993+0000 7f53217fa700 1 -- 172.21.15.103:0/1735683064 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531c012c20 con 0x7f532412c0d0 2020-04-22T14:03:57.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.993+0000 7f532a790700 1 -- 172.21.15.103:0/1735683064 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53240afbc0 con 0x7f532412c0d0 2020-04-22T14:03:57.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.993+0000 7f53217fa700 1 -- 172.21.15.103:0/1735683064 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f531c012d90 con 0x7f532412c0d0 2020-04-22T14:03:57.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.993+0000 7f532a790700 1 -- 172.21.15.103:0/1735683064 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53240ad910 con 0x7f532412c0d0 2020-04-22T14:03:57.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.994+0000 7f5328d2d700 1 --2- 172.21.15.103:0/1735683064 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f532412c0d0 0x7f53240ac740 secure :-1 s=THROTTLE_DONE pgs=450 cs=0 l=1 rx=0x7f531c0033f0 tx=0x7f531c0111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:57.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.994+0000 7f532a790700 1 -- 172.21.15.103:0/1735683064 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53240ae1b0 con 0x7f532412c0d0 2020-04-22T14:03:57.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.994+0000 7f53217fa700 1 -- 172.21.15.103:0/1735683064 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f531c00ca00 con 0x7f532412c0d0 2020-04-22T14:03:57.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.994+0000 7f5328d2d700 1 --2- 172.21.15.103:0/1735683064 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f532412c0d0 0x7f53240ac740 secure :-1 s=THROTTLE_DONE pgs=450 cs=0 l=1 rx=0x7f531c0033f0 tx=0x7f531c0111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:57.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.995+0000 7f53217fa700 1 --2- 172.21.15.103:0/1735683064 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f530404d930 0x7f530404fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:57.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.995+0000 7f53217fa700 1 -- 172.21.15.103:0/1735683064 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f531c061700 con 0x7f532412c0d0 2020-04-22T14:03:57.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.995+0000 7f5323fff700 1 --2- 172.21.15.103:0/1735683064 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f530404d930 0x7f530404fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:57.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.995+0000 7f5323fff700 1 --2- 172.21.15.103:0/1735683064 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f530404d930 0x7f530404fdf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5314002f30 tx=0x7f5314007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:57.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.995+0000 7f5323fff700 1 --2- 172.21.15.103:0/1735683064 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f530404d930 0x7f530404fdf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5314002f30 tx=0x7f5314007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:57.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.995+0000 7f5323fff700 1 --2- 172.21.15.103:0/1735683064 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f530404d930 0x7f530404fdf0 secure :-1 s=READY pgs=182 cs=0 l=1 rx=0x7f5314002f30 tx=0x7f5314007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:57.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.999+0000 7f5328d2d700 1 --2- 172.21.15.103:0/1735683064 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f532412c0d0 0x7f53240ac740 secure :-1 s=THROTTLE_DONE pgs=450 cs=0 l=1 rx=0x7f531c0033f0 tx=0x7f531c0111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:57.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:56.999+0000 7f53217fa700 1 -- 172.21.15.103:0/1735683064 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f531c03ca80 con 0x7f532412c0d0 2020-04-22T14:03:57.189 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.187+0000 7f532a790700 1 -- 172.21.15.103:0/1735683064 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5324056c90 con 0x7f532412c0d0 2020-04-22T14:03:57.189 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.187+0000 7f5328d2d700 1 --2- 172.21.15.103:0/1735683064 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f532412c0d0 0x7f53240ac740 secure :-1 s=THROTTLE_DONE pgs=450 cs=0 l=1 rx=0x7f531c0033f0 tx=0x7f531c0111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:57.190 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.187+0000 7f53217fa700 1 -- 172.21.15.103:0/1735683064 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2141 (secure 0 0 0) 0x7f531c0400a0 con 0x7f532412c0d0 2020-04-22T14:03:57.190 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:03:57.190 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4956,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/2333777975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2333777975},{"type":"v1","addr":"172.21.15.86:6835","nonce":2333777975}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:03:38.935462+0000","modified":"2020-04-22T14:03:40.946647+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5050},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5050":{"gid":5050,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/3282872682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3282872682},{"type":"v1","addr":"172.21.15.103:6833","nonce":3282872682}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2020-04-22T14:03:57.192 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.188+0000 7f532a790700 1 -- 172.21.15.103:0/1735683064 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f530404d930 msgr2=0x7f530404fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:57.192 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.188+0000 7f532a790700 1 --2- 172.21.15.103:0/1735683064 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f530404d930 0x7f530404fdf0 secure :-1 s=READY pgs=182 cs=0 l=1 rx=0x7f5314002f30 tx=0x7f5314007a40).stop 2020-04-22T14:03:57.192 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.188+0000 7f532a790700 1 -- 172.21.15.103:0/1735683064 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f532412c0d0 msgr2=0x7f53240ac740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:57.192 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.188+0000 7f532a790700 1 --2- 172.21.15.103:0/1735683064 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f532412c0d0 0x7f53240ac740 secure :-1 s=READY pgs=450 cs=0 l=1 rx=0x7f531c0033f0 tx=0x7f531c0111e0).stop 2020-04-22T14:03:57.193 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.188+0000 7f532a790700 1 -- 172.21.15.103:0/1735683064 shutdown_connections 2020-04-22T14:03:57.193 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.189+0000 7f532a790700 1 --2- 172.21.15.103:0/1735683064 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f530404d930 0x7f530404fdf0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:57.193 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.189+0000 7f532a790700 1 --2- 172.21.15.103:0/1735683064 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f532412c0d0 0x7f53240ac740 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:57.193 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.189+0000 7f532a790700 1 --2- 172.21.15.103:0/1735683064 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5324063e30 0x7f53240b7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:57.193 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.189+0000 7f532a790700 1 -- 172.21.15.103:0/1735683064 >> 172.21.15.103:0/1735683064 conn(0x7f53240b9160 msgr2=0x7f532405ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:57.193 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.189+0000 7f532a790700 1 -- 172.21.15.103:0/1735683064 shutdown_connections 2020-04-22T14:03:57.193 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.189+0000 7f532a790700 1 -- 172.21.15.103:0/1735683064 wait complete. 2020-04-22T14:03:57.194 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 14 2020-04-22T14:03:57.201 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:57.214 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok config set mds_defer_session_stale false 2020-04-22T14:03:57.368 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:03:57.368 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "mds_defer_session_stale = 'false' (not observed, change may require restart) " 2020-04-22T14:03:57.368 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:03:57.376 INFO:tasks.cephfs.filesystem:_json_asok output: { "success": "mds_defer_session_stale = 'false' (not observed, change may require restart) " } 2020-04-22T14:03:57.376 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:57.401 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:03:57.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.546+0000 7fd542d2b700 1 Processor -- start 2020-04-22T14:03:57.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.546+0000 7fd542d2b700 1 -- start start 2020-04-22T14:03:57.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.547+0000 7fd542d2b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd53c12c0d0 0x7fd53c1464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:57.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.547+0000 7fd542d2b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd53c065fe0 0x7fd53c05b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:03:57.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.547+0000 7fd542d2b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd53c143300 con 0x7fd53c05b8a0 2020-04-22T14:03:57.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.547+0000 7fd542d2b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd53c12c4b0 con 0x7fd53c12c0d0 2020-04-22T14:03:57.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.547+0000 7fd542d2b700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd53c1435a0 con 0x7fd53c065fe0 2020-04-22T14:03:57.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.547+0000 7fd53bfff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd53c065fe0 0x7fd53c05b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:57.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.547+0000 7fd53bfff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd53c065fe0 0x7fd53c05b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49040/0 (socket says 172.21.15.103:49040) 2020-04-22T14:03:57.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.547+0000 7fd53bfff700 1 -- 172.21.15.103:0/3345606024 learned_addr learned my addr 172.21.15.103:0/3345606024 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:57.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.547+0000 7fd540ac7700 1 --2- 172.21.15.103:0/3345606024 >> v2:172.21.15.86:3300/0 conn(0x7fd53c12c0d0 0x7fd53c1464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:57.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.547+0000 7fd53bfff700 1 -- 172.21.15.103:0/3345606024 >> v2:172.21.15.86:3300/0 conn(0x7fd53c12c0d0 msgr2=0x7fd53c1464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:03:57.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.547+0000 7fd53bfff700 1 --2- 172.21.15.103:0/3345606024 >> v2:172.21.15.86:3300/0 conn(0x7fd53c12c0d0 0x7fd53c1464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:57.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.547+0000 7fd53bfff700 1 -- 172.21.15.103:0/3345606024 >> v1:172.21.15.86:6789/0 conn(0x7fd53c05b8a0 legacy=0x7fd53c062ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:57.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.547+0000 7fd53bfff700 1 -- 172.21.15.103:0/3345606024 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd53c143840 con 0x7fd53c065fe0 2020-04-22T14:03:57.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.547+0000 7fd53bfff700 1 --2- 172.21.15.103:0/3345606024 >> v2:172.21.15.103:3300/0 conn(0x7fd53c065fe0 0x7fd53c05b440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd528002f30 tx=0x7fd528007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:57.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.547+0000 7fd53bfff700 1 --2- 172.21.15.103:0/3345606024 >> v2:172.21.15.103:3300/0 conn(0x7fd53c065fe0 0x7fd53c05b440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd528002f30 tx=0x7fd528007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:57.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.547+0000 7fd53bfff700 1 --2- 172.21.15.103:0/3345606024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd53c065fe0 0x7fd53c05b440 secure :-1 s=READY pgs=451 cs=0 l=1 rx=0x7fd528002f30 tx=0x7fd528007a40).ready entity=mon.1 client_cookie=f6f662b5f7bf7a11 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:57.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.548+0000 7fd53bfff700 1 --2- 172.21.15.103:0/3345606024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd53c065fe0 0x7fd53c05b440 secure :-1 s=THROTTLE_DONE pgs=451 cs=0 l=1 rx=0x7fd528002f30 tx=0x7fd528007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:57.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.548+0000 7fd53b7fe700 1 -- 172.21.15.103:0/3345606024 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd528011720 con 0x7fd53c065fe0 2020-04-22T14:03:57.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.548+0000 7fd53bfff700 1 --2- 172.21.15.103:0/3345606024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd53c065fe0 0x7fd53c05b440 secure :-1 s=THROTTLE_DONE pgs=451 cs=0 l=1 rx=0x7fd528002f30 tx=0x7fd528007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:57.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.548+0000 7fd53bfff700 1 --2- 172.21.15.103:0/3345606024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd53c065fe0 0x7fd53c05b440 secure :-1 s=THROTTLE_DONE pgs=451 cs=0 l=1 rx=0x7fd528002f30 tx=0x7fd528007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:57.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.548+0000 7fd53b7fe700 1 -- 172.21.15.103:0/3345606024 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd528011880 con 0x7fd53c065fe0 2020-04-22T14:03:57.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.548+0000 7fd53b7fe700 1 -- 172.21.15.103:0/3345606024 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd528011ca0 con 0x7fd53c065fe0 2020-04-22T14:03:57.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.548+0000 7fd542d2b700 1 -- 172.21.15.103:0/3345606024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd53c065fe0 msgr2=0x7fd53c05b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:57.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.548+0000 7fd542d2b700 1 --2- 172.21.15.103:0/3345606024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd53c065fe0 0x7fd53c05b440 secure :-1 s=READY pgs=451 cs=0 l=1 rx=0x7fd528002f30 tx=0x7fd528007a40).stop 2020-04-22T14:03:57.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.548+0000 7fd542d2b700 1 -- 172.21.15.103:0/3345606024 shutdown_connections 2020-04-22T14:03:57.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.548+0000 7fd542d2b700 1 --2- 172.21.15.103:0/3345606024 >> v2:172.21.15.86:3300/0 conn(0x7fd53c12c0d0 0x7fd53c1464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:03:57.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.548+0000 7fd542d2b700 1 --2- 172.21.15.103:0/3345606024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd53c065fe0 0x7fd53c05b440 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:57.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.548+0000 7fd542d2b700 1 -- 172.21.15.103:0/3345606024 >> 172.21.15.103:0/3345606024 conn(0x7fd53c0b9160 msgr2=0x7fd53c05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:57.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.548+0000 7fd542d2b700 1 -- 172.21.15.103:0/3345606024 shutdown_connections 2020-04-22T14:03:57.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.548+0000 7fd542d2b700 1 -- 172.21.15.103:0/3345606024 wait complete. 2020-04-22T14:03:57.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.549+0000 7fd542d2b700 1 Processor -- start 2020-04-22T14:03:57.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.549+0000 7fd542d2b700 1 -- start start 2020-04-22T14:03:57.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.550+0000 7fd542d2b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd53c05b8a0 0x7fd53c0b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:57.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.550+0000 7fd542d2b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd53c065fe0 0x7fd53c0ad630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:57.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.550+0000 7fd542d2b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd53c12c0d0 0x7fd53c0ada90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:57.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.550+0000 7fd542d2b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd53c0b5920 con 0x7fd53c065fe0 2020-04-22T14:03:57.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.550+0000 7fd542d2b700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd53c0adfe0 con 0x7fd53c12c0d0 2020-04-22T14:03:57.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.550+0000 7fd542d2b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c0ae280 con 0x7fd53c05b8a0 2020-04-22T14:03:57.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.550+0000 7fd5412c8700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd53c12c0d0 0x7fd53c0ada90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:57.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.550+0000 7fd5412c8700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd53c12c0d0 0x7fd53c0ada90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49048/0 (socket says 172.21.15.103:49048) 2020-04-22T14:03:57.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.550+0000 7fd5412c8700 1 -- 172.21.15.103:0/1363437814 learned_addr learned my addr 172.21.15.103:0/1363437814 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:03:57.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.550+0000 7fd53bfff700 1 --2- 172.21.15.103:0/1363437814 >> v2:172.21.15.86:3300/0 conn(0x7fd53c065fe0 0x7fd53c0ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:57.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.550+0000 7fd540ac7700 1 --2- 172.21.15.103:0/1363437814 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd53c05b8a0 0x7fd53c0b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:57.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.550+0000 7fd5412c8700 1 -- 172.21.15.103:0/1363437814 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd53c05b8a0 msgr2=0x7fd53c0b54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:57.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.550+0000 7fd5412c8700 1 --2- 172.21.15.103:0/1363437814 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd53c05b8a0 0x7fd53c0b54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:57.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.550+0000 7fd5412c8700 1 -- 172.21.15.103:0/1363437814 >> v2:172.21.15.86:3300/0 conn(0x7fd53c065fe0 msgr2=0x7fd53c0ad630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:57.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.550+0000 7fd5412c8700 1 --2- 172.21.15.103:0/1363437814 >> v2:172.21.15.86:3300/0 conn(0x7fd53c065fe0 0x7fd53c0ad630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:57.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.550+0000 7fd5412c8700 1 -- 172.21.15.103:0/1363437814 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd53c0ae520 con 0x7fd53c12c0d0 2020-04-22T14:03:57.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.550+0000 7fd5412c8700 1 --2- 172.21.15.103:0/1363437814 >> v2:172.21.15.103:3300/0 conn(0x7fd53c12c0d0 0x7fd53c0ada90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd53c0669a0 tx=0x7fd5340021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:57.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.551+0000 7fd5412c8700 1 --2- 172.21.15.103:0/1363437814 >> v2:172.21.15.103:3300/0 conn(0x7fd53c12c0d0 0x7fd53c0ada90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd53c0669a0 tx=0x7fd5340021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:57.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.551+0000 7fd5412c8700 1 --2- 172.21.15.103:0/1363437814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd53c12c0d0 0x7fd53c0ada90 secure :-1 s=READY pgs=452 cs=0 l=1 rx=0x7fd53c0669a0 tx=0x7fd5340021b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:57.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.551+0000 7fd5412c8700 1 --2- 172.21.15.103:0/1363437814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd53c12c0d0 0x7fd53c0ada90 secure :-1 s=THROTTLE_DONE pgs=452 cs=0 l=1 rx=0x7fd53c0669a0 tx=0x7fd5340021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:57.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.551+0000 7fd5412c8700 1 --2- 172.21.15.103:0/1363437814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd53c12c0d0 0x7fd53c0ada90 secure :-1 s=THROTTLE_DONE pgs=452 cs=0 l=1 rx=0x7fd53c0669a0 tx=0x7fd5340021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:57.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.551+0000 7fd5412c8700 1 --2- 172.21.15.103:0/1363437814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd53c12c0d0 0x7fd53c0ada90 secure :-1 s=THROTTLE_DONE pgs=452 cs=0 l=1 rx=0x7fd53c0669a0 tx=0x7fd5340021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:57.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.551+0000 7fd539ffb700 1 -- 172.21.15.103:0/1363437814 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5340101e0 con 0x7fd53c12c0d0 2020-04-22T14:03:57.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.551+0000 7fd539ffb700 1 -- 172.21.15.103:0/1363437814 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd534010340 con 0x7fd53c12c0d0 2020-04-22T14:03:57.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.551+0000 7fd539ffb700 1 -- 172.21.15.103:0/1363437814 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd534010760 con 0x7fd53c12c0d0 2020-04-22T14:03:57.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.551+0000 7fd542d2b700 1 -- 172.21.15.103:0/1363437814 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd53c0ac940 con 0x7fd53c12c0d0 2020-04-22T14:03:57.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.551+0000 7fd542d2b700 1 -- 172.21.15.103:0/1363437814 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd53c0aec00 con 0x7fd53c12c0d0 2020-04-22T14:03:57.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.551+0000 7fd5412c8700 1 --2- 172.21.15.103:0/1363437814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd53c12c0d0 0x7fd53c0ada90 secure :-1 s=THROTTLE_DONE pgs=452 cs=0 l=1 rx=0x7fd53c0669a0 tx=0x7fd5340021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:57.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.552+0000 7fd542d2b700 1 -- 172.21.15.103:0/1363437814 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd53c056c90 con 0x7fd53c12c0d0 2020-04-22T14:03:57.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.552+0000 7fd539ffb700 1 -- 172.21.15.103:0/1363437814 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fd534006860 con 0x7fd53c12c0d0 2020-04-22T14:03:57.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.552+0000 7fd5412c8700 1 --2- 172.21.15.103:0/1363437814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd53c12c0d0 0x7fd53c0ada90 secure :-1 s=THROTTLE_DONE pgs=452 cs=0 l=1 rx=0x7fd53c0669a0 tx=0x7fd5340021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:57.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.552+0000 7fd539ffb700 1 --2- 172.21.15.103:0/1363437814 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd52404d9d0 0x7fd52404fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:03:57.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.552+0000 7fd539ffb700 1 -- 172.21.15.103:0/1363437814 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd534061430 con 0x7fd53c12c0d0 2020-04-22T14:03:57.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.552+0000 7fd540ac7700 1 --2- 172.21.15.103:0/1363437814 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd52404d9d0 0x7fd52404fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:03:57.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.552+0000 7fd540ac7700 1 --2- 172.21.15.103:0/1363437814 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd52404d9d0 0x7fd52404fe90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd530002f30 tx=0x7fd53000d710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:57.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.553+0000 7fd540ac7700 1 --2- 172.21.15.103:0/1363437814 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd52404d9d0 0x7fd52404fe90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd530002f30 tx=0x7fd53000d710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:57.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.553+0000 7fd540ac7700 1 --2- 172.21.15.103:0/1363437814 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd52404d9d0 0x7fd52404fe90 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7fd530002f30 tx=0x7fd53000d710).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:03:57.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.556+0000 7fd5412c8700 1 --2- 172.21.15.103:0/1363437814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd53c12c0d0 0x7fd53c0ada90 secure :-1 s=THROTTLE_DONE pgs=452 cs=0 l=1 rx=0x7fd53c0669a0 tx=0x7fd5340021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:57.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.556+0000 7fd539ffb700 1 -- 172.21.15.103:0/1363437814 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fd53403c930 con 0x7fd53c12c0d0 2020-04-22T14:03:57.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.749+0000 7fd542d2b700 1 -- 172.21.15.103:0/1363437814 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd53c147360 con 0x7fd53c12c0d0 2020-04-22T14:03:57.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.749+0000 7fd5412c8700 1 --2- 172.21.15.103:0/1363437814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd53c12c0d0 0x7fd53c0ada90 secure :-1 s=THROTTLE_DONE pgs=452 cs=0 l=1 rx=0x7fd53c0669a0 tx=0x7fd5340021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:03:57.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.749+0000 7fd539ffb700 1 -- 172.21.15.103:0/1363437814 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2141 (secure 0 0 0) 0x7fd53403ff50 con 0x7fd53c12c0d0 2020-04-22T14:03:57.752 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:03:57.752 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4956,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/2333777975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2333777975},{"type":"v1","addr":"172.21.15.86:6835","nonce":2333777975}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:03:38.935462+0000","modified":"2020-04-22T14:03:40.946647+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5050},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5050":{"gid":5050,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/3282872682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3282872682},{"type":"v1","addr":"172.21.15.103:6833","nonce":3282872682}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2020-04-22T14:03:57.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.751+0000 7fd542d2b700 1 -- 172.21.15.103:0/1363437814 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd52404d9d0 msgr2=0x7fd52404fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:57.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.751+0000 7fd542d2b700 1 --2- 172.21.15.103:0/1363437814 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd52404d9d0 0x7fd52404fe90 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7fd530002f30 tx=0x7fd53000d710).stop 2020-04-22T14:03:57.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.751+0000 7fd542d2b700 1 -- 172.21.15.103:0/1363437814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd53c12c0d0 msgr2=0x7fd53c0ada90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:03:57.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.751+0000 7fd542d2b700 1 --2- 172.21.15.103:0/1363437814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd53c12c0d0 0x7fd53c0ada90 secure :-1 s=READY pgs=452 cs=0 l=1 rx=0x7fd53c0669a0 tx=0x7fd5340021b0).stop 2020-04-22T14:03:57.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.751+0000 7fd542d2b700 1 -- 172.21.15.103:0/1363437814 shutdown_connections 2020-04-22T14:03:57.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.751+0000 7fd542d2b700 1 --2- 172.21.15.103:0/1363437814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd53c12c0d0 0x7fd53c0ada90 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:57.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.751+0000 7fd542d2b700 1 --2- 172.21.15.103:0/1363437814 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd53c05b8a0 0x7fd53c0b54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:57.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.751+0000 7fd542d2b700 1 --2- 172.21.15.103:0/1363437814 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd52404d9d0 0x7fd52404fe90 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:57.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.751+0000 7fd542d2b700 1 --2- 172.21.15.103:0/1363437814 >> v2:172.21.15.86:3300/0 conn(0x7fd53c065fe0 0x7fd53c0ad630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:03:57.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.751+0000 7fd542d2b700 1 -- 172.21.15.103:0/1363437814 >> 172.21.15.103:0/1363437814 conn(0x7fd53c0b9160 msgr2=0x7fd53c12b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:03:57.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.751+0000 7fd542d2b700 1 -- 172.21.15.103:0/1363437814 shutdown_connections 2020-04-22T14:03:57.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:03:57.751+0000 7fd542d2b700 1 -- 172.21.15.103:0/1363437814 wait complete. 2020-04-22T14:03:57.755 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 14 2020-04-22T14:03:57.763 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2020-04-22T14:03:57.763 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:57.776 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-04-22T14:03:57.776 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:03:57.853 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[46220]: fuse finished with error 0 and tester_r 0 2020-04-22T14:03:57.884 INFO:teuthology.orchestra.run:waiting for 900 2020-04-22T14:03:57.970 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:03:57.970 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:03:57.970 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:57.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:57.986 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:03:58.065 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:58.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:58.112 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down brx.0' 2020-04-22T14:03:58.280 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.0' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/9) 2020-04-22T14:03:58.280 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:58.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:58.293 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete brx.0' 2020-04-22T14:03:58.402 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.0' (67eea279-a82c-4e35-b760-55f58d2b9f7e) successfully deleted. 2020-04-22T14:03:58.402 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:58.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:58.431 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:03:58.538 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:58.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:58.563 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:03:58.629 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:03:58.630 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:03:58.630 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:03:58.630 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:58.630 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:03:58.633 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:58.633 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:03:58.633 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:58.634 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:03:58.634 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:58.634 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:03:58.634 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:58.634 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:03:58.634 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:58.634 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:03:58.635 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42602sec preferred_lft 42602sec 2020-04-22T14:03:58.635 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:03:58.635 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:58.635 INFO:teuthology.orchestra.run.smithi103.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:03:58.635 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 1e:c6:b7:0e:37:a7 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:58.635 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:03:58.635 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:58.636 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::d0d0:5166:401f:3825/64 scope link noprefixroute 2020-04-22T14:03:58.636 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:58.636 INFO:teuthology.orchestra.run.smithi103.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-04-22T14:03:58.636 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 1e:c6:b7:0e:37:a7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2020-04-22T14:03:58.636 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:58.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:58.674 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:03:58.749 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:58.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:58.799 INFO:teuthology.orchestra.run.smithi103:> nmcli connection show 2020-04-22T14:03:58.880 INFO:teuthology.orchestra.run.smithi103.stdout:NAME UUID TYPE DEVICE 2020-04-22T14:03:58.956 INFO:teuthology.orchestra.run.smithi103.stdout:System enp3s0f1 b0a308d1-bd90-60af-eb7c-0183bb425a1a ethernet enp3s0f1 2020-04-22T14:03:58.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-brx a4692aa6-6ed6-43e9-ba6f-d4aca06d15e9 bridge ceph-brx 2020-04-22T14:03:58.956 INFO:teuthology.orchestra.run.smithi103.stdout:brx.1 58b499b1-b397-46f5-ba0f-982e5d02d150 ethernet brx.1 2020-04-22T14:03:58.957 INFO:teuthology.orchestra.run.smithi103.stdout:eno1 206ad60d-195e-4d4b-a9fe-a5dd1f33a67d ethernet -- 2020-04-22T14:03:58.957 INFO:teuthology.orchestra.run.smithi103.stdout:eno2 894a7dd2-d329-4985-9ef9-84a92c6e1c6c ethernet -- 2020-04-22T14:03:58.957 INFO:teuthology.orchestra.run.smithi103.stdout:enp3s0f0 5a3237ce-06ab-4ae0-818b-45bdf036cb08 ethernet -- 2020-04-22T14:03:58.957 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:58.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:58.989 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:03:59.051 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2020-04-22T14:03:59.051 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:59.101 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-04-22T14:03:59.101 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:03:59.178 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[47478]: fuse finished with error 0 and tester_r 0 2020-04-22T14:03:59.215 INFO:teuthology.orchestra.run:waiting for 900 2020-04-22T14:03:59.216 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-04-22T14:03:59.216 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:03:59.216 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:59.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:59.269 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:03:59.345 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:59.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:59.395 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down brx.1' 2020-04-22T14:03:59.553 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.1' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/10) 2020-04-22T14:03:59.553 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:59.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:59.566 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete brx.1' 2020-04-22T14:03:59.681 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.1' (58b499b1-b397-46f5-ba0f-982e5d02d150) successfully deleted. 2020-04-22T14:03:59.681 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:59.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:59.705 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:03:59.817 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:59.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:59.838 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:03:59.898 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:03:59.898 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:03:59.898 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:03:59.898 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:59.898 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:03:59.899 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:59.899 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:03:59.899 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:59.899 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:03:59.899 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:59.899 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:03:59.900 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:59.900 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:03:59.900 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:59.900 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:03:59.900 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42600sec preferred_lft 42600sec 2020-04-22T14:03:59.901 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:03:59.901 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:59.901 INFO:teuthology.orchestra.run.smithi103.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:03:59.901 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:03:59.901 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:03:59.901 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:59.902 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::d0d0:5166:401f:3825/64 scope link noprefixroute 2020-04-22T14:03:59.902 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:03:59.902 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:03:59.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:03:59.954 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:04:00.029 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:04:00.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:04:00.079 INFO:teuthology.orchestra.run.smithi103:> nmcli connection show 2020-04-22T14:04:00.153 INFO:teuthology.orchestra.run.smithi103.stdout:NAME UUID TYPE DEVICE 2020-04-22T14:04:00.156 INFO:teuthology.orchestra.run.smithi103.stdout:System enp3s0f1 b0a308d1-bd90-60af-eb7c-0183bb425a1a ethernet enp3s0f1 2020-04-22T14:04:00.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-brx a4692aa6-6ed6-43e9-ba6f-d4aca06d15e9 bridge ceph-brx 2020-04-22T14:04:00.156 INFO:teuthology.orchestra.run.smithi103.stdout:eno1 206ad60d-195e-4d4b-a9fe-a5dd1f33a67d ethernet -- 2020-04-22T14:04:00.156 INFO:teuthology.orchestra.run.smithi103.stdout:eno2 894a7dd2-d329-4985-9ef9-84a92c6e1c6c ethernet -- 2020-04-22T14:04:00.156 INFO:teuthology.orchestra.run.smithi103.stdout:enp3s0f0 5a3237ce-06ab-4ae0-818b-45bdf036cb08 ethernet -- 2020-04-22T14:04:00.156 INFO:tasks.cephfs.mount:Removing the 'ceph-brx' 2020-04-22T14:04:00.157 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:04:00.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:04:00.199 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down ceph-brx' 2020-04-22T14:04:00.358 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/8) 2020-04-22T14:04:00.358 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:04:00.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:04:00.372 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete ceph-brx' 2020-04-22T14:04:00.480 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' (a4692aa6-6ed6-43e9-ba6f-d4aca06d15e9) successfully deleted. 2020-04-22T14:04:00.480 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:04:00.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:04:00.507 INFO:teuthology.orchestra.run.smithi103:> route 2020-04-22T14:04:00.565 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2020-04-22T14:04:00.565 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-04-22T14:04:00.566 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 102 0 0 enp3s0f1 2020-04-22T14:04:00.566 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 102 0 0 enp3s0f1 2020-04-22T14:04:00.566 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:04:00.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:04:00.616 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -D FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-04-22T14:04:00.693 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:04:00.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:04:00.746 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -D FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-04-22T14:04:00.853 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:04:00.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:04:00.877 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -t nat -D POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-04-22T14:04:00.962 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:04:01.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:04:01.014 INFO:teuthology.orchestra.run.smithi103:> cat /tmp/python-ceph-brx 2020-04-22T14:04:01.072 INFO:teuthology.orchestra.run.smithi103.stdout:0 2020-04-22T14:04:01.072 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:04:01.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:04:01.120 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 0 > /proc/sys/net/ipv4/ip_forward' 2020-04-22T14:04:01.195 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:04:01.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:04:01.240 INFO:teuthology.orchestra.run.smithi103:> rm -f /tmp/python-ceph-brx 2020-04-22T14:04:01.300 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:04:01.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:04:01.359 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:04:01.418 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:04:01.466 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-04-22T14:04:01.467 INFO:teuthology.orchestra.run.smithi103:> import cephfs as libcephfs 2020-04-22T14:04:01.467 INFO:teuthology.orchestra.run.smithi103:> cephfs = libcephfs.LibCephFS(conffile='"'"''"'"') 2020-04-22T14:04:01.467 INFO:teuthology.orchestra.run.smithi103:> cephfs.mount() 2020-04-22T14:04:01.467 INFO:teuthology.orchestra.run.smithi103:> client_id = cephfs.get_instance_id() 2020-04-22T14:04:01.467 INFO:teuthology.orchestra.run.smithi103:> cephfs.abort_conn() 2020-04-22T14:04:01.467 INFO:teuthology.orchestra.run.smithi103:> print(client_id) 2020-04-22T14:04:01.467 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:04:01.611 INFO:teuthology.orchestra.run.smithi103.stdout:5383 2020-04-22T14:04:01.772 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:04:01.826 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:04:01.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.970+0000 7f79fc7e5700 1 Processor -- start 2020-04-22T14:04:01.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.970+0000 7f79fc7e5700 1 -- start start 2020-04-22T14:04:01.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.971+0000 7f79fc7e5700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f79f412c0d0 0x7f79f41464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:04:01.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.971+0000 7f79fc7e5700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79f4063e30 0x7f79f40642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:04:01.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.971+0000 7f79fc7e5700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79f4143300 con 0x7f79f4065fe0 2020-04-22T14:04:01.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.971+0000 7f79fc7e5700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79f41435a0 con 0x7f79f412c0d0 2020-04-22T14:04:01.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.971+0000 7f79fc7e5700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f4143840 con 0x7f79f4063e30 2020-04-22T14:04:01.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.971+0000 7f79fa581700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f79f412c0d0 0x7f79f41464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:04:01.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.971+0000 7f79f9d80700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f79f4065fe0 0x7f79f405b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41260/0 (socket says 172.21.15.103:41260) 2020-04-22T14:04:01.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.971+0000 7f79fa581700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f79f412c0d0 0x7f79f41464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49070/0 (socket says 172.21.15.103:49070) 2020-04-22T14:04:01.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.971+0000 7f79f9d80700 1 -- 172.21.15.103:0/3764933397 learned_addr learned my addr 172.21.15.103:0/3764933397 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:04:01.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.971+0000 7f79fad82700 1 --2- 172.21.15.103:0/3764933397 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79f4063e30 0x7f79f40642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:04:01.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.971+0000 7f79fa581700 1 -- 172.21.15.103:0/3764933397 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79f4063e30 msgr2=0x7f79f40642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:04:01.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.971+0000 7f79fa581700 1 --2- 172.21.15.103:0/3764933397 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79f4063e30 0x7f79f40642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:04:01.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.972+0000 7f79fa581700 1 -- 172.21.15.103:0/3764933397 >> v1:172.21.15.103:6789/0 conn(0x7f79f4065fe0 legacy=0x7f79f405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:04:01.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.972+0000 7f79f957f700 1 -- 172.21.15.103:0/3764933397 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 295714173 0 0) 0x7f79f4143300 con 0x7f79f4065fe0 2020-04-22T14:04:01.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.972+0000 7f79fa581700 1 -- 172.21.15.103:0/3764933397 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f405bb50 con 0x7f79f412c0d0 2020-04-22T14:04:01.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.972+0000 7f79fa581700 1 --2- 172.21.15.103:0/3764933397 >> v2:172.21.15.103:3300/0 conn(0x7f79f412c0d0 0x7f79f41464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f79e8002f30 tx=0x7f79e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:04:01.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.972+0000 7f79fa581700 1 --2- 172.21.15.103:0/3764933397 >> v2:172.21.15.103:3300/0 conn(0x7f79f412c0d0 0x7f79f41464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f79e8002f30 tx=0x7f79e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:04:01.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.972+0000 7f79fa581700 1 --2- 172.21.15.103:0/3764933397 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79f412c0d0 0x7f79f41464e0 secure :-1 s=READY pgs=458 cs=0 l=1 rx=0x7f79e8002f30 tx=0x7f79e8007a40).ready entity=mon.1 client_cookie=3cf90c57114f19a3 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:04:01.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.972+0000 7f79fa581700 1 --2- 172.21.15.103:0/3764933397 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79f412c0d0 0x7f79f41464e0 secure :-1 s=THROTTLE_DONE pgs=458 cs=0 l=1 rx=0x7f79e8002f30 tx=0x7f79e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:04:01.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.972+0000 7f79f957f700 1 -- 172.21.15.103:0/3764933397 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79e8011470 con 0x7f79f412c0d0 2020-04-22T14:04:01.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.972+0000 7f79fa581700 1 --2- 172.21.15.103:0/3764933397 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79f412c0d0 0x7f79f41464e0 secure :-1 s=THROTTLE_DONE pgs=458 cs=0 l=1 rx=0x7f79e8002f30 tx=0x7f79e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:04:01.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.972+0000 7f79f957f700 1 -- 172.21.15.103:0/3764933397 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e8011610 con 0x7f79f412c0d0 2020-04-22T14:04:01.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.972+0000 7f79fa581700 1 --2- 172.21.15.103:0/3764933397 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79f412c0d0 0x7f79f41464e0 secure :-1 s=THROTTLE_DONE pgs=458 cs=0 l=1 rx=0x7f79e8002f30 tx=0x7f79e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:04:01.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.972+0000 7f79f957f700 1 -- 172.21.15.103:0/3764933397 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79e80119f0 con 0x7f79f412c0d0 2020-04-22T14:04:01.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.972+0000 7f79fc7e5700 1 -- 172.21.15.103:0/3764933397 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79f412c0d0 msgr2=0x7f79f41464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:04:01.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.972+0000 7f79fc7e5700 1 --2- 172.21.15.103:0/3764933397 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79f412c0d0 0x7f79f41464e0 secure :-1 s=READY pgs=458 cs=0 l=1 rx=0x7f79e8002f30 tx=0x7f79e8007a40).stop 2020-04-22T14:04:01.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.972+0000 7f79fc7e5700 1 -- 172.21.15.103:0/3764933397 shutdown_connections 2020-04-22T14:04:01.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.972+0000 7f79fc7e5700 1 --2- 172.21.15.103:0/3764933397 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79f4063e30 0x7f79f40642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:04:01.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.972+0000 7f79fc7e5700 1 --2- 172.21.15.103:0/3764933397 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79f412c0d0 0x7f79f41464e0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:04:01.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.972+0000 7f79fc7e5700 1 -- 172.21.15.103:0/3764933397 >> 172.21.15.103:0/3764933397 conn(0x7f79f40b9160 msgr2=0x7f79f405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:04:01.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.972+0000 7f79fc7e5700 1 -- 172.21.15.103:0/3764933397 shutdown_connections 2020-04-22T14:04:01.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.972+0000 7f79fc7e5700 1 -- 172.21.15.103:0/3764933397 wait complete. 2020-04-22T14:04:01.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.973+0000 7f79fc7e5700 1 Processor -- start 2020-04-22T14:04:01.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.973+0000 7f79fc7e5700 1 -- start start 2020-04-22T14:04:01.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.974+0000 7f79fc7e5700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f79f4063e30 0x7f79f4126c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:04:01.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.974+0000 7f79fc7e5700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79f4065fe0 0x7f79f4128b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:04:01.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.974+0000 7f79fc7e5700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79f4127070 con 0x7f79f412c0d0 2020-04-22T14:04:01.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.974+0000 7f79fc7e5700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79f40b6d70 con 0x7f79f4063e30 2020-04-22T14:04:01.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.974+0000 7f79fc7e5700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f40b7010 con 0x7f79f4065fe0 2020-04-22T14:04:01.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.974+0000 7f79fa581700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f79f4063e30 0x7f79f4126c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:04:01.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.974+0000 7f79fad82700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f79f412c0d0 0x7f79f4125e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41268/0 (socket says 172.21.15.103:41268) 2020-04-22T14:04:01.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.974+0000 7f79fad82700 1 -- 172.21.15.103:0/4256855211 learned_addr learned my addr 172.21.15.103:0/4256855211 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:04:01.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.974+0000 7f79f9d80700 1 --2- 172.21.15.103:0/4256855211 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79f4065fe0 0x7f79f4128b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:04:01.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.974+0000 7f79fa581700 1 -- 172.21.15.103:0/4256855211 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79f4065fe0 msgr2=0x7f79f4128b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:04:01.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.974+0000 7f79fa581700 1 --2- 172.21.15.103:0/4256855211 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79f4065fe0 0x7f79f4128b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:04:01.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.974+0000 7f79fa581700 1 -- 172.21.15.103:0/4256855211 >> v1:172.21.15.103:6789/0 conn(0x7f79f412c0d0 legacy=0x7f79f4125e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:04:01.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.974+0000 7f79e77fe700 1 -- 172.21.15.103:0/4256855211 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 610373621 0 0) 0x7f79ec001260 con 0x7f79f412c0d0 2020-04-22T14:04:01.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.974+0000 7f79fa581700 1 -- 172.21.15.103:0/4256855211 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f40b72b0 con 0x7f79f4063e30 2020-04-22T14:04:01.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.974+0000 7f79fa581700 1 --2- 172.21.15.103:0/4256855211 >> v2:172.21.15.103:3300/0 conn(0x7f79f4063e30 0x7f79f4126c10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f79e8002f30 tx=0x7f79e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:04:01.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.974+0000 7f79fa581700 1 --2- 172.21.15.103:0/4256855211 >> v2:172.21.15.103:3300/0 conn(0x7f79f4063e30 0x7f79f4126c10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f79e8002f30 tx=0x7f79e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:04:01.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.974+0000 7f79fa581700 1 --2- 172.21.15.103:0/4256855211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79f4063e30 0x7f79f4126c10 secure :-1 s=READY pgs=460 cs=0 l=1 rx=0x7f79e8002f30 tx=0x7f79e8007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:04:01.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.975+0000 7f79fa581700 1 --2- 172.21.15.103:0/4256855211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79f4063e30 0x7f79f4126c10 secure :-1 s=THROTTLE_DONE pgs=460 cs=0 l=1 rx=0x7f79e8002f30 tx=0x7f79e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:04:01.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.975+0000 7f79fa581700 1 --2- 172.21.15.103:0/4256855211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79f4063e30 0x7f79f4126c10 secure :-1 s=THROTTLE_DONE pgs=460 cs=0 l=1 rx=0x7f79e8002f30 tx=0x7f79e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:04:01.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.975+0000 7f79e77fe700 1 -- 172.21.15.103:0/4256855211 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79e8007170 con 0x7f79f4063e30 2020-04-22T14:04:01.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.975+0000 7f79fa581700 1 --2- 172.21.15.103:0/4256855211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79f4063e30 0x7f79f4126c10 secure :-1 s=THROTTLE_DONE pgs=460 cs=0 l=1 rx=0x7f79e8002f30 tx=0x7f79e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:04:01.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.975+0000 7f79e77fe700 1 -- 172.21.15.103:0/4256855211 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e80072d0 con 0x7f79f4063e30 2020-04-22T14:04:01.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.975+0000 7f79e77fe700 1 -- 172.21.15.103:0/4256855211 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79e80056c0 con 0x7f79f4063e30 2020-04-22T14:04:01.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.975+0000 7f79fc7e5700 1 -- 172.21.15.103:0/4256855211 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f41265a0 con 0x7f79f4063e30 2020-04-22T14:04:01.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.975+0000 7f79fc7e5700 1 -- 172.21.15.103:0/4256855211 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f4128f80 con 0x7f79f4063e30 2020-04-22T14:04:01.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.975+0000 7f79fa581700 1 --2- 172.21.15.103:0/4256855211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79f4063e30 0x7f79f4126c10 secure :-1 s=THROTTLE_DONE pgs=460 cs=0 l=1 rx=0x7f79e8002f30 tx=0x7f79e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:04:01.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.976+0000 7f79fc7e5700 1 -- 172.21.15.103:0/4256855211 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79f40b6bb0 con 0x7f79f4063e30 2020-04-22T14:04:01.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.976+0000 7f79e77fe700 1 -- 172.21.15.103:0/4256855211 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f79e8005930 con 0x7f79f4063e30 2020-04-22T14:04:01.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.976+0000 7f79fa581700 1 --2- 172.21.15.103:0/4256855211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79f4063e30 0x7f79f4126c10 secure :-1 s=THROTTLE_DONE pgs=460 cs=0 l=1 rx=0x7f79e8002f30 tx=0x7f79e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:04:01.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.976+0000 7f79e77fe700 1 --2- 172.21.15.103:0/4256855211 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f79d404d800 0x7f79d404fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:04:01.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.976+0000 7f79e77fe700 1 -- 172.21.15.103:0/4256855211 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f79e8061b40 con 0x7f79f4063e30 2020-04-22T14:04:01.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.976+0000 7f79f9d80700 1 --2- 172.21.15.103:0/4256855211 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f79d404d800 0x7f79d404fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:04:01.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.977+0000 7f79f9d80700 1 --2- 172.21.15.103:0/4256855211 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f79d404d800 0x7f79d404fcc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f79f0000b80 tx=0x7f79f0001510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:04:01.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.977+0000 7f79f9d80700 1 --2- 172.21.15.103:0/4256855211 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f79d404d800 0x7f79d404fcc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f79f0000b80 tx=0x7f79f0001510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:04:01.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.977+0000 7f79f9d80700 1 --2- 172.21.15.103:0/4256855211 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f79d404d800 0x7f79d404fcc0 secure :-1 s=READY pgs=184 cs=0 l=1 rx=0x7f79f0000b80 tx=0x7f79f0001510).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:04:01.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.980+0000 7f79fa581700 1 --2- 172.21.15.103:0/4256855211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79f4063e30 0x7f79f4126c10 secure :-1 s=THROTTLE_DONE pgs=460 cs=0 l=1 rx=0x7f79e8002f30 tx=0x7f79e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:04:01.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:01.980+0000 7f79e77fe700 1 -- 172.21.15.103:0/4256855211 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f79e803cfe0 con 0x7f79f4063e30 2020-04-22T14:04:02.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:02.171+0000 7f79fc7e5700 1 -- 172.21.15.103:0/4256855211 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f79f4056c90 con 0x7f79f4063e30 2020-04-22T14:04:02.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:02.171+0000 7f79fa581700 1 --2- 172.21.15.103:0/4256855211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79f4063e30 0x7f79f4126c10 secure :-1 s=THROTTLE_DONE pgs=460 cs=0 l=1 rx=0x7f79e8002f30 tx=0x7f79e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:04:02.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:02.171+0000 7f79e77fe700 1 -- 172.21.15.103:0/4256855211 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2141 (secure 0 0 0) 0x7f79e8040600 con 0x7f79f4063e30 2020-04-22T14:04:02.174 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:04:02.174 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4956,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/2333777975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2333777975},{"type":"v1","addr":"172.21.15.86:6835","nonce":2333777975}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:03:38.935462+0000","modified":"2020-04-22T14:03:40.946647+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5050},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5050":{"gid":5050,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/3282872682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3282872682},{"type":"v1","addr":"172.21.15.103:6833","nonce":3282872682}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2020-04-22T14:04:02.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:02.173+0000 7f79fc7e5700 1 -- 172.21.15.103:0/4256855211 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f79d404d800 msgr2=0x7f79d404fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:04:02.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:02.173+0000 7f79fc7e5700 1 --2- 172.21.15.103:0/4256855211 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f79d404d800 0x7f79d404fcc0 secure :-1 s=READY pgs=184 cs=0 l=1 rx=0x7f79f0000b80 tx=0x7f79f0001510).stop 2020-04-22T14:04:02.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:02.173+0000 7f79fc7e5700 1 -- 172.21.15.103:0/4256855211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79f4063e30 msgr2=0x7f79f4126c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:04:02.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:02.173+0000 7f79fc7e5700 1 --2- 172.21.15.103:0/4256855211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79f4063e30 0x7f79f4126c10 secure :-1 s=READY pgs=460 cs=0 l=1 rx=0x7f79e8002f30 tx=0x7f79e8007a40).stop 2020-04-22T14:04:02.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:02.173+0000 7f79fc7e5700 1 -- 172.21.15.103:0/4256855211 shutdown_connections 2020-04-22T14:04:02.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:02.173+0000 7f79fc7e5700 1 --2- 172.21.15.103:0/4256855211 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f79d404d800 0x7f79d404fcc0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:04:02.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:02.173+0000 7f79fc7e5700 1 --2- 172.21.15.103:0/4256855211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79f4063e30 0x7f79f4126c10 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:04:02.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:02.173+0000 7f79fc7e5700 1 --2- 172.21.15.103:0/4256855211 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79f4065fe0 0x7f79f4128b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:04:02.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:02.173+0000 7f79fc7e5700 1 -- 172.21.15.103:0/4256855211 >> 172.21.15.103:0/4256855211 conn(0x7f79f40b9160 msgr2=0x7f79f4129e10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:04:02.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:02.173+0000 7f79fc7e5700 1 -- 172.21.15.103:0/4256855211 shutdown_connections 2020-04-22T14:04:02.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:04:02.173+0000 7f79fc7e5700 1 -- 172.21.15.103:0/4256855211 wait complete. 2020-04-22T14:04:02.177 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 14 2020-04-22T14:04:02.185 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:04:02.199 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok session ls 2020-04-22T14:04:02.359 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2020-04-22T14:04:02.359 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:04:02.359 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 5383, 2020-04-22T14:04:02.359 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": { 2020-04-22T14:04:02.360 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:04:02.360 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:04:02.360 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5383 2020-04-22T14:04:02.360 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:04:02.360 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:04:02.360 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "any", 2020-04-22T14:04:02.360 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:0", 2020-04-22T14:04:02.361 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 3293635762 2020-04-22T14:04:02.361 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:04:02.361 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:04:02.361 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "open", 2020-04-22T14:04:02.361 INFO:teuthology.orchestra.run.smithi103.stdout: "num_leases": 0, 2020-04-22T14:04:02.361 INFO:teuthology.orchestra.run.smithi103.stdout: "num_caps": 1, 2020-04-22T14:04:02.361 INFO:teuthology.orchestra.run.smithi103.stdout: "request_load_avg": 0, 2020-04-22T14:04:02.362 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 0.75098561100000005, 2020-04-22T14:04:02.362 INFO:teuthology.orchestra.run.smithi103.stdout: "requests_in_flight": 0, 2020-04-22T14:04:02.362 INFO:teuthology.orchestra.run.smithi103.stdout: "completed_requests": 0, 2020-04-22T14:04:02.362 INFO:teuthology.orchestra.run.smithi103.stdout: "reconnecting": false, 2020-04-22T14:04:02.362 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps": { 2020-04-22T14:04:02.362 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:04:02.362 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 60 2020-04-22T14:04:02.363 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:04:02.363 INFO:teuthology.orchestra.run.smithi103.stdout: "release_caps": { 2020-04-22T14:04:02.363 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:04:02.363 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 60 2020-04-22T14:04:02.363 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:04:02.363 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps_throttle": { 2020-04-22T14:04:02.363 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:04:02.364 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 2.5 2020-04-22T14:04:02.364 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:04:02.364 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps_throttle2o": { 2020-04-22T14:04:02.364 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:04:02.364 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 0.5 2020-04-22T14:04:02.364 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:04:02.364 INFO:teuthology.orchestra.run.smithi103.stdout: "session_cache_liveness": { 2020-04-22T14:04:02.367 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0.998273278643104, 2020-04-22T14:04:02.367 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 300 2020-04-22T14:04:02.367 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:04:02.367 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": "client.5383 172.21.15.103:0/3293635762", 2020-04-22T14:04:02.367 INFO:teuthology.orchestra.run.smithi103.stdout: "completed_requests": [], 2020-04-22T14:04:02.368 INFO:teuthology.orchestra.run.smithi103.stdout: "prealloc_inos": [], 2020-04-22T14:04:02.368 INFO:teuthology.orchestra.run.smithi103.stdout: "used_inos": [], 2020-04-22T14:04:02.368 INFO:teuthology.orchestra.run.smithi103.stdout: "client_metadata": { 2020-04-22T14:04:02.368 INFO:teuthology.orchestra.run.smithi103.stdout: "client_features": { 2020-04-22T14:04:02.370 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_bits": "0x0000000000003fff" 2020-04-22T14:04:02.370 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:04:02.370 INFO:teuthology.orchestra.run.smithi103.stdout: "metric_spec": { 2020-04-22T14:04:02.370 INFO:teuthology.orchestra.run.smithi103.stdout: "metric_flags": { 2020-04-22T14:04:02.370 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_bits": "0x" 2020-04-22T14:04:02.370 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:04:02.371 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:04:02.371 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:04:02.371 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:04:02.371 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "admin", 2020-04-22T14:04:02.371 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:04:02.371 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "48819", 2020-04-22T14:04:02.371 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:04:02.372 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:04:02.372 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:04:02.372 INFO:teuthology.orchestra.run.smithi103.stdout:] 2020-04-22T14:04:02.373 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "id": 5383, "entity": { "name": { "type": "client", "num": 5383 }, "addr": { "type": "any", "addr": "172.21.15.103:0", "nonce": 3293635762 } }, "state": "open", "num_leases": 0, "num_caps": 1, "request_load_avg": 0, "uptime": 0.75098561100000005, "requests_in_flight": 0, "completed_requests": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0.998273278643104, "halflife": 300 }, "inst": "client.5383 172.21.15.103:0/3293635762", "completed_requests": [], "prealloc_inos": [], "used_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x0000000000003fff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x" } }, "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", "entity_id": "admin", "hostname": "smithi103", "pid": "48819", "root": "/" } } ] 2020-04-22T14:04:19.315 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:04:19.334 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:04:19.377 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:04:19.397 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:04:49.491 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:04:49.507 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:04:49.550 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:04:49.568 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:05:19.671 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:05:19.688 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:05:19.730 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:19.747 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:05:32.374 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:32.397 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:05:32.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.549+0000 7f966bf11700 1 Processor -- start 2020-04-22T14:05:32.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.550+0000 7f966bf11700 1 -- start start 2020-04-22T14:05:32.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.550+0000 7f966bf11700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f966405b7c0 0x7f96640b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:32.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.550+0000 7f966bf11700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96641441f0 0x7f9664144820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:32.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.550+0000 7f966bf11700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9664144c80 0x7f9664147670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:32.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.550+0000 7f966bf11700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96640b5900 con 0x7f9664144c80 2020-04-22T14:05:32.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.550+0000 7f966bf11700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96640b5ba0 con 0x7f966405b7c0 2020-04-22T14:05:32.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.550+0000 7f966bf11700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96640b5e40 con 0x7f96641441f0 2020-04-22T14:05:32.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.551+0000 7f9669cad700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f966405b7c0 0x7f96640b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:32.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.551+0000 7f9669cad700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f966405b7c0 0x7f96640b50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49082/0 (socket says 172.21.15.103:49082) 2020-04-22T14:05:32.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.551+0000 7f9669cad700 1 -- 172.21.15.103:0/476302313 learned_addr learned my addr 172.21.15.103:0/476302313 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:05:32.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.551+0000 7f96694ac700 1 --2- 172.21.15.103:0/476302313 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96641441f0 0x7f9664144820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:32.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.551+0000 7f966a4ae700 1 --2- 172.21.15.103:0/476302313 >> v2:172.21.15.86:3300/0 conn(0x7f9664144c80 0x7f9664147670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:32.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.551+0000 7f9669cad700 1 -- 172.21.15.103:0/476302313 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96641441f0 msgr2=0x7f9664144820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:32.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.551+0000 7f9669cad700 1 --2- 172.21.15.103:0/476302313 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96641441f0 0x7f9664144820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:32.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.551+0000 7f9669cad700 1 -- 172.21.15.103:0/476302313 >> v2:172.21.15.86:3300/0 conn(0x7f9664144c80 msgr2=0x7f9664147670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:32.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.551+0000 7f9669cad700 1 --2- 172.21.15.103:0/476302313 >> v2:172.21.15.86:3300/0 conn(0x7f9664144c80 0x7f9664147670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:32.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.551+0000 7f9669cad700 1 -- 172.21.15.103:0/476302313 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f966405bba0 con 0x7f966405b7c0 2020-04-22T14:05:32.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.551+0000 7f9669cad700 1 --2- 172.21.15.103:0/476302313 >> v2:172.21.15.103:3300/0 conn(0x7f966405b7c0 0x7f96640b50d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9654002f30 tx=0x7f9654007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:32.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.551+0000 7f9669cad700 1 --2- 172.21.15.103:0/476302313 >> v2:172.21.15.103:3300/0 conn(0x7f966405b7c0 0x7f96640b50d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9654002f30 tx=0x7f9654007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:32.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.551+0000 7f9669cad700 1 --2- 172.21.15.103:0/476302313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f966405b7c0 0x7f96640b50d0 secure :-1 s=READY pgs=461 cs=0 l=1 rx=0x7f9654002f30 tx=0x7f9654007a40).ready entity=mon.1 client_cookie=5cd4c51db660ba7e server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:32.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.551+0000 7f9669cad700 1 --2- 172.21.15.103:0/476302313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f966405b7c0 0x7f96640b50d0 secure :-1 s=THROTTLE_DONE pgs=461 cs=0 l=1 rx=0x7f9654002f30 tx=0x7f9654007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:32.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.551+0000 7f9668cab700 1 -- 172.21.15.103:0/476302313 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9654008e10 con 0x7f966405b7c0 2020-04-22T14:05:32.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.551+0000 7f9669cad700 1 --2- 172.21.15.103:0/476302313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f966405b7c0 0x7f96640b50d0 secure :-1 s=THROTTLE_DONE pgs=461 cs=0 l=1 rx=0x7f9654002f30 tx=0x7f9654007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:32.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.551+0000 7f9669cad700 1 --2- 172.21.15.103:0/476302313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f966405b7c0 0x7f96640b50d0 secure :-1 s=THROTTLE_DONE pgs=461 cs=0 l=1 rx=0x7f9654002f30 tx=0x7f9654007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:32.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.551+0000 7f9668cab700 1 -- 172.21.15.103:0/476302313 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96540107c0 con 0x7f966405b7c0 2020-04-22T14:05:32.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.551+0000 7f9668cab700 1 -- 172.21.15.103:0/476302313 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9654010be0 con 0x7f966405b7c0 2020-04-22T14:05:32.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.551+0000 7f966bf11700 1 -- 172.21.15.103:0/476302313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f966405b7c0 msgr2=0x7f96640b50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:32.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.551+0000 7f966bf11700 1 --2- 172.21.15.103:0/476302313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f966405b7c0 0x7f96640b50d0 secure :-1 s=READY pgs=461 cs=0 l=1 rx=0x7f9654002f30 tx=0x7f9654007a40).stop 2020-04-22T14:05:32.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.552+0000 7f966bf11700 1 -- 172.21.15.103:0/476302313 shutdown_connections 2020-04-22T14:05:32.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.552+0000 7f966bf11700 1 --2- 172.21.15.103:0/476302313 >> v2:172.21.15.86:3300/0 conn(0x7f9664144c80 0x7f9664147670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:32.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.552+0000 7f966bf11700 1 --2- 172.21.15.103:0/476302313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f966405b7c0 0x7f96640b50d0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:32.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.552+0000 7f966bf11700 1 --2- 172.21.15.103:0/476302313 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96641441f0 0x7f9664144820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:32.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.552+0000 7f966bf11700 1 -- 172.21.15.103:0/476302313 >> 172.21.15.103:0/476302313 conn(0x7f96640b9160 msgr2=0x7f966405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:32.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.552+0000 7f966bf11700 1 -- 172.21.15.103:0/476302313 shutdown_connections 2020-04-22T14:05:32.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.552+0000 7f966bf11700 1 -- 172.21.15.103:0/476302313 wait complete. 2020-04-22T14:05:32.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.553+0000 7f966bf11700 1 Processor -- start 2020-04-22T14:05:32.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.553+0000 7f966bf11700 1 -- start start 2020-04-22T14:05:32.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.554+0000 7f966bf11700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f966405b7c0 0x7f9664147600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:32.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.554+0000 7f966bf11700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9664144c80 0x7f966413f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:32.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.554+0000 7f966bf11700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9664141080 con 0x7f96641441f0 2020-04-22T14:05:32.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.554+0000 7f966bf11700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9664141320 con 0x7f9664144c80 2020-04-22T14:05:32.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.554+0000 7f966bf11700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9664155900 con 0x7f966405b7c0 2020-04-22T14:05:32.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.554+0000 7f9669cad700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f966405b7c0 0x7f9664147600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:32.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.554+0000 7f9669cad700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f966405b7c0 0x7f9664147600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49088/0 (socket says 172.21.15.103:49088) 2020-04-22T14:05:32.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.554+0000 7f96694ac700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f96641441f0 0x7f96641551f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41280/0 (socket says 172.21.15.103:41280) 2020-04-22T14:05:32.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.554+0000 7f9669cad700 1 -- 172.21.15.103:0/2931199258 learned_addr learned my addr 172.21.15.103:0/2931199258 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:05:32.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.554+0000 7f966a4ae700 1 --2- 172.21.15.103:0/2931199258 >> v2:172.21.15.86:3300/0 conn(0x7f9664144c80 0x7f966413f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:32.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.554+0000 7f9669cad700 1 -- 172.21.15.103:0/2931199258 >> v2:172.21.15.86:3300/0 conn(0x7f9664144c80 msgr2=0x7f966413f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:32.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.554+0000 7f9669cad700 1 --2- 172.21.15.103:0/2931199258 >> v2:172.21.15.86:3300/0 conn(0x7f9664144c80 0x7f966413f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:32.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.554+0000 7f9669cad700 1 -- 172.21.15.103:0/2931199258 >> v1:172.21.15.103:6789/0 conn(0x7f96641441f0 legacy=0x7f96641551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:32.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.554+0000 7f9652ffd700 1 -- 172.21.15.103:0/2931199258 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1873711803 0 0) 0x7f9664141080 con 0x7f96641441f0 2020-04-22T14:05:32.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.554+0000 7f9669cad700 1 -- 172.21.15.103:0/2931199258 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9664155a40 con 0x7f966405b7c0 2020-04-22T14:05:32.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.554+0000 7f9669cad700 1 --2- 172.21.15.103:0/2931199258 >> v2:172.21.15.103:3300/0 conn(0x7f966405b7c0 0x7f9664147600 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9664151930 tx=0x7f9654007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:32.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.554+0000 7f9669cad700 1 --2- 172.21.15.103:0/2931199258 >> v2:172.21.15.103:3300/0 conn(0x7f966405b7c0 0x7f9664147600 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9664151930 tx=0x7f9654007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:32.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.554+0000 7f9669cad700 1 --2- 172.21.15.103:0/2931199258 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f966405b7c0 0x7f9664147600 secure :-1 s=READY pgs=463 cs=0 l=1 rx=0x7f9664151930 tx=0x7f9654007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:32.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.554+0000 7f9669cad700 1 --2- 172.21.15.103:0/2931199258 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f966405b7c0 0x7f9664147600 secure :-1 s=THROTTLE_DONE pgs=463 cs=0 l=1 rx=0x7f9664151930 tx=0x7f9654007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:32.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.554+0000 7f9652ffd700 1 -- 172.21.15.103:0/2931199258 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9654010c20 con 0x7f966405b7c0 2020-04-22T14:05:32.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.554+0000 7f9669cad700 1 --2- 172.21.15.103:0/2931199258 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f966405b7c0 0x7f9664147600 secure :-1 s=THROTTLE_DONE pgs=463 cs=0 l=1 rx=0x7f9664151930 tx=0x7f9654007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:32.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.554+0000 7f9669cad700 1 --2- 172.21.15.103:0/2931199258 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f966405b7c0 0x7f9664147600 secure :-1 s=THROTTLE_DONE pgs=463 cs=0 l=1 rx=0x7f9664151930 tx=0x7f9654007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:32.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.554+0000 7f9652ffd700 1 -- 172.21.15.103:0/2931199258 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9654007360 con 0x7f966405b7c0 2020-04-22T14:05:32.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.554+0000 7f9652ffd700 1 -- 172.21.15.103:0/2931199258 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96540056c0 con 0x7f966405b7c0 2020-04-22T14:05:32.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.554+0000 7f966bf11700 1 -- 172.21.15.103:0/2931199258 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f966413f510 con 0x7f966405b7c0 2020-04-22T14:05:32.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.554+0000 7f966bf11700 1 -- 172.21.15.103:0/2931199258 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f966413fa60 con 0x7f966405b7c0 2020-04-22T14:05:32.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.555+0000 7f9669cad700 1 --2- 172.21.15.103:0/2931199258 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f966405b7c0 0x7f9664147600 secure :-1 s=THROTTLE_DONE pgs=463 cs=0 l=1 rx=0x7f9664151930 tx=0x7f9654007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:32.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.555+0000 7f9652ffd700 1 -- 172.21.15.103:0/2931199258 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f9654005930 con 0x7f966405b7c0 2020-04-22T14:05:32.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.555+0000 7f9669cad700 1 --2- 172.21.15.103:0/2931199258 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f966405b7c0 0x7f9664147600 secure :-1 s=THROTTLE_DONE pgs=463 cs=0 l=1 rx=0x7f9664151930 tx=0x7f9654007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:32.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.555+0000 7f966bf11700 1 -- 172.21.15.103:0/2931199258 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9664056c90 con 0x7f966405b7c0 2020-04-22T14:05:32.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.556+0000 7f9652ffd700 1 --2- 172.21.15.103:0/2931199258 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f964404d8d0 0x7f964404fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:32.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.556+0000 7f9652ffd700 1 -- 172.21.15.103:0/2931199258 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f96540616b0 con 0x7f966405b7c0 2020-04-22T14:05:32.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.556+0000 7f96694ac700 1 --2- 172.21.15.103:0/2931199258 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f964404d8d0 0x7f964404fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:32.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.556+0000 7f96694ac700 1 --2- 172.21.15.103:0/2931199258 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f964404d8d0 0x7f964404fd90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f96600020b0 tx=0x7f9660002520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:32.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.556+0000 7f96694ac700 1 --2- 172.21.15.103:0/2931199258 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f964404d8d0 0x7f964404fd90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f96600020b0 tx=0x7f9660002520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:32.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.556+0000 7f96694ac700 1 --2- 172.21.15.103:0/2931199258 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f964404d8d0 0x7f964404fd90 secure :-1 s=READY pgs=185 cs=0 l=1 rx=0x7f96600020b0 tx=0x7f9660002520).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:32.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.560+0000 7f9669cad700 1 --2- 172.21.15.103:0/2931199258 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f966405b7c0 0x7f9664147600 secure :-1 s=THROTTLE_DONE pgs=463 cs=0 l=1 rx=0x7f9664151930 tx=0x7f9654007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:32.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.560+0000 7f9652ffd700 1 -- 172.21.15.103:0/2931199258 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f965403cbb0 con 0x7f966405b7c0 2020-04-22T14:05:32.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.751+0000 7f966bf11700 1 -- 172.21.15.103:0/2931199258 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96640b47a0 con 0x7f966405b7c0 2020-04-22T14:05:32.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.751+0000 7f9669cad700 1 --2- 172.21.15.103:0/2931199258 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f966405b7c0 0x7f9664147600 secure :-1 s=THROTTLE_DONE pgs=463 cs=0 l=1 rx=0x7f9664151930 tx=0x7f9654007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:32.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.751+0000 7f9652ffd700 1 -- 172.21.15.103:0/2931199258 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2141 (secure 0 0 0) 0x7f96540401d0 con 0x7f966405b7c0 2020-04-22T14:05:32.755 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:05:32.755 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4956,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/2333777975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2333777975},{"type":"v1","addr":"172.21.15.86:6835","nonce":2333777975}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:03:38.935462+0000","modified":"2020-04-22T14:03:40.946647+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5050},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5050":{"gid":5050,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/3282872682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3282872682},{"type":"v1","addr":"172.21.15.103:6833","nonce":3282872682}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2020-04-22T14:05:32.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.753+0000 7f966bf11700 1 -- 172.21.15.103:0/2931199258 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f964404d8d0 msgr2=0x7f964404fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:32.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.753+0000 7f966bf11700 1 --2- 172.21.15.103:0/2931199258 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f964404d8d0 0x7f964404fd90 secure :-1 s=READY pgs=185 cs=0 l=1 rx=0x7f96600020b0 tx=0x7f9660002520).stop 2020-04-22T14:05:32.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.753+0000 7f966bf11700 1 -- 172.21.15.103:0/2931199258 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f966405b7c0 msgr2=0x7f9664147600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:32.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.753+0000 7f966bf11700 1 --2- 172.21.15.103:0/2931199258 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f966405b7c0 0x7f9664147600 secure :-1 s=READY pgs=463 cs=0 l=1 rx=0x7f9664151930 tx=0x7f9654007a40).stop 2020-04-22T14:05:32.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.753+0000 7f966bf11700 1 -- 172.21.15.103:0/2931199258 shutdown_connections 2020-04-22T14:05:32.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.753+0000 7f966bf11700 1 --2- 172.21.15.103:0/2931199258 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f964404d8d0 0x7f964404fd90 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:32.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.753+0000 7f966bf11700 1 --2- 172.21.15.103:0/2931199258 >> v2:172.21.15.86:3300/0 conn(0x7f9664144c80 0x7f966413f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:32.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.753+0000 7f966bf11700 1 --2- 172.21.15.103:0/2931199258 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f966405b7c0 0x7f9664147600 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:32.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.753+0000 7f966bf11700 1 -- 172.21.15.103:0/2931199258 >> 172.21.15.103:0/2931199258 conn(0x7f96640b9160 msgr2=0x7f9664066b90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:32.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.753+0000 7f966bf11700 1 -- 172.21.15.103:0/2931199258 shutdown_connections 2020-04-22T14:05:32.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:32.753+0000 7f966bf11700 1 -- 172.21.15.103:0/2931199258 wait complete. 2020-04-22T14:05:32.758 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 14 2020-04-22T14:05:32.766 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:32.779 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok session ls 2020-04-22T14:05:32.936 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2020-04-22T14:05:32.936 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:32.937 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 5383, 2020-04-22T14:05:32.937 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": { 2020-04-22T14:05:32.937 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:05:32.937 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:05:32.937 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5383 2020-04-22T14:05:32.937 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:32.937 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:05:32.938 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "any", 2020-04-22T14:05:32.938 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:0", 2020-04-22T14:05:32.938 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 3293635762 2020-04-22T14:05:32.938 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:32.938 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:32.938 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "stale", 2020-04-22T14:05:32.938 INFO:teuthology.orchestra.run.smithi103.stdout: "num_leases": 0, 2020-04-22T14:05:32.939 INFO:teuthology.orchestra.run.smithi103.stdout: "num_caps": 1, 2020-04-22T14:05:32.939 INFO:teuthology.orchestra.run.smithi103.stdout: "request_load_avg": 0, 2020-04-22T14:05:32.939 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 91.327250020999998, 2020-04-22T14:05:32.939 INFO:teuthology.orchestra.run.smithi103.stdout: "requests_in_flight": 0, 2020-04-22T14:05:32.939 INFO:teuthology.orchestra.run.smithi103.stdout: "completed_requests": 0, 2020-04-22T14:05:32.939 INFO:teuthology.orchestra.run.smithi103.stdout: "reconnecting": false, 2020-04-22T14:05:32.939 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps": { 2020-04-22T14:05:32.940 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:05:32.940 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 60 2020-04-22T14:05:32.940 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:32.940 INFO:teuthology.orchestra.run.smithi103.stdout: "release_caps": { 2020-04-22T14:05:32.940 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:05:32.940 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 60 2020-04-22T14:05:32.940 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:32.941 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps_throttle": { 2020-04-22T14:05:32.941 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:05:32.941 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 2.5 2020-04-22T14:05:32.941 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:32.941 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps_throttle2o": { 2020-04-22T14:05:32.941 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:05:32.941 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 0.5 2020-04-22T14:05:32.941 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:32.942 INFO:teuthology.orchestra.run.smithi103.stdout: "session_cache_liveness": { 2020-04-22T14:05:32.942 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0.80977097231127204, 2020-04-22T14:05:32.942 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 300 2020-04-22T14:05:32.942 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:32.942 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": "client.5383 172.21.15.103:0/3293635762", 2020-04-22T14:05:32.942 INFO:teuthology.orchestra.run.smithi103.stdout: "completed_requests": [], 2020-04-22T14:05:32.942 INFO:teuthology.orchestra.run.smithi103.stdout: "prealloc_inos": [], 2020-04-22T14:05:32.943 INFO:teuthology.orchestra.run.smithi103.stdout: "used_inos": [], 2020-04-22T14:05:32.943 INFO:teuthology.orchestra.run.smithi103.stdout: "client_metadata": { 2020-04-22T14:05:32.943 INFO:teuthology.orchestra.run.smithi103.stdout: "client_features": { 2020-04-22T14:05:32.943 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_bits": "0x0000000000003fff" 2020-04-22T14:05:32.943 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:32.943 INFO:teuthology.orchestra.run.smithi103.stdout: "metric_spec": { 2020-04-22T14:05:32.943 INFO:teuthology.orchestra.run.smithi103.stdout: "metric_flags": { 2020-04-22T14:05:32.943 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_bits": "0x" 2020-04-22T14:05:32.944 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:32.944 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:32.944 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:05:32.944 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:05:32.944 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "admin", 2020-04-22T14:05:32.944 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:05:32.944 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "48819", 2020-04-22T14:05:32.945 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:05:32.945 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:32.945 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:32.945 INFO:teuthology.orchestra.run.smithi103.stdout:] 2020-04-22T14:05:32.946 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "id": 5383, "entity": { "name": { "type": "client", "num": 5383 }, "addr": { "type": "any", "addr": "172.21.15.103:0", "nonce": 3293635762 } }, "state": "stale", "num_leases": 0, "num_caps": 1, "request_load_avg": 0, "uptime": 91.327250020999998, "requests_in_flight": 0, "completed_requests": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0.80977097231127204, "halflife": 300 }, "inst": "client.5383 172.21.15.103:0/3293635762", "completed_requests": [], "prealloc_inos": [], "used_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x0000000000003fff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x" } }, "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", "entity_id": "admin", "hostname": "smithi103", "pid": "48819", "root": "/" } } ] 2020-04-22T14:05:32.946 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-04-22T14:05:32.947 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:05:32.962 INFO:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:05:33.055 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:33.069 INFO:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:05:33.154 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-04-22T14:05:33.154 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:05:33.154 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:33.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:05:33.167 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:05:33.226 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:05:33.227 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:05:33.227 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:05:33.227 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:05:33.227 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:05:33.227 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:05:33.227 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:05:33.228 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:05:33.228 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:05:33.228 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:05:33.228 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:05:33.228 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:05:33.228 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:05:33.228 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:05:33.229 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:05:33.229 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42507sec preferred_lft 42507sec 2020-04-22T14:05:33.229 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:05:33.229 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:05:33.229 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:33.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:05:33.282 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:05:33.350 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-04-22T14:05:33.350 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:33.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:05:33.395 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:05:33.453 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:05:33.454 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:05:33.454 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:05:33.454 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:05:33.454 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:05:33.455 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:05:33.455 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:05:33.455 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:05:33.455 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:05:33.455 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:05:33.455 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:05:33.455 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:05:33.456 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:05:33.456 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:05:33.456 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:05:33.456 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42507sec preferred_lft 42507sec 2020-04-22T14:05:33.456 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:05:33.457 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:05:33.457 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:33.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:05:33.502 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:05:33.561 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.2' netns for '/home/ubuntu/cephtest/mnt.2' 2020-04-22T14:05:33.561 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:05:33.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:05:33.577 INFO:teuthology.orchestra.run.smithi086:> ip addr 2020-04-22T14:05:33.635 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:05:33.636 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:05:33.636 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:05:33.636 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:05:33.636 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2020-04-22T14:05:33.636 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:05:33.636 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:05:33.636 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:05:33.637 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:05:33.637 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:05:33.637 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:05:33.637 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:05:33.637 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:05:33.637 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:05:33.637 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:05:33.638 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 42480sec preferred_lft 42480sec 2020-04-22T14:05:33.638 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2020-04-22T14:05:33.638 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:05:33.638 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:05:33.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:05:33.690 INFO:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.2) 2020-04-22T14:05:33.749 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.3' netns for '/home/ubuntu/cephtest/mnt.3' 2020-04-22T14:05:33.750 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:05:33.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:05:33.801 INFO:teuthology.orchestra.run.smithi086:> ip addr 2020-04-22T14:05:33.860 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:05:33.860 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:05:33.860 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:05:33.861 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:05:33.861 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2020-04-22T14:05:33.861 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:05:33.861 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:05:33.861 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:05:33.861 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:05:33.861 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:05:33.862 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:05:33.862 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:05:33.862 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:05:33.862 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:05:33.862 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:05:33.862 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 42480sec preferred_lft 42480sec 2020-04-22T14:05:33.862 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2020-04-22T14:05:33.862 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:05:33.863 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:05:33.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:05:33.912 INFO:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.3) 2020-04-22T14:05:33.971 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:33.985 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_abort_conn' 2020-04-22T14:05:34.133 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.127+0000 7f5220281700 1 Processor -- start 2020-04-22T14:05:34.133 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.127+0000 7f5220281700 1 -- start start 2020-04-22T14:05:34.134 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.128+0000 7f5220281700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f52180ae1a0 0x7f521814a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:34.134 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.128+0000 7f5220281700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f52180bd1b0 0x7f52180bd620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:34.134 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.128+0000 7f5220281700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f521814a710 con 0x7f5218140320 2020-04-22T14:05:34.134 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.128+0000 7f5220281700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52181462f0 con 0x7f52180ae1a0 2020-04-22T14:05:34.134 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.128+0000 7f5220281700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5218146590 con 0x7f52180bd1b0 2020-04-22T14:05:34.134 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.128+0000 7f521e81e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f52180bd1b0 0x7f52180bd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:34.134 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.128+0000 7f521e01d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f5218140320 0x7f5218146cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41286/0 (socket says 172.21.15.103:41286) 2020-04-22T14:05:34.135 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.128+0000 7f521e01d700 1 -- 172.21.15.103:0/3647966760 learned_addr learned my addr 172.21.15.103:0/3647966760 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:34.135 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.129+0000 7f521d81c700 1 --2- 172.21.15.103:0/3647966760 >> v2:172.21.15.86:3300/0 conn(0x7f52180ae1a0 0x7f521814a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:34.135 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.129+0000 7f521e81e700 1 -- 172.21.15.103:0/3647966760 >> v2:172.21.15.86:3300/0 conn(0x7f52180ae1a0 msgr2=0x7f521814a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:34.135 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.129+0000 7f521e81e700 1 --2- 172.21.15.103:0/3647966760 >> v2:172.21.15.86:3300/0 conn(0x7f52180ae1a0 0x7f521814a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:34.135 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.129+0000 7f521e81e700 1 -- 172.21.15.103:0/3647966760 >> v1:172.21.15.103:6789/0 conn(0x7f5218140320 legacy=0x7f5218146cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:34.135 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.129+0000 7f521d01b700 1 -- 172.21.15.103:0/3647966760 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1678621168 0 0) 0x7f521814a710 con 0x7f5218140320 2020-04-22T14:05:34.135 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.129+0000 7f521e81e700 1 -- 172.21.15.103:0/3647966760 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5218146830 con 0x7f52180bd1b0 2020-04-22T14:05:34.135 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.129+0000 7f521d81c700 1 --2- 172.21.15.103:0/3647966760 >> v2:172.21.15.86:3300/0 conn(0x7f52180ae1a0 0x7f521814a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:05:34.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.129+0000 7f521e81e700 1 --2- 172.21.15.103:0/3647966760 >> v2:172.21.15.103:3300/0 conn(0x7f52180bd1b0 0x7f52180bd620 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f52100032b0 tx=0x7f5210007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:34.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.129+0000 7f521e81e700 1 --2- 172.21.15.103:0/3647966760 >> v2:172.21.15.103:3300/0 conn(0x7f52180bd1b0 0x7f52180bd620 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f52100032b0 tx=0x7f5210007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:34.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.129+0000 7f521e81e700 1 --2- 172.21.15.103:0/3647966760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52180bd1b0 0x7f52180bd620 secure :-1 s=READY pgs=465 cs=0 l=1 rx=0x7f52100032b0 tx=0x7f5210007dc0).ready entity=mon.1 client_cookie=89238c30d505afbb server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:34.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.129+0000 7f521e81e700 1 --2- 172.21.15.103:0/3647966760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52180bd1b0 0x7f52180bd620 secure :-1 s=THROTTLE_DONE pgs=465 cs=0 l=1 rx=0x7f52100032b0 tx=0x7f5210007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:34.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.129+0000 7f521d01b700 1 -- 172.21.15.103:0/3647966760 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f521000a180 con 0x7f52180bd1b0 2020-04-22T14:05:34.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.129+0000 7f521e81e700 1 --2- 172.21.15.103:0/3647966760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52180bd1b0 0x7f52180bd620 secure :-1 s=THROTTLE_DONE pgs=465 cs=0 l=1 rx=0x7f52100032b0 tx=0x7f5210007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:34.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.129+0000 7f521d01b700 1 -- 172.21.15.103:0/3647966760 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521000a2e0 con 0x7f52180bd1b0 2020-04-22T14:05:34.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.129+0000 7f521e81e700 1 --2- 172.21.15.103:0/3647966760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52180bd1b0 0x7f52180bd620 secure :-1 s=THROTTLE_DONE pgs=465 cs=0 l=1 rx=0x7f52100032b0 tx=0x7f5210007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:34.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.129+0000 7f521d01b700 1 -- 172.21.15.103:0/3647966760 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f521000a6c0 con 0x7f52180bd1b0 2020-04-22T14:05:34.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.129+0000 7f5220281700 1 -- 172.21.15.103:0/3647966760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52180bd1b0 msgr2=0x7f52180bd620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:34.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.129+0000 7f5220281700 1 --2- 172.21.15.103:0/3647966760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52180bd1b0 0x7f52180bd620 secure :-1 s=READY pgs=465 cs=0 l=1 rx=0x7f52100032b0 tx=0x7f5210007dc0).stop 2020-04-22T14:05:34.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.129+0000 7f5220281700 1 -- 172.21.15.103:0/3647966760 shutdown_connections 2020-04-22T14:05:34.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.129+0000 7f5220281700 1 --2- 172.21.15.103:0/3647966760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52180bd1b0 0x7f52180bd620 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:34.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.129+0000 7f5220281700 1 --2- 172.21.15.103:0/3647966760 >> v2:172.21.15.86:3300/0 conn(0x7f52180ae1a0 0x7f521814a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:34.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.129+0000 7f5220281700 1 -- 172.21.15.103:0/3647966760 >> 172.21.15.103:0/3647966760 conn(0x7f521805f2c0 msgr2=0x7f52180bcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:34.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.129+0000 7f5220281700 1 -- 172.21.15.103:0/3647966760 shutdown_connections 2020-04-22T14:05:34.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.130+0000 7f5220281700 1 -- 172.21.15.103:0/3647966760 wait complete. 2020-04-22T14:05:34.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.130+0000 7f5220281700 1 Processor -- start 2020-04-22T14:05:34.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.130+0000 7f5220281700 1 -- start start 2020-04-22T14:05:34.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.131+0000 7f5220281700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f52180ae1a0 0x7f5218157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:34.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.131+0000 7f5220281700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5218140a00 con 0x7f52180bd1b0 2020-04-22T14:05:34.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.131+0000 7f5220281700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5218157cb0 con 0x7f5218140320 2020-04-22T14:05:34.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.131+0000 7f5220281700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f521813f3a0 con 0x7f52180ae1a0 2020-04-22T14:05:34.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.131+0000 7f521e81e700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f5218140320 0x7f521813ccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41296/0 (socket says 172.21.15.103:41296) 2020-04-22T14:05:34.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.131+0000 7f521e81e700 1 -- 172.21.15.103:0/3297162226 learned_addr learned my addr 172.21.15.103:0/3297162226 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:34.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.131+0000 7f521e01d700 1 --2- 172.21.15.103:0/3297162226 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f52180ae1a0 0x7f5218157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:34.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.131+0000 7f520b7fe700 1 -- 172.21.15.103:0/3297162226 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3396282331 0 0) 0x7f5218146830 con 0x7f5218140320 2020-04-22T14:05:34.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.131+0000 7f520b7fe700 1 -- 172.21.15.103:0/3297162226 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51f8002fe0 con 0x7f5218140320 2020-04-22T14:05:34.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.132+0000 7f520b7fe700 1 -- 172.21.15.103:0/3297162226 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1734952664 0 0) 0x7f5218140a00 con 0x7f52180bd1b0 2020-04-22T14:05:34.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.132+0000 7f520b7fe700 1 -- 172.21.15.103:0/3297162226 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5218146830 con 0x7f52180bd1b0 2020-04-22T14:05:34.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.132+0000 7f520b7fe700 1 -- 172.21.15.103:0/3297162226 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3155753311 0 0) 0x7f51f8002fe0 con 0x7f5218140320 2020-04-22T14:05:34.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.132+0000 7f520b7fe700 1 -- 172.21.15.103:0/3297162226 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5218140a00 con 0x7f5218140320 2020-04-22T14:05:34.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.132+0000 7f520b7fe700 1 -- 172.21.15.103:0/3297162226 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f5210008960 con 0x7f5218140320 2020-04-22T14:05:34.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.132+0000 7f520b7fe700 1 -- 172.21.15.103:0/3297162226 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f52180ae1a0 msgr2=0x7f5218157850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:34.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.132+0000 7f520b7fe700 1 --2- 172.21.15.103:0/3297162226 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f52180ae1a0 0x7f5218157850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:34.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.132+0000 7f520b7fe700 1 -- 172.21.15.103:0/3297162226 >> v1:172.21.15.103:6789/0 conn(0x7f5218140320 legacy=0x7f521813ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:34.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.132+0000 7f520b7fe700 1 -- 172.21.15.103:0/3297162226 >> v1:172.21.15.86:6789/0 conn(0x7f52180bd1b0 legacy=0x7f52180b0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:34.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.132+0000 7f520b7fe700 1 --2- 172.21.15.103:0/3297162226 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f52180ae1a0 0x7f51f8004b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:34.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.132+0000 7f520b7fe700 1 --2- 172.21.15.103:0/3297162226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51f8004f80 0x7f51f8003800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:34.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.132+0000 7f520b7fe700 1 --2- 172.21.15.103:0/3297162226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51f8003c60 0x7f51f80040e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:34.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.132+0000 7f520b7fe700 1 -- 172.21.15.103:0/3297162226 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f8004540 con 0x7f51f8003c60 2020-04-22T14:05:34.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.132+0000 7f520b7fe700 1 -- 172.21.15.103:0/3297162226 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f80046b0 con 0x7f51f8004f80 2020-04-22T14:05:34.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.132+0000 7f520b7fe700 1 -- 172.21.15.103:0/3297162226 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f800b750 con 0x7f52180ae1a0 2020-04-22T14:05:34.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.132+0000 7f521d81c700 1 --2- 172.21.15.103:0/3297162226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51f8004f80 0x7f51f8003800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:34.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.132+0000 7f521e01d700 1 --2- 172.21.15.103:0/3297162226 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f52180ae1a0 0x7f51f8004b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:34.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.132+0000 7f521e81e700 1 --2- 172.21.15.103:0/3297162226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51f8003c60 0x7f51f80040e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:34.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.132+0000 7f521d81c700 1 -- 172.21.15.103:0/3297162226 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f52180ae1a0 msgr2=0x7f51f8004b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:34.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.132+0000 7f521d81c700 1 --2- 172.21.15.103:0/3297162226 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f52180ae1a0 0x7f51f8004b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:34.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.132+0000 7f521d81c700 1 -- 172.21.15.103:0/3297162226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51f8003c60 msgr2=0x7f51f80040e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:34.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.132+0000 7f521d81c700 1 --2- 172.21.15.103:0/3297162226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51f8003c60 0x7f51f80040e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:34.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.132+0000 7f521d81c700 1 -- 172.21.15.103:0/3297162226 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5218140c30 con 0x7f51f8004f80 2020-04-22T14:05:34.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.132+0000 7f5220281700 1 -- 172.21.15.103:0/3297162226 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5218140ed0 con 0x7f51f8004f80 2020-04-22T14:05:34.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.132+0000 7f521d81c700 1 --2- 172.21.15.103:0/3297162226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51f8004f80 0x7f51f8003800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f51f8005650 tx=0x7f520c010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:34.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.132+0000 7f5220281700 1 -- 172.21.15.103:0/3297162226 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5218158180 con 0x7f51f8004f80 2020-04-22T14:05:34.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.132+0000 7f521d81c700 1 --2- 172.21.15.103:0/3297162226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51f8004f80 0x7f51f8003800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f51f8005650 tx=0x7f520c010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:34.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.132+0000 7f521d81c700 1 --2- 172.21.15.103:0/3297162226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51f8004f80 0x7f51f8003800 secure :-1 s=READY pgs=467 cs=0 l=1 rx=0x7f51f8005650 tx=0x7f520c010c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:34.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.132+0000 7f521d81c700 1 --2- 172.21.15.103:0/3297162226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51f8004f80 0x7f51f8003800 secure :-1 s=THROTTLE_DONE pgs=467 cs=0 l=1 rx=0x7f51f8005650 tx=0x7f520c010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:34.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.132+0000 7f520b7fe700 1 -- 172.21.15.103:0/3297162226 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f520c005aa0 con 0x7f51f8004f80 2020-04-22T14:05:34.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.132+0000 7f521d81c700 1 --2- 172.21.15.103:0/3297162226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51f8004f80 0x7f51f8003800 secure :-1 s=THROTTLE_DONE pgs=467 cs=0 l=1 rx=0x7f51f8005650 tx=0x7f520c010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:34.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.132+0000 7f521d81c700 1 --2- 172.21.15.103:0/3297162226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51f8004f80 0x7f51f8003800 secure :-1 s=THROTTLE_DONE pgs=467 cs=0 l=1 rx=0x7f51f8005650 tx=0x7f520c010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:34.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.132+0000 7f520b7fe700 1 -- 172.21.15.103:0/3297162226 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f520c005c40 con 0x7f51f8004f80 2020-04-22T14:05:34.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.132+0000 7f520b7fe700 1 -- 172.21.15.103:0/3297162226 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f520c005e30 con 0x7f51f8004f80 2020-04-22T14:05:34.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.133+0000 7f521d81c700 1 --2- 172.21.15.103:0/3297162226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51f8004f80 0x7f51f8003800 secure :-1 s=THROTTLE_DONE pgs=467 cs=0 l=1 rx=0x7f51f8005650 tx=0x7f520c010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:34.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.133+0000 7f520b7fe700 1 -- 172.21.15.103:0/3297162226 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f520c012770 con 0x7f51f8004f80 2020-04-22T14:05:34.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.133+0000 7f521d81c700 1 --2- 172.21.15.103:0/3297162226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51f8004f80 0x7f51f8003800 secure :-1 s=THROTTLE_DONE pgs=467 cs=0 l=1 rx=0x7f51f8005650 tx=0x7f520c010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:34.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.133+0000 7f5220281700 1 -- 172.21.15.103:0/3297162226 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5218056c90 con 0x7f51f8004f80 2020-04-22T14:05:34.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.134+0000 7f520b7fe700 1 --2- 172.21.15.103:0/3297162226 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f51f8055ef0 0x7f51f80583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:34.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.134+0000 7f520b7fe700 1 -- 172.21.15.103:0/3297162226 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f520c013070 con 0x7f51f8004f80 2020-04-22T14:05:34.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.134+0000 7f521e01d700 1 --2- 172.21.15.103:0/3297162226 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f51f8055ef0 0x7f51f80583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:34.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.134+0000 7f521e01d700 1 --2- 172.21.15.103:0/3297162226 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f51f8055ef0 0x7f51f80583b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5214000b80 tx=0x7f521400ca90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:34.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.134+0000 7f521e01d700 1 --2- 172.21.15.103:0/3297162226 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f51f8055ef0 0x7f51f80583b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5214000b80 tx=0x7f521400ca90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:34.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.134+0000 7f521e01d700 1 --2- 172.21.15.103:0/3297162226 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f51f8055ef0 0x7f51f80583b0 secure :-1 s=READY pgs=186 cs=0 l=1 rx=0x7f5214000b80 tx=0x7f521400ca90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:34.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.138+0000 7f521d81c700 1 --2- 172.21.15.103:0/3297162226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51f8004f80 0x7f51f8003800 secure :-1 s=THROTTLE_DONE pgs=467 cs=0 l=1 rx=0x7f51f8005650 tx=0x7f520c010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:34.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.138+0000 7f520b7fe700 1 -- 172.21.15.103:0/3297162226 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f520c03c660 con 0x7f51f8004f80 2020-04-22T14:05:34.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.330+0000 7f5220281700 1 -- 172.21.15.103:0/3297162226 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_abort_conn"]} v 0) v1 -- 0x7f52180b91d0 con 0x7f51f8004f80 2020-04-22T14:05:34.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.493+0000 7f521d81c700 1 --2- 172.21.15.103:0/3297162226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51f8004f80 0x7f51f8003800 secure :-1 s=THROTTLE_DONE pgs=467 cs=0 l=1 rx=0x7f51f8005650 tx=0x7f520c010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:34.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.493+0000 7f520b7fe700 1 -- 172.21.15.103:0/3297162226 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_abort_conn"]}]=0 v143) v1 ==== 147+0+0 (secure 0 0 0) 0x7f520c03fc80 con 0x7f51f8004f80 2020-04-22T14:05:34.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.495+0000 7f5220281700 1 -- 172.21.15.103:0/3297162226 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f51f8055ef0 msgr2=0x7f51f80583b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:34.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.495+0000 7f5220281700 1 --2- 172.21.15.103:0/3297162226 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f51f8055ef0 0x7f51f80583b0 secure :-1 s=READY pgs=186 cs=0 l=1 rx=0x7f5214000b80 tx=0x7f521400ca90).stop 2020-04-22T14:05:34.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.495+0000 7f5220281700 1 -- 172.21.15.103:0/3297162226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51f8004f80 msgr2=0x7f51f8003800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:34.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.495+0000 7f5220281700 1 --2- 172.21.15.103:0/3297162226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51f8004f80 0x7f51f8003800 secure :-1 s=READY pgs=467 cs=0 l=1 rx=0x7f51f8005650 tx=0x7f520c010c40).stop 2020-04-22T14:05:34.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.495+0000 7f521e81e700 1 -- 172.21.15.103:0/3297162226 reap_dead start 2020-04-22T14:05:34.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.495+0000 7f521e81e700 1 -- 172.21.15.103:0/3297162226 reap_dead start 2020-04-22T14:05:34.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.495+0000 7f5220281700 1 -- 172.21.15.103:0/3297162226 shutdown_connections 2020-04-22T14:05:34.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.495+0000 7f5220281700 1 -- 172.21.15.103:0/3297162226 >> 172.21.15.103:0/3297162226 conn(0x7f521805f2c0 msgr2=0x7f521805ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:34.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.495+0000 7f5220281700 1 -- 172.21.15.103:0/3297162226 shutdown_connections 2020-04-22T14:05:34.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.495+0000 7f5220281700 1 -- 172.21.15.103:0/3297162226 wait complete. 2020-04-22T14:05:34.519 INFO:tasks.cephfs_test_runner:test_abort_conn (tasks.cephfs.test_client_recovery.TestClientRecovery) ... ok 2020-04-22T14:05:34.519 INFO:tasks.cephfs_test_runner:Starting test: test_basic (tasks.cephfs.test_client_recovery.TestClientRecovery) 2020-04-22T14:05:34.519 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:34.533 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_basic' 2020-04-22T14:05:34.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.675+0000 7fb857fb4700 1 Processor -- start 2020-04-22T14:05:34.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.675+0000 7fb857fb4700 1 -- start start 2020-04-22T14:05:34.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.676+0000 7fb857fb4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb85012c0d0 0x7fb8501464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:34.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.676+0000 7fb857fb4700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb850063e30 0x7fb8500642a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:34.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.676+0000 7fb857fb4700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb850143300 con 0x7fb850065fe0 2020-04-22T14:05:34.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.676+0000 7fb857fb4700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8501435a0 con 0x7fb850063e30 2020-04-22T14:05:34.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.676+0000 7fb857fb4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb850143840 con 0x7fb85012c0d0 2020-04-22T14:05:34.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.676+0000 7fb856551700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb850063e30 0x7fb8500642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:34.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.676+0000 7fb856551700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb850063e30 0x7fb8500642a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49116/0 (socket says 172.21.15.103:49116) 2020-04-22T14:05:34.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.676+0000 7fb856551700 1 -- 172.21.15.103:0/4283901517 learned_addr learned my addr 172.21.15.103:0/4283901517 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:05:34.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.677+0000 7fb855d50700 1 --2- 172.21.15.103:0/4283901517 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb85012c0d0 0x7fb8501464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:34.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.677+0000 7fb856551700 1 -- 172.21.15.103:0/4283901517 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb85012c0d0 msgr2=0x7fb8501464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:34.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.677+0000 7fb856551700 1 --2- 172.21.15.103:0/4283901517 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb85012c0d0 0x7fb8501464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:34.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.677+0000 7fb856551700 1 -- 172.21.15.103:0/4283901517 >> v1:172.21.15.86:6789/0 conn(0x7fb850065fe0 legacy=0x7fb85005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:34.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.677+0000 7fb856551700 1 -- 172.21.15.103:0/4283901517 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85005bb50 con 0x7fb850063e30 2020-04-22T14:05:34.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.677+0000 7fb856551700 1 --2- 172.21.15.103:0/4283901517 >> v2:172.21.15.103:3300/0 conn(0x7fb850063e30 0x7fb8500642a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb8500669a0 tx=0x7fb848007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:34.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.677+0000 7fb856551700 1 --2- 172.21.15.103:0/4283901517 >> v2:172.21.15.103:3300/0 conn(0x7fb850063e30 0x7fb8500642a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb8500669a0 tx=0x7fb848007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:34.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.677+0000 7fb856551700 1 --2- 172.21.15.103:0/4283901517 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb850063e30 0x7fb8500642a0 secure :-1 s=READY pgs=468 cs=0 l=1 rx=0x7fb8500669a0 tx=0x7fb848007dc0).ready entity=mon.1 client_cookie=8cf21c7da292d0e5 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:34.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.677+0000 7fb856551700 1 --2- 172.21.15.103:0/4283901517 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb850063e30 0x7fb8500642a0 secure :-1 s=THROTTLE_DONE pgs=468 cs=0 l=1 rx=0x7fb8500669a0 tx=0x7fb848007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:34.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.677+0000 7fb854d4e700 1 -- 172.21.15.103:0/4283901517 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb84800a180 con 0x7fb850063e30 2020-04-22T14:05:34.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.677+0000 7fb856551700 1 --2- 172.21.15.103:0/4283901517 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb850063e30 0x7fb8500642a0 secure :-1 s=THROTTLE_DONE pgs=468 cs=0 l=1 rx=0x7fb8500669a0 tx=0x7fb848007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:34.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.677+0000 7fb856551700 1 --2- 172.21.15.103:0/4283901517 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb850063e30 0x7fb8500642a0 secure :-1 s=THROTTLE_DONE pgs=468 cs=0 l=1 rx=0x7fb8500669a0 tx=0x7fb848007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:34.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.677+0000 7fb854d4e700 1 -- 172.21.15.103:0/4283901517 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84800a2e0 con 0x7fb850063e30 2020-04-22T14:05:34.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.677+0000 7fb854d4e700 1 -- 172.21.15.103:0/4283901517 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb84800a700 con 0x7fb850063e30 2020-04-22T14:05:34.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.677+0000 7fb857fb4700 1 -- 172.21.15.103:0/4283901517 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb850063e30 msgr2=0x7fb8500642a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:34.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.677+0000 7fb857fb4700 1 --2- 172.21.15.103:0/4283901517 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb850063e30 0x7fb8500642a0 secure :-1 s=READY pgs=468 cs=0 l=1 rx=0x7fb8500669a0 tx=0x7fb848007dc0).stop 2020-04-22T14:05:34.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.677+0000 7fb857fb4700 1 -- 172.21.15.103:0/4283901517 shutdown_connections 2020-04-22T14:05:34.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.677+0000 7fb857fb4700 1 --2- 172.21.15.103:0/4283901517 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb850063e30 0x7fb8500642a0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:34.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.677+0000 7fb857fb4700 1 --2- 172.21.15.103:0/4283901517 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb85012c0d0 0x7fb8501464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:34.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.677+0000 7fb857fb4700 1 -- 172.21.15.103:0/4283901517 >> 172.21.15.103:0/4283901517 conn(0x7fb8500b9160 msgr2=0x7fb85005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:34.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.678+0000 7fb857fb4700 1 -- 172.21.15.103:0/4283901517 shutdown_connections 2020-04-22T14:05:34.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.678+0000 7fb857fb4700 1 -- 172.21.15.103:0/4283901517 wait complete. 2020-04-22T14:05:34.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.678+0000 7fb857fb4700 1 Processor -- start 2020-04-22T14:05:34.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.678+0000 7fb857fb4700 1 -- start start 2020-04-22T14:05:34.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.679+0000 7fb857fb4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb850063e30 0x7fb8500b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:34.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.679+0000 7fb857fb4700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb850065fe0 0x7fb8500afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:34.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.679+0000 7fb857fb4700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb85012c0d0 0x7fb8500ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:34.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.679+0000 7fb857fb4700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8500b19b0 con 0x7fb850065fe0 2020-04-22T14:05:34.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.679+0000 7fb857fb4700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8500b0630 con 0x7fb85012c0d0 2020-04-22T14:05:34.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.679+0000 7fb857fb4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8500ad570 con 0x7fb850063e30 2020-04-22T14:05:34.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.679+0000 7fb856551700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb85012c0d0 0x7fb8500ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:34.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.679+0000 7fb856551700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb85012c0d0 0x7fb8500ad110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49126/0 (socket says 172.21.15.103:49126) 2020-04-22T14:05:34.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.679+0000 7fb856551700 1 -- 172.21.15.103:0/3587364530 learned_addr learned my addr 172.21.15.103:0/3587364530 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:05:34.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.679+0000 7fb855d50700 1 --2- 172.21.15.103:0/3587364530 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb850063e30 0x7fb8500b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:34.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.679+0000 7fb85554f700 1 --2- 172.21.15.103:0/3587364530 >> v2:172.21.15.86:3300/0 conn(0x7fb850065fe0 0x7fb8500afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:34.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.680+0000 7fb856551700 1 -- 172.21.15.103:0/3587364530 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb850063e30 msgr2=0x7fb8500b3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:34.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.680+0000 7fb856551700 1 --2- 172.21.15.103:0/3587364530 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb850063e30 0x7fb8500b3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:34.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.680+0000 7fb856551700 1 -- 172.21.15.103:0/3587364530 >> v2:172.21.15.86:3300/0 conn(0x7fb850065fe0 msgr2=0x7fb8500afcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:34.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.680+0000 7fb856551700 1 --2- 172.21.15.103:0/3587364530 >> v2:172.21.15.86:3300/0 conn(0x7fb850065fe0 0x7fb8500afcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:34.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.680+0000 7fb856551700 1 -- 172.21.15.103:0/3587364530 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8500b1ba0 con 0x7fb85012c0d0 2020-04-22T14:05:34.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.680+0000 7fb856551700 1 --2- 172.21.15.103:0/3587364530 >> v2:172.21.15.103:3300/0 conn(0x7fb85012c0d0 0x7fb8500ad110 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb8500669a0 tx=0x7fb848007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:34.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.680+0000 7fb856551700 1 --2- 172.21.15.103:0/3587364530 >> v2:172.21.15.103:3300/0 conn(0x7fb85012c0d0 0x7fb8500ad110 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb8500669a0 tx=0x7fb848007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:34.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.680+0000 7fb856551700 1 --2- 172.21.15.103:0/3587364530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb85012c0d0 0x7fb8500ad110 secure :-1 s=READY pgs=469 cs=0 l=1 rx=0x7fb8500669a0 tx=0x7fb848007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:34.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.680+0000 7fb856551700 1 --2- 172.21.15.103:0/3587364530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb85012c0d0 0x7fb8500ad110 secure :-1 s=THROTTLE_DONE pgs=469 cs=0 l=1 rx=0x7fb8500669a0 tx=0x7fb848007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:34.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.680+0000 7fb856551700 1 --2- 172.21.15.103:0/3587364530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb85012c0d0 0x7fb8500ad110 secure :-1 s=THROTTLE_DONE pgs=469 cs=0 l=1 rx=0x7fb8500669a0 tx=0x7fb848007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:34.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.680+0000 7fb83effd700 1 -- 172.21.15.103:0/3587364530 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8480115c0 con 0x7fb85012c0d0 2020-04-22T14:05:34.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.680+0000 7fb856551700 1 --2- 172.21.15.103:0/3587364530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb85012c0d0 0x7fb8500ad110 secure :-1 s=THROTTLE_DONE pgs=469 cs=0 l=1 rx=0x7fb8500669a0 tx=0x7fb848007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:34.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.680+0000 7fb83effd700 1 -- 172.21.15.103:0/3587364530 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb848005a40 con 0x7fb85012c0d0 2020-04-22T14:05:34.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.680+0000 7fb83effd700 1 -- 172.21.15.103:0/3587364530 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb848005e60 con 0x7fb85012c0d0 2020-04-22T14:05:34.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.680+0000 7fb857fb4700 1 -- 172.21.15.103:0/3587364530 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8500b1e40 con 0x7fb85012c0d0 2020-04-22T14:05:34.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.680+0000 7fb857fb4700 1 -- 172.21.15.103:0/3587364530 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8500627e0 con 0x7fb85012c0d0 2020-04-22T14:05:34.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.680+0000 7fb856551700 1 --2- 172.21.15.103:0/3587364530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb85012c0d0 0x7fb8500ad110 secure :-1 s=THROTTLE_DONE pgs=469 cs=0 l=1 rx=0x7fb8500669a0 tx=0x7fb848007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:34.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.681+0000 7fb83effd700 1 -- 172.21.15.103:0/3587364530 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fb848010700 con 0x7fb85012c0d0 2020-04-22T14:05:34.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.681+0000 7fb856551700 1 --2- 172.21.15.103:0/3587364530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb85012c0d0 0x7fb8500ad110 secure :-1 s=THROTTLE_DONE pgs=469 cs=0 l=1 rx=0x7fb8500669a0 tx=0x7fb848007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:34.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.681+0000 7fb857fb4700 1 -- 172.21.15.103:0/3587364530 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb850056c90 con 0x7fb85012c0d0 2020-04-22T14:05:34.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.681+0000 7fb83effd700 1 --2- 172.21.15.103:0/3587364530 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb83004da20 0x7fb83004fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:34.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.681+0000 7fb83effd700 1 -- 172.21.15.103:0/3587364530 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb848061da0 con 0x7fb85012c0d0 2020-04-22T14:05:34.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.681+0000 7fb855d50700 1 --2- 172.21.15.103:0/3587364530 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb83004da20 0x7fb83004fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:34.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.682+0000 7fb855d50700 1 --2- 172.21.15.103:0/3587364530 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb83004da20 0x7fb83004fee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb840002f30 tx=0x7fb84000d710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:34.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.682+0000 7fb855d50700 1 --2- 172.21.15.103:0/3587364530 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb83004da20 0x7fb83004fee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb840002f30 tx=0x7fb84000d710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:34.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.682+0000 7fb855d50700 1 --2- 172.21.15.103:0/3587364530 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb83004da20 0x7fb83004fee0 secure :-1 s=READY pgs=187 cs=0 l=1 rx=0x7fb840002f30 tx=0x7fb84000d710).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:34.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.685+0000 7fb856551700 1 --2- 172.21.15.103:0/3587364530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb85012c0d0 0x7fb8500ad110 secure :-1 s=THROTTLE_DONE pgs=469 cs=0 l=1 rx=0x7fb8500669a0 tx=0x7fb848007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:34.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.685+0000 7fb83effd700 1 -- 172.21.15.103:0/3587364530 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fb84803d240 con 0x7fb85012c0d0 2020-04-22T14:05:34.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:34.877+0000 7fb857fb4700 1 -- 172.21.15.103:0/3587364530 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_basic"]} v 0) v1 -- 0x7fb85006a790 con 0x7fb85012c0d0 2020-04-22T14:05:35.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.496+0000 7fb856551700 1 --2- 172.21.15.103:0/3587364530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb85012c0d0 0x7fb8500ad110 secure :-1 s=THROTTLE_DONE pgs=469 cs=0 l=1 rx=0x7fb8500669a0 tx=0x7fb848007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:35.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.496+0000 7fb83effd700 1 -- 172.21.15.103:0/3587364530 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_basic"]}]=0 v144) v1 ==== 145+0+0 (secure 0 0 0) 0x7fb848040860 con 0x7fb85012c0d0 2020-04-22T14:05:35.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.498+0000 7fb857fb4700 1 -- 172.21.15.103:0/3587364530 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb83004da20 msgr2=0x7fb83004fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:35.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.498+0000 7fb857fb4700 1 --2- 172.21.15.103:0/3587364530 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb83004da20 0x7fb83004fee0 secure :-1 s=READY pgs=187 cs=0 l=1 rx=0x7fb840002f30 tx=0x7fb84000d710).stop 2020-04-22T14:05:35.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.498+0000 7fb857fb4700 1 -- 172.21.15.103:0/3587364530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb85012c0d0 msgr2=0x7fb8500ad110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:35.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.498+0000 7fb857fb4700 1 --2- 172.21.15.103:0/3587364530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb85012c0d0 0x7fb8500ad110 secure :-1 s=READY pgs=469 cs=0 l=1 rx=0x7fb8500669a0 tx=0x7fb848007dc0).stop 2020-04-22T14:05:35.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.498+0000 7fb857fb4700 1 -- 172.21.15.103:0/3587364530 shutdown_connections 2020-04-22T14:05:35.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.498+0000 7fb857fb4700 1 --2- 172.21.15.103:0/3587364530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb85012c0d0 0x7fb8500ad110 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:35.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.498+0000 7fb857fb4700 1 --2- 172.21.15.103:0/3587364530 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb850063e30 0x7fb8500b3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:35.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.498+0000 7fb857fb4700 1 --2- 172.21.15.103:0/3587364530 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb83004da20 0x7fb83004fee0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:35.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.498+0000 7fb857fb4700 1 --2- 172.21.15.103:0/3587364530 >> v2:172.21.15.86:3300/0 conn(0x7fb850065fe0 0x7fb8500afcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:35.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.498+0000 7fb857fb4700 1 -- 172.21.15.103:0/3587364530 >> 172.21.15.103:0/3587364530 conn(0x7fb8500b9160 msgr2=0x7fb8500b7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:35.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.498+0000 7fb857fb4700 1 -- 172.21.15.103:0/3587364530 shutdown_connections 2020-04-22T14:05:35.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.498+0000 7fb857fb4700 1 -- 172.21.15.103:0/3587364530 wait complete. 2020-04-22T14:05:35.513 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-04-22T14:05:35.513 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:05:35.528 INFO:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:05:35.618 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:35.634 INFO:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:05:35.723 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-04-22T14:05:35.723 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:35.737 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2020-04-22T14:05:35.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.905+0000 7f173bb16700 1 Processor -- start 2020-04-22T14:05:35.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.905+0000 7f173bb16700 1 -- start start 2020-04-22T14:05:35.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.906+0000 7f173bb16700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f173405b7c0 0x7f17340b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:35.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.906+0000 7f173bb16700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f17340ad850 0x7f17340adc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:35.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.906+0000 7f173bb16700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17340b5900 con 0x7f17341441f0 2020-04-22T14:05:35.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.906+0000 7f173bb16700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17340b5ba0 con 0x7f17340ad850 2020-04-22T14:05:35.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.906+0000 7f173bb16700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17340b5e40 con 0x7f173405b7c0 2020-04-22T14:05:35.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.906+0000 7f17390b1700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f17341441f0 0x7f1734144820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41320/0 (socket says 172.21.15.103:41320) 2020-04-22T14:05:35.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.906+0000 7f17390b1700 1 -- 172.21.15.103:0/1174879353 learned_addr learned my addr 172.21.15.103:0/1174879353 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:35.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.907+0000 7f17398b2700 1 --2- 172.21.15.103:0/1174879353 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f173405b7c0 0x7f17340b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:35.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.907+0000 7f173a0b3700 1 --2- 172.21.15.103:0/1174879353 >> v2:172.21.15.86:3300/0 conn(0x7f17340ad850 0x7f17340adc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:35.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.907+0000 7f17388b0700 1 -- 172.21.15.103:0/1174879353 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1253316218 0 0) 0x7f17340b5900 con 0x7f17341441f0 2020-04-22T14:05:35.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.907+0000 7f17388b0700 1 -- 172.21.15.103:0/1174879353 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f171c003230 con 0x7f17341441f0 2020-04-22T14:05:35.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.907+0000 7f17388b0700 1 -- 172.21.15.103:0/1174879353 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3625109212 0 0) 0x7f171c003230 con 0x7f17341441f0 2020-04-22T14:05:35.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.907+0000 7f17388b0700 1 -- 172.21.15.103:0/1174879353 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f173405b7c0 msgr2=0x7f17340b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:35.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.907+0000 7f17388b0700 1 --2- 172.21.15.103:0/1174879353 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f173405b7c0 0x7f17340b50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:35.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.907+0000 7f17388b0700 1 -- 172.21.15.103:0/1174879353 >> v2:172.21.15.86:3300/0 conn(0x7f17340ad850 msgr2=0x7f17340adc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:35.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.907+0000 7f17388b0700 1 --2- 172.21.15.103:0/1174879353 >> v2:172.21.15.86:3300/0 conn(0x7f17340ad850 0x7f17340adc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:35.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.907+0000 7f17388b0700 1 -- 172.21.15.103:0/1174879353 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f173405bba0 con 0x7f17341441f0 2020-04-22T14:05:35.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.907+0000 7f17388b0700 1 -- 172.21.15.103:0/1174879353 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f17300016d0 con 0x7f17341441f0 2020-04-22T14:05:35.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.907+0000 7f17388b0700 1 -- 172.21.15.103:0/1174879353 >> v1:172.21.15.103:6789/0 conn(0x7f17341441f0 legacy=0x7f1734144820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:35.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.907+0000 7f17388b0700 1 --2- 172.21.15.103:0/1174879353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f171c003720 0x7f171c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:35.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.907+0000 7f17388b0700 1 --2- 172.21.15.103:0/1174879353 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f171c004060 0x7f171c004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:35.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.907+0000 7f17388b0700 1 --2- 172.21.15.103:0/1174879353 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f173405b7c0 0x7f171c004ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:35.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.907+0000 7f17388b0700 1 -- 172.21.15.103:0/1174879353 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17340b5ba0 con 0x7f171c004060 2020-04-22T14:05:35.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.907+0000 7f17388b0700 1 -- 172.21.15.103:0/1174879353 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17340b5e40 con 0x7f171c003720 2020-04-22T14:05:35.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.907+0000 7f17388b0700 1 -- 172.21.15.103:0/1174879353 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f171c004ff0 con 0x7f173405b7c0 2020-04-22T14:05:35.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.907+0000 7f17398b2700 1 --2- 172.21.15.103:0/1174879353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f171c003720 0x7f171c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:35.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.907+0000 7f17390b1700 1 --2- 172.21.15.103:0/1174879353 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f171c004060 0x7f171c004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:35.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.907+0000 7f173a0b3700 1 --2- 172.21.15.103:0/1174879353 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f173405b7c0 0x7f171c004ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:35.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.907+0000 7f17398b2700 1 -- 172.21.15.103:0/1174879353 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f173405b7c0 msgr2=0x7f171c004ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:35.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.907+0000 7f17398b2700 1 --2- 172.21.15.103:0/1174879353 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f173405b7c0 0x7f171c004ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:35.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.907+0000 7f17398b2700 1 -- 172.21.15.103:0/1174879353 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f171c004060 msgr2=0x7f171c004530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:35.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.907+0000 7f17398b2700 1 --2- 172.21.15.103:0/1174879353 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f171c004060 0x7f171c004530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:35.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.907+0000 7f17398b2700 1 -- 172.21.15.103:0/1174879353 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f171c003230 con 0x7f171c003720 2020-04-22T14:05:35.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.907+0000 7f17398b2700 1 --2- 172.21.15.103:0/1174879353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f171c003720 0x7f171c003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1724002f30 tx=0x7f1724010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:35.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.907+0000 7f17398b2700 1 --2- 172.21.15.103:0/1174879353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f171c003720 0x7f171c003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1724002f30 tx=0x7f1724010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:35.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.907+0000 7f17398b2700 1 --2- 172.21.15.103:0/1174879353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f171c003720 0x7f171c003b40 secure :-1 s=READY pgs=471 cs=0 l=1 rx=0x7f1724002f30 tx=0x7f1724010020).ready entity=mon.1 client_cookie=91f326c11d20580a server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:35.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.908+0000 7f17398b2700 1 --2- 172.21.15.103:0/1174879353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f171c003720 0x7f171c003b40 secure :-1 s=THROTTLE_DONE pgs=471 cs=0 l=1 rx=0x7f1724002f30 tx=0x7f1724010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:35.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.908+0000 7f17388b0700 1 -- 172.21.15.103:0/1174879353 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1724008d30 con 0x7f171c003720 2020-04-22T14:05:35.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.908+0000 7f17398b2700 1 --2- 172.21.15.103:0/1174879353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f171c003720 0x7f171c003b40 secure :-1 s=THROTTLE_DONE pgs=471 cs=0 l=1 rx=0x7f1724002f30 tx=0x7f1724010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:35.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.908+0000 7f17398b2700 1 --2- 172.21.15.103:0/1174879353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f171c003720 0x7f171c003b40 secure :-1 s=THROTTLE_DONE pgs=471 cs=0 l=1 rx=0x7f1724002f30 tx=0x7f1724010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:35.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.908+0000 7f17388b0700 1 -- 172.21.15.103:0/1174879353 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1724008e90 con 0x7f171c003720 2020-04-22T14:05:35.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.908+0000 7f17388b0700 1 -- 172.21.15.103:0/1174879353 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1724010a90 con 0x7f171c003720 2020-04-22T14:05:35.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.908+0000 7f173bb16700 1 -- 172.21.15.103:0/1174879353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f171c003720 msgr2=0x7f171c003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:35.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.908+0000 7f173bb16700 1 --2- 172.21.15.103:0/1174879353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f171c003720 0x7f171c003b40 secure :-1 s=READY pgs=471 cs=0 l=1 rx=0x7f1724002f30 tx=0x7f1724010020).stop 2020-04-22T14:05:35.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.908+0000 7f173a0b3700 1 -- 172.21.15.103:0/1174879353 reap_dead start 2020-04-22T14:05:35.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.908+0000 7f173bb16700 1 -- 172.21.15.103:0/1174879353 shutdown_connections 2020-04-22T14:05:35.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.908+0000 7f173bb16700 1 -- 172.21.15.103:0/1174879353 >> 172.21.15.103:0/1174879353 conn(0x7f17340b9160 msgr2=0x7f173405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:35.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.908+0000 7f173bb16700 1 -- 172.21.15.103:0/1174879353 shutdown_connections 2020-04-22T14:05:35.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.908+0000 7f173bb16700 1 -- 172.21.15.103:0/1174879353 wait complete. 2020-04-22T14:05:35.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.909+0000 7f173bb16700 1 Processor -- start 2020-04-22T14:05:35.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.909+0000 7f173bb16700 1 -- start start 2020-04-22T14:05:35.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.910+0000 7f173bb16700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1734154ac0 0x7f17340b4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:35.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.910+0000 7f173bb16700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f17340b1620 0x7f17340b1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:35.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.910+0000 7f173bb16700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17340af440 con 0x7f1734151b70 2020-04-22T14:05:35.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.910+0000 7f173bb16700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1734151fd0 con 0x7f17340b1620 2020-04-22T14:05:35.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.910+0000 7f173bb16700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1734154ea0 con 0x7f1734154ac0 2020-04-22T14:05:35.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.910+0000 7f17398b2700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1734154ac0 0x7f17340b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:35.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.910+0000 7f17390b1700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f1734151b70 0x7f1734111680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:58488/0 (socket says 172.21.15.103:58488) 2020-04-22T14:05:35.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.910+0000 7f173a0b3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f17340b1620 0x7f17340b1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:35.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.910+0000 7f17390b1700 1 -- 172.21.15.103:0/3278285361 learned_addr learned my addr 172.21.15.103:0/3278285361 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:35.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.910+0000 7f17398b2700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1734154ac0 0x7f17340b4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:33918/0 (socket says 172.21.15.103:33918) 2020-04-22T14:05:35.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.910+0000 7f17398b2700 1 -- 172.21.15.103:0/3278285361 >> v2:172.21.15.86:3300/0 conn(0x7f17340b1620 msgr2=0x7f17340b1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:35.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.910+0000 7f17398b2700 1 --2- 172.21.15.103:0/3278285361 >> v2:172.21.15.86:3300/0 conn(0x7f17340b1620 0x7f17340b1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:35.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.910+0000 7f17398b2700 1 -- 172.21.15.103:0/3278285361 >> v1:172.21.15.86:6789/0 conn(0x7f1734151b70 legacy=0x7f1734111680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:35.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.910+0000 7f17398b2700 1 -- 172.21.15.103:0/3278285361 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17340aef00 con 0x7f1734154ac0 2020-04-22T14:05:35.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.910+0000 7f17398b2700 1 --2- 172.21.15.103:0/3278285361 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1734154ac0 0x7f17340b4160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1724002f30 tx=0x7f1724010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:35.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.910+0000 7f17398b2700 1 --2- 172.21.15.103:0/3278285361 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1734154ac0 0x7f17340b4160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1724002f30 tx=0x7f1724010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:35.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.910+0000 7f17398b2700 1 --2- 172.21.15.103:0/3278285361 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1734154ac0 0x7f17340b4160 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7f1724002f30 tx=0x7f1724010020).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:35.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.911+0000 7f17398b2700 1 --2- 172.21.15.103:0/3278285361 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1734154ac0 0x7f17340b4160 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f1724002f30 tx=0x7f1724010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:35.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.911+0000 7f1722ffd700 1 -- 172.21.15.103:0/3278285361 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f172400f720 con 0x7f1734154ac0 2020-04-22T14:05:35.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.911+0000 7f17398b2700 1 --2- 172.21.15.103:0/3278285361 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1734154ac0 0x7f17340b4160 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f1724002f30 tx=0x7f1724010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:35.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.911+0000 7f17398b2700 1 --2- 172.21.15.103:0/3278285361 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1734154ac0 0x7f17340b4160 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f1724002f30 tx=0x7f1724010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:35.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.911+0000 7f1722ffd700 1 -- 172.21.15.103:0/3278285361 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17240056c0 con 0x7f1734154ac0 2020-04-22T14:05:35.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.911+0000 7f173bb16700 1 -- 172.21.15.103:0/3278285361 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17340af1a0 con 0x7f1734154ac0 2020-04-22T14:05:35.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.911+0000 7f1722ffd700 1 -- 172.21.15.103:0/3278285361 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f172400f880 con 0x7f1734154ac0 2020-04-22T14:05:35.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.911+0000 7f173bb16700 1 -- 172.21.15.103:0/3278285361 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1734111d90 con 0x7f1734154ac0 2020-04-22T14:05:35.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.911+0000 7f17398b2700 1 --2- 172.21.15.103:0/3278285361 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1734154ac0 0x7f17340b4160 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f1724002f30 tx=0x7f1724010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:35.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.912+0000 7f173bb16700 1 -- 172.21.15.103:0/3278285361 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17340b1320 con 0x7f1734154ac0 2020-04-22T14:05:35.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.912+0000 7f1722ffd700 1 -- 172.21.15.103:0/3278285361 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f1724005a60 con 0x7f1734154ac0 2020-04-22T14:05:35.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.912+0000 7f17398b2700 1 --2- 172.21.15.103:0/3278285361 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1734154ac0 0x7f17340b4160 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f1724002f30 tx=0x7f1724010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:35.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.912+0000 7f1722ffd700 1 --2- 172.21.15.103:0/3278285361 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f171404d940 0x7f171404fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:35.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.912+0000 7f1722ffd700 1 -- 172.21.15.103:0/3278285361 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f17240613e0 con 0x7f1734154ac0 2020-04-22T14:05:35.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.912+0000 7f17390b1700 1 --2- 172.21.15.103:0/3278285361 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f171404d940 0x7f171404fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:35.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.912+0000 7f17390b1700 1 --2- 172.21.15.103:0/3278285361 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f171404d940 0x7f171404fe00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f17340af950 tx=0x7f173405bd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:35.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.913+0000 7f17390b1700 1 --2- 172.21.15.103:0/3278285361 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f171404d940 0x7f171404fe00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f17340af950 tx=0x7f173405bd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:35.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.913+0000 7f17390b1700 1 --2- 172.21.15.103:0/3278285361 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f171404d940 0x7f171404fe00 secure :-1 s=READY pgs=188 cs=0 l=1 rx=0x7f17340af950 tx=0x7f173405bd30).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:35.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.916+0000 7f17398b2700 1 --2- 172.21.15.103:0/3278285361 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1734154ac0 0x7f17340b4160 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f1724002f30 tx=0x7f1724010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:35.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:35.916+0000 7f1722ffd700 1 -- 172.21.15.103:0/3278285361 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f172403c880 con 0x7f1734154ac0 2020-04-22T14:05:36.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.058+0000 7f173bb16700 1 -- 172.21.15.103:0/3278285361 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f1734056c90 con 0x7f1734154ac0 2020-04-22T14:05:36.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.059+0000 7f17398b2700 1 --2- 172.21.15.103:0/3278285361 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1734154ac0 0x7f17340b4160 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f1724002f30 tx=0x7f1724010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:36.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.059+0000 7f1722ffd700 1 -- 172.21.15.103:0/3278285361 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v35) v1 ==== 81+0+33696 (secure 0 0 0) 0x7f172403fea0 con 0x7f1734154ac0 2020-04-22T14:05:36.063 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:05:36.063 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:05:36.063 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 35, 2020-04-22T14:05:36.064 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:05:36.064 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2020-04-22T14:02:06.484738+0000", 2020-04-22T14:05:36.064 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2020-04-22T14:03:40.946120+0000", 2020-04-22T14:05:36.064 INFO:teuthology.orchestra.run.smithi103.stdout: "last_up_change": "2020-04-22T14:02:18.623774+0000", 2020-04-22T14:05:36.064 INFO:teuthology.orchestra.run.smithi103.stdout: "last_in_change": "2020-04-22T14:02:18.623774+0000", 2020-04-22T14:05:36.064 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-04-22T14:05:36.064 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_num": 5799936, 2020-04-22T14:05:36.064 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_set": [ 2020-04-22T14:05:36.065 INFO:teuthology.orchestra.run.smithi103.stdout: "pglog_hardlimit", 2020-04-22T14:05:36.065 INFO:teuthology.orchestra.run.smithi103.stdout: "purged_snapdirs", 2020-04-22T14:05:36.065 INFO:teuthology.orchestra.run.smithi103.stdout: "recovery_deletes", 2020-04-22T14:05:36.065 INFO:teuthology.orchestra.run.smithi103.stdout: "sortbitwise" 2020-04-22T14:05:36.065 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:05:36.065 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_version": 5, 2020-04-22T14:05:36.065 INFO:teuthology.orchestra.run.smithi103.stdout: "full_ratio": 0.94999998807907104, 2020-04-22T14:05:36.066 INFO:teuthology.orchestra.run.smithi103.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-04-22T14:05:36.066 INFO:teuthology.orchestra.run.smithi103.stdout: "nearfull_ratio": 0.85000002384185791, 2020-04-22T14:05:36.066 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_snapshot": "", 2020-04-22T14:05:36.066 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_max": 6, 2020-04-22T14:05:36.066 INFO:teuthology.orchestra.run.smithi103.stdout: "max_osd": 8, 2020-04-22T14:05:36.066 INFO:teuthology.orchestra.run.smithi103.stdout: "require_min_compat_client": "luminous", 2020-04-22T14:05:36.066 INFO:teuthology.orchestra.run.smithi103.stdout: "min_compat_client": "jewel", 2020-04-22T14:05:36.067 INFO:teuthology.orchestra.run.smithi103.stdout: "require_osd_release": "pacific", 2020-04-22T14:05:36.067 INFO:teuthology.orchestra.run.smithi103.stdout: "pools": [ 2020-04-22T14:05:36.067 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.067 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 1, 2020-04-22T14:05:36.067 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "device_health_metrics", 2020-04-22T14:05:36.067 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:02:09.565655+0000", 2020-04-22T14:05:36.067 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:05:36.067 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:05:36.068 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:05:36.068 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:05:36.068 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:05:36.068 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:05:36.068 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:05:36.068 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:05:36.068 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 1, 2020-04-22T14:05:36.069 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 1, 2020-04-22T14:05:36.069 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 1, 2020-04-22T14:05:36.069 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 1, 2020-04-22T14:05:36.069 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 1, 2020-04-22T14:05:36.069 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:05:36.069 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:05:36.069 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:05:36.070 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:05:36.070 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:05:36.070 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:05:36.070 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:05:36.070 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.070 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "17", 2020-04-22T14:05:36.070 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:05:36.070 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:05:36.071 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:05:36.071 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:05:36.071 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:05:36.071 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:05:36.071 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:05:36.071 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:05:36.071 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:05:36.072 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:05:36.072 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:05:36.072 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:05:36.072 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:05:36.072 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:05:36.072 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:05:36.072 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:05:36.073 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:05:36.073 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:05:36.073 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:05:36.074 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:05:36.074 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:05:36.074 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:05:36.074 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:05:36.074 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:05:36.074 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:05:36.074 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:05:36.075 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.075 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:05:36.075 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:05:36.075 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:05:36.075 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:05:36.075 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:05:36.075 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:05:36.076 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:05:36.076 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:05:36.076 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:05:36.076 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:05:36.076 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:05:36.076 INFO:teuthology.orchestra.run.smithi103.stdout: "options": { 2020-04-22T14:05:36.076 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_min": 1 2020-04-22T14:05:36.076 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.077 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:05:36.077 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_devicehealth": {} 2020-04-22T14:05:36.077 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.077 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.077 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.077 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 2, 2020-04-22T14:05:36.077 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "rbd", 2020-04-22T14:05:36.078 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:02:22.733031+0000", 2020-04-22T14:05:36.078 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:05:36.078 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:05:36.078 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:05:36.078 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:05:36.078 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:05:36.078 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:05:36.078 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:05:36.079 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:05:36.079 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 8, 2020-04-22T14:05:36.079 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 8, 2020-04-22T14:05:36.079 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 8, 2020-04-22T14:05:36.079 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 8, 2020-04-22T14:05:36.079 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 8, 2020-04-22T14:05:36.079 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:05:36.080 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:05:36.080 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:05:36.080 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:05:36.080 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:05:36.080 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:05:36.080 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:05:36.080 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.080 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "20", 2020-04-22T14:05:36.081 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:05:36.081 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:05:36.081 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:05:36.081 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:05:36.081 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:05:36.081 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:05:36.081 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:05:36.082 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:05:36.082 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:05:36.082 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:05:36.082 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:05:36.082 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:05:36.082 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:05:36.082 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:05:36.082 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:05:36.083 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:05:36.083 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:05:36.083 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:05:36.083 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:05:36.083 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:05:36.083 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:05:36.083 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:05:36.084 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:05:36.084 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:05:36.084 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:05:36.084 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:05:36.084 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.084 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:05:36.084 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:05:36.085 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:05:36.085 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:05:36.085 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:05:36.085 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:05:36.085 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:05:36.085 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:05:36.085 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:05:36.085 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:05:36.086 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:05:36.086 INFO:teuthology.orchestra.run.smithi103.stdout: "options": {}, 2020-04-22T14:05:36.086 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:05:36.086 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd": {} 2020-04-22T14:05:36.086 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.086 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.086 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.086 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 5, 2020-04-22T14:05:36.087 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "cephfs_metadata", 2020-04-22T14:05:36.087 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:03:37.161048+0000", 2020-04-22T14:05:36.087 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:05:36.087 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:05:36.087 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:05:36.087 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:05:36.087 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:05:36.088 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:05:36.088 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:05:36.088 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:05:36.088 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 8, 2020-04-22T14:05:36.088 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 8, 2020-04-22T14:05:36.088 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 8, 2020-04-22T14:05:36.088 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 8, 2020-04-22T14:05:36.088 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 8, 2020-04-22T14:05:36.089 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:05:36.089 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:05:36.089 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:05:36.089 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:05:36.089 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:05:36.089 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:05:36.089 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:05:36.090 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.090 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "34", 2020-04-22T14:05:36.090 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:05:36.090 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:05:36.090 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:05:36.090 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:05:36.090 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:05:36.090 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:05:36.091 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:05:36.091 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:05:36.091 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:05:36.091 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:05:36.091 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:05:36.091 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:05:36.091 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:05:36.092 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:05:36.092 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:05:36.092 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:05:36.092 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:05:36.092 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:05:36.092 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:05:36.092 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:05:36.093 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:05:36.093 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:05:36.093 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:05:36.093 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:05:36.093 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:05:36.093 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:05:36.093 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.093 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:05:36.094 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:05:36.094 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:05:36.094 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:05:36.094 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:05:36.094 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:05:36.094 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:05:36.094 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:05:36.095 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:05:36.095 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:05:36.095 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:05:36.095 INFO:teuthology.orchestra.run.smithi103.stdout: "options": { 2020-04-22T14:05:36.095 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_bias": 4, 2020-04-22T14:05:36.095 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_min": 16, 2020-04-22T14:05:36.095 INFO:teuthology.orchestra.run.smithi103.stdout: "recovery_priority": 5 2020-04-22T14:05:36.095 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.096 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:05:36.096 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs": { 2020-04-22T14:05:36.096 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": "cephfs" 2020-04-22T14:05:36.096 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.096 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.096 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.096 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.097 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 6, 2020-04-22T14:05:36.097 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "cephfs_data", 2020-04-22T14:05:36.097 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:03:37.878823+0000", 2020-04-22T14:05:36.097 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:05:36.097 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:05:36.097 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:05:36.097 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:05:36.098 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:05:36.098 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:05:36.098 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:05:36.098 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:05:36.098 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 8, 2020-04-22T14:05:36.098 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 8, 2020-04-22T14:05:36.098 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 8, 2020-04-22T14:05:36.098 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 8, 2020-04-22T14:05:36.099 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 8, 2020-04-22T14:05:36.099 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:05:36.099 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:05:36.099 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:05:36.099 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:05:36.099 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:05:36.099 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:05:36.099 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:05:36.100 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.100 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "35", 2020-04-22T14:05:36.100 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:05:36.100 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:05:36.100 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:05:36.100 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:05:36.100 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:05:36.101 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:05:36.101 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:05:36.101 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:05:36.101 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:05:36.101 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:05:36.101 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:05:36.101 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:05:36.102 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:05:36.102 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:05:36.102 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:05:36.102 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:05:36.102 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:05:36.102 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:05:36.102 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:05:36.103 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:05:36.103 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:05:36.103 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:05:36.103 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:05:36.103 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:05:36.103 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:05:36.104 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:05:36.104 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.104 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:05:36.104 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:05:36.104 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:05:36.104 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:05:36.104 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:05:36.105 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:05:36.105 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:05:36.105 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:05:36.105 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:05:36.105 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:05:36.106 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:05:36.106 INFO:teuthology.orchestra.run.smithi103.stdout: "options": {}, 2020-04-22T14:05:36.106 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:05:36.106 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs": { 2020-04-22T14:05:36.106 INFO:teuthology.orchestra.run.smithi103.stdout: "data": "cephfs" 2020-04-22T14:05:36.106 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.106 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.107 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.107 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:05:36.107 INFO:teuthology.orchestra.run.smithi103.stdout: "osds": [ 2020-04-22T14:05:36.107 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.107 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 0, 2020-04-22T14:05:36.107 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "3546145b-bd93-4a79-b6fe-3158153b8f05", 2020-04-22T14:05:36.107 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:05:36.107 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:05:36.108 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:05:36.108 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:05:36.108 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:05:36.108 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:05:36.108 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:05:36.108 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 32, 2020-04-22T14:05:36.108 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:05:36.109 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:05:36.109 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:05:36.109 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:05:36.109 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.109 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:05:36.127 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6800", 2020-04-22T14:05:36.127 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:05:36.127 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.127 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.127 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:05:36.128 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6801", 2020-04-22T14:05:36.128 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:05:36.128 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.128 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:05:36.128 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.128 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:05:36.128 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:05:36.128 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.129 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:05:36.129 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6802", 2020-04-22T14:05:36.129 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:05:36.129 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.129 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.129 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:05:36.129 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6803", 2020-04-22T14:05:36.130 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:05:36.130 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.130 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:05:36.130 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.130 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:05:36.130 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:05:36.130 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.130 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:05:36.131 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6806", 2020-04-22T14:05:36.131 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:05:36.131 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.131 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.131 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:05:36.131 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6807", 2020-04-22T14:05:36.131 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:05:36.132 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.132 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:05:36.132 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.132 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:05:36.132 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:05:36.132 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.132 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:05:36.132 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6804", 2020-04-22T14:05:36.133 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:05:36.133 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.133 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.133 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:05:36.133 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6805", 2020-04-22T14:05:36.133 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:05:36.133 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.134 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:05:36.134 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.134 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6801/33072", 2020-04-22T14:05:36.134 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6803/33072", 2020-04-22T14:05:36.134 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6807/33072", 2020-04-22T14:05:36.134 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6805/33072", 2020-04-22T14:05:36.134 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:05:36.134 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:05:36.135 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:05:36.135 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:05:36.135 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.135 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.135 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 1, 2020-04-22T14:05:36.135 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "65ca5f7d-2ea6-4de6-a034-08a0a99aa80d", 2020-04-22T14:05:36.135 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:05:36.136 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:05:36.136 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:05:36.136 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:05:36.136 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:05:36.136 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:05:36.136 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:05:36.137 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 33, 2020-04-22T14:05:36.137 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:05:36.137 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:05:36.137 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:05:36.137 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:05:36.137 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.137 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:05:36.138 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6808", 2020-04-22T14:05:36.138 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:05:36.138 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.138 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.138 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:05:36.138 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6809", 2020-04-22T14:05:36.138 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:05:36.138 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.139 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:05:36.139 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.139 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:05:36.139 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:05:36.139 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.139 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:05:36.139 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6810", 2020-04-22T14:05:36.140 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:05:36.140 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.140 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.140 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:05:36.140 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6811", 2020-04-22T14:05:36.140 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:05:36.140 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.140 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:05:36.141 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.141 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:05:36.141 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:05:36.141 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.141 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:05:36.141 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6814", 2020-04-22T14:05:36.141 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:05:36.142 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.142 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.142 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:05:36.142 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6815", 2020-04-22T14:05:36.142 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:05:36.142 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.142 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:05:36.142 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.143 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:05:36.143 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:05:36.143 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.143 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:05:36.143 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6812", 2020-04-22T14:05:36.143 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:05:36.143 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.144 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.144 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:05:36.144 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6813", 2020-04-22T14:05:36.144 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:05:36.144 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.144 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:05:36.144 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.144 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6809/33103", 2020-04-22T14:05:36.145 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6811/33103", 2020-04-22T14:05:36.145 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6815/33103", 2020-04-22T14:05:36.145 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6813/33103", 2020-04-22T14:05:36.145 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:05:36.145 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:05:36.145 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:05:36.145 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:05:36.146 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.146 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.146 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 2, 2020-04-22T14:05:36.146 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "f2e9bf44-c844-48d7-b6c2-f08ea71189b4", 2020-04-22T14:05:36.146 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:05:36.146 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:05:36.146 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:05:36.146 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:05:36.147 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:05:36.147 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:05:36.147 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:05:36.147 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 31, 2020-04-22T14:05:36.147 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:05:36.147 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:05:36.147 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:05:36.148 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:05:36.148 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.148 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:05:36.148 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6816", 2020-04-22T14:05:36.148 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:05:36.148 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.148 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.148 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:05:36.149 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6817", 2020-04-22T14:05:36.149 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:05:36.149 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.149 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:05:36.149 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.149 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:05:36.150 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:05:36.150 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.150 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:05:36.150 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6818", 2020-04-22T14:05:36.150 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:05:36.150 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.150 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.151 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:05:36.151 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6819", 2020-04-22T14:05:36.151 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:05:36.151 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.151 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:05:36.151 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.151 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:05:36.151 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:05:36.152 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.152 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:05:36.152 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6822", 2020-04-22T14:05:36.152 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:05:36.152 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.152 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.152 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:05:36.153 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6823", 2020-04-22T14:05:36.153 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:05:36.153 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.153 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:05:36.153 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.153 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:05:36.153 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:05:36.154 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.154 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:05:36.154 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6820", 2020-04-22T14:05:36.154 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:05:36.154 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.154 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.154 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:05:36.154 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6821", 2020-04-22T14:05:36.155 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:05:36.155 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.155 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:05:36.155 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.155 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6817/33153", 2020-04-22T14:05:36.155 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6819/33153", 2020-04-22T14:05:36.155 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6823/33153", 2020-04-22T14:05:36.155 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6821/33153", 2020-04-22T14:05:36.156 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:05:36.156 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:05:36.156 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:05:36.156 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:05:36.156 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.156 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.157 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 3, 2020-04-22T14:05:36.157 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "0ab87fee-a427-4906-851a-b9bd8c2e5645", 2020-04-22T14:05:36.157 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:05:36.157 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:05:36.157 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:05:36.157 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:05:36.157 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:05:36.158 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:05:36.158 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:05:36.158 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 32, 2020-04-22T14:05:36.158 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:05:36.158 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:05:36.158 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:05:36.158 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:05:36.158 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.159 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:05:36.159 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6824", 2020-04-22T14:05:36.159 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:05:36.159 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.159 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.159 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:05:36.159 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6825", 2020-04-22T14:05:36.160 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:05:36.160 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.160 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:05:36.160 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.160 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:05:36.160 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:05:36.160 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.160 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:05:36.161 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6826", 2020-04-22T14:05:36.161 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:05:36.161 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.161 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.161 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:05:36.161 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6827", 2020-04-22T14:05:36.161 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:05:36.162 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.162 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:05:36.162 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.162 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:05:36.162 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:05:36.162 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.162 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:05:36.162 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6830", 2020-04-22T14:05:36.163 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:05:36.163 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.163 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.163 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:05:36.163 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6831", 2020-04-22T14:05:36.163 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:05:36.163 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.163 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:05:36.164 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.164 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:05:36.164 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:05:36.164 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.164 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:05:36.164 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6828", 2020-04-22T14:05:36.164 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:05:36.165 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.165 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.165 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:05:36.165 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6829", 2020-04-22T14:05:36.165 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:05:36.165 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.165 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:05:36.165 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.166 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6825/33183", 2020-04-22T14:05:36.166 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6827/33183", 2020-04-22T14:05:36.166 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6831/33183", 2020-04-22T14:05:36.166 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6829/33183", 2020-04-22T14:05:36.166 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:05:36.166 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:05:36.166 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:05:36.167 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:05:36.167 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.167 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.167 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 4, 2020-04-22T14:05:36.167 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "2565df7d-2eff-484b-a3cd-ed7715e5d875", 2020-04-22T14:05:36.167 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:05:36.167 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:05:36.167 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:05:36.168 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:05:36.168 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:05:36.168 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:05:36.168 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:05:36.168 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 32, 2020-04-22T14:05:36.168 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:05:36.168 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:05:36.168 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:05:36.169 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:05:36.169 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.169 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:05:36.169 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6802", 2020-04-22T14:05:36.169 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:05:36.169 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.169 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.170 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:05:36.170 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6803", 2020-04-22T14:05:36.170 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:05:36.170 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.170 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:05:36.170 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.170 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:05:36.171 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:05:36.171 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.171 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:05:36.171 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6804", 2020-04-22T14:05:36.171 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:05:36.171 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.171 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.171 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:05:36.172 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6805", 2020-04-22T14:05:36.172 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:05:36.172 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.172 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:05:36.172 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.172 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:05:36.172 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:05:36.173 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.173 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:05:36.173 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6808", 2020-04-22T14:05:36.173 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:05:36.173 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.173 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.174 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:05:36.174 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6809", 2020-04-22T14:05:36.174 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:05:36.174 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.174 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:05:36.174 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.174 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:05:36.175 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:05:36.175 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.175 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:05:36.175 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6806", 2020-04-22T14:05:36.175 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:05:36.175 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.176 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.176 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:05:36.176 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6807", 2020-04-22T14:05:36.176 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:05:36.176 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.176 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:05:36.177 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.177 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6803/33506", 2020-04-22T14:05:36.178 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6805/33506", 2020-04-22T14:05:36.178 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6809/33506", 2020-04-22T14:05:36.178 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6807/33506", 2020-04-22T14:05:36.178 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:05:36.179 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:05:36.179 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:05:36.179 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:05:36.179 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.179 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.179 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 5, 2020-04-22T14:05:36.179 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "bcfd7a16-6914-4152-8647-a481917fe19d", 2020-04-22T14:05:36.179 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:05:36.180 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:05:36.180 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:05:36.180 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:05:36.180 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:05:36.180 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:05:36.180 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:05:36.180 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 32, 2020-04-22T14:05:36.181 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:05:36.181 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:05:36.181 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:05:36.181 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:05:36.181 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.181 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:05:36.181 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6810", 2020-04-22T14:05:36.182 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:05:36.182 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.182 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.182 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:05:36.182 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6811", 2020-04-22T14:05:36.182 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:05:36.182 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.182 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:05:36.183 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.183 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:05:36.183 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:05:36.183 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.183 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:05:36.183 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6812", 2020-04-22T14:05:36.183 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:05:36.184 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.184 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.184 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:05:36.184 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6813", 2020-04-22T14:05:36.184 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:05:36.184 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.184 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:05:36.184 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.185 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:05:36.185 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:05:36.185 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.185 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:05:36.185 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6816", 2020-04-22T14:05:36.185 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:05:36.185 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.186 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.186 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:05:36.186 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6817", 2020-04-22T14:05:36.186 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:05:36.186 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.186 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:05:36.186 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.186 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:05:36.187 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:05:36.187 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.187 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:05:36.187 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6814", 2020-04-22T14:05:36.187 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:05:36.187 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.187 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.188 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:05:36.188 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6815", 2020-04-22T14:05:36.188 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:05:36.188 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.188 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:05:36.188 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.189 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6811/33554", 2020-04-22T14:05:36.189 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6813/33554", 2020-04-22T14:05:36.189 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6817/33554", 2020-04-22T14:05:36.189 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6815/33554", 2020-04-22T14:05:36.189 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:05:36.189 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:05:36.190 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:05:36.190 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:05:36.190 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.190 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.190 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 6, 2020-04-22T14:05:36.190 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050", 2020-04-22T14:05:36.190 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:05:36.191 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:05:36.191 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:05:36.191 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:05:36.191 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:05:36.191 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:05:36.191 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:05:36.191 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 31, 2020-04-22T14:05:36.192 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:05:36.192 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:05:36.192 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:05:36.192 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:05:36.192 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.192 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:05:36.192 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6818", 2020-04-22T14:05:36.192 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:05:36.193 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.193 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.193 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:05:36.193 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6819", 2020-04-22T14:05:36.193 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:05:36.193 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.193 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:05:36.194 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.194 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:05:36.194 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:05:36.194 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.194 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:05:36.194 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6820", 2020-04-22T14:05:36.194 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:05:36.194 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.195 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.195 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:05:36.195 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6821", 2020-04-22T14:05:36.195 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:05:36.195 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.195 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:05:36.195 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.196 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:05:36.196 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:05:36.196 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.196 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:05:36.196 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6824", 2020-04-22T14:05:36.196 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:05:36.196 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.197 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.197 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:05:36.197 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6825", 2020-04-22T14:05:36.197 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:05:36.197 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.197 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:05:36.197 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.198 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:05:36.198 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:05:36.198 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.198 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:05:36.198 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6822", 2020-04-22T14:05:36.198 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:05:36.198 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.198 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.199 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:05:36.199 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6823", 2020-04-22T14:05:36.199 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:05:36.200 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.200 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:05:36.200 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.200 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6819/33601", 2020-04-22T14:05:36.200 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6821/33601", 2020-04-22T14:05:36.200 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6825/33601", 2020-04-22T14:05:36.201 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6823/33601", 2020-04-22T14:05:36.201 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:05:36.201 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:05:36.201 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:05:36.201 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:05:36.202 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.202 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.202 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 7, 2020-04-22T14:05:36.202 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "340eece1-4c39-47cd-b95f-9cfa5dcfe361", 2020-04-22T14:05:36.202 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:05:36.202 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:05:36.202 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:05:36.202 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:05:36.203 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:05:36.203 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:05:36.203 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:05:36.203 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 32, 2020-04-22T14:05:36.203 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:05:36.203 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:05:36.203 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:05:36.204 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:05:36.204 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.204 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:05:36.204 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6826", 2020-04-22T14:05:36.204 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:05:36.204 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.204 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.204 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:05:36.205 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6827", 2020-04-22T14:05:36.205 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:05:36.205 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.205 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:05:36.205 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.205 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:05:36.206 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:05:36.206 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.206 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:05:36.206 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6828", 2020-04-22T14:05:36.206 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:05:36.206 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.206 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.207 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:05:36.207 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6829", 2020-04-22T14:05:36.207 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:05:36.207 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.207 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:05:36.207 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.207 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:05:36.208 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:05:36.208 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.208 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:05:36.209 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6832", 2020-04-22T14:05:36.209 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:05:36.209 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.209 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.209 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:05:36.209 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6833", 2020-04-22T14:05:36.210 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:05:36.210 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.210 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:05:36.210 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.210 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:05:36.210 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:05:36.210 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.210 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:05:36.211 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6830", 2020-04-22T14:05:36.211 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:05:36.211 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.211 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.211 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:05:36.211 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6831", 2020-04-22T14:05:36.211 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:05:36.212 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.212 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:05:36.212 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.212 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6827/33629", 2020-04-22T14:05:36.212 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6829/33629", 2020-04-22T14:05:36.212 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6833/33629", 2020-04-22T14:05:36.212 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6831/33629", 2020-04-22T14:05:36.212 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:05:36.213 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:05:36.213 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:05:36.213 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:05:36.213 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.213 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:05:36.213 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_xinfo": [ 2020-04-22T14:05:36.213 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.214 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 0, 2020-04-22T14:05:36.214 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:05:36.214 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:05:36.214 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:05:36.214 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:05:36.214 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:05:36.214 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.384360+0000", 2020-04-22T14:05:36.214 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:05:36.215 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.215 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.215 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 1, 2020-04-22T14:05:36.215 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:05:36.215 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:05:36.215 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:05:36.215 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:05:36.216 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:05:36.216 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.503590+0000", 2020-04-22T14:05:36.216 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:05:36.216 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.216 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.216 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 2, 2020-04-22T14:05:36.216 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:05:36.217 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:05:36.217 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:05:36.217 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:05:36.217 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:05:36.217 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.525058+0000", 2020-04-22T14:05:36.217 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:05:36.217 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.218 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.218 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 3, 2020-04-22T14:05:36.218 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:05:36.218 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:05:36.218 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:05:36.218 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:05:36.218 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:05:36.218 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.599729+0000", 2020-04-22T14:05:36.219 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:05:36.219 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.219 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.219 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 4, 2020-04-22T14:05:36.219 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:05:36.219 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:05:36.219 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:05:36.219 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:05:36.220 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:05:36.220 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.600919+0000", 2020-04-22T14:05:36.220 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:05:36.220 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.220 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.220 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 5, 2020-04-22T14:05:36.220 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:05:36.221 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:05:36.221 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:05:36.221 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:05:36.221 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:05:36.221 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.654718+0000", 2020-04-22T14:05:36.221 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:05:36.221 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.222 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.222 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 6, 2020-04-22T14:05:36.222 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:05:36.222 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:05:36.222 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:05:36.222 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:05:36.222 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:05:36.222 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.718342+0000", 2020-04-22T14:05:36.223 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:05:36.223 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.223 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:36.223 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 7, 2020-04-22T14:05:36.223 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:05:36.223 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:05:36.223 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:05:36.224 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:05:36.224 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:05:36.224 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.839089+0000", 2020-04-22T14:05:36.224 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:05:36.224 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.224 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:05:36.224 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_upmap": [], 2020-04-22T14:05:36.225 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_upmap_items": [], 2020-04-22T14:05:36.225 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_temp": [], 2020-04-22T14:05:36.225 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_temp": [], 2020-04-22T14:05:36.225 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklist": {}, 2020-04-22T14:05:36.225 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profiles": { 2020-04-22T14:05:36.225 INFO:teuthology.orchestra.run.smithi103.stdout: "default": { 2020-04-22T14:05:36.225 INFO:teuthology.orchestra.run.smithi103.stdout: "crush-failure-domain": "osd", 2020-04-22T14:05:36.225 INFO:teuthology.orchestra.run.smithi103.stdout: "k": "2", 2020-04-22T14:05:36.226 INFO:teuthology.orchestra.run.smithi103.stdout: "m": "1", 2020-04-22T14:05:36.226 INFO:teuthology.orchestra.run.smithi103.stdout: "plugin": "jerasure", 2020-04-22T14:05:36.226 INFO:teuthology.orchestra.run.smithi103.stdout: "ruleset-failure-domain": "osd", 2020-04-22T14:05:36.226 INFO:teuthology.orchestra.run.smithi103.stdout: "technique": "reed_sol_van" 2020-04-22T14:05:36.226 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:36.226 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:36.226 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps_queue": [], 2020-04-22T14:05:36.227 INFO:teuthology.orchestra.run.smithi103.stdout: "new_removed_snaps": [], 2020-04-22T14:05:36.227 INFO:teuthology.orchestra.run.smithi103.stdout: "new_purged_snaps": [], 2020-04-22T14:05:36.227 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_node_flags": {}, 2020-04-22T14:05:36.227 INFO:teuthology.orchestra.run.smithi103.stdout: "device_class_flags": {} 2020-04-22T14:05:36.227 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:05:36.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.061+0000 7f173bb16700 1 -- 172.21.15.103:0/3278285361 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f171404d940 msgr2=0x7f171404fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:36.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.061+0000 7f173bb16700 1 --2- 172.21.15.103:0/3278285361 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f171404d940 0x7f171404fe00 secure :-1 s=READY pgs=188 cs=0 l=1 rx=0x7f17340af950 tx=0x7f173405bd30).stop 2020-04-22T14:05:36.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.061+0000 7f173bb16700 1 -- 172.21.15.103:0/3278285361 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1734154ac0 msgr2=0x7f17340b4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:36.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.061+0000 7f173bb16700 1 --2- 172.21.15.103:0/3278285361 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1734154ac0 0x7f17340b4160 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7f1724002f30 tx=0x7f1724010020).stop 2020-04-22T14:05:36.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.061+0000 7f173bb16700 1 -- 172.21.15.103:0/3278285361 shutdown_connections 2020-04-22T14:05:36.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.061+0000 7f173bb16700 1 --2- 172.21.15.103:0/3278285361 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f171404d940 0x7f171404fe00 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:36.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.061+0000 7f173bb16700 1 --2- 172.21.15.103:0/3278285361 >> v2:172.21.15.86:3300/0 conn(0x7f17340b1620 0x7f17340b1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:36.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.061+0000 7f173bb16700 1 --2- 172.21.15.103:0/3278285361 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1734154ac0 0x7f17340b4160 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:36.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.061+0000 7f173bb16700 1 -- 172.21.15.103:0/3278285361 >> 172.21.15.103:0/3278285361 conn(0x7f17340b9160 msgr2=0x7f17341426f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:36.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.061+0000 7f173bb16700 1 -- 172.21.15.103:0/3278285361 shutdown_connections 2020-04-22T14:05:36.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.061+0000 7f173bb16700 1 -- 172.21.15.103:0/3278285361 wait complete. 2020-04-22T14:05:36.231 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:36.245 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:05:36.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.389+0000 7f7cebdc5700 1 Processor -- start 2020-04-22T14:05:36.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.389+0000 7f7cebdc5700 1 -- start start 2020-04-22T14:05:36.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.390+0000 7f7cebdc5700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7ce4067170 0x7f7ce40b6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:36.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.390+0000 7f7cebdc5700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ce40ac740 0x7f7ce413c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:36.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.390+0000 7f7cebdc5700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7ce413c7e0 0x7f7ce405b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:36.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.390+0000 7f7cebdc5700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ce4065af0 con 0x7f7ce4067170 2020-04-22T14:05:36.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.390+0000 7f7cebdc5700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ce4064ec0 con 0x7f7ce413c7e0 2020-04-22T14:05:36.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.390+0000 7f7cebdc5700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce4146870 con 0x7f7ce40ac740 2020-04-22T14:05:36.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.390+0000 7f7cea362700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7ce413c7e0 0x7f7ce405b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:36.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.390+0000 7f7cea362700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7ce413c7e0 0x7f7ce405b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49148/0 (socket says 172.21.15.103:49148) 2020-04-22T14:05:36.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.390+0000 7f7cea362700 1 -- 172.21.15.103:0/143355903 learned_addr learned my addr 172.21.15.103:0/143355903 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:05:36.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.390+0000 7f7ce9360700 1 --2- 172.21.15.103:0/143355903 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ce40ac740 0x7f7ce413c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:36.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.390+0000 7f7ce9b61700 1 --2- 172.21.15.103:0/143355903 >> v2:172.21.15.86:3300/0 conn(0x7f7ce4067170 0x7f7ce40b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:36.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.390+0000 7f7cea362700 1 -- 172.21.15.103:0/143355903 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ce40ac740 msgr2=0x7f7ce413c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:36.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.390+0000 7f7cea362700 1 --2- 172.21.15.103:0/143355903 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ce40ac740 0x7f7ce413c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:36.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.390+0000 7f7cea362700 1 -- 172.21.15.103:0/143355903 >> v2:172.21.15.86:3300/0 conn(0x7f7ce4067170 msgr2=0x7f7ce40b6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:36.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.390+0000 7f7cea362700 1 --2- 172.21.15.103:0/143355903 >> v2:172.21.15.86:3300/0 conn(0x7f7ce4067170 0x7f7ce40b6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:36.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.390+0000 7f7cea362700 1 -- 172.21.15.103:0/143355903 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce4067550 con 0x7f7ce413c7e0 2020-04-22T14:05:36.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.390+0000 7f7cea362700 1 --2- 172.21.15.103:0/143355903 >> v2:172.21.15.103:3300/0 conn(0x7f7ce413c7e0 0x7f7ce405b440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7cdc0032b0 tx=0x7f7cdc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:36.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.390+0000 7f7cea362700 1 --2- 172.21.15.103:0/143355903 >> v2:172.21.15.103:3300/0 conn(0x7f7ce413c7e0 0x7f7ce405b440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7cdc0032b0 tx=0x7f7cdc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:36.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.390+0000 7f7cea362700 1 --2- 172.21.15.103:0/143355903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ce413c7e0 0x7f7ce405b440 secure :-1 s=READY pgs=472 cs=0 l=1 rx=0x7f7cdc0032b0 tx=0x7f7cdc007dc0).ready entity=mon.1 client_cookie=295552b71bfe3b98 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:36.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.390+0000 7f7cea362700 1 --2- 172.21.15.103:0/143355903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ce413c7e0 0x7f7ce405b440 secure :-1 s=THROTTLE_DONE pgs=472 cs=0 l=1 rx=0x7f7cdc0032b0 tx=0x7f7cdc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:36.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.391+0000 7f7cea362700 1 --2- 172.21.15.103:0/143355903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ce413c7e0 0x7f7ce405b440 secure :-1 s=THROTTLE_DONE pgs=472 cs=0 l=1 rx=0x7f7cdc0032b0 tx=0x7f7cdc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:36.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.390+0000 7f7ce8b5f700 1 -- 172.21.15.103:0/143355903 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cdc00a180 con 0x7f7ce413c7e0 2020-04-22T14:05:36.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.391+0000 7f7cea362700 1 --2- 172.21.15.103:0/143355903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ce413c7e0 0x7f7ce405b440 secure :-1 s=THROTTLE_DONE pgs=472 cs=0 l=1 rx=0x7f7cdc0032b0 tx=0x7f7cdc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:36.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.391+0000 7f7ce8b5f700 1 -- 172.21.15.103:0/143355903 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cdc00a2e0 con 0x7f7ce413c7e0 2020-04-22T14:05:36.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.391+0000 7f7ce8b5f700 1 -- 172.21.15.103:0/143355903 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cdc00a700 con 0x7f7ce413c7e0 2020-04-22T14:05:36.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.391+0000 7f7cebdc5700 1 -- 172.21.15.103:0/143355903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ce413c7e0 msgr2=0x7f7ce405b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:36.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.391+0000 7f7cebdc5700 1 --2- 172.21.15.103:0/143355903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ce413c7e0 0x7f7ce405b440 secure :-1 s=READY pgs=472 cs=0 l=1 rx=0x7f7cdc0032b0 tx=0x7f7cdc007dc0).stop 2020-04-22T14:05:36.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.391+0000 7f7cebdc5700 1 -- 172.21.15.103:0/143355903 shutdown_connections 2020-04-22T14:05:36.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.391+0000 7f7cebdc5700 1 --2- 172.21.15.103:0/143355903 >> v2:172.21.15.86:3300/0 conn(0x7f7ce4067170 0x7f7ce40b6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:36.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.391+0000 7f7cebdc5700 1 --2- 172.21.15.103:0/143355903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ce413c7e0 0x7f7ce405b440 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:36.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.391+0000 7f7cebdc5700 1 --2- 172.21.15.103:0/143355903 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ce40ac740 0x7f7ce413c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:36.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.391+0000 7f7cebdc5700 1 -- 172.21.15.103:0/143355903 >> 172.21.15.103:0/143355903 conn(0x7f7ce40b9160 msgr2=0x7f7ce405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:36.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.391+0000 7f7cebdc5700 1 -- 172.21.15.103:0/143355903 shutdown_connections 2020-04-22T14:05:36.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.391+0000 7f7cebdc5700 1 -- 172.21.15.103:0/143355903 wait complete. 2020-04-22T14:05:36.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.392+0000 7f7cebdc5700 1 Processor -- start 2020-04-22T14:05:36.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.392+0000 7f7cebdc5700 1 -- start start 2020-04-22T14:05:36.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.393+0000 7f7cebdc5700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ce4067170 0x7f7ce4157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:36.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.393+0000 7f7cebdc5700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7ce413c7e0 0x7f7ce40ad3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:36.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.393+0000 7f7cebdc5700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ce4153ea0 con 0x7f7ce40ac740 2020-04-22T14:05:36.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.393+0000 7f7cebdc5700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ce4153c90 con 0x7f7ce413c7e0 2020-04-22T14:05:36.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.393+0000 7f7cebdc5700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce4154140 con 0x7f7ce4067170 2020-04-22T14:05:36.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.393+0000 7f7ce9b61700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ce4067170 0x7f7ce4157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:36.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.393+0000 7f7cea362700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7ce413c7e0 0x7f7ce40ad3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:36.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.393+0000 7f7ce9b61700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ce4067170 0x7f7ce4157750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:33930/0 (socket says 172.21.15.103:33930) 2020-04-22T14:05:36.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.393+0000 7f7cea362700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7ce413c7e0 0x7f7ce40ad3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:46388/0 (socket says 172.21.15.103:46388) 2020-04-22T14:05:36.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.393+0000 7f7ce9b61700 1 -- 172.21.15.103:0/3118158593 learned_addr learned my addr 172.21.15.103:0/3118158593 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:05:36.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.393+0000 7f7ce9b61700 1 -- 172.21.15.103:0/3118158593 >> v2:172.21.15.86:3300/0 conn(0x7f7ce413c7e0 msgr2=0x7f7ce40ad3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:36.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.393+0000 7f7ce9b61700 1 --2- 172.21.15.103:0/3118158593 >> v2:172.21.15.86:3300/0 conn(0x7f7ce413c7e0 0x7f7ce40ad3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:36.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.393+0000 7f7ce9b61700 1 -- 172.21.15.103:0/3118158593 >> v1:172.21.15.86:6789/0 conn(0x7f7ce40ac740 legacy=0x7f7ce4064050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:36.408 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.393+0000 7f7ce9b61700 1 -- 172.21.15.103:0/3118158593 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce4064760 con 0x7f7ce4067170 2020-04-22T14:05:36.408 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.393+0000 7f7cea362700 1 --2- 172.21.15.103:0/3118158593 >> v2:172.21.15.86:3300/0 conn(0x7f7ce413c7e0 0x7f7ce40ad3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:05:36.408 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.393+0000 7f7ce9b61700 1 --2- 172.21.15.103:0/3118158593 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ce4067170 0x7f7ce4157750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7cd4002f30 tx=0x7f7cd4010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:36.408 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.393+0000 7f7ce9b61700 1 --2- 172.21.15.103:0/3118158593 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ce4067170 0x7f7ce4157750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7cd4002f30 tx=0x7f7cd4010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:36.408 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.393+0000 7f7ce9b61700 1 --2- 172.21.15.103:0/3118158593 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ce4067170 0x7f7ce4157750 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7f7cd4002f30 tx=0x7f7cd4010ba0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:36.408 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.394+0000 7f7ce9b61700 1 --2- 172.21.15.103:0/3118158593 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ce4067170 0x7f7ce4157750 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f7cd4002f30 tx=0x7f7cd4010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:36.408 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.394+0000 7f7cd2ffd700 1 -- 172.21.15.103:0/3118158593 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cd4012a10 con 0x7f7ce4067170 2020-04-22T14:05:36.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.394+0000 7f7ce9b61700 1 --2- 172.21.15.103:0/3118158593 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ce4067170 0x7f7ce4157750 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f7cd4002f30 tx=0x7f7cd4010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:36.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.394+0000 7f7cd2ffd700 1 -- 172.21.15.103:0/3118158593 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd4012b70 con 0x7f7ce4067170 2020-04-22T14:05:36.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.394+0000 7f7ce9b61700 1 --2- 172.21.15.103:0/3118158593 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ce4067170 0x7f7ce4157750 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f7cd4002f30 tx=0x7f7cd4010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:36.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.394+0000 7f7cebdc5700 1 -- 172.21.15.103:0/3118158593 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ce41538c0 con 0x7f7ce4067170 2020-04-22T14:05:36.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.394+0000 7f7cd2ffd700 1 -- 172.21.15.103:0/3118158593 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cd40091c0 con 0x7f7ce4067170 2020-04-22T14:05:36.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.394+0000 7f7cebdc5700 1 -- 172.21.15.103:0/3118158593 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ce413ee90 con 0x7f7ce4067170 2020-04-22T14:05:36.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.394+0000 7f7ce9b61700 1 --2- 172.21.15.103:0/3118158593 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ce4067170 0x7f7ce4157750 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f7cd4002f30 tx=0x7f7cd4010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:36.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.395+0000 7f7cd2ffd700 1 -- 172.21.15.103:0/3118158593 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f7cd4007190 con 0x7f7ce4067170 2020-04-22T14:05:36.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.395+0000 7f7ce9b61700 1 --2- 172.21.15.103:0/3118158593 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ce4067170 0x7f7ce4157750 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f7cd4002f30 tx=0x7f7cd4010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:36.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.395+0000 7f7cebdc5700 1 -- 172.21.15.103:0/3118158593 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ce4157d70 con 0x7f7ce4067170 2020-04-22T14:05:36.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.395+0000 7f7cd2ffd700 1 --2- 172.21.15.103:0/3118158593 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7cc404d8d0 0x7f7cc404fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:36.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.395+0000 7f7cd2ffd700 1 -- 172.21.15.103:0/3118158593 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7cd40619b0 con 0x7f7ce4067170 2020-04-22T14:05:36.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.395+0000 7f7ce9360700 1 --2- 172.21.15.103:0/3118158593 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7cc404d8d0 0x7f7cc404fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:36.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.396+0000 7f7ce9360700 1 --2- 172.21.15.103:0/3118158593 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7cc404d8d0 0x7f7cc404fd90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7ce4142560 tx=0x7f7ce0008c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:36.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.396+0000 7f7ce9360700 1 --2- 172.21.15.103:0/3118158593 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7cc404d8d0 0x7f7cc404fd90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7ce4142560 tx=0x7f7ce0008c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:36.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.396+0000 7f7ce9360700 1 --2- 172.21.15.103:0/3118158593 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7cc404d8d0 0x7f7cc404fd90 secure :-1 s=READY pgs=189 cs=0 l=1 rx=0x7f7ce4142560 tx=0x7f7ce0008c70).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:36.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.399+0000 7f7ce9b61700 1 --2- 172.21.15.103:0/3118158593 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ce4067170 0x7f7ce4157750 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f7cd4002f30 tx=0x7f7cd4010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:36.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.399+0000 7f7cd2ffd700 1 -- 172.21.15.103:0/3118158593 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f7cd403cdf0 con 0x7f7ce4067170 2020-04-22T14:05:36.591 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.588+0000 7f7cebdc5700 1 -- 172.21.15.103:0/3118158593 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ce4153a50 con 0x7f7ce4067170 2020-04-22T14:05:36.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.589+0000 7f7ce9b61700 1 --2- 172.21.15.103:0/3118158593 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ce4067170 0x7f7ce4157750 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f7cd4002f30 tx=0x7f7cd4010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:36.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.589+0000 7f7cd2ffd700 1 -- 172.21.15.103:0/3118158593 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2141 (secure 0 0 0) 0x7f7cd4040410 con 0x7f7ce4067170 2020-04-22T14:05:36.593 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:05:36.593 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4956,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/2333777975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2333777975},{"type":"v1","addr":"172.21.15.86:6835","nonce":2333777975}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:03:38.935462+0000","modified":"2020-04-22T14:03:40.946647+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5050},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5050":{"gid":5050,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/3282872682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3282872682},{"type":"v1","addr":"172.21.15.103:6833","nonce":3282872682}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2020-04-22T14:05:36.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.591+0000 7f7cebdc5700 1 -- 172.21.15.103:0/3118158593 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7cc404d8d0 msgr2=0x7f7cc404fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:36.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.591+0000 7f7cebdc5700 1 --2- 172.21.15.103:0/3118158593 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7cc404d8d0 0x7f7cc404fd90 secure :-1 s=READY pgs=189 cs=0 l=1 rx=0x7f7ce4142560 tx=0x7f7ce0008c70).stop 2020-04-22T14:05:36.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.591+0000 7f7cebdc5700 1 -- 172.21.15.103:0/3118158593 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ce4067170 msgr2=0x7f7ce4157750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:36.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.591+0000 7f7cebdc5700 1 --2- 172.21.15.103:0/3118158593 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ce4067170 0x7f7ce4157750 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7f7cd4002f30 tx=0x7f7cd4010ba0).stop 2020-04-22T14:05:36.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.591+0000 7f7cebdc5700 1 -- 172.21.15.103:0/3118158593 shutdown_connections 2020-04-22T14:05:36.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.591+0000 7f7cebdc5700 1 --2- 172.21.15.103:0/3118158593 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7cc404d8d0 0x7f7cc404fd90 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:36.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.591+0000 7f7cebdc5700 1 --2- 172.21.15.103:0/3118158593 >> v2:172.21.15.86:3300/0 conn(0x7f7ce413c7e0 0x7f7ce40ad3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:36.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.591+0000 7f7cebdc5700 1 --2- 172.21.15.103:0/3118158593 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ce4067170 0x7f7ce4157750 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:36.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.591+0000 7f7cebdc5700 1 -- 172.21.15.103:0/3118158593 >> 172.21.15.103:0/3118158593 conn(0x7f7ce40b9160 msgr2=0x7f7ce40b65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:36.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.591+0000 7f7cebdc5700 1 -- 172.21.15.103:0/3118158593 shutdown_connections 2020-04-22T14:05:36.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.591+0000 7f7cebdc5700 1 -- 172.21.15.103:0/3118158593 wait complete. 2020-04-22T14:05:36.596 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 14 2020-04-22T14:05:36.604 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:36.617 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2020-04-22T14:05:36.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.762+0000 7ff4b27ea700 1 Processor -- start 2020-04-22T14:05:36.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.762+0000 7ff4b27ea700 1 -- start start 2020-04-22T14:05:36.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.763+0000 7ff4b27ea700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff4ac0b4320 0x7ff4ac0b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:36.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.763+0000 7ff4b27ea700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4ac0b4700 0x7ff4ac0b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:36.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.763+0000 7ff4b27ea700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff4ac0b2530 0x7ff4ac0afa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:36.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.763+0000 7ff4b27ea700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4ac0b2a90 con 0x7ff4ac0b2530 2020-04-22T14:05:36.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.763+0000 7ff4b27ea700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4ac0b0e90 con 0x7ff4ac0b4320 2020-04-22T14:05:36.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.763+0000 7ff4b27ea700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac0b1130 con 0x7ff4ac0b4700 2020-04-22T14:05:36.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.763+0000 7ff4abfff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff4ac0b4320 0x7ff4ac0b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:36.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.763+0000 7ff4abfff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff4ac0b4320 0x7ff4ac0b15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49160/0 (socket says 172.21.15.103:49160) 2020-04-22T14:05:36.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.763+0000 7ff4abfff700 1 -- 172.21.15.103:0/2471126983 learned_addr learned my addr 172.21.15.103:0/2471126983 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:05:36.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.763+0000 7ff4b0d87700 1 --2- 172.21.15.103:0/2471126983 >> v2:172.21.15.86:3300/0 conn(0x7ff4ac0b2530 0x7ff4ac0afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:36.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.763+0000 7ff4a3fff700 1 --2- 172.21.15.103:0/2471126983 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4ac0b4700 0x7ff4ac0b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:36.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.764+0000 7ff4abfff700 1 -- 172.21.15.103:0/2471126983 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4ac0b4700 msgr2=0x7ff4ac0b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:36.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.764+0000 7ff4abfff700 1 --2- 172.21.15.103:0/2471126983 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4ac0b4700 0x7ff4ac0b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:36.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.764+0000 7ff4abfff700 1 -- 172.21.15.103:0/2471126983 >> v2:172.21.15.86:3300/0 conn(0x7ff4ac0b2530 msgr2=0x7ff4ac0afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:36.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.764+0000 7ff4abfff700 1 --2- 172.21.15.103:0/2471126983 >> v2:172.21.15.86:3300/0 conn(0x7ff4ac0b2530 0x7ff4ac0afa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:36.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.764+0000 7ff4abfff700 1 -- 172.21.15.103:0/2471126983 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ac0ae500 con 0x7ff4ac0b4320 2020-04-22T14:05:36.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.764+0000 7ff4abfff700 1 --2- 172.21.15.103:0/2471126983 >> v2:172.21.15.103:3300/0 conn(0x7ff4ac0b4320 0x7ff4ac0b15d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff4ac0b1ec0 tx=0x7ff49c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:36.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.764+0000 7ff4abfff700 1 --2- 172.21.15.103:0/2471126983 >> v2:172.21.15.103:3300/0 conn(0x7ff4ac0b4320 0x7ff4ac0b15d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff4ac0b1ec0 tx=0x7ff49c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:36.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.764+0000 7ff4abfff700 1 --2- 172.21.15.103:0/2471126983 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4ac0b4320 0x7ff4ac0b15d0 secure :-1 s=READY pgs=473 cs=0 l=1 rx=0x7ff4ac0b1ec0 tx=0x7ff49c007a40).ready entity=mon.1 client_cookie=3ad0f1df6c2c08bc server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:36.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.764+0000 7ff4abfff700 1 --2- 172.21.15.103:0/2471126983 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4ac0b4320 0x7ff4ac0b15d0 secure :-1 s=THROTTLE_DONE pgs=473 cs=0 l=1 rx=0x7ff4ac0b1ec0 tx=0x7ff49c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:36.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.764+0000 7ff4ab7fe700 1 -- 172.21.15.103:0/2471126983 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff49c0116e0 con 0x7ff4ac0b4320 2020-04-22T14:05:36.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.764+0000 7ff4abfff700 1 --2- 172.21.15.103:0/2471126983 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4ac0b4320 0x7ff4ac0b15d0 secure :-1 s=THROTTLE_DONE pgs=473 cs=0 l=1 rx=0x7ff4ac0b1ec0 tx=0x7ff49c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:36.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.764+0000 7ff4abfff700 1 --2- 172.21.15.103:0/2471126983 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4ac0b4320 0x7ff4ac0b15d0 secure :-1 s=THROTTLE_DONE pgs=473 cs=0 l=1 rx=0x7ff4ac0b1ec0 tx=0x7ff49c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:36.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.764+0000 7ff4ab7fe700 1 -- 172.21.15.103:0/2471126983 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff49c011880 con 0x7ff4ac0b4320 2020-04-22T14:05:36.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.764+0000 7ff4ab7fe700 1 -- 172.21.15.103:0/2471126983 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff49c011ca0 con 0x7ff4ac0b4320 2020-04-22T14:05:36.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.764+0000 7ff4b27ea700 1 -- 172.21.15.103:0/2471126983 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4ac0b4320 msgr2=0x7ff4ac0b15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:36.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.764+0000 7ff4b27ea700 1 --2- 172.21.15.103:0/2471126983 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4ac0b4320 0x7ff4ac0b15d0 secure :-1 s=READY pgs=473 cs=0 l=1 rx=0x7ff4ac0b1ec0 tx=0x7ff49c007a40).stop 2020-04-22T14:05:36.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.764+0000 7ff4b27ea700 1 -- 172.21.15.103:0/2471126983 shutdown_connections 2020-04-22T14:05:36.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.764+0000 7ff4b27ea700 1 --2- 172.21.15.103:0/2471126983 >> v2:172.21.15.86:3300/0 conn(0x7ff4ac0b2530 0x7ff4ac0afa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:36.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.764+0000 7ff4b27ea700 1 --2- 172.21.15.103:0/2471126983 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4ac0b4320 0x7ff4ac0b15d0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:36.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.764+0000 7ff4b27ea700 1 --2- 172.21.15.103:0/2471126983 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4ac0b4700 0x7ff4ac0b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:36.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.764+0000 7ff4b27ea700 1 -- 172.21.15.103:0/2471126983 >> 172.21.15.103:0/2471126983 conn(0x7ff4ac0b86b0 msgr2=0x7ff4ac0b8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:36.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.764+0000 7ff4b27ea700 1 -- 172.21.15.103:0/2471126983 shutdown_connections 2020-04-22T14:05:36.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.764+0000 7ff4b27ea700 1 -- 172.21.15.103:0/2471126983 wait complete. 2020-04-22T14:05:36.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.765+0000 7ff4b27ea700 1 Processor -- start 2020-04-22T14:05:36.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.765+0000 7ff4b27ea700 1 -- start start 2020-04-22T14:05:36.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.766+0000 7ff4b27ea700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff4ac0b4320 0x7ff4ac0b7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:36.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.766+0000 7ff4b27ea700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff4ac0b4700 0x7ff4ac13c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:36.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.766+0000 7ff4b27ea700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4ac065600 con 0x7ff4ac0b2530 2020-04-22T14:05:36.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.766+0000 7ff4b27ea700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4ac0b7f10 con 0x7ff4ac0b4700 2020-04-22T14:05:36.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.766+0000 7ff4b27ea700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4ac144780 con 0x7ff4ac0b4320 2020-04-22T14:05:36.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.766+0000 7ff4abfff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff4ac0b2530 0x7ff4ac144070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41356/0 (socket says 172.21.15.103:41356) 2020-04-22T14:05:36.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.766+0000 7ff4abfff700 1 -- 172.21.15.103:0/182257457 learned_addr learned my addr 172.21.15.103:0/182257457 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:36.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.766+0000 7ff4a3fff700 1 --2- 172.21.15.103:0/182257457 >> v2:172.21.15.103:3300/0 conn(0x7ff4ac0b4320 0x7ff4ac0b7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:36.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.766+0000 7ff4b0d87700 1 --2- 172.21.15.103:0/182257457 >> v2:172.21.15.86:3300/0 conn(0x7ff4ac0b4700 0x7ff4ac13c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:36.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.766+0000 7ff4a9ffb700 1 -- 172.21.15.103:0/182257457 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2708861074 0 0) 0x7ff4ac065600 con 0x7ff4ac0b2530 2020-04-22T14:05:36.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.766+0000 7ff4a9ffb700 1 -- 172.21.15.103:0/182257457 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff490002fe0 con 0x7ff4ac0b2530 2020-04-22T14:05:36.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.766+0000 7ff4a3fff700 1 -- 172.21.15.103:0/182257457 >> v2:172.21.15.86:3300/0 conn(0x7ff4ac0b4700 msgr2=0x7ff4ac13c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:36.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.766+0000 7ff4a3fff700 1 --2- 172.21.15.103:0/182257457 >> v2:172.21.15.86:3300/0 conn(0x7ff4ac0b4700 0x7ff4ac13c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:36.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.766+0000 7ff4a3fff700 1 -- 172.21.15.103:0/182257457 >> v1:172.21.15.103:6789/0 conn(0x7ff4ac0b2530 legacy=0x7ff4ac144070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:36.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.766+0000 7ff4a3fff700 1 -- 172.21.15.103:0/182257457 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ac065830 con 0x7ff4ac0b4320 2020-04-22T14:05:36.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.766+0000 7ff4b0d87700 1 --2- 172.21.15.103:0/182257457 >> v2:172.21.15.86:3300/0 conn(0x7ff4ac0b4700 0x7ff4ac13c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:05:36.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.767+0000 7ff4a3fff700 1 --2- 172.21.15.103:0/182257457 >> v2:172.21.15.103:3300/0 conn(0x7ff4ac0b4320 0x7ff4ac0b7ab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff494002f30 tx=0x7ff494010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:36.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.767+0000 7ff4a3fff700 1 --2- 172.21.15.103:0/182257457 >> v2:172.21.15.103:3300/0 conn(0x7ff4ac0b4320 0x7ff4ac0b7ab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff494002f30 tx=0x7ff494010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:36.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.767+0000 7ff4a3fff700 1 --2- 172.21.15.103:0/182257457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4ac0b4320 0x7ff4ac0b7ab0 secure :-1 s=READY pgs=475 cs=0 l=1 rx=0x7ff494002f30 tx=0x7ff494010b60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:36.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.767+0000 7ff4a3fff700 1 --2- 172.21.15.103:0/182257457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4ac0b4320 0x7ff4ac0b7ab0 secure :-1 s=THROTTLE_DONE pgs=475 cs=0 l=1 rx=0x7ff494002f30 tx=0x7ff494010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:36.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.767+0000 7ff4a9ffb700 1 -- 172.21.15.103:0/182257457 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff494005ca0 con 0x7ff4ac0b4320 2020-04-22T14:05:36.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.767+0000 7ff4a3fff700 1 --2- 172.21.15.103:0/182257457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4ac0b4320 0x7ff4ac0b7ab0 secure :-1 s=THROTTLE_DONE pgs=475 cs=0 l=1 rx=0x7ff494002f30 tx=0x7ff494010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:36.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.767+0000 7ff4a9ffb700 1 -- 172.21.15.103:0/182257457 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff494005e00 con 0x7ff4ac0b4320 2020-04-22T14:05:36.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.767+0000 7ff4a3fff700 1 --2- 172.21.15.103:0/182257457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4ac0b4320 0x7ff4ac0b7ab0 secure :-1 s=THROTTLE_DONE pgs=475 cs=0 l=1 rx=0x7ff494002f30 tx=0x7ff494010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:36.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.767+0000 7ff4b27ea700 1 -- 172.21.15.103:0/182257457 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4ac142fd0 con 0x7ff4ac0b4320 2020-04-22T14:05:36.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.767+0000 7ff4a9ffb700 1 -- 172.21.15.103:0/182257457 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff494007370 con 0x7ff4ac0b4320 2020-04-22T14:05:36.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.767+0000 7ff4b27ea700 1 -- 172.21.15.103:0/182257457 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4ac141850 con 0x7ff4ac0b4320 2020-04-22T14:05:36.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.767+0000 7ff4a3fff700 1 --2- 172.21.15.103:0/182257457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4ac0b4320 0x7ff4ac0b7ab0 secure :-1 s=THROTTLE_DONE pgs=475 cs=0 l=1 rx=0x7ff494002f30 tx=0x7ff494010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:36.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.768+0000 7ff4b27ea700 1 -- 172.21.15.103:0/182257457 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4ac064eb0 con 0x7ff4ac0b4320 2020-04-22T14:05:36.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.768+0000 7ff4a9ffb700 1 -- 172.21.15.103:0/182257457 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ff49400e240 con 0x7ff4ac0b4320 2020-04-22T14:05:36.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.768+0000 7ff4a3fff700 1 --2- 172.21.15.103:0/182257457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4ac0b4320 0x7ff4ac0b7ab0 secure :-1 s=THROTTLE_DONE pgs=475 cs=0 l=1 rx=0x7ff494002f30 tx=0x7ff494010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:36.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.768+0000 7ff4a9ffb700 1 --2- 172.21.15.103:0/182257457 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff49004dc90 0x7ff490050150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:36.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.768+0000 7ff4a9ffb700 1 -- 172.21.15.103:0/182257457 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff494061560 con 0x7ff4ac0b4320 2020-04-22T14:05:36.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.768+0000 7ff4abfff700 1 --2- 172.21.15.103:0/182257457 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff49004dc90 0x7ff490050150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:36.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.769+0000 7ff4abfff700 1 --2- 172.21.15.103:0/182257457 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff49004dc90 0x7ff490050150 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff49c002f30 tx=0x7ff49c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:36.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.769+0000 7ff4abfff700 1 --2- 172.21.15.103:0/182257457 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff49004dc90 0x7ff490050150 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff49c002f30 tx=0x7ff49c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:36.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.769+0000 7ff4abfff700 1 --2- 172.21.15.103:0/182257457 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff49004dc90 0x7ff490050150 secure :-1 s=READY pgs=190 cs=0 l=1 rx=0x7ff49c002f30 tx=0x7ff49c007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:36.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.773+0000 7ff4a3fff700 1 --2- 172.21.15.103:0/182257457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4ac0b4320 0x7ff4ac0b7ab0 secure :-1 s=THROTTLE_DONE pgs=475 cs=0 l=1 rx=0x7ff494002f30 tx=0x7ff494010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:36.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.773+0000 7ff4a9ffb700 1 -- 172.21.15.103:0/182257457 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ff49403c8e0 con 0x7ff4ac0b4320 2020-04-22T14:05:36.964 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:36.962+0000 7ff4b27ea700 1 -- 172.21.15.103:0/182257457 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff4ac056c90 con 0x7ff4ac0b4320 2020-04-22T14:05:37.503 INFO:tasks.ceph.mon.b.smithi086.stderr:2020-04-22T14:05:37.501+0000 7fbdbf880700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-04-22T14:05:37.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.504+0000 7ff4a3fff700 1 --2- 172.21.15.103:0/182257457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4ac0b4320 0x7ff4ac0b7ab0 secure :-1 s=THROTTLE_DONE pgs=475 cs=0 l=1 rx=0x7ff494002f30 tx=0x7ff494010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:37.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.504+0000 7ff4a9ffb700 1 -- 172.21.15.103:0/182257457 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v15) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff49403ff00 con 0x7ff4ac0b4320 2020-04-22T14:05:37.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.505+0000 7ff4b27ea700 1 -- 172.21.15.103:0/182257457 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff49004dc90 msgr2=0x7ff490050150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:37.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.505+0000 7ff4b27ea700 1 --2- 172.21.15.103:0/182257457 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff49004dc90 0x7ff490050150 secure :-1 s=READY pgs=190 cs=0 l=1 rx=0x7ff49c002f30 tx=0x7ff49c007a40).stop 2020-04-22T14:05:37.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.505+0000 7ff4b27ea700 1 -- 172.21.15.103:0/182257457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4ac0b4320 msgr2=0x7ff4ac0b7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:37.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.505+0000 7ff4b27ea700 1 --2- 172.21.15.103:0/182257457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4ac0b4320 0x7ff4ac0b7ab0 secure :-1 s=READY pgs=475 cs=0 l=1 rx=0x7ff494002f30 tx=0x7ff494010b60).stop 2020-04-22T14:05:37.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.506+0000 7ff4b27ea700 1 -- 172.21.15.103:0/182257457 shutdown_connections 2020-04-22T14:05:37.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.506+0000 7ff4b27ea700 1 --2- 172.21.15.103:0/182257457 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff49004dc90 0x7ff490050150 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:37.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.506+0000 7ff4b27ea700 1 --2- 172.21.15.103:0/182257457 >> v2:172.21.15.86:3300/0 conn(0x7ff4ac0b4700 0x7ff4ac13c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:37.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.506+0000 7ff4b27ea700 1 --2- 172.21.15.103:0/182257457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4ac0b4320 0x7ff4ac0b7ab0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:37.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.506+0000 7ff4b27ea700 1 -- 172.21.15.103:0/182257457 >> 172.21.15.103:0/182257457 conn(0x7ff4ac0b86b0 msgr2=0x7ff4ac13d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:37.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.506+0000 7ff4b27ea700 1 -- 172.21.15.103:0/182257457 shutdown_connections 2020-04-22T14:05:37.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.506+0000 7ff4b27ea700 1 -- 172.21.15.103:0/182257457 wait complete. 2020-04-22T14:05:37.510 INFO:teuthology.orchestra.run.smithi103.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2020-04-22T14:05:37.520 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:37.530 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2020-04-22T14:05:37.535 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:05:37.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.686+0000 7ff3792e8700 1 Processor -- start 2020-04-22T14:05:37.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.686+0000 7ff3792e8700 1 -- start start 2020-04-22T14:05:37.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.686+0000 7ff3792e8700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff3740620a0 0x7ff374142e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:37.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.686+0000 7ff3792e8700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff374143280 0x7ff374146ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:37.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.686+0000 7ff3792e8700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff374143810 con 0x7ff374146f30 2020-04-22T14:05:37.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.686+0000 7ff3792e8700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3741473c0 con 0x7ff3740620a0 2020-04-22T14:05:37.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.686+0000 7ff3792e8700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff374143ab0 con 0x7ff374143280 2020-04-22T14:05:37.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.687+0000 7ff3737fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff374143280 0x7ff374146ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:37.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.687+0000 7ff378ae7700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff374146f30 0x7ff374063a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41376/0 (socket says 172.21.15.103:41376) 2020-04-22T14:05:37.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.687+0000 7ff378ae7700 1 -- 172.21.15.103:0/3325294203 learned_addr learned my addr 172.21.15.103:0/3325294203 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:37.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.687+0000 7ff373fff700 1 --2- 172.21.15.103:0/3325294203 >> v2:172.21.15.86:3300/0 conn(0x7ff3740620a0 0x7ff374142e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:37.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.687+0000 7ff3737fe700 1 -- 172.21.15.103:0/3325294203 >> v2:172.21.15.86:3300/0 conn(0x7ff3740620a0 msgr2=0x7ff374142e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:37.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.687+0000 7ff3737fe700 1 --2- 172.21.15.103:0/3325294203 >> v2:172.21.15.86:3300/0 conn(0x7ff3740620a0 0x7ff374142e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:37.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.687+0000 7ff3737fe700 1 -- 172.21.15.103:0/3325294203 >> v1:172.21.15.103:6789/0 conn(0x7ff374146f30 legacy=0x7ff374063a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:37.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.687+0000 7ff372ffd700 1 -- 172.21.15.103:0/3325294203 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1449797440 0 0) 0x7ff374143810 con 0x7ff374146f30 2020-04-22T14:05:37.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.687+0000 7ff3737fe700 1 -- 172.21.15.103:0/3325294203 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff374143d50 con 0x7ff374143280 2020-04-22T14:05:37.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.687+0000 7ff3737fe700 1 --2- 172.21.15.103:0/3325294203 >> v2:172.21.15.103:3300/0 conn(0x7ff374143280 0x7ff374146ad0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff368002f30 tx=0x7ff368007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:37.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.687+0000 7ff3737fe700 1 --2- 172.21.15.103:0/3325294203 >> v2:172.21.15.103:3300/0 conn(0x7ff374143280 0x7ff374146ad0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff368002f30 tx=0x7ff368007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:37.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.687+0000 7ff3737fe700 1 --2- 172.21.15.103:0/3325294203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff374143280 0x7ff374146ad0 secure :-1 s=READY pgs=480 cs=0 l=1 rx=0x7ff368002f30 tx=0x7ff368007a40).ready entity=mon.1 client_cookie=69b3347141a4b054 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:37.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.687+0000 7ff3737fe700 1 --2- 172.21.15.103:0/3325294203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff374143280 0x7ff374146ad0 secure :-1 s=THROTTLE_DONE pgs=480 cs=0 l=1 rx=0x7ff368002f30 tx=0x7ff368007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:37.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.687+0000 7ff372ffd700 1 -- 172.21.15.103:0/3325294203 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff368008d00 con 0x7ff374143280 2020-04-22T14:05:37.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.687+0000 7ff3737fe700 1 --2- 172.21.15.103:0/3325294203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff374143280 0x7ff374146ad0 secure :-1 s=THROTTLE_DONE pgs=480 cs=0 l=1 rx=0x7ff368002f30 tx=0x7ff368007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:37.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.687+0000 7ff372ffd700 1 -- 172.21.15.103:0/3325294203 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff368008e60 con 0x7ff374143280 2020-04-22T14:05:37.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.687+0000 7ff3737fe700 1 --2- 172.21.15.103:0/3325294203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff374143280 0x7ff374146ad0 secure :-1 s=THROTTLE_DONE pgs=480 cs=0 l=1 rx=0x7ff368002f30 tx=0x7ff368007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:37.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.687+0000 7ff372ffd700 1 -- 172.21.15.103:0/3325294203 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3680108f0 con 0x7ff374143280 2020-04-22T14:05:37.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.687+0000 7ff3792e8700 1 -- 172.21.15.103:0/3325294203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff374143280 msgr2=0x7ff374146ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:37.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.687+0000 7ff3792e8700 1 --2- 172.21.15.103:0/3325294203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff374143280 0x7ff374146ad0 secure :-1 s=READY pgs=480 cs=0 l=1 rx=0x7ff368002f30 tx=0x7ff368007a40).stop 2020-04-22T14:05:37.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.688+0000 7ff3792e8700 1 -- 172.21.15.103:0/3325294203 shutdown_connections 2020-04-22T14:05:37.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.688+0000 7ff3792e8700 1 --2- 172.21.15.103:0/3325294203 >> v2:172.21.15.86:3300/0 conn(0x7ff3740620a0 0x7ff374142e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:37.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.688+0000 7ff3792e8700 1 --2- 172.21.15.103:0/3325294203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff374143280 0x7ff374146ad0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:37.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.688+0000 7ff3792e8700 1 -- 172.21.15.103:0/3325294203 >> 172.21.15.103:0/3325294203 conn(0x7ff37405b7c0 msgr2=0x7ff374061610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:37.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.688+0000 7ff3792e8700 1 -- 172.21.15.103:0/3325294203 shutdown_connections 2020-04-22T14:05:37.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.688+0000 7ff3792e8700 1 -- 172.21.15.103:0/3325294203 wait complete. 2020-04-22T14:05:37.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.689+0000 7ff3792e8700 1 Processor -- start 2020-04-22T14:05:37.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.689+0000 7ff3792e8700 1 -- start start 2020-04-22T14:05:37.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.690+0000 7ff3792e8700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff374146f30 0x7ff374141a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:37.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.690+0000 7ff3792e8700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff374141ea0 con 0x7ff3740620a0 2020-04-22T14:05:37.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.690+0000 7ff3792e8700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3740ae540 con 0x7ff374143280 2020-04-22T14:05:37.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.690+0000 7ff3792e8700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3740b16d0 con 0x7ff374146f30 2020-04-22T14:05:37.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.690+0000 7ff378ae7700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff374146f30 0x7ff374141a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:37.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.690+0000 7ff3737fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff374143280 0x7ff37413c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41384/0 (socket says 172.21.15.103:41384) 2020-04-22T14:05:37.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.690+0000 7ff3737fe700 1 -- 172.21.15.103:0/2253733744 learned_addr learned my addr 172.21.15.103:0/2253733744 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:37.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.690+0000 7ff3717fa700 1 -- 172.21.15.103:0/2253733744 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3056324902 0 0) 0x7ff3740ae540 con 0x7ff374143280 2020-04-22T14:05:37.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.690+0000 7ff3717fa700 1 -- 172.21.15.103:0/2253733744 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff354002fe0 con 0x7ff374143280 2020-04-22T14:05:37.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.690+0000 7ff378ae7700 1 -- 172.21.15.103:0/2253733744 >> v1:172.21.15.103:6789/0 conn(0x7ff374143280 legacy=0x7ff37413c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:37.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.690+0000 7ff378ae7700 1 -- 172.21.15.103:0/2253733744 >> v1:172.21.15.86:6789/0 conn(0x7ff3740620a0 legacy=0x7ff3740b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:37.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.690+0000 7ff378ae7700 1 -- 172.21.15.103:0/2253733744 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3740ae7e0 con 0x7ff374146f30 2020-04-22T14:05:37.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.690+0000 7ff378ae7700 1 --2- 172.21.15.103:0/2253733744 >> v2:172.21.15.103:3300/0 conn(0x7ff374146f30 0x7ff374141a40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff36c001210 tx=0x7ff36c010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:37.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.690+0000 7ff378ae7700 1 --2- 172.21.15.103:0/2253733744 >> v2:172.21.15.103:3300/0 conn(0x7ff374146f30 0x7ff374141a40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff36c001210 tx=0x7ff36c010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:37.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.690+0000 7ff378ae7700 1 --2- 172.21.15.103:0/2253733744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff374146f30 0x7ff374141a40 secure :-1 s=READY pgs=482 cs=0 l=1 rx=0x7ff36c001210 tx=0x7ff36c010c20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:37.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.690+0000 7ff378ae7700 1 --2- 172.21.15.103:0/2253733744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff374146f30 0x7ff374141a40 secure :-1 s=THROTTLE_DONE pgs=482 cs=0 l=1 rx=0x7ff36c001210 tx=0x7ff36c010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:37.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.690+0000 7ff3717fa700 1 -- 172.21.15.103:0/2253733744 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff36c005e30 con 0x7ff374146f30 2020-04-22T14:05:37.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.690+0000 7ff378ae7700 1 --2- 172.21.15.103:0/2253733744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff374146f30 0x7ff374141a40 secure :-1 s=THROTTLE_DONE pgs=482 cs=0 l=1 rx=0x7ff36c001210 tx=0x7ff36c010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:37.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.690+0000 7ff378ae7700 1 --2- 172.21.15.103:0/2253733744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff374146f30 0x7ff374141a40 secure :-1 s=THROTTLE_DONE pgs=482 cs=0 l=1 rx=0x7ff36c001210 tx=0x7ff36c010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:37.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.690+0000 7ff3717fa700 1 -- 172.21.15.103:0/2253733744 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36c0124b0 con 0x7ff374146f30 2020-04-22T14:05:37.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.690+0000 7ff3717fa700 1 -- 172.21.15.103:0/2253733744 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff36c012890 con 0x7ff374146f30 2020-04-22T14:05:37.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.690+0000 7ff3792e8700 1 -- 172.21.15.103:0/2253733744 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3740aea80 con 0x7ff374146f30 2020-04-22T14:05:37.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.690+0000 7ff3792e8700 1 -- 172.21.15.103:0/2253733744 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff37413c710 con 0x7ff374146f30 2020-04-22T14:05:37.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.691+0000 7ff378ae7700 1 --2- 172.21.15.103:0/2253733744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff374146f30 0x7ff374141a40 secure :-1 s=THROTTLE_DONE pgs=482 cs=0 l=1 rx=0x7ff36c001210 tx=0x7ff36c010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:37.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.691+0000 7ff3792e8700 1 -- 172.21.15.103:0/2253733744 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff374056c90 con 0x7ff374146f30 2020-04-22T14:05:37.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.691+0000 7ff3717fa700 1 -- 172.21.15.103:0/2253733744 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ff36c012b00 con 0x7ff374146f30 2020-04-22T14:05:37.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.691+0000 7ff378ae7700 1 --2- 172.21.15.103:0/2253733744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff374146f30 0x7ff374141a40 secure :-1 s=THROTTLE_DONE pgs=482 cs=0 l=1 rx=0x7ff36c001210 tx=0x7ff36c010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:37.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.692+0000 7ff3717fa700 1 --2- 172.21.15.103:0/2253733744 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff35404dcc0 0x7ff354050180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:37.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.692+0000 7ff3717fa700 1 -- 172.21.15.103:0/2253733744 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6159+0+0 (secure 0 0 0) 0x7ff36c0090c0 con 0x7ff374146f30 2020-04-22T14:05:37.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.692+0000 7ff373fff700 1 --2- 172.21.15.103:0/2253733744 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff35404dcc0 0x7ff354050180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:37.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.692+0000 7ff373fff700 1 --2- 172.21.15.103:0/2253733744 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff35404dcc0 0x7ff354050180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff374145c10 tx=0x7ff3640022f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:37.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.692+0000 7ff373fff700 1 --2- 172.21.15.103:0/2253733744 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff35404dcc0 0x7ff354050180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff374145c10 tx=0x7ff3640022f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:37.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.692+0000 7ff373fff700 1 --2- 172.21.15.103:0/2253733744 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff35404dcc0 0x7ff354050180 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7ff374145c10 tx=0x7ff3640022f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:37.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.696+0000 7ff378ae7700 1 --2- 172.21.15.103:0/2253733744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff374146f30 0x7ff374141a40 secure :-1 s=THROTTLE_DONE pgs=482 cs=0 l=1 rx=0x7ff36c001210 tx=0x7ff36c010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:37.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.696+0000 7ff3717fa700 1 -- 172.21.15.103:0/2253733744 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ff36c03cf00 con 0x7ff374146f30 2020-04-22T14:05:37.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.884+0000 7ff3792e8700 1 -- 172.21.15.103:0/2253733744 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff374066790 con 0x7ff374146f30 2020-04-22T14:05:37.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.885+0000 7ff378ae7700 1 --2- 172.21.15.103:0/2253733744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff374146f30 0x7ff374141a40 secure :-1 s=THROTTLE_DONE pgs=482 cs=0 l=1 rx=0x7ff36c001210 tx=0x7ff36c010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:37.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.885+0000 7ff3717fa700 1 -- 172.21.15.103:0/2253733744 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+1777 (secure 0 0 0) 0x7ff36c040520 con 0x7ff374146f30 2020-04-22T14:05:37.887 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:05:37.887 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4956,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/2333777975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2333777975},{"type":"v1","addr":"172.21.15.86:6835","nonce":2333777975}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:03:38.935462+0000","modified":"2020-04-22T14:05:37.501528+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2020-04-22T14:05:37.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.886+0000 7ff3792e8700 1 -- 172.21.15.103:0/2253733744 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff35404dcc0 msgr2=0x7ff354050180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:37.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.886+0000 7ff3792e8700 1 --2- 172.21.15.103:0/2253733744 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff35404dcc0 0x7ff354050180 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7ff374145c10 tx=0x7ff3640022f0).stop 2020-04-22T14:05:37.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.886+0000 7ff3792e8700 1 -- 172.21.15.103:0/2253733744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff374146f30 msgr2=0x7ff374141a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:37.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.886+0000 7ff3792e8700 1 --2- 172.21.15.103:0/2253733744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff374146f30 0x7ff374141a40 secure :-1 s=READY pgs=482 cs=0 l=1 rx=0x7ff36c001210 tx=0x7ff36c010c20).stop 2020-04-22T14:05:37.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.886+0000 7ff3792e8700 1 -- 172.21.15.103:0/2253733744 shutdown_connections 2020-04-22T14:05:37.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.886+0000 7ff3792e8700 1 --2- 172.21.15.103:0/2253733744 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff35404dcc0 0x7ff354050180 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:37.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.886+0000 7ff3792e8700 1 --2- 172.21.15.103:0/2253733744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff374146f30 0x7ff374141a40 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:37.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.886+0000 7ff3792e8700 1 -- 172.21.15.103:0/2253733744 >> 172.21.15.103:0/2253733744 conn(0x7ff37405b7c0 msgr2=0x7ff374064d80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:37.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.886+0000 7ff3792e8700 1 -- 172.21.15.103:0/2253733744 shutdown_connections 2020-04-22T14:05:37.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:37.886+0000 7ff3792e8700 1 -- 172.21.15.103:0/2253733744 wait complete. 2020-04-22T14:05:37.890 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 15 2020-04-22T14:05:37.899 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:37.912 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-04-22T14:05:38.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.058+0000 7f042e318700 1 Processor -- start 2020-04-22T14:05:38.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.058+0000 7f042e318700 1 -- start start 2020-04-22T14:05:38.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.058+0000 7f042e318700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f04280b9140 0x7f042812b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:38.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.058+0000 7f042e318700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f04280ac950 0x7f042812b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:38.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.058+0000 7f042e318700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0428146c40 0x7f04281470f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:38.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.058+0000 7f042e318700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04280602f0 con 0x7f0428146c40 2020-04-22T14:05:38.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.058+0000 7f042e318700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04281467e0 con 0x7f04280b9140 2020-04-22T14:05:38.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.058+0000 7f042e318700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0428060050 con 0x7f04280ac950 2020-04-22T14:05:38.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.059+0000 7f0427fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f04280b9140 0x7f042812b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:38.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.059+0000 7f0427fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f04280b9140 0x7f042812b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49200/0 (socket says 172.21.15.103:49200) 2020-04-22T14:05:38.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.059+0000 7f0427fff700 1 -- 172.21.15.103:0/1722962396 learned_addr learned my addr 172.21.15.103:0/1722962396 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:05:38.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.059+0000 7f04277fe700 1 --2- 172.21.15.103:0/1722962396 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f04280ac950 0x7f042812b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:38.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.059+0000 7f042c8b5700 1 --2- 172.21.15.103:0/1722962396 >> v2:172.21.15.86:3300/0 conn(0x7f0428146c40 0x7f04281470f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:38.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.059+0000 7f0427fff700 1 -- 172.21.15.103:0/1722962396 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f04280ac950 msgr2=0x7f042812b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:38.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.059+0000 7f0427fff700 1 --2- 172.21.15.103:0/1722962396 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f04280ac950 0x7f042812b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:38.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.059+0000 7f0427fff700 1 -- 172.21.15.103:0/1722962396 >> v2:172.21.15.86:3300/0 conn(0x7f0428146c40 msgr2=0x7f04281470f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:38.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.059+0000 7f0427fff700 1 --2- 172.21.15.103:0/1722962396 >> v2:172.21.15.86:3300/0 conn(0x7f0428146c40 0x7f04281470f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:38.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.059+0000 7f0427fff700 1 -- 172.21.15.103:0/1722962396 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04280b9520 con 0x7f04280b9140 2020-04-22T14:05:38.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.059+0000 7f04277fe700 1 --2- 172.21.15.103:0/1722962396 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f04280ac950 0x7f042812b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:05:38.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.059+0000 7f042c8b5700 1 --2- 172.21.15.103:0/1722962396 >> v2:172.21.15.86:3300/0 conn(0x7f0428146c40 0x7f04281470f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:05:38.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.059+0000 7f0427fff700 1 --2- 172.21.15.103:0/1722962396 >> v2:172.21.15.103:3300/0 conn(0x7f04280b9140 0x7f042812b210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0418002f30 tx=0x7f0418007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:38.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.059+0000 7f0427fff700 1 --2- 172.21.15.103:0/1722962396 >> v2:172.21.15.103:3300/0 conn(0x7f04280b9140 0x7f042812b210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0418002f30 tx=0x7f0418007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:38.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.059+0000 7f0427fff700 1 --2- 172.21.15.103:0/1722962396 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04280b9140 0x7f042812b210 secure :-1 s=READY pgs=483 cs=0 l=1 rx=0x7f0418002f30 tx=0x7f0418007a40).ready entity=mon.1 client_cookie=27ea5bd176bb6b4d server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:38.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.059+0000 7f0427fff700 1 --2- 172.21.15.103:0/1722962396 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04280b9140 0x7f042812b210 secure :-1 s=THROTTLE_DONE pgs=483 cs=0 l=1 rx=0x7f0418002f30 tx=0x7f0418007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:38.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.059+0000 7f0426ffd700 1 -- 172.21.15.103:0/1722962396 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0418011720 con 0x7f04280b9140 2020-04-22T14:05:38.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.059+0000 7f0427fff700 1 --2- 172.21.15.103:0/1722962396 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04280b9140 0x7f042812b210 secure :-1 s=THROTTLE_DONE pgs=483 cs=0 l=1 rx=0x7f0418002f30 tx=0x7f0418007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:38.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.059+0000 7f0426ffd700 1 -- 172.21.15.103:0/1722962396 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0418011880 con 0x7f04280b9140 2020-04-22T14:05:38.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.059+0000 7f0427fff700 1 --2- 172.21.15.103:0/1722962396 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04280b9140 0x7f042812b210 secure :-1 s=THROTTLE_DONE pgs=483 cs=0 l=1 rx=0x7f0418002f30 tx=0x7f0418007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:38.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.059+0000 7f0426ffd700 1 -- 172.21.15.103:0/1722962396 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0418011ca0 con 0x7f04280b9140 2020-04-22T14:05:38.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.059+0000 7f042e318700 1 -- 172.21.15.103:0/1722962396 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04280b9140 msgr2=0x7f042812b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:38.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.059+0000 7f042e318700 1 --2- 172.21.15.103:0/1722962396 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04280b9140 0x7f042812b210 secure :-1 s=READY pgs=483 cs=0 l=1 rx=0x7f0418002f30 tx=0x7f0418007a40).stop 2020-04-22T14:05:38.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.060+0000 7f042e318700 1 -- 172.21.15.103:0/1722962396 shutdown_connections 2020-04-22T14:05:38.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.060+0000 7f042e318700 1 --2- 172.21.15.103:0/1722962396 >> v2:172.21.15.86:3300/0 conn(0x7f0428146c40 0x7f04281470f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:38.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.060+0000 7f042e318700 1 --2- 172.21.15.103:0/1722962396 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04280b9140 0x7f042812b210 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:38.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.060+0000 7f042e318700 1 --2- 172.21.15.103:0/1722962396 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f04280ac950 0x7f042812b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:38.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.060+0000 7f042e318700 1 -- 172.21.15.103:0/1722962396 >> 172.21.15.103:0/1722962396 conn(0x7f042805b7b0 msgr2=0x7f04280b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:38.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.060+0000 7f042e318700 1 -- 172.21.15.103:0/1722962396 shutdown_connections 2020-04-22T14:05:38.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.060+0000 7f042e318700 1 -- 172.21.15.103:0/1722962396 wait complete. 2020-04-22T14:05:38.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.061+0000 7f042e318700 1 Processor -- start 2020-04-22T14:05:38.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.061+0000 7f042e318700 1 -- start start 2020-04-22T14:05:38.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.061+0000 7f042e318700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f04280ac950 0x7f0428064b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:38.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.061+0000 7f042e318700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f04280b9140 0x7f0428147a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:38.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.061+0000 7f042e318700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0428146c40 0x7f0428127a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:38.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.061+0000 7f042e318700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04280b29f0 con 0x7f04280ac950 2020-04-22T14:05:38.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.061+0000 7f042e318700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0428147ee0 con 0x7f04280b9140 2020-04-22T14:05:38.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.061+0000 7f042e318700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0428066880 con 0x7f0428146c40 2020-04-22T14:05:38.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.062+0000 7f04277fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f04280b9140 0x7f0428147a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:38.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.062+0000 7f04277fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f04280b9140 0x7f0428147a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49210/0 (socket says 172.21.15.103:49210) 2020-04-22T14:05:38.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.062+0000 7f04277fe700 1 -- 172.21.15.103:0/3969184982 learned_addr learned my addr 172.21.15.103:0/3969184982 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:05:38.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.062+0000 7f0427fff700 1 --2- 172.21.15.103:0/3969184982 >> v2:172.21.15.86:3300/0 conn(0x7f04280ac950 0x7f0428064b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:38.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.062+0000 7f042c8b5700 1 --2- 172.21.15.103:0/3969184982 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0428146c40 0x7f0428127a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:38.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.062+0000 7f04277fe700 1 -- 172.21.15.103:0/3969184982 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0428146c40 msgr2=0x7f0428127a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:38.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.062+0000 7f04277fe700 1 --2- 172.21.15.103:0/3969184982 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0428146c40 0x7f0428127a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:38.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.062+0000 7f04277fe700 1 -- 172.21.15.103:0/3969184982 >> v2:172.21.15.86:3300/0 conn(0x7f04280ac950 msgr2=0x7f0428064b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:38.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.062+0000 7f04277fe700 1 --2- 172.21.15.103:0/3969184982 >> v2:172.21.15.86:3300/0 conn(0x7f04280ac950 0x7f0428064b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:38.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.062+0000 7f04277fe700 1 -- 172.21.15.103:0/3969184982 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0428064700 con 0x7f04280b9140 2020-04-22T14:05:38.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.062+0000 7f04277fe700 1 --2- 172.21.15.103:0/3969184982 >> v2:172.21.15.103:3300/0 conn(0x7f04280b9140 0x7f0428147a80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f041c002f30 tx=0x7f041c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:38.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.062+0000 7f04277fe700 1 --2- 172.21.15.103:0/3969184982 >> v2:172.21.15.103:3300/0 conn(0x7f04280b9140 0x7f0428147a80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f041c002f30 tx=0x7f041c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:38.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.062+0000 7f04277fe700 1 --2- 172.21.15.103:0/3969184982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04280b9140 0x7f0428147a80 secure :-1 s=READY pgs=484 cs=0 l=1 rx=0x7f041c002f30 tx=0x7f041c010ac0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:38.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.062+0000 7f04277fe700 1 --2- 172.21.15.103:0/3969184982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04280b9140 0x7f0428147a80 secure :-1 s=THROTTLE_DONE pgs=484 cs=0 l=1 rx=0x7f041c002f30 tx=0x7f041c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:38.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.062+0000 7f04257fa700 1 -- 172.21.15.103:0/3969184982 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f041c007180 con 0x7f04280b9140 2020-04-22T14:05:38.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.062+0000 7f04277fe700 1 --2- 172.21.15.103:0/3969184982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04280b9140 0x7f0428147a80 secure :-1 s=THROTTLE_DONE pgs=484 cs=0 l=1 rx=0x7f041c002f30 tx=0x7f041c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:38.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.062+0000 7f04277fe700 1 --2- 172.21.15.103:0/3969184982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04280b9140 0x7f0428147a80 secure :-1 s=THROTTLE_DONE pgs=484 cs=0 l=1 rx=0x7f041c002f30 tx=0x7f041c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:38.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.062+0000 7f04257fa700 1 -- 172.21.15.103:0/3969184982 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041c0072e0 con 0x7f04280b9140 2020-04-22T14:05:38.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.062+0000 7f042e318700 1 -- 172.21.15.103:0/3969184982 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04280663e0 con 0x7f04280b9140 2020-04-22T14:05:38.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.062+0000 7f04257fa700 1 -- 172.21.15.103:0/3969184982 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f041c0059c0 con 0x7f04280b9140 2020-04-22T14:05:38.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.062+0000 7f042e318700 1 -- 172.21.15.103:0/3969184982 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0428127e80 con 0x7f04280b9140 2020-04-22T14:05:38.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.063+0000 7f04277fe700 1 --2- 172.21.15.103:0/3969184982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04280b9140 0x7f0428147a80 secure :-1 s=THROTTLE_DONE pgs=484 cs=0 l=1 rx=0x7f041c002f30 tx=0x7f041c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:38.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.063+0000 7f042e318700 1 -- 172.21.15.103:0/3969184982 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0428066570 con 0x7f04280b9140 2020-04-22T14:05:38.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.063+0000 7f04257fa700 1 -- 172.21.15.103:0/3969184982 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f041c005bf0 con 0x7f04280b9140 2020-04-22T14:05:38.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.063+0000 7f04277fe700 1 --2- 172.21.15.103:0/3969184982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04280b9140 0x7f0428147a80 secure :-1 s=THROTTLE_DONE pgs=484 cs=0 l=1 rx=0x7f041c002f30 tx=0x7f041c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:38.092 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.063+0000 7f04257fa700 1 --2- 172.21.15.103:0/3969184982 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f040804dac0 0x7f040804ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:38.092 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.063+0000 7f04257fa700 1 -- 172.21.15.103:0/3969184982 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f041c061190 con 0x7f04280b9140 2020-04-22T14:05:38.092 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.064+0000 7f0427fff700 1 --2- 172.21.15.103:0/3969184982 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f040804dac0 0x7f040804ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:38.092 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.064+0000 7f0427fff700 1 --2- 172.21.15.103:0/3969184982 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f040804dac0 0x7f040804ff80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0418002f30 tx=0x7f0418007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:38.092 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.064+0000 7f0427fff700 1 --2- 172.21.15.103:0/3969184982 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f040804dac0 0x7f040804ff80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0418002f30 tx=0x7f0418007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:38.092 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.064+0000 7f0427fff700 1 --2- 172.21.15.103:0/3969184982 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f040804dac0 0x7f040804ff80 secure :-1 s=READY pgs=192 cs=0 l=1 rx=0x7f0418002f30 tx=0x7f0418007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:38.092 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.067+0000 7f04277fe700 1 --2- 172.21.15.103:0/3969184982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04280b9140 0x7f0428147a80 secure :-1 s=THROTTLE_DONE pgs=484 cs=0 l=1 rx=0x7f041c002f30 tx=0x7f041c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:38.092 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.067+0000 7f04257fa700 1 -- 172.21.15.103:0/3969184982 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f041c03c510 con 0x7f04280b9140 2020-04-22T14:05:38.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.260+0000 7f042e318700 1 -- 172.21.15.103:0/3969184982 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f04280648c0 con 0x7f04280b9140 2020-04-22T14:05:38.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.509+0000 7f04277fe700 1 --2- 172.21.15.103:0/3969184982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04280b9140 0x7f0428147a80 secure :-1 s=THROTTLE_DONE pgs=484 cs=0 l=1 rx=0x7f041c002f30 tx=0x7f041c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:38.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.509+0000 7f04257fa700 1 -- 172.21.15.103:0/3969184982 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v16) v1 ==== 104+0+0 (secure 0 0 0) 0x7f041c03fb30 con 0x7f04280b9140 2020-04-22T14:05:38.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.511+0000 7f042e318700 1 -- 172.21.15.103:0/3969184982 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f040804dac0 msgr2=0x7f040804ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:38.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.511+0000 7f042e318700 1 --2- 172.21.15.103:0/3969184982 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f040804dac0 0x7f040804ff80 secure :-1 s=READY pgs=192 cs=0 l=1 rx=0x7f0418002f30 tx=0x7f0418007a40).stop 2020-04-22T14:05:38.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.511+0000 7f042e318700 1 -- 172.21.15.103:0/3969184982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04280b9140 msgr2=0x7f0428147a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:38.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.511+0000 7f042e318700 1 --2- 172.21.15.103:0/3969184982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04280b9140 0x7f0428147a80 secure :-1 s=READY pgs=484 cs=0 l=1 rx=0x7f041c002f30 tx=0x7f041c010ac0).stop 2020-04-22T14:05:38.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.511+0000 7f042e318700 1 -- 172.21.15.103:0/3969184982 shutdown_connections 2020-04-22T14:05:38.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.511+0000 7f042e318700 1 --2- 172.21.15.103:0/3969184982 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f040804dac0 0x7f040804ff80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:38.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.511+0000 7f042e318700 1 --2- 172.21.15.103:0/3969184982 >> v2:172.21.15.86:3300/0 conn(0x7f04280ac950 0x7f0428064b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:38.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.511+0000 7f042e318700 1 --2- 172.21.15.103:0/3969184982 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0428146c40 0x7f0428127a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:38.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.511+0000 7f042e318700 1 --2- 172.21.15.103:0/3969184982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04280b9140 0x7f0428147a80 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:38.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.511+0000 7f042e318700 1 -- 172.21.15.103:0/3969184982 >> 172.21.15.103:0/3969184982 conn(0x7f042805b7b0 msgr2=0x7f0428128d90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:38.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.511+0000 7f042e318700 1 -- 172.21.15.103:0/3969184982 shutdown_connections 2020-04-22T14:05:38.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.511+0000 7f042e318700 1 -- 172.21.15.103:0/3969184982 wait complete. 2020-04-22T14:05:38.524 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:38.538 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-04-22T14:05:38.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.687+0000 7f7c3c2ff700 1 Processor -- start 2020-04-22T14:05:38.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.687+0000 7f7c3c2ff700 1 -- start start 2020-04-22T14:05:38.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.688+0000 7f7c3c2ff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7c34145ff0 0x7f7c341464a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:38.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.688+0000 7f7c3c2ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c340b4420 con 0x7f7c340b9670 2020-04-22T14:05:38.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.688+0000 7f7c3c2ff700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c341498e0 con 0x7f7c340b6180 2020-04-22T14:05:38.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.688+0000 7f7c3c2ff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c34149b80 con 0x7f7c34145ff0 2020-04-22T14:05:38.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.688+0000 7f7c3989a700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f7c340b6180 0x7f7c341458e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41406/0 (socket says 172.21.15.103:41406) 2020-04-22T14:05:38.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.688+0000 7f7c3989a700 1 -- 172.21.15.103:0/856078056 learned_addr learned my addr 172.21.15.103:0/856078056 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:38.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.689+0000 7f7c3a89c700 1 --2- 172.21.15.103:0/856078056 >> v2:172.21.15.86:3300/0 conn(0x7f7c34145ff0 0x7f7c341464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:38.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.689+0000 7f7c39099700 1 -- 172.21.15.103:0/856078056 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2186583365 0 0) 0x7f7c341498e0 con 0x7f7c340b6180 2020-04-22T14:05:38.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.689+0000 7f7c39099700 1 -- 172.21.15.103:0/856078056 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c1c003230 con 0x7f7c340b6180 2020-04-22T14:05:38.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.689+0000 7f7c39099700 1 -- 172.21.15.103:0/856078056 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2991362267 0 0) 0x7f7c1c003230 con 0x7f7c340b6180 2020-04-22T14:05:38.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.689+0000 7f7c39099700 1 -- 172.21.15.103:0/856078056 >> v2:172.21.15.86:3300/0 conn(0x7f7c34145ff0 msgr2=0x7f7c341464a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:38.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.689+0000 7f7c39099700 1 --2- 172.21.15.103:0/856078056 >> v2:172.21.15.86:3300/0 conn(0x7f7c34145ff0 0x7f7c341464a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:38.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.689+0000 7f7c39099700 1 -- 172.21.15.103:0/856078056 >> v1:172.21.15.86:6789/0 conn(0x7f7c340b9670 legacy=0x7f7c3414a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:38.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.689+0000 7f7c39099700 1 -- 172.21.15.103:0/856078056 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c340b9a50 con 0x7f7c340b6180 2020-04-22T14:05:38.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.689+0000 7f7c39099700 1 -- 172.21.15.103:0/856078056 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f7c300016d0 con 0x7f7c340b6180 2020-04-22T14:05:38.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.689+0000 7f7c39099700 1 -- 172.21.15.103:0/856078056 >> v1:172.21.15.103:6789/0 conn(0x7f7c340b6180 legacy=0x7f7c341458e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:38.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.689+0000 7f7c39099700 1 --2- 172.21.15.103:0/856078056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c1c003720 0x7f7c1c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:38.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.689+0000 7f7c39099700 1 --2- 172.21.15.103:0/856078056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c1c0044d0 0x7f7c1c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:38.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.689+0000 7f7c39099700 1 --2- 172.21.15.103:0/856078056 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c1c004db0 0x7f7c1c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:38.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.689+0000 7f7c39099700 1 -- 172.21.15.103:0/856078056 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c34149b80 con 0x7f7c1c0044d0 2020-04-22T14:05:38.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.689+0000 7f7c39099700 1 -- 172.21.15.103:0/856078056 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1c0041c0 con 0x7f7c1c003720 2020-04-22T14:05:38.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.689+0000 7f7c39099700 1 -- 172.21.15.103:0/856078056 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1c00bb80 con 0x7f7c1c004db0 2020-04-22T14:05:38.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.689+0000 7f7c3a09b700 1 --2- 172.21.15.103:0/856078056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c1c003720 0x7f7c1c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:38.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.689+0000 7f7c3989a700 1 --2- 172.21.15.103:0/856078056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c1c0044d0 0x7f7c1c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:38.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.689+0000 7f7c3a89c700 1 --2- 172.21.15.103:0/856078056 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c1c004db0 0x7f7c1c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:38.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.689+0000 7f7c3a09b700 1 -- 172.21.15.103:0/856078056 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c1c004db0 msgr2=0x7f7c1c00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:38.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.689+0000 7f7c3a09b700 1 --2- 172.21.15.103:0/856078056 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c1c004db0 0x7f7c1c00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:38.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.689+0000 7f7c3a09b700 1 -- 172.21.15.103:0/856078056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c1c0044d0 msgr2=0x7f7c1c004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:38.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.689+0000 7f7c3a09b700 1 --2- 172.21.15.103:0/856078056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c1c0044d0 0x7f7c1c004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:38.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.689+0000 7f7c3a09b700 1 -- 172.21.15.103:0/856078056 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1c003230 con 0x7f7c1c003720 2020-04-22T14:05:38.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.689+0000 7f7c3a89c700 1 --2- 172.21.15.103:0/856078056 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c1c004db0 0x7f7c1c00b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:05:38.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.689+0000 7f7c3a89c700 1 -- 172.21.15.103:0/856078056 reap_dead start 2020-04-22T14:05:38.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.689+0000 7f7c3a09b700 1 --2- 172.21.15.103:0/856078056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c1c003720 0x7f7c1c003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7c1c0054a0 tx=0x7f7c2800fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:38.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.689+0000 7f7c3a09b700 1 --2- 172.21.15.103:0/856078056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c1c003720 0x7f7c1c003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7c1c0054a0 tx=0x7f7c2800fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:38.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.689+0000 7f7c3a09b700 1 --2- 172.21.15.103:0/856078056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c1c003720 0x7f7c1c003b40 secure :-1 s=READY pgs=486 cs=0 l=1 rx=0x7f7c1c0054a0 tx=0x7f7c2800fd20).ready entity=mon.1 client_cookie=ab1c956b16bbaea3 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:38.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.689+0000 7f7c3a09b700 1 --2- 172.21.15.103:0/856078056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c1c003720 0x7f7c1c003b40 secure :-1 s=THROTTLE_DONE pgs=486 cs=0 l=1 rx=0x7f7c1c0054a0 tx=0x7f7c2800fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:38.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.689+0000 7f7c39099700 1 -- 172.21.15.103:0/856078056 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c28003560 con 0x7f7c1c003720 2020-04-22T14:05:38.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.689+0000 7f7c3a09b700 1 --2- 172.21.15.103:0/856078056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c1c003720 0x7f7c1c003b40 secure :-1 s=THROTTLE_DONE pgs=486 cs=0 l=1 rx=0x7f7c1c0054a0 tx=0x7f7c2800fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:38.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.689+0000 7f7c3a09b700 1 --2- 172.21.15.103:0/856078056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c1c003720 0x7f7c1c003b40 secure :-1 s=THROTTLE_DONE pgs=486 cs=0 l=1 rx=0x7f7c1c0054a0 tx=0x7f7c2800fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:38.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.690+0000 7f7c39099700 1 -- 172.21.15.103:0/856078056 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c280036c0 con 0x7f7c1c003720 2020-04-22T14:05:38.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.690+0000 7f7c39099700 1 -- 172.21.15.103:0/856078056 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c28003aa0 con 0x7f7c1c003720 2020-04-22T14:05:38.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.690+0000 7f7c3c2ff700 1 -- 172.21.15.103:0/856078056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c1c003720 msgr2=0x7f7c1c003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:38.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.690+0000 7f7c3c2ff700 1 --2- 172.21.15.103:0/856078056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c1c003720 0x7f7c1c003b40 secure :-1 s=READY pgs=486 cs=0 l=1 rx=0x7f7c1c0054a0 tx=0x7f7c2800fd20).stop 2020-04-22T14:05:38.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.690+0000 7f7c3c2ff700 1 -- 172.21.15.103:0/856078056 shutdown_connections 2020-04-22T14:05:38.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.690+0000 7f7c3c2ff700 1 --2- 172.21.15.103:0/856078056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c1c003720 0x7f7c1c003b40 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:38.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.690+0000 7f7c3c2ff700 1 -- 172.21.15.103:0/856078056 >> 172.21.15.103:0/856078056 conn(0x7f7c3405ad30 msgr2=0x7f7c3405b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:38.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.690+0000 7f7c3c2ff700 1 -- 172.21.15.103:0/856078056 shutdown_connections 2020-04-22T14:05:38.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.690+0000 7f7c3c2ff700 1 -- 172.21.15.103:0/856078056 wait complete. 2020-04-22T14:05:38.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.691+0000 7f7c3c2ff700 1 Processor -- start 2020-04-22T14:05:38.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.691+0000 7f7c3c2ff700 1 -- start start 2020-04-22T14:05:38.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.692+0000 7f7c3c2ff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c3415c120 0x7f7c3415e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:38.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.692+0000 7f7c3c2ff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c340af650 con 0x7f7c1c003720 2020-04-22T14:05:38.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.692+0000 7f7c3c2ff700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c340af8f0 con 0x7f7c341403d0 2020-04-22T14:05:38.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.692+0000 7f7c3c2ff700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c34140850 con 0x7f7c3415c120 2020-04-22T14:05:38.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.692+0000 7f7c3989a700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f7c341403d0 0x7f7c3413dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41418/0 (socket says 172.21.15.103:41418) 2020-04-22T14:05:38.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.692+0000 7f7c3989a700 1 -- 172.21.15.103:0/797861184 learned_addr learned my addr 172.21.15.103:0/797861184 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:38.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.692+0000 7f7c3a89c700 1 --2- 172.21.15.103:0/797861184 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c3415c120 0x7f7c3415e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:38.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.692+0000 7f7c277fe700 1 -- 172.21.15.103:0/797861184 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3915151300 0 0) 0x7f7c340af8f0 con 0x7f7c341403d0 2020-04-22T14:05:38.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.692+0000 7f7c277fe700 1 -- 172.21.15.103:0/797861184 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c14002fe0 con 0x7f7c341403d0 2020-04-22T14:05:38.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.692+0000 7f7c277fe700 1 -- 172.21.15.103:0/797861184 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1689345600 0 0) 0x7f7c340af650 con 0x7f7c1c003720 2020-04-22T14:05:38.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.692+0000 7f7c277fe700 1 -- 172.21.15.103:0/797861184 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c340af8f0 con 0x7f7c1c003720 2020-04-22T14:05:38.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.692+0000 7f7c277fe700 1 -- 172.21.15.103:0/797861184 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 389994468 0 0) 0x7f7c14002fe0 con 0x7f7c341403d0 2020-04-22T14:05:38.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.692+0000 7f7c277fe700 1 -- 172.21.15.103:0/797861184 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7c340af650 con 0x7f7c341403d0 2020-04-22T14:05:38.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.692+0000 7f7c277fe700 1 -- 172.21.15.103:0/797861184 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f7c300016d0 con 0x7f7c341403d0 2020-04-22T14:05:38.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.692+0000 7f7c277fe700 1 -- 172.21.15.103:0/797861184 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c3415c120 msgr2=0x7f7c3415e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:38.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.692+0000 7f7c277fe700 1 --2- 172.21.15.103:0/797861184 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c3415c120 0x7f7c3415e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:38.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.692+0000 7f7c277fe700 1 -- 172.21.15.103:0/797861184 >> v1:172.21.15.103:6789/0 conn(0x7f7c341403d0 legacy=0x7f7c3413dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:38.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.692+0000 7f7c277fe700 1 -- 172.21.15.103:0/797861184 >> v1:172.21.15.86:6789/0 conn(0x7f7c1c003720 legacy=0x7f7c34143f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:38.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.692+0000 7f7c277fe700 1 --2- 172.21.15.103:0/797861184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c14004b20 0x7f7c14004f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:38.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.692+0000 7f7c277fe700 1 --2- 172.21.15.103:0/797861184 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c14003ab0 0x7f7c14003f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:38.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.692+0000 7f7c277fe700 1 --2- 172.21.15.103:0/797861184 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c14004390 0x7f7c1400b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:38.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.692+0000 7f7c277fe700 1 -- 172.21.15.103:0/797861184 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c34140850 con 0x7f7c14004b20 2020-04-22T14:05:38.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.692+0000 7f7c277fe700 1 -- 172.21.15.103:0/797861184 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c14004900 con 0x7f7c14004390 2020-04-22T14:05:38.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.692+0000 7f7c277fe700 1 -- 172.21.15.103:0/797861184 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1400bbb0 con 0x7f7c14003ab0 2020-04-22T14:05:38.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.692+0000 7f7c3a89c700 1 --2- 172.21.15.103:0/797861184 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c3415c120 0x7f7c3415e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:05:38.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.692+0000 7f7c3a89c700 1 --2- 172.21.15.103:0/797861184 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c14004390 0x7f7c1400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:38.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.692+0000 7f7c3a09b700 1 --2- 172.21.15.103:0/797861184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c14004b20 0x7f7c14004f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:38.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.692+0000 7f7c3989a700 1 --2- 172.21.15.103:0/797861184 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c14003ab0 0x7f7c14003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:38.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.693+0000 7f7c3a89c700 1 -- 172.21.15.103:0/797861184 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c14003ab0 msgr2=0x7f7c14003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:38.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.693+0000 7f7c3a89c700 1 --2- 172.21.15.103:0/797861184 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c14003ab0 0x7f7c14003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:38.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.693+0000 7f7c3a89c700 1 -- 172.21.15.103:0/797861184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c14004b20 msgr2=0x7f7c14004f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:38.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.693+0000 7f7c3a89c700 1 --2- 172.21.15.103:0/797861184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c14004b20 0x7f7c14004f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:38.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.693+0000 7f7c3a89c700 1 -- 172.21.15.103:0/797861184 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c340afb90 con 0x7f7c14004390 2020-04-22T14:05:38.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.693+0000 7f7c3c2ff700 1 -- 172.21.15.103:0/797861184 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c340af340 con 0x7f7c14004390 2020-04-22T14:05:38.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.693+0000 7f7c3a89c700 1 --2- 172.21.15.103:0/797861184 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c14004390 0x7f7c1400b750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7c300014a0 tx=0x7f7c2c010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:38.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.693+0000 7f7c3c2ff700 1 -- 172.21.15.103:0/797861184 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c3413e340 con 0x7f7c14004390 2020-04-22T14:05:38.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.693+0000 7f7c3a89c700 1 --2- 172.21.15.103:0/797861184 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c14004390 0x7f7c1400b750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7c300014a0 tx=0x7f7c2c010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:38.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.693+0000 7f7c3a89c700 1 --2- 172.21.15.103:0/797861184 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c14004390 0x7f7c1400b750 secure :-1 s=READY pgs=488 cs=0 l=1 rx=0x7f7c300014a0 tx=0x7f7c2c010d10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:38.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.693+0000 7f7c3a89c700 1 --2- 172.21.15.103:0/797861184 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c14004390 0x7f7c1400b750 secure :-1 s=THROTTLE_DONE pgs=488 cs=0 l=1 rx=0x7f7c300014a0 tx=0x7f7c2c010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:38.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.693+0000 7f7c277fe700 1 -- 172.21.15.103:0/797861184 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c2c005e20 con 0x7f7c14004390 2020-04-22T14:05:38.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.693+0000 7f7c3a89c700 1 --2- 172.21.15.103:0/797861184 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c14004390 0x7f7c1400b750 secure :-1 s=THROTTLE_DONE pgs=488 cs=0 l=1 rx=0x7f7c300014a0 tx=0x7f7c2c010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:38.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.693+0000 7f7c3a89c700 1 --2- 172.21.15.103:0/797861184 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c14004390 0x7f7c1400b750 secure :-1 s=THROTTLE_DONE pgs=488 cs=0 l=1 rx=0x7f7c300014a0 tx=0x7f7c2c010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:38.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.693+0000 7f7c277fe700 1 -- 172.21.15.103:0/797861184 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2c007160 con 0x7f7c14004390 2020-04-22T14:05:38.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.693+0000 7f7c277fe700 1 -- 172.21.15.103:0/797861184 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c2c007500 con 0x7f7c14004390 2020-04-22T14:05:38.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.693+0000 7f7c3a89c700 1 --2- 172.21.15.103:0/797861184 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c14004390 0x7f7c1400b750 secure :-1 s=THROTTLE_DONE pgs=488 cs=0 l=1 rx=0x7f7c300014a0 tx=0x7f7c2c010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:38.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.694+0000 7f7c277fe700 1 -- 172.21.15.103:0/797861184 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f7c2c007660 con 0x7f7c14004390 2020-04-22T14:05:38.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.694+0000 7f7c3a89c700 1 --2- 172.21.15.103:0/797861184 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c14004390 0x7f7c1400b750 secure :-1 s=THROTTLE_DONE pgs=488 cs=0 l=1 rx=0x7f7c300014a0 tx=0x7f7c2c010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:38.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.694+0000 7f7c3c2ff700 1 -- 172.21.15.103:0/797861184 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c340afd20 con 0x7f7c14004390 2020-04-22T14:05:38.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.694+0000 7f7c277fe700 1 --2- 172.21.15.103:0/797861184 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7c140562c0 0x7f7c14058780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:38.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.694+0000 7f7c277fe700 1 -- 172.21.15.103:0/797861184 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f7c2c060f00 con 0x7f7c14004390 2020-04-22T14:05:38.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.694+0000 7f7c3a09b700 1 --2- 172.21.15.103:0/797861184 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7c140562c0 0x7f7c14058780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:38.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.695+0000 7f7c3a09b700 1 --2- 172.21.15.103:0/797861184 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7c140562c0 0x7f7c14058780 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7c28001420 tx=0x7f7c2800fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:38.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.695+0000 7f7c3a09b700 1 --2- 172.21.15.103:0/797861184 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7c140562c0 0x7f7c14058780 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7c28001420 tx=0x7f7c2800fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:38.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.695+0000 7f7c3a09b700 1 --2- 172.21.15.103:0/797861184 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7c140562c0 0x7f7c14058780 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7f7c28001420 tx=0x7f7c2800fd20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:38.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.698+0000 7f7c3a89c700 1 --2- 172.21.15.103:0/797861184 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c14004390 0x7f7c1400b750 secure :-1 s=THROTTLE_DONE pgs=488 cs=0 l=1 rx=0x7f7c300014a0 tx=0x7f7c2c010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:38.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.698+0000 7f7c277fe700 1 -- 172.21.15.103:0/797861184 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f7c2c03c2e0 con 0x7f7c14004390 2020-04-22T14:05:38.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:38.839+0000 7f7c3c2ff700 1 -- 172.21.15.103:0/797861184 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7c34056c90 con 0x7f7c14004390 2020-04-22T14:05:39.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.545+0000 7f7c3a89c700 1 --2- 172.21.15.103:0/797861184 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c14004390 0x7f7c1400b750 secure :-1 s=THROTTLE_DONE pgs=488 cs=0 l=1 rx=0x7f7c300014a0 tx=0x7f7c2c010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:39.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.545+0000 7f7c277fe700 1 -- 172.21.15.103:0/797861184 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v37) v1 ==== 185+0+0 (secure 0 0 0) 0x7f7c2c03f900 con 0x7f7c14004390 2020-04-22T14:05:39.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.547+0000 7f7c3c2ff700 1 -- 172.21.15.103:0/797861184 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7c140562c0 msgr2=0x7f7c14058780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:39.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.547+0000 7f7c3c2ff700 1 --2- 172.21.15.103:0/797861184 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7c140562c0 0x7f7c14058780 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7f7c28001420 tx=0x7f7c2800fd20).stop 2020-04-22T14:05:39.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.547+0000 7f7c3c2ff700 1 -- 172.21.15.103:0/797861184 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c14004390 msgr2=0x7f7c1400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:39.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.547+0000 7f7c3c2ff700 1 --2- 172.21.15.103:0/797861184 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c14004390 0x7f7c1400b750 secure :-1 s=READY pgs=488 cs=0 l=1 rx=0x7f7c300014a0 tx=0x7f7c2c010d10).stop 2020-04-22T14:05:39.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.547+0000 7f7c3a89c700 1 -- 172.21.15.103:0/797861184 reap_dead start 2020-04-22T14:05:39.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.547+0000 7f7c3a89c700 1 -- 172.21.15.103:0/797861184 reap_dead start 2020-04-22T14:05:39.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.547+0000 7f7c3c2ff700 1 -- 172.21.15.103:0/797861184 shutdown_connections 2020-04-22T14:05:39.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.547+0000 7f7c3c2ff700 1 -- 172.21.15.103:0/797861184 >> 172.21.15.103:0/797861184 conn(0x7f7c3405ad30 msgr2=0x7f7c34144a00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:39.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.547+0000 7f7c3c2ff700 1 -- 172.21.15.103:0/797861184 shutdown_connections 2020-04-22T14:05:39.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.547+0000 7f7c3c2ff700 1 -- 172.21.15.103:0/797861184 wait complete. 2020-04-22T14:05:39.551 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' removed 2020-04-22T14:05:39.562 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:39.577 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2020-04-22T14:05:39.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.732+0000 7f9005edd700 1 Processor -- start 2020-04-22T14:05:39.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.732+0000 7f9005edd700 1 -- start start 2020-04-22T14:05:39.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.733+0000 7f9005edd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90000bcc50 0x7f9000146f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:39.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.733+0000 7f9005edd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f900012c5d0 0x7f900014a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:39.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.733+0000 7f9005edd700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9000146560 con 0x7f900005fc70 2020-04-22T14:05:39.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.733+0000 7f9005edd700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9000146370 con 0x7f900012c5d0 2020-04-22T14:05:39.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.733+0000 7f9005edd700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9000146800 con 0x7f90000bcc50 2020-04-22T14:05:39.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.733+0000 7f8ffffff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f900005fc70 0x7f900012bec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41432/0 (socket says 172.21.15.103:41432) 2020-04-22T14:05:39.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.733+0000 7f8ffffff700 1 -- 172.21.15.103:0/3331882502 learned_addr learned my addr 172.21.15.103:0/3331882502 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:39.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.734+0000 7f9004edb700 1 --2- 172.21.15.103:0/3331882502 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90000bcc50 0x7f9000146f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:39.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.734+0000 7f90056dc700 1 --2- 172.21.15.103:0/3331882502 >> v2:172.21.15.86:3300/0 conn(0x7f900012c5d0 0x7f900014a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:39.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.734+0000 7f8fff7fe700 1 -- 172.21.15.103:0/3331882502 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2234582257 0 0) 0x7f9000146560 con 0x7f900005fc70 2020-04-22T14:05:39.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.734+0000 7f8fff7fe700 1 -- 172.21.15.103:0/3331882502 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fec003230 con 0x7f900005fc70 2020-04-22T14:05:39.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.734+0000 7f8fff7fe700 1 -- 172.21.15.103:0/3331882502 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4180898854 0 0) 0x7f8fec003230 con 0x7f900005fc70 2020-04-22T14:05:39.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.734+0000 7f9004edb700 1 -- 172.21.15.103:0/3331882502 >> v2:172.21.15.86:3300/0 conn(0x7f900012c5d0 msgr2=0x7f900014a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:39.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.734+0000 7f9004edb700 1 --2- 172.21.15.103:0/3331882502 >> v2:172.21.15.86:3300/0 conn(0x7f900012c5d0 0x7f900014a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:39.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.734+0000 7f9004edb700 1 -- 172.21.15.103:0/3331882502 >> v1:172.21.15.103:6789/0 conn(0x7f900005fc70 legacy=0x7f900012bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:39.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.734+0000 7f9004edb700 1 -- 172.21.15.103:0/3331882502 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9000146aa0 con 0x7f90000bcc50 2020-04-22T14:05:39.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.734+0000 7f9004edb700 1 --2- 172.21.15.103:0/3331882502 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90000bcc50 0x7f9000146f40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8ff4001870 tx=0x7f8ff0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:39.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.734+0000 7f9004edb700 1 --2- 172.21.15.103:0/3331882502 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90000bcc50 0x7f9000146f40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8ff4001870 tx=0x7f8ff0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:39.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.734+0000 7f9004edb700 1 --2- 172.21.15.103:0/3331882502 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90000bcc50 0x7f9000146f40 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7f8ff4001870 tx=0x7f8ff0007a40).ready entity=mon.2 client_cookie=135b553e5505f513 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:39.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.734+0000 7f9004edb700 1 --2- 172.21.15.103:0/3331882502 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90000bcc50 0x7f9000146f40 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f8ff4001870 tx=0x7f8ff0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:39.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.734+0000 7f8fff7fe700 1 -- 172.21.15.103:0/3331882502 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ff40016d0 con 0x7f90000bcc50 2020-04-22T14:05:39.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.734+0000 7f9004edb700 1 --2- 172.21.15.103:0/3331882502 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90000bcc50 0x7f9000146f40 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f8ff4001870 tx=0x7f8ff0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:39.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.734+0000 7f8fff7fe700 1 -- 172.21.15.103:0/3331882502 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff0008b40 con 0x7f90000bcc50 2020-04-22T14:05:39.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.734+0000 7f9004edb700 1 --2- 172.21.15.103:0/3331882502 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90000bcc50 0x7f9000146f40 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f8ff4001870 tx=0x7f8ff0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:39.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.734+0000 7f9005edd700 1 -- 172.21.15.103:0/3331882502 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90000bcc50 msgr2=0x7f9000146f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:39.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.734+0000 7f8fff7fe700 1 -- 172.21.15.103:0/3331882502 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ff00115a0 con 0x7f90000bcc50 2020-04-22T14:05:39.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.734+0000 7f9005edd700 1 --2- 172.21.15.103:0/3331882502 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90000bcc50 0x7f9000146f40 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7f8ff4001870 tx=0x7f8ff0007a40).stop 2020-04-22T14:05:39.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.735+0000 7f9005edd700 1 -- 172.21.15.103:0/3331882502 shutdown_connections 2020-04-22T14:05:39.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.735+0000 7f9005edd700 1 --2- 172.21.15.103:0/3331882502 >> v2:172.21.15.86:3300/0 conn(0x7f900012c5d0 0x7f900014a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:39.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.735+0000 7f9005edd700 1 --2- 172.21.15.103:0/3331882502 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90000bcc50 0x7f9000146f40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:39.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.735+0000 7f9005edd700 1 -- 172.21.15.103:0/3331882502 >> 172.21.15.103:0/3331882502 conn(0x7f9000065af0 msgr2=0x7f9000065f00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:39.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.735+0000 7f9005edd700 1 -- 172.21.15.103:0/3331882502 shutdown_connections 2020-04-22T14:05:39.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.735+0000 7f9005edd700 1 -- 172.21.15.103:0/3331882502 wait complete. 2020-04-22T14:05:39.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.736+0000 7f9005edd700 1 Processor -- start 2020-04-22T14:05:39.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.736+0000 7f9005edd700 1 -- start start 2020-04-22T14:05:39.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.737+0000 7f9005edd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f900005fc70 0x7f90000b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:39.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.737+0000 7f9005edd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f900012c5d0 0x7f9000144e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:39.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.737+0000 7f9005edd700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f900012f820 con 0x7f90000bcc50 2020-04-22T14:05:39.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.737+0000 7f9005edd700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9000147fa0 con 0x7f900012c5d0 2020-04-22T14:05:39.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.737+0000 7f9005edd700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9000148240 con 0x7f900005fc70 2020-04-22T14:05:39.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.737+0000 7f9004edb700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f900005fc70 0x7f90000b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:39.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.737+0000 7f9004edb700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f900005fc70 0x7f90000b2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49246/0 (socket says 172.21.15.103:49246) 2020-04-22T14:05:39.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.737+0000 7f9004edb700 1 -- 172.21.15.103:0/274974331 learned_addr learned my addr 172.21.15.103:0/274974331 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:05:39.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.737+0000 7f90056dc700 1 --2- 172.21.15.103:0/274974331 >> v2:172.21.15.86:3300/0 conn(0x7f900012c5d0 0x7f9000144e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:39.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.737+0000 7f9004edb700 1 -- 172.21.15.103:0/274974331 >> v2:172.21.15.86:3300/0 conn(0x7f900012c5d0 msgr2=0x7f9000144e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:39.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.737+0000 7f9004edb700 1 --2- 172.21.15.103:0/274974331 >> v2:172.21.15.86:3300/0 conn(0x7f900012c5d0 0x7f9000144e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:39.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.737+0000 7f9004edb700 1 -- 172.21.15.103:0/274974331 >> v1:172.21.15.86:6789/0 conn(0x7f90000bcc50 legacy=0x7f9000144730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:39.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.737+0000 7f9004edb700 1 -- 172.21.15.103:0/274974331 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90001496f0 con 0x7f900005fc70 2020-04-22T14:05:39.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.737+0000 7f90056dc700 1 --2- 172.21.15.103:0/274974331 >> v2:172.21.15.86:3300/0 conn(0x7f900012c5d0 0x7f9000144e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:05:39.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.737+0000 7f9004edb700 1 --2- 172.21.15.103:0/274974331 >> v2:172.21.15.103:3300/0 conn(0x7f900005fc70 0x7f90000b2cb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8ff4001870 tx=0x7f8ff0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:39.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.737+0000 7f9004edb700 1 --2- 172.21.15.103:0/274974331 >> v2:172.21.15.103:3300/0 conn(0x7f900005fc70 0x7f90000b2cb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8ff4001870 tx=0x7f8ff0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:39.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.737+0000 7f9004edb700 1 --2- 172.21.15.103:0/274974331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f900005fc70 0x7f90000b2cb0 secure :-1 s=READY pgs=490 cs=0 l=1 rx=0x7f8ff4001870 tx=0x7f8ff0007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:39.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.737+0000 7f9004edb700 1 --2- 172.21.15.103:0/274974331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f900005fc70 0x7f90000b2cb0 secure :-1 s=THROTTLE_DONE pgs=490 cs=0 l=1 rx=0x7f8ff4001870 tx=0x7f8ff0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:39.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.737+0000 7f8ffdffb700 1 -- 172.21.15.103:0/274974331 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ff0011c90 con 0x7f900005fc70 2020-04-22T14:05:39.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.737+0000 7f9004edb700 1 --2- 172.21.15.103:0/274974331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f900005fc70 0x7f90000b2cb0 secure :-1 s=THROTTLE_DONE pgs=490 cs=0 l=1 rx=0x7f8ff4001870 tx=0x7f8ff0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:39.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.737+0000 7f8ffdffb700 1 -- 172.21.15.103:0/274974331 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff0011df0 con 0x7f900005fc70 2020-04-22T14:05:39.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.737+0000 7f9005edd700 1 -- 172.21.15.103:0/274974331 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9000149940 con 0x7f900005fc70 2020-04-22T14:05:39.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.737+0000 7f9004edb700 1 --2- 172.21.15.103:0/274974331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f900005fc70 0x7f90000b2cb0 secure :-1 s=THROTTLE_DONE pgs=490 cs=0 l=1 rx=0x7f8ff4001870 tx=0x7f8ff0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:39.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.737+0000 7f8ffdffb700 1 -- 172.21.15.103:0/274974331 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ff0007360 con 0x7f900005fc70 2020-04-22T14:05:39.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.737+0000 7f9005edd700 1 -- 172.21.15.103:0/274974331 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f900012f3f0 con 0x7f900005fc70 2020-04-22T14:05:39.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.738+0000 7f9004edb700 1 --2- 172.21.15.103:0/274974331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f900005fc70 0x7f90000b2cb0 secure :-1 s=THROTTLE_DONE pgs=490 cs=0 l=1 rx=0x7f8ff4001870 tx=0x7f8ff0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:39.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.738+0000 7f8ffdffb700 1 -- 172.21.15.103:0/274974331 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f8ff00056c0 con 0x7f900005fc70 2020-04-22T14:05:39.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.738+0000 7f9004edb700 1 --2- 172.21.15.103:0/274974331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f900005fc70 0x7f90000b2cb0 secure :-1 s=THROTTLE_DONE pgs=490 cs=0 l=1 rx=0x7f8ff4001870 tx=0x7f8ff0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:39.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.738+0000 7f9005edd700 1 -- 172.21.15.103:0/274974331 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9000056c90 con 0x7f900005fc70 2020-04-22T14:05:39.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.738+0000 7f8ffdffb700 1 --2- 172.21.15.103:0/274974331 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8fe004da10 0x7f8fe004fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:39.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.739+0000 7f8ffdffb700 1 -- 172.21.15.103:0/274974331 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f8ff0061de0 con 0x7f900005fc70 2020-04-22T14:05:39.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.739+0000 7f8ffffff700 1 --2- 172.21.15.103:0/274974331 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8fe004da10 0x7f8fe004fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:39.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.739+0000 7f8ffffff700 1 --2- 172.21.15.103:0/274974331 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8fe004da10 0x7f8fe004fed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f900012e680 tx=0x7f8ff4001d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:39.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.739+0000 7f8ffffff700 1 --2- 172.21.15.103:0/274974331 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8fe004da10 0x7f8fe004fed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f900012e680 tx=0x7f8ff4001d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:39.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.739+0000 7f8ffffff700 1 --2- 172.21.15.103:0/274974331 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8fe004da10 0x7f8fe004fed0 secure :-1 s=READY pgs=195 cs=0 l=1 rx=0x7f900012e680 tx=0x7f8ff4001d40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:39.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.743+0000 7f9004edb700 1 --2- 172.21.15.103:0/274974331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f900005fc70 0x7f90000b2cb0 secure :-1 s=THROTTLE_DONE pgs=490 cs=0 l=1 rx=0x7f8ff4001870 tx=0x7f8ff0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:39.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.743+0000 7f8ffdffb700 1 -- 172.21.15.103:0/274974331 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f8ff003d220 con 0x7f900005fc70 2020-04-22T14:05:39.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:39.884+0000 7f9005edd700 1 -- 172.21.15.103:0/274974331 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f90000b6dc0 con 0x7f900005fc70 2020-04-22T14:05:40.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.545+0000 7f9004edb700 1 --2- 172.21.15.103:0/274974331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f900005fc70 0x7f90000b2cb0 secure :-1 s=THROTTLE_DONE pgs=490 cs=0 l=1 rx=0x7f8ff4001870 tx=0x7f8ff0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:40.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.545+0000 7f8ffdffb700 1 -- 172.21.15.103:0/274974331 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v38) v1 ==== 173+0+0 (secure 0 0 0) 0x7f8ff0040840 con 0x7f900005fc70 2020-04-22T14:05:40.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.547+0000 7f9005edd700 1 -- 172.21.15.103:0/274974331 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8fe004da10 msgr2=0x7f8fe004fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:40.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.547+0000 7f9005edd700 1 --2- 172.21.15.103:0/274974331 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8fe004da10 0x7f8fe004fed0 secure :-1 s=READY pgs=195 cs=0 l=1 rx=0x7f900012e680 tx=0x7f8ff4001d40).stop 2020-04-22T14:05:40.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.547+0000 7f9005edd700 1 -- 172.21.15.103:0/274974331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f900005fc70 msgr2=0x7f90000b2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:40.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.547+0000 7f9005edd700 1 --2- 172.21.15.103:0/274974331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f900005fc70 0x7f90000b2cb0 secure :-1 s=READY pgs=490 cs=0 l=1 rx=0x7f8ff4001870 tx=0x7f8ff0007a40).stop 2020-04-22T14:05:40.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.547+0000 7f9005edd700 1 -- 172.21.15.103:0/274974331 shutdown_connections 2020-04-22T14:05:40.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.547+0000 7f9005edd700 1 --2- 172.21.15.103:0/274974331 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8fe004da10 0x7f8fe004fed0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:40.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.547+0000 7f9005edd700 1 --2- 172.21.15.103:0/274974331 >> v2:172.21.15.86:3300/0 conn(0x7f900012c5d0 0x7f9000144e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:40.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.547+0000 7f9005edd700 1 --2- 172.21.15.103:0/274974331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f900005fc70 0x7f90000b2cb0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:40.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.547+0000 7f9005edd700 1 -- 172.21.15.103:0/274974331 >> 172.21.15.103:0/274974331 conn(0x7f9000065af0 msgr2=0x7f900005ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:40.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.547+0000 7f9005edd700 1 -- 172.21.15.103:0/274974331 shutdown_connections 2020-04-22T14:05:40.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.547+0000 7f9005edd700 1 -- 172.21.15.103:0/274974331 wait complete. 2020-04-22T14:05:40.551 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' removed 2020-04-22T14:05:40.560 INFO:tasks.ceph.mds.a:Restarting daemon 2020-04-22T14:05:40.560 INFO:tasks.ceph.mds.a:Stopping old one... 2020-04-22T14:05:40.560 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-04-22T14:05:40.560 INFO:teuthology.orchestra.run:waiting for 300 2020-04-22T14:05:40.561 INFO:tasks.ceph.mds.b:Restarting daemon 2020-04-22T14:05:40.561 INFO:tasks.ceph.mds.b:Stopping old one... 2020-04-22T14:05:40.561 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-04-22T14:05:40.561 INFO:teuthology.orchestra.run:waiting for 300 2020-04-22T14:05:40.568 INFO:tasks.ceph.mds.a:Stopped 2020-04-22T14:05:40.568 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:40.570 INFO:tasks.ceph.mds.b:Stopped 2020-04-22T14:05:40.570 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:05:40.623 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-04-22T14:05:40.626 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-04-22T14:05:40.665 INFO:tasks.ceph.mds.a:Started 2020-04-22T14:05:40.665 DEBUG:teuthology.parallel:result is None 2020-04-22T14:05:40.669 INFO:tasks.ceph.mds.b:Started 2020-04-22T14:05:40.670 DEBUG:teuthology.parallel:result is None 2020-04-22T14:05:40.670 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:40.684 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2020-04-22T14:05:40.740 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2020-04-22T14:05:40.746 INFO:tasks.ceph.mds.b.smithi086.stdout:starting mds.b at 2020-04-22T14:05:40.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.832+0000 7f5038bbe700 1 Processor -- start 2020-04-22T14:05:40.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.832+0000 7f5038bbe700 1 -- start start 2020-04-22T14:05:40.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.833+0000 7f5038bbe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5034146210 0x7f50341465f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:40.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.833+0000 7f5038bbe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f50340af280 0x7f5034141cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:40.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.833+0000 7f5038bbe700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50340adad0 con 0x7f5034142150 2020-04-22T14:05:40.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.833+0000 7f5038bbe700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50340add70 con 0x7f50340af280 2020-04-22T14:05:40.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.833+0000 7f5038bbe700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5034146a50 con 0x7f5034146210 2020-04-22T14:05:40.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.833+0000 7f503259c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5034146210 0x7f50341465f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:40.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.833+0000 7f5032d9d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f5034142150 0x7f50340b3e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41460/0 (socket says 172.21.15.103:41460) 2020-04-22T14:05:40.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.833+0000 7f5032d9d700 1 -- 172.21.15.103:0/679284932 learned_addr learned my addr 172.21.15.103:0/679284932 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:40.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.833+0000 7f5031d9b700 1 --2- 172.21.15.103:0/679284932 >> v2:172.21.15.86:3300/0 conn(0x7f50340af280 0x7f5034141cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:40.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.833+0000 7f503259c700 1 -- 172.21.15.103:0/679284932 >> v2:172.21.15.86:3300/0 conn(0x7f50340af280 msgr2=0x7f5034141cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:40.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.833+0000 7f503259c700 1 --2- 172.21.15.103:0/679284932 >> v2:172.21.15.86:3300/0 conn(0x7f50340af280 0x7f5034141cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:40.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.833+0000 7f503259c700 1 -- 172.21.15.103:0/679284932 >> v1:172.21.15.103:6789/0 conn(0x7f5034142150 legacy=0x7f50340b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:40.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.833+0000 7f503259c700 1 -- 172.21.15.103:0/679284932 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50340af750 con 0x7f5034146210 2020-04-22T14:05:40.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.833+0000 7f503159a700 1 -- 172.21.15.103:0/679284932 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 294345056 0 0) 0x7f50340adad0 con 0x7f5034142150 2020-04-22T14:05:40.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.833+0000 7f5031d9b700 1 --2- 172.21.15.103:0/679284932 >> v2:172.21.15.86:3300/0 conn(0x7f50340af280 0x7f5034141cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:05:40.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.833+0000 7f503259c700 1 --2- 172.21.15.103:0/679284932 >> v2:172.21.15.103:3300/0 conn(0x7f5034146210 0x7f50341465f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5028002f30 tx=0x7f5028007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:40.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.833+0000 7f503259c700 1 --2- 172.21.15.103:0/679284932 >> v2:172.21.15.103:3300/0 conn(0x7f5034146210 0x7f50341465f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5028002f30 tx=0x7f5028007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:40.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.833+0000 7f503259c700 1 --2- 172.21.15.103:0/679284932 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5034146210 0x7f50341465f0 secure :-1 s=READY pgs=495 cs=0 l=1 rx=0x7f5028002f30 tx=0x7f5028007a40).ready entity=mon.1 client_cookie=9166974287112169 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:40.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.834+0000 7f503259c700 1 --2- 172.21.15.103:0/679284932 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5034146210 0x7f50341465f0 secure :-1 s=THROTTLE_DONE pgs=495 cs=0 l=1 rx=0x7f5028002f30 tx=0x7f5028007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:40.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.834+0000 7f503159a700 1 -- 172.21.15.103:0/679284932 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5028011470 con 0x7f5034146210 2020-04-22T14:05:40.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.834+0000 7f503259c700 1 --2- 172.21.15.103:0/679284932 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5034146210 0x7f50341465f0 secure :-1 s=THROTTLE_DONE pgs=495 cs=0 l=1 rx=0x7f5028002f30 tx=0x7f5028007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:40.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.834+0000 7f503159a700 1 -- 172.21.15.103:0/679284932 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50280115d0 con 0x7f5034146210 2020-04-22T14:05:40.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.834+0000 7f503259c700 1 --2- 172.21.15.103:0/679284932 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5034146210 0x7f50341465f0 secure :-1 s=THROTTLE_DONE pgs=495 cs=0 l=1 rx=0x7f5028002f30 tx=0x7f5028007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:40.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.834+0000 7f5038bbe700 1 -- 172.21.15.103:0/679284932 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5034146210 msgr2=0x7f50341465f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:40.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.834+0000 7f503159a700 1 -- 172.21.15.103:0/679284932 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50280119b0 con 0x7f5034146210 2020-04-22T14:05:40.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.834+0000 7f5038bbe700 1 --2- 172.21.15.103:0/679284932 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5034146210 0x7f50341465f0 secure :-1 s=READY pgs=495 cs=0 l=1 rx=0x7f5028002f30 tx=0x7f5028007a40).stop 2020-04-22T14:05:40.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.834+0000 7f5038bbe700 1 -- 172.21.15.103:0/679284932 shutdown_connections 2020-04-22T14:05:40.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.834+0000 7f5038bbe700 1 --2- 172.21.15.103:0/679284932 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5034146210 0x7f50341465f0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:40.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.834+0000 7f5038bbe700 1 --2- 172.21.15.103:0/679284932 >> v2:172.21.15.86:3300/0 conn(0x7f50340af280 0x7f5034141cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:40.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.834+0000 7f5038bbe700 1 -- 172.21.15.103:0/679284932 >> 172.21.15.103:0/679284932 conn(0x7f50340b86b0 msgr2=0x7f50340b8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:40.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.834+0000 7f5038bbe700 1 -- 172.21.15.103:0/679284932 shutdown_connections 2020-04-22T14:05:40.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.834+0000 7f5038bbe700 1 -- 172.21.15.103:0/679284932 wait complete. 2020-04-22T14:05:40.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.835+0000 7f5038bbe700 1 Processor -- start 2020-04-22T14:05:40.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.835+0000 7f5038bbe700 1 -- start start 2020-04-22T14:05:40.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.836+0000 7f5038bbe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5034142150 0x7f503414ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:40.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.836+0000 7f5038bbe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5034146210 0x7f5034141020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:40.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.836+0000 7f5038bbe700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5034065260 con 0x7f50340af280 2020-04-22T14:05:40.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.836+0000 7f5038bbe700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5034148010 con 0x7f5034146210 2020-04-22T14:05:40.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.836+0000 7f5038bbe700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503414c6d0 con 0x7f5034142150 2020-04-22T14:05:40.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.836+0000 7f503259c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f50340af280 0x7f50340629e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41462/0 (socket says 172.21.15.103:41462) 2020-04-22T14:05:40.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.836+0000 7f5031d9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5034142150 0x7f503414ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:40.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.836+0000 7f503259c700 1 -- 172.21.15.103:0/847999628 learned_addr learned my addr 172.21.15.103:0/847999628 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:40.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.836+0000 7f5032d9d700 1 --2- 172.21.15.103:0/847999628 >> v2:172.21.15.86:3300/0 conn(0x7f5034146210 0x7f5034141020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:40.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.836+0000 7f5031d9b700 1 -- 172.21.15.103:0/847999628 >> v2:172.21.15.86:3300/0 conn(0x7f5034146210 msgr2=0x7f5034141020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:40.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.836+0000 7f5031d9b700 1 --2- 172.21.15.103:0/847999628 >> v2:172.21.15.86:3300/0 conn(0x7f5034146210 0x7f5034141020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:40.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.836+0000 7f50237fe700 1 -- 172.21.15.103:0/847999628 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3071866810 0 0) 0x7f5034065260 con 0x7f50340af280 2020-04-22T14:05:40.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.836+0000 7f5031d9b700 1 -- 172.21.15.103:0/847999628 >> v1:172.21.15.103:6789/0 conn(0x7f50340af280 legacy=0x7f50340629e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:40.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.836+0000 7f5031d9b700 1 -- 172.21.15.103:0/847999628 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f503414c970 con 0x7f5034142150 2020-04-22T14:05:40.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.836+0000 7f5031d9b700 1 --2- 172.21.15.103:0/847999628 >> v2:172.21.15.103:3300/0 conn(0x7f5034142150 0x7f503414ce10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5024002f30 tx=0x7f5024010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:40.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.836+0000 7f5031d9b700 1 --2- 172.21.15.103:0/847999628 >> v2:172.21.15.103:3300/0 conn(0x7f5034142150 0x7f503414ce10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5024002f30 tx=0x7f5024010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:40.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.836+0000 7f5031d9b700 1 --2- 172.21.15.103:0/847999628 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5034142150 0x7f503414ce10 secure :-1 s=READY pgs=497 cs=0 l=1 rx=0x7f5024002f30 tx=0x7f5024010b50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:40.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.836+0000 7f5031d9b700 1 --2- 172.21.15.103:0/847999628 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5034142150 0x7f503414ce10 secure :-1 s=THROTTLE_DONE pgs=497 cs=0 l=1 rx=0x7f5024002f30 tx=0x7f5024010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:40.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.836+0000 7f50237fe700 1 -- 172.21.15.103:0/847999628 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5024005aa0 con 0x7f5034142150 2020-04-22T14:05:40.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.836+0000 7f5031d9b700 1 --2- 172.21.15.103:0/847999628 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5034142150 0x7f503414ce10 secure :-1 s=THROTTLE_DONE pgs=497 cs=0 l=1 rx=0x7f5024002f30 tx=0x7f5024010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:40.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.836+0000 7f5031d9b700 1 --2- 172.21.15.103:0/847999628 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5034142150 0x7f503414ce10 secure :-1 s=THROTTLE_DONE pgs=497 cs=0 l=1 rx=0x7f5024002f30 tx=0x7f5024010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:40.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.836+0000 7f50237fe700 1 -- 172.21.15.103:0/847999628 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5024005c00 con 0x7f5034142150 2020-04-22T14:05:40.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.836+0000 7f5038bbe700 1 -- 172.21.15.103:0/847999628 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50341479a0 con 0x7f5034142150 2020-04-22T14:05:40.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.836+0000 7f50237fe700 1 -- 172.21.15.103:0/847999628 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50240125e0 con 0x7f5034142150 2020-04-22T14:05:40.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.837+0000 7f5038bbe700 1 -- 172.21.15.103:0/847999628 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50340acf50 con 0x7f5034142150 2020-04-22T14:05:40.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.837+0000 7f5031d9b700 1 --2- 172.21.15.103:0/847999628 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5034142150 0x7f503414ce10 secure :-1 s=THROTTLE_DONE pgs=497 cs=0 l=1 rx=0x7f5024002f30 tx=0x7f5024010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:40.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.838+0000 7f50237fe700 1 -- 172.21.15.103:0/847999628 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f50240071a0 con 0x7f5034142150 2020-04-22T14:05:40.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.838+0000 7f5031d9b700 1 --2- 172.21.15.103:0/847999628 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5034142150 0x7f503414ce10 secure :-1 s=THROTTLE_DONE pgs=497 cs=0 l=1 rx=0x7f5024002f30 tx=0x7f5024010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:40.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.838+0000 7f5038bbe700 1 -- 172.21.15.103:0/847999628 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5034147e60 con 0x7f5034142150 2020-04-22T14:05:40.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.838+0000 7f50237fe700 1 --2- 172.21.15.103:0/847999628 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f501004d870 0x7f501004fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:40.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.838+0000 7f50237fe700 1 -- 172.21.15.103:0/847999628 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f50240612e0 con 0x7f5034142150 2020-04-22T14:05:40.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.838+0000 7f503259c700 1 --2- 172.21.15.103:0/847999628 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f501004d870 0x7f501004fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:40.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.839+0000 7f503259c700 1 --2- 172.21.15.103:0/847999628 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f501004d870 0x7f501004fd30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5028010200 tx=0x7f5028007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:40.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.839+0000 7f503259c700 1 --2- 172.21.15.103:0/847999628 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f501004d870 0x7f501004fd30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5028010200 tx=0x7f5028007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:40.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.839+0000 7f503259c700 1 --2- 172.21.15.103:0/847999628 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f501004d870 0x7f501004fd30 secure :-1 s=READY pgs=196 cs=0 l=1 rx=0x7f5028010200 tx=0x7f5028007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:40.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.842+0000 7f5031d9b700 1 --2- 172.21.15.103:0/847999628 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5034142150 0x7f503414ce10 secure :-1 s=THROTTLE_DONE pgs=497 cs=0 l=1 rx=0x7f5024002f30 tx=0x7f5024010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:40.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:40.842+0000 7f50237fe700 1 -- 172.21.15.103:0/847999628 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f502403c720 con 0x7f5034142150 2020-04-22T14:05:41.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.002+0000 7f5038bbe700 1 -- 172.21.15.103:0/847999628 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f5034056c90 con 0x7f5034142150 2020-04-22T14:05:41.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.768+0000 7f5031d9b700 1 --2- 172.21.15.103:0/847999628 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5034142150 0x7f503414ce10 secure :-1 s=THROTTLE_DONE pgs=497 cs=0 l=1 rx=0x7f5024002f30 tx=0x7f5024010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:41.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.768+0000 7f50237fe700 1 -- 172.21.15.103:0/847999628 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v41) v1 ==== 97+0+0 (secure 0 0 0) 0x7f502403fd40 con 0x7f5034142150 2020-04-22T14:05:41.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.770+0000 7f5038bbe700 1 -- 172.21.15.103:0/847999628 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f501004d870 msgr2=0x7f501004fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:41.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.770+0000 7f5038bbe700 1 --2- 172.21.15.103:0/847999628 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f501004d870 0x7f501004fd30 secure :-1 s=READY pgs=196 cs=0 l=1 rx=0x7f5028010200 tx=0x7f5028007a40).stop 2020-04-22T14:05:41.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.770+0000 7f5038bbe700 1 -- 172.21.15.103:0/847999628 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5034142150 msgr2=0x7f503414ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:41.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.771+0000 7f5038bbe700 1 --2- 172.21.15.103:0/847999628 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5034142150 0x7f503414ce10 secure :-1 s=READY pgs=497 cs=0 l=1 rx=0x7f5024002f30 tx=0x7f5024010b50).stop 2020-04-22T14:05:41.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.771+0000 7f5038bbe700 1 -- 172.21.15.103:0/847999628 shutdown_connections 2020-04-22T14:05:41.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.771+0000 7f5038bbe700 1 --2- 172.21.15.103:0/847999628 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f501004d870 0x7f501004fd30 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:41.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.771+0000 7f5038bbe700 1 --2- 172.21.15.103:0/847999628 >> v2:172.21.15.86:3300/0 conn(0x7f5034146210 0x7f5034141020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:41.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.771+0000 7f5038bbe700 1 --2- 172.21.15.103:0/847999628 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5034142150 0x7f503414ce10 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:41.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.771+0000 7f5038bbe700 1 -- 172.21.15.103:0/847999628 >> 172.21.15.103:0/847999628 conn(0x7f50340b86b0 msgr2=0x7f50340b19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:41.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.771+0000 7f5038bbe700 1 -- 172.21.15.103:0/847999628 shutdown_connections 2020-04-22T14:05:41.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.771+0000 7f5038bbe700 1 -- 172.21.15.103:0/847999628 wait complete. 2020-04-22T14:05:41.775 INFO:teuthology.orchestra.run.smithi103.stderr: removed all blacklist entries 2020-04-22T14:05:41.785 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2020-04-22T14:05:41.786 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:41.841 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2020-04-22T14:05:41.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.989+0000 7ff806071700 1 Processor -- start 2020-04-22T14:05:41.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.990+0000 7ff806071700 1 -- start start 2020-04-22T14:05:42.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.990+0000 7ff806071700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff80005b7c0 0x7ff8000665a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:42.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.990+0000 7ff806071700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8000651f0 con 0x7ff80014a640 2020-04-22T14:05:42.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.990+0000 7ff806071700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff800066b90 con 0x7ff8000b4ec0 2020-04-22T14:05:42.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.990+0000 7ff806071700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff800066e30 con 0x7ff80005b7c0 2020-04-22T14:05:42.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.990+0000 7ff7fffff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff8000b4ec0 0x7ff8000b5350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41472/0 (socket says 172.21.15.103:41472) 2020-04-22T14:05:42.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.990+0000 7ff7fffff700 1 -- 172.21.15.103:0/1456027014 learned_addr learned my addr 172.21.15.103:0/1456027014 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:42.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.991+0000 7ff7ff7fe700 1 --2- 172.21.15.103:0/1456027014 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff80005b7c0 0x7ff8000665a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:42.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.991+0000 7ff7fe7fc700 1 -- 172.21.15.103:0/1456027014 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3705344227 0 0) 0x7ff800066b90 con 0x7ff8000b4ec0 2020-04-22T14:05:42.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.991+0000 7ff7fe7fc700 1 -- 172.21.15.103:0/1456027014 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7e0003230 con 0x7ff8000b4ec0 2020-04-22T14:05:42.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.991+0000 7ff7fe7fc700 1 -- 172.21.15.103:0/1456027014 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3628316168 0 0) 0x7ff8000651f0 con 0x7ff80014a640 2020-04-22T14:05:42.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.991+0000 7ff7fe7fc700 1 -- 172.21.15.103:0/1456027014 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff800066b90 con 0x7ff80014a640 2020-04-22T14:05:42.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.991+0000 7ff7fe7fc700 1 -- 172.21.15.103:0/1456027014 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3536977748 0 0) 0x7ff7e0003230 con 0x7ff8000b4ec0 2020-04-22T14:05:42.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.991+0000 7ff7fe7fc700 1 -- 172.21.15.103:0/1456027014 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff80005b7c0 msgr2=0x7ff8000665a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:42.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.991+0000 7ff7fe7fc700 1 --2- 172.21.15.103:0/1456027014 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff80005b7c0 0x7ff8000665a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:42.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.991+0000 7ff7fe7fc700 1 -- 172.21.15.103:0/1456027014 >> v1:172.21.15.86:6789/0 conn(0x7ff80014a640 legacy=0x7ff8001336b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:42.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.991+0000 7ff7fe7fc700 1 -- 172.21.15.103:0/1456027014 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8000670d0 con 0x7ff8000b4ec0 2020-04-22T14:05:42.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.991+0000 7ff7fe7fc700 1 -- 172.21.15.103:0/1456027014 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7ff7f80016d0 con 0x7ff8000b4ec0 2020-04-22T14:05:42.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.991+0000 7ff7fe7fc700 1 -- 172.21.15.103:0/1456027014 >> v1:172.21.15.103:6789/0 conn(0x7ff8000b4ec0 legacy=0x7ff8000b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:42.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.991+0000 7ff7fe7fc700 1 --2- 172.21.15.103:0/1456027014 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7e00038b0 0x7ff7e0003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:42.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.991+0000 7ff7fe7fc700 1 --2- 172.21.15.103:0/1456027014 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7e00044d0 0x7ff7e0004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:42.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.991+0000 7ff7fe7fc700 1 --2- 172.21.15.103:0/1456027014 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff80005b7c0 0x7ff7e0004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:42.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.991+0000 7ff7fe7fc700 1 -- 172.21.15.103:0/1456027014 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff800066e30 con 0x7ff7e00038b0 2020-04-22T14:05:42.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.991+0000 7ff7fe7fc700 1 -- 172.21.15.103:0/1456027014 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e0005210 con 0x7ff7e00044d0 2020-04-22T14:05:42.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.991+0000 7ff7fe7fc700 1 -- 172.21.15.103:0/1456027014 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e000b720 con 0x7ff80005b7c0 2020-04-22T14:05:42.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.991+0000 7ff7feffd700 1 --2- 172.21.15.103:0/1456027014 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7e00044d0 0x7ff7e0004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:42.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.991+0000 7ff7ff7fe700 1 --2- 172.21.15.103:0/1456027014 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7e00038b0 0x7ff7e0003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:42.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.991+0000 7ff7fffff700 1 --2- 172.21.15.103:0/1456027014 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff80005b7c0 0x7ff7e0004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:42.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.991+0000 7ff7feffd700 1 -- 172.21.15.103:0/1456027014 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff80005b7c0 msgr2=0x7ff7e0004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:42.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.991+0000 7ff7feffd700 1 --2- 172.21.15.103:0/1456027014 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff80005b7c0 0x7ff7e0004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:42.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.991+0000 7ff7feffd700 1 -- 172.21.15.103:0/1456027014 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7e00038b0 msgr2=0x7ff7e0003cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:42.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.991+0000 7ff7feffd700 1 --2- 172.21.15.103:0/1456027014 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7e00038b0 0x7ff7e0003cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:42.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.991+0000 7ff7feffd700 1 -- 172.21.15.103:0/1456027014 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e0003230 con 0x7ff7e00044d0 2020-04-22T14:05:42.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.991+0000 7ff7feffd700 1 --2- 172.21.15.103:0/1456027014 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7e00044d0 0x7ff7e0004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff7e80010d0 tx=0x7ff7e800fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.991+0000 7ff7feffd700 1 --2- 172.21.15.103:0/1456027014 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7e00044d0 0x7ff7e0004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff7e80010d0 tx=0x7ff7e800fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.991+0000 7ff7feffd700 1 --2- 172.21.15.103:0/1456027014 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7e00044d0 0x7ff7e0004950 secure :-1 s=READY pgs=499 cs=0 l=1 rx=0x7ff7e80010d0 tx=0x7ff7e800fe50).ready entity=mon.1 client_cookie=90e0098885a5fb1b server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:42.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.992+0000 7ff7feffd700 1 --2- 172.21.15.103:0/1456027014 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7e00044d0 0x7ff7e0004950 secure :-1 s=THROTTLE_DONE pgs=499 cs=0 l=1 rx=0x7ff7e80010d0 tx=0x7ff7e800fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.992+0000 7ff7feffd700 1 --2- 172.21.15.103:0/1456027014 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7e00044d0 0x7ff7e0004950 secure :-1 s=THROTTLE_DONE pgs=499 cs=0 l=1 rx=0x7ff7e80010d0 tx=0x7ff7e800fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.992+0000 7ff7fe7fc700 1 -- 172.21.15.103:0/1456027014 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7e8011bb0 con 0x7ff7e00044d0 2020-04-22T14:05:42.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.992+0000 7ff7feffd700 1 --2- 172.21.15.103:0/1456027014 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7e00044d0 0x7ff7e0004950 secure :-1 s=THROTTLE_DONE pgs=499 cs=0 l=1 rx=0x7ff7e80010d0 tx=0x7ff7e800fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.992+0000 7ff7fe7fc700 1 -- 172.21.15.103:0/1456027014 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e8011d50 con 0x7ff7e00044d0 2020-04-22T14:05:42.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.992+0000 7ff7fe7fc700 1 -- 172.21.15.103:0/1456027014 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7e80066d0 con 0x7ff7e00044d0 2020-04-22T14:05:42.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.992+0000 7ff806071700 1 -- 172.21.15.103:0/1456027014 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7e00044d0 msgr2=0x7ff7e0004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:42.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.992+0000 7ff806071700 1 --2- 172.21.15.103:0/1456027014 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7e00044d0 0x7ff7e0004950 secure :-1 s=READY pgs=499 cs=0 l=1 rx=0x7ff7e80010d0 tx=0x7ff7e800fe50).stop 2020-04-22T14:05:42.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.992+0000 7ff7fffff700 1 -- 172.21.15.103:0/1456027014 reap_dead start 2020-04-22T14:05:42.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.992+0000 7ff806071700 1 -- 172.21.15.103:0/1456027014 shutdown_connections 2020-04-22T14:05:42.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.992+0000 7ff806071700 1 -- 172.21.15.103:0/1456027014 >> 172.21.15.103:0/1456027014 conn(0x7ff8000b9160 msgr2=0x7ff80005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:42.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.992+0000 7ff806071700 1 -- 172.21.15.103:0/1456027014 shutdown_connections 2020-04-22T14:05:42.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.992+0000 7ff806071700 1 -- 172.21.15.103:0/1456027014 wait complete. 2020-04-22T14:05:42.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.993+0000 7ff806071700 1 Processor -- start 2020-04-22T14:05:42.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.993+0000 7ff806071700 1 -- start start 2020-04-22T14:05:42.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.994+0000 7ff806071700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff80014cb50 0x7ff800158240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:42.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.994+0000 7ff806071700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff80014df80 0x7ff8000b0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:42.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.994+0000 7ff806071700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8000afea0 con 0x7ff8000adea0 2020-04-22T14:05:42.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.994+0000 7ff806071700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff80014cf30 con 0x7ff80014df80 2020-04-22T14:05:42.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.994+0000 7ff806071700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8000b0140 con 0x7ff80014cb50 2020-04-22T14:05:42.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.994+0000 7ff7ff7fe700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff80014cb50 0x7ff800158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:42.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.994+0000 7ff7ff7fe700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff80014cb50 0x7ff800158240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:34074/0 (socket says 172.21.15.103:34074) 2020-04-22T14:05:42.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.994+0000 7ff7ff7fe700 1 -- 172.21.15.103:0/832211152 learned_addr learned my addr 172.21.15.103:0/832211152 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:05:42.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.994+0000 7ff7feffd700 1 --2- 172.21.15.103:0/832211152 >> v2:172.21.15.86:3300/0 conn(0x7ff80014df80 0x7ff8000b0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:42.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.995+0000 7ff7feffd700 1 -- 172.21.15.103:0/832211152 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff80014cb50 msgr2=0x7ff800158240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:42.016 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.995+0000 7ff7feffd700 1 --2- 172.21.15.103:0/832211152 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff80014cb50 0x7ff800158240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:42.016 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.995+0000 7ff7feffd700 1 -- 172.21.15.103:0/832211152 >> v1:172.21.15.86:6789/0 conn(0x7ff8000adea0 legacy=0x7ff8000ac850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:42.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.995+0000 7ff7fcff9700 1 -- 172.21.15.103:0/832211152 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3261136605 0 0) 0x7ff8000afea0 con 0x7ff8000adea0 2020-04-22T14:05:42.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.995+0000 7ff7feffd700 1 -- 172.21.15.103:0/832211152 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8000b03e0 con 0x7ff80014df80 2020-04-22T14:05:42.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.995+0000 7ff7ff7fe700 1 --2- 172.21.15.103:0/832211152 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff80014cb50 0x7ff800158240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:05:42.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.995+0000 7ff7feffd700 1 --2- 172.21.15.103:0/832211152 >> v2:172.21.15.86:3300/0 conn(0x7ff80014df80 0x7ff8000b0880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff7e80010d0 tx=0x7ff7e800fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.995+0000 7ff7feffd700 1 --2- 172.21.15.103:0/832211152 >> v2:172.21.15.86:3300/0 conn(0x7ff80014df80 0x7ff8000b0880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff7e80010d0 tx=0x7ff7e800fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.995+0000 7ff7feffd700 1 --2- 172.21.15.103:0/832211152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff80014df80 0x7ff8000b0880 secure :-1 s=READY pgs=284 cs=0 l=1 rx=0x7ff7e80010d0 tx=0x7ff7e800fe50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:42.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.995+0000 7ff7feffd700 1 --2- 172.21.15.103:0/832211152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff80014df80 0x7ff8000b0880 secure :-1 s=THROTTLE_DONE pgs=284 cs=0 l=1 rx=0x7ff7e80010d0 tx=0x7ff7e800fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.995+0000 7ff7fcff9700 1 -- 172.21.15.103:0/832211152 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7e80012b0 con 0x7ff80014df80 2020-04-22T14:05:42.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.995+0000 7ff7feffd700 1 --2- 172.21.15.103:0/832211152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff80014df80 0x7ff8000b0880 secure :-1 s=THROTTLE_DONE pgs=284 cs=0 l=1 rx=0x7ff7e80010d0 tx=0x7ff7e800fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.995+0000 7ff7fcff9700 1 -- 172.21.15.103:0/832211152 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e8012480 con 0x7ff80014df80 2020-04-22T14:05:42.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.995+0000 7ff806071700 1 -- 172.21.15.103:0/832211152 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8001586a0 con 0x7ff80014df80 2020-04-22T14:05:42.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.995+0000 7ff7feffd700 1 --2- 172.21.15.103:0/832211152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff80014df80 0x7ff8000b0880 secure :-1 s=THROTTLE_DONE pgs=284 cs=0 l=1 rx=0x7ff7e80010d0 tx=0x7ff7e800fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.995+0000 7ff7fcff9700 1 -- 172.21.15.103:0/832211152 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7e8012820 con 0x7ff80014df80 2020-04-22T14:05:42.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.995+0000 7ff806071700 1 -- 172.21.15.103:0/832211152 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8000b0ea0 con 0x7ff80014df80 2020-04-22T14:05:42.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.996+0000 7ff7feffd700 1 --2- 172.21.15.103:0/832211152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff80014df80 0x7ff8000b0880 secure :-1 s=THROTTLE_DONE pgs=284 cs=0 l=1 rx=0x7ff7e80010d0 tx=0x7ff7e800fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.996+0000 7ff806071700 1 -- 172.21.15.103:0/832211152 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8000ad2e0 con 0x7ff80014df80 2020-04-22T14:05:42.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.996+0000 7ff7fcff9700 1 -- 172.21.15.103:0/832211152 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ff7e800b0b0 con 0x7ff80014df80 2020-04-22T14:05:42.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.996+0000 7ff7feffd700 1 --2- 172.21.15.103:0/832211152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff80014df80 0x7ff8000b0880 secure :-1 s=THROTTLE_DONE pgs=284 cs=0 l=1 rx=0x7ff7e80010d0 tx=0x7ff7e800fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.996+0000 7ff7fcff9700 1 --2- 172.21.15.103:0/832211152 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff7e404d8b0 0x7ff7e404fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:42.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.996+0000 7ff7fcff9700 1 -- 172.21.15.103:0/832211152 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5253+0+0 (secure 0 0 0) 0x7ff7e8061c10 con 0x7ff80014df80 2020-04-22T14:05:42.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.997+0000 7ff7ff7fe700 1 --2- 172.21.15.103:0/832211152 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff7e404d8b0 0x7ff7e404fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:42.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.997+0000 7ff7ff7fe700 1 --2- 172.21.15.103:0/832211152 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff7e404d8b0 0x7ff7e404fd70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff7f00033f0 tx=0x7ff7f000ae50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.997+0000 7ff7ff7fe700 1 --2- 172.21.15.103:0/832211152 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff7e404d8b0 0x7ff7e404fd70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff7f00033f0 tx=0x7ff7f000ae50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:41.997+0000 7ff7ff7fe700 1 --2- 172.21.15.103:0/832211152 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff7e404d8b0 0x7ff7e404fd70 secure :-1 s=READY pgs=199 cs=0 l=1 rx=0x7ff7f00033f0 tx=0x7ff7f000ae50).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:42.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.000+0000 7ff7feffd700 1 --2- 172.21.15.103:0/832211152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff80014df80 0x7ff8000b0880 secure :-1 s=THROTTLE_DONE pgs=284 cs=0 l=1 rx=0x7ff7e80010d0 tx=0x7ff7e800fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.000+0000 7ff7fcff9700 1 -- 172.21.15.103:0/832211152 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ff7e803cff0 con 0x7ff80014df80 2020-04-22T14:05:42.194 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.192+0000 7ff806071700 1 -- 172.21.15.103:0/832211152 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff800056c90 con 0x7ff80014df80 2020-04-22T14:05:42.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.193+0000 7ff7feffd700 1 --2- 172.21.15.103:0/832211152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff80014df80 0x7ff8000b0880 secure :-1 s=THROTTLE_DONE pgs=284 cs=0 l=1 rx=0x7ff7e80010d0 tx=0x7ff7e800fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.193+0000 7ff7fcff9700 1 -- 172.21.15.103:0/832211152 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+4513 (secure 0 0 0) 0x7ff7e8040610 con 0x7ff80014df80 2020-04-22T14:05:42.195 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:05:42.196 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:05:42.196 INFO:teuthology.orchestra.run.smithi103.stdout: "auth_dump": [ 2020-04-22T14:05:42.196 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:42.196 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.a", 2020-04-22T14:05:42.196 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBeliD5IBAAjC7UikdEP8FeE2rKs/ympw==", 2020-04-22T14:05:42.197 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:05:42.197 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:05:42.197 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:05:42.197 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:05:42.197 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:05:42.197 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:42.197 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:42.197 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:42.198 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.b", 2020-04-22T14:05:42.198 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBepkqQLBAA4aMKXxROQugglhm4aBd1Iw==", 2020-04-22T14:05:42.198 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:05:42.198 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:05:42.198 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:05:42.198 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:05:42.199 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:05:42.199 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:42.199 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:42.199 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:42.199 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.0", 2020-04-22T14:05:42.199 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA2TqBehMJiBxAARaWo32QGx49PxImGafnOFw==", 2020-04-22T14:05:42.199 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:05:42.200 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:05:42.200 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:05:42.200 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:05:42.200 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:42.200 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:42.200 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:42.200 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.1", 2020-04-22T14:05:42.201 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA4TqBeiAAcKRAAEHuaqbsB+NLUTSgFOCOFZg==", 2020-04-22T14:05:42.201 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:05:42.201 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:05:42.201 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:05:42.201 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:05:42.201 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:42.202 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:42.202 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:42.202 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.2", 2020-04-22T14:05:42.202 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA7TqBebeRzDxAAsjRyvJektq7MQ+334kU+UQ==", 2020-04-22T14:05:42.202 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:05:42.202 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:05:42.203 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:05:42.203 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:05:42.203 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:42.203 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:42.203 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:42.204 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.3", 2020-04-22T14:05:42.204 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA9TqBehxmSMRAATZ0o/ZnxHp2m/tqLmv6JwA==", 2020-04-22T14:05:42.204 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:05:42.204 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:05:42.204 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:05:42.204 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:05:42.204 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:42.205 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:42.205 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:42.205 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.4", 2020-04-22T14:05:42.205 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBETqBePwJSBRAAXgMKuX3EILi3gy8QzR4cig==", 2020-04-22T14:05:42.205 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:05:42.205 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:05:42.206 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:05:42.206 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:05:42.206 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:42.213 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:42.213 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:42.213 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.5", 2020-04-22T14:05:42.213 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBGTqBe5l++KRAAHIWG6bBnru2EVXv/drAL0g==", 2020-04-22T14:05:42.213 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:05:42.213 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:05:42.214 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:05:42.214 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:05:42.214 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:42.214 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:42.214 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:42.214 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.6", 2020-04-22T14:05:42.215 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBJTqBe88rTEBAAO2Z78NZLTYIbBpYovBSHVQ==", 2020-04-22T14:05:42.215 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:05:42.215 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:05:42.215 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:05:42.215 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:05:42.215 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:42.215 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:42.215 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:42.216 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.7", 2020-04-22T14:05:42.216 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBLTqBeGNFIMxAARIXhPNM6xurdnDv8+xZqUw==", 2020-04-22T14:05:42.216 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:05:42.217 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:05:42.217 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:05:42.218 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:05:42.218 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:42.220 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:42.220 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:42.220 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.0", 2020-04-22T14:05:42.220 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBe5ooUNxAA9zBtv6+i3Xl9iYtRl4xKGg==", 2020-04-22T14:05:42.220 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:05:42.220 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:05:42.221 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:05:42.221 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:05:42.221 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:42.221 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:42.221 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:42.222 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.1", 2020-04-22T14:05:42.222 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAyTqBe0bioBBAAVpoQouA/QICwqRoaFbjkiA==", 2020-04-22T14:05:42.222 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:05:42.222 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:05:42.222 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:05:42.222 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:05:42.223 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:42.223 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:42.223 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:42.223 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.2", 2020-04-22T14:05:42.223 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAyTqBemwpXCxAAObNL96zS67nMEe4MLjrEtw==", 2020-04-22T14:05:42.223 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:05:42.223 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:05:42.224 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:05:42.224 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:05:42.224 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:42.224 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:42.224 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:42.224 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.3", 2020-04-22T14:05:42.229 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAyTqBemGxNFBAAlqvB8FeZbMRwvzVjBpH/tA==", 2020-04-22T14:05:42.229 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:05:42.229 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:05:42.229 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:05:42.229 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:05:42.232 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:42.232 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:42.233 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:42.233 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.admin", 2020-04-22T14:05:42.233 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAwTqBeSx5dHxAAH0jPkaiWEwpr66ROWwbU8Q==", 2020-04-22T14:05:42.233 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:05:42.233 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2020-04-22T14:05:42.233 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:05:42.234 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:05:42.234 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:05:42.234 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:42.234 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:42.234 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:42.234 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mgr.x", 2020-04-22T14:05:42.235 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBe3YVhGhAAWAf6f9sV3bzoucBBPS3j2g==", 2020-04-22T14:05:42.235 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:05:42.235 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2020-04-22T14:05:42.235 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile mgr", 2020-04-22T14:05:42.235 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:05:42.235 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:42.235 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:42.235 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:42.236 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mgr.y", 2020-04-22T14:05:42.236 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBeX8AXExAAhh/N+/ogdKlxmkveSM60+g==", 2020-04-22T14:05:42.236 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:05:42.236 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2020-04-22T14:05:42.236 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile mgr", 2020-04-22T14:05:42.236 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:05:42.236 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:42.237 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:42.237 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:05:42.237 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:05:42.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.194+0000 7ff806071700 1 -- 172.21.15.103:0/832211152 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff7e404d8b0 msgr2=0x7ff7e404fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:42.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.194+0000 7ff806071700 1 --2- 172.21.15.103:0/832211152 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff7e404d8b0 0x7ff7e404fd70 secure :-1 s=READY pgs=199 cs=0 l=1 rx=0x7ff7f00033f0 tx=0x7ff7f000ae50).stop 2020-04-22T14:05:42.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.194+0000 7ff806071700 1 -- 172.21.15.103:0/832211152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff80014df80 msgr2=0x7ff8000b0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:42.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.195+0000 7ff806071700 1 --2- 172.21.15.103:0/832211152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff80014df80 0x7ff8000b0880 secure :-1 s=READY pgs=284 cs=0 l=1 rx=0x7ff7e80010d0 tx=0x7ff7e800fe50).stop 2020-04-22T14:05:42.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.195+0000 7ff806071700 1 -- 172.21.15.103:0/832211152 shutdown_connections 2020-04-22T14:05:42.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.195+0000 7ff806071700 1 --2- 172.21.15.103:0/832211152 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff80014cb50 0x7ff800158240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:42.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.195+0000 7ff806071700 1 --2- 172.21.15.103:0/832211152 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff7e404d8b0 0x7ff7e404fd70 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:42.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.195+0000 7ff806071700 1 --2- 172.21.15.103:0/832211152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff80014df80 0x7ff8000b0880 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:42.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.195+0000 7ff806071700 1 -- 172.21.15.103:0/832211152 >> 172.21.15.103:0/832211152 conn(0x7ff8000b9160 msgr2=0x7ff80005ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:42.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.195+0000 7ff806071700 1 -- 172.21.15.103:0/832211152 shutdown_connections 2020-04-22T14:05:42.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.195+0000 7ff806071700 1 -- 172.21.15.103:0/832211152 wait complete. 2020-04-22T14:05:42.241 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:42.256 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:05:42.413 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.399+0000 7f37ffab5700 1 Processor -- start 2020-04-22T14:05:42.413 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.399+0000 7f37ffab5700 1 -- start start 2020-04-22T14:05:42.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.400+0000 7f37ffab5700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f37f812c0d0 0x7f37f81464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:42.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.400+0000 7f37ffab5700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f37f8063e30 0x7f37f80642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:42.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.400+0000 7f37ffab5700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37f8143300 con 0x7f37f8065fe0 2020-04-22T14:05:42.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.400+0000 7f37ffab5700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37f81435a0 con 0x7f37f812c0d0 2020-04-22T14:05:42.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.400+0000 7f37ffab5700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f8143840 con 0x7f37f8063e30 2020-04-22T14:05:42.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.400+0000 7f37fd851700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f37f812c0d0 0x7f37f81464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:42.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.400+0000 7f37fe052700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f37f8063e30 0x7f37f80642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:42.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.401+0000 7f37fd050700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f37f8065fe0 0x7f37f805b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:58648/0 (socket says 172.21.15.103:58648) 2020-04-22T14:05:42.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.401+0000 7f37fe052700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f37f8063e30 0x7f37f80642c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:34080/0 (socket says 172.21.15.103:34080) 2020-04-22T14:05:42.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.401+0000 7f37fd851700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f37f812c0d0 0x7f37f81464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:46534/0 (socket says 172.21.15.103:46534) 2020-04-22T14:05:42.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.401+0000 7f37fd050700 1 -- 172.21.15.103:0/3367762562 learned_addr learned my addr 172.21.15.103:0/3367762562 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:42.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.401+0000 7f37fd851700 1 -- 172.21.15.103:0/3367762562 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f37f8063e30 msgr2=0x7f37f80642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:42.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.401+0000 7f37fd851700 1 --2- 172.21.15.103:0/3367762562 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f37f8063e30 0x7f37f80642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:42.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.401+0000 7f37fd851700 1 -- 172.21.15.103:0/3367762562 >> v1:172.21.15.86:6789/0 conn(0x7f37f8065fe0 legacy=0x7f37f805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:42.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.401+0000 7f37fd851700 1 -- 172.21.15.103:0/3367762562 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f805bb50 con 0x7f37f812c0d0 2020-04-22T14:05:42.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.401+0000 7f37fc84f700 1 -- 172.21.15.103:0/3367762562 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1774791792 0 0) 0x7f37f8143300 con 0x7f37f8065fe0 2020-04-22T14:05:42.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.401+0000 7f37fe052700 1 --2- 172.21.15.103:0/3367762562 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f37f8063e30 0x7f37f80642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:05:42.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.401+0000 7f37fd851700 1 --2- 172.21.15.103:0/3367762562 >> v2:172.21.15.86:3300/0 conn(0x7f37f812c0d0 0x7f37f81464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f37f4002f30 tx=0x7f37f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.401+0000 7f37fd851700 1 --2- 172.21.15.103:0/3367762562 >> v2:172.21.15.86:3300/0 conn(0x7f37f812c0d0 0x7f37f81464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f37f4002f30 tx=0x7f37f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.401+0000 7f37fd851700 1 --2- 172.21.15.103:0/3367762562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37f812c0d0 0x7f37f81464e0 secure :-1 s=READY pgs=286 cs=0 l=1 rx=0x7f37f4002f30 tx=0x7f37f4007a40).ready entity=mon.0 client_cookie=de809cbba164f711 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:42.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.401+0000 7f37fd851700 1 --2- 172.21.15.103:0/3367762562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37f812c0d0 0x7f37f81464e0 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7f37f4002f30 tx=0x7f37f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.401+0000 7f37fc84f700 1 -- 172.21.15.103:0/3367762562 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37f40113c0 con 0x7f37f812c0d0 2020-04-22T14:05:42.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.401+0000 7f37fd851700 1 --2- 172.21.15.103:0/3367762562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37f812c0d0 0x7f37f81464e0 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7f37f4002f30 tx=0x7f37f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.401+0000 7f37fd851700 1 --2- 172.21.15.103:0/3367762562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37f812c0d0 0x7f37f81464e0 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7f37f4002f30 tx=0x7f37f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.401+0000 7f37fc84f700 1 -- 172.21.15.103:0/3367762562 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f4011560 con 0x7f37f812c0d0 2020-04-22T14:05:42.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.401+0000 7f37fc84f700 1 -- 172.21.15.103:0/3367762562 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37f4011940 con 0x7f37f812c0d0 2020-04-22T14:05:42.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.401+0000 7f37ffab5700 1 -- 172.21.15.103:0/3367762562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37f812c0d0 msgr2=0x7f37f81464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:42.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.401+0000 7f37ffab5700 1 --2- 172.21.15.103:0/3367762562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37f812c0d0 0x7f37f81464e0 secure :-1 s=READY pgs=286 cs=0 l=1 rx=0x7f37f4002f30 tx=0x7f37f4007a40).stop 2020-04-22T14:05:42.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.402+0000 7f37ffab5700 1 -- 172.21.15.103:0/3367762562 shutdown_connections 2020-04-22T14:05:42.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.402+0000 7f37ffab5700 1 --2- 172.21.15.103:0/3367762562 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f37f8063e30 0x7f37f80642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:42.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.402+0000 7f37ffab5700 1 --2- 172.21.15.103:0/3367762562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37f812c0d0 0x7f37f81464e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:42.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.402+0000 7f37ffab5700 1 -- 172.21.15.103:0/3367762562 >> 172.21.15.103:0/3367762562 conn(0x7f37f80b9160 msgr2=0x7f37f805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:42.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.402+0000 7f37ffab5700 1 -- 172.21.15.103:0/3367762562 shutdown_connections 2020-04-22T14:05:42.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.402+0000 7f37ffab5700 1 -- 172.21.15.103:0/3367762562 wait complete. 2020-04-22T14:05:42.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.403+0000 7f37ffab5700 1 Processor -- start 2020-04-22T14:05:42.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.403+0000 7f37ffab5700 1 -- start start 2020-04-22T14:05:42.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.403+0000 7f37ffab5700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f37f8063e30 0x7f37f8153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:42.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.403+0000 7f37ffab5700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37f8154e70 con 0x7f37f812c0d0 2020-04-22T14:05:42.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.403+0000 7f37ffab5700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37f8157980 con 0x7f37f8065fe0 2020-04-22T14:05:42.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.403+0000 7f37ffab5700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37f8157c20 con 0x7f37f8063e30 2020-04-22T14:05:42.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.403+0000 7f37fd851700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f37f8063e30 0x7f37f8153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:42.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.403+0000 7f37fd050700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f37f8065fe0 0x7f37f8141eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41500/0 (socket says 172.21.15.103:41500) 2020-04-22T14:05:42.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.403+0000 7f37fd851700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f37f8063e30 0x7f37f8153ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49308/0 (socket says 172.21.15.103:49308) 2020-04-22T14:05:42.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.403+0000 7f37fd050700 1 -- 172.21.15.103:0/4064313533 learned_addr learned my addr 172.21.15.103:0/4064313533 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:42.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.404+0000 7f37fd851700 1 -- 172.21.15.103:0/4064313533 >> v1:172.21.15.103:6789/0 conn(0x7f37f8065fe0 legacy=0x7f37f8141eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:42.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.404+0000 7f37fd851700 1 -- 172.21.15.103:0/4064313533 >> v1:172.21.15.86:6789/0 conn(0x7f37f812c0d0 legacy=0x7f37f80b0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:42.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.404+0000 7f37fd851700 1 -- 172.21.15.103:0/4064313533 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f8157ec0 con 0x7f37f8063e30 2020-04-22T14:05:42.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.404+0000 7f37eaffd700 1 -- 172.21.15.103:0/4064313533 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 490840614 0 0) 0x7f37f8157980 con 0x7f37f8065fe0 2020-04-22T14:05:42.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.404+0000 7f37fd851700 1 --2- 172.21.15.103:0/4064313533 >> v2:172.21.15.103:3300/0 conn(0x7f37f8063e30 0x7f37f8153ce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f37f4002f30 tx=0x7f37f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.404+0000 7f37fd851700 1 --2- 172.21.15.103:0/4064313533 >> v2:172.21.15.103:3300/0 conn(0x7f37f8063e30 0x7f37f8153ce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f37f4002f30 tx=0x7f37f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.404+0000 7f37fd851700 1 --2- 172.21.15.103:0/4064313533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37f8063e30 0x7f37f8153ce0 secure :-1 s=READY pgs=501 cs=0 l=1 rx=0x7f37f4002f30 tx=0x7f37f4007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:42.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.404+0000 7f37fd851700 1 --2- 172.21.15.103:0/4064313533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37f8063e30 0x7f37f8153ce0 secure :-1 s=THROTTLE_DONE pgs=501 cs=0 l=1 rx=0x7f37f4002f30 tx=0x7f37f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.404+0000 7f37eaffd700 1 -- 172.21.15.103:0/4064313533 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37f4007170 con 0x7f37f8063e30 2020-04-22T14:05:42.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.404+0000 7f37fd851700 1 --2- 172.21.15.103:0/4064313533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37f8063e30 0x7f37f8153ce0 secure :-1 s=THROTTLE_DONE pgs=501 cs=0 l=1 rx=0x7f37f4002f30 tx=0x7f37f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.404+0000 7f37eaffd700 1 -- 172.21.15.103:0/4064313533 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f40072d0 con 0x7f37f8063e30 2020-04-22T14:05:42.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.404+0000 7f37ffab5700 1 -- 172.21.15.103:0/4064313533 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37f81425c0 con 0x7f37f8063e30 2020-04-22T14:05:42.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.404+0000 7f37fd851700 1 --2- 172.21.15.103:0/4064313533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37f8063e30 0x7f37f8153ce0 secure :-1 s=THROTTLE_DONE pgs=501 cs=0 l=1 rx=0x7f37f4002f30 tx=0x7f37f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.404+0000 7f37eaffd700 1 -- 172.21.15.103:0/4064313533 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37f40056c0 con 0x7f37f8063e30 2020-04-22T14:05:42.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.404+0000 7f37ffab5700 1 -- 172.21.15.103:0/4064313533 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37f80b5700 con 0x7f37f8063e30 2020-04-22T14:05:42.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.405+0000 7f37fd851700 1 --2- 172.21.15.103:0/4064313533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37f8063e30 0x7f37f8153ce0 secure :-1 s=THROTTLE_DONE pgs=501 cs=0 l=1 rx=0x7f37f4002f30 tx=0x7f37f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.405+0000 7f37eaffd700 1 -- 172.21.15.103:0/4064313533 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f37f40058c0 con 0x7f37f8063e30 2020-04-22T14:05:42.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.405+0000 7f37fd851700 1 --2- 172.21.15.103:0/4064313533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37f8063e30 0x7f37f8153ce0 secure :-1 s=THROTTLE_DONE pgs=501 cs=0 l=1 rx=0x7f37f4002f30 tx=0x7f37f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.405+0000 7f37ffab5700 1 -- 172.21.15.103:0/4064313533 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37f8056c90 con 0x7f37f8063e30 2020-04-22T14:05:42.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.405+0000 7f37eaffd700 1 --2- 172.21.15.103:0/4064313533 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f37d804d8e0 0x7f37d804fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:42.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.405+0000 7f37eaffd700 1 -- 172.21.15.103:0/4064313533 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f37f4061c40 con 0x7f37f8063e30 2020-04-22T14:05:42.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.405+0000 7f37fd050700 1 --2- 172.21.15.103:0/4064313533 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f37d804d8e0 0x7f37d804fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:42.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.406+0000 7f37fd050700 1 --2- 172.21.15.103:0/4064313533 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f37d804d8e0 0x7f37d804fda0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f37ec001130 tx=0x7f37ec0016a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.406+0000 7f37fd050700 1 --2- 172.21.15.103:0/4064313533 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f37d804d8e0 0x7f37d804fda0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f37ec001130 tx=0x7f37ec0016a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.406+0000 7f37fd050700 1 --2- 172.21.15.103:0/4064313533 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f37d804d8e0 0x7f37d804fda0 secure :-1 s=READY pgs=200 cs=0 l=1 rx=0x7f37ec001130 tx=0x7f37ec0016a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:42.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.409+0000 7f37fd851700 1 --2- 172.21.15.103:0/4064313533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37f8063e30 0x7f37f8153ce0 secure :-1 s=THROTTLE_DONE pgs=501 cs=0 l=1 rx=0x7f37f4002f30 tx=0x7f37f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.409+0000 7f37eaffd700 1 -- 172.21.15.103:0/4064313533 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f37f403d080 con 0x7f37f8063e30 2020-04-22T14:05:42.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.552+0000 7f37ffab5700 1 -- 172.21.15.103:0/4064313533 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37f8147360 con 0x7f37f8063e30 2020-04-22T14:05:42.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.555+0000 7f37fd851700 1 --2- 172.21.15.103:0/4064313533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37f8063e30 0x7f37f8153ce0 secure :-1 s=THROTTLE_DONE pgs=501 cs=0 l=1 rx=0x7f37f4002f30 tx=0x7f37f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.555+0000 7f37eaffd700 1 -- 172.21.15.103:0/4064313533 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+13232 (secure 0 0 0) 0x7f37f40406a0 con 0x7f37f8063e30 2020-04-22T14:05:42.558 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:05:42.558 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":41,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:05:41.765303+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:05:42.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.557+0000 7f37ffab5700 1 -- 172.21.15.103:0/4064313533 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f37d804d8e0 msgr2=0x7f37d804fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:42.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.557+0000 7f37ffab5700 1 --2- 172.21.15.103:0/4064313533 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f37d804d8e0 0x7f37d804fda0 secure :-1 s=READY pgs=200 cs=0 l=1 rx=0x7f37ec001130 tx=0x7f37ec0016a0).stop 2020-04-22T14:05:42.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.557+0000 7f37ffab5700 1 -- 172.21.15.103:0/4064313533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37f8063e30 msgr2=0x7f37f8153ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:42.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.557+0000 7f37ffab5700 1 --2- 172.21.15.103:0/4064313533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37f8063e30 0x7f37f8153ce0 secure :-1 s=READY pgs=501 cs=0 l=1 rx=0x7f37f4002f30 tx=0x7f37f4007a40).stop 2020-04-22T14:05:42.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.557+0000 7f37ffab5700 1 -- 172.21.15.103:0/4064313533 shutdown_connections 2020-04-22T14:05:42.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.557+0000 7f37ffab5700 1 --2- 172.21.15.103:0/4064313533 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f37d804d8e0 0x7f37d804fda0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:42.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.557+0000 7f37ffab5700 1 --2- 172.21.15.103:0/4064313533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37f8063e30 0x7f37f8153ce0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:42.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.557+0000 7f37ffab5700 1 -- 172.21.15.103:0/4064313533 >> 172.21.15.103:0/4064313533 conn(0x7f37f80b9160 msgr2=0x7f37f80656f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:42.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.557+0000 7f37ffab5700 1 -- 172.21.15.103:0/4064313533 shutdown_connections 2020-04-22T14:05:42.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.557+0000 7f37ffab5700 1 -- 172.21.15.103:0/4064313533 wait complete. 2020-04-22T14:05:42.570 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:05:42.570 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:42.583 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:05:42.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.729+0000 7fbd7b798700 1 Processor -- start 2020-04-22T14:05:42.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.729+0000 7fbd7b798700 1 -- start start 2020-04-22T14:05:42.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.730+0000 7fbd7b798700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbd740b9140 0x7fbd7412b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:42.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.730+0000 7fbd7b798700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbd740ac950 0x7fbd7412b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:42.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.730+0000 7fbd7b798700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd741467e0 con 0x7fbd74146c40 2020-04-22T14:05:42.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.730+0000 7fbd7b798700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd740602f0 con 0x7fbd740b9140 2020-04-22T14:05:42.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.730+0000 7fbd7b798700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd74060050 con 0x7fbd740ac950 2020-04-22T14:05:42.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.730+0000 7fbd78d33700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbd740ac950 0x7fbd7412b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:42.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.730+0000 7fbd78d33700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbd740ac950 0x7fbd7412b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49316/0 (socket says 172.21.15.103:49316) 2020-04-22T14:05:42.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.730+0000 7fbd78d33700 1 -- 172.21.15.103:0/2608517793 learned_addr learned my addr 172.21.15.103:0/2608517793 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:05:42.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.731+0000 7fbd79534700 1 --2- 172.21.15.103:0/2608517793 >> v2:172.21.15.86:3300/0 conn(0x7fbd740b9140 0x7fbd7412b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:42.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.731+0000 7fbd78d33700 1 -- 172.21.15.103:0/2608517793 >> v2:172.21.15.86:3300/0 conn(0x7fbd740b9140 msgr2=0x7fbd7412b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:42.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.731+0000 7fbd78d33700 1 --2- 172.21.15.103:0/2608517793 >> v2:172.21.15.86:3300/0 conn(0x7fbd740b9140 0x7fbd7412b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:42.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.731+0000 7fbd78d33700 1 -- 172.21.15.103:0/2608517793 >> v1:172.21.15.86:6789/0 conn(0x7fbd74146c40 legacy=0x7fbd74143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:42.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.731+0000 7fbd78d33700 1 -- 172.21.15.103:0/2608517793 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd740b9520 con 0x7fbd740ac950 2020-04-22T14:05:42.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.731+0000 7fbd78d33700 1 --2- 172.21.15.103:0/2608517793 >> v2:172.21.15.103:3300/0 conn(0x7fbd740ac950 0x7fbd7412b670 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbd740b6250 tx=0x7fbd70007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.731+0000 7fbd78d33700 1 --2- 172.21.15.103:0/2608517793 >> v2:172.21.15.103:3300/0 conn(0x7fbd740ac950 0x7fbd7412b670 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbd740b6250 tx=0x7fbd70007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.731+0000 7fbd78d33700 1 --2- 172.21.15.103:0/2608517793 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd740ac950 0x7fbd7412b670 secure :-1 s=READY pgs=502 cs=0 l=1 rx=0x7fbd740b6250 tx=0x7fbd70007a40).ready entity=mon.1 client_cookie=7d078386fc7f380 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:42.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.731+0000 7fbd78d33700 1 --2- 172.21.15.103:0/2608517793 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd740ac950 0x7fbd7412b670 secure :-1 s=THROTTLE_DONE pgs=502 cs=0 l=1 rx=0x7fbd740b6250 tx=0x7fbd70007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.731+0000 7fbd63fff700 1 -- 172.21.15.103:0/2608517793 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd700116e0 con 0x7fbd740ac950 2020-04-22T14:05:42.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.731+0000 7fbd78d33700 1 --2- 172.21.15.103:0/2608517793 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd740ac950 0x7fbd7412b670 secure :-1 s=THROTTLE_DONE pgs=502 cs=0 l=1 rx=0x7fbd740b6250 tx=0x7fbd70007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.731+0000 7fbd78d33700 1 --2- 172.21.15.103:0/2608517793 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd740ac950 0x7fbd7412b670 secure :-1 s=THROTTLE_DONE pgs=502 cs=0 l=1 rx=0x7fbd740b6250 tx=0x7fbd70007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.731+0000 7fbd63fff700 1 -- 172.21.15.103:0/2608517793 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd70011840 con 0x7fbd740ac950 2020-04-22T14:05:42.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.731+0000 7fbd63fff700 1 -- 172.21.15.103:0/2608517793 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd70011c20 con 0x7fbd740ac950 2020-04-22T14:05:42.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.731+0000 7fbd7b798700 1 -- 172.21.15.103:0/2608517793 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd740ac950 msgr2=0x7fbd7412b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:42.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.731+0000 7fbd7b798700 1 --2- 172.21.15.103:0/2608517793 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd740ac950 0x7fbd7412b670 secure :-1 s=READY pgs=502 cs=0 l=1 rx=0x7fbd740b6250 tx=0x7fbd70007a40).stop 2020-04-22T14:05:42.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.732+0000 7fbd7b798700 1 -- 172.21.15.103:0/2608517793 shutdown_connections 2020-04-22T14:05:42.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.732+0000 7fbd7b798700 1 --2- 172.21.15.103:0/2608517793 >> v2:172.21.15.86:3300/0 conn(0x7fbd740b9140 0x7fbd7412b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:42.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.732+0000 7fbd7b798700 1 --2- 172.21.15.103:0/2608517793 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd740ac950 0x7fbd7412b670 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:42.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.732+0000 7fbd7b798700 1 -- 172.21.15.103:0/2608517793 >> 172.21.15.103:0/2608517793 conn(0x7fbd7405b7b0 msgr2=0x7fbd740b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:42.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.732+0000 7fbd7b798700 1 -- 172.21.15.103:0/2608517793 shutdown_connections 2020-04-22T14:05:42.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.732+0000 7fbd7b798700 1 -- 172.21.15.103:0/2608517793 wait complete. 2020-04-22T14:05:42.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.733+0000 7fbd7b798700 1 Processor -- start 2020-04-22T14:05:42.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.733+0000 7fbd7b798700 1 -- start start 2020-04-22T14:05:42.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.733+0000 7fbd7b798700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbd740ac950 0x7fbd740b2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:42.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.733+0000 7fbd7b798700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbd740b9140 0x7fbd740b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:42.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.733+0000 7fbd7b798700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbd74146c40 0x7fbd7412a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:42.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.733+0000 7fbd7b798700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd7413f5c0 con 0x7fbd74146c40 2020-04-22T14:05:42.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.733+0000 7fbd7b798700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd7412a8d0 con 0x7fbd740ac950 2020-04-22T14:05:42.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.733+0000 7fbd7b798700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7413f7b0 con 0x7fbd740b9140 2020-04-22T14:05:42.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.733+0000 7fbd79534700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbd740ac950 0x7fbd740b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:42.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.733+0000 7fbd79534700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbd740ac950 0x7fbd740b2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49320/0 (socket says 172.21.15.103:49320) 2020-04-22T14:05:42.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.733+0000 7fbd79534700 1 -- 172.21.15.103:0/2356137800 learned_addr learned my addr 172.21.15.103:0/2356137800 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:05:42.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.733+0000 7fbd78d33700 1 --2- 172.21.15.103:0/2356137800 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbd740b9140 0x7fbd740b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:42.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.733+0000 7fbd79d35700 1 --2- 172.21.15.103:0/2356137800 >> v2:172.21.15.86:3300/0 conn(0x7fbd74146c40 0x7fbd7412a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:42.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.734+0000 7fbd79534700 1 -- 172.21.15.103:0/2356137800 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbd740b9140 msgr2=0x7fbd740b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:42.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.734+0000 7fbd79534700 1 --2- 172.21.15.103:0/2356137800 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbd740b9140 0x7fbd740b0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:42.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.734+0000 7fbd79534700 1 -- 172.21.15.103:0/2356137800 >> v2:172.21.15.86:3300/0 conn(0x7fbd74146c40 msgr2=0x7fbd7412a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:42.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.734+0000 7fbd79534700 1 --2- 172.21.15.103:0/2356137800 >> v2:172.21.15.86:3300/0 conn(0x7fbd74146c40 0x7fbd7412a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:42.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.734+0000 7fbd79534700 1 -- 172.21.15.103:0/2356137800 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd7413fa50 con 0x7fbd740ac950 2020-04-22T14:05:42.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.734+0000 7fbd79d35700 1 --2- 172.21.15.103:0/2356137800 >> v2:172.21.15.86:3300/0 conn(0x7fbd74146c40 0x7fbd7412a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:05:42.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.734+0000 7fbd79534700 1 --2- 172.21.15.103:0/2356137800 >> v2:172.21.15.103:3300/0 conn(0x7fbd740ac950 0x7fbd740b2450 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbd64002f30 tx=0x7fbd64010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.734+0000 7fbd79534700 1 --2- 172.21.15.103:0/2356137800 >> v2:172.21.15.103:3300/0 conn(0x7fbd740ac950 0x7fbd740b2450 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbd64002f30 tx=0x7fbd64010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.734+0000 7fbd79534700 1 --2- 172.21.15.103:0/2356137800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd740ac950 0x7fbd740b2450 secure :-1 s=READY pgs=503 cs=0 l=1 rx=0x7fbd64002f30 tx=0x7fbd64010c30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:42.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.734+0000 7fbd79534700 1 --2- 172.21.15.103:0/2356137800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd740ac950 0x7fbd740b2450 secure :-1 s=THROTTLE_DONE pgs=503 cs=0 l=1 rx=0x7fbd64002f30 tx=0x7fbd64010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.734+0000 7fbd79534700 1 --2- 172.21.15.103:0/2356137800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd740ac950 0x7fbd740b2450 secure :-1 s=THROTTLE_DONE pgs=503 cs=0 l=1 rx=0x7fbd64002f30 tx=0x7fbd64010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.734+0000 7fbd627fc700 1 -- 172.21.15.103:0/2356137800 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd64012aa0 con 0x7fbd740ac950 2020-04-22T14:05:42.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.734+0000 7fbd79534700 1 --2- 172.21.15.103:0/2356137800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd740ac950 0x7fbd740b2450 secure :-1 s=THROTTLE_DONE pgs=503 cs=0 l=1 rx=0x7fbd64002f30 tx=0x7fbd64010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.734+0000 7fbd627fc700 1 -- 172.21.15.103:0/2356137800 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd64012c00 con 0x7fbd740ac950 2020-04-22T14:05:42.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.734+0000 7fbd7b798700 1 -- 172.21.15.103:0/2356137800 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd740b2010 con 0x7fbd740ac950 2020-04-22T14:05:42.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.734+0000 7fbd627fc700 1 -- 172.21.15.103:0/2356137800 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd640091c0 con 0x7fbd740ac950 2020-04-22T14:05:42.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.734+0000 7fbd7b798700 1 -- 172.21.15.103:0/2356137800 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd74062bf0 con 0x7fbd740ac950 2020-04-22T14:05:42.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.735+0000 7fbd79534700 1 --2- 172.21.15.103:0/2356137800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd740ac950 0x7fbd740b2450 secure :-1 s=THROTTLE_DONE pgs=503 cs=0 l=1 rx=0x7fbd64002f30 tx=0x7fbd64010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.735+0000 7fbd627fc700 1 -- 172.21.15.103:0/2356137800 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fbd64007190 con 0x7fbd740ac950 2020-04-22T14:05:42.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.735+0000 7fbd79534700 1 --2- 172.21.15.103:0/2356137800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd740ac950 0x7fbd740b2450 secure :-1 s=THROTTLE_DONE pgs=503 cs=0 l=1 rx=0x7fbd64002f30 tx=0x7fbd64010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.735+0000 7fbd7b798700 1 -- 172.21.15.103:0/2356137800 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd74056c90 con 0x7fbd740ac950 2020-04-22T14:05:42.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.735+0000 7fbd627fc700 1 --2- 172.21.15.103:0/2356137800 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbd5404dac0 0x7fbd5404ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:42.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.735+0000 7fbd627fc700 1 -- 172.21.15.103:0/2356137800 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fbd64061950 con 0x7fbd740ac950 2020-04-22T14:05:42.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.735+0000 7fbd78d33700 1 --2- 172.21.15.103:0/2356137800 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbd5404dac0 0x7fbd5404ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:42.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.736+0000 7fbd78d33700 1 --2- 172.21.15.103:0/2356137800 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbd5404dac0 0x7fbd5404ff80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbd740b6250 tx=0x7fbd70007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.736+0000 7fbd78d33700 1 --2- 172.21.15.103:0/2356137800 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbd5404dac0 0x7fbd5404ff80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbd740b6250 tx=0x7fbd70007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.736+0000 7fbd78d33700 1 --2- 172.21.15.103:0/2356137800 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbd5404dac0 0x7fbd5404ff80 secure :-1 s=READY pgs=201 cs=0 l=1 rx=0x7fbd740b6250 tx=0x7fbd70007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:42.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.739+0000 7fbd79534700 1 --2- 172.21.15.103:0/2356137800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd740ac950 0x7fbd740b2450 secure :-1 s=THROTTLE_DONE pgs=503 cs=0 l=1 rx=0x7fbd64002f30 tx=0x7fbd64010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.739+0000 7fbd627fc700 1 -- 172.21.15.103:0/2356137800 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fbd6403ccd0 con 0x7fbd740ac950 2020-04-22T14:05:42.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.884+0000 7fbd7b798700 1 -- 172.21.15.103:0/2356137800 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fbd7406a960 con 0x7fbd740ac950 2020-04-22T14:05:42.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.884+0000 7fbd79534700 1 --2- 172.21.15.103:0/2356137800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd740ac950 0x7fbd740b2450 secure :-1 s=THROTTLE_DONE pgs=503 cs=0 l=1 rx=0x7fbd64002f30 tx=0x7fbd64010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:42.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.884+0000 7fbd627fc700 1 -- 172.21.15.103:0/2356137800 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v41) v1 ==== 110+0+10 (secure 0 0 0) 0x7fbd640402f0 con 0x7fbd740ac950 2020-04-22T14:05:42.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.885+0000 7fbd7b798700 1 -- 172.21.15.103:0/2356137800 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbd5404dac0 msgr2=0x7fbd5404ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:42.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.885+0000 7fbd7b798700 1 --2- 172.21.15.103:0/2356137800 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbd5404dac0 0x7fbd5404ff80 secure :-1 s=READY pgs=201 cs=0 l=1 rx=0x7fbd740b6250 tx=0x7fbd70007a40).stop 2020-04-22T14:05:42.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.885+0000 7fbd7b798700 1 -- 172.21.15.103:0/2356137800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd740ac950 msgr2=0x7fbd740b2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:42.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.885+0000 7fbd7b798700 1 --2- 172.21.15.103:0/2356137800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd740ac950 0x7fbd740b2450 secure :-1 s=READY pgs=503 cs=0 l=1 rx=0x7fbd64002f30 tx=0x7fbd64010c30).stop 2020-04-22T14:05:42.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.885+0000 7fbd7b798700 1 -- 172.21.15.103:0/2356137800 shutdown_connections 2020-04-22T14:05:42.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.885+0000 7fbd7b798700 1 --2- 172.21.15.103:0/2356137800 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbd5404dac0 0x7fbd5404ff80 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:42.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.885+0000 7fbd7b798700 1 --2- 172.21.15.103:0/2356137800 >> v2:172.21.15.86:3300/0 conn(0x7fbd74146c40 0x7fbd7412a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:42.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.885+0000 7fbd7b798700 1 --2- 172.21.15.103:0/2356137800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd740ac950 0x7fbd740b2450 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:42.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.885+0000 7fbd7b798700 1 --2- 172.21.15.103:0/2356137800 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbd740b9140 0x7fbd740b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:42.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.885+0000 7fbd7b798700 1 -- 172.21.15.103:0/2356137800 >> 172.21.15.103:0/2356137800 conn(0x7fbd7405b7b0 msgr2=0x7fbd740b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:42.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.886+0000 7fbd7b798700 1 -- 172.21.15.103:0/2356137800 shutdown_connections 2020-04-22T14:05:42.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:42.886+0000 7fbd7b798700 1 -- 172.21.15.103:0/2356137800 wait complete. 2020-04-22T14:05:42.891 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:05:42.897 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:42.911 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:05:43.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.057+0000 7fb920429700 1 Processor -- start 2020-04-22T14:05:43.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.057+0000 7fb920429700 1 -- start start 2020-04-22T14:05:43.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.058+0000 7fb920429700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb9180b9140 0x7fb91812b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:43.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.058+0000 7fb920429700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb9180ac950 0x7fb91812b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:43.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.058+0000 7fb920429700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9181467e0 con 0x7fb918146c40 2020-04-22T14:05:43.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.058+0000 7fb920429700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9180602f0 con 0x7fb9180ac950 2020-04-22T14:05:43.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.058+0000 7fb920429700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb918060050 con 0x7fb9180b9140 2020-04-22T14:05:43.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.058+0000 7fb91e1c5700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb9180b9140 0x7fb91812b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:43.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.058+0000 7fb91e1c5700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb9180b9140 0x7fb91812b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49328/0 (socket says 172.21.15.103:49328) 2020-04-22T14:05:43.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.058+0000 7fb91e1c5700 1 -- 172.21.15.103:0/3064159386 learned_addr learned my addr 172.21.15.103:0/3064159386 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:05:43.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.059+0000 7fb91d9c4700 1 --2- 172.21.15.103:0/3064159386 >> v2:172.21.15.86:3300/0 conn(0x7fb9180ac950 0x7fb91812b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:43.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.059+0000 7fb91e1c5700 1 -- 172.21.15.103:0/3064159386 >> v2:172.21.15.86:3300/0 conn(0x7fb9180ac950 msgr2=0x7fb91812b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:43.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.059+0000 7fb91e1c5700 1 --2- 172.21.15.103:0/3064159386 >> v2:172.21.15.86:3300/0 conn(0x7fb9180ac950 0x7fb91812b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:43.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.059+0000 7fb91e1c5700 1 -- 172.21.15.103:0/3064159386 >> v1:172.21.15.86:6789/0 conn(0x7fb918146c40 legacy=0x7fb918143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:43.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.059+0000 7fb91e1c5700 1 -- 172.21.15.103:0/3064159386 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9180b9520 con 0x7fb9180b9140 2020-04-22T14:05:43.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.059+0000 7fb91e1c5700 1 --2- 172.21.15.103:0/3064159386 >> v2:172.21.15.103:3300/0 conn(0x7fb9180b9140 0x7fb91812b210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb908002f30 tx=0x7fb908007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.059+0000 7fb91e1c5700 1 --2- 172.21.15.103:0/3064159386 >> v2:172.21.15.103:3300/0 conn(0x7fb9180b9140 0x7fb91812b210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb908002f30 tx=0x7fb908007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.059+0000 7fb91e1c5700 1 --2- 172.21.15.103:0/3064159386 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9180b9140 0x7fb91812b210 secure :-1 s=READY pgs=504 cs=0 l=1 rx=0x7fb908002f30 tx=0x7fb908007a40).ready entity=mon.1 client_cookie=284cbe78eba7a69d server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:43.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.059+0000 7fb91e1c5700 1 --2- 172.21.15.103:0/3064159386 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9180b9140 0x7fb91812b210 secure :-1 s=THROTTLE_DONE pgs=504 cs=0 l=1 rx=0x7fb908002f30 tx=0x7fb908007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.059+0000 7fb91e1c5700 1 --2- 172.21.15.103:0/3064159386 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9180b9140 0x7fb91812b210 secure :-1 s=THROTTLE_DONE pgs=504 cs=0 l=1 rx=0x7fb908002f30 tx=0x7fb908007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.059+0000 7fb91e1c5700 1 --2- 172.21.15.103:0/3064159386 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9180b9140 0x7fb91812b210 secure :-1 s=THROTTLE_DONE pgs=504 cs=0 l=1 rx=0x7fb908002f30 tx=0x7fb908007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.059+0000 7fb91d1c3700 1 -- 172.21.15.103:0/3064159386 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb908011720 con 0x7fb9180b9140 2020-04-22T14:05:43.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.059+0000 7fb91d1c3700 1 -- 172.21.15.103:0/3064159386 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb908011880 con 0x7fb9180b9140 2020-04-22T14:05:43.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.059+0000 7fb91d1c3700 1 -- 172.21.15.103:0/3064159386 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb908011ca0 con 0x7fb9180b9140 2020-04-22T14:05:43.070 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.059+0000 7fb920429700 1 -- 172.21.15.103:0/3064159386 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9180b9140 msgr2=0x7fb91812b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:43.070 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.059+0000 7fb920429700 1 --2- 172.21.15.103:0/3064159386 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9180b9140 0x7fb91812b210 secure :-1 s=READY pgs=504 cs=0 l=1 rx=0x7fb908002f30 tx=0x7fb908007a40).stop 2020-04-22T14:05:43.070 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.060+0000 7fb920429700 1 -- 172.21.15.103:0/3064159386 shutdown_connections 2020-04-22T14:05:43.070 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.060+0000 7fb920429700 1 --2- 172.21.15.103:0/3064159386 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9180b9140 0x7fb91812b210 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:43.070 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.060+0000 7fb920429700 1 --2- 172.21.15.103:0/3064159386 >> v2:172.21.15.86:3300/0 conn(0x7fb9180ac950 0x7fb91812b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:43.070 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.060+0000 7fb920429700 1 -- 172.21.15.103:0/3064159386 >> 172.21.15.103:0/3064159386 conn(0x7fb91805b7b0 msgr2=0x7fb9180b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:43.070 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.060+0000 7fb920429700 1 -- 172.21.15.103:0/3064159386 shutdown_connections 2020-04-22T14:05:43.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.060+0000 7fb920429700 1 -- 172.21.15.103:0/3064159386 wait complete. 2020-04-22T14:05:43.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.061+0000 7fb920429700 1 Processor -- start 2020-04-22T14:05:43.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.061+0000 7fb920429700 1 -- start start 2020-04-22T14:05:43.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.061+0000 7fb920429700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb9180ac950 0x7fb918062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:43.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.061+0000 7fb91d9c4700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb9180b9140 0x7fb918142a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41524/0 (socket says 172.21.15.103:41524) 2020-04-22T14:05:43.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.061+0000 7fb91d9c4700 1 -- 172.21.15.103:0/3825495917 learned_addr learned my addr 172.21.15.103:0/3825495917 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:43.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.061+0000 7fb920429700 1 -- 172.21.15.103:0/3825495917 --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9181454f0 con 0x7fb918146c40 2020-04-22T14:05:43.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.061+0000 7fb920429700 1 -- 172.21.15.103:0/3825495917 --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9180b2660 con 0x7fb9180b9140 2020-04-22T14:05:43.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.061+0000 7fb920429700 1 -- 172.21.15.103:0/3825495917 --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb918143700 con 0x7fb9180ac950 2020-04-22T14:05:43.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.061+0000 7fb91e1c5700 1 --2- 172.21.15.103:0/3825495917 >> v2:172.21.15.86:3300/0 conn(0x7fb9180ac950 0x7fb918062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:43.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.062+0000 7fb9077fe700 1 -- 172.21.15.103:0/3825495917 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2864981159 0 0) 0x7fb9180b2660 con 0x7fb9180b9140 2020-04-22T14:05:43.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.062+0000 7fb9077fe700 1 -- 172.21.15.103:0/3825495917 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8f8002fe0 con 0x7fb9180b9140 2020-04-22T14:05:43.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.062+0000 7fb91e1c5700 1 -- 172.21.15.103:0/3825495917 >> v1:172.21.15.103:6789/0 conn(0x7fb9180b9140 legacy=0x7fb918142a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:43.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.062+0000 7fb91e1c5700 1 -- 172.21.15.103:0/3825495917 >> v1:172.21.15.86:6789/0 conn(0x7fb918146c40 legacy=0x7fb9181552b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:43.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.062+0000 7fb91e1c5700 1 -- 172.21.15.103:0/3825495917 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9180b23c0 con 0x7fb9180ac950 2020-04-22T14:05:43.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.062+0000 7fb91e1c5700 1 --2- 172.21.15.103:0/3825495917 >> v2:172.21.15.86:3300/0 conn(0x7fb9180ac950 0x7fb918062a30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb908002f30 tx=0x7fb908007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.062+0000 7fb91e1c5700 1 --2- 172.21.15.103:0/3825495917 >> v2:172.21.15.86:3300/0 conn(0x7fb9180ac950 0x7fb918062a30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb908002f30 tx=0x7fb908007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.062+0000 7fb91e1c5700 1 --2- 172.21.15.103:0/3825495917 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9180ac950 0x7fb918062a30 secure :-1 s=READY pgs=291 cs=0 l=1 rx=0x7fb908002f30 tx=0x7fb908007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:43.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.062+0000 7fb91e1c5700 1 --2- 172.21.15.103:0/3825495917 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9180ac950 0x7fb918062a30 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7fb908002f30 tx=0x7fb908007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.062+0000 7fb9077fe700 1 -- 172.21.15.103:0/3825495917 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb908011d60 con 0x7fb9180ac950 2020-04-22T14:05:43.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.062+0000 7fb91e1c5700 1 --2- 172.21.15.103:0/3825495917 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9180ac950 0x7fb918062a30 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7fb908002f30 tx=0x7fb908007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.062+0000 7fb9077fe700 1 -- 172.21.15.103:0/3825495917 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb908007360 con 0x7fb9180ac950 2020-04-22T14:05:43.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.062+0000 7fb91e1c5700 1 --2- 172.21.15.103:0/3825495917 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9180ac950 0x7fb918062a30 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7fb908002f30 tx=0x7fb908007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.062+0000 7fb920429700 1 -- 172.21.15.103:0/3825495917 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb918145720 con 0x7fb9180ac950 2020-04-22T14:05:43.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.062+0000 7fb9077fe700 1 -- 172.21.15.103:0/3825495917 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9080056c0 con 0x7fb9180ac950 2020-04-22T14:05:43.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.062+0000 7fb920429700 1 -- 172.21.15.103:0/3825495917 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9180b17c0 con 0x7fb9180ac950 2020-04-22T14:05:43.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.063+0000 7fb91e1c5700 1 --2- 172.21.15.103:0/3825495917 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9180ac950 0x7fb918062a30 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7fb908002f30 tx=0x7fb908007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.063+0000 7fb920429700 1 -- 172.21.15.103:0/3825495917 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb918056c90 con 0x7fb9180ac950 2020-04-22T14:05:43.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.064+0000 7fb9077fe700 1 -- 172.21.15.103:0/3825495917 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fb9080058c0 con 0x7fb9180ac950 2020-04-22T14:05:43.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.064+0000 7fb91e1c5700 1 --2- 172.21.15.103:0/3825495917 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9180ac950 0x7fb918062a30 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7fb908002f30 tx=0x7fb908007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.064+0000 7fb9077fe700 1 --2- 172.21.15.103:0/3825495917 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb8f804dc70 0x7fb8f8050130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:43.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.064+0000 7fb9077fe700 1 -- 172.21.15.103:0/3825495917 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fb908061b60 con 0x7fb9180ac950 2020-04-22T14:05:43.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.064+0000 7fb91d9c4700 1 --2- 172.21.15.103:0/3825495917 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb8f804dc70 0x7fb8f8050130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:43.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.064+0000 7fb91d9c4700 1 --2- 172.21.15.103:0/3825495917 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb8f804dc70 0x7fb8f8050130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb914002f30 tx=0x7fb9140013a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.064+0000 7fb91d9c4700 1 --2- 172.21.15.103:0/3825495917 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb8f804dc70 0x7fb8f8050130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb914002f30 tx=0x7fb9140013a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.064+0000 7fb91d9c4700 1 --2- 172.21.15.103:0/3825495917 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb8f804dc70 0x7fb8f8050130 secure :-1 s=READY pgs=202 cs=0 l=1 rx=0x7fb914002f30 tx=0x7fb9140013a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:43.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.067+0000 7fb91e1c5700 1 --2- 172.21.15.103:0/3825495917 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9180ac950 0x7fb918062a30 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7fb908002f30 tx=0x7fb908007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.067+0000 7fb9077fe700 1 -- 172.21.15.103:0/3825495917 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fb90803d000 con 0x7fb9180ac950 2020-04-22T14:05:43.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.210+0000 7fb920429700 1 -- 172.21.15.103:0/3825495917 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb9180b83f0 con 0x7fb9180ac950 2020-04-22T14:05:43.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.211+0000 7fb91e1c5700 1 --2- 172.21.15.103:0/3825495917 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9180ac950 0x7fb918062a30 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7fb908002f30 tx=0x7fb908007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.214 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.211+0000 7fb9077fe700 1 -- 172.21.15.103:0/3825495917 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v41) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb908040620 con 0x7fb9180ac950 2020-04-22T14:05:43.214 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:05:43.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.212+0000 7fb920429700 1 -- 172.21.15.103:0/3825495917 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb8f804dc70 msgr2=0x7fb8f8050130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:43.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.212+0000 7fb920429700 1 --2- 172.21.15.103:0/3825495917 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb8f804dc70 0x7fb8f8050130 secure :-1 s=READY pgs=202 cs=0 l=1 rx=0x7fb914002f30 tx=0x7fb9140013a0).stop 2020-04-22T14:05:43.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.212+0000 7fb920429700 1 -- 172.21.15.103:0/3825495917 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9180ac950 msgr2=0x7fb918062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:43.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.212+0000 7fb920429700 1 --2- 172.21.15.103:0/3825495917 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9180ac950 0x7fb918062a30 secure :-1 s=READY pgs=291 cs=0 l=1 rx=0x7fb908002f30 tx=0x7fb908007a40).stop 2020-04-22T14:05:43.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.212+0000 7fb920429700 1 -- 172.21.15.103:0/3825495917 shutdown_connections 2020-04-22T14:05:43.216 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.212+0000 7fb920429700 1 --2- 172.21.15.103:0/3825495917 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb8f804dc70 0x7fb8f8050130 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:43.216 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.212+0000 7fb920429700 1 --2- 172.21.15.103:0/3825495917 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9180ac950 0x7fb918062a30 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:43.216 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.212+0000 7fb920429700 1 -- 172.21.15.103:0/3825495917 >> 172.21.15.103:0/3825495917 conn(0x7fb91805b7b0 msgr2=0x7fb918145b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:43.216 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.212+0000 7fb920429700 1 -- 172.21.15.103:0/3825495917 shutdown_connections 2020-04-22T14:05:43.216 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.212+0000 7fb920429700 1 -- 172.21.15.103:0/3825495917 wait complete. 2020-04-22T14:05:43.224 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:43.238 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-04-22T14:05:43.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.381+0000 7f7a78168700 1 Processor -- start 2020-04-22T14:05:43.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.381+0000 7f7a78168700 1 -- start start 2020-04-22T14:05:43.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.382+0000 7f7a78168700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7a700ac740 0x7f7a70142de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:43.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.382+0000 7f7a78168700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a70064ec0 con 0x7f7a700b6040 2020-04-22T14:05:43.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.382+0000 7f7a78168700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a70146870 con 0x7f7a70067170 2020-04-22T14:05:43.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.382+0000 7f7a78168700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a70065af0 con 0x7f7a700ac740 2020-04-22T14:05:43.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.382+0000 7f7a75f04700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f7a70067170 0x7f7a7013c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41530/0 (socket says 172.21.15.103:41530) 2020-04-22T14:05:43.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.382+0000 7f7a75f04700 1 -- 172.21.15.103:0/3131646690 learned_addr learned my addr 172.21.15.103:0/3131646690 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:43.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.383+0000 7f7a76705700 1 --2- 172.21.15.103:0/3131646690 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7a700ac740 0x7f7a70142de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:43.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.383+0000 7f7a74f02700 1 -- 172.21.15.103:0/3131646690 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2426682019 0 0) 0x7f7a70146870 con 0x7f7a70067170 2020-04-22T14:05:43.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.383+0000 7f7a74f02700 1 -- 172.21.15.103:0/3131646690 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a58003230 con 0x7f7a70067170 2020-04-22T14:05:43.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.383+0000 7f7a74f02700 1 -- 172.21.15.103:0/3131646690 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3217119622 0 0) 0x7f7a58003230 con 0x7f7a70067170 2020-04-22T14:05:43.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.383+0000 7f7a74f02700 1 -- 172.21.15.103:0/3131646690 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7a700ac740 msgr2=0x7f7a70142de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:43.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.383+0000 7f7a74f02700 1 --2- 172.21.15.103:0/3131646690 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7a700ac740 0x7f7a70142de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:43.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.383+0000 7f7a74f02700 1 -- 172.21.15.103:0/3131646690 >> v1:172.21.15.86:6789/0 conn(0x7f7a700b6040 legacy=0x7f7a701426d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:43.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.383+0000 7f7a74f02700 1 -- 172.21.15.103:0/3131646690 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a70067550 con 0x7f7a70067170 2020-04-22T14:05:43.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.383+0000 7f7a74f02700 1 -- 172.21.15.103:0/3131646690 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f7a640016d0 con 0x7f7a70067170 2020-04-22T14:05:43.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.383+0000 7f7a74f02700 1 -- 172.21.15.103:0/3131646690 >> v1:172.21.15.103:6789/0 conn(0x7f7a70067170 legacy=0x7f7a7013c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:43.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.383+0000 7f7a74f02700 1 --2- 172.21.15.103:0/3131646690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a58003720 0x7f7a58003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:43.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.383+0000 7f7a74f02700 1 --2- 172.21.15.103:0/3131646690 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7a700ac740 0x7f7a580044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:43.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.383+0000 7f7a74f02700 1 --2- 172.21.15.103:0/3131646690 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a58004930 0x7f7a58004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:43.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.383+0000 7f7a74f02700 1 -- 172.21.15.103:0/3131646690 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a70065af0 con 0x7f7a58004930 2020-04-22T14:05:43.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.383+0000 7f7a74f02700 1 -- 172.21.15.103:0/3131646690 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a58005300 con 0x7f7a58003720 2020-04-22T14:05:43.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.383+0000 7f7a74f02700 1 -- 172.21.15.103:0/3131646690 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a580040f0 con 0x7f7a700ac740 2020-04-22T14:05:43.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.383+0000 7f7a75f04700 1 --2- 172.21.15.103:0/3131646690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a58003720 0x7f7a58003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:43.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.383+0000 7f7a76705700 1 --2- 172.21.15.103:0/3131646690 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a58004930 0x7f7a58004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:43.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.383+0000 7f7a75703700 1 --2- 172.21.15.103:0/3131646690 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7a700ac740 0x7f7a580044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:43.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.383+0000 7f7a75f04700 1 -- 172.21.15.103:0/3131646690 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7a700ac740 msgr2=0x7f7a580044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:43.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.383+0000 7f7a75f04700 1 --2- 172.21.15.103:0/3131646690 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7a700ac740 0x7f7a580044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:43.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.383+0000 7f7a75f04700 1 -- 172.21.15.103:0/3131646690 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a58004930 msgr2=0x7f7a58004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:43.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.383+0000 7f7a75f04700 1 --2- 172.21.15.103:0/3131646690 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a58004930 0x7f7a58004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:43.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.383+0000 7f7a75f04700 1 -- 172.21.15.103:0/3131646690 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a58003230 con 0x7f7a58003720 2020-04-22T14:05:43.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.383+0000 7f7a75f04700 1 --2- 172.21.15.103:0/3131646690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a58003720 0x7f7a58003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7a640013e0 tx=0x7f7a700676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.383+0000 7f7a75f04700 1 --2- 172.21.15.103:0/3131646690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a58003720 0x7f7a58003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7a640013e0 tx=0x7f7a700676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.383+0000 7f7a75f04700 1 --2- 172.21.15.103:0/3131646690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a58003720 0x7f7a58003b40 secure :-1 s=READY pgs=507 cs=0 l=1 rx=0x7f7a640013e0 tx=0x7f7a700676e0).ready entity=mon.1 client_cookie=a345c587e6422455 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:43.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.384+0000 7f7a75f04700 1 --2- 172.21.15.103:0/3131646690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a58003720 0x7f7a58003b40 secure :-1 s=THROTTLE_DONE pgs=507 cs=0 l=1 rx=0x7f7a640013e0 tx=0x7f7a700676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.384+0000 7f7a74f02700 1 -- 172.21.15.103:0/3131646690 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a6400e180 con 0x7f7a58003720 2020-04-22T14:05:43.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.384+0000 7f7a75f04700 1 --2- 172.21.15.103:0/3131646690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a58003720 0x7f7a58003b40 secure :-1 s=THROTTLE_DONE pgs=507 cs=0 l=1 rx=0x7f7a640013e0 tx=0x7f7a700676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.384+0000 7f7a74f02700 1 -- 172.21.15.103:0/3131646690 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a6400e320 con 0x7f7a58003720 2020-04-22T14:05:43.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.384+0000 7f7a75f04700 1 --2- 172.21.15.103:0/3131646690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a58003720 0x7f7a58003b40 secure :-1 s=THROTTLE_DONE pgs=507 cs=0 l=1 rx=0x7f7a640013e0 tx=0x7f7a700676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.384+0000 7f7a74f02700 1 -- 172.21.15.103:0/3131646690 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a640100c0 con 0x7f7a58003720 2020-04-22T14:05:43.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.384+0000 7f7a78168700 1 -- 172.21.15.103:0/3131646690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a58003720 msgr2=0x7f7a58003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:43.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.384+0000 7f7a78168700 1 --2- 172.21.15.103:0/3131646690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a58003720 0x7f7a58003b40 secure :-1 s=READY pgs=507 cs=0 l=1 rx=0x7f7a640013e0 tx=0x7f7a700676e0).stop 2020-04-22T14:05:43.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.384+0000 7f7a76705700 1 -- 172.21.15.103:0/3131646690 reap_dead start 2020-04-22T14:05:43.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.384+0000 7f7a78168700 1 -- 172.21.15.103:0/3131646690 shutdown_connections 2020-04-22T14:05:43.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.384+0000 7f7a78168700 1 -- 172.21.15.103:0/3131646690 >> 172.21.15.103:0/3131646690 conn(0x7f7a700b9160 msgr2=0x7f7a7005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:43.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.384+0000 7f7a78168700 1 -- 172.21.15.103:0/3131646690 shutdown_connections 2020-04-22T14:05:43.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.384+0000 7f7a78168700 1 -- 172.21.15.103:0/3131646690 wait complete. 2020-04-22T14:05:43.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.385+0000 7f7a78168700 1 Processor -- start 2020-04-22T14:05:43.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.385+0000 7f7a78168700 1 -- start start 2020-04-22T14:05:43.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.386+0000 7f7a78168700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7a70142d10 0x7f7a701442b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:43.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.386+0000 7f7a78168700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7a70144710 0x7f7a7013cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:43.397 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.386+0000 7f7a78168700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a70144b60 con 0x7f7a70140640 2020-04-22T14:05:43.397 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.386+0000 7f7a78168700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a70153840 con 0x7f7a70142d10 2020-04-22T14:05:43.397 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.386+0000 7f7a78168700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7013c870 con 0x7f7a70144710 2020-04-22T14:05:43.397 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.386+0000 7f7a75703700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7a70142d10 0x7f7a701442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:43.397 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.386+0000 7f7a75703700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7a70142d10 0x7f7a701442b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49352/0 (socket says 172.21.15.103:49352) 2020-04-22T14:05:43.397 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.386+0000 7f7a75703700 1 -- 172.21.15.103:0/1856240860 learned_addr learned my addr 172.21.15.103:0/1856240860 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:05:43.397 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.386+0000 7f7a76705700 1 --2- 172.21.15.103:0/1856240860 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7a70144710 0x7f7a7013cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:43.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.386+0000 7f7a75703700 1 -- 172.21.15.103:0/1856240860 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7a70144710 msgr2=0x7f7a7013cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:43.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.386+0000 7f7a75703700 1 --2- 172.21.15.103:0/1856240860 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7a70144710 0x7f7a7013cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:43.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.386+0000 7f7a75703700 1 -- 172.21.15.103:0/1856240860 >> v1:172.21.15.86:6789/0 conn(0x7f7a70140640 legacy=0x7f7a70143840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:43.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.386+0000 7f7a75703700 1 -- 172.21.15.103:0/1856240860 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a70140a20 con 0x7f7a70142d10 2020-04-22T14:05:43.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.386+0000 7f7a75703700 1 --2- 172.21.15.103:0/1856240860 >> v2:172.21.15.103:3300/0 conn(0x7f7a70142d10 0x7f7a701442b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7a7005bdf0 tx=0x7f7a6c010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.386+0000 7f7a75703700 1 --2- 172.21.15.103:0/1856240860 >> v2:172.21.15.103:3300/0 conn(0x7f7a70142d10 0x7f7a701442b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7a7005bdf0 tx=0x7f7a6c010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.386+0000 7f7a75703700 1 --2- 172.21.15.103:0/1856240860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a70142d10 0x7f7a701442b0 secure :-1 s=READY pgs=508 cs=0 l=1 rx=0x7f7a7005bdf0 tx=0x7f7a6c010c80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:43.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.386+0000 7f7a75703700 1 --2- 172.21.15.103:0/1856240860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a70142d10 0x7f7a701442b0 secure :-1 s=THROTTLE_DONE pgs=508 cs=0 l=1 rx=0x7f7a7005bdf0 tx=0x7f7a6c010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.386+0000 7f7a62ffd700 1 -- 172.21.15.103:0/1856240860 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a6c012550 con 0x7f7a70142d10 2020-04-22T14:05:43.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.386+0000 7f7a75703700 1 --2- 172.21.15.103:0/1856240860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a70142d10 0x7f7a701442b0 secure :-1 s=THROTTLE_DONE pgs=508 cs=0 l=1 rx=0x7f7a7005bdf0 tx=0x7f7a6c010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.386+0000 7f7a75703700 1 --2- 172.21.15.103:0/1856240860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a70142d10 0x7f7a701442b0 secure :-1 s=THROTTLE_DONE pgs=508 cs=0 l=1 rx=0x7f7a7005bdf0 tx=0x7f7a6c010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.386+0000 7f7a62ffd700 1 -- 172.21.15.103:0/1856240860 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a6c0126b0 con 0x7f7a70142d10 2020-04-22T14:05:43.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.386+0000 7f7a62ffd700 1 -- 172.21.15.103:0/1856240860 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a6c012a90 con 0x7f7a70142d10 2020-04-22T14:05:43.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.386+0000 7f7a78168700 1 -- 172.21.15.103:0/1856240860 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a70143f50 con 0x7f7a70142d10 2020-04-22T14:05:43.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.386+0000 7f7a78168700 1 -- 172.21.15.103:0/1856240860 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a70145a20 con 0x7f7a70142d10 2020-04-22T14:05:43.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.387+0000 7f7a75703700 1 --2- 172.21.15.103:0/1856240860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a70142d10 0x7f7a701442b0 secure :-1 s=THROTTLE_DONE pgs=508 cs=0 l=1 rx=0x7f7a7005bdf0 tx=0x7f7a6c010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.388+0000 7f7a62ffd700 1 -- 172.21.15.103:0/1856240860 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f7a6c012cc0 con 0x7f7a70142d10 2020-04-22T14:05:43.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.388+0000 7f7a78168700 1 -- 172.21.15.103:0/1856240860 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a70056c90 con 0x7f7a70142d10 2020-04-22T14:05:43.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.388+0000 7f7a75703700 1 --2- 172.21.15.103:0/1856240860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a70142d10 0x7f7a701442b0 secure :-1 s=THROTTLE_DONE pgs=508 cs=0 l=1 rx=0x7f7a7005bdf0 tx=0x7f7a6c010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.388+0000 7f7a62ffd700 1 --2- 172.21.15.103:0/1856240860 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7a5004d8d0 0x7f7a5004fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:43.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.388+0000 7f7a62ffd700 1 -- 172.21.15.103:0/1856240860 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f7a6c061470 con 0x7f7a70142d10 2020-04-22T14:05:43.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.388+0000 7f7a75f04700 1 --2- 172.21.15.103:0/1856240860 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7a5004d8d0 0x7f7a5004fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:43.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.388+0000 7f7a75f04700 1 --2- 172.21.15.103:0/1856240860 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7a5004d8d0 0x7f7a5004fd90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7a70141030 tx=0x7f7a700676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.388+0000 7f7a75f04700 1 --2- 172.21.15.103:0/1856240860 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7a5004d8d0 0x7f7a5004fd90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7a70141030 tx=0x7f7a700676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.388+0000 7f7a75f04700 1 --2- 172.21.15.103:0/1856240860 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7a5004d8d0 0x7f7a5004fd90 secure :-1 s=READY pgs=203 cs=0 l=1 rx=0x7f7a70141030 tx=0x7f7a700676e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:43.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.392+0000 7f7a75703700 1 --2- 172.21.15.103:0/1856240860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a70142d10 0x7f7a701442b0 secure :-1 s=THROTTLE_DONE pgs=508 cs=0 l=1 rx=0x7f7a7005bdf0 tx=0x7f7a6c010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.392+0000 7f7a62ffd700 1 -- 172.21.15.103:0/1856240860 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f7a6c03c8b0 con 0x7f7a70142d10 2020-04-22T14:05:43.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.536+0000 7f7a78168700 1 -- 172.21.15.103:0/1856240860 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7a7013c9e0 con 0x7f7a70142d10 2020-04-22T14:05:43.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.536+0000 7f7a75703700 1 --2- 172.21.15.103:0/1856240860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a70142d10 0x7f7a701442b0 secure :-1 s=THROTTLE_DONE pgs=508 cs=0 l=1 rx=0x7f7a7005bdf0 tx=0x7f7a6c010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.536+0000 7f7a62ffd700 1 -- 172.21.15.103:0/1856240860 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v41) v1 ==== 84+0+143 (secure 0 0 0) 0x7f7a6c03fed0 con 0x7f7a70142d10 2020-04-22T14:05:43.539 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:05:43.539 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2020-04-22T14:05:43.539 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:43.539 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 1, 2020-04-22T14:05:43.539 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": "device_health_metrics" 2020-04-22T14:05:43.539 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:43.540 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:05:43.540 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 2, 2020-04-22T14:05:43.540 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": "rbd" 2020-04-22T14:05:43.540 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:43.540 INFO:teuthology.orchestra.run.smithi103.stdout:] 2020-04-22T14:05:43.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.537+0000 7f7a78168700 1 -- 172.21.15.103:0/1856240860 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7a5004d8d0 msgr2=0x7f7a5004fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:43.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.537+0000 7f7a78168700 1 --2- 172.21.15.103:0/1856240860 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7a5004d8d0 0x7f7a5004fd90 secure :-1 s=READY pgs=203 cs=0 l=1 rx=0x7f7a70141030 tx=0x7f7a700676e0).stop 2020-04-22T14:05:43.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.537+0000 7f7a78168700 1 -- 172.21.15.103:0/1856240860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a70142d10 msgr2=0x7f7a701442b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:43.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.537+0000 7f7a78168700 1 --2- 172.21.15.103:0/1856240860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a70142d10 0x7f7a701442b0 secure :-1 s=READY pgs=508 cs=0 l=1 rx=0x7f7a7005bdf0 tx=0x7f7a6c010c80).stop 2020-04-22T14:05:43.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.537+0000 7f7a78168700 1 -- 172.21.15.103:0/1856240860 shutdown_connections 2020-04-22T14:05:43.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.537+0000 7f7a78168700 1 --2- 172.21.15.103:0/1856240860 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7a5004d8d0 0x7f7a5004fd90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:43.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.537+0000 7f7a78168700 1 --2- 172.21.15.103:0/1856240860 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7a70144710 0x7f7a7013cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:43.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.537+0000 7f7a78168700 1 --2- 172.21.15.103:0/1856240860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a70142d10 0x7f7a701442b0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:43.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.537+0000 7f7a78168700 1 -- 172.21.15.103:0/1856240860 >> 172.21.15.103:0/1856240860 conn(0x7f7a700b9160 msgr2=0x7f7a70137eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:43.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.537+0000 7f7a78168700 1 -- 172.21.15.103:0/1856240860 shutdown_connections 2020-04-22T14:05:43.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.538+0000 7f7a78168700 1 -- 172.21.15.103:0/1856240860 wait complete. 2020-04-22T14:05:43.549 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-04-22T14:05:43.550 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:43.563 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-04-22T14:05:43.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.709+0000 7f7822cba700 1 Processor -- start 2020-04-22T14:05:43.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.709+0000 7f7822cba700 1 -- start start 2020-04-22T14:05:43.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.710+0000 7f7822cba700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f781c14a320 0x7f781c05fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:43.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.710+0000 7f7822cba700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f781c1465d0 con 0x7f781c146fb0 2020-04-22T14:05:43.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.710+0000 7f7822cba700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f781c146870 con 0x7f781c149890 2020-04-22T14:05:43.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.710+0000 7f7822cba700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f781c1407a0 con 0x7f781c14a320 2020-04-22T14:05:43.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.710+0000 7f7821257700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f781c149890 0x7f781c0b3db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41552/0 (socket says 172.21.15.103:41552) 2020-04-22T14:05:43.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.710+0000 7f7821257700 1 -- 172.21.15.103:0/1994421692 learned_addr learned my addr 172.21.15.103:0/1994421692 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:43.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.710+0000 7f781b7fe700 1 -- 172.21.15.103:0/1994421692 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1680786373 0 0) 0x7f781c146870 con 0x7f781c149890 2020-04-22T14:05:43.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.710+0000 7f7820a56700 1 --2- 172.21.15.103:0/1994421692 >> v2:172.21.15.86:3300/0 conn(0x7f781c14a320 0x7f781c05fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:43.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.710+0000 7f781b7fe700 1 -- 172.21.15.103:0/1994421692 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7808003230 con 0x7f781c149890 2020-04-22T14:05:43.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.711+0000 7f781b7fe700 1 -- 172.21.15.103:0/1994421692 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2982995002 0 0) 0x7f7808003230 con 0x7f781c149890 2020-04-22T14:05:43.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.711+0000 7f781b7fe700 1 -- 172.21.15.103:0/1994421692 >> v2:172.21.15.86:3300/0 conn(0x7f781c14a320 msgr2=0x7f781c05fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:43.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.711+0000 7f781b7fe700 1 --2- 172.21.15.103:0/1994421692 >> v2:172.21.15.86:3300/0 conn(0x7f781c14a320 0x7f781c05fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:43.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.711+0000 7f781b7fe700 1 -- 172.21.15.103:0/1994421692 >> v1:172.21.15.86:6789/0 conn(0x7f781c146fb0 legacy=0x7f781c0b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:43.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.711+0000 7f781b7fe700 1 -- 172.21.15.103:0/1994421692 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781c146b10 con 0x7f781c149890 2020-04-22T14:05:43.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.711+0000 7f781b7fe700 1 -- 172.21.15.103:0/1994421692 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f7814001a50 con 0x7f781c149890 2020-04-22T14:05:43.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.711+0000 7f7820a56700 1 --2- 172.21.15.103:0/1994421692 >> v2:172.21.15.86:3300/0 conn(0x7f781c14a320 0x7f781c05fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:05:43.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.711+0000 7f781b7fe700 1 -- 172.21.15.103:0/1994421692 >> v1:172.21.15.103:6789/0 conn(0x7f781c149890 legacy=0x7f781c0b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:43.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.711+0000 7f781b7fe700 1 --2- 172.21.15.103:0/1994421692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7808003720 0x7f7808003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:43.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.711+0000 7f781b7fe700 1 --2- 172.21.15.103:0/1994421692 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78080044d0 0x7f7808004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:43.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.711+0000 7f781b7fe700 1 --2- 172.21.15.103:0/1994421692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7808004db0 0x7f780800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:43.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.711+0000 7f781b7fe700 1 -- 172.21.15.103:0/1994421692 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781c1407a0 con 0x7f7808003720 2020-04-22T14:05:43.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.711+0000 7f781b7fe700 1 -- 172.21.15.103:0/1994421692 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78080041c0 con 0x7f7808004db0 2020-04-22T14:05:43.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.711+0000 7f781b7fe700 1 -- 172.21.15.103:0/1994421692 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780800bb80 con 0x7f78080044d0 2020-04-22T14:05:43.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.711+0000 7f7821257700 1 --2- 172.21.15.103:0/1994421692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7808004db0 0x7f780800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:43.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.711+0000 7f7820a56700 1 --2- 172.21.15.103:0/1994421692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7808003720 0x7f7808003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:43.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.711+0000 7f781bfff700 1 --2- 172.21.15.103:0/1994421692 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78080044d0 0x7f7808004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:43.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.711+0000 7f7821257700 1 -- 172.21.15.103:0/1994421692 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78080044d0 msgr2=0x7f7808004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:43.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.711+0000 7f7821257700 1 --2- 172.21.15.103:0/1994421692 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78080044d0 0x7f7808004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:43.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.711+0000 7f7821257700 1 -- 172.21.15.103:0/1994421692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7808003720 msgr2=0x7f7808003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:43.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.711+0000 7f7821257700 1 --2- 172.21.15.103:0/1994421692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7808003720 0x7f7808003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:43.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.711+0000 7f7821257700 1 -- 172.21.15.103:0/1994421692 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7808003230 con 0x7f7808004db0 2020-04-22T14:05:43.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.711+0000 7f7821257700 1 --2- 172.21.15.103:0/1994421692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7808004db0 0x7f780800b720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f78080054a0 tx=0x7f7814002040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.711+0000 7f7821257700 1 -- 172.21.15.103:0/1994421692 reap_dead start 2020-04-22T14:05:43.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.711+0000 7f7821257700 1 --2- 172.21.15.103:0/1994421692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7808004db0 0x7f780800b720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f78080054a0 tx=0x7f7814002040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.711+0000 7f7821257700 1 --2- 172.21.15.103:0/1994421692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7808004db0 0x7f780800b720 secure :-1 s=READY pgs=510 cs=0 l=1 rx=0x7f78080054a0 tx=0x7f7814002040).ready entity=mon.1 client_cookie=5524b92fe76275cf server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:43.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.711+0000 7f7821257700 1 --2- 172.21.15.103:0/1994421692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7808004db0 0x7f780800b720 secure :-1 s=THROTTLE_DONE pgs=510 cs=0 l=1 rx=0x7f78080054a0 tx=0x7f7814002040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.711+0000 7f7821257700 1 --2- 172.21.15.103:0/1994421692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7808004db0 0x7f780800b720 secure :-1 s=THROTTLE_DONE pgs=510 cs=0 l=1 rx=0x7f78080054a0 tx=0x7f7814002040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.711+0000 7f781b7fe700 1 -- 172.21.15.103:0/1994421692 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f781400ce80 con 0x7f7808004db0 2020-04-22T14:05:43.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.711+0000 7f7821257700 1 --2- 172.21.15.103:0/1994421692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7808004db0 0x7f780800b720 secure :-1 s=THROTTLE_DONE pgs=510 cs=0 l=1 rx=0x7f78080054a0 tx=0x7f7814002040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.711+0000 7f781b7fe700 1 -- 172.21.15.103:0/1994421692 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781400e560 con 0x7f7808004db0 2020-04-22T14:05:43.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.711+0000 7f781b7fe700 1 -- 172.21.15.103:0/1994421692 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f781400e8c0 con 0x7f7808004db0 2020-04-22T14:05:43.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.711+0000 7f7822cba700 1 -- 172.21.15.103:0/1994421692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7808004db0 msgr2=0x7f780800b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:43.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.711+0000 7f7822cba700 1 --2- 172.21.15.103:0/1994421692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7808004db0 0x7f780800b720 secure :-1 s=READY pgs=510 cs=0 l=1 rx=0x7f78080054a0 tx=0x7f7814002040).stop 2020-04-22T14:05:43.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.712+0000 7f7822cba700 1 -- 172.21.15.103:0/1994421692 shutdown_connections 2020-04-22T14:05:43.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.712+0000 7f7822cba700 1 --2- 172.21.15.103:0/1994421692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7808004db0 0x7f780800b720 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:43.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.712+0000 7f7822cba700 1 -- 172.21.15.103:0/1994421692 >> 172.21.15.103:0/1994421692 conn(0x7f781c0610c0 msgr2=0x7f781c05f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:43.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.712+0000 7f7822cba700 1 -- 172.21.15.103:0/1994421692 shutdown_connections 2020-04-22T14:05:43.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.712+0000 7f7822cba700 1 -- 172.21.15.103:0/1994421692 wait complete. 2020-04-22T14:05:43.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.713+0000 7f7822cba700 1 Processor -- start 2020-04-22T14:05:43.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.713+0000 7f7822cba700 1 -- start start 2020-04-22T14:05:43.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.714+0000 7f7822cba700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7808004db0 0x7f781c12a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:43.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.714+0000 7f7822cba700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f781c127b10 0x7f781c127fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:43.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.714+0000 7f7822cba700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f781c157210 con 0x7f781c156b00 2020-04-22T14:05:43.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.714+0000 7f7822cba700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f781c1574b0 con 0x7f7808004db0 2020-04-22T14:05:43.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.714+0000 7f7822cba700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f781c157750 con 0x7f781c127b10 2020-04-22T14:05:43.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.714+0000 7f7821257700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f781c127b10 0x7f781c127fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:43.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.714+0000 7f7821257700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f781c127b10 0x7f781c127fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49374/0 (socket says 172.21.15.103:49374) 2020-04-22T14:05:43.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.714+0000 7f7821257700 1 -- 172.21.15.103:0/3479718298 learned_addr learned my addr 172.21.15.103:0/3479718298 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:05:43.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.714+0000 7f7820a56700 1 --2- 172.21.15.103:0/3479718298 >> v2:172.21.15.86:3300/0 conn(0x7f7808004db0 0x7f781c12a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:43.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.714+0000 7f7821257700 1 -- 172.21.15.103:0/3479718298 >> v2:172.21.15.86:3300/0 conn(0x7f7808004db0 msgr2=0x7f781c12a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:43.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.714+0000 7f7821257700 1 --2- 172.21.15.103:0/3479718298 >> v2:172.21.15.86:3300/0 conn(0x7f7808004db0 0x7f781c12a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:43.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.714+0000 7f7821257700 1 -- 172.21.15.103:0/3479718298 >> v1:172.21.15.86:6789/0 conn(0x7f781c156b00 legacy=0x7f781c1489b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:43.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.714+0000 7f7821257700 1 -- 172.21.15.103:0/3479718298 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781c156f70 con 0x7f781c127b10 2020-04-22T14:05:43.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.714+0000 7f7821257700 1 --2- 172.21.15.103:0/3479718298 >> v2:172.21.15.103:3300/0 conn(0x7f781c127b10 0x7f781c127fc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f78080054a0 tx=0x7f7814002040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.714+0000 7f7821257700 1 --2- 172.21.15.103:0/3479718298 >> v2:172.21.15.103:3300/0 conn(0x7f781c127b10 0x7f781c127fc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f78080054a0 tx=0x7f7814002040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.714+0000 7f7821257700 1 --2- 172.21.15.103:0/3479718298 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f781c127b10 0x7f781c127fc0 secure :-1 s=READY pgs=511 cs=0 l=1 rx=0x7f78080054a0 tx=0x7f7814002040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:43.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.714+0000 7f7821257700 1 --2- 172.21.15.103:0/3479718298 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f781c127b10 0x7f781c127fc0 secure :-1 s=THROTTLE_DONE pgs=511 cs=0 l=1 rx=0x7f78080054a0 tx=0x7f7814002040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.714+0000 7f7821257700 1 --2- 172.21.15.103:0/3479718298 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f781c127b10 0x7f781c127fc0 secure :-1 s=THROTTLE_DONE pgs=511 cs=0 l=1 rx=0x7f78080054a0 tx=0x7f7814002040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.714+0000 7f7819ffb700 1 -- 172.21.15.103:0/3479718298 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78140150c0 con 0x7f781c127b10 2020-04-22T14:05:43.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.714+0000 7f7821257700 1 --2- 172.21.15.103:0/3479718298 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f781c127b10 0x7f781c127fc0 secure :-1 s=THROTTLE_DONE pgs=511 cs=0 l=1 rx=0x7f78080054a0 tx=0x7f7814002040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.714+0000 7f7819ffb700 1 -- 172.21.15.103:0/3479718298 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781400e9c0 con 0x7f781c127b10 2020-04-22T14:05:43.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.714+0000 7f7822cba700 1 -- 172.21.15.103:0/3479718298 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f781c12ceb0 con 0x7f781c127b10 2020-04-22T14:05:43.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.714+0000 7f7819ffb700 1 -- 172.21.15.103:0/3479718298 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7814010d40 con 0x7f781c127b10 2020-04-22T14:05:43.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.714+0000 7f7822cba700 1 -- 172.21.15.103:0/3479718298 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f781c12d3d0 con 0x7f781c127b10 2020-04-22T14:05:43.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.715+0000 7f7821257700 1 --2- 172.21.15.103:0/3479718298 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f781c127b10 0x7f781c127fc0 secure :-1 s=THROTTLE_DONE pgs=511 cs=0 l=1 rx=0x7f78080054a0 tx=0x7f7814002040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.715+0000 7f7822cba700 1 -- 172.21.15.103:0/3479718298 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f781c056c90 con 0x7f781c127b10 2020-04-22T14:05:43.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.715+0000 7f7819ffb700 1 -- 172.21.15.103:0/3479718298 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f7814004870 con 0x7f781c127b10 2020-04-22T14:05:43.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.715+0000 7f7821257700 1 --2- 172.21.15.103:0/3479718298 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f781c127b10 0x7f781c127fc0 secure :-1 s=THROTTLE_DONE pgs=511 cs=0 l=1 rx=0x7f78080054a0 tx=0x7f7814002040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.715+0000 7f7819ffb700 1 --2- 172.21.15.103:0/3479718298 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f77fc04da20 0x7f77fc04fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:43.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.716+0000 7f7819ffb700 1 -- 172.21.15.103:0/3479718298 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f7814061aa0 con 0x7f781c127b10 2020-04-22T14:05:43.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.716+0000 7f7820a56700 1 --2- 172.21.15.103:0/3479718298 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f77fc04da20 0x7f77fc04fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:43.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.716+0000 7f7820a56700 1 --2- 172.21.15.103:0/3479718298 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f77fc04da20 0x7f77fc04fee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f780c002f30 tx=0x7f780c0098c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.716+0000 7f7820a56700 1 --2- 172.21.15.103:0/3479718298 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f77fc04da20 0x7f77fc04fee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f780c002f30 tx=0x7f780c0098c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.716+0000 7f7820a56700 1 --2- 172.21.15.103:0/3479718298 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f77fc04da20 0x7f77fc04fee0 secure :-1 s=READY pgs=204 cs=0 l=1 rx=0x7f780c002f30 tx=0x7f780c0098c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:43.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.719+0000 7f7821257700 1 --2- 172.21.15.103:0/3479718298 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f781c127b10 0x7f781c127fc0 secure :-1 s=THROTTLE_DONE pgs=511 cs=0 l=1 rx=0x7f78080054a0 tx=0x7f7814002040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:43.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.719+0000 7f7819ffb700 1 -- 172.21.15.103:0/3479718298 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f781403cfa0 con 0x7f781c127b10 2020-04-22T14:05:43.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:43.862+0000 7f7822cba700 1 -- 172.21.15.103:0/3479718298 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f781c13fd30 con 0x7f781c127b10 2020-04-22T14:05:44.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.562+0000 7f7821257700 1 --2- 172.21.15.103:0/3479718298 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f781c127b10 0x7f781c127fc0 secure :-1 s=THROTTLE_DONE pgs=511 cs=0 l=1 rx=0x7f78080054a0 tx=0x7f7814002040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:44.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.562+0000 7f7819ffb700 1 -- 172.21.15.103:0/3479718298 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v42) v1 ==== 133+0+0 (secure 0 0 0) 0x7f78140405c0 con 0x7f781c127b10 2020-04-22T14:05:44.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.564+0000 7f7822cba700 1 -- 172.21.15.103:0/3479718298 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f77fc04da20 msgr2=0x7f77fc04fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:44.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.564+0000 7f7822cba700 1 --2- 172.21.15.103:0/3479718298 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f77fc04da20 0x7f77fc04fee0 secure :-1 s=READY pgs=204 cs=0 l=1 rx=0x7f780c002f30 tx=0x7f780c0098c0).stop 2020-04-22T14:05:44.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.564+0000 7f7822cba700 1 -- 172.21.15.103:0/3479718298 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f781c127b10 msgr2=0x7f781c127fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:44.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.564+0000 7f7822cba700 1 --2- 172.21.15.103:0/3479718298 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f781c127b10 0x7f781c127fc0 secure :-1 s=READY pgs=511 cs=0 l=1 rx=0x7f78080054a0 tx=0x7f7814002040).stop 2020-04-22T14:05:44.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.564+0000 7f7822cba700 1 -- 172.21.15.103:0/3479718298 shutdown_connections 2020-04-22T14:05:44.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.564+0000 7f7822cba700 1 --2- 172.21.15.103:0/3479718298 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f781c127b10 0x7f781c127fc0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:44.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.564+0000 7f7822cba700 1 --2- 172.21.15.103:0/3479718298 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f77fc04da20 0x7f77fc04fee0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:44.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.564+0000 7f7822cba700 1 --2- 172.21.15.103:0/3479718298 >> v2:172.21.15.86:3300/0 conn(0x7f7808004db0 0x7f781c12a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:44.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.564+0000 7f7822cba700 1 -- 172.21.15.103:0/3479718298 >> 172.21.15.103:0/3479718298 conn(0x7f781c0610c0 msgr2=0x7f781c12ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:44.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.564+0000 7f7822cba700 1 -- 172.21.15.103:0/3479718298 shutdown_connections 2020-04-22T14:05:44.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.564+0000 7f7822cba700 1 -- 172.21.15.103:0/3479718298 wait complete. 2020-04-22T14:05:44.568 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' created 2020-04-22T14:05:44.579 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:44.593 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-04-22T14:05:44.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.742+0000 7f186f59e700 1 Processor -- start 2020-04-22T14:05:44.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.742+0000 7f186f59e700 1 -- start start 2020-04-22T14:05:44.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.743+0000 7f186f59e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f187005fed0 0x7f18700af010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:44.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.743+0000 7f186f59e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18700b29b0 con 0x7f18700b8e00 2020-04-22T14:05:44.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.743+0000 7f186f59e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18700b4270 con 0x7f18700b91e0 2020-04-22T14:05:44.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.743+0000 7f186f59e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18700b4510 con 0x7f187005fed0 2020-04-22T14:05:44.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.743+0000 7f186dd9b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f18700b91e0 0x7f18700b1bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41568/0 (socket says 172.21.15.103:41568) 2020-04-22T14:05:44.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.743+0000 7f186dd9b700 1 -- 172.21.15.103:0/4205981881 learned_addr learned my addr 172.21.15.103:0/4205981881 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:44.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.743+0000 7f186ed9d700 1 --2- 172.21.15.103:0/4205981881 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f187005fed0 0x7f18700af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:44.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.744+0000 7f186d59a700 1 -- 172.21.15.103:0/4205981881 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1770081346 0 0) 0x7f18700b4270 con 0x7f18700b91e0 2020-04-22T14:05:44.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.744+0000 7f186d59a700 1 -- 172.21.15.103:0/4205981881 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1854003230 con 0x7f18700b91e0 2020-04-22T14:05:44.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.744+0000 7f186d59a700 1 -- 172.21.15.103:0/4205981881 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3534971512 0 0) 0x7f18700b29b0 con 0x7f18700b8e00 2020-04-22T14:05:44.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.744+0000 7f186d59a700 1 -- 172.21.15.103:0/4205981881 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18700b4270 con 0x7f18700b8e00 2020-04-22T14:05:44.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.744+0000 7f186d59a700 1 -- 172.21.15.103:0/4205981881 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2710007554 0 0) 0x7f1854003230 con 0x7f18700b91e0 2020-04-22T14:05:44.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.744+0000 7f186d59a700 1 -- 172.21.15.103:0/4205981881 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f187005fed0 msgr2=0x7f18700af010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:44.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.744+0000 7f186d59a700 1 --2- 172.21.15.103:0/4205981881 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f187005fed0 0x7f18700af010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:44.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.744+0000 7f186d59a700 1 -- 172.21.15.103:0/4205981881 >> v1:172.21.15.86:6789/0 conn(0x7f18700b8e00 legacy=0x7f1870142f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:44.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.744+0000 7f186d59a700 1 -- 172.21.15.103:0/4205981881 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18700b22d0 con 0x7f18700b91e0 2020-04-22T14:05:44.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.744+0000 7f186d59a700 1 -- 172.21.15.103:0/4205981881 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f18600016d0 con 0x7f18700b91e0 2020-04-22T14:05:44.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.744+0000 7f186d59a700 1 -- 172.21.15.103:0/4205981881 >> v1:172.21.15.103:6789/0 conn(0x7f18700b91e0 legacy=0x7f18700b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:44.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.744+0000 7f186d59a700 1 --2- 172.21.15.103:0/4205981881 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18540038b0 0x7f1854003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:44.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.744+0000 7f186d59a700 1 --2- 172.21.15.103:0/4205981881 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f187005fed0 0x7f18540044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:44.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.744+0000 7f186d59a700 1 --2- 172.21.15.103:0/4205981881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1854004930 0x7f1854004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:44.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.744+0000 7f186d59a700 1 -- 172.21.15.103:0/4205981881 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18700b4510 con 0x7f1854004930 2020-04-22T14:05:44.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.744+0000 7f186d59a700 1 -- 172.21.15.103:0/4205981881 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1854005210 con 0x7f18540038b0 2020-04-22T14:05:44.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.744+0000 7f186d59a700 1 -- 172.21.15.103:0/4205981881 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185400b720 con 0x7f187005fed0 2020-04-22T14:05:44.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.744+0000 7f186e59c700 1 --2- 172.21.15.103:0/4205981881 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18540038b0 0x7f1854003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:44.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.744+0000 7f186ed9d700 1 --2- 172.21.15.103:0/4205981881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1854004930 0x7f1854004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:44.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.744+0000 7f186dd9b700 1 --2- 172.21.15.103:0/4205981881 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f187005fed0 0x7f18540044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:44.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.744+0000 7f186e59c700 1 -- 172.21.15.103:0/4205981881 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f187005fed0 msgr2=0x7f18540044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:44.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.744+0000 7f186e59c700 1 --2- 172.21.15.103:0/4205981881 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f187005fed0 0x7f18540044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:44.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.744+0000 7f186e59c700 1 -- 172.21.15.103:0/4205981881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1854004930 msgr2=0x7f1854004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:44.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.744+0000 7f186e59c700 1 --2- 172.21.15.103:0/4205981881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1854004930 0x7f1854004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:44.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.744+0000 7f186e59c700 1 -- 172.21.15.103:0/4205981881 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1854003230 con 0x7f18540038b0 2020-04-22T14:05:44.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.744+0000 7f186dd9b700 1 --2- 172.21.15.103:0/4205981881 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f187005fed0 0x7f18540044d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:05:44.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.744+0000 7f186e59c700 1 --2- 172.21.15.103:0/4205981881 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18540038b0 0x7f1854003cb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f18640010d0 tx=0x7f186400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:44.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.744+0000 7f186e59c700 1 --2- 172.21.15.103:0/4205981881 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18540038b0 0x7f1854003cb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f18640010d0 tx=0x7f186400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:44.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.744+0000 7f186e59c700 1 --2- 172.21.15.103:0/4205981881 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18540038b0 0x7f1854003cb0 secure :-1 s=READY pgs=513 cs=0 l=1 rx=0x7f18640010d0 tx=0x7f186400fe50).ready entity=mon.1 client_cookie=d13701fe1feef483 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:44.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.745+0000 7f186e59c700 1 --2- 172.21.15.103:0/4205981881 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18540038b0 0x7f1854003cb0 secure :-1 s=THROTTLE_DONE pgs=513 cs=0 l=1 rx=0x7f18640010d0 tx=0x7f186400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:44.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.745+0000 7f186d59a700 1 -- 172.21.15.103:0/4205981881 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1864010b60 con 0x7f18540038b0 2020-04-22T14:05:44.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.745+0000 7f186e59c700 1 --2- 172.21.15.103:0/4205981881 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18540038b0 0x7f1854003cb0 secure :-1 s=THROTTLE_DONE pgs=513 cs=0 l=1 rx=0x7f18640010d0 tx=0x7f186400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:44.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.745+0000 7f186e59c700 1 --2- 172.21.15.103:0/4205981881 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18540038b0 0x7f1854003cb0 secure :-1 s=THROTTLE_DONE pgs=513 cs=0 l=1 rx=0x7f18640010d0 tx=0x7f186400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:44.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.745+0000 7f186d59a700 1 -- 172.21.15.103:0/4205981881 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1864010d00 con 0x7f18540038b0 2020-04-22T14:05:44.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.745+0000 7f186d59a700 1 -- 172.21.15.103:0/4205981881 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1864010e70 con 0x7f18540038b0 2020-04-22T14:05:44.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.745+0000 7f186f59e700 1 -- 172.21.15.103:0/4205981881 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18540038b0 msgr2=0x7f1854003cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:44.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.745+0000 7f186f59e700 1 --2- 172.21.15.103:0/4205981881 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18540038b0 0x7f1854003cb0 secure :-1 s=READY pgs=513 cs=0 l=1 rx=0x7f18640010d0 tx=0x7f186400fe50).stop 2020-04-22T14:05:44.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.745+0000 7f186ed9d700 1 -- 172.21.15.103:0/4205981881 reap_dead start 2020-04-22T14:05:44.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.745+0000 7f186f59e700 1 -- 172.21.15.103:0/4205981881 shutdown_connections 2020-04-22T14:05:44.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.745+0000 7f186f59e700 1 -- 172.21.15.103:0/4205981881 >> 172.21.15.103:0/4205981881 conn(0x7f187005b780 msgr2=0x7f18700b8530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:44.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.745+0000 7f186f59e700 1 -- 172.21.15.103:0/4205981881 shutdown_connections 2020-04-22T14:05:44.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.745+0000 7f186f59e700 1 -- 172.21.15.103:0/4205981881 wait complete. 2020-04-22T14:05:44.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.746+0000 7f186f59e700 1 Processor -- start 2020-04-22T14:05:44.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.746+0000 7f186f59e700 1 -- start start 2020-04-22T14:05:44.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.747+0000 7f186f59e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1870061950 0x7f1870143650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:44.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.747+0000 7f186f59e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1870155480 0x7f1870063600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:44.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.747+0000 7f186f59e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1870063a60 con 0x7f18700628d0 2020-04-22T14:05:44.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.747+0000 7f186f59e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1870152470 con 0x7f1870061950 2020-04-22T14:05:44.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.747+0000 7f186f59e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1870066200 con 0x7f1870155480 2020-04-22T14:05:44.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.747+0000 7f186e59c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1870061950 0x7f1870143650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:44.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.747+0000 7f186e59c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1870061950 0x7f1870143650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49388/0 (socket says 172.21.15.103:49388) 2020-04-22T14:05:44.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.747+0000 7f186e59c700 1 -- 172.21.15.103:0/2303521824 learned_addr learned my addr 172.21.15.103:0/2303521824 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:05:44.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.747+0000 7f186ed9d700 1 --2- 172.21.15.103:0/2303521824 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1870155480 0x7f1870063600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:44.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.747+0000 7f186e59c700 1 -- 172.21.15.103:0/2303521824 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1870155480 msgr2=0x7f1870063600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:44.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.747+0000 7f186e59c700 1 --2- 172.21.15.103:0/2303521824 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1870155480 0x7f1870063600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:44.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.747+0000 7f186e59c700 1 -- 172.21.15.103:0/2303521824 >> v1:172.21.15.86:6789/0 conn(0x7f18700628d0 legacy=0x7f1870062ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:44.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.747+0000 7f186e59c700 1 -- 172.21.15.103:0/2303521824 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18700664a0 con 0x7f1870061950 2020-04-22T14:05:44.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.747+0000 7f186e59c700 1 --2- 172.21.15.103:0/2303521824 >> v2:172.21.15.103:3300/0 conn(0x7f1870061950 0x7f1870143650 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f18640010d0 tx=0x7f186400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:44.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.747+0000 7f186e59c700 1 --2- 172.21.15.103:0/2303521824 >> v2:172.21.15.103:3300/0 conn(0x7f1870061950 0x7f1870143650 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f18640010d0 tx=0x7f186400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:44.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.747+0000 7f186e59c700 1 --2- 172.21.15.103:0/2303521824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1870061950 0x7f1870143650 secure :-1 s=READY pgs=514 cs=0 l=1 rx=0x7f18640010d0 tx=0x7f186400fe50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:44.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.747+0000 7f186e59c700 1 --2- 172.21.15.103:0/2303521824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1870061950 0x7f1870143650 secure :-1 s=THROTTLE_DONE pgs=514 cs=0 l=1 rx=0x7f18640010d0 tx=0x7f186400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:44.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.747+0000 7f185f7fe700 1 -- 172.21.15.103:0/2303521824 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18640064e0 con 0x7f1870061950 2020-04-22T14:05:44.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.747+0000 7f186e59c700 1 --2- 172.21.15.103:0/2303521824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1870061950 0x7f1870143650 secure :-1 s=THROTTLE_DONE pgs=514 cs=0 l=1 rx=0x7f18640010d0 tx=0x7f186400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:44.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.747+0000 7f186e59c700 1 --2- 172.21.15.103:0/2303521824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1870061950 0x7f1870143650 secure :-1 s=THROTTLE_DONE pgs=514 cs=0 l=1 rx=0x7f18640010d0 tx=0x7f186400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:44.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.747+0000 7f185f7fe700 1 -- 172.21.15.103:0/2303521824 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1864006680 con 0x7f1870061950 2020-04-22T14:05:44.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.747+0000 7f185f7fe700 1 -- 172.21.15.103:0/2303521824 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1864006aa0 con 0x7f1870061950 2020-04-22T14:05:44.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.747+0000 7f186f59e700 1 -- 172.21.15.103:0/2303521824 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1870061d30 con 0x7f1870061950 2020-04-22T14:05:44.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.747+0000 7f186f59e700 1 -- 172.21.15.103:0/2303521824 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18701514e0 con 0x7f1870061950 2020-04-22T14:05:44.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.748+0000 7f186e59c700 1 --2- 172.21.15.103:0/2303521824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1870061950 0x7f1870143650 secure :-1 s=THROTTLE_DONE pgs=514 cs=0 l=1 rx=0x7f18640010d0 tx=0x7f186400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:44.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.748+0000 7f185f7fe700 1 -- 172.21.15.103:0/2303521824 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f186400b0b0 con 0x7f1870061950 2020-04-22T14:05:44.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.748+0000 7f186e59c700 1 --2- 172.21.15.103:0/2303521824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1870061950 0x7f1870143650 secure :-1 s=THROTTLE_DONE pgs=514 cs=0 l=1 rx=0x7f18640010d0 tx=0x7f186400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:44.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.749+0000 7f186f59e700 1 -- 172.21.15.103:0/2303521824 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1870056c90 con 0x7f1870061950 2020-04-22T14:05:44.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.749+0000 7f185f7fe700 1 --2- 172.21.15.103:0/2303521824 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f184c04d8b0 0x7f184c04fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:44.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.749+0000 7f185f7fe700 1 -- 172.21.15.103:0/2303521824 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f1864061790 con 0x7f1870061950 2020-04-22T14:05:44.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.749+0000 7f186dd9b700 1 --2- 172.21.15.103:0/2303521824 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f184c04d8b0 0x7f184c04fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:44.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.749+0000 7f186dd9b700 1 --2- 172.21.15.103:0/2303521824 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f184c04d8b0 0x7f184c04fd70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1870062320 tx=0x7f18700b24c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:44.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.749+0000 7f186dd9b700 1 --2- 172.21.15.103:0/2303521824 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f184c04d8b0 0x7f184c04fd70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1870062320 tx=0x7f18700b24c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:44.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.749+0000 7f186dd9b700 1 --2- 172.21.15.103:0/2303521824 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f184c04d8b0 0x7f184c04fd70 secure :-1 s=READY pgs=205 cs=0 l=1 rx=0x7f1870062320 tx=0x7f18700b24c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:44.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.753+0000 7f186e59c700 1 --2- 172.21.15.103:0/2303521824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1870061950 0x7f1870143650 secure :-1 s=THROTTLE_DONE pgs=514 cs=0 l=1 rx=0x7f18640010d0 tx=0x7f186400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:44.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.753+0000 7f185f7fe700 1 -- 172.21.15.103:0/2303521824 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f186403cc30 con 0x7f1870061950 2020-04-22T14:05:44.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:44.897+0000 7f186f59e700 1 -- 172.21.15.103:0/2303521824 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f187006a8b0 con 0x7f1870061950 2020-04-22T14:05:45.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.570+0000 7f186e59c700 1 --2- 172.21.15.103:0/2303521824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1870061950 0x7f1870143650 secure :-1 s=THROTTLE_DONE pgs=514 cs=0 l=1 rx=0x7f18640010d0 tx=0x7f186400fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:45.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.570+0000 7f185f7fe700 1 -- 172.21.15.103:0/2303521824 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v43) v1 ==== 125+0+0 (secure 0 0 0) 0x7f1864040250 con 0x7f1870061950 2020-04-22T14:05:45.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.574+0000 7f186f59e700 1 -- 172.21.15.103:0/2303521824 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f184c04d8b0 msgr2=0x7f184c04fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:45.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.574+0000 7f186f59e700 1 --2- 172.21.15.103:0/2303521824 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f184c04d8b0 0x7f184c04fd70 secure :-1 s=READY pgs=205 cs=0 l=1 rx=0x7f1870062320 tx=0x7f18700b24c0).stop 2020-04-22T14:05:45.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.574+0000 7f186f59e700 1 -- 172.21.15.103:0/2303521824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1870061950 msgr2=0x7f1870143650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:45.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.574+0000 7f186f59e700 1 --2- 172.21.15.103:0/2303521824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1870061950 0x7f1870143650 secure :-1 s=READY pgs=514 cs=0 l=1 rx=0x7f18640010d0 tx=0x7f186400fe50).stop 2020-04-22T14:05:45.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.574+0000 7f186f59e700 1 -- 172.21.15.103:0/2303521824 shutdown_connections 2020-04-22T14:05:45.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.574+0000 7f186f59e700 1 --2- 172.21.15.103:0/2303521824 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f184c04d8b0 0x7f184c04fd70 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:45.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.574+0000 7f186f59e700 1 --2- 172.21.15.103:0/2303521824 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1870155480 0x7f1870063600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:45.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.574+0000 7f186f59e700 1 --2- 172.21.15.103:0/2303521824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1870061950 0x7f1870143650 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:45.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.574+0000 7f186f59e700 1 -- 172.21.15.103:0/2303521824 >> 172.21.15.103:0/2303521824 conn(0x7f187005b780 msgr2=0x7f18700b8530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:45.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.574+0000 7f186f59e700 1 -- 172.21.15.103:0/2303521824 shutdown_connections 2020-04-22T14:05:45.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.574+0000 7f186f59e700 1 -- 172.21.15.103:0/2303521824 wait complete. 2020-04-22T14:05:45.578 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' created 2020-04-22T14:05:45.589 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:45.604 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-04-22T14:05:45.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.754+0000 7f50593f3700 1 Processor -- start 2020-04-22T14:05:45.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.755+0000 7f50593f3700 1 -- start start 2020-04-22T14:05:45.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.755+0000 7f50593f3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f50540b91e0 0x7f50540af010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:45.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.755+0000 7f50593f3700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50540b29b0 con 0x7f50540b8e00 2020-04-22T14:05:45.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.755+0000 7f50593f3700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50540b4270 con 0x7f505405fed0 2020-04-22T14:05:45.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.755+0000 7f50593f3700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50540b4510 con 0x7f50540b91e0 2020-04-22T14:05:45.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.755+0000 7f5058bf2700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f505405fed0 0x7f50540b1bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41590/0 (socket says 172.21.15.103:41590) 2020-04-22T14:05:45.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.755+0000 7f5058bf2700 1 -- 172.21.15.103:0/1098986679 learned_addr learned my addr 172.21.15.103:0/1098986679 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:45.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.756+0000 7f5052ffd700 1 -- 172.21.15.103:0/1098986679 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2197875165 0 0) 0x7f50540b4270 con 0x7f505405fed0 2020-04-22T14:05:45.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.756+0000 7f50537fe700 1 --2- 172.21.15.103:0/1098986679 >> v2:172.21.15.86:3300/0 conn(0x7f50540b91e0 0x7f50540af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:45.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.756+0000 7f5052ffd700 1 -- 172.21.15.103:0/1098986679 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5040003230 con 0x7f505405fed0 2020-04-22T14:05:45.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.756+0000 7f5052ffd700 1 -- 172.21.15.103:0/1098986679 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2097795402 0 0) 0x7f5040003230 con 0x7f505405fed0 2020-04-22T14:05:45.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.756+0000 7f5052ffd700 1 -- 172.21.15.103:0/1098986679 >> v2:172.21.15.86:3300/0 conn(0x7f50540b91e0 msgr2=0x7f50540af010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:45.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.756+0000 7f5052ffd700 1 --2- 172.21.15.103:0/1098986679 >> v2:172.21.15.86:3300/0 conn(0x7f50540b91e0 0x7f50540af010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:45.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.756+0000 7f5052ffd700 1 -- 172.21.15.103:0/1098986679 >> v1:172.21.15.86:6789/0 conn(0x7f50540b8e00 legacy=0x7f5054142f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:45.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.756+0000 7f5052ffd700 1 -- 172.21.15.103:0/1098986679 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50540b22d0 con 0x7f505405fed0 2020-04-22T14:05:45.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.756+0000 7f5052ffd700 1 -- 172.21.15.103:0/1098986679 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f504c001a50 con 0x7f505405fed0 2020-04-22T14:05:45.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.756+0000 7f5052ffd700 1 -- 172.21.15.103:0/1098986679 >> v1:172.21.15.103:6789/0 conn(0x7f505405fed0 legacy=0x7f50540b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:45.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.756+0000 7f5052ffd700 1 --2- 172.21.15.103:0/1098986679 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5040003720 0x7f5040003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:45.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.756+0000 7f5052ffd700 1 --2- 172.21.15.103:0/1098986679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50400044d0 0x7f5040004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:45.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.756+0000 7f5052ffd700 1 --2- 172.21.15.103:0/1098986679 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5040004db0 0x7f504000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:45.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.756+0000 7f5052ffd700 1 -- 172.21.15.103:0/1098986679 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50540b4510 con 0x7f5040004db0 2020-04-22T14:05:45.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.756+0000 7f5052ffd700 1 -- 172.21.15.103:0/1098986679 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50400041c0 con 0x7f50400044d0 2020-04-22T14:05:45.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.756+0000 7f5052ffd700 1 -- 172.21.15.103:0/1098986679 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f504000bb80 con 0x7f5040003720 2020-04-22T14:05:45.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.756+0000 7f50537fe700 1 --2- 172.21.15.103:0/1098986679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50400044d0 0x7f5040004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:45.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.756+0000 7f5058bf2700 1 --2- 172.21.15.103:0/1098986679 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5040004db0 0x7f504000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:45.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.756+0000 7f5053fff700 1 --2- 172.21.15.103:0/1098986679 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5040003720 0x7f5040003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:45.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.756+0000 7f50537fe700 1 -- 172.21.15.103:0/1098986679 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5040003720 msgr2=0x7f5040003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:45.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.756+0000 7f50537fe700 1 --2- 172.21.15.103:0/1098986679 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5040003720 0x7f5040003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:45.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.756+0000 7f50537fe700 1 -- 172.21.15.103:0/1098986679 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5040004db0 msgr2=0x7f504000b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:45.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.756+0000 7f50537fe700 1 --2- 172.21.15.103:0/1098986679 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5040004db0 0x7f504000b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:45.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.756+0000 7f50537fe700 1 -- 172.21.15.103:0/1098986679 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5040003230 con 0x7f50400044d0 2020-04-22T14:05:45.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.756+0000 7f5058bf2700 1 --2- 172.21.15.103:0/1098986679 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5040004db0 0x7f504000b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:05:45.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.756+0000 7f5053fff700 1 --2- 172.21.15.103:0/1098986679 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5040003720 0x7f5040003b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:05:45.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.756+0000 7f5058bf2700 1 -- 172.21.15.103:0/1098986679 reap_dead start 2020-04-22T14:05:45.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.756+0000 7f50537fe700 1 --2- 172.21.15.103:0/1098986679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50400044d0 0x7f5040004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f50400054a0 tx=0x7f5048010100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:45.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.756+0000 7f50537fe700 1 --2- 172.21.15.103:0/1098986679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50400044d0 0x7f5040004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f50400054a0 tx=0x7f5048010100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:45.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.756+0000 7f50537fe700 1 --2- 172.21.15.103:0/1098986679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50400044d0 0x7f5040004950 secure :-1 s=READY pgs=516 cs=0 l=1 rx=0x7f50400054a0 tx=0x7f5048010100).ready entity=mon.1 client_cookie=782821b3c4da9d87 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:45.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.757+0000 7f50537fe700 1 --2- 172.21.15.103:0/1098986679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50400044d0 0x7f5040004950 secure :-1 s=THROTTLE_DONE pgs=516 cs=0 l=1 rx=0x7f50400054a0 tx=0x7f5048010100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:45.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.757+0000 7f5052ffd700 1 -- 172.21.15.103:0/1098986679 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5048010dd0 con 0x7f50400044d0 2020-04-22T14:05:45.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.757+0000 7f50537fe700 1 --2- 172.21.15.103:0/1098986679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50400044d0 0x7f5040004950 secure :-1 s=THROTTLE_DONE pgs=516 cs=0 l=1 rx=0x7f50400054a0 tx=0x7f5048010100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:45.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.757+0000 7f50537fe700 1 --2- 172.21.15.103:0/1098986679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50400044d0 0x7f5040004950 secure :-1 s=THROTTLE_DONE pgs=516 cs=0 l=1 rx=0x7f50400054a0 tx=0x7f5048010100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:45.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.757+0000 7f5052ffd700 1 -- 172.21.15.103:0/1098986679 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5048008910 con 0x7f50400044d0 2020-04-22T14:05:45.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.757+0000 7f5052ffd700 1 -- 172.21.15.103:0/1098986679 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5048008c70 con 0x7f50400044d0 2020-04-22T14:05:45.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.757+0000 7f50593f3700 1 -- 172.21.15.103:0/1098986679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50400044d0 msgr2=0x7f5040004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:45.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.757+0000 7f50593f3700 1 --2- 172.21.15.103:0/1098986679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50400044d0 0x7f5040004950 secure :-1 s=READY pgs=516 cs=0 l=1 rx=0x7f50400054a0 tx=0x7f5048010100).stop 2020-04-22T14:05:45.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.757+0000 7f50593f3700 1 -- 172.21.15.103:0/1098986679 shutdown_connections 2020-04-22T14:05:45.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.757+0000 7f50593f3700 1 --2- 172.21.15.103:0/1098986679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50400044d0 0x7f5040004950 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:45.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.757+0000 7f50593f3700 1 -- 172.21.15.103:0/1098986679 >> 172.21.15.103:0/1098986679 conn(0x7f505405b780 msgr2=0x7f50540b8530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:45.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.757+0000 7f50593f3700 1 -- 172.21.15.103:0/1098986679 shutdown_connections 2020-04-22T14:05:45.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.757+0000 7f50593f3700 1 -- 172.21.15.103:0/1098986679 wait complete. 2020-04-22T14:05:45.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.758+0000 7f50593f3700 1 Processor -- start 2020-04-22T14:05:45.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.758+0000 7f50593f3700 1 -- start start 2020-04-22T14:05:45.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.759+0000 7f50593f3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f50400044d0 0x7f5054142710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:45.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.759+0000 7f50593f3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5054061950 0x7f5054142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:45.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.759+0000 7f50593f3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5054151a00 0x7f5054151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:45.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.759+0000 7f50593f3700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5054061db0 con 0x7f50400044d0 2020-04-22T14:05:45.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.759+0000 7f50593f3700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5054143580 con 0x7f5054151a00 2020-04-22T14:05:45.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.759+0000 7f50593f3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5054154ff0 con 0x7f5054061950 2020-04-22T14:05:45.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.759+0000 7f5058bf2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5054151a00 0x7f5054151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:45.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.759+0000 7f5058bf2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5054151a00 0x7f5054151eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49410/0 (socket says 172.21.15.103:49410) 2020-04-22T14:05:45.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.759+0000 7f5058bf2700 1 -- 172.21.15.103:0/3708706377 learned_addr learned my addr 172.21.15.103:0/3708706377 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:05:45.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.759+0000 7f50537fe700 1 --2- 172.21.15.103:0/3708706377 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5054061950 0x7f5054142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:45.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.759+0000 7f5053fff700 1 --2- 172.21.15.103:0/3708706377 >> v2:172.21.15.86:3300/0 conn(0x7f50400044d0 0x7f5054142710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:45.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.759+0000 7f5058bf2700 1 -- 172.21.15.103:0/3708706377 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5054061950 msgr2=0x7f5054142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:45.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.759+0000 7f5058bf2700 1 --2- 172.21.15.103:0/3708706377 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5054061950 0x7f5054142dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:45.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.759+0000 7f5058bf2700 1 -- 172.21.15.103:0/3708706377 >> v2:172.21.15.86:3300/0 conn(0x7f50400044d0 msgr2=0x7f5054142710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:45.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.759+0000 7f5058bf2700 1 --2- 172.21.15.103:0/3708706377 >> v2:172.21.15.86:3300/0 conn(0x7f50400044d0 0x7f5054142710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:45.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.759+0000 7f5058bf2700 1 -- 172.21.15.103:0/3708706377 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5054143820 con 0x7f5054151a00 2020-04-22T14:05:45.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.759+0000 7f50537fe700 1 --2- 172.21.15.103:0/3708706377 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5054061950 0x7f5054142dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:05:45.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.759+0000 7f5058bf2700 1 --2- 172.21.15.103:0/3708706377 >> v2:172.21.15.103:3300/0 conn(0x7f5054151a00 0x7f5054151eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f50540af7e0 tx=0x7f50540b24c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:45.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.759+0000 7f5058bf2700 1 --2- 172.21.15.103:0/3708706377 >> v2:172.21.15.103:3300/0 conn(0x7f5054151a00 0x7f5054151eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f50540af7e0 tx=0x7f50540b24c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:45.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.759+0000 7f5058bf2700 1 --2- 172.21.15.103:0/3708706377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5054151a00 0x7f5054151eb0 secure :-1 s=READY pgs=517 cs=0 l=1 rx=0x7f50540af7e0 tx=0x7f50540b24c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:45.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.760+0000 7f5058bf2700 1 --2- 172.21.15.103:0/3708706377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5054151a00 0x7f5054151eb0 secure :-1 s=THROTTLE_DONE pgs=517 cs=0 l=1 rx=0x7f50540af7e0 tx=0x7f50540b24c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:45.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.760+0000 7f50517fa700 1 -- 172.21.15.103:0/3708706377 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f504c004c50 con 0x7f5054151a00 2020-04-22T14:05:45.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.760+0000 7f5058bf2700 1 --2- 172.21.15.103:0/3708706377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5054151a00 0x7f5054151eb0 secure :-1 s=THROTTLE_DONE pgs=517 cs=0 l=1 rx=0x7f50540af7e0 tx=0x7f50540b24c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:45.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.760+0000 7f5058bf2700 1 --2- 172.21.15.103:0/3708706377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5054151a00 0x7f5054151eb0 secure :-1 s=THROTTLE_DONE pgs=517 cs=0 l=1 rx=0x7f50540af7e0 tx=0x7f50540b24c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:45.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.760+0000 7f50517fa700 1 -- 172.21.15.103:0/3708706377 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f504c004db0 con 0x7f5054151a00 2020-04-22T14:05:45.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.760+0000 7f50593f3700 1 -- 172.21.15.103:0/3708706377 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5054143220 con 0x7f5054151a00 2020-04-22T14:05:45.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.760+0000 7f50517fa700 1 -- 172.21.15.103:0/3708706377 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f504c00d2c0 con 0x7f5054151a00 2020-04-22T14:05:45.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.760+0000 7f50593f3700 1 -- 172.21.15.103:0/3708706377 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5054134af0 con 0x7f5054151a00 2020-04-22T14:05:45.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.760+0000 7f5058bf2700 1 --2- 172.21.15.103:0/3708706377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5054151a00 0x7f5054151eb0 secure :-1 s=THROTTLE_DONE pgs=517 cs=0 l=1 rx=0x7f50540af7e0 tx=0x7f50540b24c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:45.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.761+0000 7f50593f3700 1 -- 172.21.15.103:0/3708706377 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5054056c90 con 0x7f5054151a00 2020-04-22T14:05:45.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.761+0000 7f50517fa700 1 -- 172.21.15.103:0/3708706377 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f504c00d420 con 0x7f5054151a00 2020-04-22T14:05:45.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.761+0000 7f5058bf2700 1 --2- 172.21.15.103:0/3708706377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5054151a00 0x7f5054151eb0 secure :-1 s=THROTTLE_DONE pgs=517 cs=0 l=1 rx=0x7f50540af7e0 tx=0x7f50540b24c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:45.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.761+0000 7f50517fa700 1 --2- 172.21.15.103:0/3708706377 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f503404da70 0x7f503404ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:45.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.761+0000 7f50517fa700 1 -- 172.21.15.103:0/3708706377 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f504c060eb0 con 0x7f5054151a00 2020-04-22T14:05:45.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.761+0000 7f5053fff700 1 --2- 172.21.15.103:0/3708706377 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f503404da70 0x7f503404ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:45.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.761+0000 7f5053fff700 1 --2- 172.21.15.103:0/3708706377 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f503404da70 0x7f503404ff30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5054062890 tx=0x7f5044001980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:45.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.761+0000 7f5053fff700 1 --2- 172.21.15.103:0/3708706377 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f503404da70 0x7f503404ff30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5054062890 tx=0x7f5044001980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:45.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.761+0000 7f5053fff700 1 --2- 172.21.15.103:0/3708706377 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f503404da70 0x7f503404ff30 secure :-1 s=READY pgs=206 cs=0 l=1 rx=0x7f5054062890 tx=0x7f5044001980).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:45.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.765+0000 7f5058bf2700 1 --2- 172.21.15.103:0/3708706377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5054151a00 0x7f5054151eb0 secure :-1 s=THROTTLE_DONE pgs=517 cs=0 l=1 rx=0x7f50540af7e0 tx=0x7f50540b24c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:45.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.765+0000 7f50517fa700 1 -- 172.21.15.103:0/3708706377 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f504c03c290 con 0x7f5054151a00 2020-04-22T14:05:45.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.956+0000 7f50593f3700 1 -- 172.21.15.103:0/3708706377 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f50541433b0 con 0x7f5054151a00 2020-04-22T14:05:45.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.965+0000 7f5058bf2700 1 --2- 172.21.15.103:0/3708706377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5054151a00 0x7f5054151eb0 secure :-1 s=THROTTLE_DONE pgs=517 cs=0 l=1 rx=0x7f50540af7e0 tx=0x7f50540b24c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:45.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.965+0000 7f50517fa700 1 -- 172.21.15.103:0/3708706377 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 7 and data pool 8 v18) v1 ==== 187+0+0 (secure 0 0 0) 0x7f504c03f8b0 con 0x7f5054151a00 2020-04-22T14:05:45.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.968+0000 7f50593f3700 1 -- 172.21.15.103:0/3708706377 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f503404da70 msgr2=0x7f503404ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:45.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.968+0000 7f50593f3700 1 --2- 172.21.15.103:0/3708706377 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f503404da70 0x7f503404ff30 secure :-1 s=READY pgs=206 cs=0 l=1 rx=0x7f5054062890 tx=0x7f5044001980).stop 2020-04-22T14:05:45.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.968+0000 7f50593f3700 1 -- 172.21.15.103:0/3708706377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5054151a00 msgr2=0x7f5054151eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:45.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.968+0000 7f50593f3700 1 --2- 172.21.15.103:0/3708706377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5054151a00 0x7f5054151eb0 secure :-1 s=READY pgs=517 cs=0 l=1 rx=0x7f50540af7e0 tx=0x7f50540b24c0).stop 2020-04-22T14:05:45.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.968+0000 7f50593f3700 1 -- 172.21.15.103:0/3708706377 shutdown_connections 2020-04-22T14:05:45.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.968+0000 7f50593f3700 1 --2- 172.21.15.103:0/3708706377 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f503404da70 0x7f503404ff30 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:45.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.968+0000 7f50593f3700 1 --2- 172.21.15.103:0/3708706377 >> v2:172.21.15.86:3300/0 conn(0x7f50400044d0 0x7f5054142710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:45.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.968+0000 7f50593f3700 1 --2- 172.21.15.103:0/3708706377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5054151a00 0x7f5054151eb0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:45.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.968+0000 7f50593f3700 1 --2- 172.21.15.103:0/3708706377 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5054061950 0x7f5054142dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:45.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.968+0000 7f50593f3700 1 -- 172.21.15.103:0/3708706377 >> 172.21.15.103:0/3708706377 conn(0x7f505405b780 msgr2=0x7f50540b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:45.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.969+0000 7f50593f3700 1 -- 172.21.15.103:0/3708706377 shutdown_connections 2020-04-22T14:05:45.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:45.969+0000 7f50593f3700 1 -- 172.21.15.103:0/3708706377 wait complete. 2020-04-22T14:05:45.974 INFO:teuthology.orchestra.run.smithi103.stderr:new fs with metadata pool 7 and data pool 8 2020-04-22T14:05:45.986 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:46.000 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:05:46.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.144+0000 7f7417359700 1 Processor -- start 2020-04-22T14:05:46.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.144+0000 7f7417359700 1 -- start start 2020-04-22T14:05:46.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.145+0000 7f7417359700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f74100ad150 0x7f74100664a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:46.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.145+0000 7f7417359700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7410141c10 0x7f74101420a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:46.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.145+0000 7f7417359700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7410066a20 con 0x7f7410142500 2020-04-22T14:05:46.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.145+0000 7f7417359700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74100adf30 con 0x7f7410141c10 2020-04-22T14:05:46.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.145+0000 7f7417359700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74100ad7f0 con 0x7f74100ad150 2020-04-22T14:05:46.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.145+0000 7f7416357700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f74100ad150 0x7f74100664a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:46.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.145+0000 7f7416357700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f74100ad150 0x7f74100664a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49426/0 (socket says 172.21.15.103:49426) 2020-04-22T14:05:46.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.145+0000 7f7416357700 1 -- 172.21.15.103:0/4206428314 learned_addr learned my addr 172.21.15.103:0/4206428314 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:05:46.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.145+0000 7f7415b56700 1 --2- 172.21.15.103:0/4206428314 >> v2:172.21.15.86:3300/0 conn(0x7f7410141c10 0x7f74101420a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:46.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.145+0000 7f7416357700 1 -- 172.21.15.103:0/4206428314 >> v2:172.21.15.86:3300/0 conn(0x7f7410141c10 msgr2=0x7f74101420a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:46.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.145+0000 7f7416357700 1 --2- 172.21.15.103:0/4206428314 >> v2:172.21.15.86:3300/0 conn(0x7f7410141c10 0x7f74101420a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:46.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.145+0000 7f7416357700 1 -- 172.21.15.103:0/4206428314 >> v1:172.21.15.86:6789/0 conn(0x7f7410142500 legacy=0x7f7410063340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:46.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.145+0000 7f7416357700 1 -- 172.21.15.103:0/4206428314 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74100ada90 con 0x7f74100ad150 2020-04-22T14:05:46.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.145+0000 7f7415b56700 1 --2- 172.21.15.103:0/4206428314 >> v2:172.21.15.86:3300/0 conn(0x7f7410141c10 0x7f74101420a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:05:46.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.145+0000 7f7416357700 1 --2- 172.21.15.103:0/4206428314 >> v2:172.21.15.103:3300/0 conn(0x7f74100ad150 0x7f74100664a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f741006a000 tx=0x7f7400007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.145+0000 7f7416357700 1 --2- 172.21.15.103:0/4206428314 >> v2:172.21.15.103:3300/0 conn(0x7f74100ad150 0x7f74100664a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f741006a000 tx=0x7f7400007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.146+0000 7f7416357700 1 --2- 172.21.15.103:0/4206428314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74100ad150 0x7f74100664a0 secure :-1 s=READY pgs=518 cs=0 l=1 rx=0x7f741006a000 tx=0x7f7400007a40).ready entity=mon.1 client_cookie=26d7b4a31bca4b42 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:46.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.146+0000 7f7416357700 1 --2- 172.21.15.103:0/4206428314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74100ad150 0x7f74100664a0 secure :-1 s=THROTTLE_DONE pgs=518 cs=0 l=1 rx=0x7f741006a000 tx=0x7f7400007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.146+0000 7f7415355700 1 -- 172.21.15.103:0/4206428314 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74000116e0 con 0x7f74100ad150 2020-04-22T14:05:46.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.146+0000 7f7416357700 1 --2- 172.21.15.103:0/4206428314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74100ad150 0x7f74100664a0 secure :-1 s=THROTTLE_DONE pgs=518 cs=0 l=1 rx=0x7f741006a000 tx=0x7f7400007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.146+0000 7f7416357700 1 --2- 172.21.15.103:0/4206428314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74100ad150 0x7f74100664a0 secure :-1 s=THROTTLE_DONE pgs=518 cs=0 l=1 rx=0x7f741006a000 tx=0x7f7400007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.146+0000 7f7415355700 1 -- 172.21.15.103:0/4206428314 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7400011840 con 0x7f74100ad150 2020-04-22T14:05:46.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.146+0000 7f7415355700 1 -- 172.21.15.103:0/4206428314 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7400011c20 con 0x7f74100ad150 2020-04-22T14:05:46.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.146+0000 7f7417359700 1 -- 172.21.15.103:0/4206428314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74100ad150 msgr2=0x7f74100664a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:46.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.146+0000 7f7417359700 1 --2- 172.21.15.103:0/4206428314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74100ad150 0x7f74100664a0 secure :-1 s=READY pgs=518 cs=0 l=1 rx=0x7f741006a000 tx=0x7f7400007a40).stop 2020-04-22T14:05:46.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.146+0000 7f7417359700 1 -- 172.21.15.103:0/4206428314 shutdown_connections 2020-04-22T14:05:46.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.146+0000 7f7417359700 1 --2- 172.21.15.103:0/4206428314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74100ad150 0x7f74100664a0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:46.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.146+0000 7f7417359700 1 --2- 172.21.15.103:0/4206428314 >> v2:172.21.15.86:3300/0 conn(0x7f7410141c10 0x7f74101420a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:46.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.146+0000 7f7417359700 1 -- 172.21.15.103:0/4206428314 >> 172.21.15.103:0/4206428314 conn(0x7f741005b7c0 msgr2=0x7f7410061610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:46.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.146+0000 7f7417359700 1 -- 172.21.15.103:0/4206428314 shutdown_connections 2020-04-22T14:05:46.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.146+0000 7f7417359700 1 -- 172.21.15.103:0/4206428314 wait complete. 2020-04-22T14:05:46.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.147+0000 7f7417359700 1 Processor -- start 2020-04-22T14:05:46.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.147+0000 7f7417359700 1 -- start start 2020-04-22T14:05:46.162 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.148+0000 7f7417359700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7410141c10 0x7f741012c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:46.162 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.148+0000 7f7417359700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7410142500 0x7f741012ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:46.162 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.148+0000 7f7417359700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7410129240 con 0x7f74100ad150 2020-04-22T14:05:46.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.148+0000 7f7417359700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f741012b3a0 con 0x7f7410141c10 2020-04-22T14:05:46.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.148+0000 7f7417359700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741012b640 con 0x7f7410142500 2020-04-22T14:05:46.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.148+0000 7f7415b56700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7410141c10 0x7f741012c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:46.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.148+0000 7f7416b58700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7410142500 0x7f741012ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:46.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.148+0000 7f7415b56700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7410141c10 0x7f741012c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:46666/0 (socket says 172.21.15.103:46666) 2020-04-22T14:05:46.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.148+0000 7f7415b56700 1 -- 172.21.15.103:0/4204780378 learned_addr learned my addr 172.21.15.103:0/4204780378 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:05:46.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.149+0000 7f7415b56700 1 -- 172.21.15.103:0/4204780378 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7410142500 msgr2=0x7f741012ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:46.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.149+0000 7f7415b56700 1 --2- 172.21.15.103:0/4204780378 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7410142500 0x7f741012ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:46.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.149+0000 7f7415b56700 1 -- 172.21.15.103:0/4204780378 >> v1:172.21.15.86:6789/0 conn(0x7f74100ad150 legacy=0x7f741012dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:46.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.149+0000 7f73ff7fe700 1 -- 172.21.15.103:0/4204780378 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3611739305 0 0) 0x7f7410129240 con 0x7f74100ad150 2020-04-22T14:05:46.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.149+0000 7f7415b56700 1 -- 172.21.15.103:0/4204780378 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f741012f550 con 0x7f7410141c10 2020-04-22T14:05:46.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.149+0000 7f7416b58700 1 --2- 172.21.15.103:0/4204780378 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7410142500 0x7f741012ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:05:46.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.149+0000 7f7415b56700 1 --2- 172.21.15.103:0/4204780378 >> v2:172.21.15.86:3300/0 conn(0x7f7410141c10 0x7f741012c4b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f740c002f30 tx=0x7f740c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.149+0000 7f7415b56700 1 --2- 172.21.15.103:0/4204780378 >> v2:172.21.15.86:3300/0 conn(0x7f7410141c10 0x7f741012c4b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f740c002f30 tx=0x7f740c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.149+0000 7f7415b56700 1 --2- 172.21.15.103:0/4204780378 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7410141c10 0x7f741012c4b0 secure :-1 s=READY pgs=301 cs=0 l=1 rx=0x7f740c002f30 tx=0x7f740c010ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:46.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.149+0000 7f7415b56700 1 --2- 172.21.15.103:0/4204780378 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7410141c10 0x7f741012c4b0 secure :-1 s=THROTTLE_DONE pgs=301 cs=0 l=1 rx=0x7f740c002f30 tx=0x7f740c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.149+0000 7f73ff7fe700 1 -- 172.21.15.103:0/4204780378 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f740c007180 con 0x7f7410141c10 2020-04-22T14:05:46.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.149+0000 7f7415b56700 1 --2- 172.21.15.103:0/4204780378 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7410141c10 0x7f741012c4b0 secure :-1 s=THROTTLE_DONE pgs=301 cs=0 l=1 rx=0x7f740c002f30 tx=0x7f740c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.149+0000 7f73ff7fe700 1 -- 172.21.15.103:0/4204780378 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740c0072e0 con 0x7f7410141c10 2020-04-22T14:05:46.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.149+0000 7f7415b56700 1 --2- 172.21.15.103:0/4204780378 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7410141c10 0x7f741012c4b0 secure :-1 s=THROTTLE_DONE pgs=301 cs=0 l=1 rx=0x7f740c002f30 tx=0x7f740c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.149+0000 7f7417359700 1 -- 172.21.15.103:0/4204780378 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f741012f980 con 0x7f7410141c10 2020-04-22T14:05:46.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.149+0000 7f73ff7fe700 1 -- 172.21.15.103:0/4204780378 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f740c0059c0 con 0x7f7410141c10 2020-04-22T14:05:46.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.149+0000 7f7417359700 1 -- 172.21.15.103:0/4204780378 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74101299c0 con 0x7f7410141c10 2020-04-22T14:05:46.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.150+0000 7f7415b56700 1 --2- 172.21.15.103:0/4204780378 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7410141c10 0x7f741012c4b0 secure :-1 s=THROTTLE_DONE pgs=301 cs=0 l=1 rx=0x7f740c002f30 tx=0x7f740c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.150+0000 7f7417359700 1 -- 172.21.15.103:0/4204780378 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7410056c90 con 0x7f7410141c10 2020-04-22T14:05:46.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.150+0000 7f73ff7fe700 1 -- 172.21.15.103:0/4204780378 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f740c005c00 con 0x7f7410141c10 2020-04-22T14:05:46.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.150+0000 7f7415b56700 1 --2- 172.21.15.103:0/4204780378 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7410141c10 0x7f741012c4b0 secure :-1 s=THROTTLE_DONE pgs=301 cs=0 l=1 rx=0x7f740c002f30 tx=0x7f740c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.151+0000 7f73ff7fe700 1 --2- 172.21.15.103:0/4204780378 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f73f004d790 0x7f73f004fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:46.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.151+0000 7f73ff7fe700 1 -- 172.21.15.103:0/4204780378 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f740c061240 con 0x7f7410141c10 2020-04-22T14:05:46.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.151+0000 7f7416357700 1 --2- 172.21.15.103:0/4204780378 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f73f004d790 0x7f73f004fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:46.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.151+0000 7f7416357700 1 --2- 172.21.15.103:0/4204780378 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f73f004d790 0x7f73f004fc50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7400002f30 tx=0x7f7400007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.151+0000 7f7416357700 1 --2- 172.21.15.103:0/4204780378 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f73f004d790 0x7f73f004fc50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7400002f30 tx=0x7f7400007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.151+0000 7f7416357700 1 --2- 172.21.15.103:0/4204780378 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f73f004d790 0x7f73f004fc50 secure :-1 s=READY pgs=207 cs=0 l=1 rx=0x7f7400002f30 tx=0x7f7400007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:46.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.154+0000 7f7415b56700 1 --2- 172.21.15.103:0/4204780378 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7410141c10 0x7f741012c4b0 secure :-1 s=THROTTLE_DONE pgs=301 cs=0 l=1 rx=0x7f740c002f30 tx=0x7f740c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.154+0000 7f73ff7fe700 1 -- 172.21.15.103:0/4204780378 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f740c03c620 con 0x7f7410141c10 2020-04-22T14:05:46.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.299+0000 7f7417359700 1 -- 172.21.15.103:0/4204780378 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f741012b780 con 0x7f7410141c10 2020-04-22T14:05:46.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.300+0000 7f7415b56700 1 --2- 172.21.15.103:0/4204780378 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7410141c10 0x7f741012c4b0 secure :-1 s=THROTTLE_DONE pgs=301 cs=0 l=1 rx=0x7f740c002f30 tx=0x7f740c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.300+0000 7f73ff7fe700 1 -- 172.21.15.103:0/4204780378 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+16102 (secure 0 0 0) 0x7f740c03fc40 con 0x7f7410141c10 2020-04-22T14:05:46.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.301+0000 7f7417359700 1 -- 172.21.15.103:0/4204780378 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f73f004d790 msgr2=0x7f73f004fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:46.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.301+0000 7f7417359700 1 --2- 172.21.15.103:0/4204780378 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f73f004d790 0x7f73f004fc50 secure :-1 s=READY pgs=207 cs=0 l=1 rx=0x7f7400002f30 tx=0x7f7400007a40).stop 2020-04-22T14:05:46.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.301+0000 7f7417359700 1 -- 172.21.15.103:0/4204780378 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7410141c10 msgr2=0x7f741012c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:46.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.301+0000 7f7417359700 1 --2- 172.21.15.103:0/4204780378 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7410141c10 0x7f741012c4b0 secure :-1 s=READY pgs=301 cs=0 l=1 rx=0x7f740c002f30 tx=0x7f740c010ac0).stop 2020-04-22T14:05:46.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.301+0000 7f7417359700 1 -- 172.21.15.103:0/4204780378 shutdown_connections 2020-04-22T14:05:46.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.301+0000 7f7417359700 1 --2- 172.21.15.103:0/4204780378 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7410142500 0x7f741012ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:46.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.301+0000 7f7417359700 1 --2- 172.21.15.103:0/4204780378 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f73f004d790 0x7f73f004fc50 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:46.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.301+0000 7f7417359700 1 --2- 172.21.15.103:0/4204780378 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7410141c10 0x7f741012c4b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:46.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.301+0000 7f7417359700 1 -- 172.21.15.103:0/4204780378 >> 172.21.15.103:0/4204780378 conn(0x7f741005b7c0 msgr2=0x7f7410136d90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:46.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.301+0000 7f7417359700 1 -- 172.21.15.103:0/4204780378 shutdown_connections 2020-04-22T14:05:46.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.301+0000 7f7417359700 1 -- 172.21.15.103:0/4204780378 wait complete. 2020-04-22T14:05:46.306 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:05:46.306 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":44,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:05:45.958274+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:05:43.875682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2020-04-22T14:05:44.910499+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:05:46.314 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:46.327 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:05:46.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.475+0000 7f9c921b0700 1 Processor -- start 2020-04-22T14:05:46.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.475+0000 7f9c921b0700 1 -- start start 2020-04-22T14:05:46.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.476+0000 7f9c921b0700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9c8c12c0d0 0x7f9c8c1464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:46.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.476+0000 7f9c921b0700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9c8c063e30 0x7f9c8c0642a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:46.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.476+0000 7f9c921b0700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c8c143300 con 0x7f9c8c065fe0 2020-04-22T14:05:46.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.476+0000 7f9c921b0700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c8c1435a0 con 0x7f9c8c063e30 2020-04-22T14:05:46.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.476+0000 7f9c921b0700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c143840 con 0x7f9c8c12c0d0 2020-04-22T14:05:46.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.476+0000 7f9c8affd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f9c8c065fe0 0x7f9c8c05b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41630/0 (socket says 172.21.15.103:41630) 2020-04-22T14:05:46.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.476+0000 7f9c8affd700 1 -- 172.21.15.103:0/2693366931 learned_addr learned my addr 172.21.15.103:0/2693366931 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:46.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.476+0000 7f9c8a7fc700 1 -- 172.21.15.103:0/2693366931 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2010622517 0 0) 0x7f9c8c143300 con 0x7f9c8c065fe0 2020-04-22T14:05:46.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.476+0000 7f9c8a7fc700 1 -- 172.21.15.103:0/2693366931 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c78003230 con 0x7f9c8c065fe0 2020-04-22T14:05:46.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.476+0000 7f9c8bfff700 1 --2- 172.21.15.103:0/2693366931 >> v2:172.21.15.86:3300/0 conn(0x7f9c8c063e30 0x7f9c8c0642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:46.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.476+0000 7f9c8b7fe700 1 --2- 172.21.15.103:0/2693366931 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9c8c12c0d0 0x7f9c8c1464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:46.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.476+0000 7f9c8a7fc700 1 -- 172.21.15.103:0/2693366931 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1414677569 0 0) 0x7f9c78003230 con 0x7f9c8c065fe0 2020-04-22T14:05:46.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.476+0000 7f9c8a7fc700 1 -- 172.21.15.103:0/2693366931 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9c8c12c0d0 msgr2=0x7f9c8c1464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:46.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.476+0000 7f9c8a7fc700 1 --2- 172.21.15.103:0/2693366931 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9c8c12c0d0 0x7f9c8c1464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:46.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.476+0000 7f9c8a7fc700 1 -- 172.21.15.103:0/2693366931 >> v2:172.21.15.86:3300/0 conn(0x7f9c8c063e30 msgr2=0x7f9c8c0642a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:46.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.476+0000 7f9c8a7fc700 1 --2- 172.21.15.103:0/2693366931 >> v2:172.21.15.86:3300/0 conn(0x7f9c8c063e30 0x7f9c8c0642a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:46.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.476+0000 7f9c8a7fc700 1 -- 172.21.15.103:0/2693366931 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c8c05bb50 con 0x7f9c8c065fe0 2020-04-22T14:05:46.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.476+0000 7f9c8a7fc700 1 -- 172.21.15.103:0/2693366931 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f9c800016d0 con 0x7f9c8c065fe0 2020-04-22T14:05:46.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.477+0000 7f9c8a7fc700 1 -- 172.21.15.103:0/2693366931 >> v1:172.21.15.103:6789/0 conn(0x7f9c8c065fe0 legacy=0x7f9c8c05b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:46.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.477+0000 7f9c8a7fc700 1 --2- 172.21.15.103:0/2693366931 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9c8c12c0d0 0x7f9c78003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:46.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.477+0000 7f9c8a7fc700 1 --2- 172.21.15.103:0/2693366931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c78003b80 0x7f9c78003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:46.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.477+0000 7f9c8a7fc700 1 --2- 172.21.15.103:0/2693366931 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c780045c0 0x7f9c78004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:46.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.477+0000 7f9c8a7fc700 1 -- 172.21.15.103:0/2693366931 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c1435a0 con 0x7f9c78003b80 2020-04-22T14:05:46.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.477+0000 7f9c8a7fc700 1 -- 172.21.15.103:0/2693366931 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c143840 con 0x7f9c780045c0 2020-04-22T14:05:46.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.477+0000 7f9c8a7fc700 1 -- 172.21.15.103:0/2693366931 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c78005050 con 0x7f9c8c12c0d0 2020-04-22T14:05:46.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.477+0000 7f9c8bfff700 1 --2- 172.21.15.103:0/2693366931 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c780045c0 0x7f9c78004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:46.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.477+0000 7f9c8b7fe700 1 --2- 172.21.15.103:0/2693366931 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9c8c12c0d0 0x7f9c78003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:46.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.477+0000 7f9c8affd700 1 --2- 172.21.15.103:0/2693366931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c78003b80 0x7f9c78003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:46.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.477+0000 7f9c8bfff700 1 -- 172.21.15.103:0/2693366931 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9c8c12c0d0 msgr2=0x7f9c78003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:46.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.477+0000 7f9c8bfff700 1 --2- 172.21.15.103:0/2693366931 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9c8c12c0d0 0x7f9c78003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:46.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.477+0000 7f9c8bfff700 1 -- 172.21.15.103:0/2693366931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c78003b80 msgr2=0x7f9c78003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:46.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.477+0000 7f9c8bfff700 1 --2- 172.21.15.103:0/2693366931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c78003b80 0x7f9c78003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:46.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.477+0000 7f9c8bfff700 1 -- 172.21.15.103:0/2693366931 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c78003230 con 0x7f9c780045c0 2020-04-22T14:05:46.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.477+0000 7f9c8bfff700 1 --2- 172.21.15.103:0/2693366931 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c780045c0 0x7f9c78004a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9c84002f30 tx=0x7f9c84010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.477+0000 7f9c8bfff700 1 --2- 172.21.15.103:0/2693366931 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c780045c0 0x7f9c78004a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9c84002f30 tx=0x7f9c84010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.477+0000 7f9c8bfff700 1 --2- 172.21.15.103:0/2693366931 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c780045c0 0x7f9c78004a20 secure :-1 s=READY pgs=520 cs=0 l=1 rx=0x7f9c84002f30 tx=0x7f9c84010020).ready entity=mon.1 client_cookie=9e0b0d08d6dfcd42 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:46.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.477+0000 7f9c8bfff700 1 --2- 172.21.15.103:0/2693366931 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c780045c0 0x7f9c78004a20 secure :-1 s=THROTTLE_DONE pgs=520 cs=0 l=1 rx=0x7f9c84002f30 tx=0x7f9c84010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.477+0000 7f9c8bfff700 1 --2- 172.21.15.103:0/2693366931 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c780045c0 0x7f9c78004a20 secure :-1 s=THROTTLE_DONE pgs=520 cs=0 l=1 rx=0x7f9c84002f30 tx=0x7f9c84010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.477+0000 7f9c8a7fc700 1 -- 172.21.15.103:0/2693366931 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c84008df0 con 0x7f9c780045c0 2020-04-22T14:05:46.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.477+0000 7f9c8bfff700 1 --2- 172.21.15.103:0/2693366931 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c780045c0 0x7f9c78004a20 secure :-1 s=THROTTLE_DONE pgs=520 cs=0 l=1 rx=0x7f9c84002f30 tx=0x7f9c84010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.477+0000 7f9c8a7fc700 1 -- 172.21.15.103:0/2693366931 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c84010950 con 0x7f9c780045c0 2020-04-22T14:05:46.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.477+0000 7f9c8a7fc700 1 -- 172.21.15.103:0/2693366931 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c84010cf0 con 0x7f9c780045c0 2020-04-22T14:05:46.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.477+0000 7f9c921b0700 1 -- 172.21.15.103:0/2693366931 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c780045c0 msgr2=0x7f9c78004a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:46.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.477+0000 7f9c921b0700 1 --2- 172.21.15.103:0/2693366931 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c780045c0 0x7f9c78004a20 secure :-1 s=READY pgs=520 cs=0 l=1 rx=0x7f9c84002f30 tx=0x7f9c84010020).stop 2020-04-22T14:05:46.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.477+0000 7f9c8bfff700 1 -- 172.21.15.103:0/2693366931 reap_dead start 2020-04-22T14:05:46.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.478+0000 7f9c921b0700 1 -- 172.21.15.103:0/2693366931 shutdown_connections 2020-04-22T14:05:46.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.478+0000 7f9c921b0700 1 -- 172.21.15.103:0/2693366931 >> 172.21.15.103:0/2693366931 conn(0x7f9c8c0b9160 msgr2=0x7f9c8c05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:46.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.478+0000 7f9c921b0700 1 -- 172.21.15.103:0/2693366931 shutdown_connections 2020-04-22T14:05:46.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.478+0000 7f9c921b0700 1 -- 172.21.15.103:0/2693366931 wait complete. 2020-04-22T14:05:46.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.479+0000 7f9c921b0700 1 Processor -- start 2020-04-22T14:05:46.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.479+0000 7f9c921b0700 1 -- start start 2020-04-22T14:05:46.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.479+0000 7f9c921b0700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9c8c0b0b50 0x7f9c8c0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:46.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.479+0000 7f9c921b0700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9c8c129d80 0x7f9c8c12a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:46.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.479+0000 7f9c921b0700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c8c0b14d0 con 0x7f9c8c145100 2020-04-22T14:05:46.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.479+0000 7f9c921b0700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c8c158090 con 0x7f9c8c129d80 2020-04-22T14:05:46.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.479+0000 7f9c921b0700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c157240 con 0x7f9c8c0b0b50 2020-04-22T14:05:46.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.480+0000 7f9c8b7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f9c8c145100 0x7f9c8c157980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41642/0 (socket says 172.21.15.103:41642) 2020-04-22T14:05:46.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.480+0000 7f9c8b7fe700 1 -- 172.21.15.103:0/1284233176 learned_addr learned my addr 172.21.15.103:0/1284233176 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:46.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.480+0000 7f9c8bfff700 1 --2- 172.21.15.103:0/1284233176 >> v2:172.21.15.103:3300/0 conn(0x7f9c8c129d80 0x7f9c8c12a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:46.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.480+0000 7f9c8affd700 1 --2- 172.21.15.103:0/1284233176 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9c8c0b0b50 0x7f9c8c0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:46.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.480+0000 7f9c8bfff700 1 -- 172.21.15.103:0/1284233176 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9c8c0b0b50 msgr2=0x7f9c8c0b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:46.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.480+0000 7f9c8bfff700 1 --2- 172.21.15.103:0/1284233176 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9c8c0b0b50 0x7f9c8c0b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:46.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.480+0000 7f9c8bfff700 1 -- 172.21.15.103:0/1284233176 >> v1:172.21.15.103:6789/0 conn(0x7f9c8c145100 legacy=0x7f9c8c157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:46.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.480+0000 7f9c88ff9700 1 -- 172.21.15.103:0/1284233176 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2943702606 0 0) 0x7f9c8c0b14d0 con 0x7f9c8c145100 2020-04-22T14:05:46.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.480+0000 7f9c8bfff700 1 -- 172.21.15.103:0/1284233176 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c8c12a670 con 0x7f9c8c129d80 2020-04-22T14:05:46.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.480+0000 7f9c8bfff700 1 --2- 172.21.15.103:0/1284233176 >> v2:172.21.15.103:3300/0 conn(0x7f9c8c129d80 0x7f9c8c12a210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9c8c067540 tx=0x7f9c84010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.480+0000 7f9c8bfff700 1 --2- 172.21.15.103:0/1284233176 >> v2:172.21.15.103:3300/0 conn(0x7f9c8c129d80 0x7f9c8c12a210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9c8c067540 tx=0x7f9c84010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.480+0000 7f9c8bfff700 1 --2- 172.21.15.103:0/1284233176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c8c129d80 0x7f9c8c12a210 secure :-1 s=READY pgs=522 cs=0 l=1 rx=0x7f9c8c067540 tx=0x7f9c84010020).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:46.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.480+0000 7f9c8bfff700 1 --2- 172.21.15.103:0/1284233176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c8c129d80 0x7f9c8c12a210 secure :-1 s=THROTTLE_DONE pgs=522 cs=0 l=1 rx=0x7f9c8c067540 tx=0x7f9c84010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.480+0000 7f9c88ff9700 1 -- 172.21.15.103:0/1284233176 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c84009e40 con 0x7f9c8c129d80 2020-04-22T14:05:46.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.480+0000 7f9c8bfff700 1 --2- 172.21.15.103:0/1284233176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c8c129d80 0x7f9c8c12a210 secure :-1 s=THROTTLE_DONE pgs=522 cs=0 l=1 rx=0x7f9c8c067540 tx=0x7f9c84010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.480+0000 7f9c8bfff700 1 --2- 172.21.15.103:0/1284233176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c8c129d80 0x7f9c8c12a210 secure :-1 s=THROTTLE_DONE pgs=522 cs=0 l=1 rx=0x7f9c8c067540 tx=0x7f9c84010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.480+0000 7f9c88ff9700 1 -- 172.21.15.103:0/1284233176 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c84007360 con 0x7f9c8c129d80 2020-04-22T14:05:46.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.480+0000 7f9c921b0700 1 -- 172.21.15.103:0/1284233176 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c8c1574e0 con 0x7f9c8c129d80 2020-04-22T14:05:46.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.480+0000 7f9c88ff9700 1 -- 172.21.15.103:0/1284233176 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c840056c0 con 0x7f9c8c129d80 2020-04-22T14:05:46.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.480+0000 7f9c921b0700 1 -- 172.21.15.103:0/1284233176 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c8c0b28a0 con 0x7f9c8c129d80 2020-04-22T14:05:46.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.481+0000 7f9c8bfff700 1 --2- 172.21.15.103:0/1284233176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c8c129d80 0x7f9c8c12a210 secure :-1 s=THROTTLE_DONE pgs=522 cs=0 l=1 rx=0x7f9c8c067540 tx=0x7f9c84010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.481+0000 7f9c921b0700 1 -- 172.21.15.103:0/1284233176 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c8c056c90 con 0x7f9c8c129d80 2020-04-22T14:05:46.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.481+0000 7f9c88ff9700 1 -- 172.21.15.103:0/1284233176 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f9c84005820 con 0x7f9c8c129d80 2020-04-22T14:05:46.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.481+0000 7f9c8bfff700 1 --2- 172.21.15.103:0/1284233176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c8c129d80 0x7f9c8c12a210 secure :-1 s=THROTTLE_DONE pgs=522 cs=0 l=1 rx=0x7f9c8c067540 tx=0x7f9c84010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.482+0000 7f9c88ff9700 1 --2- 172.21.15.103:0/1284233176 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9c6c04d770 0x7f9c6c04fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:46.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.482+0000 7f9c88ff9700 1 -- 172.21.15.103:0/1284233176 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9c84060dc0 con 0x7f9c8c129d80 2020-04-22T14:05:46.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.482+0000 7f9c8b7fe700 1 --2- 172.21.15.103:0/1284233176 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9c6c04d770 0x7f9c6c04fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:46.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.482+0000 7f9c8b7fe700 1 --2- 172.21.15.103:0/1284233176 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9c6c04d770 0x7f9c6c04fc30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9c7c0083a0 tx=0x7f9c7c00cd80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.482+0000 7f9c8b7fe700 1 --2- 172.21.15.103:0/1284233176 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9c6c04d770 0x7f9c6c04fc30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9c7c0083a0 tx=0x7f9c7c00cd80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.482+0000 7f9c8b7fe700 1 --2- 172.21.15.103:0/1284233176 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9c6c04d770 0x7f9c6c04fc30 secure :-1 s=READY pgs=208 cs=0 l=1 rx=0x7f9c7c0083a0 tx=0x7f9c7c00cd80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:46.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.486+0000 7f9c8bfff700 1 --2- 172.21.15.103:0/1284233176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c8c129d80 0x7f9c8c12a210 secure :-1 s=THROTTLE_DONE pgs=522 cs=0 l=1 rx=0x7f9c8c067540 tx=0x7f9c84010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.486+0000 7f9c88ff9700 1 -- 172.21.15.103:0/1284233176 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f9c8403c260 con 0x7f9c8c129d80 2020-04-22T14:05:46.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.629+0000 7f9c921b0700 1 -- 172.21.15.103:0/1284233176 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c8c065cf0 con 0x7f9c8c129d80 2020-04-22T14:05:46.633 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.630+0000 7f9c8bfff700 1 --2- 172.21.15.103:0/1284233176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c8c129d80 0x7f9c8c12a210 secure :-1 s=THROTTLE_DONE pgs=522 cs=0 l=1 rx=0x7f9c8c067540 tx=0x7f9c84010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.633 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.630+0000 7f9c88ff9700 1 -- 172.21.15.103:0/1284233176 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+16102 (secure 0 0 0) 0x7f9c8403f880 con 0x7f9c8c129d80 2020-04-22T14:05:46.633 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:05:46.633 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":44,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:05:45.958274+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:05:43.875682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2020-04-22T14:05:44.910499+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:05:46.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.632+0000 7f9c921b0700 1 -- 172.21.15.103:0/1284233176 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9c6c04d770 msgr2=0x7f9c6c04fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:46.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.632+0000 7f9c921b0700 1 --2- 172.21.15.103:0/1284233176 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9c6c04d770 0x7f9c6c04fc30 secure :-1 s=READY pgs=208 cs=0 l=1 rx=0x7f9c7c0083a0 tx=0x7f9c7c00cd80).stop 2020-04-22T14:05:46.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.632+0000 7f9c921b0700 1 -- 172.21.15.103:0/1284233176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c8c129d80 msgr2=0x7f9c8c12a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:46.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.632+0000 7f9c921b0700 1 --2- 172.21.15.103:0/1284233176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c8c129d80 0x7f9c8c12a210 secure :-1 s=READY pgs=522 cs=0 l=1 rx=0x7f9c8c067540 tx=0x7f9c84010020).stop 2020-04-22T14:05:46.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.632+0000 7f9c921b0700 1 -- 172.21.15.103:0/1284233176 shutdown_connections 2020-04-22T14:05:46.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.632+0000 7f9c921b0700 1 --2- 172.21.15.103:0/1284233176 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9c6c04d770 0x7f9c6c04fc30 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:46.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.632+0000 7f9c921b0700 1 --2- 172.21.15.103:0/1284233176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c8c129d80 0x7f9c8c12a210 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:46.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.632+0000 7f9c921b0700 1 --2- 172.21.15.103:0/1284233176 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9c8c0b0b50 0x7f9c8c0b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:46.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.632+0000 7f9c921b0700 1 -- 172.21.15.103:0/1284233176 >> 172.21.15.103:0/1284233176 conn(0x7f9c8c0b9160 msgr2=0x7f9c8c12aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:46.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.632+0000 7f9c921b0700 1 -- 172.21.15.103:0/1284233176 shutdown_connections 2020-04-22T14:05:46.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.632+0000 7f9c921b0700 1 -- 172.21.15.103:0/1284233176 wait complete. 2020-04-22T14:05:46.646 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:46.670 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-04-22T14:05:46.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.842+0000 7fb135028700 1 Processor -- start 2020-04-22T14:05:46.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.842+0000 7fb135028700 1 -- start start 2020-04-22T14:05:46.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.843+0000 7fb135028700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb1300b4820 0x7fb1300acb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:46.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.843+0000 7fb135028700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1300af030 con 0x7fb130141f20 2020-04-22T14:05:46.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.843+0000 7fb135028700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb130060250 con 0x7fb130061a30 2020-04-22T14:05:46.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.843+0000 7fb135028700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1300623c0 con 0x7fb1300b4820 2020-04-22T14:05:46.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.843+0000 7fb12e59c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb1300b4820 0x7fb1300acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:46.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.843+0000 7fb12ed9d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb130061a30 0x7fb1300ae920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41650/0 (socket says 172.21.15.103:41650) 2020-04-22T14:05:46.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.844+0000 7fb12ed9d700 1 -- 172.21.15.103:0/4121708694 learned_addr learned my addr 172.21.15.103:0/4121708694 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:46.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.844+0000 7fb12e59c700 1 -- 172.21.15.103:0/4121708694 >> v1:172.21.15.103:6789/0 conn(0x7fb130061a30 legacy=0x7fb1300ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:46.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.844+0000 7fb12dd9b700 1 -- 172.21.15.103:0/4121708694 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2179513221 0 0) 0x7fb130060250 con 0x7fb130061a30 2020-04-22T14:05:46.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.844+0000 7fb12e59c700 1 -- 172.21.15.103:0/4121708694 >> v1:172.21.15.86:6789/0 conn(0x7fb130141f20 legacy=0x7fb130142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:46.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.844+0000 7fb12e59c700 1 -- 172.21.15.103:0/4121708694 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb130062660 con 0x7fb1300b4820 2020-04-22T14:05:46.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.844+0000 7fb12e59c700 1 --2- 172.21.15.103:0/4121708694 >> v2:172.21.15.103:3300/0 conn(0x7fb1300b4820 0x7fb1300acb10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb13005bc40 tx=0x7fb118007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.844+0000 7fb12e59c700 1 --2- 172.21.15.103:0/4121708694 >> v2:172.21.15.103:3300/0 conn(0x7fb1300b4820 0x7fb1300acb10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb13005bc40 tx=0x7fb118007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.844+0000 7fb12e59c700 1 --2- 172.21.15.103:0/4121708694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1300b4820 0x7fb1300acb10 secure :-1 s=READY pgs=524 cs=0 l=1 rx=0x7fb13005bc40 tx=0x7fb118007a40).ready entity=mon.1 client_cookie=d96485c34785247e server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:46.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.844+0000 7fb12e59c700 1 --2- 172.21.15.103:0/4121708694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1300b4820 0x7fb1300acb10 secure :-1 s=THROTTLE_DONE pgs=524 cs=0 l=1 rx=0x7fb13005bc40 tx=0x7fb118007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.844+0000 7fb12dd9b700 1 -- 172.21.15.103:0/4121708694 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb118011430 con 0x7fb1300b4820 2020-04-22T14:05:46.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.844+0000 7fb12e59c700 1 --2- 172.21.15.103:0/4121708694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1300b4820 0x7fb1300acb10 secure :-1 s=THROTTLE_DONE pgs=524 cs=0 l=1 rx=0x7fb13005bc40 tx=0x7fb118007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.844+0000 7fb12dd9b700 1 -- 172.21.15.103:0/4121708694 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb118011590 con 0x7fb1300b4820 2020-04-22T14:05:46.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.844+0000 7fb12e59c700 1 --2- 172.21.15.103:0/4121708694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1300b4820 0x7fb1300acb10 secure :-1 s=THROTTLE_DONE pgs=524 cs=0 l=1 rx=0x7fb13005bc40 tx=0x7fb118007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.844+0000 7fb12dd9b700 1 -- 172.21.15.103:0/4121708694 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb118011970 con 0x7fb1300b4820 2020-04-22T14:05:46.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.844+0000 7fb135028700 1 -- 172.21.15.103:0/4121708694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1300b4820 msgr2=0x7fb1300acb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:46.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.844+0000 7fb135028700 1 --2- 172.21.15.103:0/4121708694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1300b4820 0x7fb1300acb10 secure :-1 s=READY pgs=524 cs=0 l=1 rx=0x7fb13005bc40 tx=0x7fb118007a40).stop 2020-04-22T14:05:46.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.845+0000 7fb135028700 1 -- 172.21.15.103:0/4121708694 shutdown_connections 2020-04-22T14:05:46.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.845+0000 7fb135028700 1 --2- 172.21.15.103:0/4121708694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1300b4820 0x7fb1300acb10 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:46.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.845+0000 7fb135028700 1 -- 172.21.15.103:0/4121708694 >> 172.21.15.103:0/4121708694 conn(0x7fb13005b7b0 msgr2=0x7fb1300b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:46.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.845+0000 7fb135028700 1 -- 172.21.15.103:0/4121708694 shutdown_connections 2020-04-22T14:05:46.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.845+0000 7fb135028700 1 -- 172.21.15.103:0/4121708694 wait complete. 2020-04-22T14:05:46.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.846+0000 7fb135028700 1 Processor -- start 2020-04-22T14:05:46.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.846+0000 7fb135028700 1 -- start start 2020-04-22T14:05:46.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.846+0000 7fb135028700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb130061a30 0x7fb1300662d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:46.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.846+0000 7fb135028700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb1300b4820 0x7fb1301373a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:46.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.846+0000 7fb135028700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb130141f20 0x7fb130136630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:46.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.846+0000 7fb135028700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb130137800 con 0x7fb1300b4820 2020-04-22T14:05:46.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.846+0000 7fb135028700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb130112340 con 0x7fb130141f20 2020-04-22T14:05:46.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.846+0000 7fb135028700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1301125e0 con 0x7fb130061a30 2020-04-22T14:05:46.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.846+0000 7fb12f59e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb130141f20 0x7fb130136630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:46.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.846+0000 7fb12f59e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb130141f20 0x7fb130136630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49470/0 (socket says 172.21.15.103:49470) 2020-04-22T14:05:46.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.846+0000 7fb12f59e700 1 -- 172.21.15.103:0/3653982794 learned_addr learned my addr 172.21.15.103:0/3653982794 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:05:46.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.846+0000 7fb12ed9d700 1 --2- 172.21.15.103:0/3653982794 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb130061a30 0x7fb1300662d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:46.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.846+0000 7fb12e59c700 1 --2- 172.21.15.103:0/3653982794 >> v2:172.21.15.86:3300/0 conn(0x7fb1300b4820 0x7fb1301373a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:46.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.847+0000 7fb12f59e700 1 -- 172.21.15.103:0/3653982794 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb130061a30 msgr2=0x7fb1300662d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:46.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.847+0000 7fb12f59e700 1 --2- 172.21.15.103:0/3653982794 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb130061a30 0x7fb1300662d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:46.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.847+0000 7fb12f59e700 1 -- 172.21.15.103:0/3653982794 >> v2:172.21.15.86:3300/0 conn(0x7fb1300b4820 msgr2=0x7fb1301373a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:46.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.847+0000 7fb12f59e700 1 --2- 172.21.15.103:0/3653982794 >> v2:172.21.15.86:3300/0 conn(0x7fb1300b4820 0x7fb1301373a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:46.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.847+0000 7fb12f59e700 1 -- 172.21.15.103:0/3653982794 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb130112880 con 0x7fb130141f20 2020-04-22T14:05:46.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.847+0000 7fb12f59e700 1 --2- 172.21.15.103:0/3653982794 >> v2:172.21.15.103:3300/0 conn(0x7fb130141f20 0x7fb130136630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb128002360 tx=0x7fb128002740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.847+0000 7fb12f59e700 1 --2- 172.21.15.103:0/3653982794 >> v2:172.21.15.103:3300/0 conn(0x7fb130141f20 0x7fb130136630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb128002360 tx=0x7fb128002740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.847+0000 7fb12f59e700 1 --2- 172.21.15.103:0/3653982794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb130141f20 0x7fb130136630 secure :-1 s=READY pgs=525 cs=0 l=1 rx=0x7fb128002360 tx=0x7fb128002740).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:46.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.847+0000 7fb12f59e700 1 --2- 172.21.15.103:0/3653982794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb130141f20 0x7fb130136630 secure :-1 s=THROTTLE_DONE pgs=525 cs=0 l=1 rx=0x7fb128002360 tx=0x7fb128002740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.847+0000 7fb127fff700 1 -- 172.21.15.103:0/3653982794 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb12800cea0 con 0x7fb130141f20 2020-04-22T14:05:46.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.847+0000 7fb12f59e700 1 --2- 172.21.15.103:0/3653982794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb130141f20 0x7fb130136630 secure :-1 s=THROTTLE_DONE pgs=525 cs=0 l=1 rx=0x7fb128002360 tx=0x7fb128002740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.847+0000 7fb127fff700 1 -- 172.21.15.103:0/3653982794 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb128012580 con 0x7fb130141f20 2020-04-22T14:05:46.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.847+0000 7fb12f59e700 1 --2- 172.21.15.103:0/3653982794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb130141f20 0x7fb130136630 secure :-1 s=THROTTLE_DONE pgs=525 cs=0 l=1 rx=0x7fb128002360 tx=0x7fb128002740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.847+0000 7fb135028700 1 -- 172.21.15.103:0/3653982794 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb130112070 con 0x7fb130141f20 2020-04-22T14:05:46.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.847+0000 7fb127fff700 1 -- 172.21.15.103:0/3653982794 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb128012960 con 0x7fb130141f20 2020-04-22T14:05:46.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.847+0000 7fb135028700 1 -- 172.21.15.103:0/3653982794 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1301131b0 con 0x7fb130141f20 2020-04-22T14:05:46.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.847+0000 7fb12f59e700 1 --2- 172.21.15.103:0/3653982794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb130141f20 0x7fb130136630 secure :-1 s=THROTTLE_DONE pgs=525 cs=0 l=1 rx=0x7fb128002360 tx=0x7fb128002740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.848+0000 7fb135028700 1 -- 172.21.15.103:0/3653982794 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb130136e40 con 0x7fb130141f20 2020-04-22T14:05:46.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.848+0000 7fb127fff700 1 -- 172.21.15.103:0/3653982794 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fb128012b90 con 0x7fb130141f20 2020-04-22T14:05:46.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.848+0000 7fb12f59e700 1 --2- 172.21.15.103:0/3653982794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb130141f20 0x7fb130136630 secure :-1 s=THROTTLE_DONE pgs=525 cs=0 l=1 rx=0x7fb128002360 tx=0x7fb128002740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.848+0000 7fb127fff700 1 --2- 172.21.15.103:0/3653982794 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb11404d960 0x7fb11404fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:46.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.848+0000 7fb127fff700 1 -- 172.21.15.103:0/3653982794 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb128061890 con 0x7fb130141f20 2020-04-22T14:05:46.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.848+0000 7fb12ed9d700 1 --2- 172.21.15.103:0/3653982794 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb11404d960 0x7fb11404fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:46.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.849+0000 7fb12ed9d700 1 --2- 172.21.15.103:0/3653982794 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb11404d960 0x7fb11404fe20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb120000b80 tx=0x7fb120001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.849+0000 7fb12ed9d700 1 --2- 172.21.15.103:0/3653982794 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb11404d960 0x7fb11404fe20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb120000b80 tx=0x7fb120001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.849+0000 7fb12ed9d700 1 --2- 172.21.15.103:0/3653982794 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb11404d960 0x7fb11404fe20 secure :-1 s=READY pgs=209 cs=0 l=1 rx=0x7fb120000b80 tx=0x7fb120001710).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:46.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.852+0000 7fb12f59e700 1 --2- 172.21.15.103:0/3653982794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb130141f20 0x7fb130136630 secure :-1 s=THROTTLE_DONE pgs=525 cs=0 l=1 rx=0x7fb128002360 tx=0x7fb128002740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:46.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:46.852+0000 7fb127fff700 1 -- 172.21.15.103:0/3653982794 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fb12803cc70 con 0x7fb130141f20 2020-04-22T14:05:47.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:47.044+0000 7fb135028700 1 -- 172.21.15.103:0/3653982794 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb130056c90 con 0x7fb130141f20 2020-04-22T14:05:47.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:47.847+0000 7fb12f59e700 1 --2- 172.21.15.103:0/3653982794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb130141f20 0x7fb130136630 secure :-1 s=READY pgs=525 cs=0 l=1 rx=0x7fb128002360 tx=0x7fb128002740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:47.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:47.968+0000 7fb12f59e700 1 --2- 172.21.15.103:0/3653982794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb130141f20 0x7fb130136630 secure :-1 s=THROTTLE_DONE pgs=525 cs=0 l=1 rx=0x7fb128002360 tx=0x7fb128002740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:47.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:47.968+0000 7fb127fff700 1 -- 172.21.15.103:0/3653982794 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v20) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb128040290 con 0x7fb130141f20 2020-04-22T14:05:47.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:47.970+0000 7fb135028700 1 -- 172.21.15.103:0/3653982794 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb11404d960 msgr2=0x7fb11404fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:47.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:47.970+0000 7fb135028700 1 --2- 172.21.15.103:0/3653982794 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb11404d960 0x7fb11404fe20 secure :-1 s=READY pgs=209 cs=0 l=1 rx=0x7fb120000b80 tx=0x7fb120001710).stop 2020-04-22T14:05:47.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:47.970+0000 7fb135028700 1 -- 172.21.15.103:0/3653982794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb130141f20 msgr2=0x7fb130136630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:47.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:47.970+0000 7fb135028700 1 --2- 172.21.15.103:0/3653982794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb130141f20 0x7fb130136630 secure :-1 s=READY pgs=525 cs=0 l=1 rx=0x7fb128002360 tx=0x7fb128002740).stop 2020-04-22T14:05:47.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:47.970+0000 7fb135028700 1 -- 172.21.15.103:0/3653982794 shutdown_connections 2020-04-22T14:05:47.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:47.970+0000 7fb135028700 1 --2- 172.21.15.103:0/3653982794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb130141f20 0x7fb130136630 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:47.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:47.970+0000 7fb135028700 1 --2- 172.21.15.103:0/3653982794 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb130061a30 0x7fb1300662d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:47.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:47.970+0000 7fb135028700 1 --2- 172.21.15.103:0/3653982794 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb11404d960 0x7fb11404fe20 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:47.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:47.970+0000 7fb135028700 1 --2- 172.21.15.103:0/3653982794 >> v2:172.21.15.86:3300/0 conn(0x7fb1300b4820 0x7fb1301373a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:47.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:47.970+0000 7fb135028700 1 -- 172.21.15.103:0/3653982794 >> 172.21.15.103:0/3653982794 conn(0x7fb13005b7b0 msgr2=0x7fb1300b7de0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:47.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:47.970+0000 7fb135028700 1 -- 172.21.15.103:0/3653982794 shutdown_connections 2020-04-22T14:05:47.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:47.970+0000 7fb135028700 1 -- 172.21.15.103:0/3653982794 wait complete. 2020-04-22T14:05:47.985 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:48.006 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:05:48.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.159+0000 7f8117c51700 1 Processor -- start 2020-04-22T14:05:48.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.159+0000 7f8117c51700 1 -- start start 2020-04-22T14:05:48.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.160+0000 7f8117c51700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8110140320 0x7f81100ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:48.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.160+0000 7f8117c51700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f811014a2b0 0x7f8110146cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:48.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.160+0000 7f8117c51700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81101462f0 con 0x7f81100bd1b0 2020-04-22T14:05:48.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.160+0000 7f8117c51700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8110146590 con 0x7f8110140320 2020-04-22T14:05:48.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.160+0000 7f8117c51700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8110146830 con 0x7f811014a2b0 2020-04-22T14:05:48.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.160+0000 7f81159ed700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8110140320 0x7f81100ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:48.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.160+0000 7f81161ee700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f81100bd1b0 0x7f81100ac740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41664/0 (socket says 172.21.15.103:41664) 2020-04-22T14:05:48.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.160+0000 7f81161ee700 1 -- 172.21.15.103:0/2147197029 learned_addr learned my addr 172.21.15.103:0/2147197029 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:48.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.160+0000 7f81151ec700 1 --2- 172.21.15.103:0/2147197029 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f811014a2b0 0x7f8110146cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:48.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.160+0000 7f81159ed700 1 -- 172.21.15.103:0/2147197029 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f811014a2b0 msgr2=0x7f8110146cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:48.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.160+0000 7f81159ed700 1 --2- 172.21.15.103:0/2147197029 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f811014a2b0 0x7f8110146cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:48.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.160+0000 7f81159ed700 1 -- 172.21.15.103:0/2147197029 >> v1:172.21.15.103:6789/0 conn(0x7f81100bd1b0 legacy=0x7f81100ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:48.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.160+0000 7f81159ed700 1 -- 172.21.15.103:0/2147197029 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8110140700 con 0x7f8110140320 2020-04-22T14:05:48.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.160+0000 7f81149eb700 1 -- 172.21.15.103:0/2147197029 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3370011293 0 0) 0x7f81101462f0 con 0x7f81100bd1b0 2020-04-22T14:05:48.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.161+0000 7f81159ed700 1 --2- 172.21.15.103:0/2147197029 >> v2:172.21.15.103:3300/0 conn(0x7f8110140320 0x7f81100ae1a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8100002f30 tx=0x7f8100007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.161+0000 7f81159ed700 1 --2- 172.21.15.103:0/2147197029 >> v2:172.21.15.103:3300/0 conn(0x7f8110140320 0x7f81100ae1a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8100002f30 tx=0x7f8100007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.161+0000 7f81159ed700 1 --2- 172.21.15.103:0/2147197029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8110140320 0x7f81100ae1a0 secure :-1 s=READY pgs=527 cs=0 l=1 rx=0x7f8100002f30 tx=0x7f8100007a40).ready entity=mon.1 client_cookie=d0fd899326b3645a server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:48.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.161+0000 7f81159ed700 1 --2- 172.21.15.103:0/2147197029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8110140320 0x7f81100ae1a0 secure :-1 s=THROTTLE_DONE pgs=527 cs=0 l=1 rx=0x7f8100002f30 tx=0x7f8100007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.161+0000 7f81149eb700 1 -- 172.21.15.103:0/2147197029 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8100011470 con 0x7f8110140320 2020-04-22T14:05:48.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.161+0000 7f81159ed700 1 --2- 172.21.15.103:0/2147197029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8110140320 0x7f81100ae1a0 secure :-1 s=THROTTLE_DONE pgs=527 cs=0 l=1 rx=0x7f8100002f30 tx=0x7f8100007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.161+0000 7f81159ed700 1 --2- 172.21.15.103:0/2147197029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8110140320 0x7f81100ae1a0 secure :-1 s=THROTTLE_DONE pgs=527 cs=0 l=1 rx=0x7f8100002f30 tx=0x7f8100007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.161+0000 7f81149eb700 1 -- 172.21.15.103:0/2147197029 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8100011610 con 0x7f8110140320 2020-04-22T14:05:48.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.161+0000 7f81149eb700 1 -- 172.21.15.103:0/2147197029 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81000119f0 con 0x7f8110140320 2020-04-22T14:05:48.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.161+0000 7f8117c51700 1 -- 172.21.15.103:0/2147197029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8110140320 msgr2=0x7f81100ae1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:48.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.161+0000 7f8117c51700 1 --2- 172.21.15.103:0/2147197029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8110140320 0x7f81100ae1a0 secure :-1 s=READY pgs=527 cs=0 l=1 rx=0x7f8100002f30 tx=0x7f8100007a40).stop 2020-04-22T14:05:48.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.161+0000 7f8117c51700 1 -- 172.21.15.103:0/2147197029 shutdown_connections 2020-04-22T14:05:48.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.161+0000 7f8117c51700 1 --2- 172.21.15.103:0/2147197029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8110140320 0x7f81100ae1a0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:48.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.161+0000 7f8117c51700 1 --2- 172.21.15.103:0/2147197029 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f811014a2b0 0x7f8110146cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:48.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.161+0000 7f8117c51700 1 -- 172.21.15.103:0/2147197029 >> 172.21.15.103:0/2147197029 conn(0x7f811005f2c0 msgr2=0x7f81100bcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:48.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.161+0000 7f8117c51700 1 -- 172.21.15.103:0/2147197029 shutdown_connections 2020-04-22T14:05:48.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.161+0000 7f8117c51700 1 -- 172.21.15.103:0/2147197029 wait complete. 2020-04-22T14:05:48.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.162+0000 7f8117c51700 1 Processor -- start 2020-04-22T14:05:48.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.162+0000 7f8117c51700 1 -- start start 2020-04-22T14:05:48.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.163+0000 7f8117c51700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f81100bd1b0 0x7f8110143330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:48.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.163+0000 7f8117c51700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8110140320 0x7f81100bbb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:48.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.163+0000 7f8117c51700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81100bbf70 con 0x7f811014a2b0 2020-04-22T14:05:48.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.163+0000 7f8117c51700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81100b23d0 con 0x7f81100bd1b0 2020-04-22T14:05:48.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.163+0000 7f8117c51700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81100af970 con 0x7f8110140320 2020-04-22T14:05:48.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.163+0000 7f81161ee700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f811014a2b0 0x7f8110153aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41672/0 (socket says 172.21.15.103:41672) 2020-04-22T14:05:48.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.163+0000 7f81161ee700 1 -- 172.21.15.103:0/3488642704 learned_addr learned my addr 172.21.15.103:0/3488642704 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:48.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.163+0000 7f81159ed700 1 --2- 172.21.15.103:0/3488642704 >> v2:172.21.15.86:3300/0 conn(0x7f81100bd1b0 0x7f8110143330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:48.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.163+0000 7f81151ec700 1 --2- 172.21.15.103:0/3488642704 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8110140320 0x7f81100bbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:48.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.163+0000 7f80feffd700 1 -- 172.21.15.103:0/3488642704 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3937139723 0 0) 0x7f81080013b0 con 0x7f811014a2b0 2020-04-22T14:05:48.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.163+0000 7f80feffd700 1 -- 172.21.15.103:0/3488642704 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80f0002fe0 con 0x7f811014a2b0 2020-04-22T14:05:48.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.163+0000 7f80feffd700 1 -- 172.21.15.103:0/3488642704 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 897244609 0 0) 0x7f80f0002fe0 con 0x7f811014a2b0 2020-04-22T14:05:48.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.163+0000 7f80feffd700 1 -- 172.21.15.103:0/3488642704 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f80f0003920 con 0x7f811014a2b0 2020-04-22T14:05:48.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.164+0000 7f80feffd700 1 -- 172.21.15.103:0/3488642704 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f8108001ce0 con 0x7f811014a2b0 2020-04-22T14:05:48.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.164+0000 7f80feffd700 1 -- 172.21.15.103:0/3488642704 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8110140320 msgr2=0x7f81100bbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:48.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.164+0000 7f80feffd700 1 --2- 172.21.15.103:0/3488642704 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8110140320 0x7f81100bbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:48.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.164+0000 7f80feffd700 1 -- 172.21.15.103:0/3488642704 >> v2:172.21.15.86:3300/0 conn(0x7f81100bd1b0 msgr2=0x7f8110143330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:48.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.164+0000 7f80feffd700 1 --2- 172.21.15.103:0/3488642704 >> v2:172.21.15.86:3300/0 conn(0x7f81100bd1b0 0x7f8110143330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:48.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.164+0000 7f80feffd700 1 -- 172.21.15.103:0/3488642704 >> v1:172.21.15.103:6789/0 conn(0x7f811014a2b0 legacy=0x7f8110153aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:48.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.164+0000 7f80feffd700 1 --2- 172.21.15.103:0/3488642704 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80f0004b40 0x7f80f0004f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:48.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.164+0000 7f80feffd700 1 --2- 172.21.15.103:0/3488642704 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8110140320 0x7f80f0003ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:48.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.164+0000 7f80feffd700 1 --2- 172.21.15.103:0/3488642704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80f0003f10 0x7f80f0004390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:48.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.164+0000 7f80feffd700 1 -- 172.21.15.103:0/3488642704 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81100af970 con 0x7f80f0004b40 2020-04-22T14:05:48.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.164+0000 7f80feffd700 1 -- 172.21.15.103:0/3488642704 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f00047f0 con 0x7f80f0003f10 2020-04-22T14:05:48.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.164+0000 7f80feffd700 1 -- 172.21.15.103:0/3488642704 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f000b750 con 0x7f8110140320 2020-04-22T14:05:48.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.164+0000 7f81161ee700 1 --2- 172.21.15.103:0/3488642704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80f0003f10 0x7f80f0004390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:48.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.164+0000 7f81151ec700 1 --2- 172.21.15.103:0/3488642704 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8110140320 0x7f80f0003ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:48.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.164+0000 7f81159ed700 1 --2- 172.21.15.103:0/3488642704 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80f0004b40 0x7f80f0004f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:48.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.164+0000 7f81161ee700 1 -- 172.21.15.103:0/3488642704 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8110140320 msgr2=0x7f80f0003ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:48.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.164+0000 7f81161ee700 1 --2- 172.21.15.103:0/3488642704 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8110140320 0x7f80f0003ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:48.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.164+0000 7f81161ee700 1 -- 172.21.15.103:0/3488642704 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80f0004b40 msgr2=0x7f80f0004f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:48.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.164+0000 7f81161ee700 1 --2- 172.21.15.103:0/3488642704 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80f0004b40 0x7f80f0004f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:48.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.164+0000 7f81161ee700 1 -- 172.21.15.103:0/3488642704 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81100b25c0 con 0x7f80f0003f10 2020-04-22T14:05:48.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.164+0000 7f8117c51700 1 -- 172.21.15.103:0/3488642704 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81100b0790 con 0x7f80f0003f10 2020-04-22T14:05:48.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.164+0000 7f81161ee700 1 --2- 172.21.15.103:0/3488642704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80f0003f10 0x7f80f0004390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f81080058c0 tx=0x7f8108011910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.164+0000 7f8117c51700 1 -- 172.21.15.103:0/3488642704 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81101430a0 con 0x7f80f0003f10 2020-04-22T14:05:48.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.164+0000 7f81161ee700 1 --2- 172.21.15.103:0/3488642704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80f0003f10 0x7f80f0004390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f81080058c0 tx=0x7f8108011910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.164+0000 7f81161ee700 1 --2- 172.21.15.103:0/3488642704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80f0003f10 0x7f80f0004390 secure :-1 s=READY pgs=529 cs=0 l=1 rx=0x7f81080058c0 tx=0x7f8108011910).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:48.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.164+0000 7f81161ee700 1 --2- 172.21.15.103:0/3488642704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80f0003f10 0x7f80f0004390 secure :-1 s=THROTTLE_DONE pgs=529 cs=0 l=1 rx=0x7f81080058c0 tx=0x7f8108011910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.164+0000 7f80feffd700 1 -- 172.21.15.103:0/3488642704 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8108012ea0 con 0x7f80f0003f10 2020-04-22T14:05:48.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.164+0000 7f81161ee700 1 --2- 172.21.15.103:0/3488642704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80f0003f10 0x7f80f0004390 secure :-1 s=THROTTLE_DONE pgs=529 cs=0 l=1 rx=0x7f81080058c0 tx=0x7f8108011910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.164+0000 7f81161ee700 1 --2- 172.21.15.103:0/3488642704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80f0003f10 0x7f80f0004390 secure :-1 s=THROTTLE_DONE pgs=529 cs=0 l=1 rx=0x7f81080058c0 tx=0x7f8108011910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.164+0000 7f80feffd700 1 -- 172.21.15.103:0/3488642704 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8108005dc0 con 0x7f80f0003f10 2020-04-22T14:05:48.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.164+0000 7f80feffd700 1 -- 172.21.15.103:0/3488642704 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8108008470 con 0x7f80f0003f10 2020-04-22T14:05:48.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.165+0000 7f81161ee700 1 --2- 172.21.15.103:0/3488642704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80f0003f10 0x7f80f0004390 secure :-1 s=THROTTLE_DONE pgs=529 cs=0 l=1 rx=0x7f81080058c0 tx=0x7f8108011910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.165+0000 7f80feffd700 1 -- 172.21.15.103:0/3488642704 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f81080085d0 con 0x7f80f0003f10 2020-04-22T14:05:48.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.165+0000 7f81161ee700 1 --2- 172.21.15.103:0/3488642704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80f0003f10 0x7f80f0004390 secure :-1 s=THROTTLE_DONE pgs=529 cs=0 l=1 rx=0x7f81080058c0 tx=0x7f8108011910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.165+0000 7f8117c51700 1 -- 172.21.15.103:0/3488642704 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8110056c90 con 0x7f80f0003f10 2020-04-22T14:05:48.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.165+0000 7f80feffd700 1 --2- 172.21.15.103:0/3488642704 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f80f0055bb0 0x7f80f0058070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:48.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.166+0000 7f80feffd700 1 -- 172.21.15.103:0/3488642704 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8108061bf0 con 0x7f80f0003f10 2020-04-22T14:05:48.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.166+0000 7f81159ed700 1 --2- 172.21.15.103:0/3488642704 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f80f0055bb0 0x7f80f0058070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:48.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.166+0000 7f81159ed700 1 --2- 172.21.15.103:0/3488642704 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f80f0055bb0 0x7f80f0058070 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8100002f30 tx=0x7f8100007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.166+0000 7f81159ed700 1 --2- 172.21.15.103:0/3488642704 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f80f0055bb0 0x7f80f0058070 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8100002f30 tx=0x7f8100007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.166+0000 7f81159ed700 1 --2- 172.21.15.103:0/3488642704 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f80f0055bb0 0x7f80f0058070 secure :-1 s=READY pgs=210 cs=0 l=1 rx=0x7f8100002f30 tx=0x7f8100007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:48.188 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.170+0000 7f81161ee700 1 --2- 172.21.15.103:0/3488642704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80f0003f10 0x7f80f0004390 secure :-1 s=THROTTLE_DONE pgs=529 cs=0 l=1 rx=0x7f81080058c0 tx=0x7f8108011910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.188 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.170+0000 7f80feffd700 1 -- 172.21.15.103:0/3488642704 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f810803cfd0 con 0x7f80f0003f10 2020-04-22T14:05:48.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.359+0000 7f8117c51700 1 -- 172.21.15.103:0/3488642704 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f81100bbf50 con 0x7f80f0003f10 2020-04-22T14:05:48.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.359+0000 7f81161ee700 1 --2- 172.21.15.103:0/3488642704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80f0003f10 0x7f80f0004390 secure :-1 s=THROTTLE_DONE pgs=529 cs=0 l=1 rx=0x7f81080058c0 tx=0x7f8108011910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.359+0000 7f80feffd700 1 -- 172.21.15.103:0/3488642704 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+2141 (secure 0 0 0) 0x7f81080405f0 con 0x7f80f0003f10 2020-04-22T14:05:48.362 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:05:48.362 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":20,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4748,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1859944899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1859944899},{"type":"v1","addr":"172.21.15.86:6835","nonce":1859944899}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:05:45.958513+0000","modified":"2020-04-22T14:05:47.963559+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5491},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5491":{"gid":5491,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/2581125360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2581125360},{"type":"v1","addr":"172.21.15.103:6833","nonce":2581125360}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2020-04-22T14:05:48.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.360+0000 7f8117c51700 1 -- 172.21.15.103:0/3488642704 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f80f0055bb0 msgr2=0x7f80f0058070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:48.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.361+0000 7f8117c51700 1 --2- 172.21.15.103:0/3488642704 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f80f0055bb0 0x7f80f0058070 secure :-1 s=READY pgs=210 cs=0 l=1 rx=0x7f8100002f30 tx=0x7f8100007a40).stop 2020-04-22T14:05:48.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.361+0000 7f8117c51700 1 -- 172.21.15.103:0/3488642704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80f0003f10 msgr2=0x7f80f0004390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:48.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.361+0000 7f8117c51700 1 --2- 172.21.15.103:0/3488642704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80f0003f10 0x7f80f0004390 secure :-1 s=READY pgs=529 cs=0 l=1 rx=0x7f81080058c0 tx=0x7f8108011910).stop 2020-04-22T14:05:48.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.361+0000 7f81161ee700 1 -- 172.21.15.103:0/3488642704 reap_dead start 2020-04-22T14:05:48.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.361+0000 7f81161ee700 1 -- 172.21.15.103:0/3488642704 reap_dead start 2020-04-22T14:05:48.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.361+0000 7f8117c51700 1 -- 172.21.15.103:0/3488642704 shutdown_connections 2020-04-22T14:05:48.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.361+0000 7f8117c51700 1 -- 172.21.15.103:0/3488642704 >> 172.21.15.103:0/3488642704 conn(0x7f811005f2c0 msgr2=0x7f81100ac740 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:48.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.361+0000 7f8117c51700 1 -- 172.21.15.103:0/3488642704 shutdown_connections 2020-04-22T14:05:48.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.361+0000 7f8117c51700 1 -- 172.21.15.103:0/3488642704 wait complete. 2020-04-22T14:05:48.364 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 20 2020-04-22T14:05:48.373 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:48.386 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:05:48.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.530+0000 7f1a4535a700 1 Processor -- start 2020-04-22T14:05:48.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.530+0000 7f1a4535a700 1 -- start start 2020-04-22T14:05:48.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.531+0000 7f1a4535a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1a40065fe0 0x7f1a401464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:48.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.531+0000 7f1a4535a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1a40063e30 0x7f1a400642a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:48.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.531+0000 7f1a4535a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a40143300 con 0x7f1a4012c0d0 2020-04-22T14:05:48.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.531+0000 7f1a4535a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a401435a0 con 0x7f1a40063e30 2020-04-22T14:05:48.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.531+0000 7f1a4535a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a40143840 con 0x7f1a40065fe0 2020-04-22T14:05:48.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.531+0000 7f1a3f7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1a40063e30 0x7f1a400642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:48.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.531+0000 7f1a3f7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1a40063e30 0x7f1a400642a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49496/0 (socket says 172.21.15.103:49496) 2020-04-22T14:05:48.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.531+0000 7f1a3f7fe700 1 -- 172.21.15.103:0/2192508265 learned_addr learned my addr 172.21.15.103:0/2192508265 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:05:48.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.531+0000 7f1a3e7fc700 1 --2- 172.21.15.103:0/2192508265 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1a40065fe0 0x7f1a401464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:48.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.531+0000 7f1a3f7fe700 1 -- 172.21.15.103:0/2192508265 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1a40065fe0 msgr2=0x7f1a401464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:48.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.531+0000 7f1a3f7fe700 1 --2- 172.21.15.103:0/2192508265 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1a40065fe0 0x7f1a401464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:48.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.531+0000 7f1a3f7fe700 1 -- 172.21.15.103:0/2192508265 >> v1:172.21.15.86:6789/0 conn(0x7f1a4012c0d0 legacy=0x7f1a4005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:48.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.531+0000 7f1a3f7fe700 1 -- 172.21.15.103:0/2192508265 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a4005bb50 con 0x7f1a40063e30 2020-04-22T14:05:48.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.531+0000 7f1a3f7fe700 1 --2- 172.21.15.103:0/2192508265 >> v2:172.21.15.103:3300/0 conn(0x7f1a40063e30 0x7f1a400642a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1a400613e0 tx=0x7f1a38007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.532+0000 7f1a3f7fe700 1 --2- 172.21.15.103:0/2192508265 >> v2:172.21.15.103:3300/0 conn(0x7f1a40063e30 0x7f1a400642a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1a400613e0 tx=0x7f1a38007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.532+0000 7f1a3f7fe700 1 --2- 172.21.15.103:0/2192508265 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a40063e30 0x7f1a400642a0 secure :-1 s=READY pgs=530 cs=0 l=1 rx=0x7f1a400613e0 tx=0x7f1a38007dc0).ready entity=mon.1 client_cookie=5d29a2013bf0ff18 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:48.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.532+0000 7f1a3f7fe700 1 --2- 172.21.15.103:0/2192508265 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a40063e30 0x7f1a400642a0 secure :-1 s=THROTTLE_DONE pgs=530 cs=0 l=1 rx=0x7f1a400613e0 tx=0x7f1a38007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.532+0000 7f1a3f7fe700 1 --2- 172.21.15.103:0/2192508265 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a40063e30 0x7f1a400642a0 secure :-1 s=THROTTLE_DONE pgs=530 cs=0 l=1 rx=0x7f1a400613e0 tx=0x7f1a38007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.532+0000 7f1a3dffb700 1 -- 172.21.15.103:0/2192508265 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a3800a180 con 0x7f1a40063e30 2020-04-22T14:05:48.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.532+0000 7f1a3f7fe700 1 --2- 172.21.15.103:0/2192508265 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a40063e30 0x7f1a400642a0 secure :-1 s=THROTTLE_DONE pgs=530 cs=0 l=1 rx=0x7f1a400613e0 tx=0x7f1a38007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.532+0000 7f1a3dffb700 1 -- 172.21.15.103:0/2192508265 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3800a2e0 con 0x7f1a40063e30 2020-04-22T14:05:48.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.532+0000 7f1a3dffb700 1 -- 172.21.15.103:0/2192508265 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a3800a700 con 0x7f1a40063e30 2020-04-22T14:05:48.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.532+0000 7f1a4535a700 1 -- 172.21.15.103:0/2192508265 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a40063e30 msgr2=0x7f1a400642a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:48.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.532+0000 7f1a4535a700 1 --2- 172.21.15.103:0/2192508265 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a40063e30 0x7f1a400642a0 secure :-1 s=READY pgs=530 cs=0 l=1 rx=0x7f1a400613e0 tx=0x7f1a38007dc0).stop 2020-04-22T14:05:48.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.532+0000 7f1a4535a700 1 -- 172.21.15.103:0/2192508265 shutdown_connections 2020-04-22T14:05:48.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.532+0000 7f1a4535a700 1 --2- 172.21.15.103:0/2192508265 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a40063e30 0x7f1a400642a0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:48.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.532+0000 7f1a4535a700 1 --2- 172.21.15.103:0/2192508265 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1a40065fe0 0x7f1a401464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:48.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.532+0000 7f1a4535a700 1 -- 172.21.15.103:0/2192508265 >> 172.21.15.103:0/2192508265 conn(0x7f1a400b9160 msgr2=0x7f1a4005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:48.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.532+0000 7f1a4535a700 1 -- 172.21.15.103:0/2192508265 shutdown_connections 2020-04-22T14:05:48.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.532+0000 7f1a4535a700 1 -- 172.21.15.103:0/2192508265 wait complete. 2020-04-22T14:05:48.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.533+0000 7f1a4535a700 1 Processor -- start 2020-04-22T14:05:48.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.533+0000 7f1a4535a700 1 -- start start 2020-04-22T14:05:48.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.534+0000 7f1a4535a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1a40065fe0 0x7f1a401297e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:48.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.534+0000 7f1a4535a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a401551b0 con 0x7f1a4012c0d0 2020-04-22T14:05:48.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.534+0000 7f1a4535a700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a40155450 con 0x7f1a40063e30 2020-04-22T14:05:48.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.534+0000 7f1a4535a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a40154fb0 con 0x7f1a40065fe0 2020-04-22T14:05:48.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.534+0000 7f1a3effd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f1a40063e30 0x7f1a401558f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41688/0 (socket says 172.21.15.103:41688) 2020-04-22T14:05:48.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.534+0000 7f1a3e7fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1a40065fe0 0x7f1a401297e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:48.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.534+0000 7f1a3effd700 1 -- 172.21.15.103:0/1506161372 learned_addr learned my addr 172.21.15.103:0/1506161372 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:48.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.534+0000 7f1a2ffff700 1 -- 172.21.15.103:0/1506161372 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3350574267 0 0) 0x7f1a40155450 con 0x7f1a40063e30 2020-04-22T14:05:48.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.534+0000 7f1a2ffff700 1 -- 172.21.15.103:0/1506161372 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a1c002fe0 con 0x7f1a40063e30 2020-04-22T14:05:48.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.534+0000 7f1a3e7fc700 1 -- 172.21.15.103:0/1506161372 >> v1:172.21.15.103:6789/0 conn(0x7f1a40063e30 legacy=0x7f1a401558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:48.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.534+0000 7f1a3e7fc700 1 -- 172.21.15.103:0/1506161372 >> v1:172.21.15.86:6789/0 conn(0x7f1a4012c0d0 legacy=0x7f1a40141f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:48.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.534+0000 7f1a3e7fc700 1 -- 172.21.15.103:0/1506161372 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a401365e0 con 0x7f1a40065fe0 2020-04-22T14:05:48.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.534+0000 7f1a3e7fc700 1 --2- 172.21.15.103:0/1506161372 >> v2:172.21.15.103:3300/0 conn(0x7f1a40065fe0 0x7f1a401297e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1a401295a0 tx=0x7f1a300109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.534+0000 7f1a3e7fc700 1 --2- 172.21.15.103:0/1506161372 >> v2:172.21.15.103:3300/0 conn(0x7f1a40065fe0 0x7f1a401297e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1a401295a0 tx=0x7f1a300109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.534+0000 7f1a3e7fc700 1 --2- 172.21.15.103:0/1506161372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a40065fe0 0x7f1a401297e0 secure :-1 s=READY pgs=532 cs=0 l=1 rx=0x7f1a401295a0 tx=0x7f1a300109b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:48.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.535+0000 7f1a3e7fc700 1 --2- 172.21.15.103:0/1506161372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a40065fe0 0x7f1a401297e0 secure :-1 s=THROTTLE_DONE pgs=532 cs=0 l=1 rx=0x7f1a401295a0 tx=0x7f1a300109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.535+0000 7f1a3e7fc700 1 --2- 172.21.15.103:0/1506161372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a40065fe0 0x7f1a401297e0 secure :-1 s=THROTTLE_DONE pgs=532 cs=0 l=1 rx=0x7f1a401295a0 tx=0x7f1a300109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.535+0000 7f1a2ffff700 1 -- 172.21.15.103:0/1506161372 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a3000a370 con 0x7f1a40065fe0 2020-04-22T14:05:48.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.535+0000 7f1a3e7fc700 1 --2- 172.21.15.103:0/1506161372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a40065fe0 0x7f1a401297e0 secure :-1 s=THROTTLE_DONE pgs=532 cs=0 l=1 rx=0x7f1a401295a0 tx=0x7f1a300109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.535+0000 7f1a2ffff700 1 -- 172.21.15.103:0/1506161372 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3000a4d0 con 0x7f1a40065fe0 2020-04-22T14:05:48.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.535+0000 7f1a4535a700 1 -- 172.21.15.103:0/1506161372 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a40129db0 con 0x7f1a40065fe0 2020-04-22T14:05:48.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.535+0000 7f1a2ffff700 1 -- 172.21.15.103:0/1506161372 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a3000a8b0 con 0x7f1a40065fe0 2020-04-22T14:05:48.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.535+0000 7f1a4535a700 1 -- 172.21.15.103:0/1506161372 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a40142880 con 0x7f1a40065fe0 2020-04-22T14:05:48.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.535+0000 7f1a3e7fc700 1 --2- 172.21.15.103:0/1506161372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a40065fe0 0x7f1a401297e0 secure :-1 s=THROTTLE_DONE pgs=532 cs=0 l=1 rx=0x7f1a401295a0 tx=0x7f1a300109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.536+0000 7f1a4535a700 1 -- 172.21.15.103:0/1506161372 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a40056c90 con 0x7f1a40065fe0 2020-04-22T14:05:48.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.536+0000 7f1a2ffff700 1 -- 172.21.15.103:0/1506161372 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f1a30007190 con 0x7f1a40065fe0 2020-04-22T14:05:48.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.536+0000 7f1a3e7fc700 1 --2- 172.21.15.103:0/1506161372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a40065fe0 0x7f1a401297e0 secure :-1 s=THROTTLE_DONE pgs=532 cs=0 l=1 rx=0x7f1a401295a0 tx=0x7f1a300109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.536+0000 7f1a2ffff700 1 --2- 172.21.15.103:0/1506161372 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1a1c04dd30 0x7f1a1c0501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:48.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.536+0000 7f1a2ffff700 1 -- 172.21.15.103:0/1506161372 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1a30060f90 con 0x7f1a40065fe0 2020-04-22T14:05:48.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.536+0000 7f1a3effd700 1 --2- 172.21.15.103:0/1506161372 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1a1c04dd30 0x7f1a1c0501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:48.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.536+0000 7f1a3effd700 1 --2- 172.21.15.103:0/1506161372 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1a1c04dd30 0x7f1a1c0501f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1a340020d0 tx=0x7f1a340027a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.537+0000 7f1a3effd700 1 --2- 172.21.15.103:0/1506161372 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1a1c04dd30 0x7f1a1c0501f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1a340020d0 tx=0x7f1a340027a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.537+0000 7f1a3effd700 1 --2- 172.21.15.103:0/1506161372 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1a1c04dd30 0x7f1a1c0501f0 secure :-1 s=READY pgs=211 cs=0 l=1 rx=0x7f1a340020d0 tx=0x7f1a340027a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:48.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.540+0000 7f1a3e7fc700 1 --2- 172.21.15.103:0/1506161372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a40065fe0 0x7f1a401297e0 secure :-1 s=THROTTLE_DONE pgs=532 cs=0 l=1 rx=0x7f1a401295a0 tx=0x7f1a300109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.540+0000 7f1a2ffff700 1 -- 172.21.15.103:0/1506161372 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f1a3003c370 con 0x7f1a40065fe0 2020-04-22T14:05:48.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.685+0000 7f1a4535a700 1 -- 172.21.15.103:0/1506161372 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a40147360 con 0x7f1a40065fe0 2020-04-22T14:05:48.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.686+0000 7f1a3e7fc700 1 --2- 172.21.15.103:0/1506161372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a40065fe0 0x7f1a401297e0 secure :-1 s=THROTTLE_DONE pgs=532 cs=0 l=1 rx=0x7f1a401295a0 tx=0x7f1a300109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.686+0000 7f1a2ffff700 1 -- 172.21.15.103:0/1506161372 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f1a3003f990 con 0x7f1a40065fe0 2020-04-22T14:05:48.689 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:05:48.689 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":45,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:05:46.962137+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:05:43.875682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2020-04-22T14:05:44.910499+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:05:48.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.687+0000 7f1a4535a700 1 -- 172.21.15.103:0/1506161372 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1a1c04dd30 msgr2=0x7f1a1c0501f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:48.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.687+0000 7f1a4535a700 1 --2- 172.21.15.103:0/1506161372 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1a1c04dd30 0x7f1a1c0501f0 secure :-1 s=READY pgs=211 cs=0 l=1 rx=0x7f1a340020d0 tx=0x7f1a340027a0).stop 2020-04-22T14:05:48.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.687+0000 7f1a4535a700 1 -- 172.21.15.103:0/1506161372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a40065fe0 msgr2=0x7f1a401297e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:48.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.687+0000 7f1a4535a700 1 --2- 172.21.15.103:0/1506161372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a40065fe0 0x7f1a401297e0 secure :-1 s=READY pgs=532 cs=0 l=1 rx=0x7f1a401295a0 tx=0x7f1a300109b0).stop 2020-04-22T14:05:48.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.687+0000 7f1a4535a700 1 -- 172.21.15.103:0/1506161372 shutdown_connections 2020-04-22T14:05:48.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.687+0000 7f1a4535a700 1 --2- 172.21.15.103:0/1506161372 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1a1c04dd30 0x7f1a1c0501f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:48.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.687+0000 7f1a4535a700 1 --2- 172.21.15.103:0/1506161372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a40065fe0 0x7f1a401297e0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:48.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.688+0000 7f1a4535a700 1 -- 172.21.15.103:0/1506161372 >> 172.21.15.103:0/1506161372 conn(0x7f1a400b9160 msgr2=0x7f1a40064210 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:48.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.688+0000 7f1a4535a700 1 -- 172.21.15.103:0/1506161372 shutdown_connections 2020-04-22T14:05:48.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.688+0000 7f1a4535a700 1 -- 172.21.15.103:0/1506161372 wait complete. 2020-04-22T14:05:48.700 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:48.716 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:05:48.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.865+0000 7f4818113700 1 Processor -- start 2020-04-22T14:05:48.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.865+0000 7f4818113700 1 -- start start 2020-04-22T14:05:48.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.866+0000 7f4818113700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4810152a90 0x7f48100b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:48.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.866+0000 7f4818113700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4810152e70 con 0x7f4810062170 2020-04-22T14:05:48.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.866+0000 7f4818113700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48100614f0 con 0x7f48100adf50 2020-04-22T14:05:48.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.866+0000 7f4818113700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4810061790 con 0x7f4810152a90 2020-04-22T14:05:48.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.866+0000 7f4816eb1700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f48100adf50 0x7f48100ae3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41696/0 (socket says 172.21.15.103:41696) 2020-04-22T14:05:48.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.866+0000 7f4816eb1700 1 -- 172.21.15.103:0/926678819 learned_addr learned my addr 172.21.15.103:0/926678819 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:48.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.867+0000 7f48156ae700 1 -- 172.21.15.103:0/926678819 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1642312216 0 0) 0x7f48100614f0 con 0x7f48100adf50 2020-04-22T14:05:48.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.867+0000 7f48156ae700 1 -- 172.21.15.103:0/926678819 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47fc003230 con 0x7f48100adf50 2020-04-22T14:05:48.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.867+0000 7f48166b0700 1 --2- 172.21.15.103:0/926678819 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4810152a90 0x7f48100b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:48.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.867+0000 7f48156ae700 1 -- 172.21.15.103:0/926678819 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3312357101 0 0) 0x7f47fc003230 con 0x7f48100adf50 2020-04-22T14:05:48.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.867+0000 7f48156ae700 1 -- 172.21.15.103:0/926678819 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4810152a90 msgr2=0x7f48100b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:48.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.867+0000 7f48156ae700 1 --2- 172.21.15.103:0/926678819 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4810152a90 0x7f48100b44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:48.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.867+0000 7f48156ae700 1 -- 172.21.15.103:0/926678819 >> v1:172.21.15.86:6789/0 conn(0x7f4810062170 legacy=0x7f48100b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:48.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.867+0000 7f48156ae700 1 -- 172.21.15.103:0/926678819 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4810061a30 con 0x7f48100adf50 2020-04-22T14:05:48.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.867+0000 7f48156ae700 1 -- 172.21.15.103:0/926678819 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f4808001a50 con 0x7f48100adf50 2020-04-22T14:05:48.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.867+0000 7f48156ae700 1 -- 172.21.15.103:0/926678819 >> v1:172.21.15.103:6789/0 conn(0x7f48100adf50 legacy=0x7f48100ae3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:48.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.867+0000 7f48156ae700 1 --2- 172.21.15.103:0/926678819 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4810152a90 0x7f47fc003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:48.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.867+0000 7f48156ae700 1 --2- 172.21.15.103:0/926678819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47fc003b80 0x7f47fc003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:48.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.867+0000 7f48156ae700 1 --2- 172.21.15.103:0/926678819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47fc0045c0 0x7f47fc004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:48.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.867+0000 7f48156ae700 1 -- 172.21.15.103:0/926678819 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4810061790 con 0x7f47fc003b80 2020-04-22T14:05:48.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.867+0000 7f48156ae700 1 -- 172.21.15.103:0/926678819 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc004fd0 con 0x7f47fc0045c0 2020-04-22T14:05:48.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.867+0000 7f48156ae700 1 -- 172.21.15.103:0/926678819 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc005190 con 0x7f4810152a90 2020-04-22T14:05:48.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.867+0000 7f4816eb1700 1 --2- 172.21.15.103:0/926678819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47fc0045c0 0x7f47fc004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:48.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.867+0000 7f48166b0700 1 --2- 172.21.15.103:0/926678819 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4810152a90 0x7f47fc003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:48.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.867+0000 7f4815eaf700 1 --2- 172.21.15.103:0/926678819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47fc003b80 0x7f47fc003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:48.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.867+0000 7f4816eb1700 1 -- 172.21.15.103:0/926678819 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4810152a90 msgr2=0x7f47fc003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:48.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.867+0000 7f4816eb1700 1 --2- 172.21.15.103:0/926678819 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4810152a90 0x7f47fc003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:48.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.867+0000 7f4816eb1700 1 -- 172.21.15.103:0/926678819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47fc003b80 msgr2=0x7f47fc003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:48.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.867+0000 7f4816eb1700 1 --2- 172.21.15.103:0/926678819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47fc003b80 0x7f47fc003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:48.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.867+0000 7f4816eb1700 1 -- 172.21.15.103:0/926678819 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47fc003230 con 0x7f47fc0045c0 2020-04-22T14:05:48.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.867+0000 7f4815eaf700 1 --2- 172.21.15.103:0/926678819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47fc003b80 0x7f47fc003fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:05:48.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.867+0000 7f4816eb1700 1 --2- 172.21.15.103:0/926678819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47fc0045c0 0x7f47fc004a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4808001760 tx=0x7f48100b6300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.867+0000 7f4816eb1700 1 --2- 172.21.15.103:0/926678819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47fc0045c0 0x7f47fc004a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4808001760 tx=0x7f48100b6300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.867+0000 7f4816eb1700 1 --2- 172.21.15.103:0/926678819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47fc0045c0 0x7f47fc004a20 secure :-1 s=READY pgs=534 cs=0 l=1 rx=0x7f4808001760 tx=0x7f48100b6300).ready entity=mon.1 client_cookie=7ee6136d6a747090 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:48.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.868+0000 7f4816eb1700 1 --2- 172.21.15.103:0/926678819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47fc0045c0 0x7f47fc004a20 secure :-1 s=THROTTLE_DONE pgs=534 cs=0 l=1 rx=0x7f4808001760 tx=0x7f48100b6300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.868+0000 7f4816eb1700 1 --2- 172.21.15.103:0/926678819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47fc0045c0 0x7f47fc004a20 secure :-1 s=THROTTLE_DONE pgs=534 cs=0 l=1 rx=0x7f4808001760 tx=0x7f48100b6300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.868+0000 7f48156ae700 1 -- 172.21.15.103:0/926678819 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f480800e560 con 0x7f47fc0045c0 2020-04-22T14:05:48.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.868+0000 7f4816eb1700 1 --2- 172.21.15.103:0/926678819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47fc0045c0 0x7f47fc004a20 secure :-1 s=THROTTLE_DONE pgs=534 cs=0 l=1 rx=0x7f4808001760 tx=0x7f48100b6300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.868+0000 7f48156ae700 1 -- 172.21.15.103:0/926678819 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f480800e700 con 0x7f47fc0045c0 2020-04-22T14:05:48.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.868+0000 7f48156ae700 1 -- 172.21.15.103:0/926678819 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48080100c0 con 0x7f47fc0045c0 2020-04-22T14:05:48.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.868+0000 7f4818113700 1 -- 172.21.15.103:0/926678819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47fc0045c0 msgr2=0x7f47fc004a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:48.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.868+0000 7f4818113700 1 --2- 172.21.15.103:0/926678819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47fc0045c0 0x7f47fc004a20 secure :-1 s=READY pgs=534 cs=0 l=1 rx=0x7f4808001760 tx=0x7f48100b6300).stop 2020-04-22T14:05:48.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.868+0000 7f4816eb1700 1 -- 172.21.15.103:0/926678819 reap_dead start 2020-04-22T14:05:48.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.868+0000 7f4818113700 1 -- 172.21.15.103:0/926678819 shutdown_connections 2020-04-22T14:05:48.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.868+0000 7f4818113700 1 -- 172.21.15.103:0/926678819 >> 172.21.15.103:0/926678819 conn(0x7f481005ad30 msgr2=0x7f481005b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:48.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.868+0000 7f4818113700 1 -- 172.21.15.103:0/926678819 shutdown_connections 2020-04-22T14:05:48.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.868+0000 7f4818113700 1 -- 172.21.15.103:0/926678819 wait complete. 2020-04-22T14:05:48.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.869+0000 7f4818113700 1 Processor -- start 2020-04-22T14:05:48.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.869+0000 7f4818113700 1 -- start start 2020-04-22T14:05:48.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.870+0000 7f4818113700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f48100b7300 0x7f4810134590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:48.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.870+0000 7f4818113700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4810151d20 0x7f4810112690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:48.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.870+0000 7f4818113700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48101458e0 con 0x7f4810145440 2020-04-22T14:05:48.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.870+0000 7f4818113700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4810145b80 con 0x7f4810151d20 2020-04-22T14:05:48.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.870+0000 7f4818113700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4810145e20 con 0x7f48100b7300 2020-04-22T14:05:48.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.870+0000 7f4815eaf700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f4810145440 0x7f4810151610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41708/0 (socket says 172.21.15.103:41708) 2020-04-22T14:05:48.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.870+0000 7f48166b0700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f48100b7300 0x7f4810134590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:48.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.870+0000 7f4815eaf700 1 -- 172.21.15.103:0/2293890390 learned_addr learned my addr 172.21.15.103:0/2293890390 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:48.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.870+0000 7f4816eb1700 1 --2- 172.21.15.103:0/2293890390 >> v2:172.21.15.86:3300/0 conn(0x7f4810151d20 0x7f4810112690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:48.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.870+0000 7f48166b0700 1 -- 172.21.15.103:0/2293890390 >> v2:172.21.15.86:3300/0 conn(0x7f4810151d20 msgr2=0x7f4810112690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:48.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.870+0000 7f48166b0700 1 --2- 172.21.15.103:0/2293890390 >> v2:172.21.15.86:3300/0 conn(0x7f4810151d20 0x7f4810112690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:48.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.870+0000 7f48166b0700 1 -- 172.21.15.103:0/2293890390 >> v1:172.21.15.103:6789/0 conn(0x7f4810145440 legacy=0x7f4810151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:48.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.870+0000 7f4806ffd700 1 -- 172.21.15.103:0/2293890390 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1411537777 0 0) 0x7f48101458e0 con 0x7f4810145440 2020-04-22T14:05:48.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.870+0000 7f48166b0700 1 -- 172.21.15.103:0/2293890390 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48100b76e0 con 0x7f48100b7300 2020-04-22T14:05:48.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.870+0000 7f48166b0700 1 --2- 172.21.15.103:0/2293890390 >> v2:172.21.15.103:3300/0 conn(0x7f48100b7300 0x7f4810134590 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f480c002f30 tx=0x7f480c010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.871+0000 7f48166b0700 1 --2- 172.21.15.103:0/2293890390 >> v2:172.21.15.103:3300/0 conn(0x7f48100b7300 0x7f4810134590 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f480c002f30 tx=0x7f480c010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.871+0000 7f48166b0700 1 --2- 172.21.15.103:0/2293890390 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48100b7300 0x7f4810134590 secure :-1 s=READY pgs=536 cs=0 l=1 rx=0x7f480c002f30 tx=0x7f480c010c00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:48.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.871+0000 7f48166b0700 1 --2- 172.21.15.103:0/2293890390 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48100b7300 0x7f4810134590 secure :-1 s=THROTTLE_DONE pgs=536 cs=0 l=1 rx=0x7f480c002f30 tx=0x7f480c010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.871+0000 7f4806ffd700 1 -- 172.21.15.103:0/2293890390 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f480c005e90 con 0x7f48100b7300 2020-04-22T14:05:48.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.871+0000 7f48166b0700 1 --2- 172.21.15.103:0/2293890390 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48100b7300 0x7f4810134590 secure :-1 s=THROTTLE_DONE pgs=536 cs=0 l=1 rx=0x7f480c002f30 tx=0x7f480c010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.871+0000 7f48166b0700 1 --2- 172.21.15.103:0/2293890390 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48100b7300 0x7f4810134590 secure :-1 s=THROTTLE_DONE pgs=536 cs=0 l=1 rx=0x7f480c002f30 tx=0x7f480c010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.871+0000 7f4806ffd700 1 -- 172.21.15.103:0/2293890390 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f480c007180 con 0x7f48100b7300 2020-04-22T14:05:48.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.871+0000 7f4818113700 1 -- 172.21.15.103:0/2293890390 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48101341d0 con 0x7f48100b7300 2020-04-22T14:05:48.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.871+0000 7f4806ffd700 1 -- 172.21.15.103:0/2293890390 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f480c0074e0 con 0x7f48100b7300 2020-04-22T14:05:48.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.871+0000 7f4818113700 1 -- 172.21.15.103:0/2293890390 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4810112af0 con 0x7f48100b7300 2020-04-22T14:05:48.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.871+0000 7f48166b0700 1 --2- 172.21.15.103:0/2293890390 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48100b7300 0x7f4810134590 secure :-1 s=THROTTLE_DONE pgs=536 cs=0 l=1 rx=0x7f480c002f30 tx=0x7f480c010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.872+0000 7f4806ffd700 1 -- 172.21.15.103:0/2293890390 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f480c013070 con 0x7f48100b7300 2020-04-22T14:05:48.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.872+0000 7f48166b0700 1 --2- 172.21.15.103:0/2293890390 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48100b7300 0x7f4810134590 secure :-1 s=THROTTLE_DONE pgs=536 cs=0 l=1 rx=0x7f480c002f30 tx=0x7f480c010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.872+0000 7f4818113700 1 -- 172.21.15.103:0/2293890390 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4810056c90 con 0x7f48100b7300 2020-04-22T14:05:48.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.872+0000 7f4806ffd700 1 --2- 172.21.15.103:0/2293890390 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f47f804d8a0 0x7f47f804fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:48.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.872+0000 7f4806ffd700 1 -- 172.21.15.103:0/2293890390 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f480c0613f0 con 0x7f48100b7300 2020-04-22T14:05:48.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.872+0000 7f4815eaf700 1 --2- 172.21.15.103:0/2293890390 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f47f804d8a0 0x7f47f804fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:48.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.872+0000 7f4815eaf700 1 --2- 172.21.15.103:0/2293890390 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f47f804d8a0 0x7f47f804fd60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4800001470 tx=0x7f481005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.873+0000 7f4815eaf700 1 --2- 172.21.15.103:0/2293890390 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f47f804d8a0 0x7f47f804fd60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4800001470 tx=0x7f481005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.873+0000 7f4815eaf700 1 --2- 172.21.15.103:0/2293890390 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f47f804d8a0 0x7f47f804fd60 secure :-1 s=READY pgs=212 cs=0 l=1 rx=0x7f4800001470 tx=0x7f481005a720).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:48.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.876+0000 7f48166b0700 1 --2- 172.21.15.103:0/2293890390 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48100b7300 0x7f4810134590 secure :-1 s=THROTTLE_DONE pgs=536 cs=0 l=1 rx=0x7f480c002f30 tx=0x7f480c010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:48.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:48.876+0000 7f4806ffd700 1 -- 172.21.15.103:0/2293890390 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f480c03c7d0 con 0x7f48100b7300 2020-04-22T14:05:49.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.070+0000 7f4818113700 1 -- 172.21.15.103:0/2293890390 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f48100805e0 con 0x7f48100b7300 2020-04-22T14:05:49.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.076+0000 7f48166b0700 1 --2- 172.21.15.103:0/2293890390 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48100b7300 0x7f4810134590 secure :-1 s=THROTTLE_DONE pgs=536 cs=0 l=1 rx=0x7f480c002f30 tx=0x7f480c010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:49.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.076+0000 7f4806ffd700 1 -- 172.21.15.103:0/2293890390 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v17) v1 ==== 184+0+0 (secure 0 0 0) 0x7f480c03fdf0 con 0x7f48100b7300 2020-04-22T14:05:49.082 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.078+0000 7f4818113700 1 -- 172.21.15.103:0/2293890390 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f47f804d8a0 msgr2=0x7f47f804fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:49.082 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.078+0000 7f4818113700 1 --2- 172.21.15.103:0/2293890390 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f47f804d8a0 0x7f47f804fd60 secure :-1 s=READY pgs=212 cs=0 l=1 rx=0x7f4800001470 tx=0x7f481005a720).stop 2020-04-22T14:05:49.082 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.078+0000 7f4818113700 1 -- 172.21.15.103:0/2293890390 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48100b7300 msgr2=0x7f4810134590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:49.082 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.078+0000 7f4818113700 1 --2- 172.21.15.103:0/2293890390 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48100b7300 0x7f4810134590 secure :-1 s=READY pgs=536 cs=0 l=1 rx=0x7f480c002f30 tx=0x7f480c010c00).stop 2020-04-22T14:05:49.082 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.078+0000 7f4818113700 1 -- 172.21.15.103:0/2293890390 shutdown_connections 2020-04-22T14:05:49.082 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.078+0000 7f4818113700 1 --2- 172.21.15.103:0/2293890390 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f47f804d8a0 0x7f47f804fd60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:49.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.078+0000 7f4818113700 1 --2- 172.21.15.103:0/2293890390 >> v2:172.21.15.86:3300/0 conn(0x7f4810151d20 0x7f4810112690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:49.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.078+0000 7f4818113700 1 --2- 172.21.15.103:0/2293890390 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48100b7300 0x7f4810134590 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:49.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.078+0000 7f4818113700 1 -- 172.21.15.103:0/2293890390 >> 172.21.15.103:0/2293890390 conn(0x7f481005ad30 msgr2=0x7f48101355f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:49.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.078+0000 7f4818113700 1 -- 172.21.15.103:0/2293890390 shutdown_connections 2020-04-22T14:05:49.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.078+0000 7f4818113700 1 -- 172.21.15.103:0/2293890390 wait complete. 2020-04-22T14:05:49.083 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.0 2020-04-22T14:05:49.091 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:49.108 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:05:49.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.258+0000 7fb6d54d6700 1 Processor -- start 2020-04-22T14:05:49.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.258+0000 7fb6d54d6700 1 -- start start 2020-04-22T14:05:49.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.259+0000 7fb6d54d6700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb6d0152a90 0x7fb6d00b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:49.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.259+0000 7fb6d54d6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb6d0062170 0x7fb6d00b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:49.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.259+0000 7fb6d54d6700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6d0152e70 con 0x7fb6d00b5210 2020-04-22T14:05:49.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.259+0000 7fb6d54d6700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6d00614f0 con 0x7fb6d0152a90 2020-04-22T14:05:49.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.259+0000 7fb6d54d6700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d0061790 con 0x7fb6d0062170 2020-04-22T14:05:49.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.259+0000 7fb6cf7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb6d0152a90 0x7fb6d00b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:49.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.259+0000 7fb6cf7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb6d0152a90 0x7fb6d00b44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49524/0 (socket says 172.21.15.103:49524) 2020-04-22T14:05:49.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.259+0000 7fb6cf7fe700 1 -- 172.21.15.103:0/2329579219 learned_addr learned my addr 172.21.15.103:0/2329579219 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:05:49.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.259+0000 7fb6c6ffd700 1 --2- 172.21.15.103:0/2329579219 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb6d0062170 0x7fb6d00b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:49.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.259+0000 7fb6cf7fe700 1 -- 172.21.15.103:0/2329579219 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb6d0062170 msgr2=0x7fb6d00b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:49.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.259+0000 7fb6cf7fe700 1 --2- 172.21.15.103:0/2329579219 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb6d0062170 0x7fb6d00b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:49.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.259+0000 7fb6cf7fe700 1 -- 172.21.15.103:0/2329579219 >> v1:172.21.15.86:6789/0 conn(0x7fb6d00b5210 legacy=0x7fb6d0156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:49.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.259+0000 7fb6cf7fe700 1 -- 172.21.15.103:0/2329579219 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d00b56a0 con 0x7fb6d0152a90 2020-04-22T14:05:49.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.259+0000 7fb6cf7fe700 1 --2- 172.21.15.103:0/2329579219 >> v2:172.21.15.103:3300/0 conn(0x7fb6d0152a90 0x7fb6d00b44d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb6c0002f30 tx=0x7fb6c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:49.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.259+0000 7fb6cf7fe700 1 --2- 172.21.15.103:0/2329579219 >> v2:172.21.15.103:3300/0 conn(0x7fb6d0152a90 0x7fb6d00b44d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb6c0002f30 tx=0x7fb6c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:49.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.259+0000 7fb6cf7fe700 1 --2- 172.21.15.103:0/2329579219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6d0152a90 0x7fb6d00b44d0 secure :-1 s=READY pgs=537 cs=0 l=1 rx=0x7fb6c0002f30 tx=0x7fb6c0007a40).ready entity=mon.1 client_cookie=d3c06aef2c5a9fc7 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:49.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.259+0000 7fb6cf7fe700 1 --2- 172.21.15.103:0/2329579219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6d0152a90 0x7fb6d00b44d0 secure :-1 s=THROTTLE_DONE pgs=537 cs=0 l=1 rx=0x7fb6c0002f30 tx=0x7fb6c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:49.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.259+0000 7fb6ceffd700 1 -- 172.21.15.103:0/2329579219 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6c0011720 con 0x7fb6d0152a90 2020-04-22T14:05:49.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.259+0000 7fb6cf7fe700 1 --2- 172.21.15.103:0/2329579219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6d0152a90 0x7fb6d00b44d0 secure :-1 s=THROTTLE_DONE pgs=537 cs=0 l=1 rx=0x7fb6c0002f30 tx=0x7fb6c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:49.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.259+0000 7fb6cf7fe700 1 --2- 172.21.15.103:0/2329579219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6d0152a90 0x7fb6d00b44d0 secure :-1 s=THROTTLE_DONE pgs=537 cs=0 l=1 rx=0x7fb6c0002f30 tx=0x7fb6c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:49.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.259+0000 7fb6ceffd700 1 -- 172.21.15.103:0/2329579219 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c00118c0 con 0x7fb6d0152a90 2020-04-22T14:05:49.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.259+0000 7fb6ceffd700 1 -- 172.21.15.103:0/2329579219 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6c0011ce0 con 0x7fb6d0152a90 2020-04-22T14:05:49.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.259+0000 7fb6d54d6700 1 -- 172.21.15.103:0/2329579219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6d0152a90 msgr2=0x7fb6d00b44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:49.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.259+0000 7fb6d54d6700 1 --2- 172.21.15.103:0/2329579219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6d0152a90 0x7fb6d00b44d0 secure :-1 s=READY pgs=537 cs=0 l=1 rx=0x7fb6c0002f30 tx=0x7fb6c0007a40).stop 2020-04-22T14:05:49.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.260+0000 7fb6d54d6700 1 -- 172.21.15.103:0/2329579219 shutdown_connections 2020-04-22T14:05:49.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.260+0000 7fb6d54d6700 1 --2- 172.21.15.103:0/2329579219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6d0152a90 0x7fb6d00b44d0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:49.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.260+0000 7fb6d54d6700 1 --2- 172.21.15.103:0/2329579219 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb6d0062170 0x7fb6d00b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:49.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.260+0000 7fb6d54d6700 1 -- 172.21.15.103:0/2329579219 >> 172.21.15.103:0/2329579219 conn(0x7fb6d005ad30 msgr2=0x7fb6d005b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:49.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.260+0000 7fb6d54d6700 1 -- 172.21.15.103:0/2329579219 shutdown_connections 2020-04-22T14:05:49.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.260+0000 7fb6d54d6700 1 -- 172.21.15.103:0/2329579219 wait complete. 2020-04-22T14:05:49.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.261+0000 7fb6d54d6700 1 Processor -- start 2020-04-22T14:05:49.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.261+0000 7fb6d54d6700 1 -- start start 2020-04-22T14:05:49.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.262+0000 7fb6d54d6700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb6d0062170 0x7fb6d0064f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:49.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.262+0000 7fb6d54d6700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb6d0152a90 0x7fb6d00ae260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:49.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.262+0000 7fb6d54d6700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6d00ae6c0 con 0x7fb6d00b5210 2020-04-22T14:05:49.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.262+0000 7fb6d54d6700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6d00653d0 con 0x7fb6d0152a90 2020-04-22T14:05:49.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.262+0000 7fb6d54d6700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6d0139460 con 0x7fb6d0062170 2020-04-22T14:05:49.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.262+0000 7fb6cf7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb6d0062170 0x7fb6d0064f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:49.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.262+0000 7fb6cf7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb6d0062170 0x7fb6d0064f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49528/0 (socket says 172.21.15.103:49528) 2020-04-22T14:05:49.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.262+0000 7fb6cf7fe700 1 -- 172.21.15.103:0/3522888310 learned_addr learned my addr 172.21.15.103:0/3522888310 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:05:49.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.262+0000 7fb6cffff700 1 --2- 172.21.15.103:0/3522888310 >> v2:172.21.15.86:3300/0 conn(0x7fb6d0152a90 0x7fb6d00ae260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:49.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.262+0000 7fb6cf7fe700 1 -- 172.21.15.103:0/3522888310 >> v2:172.21.15.86:3300/0 conn(0x7fb6d0152a90 msgr2=0x7fb6d00ae260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:49.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.262+0000 7fb6cf7fe700 1 --2- 172.21.15.103:0/3522888310 >> v2:172.21.15.86:3300/0 conn(0x7fb6d0152a90 0x7fb6d00ae260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:49.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.262+0000 7fb6cf7fe700 1 -- 172.21.15.103:0/3522888310 >> v1:172.21.15.86:6789/0 conn(0x7fb6d00b5210 legacy=0x7fb6d01532d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:49.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.262+0000 7fb6cf7fe700 1 -- 172.21.15.103:0/3522888310 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d0139700 con 0x7fb6d0062170 2020-04-22T14:05:49.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.262+0000 7fb6cf7fe700 1 --2- 172.21.15.103:0/3522888310 >> v2:172.21.15.103:3300/0 conn(0x7fb6d0062170 0x7fb6d0064f70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb6d0135a00 tx=0x7fb6c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:49.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.262+0000 7fb6cf7fe700 1 --2- 172.21.15.103:0/3522888310 >> v2:172.21.15.103:3300/0 conn(0x7fb6d0062170 0x7fb6d0064f70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb6d0135a00 tx=0x7fb6c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:49.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.262+0000 7fb6cf7fe700 1 --2- 172.21.15.103:0/3522888310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6d0062170 0x7fb6d0064f70 secure :-1 s=READY pgs=538 cs=0 l=1 rx=0x7fb6d0135a00 tx=0x7fb6c0007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:49.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.262+0000 7fb6cf7fe700 1 --2- 172.21.15.103:0/3522888310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6d0062170 0x7fb6d0064f70 secure :-1 s=THROTTLE_DONE pgs=538 cs=0 l=1 rx=0x7fb6d0135a00 tx=0x7fb6c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:49.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.262+0000 7fb6ccff9700 1 -- 172.21.15.103:0/3522888310 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6c00102c0 con 0x7fb6d0062170 2020-04-22T14:05:49.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.262+0000 7fb6cf7fe700 1 --2- 172.21.15.103:0/3522888310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6d0062170 0x7fb6d0064f70 secure :-1 s=THROTTLE_DONE pgs=538 cs=0 l=1 rx=0x7fb6d0135a00 tx=0x7fb6c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:49.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.263+0000 7fb6ccff9700 1 -- 172.21.15.103:0/3522888310 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c0011d20 con 0x7fb6d0062170 2020-04-22T14:05:49.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.263+0000 7fb6cf7fe700 1 --2- 172.21.15.103:0/3522888310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6d0062170 0x7fb6d0064f70 secure :-1 s=THROTTLE_DONE pgs=538 cs=0 l=1 rx=0x7fb6d0135a00 tx=0x7fb6c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:49.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.263+0000 7fb6d54d6700 1 -- 172.21.15.103:0/3522888310 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6d01399a0 con 0x7fb6d0062170 2020-04-22T14:05:49.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.263+0000 7fb6ccff9700 1 -- 172.21.15.103:0/3522888310 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6c0007550 con 0x7fb6d0062170 2020-04-22T14:05:49.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.263+0000 7fb6d54d6700 1 -- 172.21.15.103:0/3522888310 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6d0138fc0 con 0x7fb6d0062170 2020-04-22T14:05:49.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.263+0000 7fb6cf7fe700 1 --2- 172.21.15.103:0/3522888310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6d0062170 0x7fb6d0064f70 secure :-1 s=THROTTLE_DONE pgs=538 cs=0 l=1 rx=0x7fb6d0135a00 tx=0x7fb6c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:49.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.264+0000 7fb6d54d6700 1 -- 172.21.15.103:0/3522888310 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6d01392d0 con 0x7fb6d0062170 2020-04-22T14:05:49.286 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.264+0000 7fb6ccff9700 1 -- 172.21.15.103:0/3522888310 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fb6c00056c0 con 0x7fb6d0062170 2020-04-22T14:05:49.286 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.264+0000 7fb6cf7fe700 1 --2- 172.21.15.103:0/3522888310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6d0062170 0x7fb6d0064f70 secure :-1 s=THROTTLE_DONE pgs=538 cs=0 l=1 rx=0x7fb6d0135a00 tx=0x7fb6c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:49.286 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.264+0000 7fb6ccff9700 1 --2- 172.21.15.103:0/3522888310 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb6b404d980 0x7fb6b404fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:49.286 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.264+0000 7fb6ccff9700 1 -- 172.21.15.103:0/3522888310 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb6c0061c40 con 0x7fb6d0062170 2020-04-22T14:05:49.286 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.264+0000 7fb6c6ffd700 1 --2- 172.21.15.103:0/3522888310 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb6b404d980 0x7fb6b404fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:49.286 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.264+0000 7fb6c6ffd700 1 --2- 172.21.15.103:0/3522888310 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb6b404d980 0x7fb6b404fe40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb6d0065a40 tx=0x7fb6d005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:49.286 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.264+0000 7fb6c6ffd700 1 --2- 172.21.15.103:0/3522888310 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb6b404d980 0x7fb6b404fe40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb6d0065a40 tx=0x7fb6d005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:49.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.264+0000 7fb6c6ffd700 1 --2- 172.21.15.103:0/3522888310 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb6b404d980 0x7fb6b404fe40 secure :-1 s=READY pgs=213 cs=0 l=1 rx=0x7fb6d0065a40 tx=0x7fb6d005a720).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:49.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.268+0000 7fb6cf7fe700 1 --2- 172.21.15.103:0/3522888310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6d0062170 0x7fb6d0064f70 secure :-1 s=THROTTLE_DONE pgs=538 cs=0 l=1 rx=0x7fb6d0135a00 tx=0x7fb6c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:49.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.268+0000 7fb6ccff9700 1 -- 172.21.15.103:0/3522888310 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fb6c003d0e0 con 0x7fb6d0062170 2020-04-22T14:05:49.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.458+0000 7fb6d54d6700 1 -- 172.21.15.103:0/3522888310 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fb6d0056c90 con 0x7fb6d0062170 2020-04-22T14:05:49.466 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.464+0000 7fb6cf7fe700 1 --2- 172.21.15.103:0/3522888310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6d0062170 0x7fb6d0064f70 secure :-1 s=THROTTLE_DONE pgs=538 cs=0 l=1 rx=0x7fb6d0135a00 tx=0x7fb6c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:49.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.464+0000 7fb6ccff9700 1 -- 172.21.15.103:0/3522888310 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v18) v1 ==== 184+0+0 (secure 0 0 0) 0x7fb6c0040700 con 0x7fb6d0062170 2020-04-22T14:05:49.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.466+0000 7fb6d54d6700 1 -- 172.21.15.103:0/3522888310 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb6b404d980 msgr2=0x7fb6b404fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:49.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.466+0000 7fb6d54d6700 1 --2- 172.21.15.103:0/3522888310 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb6b404d980 0x7fb6b404fe40 secure :-1 s=READY pgs=213 cs=0 l=1 rx=0x7fb6d0065a40 tx=0x7fb6d005a720).stop 2020-04-22T14:05:49.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.466+0000 7fb6d54d6700 1 -- 172.21.15.103:0/3522888310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6d0062170 msgr2=0x7fb6d0064f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:49.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.466+0000 7fb6d54d6700 1 --2- 172.21.15.103:0/3522888310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6d0062170 0x7fb6d0064f70 secure :-1 s=READY pgs=538 cs=0 l=1 rx=0x7fb6d0135a00 tx=0x7fb6c0007a40).stop 2020-04-22T14:05:49.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.466+0000 7fb6d54d6700 1 -- 172.21.15.103:0/3522888310 shutdown_connections 2020-04-22T14:05:49.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.466+0000 7fb6d54d6700 1 --2- 172.21.15.103:0/3522888310 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb6b404d980 0x7fb6b404fe40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:49.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.466+0000 7fb6d54d6700 1 --2- 172.21.15.103:0/3522888310 >> v2:172.21.15.86:3300/0 conn(0x7fb6d0152a90 0x7fb6d00ae260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:49.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.466+0000 7fb6d54d6700 1 --2- 172.21.15.103:0/3522888310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6d0062170 0x7fb6d0064f70 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:49.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.466+0000 7fb6d54d6700 1 -- 172.21.15.103:0/3522888310 >> 172.21.15.103:0/3522888310 conn(0x7fb6d005ad30 msgr2=0x7fb6d0126cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:49.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.466+0000 7fb6d54d6700 1 -- 172.21.15.103:0/3522888310 shutdown_connections 2020-04-22T14:05:49.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.466+0000 7fb6d54d6700 1 -- 172.21.15.103:0/3522888310 wait complete. 2020-04-22T14:05:49.471 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.1 2020-04-22T14:05:49.479 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:49.492 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:05:49.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.642+0000 7f284c644700 1 Processor -- start 2020-04-22T14:05:49.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.642+0000 7f284c644700 1 -- start start 2020-04-22T14:05:49.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.643+0000 7f284c644700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2844152a90 0x7f28440b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:49.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.643+0000 7f284c644700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f28440adf50 0x7f28440ae3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:49.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.643+0000 7f284c644700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28440614f0 con 0x7f2844062170 2020-04-22T14:05:49.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.643+0000 7f284c644700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2844061790 con 0x7f2844152a90 2020-04-22T14:05:49.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.643+0000 7f284c644700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2844061a30 con 0x7f28440adf50 2020-04-22T14:05:49.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.643+0000 7f284b3e2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f28440adf50 0x7f28440ae3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:49.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.643+0000 7f284b3e2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f28440adf50 0x7f28440ae3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49540/0 (socket says 172.21.15.103:49540) 2020-04-22T14:05:49.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.644+0000 7f284b3e2700 1 -- 172.21.15.103:0/1329036526 learned_addr learned my addr 172.21.15.103:0/1329036526 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:05:49.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.644+0000 7f284abe1700 1 --2- 172.21.15.103:0/1329036526 >> v2:172.21.15.86:3300/0 conn(0x7f2844152a90 0x7f28440b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:49.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.644+0000 7f284b3e2700 1 -- 172.21.15.103:0/1329036526 >> v2:172.21.15.86:3300/0 conn(0x7f2844152a90 msgr2=0x7f28440b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:49.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.644+0000 7f284b3e2700 1 --2- 172.21.15.103:0/1329036526 >> v2:172.21.15.86:3300/0 conn(0x7f2844152a90 0x7f28440b44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:49.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.644+0000 7f284b3e2700 1 -- 172.21.15.103:0/1329036526 >> v1:172.21.15.86:6789/0 conn(0x7f2844062170 legacy=0x7f28440b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:49.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.644+0000 7f284b3e2700 1 -- 172.21.15.103:0/1329036526 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2844061cd0 con 0x7f28440adf50 2020-04-22T14:05:49.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.644+0000 7f284b3e2700 1 --2- 172.21.15.103:0/1329036526 >> v2:172.21.15.103:3300/0 conn(0x7f28440adf50 0x7f28440ae3c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f283c0032b0 tx=0x7f283c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:49.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.644+0000 7f284b3e2700 1 --2- 172.21.15.103:0/1329036526 >> v2:172.21.15.103:3300/0 conn(0x7f28440adf50 0x7f28440ae3c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f283c0032b0 tx=0x7f283c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:49.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.644+0000 7f284b3e2700 1 --2- 172.21.15.103:0/1329036526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28440adf50 0x7f28440ae3c0 secure :-1 s=READY pgs=539 cs=0 l=1 rx=0x7f283c0032b0 tx=0x7f283c007dc0).ready entity=mon.1 client_cookie=507436f639b91e3b server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:49.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.644+0000 7f284b3e2700 1 --2- 172.21.15.103:0/1329036526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28440adf50 0x7f28440ae3c0 secure :-1 s=THROTTLE_DONE pgs=539 cs=0 l=1 rx=0x7f283c0032b0 tx=0x7f283c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:49.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.644+0000 7f2849bdf700 1 -- 172.21.15.103:0/1329036526 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f283c00a180 con 0x7f28440adf50 2020-04-22T14:05:49.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.644+0000 7f284b3e2700 1 --2- 172.21.15.103:0/1329036526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28440adf50 0x7f28440ae3c0 secure :-1 s=THROTTLE_DONE pgs=539 cs=0 l=1 rx=0x7f283c0032b0 tx=0x7f283c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:49.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.644+0000 7f284b3e2700 1 --2- 172.21.15.103:0/1329036526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28440adf50 0x7f28440ae3c0 secure :-1 s=THROTTLE_DONE pgs=539 cs=0 l=1 rx=0x7f283c0032b0 tx=0x7f283c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:49.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.644+0000 7f2849bdf700 1 -- 172.21.15.103:0/1329036526 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f283c00a2e0 con 0x7f28440adf50 2020-04-22T14:05:49.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.644+0000 7f2849bdf700 1 -- 172.21.15.103:0/1329036526 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f283c00a700 con 0x7f28440adf50 2020-04-22T14:05:49.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.644+0000 7f284c644700 1 -- 172.21.15.103:0/1329036526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28440adf50 msgr2=0x7f28440ae3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:49.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.644+0000 7f284c644700 1 --2- 172.21.15.103:0/1329036526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28440adf50 0x7f28440ae3c0 secure :-1 s=READY pgs=539 cs=0 l=1 rx=0x7f283c0032b0 tx=0x7f283c007dc0).stop 2020-04-22T14:05:49.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.645+0000 7f284c644700 1 -- 172.21.15.103:0/1329036526 shutdown_connections 2020-04-22T14:05:49.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.645+0000 7f284c644700 1 --2- 172.21.15.103:0/1329036526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28440adf50 0x7f28440ae3c0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:49.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.645+0000 7f284c644700 1 --2- 172.21.15.103:0/1329036526 >> v2:172.21.15.86:3300/0 conn(0x7f2844152a90 0x7f28440b44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:49.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.645+0000 7f284c644700 1 -- 172.21.15.103:0/1329036526 >> 172.21.15.103:0/1329036526 conn(0x7f284405ad30 msgr2=0x7f284405b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:49.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.645+0000 7f284c644700 1 -- 172.21.15.103:0/1329036526 shutdown_connections 2020-04-22T14:05:49.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.645+0000 7f284c644700 1 -- 172.21.15.103:0/1329036526 wait complete. 2020-04-22T14:05:49.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.646+0000 7f284c644700 1 Processor -- start 2020-04-22T14:05:49.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.646+0000 7f284c644700 1 -- start start 2020-04-22T14:05:49.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.647+0000 7f284c644700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f28440adf50 0x7f28440b1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:49.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.647+0000 7f284c644700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2844152a90 0x7f2844152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:49.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.647+0000 7f284c644700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2844153c80 con 0x7f2844062170 2020-04-22T14:05:49.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.647+0000 7f284c644700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28441277a0 con 0x7f28440adf50 2020-04-22T14:05:49.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.647+0000 7f284c644700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2844153f20 con 0x7f2844152a90 2020-04-22T14:05:49.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.647+0000 7f284b3e2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2844152a90 0x7f2844152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:49.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.647+0000 7f284b3e2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2844152a90 0x7f2844152f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49546/0 (socket says 172.21.15.103:49546) 2020-04-22T14:05:49.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.647+0000 7f284b3e2700 1 -- 172.21.15.103:0/3991577559 learned_addr learned my addr 172.21.15.103:0/3991577559 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:05:49.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.647+0000 7f284a3e0700 1 --2- 172.21.15.103:0/3991577559 >> v2:172.21.15.86:3300/0 conn(0x7f28440adf50 0x7f28440b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:49.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.647+0000 7f284b3e2700 1 -- 172.21.15.103:0/3991577559 >> v2:172.21.15.86:3300/0 conn(0x7f28440adf50 msgr2=0x7f28440b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:49.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.647+0000 7f284b3e2700 1 --2- 172.21.15.103:0/3991577559 >> v2:172.21.15.86:3300/0 conn(0x7f28440adf50 0x7f28440b1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:49.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.647+0000 7f284b3e2700 1 -- 172.21.15.103:0/3991577559 >> v1:172.21.15.86:6789/0 conn(0x7f2844062170 legacy=0x7f28440b2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:49.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.647+0000 7f284b3e2700 1 -- 172.21.15.103:0/3991577559 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28440b2820 con 0x7f2844152a90 2020-04-22T14:05:49.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.647+0000 7f284b3e2700 1 --2- 172.21.15.103:0/3991577559 >> v2:172.21.15.103:3300/0 conn(0x7f2844152a90 0x7f2844152f00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f28441541f0 tx=0x7f283c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:49.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.647+0000 7f284b3e2700 1 --2- 172.21.15.103:0/3991577559 >> v2:172.21.15.103:3300/0 conn(0x7f2844152a90 0x7f2844152f00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f28441541f0 tx=0x7f283c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:49.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.647+0000 7f284b3e2700 1 --2- 172.21.15.103:0/3991577559 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2844152a90 0x7f2844152f00 secure :-1 s=READY pgs=540 cs=0 l=1 rx=0x7f28441541f0 tx=0x7f283c007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:49.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.647+0000 7f284b3e2700 1 --2- 172.21.15.103:0/3991577559 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2844152a90 0x7f2844152f00 secure :-1 s=THROTTLE_DONE pgs=540 cs=0 l=1 rx=0x7f28441541f0 tx=0x7f283c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:49.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.647+0000 7f283b7fe700 1 -- 172.21.15.103:0/3991577559 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f283c0112e0 con 0x7f2844152a90 2020-04-22T14:05:49.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.647+0000 7f284b3e2700 1 --2- 172.21.15.103:0/3991577559 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2844152a90 0x7f2844152f00 secure :-1 s=THROTTLE_DONE pgs=540 cs=0 l=1 rx=0x7f28441541f0 tx=0x7f283c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:49.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.647+0000 7f284b3e2700 1 --2- 172.21.15.103:0/3991577559 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2844152a90 0x7f2844152f00 secure :-1 s=THROTTLE_DONE pgs=540 cs=0 l=1 rx=0x7f28441541f0 tx=0x7f283c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:49.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.647+0000 7f283b7fe700 1 -- 172.21.15.103:0/3991577559 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f283c011440 con 0x7f2844152a90 2020-04-22T14:05:49.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.647+0000 7f283b7fe700 1 -- 172.21.15.103:0/3991577559 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f283c005a40 con 0x7f2844152a90 2020-04-22T14:05:49.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.647+0000 7f284c644700 1 -- 172.21.15.103:0/3991577559 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28440b2a10 con 0x7f2844152a90 2020-04-22T14:05:49.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.647+0000 7f284c644700 1 -- 172.21.15.103:0/3991577559 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28441537a0 con 0x7f2844152a90 2020-04-22T14:05:49.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.648+0000 7f284b3e2700 1 --2- 172.21.15.103:0/3991577559 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2844152a90 0x7f2844152f00 secure :-1 s=THROTTLE_DONE pgs=540 cs=0 l=1 rx=0x7f28441541f0 tx=0x7f283c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:49.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.648+0000 7f283b7fe700 1 -- 172.21.15.103:0/3991577559 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f283c005cb0 con 0x7f2844152a90 2020-04-22T14:05:49.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.648+0000 7f284b3e2700 1 --2- 172.21.15.103:0/3991577559 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2844152a90 0x7f2844152f00 secure :-1 s=THROTTLE_DONE pgs=540 cs=0 l=1 rx=0x7f28441541f0 tx=0x7f283c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:49.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.648+0000 7f284c644700 1 -- 172.21.15.103:0/3991577559 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2844056c90 con 0x7f2844152a90 2020-04-22T14:05:49.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.649+0000 7f283b7fe700 1 --2- 172.21.15.103:0/3991577559 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f282c04d9d0 0x7f282c04fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:49.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.649+0000 7f283b7fe700 1 -- 172.21.15.103:0/3991577559 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f283c0643b0 con 0x7f2844152a90 2020-04-22T14:05:49.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.649+0000 7f284abe1700 1 --2- 172.21.15.103:0/3991577559 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f282c04d9d0 0x7f282c04fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:49.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.649+0000 7f284abe1700 1 --2- 172.21.15.103:0/3991577559 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f282c04d9d0 0x7f282c04fe90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2844155770 tx=0x7f2840008d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:49.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.649+0000 7f284abe1700 1 --2- 172.21.15.103:0/3991577559 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f282c04d9d0 0x7f282c04fe90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2844155770 tx=0x7f2840008d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:49.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.649+0000 7f284abe1700 1 --2- 172.21.15.103:0/3991577559 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f282c04d9d0 0x7f282c04fe90 secure :-1 s=READY pgs=214 cs=0 l=1 rx=0x7f2844155770 tx=0x7f2840008d10).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:49.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.653+0000 7f284b3e2700 1 --2- 172.21.15.103:0/3991577559 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2844152a90 0x7f2844152f00 secure :-1 s=THROTTLE_DONE pgs=540 cs=0 l=1 rx=0x7f28441541f0 tx=0x7f283c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:49.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.653+0000 7f283b7fe700 1 -- 172.21.15.103:0/3991577559 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f283c03f8b0 con 0x7f2844152a90 2020-04-22T14:05:49.844 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:05:49.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.843+0000 7f284c644700 1 -- 172.21.15.103:0/3991577559 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f2844066710 con 0x7f2844152a90 2020-04-22T14:05:49.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.850+0000 7f284b3e2700 1 --2- 172.21.15.103:0/3991577559 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2844152a90 0x7f2844152f00 secure :-1 s=THROTTLE_DONE pgs=540 cs=0 l=1 rx=0x7f28441541f0 tx=0x7f283c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:49.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.850+0000 7f283b7fe700 1 -- 172.21.15.103:0/3991577559 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v19) v1 ==== 184+0+0 (secure 0 0 0) 0x7f283c042ed0 con 0x7f2844152a90 2020-04-22T14:05:49.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.851+0000 7f284c644700 1 -- 172.21.15.103:0/3991577559 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f282c04d9d0 msgr2=0x7f282c04fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:49.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.851+0000 7f284c644700 1 --2- 172.21.15.103:0/3991577559 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f282c04d9d0 0x7f282c04fe90 secure :-1 s=READY pgs=214 cs=0 l=1 rx=0x7f2844155770 tx=0x7f2840008d10).stop 2020-04-22T14:05:49.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.851+0000 7f284c644700 1 -- 172.21.15.103:0/3991577559 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2844152a90 msgr2=0x7f2844152f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:49.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.851+0000 7f284c644700 1 --2- 172.21.15.103:0/3991577559 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2844152a90 0x7f2844152f00 secure :-1 s=READY pgs=540 cs=0 l=1 rx=0x7f28441541f0 tx=0x7f283c007dc0).stop 2020-04-22T14:05:49.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.851+0000 7f284c644700 1 -- 172.21.15.103:0/3991577559 shutdown_connections 2020-04-22T14:05:49.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.851+0000 7f284c644700 1 --2- 172.21.15.103:0/3991577559 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2844152a90 0x7f2844152f00 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:49.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.851+0000 7f284c644700 1 --2- 172.21.15.103:0/3991577559 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f282c04d9d0 0x7f282c04fe90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:49.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.851+0000 7f284c644700 1 --2- 172.21.15.103:0/3991577559 >> v2:172.21.15.86:3300/0 conn(0x7f28440adf50 0x7f28440b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:49.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.851+0000 7f284c644700 1 -- 172.21.15.103:0/3991577559 >> 172.21.15.103:0/3991577559 conn(0x7f284405ad30 msgr2=0x7f28440b4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:49.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.851+0000 7f284c644700 1 -- 172.21.15.103:0/3991577559 shutdown_connections 2020-04-22T14:05:49.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:49.851+0000 7f284c644700 1 -- 172.21.15.103:0/3991577559 wait complete. 2020-04-22T14:05:49.855 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.2 2020-04-22T14:05:49.861 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:05:49.863 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:49.883 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:05:49.903 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:49.939 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:05:50.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.038+0000 7f57ee793700 1 Processor -- start 2020-04-22T14:05:50.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.038+0000 7f57ee793700 1 -- start start 2020-04-22T14:05:50.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.039+0000 7f57ee793700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f57e80b6600 0x7f57e80b6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:50.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.039+0000 7f57ee793700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57e8025b90 con 0x7f57e80633c0 2020-04-22T14:05:50.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.039+0000 7f57ee793700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57e8066ac0 con 0x7f57e80666e0 2020-04-22T14:05:50.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.039+0000 7f57ee793700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57e8024ea0 con 0x7f57e80b6600 2020-04-22T14:05:50.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.039+0000 7f57edf92700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f57e80666e0 0x7f57e80b9880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41740/0 (socket says 172.21.15.103:41740) 2020-04-22T14:05:50.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.039+0000 7f57edf92700 1 -- 172.21.15.103:0/1453363267 learned_addr learned my addr 172.21.15.103:0/1453363267 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:50.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.039+0000 7f57ecf90700 1 -- 172.21.15.103:0/1453363267 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3756595535 0 0) 0x7f57e8066ac0 con 0x7f57e80666e0 2020-04-22T14:05:50.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.039+0000 7f57ecf90700 1 -- 172.21.15.103:0/1453363267 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57d4003230 con 0x7f57e80666e0 2020-04-22T14:05:50.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.039+0000 7f57ef9f5700 1 --2- 172.21.15.103:0/1453363267 >> v2:172.21.15.86:3300/0 conn(0x7f57e80b6600 0x7f57e80b6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:50.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.039+0000 7f57ecf90700 1 -- 172.21.15.103:0/1453363267 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 256117193 0 0) 0x7f57d4003230 con 0x7f57e80666e0 2020-04-22T14:05:50.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.039+0000 7f57ecf90700 1 -- 172.21.15.103:0/1453363267 >> v2:172.21.15.86:3300/0 conn(0x7f57e80b6600 msgr2=0x7f57e80b6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:50.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.039+0000 7f57ecf90700 1 --2- 172.21.15.103:0/1453363267 >> v2:172.21.15.86:3300/0 conn(0x7f57e80b6600 0x7f57e80b6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:50.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.039+0000 7f57ecf90700 1 -- 172.21.15.103:0/1453363267 >> v1:172.21.15.86:6789/0 conn(0x7f57e80633c0 legacy=0x7f57e80b5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:50.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.039+0000 7f57ecf90700 1 -- 172.21.15.103:0/1453363267 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e8155ff0 con 0x7f57e80666e0 2020-04-22T14:05:50.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.039+0000 7f57ecf90700 1 -- 172.21.15.103:0/1453363267 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f57e40016d0 con 0x7f57e80666e0 2020-04-22T14:05:50.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.039+0000 7f57ecf90700 1 -- 172.21.15.103:0/1453363267 >> v1:172.21.15.103:6789/0 conn(0x7f57e80666e0 legacy=0x7f57e80b9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:50.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.039+0000 7f57ecf90700 1 --2- 172.21.15.103:0/1453363267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57d4003720 0x7f57d4003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:50.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.039+0000 7f57ecf90700 1 --2- 172.21.15.103:0/1453363267 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57d40044d0 0x7f57d4004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:50.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.039+0000 7f57ecf90700 1 --2- 172.21.15.103:0/1453363267 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57d4004db0 0x7f57d400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:50.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.039+0000 7f57ecf90700 1 -- 172.21.15.103:0/1453363267 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e8024ea0 con 0x7f57d4004db0 2020-04-22T14:05:50.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.039+0000 7f57ecf90700 1 -- 172.21.15.103:0/1453363267 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d40041c0 con 0x7f57d4003720 2020-04-22T14:05:50.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.039+0000 7f57ecf90700 1 -- 172.21.15.103:0/1453363267 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d404fb90 con 0x7f57d40044d0 2020-04-22T14:05:50.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.039+0000 7f57edf92700 1 --2- 172.21.15.103:0/1453363267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57d4003720 0x7f57d4003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:50.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.040+0000 7f57ef9f5700 1 --2- 172.21.15.103:0/1453363267 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57d4004db0 0x7f57d400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:50.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.040+0000 7f57ed791700 1 --2- 172.21.15.103:0/1453363267 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57d40044d0 0x7f57d4004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:50.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.040+0000 7f57edf92700 1 -- 172.21.15.103:0/1453363267 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57d40044d0 msgr2=0x7f57d4004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:50.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.040+0000 7f57edf92700 1 --2- 172.21.15.103:0/1453363267 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57d40044d0 0x7f57d4004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:50.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.040+0000 7f57edf92700 1 -- 172.21.15.103:0/1453363267 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57d4004db0 msgr2=0x7f57d400b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:50.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.040+0000 7f57edf92700 1 --2- 172.21.15.103:0/1453363267 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57d4004db0 0x7f57d400b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:50.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.040+0000 7f57edf92700 1 -- 172.21.15.103:0/1453363267 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d4003230 con 0x7f57d4003720 2020-04-22T14:05:50.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.040+0000 7f57ef9f5700 1 --2- 172.21.15.103:0/1453363267 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57d4004db0 0x7f57d400b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:05:50.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.040+0000 7f57ef9f5700 1 -- 172.21.15.103:0/1453363267 reap_dead start 2020-04-22T14:05:50.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.040+0000 7f57edf92700 1 --2- 172.21.15.103:0/1453363267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57d4003720 0x7f57d4003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f57d40054a0 tx=0x7f57e80ba470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:50.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.040+0000 7f57edf92700 1 --2- 172.21.15.103:0/1453363267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57d4003720 0x7f57d4003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f57d40054a0 tx=0x7f57e80ba470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:50.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.040+0000 7f57edf92700 1 --2- 172.21.15.103:0/1453363267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57d4003720 0x7f57d4003b40 secure :-1 s=READY pgs=542 cs=0 l=1 rx=0x7f57d40054a0 tx=0x7f57e80ba470).ready entity=mon.1 client_cookie=234b3e6034abcf40 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:50.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.040+0000 7f57edf92700 1 --2- 172.21.15.103:0/1453363267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57d4003720 0x7f57d4003b40 secure :-1 s=THROTTLE_DONE pgs=542 cs=0 l=1 rx=0x7f57d40054a0 tx=0x7f57e80ba470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:50.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.040+0000 7f57ecf90700 1 -- 172.21.15.103:0/1453363267 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57e400e180 con 0x7f57d4003720 2020-04-22T14:05:50.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.040+0000 7f57edf92700 1 --2- 172.21.15.103:0/1453363267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57d4003720 0x7f57d4003b40 secure :-1 s=THROTTLE_DONE pgs=542 cs=0 l=1 rx=0x7f57d40054a0 tx=0x7f57e80ba470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:50.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.040+0000 7f57edf92700 1 --2- 172.21.15.103:0/1453363267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57d4003720 0x7f57d4003b40 secure :-1 s=THROTTLE_DONE pgs=542 cs=0 l=1 rx=0x7f57d40054a0 tx=0x7f57e80ba470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:50.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.040+0000 7f57ecf90700 1 -- 172.21.15.103:0/1453363267 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e400e320 con 0x7f57d4003720 2020-04-22T14:05:50.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.040+0000 7f57ecf90700 1 -- 172.21.15.103:0/1453363267 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57e40100c0 con 0x7f57d4003720 2020-04-22T14:05:50.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.040+0000 7f57ee793700 1 -- 172.21.15.103:0/1453363267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57d4003720 msgr2=0x7f57d4003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:50.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.040+0000 7f57ee793700 1 --2- 172.21.15.103:0/1453363267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57d4003720 0x7f57d4003b40 secure :-1 s=READY pgs=542 cs=0 l=1 rx=0x7f57d40054a0 tx=0x7f57e80ba470).stop 2020-04-22T14:05:50.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.040+0000 7f57ee793700 1 -- 172.21.15.103:0/1453363267 shutdown_connections 2020-04-22T14:05:50.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.040+0000 7f57ee793700 1 --2- 172.21.15.103:0/1453363267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57d4003720 0x7f57d4003b40 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:50.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.040+0000 7f57ee793700 1 -- 172.21.15.103:0/1453363267 >> 172.21.15.103:0/1453363267 conn(0x7f57e8060930 msgr2=0x7f57e8060d40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:50.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.041+0000 7f57ee793700 1 -- 172.21.15.103:0/1453363267 shutdown_connections 2020-04-22T14:05:50.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.041+0000 7f57ee793700 1 -- 172.21.15.103:0/1453363267 wait complete. 2020-04-22T14:05:50.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.042+0000 7f57ee793700 1 Processor -- start 2020-04-22T14:05:50.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.042+0000 7f57ee793700 1 -- start start 2020-04-22T14:05:50.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.042+0000 7f57ee793700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f57e80b12f0 0x7f57e807fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:50.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.042+0000 7f57ee793700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57e807f750 0x7f57e805b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:50.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.042+0000 7f57ee793700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57e805b4c0 con 0x7f57d4003720 2020-04-22T14:05:50.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.042+0000 7f57ee793700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57e80b31f0 con 0x7f57e80b12f0 2020-04-22T14:05:50.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.042+0000 7f57ee793700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e80b0390 con 0x7f57e807f750 2020-04-22T14:05:50.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.043+0000 7f57ed791700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f57e80b12f0 0x7f57e807fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:50.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.043+0000 7f57ef9f5700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57e807f750 0x7f57e805b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:50.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.043+0000 7f57ed791700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f57e80b12f0 0x7f57e807fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:46796/0 (socket says 172.21.15.103:46796) 2020-04-22T14:05:50.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.043+0000 7f57ed791700 1 -- 172.21.15.103:0/679254573 learned_addr learned my addr 172.21.15.103:0/679254573 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:05:50.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.043+0000 7f57de7fc700 1 -- 172.21.15.103:0/679254573 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1510451626 0 0) 0x7f57d4003230 con 0x7f57d4003720 2020-04-22T14:05:50.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.043+0000 7f57ef9f5700 1 -- 172.21.15.103:0/679254573 >> v2:172.21.15.86:3300/0 conn(0x7f57e80b12f0 msgr2=0x7f57e807fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:50.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.043+0000 7f57ef9f5700 1 --2- 172.21.15.103:0/679254573 >> v2:172.21.15.86:3300/0 conn(0x7f57e80b12f0 0x7f57e807fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:50.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.043+0000 7f57ef9f5700 1 -- 172.21.15.103:0/679254573 >> v1:172.21.15.86:6789/0 conn(0x7f57d4003720 legacy=0x7f57e8121750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:50.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.043+0000 7f57ef9f5700 1 -- 172.21.15.103:0/679254573 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e80b0630 con 0x7f57e807f750 2020-04-22T14:05:50.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.043+0000 7f57ef9f5700 1 --2- 172.21.15.103:0/679254573 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57e807f750 0x7f57e805b060 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f57e8063c20 tx=0x7f57e0010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:50.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.043+0000 7f57ef9f5700 1 --2- 172.21.15.103:0/679254573 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57e807f750 0x7f57e805b060 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f57e8063c20 tx=0x7f57e0010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:50.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.043+0000 7f57ef9f5700 1 --2- 172.21.15.103:0/679254573 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57e807f750 0x7f57e805b060 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f57e8063c20 tx=0x7f57e0010ba0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:50.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.043+0000 7f57ef9f5700 1 --2- 172.21.15.103:0/679254573 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57e807f750 0x7f57e805b060 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f57e8063c20 tx=0x7f57e0010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:50.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.043+0000 7f57de7fc700 1 -- 172.21.15.103:0/679254573 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57e0005e20 con 0x7f57e807f750 2020-04-22T14:05:50.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.043+0000 7f57ef9f5700 1 --2- 172.21.15.103:0/679254573 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57e807f750 0x7f57e805b060 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f57e8063c20 tx=0x7f57e0010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:50.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.043+0000 7f57ee793700 1 -- 172.21.15.103:0/679254573 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57e8121e60 con 0x7f57e807f750 2020-04-22T14:05:50.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.043+0000 7f57de7fc700 1 -- 172.21.15.103:0/679254573 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e0008420 con 0x7f57e807f750 2020-04-22T14:05:50.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.043+0000 7f57ef9f5700 1 --2- 172.21.15.103:0/679254573 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57e807f750 0x7f57e805b060 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f57e8063c20 tx=0x7f57e0010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:50.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.043+0000 7f57de7fc700 1 -- 172.21.15.103:0/679254573 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57e0008780 con 0x7f57e807f750 2020-04-22T14:05:50.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.044+0000 7f57ee793700 1 -- 172.21.15.103:0/679254573 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57e8122300 con 0x7f57e807f750 2020-04-22T14:05:50.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.044+0000 7f57ef9f5700 1 --2- 172.21.15.103:0/679254573 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57e807f750 0x7f57e805b060 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f57e8063c20 tx=0x7f57e0010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:50.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.044+0000 7f57de7fc700 1 -- 172.21.15.103:0/679254573 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f57e00088e0 con 0x7f57e807f750 2020-04-22T14:05:50.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.044+0000 7f57ef9f5700 1 --2- 172.21.15.103:0/679254573 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57e807f750 0x7f57e805b060 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f57e8063c20 tx=0x7f57e0010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:50.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.045+0000 7f57ee793700 1 -- 172.21.15.103:0/679254573 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57e8056c90 con 0x7f57e807f750 2020-04-22T14:05:50.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.045+0000 7f57de7fc700 1 --2- 172.21.15.103:0/679254573 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f57d004d8d0 0x7f57d004fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:50.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.045+0000 7f57de7fc700 1 -- 172.21.15.103:0/679254573 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f57e0060ef0 con 0x7f57e807f750 2020-04-22T14:05:50.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.045+0000 7f57edf92700 1 --2- 172.21.15.103:0/679254573 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f57d004d8d0 0x7f57d004fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:50.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.045+0000 7f57edf92700 1 --2- 172.21.15.103:0/679254573 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f57d004d8d0 0x7f57d004fd90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f57e4001e80 tx=0x7f57e80ba470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:50.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.045+0000 7f57edf92700 1 --2- 172.21.15.103:0/679254573 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f57d004d8d0 0x7f57d004fd90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f57e4001e80 tx=0x7f57e80ba470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:50.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.045+0000 7f57edf92700 1 --2- 172.21.15.103:0/679254573 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f57d004d8d0 0x7f57d004fd90 secure :-1 s=READY pgs=215 cs=0 l=1 rx=0x7f57e4001e80 tx=0x7f57e80ba470).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:50.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.049+0000 7f57ef9f5700 1 --2- 172.21.15.103:0/679254573 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57e807f750 0x7f57e805b060 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f57e8063c20 tx=0x7f57e0010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:50.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.049+0000 7f57de7fc700 1 -- 172.21.15.103:0/679254573 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f57e003c2d0 con 0x7f57e807f750 2020-04-22T14:05:50.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.241+0000 7f57ee793700 1 -- 172.21.15.103:0/679254573 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f57e80ba710 con 0x7f57e807f750 2020-04-22T14:05:50.248 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.246+0000 7f57ef9f5700 1 --2- 172.21.15.103:0/679254573 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57e807f750 0x7f57e805b060 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f57e8063c20 tx=0x7f57e0010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:50.248 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.246+0000 7f57de7fc700 1 -- 172.21.15.103:0/679254573 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v20) v1 ==== 184+0+0 (secure 0 0 0) 0x7f57e003f8f0 con 0x7f57e807f750 2020-04-22T14:05:50.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.248+0000 7f57ee793700 1 -- 172.21.15.103:0/679254573 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f57d004d8d0 msgr2=0x7f57d004fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:50.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.248+0000 7f57ee793700 1 --2- 172.21.15.103:0/679254573 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f57d004d8d0 0x7f57d004fd90 secure :-1 s=READY pgs=215 cs=0 l=1 rx=0x7f57e4001e80 tx=0x7f57e80ba470).stop 2020-04-22T14:05:50.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.248+0000 7f57ee793700 1 -- 172.21.15.103:0/679254573 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57e807f750 msgr2=0x7f57e805b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:50.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.248+0000 7f57ee793700 1 --2- 172.21.15.103:0/679254573 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57e807f750 0x7f57e805b060 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f57e8063c20 tx=0x7f57e0010ba0).stop 2020-04-22T14:05:50.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.248+0000 7f57ee793700 1 -- 172.21.15.103:0/679254573 shutdown_connections 2020-04-22T14:05:50.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.248+0000 7f57ee793700 1 --2- 172.21.15.103:0/679254573 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57e807f750 0x7f57e805b060 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:50.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.248+0000 7f57ee793700 1 --2- 172.21.15.103:0/679254573 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f57d004d8d0 0x7f57d004fd90 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:50.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.248+0000 7f57ee793700 1 --2- 172.21.15.103:0/679254573 >> v2:172.21.15.86:3300/0 conn(0x7f57e80b12f0 0x7f57e807fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:50.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.248+0000 7f57ee793700 1 -- 172.21.15.103:0/679254573 >> 172.21.15.103:0/679254573 conn(0x7f57e8060930 msgr2=0x7f57e80b9880 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:50.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.248+0000 7f57ee793700 1 -- 172.21.15.103:0/679254573 shutdown_connections 2020-04-22T14:05:50.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.248+0000 7f57ee793700 1 -- 172.21.15.103:0/679254573 wait complete. 2020-04-22T14:05:50.252 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.3 2020-04-22T14:05:50.260 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:50.313 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:05:50.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.456+0000 7f5ad24bf700 1 Processor -- start 2020-04-22T14:05:50.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.457+0000 7f5ad24bf700 1 -- start start 2020-04-22T14:05:50.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.457+0000 7f5ad24bf700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5acc0ac740 0x7f5acc066120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:50.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.457+0000 7f5ad24bf700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5acc148270 con 0x7f5acc0620a0 2020-04-22T14:05:50.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.457+0000 7f5ad24bf700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5acc143f10 con 0x7f5acc066580 2020-04-22T14:05:50.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.457+0000 7f5ad24bf700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5acc1441b0 con 0x7f5acc0ac740 2020-04-22T14:05:50.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.458+0000 7f5ad1cbe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f5acc066580 0x7f5acc129a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41762/0 (socket says 172.21.15.103:41762) 2020-04-22T14:05:50.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.458+0000 7f5ad1cbe700 1 -- 172.21.15.103:0/871644268 learned_addr learned my addr 172.21.15.103:0/871644268 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:50.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.458+0000 7f5ad0cbc700 1 --2- 172.21.15.103:0/871644268 >> v2:172.21.15.86:3300/0 conn(0x7f5acc0ac740 0x7f5acc066120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:50.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.458+0000 7f5abffff700 1 -- 172.21.15.103:0/871644268 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3045417162 0 0) 0x7f5acc143f10 con 0x7f5acc066580 2020-04-22T14:05:50.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.458+0000 7f5abffff700 1 -- 172.21.15.103:0/871644268 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ab4003230 con 0x7f5acc066580 2020-04-22T14:05:50.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.458+0000 7f5ad0cbc700 1 -- 172.21.15.103:0/871644268 >> v1:172.21.15.103:6789/0 conn(0x7f5acc066580 legacy=0x7f5acc129a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:50.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.458+0000 7f5ad0cbc700 1 -- 172.21.15.103:0/871644268 >> v1:172.21.15.86:6789/0 conn(0x7f5acc0620a0 legacy=0x7f5acc144650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:50.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.458+0000 7f5abffff700 1 -- 172.21.15.103:0/871644268 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3060604047 0 0) 0x7f5acc148270 con 0x7f5acc0620a0 2020-04-22T14:05:50.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.458+0000 7f5ad0cbc700 1 -- 172.21.15.103:0/871644268 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5acc062480 con 0x7f5acc0ac740 2020-04-22T14:05:50.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.458+0000 7f5ad0cbc700 1 --2- 172.21.15.103:0/871644268 >> v2:172.21.15.86:3300/0 conn(0x7f5acc0ac740 0x7f5acc066120 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5acc144530 tx=0x7f5ac00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:50.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.458+0000 7f5ad0cbc700 1 --2- 172.21.15.103:0/871644268 >> v2:172.21.15.86:3300/0 conn(0x7f5acc0ac740 0x7f5acc066120 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5acc144530 tx=0x7f5ac00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:50.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.458+0000 7f5ad0cbc700 1 --2- 172.21.15.103:0/871644268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5acc0ac740 0x7f5acc066120 secure :-1 s=READY pgs=313 cs=0 l=1 rx=0x7f5acc144530 tx=0x7f5ac00088e0).ready entity=mon.0 client_cookie=a3a901b74abdd8f6 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:50.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.458+0000 7f5ad0cbc700 1 --2- 172.21.15.103:0/871644268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5acc0ac740 0x7f5acc066120 secure :-1 s=THROTTLE_DONE pgs=313 cs=0 l=1 rx=0x7f5acc144530 tx=0x7f5ac00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:50.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.458+0000 7f5abffff700 1 -- 172.21.15.103:0/871644268 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ac0008e40 con 0x7f5acc0ac740 2020-04-22T14:05:50.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.458+0000 7f5ad0cbc700 1 --2- 172.21.15.103:0/871644268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5acc0ac740 0x7f5acc066120 secure :-1 s=THROTTLE_DONE pgs=313 cs=0 l=1 rx=0x7f5acc144530 tx=0x7f5ac00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:50.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.458+0000 7f5ad0cbc700 1 --2- 172.21.15.103:0/871644268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5acc0ac740 0x7f5acc066120 secure :-1 s=THROTTLE_DONE pgs=313 cs=0 l=1 rx=0x7f5acc144530 tx=0x7f5ac00088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:50.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.458+0000 7f5abffff700 1 -- 172.21.15.103:0/871644268 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac00115b0 con 0x7f5acc0ac740 2020-04-22T14:05:50.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.458+0000 7f5abffff700 1 -- 172.21.15.103:0/871644268 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ac0011990 con 0x7f5acc0ac740 2020-04-22T14:05:50.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.458+0000 7f5ad24bf700 1 -- 172.21.15.103:0/871644268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5acc0ac740 msgr2=0x7f5acc066120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:50.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.458+0000 7f5ad24bf700 1 --2- 172.21.15.103:0/871644268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5acc0ac740 0x7f5acc066120 secure :-1 s=READY pgs=313 cs=0 l=1 rx=0x7f5acc144530 tx=0x7f5ac00088e0).stop 2020-04-22T14:05:50.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.459+0000 7f5ad24bf700 1 -- 172.21.15.103:0/871644268 shutdown_connections 2020-04-22T14:05:50.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.459+0000 7f5ad24bf700 1 --2- 172.21.15.103:0/871644268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5acc0ac740 0x7f5acc066120 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:50.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.459+0000 7f5ad24bf700 1 -- 172.21.15.103:0/871644268 >> 172.21.15.103:0/871644268 conn(0x7f5acc05b7c0 msgr2=0x7f5acc061610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:50.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.459+0000 7f5ad24bf700 1 -- 172.21.15.103:0/871644268 shutdown_connections 2020-04-22T14:05:50.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.459+0000 7f5ad24bf700 1 -- 172.21.15.103:0/871644268 wait complete. 2020-04-22T14:05:50.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.460+0000 7f5ad24bf700 1 Processor -- start 2020-04-22T14:05:50.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.460+0000 7f5ad24bf700 1 -- start start 2020-04-22T14:05:50.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.461+0000 7f5ad24bf700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5acc0620a0 0x7f5acc146000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:50.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.461+0000 7f5ad24bf700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5acc0ac740 0x7f5acc12bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:50.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.461+0000 7f5ad24bf700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5acc12c0e0 con 0x7f5acc066580 2020-04-22T14:05:50.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.461+0000 7f5ad24bf700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5acc0b18a0 con 0x7f5acc0620a0 2020-04-22T14:05:50.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.461+0000 7f5ad24bf700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5acc147630 con 0x7f5acc0ac740 2020-04-22T14:05:50.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.461+0000 7f5ad14bd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5acc0620a0 0x7f5acc146000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:50.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.461+0000 7f5ad14bd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5acc0620a0 0x7f5acc146000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49576/0 (socket says 172.21.15.103:49576) 2020-04-22T14:05:50.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.461+0000 7f5ad14bd700 1 -- 172.21.15.103:0/3066524967 learned_addr learned my addr 172.21.15.103:0/3066524967 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:05:50.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.461+0000 7f5ad14bd700 1 -- 172.21.15.103:0/3066524967 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5acc0ac740 msgr2=0x7f5acc12bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:50.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.461+0000 7f5ad14bd700 1 --2- 172.21.15.103:0/3066524967 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5acc0ac740 0x7f5acc12bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:50.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.461+0000 7f5ad14bd700 1 -- 172.21.15.103:0/3066524967 >> v1:172.21.15.86:6789/0 conn(0x7f5acc066580 legacy=0x7f5acc144570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:50.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.461+0000 7f5ad14bd700 1 -- 172.21.15.103:0/3066524967 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5acc0b1a90 con 0x7f5acc0620a0 2020-04-22T14:05:50.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.461+0000 7f5ad14bd700 1 --2- 172.21.15.103:0/3066524967 >> v2:172.21.15.103:3300/0 conn(0x7f5acc0620a0 0x7f5acc146000 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5acc12c530 tx=0x7f5ac8010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:50.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.461+0000 7f5ad14bd700 1 --2- 172.21.15.103:0/3066524967 >> v2:172.21.15.103:3300/0 conn(0x7f5acc0620a0 0x7f5acc146000 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5acc12c530 tx=0x7f5ac8010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:50.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.461+0000 7f5ad14bd700 1 --2- 172.21.15.103:0/3066524967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5acc0620a0 0x7f5acc146000 secure :-1 s=READY pgs=544 cs=0 l=1 rx=0x7f5acc12c530 tx=0x7f5ac8010a10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:50.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.461+0000 7f5ad14bd700 1 --2- 172.21.15.103:0/3066524967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5acc0620a0 0x7f5acc146000 secure :-1 s=THROTTLE_DONE pgs=544 cs=0 l=1 rx=0x7f5acc12c530 tx=0x7f5ac8010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:50.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.461+0000 7f5abe7fc700 1 -- 172.21.15.103:0/3066524967 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ac800cc20 con 0x7f5acc0620a0 2020-04-22T14:05:50.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.461+0000 7f5ad14bd700 1 --2- 172.21.15.103:0/3066524967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5acc0620a0 0x7f5acc146000 secure :-1 s=THROTTLE_DONE pgs=544 cs=0 l=1 rx=0x7f5acc12c530 tx=0x7f5ac8010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:50.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.461+0000 7f5ad24bf700 1 -- 172.21.15.103:0/3066524967 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5acc146f20 con 0x7f5acc0620a0 2020-04-22T14:05:50.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.461+0000 7f5ad14bd700 1 --2- 172.21.15.103:0/3066524967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5acc0620a0 0x7f5acc146000 secure :-1 s=THROTTLE_DONE pgs=544 cs=0 l=1 rx=0x7f5acc12c530 tx=0x7f5ac8010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:50.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.461+0000 7f5abe7fc700 1 -- 172.21.15.103:0/3066524967 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac800cd80 con 0x7f5acc0620a0 2020-04-22T14:05:50.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.461+0000 7f5abe7fc700 1 -- 172.21.15.103:0/3066524967 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ac8012260 con 0x7f5acc0620a0 2020-04-22T14:05:50.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.461+0000 7f5ad24bf700 1 -- 172.21.15.103:0/3066524967 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5acc144c80 con 0x7f5acc0620a0 2020-04-22T14:05:50.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.462+0000 7f5ad14bd700 1 --2- 172.21.15.103:0/3066524967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5acc0620a0 0x7f5acc146000 secure :-1 s=THROTTLE_DONE pgs=544 cs=0 l=1 rx=0x7f5acc12c530 tx=0x7f5ac8010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:50.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.463+0000 7f5abe7fc700 1 -- 172.21.15.103:0/3066524967 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f5ac80064e0 con 0x7f5acc0620a0 2020-04-22T14:05:50.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.463+0000 7f5ad24bf700 1 -- 172.21.15.103:0/3066524967 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5acc147470 con 0x7f5acc0620a0 2020-04-22T14:05:50.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.463+0000 7f5ad14bd700 1 --2- 172.21.15.103:0/3066524967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5acc0620a0 0x7f5acc146000 secure :-1 s=THROTTLE_DONE pgs=544 cs=0 l=1 rx=0x7f5acc12c530 tx=0x7f5ac8010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:50.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.463+0000 7f5abe7fc700 1 --2- 172.21.15.103:0/3066524967 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5aac04d9b0 0x7f5aac04fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:50.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.463+0000 7f5abe7fc700 1 -- 172.21.15.103:0/3066524967 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5ac8060f90 con 0x7f5acc0620a0 2020-04-22T14:05:50.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.463+0000 7f5ad0cbc700 1 --2- 172.21.15.103:0/3066524967 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5aac04d9b0 0x7f5aac04fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:50.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.463+0000 7f5ad0cbc700 1 --2- 172.21.15.103:0/3066524967 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5aac04d9b0 0x7f5aac04fe70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5acc144530 tx=0x7f5acc062610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:50.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.463+0000 7f5ad0cbc700 1 --2- 172.21.15.103:0/3066524967 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5aac04d9b0 0x7f5aac04fe70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5acc144530 tx=0x7f5acc062610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:50.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.463+0000 7f5ad0cbc700 1 --2- 172.21.15.103:0/3066524967 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5aac04d9b0 0x7f5aac04fe70 secure :-1 s=READY pgs=216 cs=0 l=1 rx=0x7f5acc144530 tx=0x7f5acc062610).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:50.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.467+0000 7f5ad14bd700 1 --2- 172.21.15.103:0/3066524967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5acc0620a0 0x7f5acc146000 secure :-1 s=THROTTLE_DONE pgs=544 cs=0 l=1 rx=0x7f5acc12c530 tx=0x7f5ac8010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:50.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.467+0000 7f5abe7fc700 1 -- 172.21.15.103:0/3066524967 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f5ac803c310 con 0x7f5acc0620a0 2020-04-22T14:05:50.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.656+0000 7f5ad24bf700 1 -- 172.21.15.103:0/3066524967 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5acc12c0e0 con 0x7f5acc0620a0 2020-04-22T14:05:50.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.656+0000 7f5ad14bd700 1 --2- 172.21.15.103:0/3066524967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5acc0620a0 0x7f5acc146000 secure :-1 s=THROTTLE_DONE pgs=544 cs=0 l=1 rx=0x7f5acc12c530 tx=0x7f5ac8010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:50.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.656+0000 7f5abe7fc700 1 -- 172.21.15.103:0/3066524967 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+2141 (secure 0 0 0) 0x7f5acc12c0e0 con 0x7f5acc0620a0 2020-04-22T14:05:50.658 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:05:50.659 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":20,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4748,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1859944899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1859944899},{"type":"v1","addr":"172.21.15.86:6835","nonce":1859944899}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:05:45.958513+0000","modified":"2020-04-22T14:05:47.963559+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5491},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5491":{"gid":5491,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/2581125360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2581125360},{"type":"v1","addr":"172.21.15.103:6833","nonce":2581125360}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2020-04-22T14:05:50.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.657+0000 7f5ad24bf700 1 -- 172.21.15.103:0/3066524967 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5aac04d9b0 msgr2=0x7f5aac04fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:50.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.657+0000 7f5ad24bf700 1 --2- 172.21.15.103:0/3066524967 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5aac04d9b0 0x7f5aac04fe70 secure :-1 s=READY pgs=216 cs=0 l=1 rx=0x7f5acc144530 tx=0x7f5acc062610).stop 2020-04-22T14:05:50.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.657+0000 7f5ad24bf700 1 -- 172.21.15.103:0/3066524967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5acc0620a0 msgr2=0x7f5acc146000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:50.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.657+0000 7f5ad24bf700 1 --2- 172.21.15.103:0/3066524967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5acc0620a0 0x7f5acc146000 secure :-1 s=READY pgs=544 cs=0 l=1 rx=0x7f5acc12c530 tx=0x7f5ac8010a10).stop 2020-04-22T14:05:50.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.657+0000 7f5ad24bf700 1 -- 172.21.15.103:0/3066524967 shutdown_connections 2020-04-22T14:05:50.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.657+0000 7f5ad24bf700 1 --2- 172.21.15.103:0/3066524967 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5aac04d9b0 0x7f5aac04fe70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:50.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.657+0000 7f5ad24bf700 1 --2- 172.21.15.103:0/3066524967 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5acc0ac740 0x7f5acc12bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:50.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.657+0000 7f5ad24bf700 1 --2- 172.21.15.103:0/3066524967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5acc0620a0 0x7f5acc146000 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:50.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.657+0000 7f5ad24bf700 1 -- 172.21.15.103:0/3066524967 >> 172.21.15.103:0/3066524967 conn(0x7f5acc05b7c0 msgr2=0x7f5acc0b7800 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:50.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.657+0000 7f5ad24bf700 1 -- 172.21.15.103:0/3066524967 shutdown_connections 2020-04-22T14:05:50.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:50.657+0000 7f5ad24bf700 1 -- 172.21.15.103:0/3066524967 wait complete. 2020-04-22T14:05:50.661 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 20 2020-04-22T14:05:50.871 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 5491}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 7, u'failed': [], u'epoch': 20, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [8], u'info': {u'gid_5491': {u'export_targets': [], u'name': u'a', u'incarnation': 18, u'state_seq': 3, u'state': u'up:active', u'gid': 5491, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 2581125360, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 2581125360, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/2581125360'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:05:45.958513+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:05:47.963559+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:05:50.871 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:05:50.871 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:50.886 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:05:51.045 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:05:51.045 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:05:51.046 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:05:51.046 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 5491, 2020-04-22T14:05:51.046 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:05:51.046 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:05:51.046 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 5.0809561350000001, 2020-04-22T14:05:51.046 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 20, 2020-04-22T14:05:51.046 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 45, 2020-04-22T14:05:51.047 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 45, 2020-04-22T14:05:51.047 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 10.303965025 2020-04-22T14:05:51.047 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:05:51.054 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 5491, "want_state": "up:active", "state": "up:active", "rank_uptime": 5.0809561350000001, "mdsmap_epoch": 20, "osdmap_epoch": 45, "osdmap_epoch_barrier": 45, "uptime": 10.303965025 } 2020-04-22T14:05:51.054 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:51.068 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:05:51.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.213+0000 7f3b3a902700 1 Processor -- start 2020-04-22T14:05:51.216 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.213+0000 7f3b3a902700 1 -- start start 2020-04-22T14:05:51.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.214+0000 7f3b3a902700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3b34140320 0x7f3b340ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:51.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.214+0000 7f3b3a902700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3b3414a2b0 0x7f3b34146cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:51.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.214+0000 7f3b3a902700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3b340bd1b0 0x7f3b340bd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:51.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.214+0000 7f3b3a902700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b3414a710 con 0x7f3b340bd1b0 2020-04-22T14:05:51.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.214+0000 7f3b3a902700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b341462f0 con 0x7f3b3414a2b0 2020-04-22T14:05:51.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.214+0000 7f3b3a902700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b34146590 con 0x7f3b34140320 2020-04-22T14:05:51.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.214+0000 7f3b337fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3b3414a2b0 0x7f3b34146cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:51.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.214+0000 7f3b337fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3b3414a2b0 0x7f3b34146cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49584/0 (socket says 172.21.15.103:49584) 2020-04-22T14:05:51.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.214+0000 7f3b337fe700 1 -- 172.21.15.103:0/1117999003 learned_addr learned my addr 172.21.15.103:0/1117999003 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:05:51.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.214+0000 7f3b337fe700 1 -- 172.21.15.103:0/1117999003 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3b34140320 msgr2=0x7f3b340ae1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:51.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.214+0000 7f3b38e9f700 1 --2- 172.21.15.103:0/1117999003 >> v2:172.21.15.86:3300/0 conn(0x7f3b340bd1b0 0x7f3b340bd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:51.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.214+0000 7f3b337fe700 1 --2- 172.21.15.103:0/1117999003 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3b34140320 0x7f3b340ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:51.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.214+0000 7f3b337fe700 1 -- 172.21.15.103:0/1117999003 >> v2:172.21.15.86:3300/0 conn(0x7f3b340bd1b0 msgr2=0x7f3b340bd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:51.225 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.214+0000 7f3b337fe700 1 --2- 172.21.15.103:0/1117999003 >> v2:172.21.15.86:3300/0 conn(0x7f3b340bd1b0 0x7f3b340bd640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:51.225 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.214+0000 7f3b337fe700 1 -- 172.21.15.103:0/1117999003 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b34146830 con 0x7f3b3414a2b0 2020-04-22T14:05:51.225 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.214+0000 7f3b337fe700 1 --2- 172.21.15.103:0/1117999003 >> v2:172.21.15.103:3300/0 conn(0x7f3b3414a2b0 0x7f3b34146cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3b28002f30 tx=0x7f3b28007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.225 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.214+0000 7f3b337fe700 1 --2- 172.21.15.103:0/1117999003 >> v2:172.21.15.103:3300/0 conn(0x7f3b3414a2b0 0x7f3b34146cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3b28002f30 tx=0x7f3b28007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.225 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.214+0000 7f3b337fe700 1 --2- 172.21.15.103:0/1117999003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b3414a2b0 0x7f3b34146cd0 secure :-1 s=READY pgs=545 cs=0 l=1 rx=0x7f3b28002f30 tx=0x7f3b28007a40).ready entity=mon.1 client_cookie=6c3c8ead46857c46 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:51.225 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.215+0000 7f3b337fe700 1 --2- 172.21.15.103:0/1117999003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b3414a2b0 0x7f3b34146cd0 secure :-1 s=THROTTLE_DONE pgs=545 cs=0 l=1 rx=0x7f3b28002f30 tx=0x7f3b28007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.225 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.215+0000 7f3b32ffd700 1 -- 172.21.15.103:0/1117999003 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b28011720 con 0x7f3b3414a2b0 2020-04-22T14:05:51.226 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.215+0000 7f3b337fe700 1 --2- 172.21.15.103:0/1117999003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b3414a2b0 0x7f3b34146cd0 secure :-1 s=THROTTLE_DONE pgs=545 cs=0 l=1 rx=0x7f3b28002f30 tx=0x7f3b28007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.226 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.215+0000 7f3b337fe700 1 --2- 172.21.15.103:0/1117999003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b3414a2b0 0x7f3b34146cd0 secure :-1 s=THROTTLE_DONE pgs=545 cs=0 l=1 rx=0x7f3b28002f30 tx=0x7f3b28007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.226 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.215+0000 7f3b32ffd700 1 -- 172.21.15.103:0/1117999003 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b28011880 con 0x7f3b3414a2b0 2020-04-22T14:05:51.226 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.215+0000 7f3b32ffd700 1 -- 172.21.15.103:0/1117999003 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b28011ca0 con 0x7f3b3414a2b0 2020-04-22T14:05:51.226 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.215+0000 7f3b3a902700 1 -- 172.21.15.103:0/1117999003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b3414a2b0 msgr2=0x7f3b34146cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:51.226 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.215+0000 7f3b3a902700 1 --2- 172.21.15.103:0/1117999003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b3414a2b0 0x7f3b34146cd0 secure :-1 s=READY pgs=545 cs=0 l=1 rx=0x7f3b28002f30 tx=0x7f3b28007a40).stop 2020-04-22T14:05:51.226 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.215+0000 7f3b3a902700 1 -- 172.21.15.103:0/1117999003 shutdown_connections 2020-04-22T14:05:51.227 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.215+0000 7f3b3a902700 1 --2- 172.21.15.103:0/1117999003 >> v2:172.21.15.86:3300/0 conn(0x7f3b340bd1b0 0x7f3b340bd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:51.227 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.215+0000 7f3b3a902700 1 --2- 172.21.15.103:0/1117999003 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3b34140320 0x7f3b340ae1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:51.227 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.215+0000 7f3b3a902700 1 --2- 172.21.15.103:0/1117999003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b3414a2b0 0x7f3b34146cd0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:51.227 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.215+0000 7f3b3a902700 1 -- 172.21.15.103:0/1117999003 >> 172.21.15.103:0/1117999003 conn(0x7f3b3405f2c0 msgr2=0x7f3b340bcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:51.227 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.215+0000 7f3b3a902700 1 -- 172.21.15.103:0/1117999003 shutdown_connections 2020-04-22T14:05:51.227 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.215+0000 7f3b3a902700 1 -- 172.21.15.103:0/1117999003 wait complete. 2020-04-22T14:05:51.227 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.216+0000 7f3b3a902700 1 Processor -- start 2020-04-22T14:05:51.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.216+0000 7f3b3a902700 1 -- start start 2020-04-22T14:05:51.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.217+0000 7f3b3a902700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3b340bd1b0 0x7f3b340b3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:51.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.217+0000 7f3b3a902700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b340b2b10 con 0x7f3b34140320 2020-04-22T14:05:51.231 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.217+0000 7f3b3a902700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b340b2db0 con 0x7f3b3414a2b0 2020-04-22T14:05:51.231 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.217+0000 7f3b3a902700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b340b0f60 con 0x7f3b340bd1b0 2020-04-22T14:05:51.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.217+0000 7f3b38e9f700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f3b3414a2b0 0x7f3b34140a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41782/0 (socket says 172.21.15.103:41782) 2020-04-22T14:05:51.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.217+0000 7f3b38e9f700 1 -- 172.21.15.103:0/413036311 learned_addr learned my addr 172.21.15.103:0/413036311 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:51.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.217+0000 7f3b33fff700 1 --2- 172.21.15.103:0/413036311 >> v2:172.21.15.86:3300/0 conn(0x7f3b340bd1b0 0x7f3b340b3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:51.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.217+0000 7f3b317fa700 1 -- 172.21.15.103:0/413036311 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3940228410 0 0) 0x7f3b340b2db0 con 0x7f3b3414a2b0 2020-04-22T14:05:51.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.217+0000 7f3b317fa700 1 -- 172.21.15.103:0/413036311 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b14002fe0 con 0x7f3b3414a2b0 2020-04-22T14:05:51.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.218+0000 7f3b317fa700 1 -- 172.21.15.103:0/413036311 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1452425112 0 0) 0x7f3b14002fe0 con 0x7f3b3414a2b0 2020-04-22T14:05:51.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.218+0000 7f3b317fa700 1 -- 172.21.15.103:0/413036311 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3b340b2db0 con 0x7f3b3414a2b0 2020-04-22T14:05:51.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.218+0000 7f3b317fa700 1 -- 172.21.15.103:0/413036311 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f3b2c002a90 con 0x7f3b3414a2b0 2020-04-22T14:05:51.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.218+0000 7f3b317fa700 1 -- 172.21.15.103:0/413036311 >> v2:172.21.15.86:3300/0 conn(0x7f3b340bd1b0 msgr2=0x7f3b340b3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:51.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.218+0000 7f3b317fa700 1 --2- 172.21.15.103:0/413036311 >> v2:172.21.15.86:3300/0 conn(0x7f3b340bd1b0 0x7f3b340b3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:51.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.218+0000 7f3b317fa700 1 -- 172.21.15.103:0/413036311 >> v1:172.21.15.103:6789/0 conn(0x7f3b3414a2b0 legacy=0x7f3b34140a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:51.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.218+0000 7f3b317fa700 1 -- 172.21.15.103:0/413036311 >> v1:172.21.15.86:6789/0 conn(0x7f3b34140320 legacy=0x7f3b3413f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:51.246 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.218+0000 7f3b317fa700 1 --2- 172.21.15.103:0/413036311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b140049b0 0x7f3b14004db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:51.246 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.218+0000 7f3b317fa700 1 --2- 172.21.15.103:0/413036311 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3b14003920 0x7f3b14003d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:51.246 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.218+0000 7f3b317fa700 1 --2- 172.21.15.103:0/413036311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b140041e0 0x7f3b1400b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:51.246 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.218+0000 7f3b317fa700 1 -- 172.21.15.103:0/413036311 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b340b0f60 con 0x7f3b140041e0 2020-04-22T14:05:51.246 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.218+0000 7f3b317fa700 1 -- 172.21.15.103:0/413036311 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b14004690 con 0x7f3b140049b0 2020-04-22T14:05:51.246 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.218+0000 7f3b317fa700 1 -- 172.21.15.103:0/413036311 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1400bbb0 con 0x7f3b14003920 2020-04-22T14:05:51.246 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.218+0000 7f3b33fff700 1 --2- 172.21.15.103:0/413036311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b140049b0 0x7f3b14004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:51.247 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.218+0000 7f3b38e9f700 1 --2- 172.21.15.103:0/413036311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b140041e0 0x7f3b1400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:51.247 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.218+0000 7f3b337fe700 1 --2- 172.21.15.103:0/413036311 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3b14003920 0x7f3b14003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:51.247 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.218+0000 7f3b33fff700 1 -- 172.21.15.103:0/413036311 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3b14003920 msgr2=0x7f3b14003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:51.247 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.218+0000 7f3b33fff700 1 --2- 172.21.15.103:0/413036311 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3b14003920 0x7f3b14003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:51.247 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.218+0000 7f3b33fff700 1 -- 172.21.15.103:0/413036311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b140041e0 msgr2=0x7f3b1400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:51.247 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.218+0000 7f3b33fff700 1 --2- 172.21.15.103:0/413036311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b140041e0 0x7f3b1400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:51.247 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.218+0000 7f3b38e9f700 1 -- 172.21.15.103:0/413036311 reap_dead start 2020-04-22T14:05:51.247 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.218+0000 7f3b33fff700 1 -- 172.21.15.103:0/413036311 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b340b2480 con 0x7f3b140049b0 2020-04-22T14:05:51.248 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.218+0000 7f3b3a902700 1 -- 172.21.15.103:0/413036311 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b340b3250 con 0x7f3b140049b0 2020-04-22T14:05:51.248 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.218+0000 7f3b33fff700 1 --2- 172.21.15.103:0/413036311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b140049b0 0x7f3b14004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3b24002f30 tx=0x7f3b24007d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.248 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.218+0000 7f3b3a902700 1 -- 172.21.15.103:0/413036311 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b34157d20 con 0x7f3b140049b0 2020-04-22T14:05:51.248 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.218+0000 7f3b33fff700 1 --2- 172.21.15.103:0/413036311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b140049b0 0x7f3b14004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3b24002f30 tx=0x7f3b24007d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.248 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.218+0000 7f3b33fff700 1 --2- 172.21.15.103:0/413036311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b140049b0 0x7f3b14004db0 secure :-1 s=READY pgs=547 cs=0 l=1 rx=0x7f3b24002f30 tx=0x7f3b24007d40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:51.248 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.218+0000 7f3b33fff700 1 --2- 172.21.15.103:0/413036311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b140049b0 0x7f3b14004db0 secure :-1 s=THROTTLE_DONE pgs=547 cs=0 l=1 rx=0x7f3b24002f30 tx=0x7f3b24007d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.248 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.218+0000 7f3b33fff700 1 --2- 172.21.15.103:0/413036311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b140049b0 0x7f3b14004db0 secure :-1 s=THROTTLE_DONE pgs=547 cs=0 l=1 rx=0x7f3b24002f30 tx=0x7f3b24007d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.249 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.218+0000 7f3b33fff700 1 --2- 172.21.15.103:0/413036311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b140049b0 0x7f3b14004db0 secure :-1 s=THROTTLE_DONE pgs=547 cs=0 l=1 rx=0x7f3b24002f30 tx=0x7f3b24007d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.249 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.219+0000 7f3b317fa700 1 -- 172.21.15.103:0/413036311 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b24008ab0 con 0x7f3b140049b0 2020-04-22T14:05:51.249 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.219+0000 7f3b317fa700 1 -- 172.21.15.103:0/413036311 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b24000e90 con 0x7f3b140049b0 2020-04-22T14:05:51.249 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.219+0000 7f3b317fa700 1 -- 172.21.15.103:0/413036311 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b24008e00 con 0x7f3b140049b0 2020-04-22T14:05:51.249 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.219+0000 7f3b33fff700 1 --2- 172.21.15.103:0/413036311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b140049b0 0x7f3b14004db0 secure :-1 s=THROTTLE_DONE pgs=547 cs=0 l=1 rx=0x7f3b24002f30 tx=0x7f3b24007d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.249 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.219+0000 7f3b3a902700 1 -- 172.21.15.103:0/413036311 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b10003340 con 0x7f3b140049b0 2020-04-22T14:05:51.249 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.219+0000 7f3b317fa700 1 -- 172.21.15.103:0/413036311 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f3b24012270 con 0x7f3b140049b0 2020-04-22T14:05:51.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.219+0000 7f3b33fff700 1 --2- 172.21.15.103:0/413036311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b140049b0 0x7f3b14004db0 secure :-1 s=THROTTLE_DONE pgs=547 cs=0 l=1 rx=0x7f3b24002f30 tx=0x7f3b24007d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.220+0000 7f3b317fa700 1 --2- 172.21.15.103:0/413036311 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3b14051810 0x7f3b14053cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:51.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.220+0000 7f3b317fa700 1 -- 172.21.15.103:0/413036311 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3b240610a0 con 0x7f3b140049b0 2020-04-22T14:05:51.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.220+0000 7f3b337fe700 1 --2- 172.21.15.103:0/413036311 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3b14051810 0x7f3b14053cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:51.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.220+0000 7f3b337fe700 1 --2- 172.21.15.103:0/413036311 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3b14051810 0x7f3b14053cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3b340b1590 tx=0x7f3b28007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.220+0000 7f3b337fe700 1 --2- 172.21.15.103:0/413036311 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3b14051810 0x7f3b14053cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3b340b1590 tx=0x7f3b28007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.220+0000 7f3b337fe700 1 --2- 172.21.15.103:0/413036311 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3b14051810 0x7f3b14053cd0 secure :-1 s=READY pgs=217 cs=0 l=1 rx=0x7f3b340b1590 tx=0x7f3b28007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:51.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.224+0000 7f3b33fff700 1 --2- 172.21.15.103:0/413036311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b140049b0 0x7f3b14004db0 secure :-1 s=THROTTLE_DONE pgs=547 cs=0 l=1 rx=0x7f3b24002f30 tx=0x7f3b24007d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.224+0000 7f3b317fa700 1 -- 172.21.15.103:0/413036311 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f3b2403c480 con 0x7f3b140049b0 2020-04-22T14:05:51.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.366+0000 7f3b3a902700 1 -- 172.21.15.103:0/413036311 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b100021d0 con 0x7f3b140049b0 2020-04-22T14:05:51.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.367+0000 7f3b33fff700 1 --2- 172.21.15.103:0/413036311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b140049b0 0x7f3b14004db0 secure :-1 s=THROTTLE_DONE pgs=547 cs=0 l=1 rx=0x7f3b24002f30 tx=0x7f3b24007d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.367+0000 7f3b317fa700 1 -- 172.21.15.103:0/413036311 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f3b2403faa0 con 0x7f3b140049b0 2020-04-22T14:05:51.370 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:05:51.370 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":45,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:05:46.962137+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:05:43.875682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2020-04-22T14:05:44.910499+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:05:51.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.369+0000 7f3b3a902700 1 -- 172.21.15.103:0/413036311 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3b14051810 msgr2=0x7f3b14053cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:51.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.369+0000 7f3b3a902700 1 --2- 172.21.15.103:0/413036311 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3b14051810 0x7f3b14053cd0 secure :-1 s=READY pgs=217 cs=0 l=1 rx=0x7f3b340b1590 tx=0x7f3b28007a40).stop 2020-04-22T14:05:51.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.369+0000 7f3b3a902700 1 -- 172.21.15.103:0/413036311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b140049b0 msgr2=0x7f3b14004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:51.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.369+0000 7f3b3a902700 1 --2- 172.21.15.103:0/413036311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b140049b0 0x7f3b14004db0 secure :-1 s=READY pgs=547 cs=0 l=1 rx=0x7f3b24002f30 tx=0x7f3b24007d40).stop 2020-04-22T14:05:51.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.369+0000 7f3b3a902700 1 -- 172.21.15.103:0/413036311 shutdown_connections 2020-04-22T14:05:51.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.369+0000 7f3b3a902700 1 --2- 172.21.15.103:0/413036311 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3b14051810 0x7f3b14053cd0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:51.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.369+0000 7f3b3a902700 1 --2- 172.21.15.103:0/413036311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b140049b0 0x7f3b14004db0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:51.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.369+0000 7f3b3a902700 1 -- 172.21.15.103:0/413036311 >> 172.21.15.103:0/413036311 conn(0x7f3b3405f2c0 msgr2=0x7f3b34148c00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:51.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.369+0000 7f3b3a902700 1 -- 172.21.15.103:0/413036311 shutdown_connections 2020-04-22T14:05:51.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.369+0000 7f3b3a902700 1 -- 172.21.15.103:0/413036311 wait complete. 2020-04-22T14:05:51.383 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:05:43.875682+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 7, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'44', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:05:44.910499+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 8, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'45', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:05:51.383 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:51.398 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:05:51.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.544+0000 7f6eaca0d700 1 Processor -- start 2020-04-22T14:05:51.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.544+0000 7f6eaca0d700 1 -- start start 2020-04-22T14:05:51.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.545+0000 7f6eaca0d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6ea80b8e00 0x7f6ea80af010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:51.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.545+0000 7f6eaca0d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ea80b29b0 con 0x7f6ea805fed0 2020-04-22T14:05:51.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.545+0000 7f6eaca0d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ea80b4270 con 0x7f6ea80b91e0 2020-04-22T14:05:51.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.545+0000 7f6eaca0d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ea80b4510 con 0x7f6ea80b8e00 2020-04-22T14:05:51.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.545+0000 7f6ea6ffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f6ea80b91e0 0x7f6ea8142f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41796/0 (socket says 172.21.15.103:41796) 2020-04-22T14:05:51.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.545+0000 7f6ea6ffd700 1 -- 172.21.15.103:0/2540824071 learned_addr learned my addr 172.21.15.103:0/2540824071 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:51.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.545+0000 7f6ea77fe700 1 --2- 172.21.15.103:0/2540824071 >> v2:172.21.15.86:3300/0 conn(0x7f6ea80b8e00 0x7f6ea80af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:51.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.545+0000 7f6ea67fc700 1 -- 172.21.15.103:0/2540824071 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2688372126 0 0) 0x7f6ea80b4270 con 0x7f6ea80b91e0 2020-04-22T14:05:51.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.545+0000 7f6ea67fc700 1 -- 172.21.15.103:0/2540824071 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e94003230 con 0x7f6ea80b91e0 2020-04-22T14:05:51.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.546+0000 7f6ea67fc700 1 -- 172.21.15.103:0/2540824071 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 306505836 0 0) 0x7f6e94003230 con 0x7f6ea80b91e0 2020-04-22T14:05:51.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.546+0000 7f6ea77fe700 1 -- 172.21.15.103:0/2540824071 >> v1:172.21.15.103:6789/0 conn(0x7f6ea80b91e0 legacy=0x7f6ea8142f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:51.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.546+0000 7f6ea77fe700 1 -- 172.21.15.103:0/2540824071 >> v1:172.21.15.86:6789/0 conn(0x7f6ea805fed0 legacy=0x7f6ea80b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:51.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.546+0000 7f6ea77fe700 1 -- 172.21.15.103:0/2540824071 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea80b22d0 con 0x7f6ea80b8e00 2020-04-22T14:05:51.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.546+0000 7f6ea77fe700 1 --2- 172.21.15.103:0/2540824071 >> v2:172.21.15.86:3300/0 conn(0x7f6ea80b8e00 0x7f6ea80af010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6ea0001450 tx=0x7f6e98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.546+0000 7f6ea77fe700 1 --2- 172.21.15.103:0/2540824071 >> v2:172.21.15.86:3300/0 conn(0x7f6ea80b8e00 0x7f6ea80af010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6ea0001450 tx=0x7f6e98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.546+0000 7f6ea77fe700 1 --2- 172.21.15.103:0/2540824071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ea80b8e00 0x7f6ea80af010 secure :-1 s=READY pgs=317 cs=0 l=1 rx=0x7f6ea0001450 tx=0x7f6e98007a40).ready entity=mon.0 client_cookie=e4fa0467a089f96d server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:51.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.546+0000 7f6ea77fe700 1 --2- 172.21.15.103:0/2540824071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ea80b8e00 0x7f6ea80af010 secure :-1 s=THROTTLE_DONE pgs=317 cs=0 l=1 rx=0x7f6ea0001450 tx=0x7f6e98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.546+0000 7f6ea67fc700 1 -- 172.21.15.103:0/2540824071 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e9c0016d0 con 0x7f6ea80b8e00 2020-04-22T14:05:51.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.546+0000 7f6ea77fe700 1 --2- 172.21.15.103:0/2540824071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ea80b8e00 0x7f6ea80af010 secure :-1 s=THROTTLE_DONE pgs=317 cs=0 l=1 rx=0x7f6ea0001450 tx=0x7f6e98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.546+0000 7f6ea77fe700 1 --2- 172.21.15.103:0/2540824071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ea80b8e00 0x7f6ea80af010 secure :-1 s=THROTTLE_DONE pgs=317 cs=0 l=1 rx=0x7f6ea0001450 tx=0x7f6e98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.546+0000 7f6ea67fc700 1 -- 172.21.15.103:0/2540824071 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e98008b40 con 0x7f6ea80b8e00 2020-04-22T14:05:51.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.546+0000 7f6ea67fc700 1 -- 172.21.15.103:0/2540824071 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e98008ea0 con 0x7f6ea80b8e00 2020-04-22T14:05:51.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.546+0000 7f6eaca0d700 1 -- 172.21.15.103:0/2540824071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ea80b8e00 msgr2=0x7f6ea80af010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:51.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.546+0000 7f6eaca0d700 1 --2- 172.21.15.103:0/2540824071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ea80b8e00 0x7f6ea80af010 secure :-1 s=READY pgs=317 cs=0 l=1 rx=0x7f6ea0001450 tx=0x7f6e98007a40).stop 2020-04-22T14:05:51.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.547+0000 7f6eaca0d700 1 -- 172.21.15.103:0/2540824071 shutdown_connections 2020-04-22T14:05:51.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.547+0000 7f6eaca0d700 1 --2- 172.21.15.103:0/2540824071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ea80b8e00 0x7f6ea80af010 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:51.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.547+0000 7f6eaca0d700 1 -- 172.21.15.103:0/2540824071 >> 172.21.15.103:0/2540824071 conn(0x7f6ea805b780 msgr2=0x7f6ea80b8530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:51.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.547+0000 7f6eaca0d700 1 -- 172.21.15.103:0/2540824071 shutdown_connections 2020-04-22T14:05:51.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.547+0000 7f6eaca0d700 1 -- 172.21.15.103:0/2540824071 wait complete. 2020-04-22T14:05:51.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.548+0000 7f6eaca0d700 1 Processor -- start 2020-04-22T14:05:51.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.548+0000 7f6eaca0d700 1 -- start start 2020-04-22T14:05:51.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.548+0000 7f6eaca0d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6ea80b8e00 0x7f6ea8061950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:51.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.548+0000 7f6eaca0d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ea80b91e0 0x7f6ea8065260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:51.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.548+0000 7f6eaca0d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ea8061db0 con 0x7f6ea805fed0 2020-04-22T14:05:51.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.548+0000 7f6eaca0d700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ea8064880 con 0x7f6ea80b8e00 2020-04-22T14:05:51.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.548+0000 7f6eaca0d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea8064b20 con 0x7f6ea80b91e0 2020-04-22T14:05:51.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.548+0000 7f6ea77fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f6ea805fed0 0x7f6ea8063c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41798/0 (socket says 172.21.15.103:41798) 2020-04-22T14:05:51.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.548+0000 7f6ea77fe700 1 -- 172.21.15.103:0/2565457026 learned_addr learned my addr 172.21.15.103:0/2565457026 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:51.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.548+0000 7f6ea6ffd700 1 --2- 172.21.15.103:0/2565457026 >> v2:172.21.15.103:3300/0 conn(0x7f6ea80b8e00 0x7f6ea8061950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:51.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.549+0000 7f6ea7fff700 1 --2- 172.21.15.103:0/2565457026 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ea80b91e0 0x7f6ea8065260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:51.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.549+0000 7f6ea4ff9700 1 -- 172.21.15.103:0/2565457026 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4039827321 0 0) 0x7f6ea80b22d0 con 0x7f6ea805fed0 2020-04-22T14:05:51.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.549+0000 7f6ea4ff9700 1 -- 172.21.15.103:0/2565457026 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e88002fe0 con 0x7f6ea805fed0 2020-04-22T14:05:51.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.549+0000 7f6ea6ffd700 1 -- 172.21.15.103:0/2565457026 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ea80b91e0 msgr2=0x7f6ea8065260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:51.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.549+0000 7f6ea6ffd700 1 --2- 172.21.15.103:0/2565457026 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ea80b91e0 0x7f6ea8065260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:51.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.549+0000 7f6ea6ffd700 1 -- 172.21.15.103:0/2565457026 >> v1:172.21.15.103:6789/0 conn(0x7f6ea805fed0 legacy=0x7f6ea8063c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:51.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.549+0000 7f6ea6ffd700 1 -- 172.21.15.103:0/2565457026 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea8064dc0 con 0x7f6ea80b8e00 2020-04-22T14:05:51.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.549+0000 7f6ea6ffd700 1 --2- 172.21.15.103:0/2565457026 >> v2:172.21.15.103:3300/0 conn(0x7f6ea80b8e00 0x7f6ea8061950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6e9c001930 tx=0x7f6e9c00c510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.549+0000 7f6ea6ffd700 1 --2- 172.21.15.103:0/2565457026 >> v2:172.21.15.103:3300/0 conn(0x7f6ea80b8e00 0x7f6ea8061950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6e9c001930 tx=0x7f6e9c00c510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.549+0000 7f6ea6ffd700 1 --2- 172.21.15.103:0/2565457026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ea80b8e00 0x7f6ea8061950 secure :-1 s=READY pgs=550 cs=0 l=1 rx=0x7f6e9c001930 tx=0x7f6e9c00c510).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:51.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.549+0000 7f6ea6ffd700 1 --2- 172.21.15.103:0/2565457026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ea80b8e00 0x7f6ea8061950 secure :-1 s=THROTTLE_DONE pgs=550 cs=0 l=1 rx=0x7f6e9c001930 tx=0x7f6e9c00c510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.549+0000 7f6ea4ff9700 1 -- 172.21.15.103:0/2565457026 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e9c00c950 con 0x7f6ea80b8e00 2020-04-22T14:05:51.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.549+0000 7f6ea6ffd700 1 --2- 172.21.15.103:0/2565457026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ea80b8e00 0x7f6ea8061950 secure :-1 s=THROTTLE_DONE pgs=550 cs=0 l=1 rx=0x7f6e9c001930 tx=0x7f6e9c00c510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.549+0000 7f6ea4ff9700 1 -- 172.21.15.103:0/2565457026 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e9c00cab0 con 0x7f6ea80b8e00 2020-04-22T14:05:51.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.549+0000 7f6ea6ffd700 1 --2- 172.21.15.103:0/2565457026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ea80b8e00 0x7f6ea8061950 secure :-1 s=THROTTLE_DONE pgs=550 cs=0 l=1 rx=0x7f6e9c001930 tx=0x7f6e9c00c510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.549+0000 7f6eaca0d700 1 -- 172.21.15.103:0/2565457026 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ea80644e0 con 0x7f6ea80b8e00 2020-04-22T14:05:51.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.549+0000 7f6ea4ff9700 1 -- 172.21.15.103:0/2565457026 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e9c00ce90 con 0x7f6ea80b8e00 2020-04-22T14:05:51.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.549+0000 7f6eaca0d700 1 -- 172.21.15.103:0/2565457026 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ea8065880 con 0x7f6ea80b8e00 2020-04-22T14:05:51.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.550+0000 7f6ea6ffd700 1 --2- 172.21.15.103:0/2565457026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ea80b8e00 0x7f6ea8061950 secure :-1 s=THROTTLE_DONE pgs=550 cs=0 l=1 rx=0x7f6e9c001930 tx=0x7f6e9c00c510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.550+0000 7f6ea4ff9700 1 -- 172.21.15.103:0/2565457026 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f6e9c0044f0 con 0x7f6ea80b8e00 2020-04-22T14:05:51.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.550+0000 7f6ea6ffd700 1 --2- 172.21.15.103:0/2565457026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ea80b8e00 0x7f6ea8061950 secure :-1 s=THROTTLE_DONE pgs=550 cs=0 l=1 rx=0x7f6e9c001930 tx=0x7f6e9c00c510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.550+0000 7f6eaca0d700 1 -- 172.21.15.103:0/2565457026 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ea8056c90 con 0x7f6ea80b8e00 2020-04-22T14:05:51.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.550+0000 7f6ea4ff9700 1 --2- 172.21.15.103:0/2565457026 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6e8804dcc0 0x7f6e88050180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:51.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.550+0000 7f6ea4ff9700 1 -- 172.21.15.103:0/2565457026 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6e9c061310 con 0x7f6ea80b8e00 2020-04-22T14:05:51.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.551+0000 7f6ea77fe700 1 --2- 172.21.15.103:0/2565457026 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6e8804dcc0 0x7f6e88050180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:51.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.551+0000 7f6ea77fe700 1 --2- 172.21.15.103:0/2565457026 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6e8804dcc0 0x7f6e88050180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6e98007fa0 tx=0x7f6e98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.551+0000 7f6ea77fe700 1 --2- 172.21.15.103:0/2565457026 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6e8804dcc0 0x7f6e88050180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6e98007fa0 tx=0x7f6e98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.551+0000 7f6ea77fe700 1 --2- 172.21.15.103:0/2565457026 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6e8804dcc0 0x7f6e88050180 secure :-1 s=READY pgs=218 cs=0 l=1 rx=0x7f6e98007fa0 tx=0x7f6e98007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:51.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.555+0000 7f6ea6ffd700 1 --2- 172.21.15.103:0/2565457026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ea80b8e00 0x7f6ea8061950 secure :-1 s=THROTTLE_DONE pgs=550 cs=0 l=1 rx=0x7f6e9c001930 tx=0x7f6e9c00c510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.555+0000 7f6ea4ff9700 1 -- 172.21.15.103:0/2565457026 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f6e9c03c690 con 0x7f6ea80b8e00 2020-04-22T14:05:51.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.696+0000 7f6eaca0d700 1 -- 172.21.15.103:0/2565457026 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f6ea806a8b0 con 0x7f6ea80b8e00 2020-04-22T14:05:51.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.697+0000 7f6ea6ffd700 1 --2- 172.21.15.103:0/2565457026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ea80b8e00 0x7f6ea8061950 secure :-1 s=THROTTLE_DONE pgs=550 cs=0 l=1 rx=0x7f6e9c001930 tx=0x7f6e9c00c510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.697+0000 7f6ea4ff9700 1 -- 172.21.15.103:0/2565457026 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v45) v1 ==== 110+0+10 (secure 0 0 0) 0x7f6e9c03fcb0 con 0x7f6ea80b8e00 2020-04-22T14:05:51.699 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:05:51.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.698+0000 7f6eaca0d700 1 -- 172.21.15.103:0/2565457026 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6e8804dcc0 msgr2=0x7f6e88050180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:51.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.698+0000 7f6eaca0d700 1 --2- 172.21.15.103:0/2565457026 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6e8804dcc0 0x7f6e88050180 secure :-1 s=READY pgs=218 cs=0 l=1 rx=0x7f6e98007fa0 tx=0x7f6e98007a40).stop 2020-04-22T14:05:51.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.698+0000 7f6eaca0d700 1 -- 172.21.15.103:0/2565457026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ea80b8e00 msgr2=0x7f6ea8061950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:51.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.698+0000 7f6eaca0d700 1 --2- 172.21.15.103:0/2565457026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ea80b8e00 0x7f6ea8061950 secure :-1 s=READY pgs=550 cs=0 l=1 rx=0x7f6e9c001930 tx=0x7f6e9c00c510).stop 2020-04-22T14:05:51.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.698+0000 7f6eaca0d700 1 -- 172.21.15.103:0/2565457026 shutdown_connections 2020-04-22T14:05:51.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.698+0000 7f6eaca0d700 1 --2- 172.21.15.103:0/2565457026 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6e8804dcc0 0x7f6e88050180 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:51.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.698+0000 7f6eaca0d700 1 --2- 172.21.15.103:0/2565457026 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ea80b91e0 0x7f6ea8065260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:51.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.698+0000 7f6eaca0d700 1 --2- 172.21.15.103:0/2565457026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ea80b8e00 0x7f6ea8061950 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:51.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.698+0000 7f6eaca0d700 1 -- 172.21.15.103:0/2565457026 >> 172.21.15.103:0/2565457026 conn(0x7f6ea805b780 msgr2=0x7f6ea8145fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:51.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.698+0000 7f6eaca0d700 1 -- 172.21.15.103:0/2565457026 shutdown_connections 2020-04-22T14:05:51.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.698+0000 7f6eaca0d700 1 -- 172.21.15.103:0/2565457026 wait complete. 2020-04-22T14:05:51.710 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:51.723 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:05:51.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.871+0000 7f27858bc700 1 Processor -- start 2020-04-22T14:05:51.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.871+0000 7f27858bc700 1 -- start start 2020-04-22T14:05:51.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.872+0000 7f27858bc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2780061a30 0x7f27800b4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:51.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.872+0000 7f27858bc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2780141f20 0x7f27801423b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:51.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.872+0000 7f27858bc700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27800af030 con 0x7f27800acb10 2020-04-22T14:05:51.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.872+0000 7f27858bc700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2780060250 con 0x7f2780061a30 2020-04-22T14:05:51.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.872+0000 7f27858bc700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27800623c0 con 0x7f2780141f20 2020-04-22T14:05:51.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.872+0000 7f277f7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2780141f20 0x7f27801423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:51.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.872+0000 7f277f7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2780141f20 0x7f27801423b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49620/0 (socket says 172.21.15.103:49620) 2020-04-22T14:05:51.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.872+0000 7f277e7fc700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f27800acb10 0x7f27800ae920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41808/0 (socket says 172.21.15.103:41808) 2020-04-22T14:05:51.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.872+0000 7f277f7fe700 1 -- 172.21.15.103:0/3559898029 learned_addr learned my addr 172.21.15.103:0/3559898029 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:05:51.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.872+0000 7f277effd700 1 --2- 172.21.15.103:0/3559898029 >> v2:172.21.15.86:3300/0 conn(0x7f2780061a30 0x7f27800b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:51.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.872+0000 7f277f7fe700 1 -- 172.21.15.103:0/3559898029 >> v2:172.21.15.86:3300/0 conn(0x7f2780061a30 msgr2=0x7f27800b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:51.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.872+0000 7f277f7fe700 1 --2- 172.21.15.103:0/3559898029 >> v2:172.21.15.86:3300/0 conn(0x7f2780061a30 0x7f27800b4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:51.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.872+0000 7f277f7fe700 1 -- 172.21.15.103:0/3559898029 >> v1:172.21.15.103:6789/0 conn(0x7f27800acb10 legacy=0x7f27800ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:51.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.872+0000 7f277f7fe700 1 -- 172.21.15.103:0/3559898029 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2780062660 con 0x7f2780141f20 2020-04-22T14:05:51.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.872+0000 7f277dffb700 1 -- 172.21.15.103:0/3559898029 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3943513530 0 0) 0x7f27800af030 con 0x7f27800acb10 2020-04-22T14:05:51.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.872+0000 7f277f7fe700 1 --2- 172.21.15.103:0/3559898029 >> v2:172.21.15.103:3300/0 conn(0x7f2780141f20 0x7f27801423b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f27780032b0 tx=0x7f2778007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.872+0000 7f277f7fe700 1 --2- 172.21.15.103:0/3559898029 >> v2:172.21.15.103:3300/0 conn(0x7f2780141f20 0x7f27801423b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f27780032b0 tx=0x7f2778007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.872+0000 7f277f7fe700 1 --2- 172.21.15.103:0/3559898029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2780141f20 0x7f27801423b0 secure :-1 s=READY pgs=552 cs=0 l=1 rx=0x7f27780032b0 tx=0x7f2778007dc0).ready entity=mon.1 client_cookie=b739ebe41a76a50a server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:51.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.872+0000 7f277f7fe700 1 --2- 172.21.15.103:0/3559898029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2780141f20 0x7f27801423b0 secure :-1 s=THROTTLE_DONE pgs=552 cs=0 l=1 rx=0x7f27780032b0 tx=0x7f2778007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.872+0000 7f277dffb700 1 -- 172.21.15.103:0/3559898029 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f277800a180 con 0x7f2780141f20 2020-04-22T14:05:51.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.872+0000 7f277f7fe700 1 --2- 172.21.15.103:0/3559898029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2780141f20 0x7f27801423b0 secure :-1 s=THROTTLE_DONE pgs=552 cs=0 l=1 rx=0x7f27780032b0 tx=0x7f2778007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.872+0000 7f277dffb700 1 -- 172.21.15.103:0/3559898029 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277800a2e0 con 0x7f2780141f20 2020-04-22T14:05:51.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.872+0000 7f277f7fe700 1 --2- 172.21.15.103:0/3559898029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2780141f20 0x7f27801423b0 secure :-1 s=THROTTLE_DONE pgs=552 cs=0 l=1 rx=0x7f27780032b0 tx=0x7f2778007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.872+0000 7f277dffb700 1 -- 172.21.15.103:0/3559898029 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f277800a6c0 con 0x7f2780141f20 2020-04-22T14:05:51.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.872+0000 7f27858bc700 1 -- 172.21.15.103:0/3559898029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2780141f20 msgr2=0x7f27801423b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:51.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.872+0000 7f27858bc700 1 --2- 172.21.15.103:0/3559898029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2780141f20 0x7f27801423b0 secure :-1 s=READY pgs=552 cs=0 l=1 rx=0x7f27780032b0 tx=0x7f2778007dc0).stop 2020-04-22T14:05:51.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.873+0000 7f27858bc700 1 -- 172.21.15.103:0/3559898029 shutdown_connections 2020-04-22T14:05:51.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.873+0000 7f27858bc700 1 --2- 172.21.15.103:0/3559898029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2780141f20 0x7f27801423b0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:51.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.873+0000 7f27858bc700 1 --2- 172.21.15.103:0/3559898029 >> v2:172.21.15.86:3300/0 conn(0x7f2780061a30 0x7f27800b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:51.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.873+0000 7f27858bc700 1 -- 172.21.15.103:0/3559898029 >> 172.21.15.103:0/3559898029 conn(0x7f278005b7b0 msgr2=0x7f27800b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:51.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.873+0000 7f27858bc700 1 -- 172.21.15.103:0/3559898029 shutdown_connections 2020-04-22T14:05:51.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.873+0000 7f27858bc700 1 -- 172.21.15.103:0/3559898029 wait complete. 2020-04-22T14:05:51.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.874+0000 7f27858bc700 1 Processor -- start 2020-04-22T14:05:51.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.874+0000 7f27858bc700 1 -- start start 2020-04-22T14:05:51.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.875+0000 7f27858bc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f27800acb10 0x7f27801448c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:51.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.875+0000 7f27858bc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2780141f20 0x7f2780141620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:51.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.875+0000 7f27858bc700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2780144d20 con 0x7f2780061a30 2020-04-22T14:05:51.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.875+0000 7f27858bc700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27801556e0 con 0x7f2780141f20 2020-04-22T14:05:51.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.875+0000 7f27858bc700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f278013c900 con 0x7f27800acb10 2020-04-22T14:05:51.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.875+0000 7f277effd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f2780061a30 0x7f2780063b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41812/0 (socket says 172.21.15.103:41812) 2020-04-22T14:05:51.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.875+0000 7f277e7fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f27800acb10 0x7f27801448c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:51.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.875+0000 7f277effd700 1 -- 172.21.15.103:0/250707711 learned_addr learned my addr 172.21.15.103:0/250707711 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:51.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.875+0000 7f277f7fe700 1 --2- 172.21.15.103:0/250707711 >> v2:172.21.15.86:3300/0 conn(0x7f2780141f20 0x7f2780141620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:51.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.875+0000 7f277e7fc700 1 -- 172.21.15.103:0/250707711 >> v2:172.21.15.86:3300/0 conn(0x7f2780141f20 msgr2=0x7f2780141620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:51.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.875+0000 7f277e7fc700 1 --2- 172.21.15.103:0/250707711 >> v2:172.21.15.86:3300/0 conn(0x7f2780141f20 0x7f2780141620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:51.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.875+0000 7f277e7fc700 1 -- 172.21.15.103:0/250707711 >> v1:172.21.15.103:6789/0 conn(0x7f2780061a30 legacy=0x7f2780063b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:51.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.875+0000 7f2777fff700 1 -- 172.21.15.103:0/250707711 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3604623045 0 0) 0x7f2768001f40 con 0x7f2780061a30 2020-04-22T14:05:51.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.875+0000 7f277e7fc700 1 -- 172.21.15.103:0/250707711 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2780141a80 con 0x7f27800acb10 2020-04-22T14:05:51.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.875+0000 7f277e7fc700 1 --2- 172.21.15.103:0/250707711 >> v2:172.21.15.103:3300/0 conn(0x7f27800acb10 0x7f27801448c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2770000b80 tx=0x7f2770001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.875+0000 7f277e7fc700 1 --2- 172.21.15.103:0/250707711 >> v2:172.21.15.103:3300/0 conn(0x7f27800acb10 0x7f27801448c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2770000b80 tx=0x7f2770001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.875+0000 7f277e7fc700 1 --2- 172.21.15.103:0/250707711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27800acb10 0x7f27801448c0 secure :-1 s=READY pgs=554 cs=0 l=1 rx=0x7f2770000b80 tx=0x7f2770001e40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:51.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.875+0000 7f277e7fc700 1 --2- 172.21.15.103:0/250707711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27800acb10 0x7f27801448c0 secure :-1 s=THROTTLE_DONE pgs=554 cs=0 l=1 rx=0x7f2770000b80 tx=0x7f2770001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.875+0000 7f2777fff700 1 -- 172.21.15.103:0/250707711 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f277000c970 con 0x7f27800acb10 2020-04-22T14:05:51.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.875+0000 7f277e7fc700 1 --2- 172.21.15.103:0/250707711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27800acb10 0x7f27801448c0 secure :-1 s=THROTTLE_DONE pgs=554 cs=0 l=1 rx=0x7f2770000b80 tx=0x7f2770001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.875+0000 7f277e7fc700 1 --2- 172.21.15.103:0/250707711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27800acb10 0x7f27801448c0 secure :-1 s=THROTTLE_DONE pgs=554 cs=0 l=1 rx=0x7f2770000b80 tx=0x7f2770001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.875+0000 7f2777fff700 1 -- 172.21.15.103:0/250707711 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277000cad0 con 0x7f27800acb10 2020-04-22T14:05:51.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.875+0000 7f27858bc700 1 -- 172.21.15.103:0/250707711 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27801553d0 con 0x7f27800acb10 2020-04-22T14:05:51.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.875+0000 7f2777fff700 1 -- 172.21.15.103:0/250707711 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f277000ce70 con 0x7f27800acb10 2020-04-22T14:05:51.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.875+0000 7f27858bc700 1 -- 172.21.15.103:0/250707711 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2780139d00 con 0x7f27800acb10 2020-04-22T14:05:51.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.876+0000 7f277e7fc700 1 --2- 172.21.15.103:0/250707711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27800acb10 0x7f27801448c0 secure :-1 s=THROTTLE_DONE pgs=554 cs=0 l=1 rx=0x7f2770000b80 tx=0x7f2770001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.876+0000 7f27858bc700 1 -- 172.21.15.103:0/250707711 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2780056c90 con 0x7f27800acb10 2020-04-22T14:05:51.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.876+0000 7f2777fff700 1 -- 172.21.15.103:0/250707711 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f27700044f0 con 0x7f27800acb10 2020-04-22T14:05:51.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.876+0000 7f277e7fc700 1 --2- 172.21.15.103:0/250707711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27800acb10 0x7f27801448c0 secure :-1 s=THROTTLE_DONE pgs=554 cs=0 l=1 rx=0x7f2770000b80 tx=0x7f2770001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.877+0000 7f2777fff700 1 --2- 172.21.15.103:0/250707711 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f276404d890 0x7f276404fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:51.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.877+0000 7f2777fff700 1 -- 172.21.15.103:0/250707711 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2770060dd0 con 0x7f27800acb10 2020-04-22T14:05:51.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.877+0000 7f277effd700 1 --2- 172.21.15.103:0/250707711 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f276404d890 0x7f276404fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:51.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.877+0000 7f277effd700 1 --2- 172.21.15.103:0/250707711 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f276404d890 0x7f276404fd50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2768007a40 tx=0x7f27680024f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.877+0000 7f277effd700 1 --2- 172.21.15.103:0/250707711 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f276404d890 0x7f276404fd50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2768007a40 tx=0x7f27680024f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.877+0000 7f277effd700 1 --2- 172.21.15.103:0/250707711 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f276404d890 0x7f276404fd50 secure :-1 s=READY pgs=219 cs=0 l=1 rx=0x7f2768007a40 tx=0x7f27680024f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:51.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.881+0000 7f277e7fc700 1 --2- 172.21.15.103:0/250707711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27800acb10 0x7f27801448c0 secure :-1 s=THROTTLE_DONE pgs=554 cs=0 l=1 rx=0x7f2770000b80 tx=0x7f2770001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:51.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:51.881+0000 7f2777fff700 1 -- 172.21.15.103:0/250707711 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f277003c210 con 0x7f27800acb10 2020-04-22T14:05:52.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.024+0000 7f27858bc700 1 -- 172.21.15.103:0/250707711 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f278013ca40 con 0x7f27800acb10 2020-04-22T14:05:52.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.024+0000 7f277e7fc700 1 --2- 172.21.15.103:0/250707711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27800acb10 0x7f27801448c0 secure :-1 s=THROTTLE_DONE pgs=554 cs=0 l=1 rx=0x7f2770000b80 tx=0x7f2770001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.024+0000 7f2777fff700 1 -- 172.21.15.103:0/250707711 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v45) v1 ==== 92+0+10 (secure 0 0 0) 0x7f277003f830 con 0x7f27800acb10 2020-04-22T14:05:52.026 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:05:52.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.025+0000 7f27858bc700 1 -- 172.21.15.103:0/250707711 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f276404d890 msgr2=0x7f276404fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:52.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.025+0000 7f27858bc700 1 --2- 172.21.15.103:0/250707711 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f276404d890 0x7f276404fd50 secure :-1 s=READY pgs=219 cs=0 l=1 rx=0x7f2768007a40 tx=0x7f27680024f0).stop 2020-04-22T14:05:52.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.025+0000 7f27858bc700 1 -- 172.21.15.103:0/250707711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27800acb10 msgr2=0x7f27801448c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:52.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.025+0000 7f27858bc700 1 --2- 172.21.15.103:0/250707711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27800acb10 0x7f27801448c0 secure :-1 s=READY pgs=554 cs=0 l=1 rx=0x7f2770000b80 tx=0x7f2770001e40).stop 2020-04-22T14:05:52.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.025+0000 7f27858bc700 1 -- 172.21.15.103:0/250707711 shutdown_connections 2020-04-22T14:05:52.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.025+0000 7f27858bc700 1 --2- 172.21.15.103:0/250707711 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f276404d890 0x7f276404fd50 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:52.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.025+0000 7f27858bc700 1 --2- 172.21.15.103:0/250707711 >> v2:172.21.15.86:3300/0 conn(0x7f2780141f20 0x7f2780141620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:52.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.025+0000 7f27858bc700 1 --2- 172.21.15.103:0/250707711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27800acb10 0x7f27801448c0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:52.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.025+0000 7f27858bc700 1 -- 172.21.15.103:0/250707711 >> 172.21.15.103:0/250707711 conn(0x7f278005b7b0 msgr2=0x7f27800b5000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:52.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.025+0000 7f27858bc700 1 -- 172.21.15.103:0/250707711 shutdown_connections 2020-04-22T14:05:52.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.025+0000 7f27858bc700 1 -- 172.21.15.103:0/250707711 wait complete. 2020-04-22T14:05:52.038 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:52.051 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-22T14:05:52.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.197+0000 7f44cc1b6700 1 Processor -- start 2020-04-22T14:05:52.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.197+0000 7f44cc1b6700 1 -- start start 2020-04-22T14:05:52.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.198+0000 7f44cc1b6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f44c4145ff0 0x7f44c41464a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:52.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.198+0000 7f44cc1b6700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44c40b4420 con 0x7f44c40b6180 2020-04-22T14:05:52.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.198+0000 7f44cc1b6700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44c41498e0 con 0x7f44c40b9670 2020-04-22T14:05:52.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.198+0000 7f44cc1b6700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c4149b80 con 0x7f44c4145ff0 2020-04-22T14:05:52.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.198+0000 7f44c9f52700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f44c40b9670 0x7f44c414a020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41822/0 (socket says 172.21.15.103:41822) 2020-04-22T14:05:52.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.198+0000 7f44c9f52700 1 -- 172.21.15.103:0/600586067 learned_addr learned my addr 172.21.15.103:0/600586067 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:52.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.198+0000 7f44ca753700 1 --2- 172.21.15.103:0/600586067 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f44c4145ff0 0x7f44c41464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:52.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.199+0000 7f44c8f50700 1 -- 172.21.15.103:0/600586067 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1780586931 0 0) 0x7f44c41498e0 con 0x7f44c40b9670 2020-04-22T14:05:52.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.199+0000 7f44c8f50700 1 -- 172.21.15.103:0/600586067 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44ac003230 con 0x7f44c40b9670 2020-04-22T14:05:52.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.199+0000 7f44c8f50700 1 -- 172.21.15.103:0/600586067 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3950613112 0 0) 0x7f44c40b4420 con 0x7f44c40b6180 2020-04-22T14:05:52.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.199+0000 7f44c8f50700 1 -- 172.21.15.103:0/600586067 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44c41498e0 con 0x7f44c40b6180 2020-04-22T14:05:52.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.199+0000 7f44ca753700 1 -- 172.21.15.103:0/600586067 >> v1:172.21.15.103:6789/0 conn(0x7f44c40b9670 legacy=0x7f44c414a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:52.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.199+0000 7f44ca753700 1 -- 172.21.15.103:0/600586067 >> v1:172.21.15.86:6789/0 conn(0x7f44c40b6180 legacy=0x7f44c41458e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:52.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.199+0000 7f44ca753700 1 -- 172.21.15.103:0/600586067 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c40b9a50 con 0x7f44c4145ff0 2020-04-22T14:05:52.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.199+0000 7f44ca753700 1 --2- 172.21.15.103:0/600586067 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f44c4145ff0 0x7f44c41464a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f44bc0032b0 tx=0x7f44bc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.199+0000 7f44ca753700 1 --2- 172.21.15.103:0/600586067 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f44c4145ff0 0x7f44c41464a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f44bc0032b0 tx=0x7f44bc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.199+0000 7f44ca753700 1 --2- 172.21.15.103:0/600586067 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f44c4145ff0 0x7f44c41464a0 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f44bc0032b0 tx=0x7f44bc008c60).ready entity=mon.2 client_cookie=355f127193ec235a server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:52.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.199+0000 7f44ca753700 1 --2- 172.21.15.103:0/600586067 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f44c4145ff0 0x7f44c41464a0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f44bc0032b0 tx=0x7f44bc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.199+0000 7f44c8f50700 1 -- 172.21.15.103:0/600586067 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44bc011db0 con 0x7f44c4145ff0 2020-04-22T14:05:52.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.199+0000 7f44ca753700 1 --2- 172.21.15.103:0/600586067 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f44c4145ff0 0x7f44c41464a0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f44bc0032b0 tx=0x7f44bc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.199+0000 7f44c8f50700 1 -- 172.21.15.103:0/600586067 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44bc00a180 con 0x7f44c4145ff0 2020-04-22T14:05:52.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.199+0000 7f44ca753700 1 --2- 172.21.15.103:0/600586067 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f44c4145ff0 0x7f44c41464a0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f44bc0032b0 tx=0x7f44bc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.199+0000 7f44c8f50700 1 -- 172.21.15.103:0/600586067 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44bc00a520 con 0x7f44c4145ff0 2020-04-22T14:05:52.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.199+0000 7f44cc1b6700 1 -- 172.21.15.103:0/600586067 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f44c4145ff0 msgr2=0x7f44c41464a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:52.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.199+0000 7f44cc1b6700 1 --2- 172.21.15.103:0/600586067 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f44c4145ff0 0x7f44c41464a0 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f44bc0032b0 tx=0x7f44bc008c60).stop 2020-04-22T14:05:52.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.200+0000 7f44cc1b6700 1 -- 172.21.15.103:0/600586067 shutdown_connections 2020-04-22T14:05:52.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.200+0000 7f44cc1b6700 1 --2- 172.21.15.103:0/600586067 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f44c4145ff0 0x7f44c41464a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:52.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.200+0000 7f44cc1b6700 1 -- 172.21.15.103:0/600586067 >> 172.21.15.103:0/600586067 conn(0x7f44c405ad30 msgr2=0x7f44c405b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:52.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.200+0000 7f44cc1b6700 1 -- 172.21.15.103:0/600586067 shutdown_connections 2020-04-22T14:05:52.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.200+0000 7f44cc1b6700 1 -- 172.21.15.103:0/600586067 wait complete. 2020-04-22T14:05:52.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.201+0000 7f44cc1b6700 1 Processor -- start 2020-04-22T14:05:52.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.201+0000 7f44cc1b6700 1 -- start start 2020-04-22T14:05:52.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.201+0000 7f44cc1b6700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f44c40b6180 0x7f44c4066740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:52.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.201+0000 7f44cc1b6700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44c4144860 con 0x7f44c4145ff0 2020-04-22T14:05:52.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.201+0000 7f44cc1b6700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44c4144b00 con 0x7f44c40b9670 2020-04-22T14:05:52.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.201+0000 7f44cc1b6700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44c4153b30 con 0x7f44c40b6180 2020-04-22T14:05:52.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.201+0000 7f44c9751700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f44c40b9670 0x7f44c4143f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41826/0 (socket says 172.21.15.103:41826) 2020-04-22T14:05:52.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.201+0000 7f44c9751700 1 -- 172.21.15.103:0/2600737429 learned_addr learned my addr 172.21.15.103:0/2600737429 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:52.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.201+0000 7f44c9f52700 1 --2- 172.21.15.103:0/2600737429 >> v2:172.21.15.86:3300/0 conn(0x7f44c40b6180 0x7f44c4066740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:52.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.202+0000 7f44b6ffd700 1 -- 172.21.15.103:0/2600737429 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1492670442 0 0) 0x7f44c4144b00 con 0x7f44c40b9670 2020-04-22T14:05:52.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.202+0000 7f44b6ffd700 1 -- 172.21.15.103:0/2600737429 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44a4002fe0 con 0x7f44c40b9670 2020-04-22T14:05:52.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.202+0000 7f44c9f52700 1 -- 172.21.15.103:0/2600737429 >> v1:172.21.15.103:6789/0 conn(0x7f44c40b9670 legacy=0x7f44c4143f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:52.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.202+0000 7f44b6ffd700 1 -- 172.21.15.103:0/2600737429 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1897766877 0 0) 0x7f44c4144860 con 0x7f44c4145ff0 2020-04-22T14:05:52.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.202+0000 7f44c9f52700 1 -- 172.21.15.103:0/2600737429 >> v1:172.21.15.86:6789/0 conn(0x7f44c4145ff0 legacy=0x7f44c41570f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:52.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.202+0000 7f44c9f52700 1 -- 172.21.15.103:0/2600737429 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c40adfd0 con 0x7f44c40b6180 2020-04-22T14:05:52.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.202+0000 7f44c9f52700 1 --2- 172.21.15.103:0/2600737429 >> v2:172.21.15.86:3300/0 conn(0x7f44c40b6180 0x7f44c4066740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f44c40ae8f0 tx=0x7f44c0010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.202+0000 7f44c9f52700 1 --2- 172.21.15.103:0/2600737429 >> v2:172.21.15.86:3300/0 conn(0x7f44c40b6180 0x7f44c4066740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f44c40ae8f0 tx=0x7f44c0010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.202+0000 7f44c9f52700 1 --2- 172.21.15.103:0/2600737429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44c40b6180 0x7f44c4066740 secure :-1 s=READY pgs=320 cs=0 l=1 rx=0x7f44c40ae8f0 tx=0x7f44c0010830).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:52.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.202+0000 7f44c9f52700 1 --2- 172.21.15.103:0/2600737429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44c40b6180 0x7f44c4066740 secure :-1 s=THROTTLE_DONE pgs=320 cs=0 l=1 rx=0x7f44c40ae8f0 tx=0x7f44c0010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.202+0000 7f44b6ffd700 1 -- 172.21.15.103:0/2600737429 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44c0005bc0 con 0x7f44c40b6180 2020-04-22T14:05:52.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.202+0000 7f44c9f52700 1 --2- 172.21.15.103:0/2600737429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44c40b6180 0x7f44c4066740 secure :-1 s=THROTTLE_DONE pgs=320 cs=0 l=1 rx=0x7f44c40ae8f0 tx=0x7f44c0010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.202+0000 7f44c9f52700 1 --2- 172.21.15.103:0/2600737429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44c40b6180 0x7f44c4066740 secure :-1 s=THROTTLE_DONE pgs=320 cs=0 l=1 rx=0x7f44c40ae8f0 tx=0x7f44c0010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.202+0000 7f44b6ffd700 1 -- 172.21.15.103:0/2600737429 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c0005d20 con 0x7f44c40b6180 2020-04-22T14:05:52.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.202+0000 7f44cc1b6700 1 -- 172.21.15.103:0/2600737429 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44c4155010 con 0x7f44c40b6180 2020-04-22T14:05:52.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.202+0000 7f44b6ffd700 1 -- 172.21.15.103:0/2600737429 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44c0005e90 con 0x7f44c40b6180 2020-04-22T14:05:52.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.202+0000 7f44cc1b6700 1 -- 172.21.15.103:0/2600737429 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44c4157a40 con 0x7f44c40b6180 2020-04-22T14:05:52.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.203+0000 7f44c9f52700 1 --2- 172.21.15.103:0/2600737429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44c40b6180 0x7f44c4066740 secure :-1 s=THROTTLE_DONE pgs=320 cs=0 l=1 rx=0x7f44c40ae8f0 tx=0x7f44c0010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.203+0000 7f44cc1b6700 1 -- 172.21.15.103:0/2600737429 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44c41552f0 con 0x7f44c40b6180 2020-04-22T14:05:52.214 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.203+0000 7f44b6ffd700 1 -- 172.21.15.103:0/2600737429 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f44c000a360 con 0x7f44c40b6180 2020-04-22T14:05:52.214 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.203+0000 7f44c9f52700 1 --2- 172.21.15.103:0/2600737429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44c40b6180 0x7f44c4066740 secure :-1 s=THROTTLE_DONE pgs=320 cs=0 l=1 rx=0x7f44c40ae8f0 tx=0x7f44c0010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.214 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.204+0000 7f44b6ffd700 1 --2- 172.21.15.103:0/2600737429 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f44a404dc70 0x7f44a4050130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:52.214 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.204+0000 7f44b6ffd700 1 -- 172.21.15.103:0/2600737429 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f44c00090c0 con 0x7f44c40b6180 2020-04-22T14:05:52.214 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.204+0000 7f44c9751700 1 --2- 172.21.15.103:0/2600737429 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f44a404dc70 0x7f44a4050130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:52.214 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.204+0000 7f44c9751700 1 --2- 172.21.15.103:0/2600737429 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f44a404dc70 0x7f44a4050130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f44b8001750 tx=0x7f44b800cb40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.204+0000 7f44c9751700 1 --2- 172.21.15.103:0/2600737429 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f44a404dc70 0x7f44a4050130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f44b8001750 tx=0x7f44b800cb40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.204+0000 7f44c9751700 1 --2- 172.21.15.103:0/2600737429 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f44a404dc70 0x7f44a4050130 secure :-1 s=READY pgs=220 cs=0 l=1 rx=0x7f44b8001750 tx=0x7f44b800cb40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:52.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.207+0000 7f44c9f52700 1 --2- 172.21.15.103:0/2600737429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44c40b6180 0x7f44c4066740 secure :-1 s=THROTTLE_DONE pgs=320 cs=0 l=1 rx=0x7f44c40ae8f0 tx=0x7f44c0010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.207+0000 7f44b6ffd700 1 -- 172.21.15.103:0/2600737429 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f44c41552f0 con 0x7f44c40b6180 2020-04-22T14:05:52.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.351+0000 7f44cc1b6700 1 -- 172.21.15.103:0/2600737429 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f44c40ae160 con 0x7f44c40b6180 2020-04-22T14:05:52.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.351+0000 7f44c9f52700 1 --2- 172.21.15.103:0/2600737429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44c40b6180 0x7f44c4066740 secure :-1 s=THROTTLE_DONE pgs=320 cs=0 l=1 rx=0x7f44c40ae8f0 tx=0x7f44c0010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.351+0000 7f44b6ffd700 1 -- 172.21.15.103:0/2600737429 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v45) v1 ==== 104+0+10 (secure 0 0 0) 0x7f44c003c630 con 0x7f44c40b6180 2020-04-22T14:05:52.354 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:05:52.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.353+0000 7f44cc1b6700 1 -- 172.21.15.103:0/2600737429 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f44a404dc70 msgr2=0x7f44a4050130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:52.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.353+0000 7f44cc1b6700 1 --2- 172.21.15.103:0/2600737429 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f44a404dc70 0x7f44a4050130 secure :-1 s=READY pgs=220 cs=0 l=1 rx=0x7f44b8001750 tx=0x7f44b800cb40).stop 2020-04-22T14:05:52.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.353+0000 7f44cc1b6700 1 -- 172.21.15.103:0/2600737429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44c40b6180 msgr2=0x7f44c4066740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:52.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.353+0000 7f44cc1b6700 1 --2- 172.21.15.103:0/2600737429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44c40b6180 0x7f44c4066740 secure :-1 s=READY pgs=320 cs=0 l=1 rx=0x7f44c40ae8f0 tx=0x7f44c0010830).stop 2020-04-22T14:05:52.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.353+0000 7f44cc1b6700 1 -- 172.21.15.103:0/2600737429 shutdown_connections 2020-04-22T14:05:52.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.353+0000 7f44cc1b6700 1 --2- 172.21.15.103:0/2600737429 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f44a404dc70 0x7f44a4050130 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:52.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.353+0000 7f44cc1b6700 1 --2- 172.21.15.103:0/2600737429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44c40b6180 0x7f44c4066740 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:52.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.353+0000 7f44cc1b6700 1 -- 172.21.15.103:0/2600737429 >> 172.21.15.103:0/2600737429 conn(0x7f44c405ad30 msgr2=0x7f44c40b2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:52.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.353+0000 7f44cc1b6700 1 -- 172.21.15.103:0/2600737429 shutdown_connections 2020-04-22T14:05:52.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.353+0000 7f44cc1b6700 1 -- 172.21.15.103:0/2600737429 wait complete. 2020-04-22T14:05:52.365 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:52.382 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-22T14:05:52.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.527+0000 7fc364246700 1 Processor -- start 2020-04-22T14:05:52.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.527+0000 7fc364246700 1 -- start start 2020-04-22T14:05:52.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.528+0000 7fc364246700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc35c0ac950 0x7fc35c146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:52.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.528+0000 7fc364246700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc35c1467e0 con 0x7fc35c1470a0 2020-04-22T14:05:52.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.528+0000 7fc364246700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc35c060050 con 0x7fc35c0b9140 2020-04-22T14:05:52.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.528+0000 7fc364246700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c0602f0 con 0x7fc35c0ac950 2020-04-22T14:05:52.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.528+0000 7fc361fe2700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc35c0b9140 0x7fc35c12b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41834/0 (socket says 172.21.15.103:41834) 2020-04-22T14:05:52.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.528+0000 7fc361fe2700 1 -- 172.21.15.103:0/2963915676 learned_addr learned my addr 172.21.15.103:0/2963915676 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:52.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.528+0000 7fc3617e1700 1 --2- 172.21.15.103:0/2963915676 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc35c0ac950 0x7fc35c146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:52.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.528+0000 7fc360fe0700 1 -- 172.21.15.103:0/2963915676 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1651420704 0 0) 0x7fc35c060050 con 0x7fc35c0b9140 2020-04-22T14:05:52.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.528+0000 7fc360fe0700 1 -- 172.21.15.103:0/2963915676 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc344003230 con 0x7fc35c0b9140 2020-04-22T14:05:52.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.529+0000 7fc360fe0700 1 -- 172.21.15.103:0/2963915676 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1024088251 0 0) 0x7fc35c1467e0 con 0x7fc35c1470a0 2020-04-22T14:05:52.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.529+0000 7fc360fe0700 1 -- 172.21.15.103:0/2963915676 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc35c060050 con 0x7fc35c1470a0 2020-04-22T14:05:52.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.529+0000 7fc3617e1700 1 -- 172.21.15.103:0/2963915676 >> v1:172.21.15.103:6789/0 conn(0x7fc35c0b9140 legacy=0x7fc35c12b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:52.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.529+0000 7fc3617e1700 1 -- 172.21.15.103:0/2963915676 >> v1:172.21.15.86:6789/0 conn(0x7fc35c1470a0 legacy=0x7fc35c143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:52.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.529+0000 7fc3617e1700 1 -- 172.21.15.103:0/2963915676 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc35c0b9520 con 0x7fc35c0ac950 2020-04-22T14:05:52.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.529+0000 7fc3617e1700 1 --2- 172.21.15.103:0/2963915676 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc35c0ac950 0x7fc35c146c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc350002f30 tx=0x7fc3500088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.529+0000 7fc3617e1700 1 --2- 172.21.15.103:0/2963915676 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc35c0ac950 0x7fc35c146c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc350002f30 tx=0x7fc3500088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.529+0000 7fc3617e1700 1 --2- 172.21.15.103:0/2963915676 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc35c0ac950 0x7fc35c146c40 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7fc350002f30 tx=0x7fc3500088e0).ready entity=mon.2 client_cookie=ffbf2310bc35ae62 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:52.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.529+0000 7fc3617e1700 1 --2- 172.21.15.103:0/2963915676 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc35c0ac950 0x7fc35c146c40 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7fc350002f30 tx=0x7fc3500088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.529+0000 7fc360fe0700 1 -- 172.21.15.103:0/2963915676 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc350008e40 con 0x7fc35c0ac950 2020-04-22T14:05:52.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.529+0000 7fc3617e1700 1 --2- 172.21.15.103:0/2963915676 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc35c0ac950 0x7fc35c146c40 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7fc350002f30 tx=0x7fc3500088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.529+0000 7fc3617e1700 1 --2- 172.21.15.103:0/2963915676 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc35c0ac950 0x7fc35c146c40 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7fc350002f30 tx=0x7fc3500088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.529+0000 7fc360fe0700 1 -- 172.21.15.103:0/2963915676 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc350011540 con 0x7fc35c0ac950 2020-04-22T14:05:52.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.529+0000 7fc360fe0700 1 -- 172.21.15.103:0/2963915676 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc350011960 con 0x7fc35c0ac950 2020-04-22T14:05:52.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.529+0000 7fc364246700 1 -- 172.21.15.103:0/2963915676 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc35c0ac950 msgr2=0x7fc35c146c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:52.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.529+0000 7fc364246700 1 --2- 172.21.15.103:0/2963915676 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc35c0ac950 0x7fc35c146c40 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7fc350002f30 tx=0x7fc3500088e0).stop 2020-04-22T14:05:52.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.530+0000 7fc364246700 1 -- 172.21.15.103:0/2963915676 shutdown_connections 2020-04-22T14:05:52.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.530+0000 7fc364246700 1 --2- 172.21.15.103:0/2963915676 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc35c0ac950 0x7fc35c146c40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:52.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.530+0000 7fc364246700 1 -- 172.21.15.103:0/2963915676 >> 172.21.15.103:0/2963915676 conn(0x7fc35c05b7b0 msgr2=0x7fc35c0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:52.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.530+0000 7fc364246700 1 -- 172.21.15.103:0/2963915676 shutdown_connections 2020-04-22T14:05:52.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.530+0000 7fc364246700 1 -- 172.21.15.103:0/2963915676 wait complete. 2020-04-22T14:05:52.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.531+0000 7fc364246700 1 Processor -- start 2020-04-22T14:05:52.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.531+0000 7fc364246700 1 -- start start 2020-04-22T14:05:52.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.531+0000 7fc364246700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc35c1470a0 0x7fc35c140d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:52.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.531+0000 7fc364246700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc35c127200 con 0x7fc35c0b9140 2020-04-22T14:05:52.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.531+0000 7fc364246700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc35c1274a0 con 0x7fc35c0ac950 2020-04-22T14:05:52.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.531+0000 7fc364246700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc35c127020 con 0x7fc35c1470a0 2020-04-22T14:05:52.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.531+0000 7fc361fe2700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc35c0ac950 0x7fc35c140660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41840/0 (socket says 172.21.15.103:41840) 2020-04-22T14:05:52.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.531+0000 7fc361fe2700 1 -- 172.21.15.103:0/4270936707 learned_addr learned my addr 172.21.15.103:0/4270936707 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:52.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.531+0000 7fc34effd700 1 -- 172.21.15.103:0/4270936707 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4129896103 0 0) 0x7fc35c1274a0 con 0x7fc35c0ac950 2020-04-22T14:05:52.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.531+0000 7fc3627e3700 1 --2- 172.21.15.103:0/4270936707 >> v2:172.21.15.86:3300/0 conn(0x7fc35c1470a0 0x7fc35c140d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:52.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.532+0000 7fc34effd700 1 -- 172.21.15.103:0/4270936707 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc33c002fe0 con 0x7fc35c0ac950 2020-04-22T14:05:52.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.532+0000 7fc34effd700 1 -- 172.21.15.103:0/4270936707 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2785156946 0 0) 0x7fc35c127200 con 0x7fc35c0b9140 2020-04-22T14:05:52.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.532+0000 7fc34effd700 1 -- 172.21.15.103:0/4270936707 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc35c1274a0 con 0x7fc35c0b9140 2020-04-22T14:05:52.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.532+0000 7fc34effd700 1 -- 172.21.15.103:0/4270936707 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 672715834 0 0) 0x7fc33c002fe0 con 0x7fc35c0ac950 2020-04-22T14:05:52.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.532+0000 7fc34effd700 1 -- 172.21.15.103:0/4270936707 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc35c127200 con 0x7fc35c0ac950 2020-04-22T14:05:52.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.532+0000 7fc34effd700 1 -- 172.21.15.103:0/4270936707 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fc354001c00 con 0x7fc35c0ac950 2020-04-22T14:05:52.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.532+0000 7fc34effd700 1 -- 172.21.15.103:0/4270936707 >> v2:172.21.15.86:3300/0 conn(0x7fc35c1470a0 msgr2=0x7fc35c140d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:52.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.532+0000 7fc34effd700 1 --2- 172.21.15.103:0/4270936707 >> v2:172.21.15.86:3300/0 conn(0x7fc35c1470a0 0x7fc35c140d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:52.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.532+0000 7fc34effd700 1 -- 172.21.15.103:0/4270936707 >> v1:172.21.15.103:6789/0 conn(0x7fc35c0ac950 legacy=0x7fc35c140660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:52.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.532+0000 7fc34effd700 1 -- 172.21.15.103:0/4270936707 >> v1:172.21.15.86:6789/0 conn(0x7fc35c0b9140 legacy=0x7fc35c0b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:52.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.532+0000 7fc34effd700 1 --2- 172.21.15.103:0/4270936707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc33c004b20 0x7fc33c004f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:52.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.532+0000 7fc34effd700 1 --2- 172.21.15.103:0/4270936707 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc33c003800 0x7fc33c003c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:52.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.532+0000 7fc34effd700 1 --2- 172.21.15.103:0/4270936707 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc33c0040c0 0x7fc33c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:52.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.532+0000 7fc34effd700 1 -- 172.21.15.103:0/4270936707 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c127020 con 0x7fc33c0040c0 2020-04-22T14:05:52.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.532+0000 7fc34effd700 1 -- 172.21.15.103:0/4270936707 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c0046d0 con 0x7fc33c004b20 2020-04-22T14:05:52.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.532+0000 7fc34effd700 1 -- 172.21.15.103:0/4270936707 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c00bc30 con 0x7fc33c003800 2020-04-22T14:05:52.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.532+0000 7fc361fe2700 1 --2- 172.21.15.103:0/4270936707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc33c004b20 0x7fc33c004f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:52.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.532+0000 7fc3617e1700 1 --2- 172.21.15.103:0/4270936707 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc33c003800 0x7fc33c003c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:52.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.532+0000 7fc3627e3700 1 --2- 172.21.15.103:0/4270936707 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc33c0040c0 0x7fc33c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:52.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.532+0000 7fc361fe2700 1 -- 172.21.15.103:0/4270936707 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc33c003800 msgr2=0x7fc33c003c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:52.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.532+0000 7fc361fe2700 1 --2- 172.21.15.103:0/4270936707 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc33c003800 0x7fc33c003c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:52.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.532+0000 7fc361fe2700 1 -- 172.21.15.103:0/4270936707 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc33c0040c0 msgr2=0x7fc33c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:52.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.532+0000 7fc361fe2700 1 --2- 172.21.15.103:0/4270936707 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc33c0040c0 0x7fc33c00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:52.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.532+0000 7fc3627e3700 1 -- 172.21.15.103:0/4270936707 reap_dead start 2020-04-22T14:05:52.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.532+0000 7fc361fe2700 1 -- 172.21.15.103:0/4270936707 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc35c126b70 con 0x7fc33c004b20 2020-04-22T14:05:52.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.532+0000 7fc364246700 1 -- 172.21.15.103:0/4270936707 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc35c1255d0 con 0x7fc33c004b20 2020-04-22T14:05:52.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.532+0000 7fc361fe2700 1 --2- 172.21.15.103:0/4270936707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc33c004b20 0x7fc33c004f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc354001270 tx=0x7fc354011630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.532+0000 7fc364246700 1 -- 172.21.15.103:0/4270936707 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc35c1257c0 con 0x7fc33c004b20 2020-04-22T14:05:52.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.532+0000 7fc361fe2700 1 --2- 172.21.15.103:0/4270936707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc33c004b20 0x7fc33c004f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc354001270 tx=0x7fc354011630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.532+0000 7fc361fe2700 1 --2- 172.21.15.103:0/4270936707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc33c004b20 0x7fc33c004f20 secure :-1 s=READY pgs=559 cs=0 l=1 rx=0x7fc354001270 tx=0x7fc354011630).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:52.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.533+0000 7fc361fe2700 1 --2- 172.21.15.103:0/4270936707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc33c004b20 0x7fc33c004f20 secure :-1 s=THROTTLE_DONE pgs=559 cs=0 l=1 rx=0x7fc354001270 tx=0x7fc354011630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.533+0000 7fc34effd700 1 -- 172.21.15.103:0/4270936707 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc354005d40 con 0x7fc33c004b20 2020-04-22T14:05:52.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.533+0000 7fc361fe2700 1 --2- 172.21.15.103:0/4270936707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc33c004b20 0x7fc33c004f20 secure :-1 s=THROTTLE_DONE pgs=559 cs=0 l=1 rx=0x7fc354001270 tx=0x7fc354011630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.533+0000 7fc34effd700 1 -- 172.21.15.103:0/4270936707 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc354004c60 con 0x7fc33c004b20 2020-04-22T14:05:52.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.533+0000 7fc361fe2700 1 --2- 172.21.15.103:0/4270936707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc33c004b20 0x7fc33c004f20 secure :-1 s=THROTTLE_DONE pgs=559 cs=0 l=1 rx=0x7fc354001270 tx=0x7fc354011630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.533+0000 7fc34effd700 1 -- 172.21.15.103:0/4270936707 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc354005ea0 con 0x7fc33c004b20 2020-04-22T14:05:52.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.533+0000 7fc361fe2700 1 --2- 172.21.15.103:0/4270936707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc33c004b20 0x7fc33c004f20 secure :-1 s=THROTTLE_DONE pgs=559 cs=0 l=1 rx=0x7fc354001270 tx=0x7fc354011630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.533+0000 7fc34effd700 1 -- 172.21.15.103:0/4270936707 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fc354005000 con 0x7fc33c004b20 2020-04-22T14:05:52.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.534+0000 7fc361fe2700 1 --2- 172.21.15.103:0/4270936707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc33c004b20 0x7fc33c004f20 secure :-1 s=THROTTLE_DONE pgs=559 cs=0 l=1 rx=0x7fc354001270 tx=0x7fc354011630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.534+0000 7fc364246700 1 -- 172.21.15.103:0/4270936707 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc35c056c90 con 0x7fc33c004b20 2020-04-22T14:05:52.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.534+0000 7fc34effd700 1 --2- 172.21.15.103:0/4270936707 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc33c0519b0 0x7fc33c053e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:52.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.534+0000 7fc34effd700 1 -- 172.21.15.103:0/4270936707 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc354061c50 con 0x7fc33c004b20 2020-04-22T14:05:52.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.534+0000 7fc3617e1700 1 --2- 172.21.15.103:0/4270936707 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc33c0519b0 0x7fc33c053e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:52.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.534+0000 7fc3617e1700 1 --2- 172.21.15.103:0/4270936707 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc33c0519b0 0x7fc33c053e70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc3500084c0 tx=0x7fc35c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.534+0000 7fc3617e1700 1 --2- 172.21.15.103:0/4270936707 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc33c0519b0 0x7fc33c053e70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc3500084c0 tx=0x7fc35c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.534+0000 7fc3617e1700 1 --2- 172.21.15.103:0/4270936707 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc33c0519b0 0x7fc33c053e70 secure :-1 s=READY pgs=221 cs=0 l=1 rx=0x7fc3500084c0 tx=0x7fc35c0b96b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:52.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.538+0000 7fc361fe2700 1 --2- 172.21.15.103:0/4270936707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc33c004b20 0x7fc33c004f20 secure :-1 s=THROTTLE_DONE pgs=559 cs=0 l=1 rx=0x7fc354001270 tx=0x7fc354011630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.538+0000 7fc34effd700 1 -- 172.21.15.103:0/4270936707 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fc35403d030 con 0x7fc33c004b20 2020-04-22T14:05:52.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.680+0000 7fc364246700 1 -- 172.21.15.103:0/4270936707 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc35c125760 con 0x7fc33c004b20 2020-04-22T14:05:52.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.681+0000 7fc361fe2700 1 --2- 172.21.15.103:0/4270936707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc33c004b20 0x7fc33c004f20 secure :-1 s=THROTTLE_DONE pgs=559 cs=0 l=1 rx=0x7fc354001270 tx=0x7fc354011630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.681+0000 7fc34effd700 1 -- 172.21.15.103:0/4270936707 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v45) v1 ==== 100+0+10 (secure 0 0 0) 0x7fc354040650 con 0x7fc33c004b20 2020-04-22T14:05:52.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.682+0000 7fc364246700 1 -- 172.21.15.103:0/4270936707 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc33c0519b0 msgr2=0x7fc33c053e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:52.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.682+0000 7fc364246700 1 --2- 172.21.15.103:0/4270936707 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc33c0519b0 0x7fc33c053e70 secure :-1 s=READY pgs=221 cs=0 l=1 rx=0x7fc3500084c0 tx=0x7fc35c0b96b0).stop 2020-04-22T14:05:52.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.682+0000 7fc364246700 1 -- 172.21.15.103:0/4270936707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc33c004b20 msgr2=0x7fc33c004f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:52.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.682+0000 7fc364246700 1 --2- 172.21.15.103:0/4270936707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc33c004b20 0x7fc33c004f20 secure :-1 s=READY pgs=559 cs=0 l=1 rx=0x7fc354001270 tx=0x7fc354011630).stop 2020-04-22T14:05:52.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.682+0000 7fc364246700 1 -- 172.21.15.103:0/4270936707 shutdown_connections 2020-04-22T14:05:52.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.682+0000 7fc364246700 1 --2- 172.21.15.103:0/4270936707 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc33c0519b0 0x7fc33c053e70 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:52.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.682+0000 7fc364246700 1 --2- 172.21.15.103:0/4270936707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc33c004b20 0x7fc33c004f20 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:52.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.682+0000 7fc364246700 1 -- 172.21.15.103:0/4270936707 >> 172.21.15.103:0/4270936707 conn(0x7fc35c05b7b0 msgr2=0x7fc35c0b8670 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:52.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.682+0000 7fc364246700 1 -- 172.21.15.103:0/4270936707 shutdown_connections 2020-04-22T14:05:52.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.682+0000 7fc364246700 1 -- 172.21.15.103:0/4270936707 wait complete. 2020-04-22T14:05:52.696 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:05:52.697 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-04-22T14:05:52.697 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:52.710 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:05:52.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.854+0000 7f4fcfc77700 1 Processor -- start 2020-04-22T14:05:52.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.854+0000 7f4fcfc77700 1 -- start start 2020-04-22T14:05:52.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.855+0000 7f4fcfc77700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4fc812c0d0 0x7f4fc81464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:52.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.855+0000 7f4fcfc77700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc8143300 con 0x7f4fc8065fe0 2020-04-22T14:05:52.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.855+0000 7f4fcfc77700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc81435a0 con 0x7f4fc8063e30 2020-04-22T14:05:52.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.855+0000 7f4fcfc77700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc8143840 con 0x7f4fc812c0d0 2020-04-22T14:05:52.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.855+0000 7f4fcda13700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4fc812c0d0 0x7f4fc81464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:52.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.855+0000 7f4fce214700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f4fc8063e30 0x7f4fc80642c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41858/0 (socket says 172.21.15.103:41858) 2020-04-22T14:05:52.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.855+0000 7f4fce214700 1 -- 172.21.15.103:0/1181219771 learned_addr learned my addr 172.21.15.103:0/1181219771 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:52.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.855+0000 7f4fcda13700 1 -- 172.21.15.103:0/1181219771 >> v1:172.21.15.103:6789/0 conn(0x7f4fc8063e30 legacy=0x7f4fc80642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:52.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.855+0000 7f4fcda13700 1 -- 172.21.15.103:0/1181219771 >> v1:172.21.15.86:6789/0 conn(0x7f4fc8065fe0 legacy=0x7f4fc805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:52.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.855+0000 7f4fcca11700 1 -- 172.21.15.103:0/1181219771 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3453965997 0 0) 0x7f4fc81435a0 con 0x7f4fc8063e30 2020-04-22T14:05:52.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.855+0000 7f4fcda13700 1 -- 172.21.15.103:0/1181219771 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc805bb50 con 0x7f4fc812c0d0 2020-04-22T14:05:52.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.855+0000 7f4fcda13700 1 --2- 172.21.15.103:0/1181219771 >> v2:172.21.15.103:3300/0 conn(0x7f4fc812c0d0 0x7f4fc81464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4fb8002f30 tx=0x7f4fb8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.855+0000 7f4fcda13700 1 --2- 172.21.15.103:0/1181219771 >> v2:172.21.15.103:3300/0 conn(0x7f4fc812c0d0 0x7f4fc81464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4fb8002f30 tx=0x7f4fb8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.855+0000 7f4fcda13700 1 --2- 172.21.15.103:0/1181219771 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fc812c0d0 0x7f4fc81464e0 secure :-1 s=READY pgs=561 cs=0 l=1 rx=0x7f4fb8002f30 tx=0x7f4fb8007a40).ready entity=mon.1 client_cookie=506a0a2c81dd0f72 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:52.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.856+0000 7f4fcda13700 1 --2- 172.21.15.103:0/1181219771 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fc812c0d0 0x7f4fc81464e0 secure :-1 s=THROTTLE_DONE pgs=561 cs=0 l=1 rx=0x7f4fb8002f30 tx=0x7f4fb8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.856+0000 7f4fcca11700 1 -- 172.21.15.103:0/1181219771 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fb8011470 con 0x7f4fc812c0d0 2020-04-22T14:05:52.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.856+0000 7f4fcda13700 1 --2- 172.21.15.103:0/1181219771 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fc812c0d0 0x7f4fc81464e0 secure :-1 s=THROTTLE_DONE pgs=561 cs=0 l=1 rx=0x7f4fb8002f30 tx=0x7f4fb8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.856+0000 7f4fcda13700 1 --2- 172.21.15.103:0/1181219771 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fc812c0d0 0x7f4fc81464e0 secure :-1 s=THROTTLE_DONE pgs=561 cs=0 l=1 rx=0x7f4fb8002f30 tx=0x7f4fb8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.856+0000 7f4fcca11700 1 -- 172.21.15.103:0/1181219771 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb80115d0 con 0x7f4fc812c0d0 2020-04-22T14:05:52.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.856+0000 7f4fcca11700 1 -- 172.21.15.103:0/1181219771 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fb80119f0 con 0x7f4fc812c0d0 2020-04-22T14:05:52.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.856+0000 7f4fcfc77700 1 -- 172.21.15.103:0/1181219771 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fc812c0d0 msgr2=0x7f4fc81464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:52.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.856+0000 7f4fcfc77700 1 --2- 172.21.15.103:0/1181219771 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fc812c0d0 0x7f4fc81464e0 secure :-1 s=READY pgs=561 cs=0 l=1 rx=0x7f4fb8002f30 tx=0x7f4fb8007a40).stop 2020-04-22T14:05:52.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.856+0000 7f4fcfc77700 1 -- 172.21.15.103:0/1181219771 shutdown_connections 2020-04-22T14:05:52.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.856+0000 7f4fcfc77700 1 --2- 172.21.15.103:0/1181219771 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fc812c0d0 0x7f4fc81464e0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:52.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.856+0000 7f4fcfc77700 1 -- 172.21.15.103:0/1181219771 >> 172.21.15.103:0/1181219771 conn(0x7f4fc80b9160 msgr2=0x7f4fc805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:52.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.856+0000 7f4fcfc77700 1 -- 172.21.15.103:0/1181219771 shutdown_connections 2020-04-22T14:05:52.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.856+0000 7f4fcfc77700 1 -- 172.21.15.103:0/1181219771 wait complete. 2020-04-22T14:05:52.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.857+0000 7f4fcfc77700 1 Processor -- start 2020-04-22T14:05:52.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.857+0000 7f4fcfc77700 1 -- start start 2020-04-22T14:05:52.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.858+0000 7f4fcfc77700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4fc8063e30 0x7f4fc80b5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:52.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.858+0000 7f4fcfc77700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4fc812c0d0 0x7f4fc81422e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:52.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.858+0000 7f4fcfc77700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc80b5a10 con 0x7f4fc8065fe0 2020-04-22T14:05:52.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.858+0000 7f4fcfc77700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc8142740 con 0x7f4fc8063e30 2020-04-22T14:05:52.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.858+0000 7f4fcfc77700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc80b5770 con 0x7f4fc812c0d0 2020-04-22T14:05:52.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.858+0000 7f4fcda13700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4fc8063e30 0x7f4fc80b5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:52.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.858+0000 7f4fcda13700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4fc8063e30 0x7f4fc80b5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49670/0 (socket says 172.21.15.103:49670) 2020-04-22T14:05:52.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.858+0000 7f4fcda13700 1 -- 172.21.15.103:0/1823536751 learned_addr learned my addr 172.21.15.103:0/1823536751 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:05:52.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.858+0000 7f4fce214700 1 --2- 172.21.15.103:0/1823536751 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4fc812c0d0 0x7f4fc81422e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:52.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.858+0000 7f4fcda13700 1 -- 172.21.15.103:0/1823536751 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4fc812c0d0 msgr2=0x7f4fc81422e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:52.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.858+0000 7f4fcda13700 1 --2- 172.21.15.103:0/1823536751 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4fc812c0d0 0x7f4fc81422e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:52.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.858+0000 7f4fcda13700 1 -- 172.21.15.103:0/1823536751 >> v1:172.21.15.86:6789/0 conn(0x7f4fc8065fe0 legacy=0x7f4fc8157ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:52.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.858+0000 7f4fcda13700 1 -- 172.21.15.103:0/1823536751 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc80ad8b0 con 0x7f4fc8063e30 2020-04-22T14:05:52.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.858+0000 7f4fce214700 1 --2- 172.21.15.103:0/1823536751 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4fc812c0d0 0x7f4fc81422e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:05:52.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.858+0000 7f4fcda13700 1 --2- 172.21.15.103:0/1823536751 >> v2:172.21.15.103:3300/0 conn(0x7f4fc8063e30 0x7f4fc80b5140 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4fc8154c70 tx=0x7f4fb8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.858+0000 7f4fcda13700 1 --2- 172.21.15.103:0/1823536751 >> v2:172.21.15.103:3300/0 conn(0x7f4fc8063e30 0x7f4fc80b5140 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4fc8154c70 tx=0x7f4fb8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.858+0000 7f4fcda13700 1 --2- 172.21.15.103:0/1823536751 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fc8063e30 0x7f4fc80b5140 secure :-1 s=READY pgs=562 cs=0 l=1 rx=0x7f4fc8154c70 tx=0x7f4fb8007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:52.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.858+0000 7f4fcda13700 1 --2- 172.21.15.103:0/1823536751 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fc8063e30 0x7f4fc80b5140 secure :-1 s=THROTTLE_DONE pgs=562 cs=0 l=1 rx=0x7f4fc8154c70 tx=0x7f4fb8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.858+0000 7f4fcda13700 1 --2- 172.21.15.103:0/1823536751 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fc8063e30 0x7f4fc80b5140 secure :-1 s=THROTTLE_DONE pgs=562 cs=0 l=1 rx=0x7f4fc8154c70 tx=0x7f4fb8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.858+0000 7f4fb6ffd700 1 -- 172.21.15.103:0/1823536751 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fb800f860 con 0x7f4fc8063e30 2020-04-22T14:05:52.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.858+0000 7f4fcda13700 1 --2- 172.21.15.103:0/1823536751 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fc8063e30 0x7f4fc80b5140 secure :-1 s=THROTTLE_DONE pgs=562 cs=0 l=1 rx=0x7f4fc8154c70 tx=0x7f4fb8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.858+0000 7f4fb6ffd700 1 -- 172.21.15.103:0/1823536751 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb8007360 con 0x7f4fc8063e30 2020-04-22T14:05:52.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.858+0000 7f4fcfc77700 1 -- 172.21.15.103:0/1823536751 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc8128c00 con 0x7f4fc8063e30 2020-04-22T14:05:52.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.858+0000 7f4fb6ffd700 1 -- 172.21.15.103:0/1823536751 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fb80056c0 con 0x7f4fc8063e30 2020-04-22T14:05:52.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.859+0000 7f4fcfc77700 1 -- 172.21.15.103:0/1823536751 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc8129150 con 0x7f4fc8063e30 2020-04-22T14:05:52.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.859+0000 7f4fcda13700 1 --2- 172.21.15.103:0/1823536751 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fc8063e30 0x7f4fc80b5140 secure :-1 s=THROTTLE_DONE pgs=562 cs=0 l=1 rx=0x7f4fc8154c70 tx=0x7f4fb8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.859+0000 7f4fb6ffd700 1 -- 172.21.15.103:0/1823536751 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f4fb8005930 con 0x7f4fc8063e30 2020-04-22T14:05:52.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.859+0000 7f4fcda13700 1 --2- 172.21.15.103:0/1823536751 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fc8063e30 0x7f4fc80b5140 secure :-1 s=THROTTLE_DONE pgs=562 cs=0 l=1 rx=0x7f4fc8154c70 tx=0x7f4fb8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.860+0000 7f4fcfc77700 1 -- 172.21.15.103:0/1823536751 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc80ada40 con 0x7f4fc8063e30 2020-04-22T14:05:52.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.860+0000 7f4fb6ffd700 1 --2- 172.21.15.103:0/1823536751 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4fa804d9e0 0x7f4fa804fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:52.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.860+0000 7f4fb6ffd700 1 -- 172.21.15.103:0/1823536751 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4fb8061db0 con 0x7f4fc8063e30 2020-04-22T14:05:52.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.860+0000 7f4fcd212700 1 --2- 172.21.15.103:0/1823536751 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4fa804d9e0 0x7f4fa804fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:52.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.860+0000 7f4fcd212700 1 --2- 172.21.15.103:0/1823536751 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4fa804d9e0 0x7f4fa804fea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4fc8064950 tx=0x7f4fc4002590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.860+0000 7f4fcd212700 1 --2- 172.21.15.103:0/1823536751 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4fa804d9e0 0x7f4fa804fea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4fc8064950 tx=0x7f4fc4002590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.860+0000 7f4fcd212700 1 --2- 172.21.15.103:0/1823536751 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4fa804d9e0 0x7f4fa804fea0 secure :-1 s=READY pgs=222 cs=0 l=1 rx=0x7f4fc8064950 tx=0x7f4fc4002590).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:52.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.864+0000 7f4fcda13700 1 --2- 172.21.15.103:0/1823536751 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fc8063e30 0x7f4fc80b5140 secure :-1 s=THROTTLE_DONE pgs=562 cs=0 l=1 rx=0x7f4fc8154c70 tx=0x7f4fb8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:52.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:52.864+0000 7f4fb6ffd700 1 -- 172.21.15.103:0/1823536751 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f4fb803d2b0 con 0x7f4fc8063e30 2020-04-22T14:05:53.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:53.053+0000 7f4fcfc77700 1 -- 172.21.15.103:0/1823536751 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4fc8056c90 con 0x7f4fc8063e30 2020-04-22T14:05:53.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:53.054+0000 7f4fcda13700 1 --2- 172.21.15.103:0/1823536751 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fc8063e30 0x7f4fc80b5140 secure :-1 s=THROTTLE_DONE pgs=562 cs=0 l=1 rx=0x7f4fc8154c70 tx=0x7f4fb8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:53.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:53.054+0000 7f4fb6ffd700 1 -- 172.21.15.103:0/1823536751 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+2141 (secure 0 0 0) 0x7f4fb80408d0 con 0x7f4fc8063e30 2020-04-22T14:05:53.056 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:05:53.056 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":20,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4748,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1859944899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1859944899},{"type":"v1","addr":"172.21.15.86:6835","nonce":1859944899}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:05:45.958513+0000","modified":"2020-04-22T14:05:47.963559+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5491},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5491":{"gid":5491,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/2581125360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2581125360},{"type":"v1","addr":"172.21.15.103:6833","nonce":2581125360}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2020-04-22T14:05:53.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:53.055+0000 7f4fcfc77700 1 -- 172.21.15.103:0/1823536751 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4fa804d9e0 msgr2=0x7f4fa804fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:53.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:53.055+0000 7f4fcfc77700 1 --2- 172.21.15.103:0/1823536751 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4fa804d9e0 0x7f4fa804fea0 secure :-1 s=READY pgs=222 cs=0 l=1 rx=0x7f4fc8064950 tx=0x7f4fc4002590).stop 2020-04-22T14:05:53.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:53.055+0000 7f4fcfc77700 1 -- 172.21.15.103:0/1823536751 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fc8063e30 msgr2=0x7f4fc80b5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:53.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:53.055+0000 7f4fcfc77700 1 --2- 172.21.15.103:0/1823536751 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fc8063e30 0x7f4fc80b5140 secure :-1 s=READY pgs=562 cs=0 l=1 rx=0x7f4fc8154c70 tx=0x7f4fb8007a40).stop 2020-04-22T14:05:53.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:53.055+0000 7f4fcfc77700 1 -- 172.21.15.103:0/1823536751 shutdown_connections 2020-04-22T14:05:53.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:53.055+0000 7f4fcfc77700 1 --2- 172.21.15.103:0/1823536751 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4fa804d9e0 0x7f4fa804fea0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:53.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:53.055+0000 7f4fcfc77700 1 --2- 172.21.15.103:0/1823536751 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4fc812c0d0 0x7f4fc81422e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:53.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:53.055+0000 7f4fcfc77700 1 --2- 172.21.15.103:0/1823536751 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fc8063e30 0x7f4fc80b5140 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:53.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:53.055+0000 7f4fcfc77700 1 -- 172.21.15.103:0/1823536751 >> 172.21.15.103:0/1823536751 conn(0x7f4fc80b9160 msgr2=0x7f4fc8065790 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:53.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:53.055+0000 7f4fcfc77700 1 -- 172.21.15.103:0/1823536751 shutdown_connections 2020-04-22T14:05:53.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:53.055+0000 7f4fcfc77700 1 -- 172.21.15.103:0/1823536751 wait complete. 2020-04-22T14:05:53.063 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 20 2020-04-22T14:05:53.269 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 5491}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 7, u'failed': [], u'epoch': 20, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [8], u'info': {u'gid_5491': {u'export_targets': [], u'name': u'a', u'incarnation': 18, u'state_seq': 3, u'state': u'up:active', u'gid': 5491, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 2581125360, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 2581125360, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/2581125360'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:05:45.958513+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:05:47.963559+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:05:53.269 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:05:53.270 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:53.285 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:05:53.443 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:05:53.443 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:05:53.443 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:05:53.443 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 5491, 2020-04-22T14:05:53.443 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:05:53.443 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:05:53.444 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 7.4783848749999997, 2020-04-22T14:05:53.444 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 20, 2020-04-22T14:05:53.444 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 45, 2020-04-22T14:05:53.444 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 45, 2020-04-22T14:05:53.444 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 12.701396984000001 2020-04-22T14:05:53.444 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:05:53.451 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 5491, "want_state": "up:active", "state": "up:active", "rank_uptime": 7.4783848749999997, "mdsmap_epoch": 20, "osdmap_epoch": 45, "osdmap_epoch_barrier": 45, "uptime": 12.701396984000001 } 2020-04-22T14:05:53.451 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-04-22T14:05:53.451 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:05:53.452 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:53.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:05:53.466 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:05:53.524 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:05:53.525 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:05:53.525 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:05:53.525 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:05:53.525 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:05:53.525 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:05:53.525 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:05:53.526 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:05:53.526 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:05:53.526 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:05:53.526 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:05:53.526 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:05:53.526 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:05:53.526 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:05:53.527 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:05:53.527 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42487sec preferred_lft 42487sec 2020-04-22T14:05:53.527 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:05:53.527 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:05:53.527 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-04-22T14:05:53.527 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:53.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:05:53.573 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:05:53.650 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:53.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:05:53.701 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge con-name ceph-brx ifname ceph-brx stp no' 2020-04-22T14:05:53.809 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' (9507c76d-c1e0-4cd4-b6db-cddaba92a0c7) successfully added. 2020-04-22T14:05:53.809 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:53.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:05:53.823 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection modify ceph-brx ipv4.addresses 192.168.255.254/16 ipv4.method manual' 2020-04-22T14:05:53.932 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:53.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:05:53.962 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up ceph-brx' 2020-04-22T14:05:54.069 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (master waiting for slaves) (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/12) 2020-04-22T14:05:54.070 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:54.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:05:54.084 INFO:teuthology.orchestra.run.smithi103:> touch /tmp/python-ceph-brx 2020-04-22T14:05:54.143 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:54.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:05:54.191 INFO:teuthology.orchestra.run.smithi103:> cat /proc/sys/net/ipv4/ip_forward 2020-04-22T14:05:54.251 INFO:teuthology.orchestra.run.smithi103.stdout:0 2020-04-22T14:05:54.251 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:54.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:05:54.299 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 0 > /tmp/python-ceph-brx' 2020-04-22T14:05:54.378 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:54.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:05:54.422 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 1 > /proc/sys/net/ipv4/ip_forward' 2020-04-22T14:05:54.508 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:54.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:05:54.544 INFO:teuthology.orchestra.run.smithi103:> route 2020-04-22T14:05:54.603 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2020-04-22T14:05:54.604 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-04-22T14:05:54.604 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 102 0 0 enp3s0f1 2020-04-22T14:05:54.604 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 102 0 0 enp3s0f1 2020-04-22T14:05:54.604 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 425 0 0 ceph-brx 2020-04-22T14:05:54.605 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:54.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:05:54.652 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-04-22T14:05:54.727 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:54.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:05:54.773 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-04-22T14:05:54.851 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:54.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:05:54.897 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-04-22T14:05:54.972 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:55.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:05:55.019 INFO:teuthology.orchestra.run.smithi103:> ip netns list 2020-04-22T14:05:55.078 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:55.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:05:55.126 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:05:55.186 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:55.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:05:55.233 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:05:55.308 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:55.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:05:55.356 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0' 2020-04-22T14:05:55.432 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-04-22T14:05:55.432 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:55.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:05:55.478 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0' 2020-04-22T14:05:55.558 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:55.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:05:55.600 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0' 2020-04-22T14:05:55.707 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:55.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:05:55.721 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up' 2020-04-22T14:05:55.829 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:55.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:05:55.842 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up' 2020-04-22T14:05:55.950 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:55.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:05:55.964 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254' 2020-04-22T14:05:56.071 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:56.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:05:56.084 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:05:56.159 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:56.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:05:56.209 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge-slave con-name brx.0 ifname brx.0 master ceph-brx' 2020-04-22T14:05:56.325 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.0' (8a7cdbf1-4c85-42b8-99e9-3f8f7cd32bee) successfully added. 2020-04-22T14:05:56.325 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:56.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:05:56.347 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up brx.0' 2020-04-22T14:05:56.505 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/13) 2020-04-22T14:05:56.506 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-04-22T14:05:56.506 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi103.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-04-22T14:05:56.506 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:56.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:05:56.519 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:05:56.577 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:56.625 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:05:56.625 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:05:56.695 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:05:56.702 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:05:56.702 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:56.750 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:05:56.750 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:05:56.809 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-04-22T14:05:56.809 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:56.857 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:05:56.899 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:56.912 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:05:56.912 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:05:56.981 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:05:56.988 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:05:56.989 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:56.990 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:2020-04-22T14:05:56.985+0000 7f507a66e1c0 -1 init, newargv = 0x55fafb300930 newargc=9 2020-04-22T14:05:56.990 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[52508]: starting ceph client 2020-04-22T14:05:56.992 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[52508]: starting fuse 2020-04-22T14:05:57.005 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:05:57.005 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:05:57.064 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:05:57.064 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2020-04-22T14:05:57.065 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:57.112 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:05:57.112 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:05:57.112 INFO:teuthology.orchestra.run.smithi103:> import glob 2020-04-22T14:05:57.113 INFO:teuthology.orchestra.run.smithi103:> import re 2020-04-22T14:05:57.113 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:05:57.113 INFO:teuthology.orchestra.run.smithi103:> import subprocess 2020-04-22T14:05:57.113 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:05:57.113 INFO:teuthology.orchestra.run.smithi103:> def find_socket(client_name): 2020-04-22T14:05:57.113 INFO:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-04-22T14:05:57.113 INFO:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2020-04-22T14:05:57.113 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:05:57.114 INFO:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2020-04-22T14:05:57.114 INFO:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2020-04-22T14:05:57.114 INFO:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2020-04-22T14:05:57.114 INFO:teuthology.orchestra.run.smithi103:> return files[0] 2020-04-22T14:05:57.114 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:05:57.114 INFO:teuthology.orchestra.run.smithi103:> for f in files: 2020-04-22T14:05:57.114 INFO:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:05:57.114 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:05:57.115 INFO:teuthology.orchestra.run.smithi103:> return f 2020-04-22T14:05:57.115 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:05:57.115 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:05:57.115 INFO:teuthology.orchestra.run.smithi103:> print(find_socket("client.0")) 2020-04-22T14:05:57.115 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:05:57.220 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.0.52508.asok 2020-04-22T14:05:57.220 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.52508.asok 2020-04-22T14:05:57.221 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:57.234 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:05:57.234 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.52508.asok status 2020-04-22T14:05:57.394 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:05:57.395 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2020-04-22T14:05:57.395 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:05:57.395 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:05:57.395 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "0", 2020-04-22T14:05:57.395 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:05:57.396 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-04-22T14:05:57.396 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "52508", 2020-04-22T14:05:57.396 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:05:57.396 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:57.397 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2020-04-22T14:05:57.397 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2020-04-22T14:05:57.397 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 5683, 2020-04-22T14:05:57.397 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2020-04-22T14:05:57.398 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:05:57.398 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:05:57.398 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5683 2020-04-22T14:05:57.398 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:57.399 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:05:57.399 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:05:57.399 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:05:57.399 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 455625132 2020-04-22T14:05:57.399 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:05:57.400 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:57.400 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:05:57.400 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:05:57.400 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:05:57.400 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 455625132 2020-04-22T14:05:57.401 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:05:57.401 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.5683 192.168.0.1:0/455625132", 2020-04-22T14:05:57.401 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.1:0/455625132", 2020-04-22T14:05:57.401 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2020-04-22T14:05:57.401 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 20, 2020-04-22T14:05:57.401 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 45, 2020-04-22T14:05:57.402 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2020-04-22T14:05:57.402 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklisted": false 2020-04-22T14:05:57.403 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:05:57.403 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:57.421 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:05:57.421 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-22T14:05:57.421 INFO:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:05:57.480 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2020-04-22T14:05:57.481 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-04-22T14:05:57.481 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:57.529 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:05:57.529 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:05:57.618 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:57.655 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:05:57.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.799+0000 7f395cb8f700 1 Processor -- start 2020-04-22T14:05:57.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.799+0000 7f395cb8f700 1 -- start start 2020-04-22T14:05:57.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.800+0000 7f395cb8f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f395812c0d0 0x7f39581464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:57.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.800+0000 7f395cb8f700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3958143300 con 0x7f3958063e30 2020-04-22T14:05:57.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.800+0000 7f395cb8f700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39581435a0 con 0x7f3958065fe0 2020-04-22T14:05:57.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.800+0000 7f395cb8f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3958143840 con 0x7f395812c0d0 2020-04-22T14:05:57.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.800+0000 7f3955d9b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f3958065fe0 0x7f395805b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41886/0 (socket says 172.21.15.103:41886) 2020-04-22T14:05:57.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.800+0000 7f3955d9b700 1 -- 172.21.15.103:0/863003007 learned_addr learned my addr 172.21.15.103:0/863003007 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:57.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.800+0000 7f395659c700 1 --2- 172.21.15.103:0/863003007 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f395812c0d0 0x7f39581464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:57.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.800+0000 7f395559a700 1 -- 172.21.15.103:0/863003007 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 790334852 0 0) 0x7f39581435a0 con 0x7f3958065fe0 2020-04-22T14:05:57.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.800+0000 7f395559a700 1 -- 172.21.15.103:0/863003007 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3938003230 con 0x7f3958065fe0 2020-04-22T14:05:57.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.800+0000 7f395559a700 1 -- 172.21.15.103:0/863003007 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2880605273 0 0) 0x7f3958143300 con 0x7f3958063e30 2020-04-22T14:05:57.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.800+0000 7f395559a700 1 -- 172.21.15.103:0/863003007 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39581435a0 con 0x7f3958063e30 2020-04-22T14:05:57.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.800+0000 7f395559a700 1 -- 172.21.15.103:0/863003007 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3307560748 0 0) 0x7f3938003230 con 0x7f3958065fe0 2020-04-22T14:05:57.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.800+0000 7f395559a700 1 -- 172.21.15.103:0/863003007 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f395812c0d0 msgr2=0x7f39581464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:57.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.800+0000 7f395559a700 1 --2- 172.21.15.103:0/863003007 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f395812c0d0 0x7f39581464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:57.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.800+0000 7f395559a700 1 -- 172.21.15.103:0/863003007 >> v1:172.21.15.86:6789/0 conn(0x7f3958063e30 legacy=0x7f39580642a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:57.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.800+0000 7f395559a700 1 -- 172.21.15.103:0/863003007 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f395805bb50 con 0x7f3958065fe0 2020-04-22T14:05:57.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.800+0000 7f395559a700 1 -- 172.21.15.103:0/863003007 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f39400016d0 con 0x7f3958065fe0 2020-04-22T14:05:57.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.800+0000 7f395659c700 1 --2- 172.21.15.103:0/863003007 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f395812c0d0 0x7f39581464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:05:57.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.800+0000 7f395559a700 1 -- 172.21.15.103:0/863003007 >> v1:172.21.15.103:6789/0 conn(0x7f3958065fe0 legacy=0x7f395805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:57.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.801+0000 7f395559a700 1 --2- 172.21.15.103:0/863003007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39380038b0 0x7f3938003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:57.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.801+0000 7f395559a700 1 --2- 172.21.15.103:0/863003007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39380044d0 0x7f3938004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:57.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.801+0000 7f395559a700 1 --2- 172.21.15.103:0/863003007 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f395812c0d0 0x7f3938004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:57.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.801+0000 7f395559a700 1 -- 172.21.15.103:0/863003007 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3958143840 con 0x7f39380038b0 2020-04-22T14:05:57.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.801+0000 7f395559a700 1 -- 172.21.15.103:0/863003007 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3938005210 con 0x7f39380044d0 2020-04-22T14:05:57.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.801+0000 7f395559a700 1 -- 172.21.15.103:0/863003007 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f393800b720 con 0x7f395812c0d0 2020-04-22T14:05:57.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.801+0000 7f3955d9b700 1 --2- 172.21.15.103:0/863003007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39380044d0 0x7f3938004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:57.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.801+0000 7f395659c700 1 --2- 172.21.15.103:0/863003007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39380038b0 0x7f3938003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:57.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.801+0000 7f3956d9d700 1 --2- 172.21.15.103:0/863003007 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f395812c0d0 0x7f3938004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:57.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.801+0000 7f3955d9b700 1 -- 172.21.15.103:0/863003007 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f395812c0d0 msgr2=0x7f3938004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:57.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.801+0000 7f3955d9b700 1 --2- 172.21.15.103:0/863003007 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f395812c0d0 0x7f3938004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:57.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.801+0000 7f3955d9b700 1 -- 172.21.15.103:0/863003007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39380038b0 msgr2=0x7f3938003cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:57.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.801+0000 7f3955d9b700 1 --2- 172.21.15.103:0/863003007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39380038b0 0x7f3938003cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:57.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.801+0000 7f3955d9b700 1 -- 172.21.15.103:0/863003007 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3938003230 con 0x7f39380044d0 2020-04-22T14:05:57.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.801+0000 7f3955d9b700 1 --2- 172.21.15.103:0/863003007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39380044d0 0x7f3938004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f39400014a0 tx=0x7f395805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:57.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.801+0000 7f3955d9b700 1 --2- 172.21.15.103:0/863003007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39380044d0 0x7f3938004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f39400014a0 tx=0x7f395805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:57.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.801+0000 7f3955d9b700 1 --2- 172.21.15.103:0/863003007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39380044d0 0x7f3938004950 secure :-1 s=READY pgs=566 cs=0 l=1 rx=0x7f39400014a0 tx=0x7f395805bce0).ready entity=mon.1 client_cookie=d78d5c3d25138fdf server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:57.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.801+0000 7f3955d9b700 1 --2- 172.21.15.103:0/863003007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39380044d0 0x7f3938004950 secure :-1 s=THROTTLE_DONE pgs=566 cs=0 l=1 rx=0x7f39400014a0 tx=0x7f395805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:57.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.801+0000 7f395559a700 1 -- 172.21.15.103:0/863003007 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3940010d40 con 0x7f39380044d0 2020-04-22T14:05:57.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.801+0000 7f3955d9b700 1 --2- 172.21.15.103:0/863003007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39380044d0 0x7f3938004950 secure :-1 s=THROTTLE_DONE pgs=566 cs=0 l=1 rx=0x7f39400014a0 tx=0x7f395805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:57.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.801+0000 7f395559a700 1 -- 172.21.15.103:0/863003007 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39400101c0 con 0x7f39380044d0 2020-04-22T14:05:57.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.801+0000 7f3955d9b700 1 --2- 172.21.15.103:0/863003007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39380044d0 0x7f3938004950 secure :-1 s=THROTTLE_DONE pgs=566 cs=0 l=1 rx=0x7f39400014a0 tx=0x7f395805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:57.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.801+0000 7f395559a700 1 -- 172.21.15.103:0/863003007 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3940010ea0 con 0x7f39380044d0 2020-04-22T14:05:57.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.801+0000 7f395cb8f700 1 -- 172.21.15.103:0/863003007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39380044d0 msgr2=0x7f3938004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:57.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.801+0000 7f395cb8f700 1 --2- 172.21.15.103:0/863003007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39380044d0 0x7f3938004950 secure :-1 s=READY pgs=566 cs=0 l=1 rx=0x7f39400014a0 tx=0x7f395805bce0).stop 2020-04-22T14:05:57.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.801+0000 7f3956d9d700 1 -- 172.21.15.103:0/863003007 reap_dead start 2020-04-22T14:05:57.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.802+0000 7f395cb8f700 1 -- 172.21.15.103:0/863003007 shutdown_connections 2020-04-22T14:05:57.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.802+0000 7f395cb8f700 1 -- 172.21.15.103:0/863003007 >> 172.21.15.103:0/863003007 conn(0x7f39580b9160 msgr2=0x7f395805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:57.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.802+0000 7f395cb8f700 1 -- 172.21.15.103:0/863003007 shutdown_connections 2020-04-22T14:05:57.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.802+0000 7f395cb8f700 1 -- 172.21.15.103:0/863003007 wait complete. 2020-04-22T14:05:57.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.803+0000 7f395cb8f700 1 Processor -- start 2020-04-22T14:05:57.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.803+0000 7f395cb8f700 1 -- start start 2020-04-22T14:05:57.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.803+0000 7f395cb8f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f39580b5140 0x7f39580b55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:57.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.803+0000 7f395cb8f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f39580acac0 0x7f39580acf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:57.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.803+0000 7f395cb8f700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39580b1eb0 con 0x7f3958142590 2020-04-22T14:05:57.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.803+0000 7f395cb8f700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39580b2150 con 0x7f39580acac0 2020-04-22T14:05:57.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.803+0000 7f395cb8f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39580b23f0 con 0x7f39580b5140 2020-04-22T14:05:57.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.804+0000 7f3955d9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f39580b5140 0x7f39580b55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:57.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.804+0000 7f3955d9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f39580b5140 0x7f39580b55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49706/0 (socket says 172.21.15.103:49706) 2020-04-22T14:05:57.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.804+0000 7f3955d9b700 1 -- 172.21.15.103:0/2974302862 learned_addr learned my addr 172.21.15.103:0/2974302862 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:05:57.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.804+0000 7f3956d9d700 1 --2- 172.21.15.103:0/2974302862 >> v2:172.21.15.86:3300/0 conn(0x7f39580acac0 0x7f39580acf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:57.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.804+0000 7f3955d9b700 1 -- 172.21.15.103:0/2974302862 >> v2:172.21.15.86:3300/0 conn(0x7f39580acac0 msgr2=0x7f39580acf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:57.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.804+0000 7f3955d9b700 1 --2- 172.21.15.103:0/2974302862 >> v2:172.21.15.86:3300/0 conn(0x7f39580acac0 0x7f39580acf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:57.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.804+0000 7f3955d9b700 1 -- 172.21.15.103:0/2974302862 >> v1:172.21.15.86:6789/0 conn(0x7f3958142590 legacy=0x7f39580b4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:57.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.804+0000 7f3955d9b700 1 -- 172.21.15.103:0/2974302862 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3958142970 con 0x7f39580b5140 2020-04-22T14:05:57.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.804+0000 7f3955d9b700 1 --2- 172.21.15.103:0/2974302862 >> v2:172.21.15.103:3300/0 conn(0x7f39580b5140 0x7f39580b55a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f39400014a0 tx=0x7f395805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:57.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.804+0000 7f3955d9b700 1 --2- 172.21.15.103:0/2974302862 >> v2:172.21.15.103:3300/0 conn(0x7f39580b5140 0x7f39580b55a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f39400014a0 tx=0x7f395805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:57.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.804+0000 7f3955d9b700 1 --2- 172.21.15.103:0/2974302862 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39580b5140 0x7f39580b55a0 secure :-1 s=READY pgs=567 cs=0 l=1 rx=0x7f39400014a0 tx=0x7f395805bce0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:57.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.804+0000 7f3955d9b700 1 --2- 172.21.15.103:0/2974302862 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39580b5140 0x7f39580b55a0 secure :-1 s=THROTTLE_DONE pgs=567 cs=0 l=1 rx=0x7f39400014a0 tx=0x7f395805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:57.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.804+0000 7f3955d9b700 1 --2- 172.21.15.103:0/2974302862 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39580b5140 0x7f39580b55a0 secure :-1 s=THROTTLE_DONE pgs=567 cs=0 l=1 rx=0x7f39400014a0 tx=0x7f395805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:57.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.804+0000 7f394f7fe700 1 -- 172.21.15.103:0/2974302862 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3940000e90 con 0x7f39580b5140 2020-04-22T14:05:57.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.804+0000 7f3955d9b700 1 --2- 172.21.15.103:0/2974302862 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39580b5140 0x7f39580b55a0 secure :-1 s=THROTTLE_DONE pgs=567 cs=0 l=1 rx=0x7f39400014a0 tx=0x7f395805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:57.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.804+0000 7f394f7fe700 1 -- 172.21.15.103:0/2974302862 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f394000b370 con 0x7f39580b5140 2020-04-22T14:05:57.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.804+0000 7f395cb8f700 1 -- 172.21.15.103:0/2974302862 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39580b3db0 con 0x7f39580b5140 2020-04-22T14:05:57.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.804+0000 7f394f7fe700 1 -- 172.21.15.103:0/2974302862 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f394000a2c0 con 0x7f39580b5140 2020-04-22T14:05:57.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.804+0000 7f395cb8f700 1 -- 172.21.15.103:0/2974302862 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39580ad360 con 0x7f39580b5140 2020-04-22T14:05:57.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.805+0000 7f3955d9b700 1 --2- 172.21.15.103:0/2974302862 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39580b5140 0x7f39580b55a0 secure :-1 s=THROTTLE_DONE pgs=567 cs=0 l=1 rx=0x7f39400014a0 tx=0x7f395805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:57.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.805+0000 7f394f7fe700 1 -- 172.21.15.103:0/2974302862 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f39400045b0 con 0x7f39580b5140 2020-04-22T14:05:57.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.805+0000 7f3955d9b700 1 --2- 172.21.15.103:0/2974302862 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39580b5140 0x7f39580b55a0 secure :-1 s=THROTTLE_DONE pgs=567 cs=0 l=1 rx=0x7f39400014a0 tx=0x7f395805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:57.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.805+0000 7f395cb8f700 1 -- 172.21.15.103:0/2974302862 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3958056c90 con 0x7f39580b5140 2020-04-22T14:05:57.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.806+0000 7f394f7fe700 1 --2- 172.21.15.103:0/2974302862 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f393c04d8b0 0x7f393c04fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:57.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.806+0000 7f394f7fe700 1 -- 172.21.15.103:0/2974302862 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3940061590 con 0x7f39580b5140 2020-04-22T14:05:57.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.806+0000 7f395659c700 1 --2- 172.21.15.103:0/2974302862 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f393c04d8b0 0x7f393c04fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:57.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.806+0000 7f395659c700 1 --2- 172.21.15.103:0/2974302862 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f393c04d8b0 0x7f393c04fd70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f395805b810 tx=0x7f3950007ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:57.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.806+0000 7f395659c700 1 --2- 172.21.15.103:0/2974302862 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f393c04d8b0 0x7f393c04fd70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f395805b810 tx=0x7f3950007ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:57.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.806+0000 7f395659c700 1 --2- 172.21.15.103:0/2974302862 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f393c04d8b0 0x7f393c04fd70 secure :-1 s=READY pgs=223 cs=0 l=1 rx=0x7f395805b810 tx=0x7f3950007ac0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:57.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.810+0000 7f3955d9b700 1 --2- 172.21.15.103:0/2974302862 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39580b5140 0x7f39580b55a0 secure :-1 s=THROTTLE_DONE pgs=567 cs=0 l=1 rx=0x7f39400014a0 tx=0x7f395805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:57.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.810+0000 7f394f7fe700 1 -- 172.21.15.103:0/2974302862 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f394003c970 con 0x7f39580b5140 2020-04-22T14:05:57.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.954+0000 7f395cb8f700 1 -- 172.21.15.103:0/2974302862 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f395812b7b0 con 0x7f39580b5140 2020-04-22T14:05:57.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.954+0000 7f3955d9b700 1 --2- 172.21.15.103:0/2974302862 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39580b5140 0x7f39580b55a0 secure :-1 s=THROTTLE_DONE pgs=567 cs=0 l=1 rx=0x7f39400014a0 tx=0x7f395805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:57.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.954+0000 7f394f7fe700 1 -- 172.21.15.103:0/2974302862 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f394003ff90 con 0x7f39580b5140 2020-04-22T14:05:57.957 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:05:57.957 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":45,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:05:46.962137+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:05:43.875682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2020-04-22T14:05:44.910499+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:05:57.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.956+0000 7f395cb8f700 1 -- 172.21.15.103:0/2974302862 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f393c04d8b0 msgr2=0x7f393c04fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:57.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.956+0000 7f395cb8f700 1 --2- 172.21.15.103:0/2974302862 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f393c04d8b0 0x7f393c04fd70 secure :-1 s=READY pgs=223 cs=0 l=1 rx=0x7f395805b810 tx=0x7f3950007ac0).stop 2020-04-22T14:05:57.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.956+0000 7f395cb8f700 1 -- 172.21.15.103:0/2974302862 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39580b5140 msgr2=0x7f39580b55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:57.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.956+0000 7f395cb8f700 1 --2- 172.21.15.103:0/2974302862 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39580b5140 0x7f39580b55a0 secure :-1 s=READY pgs=567 cs=0 l=1 rx=0x7f39400014a0 tx=0x7f395805bce0).stop 2020-04-22T14:05:57.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.956+0000 7f395cb8f700 1 -- 172.21.15.103:0/2974302862 shutdown_connections 2020-04-22T14:05:57.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.956+0000 7f395cb8f700 1 --2- 172.21.15.103:0/2974302862 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f393c04d8b0 0x7f393c04fd70 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:57.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.956+0000 7f395cb8f700 1 --2- 172.21.15.103:0/2974302862 >> v2:172.21.15.86:3300/0 conn(0x7f39580acac0 0x7f39580acf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:57.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.956+0000 7f395cb8f700 1 --2- 172.21.15.103:0/2974302862 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39580b5140 0x7f39580b55a0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:57.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.956+0000 7f395cb8f700 1 -- 172.21.15.103:0/2974302862 >> 172.21.15.103:0/2974302862 conn(0x7f39580b9160 msgr2=0x7f3958063100 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:57.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.956+0000 7f395cb8f700 1 -- 172.21.15.103:0/2974302862 shutdown_connections 2020-04-22T14:05:57.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:57.956+0000 7f395cb8f700 1 -- 172.21.15.103:0/2974302862 wait complete. 2020-04-22T14:05:57.969 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:05:43.875682+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 7, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'44', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:05:44.910499+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 8, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'45', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:05:57.970 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:57.983 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:05:58.132 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.130+0000 7f3861ab3700 1 Processor -- start 2020-04-22T14:05:58.133 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.130+0000 7f3861ab3700 1 -- start start 2020-04-22T14:05:58.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.131+0000 7f3861ab3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f385c0b9140 0x7f385c12b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:58.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.131+0000 7f3861ab3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f385c12b670 0x7f385c143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:58.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.131+0000 7f3861ab3700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f385c1467e0 con 0x7f385c0ac950 2020-04-22T14:05:58.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.131+0000 7f3861ab3700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f385c0602f0 con 0x7f385c12b670 2020-04-22T14:05:58.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.131+0000 7f3861ab3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f385c060050 con 0x7f385c0b9140 2020-04-22T14:05:58.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.131+0000 7f385affd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f385c0ac950 0x7f385c146c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41902/0 (socket says 172.21.15.103:41902) 2020-04-22T14:05:58.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.131+0000 7f385bfff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f385c12b670 0x7f385c143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:58.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.131+0000 7f385affd700 1 -- 172.21.15.103:0/2073606042 learned_addr learned my addr 172.21.15.103:0/2073606042 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:58.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.131+0000 7f385b7fe700 1 --2- 172.21.15.103:0/2073606042 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f385c0b9140 0x7f385c12b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:58.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.131+0000 7f385bfff700 1 -- 172.21.15.103:0/2073606042 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f385c0b9140 msgr2=0x7f385c12b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:58.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.131+0000 7f385bfff700 1 --2- 172.21.15.103:0/2073606042 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f385c0b9140 0x7f385c12b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:58.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.131+0000 7f385bfff700 1 -- 172.21.15.103:0/2073606042 >> v1:172.21.15.103:6789/0 conn(0x7f385c0ac950 legacy=0x7f385c146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:58.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.131+0000 7f385a7fc700 1 -- 172.21.15.103:0/2073606042 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2024677807 0 0) 0x7f385c1467e0 con 0x7f385c0ac950 2020-04-22T14:05:58.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.131+0000 7f385bfff700 1 -- 172.21.15.103:0/2073606042 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f385c0b9520 con 0x7f385c12b670 2020-04-22T14:05:58.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.131+0000 7f385bfff700 1 --2- 172.21.15.103:0/2073606042 >> v2:172.21.15.103:3300/0 conn(0x7f385c12b670 0x7f385c143090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f38540032b0 tx=0x7f3854007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.132+0000 7f385bfff700 1 --2- 172.21.15.103:0/2073606042 >> v2:172.21.15.103:3300/0 conn(0x7f385c12b670 0x7f385c143090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f38540032b0 tx=0x7f3854007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.132+0000 7f385bfff700 1 --2- 172.21.15.103:0/2073606042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f385c12b670 0x7f385c143090 secure :-1 s=READY pgs=569 cs=0 l=1 rx=0x7f38540032b0 tx=0x7f3854007dc0).ready entity=mon.1 client_cookie=3e18419a5c95c927 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:58.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.132+0000 7f385bfff700 1 --2- 172.21.15.103:0/2073606042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f385c12b670 0x7f385c143090 secure :-1 s=THROTTLE_DONE pgs=569 cs=0 l=1 rx=0x7f38540032b0 tx=0x7f3854007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.132+0000 7f385a7fc700 1 -- 172.21.15.103:0/2073606042 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f385400a180 con 0x7f385c12b670 2020-04-22T14:05:58.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.132+0000 7f385bfff700 1 --2- 172.21.15.103:0/2073606042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f385c12b670 0x7f385c143090 secure :-1 s=THROTTLE_DONE pgs=569 cs=0 l=1 rx=0x7f38540032b0 tx=0x7f3854007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.132+0000 7f385a7fc700 1 -- 172.21.15.103:0/2073606042 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385400a320 con 0x7f385c12b670 2020-04-22T14:05:58.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.132+0000 7f385bfff700 1 --2- 172.21.15.103:0/2073606042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f385c12b670 0x7f385c143090 secure :-1 s=THROTTLE_DONE pgs=569 cs=0 l=1 rx=0x7f38540032b0 tx=0x7f3854007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.132+0000 7f385a7fc700 1 -- 172.21.15.103:0/2073606042 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f385400a700 con 0x7f385c12b670 2020-04-22T14:05:58.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.132+0000 7f3861ab3700 1 -- 172.21.15.103:0/2073606042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f385c12b670 msgr2=0x7f385c143090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:58.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.132+0000 7f3861ab3700 1 --2- 172.21.15.103:0/2073606042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f385c12b670 0x7f385c143090 secure :-1 s=READY pgs=569 cs=0 l=1 rx=0x7f38540032b0 tx=0x7f3854007dc0).stop 2020-04-22T14:05:58.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.132+0000 7f3861ab3700 1 -- 172.21.15.103:0/2073606042 shutdown_connections 2020-04-22T14:05:58.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.132+0000 7f3861ab3700 1 --2- 172.21.15.103:0/2073606042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f385c12b670 0x7f385c143090 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:58.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.132+0000 7f3861ab3700 1 --2- 172.21.15.103:0/2073606042 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f385c0b9140 0x7f385c12b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:58.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.132+0000 7f3861ab3700 1 -- 172.21.15.103:0/2073606042 >> 172.21.15.103:0/2073606042 conn(0x7f385c05b7b0 msgr2=0x7f385c0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:58.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.132+0000 7f3861ab3700 1 -- 172.21.15.103:0/2073606042 shutdown_connections 2020-04-22T14:05:58.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.132+0000 7f3861ab3700 1 -- 172.21.15.103:0/2073606042 wait complete. 2020-04-22T14:05:58.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.133+0000 7f3861ab3700 1 Processor -- start 2020-04-22T14:05:58.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.133+0000 7f3861ab3700 1 -- start start 2020-04-22T14:05:58.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.134+0000 7f3861ab3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f385c0ac950 0x7f385c0b2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:58.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.134+0000 7f3861ab3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f385c12b670 0x7f385c0b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:58.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.134+0000 7f3861ab3700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f385c143f30 con 0x7f385c0b9140 2020-04-22T14:05:58.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.134+0000 7f3861ab3700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f385c0b4fe0 con 0x7f385c12b670 2020-04-22T14:05:58.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.134+0000 7f3861ab3700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f385c0b3fe0 con 0x7f385c0ac950 2020-04-22T14:05:58.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.134+0000 7f385b7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f385c0ac950 0x7f385c0b2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:58.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.134+0000 7f385b7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f385c0ac950 0x7f385c0b2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49716/0 (socket says 172.21.15.103:49716) 2020-04-22T14:05:58.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.134+0000 7f385b7fe700 1 -- 172.21.15.103:0/438433775 learned_addr learned my addr 172.21.15.103:0/438433775 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:05:58.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.134+0000 7f385bfff700 1 --2- 172.21.15.103:0/438433775 >> v2:172.21.15.86:3300/0 conn(0x7f385c12b670 0x7f385c0b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:58.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.134+0000 7f385b7fe700 1 -- 172.21.15.103:0/438433775 >> v2:172.21.15.86:3300/0 conn(0x7f385c12b670 msgr2=0x7f385c0b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:58.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.134+0000 7f385b7fe700 1 --2- 172.21.15.103:0/438433775 >> v2:172.21.15.86:3300/0 conn(0x7f385c12b670 0x7f385c0b3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:58.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.134+0000 7f385b7fe700 1 -- 172.21.15.103:0/438433775 >> v1:172.21.15.86:6789/0 conn(0x7f385c0b9140 legacy=0x7f385c143820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:58.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.134+0000 7f385b7fe700 1 -- 172.21.15.103:0/438433775 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f385c142760 con 0x7f385c0ac950 2020-04-22T14:05:58.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.134+0000 7f385b7fe700 1 --2- 172.21.15.103:0/438433775 >> v2:172.21.15.103:3300/0 conn(0x7f385c0ac950 0x7f385c0b2410 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f385c0625e0 tx=0x7f384c010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.134+0000 7f385b7fe700 1 --2- 172.21.15.103:0/438433775 >> v2:172.21.15.103:3300/0 conn(0x7f385c0ac950 0x7f385c0b2410 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f385c0625e0 tx=0x7f384c010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.134+0000 7f385b7fe700 1 --2- 172.21.15.103:0/438433775 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f385c0ac950 0x7f385c0b2410 secure :-1 s=READY pgs=570 cs=0 l=1 rx=0x7f385c0625e0 tx=0x7f384c010d00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:58.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.135+0000 7f385b7fe700 1 --2- 172.21.15.103:0/438433775 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f385c0ac950 0x7f385c0b2410 secure :-1 s=THROTTLE_DONE pgs=570 cs=0 l=1 rx=0x7f385c0625e0 tx=0x7f384c010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.135+0000 7f3858ff9700 1 -- 172.21.15.103:0/438433775 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f384c012b30 con 0x7f385c0ac950 2020-04-22T14:05:58.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.135+0000 7f385b7fe700 1 --2- 172.21.15.103:0/438433775 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f385c0ac950 0x7f385c0b2410 secure :-1 s=THROTTLE_DONE pgs=570 cs=0 l=1 rx=0x7f385c0625e0 tx=0x7f384c010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.135+0000 7f385b7fe700 1 --2- 172.21.15.103:0/438433775 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f385c0ac950 0x7f385c0b2410 secure :-1 s=THROTTLE_DONE pgs=570 cs=0 l=1 rx=0x7f385c0625e0 tx=0x7f384c010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.135+0000 7f3858ff9700 1 -- 172.21.15.103:0/438433775 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f384c012c90 con 0x7f385c0ac950 2020-04-22T14:05:58.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.135+0000 7f3861ab3700 1 -- 172.21.15.103:0/438433775 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f385c142490 con 0x7f385c0ac950 2020-04-22T14:05:58.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.135+0000 7f3858ff9700 1 -- 172.21.15.103:0/438433775 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f384c012e80 con 0x7f385c0ac950 2020-04-22T14:05:58.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.135+0000 7f3861ab3700 1 -- 172.21.15.103:0/438433775 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f385c061d50 con 0x7f385c0ac950 2020-04-22T14:05:58.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.135+0000 7f385b7fe700 1 --2- 172.21.15.103:0/438433775 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f385c0ac950 0x7f385c0b2410 secure :-1 s=THROTTLE_DONE pgs=570 cs=0 l=1 rx=0x7f385c0625e0 tx=0x7f384c010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.136+0000 7f3861ab3700 1 -- 172.21.15.103:0/438433775 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f385c056c90 con 0x7f385c0ac950 2020-04-22T14:05:58.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.136+0000 7f3858ff9700 1 -- 172.21.15.103:0/438433775 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f384c007190 con 0x7f385c0ac950 2020-04-22T14:05:58.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.136+0000 7f385b7fe700 1 --2- 172.21.15.103:0/438433775 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f385c0ac950 0x7f385c0b2410 secure :-1 s=THROTTLE_DONE pgs=570 cs=0 l=1 rx=0x7f385c0625e0 tx=0x7f384c010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.136+0000 7f3858ff9700 1 --2- 172.21.15.103:0/438433775 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f383c04d9a0 0x7f383c04fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:58.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.136+0000 7f3858ff9700 1 -- 172.21.15.103:0/438433775 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f384c061a40 con 0x7f385c0ac950 2020-04-22T14:05:58.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.136+0000 7f385affd700 1 --2- 172.21.15.103:0/438433775 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f383c04d9a0 0x7f383c04fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:58.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.136+0000 7f385affd700 1 --2- 172.21.15.103:0/438433775 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f383c04d9a0 0x7f383c04fe60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3850000b80 tx=0x7f3850001430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.136+0000 7f385affd700 1 --2- 172.21.15.103:0/438433775 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f383c04d9a0 0x7f383c04fe60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3850000b80 tx=0x7f3850001430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.136+0000 7f385affd700 1 --2- 172.21.15.103:0/438433775 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f383c04d9a0 0x7f383c04fe60 secure :-1 s=READY pgs=224 cs=0 l=1 rx=0x7f3850000b80 tx=0x7f3850001430).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:58.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.140+0000 7f385b7fe700 1 --2- 172.21.15.103:0/438433775 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f385c0ac950 0x7f385c0b2410 secure :-1 s=THROTTLE_DONE pgs=570 cs=0 l=1 rx=0x7f385c0625e0 tx=0x7f384c010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.140+0000 7f3858ff9700 1 -- 172.21.15.103:0/438433775 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f384c03cdc0 con 0x7f385c0ac950 2020-04-22T14:05:58.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.280+0000 7f3861ab3700 1 -- 172.21.15.103:0/438433775 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f385c0b4120 con 0x7f385c0ac950 2020-04-22T14:05:58.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.280+0000 7f385b7fe700 1 --2- 172.21.15.103:0/438433775 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f385c0ac950 0x7f385c0b2410 secure :-1 s=THROTTLE_DONE pgs=570 cs=0 l=1 rx=0x7f385c0625e0 tx=0x7f384c010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.280+0000 7f3858ff9700 1 -- 172.21.15.103:0/438433775 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v45) v1 ==== 110+0+10 (secure 0 0 0) 0x7f385c0b4120 con 0x7f385c0ac950 2020-04-22T14:05:58.283 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:05:58.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.282+0000 7f3861ab3700 1 -- 172.21.15.103:0/438433775 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f383c04d9a0 msgr2=0x7f383c04fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:58.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.282+0000 7f3861ab3700 1 --2- 172.21.15.103:0/438433775 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f383c04d9a0 0x7f383c04fe60 secure :-1 s=READY pgs=224 cs=0 l=1 rx=0x7f3850000b80 tx=0x7f3850001430).stop 2020-04-22T14:05:58.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.282+0000 7f3861ab3700 1 -- 172.21.15.103:0/438433775 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f385c0ac950 msgr2=0x7f385c0b2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:58.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.282+0000 7f3861ab3700 1 --2- 172.21.15.103:0/438433775 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f385c0ac950 0x7f385c0b2410 secure :-1 s=READY pgs=570 cs=0 l=1 rx=0x7f385c0625e0 tx=0x7f384c010d00).stop 2020-04-22T14:05:58.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.282+0000 7f3861ab3700 1 -- 172.21.15.103:0/438433775 shutdown_connections 2020-04-22T14:05:58.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.282+0000 7f3861ab3700 1 --2- 172.21.15.103:0/438433775 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f383c04d9a0 0x7f383c04fe60 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:58.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.282+0000 7f3861ab3700 1 --2- 172.21.15.103:0/438433775 >> v2:172.21.15.86:3300/0 conn(0x7f385c12b670 0x7f385c0b3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:58.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.282+0000 7f3861ab3700 1 --2- 172.21.15.103:0/438433775 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f385c0ac950 0x7f385c0b2410 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:58.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.282+0000 7f3861ab3700 1 -- 172.21.15.103:0/438433775 >> 172.21.15.103:0/438433775 conn(0x7f385c05b7b0 msgr2=0x7f385c0b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:58.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.282+0000 7f3861ab3700 1 -- 172.21.15.103:0/438433775 shutdown_connections 2020-04-22T14:05:58.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.282+0000 7f3861ab3700 1 -- 172.21.15.103:0/438433775 wait complete. 2020-04-22T14:05:58.294 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:58.307 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:05:58.455 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.453+0000 7ff52c0be700 1 Processor -- start 2020-04-22T14:05:58.455 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.453+0000 7ff52c0be700 1 -- start start 2020-04-22T14:05:58.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.454+0000 7ff52c0be700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff5240b4820 0x7ff5240acb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:58.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.454+0000 7ff52c0be700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5240af030 con 0x7ff524141f20 2020-04-22T14:05:58.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.454+0000 7ff52c0be700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff524060250 con 0x7ff524061a30 2020-04-22T14:05:58.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.454+0000 7ff52c0be700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5240623c0 con 0x7ff5240b4820 2020-04-22T14:05:58.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.454+0000 7ff529e5a700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff524061a30 0x7ff5240ae920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41914/0 (socket says 172.21.15.103:41914) 2020-04-22T14:05:58.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.454+0000 7ff529e5a700 1 -- 172.21.15.103:0/1383583352 learned_addr learned my addr 172.21.15.103:0/1383583352 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:58.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.454+0000 7ff529659700 1 --2- 172.21.15.103:0/1383583352 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff5240b4820 0x7ff5240acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:58.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.454+0000 7ff528e58700 1 -- 172.21.15.103:0/1383583352 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3360133136 0 0) 0x7ff524060250 con 0x7ff524061a30 2020-04-22T14:05:58.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.454+0000 7ff528e58700 1 -- 172.21.15.103:0/1383583352 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff50c003230 con 0x7ff524061a30 2020-04-22T14:05:58.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.454+0000 7ff528e58700 1 -- 172.21.15.103:0/1383583352 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3150278074 0 0) 0x7ff5240af030 con 0x7ff524141f20 2020-04-22T14:05:58.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.454+0000 7ff528e58700 1 -- 172.21.15.103:0/1383583352 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff524060250 con 0x7ff524141f20 2020-04-22T14:05:58.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.454+0000 7ff528e58700 1 -- 172.21.15.103:0/1383583352 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 948319388 0 0) 0x7ff50c003230 con 0x7ff524061a30 2020-04-22T14:05:58.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.454+0000 7ff528e58700 1 -- 172.21.15.103:0/1383583352 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff5240b4820 msgr2=0x7ff5240acb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:58.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.454+0000 7ff528e58700 1 --2- 172.21.15.103:0/1383583352 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff5240b4820 0x7ff5240acb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:58.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.454+0000 7ff528e58700 1 -- 172.21.15.103:0/1383583352 >> v1:172.21.15.86:6789/0 conn(0x7ff524141f20 legacy=0x7ff5241423d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:58.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.454+0000 7ff528e58700 1 -- 172.21.15.103:0/1383583352 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff524062660 con 0x7ff524061a30 2020-04-22T14:05:58.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.454+0000 7ff528e58700 1 -- 172.21.15.103:0/1383583352 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7ff5140016d0 con 0x7ff524061a30 2020-04-22T14:05:58.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.454+0000 7ff528e58700 1 -- 172.21.15.103:0/1383583352 >> v1:172.21.15.103:6789/0 conn(0x7ff524061a30 legacy=0x7ff5240ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:58.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.455+0000 7ff528e58700 1 --2- 172.21.15.103:0/1383583352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff50c0038b0 0x7ff50c003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:58.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.455+0000 7ff528e58700 1 --2- 172.21.15.103:0/1383583352 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff50c0044d0 0x7ff50c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:58.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.455+0000 7ff528e58700 1 --2- 172.21.15.103:0/1383583352 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff5240b4820 0x7ff50c004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:58.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.455+0000 7ff528e58700 1 -- 172.21.15.103:0/1383583352 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5240623c0 con 0x7ff50c0044d0 2020-04-22T14:05:58.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.455+0000 7ff528e58700 1 -- 172.21.15.103:0/1383583352 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c005210 con 0x7ff50c0038b0 2020-04-22T14:05:58.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.455+0000 7ff528e58700 1 -- 172.21.15.103:0/1383583352 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c00b720 con 0x7ff5240b4820 2020-04-22T14:05:58.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.455+0000 7ff529e5a700 1 --2- 172.21.15.103:0/1383583352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff50c0038b0 0x7ff50c003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:58.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.455+0000 7ff529659700 1 --2- 172.21.15.103:0/1383583352 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff50c0044d0 0x7ff50c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:58.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.455+0000 7ff52a65b700 1 --2- 172.21.15.103:0/1383583352 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff5240b4820 0x7ff50c004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:58.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.455+0000 7ff529e5a700 1 -- 172.21.15.103:0/1383583352 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff5240b4820 msgr2=0x7ff50c004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:58.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.455+0000 7ff529e5a700 1 --2- 172.21.15.103:0/1383583352 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff5240b4820 0x7ff50c004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:58.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.455+0000 7ff529e5a700 1 -- 172.21.15.103:0/1383583352 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff50c0044d0 msgr2=0x7ff50c004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:58.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.455+0000 7ff529e5a700 1 --2- 172.21.15.103:0/1383583352 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff50c0044d0 0x7ff50c004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:58.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.455+0000 7ff529e5a700 1 -- 172.21.15.103:0/1383583352 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff50c003230 con 0x7ff50c0038b0 2020-04-22T14:05:58.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.455+0000 7ff529e5a700 1 --2- 172.21.15.103:0/1383583352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff50c0038b0 0x7ff50c003cb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff5140014a0 tx=0x7ff514001bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.455+0000 7ff529e5a700 1 --2- 172.21.15.103:0/1383583352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff50c0038b0 0x7ff50c003cb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff5140014a0 tx=0x7ff514001bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.455+0000 7ff529e5a700 1 --2- 172.21.15.103:0/1383583352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff50c0038b0 0x7ff50c003cb0 secure :-1 s=READY pgs=572 cs=0 l=1 rx=0x7ff5140014a0 tx=0x7ff514001bb0).ready entity=mon.1 client_cookie=49b78bfdbbb281fd server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:58.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.455+0000 7ff529e5a700 1 --2- 172.21.15.103:0/1383583352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff50c0038b0 0x7ff50c003cb0 secure :-1 s=THROTTLE_DONE pgs=572 cs=0 l=1 rx=0x7ff5140014a0 tx=0x7ff514001bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.455+0000 7ff528e58700 1 -- 172.21.15.103:0/1383583352 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff514010e90 con 0x7ff50c0038b0 2020-04-22T14:05:58.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.455+0000 7ff529e5a700 1 --2- 172.21.15.103:0/1383583352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff50c0038b0 0x7ff50c003cb0 secure :-1 s=THROTTLE_DONE pgs=572 cs=0 l=1 rx=0x7ff5140014a0 tx=0x7ff514001bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.455+0000 7ff529e5a700 1 --2- 172.21.15.103:0/1383583352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff50c0038b0 0x7ff50c003cb0 secure :-1 s=THROTTLE_DONE pgs=572 cs=0 l=1 rx=0x7ff5140014a0 tx=0x7ff514001bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.455+0000 7ff528e58700 1 -- 172.21.15.103:0/1383583352 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5140104a0 con 0x7ff50c0038b0 2020-04-22T14:05:58.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.455+0000 7ff528e58700 1 -- 172.21.15.103:0/1383583352 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff51400c700 con 0x7ff50c0038b0 2020-04-22T14:05:58.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.455+0000 7ff52c0be700 1 -- 172.21.15.103:0/1383583352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff50c0038b0 msgr2=0x7ff50c003cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:58.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.455+0000 7ff52c0be700 1 --2- 172.21.15.103:0/1383583352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff50c0038b0 0x7ff50c003cb0 secure :-1 s=READY pgs=572 cs=0 l=1 rx=0x7ff5140014a0 tx=0x7ff514001bb0).stop 2020-04-22T14:05:58.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.455+0000 7ff52a65b700 1 -- 172.21.15.103:0/1383583352 reap_dead start 2020-04-22T14:05:58.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.456+0000 7ff52c0be700 1 -- 172.21.15.103:0/1383583352 shutdown_connections 2020-04-22T14:05:58.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.456+0000 7ff52c0be700 1 -- 172.21.15.103:0/1383583352 >> 172.21.15.103:0/1383583352 conn(0x7ff52405b7b0 msgr2=0x7ff5240b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:58.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.456+0000 7ff52c0be700 1 -- 172.21.15.103:0/1383583352 shutdown_connections 2020-04-22T14:05:58.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.456+0000 7ff52c0be700 1 -- 172.21.15.103:0/1383583352 wait complete. 2020-04-22T14:05:58.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.457+0000 7ff52c0be700 1 Processor -- start 2020-04-22T14:05:58.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.457+0000 7ff52c0be700 1 -- start start 2020-04-22T14:05:58.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.457+0000 7ff52c0be700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff5240b8910 0x7ff5240b8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:58.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.457+0000 7ff52c0be700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff524062d30 0x7ff524063150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:58.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.457+0000 7ff52c0be700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5240aebe0 con 0x7ff5240649a0 2020-04-22T14:05:58.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.457+0000 7ff52c0be700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5240ae6a0 con 0x7ff5240b8910 2020-04-22T14:05:58.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.457+0000 7ff52c0be700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5240ae940 con 0x7ff524062d30 2020-04-22T14:05:58.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.458+0000 7ff529659700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff5240b8910 0x7ff5240b8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:58.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.458+0000 7ff529e5a700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff5240649a0 0x7ff524112380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41926/0 (socket says 172.21.15.103:41926) 2020-04-22T14:05:58.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.458+0000 7ff529e5a700 1 -- 172.21.15.103:0/1966216385 learned_addr learned my addr 172.21.15.103:0/1966216385 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:58.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.458+0000 7ff52a65b700 1 --2- 172.21.15.103:0/1966216385 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff524062d30 0x7ff524063150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:58.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.458+0000 7ff529659700 1 -- 172.21.15.103:0/1966216385 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff524062d30 msgr2=0x7ff524063150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:58.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.458+0000 7ff529659700 1 --2- 172.21.15.103:0/1966216385 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff524062d30 0x7ff524063150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:58.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.458+0000 7ff529659700 1 -- 172.21.15.103:0/1966216385 >> v1:172.21.15.103:6789/0 conn(0x7ff5240649a0 legacy=0x7ff524112380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:58.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.458+0000 7ff529659700 1 -- 172.21.15.103:0/1966216385 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5240ae270 con 0x7ff5240b8910 2020-04-22T14:05:58.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.458+0000 7ff512ffd700 1 -- 172.21.15.103:0/1966216385 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1582124725 0 0) 0x7ff5240aebe0 con 0x7ff5240649a0 2020-04-22T14:05:58.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.458+0000 7ff529659700 1 --2- 172.21.15.103:0/1966216385 >> v2:172.21.15.103:3300/0 conn(0x7ff5240b8910 0x7ff5240b8da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff520002f30 tx=0x7ff520010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.458+0000 7ff529659700 1 --2- 172.21.15.103:0/1966216385 >> v2:172.21.15.103:3300/0 conn(0x7ff5240b8910 0x7ff5240b8da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff520002f30 tx=0x7ff520010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.458+0000 7ff529659700 1 --2- 172.21.15.103:0/1966216385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5240b8910 0x7ff5240b8da0 secure :-1 s=READY pgs=574 cs=0 l=1 rx=0x7ff520002f30 tx=0x7ff520010bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:58.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.458+0000 7ff529659700 1 --2- 172.21.15.103:0/1966216385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5240b8910 0x7ff5240b8da0 secure :-1 s=THROTTLE_DONE pgs=574 cs=0 l=1 rx=0x7ff520002f30 tx=0x7ff520010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.458+0000 7ff512ffd700 1 -- 172.21.15.103:0/1966216385 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff520005e90 con 0x7ff5240b8910 2020-04-22T14:05:58.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.458+0000 7ff529659700 1 --2- 172.21.15.103:0/1966216385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5240b8910 0x7ff5240b8da0 secure :-1 s=THROTTLE_DONE pgs=574 cs=0 l=1 rx=0x7ff520002f30 tx=0x7ff520010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.458+0000 7ff529659700 1 --2- 172.21.15.103:0/1966216385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5240b8910 0x7ff5240b8da0 secure :-1 s=THROTTLE_DONE pgs=574 cs=0 l=1 rx=0x7ff520002f30 tx=0x7ff520010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.458+0000 7ff512ffd700 1 -- 172.21.15.103:0/1966216385 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff520007180 con 0x7ff5240b8910 2020-04-22T14:05:58.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.458+0000 7ff512ffd700 1 -- 172.21.15.103:0/1966216385 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff520007520 con 0x7ff5240b8910 2020-04-22T14:05:58.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.458+0000 7ff52c0be700 1 -- 172.21.15.103:0/1966216385 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5240ae400 con 0x7ff5240b8910 2020-04-22T14:05:58.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.458+0000 7ff52c0be700 1 -- 172.21.15.103:0/1966216385 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff524063770 con 0x7ff5240b8910 2020-04-22T14:05:58.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.459+0000 7ff529659700 1 --2- 172.21.15.103:0/1966216385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5240b8910 0x7ff5240b8da0 secure :-1 s=THROTTLE_DONE pgs=574 cs=0 l=1 rx=0x7ff520002f30 tx=0x7ff520010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.459+0000 7ff512ffd700 1 -- 172.21.15.103:0/1966216385 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ff5200083f0 con 0x7ff5240b8910 2020-04-22T14:05:58.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.459+0000 7ff529659700 1 --2- 172.21.15.103:0/1966216385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5240b8910 0x7ff5240b8da0 secure :-1 s=THROTTLE_DONE pgs=574 cs=0 l=1 rx=0x7ff520002f30 tx=0x7ff520010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.459+0000 7ff52c0be700 1 -- 172.21.15.103:0/1966216385 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff524062a20 con 0x7ff5240b8910 2020-04-22T14:05:58.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.459+0000 7ff512ffd700 1 --2- 172.21.15.103:0/1966216385 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff50404d920 0x7ff50404fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:58.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.459+0000 7ff512ffd700 1 -- 172.21.15.103:0/1966216385 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff520061360 con 0x7ff5240b8910 2020-04-22T14:05:58.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.460+0000 7ff529e5a700 1 --2- 172.21.15.103:0/1966216385 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff50404d920 0x7ff50404fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:58.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.460+0000 7ff529e5a700 1 --2- 172.21.15.103:0/1966216385 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff50404d920 0x7ff50404fde0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff5140013e0 tx=0x7ff514001bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.460+0000 7ff529e5a700 1 --2- 172.21.15.103:0/1966216385 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff50404d920 0x7ff50404fde0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff5140013e0 tx=0x7ff514001bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.460+0000 7ff529e5a700 1 --2- 172.21.15.103:0/1966216385 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff50404d920 0x7ff50404fde0 secure :-1 s=READY pgs=225 cs=0 l=1 rx=0x7ff5140013e0 tx=0x7ff514001bb0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:58.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.463+0000 7ff529659700 1 --2- 172.21.15.103:0/1966216385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5240b8910 0x7ff5240b8da0 secure :-1 s=THROTTLE_DONE pgs=574 cs=0 l=1 rx=0x7ff520002f30 tx=0x7ff520010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.463+0000 7ff512ffd700 1 -- 172.21.15.103:0/1966216385 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ff52003c6e0 con 0x7ff5240b8910 2020-04-22T14:05:58.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.605+0000 7ff52c0be700 1 -- 172.21.15.103:0/1966216385 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff524056c90 con 0x7ff5240b8910 2020-04-22T14:05:58.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.606+0000 7ff529659700 1 --2- 172.21.15.103:0/1966216385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5240b8910 0x7ff5240b8da0 secure :-1 s=THROTTLE_DONE pgs=574 cs=0 l=1 rx=0x7ff520002f30 tx=0x7ff520010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.606+0000 7ff512ffd700 1 -- 172.21.15.103:0/1966216385 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v45) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff52003fd00 con 0x7ff5240b8910 2020-04-22T14:05:58.608 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:05:58.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.607+0000 7ff52c0be700 1 -- 172.21.15.103:0/1966216385 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff50404d920 msgr2=0x7ff50404fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:58.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.607+0000 7ff52c0be700 1 --2- 172.21.15.103:0/1966216385 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff50404d920 0x7ff50404fde0 secure :-1 s=READY pgs=225 cs=0 l=1 rx=0x7ff5140013e0 tx=0x7ff514001bb0).stop 2020-04-22T14:05:58.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.607+0000 7ff52c0be700 1 -- 172.21.15.103:0/1966216385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5240b8910 msgr2=0x7ff5240b8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:58.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.607+0000 7ff52c0be700 1 --2- 172.21.15.103:0/1966216385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5240b8910 0x7ff5240b8da0 secure :-1 s=READY pgs=574 cs=0 l=1 rx=0x7ff520002f30 tx=0x7ff520010bd0).stop 2020-04-22T14:05:58.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.607+0000 7ff52c0be700 1 -- 172.21.15.103:0/1966216385 shutdown_connections 2020-04-22T14:05:58.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.607+0000 7ff52c0be700 1 --2- 172.21.15.103:0/1966216385 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff50404d920 0x7ff50404fde0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:58.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.607+0000 7ff52c0be700 1 --2- 172.21.15.103:0/1966216385 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff524062d30 0x7ff524063150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:58.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.607+0000 7ff52c0be700 1 --2- 172.21.15.103:0/1966216385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5240b8910 0x7ff5240b8da0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:58.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.607+0000 7ff52c0be700 1 -- 172.21.15.103:0/1966216385 >> 172.21.15.103:0/1966216385 conn(0x7ff52405b7b0 msgr2=0x7ff524140d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:58.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.607+0000 7ff52c0be700 1 -- 172.21.15.103:0/1966216385 shutdown_connections 2020-04-22T14:05:58.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.607+0000 7ff52c0be700 1 -- 172.21.15.103:0/1966216385 wait complete. 2020-04-22T14:05:58.619 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:58.633 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-22T14:05:58.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.779+0000 7fc520e3d700 1 Processor -- start 2020-04-22T14:05:58.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.779+0000 7fc520e3d700 1 -- start start 2020-04-22T14:05:58.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.780+0000 7fc520e3d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc51c0b9140 0x7fc51c12b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:58.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.780+0000 7fc520e3d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc51c12b670 0x7fc51c143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:58.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.780+0000 7fc520e3d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc51c1467e0 con 0x7fc51c0ac950 2020-04-22T14:05:58.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.780+0000 7fc520e3d700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc51c0602f0 con 0x7fc51c12b670 2020-04-22T14:05:58.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.780+0000 7fc520e3d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc51c060050 con 0x7fc51c0b9140 2020-04-22T14:05:58.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.781+0000 7fc51ad9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc51c12b670 0x7fc51c143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:58.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.781+0000 7fc519d9b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc51c0ac950 0x7fc51c146c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41934/0 (socket says 172.21.15.103:41934) 2020-04-22T14:05:58.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.781+0000 7fc519d9b700 1 -- 172.21.15.103:0/1756567128 learned_addr learned my addr 172.21.15.103:0/1756567128 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:58.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.781+0000 7fc51a59c700 1 --2- 172.21.15.103:0/1756567128 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc51c0b9140 0x7fc51c12b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:58.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.781+0000 7fc51ad9d700 1 -- 172.21.15.103:0/1756567128 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc51c0b9140 msgr2=0x7fc51c12b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:58.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.781+0000 7fc51ad9d700 1 --2- 172.21.15.103:0/1756567128 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc51c0b9140 0x7fc51c12b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:58.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.781+0000 7fc51ad9d700 1 -- 172.21.15.103:0/1756567128 >> v1:172.21.15.103:6789/0 conn(0x7fc51c0ac950 legacy=0x7fc51c146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:58.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.781+0000 7fc51ad9d700 1 -- 172.21.15.103:0/1756567128 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc51c0b9520 con 0x7fc51c12b670 2020-04-22T14:05:58.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.781+0000 7fc51959a700 1 -- 172.21.15.103:0/1756567128 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 762238266 0 0) 0x7fc51c1467e0 con 0x7fc51c0ac950 2020-04-22T14:05:58.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.781+0000 7fc51a59c700 1 --2- 172.21.15.103:0/1756567128 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc51c0b9140 0x7fc51c12b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:05:58.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.781+0000 7fc51ad9d700 1 --2- 172.21.15.103:0/1756567128 >> v2:172.21.15.103:3300/0 conn(0x7fc51c12b670 0x7fc51c143090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc5140032b0 tx=0x7fc514007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.781+0000 7fc51ad9d700 1 --2- 172.21.15.103:0/1756567128 >> v2:172.21.15.103:3300/0 conn(0x7fc51c12b670 0x7fc51c143090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc5140032b0 tx=0x7fc514007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.781+0000 7fc51ad9d700 1 --2- 172.21.15.103:0/1756567128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc51c12b670 0x7fc51c143090 secure :-1 s=READY pgs=576 cs=0 l=1 rx=0x7fc5140032b0 tx=0x7fc514007dc0).ready entity=mon.1 client_cookie=d0a81d40d7941e4f server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:58.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.781+0000 7fc51ad9d700 1 --2- 172.21.15.103:0/1756567128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc51c12b670 0x7fc51c143090 secure :-1 s=THROTTLE_DONE pgs=576 cs=0 l=1 rx=0x7fc5140032b0 tx=0x7fc514007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.781+0000 7fc51959a700 1 -- 172.21.15.103:0/1756567128 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc51400a180 con 0x7fc51c12b670 2020-04-22T14:05:58.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.781+0000 7fc51ad9d700 1 --2- 172.21.15.103:0/1756567128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc51c12b670 0x7fc51c143090 secure :-1 s=THROTTLE_DONE pgs=576 cs=0 l=1 rx=0x7fc5140032b0 tx=0x7fc514007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.781+0000 7fc51ad9d700 1 --2- 172.21.15.103:0/1756567128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc51c12b670 0x7fc51c143090 secure :-1 s=THROTTLE_DONE pgs=576 cs=0 l=1 rx=0x7fc5140032b0 tx=0x7fc514007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.781+0000 7fc51959a700 1 -- 172.21.15.103:0/1756567128 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51400a320 con 0x7fc51c12b670 2020-04-22T14:05:58.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.781+0000 7fc51959a700 1 -- 172.21.15.103:0/1756567128 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc51400a700 con 0x7fc51c12b670 2020-04-22T14:05:58.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.781+0000 7fc520e3d700 1 -- 172.21.15.103:0/1756567128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc51c12b670 msgr2=0x7fc51c143090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:58.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.781+0000 7fc520e3d700 1 --2- 172.21.15.103:0/1756567128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc51c12b670 0x7fc51c143090 secure :-1 s=READY pgs=576 cs=0 l=1 rx=0x7fc5140032b0 tx=0x7fc514007dc0).stop 2020-04-22T14:05:58.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.782+0000 7fc520e3d700 1 -- 172.21.15.103:0/1756567128 shutdown_connections 2020-04-22T14:05:58.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.782+0000 7fc520e3d700 1 --2- 172.21.15.103:0/1756567128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc51c12b670 0x7fc51c143090 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:58.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.782+0000 7fc520e3d700 1 --2- 172.21.15.103:0/1756567128 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc51c0b9140 0x7fc51c12b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:58.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.782+0000 7fc520e3d700 1 -- 172.21.15.103:0/1756567128 >> 172.21.15.103:0/1756567128 conn(0x7fc51c05b7b0 msgr2=0x7fc51c0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:58.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.782+0000 7fc520e3d700 1 -- 172.21.15.103:0/1756567128 shutdown_connections 2020-04-22T14:05:58.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.782+0000 7fc520e3d700 1 -- 172.21.15.103:0/1756567128 wait complete. 2020-04-22T14:05:58.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.783+0000 7fc520e3d700 1 Processor -- start 2020-04-22T14:05:58.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.783+0000 7fc520e3d700 1 -- start start 2020-04-22T14:05:58.792 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.783+0000 7fc520e3d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc51c0ac950 0x7fc51c0b8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:58.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.783+0000 7fc520e3d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc51c12b670 0x7fc51c1554b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:58.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.783+0000 7fc520e3d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc51c0b1860 con 0x7fc51c0b9140 2020-04-22T14:05:58.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.783+0000 7fc520e3d700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc51c0b1b00 con 0x7fc51c0ac950 2020-04-22T14:05:58.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.783+0000 7fc520e3d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc51c0b1da0 con 0x7fc51c12b670 2020-04-22T14:05:58.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.783+0000 7fc51a59c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc51c0ac950 0x7fc51c0b8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:58.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.783+0000 7fc519d9b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc51c0b9140 0x7fc51c0b2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41940/0 (socket says 172.21.15.103:41940) 2020-04-22T14:05:58.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.783+0000 7fc519d9b700 1 -- 172.21.15.103:0/1904334781 learned_addr learned my addr 172.21.15.103:0/1904334781 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:58.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.784+0000 7fc51a59c700 1 -- 172.21.15.103:0/1904334781 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc51c12b670 msgr2=0x7fc51c1554b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:58.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.784+0000 7fc51a59c700 1 --2- 172.21.15.103:0/1904334781 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc51c12b670 0x7fc51c1554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:58.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.784+0000 7fc5137fe700 1 -- 172.21.15.103:0/1904334781 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 646903594 0 0) 0x7fc51c0b1860 con 0x7fc51c0b9140 2020-04-22T14:05:58.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.784+0000 7fc51a59c700 1 -- 172.21.15.103:0/1904334781 >> v1:172.21.15.103:6789/0 conn(0x7fc51c0b9140 legacy=0x7fc51c0b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:58.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.784+0000 7fc51a59c700 1 -- 172.21.15.103:0/1904334781 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc51c155910 con 0x7fc51c0ac950 2020-04-22T14:05:58.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.784+0000 7fc51a59c700 1 --2- 172.21.15.103:0/1904334781 >> v2:172.21.15.103:3300/0 conn(0x7fc51c0ac950 0x7fc51c0b8590 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc50c002f30 tx=0x7fc50c010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.784+0000 7fc51a59c700 1 --2- 172.21.15.103:0/1904334781 >> v2:172.21.15.103:3300/0 conn(0x7fc51c0ac950 0x7fc51c0b8590 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc50c002f30 tx=0x7fc50c010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.784+0000 7fc51a59c700 1 --2- 172.21.15.103:0/1904334781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc51c0ac950 0x7fc51c0b8590 secure :-1 s=READY pgs=578 cs=0 l=1 rx=0x7fc50c002f30 tx=0x7fc50c010ad0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:58.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.784+0000 7fc51a59c700 1 --2- 172.21.15.103:0/1904334781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc51c0ac950 0x7fc51c0b8590 secure :-1 s=THROTTLE_DONE pgs=578 cs=0 l=1 rx=0x7fc50c002f30 tx=0x7fc50c010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.784+0000 7fc51a59c700 1 --2- 172.21.15.103:0/1904334781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc51c0ac950 0x7fc51c0b8590 secure :-1 s=THROTTLE_DONE pgs=578 cs=0 l=1 rx=0x7fc50c002f30 tx=0x7fc50c010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.784+0000 7fc5137fe700 1 -- 172.21.15.103:0/1904334781 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc50c007560 con 0x7fc51c0ac950 2020-04-22T14:05:58.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.784+0000 7fc51a59c700 1 --2- 172.21.15.103:0/1904334781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc51c0ac950 0x7fc51c0b8590 secure :-1 s=THROTTLE_DONE pgs=578 cs=0 l=1 rx=0x7fc50c002f30 tx=0x7fc50c010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.784+0000 7fc5137fe700 1 -- 172.21.15.103:0/1904334781 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc50c0089e0 con 0x7fc51c0ac950 2020-04-22T14:05:58.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.784+0000 7fc5137fe700 1 -- 172.21.15.103:0/1904334781 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc50c008dc0 con 0x7fc51c0ac950 2020-04-22T14:05:58.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.784+0000 7fc520e3d700 1 -- 172.21.15.103:0/1904334781 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc51c0b2950 con 0x7fc51c0ac950 2020-04-22T14:05:58.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.784+0000 7fc520e3d700 1 -- 172.21.15.103:0/1904334781 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc51c0b01d0 con 0x7fc51c0ac950 2020-04-22T14:05:58.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.785+0000 7fc51a59c700 1 --2- 172.21.15.103:0/1904334781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc51c0ac950 0x7fc51c0b8590 secure :-1 s=THROTTLE_DONE pgs=578 cs=0 l=1 rx=0x7fc50c002f30 tx=0x7fc50c010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.785+0000 7fc5137fe700 1 -- 172.21.15.103:0/1904334781 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fc50c0059c0 con 0x7fc51c0ac950 2020-04-22T14:05:58.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.785+0000 7fc51a59c700 1 --2- 172.21.15.103:0/1904334781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc51c0ac950 0x7fc51c0b8590 secure :-1 s=THROTTLE_DONE pgs=578 cs=0 l=1 rx=0x7fc50c002f30 tx=0x7fc50c010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.785+0000 7fc520e3d700 1 -- 172.21.15.103:0/1904334781 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc51c056c90 con 0x7fc51c0ac950 2020-04-22T14:05:58.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.785+0000 7fc5137fe700 1 --2- 172.21.15.103:0/1904334781 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc50004d890 0x7fc50004fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:58.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.785+0000 7fc5137fe700 1 -- 172.21.15.103:0/1904334781 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc50c061080 con 0x7fc51c0ac950 2020-04-22T14:05:58.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.786+0000 7fc519d9b700 1 --2- 172.21.15.103:0/1904334781 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc50004d890 0x7fc50004fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:58.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.786+0000 7fc519d9b700 1 --2- 172.21.15.103:0/1904334781 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc50004d890 0x7fc50004fd50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc5040012f0 tx=0x7fc5040017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.786+0000 7fc519d9b700 1 --2- 172.21.15.103:0/1904334781 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc50004d890 0x7fc50004fd50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc5040012f0 tx=0x7fc5040017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.786+0000 7fc519d9b700 1 --2- 172.21.15.103:0/1904334781 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc50004d890 0x7fc50004fd50 secure :-1 s=READY pgs=226 cs=0 l=1 rx=0x7fc5040012f0 tx=0x7fc5040017a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:58.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.790+0000 7fc51a59c700 1 --2- 172.21.15.103:0/1904334781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc51c0ac950 0x7fc51c0b8590 secure :-1 s=THROTTLE_DONE pgs=578 cs=0 l=1 rx=0x7fc50c002f30 tx=0x7fc50c010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.790+0000 7fc5137fe700 1 -- 172.21.15.103:0/1904334781 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fc50c03c460 con 0x7fc51c0ac950 2020-04-22T14:05:58.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.930+0000 7fc520e3d700 1 -- 172.21.15.103:0/1904334781 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc51c06a960 con 0x7fc51c0ac950 2020-04-22T14:05:58.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.930+0000 7fc51a59c700 1 --2- 172.21.15.103:0/1904334781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc51c0ac950 0x7fc51c0b8590 secure :-1 s=THROTTLE_DONE pgs=578 cs=0 l=1 rx=0x7fc50c002f30 tx=0x7fc50c010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:58.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.931+0000 7fc5137fe700 1 -- 172.21.15.103:0/1904334781 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v45) v1 ==== 104+0+10 (secure 0 0 0) 0x7fc50c03fa80 con 0x7fc51c0ac950 2020-04-22T14:05:58.933 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:05:58.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.932+0000 7fc520e3d700 1 -- 172.21.15.103:0/1904334781 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc50004d890 msgr2=0x7fc50004fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:58.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.932+0000 7fc520e3d700 1 --2- 172.21.15.103:0/1904334781 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc50004d890 0x7fc50004fd50 secure :-1 s=READY pgs=226 cs=0 l=1 rx=0x7fc5040012f0 tx=0x7fc5040017a0).stop 2020-04-22T14:05:58.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.932+0000 7fc520e3d700 1 -- 172.21.15.103:0/1904334781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc51c0ac950 msgr2=0x7fc51c0b8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:58.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.932+0000 7fc520e3d700 1 --2- 172.21.15.103:0/1904334781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc51c0ac950 0x7fc51c0b8590 secure :-1 s=READY pgs=578 cs=0 l=1 rx=0x7fc50c002f30 tx=0x7fc50c010ad0).stop 2020-04-22T14:05:58.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.932+0000 7fc520e3d700 1 -- 172.21.15.103:0/1904334781 shutdown_connections 2020-04-22T14:05:58.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.932+0000 7fc520e3d700 1 --2- 172.21.15.103:0/1904334781 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc50004d890 0x7fc50004fd50 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:58.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.932+0000 7fc520e3d700 1 --2- 172.21.15.103:0/1904334781 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc51c12b670 0x7fc51c1554b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:58.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.932+0000 7fc520e3d700 1 --2- 172.21.15.103:0/1904334781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc51c0ac950 0x7fc51c0b8590 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:58.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.932+0000 7fc520e3d700 1 -- 172.21.15.103:0/1904334781 >> 172.21.15.103:0/1904334781 conn(0x7fc51c05b7b0 msgr2=0x7fc51c0ae680 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:58.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.932+0000 7fc520e3d700 1 -- 172.21.15.103:0/1904334781 shutdown_connections 2020-04-22T14:05:58.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:58.932+0000 7fc520e3d700 1 -- 172.21.15.103:0/1904334781 wait complete. 2020-04-22T14:05:58.944 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:58.957 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-22T14:05:59.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.103+0000 7fb314a0b700 1 Processor -- start 2020-04-22T14:05:59.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.103+0000 7fb314a0b700 1 -- start start 2020-04-22T14:05:59.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.104+0000 7fb314a0b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3100bcc50 0x7fb310146f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:59.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.104+0000 7fb314a0b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb31005fc70 0x7fb31014a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:59.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.104+0000 7fb314a0b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb31012bec0 0x7fb31012c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:59.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.104+0000 7fb314a0b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb310146370 con 0x7fb31012bec0 2020-04-22T14:05:59.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.104+0000 7fb314a0b700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb310146560 con 0x7fb31005fc70 2020-04-22T14:05:59.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.104+0000 7fb314a0b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb310146800 con 0x7fb3100bcc50 2020-04-22T14:05:59.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.104+0000 7fb30e59c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb31005fc70 0x7fb31014a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:59.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.104+0000 7fb30e59c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb31005fc70 0x7fb31014a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49756/0 (socket says 172.21.15.103:49756) 2020-04-22T14:05:59.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.104+0000 7fb30e59c700 1 -- 172.21.15.103:0/57877169 learned_addr learned my addr 172.21.15.103:0/57877169 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:05:59.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.105+0000 7fb30f59e700 1 --2- 172.21.15.103:0/57877169 >> v2:172.21.15.86:3300/0 conn(0x7fb31012bec0 0x7fb31012c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:59.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.105+0000 7fb30ed9d700 1 --2- 172.21.15.103:0/57877169 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3100bcc50 0x7fb310146f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:59.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.105+0000 7fb30e59c700 1 -- 172.21.15.103:0/57877169 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3100bcc50 msgr2=0x7fb310146f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:59.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.105+0000 7fb30e59c700 1 --2- 172.21.15.103:0/57877169 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3100bcc50 0x7fb310146f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:59.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.105+0000 7fb30e59c700 1 -- 172.21.15.103:0/57877169 >> v2:172.21.15.86:3300/0 conn(0x7fb31012bec0 msgr2=0x7fb31012c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:59.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.105+0000 7fb30e59c700 1 --2- 172.21.15.103:0/57877169 >> v2:172.21.15.86:3300/0 conn(0x7fb31012bec0 0x7fb31012c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:59.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.105+0000 7fb30e59c700 1 -- 172.21.15.103:0/57877169 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb310146aa0 con 0x7fb31005fc70 2020-04-22T14:05:59.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.105+0000 7fb30ed9d700 1 --2- 172.21.15.103:0/57877169 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3100bcc50 0x7fb310146f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:05:59.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.105+0000 7fb30f59e700 1 --2- 172.21.15.103:0/57877169 >> v2:172.21.15.86:3300/0 conn(0x7fb31012bec0 0x7fb31012c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:05:59.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.105+0000 7fb30e59c700 1 --2- 172.21.15.103:0/57877169 >> v2:172.21.15.103:3300/0 conn(0x7fb31005fc70 0x7fb31014a350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb2f8002f30 tx=0x7fb2f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:59.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.105+0000 7fb30e59c700 1 --2- 172.21.15.103:0/57877169 >> v2:172.21.15.103:3300/0 conn(0x7fb31005fc70 0x7fb31014a350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb2f8002f30 tx=0x7fb2f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:59.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.105+0000 7fb30e59c700 1 --2- 172.21.15.103:0/57877169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb31005fc70 0x7fb31014a350 secure :-1 s=READY pgs=579 cs=0 l=1 rx=0x7fb2f8002f30 tx=0x7fb2f8007a40).ready entity=mon.1 client_cookie=8217bd24c0a8ab09 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:59.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.105+0000 7fb30e59c700 1 --2- 172.21.15.103:0/57877169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb31005fc70 0x7fb31014a350 secure :-1 s=THROTTLE_DONE pgs=579 cs=0 l=1 rx=0x7fb2f8002f30 tx=0x7fb2f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:59.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.105+0000 7fb30dd9b700 1 -- 172.21.15.103:0/57877169 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2f8011720 con 0x7fb31005fc70 2020-04-22T14:05:59.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.105+0000 7fb30e59c700 1 --2- 172.21.15.103:0/57877169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb31005fc70 0x7fb31014a350 secure :-1 s=THROTTLE_DONE pgs=579 cs=0 l=1 rx=0x7fb2f8002f30 tx=0x7fb2f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:59.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.105+0000 7fb30e59c700 1 --2- 172.21.15.103:0/57877169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb31005fc70 0x7fb31014a350 secure :-1 s=THROTTLE_DONE pgs=579 cs=0 l=1 rx=0x7fb2f8002f30 tx=0x7fb2f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:59.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.105+0000 7fb30dd9b700 1 -- 172.21.15.103:0/57877169 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f8011880 con 0x7fb31005fc70 2020-04-22T14:05:59.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.105+0000 7fb30dd9b700 1 -- 172.21.15.103:0/57877169 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2f8011ca0 con 0x7fb31005fc70 2020-04-22T14:05:59.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.105+0000 7fb314a0b700 1 -- 172.21.15.103:0/57877169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb31005fc70 msgr2=0x7fb31014a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:59.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.105+0000 7fb314a0b700 1 --2- 172.21.15.103:0/57877169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb31005fc70 0x7fb31014a350 secure :-1 s=READY pgs=579 cs=0 l=1 rx=0x7fb2f8002f30 tx=0x7fb2f8007a40).stop 2020-04-22T14:05:59.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.106+0000 7fb314a0b700 1 -- 172.21.15.103:0/57877169 shutdown_connections 2020-04-22T14:05:59.117 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.106+0000 7fb314a0b700 1 --2- 172.21.15.103:0/57877169 >> v2:172.21.15.86:3300/0 conn(0x7fb31012bec0 0x7fb31012c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:59.117 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.106+0000 7fb314a0b700 1 --2- 172.21.15.103:0/57877169 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3100bcc50 0x7fb310146f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:59.117 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.106+0000 7fb314a0b700 1 --2- 172.21.15.103:0/57877169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb31005fc70 0x7fb31014a350 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:59.117 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.106+0000 7fb314a0b700 1 -- 172.21.15.103:0/57877169 >> 172.21.15.103:0/57877169 conn(0x7fb310065af0 msgr2=0x7fb310065f00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:59.117 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.106+0000 7fb314a0b700 1 -- 172.21.15.103:0/57877169 shutdown_connections 2020-04-22T14:05:59.117 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.106+0000 7fb314a0b700 1 -- 172.21.15.103:0/57877169 wait complete. 2020-04-22T14:05:59.117 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.107+0000 7fb314a0b700 1 Processor -- start 2020-04-22T14:05:59.118 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.107+0000 7fb314a0b700 1 -- start start 2020-04-22T14:05:59.118 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.107+0000 7fb314a0b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb31005fc70 0x7fb310147f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:59.118 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.107+0000 7fb314a0b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb31012bec0 0x7fb31012ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:59.118 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.107+0000 7fb314a0b700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb310147540 con 0x7fb3100bcc50 2020-04-22T14:05:59.118 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.107+0000 7fb314a0b700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb31012dcd0 con 0x7fb31012bec0 2020-04-22T14:05:59.118 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.107+0000 7fb314a0b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3101477e0 con 0x7fb31005fc70 2020-04-22T14:05:59.119 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.107+0000 7fb30f59e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb31012bec0 0x7fb31012ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:59.119 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.107+0000 7fb30e59c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb3100bcc50 0x7fb31012b160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41954/0 (socket says 172.21.15.103:41954) 2020-04-22T14:05:59.119 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.107+0000 7fb30e59c700 1 -- 172.21.15.103:0/278171060 learned_addr learned my addr 172.21.15.103:0/278171060 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:59.119 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.107+0000 7fb30ed9d700 1 --2- 172.21.15.103:0/278171060 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb31005fc70 0x7fb310147f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:59.119 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.108+0000 7fb30f59e700 1 -- 172.21.15.103:0/278171060 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb31005fc70 msgr2=0x7fb310147f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:59.119 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.108+0000 7fb30f59e700 1 --2- 172.21.15.103:0/278171060 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb31005fc70 0x7fb310147f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:59.120 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.108+0000 7fb30f59e700 1 -- 172.21.15.103:0/278171060 >> v1:172.21.15.103:6789/0 conn(0x7fb3100bcc50 legacy=0x7fb31012b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:59.120 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.108+0000 7fb307fff700 1 -- 172.21.15.103:0/278171060 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3466288815 0 0) 0x7fb310147540 con 0x7fb3100bcc50 2020-04-22T14:05:59.120 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.108+0000 7fb30f59e700 1 -- 172.21.15.103:0/278171060 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb310147a80 con 0x7fb31012bec0 2020-04-22T14:05:59.120 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.108+0000 7fb30f59e700 1 --2- 172.21.15.103:0/278171060 >> v2:172.21.15.103:3300/0 conn(0x7fb31012bec0 0x7fb31012ef90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb3080032b0 tx=0x7fb308010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:59.120 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.108+0000 7fb30f59e700 1 --2- 172.21.15.103:0/278171060 >> v2:172.21.15.103:3300/0 conn(0x7fb31012bec0 0x7fb31012ef90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb3080032b0 tx=0x7fb308010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:59.121 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.108+0000 7fb30f59e700 1 --2- 172.21.15.103:0/278171060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb31012bec0 0x7fb31012ef90 secure :-1 s=READY pgs=581 cs=0 l=1 rx=0x7fb3080032b0 tx=0x7fb308010c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:59.121 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.108+0000 7fb30f59e700 1 --2- 172.21.15.103:0/278171060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb31012bec0 0x7fb31012ef90 secure :-1 s=THROTTLE_DONE pgs=581 cs=0 l=1 rx=0x7fb3080032b0 tx=0x7fb308010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:59.121 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.108+0000 7fb307fff700 1 -- 172.21.15.103:0/278171060 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb308005e30 con 0x7fb31012bec0 2020-04-22T14:05:59.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.108+0000 7fb30f59e700 1 --2- 172.21.15.103:0/278171060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb31012bec0 0x7fb31012ef90 secure :-1 s=THROTTLE_DONE pgs=581 cs=0 l=1 rx=0x7fb3080032b0 tx=0x7fb308010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:59.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.108+0000 7fb30f59e700 1 --2- 172.21.15.103:0/278171060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb31012bec0 0x7fb31012ef90 secure :-1 s=THROTTLE_DONE pgs=581 cs=0 l=1 rx=0x7fb3080032b0 tx=0x7fb308010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:59.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.108+0000 7fb307fff700 1 -- 172.21.15.103:0/278171060 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb308007560 con 0x7fb31012bec0 2020-04-22T14:05:59.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.108+0000 7fb314a0b700 1 -- 172.21.15.103:0/278171060 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb31012b870 con 0x7fb31012bec0 2020-04-22T14:05:59.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.108+0000 7fb307fff700 1 -- 172.21.15.103:0/278171060 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb308007900 con 0x7fb31012bec0 2020-04-22T14:05:59.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.108+0000 7fb314a0b700 1 -- 172.21.15.103:0/278171060 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb310149e70 con 0x7fb31012bec0 2020-04-22T14:05:59.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.109+0000 7fb30f59e700 1 --2- 172.21.15.103:0/278171060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb31012bec0 0x7fb31012ef90 secure :-1 s=THROTTLE_DONE pgs=581 cs=0 l=1 rx=0x7fb3080032b0 tx=0x7fb308010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:59.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.109+0000 7fb314a0b700 1 -- 172.21.15.103:0/278171060 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb310147c10 con 0x7fb31012bec0 2020-04-22T14:05:59.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.109+0000 7fb307fff700 1 -- 172.21.15.103:0/278171060 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fb3080122e0 con 0x7fb31012bec0 2020-04-22T14:05:59.124 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.109+0000 7fb30f59e700 1 --2- 172.21.15.103:0/278171060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb31012bec0 0x7fb31012ef90 secure :-1 s=THROTTLE_DONE pgs=581 cs=0 l=1 rx=0x7fb3080032b0 tx=0x7fb308010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:59.124 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.109+0000 7fb307fff700 1 --2- 172.21.15.103:0/278171060 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb2f404d8b0 0x7fb2f404fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:59.124 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.109+0000 7fb307fff700 1 -- 172.21.15.103:0/278171060 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb3080618d0 con 0x7fb31012bec0 2020-04-22T14:05:59.124 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.109+0000 7fb30ed9d700 1 --2- 172.21.15.103:0/278171060 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb2f404d8b0 0x7fb2f404fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:59.124 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.110+0000 7fb30ed9d700 1 --2- 172.21.15.103:0/278171060 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb2f404d8b0 0x7fb2f404fd70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb300002f30 tx=0x7fb30000e190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:59.124 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.110+0000 7fb30ed9d700 1 --2- 172.21.15.103:0/278171060 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb2f404d8b0 0x7fb2f404fd70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb300002f30 tx=0x7fb30000e190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:59.124 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.110+0000 7fb30ed9d700 1 --2- 172.21.15.103:0/278171060 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb2f404d8b0 0x7fb2f404fd70 secure :-1 s=READY pgs=227 cs=0 l=1 rx=0x7fb300002f30 tx=0x7fb30000e190).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:59.125 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.113+0000 7fb30f59e700 1 --2- 172.21.15.103:0/278171060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb31012bec0 0x7fb31012ef90 secure :-1 s=THROTTLE_DONE pgs=581 cs=0 l=1 rx=0x7fb3080032b0 tx=0x7fb308010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:59.125 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.113+0000 7fb307fff700 1 -- 172.21.15.103:0/278171060 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fb30803cc50 con 0x7fb31012bec0 2020-04-22T14:05:59.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.255+0000 7fb314a0b700 1 -- 172.21.15.103:0/278171060 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb310056c90 con 0x7fb31012bec0 2020-04-22T14:05:59.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.255+0000 7fb30f59e700 1 --2- 172.21.15.103:0/278171060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb31012bec0 0x7fb31012ef90 secure :-1 s=THROTTLE_DONE pgs=581 cs=0 l=1 rx=0x7fb3080032b0 tx=0x7fb308010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:59.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.255+0000 7fb307fff700 1 -- 172.21.15.103:0/278171060 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v45) v1 ==== 100+0+10 (secure 0 0 0) 0x7fb308040270 con 0x7fb31012bec0 2020-04-22T14:05:59.259 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:05:59.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.256+0000 7fb314a0b700 1 -- 172.21.15.103:0/278171060 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb2f404d8b0 msgr2=0x7fb2f404fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:59.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.256+0000 7fb314a0b700 1 --2- 172.21.15.103:0/278171060 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb2f404d8b0 0x7fb2f404fd70 secure :-1 s=READY pgs=227 cs=0 l=1 rx=0x7fb300002f30 tx=0x7fb30000e190).stop 2020-04-22T14:05:59.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.256+0000 7fb314a0b700 1 -- 172.21.15.103:0/278171060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb31012bec0 msgr2=0x7fb31012ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:59.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.256+0000 7fb314a0b700 1 --2- 172.21.15.103:0/278171060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb31012bec0 0x7fb31012ef90 secure :-1 s=READY pgs=581 cs=0 l=1 rx=0x7fb3080032b0 tx=0x7fb308010c40).stop 2020-04-22T14:05:59.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.257+0000 7fb314a0b700 1 -- 172.21.15.103:0/278171060 shutdown_connections 2020-04-22T14:05:59.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.257+0000 7fb314a0b700 1 --2- 172.21.15.103:0/278171060 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb2f404d8b0 0x7fb2f404fd70 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:59.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.257+0000 7fb314a0b700 1 --2- 172.21.15.103:0/278171060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb31012bec0 0x7fb31012ef90 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:59.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.257+0000 7fb314a0b700 1 --2- 172.21.15.103:0/278171060 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb31005fc70 0x7fb310147f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:59.263 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.257+0000 7fb314a0b700 1 -- 172.21.15.103:0/278171060 >> 172.21.15.103:0/278171060 conn(0x7fb310065af0 msgr2=0x7fb310145c10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:59.263 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.257+0000 7fb314a0b700 1 -- 172.21.15.103:0/278171060 shutdown_connections 2020-04-22T14:05:59.263 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.257+0000 7fb314a0b700 1 -- 172.21.15.103:0/278171060 wait complete. 2020-04-22T14:05:59.269 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-04-22T14:05:59.269 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:59.283 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:05:59.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.427+0000 7f5607814700 1 Processor -- start 2020-04-22T14:05:59.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.427+0000 7f5607814700 1 -- start start 2020-04-22T14:05:59.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.428+0000 7f5607814700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f56000b6040 0x7f56000ac740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:59.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.428+0000 7f5607814700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f56001426d0 0x7f5600142b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:59.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.428+0000 7f5607814700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5600064ec0 con 0x7f5600067170 2020-04-22T14:05:59.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.428+0000 7f5607814700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5600065af0 con 0x7f56000b6040 2020-04-22T14:05:59.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.428+0000 7f5607814700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5600146870 con 0x7f56001426d0 2020-04-22T14:05:59.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.428+0000 7f56055b0700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f5600067170 0x7f560013c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41960/0 (socket says 172.21.15.103:41960) 2020-04-22T14:05:59.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.428+0000 7f56055b0700 1 -- 172.21.15.103:0/1870714182 learned_addr learned my addr 172.21.15.103:0/1870714182 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:05:59.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.429+0000 7f5605db1700 1 --2- 172.21.15.103:0/1870714182 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f56001426d0 0x7f5600142b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:59.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.429+0000 7f55f3fff700 1 -- 172.21.15.103:0/1870714182 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2464273312 0 0) 0x7f5600064ec0 con 0x7f5600067170 2020-04-22T14:05:59.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.429+0000 7f55f3fff700 1 -- 172.21.15.103:0/1870714182 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55e8003230 con 0x7f5600067170 2020-04-22T14:05:59.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.429+0000 7f5604daf700 1 --2- 172.21.15.103:0/1870714182 >> v2:172.21.15.86:3300/0 conn(0x7f56000b6040 0x7f56000ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:59.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.429+0000 7f55f3fff700 1 -- 172.21.15.103:0/1870714182 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 511230094 0 0) 0x7f55e8003230 con 0x7f5600067170 2020-04-22T14:05:59.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.429+0000 7f55f3fff700 1 -- 172.21.15.103:0/1870714182 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f56001426d0 msgr2=0x7f5600142b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:59.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.429+0000 7f55f3fff700 1 --2- 172.21.15.103:0/1870714182 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f56001426d0 0x7f5600142b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:59.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.429+0000 7f55f3fff700 1 -- 172.21.15.103:0/1870714182 >> v2:172.21.15.86:3300/0 conn(0x7f56000b6040 msgr2=0x7f56000ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:59.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.429+0000 7f55f3fff700 1 --2- 172.21.15.103:0/1870714182 >> v2:172.21.15.86:3300/0 conn(0x7f56000b6040 0x7f56000ac740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:59.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.429+0000 7f55f3fff700 1 -- 172.21.15.103:0/1870714182 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5600067550 con 0x7f5600067170 2020-04-22T14:05:59.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.429+0000 7f55f3fff700 1 -- 172.21.15.103:0/1870714182 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f55f40016d0 con 0x7f5600067170 2020-04-22T14:05:59.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.429+0000 7f5604daf700 1 --2- 172.21.15.103:0/1870714182 >> v2:172.21.15.86:3300/0 conn(0x7f56000b6040 0x7f56000ac740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:05:59.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.429+0000 7f55f3fff700 1 -- 172.21.15.103:0/1870714182 >> v1:172.21.15.103:6789/0 conn(0x7f5600067170 legacy=0x7f560013c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:59.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.429+0000 7f55f3fff700 1 --2- 172.21.15.103:0/1870714182 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e8003720 0x7f55e8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:59.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.429+0000 7f55f3fff700 1 --2- 172.21.15.103:0/1870714182 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f56001426d0 0x7f55e80044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:59.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.429+0000 7f55f3fff700 1 --2- 172.21.15.103:0/1870714182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f55e8004930 0x7f55e8004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:05:59.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.429+0000 7f55f3fff700 1 -- 172.21.15.103:0/1870714182 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5600065af0 con 0x7f55e8004930 2020-04-22T14:05:59.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.429+0000 7f55f3fff700 1 -- 172.21.15.103:0/1870714182 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5600146870 con 0x7f55e8003720 2020-04-22T14:05:59.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.429+0000 7f55f3fff700 1 -- 172.21.15.103:0/1870714182 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e8005380 con 0x7f56001426d0 2020-04-22T14:05:59.451 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.429+0000 7f56055b0700 1 --2- 172.21.15.103:0/1870714182 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e8003720 0x7f55e8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:59.451 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.429+0000 7f5604daf700 1 --2- 172.21.15.103:0/1870714182 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f56001426d0 0x7f55e80044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:59.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.429+0000 7f5605db1700 1 --2- 172.21.15.103:0/1870714182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f55e8004930 0x7f55e8004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:59.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.429+0000 7f56055b0700 1 -- 172.21.15.103:0/1870714182 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f56001426d0 msgr2=0x7f55e80044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:59.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.429+0000 7f56055b0700 1 --2- 172.21.15.103:0/1870714182 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f56001426d0 0x7f55e80044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:59.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.429+0000 7f56055b0700 1 -- 172.21.15.103:0/1870714182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f55e8004930 msgr2=0x7f55e8004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:05:59.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.429+0000 7f56055b0700 1 --2- 172.21.15.103:0/1870714182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f55e8004930 0x7f55e8004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:05:59.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.429+0000 7f56055b0700 1 -- 172.21.15.103:0/1870714182 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e8003230 con 0x7f55e8003720 2020-04-22T14:05:59.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.429+0000 7f5605db1700 1 --2- 172.21.15.103:0/1870714182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f55e8004930 0x7f55e8004db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:05:59.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.429+0000 7f56055b0700 1 --2- 172.21.15.103:0/1870714182 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e8003720 0x7f55e8003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f55f40013e0 tx=0x7f56000676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:59.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.429+0000 7f56055b0700 1 --2- 172.21.15.103:0/1870714182 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e8003720 0x7f55e8003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f55f40013e0 tx=0x7f56000676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:59.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.429+0000 7f56055b0700 1 --2- 172.21.15.103:0/1870714182 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e8003720 0x7f55e8003b40 secure :-1 s=READY pgs=583 cs=0 l=1 rx=0x7f55f40013e0 tx=0x7f56000676e0).ready entity=mon.1 client_cookie=b00ea5b2e3094086 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:59.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.430+0000 7f56055b0700 1 --2- 172.21.15.103:0/1870714182 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e8003720 0x7f55e8003b40 secure :-1 s=THROTTLE_DONE pgs=583 cs=0 l=1 rx=0x7f55f40013e0 tx=0x7f56000676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:59.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.430+0000 7f55f3fff700 1 -- 172.21.15.103:0/1870714182 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55f400e180 con 0x7f55e8003720 2020-04-22T14:05:59.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.430+0000 7f56055b0700 1 --2- 172.21.15.103:0/1870714182 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e8003720 0x7f55e8003b40 secure :-1 s=THROTTLE_DONE pgs=583 cs=0 l=1 rx=0x7f55f40013e0 tx=0x7f56000676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:59.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.430+0000 7f56055b0700 1 --2- 172.21.15.103:0/1870714182 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e8003720 0x7f55e8003b40 secure :-1 s=THROTTLE_DONE pgs=583 cs=0 l=1 rx=0x7f55f40013e0 tx=0x7f56000676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:59.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.430+0000 7f55f3fff700 1 -- 172.21.15.103:0/1870714182 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f400e320 con 0x7f55e8003720 2020-04-22T14:05:59.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.430+0000 7f55f3fff700 1 -- 172.21.15.103:0/1870714182 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55f400e6c0 con 0x7f55e8003720 2020-04-22T14:05:59.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.430+0000 7f5607814700 1 -- 172.21.15.103:0/1870714182 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e8003720 msgr2=0x7f55e8003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:59.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.430+0000 7f5607814700 1 --2- 172.21.15.103:0/1870714182 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e8003720 0x7f55e8003b40 secure :-1 s=READY pgs=583 cs=0 l=1 rx=0x7f55f40013e0 tx=0x7f56000676e0).stop 2020-04-22T14:05:59.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.430+0000 7f5605db1700 1 -- 172.21.15.103:0/1870714182 reap_dead start 2020-04-22T14:05:59.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.430+0000 7f5607814700 1 -- 172.21.15.103:0/1870714182 shutdown_connections 2020-04-22T14:05:59.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.430+0000 7f5607814700 1 -- 172.21.15.103:0/1870714182 >> 172.21.15.103:0/1870714182 conn(0x7f56000b9160 msgr2=0x7f560005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:59.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.430+0000 7f5607814700 1 -- 172.21.15.103:0/1870714182 shutdown_connections 2020-04-22T14:05:59.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.430+0000 7f5607814700 1 -- 172.21.15.103:0/1870714182 wait complete. 2020-04-22T14:05:59.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.431+0000 7f5607814700 1 Processor -- start 2020-04-22T14:05:59.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.431+0000 7f5607814700 1 -- start start 2020-04-22T14:05:59.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.432+0000 7f5607814700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5600144d40 0x7f56001326f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:59.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.432+0000 7f5607814700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5600133870 0x7f560013df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:59.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.432+0000 7f5607814700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56001348a0 con 0x7f5600132cb0 2020-04-22T14:05:59.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.432+0000 7f5607814700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f560013bae0 con 0x7f5600133870 2020-04-22T14:05:59.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.432+0000 7f5607814700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f560013cc90 con 0x7f5600144d40 2020-04-22T14:05:59.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.432+0000 7f56055b0700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5600144d40 0x7f56001326f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:59.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.432+0000 7f56055b0700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5600144d40 0x7f56001326f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49782/0 (socket says 172.21.15.103:49782) 2020-04-22T14:05:59.466 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.432+0000 7f56055b0700 1 -- 172.21.15.103:0/1961231296 learned_addr learned my addr 172.21.15.103:0/1961231296 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:05:59.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.432+0000 7f5605db1700 1 --2- 172.21.15.103:0/1961231296 >> v2:172.21.15.86:3300/0 conn(0x7f5600133870 0x7f560013df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:59.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.432+0000 7f56055b0700 1 -- 172.21.15.103:0/1961231296 >> v2:172.21.15.86:3300/0 conn(0x7f5600133870 msgr2=0x7f560013df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:59.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.432+0000 7f56055b0700 1 --2- 172.21.15.103:0/1961231296 >> v2:172.21.15.86:3300/0 conn(0x7f5600133870 0x7f560013df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:59.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.432+0000 7f56055b0700 1 -- 172.21.15.103:0/1961231296 >> v1:172.21.15.86:6789/0 conn(0x7f5600132cb0 legacy=0x7f5600133160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:59.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.432+0000 7f56055b0700 1 -- 172.21.15.103:0/1961231296 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f560013b840 con 0x7f5600144d40 2020-04-22T14:05:59.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.432+0000 7f56055b0700 1 --2- 172.21.15.103:0/1961231296 >> v2:172.21.15.103:3300/0 conn(0x7f5600144d40 0x7f56001326f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f560013de70 tx=0x7f56000676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:59.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.432+0000 7f56055b0700 1 --2- 172.21.15.103:0/1961231296 >> v2:172.21.15.103:3300/0 conn(0x7f5600144d40 0x7f56001326f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f560013de70 tx=0x7f56000676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:59.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.432+0000 7f56055b0700 1 --2- 172.21.15.103:0/1961231296 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5600144d40 0x7f56001326f0 secure :-1 s=READY pgs=584 cs=0 l=1 rx=0x7f560013de70 tx=0x7f56000676e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:59.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.432+0000 7f56055b0700 1 --2- 172.21.15.103:0/1961231296 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5600144d40 0x7f56001326f0 secure :-1 s=THROTTLE_DONE pgs=584 cs=0 l=1 rx=0x7f560013de70 tx=0x7f56000676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:59.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.432+0000 7f55f27fc700 1 -- 172.21.15.103:0/1961231296 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55f40184a0 con 0x7f5600144d40 2020-04-22T14:05:59.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.432+0000 7f56055b0700 1 --2- 172.21.15.103:0/1961231296 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5600144d40 0x7f56001326f0 secure :-1 s=THROTTLE_DONE pgs=584 cs=0 l=1 rx=0x7f560013de70 tx=0x7f56000676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:59.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.432+0000 7f56055b0700 1 --2- 172.21.15.103:0/1961231296 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5600144d40 0x7f56001326f0 secure :-1 s=THROTTLE_DONE pgs=584 cs=0 l=1 rx=0x7f560013de70 tx=0x7f56000676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:59.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.432+0000 7f55f27fc700 1 -- 172.21.15.103:0/1961231296 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f4018600 con 0x7f5600144d40 2020-04-22T14:05:59.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.432+0000 7f55f27fc700 1 -- 172.21.15.103:0/1961231296 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55f4018960 con 0x7f5600144d40 2020-04-22T14:05:59.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.432+0000 7f5607814700 1 -- 172.21.15.103:0/1961231296 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5600145120 con 0x7f5600144d40 2020-04-22T14:05:59.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.433+0000 7f5607814700 1 -- 172.21.15.103:0/1961231296 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f560013fd30 con 0x7f5600144d40 2020-04-22T14:05:59.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.433+0000 7f56055b0700 1 --2- 172.21.15.103:0/1961231296 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5600144d40 0x7f56001326f0 secure :-1 s=THROTTLE_DONE pgs=584 cs=0 l=1 rx=0x7f560013de70 tx=0x7f56000676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:59.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.433+0000 7f55f27fc700 1 -- 172.21.15.103:0/1961231296 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f55f4018bd0 con 0x7f5600144d40 2020-04-22T14:05:59.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.433+0000 7f56055b0700 1 --2- 172.21.15.103:0/1961231296 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5600144d40 0x7f56001326f0 secure :-1 s=THROTTLE_DONE pgs=584 cs=0 l=1 rx=0x7f560013de70 tx=0x7f56000676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:59.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.434+0000 7f5607814700 1 -- 172.21.15.103:0/1961231296 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5600056c90 con 0x7f5600144d40 2020-04-22T14:05:59.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.434+0000 7f55f27fc700 1 --2- 172.21.15.103:0/1961231296 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f55e004da10 0x7f55e004fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:05:59.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.434+0000 7f55f27fc700 1 -- 172.21.15.103:0/1961231296 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f55f4065cb0 con 0x7f5600144d40 2020-04-22T14:05:59.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.434+0000 7f5604daf700 1 --2- 172.21.15.103:0/1961231296 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f55e004da10 0x7f55e004fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:05:59.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.434+0000 7f5604daf700 1 --2- 172.21.15.103:0/1961231296 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f55e004da10 0x7f55e004fed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5600133e30 tx=0x7f55fc0076e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:59.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.434+0000 7f5604daf700 1 --2- 172.21.15.103:0/1961231296 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f55e004da10 0x7f55e004fed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5600133e30 tx=0x7f55fc0076e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:59.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.434+0000 7f5604daf700 1 --2- 172.21.15.103:0/1961231296 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f55e004da10 0x7f55e004fed0 secure :-1 s=READY pgs=228 cs=0 l=1 rx=0x7f5600133e30 tx=0x7f55fc0076e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:05:59.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.438+0000 7f56055b0700 1 --2- 172.21.15.103:0/1961231296 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5600144d40 0x7f56001326f0 secure :-1 s=THROTTLE_DONE pgs=584 cs=0 l=1 rx=0x7f560013de70 tx=0x7f56000676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:59.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.438+0000 7f55f27fc700 1 -- 172.21.15.103:0/1961231296 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f55f40411b0 con 0x7f5600144d40 2020-04-22T14:05:59.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.626+0000 7f5607814700 1 -- 172.21.15.103:0/1961231296 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f56000b40c0 con 0x7f5600144d40 2020-04-22T14:05:59.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.627+0000 7f56055b0700 1 --2- 172.21.15.103:0/1961231296 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5600144d40 0x7f56001326f0 secure :-1 s=THROTTLE_DONE pgs=584 cs=0 l=1 rx=0x7f560013de70 tx=0x7f56000676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:05:59.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.627+0000 7f55f27fc700 1 -- 172.21.15.103:0/1961231296 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+2141 (secure 0 0 0) 0x7f55f4018e60 con 0x7f5600144d40 2020-04-22T14:05:59.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.628+0000 7f5607814700 1 -- 172.21.15.103:0/1961231296 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f55e004da10 msgr2=0x7f55e004fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:59.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.628+0000 7f5607814700 1 --2- 172.21.15.103:0/1961231296 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f55e004da10 0x7f55e004fed0 secure :-1 s=READY pgs=228 cs=0 l=1 rx=0x7f5600133e30 tx=0x7f55fc0076e0).stop 2020-04-22T14:05:59.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.628+0000 7f5607814700 1 -- 172.21.15.103:0/1961231296 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5600144d40 msgr2=0x7f56001326f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:05:59.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.628+0000 7f5607814700 1 --2- 172.21.15.103:0/1961231296 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5600144d40 0x7f56001326f0 secure :-1 s=READY pgs=584 cs=0 l=1 rx=0x7f560013de70 tx=0x7f56000676e0).stop 2020-04-22T14:05:59.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.628+0000 7f5607814700 1 -- 172.21.15.103:0/1961231296 shutdown_connections 2020-04-22T14:05:59.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.628+0000 7f5607814700 1 --2- 172.21.15.103:0/1961231296 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f55e004da10 0x7f55e004fed0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:59.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.628+0000 7f5607814700 1 --2- 172.21.15.103:0/1961231296 >> v2:172.21.15.86:3300/0 conn(0x7f5600133870 0x7f560013df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:59.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.628+0000 7f5607814700 1 --2- 172.21.15.103:0/1961231296 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5600144d40 0x7f56001326f0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:05:59.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.628+0000 7f5607814700 1 -- 172.21.15.103:0/1961231296 >> 172.21.15.103:0/1961231296 conn(0x7f56000b9160 msgr2=0x7f56000b7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:05:59.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.628+0000 7f5607814700 1 -- 172.21.15.103:0/1961231296 shutdown_connections 2020-04-22T14:05:59.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:05:59.628+0000 7f5607814700 1 -- 172.21.15.103:0/1961231296 wait complete. 2020-04-22T14:05:59.644 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 20 2020-04-22T14:05:59.645 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:05:59.645 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":20,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4748,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1859944899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1859944899},{"type":"v1","addr":"172.21.15.86:6835","nonce":1859944899}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:05:45.958513+0000","modified":"2020-04-22T14:05:47.963559+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5491},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5491":{"gid":5491,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/2581125360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2581125360},{"type":"v1","addr":"172.21.15.103:6833","nonce":2581125360}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2020-04-22T14:05:59.848 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 5491}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 7, u'failed': [], u'epoch': 20, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [8], u'info': {u'gid_5491': {u'export_targets': [], u'name': u'a', u'incarnation': 18, u'state_seq': 3, u'state': u'up:active', u'gid': 5491, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 2581125360, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 2581125360, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/2581125360'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:05:45.958513+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:05:47.963559+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:05:59.848 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:05:59.849 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:05:59.863 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:06:00.022 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:06:00.022 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:06:00.022 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:06:00.022 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 5491, 2020-04-22T14:06:00.022 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:06:00.022 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:06:00.023 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 14.057520573, 2020-04-22T14:06:00.023 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 20, 2020-04-22T14:06:00.023 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 45, 2020-04-22T14:06:00.023 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 45, 2020-04-22T14:06:00.023 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 19.280530062 2020-04-22T14:06:00.023 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:06:00.030 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 5491, "want_state": "up:active", "state": "up:active", "rank_uptime": 14.057520573, "mdsmap_epoch": 20, "osdmap_epoch": 45, "osdmap_epoch_barrier": 45, "uptime": 19.280530062 } 2020-04-22T14:06:00.030 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-04-22T14:06:00.030 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-04-22T14:06:00.031 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:00.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:06:00.044 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:06:00.104 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:06:00.104 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:06:00.105 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:06:00.105 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:06:00.105 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:06:00.105 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:06:00.105 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:06:00.105 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:06:00.106 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:06:00.106 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:06:00.106 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:06:00.106 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:06:00.106 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:06:00.106 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:06:00.107 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:06:00.107 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42480sec preferred_lft 42480sec 2020-04-22T14:06:00.107 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:06:00.107 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:06:00.107 INFO:teuthology.orchestra.run.smithi103.stdout:12: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:06:00.108 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 7a:dc:c1:eb:d6:f4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:06:00.108 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:06:00.108 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:06:00.108 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::28ee:bf44:12d3:dbde/64 scope link noprefixroute 2020-04-22T14:06:00.108 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:06:00.108 INFO:teuthology.orchestra.run.smithi103.stdout:13: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-04-22T14:06:00.109 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 7a:dc:c1:eb:d6:f4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2020-04-22T14:06:00.109 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:00.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:06:00.154 INFO:teuthology.orchestra.run.smithi103:> ip netns list 2020-04-22T14:06:00.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2020-04-22T14:06:00.218 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:00.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:06:00.269 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:06:00.328 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2020-04-22T14:06:00.328 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:00.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:06:00.378 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:06:00.436 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2020-04-22T14:06:00.437 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:00.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:06:00.489 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:06:00.575 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:00.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:06:00.613 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 1' 2020-04-22T14:06:00.710 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:00.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:06:00.760 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr' 2020-04-22T14:06:00.847 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:06:00.847 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:06:00.847 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:06:00.847 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:06:00.848 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:06:00.848 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:06:00.848 INFO:teuthology.orchestra.run.smithi103.stdout:2: veth0@if13: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:06:00.848 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 06:57:f6:6f:62:e7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:06:00.848 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2020-04-22T14:06:00.848 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:06:00.849 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::457:f6ff:fe6f:62e7/64 scope link 2020-04-22T14:06:00.849 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:06:00.878 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:00.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:06:00.909 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr' 2020-04-22T14:06:01.018 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:06:01.018 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:06:01.018 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:06:01.018 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:06:01.018 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:06:01.019 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:06:01.019 INFO:teuthology.orchestra.run.smithi103.stdout:2: veth0@if13: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:06:01.019 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 06:57:f6:6f:62:e7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:06:01.019 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2020-04-22T14:06:01.019 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:06:01.019 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::457:f6ff:fe6f:62e7/64 scope link 2020-04-22T14:06:01.020 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:06:01.020 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.2/16 2020-04-22T14:06:01.020 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:01.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:06:01.046 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.1' 2020-04-22T14:06:01.122 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:01.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:06:01.169 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0' 2020-04-22T14:06:01.278 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:01.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:06:01.291 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up' 2020-04-22T14:06:01.403 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:01.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:06:01.417 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up' 2020-04-22T14:06:01.525 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:01.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:06:01.554 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254' 2020-04-22T14:06:01.662 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:01.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:06:01.684 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:06:01.759 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:01.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:06:01.826 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge-slave con-name brx.1 ifname brx.1 master ceph-brx' 2020-04-22T14:06:01.930 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.1' (88af662a-5ef4-4251-8e99-3c17ce610b60) successfully added. 2020-04-22T14:06:01.930 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:01.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:06:01.944 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up brx.1' 2020-04-22T14:06:02.102 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/14) 2020-04-22T14:06:02.152 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2020-04-22T14:06:02.153 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi103.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2020-04-22T14:06:02.153 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:02.179 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:06:02.180 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:06:02.239 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:02.286 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:06:02.287 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:06:02.356 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:06:02.363 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:06:02.363 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:02.409 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:06:02.409 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:06:02.469 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:06:02.469 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [47] 2020-04-22T14:06:02.469 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:02.528 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:06:02.570 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:02.583 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:06:02.583 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:06:02.652 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:06:02.658 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:06:02.658 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:02.660 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:2020-04-22T14:06:02.658+0000 7f321281f1c0 -1 init, newargv = 0x5589fc932370 newargc=9 2020-04-22T14:06:02.660 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[53766]: starting ceph client 2020-04-22T14:06:02.664 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[53766]: starting fuse 2020-04-22T14:06:02.674 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:06:02.674 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:06:02.745 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:06:02.745 INFO:teuthology.orchestra.run.smithi103.stdout:49 2020-04-22T14:06:02.745 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47, 49] 2020-04-22T14:06:02.745 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:02.795 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:06:02.795 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:06:02.795 INFO:teuthology.orchestra.run.smithi103:> import glob 2020-04-22T14:06:02.795 INFO:teuthology.orchestra.run.smithi103:> import re 2020-04-22T14:06:02.795 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:06:02.796 INFO:teuthology.orchestra.run.smithi103:> import subprocess 2020-04-22T14:06:02.796 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:06:02.796 INFO:teuthology.orchestra.run.smithi103:> def find_socket(client_name): 2020-04-22T14:06:02.796 INFO:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2020-04-22T14:06:02.796 INFO:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2020-04-22T14:06:02.796 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:06:02.796 INFO:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2020-04-22T14:06:02.796 INFO:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2020-04-22T14:06:02.797 INFO:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2020-04-22T14:06:02.797 INFO:teuthology.orchestra.run.smithi103:> return files[0] 2020-04-22T14:06:02.797 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:06:02.797 INFO:teuthology.orchestra.run.smithi103:> for f in files: 2020-04-22T14:06:02.797 INFO:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:06:02.797 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:06:02.797 INFO:teuthology.orchestra.run.smithi103:> return f 2020-04-22T14:06:02.797 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:06:02.798 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:06:02.798 INFO:teuthology.orchestra.run.smithi103:> print(find_socket("client.1")) 2020-04-22T14:06:02.798 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:06:02.902 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.1.53766.asok 2020-04-22T14:06:02.902 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.53766.asok 2020-04-22T14:06:02.902 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:02.916 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:06:02.916 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.53766.asok status 2020-04-22T14:06:03.075 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:06:03.075 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2020-04-22T14:06:03.075 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:06:03.075 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:06:03.076 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "1", 2020-04-22T14:06:03.076 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:06:03.076 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2020-04-22T14:06:03.076 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "53766", 2020-04-22T14:06:03.076 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:06:03.076 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:06:03.077 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2020-04-22T14:06:03.077 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2020-04-22T14:06:03.077 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 5740, 2020-04-22T14:06:03.077 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2020-04-22T14:06:03.077 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:06:03.077 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:06:03.077 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5740 2020-04-22T14:06:03.078 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:06:03.078 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:06:03.078 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:06:03.078 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.2:0", 2020-04-22T14:06:03.078 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 3910216232 2020-04-22T14:06:03.078 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:06:03.078 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:06:03.078 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:06:03.079 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:06:03.079 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.2:0", 2020-04-22T14:06:03.079 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 3910216232 2020-04-22T14:06:03.079 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:06:03.079 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.5740 192.168.0.2:0/3910216232", 2020-04-22T14:06:03.079 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.2:0/3910216232", 2020-04-22T14:06:03.079 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2020-04-22T14:06:03.080 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 20, 2020-04-22T14:06:03.080 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 45, 2020-04-22T14:06:03.080 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2020-04-22T14:06:03.080 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklisted": false 2020-04-22T14:06:03.080 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:06:03.080 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:03.094 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:06:03.094 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-22T14:06:03.094 INFO:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:06:03.160 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2020-04-22T14:06:03.160 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-04-22T14:06:03.160 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:03.211 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:06:03.212 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:06:03.288 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:03.335 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok config get mds_reconnect_timeout 2020-04-22T14:06:03.489 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:06:03.489 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_reconnect_timeout": "45.000000" 2020-04-22T14:06:03.489 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:06:03.497 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_reconnect_timeout": "45.000000" } 2020-04-22T14:06:03.498 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:03.511 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok config get ms_max_backoff 2020-04-22T14:06:03.664 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:06:03.664 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_max_backoff": "15.000000" 2020-04-22T14:06:03.664 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:06:03.674 INFO:tasks.cephfs.filesystem:_json_asok output: { "ms_max_backoff": "15.000000" } 2020-04-22T14:06:03.674 INFO:tasks.cephfs.mount:Creating file a 2020-04-22T14:06:03.675 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:03.689 INFO:teuthology.orchestra.run.smithi103:> sudo touch /home/ubuntu/cephtest/mnt.0/a 2020-04-22T14:06:03.763 INFO:tasks.cephfs.mount:Creating file b 2020-04-22T14:06:03.763 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:03.816 INFO:teuthology.orchestra.run.smithi103:> sudo touch /home/ubuntu/cephtest/mnt.0/b 2020-04-22T14:06:03.885 INFO:tasks.cephfs.mount:Creating file c 2020-04-22T14:06:03.885 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:03.939 INFO:teuthology.orchestra.run.smithi103:> sudo touch /home/ubuntu/cephtest/mnt.0/c 2020-04-22T14:06:04.009 INFO:tasks.cephfs.mount:Checking file a 2020-04-22T14:06:04.010 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:04.064 INFO:teuthology.orchestra.run.smithi103:> sudo ls /home/ubuntu/cephtest/mnt.0/a 2020-04-22T14:06:04.137 INFO:teuthology.orchestra.run.smithi103.stdout:/home/ubuntu/cephtest/mnt.0/a 2020-04-22T14:06:04.138 INFO:tasks.cephfs.mount:Checking file b 2020-04-22T14:06:04.138 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:04.209 INFO:teuthology.orchestra.run.smithi103:> sudo ls /home/ubuntu/cephtest/mnt.0/b 2020-04-22T14:06:04.276 INFO:teuthology.orchestra.run.smithi103.stdout:/home/ubuntu/cephtest/mnt.0/b 2020-04-22T14:06:04.277 INFO:tasks.cephfs.mount:Checking file c 2020-04-22T14:06:04.277 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:04.330 INFO:teuthology.orchestra.run.smithi103:> sudo ls /home/ubuntu/cephtest/mnt.0/c 2020-04-22T14:06:04.406 INFO:teuthology.orchestra.run.smithi103.stdout:/home/ubuntu/cephtest/mnt.0/c 2020-04-22T14:06:04.406 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2020-04-22T14:06:04.407 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:04.460 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-04-22T14:06:04.460 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:06:04.532 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[52508]: fuse finished with error 0 and tester_r 0 2020-04-22T14:06:04.535 INFO:teuthology.orchestra.run:waiting for 900 2020-04-22T14:06:10.637 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:06:10.637 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:06:10.638 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:10.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:06:10.654 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:06:10.762 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:10.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:06:10.790 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down brx.0' 2020-04-22T14:06:10.948 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.0' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/13) 2020-04-22T14:06:10.949 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:10.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:06:10.963 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete brx.0' 2020-04-22T14:06:11.071 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.0' (8a7cdbf1-4c85-42b8-99e9-3f8f7cd32bee) successfully deleted. 2020-04-22T14:06:11.071 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:11.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:06:11.100 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:06:11.185 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:11.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:06:11.237 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:06:11.297 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:06:11.297 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:06:11.297 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:06:11.297 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:06:11.297 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:06:11.298 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:06:11.298 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:06:11.298 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:06:11.298 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:06:11.298 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:06:11.298 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:06:11.298 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:06:11.299 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:06:11.299 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:06:11.299 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:06:11.299 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42469sec preferred_lft 42469sec 2020-04-22T14:06:11.299 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:06:11.299 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:06:11.299 INFO:teuthology.orchestra.run.smithi103.stdout:12: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:06:11.299 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether b6:dc:84:57:26:3b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:06:11.300 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:06:11.300 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:06:11.300 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::28ee:bf44:12d3:dbde/64 scope link noprefixroute 2020-04-22T14:06:11.300 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:06:11.300 INFO:teuthology.orchestra.run.smithi103.stdout:14: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-04-22T14:06:11.300 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether b6:dc:84:57:26:3b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2020-04-22T14:06:11.301 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:11.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:06:11.345 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:06:11.423 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:11.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:06:11.473 INFO:teuthology.orchestra.run.smithi103:> nmcli connection show 2020-04-22T14:06:11.549 INFO:teuthology.orchestra.run.smithi103.stdout:NAME UUID TYPE DEVICE 2020-04-22T14:06:11.549 INFO:teuthology.orchestra.run.smithi103.stdout:System enp3s0f1 b0a308d1-bd90-60af-eb7c-0183bb425a1a ethernet enp3s0f1 2020-04-22T14:06:11.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-brx 9507c76d-c1e0-4cd4-b6db-cddaba92a0c7 bridge ceph-brx 2020-04-22T14:06:11.549 INFO:teuthology.orchestra.run.smithi103.stdout:brx.1 88af662a-5ef4-4251-8e99-3c17ce610b60 ethernet brx.1 2020-04-22T14:06:11.549 INFO:teuthology.orchestra.run.smithi103.stdout:eno1 206ad60d-195e-4d4b-a9fe-a5dd1f33a67d ethernet -- 2020-04-22T14:06:11.549 INFO:teuthology.orchestra.run.smithi103.stdout:eno2 894a7dd2-d329-4985-9ef9-84a92c6e1c6c ethernet -- 2020-04-22T14:06:11.550 INFO:teuthology.orchestra.run.smithi103.stdout:enp3s0f0 5a3237ce-06ab-4ae0-818b-45bdf036cb08 ethernet -- 2020-04-22T14:06:11.550 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:11.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:06:11.596 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:06:11.655 INFO:tasks.cephfs.mount:Checking file a 2020-04-22T14:06:11.655 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:11.703 INFO:teuthology.orchestra.run.smithi103:> sudo ls /home/ubuntu/cephtest/mnt.1/a 2020-04-22T14:06:20.040 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:06:20.058 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:06:20.100 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:20.117 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:06:50.238 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:06:50.255 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:06:50.297 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:06:50.315 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:07:06.360 INFO:teuthology.orchestra.run.smithi103.stdout:/home/ubuntu/cephtest/mnt.1/a 2020-04-22T14:07:06.361 INFO:tasks.cephfs.mount:Checking file b 2020-04-22T14:07:06.362 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:06.379 INFO:teuthology.orchestra.run.smithi103:> sudo ls /home/ubuntu/cephtest/mnt.1/b 2020-04-22T14:07:06.453 INFO:teuthology.orchestra.run.smithi103.stdout:/home/ubuntu/cephtest/mnt.1/b 2020-04-22T14:07:06.455 INFO:tasks.cephfs.mount:Checking file c 2020-04-22T14:07:06.455 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:06.511 INFO:teuthology.orchestra.run.smithi103:> sudo ls /home/ubuntu/cephtest/mnt.1/c 2020-04-22T14:07:06.580 INFO:teuthology.orchestra.run.smithi103.stdout:/home/ubuntu/cephtest/mnt.1/c 2020-04-22T14:07:06.581 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:06.637 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:07:06.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.782+0000 7fe7704aa700 1 Processor -- start 2020-04-22T14:07:06.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.782+0000 7fe7704aa700 1 -- start start 2020-04-22T14:07:06.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.783+0000 7fe7704aa700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe76812c0d0 0x7fe7681464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:06.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.783+0000 7fe7704aa700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe768065fe0 0x7fe76805b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:06.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.783+0000 7fe7704aa700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe768143300 con 0x7fe76805b8a0 2020-04-22T14:07:06.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.783+0000 7fe7704aa700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe76812c4b0 con 0x7fe76812c0d0 2020-04-22T14:07:06.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.783+0000 7fe7704aa700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7681435a0 con 0x7fe768065fe0 2020-04-22T14:07:06.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.783+0000 7fe76e246700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe76812c0d0 0x7fe7681464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:06.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.783+0000 7fe76e246700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe76812c0d0 0x7fe7681464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49820/0 (socket says 172.21.15.103:49820) 2020-04-22T14:07:06.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.783+0000 7fe76e246700 1 -- 172.21.15.103:0/1524694750 learned_addr learned my addr 172.21.15.103:0/1524694750 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:06.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.783+0000 7fe76da45700 1 --2- 172.21.15.103:0/1524694750 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe768065fe0 0x7fe76805b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:06.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.784+0000 7fe76e246700 1 -- 172.21.15.103:0/1524694750 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe768065fe0 msgr2=0x7fe76805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:06.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.784+0000 7fe76e246700 1 --2- 172.21.15.103:0/1524694750 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe768065fe0 0x7fe76805b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:06.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.784+0000 7fe76e246700 1 -- 172.21.15.103:0/1524694750 >> v1:172.21.15.103:6789/0 conn(0x7fe76805b8a0 legacy=0x7fe768062ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:06.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.784+0000 7fe76d244700 1 -- 172.21.15.103:0/1524694750 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 524018918 0 0) 0x7fe768143300 con 0x7fe76805b8a0 2020-04-22T14:07:06.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.784+0000 7fe76e246700 1 -- 172.21.15.103:0/1524694750 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe768143840 con 0x7fe76812c0d0 2020-04-22T14:07:06.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.784+0000 7fe76da45700 1 --2- 172.21.15.103:0/1524694750 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe768065fe0 0x7fe76805b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:07:06.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.784+0000 7fe76e246700 1 --2- 172.21.15.103:0/1524694750 >> v2:172.21.15.103:3300/0 conn(0x7fe76812c0d0 0x7fe7681464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe758002f30 tx=0x7fe758007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:06.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.784+0000 7fe76e246700 1 --2- 172.21.15.103:0/1524694750 >> v2:172.21.15.103:3300/0 conn(0x7fe76812c0d0 0x7fe7681464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe758002f30 tx=0x7fe758007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:06.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.784+0000 7fe76e246700 1 --2- 172.21.15.103:0/1524694750 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe76812c0d0 0x7fe7681464e0 secure :-1 s=READY pgs=589 cs=0 l=1 rx=0x7fe758002f30 tx=0x7fe758007a40).ready entity=mon.1 client_cookie=aa23b44e739905e7 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:06.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.784+0000 7fe76e246700 1 --2- 172.21.15.103:0/1524694750 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe76812c0d0 0x7fe7681464e0 secure :-1 s=THROTTLE_DONE pgs=589 cs=0 l=1 rx=0x7fe758002f30 tx=0x7fe758007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:06.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.784+0000 7fe76d244700 1 -- 172.21.15.103:0/1524694750 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe758011720 con 0x7fe76812c0d0 2020-04-22T14:07:06.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.784+0000 7fe76e246700 1 --2- 172.21.15.103:0/1524694750 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe76812c0d0 0x7fe7681464e0 secure :-1 s=THROTTLE_DONE pgs=589 cs=0 l=1 rx=0x7fe758002f30 tx=0x7fe758007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:06.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.784+0000 7fe76d244700 1 -- 172.21.15.103:0/1524694750 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7580118c0 con 0x7fe76812c0d0 2020-04-22T14:07:06.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.784+0000 7fe76e246700 1 --2- 172.21.15.103:0/1524694750 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe76812c0d0 0x7fe7681464e0 secure :-1 s=THROTTLE_DONE pgs=589 cs=0 l=1 rx=0x7fe758002f30 tx=0x7fe758007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:06.792 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.784+0000 7fe76d244700 1 -- 172.21.15.103:0/1524694750 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe758011ca0 con 0x7fe76812c0d0 2020-04-22T14:07:06.792 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.784+0000 7fe7704aa700 1 -- 172.21.15.103:0/1524694750 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe76812c0d0 msgr2=0x7fe7681464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:06.792 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.784+0000 7fe7704aa700 1 --2- 172.21.15.103:0/1524694750 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe76812c0d0 0x7fe7681464e0 secure :-1 s=READY pgs=589 cs=0 l=1 rx=0x7fe758002f30 tx=0x7fe758007a40).stop 2020-04-22T14:07:06.792 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.785+0000 7fe7704aa700 1 -- 172.21.15.103:0/1524694750 shutdown_connections 2020-04-22T14:07:06.792 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.785+0000 7fe7704aa700 1 --2- 172.21.15.103:0/1524694750 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe76812c0d0 0x7fe7681464e0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:06.792 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.785+0000 7fe7704aa700 1 --2- 172.21.15.103:0/1524694750 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe768065fe0 0x7fe76805b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:06.792 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.785+0000 7fe7704aa700 1 -- 172.21.15.103:0/1524694750 >> 172.21.15.103:0/1524694750 conn(0x7fe7680b9160 msgr2=0x7fe76805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:06.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.785+0000 7fe7704aa700 1 -- 172.21.15.103:0/1524694750 shutdown_connections 2020-04-22T14:07:06.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.785+0000 7fe7704aa700 1 -- 172.21.15.103:0/1524694750 wait complete. 2020-04-22T14:07:06.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.786+0000 7fe7704aa700 1 Processor -- start 2020-04-22T14:07:06.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.786+0000 7fe7704aa700 1 -- start start 2020-04-22T14:07:06.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.786+0000 7fe7704aa700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe76812c0d0 0x7fe768128580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:06.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.786+0000 7fe7704aa700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7681290c0 con 0x7fe768065fe0 2020-04-22T14:07:06.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.786+0000 7fe7704aa700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe768129360 con 0x7fe76805b8a0 2020-04-22T14:07:06.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.786+0000 7fe7704aa700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe768129600 con 0x7fe76812c0d0 2020-04-22T14:07:06.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.786+0000 7fe76e246700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe76805b8a0 0x7fe768142180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42016/0 (socket says 172.21.15.103:42016) 2020-04-22T14:07:06.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.786+0000 7fe76e246700 1 -- 172.21.15.103:0/621038760 learned_addr learned my addr 172.21.15.103:0/621038760 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:06.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.786+0000 7fe76ea47700 1 --2- 172.21.15.103:0/621038760 >> v2:172.21.15.103:3300/0 conn(0x7fe76812c0d0 0x7fe768128580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:06.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.786+0000 7fe7577fe700 1 -- 172.21.15.103:0/621038760 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 591340723 0 0) 0x7fe768129360 con 0x7fe76805b8a0 2020-04-22T14:07:06.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.787+0000 7fe7577fe700 1 -- 172.21.15.103:0/621038760 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe748002fe0 con 0x7fe76805b8a0 2020-04-22T14:07:06.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.787+0000 7fe76ea47700 1 -- 172.21.15.103:0/621038760 >> v1:172.21.15.103:6789/0 conn(0x7fe76805b8a0 legacy=0x7fe768142180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:06.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.787+0000 7fe76ea47700 1 -- 172.21.15.103:0/621038760 >> v1:172.21.15.86:6789/0 conn(0x7fe768065fe0 legacy=0x7fe768129aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:06.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.787+0000 7fe76ea47700 1 -- 172.21.15.103:0/621038760 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe768142890 con 0x7fe76812c0d0 2020-04-22T14:07:06.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.787+0000 7fe76ea47700 1 --2- 172.21.15.103:0/621038760 >> v2:172.21.15.103:3300/0 conn(0x7fe76812c0d0 0x7fe768128580 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe760001210 tx=0x7fe760010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:06.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.787+0000 7fe76ea47700 1 --2- 172.21.15.103:0/621038760 >> v2:172.21.15.103:3300/0 conn(0x7fe76812c0d0 0x7fe768128580 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe760001210 tx=0x7fe760010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:06.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.787+0000 7fe76ea47700 1 --2- 172.21.15.103:0/621038760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe76812c0d0 0x7fe768128580 secure :-1 s=READY pgs=591 cs=0 l=1 rx=0x7fe760001210 tx=0x7fe760010bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:06.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.787+0000 7fe76ea47700 1 --2- 172.21.15.103:0/621038760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe76812c0d0 0x7fe768128580 secure :-1 s=THROTTLE_DONE pgs=591 cs=0 l=1 rx=0x7fe760001210 tx=0x7fe760010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:06.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.787+0000 7fe7577fe700 1 -- 172.21.15.103:0/621038760 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe760012270 con 0x7fe76812c0d0 2020-04-22T14:07:06.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.787+0000 7fe76ea47700 1 --2- 172.21.15.103:0/621038760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe76812c0d0 0x7fe768128580 secure :-1 s=THROTTLE_DONE pgs=591 cs=0 l=1 rx=0x7fe760001210 tx=0x7fe760010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:06.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.787+0000 7fe7577fe700 1 -- 172.21.15.103:0/621038760 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe760012410 con 0x7fe76812c0d0 2020-04-22T14:07:06.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.787+0000 7fe76ea47700 1 --2- 172.21.15.103:0/621038760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe76812c0d0 0x7fe768128580 secure :-1 s=THROTTLE_DONE pgs=591 cs=0 l=1 rx=0x7fe760001210 tx=0x7fe760010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:06.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.787+0000 7fe7704aa700 1 -- 172.21.15.103:0/621038760 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe768127890 con 0x7fe76812c0d0 2020-04-22T14:07:06.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.787+0000 7fe7577fe700 1 -- 172.21.15.103:0/621038760 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7600127f0 con 0x7fe76812c0d0 2020-04-22T14:07:06.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.787+0000 7fe7704aa700 1 -- 172.21.15.103:0/621038760 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe768126300 con 0x7fe76812c0d0 2020-04-22T14:07:06.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.788+0000 7fe76ea47700 1 --2- 172.21.15.103:0/621038760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe76812c0d0 0x7fe768128580 secure :-1 s=THROTTLE_DONE pgs=591 cs=0 l=1 rx=0x7fe760001210 tx=0x7fe760010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:06.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.788+0000 7fe7577fe700 1 -- 172.21.15.103:0/621038760 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fe760012a70 con 0x7fe76812c0d0 2020-04-22T14:07:06.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.788+0000 7fe76ea47700 1 --2- 172.21.15.103:0/621038760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe76812c0d0 0x7fe768128580 secure :-1 s=THROTTLE_DONE pgs=591 cs=0 l=1 rx=0x7fe760001210 tx=0x7fe760010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:06.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.788+0000 7fe7704aa700 1 -- 172.21.15.103:0/621038760 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe768056c90 con 0x7fe76812c0d0 2020-04-22T14:07:06.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.788+0000 7fe7577fe700 1 --2- 172.21.15.103:0/621038760 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe74804dca0 0x7fe748050160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:06.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.788+0000 7fe7577fe700 1 -- 172.21.15.103:0/621038760 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe7600619e0 con 0x7fe76812c0d0 2020-04-22T14:07:06.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.788+0000 7fe76e246700 1 --2- 172.21.15.103:0/621038760 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe74804dca0 0x7fe748050160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:06.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.789+0000 7fe76e246700 1 --2- 172.21.15.103:0/621038760 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe74804dca0 0x7fe748050160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe758000b80 tx=0x7fe758007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:06.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.789+0000 7fe76e246700 1 --2- 172.21.15.103:0/621038760 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe74804dca0 0x7fe748050160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe758000b80 tx=0x7fe758007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:06.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.789+0000 7fe76e246700 1 --2- 172.21.15.103:0/621038760 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe74804dca0 0x7fe748050160 secure :-1 s=READY pgs=229 cs=0 l=1 rx=0x7fe758000b80 tx=0x7fe758007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:06.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.792+0000 7fe76ea47700 1 --2- 172.21.15.103:0/621038760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe76812c0d0 0x7fe768128580 secure :-1 s=THROTTLE_DONE pgs=591 cs=0 l=1 rx=0x7fe760001210 tx=0x7fe760010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:06.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.792+0000 7fe7577fe700 1 -- 172.21.15.103:0/621038760 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fe76003ce20 con 0x7fe76812c0d0 2020-04-22T14:07:06.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.936+0000 7fe7704aa700 1 -- 172.21.15.103:0/621038760 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe768128ea0 con 0x7fe76812c0d0 2020-04-22T14:07:06.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.937+0000 7fe76ea47700 1 --2- 172.21.15.103:0/621038760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe76812c0d0 0x7fe768128580 secure :-1 s=THROTTLE_DONE pgs=591 cs=0 l=1 rx=0x7fe760001210 tx=0x7fe760010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:06.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.937+0000 7fe7577fe700 1 -- 172.21.15.103:0/621038760 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+16089 (secure 0 0 0) 0x7fe760040440 con 0x7fe76812c0d0 2020-04-22T14:07:06.941 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:07:06.941 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":45,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:05:46.962137+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:05:43.875682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2020-04-22T14:05:44.910499+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:07:06.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.939+0000 7fe7704aa700 1 -- 172.21.15.103:0/621038760 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe74804dca0 msgr2=0x7fe748050160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:06.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.939+0000 7fe7704aa700 1 --2- 172.21.15.103:0/621038760 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe74804dca0 0x7fe748050160 secure :-1 s=READY pgs=229 cs=0 l=1 rx=0x7fe758000b80 tx=0x7fe758007a40).stop 2020-04-22T14:07:06.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.939+0000 7fe7704aa700 1 -- 172.21.15.103:0/621038760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe76812c0d0 msgr2=0x7fe768128580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:06.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.939+0000 7fe7704aa700 1 --2- 172.21.15.103:0/621038760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe76812c0d0 0x7fe768128580 secure :-1 s=READY pgs=591 cs=0 l=1 rx=0x7fe760001210 tx=0x7fe760010bd0).stop 2020-04-22T14:07:06.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.939+0000 7fe7704aa700 1 -- 172.21.15.103:0/621038760 shutdown_connections 2020-04-22T14:07:06.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.939+0000 7fe7704aa700 1 --2- 172.21.15.103:0/621038760 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe74804dca0 0x7fe748050160 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:06.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.939+0000 7fe7704aa700 1 --2- 172.21.15.103:0/621038760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe76812c0d0 0x7fe768128580 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:06.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.939+0000 7fe7704aa700 1 -- 172.21.15.103:0/621038760 >> 172.21.15.103:0/621038760 conn(0x7fe7680b9160 msgr2=0x7fe76812b020 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:06.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.939+0000 7fe7704aa700 1 -- 172.21.15.103:0/621038760 shutdown_connections 2020-04-22T14:07:06.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:06.939+0000 7fe7704aa700 1 -- 172.21.15.103:0/621038760 wait complete. 2020-04-22T14:07:06.952 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:05:43.875682+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 7, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'44', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:05:44.910499+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 8, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'45', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:07:06.953 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:06.967 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:07:07.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.112+0000 7ff7fbb2e700 1 Processor -- start 2020-04-22T14:07:07.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.112+0000 7ff7fbb2e700 1 -- start start 2020-04-22T14:07:07.118 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.113+0000 7ff7fbb2e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff7f40ac950 0x7ff7f4146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:07.118 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.113+0000 7ff7fbb2e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff7f41470a0 0x7ff7f4143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:07.118 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.113+0000 7ff7fbb2e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7f41467e0 con 0x7ff7f40b9140 2020-04-22T14:07:07.118 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.113+0000 7ff7fbb2e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7f40602f0 con 0x7ff7f40ac950 2020-04-22T14:07:07.119 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.113+0000 7ff7fbb2e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f4060050 con 0x7ff7f41470a0 2020-04-22T14:07:07.119 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.113+0000 7ff7fa0cb700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff7f41470a0 0x7ff7f4143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:07.119 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.113+0000 7ff7f90c9700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff7f40ac950 0x7ff7f4146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:07.119 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.113+0000 7ff7f90c9700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff7f40ac950 0x7ff7f4146c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:47068/0 (socket says 172.21.15.103:47068) 2020-04-22T14:07:07.119 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.113+0000 7ff7f90c9700 1 -- 172.21.15.103:0/2405779713 learned_addr learned my addr 172.21.15.103:0/2405779713 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:07.120 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.113+0000 7ff7f98ca700 1 --1- 172.21.15.103:0/2405779713 >> v1:172.21.15.86:6789/0 conn(0x7ff7f40b9140 0x7ff7f412b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:59180/0 (socket says 172.21.15.103:59180) 2020-04-22T14:07:07.120 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.114+0000 7ff7f90c9700 1 -- 172.21.15.103:0/2405779713 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff7f41470a0 msgr2=0x7ff7f4143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:07.120 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.114+0000 7ff7f90c9700 1 --2- 172.21.15.103:0/2405779713 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff7f41470a0 0x7ff7f4143090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:07.120 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.114+0000 7ff7f90c9700 1 -- 172.21.15.103:0/2405779713 >> v1:172.21.15.86:6789/0 conn(0x7ff7f40b9140 legacy=0x7ff7f412b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:07.120 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.114+0000 7ff7f90c9700 1 -- 172.21.15.103:0/2405779713 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f40b9520 con 0x7ff7f40ac950 2020-04-22T14:07:07.120 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.114+0000 7ff7f88c8700 1 -- 172.21.15.103:0/2405779713 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1338099712 0 0) 0x7ff7f41467e0 con 0x7ff7f40b9140 2020-04-22T14:07:07.120 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.114+0000 7ff7fa0cb700 1 --2- 172.21.15.103:0/2405779713 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff7f41470a0 0x7ff7f4143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:07:07.121 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.114+0000 7ff7f90c9700 1 --2- 172.21.15.103:0/2405779713 >> v2:172.21.15.86:3300/0 conn(0x7ff7f40ac950 0x7ff7f4146c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff7f0002f30 tx=0x7ff7f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.121 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.114+0000 7ff7f90c9700 1 --2- 172.21.15.103:0/2405779713 >> v2:172.21.15.86:3300/0 conn(0x7ff7f40ac950 0x7ff7f4146c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff7f0002f30 tx=0x7ff7f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.121 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.114+0000 7ff7f90c9700 1 --2- 172.21.15.103:0/2405779713 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7f40ac950 0x7ff7f4146c40 secure :-1 s=READY pgs=335 cs=0 l=1 rx=0x7ff7f0002f30 tx=0x7ff7f0007a40).ready entity=mon.0 client_cookie=231b3b39952e326e server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:07.121 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.114+0000 7ff7f90c9700 1 --2- 172.21.15.103:0/2405779713 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7f40ac950 0x7ff7f4146c40 secure :-1 s=THROTTLE_DONE pgs=335 cs=0 l=1 rx=0x7ff7f0002f30 tx=0x7ff7f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.121 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.114+0000 7ff7f88c8700 1 -- 172.21.15.103:0/2405779713 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7f0011670 con 0x7ff7f40ac950 2020-04-22T14:07:07.121 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.114+0000 7ff7f90c9700 1 --2- 172.21.15.103:0/2405779713 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7f40ac950 0x7ff7f4146c40 secure :-1 s=THROTTLE_DONE pgs=335 cs=0 l=1 rx=0x7ff7f0002f30 tx=0x7ff7f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.121 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.114+0000 7ff7f90c9700 1 --2- 172.21.15.103:0/2405779713 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7f40ac950 0x7ff7f4146c40 secure :-1 s=THROTTLE_DONE pgs=335 cs=0 l=1 rx=0x7ff7f0002f30 tx=0x7ff7f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.114+0000 7ff7f88c8700 1 -- 172.21.15.103:0/2405779713 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f0011810 con 0x7ff7f40ac950 2020-04-22T14:07:07.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.114+0000 7ff7f88c8700 1 -- 172.21.15.103:0/2405779713 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7f0011bf0 con 0x7ff7f40ac950 2020-04-22T14:07:07.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.114+0000 7ff7fbb2e700 1 -- 172.21.15.103:0/2405779713 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7f40ac950 msgr2=0x7ff7f4146c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:07.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.114+0000 7ff7fbb2e700 1 --2- 172.21.15.103:0/2405779713 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7f40ac950 0x7ff7f4146c40 secure :-1 s=READY pgs=335 cs=0 l=1 rx=0x7ff7f0002f30 tx=0x7ff7f0007a40).stop 2020-04-22T14:07:07.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.115+0000 7ff7fbb2e700 1 -- 172.21.15.103:0/2405779713 shutdown_connections 2020-04-22T14:07:07.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.115+0000 7ff7fbb2e700 1 --2- 172.21.15.103:0/2405779713 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff7f41470a0 0x7ff7f4143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:07.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.115+0000 7ff7fbb2e700 1 --2- 172.21.15.103:0/2405779713 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7f40ac950 0x7ff7f4146c40 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:07.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.115+0000 7ff7fbb2e700 1 -- 172.21.15.103:0/2405779713 >> 172.21.15.103:0/2405779713 conn(0x7ff7f405b7b0 msgr2=0x7ff7f40b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:07.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.115+0000 7ff7fbb2e700 1 -- 172.21.15.103:0/2405779713 shutdown_connections 2020-04-22T14:07:07.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.115+0000 7ff7fbb2e700 1 -- 172.21.15.103:0/2405779713 wait complete. 2020-04-22T14:07:07.126 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.116+0000 7ff7fbb2e700 1 Processor -- start 2020-04-22T14:07:07.126 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.116+0000 7ff7fbb2e700 1 -- start start 2020-04-22T14:07:07.126 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.116+0000 7ff7fbb2e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff7f40ac950 0x7ff7f4061b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:07.127 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.116+0000 7ff7fbb2e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7f40b0020 con 0x7ff7f40b9140 2020-04-22T14:07:07.127 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.116+0000 7ff7fbb2e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7f40b02c0 con 0x7ff7f41470a0 2020-04-22T14:07:07.127 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.116+0000 7ff7fbb2e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7f40b0560 con 0x7ff7f40ac950 2020-04-22T14:07:07.127 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.116+0000 7ff7fa0cb700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff7f41470a0 0x7ff7f4154170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42034/0 (socket says 172.21.15.103:42034) 2020-04-22T14:07:07.127 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.116+0000 7ff7fa0cb700 1 -- 172.21.15.103:0/1273812269 learned_addr learned my addr 172.21.15.103:0/1273812269 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:07.128 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.116+0000 7ff7f98ca700 1 --2- 172.21.15.103:0/1273812269 >> v2:172.21.15.86:3300/0 conn(0x7ff7f40ac950 0x7ff7f4061b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:07.128 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.117+0000 7ff7e2ffd700 1 -- 172.21.15.103:0/1273812269 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3993922058 0 0) 0x7ff7f40b02c0 con 0x7ff7f41470a0 2020-04-22T14:07:07.128 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.117+0000 7ff7e2ffd700 1 -- 172.21.15.103:0/1273812269 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7d4002fe0 con 0x7ff7f41470a0 2020-04-22T14:07:07.128 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.117+0000 7ff7f98ca700 1 -- 172.21.15.103:0/1273812269 >> v1:172.21.15.103:6789/0 conn(0x7ff7f41470a0 legacy=0x7ff7f4154170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:07.128 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.117+0000 7ff7f98ca700 1 -- 172.21.15.103:0/1273812269 >> v1:172.21.15.86:6789/0 conn(0x7ff7f40b9140 legacy=0x7ff7f40af7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:07.128 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.117+0000 7ff7e2ffd700 1 -- 172.21.15.103:0/1273812269 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2483662936 0 0) 0x7ff7f40b0020 con 0x7ff7f40b9140 2020-04-22T14:07:07.128 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.117+0000 7ff7f98ca700 1 -- 172.21.15.103:0/1273812269 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f4154880 con 0x7ff7f40ac950 2020-04-22T14:07:07.129 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.117+0000 7ff7f98ca700 1 --2- 172.21.15.103:0/1273812269 >> v2:172.21.15.86:3300/0 conn(0x7ff7f40ac950 0x7ff7f4061b10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff7e4000b80 tx=0x7ff7e40108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.129 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.117+0000 7ff7f98ca700 1 --2- 172.21.15.103:0/1273812269 >> v2:172.21.15.86:3300/0 conn(0x7ff7f40ac950 0x7ff7f4061b10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff7e4000b80 tx=0x7ff7e40108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.129 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.117+0000 7ff7f98ca700 1 --2- 172.21.15.103:0/1273812269 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7f40ac950 0x7ff7f4061b10 secure :-1 s=READY pgs=337 cs=0 l=1 rx=0x7ff7e4000b80 tx=0x7ff7e40108a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:07.129 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.117+0000 7ff7f98ca700 1 --2- 172.21.15.103:0/1273812269 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7f40ac950 0x7ff7f4061b10 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7ff7e4000b80 tx=0x7ff7e40108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.129 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.117+0000 7ff7e2ffd700 1 -- 172.21.15.103:0/1273812269 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7e40115b0 con 0x7ff7f40ac950 2020-04-22T14:07:07.130 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.117+0000 7ff7f98ca700 1 --2- 172.21.15.103:0/1273812269 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7f40ac950 0x7ff7f4061b10 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7ff7e4000b80 tx=0x7ff7e40108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.130 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.117+0000 7ff7f98ca700 1 --2- 172.21.15.103:0/1273812269 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7f40ac950 0x7ff7f4061b10 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7ff7e4000b80 tx=0x7ff7e40108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.130 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.117+0000 7ff7e2ffd700 1 -- 172.21.15.103:0/1273812269 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e4011710 con 0x7ff7f40ac950 2020-04-22T14:07:07.130 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.117+0000 7ff7fbb2e700 1 -- 172.21.15.103:0/1273812269 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7f4153b10 con 0x7ff7f40ac950 2020-04-22T14:07:07.130 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.117+0000 7ff7e2ffd700 1 -- 172.21.15.103:0/1273812269 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7e4011ab0 con 0x7ff7f40ac950 2020-04-22T14:07:07.130 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.117+0000 7ff7fbb2e700 1 -- 172.21.15.103:0/1273812269 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7f40b1fd0 con 0x7ff7f40ac950 2020-04-22T14:07:07.130 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.118+0000 7ff7f98ca700 1 --2- 172.21.15.103:0/1273812269 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7f40ac950 0x7ff7f4061b10 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7ff7e4000b80 tx=0x7ff7e40108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.131 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.118+0000 7ff7fbb2e700 1 -- 172.21.15.103:0/1273812269 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7f4056c90 con 0x7ff7f40ac950 2020-04-22T14:07:07.131 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.118+0000 7ff7e2ffd700 1 -- 172.21.15.103:0/1273812269 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ff7e400b370 con 0x7ff7f40ac950 2020-04-22T14:07:07.131 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.118+0000 7ff7f98ca700 1 --2- 172.21.15.103:0/1273812269 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7f40ac950 0x7ff7f4061b10 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7ff7e4000b80 tx=0x7ff7e40108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.131 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.119+0000 7ff7e2ffd700 1 --2- 172.21.15.103:0/1273812269 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff7d404dc70 0x7ff7d4050130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:07.131 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.119+0000 7ff7e2ffd700 1 -- 172.21.15.103:0/1273812269 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff7e4061480 con 0x7ff7f40ac950 2020-04-22T14:07:07.131 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.119+0000 7ff7f90c9700 1 --2- 172.21.15.103:0/1273812269 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff7d404dc70 0x7ff7d4050130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:07.131 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.119+0000 7ff7f90c9700 1 --2- 172.21.15.103:0/1273812269 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff7d404dc70 0x7ff7d4050130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff7f0000b80 tx=0x7ff7f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.132 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.119+0000 7ff7f90c9700 1 --2- 172.21.15.103:0/1273812269 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff7d404dc70 0x7ff7d4050130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff7f0000b80 tx=0x7ff7f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.132 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.119+0000 7ff7f90c9700 1 --2- 172.21.15.103:0/1273812269 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff7d404dc70 0x7ff7d4050130 secure :-1 s=READY pgs=230 cs=0 l=1 rx=0x7ff7f0000b80 tx=0x7ff7f0007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:07.132 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.122+0000 7ff7f98ca700 1 --2- 172.21.15.103:0/1273812269 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7f40ac950 0x7ff7f4061b10 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7ff7e4000b80 tx=0x7ff7e40108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.132 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.122+0000 7ff7e2ffd700 1 -- 172.21.15.103:0/1273812269 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ff7e403c8c0 con 0x7ff7f40ac950 2020-04-22T14:07:07.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.262+0000 7ff7fbb2e700 1 -- 172.21.15.103:0/1273812269 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff7f4154a10 con 0x7ff7f40ac950 2020-04-22T14:07:07.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.263+0000 7ff7f98ca700 1 --2- 172.21.15.103:0/1273812269 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7f40ac950 0x7ff7f4061b10 secure :-1 s=THROTTLE_DONE pgs=337 cs=0 l=1 rx=0x7ff7e4000b80 tx=0x7ff7e40108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.263+0000 7ff7e2ffd700 1 -- 172.21.15.103:0/1273812269 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v45) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff7e403fee0 con 0x7ff7f40ac950 2020-04-22T14:07:07.266 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:07:07.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.264+0000 7ff7fbb2e700 1 -- 172.21.15.103:0/1273812269 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff7d404dc70 msgr2=0x7ff7d4050130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:07.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.264+0000 7ff7fbb2e700 1 --2- 172.21.15.103:0/1273812269 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff7d404dc70 0x7ff7d4050130 secure :-1 s=READY pgs=230 cs=0 l=1 rx=0x7ff7f0000b80 tx=0x7ff7f0007a40).stop 2020-04-22T14:07:07.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.264+0000 7ff7fbb2e700 1 -- 172.21.15.103:0/1273812269 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7f40ac950 msgr2=0x7ff7f4061b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:07.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.264+0000 7ff7fbb2e700 1 --2- 172.21.15.103:0/1273812269 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7f40ac950 0x7ff7f4061b10 secure :-1 s=READY pgs=337 cs=0 l=1 rx=0x7ff7e4000b80 tx=0x7ff7e40108a0).stop 2020-04-22T14:07:07.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.264+0000 7ff7fbb2e700 1 -- 172.21.15.103:0/1273812269 shutdown_connections 2020-04-22T14:07:07.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.264+0000 7ff7fbb2e700 1 --2- 172.21.15.103:0/1273812269 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff7d404dc70 0x7ff7d4050130 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:07.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.264+0000 7ff7fbb2e700 1 --2- 172.21.15.103:0/1273812269 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7f40ac950 0x7ff7f4061b10 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:07.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.264+0000 7ff7fbb2e700 1 -- 172.21.15.103:0/1273812269 >> 172.21.15.103:0/1273812269 conn(0x7ff7f405b7b0 msgr2=0x7ff7f40b7500 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:07.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.264+0000 7ff7fbb2e700 1 -- 172.21.15.103:0/1273812269 shutdown_connections 2020-04-22T14:07:07.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.264+0000 7ff7fbb2e700 1 -- 172.21.15.103:0/1273812269 wait complete. 2020-04-22T14:07:07.277 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:07.290 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:07:07.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.436+0000 7f0854b88700 1 Processor -- start 2020-04-22T14:07:07.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.436+0000 7f0854b88700 1 -- start start 2020-04-22T14:07:07.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.437+0000 7f0854b88700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f08500b2590 0x7f08500620c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:07.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.437+0000 7f0854b88700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f08501463e0 0x7f0850142ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:07.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.437+0000 7f0854b88700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08500af250 con 0x7f0850061870 2020-04-22T14:07:07.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.437+0000 7f0854b88700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08500af4f0 con 0x7f08501463e0 2020-04-22T14:07:07.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.437+0000 7f0854b88700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0850061c50 con 0x7f08500b2590 2020-04-22T14:07:07.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.437+0000 7f084ffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f08501463e0 0x7f0850142ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:07.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.437+0000 7f084ffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f08501463e0 0x7f0850142ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49848/0 (socket says 172.21.15.103:49848) 2020-04-22T14:07:07.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.437+0000 7f084ffff700 1 -- 172.21.15.103:0/2896343325 learned_addr learned my addr 172.21.15.103:0/2896343325 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:07.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.437+0000 7f084effd700 1 --2- 172.21.15.103:0/2896343325 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f08500b2590 0x7f08500620c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:07.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.437+0000 7f084ffff700 1 -- 172.21.15.103:0/2896343325 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f08500b2590 msgr2=0x7f08500620c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:07.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.437+0000 7f084ffff700 1 --2- 172.21.15.103:0/2896343325 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f08500b2590 0x7f08500620c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:07.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.437+0000 7f084ffff700 1 -- 172.21.15.103:0/2896343325 >> v1:172.21.15.86:6789/0 conn(0x7f0850061870 legacy=0x7f0850145cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:07.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.438+0000 7f084ffff700 1 -- 172.21.15.103:0/2896343325 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08500ad360 con 0x7f08501463e0 2020-04-22T14:07:07.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.438+0000 7f084effd700 1 --2- 172.21.15.103:0/2896343325 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f08500b2590 0x7f08500620c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:07:07.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.438+0000 7f084ffff700 1 --2- 172.21.15.103:0/2896343325 >> v2:172.21.15.103:3300/0 conn(0x7f08501463e0 0x7f0850142ce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f08500b6300 tx=0x7f0848007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.438+0000 7f084ffff700 1 --2- 172.21.15.103:0/2896343325 >> v2:172.21.15.103:3300/0 conn(0x7f08501463e0 0x7f0850142ce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f08500b6300 tx=0x7f0848007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.438+0000 7f084ffff700 1 --2- 172.21.15.103:0/2896343325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08501463e0 0x7f0850142ce0 secure :-1 s=READY pgs=593 cs=0 l=1 rx=0x7f08500b6300 tx=0x7f0848007dc0).ready entity=mon.1 client_cookie=7254215999642de3 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:07.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.438+0000 7f084ffff700 1 --2- 172.21.15.103:0/2896343325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08501463e0 0x7f0850142ce0 secure :-1 s=THROTTLE_DONE pgs=593 cs=0 l=1 rx=0x7f08500b6300 tx=0x7f0848007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.438+0000 7f084e7fc700 1 -- 172.21.15.103:0/2896343325 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0848012e70 con 0x7f08501463e0 2020-04-22T14:07:07.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.438+0000 7f084ffff700 1 --2- 172.21.15.103:0/2896343325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08501463e0 0x7f0850142ce0 secure :-1 s=THROTTLE_DONE pgs=593 cs=0 l=1 rx=0x7f08500b6300 tx=0x7f0848007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.438+0000 7f084ffff700 1 --2- 172.21.15.103:0/2896343325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08501463e0 0x7f0850142ce0 secure :-1 s=THROTTLE_DONE pgs=593 cs=0 l=1 rx=0x7f08500b6300 tx=0x7f0848007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.438+0000 7f084e7fc700 1 -- 172.21.15.103:0/2896343325 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f084800b370 con 0x7f08501463e0 2020-04-22T14:07:07.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.438+0000 7f084e7fc700 1 -- 172.21.15.103:0/2896343325 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f084800b790 con 0x7f08501463e0 2020-04-22T14:07:07.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.438+0000 7f0854b88700 1 -- 172.21.15.103:0/2896343325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08501463e0 msgr2=0x7f0850142ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:07.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.438+0000 7f0854b88700 1 --2- 172.21.15.103:0/2896343325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08501463e0 0x7f0850142ce0 secure :-1 s=READY pgs=593 cs=0 l=1 rx=0x7f08500b6300 tx=0x7f0848007dc0).stop 2020-04-22T14:07:07.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.438+0000 7f0854b88700 1 -- 172.21.15.103:0/2896343325 shutdown_connections 2020-04-22T14:07:07.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.438+0000 7f0854b88700 1 --2- 172.21.15.103:0/2896343325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08501463e0 0x7f0850142ce0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:07.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.438+0000 7f0854b88700 1 --2- 172.21.15.103:0/2896343325 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f08500b2590 0x7f08500620c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:07.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.438+0000 7f0854b88700 1 -- 172.21.15.103:0/2896343325 >> 172.21.15.103:0/2896343325 conn(0x7f085005b780 msgr2=0x7f08500b8530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:07.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.438+0000 7f0854b88700 1 -- 172.21.15.103:0/2896343325 shutdown_connections 2020-04-22T14:07:07.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.438+0000 7f0854b88700 1 -- 172.21.15.103:0/2896343325 wait complete. 2020-04-22T14:07:07.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.439+0000 7f0854b88700 1 Processor -- start 2020-04-22T14:07:07.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.439+0000 7f0854b88700 1 -- start start 2020-04-22T14:07:07.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.440+0000 7f0854b88700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0850061870 0x7f0850144c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:07.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.440+0000 7f0854b88700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08500673a0 con 0x7f08501463e0 2020-04-22T14:07:07.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.440+0000 7f0854b88700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08501537b0 con 0x7f08500b2590 2020-04-22T14:07:07.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.440+0000 7f0854b88700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0850145240 con 0x7f0850061870 2020-04-22T14:07:07.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.440+0000 7f084effd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f08500b2590 0x7f08501530a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42044/0 (socket says 172.21.15.103:42044) 2020-04-22T14:07:07.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.440+0000 7f084effd700 1 -- 172.21.15.103:0/3737538315 learned_addr learned my addr 172.21.15.103:0/3737538315 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:07.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.440+0000 7f084f7fe700 1 --2- 172.21.15.103:0/3737538315 >> v2:172.21.15.86:3300/0 conn(0x7f0850061870 0x7f0850144c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:07.451 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.441+0000 7f084f7fe700 1 -- 172.21.15.103:0/3737538315 >> v1:172.21.15.103:6789/0 conn(0x7f08500b2590 legacy=0x7f08501530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:07.451 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.441+0000 7f084f7fe700 1 -- 172.21.15.103:0/3737538315 >> v1:172.21.15.86:6789/0 conn(0x7f08501463e0 legacy=0x7f085013ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:07.451 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.441+0000 7f084f7fe700 1 -- 172.21.15.103:0/3737538315 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0850152960 con 0x7f0850061870 2020-04-22T14:07:07.451 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.441+0000 7f084f7fe700 1 --2- 172.21.15.103:0/3737538315 >> v2:172.21.15.86:3300/0 conn(0x7f0850061870 0x7f0850144c10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f085014f360 tx=0x7f0840012b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.451 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.441+0000 7f084f7fe700 1 --2- 172.21.15.103:0/3737538315 >> v2:172.21.15.86:3300/0 conn(0x7f0850061870 0x7f0850144c10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f085014f360 tx=0x7f0840012b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.451 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.441+0000 7f084f7fe700 1 --2- 172.21.15.103:0/3737538315 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0850061870 0x7f0850144c10 secure :-1 s=READY pgs=340 cs=0 l=1 rx=0x7f085014f360 tx=0x7f0840012b40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:07.451 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.442+0000 7f084f7fe700 1 --2- 172.21.15.103:0/3737538315 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0850061870 0x7f0850144c10 secure :-1 s=THROTTLE_DONE pgs=340 cs=0 l=1 rx=0x7f085014f360 tx=0x7f0840012b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.451 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.442+0000 7f084cff9700 1 -- 172.21.15.103:0/3737538315 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0840006bc0 con 0x7f0850061870 2020-04-22T14:07:07.452 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.442+0000 7f084f7fe700 1 --2- 172.21.15.103:0/3737538315 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0850061870 0x7f0850144c10 secure :-1 s=THROTTLE_DONE pgs=340 cs=0 l=1 rx=0x7f085014f360 tx=0x7f0840012b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.452 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.442+0000 7f084f7fe700 1 --2- 172.21.15.103:0/3737538315 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0850061870 0x7f0850144c10 secure :-1 s=THROTTLE_DONE pgs=340 cs=0 l=1 rx=0x7f085014f360 tx=0x7f0840012b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.452 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.442+0000 7f084cff9700 1 -- 172.21.15.103:0/3737538315 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0840006d60 con 0x7f0850061870 2020-04-22T14:07:07.452 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.442+0000 7f0854b88700 1 -- 172.21.15.103:0/3737538315 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0850152c00 con 0x7f0850061870 2020-04-22T14:07:07.452 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.442+0000 7f084cff9700 1 -- 172.21.15.103:0/3737538315 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0840014390 con 0x7f0850061870 2020-04-22T14:07:07.452 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.442+0000 7f0854b88700 1 -- 172.21.15.103:0/3737538315 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08501447d0 con 0x7f0850061870 2020-04-22T14:07:07.452 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.443+0000 7f084f7fe700 1 --2- 172.21.15.103:0/3737538315 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0850061870 0x7f0850144c10 secure :-1 s=THROTTLE_DONE pgs=340 cs=0 l=1 rx=0x7f085014f360 tx=0x7f0840012b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.453 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.443+0000 7f0854b88700 1 -- 172.21.15.103:0/3737538315 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0850145070 con 0x7f0850061870 2020-04-22T14:07:07.453 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.443+0000 7f084cff9700 1 -- 172.21.15.103:0/3737538315 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f08400144f0 con 0x7f0850061870 2020-04-22T14:07:07.453 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.443+0000 7f084f7fe700 1 --2- 172.21.15.103:0/3737538315 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0850061870 0x7f0850144c10 secure :-1 s=THROTTLE_DONE pgs=340 cs=0 l=1 rx=0x7f085014f360 tx=0x7f0840012b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.453 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.444+0000 7f084cff9700 1 --2- 172.21.15.103:0/3737538315 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f083004da50 0x7f083004ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:07.453 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.444+0000 7f084cff9700 1 -- 172.21.15.103:0/3737538315 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0840063a10 con 0x7f0850061870 2020-04-22T14:07:07.453 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.444+0000 7f084effd700 1 --2- 172.21.15.103:0/3737538315 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f083004da50 0x7f083004ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:07.453 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.444+0000 7f084effd700 1 --2- 172.21.15.103:0/3737538315 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f083004da50 0x7f083004ff10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0850143bb0 tx=0x7f0844002380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.454 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.444+0000 7f084effd700 1 --2- 172.21.15.103:0/3737538315 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f083004da50 0x7f083004ff10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0850143bb0 tx=0x7f0844002380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.454 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.444+0000 7f084effd700 1 --2- 172.21.15.103:0/3737538315 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f083004da50 0x7f083004ff10 secure :-1 s=READY pgs=231 cs=0 l=1 rx=0x7f0850143bb0 tx=0x7f0844002380).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:07.454 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.447+0000 7f084f7fe700 1 --2- 172.21.15.103:0/3737538315 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0850061870 0x7f0850144c10 secure :-1 s=THROTTLE_DONE pgs=340 cs=0 l=1 rx=0x7f085014f360 tx=0x7f0840012b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.454 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.447+0000 7f084cff9700 1 -- 172.21.15.103:0/3737538315 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f084003ed90 con 0x7f0850061870 2020-04-22T14:07:07.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.589+0000 7f0854b88700 1 -- 172.21.15.103:0/3737538315 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0850056c90 con 0x7f0850061870 2020-04-22T14:07:07.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.589+0000 7f084f7fe700 1 --2- 172.21.15.103:0/3737538315 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0850061870 0x7f0850144c10 secure :-1 s=THROTTLE_DONE pgs=340 cs=0 l=1 rx=0x7f085014f360 tx=0x7f0840012b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.590+0000 7f084cff9700 1 -- 172.21.15.103:0/3737538315 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v45) v1 ==== 92+0+10 (secure 0 0 0) 0x7f08400423b0 con 0x7f0850061870 2020-04-22T14:07:07.593 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:07:07.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.591+0000 7f0854b88700 1 -- 172.21.15.103:0/3737538315 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f083004da50 msgr2=0x7f083004ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:07.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.591+0000 7f0854b88700 1 --2- 172.21.15.103:0/3737538315 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f083004da50 0x7f083004ff10 secure :-1 s=READY pgs=231 cs=0 l=1 rx=0x7f0850143bb0 tx=0x7f0844002380).stop 2020-04-22T14:07:07.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.591+0000 7f0854b88700 1 -- 172.21.15.103:0/3737538315 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0850061870 msgr2=0x7f0850144c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:07.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.591+0000 7f0854b88700 1 --2- 172.21.15.103:0/3737538315 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0850061870 0x7f0850144c10 secure :-1 s=READY pgs=340 cs=0 l=1 rx=0x7f085014f360 tx=0x7f0840012b40).stop 2020-04-22T14:07:07.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.591+0000 7f0854b88700 1 -- 172.21.15.103:0/3737538315 shutdown_connections 2020-04-22T14:07:07.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.591+0000 7f0854b88700 1 --2- 172.21.15.103:0/3737538315 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f083004da50 0x7f083004ff10 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:07.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.591+0000 7f0854b88700 1 --2- 172.21.15.103:0/3737538315 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0850061870 0x7f0850144c10 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:07.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.591+0000 7f0854b88700 1 -- 172.21.15.103:0/3737538315 >> 172.21.15.103:0/3737538315 conn(0x7f085005b780 msgr2=0x7f08500b1530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:07.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.591+0000 7f0854b88700 1 -- 172.21.15.103:0/3737538315 shutdown_connections 2020-04-22T14:07:07.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.591+0000 7f0854b88700 1 -- 172.21.15.103:0/3737538315 wait complete. 2020-04-22T14:07:07.605 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:07.618 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-22T14:07:07.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.765+0000 7fe192c84700 1 Processor -- start 2020-04-22T14:07:07.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.765+0000 7fe192c84700 1 -- start start 2020-04-22T14:07:07.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.765+0000 7fe192c84700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe18c0b9140 0x7fe18c12b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:07.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.766+0000 7fe192c84700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe18c1467e0 con 0x7fe18c12b670 2020-04-22T14:07:07.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.766+0000 7fe192c84700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe18c060050 con 0x7fe18c0ac950 2020-04-22T14:07:07.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.766+0000 7fe192c84700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe18c0602f0 con 0x7fe18c0b9140 2020-04-22T14:07:07.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.766+0000 7fe190a20700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe18c0b9140 0x7fe18c12b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:07.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.766+0000 7fe18bfff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe18c0ac950 0x7fe18c146c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42050/0 (socket says 172.21.15.103:42050) 2020-04-22T14:07:07.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.766+0000 7fe190a20700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe18c0b9140 0x7fe18c12b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49860/0 (socket says 172.21.15.103:49860) 2020-04-22T14:07:07.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.766+0000 7fe18bfff700 1 -- 172.21.15.103:0/1209739051 learned_addr learned my addr 172.21.15.103:0/1209739051 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:07.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.766+0000 7fe190a20700 1 -- 172.21.15.103:0/1209739051 >> v1:172.21.15.103:6789/0 conn(0x7fe18c0ac950 legacy=0x7fe18c146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:07.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.766+0000 7fe190a20700 1 -- 172.21.15.103:0/1209739051 >> v1:172.21.15.86:6789/0 conn(0x7fe18c12b670 legacy=0x7fe18c143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:07.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.766+0000 7fe190a20700 1 -- 172.21.15.103:0/1209739051 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe18c0b9520 con 0x7fe18c0b9140 2020-04-22T14:07:07.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.766+0000 7fe18b7fe700 1 -- 172.21.15.103:0/1209739051 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4266763795 0 0) 0x7fe18c060050 con 0x7fe18c0ac950 2020-04-22T14:07:07.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.766+0000 7fe190a20700 1 --2- 172.21.15.103:0/1209739051 >> v2:172.21.15.103:3300/0 conn(0x7fe18c0b9140 0x7fe18c12b210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe18c0b6250 tx=0x7fe17c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.766+0000 7fe190a20700 1 --2- 172.21.15.103:0/1209739051 >> v2:172.21.15.103:3300/0 conn(0x7fe18c0b9140 0x7fe18c12b210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe18c0b6250 tx=0x7fe17c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.766+0000 7fe190a20700 1 --2- 172.21.15.103:0/1209739051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe18c0b9140 0x7fe18c12b210 secure :-1 s=READY pgs=596 cs=0 l=1 rx=0x7fe18c0b6250 tx=0x7fe17c007a40).ready entity=mon.1 client_cookie=c3feaabd78ffaccf server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:07.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.766+0000 7fe190a20700 1 --2- 172.21.15.103:0/1209739051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe18c0b9140 0x7fe18c12b210 secure :-1 s=THROTTLE_DONE pgs=596 cs=0 l=1 rx=0x7fe18c0b6250 tx=0x7fe17c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.766+0000 7fe18b7fe700 1 -- 172.21.15.103:0/1209739051 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe17c011430 con 0x7fe18c0b9140 2020-04-22T14:07:07.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.766+0000 7fe190a20700 1 --2- 172.21.15.103:0/1209739051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe18c0b9140 0x7fe18c12b210 secure :-1 s=THROTTLE_DONE pgs=596 cs=0 l=1 rx=0x7fe18c0b6250 tx=0x7fe17c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.766+0000 7fe190a20700 1 --2- 172.21.15.103:0/1209739051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe18c0b9140 0x7fe18c12b210 secure :-1 s=THROTTLE_DONE pgs=596 cs=0 l=1 rx=0x7fe18c0b6250 tx=0x7fe17c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.766+0000 7fe18b7fe700 1 -- 172.21.15.103:0/1209739051 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17c011590 con 0x7fe18c0b9140 2020-04-22T14:07:07.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.766+0000 7fe18b7fe700 1 -- 172.21.15.103:0/1209739051 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe17c011970 con 0x7fe18c0b9140 2020-04-22T14:07:07.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.766+0000 7fe192c84700 1 -- 172.21.15.103:0/1209739051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe18c0b9140 msgr2=0x7fe18c12b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:07.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.766+0000 7fe192c84700 1 --2- 172.21.15.103:0/1209739051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe18c0b9140 0x7fe18c12b210 secure :-1 s=READY pgs=596 cs=0 l=1 rx=0x7fe18c0b6250 tx=0x7fe17c007a40).stop 2020-04-22T14:07:07.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.767+0000 7fe192c84700 1 -- 172.21.15.103:0/1209739051 shutdown_connections 2020-04-22T14:07:07.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.767+0000 7fe192c84700 1 --2- 172.21.15.103:0/1209739051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe18c0b9140 0x7fe18c12b210 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:07.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.767+0000 7fe192c84700 1 -- 172.21.15.103:0/1209739051 >> 172.21.15.103:0/1209739051 conn(0x7fe18c05b7b0 msgr2=0x7fe18c0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:07.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.767+0000 7fe192c84700 1 -- 172.21.15.103:0/1209739051 shutdown_connections 2020-04-22T14:07:07.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.767+0000 7fe192c84700 1 -- 172.21.15.103:0/1209739051 wait complete. 2020-04-22T14:07:07.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.768+0000 7fe192c84700 1 Processor -- start 2020-04-22T14:07:07.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.768+0000 7fe192c84700 1 -- start start 2020-04-22T14:07:07.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.769+0000 7fe192c84700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe18c0ac950 0x7fe18c066720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:07.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.769+0000 7fe192c84700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe18c0b9140 0x7fe18c0635c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:07.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.769+0000 7fe192c84700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe18c143ed0 con 0x7fe18c12b670 2020-04-22T14:07:07.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.769+0000 7fe192c84700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe18c063f50 con 0x7fe18c0ac950 2020-04-22T14:07:07.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.769+0000 7fe192c84700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe18c0641f0 con 0x7fe18c0b9140 2020-04-22T14:07:07.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.769+0000 7fe18bfff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe18c0b9140 0x7fe18c0635c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:07.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.769+0000 7fe18bfff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe18c0b9140 0x7fe18c0635c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49868/0 (socket says 172.21.15.103:49868) 2020-04-22T14:07:07.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.769+0000 7fe18bfff700 1 -- 172.21.15.103:0/2439440001 learned_addr learned my addr 172.21.15.103:0/2439440001 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:07.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.769+0000 7fe190a20700 1 --2- 172.21.15.103:0/2439440001 >> v2:172.21.15.86:3300/0 conn(0x7fe18c0ac950 0x7fe18c066720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:07.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.769+0000 7fe18bfff700 1 -- 172.21.15.103:0/2439440001 >> v2:172.21.15.86:3300/0 conn(0x7fe18c0ac950 msgr2=0x7fe18c066720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:07.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.769+0000 7fe18bfff700 1 --2- 172.21.15.103:0/2439440001 >> v2:172.21.15.86:3300/0 conn(0x7fe18c0ac950 0x7fe18c066720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:07.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.769+0000 7fe18bfff700 1 -- 172.21.15.103:0/2439440001 >> v1:172.21.15.86:6789/0 conn(0x7fe18c12b670 legacy=0x7fe18c0b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:07.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.769+0000 7fe18bfff700 1 -- 172.21.15.103:0/2439440001 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe18c064490 con 0x7fe18c0b9140 2020-04-22T14:07:07.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.769+0000 7fe18bfff700 1 --2- 172.21.15.103:0/2439440001 >> v2:172.21.15.103:3300/0 conn(0x7fe18c0b9140 0x7fe18c0635c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe180000b80 tx=0x7fe180001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.769+0000 7fe18bfff700 1 --2- 172.21.15.103:0/2439440001 >> v2:172.21.15.103:3300/0 conn(0x7fe18c0b9140 0x7fe18c0635c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe180000b80 tx=0x7fe180001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.769+0000 7fe18bfff700 1 --2- 172.21.15.103:0/2439440001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe18c0b9140 0x7fe18c0635c0 secure :-1 s=READY pgs=597 cs=0 l=1 rx=0x7fe180000b80 tx=0x7fe180001e40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:07.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.769+0000 7fe18bfff700 1 --2- 172.21.15.103:0/2439440001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe18c0b9140 0x7fe18c0635c0 secure :-1 s=THROTTLE_DONE pgs=597 cs=0 l=1 rx=0x7fe180000b80 tx=0x7fe180001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.769+0000 7fe18bfff700 1 --2- 172.21.15.103:0/2439440001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe18c0b9140 0x7fe18c0635c0 secure :-1 s=THROTTLE_DONE pgs=597 cs=0 l=1 rx=0x7fe180000b80 tx=0x7fe180001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.769+0000 7fe189ffb700 1 -- 172.21.15.103:0/2439440001 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe18000c930 con 0x7fe18c0b9140 2020-04-22T14:07:07.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.769+0000 7fe18bfff700 1 --2- 172.21.15.103:0/2439440001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe18c0b9140 0x7fe18c0635c0 secure :-1 s=THROTTLE_DONE pgs=597 cs=0 l=1 rx=0x7fe180000b80 tx=0x7fe180001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.769+0000 7fe189ffb700 1 -- 172.21.15.103:0/2439440001 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18000ca90 con 0x7fe18c0b9140 2020-04-22T14:07:07.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.769+0000 7fe192c84700 1 -- 172.21.15.103:0/2439440001 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe18c064930 con 0x7fe18c0b9140 2020-04-22T14:07:07.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.769+0000 7fe189ffb700 1 -- 172.21.15.103:0/2439440001 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe18000ce70 con 0x7fe18c0b9140 2020-04-22T14:07:07.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.769+0000 7fe192c84700 1 -- 172.21.15.103:0/2439440001 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe18c062a70 con 0x7fe18c0b9140 2020-04-22T14:07:07.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.770+0000 7fe18bfff700 1 --2- 172.21.15.103:0/2439440001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe18c0b9140 0x7fe18c0635c0 secure :-1 s=THROTTLE_DONE pgs=597 cs=0 l=1 rx=0x7fe180000b80 tx=0x7fe180001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.770+0000 7fe192c84700 1 -- 172.21.15.103:0/2439440001 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe18c056c90 con 0x7fe18c0b9140 2020-04-22T14:07:07.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.770+0000 7fe189ffb700 1 -- 172.21.15.103:0/2439440001 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fe1800055c0 con 0x7fe18c0b9140 2020-04-22T14:07:07.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.770+0000 7fe18bfff700 1 --2- 172.21.15.103:0/2439440001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe18c0b9140 0x7fe18c0635c0 secure :-1 s=THROTTLE_DONE pgs=597 cs=0 l=1 rx=0x7fe180000b80 tx=0x7fe180001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.771+0000 7fe189ffb700 1 --2- 172.21.15.103:0/2439440001 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe16c04d930 0x7fe16c04fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:07.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.771+0000 7fe189ffb700 1 -- 172.21.15.103:0/2439440001 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe1800100c0 con 0x7fe18c0b9140 2020-04-22T14:07:07.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.771+0000 7fe190a20700 1 --2- 172.21.15.103:0/2439440001 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe16c04d930 0x7fe16c04fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:07.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.771+0000 7fe190a20700 1 --2- 172.21.15.103:0/2439440001 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe16c04d930 0x7fe16c04fdf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe18c0b6250 tx=0x7fe17c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.771+0000 7fe190a20700 1 --2- 172.21.15.103:0/2439440001 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe16c04d930 0x7fe16c04fdf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe18c0b6250 tx=0x7fe17c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.771+0000 7fe190a20700 1 --2- 172.21.15.103:0/2439440001 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe16c04d930 0x7fe16c04fdf0 secure :-1 s=READY pgs=232 cs=0 l=1 rx=0x7fe18c0b6250 tx=0x7fe17c007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:07.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.775+0000 7fe18bfff700 1 --2- 172.21.15.103:0/2439440001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe18c0b9140 0x7fe18c0635c0 secure :-1 s=THROTTLE_DONE pgs=597 cs=0 l=1 rx=0x7fe180000b80 tx=0x7fe180001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.775+0000 7fe189ffb700 1 -- 172.21.15.103:0/2439440001 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fe18003c310 con 0x7fe18c0b9140 2020-04-22T14:07:07.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.917+0000 7fe192c84700 1 -- 172.21.15.103:0/2439440001 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe18c066ce0 con 0x7fe18c0b9140 2020-04-22T14:07:07.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.918+0000 7fe18bfff700 1 --2- 172.21.15.103:0/2439440001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe18c0b9140 0x7fe18c0635c0 secure :-1 s=THROTTLE_DONE pgs=597 cs=0 l=1 rx=0x7fe180000b80 tx=0x7fe180001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:07.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.918+0000 7fe189ffb700 1 -- 172.21.15.103:0/2439440001 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v45) v1 ==== 104+0+10 (secure 0 0 0) 0x7fe18003f930 con 0x7fe18c0b9140 2020-04-22T14:07:07.921 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:07:07.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.919+0000 7fe192c84700 1 -- 172.21.15.103:0/2439440001 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe16c04d930 msgr2=0x7fe16c04fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:07.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.919+0000 7fe192c84700 1 --2- 172.21.15.103:0/2439440001 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe16c04d930 0x7fe16c04fdf0 secure :-1 s=READY pgs=232 cs=0 l=1 rx=0x7fe18c0b6250 tx=0x7fe17c007a40).stop 2020-04-22T14:07:07.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.919+0000 7fe192c84700 1 -- 172.21.15.103:0/2439440001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe18c0b9140 msgr2=0x7fe18c0635c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:07.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.919+0000 7fe192c84700 1 --2- 172.21.15.103:0/2439440001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe18c0b9140 0x7fe18c0635c0 secure :-1 s=READY pgs=597 cs=0 l=1 rx=0x7fe180000b80 tx=0x7fe180001e40).stop 2020-04-22T14:07:07.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.919+0000 7fe192c84700 1 -- 172.21.15.103:0/2439440001 shutdown_connections 2020-04-22T14:07:07.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.919+0000 7fe192c84700 1 --2- 172.21.15.103:0/2439440001 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe16c04d930 0x7fe16c04fdf0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:07.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.919+0000 7fe192c84700 1 --2- 172.21.15.103:0/2439440001 >> v2:172.21.15.86:3300/0 conn(0x7fe18c0ac950 0x7fe18c066720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:07.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.919+0000 7fe192c84700 1 --2- 172.21.15.103:0/2439440001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe18c0b9140 0x7fe18c0635c0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:07.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.919+0000 7fe192c84700 1 -- 172.21.15.103:0/2439440001 >> 172.21.15.103:0/2439440001 conn(0x7fe18c05b7b0 msgr2=0x7fe18c0ae6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:07.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.919+0000 7fe192c84700 1 -- 172.21.15.103:0/2439440001 shutdown_connections 2020-04-22T14:07:07.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:07.919+0000 7fe192c84700 1 -- 172.21.15.103:0/2439440001 wait complete. 2020-04-22T14:07:07.932 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:07.945 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-22T14:07:08.092 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.090+0000 7f79902bd700 1 Processor -- start 2020-04-22T14:07:08.093 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.090+0000 7f79902bd700 1 -- start start 2020-04-22T14:07:08.095 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.090+0000 7f79902bd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f79880b9140 0x7f798812b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:08.095 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.090+0000 7f79902bd700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79881467e0 con 0x7f79880ac950 2020-04-22T14:07:08.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.090+0000 7f79902bd700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7988060050 con 0x7f798812b670 2020-04-22T14:07:08.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.090+0000 7f79902bd700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79880602f0 con 0x7f79880b9140 2020-04-22T14:07:08.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.091+0000 7f798e85a700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f798812b670 0x7f7988143090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42068/0 (socket says 172.21.15.103:42068) 2020-04-22T14:07:08.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.091+0000 7f798e85a700 1 -- 172.21.15.103:0/3081537848 learned_addr learned my addr 172.21.15.103:0/3081537848 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:08.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.091+0000 7f798e059700 1 --2- 172.21.15.103:0/3081537848 >> v2:172.21.15.86:3300/0 conn(0x7f79880b9140 0x7f798812b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:08.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.091+0000 7f798d057700 1 -- 172.21.15.103:0/3081537848 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 306208326 0 0) 0x7f7988060050 con 0x7f798812b670 2020-04-22T14:07:08.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.091+0000 7f798d057700 1 -- 172.21.15.103:0/3081537848 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7970003230 con 0x7f798812b670 2020-04-22T14:07:08.097 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.091+0000 7f798e059700 1 -- 172.21.15.103:0/3081537848 >> v1:172.21.15.103:6789/0 conn(0x7f798812b670 legacy=0x7f7988143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:08.097 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.091+0000 7f798e059700 1 -- 172.21.15.103:0/3081537848 >> v1:172.21.15.86:6789/0 conn(0x7f79880ac950 legacy=0x7f7988146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:08.097 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.091+0000 7f798d057700 1 -- 172.21.15.103:0/3081537848 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2679324838 0 0) 0x7f79881467e0 con 0x7f79880ac950 2020-04-22T14:07:08.097 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.091+0000 7f798e059700 1 -- 172.21.15.103:0/3081537848 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79880b9520 con 0x7f79880b9140 2020-04-22T14:07:08.097 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.091+0000 7f798e059700 1 --2- 172.21.15.103:0/3081537848 >> v2:172.21.15.86:3300/0 conn(0x7f79880b9140 0x7f798812b210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7978002f30 tx=0x7f7978007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:08.097 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.091+0000 7f798e059700 1 --2- 172.21.15.103:0/3081537848 >> v2:172.21.15.86:3300/0 conn(0x7f79880b9140 0x7f798812b210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7978002f30 tx=0x7f7978007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:08.097 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.091+0000 7f798e059700 1 --2- 172.21.15.103:0/3081537848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79880b9140 0x7f798812b210 secure :-1 s=READY pgs=344 cs=0 l=1 rx=0x7f7978002f30 tx=0x7f7978007a40).ready entity=mon.0 client_cookie=fce0d10023f3812c server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:08.098 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.091+0000 7f798e059700 1 --2- 172.21.15.103:0/3081537848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79880b9140 0x7f798812b210 secure :-1 s=THROTTLE_DONE pgs=344 cs=0 l=1 rx=0x7f7978002f30 tx=0x7f7978007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:08.098 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.091+0000 7f798d057700 1 -- 172.21.15.103:0/3081537848 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79780113c0 con 0x7f79880b9140 2020-04-22T14:07:08.098 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.091+0000 7f798e059700 1 --2- 172.21.15.103:0/3081537848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79880b9140 0x7f798812b210 secure :-1 s=THROTTLE_DONE pgs=344 cs=0 l=1 rx=0x7f7978002f30 tx=0x7f7978007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:08.098 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.091+0000 7f798e059700 1 --2- 172.21.15.103:0/3081537848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79880b9140 0x7f798812b210 secure :-1 s=THROTTLE_DONE pgs=344 cs=0 l=1 rx=0x7f7978002f30 tx=0x7f7978007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:08.098 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.091+0000 7f798d057700 1 -- 172.21.15.103:0/3081537848 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7978011520 con 0x7f79880b9140 2020-04-22T14:07:08.098 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.091+0000 7f798d057700 1 -- 172.21.15.103:0/3081537848 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7978011880 con 0x7f79880b9140 2020-04-22T14:07:08.098 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.091+0000 7f79902bd700 1 -- 172.21.15.103:0/3081537848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79880b9140 msgr2=0x7f798812b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:08.098 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.091+0000 7f79902bd700 1 --2- 172.21.15.103:0/3081537848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79880b9140 0x7f798812b210 secure :-1 s=READY pgs=344 cs=0 l=1 rx=0x7f7978002f30 tx=0x7f7978007a40).stop 2020-04-22T14:07:08.099 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.092+0000 7f79902bd700 1 -- 172.21.15.103:0/3081537848 shutdown_connections 2020-04-22T14:07:08.099 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.092+0000 7f79902bd700 1 --2- 172.21.15.103:0/3081537848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79880b9140 0x7f798812b210 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:08.099 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.092+0000 7f79902bd700 1 -- 172.21.15.103:0/3081537848 >> 172.21.15.103:0/3081537848 conn(0x7f798805b7b0 msgr2=0x7f79880b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:08.099 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.092+0000 7f79902bd700 1 -- 172.21.15.103:0/3081537848 shutdown_connections 2020-04-22T14:07:08.099 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.092+0000 7f79902bd700 1 -- 172.21.15.103:0/3081537848 wait complete. 2020-04-22T14:07:08.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.093+0000 7f79902bd700 1 Processor -- start 2020-04-22T14:07:08.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.093+0000 7f79902bd700 1 -- start start 2020-04-22T14:07:08.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.094+0000 7f79902bd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f79880b9140 0x7f7988065450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:08.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.094+0000 7f79902bd700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7988147aa0 con 0x7f798812b670 2020-04-22T14:07:08.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.094+0000 7f79902bd700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7988147d40 con 0x7f79880ac950 2020-04-22T14:07:08.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.094+0000 7f79902bd700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7988147fe0 con 0x7f79880b9140 2020-04-22T14:07:08.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.094+0000 7f798d858700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f79880b9140 0x7f7988065450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:08.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.094+0000 7f798e059700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f79880ac950 0x7f7988062f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42070/0 (socket says 172.21.15.103:42070) 2020-04-22T14:07:08.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.094+0000 7f798e059700 1 -- 172.21.15.103:0/392067777 learned_addr learned my addr 172.21.15.103:0/392067777 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:08.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.094+0000 7f79777fe700 1 -- 172.21.15.103:0/392067777 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4128598722 0 0) 0x7f7988147d40 con 0x7f79880ac950 2020-04-22T14:07:08.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.094+0000 7f79777fe700 1 -- 172.21.15.103:0/392067777 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7968002fe0 con 0x7f79880ac950 2020-04-22T14:07:08.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.094+0000 7f798d858700 1 -- 172.21.15.103:0/392067777 >> v1:172.21.15.103:6789/0 conn(0x7f79880ac950 legacy=0x7f7988062f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:08.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.094+0000 7f798d858700 1 -- 172.21.15.103:0/392067777 >> v1:172.21.15.86:6789/0 conn(0x7f798812b670 legacy=0x7f7988063630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:08.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.094+0000 7f798d858700 1 -- 172.21.15.103:0/392067777 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7988147720 con 0x7f79880b9140 2020-04-22T14:07:08.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.094+0000 7f798d858700 1 --2- 172.21.15.103:0/392067777 >> v2:172.21.15.103:3300/0 conn(0x7f79880b9140 0x7f7988065450 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7984000b80 tx=0x7f7984001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:08.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.094+0000 7f798d858700 1 --2- 172.21.15.103:0/392067777 >> v2:172.21.15.103:3300/0 conn(0x7f79880b9140 0x7f7988065450 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7984000b80 tx=0x7f7984001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:08.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.094+0000 7f798d858700 1 --2- 172.21.15.103:0/392067777 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79880b9140 0x7f7988065450 secure :-1 s=READY pgs=600 cs=0 l=1 rx=0x7f7984000b80 tx=0x7f7984001e40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:08.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.094+0000 7f798d858700 1 --2- 172.21.15.103:0/392067777 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79880b9140 0x7f7988065450 secure :-1 s=THROTTLE_DONE pgs=600 cs=0 l=1 rx=0x7f7984000b80 tx=0x7f7984001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:08.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.094+0000 7f79777fe700 1 -- 172.21.15.103:0/392067777 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f798400cd10 con 0x7f79880b9140 2020-04-22T14:07:08.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.094+0000 7f798d858700 1 --2- 172.21.15.103:0/392067777 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79880b9140 0x7f7988065450 secure :-1 s=THROTTLE_DONE pgs=600 cs=0 l=1 rx=0x7f7984000b80 tx=0x7f7984001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:08.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.094+0000 7f798d858700 1 --2- 172.21.15.103:0/392067777 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79880b9140 0x7f7988065450 secure :-1 s=THROTTLE_DONE pgs=600 cs=0 l=1 rx=0x7f7984000b80 tx=0x7f7984001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:08.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.094+0000 7f79777fe700 1 -- 172.21.15.103:0/392067777 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798400ce70 con 0x7f79880b9140 2020-04-22T14:07:08.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.094+0000 7f79902bd700 1 -- 172.21.15.103:0/392067777 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79881287e0 con 0x7f79880b9140 2020-04-22T14:07:08.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.094+0000 7f79777fe700 1 -- 172.21.15.103:0/392067777 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79840110a0 con 0x7f79880b9140 2020-04-22T14:07:08.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.094+0000 7f79902bd700 1 -- 172.21.15.103:0/392067777 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79881486c0 con 0x7f79880b9140 2020-04-22T14:07:08.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.095+0000 7f798d858700 1 --2- 172.21.15.103:0/392067777 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79880b9140 0x7f7988065450 secure :-1 s=THROTTLE_DONE pgs=600 cs=0 l=1 rx=0x7f7984000b80 tx=0x7f7984001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:08.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.095+0000 7f79777fe700 1 -- 172.21.15.103:0/392067777 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f79840064e0 con 0x7f79880b9140 2020-04-22T14:07:08.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.095+0000 7f798d858700 1 --2- 172.21.15.103:0/392067777 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79880b9140 0x7f7988065450 secure :-1 s=THROTTLE_DONE pgs=600 cs=0 l=1 rx=0x7f7984000b80 tx=0x7f7984001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:08.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.095+0000 7f79902bd700 1 -- 172.21.15.103:0/392067777 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7988056c90 con 0x7f79880b9140 2020-04-22T14:07:08.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.096+0000 7f79777fe700 1 --2- 172.21.15.103:0/392067777 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f796804dc20 0x7f79680500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:08.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.096+0000 7f79777fe700 1 -- 172.21.15.103:0/392067777 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7984060fd0 con 0x7f79880b9140 2020-04-22T14:07:08.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.096+0000 7f798e059700 1 --2- 172.21.15.103:0/392067777 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f796804dc20 0x7f79680500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:08.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.096+0000 7f798e059700 1 --2- 172.21.15.103:0/392067777 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f796804dc20 0x7f79680500e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f79780088e0 tx=0x7f7978007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:08.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.096+0000 7f798e059700 1 --2- 172.21.15.103:0/392067777 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f796804dc20 0x7f79680500e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f79780088e0 tx=0x7f7978007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:08.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.096+0000 7f798e059700 1 --2- 172.21.15.103:0/392067777 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f796804dc20 0x7f79680500e0 secure :-1 s=READY pgs=233 cs=0 l=1 rx=0x7f79780088e0 tx=0x7f7978007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:08.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.100+0000 7f798d858700 1 --2- 172.21.15.103:0/392067777 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79880b9140 0x7f7988065450 secure :-1 s=THROTTLE_DONE pgs=600 cs=0 l=1 rx=0x7f7984000b80 tx=0x7f7984001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:08.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.100+0000 7f79777fe700 1 -- 172.21.15.103:0/392067777 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f798403c3b0 con 0x7f79880b9140 2020-04-22T14:07:08.244 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.241+0000 7f79902bd700 1 -- 172.21.15.103:0/392067777 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7988060010 con 0x7f79880b9140 2020-04-22T14:07:08.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.242+0000 7f798d858700 1 --2- 172.21.15.103:0/392067777 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79880b9140 0x7f7988065450 secure :-1 s=THROTTLE_DONE pgs=600 cs=0 l=1 rx=0x7f7984000b80 tx=0x7f7984001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:08.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.242+0000 7f79777fe700 1 -- 172.21.15.103:0/392067777 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v45) v1 ==== 100+0+10 (secure 0 0 0) 0x7f798403f9d0 con 0x7f79880b9140 2020-04-22T14:07:08.246 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:07:08.247 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.243+0000 7f79902bd700 1 -- 172.21.15.103:0/392067777 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f796804dc20 msgr2=0x7f79680500e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:08.247 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.243+0000 7f79902bd700 1 --2- 172.21.15.103:0/392067777 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f796804dc20 0x7f79680500e0 secure :-1 s=READY pgs=233 cs=0 l=1 rx=0x7f79780088e0 tx=0x7f7978007a40).stop 2020-04-22T14:07:08.248 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.243+0000 7f79902bd700 1 -- 172.21.15.103:0/392067777 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79880b9140 msgr2=0x7f7988065450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:08.248 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.243+0000 7f79902bd700 1 --2- 172.21.15.103:0/392067777 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79880b9140 0x7f7988065450 secure :-1 s=READY pgs=600 cs=0 l=1 rx=0x7f7984000b80 tx=0x7f7984001e40).stop 2020-04-22T14:07:08.248 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.243+0000 7f79902bd700 1 -- 172.21.15.103:0/392067777 shutdown_connections 2020-04-22T14:07:08.248 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.243+0000 7f79902bd700 1 --2- 172.21.15.103:0/392067777 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f796804dc20 0x7f79680500e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:08.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.243+0000 7f79902bd700 1 --2- 172.21.15.103:0/392067777 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79880b9140 0x7f7988065450 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:08.263 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.243+0000 7f79902bd700 1 -- 172.21.15.103:0/392067777 >> 172.21.15.103:0/392067777 conn(0x7f798805b7b0 msgr2=0x7f79880ae640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:08.263 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.243+0000 7f79902bd700 1 -- 172.21.15.103:0/392067777 shutdown_connections 2020-04-22T14:07:08.263 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.243+0000 7f79902bd700 1 -- 172.21.15.103:0/392067777 wait complete. 2020-04-22T14:07:08.265 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-04-22T14:07:08.265 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:08.279 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:07:08.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.421+0000 7f4709b1c700 1 Processor -- start 2020-04-22T14:07:08.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.421+0000 7f4709b1c700 1 -- start start 2020-04-22T14:07:08.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.422+0000 7f4709b1c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f47040b6040 0x7f47040ac740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:08.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.422+0000 7f4709b1c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f47041426d0 0x7f4704142b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:08.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.422+0000 7f4709b1c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4704064ec0 con 0x7f4704067170 2020-04-22T14:07:08.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.422+0000 7f4709b1c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4704065af0 con 0x7f47041426d0 2020-04-22T14:07:08.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.422+0000 7f4709b1c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4704146870 con 0x7f47040b6040 2020-04-22T14:07:08.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.422+0000 7f47037fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f4704067170 0x7f470413c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42078/0 (socket says 172.21.15.103:42078) 2020-04-22T14:07:08.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.422+0000 7f47037fe700 1 -- 172.21.15.103:0/2431507927 learned_addr learned my addr 172.21.15.103:0/2431507927 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:08.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.422+0000 7f4703fff700 1 --2- 172.21.15.103:0/2431507927 >> v2:172.21.15.86:3300/0 conn(0x7f47041426d0 0x7f4704142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:08.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.422+0000 7f4702ffd700 1 --2- 172.21.15.103:0/2431507927 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f47040b6040 0x7f47040ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:08.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.423+0000 7f47027fc700 1 -- 172.21.15.103:0/2431507927 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1999212642 0 0) 0x7f4704064ec0 con 0x7f4704067170 2020-04-22T14:07:08.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.423+0000 7f47027fc700 1 -- 172.21.15.103:0/2431507927 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46f0003230 con 0x7f4704067170 2020-04-22T14:07:08.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.423+0000 7f47027fc700 1 -- 172.21.15.103:0/2431507927 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3348717894 0 0) 0x7f46f0003230 con 0x7f4704067170 2020-04-22T14:07:08.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.423+0000 7f47027fc700 1 -- 172.21.15.103:0/2431507927 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f47040b6040 msgr2=0x7f47040ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:08.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.423+0000 7f47027fc700 1 --2- 172.21.15.103:0/2431507927 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f47040b6040 0x7f47040ac740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:08.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.423+0000 7f47027fc700 1 -- 172.21.15.103:0/2431507927 >> v2:172.21.15.86:3300/0 conn(0x7f47041426d0 msgr2=0x7f4704142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:08.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.423+0000 7f47027fc700 1 --2- 172.21.15.103:0/2431507927 >> v2:172.21.15.86:3300/0 conn(0x7f47041426d0 0x7f4704142b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:08.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.423+0000 7f47027fc700 1 -- 172.21.15.103:0/2431507927 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4704067550 con 0x7f4704067170 2020-04-22T14:07:08.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.423+0000 7f47027fc700 1 -- 172.21.15.103:0/2431507927 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f46f40016d0 con 0x7f4704067170 2020-04-22T14:07:08.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.423+0000 7f4703fff700 1 --2- 172.21.15.103:0/2431507927 >> v2:172.21.15.86:3300/0 conn(0x7f47041426d0 0x7f4704142b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:07:08.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.423+0000 7f47027fc700 1 -- 172.21.15.103:0/2431507927 >> v1:172.21.15.103:6789/0 conn(0x7f4704067170 legacy=0x7f470413c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:08.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.423+0000 7f47027fc700 1 --2- 172.21.15.103:0/2431507927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f46f0003720 0x7f46f0003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:08.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.423+0000 7f47027fc700 1 --2- 172.21.15.103:0/2431507927 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f47040b6040 0x7f46f00044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:08.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.423+0000 7f47027fc700 1 --2- 172.21.15.103:0/2431507927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46f0004930 0x7f46f0004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:08.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.423+0000 7f47027fc700 1 -- 172.21.15.103:0/2431507927 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4704065af0 con 0x7f46f0003720 2020-04-22T14:07:08.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.423+0000 7f47027fc700 1 -- 172.21.15.103:0/2431507927 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4704146870 con 0x7f46f0004930 2020-04-22T14:07:08.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.423+0000 7f4703fff700 1 --2- 172.21.15.103:0/2431507927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46f0004930 0x7f46f0004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:08.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.423+0000 7f47027fc700 1 -- 172.21.15.103:0/2431507927 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f00040f0 con 0x7f47040b6040 2020-04-22T14:07:08.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.423+0000 7f47037fe700 1 --2- 172.21.15.103:0/2431507927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f46f0003720 0x7f46f0003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:08.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.423+0000 7f4702ffd700 1 --2- 172.21.15.103:0/2431507927 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f47040b6040 0x7f46f00044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:08.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.423+0000 7f4703fff700 1 -- 172.21.15.103:0/2431507927 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f47040b6040 msgr2=0x7f46f00044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:08.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.423+0000 7f4703fff700 1 --2- 172.21.15.103:0/2431507927 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f47040b6040 0x7f46f00044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:08.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.423+0000 7f4703fff700 1 -- 172.21.15.103:0/2431507927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f46f0003720 msgr2=0x7f46f0003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:08.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.423+0000 7f4703fff700 1 --2- 172.21.15.103:0/2431507927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f46f0003720 0x7f46f0003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:08.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.423+0000 7f4703fff700 1 -- 172.21.15.103:0/2431507927 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f0003230 con 0x7f46f0004930 2020-04-22T14:07:08.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.423+0000 7f4703fff700 1 --2- 172.21.15.103:0/2431507927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46f0004930 0x7f46f0004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f46fc0032b0 tx=0x7f46fc00c2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:08.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.423+0000 7f4703fff700 1 --2- 172.21.15.103:0/2431507927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46f0004930 0x7f46f0004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f46fc0032b0 tx=0x7f46fc00c2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:08.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.423+0000 7f4703fff700 1 --2- 172.21.15.103:0/2431507927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46f0004930 0x7f46f0004db0 secure :-1 s=READY pgs=602 cs=0 l=1 rx=0x7f46fc0032b0 tx=0x7f46fc00c2c0).ready entity=mon.1 client_cookie=dc0217d42ad01317 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:08.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.423+0000 7f4703fff700 1 --2- 172.21.15.103:0/2431507927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46f0004930 0x7f46f0004db0 secure :-1 s=THROTTLE_DONE pgs=602 cs=0 l=1 rx=0x7f46fc0032b0 tx=0x7f46fc00c2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:08.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.424+0000 7f4703fff700 1 --2- 172.21.15.103:0/2431507927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46f0004930 0x7f46f0004db0 secure :-1 s=THROTTLE_DONE pgs=602 cs=0 l=1 rx=0x7f46fc0032b0 tx=0x7f46fc00c2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:08.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.424+0000 7f47027fc700 1 -- 172.21.15.103:0/2431507927 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46fc00e370 con 0x7f46f0004930 2020-04-22T14:07:08.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.424+0000 7f4703fff700 1 --2- 172.21.15.103:0/2431507927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46f0004930 0x7f46f0004db0 secure :-1 s=THROTTLE_DONE pgs=602 cs=0 l=1 rx=0x7f46fc0032b0 tx=0x7f46fc00c2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:08.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.424+0000 7f47027fc700 1 -- 172.21.15.103:0/2431507927 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46fc00e4d0 con 0x7f46f0004930 2020-04-22T14:07:08.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.424+0000 7f47027fc700 1 -- 172.21.15.103:0/2431507927 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46fc00ea00 con 0x7f46f0004930 2020-04-22T14:07:08.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.424+0000 7f4709b1c700 1 -- 172.21.15.103:0/2431507927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46f0004930 msgr2=0x7f46f0004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:08.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.424+0000 7f4709b1c700 1 --2- 172.21.15.103:0/2431507927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46f0004930 0x7f46f0004db0 secure :-1 s=READY pgs=602 cs=0 l=1 rx=0x7f46fc0032b0 tx=0x7f46fc00c2c0).stop 2020-04-22T14:07:08.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.424+0000 7f4703fff700 1 -- 172.21.15.103:0/2431507927 reap_dead start 2020-04-22T14:07:08.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.424+0000 7f4709b1c700 1 -- 172.21.15.103:0/2431507927 shutdown_connections 2020-04-22T14:07:08.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.424+0000 7f4709b1c700 1 -- 172.21.15.103:0/2431507927 >> 172.21.15.103:0/2431507927 conn(0x7f47040b9160 msgr2=0x7f470405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:08.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.424+0000 7f4709b1c700 1 -- 172.21.15.103:0/2431507927 shutdown_connections 2020-04-22T14:07:08.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.424+0000 7f4709b1c700 1 -- 172.21.15.103:0/2431507927 wait complete. 2020-04-22T14:07:08.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.425+0000 7f4709b1c700 1 Processor -- start 2020-04-22T14:07:08.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.425+0000 7f4709b1c700 1 -- start start 2020-04-22T14:07:08.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.426+0000 7f4709b1c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4704143a40 0x7f4704141fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:08.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.426+0000 7f4709b1c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4704142ae0 0x7f4704140170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:08.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.426+0000 7f4709b1c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4704143060 con 0x7f4704154060 2020-04-22T14:07:08.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.426+0000 7f4709b1c700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4704143300 con 0x7f4704143a40 2020-04-22T14:07:08.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.426+0000 7f4709b1c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47041435a0 con 0x7f4704142ae0 2020-04-22T14:07:08.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.426+0000 7f4702ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4704143a40 0x7f4704141fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:08.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.426+0000 7f47037fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f4704154060 0x7f47041443c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42088/0 (socket says 172.21.15.103:42088) 2020-04-22T14:07:08.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.426+0000 7f4702ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4704143a40 0x7f4704141fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49900/0 (socket says 172.21.15.103:49900) 2020-04-22T14:07:08.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.426+0000 7f47037fe700 1 -- 172.21.15.103:0/2195024262 learned_addr learned my addr 172.21.15.103:0/2195024262 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:08.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.426+0000 7f4703fff700 1 --2- 172.21.15.103:0/2195024262 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4704142ae0 0x7f4704140170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:08.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.426+0000 7f4702ffd700 1 -- 172.21.15.103:0/2195024262 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4704142ae0 msgr2=0x7f4704140170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:08.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.426+0000 7f4702ffd700 1 --2- 172.21.15.103:0/2195024262 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4704142ae0 0x7f4704140170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:08.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.426+0000 7f4702ffd700 1 -- 172.21.15.103:0/2195024262 >> v1:172.21.15.103:6789/0 conn(0x7f4704154060 legacy=0x7f47041443c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:08.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.426+0000 7f4700ff9700 1 -- 172.21.15.103:0/2195024262 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1869950812 0 0) 0x7f4704143060 con 0x7f4704154060 2020-04-22T14:07:08.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.426+0000 7f4702ffd700 1 -- 172.21.15.103:0/2195024262 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4704144ad0 con 0x7f4704143a40 2020-04-22T14:07:08.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.426+0000 7f4703fff700 1 --2- 172.21.15.103:0/2195024262 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4704142ae0 0x7f4704140170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:07:08.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.426+0000 7f4702ffd700 1 --2- 172.21.15.103:0/2195024262 >> v2:172.21.15.103:3300/0 conn(0x7f4704143a40 0x7f4704141fb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f46f8002f30 tx=0x7f46f8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:08.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.426+0000 7f4702ffd700 1 --2- 172.21.15.103:0/2195024262 >> v2:172.21.15.103:3300/0 conn(0x7f4704143a40 0x7f4704141fb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f46f8002f30 tx=0x7f46f8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:08.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.426+0000 7f4702ffd700 1 --2- 172.21.15.103:0/2195024262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4704143a40 0x7f4704141fb0 secure :-1 s=READY pgs=604 cs=0 l=1 rx=0x7f46f8002f30 tx=0x7f46f8010b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:08.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.426+0000 7f4702ffd700 1 --2- 172.21.15.103:0/2195024262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4704143a40 0x7f4704141fb0 secure :-1 s=THROTTLE_DONE pgs=604 cs=0 l=1 rx=0x7f46f8002f30 tx=0x7f46f8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:08.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.426+0000 7f4700ff9700 1 -- 172.21.15.103:0/2195024262 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46f8005e90 con 0x7f4704143a40 2020-04-22T14:07:08.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.427+0000 7f4702ffd700 1 --2- 172.21.15.103:0/2195024262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4704143a40 0x7f4704141fb0 secure :-1 s=THROTTLE_DONE pgs=604 cs=0 l=1 rx=0x7f46f8002f30 tx=0x7f46f8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:08.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.427+0000 7f4700ff9700 1 -- 172.21.15.103:0/2195024262 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f8007180 con 0x7f4704143a40 2020-04-22T14:07:08.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.427+0000 7f4709b1c700 1 -- 172.21.15.103:0/2195024262 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4704154440 con 0x7f4704143a40 2020-04-22T14:07:08.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.427+0000 7f4702ffd700 1 --2- 172.21.15.103:0/2195024262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4704143a40 0x7f4704141fb0 secure :-1 s=THROTTLE_DONE pgs=604 cs=0 l=1 rx=0x7f46f8002f30 tx=0x7f46f8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:08.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.427+0000 7f4700ff9700 1 -- 172.21.15.103:0/2195024262 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46f8007520 con 0x7f4704143a40 2020-04-22T14:07:08.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.427+0000 7f4709b1c700 1 -- 172.21.15.103:0/2195024262 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4704140790 con 0x7f4704143a40 2020-04-22T14:07:08.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.427+0000 7f4702ffd700 1 --2- 172.21.15.103:0/2195024262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4704143a40 0x7f4704141fb0 secure :-1 s=THROTTLE_DONE pgs=604 cs=0 l=1 rx=0x7f46f8002f30 tx=0x7f46f8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:08.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.428+0000 7f4700ff9700 1 -- 172.21.15.103:0/2195024262 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f46f8009490 con 0x7f4704143a40 2020-04-22T14:07:08.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.428+0000 7f4702ffd700 1 --2- 172.21.15.103:0/2195024262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4704143a40 0x7f4704141fb0 secure :-1 s=THROTTLE_DONE pgs=604 cs=0 l=1 rx=0x7f46f8002f30 tx=0x7f46f8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:08.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.428+0000 7f4709b1c700 1 -- 172.21.15.103:0/2195024262 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4704056c90 con 0x7f4704143a40 2020-04-22T14:07:08.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.428+0000 7f4700ff9700 1 --2- 172.21.15.103:0/2195024262 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f46e404d7e0 0x7f46e404fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:08.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.428+0000 7f4700ff9700 1 -- 172.21.15.103:0/2195024262 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f46f8061560 con 0x7f4704143a40 2020-04-22T14:07:08.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.428+0000 7f47037fe700 1 --2- 172.21.15.103:0/2195024262 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f46e404d7e0 0x7f46e404fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:08.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.428+0000 7f47037fe700 1 --2- 172.21.15.103:0/2195024262 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f46e404d7e0 0x7f46e404fca0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f46f400fa60 tx=0x7f4704060190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:08.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.428+0000 7f47037fe700 1 --2- 172.21.15.103:0/2195024262 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f46e404d7e0 0x7f46e404fca0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f46f400fa60 tx=0x7f4704060190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:08.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.428+0000 7f47037fe700 1 --2- 172.21.15.103:0/2195024262 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f46e404d7e0 0x7f46e404fca0 secure :-1 s=READY pgs=234 cs=0 l=1 rx=0x7f46f400fa60 tx=0x7f4704060190).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:08.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.432+0000 7f4702ffd700 1 --2- 172.21.15.103:0/2195024262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4704143a40 0x7f4704141fb0 secure :-1 s=THROTTLE_DONE pgs=604 cs=0 l=1 rx=0x7f46f8002f30 tx=0x7f46f8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:08.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.432+0000 7f4700ff9700 1 -- 172.21.15.103:0/2195024262 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f46f803c940 con 0x7f4704143a40 2020-04-22T14:07:08.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.620+0000 7f4709b1c700 1 -- 172.21.15.103:0/2195024262 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4704143710 con 0x7f4704143a40 2020-04-22T14:07:08.624 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.621+0000 7f4702ffd700 1 --2- 172.21.15.103:0/2195024262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4704143a40 0x7f4704141fb0 secure :-1 s=THROTTLE_DONE pgs=604 cs=0 l=1 rx=0x7f46f8002f30 tx=0x7f46f8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:08.624 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.621+0000 7f4700ff9700 1 -- 172.21.15.103:0/2195024262 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+2141 (secure 0 0 0) 0x7f46f803ff60 con 0x7f4704143a40 2020-04-22T14:07:08.625 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:07:08.625 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":20,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4748,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1859944899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1859944899},{"type":"v1","addr":"172.21.15.86:6835","nonce":1859944899}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:05:45.958513+0000","modified":"2020-04-22T14:05:47.963559+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5491},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5491":{"gid":5491,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/2581125360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2581125360},{"type":"v1","addr":"172.21.15.103:6833","nonce":2581125360}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2020-04-22T14:07:08.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.622+0000 7f4709b1c700 1 -- 172.21.15.103:0/2195024262 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f46e404d7e0 msgr2=0x7f46e404fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:08.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.622+0000 7f4709b1c700 1 --2- 172.21.15.103:0/2195024262 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f46e404d7e0 0x7f46e404fca0 secure :-1 s=READY pgs=234 cs=0 l=1 rx=0x7f46f400fa60 tx=0x7f4704060190).stop 2020-04-22T14:07:08.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.622+0000 7f4709b1c700 1 -- 172.21.15.103:0/2195024262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4704143a40 msgr2=0x7f4704141fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:08.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.622+0000 7f4709b1c700 1 --2- 172.21.15.103:0/2195024262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4704143a40 0x7f4704141fb0 secure :-1 s=READY pgs=604 cs=0 l=1 rx=0x7f46f8002f30 tx=0x7f46f8010b90).stop 2020-04-22T14:07:08.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.622+0000 7f4709b1c700 1 -- 172.21.15.103:0/2195024262 shutdown_connections 2020-04-22T14:07:08.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.622+0000 7f4709b1c700 1 --2- 172.21.15.103:0/2195024262 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f46e404d7e0 0x7f46e404fca0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:08.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.622+0000 7f4709b1c700 1 --2- 172.21.15.103:0/2195024262 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4704142ae0 0x7f4704140170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:08.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.622+0000 7f4709b1c700 1 --2- 172.21.15.103:0/2195024262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4704143a40 0x7f4704141fb0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:08.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.622+0000 7f4709b1c700 1 -- 172.21.15.103:0/2195024262 >> 172.21.15.103:0/2195024262 conn(0x7f47040b9160 msgr2=0x7f4704064410 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:08.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.622+0000 7f4709b1c700 1 -- 172.21.15.103:0/2195024262 shutdown_connections 2020-04-22T14:07:08.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:08.622+0000 7f4709b1c700 1 -- 172.21.15.103:0/2195024262 wait complete. 2020-04-22T14:07:08.627 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 20 2020-04-22T14:07:08.838 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 5491}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 7, u'failed': [], u'epoch': 20, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [8], u'info': {u'gid_5491': {u'export_targets': [], u'name': u'a', u'incarnation': 18, u'state_seq': 3, u'state': u'up:active', u'gid': 5491, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 2581125360, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 2581125360, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/2581125360'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:05:45.958513+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:05:47.963559+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:07:08.839 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:07:08.839 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:08.853 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:07:09.013 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:07:09.014 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:07:09.014 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:07:09.014 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 5491, 2020-04-22T14:07:09.014 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:07:09.014 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:07:09.015 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 83.048981746999999, 2020-04-22T14:07:09.015 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 20, 2020-04-22T14:07:09.015 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 45, 2020-04-22T14:07:09.015 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 45, 2020-04-22T14:07:09.015 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 88.271990931000005 2020-04-22T14:07:09.016 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:07:09.022 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 5491, "want_state": "up:active", "state": "up:active", "rank_uptime": 83.048981746999999, "mdsmap_epoch": 20, "osdmap_epoch": 45, "osdmap_epoch_barrier": 45, "uptime": 88.271990931000005 } 2020-04-22T14:07:09.022 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-04-22T14:07:09.022 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:07:09.023 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:09.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:09.036 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:07:09.096 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:07:09.096 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:07:09.096 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:07:09.096 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:07:09.096 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:07:09.097 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:07:09.097 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:07:09.097 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:07:09.097 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:07:09.097 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:07:09.097 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:07:09.097 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:07:09.098 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:07:09.098 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:07:09.098 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:07:09.098 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42411sec preferred_lft 42411sec 2020-04-22T14:07:09.098 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:07:09.098 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:07:09.098 INFO:teuthology.orchestra.run.smithi103.stdout:12: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:07:09.098 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether b6:dc:84:57:26:3b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:07:09.099 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:07:09.099 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:07:09.099 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::28ee:bf44:12d3:dbde/64 scope link noprefixroute 2020-04-22T14:07:09.099 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:07:09.099 INFO:teuthology.orchestra.run.smithi103.stdout:14: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-04-22T14:07:09.099 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether b6:dc:84:57:26:3b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2020-04-22T14:07:09.100 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:09.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:09.144 INFO:teuthology.orchestra.run.smithi103:> ip netns list 2020-04-22T14:07:09.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 1) 2020-04-22T14:07:09.203 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:09.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:09.251 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:07:09.310 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 1 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2020-04-22T14:07:09.311 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:09.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:09.359 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:07:09.435 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:09.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:09.482 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0' 2020-04-22T14:07:09.558 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:09.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:09.604 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr' 2020-04-22T14:07:09.711 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:07:09.711 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:07:09.711 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:07:09.711 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:07:09.712 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:07:09.712 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:07:09.712 INFO:teuthology.orchestra.run.smithi103.stdout:2: veth0@if14: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:07:09.712 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether c6:c0:2b:fd:f2:62 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:07:09.712 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.0.2/16 brd 192.168.255.255 scope global veth0 2020-04-22T14:07:09.712 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:07:09.712 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::c4c0:2bff:fefd:f262/64 scope link 2020-04-22T14:07:09.712 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:07:09.713 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-04-22T14:07:09.713 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:09.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:09.747 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0' 2020-04-22T14:07:09.824 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:09.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:09.869 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0' 2020-04-22T14:07:09.976 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:09.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:09.990 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up' 2020-04-22T14:07:10.097 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:10.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:10.111 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up' 2020-04-22T14:07:10.219 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:10.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:10.232 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254' 2020-04-22T14:07:10.341 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:10.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:10.354 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:07:10.432 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:10.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:10.482 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge-slave con-name brx.0 ifname brx.0 master ceph-brx' 2020-04-22T14:07:10.591 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.0' (e141bfe4-2e71-4d44-9b5f-00bc310338a4) successfully added. 2020-04-22T14:07:10.591 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:10.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:10.610 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up brx.0' 2020-04-22T14:07:10.768 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/15) 2020-04-22T14:07:10.819 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-04-22T14:07:10.819 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi103.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-04-22T14:07:10.820 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:10.834 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:07:10.834 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:07:10.893 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:10.941 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:07:10.941 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:07:11.011 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:07:11.015 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:07:11.016 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:11.063 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:07:11.064 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:07:11.122 INFO:teuthology.orchestra.run.smithi103.stdout:49 2020-04-22T14:07:11.123 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [49] 2020-04-22T14:07:11.123 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:11.171 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:07:11.213 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:11.226 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:07:11.226 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:07:11.295 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:07:11.301 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:07:11.301 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:11.303 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:2020-04-22T14:07:11.300+0000 7f44134611c0 -1 init, newargv = 0x5597c3bd9b80 newargc=9 2020-04-22T14:07:11.303 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[55700]: starting ceph client 2020-04-22T14:07:11.308 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[55700]: starting fuse 2020-04-22T14:07:11.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:07:11.318 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:07:11.375 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:07:11.376 INFO:teuthology.orchestra.run.smithi103.stdout:49 2020-04-22T14:07:11.376 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47, 49] 2020-04-22T14:07:11.376 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:11.425 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:07:11.425 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:07:11.425 INFO:teuthology.orchestra.run.smithi103:> import glob 2020-04-22T14:07:11.425 INFO:teuthology.orchestra.run.smithi103:> import re 2020-04-22T14:07:11.425 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:07:11.425 INFO:teuthology.orchestra.run.smithi103:> import subprocess 2020-04-22T14:07:11.426 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:07:11.426 INFO:teuthology.orchestra.run.smithi103:> def find_socket(client_name): 2020-04-22T14:07:11.426 INFO:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-04-22T14:07:11.426 INFO:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2020-04-22T14:07:11.426 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:07:11.426 INFO:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2020-04-22T14:07:11.426 INFO:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2020-04-22T14:07:11.426 INFO:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2020-04-22T14:07:11.427 INFO:teuthology.orchestra.run.smithi103:> return files[0] 2020-04-22T14:07:11.427 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:07:11.427 INFO:teuthology.orchestra.run.smithi103:> for f in files: 2020-04-22T14:07:11.427 INFO:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:07:11.427 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:07:11.427 INFO:teuthology.orchestra.run.smithi103:> return f 2020-04-22T14:07:11.427 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:07:11.427 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:07:11.428 INFO:teuthology.orchestra.run.smithi103:> print(find_socket("client.0")) 2020-04-22T14:07:11.428 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:07:11.532 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.0.55700.asok 2020-04-22T14:07:11.532 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.55700.asok 2020-04-22T14:07:11.532 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:11.546 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:07:11.546 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.55700.asok status 2020-04-22T14:07:11.708 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:07:11.708 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2020-04-22T14:07:11.708 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:07:11.708 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:07:11.708 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "0", 2020-04-22T14:07:11.709 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:07:11.709 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-04-22T14:07:11.709 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "55700", 2020-04-22T14:07:11.709 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:07:11.709 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:11.709 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2020-04-22T14:07:11.709 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2020-04-22T14:07:11.711 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 5791, 2020-04-22T14:07:11.711 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2020-04-22T14:07:11.711 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:07:11.712 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:07:11.712 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5791 2020-04-22T14:07:11.712 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:11.712 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:07:11.712 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:11.712 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:07:11.712 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1734662977 2020-04-22T14:07:11.713 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:11.713 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:11.713 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:07:11.713 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:11.713 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:07:11.713 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1734662977 2020-04-22T14:07:11.714 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:11.714 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.5791 192.168.0.1:0/1734662977", 2020-04-22T14:07:11.714 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.1:0/1734662977", 2020-04-22T14:07:11.714 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2020-04-22T14:07:11.714 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 20, 2020-04-22T14:07:11.714 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 45, 2020-04-22T14:07:11.714 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2020-04-22T14:07:11.715 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklisted": false 2020-04-22T14:07:11.715 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:07:11.715 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:11.729 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:07:11.729 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-22T14:07:11.729 INFO:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:07:11.788 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2020-04-22T14:07:11.788 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-04-22T14:07:11.789 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:11.836 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:07:11.836 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:07:11.912 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:11.957 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:07:12.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.100+0000 7f599e17a700 1 Processor -- start 2020-04-22T14:07:12.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.100+0000 7f599e17a700 1 -- start start 2020-04-22T14:07:12.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.101+0000 7f599e17a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f59980665a0 0x7f599814a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:12.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.101+0000 7f599e17a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f59980b4ec0 0x7f59980b5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:12.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.101+0000 7f599e17a700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59980651f0 con 0x7f599805b7c0 2020-04-22T14:07:12.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.101+0000 7f599e17a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5998066b90 con 0x7f59980665a0 2020-04-22T14:07:12.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.101+0000 7f599e17a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5998066e30 con 0x7f59980b4ec0 2020-04-22T14:07:12.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.101+0000 7f5997fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f59980b4ec0 0x7f59980b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:12.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.101+0000 7f5997fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f59980b4ec0 0x7f59980b5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49920/0 (socket says 172.21.15.103:49920) 2020-04-22T14:07:12.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.101+0000 7f5997fff700 1 -- 172.21.15.103:0/989477740 learned_addr learned my addr 172.21.15.103:0/989477740 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:12.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.101+0000 7f5997fff700 1 -- 172.21.15.103:0/989477740 >> v2:172.21.15.86:3300/0 conn(0x7f59980665a0 msgr2=0x7f599814a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:12.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.101+0000 7f598ffff700 1 --2- 172.21.15.103:0/989477740 >> v2:172.21.15.86:3300/0 conn(0x7f59980665a0 0x7f599814a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:12.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.101+0000 7f5997fff700 1 --2- 172.21.15.103:0/989477740 >> v2:172.21.15.86:3300/0 conn(0x7f59980665a0 0x7f599814a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:12.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.101+0000 7f5996ffd700 1 -- 172.21.15.103:0/989477740 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3763954784 0 0) 0x7f59980651f0 con 0x7f599805b7c0 2020-04-22T14:07:12.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.101+0000 7f5997fff700 1 -- 172.21.15.103:0/989477740 >> v1:172.21.15.103:6789/0 conn(0x7f599805b7c0 legacy=0x7f59981336b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:12.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.101+0000 7f5997fff700 1 -- 172.21.15.103:0/989477740 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59980670d0 con 0x7f59980b4ec0 2020-04-22T14:07:12.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.101+0000 7f598ffff700 1 --2- 172.21.15.103:0/989477740 >> v2:172.21.15.86:3300/0 conn(0x7f59980665a0 0x7f599814a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:07:12.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.101+0000 7f5997fff700 1 --2- 172.21.15.103:0/989477740 >> v2:172.21.15.103:3300/0 conn(0x7f59980b4ec0 0x7f59980b5350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f59900032b0 tx=0x7f5990007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:12.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.101+0000 7f5997fff700 1 --2- 172.21.15.103:0/989477740 >> v2:172.21.15.103:3300/0 conn(0x7f59980b4ec0 0x7f59980b5350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f59900032b0 tx=0x7f5990007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:12.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.101+0000 7f5997fff700 1 --2- 172.21.15.103:0/989477740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59980b4ec0 0x7f59980b5350 secure :-1 s=READY pgs=607 cs=0 l=1 rx=0x7f59900032b0 tx=0x7f5990007dc0).ready entity=mon.1 client_cookie=f82ef4c044d511db server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:12.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.102+0000 7f5997fff700 1 --2- 172.21.15.103:0/989477740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59980b4ec0 0x7f59980b5350 secure :-1 s=THROTTLE_DONE pgs=607 cs=0 l=1 rx=0x7f59900032b0 tx=0x7f5990007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:12.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.102+0000 7f5996ffd700 1 -- 172.21.15.103:0/989477740 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f599000a180 con 0x7f59980b4ec0 2020-04-22T14:07:12.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.102+0000 7f5997fff700 1 --2- 172.21.15.103:0/989477740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59980b4ec0 0x7f59980b5350 secure :-1 s=THROTTLE_DONE pgs=607 cs=0 l=1 rx=0x7f59900032b0 tx=0x7f5990007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:12.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.102+0000 7f5996ffd700 1 -- 172.21.15.103:0/989477740 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599000a2e0 con 0x7f59980b4ec0 2020-04-22T14:07:12.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.102+0000 7f5997fff700 1 --2- 172.21.15.103:0/989477740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59980b4ec0 0x7f59980b5350 secure :-1 s=THROTTLE_DONE pgs=607 cs=0 l=1 rx=0x7f59900032b0 tx=0x7f5990007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:12.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.102+0000 7f599e17a700 1 -- 172.21.15.103:0/989477740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59980b4ec0 msgr2=0x7f59980b5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:12.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.102+0000 7f5996ffd700 1 -- 172.21.15.103:0/989477740 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f599000a6c0 con 0x7f59980b4ec0 2020-04-22T14:07:12.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.102+0000 7f599e17a700 1 --2- 172.21.15.103:0/989477740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59980b4ec0 0x7f59980b5350 secure :-1 s=READY pgs=607 cs=0 l=1 rx=0x7f59900032b0 tx=0x7f5990007dc0).stop 2020-04-22T14:07:12.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.102+0000 7f599e17a700 1 -- 172.21.15.103:0/989477740 shutdown_connections 2020-04-22T14:07:12.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.102+0000 7f599e17a700 1 --2- 172.21.15.103:0/989477740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59980b4ec0 0x7f59980b5350 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:12.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.102+0000 7f599e17a700 1 --2- 172.21.15.103:0/989477740 >> v2:172.21.15.86:3300/0 conn(0x7f59980665a0 0x7f599814a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:12.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.102+0000 7f599e17a700 1 -- 172.21.15.103:0/989477740 >> 172.21.15.103:0/989477740 conn(0x7f59980b9160 msgr2=0x7f599805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:12.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.102+0000 7f599e17a700 1 -- 172.21.15.103:0/989477740 shutdown_connections 2020-04-22T14:07:12.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.102+0000 7f599e17a700 1 -- 172.21.15.103:0/989477740 wait complete. 2020-04-22T14:07:12.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.103+0000 7f599e17a700 1 Processor -- start 2020-04-22T14:07:12.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.103+0000 7f599e17a700 1 -- start start 2020-04-22T14:07:12.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.104+0000 7f599e17a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f599805b7c0 0x7f599814d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:12.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.104+0000 7f599e17a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f59980665a0 0x7f59981581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:12.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.104+0000 7f599e17a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59980b4ec0 0x7f599814a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:12.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.104+0000 7f599e17a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59980b2950 con 0x7f599805b7c0 2020-04-22T14:07:12.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.104+0000 7f599e17a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f599814ddf0 con 0x7f59980665a0 2020-04-22T14:07:12.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.104+0000 7f599e17a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59980b2410 con 0x7f59980b4ec0 2020-04-22T14:07:12.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.104+0000 7f598ffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f59980665a0 0x7f59981581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:12.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.104+0000 7f598ffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f59980665a0 0x7f59981581f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49928/0 (socket says 172.21.15.103:49928) 2020-04-22T14:07:12.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.104+0000 7f598ffff700 1 -- 172.21.15.103:0/1679134647 learned_addr learned my addr 172.21.15.103:0/1679134647 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:12.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.104+0000 7f59977fe700 1 --2- 172.21.15.103:0/1679134647 >> v2:172.21.15.86:3300/0 conn(0x7f599805b7c0 0x7f599814d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:12.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.104+0000 7f5997fff700 1 --2- 172.21.15.103:0/1679134647 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59980b4ec0 0x7f599814a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:12.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.104+0000 7f598ffff700 1 -- 172.21.15.103:0/1679134647 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59980b4ec0 msgr2=0x7f599814a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:12.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.104+0000 7f598ffff700 1 --2- 172.21.15.103:0/1679134647 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59980b4ec0 0x7f599814a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:12.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.104+0000 7f598ffff700 1 -- 172.21.15.103:0/1679134647 >> v2:172.21.15.86:3300/0 conn(0x7f599805b7c0 msgr2=0x7f599814d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:12.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.104+0000 7f598ffff700 1 --2- 172.21.15.103:0/1679134647 >> v2:172.21.15.86:3300/0 conn(0x7f599805b7c0 0x7f599814d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:12.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.104+0000 7f598ffff700 1 -- 172.21.15.103:0/1679134647 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59980b26b0 con 0x7f59980665a0 2020-04-22T14:07:12.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.104+0000 7f59977fe700 1 --2- 172.21.15.103:0/1679134647 >> v2:172.21.15.86:3300/0 conn(0x7f599805b7c0 0x7f599814d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:07:12.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.104+0000 7f598ffff700 1 --2- 172.21.15.103:0/1679134647 >> v2:172.21.15.103:3300/0 conn(0x7f59980665a0 0x7f59981581f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5980002f30 tx=0x7f5980010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:12.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.104+0000 7f598ffff700 1 --2- 172.21.15.103:0/1679134647 >> v2:172.21.15.103:3300/0 conn(0x7f59980665a0 0x7f59981581f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5980002f30 tx=0x7f5980010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:12.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.104+0000 7f598ffff700 1 --2- 172.21.15.103:0/1679134647 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59980665a0 0x7f59981581f0 secure :-1 s=READY pgs=608 cs=0 l=1 rx=0x7f5980002f30 tx=0x7f5980010b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:12.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.104+0000 7f598ffff700 1 --2- 172.21.15.103:0/1679134647 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59980665a0 0x7f59981581f0 secure :-1 s=THROTTLE_DONE pgs=608 cs=0 l=1 rx=0x7f5980002f30 tx=0x7f5980010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:12.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.104+0000 7f598ffff700 1 --2- 172.21.15.103:0/1679134647 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59980665a0 0x7f59981581f0 secure :-1 s=THROTTLE_DONE pgs=608 cs=0 l=1 rx=0x7f5980002f30 tx=0x7f5980010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:12.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.104+0000 7f59957fa700 1 -- 172.21.15.103:0/1679134647 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5980008cb0 con 0x7f59980665a0 2020-04-22T14:07:12.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.104+0000 7f598ffff700 1 --2- 172.21.15.103:0/1679134647 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59980665a0 0x7f59981581f0 secure :-1 s=THROTTLE_DONE pgs=608 cs=0 l=1 rx=0x7f5980002f30 tx=0x7f5980010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:12.117 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.105+0000 7f59957fa700 1 -- 172.21.15.103:0/1679134647 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5980008e10 con 0x7f59980665a0 2020-04-22T14:07:12.117 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.105+0000 7f599e17a700 1 -- 172.21.15.103:0/1679134647 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5998157ae0 con 0x7f59980665a0 2020-04-22T14:07:12.117 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.105+0000 7f59957fa700 1 -- 172.21.15.103:0/1679134647 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59800058b0 con 0x7f59980665a0 2020-04-22T14:07:12.117 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.105+0000 7f599e17a700 1 -- 172.21.15.103:0/1679134647 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5998158650 con 0x7f59980665a0 2020-04-22T14:07:12.117 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.105+0000 7f598ffff700 1 --2- 172.21.15.103:0/1679134647 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59980665a0 0x7f59981581f0 secure :-1 s=THROTTLE_DONE pgs=608 cs=0 l=1 rx=0x7f5980002f30 tx=0x7f5980010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:12.117 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.105+0000 7f599e17a700 1 -- 172.21.15.103:0/1679134647 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59980ac870 con 0x7f59980665a0 2020-04-22T14:07:12.117 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.105+0000 7f59957fa700 1 -- 172.21.15.103:0/1679134647 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f5980005b20 con 0x7f59980665a0 2020-04-22T14:07:12.117 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.105+0000 7f598ffff700 1 --2- 172.21.15.103:0/1679134647 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59980665a0 0x7f59981581f0 secure :-1 s=THROTTLE_DONE pgs=608 cs=0 l=1 rx=0x7f5980002f30 tx=0x7f5980010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:12.118 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.106+0000 7f59957fa700 1 --2- 172.21.15.103:0/1679134647 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f597c04da00 0x7f597c04fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:12.118 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.106+0000 7f59957fa700 1 -- 172.21.15.103:0/1679134647 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5980061330 con 0x7f59980665a0 2020-04-22T14:07:12.118 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.106+0000 7f59977fe700 1 --2- 172.21.15.103:0/1679134647 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f597c04da00 0x7f597c04fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:12.118 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.106+0000 7f59977fe700 1 --2- 172.21.15.103:0/1679134647 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f597c04da00 0x7f597c04fec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5988000b80 tx=0x7f5988001770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:12.118 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.106+0000 7f59977fe700 1 --2- 172.21.15.103:0/1679134647 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f597c04da00 0x7f597c04fec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5988000b80 tx=0x7f5988001770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:12.118 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.106+0000 7f59977fe700 1 --2- 172.21.15.103:0/1679134647 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f597c04da00 0x7f597c04fec0 secure :-1 s=READY pgs=235 cs=0 l=1 rx=0x7f5988000b80 tx=0x7f5988001770).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:12.118 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.110+0000 7f598ffff700 1 --2- 172.21.15.103:0/1679134647 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59980665a0 0x7f59981581f0 secure :-1 s=THROTTLE_DONE pgs=608 cs=0 l=1 rx=0x7f5980002f30 tx=0x7f5980010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:12.119 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.110+0000 7f59957fa700 1 -- 172.21.15.103:0/1679134647 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f598003c6b0 con 0x7f59980665a0 2020-04-22T14:07:12.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.297+0000 7f599e17a700 1 -- 172.21.15.103:0/1679134647 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f599814b000 con 0x7f59980665a0 2020-04-22T14:07:12.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.298+0000 7f598ffff700 1 --2- 172.21.15.103:0/1679134647 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59980665a0 0x7f59981581f0 secure :-1 s=THROTTLE_DONE pgs=608 cs=0 l=1 rx=0x7f5980002f30 tx=0x7f5980010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:12.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.298+0000 7f59957fa700 1 -- 172.21.15.103:0/1679134647 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+2141 (secure 0 0 0) 0x7f598003fcd0 con 0x7f59980665a0 2020-04-22T14:07:12.301 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:07:12.301 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":20,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4748,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1859944899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1859944899},{"type":"v1","addr":"172.21.15.86:6835","nonce":1859944899}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:05:45.958513+0000","modified":"2020-04-22T14:05:47.963559+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5491},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5491":{"gid":5491,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/2581125360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2581125360},{"type":"v1","addr":"172.21.15.103:6833","nonce":2581125360}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2020-04-22T14:07:12.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.299+0000 7f599e17a700 1 -- 172.21.15.103:0/1679134647 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f597c04da00 msgr2=0x7f597c04fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:12.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.299+0000 7f599e17a700 1 --2- 172.21.15.103:0/1679134647 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f597c04da00 0x7f597c04fec0 secure :-1 s=READY pgs=235 cs=0 l=1 rx=0x7f5988000b80 tx=0x7f5988001770).stop 2020-04-22T14:07:12.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.299+0000 7f599e17a700 1 -- 172.21.15.103:0/1679134647 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59980665a0 msgr2=0x7f59981581f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:12.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.299+0000 7f599e17a700 1 --2- 172.21.15.103:0/1679134647 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59980665a0 0x7f59981581f0 secure :-1 s=READY pgs=608 cs=0 l=1 rx=0x7f5980002f30 tx=0x7f5980010b90).stop 2020-04-22T14:07:12.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.299+0000 7f599e17a700 1 -- 172.21.15.103:0/1679134647 shutdown_connections 2020-04-22T14:07:12.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.299+0000 7f599e17a700 1 --2- 172.21.15.103:0/1679134647 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f597c04da00 0x7f597c04fec0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:12.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.299+0000 7f599e17a700 1 --2- 172.21.15.103:0/1679134647 >> v2:172.21.15.86:3300/0 conn(0x7f599805b7c0 0x7f599814d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:12.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.299+0000 7f599e17a700 1 --2- 172.21.15.103:0/1679134647 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59980b4ec0 0x7f599814a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:12.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.299+0000 7f599e17a700 1 --2- 172.21.15.103:0/1679134647 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59980665a0 0x7f59981581f0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:12.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.299+0000 7f599e17a700 1 -- 172.21.15.103:0/1679134647 >> 172.21.15.103:0/1679134647 conn(0x7f59980b9160 msgr2=0x7f59980629f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:12.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.299+0000 7f599e17a700 1 -- 172.21.15.103:0/1679134647 shutdown_connections 2020-04-22T14:07:12.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:12.299+0000 7f599e17a700 1 -- 172.21.15.103:0/1679134647 wait complete. 2020-04-22T14:07:12.305 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 20 2020-04-22T14:07:12.313 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:12.326 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok session ls 2020-04-22T14:07:12.486 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2020-04-22T14:07:12.486 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:12.486 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 5791, 2020-04-22T14:07:12.486 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": { 2020-04-22T14:07:12.487 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:07:12.487 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:07:12.487 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5791 2020-04-22T14:07:12.487 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:12.487 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:07:12.487 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "any", 2020-04-22T14:07:12.487 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:07:12.488 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1734662977 2020-04-22T14:07:12.488 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:12.488 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:12.488 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "open", 2020-04-22T14:07:12.488 INFO:teuthology.orchestra.run.smithi103.stdout: "num_leases": 0, 2020-04-22T14:07:12.488 INFO:teuthology.orchestra.run.smithi103.stdout: "num_caps": 1, 2020-04-22T14:07:12.488 INFO:teuthology.orchestra.run.smithi103.stdout: "request_load_avg": 1, 2020-04-22T14:07:12.489 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 1.179977396, 2020-04-22T14:07:12.489 INFO:teuthology.orchestra.run.smithi103.stdout: "requests_in_flight": 1, 2020-04-22T14:07:12.489 INFO:teuthology.orchestra.run.smithi103.stdout: "completed_requests": 0, 2020-04-22T14:07:12.489 INFO:teuthology.orchestra.run.smithi103.stdout: "reconnecting": false, 2020-04-22T14:07:12.489 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps": { 2020-04-22T14:07:12.489 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:07:12.489 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 60 2020-04-22T14:07:12.490 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:12.490 INFO:teuthology.orchestra.run.smithi103.stdout: "release_caps": { 2020-04-22T14:07:12.490 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:07:12.490 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 60 2020-04-22T14:07:12.490 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:12.490 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps_throttle": { 2020-04-22T14:07:12.490 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:07:12.490 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 2.5 2020-04-22T14:07:12.491 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:12.491 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps_throttle2o": { 2020-04-22T14:07:12.491 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:07:12.491 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 0.5 2020-04-22T14:07:12.491 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:12.491 INFO:teuthology.orchestra.run.smithi103.stdout: "session_cache_liveness": { 2020-04-22T14:07:12.491 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0.99728199469046275, 2020-04-22T14:07:12.491 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 300 2020-04-22T14:07:12.492 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:12.492 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": "client.5791 192.168.0.1:0/1734662977", 2020-04-22T14:07:12.492 INFO:teuthology.orchestra.run.smithi103.stdout: "completed_requests": [], 2020-04-22T14:07:12.492 INFO:teuthology.orchestra.run.smithi103.stdout: "prealloc_inos": [], 2020-04-22T14:07:12.492 INFO:teuthology.orchestra.run.smithi103.stdout: "used_inos": [], 2020-04-22T14:07:12.492 INFO:teuthology.orchestra.run.smithi103.stdout: "client_metadata": { 2020-04-22T14:07:12.492 INFO:teuthology.orchestra.run.smithi103.stdout: "client_features": { 2020-04-22T14:07:12.493 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_bits": "0x0000000000003fff" 2020-04-22T14:07:12.493 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:12.493 INFO:teuthology.orchestra.run.smithi103.stdout: "metric_spec": { 2020-04-22T14:07:12.493 INFO:teuthology.orchestra.run.smithi103.stdout: "metric_flags": { 2020-04-22T14:07:12.493 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_bits": "0x" 2020-04-22T14:07:12.493 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:12.493 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:12.494 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:07:12.494 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:07:12.494 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "0", 2020-04-22T14:07:12.494 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:07:12.494 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-04-22T14:07:12.494 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "55700", 2020-04-22T14:07:12.494 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:07:12.495 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:12.495 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:12.495 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:12.495 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 5740, 2020-04-22T14:07:12.495 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": { 2020-04-22T14:07:12.495 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:07:12.495 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:07:12.495 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5740 2020-04-22T14:07:12.496 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:12.496 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:07:12.496 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "any", 2020-04-22T14:07:12.496 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.2:0", 2020-04-22T14:07:12.496 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 3910216232 2020-04-22T14:07:12.496 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:12.496 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:12.497 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "open", 2020-04-22T14:07:12.497 INFO:teuthology.orchestra.run.smithi103.stdout: "num_leases": 3, 2020-04-22T14:07:12.497 INFO:teuthology.orchestra.run.smithi103.stdout: "num_caps": 4, 2020-04-22T14:07:12.497 INFO:teuthology.orchestra.run.smithi103.stdout: "request_load_avg": 4, 2020-04-22T14:07:12.497 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 69.823663514000003, 2020-04-22T14:07:12.497 INFO:teuthology.orchestra.run.smithi103.stdout: "requests_in_flight": 0, 2020-04-22T14:07:12.497 INFO:teuthology.orchestra.run.smithi103.stdout: "completed_requests": 0, 2020-04-22T14:07:12.497 INFO:teuthology.orchestra.run.smithi103.stdout: "reconnecting": false, 2020-04-22T14:07:12.498 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps": { 2020-04-22T14:07:12.498 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:07:12.498 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 60 2020-04-22T14:07:12.498 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:12.498 INFO:teuthology.orchestra.run.smithi103.stdout: "release_caps": { 2020-04-22T14:07:12.498 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:07:12.498 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 60 2020-04-22T14:07:12.498 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:12.499 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps_throttle": { 2020-04-22T14:07:12.499 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:07:12.499 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 2.5 2020-04-22T14:07:12.499 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:12.499 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps_throttle2o": { 2020-04-22T14:07:12.499 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:07:12.499 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 0.5 2020-04-22T14:07:12.500 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:12.500 INFO:teuthology.orchestra.run.smithi103.stdout: "session_cache_liveness": { 2020-04-22T14:07:12.500 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 10.471761166670625, 2020-04-22T14:07:12.500 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 300 2020-04-22T14:07:12.500 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:12.500 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": "client.5740 192.168.0.2:0/3910216232", 2020-04-22T14:07:12.500 INFO:teuthology.orchestra.run.smithi103.stdout: "completed_requests": [], 2020-04-22T14:07:12.501 INFO:teuthology.orchestra.run.smithi103.stdout: "prealloc_inos": [], 2020-04-22T14:07:12.501 INFO:teuthology.orchestra.run.smithi103.stdout: "used_inos": [], 2020-04-22T14:07:12.501 INFO:teuthology.orchestra.run.smithi103.stdout: "client_metadata": { 2020-04-22T14:07:12.501 INFO:teuthology.orchestra.run.smithi103.stdout: "client_features": { 2020-04-22T14:07:12.501 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_bits": "0x0000000000003fff" 2020-04-22T14:07:12.501 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:12.501 INFO:teuthology.orchestra.run.smithi103.stdout: "metric_spec": { 2020-04-22T14:07:12.501 INFO:teuthology.orchestra.run.smithi103.stdout: "metric_flags": { 2020-04-22T14:07:12.502 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_bits": "0x" 2020-04-22T14:07:12.502 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:12.502 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:12.502 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:07:12.502 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:07:12.502 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "1", 2020-04-22T14:07:12.502 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:07:12.503 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2020-04-22T14:07:12.503 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "53766", 2020-04-22T14:07:12.503 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:07:12.503 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:12.503 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:12.503 INFO:teuthology.orchestra.run.smithi103.stdout:] 2020-04-22T14:07:12.504 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "id": 5791, "entity": { "name": { "type": "client", "num": 5791 }, "addr": { "type": "any", "addr": "192.168.0.1:0", "nonce": 1734662977 } }, "state": "open", "num_leases": 0, "num_caps": 1, "request_load_avg": 1, "uptime": 1.179977396, "requests_in_flight": 1, "completed_requests": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0.99728199469046275, "halflife": 300 }, "inst": "client.5791 192.168.0.1:0/1734662977", "completed_requests": [], "prealloc_inos": [], "used_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x0000000000003fff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x" } }, "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", "entity_id": "0", "hostname": "smithi103", "mount_point": "/home/ubuntu/cephtest/mnt.0", "pid": "55700", "root": "/" } }, { "id": 5740, "entity": { "name": { "type": "client", "num": 5740 }, "addr": { "type": "any", "addr": "192.168.0.2:0", "nonce": 3910216232 } }, "state": "open", "num_leases": 3, "num_caps": 4, "request_load_avg": 4, "uptime": 69.823663514000003, "requests_in_flight": 0, "completed_requests": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 10.471761166670625, "halflife": 300 }, "inst": "client.5740 192.168.0.2:0/3910216232", "completed_requests": [], "prealloc_inos": [], "used_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x0000000000003fff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x" } }, "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", "entity_id": "1", "hostname": "smithi103", "mount_point": "/home/ubuntu/cephtest/mnt.1", "pid": "53766", "root": "/" } } ] 2020-04-22T14:07:12.505 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:12.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:07:12.518 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:07:12.518 INFO:teuthology.orchestra.run.smithi103:> import glob 2020-04-22T14:07:12.518 INFO:teuthology.orchestra.run.smithi103:> import re 2020-04-22T14:07:12.518 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:07:12.518 INFO:teuthology.orchestra.run.smithi103:> import subprocess 2020-04-22T14:07:12.518 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:07:12.518 INFO:teuthology.orchestra.run.smithi103:> def find_socket(client_name): 2020-04-22T14:07:12.519 INFO:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-04-22T14:07:12.519 INFO:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2020-04-22T14:07:12.519 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:07:12.519 INFO:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2020-04-22T14:07:12.519 INFO:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2020-04-22T14:07:12.519 INFO:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2020-04-22T14:07:12.519 INFO:teuthology.orchestra.run.smithi103:> return files[0] 2020-04-22T14:07:12.519 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:07:12.520 INFO:teuthology.orchestra.run.smithi103:> for f in files: 2020-04-22T14:07:12.520 INFO:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:07:12.520 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:07:12.520 INFO:teuthology.orchestra.run.smithi103:> return f 2020-04-22T14:07:12.520 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:07:12.520 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:07:12.520 INFO:teuthology.orchestra.run.smithi103:> print(find_socket("client.0")) 2020-04-22T14:07:12.520 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:07:12.627 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.0.55700.asok 2020-04-22T14:07:12.627 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.55700.asok 2020-04-22T14:07:12.627 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:12.640 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:07:12.640 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.55700.asok mds_sessions 2020-04-22T14:07:12.798 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:07:12.798 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 5791, 2020-04-22T14:07:12.799 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2020-04-22T14:07:12.799 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:07:12.799 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:07:12.799 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5791 2020-04-22T14:07:12.799 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:12.800 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:07:12.800 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:12.800 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:07:12.800 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1734662977 2020-04-22T14:07:12.800 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:12.800 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:12.800 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.5791 v1:192.168.0.1:0/1734662977", 2020-04-22T14:07:12.801 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "v1:192.168.0.1:0/1734662977", 2020-04-22T14:07:12.801 INFO:teuthology.orchestra.run.smithi103.stdout: "sessions": [ 2020-04-22T14:07:12.801 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:12.801 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": 0, 2020-04-22T14:07:12.801 INFO:teuthology.orchestra.run.smithi103.stdout: "addrs": { 2020-04-22T14:07:12.801 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:07:12.802 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:12.802 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:07:12.802 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6832", 2020-04-22T14:07:12.802 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 2581125360 2020-04-22T14:07:12.802 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:12.802 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:12.802 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:12.803 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6833", 2020-04-22T14:07:12.803 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 2581125360 2020-04-22T14:07:12.803 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:12.803 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:12.803 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:12.803 INFO:teuthology.orchestra.run.smithi103.stdout: "seq": 0, 2020-04-22T14:07:12.803 INFO:teuthology.orchestra.run.smithi103.stdout: "cap_gen": 0, 2020-04-22T14:07:12.804 INFO:teuthology.orchestra.run.smithi103.stdout: "cap_ttl": "2020-04-22T14:08:12.303412+0000", 2020-04-22T14:07:12.804 INFO:teuthology.orchestra.run.smithi103.stdout: "last_cap_renew_request": "2020-04-22T14:07:12.303412+0000", 2020-04-22T14:07:12.804 INFO:teuthology.orchestra.run.smithi103.stdout: "cap_renew_seq": 2, 2020-04-22T14:07:12.804 INFO:teuthology.orchestra.run.smithi103.stdout: "num_caps": 1, 2020-04-22T14:07:12.804 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "open" 2020-04-22T14:07:12.804 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:12.804 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:07:12.804 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 20 2020-04-22T14:07:12.805 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:07:12.805 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:12.820 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:07:12.820 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:07:12.821 INFO:teuthology.orchestra.run.smithi103:> import glob 2020-04-22T14:07:12.821 INFO:teuthology.orchestra.run.smithi103:> import re 2020-04-22T14:07:12.821 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:07:12.821 INFO:teuthology.orchestra.run.smithi103:> import subprocess 2020-04-22T14:07:12.821 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:07:12.821 INFO:teuthology.orchestra.run.smithi103:> def find_socket(client_name): 2020-04-22T14:07:12.821 INFO:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2020-04-22T14:07:12.821 INFO:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2020-04-22T14:07:12.822 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:07:12.823 INFO:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2020-04-22T14:07:12.823 INFO:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2020-04-22T14:07:12.823 INFO:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2020-04-22T14:07:12.823 INFO:teuthology.orchestra.run.smithi103:> return files[0] 2020-04-22T14:07:12.823 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:07:12.823 INFO:teuthology.orchestra.run.smithi103:> for f in files: 2020-04-22T14:07:12.824 INFO:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:07:12.824 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:07:12.824 INFO:teuthology.orchestra.run.smithi103:> return f 2020-04-22T14:07:12.824 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:07:12.824 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:07:12.824 INFO:teuthology.orchestra.run.smithi103:> print(find_socket("client.1")) 2020-04-22T14:07:12.824 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:07:12.928 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.1.53766.asok 2020-04-22T14:07:12.929 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.53766.asok 2020-04-22T14:07:12.929 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:12.942 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:07:12.942 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.53766.asok mds_sessions 2020-04-22T14:07:13.100 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:07:13.101 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 5740, 2020-04-22T14:07:13.101 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2020-04-22T14:07:13.101 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:07:13.101 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:07:13.101 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5740 2020-04-22T14:07:13.101 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:13.102 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:07:13.102 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:13.102 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.2:0", 2020-04-22T14:07:13.102 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 3910216232 2020-04-22T14:07:13.102 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:13.102 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:13.102 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.5740 v1:192.168.0.2:0/3910216232", 2020-04-22T14:07:13.103 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "v1:192.168.0.2:0/3910216232", 2020-04-22T14:07:13.103 INFO:teuthology.orchestra.run.smithi103.stdout: "sessions": [ 2020-04-22T14:07:13.103 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:13.103 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": 0, 2020-04-22T14:07:13.103 INFO:teuthology.orchestra.run.smithi103.stdout: "addrs": { 2020-04-22T14:07:13.103 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:07:13.103 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:13.103 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:07:13.104 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6832", 2020-04-22T14:07:13.104 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 2581125360 2020-04-22T14:07:13.104 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:13.104 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:13.104 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:13.104 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6833", 2020-04-22T14:07:13.105 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 2581125360 2020-04-22T14:07:13.105 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:13.105 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:13.105 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:13.105 INFO:teuthology.orchestra.run.smithi103.stdout: "seq": 2, 2020-04-22T14:07:13.105 INFO:teuthology.orchestra.run.smithi103.stdout: "cap_gen": 0, 2020-04-22T14:07:13.105 INFO:teuthology.orchestra.run.smithi103.stdout: "cap_ttl": "2020-04-22T14:08:03.666448+0000", 2020-04-22T14:07:13.105 INFO:teuthology.orchestra.run.smithi103.stdout: "last_cap_renew_request": "2020-04-22T14:07:03.666448+0000", 2020-04-22T14:07:13.106 INFO:teuthology.orchestra.run.smithi103.stdout: "cap_renew_seq": 5, 2020-04-22T14:07:13.106 INFO:teuthology.orchestra.run.smithi103.stdout: "num_caps": 4, 2020-04-22T14:07:13.106 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "open" 2020-04-22T14:07:13.106 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:13.106 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:07:13.106 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 20 2020-04-22T14:07:13.107 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:07:13.107 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-04-22T14:07:13.107 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:07:13.125 INFO:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:07:13.220 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:13.234 INFO:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:07:13.324 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-04-22T14:07:13.324 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2020-04-22T14:07:13.324 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:13.342 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-04-22T14:07:13.342 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:07:13.419 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[55700]: fuse finished with error 0 and tester_r 0 2020-04-22T14:07:13.502 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:07:13.503 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:07:13.503 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:13.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:13.516 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:07:13.600 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:13.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:13.709 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down brx.0' 2020-04-22T14:07:13.827 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.0' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/15) 2020-04-22T14:07:13.827 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:13.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:13.841 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete brx.0' 2020-04-22T14:07:13.952 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.0' (e141bfe4-2e71-4d44-9b5f-00bc310338a4) successfully deleted. 2020-04-22T14:07:13.952 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:13.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:13.966 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:07:14.074 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:14.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:14.096 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:07:14.156 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:07:14.157 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:07:14.157 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:07:14.157 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:07:14.157 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:07:14.157 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:07:14.157 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:07:14.158 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:07:14.158 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:07:14.158 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:07:14.158 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:07:14.158 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:07:14.158 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:07:14.159 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:07:14.159 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:07:14.159 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42406sec preferred_lft 42406sec 2020-04-22T14:07:14.159 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:07:14.159 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:07:14.159 INFO:teuthology.orchestra.run.smithi103.stdout:12: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:07:14.159 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether b6:dc:84:57:26:3b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:07:14.160 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:07:14.160 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:07:14.160 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::28ee:bf44:12d3:dbde/64 scope link noprefixroute 2020-04-22T14:07:14.160 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:07:14.160 INFO:teuthology.orchestra.run.smithi103.stdout:14: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-04-22T14:07:14.160 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether b6:dc:84:57:26:3b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2020-04-22T14:07:14.161 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:14.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:14.205 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:07:14.284 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:14.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:14.332 INFO:teuthology.orchestra.run.smithi103:> nmcli connection show 2020-04-22T14:07:14.407 INFO:teuthology.orchestra.run.smithi103.stdout:NAME UUID TYPE DEVICE 2020-04-22T14:07:14.407 INFO:teuthology.orchestra.run.smithi103.stdout:System enp3s0f1 b0a308d1-bd90-60af-eb7c-0183bb425a1a ethernet enp3s0f1 2020-04-22T14:07:14.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-brx 9507c76d-c1e0-4cd4-b6db-cddaba92a0c7 bridge ceph-brx 2020-04-22T14:07:14.408 INFO:teuthology.orchestra.run.smithi103.stdout:brx.1 88af662a-5ef4-4251-8e99-3c17ce610b60 ethernet brx.1 2020-04-22T14:07:14.408 INFO:teuthology.orchestra.run.smithi103.stdout:eno1 206ad60d-195e-4d4b-a9fe-a5dd1f33a67d ethernet -- 2020-04-22T14:07:14.408 INFO:teuthology.orchestra.run.smithi103.stdout:eno2 894a7dd2-d329-4985-9ef9-84a92c6e1c6c ethernet -- 2020-04-22T14:07:14.408 INFO:teuthology.orchestra.run.smithi103.stdout:enp3s0f0 5a3237ce-06ab-4ae0-818b-45bdf036cb08 ethernet -- 2020-04-22T14:07:14.408 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:14.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:14.454 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:07:14.515 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2020-04-22T14:07:14.515 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:14.563 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-04-22T14:07:14.563 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:07:14.642 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[53766]: fuse finished with error 0 and tester_r 0 2020-04-22T14:07:14.753 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-04-22T14:07:14.753 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:07:14.753 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:14.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:14.766 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:07:14.848 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:14.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:14.899 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down brx.1' 2020-04-22T14:07:15.059 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.1' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/14) 2020-04-22T14:07:15.059 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:15.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:15.073 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete brx.1' 2020-04-22T14:07:15.180 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.1' (88af662a-5ef4-4251-8e99-3c17ce610b60) successfully deleted. 2020-04-22T14:07:15.180 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:15.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:15.208 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:07:15.314 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:15.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:15.343 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:07:15.403 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:07:15.403 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:07:15.403 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:07:15.403 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:07:15.404 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:07:15.404 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:07:15.404 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:07:15.404 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:07:15.404 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:07:15.404 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:07:15.404 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:07:15.405 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:07:15.405 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:07:15.405 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:07:15.405 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:07:15.405 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42405sec preferred_lft 42405sec 2020-04-22T14:07:15.405 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:07:15.405 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:07:15.406 INFO:teuthology.orchestra.run.smithi103.stdout:12: ceph-brx: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:07:15.406 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:07:15.406 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:07:15.406 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:07:15.406 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::28ee:bf44:12d3:dbde/64 scope link noprefixroute 2020-04-22T14:07:15.406 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:07:15.408 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:15.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:15.451 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:07:15.526 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:15.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:15.582 INFO:teuthology.orchestra.run.smithi103:> nmcli connection show 2020-04-22T14:07:15.659 INFO:teuthology.orchestra.run.smithi103.stdout:NAME UUID TYPE DEVICE 2020-04-22T14:07:15.659 INFO:teuthology.orchestra.run.smithi103.stdout:System enp3s0f1 b0a308d1-bd90-60af-eb7c-0183bb425a1a ethernet enp3s0f1 2020-04-22T14:07:15.659 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-brx 9507c76d-c1e0-4cd4-b6db-cddaba92a0c7 bridge ceph-brx 2020-04-22T14:07:15.659 INFO:teuthology.orchestra.run.smithi103.stdout:eno1 206ad60d-195e-4d4b-a9fe-a5dd1f33a67d ethernet -- 2020-04-22T14:07:15.660 INFO:teuthology.orchestra.run.smithi103.stdout:eno2 894a7dd2-d329-4985-9ef9-84a92c6e1c6c ethernet -- 2020-04-22T14:07:15.660 INFO:teuthology.orchestra.run.smithi103.stdout:enp3s0f0 5a3237ce-06ab-4ae0-818b-45bdf036cb08 ethernet -- 2020-04-22T14:07:15.660 INFO:tasks.cephfs.mount:Removing the 'ceph-brx' 2020-04-22T14:07:15.660 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:15.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:15.703 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down ceph-brx' 2020-04-22T14:07:15.860 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/12) 2020-04-22T14:07:15.860 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:15.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:15.878 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete ceph-brx' 2020-04-22T14:07:15.985 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' (9507c76d-c1e0-4cd4-b6db-cddaba92a0c7) successfully deleted. 2020-04-22T14:07:15.985 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:16.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:16.024 INFO:teuthology.orchestra.run.smithi103:> route 2020-04-22T14:07:16.082 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2020-04-22T14:07:16.082 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-04-22T14:07:16.082 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 102 0 0 enp3s0f1 2020-04-22T14:07:16.083 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 102 0 0 enp3s0f1 2020-04-22T14:07:16.083 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:16.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:16.131 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -D FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-04-22T14:07:16.239 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:16.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:16.261 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -D FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-04-22T14:07:16.368 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:16.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:16.392 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -t nat -D POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-04-22T14:07:16.499 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:16.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:16.523 INFO:teuthology.orchestra.run.smithi103:> cat /tmp/python-ceph-brx 2020-04-22T14:07:16.581 INFO:teuthology.orchestra.run.smithi103.stdout:0 2020-04-22T14:07:16.582 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:16.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:16.630 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 0 > /proc/sys/net/ipv4/ip_forward' 2020-04-22T14:07:16.705 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:16.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:16.752 INFO:teuthology.orchestra.run.smithi103:> rm -f /tmp/python-ceph-brx 2020-04-22T14:07:16.810 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:16.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:16.858 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:07:16.917 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.2' netns for '/home/ubuntu/cephtest/mnt.2' 2020-04-22T14:07:16.917 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:07:16.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:16.933 INFO:teuthology.orchestra.run.smithi086:> ip addr 2020-04-22T14:07:16.994 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:07:16.994 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:07:16.995 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:07:16.995 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:07:16.995 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2020-04-22T14:07:16.995 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:07:16.995 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:07:16.995 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:07:16.995 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:07:16.996 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:07:16.996 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:07:16.996 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:07:16.996 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:07:16.996 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:07:16.996 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:07:16.996 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 42377sec preferred_lft 42377sec 2020-04-22T14:07:16.998 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2020-04-22T14:07:16.998 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:07:16.998 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:07:17.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:17.046 INFO:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.2) 2020-04-22T14:07:17.106 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.3' netns for '/home/ubuntu/cephtest/mnt.3' 2020-04-22T14:07:17.106 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:07:17.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:17.160 INFO:teuthology.orchestra.run.smithi086:> ip addr 2020-04-22T14:07:17.218 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:07:17.219 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:07:17.219 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:07:17.219 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:07:17.219 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2020-04-22T14:07:17.219 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:07:17.219 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:07:17.220 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:07:17.220 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:07:17.220 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:07:17.220 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:07:17.220 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:07:17.220 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:07:17.221 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:07:17.221 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:07:17.221 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 42377sec preferred_lft 42377sec 2020-04-22T14:07:17.221 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2020-04-22T14:07:17.221 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:07:17.222 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:07:17.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:17.273 INFO:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.3) 2020-04-22T14:07:17.331 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:17.345 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_basic' 2020-04-22T14:07:17.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.491+0000 7ff43d597700 1 Processor -- start 2020-04-22T14:07:17.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.491+0000 7ff43d597700 1 -- start start 2020-04-22T14:07:17.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.492+0000 7ff43d597700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff43812c0d0 0x7ff4381464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:17.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.492+0000 7ff43d597700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff438065fe0 0x7ff43805b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:17.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.492+0000 7ff43d597700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff438143300 con 0x7ff43805b8a0 2020-04-22T14:07:17.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.492+0000 7ff43d597700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff43812c4b0 con 0x7ff43812c0d0 2020-04-22T14:07:17.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.492+0000 7ff43d597700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4381435a0 con 0x7ff438065fe0 2020-04-22T14:07:17.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.492+0000 7ff4367fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff438065fe0 0x7ff43805b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:17.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.492+0000 7ff4377fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff43805b8a0 0x7ff438062ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42124/0 (socket says 172.21.15.103:42124) 2020-04-22T14:07:17.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.492+0000 7ff4377fe700 1 -- 172.21.15.103:0/3138889446 learned_addr learned my addr 172.21.15.103:0/3138889446 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:17.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.493+0000 7ff436ffd700 1 --2- 172.21.15.103:0/3138889446 >> v2:172.21.15.86:3300/0 conn(0x7ff43812c0d0 0x7ff4381464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:17.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.493+0000 7ff4367fc700 1 -- 172.21.15.103:0/3138889446 >> v2:172.21.15.86:3300/0 conn(0x7ff43812c0d0 msgr2=0x7ff4381464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:17.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.493+0000 7ff4367fc700 1 --2- 172.21.15.103:0/3138889446 >> v2:172.21.15.86:3300/0 conn(0x7ff43812c0d0 0x7ff4381464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:17.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.493+0000 7ff4367fc700 1 -- 172.21.15.103:0/3138889446 >> v1:172.21.15.103:6789/0 conn(0x7ff43805b8a0 legacy=0x7ff438062ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:17.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.493+0000 7ff435ffb700 1 -- 172.21.15.103:0/3138889446 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3190948566 0 0) 0x7ff438143300 con 0x7ff43805b8a0 2020-04-22T14:07:17.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.493+0000 7ff4367fc700 1 -- 172.21.15.103:0/3138889446 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff438143840 con 0x7ff438065fe0 2020-04-22T14:07:17.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.493+0000 7ff4367fc700 1 --2- 172.21.15.103:0/3138889446 >> v2:172.21.15.103:3300/0 conn(0x7ff438065fe0 0x7ff43805b440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff428002f30 tx=0x7ff428007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:17.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.493+0000 7ff4367fc700 1 --2- 172.21.15.103:0/3138889446 >> v2:172.21.15.103:3300/0 conn(0x7ff438065fe0 0x7ff43805b440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff428002f30 tx=0x7ff428007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:17.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.493+0000 7ff4367fc700 1 --2- 172.21.15.103:0/3138889446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff438065fe0 0x7ff43805b440 secure :-1 s=READY pgs=610 cs=0 l=1 rx=0x7ff428002f30 tx=0x7ff428007a40).ready entity=mon.1 client_cookie=3a5e188385bf1fae server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:17.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.493+0000 7ff4367fc700 1 --2- 172.21.15.103:0/3138889446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff438065fe0 0x7ff43805b440 secure :-1 s=THROTTLE_DONE pgs=610 cs=0 l=1 rx=0x7ff428002f30 tx=0x7ff428007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:17.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.493+0000 7ff435ffb700 1 -- 172.21.15.103:0/3138889446 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff42800ae80 con 0x7ff438065fe0 2020-04-22T14:07:17.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.493+0000 7ff4367fc700 1 --2- 172.21.15.103:0/3138889446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff438065fe0 0x7ff43805b440 secure :-1 s=THROTTLE_DONE pgs=610 cs=0 l=1 rx=0x7ff428002f30 tx=0x7ff428007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:17.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.493+0000 7ff435ffb700 1 -- 172.21.15.103:0/3138889446 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff428013a60 con 0x7ff438065fe0 2020-04-22T14:07:17.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.493+0000 7ff4367fc700 1 --2- 172.21.15.103:0/3138889446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff438065fe0 0x7ff43805b440 secure :-1 s=THROTTLE_DONE pgs=610 cs=0 l=1 rx=0x7ff428002f30 tx=0x7ff428007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:17.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.493+0000 7ff435ffb700 1 -- 172.21.15.103:0/3138889446 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff428013e40 con 0x7ff438065fe0 2020-04-22T14:07:17.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.493+0000 7ff43d597700 1 -- 172.21.15.103:0/3138889446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff438065fe0 msgr2=0x7ff43805b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:17.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.493+0000 7ff43d597700 1 --2- 172.21.15.103:0/3138889446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff438065fe0 0x7ff43805b440 secure :-1 s=READY pgs=610 cs=0 l=1 rx=0x7ff428002f30 tx=0x7ff428007a40).stop 2020-04-22T14:07:17.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.494+0000 7ff43d597700 1 -- 172.21.15.103:0/3138889446 shutdown_connections 2020-04-22T14:07:17.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.494+0000 7ff43d597700 1 --2- 172.21.15.103:0/3138889446 >> v2:172.21.15.86:3300/0 conn(0x7ff43812c0d0 0x7ff4381464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:17.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.494+0000 7ff43d597700 1 --2- 172.21.15.103:0/3138889446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff438065fe0 0x7ff43805b440 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:17.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.494+0000 7ff43d597700 1 -- 172.21.15.103:0/3138889446 >> 172.21.15.103:0/3138889446 conn(0x7ff4380b9160 msgr2=0x7ff43805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:17.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.494+0000 7ff43d597700 1 -- 172.21.15.103:0/3138889446 shutdown_connections 2020-04-22T14:07:17.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.494+0000 7ff43d597700 1 -- 172.21.15.103:0/3138889446 wait complete. 2020-04-22T14:07:17.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.495+0000 7ff43d597700 1 Processor -- start 2020-04-22T14:07:17.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.495+0000 7ff43d597700 1 -- start start 2020-04-22T14:07:17.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.495+0000 7ff43d597700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff43805b8a0 0x7ff43811f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:17.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.495+0000 7ff43d597700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff438065fe0 0x7ff4380b5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:17.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.495+0000 7ff43d597700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff43812c0d0 0x7ff4380b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:17.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.495+0000 7ff43d597700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff438127680 con 0x7ff43805b8a0 2020-04-22T14:07:17.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.495+0000 7ff43d597700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff438127920 con 0x7ff43812c0d0 2020-04-22T14:07:17.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.495+0000 7ff43d597700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff438127bc0 con 0x7ff438065fe0 2020-04-22T14:07:17.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.495+0000 7ff4377fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff43812c0d0 0x7ff4380b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:17.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.495+0000 7ff4377fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff43812c0d0 0x7ff4380b5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49942/0 (socket says 172.21.15.103:49942) 2020-04-22T14:07:17.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.495+0000 7ff4377fe700 1 -- 172.21.15.103:0/4010985792 learned_addr learned my addr 172.21.15.103:0/4010985792 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:17.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.496+0000 7ff436ffd700 1 --2- 172.21.15.103:0/4010985792 >> v2:172.21.15.86:3300/0 conn(0x7ff43805b8a0 0x7ff43811f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:17.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.496+0000 7ff4377fe700 1 -- 172.21.15.103:0/4010985792 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff438065fe0 msgr2=0x7ff4380b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:17.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.496+0000 7ff4367fc700 1 --2- 172.21.15.103:0/4010985792 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff438065fe0 0x7ff4380b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:17.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.496+0000 7ff4377fe700 1 --2- 172.21.15.103:0/4010985792 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff438065fe0 0x7ff4380b5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:17.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.496+0000 7ff4377fe700 1 -- 172.21.15.103:0/4010985792 >> v2:172.21.15.86:3300/0 conn(0x7ff43805b8a0 msgr2=0x7ff43811f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:17.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.496+0000 7ff4377fe700 1 --2- 172.21.15.103:0/4010985792 >> v2:172.21.15.86:3300/0 conn(0x7ff43805b8a0 0x7ff43811f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:17.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.496+0000 7ff4377fe700 1 -- 172.21.15.103:0/4010985792 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff438129640 con 0x7ff43812c0d0 2020-04-22T14:07:17.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.496+0000 7ff436ffd700 1 --2- 172.21.15.103:0/4010985792 >> v2:172.21.15.86:3300/0 conn(0x7ff43805b8a0 0x7ff43811f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:07:17.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.496+0000 7ff4377fe700 1 --2- 172.21.15.103:0/4010985792 >> v2:172.21.15.103:3300/0 conn(0x7ff43812c0d0 0x7ff4380b5bb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff430001210 tx=0x7ff430010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:17.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.496+0000 7ff4377fe700 1 --2- 172.21.15.103:0/4010985792 >> v2:172.21.15.103:3300/0 conn(0x7ff43812c0d0 0x7ff4380b5bb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff430001210 tx=0x7ff430010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:17.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.496+0000 7ff4377fe700 1 --2- 172.21.15.103:0/4010985792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff43812c0d0 0x7ff4380b5bb0 secure :-1 s=READY pgs=611 cs=0 l=1 rx=0x7ff430001210 tx=0x7ff430010d50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:17.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.496+0000 7ff4377fe700 1 --2- 172.21.15.103:0/4010985792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff43812c0d0 0x7ff4380b5bb0 secure :-1 s=THROTTLE_DONE pgs=611 cs=0 l=1 rx=0x7ff430001210 tx=0x7ff430010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:17.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.496+0000 7ff427fff700 1 -- 172.21.15.103:0/4010985792 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff430005e30 con 0x7ff43812c0d0 2020-04-22T14:07:17.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.496+0000 7ff4377fe700 1 --2- 172.21.15.103:0/4010985792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff43812c0d0 0x7ff4380b5bb0 secure :-1 s=THROTTLE_DONE pgs=611 cs=0 l=1 rx=0x7ff430001210 tx=0x7ff430010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:17.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.496+0000 7ff4377fe700 1 --2- 172.21.15.103:0/4010985792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff43812c0d0 0x7ff4380b5bb0 secure :-1 s=THROTTLE_DONE pgs=611 cs=0 l=1 rx=0x7ff430001210 tx=0x7ff430010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:17.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.496+0000 7ff427fff700 1 -- 172.21.15.103:0/4010985792 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4300125e0 con 0x7ff43812c0d0 2020-04-22T14:07:17.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.496+0000 7ff43d597700 1 -- 172.21.15.103:0/4010985792 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff438125960 con 0x7ff43812c0d0 2020-04-22T14:07:17.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.496+0000 7ff427fff700 1 -- 172.21.15.103:0/4010985792 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4300129c0 con 0x7ff43812c0d0 2020-04-22T14:07:17.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.496+0000 7ff43d597700 1 -- 172.21.15.103:0/4010985792 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff43811f9b0 con 0x7ff43812c0d0 2020-04-22T14:07:17.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.496+0000 7ff4377fe700 1 --2- 172.21.15.103:0/4010985792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff43812c0d0 0x7ff4380b5bb0 secure :-1 s=THROTTLE_DONE pgs=611 cs=0 l=1 rx=0x7ff430001210 tx=0x7ff430010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:17.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.497+0000 7ff43d597700 1 -- 172.21.15.103:0/4010985792 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4381297d0 con 0x7ff43812c0d0 2020-04-22T14:07:17.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.497+0000 7ff427fff700 1 -- 172.21.15.103:0/4010985792 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ff430012c30 con 0x7ff43812c0d0 2020-04-22T14:07:17.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.497+0000 7ff4377fe700 1 --2- 172.21.15.103:0/4010985792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff43812c0d0 0x7ff4380b5bb0 secure :-1 s=THROTTLE_DONE pgs=611 cs=0 l=1 rx=0x7ff430001210 tx=0x7ff430010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:17.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.497+0000 7ff427fff700 1 --2- 172.21.15.103:0/4010985792 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff41404da30 0x7ff41404fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:17.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.497+0000 7ff427fff700 1 -- 172.21.15.103:0/4010985792 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff4300090c0 con 0x7ff43812c0d0 2020-04-22T14:07:17.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.497+0000 7ff436ffd700 1 --2- 172.21.15.103:0/4010985792 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff41404da30 0x7ff41404fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:17.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.498+0000 7ff436ffd700 1 --2- 172.21.15.103:0/4010985792 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff41404da30 0x7ff41404fef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff42c002f30 tx=0x7ff42c008da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:17.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.498+0000 7ff436ffd700 1 --2- 172.21.15.103:0/4010985792 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff41404da30 0x7ff41404fef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff42c002f30 tx=0x7ff42c008da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:17.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.498+0000 7ff436ffd700 1 --2- 172.21.15.103:0/4010985792 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff41404da30 0x7ff41404fef0 secure :-1 s=READY pgs=236 cs=0 l=1 rx=0x7ff42c002f30 tx=0x7ff42c008da0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:17.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.501+0000 7ff4377fe700 1 --2- 172.21.15.103:0/4010985792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff43812c0d0 0x7ff4380b5bb0 secure :-1 s=THROTTLE_DONE pgs=611 cs=0 l=1 rx=0x7ff430001210 tx=0x7ff430010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:17.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.501+0000 7ff427fff700 1 -- 172.21.15.103:0/4010985792 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ff43003cc90 con 0x7ff43812c0d0 2020-04-22T14:07:17.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:17.695+0000 7ff43d597700 1 -- 172.21.15.103:0/4010985792 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_basic"]} v 0) v1 -- 0x7ff438056c90 con 0x7ff43812c0d0 2020-04-22T14:07:18.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.477+0000 7ff4377fe700 1 --2- 172.21.15.103:0/4010985792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff43812c0d0 0x7ff4380b5bb0 secure :-1 s=THROTTLE_DONE pgs=611 cs=0 l=1 rx=0x7ff430001210 tx=0x7ff430010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:18.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.477+0000 7ff427fff700 1 -- 172.21.15.103:0/4010985792 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_basic"]}]=0 v208) v1 ==== 142+0+0 (secure 0 0 0) 0x7ff4300402b0 con 0x7ff43812c0d0 2020-04-22T14:07:18.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.479+0000 7ff43d597700 1 -- 172.21.15.103:0/4010985792 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff41404da30 msgr2=0x7ff41404fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:18.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.479+0000 7ff43d597700 1 --2- 172.21.15.103:0/4010985792 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff41404da30 0x7ff41404fef0 secure :-1 s=READY pgs=236 cs=0 l=1 rx=0x7ff42c002f30 tx=0x7ff42c008da0).stop 2020-04-22T14:07:18.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.479+0000 7ff43d597700 1 -- 172.21.15.103:0/4010985792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff43812c0d0 msgr2=0x7ff4380b5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:18.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.479+0000 7ff43d597700 1 --2- 172.21.15.103:0/4010985792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff43812c0d0 0x7ff4380b5bb0 secure :-1 s=READY pgs=611 cs=0 l=1 rx=0x7ff430001210 tx=0x7ff430010d50).stop 2020-04-22T14:07:18.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.479+0000 7ff43d597700 1 -- 172.21.15.103:0/4010985792 shutdown_connections 2020-04-22T14:07:18.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.479+0000 7ff43d597700 1 --2- 172.21.15.103:0/4010985792 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff41404da30 0x7ff41404fef0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:18.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.479+0000 7ff43d597700 1 --2- 172.21.15.103:0/4010985792 >> v2:172.21.15.86:3300/0 conn(0x7ff43805b8a0 0x7ff43811f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:18.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.479+0000 7ff43d597700 1 --2- 172.21.15.103:0/4010985792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff43812c0d0 0x7ff4380b5bb0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:18.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.479+0000 7ff43d597700 1 --2- 172.21.15.103:0/4010985792 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff438065fe0 0x7ff4380b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:18.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.479+0000 7ff43d597700 1 -- 172.21.15.103:0/4010985792 >> 172.21.15.103:0/4010985792 conn(0x7ff4380b9160 msgr2=0x7ff43812b040 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:18.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.479+0000 7ff43d597700 1 -- 172.21.15.103:0/4010985792 shutdown_connections 2020-04-22T14:07:18.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.479+0000 7ff43d597700 1 -- 172.21.15.103:0/4010985792 wait complete. 2020-04-22T14:07:18.496 INFO:tasks.cephfs_test_runner:test_basic (tasks.cephfs.test_client_recovery.TestClientRecovery) ... ok 2020-04-22T14:07:18.496 INFO:tasks.cephfs_test_runner:Starting test: test_config_session_timeout (tasks.cephfs.test_client_recovery.TestClientRecovery) 2020-04-22T14:07:18.496 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:18.512 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_config_session_timeout' 2020-04-22T14:07:18.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.662+0000 7f9d432c0700 1 Processor -- start 2020-04-22T14:07:18.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.662+0000 7f9d432c0700 1 -- start start 2020-04-22T14:07:18.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.663+0000 7f9d432c0700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9d3c0b6040 0x7f9d3c0ac740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:18.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.663+0000 7f9d432c0700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d3c064ec0 con 0x7f9d3c1426d0 2020-04-22T14:07:18.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.663+0000 7f9d432c0700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d3c146870 con 0x7f9d3c067170 2020-04-22T14:07:18.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.663+0000 7f9d432c0700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d3c065af0 con 0x7f9d3c0b6040 2020-04-22T14:07:18.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.663+0000 7f9d4085b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9d3c0b6040 0x7f9d3c0ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:18.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.663+0000 7f9d4105c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f9d3c067170 0x7f9d3c13c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42136/0 (socket says 172.21.15.103:42136) 2020-04-22T14:07:18.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.663+0000 7f9d4105c700 1 -- 172.21.15.103:0/1034610041 learned_addr learned my addr 172.21.15.103:0/1034610041 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:18.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.664+0000 7f9d4085b700 1 -- 172.21.15.103:0/1034610041 >> v1:172.21.15.103:6789/0 conn(0x7f9d3c067170 legacy=0x7f9d3c13c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:18.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.664+0000 7f9d4085b700 1 -- 172.21.15.103:0/1034610041 >> v1:172.21.15.86:6789/0 conn(0x7f9d3c1426d0 legacy=0x7f9d3c142b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:18.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.664+0000 7f9d2bfff700 1 -- 172.21.15.103:0/1034610041 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1185866522 0 0) 0x7f9d3c146870 con 0x7f9d3c067170 2020-04-22T14:07:18.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.664+0000 7f9d4085b700 1 -- 172.21.15.103:0/1034610041 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d3c067550 con 0x7f9d3c0b6040 2020-04-22T14:07:18.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.664+0000 7f9d4085b700 1 --2- 172.21.15.103:0/1034610041 >> v2:172.21.15.103:3300/0 conn(0x7f9d3c0b6040 0x7f9d3c0ac740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9d3c066c90 tx=0x7f9d380088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:18.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.664+0000 7f9d4085b700 1 --2- 172.21.15.103:0/1034610041 >> v2:172.21.15.103:3300/0 conn(0x7f9d3c0b6040 0x7f9d3c0ac740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9d3c066c90 tx=0x7f9d380088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:18.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.664+0000 7f9d4085b700 1 --2- 172.21.15.103:0/1034610041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d3c0b6040 0x7f9d3c0ac740 secure :-1 s=READY pgs=613 cs=0 l=1 rx=0x7f9d3c066c90 tx=0x7f9d380088e0).ready entity=mon.1 client_cookie=12e51204ae6fd7d5 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:18.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.664+0000 7f9d4085b700 1 --2- 172.21.15.103:0/1034610041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d3c0b6040 0x7f9d3c0ac740 secure :-1 s=THROTTLE_DONE pgs=613 cs=0 l=1 rx=0x7f9d3c066c90 tx=0x7f9d380088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:18.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.664+0000 7f9d2bfff700 1 -- 172.21.15.103:0/1034610041 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d38008e40 con 0x7f9d3c0b6040 2020-04-22T14:07:18.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.664+0000 7f9d4085b700 1 --2- 172.21.15.103:0/1034610041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d3c0b6040 0x7f9d3c0ac740 secure :-1 s=THROTTLE_DONE pgs=613 cs=0 l=1 rx=0x7f9d3c066c90 tx=0x7f9d380088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:18.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.664+0000 7f9d2bfff700 1 -- 172.21.15.103:0/1034610041 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d38011660 con 0x7f9d3c0b6040 2020-04-22T14:07:18.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.664+0000 7f9d4085b700 1 --2- 172.21.15.103:0/1034610041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d3c0b6040 0x7f9d3c0ac740 secure :-1 s=THROTTLE_DONE pgs=613 cs=0 l=1 rx=0x7f9d3c066c90 tx=0x7f9d380088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:18.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.664+0000 7f9d2bfff700 1 -- 172.21.15.103:0/1034610041 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d38011a80 con 0x7f9d3c0b6040 2020-04-22T14:07:18.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.664+0000 7f9d432c0700 1 -- 172.21.15.103:0/1034610041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d3c0b6040 msgr2=0x7f9d3c0ac740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:18.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.664+0000 7f9d432c0700 1 --2- 172.21.15.103:0/1034610041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d3c0b6040 0x7f9d3c0ac740 secure :-1 s=READY pgs=613 cs=0 l=1 rx=0x7f9d3c066c90 tx=0x7f9d380088e0).stop 2020-04-22T14:07:18.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.664+0000 7f9d432c0700 1 -- 172.21.15.103:0/1034610041 shutdown_connections 2020-04-22T14:07:18.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.664+0000 7f9d432c0700 1 --2- 172.21.15.103:0/1034610041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d3c0b6040 0x7f9d3c0ac740 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:18.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.664+0000 7f9d432c0700 1 -- 172.21.15.103:0/1034610041 >> 172.21.15.103:0/1034610041 conn(0x7f9d3c0b9160 msgr2=0x7f9d3c05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:18.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.665+0000 7f9d432c0700 1 -- 172.21.15.103:0/1034610041 shutdown_connections 2020-04-22T14:07:18.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.665+0000 7f9d432c0700 1 -- 172.21.15.103:0/1034610041 wait complete. 2020-04-22T14:07:18.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.666+0000 7f9d432c0700 1 Processor -- start 2020-04-22T14:07:18.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.666+0000 7f9d432c0700 1 -- start start 2020-04-22T14:07:18.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.666+0000 7f9d432c0700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9d3c067170 0x7f9d3c0b3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:18.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.666+0000 7f9d432c0700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9d3c0b6040 0x7f9d3c064180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:18.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.666+0000 7f9d432c0700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9d3c1426d0 0x7f9d3c0b2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:18.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.666+0000 7f9d432c0700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d3c0b3c80 con 0x7f9d3c067170 2020-04-22T14:07:18.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.666+0000 7f9d432c0700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d3c0645e0 con 0x7f9d3c1426d0 2020-04-22T14:07:18.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.666+0000 7f9d432c0700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3c157eb0 con 0x7f9d3c0b6040 2020-04-22T14:07:18.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.666+0000 7f9d4185d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9d3c1426d0 0x7f9d3c0b2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:18.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.666+0000 7f9d4105c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9d3c067170 0x7f9d3c0b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:18.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.666+0000 7f9d4185d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9d3c1426d0 0x7f9d3c0b2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49952/0 (socket says 172.21.15.103:49952) 2020-04-22T14:07:18.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.666+0000 7f9d4185d700 1 -- 172.21.15.103:0/3431667978 learned_addr learned my addr 172.21.15.103:0/3431667978 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:18.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.666+0000 7f9d4085b700 1 --2- 172.21.15.103:0/3431667978 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9d3c0b6040 0x7f9d3c064180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:18.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.667+0000 7f9d4185d700 1 -- 172.21.15.103:0/3431667978 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9d3c0b6040 msgr2=0x7f9d3c064180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:18.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.667+0000 7f9d4185d700 1 --2- 172.21.15.103:0/3431667978 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9d3c0b6040 0x7f9d3c064180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:18.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.667+0000 7f9d4185d700 1 -- 172.21.15.103:0/3431667978 >> v2:172.21.15.86:3300/0 conn(0x7f9d3c067170 msgr2=0x7f9d3c0b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:18.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.667+0000 7f9d4185d700 1 --2- 172.21.15.103:0/3431667978 >> v2:172.21.15.86:3300/0 conn(0x7f9d3c067170 0x7f9d3c0b3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:18.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.667+0000 7f9d4185d700 1 -- 172.21.15.103:0/3431667978 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d3c153d40 con 0x7f9d3c1426d0 2020-04-22T14:07:18.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.667+0000 7f9d4105c700 1 --2- 172.21.15.103:0/3431667978 >> v2:172.21.15.86:3300/0 conn(0x7f9d3c067170 0x7f9d3c0b3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:07:18.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.667+0000 7f9d4185d700 1 --2- 172.21.15.103:0/3431667978 >> v2:172.21.15.103:3300/0 conn(0x7f9d3c1426d0 0x7f9d3c0b2340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9d3c066130 tx=0x7f9d340021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:18.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.667+0000 7f9d4185d700 1 --2- 172.21.15.103:0/3431667978 >> v2:172.21.15.103:3300/0 conn(0x7f9d3c1426d0 0x7f9d3c0b2340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9d3c066130 tx=0x7f9d340021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:18.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.667+0000 7f9d4185d700 1 --2- 172.21.15.103:0/3431667978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d3c1426d0 0x7f9d3c0b2340 secure :-1 s=READY pgs=614 cs=0 l=1 rx=0x7f9d3c066130 tx=0x7f9d340021b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:18.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.667+0000 7f9d4185d700 1 --2- 172.21.15.103:0/3431667978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d3c1426d0 0x7f9d3c0b2340 secure :-1 s=THROTTLE_DONE pgs=614 cs=0 l=1 rx=0x7f9d3c066130 tx=0x7f9d340021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:18.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.667+0000 7f9d2a7fc700 1 -- 172.21.15.103:0/3431667978 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d340101e0 con 0x7f9d3c1426d0 2020-04-22T14:07:18.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.667+0000 7f9d4185d700 1 --2- 172.21.15.103:0/3431667978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d3c1426d0 0x7f9d3c0b2340 secure :-1 s=THROTTLE_DONE pgs=614 cs=0 l=1 rx=0x7f9d3c066130 tx=0x7f9d340021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:18.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.667+0000 7f9d432c0700 1 -- 172.21.15.103:0/3431667978 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d3c13b6e0 con 0x7f9d3c1426d0 2020-04-22T14:07:18.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.667+0000 7f9d2a7fc700 1 -- 172.21.15.103:0/3431667978 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d34010340 con 0x7f9d3c1426d0 2020-04-22T14:07:18.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.667+0000 7f9d4185d700 1 --2- 172.21.15.103:0/3431667978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d3c1426d0 0x7f9d3c0b2340 secure :-1 s=THROTTLE_DONE pgs=614 cs=0 l=1 rx=0x7f9d3c066130 tx=0x7f9d340021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:18.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.667+0000 7f9d2a7fc700 1 -- 172.21.15.103:0/3431667978 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d34010760 con 0x7f9d3c1426d0 2020-04-22T14:07:18.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.667+0000 7f9d432c0700 1 -- 172.21.15.103:0/3431667978 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d3c0b2960 con 0x7f9d3c1426d0 2020-04-22T14:07:18.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.668+0000 7f9d4185d700 1 --2- 172.21.15.103:0/3431667978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d3c1426d0 0x7f9d3c0b2340 secure :-1 s=THROTTLE_DONE pgs=614 cs=0 l=1 rx=0x7f9d3c066130 tx=0x7f9d340021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:18.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.668+0000 7f9d2a7fc700 1 -- 172.21.15.103:0/3431667978 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f9d34006860 con 0x7f9d3c1426d0 2020-04-22T14:07:18.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.668+0000 7f9d4185d700 1 --2- 172.21.15.103:0/3431667978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d3c1426d0 0x7f9d3c0b2340 secure :-1 s=THROTTLE_DONE pgs=614 cs=0 l=1 rx=0x7f9d3c066130 tx=0x7f9d340021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:18.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.668+0000 7f9d432c0700 1 -- 172.21.15.103:0/3431667978 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d3c056c90 con 0x7f9d3c1426d0 2020-04-22T14:07:18.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.669+0000 7f9d2a7fc700 1 --2- 172.21.15.103:0/3431667978 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9d1c04d910 0x7f9d1c04fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:18.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.669+0000 7f9d2a7fc700 1 -- 172.21.15.103:0/3431667978 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9d340615d0 con 0x7f9d3c1426d0 2020-04-22T14:07:18.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.669+0000 7f9d4105c700 1 --2- 172.21.15.103:0/3431667978 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9d1c04d910 0x7f9d1c04fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:18.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.669+0000 7f9d4105c700 1 --2- 172.21.15.103:0/3431667978 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9d1c04d910 0x7f9d1c04fdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9d2c000b80 tx=0x7f9d2c00cca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:18.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.669+0000 7f9d4105c700 1 --2- 172.21.15.103:0/3431667978 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9d1c04d910 0x7f9d1c04fdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9d2c000b80 tx=0x7f9d2c00cca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:18.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.669+0000 7f9d4105c700 1 --2- 172.21.15.103:0/3431667978 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9d1c04d910 0x7f9d1c04fdd0 secure :-1 s=READY pgs=237 cs=0 l=1 rx=0x7f9d2c000b80 tx=0x7f9d2c00cca0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:18.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.673+0000 7f9d4185d700 1 --2- 172.21.15.103:0/3431667978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d3c1426d0 0x7f9d3c0b2340 secure :-1 s=THROTTLE_DONE pgs=614 cs=0 l=1 rx=0x7f9d3c066130 tx=0x7f9d340021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:18.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.673+0000 7f9d2a7fc700 1 -- 172.21.15.103:0/3431667978 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f9d3403c9b0 con 0x7f9d3c1426d0 2020-04-22T14:07:18.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:18.862+0000 7f9d432c0700 1 -- 172.21.15.103:0/3431667978 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_config_session_timeout"]} v 0) v1 -- 0x7f9d3c05a640 con 0x7f9d3c1426d0 2020-04-22T14:07:19.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.479+0000 7f9d4185d700 1 --2- 172.21.15.103:0/3431667978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d3c1426d0 0x7f9d3c0b2340 secure :-1 s=THROTTLE_DONE pgs=614 cs=0 l=1 rx=0x7f9d3c066130 tx=0x7f9d340021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:19.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.479+0000 7f9d2a7fc700 1 -- 172.21.15.103:0/3431667978 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_config_session_timeout"]}]=0 v209) v1 ==== 162+0+0 (secure 0 0 0) 0x7f9d3403ffd0 con 0x7f9d3c1426d0 2020-04-22T14:07:19.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.481+0000 7f9d432c0700 1 -- 172.21.15.103:0/3431667978 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9d1c04d910 msgr2=0x7f9d1c04fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:19.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.481+0000 7f9d432c0700 1 --2- 172.21.15.103:0/3431667978 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9d1c04d910 0x7f9d1c04fdd0 secure :-1 s=READY pgs=237 cs=0 l=1 rx=0x7f9d2c000b80 tx=0x7f9d2c00cca0).stop 2020-04-22T14:07:19.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.481+0000 7f9d432c0700 1 -- 172.21.15.103:0/3431667978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d3c1426d0 msgr2=0x7f9d3c0b2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:19.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.481+0000 7f9d432c0700 1 --2- 172.21.15.103:0/3431667978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d3c1426d0 0x7f9d3c0b2340 secure :-1 s=READY pgs=614 cs=0 l=1 rx=0x7f9d3c066130 tx=0x7f9d340021b0).stop 2020-04-22T14:07:19.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.481+0000 7f9d432c0700 1 -- 172.21.15.103:0/3431667978 shutdown_connections 2020-04-22T14:07:19.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.481+0000 7f9d432c0700 1 --2- 172.21.15.103:0/3431667978 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9d1c04d910 0x7f9d1c04fdd0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:19.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.481+0000 7f9d432c0700 1 --2- 172.21.15.103:0/3431667978 >> v2:172.21.15.86:3300/0 conn(0x7f9d3c067170 0x7f9d3c0b3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:19.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.481+0000 7f9d432c0700 1 --2- 172.21.15.103:0/3431667978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d3c1426d0 0x7f9d3c0b2340 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:19.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.481+0000 7f9d432c0700 1 --2- 172.21.15.103:0/3431667978 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9d3c0b6040 0x7f9d3c064180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:19.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.481+0000 7f9d432c0700 1 -- 172.21.15.103:0/3431667978 >> 172.21.15.103:0/3431667978 conn(0x7f9d3c0b9160 msgr2=0x7f9d3c132d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:19.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.481+0000 7f9d432c0700 1 -- 172.21.15.103:0/3431667978 shutdown_connections 2020-04-22T14:07:19.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.481+0000 7f9d432c0700 1 -- 172.21.15.103:0/3431667978 wait complete. 2020-04-22T14:07:19.496 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-04-22T14:07:19.496 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:07:19.513 INFO:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:07:19.614 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:19.630 INFO:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:07:19.726 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-04-22T14:07:19.726 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:19.746 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2020-04-22T14:07:19.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.894+0000 7f29db3ed700 1 Processor -- start 2020-04-22T14:07:19.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.894+0000 7f29db3ed700 1 -- start start 2020-04-22T14:07:19.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.895+0000 7f29db3ed700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f29d41464e0 0x7f29d4064540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:19.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.895+0000 7f29db3ed700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29d4143300 con 0x7f29d412c0d0 2020-04-22T14:07:19.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.895+0000 7f29db3ed700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29d41435a0 con 0x7f29d4065fe0 2020-04-22T14:07:19.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.895+0000 7f29db3ed700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d4143840 con 0x7f29d41464e0 2020-04-22T14:07:19.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.895+0000 7f29d8988700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f29d4065fe0 0x7f29d4063e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42150/0 (socket says 172.21.15.103:42150) 2020-04-22T14:07:19.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.895+0000 7f29d8988700 1 -- 172.21.15.103:0/843871302 learned_addr learned my addr 172.21.15.103:0/843871302 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:19.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.895+0000 7f29c3fff700 1 -- 172.21.15.103:0/843871302 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3182792148 0 0) 0x7f29d41435a0 con 0x7f29d4065fe0 2020-04-22T14:07:19.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.895+0000 7f29d998a700 1 --2- 172.21.15.103:0/843871302 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f29d41464e0 0x7f29d4064540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:19.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.895+0000 7f29c3fff700 1 -- 172.21.15.103:0/843871302 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29bc003230 con 0x7f29d4065fe0 2020-04-22T14:07:19.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.896+0000 7f29c3fff700 1 -- 172.21.15.103:0/843871302 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1985318719 0 0) 0x7f29bc003230 con 0x7f29d4065fe0 2020-04-22T14:07:19.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.896+0000 7f29c3fff700 1 -- 172.21.15.103:0/843871302 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f29d41464e0 msgr2=0x7f29d4064540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:19.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.896+0000 7f29c3fff700 1 --2- 172.21.15.103:0/843871302 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f29d41464e0 0x7f29d4064540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:19.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.896+0000 7f29c3fff700 1 -- 172.21.15.103:0/843871302 >> v1:172.21.15.86:6789/0 conn(0x7f29d412c0d0 legacy=0x7f29d405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:19.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.896+0000 7f29c3fff700 1 -- 172.21.15.103:0/843871302 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d405bb50 con 0x7f29d4065fe0 2020-04-22T14:07:19.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.896+0000 7f29c3fff700 1 -- 172.21.15.103:0/843871302 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f29d00016d0 con 0x7f29d4065fe0 2020-04-22T14:07:19.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.896+0000 7f29c3fff700 1 -- 172.21.15.103:0/843871302 >> v1:172.21.15.103:6789/0 conn(0x7f29d4065fe0 legacy=0x7f29d4063e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:19.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.896+0000 7f29c3fff700 1 --2- 172.21.15.103:0/843871302 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29bc003750 0x7f29bc003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:19.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.896+0000 7f29c3fff700 1 --2- 172.21.15.103:0/843871302 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f29d41464e0 0x7f29bc0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:19.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.896+0000 7f29c3fff700 1 --2- 172.21.15.103:0/843871302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29bc004930 0x7f29bc004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:19.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.896+0000 7f29c3fff700 1 -- 172.21.15.103:0/843871302 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d4143840 con 0x7f29bc003750 2020-04-22T14:07:19.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.896+0000 7f29c3fff700 1 -- 172.21.15.103:0/843871302 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc005330 con 0x7f29bc004930 2020-04-22T14:07:19.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.896+0000 7f29c3fff700 1 -- 172.21.15.103:0/843871302 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc004150 con 0x7f29d41464e0 2020-04-22T14:07:19.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.896+0000 7f29d998a700 1 --2- 172.21.15.103:0/843871302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29bc004930 0x7f29bc004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:19.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.896+0000 7f29d9189700 1 --2- 172.21.15.103:0/843871302 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29bc003750 0x7f29bc003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:19.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.896+0000 7f29d8988700 1 --2- 172.21.15.103:0/843871302 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f29d41464e0 0x7f29bc0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:19.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.896+0000 7f29d998a700 1 -- 172.21.15.103:0/843871302 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f29d41464e0 msgr2=0x7f29bc0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:19.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.896+0000 7f29d998a700 1 --2- 172.21.15.103:0/843871302 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f29d41464e0 0x7f29bc0044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:19.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.896+0000 7f29d998a700 1 -- 172.21.15.103:0/843871302 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29bc003750 msgr2=0x7f29bc003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:19.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.896+0000 7f29d998a700 1 --2- 172.21.15.103:0/843871302 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29bc003750 0x7f29bc003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:19.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.896+0000 7f29d998a700 1 -- 172.21.15.103:0/843871302 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29bc003230 con 0x7f29bc004930 2020-04-22T14:07:19.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.896+0000 7f29d8988700 1 --2- 172.21.15.103:0/843871302 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f29d41464e0 0x7f29bc0044d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:07:19.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.896+0000 7f29d998a700 1 --2- 172.21.15.103:0/843871302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29bc004930 0x7f29bc004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f29cc0032b0 tx=0x7f29cc0103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:19.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.896+0000 7f29d998a700 1 --2- 172.21.15.103:0/843871302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29bc004930 0x7f29bc004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f29cc0032b0 tx=0x7f29cc0103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:19.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.896+0000 7f29d998a700 1 --2- 172.21.15.103:0/843871302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29bc004930 0x7f29bc004db0 secure :-1 s=READY pgs=616 cs=0 l=1 rx=0x7f29cc0032b0 tx=0x7f29cc0103a0).ready entity=mon.1 client_cookie=b9a7628451cf136d server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:19.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.896+0000 7f29d998a700 1 --2- 172.21.15.103:0/843871302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29bc004930 0x7f29bc004db0 secure :-1 s=THROTTLE_DONE pgs=616 cs=0 l=1 rx=0x7f29cc0032b0 tx=0x7f29cc0103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:19.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.896+0000 7f29c3fff700 1 -- 172.21.15.103:0/843871302 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29cc005c30 con 0x7f29bc004930 2020-04-22T14:07:19.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.896+0000 7f29d998a700 1 --2- 172.21.15.103:0/843871302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29bc004930 0x7f29bc004db0 secure :-1 s=THROTTLE_DONE pgs=616 cs=0 l=1 rx=0x7f29cc0032b0 tx=0x7f29cc0103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:19.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.896+0000 7f29d998a700 1 --2- 172.21.15.103:0/843871302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29bc004930 0x7f29bc004db0 secure :-1 s=THROTTLE_DONE pgs=616 cs=0 l=1 rx=0x7f29cc0032b0 tx=0x7f29cc0103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:19.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.896+0000 7f29c3fff700 1 -- 172.21.15.103:0/843871302 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29cc005d90 con 0x7f29bc004930 2020-04-22T14:07:19.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.896+0000 7f29c3fff700 1 -- 172.21.15.103:0/843871302 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29cc0112c0 con 0x7f29bc004930 2020-04-22T14:07:19.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.896+0000 7f29db3ed700 1 -- 172.21.15.103:0/843871302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29bc004930 msgr2=0x7f29bc004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:19.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.896+0000 7f29db3ed700 1 --2- 172.21.15.103:0/843871302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29bc004930 0x7f29bc004db0 secure :-1 s=READY pgs=616 cs=0 l=1 rx=0x7f29cc0032b0 tx=0x7f29cc0103a0).stop 2020-04-22T14:07:19.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.896+0000 7f29d998a700 1 -- 172.21.15.103:0/843871302 reap_dead start 2020-04-22T14:07:19.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.897+0000 7f29db3ed700 1 -- 172.21.15.103:0/843871302 shutdown_connections 2020-04-22T14:07:19.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.897+0000 7f29db3ed700 1 -- 172.21.15.103:0/843871302 >> 172.21.15.103:0/843871302 conn(0x7f29d40b9160 msgr2=0x7f29d405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:19.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.897+0000 7f29db3ed700 1 -- 172.21.15.103:0/843871302 shutdown_connections 2020-04-22T14:07:19.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.897+0000 7f29db3ed700 1 -- 172.21.15.103:0/843871302 wait complete. 2020-04-22T14:07:19.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.898+0000 7f29db3ed700 1 Processor -- start 2020-04-22T14:07:19.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.898+0000 7f29db3ed700 1 -- start start 2020-04-22T14:07:19.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.898+0000 7f29db3ed700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f29d40b7dd0 0x7f29d40b2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:19.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.898+0000 7f29db3ed700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f29d40ae720 0x7f29d40b3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:19.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.898+0000 7f29db3ed700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29d40b3ae0 con 0x7f29d4128e50 2020-04-22T14:07:19.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.898+0000 7f29db3ed700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29d40aeb40 con 0x7f29d40b7dd0 2020-04-22T14:07:19.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.898+0000 7f29db3ed700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29d40aede0 con 0x7f29d40ae720 2020-04-22T14:07:19.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.899+0000 7f29d8988700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f29d40ae720 0x7f29d40b3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:19.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.899+0000 7f29d8988700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f29d40ae720 0x7f29d40b3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49974/0 (socket says 172.21.15.103:49974) 2020-04-22T14:07:19.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.899+0000 7f29d8988700 1 -- 172.21.15.103:0/511969315 learned_addr learned my addr 172.21.15.103:0/511969315 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:19.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.899+0000 7f29d9189700 1 --2- 172.21.15.103:0/511969315 >> v2:172.21.15.86:3300/0 conn(0x7f29d40b7dd0 0x7f29d40b2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:19.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.899+0000 7f29d8988700 1 -- 172.21.15.103:0/511969315 >> v2:172.21.15.86:3300/0 conn(0x7f29d40b7dd0 msgr2=0x7f29d40b2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:19.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.899+0000 7f29d8988700 1 --2- 172.21.15.103:0/511969315 >> v2:172.21.15.86:3300/0 conn(0x7f29d40b7dd0 0x7f29d40b2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:19.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.899+0000 7f29d8988700 1 -- 172.21.15.103:0/511969315 >> v1:172.21.15.86:6789/0 conn(0x7f29d4128e50 legacy=0x7f29d4129300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:19.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.899+0000 7f29d8988700 1 -- 172.21.15.103:0/511969315 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d40af080 con 0x7f29d40ae720 2020-04-22T14:07:19.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.899+0000 7f29d8988700 1 --2- 172.21.15.103:0/511969315 >> v2:172.21.15.103:3300/0 conn(0x7f29d40ae720 0x7f29d40b3680 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f29d00013e0 tx=0x7f29d405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:19.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.899+0000 7f29d8988700 1 --2- 172.21.15.103:0/511969315 >> v2:172.21.15.103:3300/0 conn(0x7f29d40ae720 0x7f29d40b3680 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f29d00013e0 tx=0x7f29d405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:19.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.899+0000 7f29d8988700 1 --2- 172.21.15.103:0/511969315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29d40ae720 0x7f29d40b3680 secure :-1 s=READY pgs=617 cs=0 l=1 rx=0x7f29d00013e0 tx=0x7f29d405bce0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:19.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.899+0000 7f29d8988700 1 --2- 172.21.15.103:0/511969315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29d40ae720 0x7f29d40b3680 secure :-1 s=THROTTLE_DONE pgs=617 cs=0 l=1 rx=0x7f29d00013e0 tx=0x7f29d405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:19.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.899+0000 7f29d8988700 1 --2- 172.21.15.103:0/511969315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29d40ae720 0x7f29d40b3680 secure :-1 s=THROTTLE_DONE pgs=617 cs=0 l=1 rx=0x7f29d00013e0 tx=0x7f29d405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:19.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.899+0000 7f29c27fc700 1 -- 172.21.15.103:0/511969315 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29d0012c70 con 0x7f29d40ae720 2020-04-22T14:07:19.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.899+0000 7f29d8988700 1 --2- 172.21.15.103:0/511969315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29d40ae720 0x7f29d40b3680 secure :-1 s=THROTTLE_DONE pgs=617 cs=0 l=1 rx=0x7f29d00013e0 tx=0x7f29d405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:19.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.899+0000 7f29c27fc700 1 -- 172.21.15.103:0/511969315 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d0012e10 con 0x7f29d40ae720 2020-04-22T14:07:19.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.899+0000 7f29db3ed700 1 -- 172.21.15.103:0/511969315 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29d40af320 con 0x7f29d40ae720 2020-04-22T14:07:19.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.899+0000 7f29c27fc700 1 -- 172.21.15.103:0/511969315 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29d000ca60 con 0x7f29d40ae720 2020-04-22T14:07:19.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.899+0000 7f29db3ed700 1 -- 172.21.15.103:0/511969315 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29d40af840 con 0x7f29d40ae720 2020-04-22T14:07:19.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.900+0000 7f29d8988700 1 --2- 172.21.15.103:0/511969315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29d40ae720 0x7f29d40b3680 secure :-1 s=THROTTLE_DONE pgs=617 cs=0 l=1 rx=0x7f29d00013e0 tx=0x7f29d405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:19.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.900+0000 7f29c27fc700 1 -- 172.21.15.103:0/511969315 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f29d000ccd0 con 0x7f29d40ae720 2020-04-22T14:07:19.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.900+0000 7f29d8988700 1 --2- 172.21.15.103:0/511969315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29d40ae720 0x7f29d40b3680 secure :-1 s=THROTTLE_DONE pgs=617 cs=0 l=1 rx=0x7f29d00013e0 tx=0x7f29d405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:19.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.900+0000 7f29c27fc700 1 --2- 172.21.15.103:0/511969315 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f29b404d9c0 0x7f29b404fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:19.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.900+0000 7f29db3ed700 1 -- 172.21.15.103:0/511969315 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29d4056c90 con 0x7f29d40ae720 2020-04-22T14:07:19.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.900+0000 7f29c27fc700 1 -- 172.21.15.103:0/511969315 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f29d0061260 con 0x7f29d40ae720 2020-04-22T14:07:19.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.901+0000 7f29d9189700 1 --2- 172.21.15.103:0/511969315 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f29b404d9c0 0x7f29b404fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:19.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.901+0000 7f29d9189700 1 --2- 172.21.15.103:0/511969315 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f29b404d9c0 0x7f29b404fe80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f29d40b85b0 tx=0x7f29c4003e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:19.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.901+0000 7f29d9189700 1 --2- 172.21.15.103:0/511969315 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f29b404d9c0 0x7f29b404fe80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f29d40b85b0 tx=0x7f29c4003e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:19.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.901+0000 7f29d9189700 1 --2- 172.21.15.103:0/511969315 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f29b404d9c0 0x7f29b404fe80 secure :-1 s=READY pgs=238 cs=0 l=1 rx=0x7f29d40b85b0 tx=0x7f29c4003e20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:19.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.905+0000 7f29d8988700 1 --2- 172.21.15.103:0/511969315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29d40ae720 0x7f29d40b3680 secure :-1 s=THROTTLE_DONE pgs=617 cs=0 l=1 rx=0x7f29d00013e0 tx=0x7f29d405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:19.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:19.905+0000 7f29c27fc700 1 -- 172.21.15.103:0/511969315 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f29d003c640 con 0x7f29d40ae720 2020-04-22T14:07:20.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.048+0000 7f29db3ed700 1 -- 172.21.15.103:0/511969315 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f29d4147360 con 0x7f29d40ae720 2020-04-22T14:07:20.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.049+0000 7f29d8988700 1 --2- 172.21.15.103:0/511969315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29d40ae720 0x7f29d40b3680 secure :-1 s=THROTTLE_DONE pgs=617 cs=0 l=1 rx=0x7f29d00013e0 tx=0x7f29d405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:20.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.049+0000 7f29c27fc700 1 -- 172.21.15.103:0/511969315 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v45) v1 ==== 81+0+33696 (secure 0 0 0) 0x7f29d003fc60 con 0x7f29d40ae720 2020-04-22T14:07:20.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.050+0000 7f29db3ed700 1 -- 172.21.15.103:0/511969315 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f29b404d9c0 msgr2=0x7f29b404fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:20.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.050+0000 7f29db3ed700 1 --2- 172.21.15.103:0/511969315 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f29b404d9c0 0x7f29b404fe80 secure :-1 s=READY pgs=238 cs=0 l=1 rx=0x7f29d40b85b0 tx=0x7f29c4003e20).stop 2020-04-22T14:07:20.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.050+0000 7f29db3ed700 1 -- 172.21.15.103:0/511969315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29d40ae720 msgr2=0x7f29d40b3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:20.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.050+0000 7f29db3ed700 1 --2- 172.21.15.103:0/511969315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29d40ae720 0x7f29d40b3680 secure :-1 s=READY pgs=617 cs=0 l=1 rx=0x7f29d00013e0 tx=0x7f29d405bce0).stop 2020-04-22T14:07:20.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.050+0000 7f29db3ed700 1 -- 172.21.15.103:0/511969315 shutdown_connections 2020-04-22T14:07:20.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.050+0000 7f29db3ed700 1 --2- 172.21.15.103:0/511969315 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f29b404d9c0 0x7f29b404fe80 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:20.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.050+0000 7f29db3ed700 1 --2- 172.21.15.103:0/511969315 >> v2:172.21.15.86:3300/0 conn(0x7f29d40b7dd0 0x7f29d40b2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:20.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.050+0000 7f29db3ed700 1 --2- 172.21.15.103:0/511969315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29d40ae720 0x7f29d40b3680 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:20.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.050+0000 7f29db3ed700 1 -- 172.21.15.103:0/511969315 >> 172.21.15.103:0/511969315 conn(0x7f29d40b9160 msgr2=0x7f29d40b5900 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:20.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.050+0000 7f29db3ed700 1 -- 172.21.15.103:0/511969315 shutdown_connections 2020-04-22T14:07:20.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.050+0000 7f29db3ed700 1 -- 172.21.15.103:0/511969315 wait complete. 2020-04-22T14:07:20.061 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:07:20.062 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:07:20.062 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 45, 2020-04-22T14:07:20.062 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:07:20.062 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2020-04-22T14:02:06.484738+0000", 2020-04-22T14:07:20.062 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2020-04-22T14:05:46.962137+0000", 2020-04-22T14:07:20.062 INFO:teuthology.orchestra.run.smithi103.stdout: "last_up_change": "2020-04-22T14:02:18.623774+0000", 2020-04-22T14:07:20.062 INFO:teuthology.orchestra.run.smithi103.stdout: "last_in_change": "2020-04-22T14:02:18.623774+0000", 2020-04-22T14:07:20.063 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-04-22T14:07:20.063 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_num": 5799936, 2020-04-22T14:07:20.063 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_set": [ 2020-04-22T14:07:20.063 INFO:teuthology.orchestra.run.smithi103.stdout: "pglog_hardlimit", 2020-04-22T14:07:20.063 INFO:teuthology.orchestra.run.smithi103.stdout: "purged_snapdirs", 2020-04-22T14:07:20.063 INFO:teuthology.orchestra.run.smithi103.stdout: "recovery_deletes", 2020-04-22T14:07:20.063 INFO:teuthology.orchestra.run.smithi103.stdout: "sortbitwise" 2020-04-22T14:07:20.064 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:07:20.064 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_version": 5, 2020-04-22T14:07:20.064 INFO:teuthology.orchestra.run.smithi103.stdout: "full_ratio": 0.94999998807907104, 2020-04-22T14:07:20.064 INFO:teuthology.orchestra.run.smithi103.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-04-22T14:07:20.064 INFO:teuthology.orchestra.run.smithi103.stdout: "nearfull_ratio": 0.85000002384185791, 2020-04-22T14:07:20.064 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_snapshot": "", 2020-04-22T14:07:20.064 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_max": 8, 2020-04-22T14:07:20.065 INFO:teuthology.orchestra.run.smithi103.stdout: "max_osd": 8, 2020-04-22T14:07:20.065 INFO:teuthology.orchestra.run.smithi103.stdout: "require_min_compat_client": "luminous", 2020-04-22T14:07:20.065 INFO:teuthology.orchestra.run.smithi103.stdout: "min_compat_client": "jewel", 2020-04-22T14:07:20.065 INFO:teuthology.orchestra.run.smithi103.stdout: "require_osd_release": "pacific", 2020-04-22T14:07:20.065 INFO:teuthology.orchestra.run.smithi103.stdout: "pools": [ 2020-04-22T14:07:20.066 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.066 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 1, 2020-04-22T14:07:20.066 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "device_health_metrics", 2020-04-22T14:07:20.066 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:02:09.565655+0000", 2020-04-22T14:07:20.067 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:07:20.067 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:07:20.067 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:07:20.067 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:07:20.067 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:07:20.067 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:07:20.068 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:07:20.068 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:07:20.068 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 1, 2020-04-22T14:07:20.068 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 1, 2020-04-22T14:07:20.068 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 1, 2020-04-22T14:07:20.068 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 1, 2020-04-22T14:07:20.068 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 1, 2020-04-22T14:07:20.069 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:07:20.069 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:07:20.069 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:07:20.069 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:07:20.069 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:07:20.069 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:07:20.069 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:07:20.070 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.070 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "17", 2020-04-22T14:07:20.070 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:07:20.070 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:07:20.070 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:07:20.070 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:07:20.071 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:07:20.071 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:07:20.071 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:07:20.071 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:07:20.071 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:07:20.071 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:07:20.072 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:07:20.072 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:07:20.072 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:07:20.072 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:07:20.072 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:07:20.072 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:07:20.072 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:07:20.073 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:07:20.073 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:07:20.073 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:07:20.073 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:07:20.073 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:07:20.073 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:07:20.073 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:07:20.074 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:07:20.074 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:07:20.074 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.074 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:07:20.074 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:07:20.074 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:07:20.074 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:07:20.075 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:07:20.075 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:07:20.075 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:07:20.075 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:07:20.075 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:07:20.075 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:07:20.075 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:07:20.076 INFO:teuthology.orchestra.run.smithi103.stdout: "options": { 2020-04-22T14:07:20.076 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_min": 1 2020-04-22T14:07:20.076 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.076 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:07:20.076 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_devicehealth": {} 2020-04-22T14:07:20.076 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.076 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.077 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.077 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 2, 2020-04-22T14:07:20.077 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "rbd", 2020-04-22T14:07:20.077 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:02:22.733031+0000", 2020-04-22T14:07:20.077 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:07:20.077 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:07:20.078 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:07:20.078 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:07:20.078 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:07:20.078 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:07:20.078 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:07:20.078 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:07:20.079 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 8, 2020-04-22T14:07:20.079 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 8, 2020-04-22T14:07:20.079 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 8, 2020-04-22T14:07:20.079 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 8, 2020-04-22T14:07:20.079 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 8, 2020-04-22T14:07:20.079 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:07:20.079 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:07:20.079 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:07:20.080 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:07:20.080 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:07:20.080 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:07:20.080 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:07:20.080 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.080 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "20", 2020-04-22T14:07:20.080 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:07:20.081 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:07:20.081 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:07:20.081 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:07:20.081 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:07:20.081 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:07:20.082 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:07:20.082 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:07:20.082 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:07:20.082 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:07:20.082 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:07:20.082 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:07:20.082 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:07:20.083 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:07:20.083 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:07:20.083 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:07:20.083 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:07:20.083 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:07:20.083 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:07:20.083 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:07:20.083 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:07:20.084 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:07:20.084 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:07:20.084 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:07:20.084 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:07:20.084 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:07:20.084 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.084 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:07:20.085 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:07:20.085 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:07:20.085 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:07:20.085 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:07:20.085 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:07:20.085 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:07:20.086 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:07:20.086 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:07:20.086 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:07:20.086 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:07:20.086 INFO:teuthology.orchestra.run.smithi103.stdout: "options": {}, 2020-04-22T14:07:20.086 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:07:20.086 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd": {} 2020-04-22T14:07:20.087 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.087 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.087 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.087 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 7, 2020-04-22T14:07:20.087 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "cephfs_metadata", 2020-04-22T14:07:20.087 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:05:43.875682+0000", 2020-04-22T14:07:20.087 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:07:20.087 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:07:20.088 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:07:20.088 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:07:20.088 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:07:20.088 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:07:20.088 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:07:20.088 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:07:20.088 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 8, 2020-04-22T14:07:20.089 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 8, 2020-04-22T14:07:20.089 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 8, 2020-04-22T14:07:20.089 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 8, 2020-04-22T14:07:20.089 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 8, 2020-04-22T14:07:20.089 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:07:20.089 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:07:20.089 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:07:20.090 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:07:20.090 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:07:20.090 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:07:20.090 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:07:20.090 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.090 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "44", 2020-04-22T14:07:20.090 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:07:20.090 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:07:20.091 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:07:20.091 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:07:20.091 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:07:20.091 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:07:20.091 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:07:20.091 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:07:20.091 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:07:20.092 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:07:20.092 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:07:20.092 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:07:20.092 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:07:20.092 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:07:20.092 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:07:20.092 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:07:20.093 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:07:20.093 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:07:20.093 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:07:20.093 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:07:20.093 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:07:20.093 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:07:20.093 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:07:20.094 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:07:20.094 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:07:20.094 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:07:20.094 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.094 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:07:20.094 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:07:20.094 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:07:20.094 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:07:20.095 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:07:20.095 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:07:20.095 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:07:20.095 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:07:20.095 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:07:20.095 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:07:20.095 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:07:20.096 INFO:teuthology.orchestra.run.smithi103.stdout: "options": { 2020-04-22T14:07:20.096 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_bias": 4, 2020-04-22T14:07:20.096 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_min": 16, 2020-04-22T14:07:20.096 INFO:teuthology.orchestra.run.smithi103.stdout: "recovery_priority": 5 2020-04-22T14:07:20.096 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.096 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:07:20.096 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs": { 2020-04-22T14:07:20.097 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": "cephfs" 2020-04-22T14:07:20.097 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.097 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.097 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.097 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.097 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 8, 2020-04-22T14:07:20.097 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "cephfs_data", 2020-04-22T14:07:20.098 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:05:44.910499+0000", 2020-04-22T14:07:20.098 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:07:20.098 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:07:20.098 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:07:20.098 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:07:20.098 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:07:20.098 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:07:20.099 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:07:20.099 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:07:20.099 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 8, 2020-04-22T14:07:20.099 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 8, 2020-04-22T14:07:20.099 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 8, 2020-04-22T14:07:20.099 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 8, 2020-04-22T14:07:20.099 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 8, 2020-04-22T14:07:20.099 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:07:20.100 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:07:20.100 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:07:20.100 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:07:20.100 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:07:20.100 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:07:20.100 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:07:20.100 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.101 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "45", 2020-04-22T14:07:20.101 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:07:20.101 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:07:20.101 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:07:20.101 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:07:20.101 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:07:20.101 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:07:20.102 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:07:20.102 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:07:20.102 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:07:20.102 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:07:20.102 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:07:20.102 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:07:20.103 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:07:20.103 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:07:20.103 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:07:20.103 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:07:20.103 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:07:20.103 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:07:20.103 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:07:20.104 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:07:20.104 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:07:20.104 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:07:20.104 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:07:20.104 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:07:20.104 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:07:20.104 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:07:20.105 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.105 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:07:20.105 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:07:20.105 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:07:20.105 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:07:20.105 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:07:20.105 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:07:20.106 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:07:20.106 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:07:20.106 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:07:20.106 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:07:20.106 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:07:20.106 INFO:teuthology.orchestra.run.smithi103.stdout: "options": {}, 2020-04-22T14:07:20.106 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:07:20.107 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs": { 2020-04-22T14:07:20.107 INFO:teuthology.orchestra.run.smithi103.stdout: "data": "cephfs" 2020-04-22T14:07:20.107 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.107 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.107 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.108 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:07:20.108 INFO:teuthology.orchestra.run.smithi103.stdout: "osds": [ 2020-04-22T14:07:20.108 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.108 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 0, 2020-04-22T14:07:20.108 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "3546145b-bd93-4a79-b6fe-3158153b8f05", 2020-04-22T14:07:20.109 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:07:20.109 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:07:20.109 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:07:20.109 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:07:20.109 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:07:20.109 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:07:20.109 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:07:20.110 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 43, 2020-04-22T14:07:20.110 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:07:20.110 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:07:20.110 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:07:20.110 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:07:20.110 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.110 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:07:20.111 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6800", 2020-04-22T14:07:20.111 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:07:20.111 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.111 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.111 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:20.111 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6801", 2020-04-22T14:07:20.112 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:07:20.112 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.112 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:20.112 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.112 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:07:20.113 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:07:20.113 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.113 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:07:20.113 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6802", 2020-04-22T14:07:20.114 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:07:20.114 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.114 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.114 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:20.114 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6803", 2020-04-22T14:07:20.114 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:07:20.115 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.115 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:20.115 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.115 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:07:20.115 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:07:20.115 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.115 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:07:20.116 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6806", 2020-04-22T14:07:20.116 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:07:20.116 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.116 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.116 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:20.116 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6807", 2020-04-22T14:07:20.116 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:07:20.117 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.117 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:20.117 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.117 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:07:20.117 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:07:20.117 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.117 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:07:20.118 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6804", 2020-04-22T14:07:20.118 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:07:20.118 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.118 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.118 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:20.118 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6805", 2020-04-22T14:07:20.118 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:07:20.118 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.119 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:20.119 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.119 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6801/33072", 2020-04-22T14:07:20.120 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6803/33072", 2020-04-22T14:07:20.120 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6807/33072", 2020-04-22T14:07:20.120 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6805/33072", 2020-04-22T14:07:20.120 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:07:20.120 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:07:20.120 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:07:20.121 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:20.121 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.121 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.121 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 1, 2020-04-22T14:07:20.121 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "65ca5f7d-2ea6-4de6-a034-08a0a99aa80d", 2020-04-22T14:07:20.121 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:07:20.121 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:07:20.122 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:07:20.122 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:07:20.122 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:07:20.122 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:07:20.122 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:07:20.122 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 43, 2020-04-22T14:07:20.123 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:07:20.123 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:07:20.123 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:07:20.123 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:07:20.123 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.123 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:07:20.124 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6808", 2020-04-22T14:07:20.124 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:07:20.124 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.124 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.124 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:20.124 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6809", 2020-04-22T14:07:20.124 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:07:20.125 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.125 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:20.125 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.125 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:07:20.125 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:07:20.126 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.126 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:07:20.126 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6810", 2020-04-22T14:07:20.126 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:07:20.126 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.126 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.126 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:20.126 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6811", 2020-04-22T14:07:20.127 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:07:20.127 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.127 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:20.127 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.127 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:07:20.127 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:07:20.128 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.128 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:07:20.128 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6814", 2020-04-22T14:07:20.128 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:07:20.128 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.129 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.129 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:20.129 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6815", 2020-04-22T14:07:20.129 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:07:20.129 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.129 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:20.129 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.130 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:07:20.130 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:07:20.130 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.130 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:07:20.130 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6812", 2020-04-22T14:07:20.130 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:07:20.130 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.130 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.131 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:20.131 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6813", 2020-04-22T14:07:20.131 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:07:20.131 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.131 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:20.131 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.131 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6809/33103", 2020-04-22T14:07:20.132 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6811/33103", 2020-04-22T14:07:20.132 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6815/33103", 2020-04-22T14:07:20.132 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6813/33103", 2020-04-22T14:07:20.132 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:07:20.132 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:07:20.134 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:07:20.134 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:20.134 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.134 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.134 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 2, 2020-04-22T14:07:20.136 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "f2e9bf44-c844-48d7-b6c2-f08ea71189b4", 2020-04-22T14:07:20.136 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:07:20.137 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:07:20.137 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:07:20.137 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:07:20.137 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:07:20.137 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:07:20.137 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:07:20.138 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 31, 2020-04-22T14:07:20.138 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:07:20.138 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:07:20.138 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:07:20.138 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:07:20.138 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.138 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:07:20.139 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6816", 2020-04-22T14:07:20.139 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:07:20.139 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.139 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.139 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:20.139 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6817", 2020-04-22T14:07:20.139 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:07:20.140 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.140 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:20.140 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.140 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:07:20.140 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:07:20.140 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.141 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:07:20.141 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6818", 2020-04-22T14:07:20.141 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:07:20.141 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.141 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.141 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:20.141 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6819", 2020-04-22T14:07:20.142 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:07:20.142 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.142 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:20.142 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.142 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:07:20.142 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:07:20.143 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.143 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:07:20.143 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6822", 2020-04-22T14:07:20.143 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:07:20.143 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.143 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.143 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:20.144 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6823", 2020-04-22T14:07:20.144 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:07:20.144 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.144 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:20.144 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.144 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:07:20.145 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:07:20.145 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.145 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:07:20.145 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6820", 2020-04-22T14:07:20.145 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:07:20.145 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.145 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.146 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:20.146 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6821", 2020-04-22T14:07:20.146 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:07:20.146 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.146 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:20.146 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.146 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6817/33153", 2020-04-22T14:07:20.147 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6819/33153", 2020-04-22T14:07:20.147 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6823/33153", 2020-04-22T14:07:20.147 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6821/33153", 2020-04-22T14:07:20.147 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:07:20.147 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:07:20.147 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:07:20.147 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:20.148 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.148 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.148 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 3, 2020-04-22T14:07:20.148 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "0ab87fee-a427-4906-851a-b9bd8c2e5645", 2020-04-22T14:07:20.148 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:07:20.148 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:07:20.149 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:07:20.149 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:07:20.149 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:07:20.149 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:07:20.149 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:07:20.149 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 43, 2020-04-22T14:07:20.149 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:07:20.150 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:07:20.150 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:07:20.150 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:07:20.150 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.150 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:07:20.150 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6824", 2020-04-22T14:07:20.150 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:07:20.151 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.151 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.151 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:20.151 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6825", 2020-04-22T14:07:20.151 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:07:20.151 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.152 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:20.152 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.152 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:07:20.152 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:07:20.152 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.152 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:07:20.152 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6826", 2020-04-22T14:07:20.153 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:07:20.153 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.153 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.153 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:20.153 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6827", 2020-04-22T14:07:20.153 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:07:20.154 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.154 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:20.154 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.154 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:07:20.154 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:07:20.154 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.154 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:07:20.155 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6830", 2020-04-22T14:07:20.155 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:07:20.155 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.155 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.155 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:20.155 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6831", 2020-04-22T14:07:20.155 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:07:20.156 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.156 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:20.156 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.156 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:07:20.156 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:07:20.156 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.157 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:07:20.157 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6828", 2020-04-22T14:07:20.157 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:07:20.157 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.157 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.157 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:20.158 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6829", 2020-04-22T14:07:20.158 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:07:20.158 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.158 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:20.158 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.158 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6825/33183", 2020-04-22T14:07:20.159 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6827/33183", 2020-04-22T14:07:20.159 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6831/33183", 2020-04-22T14:07:20.159 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6829/33183", 2020-04-22T14:07:20.159 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:07:20.159 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:07:20.159 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:07:20.159 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:20.160 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.160 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.160 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 4, 2020-04-22T14:07:20.160 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "2565df7d-2eff-484b-a3cd-ed7715e5d875", 2020-04-22T14:07:20.160 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:07:20.160 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:07:20.161 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:07:20.161 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:07:20.161 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:07:20.161 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:07:20.161 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:07:20.161 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 43, 2020-04-22T14:07:20.161 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:07:20.162 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:07:20.162 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:07:20.162 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:07:20.162 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.162 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:07:20.162 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6802", 2020-04-22T14:07:20.162 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:07:20.163 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.163 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.163 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:20.163 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6803", 2020-04-22T14:07:20.163 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:07:20.163 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.164 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:20.164 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.164 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:07:20.164 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:07:20.164 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.164 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:07:20.164 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6804", 2020-04-22T14:07:20.165 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:07:20.165 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.165 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.165 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:20.165 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6805", 2020-04-22T14:07:20.165 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:07:20.165 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.166 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:20.166 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.166 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:07:20.166 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:07:20.166 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.166 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:07:20.166 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6808", 2020-04-22T14:07:20.167 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:07:20.167 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.167 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.167 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:20.167 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6809", 2020-04-22T14:07:20.167 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:07:20.168 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.168 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:20.168 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.168 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:07:20.168 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:07:20.168 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.168 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:07:20.169 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6806", 2020-04-22T14:07:20.169 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:07:20.169 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.169 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.169 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:20.169 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6807", 2020-04-22T14:07:20.170 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:07:20.170 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.170 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:20.170 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.170 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6803/33506", 2020-04-22T14:07:20.170 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6805/33506", 2020-04-22T14:07:20.171 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6809/33506", 2020-04-22T14:07:20.171 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6807/33506", 2020-04-22T14:07:20.171 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:07:20.171 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:07:20.171 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:07:20.171 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:20.171 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.172 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.172 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 5, 2020-04-22T14:07:20.172 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "bcfd7a16-6914-4152-8647-a481917fe19d", 2020-04-22T14:07:20.172 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:07:20.172 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:07:20.172 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:07:20.172 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:07:20.173 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:07:20.173 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:07:20.173 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:07:20.173 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 43, 2020-04-22T14:07:20.173 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:07:20.173 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:07:20.174 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:07:20.174 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:07:20.174 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.174 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:07:20.174 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6810", 2020-04-22T14:07:20.174 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:07:20.174 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.175 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.175 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:20.175 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6811", 2020-04-22T14:07:20.175 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:07:20.175 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.175 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:20.175 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.176 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:07:20.176 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:07:20.176 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.176 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:07:20.176 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6812", 2020-04-22T14:07:20.176 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:07:20.176 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.177 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.177 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:20.177 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6813", 2020-04-22T14:07:20.177 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:07:20.177 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.177 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:20.177 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.178 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:07:20.178 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:07:20.178 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.178 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:07:20.178 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6816", 2020-04-22T14:07:20.178 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:07:20.179 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.179 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.179 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:20.179 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6817", 2020-04-22T14:07:20.179 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:07:20.179 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.179 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:20.180 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.180 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:07:20.180 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:07:20.180 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.180 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:07:20.180 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6814", 2020-04-22T14:07:20.181 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:07:20.181 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.181 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.181 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:20.181 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6815", 2020-04-22T14:07:20.181 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:07:20.181 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.182 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:20.182 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.182 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6811/33554", 2020-04-22T14:07:20.182 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6813/33554", 2020-04-22T14:07:20.182 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6817/33554", 2020-04-22T14:07:20.182 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6815/33554", 2020-04-22T14:07:20.182 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:07:20.183 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:07:20.183 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:07:20.183 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:20.183 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.183 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.183 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 6, 2020-04-22T14:07:20.184 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050", 2020-04-22T14:07:20.184 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:07:20.184 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:07:20.184 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:07:20.184 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:07:20.184 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:07:20.184 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:07:20.185 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:07:20.185 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 43, 2020-04-22T14:07:20.185 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:07:20.185 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:07:20.185 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:07:20.185 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:07:20.186 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.186 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:07:20.186 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6818", 2020-04-22T14:07:20.186 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:07:20.186 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.186 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.187 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:20.187 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6819", 2020-04-22T14:07:20.187 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:07:20.187 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.187 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:20.187 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.187 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:07:20.188 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:07:20.188 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.188 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:07:20.188 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6820", 2020-04-22T14:07:20.188 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:07:20.188 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.189 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.189 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:20.189 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6821", 2020-04-22T14:07:20.189 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:07:20.189 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.189 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:20.189 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.190 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:07:20.190 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:07:20.190 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.190 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:07:20.190 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6824", 2020-04-22T14:07:20.190 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:07:20.190 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.191 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.191 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:20.191 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6825", 2020-04-22T14:07:20.191 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:07:20.191 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.191 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:20.192 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.192 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:07:20.192 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:07:20.192 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.192 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:07:20.192 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6822", 2020-04-22T14:07:20.192 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:07:20.193 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.193 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.193 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:20.193 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6823", 2020-04-22T14:07:20.193 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:07:20.193 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.194 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:20.194 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.194 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6819/33601", 2020-04-22T14:07:20.194 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6821/33601", 2020-04-22T14:07:20.194 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6825/33601", 2020-04-22T14:07:20.194 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6823/33601", 2020-04-22T14:07:20.194 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:07:20.195 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:07:20.195 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:07:20.195 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:20.195 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.195 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.195 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 7, 2020-04-22T14:07:20.195 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "340eece1-4c39-47cd-b95f-9cfa5dcfe361", 2020-04-22T14:07:20.196 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:07:20.196 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:07:20.196 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:07:20.196 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:07:20.197 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:07:20.197 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:07:20.197 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:07:20.197 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 42, 2020-04-22T14:07:20.197 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:07:20.197 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:07:20.197 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:07:20.198 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:07:20.198 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.198 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:07:20.198 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6826", 2020-04-22T14:07:20.198 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:07:20.198 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.198 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.199 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:20.199 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6827", 2020-04-22T14:07:20.199 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:07:20.199 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.199 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:20.199 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.200 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:07:20.200 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:07:20.200 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.200 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:07:20.200 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6828", 2020-04-22T14:07:20.200 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:07:20.201 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.201 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.201 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:20.201 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6829", 2020-04-22T14:07:20.201 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:07:20.201 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.201 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:20.202 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.202 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:07:20.202 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:07:20.202 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.202 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:07:20.202 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6832", 2020-04-22T14:07:20.202 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:07:20.203 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.203 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.203 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:20.203 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6833", 2020-04-22T14:07:20.203 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:07:20.203 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.204 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:20.204 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.204 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:07:20.204 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:07:20.204 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.204 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:07:20.204 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6830", 2020-04-22T14:07:20.205 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:07:20.205 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.205 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.205 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:20.205 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6831", 2020-04-22T14:07:20.205 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:07:20.206 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.206 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:20.206 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.206 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6827/33629", 2020-04-22T14:07:20.206 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6829/33629", 2020-04-22T14:07:20.206 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6833/33629", 2020-04-22T14:07:20.206 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6831/33629", 2020-04-22T14:07:20.207 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:07:20.207 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:07:20.207 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:07:20.207 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:20.207 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.207 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:07:20.208 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_xinfo": [ 2020-04-22T14:07:20.208 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.208 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 0, 2020-04-22T14:07:20.208 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:07:20.208 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:07:20.208 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:07:20.208 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:07:20.209 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:07:20.209 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.384360+0000", 2020-04-22T14:07:20.209 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:07:20.209 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.209 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.209 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 1, 2020-04-22T14:07:20.210 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:07:20.210 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:07:20.210 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:07:20.210 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:07:20.210 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:07:20.210 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.503590+0000", 2020-04-22T14:07:20.210 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:07:20.211 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.211 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.211 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 2, 2020-04-22T14:07:20.211 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:07:20.211 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:07:20.211 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:07:20.211 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:07:20.212 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:07:20.212 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.525058+0000", 2020-04-22T14:07:20.212 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:07:20.212 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.212 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.212 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 3, 2020-04-22T14:07:20.213 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:07:20.213 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:07:20.213 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:07:20.213 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:07:20.213 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:07:20.213 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.599729+0000", 2020-04-22T14:07:20.213 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:07:20.214 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.214 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.214 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 4, 2020-04-22T14:07:20.214 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:07:20.214 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:07:20.214 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:07:20.214 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:07:20.215 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:07:20.215 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.600919+0000", 2020-04-22T14:07:20.215 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:07:20.215 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.215 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.215 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 5, 2020-04-22T14:07:20.216 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:07:20.216 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:07:20.216 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:07:20.216 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:07:20.216 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:07:20.216 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.654718+0000", 2020-04-22T14:07:20.216 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:07:20.217 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.217 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.217 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 6, 2020-04-22T14:07:20.217 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:07:20.217 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:07:20.217 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:07:20.218 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:07:20.218 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:07:20.218 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.718342+0000", 2020-04-22T14:07:20.218 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:07:20.218 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.218 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:20.218 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 7, 2020-04-22T14:07:20.219 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:07:20.219 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:07:20.219 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:07:20.219 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:07:20.219 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:07:20.219 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.839089+0000", 2020-04-22T14:07:20.220 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:07:20.220 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.220 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:07:20.220 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_upmap": [], 2020-04-22T14:07:20.220 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_upmap_items": [], 2020-04-22T14:07:20.220 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_temp": [], 2020-04-22T14:07:20.220 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_temp": [], 2020-04-22T14:07:20.221 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklist": {}, 2020-04-22T14:07:20.221 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profiles": { 2020-04-22T14:07:20.221 INFO:teuthology.orchestra.run.smithi103.stdout: "default": { 2020-04-22T14:07:20.221 INFO:teuthology.orchestra.run.smithi103.stdout: "crush-failure-domain": "osd", 2020-04-22T14:07:20.221 INFO:teuthology.orchestra.run.smithi103.stdout: "k": "2", 2020-04-22T14:07:20.221 INFO:teuthology.orchestra.run.smithi103.stdout: "m": "1", 2020-04-22T14:07:20.221 INFO:teuthology.orchestra.run.smithi103.stdout: "plugin": "jerasure", 2020-04-22T14:07:20.222 INFO:teuthology.orchestra.run.smithi103.stdout: "ruleset-failure-domain": "osd", 2020-04-22T14:07:20.222 INFO:teuthology.orchestra.run.smithi103.stdout: "technique": "reed_sol_van" 2020-04-22T14:07:20.222 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:20.222 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:20.222 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps_queue": [], 2020-04-22T14:07:20.222 INFO:teuthology.orchestra.run.smithi103.stdout: "new_removed_snaps": [], 2020-04-22T14:07:20.223 INFO:teuthology.orchestra.run.smithi103.stdout: "new_purged_snaps": [], 2020-04-22T14:07:20.223 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_node_flags": {}, 2020-04-22T14:07:20.223 INFO:teuthology.orchestra.run.smithi103.stdout: "device_class_flags": {} 2020-04-22T14:07:20.223 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:07:20.225 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:20.239 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:07:20.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.383+0000 7f0bd2781700 1 Processor -- start 2020-04-22T14:07:20.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.383+0000 7f0bd2781700 1 -- start start 2020-04-22T14:07:20.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.384+0000 7f0bd2781700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0bcc0ac740 0x7f0bcc066120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:20.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.384+0000 7f0bd2781700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0bcc066580 0x7f0bcc129a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:20.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.384+0000 7f0bd2781700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bcc148270 con 0x7f0bcc0620a0 2020-04-22T14:07:20.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.384+0000 7f0bd2781700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bcc143f10 con 0x7f0bcc066580 2020-04-22T14:07:20.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.384+0000 7f0bd2781700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc1441b0 con 0x7f0bcc0ac740 2020-04-22T14:07:20.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.384+0000 7f0bd1f80700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0bcc066580 0x7f0bcc129a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:20.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.384+0000 7f0bd1f80700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0bcc066580 0x7f0bcc129a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49980/0 (socket says 172.21.15.103:49980) 2020-04-22T14:07:20.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.384+0000 7f0bd1f80700 1 -- 172.21.15.103:0/1855207542 learned_addr learned my addr 172.21.15.103:0/1855207542 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:20.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.384+0000 7f0bd177f700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f0bcc0620a0 0x7f0bcc144650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42172/0 (socket says 172.21.15.103:42172) 2020-04-22T14:07:20.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.384+0000 7f0bd1f80700 1 -- 172.21.15.103:0/1855207542 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0bcc0ac740 msgr2=0x7f0bcc066120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:20.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.384+0000 7f0bd0f7e700 1 --2- 172.21.15.103:0/1855207542 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0bcc0ac740 0x7f0bcc066120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:20.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.384+0000 7f0bd1f80700 1 --2- 172.21.15.103:0/1855207542 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0bcc0ac740 0x7f0bcc066120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:20.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.384+0000 7f0bd1f80700 1 -- 172.21.15.103:0/1855207542 >> v1:172.21.15.103:6789/0 conn(0x7f0bcc0620a0 legacy=0x7f0bcc144650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:20.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.384+0000 7f0bbbfff700 1 -- 172.21.15.103:0/1855207542 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3751185412 0 0) 0x7f0bcc148270 con 0x7f0bcc0620a0 2020-04-22T14:07:20.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.384+0000 7f0bd1f80700 1 -- 172.21.15.103:0/1855207542 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bcc062480 con 0x7f0bcc066580 2020-04-22T14:07:20.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.384+0000 7f0bd1f80700 1 --2- 172.21.15.103:0/1855207542 >> v2:172.21.15.103:3300/0 conn(0x7f0bcc066580 0x7f0bcc129a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0bcc0adae0 tx=0x7f0bc4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:20.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.384+0000 7f0bd1f80700 1 --2- 172.21.15.103:0/1855207542 >> v2:172.21.15.103:3300/0 conn(0x7f0bcc066580 0x7f0bcc129a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0bcc0adae0 tx=0x7f0bc4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:20.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.384+0000 7f0bd1f80700 1 --2- 172.21.15.103:0/1855207542 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bcc066580 0x7f0bcc129a20 secure :-1 s=READY pgs=619 cs=0 l=1 rx=0x7f0bcc0adae0 tx=0x7f0bc4008c60).ready entity=mon.1 client_cookie=83d6dfa61090eac3 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:20.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.384+0000 7f0bd1f80700 1 --2- 172.21.15.103:0/1855207542 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bcc066580 0x7f0bcc129a20 secure :-1 s=THROTTLE_DONE pgs=619 cs=0 l=1 rx=0x7f0bcc0adae0 tx=0x7f0bc4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:20.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.384+0000 7f0bbbfff700 1 -- 172.21.15.103:0/1855207542 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bc400a180 con 0x7f0bcc066580 2020-04-22T14:07:20.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.384+0000 7f0bd1f80700 1 --2- 172.21.15.103:0/1855207542 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bcc066580 0x7f0bcc129a20 secure :-1 s=THROTTLE_DONE pgs=619 cs=0 l=1 rx=0x7f0bcc0adae0 tx=0x7f0bc4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:20.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.384+0000 7f0bbbfff700 1 -- 172.21.15.103:0/1855207542 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc400a320 con 0x7f0bcc066580 2020-04-22T14:07:20.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.384+0000 7f0bd1f80700 1 --2- 172.21.15.103:0/1855207542 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bcc066580 0x7f0bcc129a20 secure :-1 s=THROTTLE_DONE pgs=619 cs=0 l=1 rx=0x7f0bcc0adae0 tx=0x7f0bc4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:20.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.384+0000 7f0bbbfff700 1 -- 172.21.15.103:0/1855207542 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bc400a700 con 0x7f0bcc066580 2020-04-22T14:07:20.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.384+0000 7f0bd2781700 1 -- 172.21.15.103:0/1855207542 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bcc066580 msgr2=0x7f0bcc129a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:20.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.384+0000 7f0bd2781700 1 --2- 172.21.15.103:0/1855207542 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bcc066580 0x7f0bcc129a20 secure :-1 s=READY pgs=619 cs=0 l=1 rx=0x7f0bcc0adae0 tx=0x7f0bc4008c60).stop 2020-04-22T14:07:20.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.385+0000 7f0bd2781700 1 -- 172.21.15.103:0/1855207542 shutdown_connections 2020-04-22T14:07:20.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.385+0000 7f0bd2781700 1 --2- 172.21.15.103:0/1855207542 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bcc066580 0x7f0bcc129a20 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:20.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.385+0000 7f0bd2781700 1 --2- 172.21.15.103:0/1855207542 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0bcc0ac740 0x7f0bcc066120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:20.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.385+0000 7f0bd2781700 1 -- 172.21.15.103:0/1855207542 >> 172.21.15.103:0/1855207542 conn(0x7f0bcc05b7c0 msgr2=0x7f0bcc061610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:20.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.385+0000 7f0bd2781700 1 -- 172.21.15.103:0/1855207542 shutdown_connections 2020-04-22T14:07:20.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.385+0000 7f0bd2781700 1 -- 172.21.15.103:0/1855207542 wait complete. 2020-04-22T14:07:20.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.386+0000 7f0bd2781700 1 Processor -- start 2020-04-22T14:07:20.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.386+0000 7f0bd2781700 1 -- start start 2020-04-22T14:07:20.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.386+0000 7f0bd2781700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0bcc0620a0 0x7f0bcc0b4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:20.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.387+0000 7f0bd2781700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bcc0b3c80 con 0x7f0bcc066580 2020-04-22T14:07:20.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.387+0000 7f0bd2781700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bcc0b3eb0 con 0x7f0bcc0ac740 2020-04-22T14:07:20.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.387+0000 7f0bd2781700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bcc0b4150 con 0x7f0bcc0620a0 2020-04-22T14:07:20.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.387+0000 7f0bd1f80700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f0bcc0ac740 0x7f0bcc0afb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42178/0 (socket says 172.21.15.103:42178) 2020-04-22T14:07:20.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.387+0000 7f0bd1f80700 1 -- 172.21.15.103:0/762349 learned_addr learned my addr 172.21.15.103:0/762349 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:20.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.387+0000 7f0bd177f700 1 --2- 172.21.15.103:0/762349 >> v2:172.21.15.86:3300/0 conn(0x7f0bcc0620a0 0x7f0bcc0b4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:20.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.387+0000 7f0bba7fc700 1 -- 172.21.15.103:0/762349 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2133438095 0 0) 0x7f0bcc0b3eb0 con 0x7f0bcc0ac740 2020-04-22T14:07:20.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.387+0000 7f0bba7fc700 1 -- 172.21.15.103:0/762349 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bac002fe0 con 0x7f0bcc0ac740 2020-04-22T14:07:20.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.387+0000 7f0bba7fc700 1 -- 172.21.15.103:0/762349 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1146844525 0 0) 0x7f0bcc0b3c80 con 0x7f0bcc066580 2020-04-22T14:07:20.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.387+0000 7f0bba7fc700 1 -- 172.21.15.103:0/762349 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bcc0b3eb0 con 0x7f0bcc066580 2020-04-22T14:07:20.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.387+0000 7f0bba7fc700 1 -- 172.21.15.103:0/762349 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3423626671 0 0) 0x7f0bac002fe0 con 0x7f0bcc0ac740 2020-04-22T14:07:20.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.387+0000 7f0bba7fc700 1 -- 172.21.15.103:0/762349 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0bcc0b3c80 con 0x7f0bcc0ac740 2020-04-22T14:07:20.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.387+0000 7f0bba7fc700 1 -- 172.21.15.103:0/762349 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f0bc40032b0 con 0x7f0bcc0ac740 2020-04-22T14:07:20.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.387+0000 7f0bba7fc700 1 -- 172.21.15.103:0/762349 >> v2:172.21.15.86:3300/0 conn(0x7f0bcc0620a0 msgr2=0x7f0bcc0b4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:20.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.387+0000 7f0bba7fc700 1 --2- 172.21.15.103:0/762349 >> v2:172.21.15.86:3300/0 conn(0x7f0bcc0620a0 0x7f0bcc0b4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:20.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.387+0000 7f0bba7fc700 1 -- 172.21.15.103:0/762349 >> v1:172.21.15.103:6789/0 conn(0x7f0bcc0ac740 legacy=0x7f0bcc0afb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:20.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.387+0000 7f0bba7fc700 1 -- 172.21.15.103:0/762349 >> v1:172.21.15.86:6789/0 conn(0x7f0bcc066580 legacy=0x7f0bcc1288c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:20.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.387+0000 7f0bba7fc700 1 --2- 172.21.15.103:0/762349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bac004b20 0x7f0bac004f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:20.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.387+0000 7f0bba7fc700 1 --2- 172.21.15.103:0/762349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0bac003ab0 0x7f0bac003f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:20.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.387+0000 7f0bba7fc700 1 --2- 172.21.15.103:0/762349 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0bac004390 0x7f0bac00b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:20.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.387+0000 7f0bba7fc700 1 -- 172.21.15.103:0/762349 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc0b4150 con 0x7f0bac003ab0 2020-04-22T14:07:20.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.387+0000 7f0bba7fc700 1 -- 172.21.15.103:0/762349 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac00bbb0 con 0x7f0bac004b20 2020-04-22T14:07:20.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.387+0000 7f0bba7fc700 1 -- 172.21.15.103:0/762349 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac00bcf0 con 0x7f0bac004390 2020-04-22T14:07:20.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.387+0000 7f0bd177f700 1 --2- 172.21.15.103:0/762349 >> v2:172.21.15.86:3300/0 conn(0x7f0bcc0620a0 0x7f0bcc0b4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:07:20.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.387+0000 7f0bd177f700 1 --2- 172.21.15.103:0/762349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bac004b20 0x7f0bac004f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:20.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.387+0000 7f0bd0f7e700 1 --2- 172.21.15.103:0/762349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0bac003ab0 0x7f0bac003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:20.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.387+0000 7f0bd1f80700 1 --2- 172.21.15.103:0/762349 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0bac004390 0x7f0bac00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:20.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.388+0000 7f0bd177f700 1 -- 172.21.15.103:0/762349 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0bac004390 msgr2=0x7f0bac00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:20.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.388+0000 7f0bd177f700 1 --2- 172.21.15.103:0/762349 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0bac004390 0x7f0bac00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:20.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.388+0000 7f0bd177f700 1 -- 172.21.15.103:0/762349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0bac003ab0 msgr2=0x7f0bac003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:20.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.388+0000 7f0bd177f700 1 --2- 172.21.15.103:0/762349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0bac003ab0 0x7f0bac003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:20.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.388+0000 7f0bd1f80700 1 -- 172.21.15.103:0/762349 reap_dead start 2020-04-22T14:07:20.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.388+0000 7f0bd177f700 1 -- 172.21.15.103:0/762349 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bcc12c9d0 con 0x7f0bac004b20 2020-04-22T14:07:20.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.388+0000 7f0bd2781700 1 -- 172.21.15.103:0/762349 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bcc0b17a0 con 0x7f0bac004b20 2020-04-22T14:07:20.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.388+0000 7f0bd177f700 1 --2- 172.21.15.103:0/762349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bac004b20 0x7f0bac004f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0bc8000b80 tx=0x7f0bc8001c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:20.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.388+0000 7f0bd177f700 1 --2- 172.21.15.103:0/762349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bac004b20 0x7f0bac004f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0bc8000b80 tx=0x7f0bc8001c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:20.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.388+0000 7f0bd177f700 1 --2- 172.21.15.103:0/762349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bac004b20 0x7f0bac004f20 secure :-1 s=READY pgs=621 cs=0 l=1 rx=0x7f0bc8000b80 tx=0x7f0bc8001c00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:20.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.388+0000 7f0bd177f700 1 --2- 172.21.15.103:0/762349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bac004b20 0x7f0bac004f20 secure :-1 s=THROTTLE_DONE pgs=621 cs=0 l=1 rx=0x7f0bc8000b80 tx=0x7f0bc8001c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:20.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.388+0000 7f0bd2781700 1 -- 172.21.15.103:0/762349 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bcc0b4590 con 0x7f0bac004b20 2020-04-22T14:07:20.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.388+0000 7f0bd177f700 1 --2- 172.21.15.103:0/762349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bac004b20 0x7f0bac004f20 secure :-1 s=THROTTLE_DONE pgs=621 cs=0 l=1 rx=0x7f0bc8000b80 tx=0x7f0bc8001c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:20.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.388+0000 7f0bd177f700 1 --2- 172.21.15.103:0/762349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bac004b20 0x7f0bac004f20 secure :-1 s=THROTTLE_DONE pgs=621 cs=0 l=1 rx=0x7f0bc8000b80 tx=0x7f0bc8001c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:20.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.388+0000 7f0bba7fc700 1 -- 172.21.15.103:0/762349 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bc800cdf0 con 0x7f0bac004b20 2020-04-22T14:07:20.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.388+0000 7f0bba7fc700 1 -- 172.21.15.103:0/762349 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc80044f0 con 0x7f0bac004b20 2020-04-22T14:07:20.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.388+0000 7f0bba7fc700 1 -- 172.21.15.103:0/762349 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bc80048d0 con 0x7f0bac004b20 2020-04-22T14:07:20.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.388+0000 7f0bd177f700 1 --2- 172.21.15.103:0/762349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bac004b20 0x7f0bac004f20 secure :-1 s=THROTTLE_DONE pgs=621 cs=0 l=1 rx=0x7f0bc8000b80 tx=0x7f0bc8001c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:20.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.389+0000 7f0bd2781700 1 -- 172.21.15.103:0/762349 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ba8003340 con 0x7f0bac004b20 2020-04-22T14:07:20.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.389+0000 7f0bba7fc700 1 -- 172.21.15.103:0/762349 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f0bc8004a30 con 0x7f0bac004b20 2020-04-22T14:07:20.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.389+0000 7f0bd177f700 1 --2- 172.21.15.103:0/762349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bac004b20 0x7f0bac004f20 secure :-1 s=THROTTLE_DONE pgs=621 cs=0 l=1 rx=0x7f0bc8000b80 tx=0x7f0bc8001c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:20.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.389+0000 7f0bba7fc700 1 --2- 172.21.15.103:0/762349 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0bac0519a0 0x7f0bac053e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:20.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.389+0000 7f0bba7fc700 1 -- 172.21.15.103:0/762349 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0bc8060f70 con 0x7f0bac004b20 2020-04-22T14:07:20.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.389+0000 7f0bd0f7e700 1 --2- 172.21.15.103:0/762349 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0bac0519a0 0x7f0bac053e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:20.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.389+0000 7f0bd0f7e700 1 --2- 172.21.15.103:0/762349 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0bac0519a0 0x7f0bac053e60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0bbc001f10 tx=0x7f0bbc002900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:20.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.390+0000 7f0bd0f7e700 1 --2- 172.21.15.103:0/762349 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0bac0519a0 0x7f0bac053e60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0bbc001f10 tx=0x7f0bbc002900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:20.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.390+0000 7f0bd0f7e700 1 --2- 172.21.15.103:0/762349 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0bac0519a0 0x7f0bac053e60 secure :-1 s=READY pgs=239 cs=0 l=1 rx=0x7f0bbc001f10 tx=0x7f0bbc002900).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:20.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.393+0000 7f0bd177f700 1 --2- 172.21.15.103:0/762349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bac004b20 0x7f0bac004f20 secure :-1 s=THROTTLE_DONE pgs=621 cs=0 l=1 rx=0x7f0bc8000b80 tx=0x7f0bc8001c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:20.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.393+0000 7f0bba7fc700 1 -- 172.21.15.103:0/762349 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f0bc803c470 con 0x7f0bac004b20 2020-04-22T14:07:20.409 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:07:20.426 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:07:20.468 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:20.482 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:07:20.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.590+0000 7f0bd2781700 1 -- 172.21.15.103:0/762349 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ba80036e0 con 0x7f0bac004b20 2020-04-22T14:07:20.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.590+0000 7f0bd177f700 1 --2- 172.21.15.103:0/762349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bac004b20 0x7f0bac004f20 secure :-1 s=THROTTLE_DONE pgs=621 cs=0 l=1 rx=0x7f0bc8000b80 tx=0x7f0bc8001c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:20.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.590+0000 7f0bba7fc700 1 -- 172.21.15.103:0/762349 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+2141 (secure 0 0 0) 0x7f0bc803fa90 con 0x7f0bac004b20 2020-04-22T14:07:20.594 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:07:20.594 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":20,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4748,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1859944899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1859944899},{"type":"v1","addr":"172.21.15.86:6835","nonce":1859944899}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:05:45.958513+0000","modified":"2020-04-22T14:05:47.963559+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5491},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5491":{"gid":5491,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/2581125360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2581125360},{"type":"v1","addr":"172.21.15.103:6833","nonce":2581125360}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2020-04-22T14:07:20.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.592+0000 7f0bd2781700 1 -- 172.21.15.103:0/762349 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0bac0519a0 msgr2=0x7f0bac053e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:20.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.592+0000 7f0bd2781700 1 --2- 172.21.15.103:0/762349 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0bac0519a0 0x7f0bac053e60 secure :-1 s=READY pgs=239 cs=0 l=1 rx=0x7f0bbc001f10 tx=0x7f0bbc002900).stop 2020-04-22T14:07:20.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.592+0000 7f0bd2781700 1 -- 172.21.15.103:0/762349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bac004b20 msgr2=0x7f0bac004f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:20.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.592+0000 7f0bd2781700 1 --2- 172.21.15.103:0/762349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bac004b20 0x7f0bac004f20 secure :-1 s=READY pgs=621 cs=0 l=1 rx=0x7f0bc8000b80 tx=0x7f0bc8001c00).stop 2020-04-22T14:07:20.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.592+0000 7f0bd2781700 1 -- 172.21.15.103:0/762349 shutdown_connections 2020-04-22T14:07:20.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.592+0000 7f0bd2781700 1 --2- 172.21.15.103:0/762349 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0bac0519a0 0x7f0bac053e60 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:20.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.592+0000 7f0bd2781700 1 --2- 172.21.15.103:0/762349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bac004b20 0x7f0bac004f20 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:20.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.592+0000 7f0bd2781700 1 -- 172.21.15.103:0/762349 >> 172.21.15.103:0/762349 conn(0x7f0bcc05b7c0 msgr2=0x7f0bcc0ae760 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:20.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.592+0000 7f0bd2781700 1 -- 172.21.15.103:0/762349 shutdown_connections 2020-04-22T14:07:20.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.592+0000 7f0bd2781700 1 -- 172.21.15.103:0/762349 wait complete. 2020-04-22T14:07:20.597 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 20 2020-04-22T14:07:20.605 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:20.618 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2020-04-22T14:07:20.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.774+0000 7fd1ec884700 1 Processor -- start 2020-04-22T14:07:20.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.774+0000 7fd1ec884700 1 -- start start 2020-04-22T14:07:20.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.774+0000 7fd1ec884700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd1e80b4700 0x7fd1e80afa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:20.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.775+0000 7fd1ec884700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1e80b2a00 con 0x7fd1e80b4320 2020-04-22T14:07:20.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.775+0000 7fd1ec884700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1e80b0e90 con 0x7fd1e80b2530 2020-04-22T14:07:20.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.775+0000 7fd1ec884700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e80b1130 con 0x7fd1e80b4700 2020-04-22T14:07:20.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.775+0000 7fd1e6d9d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd1e80b2530 0x7fd1e80afec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42188/0 (socket says 172.21.15.103:42188) 2020-04-22T14:07:20.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.775+0000 7fd1e6d9d700 1 -- 172.21.15.103:0/3581629509 learned_addr learned my addr 172.21.15.103:0/3581629509 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:20.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.775+0000 7fd1e559a700 1 -- 172.21.15.103:0/3581629509 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2837304131 0 0) 0x7fd1e80b0e90 con 0x7fd1e80b2530 2020-04-22T14:07:20.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.775+0000 7fd1e559a700 1 -- 172.21.15.103:0/3581629509 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1c8003230 con 0x7fd1e80b2530 2020-04-22T14:07:20.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.775+0000 7fd1e5d9b700 1 --2- 172.21.15.103:0/3581629509 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd1e80b4700 0x7fd1e80afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:20.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.775+0000 7fd1e559a700 1 -- 172.21.15.103:0/3581629509 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 314685233 0 0) 0x7fd1c8003230 con 0x7fd1e80b2530 2020-04-22T14:07:20.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.775+0000 7fd1e559a700 1 -- 172.21.15.103:0/3581629509 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd1e80b4700 msgr2=0x7fd1e80afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:20.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.775+0000 7fd1e559a700 1 --2- 172.21.15.103:0/3581629509 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd1e80b4700 0x7fd1e80afa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:20.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.775+0000 7fd1e559a700 1 -- 172.21.15.103:0/3581629509 >> v1:172.21.15.86:6789/0 conn(0x7fd1e80b4320 legacy=0x7fd1e80b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:20.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.775+0000 7fd1e559a700 1 -- 172.21.15.103:0/3581629509 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e80b1ce0 con 0x7fd1e80b2530 2020-04-22T14:07:20.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.775+0000 7fd1e559a700 1 -- 172.21.15.103:0/3581629509 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fd1e0001a50 con 0x7fd1e80b2530 2020-04-22T14:07:20.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.775+0000 7fd1e559a700 1 -- 172.21.15.103:0/3581629509 >> v1:172.21.15.103:6789/0 conn(0x7fd1e80b2530 legacy=0x7fd1e80afec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:20.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.775+0000 7fd1e559a700 1 --2- 172.21.15.103:0/3581629509 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd1c8003720 0x7fd1c8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:20.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.775+0000 7fd1e559a700 1 --2- 172.21.15.103:0/3581629509 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd1c8004060 0x7fd1c8004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:20.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.775+0000 7fd1e559a700 1 --2- 172.21.15.103:0/3581629509 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1c8004a50 0x7fd1c8004ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:20.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.775+0000 7fd1e559a700 1 -- 172.21.15.103:0/3581629509 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e80b1130 con 0x7fd1c8003720 2020-04-22T14:07:20.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.775+0000 7fd1e559a700 1 -- 172.21.15.103:0/3581629509 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c800b7e0 con 0x7fd1c8004a50 2020-04-22T14:07:20.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.775+0000 7fd1e559a700 1 -- 172.21.15.103:0/3581629509 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c800b9a0 con 0x7fd1c8004060 2020-04-22T14:07:20.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.775+0000 7fd1e5d9b700 1 --2- 172.21.15.103:0/3581629509 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd1e80b4700 0x7fd1e80afa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:07:20.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.775+0000 7fd1e6d9d700 1 --2- 172.21.15.103:0/3581629509 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1c8004a50 0x7fd1c8004ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:20.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.775+0000 7fd1e659c700 1 --2- 172.21.15.103:0/3581629509 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd1c8003720 0x7fd1c8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:20.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.775+0000 7fd1e5d9b700 1 --2- 172.21.15.103:0/3581629509 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd1c8004060 0x7fd1c8004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:20.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.776+0000 7fd1e6d9d700 1 -- 172.21.15.103:0/3581629509 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd1c8004060 msgr2=0x7fd1c8004530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:20.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.776+0000 7fd1e6d9d700 1 --2- 172.21.15.103:0/3581629509 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd1c8004060 0x7fd1c8004530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:20.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.776+0000 7fd1e6d9d700 1 -- 172.21.15.103:0/3581629509 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd1c8003720 msgr2=0x7fd1c8003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:20.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.776+0000 7fd1e6d9d700 1 --2- 172.21.15.103:0/3581629509 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd1c8003720 0x7fd1c8003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:20.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.776+0000 7fd1e6d9d700 1 -- 172.21.15.103:0/3581629509 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c8003230 con 0x7fd1c8004a50 2020-04-22T14:07:20.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.776+0000 7fd1e6d9d700 1 --2- 172.21.15.103:0/3581629509 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1c8004a50 0x7fd1c8004ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd1e0001760 tx=0x7fd1e80b1e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:20.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.776+0000 7fd1e6d9d700 1 --2- 172.21.15.103:0/3581629509 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1c8004a50 0x7fd1c8004ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd1e0001760 tx=0x7fd1e80b1e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:20.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.776+0000 7fd1e6d9d700 1 --2- 172.21.15.103:0/3581629509 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1c8004a50 0x7fd1c8004ed0 secure :-1 s=READY pgs=623 cs=0 l=1 rx=0x7fd1e0001760 tx=0x7fd1e80b1e70).ready entity=mon.1 client_cookie=4a7b84e1bcb520ae server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:20.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.776+0000 7fd1e6d9d700 1 --2- 172.21.15.103:0/3581629509 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1c8004a50 0x7fd1c8004ed0 secure :-1 s=THROTTLE_DONE pgs=623 cs=0 l=1 rx=0x7fd1e0001760 tx=0x7fd1e80b1e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:20.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.776+0000 7fd1e559a700 1 -- 172.21.15.103:0/3581629509 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1e0005de0 con 0x7fd1c8004a50 2020-04-22T14:07:20.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.776+0000 7fd1e6d9d700 1 --2- 172.21.15.103:0/3581629509 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1c8004a50 0x7fd1c8004ed0 secure :-1 s=THROTTLE_DONE pgs=623 cs=0 l=1 rx=0x7fd1e0001760 tx=0x7fd1e80b1e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:20.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.776+0000 7fd1e6d9d700 1 --2- 172.21.15.103:0/3581629509 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1c8004a50 0x7fd1c8004ed0 secure :-1 s=THROTTLE_DONE pgs=623 cs=0 l=1 rx=0x7fd1e0001760 tx=0x7fd1e80b1e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:20.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.776+0000 7fd1e559a700 1 -- 172.21.15.103:0/3581629509 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e0010180 con 0x7fd1c8004a50 2020-04-22T14:07:20.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.776+0000 7fd1e559a700 1 -- 172.21.15.103:0/3581629509 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1e00105a0 con 0x7fd1c8004a50 2020-04-22T14:07:20.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.776+0000 7fd1ec884700 1 -- 172.21.15.103:0/3581629509 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1c8004a50 msgr2=0x7fd1c8004ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:20.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.776+0000 7fd1ec884700 1 --2- 172.21.15.103:0/3581629509 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1c8004a50 0x7fd1c8004ed0 secure :-1 s=READY pgs=623 cs=0 l=1 rx=0x7fd1e0001760 tx=0x7fd1e80b1e70).stop 2020-04-22T14:07:20.792 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.776+0000 7fd1e6d9d700 1 -- 172.21.15.103:0/3581629509 reap_dead start 2020-04-22T14:07:20.792 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.776+0000 7fd1ec884700 1 -- 172.21.15.103:0/3581629509 shutdown_connections 2020-04-22T14:07:20.792 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.776+0000 7fd1ec884700 1 -- 172.21.15.103:0/3581629509 >> 172.21.15.103:0/3581629509 conn(0x7fd1e80b86b0 msgr2=0x7fd1e80b8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:20.792 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.776+0000 7fd1ec884700 1 -- 172.21.15.103:0/3581629509 shutdown_connections 2020-04-22T14:07:20.792 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.776+0000 7fd1ec884700 1 -- 172.21.15.103:0/3581629509 wait complete. 2020-04-22T14:07:20.792 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.777+0000 7fd1ec884700 1 Processor -- start 2020-04-22T14:07:20.792 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.777+0000 7fd1ec884700 1 -- start start 2020-04-22T14:07:20.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.778+0000 7fd1ec884700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd1e80ad430 0x7fd1e81419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:20.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.778+0000 7fd1ec884700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd1e8145520 0x7fd1e813c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:20.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.778+0000 7fd1ec884700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1e813ced0 con 0x7fd1e813ca40 2020-04-22T14:07:20.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.778+0000 7fd1ec884700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1e81459f0 con 0x7fd1e80ad430 2020-04-22T14:07:20.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.778+0000 7fd1ec884700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1e8145c90 con 0x7fd1e8145520 2020-04-22T14:07:20.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.778+0000 7fd1e5d9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd1e8145520 0x7fd1e813c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:20.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.778+0000 7fd1e6d9d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd1e813ca40 0x7fd1e8061630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42202/0 (socket says 172.21.15.103:42202) 2020-04-22T14:07:20.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.778+0000 7fd1e5d9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd1e8145520 0x7fd1e813c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50010/0 (socket says 172.21.15.103:50010) 2020-04-22T14:07:20.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.778+0000 7fd1e6d9d700 1 -- 172.21.15.103:0/1711767439 learned_addr learned my addr 172.21.15.103:0/1711767439 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:20.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.778+0000 7fd1e659c700 1 --2- 172.21.15.103:0/1711767439 >> v2:172.21.15.86:3300/0 conn(0x7fd1e80ad430 0x7fd1e81419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:20.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.778+0000 7fd1e5d9b700 1 -- 172.21.15.103:0/1711767439 >> v2:172.21.15.86:3300/0 conn(0x7fd1e80ad430 msgr2=0x7fd1e81419d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:20.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.778+0000 7fd1e5d9b700 1 --2- 172.21.15.103:0/1711767439 >> v2:172.21.15.86:3300/0 conn(0x7fd1e80ad430 0x7fd1e81419d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:20.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.778+0000 7fd1df7fe700 1 -- 172.21.15.103:0/1711767439 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 998474835 0 0) 0x7fd1e813ced0 con 0x7fd1e813ca40 2020-04-22T14:07:20.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.778+0000 7fd1e5d9b700 1 -- 172.21.15.103:0/1711767439 >> v1:172.21.15.103:6789/0 conn(0x7fd1e813ca40 legacy=0x7fd1e8061630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:20.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.778+0000 7fd1e5d9b700 1 -- 172.21.15.103:0/1711767439 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e8145f30 con 0x7fd1e8145520 2020-04-22T14:07:20.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.779+0000 7fd1e5d9b700 1 --2- 172.21.15.103:0/1711767439 >> v2:172.21.15.103:3300/0 conn(0x7fd1e8145520 0x7fd1e813c5e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd1d0002f30 tx=0x7fd1d00109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:20.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.779+0000 7fd1e5d9b700 1 --2- 172.21.15.103:0/1711767439 >> v2:172.21.15.103:3300/0 conn(0x7fd1e8145520 0x7fd1e813c5e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd1d0002f30 tx=0x7fd1d00109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:20.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.779+0000 7fd1e5d9b700 1 --2- 172.21.15.103:0/1711767439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1e8145520 0x7fd1e813c5e0 secure :-1 s=READY pgs=625 cs=0 l=1 rx=0x7fd1d0002f30 tx=0x7fd1d00109e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:20.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.779+0000 7fd1e5d9b700 1 --2- 172.21.15.103:0/1711767439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1e8145520 0x7fd1e813c5e0 secure :-1 s=THROTTLE_DONE pgs=625 cs=0 l=1 rx=0x7fd1d0002f30 tx=0x7fd1d00109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:20.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.779+0000 7fd1df7fe700 1 -- 172.21.15.103:0/1711767439 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1d0005e90 con 0x7fd1e8145520 2020-04-22T14:07:20.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.779+0000 7fd1e5d9b700 1 --2- 172.21.15.103:0/1711767439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1e8145520 0x7fd1e813c5e0 secure :-1 s=THROTTLE_DONE pgs=625 cs=0 l=1 rx=0x7fd1d0002f30 tx=0x7fd1d00109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:20.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.779+0000 7fd1e5d9b700 1 --2- 172.21.15.103:0/1711767439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1e8145520 0x7fd1e813c5e0 secure :-1 s=THROTTLE_DONE pgs=625 cs=0 l=1 rx=0x7fd1d0002f30 tx=0x7fd1d00109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:20.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.779+0000 7fd1df7fe700 1 -- 172.21.15.103:0/1711767439 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d0007180 con 0x7fd1e8145520 2020-04-22T14:07:20.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.779+0000 7fd1ec884700 1 -- 172.21.15.103:0/1711767439 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1e80ad810 con 0x7fd1e8145520 2020-04-22T14:07:20.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.779+0000 7fd1df7fe700 1 -- 172.21.15.103:0/1711767439 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1d0007520 con 0x7fd1e8145520 2020-04-22T14:07:20.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.779+0000 7fd1ec884700 1 -- 172.21.15.103:0/1711767439 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e8063e80 con 0x7fd1e8145520 2020-04-22T14:07:20.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.779+0000 7fd1e5d9b700 1 --2- 172.21.15.103:0/1711767439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1e8145520 0x7fd1e813c5e0 secure :-1 s=THROTTLE_DONE pgs=625 cs=0 l=1 rx=0x7fd1d0002f30 tx=0x7fd1d00109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:20.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.780+0000 7fd1df7fe700 1 -- 172.21.15.103:0/1711767439 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fd1d000b280 con 0x7fd1e8145520 2020-04-22T14:07:20.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.780+0000 7fd1e5d9b700 1 --2- 172.21.15.103:0/1711767439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1e8145520 0x7fd1e813c5e0 secure :-1 s=THROTTLE_DONE pgs=625 cs=0 l=1 rx=0x7fd1d0002f30 tx=0x7fd1d00109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:20.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.780+0000 7fd1ec884700 1 -- 172.21.15.103:0/1711767439 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1e80b5cd0 con 0x7fd1e8145520 2020-04-22T14:07:20.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.780+0000 7fd1df7fe700 1 --2- 172.21.15.103:0/1711767439 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd1cc04d870 0x7fd1cc04fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:20.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.780+0000 7fd1df7fe700 1 -- 172.21.15.103:0/1711767439 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd1d0061250 con 0x7fd1e8145520 2020-04-22T14:07:20.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.780+0000 7fd1e659c700 1 --2- 172.21.15.103:0/1711767439 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd1cc04d870 0x7fd1cc04fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:20.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.781+0000 7fd1e659c700 1 --2- 172.21.15.103:0/1711767439 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd1cc04d870 0x7fd1cc04fd30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd1e80b0db0 tx=0x7fd1d8003e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:20.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.781+0000 7fd1e659c700 1 --2- 172.21.15.103:0/1711767439 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd1cc04d870 0x7fd1cc04fd30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd1e80b0db0 tx=0x7fd1d8003e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:20.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.781+0000 7fd1e659c700 1 --2- 172.21.15.103:0/1711767439 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd1cc04d870 0x7fd1cc04fd30 secure :-1 s=READY pgs=240 cs=0 l=1 rx=0x7fd1e80b0db0 tx=0x7fd1d8003e70).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:20.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.784+0000 7fd1e5d9b700 1 --2- 172.21.15.103:0/1711767439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1e8145520 0x7fd1e813c5e0 secure :-1 s=THROTTLE_DONE pgs=625 cs=0 l=1 rx=0x7fd1d0002f30 tx=0x7fd1d00109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:20.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.784+0000 7fd1df7fe700 1 -- 172.21.15.103:0/1711767439 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fd1d003c5d0 con 0x7fd1e8145520 2020-04-22T14:07:20.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:20.974+0000 7fd1ec884700 1 -- 172.21.15.103:0/1711767439 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd1e8064160 con 0x7fd1e8145520 2020-04-22T14:07:21.486 INFO:tasks.ceph.mon.b.smithi086.stderr:2020-04-22T14:07:21.484+0000 7fbdbf880700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-04-22T14:07:21.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.490+0000 7fd1e5d9b700 1 --2- 172.21.15.103:0/1711767439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1e8145520 0x7fd1e813c5e0 secure :-1 s=THROTTLE_DONE pgs=625 cs=0 l=1 rx=0x7fd1d0002f30 tx=0x7fd1d00109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:21.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.490+0000 7fd1df7fe700 1 -- 172.21.15.103:0/1711767439 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v21) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd1e8064160 con 0x7fd1e8145520 2020-04-22T14:07:21.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.492+0000 7fd1ec884700 1 -- 172.21.15.103:0/1711767439 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd1cc04d870 msgr2=0x7fd1cc04fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:21.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.492+0000 7fd1ec884700 1 --2- 172.21.15.103:0/1711767439 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd1cc04d870 0x7fd1cc04fd30 secure :-1 s=READY pgs=240 cs=0 l=1 rx=0x7fd1e80b0db0 tx=0x7fd1d8003e70).stop 2020-04-22T14:07:21.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.492+0000 7fd1ec884700 1 -- 172.21.15.103:0/1711767439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1e8145520 msgr2=0x7fd1e813c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:21.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.492+0000 7fd1ec884700 1 --2- 172.21.15.103:0/1711767439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1e8145520 0x7fd1e813c5e0 secure :-1 s=READY pgs=625 cs=0 l=1 rx=0x7fd1d0002f30 tx=0x7fd1d00109e0).stop 2020-04-22T14:07:21.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.492+0000 7fd1ec884700 1 -- 172.21.15.103:0/1711767439 shutdown_connections 2020-04-22T14:07:21.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.492+0000 7fd1ec884700 1 --2- 172.21.15.103:0/1711767439 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd1cc04d870 0x7fd1cc04fd30 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:21.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.492+0000 7fd1ec884700 1 --2- 172.21.15.103:0/1711767439 >> v2:172.21.15.86:3300/0 conn(0x7fd1e80ad430 0x7fd1e81419d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:21.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.492+0000 7fd1ec884700 1 --2- 172.21.15.103:0/1711767439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1e8145520 0x7fd1e813c5e0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:21.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.492+0000 7fd1ec884700 1 -- 172.21.15.103:0/1711767439 >> 172.21.15.103:0/1711767439 conn(0x7fd1e80b86b0 msgr2=0x7fd1e813ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:21.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.492+0000 7fd1ec884700 1 -- 172.21.15.103:0/1711767439 shutdown_connections 2020-04-22T14:07:21.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.492+0000 7fd1ec884700 1 -- 172.21.15.103:0/1711767439 wait complete. 2020-04-22T14:07:21.496 INFO:teuthology.orchestra.run.smithi103.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2020-04-22T14:07:21.506 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:21.518 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2020-04-22T14:07:21.520 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:07:21.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.666+0000 7f70fd9b4700 1 Processor -- start 2020-04-22T14:07:21.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.666+0000 7f70fd9b4700 1 -- start start 2020-04-22T14:07:21.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.667+0000 7f70fd9b4700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f70f80ac740 0x7f70f80b5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:21.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.667+0000 7f70fd9b4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70f8064a10 0x7f70f81421f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:21.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.667+0000 7f70fd9b4700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70f80b51e0 con 0x7f70f81282c0 2020-04-22T14:07:21.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.667+0000 7f70fd9b4700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70f81286a0 con 0x7f70f80ac740 2020-04-22T14:07:21.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.667+0000 7f70fd9b4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f80b6020 con 0x7f70f8064a10 2020-04-22T14:07:21.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.667+0000 7f70f67fc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f70f80ac740 0x7f70f80b5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:21.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.667+0000 7f70f77fe700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70f8064a10 0x7f70f81421f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:21.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.667+0000 7f70f67fc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f70f80ac740 0x7f70f80b5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:47262/0 (socket says 172.21.15.103:47262) 2020-04-22T14:07:21.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.667+0000 7f70f67fc700 1 -- 172.21.15.103:0/2254131981 learned_addr learned my addr 172.21.15.103:0/2254131981 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:21.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.667+0000 7f70f6ffd700 1 --1- 172.21.15.103:0/2254131981 >> v1:172.21.15.86:6789/0 conn(0x7f70f81282c0 0x7f70f805b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:59374/0 (socket says 172.21.15.103:59374) 2020-04-22T14:07:21.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.668+0000 7f70f67fc700 1 -- 172.21.15.103:0/2254131981 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70f8064a10 msgr2=0x7f70f81421f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:21.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.668+0000 7f70f67fc700 1 --2- 172.21.15.103:0/2254131981 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70f8064a10 0x7f70f81421f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:21.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.668+0000 7f70f67fc700 1 -- 172.21.15.103:0/2254131981 >> v1:172.21.15.86:6789/0 conn(0x7f70f81282c0 legacy=0x7f70f805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:21.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.668+0000 7f70f67fc700 1 -- 172.21.15.103:0/2254131981 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f80b5480 con 0x7f70f80ac740 2020-04-22T14:07:21.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.668+0000 7f70f5ffb700 1 -- 172.21.15.103:0/2254131981 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 810423553 0 0) 0x7f70f80b51e0 con 0x7f70f81282c0 2020-04-22T14:07:21.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.668+0000 7f70f67fc700 1 --2- 172.21.15.103:0/2254131981 >> v2:172.21.15.86:3300/0 conn(0x7f70f80ac740 0x7f70f80b5bc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f70f8062b90 tx=0x7f70e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:21.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.668+0000 7f70f67fc700 1 --2- 172.21.15.103:0/2254131981 >> v2:172.21.15.86:3300/0 conn(0x7f70f80ac740 0x7f70f80b5bc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f70f8062b90 tx=0x7f70e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:21.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.668+0000 7f70f67fc700 1 --2- 172.21.15.103:0/2254131981 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70f80ac740 0x7f70f80b5bc0 secure :-1 s=READY pgs=356 cs=0 l=1 rx=0x7f70f8062b90 tx=0x7f70e80088e0).ready entity=mon.0 client_cookie=1020d414f6045f44 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:21.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.668+0000 7f70f67fc700 1 --2- 172.21.15.103:0/2254131981 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70f80ac740 0x7f70f80b5bc0 secure :-1 s=THROTTLE_DONE pgs=356 cs=0 l=1 rx=0x7f70f8062b90 tx=0x7f70e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:21.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.668+0000 7f70f5ffb700 1 -- 172.21.15.103:0/2254131981 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70e8011670 con 0x7f70f80ac740 2020-04-22T14:07:21.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.668+0000 7f70f67fc700 1 --2- 172.21.15.103:0/2254131981 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70f80ac740 0x7f70f80b5bc0 secure :-1 s=THROTTLE_DONE pgs=356 cs=0 l=1 rx=0x7f70f8062b90 tx=0x7f70e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:21.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.668+0000 7f70f5ffb700 1 -- 172.21.15.103:0/2254131981 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e8011810 con 0x7f70f80ac740 2020-04-22T14:07:21.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.668+0000 7f70f67fc700 1 --2- 172.21.15.103:0/2254131981 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70f80ac740 0x7f70f80b5bc0 secure :-1 s=THROTTLE_DONE pgs=356 cs=0 l=1 rx=0x7f70f8062b90 tx=0x7f70e80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:21.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.668+0000 7f70fd9b4700 1 -- 172.21.15.103:0/2254131981 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70f80ac740 msgr2=0x7f70f80b5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:21.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.668+0000 7f70fd9b4700 1 --2- 172.21.15.103:0/2254131981 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70f80ac740 0x7f70f80b5bc0 secure :-1 s=READY pgs=356 cs=0 l=1 rx=0x7f70f8062b90 tx=0x7f70e80088e0).stop 2020-04-22T14:07:21.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.668+0000 7f70f5ffb700 1 -- 172.21.15.103:0/2254131981 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70e8011bf0 con 0x7f70f80ac740 2020-04-22T14:07:21.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.669+0000 7f70fd9b4700 1 -- 172.21.15.103:0/2254131981 shutdown_connections 2020-04-22T14:07:21.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.669+0000 7f70fd9b4700 1 --2- 172.21.15.103:0/2254131981 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70f8064a10 0x7f70f81421f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:21.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.669+0000 7f70fd9b4700 1 --2- 172.21.15.103:0/2254131981 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70f80ac740 0x7f70f80b5bc0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:21.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.669+0000 7f70fd9b4700 1 -- 172.21.15.103:0/2254131981 >> 172.21.15.103:0/2254131981 conn(0x7f70f80b9160 msgr2=0x7f70f805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:21.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.669+0000 7f70fd9b4700 1 -- 172.21.15.103:0/2254131981 shutdown_connections 2020-04-22T14:07:21.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.669+0000 7f70fd9b4700 1 -- 172.21.15.103:0/2254131981 wait complete. 2020-04-22T14:07:21.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.670+0000 7f70fd9b4700 1 Processor -- start 2020-04-22T14:07:21.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.670+0000 7f70fd9b4700 1 -- start start 2020-04-22T14:07:21.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.670+0000 7f70fd9b4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70f8064a10 0x7f70f814f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:21.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.670+0000 7f70fd9b4700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f70f80ac740 0x7f70f8153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:21.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.670+0000 7f70fd9b4700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f70f81282c0 0x7f70f8144770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:21.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.670+0000 7f70fd9b4700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70f814fd00 con 0x7f70f80ac740 2020-04-22T14:07:21.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.670+0000 7f70fd9b4700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70f814ffa0 con 0x7f70f81282c0 2020-04-22T14:07:21.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.670+0000 7f70fd9b4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f8150240 con 0x7f70f8064a10 2020-04-22T14:07:21.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.670+0000 7f70f77fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f70f81282c0 0x7f70f8144770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:21.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.670+0000 7f70f77fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f70f81282c0 0x7f70f8144770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50038/0 (socket says 172.21.15.103:50038) 2020-04-22T14:07:21.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.670+0000 7f70f77fe700 1 -- 172.21.15.103:0/3139567362 learned_addr learned my addr 172.21.15.103:0/3139567362 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:21.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.670+0000 7f70f67fc700 1 --2- 172.21.15.103:0/3139567362 >> v2:172.21.15.86:3300/0 conn(0x7f70f80ac740 0x7f70f8153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:21.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.670+0000 7f70f6ffd700 1 --2- 172.21.15.103:0/3139567362 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70f8064a10 0x7f70f814f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:21.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.671+0000 7f70f77fe700 1 -- 172.21.15.103:0/3139567362 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70f8064a10 msgr2=0x7f70f814f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:21.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.671+0000 7f70f77fe700 1 --2- 172.21.15.103:0/3139567362 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70f8064a10 0x7f70f814f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:21.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.671+0000 7f70f77fe700 1 -- 172.21.15.103:0/3139567362 >> v2:172.21.15.86:3300/0 conn(0x7f70f80ac740 msgr2=0x7f70f8153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:21.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.671+0000 7f70f77fe700 1 --2- 172.21.15.103:0/3139567362 >> v2:172.21.15.86:3300/0 conn(0x7f70f80ac740 0x7f70f8153510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:21.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.671+0000 7f70f77fe700 1 -- 172.21.15.103:0/3139567362 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f8153970 con 0x7f70f81282c0 2020-04-22T14:07:21.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.671+0000 7f70f77fe700 1 --2- 172.21.15.103:0/3139567362 >> v2:172.21.15.103:3300/0 conn(0x7f70f81282c0 0x7f70f8144770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f70f00032b0 tx=0x7f70f0010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:21.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.671+0000 7f70f77fe700 1 --2- 172.21.15.103:0/3139567362 >> v2:172.21.15.103:3300/0 conn(0x7f70f81282c0 0x7f70f8144770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f70f00032b0 tx=0x7f70f0010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:21.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.671+0000 7f70f77fe700 1 --2- 172.21.15.103:0/3139567362 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70f81282c0 0x7f70f8144770 secure :-1 s=READY pgs=629 cs=0 l=1 rx=0x7f70f00032b0 tx=0x7f70f0010f30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:21.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.671+0000 7f70f77fe700 1 --2- 172.21.15.103:0/3139567362 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70f81282c0 0x7f70f8144770 secure :-1 s=THROTTLE_DONE pgs=629 cs=0 l=1 rx=0x7f70f00032b0 tx=0x7f70f0010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:21.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.671+0000 7f70e7fff700 1 -- 172.21.15.103:0/3139567362 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70f000e370 con 0x7f70f81282c0 2020-04-22T14:07:21.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.671+0000 7f70f77fe700 1 --2- 172.21.15.103:0/3139567362 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70f81282c0 0x7f70f8144770 secure :-1 s=THROTTLE_DONE pgs=629 cs=0 l=1 rx=0x7f70f00032b0 tx=0x7f70f0010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:21.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.671+0000 7f70e7fff700 1 -- 172.21.15.103:0/3139567362 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f0005c30 con 0x7f70f81282c0 2020-04-22T14:07:21.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.671+0000 7f70f77fe700 1 --2- 172.21.15.103:0/3139567362 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70f81282c0 0x7f70f8144770 secure :-1 s=THROTTLE_DONE pgs=629 cs=0 l=1 rx=0x7f70f00032b0 tx=0x7f70f0010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:21.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.671+0000 7f70fd9b4700 1 -- 172.21.15.103:0/3139567362 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f8153bc0 con 0x7f70f81282c0 2020-04-22T14:07:21.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.671+0000 7f70e7fff700 1 -- 172.21.15.103:0/3139567362 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70f0005e20 con 0x7f70f81282c0 2020-04-22T14:07:21.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.671+0000 7f70fd9b4700 1 -- 172.21.15.103:0/3139567362 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f8144e10 con 0x7f70f81282c0 2020-04-22T14:07:21.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.672+0000 7f70f77fe700 1 --2- 172.21.15.103:0/3139567362 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70f81282c0 0x7f70f8144770 secure :-1 s=THROTTLE_DONE pgs=629 cs=0 l=1 rx=0x7f70f00032b0 tx=0x7f70f0010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:21.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.672+0000 7f70e7fff700 1 -- 172.21.15.103:0/3139567362 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f70f0012b00 con 0x7f70f81282c0 2020-04-22T14:07:21.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.672+0000 7f70f77fe700 1 --2- 172.21.15.103:0/3139567362 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70f81282c0 0x7f70f8144770 secure :-1 s=THROTTLE_DONE pgs=629 cs=0 l=1 rx=0x7f70f00032b0 tx=0x7f70f0010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:21.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.672+0000 7f70fd9b4700 1 -- 172.21.15.103:0/3139567362 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70f814fb30 con 0x7f70f81282c0 2020-04-22T14:07:21.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.672+0000 7f70e7fff700 1 --2- 172.21.15.103:0/3139567362 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f70d404d9d0 0x7f70d404fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:21.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.672+0000 7f70e7fff700 1 -- 172.21.15.103:0/3139567362 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f70f0061120 con 0x7f70f81282c0 2020-04-22T14:07:21.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.672+0000 7f70f6ffd700 1 --2- 172.21.15.103:0/3139567362 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f70d404d9d0 0x7f70d404fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:21.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.673+0000 7f70f6ffd700 1 --2- 172.21.15.103:0/3139567362 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f70d404d9d0 0x7f70d404fe90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f70ec000b80 tx=0x7f70ec001940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:21.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.673+0000 7f70f6ffd700 1 --2- 172.21.15.103:0/3139567362 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f70d404d9d0 0x7f70d404fe90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f70ec000b80 tx=0x7f70ec001940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:21.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.673+0000 7f70f6ffd700 1 --2- 172.21.15.103:0/3139567362 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f70d404d9d0 0x7f70d404fe90 secure :-1 s=READY pgs=241 cs=0 l=1 rx=0x7f70ec000b80 tx=0x7f70ec001940).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:21.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.676+0000 7f70f77fe700 1 --2- 172.21.15.103:0/3139567362 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70f81282c0 0x7f70f8144770 secure :-1 s=THROTTLE_DONE pgs=629 cs=0 l=1 rx=0x7f70f00032b0 tx=0x7f70f0010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:21.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.676+0000 7f70e7fff700 1 -- 172.21.15.103:0/3139567362 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f70f003c5c0 con 0x7f70f81282c0 2020-04-22T14:07:21.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.864+0000 7f70fd9b4700 1 -- 172.21.15.103:0/3139567362 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70f8153b60 con 0x7f70f81282c0 2020-04-22T14:07:21.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.864+0000 7f70f77fe700 1 --2- 172.21.15.103:0/3139567362 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70f81282c0 0x7f70f8144770 secure :-1 s=THROTTLE_DONE pgs=629 cs=0 l=1 rx=0x7f70f00032b0 tx=0x7f70f0010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:21.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.864+0000 7f70e7fff700 1 -- 172.21.15.103:0/3139567362 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+1777 (secure 0 0 0) 0x7f70f003fbe0 con 0x7f70f81282c0 2020-04-22T14:07:21.867 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:07:21.867 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":21,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4748,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1859944899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1859944899},{"type":"v1","addr":"172.21.15.86:6835","nonce":1859944899}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":17}],"filesystems":[{"mdsmap":{"epoch":21,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:05:45.958513+0000","modified":"2020-04-22T14:07:21.485097+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2020-04-22T14:07:21.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.866+0000 7f70fd9b4700 1 -- 172.21.15.103:0/3139567362 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f70d404d9d0 msgr2=0x7f70d404fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:21.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.866+0000 7f70fd9b4700 1 --2- 172.21.15.103:0/3139567362 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f70d404d9d0 0x7f70d404fe90 secure :-1 s=READY pgs=241 cs=0 l=1 rx=0x7f70ec000b80 tx=0x7f70ec001940).stop 2020-04-22T14:07:21.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.866+0000 7f70fd9b4700 1 -- 172.21.15.103:0/3139567362 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70f81282c0 msgr2=0x7f70f8144770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:21.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.866+0000 7f70fd9b4700 1 --2- 172.21.15.103:0/3139567362 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70f81282c0 0x7f70f8144770 secure :-1 s=READY pgs=629 cs=0 l=1 rx=0x7f70f00032b0 tx=0x7f70f0010f30).stop 2020-04-22T14:07:21.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.866+0000 7f70fd9b4700 1 -- 172.21.15.103:0/3139567362 shutdown_connections 2020-04-22T14:07:21.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.866+0000 7f70fd9b4700 1 --2- 172.21.15.103:0/3139567362 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70f81282c0 0x7f70f8144770 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:21.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.866+0000 7f70fd9b4700 1 --2- 172.21.15.103:0/3139567362 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70f8064a10 0x7f70f814f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:21.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.866+0000 7f70fd9b4700 1 --2- 172.21.15.103:0/3139567362 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f70d404d9d0 0x7f70d404fe90 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:21.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.866+0000 7f70fd9b4700 1 --2- 172.21.15.103:0/3139567362 >> v2:172.21.15.86:3300/0 conn(0x7f70f80ac740 0x7f70f8153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:21.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.866+0000 7f70fd9b4700 1 -- 172.21.15.103:0/3139567362 >> 172.21.15.103:0/3139567362 conn(0x7f70f80b9160 msgr2=0x7f70f81425d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:21.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.866+0000 7f70fd9b4700 1 -- 172.21.15.103:0/3139567362 shutdown_connections 2020-04-22T14:07:21.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:21.866+0000 7f70fd9b4700 1 -- 172.21.15.103:0/3139567362 wait complete. 2020-04-22T14:07:21.870 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 21 2020-04-22T14:07:21.878 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:21.891 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-04-22T14:07:22.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.037+0000 7eff699d9700 1 Processor -- start 2020-04-22T14:07:22.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.037+0000 7eff699d9700 1 -- start start 2020-04-22T14:07:22.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.038+0000 7eff699d9700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff640b9140 0x7eff6412b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:22.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.038+0000 7eff699d9700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7eff6412b670 0x7eff64143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:22.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.038+0000 7eff699d9700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff641467e0 con 0x7eff640ac950 2020-04-22T14:07:22.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.038+0000 7eff699d9700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff640602f0 con 0x7eff6412b670 2020-04-22T14:07:22.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.038+0000 7eff699d9700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff64060050 con 0x7eff640b9140 2020-04-22T14:07:22.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.038+0000 7eff637fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7eff6412b670 0x7eff64143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:22.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.038+0000 7eff637fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7eff6412b670 0x7eff64143090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50042/0 (socket says 172.21.15.103:50042) 2020-04-22T14:07:22.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.038+0000 7eff637fe700 1 -- 172.21.15.103:0/2914268305 learned_addr learned my addr 172.21.15.103:0/2914268305 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:22.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.038+0000 7eff62ffd700 1 --2- 172.21.15.103:0/2914268305 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff640b9140 0x7eff6412b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:22.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.038+0000 7eff637fe700 1 -- 172.21.15.103:0/2914268305 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff640b9140 msgr2=0x7eff6412b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:22.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.038+0000 7eff637fe700 1 --2- 172.21.15.103:0/2914268305 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff640b9140 0x7eff6412b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:22.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.038+0000 7eff637fe700 1 -- 172.21.15.103:0/2914268305 >> v1:172.21.15.86:6789/0 conn(0x7eff640ac950 legacy=0x7eff64146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:22.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.038+0000 7eff637fe700 1 -- 172.21.15.103:0/2914268305 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff640b9520 con 0x7eff6412b670 2020-04-22T14:07:22.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.038+0000 7eff62ffd700 1 --2- 172.21.15.103:0/2914268305 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff640b9140 0x7eff6412b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:07:22.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.039+0000 7eff637fe700 1 --2- 172.21.15.103:0/2914268305 >> v2:172.21.15.103:3300/0 conn(0x7eff6412b670 0x7eff64143090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7eff5c0032b0 tx=0x7eff5c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:22.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.039+0000 7eff637fe700 1 --2- 172.21.15.103:0/2914268305 >> v2:172.21.15.103:3300/0 conn(0x7eff6412b670 0x7eff64143090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7eff5c0032b0 tx=0x7eff5c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:22.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.039+0000 7eff637fe700 1 --2- 172.21.15.103:0/2914268305 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff6412b670 0x7eff64143090 secure :-1 s=READY pgs=630 cs=0 l=1 rx=0x7eff5c0032b0 tx=0x7eff5c007dc0).ready entity=mon.1 client_cookie=8b92d080f924a300 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:22.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.039+0000 7eff637fe700 1 --2- 172.21.15.103:0/2914268305 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff6412b670 0x7eff64143090 secure :-1 s=THROTTLE_DONE pgs=630 cs=0 l=1 rx=0x7eff5c0032b0 tx=0x7eff5c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:22.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.039+0000 7eff61ffb700 1 -- 172.21.15.103:0/2914268305 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff5c00a180 con 0x7eff6412b670 2020-04-22T14:07:22.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.039+0000 7eff637fe700 1 --2- 172.21.15.103:0/2914268305 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff6412b670 0x7eff64143090 secure :-1 s=THROTTLE_DONE pgs=630 cs=0 l=1 rx=0x7eff5c0032b0 tx=0x7eff5c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:22.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.039+0000 7eff637fe700 1 --2- 172.21.15.103:0/2914268305 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff6412b670 0x7eff64143090 secure :-1 s=THROTTLE_DONE pgs=630 cs=0 l=1 rx=0x7eff5c0032b0 tx=0x7eff5c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:22.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.039+0000 7eff61ffb700 1 -- 172.21.15.103:0/2914268305 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5c00a320 con 0x7eff6412b670 2020-04-22T14:07:22.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.039+0000 7eff699d9700 1 -- 172.21.15.103:0/2914268305 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff6412b670 msgr2=0x7eff64143090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:22.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.039+0000 7eff61ffb700 1 -- 172.21.15.103:0/2914268305 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff5c00a740 con 0x7eff6412b670 2020-04-22T14:07:22.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.039+0000 7eff699d9700 1 --2- 172.21.15.103:0/2914268305 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff6412b670 0x7eff64143090 secure :-1 s=READY pgs=630 cs=0 l=1 rx=0x7eff5c0032b0 tx=0x7eff5c007dc0).stop 2020-04-22T14:07:22.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.039+0000 7eff699d9700 1 -- 172.21.15.103:0/2914268305 shutdown_connections 2020-04-22T14:07:22.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.039+0000 7eff699d9700 1 --2- 172.21.15.103:0/2914268305 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff6412b670 0x7eff64143090 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:22.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.039+0000 7eff699d9700 1 --2- 172.21.15.103:0/2914268305 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff640b9140 0x7eff6412b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:22.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.039+0000 7eff699d9700 1 -- 172.21.15.103:0/2914268305 >> 172.21.15.103:0/2914268305 conn(0x7eff6405b7b0 msgr2=0x7eff640b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:22.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.039+0000 7eff699d9700 1 -- 172.21.15.103:0/2914268305 shutdown_connections 2020-04-22T14:07:22.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.039+0000 7eff699d9700 1 -- 172.21.15.103:0/2914268305 wait complete. 2020-04-22T14:07:22.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.040+0000 7eff699d9700 1 Processor -- start 2020-04-22T14:07:22.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.040+0000 7eff699d9700 1 -- start start 2020-04-22T14:07:22.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.041+0000 7eff699d9700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7eff640b9140 0x7eff640b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:22.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.041+0000 7eff699d9700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff64066390 con 0x7eff6412b670 2020-04-22T14:07:22.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.041+0000 7eff699d9700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff640b2540 con 0x7eff640ac950 2020-04-22T14:07:22.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.041+0000 7eff699d9700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff640b5fc0 con 0x7eff640b9140 2020-04-22T14:07:22.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.041+0000 7eff62ffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7eff640ac950 0x7eff640634a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42236/0 (socket says 172.21.15.103:42236) 2020-04-22T14:07:22.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.041+0000 7eff62ffd700 1 -- 172.21.15.103:0/2685728561 learned_addr learned my addr 172.21.15.103:0/2685728561 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:22.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.041+0000 7eff53fff700 1 -- 172.21.15.103:0/2685728561 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2450114702 0 0) 0x7eff58007d60 con 0x7eff640ac950 2020-04-22T14:07:22.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.041+0000 7eff53fff700 1 -- 172.21.15.103:0/2685728561 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff40002fe0 con 0x7eff640ac950 2020-04-22T14:07:22.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.041+0000 7eff627fc700 1 --2- 172.21.15.103:0/2685728561 >> v2:172.21.15.86:3300/0 conn(0x7eff640b9140 0x7eff640b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:22.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.042+0000 7eff53fff700 1 -- 172.21.15.103:0/2685728561 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2857956848 0 0) 0x7eff64066390 con 0x7eff6412b670 2020-04-22T14:07:22.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.042+0000 7eff53fff700 1 -- 172.21.15.103:0/2685728561 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff58007d60 con 0x7eff6412b670 2020-04-22T14:07:22.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.042+0000 7eff53fff700 1 -- 172.21.15.103:0/2685728561 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3021108841 0 0) 0x7eff40002fe0 con 0x7eff640ac950 2020-04-22T14:07:22.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.042+0000 7eff53fff700 1 -- 172.21.15.103:0/2685728561 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7eff64066390 con 0x7eff640ac950 2020-04-22T14:07:22.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.042+0000 7eff53fff700 1 -- 172.21.15.103:0/2685728561 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7eff580085b0 con 0x7eff640ac950 2020-04-22T14:07:22.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.042+0000 7eff53fff700 1 -- 172.21.15.103:0/2685728561 >> v2:172.21.15.86:3300/0 conn(0x7eff640b9140 msgr2=0x7eff640b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:22.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.042+0000 7eff53fff700 1 --2- 172.21.15.103:0/2685728561 >> v2:172.21.15.86:3300/0 conn(0x7eff640b9140 0x7eff640b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:22.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.042+0000 7eff53fff700 1 -- 172.21.15.103:0/2685728561 >> v1:172.21.15.103:6789/0 conn(0x7eff640ac950 legacy=0x7eff640634a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:22.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.042+0000 7eff53fff700 1 -- 172.21.15.103:0/2685728561 >> v1:172.21.15.86:6789/0 conn(0x7eff6412b670 legacy=0x7eff641431f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:22.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.042+0000 7eff53fff700 1 --2- 172.21.15.103:0/2685728561 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff40004b20 0x7eff40004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:22.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.042+0000 7eff53fff700 1 --2- 172.21.15.103:0/2685728561 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff40003ab0 0x7eff40003f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:22.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.042+0000 7eff53fff700 1 --2- 172.21.15.103:0/2685728561 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff40004370 0x7eff4000fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:22.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.042+0000 7eff53fff700 1 -- 172.21.15.103:0/2685728561 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff640b5fc0 con 0x7eff40004370 2020-04-22T14:07:22.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.042+0000 7eff53fff700 1 -- 172.21.15.103:0/2685728561 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4000ffc0 con 0x7eff40004b20 2020-04-22T14:07:22.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.042+0000 7eff53fff700 1 -- 172.21.15.103:0/2685728561 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff40010100 con 0x7eff40003ab0 2020-04-22T14:07:22.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.042+0000 7eff62ffd700 1 --2- 172.21.15.103:0/2685728561 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff40004b20 0x7eff40004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:22.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.042+0000 7eff637fe700 1 --2- 172.21.15.103:0/2685728561 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff40004370 0x7eff4000fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:22.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.042+0000 7eff62ffd700 1 -- 172.21.15.103:0/2685728561 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff40003ab0 msgr2=0x7eff40003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:22.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.042+0000 7eff62ffd700 1 --2- 172.21.15.103:0/2685728561 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff40003ab0 0x7eff40003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:22.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.042+0000 7eff62ffd700 1 -- 172.21.15.103:0/2685728561 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff40004370 msgr2=0x7eff4000fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:22.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.042+0000 7eff62ffd700 1 --2- 172.21.15.103:0/2685728561 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff40004370 0x7eff4000fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:22.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.042+0000 7eff62ffd700 1 -- 172.21.15.103:0/2685728561 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff64155b50 con 0x7eff40004b20 2020-04-22T14:07:22.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.042+0000 7eff637fe700 1 -- 172.21.15.103:0/2685728561 reap_dead start 2020-04-22T14:07:22.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.043+0000 7eff62ffd700 1 --2- 172.21.15.103:0/2685728561 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff40004b20 0x7eff40004f40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7eff58008380 tx=0x7eff40004a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:22.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.043+0000 7eff699d9700 1 -- 172.21.15.103:0/2685728561 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff64066620 con 0x7eff40004b20 2020-04-22T14:07:22.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.043+0000 7eff699d9700 1 -- 172.21.15.103:0/2685728561 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff64065000 con 0x7eff40004b20 2020-04-22T14:07:22.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.043+0000 7eff62ffd700 1 --2- 172.21.15.103:0/2685728561 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff40004b20 0x7eff40004f40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7eff58008380 tx=0x7eff40004a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:22.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.043+0000 7eff62ffd700 1 --2- 172.21.15.103:0/2685728561 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff40004b20 0x7eff40004f40 secure :-1 s=READY pgs=632 cs=0 l=1 rx=0x7eff58008380 tx=0x7eff40004a60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:22.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.043+0000 7eff62ffd700 1 --2- 172.21.15.103:0/2685728561 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff40004b20 0x7eff40004f40 secure :-1 s=THROTTLE_DONE pgs=632 cs=0 l=1 rx=0x7eff58008380 tx=0x7eff40004a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:22.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.043+0000 7eff62ffd700 1 --2- 172.21.15.103:0/2685728561 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff40004b20 0x7eff40004f40 secure :-1 s=THROTTLE_DONE pgs=632 cs=0 l=1 rx=0x7eff58008380 tx=0x7eff40004a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:22.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.043+0000 7eff62ffd700 1 --2- 172.21.15.103:0/2685728561 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff40004b20 0x7eff40004f40 secure :-1 s=THROTTLE_DONE pgs=632 cs=0 l=1 rx=0x7eff58008380 tx=0x7eff40004a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:22.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.043+0000 7eff53fff700 1 -- 172.21.15.103:0/2685728561 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff58007180 con 0x7eff40004b20 2020-04-22T14:07:22.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.043+0000 7eff53fff700 1 -- 172.21.15.103:0/2685728561 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff580072e0 con 0x7eff40004b20 2020-04-22T14:07:22.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.043+0000 7eff53fff700 1 -- 172.21.15.103:0/2685728561 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff58008a50 con 0x7eff40004b20 2020-04-22T14:07:22.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.043+0000 7eff62ffd700 1 --2- 172.21.15.103:0/2685728561 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff40004b20 0x7eff40004f40 secure :-1 s=THROTTLE_DONE pgs=632 cs=0 l=1 rx=0x7eff58008380 tx=0x7eff40004a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:22.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.044+0000 7eff699d9700 1 -- 172.21.15.103:0/2685728561 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff44003340 con 0x7eff40004b20 2020-04-22T14:07:22.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.044+0000 7eff53fff700 1 -- 172.21.15.103:0/2685728561 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7eff58008bb0 con 0x7eff40004b20 2020-04-22T14:07:22.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.044+0000 7eff62ffd700 1 --2- 172.21.15.103:0/2685728561 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff40004b20 0x7eff40004f40 secure :-1 s=THROTTLE_DONE pgs=632 cs=0 l=1 rx=0x7eff58008380 tx=0x7eff40004a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:22.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.044+0000 7eff53fff700 1 --2- 172.21.15.103:0/2685728561 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7eff40055ec0 0x7eff40058380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:22.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.044+0000 7eff53fff700 1 -- 172.21.15.103:0/2685728561 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6159+0+0 (secure 0 0 0) 0x7eff58061be0 con 0x7eff40004b20 2020-04-22T14:07:22.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.044+0000 7eff627fc700 1 --2- 172.21.15.103:0/2685728561 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7eff40055ec0 0x7eff40058380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:22.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.045+0000 7eff627fc700 1 --2- 172.21.15.103:0/2685728561 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7eff40055ec0 0x7eff40058380 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7eff64060f70 tx=0x7eff54001410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:22.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.045+0000 7eff627fc700 1 --2- 172.21.15.103:0/2685728561 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7eff40055ec0 0x7eff40058380 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7eff64060f70 tx=0x7eff54001410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:22.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.045+0000 7eff627fc700 1 --2- 172.21.15.103:0/2685728561 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7eff40055ec0 0x7eff40058380 secure :-1 s=READY pgs=242 cs=0 l=1 rx=0x7eff64060f70 tx=0x7eff54001410).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:22.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.048+0000 7eff62ffd700 1 --2- 172.21.15.103:0/2685728561 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff40004b20 0x7eff40004f40 secure :-1 s=THROTTLE_DONE pgs=632 cs=0 l=1 rx=0x7eff58008380 tx=0x7eff40004a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:22.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.048+0000 7eff53fff700 1 -- 172.21.15.103:0/2685728561 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7eff5803d040 con 0x7eff40004b20 2020-04-22T14:07:22.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.240+0000 7eff699d9700 1 -- 172.21.15.103:0/2685728561 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7eff44002200 con 0x7eff40004b20 2020-04-22T14:07:22.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.495+0000 7eff62ffd700 1 --2- 172.21.15.103:0/2685728561 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff40004b20 0x7eff40004f40 secure :-1 s=THROTTLE_DONE pgs=632 cs=0 l=1 rx=0x7eff58008380 tx=0x7eff40004a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:22.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.495+0000 7eff53fff700 1 -- 172.21.15.103:0/2685728561 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v22) v1 ==== 104+0+0 (secure 0 0 0) 0x7eff58040660 con 0x7eff40004b20 2020-04-22T14:07:22.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.497+0000 7eff699d9700 1 -- 172.21.15.103:0/2685728561 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7eff40055ec0 msgr2=0x7eff40058380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:22.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.497+0000 7eff699d9700 1 --2- 172.21.15.103:0/2685728561 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7eff40055ec0 0x7eff40058380 secure :-1 s=READY pgs=242 cs=0 l=1 rx=0x7eff64060f70 tx=0x7eff54001410).stop 2020-04-22T14:07:22.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.497+0000 7eff699d9700 1 -- 172.21.15.103:0/2685728561 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff40004b20 msgr2=0x7eff40004f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:22.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.497+0000 7eff699d9700 1 --2- 172.21.15.103:0/2685728561 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff40004b20 0x7eff40004f40 secure :-1 s=READY pgs=632 cs=0 l=1 rx=0x7eff58008380 tx=0x7eff40004a60).stop 2020-04-22T14:07:22.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.497+0000 7eff699d9700 1 -- 172.21.15.103:0/2685728561 shutdown_connections 2020-04-22T14:07:22.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.497+0000 7eff699d9700 1 --2- 172.21.15.103:0/2685728561 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7eff40055ec0 0x7eff40058380 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:22.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.497+0000 7eff699d9700 1 --2- 172.21.15.103:0/2685728561 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff40004b20 0x7eff40004f40 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:22.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.497+0000 7eff699d9700 1 -- 172.21.15.103:0/2685728561 >> 172.21.15.103:0/2685728561 conn(0x7eff6405b7b0 msgr2=0x7eff64128d90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:22.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.497+0000 7eff699d9700 1 -- 172.21.15.103:0/2685728561 shutdown_connections 2020-04-22T14:07:22.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.497+0000 7eff699d9700 1 -- 172.21.15.103:0/2685728561 wait complete. 2020-04-22T14:07:22.509 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:22.523 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-04-22T14:07:22.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.670+0000 7f2685535700 1 Processor -- start 2020-04-22T14:07:22.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.670+0000 7f2685535700 1 -- start start 2020-04-22T14:07:22.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.671+0000 7f2685535700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f26800b9140 0x7f268012b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:22.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.671+0000 7f2685535700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f268012b670 0x7f2680143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:22.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.671+0000 7f2685535700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26801467e0 con 0x7f26800ac950 2020-04-22T14:07:22.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.671+0000 7f2685535700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26800602f0 con 0x7f26800b9140 2020-04-22T14:07:22.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.671+0000 7f2685535700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2680060050 con 0x7f268012b670 2020-04-22T14:07:22.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.671+0000 7f267effd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f26800b9140 0x7f268012b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:22.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.671+0000 7f267e7fc700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f26800ac950 0x7f2680146c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42250/0 (socket says 172.21.15.103:42250) 2020-04-22T14:07:22.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.671+0000 7f267effd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f26800b9140 0x7f268012b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50060/0 (socket says 172.21.15.103:50060) 2020-04-22T14:07:22.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.671+0000 7f267e7fc700 1 -- 172.21.15.103:0/3978903494 learned_addr learned my addr 172.21.15.103:0/3978903494 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:22.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.671+0000 7f267f7fe700 1 --2- 172.21.15.103:0/3978903494 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f268012b670 0x7f2680143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:22.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.672+0000 7f267effd700 1 -- 172.21.15.103:0/3978903494 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f268012b670 msgr2=0x7f2680143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:22.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.672+0000 7f267effd700 1 --2- 172.21.15.103:0/3978903494 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f268012b670 0x7f2680143090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:22.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.672+0000 7f267effd700 1 -- 172.21.15.103:0/3978903494 >> v1:172.21.15.103:6789/0 conn(0x7f26800ac950 legacy=0x7f2680146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:22.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.672+0000 7f267effd700 1 -- 172.21.15.103:0/3978903494 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26800b9520 con 0x7f26800b9140 2020-04-22T14:07:22.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.672+0000 7f267dffb700 1 -- 172.21.15.103:0/3978903494 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2682599937 0 0) 0x7f26801467e0 con 0x7f26800ac950 2020-04-22T14:07:22.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.672+0000 7f267effd700 1 --2- 172.21.15.103:0/3978903494 >> v2:172.21.15.103:3300/0 conn(0x7f26800b9140 0x7f268012b210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2668002f30 tx=0x7f2668007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:22.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.672+0000 7f267effd700 1 --2- 172.21.15.103:0/3978903494 >> v2:172.21.15.103:3300/0 conn(0x7f26800b9140 0x7f268012b210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2668002f30 tx=0x7f2668007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:22.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.672+0000 7f267effd700 1 --2- 172.21.15.103:0/3978903494 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26800b9140 0x7f268012b210 secure :-1 s=READY pgs=634 cs=0 l=1 rx=0x7f2668002f30 tx=0x7f2668007a40).ready entity=mon.1 client_cookie=c55bc4b98235250d server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:22.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.672+0000 7f267effd700 1 --2- 172.21.15.103:0/3978903494 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26800b9140 0x7f268012b210 secure :-1 s=THROTTLE_DONE pgs=634 cs=0 l=1 rx=0x7f2668002f30 tx=0x7f2668007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:22.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.672+0000 7f267dffb700 1 -- 172.21.15.103:0/3978903494 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2668011470 con 0x7f26800b9140 2020-04-22T14:07:22.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.672+0000 7f267effd700 1 --2- 172.21.15.103:0/3978903494 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26800b9140 0x7f268012b210 secure :-1 s=THROTTLE_DONE pgs=634 cs=0 l=1 rx=0x7f2668002f30 tx=0x7f2668007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:22.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.672+0000 7f267dffb700 1 -- 172.21.15.103:0/3978903494 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2668011610 con 0x7f26800b9140 2020-04-22T14:07:22.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.672+0000 7f267effd700 1 --2- 172.21.15.103:0/3978903494 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26800b9140 0x7f268012b210 secure :-1 s=THROTTLE_DONE pgs=634 cs=0 l=1 rx=0x7f2668002f30 tx=0x7f2668007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:22.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.672+0000 7f267dffb700 1 -- 172.21.15.103:0/3978903494 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26680119f0 con 0x7f26800b9140 2020-04-22T14:07:22.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.672+0000 7f2685535700 1 -- 172.21.15.103:0/3978903494 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26800b9140 msgr2=0x7f268012b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:22.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.672+0000 7f2685535700 1 --2- 172.21.15.103:0/3978903494 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26800b9140 0x7f268012b210 secure :-1 s=READY pgs=634 cs=0 l=1 rx=0x7f2668002f30 tx=0x7f2668007a40).stop 2020-04-22T14:07:22.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.672+0000 7f2685535700 1 -- 172.21.15.103:0/3978903494 shutdown_connections 2020-04-22T14:07:22.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.672+0000 7f2685535700 1 --2- 172.21.15.103:0/3978903494 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f268012b670 0x7f2680143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:22.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.672+0000 7f2685535700 1 --2- 172.21.15.103:0/3978903494 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26800b9140 0x7f268012b210 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:22.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.672+0000 7f2685535700 1 -- 172.21.15.103:0/3978903494 >> 172.21.15.103:0/3978903494 conn(0x7f268005b7b0 msgr2=0x7f26800b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:22.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.672+0000 7f2685535700 1 -- 172.21.15.103:0/3978903494 shutdown_connections 2020-04-22T14:07:22.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.673+0000 7f2685535700 1 -- 172.21.15.103:0/3978903494 wait complete. 2020-04-22T14:07:22.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.673+0000 7f2685535700 1 Processor -- start 2020-04-22T14:07:22.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.673+0000 7f2685535700 1 -- start start 2020-04-22T14:07:22.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.674+0000 7f2685535700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f26800b9140 0x7f26800637a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:22.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.674+0000 7f2685535700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f268012b670 0x7f2680062a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:22.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.674+0000 7f2685535700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2680065c00 con 0x7f26800ac950 2020-04-22T14:07:22.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.674+0000 7f2685535700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26800634d0 con 0x7f26800b9140 2020-04-22T14:07:22.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.674+0000 7f2685535700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2680065ea0 con 0x7f268012b670 2020-04-22T14:07:22.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.674+0000 7f267e7fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f26800b9140 0x7f26800637a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:22.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.674+0000 7f267effd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f26800ac950 0x7f2680127e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42254/0 (socket says 172.21.15.103:42254) 2020-04-22T14:07:22.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.674+0000 7f267effd700 1 -- 172.21.15.103:0/1781779900 learned_addr learned my addr 172.21.15.103:0/1781779900 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:22.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.674+0000 7f267e7fc700 1 -- 172.21.15.103:0/1781779900 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f268012b670 msgr2=0x7f2680062a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:22.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.674+0000 7f267e7fc700 1 --2- 172.21.15.103:0/1781779900 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f268012b670 0x7f2680062a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:22.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.674+0000 7f267e7fc700 1 -- 172.21.15.103:0/1781779900 >> v1:172.21.15.103:6789/0 conn(0x7f26800ac950 legacy=0x7f2680127e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:22.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.674+0000 7f2677fff700 1 -- 172.21.15.103:0/1781779900 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1731709177 0 0) 0x7f2680065c00 con 0x7f26800ac950 2020-04-22T14:07:22.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.674+0000 7f267e7fc700 1 -- 172.21.15.103:0/1781779900 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2680066140 con 0x7f26800b9140 2020-04-22T14:07:22.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.675+0000 7f267e7fc700 1 --2- 172.21.15.103:0/1781779900 >> v2:172.21.15.103:3300/0 conn(0x7f26800b9140 0x7f26800637a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2670000b80 tx=0x7f2670010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:22.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.675+0000 7f267e7fc700 1 --2- 172.21.15.103:0/1781779900 >> v2:172.21.15.103:3300/0 conn(0x7f26800b9140 0x7f26800637a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2670000b80 tx=0x7f2670010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:22.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.675+0000 7f267e7fc700 1 --2- 172.21.15.103:0/1781779900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26800b9140 0x7f26800637a0 secure :-1 s=READY pgs=636 cs=0 l=1 rx=0x7f2670000b80 tx=0x7f2670010970).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:22.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.675+0000 7f267e7fc700 1 --2- 172.21.15.103:0/1781779900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26800b9140 0x7f26800637a0 secure :-1 s=THROTTLE_DONE pgs=636 cs=0 l=1 rx=0x7f2670000b80 tx=0x7f2670010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:22.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.675+0000 7f2677fff700 1 -- 172.21.15.103:0/1781779900 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2670005d40 con 0x7f26800b9140 2020-04-22T14:07:22.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.675+0000 7f267e7fc700 1 --2- 172.21.15.103:0/1781779900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26800b9140 0x7f26800637a0 secure :-1 s=THROTTLE_DONE pgs=636 cs=0 l=1 rx=0x7f2670000b80 tx=0x7f2670010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:22.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.675+0000 7f2677fff700 1 -- 172.21.15.103:0/1781779900 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26700060d0 con 0x7f26800b9140 2020-04-22T14:07:22.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.675+0000 7f267e7fc700 1 --2- 172.21.15.103:0/1781779900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26800b9140 0x7f26800637a0 secure :-1 s=THROTTLE_DONE pgs=636 cs=0 l=1 rx=0x7f2670000b80 tx=0x7f2670010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:22.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.675+0000 7f2685535700 1 -- 172.21.15.103:0/1781779900 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2680128520 con 0x7f26800b9140 2020-04-22T14:07:22.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.675+0000 7f2677fff700 1 -- 172.21.15.103:0/1781779900 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2670005ea0 con 0x7f26800b9140 2020-04-22T14:07:22.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.675+0000 7f2685535700 1 -- 172.21.15.103:0/1781779900 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26800b1800 con 0x7f26800b9140 2020-04-22T14:07:22.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.675+0000 7f267e7fc700 1 --2- 172.21.15.103:0/1781779900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26800b9140 0x7f26800637a0 secure :-1 s=THROTTLE_DONE pgs=636 cs=0 l=1 rx=0x7f2670000b80 tx=0x7f2670010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:22.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.676+0000 7f2685535700 1 -- 172.21.15.103:0/1781779900 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2680065a40 con 0x7f26800b9140 2020-04-22T14:07:22.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.676+0000 7f2677fff700 1 -- 172.21.15.103:0/1781779900 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f26700064b0 con 0x7f26800b9140 2020-04-22T14:07:22.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.676+0000 7f267e7fc700 1 --2- 172.21.15.103:0/1781779900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26800b9140 0x7f26800637a0 secure :-1 s=THROTTLE_DONE pgs=636 cs=0 l=1 rx=0x7f2670000b80 tx=0x7f2670010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:22.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.676+0000 7f2677fff700 1 --2- 172.21.15.103:0/1781779900 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f266404d7e0 0x7f266404fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:22.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.676+0000 7f2677fff700 1 -- 172.21.15.103:0/1781779900 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f26700090c0 con 0x7f26800b9140 2020-04-22T14:07:22.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.677+0000 7f267effd700 1 --2- 172.21.15.103:0/1781779900 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f266404d7e0 0x7f266404fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:22.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.677+0000 7f267effd700 1 --2- 172.21.15.103:0/1781779900 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f266404d7e0 0x7f266404fca0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f26680082e0 tx=0x7f2668007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:22.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.677+0000 7f267effd700 1 --2- 172.21.15.103:0/1781779900 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f266404d7e0 0x7f266404fca0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f26680082e0 tx=0x7f2668007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:22.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.677+0000 7f267effd700 1 --2- 172.21.15.103:0/1781779900 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f266404d7e0 0x7f266404fca0 secure :-1 s=READY pgs=243 cs=0 l=1 rx=0x7f26680082e0 tx=0x7f2668007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:22.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.680+0000 7f267e7fc700 1 --2- 172.21.15.103:0/1781779900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26800b9140 0x7f26800637a0 secure :-1 s=THROTTLE_DONE pgs=636 cs=0 l=1 rx=0x7f2670000b80 tx=0x7f2670010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:22.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.680+0000 7f2677fff700 1 -- 172.21.15.103:0/1781779900 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f267003c8c0 con 0x7f26800b9140 2020-04-22T14:07:22.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:22.822+0000 7f2685535700 1 -- 172.21.15.103:0/1781779900 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2680056c90 con 0x7f26800b9140 2020-04-22T14:07:23.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.499+0000 7f267e7fc700 1 --2- 172.21.15.103:0/1781779900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26800b9140 0x7f26800637a0 secure :-1 s=THROTTLE_DONE pgs=636 cs=0 l=1 rx=0x7f2670000b80 tx=0x7f2670010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:23.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.499+0000 7f2677fff700 1 -- 172.21.15.103:0/1781779900 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v47) v1 ==== 185+0+0 (secure 0 0 0) 0x7f267003fee0 con 0x7f26800b9140 2020-04-22T14:07:23.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.500+0000 7f2685535700 1 -- 172.21.15.103:0/1781779900 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f266404d7e0 msgr2=0x7f266404fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:23.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.500+0000 7f2685535700 1 --2- 172.21.15.103:0/1781779900 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f266404d7e0 0x7f266404fca0 secure :-1 s=READY pgs=243 cs=0 l=1 rx=0x7f26680082e0 tx=0x7f2668007a40).stop 2020-04-22T14:07:23.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.500+0000 7f2685535700 1 -- 172.21.15.103:0/1781779900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26800b9140 msgr2=0x7f26800637a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:23.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.500+0000 7f2685535700 1 --2- 172.21.15.103:0/1781779900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26800b9140 0x7f26800637a0 secure :-1 s=READY pgs=636 cs=0 l=1 rx=0x7f2670000b80 tx=0x7f2670010970).stop 2020-04-22T14:07:23.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.501+0000 7f2685535700 1 -- 172.21.15.103:0/1781779900 shutdown_connections 2020-04-22T14:07:23.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.501+0000 7f2685535700 1 --2- 172.21.15.103:0/1781779900 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f266404d7e0 0x7f266404fca0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:23.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.501+0000 7f2685535700 1 --2- 172.21.15.103:0/1781779900 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f268012b670 0x7f2680062a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:23.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.501+0000 7f2685535700 1 --2- 172.21.15.103:0/1781779900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26800b9140 0x7f26800637a0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:23.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.501+0000 7f2685535700 1 -- 172.21.15.103:0/1781779900 >> 172.21.15.103:0/1781779900 conn(0x7f268005b7b0 msgr2=0x7f2680129fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:23.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.501+0000 7f2685535700 1 -- 172.21.15.103:0/1781779900 shutdown_connections 2020-04-22T14:07:23.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.501+0000 7f2685535700 1 -- 172.21.15.103:0/1781779900 wait complete. 2020-04-22T14:07:23.505 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' removed 2020-04-22T14:07:23.515 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:23.529 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2020-04-22T14:07:23.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.681+0000 7f470ef7d700 1 Processor -- start 2020-04-22T14:07:23.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.682+0000 7f470ef7d700 1 -- start start 2020-04-22T14:07:23.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.682+0000 7f470ef7d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f47080b9140 0x7f47080aed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:23.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.682+0000 7f470ef7d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f47080b3bd0 0x7f47080af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:23.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.682+0000 7f470ef7d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4708148310 con 0x7f47080616b0 2020-04-22T14:07:23.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.682+0000 7f470ef7d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47080af650 con 0x7f47080b9140 2020-04-22T14:07:23.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.682+0000 7f470ef7d700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47081485b0 con 0x7f47080b3bd0 2020-04-22T14:07:23.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.682+0000 7f4707fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f47080b3bd0 0x7f47080af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:23.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.682+0000 7f4707fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f47080b3bd0 0x7f47080af1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50076/0 (socket says 172.21.15.103:50076) 2020-04-22T14:07:23.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.682+0000 7f4707fff700 1 -- 172.21.15.103:0/775063497 learned_addr learned my addr 172.21.15.103:0/775063497 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:23.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.683+0000 7f470cd19700 1 --2- 172.21.15.103:0/775063497 >> v2:172.21.15.86:3300/0 conn(0x7f47080b9140 0x7f47080aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:23.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.683+0000 7f4707fff700 1 -- 172.21.15.103:0/775063497 >> v2:172.21.15.86:3300/0 conn(0x7f47080b9140 msgr2=0x7f47080aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:23.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.683+0000 7f4707fff700 1 --2- 172.21.15.103:0/775063497 >> v2:172.21.15.86:3300/0 conn(0x7f47080b9140 0x7f47080aed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:23.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.683+0000 7f4707fff700 1 -- 172.21.15.103:0/775063497 >> v1:172.21.15.86:6789/0 conn(0x7f47080616b0 legacy=0x7f4708061b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:23.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.683+0000 7f4707fff700 1 -- 172.21.15.103:0/775063497 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47080b9520 con 0x7f47080b3bd0 2020-04-22T14:07:23.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.683+0000 7f470cd19700 1 --2- 172.21.15.103:0/775063497 >> v2:172.21.15.86:3300/0 conn(0x7f47080b9140 0x7f47080aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:07:23.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.683+0000 7f4707fff700 1 --2- 172.21.15.103:0/775063497 >> v2:172.21.15.103:3300/0 conn(0x7f47080b3bd0 0x7f47080af1f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4708067530 tx=0x7f46f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:23.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.683+0000 7f4707fff700 1 --2- 172.21.15.103:0/775063497 >> v2:172.21.15.103:3300/0 conn(0x7f47080b3bd0 0x7f47080af1f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4708067530 tx=0x7f46f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:23.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.683+0000 7f4707fff700 1 --2- 172.21.15.103:0/775063497 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47080b3bd0 0x7f47080af1f0 secure :-1 s=READY pgs=637 cs=0 l=1 rx=0x7f4708067530 tx=0x7f46f0007dc0).ready entity=mon.1 client_cookie=bca1cf2553cc358 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:23.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.683+0000 7f4707fff700 1 --2- 172.21.15.103:0/775063497 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47080b3bd0 0x7f47080af1f0 secure :-1 s=THROTTLE_DONE pgs=637 cs=0 l=1 rx=0x7f4708067530 tx=0x7f46f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:23.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.683+0000 7f47077fe700 1 -- 172.21.15.103:0/775063497 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46f000a180 con 0x7f47080b3bd0 2020-04-22T14:07:23.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.683+0000 7f4707fff700 1 --2- 172.21.15.103:0/775063497 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47080b3bd0 0x7f47080af1f0 secure :-1 s=THROTTLE_DONE pgs=637 cs=0 l=1 rx=0x7f4708067530 tx=0x7f46f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:23.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.683+0000 7f4707fff700 1 --2- 172.21.15.103:0/775063497 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47080b3bd0 0x7f47080af1f0 secure :-1 s=THROTTLE_DONE pgs=637 cs=0 l=1 rx=0x7f4708067530 tx=0x7f46f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:23.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.683+0000 7f47077fe700 1 -- 172.21.15.103:0/775063497 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f000a2e0 con 0x7f47080b3bd0 2020-04-22T14:07:23.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.683+0000 7f47077fe700 1 -- 172.21.15.103:0/775063497 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46f000a6c0 con 0x7f47080b3bd0 2020-04-22T14:07:23.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.683+0000 7f470ef7d700 1 -- 172.21.15.103:0/775063497 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47080b3bd0 msgr2=0x7f47080af1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:23.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.683+0000 7f470ef7d700 1 --2- 172.21.15.103:0/775063497 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47080b3bd0 0x7f47080af1f0 secure :-1 s=READY pgs=637 cs=0 l=1 rx=0x7f4708067530 tx=0x7f46f0007dc0).stop 2020-04-22T14:07:23.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.684+0000 7f470ef7d700 1 -- 172.21.15.103:0/775063497 shutdown_connections 2020-04-22T14:07:23.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.684+0000 7f470ef7d700 1 --2- 172.21.15.103:0/775063497 >> v2:172.21.15.86:3300/0 conn(0x7f47080b9140 0x7f47080aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:23.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.684+0000 7f470ef7d700 1 --2- 172.21.15.103:0/775063497 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47080b3bd0 0x7f47080af1f0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:23.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.684+0000 7f470ef7d700 1 -- 172.21.15.103:0/775063497 >> 172.21.15.103:0/775063497 conn(0x7f470805b7b0 msgr2=0x7f47080b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:23.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.684+0000 7f470ef7d700 1 -- 172.21.15.103:0/775063497 shutdown_connections 2020-04-22T14:07:23.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.684+0000 7f470ef7d700 1 -- 172.21.15.103:0/775063497 wait complete. 2020-04-22T14:07:23.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.684+0000 7f470ef7d700 1 Processor -- start 2020-04-22T14:07:23.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.685+0000 7f470ef7d700 1 -- start start 2020-04-22T14:07:23.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.685+0000 7f470ef7d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f47080b3bd0 0x7f470813f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:23.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.685+0000 7f470ef7d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4708065db0 con 0x7f47080616b0 2020-04-22T14:07:23.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.685+0000 7f470ef7d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4708065830 con 0x7f47080b9140 2020-04-22T14:07:23.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.685+0000 7f470ef7d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4708065ba0 con 0x7f47080b3bd0 2020-04-22T14:07:23.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.685+0000 7f470d51a700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f47080b9140 0x7f47081453b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42272/0 (socket says 172.21.15.103:42272) 2020-04-22T14:07:23.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.685+0000 7f470d51a700 1 -- 172.21.15.103:0/314912394 learned_addr learned my addr 172.21.15.103:0/314912394 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:23.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.686+0000 7f4707fff700 1 --2- 172.21.15.103:0/314912394 >> v2:172.21.15.86:3300/0 conn(0x7f47080b3bd0 0x7f470813f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:23.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.686+0000 7f4705ffb700 1 -- 172.21.15.103:0/314912394 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3263628364 0 0) 0x7f4708065830 con 0x7f47080b9140 2020-04-22T14:07:23.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.686+0000 7f4705ffb700 1 -- 172.21.15.103:0/314912394 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46ec002fe0 con 0x7f47080b9140 2020-04-22T14:07:23.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.686+0000 7f4705ffb700 1 -- 172.21.15.103:0/314912394 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4244379529 0 0) 0x7f46ec002fe0 con 0x7f47080b9140 2020-04-22T14:07:23.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.686+0000 7f4707fff700 1 -- 172.21.15.103:0/314912394 >> v1:172.21.15.103:6789/0 conn(0x7f47080b9140 legacy=0x7f47081453b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:23.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.686+0000 7f4707fff700 1 -- 172.21.15.103:0/314912394 >> v1:172.21.15.86:6789/0 conn(0x7f47080616b0 legacy=0x7f470813edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:23.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.686+0000 7f4707fff700 1 -- 172.21.15.103:0/314912394 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4708144ea0 con 0x7f47080b3bd0 2020-04-22T14:07:23.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.686+0000 7f4707fff700 1 --2- 172.21.15.103:0/314912394 >> v2:172.21.15.86:3300/0 conn(0x7f47080b3bd0 0x7f470813f4d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4700007720 tx=0x7f46f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:23.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.686+0000 7f4707fff700 1 --2- 172.21.15.103:0/314912394 >> v2:172.21.15.86:3300/0 conn(0x7f47080b3bd0 0x7f470813f4d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4700007720 tx=0x7f46f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:23.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.686+0000 7f4707fff700 1 --2- 172.21.15.103:0/314912394 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47080b3bd0 0x7f470813f4d0 secure :-1 s=READY pgs=361 cs=0 l=1 rx=0x7f4700007720 tx=0x7f46f0007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:23.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.686+0000 7f4707fff700 1 --2- 172.21.15.103:0/314912394 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47080b3bd0 0x7f470813f4d0 secure :-1 s=THROTTLE_DONE pgs=361 cs=0 l=1 rx=0x7f4700007720 tx=0x7f46f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:23.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.686+0000 7f4705ffb700 1 -- 172.21.15.103:0/314912394 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46f8002890 con 0x7f47080b3bd0 2020-04-22T14:07:23.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.686+0000 7f4707fff700 1 --2- 172.21.15.103:0/314912394 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47080b3bd0 0x7f470813f4d0 secure :-1 s=THROTTLE_DONE pgs=361 cs=0 l=1 rx=0x7f4700007720 tx=0x7f46f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:23.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.686+0000 7f4705ffb700 1 -- 172.21.15.103:0/314912394 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f0005a40 con 0x7f47080b3bd0 2020-04-22T14:07:23.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.686+0000 7f4707fff700 1 --2- 172.21.15.103:0/314912394 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47080b3bd0 0x7f470813f4d0 secure :-1 s=THROTTLE_DONE pgs=361 cs=0 l=1 rx=0x7f4700007720 tx=0x7f46f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:23.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.686+0000 7f470ef7d700 1 -- 172.21.15.103:0/314912394 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4708064550 con 0x7f47080b3bd0 2020-04-22T14:07:23.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.686+0000 7f4705ffb700 1 -- 172.21.15.103:0/314912394 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46f0005da0 con 0x7f47080b3bd0 2020-04-22T14:07:23.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.686+0000 7f470ef7d700 1 -- 172.21.15.103:0/314912394 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4708066290 con 0x7f47080b3bd0 2020-04-22T14:07:23.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.687+0000 7f4707fff700 1 --2- 172.21.15.103:0/314912394 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47080b3bd0 0x7f470813f4d0 secure :-1 s=THROTTLE_DONE pgs=361 cs=0 l=1 rx=0x7f4700007720 tx=0x7f46f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:23.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.687+0000 7f470ef7d700 1 -- 172.21.15.103:0/314912394 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47081450f0 con 0x7f47080b3bd0 2020-04-22T14:07:23.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.688+0000 7f4705ffb700 1 -- 172.21.15.103:0/314912394 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f46f0007170 con 0x7f47080b3bd0 2020-04-22T14:07:23.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.688+0000 7f4707fff700 1 --2- 172.21.15.103:0/314912394 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47080b3bd0 0x7f470813f4d0 secure :-1 s=THROTTLE_DONE pgs=361 cs=0 l=1 rx=0x7f4700007720 tx=0x7f46f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:23.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.688+0000 7f4705ffb700 1 --2- 172.21.15.103:0/314912394 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f46ec04dc00 0x7f46ec0500c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:23.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.688+0000 7f4705ffb700 1 -- 172.21.15.103:0/314912394 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f46f0061e40 con 0x7f47080b3bd0 2020-04-22T14:07:23.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.688+0000 7f470cd19700 1 --2- 172.21.15.103:0/314912394 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f46ec04dc00 0x7f46ec0500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:23.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.688+0000 7f470cd19700 1 --2- 172.21.15.103:0/314912394 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f46ec04dc00 0x7f46ec0500c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4700007a20 tx=0x7f4700007e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:23.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.688+0000 7f470cd19700 1 --2- 172.21.15.103:0/314912394 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f46ec04dc00 0x7f46ec0500c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4700007a20 tx=0x7f4700007e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:23.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.688+0000 7f470cd19700 1 --2- 172.21.15.103:0/314912394 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f46ec04dc00 0x7f46ec0500c0 secure :-1 s=READY pgs=244 cs=0 l=1 rx=0x7f4700007a20 tx=0x7f4700007e20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:23.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.691+0000 7f4707fff700 1 --2- 172.21.15.103:0/314912394 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47080b3bd0 0x7f470813f4d0 secure :-1 s=THROTTLE_DONE pgs=361 cs=0 l=1 rx=0x7f4700007720 tx=0x7f46f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:23.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.691+0000 7f4705ffb700 1 -- 172.21.15.103:0/314912394 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f47081450f0 con 0x7f47080b3bd0 2020-04-22T14:07:23.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:23.836+0000 7f470ef7d700 1 -- 172.21.15.103:0/314912394 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4708145090 con 0x7f47080b3bd0 2020-04-22T14:07:24.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.503+0000 7f4707fff700 1 --2- 172.21.15.103:0/314912394 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47080b3bd0 0x7f470813f4d0 secure :-1 s=THROTTLE_DONE pgs=361 cs=0 l=1 rx=0x7f4700007720 tx=0x7f46f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:24.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.503+0000 7f4705ffb700 1 -- 172.21.15.103:0/314912394 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v48) v1 ==== 173+0+0 (secure 0 0 0) 0x7f46f0040d70 con 0x7f47080b3bd0 2020-04-22T14:07:24.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.505+0000 7f470ef7d700 1 -- 172.21.15.103:0/314912394 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f46ec04dc00 msgr2=0x7f46ec0500c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:24.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.505+0000 7f470ef7d700 1 --2- 172.21.15.103:0/314912394 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f46ec04dc00 0x7f46ec0500c0 secure :-1 s=READY pgs=244 cs=0 l=1 rx=0x7f4700007a20 tx=0x7f4700007e20).stop 2020-04-22T14:07:24.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.505+0000 7f470ef7d700 1 -- 172.21.15.103:0/314912394 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47080b3bd0 msgr2=0x7f470813f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:24.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.505+0000 7f470ef7d700 1 --2- 172.21.15.103:0/314912394 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47080b3bd0 0x7f470813f4d0 secure :-1 s=READY pgs=361 cs=0 l=1 rx=0x7f4700007720 tx=0x7f46f0007dc0).stop 2020-04-22T14:07:24.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.505+0000 7f470ef7d700 1 -- 172.21.15.103:0/314912394 shutdown_connections 2020-04-22T14:07:24.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.505+0000 7f470ef7d700 1 --2- 172.21.15.103:0/314912394 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f46ec04dc00 0x7f46ec0500c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:24.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.505+0000 7f470ef7d700 1 --2- 172.21.15.103:0/314912394 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47080b3bd0 0x7f470813f4d0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:24.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.505+0000 7f470ef7d700 1 -- 172.21.15.103:0/314912394 >> 172.21.15.103:0/314912394 conn(0x7f470805b7b0 msgr2=0x7f47080b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:24.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.505+0000 7f470ef7d700 1 -- 172.21.15.103:0/314912394 shutdown_connections 2020-04-22T14:07:24.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.505+0000 7f470ef7d700 1 -- 172.21.15.103:0/314912394 wait complete. 2020-04-22T14:07:24.509 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' removed 2020-04-22T14:07:24.518 INFO:tasks.ceph.mds.a:Restarting daemon 2020-04-22T14:07:24.519 INFO:tasks.ceph.mds.a:Stopping old one... 2020-04-22T14:07:24.519 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-04-22T14:07:24.519 INFO:teuthology.orchestra.run:waiting for 300 2020-04-22T14:07:24.519 INFO:tasks.ceph.mds.b:Restarting daemon 2020-04-22T14:07:24.519 INFO:tasks.ceph.mds.b:Stopping old one... 2020-04-22T14:07:24.520 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-04-22T14:07:24.520 INFO:teuthology.orchestra.run:waiting for 300 2020-04-22T14:07:24.527 INFO:tasks.ceph.mds.a:Stopped 2020-04-22T14:07:24.527 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:24.529 INFO:tasks.ceph.mds.b:Stopped 2020-04-22T14:07:24.529 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:07:24.581 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-04-22T14:07:24.585 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-04-22T14:07:24.625 INFO:tasks.ceph.mds.a:Started 2020-04-22T14:07:24.625 DEBUG:teuthology.parallel:result is None 2020-04-22T14:07:24.627 INFO:tasks.ceph.mds.b:Started 2020-04-22T14:07:24.628 DEBUG:teuthology.parallel:result is None 2020-04-22T14:07:24.628 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:24.642 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2020-04-22T14:07:24.705 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2020-04-22T14:07:24.710 INFO:tasks.ceph.mds.b.smithi086.stdout:starting mds.b at 2020-04-22T14:07:24.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.792+0000 7feea8cd2700 1 Processor -- start 2020-04-22T14:07:24.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.792+0000 7feea8cd2700 1 -- start start 2020-04-22T14:07:24.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.792+0000 7feea8cd2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7feea40b4320 0x7feea40b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:24.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.793+0000 7feea8cd2700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7feea40b4700 0x7feea40b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:24.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.793+0000 7feea8cd2700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea40b0e90 con 0x7feea40b2530 2020-04-22T14:07:24.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.793+0000 7feea8cd2700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feea40b1130 con 0x7feea40b4700 2020-04-22T14:07:24.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.793+0000 7feea8cd2700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feea40ae500 con 0x7feea40b4320 2020-04-22T14:07:24.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.793+0000 7feea259c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7feea40b4320 0x7feea40b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:24.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.793+0000 7feea259c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7feea40b4320 0x7feea40b15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50098/0 (socket says 172.21.15.103:50098) 2020-04-22T14:07:24.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.793+0000 7feea259c700 1 -- 172.21.15.103:0/2534102260 learned_addr learned my addr 172.21.15.103:0/2534102260 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:24.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.793+0000 7feea1d9b700 1 --2- 172.21.15.103:0/2534102260 >> v2:172.21.15.86:3300/0 conn(0x7feea40b4700 0x7feea40b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:24.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.793+0000 7feea259c700 1 -- 172.21.15.103:0/2534102260 >> v2:172.21.15.86:3300/0 conn(0x7feea40b4700 msgr2=0x7feea40b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:24.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.793+0000 7feea259c700 1 --2- 172.21.15.103:0/2534102260 >> v2:172.21.15.86:3300/0 conn(0x7feea40b4700 0x7feea40b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:24.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.793+0000 7feea259c700 1 -- 172.21.15.103:0/2534102260 >> v1:172.21.15.86:6789/0 conn(0x7feea40b2530 legacy=0x7feea40afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:24.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.793+0000 7feea259c700 1 -- 172.21.15.103:0/2534102260 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea40b0170 con 0x7feea40b4320 2020-04-22T14:07:24.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.793+0000 7feea259c700 1 --2- 172.21.15.103:0/2534102260 >> v2:172.21.15.103:3300/0 conn(0x7feea40b4320 0x7feea40b15d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fee98002f30 tx=0x7fee98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:24.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.793+0000 7feea259c700 1 --2- 172.21.15.103:0/2534102260 >> v2:172.21.15.103:3300/0 conn(0x7feea40b4320 0x7feea40b15d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fee98002f30 tx=0x7fee98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:24.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.793+0000 7feea259c700 1 --2- 172.21.15.103:0/2534102260 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feea40b4320 0x7feea40b15d0 secure :-1 s=READY pgs=642 cs=0 l=1 rx=0x7fee98002f30 tx=0x7fee98007a40).ready entity=mon.1 client_cookie=bbf5d5622143e3f7 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:24.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.793+0000 7feea259c700 1 --2- 172.21.15.103:0/2534102260 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feea40b4320 0x7feea40b15d0 secure :-1 s=THROTTLE_DONE pgs=642 cs=0 l=1 rx=0x7fee98002f30 tx=0x7fee98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:24.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.793+0000 7feea159a700 1 -- 172.21.15.103:0/2534102260 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee98011670 con 0x7feea40b4320 2020-04-22T14:07:24.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.793+0000 7feea259c700 1 --2- 172.21.15.103:0/2534102260 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feea40b4320 0x7feea40b15d0 secure :-1 s=THROTTLE_DONE pgs=642 cs=0 l=1 rx=0x7fee98002f30 tx=0x7fee98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:24.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.793+0000 7feea259c700 1 --2- 172.21.15.103:0/2534102260 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feea40b4320 0x7feea40b15d0 secure :-1 s=THROTTLE_DONE pgs=642 cs=0 l=1 rx=0x7fee98002f30 tx=0x7fee98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:24.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.793+0000 7feea159a700 1 -- 172.21.15.103:0/2534102260 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee980117d0 con 0x7feea40b4320 2020-04-22T14:07:24.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.793+0000 7feea159a700 1 -- 172.21.15.103:0/2534102260 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee98011bf0 con 0x7feea40b4320 2020-04-22T14:07:24.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.793+0000 7feea8cd2700 1 -- 172.21.15.103:0/2534102260 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feea40b4320 msgr2=0x7feea40b15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:24.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.793+0000 7feea8cd2700 1 --2- 172.21.15.103:0/2534102260 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feea40b4320 0x7feea40b15d0 secure :-1 s=READY pgs=642 cs=0 l=1 rx=0x7fee98002f30 tx=0x7fee98007a40).stop 2020-04-22T14:07:24.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.794+0000 7feea8cd2700 1 -- 172.21.15.103:0/2534102260 shutdown_connections 2020-04-22T14:07:24.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.794+0000 7feea8cd2700 1 --2- 172.21.15.103:0/2534102260 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feea40b4320 0x7feea40b15d0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:24.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.794+0000 7feea8cd2700 1 --2- 172.21.15.103:0/2534102260 >> v2:172.21.15.86:3300/0 conn(0x7feea40b4700 0x7feea40b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:24.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.794+0000 7feea8cd2700 1 -- 172.21.15.103:0/2534102260 >> 172.21.15.103:0/2534102260 conn(0x7feea40b86b0 msgr2=0x7feea40b8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:24.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.794+0000 7feea8cd2700 1 -- 172.21.15.103:0/2534102260 shutdown_connections 2020-04-22T14:07:24.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.794+0000 7feea8cd2700 1 -- 172.21.15.103:0/2534102260 wait complete. 2020-04-22T14:07:24.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.795+0000 7feea8cd2700 1 Processor -- start 2020-04-22T14:07:24.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.795+0000 7feea8cd2700 1 -- start start 2020-04-22T14:07:24.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.795+0000 7feea8cd2700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feea40b2530 0x7feea40b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:24.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.795+0000 7feea8cd2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7feea40b4700 0x7feea413d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:24.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.795+0000 7feea8cd2700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea4140ca0 con 0x7feea40b4320 2020-04-22T14:07:24.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.795+0000 7feea8cd2700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feea40b3830 con 0x7feea40b4700 2020-04-22T14:07:24.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.795+0000 7feea8cd2700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea4140ed0 con 0x7feea40b2530 2020-04-22T14:07:24.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.795+0000 7feea2d9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7feea40b4700 0x7feea413d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:24.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.796+0000 7feea2d9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7feea40b4700 0x7feea413d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50108/0 (socket says 172.21.15.103:50108) 2020-04-22T14:07:24.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.796+0000 7feea2d9d700 1 -- 172.21.15.103:0/806693418 learned_addr learned my addr 172.21.15.103:0/806693418 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:24.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.796+0000 7feea259c700 1 --2- 172.21.15.103:0/806693418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feea40b2530 0x7feea40b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:24.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.796+0000 7feea2d9d700 1 -- 172.21.15.103:0/806693418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feea40b2530 msgr2=0x7feea40b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:24.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.796+0000 7feea2d9d700 1 --2- 172.21.15.103:0/806693418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feea40b2530 0x7feea40b33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:24.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.796+0000 7feea2d9d700 1 -- 172.21.15.103:0/806693418 >> v1:172.21.15.86:6789/0 conn(0x7feea40b4320 legacy=0x7feea4144830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:24.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.796+0000 7fee937fe700 1 -- 172.21.15.103:0/806693418 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2295845213 0 0) 0x7feea4140ca0 con 0x7feea40b4320 2020-04-22T14:07:24.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.796+0000 7feea2d9d700 1 -- 172.21.15.103:0/806693418 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea4141170 con 0x7feea40b4700 2020-04-22T14:07:24.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.796+0000 7feea2d9d700 1 --2- 172.21.15.103:0/806693418 >> v2:172.21.15.103:3300/0 conn(0x7feea40b4700 0x7feea413d140 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7feea40af970 tx=0x7fee9c010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:24.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.796+0000 7feea2d9d700 1 --2- 172.21.15.103:0/806693418 >> v2:172.21.15.103:3300/0 conn(0x7feea40b4700 0x7feea413d140 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7feea40af970 tx=0x7fee9c010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:24.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.796+0000 7feea2d9d700 1 --2- 172.21.15.103:0/806693418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feea40b4700 0x7feea413d140 secure :-1 s=READY pgs=643 cs=0 l=1 rx=0x7feea40af970 tx=0x7fee9c010be0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:24.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.796+0000 7feea2d9d700 1 --2- 172.21.15.103:0/806693418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feea40b4700 0x7feea413d140 secure :-1 s=THROTTLE_DONE pgs=643 cs=0 l=1 rx=0x7feea40af970 tx=0x7fee9c010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:24.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.796+0000 7fee937fe700 1 -- 172.21.15.103:0/806693418 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee9c012280 con 0x7feea40b4700 2020-04-22T14:07:24.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.796+0000 7feea2d9d700 1 --2- 172.21.15.103:0/806693418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feea40b4700 0x7feea413d140 secure :-1 s=THROTTLE_DONE pgs=643 cs=0 l=1 rx=0x7feea40af970 tx=0x7fee9c010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:24.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.796+0000 7feea2d9d700 1 --2- 172.21.15.103:0/806693418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feea40b4700 0x7feea413d140 secure :-1 s=THROTTLE_DONE pgs=643 cs=0 l=1 rx=0x7feea40af970 tx=0x7fee9c010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:24.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.796+0000 7fee937fe700 1 -- 172.21.15.103:0/806693418 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9c012420 con 0x7feea40b4700 2020-04-22T14:07:24.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.796+0000 7feea8cd2700 1 -- 172.21.15.103:0/806693418 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea40663e0 con 0x7feea40b4700 2020-04-22T14:07:24.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.796+0000 7fee937fe700 1 -- 172.21.15.103:0/806693418 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee9c012800 con 0x7feea40b4700 2020-04-22T14:07:24.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.796+0000 7feea8cd2700 1 -- 172.21.15.103:0/806693418 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea413d7e0 con 0x7feea40b4700 2020-04-22T14:07:24.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.797+0000 7feea2d9d700 1 --2- 172.21.15.103:0/806693418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feea40b4700 0x7feea413d140 secure :-1 s=THROTTLE_DONE pgs=643 cs=0 l=1 rx=0x7feea40af970 tx=0x7fee9c010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:24.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.797+0000 7fee937fe700 1 -- 172.21.15.103:0/806693418 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fee9c012a70 con 0x7feea40b4700 2020-04-22T14:07:24.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.797+0000 7feea2d9d700 1 --2- 172.21.15.103:0/806693418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feea40b4700 0x7feea413d140 secure :-1 s=THROTTLE_DONE pgs=643 cs=0 l=1 rx=0x7feea40af970 tx=0x7fee9c010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:24.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.797+0000 7feea8cd2700 1 -- 172.21.15.103:0/806693418 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feea4141300 con 0x7feea40b4700 2020-04-22T14:07:24.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.797+0000 7fee937fe700 1 --2- 172.21.15.103:0/806693418 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fee8004d800 0x7fee8004fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:24.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.798+0000 7fee937fe700 1 -- 172.21.15.103:0/806693418 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fee9c0619a0 con 0x7feea40b4700 2020-04-22T14:07:24.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.798+0000 7feea259c700 1 --2- 172.21.15.103:0/806693418 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fee8004d800 0x7fee8004fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:24.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.798+0000 7feea259c700 1 --2- 172.21.15.103:0/806693418 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fee8004d800 0x7fee8004fcc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fee98002f30 tx=0x7fee98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:24.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.798+0000 7feea259c700 1 --2- 172.21.15.103:0/806693418 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fee8004d800 0x7fee8004fcc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fee98002f30 tx=0x7fee98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:24.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.798+0000 7feea259c700 1 --2- 172.21.15.103:0/806693418 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fee8004d800 0x7fee8004fcc0 secure :-1 s=READY pgs=245 cs=0 l=1 rx=0x7fee98002f30 tx=0x7fee98007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:24.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.802+0000 7feea2d9d700 1 --2- 172.21.15.103:0/806693418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feea40b4700 0x7feea413d140 secure :-1 s=THROTTLE_DONE pgs=643 cs=0 l=1 rx=0x7feea40af970 tx=0x7fee9c010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:24.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.802+0000 7fee937fe700 1 -- 172.21.15.103:0/806693418 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fee9c03cd20 con 0x7feea40b4700 2020-04-22T14:07:24.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:24.958+0000 7feea8cd2700 1 -- 172.21.15.103:0/806693418 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7feea4056c90 con 0x7feea40b4700 2020-04-22T14:07:25.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.725+0000 7feea2d9d700 1 --2- 172.21.15.103:0/806693418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feea40b4700 0x7feea413d140 secure :-1 s=THROTTLE_DONE pgs=643 cs=0 l=1 rx=0x7feea40af970 tx=0x7fee9c010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:25.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.725+0000 7fee937fe700 1 -- 172.21.15.103:0/806693418 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v49) v1 ==== 97+0+0 (secure 0 0 0) 0x7fee9c040340 con 0x7feea40b4700 2020-04-22T14:07:25.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.727+0000 7feea8cd2700 1 -- 172.21.15.103:0/806693418 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fee8004d800 msgr2=0x7fee8004fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:25.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.727+0000 7feea8cd2700 1 --2- 172.21.15.103:0/806693418 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fee8004d800 0x7fee8004fcc0 secure :-1 s=READY pgs=245 cs=0 l=1 rx=0x7fee98002f30 tx=0x7fee98007a40).stop 2020-04-22T14:07:25.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.727+0000 7feea8cd2700 1 -- 172.21.15.103:0/806693418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feea40b4700 msgr2=0x7feea413d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:25.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.727+0000 7feea8cd2700 1 --2- 172.21.15.103:0/806693418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feea40b4700 0x7feea413d140 secure :-1 s=READY pgs=643 cs=0 l=1 rx=0x7feea40af970 tx=0x7fee9c010be0).stop 2020-04-22T14:07:25.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.727+0000 7feea8cd2700 1 -- 172.21.15.103:0/806693418 shutdown_connections 2020-04-22T14:07:25.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.727+0000 7feea8cd2700 1 --2- 172.21.15.103:0/806693418 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fee8004d800 0x7fee8004fcc0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:25.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.727+0000 7feea8cd2700 1 --2- 172.21.15.103:0/806693418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feea40b4700 0x7feea413d140 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:25.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.727+0000 7feea8cd2700 1 --2- 172.21.15.103:0/806693418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feea40b2530 0x7feea40b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:25.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.727+0000 7feea8cd2700 1 -- 172.21.15.103:0/806693418 >> 172.21.15.103:0/806693418 conn(0x7feea40b86b0 msgr2=0x7feea405f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:25.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.727+0000 7feea8cd2700 1 -- 172.21.15.103:0/806693418 shutdown_connections 2020-04-22T14:07:25.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.727+0000 7feea8cd2700 1 -- 172.21.15.103:0/806693418 wait complete. 2020-04-22T14:07:25.731 INFO:teuthology.orchestra.run.smithi103.stderr: removed all blacklist entries 2020-04-22T14:07:25.740 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2020-04-22T14:07:25.740 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:25.795 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2020-04-22T14:07:25.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.942+0000 7f0eb31ac700 1 Processor -- start 2020-04-22T14:07:25.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.942+0000 7f0eb31ac700 1 -- start start 2020-04-22T14:07:25.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.943+0000 7f0eb31ac700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0eac0ac740 0x7f0eac142de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:25.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.943+0000 7f0eb31ac700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eac064ec0 con 0x7f0eac067170 2020-04-22T14:07:25.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.943+0000 7f0eb31ac700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eac146870 con 0x7f0eac0b6040 2020-04-22T14:07:25.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.943+0000 7f0eb31ac700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eac065af0 con 0x7f0eac0ac740 2020-04-22T14:07:25.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.943+0000 7f0eabfff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f0eac0b6040 0x7f0eac1426d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42306/0 (socket says 172.21.15.103:42306) 2020-04-22T14:07:25.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.943+0000 7f0eabfff700 1 -- 172.21.15.103:0/441386957 learned_addr learned my addr 172.21.15.103:0/441386957 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:25.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.943+0000 7f0eb1749700 1 --2- 172.21.15.103:0/441386957 >> v2:172.21.15.86:3300/0 conn(0x7f0eac0ac740 0x7f0eac142de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:25.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.943+0000 7f0eab7fe700 1 -- 172.21.15.103:0/441386957 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1691661401 0 0) 0x7f0eac146870 con 0x7f0eac0b6040 2020-04-22T14:07:25.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.944+0000 7f0eab7fe700 1 -- 172.21.15.103:0/441386957 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e98003230 con 0x7f0eac0b6040 2020-04-22T14:07:25.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.944+0000 7f0eab7fe700 1 -- 172.21.15.103:0/441386957 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3018514059 0 0) 0x7f0eac064ec0 con 0x7f0eac067170 2020-04-22T14:07:25.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.944+0000 7f0eab7fe700 1 -- 172.21.15.103:0/441386957 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0eac146870 con 0x7f0eac067170 2020-04-22T14:07:25.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.944+0000 7f0eab7fe700 1 -- 172.21.15.103:0/441386957 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2281269116 0 0) 0x7f0e98003230 con 0x7f0eac0b6040 2020-04-22T14:07:25.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.944+0000 7f0eab7fe700 1 -- 172.21.15.103:0/441386957 >> v2:172.21.15.86:3300/0 conn(0x7f0eac0ac740 msgr2=0x7f0eac142de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:25.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.944+0000 7f0eab7fe700 1 --2- 172.21.15.103:0/441386957 >> v2:172.21.15.86:3300/0 conn(0x7f0eac0ac740 0x7f0eac142de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:25.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.944+0000 7f0eab7fe700 1 -- 172.21.15.103:0/441386957 >> v1:172.21.15.86:6789/0 conn(0x7f0eac067170 legacy=0x7f0eac13c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:25.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.944+0000 7f0eab7fe700 1 -- 172.21.15.103:0/441386957 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eac067550 con 0x7f0eac0b6040 2020-04-22T14:07:25.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.944+0000 7f0eab7fe700 1 -- 172.21.15.103:0/441386957 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f0ea00016d0 con 0x7f0eac0b6040 2020-04-22T14:07:25.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.944+0000 7f0eab7fe700 1 -- 172.21.15.103:0/441386957 >> v1:172.21.15.103:6789/0 conn(0x7f0eac0b6040 legacy=0x7f0eac1426d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:25.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.944+0000 7f0eab7fe700 1 --2- 172.21.15.103:0/441386957 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e980038b0 0x7f0e98003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:25.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.944+0000 7f0eab7fe700 1 --2- 172.21.15.103:0/441386957 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e980044d0 0x7f0e98004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:25.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.944+0000 7f0eab7fe700 1 --2- 172.21.15.103:0/441386957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e98004db0 0x7f0e9800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:25.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.944+0000 7f0eab7fe700 1 -- 172.21.15.103:0/441386957 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac065af0 con 0x7f0e980044d0 2020-04-22T14:07:25.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.944+0000 7f0eab7fe700 1 -- 172.21.15.103:0/441386957 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e980053a0 con 0x7f0e98004db0 2020-04-22T14:07:25.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.944+0000 7f0eab7fe700 1 -- 172.21.15.103:0/441386957 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9800bc00 con 0x7f0e980038b0 2020-04-22T14:07:25.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.944+0000 7f0eb1749700 1 --2- 172.21.15.103:0/441386957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e98004db0 0x7f0e9800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:25.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.944+0000 7f0eabfff700 1 --2- 172.21.15.103:0/441386957 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e980044d0 0x7f0e98004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:25.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.944+0000 7f0eb0f48700 1 --2- 172.21.15.103:0/441386957 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e980038b0 0x7f0e98003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:25.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.944+0000 7f0eb1749700 1 -- 172.21.15.103:0/441386957 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e980038b0 msgr2=0x7f0e98003cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:25.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.944+0000 7f0eb1749700 1 --2- 172.21.15.103:0/441386957 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e980038b0 0x7f0e98003cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:25.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.944+0000 7f0eb1749700 1 -- 172.21.15.103:0/441386957 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e980044d0 msgr2=0x7f0e98004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:25.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.944+0000 7f0eb1749700 1 --2- 172.21.15.103:0/441386957 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e980044d0 0x7f0e98004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:25.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.944+0000 7f0eb1749700 1 -- 172.21.15.103:0/441386957 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e98003230 con 0x7f0e98004db0 2020-04-22T14:07:25.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.944+0000 7f0eb0f48700 1 --2- 172.21.15.103:0/441386957 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e980038b0 0x7f0e98003cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:07:25.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.944+0000 7f0eb1749700 1 --2- 172.21.15.103:0/441386957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e98004db0 0x7f0e9800b720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0ea40032b0 tx=0x7f0ea40103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:25.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.944+0000 7f0eb1749700 1 -- 172.21.15.103:0/441386957 reap_dead start 2020-04-22T14:07:25.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.944+0000 7f0eb1749700 1 --2- 172.21.15.103:0/441386957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e98004db0 0x7f0e9800b720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0ea40032b0 tx=0x7f0ea40103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:25.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.944+0000 7f0eb1749700 1 --2- 172.21.15.103:0/441386957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e98004db0 0x7f0e9800b720 secure :-1 s=READY pgs=645 cs=0 l=1 rx=0x7f0ea40032b0 tx=0x7f0ea40103a0).ready entity=mon.1 client_cookie=e0137603bb079f7e server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:25.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.944+0000 7f0eb1749700 1 --2- 172.21.15.103:0/441386957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e98004db0 0x7f0e9800b720 secure :-1 s=THROTTLE_DONE pgs=645 cs=0 l=1 rx=0x7f0ea40032b0 tx=0x7f0ea40103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:25.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.944+0000 7f0eab7fe700 1 -- 172.21.15.103:0/441386957 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ea4005c30 con 0x7f0e98004db0 2020-04-22T14:07:25.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.944+0000 7f0eb1749700 1 --2- 172.21.15.103:0/441386957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e98004db0 0x7f0e9800b720 secure :-1 s=THROTTLE_DONE pgs=645 cs=0 l=1 rx=0x7f0ea40032b0 tx=0x7f0ea40103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:25.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.944+0000 7f0eb1749700 1 --2- 172.21.15.103:0/441386957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e98004db0 0x7f0e9800b720 secure :-1 s=THROTTLE_DONE pgs=645 cs=0 l=1 rx=0x7f0ea40032b0 tx=0x7f0ea40103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:25.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.944+0000 7f0eab7fe700 1 -- 172.21.15.103:0/441386957 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea4005d90 con 0x7f0e98004db0 2020-04-22T14:07:25.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.944+0000 7f0eab7fe700 1 -- 172.21.15.103:0/441386957 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ea40112c0 con 0x7f0e98004db0 2020-04-22T14:07:25.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.945+0000 7f0eb31ac700 1 -- 172.21.15.103:0/441386957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e98004db0 msgr2=0x7f0e9800b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:25.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.945+0000 7f0eb31ac700 1 --2- 172.21.15.103:0/441386957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e98004db0 0x7f0e9800b720 secure :-1 s=READY pgs=645 cs=0 l=1 rx=0x7f0ea40032b0 tx=0x7f0ea40103a0).stop 2020-04-22T14:07:25.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.945+0000 7f0eb31ac700 1 -- 172.21.15.103:0/441386957 shutdown_connections 2020-04-22T14:07:25.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.945+0000 7f0eb31ac700 1 --2- 172.21.15.103:0/441386957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e98004db0 0x7f0e9800b720 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:25.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.945+0000 7f0eb31ac700 1 -- 172.21.15.103:0/441386957 >> 172.21.15.103:0/441386957 conn(0x7f0eac0b9160 msgr2=0x7f0eac05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:25.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.945+0000 7f0eb31ac700 1 -- 172.21.15.103:0/441386957 shutdown_connections 2020-04-22T14:07:25.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.945+0000 7f0eb31ac700 1 -- 172.21.15.103:0/441386957 wait complete. 2020-04-22T14:07:25.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.946+0000 7f0eb31ac700 1 Processor -- start 2020-04-22T14:07:25.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.946+0000 7f0eb31ac700 1 -- start start 2020-04-22T14:07:25.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.947+0000 7f0eb31ac700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0eac134fc0 0x7f0eac145ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:25.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.947+0000 7f0eb31ac700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eac146450 con 0x7f0eac1403a0 2020-04-22T14:07:25.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.947+0000 7f0eb31ac700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eac142570 con 0x7f0e98004db0 2020-04-22T14:07:25.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.947+0000 7f0eb31ac700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac142810 con 0x7f0eac134fc0 2020-04-22T14:07:25.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.947+0000 7f0eb0f48700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f0e98004db0 0x7f0eac142f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42318/0 (socket says 172.21.15.103:42318) 2020-04-22T14:07:25.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.947+0000 7f0eb0f48700 1 -- 172.21.15.103:0/72587289 learned_addr learned my addr 172.21.15.103:0/72587289 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:25.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.947+0000 7f0eb1749700 1 --2- 172.21.15.103:0/72587289 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0eac134fc0 0x7f0eac145ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:25.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.947+0000 7f0ea9ffb700 1 -- 172.21.15.103:0/72587289 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1737653117 0 0) 0x7f0eac142570 con 0x7f0e98004db0 2020-04-22T14:07:25.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.947+0000 7f0ea9ffb700 1 -- 172.21.15.103:0/72587289 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e8c002fe0 con 0x7f0e98004db0 2020-04-22T14:07:25.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.947+0000 7f0ea9ffb700 1 -- 172.21.15.103:0/72587289 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1220665013 0 0) 0x7f0eac067550 con 0x7f0eac1403a0 2020-04-22T14:07:25.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.947+0000 7f0ea9ffb700 1 -- 172.21.15.103:0/72587289 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0eac142570 con 0x7f0eac1403a0 2020-04-22T14:07:25.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.947+0000 7f0eb1749700 1 -- 172.21.15.103:0/72587289 >> v1:172.21.15.103:6789/0 conn(0x7f0e98004db0 legacy=0x7f0eac142f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:25.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.947+0000 7f0eb1749700 1 -- 172.21.15.103:0/72587289 >> v1:172.21.15.86:6789/0 conn(0x7f0eac1403a0 legacy=0x7f0eac1348b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:25.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.947+0000 7f0eb1749700 1 -- 172.21.15.103:0/72587289 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eac142ab0 con 0x7f0eac134fc0 2020-04-22T14:07:25.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.947+0000 7f0eb1749700 1 --2- 172.21.15.103:0/72587289 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0eac134fc0 0x7f0eac145ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0ea40032b0 tx=0x7f0ea40103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:25.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.947+0000 7f0eb1749700 1 --2- 172.21.15.103:0/72587289 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0eac134fc0 0x7f0eac145ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0ea40032b0 tx=0x7f0ea40103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:25.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.947+0000 7f0eb1749700 1 --2- 172.21.15.103:0/72587289 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0eac134fc0 0x7f0eac145ff0 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7f0ea40032b0 tx=0x7f0ea40103a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:25.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.948+0000 7f0eb1749700 1 --2- 172.21.15.103:0/72587289 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0eac134fc0 0x7f0eac145ff0 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f0ea40032b0 tx=0x7f0ea40103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:25.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.948+0000 7f0ea9ffb700 1 -- 172.21.15.103:0/72587289 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ea4007f50 con 0x7f0eac134fc0 2020-04-22T14:07:25.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.948+0000 7f0eb1749700 1 --2- 172.21.15.103:0/72587289 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0eac134fc0 0x7f0eac145ff0 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f0ea40032b0 tx=0x7f0ea40103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:25.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.948+0000 7f0eb1749700 1 --2- 172.21.15.103:0/72587289 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0eac134fc0 0x7f0eac145ff0 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f0ea40032b0 tx=0x7f0ea40103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:25.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.948+0000 7f0ea9ffb700 1 -- 172.21.15.103:0/72587289 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea4005c30 con 0x7f0eac134fc0 2020-04-22T14:07:25.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.948+0000 7f0eb31ac700 1 -- 172.21.15.103:0/72587289 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eac155460 con 0x7f0eac134fc0 2020-04-22T14:07:25.961 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.948+0000 7f0ea9ffb700 1 -- 172.21.15.103:0/72587289 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ea400e410 con 0x7f0eac134fc0 2020-04-22T14:07:25.961 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.948+0000 7f0eb31ac700 1 -- 172.21.15.103:0/72587289 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eac1558d0 con 0x7f0eac134fc0 2020-04-22T14:07:25.961 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.948+0000 7f0eb1749700 1 --2- 172.21.15.103:0/72587289 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0eac134fc0 0x7f0eac145ff0 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f0ea40032b0 tx=0x7f0ea40103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:25.961 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.949+0000 7f0eb31ac700 1 -- 172.21.15.103:0/72587289 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eac135470 con 0x7f0eac134fc0 2020-04-22T14:07:25.961 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.949+0000 7f0ea9ffb700 1 -- 172.21.15.103:0/72587289 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f0ea400e570 con 0x7f0eac134fc0 2020-04-22T14:07:25.961 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.949+0000 7f0eb1749700 1 --2- 172.21.15.103:0/72587289 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0eac134fc0 0x7f0eac145ff0 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f0ea40032b0 tx=0x7f0ea40103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:25.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.949+0000 7f0ea9ffb700 1 --2- 172.21.15.103:0/72587289 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0e8c04de00 0x7f0e8c0502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:25.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.949+0000 7f0ea9ffb700 1 -- 172.21.15.103:0/72587289 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f0ea4061880 con 0x7f0eac134fc0 2020-04-22T14:07:25.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.949+0000 7f0eb0f48700 1 --2- 172.21.15.103:0/72587289 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0e8c04de00 0x7f0e8c0502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:25.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.949+0000 7f0eb0f48700 1 --2- 172.21.15.103:0/72587289 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0e8c04de00 0x7f0e8c0502c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0e9c0010d0 tx=0x7f0e9c003910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:25.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.950+0000 7f0eb0f48700 1 --2- 172.21.15.103:0/72587289 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0e8c04de00 0x7f0e8c0502c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0e9c0010d0 tx=0x7f0e9c003910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:25.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.950+0000 7f0eb0f48700 1 --2- 172.21.15.103:0/72587289 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0e8c04de00 0x7f0e8c0502c0 secure :-1 s=READY pgs=247 cs=0 l=1 rx=0x7f0e9c0010d0 tx=0x7f0e9c003910).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:25.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.953+0000 7f0eb1749700 1 --2- 172.21.15.103:0/72587289 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0eac134fc0 0x7f0eac145ff0 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f0ea40032b0 tx=0x7f0ea40103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:25.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:25.953+0000 7f0ea9ffb700 1 -- 172.21.15.103:0/72587289 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f0ea403ccc0 con 0x7f0eac134fc0 2020-04-22T14:07:26.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.145+0000 7f0eb31ac700 1 -- 172.21.15.103:0/72587289 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f0eac056c90 con 0x7f0eac134fc0 2020-04-22T14:07:26.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.146+0000 7f0eb1749700 1 --2- 172.21.15.103:0/72587289 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0eac134fc0 0x7f0eac145ff0 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f0ea40032b0 tx=0x7f0ea40103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:26.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.146+0000 7f0ea9ffb700 1 -- 172.21.15.103:0/72587289 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) v1 ==== 80+0+4513 (secure 0 0 0) 0x7f0ea40402e0 con 0x7f0eac134fc0 2020-04-22T14:07:26.148 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:07:26.148 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:07:26.149 INFO:teuthology.orchestra.run.smithi103.stdout: "auth_dump": [ 2020-04-22T14:07:26.149 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:26.149 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.a", 2020-04-22T14:07:26.149 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBeliD5IBAAjC7UikdEP8FeE2rKs/ympw==", 2020-04-22T14:07:26.149 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:07:26.149 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:07:26.149 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:07:26.150 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:07:26.150 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:07:26.150 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:26.150 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:26.150 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:26.150 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.b", 2020-04-22T14:07:26.150 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBepkqQLBAA4aMKXxROQugglhm4aBd1Iw==", 2020-04-22T14:07:26.150 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:07:26.151 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:07:26.151 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:07:26.151 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:07:26.151 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:07:26.151 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:26.151 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:26.151 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:26.152 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.0", 2020-04-22T14:07:26.152 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA2TqBehMJiBxAARaWo32QGx49PxImGafnOFw==", 2020-04-22T14:07:26.152 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:07:26.152 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:07:26.152 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:07:26.152 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:07:26.152 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:26.153 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:26.153 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:26.153 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.1", 2020-04-22T14:07:26.153 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA4TqBeiAAcKRAAEHuaqbsB+NLUTSgFOCOFZg==", 2020-04-22T14:07:26.153 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:07:26.153 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:07:26.153 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:07:26.153 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:07:26.154 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:26.154 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:26.154 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:26.154 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.2", 2020-04-22T14:07:26.154 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA7TqBebeRzDxAAsjRyvJektq7MQ+334kU+UQ==", 2020-04-22T14:07:26.154 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:07:26.154 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:07:26.155 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:07:26.155 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:07:26.155 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:26.155 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:26.155 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:26.155 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.3", 2020-04-22T14:07:26.155 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA9TqBehxmSMRAATZ0o/ZnxHp2m/tqLmv6JwA==", 2020-04-22T14:07:26.155 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:07:26.156 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:07:26.156 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:07:26.156 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:07:26.156 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:26.156 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:26.156 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:26.156 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.4", 2020-04-22T14:07:26.157 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBETqBePwJSBRAAXgMKuX3EILi3gy8QzR4cig==", 2020-04-22T14:07:26.157 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:07:26.157 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:07:26.157 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:07:26.157 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:07:26.157 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:26.157 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:26.157 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:26.158 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.5", 2020-04-22T14:07:26.158 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBGTqBe5l++KRAAHIWG6bBnru2EVXv/drAL0g==", 2020-04-22T14:07:26.158 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:07:26.158 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:07:26.158 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:07:26.158 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:07:26.158 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:26.159 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:26.159 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:26.159 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.6", 2020-04-22T14:07:26.159 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBJTqBe88rTEBAAO2Z78NZLTYIbBpYovBSHVQ==", 2020-04-22T14:07:26.159 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:07:26.159 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:07:26.159 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:07:26.159 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:07:26.160 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:26.160 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:26.160 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:26.160 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.7", 2020-04-22T14:07:26.160 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBLTqBeGNFIMxAARIXhPNM6xurdnDv8+xZqUw==", 2020-04-22T14:07:26.160 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:07:26.160 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:07:26.161 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:07:26.161 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:07:26.161 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:26.161 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:26.161 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:26.161 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.0", 2020-04-22T14:07:26.161 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBe5ooUNxAA9zBtv6+i3Xl9iYtRl4xKGg==", 2020-04-22T14:07:26.161 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:07:26.162 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:07:26.162 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:07:26.162 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:07:26.162 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:26.162 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:26.162 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:26.162 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.1", 2020-04-22T14:07:26.162 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAyTqBe0bioBBAAVpoQouA/QICwqRoaFbjkiA==", 2020-04-22T14:07:26.163 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:07:26.163 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:07:26.163 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:07:26.163 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:07:26.163 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:26.163 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:26.163 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:26.164 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.2", 2020-04-22T14:07:26.164 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAyTqBemwpXCxAAObNL96zS67nMEe4MLjrEtw==", 2020-04-22T14:07:26.164 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:07:26.164 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:07:26.164 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:07:26.164 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:07:26.164 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:26.168 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:26.168 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:26.168 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.3", 2020-04-22T14:07:26.168 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAyTqBemGxNFBAAlqvB8FeZbMRwvzVjBpH/tA==", 2020-04-22T14:07:26.168 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:07:26.168 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:07:26.169 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:07:26.169 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:07:26.169 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:26.169 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:26.169 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:26.169 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.admin", 2020-04-22T14:07:26.169 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAwTqBeSx5dHxAAH0jPkaiWEwpr66ROWwbU8Q==", 2020-04-22T14:07:26.170 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:07:26.170 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2020-04-22T14:07:26.170 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:07:26.170 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:07:26.170 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:07:26.170 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:26.170 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:26.170 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:26.171 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mgr.x", 2020-04-22T14:07:26.171 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBe3YVhGhAAWAf6f9sV3bzoucBBPS3j2g==", 2020-04-22T14:07:26.171 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:07:26.171 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2020-04-22T14:07:26.171 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile mgr", 2020-04-22T14:07:26.171 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:07:26.171 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:26.172 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:26.172 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:26.172 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mgr.y", 2020-04-22T14:07:26.172 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBeX8AXExAAhh/N+/ogdKlxmkveSM60+g==", 2020-04-22T14:07:26.172 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:07:26.172 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2020-04-22T14:07:26.172 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile mgr", 2020-04-22T14:07:26.173 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:07:26.173 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:26.173 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:26.173 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:26.173 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:07:26.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.147+0000 7f0eb31ac700 1 -- 172.21.15.103:0/72587289 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0e8c04de00 msgr2=0x7f0e8c0502c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:26.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.147+0000 7f0eb31ac700 1 --2- 172.21.15.103:0/72587289 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0e8c04de00 0x7f0e8c0502c0 secure :-1 s=READY pgs=247 cs=0 l=1 rx=0x7f0e9c0010d0 tx=0x7f0e9c003910).stop 2020-04-22T14:07:26.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.147+0000 7f0eb31ac700 1 -- 172.21.15.103:0/72587289 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0eac134fc0 msgr2=0x7f0eac145ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:26.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.147+0000 7f0eb31ac700 1 --2- 172.21.15.103:0/72587289 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0eac134fc0 0x7f0eac145ff0 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7f0ea40032b0 tx=0x7f0ea40103a0).stop 2020-04-22T14:07:26.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.147+0000 7f0eb31ac700 1 -- 172.21.15.103:0/72587289 shutdown_connections 2020-04-22T14:07:26.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.147+0000 7f0eb31ac700 1 --2- 172.21.15.103:0/72587289 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0e8c04de00 0x7f0e8c0502c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:26.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.147+0000 7f0eb31ac700 1 --2- 172.21.15.103:0/72587289 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0eac134fc0 0x7f0eac145ff0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:26.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.147+0000 7f0eb31ac700 1 -- 172.21.15.103:0/72587289 >> 172.21.15.103:0/72587289 conn(0x7f0eac0b9160 msgr2=0x7f0eac137cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:26.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.147+0000 7f0eb31ac700 1 -- 172.21.15.103:0/72587289 shutdown_connections 2020-04-22T14:07:26.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.147+0000 7f0eb31ac700 1 -- 172.21.15.103:0/72587289 wait complete. 2020-04-22T14:07:26.176 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:26.190 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:07:26.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.334+0000 7f394000a700 1 Processor -- start 2020-04-22T14:07:26.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.335+0000 7f394000a700 1 -- start start 2020-04-22T14:07:26.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.335+0000 7f394000a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3938067170 0x7f39380b6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:26.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.335+0000 7f394000a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f39381426d0 0x7f3938142b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:26.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.335+0000 7f394000a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3938064ec0 con 0x7f39380ac740 2020-04-22T14:07:26.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.335+0000 7f394000a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3938065af0 con 0x7f39381426d0 2020-04-22T14:07:26.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.335+0000 7f394000a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3938146870 con 0x7f3938067170 2020-04-22T14:07:26.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.335+0000 7f393dda6700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3938067170 0x7f39380b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:26.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.335+0000 7f393dda6700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3938067170 0x7f39380b6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50134/0 (socket says 172.21.15.103:50134) 2020-04-22T14:07:26.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.335+0000 7f393dda6700 1 -- 172.21.15.103:0/2261044767 learned_addr learned my addr 172.21.15.103:0/2261044767 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:26.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.336+0000 7f393e5a7700 1 --2- 172.21.15.103:0/2261044767 >> v2:172.21.15.86:3300/0 conn(0x7f39381426d0 0x7f3938142b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:26.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.336+0000 7f393dda6700 1 -- 172.21.15.103:0/2261044767 >> v2:172.21.15.86:3300/0 conn(0x7f39381426d0 msgr2=0x7f3938142b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:26.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.336+0000 7f393dda6700 1 --2- 172.21.15.103:0/2261044767 >> v2:172.21.15.86:3300/0 conn(0x7f39381426d0 0x7f3938142b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:26.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.336+0000 7f393dda6700 1 -- 172.21.15.103:0/2261044767 >> v1:172.21.15.86:6789/0 conn(0x7f39380ac740 legacy=0x7f393813c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:26.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.336+0000 7f393dda6700 1 -- 172.21.15.103:0/2261044767 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3938067550 con 0x7f3938067170 2020-04-22T14:07:26.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.336+0000 7f393dda6700 1 --2- 172.21.15.103:0/2261044767 >> v2:172.21.15.103:3300/0 conn(0x7f3938067170 0x7f39380b6040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3938066130 tx=0x7f3934007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:26.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.336+0000 7f393dda6700 1 --2- 172.21.15.103:0/2261044767 >> v2:172.21.15.103:3300/0 conn(0x7f3938067170 0x7f39380b6040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3938066130 tx=0x7f3934007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:26.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.336+0000 7f393dda6700 1 --2- 172.21.15.103:0/2261044767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3938067170 0x7f39380b6040 secure :-1 s=READY pgs=647 cs=0 l=1 rx=0x7f3938066130 tx=0x7f3934007a40).ready entity=mon.1 client_cookie=10e5000e11398107 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:26.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.336+0000 7f393dda6700 1 --2- 172.21.15.103:0/2261044767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3938067170 0x7f39380b6040 secure :-1 s=THROTTLE_DONE pgs=647 cs=0 l=1 rx=0x7f3938066130 tx=0x7f3934007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:26.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.336+0000 7f393dda6700 1 --2- 172.21.15.103:0/2261044767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3938067170 0x7f39380b6040 secure :-1 s=THROTTLE_DONE pgs=647 cs=0 l=1 rx=0x7f3938066130 tx=0x7f3934007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:26.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.336+0000 7f393cda4700 1 -- 172.21.15.103:0/2261044767 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39340116e0 con 0x7f3938067170 2020-04-22T14:07:26.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.336+0000 7f393dda6700 1 --2- 172.21.15.103:0/2261044767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3938067170 0x7f39380b6040 secure :-1 s=THROTTLE_DONE pgs=647 cs=0 l=1 rx=0x7f3938066130 tx=0x7f3934007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:26.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.336+0000 7f393cda4700 1 -- 172.21.15.103:0/2261044767 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3934011840 con 0x7f3938067170 2020-04-22T14:07:26.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.336+0000 7f393cda4700 1 -- 172.21.15.103:0/2261044767 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3934011c20 con 0x7f3938067170 2020-04-22T14:07:26.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.336+0000 7f394000a700 1 -- 172.21.15.103:0/2261044767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3938067170 msgr2=0x7f39380b6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:26.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.336+0000 7f394000a700 1 --2- 172.21.15.103:0/2261044767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3938067170 0x7f39380b6040 secure :-1 s=READY pgs=647 cs=0 l=1 rx=0x7f3938066130 tx=0x7f3934007a40).stop 2020-04-22T14:07:26.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.337+0000 7f394000a700 1 -- 172.21.15.103:0/2261044767 shutdown_connections 2020-04-22T14:07:26.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.337+0000 7f394000a700 1 --2- 172.21.15.103:0/2261044767 >> v2:172.21.15.86:3300/0 conn(0x7f39381426d0 0x7f3938142b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:26.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.337+0000 7f394000a700 1 --2- 172.21.15.103:0/2261044767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3938067170 0x7f39380b6040 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:26.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.337+0000 7f394000a700 1 -- 172.21.15.103:0/2261044767 >> 172.21.15.103:0/2261044767 conn(0x7f39380b9160 msgr2=0x7f393805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:26.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.337+0000 7f394000a700 1 -- 172.21.15.103:0/2261044767 shutdown_connections 2020-04-22T14:07:26.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.337+0000 7f394000a700 1 -- 172.21.15.103:0/2261044767 wait complete. 2020-04-22T14:07:26.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.338+0000 7f394000a700 1 Processor -- start 2020-04-22T14:07:26.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.338+0000 7f394000a700 1 -- start start 2020-04-22T14:07:26.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.338+0000 7f394000a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3938067170 0x7f393813d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:26.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.338+0000 7f394000a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f39380ac740 0x7f3938132d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:26.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.338+0000 7f394000a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3938133170 con 0x7f39381426d0 2020-04-22T14:07:26.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.338+0000 7f394000a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f393813c9d0 con 0x7f3938067170 2020-04-22T14:07:26.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.338+0000 7f394000a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f393813cc70 con 0x7f39380ac740 2020-04-22T14:07:26.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.338+0000 7f393dda6700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3938067170 0x7f393813d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:26.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.338+0000 7f393dda6700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3938067170 0x7f393813d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50138/0 (socket says 172.21.15.103:50138) 2020-04-22T14:07:26.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.338+0000 7f393dda6700 1 -- 172.21.15.103:0/713714043 learned_addr learned my addr 172.21.15.103:0/713714043 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:26.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.339+0000 7f393d5a5700 1 --2- 172.21.15.103:0/713714043 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f39380ac740 0x7f3938132d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:26.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.339+0000 7f393dda6700 1 -- 172.21.15.103:0/713714043 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f39380ac740 msgr2=0x7f3938132d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:26.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.339+0000 7f393dda6700 1 --2- 172.21.15.103:0/713714043 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f39380ac740 0x7f3938132d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:26.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.339+0000 7f393dda6700 1 -- 172.21.15.103:0/713714043 >> v1:172.21.15.86:6789/0 conn(0x7f39381426d0 legacy=0x7f3938130ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:26.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.339+0000 7f393dda6700 1 -- 172.21.15.103:0/713714043 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f393813cf10 con 0x7f3938067170 2020-04-22T14:07:26.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.339+0000 7f393dda6700 1 --2- 172.21.15.103:0/713714043 >> v2:172.21.15.103:3300/0 conn(0x7f3938067170 0x7f393813d3b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3938133bd0 tx=0x7f3934007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:26.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.339+0000 7f393dda6700 1 --2- 172.21.15.103:0/713714043 >> v2:172.21.15.103:3300/0 conn(0x7f3938067170 0x7f393813d3b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3938133bd0 tx=0x7f3934007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:26.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.339+0000 7f393dda6700 1 --2- 172.21.15.103:0/713714043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3938067170 0x7f393813d3b0 secure :-1 s=READY pgs=648 cs=0 l=1 rx=0x7f3938133bd0 tx=0x7f3934007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:26.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.339+0000 7f393dda6700 1 --2- 172.21.15.103:0/713714043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3938067170 0x7f393813d3b0 secure :-1 s=THROTTLE_DONE pgs=648 cs=0 l=1 rx=0x7f3938133bd0 tx=0x7f3934007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:26.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.339+0000 7f3926ffd700 1 -- 172.21.15.103:0/713714043 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3934007360 con 0x7f3938067170 2020-04-22T14:07:26.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.339+0000 7f393dda6700 1 --2- 172.21.15.103:0/713714043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3938067170 0x7f393813d3b0 secure :-1 s=THROTTLE_DONE pgs=648 cs=0 l=1 rx=0x7f3938133bd0 tx=0x7f3934007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:26.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.339+0000 7f393dda6700 1 --2- 172.21.15.103:0/713714043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3938067170 0x7f393813d3b0 secure :-1 s=THROTTLE_DONE pgs=648 cs=0 l=1 rx=0x7f3938133bd0 tx=0x7f3934007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:26.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.339+0000 7f3926ffd700 1 -- 172.21.15.103:0/713714043 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39340074c0 con 0x7f3938067170 2020-04-22T14:07:26.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.339+0000 7f3926ffd700 1 -- 172.21.15.103:0/713714043 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39340058b0 con 0x7f3938067170 2020-04-22T14:07:26.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.339+0000 7f394000a700 1 -- 172.21.15.103:0/713714043 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f393813c650 con 0x7f3938067170 2020-04-22T14:07:26.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.339+0000 7f394000a700 1 -- 172.21.15.103:0/713714043 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39381315e0 con 0x7f3938067170 2020-04-22T14:07:26.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.339+0000 7f393dda6700 1 --2- 172.21.15.103:0/713714043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3938067170 0x7f393813d3b0 secure :-1 s=THROTTLE_DONE pgs=648 cs=0 l=1 rx=0x7f3938133bd0 tx=0x7f3934007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:26.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.340+0000 7f393dda6700 1 --2- 172.21.15.103:0/713714043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3938067170 0x7f393813d3b0 secure :-1 s=THROTTLE_DONE pgs=648 cs=0 l=1 rx=0x7f3938133bd0 tx=0x7f3934007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:26.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.340+0000 7f3926ffd700 1 -- 172.21.15.103:0/713714043 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f3934005a10 con 0x7f3938067170 2020-04-22T14:07:26.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.340+0000 7f394000a700 1 -- 172.21.15.103:0/713714043 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3938056c90 con 0x7f3938067170 2020-04-22T14:07:26.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.340+0000 7f3926ffd700 1 --2- 172.21.15.103:0/713714043 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f391804d9a0 0x7f391804fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:26.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.340+0000 7f3926ffd700 1 -- 172.21.15.103:0/713714043 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f3934061c50 con 0x7f3938067170 2020-04-22T14:07:26.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.340+0000 7f393d5a5700 1 --2- 172.21.15.103:0/713714043 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f391804d9a0 0x7f391804fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:26.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.341+0000 7f393d5a5700 1 --2- 172.21.15.103:0/713714043 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f391804d9a0 0x7f391804fe60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3928001f50 tx=0x7f3928002540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:26.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.341+0000 7f393d5a5700 1 --2- 172.21.15.103:0/713714043 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f391804d9a0 0x7f391804fe60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3928001f50 tx=0x7f3928002540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:26.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.341+0000 7f393d5a5700 1 --2- 172.21.15.103:0/713714043 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f391804d9a0 0x7f391804fe60 secure :-1 s=READY pgs=248 cs=0 l=1 rx=0x7f3928001f50 tx=0x7f3928002540).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:26.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.344+0000 7f393dda6700 1 --2- 172.21.15.103:0/713714043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3938067170 0x7f393813d3b0 secure :-1 s=THROTTLE_DONE pgs=648 cs=0 l=1 rx=0x7f3938133bd0 tx=0x7f3934007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:26.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.344+0000 7f3926ffd700 1 -- 172.21.15.103:0/713714043 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f393403d110 con 0x7f3938067170 2020-04-22T14:07:26.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.487+0000 7f394000a700 1 -- 172.21.15.103:0/713714043 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3938133170 con 0x7f3938067170 2020-04-22T14:07:26.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.488+0000 7f393dda6700 1 --2- 172.21.15.103:0/713714043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3938067170 0x7f393813d3b0 secure :-1 s=THROTTLE_DONE pgs=648 cs=0 l=1 rx=0x7f3938133bd0 tx=0x7f3934007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:26.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.488+0000 7f3926ffd700 1 -- 172.21.15.103:0/713714043 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+13232 (secure 0 0 0) 0x7f3938133170 con 0x7f3938067170 2020-04-22T14:07:26.490 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:07:26.491 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":49,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:07:25.720037+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:07:26.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.489+0000 7f394000a700 1 -- 172.21.15.103:0/713714043 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f391804d9a0 msgr2=0x7f391804fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:26.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.489+0000 7f394000a700 1 --2- 172.21.15.103:0/713714043 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f391804d9a0 0x7f391804fe60 secure :-1 s=READY pgs=248 cs=0 l=1 rx=0x7f3928001f50 tx=0x7f3928002540).stop 2020-04-22T14:07:26.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.489+0000 7f394000a700 1 -- 172.21.15.103:0/713714043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3938067170 msgr2=0x7f393813d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:26.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.489+0000 7f394000a700 1 --2- 172.21.15.103:0/713714043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3938067170 0x7f393813d3b0 secure :-1 s=READY pgs=648 cs=0 l=1 rx=0x7f3938133bd0 tx=0x7f3934007a40).stop 2020-04-22T14:07:26.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.490+0000 7f394000a700 1 -- 172.21.15.103:0/713714043 shutdown_connections 2020-04-22T14:07:26.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.490+0000 7f394000a700 1 --2- 172.21.15.103:0/713714043 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f391804d9a0 0x7f391804fe60 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:26.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.490+0000 7f394000a700 1 --2- 172.21.15.103:0/713714043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3938067170 0x7f393813d3b0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:26.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.490+0000 7f394000a700 1 --2- 172.21.15.103:0/713714043 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f39380ac740 0x7f3938132d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:26.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.490+0000 7f394000a700 1 -- 172.21.15.103:0/713714043 >> 172.21.15.103:0/713714043 conn(0x7f39380b9160 msgr2=0x7f39380b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:26.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.490+0000 7f394000a700 1 -- 172.21.15.103:0/713714043 shutdown_connections 2020-04-22T14:07:26.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.490+0000 7f394000a700 1 -- 172.21.15.103:0/713714043 wait complete. 2020-04-22T14:07:26.503 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:07:26.503 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:26.516 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:07:26.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.663+0000 7fe7317c2700 1 Processor -- start 2020-04-22T14:07:26.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.663+0000 7fe7317c2700 1 -- start start 2020-04-22T14:07:26.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.663+0000 7fe7317c2700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe72c0b4820 0x7fe72c0acb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:26.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.663+0000 7fe7317c2700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe72c0af030 con 0x7fe72c061a30 2020-04-22T14:07:26.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.663+0000 7fe7317c2700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe72c060250 con 0x7fe72c141f20 2020-04-22T14:07:26.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.663+0000 7fe7317c2700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe72c0623c0 con 0x7fe72c0b4820 2020-04-22T14:07:26.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.664+0000 7fe72b7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe72c141f20 0x7fe72c142380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42336/0 (socket says 172.21.15.103:42336) 2020-04-22T14:07:26.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.664+0000 7fe72b7fe700 1 -- 172.21.15.103:0/4107403302 learned_addr learned my addr 172.21.15.103:0/4107403302 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:26.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.664+0000 7fe72a7fc700 1 --2- 172.21.15.103:0/4107403302 >> v2:172.21.15.86:3300/0 conn(0x7fe72c0b4820 0x7fe72c0acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:26.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.664+0000 7fe729ffb700 1 -- 172.21.15.103:0/4107403302 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3117904431 0 0) 0x7fe72c060250 con 0x7fe72c141f20 2020-04-22T14:07:26.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.664+0000 7fe729ffb700 1 -- 172.21.15.103:0/4107403302 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe70c003230 con 0x7fe72c141f20 2020-04-22T14:07:26.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.664+0000 7fe729ffb700 1 -- 172.21.15.103:0/4107403302 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2281476507 0 0) 0x7fe70c003230 con 0x7fe72c141f20 2020-04-22T14:07:26.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.664+0000 7fe729ffb700 1 -- 172.21.15.103:0/4107403302 >> v2:172.21.15.86:3300/0 conn(0x7fe72c0b4820 msgr2=0x7fe72c0acb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:26.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.664+0000 7fe729ffb700 1 --2- 172.21.15.103:0/4107403302 >> v2:172.21.15.86:3300/0 conn(0x7fe72c0b4820 0x7fe72c0acb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:26.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.664+0000 7fe729ffb700 1 -- 172.21.15.103:0/4107403302 >> v1:172.21.15.86:6789/0 conn(0x7fe72c061a30 legacy=0x7fe72c0ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:26.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.664+0000 7fe729ffb700 1 -- 172.21.15.103:0/4107403302 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe72c062660 con 0x7fe72c141f20 2020-04-22T14:07:26.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.664+0000 7fe729ffb700 1 -- 172.21.15.103:0/4107403302 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fe724001a50 con 0x7fe72c141f20 2020-04-22T14:07:26.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.664+0000 7fe729ffb700 1 -- 172.21.15.103:0/4107403302 >> v1:172.21.15.103:6789/0 conn(0x7fe72c141f20 legacy=0x7fe72c142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:26.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.664+0000 7fe729ffb700 1 --2- 172.21.15.103:0/4107403302 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe70c003720 0x7fe70c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:26.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.664+0000 7fe729ffb700 1 --2- 172.21.15.103:0/4107403302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe70c0044d0 0x7fe70c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:26.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.664+0000 7fe729ffb700 1 --2- 172.21.15.103:0/4107403302 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe70c004db0 0x7fe70c00c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:26.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.664+0000 7fe729ffb700 1 -- 172.21.15.103:0/4107403302 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72c0623c0 con 0x7fe70c003720 2020-04-22T14:07:26.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.664+0000 7fe729ffb700 1 -- 172.21.15.103:0/4107403302 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c0041c0 con 0x7fe70c0044d0 2020-04-22T14:07:26.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.664+0000 7fe729ffb700 1 -- 172.21.15.103:0/4107403302 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c00cc90 con 0x7fe70c004db0 2020-04-22T14:07:26.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.664+0000 7fe72a7fc700 1 --2- 172.21.15.103:0/4107403302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe70c0044d0 0x7fe70c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:26.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.664+0000 7fe72affd700 1 --2- 172.21.15.103:0/4107403302 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe70c003720 0x7fe70c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:26.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.664+0000 7fe72b7fe700 1 --2- 172.21.15.103:0/4107403302 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe70c004db0 0x7fe70c00c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:26.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.665+0000 7fe72a7fc700 1 -- 172.21.15.103:0/4107403302 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe70c004db0 msgr2=0x7fe70c00c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:26.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.665+0000 7fe72a7fc700 1 --2- 172.21.15.103:0/4107403302 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe70c004db0 0x7fe70c00c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:26.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.665+0000 7fe72a7fc700 1 -- 172.21.15.103:0/4107403302 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe70c003720 msgr2=0x7fe70c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:26.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.665+0000 7fe72a7fc700 1 --2- 172.21.15.103:0/4107403302 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe70c003720 0x7fe70c003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:26.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.665+0000 7fe72a7fc700 1 -- 172.21.15.103:0/4107403302 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe70c003230 con 0x7fe70c0044d0 2020-04-22T14:07:26.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.665+0000 7fe72b7fe700 1 -- 172.21.15.103:0/4107403302 reap_dead start 2020-04-22T14:07:26.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.665+0000 7fe72a7fc700 1 --2- 172.21.15.103:0/4107403302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe70c0044d0 0x7fe70c004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe70c0054a0 tx=0x7fe71c010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:26.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.665+0000 7fe72a7fc700 1 --2- 172.21.15.103:0/4107403302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe70c0044d0 0x7fe70c004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe70c0054a0 tx=0x7fe71c010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:26.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.665+0000 7fe72a7fc700 1 --2- 172.21.15.103:0/4107403302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe70c0044d0 0x7fe70c004950 secure :-1 s=READY pgs=650 cs=0 l=1 rx=0x7fe70c0054a0 tx=0x7fe71c010050).ready entity=mon.1 client_cookie=7ce997dda43e488c server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:26.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.665+0000 7fe72a7fc700 1 --2- 172.21.15.103:0/4107403302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe70c0044d0 0x7fe70c004950 secure :-1 s=THROTTLE_DONE pgs=650 cs=0 l=1 rx=0x7fe70c0054a0 tx=0x7fe71c010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:26.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.665+0000 7fe729ffb700 1 -- 172.21.15.103:0/4107403302 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe71c008cf0 con 0x7fe70c0044d0 2020-04-22T14:07:26.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.665+0000 7fe72a7fc700 1 --2- 172.21.15.103:0/4107403302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe70c0044d0 0x7fe70c004950 secure :-1 s=THROTTLE_DONE pgs=650 cs=0 l=1 rx=0x7fe70c0054a0 tx=0x7fe71c010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:26.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.665+0000 7fe72a7fc700 1 --2- 172.21.15.103:0/4107403302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe70c0044d0 0x7fe70c004950 secure :-1 s=THROTTLE_DONE pgs=650 cs=0 l=1 rx=0x7fe70c0054a0 tx=0x7fe71c010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:26.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.665+0000 7fe729ffb700 1 -- 172.21.15.103:0/4107403302 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71c008e50 con 0x7fe70c0044d0 2020-04-22T14:07:26.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.665+0000 7fe729ffb700 1 -- 172.21.15.103:0/4107403302 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe71c010a80 con 0x7fe70c0044d0 2020-04-22T14:07:26.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.665+0000 7fe7317c2700 1 -- 172.21.15.103:0/4107403302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe70c0044d0 msgr2=0x7fe70c004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:26.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.665+0000 7fe7317c2700 1 --2- 172.21.15.103:0/4107403302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe70c0044d0 0x7fe70c004950 secure :-1 s=READY pgs=650 cs=0 l=1 rx=0x7fe70c0054a0 tx=0x7fe71c010050).stop 2020-04-22T14:07:26.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.665+0000 7fe7317c2700 1 -- 172.21.15.103:0/4107403302 shutdown_connections 2020-04-22T14:07:26.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.665+0000 7fe7317c2700 1 --2- 172.21.15.103:0/4107403302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe70c0044d0 0x7fe70c004950 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:26.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.665+0000 7fe7317c2700 1 -- 172.21.15.103:0/4107403302 >> 172.21.15.103:0/4107403302 conn(0x7fe72c05b7b0 msgr2=0x7fe72c0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:26.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.665+0000 7fe7317c2700 1 -- 172.21.15.103:0/4107403302 shutdown_connections 2020-04-22T14:07:26.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.665+0000 7fe7317c2700 1 -- 172.21.15.103:0/4107403302 wait complete. 2020-04-22T14:07:26.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.666+0000 7fe7317c2700 1 Processor -- start 2020-04-22T14:07:26.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.666+0000 7fe7317c2700 1 -- start start 2020-04-22T14:07:26.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.667+0000 7fe7317c2700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe70c0044d0 0x7fe72c064150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:26.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.667+0000 7fe7317c2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe72c0b6770 0x7fe72c153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:26.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.667+0000 7fe7317c2700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe72c0645b0 con 0x7fe72c153c80 2020-04-22T14:07:26.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.667+0000 7fe7317c2700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe72c143350 con 0x7fe70c0044d0 2020-04-22T14:07:26.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.667+0000 7fe7317c2700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe72c0647f0 con 0x7fe72c0b6770 2020-04-22T14:07:26.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.667+0000 7fe72a7fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe72c0b6770 0x7fe72c153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:26.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.667+0000 7fe72a7fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe72c0b6770 0x7fe72c153820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50158/0 (socket says 172.21.15.103:50158) 2020-04-22T14:07:26.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.667+0000 7fe72a7fc700 1 -- 172.21.15.103:0/2369568059 learned_addr learned my addr 172.21.15.103:0/2369568059 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:26.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.667+0000 7fe72affd700 1 --2- 172.21.15.103:0/2369568059 >> v2:172.21.15.86:3300/0 conn(0x7fe70c0044d0 0x7fe72c064150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:26.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.667+0000 7fe72a7fc700 1 -- 172.21.15.103:0/2369568059 >> v2:172.21.15.86:3300/0 conn(0x7fe70c0044d0 msgr2=0x7fe72c064150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:26.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.667+0000 7fe72a7fc700 1 --2- 172.21.15.103:0/2369568059 >> v2:172.21.15.86:3300/0 conn(0x7fe70c0044d0 0x7fe72c064150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:26.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.667+0000 7fe72a7fc700 1 -- 172.21.15.103:0/2369568059 >> v1:172.21.15.86:6789/0 conn(0x7fe72c153c80 legacy=0x7fe72c154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:26.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.667+0000 7fe72a7fc700 1 -- 172.21.15.103:0/2369568059 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe72c064a90 con 0x7fe72c0b6770 2020-04-22T14:07:26.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.668+0000 7fe72a7fc700 1 --2- 172.21.15.103:0/2369568059 >> v2:172.21.15.103:3300/0 conn(0x7fe72c0b6770 0x7fe72c153820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe72c0b7040 tx=0x7fe71c010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:26.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.668+0000 7fe72a7fc700 1 --2- 172.21.15.103:0/2369568059 >> v2:172.21.15.103:3300/0 conn(0x7fe72c0b6770 0x7fe72c153820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe72c0b7040 tx=0x7fe71c010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:26.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.668+0000 7fe72a7fc700 1 --2- 172.21.15.103:0/2369568059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe72c0b6770 0x7fe72c153820 secure :-1 s=READY pgs=651 cs=0 l=1 rx=0x7fe72c0b7040 tx=0x7fe71c010050).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:26.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.668+0000 7fe72a7fc700 1 --2- 172.21.15.103:0/2369568059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe72c0b6770 0x7fe72c153820 secure :-1 s=THROTTLE_DONE pgs=651 cs=0 l=1 rx=0x7fe72c0b7040 tx=0x7fe71c010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:26.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.668+0000 7fe723fff700 1 -- 172.21.15.103:0/2369568059 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe71c0058b0 con 0x7fe72c0b6770 2020-04-22T14:07:26.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.668+0000 7fe72a7fc700 1 --2- 172.21.15.103:0/2369568059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe72c0b6770 0x7fe72c153820 secure :-1 s=THROTTLE_DONE pgs=651 cs=0 l=1 rx=0x7fe72c0b7040 tx=0x7fe71c010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:26.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.668+0000 7fe72a7fc700 1 --2- 172.21.15.103:0/2369568059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe72c0b6770 0x7fe72c153820 secure :-1 s=THROTTLE_DONE pgs=651 cs=0 l=1 rx=0x7fe72c0b7040 tx=0x7fe71c010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:26.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.668+0000 7fe723fff700 1 -- 172.21.15.103:0/2369568059 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71c005a10 con 0x7fe72c0b6770 2020-04-22T14:07:26.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.668+0000 7fe7317c2700 1 -- 172.21.15.103:0/2369568059 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe72c064d30 con 0x7fe72c0b6770 2020-04-22T14:07:26.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.668+0000 7fe723fff700 1 -- 172.21.15.103:0/2369568059 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe71c005d70 con 0x7fe72c0b6770 2020-04-22T14:07:26.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.668+0000 7fe7317c2700 1 -- 172.21.15.103:0/2369568059 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe72c0b6be0 con 0x7fe72c0b6770 2020-04-22T14:07:26.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.668+0000 7fe72a7fc700 1 --2- 172.21.15.103:0/2369568059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe72c0b6770 0x7fe72c153820 secure :-1 s=THROTTLE_DONE pgs=651 cs=0 l=1 rx=0x7fe72c0b7040 tx=0x7fe71c010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:26.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.669+0000 7fe7317c2700 1 -- 172.21.15.103:0/2369568059 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe72c056c90 con 0x7fe72c0b6770 2020-04-22T14:07:26.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.669+0000 7fe723fff700 1 -- 172.21.15.103:0/2369568059 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fe71c00a1a0 con 0x7fe72c0b6770 2020-04-22T14:07:26.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.669+0000 7fe72a7fc700 1 --2- 172.21.15.103:0/2369568059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe72c0b6770 0x7fe72c153820 secure :-1 s=THROTTLE_DONE pgs=651 cs=0 l=1 rx=0x7fe72c0b7040 tx=0x7fe71c010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:26.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.669+0000 7fe723fff700 1 --2- 172.21.15.103:0/2369568059 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe71004d960 0x7fe71004fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:26.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.669+0000 7fe723fff700 1 -- 172.21.15.103:0/2369568059 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fe71c061710 con 0x7fe72c0b6770 2020-04-22T14:07:26.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.669+0000 7fe72affd700 1 --2- 172.21.15.103:0/2369568059 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe71004d960 0x7fe71004fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:26.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.669+0000 7fe72affd700 1 --2- 172.21.15.103:0/2369568059 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe71004d960 0x7fe71004fe20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe72c05bc40 tx=0x7fe71400c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:26.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.669+0000 7fe72affd700 1 --2- 172.21.15.103:0/2369568059 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe71004d960 0x7fe71004fe20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe72c05bc40 tx=0x7fe71400c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:26.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.670+0000 7fe72affd700 1 --2- 172.21.15.103:0/2369568059 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe71004d960 0x7fe71004fe20 secure :-1 s=READY pgs=249 cs=0 l=1 rx=0x7fe72c05bc40 tx=0x7fe71400c820).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:26.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.673+0000 7fe72a7fc700 1 --2- 172.21.15.103:0/2369568059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe72c0b6770 0x7fe72c153820 secure :-1 s=THROTTLE_DONE pgs=651 cs=0 l=1 rx=0x7fe72c0b7040 tx=0x7fe71c010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:26.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.673+0000 7fe723fff700 1 -- 172.21.15.103:0/2369568059 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fe71c03caf0 con 0x7fe72c0b6770 2020-04-22T14:07:26.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.813+0000 7fe7317c2700 1 -- 172.21.15.103:0/2369568059 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe72c067be0 con 0x7fe72c0b6770 2020-04-22T14:07:26.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.814+0000 7fe72a7fc700 1 --2- 172.21.15.103:0/2369568059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe72c0b6770 0x7fe72c153820 secure :-1 s=THROTTLE_DONE pgs=651 cs=0 l=1 rx=0x7fe72c0b7040 tx=0x7fe71c010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:26.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.814+0000 7fe723fff700 1 -- 172.21.15.103:0/2369568059 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v49) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe71c040110 con 0x7fe72c0b6770 2020-04-22T14:07:26.817 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:07:26.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.815+0000 7fe7317c2700 1 -- 172.21.15.103:0/2369568059 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe71004d960 msgr2=0x7fe71004fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:26.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.815+0000 7fe7317c2700 1 --2- 172.21.15.103:0/2369568059 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe71004d960 0x7fe71004fe20 secure :-1 s=READY pgs=249 cs=0 l=1 rx=0x7fe72c05bc40 tx=0x7fe71400c820).stop 2020-04-22T14:07:26.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.815+0000 7fe7317c2700 1 -- 172.21.15.103:0/2369568059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe72c0b6770 msgr2=0x7fe72c153820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:26.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.815+0000 7fe7317c2700 1 --2- 172.21.15.103:0/2369568059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe72c0b6770 0x7fe72c153820 secure :-1 s=READY pgs=651 cs=0 l=1 rx=0x7fe72c0b7040 tx=0x7fe71c010050).stop 2020-04-22T14:07:26.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.815+0000 7fe7317c2700 1 -- 172.21.15.103:0/2369568059 shutdown_connections 2020-04-22T14:07:26.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.815+0000 7fe7317c2700 1 --2- 172.21.15.103:0/2369568059 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe71004d960 0x7fe71004fe20 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:26.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.815+0000 7fe7317c2700 1 --2- 172.21.15.103:0/2369568059 >> v2:172.21.15.86:3300/0 conn(0x7fe70c0044d0 0x7fe72c064150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:26.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.815+0000 7fe7317c2700 1 --2- 172.21.15.103:0/2369568059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe72c0b6770 0x7fe72c153820 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:26.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.815+0000 7fe7317c2700 1 -- 172.21.15.103:0/2369568059 >> 172.21.15.103:0/2369568059 conn(0x7fe72c05b7b0 msgr2=0x7fe72c0b7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:26.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.815+0000 7fe7317c2700 1 -- 172.21.15.103:0/2369568059 shutdown_connections 2020-04-22T14:07:26.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.815+0000 7fe7317c2700 1 -- 172.21.15.103:0/2369568059 wait complete. 2020-04-22T14:07:26.827 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:26.841 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:07:26.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.987+0000 7f0e49927700 1 Processor -- start 2020-04-22T14:07:26.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.987+0000 7f0e49927700 1 -- start start 2020-04-22T14:07:26.991 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.988+0000 7f0e49927700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e44061800 0x7f0e44145020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:26.991 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.988+0000 7f0e49927700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0e440b2bb0 0x7f0e440b3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:26.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.988+0000 7f0e49927700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e440b47e0 con 0x7f0e440af1b0 2020-04-22T14:07:26.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.988+0000 7f0e49927700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e440ace40 con 0x7f0e440b2bb0 2020-04-22T14:07:26.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.988+0000 7f0e49927700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e440ac740 con 0x7f0e44061800 2020-04-22T14:07:26.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.989+0000 7f0e437fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0e440b2bb0 0x7f0e440b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:26.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.989+0000 7f0e42ffd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e44061800 0x7f0e44145020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:26.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.989+0000 7f0e437fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0e440b2bb0 0x7f0e440b3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:47396/0 (socket says 172.21.15.103:47396) 2020-04-22T14:07:26.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.989+0000 7f0e427fc700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f0e440af1b0 0x7f0e44145480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:59510/0 (socket says 172.21.15.103:59510) 2020-04-22T14:07:26.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.989+0000 7f0e42ffd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e44061800 0x7f0e44145020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:34946/0 (socket says 172.21.15.103:34946) 2020-04-22T14:07:26.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.989+0000 7f0e437fe700 1 -- 172.21.15.103:0/26859307 learned_addr learned my addr 172.21.15.103:0/26859307 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:26.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.989+0000 7f0e42ffd700 1 -- 172.21.15.103:0/26859307 >> v2:172.21.15.86:3300/0 conn(0x7f0e440b2bb0 msgr2=0x7f0e440b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:26.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.989+0000 7f0e42ffd700 1 --2- 172.21.15.103:0/26859307 >> v2:172.21.15.86:3300/0 conn(0x7f0e440b2bb0 0x7f0e440b3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:26.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.989+0000 7f0e42ffd700 1 -- 172.21.15.103:0/26859307 >> v1:172.21.15.86:6789/0 conn(0x7f0e440af1b0 legacy=0x7f0e44145480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:26.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.989+0000 7f0e42ffd700 1 -- 172.21.15.103:0/26859307 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e440b4a10 con 0x7f0e44061800 2020-04-22T14:07:26.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.989+0000 7f0e42ffd700 1 --2- 172.21.15.103:0/26859307 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e44061800 0x7f0e44145020 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0e440b5a70 tx=0x7f0e340088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:26.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.989+0000 7f0e42ffd700 1 --2- 172.21.15.103:0/26859307 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e44061800 0x7f0e44145020 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0e440b5a70 tx=0x7f0e340088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:26.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.989+0000 7f0e42ffd700 1 --2- 172.21.15.103:0/26859307 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e44061800 0x7f0e44145020 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f0e440b5a70 tx=0x7f0e340088e0).ready entity=mon.2 client_cookie=502cd2cd1cd52f18 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:26.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.989+0000 7f0e42ffd700 1 --2- 172.21.15.103:0/26859307 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e44061800 0x7f0e44145020 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f0e440b5a70 tx=0x7f0e340088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:26.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.989+0000 7f0e42ffd700 1 --2- 172.21.15.103:0/26859307 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e44061800 0x7f0e44145020 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f0e440b5a70 tx=0x7f0e340088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:26.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.989+0000 7f0e42ffd700 1 --2- 172.21.15.103:0/26859307 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e44061800 0x7f0e44145020 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f0e440b5a70 tx=0x7f0e340088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:26.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.990+0000 7f0e41ffb700 1 -- 172.21.15.103:0/26859307 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e34008e40 con 0x7f0e44061800 2020-04-22T14:07:26.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.990+0000 7f0e41ffb700 1 -- 172.21.15.103:0/26859307 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e340115b0 con 0x7f0e44061800 2020-04-22T14:07:26.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.990+0000 7f0e41ffb700 1 -- 172.21.15.103:0/26859307 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e340119d0 con 0x7f0e44061800 2020-04-22T14:07:26.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.990+0000 7f0e49927700 1 -- 172.21.15.103:0/26859307 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e44061800 msgr2=0x7f0e44145020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:26.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.990+0000 7f0e49927700 1 --2- 172.21.15.103:0/26859307 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e44061800 0x7f0e44145020 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f0e440b5a70 tx=0x7f0e340088e0).stop 2020-04-22T14:07:26.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.991+0000 7f0e49927700 1 -- 172.21.15.103:0/26859307 shutdown_connections 2020-04-22T14:07:26.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.991+0000 7f0e49927700 1 --2- 172.21.15.103:0/26859307 >> v2:172.21.15.86:3300/0 conn(0x7f0e440b2bb0 0x7f0e440b3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:26.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.991+0000 7f0e49927700 1 --2- 172.21.15.103:0/26859307 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e44061800 0x7f0e44145020 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:26.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.991+0000 7f0e49927700 1 -- 172.21.15.103:0/26859307 >> 172.21.15.103:0/26859307 conn(0x7f0e44069f30 msgr2=0x7f0e4405b180 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:26.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.991+0000 7f0e49927700 1 -- 172.21.15.103:0/26859307 shutdown_connections 2020-04-22T14:07:26.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.991+0000 7f0e49927700 1 -- 172.21.15.103:0/26859307 wait complete. 2020-04-22T14:07:26.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.992+0000 7f0e49927700 1 Processor -- start 2020-04-22T14:07:26.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.992+0000 7f0e49927700 1 -- start start 2020-04-22T14:07:26.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.992+0000 7f0e49927700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e440b2bb0 0x7f0e44065bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:27.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.992+0000 7f0e49927700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e44066370 con 0x7f0e44061800 2020-04-22T14:07:27.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.992+0000 7f0e49927700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e44066610 con 0x7f0e440af1b0 2020-04-22T14:07:27.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.992+0000 7f0e49927700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e44066190 con 0x7f0e440b2bb0 2020-04-22T14:07:27.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.992+0000 7f0e427fc700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f0e440af1b0 0x7f0e44062800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42362/0 (socket says 172.21.15.103:42362) 2020-04-22T14:07:27.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.992+0000 7f0e427fc700 1 -- 172.21.15.103:0/3310654639 learned_addr learned my addr 172.21.15.103:0/3310654639 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:27.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.992+0000 7f0e437fe700 1 --2- 172.21.15.103:0/3310654639 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e440b2bb0 0x7f0e44065bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:27.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.993+0000 7f0e3bfff700 1 -- 172.21.15.103:0/3310654639 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3673236844 0 0) 0x7f0e44066610 con 0x7f0e440af1b0 2020-04-22T14:07:27.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.993+0000 7f0e3bfff700 1 -- 172.21.15.103:0/3310654639 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e28002fe0 con 0x7f0e440af1b0 2020-04-22T14:07:27.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.993+0000 7f0e3bfff700 1 -- 172.21.15.103:0/3310654639 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1331187401 0 0) 0x7f0e44066370 con 0x7f0e44061800 2020-04-22T14:07:27.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.993+0000 7f0e3bfff700 1 -- 172.21.15.103:0/3310654639 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e44066610 con 0x7f0e44061800 2020-04-22T14:07:27.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.993+0000 7f0e437fe700 1 -- 172.21.15.103:0/3310654639 >> v1:172.21.15.103:6789/0 conn(0x7f0e440af1b0 legacy=0x7f0e44062800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:27.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.993+0000 7f0e437fe700 1 -- 172.21.15.103:0/3310654639 >> v1:172.21.15.86:6789/0 conn(0x7f0e44061800 legacy=0x7f0e441389b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:27.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.993+0000 7f0e437fe700 1 -- 172.21.15.103:0/3310654639 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e44066ab0 con 0x7f0e440b2bb0 2020-04-22T14:07:27.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.993+0000 7f0e437fe700 1 --2- 172.21.15.103:0/3310654639 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e440b2bb0 0x7f0e44065bc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0e3c0032b0 tx=0x7f0e3c010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.993+0000 7f0e437fe700 1 --2- 172.21.15.103:0/3310654639 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e440b2bb0 0x7f0e44065bc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0e3c0032b0 tx=0x7f0e3c010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.993+0000 7f0e437fe700 1 --2- 172.21.15.103:0/3310654639 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e440b2bb0 0x7f0e44065bc0 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7f0e3c0032b0 tx=0x7f0e3c010ec0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:27.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.993+0000 7f0e437fe700 1 --2- 172.21.15.103:0/3310654639 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e440b2bb0 0x7f0e44065bc0 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f0e3c0032b0 tx=0x7f0e3c010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.993+0000 7f0e3bfff700 1 -- 172.21.15.103:0/3310654639 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e3c00e370 con 0x7f0e440b2bb0 2020-04-22T14:07:27.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.993+0000 7f0e437fe700 1 --2- 172.21.15.103:0/3310654639 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e440b2bb0 0x7f0e44065bc0 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f0e3c0032b0 tx=0x7f0e3c010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.993+0000 7f0e3bfff700 1 -- 172.21.15.103:0/3310654639 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3c005c30 con 0x7f0e440b2bb0 2020-04-22T14:07:27.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.993+0000 7f0e437fe700 1 --2- 172.21.15.103:0/3310654639 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e440b2bb0 0x7f0e44065bc0 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f0e3c0032b0 tx=0x7f0e3c010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.993+0000 7f0e49927700 1 -- 172.21.15.103:0/3310654639 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e44139690 con 0x7f0e440b2bb0 2020-04-22T14:07:27.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.993+0000 7f0e3bfff700 1 -- 172.21.15.103:0/3310654639 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e3c00c900 con 0x7f0e440b2bb0 2020-04-22T14:07:27.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.993+0000 7f0e49927700 1 -- 172.21.15.103:0/3310654639 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e4413c610 con 0x7f0e440b2bb0 2020-04-22T14:07:27.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.994+0000 7f0e437fe700 1 --2- 172.21.15.103:0/3310654639 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e440b2bb0 0x7f0e44065bc0 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f0e3c0032b0 tx=0x7f0e3c010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.994+0000 7f0e49927700 1 -- 172.21.15.103:0/3310654639 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e440667a0 con 0x7f0e440b2bb0 2020-04-22T14:07:27.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.994+0000 7f0e3bfff700 1 -- 172.21.15.103:0/3310654639 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f0e3c00cb00 con 0x7f0e440b2bb0 2020-04-22T14:07:27.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.994+0000 7f0e437fe700 1 --2- 172.21.15.103:0/3310654639 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e440b2bb0 0x7f0e44065bc0 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f0e3c0032b0 tx=0x7f0e3c010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.995+0000 7f0e3bfff700 1 --2- 172.21.15.103:0/3310654639 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0e2804de60 0x7f0e28050320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:27.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.995+0000 7f0e3bfff700 1 -- 172.21.15.103:0/3310654639 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f0e3c061140 con 0x7f0e440b2bb0 2020-04-22T14:07:27.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.995+0000 7f0e42ffd700 1 --2- 172.21.15.103:0/3310654639 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0e2804de60 0x7f0e28050320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:27.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.995+0000 7f0e42ffd700 1 --2- 172.21.15.103:0/3310654639 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0e2804de60 0x7f0e28050320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0e34007ed0 tx=0x7f0e34011360).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.995+0000 7f0e42ffd700 1 --2- 172.21.15.103:0/3310654639 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0e2804de60 0x7f0e28050320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0e34007ed0 tx=0x7f0e34011360).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.995+0000 7f0e42ffd700 1 --2- 172.21.15.103:0/3310654639 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0e2804de60 0x7f0e28050320 secure :-1 s=READY pgs=250 cs=0 l=1 rx=0x7f0e34007ed0 tx=0x7f0e34011360).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:27.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.998+0000 7f0e437fe700 1 --2- 172.21.15.103:0/3310654639 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e440b2bb0 0x7f0e44065bc0 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f0e3c0032b0 tx=0x7f0e3c010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:26.998+0000 7f0e3bfff700 1 -- 172.21.15.103:0/3310654639 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f0e3c03c5e0 con 0x7f0e440b2bb0 2020-04-22T14:07:27.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.140+0000 7f0e49927700 1 -- 172.21.15.103:0/3310654639 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0e44056c90 con 0x7f0e440b2bb0 2020-04-22T14:07:27.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.140+0000 7f0e437fe700 1 --2- 172.21.15.103:0/3310654639 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e440b2bb0 0x7f0e44065bc0 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f0e3c0032b0 tx=0x7f0e3c010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.141+0000 7f0e3bfff700 1 -- 172.21.15.103:0/3310654639 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v49) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0e3c03fc00 con 0x7f0e440b2bb0 2020-04-22T14:07:27.143 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:07:27.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.142+0000 7f0e49927700 1 -- 172.21.15.103:0/3310654639 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0e2804de60 msgr2=0x7f0e28050320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:27.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.142+0000 7f0e49927700 1 --2- 172.21.15.103:0/3310654639 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0e2804de60 0x7f0e28050320 secure :-1 s=READY pgs=250 cs=0 l=1 rx=0x7f0e34007ed0 tx=0x7f0e34011360).stop 2020-04-22T14:07:27.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.142+0000 7f0e49927700 1 -- 172.21.15.103:0/3310654639 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e440b2bb0 msgr2=0x7f0e44065bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:27.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.142+0000 7f0e49927700 1 --2- 172.21.15.103:0/3310654639 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e440b2bb0 0x7f0e44065bc0 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7f0e3c0032b0 tx=0x7f0e3c010ec0).stop 2020-04-22T14:07:27.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.142+0000 7f0e49927700 1 -- 172.21.15.103:0/3310654639 shutdown_connections 2020-04-22T14:07:27.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.142+0000 7f0e49927700 1 --2- 172.21.15.103:0/3310654639 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0e2804de60 0x7f0e28050320 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:27.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.142+0000 7f0e49927700 1 --2- 172.21.15.103:0/3310654639 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e440b2bb0 0x7f0e44065bc0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:27.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.142+0000 7f0e49927700 1 -- 172.21.15.103:0/3310654639 >> 172.21.15.103:0/3310654639 conn(0x7f0e44069f30 msgr2=0x7f0e440b6410 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:27.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.142+0000 7f0e49927700 1 -- 172.21.15.103:0/3310654639 shutdown_connections 2020-04-22T14:07:27.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.142+0000 7f0e49927700 1 -- 172.21.15.103:0/3310654639 wait complete. 2020-04-22T14:07:27.154 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:27.169 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-04-22T14:07:27.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.313+0000 7f1410ab8700 1 Processor -- start 2020-04-22T14:07:27.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.313+0000 7f1410ab8700 1 -- start start 2020-04-22T14:07:27.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.314+0000 7f1410ab8700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f140c12c0d0 0x7f140c1464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:27.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.314+0000 7f1410ab8700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f140c063e30 0x7f140c0642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:27.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.314+0000 7f1410ab8700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f140c143300 con 0x7f140c065fe0 2020-04-22T14:07:27.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.314+0000 7f1410ab8700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f140c1435a0 con 0x7f140c12c0d0 2020-04-22T14:07:27.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.314+0000 7f1410ab8700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f140c143840 con 0x7f140c063e30 2020-04-22T14:07:27.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.314+0000 7f140a59c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f140c12c0d0 0x7f140c1464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:27.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.314+0000 7f140a59c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f140c12c0d0 0x7f140c1464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50178/0 (socket says 172.21.15.103:50178) 2020-04-22T14:07:27.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.314+0000 7f140a59c700 1 -- 172.21.15.103:0/2908291493 learned_addr learned my addr 172.21.15.103:0/2908291493 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:27.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.315+0000 7f140ad9d700 1 --2- 172.21.15.103:0/2908291493 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f140c063e30 0x7f140c0642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:27.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.315+0000 7f140a59c700 1 -- 172.21.15.103:0/2908291493 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f140c063e30 msgr2=0x7f140c0642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:27.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.315+0000 7f140a59c700 1 --2- 172.21.15.103:0/2908291493 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f140c063e30 0x7f140c0642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:27.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.315+0000 7f140a59c700 1 -- 172.21.15.103:0/2908291493 >> v1:172.21.15.86:6789/0 conn(0x7f140c065fe0 legacy=0x7f140c05b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:27.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.315+0000 7f140a59c700 1 -- 172.21.15.103:0/2908291493 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f140c05bb50 con 0x7f140c12c0d0 2020-04-22T14:07:27.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.315+0000 7f140ad9d700 1 --2- 172.21.15.103:0/2908291493 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f140c063e30 0x7f140c0642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:07:27.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.315+0000 7f140a59c700 1 --2- 172.21.15.103:0/2908291493 >> v2:172.21.15.103:3300/0 conn(0x7f140c12c0d0 0x7f140c1464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1400002f30 tx=0x7f1400007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.315+0000 7f140a59c700 1 --2- 172.21.15.103:0/2908291493 >> v2:172.21.15.103:3300/0 conn(0x7f140c12c0d0 0x7f140c1464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1400002f30 tx=0x7f1400007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.315+0000 7f140a59c700 1 --2- 172.21.15.103:0/2908291493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f140c12c0d0 0x7f140c1464e0 secure :-1 s=READY pgs=653 cs=0 l=1 rx=0x7f1400002f30 tx=0x7f1400007a40).ready entity=mon.1 client_cookie=2e745a1e77c05b44 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:27.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.315+0000 7f140a59c700 1 --2- 172.21.15.103:0/2908291493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f140c12c0d0 0x7f140c1464e0 secure :-1 s=THROTTLE_DONE pgs=653 cs=0 l=1 rx=0x7f1400002f30 tx=0x7f1400007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.315+0000 7f140959a700 1 -- 172.21.15.103:0/2908291493 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1400011720 con 0x7f140c12c0d0 2020-04-22T14:07:27.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.315+0000 7f140a59c700 1 --2- 172.21.15.103:0/2908291493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f140c12c0d0 0x7f140c1464e0 secure :-1 s=THROTTLE_DONE pgs=653 cs=0 l=1 rx=0x7f1400002f30 tx=0x7f1400007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.315+0000 7f140a59c700 1 --2- 172.21.15.103:0/2908291493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f140c12c0d0 0x7f140c1464e0 secure :-1 s=THROTTLE_DONE pgs=653 cs=0 l=1 rx=0x7f1400002f30 tx=0x7f1400007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.315+0000 7f140959a700 1 -- 172.21.15.103:0/2908291493 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14000118c0 con 0x7f140c12c0d0 2020-04-22T14:07:27.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.315+0000 7f140959a700 1 -- 172.21.15.103:0/2908291493 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1400011ce0 con 0x7f140c12c0d0 2020-04-22T14:07:27.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.315+0000 7f1410ab8700 1 -- 172.21.15.103:0/2908291493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f140c12c0d0 msgr2=0x7f140c1464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:27.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.315+0000 7f1410ab8700 1 --2- 172.21.15.103:0/2908291493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f140c12c0d0 0x7f140c1464e0 secure :-1 s=READY pgs=653 cs=0 l=1 rx=0x7f1400002f30 tx=0x7f1400007a40).stop 2020-04-22T14:07:27.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.315+0000 7f1410ab8700 1 -- 172.21.15.103:0/2908291493 shutdown_connections 2020-04-22T14:07:27.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.315+0000 7f1410ab8700 1 --2- 172.21.15.103:0/2908291493 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f140c063e30 0x7f140c0642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:27.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.315+0000 7f1410ab8700 1 --2- 172.21.15.103:0/2908291493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f140c12c0d0 0x7f140c1464e0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:27.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.315+0000 7f1410ab8700 1 -- 172.21.15.103:0/2908291493 >> 172.21.15.103:0/2908291493 conn(0x7f140c0b9160 msgr2=0x7f140c05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:27.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.315+0000 7f1410ab8700 1 -- 172.21.15.103:0/2908291493 shutdown_connections 2020-04-22T14:07:27.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.315+0000 7f1410ab8700 1 -- 172.21.15.103:0/2908291493 wait complete. 2020-04-22T14:07:27.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.316+0000 7f1410ab8700 1 Processor -- start 2020-04-22T14:07:27.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.316+0000 7f1410ab8700 1 -- start start 2020-04-22T14:07:27.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.317+0000 7f1410ab8700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f140c065fe0 0x7f140c154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:27.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.317+0000 7f1410ab8700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f140c12c0d0 0x7f140c0ae180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:27.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.317+0000 7f1410ab8700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f140c1440b0 con 0x7f140c063e30 2020-04-22T14:07:27.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.317+0000 7f1410ab8700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f140c145450 con 0x7f140c065fe0 2020-04-22T14:07:27.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.317+0000 7f1410ab8700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f140c0ae770 con 0x7f140c12c0d0 2020-04-22T14:07:27.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.317+0000 7f140ad9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f140c12c0d0 0x7f140c0ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:27.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.317+0000 7f140a59c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f140c063e30 0x7f140c141fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42374/0 (socket says 172.21.15.103:42374) 2020-04-22T14:07:27.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.317+0000 7f140a59c700 1 -- 172.21.15.103:0/153990231 learned_addr learned my addr 172.21.15.103:0/153990231 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:27.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.317+0000 7f1409d9b700 1 --2- 172.21.15.103:0/153990231 >> v2:172.21.15.86:3300/0 conn(0x7f140c065fe0 0x7f140c154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:27.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.317+0000 7f140ad9d700 1 -- 172.21.15.103:0/153990231 >> v2:172.21.15.86:3300/0 conn(0x7f140c065fe0 msgr2=0x7f140c154010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:27.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.317+0000 7f140ad9d700 1 --2- 172.21.15.103:0/153990231 >> v2:172.21.15.86:3300/0 conn(0x7f140c065fe0 0x7f140c154010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:27.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.317+0000 7f140ad9d700 1 -- 172.21.15.103:0/153990231 >> v1:172.21.15.103:6789/0 conn(0x7f140c063e30 legacy=0x7f140c141fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:27.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.317+0000 7f140ad9d700 1 -- 172.21.15.103:0/153990231 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f140c0aea10 con 0x7f140c12c0d0 2020-04-22T14:07:27.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.317+0000 7f13fb7fe700 1 -- 172.21.15.103:0/153990231 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3942603785 0 0) 0x7f140c1440b0 con 0x7f140c063e30 2020-04-22T14:07:27.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.318+0000 7f140ad9d700 1 --2- 172.21.15.103:0/153990231 >> v2:172.21.15.103:3300/0 conn(0x7f140c12c0d0 0x7f140c0ae180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f14040032b0 tx=0x7f1404010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.318+0000 7f140ad9d700 1 --2- 172.21.15.103:0/153990231 >> v2:172.21.15.103:3300/0 conn(0x7f140c12c0d0 0x7f140c0ae180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f14040032b0 tx=0x7f1404010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.318+0000 7f140ad9d700 1 --2- 172.21.15.103:0/153990231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f140c12c0d0 0x7f140c0ae180 secure :-1 s=READY pgs=655 cs=0 l=1 rx=0x7f14040032b0 tx=0x7f1404010d20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:27.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.318+0000 7f140ad9d700 1 --2- 172.21.15.103:0/153990231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f140c12c0d0 0x7f140c0ae180 secure :-1 s=THROTTLE_DONE pgs=655 cs=0 l=1 rx=0x7f14040032b0 tx=0x7f1404010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.318+0000 7f13fb7fe700 1 -- 172.21.15.103:0/153990231 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1404005e30 con 0x7f140c12c0d0 2020-04-22T14:07:27.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.318+0000 7f140ad9d700 1 --2- 172.21.15.103:0/153990231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f140c12c0d0 0x7f140c0ae180 secure :-1 s=THROTTLE_DONE pgs=655 cs=0 l=1 rx=0x7f14040032b0 tx=0x7f1404010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.318+0000 7f140ad9d700 1 --2- 172.21.15.103:0/153990231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f140c12c0d0 0x7f140c0ae180 secure :-1 s=THROTTLE_DONE pgs=655 cs=0 l=1 rx=0x7f14040032b0 tx=0x7f1404010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.318+0000 7f13fb7fe700 1 -- 172.21.15.103:0/153990231 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1404007560 con 0x7f140c12c0d0 2020-04-22T14:07:27.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.318+0000 7f1410ab8700 1 -- 172.21.15.103:0/153990231 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f140c0aecb0 con 0x7f140c12c0d0 2020-04-22T14:07:27.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.318+0000 7f13fb7fe700 1 -- 172.21.15.103:0/153990231 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14040078c0 con 0x7f140c12c0d0 2020-04-22T14:07:27.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.318+0000 7f1410ab8700 1 -- 172.21.15.103:0/153990231 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f140c1426d0 con 0x7f140c12c0d0 2020-04-22T14:07:27.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.318+0000 7f140ad9d700 1 --2- 172.21.15.103:0/153990231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f140c12c0d0 0x7f140c0ae180 secure :-1 s=THROTTLE_DONE pgs=655 cs=0 l=1 rx=0x7f14040032b0 tx=0x7f1404010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.319+0000 7f13fb7fe700 1 -- 172.21.15.103:0/153990231 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f14040123c0 con 0x7f140c12c0d0 2020-04-22T14:07:27.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.319+0000 7f140ad9d700 1 --2- 172.21.15.103:0/153990231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f140c12c0d0 0x7f140c0ae180 secure :-1 s=THROTTLE_DONE pgs=655 cs=0 l=1 rx=0x7f14040032b0 tx=0x7f1404010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.319+0000 7f1410ab8700 1 -- 172.21.15.103:0/153990231 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f140c0ae5e0 con 0x7f140c12c0d0 2020-04-22T14:07:27.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.319+0000 7f13fb7fe700 1 --2- 172.21.15.103:0/153990231 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f13e804d840 0x7f13e804fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:27.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.319+0000 7f13fb7fe700 1 -- 172.21.15.103:0/153990231 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f1404061d90 con 0x7f140c12c0d0 2020-04-22T14:07:27.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.319+0000 7f140a59c700 1 --2- 172.21.15.103:0/153990231 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f13e804d840 0x7f13e804fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:27.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.320+0000 7f140a59c700 1 --2- 172.21.15.103:0/153990231 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f13e804d840 0x7f13e804fd00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1400008320 tx=0x7f1400007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.320+0000 7f140a59c700 1 --2- 172.21.15.103:0/153990231 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f13e804d840 0x7f13e804fd00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1400008320 tx=0x7f1400007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.320+0000 7f140a59c700 1 --2- 172.21.15.103:0/153990231 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f13e804d840 0x7f13e804fd00 secure :-1 s=READY pgs=251 cs=0 l=1 rx=0x7f1400008320 tx=0x7f1400007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:27.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.323+0000 7f140ad9d700 1 --2- 172.21.15.103:0/153990231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f140c12c0d0 0x7f140c0ae180 secure :-1 s=THROTTLE_DONE pgs=655 cs=0 l=1 rx=0x7f14040032b0 tx=0x7f1404010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.323+0000 7f13fb7fe700 1 -- 172.21.15.103:0/153990231 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f140403d110 con 0x7f140c12c0d0 2020-04-22T14:07:27.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.467+0000 7f1410ab8700 1 -- 172.21.15.103:0/153990231 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f140c056c90 con 0x7f140c12c0d0 2020-04-22T14:07:27.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.467+0000 7f140ad9d700 1 --2- 172.21.15.103:0/153990231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f140c12c0d0 0x7f140c0ae180 secure :-1 s=THROTTLE_DONE pgs=655 cs=0 l=1 rx=0x7f14040032b0 tx=0x7f1404010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.467+0000 7f13fb7fe700 1 -- 172.21.15.103:0/153990231 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v49) v1 ==== 84+0+143 (secure 0 0 0) 0x7f1404040730 con 0x7f140c12c0d0 2020-04-22T14:07:27.470 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:07:27.470 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2020-04-22T14:07:27.470 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:27.470 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 1, 2020-04-22T14:07:27.471 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": "device_health_metrics" 2020-04-22T14:07:27.471 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:27.471 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:27.471 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 2, 2020-04-22T14:07:27.471 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": "rbd" 2020-04-22T14:07:27.471 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:27.471 INFO:teuthology.orchestra.run.smithi103.stdout:] 2020-04-22T14:07:27.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.469+0000 7f1410ab8700 1 -- 172.21.15.103:0/153990231 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f13e804d840 msgr2=0x7f13e804fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:27.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.469+0000 7f1410ab8700 1 --2- 172.21.15.103:0/153990231 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f13e804d840 0x7f13e804fd00 secure :-1 s=READY pgs=251 cs=0 l=1 rx=0x7f1400008320 tx=0x7f1400007a40).stop 2020-04-22T14:07:27.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.469+0000 7f1410ab8700 1 -- 172.21.15.103:0/153990231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f140c12c0d0 msgr2=0x7f140c0ae180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:27.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.469+0000 7f1410ab8700 1 --2- 172.21.15.103:0/153990231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f140c12c0d0 0x7f140c0ae180 secure :-1 s=READY pgs=655 cs=0 l=1 rx=0x7f14040032b0 tx=0x7f1404010d20).stop 2020-04-22T14:07:27.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.469+0000 7f1410ab8700 1 -- 172.21.15.103:0/153990231 shutdown_connections 2020-04-22T14:07:27.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.469+0000 7f1410ab8700 1 --2- 172.21.15.103:0/153990231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f140c12c0d0 0x7f140c0ae180 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:27.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.469+0000 7f1410ab8700 1 --2- 172.21.15.103:0/153990231 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f13e804d840 0x7f13e804fd00 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:27.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.469+0000 7f1410ab8700 1 --2- 172.21.15.103:0/153990231 >> v2:172.21.15.86:3300/0 conn(0x7f140c065fe0 0x7f140c154010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:27.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.469+0000 7f1410ab8700 1 -- 172.21.15.103:0/153990231 >> 172.21.15.103:0/153990231 conn(0x7f140c0b9160 msgr2=0x7f140c0620d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:27.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.469+0000 7f1410ab8700 1 -- 172.21.15.103:0/153990231 shutdown_connections 2020-04-22T14:07:27.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.469+0000 7f1410ab8700 1 -- 172.21.15.103:0/153990231 wait complete. 2020-04-22T14:07:27.481 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-04-22T14:07:27.481 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:27.495 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-04-22T14:07:27.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.643+0000 7f1b5144a700 1 Processor -- start 2020-04-22T14:07:27.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.643+0000 7f1b5144a700 1 -- start start 2020-04-22T14:07:27.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.644+0000 7f1b5144a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1b4c0ac950 0x7f1b4c146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:27.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.644+0000 7f1b5144a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b4c1467e0 con 0x7f1b4c0b9140 2020-04-22T14:07:27.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.644+0000 7f1b5144a700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b4c060050 con 0x7f1b4c1470a0 2020-04-22T14:07:27.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.644+0000 7f1b5144a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b4c147530 con 0x7f1b4c0ac950 2020-04-22T14:07:27.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.644+0000 7f1b4b7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f1b4c1470a0 0x7f1b4c143090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42384/0 (socket says 172.21.15.103:42384) 2020-04-22T14:07:27.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.644+0000 7f1b4b7fe700 1 -- 172.21.15.103:0/3027713114 learned_addr learned my addr 172.21.15.103:0/3027713114 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:27.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.644+0000 7f1b4a7fc700 1 --2- 172.21.15.103:0/3027713114 >> v2:172.21.15.103:3300/0 conn(0x7f1b4c0ac950 0x7f1b4c146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:27.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.644+0000 7f1b4a7fc700 1 -- 172.21.15.103:0/3027713114 >> v1:172.21.15.103:6789/0 conn(0x7f1b4c1470a0 legacy=0x7f1b4c143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:27.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.644+0000 7f1b4a7fc700 1 -- 172.21.15.103:0/3027713114 >> v1:172.21.15.86:6789/0 conn(0x7f1b4c0b9140 legacy=0x7f1b4c12b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:27.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.644+0000 7f1b4a7fc700 1 -- 172.21.15.103:0/3027713114 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b4c0b9520 con 0x7f1b4c0ac950 2020-04-22T14:07:27.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.644+0000 7f1b4a7fc700 1 --2- 172.21.15.103:0/3027713114 >> v2:172.21.15.103:3300/0 conn(0x7f1b4c0ac950 0x7f1b4c146c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1b4c0b6250 tx=0x7f1b3c009c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.644+0000 7f1b4a7fc700 1 --2- 172.21.15.103:0/3027713114 >> v2:172.21.15.103:3300/0 conn(0x7f1b4c0ac950 0x7f1b4c146c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1b4c0b6250 tx=0x7f1b3c009c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.644+0000 7f1b4a7fc700 1 --2- 172.21.15.103:0/3027713114 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b4c0ac950 0x7f1b4c146c40 secure :-1 s=READY pgs=657 cs=0 l=1 rx=0x7f1b4c0b6250 tx=0x7f1b3c009c50).ready entity=mon.1 client_cookie=42adb56caa0e41db server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:27.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.644+0000 7f1b4a7fc700 1 --2- 172.21.15.103:0/3027713114 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b4c0ac950 0x7f1b4c146c40 secure :-1 s=THROTTLE_DONE pgs=657 cs=0 l=1 rx=0x7f1b4c0b6250 tx=0x7f1b3c009c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.644+0000 7f1b49ffb700 1 -- 172.21.15.103:0/3027713114 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b3c00ae30 con 0x7f1b4c0ac950 2020-04-22T14:07:27.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.645+0000 7f1b4a7fc700 1 --2- 172.21.15.103:0/3027713114 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b4c0ac950 0x7f1b4c146c40 secure :-1 s=THROTTLE_DONE pgs=657 cs=0 l=1 rx=0x7f1b4c0b6250 tx=0x7f1b3c009c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.645+0000 7f1b4a7fc700 1 --2- 172.21.15.103:0/3027713114 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b4c0ac950 0x7f1b4c146c40 secure :-1 s=THROTTLE_DONE pgs=657 cs=0 l=1 rx=0x7f1b4c0b6250 tx=0x7f1b3c009c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.645+0000 7f1b49ffb700 1 -- 172.21.15.103:0/3027713114 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3c013a20 con 0x7f1b4c0ac950 2020-04-22T14:07:27.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.645+0000 7f1b49ffb700 1 -- 172.21.15.103:0/3027713114 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b3c013e40 con 0x7f1b4c0ac950 2020-04-22T14:07:27.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.645+0000 7f1b5144a700 1 -- 172.21.15.103:0/3027713114 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b4c0ac950 msgr2=0x7f1b4c146c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:27.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.645+0000 7f1b5144a700 1 --2- 172.21.15.103:0/3027713114 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b4c0ac950 0x7f1b4c146c40 secure :-1 s=READY pgs=657 cs=0 l=1 rx=0x7f1b4c0b6250 tx=0x7f1b3c009c50).stop 2020-04-22T14:07:27.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.645+0000 7f1b5144a700 1 -- 172.21.15.103:0/3027713114 shutdown_connections 2020-04-22T14:07:27.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.645+0000 7f1b5144a700 1 --2- 172.21.15.103:0/3027713114 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b4c0ac950 0x7f1b4c146c40 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:27.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.645+0000 7f1b5144a700 1 -- 172.21.15.103:0/3027713114 >> 172.21.15.103:0/3027713114 conn(0x7f1b4c05b7b0 msgr2=0x7f1b4c0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:27.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.645+0000 7f1b5144a700 1 -- 172.21.15.103:0/3027713114 shutdown_connections 2020-04-22T14:07:27.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.645+0000 7f1b5144a700 1 -- 172.21.15.103:0/3027713114 wait complete. 2020-04-22T14:07:27.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.646+0000 7f1b5144a700 1 Processor -- start 2020-04-22T14:07:27.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.646+0000 7f1b5144a700 1 -- start start 2020-04-22T14:07:27.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.647+0000 7f1b5144a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1b4c0ac950 0x7f1b4c064540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:27.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.647+0000 7f1b5144a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1b4c1470a0 0x7f1b4c0b2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:27.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.647+0000 7f1b5144a700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b4c1283e0 con 0x7f1b4c0b9140 2020-04-22T14:07:27.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.647+0000 7f1b5144a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b4c1119a0 con 0x7f1b4c0ac950 2020-04-22T14:07:27.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.647+0000 7f1b5144a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c061830 con 0x7f1b4c1470a0 2020-04-22T14:07:27.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.647+0000 7f1b4a7fc700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f1b4c0b9140 0x7f1b4c0b09d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42388/0 (socket says 172.21.15.103:42388) 2020-04-22T14:07:27.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.647+0000 7f1b4a7fc700 1 -- 172.21.15.103:0/2041899410 learned_addr learned my addr 172.21.15.103:0/2041899410 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:27.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.647+0000 7f1b43fff700 1 -- 172.21.15.103:0/2041899410 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3243857639 0 0) 0x7f1b4c0b9520 con 0x7f1b4c0b9140 2020-04-22T14:07:27.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.647+0000 7f1b4affd700 1 --2- 172.21.15.103:0/2041899410 >> v2:172.21.15.86:3300/0 conn(0x7f1b4c0ac950 0x7f1b4c064540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:27.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.647+0000 7f1b43fff700 1 -- 172.21.15.103:0/2041899410 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b30002fe0 con 0x7f1b4c0b9140 2020-04-22T14:07:27.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.647+0000 7f1b4b7fe700 1 --2- 172.21.15.103:0/2041899410 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1b4c1470a0 0x7f1b4c0b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:27.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.647+0000 7f1b43fff700 1 -- 172.21.15.103:0/2041899410 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 996438863 0 0) 0x7f1b30002fe0 con 0x7f1b4c0b9140 2020-04-22T14:07:27.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.647+0000 7f1b43fff700 1 -- 172.21.15.103:0/2041899410 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1b4c0b9520 con 0x7f1b4c0b9140 2020-04-22T14:07:27.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.647+0000 7f1b43fff700 1 -- 172.21.15.103:0/2041899410 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f1b3c00ae30 con 0x7f1b4c0b9140 2020-04-22T14:07:27.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.647+0000 7f1b43fff700 1 -- 172.21.15.103:0/2041899410 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1b4c1470a0 msgr2=0x7f1b4c0b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:27.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.647+0000 7f1b43fff700 1 --2- 172.21.15.103:0/2041899410 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1b4c1470a0 0x7f1b4c0b2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:27.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.647+0000 7f1b43fff700 1 -- 172.21.15.103:0/2041899410 >> v2:172.21.15.86:3300/0 conn(0x7f1b4c0ac950 msgr2=0x7f1b4c064540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:27.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.647+0000 7f1b43fff700 1 --2- 172.21.15.103:0/2041899410 >> v2:172.21.15.86:3300/0 conn(0x7f1b4c0ac950 0x7f1b4c064540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:27.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.647+0000 7f1b43fff700 1 -- 172.21.15.103:0/2041899410 >> v1:172.21.15.103:6789/0 conn(0x7f1b4c0b9140 legacy=0x7f1b4c0b09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:27.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.647+0000 7f1b43fff700 1 --2- 172.21.15.103:0/2041899410 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1b4c1470a0 0x7f1b300049b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:27.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.647+0000 7f1b43fff700 1 --2- 172.21.15.103:0/2041899410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b30004e10 0x7f1b30003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:27.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.647+0000 7f1b43fff700 1 --2- 172.21.15.103:0/2041899410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b30003d80 0x7f1b30004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:27.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.647+0000 7f1b43fff700 1 -- 172.21.15.103:0/2041899410 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c1119a0 con 0x7f1b30003d80 2020-04-22T14:07:27.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.647+0000 7f1b43fff700 1 -- 172.21.15.103:0/2041899410 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c061830 con 0x7f1b30004e10 2020-04-22T14:07:27.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.647+0000 7f1b43fff700 1 -- 172.21.15.103:0/2041899410 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b30005380 con 0x7f1b4c1470a0 2020-04-22T14:07:27.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.648+0000 7f1b4b7fe700 1 --2- 172.21.15.103:0/2041899410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b30003d80 0x7f1b30004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:27.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.648+0000 7f1b4affd700 1 --2- 172.21.15.103:0/2041899410 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1b4c1470a0 0x7f1b300049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:27.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.648+0000 7f1b4a7fc700 1 --2- 172.21.15.103:0/2041899410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b30004e10 0x7f1b30003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:27.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.648+0000 7f1b4a7fc700 1 -- 172.21.15.103:0/2041899410 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1b4c1470a0 msgr2=0x7f1b300049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:27.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.648+0000 7f1b4a7fc700 1 --2- 172.21.15.103:0/2041899410 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1b4c1470a0 0x7f1b300049b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:27.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.648+0000 7f1b4a7fc700 1 -- 172.21.15.103:0/2041899410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b30003d80 msgr2=0x7f1b30004200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:27.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.648+0000 7f1b4a7fc700 1 --2- 172.21.15.103:0/2041899410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b30003d80 0x7f1b30004200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:27.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.648+0000 7f1b4a7fc700 1 -- 172.21.15.103:0/2041899410 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b4c061ad0 con 0x7f1b30004e10 2020-04-22T14:07:27.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.648+0000 7f1b5144a700 1 -- 172.21.15.103:0/2041899410 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b4c111690 con 0x7f1b30004e10 2020-04-22T14:07:27.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.648+0000 7f1b4a7fc700 1 --2- 172.21.15.103:0/2041899410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b30004e10 0x7f1b30003920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1b3c00a510 tx=0x7f1b3c009cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.648+0000 7f1b5144a700 1 -- 172.21.15.103:0/2041899410 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b4c0b2590 con 0x7f1b30004e10 2020-04-22T14:07:27.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.648+0000 7f1b4a7fc700 1 --2- 172.21.15.103:0/2041899410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b30004e10 0x7f1b30003920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1b3c00a510 tx=0x7f1b3c009cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.648+0000 7f1b4a7fc700 1 --2- 172.21.15.103:0/2041899410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b30004e10 0x7f1b30003920 secure :-1 s=READY pgs=659 cs=0 l=1 rx=0x7f1b3c00a510 tx=0x7f1b3c009cf0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:27.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.648+0000 7f1b4a7fc700 1 --2- 172.21.15.103:0/2041899410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b30004e10 0x7f1b30003920 secure :-1 s=THROTTLE_DONE pgs=659 cs=0 l=1 rx=0x7f1b3c00a510 tx=0x7f1b3c009cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.648+0000 7f1b43fff700 1 -- 172.21.15.103:0/2041899410 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b3c011a90 con 0x7f1b30004e10 2020-04-22T14:07:27.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.648+0000 7f1b4a7fc700 1 --2- 172.21.15.103:0/2041899410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b30004e10 0x7f1b30003920 secure :-1 s=THROTTLE_DONE pgs=659 cs=0 l=1 rx=0x7f1b3c00a510 tx=0x7f1b3c009cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.648+0000 7f1b4a7fc700 1 --2- 172.21.15.103:0/2041899410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b30004e10 0x7f1b30003920 secure :-1 s=THROTTLE_DONE pgs=659 cs=0 l=1 rx=0x7f1b3c00a510 tx=0x7f1b3c009cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.648+0000 7f1b43fff700 1 -- 172.21.15.103:0/2041899410 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3c013e30 con 0x7f1b30004e10 2020-04-22T14:07:27.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.648+0000 7f1b43fff700 1 -- 172.21.15.103:0/2041899410 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b3c00f600 con 0x7f1b30004e10 2020-04-22T14:07:27.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.649+0000 7f1b4a7fc700 1 --2- 172.21.15.103:0/2041899410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b30004e10 0x7f1b30003920 secure :-1 s=THROTTLE_DONE pgs=659 cs=0 l=1 rx=0x7f1b3c00a510 tx=0x7f1b3c009cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.649+0000 7f1b5144a700 1 -- 172.21.15.103:0/2041899410 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b24003340 con 0x7f1b30004e10 2020-04-22T14:07:27.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.649+0000 7f1b43fff700 1 -- 172.21.15.103:0/2041899410 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f1b3c00f760 con 0x7f1b30004e10 2020-04-22T14:07:27.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.649+0000 7f1b4a7fc700 1 --2- 172.21.15.103:0/2041899410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b30004e10 0x7f1b30003920 secure :-1 s=THROTTLE_DONE pgs=659 cs=0 l=1 rx=0x7f1b3c00a510 tx=0x7f1b3c009cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.649+0000 7f1b43fff700 1 --2- 172.21.15.103:0/2041899410 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1b30059f30 0x7f1b3005c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:27.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.649+0000 7f1b43fff700 1 -- 172.21.15.103:0/2041899410 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f1b3c062450 con 0x7f1b30004e10 2020-04-22T14:07:27.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.650+0000 7f1b4affd700 1 --2- 172.21.15.103:0/2041899410 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1b30059f30 0x7f1b3005c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:27.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.650+0000 7f1b4affd700 1 --2- 172.21.15.103:0/2041899410 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1b30059f30 0x7f1b3005c3f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1b34001f50 tx=0x7f1b34003960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.650+0000 7f1b4affd700 1 --2- 172.21.15.103:0/2041899410 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1b30059f30 0x7f1b3005c3f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1b34001f50 tx=0x7f1b34003960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.650+0000 7f1b4affd700 1 --2- 172.21.15.103:0/2041899410 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1b30059f30 0x7f1b3005c3f0 secure :-1 s=READY pgs=252 cs=0 l=1 rx=0x7f1b34001f50 tx=0x7f1b34003960).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:27.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.654+0000 7f1b4a7fc700 1 --2- 172.21.15.103:0/2041899410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b30004e10 0x7f1b30003920 secure :-1 s=THROTTLE_DONE pgs=659 cs=0 l=1 rx=0x7f1b3c00a510 tx=0x7f1b3c009cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:27.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.654+0000 7f1b43fff700 1 -- 172.21.15.103:0/2041899410 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f1b3c065e60 con 0x7f1b30004e10 2020-04-22T14:07:27.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:27.795+0000 7f1b5144a700 1 -- 172.21.15.103:0/2041899410 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f1b24002200 con 0x7f1b30004e10 2020-04-22T14:07:28.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.527+0000 7f1b4a7fc700 1 --2- 172.21.15.103:0/2041899410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b30004e10 0x7f1b30003920 secure :-1 s=THROTTLE_DONE pgs=659 cs=0 l=1 rx=0x7f1b3c00a510 tx=0x7f1b3c009cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:28.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.527+0000 7f1b43fff700 1 -- 172.21.15.103:0/2041899410 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v50) v1 ==== 133+0+0 (secure 0 0 0) 0x7f1b3c03d950 con 0x7f1b30004e10 2020-04-22T14:07:28.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.529+0000 7f1b5144a700 1 -- 172.21.15.103:0/2041899410 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1b30059f30 msgr2=0x7f1b3005c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:28.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.529+0000 7f1b5144a700 1 --2- 172.21.15.103:0/2041899410 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1b30059f30 0x7f1b3005c3f0 secure :-1 s=READY pgs=252 cs=0 l=1 rx=0x7f1b34001f50 tx=0x7f1b34003960).stop 2020-04-22T14:07:28.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.529+0000 7f1b5144a700 1 -- 172.21.15.103:0/2041899410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b30004e10 msgr2=0x7f1b30003920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:28.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.529+0000 7f1b5144a700 1 --2- 172.21.15.103:0/2041899410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b30004e10 0x7f1b30003920 secure :-1 s=READY pgs=659 cs=0 l=1 rx=0x7f1b3c00a510 tx=0x7f1b3c009cf0).stop 2020-04-22T14:07:28.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.529+0000 7f1b4b7fe700 1 -- 172.21.15.103:0/2041899410 reap_dead start 2020-04-22T14:07:28.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.529+0000 7f1b5144a700 1 -- 172.21.15.103:0/2041899410 shutdown_connections 2020-04-22T14:07:28.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.529+0000 7f1b5144a700 1 -- 172.21.15.103:0/2041899410 >> 172.21.15.103:0/2041899410 conn(0x7f1b4c05b7b0 msgr2=0x7f1b4c0b5060 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:28.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.529+0000 7f1b5144a700 1 -- 172.21.15.103:0/2041899410 shutdown_connections 2020-04-22T14:07:28.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.529+0000 7f1b5144a700 1 -- 172.21.15.103:0/2041899410 wait complete. 2020-04-22T14:07:28.533 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' created 2020-04-22T14:07:28.545 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:28.560 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-04-22T14:07:28.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.711+0000 7f491a72f700 1 Processor -- start 2020-04-22T14:07:28.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.711+0000 7f491a72f700 1 -- start start 2020-04-22T14:07:28.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.712+0000 7f491a72f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f49140b9140 0x7f491412b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:28.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.712+0000 7f491a72f700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49141467e0 con 0x7f49140ac950 2020-04-22T14:07:28.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.712+0000 7f491a72f700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4914060050 con 0x7f491412b670 2020-04-22T14:07:28.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.712+0000 7f491a72f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49140602f0 con 0x7f49140b9140 2020-04-22T14:07:28.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.712+0000 7f4913fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f49140b9140 0x7f491412b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:28.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.712+0000 7f4918ccc700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f491412b670 0x7f4914143090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42404/0 (socket says 172.21.15.103:42404) 2020-04-22T14:07:28.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.712+0000 7f4918ccc700 1 -- 172.21.15.103:0/1508502181 learned_addr learned my addr 172.21.15.103:0/1508502181 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:28.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.712+0000 7f4913fff700 1 -- 172.21.15.103:0/1508502181 >> v1:172.21.15.103:6789/0 conn(0x7f491412b670 legacy=0x7f4914143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:28.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.712+0000 7f4913fff700 1 -- 172.21.15.103:0/1508502181 >> v1:172.21.15.86:6789/0 conn(0x7f49140ac950 legacy=0x7f4914146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:28.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.712+0000 7f4912ffd700 1 -- 172.21.15.103:0/1508502181 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 641132886 0 0) 0x7f4914060050 con 0x7f491412b670 2020-04-22T14:07:28.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.712+0000 7f4913fff700 1 -- 172.21.15.103:0/1508502181 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49140b9520 con 0x7f49140b9140 2020-04-22T14:07:28.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.712+0000 7f4913fff700 1 --2- 172.21.15.103:0/1508502181 >> v2:172.21.15.103:3300/0 conn(0x7f49140b9140 0x7f491412b210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f49140b6250 tx=0x7f4904007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:28.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.712+0000 7f4913fff700 1 --2- 172.21.15.103:0/1508502181 >> v2:172.21.15.103:3300/0 conn(0x7f49140b9140 0x7f491412b210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f49140b6250 tx=0x7f4904007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:28.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.712+0000 7f4913fff700 1 --2- 172.21.15.103:0/1508502181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49140b9140 0x7f491412b210 secure :-1 s=READY pgs=661 cs=0 l=1 rx=0x7f49140b6250 tx=0x7f4904007a40).ready entity=mon.1 client_cookie=89e93e27383c4547 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:28.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.712+0000 7f4913fff700 1 --2- 172.21.15.103:0/1508502181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49140b9140 0x7f491412b210 secure :-1 s=THROTTLE_DONE pgs=661 cs=0 l=1 rx=0x7f49140b6250 tx=0x7f4904007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:28.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.712+0000 7f4912ffd700 1 -- 172.21.15.103:0/1508502181 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4904011430 con 0x7f49140b9140 2020-04-22T14:07:28.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.712+0000 7f4913fff700 1 --2- 172.21.15.103:0/1508502181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49140b9140 0x7f491412b210 secure :-1 s=THROTTLE_DONE pgs=661 cs=0 l=1 rx=0x7f49140b6250 tx=0x7f4904007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:28.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.712+0000 7f4912ffd700 1 -- 172.21.15.103:0/1508502181 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4904011590 con 0x7f49140b9140 2020-04-22T14:07:28.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.712+0000 7f4913fff700 1 --2- 172.21.15.103:0/1508502181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49140b9140 0x7f491412b210 secure :-1 s=THROTTLE_DONE pgs=661 cs=0 l=1 rx=0x7f49140b6250 tx=0x7f4904007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:28.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.713+0000 7f4912ffd700 1 -- 172.21.15.103:0/1508502181 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4904011970 con 0x7f49140b9140 2020-04-22T14:07:28.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.713+0000 7f491a72f700 1 -- 172.21.15.103:0/1508502181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49140b9140 msgr2=0x7f491412b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:28.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.713+0000 7f491a72f700 1 --2- 172.21.15.103:0/1508502181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49140b9140 0x7f491412b210 secure :-1 s=READY pgs=661 cs=0 l=1 rx=0x7f49140b6250 tx=0x7f4904007a40).stop 2020-04-22T14:07:28.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.713+0000 7f491a72f700 1 -- 172.21.15.103:0/1508502181 shutdown_connections 2020-04-22T14:07:28.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.713+0000 7f491a72f700 1 --2- 172.21.15.103:0/1508502181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49140b9140 0x7f491412b210 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:28.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.713+0000 7f491a72f700 1 -- 172.21.15.103:0/1508502181 >> 172.21.15.103:0/1508502181 conn(0x7f491405b7b0 msgr2=0x7f49140b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:28.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.713+0000 7f491a72f700 1 -- 172.21.15.103:0/1508502181 shutdown_connections 2020-04-22T14:07:28.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.713+0000 7f491a72f700 1 -- 172.21.15.103:0/1508502181 wait complete. 2020-04-22T14:07:28.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.714+0000 7f491a72f700 1 Processor -- start 2020-04-22T14:07:28.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.714+0000 7f491a72f700 1 -- start start 2020-04-22T14:07:28.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.715+0000 7f491a72f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f49140b9140 0x7f4914142e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:28.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.715+0000 7f491a72f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f491412b670 0x7f49140663e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:28.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.715+0000 7f491a72f700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4914066840 con 0x7f49140ac950 2020-04-22T14:07:28.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.715+0000 7f491a72f700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49141432b0 con 0x7f491412b670 2020-04-22T14:07:28.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.715+0000 7f491a72f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4914065ca0 con 0x7f49140b9140 2020-04-22T14:07:28.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.715+0000 7f4913fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f49140ac950 0x7f49140b52e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42406/0 (socket says 172.21.15.103:42406) 2020-04-22T14:07:28.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.715+0000 7f49137fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f49140b9140 0x7f4914142e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:28.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.715+0000 7f4913fff700 1 -- 172.21.15.103:0/2089036453 learned_addr learned my addr 172.21.15.103:0/2089036453 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:28.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.715+0000 7f4918ccc700 1 --2- 172.21.15.103:0/2089036453 >> v2:172.21.15.86:3300/0 conn(0x7f491412b670 0x7f49140663e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:28.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.715+0000 7f49117fa700 1 -- 172.21.15.103:0/2089036453 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4196929214 0 0) 0x7f4914066840 con 0x7f49140ac950 2020-04-22T14:07:28.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.715+0000 7f49117fa700 1 -- 172.21.15.103:0/2089036453 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48f4002fe0 con 0x7f49140ac950 2020-04-22T14:07:28.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.715+0000 7f49137fe700 1 -- 172.21.15.103:0/2089036453 >> v2:172.21.15.86:3300/0 conn(0x7f491412b670 msgr2=0x7f49140663e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:28.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.715+0000 7f49137fe700 1 --2- 172.21.15.103:0/2089036453 >> v2:172.21.15.86:3300/0 conn(0x7f491412b670 0x7f49140663e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:28.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.715+0000 7f49137fe700 1 -- 172.21.15.103:0/2089036453 >> v1:172.21.15.103:6789/0 conn(0x7f49140ac950 legacy=0x7f49140b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:28.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.715+0000 7f49137fe700 1 -- 172.21.15.103:0/2089036453 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4914065f40 con 0x7f49140b9140 2020-04-22T14:07:28.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.715+0000 7f49137fe700 1 --2- 172.21.15.103:0/2089036453 >> v2:172.21.15.103:3300/0 conn(0x7f49140b9140 0x7f4914142e50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4908002f40 tx=0x7f4908010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:28.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.715+0000 7f49137fe700 1 --2- 172.21.15.103:0/2089036453 >> v2:172.21.15.103:3300/0 conn(0x7f49140b9140 0x7f4914142e50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4908002f40 tx=0x7f4908010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:28.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.715+0000 7f49137fe700 1 --2- 172.21.15.103:0/2089036453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49140b9140 0x7f4914142e50 secure :-1 s=READY pgs=663 cs=0 l=1 rx=0x7f4908002f40 tx=0x7f4908010830).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:28.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.715+0000 7f49137fe700 1 --2- 172.21.15.103:0/2089036453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49140b9140 0x7f4914142e50 secure :-1 s=THROTTLE_DONE pgs=663 cs=0 l=1 rx=0x7f4908002f40 tx=0x7f4908010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:28.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.716+0000 7f49117fa700 1 -- 172.21.15.103:0/2089036453 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49080059f0 con 0x7f49140b9140 2020-04-22T14:07:28.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.716+0000 7f49137fe700 1 --2- 172.21.15.103:0/2089036453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49140b9140 0x7f4914142e50 secure :-1 s=THROTTLE_DONE pgs=663 cs=0 l=1 rx=0x7f4908002f40 tx=0x7f4908010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:28.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.716+0000 7f49117fa700 1 -- 172.21.15.103:0/2089036453 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4908005b50 con 0x7f49140b9140 2020-04-22T14:07:28.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.716+0000 7f49137fe700 1 --2- 172.21.15.103:0/2089036453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49140b9140 0x7f4914142e50 secure :-1 s=THROTTLE_DONE pgs=663 cs=0 l=1 rx=0x7f4908002f40 tx=0x7f4908010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:28.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.716+0000 7f49117fa700 1 -- 172.21.15.103:0/2089036453 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49080110b0 con 0x7f49140b9140 2020-04-22T14:07:28.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.716+0000 7f491a72f700 1 -- 172.21.15.103:0/2089036453 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4914111690 con 0x7f49140b9140 2020-04-22T14:07:28.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.716+0000 7f491a72f700 1 -- 172.21.15.103:0/2089036453 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4914128150 con 0x7f49140b9140 2020-04-22T14:07:28.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.716+0000 7f49137fe700 1 --2- 172.21.15.103:0/2089036453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49140b9140 0x7f4914142e50 secure :-1 s=THROTTLE_DONE pgs=663 cs=0 l=1 rx=0x7f4908002f40 tx=0x7f4908010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:28.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.716+0000 7f491a72f700 1 -- 172.21.15.103:0/2089036453 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49140b5a50 con 0x7f49140b9140 2020-04-22T14:07:28.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.717+0000 7f49117fa700 1 -- 172.21.15.103:0/2089036453 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f4908011370 con 0x7f49140b9140 2020-04-22T14:07:28.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.717+0000 7f49137fe700 1 --2- 172.21.15.103:0/2089036453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49140b9140 0x7f4914142e50 secure :-1 s=THROTTLE_DONE pgs=663 cs=0 l=1 rx=0x7f4908002f40 tx=0x7f4908010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:28.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.717+0000 7f49117fa700 1 --2- 172.21.15.103:0/2089036453 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f48f404dcc0 0x7f48f4050180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:28.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.717+0000 7f49117fa700 1 -- 172.21.15.103:0/2089036453 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f4908061020 con 0x7f49140b9140 2020-04-22T14:07:28.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.717+0000 7f4913fff700 1 --2- 172.21.15.103:0/2089036453 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f48f404dcc0 0x7f48f4050180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:28.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.717+0000 7f4913fff700 1 --2- 172.21.15.103:0/2089036453 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f48f404dcc0 0x7f48f4050180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4904010200 tx=0x7f4904007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:28.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.717+0000 7f4913fff700 1 --2- 172.21.15.103:0/2089036453 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f48f404dcc0 0x7f48f4050180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4904010200 tx=0x7f4904007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:28.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.717+0000 7f4913fff700 1 --2- 172.21.15.103:0/2089036453 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f48f404dcc0 0x7f48f4050180 secure :-1 s=READY pgs=253 cs=0 l=1 rx=0x7f4904010200 tx=0x7f4904007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:28.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.721+0000 7f49137fe700 1 --2- 172.21.15.103:0/2089036453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49140b9140 0x7f4914142e50 secure :-1 s=THROTTLE_DONE pgs=663 cs=0 l=1 rx=0x7f4908002f40 tx=0x7f4908010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:28.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.721+0000 7f49117fa700 1 -- 172.21.15.103:0/2089036453 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f490803c3a0 con 0x7f49140b9140 2020-04-22T14:07:28.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:28.866+0000 7f491a72f700 1 -- 172.21.15.103:0/2089036453 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f4914056c90 con 0x7f49140b9140 2020-04-22T14:07:29.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.715+0000 7f49137fe700 1 --2- 172.21.15.103:0/2089036453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49140b9140 0x7f4914142e50 secure :-1 s=READY pgs=663 cs=0 l=1 rx=0x7f4908002f40 tx=0x7f4908010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:29.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.747+0000 7f49137fe700 1 --2- 172.21.15.103:0/2089036453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49140b9140 0x7f4914142e50 secure :-1 s=THROTTLE_DONE pgs=663 cs=0 l=1 rx=0x7f4908002f40 tx=0x7f4908010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:29.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.748+0000 7f49117fa700 1 -- 172.21.15.103:0/2089036453 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v52) v1 ==== 125+0+0 (secure 0 0 0) 0x7f490803f9c0 con 0x7f49140b9140 2020-04-22T14:07:29.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.751+0000 7f491a72f700 1 -- 172.21.15.103:0/2089036453 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f48f404dcc0 msgr2=0x7f48f4050180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:29.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.751+0000 7f491a72f700 1 --2- 172.21.15.103:0/2089036453 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f48f404dcc0 0x7f48f4050180 secure :-1 s=READY pgs=253 cs=0 l=1 rx=0x7f4904010200 tx=0x7f4904007a40).stop 2020-04-22T14:07:29.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.751+0000 7f491a72f700 1 -- 172.21.15.103:0/2089036453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49140b9140 msgr2=0x7f4914142e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:29.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.751+0000 7f491a72f700 1 --2- 172.21.15.103:0/2089036453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49140b9140 0x7f4914142e50 secure :-1 s=READY pgs=663 cs=0 l=1 rx=0x7f4908002f40 tx=0x7f4908010830).stop 2020-04-22T14:07:29.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.751+0000 7f491a72f700 1 -- 172.21.15.103:0/2089036453 shutdown_connections 2020-04-22T14:07:29.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.751+0000 7f491a72f700 1 --2- 172.21.15.103:0/2089036453 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f48f404dcc0 0x7f48f4050180 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:29.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.751+0000 7f491a72f700 1 --2- 172.21.15.103:0/2089036453 >> v2:172.21.15.86:3300/0 conn(0x7f491412b670 0x7f49140663e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:29.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.751+0000 7f491a72f700 1 --2- 172.21.15.103:0/2089036453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49140b9140 0x7f4914142e50 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:29.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.751+0000 7f491a72f700 1 -- 172.21.15.103:0/2089036453 >> 172.21.15.103:0/2089036453 conn(0x7f491405b7b0 msgr2=0x7f4914145e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:29.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.752+0000 7f491a72f700 1 -- 172.21.15.103:0/2089036453 shutdown_connections 2020-04-22T14:07:29.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.752+0000 7f491a72f700 1 -- 172.21.15.103:0/2089036453 wait complete. 2020-04-22T14:07:29.756 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' created 2020-04-22T14:07:29.766 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:29.781 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-04-22T14:07:29.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.935+0000 7fa6018cd700 1 Processor -- start 2020-04-22T14:07:29.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.935+0000 7fa6018cd700 1 -- start start 2020-04-22T14:07:29.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.936+0000 7fa6018cd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa5fc0b8e00 0x7fa5fc0af010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:29.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.936+0000 7fa6018cd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5fc0b91e0 0x7fa5fc142f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:29.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.936+0000 7fa6018cd700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5fc0b29b0 con 0x7fa5fc05fed0 2020-04-22T14:07:29.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.936+0000 7fa6018cd700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5fc0b4270 con 0x7fa5fc0b8e00 2020-04-22T14:07:29.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.936+0000 7fa6018cd700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5fc0b4510 con 0x7fa5fc0b91e0 2020-04-22T14:07:29.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.936+0000 7fa5fbfff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5fc0b91e0 0x7fa5fc142f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:29.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.936+0000 7fa6008cb700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa5fc0b8e00 0x7fa5fc0af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:29.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.936+0000 7fa5fbfff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5fc0b91e0 0x7fa5fc142f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:35002/0 (socket says 172.21.15.103:35002) 2020-04-22T14:07:29.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.936+0000 7fa5fbfff700 1 -- 172.21.15.103:0/1788326881 learned_addr learned my addr 172.21.15.103:0/1788326881 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:29.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.936+0000 7fa6008cb700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa5fc0b8e00 0x7fa5fc0af010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:47456/0 (socket says 172.21.15.103:47456) 2020-04-22T14:07:29.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.936+0000 7fa6010cc700 1 --1- 172.21.15.103:0/1788326881 >> v1:172.21.15.86:6789/0 conn(0x7fa5fc05fed0 0x7fa5fc0b1bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:59570/0 (socket says 172.21.15.103:59570) 2020-04-22T14:07:29.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.937+0000 7fa5fbfff700 1 -- 172.21.15.103:0/1788326881 >> v2:172.21.15.86:3300/0 conn(0x7fa5fc0b8e00 msgr2=0x7fa5fc0af010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:29.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.937+0000 7fa5fbfff700 1 --2- 172.21.15.103:0/1788326881 >> v2:172.21.15.86:3300/0 conn(0x7fa5fc0b8e00 0x7fa5fc0af010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:29.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.937+0000 7fa5fbfff700 1 -- 172.21.15.103:0/1788326881 >> v1:172.21.15.86:6789/0 conn(0x7fa5fc05fed0 legacy=0x7fa5fc0b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:29.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.937+0000 7fa5fbfff700 1 -- 172.21.15.103:0/1788326881 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5fc0b22d0 con 0x7fa5fc0b91e0 2020-04-22T14:07:29.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.937+0000 7fa5fbfff700 1 --2- 172.21.15.103:0/1788326881 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5fc0b91e0 0x7fa5fc142f60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa5f0002f30 tx=0x7fa5f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:29.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.937+0000 7fa5fbfff700 1 --2- 172.21.15.103:0/1788326881 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5fc0b91e0 0x7fa5fc142f60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa5f0002f30 tx=0x7fa5f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:29.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.937+0000 7fa5fbfff700 1 --2- 172.21.15.103:0/1788326881 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5fc0b91e0 0x7fa5fc142f60 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7fa5f0002f30 tx=0x7fa5f0007a40).ready entity=mon.2 client_cookie=fc3b9f59ebcaf2e1 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:29.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.937+0000 7fa5fbfff700 1 --2- 172.21.15.103:0/1788326881 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5fc0b91e0 0x7fa5fc142f60 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7fa5f0002f30 tx=0x7fa5f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:29.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.937+0000 7fa5fb7fe700 1 -- 172.21.15.103:0/1788326881 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5f0013d70 con 0x7fa5fc0b91e0 2020-04-22T14:07:29.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.937+0000 7fa5fbfff700 1 --2- 172.21.15.103:0/1788326881 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5fc0b91e0 0x7fa5fc142f60 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7fa5f0002f30 tx=0x7fa5f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:29.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.937+0000 7fa5fbfff700 1 --2- 172.21.15.103:0/1788326881 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5fc0b91e0 0x7fa5fc142f60 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7fa5f0002f30 tx=0x7fa5f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:29.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.937+0000 7fa5fb7fe700 1 -- 172.21.15.103:0/1788326881 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f000c180 con 0x7fa5fc0b91e0 2020-04-22T14:07:29.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.937+0000 7fa5fb7fe700 1 -- 172.21.15.103:0/1788326881 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5f000c5a0 con 0x7fa5fc0b91e0 2020-04-22T14:07:29.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.937+0000 7fa6018cd700 1 -- 172.21.15.103:0/1788326881 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5fc0b91e0 msgr2=0x7fa5fc142f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:29.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.937+0000 7fa6018cd700 1 --2- 172.21.15.103:0/1788326881 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5fc0b91e0 0x7fa5fc142f60 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7fa5f0002f30 tx=0x7fa5f0007a40).stop 2020-04-22T14:07:29.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.938+0000 7fa6018cd700 1 -- 172.21.15.103:0/1788326881 shutdown_connections 2020-04-22T14:07:29.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.938+0000 7fa6018cd700 1 --2- 172.21.15.103:0/1788326881 >> v2:172.21.15.86:3300/0 conn(0x7fa5fc0b8e00 0x7fa5fc0af010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:29.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.938+0000 7fa6018cd700 1 --2- 172.21.15.103:0/1788326881 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5fc0b91e0 0x7fa5fc142f60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:29.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.938+0000 7fa6018cd700 1 -- 172.21.15.103:0/1788326881 >> 172.21.15.103:0/1788326881 conn(0x7fa5fc05b780 msgr2=0x7fa5fc0b8530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:29.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.938+0000 7fa6018cd700 1 -- 172.21.15.103:0/1788326881 shutdown_connections 2020-04-22T14:07:29.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.938+0000 7fa6018cd700 1 -- 172.21.15.103:0/1788326881 wait complete. 2020-04-22T14:07:29.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.939+0000 7fa6018cd700 1 Processor -- start 2020-04-22T14:07:29.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.939+0000 7fa6018cd700 1 -- start start 2020-04-22T14:07:29.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.939+0000 7fa6018cd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5fc0b91e0 0x7fa5fc140b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:29.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.939+0000 7fa6018cd700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5fc0649c0 con 0x7fa5fc0b8e00 2020-04-22T14:07:29.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.939+0000 7fa6018cd700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5fc064c60 con 0x7fa5fc05fed0 2020-04-22T14:07:29.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.939+0000 7fa6018cd700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5fc0647b0 con 0x7fa5fc0b91e0 2020-04-22T14:07:29.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.939+0000 7fa6008cb700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa5fc05fed0 0x7fa5fc141280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42420/0 (socket says 172.21.15.103:42420) 2020-04-22T14:07:29.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.939+0000 7fa6008cb700 1 -- 172.21.15.103:0/116644894 learned_addr learned my addr 172.21.15.103:0/116644894 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:29.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.940+0000 7fa6010cc700 1 --2- 172.21.15.103:0/116644894 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5fc0b91e0 0x7fa5fc140b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:29.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.940+0000 7fa5f9ffb700 1 -- 172.21.15.103:0/116644894 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 841517134 0 0) 0x7fa5fc064c60 con 0x7fa5fc05fed0 2020-04-22T14:07:29.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.940+0000 7fa5f9ffb700 1 -- 172.21.15.103:0/116644894 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5dc002fe0 con 0x7fa5fc05fed0 2020-04-22T14:07:29.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.940+0000 7fa5f9ffb700 1 -- 172.21.15.103:0/116644894 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3251273472 0 0) 0x7fa5dc002fe0 con 0x7fa5fc05fed0 2020-04-22T14:07:29.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.940+0000 7fa5f9ffb700 1 -- 172.21.15.103:0/116644894 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa5fc064c60 con 0x7fa5fc05fed0 2020-04-22T14:07:29.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.940+0000 7fa5f9ffb700 1 -- 172.21.15.103:0/116644894 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fa5ec001490 con 0x7fa5fc05fed0 2020-04-22T14:07:29.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.940+0000 7fa5f9ffb700 1 -- 172.21.15.103:0/116644894 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5fc0b91e0 msgr2=0x7fa5fc140b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:29.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.940+0000 7fa5f9ffb700 1 --2- 172.21.15.103:0/116644894 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5fc0b91e0 0x7fa5fc140b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:29.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.940+0000 7fa5f9ffb700 1 -- 172.21.15.103:0/116644894 >> v1:172.21.15.103:6789/0 conn(0x7fa5fc05fed0 legacy=0x7fa5fc141280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:29.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.940+0000 7fa5f9ffb700 1 -- 172.21.15.103:0/116644894 >> v1:172.21.15.86:6789/0 conn(0x7fa5fc0b8e00 legacy=0x7fa5fc065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:29.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.940+0000 7fa5f9ffb700 1 --2- 172.21.15.103:0/116644894 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5dc0049b0 0x7fa5dc004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:29.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.940+0000 7fa5f9ffb700 1 --2- 172.21.15.103:0/116644894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5dc005210 0x7fa5dc003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:29.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.940+0000 7fa5f9ffb700 1 --2- 172.21.15.103:0/116644894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5dc003e40 0x7fa5dc0042c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:29.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.940+0000 7fa5f9ffb700 1 -- 172.21.15.103:0/116644894 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5fc0647b0 con 0x7fa5dc003e40 2020-04-22T14:07:29.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.940+0000 7fa5f9ffb700 1 -- 172.21.15.103:0/116644894 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc00b7b0 con 0x7fa5dc005210 2020-04-22T14:07:29.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.940+0000 7fa5f9ffb700 1 -- 172.21.15.103:0/116644894 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc00b970 con 0x7fa5dc0049b0 2020-04-22T14:07:29.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.940+0000 7fa6010cc700 1 --2- 172.21.15.103:0/116644894 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5fc0b91e0 0x7fa5fc140b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:07:29.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.940+0000 7fa5fbfff700 1 --2- 172.21.15.103:0/116644894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5dc005210 0x7fa5dc003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:29.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.940+0000 7fa6008cb700 1 --2- 172.21.15.103:0/116644894 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5dc0049b0 0x7fa5dc004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:29.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.940+0000 7fa6010cc700 1 --2- 172.21.15.103:0/116644894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5dc003e40 0x7fa5dc0042c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:29.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.940+0000 7fa5fbfff700 1 -- 172.21.15.103:0/116644894 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5dc0049b0 msgr2=0x7fa5dc004d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:29.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.940+0000 7fa5fbfff700 1 --2- 172.21.15.103:0/116644894 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5dc0049b0 0x7fa5dc004d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:29.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.940+0000 7fa5fbfff700 1 -- 172.21.15.103:0/116644894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5dc003e40 msgr2=0x7fa5dc0042c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:29.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.940+0000 7fa5fbfff700 1 --2- 172.21.15.103:0/116644894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5dc003e40 0x7fa5dc0042c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:29.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.940+0000 7fa5fbfff700 1 -- 172.21.15.103:0/116644894 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5fc0642f0 con 0x7fa5dc005210 2020-04-22T14:07:29.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.940+0000 7fa6018cd700 1 -- 172.21.15.103:0/116644894 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5fc0644e0 con 0x7fa5dc005210 2020-04-22T14:07:29.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.940+0000 7fa6010cc700 1 --2- 172.21.15.103:0/116644894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5dc003e40 0x7fa5dc0042c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:07:29.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.940+0000 7fa5fbfff700 1 --2- 172.21.15.103:0/116644894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5dc005210 0x7fa5dc003920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa5f00084c0 tx=0x7fa5f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:29.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.941+0000 7fa6018cd700 1 -- 172.21.15.103:0/116644894 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5fc141990 con 0x7fa5dc005210 2020-04-22T14:07:29.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.941+0000 7fa5fbfff700 1 --2- 172.21.15.103:0/116644894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5dc005210 0x7fa5dc003920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa5f00084c0 tx=0x7fa5f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:29.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.941+0000 7fa5fbfff700 1 --2- 172.21.15.103:0/116644894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5dc005210 0x7fa5dc003920 secure :-1 s=READY pgs=665 cs=0 l=1 rx=0x7fa5f00084c0 tx=0x7fa5f0007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:29.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.941+0000 7fa5fbfff700 1 --2- 172.21.15.103:0/116644894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5dc005210 0x7fa5dc003920 secure :-1 s=THROTTLE_DONE pgs=665 cs=0 l=1 rx=0x7fa5f00084c0 tx=0x7fa5f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:29.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.941+0000 7fa5f9ffb700 1 -- 172.21.15.103:0/116644894 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5f0008710 con 0x7fa5dc005210 2020-04-22T14:07:29.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.941+0000 7fa5fbfff700 1 --2- 172.21.15.103:0/116644894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5dc005210 0x7fa5dc003920 secure :-1 s=THROTTLE_DONE pgs=665 cs=0 l=1 rx=0x7fa5f00084c0 tx=0x7fa5f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:29.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.941+0000 7fa5fbfff700 1 --2- 172.21.15.103:0/116644894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5dc005210 0x7fa5dc003920 secure :-1 s=THROTTLE_DONE pgs=665 cs=0 l=1 rx=0x7fa5f00084c0 tx=0x7fa5f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:29.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.941+0000 7fa5f9ffb700 1 -- 172.21.15.103:0/116644894 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f000ce50 con 0x7fa5dc005210 2020-04-22T14:07:29.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.941+0000 7fa5f9ffb700 1 -- 172.21.15.103:0/116644894 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5f0007550 con 0x7fa5dc005210 2020-04-22T14:07:29.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.941+0000 7fa5fbfff700 1 --2- 172.21.15.103:0/116644894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5dc005210 0x7fa5dc003920 secure :-1 s=THROTTLE_DONE pgs=665 cs=0 l=1 rx=0x7fa5f00084c0 tx=0x7fa5f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:29.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.941+0000 7fa6018cd700 1 -- 172.21.15.103:0/116644894 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5d8003340 con 0x7fa5dc005210 2020-04-22T14:07:29.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.942+0000 7fa5f9ffb700 1 -- 172.21.15.103:0/116644894 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fa5f00115b0 con 0x7fa5dc005210 2020-04-22T14:07:29.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.942+0000 7fa5fbfff700 1 --2- 172.21.15.103:0/116644894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5dc005210 0x7fa5dc003920 secure :-1 s=THROTTLE_DONE pgs=665 cs=0 l=1 rx=0x7fa5f00084c0 tx=0x7fa5f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:29.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.942+0000 7fa5f9ffb700 1 --2- 172.21.15.103:0/116644894 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa5dc056080 0x7fa5dc058540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:29.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.942+0000 7fa5f9ffb700 1 -- 172.21.15.103:0/116644894 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5957+0+0 (secure 0 0 0) 0x7fa5f0064180 con 0x7fa5dc005210 2020-04-22T14:07:29.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.942+0000 7fa6008cb700 1 --2- 172.21.15.103:0/116644894 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa5dc056080 0x7fa5dc058540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:29.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.942+0000 7fa6008cb700 1 --2- 172.21.15.103:0/116644894 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa5dc056080 0x7fa5dc058540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa5ec007a40 tx=0x7fa5ec001e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:29.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.943+0000 7fa6008cb700 1 --2- 172.21.15.103:0/116644894 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa5dc056080 0x7fa5dc058540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa5ec007a40 tx=0x7fa5ec001e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:29.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.943+0000 7fa6008cb700 1 --2- 172.21.15.103:0/116644894 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa5dc056080 0x7fa5dc058540 secure :-1 s=READY pgs=255 cs=0 l=1 rx=0x7fa5ec007a40 tx=0x7fa5ec001e20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:29.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.946+0000 7fa5fbfff700 1 --2- 172.21.15.103:0/116644894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5dc005210 0x7fa5dc003920 secure :-1 s=THROTTLE_DONE pgs=665 cs=0 l=1 rx=0x7fa5f00084c0 tx=0x7fa5f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:29.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:29.946+0000 7fa5f9ffb700 1 -- 172.21.15.103:0/116644894 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fa5f003f680 con 0x7fa5dc005210 2020-04-22T14:07:30.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.135+0000 7fa6018cd700 1 -- 172.21.15.103:0/116644894 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fa5d8002260 con 0x7fa5dc005210 2020-04-22T14:07:30.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.144+0000 7fa5fbfff700 1 --2- 172.21.15.103:0/116644894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5dc005210 0x7fa5dc003920 secure :-1 s=THROTTLE_DONE pgs=665 cs=0 l=1 rx=0x7fa5f00084c0 tx=0x7fa5f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:30.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.144+0000 7fa5f9ffb700 1 -- 172.21.15.103:0/116644894 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 9 and data pool 10 v25) v1 ==== 188+0+0 (secure 0 0 0) 0x7fa5f0042ca0 con 0x7fa5dc005210 2020-04-22T14:07:30.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.150+0000 7fa6018cd700 1 -- 172.21.15.103:0/116644894 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa5dc056080 msgr2=0x7fa5dc058540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:30.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.150+0000 7fa6018cd700 1 --2- 172.21.15.103:0/116644894 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa5dc056080 0x7fa5dc058540 secure :-1 s=READY pgs=255 cs=0 l=1 rx=0x7fa5ec007a40 tx=0x7fa5ec001e20).stop 2020-04-22T14:07:30.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.150+0000 7fa6018cd700 1 -- 172.21.15.103:0/116644894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5dc005210 msgr2=0x7fa5dc003920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:30.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.150+0000 7fa6018cd700 1 --2- 172.21.15.103:0/116644894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5dc005210 0x7fa5dc003920 secure :-1 s=READY pgs=665 cs=0 l=1 rx=0x7fa5f00084c0 tx=0x7fa5f0007a40).stop 2020-04-22T14:07:30.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.151+0000 7fa6010cc700 1 -- 172.21.15.103:0/116644894 reap_dead start 2020-04-22T14:07:30.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.152+0000 7fa6018cd700 1 -- 172.21.15.103:0/116644894 shutdown_connections 2020-04-22T14:07:30.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.152+0000 7fa6018cd700 1 -- 172.21.15.103:0/116644894 >> 172.21.15.103:0/116644894 conn(0x7fa5fc05b780 msgr2=0x7fa5fc061a50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:30.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.152+0000 7fa6018cd700 1 -- 172.21.15.103:0/116644894 shutdown_connections 2020-04-22T14:07:30.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.153+0000 7fa6018cd700 1 -- 172.21.15.103:0/116644894 wait complete. 2020-04-22T14:07:30.155 INFO:teuthology.orchestra.run.smithi103.stderr:new fs with metadata pool 9 and data pool 10 2020-04-22T14:07:30.166 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:30.182 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:07:30.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.325+0000 7fb79ca60700 1 Processor -- start 2020-04-22T14:07:30.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.325+0000 7fb79ca60700 1 -- start start 2020-04-22T14:07:30.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.326+0000 7fb79ca60700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb7980b6040 0x7fb7980ac740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:30.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.326+0000 7fb79ca60700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb7981426d0 0x7fb798142b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:30.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.326+0000 7fb79ca60700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb798064ec0 con 0x7fb798067170 2020-04-22T14:07:30.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.326+0000 7fb79ca60700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb798065af0 con 0x7fb7980b6040 2020-04-22T14:07:30.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.326+0000 7fb79ca60700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb798146870 con 0x7fb7981426d0 2020-04-22T14:07:30.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.326+0000 7fb79659c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb798067170 0x7fb79813c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42444/0 (socket says 172.21.15.103:42444) 2020-04-22T14:07:30.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.326+0000 7fb79659c700 1 -- 172.21.15.103:0/1371078513 learned_addr learned my addr 172.21.15.103:0/1371078513 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:30.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.326+0000 7fb796d9d700 1 --2- 172.21.15.103:0/1371078513 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb7981426d0 0x7fb798142b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:30.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.326+0000 7fb795d9b700 1 --2- 172.21.15.103:0/1371078513 >> v2:172.21.15.86:3300/0 conn(0x7fb7980b6040 0x7fb7980ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:30.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.326+0000 7fb79559a700 1 -- 172.21.15.103:0/1371078513 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2129225441 0 0) 0x7fb798064ec0 con 0x7fb798067170 2020-04-22T14:07:30.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.326+0000 7fb79559a700 1 -- 172.21.15.103:0/1371078513 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb77c003230 con 0x7fb798067170 2020-04-22T14:07:30.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.327+0000 7fb79559a700 1 -- 172.21.15.103:0/1371078513 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3106882203 0 0) 0x7fb77c003230 con 0x7fb798067170 2020-04-22T14:07:30.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.327+0000 7fb79559a700 1 -- 172.21.15.103:0/1371078513 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb7981426d0 msgr2=0x7fb798142b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:30.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.327+0000 7fb79559a700 1 --2- 172.21.15.103:0/1371078513 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb7981426d0 0x7fb798142b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:30.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.327+0000 7fb79559a700 1 -- 172.21.15.103:0/1371078513 >> v2:172.21.15.86:3300/0 conn(0x7fb7980b6040 msgr2=0x7fb7980ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:30.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.327+0000 7fb79559a700 1 --2- 172.21.15.103:0/1371078513 >> v2:172.21.15.86:3300/0 conn(0x7fb7980b6040 0x7fb7980ac740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:30.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.327+0000 7fb79559a700 1 -- 172.21.15.103:0/1371078513 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb798067550 con 0x7fb798067170 2020-04-22T14:07:30.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.327+0000 7fb79559a700 1 -- 172.21.15.103:0/1371078513 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fb78c0016d0 con 0x7fb798067170 2020-04-22T14:07:30.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.327+0000 7fb79559a700 1 -- 172.21.15.103:0/1371078513 >> v1:172.21.15.103:6789/0 conn(0x7fb798067170 legacy=0x7fb79813c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:30.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.327+0000 7fb79559a700 1 --2- 172.21.15.103:0/1371078513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb77c003720 0x7fb77c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:30.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.327+0000 7fb79559a700 1 --2- 172.21.15.103:0/1371078513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb77c004060 0x7fb77c004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:30.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.327+0000 7fb79559a700 1 --2- 172.21.15.103:0/1371078513 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb7981426d0 0x7fb77c004ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:30.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.327+0000 7fb79559a700 1 -- 172.21.15.103:0/1371078513 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb798065af0 con 0x7fb77c004060 2020-04-22T14:07:30.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.327+0000 7fb79559a700 1 -- 172.21.15.103:0/1371078513 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb798146870 con 0x7fb77c003720 2020-04-22T14:07:30.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.327+0000 7fb79559a700 1 -- 172.21.15.103:0/1371078513 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c004ff0 con 0x7fb7981426d0 2020-04-22T14:07:30.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.327+0000 7fb79659c700 1 --2- 172.21.15.103:0/1371078513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb77c003720 0x7fb77c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:30.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.327+0000 7fb795d9b700 1 --2- 172.21.15.103:0/1371078513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb77c004060 0x7fb77c004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:30.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.327+0000 7fb796d9d700 1 --2- 172.21.15.103:0/1371078513 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb7981426d0 0x7fb77c004ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:30.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.327+0000 7fb79659c700 1 -- 172.21.15.103:0/1371078513 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb7981426d0 msgr2=0x7fb77c004ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:30.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.327+0000 7fb79659c700 1 --2- 172.21.15.103:0/1371078513 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb7981426d0 0x7fb77c004ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:30.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.327+0000 7fb79659c700 1 -- 172.21.15.103:0/1371078513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb77c004060 msgr2=0x7fb77c004530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:30.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.327+0000 7fb79659c700 1 --2- 172.21.15.103:0/1371078513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb77c004060 0x7fb77c004530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:30.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.327+0000 7fb79659c700 1 -- 172.21.15.103:0/1371078513 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb77c003230 con 0x7fb77c003720 2020-04-22T14:07:30.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.327+0000 7fb79659c700 1 --2- 172.21.15.103:0/1371078513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb77c003720 0x7fb77c003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb78c0013e0 tx=0x7fb798146770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:30.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.327+0000 7fb79659c700 1 --2- 172.21.15.103:0/1371078513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb77c003720 0x7fb77c003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb78c0013e0 tx=0x7fb798146770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:30.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.327+0000 7fb79659c700 1 --2- 172.21.15.103:0/1371078513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb77c003720 0x7fb77c003b40 secure :-1 s=READY pgs=667 cs=0 l=1 rx=0x7fb78c0013e0 tx=0x7fb798146770).ready entity=mon.1 client_cookie=648e102bc3589e76 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:30.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.327+0000 7fb79659c700 1 --2- 172.21.15.103:0/1371078513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb77c003720 0x7fb77c003b40 secure :-1 s=THROTTLE_DONE pgs=667 cs=0 l=1 rx=0x7fb78c0013e0 tx=0x7fb798146770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:30.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.327+0000 7fb79559a700 1 -- 172.21.15.103:0/1371078513 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb78c00e180 con 0x7fb77c003720 2020-04-22T14:07:30.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.327+0000 7fb79659c700 1 --2- 172.21.15.103:0/1371078513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb77c003720 0x7fb77c003b40 secure :-1 s=THROTTLE_DONE pgs=667 cs=0 l=1 rx=0x7fb78c0013e0 tx=0x7fb798146770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:30.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.327+0000 7fb79559a700 1 -- 172.21.15.103:0/1371078513 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb78c00e320 con 0x7fb77c003720 2020-04-22T14:07:30.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.327+0000 7fb79659c700 1 --2- 172.21.15.103:0/1371078513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb77c003720 0x7fb77c003b40 secure :-1 s=THROTTLE_DONE pgs=667 cs=0 l=1 rx=0x7fb78c0013e0 tx=0x7fb798146770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:30.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.327+0000 7fb79ca60700 1 -- 172.21.15.103:0/1371078513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb77c003720 msgr2=0x7fb77c003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:30.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.327+0000 7fb79559a700 1 -- 172.21.15.103:0/1371078513 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb78c0100c0 con 0x7fb77c003720 2020-04-22T14:07:30.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.327+0000 7fb79ca60700 1 --2- 172.21.15.103:0/1371078513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb77c003720 0x7fb77c003b40 secure :-1 s=READY pgs=667 cs=0 l=1 rx=0x7fb78c0013e0 tx=0x7fb798146770).stop 2020-04-22T14:07:30.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.327+0000 7fb796d9d700 1 -- 172.21.15.103:0/1371078513 reap_dead start 2020-04-22T14:07:30.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.328+0000 7fb79ca60700 1 -- 172.21.15.103:0/1371078513 shutdown_connections 2020-04-22T14:07:30.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.328+0000 7fb79ca60700 1 -- 172.21.15.103:0/1371078513 >> 172.21.15.103:0/1371078513 conn(0x7fb7980b9160 msgr2=0x7fb79805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:30.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.328+0000 7fb79ca60700 1 -- 172.21.15.103:0/1371078513 shutdown_connections 2020-04-22T14:07:30.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.328+0000 7fb79ca60700 1 -- 172.21.15.103:0/1371078513 wait complete. 2020-04-22T14:07:30.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.329+0000 7fb79ca60700 1 Processor -- start 2020-04-22T14:07:30.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.329+0000 7fb79ca60700 1 -- start start 2020-04-22T14:07:30.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.330+0000 7fb79ca60700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb79813d550 0x7fb798134110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:30.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.330+0000 7fb79ca60700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb798063c60 con 0x7fb798061590 2020-04-22T14:07:30.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.330+0000 7fb79ca60700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb798063e90 con 0x7fb798154650 2020-04-22T14:07:30.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.330+0000 7fb79ca60700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb798064130 con 0x7fb79813d550 2020-04-22T14:07:30.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.330+0000 7fb796d9d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb798154650 0x7fb79813ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42458/0 (socket says 172.21.15.103:42458) 2020-04-22T14:07:30.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.330+0000 7fb796d9d700 1 -- 172.21.15.103:0/126360976 learned_addr learned my addr 172.21.15.103:0/126360976 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:30.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.330+0000 7fb795d9b700 1 --2- 172.21.15.103:0/126360976 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb79813d550 0x7fb798134110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:30.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.330+0000 7fb7877fe700 1 -- 172.21.15.103:0/126360976 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2909102053 0 0) 0x7fb798063e90 con 0x7fb798154650 2020-04-22T14:07:30.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.330+0000 7fb7877fe700 1 -- 172.21.15.103:0/126360976 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb774002fe0 con 0x7fb798154650 2020-04-22T14:07:30.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.330+0000 7fb7877fe700 1 -- 172.21.15.103:0/126360976 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 632332607 0 0) 0x7fb798063c60 con 0x7fb798061590 2020-04-22T14:07:30.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.330+0000 7fb7877fe700 1 -- 172.21.15.103:0/126360976 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb798063e90 con 0x7fb798061590 2020-04-22T14:07:30.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.330+0000 7fb795d9b700 1 -- 172.21.15.103:0/126360976 >> v1:172.21.15.103:6789/0 conn(0x7fb798154650 legacy=0x7fb79813ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:30.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.330+0000 7fb795d9b700 1 -- 172.21.15.103:0/126360976 >> v1:172.21.15.86:6789/0 conn(0x7fb798061590 legacy=0x7fb798153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:30.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.330+0000 7fb795d9b700 1 -- 172.21.15.103:0/126360976 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7980643d0 con 0x7fb79813d550 2020-04-22T14:07:30.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.330+0000 7fb795d9b700 1 --2- 172.21.15.103:0/126360976 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb79813d550 0x7fb798134110 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb788002f30 tx=0x7fb788010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:30.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.330+0000 7fb795d9b700 1 --2- 172.21.15.103:0/126360976 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb79813d550 0x7fb798134110 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb788002f30 tx=0x7fb788010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:30.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.330+0000 7fb795d9b700 1 --2- 172.21.15.103:0/126360976 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb79813d550 0x7fb798134110 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7fb788002f30 tx=0x7fb788010ae0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:30.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.331+0000 7fb795d9b700 1 --2- 172.21.15.103:0/126360976 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb79813d550 0x7fb798134110 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7fb788002f30 tx=0x7fb788010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:30.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.331+0000 7fb7877fe700 1 -- 172.21.15.103:0/126360976 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb788005e90 con 0x7fb79813d550 2020-04-22T14:07:30.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.331+0000 7fb795d9b700 1 --2- 172.21.15.103:0/126360976 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb79813d550 0x7fb798134110 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7fb788002f30 tx=0x7fb788010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:30.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.331+0000 7fb795d9b700 1 --2- 172.21.15.103:0/126360976 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb79813d550 0x7fb798134110 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7fb788002f30 tx=0x7fb788010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:30.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.331+0000 7fb7877fe700 1 -- 172.21.15.103:0/126360976 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb788007180 con 0x7fb79813d550 2020-04-22T14:07:30.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.331+0000 7fb79ca60700 1 -- 172.21.15.103:0/126360976 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb798061970 con 0x7fb79813d550 2020-04-22T14:07:30.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.331+0000 7fb7877fe700 1 -- 172.21.15.103:0/126360976 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb788007560 con 0x7fb79813d550 2020-04-22T14:07:30.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.331+0000 7fb79ca60700 1 -- 172.21.15.103:0/126360976 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb798154a80 con 0x7fb79813d550 2020-04-22T14:07:30.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.331+0000 7fb795d9b700 1 --2- 172.21.15.103:0/126360976 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb79813d550 0x7fb798134110 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7fb788002f30 tx=0x7fb788010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:30.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.332+0000 7fb79ca60700 1 -- 172.21.15.103:0/126360976 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb798056c90 con 0x7fb79813d550 2020-04-22T14:07:30.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.332+0000 7fb7877fe700 1 -- 172.21.15.103:0/126360976 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fb788009490 con 0x7fb79813d550 2020-04-22T14:07:30.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.332+0000 7fb795d9b700 1 --2- 172.21.15.103:0/126360976 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb79813d550 0x7fb798134110 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7fb788002f30 tx=0x7fb788010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:30.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.332+0000 7fb7877fe700 1 --2- 172.21.15.103:0/126360976 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb77404ddf0 0x7fb7740502b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:30.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.332+0000 7fb7877fe700 1 -- 172.21.15.103:0/126360976 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb7880612f0 con 0x7fb79813d550 2020-04-22T14:07:30.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.332+0000 7fb79659c700 1 --2- 172.21.15.103:0/126360976 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb77404ddf0 0x7fb7740502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:30.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.332+0000 7fb79659c700 1 --2- 172.21.15.103:0/126360976 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb77404ddf0 0x7fb7740502b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb78c00bb60 tx=0x7fb798146770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:30.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.333+0000 7fb79659c700 1 --2- 172.21.15.103:0/126360976 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb77404ddf0 0x7fb7740502b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb78c00bb60 tx=0x7fb798146770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:30.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.333+0000 7fb79659c700 1 --2- 172.21.15.103:0/126360976 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb77404ddf0 0x7fb7740502b0 secure :-1 s=READY pgs=256 cs=0 l=1 rx=0x7fb78c00bb60 tx=0x7fb798146770).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:30.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.336+0000 7fb795d9b700 1 --2- 172.21.15.103:0/126360976 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb79813d550 0x7fb798134110 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7fb788002f30 tx=0x7fb788010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:30.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.336+0000 7fb7877fe700 1 -- 172.21.15.103:0/126360976 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fb788033440 con 0x7fb79813d550 2020-04-22T14:07:30.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.478+0000 7fb79ca60700 1 -- 172.21.15.103:0/126360976 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7980b40c0 con 0x7fb79813d550 2020-04-22T14:07:30.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.480+0000 7fb795d9b700 1 --2- 172.21.15.103:0/126360976 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb79813d550 0x7fb798134110 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7fb788002f30 tx=0x7fb788010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:30.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.480+0000 7fb7877fe700 1 -- 172.21.15.103:0/126360976 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16104 (secure 0 0 0) 0x7fb78803c670 con 0x7fb79813d550 2020-04-22T14:07:30.482 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:07:30.482 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":53,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:07:30.137149+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:07:27.809363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2020-04-22T14:07:28.880202+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:07:30.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.481+0000 7fb79ca60700 1 -- 172.21.15.103:0/126360976 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb77404ddf0 msgr2=0x7fb7740502b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:30.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.481+0000 7fb79ca60700 1 --2- 172.21.15.103:0/126360976 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb77404ddf0 0x7fb7740502b0 secure :-1 s=READY pgs=256 cs=0 l=1 rx=0x7fb78c00bb60 tx=0x7fb798146770).stop 2020-04-22T14:07:30.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.481+0000 7fb79ca60700 1 -- 172.21.15.103:0/126360976 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb79813d550 msgr2=0x7fb798134110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:30.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.481+0000 7fb79ca60700 1 --2- 172.21.15.103:0/126360976 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb79813d550 0x7fb798134110 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7fb788002f30 tx=0x7fb788010ae0).stop 2020-04-22T14:07:30.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.481+0000 7fb79ca60700 1 -- 172.21.15.103:0/126360976 shutdown_connections 2020-04-22T14:07:30.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.481+0000 7fb79ca60700 1 --2- 172.21.15.103:0/126360976 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb77404ddf0 0x7fb7740502b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:30.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.481+0000 7fb79ca60700 1 --2- 172.21.15.103:0/126360976 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb79813d550 0x7fb798134110 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:30.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.481+0000 7fb79ca60700 1 -- 172.21.15.103:0/126360976 >> 172.21.15.103:0/126360976 conn(0x7fb7980b9160 msgr2=0x7fb7981402c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:30.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.481+0000 7fb79ca60700 1 -- 172.21.15.103:0/126360976 shutdown_connections 2020-04-22T14:07:30.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.481+0000 7fb79ca60700 1 -- 172.21.15.103:0/126360976 wait complete. 2020-04-22T14:07:30.496 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:30.513 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:07:30.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.658+0000 7fc510552700 1 Processor -- start 2020-04-22T14:07:30.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.658+0000 7fc510552700 1 -- start start 2020-04-22T14:07:30.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.659+0000 7fc510552700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc50812c0d0 0x7fc5081464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:30.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.659+0000 7fc510552700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc508065fe0 0x7fc50805b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:30.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.659+0000 7fc510552700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc50805b8a0 0x7fc508062ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:30.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.659+0000 7fc510552700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc50812c4b0 con 0x7fc50812c0d0 2020-04-22T14:07:30.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.659+0000 7fc510552700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc508143300 con 0x7fc508065fe0 2020-04-22T14:07:30.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.659+0000 7fc510552700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5081435a0 con 0x7fc50805b8a0 2020-04-22T14:07:30.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.659+0000 7fc50daed700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc508065fe0 0x7fc50805b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:30.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.659+0000 7fc50daed700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc508065fe0 0x7fc50805b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50276/0 (socket says 172.21.15.103:50276) 2020-04-22T14:07:30.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.659+0000 7fc50daed700 1 -- 172.21.15.103:0/1843144586 learned_addr learned my addr 172.21.15.103:0/1843144586 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:30.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.659+0000 7fc50eaef700 1 --2- 172.21.15.103:0/1843144586 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc50805b8a0 0x7fc508062ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:30.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.659+0000 7fc50e2ee700 1 --2- 172.21.15.103:0/1843144586 >> v2:172.21.15.86:3300/0 conn(0x7fc50812c0d0 0x7fc5081464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:30.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.659+0000 7fc50daed700 1 -- 172.21.15.103:0/1843144586 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc50805b8a0 msgr2=0x7fc508062ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:30.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.659+0000 7fc50daed700 1 --2- 172.21.15.103:0/1843144586 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc50805b8a0 0x7fc508062ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:30.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.659+0000 7fc50daed700 1 -- 172.21.15.103:0/1843144586 >> v2:172.21.15.86:3300/0 conn(0x7fc50812c0d0 msgr2=0x7fc5081464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:30.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.659+0000 7fc50daed700 1 --2- 172.21.15.103:0/1843144586 >> v2:172.21.15.86:3300/0 conn(0x7fc50812c0d0 0x7fc5081464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:30.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.659+0000 7fc50daed700 1 -- 172.21.15.103:0/1843144586 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc508143840 con 0x7fc508065fe0 2020-04-22T14:07:30.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.659+0000 7fc50daed700 1 --2- 172.21.15.103:0/1843144586 >> v2:172.21.15.103:3300/0 conn(0x7fc508065fe0 0x7fc50805b440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc4f8002f30 tx=0x7fc4f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:30.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.659+0000 7fc50daed700 1 --2- 172.21.15.103:0/1843144586 >> v2:172.21.15.103:3300/0 conn(0x7fc508065fe0 0x7fc50805b440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc4f8002f30 tx=0x7fc4f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:30.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.659+0000 7fc50daed700 1 --2- 172.21.15.103:0/1843144586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc508065fe0 0x7fc50805b440 secure :-1 s=READY pgs=669 cs=0 l=1 rx=0x7fc4f8002f30 tx=0x7fc4f8007a40).ready entity=mon.1 client_cookie=edb003cf46d7ccc7 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:30.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.659+0000 7fc50daed700 1 --2- 172.21.15.103:0/1843144586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc508065fe0 0x7fc50805b440 secure :-1 s=THROTTLE_DONE pgs=669 cs=0 l=1 rx=0x7fc4f8002f30 tx=0x7fc4f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:30.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.659+0000 7fc50d2ec700 1 -- 172.21.15.103:0/1843144586 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4f8011720 con 0x7fc508065fe0 2020-04-22T14:07:30.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.659+0000 7fc50daed700 1 --2- 172.21.15.103:0/1843144586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc508065fe0 0x7fc50805b440 secure :-1 s=THROTTLE_DONE pgs=669 cs=0 l=1 rx=0x7fc4f8002f30 tx=0x7fc4f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:30.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.659+0000 7fc50daed700 1 --2- 172.21.15.103:0/1843144586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc508065fe0 0x7fc50805b440 secure :-1 s=THROTTLE_DONE pgs=669 cs=0 l=1 rx=0x7fc4f8002f30 tx=0x7fc4f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:30.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.659+0000 7fc50d2ec700 1 -- 172.21.15.103:0/1843144586 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f8011880 con 0x7fc508065fe0 2020-04-22T14:07:30.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.660+0000 7fc50d2ec700 1 -- 172.21.15.103:0/1843144586 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4f8011ca0 con 0x7fc508065fe0 2020-04-22T14:07:30.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.660+0000 7fc510552700 1 -- 172.21.15.103:0/1843144586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc508065fe0 msgr2=0x7fc50805b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:30.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.660+0000 7fc510552700 1 --2- 172.21.15.103:0/1843144586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc508065fe0 0x7fc50805b440 secure :-1 s=READY pgs=669 cs=0 l=1 rx=0x7fc4f8002f30 tx=0x7fc4f8007a40).stop 2020-04-22T14:07:30.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.660+0000 7fc510552700 1 -- 172.21.15.103:0/1843144586 shutdown_connections 2020-04-22T14:07:30.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.660+0000 7fc510552700 1 --2- 172.21.15.103:0/1843144586 >> v2:172.21.15.86:3300/0 conn(0x7fc50812c0d0 0x7fc5081464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:30.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.660+0000 7fc510552700 1 --2- 172.21.15.103:0/1843144586 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc50805b8a0 0x7fc508062ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:30.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.660+0000 7fc510552700 1 --2- 172.21.15.103:0/1843144586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc508065fe0 0x7fc50805b440 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:30.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.660+0000 7fc510552700 1 -- 172.21.15.103:0/1843144586 >> 172.21.15.103:0/1843144586 conn(0x7fc5080b9160 msgr2=0x7fc50805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:30.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.660+0000 7fc510552700 1 -- 172.21.15.103:0/1843144586 shutdown_connections 2020-04-22T14:07:30.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.660+0000 7fc510552700 1 -- 172.21.15.103:0/1843144586 wait complete. 2020-04-22T14:07:30.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.661+0000 7fc510552700 1 Processor -- start 2020-04-22T14:07:30.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.661+0000 7fc510552700 1 -- start start 2020-04-22T14:07:30.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.662+0000 7fc510552700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc508065fe0 0x7fc5080b6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:30.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.662+0000 7fc510552700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5080b6f70 con 0x7fc50805b8a0 2020-04-22T14:07:30.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.662+0000 7fc510552700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5080b2230 con 0x7fc50812c0d0 2020-04-22T14:07:30.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.662+0000 7fc510552700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5081520c0 con 0x7fc508065fe0 2020-04-22T14:07:30.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.662+0000 7fc50daed700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc508065fe0 0x7fc5080b6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:30.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.662+0000 7fc50daed700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc508065fe0 0x7fc5080b6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50280/0 (socket says 172.21.15.103:50280) 2020-04-22T14:07:30.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.662+0000 7fc50daed700 1 -- 172.21.15.103:0/3199203385 learned_addr learned my addr 172.21.15.103:0/3199203385 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:30.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.662+0000 7fc50daed700 1 -- 172.21.15.103:0/3199203385 >> v1:172.21.15.103:6789/0 conn(0x7fc50812c0d0 legacy=0x7fc508126dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:30.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.662+0000 7fc4f77fe700 1 -- 172.21.15.103:0/3199203385 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2424577386 0 0) 0x7fc5080b2230 con 0x7fc50812c0d0 2020-04-22T14:07:30.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.662+0000 7fc50daed700 1 -- 172.21.15.103:0/3199203385 >> v1:172.21.15.86:6789/0 conn(0x7fc50805b8a0 legacy=0x7fc5081519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:30.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.662+0000 7fc50daed700 1 -- 172.21.15.103:0/3199203385 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5081522b0 con 0x7fc508065fe0 2020-04-22T14:07:30.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.662+0000 7fc50daed700 1 --2- 172.21.15.103:0/3199203385 >> v2:172.21.15.103:3300/0 conn(0x7fc508065fe0 0x7fc5080b6b10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc4f8002f30 tx=0x7fc4f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:30.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.662+0000 7fc50daed700 1 --2- 172.21.15.103:0/3199203385 >> v2:172.21.15.103:3300/0 conn(0x7fc508065fe0 0x7fc5080b6b10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc4f8002f30 tx=0x7fc4f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:30.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.662+0000 7fc50daed700 1 --2- 172.21.15.103:0/3199203385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc508065fe0 0x7fc5080b6b10 secure :-1 s=READY pgs=671 cs=0 l=1 rx=0x7fc4f8002f30 tx=0x7fc4f8007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:30.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.662+0000 7fc50daed700 1 --2- 172.21.15.103:0/3199203385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc508065fe0 0x7fc5080b6b10 secure :-1 s=THROTTLE_DONE pgs=671 cs=0 l=1 rx=0x7fc4f8002f30 tx=0x7fc4f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:30.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.662+0000 7fc4f77fe700 1 -- 172.21.15.103:0/3199203385 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4f80086e0 con 0x7fc508065fe0 2020-04-22T14:07:30.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.662+0000 7fc50daed700 1 --2- 172.21.15.103:0/3199203385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc508065fe0 0x7fc5080b6b10 secure :-1 s=THROTTLE_DONE pgs=671 cs=0 l=1 rx=0x7fc4f8002f30 tx=0x7fc4f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:30.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.662+0000 7fc50daed700 1 --2- 172.21.15.103:0/3199203385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc508065fe0 0x7fc5080b6b10 secure :-1 s=THROTTLE_DONE pgs=671 cs=0 l=1 rx=0x7fc4f8002f30 tx=0x7fc4f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:30.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.662+0000 7fc4f77fe700 1 -- 172.21.15.103:0/3199203385 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f8007360 con 0x7fc508065fe0 2020-04-22T14:07:30.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.662+0000 7fc510552700 1 -- 172.21.15.103:0/3199203385 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5081525b0 con 0x7fc508065fe0 2020-04-22T14:07:30.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.662+0000 7fc4f77fe700 1 -- 172.21.15.103:0/3199203385 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4f80056c0 con 0x7fc508065fe0 2020-04-22T14:07:30.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.662+0000 7fc510552700 1 -- 172.21.15.103:0/3199203385 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5081276a0 con 0x7fc508065fe0 2020-04-22T14:07:30.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.663+0000 7fc50daed700 1 --2- 172.21.15.103:0/3199203385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc508065fe0 0x7fc5080b6b10 secure :-1 s=THROTTLE_DONE pgs=671 cs=0 l=1 rx=0x7fc4f8002f30 tx=0x7fc4f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:30.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.663+0000 7fc4f77fe700 1 -- 172.21.15.103:0/3199203385 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fc4f8005820 con 0x7fc508065fe0 2020-04-22T14:07:30.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.663+0000 7fc510552700 1 -- 172.21.15.103:0/3199203385 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc508056c90 con 0x7fc508065fe0 2020-04-22T14:07:30.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.663+0000 7fc50daed700 1 --2- 172.21.15.103:0/3199203385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc508065fe0 0x7fc5080b6b10 secure :-1 s=THROTTLE_DONE pgs=671 cs=0 l=1 rx=0x7fc4f8002f30 tx=0x7fc4f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:30.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.664+0000 7fc4f77fe700 1 --2- 172.21.15.103:0/3199203385 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc4e804d7f0 0x7fc4e804fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:30.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.664+0000 7fc4f77fe700 1 -- 172.21.15.103:0/3199203385 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc4f8061ce0 con 0x7fc508065fe0 2020-04-22T14:07:30.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.664+0000 7fc50e2ee700 1 --2- 172.21.15.103:0/3199203385 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc4e804d7f0 0x7fc4e804fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:30.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.664+0000 7fc50e2ee700 1 --2- 172.21.15.103:0/3199203385 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc4e804d7f0 0x7fc4e804fcb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc5080ac8c0 tx=0x7fc500002670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:30.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.664+0000 7fc50e2ee700 1 --2- 172.21.15.103:0/3199203385 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc4e804d7f0 0x7fc4e804fcb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc5080ac8c0 tx=0x7fc500002670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:30.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.664+0000 7fc50e2ee700 1 --2- 172.21.15.103:0/3199203385 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc4e804d7f0 0x7fc4e804fcb0 secure :-1 s=READY pgs=257 cs=0 l=1 rx=0x7fc5080ac8c0 tx=0x7fc500002670).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:30.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.668+0000 7fc50daed700 1 --2- 172.21.15.103:0/3199203385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc508065fe0 0x7fc5080b6b10 secure :-1 s=THROTTLE_DONE pgs=671 cs=0 l=1 rx=0x7fc4f8002f30 tx=0x7fc4f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:30.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.668+0000 7fc4f77fe700 1 -- 172.21.15.103:0/3199203385 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fc4f803d0c0 con 0x7fc508065fe0 2020-04-22T14:07:30.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.811+0000 7fc510552700 1 -- 172.21.15.103:0/3199203385 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc508147360 con 0x7fc508065fe0 2020-04-22T14:07:30.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.811+0000 7fc50daed700 1 --2- 172.21.15.103:0/3199203385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc508065fe0 0x7fc5080b6b10 secure :-1 s=THROTTLE_DONE pgs=671 cs=0 l=1 rx=0x7fc4f8002f30 tx=0x7fc4f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:30.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.811+0000 7fc4f77fe700 1 -- 172.21.15.103:0/3199203385 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16104 (secure 0 0 0) 0x7fc4f80406e0 con 0x7fc508065fe0 2020-04-22T14:07:30.814 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:07:30.815 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":53,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:07:30.137149+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:07:27.809363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2020-04-22T14:07:28.880202+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:07:30.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.813+0000 7fc510552700 1 -- 172.21.15.103:0/3199203385 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc4e804d7f0 msgr2=0x7fc4e804fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:30.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.813+0000 7fc510552700 1 --2- 172.21.15.103:0/3199203385 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc4e804d7f0 0x7fc4e804fcb0 secure :-1 s=READY pgs=257 cs=0 l=1 rx=0x7fc5080ac8c0 tx=0x7fc500002670).stop 2020-04-22T14:07:30.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.813+0000 7fc510552700 1 -- 172.21.15.103:0/3199203385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc508065fe0 msgr2=0x7fc5080b6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:30.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.813+0000 7fc510552700 1 --2- 172.21.15.103:0/3199203385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc508065fe0 0x7fc5080b6b10 secure :-1 s=READY pgs=671 cs=0 l=1 rx=0x7fc4f8002f30 tx=0x7fc4f8007a40).stop 2020-04-22T14:07:30.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.813+0000 7fc510552700 1 -- 172.21.15.103:0/3199203385 shutdown_connections 2020-04-22T14:07:30.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.813+0000 7fc510552700 1 --2- 172.21.15.103:0/3199203385 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc4e804d7f0 0x7fc4e804fcb0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:30.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.813+0000 7fc510552700 1 --2- 172.21.15.103:0/3199203385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc508065fe0 0x7fc5080b6b10 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:30.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.813+0000 7fc510552700 1 -- 172.21.15.103:0/3199203385 >> 172.21.15.103:0/3199203385 conn(0x7fc5080b9160 msgr2=0x7fc5080615e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:30.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.813+0000 7fc510552700 1 -- 172.21.15.103:0/3199203385 shutdown_connections 2020-04-22T14:07:30.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.813+0000 7fc510552700 1 -- 172.21.15.103:0/3199203385 wait complete. 2020-04-22T14:07:30.826 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:30.839 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-04-22T14:07:30.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.986+0000 7efc9603b700 1 Processor -- start 2020-04-22T14:07:30.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.986+0000 7efc9603b700 1 -- start start 2020-04-22T14:07:30.991 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.987+0000 7efc9603b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7efc900b9140 0x7efc9012b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:30.991 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.987+0000 7efc9603b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7efc9012b670 0x7efc90143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:30.991 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.987+0000 7efc9603b700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc901467e0 con 0x7efc900ac950 2020-04-22T14:07:30.991 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.987+0000 7efc9603b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc900602f0 con 0x7efc9012b670 2020-04-22T14:07:30.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.987+0000 7efc9603b700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc90060050 con 0x7efc900b9140 2020-04-22T14:07:30.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.987+0000 7efc8f7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7efc900b9140 0x7efc9012b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:30.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.987+0000 7efc87fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7efc900ac950 0x7efc90146c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42476/0 (socket says 172.21.15.103:42476) 2020-04-22T14:07:30.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.987+0000 7efc87fff700 1 -- 172.21.15.103:0/3645711870 learned_addr learned my addr 172.21.15.103:0/3645711870 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:30.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.987+0000 7efc8ffff700 1 --2- 172.21.15.103:0/3645711870 >> v2:172.21.15.86:3300/0 conn(0x7efc9012b670 0x7efc90143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:30.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.987+0000 7efc8f7fe700 1 -- 172.21.15.103:0/3645711870 >> v2:172.21.15.86:3300/0 conn(0x7efc9012b670 msgr2=0x7efc90143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:30.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.987+0000 7efc8f7fe700 1 --2- 172.21.15.103:0/3645711870 >> v2:172.21.15.86:3300/0 conn(0x7efc9012b670 0x7efc90143090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:30.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.987+0000 7efc8f7fe700 1 -- 172.21.15.103:0/3645711870 >> v1:172.21.15.103:6789/0 conn(0x7efc900ac950 legacy=0x7efc90146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:30.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.987+0000 7efc8f7fe700 1 -- 172.21.15.103:0/3645711870 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc900b9520 con 0x7efc900b9140 2020-04-22T14:07:30.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.987+0000 7efc8effd700 1 -- 172.21.15.103:0/3645711870 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 555514004 0 0) 0x7efc901467e0 con 0x7efc900ac950 2020-04-22T14:07:30.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.987+0000 7efc8f7fe700 1 --2- 172.21.15.103:0/3645711870 >> v2:172.21.15.103:3300/0 conn(0x7efc900b9140 0x7efc9012b210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efc80002f30 tx=0x7efc80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:30.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.987+0000 7efc8f7fe700 1 --2- 172.21.15.103:0/3645711870 >> v2:172.21.15.103:3300/0 conn(0x7efc900b9140 0x7efc9012b210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efc80002f30 tx=0x7efc80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:30.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.987+0000 7efc8f7fe700 1 --2- 172.21.15.103:0/3645711870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc900b9140 0x7efc9012b210 secure :-1 s=READY pgs=673 cs=0 l=1 rx=0x7efc80002f30 tx=0x7efc80007a40).ready entity=mon.1 client_cookie=31a7d9a73eea2ff server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:30.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.987+0000 7efc8f7fe700 1 --2- 172.21.15.103:0/3645711870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc900b9140 0x7efc9012b210 secure :-1 s=THROTTLE_DONE pgs=673 cs=0 l=1 rx=0x7efc80002f30 tx=0x7efc80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:30.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.988+0000 7efc8effd700 1 -- 172.21.15.103:0/3645711870 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc80011470 con 0x7efc900b9140 2020-04-22T14:07:30.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.988+0000 7efc8f7fe700 1 --2- 172.21.15.103:0/3645711870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc900b9140 0x7efc9012b210 secure :-1 s=THROTTLE_DONE pgs=673 cs=0 l=1 rx=0x7efc80002f30 tx=0x7efc80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:30.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.988+0000 7efc8f7fe700 1 --2- 172.21.15.103:0/3645711870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc900b9140 0x7efc9012b210 secure :-1 s=THROTTLE_DONE pgs=673 cs=0 l=1 rx=0x7efc80002f30 tx=0x7efc80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:30.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.988+0000 7efc8effd700 1 -- 172.21.15.103:0/3645711870 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc800115d0 con 0x7efc900b9140 2020-04-22T14:07:30.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.988+0000 7efc8effd700 1 -- 172.21.15.103:0/3645711870 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc800119b0 con 0x7efc900b9140 2020-04-22T14:07:30.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.988+0000 7efc9603b700 1 -- 172.21.15.103:0/3645711870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc900b9140 msgr2=0x7efc9012b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:30.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.988+0000 7efc9603b700 1 --2- 172.21.15.103:0/3645711870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc900b9140 0x7efc9012b210 secure :-1 s=READY pgs=673 cs=0 l=1 rx=0x7efc80002f30 tx=0x7efc80007a40).stop 2020-04-22T14:07:30.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.988+0000 7efc9603b700 1 -- 172.21.15.103:0/3645711870 shutdown_connections 2020-04-22T14:07:30.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.988+0000 7efc9603b700 1 --2- 172.21.15.103:0/3645711870 >> v2:172.21.15.86:3300/0 conn(0x7efc9012b670 0x7efc90143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:30.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.988+0000 7efc9603b700 1 --2- 172.21.15.103:0/3645711870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc900b9140 0x7efc9012b210 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:30.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.988+0000 7efc9603b700 1 -- 172.21.15.103:0/3645711870 >> 172.21.15.103:0/3645711870 conn(0x7efc9005b7b0 msgr2=0x7efc900b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:30.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.988+0000 7efc9603b700 1 -- 172.21.15.103:0/3645711870 shutdown_connections 2020-04-22T14:07:30.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.988+0000 7efc9603b700 1 -- 172.21.15.103:0/3645711870 wait complete. 2020-04-22T14:07:30.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.989+0000 7efc9603b700 1 Processor -- start 2020-04-22T14:07:30.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.989+0000 7efc9603b700 1 -- start start 2020-04-22T14:07:30.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.990+0000 7efc9603b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efc900ac950 0x7efc90062c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:30.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.990+0000 7efc9603b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7efc9012b670 0x7efc900b4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:30.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.990+0000 7efc9603b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc9014cc30 con 0x7efc900b9140 2020-04-22T14:07:30.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.990+0000 7efc9603b700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc900b51c0 con 0x7efc9012b670 2020-04-22T14:07:30.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.990+0000 7efc9603b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc900b5d70 con 0x7efc900ac950 2020-04-22T14:07:30.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.990+0000 7efc8ffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7efc9012b670 0x7efc900b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:30.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.990+0000 7efc8ffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7efc9012b670 0x7efc900b4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50294/0 (socket says 172.21.15.103:50294) 2020-04-22T14:07:30.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.990+0000 7efc8ffff700 1 -- 172.21.15.103:0/1921549323 learned_addr learned my addr 172.21.15.103:0/1921549323 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:30.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.990+0000 7efc8f7fe700 1 --2- 172.21.15.103:0/1921549323 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efc900ac950 0x7efc90062c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:30.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.990+0000 7efc8ffff700 1 -- 172.21.15.103:0/1921549323 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efc900ac950 msgr2=0x7efc90062c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:30.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.990+0000 7efc8ffff700 1 --2- 172.21.15.103:0/1921549323 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efc900ac950 0x7efc90062c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:31.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.990+0000 7efc8ffff700 1 -- 172.21.15.103:0/1921549323 >> v1:172.21.15.86:6789/0 conn(0x7efc900b9140 legacy=0x7efc900b5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:31.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.990+0000 7efc8ffff700 1 -- 172.21.15.103:0/1921549323 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc900b5ee0 con 0x7efc9012b670 2020-04-22T14:07:31.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.990+0000 7efc8d7fa700 1 -- 172.21.15.103:0/1921549323 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2532688462 0 0) 0x7efc9014cc30 con 0x7efc900b9140 2020-04-22T14:07:31.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.990+0000 7efc8ffff700 1 --2- 172.21.15.103:0/1921549323 >> v2:172.21.15.103:3300/0 conn(0x7efc9012b670 0x7efc900b4060 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efc880032b0 tx=0x7efc88010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:31.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.990+0000 7efc8ffff700 1 --2- 172.21.15.103:0/1921549323 >> v2:172.21.15.103:3300/0 conn(0x7efc9012b670 0x7efc900b4060 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efc880032b0 tx=0x7efc88010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:31.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.990+0000 7efc8ffff700 1 --2- 172.21.15.103:0/1921549323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc9012b670 0x7efc900b4060 secure :-1 s=READY pgs=674 cs=0 l=1 rx=0x7efc880032b0 tx=0x7efc88010ef0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:31.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.990+0000 7efc8ffff700 1 --2- 172.21.15.103:0/1921549323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc9012b670 0x7efc900b4060 secure :-1 s=THROTTLE_DONE pgs=674 cs=0 l=1 rx=0x7efc880032b0 tx=0x7efc88010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:31.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.990+0000 7efc8d7fa700 1 -- 172.21.15.103:0/1921549323 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc88005e30 con 0x7efc9012b670 2020-04-22T14:07:31.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.990+0000 7efc8ffff700 1 --2- 172.21.15.103:0/1921549323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc9012b670 0x7efc900b4060 secure :-1 s=THROTTLE_DONE pgs=674 cs=0 l=1 rx=0x7efc880032b0 tx=0x7efc88010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:31.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.990+0000 7efc8d7fa700 1 -- 172.21.15.103:0/1921549323 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc88007560 con 0x7efc9012b670 2020-04-22T14:07:31.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.990+0000 7efc8ffff700 1 --2- 172.21.15.103:0/1921549323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc9012b670 0x7efc900b4060 secure :-1 s=THROTTLE_DONE pgs=674 cs=0 l=1 rx=0x7efc880032b0 tx=0x7efc88010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:31.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.991+0000 7efc8d7fa700 1 -- 172.21.15.103:0/1921549323 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc88007900 con 0x7efc9012b670 2020-04-22T14:07:31.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.991+0000 7efc9603b700 1 -- 172.21.15.103:0/1921549323 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc900b1040 con 0x7efc9012b670 2020-04-22T14:07:31.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.991+0000 7efc9603b700 1 -- 172.21.15.103:0/1921549323 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc90126e00 con 0x7efc9012b670 2020-04-22T14:07:31.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.991+0000 7efc8ffff700 1 --2- 172.21.15.103:0/1921549323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc9012b670 0x7efc900b4060 secure :-1 s=THROTTLE_DONE pgs=674 cs=0 l=1 rx=0x7efc880032b0 tx=0x7efc88010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:31.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.991+0000 7efc9603b700 1 -- 172.21.15.103:0/1921549323 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc9014cdc0 con 0x7efc9012b670 2020-04-22T14:07:31.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.992+0000 7efc8d7fa700 1 -- 172.21.15.103:0/1921549323 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7efc880101a0 con 0x7efc9012b670 2020-04-22T14:07:31.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.992+0000 7efc8ffff700 1 --2- 172.21.15.103:0/1921549323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc9012b670 0x7efc900b4060 secure :-1 s=THROTTLE_DONE pgs=674 cs=0 l=1 rx=0x7efc880032b0 tx=0x7efc88010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:31.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.992+0000 7efc8d7fa700 1 --2- 172.21.15.103:0/1921549323 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efc7404d7f0 0x7efc7404fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:31.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.992+0000 7efc8d7fa700 1 -- 172.21.15.103:0/1921549323 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efc88061430 con 0x7efc9012b670 2020-04-22T14:07:31.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.992+0000 7efc8f7fe700 1 --2- 172.21.15.103:0/1921549323 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efc7404d7f0 0x7efc7404fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:31.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.992+0000 7efc8f7fe700 1 --2- 172.21.15.103:0/1921549323 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efc7404d7f0 0x7efc7404fcb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efc80002f30 tx=0x7efc80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:31.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.992+0000 7efc8f7fe700 1 --2- 172.21.15.103:0/1921549323 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efc7404d7f0 0x7efc7404fcb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efc80002f30 tx=0x7efc80007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:31.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.992+0000 7efc8f7fe700 1 --2- 172.21.15.103:0/1921549323 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efc7404d7f0 0x7efc7404fcb0 secure :-1 s=READY pgs=258 cs=0 l=1 rx=0x7efc80002f30 tx=0x7efc80007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:31.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.996+0000 7efc8ffff700 1 --2- 172.21.15.103:0/1921549323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc9012b670 0x7efc900b4060 secure :-1 s=THROTTLE_DONE pgs=674 cs=0 l=1 rx=0x7efc880032b0 tx=0x7efc88010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:31.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:30.996+0000 7efc8d7fa700 1 -- 172.21.15.103:0/1921549323 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7efc8803c810 con 0x7efc9012b670 2020-04-22T14:07:31.192 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:31.190+0000 7efc9603b700 1 -- 172.21.15.103:0/1921549323 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7efc90056c90 con 0x7efc9012b670 2020-04-22T14:07:31.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:31.990+0000 7efc8ffff700 1 --2- 172.21.15.103:0/1921549323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc9012b670 0x7efc900b4060 secure :-1 s=READY pgs=674 cs=0 l=1 rx=0x7efc880032b0 tx=0x7efc88010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:32.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.148+0000 7efc8ffff700 1 --2- 172.21.15.103:0/1921549323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc9012b670 0x7efc900b4060 secure :-1 s=THROTTLE_DONE pgs=674 cs=0 l=1 rx=0x7efc880032b0 tx=0x7efc88010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:32.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.148+0000 7efc8d7fa700 1 -- 172.21.15.103:0/1921549323 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v28) v1 ==== 118+0+0 (secure 0 0 0) 0x7efc8803fe30 con 0x7efc9012b670 2020-04-22T14:07:32.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.150+0000 7efc9603b700 1 -- 172.21.15.103:0/1921549323 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efc7404d7f0 msgr2=0x7efc7404fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:32.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.150+0000 7efc9603b700 1 --2- 172.21.15.103:0/1921549323 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efc7404d7f0 0x7efc7404fcb0 secure :-1 s=READY pgs=258 cs=0 l=1 rx=0x7efc80002f30 tx=0x7efc80007a40).stop 2020-04-22T14:07:32.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.150+0000 7efc9603b700 1 -- 172.21.15.103:0/1921549323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc9012b670 msgr2=0x7efc900b4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:32.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.150+0000 7efc9603b700 1 --2- 172.21.15.103:0/1921549323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc9012b670 0x7efc900b4060 secure :-1 s=READY pgs=674 cs=0 l=1 rx=0x7efc880032b0 tx=0x7efc88010ef0).stop 2020-04-22T14:07:32.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.150+0000 7efc9603b700 1 -- 172.21.15.103:0/1921549323 shutdown_connections 2020-04-22T14:07:32.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.150+0000 7efc9603b700 1 --2- 172.21.15.103:0/1921549323 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efc7404d7f0 0x7efc7404fcb0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:32.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.150+0000 7efc9603b700 1 --2- 172.21.15.103:0/1921549323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc9012b670 0x7efc900b4060 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:32.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.150+0000 7efc9603b700 1 --2- 172.21.15.103:0/1921549323 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efc900ac950 0x7efc90062c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:32.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.150+0000 7efc9603b700 1 -- 172.21.15.103:0/1921549323 >> 172.21.15.103:0/1921549323 conn(0x7efc9005b7b0 msgr2=0x7efc90127c90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:32.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.150+0000 7efc9603b700 1 -- 172.21.15.103:0/1921549323 shutdown_connections 2020-04-22T14:07:32.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.150+0000 7efc9603b700 1 -- 172.21.15.103:0/1921549323 wait complete. 2020-04-22T14:07:32.165 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:32.179 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:07:32.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.329+0000 7f1117b83700 1 Processor -- start 2020-04-22T14:07:32.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.329+0000 7f1117b83700 1 -- start start 2020-04-22T14:07:32.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.330+0000 7f1117b83700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1110067170 0x7f11100b6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:32.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.330+0000 7f1117b83700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1110064ec0 con 0x7f11100ac740 2020-04-22T14:07:32.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.330+0000 7f1117b83700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1110146870 con 0x7f11101426d0 2020-04-22T14:07:32.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.330+0000 7f1117b83700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1110065af0 con 0x7f1110067170 2020-04-22T14:07:32.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.330+0000 7f1116120700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f11101426d0 0x7f1110142b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42492/0 (socket says 172.21.15.103:42492) 2020-04-22T14:07:32.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.330+0000 7f1116120700 1 -- 172.21.15.103:0/4042844280 learned_addr learned my addr 172.21.15.103:0/4042844280 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:32.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.330+0000 7f111591f700 1 --2- 172.21.15.103:0/4042844280 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1110067170 0x7f11100b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:32.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.330+0000 7f111491d700 1 -- 172.21.15.103:0/4042844280 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3039627442 0 0) 0x7f1110146870 con 0x7f11101426d0 2020-04-22T14:07:32.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.330+0000 7f111491d700 1 -- 172.21.15.103:0/4042844280 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10f8003230 con 0x7f11101426d0 2020-04-22T14:07:32.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.331+0000 7f111491d700 1 -- 172.21.15.103:0/4042844280 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1643434569 0 0) 0x7f10f8003230 con 0x7f11101426d0 2020-04-22T14:07:32.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.331+0000 7f111491d700 1 -- 172.21.15.103:0/4042844280 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1110067170 msgr2=0x7f11100b6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:32.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.331+0000 7f111491d700 1 --2- 172.21.15.103:0/4042844280 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1110067170 0x7f11100b6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:32.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.331+0000 7f111491d700 1 -- 172.21.15.103:0/4042844280 >> v1:172.21.15.86:6789/0 conn(0x7f11100ac740 legacy=0x7f111013c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:32.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.331+0000 7f111491d700 1 -- 172.21.15.103:0/4042844280 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1110067550 con 0x7f11101426d0 2020-04-22T14:07:32.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.331+0000 7f111491d700 1 -- 172.21.15.103:0/4042844280 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f1108001a50 con 0x7f11101426d0 2020-04-22T14:07:32.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.331+0000 7f111491d700 1 -- 172.21.15.103:0/4042844280 >> v1:172.21.15.103:6789/0 conn(0x7f11101426d0 legacy=0x7f1110142b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:32.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.331+0000 7f111491d700 1 --2- 172.21.15.103:0/4042844280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10f8003720 0x7f10f8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:32.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.331+0000 7f111491d700 1 --2- 172.21.15.103:0/4042844280 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10f8004060 0x7f10f8004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:32.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.331+0000 7f111491d700 1 --2- 172.21.15.103:0/4042844280 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1110067170 0x7f10f8004ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:32.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.331+0000 7f111491d700 1 -- 172.21.15.103:0/4042844280 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1110065af0 con 0x7f10f8004060 2020-04-22T14:07:32.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.331+0000 7f111491d700 1 -- 172.21.15.103:0/4042844280 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f8004f70 con 0x7f10f8003720 2020-04-22T14:07:32.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.331+0000 7f111491d700 1 -- 172.21.15.103:0/4042844280 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f8005130 con 0x7f1110067170 2020-04-22T14:07:32.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.331+0000 7f111591f700 1 --2- 172.21.15.103:0/4042844280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10f8003720 0x7f10f8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:32.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.331+0000 7f1116120700 1 --2- 172.21.15.103:0/4042844280 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1110067170 0x7f10f8004ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:32.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.331+0000 7f111511e700 1 --2- 172.21.15.103:0/4042844280 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10f8004060 0x7f10f8004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:32.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.331+0000 7f111591f700 1 -- 172.21.15.103:0/4042844280 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1110067170 msgr2=0x7f10f8004ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:32.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.331+0000 7f111591f700 1 --2- 172.21.15.103:0/4042844280 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1110067170 0x7f10f8004ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:32.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.331+0000 7f111591f700 1 -- 172.21.15.103:0/4042844280 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10f8004060 msgr2=0x7f10f8004530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:32.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.331+0000 7f111591f700 1 --2- 172.21.15.103:0/4042844280 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10f8004060 0x7f10f8004530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:32.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.331+0000 7f111591f700 1 -- 172.21.15.103:0/4042844280 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f8003230 con 0x7f10f8003720 2020-04-22T14:07:32.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.331+0000 7f1116120700 1 --2- 172.21.15.103:0/4042844280 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1110067170 0x7f10f8004ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:07:32.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.331+0000 7f111511e700 1 --2- 172.21.15.103:0/4042844280 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10f8004060 0x7f10f8004530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:07:32.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.331+0000 7f111591f700 1 --2- 172.21.15.103:0/4042844280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10f8003720 0x7f10f8003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1100002f30 tx=0x7f11000100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:32.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.331+0000 7f111591f700 1 --2- 172.21.15.103:0/4042844280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10f8003720 0x7f10f8003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1100002f30 tx=0x7f11000100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:32.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.331+0000 7f111591f700 1 --2- 172.21.15.103:0/4042844280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10f8003720 0x7f10f8003b40 secure :-1 s=READY pgs=676 cs=0 l=1 rx=0x7f1100002f30 tx=0x7f11000100d0).ready entity=mon.1 client_cookie=e20e2bcd98868bea server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:32.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.331+0000 7f111591f700 1 --2- 172.21.15.103:0/4042844280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10f8003720 0x7f10f8003b40 secure :-1 s=THROTTLE_DONE pgs=676 cs=0 l=1 rx=0x7f1100002f30 tx=0x7f11000100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:32.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.331+0000 7f111491d700 1 -- 172.21.15.103:0/4042844280 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1100010de0 con 0x7f10f8003720 2020-04-22T14:07:32.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.331+0000 7f111591f700 1 --2- 172.21.15.103:0/4042844280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10f8003720 0x7f10f8003b40 secure :-1 s=THROTTLE_DONE pgs=676 cs=0 l=1 rx=0x7f1100002f30 tx=0x7f11000100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:32.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.331+0000 7f111591f700 1 --2- 172.21.15.103:0/4042844280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10f8003720 0x7f10f8003b40 secure :-1 s=THROTTLE_DONE pgs=676 cs=0 l=1 rx=0x7f1100002f30 tx=0x7f11000100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:32.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.331+0000 7f111491d700 1 -- 172.21.15.103:0/4042844280 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1100008950 con 0x7f10f8003720 2020-04-22T14:07:32.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.331+0000 7f111491d700 1 -- 172.21.15.103:0/4042844280 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1100008cf0 con 0x7f10f8003720 2020-04-22T14:07:32.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.331+0000 7f1117b83700 1 -- 172.21.15.103:0/4042844280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10f8003720 msgr2=0x7f10f8003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:32.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.331+0000 7f1117b83700 1 --2- 172.21.15.103:0/4042844280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10f8003720 0x7f10f8003b40 secure :-1 s=READY pgs=676 cs=0 l=1 rx=0x7f1100002f30 tx=0x7f11000100d0).stop 2020-04-22T14:07:32.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.331+0000 7f1116120700 1 -- 172.21.15.103:0/4042844280 reap_dead start 2020-04-22T14:07:32.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.332+0000 7f1117b83700 1 -- 172.21.15.103:0/4042844280 shutdown_connections 2020-04-22T14:07:32.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.332+0000 7f1117b83700 1 -- 172.21.15.103:0/4042844280 >> 172.21.15.103:0/4042844280 conn(0x7f11100b9160 msgr2=0x7f111005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:32.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.332+0000 7f1117b83700 1 -- 172.21.15.103:0/4042844280 shutdown_connections 2020-04-22T14:07:32.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.332+0000 7f1117b83700 1 -- 172.21.15.103:0/4042844280 wait complete. 2020-04-22T14:07:32.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.333+0000 7f1117b83700 1 Processor -- start 2020-04-22T14:07:32.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.333+0000 7f1117b83700 1 -- start start 2020-04-22T14:07:32.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.333+0000 7f1117b83700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f11101369e0 0x7f11100b3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:32.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.333+0000 7f1117b83700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1110132df0 0x7f1110133270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:32.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.334+0000 7f1117b83700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11100afd90 con 0x7f1110142b60 2020-04-22T14:07:32.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.334+0000 7f1117b83700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11101336d0 con 0x7f11101369e0 2020-04-22T14:07:32.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.334+0000 7f1117b83700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11100b0030 con 0x7f1110132df0 2020-04-22T14:07:32.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.334+0000 7f111591f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f11101369e0 0x7f11100b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:32.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.334+0000 7f1116120700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f1110142b60 0x7f1110142ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42504/0 (socket says 172.21.15.103:42504) 2020-04-22T14:07:32.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.334+0000 7f1116120700 1 -- 172.21.15.103:0/3091661977 learned_addr learned my addr 172.21.15.103:0/3091661977 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:32.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.334+0000 7f111511e700 1 --2- 172.21.15.103:0/3091661977 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1110132df0 0x7f1110133270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:32.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.334+0000 7f111591f700 1 -- 172.21.15.103:0/3091661977 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1110132df0 msgr2=0x7f1110133270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:32.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.334+0000 7f111591f700 1 --2- 172.21.15.103:0/3091661977 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1110132df0 0x7f1110133270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:32.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.334+0000 7f111591f700 1 -- 172.21.15.103:0/3091661977 >> v1:172.21.15.103:6789/0 conn(0x7f1110142b60 legacy=0x7f1110142ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:32.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.334+0000 7f111591f700 1 -- 172.21.15.103:0/3091661977 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1110136dc0 con 0x7f11101369e0 2020-04-22T14:07:32.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.334+0000 7f10feffd700 1 -- 172.21.15.103:0/3091661977 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1852671681 0 0) 0x7f11100afd90 con 0x7f1110142b60 2020-04-22T14:07:32.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.334+0000 7f111591f700 1 --2- 172.21.15.103:0/3091661977 >> v2:172.21.15.103:3300/0 conn(0x7f11101369e0 0x7f11100b3870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1100002f30 tx=0x7f11000100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:32.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.334+0000 7f111591f700 1 --2- 172.21.15.103:0/3091661977 >> v2:172.21.15.103:3300/0 conn(0x7f11101369e0 0x7f11100b3870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1100002f30 tx=0x7f11000100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:32.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.334+0000 7f111591f700 1 --2- 172.21.15.103:0/3091661977 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11101369e0 0x7f11100b3870 secure :-1 s=READY pgs=678 cs=0 l=1 rx=0x7f1100002f30 tx=0x7f11000100d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:32.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.334+0000 7f111591f700 1 --2- 172.21.15.103:0/3091661977 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11101369e0 0x7f11100b3870 secure :-1 s=THROTTLE_DONE pgs=678 cs=0 l=1 rx=0x7f1100002f30 tx=0x7f11000100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:32.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.334+0000 7f10feffd700 1 -- 172.21.15.103:0/3091661977 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f110000f720 con 0x7f11101369e0 2020-04-22T14:07:32.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.334+0000 7f111591f700 1 --2- 172.21.15.103:0/3091661977 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11101369e0 0x7f11100b3870 secure :-1 s=THROTTLE_DONE pgs=678 cs=0 l=1 rx=0x7f1100002f30 tx=0x7f11000100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:32.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.334+0000 7f1117b83700 1 -- 172.21.15.103:0/3091661977 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11100afac0 con 0x7f11101369e0 2020-04-22T14:07:32.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.334+0000 7f111591f700 1 --2- 172.21.15.103:0/3091661977 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11101369e0 0x7f11100b3870 secure :-1 s=THROTTLE_DONE pgs=678 cs=0 l=1 rx=0x7f1100002f30 tx=0x7f11000100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:32.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.334+0000 7f10feffd700 1 -- 172.21.15.103:0/3091661977 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11000056c0 con 0x7f11101369e0 2020-04-22T14:07:32.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.334+0000 7f10feffd700 1 -- 172.21.15.103:0/3091661977 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f110000f880 con 0x7f11101369e0 2020-04-22T14:07:32.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.334+0000 7f1117b83700 1 -- 172.21.15.103:0/3091661977 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11100ad210 con 0x7f11101369e0 2020-04-22T14:07:32.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.335+0000 7f111591f700 1 --2- 172.21.15.103:0/3091661977 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11101369e0 0x7f11100b3870 secure :-1 s=THROTTLE_DONE pgs=678 cs=0 l=1 rx=0x7f1100002f30 tx=0x7f11000100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:32.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.335+0000 7f10feffd700 1 -- 172.21.15.103:0/3091661977 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f1100005aa0 con 0x7f11101369e0 2020-04-22T14:07:32.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.335+0000 7f111591f700 1 --2- 172.21.15.103:0/3091661977 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11101369e0 0x7f11100b3870 secure :-1 s=THROTTLE_DONE pgs=678 cs=0 l=1 rx=0x7f1100002f30 tx=0x7f11000100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:32.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.335+0000 7f1117b83700 1 -- 172.21.15.103:0/3091661977 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1110056c90 con 0x7f11101369e0 2020-04-22T14:07:32.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.335+0000 7f10feffd700 1 --2- 172.21.15.103:0/3091661977 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f10f004d7f0 0x7f10f004fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:32.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.336+0000 7f10feffd700 1 -- 172.21.15.103:0/3091661977 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1100061390 con 0x7f11101369e0 2020-04-22T14:07:32.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.336+0000 7f111511e700 1 --2- 172.21.15.103:0/3091661977 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f10f004d7f0 0x7f10f004fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:32.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.336+0000 7f111511e700 1 --2- 172.21.15.103:0/3091661977 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f10f004d7f0 0x7f10f004fcb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1110066130 tx=0x7f110c00c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:32.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.336+0000 7f111511e700 1 --2- 172.21.15.103:0/3091661977 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f10f004d7f0 0x7f10f004fcb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1110066130 tx=0x7f110c00c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:32.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.336+0000 7f111511e700 1 --2- 172.21.15.103:0/3091661977 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f10f004d7f0 0x7f10f004fcb0 secure :-1 s=READY pgs=259 cs=0 l=1 rx=0x7f1110066130 tx=0x7f110c00c820).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:32.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.340+0000 7f111591f700 1 --2- 172.21.15.103:0/3091661977 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11101369e0 0x7f11100b3870 secure :-1 s=THROTTLE_DONE pgs=678 cs=0 l=1 rx=0x7f1100002f30 tx=0x7f11000100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:32.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.340+0000 7f10feffd700 1 -- 172.21.15.103:0/3091661977 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f110003c890 con 0x7f11101369e0 2020-04-22T14:07:32.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.527+0000 7f1117b83700 1 -- 172.21.15.103:0/3091661977 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f11100b40c0 con 0x7f11101369e0 2020-04-22T14:07:32.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.527+0000 7f111591f700 1 --2- 172.21.15.103:0/3091661977 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11101369e0 0x7f11100b3870 secure :-1 s=THROTTLE_DONE pgs=678 cs=0 l=1 rx=0x7f1100002f30 tx=0x7f11000100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:32.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.527+0000 7f10feffd700 1 -- 172.21.15.103:0/3091661977 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f110003feb0 con 0x7f11101369e0 2020-04-22T14:07:32.530 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:07:32.530 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":28,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4898,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/167651529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":167651529},{"type":"v1","addr":"172.21.15.86:6835","nonce":167651529}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:07:30.137341+0000","modified":"2020-04-22T14:07:32.145409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5890},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5890":{"gid":5890,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/494421372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":494421372},{"type":"v1","addr":"172.21.15.103:6833","nonce":494421372}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2020-04-22T14:07:32.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.529+0000 7f1117b83700 1 -- 172.21.15.103:0/3091661977 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f10f004d7f0 msgr2=0x7f10f004fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:32.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.529+0000 7f1117b83700 1 --2- 172.21.15.103:0/3091661977 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f10f004d7f0 0x7f10f004fcb0 secure :-1 s=READY pgs=259 cs=0 l=1 rx=0x7f1110066130 tx=0x7f110c00c820).stop 2020-04-22T14:07:32.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.529+0000 7f1117b83700 1 -- 172.21.15.103:0/3091661977 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11101369e0 msgr2=0x7f11100b3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:32.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.529+0000 7f1117b83700 1 --2- 172.21.15.103:0/3091661977 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11101369e0 0x7f11100b3870 secure :-1 s=READY pgs=678 cs=0 l=1 rx=0x7f1100002f30 tx=0x7f11000100d0).stop 2020-04-22T14:07:32.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.529+0000 7f1117b83700 1 -- 172.21.15.103:0/3091661977 shutdown_connections 2020-04-22T14:07:32.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.529+0000 7f1117b83700 1 --2- 172.21.15.103:0/3091661977 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f10f004d7f0 0x7f10f004fcb0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:32.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.529+0000 7f1117b83700 1 --2- 172.21.15.103:0/3091661977 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11101369e0 0x7f11100b3870 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:32.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.529+0000 7f1117b83700 1 --2- 172.21.15.103:0/3091661977 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1110132df0 0x7f1110133270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:32.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.529+0000 7f1117b83700 1 -- 172.21.15.103:0/3091661977 >> 172.21.15.103:0/3091661977 conn(0x7f11100b9160 msgr2=0x7f11100b47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:32.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.529+0000 7f1117b83700 1 -- 172.21.15.103:0/3091661977 shutdown_connections 2020-04-22T14:07:32.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.529+0000 7f1117b83700 1 -- 172.21.15.103:0/3091661977 wait complete. 2020-04-22T14:07:32.533 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 28 2020-04-22T14:07:32.541 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:32.554 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:07:32.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.699+0000 7f588b468700 1 Processor -- start 2020-04-22T14:07:32.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.699+0000 7f588b468700 1 -- start start 2020-04-22T14:07:32.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.700+0000 7f588b468700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5884065fe0 0x7f58841464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:32.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.700+0000 7f588b468700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5884063e30 0x7f58840642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:32.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.700+0000 7f588b468700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5884143300 con 0x7f588412c0d0 2020-04-22T14:07:32.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.700+0000 7f588b468700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58841435a0 con 0x7f5884065fe0 2020-04-22T14:07:32.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.700+0000 7f588b468700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5884143840 con 0x7f5884063e30 2020-04-22T14:07:32.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.700+0000 7f5889204700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f588412c0d0 0x7f588405b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42508/0 (socket says 172.21.15.103:42508) 2020-04-22T14:07:32.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.700+0000 7f5889204700 1 -- 172.21.15.103:0/3012019607 learned_addr learned my addr 172.21.15.103:0/3012019607 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:32.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.700+0000 7f5889a05700 1 --2- 172.21.15.103:0/3012019607 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5884063e30 0x7f58840642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:32.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.700+0000 7f5888a03700 1 --2- 172.21.15.103:0/3012019607 >> v2:172.21.15.86:3300/0 conn(0x7f5884065fe0 0x7f58841464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:32.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.700+0000 7f5877fff700 1 -- 172.21.15.103:0/3012019607 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 189364388 0 0) 0x7f5884143300 con 0x7f588412c0d0 2020-04-22T14:07:32.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.700+0000 7f5877fff700 1 -- 172.21.15.103:0/3012019607 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f586c003230 con 0x7f588412c0d0 2020-04-22T14:07:32.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.700+0000 7f5889a05700 1 -- 172.21.15.103:0/3012019607 >> v2:172.21.15.86:3300/0 conn(0x7f5884065fe0 msgr2=0x7f58841464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:32.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.700+0000 7f5889a05700 1 --2- 172.21.15.103:0/3012019607 >> v2:172.21.15.86:3300/0 conn(0x7f5884065fe0 0x7f58841464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:32.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.700+0000 7f5889a05700 1 -- 172.21.15.103:0/3012019607 >> v1:172.21.15.103:6789/0 conn(0x7f588412c0d0 legacy=0x7f588405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:32.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.701+0000 7f5889a05700 1 -- 172.21.15.103:0/3012019607 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f588405bb50 con 0x7f5884063e30 2020-04-22T14:07:32.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.701+0000 7f5889a05700 1 --2- 172.21.15.103:0/3012019607 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5884063e30 0x7f58840642c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f587c0032b0 tx=0x7f587c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:32.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.701+0000 7f5889a05700 1 --2- 172.21.15.103:0/3012019607 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5884063e30 0x7f58840642c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f587c0032b0 tx=0x7f587c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:32.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.701+0000 7f5889a05700 1 --2- 172.21.15.103:0/3012019607 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5884063e30 0x7f58840642c0 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f587c0032b0 tx=0x7f587c007dc0).ready entity=mon.2 client_cookie=f546702271c1df33 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:32.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.701+0000 7f5889a05700 1 --2- 172.21.15.103:0/3012019607 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5884063e30 0x7f58840642c0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f587c0032b0 tx=0x7f587c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:32.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.701+0000 7f5877fff700 1 -- 172.21.15.103:0/3012019607 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f587c011d70 con 0x7f5884063e30 2020-04-22T14:07:32.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.701+0000 7f5889a05700 1 --2- 172.21.15.103:0/3012019607 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5884063e30 0x7f58840642c0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f587c0032b0 tx=0x7f587c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:32.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.701+0000 7f5889a05700 1 --2- 172.21.15.103:0/3012019607 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5884063e30 0x7f58840642c0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f587c0032b0 tx=0x7f587c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:32.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.701+0000 7f5877fff700 1 -- 172.21.15.103:0/3012019607 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f587c00a180 con 0x7f5884063e30 2020-04-22T14:07:32.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.701+0000 7f5877fff700 1 -- 172.21.15.103:0/3012019607 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f587c00a560 con 0x7f5884063e30 2020-04-22T14:07:32.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.701+0000 7f588b468700 1 -- 172.21.15.103:0/3012019607 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5884063e30 msgr2=0x7f58840642c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:32.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.701+0000 7f588b468700 1 --2- 172.21.15.103:0/3012019607 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5884063e30 0x7f58840642c0 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f587c0032b0 tx=0x7f587c007dc0).stop 2020-04-22T14:07:32.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.702+0000 7f588b468700 1 -- 172.21.15.103:0/3012019607 shutdown_connections 2020-04-22T14:07:32.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.702+0000 7f588b468700 1 --2- 172.21.15.103:0/3012019607 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5884063e30 0x7f58840642c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:32.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.702+0000 7f588b468700 1 --2- 172.21.15.103:0/3012019607 >> v2:172.21.15.86:3300/0 conn(0x7f5884065fe0 0x7f58841464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:32.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.702+0000 7f588b468700 1 -- 172.21.15.103:0/3012019607 >> 172.21.15.103:0/3012019607 conn(0x7f58840b9160 msgr2=0x7f588405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:32.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.702+0000 7f588b468700 1 -- 172.21.15.103:0/3012019607 shutdown_connections 2020-04-22T14:07:32.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.702+0000 7f588b468700 1 -- 172.21.15.103:0/3012019607 wait complete. 2020-04-22T14:07:32.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.703+0000 7f588b468700 1 Processor -- start 2020-04-22T14:07:32.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.703+0000 7f588b468700 1 -- start start 2020-04-22T14:07:32.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.703+0000 7f588b468700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5884063e30 0x7f5884141fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:32.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.703+0000 7f588b468700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5884065fe0 0x7f58840ac740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:32.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.703+0000 7f588b468700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f588412c0d0 0x7f588413eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:32.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.703+0000 7f588b468700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f588413d270 con 0x7f588412c0d0 2020-04-22T14:07:32.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.703+0000 7f588b468700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58840accc0 con 0x7f5884065fe0 2020-04-22T14:07:32.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.703+0000 7f588b468700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5884064830 con 0x7f5884063e30 2020-04-22T14:07:32.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.704+0000 7f5888a03700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5884065fe0 0x7f58840ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:32.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.704+0000 7f5888a03700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5884065fe0 0x7f58840ac740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50324/0 (socket says 172.21.15.103:50324) 2020-04-22T14:07:32.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.704+0000 7f5888a03700 1 -- 172.21.15.103:0/201394707 learned_addr learned my addr 172.21.15.103:0/201394707 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:32.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.704+0000 7f5889204700 1 --2- 172.21.15.103:0/201394707 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5884063e30 0x7f5884141fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:32.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.704+0000 7f5889a05700 1 --2- 172.21.15.103:0/201394707 >> v2:172.21.15.86:3300/0 conn(0x7f588412c0d0 0x7f588413eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:32.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.704+0000 7f5888a03700 1 -- 172.21.15.103:0/201394707 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5884063e30 msgr2=0x7f5884141fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:32.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.704+0000 7f5888a03700 1 --2- 172.21.15.103:0/201394707 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5884063e30 0x7f5884141fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:32.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.704+0000 7f5888a03700 1 -- 172.21.15.103:0/201394707 >> v2:172.21.15.86:3300/0 conn(0x7f588412c0d0 msgr2=0x7f588413eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:32.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.704+0000 7f5888a03700 1 --2- 172.21.15.103:0/201394707 >> v2:172.21.15.86:3300/0 conn(0x7f588412c0d0 0x7f588413eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:32.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.704+0000 7f5888a03700 1 -- 172.21.15.103:0/201394707 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5884064ad0 con 0x7f5884065fe0 2020-04-22T14:07:32.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.704+0000 7f5889204700 1 --2- 172.21.15.103:0/201394707 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5884063e30 0x7f5884141fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:07:32.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.704+0000 7f5889a05700 1 --2- 172.21.15.103:0/201394707 >> v2:172.21.15.86:3300/0 conn(0x7f588412c0d0 0x7f588413eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:07:32.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.704+0000 7f5888a03700 1 --2- 172.21.15.103:0/201394707 >> v2:172.21.15.103:3300/0 conn(0x7f5884065fe0 0x7f58840ac740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5880002f30 tx=0x7f5880010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:32.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.704+0000 7f5888a03700 1 --2- 172.21.15.103:0/201394707 >> v2:172.21.15.103:3300/0 conn(0x7f5884065fe0 0x7f58840ac740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5880002f30 tx=0x7f5880010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:32.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.704+0000 7f5888a03700 1 --2- 172.21.15.103:0/201394707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5884065fe0 0x7f58840ac740 secure :-1 s=READY pgs=680 cs=0 l=1 rx=0x7f5880002f30 tx=0x7f5880010d40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:32.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.704+0000 7f5888a03700 1 --2- 172.21.15.103:0/201394707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5884065fe0 0x7f58840ac740 secure :-1 s=THROTTLE_DONE pgs=680 cs=0 l=1 rx=0x7f5880002f30 tx=0x7f5880010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:32.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.704+0000 7f58767fc700 1 -- 172.21.15.103:0/201394707 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5880007550 con 0x7f5884065fe0 2020-04-22T14:07:32.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.704+0000 7f5888a03700 1 --2- 172.21.15.103:0/201394707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5884065fe0 0x7f58840ac740 secure :-1 s=THROTTLE_DONE pgs=680 cs=0 l=1 rx=0x7f5880002f30 tx=0x7f5880010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:32.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.704+0000 7f5888a03700 1 --2- 172.21.15.103:0/201394707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5884065fe0 0x7f58840ac740 secure :-1 s=THROTTLE_DONE pgs=680 cs=0 l=1 rx=0x7f5880002f30 tx=0x7f5880010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:32.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.704+0000 7f58767fc700 1 -- 172.21.15.103:0/201394707 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58800056c0 con 0x7f5884065fe0 2020-04-22T14:07:32.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.704+0000 7f58767fc700 1 -- 172.21.15.103:0/201394707 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5880005ae0 con 0x7f5884065fe0 2020-04-22T14:07:32.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.704+0000 7f588b468700 1 -- 172.21.15.103:0/201394707 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5884064f70 con 0x7f5884065fe0 2020-04-22T14:07:32.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.704+0000 7f588b468700 1 -- 172.21.15.103:0/201394707 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5884129420 con 0x7f5884065fe0 2020-04-22T14:07:32.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.705+0000 7f5888a03700 1 --2- 172.21.15.103:0/201394707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5884065fe0 0x7f58840ac740 secure :-1 s=THROTTLE_DONE pgs=680 cs=0 l=1 rx=0x7f5880002f30 tx=0x7f5880010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:32.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.705+0000 7f58767fc700 1 -- 172.21.15.103:0/201394707 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f5880005c40 con 0x7f5884065fe0 2020-04-22T14:07:32.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.705+0000 7f5888a03700 1 --2- 172.21.15.103:0/201394707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5884065fe0 0x7f58840ac740 secure :-1 s=THROTTLE_DONE pgs=680 cs=0 l=1 rx=0x7f5880002f30 tx=0x7f5880010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:32.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.705+0000 7f588b468700 1 -- 172.21.15.103:0/201394707 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5884064c60 con 0x7f5884065fe0 2020-04-22T14:07:32.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.706+0000 7f58767fc700 1 --2- 172.21.15.103:0/201394707 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f586404d9a0 0x7f586404fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:32.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.706+0000 7f58767fc700 1 -- 172.21.15.103:0/201394707 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f58800619f0 con 0x7f5884065fe0 2020-04-22T14:07:32.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.706+0000 7f5889204700 1 --2- 172.21.15.103:0/201394707 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f586404d9a0 0x7f586404fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:32.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.706+0000 7f5889204700 1 --2- 172.21.15.103:0/201394707 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f586404d9a0 0x7f586404fe60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f58780010d0 tx=0x7f5878001730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:32.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.706+0000 7f5889204700 1 --2- 172.21.15.103:0/201394707 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f586404d9a0 0x7f586404fe60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f58780010d0 tx=0x7f5878001730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:32.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.706+0000 7f5889204700 1 --2- 172.21.15.103:0/201394707 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f586404d9a0 0x7f586404fe60 secure :-1 s=READY pgs=260 cs=0 l=1 rx=0x7f58780010d0 tx=0x7f5878001730).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:32.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.710+0000 7f5888a03700 1 --2- 172.21.15.103:0/201394707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5884065fe0 0x7f58840ac740 secure :-1 s=THROTTLE_DONE pgs=680 cs=0 l=1 rx=0x7f5880002f30 tx=0x7f5880010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:32.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.710+0000 7f58767fc700 1 -- 172.21.15.103:0/201394707 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f588003cd70 con 0x7f5884065fe0 2020-04-22T14:07:32.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.850+0000 7f588b468700 1 -- 172.21.15.103:0/201394707 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5884056c90 con 0x7f5884065fe0 2020-04-22T14:07:32.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.851+0000 7f5888a03700 1 --2- 172.21.15.103:0/201394707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5884065fe0 0x7f58840ac740 secure :-1 s=THROTTLE_DONE pgs=680 cs=0 l=1 rx=0x7f5880002f30 tx=0x7f5880010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:32.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.851+0000 7f58767fc700 1 -- 172.21.15.103:0/201394707 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+16091 (secure 0 0 0) 0x7f5880040390 con 0x7f5884065fe0 2020-04-22T14:07:32.854 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:07:32.854 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:07:31.138938+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:07:27.809363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2020-04-22T14:07:28.880202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:07:32.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.853+0000 7f588b468700 1 -- 172.21.15.103:0/201394707 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f586404d9a0 msgr2=0x7f586404fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:32.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.853+0000 7f588b468700 1 --2- 172.21.15.103:0/201394707 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f586404d9a0 0x7f586404fe60 secure :-1 s=READY pgs=260 cs=0 l=1 rx=0x7f58780010d0 tx=0x7f5878001730).stop 2020-04-22T14:07:32.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.853+0000 7f588b468700 1 -- 172.21.15.103:0/201394707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5884065fe0 msgr2=0x7f58840ac740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:32.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.853+0000 7f588b468700 1 --2- 172.21.15.103:0/201394707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5884065fe0 0x7f58840ac740 secure :-1 s=READY pgs=680 cs=0 l=1 rx=0x7f5880002f30 tx=0x7f5880010d40).stop 2020-04-22T14:07:32.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.853+0000 7f588b468700 1 -- 172.21.15.103:0/201394707 shutdown_connections 2020-04-22T14:07:32.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.853+0000 7f588b468700 1 --2- 172.21.15.103:0/201394707 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f586404d9a0 0x7f586404fe60 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:32.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.853+0000 7f588b468700 1 --2- 172.21.15.103:0/201394707 >> v2:172.21.15.86:3300/0 conn(0x7f588412c0d0 0x7f588413eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:32.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.853+0000 7f588b468700 1 --2- 172.21.15.103:0/201394707 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5884063e30 0x7f5884141fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:32.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.853+0000 7f588b468700 1 --2- 172.21.15.103:0/201394707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5884065fe0 0x7f58840ac740 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:32.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.853+0000 7f588b468700 1 -- 172.21.15.103:0/201394707 >> 172.21.15.103:0/201394707 conn(0x7f58840b9160 msgr2=0x7f58840b4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:32.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.853+0000 7f588b468700 1 -- 172.21.15.103:0/201394707 shutdown_connections 2020-04-22T14:07:32.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:32.853+0000 7f588b468700 1 -- 172.21.15.103:0/201394707 wait complete. 2020-04-22T14:07:32.866 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:32.880 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:07:33.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.029+0000 7f42e9851700 1 Processor -- start 2020-04-22T14:07:33.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.029+0000 7f42e9851700 1 -- start start 2020-04-22T14:07:33.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.030+0000 7f42e9851700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f42e4152a90 0x7f42e40b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:33.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.030+0000 7f42e9851700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f42e4062170 0x7f42e40b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:33.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.030+0000 7f42e9851700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42e40b5210 0x7f42e4156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:33.035 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.030+0000 7f42e9851700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42e40b5650 con 0x7f42e4062170 2020-04-22T14:07:33.035 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.030+0000 7f42e9851700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42e40614f0 con 0x7f42e4152a90 2020-04-22T14:07:33.035 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.030+0000 7f42e9851700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e4061790 con 0x7f42e40b5210 2020-04-22T14:07:33.035 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.030+0000 7f42e37fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f42e4152a90 0x7f42e40b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:33.035 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.030+0000 7f42e37fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f42e4152a90 0x7f42e40b44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50330/0 (socket says 172.21.15.103:50330) 2020-04-22T14:07:33.035 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.030+0000 7f42e37fe700 1 -- 172.21.15.103:0/96120611 learned_addr learned my addr 172.21.15.103:0/96120611 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:33.035 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.030+0000 7f42e3fff700 1 --2- 172.21.15.103:0/96120611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42e40b5210 0x7f42e4156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:33.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.030+0000 7f42e2ffd700 1 --2- 172.21.15.103:0/96120611 >> v2:172.21.15.86:3300/0 conn(0x7f42e4062170 0x7f42e40b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:33.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.030+0000 7f42e37fe700 1 -- 172.21.15.103:0/96120611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42e40b5210 msgr2=0x7f42e4156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:33.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.030+0000 7f42e37fe700 1 --2- 172.21.15.103:0/96120611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42e40b5210 0x7f42e4156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:33.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.030+0000 7f42e37fe700 1 -- 172.21.15.103:0/96120611 >> v2:172.21.15.86:3300/0 conn(0x7f42e4062170 msgr2=0x7f42e40b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:33.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.030+0000 7f42e37fe700 1 --2- 172.21.15.103:0/96120611 >> v2:172.21.15.86:3300/0 conn(0x7f42e4062170 0x7f42e40b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:33.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.030+0000 7f42e37fe700 1 -- 172.21.15.103:0/96120611 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e4061a30 con 0x7f42e4152a90 2020-04-22T14:07:33.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.030+0000 7f42e37fe700 1 --2- 172.21.15.103:0/96120611 >> v2:172.21.15.103:3300/0 conn(0x7f42e4152a90 0x7f42e40b44d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f42d4002f30 tx=0x7f42d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.030+0000 7f42e37fe700 1 --2- 172.21.15.103:0/96120611 >> v2:172.21.15.103:3300/0 conn(0x7f42e4152a90 0x7f42e40b44d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f42d4002f30 tx=0x7f42d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.030+0000 7f42e37fe700 1 --2- 172.21.15.103:0/96120611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42e4152a90 0x7f42e40b44d0 secure :-1 s=READY pgs=681 cs=0 l=1 rx=0x7f42d4002f30 tx=0x7f42d4007a40).ready entity=mon.1 client_cookie=2cb7e8f98961b5ca server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:33.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.030+0000 7f42e37fe700 1 --2- 172.21.15.103:0/96120611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42e4152a90 0x7f42e40b44d0 secure :-1 s=THROTTLE_DONE pgs=681 cs=0 l=1 rx=0x7f42d4002f30 tx=0x7f42d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.030+0000 7f42e27fc700 1 -- 172.21.15.103:0/96120611 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42d4011720 con 0x7f42e4152a90 2020-04-22T14:07:33.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.030+0000 7f42e37fe700 1 --2- 172.21.15.103:0/96120611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42e4152a90 0x7f42e40b44d0 secure :-1 s=THROTTLE_DONE pgs=681 cs=0 l=1 rx=0x7f42d4002f30 tx=0x7f42d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.030+0000 7f42e27fc700 1 -- 172.21.15.103:0/96120611 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d4011880 con 0x7f42e4152a90 2020-04-22T14:07:33.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.030+0000 7f42e37fe700 1 --2- 172.21.15.103:0/96120611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42e4152a90 0x7f42e40b44d0 secure :-1 s=THROTTLE_DONE pgs=681 cs=0 l=1 rx=0x7f42d4002f30 tx=0x7f42d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.030+0000 7f42e27fc700 1 -- 172.21.15.103:0/96120611 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42d4011ca0 con 0x7f42e4152a90 2020-04-22T14:07:33.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.030+0000 7f42e9851700 1 -- 172.21.15.103:0/96120611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42e4152a90 msgr2=0x7f42e40b44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:33.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.030+0000 7f42e9851700 1 --2- 172.21.15.103:0/96120611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42e4152a90 0x7f42e40b44d0 secure :-1 s=READY pgs=681 cs=0 l=1 rx=0x7f42d4002f30 tx=0x7f42d4007a40).stop 2020-04-22T14:07:33.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.031+0000 7f42e9851700 1 -- 172.21.15.103:0/96120611 shutdown_connections 2020-04-22T14:07:33.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.031+0000 7f42e9851700 1 --2- 172.21.15.103:0/96120611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42e40b5210 0x7f42e4156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:33.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.031+0000 7f42e9851700 1 --2- 172.21.15.103:0/96120611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42e4152a90 0x7f42e40b44d0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:33.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.031+0000 7f42e9851700 1 --2- 172.21.15.103:0/96120611 >> v2:172.21.15.86:3300/0 conn(0x7f42e4062170 0x7f42e40b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:33.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.031+0000 7f42e9851700 1 -- 172.21.15.103:0/96120611 >> 172.21.15.103:0/96120611 conn(0x7f42e405ad30 msgr2=0x7f42e405b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:33.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.031+0000 7f42e9851700 1 -- 172.21.15.103:0/96120611 shutdown_connections 2020-04-22T14:07:33.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.031+0000 7f42e9851700 1 -- 172.21.15.103:0/96120611 wait complete. 2020-04-22T14:07:33.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.032+0000 7f42e9851700 1 Processor -- start 2020-04-22T14:07:33.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.033+0000 7f42e9851700 1 -- start start 2020-04-22T14:07:33.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.033+0000 7f42e9851700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f42e40b5210 0x7f42e4062bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:33.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.033+0000 7f42e9851700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42e4152a90 0x7f42e4064560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:33.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.033+0000 7f42e9851700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42e4064b50 con 0x7f42e4062170 2020-04-22T14:07:33.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.033+0000 7f42e9851700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42e40668e0 con 0x7f42e40b5210 2020-04-22T14:07:33.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.033+0000 7f42e9851700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e4064df0 con 0x7f42e4152a90 2020-04-22T14:07:33.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.033+0000 7f42e37fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f42e4062170 0x7f42e411ea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42524/0 (socket says 172.21.15.103:42524) 2020-04-22T14:07:33.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.033+0000 7f42e37fe700 1 -- 172.21.15.103:0/3100516617 learned_addr learned my addr 172.21.15.103:0/3100516617 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:33.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.033+0000 7f42cbfff700 1 -- 172.21.15.103:0/3100516617 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1625544344 0 0) 0x7f42e4064b50 con 0x7f42e4062170 2020-04-22T14:07:33.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.033+0000 7f42cbfff700 1 -- 172.21.15.103:0/3100516617 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42c4003230 con 0x7f42e4062170 2020-04-22T14:07:33.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.033+0000 7f42e3fff700 1 --2- 172.21.15.103:0/3100516617 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42e4152a90 0x7f42e4064560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:33.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.034+0000 7f42e2ffd700 1 --2- 172.21.15.103:0/3100516617 >> v2:172.21.15.86:3300/0 conn(0x7f42e40b5210 0x7f42e4062bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:33.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.034+0000 7f42cbfff700 1 -- 172.21.15.103:0/3100516617 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 541947087 0 0) 0x7f42c4003230 con 0x7f42e4062170 2020-04-22T14:07:33.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.034+0000 7f42cbfff700 1 -- 172.21.15.103:0/3100516617 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f42e4064b50 con 0x7f42e4062170 2020-04-22T14:07:33.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.034+0000 7f42cbfff700 1 -- 172.21.15.103:0/3100516617 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f42d40085e0 con 0x7f42e4062170 2020-04-22T14:07:33.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.034+0000 7f42cbfff700 1 -- 172.21.15.103:0/3100516617 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42e4152a90 msgr2=0x7f42e4064560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:33.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.034+0000 7f42cbfff700 1 --2- 172.21.15.103:0/3100516617 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42e4152a90 0x7f42e4064560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:33.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.034+0000 7f42cbfff700 1 -- 172.21.15.103:0/3100516617 >> v2:172.21.15.86:3300/0 conn(0x7f42e40b5210 msgr2=0x7f42e4062bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:33.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.034+0000 7f42cbfff700 1 --2- 172.21.15.103:0/3100516617 >> v2:172.21.15.86:3300/0 conn(0x7f42e40b5210 0x7f42e4062bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:33.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.034+0000 7f42cbfff700 1 -- 172.21.15.103:0/3100516617 >> v1:172.21.15.103:6789/0 conn(0x7f42e4062170 legacy=0x7f42e411ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:33.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.034+0000 7f42cbfff700 1 --2- 172.21.15.103:0/3100516617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42c40037f0 0x7f42c4003c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:33.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.034+0000 7f42cbfff700 1 --2- 172.21.15.103:0/3100516617 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42c40044d0 0x7f42c4004950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:33.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.034+0000 7f42cbfff700 1 --2- 172.21.15.103:0/3100516617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42c4004db0 0x7f42c400d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:33.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.034+0000 7f42cbfff700 1 -- 172.21.15.103:0/3100516617 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e40668e0 con 0x7f42c40037f0 2020-04-22T14:07:33.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.034+0000 7f42cbfff700 1 -- 172.21.15.103:0/3100516617 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e4064df0 con 0x7f42c4004db0 2020-04-22T14:07:33.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.034+0000 7f42cbfff700 1 -- 172.21.15.103:0/3100516617 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c400dd90 con 0x7f42c40044d0 2020-04-22T14:07:33.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.034+0000 7f42e3fff700 1 --2- 172.21.15.103:0/3100516617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42c4004db0 0x7f42c400d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:33.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.034+0000 7f42e37fe700 1 --2- 172.21.15.103:0/3100516617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42c40037f0 0x7f42c4003c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:33.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.034+0000 7f42e2ffd700 1 --2- 172.21.15.103:0/3100516617 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42c40044d0 0x7f42c4004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:33.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.034+0000 7f42e3fff700 1 -- 172.21.15.103:0/3100516617 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42c40044d0 msgr2=0x7f42c4004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:33.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.034+0000 7f42e3fff700 1 --2- 172.21.15.103:0/3100516617 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42c40044d0 0x7f42c4004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:33.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.034+0000 7f42e3fff700 1 -- 172.21.15.103:0/3100516617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42c40037f0 msgr2=0x7f42c4003c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:33.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.034+0000 7f42e3fff700 1 --2- 172.21.15.103:0/3100516617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42c40037f0 0x7f42c4003c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:33.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.034+0000 7f42e3fff700 1 -- 172.21.15.103:0/3100516617 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e4065090 con 0x7f42c4004db0 2020-04-22T14:07:33.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.034+0000 7f42e9851700 1 -- 172.21.15.103:0/3100516617 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42e4065530 con 0x7f42c4004db0 2020-04-22T14:07:33.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.034+0000 7f42e3fff700 1 --2- 172.21.15.103:0/3100516617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42c4004db0 0x7f42c400d930 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f42dc0032b0 tx=0x7f42dc010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.034+0000 7f42e9851700 1 -- 172.21.15.103:0/3100516617 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42e40647a0 con 0x7f42c4004db0 2020-04-22T14:07:33.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.034+0000 7f42e3fff700 1 --2- 172.21.15.103:0/3100516617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42c4004db0 0x7f42c400d930 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f42dc0032b0 tx=0x7f42dc010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.034+0000 7f42e3fff700 1 --2- 172.21.15.103:0/3100516617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42c4004db0 0x7f42c400d930 secure :-1 s=READY pgs=683 cs=0 l=1 rx=0x7f42dc0032b0 tx=0x7f42dc010d70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:33.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.034+0000 7f42e3fff700 1 --2- 172.21.15.103:0/3100516617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42c4004db0 0x7f42c400d930 secure :-1 s=THROTTLE_DONE pgs=683 cs=0 l=1 rx=0x7f42dc0032b0 tx=0x7f42dc010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.034+0000 7f42e3fff700 1 --2- 172.21.15.103:0/3100516617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42c4004db0 0x7f42c400d930 secure :-1 s=THROTTLE_DONE pgs=683 cs=0 l=1 rx=0x7f42dc0032b0 tx=0x7f42dc010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.034+0000 7f42cbfff700 1 -- 172.21.15.103:0/3100516617 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42dc007170 con 0x7f42c4004db0 2020-04-22T14:07:33.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.035+0000 7f42e3fff700 1 --2- 172.21.15.103:0/3100516617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42c4004db0 0x7f42c400d930 secure :-1 s=THROTTLE_DONE pgs=683 cs=0 l=1 rx=0x7f42dc0032b0 tx=0x7f42dc010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.035+0000 7f42cbfff700 1 -- 172.21.15.103:0/3100516617 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42dc0072d0 con 0x7f42c4004db0 2020-04-22T14:07:33.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.035+0000 7f42cbfff700 1 -- 172.21.15.103:0/3100516617 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42dc0076b0 con 0x7f42c4004db0 2020-04-22T14:07:33.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.035+0000 7f42e3fff700 1 --2- 172.21.15.103:0/3100516617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42c4004db0 0x7f42c400d930 secure :-1 s=THROTTLE_DONE pgs=683 cs=0 l=1 rx=0x7f42dc0032b0 tx=0x7f42dc010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.035+0000 7f42cbfff700 1 -- 172.21.15.103:0/3100516617 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f42dc007810 con 0x7f42c4004db0 2020-04-22T14:07:33.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.035+0000 7f42e3fff700 1 --2- 172.21.15.103:0/3100516617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42c4004db0 0x7f42c400d930 secure :-1 s=THROTTLE_DONE pgs=683 cs=0 l=1 rx=0x7f42dc0032b0 tx=0x7f42dc010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.035+0000 7f42e9851700 1 -- 172.21.15.103:0/3100516617 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42bc003340 con 0x7f42c4004db0 2020-04-22T14:07:33.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.036+0000 7f42cbfff700 1 --2- 172.21.15.103:0/3100516617 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f42c4058430 0x7f42c405a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:33.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.036+0000 7f42cbfff700 1 -- 172.21.15.103:0/3100516617 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f42dc0613d0 con 0x7f42c4004db0 2020-04-22T14:07:33.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.036+0000 7f42e37fe700 1 --2- 172.21.15.103:0/3100516617 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f42c4058430 0x7f42c405a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:33.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.036+0000 7f42e37fe700 1 --2- 172.21.15.103:0/3100516617 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f42c4058430 0x7f42c405a8f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f42d40102c0 tx=0x7f42d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.036+0000 7f42e37fe700 1 --2- 172.21.15.103:0/3100516617 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f42c4058430 0x7f42c405a8f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f42d40102c0 tx=0x7f42d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.036+0000 7f42e37fe700 1 --2- 172.21.15.103:0/3100516617 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f42c4058430 0x7f42c405a8f0 secure :-1 s=READY pgs=261 cs=0 l=1 rx=0x7f42d40102c0 tx=0x7f42d4007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:33.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.040+0000 7f42e3fff700 1 --2- 172.21.15.103:0/3100516617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42c4004db0 0x7f42c400d930 secure :-1 s=THROTTLE_DONE pgs=683 cs=0 l=1 rx=0x7f42dc0032b0 tx=0x7f42dc010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.040+0000 7f42cbfff700 1 -- 172.21.15.103:0/3100516617 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f42dc03c890 con 0x7f42c4004db0 2020-04-22T14:07:33.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.232+0000 7f42e9851700 1 -- 172.21.15.103:0/3100516617 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f42bc002280 con 0x7f42c4004db0 2020-04-22T14:07:33.238 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.236+0000 7f42e3fff700 1 --2- 172.21.15.103:0/3100516617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42c4004db0 0x7f42c400d930 secure :-1 s=THROTTLE_DONE pgs=683 cs=0 l=1 rx=0x7f42dc0032b0 tx=0x7f42dc010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.238 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.236+0000 7f42cbfff700 1 -- 172.21.15.103:0/3100516617 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v21) v1 ==== 184+0+0 (secure 0 0 0) 0x7f42dc03feb0 con 0x7f42c4004db0 2020-04-22T14:07:33.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.238+0000 7f42e9851700 1 -- 172.21.15.103:0/3100516617 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f42c4058430 msgr2=0x7f42c405a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:33.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.238+0000 7f42e9851700 1 --2- 172.21.15.103:0/3100516617 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f42c4058430 0x7f42c405a8f0 secure :-1 s=READY pgs=261 cs=0 l=1 rx=0x7f42d40102c0 tx=0x7f42d4007a40).stop 2020-04-22T14:07:33.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.238+0000 7f42e9851700 1 -- 172.21.15.103:0/3100516617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42c4004db0 msgr2=0x7f42c400d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:33.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.238+0000 7f42e9851700 1 --2- 172.21.15.103:0/3100516617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42c4004db0 0x7f42c400d930 secure :-1 s=READY pgs=683 cs=0 l=1 rx=0x7f42dc0032b0 tx=0x7f42dc010d70).stop 2020-04-22T14:07:33.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.238+0000 7f42e3fff700 1 -- 172.21.15.103:0/3100516617 reap_dead start 2020-04-22T14:07:33.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.238+0000 7f42e3fff700 1 -- 172.21.15.103:0/3100516617 reap_dead start 2020-04-22T14:07:33.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.238+0000 7f42e9851700 1 -- 172.21.15.103:0/3100516617 shutdown_connections 2020-04-22T14:07:33.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.238+0000 7f42e9851700 1 -- 172.21.15.103:0/3100516617 >> 172.21.15.103:0/3100516617 conn(0x7f42e405ad30 msgr2=0x7f42e40b31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:33.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.238+0000 7f42e9851700 1 -- 172.21.15.103:0/3100516617 shutdown_connections 2020-04-22T14:07:33.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.238+0000 7f42e9851700 1 -- 172.21.15.103:0/3100516617 wait complete. 2020-04-22T14:07:33.242 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.0 2020-04-22T14:07:33.250 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:33.269 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:07:33.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.419+0000 7f96ec874700 1 Processor -- start 2020-04-22T14:07:33.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.419+0000 7f96ec874700 1 -- start start 2020-04-22T14:07:33.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.420+0000 7f96ec874700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f96e8152a90 0x7f96e80b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:33.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.420+0000 7f96ec874700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f96e8062170 0x7f96e80b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:33.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.420+0000 7f96ec874700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96e80b5210 0x7f96e8156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:33.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.420+0000 7f96ec874700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e80b5650 con 0x7f96e8062170 2020-04-22T14:07:33.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.420+0000 7f96ec874700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e80614f0 con 0x7f96e8152a90 2020-04-22T14:07:33.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.420+0000 7f96ec874700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e8061790 con 0x7f96e80b5210 2020-04-22T14:07:33.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.420+0000 7f96e6d9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f96e8152a90 0x7f96e80b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:33.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.420+0000 7f96e6d9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f96e8152a90 0x7f96e80b44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50348/0 (socket says 172.21.15.103:50348) 2020-04-22T14:07:33.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.420+0000 7f96e6d9d700 1 -- 172.21.15.103:0/2992552857 learned_addr learned my addr 172.21.15.103:0/2992552857 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:33.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.420+0000 7f96e759e700 1 --2- 172.21.15.103:0/2992552857 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96e80b5210 0x7f96e8156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:33.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.420+0000 7f96dffff700 1 --2- 172.21.15.103:0/2992552857 >> v2:172.21.15.86:3300/0 conn(0x7f96e8062170 0x7f96e80b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:33.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.420+0000 7f96e6d9d700 1 -- 172.21.15.103:0/2992552857 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96e80b5210 msgr2=0x7f96e8156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:33.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.420+0000 7f96e6d9d700 1 --2- 172.21.15.103:0/2992552857 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96e80b5210 0x7f96e8156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:33.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.420+0000 7f96e6d9d700 1 -- 172.21.15.103:0/2992552857 >> v2:172.21.15.86:3300/0 conn(0x7f96e8062170 msgr2=0x7f96e80b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:33.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.420+0000 7f96e6d9d700 1 --2- 172.21.15.103:0/2992552857 >> v2:172.21.15.86:3300/0 conn(0x7f96e8062170 0x7f96e80b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:33.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.420+0000 7f96e6d9d700 1 -- 172.21.15.103:0/2992552857 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e8061a30 con 0x7f96e8152a90 2020-04-22T14:07:33.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.420+0000 7f96dffff700 1 --2- 172.21.15.103:0/2992552857 >> v2:172.21.15.86:3300/0 conn(0x7f96e8062170 0x7f96e80b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:07:33.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.420+0000 7f96e6d9d700 1 --2- 172.21.15.103:0/2992552857 >> v2:172.21.15.103:3300/0 conn(0x7f96e8152a90 0x7f96e80b44d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f96d8002f30 tx=0x7f96d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.420+0000 7f96e6d9d700 1 --2- 172.21.15.103:0/2992552857 >> v2:172.21.15.103:3300/0 conn(0x7f96e8152a90 0x7f96e80b44d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f96d8002f30 tx=0x7f96d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.420+0000 7f96e6d9d700 1 --2- 172.21.15.103:0/2992552857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96e8152a90 0x7f96e80b44d0 secure :-1 s=READY pgs=684 cs=0 l=1 rx=0x7f96d8002f30 tx=0x7f96d8007a40).ready entity=mon.1 client_cookie=147208154319ad57 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:33.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.420+0000 7f96e6d9d700 1 --2- 172.21.15.103:0/2992552857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96e8152a90 0x7f96e80b44d0 secure :-1 s=THROTTLE_DONE pgs=684 cs=0 l=1 rx=0x7f96d8002f30 tx=0x7f96d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.420+0000 7f96e659c700 1 -- 172.21.15.103:0/2992552857 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96d8011720 con 0x7f96e8152a90 2020-04-22T14:07:33.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.420+0000 7f96e6d9d700 1 --2- 172.21.15.103:0/2992552857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96e8152a90 0x7f96e80b44d0 secure :-1 s=THROTTLE_DONE pgs=684 cs=0 l=1 rx=0x7f96d8002f30 tx=0x7f96d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.420+0000 7f96e6d9d700 1 --2- 172.21.15.103:0/2992552857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96e8152a90 0x7f96e80b44d0 secure :-1 s=THROTTLE_DONE pgs=684 cs=0 l=1 rx=0x7f96d8002f30 tx=0x7f96d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.420+0000 7f96e659c700 1 -- 172.21.15.103:0/2992552857 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d8011880 con 0x7f96e8152a90 2020-04-22T14:07:33.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.420+0000 7f96e659c700 1 -- 172.21.15.103:0/2992552857 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96d8011ca0 con 0x7f96e8152a90 2020-04-22T14:07:33.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.420+0000 7f96ec874700 1 -- 172.21.15.103:0/2992552857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96e8152a90 msgr2=0x7f96e80b44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:33.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.420+0000 7f96ec874700 1 --2- 172.21.15.103:0/2992552857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96e8152a90 0x7f96e80b44d0 secure :-1 s=READY pgs=684 cs=0 l=1 rx=0x7f96d8002f30 tx=0x7f96d8007a40).stop 2020-04-22T14:07:33.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.421+0000 7f96ec874700 1 -- 172.21.15.103:0/2992552857 shutdown_connections 2020-04-22T14:07:33.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.421+0000 7f96ec874700 1 --2- 172.21.15.103:0/2992552857 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96e80b5210 0x7f96e8156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:33.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.421+0000 7f96ec874700 1 --2- 172.21.15.103:0/2992552857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96e8152a90 0x7f96e80b44d0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:33.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.421+0000 7f96ec874700 1 --2- 172.21.15.103:0/2992552857 >> v2:172.21.15.86:3300/0 conn(0x7f96e8062170 0x7f96e80b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:33.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.421+0000 7f96ec874700 1 -- 172.21.15.103:0/2992552857 >> 172.21.15.103:0/2992552857 conn(0x7f96e805ad30 msgr2=0x7f96e805b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:33.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.421+0000 7f96ec874700 1 -- 172.21.15.103:0/2992552857 shutdown_connections 2020-04-22T14:07:33.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.421+0000 7f96ec874700 1 -- 172.21.15.103:0/2992552857 wait complete. 2020-04-22T14:07:33.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.422+0000 7f96ec874700 1 Processor -- start 2020-04-22T14:07:33.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.422+0000 7f96ec874700 1 -- start start 2020-04-22T14:07:33.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.423+0000 7f96ec874700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96e8062170 0x7f96e81557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:33.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.423+0000 7f96ec874700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f96e80b5210 0x7f96e80b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:33.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.423+0000 7f96ec874700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e8155c10 con 0x7f96e8152a90 2020-04-22T14:07:33.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.423+0000 7f96ec874700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e8063370 con 0x7f96e80b5210 2020-04-22T14:07:33.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.423+0000 7f96ec874700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e8065610 con 0x7f96e8062170 2020-04-22T14:07:33.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.423+0000 7f96dffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f96e80b5210 0x7f96e80b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:33.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.423+0000 7f96dffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f96e80b5210 0x7f96e80b1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50356/0 (socket says 172.21.15.103:50356) 2020-04-22T14:07:33.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.423+0000 7f96dffff700 1 -- 172.21.15.103:0/2516091473 learned_addr learned my addr 172.21.15.103:0/2516091473 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:33.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.423+0000 7f96e6d9d700 1 --2- 172.21.15.103:0/2516091473 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96e8062170 0x7f96e81557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:33.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.423+0000 7f96dffff700 1 -- 172.21.15.103:0/2516091473 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96e8062170 msgr2=0x7f96e81557b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:33.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.423+0000 7f96dffff700 1 --2- 172.21.15.103:0/2516091473 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96e8062170 0x7f96e81557b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:33.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.423+0000 7f96dffff700 1 -- 172.21.15.103:0/2516091473 >> v1:172.21.15.86:6789/0 conn(0x7f96e8152a90 legacy=0x7f96e80adee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:33.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.423+0000 7f96dffff700 1 -- 172.21.15.103:0/2516091473 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e8062990 con 0x7f96e80b5210 2020-04-22T14:07:33.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.423+0000 7f96df7fe700 1 -- 172.21.15.103:0/2516091473 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3812791341 0 0) 0x7f96e0001210 con 0x7f96e8152a90 2020-04-22T14:07:33.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.423+0000 7f96dffff700 1 --2- 172.21.15.103:0/2516091473 >> v2:172.21.15.103:3300/0 conn(0x7f96e80b5210 0x7f96e80b1b80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f96e8154960 tx=0x7f96e805a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.423+0000 7f96dffff700 1 --2- 172.21.15.103:0/2516091473 >> v2:172.21.15.103:3300/0 conn(0x7f96e80b5210 0x7f96e80b1b80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f96e8154960 tx=0x7f96e805a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.423+0000 7f96dffff700 1 --2- 172.21.15.103:0/2516091473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96e80b5210 0x7f96e80b1b80 secure :-1 s=READY pgs=685 cs=0 l=1 rx=0x7f96e8154960 tx=0x7f96e805a720).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:33.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.423+0000 7f96dffff700 1 --2- 172.21.15.103:0/2516091473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96e80b5210 0x7f96e80b1b80 secure :-1 s=THROTTLE_DONE pgs=685 cs=0 l=1 rx=0x7f96e8154960 tx=0x7f96e805a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.423+0000 7f96df7fe700 1 -- 172.21.15.103:0/2516091473 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96d0007180 con 0x7f96e80b5210 2020-04-22T14:07:33.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.423+0000 7f96dffff700 1 --2- 172.21.15.103:0/2516091473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96e80b5210 0x7f96e80b1b80 secure :-1 s=THROTTLE_DONE pgs=685 cs=0 l=1 rx=0x7f96e8154960 tx=0x7f96e805a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.423+0000 7f96dffff700 1 --2- 172.21.15.103:0/2516091473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96e80b5210 0x7f96e80b1b80 secure :-1 s=THROTTLE_DONE pgs=685 cs=0 l=1 rx=0x7f96e8154960 tx=0x7f96e805a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.423+0000 7f96df7fe700 1 -- 172.21.15.103:0/2516091473 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d0013070 con 0x7f96e80b5210 2020-04-22T14:07:33.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.423+0000 7f96df7fe700 1 -- 172.21.15.103:0/2516091473 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96d00074d0 con 0x7f96e80b5210 2020-04-22T14:07:33.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.423+0000 7f96ec874700 1 -- 172.21.15.103:0/2516091473 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e8062c30 con 0x7f96e80b5210 2020-04-22T14:07:33.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.423+0000 7f96ec874700 1 -- 172.21.15.103:0/2516091473 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e80b1fe0 con 0x7f96e80b5210 2020-04-22T14:07:33.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.424+0000 7f96dffff700 1 --2- 172.21.15.103:0/2516091473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96e80b5210 0x7f96e80b1b80 secure :-1 s=THROTTLE_DONE pgs=685 cs=0 l=1 rx=0x7f96e8154960 tx=0x7f96e805a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.424+0000 7f96df7fe700 1 -- 172.21.15.103:0/2516091473 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f96d00059c0 con 0x7f96e80b5210 2020-04-22T14:07:33.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.424+0000 7f96dffff700 1 --2- 172.21.15.103:0/2516091473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96e80b5210 0x7f96e80b1b80 secure :-1 s=THROTTLE_DONE pgs=685 cs=0 l=1 rx=0x7f96e8154960 tx=0x7f96e805a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.425+0000 7f96ec874700 1 -- 172.21.15.103:0/2516091473 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e8063090 con 0x7f96e80b5210 2020-04-22T14:07:33.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.425+0000 7f96df7fe700 1 --2- 172.21.15.103:0/2516091473 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f96cc04d900 0x7f96cc04fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:33.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.425+0000 7f96df7fe700 1 -- 172.21.15.103:0/2516091473 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f96d00611e0 con 0x7f96e80b5210 2020-04-22T14:07:33.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.425+0000 7f96e6d9d700 1 --2- 172.21.15.103:0/2516091473 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f96cc04d900 0x7f96cc04fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:33.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.425+0000 7f96e6d9d700 1 --2- 172.21.15.103:0/2516091473 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f96cc04d900 0x7f96cc04fdc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f96d8002f30 tx=0x7f96d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.425+0000 7f96e6d9d700 1 --2- 172.21.15.103:0/2516091473 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f96cc04d900 0x7f96cc04fdc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f96d8002f30 tx=0x7f96d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.425+0000 7f96e6d9d700 1 --2- 172.21.15.103:0/2516091473 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f96cc04d900 0x7f96cc04fdc0 secure :-1 s=READY pgs=262 cs=0 l=1 rx=0x7f96d8002f30 tx=0x7f96d8007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:33.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.429+0000 7f96dffff700 1 --2- 172.21.15.103:0/2516091473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96e80b5210 0x7f96e80b1b80 secure :-1 s=THROTTLE_DONE pgs=685 cs=0 l=1 rx=0x7f96e8154960 tx=0x7f96e805a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.429+0000 7f96df7fe700 1 -- 172.21.15.103:0/2516091473 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f96d003c560 con 0x7f96e80b5210 2020-04-22T14:07:33.624 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.621+0000 7f96ec874700 1 -- 172.21.15.103:0/2516091473 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f96e8056c90 con 0x7f96e80b5210 2020-04-22T14:07:33.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.626+0000 7f96dffff700 1 --2- 172.21.15.103:0/2516091473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96e80b5210 0x7f96e80b1b80 secure :-1 s=THROTTLE_DONE pgs=685 cs=0 l=1 rx=0x7f96e8154960 tx=0x7f96e805a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.626+0000 7f96df7fe700 1 -- 172.21.15.103:0/2516091473 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v22) v1 ==== 184+0+0 (secure 0 0 0) 0x7f96d003fb80 con 0x7f96e80b5210 2020-04-22T14:07:33.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.627+0000 7f96ec874700 1 -- 172.21.15.103:0/2516091473 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f96cc04d900 msgr2=0x7f96cc04fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:33.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.627+0000 7f96ec874700 1 --2- 172.21.15.103:0/2516091473 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f96cc04d900 0x7f96cc04fdc0 secure :-1 s=READY pgs=262 cs=0 l=1 rx=0x7f96d8002f30 tx=0x7f96d8007a40).stop 2020-04-22T14:07:33.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.627+0000 7f96ec874700 1 -- 172.21.15.103:0/2516091473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96e80b5210 msgr2=0x7f96e80b1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:33.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.627+0000 7f96ec874700 1 --2- 172.21.15.103:0/2516091473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96e80b5210 0x7f96e80b1b80 secure :-1 s=READY pgs=685 cs=0 l=1 rx=0x7f96e8154960 tx=0x7f96e805a720).stop 2020-04-22T14:07:33.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.627+0000 7f96ec874700 1 -- 172.21.15.103:0/2516091473 shutdown_connections 2020-04-22T14:07:33.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.627+0000 7f96ec874700 1 --2- 172.21.15.103:0/2516091473 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f96cc04d900 0x7f96cc04fdc0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:33.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.627+0000 7f96ec874700 1 --2- 172.21.15.103:0/2516091473 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96e8062170 0x7f96e81557b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:33.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.627+0000 7f96ec874700 1 --2- 172.21.15.103:0/2516091473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96e80b5210 0x7f96e80b1b80 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:33.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.627+0000 7f96ec874700 1 -- 172.21.15.103:0/2516091473 >> 172.21.15.103:0/2516091473 conn(0x7f96e805ad30 msgr2=0x7f96e80b31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:33.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.627+0000 7f96ec874700 1 -- 172.21.15.103:0/2516091473 shutdown_connections 2020-04-22T14:07:33.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.627+0000 7f96ec874700 1 -- 172.21.15.103:0/2516091473 wait complete. 2020-04-22T14:07:33.631 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.1 2020-04-22T14:07:33.640 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:33.653 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:07:33.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.802+0000 7f9fc96b0700 1 Processor -- start 2020-04-22T14:07:33.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.802+0000 7f9fc96b0700 1 -- start start 2020-04-22T14:07:33.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.803+0000 7f9fc96b0700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9fc4152a90 0x7f9fc40b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:33.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.803+0000 7f9fc96b0700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fc4152e70 con 0x7f9fc40adf50 2020-04-22T14:07:33.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.803+0000 7f9fc96b0700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fc40614f0 con 0x7f9fc4062170 2020-04-22T14:07:33.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.803+0000 7f9fc96b0700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fc4061790 con 0x7f9fc4152a90 2020-04-22T14:07:33.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.803+0000 7f9fc37fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9fc4152a90 0x7f9fc40b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:33.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.803+0000 7f9fc37fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9fc4152a90 0x7f9fc40b44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50360/0 (socket says 172.21.15.103:50360) 2020-04-22T14:07:33.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.803+0000 7f9fc2ffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f9fc4062170 0x7f9fc40b4db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42550/0 (socket says 172.21.15.103:42550) 2020-04-22T14:07:33.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.803+0000 7f9fc37fe700 1 -- 172.21.15.103:0/2812996889 learned_addr learned my addr 172.21.15.103:0/2812996889 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:33.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.804+0000 7f9fc37fe700 1 -- 172.21.15.103:0/2812996889 >> v1:172.21.15.103:6789/0 conn(0x7f9fc4062170 legacy=0x7f9fc40b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:33.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.804+0000 7f9fc37fe700 1 -- 172.21.15.103:0/2812996889 >> v1:172.21.15.86:6789/0 conn(0x7f9fc40adf50 legacy=0x7f9fc40ae3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:33.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.804+0000 7f9fc37fe700 1 -- 172.21.15.103:0/2812996889 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc4061a30 con 0x7f9fc4152a90 2020-04-22T14:07:33.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.804+0000 7f9fc37fe700 1 --2- 172.21.15.103:0/2812996889 >> v2:172.21.15.103:3300/0 conn(0x7f9fc4152a90 0x7f9fc40b44d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9fb4002f30 tx=0x7f9fb4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.804+0000 7f9fc37fe700 1 --2- 172.21.15.103:0/2812996889 >> v2:172.21.15.103:3300/0 conn(0x7f9fc4152a90 0x7f9fc40b44d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9fb4002f30 tx=0x7f9fb4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.804+0000 7f9fc37fe700 1 --2- 172.21.15.103:0/2812996889 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fc4152a90 0x7f9fc40b44d0 secure :-1 s=READY pgs=687 cs=0 l=1 rx=0x7f9fb4002f30 tx=0x7f9fb4007a40).ready entity=mon.1 client_cookie=8ff0ea09e36a6c6 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:33.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.804+0000 7f9fc37fe700 1 --2- 172.21.15.103:0/2812996889 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fc4152a90 0x7f9fc40b44d0 secure :-1 s=THROTTLE_DONE pgs=687 cs=0 l=1 rx=0x7f9fb4002f30 tx=0x7f9fb4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.804+0000 7f9fc27fc700 1 -- 172.21.15.103:0/2812996889 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fb4011720 con 0x7f9fc4152a90 2020-04-22T14:07:33.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.804+0000 7f9fc37fe700 1 --2- 172.21.15.103:0/2812996889 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fc4152a90 0x7f9fc40b44d0 secure :-1 s=THROTTLE_DONE pgs=687 cs=0 l=1 rx=0x7f9fb4002f30 tx=0x7f9fb4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.804+0000 7f9fc37fe700 1 --2- 172.21.15.103:0/2812996889 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fc4152a90 0x7f9fc40b44d0 secure :-1 s=THROTTLE_DONE pgs=687 cs=0 l=1 rx=0x7f9fb4002f30 tx=0x7f9fb4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.804+0000 7f9fc27fc700 1 -- 172.21.15.103:0/2812996889 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb40118c0 con 0x7f9fc4152a90 2020-04-22T14:07:33.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.804+0000 7f9fc27fc700 1 -- 172.21.15.103:0/2812996889 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fb4011ce0 con 0x7f9fc4152a90 2020-04-22T14:07:33.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.804+0000 7f9fc96b0700 1 -- 172.21.15.103:0/2812996889 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fc4152a90 msgr2=0x7f9fc40b44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:33.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.804+0000 7f9fc96b0700 1 --2- 172.21.15.103:0/2812996889 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fc4152a90 0x7f9fc40b44d0 secure :-1 s=READY pgs=687 cs=0 l=1 rx=0x7f9fb4002f30 tx=0x7f9fb4007a40).stop 2020-04-22T14:07:33.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.804+0000 7f9fc96b0700 1 -- 172.21.15.103:0/2812996889 shutdown_connections 2020-04-22T14:07:33.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.804+0000 7f9fc96b0700 1 --2- 172.21.15.103:0/2812996889 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fc4152a90 0x7f9fc40b44d0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:33.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.804+0000 7f9fc96b0700 1 -- 172.21.15.103:0/2812996889 >> 172.21.15.103:0/2812996889 conn(0x7f9fc405ad30 msgr2=0x7f9fc405b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:33.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.804+0000 7f9fc96b0700 1 -- 172.21.15.103:0/2812996889 shutdown_connections 2020-04-22T14:07:33.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.804+0000 7f9fc96b0700 1 -- 172.21.15.103:0/2812996889 wait complete. 2020-04-22T14:07:33.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.805+0000 7f9fc96b0700 1 Processor -- start 2020-04-22T14:07:33.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.806+0000 7f9fc96b0700 1 -- start start 2020-04-22T14:07:33.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.806+0000 7f9fc96b0700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9fc40adf50 0x7f9fc4155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:33.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.806+0000 7f9fc96b0700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fc4152a90 0x7f9fc413a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:33.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.806+0000 7f9fc96b0700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fc413e530 con 0x7f9fc4062170 2020-04-22T14:07:33.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.806+0000 7f9fc96b0700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fc413e7d0 con 0x7f9fc40adf50 2020-04-22T14:07:33.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.806+0000 7f9fc96b0700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc413e1b0 con 0x7f9fc4152a90 2020-04-22T14:07:33.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.807+0000 7f9fc3fff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fc4152a90 0x7f9fc413a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:33.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.807+0000 7f9fc2ffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9fc40adf50 0x7f9fc4155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:33.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.807+0000 7f9fc2ffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9fc40adf50 0x7f9fc4155270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:47598/0 (socket says 172.21.15.103:47598) 2020-04-22T14:07:33.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.807+0000 7f9fc3fff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fc4152a90 0x7f9fc413a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:35146/0 (socket says 172.21.15.103:35146) 2020-04-22T14:07:33.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.807+0000 7f9fc2ffd700 1 -- 172.21.15.103:0/767153891 learned_addr learned my addr 172.21.15.103:0/767153891 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:33.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.807+0000 7f9fc3fff700 1 -- 172.21.15.103:0/767153891 >> v2:172.21.15.86:3300/0 conn(0x7f9fc40adf50 msgr2=0x7f9fc4155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:33.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.807+0000 7f9fc3fff700 1 --2- 172.21.15.103:0/767153891 >> v2:172.21.15.86:3300/0 conn(0x7f9fc40adf50 0x7f9fc4155270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:33.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.807+0000 7f9fc3fff700 1 -- 172.21.15.103:0/767153891 >> v1:172.21.15.86:6789/0 conn(0x7f9fc4062170 legacy=0x7f9fc413a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:33.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.807+0000 7f9fc3fff700 1 -- 172.21.15.103:0/767153891 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc413ef10 con 0x7f9fc4152a90 2020-04-22T14:07:33.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.807+0000 7f9fabfff700 1 -- 172.21.15.103:0/767153891 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2758217575 0 0) 0x7f9fc413e530 con 0x7f9fc4062170 2020-04-22T14:07:33.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.807+0000 7f9fc2ffd700 1 --2- 172.21.15.103:0/767153891 >> v2:172.21.15.86:3300/0 conn(0x7f9fc40adf50 0x7f9fc4155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:07:33.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.807+0000 7f9fc3fff700 1 --2- 172.21.15.103:0/767153891 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fc4152a90 0x7f9fc413a730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9fc40ad5a0 tx=0x7f9fbc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.807+0000 7f9fc3fff700 1 --2- 172.21.15.103:0/767153891 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fc4152a90 0x7f9fc413a730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9fc40ad5a0 tx=0x7f9fbc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.807+0000 7f9fc3fff700 1 --2- 172.21.15.103:0/767153891 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fc4152a90 0x7f9fc413a730 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7f9fc40ad5a0 tx=0x7f9fbc010ba0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:33.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.807+0000 7f9fc3fff700 1 --2- 172.21.15.103:0/767153891 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fc4152a90 0x7f9fc413a730 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f9fc40ad5a0 tx=0x7f9fbc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.807+0000 7f9fabfff700 1 -- 172.21.15.103:0/767153891 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fbc002240 con 0x7f9fc4152a90 2020-04-22T14:07:33.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.807+0000 7f9fc3fff700 1 --2- 172.21.15.103:0/767153891 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fc4152a90 0x7f9fc413a730 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f9fc40ad5a0 tx=0x7f9fbc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.807+0000 7f9fc96b0700 1 -- 172.21.15.103:0/767153891 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fc4156830 con 0x7f9fc4152a90 2020-04-22T14:07:33.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.807+0000 7f9fc3fff700 1 --2- 172.21.15.103:0/767153891 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fc4152a90 0x7f9fc413a730 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f9fc40ad5a0 tx=0x7f9fbc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.807+0000 7f9fabfff700 1 -- 172.21.15.103:0/767153891 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fbc0023a0 con 0x7f9fc4152a90 2020-04-22T14:07:33.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.807+0000 7f9fabfff700 1 -- 172.21.15.103:0/767153891 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fbc002780 con 0x7f9fc4152a90 2020-04-22T14:07:33.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.807+0000 7f9fc96b0700 1 -- 172.21.15.103:0/767153891 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fc4066d50 con 0x7f9fc4152a90 2020-04-22T14:07:33.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.808+0000 7f9fc3fff700 1 --2- 172.21.15.103:0/767153891 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fc4152a90 0x7f9fc413a730 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f9fc40ad5a0 tx=0x7f9fbc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.808+0000 7f9fc96b0700 1 -- 172.21.15.103:0/767153891 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fc413f100 con 0x7f9fc4152a90 2020-04-22T14:07:33.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.808+0000 7f9fabfff700 1 -- 172.21.15.103:0/767153891 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f9fbc002a00 con 0x7f9fc4152a90 2020-04-22T14:07:33.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.808+0000 7f9fc3fff700 1 --2- 172.21.15.103:0/767153891 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fc4152a90 0x7f9fc413a730 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f9fc40ad5a0 tx=0x7f9fbc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.809+0000 7f9fabfff700 1 --2- 172.21.15.103:0/767153891 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9fa404d900 0x7f9fa404fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:33.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.809+0000 7f9fabfff700 1 -- 172.21.15.103:0/767153891 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9fbc0618a0 con 0x7f9fc4152a90 2020-04-22T14:07:33.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.809+0000 7f9fc37fe700 1 --2- 172.21.15.103:0/767153891 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9fa404d900 0x7f9fa404fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:33.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.809+0000 7f9fc37fe700 1 --2- 172.21.15.103:0/767153891 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9fa404d900 0x7f9fa404fdc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9fb40084c0 tx=0x7f9fb4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.809+0000 7f9fc37fe700 1 --2- 172.21.15.103:0/767153891 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9fa404d900 0x7f9fa404fdc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9fb40084c0 tx=0x7f9fb4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.809+0000 7f9fc37fe700 1 --2- 172.21.15.103:0/767153891 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9fa404d900 0x7f9fa404fdc0 secure :-1 s=READY pgs=263 cs=0 l=1 rx=0x7f9fb40084c0 tx=0x7f9fb4007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:33.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.812+0000 7f9fc3fff700 1 --2- 172.21.15.103:0/767153891 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fc4152a90 0x7f9fc413a730 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f9fc40ad5a0 tx=0x7f9fbc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:33.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:33.812+0000 7f9fabfff700 1 -- 172.21.15.103:0/767153891 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f9fbc03cce0 con 0x7f9fc4152a90 2020-04-22T14:07:34.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.006+0000 7f9fc96b0700 1 -- 172.21.15.103:0/767153891 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f9fc4056c90 con 0x7f9fc4152a90 2020-04-22T14:07:34.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.012+0000 7f9fc3fff700 1 --2- 172.21.15.103:0/767153891 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fc4152a90 0x7f9fc413a730 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f9fc40ad5a0 tx=0x7f9fbc010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:34.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.012+0000 7f9fabfff700 1 -- 172.21.15.103:0/767153891 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v23) v1 ==== 184+0+0 (secure 0 0 0) 0x7f9fbc040300 con 0x7f9fc4152a90 2020-04-22T14:07:34.016 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.013+0000 7f9fc96b0700 1 -- 172.21.15.103:0/767153891 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9fa404d900 msgr2=0x7f9fa404fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:34.016 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.013+0000 7f9fc96b0700 1 --2- 172.21.15.103:0/767153891 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9fa404d900 0x7f9fa404fdc0 secure :-1 s=READY pgs=263 cs=0 l=1 rx=0x7f9fb40084c0 tx=0x7f9fb4007a40).stop 2020-04-22T14:07:34.016 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.013+0000 7f9fc96b0700 1 -- 172.21.15.103:0/767153891 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fc4152a90 msgr2=0x7f9fc413a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:34.016 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.013+0000 7f9fc96b0700 1 --2- 172.21.15.103:0/767153891 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fc4152a90 0x7f9fc413a730 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7f9fc40ad5a0 tx=0x7f9fbc010ba0).stop 2020-04-22T14:07:34.016 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.013+0000 7f9fc96b0700 1 -- 172.21.15.103:0/767153891 shutdown_connections 2020-04-22T14:07:34.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.013+0000 7f9fc96b0700 1 --2- 172.21.15.103:0/767153891 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fc4152a90 0x7f9fc413a730 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:34.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.013+0000 7f9fc96b0700 1 --2- 172.21.15.103:0/767153891 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9fa404d900 0x7f9fa404fdc0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:34.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.013+0000 7f9fc96b0700 1 --2- 172.21.15.103:0/767153891 >> v2:172.21.15.86:3300/0 conn(0x7f9fc40adf50 0x7f9fc4155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:34.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.014+0000 7f9fc96b0700 1 -- 172.21.15.103:0/767153891 >> 172.21.15.103:0/767153891 conn(0x7f9fc405ad30 msgr2=0x7f9fc41303e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:34.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.014+0000 7f9fc96b0700 1 -- 172.21.15.103:0/767153891 shutdown_connections 2020-04-22T14:07:34.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.014+0000 7f9fc96b0700 1 -- 172.21.15.103:0/767153891 wait complete. 2020-04-22T14:07:34.018 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.2 2020-04-22T14:07:34.026 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:34.039 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:07:34.194 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.189+0000 7fee83788700 1 Processor -- start 2020-04-22T14:07:34.194 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.189+0000 7fee83788700 1 -- start start 2020-04-22T14:07:34.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.190+0000 7fee83788700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fee7c152a90 0x7fee7c0b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:34.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.190+0000 7fee83788700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fee7c062170 0x7fee7c0b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:34.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.190+0000 7fee83788700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fee7c0b5210 0x7fee7c156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:34.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.190+0000 7fee83788700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee7c0b56a0 con 0x7fee7c0b5210 2020-04-22T14:07:34.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.190+0000 7fee83788700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee7c0614f0 con 0x7fee7c062170 2020-04-22T14:07:34.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.190+0000 7fee83788700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c061790 con 0x7fee7c152a90 2020-04-22T14:07:34.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.190+0000 7fee81524700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fee7c062170 0x7fee7c0b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:34.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.190+0000 7fee81524700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fee7c062170 0x7fee7c0b4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50372/0 (socket says 172.21.15.103:50372) 2020-04-22T14:07:34.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.190+0000 7fee81524700 1 -- 172.21.15.103:0/3984190437 learned_addr learned my addr 172.21.15.103:0/3984190437 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:34.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.191+0000 7fee81d25700 1 --2- 172.21.15.103:0/3984190437 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fee7c152a90 0x7fee7c0b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:34.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.191+0000 7fee82526700 1 --2- 172.21.15.103:0/3984190437 >> v2:172.21.15.86:3300/0 conn(0x7fee7c0b5210 0x7fee7c156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:34.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.191+0000 7fee81524700 1 -- 172.21.15.103:0/3984190437 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fee7c152a90 msgr2=0x7fee7c0b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:34.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.191+0000 7fee81524700 1 --2- 172.21.15.103:0/3984190437 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fee7c152a90 0x7fee7c0b44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:34.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.191+0000 7fee81524700 1 -- 172.21.15.103:0/3984190437 >> v2:172.21.15.86:3300/0 conn(0x7fee7c0b5210 msgr2=0x7fee7c156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:34.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.191+0000 7fee81524700 1 --2- 172.21.15.103:0/3984190437 >> v2:172.21.15.86:3300/0 conn(0x7fee7c0b5210 0x7fee7c156500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:34.197 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.191+0000 7fee81524700 1 -- 172.21.15.103:0/3984190437 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee7c061a30 con 0x7fee7c062170 2020-04-22T14:07:34.197 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.191+0000 7fee81524700 1 --2- 172.21.15.103:0/3984190437 >> v2:172.21.15.103:3300/0 conn(0x7fee7c062170 0x7fee7c0b4db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fee6c002f30 tx=0x7fee7c05a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:34.197 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.191+0000 7fee81524700 1 --2- 172.21.15.103:0/3984190437 >> v2:172.21.15.103:3300/0 conn(0x7fee7c062170 0x7fee7c0b4db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fee6c002f30 tx=0x7fee7c05a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:34.197 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.191+0000 7fee81524700 1 --2- 172.21.15.103:0/3984190437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee7c062170 0x7fee7c0b4db0 secure :-1 s=READY pgs=688 cs=0 l=1 rx=0x7fee6c002f30 tx=0x7fee7c05a720).ready entity=mon.1 client_cookie=345bf94733265e2d server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:34.197 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.191+0000 7fee81524700 1 --2- 172.21.15.103:0/3984190437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee7c062170 0x7fee7c0b4db0 secure :-1 s=THROTTLE_DONE pgs=688 cs=0 l=1 rx=0x7fee6c002f30 tx=0x7fee7c05a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:34.197 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.191+0000 7fee80d23700 1 -- 172.21.15.103:0/3984190437 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee6c011720 con 0x7fee7c062170 2020-04-22T14:07:34.197 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.191+0000 7fee81524700 1 --2- 172.21.15.103:0/3984190437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee7c062170 0x7fee7c0b4db0 secure :-1 s=THROTTLE_DONE pgs=688 cs=0 l=1 rx=0x7fee6c002f30 tx=0x7fee7c05a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:34.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.191+0000 7fee80d23700 1 -- 172.21.15.103:0/3984190437 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6c011880 con 0x7fee7c062170 2020-04-22T14:07:34.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.191+0000 7fee81524700 1 --2- 172.21.15.103:0/3984190437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee7c062170 0x7fee7c0b4db0 secure :-1 s=THROTTLE_DONE pgs=688 cs=0 l=1 rx=0x7fee6c002f30 tx=0x7fee7c05a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:34.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.191+0000 7fee83788700 1 -- 172.21.15.103:0/3984190437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee7c062170 msgr2=0x7fee7c0b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:34.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.191+0000 7fee83788700 1 --2- 172.21.15.103:0/3984190437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee7c062170 0x7fee7c0b4db0 secure :-1 s=READY pgs=688 cs=0 l=1 rx=0x7fee6c002f30 tx=0x7fee7c05a720).stop 2020-04-22T14:07:34.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.191+0000 7fee80d23700 1 -- 172.21.15.103:0/3984190437 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee6c011ca0 con 0x7fee7c062170 2020-04-22T14:07:34.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.191+0000 7fee83788700 1 -- 172.21.15.103:0/3984190437 shutdown_connections 2020-04-22T14:07:34.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.191+0000 7fee83788700 1 --2- 172.21.15.103:0/3984190437 >> v2:172.21.15.86:3300/0 conn(0x7fee7c0b5210 0x7fee7c156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:34.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.191+0000 7fee83788700 1 --2- 172.21.15.103:0/3984190437 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fee7c152a90 0x7fee7c0b44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:34.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.191+0000 7fee83788700 1 --2- 172.21.15.103:0/3984190437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee7c062170 0x7fee7c0b4db0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:34.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.191+0000 7fee83788700 1 -- 172.21.15.103:0/3984190437 >> 172.21.15.103:0/3984190437 conn(0x7fee7c05ad30 msgr2=0x7fee7c05b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:34.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.191+0000 7fee83788700 1 -- 172.21.15.103:0/3984190437 shutdown_connections 2020-04-22T14:07:34.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.191+0000 7fee83788700 1 -- 172.21.15.103:0/3984190437 wait complete. 2020-04-22T14:07:34.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.193+0000 7fee83788700 1 Processor -- start 2020-04-22T14:07:34.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.193+0000 7fee83788700 1 -- start start 2020-04-22T14:07:34.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.193+0000 7fee83788700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fee7c062170 0x7fee7c063c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:34.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.193+0000 7fee83788700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fee7c152a90 0x7fee7c0652f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:34.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.193+0000 7fee83788700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee7c063240 con 0x7fee7c0b5210 2020-04-22T14:07:34.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.193+0000 7fee83788700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee7c066510 con 0x7fee7c062170 2020-04-22T14:07:34.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.193+0000 7fee83788700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c0634e0 con 0x7fee7c152a90 2020-04-22T14:07:34.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.194+0000 7fee82526700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fee7c152a90 0x7fee7c0652f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:34.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.194+0000 7fee81d25700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fee7c062170 0x7fee7c063c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:34.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.194+0000 7fee82526700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fee7c152a90 0x7fee7c0652f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:35156/0 (socket says 172.21.15.103:35156) 2020-04-22T14:07:34.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.194+0000 7fee82526700 1 -- 172.21.15.103:0/3749656952 learned_addr learned my addr 172.21.15.103:0/3749656952 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:34.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.194+0000 7fee82526700 1 -- 172.21.15.103:0/3749656952 >> v2:172.21.15.86:3300/0 conn(0x7fee7c062170 msgr2=0x7fee7c063c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:34.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.194+0000 7fee82526700 1 --2- 172.21.15.103:0/3749656952 >> v2:172.21.15.86:3300/0 conn(0x7fee7c062170 0x7fee7c063c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:34.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.194+0000 7fee82526700 1 -- 172.21.15.103:0/3749656952 >> v1:172.21.15.86:6789/0 conn(0x7fee7c0b5210 legacy=0x7fee7c13ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:34.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.194+0000 7fee82526700 1 -- 172.21.15.103:0/3749656952 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee7c063780 con 0x7fee7c152a90 2020-04-22T14:07:34.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.194+0000 7fee82526700 1 --2- 172.21.15.103:0/3749656952 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fee7c152a90 0x7fee7c0652f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fee740032b0 tx=0x7fee74010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:34.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.194+0000 7fee82526700 1 --2- 172.21.15.103:0/3749656952 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fee7c152a90 0x7fee7c0652f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fee740032b0 tx=0x7fee74010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:34.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.194+0000 7fee82526700 1 --2- 172.21.15.103:0/3749656952 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fee7c152a90 0x7fee7c0652f0 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7fee740032b0 tx=0x7fee74010d00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:34.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.194+0000 7fee82526700 1 --2- 172.21.15.103:0/3749656952 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fee7c152a90 0x7fee7c0652f0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fee740032b0 tx=0x7fee74010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:34.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.194+0000 7fee727fc700 1 -- 172.21.15.103:0/3749656952 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee74012a80 con 0x7fee7c152a90 2020-04-22T14:07:34.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.194+0000 7fee82526700 1 --2- 172.21.15.103:0/3749656952 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fee7c152a90 0x7fee7c0652f0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fee740032b0 tx=0x7fee74010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:34.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.194+0000 7fee82526700 1 --2- 172.21.15.103:0/3749656952 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fee7c152a90 0x7fee7c0652f0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fee740032b0 tx=0x7fee74010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:34.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.194+0000 7fee727fc700 1 -- 172.21.15.103:0/3749656952 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee74012c20 con 0x7fee7c152a90 2020-04-22T14:07:34.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.194+0000 7fee83788700 1 -- 172.21.15.103:0/3749656952 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee7c0b8800 con 0x7fee7c152a90 2020-04-22T14:07:34.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.194+0000 7fee727fc700 1 -- 172.21.15.103:0/3749656952 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee74012e50 con 0x7fee7c152a90 2020-04-22T14:07:34.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.194+0000 7fee83788700 1 -- 172.21.15.103:0/3749656952 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee7c062b30 con 0x7fee7c152a90 2020-04-22T14:07:34.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.195+0000 7fee82526700 1 --2- 172.21.15.103:0/3749656952 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fee7c152a90 0x7fee7c0652f0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fee740032b0 tx=0x7fee74010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:34.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.196+0000 7fee83788700 1 -- 172.21.15.103:0/3749656952 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee7c063050 con 0x7fee7c152a90 2020-04-22T14:07:34.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.196+0000 7fee727fc700 1 -- 172.21.15.103:0/3749656952 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fee7400a370 con 0x7fee7c152a90 2020-04-22T14:07:34.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.196+0000 7fee82526700 1 --2- 172.21.15.103:0/3749656952 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fee7c152a90 0x7fee7c0652f0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fee740032b0 tx=0x7fee74010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:34.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.196+0000 7fee727fc700 1 --2- 172.21.15.103:0/3749656952 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fee6404d930 0x7fee6404fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:34.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.196+0000 7fee727fc700 1 -- 172.21.15.103:0/3749656952 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fee74061fd0 con 0x7fee7c152a90 2020-04-22T14:07:34.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.196+0000 7fee81d25700 1 --2- 172.21.15.103:0/3749656952 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fee6404d930 0x7fee6404fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:34.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.196+0000 7fee81d25700 1 --2- 172.21.15.103:0/3749656952 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fee6404d930 0x7fee6404fdf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fee78002f30 tx=0x7fee780076e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:34.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.196+0000 7fee81d25700 1 --2- 172.21.15.103:0/3749656952 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fee6404d930 0x7fee6404fdf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fee78002f30 tx=0x7fee780076e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:34.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.196+0000 7fee81d25700 1 --2- 172.21.15.103:0/3749656952 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fee6404d930 0x7fee6404fdf0 secure :-1 s=READY pgs=264 cs=0 l=1 rx=0x7fee78002f30 tx=0x7fee780076e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:34.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.200+0000 7fee82526700 1 --2- 172.21.15.103:0/3749656952 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fee7c152a90 0x7fee7c0652f0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fee740032b0 tx=0x7fee74010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:34.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.200+0000 7fee727fc700 1 -- 172.21.15.103:0/3749656952 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fee7403d310 con 0x7fee7c152a90 2020-04-22T14:07:34.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.393+0000 7fee83788700 1 -- 172.21.15.103:0/3749656952 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fee7c056c90 con 0x7fee7c152a90 2020-04-22T14:07:34.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.397+0000 7fee82526700 1 --2- 172.21.15.103:0/3749656952 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fee7c152a90 0x7fee7c0652f0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fee740032b0 tx=0x7fee74010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:34.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.397+0000 7fee727fc700 1 -- 172.21.15.103:0/3749656952 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v24) v1 ==== 184+0+0 (secure 0 0 0) 0x7fee74040930 con 0x7fee7c152a90 2020-04-22T14:07:34.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.398+0000 7fee83788700 1 -- 172.21.15.103:0/3749656952 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fee6404d930 msgr2=0x7fee6404fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:34.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.398+0000 7fee83788700 1 --2- 172.21.15.103:0/3749656952 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fee6404d930 0x7fee6404fdf0 secure :-1 s=READY pgs=264 cs=0 l=1 rx=0x7fee78002f30 tx=0x7fee780076e0).stop 2020-04-22T14:07:34.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.398+0000 7fee83788700 1 -- 172.21.15.103:0/3749656952 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fee7c152a90 msgr2=0x7fee7c0652f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:34.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.398+0000 7fee83788700 1 --2- 172.21.15.103:0/3749656952 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fee7c152a90 0x7fee7c0652f0 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7fee740032b0 tx=0x7fee74010d00).stop 2020-04-22T14:07:34.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.398+0000 7fee83788700 1 -- 172.21.15.103:0/3749656952 shutdown_connections 2020-04-22T14:07:34.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.398+0000 7fee83788700 1 --2- 172.21.15.103:0/3749656952 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fee7c152a90 0x7fee7c0652f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:34.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.398+0000 7fee83788700 1 --2- 172.21.15.103:0/3749656952 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fee6404d930 0x7fee6404fdf0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:34.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.398+0000 7fee83788700 1 --2- 172.21.15.103:0/3749656952 >> v2:172.21.15.86:3300/0 conn(0x7fee7c062170 0x7fee7c063c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:34.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.398+0000 7fee83788700 1 -- 172.21.15.103:0/3749656952 >> 172.21.15.103:0/3749656952 conn(0x7fee7c05ad30 msgr2=0x7fee7c05c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:34.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.398+0000 7fee83788700 1 -- 172.21.15.103:0/3749656952 shutdown_connections 2020-04-22T14:07:34.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.398+0000 7fee83788700 1 -- 172.21.15.103:0/3749656952 wait complete. 2020-04-22T14:07:34.402 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.3 2020-04-22T14:07:34.411 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:34.424 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:07:34.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.569+0000 7f54f3f30700 1 Processor -- start 2020-04-22T14:07:34.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.569+0000 7f54f3f30700 1 -- start start 2020-04-22T14:07:34.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.570+0000 7f54f3f30700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f54ec067170 0x7f54ec0b6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:34.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.570+0000 7f54f3f30700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f54ec1426d0 0x7f54ec142b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:34.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.570+0000 7f54f3f30700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54ec064ec0 con 0x7f54ec0ac740 2020-04-22T14:07:34.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.570+0000 7f54f3f30700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54ec065af0 con 0x7f54ec067170 2020-04-22T14:07:34.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.570+0000 7f54f3f30700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54ec146870 con 0x7f54ec1426d0 2020-04-22T14:07:34.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.570+0000 7f54f24cd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f54ec1426d0 0x7f54ec142b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:34.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.570+0000 7f54f14cb700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f54ec0ac740 0x7f54ec13c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42574/0 (socket says 172.21.15.103:42574) 2020-04-22T14:07:34.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.570+0000 7f54f14cb700 1 -- 172.21.15.103:0/881359184 learned_addr learned my addr 172.21.15.103:0/881359184 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:34.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.570+0000 7f54f1ccc700 1 --2- 172.21.15.103:0/881359184 >> v2:172.21.15.86:3300/0 conn(0x7f54ec067170 0x7f54ec0b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:34.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.570+0000 7f54f24cd700 1 -- 172.21.15.103:0/881359184 >> v2:172.21.15.86:3300/0 conn(0x7f54ec067170 msgr2=0x7f54ec0b6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:34.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.570+0000 7f54f24cd700 1 --2- 172.21.15.103:0/881359184 >> v2:172.21.15.86:3300/0 conn(0x7f54ec067170 0x7f54ec0b6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:34.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.570+0000 7f54f24cd700 1 -- 172.21.15.103:0/881359184 >> v1:172.21.15.103:6789/0 conn(0x7f54ec0ac740 legacy=0x7f54ec13c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:34.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.570+0000 7f54f0cca700 1 -- 172.21.15.103:0/881359184 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2279328845 0 0) 0x7f54ec064ec0 con 0x7f54ec0ac740 2020-04-22T14:07:34.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.570+0000 7f54f24cd700 1 -- 172.21.15.103:0/881359184 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ec067550 con 0x7f54ec1426d0 2020-04-22T14:07:34.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.570+0000 7f54f1ccc700 1 --2- 172.21.15.103:0/881359184 >> v2:172.21.15.86:3300/0 conn(0x7f54ec067170 0x7f54ec0b6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:07:34.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.570+0000 7f54f24cd700 1 --2- 172.21.15.103:0/881359184 >> v2:172.21.15.103:3300/0 conn(0x7f54ec1426d0 0x7f54ec142b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f54e40032b0 tx=0x7f54e4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:34.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.570+0000 7f54f24cd700 1 --2- 172.21.15.103:0/881359184 >> v2:172.21.15.103:3300/0 conn(0x7f54ec1426d0 0x7f54ec142b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f54e40032b0 tx=0x7f54e4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:34.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.570+0000 7f54f24cd700 1 --2- 172.21.15.103:0/881359184 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54ec1426d0 0x7f54ec142b40 secure :-1 s=READY pgs=690 cs=0 l=1 rx=0x7f54e40032b0 tx=0x7f54e4007dc0).ready entity=mon.1 client_cookie=f483181a433e541b server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:34.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.570+0000 7f54f24cd700 1 --2- 172.21.15.103:0/881359184 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54ec1426d0 0x7f54ec142b40 secure :-1 s=THROTTLE_DONE pgs=690 cs=0 l=1 rx=0x7f54e40032b0 tx=0x7f54e4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:34.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.570+0000 7f54f0cca700 1 -- 172.21.15.103:0/881359184 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54e400a180 con 0x7f54ec1426d0 2020-04-22T14:07:34.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.571+0000 7f54f24cd700 1 --2- 172.21.15.103:0/881359184 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54ec1426d0 0x7f54ec142b40 secure :-1 s=THROTTLE_DONE pgs=690 cs=0 l=1 rx=0x7f54e40032b0 tx=0x7f54e4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:34.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.571+0000 7f54f0cca700 1 -- 172.21.15.103:0/881359184 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e400a2e0 con 0x7f54ec1426d0 2020-04-22T14:07:34.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.571+0000 7f54f24cd700 1 --2- 172.21.15.103:0/881359184 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54ec1426d0 0x7f54ec142b40 secure :-1 s=THROTTLE_DONE pgs=690 cs=0 l=1 rx=0x7f54e40032b0 tx=0x7f54e4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:34.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.571+0000 7f54f0cca700 1 -- 172.21.15.103:0/881359184 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54e400a6c0 con 0x7f54ec1426d0 2020-04-22T14:07:34.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.571+0000 7f54f3f30700 1 -- 172.21.15.103:0/881359184 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54ec1426d0 msgr2=0x7f54ec142b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:34.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.571+0000 7f54f3f30700 1 --2- 172.21.15.103:0/881359184 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54ec1426d0 0x7f54ec142b40 secure :-1 s=READY pgs=690 cs=0 l=1 rx=0x7f54e40032b0 tx=0x7f54e4007dc0).stop 2020-04-22T14:07:34.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.571+0000 7f54f3f30700 1 -- 172.21.15.103:0/881359184 shutdown_connections 2020-04-22T14:07:34.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.571+0000 7f54f3f30700 1 --2- 172.21.15.103:0/881359184 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54ec1426d0 0x7f54ec142b40 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:34.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.571+0000 7f54f3f30700 1 --2- 172.21.15.103:0/881359184 >> v2:172.21.15.86:3300/0 conn(0x7f54ec067170 0x7f54ec0b6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:34.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.571+0000 7f54f3f30700 1 -- 172.21.15.103:0/881359184 >> 172.21.15.103:0/881359184 conn(0x7f54ec0b9160 msgr2=0x7f54ec05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:34.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.571+0000 7f54f3f30700 1 -- 172.21.15.103:0/881359184 shutdown_connections 2020-04-22T14:07:34.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.571+0000 7f54f3f30700 1 -- 172.21.15.103:0/881359184 wait complete. 2020-04-22T14:07:34.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.572+0000 7f54f3f30700 1 Processor -- start 2020-04-22T14:07:34.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.572+0000 7f54f3f30700 1 -- start start 2020-04-22T14:07:34.582 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.573+0000 7f54f3f30700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54ec0ac740 0x7f54ec13ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:34.582 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.573+0000 7f54f3f30700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54ec13af60 con 0x7f54ec1426d0 2020-04-22T14:07:34.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.573+0000 7f54f3f30700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54ec13cd70 con 0x7f54ec067170 2020-04-22T14:07:34.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.573+0000 7f54f3f30700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec13cb70 con 0x7f54ec0ac740 2020-04-22T14:07:34.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.573+0000 7f54f1ccc700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f54ec067170 0x7f54ec13c460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42580/0 (socket says 172.21.15.103:42580) 2020-04-22T14:07:34.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.573+0000 7f54f1ccc700 1 -- 172.21.15.103:0/3513315837 learned_addr learned my addr 172.21.15.103:0/3513315837 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:34.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.573+0000 7f54daffd700 1 -- 172.21.15.103:0/3513315837 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 88583067 0 0) 0x7f54ec13cd70 con 0x7f54ec067170 2020-04-22T14:07:34.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.573+0000 7f54daffd700 1 -- 172.21.15.103:0/3513315837 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54cc002fe0 con 0x7f54ec067170 2020-04-22T14:07:34.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.573+0000 7f54f14cb700 1 --2- 172.21.15.103:0/3513315837 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54ec0ac740 0x7f54ec13ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:34.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.573+0000 7f54daffd700 1 -- 172.21.15.103:0/3513315837 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1104552366 0 0) 0x7f54cc002fe0 con 0x7f54ec067170 2020-04-22T14:07:34.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.573+0000 7f54daffd700 1 -- 172.21.15.103:0/3513315837 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f54ec13cd70 con 0x7f54ec067170 2020-04-22T14:07:34.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.573+0000 7f54daffd700 1 -- 172.21.15.103:0/3513315837 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f54e8002500 con 0x7f54ec067170 2020-04-22T14:07:34.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.573+0000 7f54daffd700 1 -- 172.21.15.103:0/3513315837 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54ec0ac740 msgr2=0x7f54ec13ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:34.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.573+0000 7f54daffd700 1 --2- 172.21.15.103:0/3513315837 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54ec0ac740 0x7f54ec13ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:34.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.573+0000 7f54daffd700 1 -- 172.21.15.103:0/3513315837 >> v1:172.21.15.103:6789/0 conn(0x7f54ec067170 legacy=0x7f54ec13c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:34.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.573+0000 7f54daffd700 1 -- 172.21.15.103:0/3513315837 >> v1:172.21.15.86:6789/0 conn(0x7f54ec1426d0 legacy=0x7f54ec1511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:34.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.573+0000 7f54daffd700 1 --2- 172.21.15.103:0/3513315837 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54ec0ac740 0x7f54cc0049b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:34.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.573+0000 7f54daffd700 1 --2- 172.21.15.103:0/3513315837 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54cc004e10 0x7f54cc005230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:34.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.573+0000 7f54daffd700 1 --2- 172.21.15.103:0/3513315837 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54cc003a30 0x7f54cc003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:34.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.573+0000 7f54daffd700 1 -- 172.21.15.103:0/3513315837 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec13cb70 con 0x7f54cc003a30 2020-04-22T14:07:34.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.573+0000 7f54daffd700 1 -- 172.21.15.103:0/3513315837 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc0044f0 con 0x7f54cc004e10 2020-04-22T14:07:34.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.573+0000 7f54daffd700 1 -- 172.21.15.103:0/3513315837 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc0046b0 con 0x7f54ec0ac740 2020-04-22T14:07:34.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.573+0000 7f54f14cb700 1 --2- 172.21.15.103:0/3513315837 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54cc004e10 0x7f54cc005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:34.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.574+0000 7f54f24cd700 1 --2- 172.21.15.103:0/3513315837 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54cc003a30 0x7f54cc003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:34.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.574+0000 7f54f1ccc700 1 --2- 172.21.15.103:0/3513315837 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54ec0ac740 0x7f54cc0049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:34.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.574+0000 7f54f14cb700 1 -- 172.21.15.103:0/3513315837 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54ec0ac740 msgr2=0x7f54cc0049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:34.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.574+0000 7f54f14cb700 1 --2- 172.21.15.103:0/3513315837 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54ec0ac740 0x7f54cc0049b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:34.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.574+0000 7f54f14cb700 1 -- 172.21.15.103:0/3513315837 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54cc003a30 msgr2=0x7f54cc003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:34.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.574+0000 7f54f14cb700 1 --2- 172.21.15.103:0/3513315837 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54cc003a30 0x7f54cc003eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:34.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.574+0000 7f54f14cb700 1 -- 172.21.15.103:0/3513315837 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ec13d010 con 0x7f54cc004e10 2020-04-22T14:07:34.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.574+0000 7f54f3f30700 1 -- 172.21.15.103:0/3513315837 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54ec13d2b0 con 0x7f54cc004e10 2020-04-22T14:07:34.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.574+0000 7f54f14cb700 1 --2- 172.21.15.103:0/3513315837 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54cc004e10 0x7f54cc005230 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f54dc000b80 tx=0x7f54dc012ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:34.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.574+0000 7f54f3f30700 1 -- 172.21.15.103:0/3513315837 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54ec1518d0 con 0x7f54cc004e10 2020-04-22T14:07:34.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.574+0000 7f54f14cb700 1 --2- 172.21.15.103:0/3513315837 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54cc004e10 0x7f54cc005230 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f54dc000b80 tx=0x7f54dc012ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:34.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.574+0000 7f54f14cb700 1 --2- 172.21.15.103:0/3513315837 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54cc004e10 0x7f54cc005230 secure :-1 s=READY pgs=692 cs=0 l=1 rx=0x7f54dc000b80 tx=0x7f54dc012ef0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:34.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.574+0000 7f54f14cb700 1 --2- 172.21.15.103:0/3513315837 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54cc004e10 0x7f54cc005230 secure :-1 s=THROTTLE_DONE pgs=692 cs=0 l=1 rx=0x7f54dc000b80 tx=0x7f54dc012ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:34.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.574+0000 7f54daffd700 1 -- 172.21.15.103:0/3513315837 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54dc013770 con 0x7f54cc004e10 2020-04-22T14:07:34.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.574+0000 7f54f14cb700 1 --2- 172.21.15.103:0/3513315837 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54cc004e10 0x7f54cc005230 secure :-1 s=THROTTLE_DONE pgs=692 cs=0 l=1 rx=0x7f54dc000b80 tx=0x7f54dc012ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:34.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.574+0000 7f54f14cb700 1 --2- 172.21.15.103:0/3513315837 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54cc004e10 0x7f54cc005230 secure :-1 s=THROTTLE_DONE pgs=692 cs=0 l=1 rx=0x7f54dc000b80 tx=0x7f54dc012ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:34.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.574+0000 7f54daffd700 1 -- 172.21.15.103:0/3513315837 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54dc0138d0 con 0x7f54cc004e10 2020-04-22T14:07:34.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.574+0000 7f54daffd700 1 -- 172.21.15.103:0/3513315837 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54dc013c70 con 0x7f54cc004e10 2020-04-22T14:07:34.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.575+0000 7f54f14cb700 1 --2- 172.21.15.103:0/3513315837 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54cc004e10 0x7f54cc005230 secure :-1 s=THROTTLE_DONE pgs=692 cs=0 l=1 rx=0x7f54dc000b80 tx=0x7f54dc012ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:34.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.575+0000 7f54f3f30700 1 -- 172.21.15.103:0/3513315837 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54ec056c90 con 0x7f54cc004e10 2020-04-22T14:07:34.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.575+0000 7f54daffd700 1 -- 172.21.15.103:0/3513315837 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f54dc00c630 con 0x7f54cc004e10 2020-04-22T14:07:34.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.575+0000 7f54f14cb700 1 --2- 172.21.15.103:0/3513315837 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54cc004e10 0x7f54cc005230 secure :-1 s=THROTTLE_DONE pgs=692 cs=0 l=1 rx=0x7f54dc000b80 tx=0x7f54dc012ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:34.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.575+0000 7f54daffd700 1 --2- 172.21.15.103:0/3513315837 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f54cc05a0c0 0x7f54cc05c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:34.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.575+0000 7f54daffd700 1 -- 172.21.15.103:0/3513315837 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f54dc060e10 con 0x7f54cc004e10 2020-04-22T14:07:34.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.575+0000 7f54f1ccc700 1 --2- 172.21.15.103:0/3513315837 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f54cc05a0c0 0x7f54cc05c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:34.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.576+0000 7f54f1ccc700 1 --2- 172.21.15.103:0/3513315837 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f54cc05a0c0 0x7f54cc05c580 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f54e8007a40 tx=0x7f54e8002f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:34.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.576+0000 7f54f1ccc700 1 --2- 172.21.15.103:0/3513315837 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f54cc05a0c0 0x7f54cc05c580 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f54e8007a40 tx=0x7f54e8002f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:34.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.576+0000 7f54f1ccc700 1 --2- 172.21.15.103:0/3513315837 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f54cc05a0c0 0x7f54cc05c580 secure :-1 s=READY pgs=265 cs=0 l=1 rx=0x7f54e8007a40 tx=0x7f54e8002f70).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:34.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.579+0000 7f54f14cb700 1 --2- 172.21.15.103:0/3513315837 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54cc004e10 0x7f54cc005230 secure :-1 s=THROTTLE_DONE pgs=692 cs=0 l=1 rx=0x7f54dc000b80 tx=0x7f54dc012ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:34.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.579+0000 7f54daffd700 1 -- 172.21.15.103:0/3513315837 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f54dc03c2b0 con 0x7f54cc004e10 2020-04-22T14:07:34.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.770+0000 7f54f3f30700 1 -- 172.21.15.103:0/3513315837 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f54ec0b45f0 con 0x7f54cc004e10 2020-04-22T14:07:34.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.771+0000 7f54f14cb700 1 --2- 172.21.15.103:0/3513315837 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54cc004e10 0x7f54cc005230 secure :-1 s=THROTTLE_DONE pgs=692 cs=0 l=1 rx=0x7f54dc000b80 tx=0x7f54dc012ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:34.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.771+0000 7f54daffd700 1 -- 172.21.15.103:0/3513315837 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f54dc03f8d0 con 0x7f54cc004e10 2020-04-22T14:07:34.773 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:07:34.773 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":28,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4898,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/167651529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":167651529},{"type":"v1","addr":"172.21.15.86:6835","nonce":167651529}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:07:30.137341+0000","modified":"2020-04-22T14:07:32.145409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5890},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5890":{"gid":5890,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/494421372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":494421372},{"type":"v1","addr":"172.21.15.103:6833","nonce":494421372}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2020-04-22T14:07:34.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.772+0000 7f54f3f30700 1 -- 172.21.15.103:0/3513315837 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f54cc05a0c0 msgr2=0x7f54cc05c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:34.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.772+0000 7f54f3f30700 1 --2- 172.21.15.103:0/3513315837 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f54cc05a0c0 0x7f54cc05c580 secure :-1 s=READY pgs=265 cs=0 l=1 rx=0x7f54e8007a40 tx=0x7f54e8002f70).stop 2020-04-22T14:07:34.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.772+0000 7f54f3f30700 1 -- 172.21.15.103:0/3513315837 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54cc004e10 msgr2=0x7f54cc005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:34.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.772+0000 7f54f3f30700 1 --2- 172.21.15.103:0/3513315837 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54cc004e10 0x7f54cc005230 secure :-1 s=READY pgs=692 cs=0 l=1 rx=0x7f54dc000b80 tx=0x7f54dc012ef0).stop 2020-04-22T14:07:34.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.772+0000 7f54f24cd700 1 -- 172.21.15.103:0/3513315837 reap_dead start 2020-04-22T14:07:34.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.772+0000 7f54f3f30700 1 -- 172.21.15.103:0/3513315837 shutdown_connections 2020-04-22T14:07:34.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.772+0000 7f54f3f30700 1 -- 172.21.15.103:0/3513315837 >> 172.21.15.103:0/3513315837 conn(0x7f54ec0b9160 msgr2=0x7f54ec1380a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:34.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.772+0000 7f54f3f30700 1 -- 172.21.15.103:0/3513315837 shutdown_connections 2020-04-22T14:07:34.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:34.772+0000 7f54f3f30700 1 -- 172.21.15.103:0/3513315837 wait complete. 2020-04-22T14:07:34.776 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 28 2020-04-22T14:07:34.985 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 5890}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 9, u'failed': [], u'epoch': 28, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [10], u'info': {u'gid_5890': {u'export_targets': [], u'name': u'a', u'incarnation': 25, u'state_seq': 3, u'state': u'up:active', u'gid': 5890, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 494421372, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 494421372, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/494421372'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:07:30.137341+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:07:32.145409+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:07:34.986 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:07:34.986 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:35.000 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:07:35.160 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:07:35.161 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:07:35.161 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:07:35.161 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 5890, 2020-04-22T14:07:35.161 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:07:35.161 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:07:35.162 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 5.0202295100000001, 2020-04-22T14:07:35.162 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 28, 2020-04-22T14:07:35.162 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 54, 2020-04-22T14:07:35.162 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 54, 2020-04-22T14:07:35.162 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 10.454331885 2020-04-22T14:07:35.162 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:07:35.169 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 5890, "want_state": "up:active", "state": "up:active", "rank_uptime": 5.0202295100000001, "mdsmap_epoch": 28, "osdmap_epoch": 54, "osdmap_epoch_barrier": 54, "uptime": 10.454331885 } 2020-04-22T14:07:35.169 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:35.182 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:07:35.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.327+0000 7fba21b72700 1 Processor -- start 2020-04-22T14:07:35.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.327+0000 7fba21b72700 1 -- start start 2020-04-22T14:07:35.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.328+0000 7fba21b72700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fba1c065fe0 0x7fba1c1464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:35.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.328+0000 7fba21b72700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba1c063e30 0x7fba1c0642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:35.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.328+0000 7fba21b72700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba1c143300 con 0x7fba1c12c0d0 2020-04-22T14:07:35.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.328+0000 7fba21b72700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba1c1435a0 con 0x7fba1c065fe0 2020-04-22T14:07:35.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.328+0000 7fba21b72700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c143840 con 0x7fba1c063e30 2020-04-22T14:07:35.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.328+0000 7fba1affd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fba1c065fe0 0x7fba1c1464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:35.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.328+0000 7fba1affd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fba1c065fe0 0x7fba1c1464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50408/0 (socket says 172.21.15.103:50408) 2020-04-22T14:07:35.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.328+0000 7fba1affd700 1 -- 172.21.15.103:0/1082166816 learned_addr learned my addr 172.21.15.103:0/1082166816 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:35.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.328+0000 7fba1bfff700 1 --2- 172.21.15.103:0/1082166816 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba1c063e30 0x7fba1c0642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:35.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.328+0000 7fba1affd700 1 -- 172.21.15.103:0/1082166816 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba1c063e30 msgr2=0x7fba1c0642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:35.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.328+0000 7fba1affd700 1 --2- 172.21.15.103:0/1082166816 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba1c063e30 0x7fba1c0642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:35.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.328+0000 7fba1affd700 1 -- 172.21.15.103:0/1082166816 >> v1:172.21.15.86:6789/0 conn(0x7fba1c12c0d0 legacy=0x7fba1c05b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:35.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.328+0000 7fba1affd700 1 -- 172.21.15.103:0/1082166816 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1c05bb50 con 0x7fba1c065fe0 2020-04-22T14:07:35.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.328+0000 7fba1bfff700 1 --2- 172.21.15.103:0/1082166816 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba1c063e30 0x7fba1c0642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:07:35.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.328+0000 7fba1affd700 1 --2- 172.21.15.103:0/1082166816 >> v2:172.21.15.103:3300/0 conn(0x7fba1c065fe0 0x7fba1c1464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fba10002f30 tx=0x7fba10007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:35.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.328+0000 7fba1affd700 1 --2- 172.21.15.103:0/1082166816 >> v2:172.21.15.103:3300/0 conn(0x7fba1c065fe0 0x7fba1c1464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fba10002f30 tx=0x7fba10007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:35.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.328+0000 7fba1affd700 1 --2- 172.21.15.103:0/1082166816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba1c065fe0 0x7fba1c1464e0 secure :-1 s=READY pgs=693 cs=0 l=1 rx=0x7fba10002f30 tx=0x7fba10007a40).ready entity=mon.1 client_cookie=d4fde20afc126325 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:35.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.328+0000 7fba1affd700 1 --2- 172.21.15.103:0/1082166816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba1c065fe0 0x7fba1c1464e0 secure :-1 s=THROTTLE_DONE pgs=693 cs=0 l=1 rx=0x7fba10002f30 tx=0x7fba10007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:35.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.328+0000 7fba1a7fc700 1 -- 172.21.15.103:0/1082166816 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba10011720 con 0x7fba1c065fe0 2020-04-22T14:07:35.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.328+0000 7fba1affd700 1 --2- 172.21.15.103:0/1082166816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba1c065fe0 0x7fba1c1464e0 secure :-1 s=THROTTLE_DONE pgs=693 cs=0 l=1 rx=0x7fba10002f30 tx=0x7fba10007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:35.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.328+0000 7fba1affd700 1 --2- 172.21.15.103:0/1082166816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba1c065fe0 0x7fba1c1464e0 secure :-1 s=THROTTLE_DONE pgs=693 cs=0 l=1 rx=0x7fba10002f30 tx=0x7fba10007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:35.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.328+0000 7fba1a7fc700 1 -- 172.21.15.103:0/1082166816 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba100118c0 con 0x7fba1c065fe0 2020-04-22T14:07:35.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.328+0000 7fba1a7fc700 1 -- 172.21.15.103:0/1082166816 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba10011ce0 con 0x7fba1c065fe0 2020-04-22T14:07:35.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.329+0000 7fba21b72700 1 -- 172.21.15.103:0/1082166816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba1c065fe0 msgr2=0x7fba1c1464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:35.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.329+0000 7fba21b72700 1 --2- 172.21.15.103:0/1082166816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba1c065fe0 0x7fba1c1464e0 secure :-1 s=READY pgs=693 cs=0 l=1 rx=0x7fba10002f30 tx=0x7fba10007a40).stop 2020-04-22T14:07:35.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.329+0000 7fba21b72700 1 -- 172.21.15.103:0/1082166816 shutdown_connections 2020-04-22T14:07:35.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.329+0000 7fba21b72700 1 --2- 172.21.15.103:0/1082166816 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba1c063e30 0x7fba1c0642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:35.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.329+0000 7fba21b72700 1 --2- 172.21.15.103:0/1082166816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba1c065fe0 0x7fba1c1464e0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:35.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.329+0000 7fba21b72700 1 -- 172.21.15.103:0/1082166816 >> 172.21.15.103:0/1082166816 conn(0x7fba1c0b9160 msgr2=0x7fba1c05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:35.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.329+0000 7fba21b72700 1 -- 172.21.15.103:0/1082166816 shutdown_connections 2020-04-22T14:07:35.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.329+0000 7fba21b72700 1 -- 172.21.15.103:0/1082166816 wait complete. 2020-04-22T14:07:35.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.330+0000 7fba21b72700 1 Processor -- start 2020-04-22T14:07:35.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.330+0000 7fba21b72700 1 -- start start 2020-04-22T14:07:35.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.331+0000 7fba21b72700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fba1c063e30 0x7fba1c0b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:35.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.331+0000 7fba21b72700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba1c065fe0 0x7fba1c0b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:35.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.331+0000 7fba21b72700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba1c1295f0 con 0x7fba1c12c0d0 2020-04-22T14:07:35.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.331+0000 7fba21b72700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba1c129890 con 0x7fba1c063e30 2020-04-22T14:07:35.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.331+0000 7fba21b72700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c129b30 con 0x7fba1c065fe0 2020-04-22T14:07:35.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.331+0000 7fba1bfff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fba1c12c0d0 0x7fba1c142070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42604/0 (socket says 172.21.15.103:42604) 2020-04-22T14:07:35.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.331+0000 7fba1bfff700 1 -- 172.21.15.103:0/1118198863 learned_addr learned my addr 172.21.15.103:0/1118198863 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:35.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.331+0000 7fba1affd700 1 --2- 172.21.15.103:0/1118198863 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba1c065fe0 0x7fba1c0b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:35.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.331+0000 7fba1b7fe700 1 --2- 172.21.15.103:0/1118198863 >> v2:172.21.15.86:3300/0 conn(0x7fba1c063e30 0x7fba1c0b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:35.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.331+0000 7fba18ff9700 1 -- 172.21.15.103:0/1118198863 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 342103453 0 0) 0x7fba1c1295f0 con 0x7fba1c12c0d0 2020-04-22T14:07:35.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.331+0000 7fba18ff9700 1 -- 172.21.15.103:0/1118198863 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9fc002fe0 con 0x7fba1c12c0d0 2020-04-22T14:07:35.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.331+0000 7fba18ff9700 1 -- 172.21.15.103:0/1118198863 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4123872183 0 0) 0x7fb9fc002fe0 con 0x7fba1c12c0d0 2020-04-22T14:07:35.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.331+0000 7fba1b7fe700 1 -- 172.21.15.103:0/1118198863 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba1c065fe0 msgr2=0x7fba1c0b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:35.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.331+0000 7fba1b7fe700 1 --2- 172.21.15.103:0/1118198863 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba1c065fe0 0x7fba1c0b3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:35.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.331+0000 7fba1b7fe700 1 -- 172.21.15.103:0/1118198863 >> v1:172.21.15.103:6789/0 conn(0x7fba1c12c0d0 legacy=0x7fba1c142070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:35.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.331+0000 7fba1b7fe700 1 -- 172.21.15.103:0/1118198863 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1c0b4440 con 0x7fba1c063e30 2020-04-22T14:07:35.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.331+0000 7fba1affd700 1 --2- 172.21.15.103:0/1118198863 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba1c065fe0 0x7fba1c0b3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:07:35.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.331+0000 7fba1b7fe700 1 --2- 172.21.15.103:0/1118198863 >> v2:172.21.15.86:3300/0 conn(0x7fba1c063e30 0x7fba1c0b54c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fba14001a30 tx=0x7fba0c010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:35.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.331+0000 7fba1b7fe700 1 --2- 172.21.15.103:0/1118198863 >> v2:172.21.15.86:3300/0 conn(0x7fba1c063e30 0x7fba1c0b54c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fba14001a30 tx=0x7fba0c010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:35.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.331+0000 7fba1b7fe700 1 --2- 172.21.15.103:0/1118198863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba1c063e30 0x7fba1c0b54c0 secure :-1 s=READY pgs=390 cs=0 l=1 rx=0x7fba14001a30 tx=0x7fba0c010880).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:35.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.332+0000 7fba1b7fe700 1 --2- 172.21.15.103:0/1118198863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba1c063e30 0x7fba1c0b54c0 secure :-1 s=THROTTLE_DONE pgs=390 cs=0 l=1 rx=0x7fba14001a30 tx=0x7fba0c010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:35.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.332+0000 7fba18ff9700 1 -- 172.21.15.103:0/1118198863 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba0c001ea0 con 0x7fba1c063e30 2020-04-22T14:07:35.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.332+0000 7fba1b7fe700 1 --2- 172.21.15.103:0/1118198863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba1c063e30 0x7fba1c0b54c0 secure :-1 s=THROTTLE_DONE pgs=390 cs=0 l=1 rx=0x7fba14001a30 tx=0x7fba0c010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:35.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.332+0000 7fba18ff9700 1 -- 172.21.15.103:0/1118198863 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0c0069d0 con 0x7fba1c063e30 2020-04-22T14:07:35.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.332+0000 7fba1b7fe700 1 --2- 172.21.15.103:0/1118198863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba1c063e30 0x7fba1c0b54c0 secure :-1 s=THROTTLE_DONE pgs=390 cs=0 l=1 rx=0x7fba14001a30 tx=0x7fba0c010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:35.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.332+0000 7fba21b72700 1 -- 172.21.15.103:0/1118198863 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba1c129fd0 con 0x7fba1c063e30 2020-04-22T14:07:35.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.332+0000 7fba18ff9700 1 -- 172.21.15.103:0/1118198863 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba14001890 con 0x7fba1c063e30 2020-04-22T14:07:35.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.332+0000 7fba21b72700 1 -- 172.21.15.103:0/1118198863 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba1c142940 con 0x7fba1c063e30 2020-04-22T14:07:35.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.332+0000 7fba1b7fe700 1 --2- 172.21.15.103:0/1118198863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba1c063e30 0x7fba1c0b54c0 secure :-1 s=THROTTLE_DONE pgs=390 cs=0 l=1 rx=0x7fba14001a30 tx=0x7fba0c010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:35.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.333+0000 7fba21b72700 1 -- 172.21.15.103:0/1118198863 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba1c056c90 con 0x7fba1c063e30 2020-04-22T14:07:35.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.333+0000 7fba1b7fe700 1 --2- 172.21.15.103:0/1118198863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba1c063e30 0x7fba1c0b54c0 secure :-1 s=THROTTLE_DONE pgs=390 cs=0 l=1 rx=0x7fba14001a30 tx=0x7fba0c010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:35.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.333+0000 7fba18ff9700 1 -- 172.21.15.103:0/1118198863 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fba0c00a2b0 con 0x7fba1c063e30 2020-04-22T14:07:35.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.333+0000 7fba18ff9700 1 --2- 172.21.15.103:0/1118198863 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb9fc04dca0 0x7fb9fc050160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:35.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.333+0000 7fba18ff9700 1 -- 172.21.15.103:0/1118198863 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fba0c060de0 con 0x7fba1c063e30 2020-04-22T14:07:35.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.333+0000 7fba1affd700 1 --2- 172.21.15.103:0/1118198863 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb9fc04dca0 0x7fb9fc050160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:35.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.333+0000 7fba1affd700 1 --2- 172.21.15.103:0/1118198863 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb9fc04dca0 0x7fb9fc050160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fba10002f30 tx=0x7fba10007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:35.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.334+0000 7fba1affd700 1 --2- 172.21.15.103:0/1118198863 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb9fc04dca0 0x7fb9fc050160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fba10002f30 tx=0x7fba10007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:35.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.334+0000 7fba1affd700 1 --2- 172.21.15.103:0/1118198863 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb9fc04dca0 0x7fb9fc050160 secure :-1 s=READY pgs=266 cs=0 l=1 rx=0x7fba10002f30 tx=0x7fba10007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:35.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.337+0000 7fba1b7fe700 1 --2- 172.21.15.103:0/1118198863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba1c063e30 0x7fba1c0b54c0 secure :-1 s=THROTTLE_DONE pgs=390 cs=0 l=1 rx=0x7fba14001a30 tx=0x7fba0c010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:35.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.337+0000 7fba18ff9700 1 -- 172.21.15.103:0/1118198863 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fba0c03c180 con 0x7fba1c063e30 2020-04-22T14:07:35.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.479+0000 7fba21b72700 1 -- 172.21.15.103:0/1118198863 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba1c0b45d0 con 0x7fba1c063e30 2020-04-22T14:07:35.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.480+0000 7fba1b7fe700 1 --2- 172.21.15.103:0/1118198863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba1c063e30 0x7fba1c0b54c0 secure :-1 s=THROTTLE_DONE pgs=390 cs=0 l=1 rx=0x7fba14001a30 tx=0x7fba0c010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:35.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.480+0000 7fba18ff9700 1 -- 172.21.15.103:0/1118198863 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+16091 (secure 0 0 0) 0x7fba0c03f7a0 con 0x7fba1c063e30 2020-04-22T14:07:35.483 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:07:35.484 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:07:31.138938+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:07:27.809363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2020-04-22T14:07:28.880202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:07:35.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.482+0000 7fba21b72700 1 -- 172.21.15.103:0/1118198863 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb9fc04dca0 msgr2=0x7fb9fc050160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:35.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.482+0000 7fba21b72700 1 --2- 172.21.15.103:0/1118198863 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb9fc04dca0 0x7fb9fc050160 secure :-1 s=READY pgs=266 cs=0 l=1 rx=0x7fba10002f30 tx=0x7fba10007a40).stop 2020-04-22T14:07:35.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.482+0000 7fba21b72700 1 -- 172.21.15.103:0/1118198863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba1c063e30 msgr2=0x7fba1c0b54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:35.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.482+0000 7fba21b72700 1 --2- 172.21.15.103:0/1118198863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba1c063e30 0x7fba1c0b54c0 secure :-1 s=READY pgs=390 cs=0 l=1 rx=0x7fba14001a30 tx=0x7fba0c010880).stop 2020-04-22T14:07:35.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.482+0000 7fba21b72700 1 -- 172.21.15.103:0/1118198863 shutdown_connections 2020-04-22T14:07:35.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.482+0000 7fba21b72700 1 --2- 172.21.15.103:0/1118198863 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb9fc04dca0 0x7fb9fc050160 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:35.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.482+0000 7fba21b72700 1 --2- 172.21.15.103:0/1118198863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba1c063e30 0x7fba1c0b54c0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:35.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.482+0000 7fba21b72700 1 --2- 172.21.15.103:0/1118198863 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba1c065fe0 0x7fba1c0b3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:35.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.482+0000 7fba21b72700 1 -- 172.21.15.103:0/1118198863 >> 172.21.15.103:0/1118198863 conn(0x7fba1c0b9160 msgr2=0x7fba1c0615e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:35.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.482+0000 7fba21b72700 1 -- 172.21.15.103:0/1118198863 shutdown_connections 2020-04-22T14:07:35.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.482+0000 7fba21b72700 1 -- 172.21.15.103:0/1118198863 wait complete. 2020-04-22T14:07:35.495 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:07:27.809363+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 9, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'53', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:07:28.880202+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 10, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'54', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:07:35.495 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:35.509 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:07:35.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.655+0000 7f4a6d14c700 1 Processor -- start 2020-04-22T14:07:35.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.655+0000 7f4a6d14c700 1 -- start start 2020-04-22T14:07:35.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.656+0000 7f4a6d14c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4a680b8e00 0x7f4a680af010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:35.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.656+0000 7f4a6d14c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4a6805fed0 0x7f4a680b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:35.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.656+0000 7f4a6d14c700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a680b29b0 con 0x7f4a680b91e0 2020-04-22T14:07:35.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.656+0000 7f4a6d14c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a680b4270 con 0x7f4a680b8e00 2020-04-22T14:07:35.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.656+0000 7f4a6d14c700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a680b4510 con 0x7f4a6805fed0 2020-04-22T14:07:35.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.656+0000 7f4a6c94b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4a6805fed0 0x7f4a680b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:35.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.656+0000 7f4a6c94b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4a6805fed0 0x7f4a680b1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50418/0 (socket says 172.21.15.103:50418) 2020-04-22T14:07:35.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.656+0000 7f4a6c94b700 1 -- 172.21.15.103:0/469567657 learned_addr learned my addr 172.21.15.103:0/469567657 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:35.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.657+0000 7f4a67fff700 1 --2- 172.21.15.103:0/469567657 >> v2:172.21.15.86:3300/0 conn(0x7f4a680b8e00 0x7f4a680af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:35.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.657+0000 7f4a6c94b700 1 -- 172.21.15.103:0/469567657 >> v2:172.21.15.86:3300/0 conn(0x7f4a680b8e00 msgr2=0x7f4a680af010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:35.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.657+0000 7f4a6c94b700 1 --2- 172.21.15.103:0/469567657 >> v2:172.21.15.86:3300/0 conn(0x7f4a680b8e00 0x7f4a680af010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:35.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.657+0000 7f4a6c94b700 1 -- 172.21.15.103:0/469567657 >> v1:172.21.15.86:6789/0 conn(0x7f4a680b91e0 legacy=0x7f4a68142f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:35.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.657+0000 7f4a6c94b700 1 -- 172.21.15.103:0/469567657 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a680b2020 con 0x7f4a6805fed0 2020-04-22T14:07:35.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.657+0000 7f4a67fff700 1 --2- 172.21.15.103:0/469567657 >> v2:172.21.15.86:3300/0 conn(0x7f4a680b8e00 0x7f4a680af010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:07:35.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.657+0000 7f4a6c94b700 1 --2- 172.21.15.103:0/469567657 >> v2:172.21.15.103:3300/0 conn(0x7f4a6805fed0 0x7f4a680b1bc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4a68062890 tx=0x7f4a60007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:35.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.657+0000 7f4a6c94b700 1 --2- 172.21.15.103:0/469567657 >> v2:172.21.15.103:3300/0 conn(0x7f4a6805fed0 0x7f4a680b1bc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4a68062890 tx=0x7f4a60007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:35.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.657+0000 7f4a6c94b700 1 --2- 172.21.15.103:0/469567657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4a6805fed0 0x7f4a680b1bc0 secure :-1 s=READY pgs=695 cs=0 l=1 rx=0x7f4a68062890 tx=0x7f4a60007dc0).ready entity=mon.1 client_cookie=cb07672bf9f2b777 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:35.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.657+0000 7f4a6c94b700 1 --2- 172.21.15.103:0/469567657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4a6805fed0 0x7f4a680b1bc0 secure :-1 s=THROTTLE_DONE pgs=695 cs=0 l=1 rx=0x7f4a68062890 tx=0x7f4a60007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:35.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.657+0000 7f4a66ffd700 1 -- 172.21.15.103:0/469567657 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a6000a180 con 0x7f4a6805fed0 2020-04-22T14:07:35.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.657+0000 7f4a6c94b700 1 --2- 172.21.15.103:0/469567657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4a6805fed0 0x7f4a680b1bc0 secure :-1 s=THROTTLE_DONE pgs=695 cs=0 l=1 rx=0x7f4a68062890 tx=0x7f4a60007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:35.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.657+0000 7f4a6c94b700 1 --2- 172.21.15.103:0/469567657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4a6805fed0 0x7f4a680b1bc0 secure :-1 s=THROTTLE_DONE pgs=695 cs=0 l=1 rx=0x7f4a68062890 tx=0x7f4a60007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:35.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.657+0000 7f4a66ffd700 1 -- 172.21.15.103:0/469567657 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6000a2e0 con 0x7f4a6805fed0 2020-04-22T14:07:35.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.657+0000 7f4a66ffd700 1 -- 172.21.15.103:0/469567657 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a6000a6c0 con 0x7f4a6805fed0 2020-04-22T14:07:35.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.657+0000 7f4a6d14c700 1 -- 172.21.15.103:0/469567657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4a6805fed0 msgr2=0x7f4a680b1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:35.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.657+0000 7f4a6d14c700 1 --2- 172.21.15.103:0/469567657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4a6805fed0 0x7f4a680b1bc0 secure :-1 s=READY pgs=695 cs=0 l=1 rx=0x7f4a68062890 tx=0x7f4a60007dc0).stop 2020-04-22T14:07:35.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.657+0000 7f4a6d14c700 1 -- 172.21.15.103:0/469567657 shutdown_connections 2020-04-22T14:07:35.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.658+0000 7f4a6d14c700 1 --2- 172.21.15.103:0/469567657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4a6805fed0 0x7f4a680b1bc0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:35.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.658+0000 7f4a6d14c700 1 --2- 172.21.15.103:0/469567657 >> v2:172.21.15.86:3300/0 conn(0x7f4a680b8e00 0x7f4a680af010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:35.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.658+0000 7f4a6d14c700 1 -- 172.21.15.103:0/469567657 >> 172.21.15.103:0/469567657 conn(0x7f4a6805b780 msgr2=0x7f4a680b8530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:35.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.658+0000 7f4a6d14c700 1 -- 172.21.15.103:0/469567657 shutdown_connections 2020-04-22T14:07:35.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.658+0000 7f4a6d14c700 1 -- 172.21.15.103:0/469567657 wait complete. 2020-04-22T14:07:35.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.658+0000 7f4a6d14c700 1 Processor -- start 2020-04-22T14:07:35.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.659+0000 7f4a6d14c700 1 -- start start 2020-04-22T14:07:35.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.659+0000 7f4a6d14c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4a6805fed0 0x7f4a68113fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:35.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.659+0000 7f4a6d14c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4a680b91e0 0x7f4a68061950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:35.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.659+0000 7f4a6d14c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a68061db0 con 0x7f4a680b8e00 2020-04-22T14:07:35.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.659+0000 7f4a6d14c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a680651f0 con 0x7f4a680b91e0 2020-04-22T14:07:35.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.659+0000 7f4a6d14c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a68065490 con 0x7f4a6805fed0 2020-04-22T14:07:35.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.659+0000 7f4a677fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f4a680b8e00 0x7f4a68151950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42614/0 (socket says 172.21.15.103:42614) 2020-04-22T14:07:35.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.659+0000 7f4a677fe700 1 -- 172.21.15.103:0/2012154956 learned_addr learned my addr 172.21.15.103:0/2012154956 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:35.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.660+0000 7f4a67fff700 1 --2- 172.21.15.103:0/2012154956 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4a6805fed0 0x7f4a68113fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:35.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.660+0000 7f4a6c94b700 1 --2- 172.21.15.103:0/2012154956 >> v2:172.21.15.86:3300/0 conn(0x7f4a680b91e0 0x7f4a68061950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:35.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.660+0000 7f4a657fa700 1 -- 172.21.15.103:0/2012154956 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2643573313 0 0) 0x7f4a5c002160 con 0x7f4a680b8e00 2020-04-22T14:07:35.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.660+0000 7f4a657fa700 1 -- 172.21.15.103:0/2012154956 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a48002fe0 con 0x7f4a680b8e00 2020-04-22T14:07:35.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.660+0000 7f4a6c94b700 1 -- 172.21.15.103:0/2012154956 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4a6805fed0 msgr2=0x7f4a68113fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:35.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.660+0000 7f4a657fa700 1 -- 172.21.15.103:0/2012154956 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4263448600 0 0) 0x7f4a48002fe0 con 0x7f4a680b8e00 2020-04-22T14:07:35.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.660+0000 7f4a6c94b700 1 --2- 172.21.15.103:0/2012154956 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4a6805fed0 0x7f4a68113fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:35.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.660+0000 7f4a6c94b700 1 -- 172.21.15.103:0/2012154956 >> v1:172.21.15.103:6789/0 conn(0x7f4a680b8e00 legacy=0x7f4a68151950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:35.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.660+0000 7f4a6c94b700 1 -- 172.21.15.103:0/2012154956 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a68065730 con 0x7f4a680b91e0 2020-04-22T14:07:35.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.660+0000 7f4a67fff700 1 --2- 172.21.15.103:0/2012154956 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4a6805fed0 0x7f4a68113fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:07:35.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.660+0000 7f4a6c94b700 1 --2- 172.21.15.103:0/2012154956 >> v2:172.21.15.86:3300/0 conn(0x7f4a680b91e0 0x7f4a68061950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4a5c002cd0 tx=0x7f4a60007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:35.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.660+0000 7f4a6c94b700 1 --2- 172.21.15.103:0/2012154956 >> v2:172.21.15.86:3300/0 conn(0x7f4a680b91e0 0x7f4a68061950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4a5c002cd0 tx=0x7f4a60007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:35.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.660+0000 7f4a6c94b700 1 --2- 172.21.15.103:0/2012154956 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a680b91e0 0x7f4a68061950 secure :-1 s=READY pgs=392 cs=0 l=1 rx=0x7f4a5c002cd0 tx=0x7f4a60007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:35.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.660+0000 7f4a6c94b700 1 --2- 172.21.15.103:0/2012154956 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a680b91e0 0x7f4a68061950 secure :-1 s=THROTTLE_DONE pgs=392 cs=0 l=1 rx=0x7f4a5c002cd0 tx=0x7f4a60007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:35.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.660+0000 7f4a657fa700 1 -- 172.21.15.103:0/2012154956 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a5c002b30 con 0x7f4a680b91e0 2020-04-22T14:07:35.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.660+0000 7f4a6c94b700 1 --2- 172.21.15.103:0/2012154956 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a680b91e0 0x7f4a68061950 secure :-1 s=THROTTLE_DONE pgs=392 cs=0 l=1 rx=0x7f4a5c002cd0 tx=0x7f4a60007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:35.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.660+0000 7f4a6c94b700 1 --2- 172.21.15.103:0/2012154956 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a680b91e0 0x7f4a68061950 secure :-1 s=THROTTLE_DONE pgs=392 cs=0 l=1 rx=0x7f4a5c002cd0 tx=0x7f4a60007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:35.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.660+0000 7f4a657fa700 1 -- 172.21.15.103:0/2012154956 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a60005a40 con 0x7f4a680b91e0 2020-04-22T14:07:35.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.660+0000 7f4a6d14c700 1 -- 172.21.15.103:0/2012154956 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a68152060 con 0x7f4a680b91e0 2020-04-22T14:07:35.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.660+0000 7f4a657fa700 1 -- 172.21.15.103:0/2012154956 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a60005da0 con 0x7f4a680b91e0 2020-04-22T14:07:35.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.660+0000 7f4a6d14c700 1 -- 172.21.15.103:0/2012154956 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a68064d20 con 0x7f4a680b91e0 2020-04-22T14:07:35.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.661+0000 7f4a6c94b700 1 --2- 172.21.15.103:0/2012154956 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a680b91e0 0x7f4a68061950 secure :-1 s=THROTTLE_DONE pgs=392 cs=0 l=1 rx=0x7f4a5c002cd0 tx=0x7f4a60007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:35.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.661+0000 7f4a6d14c700 1 -- 172.21.15.103:0/2012154956 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a68056c90 con 0x7f4a680b91e0 2020-04-22T14:07:35.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.661+0000 7f4a657fa700 1 -- 172.21.15.103:0/2012154956 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f4a600110d0 con 0x7f4a680b91e0 2020-04-22T14:07:35.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.661+0000 7f4a6c94b700 1 --2- 172.21.15.103:0/2012154956 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a680b91e0 0x7f4a68061950 secure :-1 s=THROTTLE_DONE pgs=392 cs=0 l=1 rx=0x7f4a5c002cd0 tx=0x7f4a60007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:35.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.662+0000 7f4a657fa700 1 --2- 172.21.15.103:0/2012154956 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4a4804dca0 0x7f4a48050160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:35.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.662+0000 7f4a657fa700 1 -- 172.21.15.103:0/2012154956 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4a60061880 con 0x7f4a680b91e0 2020-04-22T14:07:35.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.662+0000 7f4a67fff700 1 --2- 172.21.15.103:0/2012154956 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4a4804dca0 0x7f4a48050160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:35.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.662+0000 7f4a67fff700 1 --2- 172.21.15.103:0/2012154956 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4a4804dca0 0x7f4a48050160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4a58002f30 tx=0x7f4a5800b3f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:35.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.662+0000 7f4a67fff700 1 --2- 172.21.15.103:0/2012154956 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4a4804dca0 0x7f4a48050160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4a58002f30 tx=0x7f4a5800b3f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:35.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.662+0000 7f4a67fff700 1 --2- 172.21.15.103:0/2012154956 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4a4804dca0 0x7f4a48050160 secure :-1 s=READY pgs=267 cs=0 l=1 rx=0x7f4a58002f30 tx=0x7f4a5800b3f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:35.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.665+0000 7f4a6c94b700 1 --2- 172.21.15.103:0/2012154956 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a680b91e0 0x7f4a68061950 secure :-1 s=THROTTLE_DONE pgs=392 cs=0 l=1 rx=0x7f4a5c002cd0 tx=0x7f4a60007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:35.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.665+0000 7f4a657fa700 1 -- 172.21.15.103:0/2012154956 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f4a6003cd80 con 0x7f4a680b91e0 2020-04-22T14:07:35.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.808+0000 7f4a6d14c700 1 -- 172.21.15.103:0/2012154956 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4a6806a8b0 con 0x7f4a680b91e0 2020-04-22T14:07:35.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.809+0000 7f4a6c94b700 1 --2- 172.21.15.103:0/2012154956 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a680b91e0 0x7f4a68061950 secure :-1 s=THROTTLE_DONE pgs=392 cs=0 l=1 rx=0x7f4a5c002cd0 tx=0x7f4a60007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:35.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.809+0000 7f4a657fa700 1 -- 172.21.15.103:0/2012154956 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v54) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4a600403a0 con 0x7f4a680b91e0 2020-04-22T14:07:35.811 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:07:35.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.810+0000 7f4a6d14c700 1 -- 172.21.15.103:0/2012154956 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4a4804dca0 msgr2=0x7f4a48050160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:35.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.810+0000 7f4a6d14c700 1 --2- 172.21.15.103:0/2012154956 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4a4804dca0 0x7f4a48050160 secure :-1 s=READY pgs=267 cs=0 l=1 rx=0x7f4a58002f30 tx=0x7f4a5800b3f0).stop 2020-04-22T14:07:35.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.810+0000 7f4a6d14c700 1 -- 172.21.15.103:0/2012154956 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a680b91e0 msgr2=0x7f4a68061950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:35.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.810+0000 7f4a6d14c700 1 --2- 172.21.15.103:0/2012154956 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a680b91e0 0x7f4a68061950 secure :-1 s=READY pgs=392 cs=0 l=1 rx=0x7f4a5c002cd0 tx=0x7f4a60007dc0).stop 2020-04-22T14:07:35.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.810+0000 7f4a6d14c700 1 -- 172.21.15.103:0/2012154956 shutdown_connections 2020-04-22T14:07:35.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.810+0000 7f4a6d14c700 1 --2- 172.21.15.103:0/2012154956 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4a4804dca0 0x7f4a48050160 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:35.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.810+0000 7f4a6d14c700 1 --2- 172.21.15.103:0/2012154956 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a680b91e0 0x7f4a68061950 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:35.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.810+0000 7f4a6d14c700 1 --2- 172.21.15.103:0/2012154956 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4a6805fed0 0x7f4a68113fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:35.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.810+0000 7f4a6d14c700 1 -- 172.21.15.103:0/2012154956 >> 172.21.15.103:0/2012154956 conn(0x7f4a6805b780 msgr2=0x7f4a680b57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:35.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.810+0000 7f4a6d14c700 1 -- 172.21.15.103:0/2012154956 shutdown_connections 2020-04-22T14:07:35.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.810+0000 7f4a6d14c700 1 -- 172.21.15.103:0/2012154956 wait complete. 2020-04-22T14:07:35.823 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:35.837 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:07:35.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.984+0000 7fa7bafed700 1 Processor -- start 2020-04-22T14:07:35.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.984+0000 7fa7bafed700 1 -- start start 2020-04-22T14:07:35.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.985+0000 7fa7bafed700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa7b40b9140 0x7fa7b412b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:35.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.985+0000 7fa7bafed700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7b41467e0 con 0x7fa7b40ac950 2020-04-22T14:07:35.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.985+0000 7fa7bafed700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7b4060050 con 0x7fa7b412b670 2020-04-22T14:07:35.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.985+0000 7fa7bafed700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7b40602f0 con 0x7fa7b40b9140 2020-04-22T14:07:35.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.985+0000 7fa7b8d89700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa7b40b9140 0x7fa7b412b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:35.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.985+0000 7fa7b958a700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa7b412b670 0x7fa7b4143090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42624/0 (socket says 172.21.15.103:42624) 2020-04-22T14:07:35.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.985+0000 7fa7b8d89700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa7b40b9140 0x7fa7b412b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50430/0 (socket says 172.21.15.103:50430) 2020-04-22T14:07:35.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.985+0000 7fa7b958a700 1 -- 172.21.15.103:0/1632130464 learned_addr learned my addr 172.21.15.103:0/1632130464 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:35.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.985+0000 7fa7b8d89700 1 -- 172.21.15.103:0/1632130464 >> v1:172.21.15.103:6789/0 conn(0x7fa7b412b670 legacy=0x7fa7b4143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:35.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.985+0000 7fa7b8d89700 1 -- 172.21.15.103:0/1632130464 >> v1:172.21.15.86:6789/0 conn(0x7fa7b40ac950 legacy=0x7fa7b4146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:35.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.985+0000 7fa7b8d89700 1 -- 172.21.15.103:0/1632130464 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b40b9520 con 0x7fa7b40b9140 2020-04-22T14:07:35.991 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.985+0000 7fa7b8d89700 1 --2- 172.21.15.103:0/1632130464 >> v2:172.21.15.103:3300/0 conn(0x7fa7b40b9140 0x7fa7b412b210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa7b40b6250 tx=0x7fa7ac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:35.991 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.985+0000 7fa7b8d89700 1 --2- 172.21.15.103:0/1632130464 >> v2:172.21.15.103:3300/0 conn(0x7fa7b40b9140 0x7fa7b412b210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa7b40b6250 tx=0x7fa7ac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:35.991 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.985+0000 7fa7b8d89700 1 --2- 172.21.15.103:0/1632130464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7b40b9140 0x7fa7b412b210 secure :-1 s=READY pgs=698 cs=0 l=1 rx=0x7fa7b40b6250 tx=0x7fa7ac007dc0).ready entity=mon.1 client_cookie=ace82b614951eb96 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:35.991 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.985+0000 7fa7b8d89700 1 --2- 172.21.15.103:0/1632130464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7b40b9140 0x7fa7b412b210 secure :-1 s=THROTTLE_DONE pgs=698 cs=0 l=1 rx=0x7fa7b40b6250 tx=0x7fa7ac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:35.991 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.985+0000 7fa7b37fe700 1 -- 172.21.15.103:0/1632130464 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7ac011e90 con 0x7fa7b40b9140 2020-04-22T14:07:35.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.985+0000 7fa7b8d89700 1 --2- 172.21.15.103:0/1632130464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7b40b9140 0x7fa7b412b210 secure :-1 s=THROTTLE_DONE pgs=698 cs=0 l=1 rx=0x7fa7b40b6250 tx=0x7fa7ac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:35.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.985+0000 7fa7b8d89700 1 --2- 172.21.15.103:0/1632130464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7b40b9140 0x7fa7b412b210 secure :-1 s=THROTTLE_DONE pgs=698 cs=0 l=1 rx=0x7fa7b40b6250 tx=0x7fa7ac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:35.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.985+0000 7fa7b37fe700 1 -- 172.21.15.103:0/1632130464 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7ac00a180 con 0x7fa7b40b9140 2020-04-22T14:07:35.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.985+0000 7fa7b37fe700 1 -- 172.21.15.103:0/1632130464 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7ac00a5a0 con 0x7fa7b40b9140 2020-04-22T14:07:35.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.986+0000 7fa7bafed700 1 -- 172.21.15.103:0/1632130464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7b40b9140 msgr2=0x7fa7b412b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:35.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.986+0000 7fa7bafed700 1 --2- 172.21.15.103:0/1632130464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7b40b9140 0x7fa7b412b210 secure :-1 s=READY pgs=698 cs=0 l=1 rx=0x7fa7b40b6250 tx=0x7fa7ac007dc0).stop 2020-04-22T14:07:35.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.986+0000 7fa7bafed700 1 -- 172.21.15.103:0/1632130464 shutdown_connections 2020-04-22T14:07:35.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.986+0000 7fa7bafed700 1 --2- 172.21.15.103:0/1632130464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7b40b9140 0x7fa7b412b210 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:35.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.986+0000 7fa7bafed700 1 -- 172.21.15.103:0/1632130464 >> 172.21.15.103:0/1632130464 conn(0x7fa7b405b7b0 msgr2=0x7fa7b40b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:35.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.986+0000 7fa7bafed700 1 -- 172.21.15.103:0/1632130464 shutdown_connections 2020-04-22T14:07:35.997 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.986+0000 7fa7bafed700 1 -- 172.21.15.103:0/1632130464 wait complete. 2020-04-22T14:07:36.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.987+0000 7fa7bafed700 1 Processor -- start 2020-04-22T14:07:36.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.987+0000 7fa7bafed700 1 -- start start 2020-04-22T14:07:36.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.988+0000 7fa7bafed700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa7b40b9140 0x7fa7b40b5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:36.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.988+0000 7fa7bafed700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7b412b670 0x7fa7b4142ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:36.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.988+0000 7fa7bafed700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7b4066060 con 0x7fa7b40ac950 2020-04-22T14:07:36.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.988+0000 7fa7bafed700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7b4155e90 con 0x7fa7b40b9140 2020-04-22T14:07:36.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.988+0000 7fa7bafed700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b4066300 con 0x7fa7b412b670 2020-04-22T14:07:36.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.988+0000 7fa7b3fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa7b40b9140 0x7fa7b40b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:36.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.988+0000 7fa7b8d89700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa7b40ac950 0x7fa7b40b1900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42626/0 (socket says 172.21.15.103:42626) 2020-04-22T14:07:36.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.988+0000 7fa7b8d89700 1 -- 172.21.15.103:0/3920901038 learned_addr learned my addr 172.21.15.103:0/3920901038 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:36.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.988+0000 7fa7b958a700 1 --2- 172.21.15.103:0/3920901038 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7b412b670 0x7fa7b4142ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:36.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.988+0000 7fa7b1ffb700 1 -- 172.21.15.103:0/3920901038 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3871670708 0 0) 0x7fa7b4066060 con 0x7fa7b40ac950 2020-04-22T14:07:36.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.988+0000 7fa7b3fff700 1 -- 172.21.15.103:0/3920901038 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7b412b670 msgr2=0x7fa7b4142ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:36.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.988+0000 7fa7b3fff700 1 --2- 172.21.15.103:0/3920901038 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7b412b670 0x7fa7b4142ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:36.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.988+0000 7fa7b3fff700 1 -- 172.21.15.103:0/3920901038 >> v1:172.21.15.103:6789/0 conn(0x7fa7b40ac950 legacy=0x7fa7b40b1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:36.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.988+0000 7fa7b3fff700 1 -- 172.21.15.103:0/3920901038 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b40665a0 con 0x7fa7b40b9140 2020-04-22T14:07:36.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.988+0000 7fa7b3fff700 1 --2- 172.21.15.103:0/3920901038 >> v2:172.21.15.103:3300/0 conn(0x7fa7b40b9140 0x7fa7b40b5710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa7a8001f50 tx=0x7fa7a8010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.988+0000 7fa7b3fff700 1 --2- 172.21.15.103:0/3920901038 >> v2:172.21.15.103:3300/0 conn(0x7fa7b40b9140 0x7fa7b40b5710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa7a8001f50 tx=0x7fa7a8010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.988+0000 7fa7b3fff700 1 --2- 172.21.15.103:0/3920901038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7b40b9140 0x7fa7b40b5710 secure :-1 s=READY pgs=700 cs=0 l=1 rx=0x7fa7a8001f50 tx=0x7fa7a8010850).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:36.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.988+0000 7fa7b3fff700 1 --2- 172.21.15.103:0/3920901038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7b40b9140 0x7fa7b40b5710 secure :-1 s=THROTTLE_DONE pgs=700 cs=0 l=1 rx=0x7fa7a8001f50 tx=0x7fa7a8010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.988+0000 7fa7b1ffb700 1 -- 172.21.15.103:0/3920901038 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7a8006bc0 con 0x7fa7b40b9140 2020-04-22T14:07:36.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.988+0000 7fa7b3fff700 1 --2- 172.21.15.103:0/3920901038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7b40b9140 0x7fa7b40b5710 secure :-1 s=THROTTLE_DONE pgs=700 cs=0 l=1 rx=0x7fa7a8001f50 tx=0x7fa7a8010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.988+0000 7fa7b3fff700 1 --2- 172.21.15.103:0/3920901038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7b40b9140 0x7fa7b40b5710 secure :-1 s=THROTTLE_DONE pgs=700 cs=0 l=1 rx=0x7fa7a8001f50 tx=0x7fa7a8010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.989+0000 7fa7b1ffb700 1 -- 172.21.15.103:0/3920901038 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a8006d60 con 0x7fa7b40b9140 2020-04-22T14:07:36.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.989+0000 7fa7bafed700 1 -- 172.21.15.103:0/3920901038 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7b4143320 con 0x7fa7b40b9140 2020-04-22T14:07:36.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.989+0000 7fa7b1ffb700 1 -- 172.21.15.103:0/3920901038 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7a8008370 con 0x7fa7b40b9140 2020-04-22T14:07:36.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.989+0000 7fa7bafed700 1 -- 172.21.15.103:0/3920901038 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7b40b5ec0 con 0x7fa7b40b9140 2020-04-22T14:07:36.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.989+0000 7fa7b3fff700 1 --2- 172.21.15.103:0/3920901038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7b40b9140 0x7fa7b40b5710 secure :-1 s=THROTTLE_DONE pgs=700 cs=0 l=1 rx=0x7fa7a8001f50 tx=0x7fa7a8010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.989+0000 7fa7bafed700 1 -- 172.21.15.103:0/3920901038 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7b4056c90 con 0x7fa7b40b9140 2020-04-22T14:07:36.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.990+0000 7fa7b1ffb700 1 -- 172.21.15.103:0/3920901038 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fa7a80085b0 con 0x7fa7b40b9140 2020-04-22T14:07:36.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.990+0000 7fa7b3fff700 1 --2- 172.21.15.103:0/3920901038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7b40b9140 0x7fa7b40b5710 secure :-1 s=THROTTLE_DONE pgs=700 cs=0 l=1 rx=0x7fa7a8001f50 tx=0x7fa7a8010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.990+0000 7fa7b1ffb700 1 --2- 172.21.15.103:0/3920901038 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa79404d870 0x7fa79404fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:36.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.990+0000 7fa7b1ffb700 1 -- 172.21.15.103:0/3920901038 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa7a8061570 con 0x7fa7b40b9140 2020-04-22T14:07:36.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.990+0000 7fa7b8d89700 1 --2- 172.21.15.103:0/3920901038 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa79404d870 0x7fa79404fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:36.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.990+0000 7fa7b8d89700 1 --2- 172.21.15.103:0/3920901038 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa79404d870 0x7fa79404fd30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa7ac008660 tx=0x7fa7ac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.990+0000 7fa7b8d89700 1 --2- 172.21.15.103:0/3920901038 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa79404d870 0x7fa79404fd30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa7ac008660 tx=0x7fa7ac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.990+0000 7fa7b8d89700 1 --2- 172.21.15.103:0/3920901038 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa79404d870 0x7fa79404fd30 secure :-1 s=READY pgs=268 cs=0 l=1 rx=0x7fa7ac008660 tx=0x7fa7ac007dc0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:36.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.994+0000 7fa7b3fff700 1 --2- 172.21.15.103:0/3920901038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7b40b9140 0x7fa7b40b5710 secure :-1 s=THROTTLE_DONE pgs=700 cs=0 l=1 rx=0x7fa7a8001f50 tx=0x7fa7a8010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:35.994+0000 7fa7b1ffb700 1 -- 172.21.15.103:0/3920901038 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fa7a803c8f0 con 0x7fa7b40b9140 2020-04-22T14:07:36.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.136+0000 7fa7bafed700 1 -- 172.21.15.103:0/3920901038 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa7b406a960 con 0x7fa7b40b9140 2020-04-22T14:07:36.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.136+0000 7fa7b3fff700 1 --2- 172.21.15.103:0/3920901038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7b40b9140 0x7fa7b40b5710 secure :-1 s=THROTTLE_DONE pgs=700 cs=0 l=1 rx=0x7fa7a8001f50 tx=0x7fa7a8010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.136+0000 7fa7b1ffb700 1 -- 172.21.15.103:0/3920901038 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v54) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa7a803ff10 con 0x7fa7b40b9140 2020-04-22T14:07:36.139 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:07:36.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.137+0000 7fa7bafed700 1 -- 172.21.15.103:0/3920901038 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa79404d870 msgr2=0x7fa79404fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:36.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.137+0000 7fa7bafed700 1 --2- 172.21.15.103:0/3920901038 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa79404d870 0x7fa79404fd30 secure :-1 s=READY pgs=268 cs=0 l=1 rx=0x7fa7ac008660 tx=0x7fa7ac007dc0).stop 2020-04-22T14:07:36.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.137+0000 7fa7bafed700 1 -- 172.21.15.103:0/3920901038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7b40b9140 msgr2=0x7fa7b40b5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:36.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.137+0000 7fa7bafed700 1 --2- 172.21.15.103:0/3920901038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7b40b9140 0x7fa7b40b5710 secure :-1 s=READY pgs=700 cs=0 l=1 rx=0x7fa7a8001f50 tx=0x7fa7a8010850).stop 2020-04-22T14:07:36.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.137+0000 7fa7bafed700 1 -- 172.21.15.103:0/3920901038 shutdown_connections 2020-04-22T14:07:36.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.137+0000 7fa7bafed700 1 --2- 172.21.15.103:0/3920901038 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa79404d870 0x7fa79404fd30 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:36.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.137+0000 7fa7bafed700 1 --2- 172.21.15.103:0/3920901038 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7b412b670 0x7fa7b4142ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:36.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.137+0000 7fa7bafed700 1 --2- 172.21.15.103:0/3920901038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7b40b9140 0x7fa7b40b5710 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:36.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.137+0000 7fa7bafed700 1 -- 172.21.15.103:0/3920901038 >> 172.21.15.103:0/3920901038 conn(0x7fa7b405b7b0 msgr2=0x7fa7b40af0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:36.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.137+0000 7fa7bafed700 1 -- 172.21.15.103:0/3920901038 shutdown_connections 2020-04-22T14:07:36.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.137+0000 7fa7bafed700 1 -- 172.21.15.103:0/3920901038 wait complete. 2020-04-22T14:07:36.150 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:36.163 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-22T14:07:36.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.310+0000 7f48ad6cd700 1 Processor -- start 2020-04-22T14:07:36.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.310+0000 7f48ad6cd700 1 -- start start 2020-04-22T14:07:36.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.310+0000 7f48ad6cd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f48a8061870 0x7f48a80b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:36.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.310+0000 7f48ad6cd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48a81463e0 0x7f48a8146850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:36.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.311+0000 7f48ad6cd700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a80af250 con 0x7f48a80620c0 2020-04-22T14:07:36.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.311+0000 7f48ad6cd700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48a80af4f0 con 0x7f48a8061870 2020-04-22T14:07:36.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.311+0000 7f48ad6cd700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a8061c50 con 0x7f48a81463e0 2020-04-22T14:07:36.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.311+0000 7f48a7fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f48a8061870 0x7f48a80b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:36.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.311+0000 7f48a77fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f48a80620c0 0x7f48a8145cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42634/0 (socket says 172.21.15.103:42634) 2020-04-22T14:07:36.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.311+0000 7f48a7fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f48a8061870 0x7f48a80b2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50444/0 (socket says 172.21.15.103:50444) 2020-04-22T14:07:36.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.311+0000 7f48a77fe700 1 -- 172.21.15.103:0/4234263515 learned_addr learned my addr 172.21.15.103:0/4234263515 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:36.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.311+0000 7f48acecc700 1 --2- 172.21.15.103:0/4234263515 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48a81463e0 0x7f48a8146850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:36.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.311+0000 7f48a7fff700 1 -- 172.21.15.103:0/4234263515 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48a81463e0 msgr2=0x7f48a8146850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:36.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.311+0000 7f48a7fff700 1 --2- 172.21.15.103:0/4234263515 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48a81463e0 0x7f48a8146850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:36.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.311+0000 7f48a7fff700 1 -- 172.21.15.103:0/4234263515 >> v1:172.21.15.103:6789/0 conn(0x7f48a80620c0 legacy=0x7f48a8145cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:36.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.311+0000 7f48a6ffd700 1 -- 172.21.15.103:0/4234263515 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1107339552 0 0) 0x7f48a80af250 con 0x7f48a80620c0 2020-04-22T14:07:36.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.311+0000 7f48a7fff700 1 -- 172.21.15.103:0/4234263515 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a80ad360 con 0x7f48a8061870 2020-04-22T14:07:36.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.311+0000 7f48a7fff700 1 --2- 172.21.15.103:0/4234263515 >> v2:172.21.15.103:3300/0 conn(0x7f48a8061870 0x7f48a80b2590 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4898002f30 tx=0x7f4898007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.311+0000 7f48a7fff700 1 --2- 172.21.15.103:0/4234263515 >> v2:172.21.15.103:3300/0 conn(0x7f48a8061870 0x7f48a80b2590 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4898002f30 tx=0x7f4898007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.311+0000 7f48a7fff700 1 --2- 172.21.15.103:0/4234263515 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48a8061870 0x7f48a80b2590 secure :-1 s=READY pgs=702 cs=0 l=1 rx=0x7f4898002f30 tx=0x7f4898007a40).ready entity=mon.1 client_cookie=56dfd8b4289a6163 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:36.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.311+0000 7f48a7fff700 1 --2- 172.21.15.103:0/4234263515 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48a8061870 0x7f48a80b2590 secure :-1 s=THROTTLE_DONE pgs=702 cs=0 l=1 rx=0x7f4898002f30 tx=0x7f4898007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.311+0000 7f48a6ffd700 1 -- 172.21.15.103:0/4234263515 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4898011470 con 0x7f48a8061870 2020-04-22T14:07:36.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.311+0000 7f48a7fff700 1 --2- 172.21.15.103:0/4234263515 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48a8061870 0x7f48a80b2590 secure :-1 s=THROTTLE_DONE pgs=702 cs=0 l=1 rx=0x7f4898002f30 tx=0x7f4898007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.311+0000 7f48a7fff700 1 --2- 172.21.15.103:0/4234263515 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48a8061870 0x7f48a80b2590 secure :-1 s=THROTTLE_DONE pgs=702 cs=0 l=1 rx=0x7f4898002f30 tx=0x7f4898007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.311+0000 7f48a6ffd700 1 -- 172.21.15.103:0/4234263515 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4898011610 con 0x7f48a8061870 2020-04-22T14:07:36.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.311+0000 7f48a6ffd700 1 -- 172.21.15.103:0/4234263515 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48980119f0 con 0x7f48a8061870 2020-04-22T14:07:36.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.311+0000 7f48ad6cd700 1 -- 172.21.15.103:0/4234263515 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48a8061870 msgr2=0x7f48a80b2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:36.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.311+0000 7f48ad6cd700 1 --2- 172.21.15.103:0/4234263515 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48a8061870 0x7f48a80b2590 secure :-1 s=READY pgs=702 cs=0 l=1 rx=0x7f4898002f30 tx=0x7f4898007a40).stop 2020-04-22T14:07:36.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.312+0000 7f48ad6cd700 1 -- 172.21.15.103:0/4234263515 shutdown_connections 2020-04-22T14:07:36.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.312+0000 7f48ad6cd700 1 --2- 172.21.15.103:0/4234263515 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48a81463e0 0x7f48a8146850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:36.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.312+0000 7f48ad6cd700 1 --2- 172.21.15.103:0/4234263515 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48a8061870 0x7f48a80b2590 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:36.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.312+0000 7f48ad6cd700 1 -- 172.21.15.103:0/4234263515 >> 172.21.15.103:0/4234263515 conn(0x7f48a805b780 msgr2=0x7f48a80b8530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:36.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.312+0000 7f48ad6cd700 1 -- 172.21.15.103:0/4234263515 shutdown_connections 2020-04-22T14:07:36.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.312+0000 7f48ad6cd700 1 -- 172.21.15.103:0/4234263515 wait complete. 2020-04-22T14:07:36.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.313+0000 7f48ad6cd700 1 Processor -- start 2020-04-22T14:07:36.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.313+0000 7f48ad6cd700 1 -- start start 2020-04-22T14:07:36.324 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.314+0000 7f48ad6cd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f48a8061870 0x7f48a8111510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:36.324 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.314+0000 7f48ad6cd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48a80620c0 0x7f48a80b1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:36.324 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.314+0000 7f48ad6cd700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a80b17a0 con 0x7f48a81463e0 2020-04-22T14:07:36.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.314+0000 7f48ad6cd700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48a8133fd0 con 0x7f48a8061870 2020-04-22T14:07:36.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.314+0000 7f48ad6cd700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a80b5950 con 0x7f48a80620c0 2020-04-22T14:07:36.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.314+0000 7f48acecc700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f48a81463e0 0x7f48a8062850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42644/0 (socket says 172.21.15.103:42644) 2020-04-22T14:07:36.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.314+0000 7f48acecc700 1 -- 172.21.15.103:0/2622102572 learned_addr learned my addr 172.21.15.103:0/2622102572 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:36.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.314+0000 7f48a77fe700 1 --2- 172.21.15.103:0/2622102572 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48a80620c0 0x7f48a80b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:36.326 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.314+0000 7f48a7fff700 1 --2- 172.21.15.103:0/2622102572 >> v2:172.21.15.86:3300/0 conn(0x7f48a8061870 0x7f48a8111510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:36.326 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.314+0000 7f48a57fa700 1 -- 172.21.15.103:0/2622102572 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3503766204 0 0) 0x7f48a0001260 con 0x7f48a81463e0 2020-04-22T14:07:36.326 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.314+0000 7f48a57fa700 1 -- 172.21.15.103:0/2622102572 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4888002fe0 con 0x7f48a81463e0 2020-04-22T14:07:36.326 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.314+0000 7f48a57fa700 1 -- 172.21.15.103:0/2622102572 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2630233159 0 0) 0x7f4888002fe0 con 0x7f48a81463e0 2020-04-22T14:07:36.326 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.314+0000 7f48a77fe700 1 -- 172.21.15.103:0/2622102572 >> v2:172.21.15.86:3300/0 conn(0x7f48a8061870 msgr2=0x7f48a8111510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:36.326 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.314+0000 7f48a77fe700 1 --2- 172.21.15.103:0/2622102572 >> v2:172.21.15.86:3300/0 conn(0x7f48a8061870 0x7f48a8111510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:36.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.314+0000 7f48a77fe700 1 -- 172.21.15.103:0/2622102572 >> v1:172.21.15.103:6789/0 conn(0x7f48a81463e0 legacy=0x7f48a8062850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:36.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.314+0000 7f48a77fe700 1 -- 172.21.15.103:0/2622102572 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a80b5bf0 con 0x7f48a80620c0 2020-04-22T14:07:36.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.314+0000 7f48a77fe700 1 --2- 172.21.15.103:0/2622102572 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48a80620c0 0x7f48a80b1340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f48a0001c10 tx=0x7f489c0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.314+0000 7f48a77fe700 1 --2- 172.21.15.103:0/2622102572 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48a80620c0 0x7f48a80b1340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f48a0001c10 tx=0x7f489c0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.314+0000 7f48a77fe700 1 --2- 172.21.15.103:0/2622102572 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48a80620c0 0x7f48a80b1340 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7f48a0001c10 tx=0x7f489c0108c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:36.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.314+0000 7f48a77fe700 1 --2- 172.21.15.103:0/2622102572 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48a80620c0 0x7f48a80b1340 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f48a0001c10 tx=0x7f489c0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.314+0000 7f48a57fa700 1 -- 172.21.15.103:0/2622102572 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48a0001a70 con 0x7f48a80620c0 2020-04-22T14:07:36.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.314+0000 7f48a77fe700 1 --2- 172.21.15.103:0/2622102572 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48a80620c0 0x7f48a80b1340 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f48a0001c10 tx=0x7f489c0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.314+0000 7f48a77fe700 1 --2- 172.21.15.103:0/2622102572 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48a80620c0 0x7f48a80b1340 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f48a0001c10 tx=0x7f489c0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.314+0000 7f48a57fa700 1 -- 172.21.15.103:0/2622102572 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489c005ab0 con 0x7f48a80620c0 2020-04-22T14:07:36.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.315+0000 7f48ad6cd700 1 -- 172.21.15.103:0/2622102572 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48a80b5640 con 0x7f48a80620c0 2020-04-22T14:07:36.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.315+0000 7f48a57fa700 1 -- 172.21.15.103:0/2622102572 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f489c005e10 con 0x7f48a80620c0 2020-04-22T14:07:36.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.315+0000 7f48ad6cd700 1 -- 172.21.15.103:0/2622102572 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48a80b5460 con 0x7f48a80620c0 2020-04-22T14:07:36.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.315+0000 7f48a77fe700 1 --2- 172.21.15.103:0/2622102572 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48a80620c0 0x7f48a80b1340 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f48a0001c10 tx=0x7f489c0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.315+0000 7f48ad6cd700 1 -- 172.21.15.103:0/2622102572 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48a8056c90 con 0x7f48a80620c0 2020-04-22T14:07:36.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.315+0000 7f48a57fa700 1 -- 172.21.15.103:0/2622102572 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f489c011d70 con 0x7f48a80620c0 2020-04-22T14:07:36.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.316+0000 7f48a77fe700 1 --2- 172.21.15.103:0/2622102572 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48a80620c0 0x7f48a80b1340 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f48a0001c10 tx=0x7f489c0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.316+0000 7f48a57fa700 1 --2- 172.21.15.103:0/2622102572 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f488804dc70 0x7f4888050130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:36.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.316+0000 7f48a57fa700 1 -- 172.21.15.103:0/2622102572 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f489c0090c0 con 0x7f48a80620c0 2020-04-22T14:07:36.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.316+0000 7f48a7fff700 1 --2- 172.21.15.103:0/2622102572 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f488804dc70 0x7f4888050130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:36.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.316+0000 7f48a7fff700 1 --2- 172.21.15.103:0/2622102572 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f488804dc70 0x7f4888050130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4898002f30 tx=0x7f4898007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.316+0000 7f48a7fff700 1 --2- 172.21.15.103:0/2622102572 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f488804dc70 0x7f4888050130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4898002f30 tx=0x7f4898007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.316+0000 7f48a7fff700 1 --2- 172.21.15.103:0/2622102572 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f488804dc70 0x7f4888050130 secure :-1 s=READY pgs=269 cs=0 l=1 rx=0x7f4898002f30 tx=0x7f4898007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:36.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.319+0000 7f48a77fe700 1 --2- 172.21.15.103:0/2622102572 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48a80620c0 0x7f48a80b1340 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f48a0001c10 tx=0x7f489c0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.319+0000 7f48a57fa700 1 -- 172.21.15.103:0/2622102572 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f489c03c1d0 con 0x7f48a80620c0 2020-04-22T14:07:36.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.463+0000 7f48ad6cd700 1 -- 172.21.15.103:0/2622102572 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f48a805cc80 con 0x7f48a80620c0 2020-04-22T14:07:36.466 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.464+0000 7f48a77fe700 1 --2- 172.21.15.103:0/2622102572 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48a80620c0 0x7f48a80b1340 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f48a0001c10 tx=0x7f489c0108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.466 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.464+0000 7f48a57fa700 1 -- 172.21.15.103:0/2622102572 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+10 (secure 0 0 0) 0x7f489c03f7f0 con 0x7f48a80620c0 2020-04-22T14:07:36.466 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:07:36.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.465+0000 7f48ad6cd700 1 -- 172.21.15.103:0/2622102572 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f488804dc70 msgr2=0x7f4888050130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:36.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.465+0000 7f48ad6cd700 1 --2- 172.21.15.103:0/2622102572 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f488804dc70 0x7f4888050130 secure :-1 s=READY pgs=269 cs=0 l=1 rx=0x7f4898002f30 tx=0x7f4898007a40).stop 2020-04-22T14:07:36.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.465+0000 7f48ad6cd700 1 -- 172.21.15.103:0/2622102572 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48a80620c0 msgr2=0x7f48a80b1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:36.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.465+0000 7f48ad6cd700 1 --2- 172.21.15.103:0/2622102572 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48a80620c0 0x7f48a80b1340 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7f48a0001c10 tx=0x7f489c0108c0).stop 2020-04-22T14:07:36.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.465+0000 7f48ad6cd700 1 -- 172.21.15.103:0/2622102572 shutdown_connections 2020-04-22T14:07:36.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.465+0000 7f48ad6cd700 1 --2- 172.21.15.103:0/2622102572 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f488804dc70 0x7f4888050130 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:36.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.465+0000 7f48ad6cd700 1 --2- 172.21.15.103:0/2622102572 >> v2:172.21.15.86:3300/0 conn(0x7f48a8061870 0x7f48a8111510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:36.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.465+0000 7f48ad6cd700 1 --2- 172.21.15.103:0/2622102572 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48a80620c0 0x7f48a80b1340 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:36.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.465+0000 7f48ad6cd700 1 -- 172.21.15.103:0/2622102572 >> 172.21.15.103:0/2622102572 conn(0x7f48a805b780 msgr2=0x7f48a80b6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:36.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.465+0000 7f48ad6cd700 1 -- 172.21.15.103:0/2622102572 shutdown_connections 2020-04-22T14:07:36.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.465+0000 7f48ad6cd700 1 -- 172.21.15.103:0/2622102572 wait complete. 2020-04-22T14:07:36.478 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:36.496 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-22T14:07:36.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.643+0000 7f9066c4f700 1 Processor -- start 2020-04-22T14:07:36.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.643+0000 7f9066c4f700 1 -- start start 2020-04-22T14:07:36.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.644+0000 7f9066c4f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9060061870 0x7f90600b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:36.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.644+0000 7f9066c4f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f90601463e0 0x7f9060146800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:36.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.644+0000 7f9066c4f700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90600af250 con 0x7f90600620c0 2020-04-22T14:07:36.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.644+0000 7f9066c4f700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90600af4f0 con 0x7f90601463e0 2020-04-22T14:07:36.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.644+0000 7f9066c4f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9060061c50 con 0x7f9060061870 2020-04-22T14:07:36.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.644+0000 7f9065c4d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9060061870 0x7f90600b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:36.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.644+0000 7f9065c4d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9060061870 0x7f90600b2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50458/0 (socket says 172.21.15.103:50458) 2020-04-22T14:07:36.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.644+0000 7f906544c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f90600620c0 0x7f9060145cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42648/0 (socket says 172.21.15.103:42648) 2020-04-22T14:07:36.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.644+0000 7f9065c4d700 1 -- 172.21.15.103:0/1860122293 learned_addr learned my addr 172.21.15.103:0/1860122293 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:36.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.644+0000 7f906644e700 1 --2- 172.21.15.103:0/1860122293 >> v2:172.21.15.86:3300/0 conn(0x7f90601463e0 0x7f9060146800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:36.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.644+0000 7f9065c4d700 1 -- 172.21.15.103:0/1860122293 >> v2:172.21.15.86:3300/0 conn(0x7f90601463e0 msgr2=0x7f9060146800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:36.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.644+0000 7f9065c4d700 1 --2- 172.21.15.103:0/1860122293 >> v2:172.21.15.86:3300/0 conn(0x7f90601463e0 0x7f9060146800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:36.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.644+0000 7f9065c4d700 1 -- 172.21.15.103:0/1860122293 >> v1:172.21.15.103:6789/0 conn(0x7f90600620c0 legacy=0x7f9060145cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:36.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.644+0000 7f9064c4b700 1 -- 172.21.15.103:0/1860122293 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1275055278 0 0) 0x7f90600af250 con 0x7f90600620c0 2020-04-22T14:07:36.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.644+0000 7f9065c4d700 1 -- 172.21.15.103:0/1860122293 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90600ad360 con 0x7f9060061870 2020-04-22T14:07:36.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.645+0000 7f9065c4d700 1 --2- 172.21.15.103:0/1860122293 >> v2:172.21.15.103:3300/0 conn(0x7f9060061870 0x7f90600b2590 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9050002f30 tx=0x7f9050007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.645+0000 7f9065c4d700 1 --2- 172.21.15.103:0/1860122293 >> v2:172.21.15.103:3300/0 conn(0x7f9060061870 0x7f90600b2590 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9050002f30 tx=0x7f9050007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.645+0000 7f9065c4d700 1 --2- 172.21.15.103:0/1860122293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9060061870 0x7f90600b2590 secure :-1 s=READY pgs=705 cs=0 l=1 rx=0x7f9050002f30 tx=0x7f9050007a40).ready entity=mon.1 client_cookie=5b963acfd986d4ab server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:36.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.645+0000 7f9065c4d700 1 --2- 172.21.15.103:0/1860122293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9060061870 0x7f90600b2590 secure :-1 s=THROTTLE_DONE pgs=705 cs=0 l=1 rx=0x7f9050002f30 tx=0x7f9050007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.645+0000 7f9064c4b700 1 -- 172.21.15.103:0/1860122293 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9050011720 con 0x7f9060061870 2020-04-22T14:07:36.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.645+0000 7f9065c4d700 1 --2- 172.21.15.103:0/1860122293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9060061870 0x7f90600b2590 secure :-1 s=THROTTLE_DONE pgs=705 cs=0 l=1 rx=0x7f9050002f30 tx=0x7f9050007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.645+0000 7f9065c4d700 1 --2- 172.21.15.103:0/1860122293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9060061870 0x7f90600b2590 secure :-1 s=THROTTLE_DONE pgs=705 cs=0 l=1 rx=0x7f9050002f30 tx=0x7f9050007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.645+0000 7f9064c4b700 1 -- 172.21.15.103:0/1860122293 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9050011880 con 0x7f9060061870 2020-04-22T14:07:36.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.645+0000 7f9064c4b700 1 -- 172.21.15.103:0/1860122293 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9050011c60 con 0x7f9060061870 2020-04-22T14:07:36.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.645+0000 7f9066c4f700 1 -- 172.21.15.103:0/1860122293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9060061870 msgr2=0x7f90600b2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:36.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.645+0000 7f9066c4f700 1 --2- 172.21.15.103:0/1860122293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9060061870 0x7f90600b2590 secure :-1 s=READY pgs=705 cs=0 l=1 rx=0x7f9050002f30 tx=0x7f9050007a40).stop 2020-04-22T14:07:36.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.645+0000 7f9066c4f700 1 -- 172.21.15.103:0/1860122293 shutdown_connections 2020-04-22T14:07:36.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.645+0000 7f9066c4f700 1 --2- 172.21.15.103:0/1860122293 >> v2:172.21.15.86:3300/0 conn(0x7f90601463e0 0x7f9060146800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:36.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.645+0000 7f9066c4f700 1 --2- 172.21.15.103:0/1860122293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9060061870 0x7f90600b2590 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:36.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.645+0000 7f9066c4f700 1 -- 172.21.15.103:0/1860122293 >> 172.21.15.103:0/1860122293 conn(0x7f906005b780 msgr2=0x7f90600b8530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:36.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.645+0000 7f9066c4f700 1 -- 172.21.15.103:0/1860122293 shutdown_connections 2020-04-22T14:07:36.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.645+0000 7f9066c4f700 1 -- 172.21.15.103:0/1860122293 wait complete. 2020-04-22T14:07:36.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.646+0000 7f9066c4f700 1 Processor -- start 2020-04-22T14:07:36.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.646+0000 7f9066c4f700 1 -- start start 2020-04-22T14:07:36.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.647+0000 7f9066c4f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9060061870 0x7f9060064de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:36.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.647+0000 7f9066c4f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90600620c0 0x7f90601454f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:36.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.647+0000 7f9066c4f700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9060065240 con 0x7f90601463e0 2020-04-22T14:07:36.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.647+0000 7f9066c4f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f906013e220 con 0x7f9060061870 2020-04-22T14:07:36.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.647+0000 7f9066c4f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9060143000 con 0x7f90600620c0 2020-04-22T14:07:36.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.647+0000 7f9065c4d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9060061870 0x7f9060064de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:36.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.647+0000 7f9065c4d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9060061870 0x7f9060064de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50462/0 (socket says 172.21.15.103:50462) 2020-04-22T14:07:36.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.647+0000 7f9065c4d700 1 -- 172.21.15.103:0/456921076 learned_addr learned my addr 172.21.15.103:0/456921076 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:36.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.647+0000 7f906544c700 1 --2- 172.21.15.103:0/456921076 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90600620c0 0x7f90601454f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:36.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.647+0000 7f9065c4d700 1 -- 172.21.15.103:0/456921076 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90600620c0 msgr2=0x7f90601454f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:36.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.647+0000 7f904effd700 1 -- 172.21.15.103:0/456921076 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2055970939 0 0) 0x7f9058001210 con 0x7f90601463e0 2020-04-22T14:07:36.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.647+0000 7f9065c4d700 1 --2- 172.21.15.103:0/456921076 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90600620c0 0x7f90601454f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:36.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.647+0000 7f9065c4d700 1 -- 172.21.15.103:0/456921076 >> v1:172.21.15.103:6789/0 conn(0x7f90601463e0 legacy=0x7f9060065d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:36.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.647+0000 7f9065c4d700 1 -- 172.21.15.103:0/456921076 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90601432a0 con 0x7f9060061870 2020-04-22T14:07:36.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.647+0000 7f9065c4d700 1 --2- 172.21.15.103:0/456921076 >> v2:172.21.15.103:3300/0 conn(0x7f9060061870 0x7f9060064de0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9050002f30 tx=0x7f9050007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.647+0000 7f9065c4d700 1 --2- 172.21.15.103:0/456921076 >> v2:172.21.15.103:3300/0 conn(0x7f9060061870 0x7f9060064de0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9050002f30 tx=0x7f9050007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.647+0000 7f9065c4d700 1 --2- 172.21.15.103:0/456921076 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9060061870 0x7f9060064de0 secure :-1 s=READY pgs=707 cs=0 l=1 rx=0x7f9050002f30 tx=0x7f9050007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:36.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.648+0000 7f9065c4d700 1 --2- 172.21.15.103:0/456921076 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9060061870 0x7f9060064de0 secure :-1 s=THROTTLE_DONE pgs=707 cs=0 l=1 rx=0x7f9050002f30 tx=0x7f9050007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.648+0000 7f904effd700 1 -- 172.21.15.103:0/456921076 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9050007360 con 0x7f9060061870 2020-04-22T14:07:36.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.648+0000 7f9065c4d700 1 --2- 172.21.15.103:0/456921076 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9060061870 0x7f9060064de0 secure :-1 s=THROTTLE_DONE pgs=707 cs=0 l=1 rx=0x7f9050002f30 tx=0x7f9050007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.648+0000 7f9065c4d700 1 --2- 172.21.15.103:0/456921076 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9060061870 0x7f9060064de0 secure :-1 s=THROTTLE_DONE pgs=707 cs=0 l=1 rx=0x7f9050002f30 tx=0x7f9050007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.648+0000 7f904effd700 1 -- 172.21.15.103:0/456921076 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90500074c0 con 0x7f9060061870 2020-04-22T14:07:36.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.648+0000 7f904effd700 1 -- 172.21.15.103:0/456921076 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90500058b0 con 0x7f9060061870 2020-04-22T14:07:36.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.648+0000 7f9066c4f700 1 -- 172.21.15.103:0/456921076 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9060143540 con 0x7f9060061870 2020-04-22T14:07:36.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.648+0000 7f9066c4f700 1 -- 172.21.15.103:0/456921076 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9060145a10 con 0x7f9060061870 2020-04-22T14:07:36.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.648+0000 7f9065c4d700 1 --2- 172.21.15.103:0/456921076 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9060061870 0x7f9060064de0 secure :-1 s=THROTTLE_DONE pgs=707 cs=0 l=1 rx=0x7f9050002f30 tx=0x7f9050007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.649+0000 7f9066c4f700 1 -- 172.21.15.103:0/456921076 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9060056c90 con 0x7f9060061870 2020-04-22T14:07:36.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.649+0000 7f904effd700 1 -- 172.21.15.103:0/456921076 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f9050005b20 con 0x7f9060061870 2020-04-22T14:07:36.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.649+0000 7f9065c4d700 1 --2- 172.21.15.103:0/456921076 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9060061870 0x7f9060064de0 secure :-1 s=THROTTLE_DONE pgs=707 cs=0 l=1 rx=0x7f9050002f30 tx=0x7f9050007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.649+0000 7f904effd700 1 --2- 172.21.15.103:0/456921076 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f904004d860 0x7f904004fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:36.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.649+0000 7f904effd700 1 -- 172.21.15.103:0/456921076 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9050061be0 con 0x7f9060061870 2020-04-22T14:07:36.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.649+0000 7f906544c700 1 --2- 172.21.15.103:0/456921076 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f904004d860 0x7f904004fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:36.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.649+0000 7f906544c700 1 --2- 172.21.15.103:0/456921076 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f904004d860 0x7f904004fd20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f905c000b80 tx=0x7f905c0015a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.650+0000 7f906544c700 1 --2- 172.21.15.103:0/456921076 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f904004d860 0x7f904004fd20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f905c000b80 tx=0x7f905c0015a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.650+0000 7f906544c700 1 --2- 172.21.15.103:0/456921076 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f904004d860 0x7f904004fd20 secure :-1 s=READY pgs=270 cs=0 l=1 rx=0x7f905c000b80 tx=0x7f905c0015a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:36.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.653+0000 7f9065c4d700 1 --2- 172.21.15.103:0/456921076 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9060061870 0x7f9060064de0 secure :-1 s=THROTTLE_DONE pgs=707 cs=0 l=1 rx=0x7f9050002f30 tx=0x7f9050007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.653+0000 7f904effd700 1 -- 172.21.15.103:0/456921076 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f905003d0e0 con 0x7f9060061870 2020-04-22T14:07:36.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.796+0000 7f9066c4f700 1 -- 172.21.15.103:0/456921076 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f906006a8b0 con 0x7f9060061870 2020-04-22T14:07:36.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.796+0000 7f9065c4d700 1 --2- 172.21.15.103:0/456921076 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9060061870 0x7f9060064de0 secure :-1 s=THROTTLE_DONE pgs=707 cs=0 l=1 rx=0x7f9050002f30 tx=0x7f9050007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.797+0000 7f904effd700 1 -- 172.21.15.103:0/456921076 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+10 (secure 0 0 0) 0x7f9050040700 con 0x7f9060061870 2020-04-22T14:07:36.799 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:07:36.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.798+0000 7f9066c4f700 1 -- 172.21.15.103:0/456921076 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f904004d860 msgr2=0x7f904004fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:36.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.798+0000 7f9066c4f700 1 --2- 172.21.15.103:0/456921076 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f904004d860 0x7f904004fd20 secure :-1 s=READY pgs=270 cs=0 l=1 rx=0x7f905c000b80 tx=0x7f905c0015a0).stop 2020-04-22T14:07:36.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.798+0000 7f9066c4f700 1 -- 172.21.15.103:0/456921076 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9060061870 msgr2=0x7f9060064de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:36.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.798+0000 7f9066c4f700 1 --2- 172.21.15.103:0/456921076 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9060061870 0x7f9060064de0 secure :-1 s=READY pgs=707 cs=0 l=1 rx=0x7f9050002f30 tx=0x7f9050007a40).stop 2020-04-22T14:07:36.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.798+0000 7f9066c4f700 1 -- 172.21.15.103:0/456921076 shutdown_connections 2020-04-22T14:07:36.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.798+0000 7f9066c4f700 1 --2- 172.21.15.103:0/456921076 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f904004d860 0x7f904004fd20 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:36.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.798+0000 7f9066c4f700 1 --2- 172.21.15.103:0/456921076 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9060061870 0x7f9060064de0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:36.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.798+0000 7f9066c4f700 1 --2- 172.21.15.103:0/456921076 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90600620c0 0x7f90601454f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:36.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.798+0000 7f9066c4f700 1 -- 172.21.15.103:0/456921076 >> 172.21.15.103:0/456921076 conn(0x7f906005b780 msgr2=0x7f90600b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:36.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.798+0000 7f9066c4f700 1 -- 172.21.15.103:0/456921076 shutdown_connections 2020-04-22T14:07:36.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.798+0000 7f9066c4f700 1 -- 172.21.15.103:0/456921076 wait complete. 2020-04-22T14:07:36.810 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-04-22T14:07:36.810 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:36.824 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:07:36.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.968+0000 7fa676886700 1 Processor -- start 2020-04-22T14:07:36.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.968+0000 7fa676886700 1 -- start start 2020-04-22T14:07:36.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.969+0000 7fa676886700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa67005b7c0 0x7fa6700b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:36.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.969+0000 7fa676886700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa6701441f0 0x7fa670144820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:36.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.969+0000 7fa676886700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6700ae860 con 0x7fa670144c80 2020-04-22T14:07:36.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.969+0000 7fa676886700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6700b5900 con 0x7fa6701441f0 2020-04-22T14:07:36.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.969+0000 7fa676886700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6700b5ba0 con 0x7fa67005b7c0 2020-04-22T14:07:36.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.969+0000 7fa674e23700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa670144c80 0x7fa670147670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42660/0 (socket says 172.21.15.103:42660) 2020-04-22T14:07:36.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.969+0000 7fa674e23700 1 -- 172.21.15.103:0/2836223767 learned_addr learned my addr 172.21.15.103:0/2836223767 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:36.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.969+0000 7fa66f7fe700 1 --2- 172.21.15.103:0/2836223767 >> v2:172.21.15.86:3300/0 conn(0x7fa6701441f0 0x7fa670144820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:36.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.969+0000 7fa66ffff700 1 --2- 172.21.15.103:0/2836223767 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa67005b7c0 0x7fa6700b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:36.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.969+0000 7fa66effd700 1 -- 172.21.15.103:0/2836223767 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2461356705 0 0) 0x7fa6700ae860 con 0x7fa670144c80 2020-04-22T14:07:36.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.969+0000 7fa66effd700 1 -- 172.21.15.103:0/2836223767 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa65c003230 con 0x7fa670144c80 2020-04-22T14:07:36.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.970+0000 7fa66effd700 1 -- 172.21.15.103:0/2836223767 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 969345360 0 0) 0x7fa65c003230 con 0x7fa670144c80 2020-04-22T14:07:36.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.970+0000 7fa66effd700 1 -- 172.21.15.103:0/2836223767 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa67005b7c0 msgr2=0x7fa6700b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:36.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.970+0000 7fa66effd700 1 --2- 172.21.15.103:0/2836223767 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa67005b7c0 0x7fa6700b50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:36.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.970+0000 7fa66effd700 1 -- 172.21.15.103:0/2836223767 >> v2:172.21.15.86:3300/0 conn(0x7fa6701441f0 msgr2=0x7fa670144820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:36.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.970+0000 7fa66effd700 1 --2- 172.21.15.103:0/2836223767 >> v2:172.21.15.86:3300/0 conn(0x7fa6701441f0 0x7fa670144820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:36.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.970+0000 7fa66effd700 1 -- 172.21.15.103:0/2836223767 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6700b5e40 con 0x7fa670144c80 2020-04-22T14:07:36.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.970+0000 7fa66effd700 1 -- 172.21.15.103:0/2836223767 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fa668001a50 con 0x7fa670144c80 2020-04-22T14:07:36.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.970+0000 7fa66effd700 1 -- 172.21.15.103:0/2836223767 >> v1:172.21.15.103:6789/0 conn(0x7fa670144c80 legacy=0x7fa670147670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:36.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.970+0000 7fa66effd700 1 --2- 172.21.15.103:0/2836223767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa65c003720 0x7fa65c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:36.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.970+0000 7fa66effd700 1 --2- 172.21.15.103:0/2836223767 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa67005b7c0 0x7fa65c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:36.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.970+0000 7fa66effd700 1 --2- 172.21.15.103:0/2836223767 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa65c004930 0x7fa65c004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:36.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.970+0000 7fa66effd700 1 -- 172.21.15.103:0/2836223767 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6700b5900 con 0x7fa65c004930 2020-04-22T14:07:36.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.970+0000 7fa66effd700 1 -- 172.21.15.103:0/2836223767 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6700b5ba0 con 0x7fa65c003720 2020-04-22T14:07:36.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.970+0000 7fa66effd700 1 -- 172.21.15.103:0/2836223767 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c005380 con 0x7fa67005b7c0 2020-04-22T14:07:36.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.970+0000 7fa66ffff700 1 --2- 172.21.15.103:0/2836223767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa65c003720 0x7fa65c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:36.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.970+0000 7fa674e23700 1 --2- 172.21.15.103:0/2836223767 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa65c004930 0x7fa65c004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:36.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.970+0000 7fa66f7fe700 1 --2- 172.21.15.103:0/2836223767 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa67005b7c0 0x7fa65c0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:36.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.970+0000 7fa66ffff700 1 -- 172.21.15.103:0/2836223767 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa67005b7c0 msgr2=0x7fa65c0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:36.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.970+0000 7fa66ffff700 1 --2- 172.21.15.103:0/2836223767 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa67005b7c0 0x7fa65c0044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:36.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.970+0000 7fa66ffff700 1 -- 172.21.15.103:0/2836223767 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa65c004930 msgr2=0x7fa65c004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:36.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.970+0000 7fa66ffff700 1 --2- 172.21.15.103:0/2836223767 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa65c004930 0x7fa65c004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:36.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.970+0000 7fa66ffff700 1 -- 172.21.15.103:0/2836223767 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65c003230 con 0x7fa65c003720 2020-04-22T14:07:36.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.970+0000 7fa674e23700 1 --2- 172.21.15.103:0/2836223767 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa65c004930 0x7fa65c004db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:07:36.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.970+0000 7fa66f7fe700 1 --2- 172.21.15.103:0/2836223767 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa67005b7c0 0x7fa65c0044d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:07:36.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.970+0000 7fa66ffff700 1 --2- 172.21.15.103:0/2836223767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa65c003720 0x7fa65c003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa660002f30 tx=0x7fa6600100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.970+0000 7fa66ffff700 1 --2- 172.21.15.103:0/2836223767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa65c003720 0x7fa65c003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa660002f30 tx=0x7fa6600100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.970+0000 7fa66ffff700 1 --2- 172.21.15.103:0/2836223767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa65c003720 0x7fa65c003b40 secure :-1 s=READY pgs=709 cs=0 l=1 rx=0x7fa660002f30 tx=0x7fa6600100d0).ready entity=mon.1 client_cookie=98058716c5bc3921 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:36.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.970+0000 7fa66ffff700 1 --2- 172.21.15.103:0/2836223767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa65c003720 0x7fa65c003b40 secure :-1 s=THROTTLE_DONE pgs=709 cs=0 l=1 rx=0x7fa660002f30 tx=0x7fa6600100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.970+0000 7fa66ffff700 1 --2- 172.21.15.103:0/2836223767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa65c003720 0x7fa65c003b40 secure :-1 s=THROTTLE_DONE pgs=709 cs=0 l=1 rx=0x7fa660002f30 tx=0x7fa6600100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.970+0000 7fa66effd700 1 -- 172.21.15.103:0/2836223767 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa660010de0 con 0x7fa65c003720 2020-04-22T14:07:36.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.970+0000 7fa66ffff700 1 --2- 172.21.15.103:0/2836223767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa65c003720 0x7fa65c003b40 secure :-1 s=THROTTLE_DONE pgs=709 cs=0 l=1 rx=0x7fa660002f30 tx=0x7fa6600100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.970+0000 7fa66effd700 1 -- 172.21.15.103:0/2836223767 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa660008950 con 0x7fa65c003720 2020-04-22T14:07:36.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.970+0000 7fa66effd700 1 -- 172.21.15.103:0/2836223767 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa660008cf0 con 0x7fa65c003720 2020-04-22T14:07:36.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.970+0000 7fa676886700 1 -- 172.21.15.103:0/2836223767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa65c003720 msgr2=0x7fa65c003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:36.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.970+0000 7fa676886700 1 --2- 172.21.15.103:0/2836223767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa65c003720 0x7fa65c003b40 secure :-1 s=READY pgs=709 cs=0 l=1 rx=0x7fa660002f30 tx=0x7fa6600100d0).stop 2020-04-22T14:07:36.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.970+0000 7fa674e23700 1 -- 172.21.15.103:0/2836223767 reap_dead start 2020-04-22T14:07:36.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.971+0000 7fa676886700 1 -- 172.21.15.103:0/2836223767 shutdown_connections 2020-04-22T14:07:36.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.971+0000 7fa676886700 1 -- 172.21.15.103:0/2836223767 >> 172.21.15.103:0/2836223767 conn(0x7fa6700b9160 msgr2=0x7fa67005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:36.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.971+0000 7fa676886700 1 -- 172.21.15.103:0/2836223767 shutdown_connections 2020-04-22T14:07:36.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.971+0000 7fa676886700 1 -- 172.21.15.103:0/2836223767 wait complete. 2020-04-22T14:07:36.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.972+0000 7fa676886700 1 Processor -- start 2020-04-22T14:07:36.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.972+0000 7fa676886700 1 -- start start 2020-04-22T14:07:36.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.973+0000 7fa676886700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa670148aa0 0x7fa670151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:36.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.973+0000 7fa676886700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa670147980 con 0x7fa670155630 2020-04-22T14:07:36.991 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.973+0000 7fa676886700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa670147c20 con 0x7fa670140720 2020-04-22T14:07:36.991 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.973+0000 7fa676886700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa670140b00 con 0x7fa670148aa0 2020-04-22T14:07:36.991 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.973+0000 7fa66ffff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa670140720 0x7fa6701480c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42674/0 (socket says 172.21.15.103:42674) 2020-04-22T14:07:36.991 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.973+0000 7fa66ffff700 1 -- 172.21.15.103:0/2057921760 learned_addr learned my addr 172.21.15.103:0/2057921760 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:36.991 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.973+0000 7fa674e23700 1 --2- 172.21.15.103:0/2057921760 >> v2:172.21.15.86:3300/0 conn(0x7fa670148aa0 0x7fa670151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:36.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.973+0000 7fa66d7fa700 1 -- 172.21.15.103:0/2057921760 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1820475275 0 0) 0x7fa670147c20 con 0x7fa670140720 2020-04-22T14:07:36.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.973+0000 7fa66d7fa700 1 -- 172.21.15.103:0/2057921760 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa650002fe0 con 0x7fa670140720 2020-04-22T14:07:36.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.973+0000 7fa66d7fa700 1 -- 172.21.15.103:0/2057921760 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3449640830 0 0) 0x7fa650002fe0 con 0x7fa670140720 2020-04-22T14:07:36.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.973+0000 7fa674e23700 1 -- 172.21.15.103:0/2057921760 >> v1:172.21.15.103:6789/0 conn(0x7fa670140720 legacy=0x7fa6701480c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:36.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.973+0000 7fa674e23700 1 -- 172.21.15.103:0/2057921760 >> v1:172.21.15.86:6789/0 conn(0x7fa670155630 legacy=0x7fa67013cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:36.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.973+0000 7fa674e23700 1 -- 172.21.15.103:0/2057921760 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6701487d0 con 0x7fa670148aa0 2020-04-22T14:07:36.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.973+0000 7fa674e23700 1 --2- 172.21.15.103:0/2057921760 >> v2:172.21.15.86:3300/0 conn(0x7fa670148aa0 0x7fa670151700 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa660008620 tx=0x7fa668001b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.973+0000 7fa674e23700 1 --2- 172.21.15.103:0/2057921760 >> v2:172.21.15.86:3300/0 conn(0x7fa670148aa0 0x7fa670151700 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa660008620 tx=0x7fa668001b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.973+0000 7fa674e23700 1 --2- 172.21.15.103:0/2057921760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa670148aa0 0x7fa670151700 secure :-1 s=READY pgs=395 cs=0 l=1 rx=0x7fa660008620 tx=0x7fa668001b40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:36.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.974+0000 7fa674e23700 1 --2- 172.21.15.103:0/2057921760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa670148aa0 0x7fa670151700 secure :-1 s=THROTTLE_DONE pgs=395 cs=0 l=1 rx=0x7fa660008620 tx=0x7fa668001b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.974+0000 7fa66d7fa700 1 -- 172.21.15.103:0/2057921760 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6600077f0 con 0x7fa670148aa0 2020-04-22T14:07:36.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.974+0000 7fa674e23700 1 --2- 172.21.15.103:0/2057921760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa670148aa0 0x7fa670151700 secure :-1 s=THROTTLE_DONE pgs=395 cs=0 l=1 rx=0x7fa660008620 tx=0x7fa668001b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.974+0000 7fa676886700 1 -- 172.21.15.103:0/2057921760 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6701470f0 con 0x7fa670148aa0 2020-04-22T14:07:36.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.974+0000 7fa66d7fa700 1 -- 172.21.15.103:0/2057921760 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66800ce70 con 0x7fa670148aa0 2020-04-22T14:07:36.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.974+0000 7fa674e23700 1 --2- 172.21.15.103:0/2057921760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa670148aa0 0x7fa670151700 secure :-1 s=THROTTLE_DONE pgs=395 cs=0 l=1 rx=0x7fa660008620 tx=0x7fa668001b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.974+0000 7fa66d7fa700 1 -- 172.21.15.103:0/2057921760 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa668004b20 con 0x7fa670148aa0 2020-04-22T14:07:36.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.974+0000 7fa676886700 1 -- 172.21.15.103:0/2057921760 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa670151b60 con 0x7fa670148aa0 2020-04-22T14:07:36.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.974+0000 7fa674e23700 1 --2- 172.21.15.103:0/2057921760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa670148aa0 0x7fa670151700 secure :-1 s=THROTTLE_DONE pgs=395 cs=0 l=1 rx=0x7fa660008620 tx=0x7fa668001b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.975+0000 7fa676886700 1 -- 172.21.15.103:0/2057921760 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa670056c90 con 0x7fa670148aa0 2020-04-22T14:07:36.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.975+0000 7fa66d7fa700 1 -- 172.21.15.103:0/2057921760 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fa668004c80 con 0x7fa670148aa0 2020-04-22T14:07:36.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.975+0000 7fa674e23700 1 --2- 172.21.15.103:0/2057921760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa670148aa0 0x7fa670151700 secure :-1 s=THROTTLE_DONE pgs=395 cs=0 l=1 rx=0x7fa660008620 tx=0x7fa668001b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.975+0000 7fa66d7fa700 1 --2- 172.21.15.103:0/2057921760 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa65004dc20 0x7fa6500500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:36.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.975+0000 7fa66d7fa700 1 -- 172.21.15.103:0/2057921760 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa668060a70 con 0x7fa670148aa0 2020-04-22T14:07:36.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.975+0000 7fa66ffff700 1 --2- 172.21.15.103:0/2057921760 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa65004dc20 0x7fa6500500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:36.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.976+0000 7fa66ffff700 1 --2- 172.21.15.103:0/2057921760 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa65004dc20 0x7fa6500500e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa660007950 tx=0x7fa6600100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.976+0000 7fa66ffff700 1 --2- 172.21.15.103:0/2057921760 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa65004dc20 0x7fa6500500e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa660007950 tx=0x7fa6600100d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.976+0000 7fa66ffff700 1 --2- 172.21.15.103:0/2057921760 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa65004dc20 0x7fa6500500e0 secure :-1 s=READY pgs=271 cs=0 l=1 rx=0x7fa660007950 tx=0x7fa6600100d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:36.996 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.979+0000 7fa674e23700 1 --2- 172.21.15.103:0/2057921760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa670148aa0 0x7fa670151700 secure :-1 s=THROTTLE_DONE pgs=395 cs=0 l=1 rx=0x7fa660008620 tx=0x7fa668001b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:36.996 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:36.979+0000 7fa66d7fa700 1 -- 172.21.15.103:0/2057921760 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fa66803bf10 con 0x7fa670148aa0 2020-04-22T14:07:37.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:37.166+0000 7fa676886700 1 -- 172.21.15.103:0/2057921760 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6700b4eb0 con 0x7fa670148aa0 2020-04-22T14:07:37.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:37.166+0000 7fa674e23700 1 --2- 172.21.15.103:0/2057921760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa670148aa0 0x7fa670151700 secure :-1 s=THROTTLE_DONE pgs=395 cs=0 l=1 rx=0x7fa660008620 tx=0x7fa668001b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:37.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:37.167+0000 7fa66d7fa700 1 -- 172.21.15.103:0/2057921760 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+2136 (secure 0 0 0) 0x7fa66803f530 con 0x7fa670148aa0 2020-04-22T14:07:37.169 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:07:37.169 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":28,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4898,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/167651529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":167651529},{"type":"v1","addr":"172.21.15.86:6835","nonce":167651529}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:07:30.137341+0000","modified":"2020-04-22T14:07:32.145409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5890},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5890":{"gid":5890,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/494421372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":494421372},{"type":"v1","addr":"172.21.15.103:6833","nonce":494421372}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2020-04-22T14:07:37.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:37.168+0000 7fa676886700 1 -- 172.21.15.103:0/2057921760 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa65004dc20 msgr2=0x7fa6500500e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:37.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:37.168+0000 7fa676886700 1 --2- 172.21.15.103:0/2057921760 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa65004dc20 0x7fa6500500e0 secure :-1 s=READY pgs=271 cs=0 l=1 rx=0x7fa660007950 tx=0x7fa6600100d0).stop 2020-04-22T14:07:37.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:37.168+0000 7fa676886700 1 -- 172.21.15.103:0/2057921760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa670148aa0 msgr2=0x7fa670151700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:37.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:37.168+0000 7fa676886700 1 --2- 172.21.15.103:0/2057921760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa670148aa0 0x7fa670151700 secure :-1 s=READY pgs=395 cs=0 l=1 rx=0x7fa660008620 tx=0x7fa668001b40).stop 2020-04-22T14:07:37.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:37.168+0000 7fa676886700 1 -- 172.21.15.103:0/2057921760 shutdown_connections 2020-04-22T14:07:37.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:37.168+0000 7fa676886700 1 --2- 172.21.15.103:0/2057921760 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa65004dc20 0x7fa6500500e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:37.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:37.168+0000 7fa676886700 1 --2- 172.21.15.103:0/2057921760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa670148aa0 0x7fa670151700 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:37.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:37.168+0000 7fa676886700 1 -- 172.21.15.103:0/2057921760 >> 172.21.15.103:0/2057921760 conn(0x7fa6700b9160 msgr2=0x7fa6700b66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:37.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:37.168+0000 7fa676886700 1 -- 172.21.15.103:0/2057921760 shutdown_connections 2020-04-22T14:07:37.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:37.168+0000 7fa676886700 1 -- 172.21.15.103:0/2057921760 wait complete. 2020-04-22T14:07:37.172 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 28 2020-04-22T14:07:37.383 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 5890}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 9, u'failed': [], u'epoch': 28, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [10], u'info': {u'gid_5890': {u'export_targets': [], u'name': u'a', u'incarnation': 25, u'state_seq': 3, u'state': u'up:active', u'gid': 5890, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 494421372, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 494421372, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/494421372'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:07:30.137341+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:07:32.145409+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:07:37.383 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:07:37.383 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:37.400 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:07:37.559 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:07:37.559 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:07:37.560 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:07:37.560 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 5890, 2020-04-22T14:07:37.560 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:07:37.560 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:07:37.560 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 7.4188322810000003, 2020-04-22T14:07:37.560 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 28, 2020-04-22T14:07:37.560 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 54, 2020-04-22T14:07:37.561 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 54, 2020-04-22T14:07:37.561 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 12.852935225 2020-04-22T14:07:37.561 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:07:37.568 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 5890, "want_state": "up:active", "state": "up:active", "rank_uptime": 7.4188322810000003, "mdsmap_epoch": 28, "osdmap_epoch": 54, "osdmap_epoch_barrier": 54, "uptime": 12.852935225 } 2020-04-22T14:07:37.568 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-04-22T14:07:37.568 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:07:37.568 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:37.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:37.583 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:07:37.643 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:07:37.643 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:07:37.644 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:07:37.644 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:07:37.644 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:07:37.645 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:07:37.645 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:07:37.645 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:07:37.646 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:07:37.646 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:07:37.646 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:07:37.646 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:07:37.646 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:07:37.646 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:07:37.646 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:07:37.647 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42383sec preferred_lft 42383sec 2020-04-22T14:07:37.647 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:07:37.647 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:07:37.647 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-04-22T14:07:37.647 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:37.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:37.690 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:07:37.767 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:37.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:37.815 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge con-name ceph-brx ifname ceph-brx stp no' 2020-04-22T14:07:37.924 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' (70feb78c-df29-4653-99f5-41d7cd765c0f) successfully added. 2020-04-22T14:07:37.924 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:37.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:37.938 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection modify ceph-brx ipv4.addresses 192.168.255.254/16 ipv4.method manual' 2020-04-22T14:07:38.046 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:38.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:38.070 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up ceph-brx' 2020-04-22T14:07:38.178 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (master waiting for slaves) (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/17) 2020-04-22T14:07:38.179 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:38.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:38.193 INFO:teuthology.orchestra.run.smithi103:> touch /tmp/python-ceph-brx 2020-04-22T14:07:38.252 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:38.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:38.300 INFO:teuthology.orchestra.run.smithi103:> cat /proc/sys/net/ipv4/ip_forward 2020-04-22T14:07:38.358 INFO:teuthology.orchestra.run.smithi103.stdout:0 2020-04-22T14:07:38.359 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:38.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:38.407 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 0 > /tmp/python-ceph-brx' 2020-04-22T14:07:38.482 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:38.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:38.528 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 1 > /proc/sys/net/ipv4/ip_forward' 2020-04-22T14:07:38.604 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:38.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:38.649 INFO:teuthology.orchestra.run.smithi103:> route 2020-04-22T14:07:38.709 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2020-04-22T14:07:38.709 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-04-22T14:07:38.709 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 102 0 0 enp3s0f1 2020-04-22T14:07:38.709 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 102 0 0 enp3s0f1 2020-04-22T14:07:38.709 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 425 0 0 ceph-brx 2020-04-22T14:07:38.710 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:38.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:38.758 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-04-22T14:07:38.832 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:38.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:38.880 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-04-22T14:07:38.955 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:38.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:39.000 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-04-22T14:07:39.072 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:39.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:39.123 INFO:teuthology.orchestra.run.smithi103:> ip netns list 2020-04-22T14:07:39.184 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:39.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:39.297 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:07:39.315 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:39.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:39.364 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:07:39.439 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:39.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:39.485 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0' 2020-04-22T14:07:39.562 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-04-22T14:07:39.562 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:39.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:39.607 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0' 2020-04-22T14:07:39.682 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:39.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:39.728 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0' 2020-04-22T14:07:39.837 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:39.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:39.867 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up' 2020-04-22T14:07:39.976 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:39.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:39.991 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up' 2020-04-22T14:07:40.101 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:40.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:40.115 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254' 2020-04-22T14:07:40.232 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:40.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:40.246 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:07:40.326 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:40.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:40.378 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge-slave con-name brx.0 ifname brx.0 master ceph-brx' 2020-04-22T14:07:40.484 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.0' (5271b6f3-e2f5-4031-bb7f-6d4a01ed71b8) successfully added. 2020-04-22T14:07:40.484 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:40.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:40.515 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up brx.0' 2020-04-22T14:07:40.673 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/18) 2020-04-22T14:07:40.723 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-04-22T14:07:40.723 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi103.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-04-22T14:07:40.724 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:40.738 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:07:40.738 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:07:40.797 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:40.846 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:07:40.846 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:07:40.914 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:07:40.920 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:07:40.921 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:40.967 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:07:40.967 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:07:41.027 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-04-22T14:07:41.027 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:41.074 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:07:41.118 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:41.131 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:07:41.131 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:07:41.199 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:07:41.206 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:2020-04-22T14:07:41.204+0000 7fa81422d1c0 -1 init, newargv = 0x56466d349b60 newargc=9 2020-04-22T14:07:41.206 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[60261]: starting ceph client 2020-04-22T14:07:41.207 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:07:41.208 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:41.211 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[60261]: starting fuse 2020-04-22T14:07:41.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:07:41.225 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:07:41.284 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:07:41.285 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2020-04-22T14:07:41.285 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:41.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:07:41.334 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:07:41.335 INFO:teuthology.orchestra.run.smithi103:> import glob 2020-04-22T14:07:41.335 INFO:teuthology.orchestra.run.smithi103:> import re 2020-04-22T14:07:41.335 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:07:41.335 INFO:teuthology.orchestra.run.smithi103:> import subprocess 2020-04-22T14:07:41.335 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:07:41.335 INFO:teuthology.orchestra.run.smithi103:> def find_socket(client_name): 2020-04-22T14:07:41.335 INFO:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-04-22T14:07:41.336 INFO:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2020-04-22T14:07:41.336 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:07:41.336 INFO:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2020-04-22T14:07:41.336 INFO:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2020-04-22T14:07:41.336 INFO:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2020-04-22T14:07:41.336 INFO:teuthology.orchestra.run.smithi103:> return files[0] 2020-04-22T14:07:41.336 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:07:41.336 INFO:teuthology.orchestra.run.smithi103:> for f in files: 2020-04-22T14:07:41.337 INFO:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:07:41.337 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:07:41.337 INFO:teuthology.orchestra.run.smithi103:> return f 2020-04-22T14:07:41.337 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:07:41.337 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:07:41.337 INFO:teuthology.orchestra.run.smithi103:> print(find_socket("client.0")) 2020-04-22T14:07:41.337 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:07:41.442 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.0.60261.asok 2020-04-22T14:07:41.442 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.60261.asok 2020-04-22T14:07:41.442 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:41.456 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:07:41.456 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.60261.asok status 2020-04-22T14:07:41.615 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:07:41.615 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2020-04-22T14:07:41.615 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:07:41.616 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:07:41.616 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "0", 2020-04-22T14:07:41.616 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:07:41.616 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-04-22T14:07:41.616 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "60261", 2020-04-22T14:07:41.617 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:07:41.617 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:41.617 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2020-04-22T14:07:41.617 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2020-04-22T14:07:41.617 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 6103, 2020-04-22T14:07:41.617 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2020-04-22T14:07:41.617 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:07:41.618 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:07:41.618 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 6103 2020-04-22T14:07:41.618 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:41.618 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:07:41.618 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:41.618 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:07:41.618 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 322128533 2020-04-22T14:07:41.619 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:41.619 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:41.619 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:07:41.619 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:41.619 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:07:41.619 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 322128533 2020-04-22T14:07:41.619 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:41.619 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.6103 192.168.0.1:0/322128533", 2020-04-22T14:07:41.620 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.1:0/322128533", 2020-04-22T14:07:41.620 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2020-04-22T14:07:41.620 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 28, 2020-04-22T14:07:41.620 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 54, 2020-04-22T14:07:41.620 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2020-04-22T14:07:41.620 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklisted": false 2020-04-22T14:07:41.620 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:07:41.621 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:41.635 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:07:41.635 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-22T14:07:41.635 INFO:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:07:41.695 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2020-04-22T14:07:41.695 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-04-22T14:07:41.696 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:41.750 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:07:41.756 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:07:41.826 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:41.873 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:07:42.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.017+0000 7f9f5b312700 1 Processor -- start 2020-04-22T14:07:42.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.017+0000 7f9f5b312700 1 -- start start 2020-04-22T14:07:42.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.018+0000 7f9f5b312700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f540b6040 0x7f9f540ac740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:42.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.018+0000 7f9f5b312700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9f541426d0 0x7f9f54142b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:42.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.018+0000 7f9f5b312700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f54064ec0 con 0x7f9f54067170 2020-04-22T14:07:42.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.018+0000 7f9f5b312700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f54065af0 con 0x7f9f541426d0 2020-04-22T14:07:42.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.018+0000 7f9f5b312700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f54146870 con 0x7f9f540b6040 2020-04-22T14:07:42.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.018+0000 7f9f598af700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9f541426d0 0x7f9f54142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:42.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.018+0000 7f9f588ad700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f540b6040 0x7f9f540ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:42.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.018+0000 7f9f588ad700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f540b6040 0x7f9f540ac740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:35290/0 (socket says 172.21.15.103:35290) 2020-04-22T14:07:42.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.018+0000 7f9f598af700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9f541426d0 0x7f9f54142b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:47746/0 (socket says 172.21.15.103:47746) 2020-04-22T14:07:42.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.018+0000 7f9f588ad700 1 -- 172.21.15.103:0/1575629198 learned_addr learned my addr 172.21.15.103:0/1575629198 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:42.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.018+0000 7f9f590ae700 1 --1- 172.21.15.103:0/1575629198 >> v1:172.21.15.86:6789/0 conn(0x7f9f54067170 0x7f9f5413c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:59856/0 (socket says 172.21.15.103:59856) 2020-04-22T14:07:42.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.019+0000 7f9f588ad700 1 -- 172.21.15.103:0/1575629198 >> v2:172.21.15.86:3300/0 conn(0x7f9f541426d0 msgr2=0x7f9f54142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:42.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.019+0000 7f9f588ad700 1 --2- 172.21.15.103:0/1575629198 >> v2:172.21.15.86:3300/0 conn(0x7f9f541426d0 0x7f9f54142b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:42.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.019+0000 7f9f588ad700 1 -- 172.21.15.103:0/1575629198 >> v1:172.21.15.86:6789/0 conn(0x7f9f54067170 legacy=0x7f9f5413c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:42.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.019+0000 7f9f588ad700 1 -- 172.21.15.103:0/1575629198 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f54067550 con 0x7f9f540b6040 2020-04-22T14:07:42.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.019+0000 7f9f588ad700 1 --2- 172.21.15.103:0/1575629198 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f540b6040 0x7f9f540ac740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9f50002f30 tx=0x7f9f50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.019+0000 7f9f588ad700 1 --2- 172.21.15.103:0/1575629198 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f540b6040 0x7f9f540ac740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9f50002f30 tx=0x7f9f50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.019+0000 7f9f588ad700 1 --2- 172.21.15.103:0/1575629198 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f540b6040 0x7f9f540ac740 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f9f50002f30 tx=0x7f9f50007a40).ready entity=mon.2 client_cookie=9c7aa38bfd265685 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:42.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.019+0000 7f9f588ad700 1 --2- 172.21.15.103:0/1575629198 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f540b6040 0x7f9f540ac740 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f9f50002f30 tx=0x7f9f50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.019+0000 7f9f47fff700 1 -- 172.21.15.103:0/1575629198 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f50011670 con 0x7f9f540b6040 2020-04-22T14:07:42.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.019+0000 7f9f588ad700 1 --2- 172.21.15.103:0/1575629198 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f540b6040 0x7f9f540ac740 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f9f50002f30 tx=0x7f9f50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.019+0000 7f9f588ad700 1 --2- 172.21.15.103:0/1575629198 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f540b6040 0x7f9f540ac740 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f9f50002f30 tx=0x7f9f50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.019+0000 7f9f47fff700 1 -- 172.21.15.103:0/1575629198 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f50011810 con 0x7f9f540b6040 2020-04-22T14:07:42.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.019+0000 7f9f47fff700 1 -- 172.21.15.103:0/1575629198 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f50011c30 con 0x7f9f540b6040 2020-04-22T14:07:42.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.019+0000 7f9f5b312700 1 -- 172.21.15.103:0/1575629198 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f540b6040 msgr2=0x7f9f540ac740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:42.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.019+0000 7f9f5b312700 1 --2- 172.21.15.103:0/1575629198 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f540b6040 0x7f9f540ac740 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f9f50002f30 tx=0x7f9f50007a40).stop 2020-04-22T14:07:42.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.020+0000 7f9f5b312700 1 -- 172.21.15.103:0/1575629198 shutdown_connections 2020-04-22T14:07:42.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.020+0000 7f9f5b312700 1 --2- 172.21.15.103:0/1575629198 >> v2:172.21.15.86:3300/0 conn(0x7f9f541426d0 0x7f9f54142b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:42.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.020+0000 7f9f5b312700 1 --2- 172.21.15.103:0/1575629198 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f540b6040 0x7f9f540ac740 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:42.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.020+0000 7f9f5b312700 1 -- 172.21.15.103:0/1575629198 >> 172.21.15.103:0/1575629198 conn(0x7f9f540b9160 msgr2=0x7f9f5405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:42.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.020+0000 7f9f5b312700 1 -- 172.21.15.103:0/1575629198 shutdown_connections 2020-04-22T14:07:42.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.020+0000 7f9f5b312700 1 -- 172.21.15.103:0/1575629198 wait complete. 2020-04-22T14:07:42.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.021+0000 7f9f5b312700 1 Processor -- start 2020-04-22T14:07:42.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.021+0000 7f9f5b312700 1 -- start start 2020-04-22T14:07:42.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.021+0000 7f9f5b312700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9f540b6040 0x7f9f5413c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:42.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.021+0000 7f9f5b312700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9f541426d0 0x7f9f5413e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:42.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.021+0000 7f9f5b312700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f5413ee60 con 0x7f9f54067170 2020-04-22T14:07:42.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.021+0000 7f9f5b312700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f5413ec50 con 0x7f9f540b6040 2020-04-22T14:07:42.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.021+0000 7f9f5b312700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f54145a10 con 0x7f9f541426d0 2020-04-22T14:07:42.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.021+0000 7f9f598af700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9f541426d0 0x7f9f5413e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:42.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.021+0000 7f9f598af700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9f541426d0 0x7f9f5413e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50520/0 (socket says 172.21.15.103:50520) 2020-04-22T14:07:42.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.021+0000 7f9f598af700 1 -- 172.21.15.103:0/2751055136 learned_addr learned my addr 172.21.15.103:0/2751055136 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:42.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.021+0000 7f9f588ad700 1 --2- 172.21.15.103:0/2751055136 >> v2:172.21.15.86:3300/0 conn(0x7f9f540b6040 0x7f9f5413c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:42.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.022+0000 7f9f598af700 1 -- 172.21.15.103:0/2751055136 >> v2:172.21.15.86:3300/0 conn(0x7f9f540b6040 msgr2=0x7f9f5413c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:42.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.022+0000 7f9f598af700 1 --2- 172.21.15.103:0/2751055136 >> v2:172.21.15.86:3300/0 conn(0x7f9f540b6040 0x7f9f5413c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:42.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.022+0000 7f9f598af700 1 -- 172.21.15.103:0/2751055136 >> v1:172.21.15.86:6789/0 conn(0x7f9f54067170 legacy=0x7f9f54142ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:42.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.022+0000 7f9f598af700 1 -- 172.21.15.103:0/2751055136 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5413f100 con 0x7f9f541426d0 2020-04-22T14:07:42.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.022+0000 7f9f598af700 1 --2- 172.21.15.103:0/2751055136 >> v2:172.21.15.103:3300/0 conn(0x7f9f541426d0 0x7f9f5413e5d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9f4c0032b0 tx=0x7f9f4c010fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.022+0000 7f9f598af700 1 --2- 172.21.15.103:0/2751055136 >> v2:172.21.15.103:3300/0 conn(0x7f9f541426d0 0x7f9f5413e5d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9f4c0032b0 tx=0x7f9f4c010fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.022+0000 7f9f598af700 1 --2- 172.21.15.103:0/2751055136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f541426d0 0x7f9f5413e5d0 secure :-1 s=READY pgs=715 cs=0 l=1 rx=0x7f9f4c0032b0 tx=0x7f9f4c010fa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:42.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.022+0000 7f9f598af700 1 --2- 172.21.15.103:0/2751055136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f541426d0 0x7f9f5413e5d0 secure :-1 s=THROTTLE_DONE pgs=715 cs=0 l=1 rx=0x7f9f4c0032b0 tx=0x7f9f4c010fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.022+0000 7f9f467fc700 1 -- 172.21.15.103:0/2751055136 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f4c012d20 con 0x7f9f541426d0 2020-04-22T14:07:42.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.022+0000 7f9f598af700 1 --2- 172.21.15.103:0/2751055136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f541426d0 0x7f9f5413e5d0 secure :-1 s=THROTTLE_DONE pgs=715 cs=0 l=1 rx=0x7f9f4c0032b0 tx=0x7f9f4c010fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.022+0000 7f9f598af700 1 --2- 172.21.15.103:0/2751055136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f541426d0 0x7f9f5413e5d0 secure :-1 s=THROTTLE_DONE pgs=715 cs=0 l=1 rx=0x7f9f4c0032b0 tx=0x7f9f4c010fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.035 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.022+0000 7f9f467fc700 1 -- 172.21.15.103:0/2751055136 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4c012e80 con 0x7f9f541426d0 2020-04-22T14:07:42.035 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.022+0000 7f9f5b312700 1 -- 172.21.15.103:0/2751055136 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f5413d290 con 0x7f9f541426d0 2020-04-22T14:07:42.035 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.022+0000 7f9f467fc700 1 -- 172.21.15.103:0/2751055136 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f4c00a370 con 0x7f9f541426d0 2020-04-22T14:07:42.035 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.022+0000 7f9f5b312700 1 -- 172.21.15.103:0/2751055136 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f54142120 con 0x7f9f541426d0 2020-04-22T14:07:42.035 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.023+0000 7f9f598af700 1 --2- 172.21.15.103:0/2751055136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f541426d0 0x7f9f5413e5d0 secure :-1 s=THROTTLE_DONE pgs=715 cs=0 l=1 rx=0x7f9f4c0032b0 tx=0x7f9f4c010fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.035 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.023+0000 7f9f467fc700 1 -- 172.21.15.103:0/2751055136 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f9f4c00a560 con 0x7f9f541426d0 2020-04-22T14:07:42.035 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.023+0000 7f9f598af700 1 --2- 172.21.15.103:0/2751055136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f541426d0 0x7f9f5413e5d0 secure :-1 s=THROTTLE_DONE pgs=715 cs=0 l=1 rx=0x7f9f4c0032b0 tx=0x7f9f4c010fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.023+0000 7f9f5b312700 1 -- 172.21.15.103:0/2751055136 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f5413f4c0 con 0x7f9f541426d0 2020-04-22T14:07:42.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.024+0000 7f9f467fc700 1 --2- 172.21.15.103:0/2751055136 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9f3404d960 0x7f9f3404fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:42.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.024+0000 7f9f467fc700 1 -- 172.21.15.103:0/2751055136 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9f4c061e60 con 0x7f9f541426d0 2020-04-22T14:07:42.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.024+0000 7f9f590ae700 1 --2- 172.21.15.103:0/2751055136 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9f3404d960 0x7f9f3404fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:42.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.024+0000 7f9f590ae700 1 --2- 172.21.15.103:0/2751055136 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9f3404d960 0x7f9f3404fe20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9f54143de0 tx=0x7f9f480014f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.024+0000 7f9f590ae700 1 --2- 172.21.15.103:0/2751055136 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9f3404d960 0x7f9f3404fe20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9f54143de0 tx=0x7f9f480014f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.024+0000 7f9f590ae700 1 --2- 172.21.15.103:0/2751055136 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9f3404d960 0x7f9f3404fe20 secure :-1 s=READY pgs=272 cs=0 l=1 rx=0x7f9f54143de0 tx=0x7f9f480014f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:42.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.028+0000 7f9f598af700 1 --2- 172.21.15.103:0/2751055136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f541426d0 0x7f9f5413e5d0 secure :-1 s=THROTTLE_DONE pgs=715 cs=0 l=1 rx=0x7f9f4c0032b0 tx=0x7f9f4c010fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.028+0000 7f9f467fc700 1 -- 172.21.15.103:0/2751055136 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f9f5413f4c0 con 0x7f9f541426d0 2020-04-22T14:07:42.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.170+0000 7f9f5b312700 1 -- 172.21.15.103:0/2751055136 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f5413f4c0 con 0x7f9f541426d0 2020-04-22T14:07:42.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.171+0000 7f9f598af700 1 --2- 172.21.15.103:0/2751055136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f541426d0 0x7f9f5413e5d0 secure :-1 s=THROTTLE_DONE pgs=715 cs=0 l=1 rx=0x7f9f4c0032b0 tx=0x7f9f4c010fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.171+0000 7f9f467fc700 1 -- 172.21.15.103:0/2751055136 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+16091 (secure 0 0 0) 0x7f9f5413f4c0 con 0x7f9f541426d0 2020-04-22T14:07:42.173 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:07:42.174 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:07:31.138938+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:07:27.809363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2020-04-22T14:07:28.880202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:07:42.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.172+0000 7f9f5b312700 1 -- 172.21.15.103:0/2751055136 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9f3404d960 msgr2=0x7f9f3404fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:42.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.172+0000 7f9f5b312700 1 --2- 172.21.15.103:0/2751055136 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9f3404d960 0x7f9f3404fe20 secure :-1 s=READY pgs=272 cs=0 l=1 rx=0x7f9f54143de0 tx=0x7f9f480014f0).stop 2020-04-22T14:07:42.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.172+0000 7f9f5b312700 1 -- 172.21.15.103:0/2751055136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f541426d0 msgr2=0x7f9f5413e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:42.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.172+0000 7f9f5b312700 1 --2- 172.21.15.103:0/2751055136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f541426d0 0x7f9f5413e5d0 secure :-1 s=READY pgs=715 cs=0 l=1 rx=0x7f9f4c0032b0 tx=0x7f9f4c010fa0).stop 2020-04-22T14:07:42.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.172+0000 7f9f5b312700 1 -- 172.21.15.103:0/2751055136 shutdown_connections 2020-04-22T14:07:42.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.172+0000 7f9f5b312700 1 --2- 172.21.15.103:0/2751055136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f541426d0 0x7f9f5413e5d0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:42.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.172+0000 7f9f5b312700 1 --2- 172.21.15.103:0/2751055136 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9f3404d960 0x7f9f3404fe20 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:42.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.172+0000 7f9f5b312700 1 --2- 172.21.15.103:0/2751055136 >> v2:172.21.15.86:3300/0 conn(0x7f9f540b6040 0x7f9f5413c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:42.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.172+0000 7f9f5b312700 1 -- 172.21.15.103:0/2751055136 >> 172.21.15.103:0/2751055136 conn(0x7f9f540b9160 msgr2=0x7f9f54062960 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:42.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.173+0000 7f9f5b312700 1 -- 172.21.15.103:0/2751055136 shutdown_connections 2020-04-22T14:07:42.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.173+0000 7f9f5b312700 1 -- 172.21.15.103:0/2751055136 wait complete. 2020-04-22T14:07:42.185 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:07:27.809363+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 9, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'53', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:07:28.880202+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 10, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'54', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:07:42.186 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:42.200 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:07:42.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.347+0000 7f6a2d2ef700 1 Processor -- start 2020-04-22T14:07:42.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.347+0000 7f6a2d2ef700 1 -- start start 2020-04-22T14:07:42.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.348+0000 7f6a2d2ef700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6a280ac950 0x7f6a28146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:42.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.348+0000 7f6a2d2ef700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a281467e0 con 0x7f6a280b9140 2020-04-22T14:07:42.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.348+0000 7f6a2d2ef700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a28060050 con 0x7f6a281470a0 2020-04-22T14:07:42.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.348+0000 7f6a2d2ef700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a28147530 con 0x7f6a280ac950 2020-04-22T14:07:42.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.348+0000 7f6a277fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f6a281470a0 0x7f6a28143090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42716/0 (socket says 172.21.15.103:42716) 2020-04-22T14:07:42.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.348+0000 7f6a277fe700 1 -- 172.21.15.103:0/1751666913 learned_addr learned my addr 172.21.15.103:0/1751666913 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:42.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.348+0000 7f6a1ffff700 1 --2- 172.21.15.103:0/1751666913 >> v2:172.21.15.86:3300/0 conn(0x7f6a280ac950 0x7f6a28146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:42.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.348+0000 7f6a267fc700 1 -- 172.21.15.103:0/1751666913 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2837927995 0 0) 0x7f6a28060050 con 0x7f6a281470a0 2020-04-22T14:07:42.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.348+0000 7f6a267fc700 1 -- 172.21.15.103:0/1751666913 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a08003230 con 0x7f6a281470a0 2020-04-22T14:07:42.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.348+0000 7f6a267fc700 1 -- 172.21.15.103:0/1751666913 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 348856315 0 0) 0x7f6a08003230 con 0x7f6a281470a0 2020-04-22T14:07:42.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.348+0000 7f6a267fc700 1 -- 172.21.15.103:0/1751666913 >> v2:172.21.15.86:3300/0 conn(0x7f6a280ac950 msgr2=0x7f6a28146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:42.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.348+0000 7f6a267fc700 1 --2- 172.21.15.103:0/1751666913 >> v2:172.21.15.86:3300/0 conn(0x7f6a280ac950 0x7f6a28146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:42.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.348+0000 7f6a267fc700 1 -- 172.21.15.103:0/1751666913 >> v1:172.21.15.86:6789/0 conn(0x7f6a280b9140 legacy=0x7f6a2812b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:42.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.348+0000 7f6a267fc700 1 -- 172.21.15.103:0/1751666913 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a280b9520 con 0x7f6a281470a0 2020-04-22T14:07:42.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.348+0000 7f6a267fc700 1 -- 172.21.15.103:0/1751666913 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f6a20001a90 con 0x7f6a281470a0 2020-04-22T14:07:42.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.348+0000 7f6a267fc700 1 -- 172.21.15.103:0/1751666913 >> v1:172.21.15.103:6789/0 conn(0x7f6a281470a0 legacy=0x7f6a28143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:42.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.348+0000 7f6a267fc700 1 --2- 172.21.15.103:0/1751666913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a08003720 0x7f6a08003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:42.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.348+0000 7f6a267fc700 1 --2- 172.21.15.103:0/1751666913 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a080044d0 0x7f6a08004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:42.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.348+0000 7f6a267fc700 1 --2- 172.21.15.103:0/1751666913 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a08004db0 0x7f6a0800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:42.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.348+0000 7f6a267fc700 1 -- 172.21.15.103:0/1751666913 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a080041c0 con 0x7f6a08004db0 2020-04-22T14:07:42.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.348+0000 7f6a267fc700 1 -- 172.21.15.103:0/1751666913 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a08004330 con 0x7f6a08003720 2020-04-22T14:07:42.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.348+0000 7f6a267fc700 1 -- 172.21.15.103:0/1751666913 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0800bbd0 con 0x7f6a080044d0 2020-04-22T14:07:42.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.348+0000 7f6a26ffd700 1 --2- 172.21.15.103:0/1751666913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a08003720 0x7f6a08003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:42.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.349+0000 7f6a1ffff700 1 --2- 172.21.15.103:0/1751666913 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a080044d0 0x7f6a08004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:42.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.349+0000 7f6a277fe700 1 --2- 172.21.15.103:0/1751666913 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a08004db0 0x7f6a0800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:42.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.349+0000 7f6a26ffd700 1 -- 172.21.15.103:0/1751666913 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a080044d0 msgr2=0x7f6a08004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:42.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.349+0000 7f6a26ffd700 1 --2- 172.21.15.103:0/1751666913 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a080044d0 0x7f6a08004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:42.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.349+0000 7f6a26ffd700 1 -- 172.21.15.103:0/1751666913 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a08004db0 msgr2=0x7f6a0800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:42.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.349+0000 7f6a26ffd700 1 --2- 172.21.15.103:0/1751666913 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a08004db0 0x7f6a0800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:42.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.349+0000 7f6a26ffd700 1 -- 172.21.15.103:0/1751666913 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a08003230 con 0x7f6a08003720 2020-04-22T14:07:42.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.349+0000 7f6a277fe700 1 --2- 172.21.15.103:0/1751666913 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a08004db0 0x7f6a0800b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:07:42.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.349+0000 7f6a277fe700 1 -- 172.21.15.103:0/1751666913 reap_dead start 2020-04-22T14:07:42.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.349+0000 7f6a26ffd700 1 --2- 172.21.15.103:0/1751666913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a08003720 0x7f6a08003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6a280b6250 tx=0x7f6a1800fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.349+0000 7f6a26ffd700 1 --2- 172.21.15.103:0/1751666913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a08003720 0x7f6a08003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6a280b6250 tx=0x7f6a1800fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.349+0000 7f6a26ffd700 1 --2- 172.21.15.103:0/1751666913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a08003720 0x7f6a08003b40 secure :-1 s=READY pgs=717 cs=0 l=1 rx=0x7f6a280b6250 tx=0x7f6a1800fcf0).ready entity=mon.1 client_cookie=5ee735f3bf72dc7a server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:42.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.349+0000 7f6a26ffd700 1 --2- 172.21.15.103:0/1751666913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a08003720 0x7f6a08003b40 secure :-1 s=THROTTLE_DONE pgs=717 cs=0 l=1 rx=0x7f6a280b6250 tx=0x7f6a1800fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.349+0000 7f6a26ffd700 1 --2- 172.21.15.103:0/1751666913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a08003720 0x7f6a08003b40 secure :-1 s=THROTTLE_DONE pgs=717 cs=0 l=1 rx=0x7f6a280b6250 tx=0x7f6a1800fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.349+0000 7f6a267fc700 1 -- 172.21.15.103:0/1751666913 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a18003560 con 0x7f6a08003720 2020-04-22T14:07:42.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.349+0000 7f6a26ffd700 1 --2- 172.21.15.103:0/1751666913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a08003720 0x7f6a08003b40 secure :-1 s=THROTTLE_DONE pgs=717 cs=0 l=1 rx=0x7f6a280b6250 tx=0x7f6a1800fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.349+0000 7f6a267fc700 1 -- 172.21.15.103:0/1751666913 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a180036c0 con 0x7f6a08003720 2020-04-22T14:07:42.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.349+0000 7f6a267fc700 1 -- 172.21.15.103:0/1751666913 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a18003a60 con 0x7f6a08003720 2020-04-22T14:07:42.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.349+0000 7f6a2d2ef700 1 -- 172.21.15.103:0/1751666913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a08003720 msgr2=0x7f6a08003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:42.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.349+0000 7f6a2d2ef700 1 --2- 172.21.15.103:0/1751666913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a08003720 0x7f6a08003b40 secure :-1 s=READY pgs=717 cs=0 l=1 rx=0x7f6a280b6250 tx=0x7f6a1800fcf0).stop 2020-04-22T14:07:42.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.350+0000 7f6a2d2ef700 1 -- 172.21.15.103:0/1751666913 shutdown_connections 2020-04-22T14:07:42.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.350+0000 7f6a2d2ef700 1 --2- 172.21.15.103:0/1751666913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a08003720 0x7f6a08003b40 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:42.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.350+0000 7f6a2d2ef700 1 -- 172.21.15.103:0/1751666913 >> 172.21.15.103:0/1751666913 conn(0x7f6a2805b7b0 msgr2=0x7f6a280b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:42.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.350+0000 7f6a2d2ef700 1 -- 172.21.15.103:0/1751666913 shutdown_connections 2020-04-22T14:07:42.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.350+0000 7f6a2d2ef700 1 -- 172.21.15.103:0/1751666913 wait complete. 2020-04-22T14:07:42.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.351+0000 7f6a2d2ef700 1 Processor -- start 2020-04-22T14:07:42.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.351+0000 7f6a2d2ef700 1 -- start start 2020-04-22T14:07:42.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.351+0000 7f6a2d2ef700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6a2813f780 0x7f6a280b5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:42.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.351+0000 7f6a2d2ef700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a28154fc0 con 0x7f6a08003720 2020-04-22T14:07:42.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.351+0000 7f6a2d2ef700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a28155260 con 0x7f6a280b5c90 2020-04-22T14:07:42.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.351+0000 7f6a2d2ef700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a2813fc00 con 0x7f6a2813f780 2020-04-22T14:07:42.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.351+0000 7f6a277fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f6a280b5c90 0x7f6a28151630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42730/0 (socket says 172.21.15.103:42730) 2020-04-22T14:07:42.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.351+0000 7f6a277fe700 1 -- 172.21.15.103:0/1388501187 learned_addr learned my addr 172.21.15.103:0/1388501187 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:42.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.352+0000 7f6a1ffff700 1 --2- 172.21.15.103:0/1388501187 >> v2:172.21.15.86:3300/0 conn(0x7f6a2813f780 0x7f6a280b5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:42.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.352+0000 7f6a24ff9700 1 -- 172.21.15.103:0/1388501187 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3476886272 0 0) 0x7f6a28155260 con 0x7f6a280b5c90 2020-04-22T14:07:42.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.352+0000 7f6a24ff9700 1 -- 172.21.15.103:0/1388501187 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a0c002fe0 con 0x7f6a280b5c90 2020-04-22T14:07:42.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.352+0000 7f6a24ff9700 1 -- 172.21.15.103:0/1388501187 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 763394917 0 0) 0x7f6a0c002fe0 con 0x7f6a280b5c90 2020-04-22T14:07:42.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.352+0000 7f6a24ff9700 1 -- 172.21.15.103:0/1388501187 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6a28155260 con 0x7f6a280b5c90 2020-04-22T14:07:42.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.352+0000 7f6a24ff9700 1 -- 172.21.15.103:0/1388501187 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f6a20001a90 con 0x7f6a280b5c90 2020-04-22T14:07:42.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.352+0000 7f6a24ff9700 1 -- 172.21.15.103:0/1388501187 >> v2:172.21.15.86:3300/0 conn(0x7f6a2813f780 msgr2=0x7f6a280b5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:42.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.352+0000 7f6a24ff9700 1 --2- 172.21.15.103:0/1388501187 >> v2:172.21.15.86:3300/0 conn(0x7f6a2813f780 0x7f6a280b5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:42.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.352+0000 7f6a24ff9700 1 -- 172.21.15.103:0/1388501187 >> v1:172.21.15.103:6789/0 conn(0x7f6a280b5c90 legacy=0x7f6a28151630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:42.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.352+0000 7f6a24ff9700 1 -- 172.21.15.103:0/1388501187 >> v1:172.21.15.86:6789/0 conn(0x7f6a08003720 legacy=0x7f6a280b5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:42.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.352+0000 7f6a24ff9700 1 --2- 172.21.15.103:0/1388501187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a0c0049b0 0x7f6a0c004db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:42.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.352+0000 7f6a24ff9700 1 --2- 172.21.15.103:0/1388501187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a0c003920 0x7f6a0c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:42.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.352+0000 7f6a24ff9700 1 --2- 172.21.15.103:0/1388501187 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a0c0041e0 0x7f6a0c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:42.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.352+0000 7f6a24ff9700 1 -- 172.21.15.103:0/1388501187 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2813fc00 con 0x7f6a0c0049b0 2020-04-22T14:07:42.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.352+0000 7f6a24ff9700 1 -- 172.21.15.103:0/1388501187 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c004780 con 0x7f6a0c003920 2020-04-22T14:07:42.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.352+0000 7f6a24ff9700 1 -- 172.21.15.103:0/1388501187 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c00bbb0 con 0x7f6a0c0041e0 2020-04-22T14:07:42.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.352+0000 7f6a1ffff700 1 --2- 172.21.15.103:0/1388501187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a0c003920 0x7f6a0c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:42.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.352+0000 7f6a26ffd700 1 --2- 172.21.15.103:0/1388501187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a0c0049b0 0x7f6a0c004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:42.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.352+0000 7f6a277fe700 1 --2- 172.21.15.103:0/1388501187 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a0c0041e0 0x7f6a0c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:42.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.352+0000 7f6a1ffff700 1 -- 172.21.15.103:0/1388501187 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a0c0041e0 msgr2=0x7f6a0c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:42.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.352+0000 7f6a1ffff700 1 --2- 172.21.15.103:0/1388501187 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a0c0041e0 0x7f6a0c00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:42.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.352+0000 7f6a1ffff700 1 -- 172.21.15.103:0/1388501187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a0c0049b0 msgr2=0x7f6a0c004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:42.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.352+0000 7f6a1ffff700 1 --2- 172.21.15.103:0/1388501187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a0c0049b0 0x7f6a0c004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:42.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.352+0000 7f6a1ffff700 1 -- 172.21.15.103:0/1388501187 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a280b3950 con 0x7f6a0c003920 2020-04-22T14:07:42.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.352+0000 7f6a2d2ef700 1 -- 172.21.15.103:0/1388501187 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a28154c40 con 0x7f6a0c003920 2020-04-22T14:07:42.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.352+0000 7f6a277fe700 1 --2- 172.21.15.103:0/1388501187 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a0c0041e0 0x7f6a0c00b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:07:42.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.352+0000 7f6a277fe700 1 -- 172.21.15.103:0/1388501187 reap_dead start 2020-04-22T14:07:42.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.352+0000 7f6a1ffff700 1 --2- 172.21.15.103:0/1388501187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a0c003920 0x7f6a0c003d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6a0c0048f0 tx=0x7f6a1000efd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.352+0000 7f6a2d2ef700 1 -- 172.21.15.103:0/1388501187 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a28155b60 con 0x7f6a0c003920 2020-04-22T14:07:42.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.353+0000 7f6a1ffff700 1 --2- 172.21.15.103:0/1388501187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a0c003920 0x7f6a0c003d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6a0c0048f0 tx=0x7f6a1000efd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.353+0000 7f6a1ffff700 1 --2- 172.21.15.103:0/1388501187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a0c003920 0x7f6a0c003d80 secure :-1 s=READY pgs=719 cs=0 l=1 rx=0x7f6a0c0048f0 tx=0x7f6a1000efd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:42.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.353+0000 7f6a1ffff700 1 --2- 172.21.15.103:0/1388501187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a0c003920 0x7f6a0c003d80 secure :-1 s=THROTTLE_DONE pgs=719 cs=0 l=1 rx=0x7f6a0c0048f0 tx=0x7f6a1000efd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.353+0000 7f6a24ff9700 1 -- 172.21.15.103:0/1388501187 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a10007580 con 0x7f6a0c003920 2020-04-22T14:07:42.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.353+0000 7f6a1ffff700 1 --2- 172.21.15.103:0/1388501187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a0c003920 0x7f6a0c003d80 secure :-1 s=THROTTLE_DONE pgs=719 cs=0 l=1 rx=0x7f6a0c0048f0 tx=0x7f6a1000efd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.353+0000 7f6a1ffff700 1 --2- 172.21.15.103:0/1388501187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a0c003920 0x7f6a0c003d80 secure :-1 s=THROTTLE_DONE pgs=719 cs=0 l=1 rx=0x7f6a0c0048f0 tx=0x7f6a1000efd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.353+0000 7f6a24ff9700 1 -- 172.21.15.103:0/1388501187 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a100119d0 con 0x7f6a0c003920 2020-04-22T14:07:42.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.353+0000 7f6a24ff9700 1 -- 172.21.15.103:0/1388501187 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a10011d70 con 0x7f6a0c003920 2020-04-22T14:07:42.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.353+0000 7f6a1ffff700 1 --2- 172.21.15.103:0/1388501187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a0c003920 0x7f6a0c003d80 secure :-1 s=THROTTLE_DONE pgs=719 cs=0 l=1 rx=0x7f6a0c0048f0 tx=0x7f6a1000efd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.353+0000 7f6a2d2ef700 1 -- 172.21.15.103:0/1388501187 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a00003340 con 0x7f6a0c003920 2020-04-22T14:07:42.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.354+0000 7f6a24ff9700 1 -- 172.21.15.103:0/1388501187 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f6a100056c0 con 0x7f6a0c003920 2020-04-22T14:07:42.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.354+0000 7f6a1ffff700 1 --2- 172.21.15.103:0/1388501187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a0c003920 0x7f6a0c003d80 secure :-1 s=THROTTLE_DONE pgs=719 cs=0 l=1 rx=0x7f6a0c0048f0 tx=0x7f6a1000efd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.354+0000 7f6a24ff9700 1 --2- 172.21.15.103:0/1388501187 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6a0c051090 0x7f6a0c053550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:42.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.354+0000 7f6a24ff9700 1 -- 172.21.15.103:0/1388501187 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6a10061000 con 0x7f6a0c003920 2020-04-22T14:07:42.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.354+0000 7f6a26ffd700 1 --2- 172.21.15.103:0/1388501187 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6a0c051090 0x7f6a0c053550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:42.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.354+0000 7f6a26ffd700 1 --2- 172.21.15.103:0/1388501187 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6a0c051090 0x7f6a0c053550 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6a2813e410 tx=0x7f6a1800fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.354+0000 7f6a26ffd700 1 --2- 172.21.15.103:0/1388501187 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6a0c051090 0x7f6a0c053550 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6a2813e410 tx=0x7f6a1800fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.354+0000 7f6a26ffd700 1 --2- 172.21.15.103:0/1388501187 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6a0c051090 0x7f6a0c053550 secure :-1 s=READY pgs=273 cs=0 l=1 rx=0x7f6a2813e410 tx=0x7f6a1800fcf0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:42.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.358+0000 7f6a1ffff700 1 --2- 172.21.15.103:0/1388501187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a0c003920 0x7f6a0c003d80 secure :-1 s=THROTTLE_DONE pgs=719 cs=0 l=1 rx=0x7f6a0c0048f0 tx=0x7f6a1000efd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.358+0000 7f6a24ff9700 1 -- 172.21.15.103:0/1388501187 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f6a1003c440 con 0x7f6a0c003920 2020-04-22T14:07:42.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.499+0000 7f6a2d2ef700 1 -- 172.21.15.103:0/1388501187 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f6a00002220 con 0x7f6a0c003920 2020-04-22T14:07:42.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.499+0000 7f6a1ffff700 1 --2- 172.21.15.103:0/1388501187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a0c003920 0x7f6a0c003d80 secure :-1 s=THROTTLE_DONE pgs=719 cs=0 l=1 rx=0x7f6a0c0048f0 tx=0x7f6a1000efd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.499+0000 7f6a24ff9700 1 -- 172.21.15.103:0/1388501187 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v54) v1 ==== 110+0+10 (secure 0 0 0) 0x7f6a1003fa60 con 0x7f6a0c003920 2020-04-22T14:07:42.502 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:07:42.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.500+0000 7f6a2d2ef700 1 -- 172.21.15.103:0/1388501187 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6a0c051090 msgr2=0x7f6a0c053550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:42.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.500+0000 7f6a2d2ef700 1 --2- 172.21.15.103:0/1388501187 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6a0c051090 0x7f6a0c053550 secure :-1 s=READY pgs=273 cs=0 l=1 rx=0x7f6a2813e410 tx=0x7f6a1800fcf0).stop 2020-04-22T14:07:42.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.500+0000 7f6a2d2ef700 1 -- 172.21.15.103:0/1388501187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a0c003920 msgr2=0x7f6a0c003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:42.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.500+0000 7f6a2d2ef700 1 --2- 172.21.15.103:0/1388501187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a0c003920 0x7f6a0c003d80 secure :-1 s=READY pgs=719 cs=0 l=1 rx=0x7f6a0c0048f0 tx=0x7f6a1000efd0).stop 2020-04-22T14:07:42.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.500+0000 7f6a2d2ef700 1 -- 172.21.15.103:0/1388501187 shutdown_connections 2020-04-22T14:07:42.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.500+0000 7f6a2d2ef700 1 --2- 172.21.15.103:0/1388501187 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6a0c051090 0x7f6a0c053550 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:42.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.500+0000 7f6a2d2ef700 1 --2- 172.21.15.103:0/1388501187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a0c003920 0x7f6a0c003d80 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:42.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.500+0000 7f6a2d2ef700 1 -- 172.21.15.103:0/1388501187 >> 172.21.15.103:0/1388501187 conn(0x7f6a2805b7b0 msgr2=0x7f6a28145750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:42.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.500+0000 7f6a2d2ef700 1 -- 172.21.15.103:0/1388501187 shutdown_connections 2020-04-22T14:07:42.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.500+0000 7f6a2d2ef700 1 -- 172.21.15.103:0/1388501187 wait complete. 2020-04-22T14:07:42.512 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:42.525 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:07:42.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.673+0000 7f039be71700 1 Processor -- start 2020-04-22T14:07:42.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.673+0000 7f039be71700 1 -- start start 2020-04-22T14:07:42.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.674+0000 7f039be71700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f03940b4820 0x7f03940acb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:42.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.674+0000 7f039be71700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03940af030 con 0x7f0394061a30 2020-04-22T14:07:42.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.674+0000 7f039be71700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0394060250 con 0x7f0394141f20 2020-04-22T14:07:42.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.674+0000 7f039be71700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03940623c0 con 0x7f03940b4820 2020-04-22T14:07:42.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.674+0000 7f039940c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f03940b4820 0x7f03940acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:42.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.674+0000 7f039a40e700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f0394141f20 0x7f0394142380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42744/0 (socket says 172.21.15.103:42744) 2020-04-22T14:07:42.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.674+0000 7f039a40e700 1 -- 172.21.15.103:0/2800299255 learned_addr learned my addr 172.21.15.103:0/2800299255 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:42.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.674+0000 7f039940c700 1 -- 172.21.15.103:0/2800299255 >> v1:172.21.15.103:6789/0 conn(0x7f0394141f20 legacy=0x7f0394142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:42.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.674+0000 7f039940c700 1 -- 172.21.15.103:0/2800299255 >> v1:172.21.15.86:6789/0 conn(0x7f0394061a30 legacy=0x7f03940ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:42.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.674+0000 7f0398c0b700 1 -- 172.21.15.103:0/2800299255 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4074380246 0 0) 0x7f0394060250 con 0x7f0394141f20 2020-04-22T14:07:42.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.674+0000 7f039940c700 1 -- 172.21.15.103:0/2800299255 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0394062660 con 0x7f03940b4820 2020-04-22T14:07:42.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.675+0000 7f039940c700 1 --2- 172.21.15.103:0/2800299255 >> v2:172.21.15.103:3300/0 conn(0x7f03940b4820 0x7f03940acb10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0388002f30 tx=0x7f0388007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.675+0000 7f039940c700 1 --2- 172.21.15.103:0/2800299255 >> v2:172.21.15.103:3300/0 conn(0x7f03940b4820 0x7f03940acb10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0388002f30 tx=0x7f0388007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.675+0000 7f039940c700 1 --2- 172.21.15.103:0/2800299255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03940b4820 0x7f03940acb10 secure :-1 s=READY pgs=721 cs=0 l=1 rx=0x7f0388002f30 tx=0x7f0388007a40).ready entity=mon.1 client_cookie=a6d41ec1c510a0bf server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:42.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.675+0000 7f039940c700 1 --2- 172.21.15.103:0/2800299255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03940b4820 0x7f03940acb10 secure :-1 s=THROTTLE_DONE pgs=721 cs=0 l=1 rx=0x7f0388002f30 tx=0x7f0388007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.675+0000 7f0398c0b700 1 -- 172.21.15.103:0/2800299255 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0388011470 con 0x7f03940b4820 2020-04-22T14:07:42.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.675+0000 7f039940c700 1 --2- 172.21.15.103:0/2800299255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03940b4820 0x7f03940acb10 secure :-1 s=THROTTLE_DONE pgs=721 cs=0 l=1 rx=0x7f0388002f30 tx=0x7f0388007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.675+0000 7f0398c0b700 1 -- 172.21.15.103:0/2800299255 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03880115d0 con 0x7f03940b4820 2020-04-22T14:07:42.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.675+0000 7f039940c700 1 --2- 172.21.15.103:0/2800299255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03940b4820 0x7f03940acb10 secure :-1 s=THROTTLE_DONE pgs=721 cs=0 l=1 rx=0x7f0388002f30 tx=0x7f0388007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.675+0000 7f039be71700 1 -- 172.21.15.103:0/2800299255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03940b4820 msgr2=0x7f03940acb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:42.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.675+0000 7f0398c0b700 1 -- 172.21.15.103:0/2800299255 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03880119f0 con 0x7f03940b4820 2020-04-22T14:07:42.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.675+0000 7f039be71700 1 --2- 172.21.15.103:0/2800299255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03940b4820 0x7f03940acb10 secure :-1 s=READY pgs=721 cs=0 l=1 rx=0x7f0388002f30 tx=0x7f0388007a40).stop 2020-04-22T14:07:42.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.675+0000 7f039be71700 1 -- 172.21.15.103:0/2800299255 shutdown_connections 2020-04-22T14:07:42.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.675+0000 7f039be71700 1 --2- 172.21.15.103:0/2800299255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03940b4820 0x7f03940acb10 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:42.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.675+0000 7f039be71700 1 -- 172.21.15.103:0/2800299255 >> 172.21.15.103:0/2800299255 conn(0x7f039405b7b0 msgr2=0x7f03940b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:42.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.675+0000 7f039be71700 1 -- 172.21.15.103:0/2800299255 shutdown_connections 2020-04-22T14:07:42.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.675+0000 7f039be71700 1 -- 172.21.15.103:0/2800299255 wait complete. 2020-04-22T14:07:42.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.676+0000 7f039be71700 1 Processor -- start 2020-04-22T14:07:42.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.676+0000 7f039be71700 1 -- start start 2020-04-22T14:07:42.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.677+0000 7f039be71700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0394061a30 0x7f03941415a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:42.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.677+0000 7f039be71700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0394141f20 0x7f0394064060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:42.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.677+0000 7f039be71700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0394144c90 con 0x7f03940b4820 2020-04-22T14:07:42.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.677+0000 7f039be71700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03940644c0 con 0x7f0394061a30 2020-04-22T14:07:42.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.677+0000 7f039be71700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0394141ab0 con 0x7f0394141f20 2020-04-22T14:07:42.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.677+0000 7f0399c0d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0394061a30 0x7f03941415a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:42.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.677+0000 7f0399c0d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0394061a30 0x7f03941415a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50556/0 (socket says 172.21.15.103:50556) 2020-04-22T14:07:42.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.677+0000 7f0399c0d700 1 -- 172.21.15.103:0/2707404123 learned_addr learned my addr 172.21.15.103:0/2707404123 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:42.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.677+0000 7f039a40e700 1 --2- 172.21.15.103:0/2707404123 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0394141f20 0x7f0394064060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:42.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.677+0000 7f0399c0d700 1 -- 172.21.15.103:0/2707404123 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0394141f20 msgr2=0x7f0394064060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:42.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.677+0000 7f0399c0d700 1 --2- 172.21.15.103:0/2707404123 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0394141f20 0x7f0394064060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:42.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.677+0000 7f0399c0d700 1 -- 172.21.15.103:0/2707404123 >> v1:172.21.15.86:6789/0 conn(0x7f03940b4820 legacy=0x7f0394144f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:42.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.677+0000 7f0399c0d700 1 -- 172.21.15.103:0/2707404123 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0394066290 con 0x7f0394061a30 2020-04-22T14:07:42.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.677+0000 7f0399c0d700 1 --2- 172.21.15.103:0/2707404123 >> v2:172.21.15.103:3300/0 conn(0x7f0394061a30 0x7f03941415a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0394143ee0 tx=0x7f038c001730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.677+0000 7f0399c0d700 1 --2- 172.21.15.103:0/2707404123 >> v2:172.21.15.103:3300/0 conn(0x7f0394061a30 0x7f03941415a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0394143ee0 tx=0x7f038c001730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.677+0000 7f0399c0d700 1 --2- 172.21.15.103:0/2707404123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0394061a30 0x7f03941415a0 secure :-1 s=READY pgs=722 cs=0 l=1 rx=0x7f0394143ee0 tx=0x7f038c001730).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:42.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.678+0000 7f0399c0d700 1 --2- 172.21.15.103:0/2707404123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0394061a30 0x7f03941415a0 secure :-1 s=THROTTLE_DONE pgs=722 cs=0 l=1 rx=0x7f0394143ee0 tx=0x7f038c001730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.678+0000 7f0392ffd700 1 -- 172.21.15.103:0/2707404123 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f038c0101e0 con 0x7f0394061a30 2020-04-22T14:07:42.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.678+0000 7f0399c0d700 1 --2- 172.21.15.103:0/2707404123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0394061a30 0x7f03941415a0 secure :-1 s=THROTTLE_DONE pgs=722 cs=0 l=1 rx=0x7f0394143ee0 tx=0x7f038c001730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.678+0000 7f0399c0d700 1 --2- 172.21.15.103:0/2707404123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0394061a30 0x7f03941415a0 secure :-1 s=THROTTLE_DONE pgs=722 cs=0 l=1 rx=0x7f0394143ee0 tx=0x7f038c001730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.678+0000 7f0392ffd700 1 -- 172.21.15.103:0/2707404123 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038c010340 con 0x7f0394061a30 2020-04-22T14:07:42.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.678+0000 7f039be71700 1 -- 172.21.15.103:0/2707404123 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0394066530 con 0x7f0394061a30 2020-04-22T14:07:42.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.678+0000 7f0392ffd700 1 -- 172.21.15.103:0/2707404123 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f038c010760 con 0x7f0394061a30 2020-04-22T14:07:42.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.678+0000 7f039be71700 1 -- 172.21.15.103:0/2707404123 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0394062b50 con 0x7f0394061a30 2020-04-22T14:07:42.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.678+0000 7f0399c0d700 1 --2- 172.21.15.103:0/2707404123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0394061a30 0x7f03941415a0 secure :-1 s=THROTTLE_DONE pgs=722 cs=0 l=1 rx=0x7f0394143ee0 tx=0x7f038c001730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.679+0000 7f0392ffd700 1 -- 172.21.15.103:0/2707404123 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f038c006860 con 0x7f0394061a30 2020-04-22T14:07:42.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.679+0000 7f0399c0d700 1 --2- 172.21.15.103:0/2707404123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0394061a30 0x7f03941415a0 secure :-1 s=THROTTLE_DONE pgs=722 cs=0 l=1 rx=0x7f0394143ee0 tx=0x7f038c001730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.679+0000 7f039be71700 1 -- 172.21.15.103:0/2707404123 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0394056c90 con 0x7f0394061a30 2020-04-22T14:07:42.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.679+0000 7f0392ffd700 1 --2- 172.21.15.103:0/2707404123 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f037404d940 0x7f037404fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:42.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.679+0000 7f0392ffd700 1 -- 172.21.15.103:0/2707404123 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f038c0618e0 con 0x7f0394061a30 2020-04-22T14:07:42.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.679+0000 7f039940c700 1 --2- 172.21.15.103:0/2707404123 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f037404d940 0x7f037404fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:42.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.679+0000 7f039940c700 1 --2- 172.21.15.103:0/2707404123 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f037404d940 0x7f037404fe00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0388002f30 tx=0x7f0388007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.679+0000 7f039940c700 1 --2- 172.21.15.103:0/2707404123 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f037404d940 0x7f037404fe00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0388002f30 tx=0x7f0388007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.679+0000 7f039940c700 1 --2- 172.21.15.103:0/2707404123 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f037404d940 0x7f037404fe00 secure :-1 s=READY pgs=274 cs=0 l=1 rx=0x7f0388002f30 tx=0x7f0388007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:42.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.683+0000 7f0399c0d700 1 --2- 172.21.15.103:0/2707404123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0394061a30 0x7f03941415a0 secure :-1 s=THROTTLE_DONE pgs=722 cs=0 l=1 rx=0x7f0394143ee0 tx=0x7f038c001730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.683+0000 7f0392ffd700 1 -- 172.21.15.103:0/2707404123 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f038c03cc60 con 0x7f0394061a30 2020-04-22T14:07:42.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.823+0000 7f039be71700 1 -- 172.21.15.103:0/2707404123 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f03941457f0 con 0x7f0394061a30 2020-04-22T14:07:42.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.823+0000 7f0399c0d700 1 --2- 172.21.15.103:0/2707404123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0394061a30 0x7f03941415a0 secure :-1 s=THROTTLE_DONE pgs=722 cs=0 l=1 rx=0x7f0394143ee0 tx=0x7f038c001730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:42.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.824+0000 7f0392ffd700 1 -- 172.21.15.103:0/2707404123 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v54) v1 ==== 92+0+10 (secure 0 0 0) 0x7f038c040280 con 0x7f0394061a30 2020-04-22T14:07:42.826 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:07:42.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.825+0000 7f039be71700 1 -- 172.21.15.103:0/2707404123 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f037404d940 msgr2=0x7f037404fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:42.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.825+0000 7f039be71700 1 --2- 172.21.15.103:0/2707404123 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f037404d940 0x7f037404fe00 secure :-1 s=READY pgs=274 cs=0 l=1 rx=0x7f0388002f30 tx=0x7f0388007a40).stop 2020-04-22T14:07:42.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.825+0000 7f039be71700 1 -- 172.21.15.103:0/2707404123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0394061a30 msgr2=0x7f03941415a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:42.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.825+0000 7f039be71700 1 --2- 172.21.15.103:0/2707404123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0394061a30 0x7f03941415a0 secure :-1 s=READY pgs=722 cs=0 l=1 rx=0x7f0394143ee0 tx=0x7f038c001730).stop 2020-04-22T14:07:42.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.825+0000 7f039be71700 1 -- 172.21.15.103:0/2707404123 shutdown_connections 2020-04-22T14:07:42.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.825+0000 7f039be71700 1 --2- 172.21.15.103:0/2707404123 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f037404d940 0x7f037404fe00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:42.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.825+0000 7f039be71700 1 --2- 172.21.15.103:0/2707404123 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0394141f20 0x7f0394064060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:42.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.825+0000 7f039be71700 1 --2- 172.21.15.103:0/2707404123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0394061a30 0x7f03941415a0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:42.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.825+0000 7f039be71700 1 -- 172.21.15.103:0/2707404123 >> 172.21.15.103:0/2707404123 conn(0x7f039405b7b0 msgr2=0x7f03940ae620 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:42.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.825+0000 7f039be71700 1 -- 172.21.15.103:0/2707404123 shutdown_connections 2020-04-22T14:07:42.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.825+0000 7f039be71700 1 -- 172.21.15.103:0/2707404123 wait complete. 2020-04-22T14:07:42.837 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:42.850 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-22T14:07:43.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.999+0000 7fe0ee9e9700 1 Processor -- start 2020-04-22T14:07:43.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:42.999+0000 7fe0ee9e9700 1 -- start start 2020-04-22T14:07:43.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.000+0000 7fe0ee9e9700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe0e80ac950 0x7fe0e8146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:43.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.000+0000 7fe0ee9e9700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0e81467e0 con 0x7fe0e80b9140 2020-04-22T14:07:43.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.000+0000 7fe0ee9e9700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0e8060050 con 0x7fe0e81470a0 2020-04-22T14:07:43.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.000+0000 7fe0ee9e9700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0e8147530 con 0x7fe0e80ac950 2020-04-22T14:07:43.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.000+0000 7fe0ecf86700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe0e81470a0 0x7fe0e8143090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42754/0 (socket says 172.21.15.103:42754) 2020-04-22T14:07:43.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.000+0000 7fe0ecf86700 1 -- 172.21.15.103:0/454688947 learned_addr learned my addr 172.21.15.103:0/454688947 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:43.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.000+0000 7fe0dffff700 1 --2- 172.21.15.103:0/454688947 >> v2:172.21.15.86:3300/0 conn(0x7fe0e80ac950 0x7fe0e8146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:43.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.000+0000 7fe0e77fe700 1 -- 172.21.15.103:0/454688947 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1959584111 0 0) 0x7fe0e8060050 con 0x7fe0e81470a0 2020-04-22T14:07:43.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.000+0000 7fe0e77fe700 1 -- 172.21.15.103:0/454688947 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0c8003230 con 0x7fe0e81470a0 2020-04-22T14:07:43.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.000+0000 7fe0dffff700 1 -- 172.21.15.103:0/454688947 >> v1:172.21.15.103:6789/0 conn(0x7fe0e81470a0 legacy=0x7fe0e8143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:43.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.001+0000 7fe0dffff700 1 -- 172.21.15.103:0/454688947 >> v1:172.21.15.86:6789/0 conn(0x7fe0e80b9140 legacy=0x7fe0e812b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:43.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.001+0000 7fe0e77fe700 1 -- 172.21.15.103:0/454688947 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2984378797 0 0) 0x7fe0e81467e0 con 0x7fe0e80b9140 2020-04-22T14:07:43.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.001+0000 7fe0dffff700 1 -- 172.21.15.103:0/454688947 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e80b9520 con 0x7fe0e80ac950 2020-04-22T14:07:43.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.001+0000 7fe0dffff700 1 --2- 172.21.15.103:0/454688947 >> v2:172.21.15.86:3300/0 conn(0x7fe0e80ac950 0x7fe0e8146c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe0d0002f30 tx=0x7fe0d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.001+0000 7fe0dffff700 1 --2- 172.21.15.103:0/454688947 >> v2:172.21.15.86:3300/0 conn(0x7fe0e80ac950 0x7fe0e8146c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe0d0002f30 tx=0x7fe0d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.001+0000 7fe0dffff700 1 --2- 172.21.15.103:0/454688947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0e80ac950 0x7fe0e8146c40 secure :-1 s=READY pgs=404 cs=0 l=1 rx=0x7fe0d0002f30 tx=0x7fe0d0007a40).ready entity=mon.0 client_cookie=ec998c0ff7127174 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:43.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.001+0000 7fe0dffff700 1 --2- 172.21.15.103:0/454688947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0e80ac950 0x7fe0e8146c40 secure :-1 s=THROTTLE_DONE pgs=404 cs=0 l=1 rx=0x7fe0d0002f30 tx=0x7fe0d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.001+0000 7fe0e77fe700 1 -- 172.21.15.103:0/454688947 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0d00113c0 con 0x7fe0e80ac950 2020-04-22T14:07:43.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.001+0000 7fe0dffff700 1 --2- 172.21.15.103:0/454688947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0e80ac950 0x7fe0e8146c40 secure :-1 s=THROTTLE_DONE pgs=404 cs=0 l=1 rx=0x7fe0d0002f30 tx=0x7fe0d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.001+0000 7fe0e77fe700 1 -- 172.21.15.103:0/454688947 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d0011520 con 0x7fe0e80ac950 2020-04-22T14:07:43.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.001+0000 7fe0dffff700 1 --2- 172.21.15.103:0/454688947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0e80ac950 0x7fe0e8146c40 secure :-1 s=THROTTLE_DONE pgs=404 cs=0 l=1 rx=0x7fe0d0002f30 tx=0x7fe0d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.001+0000 7fe0ee9e9700 1 -- 172.21.15.103:0/454688947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0e80ac950 msgr2=0x7fe0e8146c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:43.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.001+0000 7fe0e77fe700 1 -- 172.21.15.103:0/454688947 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0d0011880 con 0x7fe0e80ac950 2020-04-22T14:07:43.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.001+0000 7fe0ee9e9700 1 --2- 172.21.15.103:0/454688947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0e80ac950 0x7fe0e8146c40 secure :-1 s=READY pgs=404 cs=0 l=1 rx=0x7fe0d0002f30 tx=0x7fe0d0007a40).stop 2020-04-22T14:07:43.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.001+0000 7fe0ee9e9700 1 -- 172.21.15.103:0/454688947 shutdown_connections 2020-04-22T14:07:43.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.001+0000 7fe0ee9e9700 1 --2- 172.21.15.103:0/454688947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0e80ac950 0x7fe0e8146c40 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:43.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.001+0000 7fe0ee9e9700 1 -- 172.21.15.103:0/454688947 >> 172.21.15.103:0/454688947 conn(0x7fe0e805b7b0 msgr2=0x7fe0e80b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:43.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.001+0000 7fe0ee9e9700 1 -- 172.21.15.103:0/454688947 shutdown_connections 2020-04-22T14:07:43.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.001+0000 7fe0ee9e9700 1 -- 172.21.15.103:0/454688947 wait complete. 2020-04-22T14:07:43.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.002+0000 7fe0ee9e9700 1 Processor -- start 2020-04-22T14:07:43.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.002+0000 7fe0ee9e9700 1 -- start start 2020-04-22T14:07:43.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.003+0000 7fe0ee9e9700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe0e80b9140 0x7fe0e8066470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:43.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.003+0000 7fe0ee9e9700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe0e81470a0 0x7fe0e8142660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:43.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.003+0000 7fe0ee9e9700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0e80668d0 con 0x7fe0e80ac950 2020-04-22T14:07:43.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.003+0000 7fe0ee9e9700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0e8136460 con 0x7fe0e81470a0 2020-04-22T14:07:43.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.003+0000 7fe0ee9e9700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0e81366c0 con 0x7fe0e80b9140 2020-04-22T14:07:43.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.003+0000 7fe0e7fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe0e80ac950 0x7fe0e8111690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42760/0 (socket says 172.21.15.103:42760) 2020-04-22T14:07:43.015 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.003+0000 7fe0e7fff700 1 -- 172.21.15.103:0/1638150897 learned_addr learned my addr 172.21.15.103:0/1638150897 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:43.015 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.003+0000 7fe0dffff700 1 --2- 172.21.15.103:0/1638150897 >> v2:172.21.15.103:3300/0 conn(0x7fe0e80b9140 0x7fe0e8066470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:43.015 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.003+0000 7fe0ecf86700 1 --2- 172.21.15.103:0/1638150897 >> v2:172.21.15.86:3300/0 conn(0x7fe0e81470a0 0x7fe0e8142660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:43.015 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.003+0000 7fe0e5ffb700 1 -- 172.21.15.103:0/1638150897 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2174351359 0 0) 0x7fe0d8001030 con 0x7fe0e80ac950 2020-04-22T14:07:43.015 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.003+0000 7fe0e5ffb700 1 -- 172.21.15.103:0/1638150897 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0cc002fe0 con 0x7fe0e80ac950 2020-04-22T14:07:43.016 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.004+0000 7fe0dffff700 1 -- 172.21.15.103:0/1638150897 >> v2:172.21.15.86:3300/0 conn(0x7fe0e81470a0 msgr2=0x7fe0e8142660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:43.016 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.004+0000 7fe0dffff700 1 --2- 172.21.15.103:0/1638150897 >> v2:172.21.15.86:3300/0 conn(0x7fe0e81470a0 0x7fe0e8142660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:43.016 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.004+0000 7fe0dffff700 1 -- 172.21.15.103:0/1638150897 >> v1:172.21.15.103:6789/0 conn(0x7fe0e80ac950 legacy=0x7fe0e8111690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:43.016 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.004+0000 7fe0dffff700 1 -- 172.21.15.103:0/1638150897 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e8136960 con 0x7fe0e80b9140 2020-04-22T14:07:43.016 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.004+0000 7fe0dffff700 1 --2- 172.21.15.103:0/1638150897 >> v2:172.21.15.103:3300/0 conn(0x7fe0e80b9140 0x7fe0e8066470 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe0d0002f30 tx=0x7fe0d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.016 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.004+0000 7fe0dffff700 1 --2- 172.21.15.103:0/1638150897 >> v2:172.21.15.103:3300/0 conn(0x7fe0e80b9140 0x7fe0e8066470 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe0d0002f30 tx=0x7fe0d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.016 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.004+0000 7fe0dffff700 1 --2- 172.21.15.103:0/1638150897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0e80b9140 0x7fe0e8066470 secure :-1 s=READY pgs=725 cs=0 l=1 rx=0x7fe0d0002f30 tx=0x7fe0d0007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:43.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.004+0000 7fe0dffff700 1 --2- 172.21.15.103:0/1638150897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0e80b9140 0x7fe0e8066470 secure :-1 s=THROTTLE_DONE pgs=725 cs=0 l=1 rx=0x7fe0d0002f30 tx=0x7fe0d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.004+0000 7fe0e5ffb700 1 -- 172.21.15.103:0/1638150897 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0d000f7b0 con 0x7fe0e80b9140 2020-04-22T14:07:43.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.004+0000 7fe0dffff700 1 --2- 172.21.15.103:0/1638150897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0e80b9140 0x7fe0e8066470 secure :-1 s=THROTTLE_DONE pgs=725 cs=0 l=1 rx=0x7fe0d0002f30 tx=0x7fe0d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.004+0000 7fe0e5ffb700 1 -- 172.21.15.103:0/1638150897 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d0007170 con 0x7fe0e80b9140 2020-04-22T14:07:43.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.004+0000 7fe0dffff700 1 --2- 172.21.15.103:0/1638150897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0e80b9140 0x7fe0e8066470 secure :-1 s=THROTTLE_DONE pgs=725 cs=0 l=1 rx=0x7fe0d0002f30 tx=0x7fe0d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.004+0000 7fe0ee9e9700 1 -- 172.21.15.103:0/1638150897 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e8136e00 con 0x7fe0e80b9140 2020-04-22T14:07:43.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.004+0000 7fe0e5ffb700 1 -- 172.21.15.103:0/1638150897 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0d0007510 con 0x7fe0e80b9140 2020-04-22T14:07:43.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.004+0000 7fe0ee9e9700 1 -- 172.21.15.103:0/1638150897 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0e8142ac0 con 0x7fe0e80b9140 2020-04-22T14:07:43.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.004+0000 7fe0dffff700 1 --2- 172.21.15.103:0/1638150897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0e80b9140 0x7fe0e8066470 secure :-1 s=THROTTLE_DONE pgs=725 cs=0 l=1 rx=0x7fe0d0002f30 tx=0x7fe0d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.005+0000 7fe0ee9e9700 1 -- 172.21.15.103:0/1638150897 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0e8056c90 con 0x7fe0e80b9140 2020-04-22T14:07:43.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.005+0000 7fe0e5ffb700 1 -- 172.21.15.103:0/1638150897 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fe0d00056c0 con 0x7fe0e80b9140 2020-04-22T14:07:43.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.005+0000 7fe0dffff700 1 --2- 172.21.15.103:0/1638150897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0e80b9140 0x7fe0e8066470 secure :-1 s=THROTTLE_DONE pgs=725 cs=0 l=1 rx=0x7fe0d0002f30 tx=0x7fe0d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.005+0000 7fe0e5ffb700 1 --2- 172.21.15.103:0/1638150897 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe0cc04db50 0x7fe0cc050010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:43.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.005+0000 7fe0e5ffb700 1 -- 172.21.15.103:0/1638150897 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe0d0061d70 con 0x7fe0e80b9140 2020-04-22T14:07:43.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.005+0000 7fe0e7fff700 1 --2- 172.21.15.103:0/1638150897 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe0cc04db50 0x7fe0cc050010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:43.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.005+0000 7fe0e7fff700 1 --2- 172.21.15.103:0/1638150897 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe0cc04db50 0x7fe0cc050010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe0d8001260 tx=0x7fe0d8001930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.006+0000 7fe0e7fff700 1 --2- 172.21.15.103:0/1638150897 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe0cc04db50 0x7fe0cc050010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe0d8001260 tx=0x7fe0d8001930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.006+0000 7fe0e7fff700 1 --2- 172.21.15.103:0/1638150897 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe0cc04db50 0x7fe0cc050010 secure :-1 s=READY pgs=275 cs=0 l=1 rx=0x7fe0d8001260 tx=0x7fe0d8001930).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:43.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.009+0000 7fe0dffff700 1 --2- 172.21.15.103:0/1638150897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0e80b9140 0x7fe0e8066470 secure :-1 s=THROTTLE_DONE pgs=725 cs=0 l=1 rx=0x7fe0d0002f30 tx=0x7fe0d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.009+0000 7fe0e5ffb700 1 -- 172.21.15.103:0/1638150897 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fe0d003d1b0 con 0x7fe0e80b9140 2020-04-22T14:07:43.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.150+0000 7fe0ee9e9700 1 -- 172.21.15.103:0/1638150897 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe0e8066ce0 con 0x7fe0e80b9140 2020-04-22T14:07:43.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.151+0000 7fe0dffff700 1 --2- 172.21.15.103:0/1638150897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0e80b9140 0x7fe0e8066470 secure :-1 s=THROTTLE_DONE pgs=725 cs=0 l=1 rx=0x7fe0d0002f30 tx=0x7fe0d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.151+0000 7fe0e5ffb700 1 -- 172.21.15.103:0/1638150897 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+10 (secure 0 0 0) 0x7fe0d00407d0 con 0x7fe0e80b9140 2020-04-22T14:07:43.153 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:07:43.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.152+0000 7fe0ee9e9700 1 -- 172.21.15.103:0/1638150897 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe0cc04db50 msgr2=0x7fe0cc050010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:43.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.152+0000 7fe0ee9e9700 1 --2- 172.21.15.103:0/1638150897 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe0cc04db50 0x7fe0cc050010 secure :-1 s=READY pgs=275 cs=0 l=1 rx=0x7fe0d8001260 tx=0x7fe0d8001930).stop 2020-04-22T14:07:43.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.152+0000 7fe0ee9e9700 1 -- 172.21.15.103:0/1638150897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0e80b9140 msgr2=0x7fe0e8066470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:43.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.152+0000 7fe0ee9e9700 1 --2- 172.21.15.103:0/1638150897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0e80b9140 0x7fe0e8066470 secure :-1 s=READY pgs=725 cs=0 l=1 rx=0x7fe0d0002f30 tx=0x7fe0d0007a40).stop 2020-04-22T14:07:43.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.152+0000 7fe0ee9e9700 1 -- 172.21.15.103:0/1638150897 shutdown_connections 2020-04-22T14:07:43.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.152+0000 7fe0ee9e9700 1 --2- 172.21.15.103:0/1638150897 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe0cc04db50 0x7fe0cc050010 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:43.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.152+0000 7fe0ee9e9700 1 --2- 172.21.15.103:0/1638150897 >> v2:172.21.15.86:3300/0 conn(0x7fe0e81470a0 0x7fe0e8142660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:43.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.152+0000 7fe0ee9e9700 1 --2- 172.21.15.103:0/1638150897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0e80b9140 0x7fe0e8066470 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:43.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.152+0000 7fe0ee9e9700 1 -- 172.21.15.103:0/1638150897 >> 172.21.15.103:0/1638150897 conn(0x7fe0e805b7b0 msgr2=0x7fe0e80b5260 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:43.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.152+0000 7fe0ee9e9700 1 -- 172.21.15.103:0/1638150897 shutdown_connections 2020-04-22T14:07:43.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.152+0000 7fe0ee9e9700 1 -- 172.21.15.103:0/1638150897 wait complete. 2020-04-22T14:07:43.164 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:43.179 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-22T14:07:43.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.326+0000 7fdf4c5ed700 1 Processor -- start 2020-04-22T14:07:43.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.326+0000 7fdf4c5ed700 1 -- start start 2020-04-22T14:07:43.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.326+0000 7fdf4c5ed700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdf44061a30 0x7fdf440b4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:43.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.326+0000 7fdf4c5ed700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdf440acb10 0x7fdf440ae920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:43.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.326+0000 7fdf4c5ed700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf44060250 con 0x7fdf440aed80 2020-04-22T14:07:43.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.326+0000 7fdf4c5ed700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf440b94d0 con 0x7fdf44061a30 2020-04-22T14:07:43.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.326+0000 7fdf4c5ed700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf440623c0 con 0x7fdf440acb10 2020-04-22T14:07:43.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.327+0000 7fdf49b88700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdf440acb10 0x7fdf440ae920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:43.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.327+0000 7fdf49b88700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdf440acb10 0x7fdf440ae920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50578/0 (socket says 172.21.15.103:50578) 2020-04-22T14:07:43.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.327+0000 7fdf49b88700 1 -- 172.21.15.103:0/2808289382 learned_addr learned my addr 172.21.15.103:0/2808289382 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:43.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.327+0000 7fdf4a389700 1 --2- 172.21.15.103:0/2808289382 >> v2:172.21.15.86:3300/0 conn(0x7fdf44061a30 0x7fdf440b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:43.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.327+0000 7fdf49b88700 1 -- 172.21.15.103:0/2808289382 >> v2:172.21.15.86:3300/0 conn(0x7fdf44061a30 msgr2=0x7fdf440b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:43.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.327+0000 7fdf49b88700 1 --2- 172.21.15.103:0/2808289382 >> v2:172.21.15.86:3300/0 conn(0x7fdf44061a30 0x7fdf440b4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:43.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.327+0000 7fdf49b88700 1 -- 172.21.15.103:0/2808289382 >> v1:172.21.15.86:6789/0 conn(0x7fdf440aed80 legacy=0x7fdf440b8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:43.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.327+0000 7fdf49b88700 1 -- 172.21.15.103:0/2808289382 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf44062660 con 0x7fdf440acb10 2020-04-22T14:07:43.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.327+0000 7fdf49b88700 1 --2- 172.21.15.103:0/2808289382 >> v2:172.21.15.103:3300/0 conn(0x7fdf440acb10 0x7fdf440ae920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdf34002f30 tx=0x7fdf34007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.327+0000 7fdf49b88700 1 --2- 172.21.15.103:0/2808289382 >> v2:172.21.15.103:3300/0 conn(0x7fdf440acb10 0x7fdf440ae920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdf34002f30 tx=0x7fdf34007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.327+0000 7fdf49b88700 1 --2- 172.21.15.103:0/2808289382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf440acb10 0x7fdf440ae920 secure :-1 s=READY pgs=726 cs=0 l=1 rx=0x7fdf34002f30 tx=0x7fdf34007a40).ready entity=mon.1 client_cookie=1c9aec140b96d8c6 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:43.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.327+0000 7fdf49b88700 1 --2- 172.21.15.103:0/2808289382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf440acb10 0x7fdf440ae920 secure :-1 s=THROTTLE_DONE pgs=726 cs=0 l=1 rx=0x7fdf34002f30 tx=0x7fdf34007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.327+0000 7fdf49387700 1 -- 172.21.15.103:0/2808289382 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf34011720 con 0x7fdf440acb10 2020-04-22T14:07:43.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.327+0000 7fdf49b88700 1 --2- 172.21.15.103:0/2808289382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf440acb10 0x7fdf440ae920 secure :-1 s=THROTTLE_DONE pgs=726 cs=0 l=1 rx=0x7fdf34002f30 tx=0x7fdf34007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.327+0000 7fdf49b88700 1 --2- 172.21.15.103:0/2808289382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf440acb10 0x7fdf440ae920 secure :-1 s=THROTTLE_DONE pgs=726 cs=0 l=1 rx=0x7fdf34002f30 tx=0x7fdf34007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.327+0000 7fdf49387700 1 -- 172.21.15.103:0/2808289382 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf34011880 con 0x7fdf440acb10 2020-04-22T14:07:43.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.327+0000 7fdf49387700 1 -- 172.21.15.103:0/2808289382 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf34011ca0 con 0x7fdf440acb10 2020-04-22T14:07:43.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.327+0000 7fdf4c5ed700 1 -- 172.21.15.103:0/2808289382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf440acb10 msgr2=0x7fdf440ae920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:43.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.327+0000 7fdf4c5ed700 1 --2- 172.21.15.103:0/2808289382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf440acb10 0x7fdf440ae920 secure :-1 s=READY pgs=726 cs=0 l=1 rx=0x7fdf34002f30 tx=0x7fdf34007a40).stop 2020-04-22T14:07:43.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.328+0000 7fdf4c5ed700 1 -- 172.21.15.103:0/2808289382 shutdown_connections 2020-04-22T14:07:43.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.328+0000 7fdf4c5ed700 1 --2- 172.21.15.103:0/2808289382 >> v2:172.21.15.86:3300/0 conn(0x7fdf44061a30 0x7fdf440b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:43.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.328+0000 7fdf4c5ed700 1 --2- 172.21.15.103:0/2808289382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf440acb10 0x7fdf440ae920 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:43.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.328+0000 7fdf4c5ed700 1 -- 172.21.15.103:0/2808289382 >> 172.21.15.103:0/2808289382 conn(0x7fdf4405b7b0 msgr2=0x7fdf440b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:43.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.328+0000 7fdf4c5ed700 1 -- 172.21.15.103:0/2808289382 shutdown_connections 2020-04-22T14:07:43.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.328+0000 7fdf4c5ed700 1 -- 172.21.15.103:0/2808289382 wait complete. 2020-04-22T14:07:43.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.329+0000 7fdf4c5ed700 1 Processor -- start 2020-04-22T14:07:43.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.329+0000 7fdf4c5ed700 1 -- start start 2020-04-22T14:07:43.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.330+0000 7fdf4c5ed700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdf440acb10 0x7fdf441516a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:43.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.330+0000 7fdf4c5ed700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdf440aed80 0x7fdf44144280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:43.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.330+0000 7fdf4c5ed700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf441446e0 con 0x7fdf44061a30 2020-04-22T14:07:43.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.330+0000 7fdf4c5ed700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf44063bb0 con 0x7fdf440acb10 2020-04-22T14:07:43.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.330+0000 7fdf4c5ed700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf44062ac0 con 0x7fdf440aed80 2020-04-22T14:07:43.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.330+0000 7fdf4a389700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fdf44061a30 0x7fdf440634a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42772/0 (socket says 172.21.15.103:42772) 2020-04-22T14:07:43.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.330+0000 7fdf4a389700 1 -- 172.21.15.103:0/1652206943 learned_addr learned my addr 172.21.15.103:0/1652206943 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:43.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.330+0000 7fdf49b88700 1 --2- 172.21.15.103:0/1652206943 >> v2:172.21.15.103:3300/0 conn(0x7fdf440acb10 0x7fdf441516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:43.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.330+0000 7fdf4ab8a700 1 --2- 172.21.15.103:0/1652206943 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdf440aed80 0x7fdf44144280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:43.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.330+0000 7fdf337fe700 1 -- 172.21.15.103:0/1652206943 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1520832581 0 0) 0x7fdf400022c0 con 0x7fdf44061a30 2020-04-22T14:07:43.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.330+0000 7fdf337fe700 1 -- 172.21.15.103:0/1652206943 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf24002fe0 con 0x7fdf44061a30 2020-04-22T14:07:43.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.330+0000 7fdf49b88700 1 -- 172.21.15.103:0/1652206943 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdf440aed80 msgr2=0x7fdf44144280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:43.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.330+0000 7fdf49b88700 1 --2- 172.21.15.103:0/1652206943 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdf440aed80 0x7fdf44144280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:43.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.330+0000 7fdf49b88700 1 -- 172.21.15.103:0/1652206943 >> v1:172.21.15.103:6789/0 conn(0x7fdf44061a30 legacy=0x7fdf440634a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:43.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.330+0000 7fdf49b88700 1 -- 172.21.15.103:0/1652206943 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf44062d60 con 0x7fdf440acb10 2020-04-22T14:07:43.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.330+0000 7fdf49b88700 1 --2- 172.21.15.103:0/1652206943 >> v2:172.21.15.103:3300/0 conn(0x7fdf440acb10 0x7fdf441516a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdf34002f30 tx=0x7fdf34007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.330+0000 7fdf49b88700 1 --2- 172.21.15.103:0/1652206943 >> v2:172.21.15.103:3300/0 conn(0x7fdf440acb10 0x7fdf441516a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdf34002f30 tx=0x7fdf34007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.330+0000 7fdf49b88700 1 --2- 172.21.15.103:0/1652206943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf440acb10 0x7fdf441516a0 secure :-1 s=READY pgs=728 cs=0 l=1 rx=0x7fdf34002f30 tx=0x7fdf34007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:43.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.330+0000 7fdf49b88700 1 --2- 172.21.15.103:0/1652206943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf440acb10 0x7fdf441516a0 secure :-1 s=THROTTLE_DONE pgs=728 cs=0 l=1 rx=0x7fdf34002f30 tx=0x7fdf34007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.330+0000 7fdf337fe700 1 -- 172.21.15.103:0/1652206943 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf34007360 con 0x7fdf440acb10 2020-04-22T14:07:43.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.330+0000 7fdf49b88700 1 --2- 172.21.15.103:0/1652206943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf440acb10 0x7fdf441516a0 secure :-1 s=THROTTLE_DONE pgs=728 cs=0 l=1 rx=0x7fdf34002f30 tx=0x7fdf34007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.330+0000 7fdf49b88700 1 --2- 172.21.15.103:0/1652206943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf440acb10 0x7fdf441516a0 secure :-1 s=THROTTLE_DONE pgs=728 cs=0 l=1 rx=0x7fdf34002f30 tx=0x7fdf34007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.330+0000 7fdf337fe700 1 -- 172.21.15.103:0/1652206943 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf340074c0 con 0x7fdf440acb10 2020-04-22T14:07:43.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.330+0000 7fdf4c5ed700 1 -- 172.21.15.103:0/1652206943 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf44063060 con 0x7fdf440acb10 2020-04-22T14:07:43.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.330+0000 7fdf337fe700 1 -- 172.21.15.103:0/1652206943 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf340058b0 con 0x7fdf440acb10 2020-04-22T14:07:43.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.330+0000 7fdf4c5ed700 1 -- 172.21.15.103:0/1652206943 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf440667e0 con 0x7fdf440acb10 2020-04-22T14:07:43.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.331+0000 7fdf49b88700 1 --2- 172.21.15.103:0/1652206943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf440acb10 0x7fdf441516a0 secure :-1 s=THROTTLE_DONE pgs=728 cs=0 l=1 rx=0x7fdf34002f30 tx=0x7fdf34007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.331+0000 7fdf337fe700 1 -- 172.21.15.103:0/1652206943 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fdf34005b20 con 0x7fdf440acb10 2020-04-22T14:07:43.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.331+0000 7fdf49b88700 1 --2- 172.21.15.103:0/1652206943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf440acb10 0x7fdf441516a0 secure :-1 s=THROTTLE_DONE pgs=728 cs=0 l=1 rx=0x7fdf34002f30 tx=0x7fdf34007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.332+0000 7fdf4c5ed700 1 -- 172.21.15.103:0/1652206943 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf44056c90 con 0x7fdf440acb10 2020-04-22T14:07:43.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.332+0000 7fdf337fe700 1 --2- 172.21.15.103:0/1652206943 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdf2404dd90 0x7fdf24050250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:43.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.332+0000 7fdf337fe700 1 -- 172.21.15.103:0/1652206943 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdf34061a00 con 0x7fdf440acb10 2020-04-22T14:07:43.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.332+0000 7fdf4a389700 1 --2- 172.21.15.103:0/1652206943 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdf2404dd90 0x7fdf24050250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:43.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.332+0000 7fdf4a389700 1 --2- 172.21.15.103:0/1652206943 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdf2404dd90 0x7fdf24050250 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdf400032b0 tx=0x7fdf40002850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.332+0000 7fdf4a389700 1 --2- 172.21.15.103:0/1652206943 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdf2404dd90 0x7fdf24050250 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdf400032b0 tx=0x7fdf40002850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.332+0000 7fdf4a389700 1 --2- 172.21.15.103:0/1652206943 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdf2404dd90 0x7fdf24050250 secure :-1 s=READY pgs=276 cs=0 l=1 rx=0x7fdf400032b0 tx=0x7fdf40002850).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:43.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.336+0000 7fdf49b88700 1 --2- 172.21.15.103:0/1652206943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf440acb10 0x7fdf441516a0 secure :-1 s=THROTTLE_DONE pgs=728 cs=0 l=1 rx=0x7fdf34002f30 tx=0x7fdf34007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.336+0000 7fdf337fe700 1 -- 172.21.15.103:0/1652206943 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fdf3403cd80 con 0x7fdf440acb10 2020-04-22T14:07:43.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.478+0000 7fdf4c5ed700 1 -- 172.21.15.103:0/1652206943 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdf4406a960 con 0x7fdf440acb10 2020-04-22T14:07:43.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.479+0000 7fdf49b88700 1 --2- 172.21.15.103:0/1652206943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf440acb10 0x7fdf441516a0 secure :-1 s=THROTTLE_DONE pgs=728 cs=0 l=1 rx=0x7fdf34002f30 tx=0x7fdf34007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.479+0000 7fdf337fe700 1 -- 172.21.15.103:0/1652206943 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+10 (secure 0 0 0) 0x7fdf340403a0 con 0x7fdf440acb10 2020-04-22T14:07:43.481 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:07:43.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.480+0000 7fdf4c5ed700 1 -- 172.21.15.103:0/1652206943 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdf2404dd90 msgr2=0x7fdf24050250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:43.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.480+0000 7fdf4c5ed700 1 --2- 172.21.15.103:0/1652206943 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdf2404dd90 0x7fdf24050250 secure :-1 s=READY pgs=276 cs=0 l=1 rx=0x7fdf400032b0 tx=0x7fdf40002850).stop 2020-04-22T14:07:43.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.480+0000 7fdf4c5ed700 1 -- 172.21.15.103:0/1652206943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf440acb10 msgr2=0x7fdf441516a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:43.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.480+0000 7fdf4c5ed700 1 --2- 172.21.15.103:0/1652206943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf440acb10 0x7fdf441516a0 secure :-1 s=READY pgs=728 cs=0 l=1 rx=0x7fdf34002f30 tx=0x7fdf34007a40).stop 2020-04-22T14:07:43.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.480+0000 7fdf4c5ed700 1 -- 172.21.15.103:0/1652206943 shutdown_connections 2020-04-22T14:07:43.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.480+0000 7fdf4c5ed700 1 --2- 172.21.15.103:0/1652206943 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdf2404dd90 0x7fdf24050250 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:43.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.480+0000 7fdf4c5ed700 1 --2- 172.21.15.103:0/1652206943 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdf440aed80 0x7fdf44144280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:43.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.480+0000 7fdf4c5ed700 1 --2- 172.21.15.103:0/1652206943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf440acb10 0x7fdf441516a0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:43.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.480+0000 7fdf4c5ed700 1 -- 172.21.15.103:0/1652206943 >> 172.21.15.103:0/1652206943 conn(0x7fdf4405b7b0 msgr2=0x7fdf440b6eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:43.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.480+0000 7fdf4c5ed700 1 -- 172.21.15.103:0/1652206943 shutdown_connections 2020-04-22T14:07:43.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.480+0000 7fdf4c5ed700 1 -- 172.21.15.103:0/1652206943 wait complete. 2020-04-22T14:07:43.492 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-04-22T14:07:43.492 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:43.507 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:07:43.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.650+0000 7f369c915700 1 Processor -- start 2020-04-22T14:07:43.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.650+0000 7f369c915700 1 -- start start 2020-04-22T14:07:43.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.651+0000 7f369c915700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3698065fe0 0x7f36981464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:43.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.651+0000 7f369c915700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3698063e30 0x7f36980642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:43.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.651+0000 7f369c915700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3698143300 con 0x7f369812c0d0 2020-04-22T14:07:43.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.651+0000 7f369c915700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36981435a0 con 0x7f3698065fe0 2020-04-22T14:07:43.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.651+0000 7f369c915700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3698143840 con 0x7f3698063e30 2020-04-22T14:07:43.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.651+0000 7f3695d9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3698065fe0 0x7f36981464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:43.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.651+0000 7f3695d9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3698065fe0 0x7f36981464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50592/0 (socket says 172.21.15.103:50592) 2020-04-22T14:07:43.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.651+0000 7f3695d9b700 1 -- 172.21.15.103:0/3352655538 learned_addr learned my addr 172.21.15.103:0/3352655538 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:43.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.651+0000 7f3696d9d700 1 --2- 172.21.15.103:0/3352655538 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3698063e30 0x7f36980642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:43.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.651+0000 7f3695d9b700 1 -- 172.21.15.103:0/3352655538 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3698063e30 msgr2=0x7f36980642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:43.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.651+0000 7f3695d9b700 1 --2- 172.21.15.103:0/3352655538 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3698063e30 0x7f36980642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:43.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.651+0000 7f3695d9b700 1 -- 172.21.15.103:0/3352655538 >> v1:172.21.15.86:6789/0 conn(0x7f369812c0d0 legacy=0x7f369805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:43.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.651+0000 7f3695d9b700 1 -- 172.21.15.103:0/3352655538 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369805bb50 con 0x7f3698065fe0 2020-04-22T14:07:43.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.651+0000 7f3695d9b700 1 --2- 172.21.15.103:0/3352655538 >> v2:172.21.15.103:3300/0 conn(0x7f3698065fe0 0x7f36981464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3688002f30 tx=0x7f3688007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.651+0000 7f3695d9b700 1 --2- 172.21.15.103:0/3352655538 >> v2:172.21.15.103:3300/0 conn(0x7f3698065fe0 0x7f36981464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3688002f30 tx=0x7f3688007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.651+0000 7f3695d9b700 1 --2- 172.21.15.103:0/3352655538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3698065fe0 0x7f36981464e0 secure :-1 s=READY pgs=729 cs=0 l=1 rx=0x7f3688002f30 tx=0x7f3688007a40).ready entity=mon.1 client_cookie=17f107b4429df1e3 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:43.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.651+0000 7f3695d9b700 1 --2- 172.21.15.103:0/3352655538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3698065fe0 0x7f36981464e0 secure :-1 s=THROTTLE_DONE pgs=729 cs=0 l=1 rx=0x7f3688002f30 tx=0x7f3688007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.652+0000 7f3695d9b700 1 --2- 172.21.15.103:0/3352655538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3698065fe0 0x7f36981464e0 secure :-1 s=THROTTLE_DONE pgs=729 cs=0 l=1 rx=0x7f3688002f30 tx=0x7f3688007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.652+0000 7f369559a700 1 -- 172.21.15.103:0/3352655538 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3688011670 con 0x7f3698065fe0 2020-04-22T14:07:43.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.652+0000 7f3695d9b700 1 --2- 172.21.15.103:0/3352655538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3698065fe0 0x7f36981464e0 secure :-1 s=THROTTLE_DONE pgs=729 cs=0 l=1 rx=0x7f3688002f30 tx=0x7f3688007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.652+0000 7f369559a700 1 -- 172.21.15.103:0/3352655538 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3688011810 con 0x7f3698065fe0 2020-04-22T14:07:43.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.652+0000 7f369559a700 1 -- 172.21.15.103:0/3352655538 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3688011c30 con 0x7f3698065fe0 2020-04-22T14:07:43.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.652+0000 7f369c915700 1 -- 172.21.15.103:0/3352655538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3698065fe0 msgr2=0x7f36981464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:43.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.652+0000 7f369c915700 1 --2- 172.21.15.103:0/3352655538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3698065fe0 0x7f36981464e0 secure :-1 s=READY pgs=729 cs=0 l=1 rx=0x7f3688002f30 tx=0x7f3688007a40).stop 2020-04-22T14:07:43.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.652+0000 7f369c915700 1 -- 172.21.15.103:0/3352655538 shutdown_connections 2020-04-22T14:07:43.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.652+0000 7f369c915700 1 --2- 172.21.15.103:0/3352655538 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3698063e30 0x7f36980642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:43.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.652+0000 7f369c915700 1 --2- 172.21.15.103:0/3352655538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3698065fe0 0x7f36981464e0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:43.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.652+0000 7f369c915700 1 -- 172.21.15.103:0/3352655538 >> 172.21.15.103:0/3352655538 conn(0x7f36980b9160 msgr2=0x7f369805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:43.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.652+0000 7f369c915700 1 -- 172.21.15.103:0/3352655538 shutdown_connections 2020-04-22T14:07:43.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.652+0000 7f369c915700 1 -- 172.21.15.103:0/3352655538 wait complete. 2020-04-22T14:07:43.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.653+0000 7f369c915700 1 Processor -- start 2020-04-22T14:07:43.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.653+0000 7f369c915700 1 -- start start 2020-04-22T14:07:43.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.654+0000 7f369c915700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3698063e30 0x7f369812b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:43.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.654+0000 7f369c915700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f369812c0d0 0x7f3698064990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:43.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.654+0000 7f369c915700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3698064df0 con 0x7f3698065fe0 2020-04-22T14:07:43.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.654+0000 7f369c915700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36981296d0 con 0x7f369812c0d0 2020-04-22T14:07:43.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.654+0000 7f369c915700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3698128b70 con 0x7f3698063e30 2020-04-22T14:07:43.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.654+0000 7f3696d9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f369812c0d0 0x7f3698064990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:43.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.654+0000 7f3695d9b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f3698065fe0 0x7f3698125ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42788/0 (socket says 172.21.15.103:42788) 2020-04-22T14:07:43.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.654+0000 7f3695d9b700 1 -- 172.21.15.103:0/3672659208 learned_addr learned my addr 172.21.15.103:0/3672659208 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:43.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.654+0000 7f369659c700 1 --2- 172.21.15.103:0/3672659208 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3698063e30 0x7f369812b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:43.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.654+0000 7f3696d9d700 1 -- 172.21.15.103:0/3672659208 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3698063e30 msgr2=0x7f369812b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:43.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.654+0000 7f3696d9d700 1 --2- 172.21.15.103:0/3672659208 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3698063e30 0x7f369812b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:43.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.654+0000 7f3696d9d700 1 -- 172.21.15.103:0/3672659208 >> v1:172.21.15.103:6789/0 conn(0x7f3698065fe0 legacy=0x7f3698125ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:43.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.654+0000 7f368f7fe700 1 -- 172.21.15.103:0/3672659208 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3169494395 0 0) 0x7f369805bb50 con 0x7f3698065fe0 2020-04-22T14:07:43.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.654+0000 7f3696d9d700 1 -- 172.21.15.103:0/3672659208 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3698128e10 con 0x7f369812c0d0 2020-04-22T14:07:43.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.654+0000 7f3696d9d700 1 --2- 172.21.15.103:0/3672659208 >> v2:172.21.15.103:3300/0 conn(0x7f369812c0d0 0x7f3698064990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3680002f30 tx=0x7f3680010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.654+0000 7f3696d9d700 1 --2- 172.21.15.103:0/3672659208 >> v2:172.21.15.103:3300/0 conn(0x7f369812c0d0 0x7f3698064990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3680002f30 tx=0x7f3680010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.654+0000 7f3696d9d700 1 --2- 172.21.15.103:0/3672659208 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f369812c0d0 0x7f3698064990 secure :-1 s=READY pgs=731 cs=0 l=1 rx=0x7f3680002f30 tx=0x7f3680010b40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:43.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.654+0000 7f3696d9d700 1 --2- 172.21.15.103:0/3672659208 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f369812c0d0 0x7f3698064990 secure :-1 s=THROTTLE_DONE pgs=731 cs=0 l=1 rx=0x7f3680002f30 tx=0x7f3680010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.654+0000 7f368f7fe700 1 -- 172.21.15.103:0/3672659208 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3680007550 con 0x7f369812c0d0 2020-04-22T14:07:43.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.654+0000 7f3696d9d700 1 --2- 172.21.15.103:0/3672659208 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f369812c0d0 0x7f3698064990 secure :-1 s=THROTTLE_DONE pgs=731 cs=0 l=1 rx=0x7f3680002f30 tx=0x7f3680010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.654+0000 7f3696d9d700 1 --2- 172.21.15.103:0/3672659208 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f369812c0d0 0x7f3698064990 secure :-1 s=THROTTLE_DONE pgs=731 cs=0 l=1 rx=0x7f3680002f30 tx=0x7f3680010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.654+0000 7f368f7fe700 1 -- 172.21.15.103:0/3672659208 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36800056c0 con 0x7f369812c0d0 2020-04-22T14:07:43.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.654+0000 7f369c915700 1 -- 172.21.15.103:0/3672659208 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3698129230 con 0x7f369812c0d0 2020-04-22T14:07:43.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.654+0000 7f368f7fe700 1 -- 172.21.15.103:0/3672659208 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3680005aa0 con 0x7f369812c0d0 2020-04-22T14:07:43.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.654+0000 7f369c915700 1 -- 172.21.15.103:0/3672659208 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3698142380 con 0x7f369812c0d0 2020-04-22T14:07:43.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.655+0000 7f3696d9d700 1 --2- 172.21.15.103:0/3672659208 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f369812c0d0 0x7f3698064990 secure :-1 s=THROTTLE_DONE pgs=731 cs=0 l=1 rx=0x7f3680002f30 tx=0x7f3680010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.655+0000 7f368f7fe700 1 -- 172.21.15.103:0/3672659208 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f3680005c50 con 0x7f369812c0d0 2020-04-22T14:07:43.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.655+0000 7f3696d9d700 1 --2- 172.21.15.103:0/3672659208 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f369812c0d0 0x7f3698064990 secure :-1 s=THROTTLE_DONE pgs=731 cs=0 l=1 rx=0x7f3680002f30 tx=0x7f3680010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.656+0000 7f369c915700 1 -- 172.21.15.103:0/3672659208 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3698056c90 con 0x7f369812c0d0 2020-04-22T14:07:43.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.656+0000 7f368f7fe700 1 --2- 172.21.15.103:0/3672659208 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f367c04d8b0 0x7f367c04fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:43.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.656+0000 7f368f7fe700 1 -- 172.21.15.103:0/3672659208 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f368000d0d0 con 0x7f369812c0d0 2020-04-22T14:07:43.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.656+0000 7f369659c700 1 --2- 172.21.15.103:0/3672659208 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f367c04d8b0 0x7f367c04fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:43.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.656+0000 7f369659c700 1 --2- 172.21.15.103:0/3672659208 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f367c04d8b0 0x7f367c04fd70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f36980b85b0 tx=0x7f36900041a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.656+0000 7f369659c700 1 --2- 172.21.15.103:0/3672659208 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f367c04d8b0 0x7f367c04fd70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f36980b85b0 tx=0x7f36900041a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.656+0000 7f369659c700 1 --2- 172.21.15.103:0/3672659208 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f367c04d8b0 0x7f367c04fd70 secure :-1 s=READY pgs=277 cs=0 l=1 rx=0x7f36980b85b0 tx=0x7f36900041a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:43.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.660+0000 7f3696d9d700 1 --2- 172.21.15.103:0/3672659208 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f369812c0d0 0x7f3698064990 secure :-1 s=THROTTLE_DONE pgs=731 cs=0 l=1 rx=0x7f3680002f30 tx=0x7f3680010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.660+0000 7f368f7fe700 1 -- 172.21.15.103:0/3672659208 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f368003c960 con 0x7f369812c0d0 2020-04-22T14:07:43.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.848+0000 7f369c915700 1 -- 172.21.15.103:0/3672659208 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3698063ba0 con 0x7f369812c0d0 2020-04-22T14:07:43.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.849+0000 7f3696d9d700 1 --2- 172.21.15.103:0/3672659208 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f369812c0d0 0x7f3698064990 secure :-1 s=THROTTLE_DONE pgs=731 cs=0 l=1 rx=0x7f3680002f30 tx=0x7f3680010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:43.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.849+0000 7f368f7fe700 1 -- 172.21.15.103:0/3672659208 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f368003ff80 con 0x7f369812c0d0 2020-04-22T14:07:43.852 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:07:43.852 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":28,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4898,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/167651529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":167651529},{"type":"v1","addr":"172.21.15.86:6835","nonce":167651529}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:07:30.137341+0000","modified":"2020-04-22T14:07:32.145409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5890},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5890":{"gid":5890,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/494421372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":494421372},{"type":"v1","addr":"172.21.15.103:6833","nonce":494421372}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2020-04-22T14:07:43.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.850+0000 7f369c915700 1 -- 172.21.15.103:0/3672659208 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f367c04d8b0 msgr2=0x7f367c04fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:43.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.850+0000 7f369c915700 1 --2- 172.21.15.103:0/3672659208 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f367c04d8b0 0x7f367c04fd70 secure :-1 s=READY pgs=277 cs=0 l=1 rx=0x7f36980b85b0 tx=0x7f36900041a0).stop 2020-04-22T14:07:43.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.850+0000 7f369c915700 1 -- 172.21.15.103:0/3672659208 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f369812c0d0 msgr2=0x7f3698064990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:43.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.850+0000 7f369c915700 1 --2- 172.21.15.103:0/3672659208 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f369812c0d0 0x7f3698064990 secure :-1 s=READY pgs=731 cs=0 l=1 rx=0x7f3680002f30 tx=0x7f3680010b40).stop 2020-04-22T14:07:43.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.850+0000 7f369c915700 1 -- 172.21.15.103:0/3672659208 shutdown_connections 2020-04-22T14:07:43.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.850+0000 7f369c915700 1 --2- 172.21.15.103:0/3672659208 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f367c04d8b0 0x7f367c04fd70 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:43.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.850+0000 7f369c915700 1 --2- 172.21.15.103:0/3672659208 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f369812c0d0 0x7f3698064990 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:43.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.850+0000 7f369c915700 1 --2- 172.21.15.103:0/3672659208 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3698063e30 0x7f369812b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:43.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.850+0000 7f369c915700 1 -- 172.21.15.103:0/3672659208 >> 172.21.15.103:0/3672659208 conn(0x7f36980b9160 msgr2=0x7f36980b7910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:43.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.850+0000 7f369c915700 1 -- 172.21.15.103:0/3672659208 shutdown_connections 2020-04-22T14:07:43.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:43.850+0000 7f369c915700 1 -- 172.21.15.103:0/3672659208 wait complete. 2020-04-22T14:07:43.855 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 28 2020-04-22T14:07:44.064 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 5890}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 9, u'failed': [], u'epoch': 28, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [10], u'info': {u'gid_5890': {u'export_targets': [], u'name': u'a', u'incarnation': 25, u'state_seq': 3, u'state': u'up:active', u'gid': 5890, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 494421372, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 494421372, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/494421372'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:07:30.137341+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:07:32.145409+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:07:44.065 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:07:44.065 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:44.079 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:07:44.238 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:07:44.238 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:07:44.239 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:07:44.239 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 5890, 2020-04-22T14:07:44.239 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:07:44.239 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:07:44.239 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 14.097799066, 2020-04-22T14:07:44.239 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 28, 2020-04-22T14:07:44.240 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 54, 2020-04-22T14:07:44.240 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 54, 2020-04-22T14:07:44.240 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 19.531904073 2020-04-22T14:07:44.240 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:07:44.246 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 5890, "want_state": "up:active", "state": "up:active", "rank_uptime": 14.097799066, "mdsmap_epoch": 28, "osdmap_epoch": 54, "osdmap_epoch_barrier": 54, "uptime": 19.531904073 } 2020-04-22T14:07:44.247 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-04-22T14:07:44.247 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-04-22T14:07:44.247 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:44.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:44.261 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:07:44.319 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:07:44.319 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:07:44.319 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:07:44.319 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:07:44.320 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:07:44.320 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:07:44.320 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:07:44.320 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:07:44.320 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:07:44.320 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:07:44.320 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:07:44.321 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:07:44.321 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:07:44.321 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:07:44.321 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:07:44.321 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42376sec preferred_lft 42376sec 2020-04-22T14:07:44.321 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:07:44.321 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:07:44.322 INFO:teuthology.orchestra.run.smithi103.stdout:16: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:07:44.322 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 7e:d2:ee:04:ad:7f brd ff:ff:ff:ff:ff:ff 2020-04-22T14:07:44.322 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:07:44.322 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:07:44.322 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::4c33:3a93:86a3:5735/64 scope link noprefixroute 2020-04-22T14:07:44.322 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:07:44.322 INFO:teuthology.orchestra.run.smithi103.stdout:17: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-04-22T14:07:44.323 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 7e:d2:ee:04:ad:7f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2020-04-22T14:07:44.323 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:44.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:44.368 INFO:teuthology.orchestra.run.smithi103:> ip netns list 2020-04-22T14:07:44.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2020-04-22T14:07:44.428 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:44.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:44.476 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:07:44.534 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2020-04-22T14:07:44.535 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:44.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:44.583 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:07:44.641 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2020-04-22T14:07:44.642 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:44.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:44.690 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:07:44.765 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:44.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:44.812 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 1' 2020-04-22T14:07:44.886 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:44.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:44.933 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr' 2020-04-22T14:07:45.041 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:07:45.041 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:07:45.041 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:07:45.042 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:07:45.042 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:07:45.042 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:07:45.042 INFO:teuthology.orchestra.run.smithi103.stdout:2: veth0@if17: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:07:45.042 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 26:bb:d5:0f:d3:58 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:07:45.042 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2020-04-22T14:07:45.043 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:07:45.043 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::24bb:d5ff:fe0f:d358/64 scope link 2020-04-22T14:07:45.043 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:07:45.043 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:45.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:45.068 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr' 2020-04-22T14:07:45.144 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:07:45.145 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:07:45.145 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:07:45.145 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:07:45.145 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:07:45.145 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:07:45.145 INFO:teuthology.orchestra.run.smithi103.stdout:2: veth0@if17: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:07:45.146 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 26:bb:d5:0f:d3:58 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:07:45.146 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2020-04-22T14:07:45.146 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:07:45.146 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::24bb:d5ff:fe0f:d358/64 scope link 2020-04-22T14:07:45.146 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:07:45.177 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.2/16 2020-04-22T14:07:45.177 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:45.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:45.209 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.1' 2020-04-22T14:07:45.284 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:45.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:45.331 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0' 2020-04-22T14:07:45.439 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:45.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:45.453 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up' 2020-04-22T14:07:45.560 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:45.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:45.574 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up' 2020-04-22T14:07:45.681 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:45.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:45.696 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254' 2020-04-22T14:07:45.803 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:45.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:45.818 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:07:45.894 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:45.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:45.957 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge-slave con-name brx.1 ifname brx.1 master ceph-brx' 2020-04-22T14:07:46.072 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.1' (3bf11b3f-4c36-49c5-a8ec-05519a9cafbb) successfully added. 2020-04-22T14:07:46.072 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:46.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:46.096 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up brx.1' 2020-04-22T14:07:46.258 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/19) 2020-04-22T14:07:46.310 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2020-04-22T14:07:46.310 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi103.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2020-04-22T14:07:46.311 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:46.325 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:07:46.325 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:07:46.401 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:46.447 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:07:46.447 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:07:46.514 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:07:46.521 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:07:46.521 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:46.569 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:07:46.569 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:07:46.630 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:07:46.631 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [47] 2020-04-22T14:07:46.631 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:46.679 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:07:46.728 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:46.742 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:07:46.742 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:07:46.811 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:07:46.811 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:2020-04-22T14:07:46.810+0000 7f863c6d91c0 -1 init, newargv = 0x559571f083c0 newargc=9 2020-04-22T14:07:46.812 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[61519]: starting ceph client 2020-04-22T14:07:46.816 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[61519]: starting fuse 2020-04-22T14:07:46.823 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:07:46.823 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:46.836 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:07:46.836 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:07:46.894 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:07:46.894 INFO:teuthology.orchestra.run.smithi103.stdout:49 2020-04-22T14:07:46.895 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47, 49] 2020-04-22T14:07:46.895 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:46.941 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:07:46.942 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:07:46.942 INFO:teuthology.orchestra.run.smithi103:> import glob 2020-04-22T14:07:46.942 INFO:teuthology.orchestra.run.smithi103:> import re 2020-04-22T14:07:46.942 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:07:46.942 INFO:teuthology.orchestra.run.smithi103:> import subprocess 2020-04-22T14:07:46.942 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:07:46.942 INFO:teuthology.orchestra.run.smithi103:> def find_socket(client_name): 2020-04-22T14:07:46.943 INFO:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2020-04-22T14:07:46.943 INFO:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2020-04-22T14:07:46.943 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:07:46.943 INFO:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2020-04-22T14:07:46.943 INFO:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2020-04-22T14:07:46.943 INFO:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2020-04-22T14:07:46.943 INFO:teuthology.orchestra.run.smithi103:> return files[0] 2020-04-22T14:07:46.943 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:07:46.943 INFO:teuthology.orchestra.run.smithi103:> for f in files: 2020-04-22T14:07:46.944 INFO:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:07:46.944 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:07:46.944 INFO:teuthology.orchestra.run.smithi103:> return f 2020-04-22T14:07:46.944 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:07:46.944 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:07:46.944 INFO:teuthology.orchestra.run.smithi103:> print(find_socket("client.1")) 2020-04-22T14:07:46.944 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:07:47.050 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.1.61519.asok 2020-04-22T14:07:47.050 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.61519.asok 2020-04-22T14:07:47.050 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:47.064 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:07:47.064 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.61519.asok status 2020-04-22T14:07:47.225 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:07:47.225 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2020-04-22T14:07:47.225 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:07:47.226 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:07:47.226 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "1", 2020-04-22T14:07:47.226 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:07:47.226 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2020-04-22T14:07:47.226 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "61519", 2020-04-22T14:07:47.226 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:07:47.226 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:47.227 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2020-04-22T14:07:47.227 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2020-04-22T14:07:47.228 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 5826, 2020-04-22T14:07:47.228 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2020-04-22T14:07:47.228 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:07:47.228 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:07:47.228 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5826 2020-04-22T14:07:47.228 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:47.229 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:07:47.229 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:47.229 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.2:0", 2020-04-22T14:07:47.229 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1402976942 2020-04-22T14:07:47.229 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:47.229 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:47.229 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:07:47.230 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:47.230 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.2:0", 2020-04-22T14:07:47.230 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1402976942 2020-04-22T14:07:47.230 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:47.230 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.5826 192.168.0.2:0/1402976942", 2020-04-22T14:07:47.230 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.2:0/1402976942", 2020-04-22T14:07:47.231 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2020-04-22T14:07:47.231 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 28, 2020-04-22T14:07:47.231 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 54, 2020-04-22T14:07:47.231 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2020-04-22T14:07:47.231 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklisted": false 2020-04-22T14:07:47.231 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:07:47.232 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:47.245 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:07:47.245 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-22T14:07:47.246 INFO:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:07:47.304 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2020-04-22T14:07:47.304 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-04-22T14:07:47.304 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:47.353 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:07:47.353 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:07:47.431 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:47.474 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok config get mds_reconnect_timeout 2020-04-22T14:07:47.627 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:07:47.627 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_reconnect_timeout": "45.000000" 2020-04-22T14:07:47.628 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:07:47.636 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_reconnect_timeout": "45.000000" } 2020-04-22T14:07:47.636 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:47.649 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok config get ms_max_backoff 2020-04-22T14:07:47.802 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:07:47.803 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_max_backoff": "15.000000" 2020-04-22T14:07:47.803 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:07:47.811 INFO:tasks.cephfs.filesystem:_json_asok output: { "ms_max_backoff": "15.000000" } 2020-04-22T14:07:47.811 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:47.824 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:07:47.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.970+0000 7f531359e700 1 Processor -- start 2020-04-22T14:07:47.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.970+0000 7f531359e700 1 -- start start 2020-04-22T14:07:47.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.971+0000 7f531359e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f53140ad150 0x7f53140664a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:47.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.971+0000 7f531359e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5314141c10 0x7f53141420a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:47.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.971+0000 7f531359e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5314142500 0x7f5314061d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:47.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.971+0000 7f531359e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53140adf30 con 0x7f5314141c10 2020-04-22T14:07:47.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.971+0000 7f531359e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5314066a20 con 0x7f53140ad150 2020-04-22T14:07:47.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.971+0000 7f531359e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53140ad7f0 con 0x7f5314142500 2020-04-22T14:07:47.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.971+0000 7f531259c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f53140ad150 0x7f53140664a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:47.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.971+0000 7f531259c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f53140ad150 0x7f53140664a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50618/0 (socket says 172.21.15.103:50618) 2020-04-22T14:07:47.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.971+0000 7f531259c700 1 -- 172.21.15.103:0/3174523950 learned_addr learned my addr 172.21.15.103:0/3174523950 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:47.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.971+0000 7f5311d9b700 1 --2- 172.21.15.103:0/3174523950 >> v2:172.21.15.86:3300/0 conn(0x7f5314141c10 0x7f53141420a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:47.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.971+0000 7f5312d9d700 1 --2- 172.21.15.103:0/3174523950 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5314142500 0x7f5314061d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:47.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.971+0000 7f531259c700 1 -- 172.21.15.103:0/3174523950 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5314142500 msgr2=0x7f5314061d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:47.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.971+0000 7f531259c700 1 --2- 172.21.15.103:0/3174523950 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5314142500 0x7f5314061d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:47.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.971+0000 7f531259c700 1 -- 172.21.15.103:0/3174523950 >> v2:172.21.15.86:3300/0 conn(0x7f5314141c10 msgr2=0x7f53141420a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:47.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.971+0000 7f531259c700 1 --2- 172.21.15.103:0/3174523950 >> v2:172.21.15.86:3300/0 conn(0x7f5314141c10 0x7f53141420a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:47.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.971+0000 7f531259c700 1 -- 172.21.15.103:0/3174523950 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53140ada90 con 0x7f53140ad150 2020-04-22T14:07:47.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.971+0000 7f5312d9d700 1 --2- 172.21.15.103:0/3174523950 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5314142500 0x7f5314061d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:07:47.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.971+0000 7f531259c700 1 --2- 172.21.15.103:0/3174523950 >> v2:172.21.15.103:3300/0 conn(0x7f53140ad150 0x7f53140664a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5308002f30 tx=0x7f5308007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:47.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.971+0000 7f531259c700 1 --2- 172.21.15.103:0/3174523950 >> v2:172.21.15.103:3300/0 conn(0x7f53140ad150 0x7f53140664a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5308002f30 tx=0x7f5308007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:47.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.971+0000 7f531259c700 1 --2- 172.21.15.103:0/3174523950 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53140ad150 0x7f53140664a0 secure :-1 s=READY pgs=733 cs=0 l=1 rx=0x7f5308002f30 tx=0x7f5308007a40).ready entity=mon.1 client_cookie=4cdad2d4b125045b server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:47.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.971+0000 7f531259c700 1 --2- 172.21.15.103:0/3174523950 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53140ad150 0x7f53140664a0 secure :-1 s=THROTTLE_DONE pgs=733 cs=0 l=1 rx=0x7f5308002f30 tx=0x7f5308007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:47.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.971+0000 7f531159a700 1 -- 172.21.15.103:0/3174523950 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5308011720 con 0x7f53140ad150 2020-04-22T14:07:47.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.971+0000 7f531259c700 1 --2- 172.21.15.103:0/3174523950 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53140ad150 0x7f53140664a0 secure :-1 s=THROTTLE_DONE pgs=733 cs=0 l=1 rx=0x7f5308002f30 tx=0x7f5308007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:47.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.971+0000 7f531259c700 1 --2- 172.21.15.103:0/3174523950 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53140ad150 0x7f53140664a0 secure :-1 s=THROTTLE_DONE pgs=733 cs=0 l=1 rx=0x7f5308002f30 tx=0x7f5308007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:47.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.971+0000 7f531159a700 1 -- 172.21.15.103:0/3174523950 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5308011880 con 0x7f53140ad150 2020-04-22T14:07:47.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.971+0000 7f531159a700 1 -- 172.21.15.103:0/3174523950 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5308011c60 con 0x7f53140ad150 2020-04-22T14:07:47.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.971+0000 7f531359e700 1 -- 172.21.15.103:0/3174523950 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53140ad150 msgr2=0x7f53140664a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:47.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.971+0000 7f531359e700 1 --2- 172.21.15.103:0/3174523950 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53140ad150 0x7f53140664a0 secure :-1 s=READY pgs=733 cs=0 l=1 rx=0x7f5308002f30 tx=0x7f5308007a40).stop 2020-04-22T14:07:47.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.972+0000 7f531359e700 1 -- 172.21.15.103:0/3174523950 shutdown_connections 2020-04-22T14:07:47.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.972+0000 7f531359e700 1 --2- 172.21.15.103:0/3174523950 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5314142500 0x7f5314061d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:47.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.972+0000 7f531359e700 1 --2- 172.21.15.103:0/3174523950 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53140ad150 0x7f53140664a0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:47.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.972+0000 7f531359e700 1 --2- 172.21.15.103:0/3174523950 >> v2:172.21.15.86:3300/0 conn(0x7f5314141c10 0x7f53141420a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:47.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.972+0000 7f531359e700 1 -- 172.21.15.103:0/3174523950 >> 172.21.15.103:0/3174523950 conn(0x7f531405b7c0 msgr2=0x7f5314061610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:47.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.972+0000 7f531359e700 1 -- 172.21.15.103:0/3174523950 shutdown_connections 2020-04-22T14:07:47.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.972+0000 7f531359e700 1 -- 172.21.15.103:0/3174523950 wait complete. 2020-04-22T14:07:47.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.973+0000 7f531359e700 1 Processor -- start 2020-04-22T14:07:47.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.973+0000 7f531359e700 1 -- start start 2020-04-22T14:07:47.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.973+0000 7f531359e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f53140ad150 0x7f53141367d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:47.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.973+0000 7f531359e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5314142500 0x7f5314155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:47.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.973+0000 7f531359e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5314131730 con 0x7f5314141c10 2020-04-22T14:07:47.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.973+0000 7f531359e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5314152200 con 0x7f53140ad150 2020-04-22T14:07:47.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.973+0000 7f531359e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5314151160 con 0x7f5314142500 2020-04-22T14:07:47.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.974+0000 7f5312d9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5314142500 0x7f5314155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:47.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.974+0000 7f5311d9b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f5314141c10 0x7f5314151af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42814/0 (socket says 172.21.15.103:42814) 2020-04-22T14:07:47.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.974+0000 7f5312d9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5314142500 0x7f5314155140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50626/0 (socket says 172.21.15.103:50626) 2020-04-22T14:07:47.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.974+0000 7f5311d9b700 1 -- 172.21.15.103:0/2170584077 learned_addr learned my addr 172.21.15.103:0/2170584077 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:47.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.974+0000 7f531259c700 1 --2- 172.21.15.103:0/2170584077 >> v2:172.21.15.86:3300/0 conn(0x7f53140ad150 0x7f53141367d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:47.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.974+0000 7f5312d9d700 1 -- 172.21.15.103:0/2170584077 >> v2:172.21.15.86:3300/0 conn(0x7f53140ad150 msgr2=0x7f53141367d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:47.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.974+0000 7f5312d9d700 1 --2- 172.21.15.103:0/2170584077 >> v2:172.21.15.86:3300/0 conn(0x7f53140ad150 0x7f53141367d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:47.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.974+0000 7f5312d9d700 1 -- 172.21.15.103:0/2170584077 >> v1:172.21.15.103:6789/0 conn(0x7f5314141c10 legacy=0x7f5314151af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:47.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.974+0000 7f53037fe700 1 -- 172.21.15.103:0/2170584077 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1753270319 0 0) 0x7f5314131730 con 0x7f5314141c10 2020-04-22T14:07:47.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.974+0000 7f5312d9d700 1 -- 172.21.15.103:0/2170584077 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53141513b0 con 0x7f5314142500 2020-04-22T14:07:47.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.974+0000 7f5312d9d700 1 --2- 172.21.15.103:0/2170584077 >> v2:172.21.15.103:3300/0 conn(0x7f5314142500 0x7f5314155140 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f530c0032b0 tx=0x7f530c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:47.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.974+0000 7f5312d9d700 1 --2- 172.21.15.103:0/2170584077 >> v2:172.21.15.103:3300/0 conn(0x7f5314142500 0x7f5314155140 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f530c0032b0 tx=0x7f530c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:47.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.974+0000 7f5312d9d700 1 --2- 172.21.15.103:0/2170584077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5314142500 0x7f5314155140 secure :-1 s=READY pgs=735 cs=0 l=1 rx=0x7f530c0032b0 tx=0x7f530c010bb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:47.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.974+0000 7f5312d9d700 1 --2- 172.21.15.103:0/2170584077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5314142500 0x7f5314155140 secure :-1 s=THROTTLE_DONE pgs=735 cs=0 l=1 rx=0x7f530c0032b0 tx=0x7f530c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:47.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.974+0000 7f53037fe700 1 -- 172.21.15.103:0/2170584077 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f530c005e30 con 0x7f5314142500 2020-04-22T14:07:47.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.974+0000 7f5312d9d700 1 --2- 172.21.15.103:0/2170584077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5314142500 0x7f5314155140 secure :-1 s=THROTTLE_DONE pgs=735 cs=0 l=1 rx=0x7f530c0032b0 tx=0x7f530c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:47.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.974+0000 7f5312d9d700 1 --2- 172.21.15.103:0/2170584077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5314142500 0x7f5314155140 secure :-1 s=THROTTLE_DONE pgs=735 cs=0 l=1 rx=0x7f530c0032b0 tx=0x7f530c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:47.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.974+0000 7f53037fe700 1 -- 172.21.15.103:0/2170584077 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f530c007560 con 0x7f5314142500 2020-04-22T14:07:47.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.974+0000 7f531359e700 1 -- 172.21.15.103:0/2170584077 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5314151650 con 0x7f5314142500 2020-04-22T14:07:47.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.974+0000 7f53037fe700 1 -- 172.21.15.103:0/2170584077 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f530c012250 con 0x7f5314142500 2020-04-22T14:07:47.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.974+0000 7f531359e700 1 -- 172.21.15.103:0/2170584077 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53141414f0 con 0x7f5314142500 2020-04-22T14:07:47.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.975+0000 7f5312d9d700 1 --2- 172.21.15.103:0/2170584077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5314142500 0x7f5314155140 secure :-1 s=THROTTLE_DONE pgs=735 cs=0 l=1 rx=0x7f530c0032b0 tx=0x7f530c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:47.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.976+0000 7f531359e700 1 -- 172.21.15.103:0/2170584077 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5314137350 con 0x7f5314142500 2020-04-22T14:07:47.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.976+0000 7f53037fe700 1 -- 172.21.15.103:0/2170584077 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f530c0124c0 con 0x7f5314142500 2020-04-22T14:07:47.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.976+0000 7f5312d9d700 1 --2- 172.21.15.103:0/2170584077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5314142500 0x7f5314155140 secure :-1 s=THROTTLE_DONE pgs=735 cs=0 l=1 rx=0x7f530c0032b0 tx=0x7f530c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:47.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.976+0000 7f53037fe700 1 --2- 172.21.15.103:0/2170584077 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f52f004d960 0x7f52f004fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:47.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.976+0000 7f53037fe700 1 -- 172.21.15.103:0/2170584077 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f530c061630 con 0x7f5314142500 2020-04-22T14:07:47.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.976+0000 7f531259c700 1 --2- 172.21.15.103:0/2170584077 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f52f004d960 0x7f52f004fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:47.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.976+0000 7f531259c700 1 --2- 172.21.15.103:0/2170584077 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f52f004d960 0x7f52f004fe20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5308002f30 tx=0x7f5308007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:47.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.976+0000 7f531259c700 1 --2- 172.21.15.103:0/2170584077 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f52f004d960 0x7f52f004fe20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5308002f30 tx=0x7f5308007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:47.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.976+0000 7f531259c700 1 --2- 172.21.15.103:0/2170584077 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f52f004d960 0x7f52f004fe20 secure :-1 s=READY pgs=278 cs=0 l=1 rx=0x7f5308002f30 tx=0x7f5308007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:47.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.980+0000 7f5312d9d700 1 --2- 172.21.15.103:0/2170584077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5314142500 0x7f5314155140 secure :-1 s=THROTTLE_DONE pgs=735 cs=0 l=1 rx=0x7f530c0032b0 tx=0x7f530c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:47.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:47.980+0000 7f53037fe700 1 -- 172.21.15.103:0/2170584077 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f5314137350 con 0x7f5314142500 2020-04-22T14:07:48.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.166+0000 7f531359e700 1 -- 172.21.15.103:0/2170584077 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5314137350 con 0x7f5314142500 2020-04-22T14:07:48.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.166+0000 7f5312d9d700 1 --2- 172.21.15.103:0/2170584077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5314142500 0x7f5314155140 secure :-1 s=THROTTLE_DONE pgs=735 cs=0 l=1 rx=0x7f530c0032b0 tx=0x7f530c010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:48.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.166+0000 7f53037fe700 1 -- 172.21.15.103:0/2170584077 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f5314137350 con 0x7f5314142500 2020-04-22T14:07:48.169 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:07:48.169 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":28,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4898,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/167651529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":167651529},{"type":"v1","addr":"172.21.15.86:6835","nonce":167651529}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:07:30.137341+0000","modified":"2020-04-22T14:07:32.145409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5890},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5890":{"gid":5890,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/494421372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":494421372},{"type":"v1","addr":"172.21.15.103:6833","nonce":494421372}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2020-04-22T14:07:48.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.168+0000 7f531359e700 1 -- 172.21.15.103:0/2170584077 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f52f004d960 msgr2=0x7f52f004fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:48.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.168+0000 7f531359e700 1 --2- 172.21.15.103:0/2170584077 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f52f004d960 0x7f52f004fe20 secure :-1 s=READY pgs=278 cs=0 l=1 rx=0x7f5308002f30 tx=0x7f5308007a40).stop 2020-04-22T14:07:48.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.168+0000 7f531359e700 1 -- 172.21.15.103:0/2170584077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5314142500 msgr2=0x7f5314155140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:48.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.168+0000 7f531359e700 1 --2- 172.21.15.103:0/2170584077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5314142500 0x7f5314155140 secure :-1 s=READY pgs=735 cs=0 l=1 rx=0x7f530c0032b0 tx=0x7f530c010bb0).stop 2020-04-22T14:07:48.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.168+0000 7f531359e700 1 -- 172.21.15.103:0/2170584077 shutdown_connections 2020-04-22T14:07:48.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.168+0000 7f531359e700 1 --2- 172.21.15.103:0/2170584077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5314142500 0x7f5314155140 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:48.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.168+0000 7f531359e700 1 --2- 172.21.15.103:0/2170584077 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f52f004d960 0x7f52f004fe20 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:48.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.168+0000 7f531359e700 1 --2- 172.21.15.103:0/2170584077 >> v2:172.21.15.86:3300/0 conn(0x7f53140ad150 0x7f53141367d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:48.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.168+0000 7f531359e700 1 -- 172.21.15.103:0/2170584077 >> 172.21.15.103:0/2170584077 conn(0x7f531405b7c0 msgr2=0x7f5314062850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:48.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.168+0000 7f531359e700 1 -- 172.21.15.103:0/2170584077 shutdown_connections 2020-04-22T14:07:48.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.168+0000 7f531359e700 1 -- 172.21.15.103:0/2170584077 wait complete. 2020-04-22T14:07:48.172 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 28 2020-04-22T14:07:48.187 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:48.200 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok config set mds_defer_session_stale false 2020-04-22T14:07:48.371 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:07:48.371 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "mds_defer_session_stale = 'false' (not observed, change may require restart) " 2020-04-22T14:07:48.371 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:07:48.379 INFO:tasks.cephfs.filesystem:_json_asok output: { "success": "mds_defer_session_stale = 'false' (not observed, change may require restart) " } 2020-04-22T14:07:48.379 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:48.393 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:07:48.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.536+0000 7f9e9243e700 1 Processor -- start 2020-04-22T14:07:48.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.536+0000 7f9e9243e700 1 -- start start 2020-04-22T14:07:48.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.537+0000 7f9e9243e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9e8c065fe0 0x7f9e8c1464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:48.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.537+0000 7f9e9243e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9e8c063e30 0x7f9e8c0642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:48.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.537+0000 7f9e9243e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e8c143300 con 0x7f9e8c12c0d0 2020-04-22T14:07:48.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.537+0000 7f9e9243e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e8c1435a0 con 0x7f9e8c065fe0 2020-04-22T14:07:48.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.537+0000 7f9e9243e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c143840 con 0x7f9e8c063e30 2020-04-22T14:07:48.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.537+0000 7f9e909db700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9e8c063e30 0x7f9e8c0642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:48.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.537+0000 7f9e8b7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9e8c065fe0 0x7f9e8c1464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:48.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.537+0000 7f9e8b7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9e8c065fe0 0x7f9e8c1464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:47866/0 (socket says 172.21.15.103:47866) 2020-04-22T14:07:48.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.537+0000 7f9e8bfff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f9e8c12c0d0 0x7f9e8c05b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:59976/0 (socket says 172.21.15.103:59976) 2020-04-22T14:07:48.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.537+0000 7f9e909db700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9e8c063e30 0x7f9e8c0642c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:35410/0 (socket says 172.21.15.103:35410) 2020-04-22T14:07:48.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.537+0000 7f9e8b7fe700 1 -- 172.21.15.103:0/2563285785 learned_addr learned my addr 172.21.15.103:0/2563285785 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:48.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.538+0000 7f9e8b7fe700 1 -- 172.21.15.103:0/2563285785 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9e8c063e30 msgr2=0x7f9e8c0642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:48.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.538+0000 7f9e8b7fe700 1 --2- 172.21.15.103:0/2563285785 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9e8c063e30 0x7f9e8c0642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:48.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.538+0000 7f9e8b7fe700 1 -- 172.21.15.103:0/2563285785 >> v1:172.21.15.86:6789/0 conn(0x7f9e8c12c0d0 legacy=0x7f9e8c05b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:48.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.538+0000 7f9e8affd700 1 -- 172.21.15.103:0/2563285785 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2244044025 0 0) 0x7f9e8c143300 con 0x7f9e8c12c0d0 2020-04-22T14:07:48.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.538+0000 7f9e8b7fe700 1 -- 172.21.15.103:0/2563285785 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8c05bb50 con 0x7f9e8c065fe0 2020-04-22T14:07:48.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.538+0000 7f9e909db700 1 --2- 172.21.15.103:0/2563285785 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9e8c063e30 0x7f9e8c0642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:07:48.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.538+0000 7f9e8b7fe700 1 --2- 172.21.15.103:0/2563285785 >> v2:172.21.15.86:3300/0 conn(0x7f9e8c065fe0 0x7f9e8c1464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9e7c002f30 tx=0x7f9e7c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:48.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.538+0000 7f9e8b7fe700 1 --2- 172.21.15.103:0/2563285785 >> v2:172.21.15.86:3300/0 conn(0x7f9e8c065fe0 0x7f9e8c1464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9e7c002f30 tx=0x7f9e7c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:48.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.538+0000 7f9e8b7fe700 1 --2- 172.21.15.103:0/2563285785 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e8c065fe0 0x7f9e8c1464e0 secure :-1 s=READY pgs=412 cs=0 l=1 rx=0x7f9e7c002f30 tx=0x7f9e7c007a40).ready entity=mon.0 client_cookie=a4c20101e69ac51f server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:48.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.538+0000 7f9e8b7fe700 1 --2- 172.21.15.103:0/2563285785 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e8c065fe0 0x7f9e8c1464e0 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7f9e7c002f30 tx=0x7f9e7c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:48.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.538+0000 7f9e8affd700 1 -- 172.21.15.103:0/2563285785 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e7c011670 con 0x7f9e8c065fe0 2020-04-22T14:07:48.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.538+0000 7f9e8b7fe700 1 --2- 172.21.15.103:0/2563285785 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e8c065fe0 0x7f9e8c1464e0 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7f9e7c002f30 tx=0x7f9e7c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:48.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.538+0000 7f9e8affd700 1 -- 172.21.15.103:0/2563285785 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e7c011810 con 0x7f9e8c065fe0 2020-04-22T14:07:48.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.538+0000 7f9e8b7fe700 1 --2- 172.21.15.103:0/2563285785 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e8c065fe0 0x7f9e8c1464e0 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7f9e7c002f30 tx=0x7f9e7c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:48.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.538+0000 7f9e9243e700 1 -- 172.21.15.103:0/2563285785 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e8c065fe0 msgr2=0x7f9e8c1464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:48.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.538+0000 7f9e8affd700 1 -- 172.21.15.103:0/2563285785 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e7c011bf0 con 0x7f9e8c065fe0 2020-04-22T14:07:48.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.538+0000 7f9e9243e700 1 --2- 172.21.15.103:0/2563285785 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e8c065fe0 0x7f9e8c1464e0 secure :-1 s=READY pgs=412 cs=0 l=1 rx=0x7f9e7c002f30 tx=0x7f9e7c007a40).stop 2020-04-22T14:07:48.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.539+0000 7f9e9243e700 1 -- 172.21.15.103:0/2563285785 shutdown_connections 2020-04-22T14:07:48.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.539+0000 7f9e9243e700 1 --2- 172.21.15.103:0/2563285785 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9e8c063e30 0x7f9e8c0642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:48.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.539+0000 7f9e9243e700 1 --2- 172.21.15.103:0/2563285785 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e8c065fe0 0x7f9e8c1464e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:48.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.539+0000 7f9e9243e700 1 -- 172.21.15.103:0/2563285785 >> 172.21.15.103:0/2563285785 conn(0x7f9e8c0b9160 msgr2=0x7f9e8c05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:48.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.539+0000 7f9e9243e700 1 -- 172.21.15.103:0/2563285785 shutdown_connections 2020-04-22T14:07:48.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.539+0000 7f9e9243e700 1 -- 172.21.15.103:0/2563285785 wait complete. 2020-04-22T14:07:48.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.540+0000 7f9e9243e700 1 Processor -- start 2020-04-22T14:07:48.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.540+0000 7f9e9243e700 1 -- start start 2020-04-22T14:07:48.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.541+0000 7f9e9243e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9e8c063e30 0x7f9e8c144d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:48.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.541+0000 7f9e9243e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9e8c065fe0 0x7f9e8c0b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:48.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.541+0000 7f9e9243e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e8c0b2910 con 0x7f9e8c12c0d0 2020-04-22T14:07:48.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.541+0000 7f9e9243e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e8c0b2e90 con 0x7f9e8c063e30 2020-04-22T14:07:48.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.541+0000 7f9e9243e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c0b0650 con 0x7f9e8c065fe0 2020-04-22T14:07:48.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.541+0000 7f9e8bfff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9e8c063e30 0x7f9e8c144d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:48.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.541+0000 7f9e8bfff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9e8c063e30 0x7f9e8c144d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50636/0 (socket says 172.21.15.103:50636) 2020-04-22T14:07:48.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.541+0000 7f9e8bfff700 1 -- 172.21.15.103:0/1877757899 learned_addr learned my addr 172.21.15.103:0/1877757899 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:48.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.541+0000 7f9e8b7fe700 1 --2- 172.21.15.103:0/1877757899 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9e8c065fe0 0x7f9e8c0b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:48.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.541+0000 7f9e8bfff700 1 -- 172.21.15.103:0/1877757899 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9e8c065fe0 msgr2=0x7f9e8c0b01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:48.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.541+0000 7f9e8bfff700 1 --2- 172.21.15.103:0/1877757899 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9e8c065fe0 0x7f9e8c0b01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:48.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.541+0000 7f9e8bfff700 1 -- 172.21.15.103:0/1877757899 >> v1:172.21.15.86:6789/0 conn(0x7f9e8c12c0d0 legacy=0x7f9e8c129520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:48.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.541+0000 7f9e8bfff700 1 -- 172.21.15.103:0/1877757899 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8c1454c0 con 0x7f9e8c063e30 2020-04-22T14:07:48.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.541+0000 7f9e8b7fe700 1 --2- 172.21.15.103:0/1877757899 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9e8c065fe0 0x7f9e8c0b01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:07:48.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.541+0000 7f9e8bfff700 1 --2- 172.21.15.103:0/1877757899 >> v2:172.21.15.103:3300/0 conn(0x7f9e8c063e30 0x7f9e8c144d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9e80000b80 tx=0x7f9e800109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:48.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.541+0000 7f9e8bfff700 1 --2- 172.21.15.103:0/1877757899 >> v2:172.21.15.103:3300/0 conn(0x7f9e8c063e30 0x7f9e8c144d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9e80000b80 tx=0x7f9e800109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:48.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.541+0000 7f9e8bfff700 1 --2- 172.21.15.103:0/1877757899 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e8c063e30 0x7f9e8c144d80 secure :-1 s=READY pgs=736 cs=0 l=1 rx=0x7f9e80000b80 tx=0x7f9e800109f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:48.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.541+0000 7f9e8bfff700 1 --2- 172.21.15.103:0/1877757899 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e8c063e30 0x7f9e8c144d80 secure :-1 s=THROTTLE_DONE pgs=736 cs=0 l=1 rx=0x7f9e80000b80 tx=0x7f9e800109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:48.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.541+0000 7f9e897fa700 1 -- 172.21.15.103:0/1877757899 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e800048d0 con 0x7f9e8c063e30 2020-04-22T14:07:48.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.541+0000 7f9e8bfff700 1 --2- 172.21.15.103:0/1877757899 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e8c063e30 0x7f9e8c144d80 secure :-1 s=THROTTLE_DONE pgs=736 cs=0 l=1 rx=0x7f9e80000b80 tx=0x7f9e800109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:48.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.541+0000 7f9e8bfff700 1 --2- 172.21.15.103:0/1877757899 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e8c063e30 0x7f9e8c144d80 secure :-1 s=THROTTLE_DONE pgs=736 cs=0 l=1 rx=0x7f9e80000b80 tx=0x7f9e800109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:48.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.541+0000 7f9e897fa700 1 -- 172.21.15.103:0/1877757899 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e80004a30 con 0x7f9e8c063e30 2020-04-22T14:07:48.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.541+0000 7f9e9243e700 1 -- 172.21.15.103:0/1877757899 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e8c0ae220 con 0x7f9e8c063e30 2020-04-22T14:07:48.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.541+0000 7f9e897fa700 1 -- 172.21.15.103:0/1877757899 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e80004e50 con 0x7f9e8c063e30 2020-04-22T14:07:48.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.541+0000 7f9e9243e700 1 -- 172.21.15.103:0/1877757899 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e8c0b25f0 con 0x7f9e8c063e30 2020-04-22T14:07:48.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.542+0000 7f9e8bfff700 1 --2- 172.21.15.103:0/1877757899 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e8c063e30 0x7f9e8c144d80 secure :-1 s=THROTTLE_DONE pgs=736 cs=0 l=1 rx=0x7f9e80000b80 tx=0x7f9e800109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:48.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.542+0000 7f9e9243e700 1 -- 172.21.15.103:0/1877757899 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e8c056c90 con 0x7f9e8c063e30 2020-04-22T14:07:48.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.542+0000 7f9e897fa700 1 -- 172.21.15.103:0/1877757899 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f9e80012390 con 0x7f9e8c063e30 2020-04-22T14:07:48.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.542+0000 7f9e8bfff700 1 --2- 172.21.15.103:0/1877757899 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e8c063e30 0x7f9e8c144d80 secure :-1 s=THROTTLE_DONE pgs=736 cs=0 l=1 rx=0x7f9e80000b80 tx=0x7f9e800109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:48.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.543+0000 7f9e897fa700 1 --2- 172.21.15.103:0/1877757899 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9e6c04d8e0 0x7f9e6c04fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:48.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.543+0000 7f9e897fa700 1 -- 172.21.15.103:0/1877757899 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9e800613d0 con 0x7f9e8c063e30 2020-04-22T14:07:48.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.543+0000 7f9e8b7fe700 1 --2- 172.21.15.103:0/1877757899 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9e6c04d8e0 0x7f9e6c04fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:48.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.543+0000 7f9e8b7fe700 1 --2- 172.21.15.103:0/1877757899 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9e6c04d8e0 0x7f9e6c04fda0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9e7c002f30 tx=0x7f9e7c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:48.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.543+0000 7f9e8b7fe700 1 --2- 172.21.15.103:0/1877757899 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9e6c04d8e0 0x7f9e6c04fda0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9e7c002f30 tx=0x7f9e7c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:48.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.543+0000 7f9e8b7fe700 1 --2- 172.21.15.103:0/1877757899 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9e6c04d8e0 0x7f9e6c04fda0 secure :-1 s=READY pgs=279 cs=0 l=1 rx=0x7f9e7c002f30 tx=0x7f9e7c007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:48.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.547+0000 7f9e8bfff700 1 --2- 172.21.15.103:0/1877757899 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e8c063e30 0x7f9e8c144d80 secure :-1 s=THROTTLE_DONE pgs=736 cs=0 l=1 rx=0x7f9e80000b80 tx=0x7f9e800109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:48.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.547+0000 7f9e897fa700 1 -- 172.21.15.103:0/1877757899 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f9e8003c7b0 con 0x7f9e8c063e30 2020-04-22T14:07:48.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.737+0000 7f9e9243e700 1 -- 172.21.15.103:0/1877757899 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e8c0b5700 con 0x7f9e8c063e30 2020-04-22T14:07:48.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.738+0000 7f9e8bfff700 1 --2- 172.21.15.103:0/1877757899 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e8c063e30 0x7f9e8c144d80 secure :-1 s=THROTTLE_DONE pgs=736 cs=0 l=1 rx=0x7f9e80000b80 tx=0x7f9e800109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:48.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.738+0000 7f9e897fa700 1 -- 172.21.15.103:0/1877757899 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f9e8003fdd0 con 0x7f9e8c063e30 2020-04-22T14:07:48.741 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:07:48.742 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":28,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4898,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/167651529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":167651529},{"type":"v1","addr":"172.21.15.86:6835","nonce":167651529}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:07:30.137341+0000","modified":"2020-04-22T14:07:32.145409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5890},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5890":{"gid":5890,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/494421372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":494421372},{"type":"v1","addr":"172.21.15.103:6833","nonce":494421372}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2020-04-22T14:07:48.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.739+0000 7f9e9243e700 1 -- 172.21.15.103:0/1877757899 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9e6c04d8e0 msgr2=0x7f9e6c04fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:48.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.739+0000 7f9e9243e700 1 --2- 172.21.15.103:0/1877757899 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9e6c04d8e0 0x7f9e6c04fda0 secure :-1 s=READY pgs=279 cs=0 l=1 rx=0x7f9e7c002f30 tx=0x7f9e7c007a40).stop 2020-04-22T14:07:48.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.739+0000 7f9e9243e700 1 -- 172.21.15.103:0/1877757899 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e8c063e30 msgr2=0x7f9e8c144d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:48.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.739+0000 7f9e9243e700 1 --2- 172.21.15.103:0/1877757899 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e8c063e30 0x7f9e8c144d80 secure :-1 s=READY pgs=736 cs=0 l=1 rx=0x7f9e80000b80 tx=0x7f9e800109f0).stop 2020-04-22T14:07:48.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.739+0000 7f9e9243e700 1 -- 172.21.15.103:0/1877757899 shutdown_connections 2020-04-22T14:07:48.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.739+0000 7f9e9243e700 1 --2- 172.21.15.103:0/1877757899 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9e6c04d8e0 0x7f9e6c04fda0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:48.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.739+0000 7f9e9243e700 1 --2- 172.21.15.103:0/1877757899 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e8c063e30 0x7f9e8c144d80 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:48.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.739+0000 7f9e9243e700 1 --2- 172.21.15.103:0/1877757899 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9e8c065fe0 0x7f9e8c0b01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:48.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.739+0000 7f9e9243e700 1 -- 172.21.15.103:0/1877757899 >> 172.21.15.103:0/1877757899 conn(0x7f9e8c0b9160 msgr2=0x7f9e8c0b4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:48.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.739+0000 7f9e9243e700 1 -- 172.21.15.103:0/1877757899 shutdown_connections 2020-04-22T14:07:48.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:48.739+0000 7f9e9243e700 1 -- 172.21.15.103:0/1877757899 wait complete. 2020-04-22T14:07:48.744 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 28 2020-04-22T14:07:48.753 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:48.785 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:07:48.785 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:07:48.785 INFO:teuthology.orchestra.run.smithi103:> import glob 2020-04-22T14:07:48.785 INFO:teuthology.orchestra.run.smithi103:> import re 2020-04-22T14:07:48.786 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:07:48.786 INFO:teuthology.orchestra.run.smithi103:> import subprocess 2020-04-22T14:07:48.786 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:07:48.786 INFO:teuthology.orchestra.run.smithi103:> def find_socket(client_name): 2020-04-22T14:07:48.786 INFO:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-04-22T14:07:48.786 INFO:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2020-04-22T14:07:48.786 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:07:48.786 INFO:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2020-04-22T14:07:48.787 INFO:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2020-04-22T14:07:48.787 INFO:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2020-04-22T14:07:48.787 INFO:teuthology.orchestra.run.smithi103:> return files[0] 2020-04-22T14:07:48.787 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:07:48.787 INFO:teuthology.orchestra.run.smithi103:> for f in files: 2020-04-22T14:07:48.787 INFO:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:07:48.787 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:07:48.787 INFO:teuthology.orchestra.run.smithi103:> return f 2020-04-22T14:07:48.788 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:07:48.788 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:07:48.788 INFO:teuthology.orchestra.run.smithi103:> print(find_socket("client.0")) 2020-04-22T14:07:48.788 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:07:48.873 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.0.60261.asok 2020-04-22T14:07:48.873 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.60261.asok 2020-04-22T14:07:48.874 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:48.887 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:07:48.888 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.60261.asok mds_sessions 2020-04-22T14:07:49.046 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:07:49.046 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 6103, 2020-04-22T14:07:49.046 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2020-04-22T14:07:49.047 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:07:49.047 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:07:49.047 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 6103 2020-04-22T14:07:49.047 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:49.047 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:07:49.048 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:49.048 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:07:49.048 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 322128533 2020-04-22T14:07:49.048 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:49.048 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:49.048 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.6103 v1:192.168.0.1:0/322128533", 2020-04-22T14:07:49.049 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "v1:192.168.0.1:0/322128533", 2020-04-22T14:07:49.049 INFO:teuthology.orchestra.run.smithi103.stdout: "sessions": [ 2020-04-22T14:07:49.049 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:49.049 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": 0, 2020-04-22T14:07:49.049 INFO:teuthology.orchestra.run.smithi103.stdout: "addrs": { 2020-04-22T14:07:49.050 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:07:49.050 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:49.050 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:07:49.050 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6832", 2020-04-22T14:07:49.050 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 494421372 2020-04-22T14:07:49.050 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:49.050 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:49.051 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:07:49.051 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6833", 2020-04-22T14:07:49.051 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 494421372 2020-04-22T14:07:49.051 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:49.051 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:07:49.051 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:49.052 INFO:teuthology.orchestra.run.smithi103.stdout: "seq": 0, 2020-04-22T14:07:49.052 INFO:teuthology.orchestra.run.smithi103.stdout: "cap_gen": 0, 2020-04-22T14:07:49.052 INFO:teuthology.orchestra.run.smithi103.stdout: "cap_ttl": "2020-04-22T14:08:42.206403+0000", 2020-04-22T14:07:49.052 INFO:teuthology.orchestra.run.smithi103.stdout: "last_cap_renew_request": "2020-04-22T14:07:42.206403+0000", 2020-04-22T14:07:49.052 INFO:teuthology.orchestra.run.smithi103.stdout: "cap_renew_seq": 2, 2020-04-22T14:07:49.052 INFO:teuthology.orchestra.run.smithi103.stdout: "num_caps": 1, 2020-04-22T14:07:49.053 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "open" 2020-04-22T14:07:49.053 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:49.053 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:07:49.053 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 28 2020-04-22T14:07:49.053 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:07:49.054 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:49.068 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:07:49.214 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.211+0000 7f1883e26700 1 Processor -- start 2020-04-22T14:07:49.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.211+0000 7f1883e26700 1 -- start start 2020-04-22T14:07:49.222 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.212+0000 7f1883e26700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f187c140320 0x7f187c0ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:49.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.212+0000 7f1883e26700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f187c14a740 con 0x7f187c14a2b0 2020-04-22T14:07:49.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.212+0000 7f1883e26700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f187c1462f0 con 0x7f187c0bd1b0 2020-04-22T14:07:49.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.212+0000 7f1883e26700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f187c146590 con 0x7f187c140320 2020-04-22T14:07:49.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.212+0000 7f18823c3700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f187c0bd1b0 0x7f187c0ac740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42838/0 (socket says 172.21.15.103:42838) 2020-04-22T14:07:49.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.212+0000 7f18823c3700 1 -- 172.21.15.103:0/1740648611 learned_addr learned my addr 172.21.15.103:0/1740648611 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:07:49.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.212+0000 7f1881bc2700 1 --2- 172.21.15.103:0/1740648611 >> v2:172.21.15.86:3300/0 conn(0x7f187c140320 0x7f187c0ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:49.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.213+0000 7f1880bc0700 1 -- 172.21.15.103:0/1740648611 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3904673175 0 0) 0x7f187c1462f0 con 0x7f187c0bd1b0 2020-04-22T14:07:49.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.213+0000 7f1880bc0700 1 -- 172.21.15.103:0/1740648611 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1864003230 con 0x7f187c0bd1b0 2020-04-22T14:07:49.225 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.213+0000 7f1880bc0700 1 -- 172.21.15.103:0/1740648611 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 529317951 0 0) 0x7f1864003230 con 0x7f187c0bd1b0 2020-04-22T14:07:49.225 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.213+0000 7f1880bc0700 1 -- 172.21.15.103:0/1740648611 >> v2:172.21.15.86:3300/0 conn(0x7f187c140320 msgr2=0x7f187c0ae1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:49.225 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.213+0000 7f1880bc0700 1 --2- 172.21.15.103:0/1740648611 >> v2:172.21.15.86:3300/0 conn(0x7f187c140320 0x7f187c0ae1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:49.225 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.213+0000 7f1880bc0700 1 -- 172.21.15.103:0/1740648611 >> v1:172.21.15.86:6789/0 conn(0x7f187c14a2b0 legacy=0x7f187c146cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:49.225 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.213+0000 7f1880bc0700 1 -- 172.21.15.103:0/1740648611 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f187c146830 con 0x7f187c0bd1b0 2020-04-22T14:07:49.227 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.213+0000 7f1880bc0700 1 -- 172.21.15.103:0/1740648611 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f1874001a50 con 0x7f187c0bd1b0 2020-04-22T14:07:49.227 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.213+0000 7f1880bc0700 1 -- 172.21.15.103:0/1740648611 >> v1:172.21.15.103:6789/0 conn(0x7f187c0bd1b0 legacy=0x7f187c0ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:49.227 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.213+0000 7f1880bc0700 1 --2- 172.21.15.103:0/1740648611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1864003720 0x7f1864003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:49.227 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.213+0000 7f1880bc0700 1 --2- 172.21.15.103:0/1740648611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18640044d0 0x7f1864004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:49.227 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.213+0000 7f1880bc0700 1 --2- 172.21.15.103:0/1740648611 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1864004db0 0x7f186400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:49.228 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.213+0000 7f1880bc0700 1 -- 172.21.15.103:0/1740648611 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187c146590 con 0x7f1864004db0 2020-04-22T14:07:49.228 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.213+0000 7f1880bc0700 1 -- 172.21.15.103:0/1740648611 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18640041c0 con 0x7f1864003720 2020-04-22T14:07:49.228 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.213+0000 7f1880bc0700 1 -- 172.21.15.103:0/1740648611 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f186400bb80 con 0x7f18640044d0 2020-04-22T14:07:49.228 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.213+0000 7f1881bc2700 1 --2- 172.21.15.103:0/1740648611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1864003720 0x7f1864003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:49.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.213+0000 7f18823c3700 1 --2- 172.21.15.103:0/1740648611 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1864004db0 0x7f186400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:49.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.213+0000 7f18813c1700 1 --2- 172.21.15.103:0/1740648611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18640044d0 0x7f1864004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:49.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.213+0000 7f1881bc2700 1 -- 172.21.15.103:0/1740648611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18640044d0 msgr2=0x7f1864004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:49.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.213+0000 7f1881bc2700 1 --2- 172.21.15.103:0/1740648611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18640044d0 0x7f1864004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:49.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.213+0000 7f1881bc2700 1 -- 172.21.15.103:0/1740648611 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1864004db0 msgr2=0x7f186400b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:49.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.213+0000 7f1881bc2700 1 --2- 172.21.15.103:0/1740648611 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1864004db0 0x7f186400b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:49.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.213+0000 7f1881bc2700 1 -- 172.21.15.103:0/1740648611 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1864003230 con 0x7f1864003720 2020-04-22T14:07:49.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.213+0000 7f18823c3700 1 -- 172.21.15.103:0/1740648611 reap_dead start 2020-04-22T14:07:49.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.213+0000 7f18813c1700 1 --2- 172.21.15.103:0/1740648611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18640044d0 0x7f1864004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:07:49.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.213+0000 7f1881bc2700 1 --2- 172.21.15.103:0/1740648611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1864003720 0x7f1864003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f18640054a0 tx=0x7f1878010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:49.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.213+0000 7f1881bc2700 1 --2- 172.21.15.103:0/1740648611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1864003720 0x7f1864003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f18640054a0 tx=0x7f1878010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:49.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.213+0000 7f1881bc2700 1 --2- 172.21.15.103:0/1740648611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1864003720 0x7f1864003b40 secure :-1 s=READY pgs=738 cs=0 l=1 rx=0x7f18640054a0 tx=0x7f1878010050).ready entity=mon.1 client_cookie=80cc96ba6c470f6c server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:49.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.213+0000 7f1881bc2700 1 --2- 172.21.15.103:0/1740648611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1864003720 0x7f1864003b40 secure :-1 s=THROTTLE_DONE pgs=738 cs=0 l=1 rx=0x7f18640054a0 tx=0x7f1878010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:49.231 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.213+0000 7f1881bc2700 1 --2- 172.21.15.103:0/1740648611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1864003720 0x7f1864003b40 secure :-1 s=THROTTLE_DONE pgs=738 cs=0 l=1 rx=0x7f18640054a0 tx=0x7f1878010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:49.231 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.213+0000 7f1880bc0700 1 -- 172.21.15.103:0/1740648611 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1878010d20 con 0x7f1864003720 2020-04-22T14:07:49.231 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.214+0000 7f1881bc2700 1 --2- 172.21.15.103:0/1740648611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1864003720 0x7f1864003b40 secure :-1 s=THROTTLE_DONE pgs=738 cs=0 l=1 rx=0x7f18640054a0 tx=0x7f1878010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:49.231 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.214+0000 7f1880bc0700 1 -- 172.21.15.103:0/1740648611 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1878010e80 con 0x7f1864003720 2020-04-22T14:07:49.231 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.214+0000 7f1880bc0700 1 -- 172.21.15.103:0/1740648611 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1878008b10 con 0x7f1864003720 2020-04-22T14:07:49.231 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.214+0000 7f1883e26700 1 -- 172.21.15.103:0/1740648611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1864003720 msgr2=0x7f1864003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:49.231 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.214+0000 7f1883e26700 1 --2- 172.21.15.103:0/1740648611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1864003720 0x7f1864003b40 secure :-1 s=READY pgs=738 cs=0 l=1 rx=0x7f18640054a0 tx=0x7f1878010050).stop 2020-04-22T14:07:49.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.214+0000 7f1883e26700 1 -- 172.21.15.103:0/1740648611 shutdown_connections 2020-04-22T14:07:49.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.214+0000 7f1883e26700 1 --2- 172.21.15.103:0/1740648611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1864003720 0x7f1864003b40 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:49.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.214+0000 7f1883e26700 1 -- 172.21.15.103:0/1740648611 >> 172.21.15.103:0/1740648611 conn(0x7f187c05f2c0 msgr2=0x7f187c0bcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:49.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.214+0000 7f1883e26700 1 -- 172.21.15.103:0/1740648611 shutdown_connections 2020-04-22T14:07:49.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.214+0000 7f1883e26700 1 -- 172.21.15.103:0/1740648611 wait complete. 2020-04-22T14:07:49.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.215+0000 7f1883e26700 1 Processor -- start 2020-04-22T14:07:49.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.215+0000 7f1883e26700 1 -- start start 2020-04-22T14:07:49.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.216+0000 7f1883e26700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1864003720 0x7f187c142520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:49.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.216+0000 7f1883e26700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f187c145d40 0x7f187c148cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:49.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.216+0000 7f1883e26700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f187c149110 con 0x7f187c13c560 2020-04-22T14:07:49.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.216+0000 7f1883e26700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f187c0af880 con 0x7f1864003720 2020-04-22T14:07:49.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.216+0000 7f1883e26700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f187c0afb20 con 0x7f187c145d40 2020-04-22T14:07:49.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.216+0000 7f18813c1700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f187c145d40 0x7f187c148cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:49.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.216+0000 7f18813c1700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f187c145d40 0x7f187c148cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50658/0 (socket says 172.21.15.103:50658) 2020-04-22T14:07:49.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.216+0000 7f18813c1700 1 -- 172.21.15.103:0/2740567293 learned_addr learned my addr 172.21.15.103:0/2740567293 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:49.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.216+0000 7f1881bc2700 1 --2- 172.21.15.103:0/2740567293 >> v2:172.21.15.86:3300/0 conn(0x7f1864003720 0x7f187c142520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:49.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.216+0000 7f18813c1700 1 -- 172.21.15.103:0/2740567293 >> v2:172.21.15.86:3300/0 conn(0x7f1864003720 msgr2=0x7f187c142520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:49.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.216+0000 7f18813c1700 1 --2- 172.21.15.103:0/2740567293 >> v2:172.21.15.86:3300/0 conn(0x7f1864003720 0x7f187c142520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:49.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.216+0000 7f18813c1700 1 -- 172.21.15.103:0/2740567293 >> v1:172.21.15.86:6789/0 conn(0x7f187c13c560 legacy=0x7f187c143f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:49.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.216+0000 7f18813c1700 1 -- 172.21.15.103:0/2740567293 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f187c0afdc0 con 0x7f187c145d40 2020-04-22T14:07:49.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.216+0000 7f18813c1700 1 --2- 172.21.15.103:0/2740567293 >> v2:172.21.15.103:3300/0 conn(0x7f187c145d40 0x7f187c148cb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f187c146bb0 tx=0x7f186c001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:49.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.216+0000 7f18813c1700 1 --2- 172.21.15.103:0/2740567293 >> v2:172.21.15.103:3300/0 conn(0x7f187c145d40 0x7f187c148cb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f187c146bb0 tx=0x7f186c001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:49.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.216+0000 7f18813c1700 1 --2- 172.21.15.103:0/2740567293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f187c145d40 0x7f187c148cb0 secure :-1 s=READY pgs=739 cs=0 l=1 rx=0x7f187c146bb0 tx=0x7f186c001e40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:49.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.216+0000 7f18813c1700 1 --2- 172.21.15.103:0/2740567293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f187c145d40 0x7f187c148cb0 secure :-1 s=THROTTLE_DONE pgs=739 cs=0 l=1 rx=0x7f187c146bb0 tx=0x7f186c001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:49.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.216+0000 7f186affd700 1 -- 172.21.15.103:0/2740567293 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f186c0124d0 con 0x7f187c145d40 2020-04-22T14:07:49.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.216+0000 7f18813c1700 1 --2- 172.21.15.103:0/2740567293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f187c145d40 0x7f187c148cb0 secure :-1 s=THROTTLE_DONE pgs=739 cs=0 l=1 rx=0x7f187c146bb0 tx=0x7f186c001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:49.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.216+0000 7f1883e26700 1 -- 172.21.15.103:0/2740567293 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f187c0b0060 con 0x7f187c145d40 2020-04-22T14:07:49.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.216+0000 7f186affd700 1 -- 172.21.15.103:0/2740567293 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186c012630 con 0x7f187c145d40 2020-04-22T14:07:49.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.216+0000 7f18813c1700 1 --2- 172.21.15.103:0/2740567293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f187c145d40 0x7f187c148cb0 secure :-1 s=THROTTLE_DONE pgs=739 cs=0 l=1 rx=0x7f187c146bb0 tx=0x7f186c001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:49.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.216+0000 7f186affd700 1 -- 172.21.15.103:0/2740567293 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f186c012a10 con 0x7f187c145d40 2020-04-22T14:07:49.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.216+0000 7f1883e26700 1 -- 172.21.15.103:0/2740567293 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f187c13c990 con 0x7f187c145d40 2020-04-22T14:07:49.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.217+0000 7f18813c1700 1 --2- 172.21.15.103:0/2740567293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f187c145d40 0x7f187c148cb0 secure :-1 s=THROTTLE_DONE pgs=739 cs=0 l=1 rx=0x7f187c146bb0 tx=0x7f186c001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:49.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.217+0000 7f186affd700 1 -- 172.21.15.103:0/2740567293 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f186c012c50 con 0x7f187c145d40 2020-04-22T14:07:49.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.217+0000 7f18813c1700 1 --2- 172.21.15.103:0/2740567293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f187c145d40 0x7f187c148cb0 secure :-1 s=THROTTLE_DONE pgs=739 cs=0 l=1 rx=0x7f187c146bb0 tx=0x7f186c001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:49.237 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.217+0000 7f1883e26700 1 -- 172.21.15.103:0/2740567293 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f187c0b01f0 con 0x7f187c145d40 2020-04-22T14:07:49.237 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.218+0000 7f186affd700 1 --2- 172.21.15.103:0/2740567293 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f185c04d900 0x7f185c04fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:49.237 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.218+0000 7f186affd700 1 -- 172.21.15.103:0/2740567293 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f186c060f20 con 0x7f187c145d40 2020-04-22T14:07:49.237 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.218+0000 7f1881bc2700 1 --2- 172.21.15.103:0/2740567293 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f185c04d900 0x7f185c04fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:49.238 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.218+0000 7f1881bc2700 1 --2- 172.21.15.103:0/2740567293 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f185c04d900 0x7f185c04fdc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f18640054a0 tx=0x7f1878010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:49.238 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.218+0000 7f1881bc2700 1 --2- 172.21.15.103:0/2740567293 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f185c04d900 0x7f185c04fdc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f18640054a0 tx=0x7f1878010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:49.238 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.218+0000 7f1881bc2700 1 --2- 172.21.15.103:0/2740567293 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f185c04d900 0x7f185c04fdc0 secure :-1 s=READY pgs=280 cs=0 l=1 rx=0x7f18640054a0 tx=0x7f1878010050).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:49.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.222+0000 7f18813c1700 1 --2- 172.21.15.103:0/2740567293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f187c145d40 0x7f187c148cb0 secure :-1 s=THROTTLE_DONE pgs=739 cs=0 l=1 rx=0x7f187c146bb0 tx=0x7f186c001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:49.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.222+0000 7f186affd700 1 -- 172.21.15.103:0/2740567293 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f186c03c2a0 con 0x7f187c145d40 2020-04-22T14:07:49.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.412+0000 7f1883e26700 1 -- 172.21.15.103:0/2740567293 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f187c056c90 con 0x7f187c145d40 2020-04-22T14:07:49.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.413+0000 7f18813c1700 1 --2- 172.21.15.103:0/2740567293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f187c145d40 0x7f187c148cb0 secure :-1 s=THROTTLE_DONE pgs=739 cs=0 l=1 rx=0x7f187c146bb0 tx=0x7f186c001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:49.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.413+0000 7f186affd700 1 -- 172.21.15.103:0/2740567293 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f186c03f8c0 con 0x7f187c145d40 2020-04-22T14:07:49.416 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:07:49.417 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":28,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4898,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/167651529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":167651529},{"type":"v1","addr":"172.21.15.86:6835","nonce":167651529}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:07:30.137341+0000","modified":"2020-04-22T14:07:32.145409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5890},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5890":{"gid":5890,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/494421372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":494421372},{"type":"v1","addr":"172.21.15.103:6833","nonce":494421372}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2020-04-22T14:07:49.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.414+0000 7f1883e26700 1 -- 172.21.15.103:0/2740567293 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f185c04d900 msgr2=0x7f185c04fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:49.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.414+0000 7f1883e26700 1 --2- 172.21.15.103:0/2740567293 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f185c04d900 0x7f185c04fdc0 secure :-1 s=READY pgs=280 cs=0 l=1 rx=0x7f18640054a0 tx=0x7f1878010050).stop 2020-04-22T14:07:49.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.414+0000 7f1883e26700 1 -- 172.21.15.103:0/2740567293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f187c145d40 msgr2=0x7f187c148cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:49.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.414+0000 7f1883e26700 1 --2- 172.21.15.103:0/2740567293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f187c145d40 0x7f187c148cb0 secure :-1 s=READY pgs=739 cs=0 l=1 rx=0x7f187c146bb0 tx=0x7f186c001e40).stop 2020-04-22T14:07:49.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.414+0000 7f1883e26700 1 -- 172.21.15.103:0/2740567293 shutdown_connections 2020-04-22T14:07:49.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.414+0000 7f1883e26700 1 --2- 172.21.15.103:0/2740567293 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f185c04d900 0x7f185c04fdc0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:49.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.414+0000 7f1883e26700 1 --2- 172.21.15.103:0/2740567293 >> v2:172.21.15.86:3300/0 conn(0x7f1864003720 0x7f187c142520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:49.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.414+0000 7f1883e26700 1 --2- 172.21.15.103:0/2740567293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f187c145d40 0x7f187c148cb0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:49.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.414+0000 7f1883e26700 1 -- 172.21.15.103:0/2740567293 >> 172.21.15.103:0/2740567293 conn(0x7f187c05f2c0 msgr2=0x7f187c13f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:49.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.414+0000 7f1883e26700 1 -- 172.21.15.103:0/2740567293 shutdown_connections 2020-04-22T14:07:49.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.414+0000 7f1883e26700 1 -- 172.21.15.103:0/2740567293 wait complete. 2020-04-22T14:07:49.419 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 28 2020-04-22T14:07:49.427 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:49.441 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok session config 6103 timeout 120 2020-04-22T14:07:49.607 INFO:tasks.cephfs.filesystem:_json_asok output: 2020-04-22T14:07:49.607 INFO:tasks.cephfs.mount:Killing connection on ubuntu@smithi103.front.sepia.ceph.com... 2020-04-22T14:07:49.607 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:07:49.607 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:49.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:07:49.621 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip link set brx.0 down' 2020-04-22T14:07:49.698 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:49.750 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:07:49.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.894+0000 7fae3b8b3700 1 Processor -- start 2020-04-22T14:07:49.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.894+0000 7fae3b8b3700 1 -- start start 2020-04-22T14:07:49.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.895+0000 7fae3b8b3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fae341441f0 0x7fae34144820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:49.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.895+0000 7fae3b8b3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fae34144c80 0x7fae340ad850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:07:49.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.895+0000 7fae3b8b3700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae340b5900 con 0x7fae3405b7c0 2020-04-22T14:07:49.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.895+0000 7fae3b8b3700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae340b5ba0 con 0x7fae341441f0 2020-04-22T14:07:49.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.895+0000 7fae3b8b3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae340b5e40 con 0x7fae34144c80 2020-04-22T14:07:49.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.895+0000 7fae38e4e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fae341441f0 0x7fae34144820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:49.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.895+0000 7fae38e4e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fae341441f0 0x7fae34144820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50666/0 (socket says 172.21.15.103:50666) 2020-04-22T14:07:49.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.895+0000 7fae38e4e700 1 -- 172.21.15.103:0/1385758315 learned_addr learned my addr 172.21.15.103:0/1385758315 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:49.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.895+0000 7fae39e50700 1 --2- 172.21.15.103:0/1385758315 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fae34144c80 0x7fae340ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:49.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.895+0000 7fae38e4e700 1 -- 172.21.15.103:0/1385758315 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fae34144c80 msgr2=0x7fae340ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:07:49.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.895+0000 7fae38e4e700 1 --2- 172.21.15.103:0/1385758315 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fae34144c80 0x7fae340ad850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:49.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.895+0000 7fae38e4e700 1 -- 172.21.15.103:0/1385758315 >> v1:172.21.15.86:6789/0 conn(0x7fae3405b7c0 legacy=0x7fae340b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:49.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.895+0000 7fae38e4e700 1 -- 172.21.15.103:0/1385758315 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae3405bba0 con 0x7fae341441f0 2020-04-22T14:07:49.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.895+0000 7fae38e4e700 1 --2- 172.21.15.103:0/1385758315 >> v2:172.21.15.103:3300/0 conn(0x7fae341441f0 0x7fae34144820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fae28002f30 tx=0x7fae28007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:49.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.895+0000 7fae38e4e700 1 --2- 172.21.15.103:0/1385758315 >> v2:172.21.15.103:3300/0 conn(0x7fae341441f0 0x7fae34144820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fae28002f30 tx=0x7fae28007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:49.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.895+0000 7fae38e4e700 1 --2- 172.21.15.103:0/1385758315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae341441f0 0x7fae34144820 secure :-1 s=READY pgs=740 cs=0 l=1 rx=0x7fae28002f30 tx=0x7fae28007a40).ready entity=mon.1 client_cookie=e1d0f60a3451f6a8 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:49.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.895+0000 7fae38e4e700 1 --2- 172.21.15.103:0/1385758315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae341441f0 0x7fae34144820 secure :-1 s=THROTTLE_DONE pgs=740 cs=0 l=1 rx=0x7fae28002f30 tx=0x7fae28007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:49.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.895+0000 7fae27fff700 1 -- 172.21.15.103:0/1385758315 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae28008e10 con 0x7fae341441f0 2020-04-22T14:07:49.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.895+0000 7fae38e4e700 1 --2- 172.21.15.103:0/1385758315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae341441f0 0x7fae34144820 secure :-1 s=THROTTLE_DONE pgs=740 cs=0 l=1 rx=0x7fae28002f30 tx=0x7fae28007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:49.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.895+0000 7fae38e4e700 1 --2- 172.21.15.103:0/1385758315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae341441f0 0x7fae34144820 secure :-1 s=THROTTLE_DONE pgs=740 cs=0 l=1 rx=0x7fae28002f30 tx=0x7fae28007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:49.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.895+0000 7fae27fff700 1 -- 172.21.15.103:0/1385758315 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae280107c0 con 0x7fae341441f0 2020-04-22T14:07:49.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.895+0000 7fae27fff700 1 -- 172.21.15.103:0/1385758315 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae28010be0 con 0x7fae341441f0 2020-04-22T14:07:49.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.895+0000 7fae3b8b3700 1 -- 172.21.15.103:0/1385758315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae341441f0 msgr2=0x7fae34144820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:49.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.895+0000 7fae3b8b3700 1 --2- 172.21.15.103:0/1385758315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae341441f0 0x7fae34144820 secure :-1 s=READY pgs=740 cs=0 l=1 rx=0x7fae28002f30 tx=0x7fae28007a40).stop 2020-04-22T14:07:49.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.896+0000 7fae3b8b3700 1 -- 172.21.15.103:0/1385758315 shutdown_connections 2020-04-22T14:07:49.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.896+0000 7fae3b8b3700 1 --2- 172.21.15.103:0/1385758315 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fae34144c80 0x7fae340ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:07:49.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.896+0000 7fae3b8b3700 1 --2- 172.21.15.103:0/1385758315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae341441f0 0x7fae34144820 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:49.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.896+0000 7fae3b8b3700 1 -- 172.21.15.103:0/1385758315 >> 172.21.15.103:0/1385758315 conn(0x7fae340b9160 msgr2=0x7fae3405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:49.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.896+0000 7fae3b8b3700 1 -- 172.21.15.103:0/1385758315 shutdown_connections 2020-04-22T14:07:49.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.896+0000 7fae3b8b3700 1 -- 172.21.15.103:0/1385758315 wait complete. 2020-04-22T14:07:49.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.897+0000 7fae3b8b3700 1 Processor -- start 2020-04-22T14:07:49.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.897+0000 7fae3b8b3700 1 -- start start 2020-04-22T14:07:49.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.898+0000 7fae3b8b3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fae3405b7c0 0x7fae340ae7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:49.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.898+0000 7fae3b8b3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fae34144c80 0x7fae340666d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:49.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.898+0000 7fae3b8b3700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae340aecb0 con 0x7fae341441f0 2020-04-22T14:07:49.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.898+0000 7fae3b8b3700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae3413e740 con 0x7fae3405b7c0 2020-04-22T14:07:49.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.898+0000 7fae3b8b3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae34140820 con 0x7fae34144c80 2020-04-22T14:07:49.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.898+0000 7fae39e50700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fae34144c80 0x7fae340666d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:49.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.898+0000 7fae3964f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fae3405b7c0 0x7fae340ae7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:49.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.898+0000 7fae39e50700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fae34144c80 0x7fae340666d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:35452/0 (socket says 172.21.15.103:35452) 2020-04-22T14:07:49.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.898+0000 7fae39e50700 1 -- 172.21.15.103:0/3867154391 learned_addr learned my addr 172.21.15.103:0/3867154391 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:07:49.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.898+0000 7fae39e50700 1 -- 172.21.15.103:0/3867154391 >> v2:172.21.15.86:3300/0 conn(0x7fae3405b7c0 msgr2=0x7fae340ae7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:49.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.898+0000 7fae39e50700 1 --2- 172.21.15.103:0/3867154391 >> v2:172.21.15.86:3300/0 conn(0x7fae3405b7c0 0x7fae340ae7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:49.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.898+0000 7fae39e50700 1 -- 172.21.15.103:0/3867154391 >> v1:172.21.15.86:6789/0 conn(0x7fae341441f0 legacy=0x7fae3413a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:49.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.898+0000 7fae267fc700 1 -- 172.21.15.103:0/3867154391 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3518931530 0 0) 0x7fae340aecb0 con 0x7fae341441f0 2020-04-22T14:07:49.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.898+0000 7fae39e50700 1 -- 172.21.15.103:0/3867154391 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae3413b020 con 0x7fae34144c80 2020-04-22T14:07:49.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.898+0000 7fae3964f700 1 --2- 172.21.15.103:0/3867154391 >> v2:172.21.15.86:3300/0 conn(0x7fae3405b7c0 0x7fae340ae7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:07:49.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.898+0000 7fae39e50700 1 --2- 172.21.15.103:0/3867154391 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fae34144c80 0x7fae340666d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fae30002f30 tx=0x7fae30010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:49.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.898+0000 7fae39e50700 1 --2- 172.21.15.103:0/3867154391 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fae34144c80 0x7fae340666d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fae30002f30 tx=0x7fae30010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:49.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.898+0000 7fae39e50700 1 --2- 172.21.15.103:0/3867154391 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fae34144c80 0x7fae340666d0 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7fae30002f30 tx=0x7fae30010b70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:49.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.898+0000 7fae39e50700 1 --2- 172.21.15.103:0/3867154391 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fae34144c80 0x7fae340666d0 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7fae30002f30 tx=0x7fae30010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:49.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.898+0000 7fae267fc700 1 -- 172.21.15.103:0/3867154391 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae30005e90 con 0x7fae34144c80 2020-04-22T14:07:49.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.899+0000 7fae39e50700 1 --2- 172.21.15.103:0/3867154391 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fae34144c80 0x7fae340666d0 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7fae30002f30 tx=0x7fae30010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:49.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.899+0000 7fae39e50700 1 --2- 172.21.15.103:0/3867154391 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fae34144c80 0x7fae340666d0 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7fae30002f30 tx=0x7fae30010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:49.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.899+0000 7fae267fc700 1 -- 172.21.15.103:0/3867154391 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae30007180 con 0x7fae34144c80 2020-04-22T14:07:49.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.899+0000 7fae3b8b3700 1 -- 172.21.15.103:0/3867154391 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae340b78b0 con 0x7fae34144c80 2020-04-22T14:07:49.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.899+0000 7fae267fc700 1 -- 172.21.15.103:0/3867154391 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae30007520 con 0x7fae34144c80 2020-04-22T14:07:49.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.899+0000 7fae3b8b3700 1 -- 172.21.15.103:0/3867154391 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae34151ae0 con 0x7fae34144c80 2020-04-22T14:07:49.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.899+0000 7fae39e50700 1 --2- 172.21.15.103:0/3867154391 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fae34144c80 0x7fae340666d0 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7fae30002f30 tx=0x7fae30010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:49.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.900+0000 7fae267fc700 1 -- 172.21.15.103:0/3867154391 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fae30012210 con 0x7fae34144c80 2020-04-22T14:07:49.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.900+0000 7fae39e50700 1 --2- 172.21.15.103:0/3867154391 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fae34144c80 0x7fae340666d0 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7fae30002f30 tx=0x7fae30010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:49.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.900+0000 7fae267fc700 1 --2- 172.21.15.103:0/3867154391 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fae1404d900 0x7fae1404fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:07:49.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.900+0000 7fae267fc700 1 -- 172.21.15.103:0/3867154391 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fae30061720 con 0x7fae34144c80 2020-04-22T14:07:49.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.901+0000 7fae3964f700 1 --2- 172.21.15.103:0/3867154391 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fae1404d900 0x7fae1404fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:07:49.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.901+0000 7fae3964f700 1 --2- 172.21.15.103:0/3867154391 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fae1404d900 0x7fae1404fdc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fae340613e0 tx=0x7fae2c001720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:49.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.901+0000 7fae3964f700 1 --2- 172.21.15.103:0/3867154391 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fae1404d900 0x7fae1404fdc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fae340613e0 tx=0x7fae2c001720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:49.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.901+0000 7fae3964f700 1 --2- 172.21.15.103:0/3867154391 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fae1404d900 0x7fae1404fdc0 secure :-1 s=READY pgs=281 cs=0 l=1 rx=0x7fae340613e0 tx=0x7fae2c001720).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:07:49.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.905+0000 7fae3b8b3700 1 -- 172.21.15.103:0/3867154391 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae34056c90 con 0x7fae34144c80 2020-04-22T14:07:49.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.909+0000 7fae39e50700 1 --2- 172.21.15.103:0/3867154391 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fae34144c80 0x7fae340666d0 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7fae30002f30 tx=0x7fae30010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:49.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:49.909+0000 7fae267fc700 1 -- 172.21.15.103:0/3867154391 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fae3003cb00 con 0x7fae34144c80 2020-04-22T14:07:50.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:50.099+0000 7fae3b8b3700 1 -- 172.21.15.103:0/3867154391 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fae340b4eb0 con 0x7fae34144c80 2020-04-22T14:07:50.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:50.101+0000 7fae39e50700 1 --2- 172.21.15.103:0/3867154391 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fae34144c80 0x7fae340666d0 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7fae30002f30 tx=0x7fae30010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:07:50.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:50.101+0000 7fae267fc700 1 -- 172.21.15.103:0/3867154391 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+2136 (secure 0 0 0) 0x7fae30040120 con 0x7fae34144c80 2020-04-22T14:07:50.104 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:07:50.104 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":28,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4898,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/167651529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":167651529},{"type":"v1","addr":"172.21.15.86:6835","nonce":167651529}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:07:30.137341+0000","modified":"2020-04-22T14:07:32.145409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5890},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5890":{"gid":5890,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/494421372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":494421372},{"type":"v1","addr":"172.21.15.103:6833","nonce":494421372}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2020-04-22T14:07:50.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:50.102+0000 7fae3b8b3700 1 -- 172.21.15.103:0/3867154391 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fae1404d900 msgr2=0x7fae1404fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:50.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:50.102+0000 7fae3b8b3700 1 --2- 172.21.15.103:0/3867154391 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fae1404d900 0x7fae1404fdc0 secure :-1 s=READY pgs=281 cs=0 l=1 rx=0x7fae340613e0 tx=0x7fae2c001720).stop 2020-04-22T14:07:50.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:50.102+0000 7fae3b8b3700 1 -- 172.21.15.103:0/3867154391 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fae34144c80 msgr2=0x7fae340666d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:07:50.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:50.102+0000 7fae3b8b3700 1 --2- 172.21.15.103:0/3867154391 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fae34144c80 0x7fae340666d0 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7fae30002f30 tx=0x7fae30010b70).stop 2020-04-22T14:07:50.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:50.102+0000 7fae3b8b3700 1 -- 172.21.15.103:0/3867154391 shutdown_connections 2020-04-22T14:07:50.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:50.102+0000 7fae3b8b3700 1 --2- 172.21.15.103:0/3867154391 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fae34144c80 0x7fae340666d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:50.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:50.102+0000 7fae3b8b3700 1 --2- 172.21.15.103:0/3867154391 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fae1404d900 0x7fae1404fdc0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:50.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:50.102+0000 7fae3b8b3700 1 --2- 172.21.15.103:0/3867154391 >> v2:172.21.15.86:3300/0 conn(0x7fae3405b7c0 0x7fae340ae7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:07:50.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:50.102+0000 7fae3b8b3700 1 -- 172.21.15.103:0/3867154391 >> 172.21.15.103:0/3867154391 conn(0x7fae340b9160 msgr2=0x7fae340621f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:07:50.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:50.102+0000 7fae3b8b3700 1 -- 172.21.15.103:0/3867154391 shutdown_connections 2020-04-22T14:07:50.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:07:50.102+0000 7fae3b8b3700 1 -- 172.21.15.103:0/3867154391 wait complete. 2020-04-22T14:07:50.107 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 28 2020-04-22T14:07:50.115 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:50.129 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok session ls 2020-04-22T14:07:50.287 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2020-04-22T14:07:50.287 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:50.287 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 5826, 2020-04-22T14:07:50.288 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": { 2020-04-22T14:07:50.288 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:07:50.288 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:07:50.288 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5826 2020-04-22T14:07:50.288 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:50.288 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:07:50.289 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "any", 2020-04-22T14:07:50.289 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.2:0", 2020-04-22T14:07:50.289 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1402976942 2020-04-22T14:07:50.289 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:50.289 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:50.289 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "open", 2020-04-22T14:07:50.289 INFO:teuthology.orchestra.run.smithi103.stdout: "num_leases": 0, 2020-04-22T14:07:50.290 INFO:teuthology.orchestra.run.smithi103.stdout: "num_caps": 1, 2020-04-22T14:07:50.290 INFO:teuthology.orchestra.run.smithi103.stdout: "request_load_avg": 1, 2020-04-22T14:07:50.290 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 3.473933454, 2020-04-22T14:07:50.290 INFO:teuthology.orchestra.run.smithi103.stdout: "requests_in_flight": 0, 2020-04-22T14:07:50.290 INFO:teuthology.orchestra.run.smithi103.stdout: "completed_requests": 1, 2020-04-22T14:07:50.290 INFO:teuthology.orchestra.run.smithi103.stdout: "reconnecting": false, 2020-04-22T14:07:50.291 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps": { 2020-04-22T14:07:50.291 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:07:50.291 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 60 2020-04-22T14:07:50.291 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:50.291 INFO:teuthology.orchestra.run.smithi103.stdout: "release_caps": { 2020-04-22T14:07:50.291 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:07:50.291 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 60 2020-04-22T14:07:50.292 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:50.292 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps_throttle": { 2020-04-22T14:07:50.292 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:07:50.292 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 2.5 2020-04-22T14:07:50.292 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:50.292 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps_throttle2o": { 2020-04-22T14:07:50.293 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:07:50.293 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 0.5 2020-04-22T14:07:50.293 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:50.293 INFO:teuthology.orchestra.run.smithi103.stdout: "session_cache_liveness": { 2020-04-22T14:07:50.293 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0.99201251161977289, 2020-04-22T14:07:50.293 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 300 2020-04-22T14:07:50.293 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:50.294 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": "client.5826 192.168.0.2:0/1402976942", 2020-04-22T14:07:50.294 INFO:teuthology.orchestra.run.smithi103.stdout: "completed_requests": [ 2020-04-22T14:07:50.294 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:50.294 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2, 2020-04-22T14:07:50.294 INFO:teuthology.orchestra.run.smithi103.stdout: "created_ino": "0x0" 2020-04-22T14:07:50.294 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:50.294 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:07:50.295 INFO:teuthology.orchestra.run.smithi103.stdout: "prealloc_inos": [], 2020-04-22T14:07:50.295 INFO:teuthology.orchestra.run.smithi103.stdout: "used_inos": [], 2020-04-22T14:07:50.295 INFO:teuthology.orchestra.run.smithi103.stdout: "client_metadata": { 2020-04-22T14:07:50.295 INFO:teuthology.orchestra.run.smithi103.stdout: "client_features": { 2020-04-22T14:07:50.295 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_bits": "0x0000000000003fff" 2020-04-22T14:07:50.295 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:50.295 INFO:teuthology.orchestra.run.smithi103.stdout: "metric_spec": { 2020-04-22T14:07:50.296 INFO:teuthology.orchestra.run.smithi103.stdout: "metric_flags": { 2020-04-22T14:07:50.296 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_bits": "0x" 2020-04-22T14:07:50.296 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:50.296 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:50.296 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:07:50.296 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:07:50.296 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "1", 2020-04-22T14:07:50.297 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:07:50.297 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2020-04-22T14:07:50.297 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "61519", 2020-04-22T14:07:50.297 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:07:50.297 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:50.297 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:50.297 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:50.298 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 6103, 2020-04-22T14:07:50.298 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": { 2020-04-22T14:07:50.298 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:07:50.298 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:07:50.298 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 6103 2020-04-22T14:07:50.298 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:50.298 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:07:50.299 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "any", 2020-04-22T14:07:50.299 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:07:50.299 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 322128533 2020-04-22T14:07:50.299 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:50.299 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:50.299 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "open", 2020-04-22T14:07:50.299 INFO:teuthology.orchestra.run.smithi103.stdout: "num_leases": 0, 2020-04-22T14:07:50.300 INFO:teuthology.orchestra.run.smithi103.stdout: "num_caps": 1, 2020-04-22T14:07:50.300 INFO:teuthology.orchestra.run.smithi103.stdout: "request_load_avg": 1, 2020-04-22T14:07:50.300 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 9.0788260869999995, 2020-04-22T14:07:50.300 INFO:teuthology.orchestra.run.smithi103.stdout: "requests_in_flight": 0, 2020-04-22T14:07:50.300 INFO:teuthology.orchestra.run.smithi103.stdout: "completed_requests": 1, 2020-04-22T14:07:50.300 INFO:teuthology.orchestra.run.smithi103.stdout: "reconnecting": false, 2020-04-22T14:07:50.303 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps": { 2020-04-22T14:07:50.303 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:07:50.303 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 60 2020-04-22T14:07:50.303 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:50.303 INFO:teuthology.orchestra.run.smithi103.stdout: "release_caps": { 2020-04-22T14:07:50.304 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:07:50.304 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 60 2020-04-22T14:07:50.304 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:50.304 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps_throttle": { 2020-04-22T14:07:50.304 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:07:50.304 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 2.5 2020-04-22T14:07:50.304 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:50.305 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps_throttle2o": { 2020-04-22T14:07:50.305 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:07:50.305 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 0.5 2020-04-22T14:07:50.305 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:50.305 INFO:teuthology.orchestra.run.smithi103.stdout: "session_cache_liveness": { 2020-04-22T14:07:50.305 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0.97924645999541682, 2020-04-22T14:07:50.306 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 300 2020-04-22T14:07:50.306 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:50.306 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": "client.6103 192.168.0.1:0/322128533", 2020-04-22T14:07:50.306 INFO:teuthology.orchestra.run.smithi103.stdout: "completed_requests": [ 2020-04-22T14:07:50.306 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:07:50.306 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2, 2020-04-22T14:07:50.307 INFO:teuthology.orchestra.run.smithi103.stdout: "created_ino": "0x0" 2020-04-22T14:07:50.307 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:50.307 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:07:50.307 INFO:teuthology.orchestra.run.smithi103.stdout: "prealloc_inos": [], 2020-04-22T14:07:50.307 INFO:teuthology.orchestra.run.smithi103.stdout: "used_inos": [], 2020-04-22T14:07:50.308 INFO:teuthology.orchestra.run.smithi103.stdout: "client_metadata": { 2020-04-22T14:07:50.308 INFO:teuthology.orchestra.run.smithi103.stdout: "client_features": { 2020-04-22T14:07:50.308 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_bits": "0x0000000000003fff" 2020-04-22T14:07:50.308 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:50.308 INFO:teuthology.orchestra.run.smithi103.stdout: "metric_spec": { 2020-04-22T14:07:50.308 INFO:teuthology.orchestra.run.smithi103.stdout: "metric_flags": { 2020-04-22T14:07:50.309 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_bits": "0x" 2020-04-22T14:07:50.309 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:50.309 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:07:50.309 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:07:50.309 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:07:50.309 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "0", 2020-04-22T14:07:50.310 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:07:50.310 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-04-22T14:07:50.310 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "60261", 2020-04-22T14:07:50.310 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/", 2020-04-22T14:07:50.310 INFO:teuthology.orchestra.run.smithi103.stdout: "timeout": "120" 2020-04-22T14:07:50.310 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:50.310 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:07:50.311 INFO:teuthology.orchestra.run.smithi103.stdout:] 2020-04-22T14:07:50.312 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "id": 5826, "entity": { "name": { "type": "client", "num": 5826 }, "addr": { "type": "any", "addr": "192.168.0.2:0", "nonce": 1402976942 } }, "state": "open", "num_leases": 0, "num_caps": 1, "request_load_avg": 1, "uptime": 3.473933454, "requests_in_flight": 0, "completed_requests": 1, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0.99201251161977289, "halflife": 300 }, "inst": "client.5826 192.168.0.2:0/1402976942", "completed_requests": [ { "tid": 2, "created_ino": "0x0" } ], "prealloc_inos": [], "used_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x0000000000003fff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x" } }, "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", "entity_id": "1", "hostname": "smithi103", "mount_point": "/home/ubuntu/cephtest/mnt.1", "pid": "61519", "root": "/" } }, { "id": 6103, "entity": { "name": { "type": "client", "num": 6103 }, "addr": { "type": "any", "addr": "192.168.0.1:0", "nonce": 322128533 } }, "state": "open", "num_leases": 0, "num_caps": 1, "request_load_avg": 1, "uptime": 9.0788260869999995, "requests_in_flight": 0, "completed_requests": 1, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0.97924645999541682, "halflife": 300 }, "inst": "client.6103 192.168.0.1:0/322128533", "completed_requests": [ { "tid": 2, "created_ino": "0x0" } ], "prealloc_inos": [], "used_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x0000000000003fff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x" } }, "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", "entity_id": "0", "hostname": "smithi103", "mount_point": "/home/ubuntu/cephtest/mnt.0", "pid": "60261", "root": "/", "timeout": "120" } } ] 2020-04-22T14:07:50.631 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:07:50.648 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:07:50.691 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:07:50.706 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:08:20.809 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:08:20.828 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:08:20.871 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:08:20.888 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:08:50.981 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:08:51.004 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:08:51.047 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:08:51.065 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:09:20.313 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:09:20.330 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:09:20.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.484+0000 7f16362a3700 1 Processor -- start 2020-04-22T14:09:20.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.484+0000 7f16362a3700 1 -- start start 2020-04-22T14:09:20.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.484+0000 7f16362a3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16300ae1a0 0x7f163014a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:09:20.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.484+0000 7f16362a3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f16300bd1b0 0x7f16300bd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:09:20.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.484+0000 7f16362a3700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f163014a710 con 0x7f1630140320 2020-04-22T14:09:20.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.484+0000 7f16362a3700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16301462f0 con 0x7f16300bd1b0 2020-04-22T14:09:20.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.484+0000 7f16362a3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1630146590 con 0x7f16300ae1a0 2020-04-22T14:09:20.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.485+0000 7f1634840700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f16300bd1b0 0x7f16300bd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:09:20.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.485+0000 7f1634840700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f16300bd1b0 0x7f16300bd640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50764/0 (socket says 172.21.15.103:50764) 2020-04-22T14:09:20.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.485+0000 7f1634840700 1 -- 172.21.15.103:0/194329066 learned_addr learned my addr 172.21.15.103:0/194329066 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:09:20.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.485+0000 7f162f7fe700 1 --2- 172.21.15.103:0/194329066 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16300ae1a0 0x7f163014a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:09:20.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.485+0000 7f1634840700 1 -- 172.21.15.103:0/194329066 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16300ae1a0 msgr2=0x7f163014a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:09:20.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.485+0000 7f1634840700 1 --2- 172.21.15.103:0/194329066 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16300ae1a0 0x7f163014a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:09:20.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.485+0000 7f1634840700 1 -- 172.21.15.103:0/194329066 >> v1:172.21.15.86:6789/0 conn(0x7f1630140320 legacy=0x7f1630146cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:09:20.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.485+0000 7f1634840700 1 -- 172.21.15.103:0/194329066 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1630146830 con 0x7f16300bd1b0 2020-04-22T14:09:20.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.485+0000 7f162f7fe700 1 --2- 172.21.15.103:0/194329066 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16300ae1a0 0x7f163014a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:09:20.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.485+0000 7f1634840700 1 --2- 172.21.15.103:0/194329066 >> v2:172.21.15.103:3300/0 conn(0x7f16300bd1b0 0x7f16300bd640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f16300ba860 tx=0x7f1628007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:09:20.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.485+0000 7f1634840700 1 --2- 172.21.15.103:0/194329066 >> v2:172.21.15.103:3300/0 conn(0x7f16300bd1b0 0x7f16300bd640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f16300ba860 tx=0x7f1628007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:09:20.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.485+0000 7f1634840700 1 --2- 172.21.15.103:0/194329066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16300bd1b0 0x7f16300bd640 secure :-1 s=READY pgs=741 cs=0 l=1 rx=0x7f16300ba860 tx=0x7f1628007dc0).ready entity=mon.1 client_cookie=331f49a749bcb8a8 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:09:20.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.485+0000 7f1634840700 1 --2- 172.21.15.103:0/194329066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16300bd1b0 0x7f16300bd640 secure :-1 s=THROTTLE_DONE pgs=741 cs=0 l=1 rx=0x7f16300ba860 tx=0x7f1628007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:09:20.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.485+0000 7f162effd700 1 -- 172.21.15.103:0/194329066 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f162800a180 con 0x7f16300bd1b0 2020-04-22T14:09:20.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.485+0000 7f1634840700 1 --2- 172.21.15.103:0/194329066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16300bd1b0 0x7f16300bd640 secure :-1 s=THROTTLE_DONE pgs=741 cs=0 l=1 rx=0x7f16300ba860 tx=0x7f1628007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:09:20.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.485+0000 7f1634840700 1 --2- 172.21.15.103:0/194329066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16300bd1b0 0x7f16300bd640 secure :-1 s=THROTTLE_DONE pgs=741 cs=0 l=1 rx=0x7f16300ba860 tx=0x7f1628007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:09:20.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.485+0000 7f162effd700 1 -- 172.21.15.103:0/194329066 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162800a2e0 con 0x7f16300bd1b0 2020-04-22T14:09:20.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.485+0000 7f162effd700 1 -- 172.21.15.103:0/194329066 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f162800a700 con 0x7f16300bd1b0 2020-04-22T14:09:20.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.485+0000 7f16362a3700 1 -- 172.21.15.103:0/194329066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16300bd1b0 msgr2=0x7f16300bd640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:09:20.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.485+0000 7f16362a3700 1 --2- 172.21.15.103:0/194329066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16300bd1b0 0x7f16300bd640 secure :-1 s=READY pgs=741 cs=0 l=1 rx=0x7f16300ba860 tx=0x7f1628007dc0).stop 2020-04-22T14:09:20.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.486+0000 7f16362a3700 1 -- 172.21.15.103:0/194329066 shutdown_connections 2020-04-22T14:09:20.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.486+0000 7f16362a3700 1 --2- 172.21.15.103:0/194329066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16300bd1b0 0x7f16300bd640 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:09:20.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.486+0000 7f16362a3700 1 --2- 172.21.15.103:0/194329066 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16300ae1a0 0x7f163014a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:09:20.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.486+0000 7f16362a3700 1 -- 172.21.15.103:0/194329066 >> 172.21.15.103:0/194329066 conn(0x7f163005f2c0 msgr2=0x7f16300bcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:09:20.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.486+0000 7f16362a3700 1 -- 172.21.15.103:0/194329066 shutdown_connections 2020-04-22T14:09:20.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.486+0000 7f16362a3700 1 -- 172.21.15.103:0/194329066 wait complete. 2020-04-22T14:09:20.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.487+0000 7f16362a3700 1 Processor -- start 2020-04-22T14:09:20.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.487+0000 7f16362a3700 1 -- start start 2020-04-22T14:09:20.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.488+0000 7f16362a3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f16300ae1a0 0x7f16300b04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:09:20.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.488+0000 7f16362a3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1630140320 0x7f16301432f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:09:20.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.488+0000 7f16362a3700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16300af820 con 0x7f16300bd1b0 2020-04-22T14:09:20.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.488+0000 7f16362a3700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16300afac0 con 0x7f16300ae1a0 2020-04-22T14:09:20.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.488+0000 7f16362a3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16300afd60 con 0x7f1630140320 2020-04-22T14:09:20.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.488+0000 7f162f7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f16300bd1b0 0x7f163013f240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42962/0 (socket says 172.21.15.103:42962) 2020-04-22T14:09:20.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.488+0000 7f162f7fe700 1 -- 172.21.15.103:0/1656106235 learned_addr learned my addr 172.21.15.103:0/1656106235 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:09:20.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.488+0000 7f162ffff700 1 --2- 172.21.15.103:0/1656106235 >> v2:172.21.15.86:3300/0 conn(0x7f16300ae1a0 0x7f16300b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:09:20.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.488+0000 7f162d7fa700 1 -- 172.21.15.103:0/1656106235 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2907110378 0 0) 0x7f16300af820 con 0x7f16300bd1b0 2020-04-22T14:09:20.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.488+0000 7f1634840700 1 --2- 172.21.15.103:0/1656106235 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1630140320 0x7f16301432f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:09:20.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.488+0000 7f162d7fa700 1 -- 172.21.15.103:0/1656106235 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1610002fe0 con 0x7f16300bd1b0 2020-04-22T14:09:20.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.488+0000 7f162d7fa700 1 -- 172.21.15.103:0/1656106235 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4110803708 0 0) 0x7f1610002fe0 con 0x7f16300bd1b0 2020-04-22T14:09:20.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.488+0000 7f162d7fa700 1 -- 172.21.15.103:0/1656106235 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f16300af820 con 0x7f16300bd1b0 2020-04-22T14:09:20.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.488+0000 7f162d7fa700 1 -- 172.21.15.103:0/1656106235 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f16240026d0 con 0x7f16300bd1b0 2020-04-22T14:09:20.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.488+0000 7f162d7fa700 1 -- 172.21.15.103:0/1656106235 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1630140320 msgr2=0x7f16301432f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:09:20.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.488+0000 7f162d7fa700 1 --2- 172.21.15.103:0/1656106235 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1630140320 0x7f16301432f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:09:20.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.488+0000 7f162d7fa700 1 -- 172.21.15.103:0/1656106235 >> v2:172.21.15.86:3300/0 conn(0x7f16300ae1a0 msgr2=0x7f16300b04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:09:20.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.488+0000 7f162d7fa700 1 --2- 172.21.15.103:0/1656106235 >> v2:172.21.15.86:3300/0 conn(0x7f16300ae1a0 0x7f16300b04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:09:20.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.488+0000 7f162d7fa700 1 -- 172.21.15.103:0/1656106235 >> v1:172.21.15.103:6789/0 conn(0x7f16300bd1b0 legacy=0x7f163013f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:09:20.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.488+0000 7f162d7fa700 1 --2- 172.21.15.103:0/1656106235 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16100049b0 0x7f1610004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:09:20.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.488+0000 7f162d7fa700 1 --2- 172.21.15.103:0/1656106235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1610003920 0x7f1610003d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:09:20.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.488+0000 7f162d7fa700 1 --2- 172.21.15.103:0/1656106235 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1630140320 0x7f16100041c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:09:20.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.488+0000 7f162d7fa700 1 -- 172.21.15.103:0/1656106235 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16300afac0 con 0x7f16100049b0 2020-04-22T14:09:20.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.488+0000 7f162d7fa700 1 -- 172.21.15.103:0/1656106235 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16300afd60 con 0x7f1610003920 2020-04-22T14:09:20.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.488+0000 7f162d7fa700 1 -- 172.21.15.103:0/1656106235 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1610004620 con 0x7f1630140320 2020-04-22T14:09:20.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.488+0000 7f162f7fe700 1 --2- 172.21.15.103:0/1656106235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1610003920 0x7f1610003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:09:20.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.488+0000 7f162ffff700 1 --2- 172.21.15.103:0/1656106235 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16100049b0 0x7f1610004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:09:20.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.488+0000 7f1634840700 1 --2- 172.21.15.103:0/1656106235 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1630140320 0x7f16100041c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:09:20.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.489+0000 7f162f7fe700 1 -- 172.21.15.103:0/1656106235 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1630140320 msgr2=0x7f16100041c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:09:20.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.489+0000 7f162f7fe700 1 --2- 172.21.15.103:0/1656106235 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1630140320 0x7f16100041c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:09:20.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.489+0000 7f162f7fe700 1 -- 172.21.15.103:0/1656106235 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16100049b0 msgr2=0x7f1610004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:09:20.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.489+0000 7f162f7fe700 1 --2- 172.21.15.103:0/1656106235 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16100049b0 0x7f1610004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:09:20.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.489+0000 7f162f7fe700 1 -- 172.21.15.103:0/1656106235 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16300b0000 con 0x7f1610003920 2020-04-22T14:09:20.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.489+0000 7f16362a3700 1 -- 172.21.15.103:0/1656106235 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16300b0e30 con 0x7f1610003920 2020-04-22T14:09:20.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.489+0000 7f162f7fe700 1 --2- 172.21.15.103:0/1656106235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1610003920 0x7f1610003d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1624002460 tx=0x7f1624011600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:09:20.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.489+0000 7f16362a3700 1 -- 172.21.15.103:0/1656106235 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f163013fb90 con 0x7f1610003920 2020-04-22T14:09:20.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.489+0000 7f162f7fe700 1 --2- 172.21.15.103:0/1656106235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1610003920 0x7f1610003d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1624002460 tx=0x7f1624011600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:09:20.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.489+0000 7f162f7fe700 1 --2- 172.21.15.103:0/1656106235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1610003920 0x7f1610003d60 secure :-1 s=READY pgs=743 cs=0 l=1 rx=0x7f1624002460 tx=0x7f1624011600).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:09:20.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.489+0000 7f162f7fe700 1 --2- 172.21.15.103:0/1656106235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1610003920 0x7f1610003d60 secure :-1 s=THROTTLE_DONE pgs=743 cs=0 l=1 rx=0x7f1624002460 tx=0x7f1624011600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:09:20.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.489+0000 7f162d7fa700 1 -- 172.21.15.103:0/1656106235 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1624007db0 con 0x7f1610003920 2020-04-22T14:09:20.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.489+0000 7f162f7fe700 1 --2- 172.21.15.103:0/1656106235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1610003920 0x7f1610003d60 secure :-1 s=THROTTLE_DONE pgs=743 cs=0 l=1 rx=0x7f1624002460 tx=0x7f1624011600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:09:20.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.489+0000 7f162d7fa700 1 -- 172.21.15.103:0/1656106235 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16240056c0 con 0x7f1610003920 2020-04-22T14:09:20.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.489+0000 7f162f7fe700 1 --2- 172.21.15.103:0/1656106235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1610003920 0x7f1610003d60 secure :-1 s=THROTTLE_DONE pgs=743 cs=0 l=1 rx=0x7f1624002460 tx=0x7f1624011600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:09:20.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.489+0000 7f162d7fa700 1 -- 172.21.15.103:0/1656106235 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1624005a20 con 0x7f1610003920 2020-04-22T14:09:20.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.490+0000 7f162f7fe700 1 --2- 172.21.15.103:0/1656106235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1610003920 0x7f1610003d60 secure :-1 s=THROTTLE_DONE pgs=743 cs=0 l=1 rx=0x7f1624002460 tx=0x7f1624011600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:09:20.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.490+0000 7f16362a3700 1 -- 172.21.15.103:0/1656106235 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f160c003340 con 0x7f1610003920 2020-04-22T14:09:20.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.490+0000 7f162d7fa700 1 -- 172.21.15.103:0/1656106235 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f1624005b80 con 0x7f1610003920 2020-04-22T14:09:20.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.490+0000 7f162f7fe700 1 --2- 172.21.15.103:0/1656106235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1610003920 0x7f1610003d60 secure :-1 s=THROTTLE_DONE pgs=743 cs=0 l=1 rx=0x7f1624002460 tx=0x7f1624011600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:09:20.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.490+0000 7f162d7fa700 1 --2- 172.21.15.103:0/1656106235 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1610055ad0 0x7f1610057f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:09:20.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.490+0000 7f162d7fa700 1 -- 172.21.15.103:0/1656106235 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1624061a50 con 0x7f1610003920 2020-04-22T14:09:20.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.490+0000 7f162ffff700 1 --2- 172.21.15.103:0/1656106235 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1610055ad0 0x7f1610057f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:09:20.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.491+0000 7f162ffff700 1 --2- 172.21.15.103:0/1656106235 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1610055ad0 0x7f1610057f90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1620001f50 tx=0x7f162000ca80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:09:20.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.491+0000 7f162ffff700 1 --2- 172.21.15.103:0/1656106235 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1610055ad0 0x7f1610057f90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1620001f50 tx=0x7f162000ca80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:09:20.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.491+0000 7f162ffff700 1 --2- 172.21.15.103:0/1656106235 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1610055ad0 0x7f1610057f90 secure :-1 s=READY pgs=282 cs=0 l=1 rx=0x7f1620001f50 tx=0x7f162000ca80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:09:20.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.494+0000 7f162f7fe700 1 --2- 172.21.15.103:0/1656106235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1610003920 0x7f1610003d60 secure :-1 s=THROTTLE_DONE pgs=743 cs=0 l=1 rx=0x7f1624002460 tx=0x7f1624011600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:09:20.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.494+0000 7f162d7fa700 1 -- 172.21.15.103:0/1656106235 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f162403ce90 con 0x7f1610003920 2020-04-22T14:09:20.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.687+0000 7f16362a3700 1 -- 172.21.15.103:0/1656106235 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f160c0036e0 con 0x7f1610003920 2020-04-22T14:09:20.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.687+0000 7f162f7fe700 1 --2- 172.21.15.103:0/1656106235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1610003920 0x7f1610003d60 secure :-1 s=THROTTLE_DONE pgs=743 cs=0 l=1 rx=0x7f1624002460 tx=0x7f1624011600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:09:20.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.687+0000 7f162d7fa700 1 -- 172.21.15.103:0/1656106235 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f16240404b0 con 0x7f1610003920 2020-04-22T14:09:20.690 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:09:20.690 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":28,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4898,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/167651529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":167651529},{"type":"v1","addr":"172.21.15.86:6835","nonce":167651529}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:07:30.137341+0000","modified":"2020-04-22T14:07:32.145409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5890},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5890":{"gid":5890,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/494421372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":494421372},{"type":"v1","addr":"172.21.15.103:6833","nonce":494421372}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2020-04-22T14:09:20.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.688+0000 7f16362a3700 1 -- 172.21.15.103:0/1656106235 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1610055ad0 msgr2=0x7f1610057f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:09:20.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.688+0000 7f16362a3700 1 --2- 172.21.15.103:0/1656106235 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1610055ad0 0x7f1610057f90 secure :-1 s=READY pgs=282 cs=0 l=1 rx=0x7f1620001f50 tx=0x7f162000ca80).stop 2020-04-22T14:09:20.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.688+0000 7f16362a3700 1 -- 172.21.15.103:0/1656106235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1610003920 msgr2=0x7f1610003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:09:20.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.688+0000 7f16362a3700 1 --2- 172.21.15.103:0/1656106235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1610003920 0x7f1610003d60 secure :-1 s=READY pgs=743 cs=0 l=1 rx=0x7f1624002460 tx=0x7f1624011600).stop 2020-04-22T14:09:20.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.688+0000 7f1634840700 1 -- 172.21.15.103:0/1656106235 reap_dead start 2020-04-22T14:09:20.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.688+0000 7f1634840700 1 -- 172.21.15.103:0/1656106235 reap_dead start 2020-04-22T14:09:20.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.688+0000 7f16362a3700 1 -- 172.21.15.103:0/1656106235 shutdown_connections 2020-04-22T14:09:20.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.688+0000 7f16362a3700 1 -- 172.21.15.103:0/1656106235 >> 172.21.15.103:0/1656106235 conn(0x7f163005f2c0 msgr2=0x7f16300ac740 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:09:20.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.689+0000 7f16362a3700 1 -- 172.21.15.103:0/1656106235 shutdown_connections 2020-04-22T14:09:20.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:09:20.689+0000 7f16362a3700 1 -- 172.21.15.103:0/1656106235 wait complete. 2020-04-22T14:09:20.693 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 28 2020-04-22T14:09:20.701 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:09:20.714 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok session ls 2020-04-22T14:09:20.873 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2020-04-22T14:09:20.873 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:09:20.873 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 5826, 2020-04-22T14:09:20.873 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": { 2020-04-22T14:09:20.873 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:09:20.873 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:09:20.874 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5826 2020-04-22T14:09:20.874 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:09:20.874 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:09:20.874 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "any", 2020-04-22T14:09:20.874 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.2:0", 2020-04-22T14:09:20.874 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1402976942 2020-04-22T14:09:20.874 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:09:20.874 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:09:20.875 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "open", 2020-04-22T14:09:20.875 INFO:teuthology.orchestra.run.smithi103.stdout: "num_leases": 0, 2020-04-22T14:09:20.875 INFO:teuthology.orchestra.run.smithi103.stdout: "num_caps": 1, 2020-04-22T14:09:20.875 INFO:teuthology.orchestra.run.smithi103.stdout: "request_load_avg": 0, 2020-04-22T14:09:20.875 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 94.059177277000003, 2020-04-22T14:09:20.875 INFO:teuthology.orchestra.run.smithi103.stdout: "requests_in_flight": 0, 2020-04-22T14:09:20.875 INFO:teuthology.orchestra.run.smithi103.stdout: "completed_requests": 1, 2020-04-22T14:09:20.876 INFO:teuthology.orchestra.run.smithi103.stdout: "reconnecting": false, 2020-04-22T14:09:20.877 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps": { 2020-04-22T14:09:20.877 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:09:20.877 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 60 2020-04-22T14:09:20.877 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:09:20.877 INFO:teuthology.orchestra.run.smithi103.stdout: "release_caps": { 2020-04-22T14:09:20.877 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:09:20.878 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 60 2020-04-22T14:09:20.878 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:09:20.878 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps_throttle": { 2020-04-22T14:09:20.878 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:09:20.878 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 2.5 2020-04-22T14:09:20.878 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:09:20.879 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps_throttle2o": { 2020-04-22T14:09:20.879 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:09:20.879 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 0.5 2020-04-22T14:09:20.879 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:09:20.879 INFO:teuthology.orchestra.run.smithi103.stdout: "session_cache_liveness": { 2020-04-22T14:09:20.879 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0.8046757210000044, 2020-04-22T14:09:20.879 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 300 2020-04-22T14:09:20.880 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:09:20.880 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": "client.5826 192.168.0.2:0/1402976942", 2020-04-22T14:09:20.880 INFO:teuthology.orchestra.run.smithi103.stdout: "completed_requests": [ 2020-04-22T14:09:20.880 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:09:20.880 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2, 2020-04-22T14:09:20.880 INFO:teuthology.orchestra.run.smithi103.stdout: "created_ino": "0x0" 2020-04-22T14:09:20.881 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:09:20.886 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:09:20.886 INFO:teuthology.orchestra.run.smithi103.stdout: "prealloc_inos": [], 2020-04-22T14:09:20.886 INFO:teuthology.orchestra.run.smithi103.stdout: "used_inos": [], 2020-04-22T14:09:20.886 INFO:teuthology.orchestra.run.smithi103.stdout: "client_metadata": { 2020-04-22T14:09:20.887 INFO:teuthology.orchestra.run.smithi103.stdout: "client_features": { 2020-04-22T14:09:20.887 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_bits": "0x0000000000003fff" 2020-04-22T14:09:20.888 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:09:20.888 INFO:teuthology.orchestra.run.smithi103.stdout: "metric_spec": { 2020-04-22T14:09:20.888 INFO:teuthology.orchestra.run.smithi103.stdout: "metric_flags": { 2020-04-22T14:09:20.888 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_bits": "0x" 2020-04-22T14:09:20.888 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:09:20.888 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:09:20.888 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:09:20.889 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:09:20.889 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "1", 2020-04-22T14:09:20.889 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:09:20.889 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2020-04-22T14:09:20.889 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "61519", 2020-04-22T14:09:20.889 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:09:20.889 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:09:20.890 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:09:20.890 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:09:20.890 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 6103, 2020-04-22T14:09:20.890 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": { 2020-04-22T14:09:20.891 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:09:20.891 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:09:20.891 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 6103 2020-04-22T14:09:20.891 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:09:20.891 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:09:20.891 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "any", 2020-04-22T14:09:20.891 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:09:20.892 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 322128533 2020-04-22T14:09:20.892 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:09:20.892 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:09:20.892 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "open", 2020-04-22T14:09:20.892 INFO:teuthology.orchestra.run.smithi103.stdout: "num_leases": 0, 2020-04-22T14:09:20.892 INFO:teuthology.orchestra.run.smithi103.stdout: "num_caps": 1, 2020-04-22T14:09:20.892 INFO:teuthology.orchestra.run.smithi103.stdout: "request_load_avg": 0, 2020-04-22T14:09:20.893 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 99.664069909999995, 2020-04-22T14:09:20.893 INFO:teuthology.orchestra.run.smithi103.stdout: "requests_in_flight": 0, 2020-04-22T14:09:20.893 INFO:teuthology.orchestra.run.smithi103.stdout: "completed_requests": 1, 2020-04-22T14:09:20.893 INFO:teuthology.orchestra.run.smithi103.stdout: "reconnecting": false, 2020-04-22T14:09:20.893 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps": { 2020-04-22T14:09:20.894 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:09:20.894 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 60 2020-04-22T14:09:20.894 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:09:20.894 INFO:teuthology.orchestra.run.smithi103.stdout: "release_caps": { 2020-04-22T14:09:20.894 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:09:20.894 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 60 2020-04-22T14:09:20.894 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:09:20.895 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps_throttle": { 2020-04-22T14:09:20.895 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:09:20.895 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 2.5 2020-04-22T14:09:20.895 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:09:20.895 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps_throttle2o": { 2020-04-22T14:09:20.895 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:09:20.895 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 0.5 2020-04-22T14:09:20.896 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:09:20.896 INFO:teuthology.orchestra.run.smithi103.stdout: "session_cache_liveness": { 2020-04-22T14:09:20.896 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0.79432047681222862, 2020-04-22T14:09:20.896 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 300 2020-04-22T14:09:20.896 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:09:20.896 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": "client.6103 192.168.0.1:0/322128533", 2020-04-22T14:09:20.896 INFO:teuthology.orchestra.run.smithi103.stdout: "completed_requests": [ 2020-04-22T14:09:20.896 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:09:20.897 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2, 2020-04-22T14:09:20.897 INFO:teuthology.orchestra.run.smithi103.stdout: "created_ino": "0x0" 2020-04-22T14:09:20.897 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:09:20.897 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:09:20.897 INFO:teuthology.orchestra.run.smithi103.stdout: "prealloc_inos": [], 2020-04-22T14:09:20.897 INFO:teuthology.orchestra.run.smithi103.stdout: "used_inos": [], 2020-04-22T14:09:20.897 INFO:teuthology.orchestra.run.smithi103.stdout: "client_metadata": { 2020-04-22T14:09:20.899 INFO:teuthology.orchestra.run.smithi103.stdout: "client_features": { 2020-04-22T14:09:20.913 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_bits": "0x0000000000003fff" 2020-04-22T14:09:20.913 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:09:20.913 INFO:teuthology.orchestra.run.smithi103.stdout: "metric_spec": { 2020-04-22T14:09:20.916 INFO:teuthology.orchestra.run.smithi103.stdout: "metric_flags": { 2020-04-22T14:09:20.916 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_bits": "0x" 2020-04-22T14:09:20.917 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:09:20.917 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:09:20.917 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:09:20.918 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:09:20.918 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "0", 2020-04-22T14:09:20.918 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:09:20.918 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-04-22T14:09:20.918 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "60261", 2020-04-22T14:09:20.918 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/", 2020-04-22T14:09:20.919 INFO:teuthology.orchestra.run.smithi103.stdout: "timeout": "120" 2020-04-22T14:09:20.919 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:09:20.919 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:09:20.920 INFO:teuthology.orchestra.run.smithi103.stdout:] 2020-04-22T14:09:20.922 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "id": 5826, "entity": { "name": { "type": "client", "num": 5826 }, "addr": { "type": "any", "addr": "192.168.0.2:0", "nonce": 1402976942 } }, "state": "open", "num_leases": 0, "num_caps": 1, "request_load_avg": 0, "uptime": 94.059177277000003, "requests_in_flight": 0, "completed_requests": 1, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0.8046757210000044, "halflife": 300 }, "inst": "client.5826 192.168.0.2:0/1402976942", "completed_requests": [ { "tid": 2, "created_ino": "0x0" } ], "prealloc_inos": [], "used_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x0000000000003fff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x" } }, "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", "entity_id": "1", "hostname": "smithi103", "mount_point": "/home/ubuntu/cephtest/mnt.1", "pid": "61519", "root": "/" } }, { "id": 6103, "entity": { "name": { "type": "client", "num": 6103 }, "addr": { "type": "any", "addr": "192.168.0.1:0", "nonce": 322128533 } }, "state": "open", "num_leases": 0, "num_caps": 1, "request_load_avg": 0, "uptime": 99.664069909999995, "requests_in_flight": 0, "completed_requests": 1, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0.79432047681222862, "halflife": 300 }, "inst": "client.6103 192.168.0.1:0/322128533", "completed_requests": [ { "tid": 2, "created_ino": "0x0" } ], "prealloc_inos": [], "used_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x0000000000003fff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x" } }, "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", "entity_id": "0", "hostname": "smithi103", "mount_point": "/home/ubuntu/cephtest/mnt.0", "pid": "60261", "root": "/", "timeout": "120" } } ] 2020-04-22T14:09:21.171 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:09:21.190 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:09:21.233 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:09:21.249 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:09:51.414 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:09:51.430 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:09:51.473 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:09:51.490 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:10:20.923 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:20.940 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:10:21.099 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.097+0000 7fd25ad82700 1 Processor -- start 2020-04-22T14:10:21.099 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.097+0000 7fd25ad82700 1 -- start start 2020-04-22T14:10:21.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.098+0000 7fd25ad82700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd25412c0d0 0x7fd2541464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:21.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.098+0000 7fd25ad82700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd254065fe0 0x7fd25405b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:21.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.098+0000 7fd25ad82700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd25405b8a0 0x7fd254062ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:21.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.098+0000 7fd25ad82700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd25412c4b0 con 0x7fd25405b8a0 2020-04-22T14:10:21.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.098+0000 7fd25ad82700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd254143300 con 0x7fd254065fe0 2020-04-22T14:10:21.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.098+0000 7fd25ad82700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2541435a0 con 0x7fd25412c0d0 2020-04-22T14:10:21.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.098+0000 7fd253fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd254065fe0 0x7fd25405b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:21.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.098+0000 7fd253fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd254065fe0 0x7fd25405b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50856/0 (socket says 172.21.15.103:50856) 2020-04-22T14:10:21.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.098+0000 7fd253fff700 1 -- 172.21.15.103:0/3584534662 learned_addr learned my addr 172.21.15.103:0/3584534662 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:10:21.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.098+0000 7fd25931f700 1 --2- 172.21.15.103:0/3584534662 >> v2:172.21.15.86:3300/0 conn(0x7fd25405b8a0 0x7fd254062ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:21.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.098+0000 7fd258b1e700 1 --2- 172.21.15.103:0/3584534662 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd25412c0d0 0x7fd2541464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:21.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.098+0000 7fd253fff700 1 -- 172.21.15.103:0/3584534662 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd25412c0d0 msgr2=0x7fd2541464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:21.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.098+0000 7fd253fff700 1 --2- 172.21.15.103:0/3584534662 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd25412c0d0 0x7fd2541464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:21.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.098+0000 7fd253fff700 1 -- 172.21.15.103:0/3584534662 >> v2:172.21.15.86:3300/0 conn(0x7fd25405b8a0 msgr2=0x7fd254062ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:21.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.098+0000 7fd253fff700 1 --2- 172.21.15.103:0/3584534662 >> v2:172.21.15.86:3300/0 conn(0x7fd25405b8a0 0x7fd254062ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:21.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.098+0000 7fd253fff700 1 -- 172.21.15.103:0/3584534662 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd254143840 con 0x7fd254065fe0 2020-04-22T14:10:21.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.098+0000 7fd253fff700 1 --2- 172.21.15.103:0/3584534662 >> v2:172.21.15.103:3300/0 conn(0x7fd254065fe0 0x7fd25405b440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd248002f30 tx=0x7fd248007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:21.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.098+0000 7fd253fff700 1 --2- 172.21.15.103:0/3584534662 >> v2:172.21.15.103:3300/0 conn(0x7fd254065fe0 0x7fd25405b440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd248002f30 tx=0x7fd248007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:21.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.098+0000 7fd253fff700 1 --2- 172.21.15.103:0/3584534662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd254065fe0 0x7fd25405b440 secure :-1 s=READY pgs=744 cs=0 l=1 rx=0x7fd248002f30 tx=0x7fd248007a40).ready entity=mon.1 client_cookie=eb85b5b000a35899 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:21.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.099+0000 7fd253fff700 1 --2- 172.21.15.103:0/3584534662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd254065fe0 0x7fd25405b440 secure :-1 s=THROTTLE_DONE pgs=744 cs=0 l=1 rx=0x7fd248002f30 tx=0x7fd248007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:21.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.099+0000 7fd2537fe700 1 -- 172.21.15.103:0/3584534662 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd248013cc0 con 0x7fd254065fe0 2020-04-22T14:10:21.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.099+0000 7fd253fff700 1 --2- 172.21.15.103:0/3584534662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd254065fe0 0x7fd25405b440 secure :-1 s=THROTTLE_DONE pgs=744 cs=0 l=1 rx=0x7fd248002f30 tx=0x7fd248007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:21.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.099+0000 7fd253fff700 1 --2- 172.21.15.103:0/3584534662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd254065fe0 0x7fd25405b440 secure :-1 s=THROTTLE_DONE pgs=744 cs=0 l=1 rx=0x7fd248002f30 tx=0x7fd248007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:21.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.099+0000 7fd2537fe700 1 -- 172.21.15.103:0/3584534662 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd248013e20 con 0x7fd254065fe0 2020-04-22T14:10:21.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.099+0000 7fd2537fe700 1 -- 172.21.15.103:0/3584534662 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd24800c370 con 0x7fd254065fe0 2020-04-22T14:10:21.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.099+0000 7fd25ad82700 1 -- 172.21.15.103:0/3584534662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd254065fe0 msgr2=0x7fd25405b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:21.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.099+0000 7fd25ad82700 1 --2- 172.21.15.103:0/3584534662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd254065fe0 0x7fd25405b440 secure :-1 s=READY pgs=744 cs=0 l=1 rx=0x7fd248002f30 tx=0x7fd248007a40).stop 2020-04-22T14:10:21.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.099+0000 7fd25ad82700 1 -- 172.21.15.103:0/3584534662 shutdown_connections 2020-04-22T14:10:21.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.099+0000 7fd25ad82700 1 --2- 172.21.15.103:0/3584534662 >> v2:172.21.15.86:3300/0 conn(0x7fd25405b8a0 0x7fd254062ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:21.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.099+0000 7fd25ad82700 1 --2- 172.21.15.103:0/3584534662 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd25412c0d0 0x7fd2541464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:21.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.099+0000 7fd25ad82700 1 --2- 172.21.15.103:0/3584534662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd254065fe0 0x7fd25405b440 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:21.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.099+0000 7fd25ad82700 1 -- 172.21.15.103:0/3584534662 >> 172.21.15.103:0/3584534662 conn(0x7fd2540b9160 msgr2=0x7fd25405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:21.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.099+0000 7fd25ad82700 1 -- 172.21.15.103:0/3584534662 shutdown_connections 2020-04-22T14:10:21.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.099+0000 7fd25ad82700 1 -- 172.21.15.103:0/3584534662 wait complete. 2020-04-22T14:10:21.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.100+0000 7fd25ad82700 1 Processor -- start 2020-04-22T14:10:21.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.100+0000 7fd25ad82700 1 -- start start 2020-04-22T14:10:21.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.101+0000 7fd25ad82700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd254065fe0 0x7fd25414f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:21.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.101+0000 7fd25ad82700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd25412c0d0 0x7fd2541416f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:21.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.101+0000 7fd25ad82700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd25413fcd0 con 0x7fd25405b8a0 2020-04-22T14:10:21.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.101+0000 7fd25ad82700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2540aea10 con 0x7fd25412c0d0 2020-04-22T14:10:21.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.101+0000 7fd25ad82700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd25413ff00 con 0x7fd254065fe0 2020-04-22T14:10:21.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.101+0000 7fd25931f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd25412c0d0 0x7fd2541416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:21.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.101+0000 7fd25931f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd25412c0d0 0x7fd2541416f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50864/0 (socket says 172.21.15.103:50864) 2020-04-22T14:10:21.117 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.101+0000 7fd25931f700 1 -- 172.21.15.103:0/1334231632 learned_addr learned my addr 172.21.15.103:0/1334231632 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:10:21.117 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.101+0000 7fd253fff700 1 --2- 172.21.15.103:0/1334231632 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd254065fe0 0x7fd25414f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:21.117 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.101+0000 7fd25931f700 1 -- 172.21.15.103:0/1334231632 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd254065fe0 msgr2=0x7fd25414f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:21.117 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.101+0000 7fd25931f700 1 --2- 172.21.15.103:0/1334231632 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd254065fe0 0x7fd25414f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:21.117 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.101+0000 7fd25931f700 1 -- 172.21.15.103:0/1334231632 >> v1:172.21.15.86:6789/0 conn(0x7fd25405b8a0 legacy=0x7fd2540b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:21.117 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.101+0000 7fd25931f700 1 -- 172.21.15.103:0/1334231632 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd254142240 con 0x7fd25412c0d0 2020-04-22T14:10:21.117 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.102+0000 7fd25931f700 1 --2- 172.21.15.103:0/1334231632 >> v2:172.21.15.103:3300/0 conn(0x7fd25412c0d0 0x7fd2541416f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd25414fd00 tx=0x7fd24c011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:21.118 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.102+0000 7fd25931f700 1 --2- 172.21.15.103:0/1334231632 >> v2:172.21.15.103:3300/0 conn(0x7fd25412c0d0 0x7fd2541416f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd25414fd00 tx=0x7fd24c011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:21.118 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.102+0000 7fd25931f700 1 --2- 172.21.15.103:0/1334231632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd25412c0d0 0x7fd2541416f0 secure :-1 s=READY pgs=745 cs=0 l=1 rx=0x7fd25414fd00 tx=0x7fd24c011060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:21.118 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.102+0000 7fd25931f700 1 --2- 172.21.15.103:0/1334231632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd25412c0d0 0x7fd2541416f0 secure :-1 s=THROTTLE_DONE pgs=745 cs=0 l=1 rx=0x7fd25414fd00 tx=0x7fd24c011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:21.118 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.102+0000 7fd251ffb700 1 -- 172.21.15.103:0/1334231632 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd24c005e30 con 0x7fd25412c0d0 2020-04-22T14:10:21.118 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.102+0000 7fd25931f700 1 --2- 172.21.15.103:0/1334231632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd25412c0d0 0x7fd2541416f0 secure :-1 s=THROTTLE_DONE pgs=745 cs=0 l=1 rx=0x7fd25414fd00 tx=0x7fd24c011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:21.118 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.102+0000 7fd25931f700 1 --2- 172.21.15.103:0/1334231632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd25412c0d0 0x7fd2541416f0 secure :-1 s=THROTTLE_DONE pgs=745 cs=0 l=1 rx=0x7fd25414fd00 tx=0x7fd24c011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:21.118 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.102+0000 7fd251ffb700 1 -- 172.21.15.103:0/1334231632 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd24c007560 con 0x7fd25412c0d0 2020-04-22T14:10:21.118 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.102+0000 7fd25ad82700 1 -- 172.21.15.103:0/1334231632 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2540b7e30 con 0x7fd25412c0d0 2020-04-22T14:10:21.119 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.102+0000 7fd251ffb700 1 -- 172.21.15.103:0/1334231632 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd24c0126c0 con 0x7fd25412c0d0 2020-04-22T14:10:21.119 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.102+0000 7fd25ad82700 1 -- 172.21.15.103:0/1334231632 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd254129c00 con 0x7fd25412c0d0 2020-04-22T14:10:21.119 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.102+0000 7fd25931f700 1 --2- 172.21.15.103:0/1334231632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd25412c0d0 0x7fd2541416f0 secure :-1 s=THROTTLE_DONE pgs=745 cs=0 l=1 rx=0x7fd25414fd00 tx=0x7fd24c011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:21.119 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.103+0000 7fd25ad82700 1 -- 172.21.15.103:0/1334231632 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2540aec10 con 0x7fd25412c0d0 2020-04-22T14:10:21.119 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.103+0000 7fd251ffb700 1 -- 172.21.15.103:0/1334231632 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fd24c00e1a0 con 0x7fd25412c0d0 2020-04-22T14:10:21.119 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.103+0000 7fd25931f700 1 --2- 172.21.15.103:0/1334231632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd25412c0d0 0x7fd2541416f0 secure :-1 s=THROTTLE_DONE pgs=745 cs=0 l=1 rx=0x7fd25414fd00 tx=0x7fd24c011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:21.119 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.103+0000 7fd251ffb700 1 --2- 172.21.15.103:0/1334231632 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd23404daa0 0x7fd23404ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:21.120 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.103+0000 7fd251ffb700 1 -- 172.21.15.103:0/1334231632 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fd24c061410 con 0x7fd25412c0d0 2020-04-22T14:10:21.120 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.103+0000 7fd258b1e700 1 --2- 172.21.15.103:0/1334231632 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd23404daa0 0x7fd23404ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:21.120 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.103+0000 7fd258b1e700 1 --2- 172.21.15.103:0/1334231632 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd23404daa0 0x7fd23404ff60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd244002f30 tx=0x7fd24400c670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:21.120 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.104+0000 7fd258b1e700 1 --2- 172.21.15.103:0/1334231632 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd23404daa0 0x7fd23404ff60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd244002f30 tx=0x7fd24400c670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:21.120 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.104+0000 7fd258b1e700 1 --2- 172.21.15.103:0/1334231632 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd23404daa0 0x7fd23404ff60 secure :-1 s=READY pgs=283 cs=0 l=1 rx=0x7fd244002f30 tx=0x7fd24400c670).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:21.120 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.108+0000 7fd25931f700 1 --2- 172.21.15.103:0/1334231632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd25412c0d0 0x7fd2541416f0 secure :-1 s=THROTTLE_DONE pgs=745 cs=0 l=1 rx=0x7fd25414fd00 tx=0x7fd24c011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:21.120 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.108+0000 7fd251ffb700 1 -- 172.21.15.103:0/1334231632 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fd24c03c7f0 con 0x7fd25412c0d0 2020-04-22T14:10:21.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.298+0000 7fd25ad82700 1 -- 172.21.15.103:0/1334231632 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd254056c90 con 0x7fd25412c0d0 2020-04-22T14:10:21.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.298+0000 7fd25931f700 1 --2- 172.21.15.103:0/1334231632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd25412c0d0 0x7fd2541416f0 secure :-1 s=THROTTLE_DONE pgs=745 cs=0 l=1 rx=0x7fd25414fd00 tx=0x7fd24c011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:21.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.298+0000 7fd251ffb700 1 -- 172.21.15.103:0/1334231632 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+2136 (secure 0 0 0) 0x7fd24c03fe10 con 0x7fd25412c0d0 2020-04-22T14:10:21.301 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:10:21.301 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":28,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4898,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/167651529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":167651529},{"type":"v1","addr":"172.21.15.86:6835","nonce":167651529}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:07:30.137341+0000","modified":"2020-04-22T14:07:32.145409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5890},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5890":{"gid":5890,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/494421372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":494421372},{"type":"v1","addr":"172.21.15.103:6833","nonce":494421372}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2020-04-22T14:10:21.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.300+0000 7fd25ad82700 1 -- 172.21.15.103:0/1334231632 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd23404daa0 msgr2=0x7fd23404ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:21.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.300+0000 7fd25ad82700 1 --2- 172.21.15.103:0/1334231632 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd23404daa0 0x7fd23404ff60 secure :-1 s=READY pgs=283 cs=0 l=1 rx=0x7fd244002f30 tx=0x7fd24400c670).stop 2020-04-22T14:10:21.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.300+0000 7fd25ad82700 1 -- 172.21.15.103:0/1334231632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd25412c0d0 msgr2=0x7fd2541416f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:21.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.300+0000 7fd25ad82700 1 --2- 172.21.15.103:0/1334231632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd25412c0d0 0x7fd2541416f0 secure :-1 s=READY pgs=745 cs=0 l=1 rx=0x7fd25414fd00 tx=0x7fd24c011060).stop 2020-04-22T14:10:21.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.300+0000 7fd25ad82700 1 -- 172.21.15.103:0/1334231632 shutdown_connections 2020-04-22T14:10:21.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.300+0000 7fd25ad82700 1 --2- 172.21.15.103:0/1334231632 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd23404daa0 0x7fd23404ff60 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:21.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.300+0000 7fd25ad82700 1 --2- 172.21.15.103:0/1334231632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd25412c0d0 0x7fd2541416f0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:21.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.300+0000 7fd25ad82700 1 --2- 172.21.15.103:0/1334231632 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd254065fe0 0x7fd25414f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:21.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.300+0000 7fd25ad82700 1 -- 172.21.15.103:0/1334231632 >> 172.21.15.103:0/1334231632 conn(0x7fd2540b9160 msgr2=0x7fd2540b4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:21.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.300+0000 7fd25ad82700 1 -- 172.21.15.103:0/1334231632 shutdown_connections 2020-04-22T14:10:21.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:21.300+0000 7fd25ad82700 1 -- 172.21.15.103:0/1334231632 wait complete. 2020-04-22T14:10:21.304 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 28 2020-04-22T14:10:21.312 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:21.325 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok session ls 2020-04-22T14:10:21.484 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2020-04-22T14:10:21.484 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:21.484 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 5826, 2020-04-22T14:10:21.484 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": { 2020-04-22T14:10:21.484 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:10:21.485 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:10:21.485 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5826 2020-04-22T14:10:21.485 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:21.485 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:10:21.485 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "any", 2020-04-22T14:10:21.485 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.2:0", 2020-04-22T14:10:21.485 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1402976942 2020-04-22T14:10:21.486 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:21.486 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:21.486 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "open", 2020-04-22T14:10:21.486 INFO:teuthology.orchestra.run.smithi103.stdout: "num_leases": 0, 2020-04-22T14:10:21.486 INFO:teuthology.orchestra.run.smithi103.stdout: "num_caps": 1, 2020-04-22T14:10:21.486 INFO:teuthology.orchestra.run.smithi103.stdout: "request_load_avg": 0, 2020-04-22T14:10:21.486 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 154.66999813300001, 2020-04-22T14:10:21.487 INFO:teuthology.orchestra.run.smithi103.stdout: "requests_in_flight": 0, 2020-04-22T14:10:21.487 INFO:teuthology.orchestra.run.smithi103.stdout: "completed_requests": 1, 2020-04-22T14:10:21.487 INFO:teuthology.orchestra.run.smithi103.stdout: "reconnecting": false, 2020-04-22T14:10:21.487 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps": { 2020-04-22T14:10:21.487 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:10:21.487 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 60 2020-04-22T14:10:21.487 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:21.488 INFO:teuthology.orchestra.run.smithi103.stdout: "release_caps": { 2020-04-22T14:10:21.488 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:10:21.488 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 60 2020-04-22T14:10:21.488 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:21.488 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps_throttle": { 2020-04-22T14:10:21.488 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:10:21.488 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 2.5 2020-04-22T14:10:21.489 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:21.489 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps_throttle2o": { 2020-04-22T14:10:21.489 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:10:21.489 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 0.5 2020-04-22T14:10:21.489 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:21.489 INFO:teuthology.orchestra.run.smithi103.stdout: "session_cache_liveness": { 2020-04-22T14:10:21.489 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0.69952297135540076, 2020-04-22T14:10:21.489 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 300 2020-04-22T14:10:21.490 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:21.490 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": "client.5826 192.168.0.2:0/1402976942", 2020-04-22T14:10:21.490 INFO:teuthology.orchestra.run.smithi103.stdout: "completed_requests": [ 2020-04-22T14:10:21.490 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:21.490 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2, 2020-04-22T14:10:21.490 INFO:teuthology.orchestra.run.smithi103.stdout: "created_ino": "0x0" 2020-04-22T14:10:21.490 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:21.491 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:10:21.491 INFO:teuthology.orchestra.run.smithi103.stdout: "prealloc_inos": [], 2020-04-22T14:10:21.491 INFO:teuthology.orchestra.run.smithi103.stdout: "used_inos": [], 2020-04-22T14:10:21.491 INFO:teuthology.orchestra.run.smithi103.stdout: "client_metadata": { 2020-04-22T14:10:21.491 INFO:teuthology.orchestra.run.smithi103.stdout: "client_features": { 2020-04-22T14:10:21.491 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_bits": "0x0000000000003fff" 2020-04-22T14:10:21.491 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:21.492 INFO:teuthology.orchestra.run.smithi103.stdout: "metric_spec": { 2020-04-22T14:10:21.492 INFO:teuthology.orchestra.run.smithi103.stdout: "metric_flags": { 2020-04-22T14:10:21.492 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_bits": "0x" 2020-04-22T14:10:21.492 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:21.492 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:21.492 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:10:21.492 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:10:21.493 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "1", 2020-04-22T14:10:21.493 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:10:21.493 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2020-04-22T14:10:21.493 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "61519", 2020-04-22T14:10:21.493 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:10:21.493 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:21.493 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:21.493 INFO:teuthology.orchestra.run.smithi103.stdout:] 2020-04-22T14:10:21.494 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "id": 5826, "entity": { "name": { "type": "client", "num": 5826 }, "addr": { "type": "any", "addr": "192.168.0.2:0", "nonce": 1402976942 } }, "state": "open", "num_leases": 0, "num_caps": 1, "request_load_avg": 0, "uptime": 154.66999813300001, "requests_in_flight": 0, "completed_requests": 1, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0.69952297135540076, "halflife": 300 }, "inst": "client.5826 192.168.0.2:0/1402976942", "completed_requests": [ { "tid": 2, "created_ino": "0x0" } ], "prealloc_inos": [], "used_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x0000000000003fff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x" } }, "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", "entity_id": "1", "hostname": "smithi103", "mount_point": "/home/ubuntu/cephtest/mnt.1", "pid": "61519", "root": "/" } } ] 2020-04-22T14:10:21.495 INFO:tasks.cephfs.mount:Cleaning up killed connection on ubuntu@smithi103.front.sepia.ceph.com 2020-04-22T14:10:21.495 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2020-04-22T14:10:21.495 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:21.509 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-04-22T14:10:21.509 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:10:21.617 INFO:teuthology.orchestra.run:waiting for 900 2020-04-22T14:10:21.617 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:10:21.617 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:10:21.617 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:21.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:21.641 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:10:21.644 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:10:21.661 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:10:21.705 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:21.721 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:21.767 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:10:21.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:21.769 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down brx.0' 2020-04-22T14:10:21.935 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.0' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/18) 2020-04-22T14:10:21.936 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:21.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:21.978 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete brx.0' 2020-04-22T14:10:22.095 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.0' (5271b6f3-e2f5-4031-bb7f-6d4a01ed71b8) successfully deleted. 2020-04-22T14:10:22.096 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:22.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:22.118 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:10:22.225 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:22.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:22.250 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:10:22.308 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:10:22.308 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:10:22.309 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:10:22.309 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:22.309 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:10:22.309 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:22.309 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:10:22.309 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:10:22.310 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:10:22.310 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:10:22.310 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:10:22.310 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:10:22.310 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:10:22.310 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:10:22.310 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:10:22.310 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42218sec preferred_lft 42218sec 2020-04-22T14:10:22.311 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:10:22.311 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:22.311 INFO:teuthology.orchestra.run.smithi103.stdout:16: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:10:22.311 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 86:6a:e2:0f:ca:92 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:10:22.311 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:10:22.311 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:22.311 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::4c33:3a93:86a3:5735/64 scope link noprefixroute 2020-04-22T14:10:22.312 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:22.312 INFO:teuthology.orchestra.run.smithi103.stdout:17: brx.0@if2: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:10:22.312 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 7e:d2:ee:04:ad:7f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:10:22.312 INFO:teuthology.orchestra.run.smithi103.stdout:18: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-04-22T14:10:22.312 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 86:6a:e2:0f:ca:92 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2020-04-22T14:10:22.312 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:22.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:22.357 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:10:22.434 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:22.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:22.484 INFO:teuthology.orchestra.run.smithi103:> nmcli connection show 2020-04-22T14:10:22.560 INFO:teuthology.orchestra.run.smithi103.stdout:NAME UUID TYPE DEVICE 2020-04-22T14:10:22.561 INFO:teuthology.orchestra.run.smithi103.stdout:System enp3s0f1 b0a308d1-bd90-60af-eb7c-0183bb425a1a ethernet enp3s0f1 2020-04-22T14:10:22.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-brx 70feb78c-df29-4653-99f5-41d7cd765c0f bridge ceph-brx 2020-04-22T14:10:22.561 INFO:teuthology.orchestra.run.smithi103.stdout:brx.1 3bf11b3f-4c36-49c5-a8ec-05519a9cafbb ethernet brx.1 2020-04-22T14:10:22.561 INFO:teuthology.orchestra.run.smithi103.stdout:eno1 206ad60d-195e-4d4b-a9fe-a5dd1f33a67d ethernet -- 2020-04-22T14:10:22.561 INFO:teuthology.orchestra.run.smithi103.stdout:eno2 894a7dd2-d329-4985-9ef9-84a92c6e1c6c ethernet -- 2020-04-22T14:10:22.561 INFO:teuthology.orchestra.run.smithi103.stdout:enp3s0f0 5a3237ce-06ab-4ae0-818b-45bdf036cb08 ethernet -- 2020-04-22T14:10:22.562 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:22.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:22.607 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:10:22.666 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:22.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:22.715 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:10:22.770 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-04-22T14:10:22.774 INFO:teuthology.orchestra.run.smithi103.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2020-04-22T14:10:22.775 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-04-22T14:10:22.775 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:10:22.792 INFO:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:10:22.884 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:22.898 INFO:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:10:22.982 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-04-22T14:10:22.982 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:10:22.982 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:22.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:22.996 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:10:23.054 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:10:23.054 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:10:23.054 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:10:23.055 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:23.055 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:10:23.055 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:23.055 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:10:23.055 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:10:23.055 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:10:23.055 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:10:23.056 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:10:23.056 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:10:23.056 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:10:23.056 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:10:23.056 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:10:23.057 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42217sec preferred_lft 42217sec 2020-04-22T14:10:23.057 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:10:23.057 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:23.057 INFO:teuthology.orchestra.run.smithi103.stdout:16: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:10:23.057 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 86:6a:e2:0f:ca:92 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:10:23.057 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:10:23.057 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:23.058 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::4c33:3a93:86a3:5735/64 scope link noprefixroute 2020-04-22T14:10:23.058 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:23.058 INFO:teuthology.orchestra.run.smithi103.stdout:17: brx.0@if2: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:10:23.058 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 7e:d2:ee:04:ad:7f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:10:23.058 INFO:teuthology.orchestra.run.smithi103.stdout:18: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-04-22T14:10:23.058 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 86:6a:e2:0f:ca:92 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2020-04-22T14:10:23.059 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:23.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:23.166 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:10:23.201 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:23.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:23.252 INFO:teuthology.orchestra.run.smithi103:> nmcli connection show 2020-04-22T14:10:23.327 INFO:teuthology.orchestra.run.smithi103.stdout:NAME UUID TYPE DEVICE 2020-04-22T14:10:23.328 INFO:teuthology.orchestra.run.smithi103.stdout:System enp3s0f1 b0a308d1-bd90-60af-eb7c-0183bb425a1a ethernet enp3s0f1 2020-04-22T14:10:23.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-brx 70feb78c-df29-4653-99f5-41d7cd765c0f bridge ceph-brx 2020-04-22T14:10:23.328 INFO:teuthology.orchestra.run.smithi103.stdout:brx.1 3bf11b3f-4c36-49c5-a8ec-05519a9cafbb ethernet brx.1 2020-04-22T14:10:23.328 INFO:teuthology.orchestra.run.smithi103.stdout:eno1 206ad60d-195e-4d4b-a9fe-a5dd1f33a67d ethernet -- 2020-04-22T14:10:23.328 INFO:teuthology.orchestra.run.smithi103.stdout:eno2 894a7dd2-d329-4985-9ef9-84a92c6e1c6c ethernet -- 2020-04-22T14:10:23.328 INFO:teuthology.orchestra.run.smithi103.stdout:enp3s0f0 5a3237ce-06ab-4ae0-818b-45bdf036cb08 ethernet -- 2020-04-22T14:10:23.329 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:23.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:23.374 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:10:23.433 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2020-04-22T14:10:23.433 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:23.483 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-04-22T14:10:23.483 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:10:23.560 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[61519]: fuse finished with error 0 and tester_r 0 2020-04-22T14:10:23.699 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-04-22T14:10:23.700 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:10:23.700 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:23.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:23.754 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:10:23.830 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:23.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:23.880 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down brx.1' 2020-04-22T14:10:23.991 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.1' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/19) 2020-04-22T14:10:23.992 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:24.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:24.008 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete brx.1' 2020-04-22T14:10:24.119 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.1' (3bf11b3f-4c36-49c5-a8ec-05519a9cafbb) successfully deleted. 2020-04-22T14:10:24.119 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:24.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:24.148 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:10:24.256 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:24.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:24.281 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:10:24.340 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:10:24.340 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:10:24.340 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:10:24.340 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:24.340 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:10:24.341 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:24.341 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:10:24.341 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:10:24.341 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:10:24.341 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:10:24.341 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:10:24.341 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:10:24.342 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:10:24.342 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:10:24.342 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:10:24.342 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42216sec preferred_lft 42216sec 2020-04-22T14:10:24.342 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:10:24.342 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:24.342 INFO:teuthology.orchestra.run.smithi103.stdout:16: ceph-brx: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:10:24.343 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:10:24.343 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:10:24.343 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:24.343 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::4c33:3a93:86a3:5735/64 scope link noprefixroute 2020-04-22T14:10:24.343 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:24.343 INFO:teuthology.orchestra.run.smithi103.stdout:17: brx.0@if2: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:10:24.343 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 7e:d2:ee:04:ad:7f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:10:24.343 INFO:teuthology.orchestra.run.smithi103.stdout:18: brx.1@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:10:24.344 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 86:6a:e2:0f:ca:92 brd ff:ff:ff:ff:ff:ff link-netnsid 1 2020-04-22T14:10:24.344 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:24.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:24.388 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:10:24.463 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:24.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:24.514 INFO:teuthology.orchestra.run.smithi103:> nmcli connection show 2020-04-22T14:10:24.590 INFO:teuthology.orchestra.run.smithi103.stdout:NAME UUID TYPE DEVICE 2020-04-22T14:10:24.590 INFO:teuthology.orchestra.run.smithi103.stdout:System enp3s0f1 b0a308d1-bd90-60af-eb7c-0183bb425a1a ethernet enp3s0f1 2020-04-22T14:10:24.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-brx 70feb78c-df29-4653-99f5-41d7cd765c0f bridge ceph-brx 2020-04-22T14:10:24.590 INFO:teuthology.orchestra.run.smithi103.stdout:eno1 206ad60d-195e-4d4b-a9fe-a5dd1f33a67d ethernet -- 2020-04-22T14:10:24.591 INFO:teuthology.orchestra.run.smithi103.stdout:eno2 894a7dd2-d329-4985-9ef9-84a92c6e1c6c ethernet -- 2020-04-22T14:10:24.591 INFO:teuthology.orchestra.run.smithi103.stdout:enp3s0f0 5a3237ce-06ab-4ae0-818b-45bdf036cb08 ethernet -- 2020-04-22T14:10:24.591 INFO:tasks.cephfs.mount:Removing the 'ceph-brx' 2020-04-22T14:10:24.591 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:24.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:24.637 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down ceph-brx' 2020-04-22T14:10:24.800 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/17) 2020-04-22T14:10:24.801 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:24.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:24.815 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete ceph-brx' 2020-04-22T14:10:24.937 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' (70feb78c-df29-4653-99f5-41d7cd765c0f) successfully deleted. 2020-04-22T14:10:24.938 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:24.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:24.954 INFO:teuthology.orchestra.run.smithi103:> route 2020-04-22T14:10:25.013 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2020-04-22T14:10:25.014 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-04-22T14:10:25.014 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 102 0 0 enp3s0f1 2020-04-22T14:10:25.014 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 102 0 0 enp3s0f1 2020-04-22T14:10:25.014 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:25.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:25.069 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -D FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-04-22T14:10:25.177 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:25.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:25.200 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -D FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-04-22T14:10:25.276 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:25.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:25.328 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -t nat -D POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-04-22T14:10:25.435 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:25.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:25.449 INFO:teuthology.orchestra.run.smithi103:> cat /tmp/python-ceph-brx 2020-04-22T14:10:25.508 INFO:teuthology.orchestra.run.smithi103.stdout:0 2020-04-22T14:10:25.508 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:25.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:25.556 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 0 > /proc/sys/net/ipv4/ip_forward' 2020-04-22T14:10:25.631 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:25.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:25.676 INFO:teuthology.orchestra.run.smithi103:> rm -f /tmp/python-ceph-brx 2020-04-22T14:10:25.735 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:25.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:25.783 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:10:25.842 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.2' netns for '/home/ubuntu/cephtest/mnt.2' 2020-04-22T14:10:25.842 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:10:25.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:25.859 INFO:teuthology.orchestra.run.smithi086:> ip addr 2020-04-22T14:10:25.918 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:10:25.918 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:10:25.918 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:10:25.918 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:25.919 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2020-04-22T14:10:25.919 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:25.919 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:10:25.919 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:10:25.919 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:10:25.919 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:10:25.919 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:10:25.920 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:10:25.920 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:10:25.920 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:10:25.920 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:10:25.920 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 42188sec preferred_lft 42188sec 2020-04-22T14:10:25.920 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2020-04-22T14:10:25.920 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:25.921 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:10:25.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:25.972 INFO:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.2) 2020-04-22T14:10:26.029 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.3' netns for '/home/ubuntu/cephtest/mnt.3' 2020-04-22T14:10:26.030 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:10:26.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:26.082 INFO:teuthology.orchestra.run.smithi086:> ip addr 2020-04-22T14:10:26.141 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:10:26.141 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:10:26.142 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:10:26.142 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:26.142 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2020-04-22T14:10:26.142 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:26.142 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:10:26.142 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:10:26.142 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:10:26.143 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:10:26.143 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:10:26.143 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:10:26.143 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:10:26.143 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:10:26.143 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:10:26.143 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 42188sec preferred_lft 42188sec 2020-04-22T14:10:26.144 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2020-04-22T14:10:26.144 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:26.144 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:10:26.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:26.193 INFO:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.3) 2020-04-22T14:10:26.254 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:26.268 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_config_session_timeout' 2020-04-22T14:10:26.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.412+0000 7fa0079ec700 1 Processor -- start 2020-04-22T14:10:26.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.412+0000 7fa0079ec700 1 -- start start 2020-04-22T14:10:26.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.413+0000 7fa0079ec700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa00012c0d0 0x7fa0001464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:26.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.413+0000 7fa0079ec700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa000143300 con 0x7fa000063e30 2020-04-22T14:10:26.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.413+0000 7fa0079ec700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0001435a0 con 0x7fa000065fe0 2020-04-22T14:10:26.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.413+0000 7fa0079ec700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa000143840 con 0x7fa00012c0d0 2020-04-22T14:10:26.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.413+0000 7fa004f87700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa000065fe0 0x7fa00005b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43058/0 (socket says 172.21.15.103:43058) 2020-04-22T14:10:26.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.413+0000 7fa004f87700 1 -- 172.21.15.103:0/4024241492 learned_addr learned my addr 172.21.15.103:0/4024241492 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:26.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.413+0000 7fa005788700 1 --2- 172.21.15.103:0/4024241492 >> v2:172.21.15.86:3300/0 conn(0x7fa00012c0d0 0x7fa0001464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:26.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.413+0000 7f9feffff700 1 -- 172.21.15.103:0/4024241492 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2495683546 0 0) 0x7fa0001435a0 con 0x7fa000065fe0 2020-04-22T14:10:26.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.413+0000 7f9feffff700 1 -- 172.21.15.103:0/4024241492 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fe8003230 con 0x7fa000065fe0 2020-04-22T14:10:26.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.413+0000 7f9feffff700 1 -- 172.21.15.103:0/4024241492 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 969552385 0 0) 0x7f9fe8003230 con 0x7fa000065fe0 2020-04-22T14:10:26.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.413+0000 7f9feffff700 1 -- 172.21.15.103:0/4024241492 >> v2:172.21.15.86:3300/0 conn(0x7fa00012c0d0 msgr2=0x7fa0001464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:26.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.413+0000 7f9feffff700 1 --2- 172.21.15.103:0/4024241492 >> v2:172.21.15.86:3300/0 conn(0x7fa00012c0d0 0x7fa0001464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:26.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.413+0000 7f9feffff700 1 -- 172.21.15.103:0/4024241492 >> v1:172.21.15.86:6789/0 conn(0x7fa000063e30 legacy=0x7fa0000642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:26.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.413+0000 7f9feffff700 1 -- 172.21.15.103:0/4024241492 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa00005bb50 con 0x7fa000065fe0 2020-04-22T14:10:26.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.413+0000 7f9feffff700 1 -- 172.21.15.103:0/4024241492 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f9ffc0016d0 con 0x7fa000065fe0 2020-04-22T14:10:26.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.413+0000 7f9feffff700 1 -- 172.21.15.103:0/4024241492 >> v1:172.21.15.103:6789/0 conn(0x7fa000065fe0 legacy=0x7fa00005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:26.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.414+0000 7f9feffff700 1 --2- 172.21.15.103:0/4024241492 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fe8003720 0x7f9fe8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:26.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.414+0000 7f9feffff700 1 --2- 172.21.15.103:0/4024241492 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fe80044d0 0x7f9fe8004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:26.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.414+0000 7f9feffff700 1 --2- 172.21.15.103:0/4024241492 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fe8004db0 0x7f9fe800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:26.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.414+0000 7f9feffff700 1 -- 172.21.15.103:0/4024241492 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa000143840 con 0x7f9fe8003720 2020-04-22T14:10:26.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.414+0000 7f9feffff700 1 -- 172.21.15.103:0/4024241492 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe80041c0 con 0x7f9fe8004db0 2020-04-22T14:10:26.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.414+0000 7f9feffff700 1 -- 172.21.15.103:0/4024241492 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe800bb80 con 0x7f9fe80044d0 2020-04-22T14:10:26.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.414+0000 7fa005f89700 1 --2- 172.21.15.103:0/4024241492 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fe8004db0 0x7f9fe800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:26.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.414+0000 7fa004f87700 1 --2- 172.21.15.103:0/4024241492 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fe80044d0 0x7f9fe8004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:26.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.414+0000 7fa005788700 1 --2- 172.21.15.103:0/4024241492 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fe8003720 0x7f9fe8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:26.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.414+0000 7fa005f89700 1 -- 172.21.15.103:0/4024241492 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fe80044d0 msgr2=0x7f9fe8004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:26.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.414+0000 7fa005f89700 1 --2- 172.21.15.103:0/4024241492 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fe80044d0 0x7f9fe8004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:26.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.414+0000 7fa005f89700 1 -- 172.21.15.103:0/4024241492 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fe8003720 msgr2=0x7f9fe8003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:26.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.414+0000 7fa005f89700 1 --2- 172.21.15.103:0/4024241492 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fe8003720 0x7f9fe8003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:26.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.414+0000 7fa005f89700 1 -- 172.21.15.103:0/4024241492 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe8003230 con 0x7f9fe8004db0 2020-04-22T14:10:26.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.414+0000 7fa005f89700 1 --2- 172.21.15.103:0/4024241492 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fe8004db0 0x7f9fe800b720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9fe80054a0 tx=0x7f9ff80100a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:26.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.414+0000 7fa005f89700 1 -- 172.21.15.103:0/4024241492 reap_dead start 2020-04-22T14:10:26.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.414+0000 7fa005f89700 1 --2- 172.21.15.103:0/4024241492 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fe8004db0 0x7f9fe800b720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9fe80054a0 tx=0x7f9ff80100a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:26.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.414+0000 7fa005f89700 1 --2- 172.21.15.103:0/4024241492 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fe8004db0 0x7f9fe800b720 secure :-1 s=READY pgs=747 cs=0 l=1 rx=0x7f9fe80054a0 tx=0x7f9ff80100a0).ready entity=mon.1 client_cookie=1505a83578b6572e server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:26.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.414+0000 7fa005f89700 1 --2- 172.21.15.103:0/4024241492 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fe8004db0 0x7f9fe800b720 secure :-1 s=THROTTLE_DONE pgs=747 cs=0 l=1 rx=0x7f9fe80054a0 tx=0x7f9ff80100a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:26.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.414+0000 7f9feffff700 1 -- 172.21.15.103:0/4024241492 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ff8006c40 con 0x7f9fe8004db0 2020-04-22T14:10:26.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.414+0000 7fa005f89700 1 --2- 172.21.15.103:0/4024241492 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fe8004db0 0x7f9fe800b720 secure :-1 s=THROTTLE_DONE pgs=747 cs=0 l=1 rx=0x7f9fe80054a0 tx=0x7f9ff80100a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:26.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.414+0000 7f9feffff700 1 -- 172.21.15.103:0/4024241492 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff8006da0 con 0x7f9fe8004db0 2020-04-22T14:10:26.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.414+0000 7fa005f89700 1 --2- 172.21.15.103:0/4024241492 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fe8004db0 0x7f9fe800b720 secure :-1 s=THROTTLE_DONE pgs=747 cs=0 l=1 rx=0x7f9fe80054a0 tx=0x7f9ff80100a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:26.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.414+0000 7f9feffff700 1 -- 172.21.15.103:0/4024241492 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ff8002640 con 0x7f9fe8004db0 2020-04-22T14:10:26.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.414+0000 7fa0079ec700 1 -- 172.21.15.103:0/4024241492 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fe8004db0 msgr2=0x7f9fe800b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:26.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.414+0000 7fa0079ec700 1 --2- 172.21.15.103:0/4024241492 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fe8004db0 0x7f9fe800b720 secure :-1 s=READY pgs=747 cs=0 l=1 rx=0x7f9fe80054a0 tx=0x7f9ff80100a0).stop 2020-04-22T14:10:26.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.415+0000 7fa0079ec700 1 -- 172.21.15.103:0/4024241492 shutdown_connections 2020-04-22T14:10:26.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.415+0000 7fa0079ec700 1 --2- 172.21.15.103:0/4024241492 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fe8004db0 0x7f9fe800b720 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:26.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.415+0000 7fa0079ec700 1 -- 172.21.15.103:0/4024241492 >> 172.21.15.103:0/4024241492 conn(0x7fa0000b9160 msgr2=0x7fa00005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:26.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.415+0000 7fa0079ec700 1 -- 172.21.15.103:0/4024241492 shutdown_connections 2020-04-22T14:10:26.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.415+0000 7fa0079ec700 1 -- 172.21.15.103:0/4024241492 wait complete. 2020-04-22T14:10:26.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.416+0000 7fa0079ec700 1 Processor -- start 2020-04-22T14:10:26.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.416+0000 7fa0079ec700 1 -- start start 2020-04-22T14:10:26.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.417+0000 7fa0079ec700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9fe8004db0 0x7fa0000b2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:26.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.417+0000 7fa0079ec700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa0000b0290 0x7fa0000ad230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:26.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.417+0000 7fa0079ec700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0000b42f0 con 0x7fa0000b3e70 2020-04-22T14:10:26.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.417+0000 7fa0079ec700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0000b3590 con 0x7f9fe8004db0 2020-04-22T14:10:26.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.417+0000 7fa0079ec700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0000b3830 con 0x7fa0000b0290 2020-04-22T14:10:26.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.417+0000 7fa005788700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9fe8004db0 0x7fa0000b2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:26.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.417+0000 7fa005788700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9fe8004db0 0x7fa0000b2ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50878/0 (socket says 172.21.15.103:50878) 2020-04-22T14:10:26.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.417+0000 7fa005788700 1 -- 172.21.15.103:0/2332204530 learned_addr learned my addr 172.21.15.103:0/2332204530 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:10:26.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.417+0000 7fa004f87700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa0000b3e70 0x7fa0000b5820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43070/0 (socket says 172.21.15.103:43070) 2020-04-22T14:10:26.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.417+0000 7fa005f89700 1 --2- 172.21.15.103:0/2332204530 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa0000b0290 0x7fa0000ad230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:26.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.417+0000 7fa005788700 1 -- 172.21.15.103:0/2332204530 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa0000b0290 msgr2=0x7fa0000ad230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:26.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.417+0000 7fa005788700 1 --2- 172.21.15.103:0/2332204530 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa0000b0290 0x7fa0000ad230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:26.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.417+0000 7fa005788700 1 -- 172.21.15.103:0/2332204530 >> v1:172.21.15.103:6789/0 conn(0x7fa0000b3e70 legacy=0x7fa0000b5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:26.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.417+0000 7f9fee7fc700 1 -- 172.21.15.103:0/2332204530 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1699503412 0 0) 0x7fa0000b42f0 con 0x7fa0000b3e70 2020-04-22T14:10:26.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.417+0000 7fa005788700 1 -- 172.21.15.103:0/2332204530 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0000b3ad0 con 0x7f9fe8004db0 2020-04-22T14:10:26.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.417+0000 7fa005788700 1 --2- 172.21.15.103:0/2332204530 >> v2:172.21.15.103:3300/0 conn(0x7f9fe8004db0 0x7fa0000b2ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9ff0007ed0 tx=0x7f9ff000c370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:26.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.417+0000 7fa005788700 1 --2- 172.21.15.103:0/2332204530 >> v2:172.21.15.103:3300/0 conn(0x7f9fe8004db0 0x7fa0000b2ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9ff0007ed0 tx=0x7f9ff000c370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:26.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.417+0000 7fa005788700 1 --2- 172.21.15.103:0/2332204530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fe8004db0 0x7fa0000b2ef0 secure :-1 s=READY pgs=749 cs=0 l=1 rx=0x7f9ff0007ed0 tx=0x7f9ff000c370).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:26.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.417+0000 7fa005788700 1 --2- 172.21.15.103:0/2332204530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fe8004db0 0x7fa0000b2ef0 secure :-1 s=THROTTLE_DONE pgs=749 cs=0 l=1 rx=0x7f9ff0007ed0 tx=0x7f9ff000c370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:26.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.417+0000 7f9fee7fc700 1 -- 172.21.15.103:0/2332204530 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ff0005aa0 con 0x7f9fe8004db0 2020-04-22T14:10:26.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.417+0000 7fa005788700 1 --2- 172.21.15.103:0/2332204530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fe8004db0 0x7fa0000b2ef0 secure :-1 s=THROTTLE_DONE pgs=749 cs=0 l=1 rx=0x7f9ff0007ed0 tx=0x7f9ff000c370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:26.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.417+0000 7fa005788700 1 --2- 172.21.15.103:0/2332204530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fe8004db0 0x7fa0000b2ef0 secure :-1 s=THROTTLE_DONE pgs=749 cs=0 l=1 rx=0x7f9ff0007ed0 tx=0x7f9ff000c370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:26.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.417+0000 7f9fee7fc700 1 -- 172.21.15.103:0/2332204530 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff0005c00 con 0x7f9fe8004db0 2020-04-22T14:10:26.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.417+0000 7fa0079ec700 1 -- 172.21.15.103:0/2332204530 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0000b1470 con 0x7f9fe8004db0 2020-04-22T14:10:26.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.417+0000 7f9fee7fc700 1 -- 172.21.15.103:0/2332204530 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ff00123d0 con 0x7f9fe8004db0 2020-04-22T14:10:26.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.417+0000 7fa0079ec700 1 -- 172.21.15.103:0/2332204530 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0000b5f30 con 0x7f9fe8004db0 2020-04-22T14:10:26.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.418+0000 7fa005788700 1 --2- 172.21.15.103:0/2332204530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fe8004db0 0x7fa0000b2ef0 secure :-1 s=THROTTLE_DONE pgs=749 cs=0 l=1 rx=0x7f9ff0007ed0 tx=0x7f9ff000c370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:26.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.418+0000 7f9fee7fc700 1 -- 172.21.15.103:0/2332204530 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f9ff0007160 con 0x7f9fe8004db0 2020-04-22T14:10:26.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.418+0000 7fa005788700 1 --2- 172.21.15.103:0/2332204530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fe8004db0 0x7fa0000b2ef0 secure :-1 s=THROTTLE_DONE pgs=749 cs=0 l=1 rx=0x7f9ff0007ed0 tx=0x7f9ff000c370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:26.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.418+0000 7fa0079ec700 1 -- 172.21.15.103:0/2332204530 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0000b3c60 con 0x7f9fe8004db0 2020-04-22T14:10:26.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.418+0000 7f9fee7fc700 1 --2- 172.21.15.103:0/2332204530 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9fe004d840 0x7f9fe004fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:26.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.418+0000 7f9fee7fc700 1 -- 172.21.15.103:0/2332204530 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f9ff0061480 con 0x7f9fe8004db0 2020-04-22T14:10:26.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.419+0000 7fa004f87700 1 --2- 172.21.15.103:0/2332204530 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9fe004d840 0x7f9fe004fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:26.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.419+0000 7fa004f87700 1 --2- 172.21.15.103:0/2332204530 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9fe004d840 0x7f9fe004fd00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9ffc000b80 tx=0x7fa00005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:26.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.419+0000 7fa004f87700 1 --2- 172.21.15.103:0/2332204530 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9fe004d840 0x7f9fe004fd00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9ffc000b80 tx=0x7fa00005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:26.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.419+0000 7fa004f87700 1 --2- 172.21.15.103:0/2332204530 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9fe004d840 0x7f9fe004fd00 secure :-1 s=READY pgs=284 cs=0 l=1 rx=0x7f9ffc000b80 tx=0x7fa00005bce0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:26.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.423+0000 7fa005788700 1 --2- 172.21.15.103:0/2332204530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fe8004db0 0x7fa0000b2ef0 secure :-1 s=THROTTLE_DONE pgs=749 cs=0 l=1 rx=0x7f9ff0007ed0 tx=0x7f9ff000c370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:26.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.423+0000 7f9fee7fc700 1 -- 172.21.15.103:0/2332204530 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f9ff003c860 con 0x7f9fe8004db0 2020-04-22T14:10:26.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:26.618+0000 7fa0079ec700 1 -- 172.21.15.103:0/2332204530 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_config_session_timeout"]} v 0) v1 -- 0x7fa000056c90 con 0x7f9fe8004db0 2020-04-22T14:10:27.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.370+0000 7fa005788700 1 --2- 172.21.15.103:0/2332204530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fe8004db0 0x7fa0000b2ef0 secure :-1 s=THROTTLE_DONE pgs=749 cs=0 l=1 rx=0x7f9ff0007ed0 tx=0x7f9ff000c370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:27.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.370+0000 7f9fee7fc700 1 -- 172.21.15.103:0/2332204530 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_config_session_timeout"]}]=0 v316) v1 ==== 159+0+0 (secure 0 0 0) 0x7f9ff003fe80 con 0x7f9fe8004db0 2020-04-22T14:10:27.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.372+0000 7fa0079ec700 1 -- 172.21.15.103:0/2332204530 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9fe004d840 msgr2=0x7f9fe004fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:27.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.372+0000 7fa0079ec700 1 --2- 172.21.15.103:0/2332204530 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9fe004d840 0x7f9fe004fd00 secure :-1 s=READY pgs=284 cs=0 l=1 rx=0x7f9ffc000b80 tx=0x7fa00005bce0).stop 2020-04-22T14:10:27.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.372+0000 7fa0079ec700 1 -- 172.21.15.103:0/2332204530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fe8004db0 msgr2=0x7fa0000b2ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:27.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.372+0000 7fa0079ec700 1 --2- 172.21.15.103:0/2332204530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fe8004db0 0x7fa0000b2ef0 secure :-1 s=READY pgs=749 cs=0 l=1 rx=0x7f9ff0007ed0 tx=0x7f9ff000c370).stop 2020-04-22T14:10:27.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.372+0000 7fa0079ec700 1 -- 172.21.15.103:0/2332204530 shutdown_connections 2020-04-22T14:10:27.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.372+0000 7fa0079ec700 1 --2- 172.21.15.103:0/2332204530 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9fe004d840 0x7f9fe004fd00 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:27.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.372+0000 7fa0079ec700 1 --2- 172.21.15.103:0/2332204530 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa0000b0290 0x7fa0000ad230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:27.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.372+0000 7fa0079ec700 1 --2- 172.21.15.103:0/2332204530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fe8004db0 0x7fa0000b2ef0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:27.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.372+0000 7fa0079ec700 1 -- 172.21.15.103:0/2332204530 >> 172.21.15.103:0/2332204530 conn(0x7fa0000b9160 msgr2=0x7fa000064c30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:27.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.372+0000 7fa0079ec700 1 -- 172.21.15.103:0/2332204530 shutdown_connections 2020-04-22T14:10:27.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.372+0000 7fa0079ec700 1 -- 172.21.15.103:0/2332204530 wait complete. 2020-04-22T14:10:27.387 INFO:tasks.cephfs_test_runner:test_config_session_timeout (tasks.cephfs.test_client_recovery.TestClientRecovery) ... ok 2020-04-22T14:10:27.387 INFO:tasks.cephfs_test_runner:Starting test: test_create_fsync (tasks.cephfs.test_client_recovery.TestClientRecovery) 2020-04-22T14:10:27.387 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:27.402 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_create_fsync' 2020-04-22T14:10:27.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.554+0000 7fb01ac13700 1 Processor -- start 2020-04-22T14:10:27.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.554+0000 7fb01ac13700 1 -- start start 2020-04-22T14:10:27.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.555+0000 7fb01ac13700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb014065fe0 0x7fb0141464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:27.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.555+0000 7fb01ac13700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb014063e30 0x7fb0140642a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:27.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.555+0000 7fb01ac13700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb014143300 con 0x7fb01412c0d0 2020-04-22T14:10:27.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.555+0000 7fb01ac13700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0141435a0 con 0x7fb014063e30 2020-04-22T14:10:27.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.555+0000 7fb01ac13700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb014143840 con 0x7fb014065fe0 2020-04-22T14:10:27.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.555+0000 7fb0189af700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb01412c0d0 0x7fb01405b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43076/0 (socket says 172.21.15.103:43076) 2020-04-22T14:10:27.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.555+0000 7fb0189af700 1 -- 172.21.15.103:0/54136060 learned_addr learned my addr 172.21.15.103:0/54136060 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:27.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.555+0000 7fb013fff700 1 --2- 172.21.15.103:0/54136060 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb014065fe0 0x7fb0141464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:27.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.555+0000 7fb0191b0700 1 --2- 172.21.15.103:0/54136060 >> v2:172.21.15.86:3300/0 conn(0x7fb014063e30 0x7fb0140642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:27.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.555+0000 7fb0137fe700 1 -- 172.21.15.103:0/54136060 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3034314452 0 0) 0x7fb014143300 con 0x7fb01412c0d0 2020-04-22T14:10:27.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.555+0000 7fb0137fe700 1 -- 172.21.15.103:0/54136060 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb000003230 con 0x7fb01412c0d0 2020-04-22T14:10:27.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.556+0000 7fb0137fe700 1 -- 172.21.15.103:0/54136060 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3380070200 0 0) 0x7fb000003230 con 0x7fb01412c0d0 2020-04-22T14:10:27.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.556+0000 7fb0137fe700 1 -- 172.21.15.103:0/54136060 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb014065fe0 msgr2=0x7fb0141464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:27.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.556+0000 7fb0137fe700 1 --2- 172.21.15.103:0/54136060 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb014065fe0 0x7fb0141464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:27.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.556+0000 7fb0137fe700 1 -- 172.21.15.103:0/54136060 >> v2:172.21.15.86:3300/0 conn(0x7fb014063e30 msgr2=0x7fb0140642a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:27.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.556+0000 7fb0137fe700 1 --2- 172.21.15.103:0/54136060 >> v2:172.21.15.86:3300/0 conn(0x7fb014063e30 0x7fb0140642a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:27.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.556+0000 7fb0137fe700 1 -- 172.21.15.103:0/54136060 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01405bb50 con 0x7fb01412c0d0 2020-04-22T14:10:27.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.556+0000 7fb0137fe700 1 -- 172.21.15.103:0/54136060 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fb0040016d0 con 0x7fb01412c0d0 2020-04-22T14:10:27.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.556+0000 7fb0137fe700 1 -- 172.21.15.103:0/54136060 >> v1:172.21.15.103:6789/0 conn(0x7fb01412c0d0 legacy=0x7fb01405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:27.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.556+0000 7fb0137fe700 1 --2- 172.21.15.103:0/54136060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb000003720 0x7fb000003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:27.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.556+0000 7fb0137fe700 1 --2- 172.21.15.103:0/54136060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb000004060 0x7fb000004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:27.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.556+0000 7fb0137fe700 1 --2- 172.21.15.103:0/54136060 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb014065fe0 0x7fb000004ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:27.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.556+0000 7fb0137fe700 1 -- 172.21.15.103:0/54136060 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0141435a0 con 0x7fb000004060 2020-04-22T14:10:27.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.556+0000 7fb0137fe700 1 -- 172.21.15.103:0/54136060 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb014143840 con 0x7fb000003720 2020-04-22T14:10:27.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.556+0000 7fb0137fe700 1 -- 172.21.15.103:0/54136060 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb000005050 con 0x7fb014065fe0 2020-04-22T14:10:27.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.556+0000 7fb0189af700 1 --2- 172.21.15.103:0/54136060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb000003720 0x7fb000003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:27.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.556+0000 7fb013fff700 1 --2- 172.21.15.103:0/54136060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb000004060 0x7fb000004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:27.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.556+0000 7fb0191b0700 1 --2- 172.21.15.103:0/54136060 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb014065fe0 0x7fb000004ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:27.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.556+0000 7fb0189af700 1 -- 172.21.15.103:0/54136060 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb014065fe0 msgr2=0x7fb000004ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:27.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.556+0000 7fb0189af700 1 --2- 172.21.15.103:0/54136060 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb014065fe0 0x7fb000004ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:27.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.556+0000 7fb0189af700 1 -- 172.21.15.103:0/54136060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb000004060 msgr2=0x7fb000004530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:27.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.556+0000 7fb0189af700 1 --2- 172.21.15.103:0/54136060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb000004060 0x7fb000004530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:27.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.556+0000 7fb0189af700 1 -- 172.21.15.103:0/54136060 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb000003230 con 0x7fb000003720 2020-04-22T14:10:27.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.556+0000 7fb0189af700 1 --2- 172.21.15.103:0/54136060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb000003720 0x7fb000003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb0040013e0 tx=0x7fb01405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:27.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.556+0000 7fb0189af700 1 --2- 172.21.15.103:0/54136060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb000003720 0x7fb000003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb0040013e0 tx=0x7fb01405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:27.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.556+0000 7fb0189af700 1 --2- 172.21.15.103:0/54136060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb000003720 0x7fb000003b40 secure :-1 s=READY pgs=751 cs=0 l=1 rx=0x7fb0040013e0 tx=0x7fb01405bce0).ready entity=mon.1 client_cookie=d5703dfea22e927d server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:27.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.556+0000 7fb0189af700 1 --2- 172.21.15.103:0/54136060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb000003720 0x7fb000003b40 secure :-1 s=THROTTLE_DONE pgs=751 cs=0 l=1 rx=0x7fb0040013e0 tx=0x7fb01405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:27.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.556+0000 7fb0189af700 1 --2- 172.21.15.103:0/54136060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb000003720 0x7fb000003b40 secure :-1 s=THROTTLE_DONE pgs=751 cs=0 l=1 rx=0x7fb0040013e0 tx=0x7fb01405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:27.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.556+0000 7fb0137fe700 1 -- 172.21.15.103:0/54136060 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb00400e180 con 0x7fb000003720 2020-04-22T14:10:27.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.556+0000 7fb0189af700 1 --2- 172.21.15.103:0/54136060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb000003720 0x7fb000003b40 secure :-1 s=THROTTLE_DONE pgs=751 cs=0 l=1 rx=0x7fb0040013e0 tx=0x7fb01405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:27.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.556+0000 7fb0137fe700 1 -- 172.21.15.103:0/54136060 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00400e2e0 con 0x7fb000003720 2020-04-22T14:10:27.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.556+0000 7fb0137fe700 1 -- 172.21.15.103:0/54136060 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0040100c0 con 0x7fb000003720 2020-04-22T14:10:27.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.556+0000 7fb01ac13700 1 -- 172.21.15.103:0/54136060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb000003720 msgr2=0x7fb000003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:27.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.556+0000 7fb01ac13700 1 --2- 172.21.15.103:0/54136060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb000003720 0x7fb000003b40 secure :-1 s=READY pgs=751 cs=0 l=1 rx=0x7fb0040013e0 tx=0x7fb01405bce0).stop 2020-04-22T14:10:27.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.556+0000 7fb0191b0700 1 -- 172.21.15.103:0/54136060 reap_dead start 2020-04-22T14:10:27.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.557+0000 7fb01ac13700 1 -- 172.21.15.103:0/54136060 shutdown_connections 2020-04-22T14:10:27.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.557+0000 7fb01ac13700 1 -- 172.21.15.103:0/54136060 >> 172.21.15.103:0/54136060 conn(0x7fb0140b9160 msgr2=0x7fb01405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:27.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.557+0000 7fb01ac13700 1 -- 172.21.15.103:0/54136060 shutdown_connections 2020-04-22T14:10:27.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.557+0000 7fb01ac13700 1 -- 172.21.15.103:0/54136060 wait complete. 2020-04-22T14:10:27.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.558+0000 7fb01ac13700 1 Processor -- start 2020-04-22T14:10:27.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.558+0000 7fb01ac13700 1 -- start start 2020-04-22T14:10:27.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.559+0000 7fb01ac13700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb014118af0 0x7fb01412aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:27.582 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.559+0000 7fb01ac13700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb01414b180 0x7fb014118ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:27.582 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.559+0000 7fb01ac13700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb014119330 0x7fb01414c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:27.582 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.559+0000 7fb01ac13700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb01412b190 con 0x7fb01414b180 2020-04-22T14:10:27.582 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.559+0000 7fb01ac13700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb01412b3c0 con 0x7fb014118af0 2020-04-22T14:10:27.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.559+0000 7fb01ac13700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01412b660 con 0x7fb014119330 2020-04-22T14:10:27.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.559+0000 7fb0189af700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb014118af0 0x7fb01412aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:27.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.559+0000 7fb0189af700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb014118af0 0x7fb01412aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50898/0 (socket says 172.21.15.103:50898) 2020-04-22T14:10:27.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.559+0000 7fb0189af700 1 -- 172.21.15.103:0/2653861290 learned_addr learned my addr 172.21.15.103:0/2653861290 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:10:27.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.559+0000 7fb013fff700 1 --2- 172.21.15.103:0/2653861290 >> v2:172.21.15.86:3300/0 conn(0x7fb01414b180 0x7fb014118ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:27.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.559+0000 7fb0191b0700 1 --2- 172.21.15.103:0/2653861290 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb014119330 0x7fb01414c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:27.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.559+0000 7fb0189af700 1 -- 172.21.15.103:0/2653861290 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb014119330 msgr2=0x7fb01414c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:27.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.559+0000 7fb0189af700 1 --2- 172.21.15.103:0/2653861290 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb014119330 0x7fb01414c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:27.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.559+0000 7fb0189af700 1 -- 172.21.15.103:0/2653861290 >> v2:172.21.15.86:3300/0 conn(0x7fb01414b180 msgr2=0x7fb014118ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:27.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.559+0000 7fb0189af700 1 --2- 172.21.15.103:0/2653861290 >> v2:172.21.15.86:3300/0 conn(0x7fb01414b180 0x7fb014118ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:27.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.559+0000 7fb0189af700 1 -- 172.21.15.103:0/2653861290 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01414b5e0 con 0x7fb014118af0 2020-04-22T14:10:27.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.559+0000 7fb0189af700 1 --2- 172.21.15.103:0/2653861290 >> v2:172.21.15.103:3300/0 conn(0x7fb014118af0 0x7fb01412aaa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb0040013e0 tx=0x7fb01405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:27.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.559+0000 7fb0189af700 1 --2- 172.21.15.103:0/2653861290 >> v2:172.21.15.103:3300/0 conn(0x7fb014118af0 0x7fb01412aaa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb0040013e0 tx=0x7fb01405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:27.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.559+0000 7fb0189af700 1 --2- 172.21.15.103:0/2653861290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb014118af0 0x7fb01412aaa0 secure :-1 s=READY pgs=752 cs=0 l=1 rx=0x7fb0040013e0 tx=0x7fb01405bce0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:27.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.559+0000 7fb0189af700 1 --2- 172.21.15.103:0/2653861290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb014118af0 0x7fb01412aaa0 secure :-1 s=THROTTLE_DONE pgs=752 cs=0 l=1 rx=0x7fb0040013e0 tx=0x7fb01405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:27.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.559+0000 7fb0189af700 1 --2- 172.21.15.103:0/2653861290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb014118af0 0x7fb01412aaa0 secure :-1 s=THROTTLE_DONE pgs=752 cs=0 l=1 rx=0x7fb0040013e0 tx=0x7fb01405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:27.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.559+0000 7fb011ffb700 1 -- 172.21.15.103:0/2653861290 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb00400fe50 con 0x7fb014118af0 2020-04-22T14:10:27.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.559+0000 7fb0189af700 1 --2- 172.21.15.103:0/2653861290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb014118af0 0x7fb01412aaa0 secure :-1 s=THROTTLE_DONE pgs=752 cs=0 l=1 rx=0x7fb0040013e0 tx=0x7fb01405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:27.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.559+0000 7fb011ffb700 1 -- 172.21.15.103:0/2653861290 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00400e660 con 0x7fb014118af0 2020-04-22T14:10:27.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.559+0000 7fb01ac13700 1 -- 172.21.15.103:0/2653861290 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0140ac740 con 0x7fb014118af0 2020-04-22T14:10:27.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.559+0000 7fb011ffb700 1 -- 172.21.15.103:0/2653861290 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0040106b0 con 0x7fb014118af0 2020-04-22T14:10:27.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.559+0000 7fb01ac13700 1 -- 172.21.15.103:0/2653861290 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0141486d0 con 0x7fb014118af0 2020-04-22T14:10:27.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.560+0000 7fb0189af700 1 --2- 172.21.15.103:0/2653861290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb014118af0 0x7fb01412aaa0 secure :-1 s=THROTTLE_DONE pgs=752 cs=0 l=1 rx=0x7fb0040013e0 tx=0x7fb01405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:27.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.560+0000 7fb01ac13700 1 -- 172.21.15.103:0/2653861290 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb01412b7d0 con 0x7fb014118af0 2020-04-22T14:10:27.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.560+0000 7fb011ffb700 1 -- 172.21.15.103:0/2653861290 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fb004010810 con 0x7fb014118af0 2020-04-22T14:10:27.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.560+0000 7fb0189af700 1 --2- 172.21.15.103:0/2653861290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb014118af0 0x7fb01412aaa0 secure :-1 s=THROTTLE_DONE pgs=752 cs=0 l=1 rx=0x7fb0040013e0 tx=0x7fb01405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:27.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.561+0000 7fb011ffb700 1 --2- 172.21.15.103:0/2653861290 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faff404d9a0 0x7faff404fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:27.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.561+0000 7fb011ffb700 1 -- 172.21.15.103:0/2653861290 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fb004061870 con 0x7fb014118af0 2020-04-22T14:10:27.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.561+0000 7fb013fff700 1 --2- 172.21.15.103:0/2653861290 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faff404d9a0 0x7faff404fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:27.590 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.561+0000 7fb013fff700 1 --2- 172.21.15.103:0/2653861290 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faff404d9a0 0x7faff404fe60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb008002f30 tx=0x7fb00800c9b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:27.590 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.561+0000 7fb013fff700 1 --2- 172.21.15.103:0/2653861290 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faff404d9a0 0x7faff404fe60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb008002f30 tx=0x7fb00800c9b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:27.590 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.561+0000 7fb013fff700 1 --2- 172.21.15.103:0/2653861290 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faff404d9a0 0x7faff404fe60 secure :-1 s=READY pgs=285 cs=0 l=1 rx=0x7fb008002f30 tx=0x7fb00800c9b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:27.590 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.565+0000 7fb0189af700 1 --2- 172.21.15.103:0/2653861290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb014118af0 0x7fb01412aaa0 secure :-1 s=THROTTLE_DONE pgs=752 cs=0 l=1 rx=0x7fb0040013e0 tx=0x7fb01405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:27.591 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.565+0000 7fb011ffb700 1 -- 172.21.15.103:0/2653861290 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fb01412b7d0 con 0x7fb014118af0 2020-04-22T14:10:27.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:27.759+0000 7fb01ac13700 1 -- 172.21.15.103:0/2653861290 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_create_fsync"]} v 0) v1 -- 0x7fb01412b7d0 con 0x7fb014118af0 2020-04-22T14:10:28.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.374+0000 7fb0189af700 1 --2- 172.21.15.103:0/2653861290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb014118af0 0x7fb01412aaa0 secure :-1 s=THROTTLE_DONE pgs=752 cs=0 l=1 rx=0x7fb0040013e0 tx=0x7fb01405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:28.378 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.374+0000 7fb011ffb700 1 -- 172.21.15.103:0/2653861290 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_create_fsync"]}]=0 v317) v1 ==== 152+0+0 (secure 0 0 0) 0x7fb01412b7d0 con 0x7fb014118af0 2020-04-22T14:10:28.379 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.376+0000 7fb01ac13700 1 -- 172.21.15.103:0/2653861290 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faff404d9a0 msgr2=0x7faff404fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:28.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.376+0000 7fb01ac13700 1 --2- 172.21.15.103:0/2653861290 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faff404d9a0 0x7faff404fe60 secure :-1 s=READY pgs=285 cs=0 l=1 rx=0x7fb008002f30 tx=0x7fb00800c9b0).stop 2020-04-22T14:10:28.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.376+0000 7fb01ac13700 1 -- 172.21.15.103:0/2653861290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb014118af0 msgr2=0x7fb01412aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:28.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.376+0000 7fb01ac13700 1 --2- 172.21.15.103:0/2653861290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb014118af0 0x7fb01412aaa0 secure :-1 s=READY pgs=752 cs=0 l=1 rx=0x7fb0040013e0 tx=0x7fb01405bce0).stop 2020-04-22T14:10:28.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.376+0000 7fb01ac13700 1 -- 172.21.15.103:0/2653861290 shutdown_connections 2020-04-22T14:10:28.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.376+0000 7fb01ac13700 1 --2- 172.21.15.103:0/2653861290 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb014119330 0x7fb01414c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:28.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.376+0000 7fb01ac13700 1 --2- 172.21.15.103:0/2653861290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb014118af0 0x7fb01412aaa0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:28.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.376+0000 7fb01ac13700 1 --2- 172.21.15.103:0/2653861290 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faff404d9a0 0x7faff404fe60 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:28.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.376+0000 7fb01ac13700 1 --2- 172.21.15.103:0/2653861290 >> v2:172.21.15.86:3300/0 conn(0x7fb01414b180 0x7fb014118ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:28.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.376+0000 7fb01ac13700 1 -- 172.21.15.103:0/2653861290 >> 172.21.15.103:0/2653861290 conn(0x7fb0140b9160 msgr2=0x7fb01414dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:28.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.376+0000 7fb01ac13700 1 -- 172.21.15.103:0/2653861290 shutdown_connections 2020-04-22T14:10:28.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.376+0000 7fb01ac13700 1 -- 172.21.15.103:0/2653861290 wait complete. 2020-04-22T14:10:28.390 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-04-22T14:10:28.390 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:10:28.419 INFO:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:10:28.516 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:28.532 INFO:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:10:28.621 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-04-22T14:10:28.622 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:28.636 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2020-04-22T14:10:28.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.780+0000 7fa438583700 1 Processor -- start 2020-04-22T14:10:28.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.780+0000 7fa438583700 1 -- start start 2020-04-22T14:10:28.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.781+0000 7fa438583700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa430065fe0 0x7fa4301464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:28.792 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.781+0000 7fa438583700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa430063e30 0x7fa4300642a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:28.792 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.781+0000 7fa438583700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa430143300 con 0x7fa43012c0d0 2020-04-22T14:10:28.792 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.781+0000 7fa438583700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4301435a0 con 0x7fa430063e30 2020-04-22T14:10:28.792 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.781+0000 7fa438583700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa430143840 con 0x7fa430065fe0 2020-04-22T14:10:28.792 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.781+0000 7fa43631f700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa43012c0d0 0x7fa43005b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43096/0 (socket says 172.21.15.103:43096) 2020-04-22T14:10:28.792 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.781+0000 7fa43631f700 1 -- 172.21.15.103:0/3232413898 learned_addr learned my addr 172.21.15.103:0/3232413898 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:28.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.781+0000 7fa435b1e700 1 --2- 172.21.15.103:0/3232413898 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa430065fe0 0x7fa4301464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:28.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.781+0000 7fa43531d700 1 -- 172.21.15.103:0/3232413898 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3654655793 0 0) 0x7fa430143300 con 0x7fa43012c0d0 2020-04-22T14:10:28.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.781+0000 7fa436b20700 1 --2- 172.21.15.103:0/3232413898 >> v2:172.21.15.86:3300/0 conn(0x7fa430063e30 0x7fa4300642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:28.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.781+0000 7fa43531d700 1 -- 172.21.15.103:0/3232413898 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa418003230 con 0x7fa43012c0d0 2020-04-22T14:10:28.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.781+0000 7fa43531d700 1 -- 172.21.15.103:0/3232413898 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1748951177 0 0) 0x7fa418003230 con 0x7fa43012c0d0 2020-04-22T14:10:28.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.781+0000 7fa43531d700 1 -- 172.21.15.103:0/3232413898 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa430065fe0 msgr2=0x7fa4301464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:28.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.781+0000 7fa43531d700 1 --2- 172.21.15.103:0/3232413898 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa430065fe0 0x7fa4301464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:28.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.781+0000 7fa43531d700 1 -- 172.21.15.103:0/3232413898 >> v2:172.21.15.86:3300/0 conn(0x7fa430063e30 msgr2=0x7fa4300642a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:28.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.781+0000 7fa43531d700 1 --2- 172.21.15.103:0/3232413898 >> v2:172.21.15.86:3300/0 conn(0x7fa430063e30 0x7fa4300642a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:28.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.781+0000 7fa43531d700 1 -- 172.21.15.103:0/3232413898 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43005bb50 con 0x7fa43012c0d0 2020-04-22T14:10:28.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.781+0000 7fa43531d700 1 -- 172.21.15.103:0/3232413898 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fa42c0016d0 con 0x7fa43012c0d0 2020-04-22T14:10:28.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.781+0000 7fa43531d700 1 -- 172.21.15.103:0/3232413898 >> v1:172.21.15.103:6789/0 conn(0x7fa43012c0d0 legacy=0x7fa43005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:28.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.781+0000 7fa43531d700 1 --2- 172.21.15.103:0/3232413898 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa430065fe0 0x7fa418003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:28.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.782+0000 7fa43531d700 1 --2- 172.21.15.103:0/3232413898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa418003b80 0x7fa418003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:28.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.782+0000 7fa43531d700 1 --2- 172.21.15.103:0/3232413898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4180045c0 0x7fa418004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:28.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.782+0000 7fa43531d700 1 -- 172.21.15.103:0/3232413898 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4301435a0 con 0x7fa418003b80 2020-04-22T14:10:28.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.782+0000 7fa43531d700 1 -- 172.21.15.103:0/3232413898 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa430143840 con 0x7fa4180045c0 2020-04-22T14:10:28.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.782+0000 7fa43531d700 1 -- 172.21.15.103:0/3232413898 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa418005050 con 0x7fa430065fe0 2020-04-22T14:10:28.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.782+0000 7fa436b20700 1 --2- 172.21.15.103:0/3232413898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4180045c0 0x7fa418004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:28.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.782+0000 7fa43631f700 1 --2- 172.21.15.103:0/3232413898 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa430065fe0 0x7fa418003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:28.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.782+0000 7fa435b1e700 1 --2- 172.21.15.103:0/3232413898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa418003b80 0x7fa418003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:28.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.782+0000 7fa436b20700 1 -- 172.21.15.103:0/3232413898 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa430065fe0 msgr2=0x7fa418003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:28.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.782+0000 7fa436b20700 1 --2- 172.21.15.103:0/3232413898 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa430065fe0 0x7fa418003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:28.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.782+0000 7fa436b20700 1 -- 172.21.15.103:0/3232413898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa418003b80 msgr2=0x7fa418003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:28.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.782+0000 7fa436b20700 1 --2- 172.21.15.103:0/3232413898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa418003b80 0x7fa418003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:28.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.782+0000 7fa436b20700 1 -- 172.21.15.103:0/3232413898 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa418003230 con 0x7fa4180045c0 2020-04-22T14:10:28.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.782+0000 7fa436b20700 1 --2- 172.21.15.103:0/3232413898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4180045c0 0x7fa418004a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa4280032b0 tx=0x7fa4280103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:28.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.782+0000 7fa436b20700 1 --2- 172.21.15.103:0/3232413898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4180045c0 0x7fa418004a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa4280032b0 tx=0x7fa4280103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:28.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.782+0000 7fa436b20700 1 --2- 172.21.15.103:0/3232413898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4180045c0 0x7fa418004a20 secure :-1 s=READY pgs=754 cs=0 l=1 rx=0x7fa4280032b0 tx=0x7fa4280103a0).ready entity=mon.1 client_cookie=ed034729b06093bf server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:28.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.782+0000 7fa436b20700 1 --2- 172.21.15.103:0/3232413898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4180045c0 0x7fa418004a20 secure :-1 s=THROTTLE_DONE pgs=754 cs=0 l=1 rx=0x7fa4280032b0 tx=0x7fa4280103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:28.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.782+0000 7fa43531d700 1 -- 172.21.15.103:0/3232413898 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4280112c0 con 0x7fa4180045c0 2020-04-22T14:10:28.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.782+0000 7fa436b20700 1 --2- 172.21.15.103:0/3232413898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4180045c0 0x7fa418004a20 secure :-1 s=THROTTLE_DONE pgs=754 cs=0 l=1 rx=0x7fa4280032b0 tx=0x7fa4280103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:28.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.782+0000 7fa436b20700 1 --2- 172.21.15.103:0/3232413898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4180045c0 0x7fa418004a20 secure :-1 s=THROTTLE_DONE pgs=754 cs=0 l=1 rx=0x7fa4280032b0 tx=0x7fa4280103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:28.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.782+0000 7fa43531d700 1 -- 172.21.15.103:0/3232413898 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa428011420 con 0x7fa4180045c0 2020-04-22T14:10:28.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.782+0000 7fa43531d700 1 -- 172.21.15.103:0/3232413898 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4280117c0 con 0x7fa4180045c0 2020-04-22T14:10:28.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.782+0000 7fa438583700 1 -- 172.21.15.103:0/3232413898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4180045c0 msgr2=0x7fa418004a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:28.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.782+0000 7fa438583700 1 --2- 172.21.15.103:0/3232413898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4180045c0 0x7fa418004a20 secure :-1 s=READY pgs=754 cs=0 l=1 rx=0x7fa4280032b0 tx=0x7fa4280103a0).stop 2020-04-22T14:10:28.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.782+0000 7fa436b20700 1 -- 172.21.15.103:0/3232413898 reap_dead start 2020-04-22T14:10:28.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.783+0000 7fa438583700 1 -- 172.21.15.103:0/3232413898 shutdown_connections 2020-04-22T14:10:28.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.783+0000 7fa438583700 1 -- 172.21.15.103:0/3232413898 >> 172.21.15.103:0/3232413898 conn(0x7fa4300b9160 msgr2=0x7fa43005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:28.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.783+0000 7fa438583700 1 -- 172.21.15.103:0/3232413898 shutdown_connections 2020-04-22T14:10:28.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.783+0000 7fa438583700 1 -- 172.21.15.103:0/3232413898 wait complete. 2020-04-22T14:10:28.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.784+0000 7fa438583700 1 Processor -- start 2020-04-22T14:10:28.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.784+0000 7fa438583700 1 -- start start 2020-04-22T14:10:28.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.784+0000 7fa438583700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa430128a20 0x7fa430155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:28.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.784+0000 7fa438583700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa430128e00 con 0x7fa4300b0db0 2020-04-22T14:10:28.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.784+0000 7fa438583700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa43012abc0 con 0x7fa4300b0950 2020-04-22T14:10:28.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.784+0000 7fa438583700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4300b4100 con 0x7fa430128a20 2020-04-22T14:10:28.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.784+0000 7fa435b1e700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa4300b0950 0x7fa4300b58d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43108/0 (socket says 172.21.15.103:43108) 2020-04-22T14:10:28.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.784+0000 7fa435b1e700 1 -- 172.21.15.103:0/1142275418 learned_addr learned my addr 172.21.15.103:0/1142275418 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:28.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.784+0000 7fa43631f700 1 --2- 172.21.15.103:0/1142275418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa430128a20 0x7fa430155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:28.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.785+0000 7fa4237fe700 1 -- 172.21.15.103:0/1142275418 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 802411967 0 0) 0x7fa43012abc0 con 0x7fa4300b0950 2020-04-22T14:10:28.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.785+0000 7fa4237fe700 1 -- 172.21.15.103:0/1142275418 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa410002fe0 con 0x7fa4300b0950 2020-04-22T14:10:28.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.785+0000 7fa4237fe700 1 -- 172.21.15.103:0/1142275418 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 556670185 0 0) 0x7fa430128e00 con 0x7fa4300b0db0 2020-04-22T14:10:28.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.785+0000 7fa4237fe700 1 -- 172.21.15.103:0/1142275418 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa43012abc0 con 0x7fa4300b0db0 2020-04-22T14:10:28.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.785+0000 7fa4237fe700 1 -- 172.21.15.103:0/1142275418 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 907952372 0 0) 0x7fa410002fe0 con 0x7fa4300b0950 2020-04-22T14:10:28.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.785+0000 7fa4237fe700 1 -- 172.21.15.103:0/1142275418 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa430128e00 con 0x7fa4300b0950 2020-04-22T14:10:28.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.785+0000 7fa4237fe700 1 -- 172.21.15.103:0/1142275418 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fa424001490 con 0x7fa4300b0950 2020-04-22T14:10:28.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.785+0000 7fa4237fe700 1 -- 172.21.15.103:0/1142275418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa430128a20 msgr2=0x7fa430155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:28.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.785+0000 7fa4237fe700 1 --2- 172.21.15.103:0/1142275418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa430128a20 0x7fa430155980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:28.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.785+0000 7fa4237fe700 1 -- 172.21.15.103:0/1142275418 >> v1:172.21.15.103:6789/0 conn(0x7fa4300b0950 legacy=0x7fa4300b58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:28.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.785+0000 7fa4237fe700 1 -- 172.21.15.103:0/1142275418 >> v1:172.21.15.86:6789/0 conn(0x7fa4300b0db0 legacy=0x7fa4300b4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:28.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.785+0000 7fa4237fe700 1 --2- 172.21.15.103:0/1142275418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa410004b20 0x7fa410004f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:28.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.785+0000 7fa4237fe700 1 --2- 172.21.15.103:0/1142275418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa410003800 0x7fa410003c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:28.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.785+0000 7fa4237fe700 1 --2- 172.21.15.103:0/1142275418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4100040e0 0x7fa41000b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:28.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.785+0000 7fa4237fe700 1 -- 172.21.15.103:0/1142275418 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4300b4100 con 0x7fa4100040e0 2020-04-22T14:10:28.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.785+0000 7fa4237fe700 1 -- 172.21.15.103:0/1142275418 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4100046a0 con 0x7fa410004b20 2020-04-22T14:10:28.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.785+0000 7fa4237fe700 1 -- 172.21.15.103:0/1142275418 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa41000bc00 con 0x7fa410003800 2020-04-22T14:10:28.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.785+0000 7fa43631f700 1 --2- 172.21.15.103:0/1142275418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa430128a20 0x7fa430155980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:10:28.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.785+0000 7fa43631f700 1 --2- 172.21.15.103:0/1142275418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa410004b20 0x7fa410004f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:28.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.785+0000 7fa435b1e700 1 --2- 172.21.15.103:0/1142275418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa410003800 0x7fa410003c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:28.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.785+0000 7fa436b20700 1 --2- 172.21.15.103:0/1142275418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4100040e0 0x7fa41000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:28.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.785+0000 7fa43631f700 1 -- 172.21.15.103:0/1142275418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa410003800 msgr2=0x7fa410003c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:28.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.785+0000 7fa43631f700 1 --2- 172.21.15.103:0/1142275418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa410003800 0x7fa410003c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:28.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.785+0000 7fa43631f700 1 -- 172.21.15.103:0/1142275418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4100040e0 msgr2=0x7fa41000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:28.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.785+0000 7fa43631f700 1 --2- 172.21.15.103:0/1142275418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4100040e0 0x7fa41000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:28.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.785+0000 7fa43631f700 1 -- 172.21.15.103:0/1142275418 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4300b43a0 con 0x7fa410004b20 2020-04-22T14:10:28.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.785+0000 7fa438583700 1 -- 172.21.15.103:0/1142275418 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4300b5fe0 con 0x7fa410004b20 2020-04-22T14:10:28.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.785+0000 7fa43631f700 1 --2- 172.21.15.103:0/1142275418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa410004b20 0x7fa410004f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa42c0013e0 tx=0x7fa43005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:28.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.785+0000 7fa438583700 1 -- 172.21.15.103:0/1142275418 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4300b2bf0 con 0x7fa410004b20 2020-04-22T14:10:28.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.785+0000 7fa43631f700 1 --2- 172.21.15.103:0/1142275418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa410004b20 0x7fa410004f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa42c0013e0 tx=0x7fa43005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:28.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.785+0000 7fa43631f700 1 --2- 172.21.15.103:0/1142275418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa410004b20 0x7fa410004f20 secure :-1 s=READY pgs=756 cs=0 l=1 rx=0x7fa42c0013e0 tx=0x7fa43005bce0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:28.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.786+0000 7fa43631f700 1 --2- 172.21.15.103:0/1142275418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa410004b20 0x7fa410004f20 secure :-1 s=THROTTLE_DONE pgs=756 cs=0 l=1 rx=0x7fa42c0013e0 tx=0x7fa43005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:28.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.786+0000 7fa4237fe700 1 -- 172.21.15.103:0/1142275418 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa42c00e550 con 0x7fa410004b20 2020-04-22T14:10:28.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.786+0000 7fa43631f700 1 --2- 172.21.15.103:0/1142275418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa410004b20 0x7fa410004f20 secure :-1 s=THROTTLE_DONE pgs=756 cs=0 l=1 rx=0x7fa42c0013e0 tx=0x7fa43005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:28.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.786+0000 7fa43631f700 1 --2- 172.21.15.103:0/1142275418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa410004b20 0x7fa410004f20 secure :-1 s=THROTTLE_DONE pgs=756 cs=0 l=1 rx=0x7fa42c0013e0 tx=0x7fa43005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:28.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.786+0000 7fa4237fe700 1 -- 172.21.15.103:0/1142275418 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42c00e6b0 con 0x7fa410004b20 2020-04-22T14:10:28.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.786+0000 7fa4237fe700 1 -- 172.21.15.103:0/1142275418 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa42c011af0 con 0x7fa410004b20 2020-04-22T14:10:28.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.786+0000 7fa43631f700 1 --2- 172.21.15.103:0/1142275418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa410004b20 0x7fa410004f20 secure :-1 s=THROTTLE_DONE pgs=756 cs=0 l=1 rx=0x7fa42c0013e0 tx=0x7fa43005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:28.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.786+0000 7fa438583700 1 -- 172.21.15.103:0/1142275418 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa43012a9d0 con 0x7fa410004b20 2020-04-22T14:10:28.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.787+0000 7fa4237fe700 1 -- 172.21.15.103:0/1142275418 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fa42c011c50 con 0x7fa410004b20 2020-04-22T14:10:28.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.787+0000 7fa43631f700 1 --2- 172.21.15.103:0/1142275418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa410004b20 0x7fa410004f20 secure :-1 s=THROTTLE_DONE pgs=756 cs=0 l=1 rx=0x7fa42c0013e0 tx=0x7fa43005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:28.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.787+0000 7fa4237fe700 1 --2- 172.21.15.103:0/1142275418 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa4100563b0 0x7fa410058870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:28.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.787+0000 7fa4237fe700 1 -- 172.21.15.103:0/1142275418 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fa42c060ed0 con 0x7fa410004b20 2020-04-22T14:10:28.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.787+0000 7fa435b1e700 1 --2- 172.21.15.103:0/1142275418 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa4100563b0 0x7fa410058870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:28.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.787+0000 7fa435b1e700 1 --2- 172.21.15.103:0/1142275418 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa4100563b0 0x7fa410058870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa424007fa0 tx=0x7fa424001c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:28.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.787+0000 7fa435b1e700 1 --2- 172.21.15.103:0/1142275418 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa4100563b0 0x7fa410058870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa424007fa0 tx=0x7fa424001c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:28.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.787+0000 7fa435b1e700 1 --2- 172.21.15.103:0/1142275418 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa4100563b0 0x7fa410058870 secure :-1 s=READY pgs=286 cs=0 l=1 rx=0x7fa424007fa0 tx=0x7fa424001c00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:28.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.791+0000 7fa43631f700 1 --2- 172.21.15.103:0/1142275418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa410004b20 0x7fa410004f20 secure :-1 s=THROTTLE_DONE pgs=756 cs=0 l=1 rx=0x7fa42c0013e0 tx=0x7fa43005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:28.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.791+0000 7fa4237fe700 1 -- 172.21.15.103:0/1142275418 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fa42c03c310 con 0x7fa410004b20 2020-04-22T14:10:28.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.933+0000 7fa438583700 1 -- 172.21.15.103:0/1142275418 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa430056c90 con 0x7fa410004b20 2020-04-22T14:10:28.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.934+0000 7fa43631f700 1 --2- 172.21.15.103:0/1142275418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa410004b20 0x7fa410004f20 secure :-1 s=THROTTLE_DONE pgs=756 cs=0 l=1 rx=0x7fa42c0013e0 tx=0x7fa43005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:28.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.934+0000 7fa4237fe700 1 -- 172.21.15.103:0/1142275418 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v55) v1 ==== 81+0+33772 (secure 0 0 0) 0x7fa42c03f930 con 0x7fa410004b20 2020-04-22T14:10:28.938 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:10:28.938 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:10:28.938 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 55, 2020-04-22T14:10:28.938 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:10:28.938 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2020-04-22T14:02:06.484738+0000", 2020-04-22T14:10:28.938 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2020-04-22T14:09:45.536874+0000", 2020-04-22T14:10:28.938 INFO:teuthology.orchestra.run.smithi103.stdout: "last_up_change": "2020-04-22T14:02:18.623774+0000", 2020-04-22T14:10:28.939 INFO:teuthology.orchestra.run.smithi103.stdout: "last_in_change": "2020-04-22T14:02:18.623774+0000", 2020-04-22T14:10:28.939 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-04-22T14:10:28.939 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_num": 5799936, 2020-04-22T14:10:28.939 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_set": [ 2020-04-22T14:10:28.939 INFO:teuthology.orchestra.run.smithi103.stdout: "pglog_hardlimit", 2020-04-22T14:10:28.939 INFO:teuthology.orchestra.run.smithi103.stdout: "purged_snapdirs", 2020-04-22T14:10:28.939 INFO:teuthology.orchestra.run.smithi103.stdout: "recovery_deletes", 2020-04-22T14:10:28.940 INFO:teuthology.orchestra.run.smithi103.stdout: "sortbitwise" 2020-04-22T14:10:28.940 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:10:28.940 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_version": 5, 2020-04-22T14:10:28.940 INFO:teuthology.orchestra.run.smithi103.stdout: "full_ratio": 0.94999998807907104, 2020-04-22T14:10:28.940 INFO:teuthology.orchestra.run.smithi103.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-04-22T14:10:28.940 INFO:teuthology.orchestra.run.smithi103.stdout: "nearfull_ratio": 0.85000002384185791, 2020-04-22T14:10:28.940 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_snapshot": "", 2020-04-22T14:10:28.940 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_max": 10, 2020-04-22T14:10:28.941 INFO:teuthology.orchestra.run.smithi103.stdout: "max_osd": 8, 2020-04-22T14:10:28.941 INFO:teuthology.orchestra.run.smithi103.stdout: "require_min_compat_client": "luminous", 2020-04-22T14:10:28.941 INFO:teuthology.orchestra.run.smithi103.stdout: "min_compat_client": "jewel", 2020-04-22T14:10:28.941 INFO:teuthology.orchestra.run.smithi103.stdout: "require_osd_release": "pacific", 2020-04-22T14:10:28.941 INFO:teuthology.orchestra.run.smithi103.stdout: "pools": [ 2020-04-22T14:10:28.941 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:28.941 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 1, 2020-04-22T14:10:28.942 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "device_health_metrics", 2020-04-22T14:10:28.942 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:02:09.565655+0000", 2020-04-22T14:10:28.942 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:10:28.942 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:10:28.942 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:10:28.942 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:10:28.942 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:10:28.942 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:10:28.943 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:10:28.943 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:10:28.943 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 1, 2020-04-22T14:10:28.943 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 1, 2020-04-22T14:10:28.943 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 1, 2020-04-22T14:10:28.943 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 1, 2020-04-22T14:10:28.943 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 1, 2020-04-22T14:10:28.943 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:10:28.944 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:10:28.944 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:10:28.944 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:10:28.944 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:10:28.944 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:10:28.944 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:10:28.944 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:28.945 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "17", 2020-04-22T14:10:28.945 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:10:28.945 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:10:28.945 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:10:28.945 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:10:28.945 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:10:28.945 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:10:28.946 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:10:28.946 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:10:28.946 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:10:28.946 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:10:28.946 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:10:28.946 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:10:28.947 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:10:28.947 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:10:28.947 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:10:28.947 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:10:28.947 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:10:28.947 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:10:28.948 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:10:28.948 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:10:28.948 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:10:28.948 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:10:28.948 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:10:28.948 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:10:28.948 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:10:28.949 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:10:28.949 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:28.949 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:10:28.949 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:10:28.949 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:10:28.949 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:10:28.949 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:10:28.949 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:10:28.950 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:10:28.950 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:10:28.950 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:10:28.950 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:10:28.950 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:10:28.950 INFO:teuthology.orchestra.run.smithi103.stdout: "options": { 2020-04-22T14:10:28.950 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_min": 1 2020-04-22T14:10:28.951 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:28.951 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:10:28.951 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_devicehealth": {} 2020-04-22T14:10:28.951 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:28.951 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:28.951 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:28.951 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 2, 2020-04-22T14:10:28.951 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "rbd", 2020-04-22T14:10:28.952 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:02:22.733031+0000", 2020-04-22T14:10:28.952 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:10:28.952 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:10:28.952 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:10:28.952 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:10:28.952 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:10:28.952 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:10:28.953 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:10:28.953 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:10:28.953 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 8, 2020-04-22T14:10:28.953 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 8, 2020-04-22T14:10:28.953 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 8, 2020-04-22T14:10:28.953 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 8, 2020-04-22T14:10:28.953 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 8, 2020-04-22T14:10:28.953 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:10:28.954 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:10:28.954 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:10:28.954 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:10:28.954 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:10:28.954 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:10:28.954 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:10:28.954 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:28.954 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "20", 2020-04-22T14:10:28.955 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:10:28.955 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:10:28.955 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:10:28.955 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:10:28.955 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:10:28.955 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:10:28.955 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:10:28.956 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:10:28.956 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:10:28.956 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:10:28.956 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:10:28.956 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:10:28.956 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:10:28.957 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:10:28.957 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:10:28.957 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:10:28.957 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:10:28.957 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:10:28.957 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:10:28.957 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:10:28.957 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:10:28.958 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:10:28.958 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:10:28.958 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:10:28.958 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:10:28.958 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:10:28.958 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:28.958 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:10:28.958 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:10:28.959 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:10:28.959 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:10:28.959 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:10:28.959 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:10:28.959 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:10:28.959 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:10:28.959 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:10:28.960 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:10:28.960 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:10:28.960 INFO:teuthology.orchestra.run.smithi103.stdout: "options": {}, 2020-04-22T14:10:28.960 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:10:28.960 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd": {} 2020-04-22T14:10:28.960 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:28.960 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:28.961 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:28.961 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 9, 2020-04-22T14:10:28.961 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "cephfs_metadata", 2020-04-22T14:10:28.961 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:07:27.809363+0000", 2020-04-22T14:10:28.961 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:10:28.961 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:10:28.961 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:10:28.962 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:10:28.962 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:10:28.962 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:10:28.962 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:10:28.962 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:10:28.962 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 8, 2020-04-22T14:10:28.962 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 8, 2020-04-22T14:10:28.963 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 8, 2020-04-22T14:10:28.963 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 8, 2020-04-22T14:10:28.963 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 8, 2020-04-22T14:10:28.963 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:10:28.963 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:10:28.963 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:10:28.963 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:10:28.963 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:10:28.964 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:10:28.964 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:10:28.964 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:28.964 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "53", 2020-04-22T14:10:28.964 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:10:28.964 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:10:28.964 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:10:28.965 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:10:28.965 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:10:28.965 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:10:28.965 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:10:28.977 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:10:28.977 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:10:28.977 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:10:28.977 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:10:28.977 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:10:28.977 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:10:28.978 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:10:28.978 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:10:28.978 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:10:28.978 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:10:28.978 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:10:28.978 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:10:28.978 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:10:28.979 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:10:28.979 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:10:28.979 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:10:28.979 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:10:28.979 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:10:28.979 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:10:28.979 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:28.979 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:10:28.980 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:10:28.980 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:10:28.980 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:10:28.980 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:10:28.980 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:10:28.980 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:10:28.980 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:10:28.981 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:10:28.981 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:10:28.981 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:10:28.981 INFO:teuthology.orchestra.run.smithi103.stdout: "options": { 2020-04-22T14:10:28.981 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_bias": 4, 2020-04-22T14:10:29.004 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_min": 16, 2020-04-22T14:10:29.004 INFO:teuthology.orchestra.run.smithi103.stdout: "recovery_priority": 5 2020-04-22T14:10:29.004 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.004 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:10:29.004 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs": { 2020-04-22T14:10:29.004 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": "cephfs" 2020-04-22T14:10:29.004 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:29.005 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:29.005 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.005 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.005 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 10, 2020-04-22T14:10:29.005 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "cephfs_data", 2020-04-22T14:10:29.005 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:07:28.880202+0000", 2020-04-22T14:10:29.006 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:10:29.006 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:10:29.006 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:10:29.006 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:10:29.006 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:10:29.006 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:10:29.006 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:10:29.007 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:10:29.007 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 8, 2020-04-22T14:10:29.007 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 8, 2020-04-22T14:10:29.007 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 8, 2020-04-22T14:10:29.007 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 8, 2020-04-22T14:10:29.007 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 8, 2020-04-22T14:10:29.007 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:10:29.007 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:10:29.008 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:10:29.008 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:10:29.008 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:10:29.008 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:10:29.008 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:10:29.008 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.008 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "54", 2020-04-22T14:10:29.009 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:10:29.009 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:10:29.009 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:10:29.009 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:10:29.009 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:10:29.009 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:10:29.009 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:10:29.009 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:10:29.010 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:10:29.010 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:10:29.010 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:10:29.010 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:10:29.010 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:10:29.010 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:10:29.010 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:10:29.011 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:10:29.011 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:10:29.011 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:10:29.011 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:10:29.011 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:10:29.011 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:10:29.011 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:10:29.012 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:10:29.012 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:10:29.012 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:10:29.012 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:10:29.012 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.012 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:10:29.012 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:10:29.012 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:10:29.013 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:10:29.013 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:10:29.013 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:10:29.013 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:10:29.013 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:10:29.013 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:10:29.013 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:10:29.013 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:10:29.014 INFO:teuthology.orchestra.run.smithi103.stdout: "options": {}, 2020-04-22T14:10:29.014 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:10:29.014 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs": { 2020-04-22T14:10:29.014 INFO:teuthology.orchestra.run.smithi103.stdout: "data": "cephfs" 2020-04-22T14:10:29.014 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:29.014 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:29.014 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:29.015 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:10:29.015 INFO:teuthology.orchestra.run.smithi103.stdout: "osds": [ 2020-04-22T14:10:29.015 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.015 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 0, 2020-04-22T14:10:29.015 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "3546145b-bd93-4a79-b6fe-3158153b8f05", 2020-04-22T14:10:29.015 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:10:29.015 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:10:29.015 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:10:29.016 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:10:29.016 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:10:29.016 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:10:29.016 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:10:29.016 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 52, 2020-04-22T14:10:29.016 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:10:29.016 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:10:29.017 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:10:29.017 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:10:29.017 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.017 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:10:29.017 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6800", 2020-04-22T14:10:29.017 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:10:29.017 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.018 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.018 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:10:29.018 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6801", 2020-04-22T14:10:29.018 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:10:29.018 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:29.018 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:10:29.018 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.019 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:10:29.019 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:10:29.019 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.019 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:10:29.019 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6802", 2020-04-22T14:10:29.019 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:10:29.019 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.020 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.020 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:10:29.020 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6803", 2020-04-22T14:10:29.020 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:10:29.020 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:29.020 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:10:29.020 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.020 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:10:29.021 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:10:29.021 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.021 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:10:29.021 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6806", 2020-04-22T14:10:29.021 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:10:29.021 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.021 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.021 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:10:29.022 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6807", 2020-04-22T14:10:29.022 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:10:29.022 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:29.022 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:10:29.022 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.022 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:10:29.022 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:10:29.023 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.023 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:10:29.023 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6804", 2020-04-22T14:10:29.023 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:10:29.023 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.023 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.023 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:10:29.023 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6805", 2020-04-22T14:10:29.024 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:10:29.024 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:29.024 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:10:29.024 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.024 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6801/33072", 2020-04-22T14:10:29.024 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6803/33072", 2020-04-22T14:10:29.024 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6807/33072", 2020-04-22T14:10:29.025 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6805/33072", 2020-04-22T14:10:29.025 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:10:29.025 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:10:29.025 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:10:29.025 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:10:29.025 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.025 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.025 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 1, 2020-04-22T14:10:29.026 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "65ca5f7d-2ea6-4de6-a034-08a0a99aa80d", 2020-04-22T14:10:29.026 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:10:29.026 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:10:29.026 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:10:29.026 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:10:29.027 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:10:29.027 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:10:29.027 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:10:29.027 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 52, 2020-04-22T14:10:29.027 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:10:29.028 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:10:29.028 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:10:29.028 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:10:29.028 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.028 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:10:29.028 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6808", 2020-04-22T14:10:29.028 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:10:29.029 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.029 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.029 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:10:29.029 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6809", 2020-04-22T14:10:29.029 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:10:29.029 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:29.029 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:10:29.030 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.030 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:10:29.030 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:10:29.030 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.030 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:10:29.030 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6810", 2020-04-22T14:10:29.030 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:10:29.030 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.031 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.031 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:10:29.031 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6811", 2020-04-22T14:10:29.031 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:10:29.031 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:29.031 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:10:29.031 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.031 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:10:29.032 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:10:29.032 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.032 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:10:29.032 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6814", 2020-04-22T14:10:29.032 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:10:29.032 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.032 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.033 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:10:29.033 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6815", 2020-04-22T14:10:29.033 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:10:29.033 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:29.033 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:10:29.033 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.033 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:10:29.033 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:10:29.034 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.034 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:10:29.034 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6812", 2020-04-22T14:10:29.034 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:10:29.034 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.034 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.034 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:10:29.035 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6813", 2020-04-22T14:10:29.035 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:10:29.035 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:29.035 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:10:29.035 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.035 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6809/33103", 2020-04-22T14:10:29.035 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6811/33103", 2020-04-22T14:10:29.035 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6815/33103", 2020-04-22T14:10:29.036 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6813/33103", 2020-04-22T14:10:29.036 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:10:29.036 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:10:29.036 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:10:29.036 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:10:29.036 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.036 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.037 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 2, 2020-04-22T14:10:29.037 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "f2e9bf44-c844-48d7-b6c2-f08ea71189b4", 2020-04-22T14:10:29.037 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:10:29.037 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:10:29.037 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:10:29.037 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:10:29.037 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:10:29.037 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:10:29.038 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:10:29.038 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 52, 2020-04-22T14:10:29.038 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:10:29.038 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:10:29.038 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:10:29.038 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:10:29.038 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.038 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:10:29.039 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6816", 2020-04-22T14:10:29.039 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:10:29.039 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.039 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.039 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:10:29.039 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6817", 2020-04-22T14:10:29.039 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:10:29.040 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:29.040 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:10:29.040 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.040 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:10:29.040 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:10:29.040 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.040 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:10:29.041 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6818", 2020-04-22T14:10:29.041 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:10:29.041 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.041 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.041 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:10:29.041 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6819", 2020-04-22T14:10:29.041 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:10:29.041 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:29.042 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:10:29.042 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.042 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:10:29.042 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:10:29.042 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.042 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:10:29.042 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6822", 2020-04-22T14:10:29.043 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:10:29.043 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.043 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.043 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:10:29.043 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6823", 2020-04-22T14:10:29.043 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:10:29.043 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:29.043 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:10:29.044 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.044 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:10:29.044 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:10:29.044 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.044 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:10:29.044 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6820", 2020-04-22T14:10:29.044 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:10:29.045 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.045 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.045 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:10:29.045 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6821", 2020-04-22T14:10:29.045 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:10:29.045 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:29.045 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:10:29.045 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.046 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6817/33153", 2020-04-22T14:10:29.046 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6819/33153", 2020-04-22T14:10:29.046 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6823/33153", 2020-04-22T14:10:29.046 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6821/33153", 2020-04-22T14:10:29.046 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:10:29.046 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:10:29.046 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:10:29.047 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:10:29.047 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.047 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.047 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 3, 2020-04-22T14:10:29.047 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "0ab87fee-a427-4906-851a-b9bd8c2e5645", 2020-04-22T14:10:29.047 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:10:29.047 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:10:29.048 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:10:29.048 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:10:29.048 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:10:29.048 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:10:29.048 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:10:29.049 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 50, 2020-04-22T14:10:29.049 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:10:29.049 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:10:29.049 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:10:29.049 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:10:29.049 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.049 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:10:29.049 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6824", 2020-04-22T14:10:29.050 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:10:29.050 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.050 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.050 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:10:29.050 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6825", 2020-04-22T14:10:29.050 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:10:29.050 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:29.050 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:10:29.051 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.051 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:10:29.051 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:10:29.051 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.051 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:10:29.051 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6826", 2020-04-22T14:10:29.051 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:10:29.052 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.052 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.052 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:10:29.052 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6827", 2020-04-22T14:10:29.052 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:10:29.052 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:29.052 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:10:29.052 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.053 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:10:29.053 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:10:29.053 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.053 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:10:29.053 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6830", 2020-04-22T14:10:29.053 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:10:29.053 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.054 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.054 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:10:29.054 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6831", 2020-04-22T14:10:29.054 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:10:29.054 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:29.054 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:10:29.054 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.054 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:10:29.055 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:10:29.055 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.055 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:10:29.055 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6828", 2020-04-22T14:10:29.055 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:10:29.055 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.055 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.056 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:10:29.056 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6829", 2020-04-22T14:10:29.056 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:10:29.056 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:29.056 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:10:29.056 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.057 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6825/33183", 2020-04-22T14:10:29.057 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6827/33183", 2020-04-22T14:10:29.057 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6831/33183", 2020-04-22T14:10:29.057 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6829/33183", 2020-04-22T14:10:29.057 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:10:29.057 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:10:29.057 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:10:29.057 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:10:29.058 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.058 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.058 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 4, 2020-04-22T14:10:29.058 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "2565df7d-2eff-484b-a3cd-ed7715e5d875", 2020-04-22T14:10:29.058 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:10:29.058 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:10:29.058 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:10:29.059 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:10:29.059 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:10:29.059 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:10:29.059 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:10:29.059 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 52, 2020-04-22T14:10:29.059 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:10:29.059 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:10:29.059 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:10:29.060 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:10:29.060 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.060 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:10:29.060 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6802", 2020-04-22T14:10:29.060 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:10:29.060 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.060 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.060 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:10:29.061 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6803", 2020-04-22T14:10:29.061 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:10:29.061 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:29.061 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:10:29.061 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.061 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:10:29.061 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:10:29.062 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.062 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:10:29.062 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6804", 2020-04-22T14:10:29.062 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:10:29.062 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.062 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.062 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:10:29.062 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6805", 2020-04-22T14:10:29.063 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:10:29.063 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:29.063 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:10:29.063 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.063 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:10:29.063 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:10:29.063 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.064 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:10:29.064 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6808", 2020-04-22T14:10:29.064 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:10:29.064 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.064 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.064 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:10:29.064 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6809", 2020-04-22T14:10:29.064 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:10:29.065 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:29.065 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:10:29.065 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.065 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:10:29.065 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:10:29.065 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.065 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:10:29.065 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6806", 2020-04-22T14:10:29.066 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:10:29.066 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.066 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.066 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:10:29.066 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6807", 2020-04-22T14:10:29.066 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:10:29.066 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:29.067 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:10:29.067 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.067 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6803/33506", 2020-04-22T14:10:29.067 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6805/33506", 2020-04-22T14:10:29.067 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6809/33506", 2020-04-22T14:10:29.067 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6807/33506", 2020-04-22T14:10:29.067 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:10:29.067 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:10:29.068 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:10:29.068 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:10:29.068 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.068 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.068 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 5, 2020-04-22T14:10:29.068 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "bcfd7a16-6914-4152-8647-a481917fe19d", 2020-04-22T14:10:29.068 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:10:29.069 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:10:29.069 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:10:29.069 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:10:29.069 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:10:29.069 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:10:29.069 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:10:29.069 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 52, 2020-04-22T14:10:29.069 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:10:29.070 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:10:29.070 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:10:29.070 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:10:29.070 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.070 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:10:29.070 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6810", 2020-04-22T14:10:29.070 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:10:29.070 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.071 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.071 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:10:29.071 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6811", 2020-04-22T14:10:29.071 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:10:29.071 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:29.071 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:10:29.071 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.071 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:10:29.072 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:10:29.072 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.072 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:10:29.072 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6812", 2020-04-22T14:10:29.072 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:10:29.072 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.072 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.073 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:10:29.073 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6813", 2020-04-22T14:10:29.073 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:10:29.073 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:29.073 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:10:29.073 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.073 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:10:29.073 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:10:29.074 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.074 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:10:29.074 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6816", 2020-04-22T14:10:29.074 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:10:29.074 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.074 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.075 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:10:29.075 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6817", 2020-04-22T14:10:29.075 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:10:29.075 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:29.075 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:10:29.075 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.075 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:10:29.076 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:10:29.076 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.076 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:10:29.076 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6814", 2020-04-22T14:10:29.076 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:10:29.077 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.077 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.078 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:10:29.078 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6815", 2020-04-22T14:10:29.078 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:10:29.078 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:29.078 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:10:29.078 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.078 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6811/33554", 2020-04-22T14:10:29.079 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6813/33554", 2020-04-22T14:10:29.079 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6817/33554", 2020-04-22T14:10:29.079 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6815/33554", 2020-04-22T14:10:29.079 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:10:29.079 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:10:29.079 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:10:29.079 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:10:29.080 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.080 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.080 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 6, 2020-04-22T14:10:29.080 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050", 2020-04-22T14:10:29.080 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:10:29.080 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:10:29.080 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:10:29.082 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:10:29.082 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:10:29.082 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:10:29.082 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:10:29.082 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 52, 2020-04-22T14:10:29.082 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:10:29.083 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:10:29.083 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:10:29.083 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:10:29.083 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.083 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:10:29.083 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6818", 2020-04-22T14:10:29.083 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:10:29.084 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.084 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.084 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:10:29.084 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6819", 2020-04-22T14:10:29.084 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:10:29.085 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:29.085 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:10:29.085 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.085 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:10:29.085 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:10:29.085 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.085 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:10:29.086 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6820", 2020-04-22T14:10:29.086 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:10:29.086 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.086 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.086 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:10:29.086 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6821", 2020-04-22T14:10:29.086 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:10:29.087 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:29.087 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:10:29.087 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.087 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:10:29.087 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:10:29.087 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.087 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:10:29.087 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6824", 2020-04-22T14:10:29.088 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:10:29.088 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.088 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.088 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:10:29.089 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6825", 2020-04-22T14:10:29.089 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:10:29.089 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:29.089 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:10:29.089 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.089 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:10:29.090 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:10:29.090 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.090 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:10:29.090 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6822", 2020-04-22T14:10:29.090 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:10:29.090 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.090 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.090 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:10:29.091 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6823", 2020-04-22T14:10:29.091 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:10:29.091 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:29.091 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:10:29.091 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.091 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6819/33601", 2020-04-22T14:10:29.091 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6821/33601", 2020-04-22T14:10:29.092 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6825/33601", 2020-04-22T14:10:29.092 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6823/33601", 2020-04-22T14:10:29.092 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:10:29.092 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:10:29.092 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:10:29.092 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:10:29.092 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.093 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.093 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 7, 2020-04-22T14:10:29.093 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "340eece1-4c39-47cd-b95f-9cfa5dcfe361", 2020-04-22T14:10:29.093 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:10:29.093 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:10:29.093 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:10:29.094 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:10:29.094 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:10:29.094 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:10:29.094 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:10:29.094 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 50, 2020-04-22T14:10:29.094 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:10:29.094 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:10:29.095 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:10:29.095 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:10:29.095 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.095 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:10:29.095 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6826", 2020-04-22T14:10:29.095 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:10:29.095 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.095 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.096 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:10:29.096 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6827", 2020-04-22T14:10:29.096 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:10:29.096 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:29.096 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:10:29.096 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.096 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:10:29.097 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:10:29.097 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.097 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:10:29.097 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6828", 2020-04-22T14:10:29.097 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:10:29.097 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.097 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.098 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:10:29.098 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6829", 2020-04-22T14:10:29.098 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:10:29.098 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:29.098 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:10:29.098 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.099 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:10:29.099 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:10:29.099 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.099 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:10:29.099 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6832", 2020-04-22T14:10:29.099 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:10:29.099 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.100 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.100 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:10:29.100 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6833", 2020-04-22T14:10:29.100 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:10:29.100 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:29.100 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:10:29.100 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.101 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:10:29.101 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:10:29.101 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.101 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:10:29.101 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6830", 2020-04-22T14:10:29.101 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:10:29.101 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.102 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.102 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:10:29.102 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6831", 2020-04-22T14:10:29.102 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:10:29.102 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:29.102 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:10:29.102 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.102 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6827/33629", 2020-04-22T14:10:29.103 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6829/33629", 2020-04-22T14:10:29.103 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6833/33629", 2020-04-22T14:10:29.103 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6831/33629", 2020-04-22T14:10:29.103 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:10:29.103 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:10:29.103 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:10:29.103 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:10:29.104 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:29.104 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:10:29.104 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_xinfo": [ 2020-04-22T14:10:29.104 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.104 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 0, 2020-04-22T14:10:29.104 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:10:29.104 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:10:29.105 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:10:29.105 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:10:29.105 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:10:29.105 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.384360+0000", 2020-04-22T14:10:29.105 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:10:29.105 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.105 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.106 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 1, 2020-04-22T14:10:29.106 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:10:29.106 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:10:29.106 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:10:29.106 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:10:29.106 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:10:29.106 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.503590+0000", 2020-04-22T14:10:29.107 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:10:29.107 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.107 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.107 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 2, 2020-04-22T14:10:29.107 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:10:29.107 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:10:29.107 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:10:29.108 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:10:29.108 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:10:29.108 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.525058+0000", 2020-04-22T14:10:29.108 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:10:29.108 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.109 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.109 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 3, 2020-04-22T14:10:29.109 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:10:29.109 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:10:29.110 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:10:29.110 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:10:29.110 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:10:29.110 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.599729+0000", 2020-04-22T14:10:29.110 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:10:29.110 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.110 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.111 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 4, 2020-04-22T14:10:29.111 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:10:29.111 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:10:29.111 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:10:29.111 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:10:29.111 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:10:29.111 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.600919+0000", 2020-04-22T14:10:29.111 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:10:29.112 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.112 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.112 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 5, 2020-04-22T14:10:29.112 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:10:29.112 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:10:29.112 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:10:29.112 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:10:29.113 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:10:29.113 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.654718+0000", 2020-04-22T14:10:29.113 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:10:29.113 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.113 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.113 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 6, 2020-04-22T14:10:29.113 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:10:29.113 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:10:29.114 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:10:29.114 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:10:29.114 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:10:29.114 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.718342+0000", 2020-04-22T14:10:29.114 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:10:29.114 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.114 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:29.115 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 7, 2020-04-22T14:10:29.115 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:10:29.115 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:10:29.115 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:10:29.115 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:10:29.116 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:10:29.116 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.839089+0000", 2020-04-22T14:10:29.116 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:10:29.116 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:29.116 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:10:29.116 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_upmap": [], 2020-04-22T14:10:29.117 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_upmap_items": [], 2020-04-22T14:10:29.117 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_temp": [], 2020-04-22T14:10:29.117 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_temp": [], 2020-04-22T14:10:29.117 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklist": { 2020-04-22T14:10:29.117 INFO:teuthology.orchestra.run.smithi103.stdout: "192.168.0.1:0/322128533": "2020-04-22T15:09:44.710719+0000" 2020-04-22T14:10:29.117 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.117 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profiles": { 2020-04-22T14:10:29.118 INFO:teuthology.orchestra.run.smithi103.stdout: "default": { 2020-04-22T14:10:29.118 INFO:teuthology.orchestra.run.smithi103.stdout: "crush-failure-domain": "osd", 2020-04-22T14:10:29.118 INFO:teuthology.orchestra.run.smithi103.stdout: "k": "2", 2020-04-22T14:10:29.118 INFO:teuthology.orchestra.run.smithi103.stdout: "m": "1", 2020-04-22T14:10:29.118 INFO:teuthology.orchestra.run.smithi103.stdout: "plugin": "jerasure", 2020-04-22T14:10:29.118 INFO:teuthology.orchestra.run.smithi103.stdout: "ruleset-failure-domain": "osd", 2020-04-22T14:10:29.118 INFO:teuthology.orchestra.run.smithi103.stdout: "technique": "reed_sol_van" 2020-04-22T14:10:29.118 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:29.119 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:29.119 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps_queue": [], 2020-04-22T14:10:29.119 INFO:teuthology.orchestra.run.smithi103.stdout: "new_removed_snaps": [], 2020-04-22T14:10:29.119 INFO:teuthology.orchestra.run.smithi103.stdout: "new_purged_snaps": [], 2020-04-22T14:10:29.119 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_node_flags": {}, 2020-04-22T14:10:29.119 INFO:teuthology.orchestra.run.smithi103.stdout: "device_class_flags": {} 2020-04-22T14:10:29.119 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:10:29.121 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.935+0000 7fa438583700 1 -- 172.21.15.103:0/1142275418 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa4100563b0 msgr2=0x7fa410058870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:29.121 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.935+0000 7fa438583700 1 --2- 172.21.15.103:0/1142275418 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa4100563b0 0x7fa410058870 secure :-1 s=READY pgs=286 cs=0 l=1 rx=0x7fa424007fa0 tx=0x7fa424001c00).stop 2020-04-22T14:10:29.121 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.935+0000 7fa438583700 1 -- 172.21.15.103:0/1142275418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa410004b20 msgr2=0x7fa410004f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:29.121 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.935+0000 7fa438583700 1 --2- 172.21.15.103:0/1142275418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa410004b20 0x7fa410004f20 secure :-1 s=READY pgs=756 cs=0 l=1 rx=0x7fa42c0013e0 tx=0x7fa43005bce0).stop 2020-04-22T14:10:29.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.935+0000 7fa436b20700 1 -- 172.21.15.103:0/1142275418 reap_dead start 2020-04-22T14:10:29.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.935+0000 7fa436b20700 1 -- 172.21.15.103:0/1142275418 reap_dead start 2020-04-22T14:10:29.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.935+0000 7fa438583700 1 -- 172.21.15.103:0/1142275418 shutdown_connections 2020-04-22T14:10:29.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.935+0000 7fa438583700 1 -- 172.21.15.103:0/1142275418 >> 172.21.15.103:0/1142275418 conn(0x7fa4300b9160 msgr2=0x7fa43005b040 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:29.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.935+0000 7fa438583700 1 -- 172.21.15.103:0/1142275418 shutdown_connections 2020-04-22T14:10:29.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:28.935+0000 7fa438583700 1 -- 172.21.15.103:0/1142275418 wait complete. 2020-04-22T14:10:29.124 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:29.137 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:10:29.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.280+0000 7f6efe41a700 1 Processor -- start 2020-04-22T14:10:29.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.280+0000 7f6efe41a700 1 -- start start 2020-04-22T14:10:29.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.280+0000 7f6efe41a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ef80ad150 0x7f6ef80664a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:29.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.280+0000 7f6efe41a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6ef8141c10 0x7f6ef8142070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:29.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.281+0000 7f6efe41a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ef8066a20 con 0x7f6ef81424d0 2020-04-22T14:10:29.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.281+0000 7f6efe41a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ef80adf30 con 0x7f6ef8141c10 2020-04-22T14:10:29.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.281+0000 7f6efe41a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef8062430 con 0x7f6ef80ad150 2020-04-22T14:10:29.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.281+0000 7f6efd418700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ef80ad150 0x7f6ef80664a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:29.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.281+0000 7f6efcc17700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6ef8141c10 0x7f6ef8142070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:29.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.281+0000 7f6efcc17700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6ef8141c10 0x7f6ef8142070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:48162/0 (socket says 172.21.15.103:48162) 2020-04-22T14:10:29.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.281+0000 7f6efd418700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ef80ad150 0x7f6ef80664a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:35708/0 (socket says 172.21.15.103:35708) 2020-04-22T14:10:29.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.281+0000 7f6efcc17700 1 -- 172.21.15.103:0/2570742362 learned_addr learned my addr 172.21.15.103:0/2570742362 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:10:29.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.281+0000 7f6efdc19700 1 --1- 172.21.15.103:0/2570742362 >> v1:172.21.15.86:6789/0 conn(0x7f6ef81424d0 0x7f6ef8061d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:60276/0 (socket says 172.21.15.103:60276) 2020-04-22T14:10:29.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.281+0000 7f6efcc17700 1 -- 172.21.15.103:0/2570742362 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ef80ad150 msgr2=0x7f6ef80664a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:29.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.281+0000 7f6efcc17700 1 --2- 172.21.15.103:0/2570742362 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ef80ad150 0x7f6ef80664a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:29.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.281+0000 7f6efcc17700 1 -- 172.21.15.103:0/2570742362 >> v1:172.21.15.86:6789/0 conn(0x7f6ef81424d0 legacy=0x7f6ef8061d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:29.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.281+0000 7f6efcc17700 1 -- 172.21.15.103:0/2570742362 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef80ad7f0 con 0x7f6ef8141c10 2020-04-22T14:10:29.297 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.281+0000 7f6ee7fff700 1 -- 172.21.15.103:0/2570742362 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3379201934 0 0) 0x7f6ef8066a20 con 0x7f6ef81424d0 2020-04-22T14:10:29.297 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.281+0000 7f6efcc17700 1 --2- 172.21.15.103:0/2570742362 >> v2:172.21.15.86:3300/0 conn(0x7f6ef8141c10 0x7f6ef8142070 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6ee8002f30 tx=0x7f6ee8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:29.297 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.281+0000 7f6efcc17700 1 --2- 172.21.15.103:0/2570742362 >> v2:172.21.15.86:3300/0 conn(0x7f6ef8141c10 0x7f6ef8142070 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6ee8002f30 tx=0x7f6ee8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:29.297 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.281+0000 7f6efcc17700 1 --2- 172.21.15.103:0/2570742362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ef8141c10 0x7f6ef8142070 secure :-1 s=READY pgs=423 cs=0 l=1 rx=0x7f6ee8002f30 tx=0x7f6ee8007a40).ready entity=mon.0 client_cookie=41387aea413a8f23 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:29.297 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.281+0000 7f6efcc17700 1 --2- 172.21.15.103:0/2570742362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ef8141c10 0x7f6ef8142070 secure :-1 s=THROTTLE_DONE pgs=423 cs=0 l=1 rx=0x7f6ee8002f30 tx=0x7f6ee8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:29.297 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.281+0000 7f6ee7fff700 1 -- 172.21.15.103:0/2570742362 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ee8011670 con 0x7f6ef8141c10 2020-04-22T14:10:29.297 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.282+0000 7f6efcc17700 1 --2- 172.21.15.103:0/2570742362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ef8141c10 0x7f6ef8142070 secure :-1 s=THROTTLE_DONE pgs=423 cs=0 l=1 rx=0x7f6ee8002f30 tx=0x7f6ee8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:29.298 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.282+0000 7f6efcc17700 1 --2- 172.21.15.103:0/2570742362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ef8141c10 0x7f6ef8142070 secure :-1 s=THROTTLE_DONE pgs=423 cs=0 l=1 rx=0x7f6ee8002f30 tx=0x7f6ee8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:29.298 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.282+0000 7f6ee7fff700 1 -- 172.21.15.103:0/2570742362 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee8011810 con 0x7f6ef8141c10 2020-04-22T14:10:29.298 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.282+0000 7f6ee7fff700 1 -- 172.21.15.103:0/2570742362 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ee8011bf0 con 0x7f6ef8141c10 2020-04-22T14:10:29.298 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.282+0000 7f6efe41a700 1 -- 172.21.15.103:0/2570742362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ef8141c10 msgr2=0x7f6ef8142070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:29.298 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.282+0000 7f6efe41a700 1 --2- 172.21.15.103:0/2570742362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ef8141c10 0x7f6ef8142070 secure :-1 s=READY pgs=423 cs=0 l=1 rx=0x7f6ee8002f30 tx=0x7f6ee8007a40).stop 2020-04-22T14:10:29.298 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.282+0000 7f6efe41a700 1 -- 172.21.15.103:0/2570742362 shutdown_connections 2020-04-22T14:10:29.298 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.282+0000 7f6efe41a700 1 --2- 172.21.15.103:0/2570742362 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ef80ad150 0x7f6ef80664a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:29.298 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.282+0000 7f6efe41a700 1 --2- 172.21.15.103:0/2570742362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ef8141c10 0x7f6ef8142070 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:29.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.282+0000 7f6efe41a700 1 -- 172.21.15.103:0/2570742362 >> 172.21.15.103:0/2570742362 conn(0x7f6ef805b7c0 msgr2=0x7f6ef8061610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:29.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.282+0000 7f6efe41a700 1 -- 172.21.15.103:0/2570742362 shutdown_connections 2020-04-22T14:10:29.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.282+0000 7f6efe41a700 1 -- 172.21.15.103:0/2570742362 wait complete. 2020-04-22T14:10:29.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.283+0000 7f6efe41a700 1 Processor -- start 2020-04-22T14:10:29.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.283+0000 7f6efe41a700 1 -- start start 2020-04-22T14:10:29.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.284+0000 7f6efe41a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ef8141c10 0x7f6ef81475e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:29.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.284+0000 7f6efe41a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6ef81424d0 0x7f6ef8146880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:29.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.284+0000 7f6efe41a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ef8154a20 con 0x7f6ef80ad150 2020-04-22T14:10:29.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.284+0000 7f6efe41a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ef8154c50 con 0x7f6ef81424d0 2020-04-22T14:10:29.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.284+0000 7f6efe41a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef8155800 con 0x7f6ef8141c10 2020-04-22T14:10:29.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.284+0000 7f6efdc19700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6ef81424d0 0x7f6ef8146880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:29.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.284+0000 7f6efdc19700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6ef81424d0 0x7f6ef8146880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50938/0 (socket says 172.21.15.103:50938) 2020-04-22T14:10:29.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.284+0000 7f6efdc19700 1 -- 172.21.15.103:0/3119466489 learned_addr learned my addr 172.21.15.103:0/3119466489 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:10:29.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.284+0000 7f6efcc17700 1 --2- 172.21.15.103:0/3119466489 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ef8141c10 0x7f6ef81475e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:29.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.284+0000 7f6efdc19700 1 -- 172.21.15.103:0/3119466489 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ef8141c10 msgr2=0x7f6ef81475e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:29.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.284+0000 7f6efdc19700 1 --2- 172.21.15.103:0/3119466489 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ef8141c10 0x7f6ef81475e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:29.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.284+0000 7f6efdc19700 1 -- 172.21.15.103:0/3119466489 >> v1:172.21.15.86:6789/0 conn(0x7f6ef80ad150 legacy=0x7f6ef81550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:29.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.284+0000 7f6ee67fc700 1 -- 172.21.15.103:0/3119466489 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3410596720 0 0) 0x7f6ef8154a20 con 0x7f6ef80ad150 2020-04-22T14:10:29.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.284+0000 7f6efdc19700 1 -- 172.21.15.103:0/3119466489 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef80af400 con 0x7f6ef81424d0 2020-04-22T14:10:29.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.284+0000 7f6efdc19700 1 --2- 172.21.15.103:0/3119466489 >> v2:172.21.15.103:3300/0 conn(0x7f6ef81424d0 0x7f6ef8146880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6ef0001210 tx=0x7f6ef0010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:29.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.284+0000 7f6efdc19700 1 --2- 172.21.15.103:0/3119466489 >> v2:172.21.15.103:3300/0 conn(0x7f6ef81424d0 0x7f6ef8146880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6ef0001210 tx=0x7f6ef0010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:29.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.284+0000 7f6efdc19700 1 --2- 172.21.15.103:0/3119466489 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ef81424d0 0x7f6ef8146880 secure :-1 s=READY pgs=757 cs=0 l=1 rx=0x7f6ef0001210 tx=0x7f6ef0010c80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:29.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.284+0000 7f6efdc19700 1 --2- 172.21.15.103:0/3119466489 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ef81424d0 0x7f6ef8146880 secure :-1 s=THROTTLE_DONE pgs=757 cs=0 l=1 rx=0x7f6ef0001210 tx=0x7f6ef0010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:29.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.285+0000 7f6ee67fc700 1 -- 172.21.15.103:0/3119466489 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ef0004c50 con 0x7f6ef81424d0 2020-04-22T14:10:29.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.285+0000 7f6efdc19700 1 --2- 172.21.15.103:0/3119466489 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ef81424d0 0x7f6ef8146880 secure :-1 s=THROTTLE_DONE pgs=757 cs=0 l=1 rx=0x7f6ef0001210 tx=0x7f6ef0010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:29.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.285+0000 7f6efe41a700 1 -- 172.21.15.103:0/3119466489 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ef8146e00 con 0x7f6ef81424d0 2020-04-22T14:10:29.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.285+0000 7f6ee67fc700 1 -- 172.21.15.103:0/3119466489 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef0004df0 con 0x7f6ef81424d0 2020-04-22T14:10:29.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.285+0000 7f6efdc19700 1 --2- 172.21.15.103:0/3119466489 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ef81424d0 0x7f6ef8146880 secure :-1 s=THROTTLE_DONE pgs=757 cs=0 l=1 rx=0x7f6ef0001210 tx=0x7f6ef0010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:29.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.285+0000 7f6ee67fc700 1 -- 172.21.15.103:0/3119466489 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ef0012810 con 0x7f6ef81424d0 2020-04-22T14:10:29.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.285+0000 7f6efe41a700 1 -- 172.21.15.103:0/3119466489 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ef8063f90 con 0x7f6ef81424d0 2020-04-22T14:10:29.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.285+0000 7f6efdc19700 1 --2- 172.21.15.103:0/3119466489 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ef81424d0 0x7f6ef8146880 secure :-1 s=THROTTLE_DONE pgs=757 cs=0 l=1 rx=0x7f6ef0001210 tx=0x7f6ef0010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:29.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.286+0000 7f6ee67fc700 1 -- 172.21.15.103:0/3119466489 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f6ef0012a90 con 0x7f6ef81424d0 2020-04-22T14:10:29.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.286+0000 7f6efdc19700 1 --2- 172.21.15.103:0/3119466489 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ef81424d0 0x7f6ef8146880 secure :-1 s=THROTTLE_DONE pgs=757 cs=0 l=1 rx=0x7f6ef0001210 tx=0x7f6ef0010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:29.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.286+0000 7f6efe41a700 1 -- 172.21.15.103:0/3119466489 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ef8056c90 con 0x7f6ef81424d0 2020-04-22T14:10:29.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.286+0000 7f6ee67fc700 1 --2- 172.21.15.103:0/3119466489 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6ed804d880 0x7f6ed804fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:29.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.286+0000 7f6ee67fc700 1 -- 172.21.15.103:0/3119466489 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f6ef0061850 con 0x7f6ef81424d0 2020-04-22T14:10:29.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.286+0000 7f6efd418700 1 --2- 172.21.15.103:0/3119466489 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6ed804d880 0x7f6ed804fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:29.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.286+0000 7f6efd418700 1 --2- 172.21.15.103:0/3119466489 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6ed804d880 0x7f6ed804fd40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6ef4007920 tx=0x7f6ef40090b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:29.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.286+0000 7f6efd418700 1 --2- 172.21.15.103:0/3119466489 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6ed804d880 0x7f6ed804fd40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6ef4007920 tx=0x7f6ef40090b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:29.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.286+0000 7f6efd418700 1 --2- 172.21.15.103:0/3119466489 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6ed804d880 0x7f6ed804fd40 secure :-1 s=READY pgs=287 cs=0 l=1 rx=0x7f6ef4007920 tx=0x7f6ef40090b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:29.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.290+0000 7f6efdc19700 1 --2- 172.21.15.103:0/3119466489 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ef81424d0 0x7f6ef8146880 secure :-1 s=THROTTLE_DONE pgs=757 cs=0 l=1 rx=0x7f6ef0001210 tx=0x7f6ef0010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:29.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.290+0000 7f6ee67fc700 1 -- 172.21.15.103:0/3119466489 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f6ef003cc90 con 0x7f6ef81424d0 2020-04-22T14:10:29.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.480+0000 7f6efe41a700 1 -- 172.21.15.103:0/3119466489 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ef8060200 con 0x7f6ef81424d0 2020-04-22T14:10:29.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.481+0000 7f6efdc19700 1 --2- 172.21.15.103:0/3119466489 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ef81424d0 0x7f6ef8146880 secure :-1 s=THROTTLE_DONE pgs=757 cs=0 l=1 rx=0x7f6ef0001210 tx=0x7f6ef0010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:29.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.481+0000 7f6ee67fc700 1 -- 172.21.15.103:0/3119466489 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f6ef00402b0 con 0x7f6ef81424d0 2020-04-22T14:10:29.485 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:10:29.485 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":28,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4898,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/167651529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":167651529},{"type":"v1","addr":"172.21.15.86:6835","nonce":167651529}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:07:30.137341+0000","modified":"2020-04-22T14:07:32.145409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5890},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5890":{"gid":5890,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/494421372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":494421372},{"type":"v1","addr":"172.21.15.103:6833","nonce":494421372}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2020-04-22T14:10:29.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.482+0000 7f6efe41a700 1 -- 172.21.15.103:0/3119466489 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6ed804d880 msgr2=0x7f6ed804fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:29.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.482+0000 7f6efe41a700 1 --2- 172.21.15.103:0/3119466489 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6ed804d880 0x7f6ed804fd40 secure :-1 s=READY pgs=287 cs=0 l=1 rx=0x7f6ef4007920 tx=0x7f6ef40090b0).stop 2020-04-22T14:10:29.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.482+0000 7f6efe41a700 1 -- 172.21.15.103:0/3119466489 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ef81424d0 msgr2=0x7f6ef8146880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:29.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.482+0000 7f6efe41a700 1 --2- 172.21.15.103:0/3119466489 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ef81424d0 0x7f6ef8146880 secure :-1 s=READY pgs=757 cs=0 l=1 rx=0x7f6ef0001210 tx=0x7f6ef0010c80).stop 2020-04-22T14:10:29.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.482+0000 7f6efe41a700 1 -- 172.21.15.103:0/3119466489 shutdown_connections 2020-04-22T14:10:29.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.482+0000 7f6efe41a700 1 --2- 172.21.15.103:0/3119466489 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6ed804d880 0x7f6ed804fd40 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:29.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.482+0000 7f6efe41a700 1 --2- 172.21.15.103:0/3119466489 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ef81424d0 0x7f6ef8146880 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:29.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.482+0000 7f6efe41a700 1 --2- 172.21.15.103:0/3119466489 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ef8141c10 0x7f6ef81475e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:29.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.482+0000 7f6efe41a700 1 -- 172.21.15.103:0/3119466489 >> 172.21.15.103:0/3119466489 conn(0x7f6ef805b7c0 msgr2=0x7f6ef813ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:29.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.482+0000 7f6efe41a700 1 -- 172.21.15.103:0/3119466489 shutdown_connections 2020-04-22T14:10:29.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.482+0000 7f6efe41a700 1 -- 172.21.15.103:0/3119466489 wait complete. 2020-04-22T14:10:29.489 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 28 2020-04-22T14:10:29.495 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:29.509 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2020-04-22T14:10:29.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.664+0000 7fe3bc3a1700 1 Processor -- start 2020-04-22T14:10:29.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.664+0000 7fe3bc3a1700 1 -- start start 2020-04-22T14:10:29.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.665+0000 7fe3bc3a1700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe3b40b4320 0x7fe3b40b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:29.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.665+0000 7fe3bc3a1700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe3b40b2530 0x7fe3b40b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:29.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.665+0000 7fe3bc3a1700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b40b0e90 con 0x7fe3b40b4700 2020-04-22T14:10:29.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.665+0000 7fe3bc3a1700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3b40b1130 con 0x7fe3b40b4320 2020-04-22T14:10:29.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.665+0000 7fe3bc3a1700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3b40ae500 con 0x7fe3b40b2530 2020-04-22T14:10:29.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.665+0000 7fe3ba93e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe3b40b2530 0x7fe3b40b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:29.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.665+0000 7fe3b993c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe3b40b4700 0x7fe3b40afa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43134/0 (socket says 172.21.15.103:43134) 2020-04-22T14:10:29.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.665+0000 7fe3b993c700 1 -- 172.21.15.103:0/1780649375 learned_addr learned my addr 172.21.15.103:0/1780649375 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:29.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.665+0000 7fe3ba13d700 1 --2- 172.21.15.103:0/1780649375 >> v2:172.21.15.86:3300/0 conn(0x7fe3b40b4320 0x7fe3b40b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:29.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.665+0000 7fe3ba93e700 1 -- 172.21.15.103:0/1780649375 >> v2:172.21.15.86:3300/0 conn(0x7fe3b40b4320 msgr2=0x7fe3b40b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:29.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.665+0000 7fe3ba93e700 1 --2- 172.21.15.103:0/1780649375 >> v2:172.21.15.86:3300/0 conn(0x7fe3b40b4320 0x7fe3b40b15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:29.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.665+0000 7fe3ba93e700 1 -- 172.21.15.103:0/1780649375 >> v1:172.21.15.103:6789/0 conn(0x7fe3b40b4700 legacy=0x7fe3b40afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:29.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.665+0000 7fe3ba93e700 1 -- 172.21.15.103:0/1780649375 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b40b1a30 con 0x7fe3b40b2530 2020-04-22T14:10:29.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.665+0000 7fe3b913b700 1 -- 172.21.15.103:0/1780649375 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2842351538 0 0) 0x7fe3b40b0e90 con 0x7fe3b40b4700 2020-04-22T14:10:29.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.665+0000 7fe3ba93e700 1 --2- 172.21.15.103:0/1780649375 >> v2:172.21.15.103:3300/0 conn(0x7fe3b40b2530 0x7fe3b40b0170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe3ac0032b0 tx=0x7fe3ac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:29.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.666+0000 7fe3ba93e700 1 --2- 172.21.15.103:0/1780649375 >> v2:172.21.15.103:3300/0 conn(0x7fe3b40b2530 0x7fe3b40b0170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe3ac0032b0 tx=0x7fe3ac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:29.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.666+0000 7fe3ba93e700 1 --2- 172.21.15.103:0/1780649375 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3b40b2530 0x7fe3b40b0170 secure :-1 s=READY pgs=759 cs=0 l=1 rx=0x7fe3ac0032b0 tx=0x7fe3ac007dc0).ready entity=mon.1 client_cookie=a4702107e9531887 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:29.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.666+0000 7fe3ba93e700 1 --2- 172.21.15.103:0/1780649375 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3b40b2530 0x7fe3b40b0170 secure :-1 s=THROTTLE_DONE pgs=759 cs=0 l=1 rx=0x7fe3ac0032b0 tx=0x7fe3ac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:29.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.666+0000 7fe3b913b700 1 -- 172.21.15.103:0/1780649375 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3ac00a180 con 0x7fe3b40b2530 2020-04-22T14:10:29.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.666+0000 7fe3ba93e700 1 --2- 172.21.15.103:0/1780649375 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3b40b2530 0x7fe3b40b0170 secure :-1 s=THROTTLE_DONE pgs=759 cs=0 l=1 rx=0x7fe3ac0032b0 tx=0x7fe3ac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:29.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.666+0000 7fe3b913b700 1 -- 172.21.15.103:0/1780649375 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ac00a2e0 con 0x7fe3b40b2530 2020-04-22T14:10:29.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.666+0000 7fe3ba93e700 1 --2- 172.21.15.103:0/1780649375 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3b40b2530 0x7fe3b40b0170 secure :-1 s=THROTTLE_DONE pgs=759 cs=0 l=1 rx=0x7fe3ac0032b0 tx=0x7fe3ac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:29.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.666+0000 7fe3bc3a1700 1 -- 172.21.15.103:0/1780649375 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3b40b2530 msgr2=0x7fe3b40b0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:29.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.666+0000 7fe3bc3a1700 1 --2- 172.21.15.103:0/1780649375 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3b40b2530 0x7fe3b40b0170 secure :-1 s=READY pgs=759 cs=0 l=1 rx=0x7fe3ac0032b0 tx=0x7fe3ac007dc0).stop 2020-04-22T14:10:29.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.666+0000 7fe3b913b700 1 -- 172.21.15.103:0/1780649375 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3ac00a6c0 con 0x7fe3b40b2530 2020-04-22T14:10:29.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.666+0000 7fe3bc3a1700 1 -- 172.21.15.103:0/1780649375 shutdown_connections 2020-04-22T14:10:29.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.666+0000 7fe3bc3a1700 1 --2- 172.21.15.103:0/1780649375 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3b40b2530 0x7fe3b40b0170 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:29.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.666+0000 7fe3bc3a1700 1 --2- 172.21.15.103:0/1780649375 >> v2:172.21.15.86:3300/0 conn(0x7fe3b40b4320 0x7fe3b40b15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:29.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.666+0000 7fe3bc3a1700 1 -- 172.21.15.103:0/1780649375 >> 172.21.15.103:0/1780649375 conn(0x7fe3b40b86b0 msgr2=0x7fe3b40b8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:29.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.666+0000 7fe3bc3a1700 1 -- 172.21.15.103:0/1780649375 shutdown_connections 2020-04-22T14:10:29.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.666+0000 7fe3bc3a1700 1 -- 172.21.15.103:0/1780649375 wait complete. 2020-04-22T14:10:29.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.667+0000 7fe3bc3a1700 1 Processor -- start 2020-04-22T14:10:29.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.667+0000 7fe3bc3a1700 1 -- start start 2020-04-22T14:10:29.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.668+0000 7fe3bc3a1700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe3b40b2530 0x7fe3b40619f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:29.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.668+0000 7fe3bc3a1700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe3b40b4700 0x7fe3b40635f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:29.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.668+0000 7fe3bc3a1700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b4062020 con 0x7fe3b40b4320 2020-04-22T14:10:29.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.668+0000 7fe3bc3a1700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3b41501c0 con 0x7fe3b40b2530 2020-04-22T14:10:29.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.668+0000 7fe3bc3a1700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3b4153a00 con 0x7fe3b40b4700 2020-04-22T14:10:29.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.668+0000 7fe3b993c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe3b40b4320 0x7fe3b413aef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43142/0 (socket says 172.21.15.103:43142) 2020-04-22T14:10:29.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.668+0000 7fe3b993c700 1 -- 172.21.15.103:0/2485081668 learned_addr learned my addr 172.21.15.103:0/2485081668 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:29.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.668+0000 7fe3ba93e700 1 --2- 172.21.15.103:0/2485081668 >> v2:172.21.15.103:3300/0 conn(0x7fe3b40b4700 0x7fe3b40635f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:29.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.668+0000 7fe3ba13d700 1 --2- 172.21.15.103:0/2485081668 >> v2:172.21.15.86:3300/0 conn(0x7fe3b40b2530 0x7fe3b40619f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:29.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.668+0000 7fe3a37fe700 1 -- 172.21.15.103:0/2485081668 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3315756796 0 0) 0x7fe3b4062020 con 0x7fe3b40b4320 2020-04-22T14:10:29.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.668+0000 7fe3a37fe700 1 -- 172.21.15.103:0/2485081668 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe394002fe0 con 0x7fe3b40b4320 2020-04-22T14:10:29.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.668+0000 7fe3ba93e700 1 -- 172.21.15.103:0/2485081668 >> v2:172.21.15.86:3300/0 conn(0x7fe3b40b2530 msgr2=0x7fe3b40619f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:29.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.668+0000 7fe3ba93e700 1 --2- 172.21.15.103:0/2485081668 >> v2:172.21.15.86:3300/0 conn(0x7fe3b40b2530 0x7fe3b40619f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:29.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.668+0000 7fe3ba93e700 1 -- 172.21.15.103:0/2485081668 >> v1:172.21.15.103:6789/0 conn(0x7fe3b40b4320 legacy=0x7fe3b413aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:29.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.668+0000 7fe3ba93e700 1 -- 172.21.15.103:0/2485081668 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b413b600 con 0x7fe3b40b4700 2020-04-22T14:10:29.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.668+0000 7fe3ba93e700 1 --2- 172.21.15.103:0/2485081668 >> v2:172.21.15.103:3300/0 conn(0x7fe3b40b4700 0x7fe3b40635f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe3ac0032b0 tx=0x7fe3ac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:29.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.668+0000 7fe3ba93e700 1 --2- 172.21.15.103:0/2485081668 >> v2:172.21.15.103:3300/0 conn(0x7fe3b40b4700 0x7fe3b40635f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe3ac0032b0 tx=0x7fe3ac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:29.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.668+0000 7fe3ba93e700 1 --2- 172.21.15.103:0/2485081668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3b40b4700 0x7fe3b40635f0 secure :-1 s=READY pgs=761 cs=0 l=1 rx=0x7fe3ac0032b0 tx=0x7fe3ac007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:29.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.669+0000 7fe3ba93e700 1 --2- 172.21.15.103:0/2485081668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3b40b4700 0x7fe3b40635f0 secure :-1 s=THROTTLE_DONE pgs=761 cs=0 l=1 rx=0x7fe3ac0032b0 tx=0x7fe3ac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:29.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.669+0000 7fe3a37fe700 1 -- 172.21.15.103:0/2485081668 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3ac010580 con 0x7fe3b40b4700 2020-04-22T14:10:29.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.669+0000 7fe3ba93e700 1 --2- 172.21.15.103:0/2485081668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3b40b4700 0x7fe3b40635f0 secure :-1 s=THROTTLE_DONE pgs=761 cs=0 l=1 rx=0x7fe3ac0032b0 tx=0x7fe3ac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:29.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.669+0000 7fe3a37fe700 1 -- 172.21.15.103:0/2485081668 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ac005a40 con 0x7fe3b40b4700 2020-04-22T14:10:29.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.669+0000 7fe3ba93e700 1 --2- 172.21.15.103:0/2485081668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3b40b4700 0x7fe3b40635f0 secure :-1 s=THROTTLE_DONE pgs=761 cs=0 l=1 rx=0x7fe3ac0032b0 tx=0x7fe3ac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:29.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.669+0000 7fe3bc3a1700 1 -- 172.21.15.103:0/2485081668 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3b4063a50 con 0x7fe3b40b4700 2020-04-22T14:10:29.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.669+0000 7fe3a37fe700 1 -- 172.21.15.103:0/2485081668 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3ac005de0 con 0x7fe3b40b4700 2020-04-22T14:10:29.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.669+0000 7fe3bc3a1700 1 -- 172.21.15.103:0/2485081668 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3b41508f0 con 0x7fe3b40b4700 2020-04-22T14:10:29.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.669+0000 7fe3ba93e700 1 --2- 172.21.15.103:0/2485081668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3b40b4700 0x7fe3b40635f0 secure :-1 s=THROTTLE_DONE pgs=761 cs=0 l=1 rx=0x7fe3ac0032b0 tx=0x7fe3ac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:29.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.670+0000 7fe3a37fe700 1 -- 172.21.15.103:0/2485081668 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fe3ac00f5b0 con 0x7fe3b40b4700 2020-04-22T14:10:29.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.670+0000 7fe3ba93e700 1 --2- 172.21.15.103:0/2485081668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3b40b4700 0x7fe3b40635f0 secure :-1 s=THROTTLE_DONE pgs=761 cs=0 l=1 rx=0x7fe3ac0032b0 tx=0x7fe3ac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:29.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.670+0000 7fe3bc3a1700 1 -- 172.21.15.103:0/2485081668 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3b4062220 con 0x7fe3b40b4700 2020-04-22T14:10:29.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.670+0000 7fe3a37fe700 1 --2- 172.21.15.103:0/2485081668 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe39404dcb0 0x7fe394050170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:29.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.670+0000 7fe3a37fe700 1 -- 172.21.15.103:0/2485081668 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fe3ac0622f0 con 0x7fe3b40b4700 2020-04-22T14:10:29.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.670+0000 7fe3ba13d700 1 --2- 172.21.15.103:0/2485081668 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe39404dcb0 0x7fe394050170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:29.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.670+0000 7fe3ba13d700 1 --2- 172.21.15.103:0/2485081668 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe39404dcb0 0x7fe394050170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe3a4002f30 tx=0x7fe3a400d710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:29.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.670+0000 7fe3ba13d700 1 --2- 172.21.15.103:0/2485081668 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe39404dcb0 0x7fe394050170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe3a4002f30 tx=0x7fe3a400d710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:29.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.670+0000 7fe3ba13d700 1 --2- 172.21.15.103:0/2485081668 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe39404dcb0 0x7fe394050170 secure :-1 s=READY pgs=288 cs=0 l=1 rx=0x7fe3a4002f30 tx=0x7fe3a400d710).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:29.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.674+0000 7fe3ba93e700 1 --2- 172.21.15.103:0/2485081668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3b40b4700 0x7fe3b40635f0 secure :-1 s=THROTTLE_DONE pgs=761 cs=0 l=1 rx=0x7fe3ac0032b0 tx=0x7fe3ac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:29.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.674+0000 7fe3a37fe700 1 -- 172.21.15.103:0/2485081668 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fe3ac03d7f0 con 0x7fe3b40b4700 2020-04-22T14:10:29.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:29.863+0000 7fe3bc3a1700 1 -- 172.21.15.103:0/2485081668 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe3b4061e50 con 0x7fe3b40b4700 2020-04-22T14:10:30.377 INFO:tasks.ceph.mon.b.smithi086.stderr:2020-04-22T14:10:30.375+0000 7fbdbf880700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-04-22T14:10:30.395 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.383+0000 7fe3ba93e700 1 --2- 172.21.15.103:0/2485081668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3b40b4700 0x7fe3b40635f0 secure :-1 s=THROTTLE_DONE pgs=761 cs=0 l=1 rx=0x7fe3ac0032b0 tx=0x7fe3ac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:30.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.383+0000 7fe3a37fe700 1 -- 172.21.15.103:0/2485081668 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v29) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe3ac040e10 con 0x7fe3b40b4700 2020-04-22T14:10:30.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.385+0000 7fe3bc3a1700 1 -- 172.21.15.103:0/2485081668 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe39404dcb0 msgr2=0x7fe394050170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:30.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.385+0000 7fe3bc3a1700 1 --2- 172.21.15.103:0/2485081668 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe39404dcb0 0x7fe394050170 secure :-1 s=READY pgs=288 cs=0 l=1 rx=0x7fe3a4002f30 tx=0x7fe3a400d710).stop 2020-04-22T14:10:30.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.385+0000 7fe3bc3a1700 1 -- 172.21.15.103:0/2485081668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3b40b4700 msgr2=0x7fe3b40635f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:30.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.385+0000 7fe3bc3a1700 1 --2- 172.21.15.103:0/2485081668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3b40b4700 0x7fe3b40635f0 secure :-1 s=READY pgs=761 cs=0 l=1 rx=0x7fe3ac0032b0 tx=0x7fe3ac007dc0).stop 2020-04-22T14:10:30.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.385+0000 7fe3bc3a1700 1 -- 172.21.15.103:0/2485081668 shutdown_connections 2020-04-22T14:10:30.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.385+0000 7fe3bc3a1700 1 --2- 172.21.15.103:0/2485081668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3b40b4700 0x7fe3b40635f0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:30.397 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.385+0000 7fe3bc3a1700 1 --2- 172.21.15.103:0/2485081668 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe39404dcb0 0x7fe394050170 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:30.397 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.385+0000 7fe3bc3a1700 1 --2- 172.21.15.103:0/2485081668 >> v2:172.21.15.86:3300/0 conn(0x7fe3b40b2530 0x7fe3b40619f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:30.397 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.385+0000 7fe3bc3a1700 1 -- 172.21.15.103:0/2485081668 >> 172.21.15.103:0/2485081668 conn(0x7fe3b40b86b0 msgr2=0x7fe3b413c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:30.397 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.385+0000 7fe3bc3a1700 1 -- 172.21.15.103:0/2485081668 shutdown_connections 2020-04-22T14:10:30.397 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.385+0000 7fe3bc3a1700 1 -- 172.21.15.103:0/2485081668 wait complete. 2020-04-22T14:10:30.397 INFO:teuthology.orchestra.run.smithi103.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2020-04-22T14:10:30.399 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:30.410 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2020-04-22T14:10:30.413 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:10:30.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.559+0000 7fbbfc3fc700 1 Processor -- start 2020-04-22T14:10:30.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.559+0000 7fbbfc3fc700 1 -- start start 2020-04-22T14:10:30.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.560+0000 7fbbfc3fc700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbf40b6040 0x7fbbf40ac740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:30.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.560+0000 7fbbfc3fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbbf41426d0 0x7fbbf4142b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:30.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.560+0000 7fbbfc3fc700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbf4064ec0 con 0x7fbbf4067170 2020-04-22T14:10:30.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.560+0000 7fbbfc3fc700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbf4065af0 con 0x7fbbf41426d0 2020-04-22T14:10:30.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.560+0000 7fbbfc3fc700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf4146870 con 0x7fbbf40b6040 2020-04-22T14:10:30.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.560+0000 7fbbfa999700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbbf41426d0 0x7fbbf4142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:30.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.561+0000 7fbbfa999700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbbf41426d0 0x7fbbf4142b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50974/0 (socket says 172.21.15.103:50974) 2020-04-22T14:10:30.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.561+0000 7fbbfa999700 1 -- 172.21.15.103:0/1891422141 learned_addr learned my addr 172.21.15.103:0/1891422141 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:10:30.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.561+0000 7fbbf9997700 1 --2- 172.21.15.103:0/1891422141 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbf40b6040 0x7fbbf40ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:30.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.561+0000 7fbbfa999700 1 -- 172.21.15.103:0/1891422141 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbf40b6040 msgr2=0x7fbbf40ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:30.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.561+0000 7fbbfa999700 1 --2- 172.21.15.103:0/1891422141 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbf40b6040 0x7fbbf40ac740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:30.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.561+0000 7fbbfa999700 1 -- 172.21.15.103:0/1891422141 >> v1:172.21.15.86:6789/0 conn(0x7fbbf4067170 legacy=0x7fbbf413c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:30.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.561+0000 7fbbfa999700 1 -- 172.21.15.103:0/1891422141 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf4067550 con 0x7fbbf41426d0 2020-04-22T14:10:30.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.561+0000 7fbbfa999700 1 --2- 172.21.15.103:0/1891422141 >> v2:172.21.15.103:3300/0 conn(0x7fbbf41426d0 0x7fbbf4142b80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbbf40663d0 tx=0x7fbbec007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:30.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.561+0000 7fbbfa999700 1 --2- 172.21.15.103:0/1891422141 >> v2:172.21.15.103:3300/0 conn(0x7fbbf41426d0 0x7fbbf4142b80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbbf40663d0 tx=0x7fbbec007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:30.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.561+0000 7fbbfa999700 1 --2- 172.21.15.103:0/1891422141 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbf41426d0 0x7fbbf4142b80 secure :-1 s=READY pgs=766 cs=0 l=1 rx=0x7fbbf40663d0 tx=0x7fbbec007dc0).ready entity=mon.1 client_cookie=e438005c2062ead3 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:30.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.561+0000 7fbbfa999700 1 --2- 172.21.15.103:0/1891422141 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbf41426d0 0x7fbbf4142b80 secure :-1 s=THROTTLE_DONE pgs=766 cs=0 l=1 rx=0x7fbbf40663d0 tx=0x7fbbec007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:30.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.561+0000 7fbbf9196700 1 -- 172.21.15.103:0/1891422141 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbec00a180 con 0x7fbbf41426d0 2020-04-22T14:10:30.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.561+0000 7fbbfa999700 1 --2- 172.21.15.103:0/1891422141 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbf41426d0 0x7fbbf4142b80 secure :-1 s=THROTTLE_DONE pgs=766 cs=0 l=1 rx=0x7fbbf40663d0 tx=0x7fbbec007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:30.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.561+0000 7fbbf9196700 1 -- 172.21.15.103:0/1891422141 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbec00a2e0 con 0x7fbbf41426d0 2020-04-22T14:10:30.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.561+0000 7fbbfa999700 1 --2- 172.21.15.103:0/1891422141 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbf41426d0 0x7fbbf4142b80 secure :-1 s=THROTTLE_DONE pgs=766 cs=0 l=1 rx=0x7fbbf40663d0 tx=0x7fbbec007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:30.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.561+0000 7fbbf9196700 1 -- 172.21.15.103:0/1891422141 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbec00a700 con 0x7fbbf41426d0 2020-04-22T14:10:30.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.561+0000 7fbbfc3fc700 1 -- 172.21.15.103:0/1891422141 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbf41426d0 msgr2=0x7fbbf4142b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:30.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.561+0000 7fbbfc3fc700 1 --2- 172.21.15.103:0/1891422141 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbf41426d0 0x7fbbf4142b80 secure :-1 s=READY pgs=766 cs=0 l=1 rx=0x7fbbf40663d0 tx=0x7fbbec007dc0).stop 2020-04-22T14:10:30.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.562+0000 7fbbfc3fc700 1 -- 172.21.15.103:0/1891422141 shutdown_connections 2020-04-22T14:10:30.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.562+0000 7fbbfc3fc700 1 --2- 172.21.15.103:0/1891422141 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbf41426d0 0x7fbbf4142b80 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:30.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.562+0000 7fbbfc3fc700 1 --2- 172.21.15.103:0/1891422141 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbf40b6040 0x7fbbf40ac740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:30.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.562+0000 7fbbfc3fc700 1 -- 172.21.15.103:0/1891422141 >> 172.21.15.103:0/1891422141 conn(0x7fbbf40b9160 msgr2=0x7fbbf405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:30.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.562+0000 7fbbfc3fc700 1 -- 172.21.15.103:0/1891422141 shutdown_connections 2020-04-22T14:10:30.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.562+0000 7fbbfc3fc700 1 -- 172.21.15.103:0/1891422141 wait complete. 2020-04-22T14:10:30.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.563+0000 7fbbfc3fc700 1 Processor -- start 2020-04-22T14:10:30.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.563+0000 7fbbfc3fc700 1 -- start start 2020-04-22T14:10:30.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.563+0000 7fbbfc3fc700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbf4067170 0x7fbbf40b7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:30.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.563+0000 7fbbfc3fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbbf41426d0 0x7fbbf4153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:30.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.563+0000 7fbbfc3fc700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbf414b3c0 con 0x7fbbf40b6040 2020-04-22T14:10:30.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.563+0000 7fbbfc3fc700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbf413d9b0 con 0x7fbbf41426d0 2020-04-22T14:10:30.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.563+0000 7fbbfc3fc700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf40b8200 con 0x7fbbf4067170 2020-04-22T14:10:30.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.563+0000 7fbbfa999700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbbf41426d0 0x7fbbf4153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:30.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.563+0000 7fbbf9997700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fbbf40b6040 0x7fbbf413d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43170/0 (socket says 172.21.15.103:43170) 2020-04-22T14:10:30.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.563+0000 7fbbf9997700 1 -- 172.21.15.103:0/4226005834 learned_addr learned my addr 172.21.15.103:0/4226005834 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:30.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.564+0000 7fbbfa198700 1 --2- 172.21.15.103:0/4226005834 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbf4067170 0x7fbbf40b7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:30.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.564+0000 7fbbfa999700 1 -- 172.21.15.103:0/4226005834 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbf4067170 msgr2=0x7fbbf40b7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:30.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.564+0000 7fbbfa999700 1 --2- 172.21.15.103:0/4226005834 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbf4067170 0x7fbbf40b7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:30.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.564+0000 7fbbfa999700 1 -- 172.21.15.103:0/4226005834 >> v1:172.21.15.103:6789/0 conn(0x7fbbf40b6040 legacy=0x7fbbf413d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:30.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.564+0000 7fbbe77fe700 1 -- 172.21.15.103:0/4226005834 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1575453553 0 0) 0x7fbbf414b3c0 con 0x7fbbf40b6040 2020-04-22T14:10:30.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.564+0000 7fbbfa999700 1 -- 172.21.15.103:0/4226005834 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf414ae80 con 0x7fbbf41426d0 2020-04-22T14:10:30.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.564+0000 7fbbfa198700 1 --2- 172.21.15.103:0/4226005834 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbf4067170 0x7fbbf40b7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:10:30.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.564+0000 7fbbfa999700 1 --2- 172.21.15.103:0/4226005834 >> v2:172.21.15.103:3300/0 conn(0x7fbbf41426d0 0x7fbbf4153f40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbbf40663d0 tx=0x7fbbec007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:30.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.564+0000 7fbbfa999700 1 --2- 172.21.15.103:0/4226005834 >> v2:172.21.15.103:3300/0 conn(0x7fbbf41426d0 0x7fbbf4153f40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbbf40663d0 tx=0x7fbbec007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:30.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.564+0000 7fbbfa999700 1 --2- 172.21.15.103:0/4226005834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbf41426d0 0x7fbbf4153f40 secure :-1 s=READY pgs=768 cs=0 l=1 rx=0x7fbbf40663d0 tx=0x7fbbec007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:30.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.564+0000 7fbbfa999700 1 --2- 172.21.15.103:0/4226005834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbf41426d0 0x7fbbf4153f40 secure :-1 s=THROTTLE_DONE pgs=768 cs=0 l=1 rx=0x7fbbf40663d0 tx=0x7fbbec007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:30.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.564+0000 7fbbe77fe700 1 -- 172.21.15.103:0/4226005834 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbec005c30 con 0x7fbbf41426d0 2020-04-22T14:10:30.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.564+0000 7fbbfa999700 1 --2- 172.21.15.103:0/4226005834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbf41426d0 0x7fbbf4153f40 secure :-1 s=THROTTLE_DONE pgs=768 cs=0 l=1 rx=0x7fbbf40663d0 tx=0x7fbbec007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:30.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.564+0000 7fbbfa999700 1 --2- 172.21.15.103:0/4226005834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbf41426d0 0x7fbbf4153f40 secure :-1 s=THROTTLE_DONE pgs=768 cs=0 l=1 rx=0x7fbbf40663d0 tx=0x7fbbec007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:30.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.564+0000 7fbbe77fe700 1 -- 172.21.15.103:0/4226005834 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbec005d90 con 0x7fbbf41426d0 2020-04-22T14:10:30.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.564+0000 7fbbe77fe700 1 -- 172.21.15.103:0/4226005834 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbec007360 con 0x7fbbf41426d0 2020-04-22T14:10:30.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.564+0000 7fbbfc3fc700 1 -- 172.21.15.103:0/4226005834 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbf414b120 con 0x7fbbf41426d0 2020-04-22T14:10:30.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.564+0000 7fbbfc3fc700 1 -- 172.21.15.103:0/4226005834 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbf4154560 con 0x7fbbf41426d0 2020-04-22T14:10:30.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.565+0000 7fbbfa999700 1 --2- 172.21.15.103:0/4226005834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbf41426d0 0x7fbbf4153f40 secure :-1 s=THROTTLE_DONE pgs=768 cs=0 l=1 rx=0x7fbbf40663d0 tx=0x7fbbec007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:30.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.565+0000 7fbbe77fe700 1 -- 172.21.15.103:0/4226005834 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fbbec0075a0 con 0x7fbbf41426d0 2020-04-22T14:10:30.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.565+0000 7fbbfa999700 1 --2- 172.21.15.103:0/4226005834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbf41426d0 0x7fbbf4153f40 secure :-1 s=THROTTLE_DONE pgs=768 cs=0 l=1 rx=0x7fbbf40663d0 tx=0x7fbbec007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:30.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.565+0000 7fbbfc3fc700 1 -- 172.21.15.103:0/4226005834 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbf4056c90 con 0x7fbbf41426d0 2020-04-22T14:10:30.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.565+0000 7fbbe77fe700 1 --2- 172.21.15.103:0/4226005834 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbbd404fa30 0x7fbbd4051ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:30.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.565+0000 7fbbe77fe700 1 -- 172.21.15.103:0/4226005834 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6202+0+0 (secure 0 0 0) 0x7fbbec062440 con 0x7fbbf41426d0 2020-04-22T14:10:30.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.566+0000 7fbbfa198700 1 --2- 172.21.15.103:0/4226005834 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbbd404fa30 0x7fbbd4051ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:30.582 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.566+0000 7fbbfa198700 1 --2- 172.21.15.103:0/4226005834 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbbd404fa30 0x7fbbd4051ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbbe8001f50 tx=0x7fbbe80027a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:30.582 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.566+0000 7fbbfa198700 1 --2- 172.21.15.103:0/4226005834 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbbd404fa30 0x7fbbd4051ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbbe8001f50 tx=0x7fbbe80027a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:30.582 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.566+0000 7fbbfa198700 1 --2- 172.21.15.103:0/4226005834 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbbd404fa30 0x7fbbd4051ef0 secure :-1 s=READY pgs=289 cs=0 l=1 rx=0x7fbbe8001f50 tx=0x7fbbe80027a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:30.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.569+0000 7fbbfa999700 1 --2- 172.21.15.103:0/4226005834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbf41426d0 0x7fbbf4153f40 secure :-1 s=THROTTLE_DONE pgs=768 cs=0 l=1 rx=0x7fbbf40663d0 tx=0x7fbbec007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:30.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.569+0000 7fbbe77fe700 1 -- 172.21.15.103:0/4226005834 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fbbec03d880 con 0x7fbbf41426d0 2020-04-22T14:10:30.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.759+0000 7fbbfc3fc700 1 -- 172.21.15.103:0/4226005834 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbbf40b40c0 con 0x7fbbf41426d0 2020-04-22T14:10:30.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.759+0000 7fbbfa999700 1 --2- 172.21.15.103:0/4226005834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbf41426d0 0x7fbbf4153f40 secure :-1 s=THROTTLE_DONE pgs=768 cs=0 l=1 rx=0x7fbbf40663d0 tx=0x7fbbec007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:30.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.760+0000 7fbbe77fe700 1 -- 172.21.15.103:0/4226005834 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+1775 (secure 0 0 0) 0x7fbbec040ea0 con 0x7fbbf41426d0 2020-04-22T14:10:30.763 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:10:30.763 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":29,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4898,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/167651529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":167651529},{"type":"v1","addr":"172.21.15.86:6835","nonce":167651529}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":29,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:07:30.137341+0000","modified":"2020-04-22T14:10:30.375719+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":56,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2020-04-22T14:10:30.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.761+0000 7fbbfc3fc700 1 -- 172.21.15.103:0/4226005834 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbbd404fa30 msgr2=0x7fbbd4051ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:30.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.761+0000 7fbbfc3fc700 1 --2- 172.21.15.103:0/4226005834 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbbd404fa30 0x7fbbd4051ef0 secure :-1 s=READY pgs=289 cs=0 l=1 rx=0x7fbbe8001f50 tx=0x7fbbe80027a0).stop 2020-04-22T14:10:30.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.761+0000 7fbbfc3fc700 1 -- 172.21.15.103:0/4226005834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbf41426d0 msgr2=0x7fbbf4153f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:30.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.761+0000 7fbbfc3fc700 1 --2- 172.21.15.103:0/4226005834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbf41426d0 0x7fbbf4153f40 secure :-1 s=READY pgs=768 cs=0 l=1 rx=0x7fbbf40663d0 tx=0x7fbbec007dc0).stop 2020-04-22T14:10:30.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.761+0000 7fbbfc3fc700 1 -- 172.21.15.103:0/4226005834 shutdown_connections 2020-04-22T14:10:30.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.761+0000 7fbbfc3fc700 1 --2- 172.21.15.103:0/4226005834 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbbd404fa30 0x7fbbd4051ef0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:30.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.761+0000 7fbbfc3fc700 1 --2- 172.21.15.103:0/4226005834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbf41426d0 0x7fbbf4153f40 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:30.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.761+0000 7fbbfc3fc700 1 --2- 172.21.15.103:0/4226005834 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbf4067170 0x7fbbf40b7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:30.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.761+0000 7fbbfc3fc700 1 -- 172.21.15.103:0/4226005834 >> 172.21.15.103:0/4226005834 conn(0x7fbbf40b9160 msgr2=0x7fbbf40b66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:30.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.761+0000 7fbbfc3fc700 1 -- 172.21.15.103:0/4226005834 shutdown_connections 2020-04-22T14:10:30.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.761+0000 7fbbfc3fc700 1 -- 172.21.15.103:0/4226005834 wait complete. 2020-04-22T14:10:30.766 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 29 2020-04-22T14:10:30.775 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:30.788 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-04-22T14:10:30.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.934+0000 7fd2e8800700 1 Processor -- start 2020-04-22T14:10:30.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.934+0000 7fd2e8800700 1 -- start start 2020-04-22T14:10:30.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.934+0000 7fd2e8800700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd2e413d170 0x7fd2e4143060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:30.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.934+0000 7fd2e8800700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e41435d0 con 0x7fd2e40ae7b0 2020-04-22T14:10:30.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.934+0000 7fd2e8800700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e4143870 con 0x7fd2e40668c0 2020-04-22T14:10:30.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.935+0000 7fd2e8800700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2e4144040 con 0x7fd2e413d170 2020-04-22T14:10:30.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.935+0000 7fd2e2d9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd2e413d170 0x7fd2e4143060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:30.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.935+0000 7fd2e359e700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd2e40668c0 0x7fd2e4066d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43174/0 (socket says 172.21.15.103:43174) 2020-04-22T14:10:30.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.935+0000 7fd2e359e700 1 -- 172.21.15.103:0/526191305 learned_addr learned my addr 172.21.15.103:0/526191305 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:30.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.935+0000 7fd2e2d9d700 1 -- 172.21.15.103:0/526191305 >> v1:172.21.15.103:6789/0 conn(0x7fd2e40668c0 legacy=0x7fd2e4066d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:30.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.935+0000 7fd2e2d9d700 1 -- 172.21.15.103:0/526191305 >> v1:172.21.15.86:6789/0 conn(0x7fd2e40ae7b0 legacy=0x7fd2e40b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:30.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.935+0000 7fd2e2d9d700 1 -- 172.21.15.103:0/526191305 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e4143b10 con 0x7fd2e413d170 2020-04-22T14:10:30.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.935+0000 7fd2e2d9d700 1 --2- 172.21.15.103:0/526191305 >> v2:172.21.15.103:3300/0 conn(0x7fd2e413d170 0x7fd2e4143060 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd2cc002f30 tx=0x7fd2cc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:30.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.935+0000 7fd2e2d9d700 1 --2- 172.21.15.103:0/526191305 >> v2:172.21.15.103:3300/0 conn(0x7fd2e413d170 0x7fd2e4143060 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd2cc002f30 tx=0x7fd2cc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:30.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.935+0000 7fd2e2d9d700 1 --2- 172.21.15.103:0/526191305 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2e413d170 0x7fd2e4143060 secure :-1 s=READY pgs=770 cs=0 l=1 rx=0x7fd2cc002f30 tx=0x7fd2cc007a40).ready entity=mon.1 client_cookie=11c7d436e55bd0ca server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:30.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.935+0000 7fd2e2d9d700 1 --2- 172.21.15.103:0/526191305 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2e413d170 0x7fd2e4143060 secure :-1 s=THROTTLE_DONE pgs=770 cs=0 l=1 rx=0x7fd2cc002f30 tx=0x7fd2cc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:30.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.935+0000 7fd2e1d9b700 1 -- 172.21.15.103:0/526191305 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2cc011470 con 0x7fd2e413d170 2020-04-22T14:10:30.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.935+0000 7fd2e2d9d700 1 --2- 172.21.15.103:0/526191305 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2e413d170 0x7fd2e4143060 secure :-1 s=THROTTLE_DONE pgs=770 cs=0 l=1 rx=0x7fd2cc002f30 tx=0x7fd2cc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:30.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.935+0000 7fd2e1d9b700 1 -- 172.21.15.103:0/526191305 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2cc0115d0 con 0x7fd2e413d170 2020-04-22T14:10:30.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.935+0000 7fd2e2d9d700 1 --2- 172.21.15.103:0/526191305 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2e413d170 0x7fd2e4143060 secure :-1 s=THROTTLE_DONE pgs=770 cs=0 l=1 rx=0x7fd2cc002f30 tx=0x7fd2cc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:30.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.935+0000 7fd2e8800700 1 -- 172.21.15.103:0/526191305 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2e413d170 msgr2=0x7fd2e4143060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:30.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.935+0000 7fd2e1d9b700 1 -- 172.21.15.103:0/526191305 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2cc0119f0 con 0x7fd2e413d170 2020-04-22T14:10:30.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.935+0000 7fd2e8800700 1 --2- 172.21.15.103:0/526191305 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2e413d170 0x7fd2e4143060 secure :-1 s=READY pgs=770 cs=0 l=1 rx=0x7fd2cc002f30 tx=0x7fd2cc007a40).stop 2020-04-22T14:10:30.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.936+0000 7fd2e8800700 1 -- 172.21.15.103:0/526191305 shutdown_connections 2020-04-22T14:10:30.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.936+0000 7fd2e8800700 1 --2- 172.21.15.103:0/526191305 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2e413d170 0x7fd2e4143060 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:30.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.936+0000 7fd2e8800700 1 -- 172.21.15.103:0/526191305 >> 172.21.15.103:0/526191305 conn(0x7fd2e406a0f0 msgr2=0x7fd2e405b180 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:30.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.936+0000 7fd2e8800700 1 -- 172.21.15.103:0/526191305 shutdown_connections 2020-04-22T14:10:30.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.936+0000 7fd2e8800700 1 -- 172.21.15.103:0/526191305 wait complete. 2020-04-22T14:10:30.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.937+0000 7fd2e8800700 1 Processor -- start 2020-04-22T14:10:30.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.937+0000 7fd2e8800700 1 -- start start 2020-04-22T14:10:30.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.937+0000 7fd2e8800700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2e40668c0 0x7fd2e4142da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:30.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.937+0000 7fd2e8800700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e4143320 con 0x7fd2e40ae7b0 2020-04-22T14:10:30.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.937+0000 7fd2e8800700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e413ff70 con 0x7fd2e413d170 2020-04-22T14:10:30.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.937+0000 7fd2e8800700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e40b7d00 con 0x7fd2e40668c0 2020-04-22T14:10:30.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.937+0000 7fd2e359e700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd2e413d170 0x7fd2e4154470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43182/0 (socket says 172.21.15.103:43182) 2020-04-22T14:10:30.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.937+0000 7fd2e359e700 1 -- 172.21.15.103:0/4271731659 learned_addr learned my addr 172.21.15.103:0/4271731659 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:30.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.938+0000 7fd2e2d9d700 1 --2- 172.21.15.103:0/4271731659 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2e40668c0 0x7fd2e4142da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:30.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.938+0000 7fd2dbfff700 1 -- 172.21.15.103:0/4271731659 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 458087415 0 0) 0x7fd2e413ff70 con 0x7fd2e413d170 2020-04-22T14:10:30.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.938+0000 7fd2dbfff700 1 -- 172.21.15.103:0/4271731659 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2c8002fe0 con 0x7fd2e413d170 2020-04-22T14:10:30.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.938+0000 7fd2dbfff700 1 -- 172.21.15.103:0/4271731659 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2792501506 0 0) 0x7fd2c8002fe0 con 0x7fd2e413d170 2020-04-22T14:10:30.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.938+0000 7fd2dbfff700 1 -- 172.21.15.103:0/4271731659 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd2e413ff70 con 0x7fd2e413d170 2020-04-22T14:10:30.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.938+0000 7fd2dbfff700 1 -- 172.21.15.103:0/4271731659 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 785071428 0 0) 0x7fd2e4143320 con 0x7fd2e40ae7b0 2020-04-22T14:10:30.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.938+0000 7fd2dbfff700 1 -- 172.21.15.103:0/4271731659 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2c8002fe0 con 0x7fd2e40ae7b0 2020-04-22T14:10:30.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.938+0000 7fd2dbfff700 1 -- 172.21.15.103:0/4271731659 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fd2dc001b50 con 0x7fd2e413d170 2020-04-22T14:10:30.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.938+0000 7fd2dbfff700 1 -- 172.21.15.103:0/4271731659 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2e40668c0 msgr2=0x7fd2e4142da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:30.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.938+0000 7fd2dbfff700 1 --2- 172.21.15.103:0/4271731659 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2e40668c0 0x7fd2e4142da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:30.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.938+0000 7fd2dbfff700 1 -- 172.21.15.103:0/4271731659 >> v1:172.21.15.103:6789/0 conn(0x7fd2e413d170 legacy=0x7fd2e4154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:30.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.938+0000 7fd2dbfff700 1 -- 172.21.15.103:0/4271731659 >> v1:172.21.15.86:6789/0 conn(0x7fd2e40ae7b0 legacy=0x7fd2e4141200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:30.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.938+0000 7fd2dbfff700 1 --2- 172.21.15.103:0/4271731659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2c8004b60 0x7fd2c8004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:30.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.938+0000 7fd2dbfff700 1 --2- 172.21.15.103:0/4271731659 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2e40668c0 0x7fd2c8003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:30.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.938+0000 7fd2dbfff700 1 --2- 172.21.15.103:0/4271731659 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2c8003d80 0x7fd2c8004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:30.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.938+0000 7fd2dbfff700 1 -- 172.21.15.103:0/4271731659 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e40b7d00 con 0x7fd2c8003d80 2020-04-22T14:10:30.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.938+0000 7fd2dbfff700 1 -- 172.21.15.103:0/4271731659 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c8004660 con 0x7fd2c8004b60 2020-04-22T14:10:30.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.938+0000 7fd2dbfff700 1 -- 172.21.15.103:0/4271731659 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c800b750 con 0x7fd2e40668c0 2020-04-22T14:10:30.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.938+0000 7fd2e2d9d700 1 --2- 172.21.15.103:0/4271731659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2c8004b60 0x7fd2c8004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:30.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.938+0000 7fd2e259c700 1 --2- 172.21.15.103:0/4271731659 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2e40668c0 0x7fd2c8003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:30.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.938+0000 7fd2e359e700 1 --2- 172.21.15.103:0/4271731659 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2c8003d80 0x7fd2c8004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:30.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.938+0000 7fd2e2d9d700 1 -- 172.21.15.103:0/4271731659 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2e40668c0 msgr2=0x7fd2c8003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:30.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.938+0000 7fd2e2d9d700 1 --2- 172.21.15.103:0/4271731659 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2e40668c0 0x7fd2c8003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:30.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.938+0000 7fd2e2d9d700 1 -- 172.21.15.103:0/4271731659 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2c8003d80 msgr2=0x7fd2c8004200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:30.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.938+0000 7fd2e2d9d700 1 --2- 172.21.15.103:0/4271731659 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2c8003d80 0x7fd2c8004200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:30.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.938+0000 7fd2e2d9d700 1 -- 172.21.15.103:0/4271731659 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e4140f50 con 0x7fd2c8004b60 2020-04-22T14:10:30.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.938+0000 7fd2e359e700 1 --2- 172.21.15.103:0/4271731659 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2c8003d80 0x7fd2c8004200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:10:30.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.938+0000 7fd2e8800700 1 -- 172.21.15.103:0/4271731659 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e4141910 con 0x7fd2c8004b60 2020-04-22T14:10:30.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.938+0000 7fd2e2d9d700 1 --2- 172.21.15.103:0/4271731659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2c8004b60 0x7fd2c8004f40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd2cc002f30 tx=0x7fd2c8005630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:30.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.938+0000 7fd2e8800700 1 -- 172.21.15.103:0/4271731659 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e4142fe0 con 0x7fd2c8004b60 2020-04-22T14:10:30.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.939+0000 7fd2e2d9d700 1 --2- 172.21.15.103:0/4271731659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2c8004b60 0x7fd2c8004f40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd2cc002f30 tx=0x7fd2c8005630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:30.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.939+0000 7fd2e2d9d700 1 --2- 172.21.15.103:0/4271731659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2c8004b60 0x7fd2c8004f40 secure :-1 s=READY pgs=772 cs=0 l=1 rx=0x7fd2cc002f30 tx=0x7fd2c8005630).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:30.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.939+0000 7fd2e2d9d700 1 --2- 172.21.15.103:0/4271731659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2c8004b60 0x7fd2c8004f40 secure :-1 s=THROTTLE_DONE pgs=772 cs=0 l=1 rx=0x7fd2cc002f30 tx=0x7fd2c8005630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:30.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.939+0000 7fd2dbfff700 1 -- 172.21.15.103:0/4271731659 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2cc007390 con 0x7fd2c8004b60 2020-04-22T14:10:30.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.939+0000 7fd2e2d9d700 1 --2- 172.21.15.103:0/4271731659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2c8004b60 0x7fd2c8004f40 secure :-1 s=THROTTLE_DONE pgs=772 cs=0 l=1 rx=0x7fd2cc002f30 tx=0x7fd2c8005630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:30.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.939+0000 7fd2dbfff700 1 -- 172.21.15.103:0/4271731659 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2cc0074f0 con 0x7fd2c8004b60 2020-04-22T14:10:30.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.939+0000 7fd2e2d9d700 1 --2- 172.21.15.103:0/4271731659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2c8004b60 0x7fd2c8004f40 secure :-1 s=THROTTLE_DONE pgs=772 cs=0 l=1 rx=0x7fd2cc002f30 tx=0x7fd2c8005630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:30.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.939+0000 7fd2dbfff700 1 -- 172.21.15.103:0/4271731659 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2cc0058b0 con 0x7fd2c8004b60 2020-04-22T14:10:30.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.939+0000 7fd2e2d9d700 1 --2- 172.21.15.103:0/4271731659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2c8004b60 0x7fd2c8004f40 secure :-1 s=THROTTLE_DONE pgs=772 cs=0 l=1 rx=0x7fd2cc002f30 tx=0x7fd2c8005630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:30.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.939+0000 7fd2e8800700 1 -- 172.21.15.103:0/4271731659 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2bc003340 con 0x7fd2c8004b60 2020-04-22T14:10:30.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.940+0000 7fd2dbfff700 1 -- 172.21.15.103:0/4271731659 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fd2cc005a10 con 0x7fd2c8004b60 2020-04-22T14:10:30.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.940+0000 7fd2e2d9d700 1 --2- 172.21.15.103:0/4271731659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2c8004b60 0x7fd2c8004f40 secure :-1 s=THROTTLE_DONE pgs=772 cs=0 l=1 rx=0x7fd2cc002f30 tx=0x7fd2c8005630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:30.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.940+0000 7fd2dbfff700 1 --2- 172.21.15.103:0/4271731659 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2c8055d60 0x7fd2c8058220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:30.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.940+0000 7fd2dbfff700 1 -- 172.21.15.103:0/4271731659 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6202+0+0 (secure 0 0 0) 0x7fd2cc064250 con 0x7fd2c8004b60 2020-04-22T14:10:30.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.940+0000 7fd2e259c700 1 --2- 172.21.15.103:0/4271731659 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2c8055d60 0x7fd2c8058220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:30.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.941+0000 7fd2e259c700 1 --2- 172.21.15.103:0/4271731659 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2c8055d60 0x7fd2c8058220 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd2d4001150 tx=0x7fd2d40010d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:30.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.941+0000 7fd2e259c700 1 --2- 172.21.15.103:0/4271731659 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2c8055d60 0x7fd2c8058220 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd2d4001150 tx=0x7fd2d40010d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:30.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.941+0000 7fd2e259c700 1 --2- 172.21.15.103:0/4271731659 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2c8055d60 0x7fd2c8058220 secure :-1 s=READY pgs=290 cs=0 l=1 rx=0x7fd2d4001150 tx=0x7fd2d40010d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:30.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.944+0000 7fd2e2d9d700 1 --2- 172.21.15.103:0/4271731659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2c8004b60 0x7fd2c8004f40 secure :-1 s=THROTTLE_DONE pgs=772 cs=0 l=1 rx=0x7fd2cc002f30 tx=0x7fd2c8005630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:30.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:30.944+0000 7fd2dbfff700 1 -- 172.21.15.103:0/4271731659 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fd2cc03f750 con 0x7fd2c8004b60 2020-04-22T14:10:31.134 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.131+0000 7fd2e8800700 1 -- 172.21.15.103:0/4271731659 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd2bc002200 con 0x7fd2c8004b60 2020-04-22T14:10:31.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.387+0000 7fd2e2d9d700 1 --2- 172.21.15.103:0/4271731659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2c8004b60 0x7fd2c8004f40 secure :-1 s=THROTTLE_DONE pgs=772 cs=0 l=1 rx=0x7fd2cc002f30 tx=0x7fd2c8005630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:31.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.387+0000 7fd2dbfff700 1 -- 172.21.15.103:0/4271731659 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v30) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd2cc042d70 con 0x7fd2c8004b60 2020-04-22T14:10:31.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.388+0000 7fd2e8800700 1 -- 172.21.15.103:0/4271731659 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2c8055d60 msgr2=0x7fd2c8058220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:31.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.388+0000 7fd2e8800700 1 --2- 172.21.15.103:0/4271731659 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2c8055d60 0x7fd2c8058220 secure :-1 s=READY pgs=290 cs=0 l=1 rx=0x7fd2d4001150 tx=0x7fd2d40010d0).stop 2020-04-22T14:10:31.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.388+0000 7fd2e8800700 1 -- 172.21.15.103:0/4271731659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2c8004b60 msgr2=0x7fd2c8004f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:31.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.388+0000 7fd2e8800700 1 --2- 172.21.15.103:0/4271731659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2c8004b60 0x7fd2c8004f40 secure :-1 s=READY pgs=772 cs=0 l=1 rx=0x7fd2cc002f30 tx=0x7fd2c8005630).stop 2020-04-22T14:10:31.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.388+0000 7fd2e359e700 1 -- 172.21.15.103:0/4271731659 reap_dead start 2020-04-22T14:10:31.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.388+0000 7fd2e8800700 1 -- 172.21.15.103:0/4271731659 shutdown_connections 2020-04-22T14:10:31.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.388+0000 7fd2e8800700 1 --2- 172.21.15.103:0/4271731659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2c8004b60 0x7fd2c8004f40 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:31.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.388+0000 7fd2e8800700 1 -- 172.21.15.103:0/4271731659 >> 172.21.15.103:0/4271731659 conn(0x7fd2e406a0f0 msgr2=0x7fd2e413c700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:31.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.388+0000 7fd2e8800700 1 -- 172.21.15.103:0/4271731659 shutdown_connections 2020-04-22T14:10:31.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.388+0000 7fd2e8800700 1 -- 172.21.15.103:0/4271731659 wait complete. 2020-04-22T14:10:31.402 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:31.423 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-04-22T14:10:31.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.570+0000 7fe57b696700 1 Processor -- start 2020-04-22T14:10:31.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.570+0000 7fe57b696700 1 -- start start 2020-04-22T14:10:31.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.571+0000 7fe57b696700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe574143bc0 0x7fe574146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:31.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.571+0000 7fe57b696700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe5740b5ea0 0x7fe5740b6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:31.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.571+0000 7fe57b696700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe57405fbc0 con 0x7fe5740b9890 2020-04-22T14:10:31.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.571+0000 7fe57b696700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe57405fe60 con 0x7fe5740b5ea0 2020-04-22T14:10:31.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.571+0000 7fe57b696700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe574060100 con 0x7fe574143bc0 2020-04-22T14:10:31.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.571+0000 7fe579432700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe5740b9890 0x7fe5741434b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43194/0 (socket says 172.21.15.103:43194) 2020-04-22T14:10:31.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.571+0000 7fe579432700 1 -- 172.21.15.103:0/1474485567 learned_addr learned my addr 172.21.15.103:0/1474485567 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:31.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.571+0000 7fe579c33700 1 --2- 172.21.15.103:0/1474485567 >> v2:172.21.15.86:3300/0 conn(0x7fe5740b5ea0 0x7fe5740b6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:31.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.571+0000 7fe578c31700 1 --2- 172.21.15.103:0/1474485567 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe574143bc0 0x7fe574146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:31.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.571+0000 7fe563fff700 1 -- 172.21.15.103:0/1474485567 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3923581766 0 0) 0x7fe57405fbc0 con 0x7fe5740b9890 2020-04-22T14:10:31.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.571+0000 7fe563fff700 1 -- 172.21.15.103:0/1474485567 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe55c003230 con 0x7fe5740b9890 2020-04-22T14:10:31.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.572+0000 7fe578c31700 1 -- 172.21.15.103:0/1474485567 >> v2:172.21.15.86:3300/0 conn(0x7fe5740b5ea0 msgr2=0x7fe5740b6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:31.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.572+0000 7fe578c31700 1 --2- 172.21.15.103:0/1474485567 >> v2:172.21.15.86:3300/0 conn(0x7fe5740b5ea0 0x7fe5740b6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:31.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.572+0000 7fe578c31700 1 -- 172.21.15.103:0/1474485567 >> v1:172.21.15.103:6789/0 conn(0x7fe5740b9890 legacy=0x7fe5741434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:31.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.572+0000 7fe563fff700 1 -- 172.21.15.103:0/1474485567 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3510050662 0 0) 0x7fe55c003230 con 0x7fe5740b9890 2020-04-22T14:10:31.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.572+0000 7fe578c31700 1 -- 172.21.15.103:0/1474485567 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5740b9c70 con 0x7fe574143bc0 2020-04-22T14:10:31.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.572+0000 7fe579c33700 1 --2- 172.21.15.103:0/1474485567 >> v2:172.21.15.86:3300/0 conn(0x7fe5740b5ea0 0x7fe5740b6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:10:31.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.572+0000 7fe578c31700 1 --2- 172.21.15.103:0/1474485567 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe574143bc0 0x7fe574146fc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe570001870 tx=0x7fe564007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:31.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.572+0000 7fe578c31700 1 --2- 172.21.15.103:0/1474485567 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe574143bc0 0x7fe574146fc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe570001870 tx=0x7fe564007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:31.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.572+0000 7fe578c31700 1 --2- 172.21.15.103:0/1474485567 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe574143bc0 0x7fe574146fc0 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7fe570001870 tx=0x7fe564007a40).ready entity=mon.2 client_cookie=c0f494b3eece2ccc server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:31.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.572+0000 7fe578c31700 1 --2- 172.21.15.103:0/1474485567 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe574143bc0 0x7fe574146fc0 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7fe570001870 tx=0x7fe564007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:31.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.572+0000 7fe563fff700 1 -- 172.21.15.103:0/1474485567 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5700016d0 con 0x7fe574143bc0 2020-04-22T14:10:31.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.572+0000 7fe578c31700 1 --2- 172.21.15.103:0/1474485567 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe574143bc0 0x7fe574146fc0 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7fe570001870 tx=0x7fe564007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:31.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.572+0000 7fe563fff700 1 -- 172.21.15.103:0/1474485567 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe564008b40 con 0x7fe574143bc0 2020-04-22T14:10:31.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.572+0000 7fe578c31700 1 --2- 172.21.15.103:0/1474485567 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe574143bc0 0x7fe574146fc0 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7fe570001870 tx=0x7fe564007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:31.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.572+0000 7fe563fff700 1 -- 172.21.15.103:0/1474485567 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5640115a0 con 0x7fe574143bc0 2020-04-22T14:10:31.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.572+0000 7fe57b696700 1 -- 172.21.15.103:0/1474485567 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe574143bc0 msgr2=0x7fe574146fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:31.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.572+0000 7fe57b696700 1 --2- 172.21.15.103:0/1474485567 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe574143bc0 0x7fe574146fc0 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7fe570001870 tx=0x7fe564007a40).stop 2020-04-22T14:10:31.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.573+0000 7fe57b696700 1 -- 172.21.15.103:0/1474485567 shutdown_connections 2020-04-22T14:10:31.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.573+0000 7fe57b696700 1 --2- 172.21.15.103:0/1474485567 >> v2:172.21.15.86:3300/0 conn(0x7fe5740b5ea0 0x7fe5740b6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:31.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.573+0000 7fe57b696700 1 --2- 172.21.15.103:0/1474485567 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe574143bc0 0x7fe574146fc0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:31.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.573+0000 7fe57b696700 1 -- 172.21.15.103:0/1474485567 >> 172.21.15.103:0/1474485567 conn(0x7fe57405ad30 msgr2=0x7fe57405b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:31.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.573+0000 7fe57b696700 1 -- 172.21.15.103:0/1474485567 shutdown_connections 2020-04-22T14:10:31.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.573+0000 7fe57b696700 1 -- 172.21.15.103:0/1474485567 wait complete. 2020-04-22T14:10:31.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.574+0000 7fe57b696700 1 Processor -- start 2020-04-22T14:10:31.582 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.574+0000 7fe57b696700 1 -- start start 2020-04-22T14:10:31.590 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.574+0000 7fe57b696700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe5740b9890 0x7fe57412e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:31.590 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.574+0000 7fe57b696700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe57412df30 con 0x7fe574143bc0 2020-04-22T14:10:31.591 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.574+0000 7fe57b696700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5740bbdb0 con 0x7fe5740b5ea0 2020-04-22T14:10:31.591 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.574+0000 7fe57b696700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe57412e190 con 0x7fe5740b9890 2020-04-22T14:10:31.591 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.574+0000 7fe579432700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe5740b5ea0 0x7fe5741577e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43200/0 (socket says 172.21.15.103:43200) 2020-04-22T14:10:31.591 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.574+0000 7fe579432700 1 -- 172.21.15.103:0/3197171137 learned_addr learned my addr 172.21.15.103:0/3197171137 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:31.591 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.574+0000 7fe5627fc700 1 -- 172.21.15.103:0/3197171137 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1579459653 0 0) 0x7fe5740bbdb0 con 0x7fe5740b5ea0 2020-04-22T14:10:31.591 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.574+0000 7fe5627fc700 1 -- 172.21.15.103:0/3197171137 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe554002fe0 con 0x7fe5740b5ea0 2020-04-22T14:10:31.591 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.575+0000 7fe578c31700 1 --2- 172.21.15.103:0/3197171137 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe5740b9890 0x7fe57412e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:31.591 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.575+0000 7fe5627fc700 1 -- 172.21.15.103:0/3197171137 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1259659491 0 0) 0x7fe554002fe0 con 0x7fe5740b5ea0 2020-04-22T14:10:31.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.575+0000 7fe5627fc700 1 -- 172.21.15.103:0/3197171137 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe5740bbdb0 con 0x7fe5740b5ea0 2020-04-22T14:10:31.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.575+0000 7fe5627fc700 1 -- 172.21.15.103:0/3197171137 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fe570001250 con 0x7fe5740b5ea0 2020-04-22T14:10:31.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.575+0000 7fe5627fc700 1 -- 172.21.15.103:0/3197171137 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe5740b9890 msgr2=0x7fe57412e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:31.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.575+0000 7fe5627fc700 1 --2- 172.21.15.103:0/3197171137 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe5740b9890 0x7fe57412e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:31.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.575+0000 7fe5627fc700 1 -- 172.21.15.103:0/3197171137 >> v1:172.21.15.103:6789/0 conn(0x7fe5740b5ea0 legacy=0x7fe5741577e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:31.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.575+0000 7fe5627fc700 1 -- 172.21.15.103:0/3197171137 >> v1:172.21.15.86:6789/0 conn(0x7fe574143bc0 legacy=0x7fe5741442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:31.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.575+0000 7fe5627fc700 1 --2- 172.21.15.103:0/3197171137 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe5740b9890 0x7fe5540049b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:31.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.575+0000 7fe5627fc700 1 --2- 172.21.15.103:0/3197171137 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe554004e10 0x7fe554005230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:31.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.575+0000 7fe5627fc700 1 --2- 172.21.15.103:0/3197171137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe554003a30 0x7fe554003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:31.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.575+0000 7fe5627fc700 1 -- 172.21.15.103:0/3197171137 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57412e190 con 0x7fe554004e10 2020-04-22T14:10:31.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.575+0000 7fe5627fc700 1 -- 172.21.15.103:0/3197171137 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe554004580 con 0x7fe554003a30 2020-04-22T14:10:31.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.575+0000 7fe5627fc700 1 -- 172.21.15.103:0/3197171137 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe554004740 con 0x7fe5740b9890 2020-04-22T14:10:31.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.575+0000 7fe579c33700 1 --2- 172.21.15.103:0/3197171137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe554003a30 0x7fe554003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:31.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.575+0000 7fe579432700 1 --2- 172.21.15.103:0/3197171137 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe5740b9890 0x7fe5540049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:31.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.575+0000 7fe578c31700 1 --2- 172.21.15.103:0/3197171137 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe554004e10 0x7fe554005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:31.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.575+0000 7fe579c33700 1 -- 172.21.15.103:0/3197171137 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe5740b9890 msgr2=0x7fe5540049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:31.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.575+0000 7fe579c33700 1 --2- 172.21.15.103:0/3197171137 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe5740b9890 0x7fe5540049b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:31.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.575+0000 7fe579c33700 1 -- 172.21.15.103:0/3197171137 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe554004e10 msgr2=0x7fe554005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:31.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.575+0000 7fe579c33700 1 --2- 172.21.15.103:0/3197171137 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe554004e10 0x7fe554005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:31.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.575+0000 7fe579c33700 1 -- 172.21.15.103:0/3197171137 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5741459d0 con 0x7fe554003a30 2020-04-22T14:10:31.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.575+0000 7fe57b696700 1 -- 172.21.15.103:0/3197171137 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe574157ef0 con 0x7fe554003a30 2020-04-22T14:10:31.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.575+0000 7fe579c33700 1 --2- 172.21.15.103:0/3197171137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe554003a30 0x7fe554003eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe56c007ca0 tx=0x7fe56c0111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:31.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.575+0000 7fe579c33700 1 --2- 172.21.15.103:0/3197171137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe554003a30 0x7fe554003eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe56c007ca0 tx=0x7fe56c0111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:31.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.575+0000 7fe579c33700 1 --2- 172.21.15.103:0/3197171137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe554003a30 0x7fe554003eb0 secure :-1 s=READY pgs=775 cs=0 l=1 rx=0x7fe56c007ca0 tx=0x7fe56c0111e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:31.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.575+0000 7fe579c33700 1 --2- 172.21.15.103:0/3197171137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe554003a30 0x7fe554003eb0 secure :-1 s=THROTTLE_DONE pgs=775 cs=0 l=1 rx=0x7fe56c007ca0 tx=0x7fe56c0111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:31.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.575+0000 7fe5627fc700 1 -- 172.21.15.103:0/3197171137 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe56c005a40 con 0x7fe554003a30 2020-04-22T14:10:31.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.575+0000 7fe579c33700 1 --2- 172.21.15.103:0/3197171137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe554003a30 0x7fe554003eb0 secure :-1 s=THROTTLE_DONE pgs=775 cs=0 l=1 rx=0x7fe56c007ca0 tx=0x7fe56c0111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:31.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.575+0000 7fe5627fc700 1 -- 172.21.15.103:0/3197171137 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe56c005ba0 con 0x7fe554003a30 2020-04-22T14:10:31.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.575+0000 7fe579c33700 1 --2- 172.21.15.103:0/3197171137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe554003a30 0x7fe554003eb0 secure :-1 s=THROTTLE_DONE pgs=775 cs=0 l=1 rx=0x7fe56c007ca0 tx=0x7fe56c0111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:31.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.575+0000 7fe57b696700 1 -- 172.21.15.103:0/3197171137 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe57412e870 con 0x7fe554003a30 2020-04-22T14:10:31.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.575+0000 7fe5627fc700 1 -- 172.21.15.103:0/3197171137 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe56c00c7d0 con 0x7fe554003a30 2020-04-22T14:10:31.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.576+0000 7fe579c33700 1 --2- 172.21.15.103:0/3197171137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe554003a30 0x7fe554003eb0 secure :-1 s=THROTTLE_DONE pgs=775 cs=0 l=1 rx=0x7fe56c007ca0 tx=0x7fe56c0111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:31.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.576+0000 7fe57b696700 1 -- 172.21.15.103:0/3197171137 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5741580e0 con 0x7fe554003a30 2020-04-22T14:10:31.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.576+0000 7fe5627fc700 1 -- 172.21.15.103:0/3197171137 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fe56c00c930 con 0x7fe554003a30 2020-04-22T14:10:31.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.576+0000 7fe579c33700 1 --2- 172.21.15.103:0/3197171137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe554003a30 0x7fe554003eb0 secure :-1 s=THROTTLE_DONE pgs=775 cs=0 l=1 rx=0x7fe56c007ca0 tx=0x7fe56c0111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:31.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.577+0000 7fe5627fc700 1 --2- 172.21.15.103:0/3197171137 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe554055c70 0x7fe554058130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:31.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.577+0000 7fe5627fc700 1 -- 172.21.15.103:0/3197171137 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6202+0+0 (secure 0 0 0) 0x7fe56c0612a0 con 0x7fe554003a30 2020-04-22T14:10:31.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.577+0000 7fe579432700 1 --2- 172.21.15.103:0/3197171137 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe554055c70 0x7fe554058130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:31.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.577+0000 7fe579432700 1 --2- 172.21.15.103:0/3197171137 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe554055c70 0x7fe554058130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe570001830 tx=0x7fe570000ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:31.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.577+0000 7fe579432700 1 --2- 172.21.15.103:0/3197171137 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe554055c70 0x7fe554058130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe570001830 tx=0x7fe570000ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:31.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.577+0000 7fe579432700 1 --2- 172.21.15.103:0/3197171137 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe554055c70 0x7fe554058130 secure :-1 s=READY pgs=291 cs=0 l=1 rx=0x7fe570001830 tx=0x7fe570000ef0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:31.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.581+0000 7fe579c33700 1 --2- 172.21.15.103:0/3197171137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe554003a30 0x7fe554003eb0 secure :-1 s=THROTTLE_DONE pgs=775 cs=0 l=1 rx=0x7fe56c007ca0 tx=0x7fe56c0111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:31.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.581+0000 7fe5627fc700 1 -- 172.21.15.103:0/3197171137 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fe56c03c740 con 0x7fe554003a30 2020-04-22T14:10:31.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:31.722+0000 7fe57b696700 1 -- 172.21.15.103:0/3197171137 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe57412e330 con 0x7fe554003a30 2020-04-22T14:10:32.397 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.394+0000 7fe579c33700 1 --2- 172.21.15.103:0/3197171137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe554003a30 0x7fe554003eb0 secure :-1 s=THROTTLE_DONE pgs=775 cs=0 l=1 rx=0x7fe56c007ca0 tx=0x7fe56c0111e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:32.397 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.394+0000 7fe5627fc700 1 -- 172.21.15.103:0/3197171137 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v57) v1 ==== 185+0+0 (secure 0 0 0) 0x7fe56c03fd60 con 0x7fe554003a30 2020-04-22T14:10:32.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.396+0000 7fe57b696700 1 -- 172.21.15.103:0/3197171137 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe554055c70 msgr2=0x7fe554058130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:32.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.396+0000 7fe57b696700 1 --2- 172.21.15.103:0/3197171137 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe554055c70 0x7fe554058130 secure :-1 s=READY pgs=291 cs=0 l=1 rx=0x7fe570001830 tx=0x7fe570000ef0).stop 2020-04-22T14:10:32.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.396+0000 7fe57b696700 1 -- 172.21.15.103:0/3197171137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe554003a30 msgr2=0x7fe554003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:32.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.396+0000 7fe57b696700 1 --2- 172.21.15.103:0/3197171137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe554003a30 0x7fe554003eb0 secure :-1 s=READY pgs=775 cs=0 l=1 rx=0x7fe56c007ca0 tx=0x7fe56c0111e0).stop 2020-04-22T14:10:32.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.396+0000 7fe579c33700 1 -- 172.21.15.103:0/3197171137 reap_dead start 2020-04-22T14:10:32.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.396+0000 7fe579c33700 1 -- 172.21.15.103:0/3197171137 reap_dead start 2020-04-22T14:10:32.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.397+0000 7fe57b696700 1 -- 172.21.15.103:0/3197171137 shutdown_connections 2020-04-22T14:10:32.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.397+0000 7fe57b696700 1 -- 172.21.15.103:0/3197171137 >> 172.21.15.103:0/3197171137 conn(0x7fe57405ad30 msgr2=0x7fe57405c690 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:32.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.397+0000 7fe57b696700 1 -- 172.21.15.103:0/3197171137 shutdown_connections 2020-04-22T14:10:32.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.397+0000 7fe57b696700 1 -- 172.21.15.103:0/3197171137 wait complete. 2020-04-22T14:10:32.402 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' removed 2020-04-22T14:10:32.411 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:32.426 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2020-04-22T14:10:32.582 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.579+0000 7fc790fe8700 1 Processor -- start 2020-04-22T14:10:32.582 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.579+0000 7fc790fe8700 1 -- start start 2020-04-22T14:10:32.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.580+0000 7fc790fe8700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc78c0b4820 0x7fc78c0acb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:32.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.580+0000 7fc790fe8700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc78c141f20 0x7fc78c142380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:32.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.580+0000 7fc790fe8700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc78c0af030 con 0x7fc78c061a30 2020-04-22T14:10:32.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.580+0000 7fc790fe8700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc78c060250 con 0x7fc78c141f20 2020-04-22T14:10:32.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.580+0000 7fc790fe8700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc78c0623c0 con 0x7fc78c0b4820 2020-04-22T14:10:32.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.580+0000 7fc789d9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc78c0b4820 0x7fc78c0acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:32.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.580+0000 7fc78a59c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc78c061a30 0x7fc78c0ae920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43214/0 (socket says 172.21.15.103:43214) 2020-04-22T14:10:32.590 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.580+0000 7fc78a59c700 1 -- 172.21.15.103:0/1544873414 learned_addr learned my addr 172.21.15.103:0/1544873414 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:32.590 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.580+0000 7fc78ad9d700 1 --2- 172.21.15.103:0/1544873414 >> v2:172.21.15.86:3300/0 conn(0x7fc78c141f20 0x7fc78c142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:32.590 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.580+0000 7fc789d9b700 1 -- 172.21.15.103:0/1544873414 >> v2:172.21.15.86:3300/0 conn(0x7fc78c141f20 msgr2=0x7fc78c142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:32.590 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.580+0000 7fc789d9b700 1 --2- 172.21.15.103:0/1544873414 >> v2:172.21.15.86:3300/0 conn(0x7fc78c141f20 0x7fc78c142380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:32.591 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.580+0000 7fc789d9b700 1 -- 172.21.15.103:0/1544873414 >> v1:172.21.15.103:6789/0 conn(0x7fc78c061a30 legacy=0x7fc78c0ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:32.591 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.580+0000 7fc789d9b700 1 -- 172.21.15.103:0/1544873414 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc78c062660 con 0x7fc78c0b4820 2020-04-22T14:10:32.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.580+0000 7fc78959a700 1 -- 172.21.15.103:0/1544873414 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3806318185 0 0) 0x7fc78c0af030 con 0x7fc78c061a30 2020-04-22T14:10:32.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.580+0000 7fc789d9b700 1 --2- 172.21.15.103:0/1544873414 >> v2:172.21.15.103:3300/0 conn(0x7fc78c0b4820 0x7fc78c0acb10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc780002f30 tx=0x7fc780007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:32.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.580+0000 7fc789d9b700 1 --2- 172.21.15.103:0/1544873414 >> v2:172.21.15.103:3300/0 conn(0x7fc78c0b4820 0x7fc78c0acb10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc780002f30 tx=0x7fc780007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:32.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.580+0000 7fc789d9b700 1 --2- 172.21.15.103:0/1544873414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc78c0b4820 0x7fc78c0acb10 secure :-1 s=READY pgs=777 cs=0 l=1 rx=0x7fc780002f30 tx=0x7fc780007a40).ready entity=mon.1 client_cookie=953c373773abc12a server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:32.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.580+0000 7fc789d9b700 1 --2- 172.21.15.103:0/1544873414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc78c0b4820 0x7fc78c0acb10 secure :-1 s=THROTTLE_DONE pgs=777 cs=0 l=1 rx=0x7fc780002f30 tx=0x7fc780007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:32.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.580+0000 7fc78959a700 1 -- 172.21.15.103:0/1544873414 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc780011470 con 0x7fc78c0b4820 2020-04-22T14:10:32.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.580+0000 7fc789d9b700 1 --2- 172.21.15.103:0/1544873414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc78c0b4820 0x7fc78c0acb10 secure :-1 s=THROTTLE_DONE pgs=777 cs=0 l=1 rx=0x7fc780002f30 tx=0x7fc780007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:32.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.580+0000 7fc789d9b700 1 --2- 172.21.15.103:0/1544873414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc78c0b4820 0x7fc78c0acb10 secure :-1 s=THROTTLE_DONE pgs=777 cs=0 l=1 rx=0x7fc780002f30 tx=0x7fc780007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:32.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.580+0000 7fc78959a700 1 -- 172.21.15.103:0/1544873414 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7800115d0 con 0x7fc78c0b4820 2020-04-22T14:10:32.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.580+0000 7fc78959a700 1 -- 172.21.15.103:0/1544873414 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7800119b0 con 0x7fc78c0b4820 2020-04-22T14:10:32.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.580+0000 7fc790fe8700 1 -- 172.21.15.103:0/1544873414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc78c0b4820 msgr2=0x7fc78c0acb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:32.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.580+0000 7fc790fe8700 1 --2- 172.21.15.103:0/1544873414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc78c0b4820 0x7fc78c0acb10 secure :-1 s=READY pgs=777 cs=0 l=1 rx=0x7fc780002f30 tx=0x7fc780007a40).stop 2020-04-22T14:10:32.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.581+0000 7fc790fe8700 1 -- 172.21.15.103:0/1544873414 shutdown_connections 2020-04-22T14:10:32.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.581+0000 7fc790fe8700 1 --2- 172.21.15.103:0/1544873414 >> v2:172.21.15.86:3300/0 conn(0x7fc78c141f20 0x7fc78c142380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:32.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.581+0000 7fc790fe8700 1 --2- 172.21.15.103:0/1544873414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc78c0b4820 0x7fc78c0acb10 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:32.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.581+0000 7fc790fe8700 1 -- 172.21.15.103:0/1544873414 >> 172.21.15.103:0/1544873414 conn(0x7fc78c05b7b0 msgr2=0x7fc78c0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:32.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.581+0000 7fc790fe8700 1 -- 172.21.15.103:0/1544873414 shutdown_connections 2020-04-22T14:10:32.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.581+0000 7fc790fe8700 1 -- 172.21.15.103:0/1544873414 wait complete. 2020-04-22T14:10:32.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.582+0000 7fc790fe8700 1 Processor -- start 2020-04-22T14:10:32.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.582+0000 7fc790fe8700 1 -- start start 2020-04-22T14:10:32.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.583+0000 7fc790fe8700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc78c141f20 0x7fc78c0b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:32.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.583+0000 7fc790fe8700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc78c065350 con 0x7fc78c0b4820 2020-04-22T14:10:32.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.583+0000 7fc790fe8700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc78c0b1fe0 con 0x7fc78c061a30 2020-04-22T14:10:32.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.583+0000 7fc790fe8700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc78c155df0 con 0x7fc78c141f20 2020-04-22T14:10:32.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.583+0000 7fc78a59c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc78c061a30 0x7fc78c151270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43220/0 (socket says 172.21.15.103:43220) 2020-04-22T14:10:32.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.583+0000 7fc78a59c700 1 -- 172.21.15.103:0/2533939952 learned_addr learned my addr 172.21.15.103:0/2533939952 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:32.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.583+0000 7fc78ad9d700 1 --2- 172.21.15.103:0/2533939952 >> v2:172.21.15.103:3300/0 conn(0x7fc78c141f20 0x7fc78c0b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:32.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.583+0000 7fc77b7fe700 1 -- 172.21.15.103:0/2533939952 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2964495585 0 0) 0x7fc77c000ff0 con 0x7fc78c061a30 2020-04-22T14:10:32.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.583+0000 7fc77b7fe700 1 -- 172.21.15.103:0/2533939952 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc768002fe0 con 0x7fc78c061a30 2020-04-22T14:10:32.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.583+0000 7fc78ad9d700 1 -- 172.21.15.103:0/2533939952 >> v1:172.21.15.103:6789/0 conn(0x7fc78c061a30 legacy=0x7fc78c151270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:32.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.583+0000 7fc78ad9d700 1 -- 172.21.15.103:0/2533939952 >> v1:172.21.15.86:6789/0 conn(0x7fc78c0b4820 legacy=0x7fc78c065780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:32.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.583+0000 7fc78ad9d700 1 -- 172.21.15.103:0/2533939952 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc78c156090 con 0x7fc78c141f20 2020-04-22T14:10:32.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.583+0000 7fc78ad9d700 1 --2- 172.21.15.103:0/2533939952 >> v2:172.21.15.103:3300/0 conn(0x7fc78c141f20 0x7fc78c0b1b80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc7840032b0 tx=0x7fc784010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:32.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.583+0000 7fc78ad9d700 1 --2- 172.21.15.103:0/2533939952 >> v2:172.21.15.103:3300/0 conn(0x7fc78c141f20 0x7fc78c0b1b80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc7840032b0 tx=0x7fc784010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:32.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.583+0000 7fc78ad9d700 1 --2- 172.21.15.103:0/2533939952 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc78c141f20 0x7fc78c0b1b80 secure :-1 s=READY pgs=779 cs=0 l=1 rx=0x7fc7840032b0 tx=0x7fc784010c30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:32.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.583+0000 7fc78ad9d700 1 --2- 172.21.15.103:0/2533939952 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc78c141f20 0x7fc78c0b1b80 secure :-1 s=THROTTLE_DONE pgs=779 cs=0 l=1 rx=0x7fc7840032b0 tx=0x7fc784010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:32.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.583+0000 7fc77b7fe700 1 -- 172.21.15.103:0/2533939952 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7840129b0 con 0x7fc78c141f20 2020-04-22T14:10:32.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.583+0000 7fc78ad9d700 1 --2- 172.21.15.103:0/2533939952 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc78c141f20 0x7fc78c0b1b80 secure :-1 s=THROTTLE_DONE pgs=779 cs=0 l=1 rx=0x7fc7840032b0 tx=0x7fc784010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:32.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.583+0000 7fc78ad9d700 1 --2- 172.21.15.103:0/2533939952 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc78c141f20 0x7fc78c0b1b80 secure :-1 s=THROTTLE_DONE pgs=779 cs=0 l=1 rx=0x7fc7840032b0 tx=0x7fc784010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:32.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.583+0000 7fc77b7fe700 1 -- 172.21.15.103:0/2533939952 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc784012b10 con 0x7fc78c141f20 2020-04-22T14:10:32.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.583+0000 7fc790fe8700 1 -- 172.21.15.103:0/2533939952 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc78c151980 con 0x7fc78c141f20 2020-04-22T14:10:32.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.583+0000 7fc77b7fe700 1 -- 172.21.15.103:0/2533939952 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc784009180 con 0x7fc78c141f20 2020-04-22T14:10:32.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.583+0000 7fc790fe8700 1 -- 172.21.15.103:0/2533939952 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc78c064f50 con 0x7fc78c141f20 2020-04-22T14:10:32.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.584+0000 7fc78ad9d700 1 --2- 172.21.15.103:0/2533939952 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc78c141f20 0x7fc78c0b1b80 secure :-1 s=THROTTLE_DONE pgs=779 cs=0 l=1 rx=0x7fc7840032b0 tx=0x7fc784010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:32.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.584+0000 7fc77b7fe700 1 -- 172.21.15.103:0/2533939952 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fc78400b350 con 0x7fc78c141f20 2020-04-22T14:10:32.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.584+0000 7fc78ad9d700 1 --2- 172.21.15.103:0/2533939952 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc78c141f20 0x7fc78c0b1b80 secure :-1 s=THROTTLE_DONE pgs=779 cs=0 l=1 rx=0x7fc7840032b0 tx=0x7fc784010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:32.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.584+0000 7fc790fe8700 1 -- 172.21.15.103:0/2533939952 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc78c056c90 con 0x7fc78c141f20 2020-04-22T14:10:32.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.585+0000 7fc77b7fe700 1 --2- 172.21.15.103:0/2533939952 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc76804dca0 0x7fc768050160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:32.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.585+0000 7fc77b7fe700 1 -- 172.21.15.103:0/2533939952 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5764+0+0 (secure 0 0 0) 0x7fc784061f80 con 0x7fc78c141f20 2020-04-22T14:10:32.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.585+0000 7fc78a59c700 1 --2- 172.21.15.103:0/2533939952 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc76804dca0 0x7fc768050160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:32.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.585+0000 7fc78a59c700 1 --2- 172.21.15.103:0/2533939952 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc76804dca0 0x7fc768050160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc78c0b2220 tx=0x7fc77c001850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:32.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.585+0000 7fc78a59c700 1 --2- 172.21.15.103:0/2533939952 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc76804dca0 0x7fc768050160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc78c0b2220 tx=0x7fc77c001850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:32.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.585+0000 7fc78a59c700 1 --2- 172.21.15.103:0/2533939952 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc76804dca0 0x7fc768050160 secure :-1 s=READY pgs=292 cs=0 l=1 rx=0x7fc78c0b2220 tx=0x7fc77c001850).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:32.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.589+0000 7fc78ad9d700 1 --2- 172.21.15.103:0/2533939952 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc78c141f20 0x7fc78c0b1b80 secure :-1 s=THROTTLE_DONE pgs=779 cs=0 l=1 rx=0x7fc7840032b0 tx=0x7fc784010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:32.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.589+0000 7fc77b7fe700 1 -- 172.21.15.103:0/2533939952 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fc78403d300 con 0x7fc78c141f20 2020-04-22T14:10:32.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:32.730+0000 7fc790fe8700 1 -- 172.21.15.103:0/2533939952 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc78c0b6da0 con 0x7fc78c141f20 2020-04-22T14:10:33.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.399+0000 7fc78ad9d700 1 --2- 172.21.15.103:0/2533939952 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc78c141f20 0x7fc78c0b1b80 secure :-1 s=THROTTLE_DONE pgs=779 cs=0 l=1 rx=0x7fc7840032b0 tx=0x7fc784010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:33.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.399+0000 7fc77b7fe700 1 -- 172.21.15.103:0/2533939952 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v58) v1 ==== 173+0+0 (secure 0 0 0) 0x7fc784040920 con 0x7fc78c141f20 2020-04-22T14:10:33.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.402+0000 7fc790fe8700 1 -- 172.21.15.103:0/2533939952 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc76804dca0 msgr2=0x7fc768050160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:33.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.402+0000 7fc790fe8700 1 --2- 172.21.15.103:0/2533939952 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc76804dca0 0x7fc768050160 secure :-1 s=READY pgs=292 cs=0 l=1 rx=0x7fc78c0b2220 tx=0x7fc77c001850).stop 2020-04-22T14:10:33.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.402+0000 7fc790fe8700 1 -- 172.21.15.103:0/2533939952 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc78c141f20 msgr2=0x7fc78c0b1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:33.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.402+0000 7fc790fe8700 1 --2- 172.21.15.103:0/2533939952 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc78c141f20 0x7fc78c0b1b80 secure :-1 s=READY pgs=779 cs=0 l=1 rx=0x7fc7840032b0 tx=0x7fc784010c30).stop 2020-04-22T14:10:33.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.402+0000 7fc790fe8700 1 -- 172.21.15.103:0/2533939952 shutdown_connections 2020-04-22T14:10:33.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.402+0000 7fc790fe8700 1 --2- 172.21.15.103:0/2533939952 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc76804dca0 0x7fc768050160 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:33.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.402+0000 7fc790fe8700 1 --2- 172.21.15.103:0/2533939952 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc78c141f20 0x7fc78c0b1b80 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:33.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.402+0000 7fc790fe8700 1 -- 172.21.15.103:0/2533939952 >> 172.21.15.103:0/2533939952 conn(0x7fc78c05b7b0 msgr2=0x7fc78c141390 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:33.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.402+0000 7fc790fe8700 1 -- 172.21.15.103:0/2533939952 shutdown_connections 2020-04-22T14:10:33.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.402+0000 7fc790fe8700 1 -- 172.21.15.103:0/2533939952 wait complete. 2020-04-22T14:10:33.407 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' removed 2020-04-22T14:10:33.417 INFO:tasks.ceph.mds.a:Restarting daemon 2020-04-22T14:10:33.417 INFO:tasks.ceph.mds.a:Stopping old one... 2020-04-22T14:10:33.417 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-04-22T14:10:33.418 INFO:teuthology.orchestra.run:waiting for 300 2020-04-22T14:10:33.418 INFO:tasks.ceph.mds.b:Restarting daemon 2020-04-22T14:10:33.418 INFO:tasks.ceph.mds.b:Stopping old one... 2020-04-22T14:10:33.418 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-04-22T14:10:33.418 INFO:teuthology.orchestra.run:waiting for 300 2020-04-22T14:10:33.426 INFO:tasks.ceph.mds.a:Stopped 2020-04-22T14:10:33.426 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:33.428 INFO:tasks.ceph.mds.b:Stopped 2020-04-22T14:10:33.428 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:10:33.482 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-04-22T14:10:33.492 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-04-22T14:10:33.524 INFO:tasks.ceph.mds.a:Started 2020-04-22T14:10:33.524 DEBUG:teuthology.parallel:result is None 2020-04-22T14:10:33.534 INFO:tasks.ceph.mds.b:Started 2020-04-22T14:10:33.534 DEBUG:teuthology.parallel:result is None 2020-04-22T14:10:33.534 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:33.550 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2020-04-22T14:10:33.601 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2020-04-22T14:10:33.615 INFO:tasks.ceph.mds.b.smithi086.stdout:starting mds.b at 2020-04-22T14:10:33.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.698+0000 7fea0d3a3700 1 Processor -- start 2020-04-22T14:10:33.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.698+0000 7fea0d3a3700 1 -- start start 2020-04-22T14:10:33.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.699+0000 7fea0d3a3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fea080b86a0 0x7fea0805b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:33.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.699+0000 7fea0d3a3700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea0814ab90 con 0x7fea08143a50 2020-04-22T14:10:33.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.699+0000 7fea0d3a3700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea08146a20 con 0x7fea0805b0b0 2020-04-22T14:10:33.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.699+0000 7fea0d3a3700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea08146830 con 0x7fea080b86a0 2020-04-22T14:10:33.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.700+0000 7fea067fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fea080b86a0 0x7fea0805b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:33.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.700+0000 7fea06ffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fea0805b0b0 0x7fea0805f800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43240/0 (socket says 172.21.15.103:43240) 2020-04-22T14:10:33.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.700+0000 7fea06ffd700 1 -- 172.21.15.103:0/3111193761 learned_addr learned my addr 172.21.15.103:0/3111193761 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:33.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.700+0000 7fea067fc700 1 -- 172.21.15.103:0/3111193761 >> v1:172.21.15.103:6789/0 conn(0x7fea0805b0b0 legacy=0x7fea0805f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:33.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.700+0000 7fea067fc700 1 -- 172.21.15.103:0/3111193761 >> v1:172.21.15.86:6789/0 conn(0x7fea08143a50 legacy=0x7fea08146ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:33.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.700+0000 7fea05ffb700 1 -- 172.21.15.103:0/3111193761 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 95352718 0 0) 0x7fea08146a20 con 0x7fea0805b0b0 2020-04-22T14:10:33.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.700+0000 7fea067fc700 1 -- 172.21.15.103:0/3111193761 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea0805ff10 con 0x7fea080b86a0 2020-04-22T14:10:33.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.700+0000 7fea067fc700 1 --2- 172.21.15.103:0/3111193761 >> v2:172.21.15.103:3300/0 conn(0x7fea080b86a0 0x7fea0805b490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fea08060ab0 tx=0x7fe9f80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:33.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.700+0000 7fea067fc700 1 --2- 172.21.15.103:0/3111193761 >> v2:172.21.15.103:3300/0 conn(0x7fea080b86a0 0x7fea0805b490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fea08060ab0 tx=0x7fe9f80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:33.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.700+0000 7fea067fc700 1 --2- 172.21.15.103:0/3111193761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea080b86a0 0x7fea0805b490 secure :-1 s=READY pgs=783 cs=0 l=1 rx=0x7fea08060ab0 tx=0x7fe9f80088e0).ready entity=mon.1 client_cookie=5975f8073a06eb08 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:33.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.700+0000 7fea067fc700 1 --2- 172.21.15.103:0/3111193761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea080b86a0 0x7fea0805b490 secure :-1 s=THROTTLE_DONE pgs=783 cs=0 l=1 rx=0x7fea08060ab0 tx=0x7fe9f80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:33.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.700+0000 7fea05ffb700 1 -- 172.21.15.103:0/3111193761 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9f8008e40 con 0x7fea080b86a0 2020-04-22T14:10:33.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.700+0000 7fea067fc700 1 --2- 172.21.15.103:0/3111193761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea080b86a0 0x7fea0805b490 secure :-1 s=THROTTLE_DONE pgs=783 cs=0 l=1 rx=0x7fea08060ab0 tx=0x7fe9f80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:33.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.700+0000 7fea05ffb700 1 -- 172.21.15.103:0/3111193761 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f8011660 con 0x7fea080b86a0 2020-04-22T14:10:33.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.700+0000 7fea067fc700 1 --2- 172.21.15.103:0/3111193761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea080b86a0 0x7fea0805b490 secure :-1 s=THROTTLE_DONE pgs=783 cs=0 l=1 rx=0x7fea08060ab0 tx=0x7fe9f80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:33.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.700+0000 7fea05ffb700 1 -- 172.21.15.103:0/3111193761 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9f8011a80 con 0x7fea080b86a0 2020-04-22T14:10:33.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.700+0000 7fea0d3a3700 1 -- 172.21.15.103:0/3111193761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea080b86a0 msgr2=0x7fea0805b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:33.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.700+0000 7fea0d3a3700 1 --2- 172.21.15.103:0/3111193761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea080b86a0 0x7fea0805b490 secure :-1 s=READY pgs=783 cs=0 l=1 rx=0x7fea08060ab0 tx=0x7fe9f80088e0).stop 2020-04-22T14:10:33.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.701+0000 7fea0d3a3700 1 -- 172.21.15.103:0/3111193761 shutdown_connections 2020-04-22T14:10:33.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.701+0000 7fea0d3a3700 1 --2- 172.21.15.103:0/3111193761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea080b86a0 0x7fea0805b490 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:33.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.701+0000 7fea0d3a3700 1 -- 172.21.15.103:0/3111193761 >> 172.21.15.103:0/3111193761 conn(0x7fea080bcae0 msgr2=0x7fea080bcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:33.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.701+0000 7fea0d3a3700 1 -- 172.21.15.103:0/3111193761 shutdown_connections 2020-04-22T14:10:33.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.701+0000 7fea0d3a3700 1 -- 172.21.15.103:0/3111193761 wait complete. 2020-04-22T14:10:33.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.702+0000 7fea0d3a3700 1 Processor -- start 2020-04-22T14:10:33.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.702+0000 7fea0d3a3700 1 -- start start 2020-04-22T14:10:33.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.702+0000 7fea0d3a3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fea080b86a0 0x7fea080ae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:33.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.702+0000 7fea0d3a3700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea080ae710 con 0x7fea08143a50 2020-04-22T14:10:33.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.702+0000 7fea0d3a3700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea080afc60 con 0x7fea0805b0b0 2020-04-22T14:10:33.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.702+0000 7fea0d3a3700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea080aff00 con 0x7fea080b86a0 2020-04-22T14:10:33.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.702+0000 7fea067fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fea080b86a0 0x7fea080ae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:33.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.702+0000 7fea067fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fea080b86a0 0x7fea080ae0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51058/0 (socket says 172.21.15.103:51058) 2020-04-22T14:10:33.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.702+0000 7fea067fc700 1 -- 172.21.15.103:0/1985920377 learned_addr learned my addr 172.21.15.103:0/1985920377 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:10:33.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.703+0000 7fea067fc700 1 -- 172.21.15.103:0/1985920377 >> v1:172.21.15.103:6789/0 conn(0x7fea0805b0b0 legacy=0x7fea080b0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:33.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.703+0000 7fea067fc700 1 -- 172.21.15.103:0/1985920377 >> v1:172.21.15.86:6789/0 conn(0x7fea08143a50 legacy=0x7fea081424b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:33.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.703+0000 7fe9f7fff700 1 -- 172.21.15.103:0/1985920377 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2132918866 0 0) 0x7fea080afc60 con 0x7fea0805b0b0 2020-04-22T14:10:33.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.703+0000 7fea067fc700 1 -- 172.21.15.103:0/1985920377 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea080b01a0 con 0x7fea080b86a0 2020-04-22T14:10:33.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.703+0000 7fea067fc700 1 --2- 172.21.15.103:0/1985920377 >> v2:172.21.15.103:3300/0 conn(0x7fea080b86a0 0x7fea080ae0a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fea08060ab0 tx=0x7fea0805f760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:33.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.703+0000 7fea067fc700 1 --2- 172.21.15.103:0/1985920377 >> v2:172.21.15.103:3300/0 conn(0x7fea080b86a0 0x7fea080ae0a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fea08060ab0 tx=0x7fea0805f760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:33.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.703+0000 7fea067fc700 1 --2- 172.21.15.103:0/1985920377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea080b86a0 0x7fea080ae0a0 secure :-1 s=READY pgs=785 cs=0 l=1 rx=0x7fea08060ab0 tx=0x7fea0805f760).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:33.714 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.703+0000 7fea067fc700 1 --2- 172.21.15.103:0/1985920377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea080b86a0 0x7fea080ae0a0 secure :-1 s=THROTTLE_DONE pgs=785 cs=0 l=1 rx=0x7fea08060ab0 tx=0x7fea0805f760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:33.714 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.703+0000 7fe9f7fff700 1 -- 172.21.15.103:0/1985920377 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9f8007360 con 0x7fea080b86a0 2020-04-22T14:10:33.714 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.703+0000 7fea067fc700 1 --2- 172.21.15.103:0/1985920377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea080b86a0 0x7fea080ae0a0 secure :-1 s=THROTTLE_DONE pgs=785 cs=0 l=1 rx=0x7fea08060ab0 tx=0x7fea0805f760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:33.714 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.703+0000 7fe9f7fff700 1 -- 172.21.15.103:0/1985920377 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f80074c0 con 0x7fea080b86a0 2020-04-22T14:10:33.714 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.703+0000 7fea067fc700 1 --2- 172.21.15.103:0/1985920377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea080b86a0 0x7fea080ae0a0 secure :-1 s=THROTTLE_DONE pgs=785 cs=0 l=1 rx=0x7fea08060ab0 tx=0x7fea0805f760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:33.714 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.703+0000 7fea0d3a3700 1 -- 172.21.15.103:0/1985920377 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea08142bc0 con 0x7fea080b86a0 2020-04-22T14:10:33.714 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.703+0000 7fe9f7fff700 1 -- 172.21.15.103:0/1985920377 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9f80058b0 con 0x7fea080b86a0 2020-04-22T14:10:33.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.703+0000 7fea0d3a3700 1 -- 172.21.15.103:0/1985920377 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea081381c0 con 0x7fea080b86a0 2020-04-22T14:10:33.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.704+0000 7fea067fc700 1 --2- 172.21.15.103:0/1985920377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea080b86a0 0x7fea080ae0a0 secure :-1 s=THROTTLE_DONE pgs=785 cs=0 l=1 rx=0x7fea08060ab0 tx=0x7fea0805f760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:33.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.704+0000 7fea0d3a3700 1 -- 172.21.15.103:0/1985920377 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea080b0330 con 0x7fea080b86a0 2020-04-22T14:10:33.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.704+0000 7fe9f7fff700 1 -- 172.21.15.103:0/1985920377 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fe9f8005b30 con 0x7fea080b86a0 2020-04-22T14:10:33.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.704+0000 7fea067fc700 1 --2- 172.21.15.103:0/1985920377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea080b86a0 0x7fea080ae0a0 secure :-1 s=THROTTLE_DONE pgs=785 cs=0 l=1 rx=0x7fea08060ab0 tx=0x7fea0805f760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:33.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.704+0000 7fe9f7fff700 1 --2- 172.21.15.103:0/1985920377 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe9e404d7a0 0x7fe9e404fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:33.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.704+0000 7fe9f7fff700 1 -- 172.21.15.103:0/1985920377 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fe9f8061f40 con 0x7fea080b86a0 2020-04-22T14:10:33.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.704+0000 7fea06ffd700 1 --2- 172.21.15.103:0/1985920377 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe9e404d7a0 0x7fe9e404fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:33.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.704+0000 7fea06ffd700 1 --2- 172.21.15.103:0/1985920377 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe9e404d7a0 0x7fe9e404fc60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe9fc005500 tx=0x7fe9fc001670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:33.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.705+0000 7fea06ffd700 1 --2- 172.21.15.103:0/1985920377 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe9e404d7a0 0x7fe9e404fc60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe9fc005500 tx=0x7fe9fc001670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:33.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.705+0000 7fea06ffd700 1 --2- 172.21.15.103:0/1985920377 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe9e404d7a0 0x7fe9e404fc60 secure :-1 s=READY pgs=293 cs=0 l=1 rx=0x7fe9fc005500 tx=0x7fe9fc001670).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:33.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.708+0000 7fea067fc700 1 --2- 172.21.15.103:0/1985920377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea080b86a0 0x7fea080ae0a0 secure :-1 s=THROTTLE_DONE pgs=785 cs=0 l=1 rx=0x7fea08060ab0 tx=0x7fea0805f760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:33.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.708+0000 7fe9f7fff700 1 -- 172.21.15.103:0/1985920377 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fe9f803d3e0 con 0x7fea080b86a0 2020-04-22T14:10:33.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:33.869+0000 7fea0d3a3700 1 -- 172.21.15.103:0/1985920377 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fea08056c90 con 0x7fea080b86a0 2020-04-22T14:10:34.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.648+0000 7fea067fc700 1 --2- 172.21.15.103:0/1985920377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea080b86a0 0x7fea080ae0a0 secure :-1 s=THROTTLE_DONE pgs=785 cs=0 l=1 rx=0x7fea08060ab0 tx=0x7fea0805f760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:34.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.648+0000 7fe9f7fff700 1 -- 172.21.15.103:0/1985920377 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v60) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe9f8040a00 con 0x7fea080b86a0 2020-04-22T14:10:34.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.651+0000 7fea0d3a3700 1 -- 172.21.15.103:0/1985920377 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe9e404d7a0 msgr2=0x7fe9e404fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:34.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.651+0000 7fea0d3a3700 1 --2- 172.21.15.103:0/1985920377 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe9e404d7a0 0x7fe9e404fc60 secure :-1 s=READY pgs=293 cs=0 l=1 rx=0x7fe9fc005500 tx=0x7fe9fc001670).stop 2020-04-22T14:10:34.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.651+0000 7fea0d3a3700 1 -- 172.21.15.103:0/1985920377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea080b86a0 msgr2=0x7fea080ae0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:34.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.651+0000 7fea0d3a3700 1 --2- 172.21.15.103:0/1985920377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea080b86a0 0x7fea080ae0a0 secure :-1 s=READY pgs=785 cs=0 l=1 rx=0x7fea08060ab0 tx=0x7fea0805f760).stop 2020-04-22T14:10:34.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.651+0000 7fea0d3a3700 1 -- 172.21.15.103:0/1985920377 shutdown_connections 2020-04-22T14:10:34.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.651+0000 7fea0d3a3700 1 --2- 172.21.15.103:0/1985920377 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe9e404d7a0 0x7fe9e404fc60 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:34.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.651+0000 7fea0d3a3700 1 --2- 172.21.15.103:0/1985920377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea080b86a0 0x7fea080ae0a0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:34.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.651+0000 7fea0d3a3700 1 -- 172.21.15.103:0/1985920377 >> 172.21.15.103:0/1985920377 conn(0x7fea080bcae0 msgr2=0x7fea0805f800 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:34.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.651+0000 7fea0d3a3700 1 -- 172.21.15.103:0/1985920377 shutdown_connections 2020-04-22T14:10:34.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.651+0000 7fea0d3a3700 1 -- 172.21.15.103:0/1985920377 wait complete. 2020-04-22T14:10:34.655 INFO:teuthology.orchestra.run.smithi103.stderr: removed all blacklist entries 2020-04-22T14:10:34.667 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2020-04-22T14:10:34.668 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:34.727 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2020-04-22T14:10:34.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.881+0000 7fa429b99700 1 Processor -- start 2020-04-22T14:10:34.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.881+0000 7fa429b99700 1 -- start start 2020-04-22T14:10:34.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.882+0000 7fa429b99700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa42412c0d0 0x7fa4241464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:34.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.882+0000 7fa429b99700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa424143300 con 0x7fa424063e30 2020-04-22T14:10:34.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.882+0000 7fa429b99700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4241435a0 con 0x7fa424065fe0 2020-04-22T14:10:34.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.882+0000 7fa429b99700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa424143840 con 0x7fa42412c0d0 2020-04-22T14:10:34.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.882+0000 7fa422ffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa424065fe0 0x7fa42405b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43254/0 (socket says 172.21.15.103:43254) 2020-04-22T14:10:34.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.882+0000 7fa422ffd700 1 -- 172.21.15.103:0/1683074115 learned_addr learned my addr 172.21.15.103:0/1683074115 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:34.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.882+0000 7fa4237fe700 1 --2- 172.21.15.103:0/1683074115 >> v2:172.21.15.86:3300/0 conn(0x7fa42412c0d0 0x7fa4241464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:34.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.882+0000 7fa4227fc700 1 -- 172.21.15.103:0/1683074115 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1501579229 0 0) 0x7fa4241435a0 con 0x7fa424065fe0 2020-04-22T14:10:34.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.882+0000 7fa4227fc700 1 -- 172.21.15.103:0/1683074115 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa410003230 con 0x7fa424065fe0 2020-04-22T14:10:34.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.883+0000 7fa4227fc700 1 -- 172.21.15.103:0/1683074115 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 409148723 0 0) 0x7fa410003230 con 0x7fa424065fe0 2020-04-22T14:10:34.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.883+0000 7fa4237fe700 1 -- 172.21.15.103:0/1683074115 >> v1:172.21.15.103:6789/0 conn(0x7fa424065fe0 legacy=0x7fa42405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:34.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.883+0000 7fa4237fe700 1 -- 172.21.15.103:0/1683074115 >> v1:172.21.15.86:6789/0 conn(0x7fa424063e30 legacy=0x7fa4240642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:34.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.883+0000 7fa4237fe700 1 -- 172.21.15.103:0/1683074115 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42405bb50 con 0x7fa42412c0d0 2020-04-22T14:10:34.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.883+0000 7fa4237fe700 1 --2- 172.21.15.103:0/1683074115 >> v2:172.21.15.86:3300/0 conn(0x7fa42412c0d0 0x7fa4241464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa41c0010d0 tx=0x7fa414007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:34.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.883+0000 7fa4237fe700 1 --2- 172.21.15.103:0/1683074115 >> v2:172.21.15.86:3300/0 conn(0x7fa42412c0d0 0x7fa4241464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa41c0010d0 tx=0x7fa414007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:34.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.883+0000 7fa4237fe700 1 --2- 172.21.15.103:0/1683074115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa42412c0d0 0x7fa4241464e0 secure :-1 s=READY pgs=439 cs=0 l=1 rx=0x7fa41c0010d0 tx=0x7fa414007dc0).ready entity=mon.0 client_cookie=3ef2bed069d3f32 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:34.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.883+0000 7fa4237fe700 1 --2- 172.21.15.103:0/1683074115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa42412c0d0 0x7fa4241464e0 secure :-1 s=THROTTLE_DONE pgs=439 cs=0 l=1 rx=0x7fa41c0010d0 tx=0x7fa414007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:34.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.883+0000 7fa4227fc700 1 -- 172.21.15.103:0/1683074115 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4180016d0 con 0x7fa42412c0d0 2020-04-22T14:10:34.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.883+0000 7fa4237fe700 1 --2- 172.21.15.103:0/1683074115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa42412c0d0 0x7fa4241464e0 secure :-1 s=THROTTLE_DONE pgs=439 cs=0 l=1 rx=0x7fa41c0010d0 tx=0x7fa414007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:34.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.883+0000 7fa4237fe700 1 --2- 172.21.15.103:0/1683074115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa42412c0d0 0x7fa4241464e0 secure :-1 s=THROTTLE_DONE pgs=439 cs=0 l=1 rx=0x7fa41c0010d0 tx=0x7fa414007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:34.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.883+0000 7fa4227fc700 1 -- 172.21.15.103:0/1683074115 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa414010b30 con 0x7fa42412c0d0 2020-04-22T14:10:34.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.883+0000 7fa4227fc700 1 -- 172.21.15.103:0/1683074115 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa414010e90 con 0x7fa42412c0d0 2020-04-22T14:10:34.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.883+0000 7fa429b99700 1 -- 172.21.15.103:0/1683074115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa42412c0d0 msgr2=0x7fa4241464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:34.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.883+0000 7fa429b99700 1 --2- 172.21.15.103:0/1683074115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa42412c0d0 0x7fa4241464e0 secure :-1 s=READY pgs=439 cs=0 l=1 rx=0x7fa41c0010d0 tx=0x7fa414007dc0).stop 2020-04-22T14:10:34.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.883+0000 7fa429b99700 1 -- 172.21.15.103:0/1683074115 shutdown_connections 2020-04-22T14:10:34.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.883+0000 7fa429b99700 1 --2- 172.21.15.103:0/1683074115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa42412c0d0 0x7fa4241464e0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:34.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.883+0000 7fa429b99700 1 -- 172.21.15.103:0/1683074115 >> 172.21.15.103:0/1683074115 conn(0x7fa4240b9160 msgr2=0x7fa42405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:34.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.884+0000 7fa429b99700 1 -- 172.21.15.103:0/1683074115 shutdown_connections 2020-04-22T14:10:34.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.884+0000 7fa429b99700 1 -- 172.21.15.103:0/1683074115 wait complete. 2020-04-22T14:10:34.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.884+0000 7fa429b99700 1 Processor -- start 2020-04-22T14:10:34.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.885+0000 7fa429b99700 1 -- start start 2020-04-22T14:10:34.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.885+0000 7fa429b99700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa424063e30 0x7fa424143f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:34.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.885+0000 7fa429b99700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa424065fe0 0x7fa424141b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:34.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.885+0000 7fa429b99700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa424147f90 con 0x7fa42412c0d0 2020-04-22T14:10:34.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.885+0000 7fa429b99700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4241443e0 con 0x7fa424063e30 2020-04-22T14:10:34.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.885+0000 7fa429b99700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4241481c0 con 0x7fa424065fe0 2020-04-22T14:10:34.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.885+0000 7fa423fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa42412c0d0 0x7fa424149aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43262/0 (socket says 172.21.15.103:43262) 2020-04-22T14:10:34.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.885+0000 7fa423fff700 1 -- 172.21.15.103:0/3502625003 learned_addr learned my addr 172.21.15.103:0/3502625003 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:34.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.885+0000 7fa4237fe700 1 --2- 172.21.15.103:0/3502625003 >> v2:172.21.15.86:3300/0 conn(0x7fa424063e30 0x7fa424143f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:34.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.885+0000 7fa422ffd700 1 --2- 172.21.15.103:0/3502625003 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa424065fe0 0x7fa424141b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:34.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.886+0000 7fa420ff9700 1 -- 172.21.15.103:0/3502625003 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1174079837 0 0) 0x7fa424147f90 con 0x7fa42412c0d0 2020-04-22T14:10:34.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.886+0000 7fa420ff9700 1 -- 172.21.15.103:0/3502625003 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa404002fe0 con 0x7fa42412c0d0 2020-04-22T14:10:34.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.886+0000 7fa420ff9700 1 -- 172.21.15.103:0/3502625003 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1480623284 0 0) 0x7fa404002fe0 con 0x7fa42412c0d0 2020-04-22T14:10:34.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.886+0000 7fa420ff9700 1 -- 172.21.15.103:0/3502625003 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa424147f90 con 0x7fa42412c0d0 2020-04-22T14:10:34.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.886+0000 7fa420ff9700 1 -- 172.21.15.103:0/3502625003 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fa41c001a40 con 0x7fa42412c0d0 2020-04-22T14:10:34.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.886+0000 7fa4237fe700 1 -- 172.21.15.103:0/3502625003 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa424065fe0 msgr2=0x7fa424141b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:34.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.886+0000 7fa4237fe700 1 --2- 172.21.15.103:0/3502625003 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa424065fe0 0x7fa424141b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:34.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.886+0000 7fa4237fe700 1 -- 172.21.15.103:0/3502625003 >> v1:172.21.15.103:6789/0 conn(0x7fa42412c0d0 legacy=0x7fa424149aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:34.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.886+0000 7fa4237fe700 1 -- 172.21.15.103:0/3502625003 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa424148460 con 0x7fa424063e30 2020-04-22T14:10:34.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.886+0000 7fa422ffd700 1 --2- 172.21.15.103:0/3502625003 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa424065fe0 0x7fa424141b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:10:34.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.886+0000 7fa4237fe700 1 --2- 172.21.15.103:0/3502625003 >> v2:172.21.15.86:3300/0 conn(0x7fa424063e30 0x7fa424143f80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa41c0010d0 tx=0x7fa414007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:34.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.886+0000 7fa4237fe700 1 --2- 172.21.15.103:0/3502625003 >> v2:172.21.15.86:3300/0 conn(0x7fa424063e30 0x7fa424143f80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa41c0010d0 tx=0x7fa414007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:34.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.886+0000 7fa4237fe700 1 --2- 172.21.15.103:0/3502625003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa424063e30 0x7fa424143f80 secure :-1 s=READY pgs=440 cs=0 l=1 rx=0x7fa41c0010d0 tx=0x7fa414007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:34.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.886+0000 7fa4237fe700 1 --2- 172.21.15.103:0/3502625003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa424063e30 0x7fa424143f80 secure :-1 s=THROTTLE_DONE pgs=440 cs=0 l=1 rx=0x7fa41c0010d0 tx=0x7fa414007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:34.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.886+0000 7fa420ff9700 1 -- 172.21.15.103:0/3502625003 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa41400fb70 con 0x7fa424063e30 2020-04-22T14:10:34.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.886+0000 7fa4237fe700 1 --2- 172.21.15.103:0/3502625003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa424063e30 0x7fa424143f80 secure :-1 s=THROTTLE_DONE pgs=440 cs=0 l=1 rx=0x7fa41c0010d0 tx=0x7fa414007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:34.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.886+0000 7fa420ff9700 1 -- 172.21.15.103:0/3502625003 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa414005a40 con 0x7fa424063e30 2020-04-22T14:10:34.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.886+0000 7fa4237fe700 1 --2- 172.21.15.103:0/3502625003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa424063e30 0x7fa424143f80 secure :-1 s=THROTTLE_DONE pgs=440 cs=0 l=1 rx=0x7fa41c0010d0 tx=0x7fa414007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:34.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.886+0000 7fa429b99700 1 -- 172.21.15.103:0/3502625003 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa424141f80 con 0x7fa424063e30 2020-04-22T14:10:34.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.886+0000 7fa420ff9700 1 -- 172.21.15.103:0/3502625003 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa414005de0 con 0x7fa424063e30 2020-04-22T14:10:34.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.886+0000 7fa429b99700 1 -- 172.21.15.103:0/3502625003 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4241426f0 con 0x7fa424063e30 2020-04-22T14:10:34.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.887+0000 7fa4237fe700 1 --2- 172.21.15.103:0/3502625003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa424063e30 0x7fa424143f80 secure :-1 s=THROTTLE_DONE pgs=440 cs=0 l=1 rx=0x7fa41c0010d0 tx=0x7fa414007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:34.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.887+0000 7fa429b99700 1 -- 172.21.15.103:0/3502625003 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa424056c90 con 0x7fa424063e30 2020-04-22T14:10:34.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.888+0000 7fa420ff9700 1 -- 172.21.15.103:0/3502625003 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fa414007180 con 0x7fa424063e30 2020-04-22T14:10:34.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.888+0000 7fa4237fe700 1 --2- 172.21.15.103:0/3502625003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa424063e30 0x7fa424143f80 secure :-1 s=THROTTLE_DONE pgs=440 cs=0 l=1 rx=0x7fa41c0010d0 tx=0x7fa414007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:34.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.888+0000 7fa420ff9700 1 --2- 172.21.15.103:0/3502625003 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa40404dff0 0x7fa4040504b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:34.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.888+0000 7fa420ff9700 1 -- 172.21.15.103:0/3502625003 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fa4140611a0 con 0x7fa424063e30 2020-04-22T14:10:34.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.888+0000 7fa422ffd700 1 --2- 172.21.15.103:0/3502625003 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa40404dff0 0x7fa4040504b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:34.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.888+0000 7fa422ffd700 1 --2- 172.21.15.103:0/3502625003 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa40404dff0 0x7fa4040504b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa418001930 tx=0x7fa41800cf10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:34.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.888+0000 7fa422ffd700 1 --2- 172.21.15.103:0/3502625003 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa40404dff0 0x7fa4040504b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa418001930 tx=0x7fa41800cf10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:34.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.888+0000 7fa422ffd700 1 --2- 172.21.15.103:0/3502625003 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa40404dff0 0x7fa4040504b0 secure :-1 s=READY pgs=295 cs=0 l=1 rx=0x7fa418001930 tx=0x7fa41800cf10).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:34.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.891+0000 7fa4237fe700 1 --2- 172.21.15.103:0/3502625003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa424063e30 0x7fa424143f80 secure :-1 s=THROTTLE_DONE pgs=440 cs=0 l=1 rx=0x7fa41c0010d0 tx=0x7fa414007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:34.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:34.891+0000 7fa420ff9700 1 -- 172.21.15.103:0/3502625003 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fa41403c640 con 0x7fa424063e30 2020-04-22T14:10:35.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.081+0000 7fa429b99700 1 -- 172.21.15.103:0/3502625003 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa424147360 con 0x7fa424063e30 2020-04-22T14:10:35.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.083+0000 7fa4237fe700 1 --2- 172.21.15.103:0/3502625003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa424063e30 0x7fa424143f80 secure :-1 s=THROTTLE_DONE pgs=440 cs=0 l=1 rx=0x7fa41c0010d0 tx=0x7fa414007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.083+0000 7fa420ff9700 1 -- 172.21.15.103:0/3502625003 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v24) v1 ==== 80+0+4513 (secure 0 0 0) 0x7fa41403fc60 con 0x7fa424063e30 2020-04-22T14:10:35.085 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:10:35.086 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:10:35.086 INFO:teuthology.orchestra.run.smithi103.stdout: "auth_dump": [ 2020-04-22T14:10:35.086 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:35.086 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.a", 2020-04-22T14:10:35.086 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBeliD5IBAAjC7UikdEP8FeE2rKs/ympw==", 2020-04-22T14:10:35.086 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:10:35.087 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:10:35.087 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:10:35.087 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:10:35.087 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:10:35.087 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:35.087 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:35.088 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:35.088 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.b", 2020-04-22T14:10:35.088 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBepkqQLBAA4aMKXxROQugglhm4aBd1Iw==", 2020-04-22T14:10:35.088 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:10:35.088 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:10:35.088 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:10:35.088 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:10:35.089 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:10:35.089 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:35.089 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:35.089 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:35.089 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.0", 2020-04-22T14:10:35.089 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA2TqBehMJiBxAARaWo32QGx49PxImGafnOFw==", 2020-04-22T14:10:35.089 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:10:35.090 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:10:35.090 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:10:35.090 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:10:35.090 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:35.090 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:35.090 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:35.090 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.1", 2020-04-22T14:10:35.091 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA4TqBeiAAcKRAAEHuaqbsB+NLUTSgFOCOFZg==", 2020-04-22T14:10:35.091 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:10:35.091 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:10:35.091 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:10:35.091 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:10:35.091 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:35.091 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:35.091 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:35.092 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.2", 2020-04-22T14:10:35.092 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA7TqBebeRzDxAAsjRyvJektq7MQ+334kU+UQ==", 2020-04-22T14:10:35.092 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:10:35.092 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:10:35.092 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:10:35.092 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:10:35.092 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:35.093 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:35.093 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:35.093 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.3", 2020-04-22T14:10:35.093 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA9TqBehxmSMRAATZ0o/ZnxHp2m/tqLmv6JwA==", 2020-04-22T14:10:35.093 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:10:35.093 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:10:35.093 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:10:35.094 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:10:35.094 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:35.094 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:35.094 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:35.094 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.4", 2020-04-22T14:10:35.094 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBETqBePwJSBRAAXgMKuX3EILi3gy8QzR4cig==", 2020-04-22T14:10:35.094 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:10:35.095 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:10:35.095 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:10:35.095 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:10:35.095 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:35.095 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:35.095 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:35.095 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.5", 2020-04-22T14:10:35.095 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBGTqBe5l++KRAAHIWG6bBnru2EVXv/drAL0g==", 2020-04-22T14:10:35.096 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:10:35.096 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:10:35.096 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:10:35.096 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:10:35.096 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:35.096 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:35.096 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:35.097 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.6", 2020-04-22T14:10:35.097 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBJTqBe88rTEBAAO2Z78NZLTYIbBpYovBSHVQ==", 2020-04-22T14:10:35.097 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:10:35.097 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:10:35.097 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:10:35.097 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:10:35.097 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:35.098 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:35.098 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:35.098 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.7", 2020-04-22T14:10:35.098 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBLTqBeGNFIMxAARIXhPNM6xurdnDv8+xZqUw==", 2020-04-22T14:10:35.098 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:10:35.098 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:10:35.098 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:10:35.098 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:10:35.099 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:35.099 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:35.099 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:35.099 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.0", 2020-04-22T14:10:35.099 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBe5ooUNxAA9zBtv6+i3Xl9iYtRl4xKGg==", 2020-04-22T14:10:35.099 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:10:35.099 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:10:35.100 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:10:35.100 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:10:35.100 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:35.100 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:35.100 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:35.100 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.1", 2020-04-22T14:10:35.100 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAyTqBe0bioBBAAVpoQouA/QICwqRoaFbjkiA==", 2020-04-22T14:10:35.101 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:10:35.101 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:10:35.101 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:10:35.101 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:10:35.101 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:35.101 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:35.101 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:35.101 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.2", 2020-04-22T14:10:35.102 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAyTqBemwpXCxAAObNL96zS67nMEe4MLjrEtw==", 2020-04-22T14:10:35.102 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:10:35.102 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:10:35.102 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:10:35.102 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:10:35.102 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:35.102 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:35.103 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:35.103 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.3", 2020-04-22T14:10:35.103 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAyTqBemGxNFBAAlqvB8FeZbMRwvzVjBpH/tA==", 2020-04-22T14:10:35.103 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:10:35.103 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:10:35.103 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:10:35.103 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:10:35.104 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:35.104 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:35.104 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:35.104 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.admin", 2020-04-22T14:10:35.105 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAwTqBeSx5dHxAAH0jPkaiWEwpr66ROWwbU8Q==", 2020-04-22T14:10:35.105 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:10:35.105 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2020-04-22T14:10:35.105 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:10:35.105 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:10:35.105 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:10:35.105 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:35.105 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:35.106 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:35.106 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mgr.x", 2020-04-22T14:10:35.106 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBe3YVhGhAAWAf6f9sV3bzoucBBPS3j2g==", 2020-04-22T14:10:35.106 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:10:35.106 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2020-04-22T14:10:35.106 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile mgr", 2020-04-22T14:10:35.106 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:10:35.107 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:35.107 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:35.107 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:35.107 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mgr.y", 2020-04-22T14:10:35.107 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBeX8AXExAAhh/N+/ogdKlxmkveSM60+g==", 2020-04-22T14:10:35.107 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:10:35.107 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2020-04-22T14:10:35.108 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile mgr", 2020-04-22T14:10:35.108 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:10:35.108 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:35.108 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:35.108 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:10:35.108 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:10:35.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.083+0000 7fa429b99700 1 -- 172.21.15.103:0/3502625003 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa40404dff0 msgr2=0x7fa4040504b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:35.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.083+0000 7fa429b99700 1 --2- 172.21.15.103:0/3502625003 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa40404dff0 0x7fa4040504b0 secure :-1 s=READY pgs=295 cs=0 l=1 rx=0x7fa418001930 tx=0x7fa41800cf10).stop 2020-04-22T14:10:35.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.083+0000 7fa429b99700 1 -- 172.21.15.103:0/3502625003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa424063e30 msgr2=0x7fa424143f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:35.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.083+0000 7fa429b99700 1 --2- 172.21.15.103:0/3502625003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa424063e30 0x7fa424143f80 secure :-1 s=READY pgs=440 cs=0 l=1 rx=0x7fa41c0010d0 tx=0x7fa414007dc0).stop 2020-04-22T14:10:35.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.083+0000 7fa429b99700 1 -- 172.21.15.103:0/3502625003 shutdown_connections 2020-04-22T14:10:35.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.083+0000 7fa429b99700 1 --2- 172.21.15.103:0/3502625003 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa40404dff0 0x7fa4040504b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:35.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.083+0000 7fa429b99700 1 --2- 172.21.15.103:0/3502625003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa424063e30 0x7fa424143f80 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:35.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.083+0000 7fa429b99700 1 --2- 172.21.15.103:0/3502625003 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa424065fe0 0x7fa424141b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:35.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.083+0000 7fa429b99700 1 -- 172.21.15.103:0/3502625003 >> 172.21.15.103:0/3502625003 conn(0x7fa4240b9160 msgr2=0x7fa4240620a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:35.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.084+0000 7fa429b99700 1 -- 172.21.15.103:0/3502625003 shutdown_connections 2020-04-22T14:10:35.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.084+0000 7fa429b99700 1 -- 172.21.15.103:0/3502625003 wait complete. 2020-04-22T14:10:35.115 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:35.128 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:10:35.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.272+0000 7fdfa9554700 1 Processor -- start 2020-04-22T14:10:35.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.272+0000 7fdfa9554700 1 -- start start 2020-04-22T14:10:35.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.272+0000 7fdfa9554700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdfa40620a0 0x7fdfa414a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:35.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.272+0000 7fdfa9554700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdfa4062930 0x7fdfa4062d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:35.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.272+0000 7fdfa9554700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfa4144a20 con 0x7fdfa40ac740 2020-04-22T14:10:35.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.272+0000 7fdfa9554700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfa40661d0 con 0x7fdfa4062930 2020-04-22T14:10:35.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.272+0000 7fdfa9554700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa40acd70 con 0x7fdfa40620a0 2020-04-22T14:10:35.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.273+0000 7fdfa8d53700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdfa4062930 0x7fdfa4062d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:35.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.273+0000 7fdfa8d53700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdfa4062930 0x7fdfa4062d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51080/0 (socket says 172.21.15.103:51080) 2020-04-22T14:10:35.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.273+0000 7fdfa8d53700 1 -- 172.21.15.103:0/2116885830 learned_addr learned my addr 172.21.15.103:0/2116885830 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:10:35.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.273+0000 7fdfa3fff700 1 --2- 172.21.15.103:0/2116885830 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdfa40620a0 0x7fdfa414a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:35.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.273+0000 7fdfa8d53700 1 -- 172.21.15.103:0/2116885830 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdfa40620a0 msgr2=0x7fdfa414a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:35.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.273+0000 7fdfa8d53700 1 --2- 172.21.15.103:0/2116885830 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdfa40620a0 0x7fdfa414a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:35.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.273+0000 7fdfa8d53700 1 -- 172.21.15.103:0/2116885830 >> v1:172.21.15.86:6789/0 conn(0x7fdfa40ac740 legacy=0x7fdfa414ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:35.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.273+0000 7fdfa8d53700 1 -- 172.21.15.103:0/2116885830 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa40ad010 con 0x7fdfa4062930 2020-04-22T14:10:35.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.273+0000 7fdfa8d53700 1 --2- 172.21.15.103:0/2116885830 >> v2:172.21.15.103:3300/0 conn(0x7fdfa4062930 0x7fdfa4062d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdf9c0032b0 tx=0x7fdf9c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.273+0000 7fdfa8d53700 1 --2- 172.21.15.103:0/2116885830 >> v2:172.21.15.103:3300/0 conn(0x7fdfa4062930 0x7fdfa4062d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdf9c0032b0 tx=0x7fdf9c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.273+0000 7fdfa8d53700 1 --2- 172.21.15.103:0/2116885830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdfa4062930 0x7fdfa4062d70 secure :-1 s=READY pgs=788 cs=0 l=1 rx=0x7fdf9c0032b0 tx=0x7fdf9c007dc0).ready entity=mon.1 client_cookie=ceba02c3f1327d32 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:35.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.273+0000 7fdfa8d53700 1 --2- 172.21.15.103:0/2116885830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdfa4062930 0x7fdfa4062d70 secure :-1 s=THROTTLE_DONE pgs=788 cs=0 l=1 rx=0x7fdf9c0032b0 tx=0x7fdf9c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.273+0000 7fdfa2ffd700 1 -- 172.21.15.103:0/2116885830 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf9c00a180 con 0x7fdfa4062930 2020-04-22T14:10:35.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.273+0000 7fdfa8d53700 1 --2- 172.21.15.103:0/2116885830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdfa4062930 0x7fdfa4062d70 secure :-1 s=THROTTLE_DONE pgs=788 cs=0 l=1 rx=0x7fdf9c0032b0 tx=0x7fdf9c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.273+0000 7fdfa8d53700 1 --2- 172.21.15.103:0/2116885830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdfa4062930 0x7fdfa4062d70 secure :-1 s=THROTTLE_DONE pgs=788 cs=0 l=1 rx=0x7fdf9c0032b0 tx=0x7fdf9c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.273+0000 7fdfa2ffd700 1 -- 172.21.15.103:0/2116885830 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf9c00a320 con 0x7fdfa4062930 2020-04-22T14:10:35.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.273+0000 7fdfa2ffd700 1 -- 172.21.15.103:0/2116885830 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf9c00a740 con 0x7fdfa4062930 2020-04-22T14:10:35.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.273+0000 7fdfa9554700 1 -- 172.21.15.103:0/2116885830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdfa4062930 msgr2=0x7fdfa4062d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:35.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.273+0000 7fdfa9554700 1 --2- 172.21.15.103:0/2116885830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdfa4062930 0x7fdfa4062d70 secure :-1 s=READY pgs=788 cs=0 l=1 rx=0x7fdf9c0032b0 tx=0x7fdf9c007dc0).stop 2020-04-22T14:10:35.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.274+0000 7fdfa9554700 1 -- 172.21.15.103:0/2116885830 shutdown_connections 2020-04-22T14:10:35.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.274+0000 7fdfa9554700 1 --2- 172.21.15.103:0/2116885830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdfa4062930 0x7fdfa4062d70 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:35.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.274+0000 7fdfa9554700 1 --2- 172.21.15.103:0/2116885830 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdfa40620a0 0x7fdfa414a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:35.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.274+0000 7fdfa9554700 1 -- 172.21.15.103:0/2116885830 >> 172.21.15.103:0/2116885830 conn(0x7fdfa405b7c0 msgr2=0x7fdfa4061610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:35.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.274+0000 7fdfa9554700 1 -- 172.21.15.103:0/2116885830 shutdown_connections 2020-04-22T14:10:35.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.274+0000 7fdfa9554700 1 -- 172.21.15.103:0/2116885830 wait complete. 2020-04-22T14:10:35.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.275+0000 7fdfa9554700 1 Processor -- start 2020-04-22T14:10:35.286 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.275+0000 7fdfa9554700 1 -- start start 2020-04-22T14:10:35.289 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.275+0000 7fdfa9554700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdfa40620a0 0x7fdfa40b26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:35.289 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.275+0000 7fdfa9554700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdfa4062930 0x7fdfa40b76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:35.289 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.275+0000 7fdfa9554700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfa40b7b00 con 0x7fdfa40ac740 2020-04-22T14:10:35.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.275+0000 7fdfa9554700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfa40b3f50 con 0x7fdfa4062930 2020-04-22T14:10:35.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.275+0000 7fdfa9554700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa40b41f0 con 0x7fdfa40620a0 2020-04-22T14:10:35.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.276+0000 7fdfa3fff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdfa40620a0 0x7fdfa40b26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:35.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.276+0000 7fdfa3fff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdfa40620a0 0x7fdfa40b26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:35860/0 (socket says 172.21.15.103:35860) 2020-04-22T14:10:35.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.276+0000 7fdfa37fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdfa4062930 0x7fdfa40b76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:35.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.276+0000 7fdfa3fff700 1 -- 172.21.15.103:0/1682788150 learned_addr learned my addr 172.21.15.103:0/1682788150 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:10:35.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.276+0000 7fdfa3fff700 1 -- 172.21.15.103:0/1682788150 >> v2:172.21.15.86:3300/0 conn(0x7fdfa4062930 msgr2=0x7fdfa40b76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:35.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.276+0000 7fdfa3fff700 1 --2- 172.21.15.103:0/1682788150 >> v2:172.21.15.86:3300/0 conn(0x7fdfa4062930 0x7fdfa40b76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:35.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.276+0000 7fdfa3fff700 1 -- 172.21.15.103:0/1682788150 >> v1:172.21.15.86:6789/0 conn(0x7fdfa40ac740 legacy=0x7fdfa40b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:35.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.276+0000 7fdfa17fa700 1 -- 172.21.15.103:0/1682788150 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2872691423 0 0) 0x7fdfa40ad010 con 0x7fdfa40ac740 2020-04-22T14:10:35.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.276+0000 7fdfa3fff700 1 -- 172.21.15.103:0/1682788150 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa40b4490 con 0x7fdfa40620a0 2020-04-22T14:10:35.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.276+0000 7fdfa37fe700 1 --2- 172.21.15.103:0/1682788150 >> v2:172.21.15.86:3300/0 conn(0x7fdfa4062930 0x7fdfa40b76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:10:35.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.276+0000 7fdfa3fff700 1 --2- 172.21.15.103:0/1682788150 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdfa40620a0 0x7fdfa40b26a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdf94002f30 tx=0x7fdf94010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.276+0000 7fdfa3fff700 1 --2- 172.21.15.103:0/1682788150 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdfa40620a0 0x7fdfa40b26a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdf94002f30 tx=0x7fdf94010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.276+0000 7fdfa3fff700 1 --2- 172.21.15.103:0/1682788150 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdfa40620a0 0x7fdfa40b26a0 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7fdf94002f30 tx=0x7fdf94010c30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:35.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.276+0000 7fdfa3fff700 1 --2- 172.21.15.103:0/1682788150 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdfa40620a0 0x7fdfa40b26a0 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7fdf94002f30 tx=0x7fdf94010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.276+0000 7fdfa17fa700 1 -- 172.21.15.103:0/1682788150 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf9400eae0 con 0x7fdfa40620a0 2020-04-22T14:10:35.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.276+0000 7fdfa3fff700 1 --2- 172.21.15.103:0/1682788150 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdfa40620a0 0x7fdfa40b26a0 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7fdf94002f30 tx=0x7fdf94010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.276+0000 7fdfa17fa700 1 -- 172.21.15.103:0/1682788150 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf9400ec40 con 0x7fdfa40620a0 2020-04-22T14:10:35.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.276+0000 7fdfa9554700 1 -- 172.21.15.103:0/1682788150 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfa40b3760 con 0x7fdfa40620a0 2020-04-22T14:10:35.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.276+0000 7fdfa3fff700 1 --2- 172.21.15.103:0/1682788150 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdfa40620a0 0x7fdfa40b26a0 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7fdf94002f30 tx=0x7fdf94010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.276+0000 7fdfa17fa700 1 -- 172.21.15.103:0/1682788150 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf94012350 con 0x7fdfa40620a0 2020-04-22T14:10:35.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.277+0000 7fdfa9554700 1 -- 172.21.15.103:0/1682788150 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfa40aed60 con 0x7fdfa40620a0 2020-04-22T14:10:35.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.277+0000 7fdfa3fff700 1 --2- 172.21.15.103:0/1682788150 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdfa40620a0 0x7fdfa40b26a0 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7fdf94002f30 tx=0x7fdf94010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.277+0000 7fdfa9554700 1 -- 172.21.15.103:0/1682788150 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfa40b4650 con 0x7fdfa40620a0 2020-04-22T14:10:35.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.278+0000 7fdfa17fa700 1 -- 172.21.15.103:0/1682788150 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fdf940120c0 con 0x7fdfa40620a0 2020-04-22T14:10:35.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.278+0000 7fdfa3fff700 1 --2- 172.21.15.103:0/1682788150 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdfa40620a0 0x7fdfa40b26a0 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7fdf94002f30 tx=0x7fdf94010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.278+0000 7fdfa17fa700 1 --2- 172.21.15.103:0/1682788150 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdf8404d900 0x7fdf8404fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:35.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.278+0000 7fdfa17fa700 1 -- 172.21.15.103:0/1682788150 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fdf940619f0 con 0x7fdfa40620a0 2020-04-22T14:10:35.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.278+0000 7fdfa37fe700 1 --2- 172.21.15.103:0/1682788150 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdf8404d900 0x7fdf8404fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:35.297 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.278+0000 7fdfa37fe700 1 --2- 172.21.15.103:0/1682788150 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdf8404d900 0x7fdf8404fdc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdfa4062770 tx=0x7fdf9800cc00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.297 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.278+0000 7fdfa37fe700 1 --2- 172.21.15.103:0/1682788150 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdf8404d900 0x7fdf8404fdc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdfa4062770 tx=0x7fdf9800cc00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.297 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.278+0000 7fdfa37fe700 1 --2- 172.21.15.103:0/1682788150 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdf8404d900 0x7fdf8404fdc0 secure :-1 s=READY pgs=296 cs=0 l=1 rx=0x7fdfa4062770 tx=0x7fdf9800cc00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:35.297 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.282+0000 7fdfa3fff700 1 --2- 172.21.15.103:0/1682788150 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdfa40620a0 0x7fdfa40b26a0 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7fdf94002f30 tx=0x7fdf94010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.297 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.282+0000 7fdfa17fa700 1 -- 172.21.15.103:0/1682788150 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fdf9403cdd0 con 0x7fdfa40620a0 2020-04-22T14:10:35.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.425+0000 7fdfa9554700 1 -- 172.21.15.103:0/1682788150 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdfa4056c90 con 0x7fdfa40620a0 2020-04-22T14:10:35.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.426+0000 7fdfa3fff700 1 --2- 172.21.15.103:0/1682788150 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdfa40620a0 0x7fdfa40b26a0 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7fdf94002f30 tx=0x7fdf94010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.426+0000 7fdfa17fa700 1 -- 172.21.15.103:0/1682788150 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+13233 (secure 0 0 0) 0x7fdf940403f0 con 0x7fdfa40620a0 2020-04-22T14:10:35.430 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:10:35.430 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":60,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:10:34.642310+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:10:35.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.428+0000 7fdfa9554700 1 -- 172.21.15.103:0/1682788150 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdf8404d900 msgr2=0x7fdf8404fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:35.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.428+0000 7fdfa9554700 1 --2- 172.21.15.103:0/1682788150 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdf8404d900 0x7fdf8404fdc0 secure :-1 s=READY pgs=296 cs=0 l=1 rx=0x7fdfa4062770 tx=0x7fdf9800cc00).stop 2020-04-22T14:10:35.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.428+0000 7fdfa9554700 1 -- 172.21.15.103:0/1682788150 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdfa40620a0 msgr2=0x7fdfa40b26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:35.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.428+0000 7fdfa9554700 1 --2- 172.21.15.103:0/1682788150 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdfa40620a0 0x7fdfa40b26a0 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7fdf94002f30 tx=0x7fdf94010c30).stop 2020-04-22T14:10:35.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.428+0000 7fdfa9554700 1 -- 172.21.15.103:0/1682788150 shutdown_connections 2020-04-22T14:10:35.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.428+0000 7fdfa9554700 1 --2- 172.21.15.103:0/1682788150 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdfa40620a0 0x7fdfa40b26a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:35.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.428+0000 7fdfa9554700 1 --2- 172.21.15.103:0/1682788150 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdf8404d900 0x7fdf8404fdc0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:35.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.428+0000 7fdfa9554700 1 --2- 172.21.15.103:0/1682788150 >> v2:172.21.15.86:3300/0 conn(0x7fdfa4062930 0x7fdfa40b76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:35.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.428+0000 7fdfa9554700 1 -- 172.21.15.103:0/1682788150 >> 172.21.15.103:0/1682788150 conn(0x7fdfa405b7c0 msgr2=0x7fdfa414cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:35.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.428+0000 7fdfa9554700 1 -- 172.21.15.103:0/1682788150 shutdown_connections 2020-04-22T14:10:35.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.428+0000 7fdfa9554700 1 -- 172.21.15.103:0/1682788150 wait complete. 2020-04-22T14:10:35.442 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:10:35.443 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:35.458 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:10:35.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.604+0000 7fa643133700 1 Processor -- start 2020-04-22T14:10:35.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.604+0000 7fa643133700 1 -- start start 2020-04-22T14:10:35.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.605+0000 7fa643133700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa63c0ac950 0x7fa63c146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:35.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.605+0000 7fa643133700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa63c1467e0 con 0x7fa63c0b9140 2020-04-22T14:10:35.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.605+0000 7fa643133700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa63c060050 con 0x7fa63c1470a0 2020-04-22T14:10:35.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.605+0000 7fa643133700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c0602f0 con 0x7fa63c0ac950 2020-04-22T14:10:35.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.605+0000 7fa6416d0700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa63c1470a0 0x7fa63c143090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43280/0 (socket says 172.21.15.103:43280) 2020-04-22T14:10:35.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.605+0000 7fa6416d0700 1 -- 172.21.15.103:0/1216320072 learned_addr learned my addr 172.21.15.103:0/1216320072 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:35.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.605+0000 7fa63bfff700 1 --2- 172.21.15.103:0/1216320072 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa63c0ac950 0x7fa63c146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:35.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.605+0000 7fa63b7fe700 1 -- 172.21.15.103:0/1216320072 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1164273051 0 0) 0x7fa63c060050 con 0x7fa63c1470a0 2020-04-22T14:10:35.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.605+0000 7fa63b7fe700 1 -- 172.21.15.103:0/1216320072 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa628003230 con 0x7fa63c1470a0 2020-04-22T14:10:35.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.605+0000 7fa63b7fe700 1 -- 172.21.15.103:0/1216320072 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1853166265 0 0) 0x7fa628003230 con 0x7fa63c1470a0 2020-04-22T14:10:35.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.605+0000 7fa63b7fe700 1 -- 172.21.15.103:0/1216320072 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa63c0ac950 msgr2=0x7fa63c146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:35.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.605+0000 7fa63b7fe700 1 --2- 172.21.15.103:0/1216320072 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa63c0ac950 0x7fa63c146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:35.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.605+0000 7fa63b7fe700 1 -- 172.21.15.103:0/1216320072 >> v1:172.21.15.86:6789/0 conn(0x7fa63c0b9140 legacy=0x7fa63c12b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:35.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.605+0000 7fa63b7fe700 1 -- 172.21.15.103:0/1216320072 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63c0b9520 con 0x7fa63c1470a0 2020-04-22T14:10:35.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.605+0000 7fa63b7fe700 1 -- 172.21.15.103:0/1216320072 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fa62c0016d0 con 0x7fa63c1470a0 2020-04-22T14:10:35.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.605+0000 7fa63b7fe700 1 -- 172.21.15.103:0/1216320072 >> v1:172.21.15.103:6789/0 conn(0x7fa63c1470a0 legacy=0x7fa63c143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:35.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.605+0000 7fa63b7fe700 1 --2- 172.21.15.103:0/1216320072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa628003720 0x7fa628003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:35.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.605+0000 7fa63b7fe700 1 --2- 172.21.15.103:0/1216320072 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa628003fd0 0x7fa6280044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:35.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.605+0000 7fa63b7fe700 1 --2- 172.21.15.103:0/1216320072 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa63c0ac950 0x7fa628004a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:35.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.605+0000 7fa63b7fe700 1 -- 172.21.15.103:0/1216320072 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c0602f0 con 0x7fa628003fd0 2020-04-22T14:10:35.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.605+0000 7fa63b7fe700 1 -- 172.21.15.103:0/1216320072 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa628004ef0 con 0x7fa628003720 2020-04-22T14:10:35.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.605+0000 7fa63b7fe700 1 -- 172.21.15.103:0/1216320072 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6280050b0 con 0x7fa63c0ac950 2020-04-22T14:10:35.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.605+0000 7fa640ecf700 1 --2- 172.21.15.103:0/1216320072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa628003720 0x7fa628003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:35.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.606+0000 7fa63bfff700 1 --2- 172.21.15.103:0/1216320072 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa628003fd0 0x7fa6280044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:35.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.606+0000 7fa6416d0700 1 --2- 172.21.15.103:0/1216320072 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa63c0ac950 0x7fa628004a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:35.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.606+0000 7fa640ecf700 1 -- 172.21.15.103:0/1216320072 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa63c0ac950 msgr2=0x7fa628004a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:35.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.606+0000 7fa640ecf700 1 --2- 172.21.15.103:0/1216320072 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa63c0ac950 0x7fa628004a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:35.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.606+0000 7fa640ecf700 1 -- 172.21.15.103:0/1216320072 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa628003fd0 msgr2=0x7fa6280044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:35.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.606+0000 7fa640ecf700 1 --2- 172.21.15.103:0/1216320072 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa628003fd0 0x7fa6280044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:35.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.606+0000 7fa640ecf700 1 -- 172.21.15.103:0/1216320072 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa628003230 con 0x7fa628003720 2020-04-22T14:10:35.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.606+0000 7fa640ecf700 1 --2- 172.21.15.103:0/1216320072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa628003720 0x7fa628003b00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa634001360 tx=0x7fa634010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.606+0000 7fa640ecf700 1 --2- 172.21.15.103:0/1216320072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa628003720 0x7fa628003b00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa634001360 tx=0x7fa634010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.606+0000 7fa640ecf700 1 --2- 172.21.15.103:0/1216320072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa628003720 0x7fa628003b00 secure :-1 s=READY pgs=790 cs=0 l=1 rx=0x7fa634001360 tx=0x7fa634010160).ready entity=mon.1 client_cookie=d053e7c927e04148 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:35.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.606+0000 7fa640ecf700 1 --2- 172.21.15.103:0/1216320072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa628003720 0x7fa628003b00 secure :-1 s=THROTTLE_DONE pgs=790 cs=0 l=1 rx=0x7fa634001360 tx=0x7fa634010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.606+0000 7fa63b7fe700 1 -- 172.21.15.103:0/1216320072 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa634006c40 con 0x7fa628003720 2020-04-22T14:10:35.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.606+0000 7fa640ecf700 1 --2- 172.21.15.103:0/1216320072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa628003720 0x7fa628003b00 secure :-1 s=THROTTLE_DONE pgs=790 cs=0 l=1 rx=0x7fa634001360 tx=0x7fa634010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.606+0000 7fa640ecf700 1 --2- 172.21.15.103:0/1216320072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa628003720 0x7fa628003b00 secure :-1 s=THROTTLE_DONE pgs=790 cs=0 l=1 rx=0x7fa634001360 tx=0x7fa634010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.606+0000 7fa63b7fe700 1 -- 172.21.15.103:0/1216320072 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa634006de0 con 0x7fa628003720 2020-04-22T14:10:35.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.606+0000 7fa63b7fe700 1 -- 172.21.15.103:0/1216320072 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa634002730 con 0x7fa628003720 2020-04-22T14:10:35.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.606+0000 7fa643133700 1 -- 172.21.15.103:0/1216320072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa628003720 msgr2=0x7fa628003b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:35.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.606+0000 7fa643133700 1 --2- 172.21.15.103:0/1216320072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa628003720 0x7fa628003b00 secure :-1 s=READY pgs=790 cs=0 l=1 rx=0x7fa634001360 tx=0x7fa634010160).stop 2020-04-22T14:10:35.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.606+0000 7fa6416d0700 1 -- 172.21.15.103:0/1216320072 reap_dead start 2020-04-22T14:10:35.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.606+0000 7fa643133700 1 -- 172.21.15.103:0/1216320072 shutdown_connections 2020-04-22T14:10:35.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.606+0000 7fa643133700 1 -- 172.21.15.103:0/1216320072 >> 172.21.15.103:0/1216320072 conn(0x7fa63c05b7b0 msgr2=0x7fa63c0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:35.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.607+0000 7fa643133700 1 -- 172.21.15.103:0/1216320072 shutdown_connections 2020-04-22T14:10:35.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.607+0000 7fa643133700 1 -- 172.21.15.103:0/1216320072 wait complete. 2020-04-22T14:10:35.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.607+0000 7fa643133700 1 Processor -- start 2020-04-22T14:10:35.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.607+0000 7fa643133700 1 -- start start 2020-04-22T14:10:35.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.608+0000 7fa643133700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa63c0b5420 0x7fa63c0b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:35.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.608+0000 7fa643133700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa63c061790 0x7fa63c061c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:35.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.608+0000 7fa643133700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa63c155790 con 0x7fa63c0b5800 2020-04-22T14:10:35.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.608+0000 7fa643133700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa63c1522e0 con 0x7fa63c0b5420 2020-04-22T14:10:35.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.608+0000 7fa643133700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c151490 con 0x7fa63c061790 2020-04-22T14:10:35.624 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.608+0000 7fa640ecf700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa63c0b5420 0x7fa63c0b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:35.624 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.608+0000 7fa640ecf700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa63c0b5420 0x7fa63c0b1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51100/0 (socket says 172.21.15.103:51100) 2020-04-22T14:10:35.624 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.608+0000 7fa640ecf700 1 -- 172.21.15.103:0/825998177 learned_addr learned my addr 172.21.15.103:0/825998177 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:10:35.625 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.608+0000 7fa6416d0700 1 --2- 172.21.15.103:0/825998177 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa63c061790 0x7fa63c061c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:35.625 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.609+0000 7fa640ecf700 1 -- 172.21.15.103:0/825998177 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa63c061790 msgr2=0x7fa63c061c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:35.625 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.609+0000 7fa640ecf700 1 --2- 172.21.15.103:0/825998177 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa63c061790 0x7fa63c061c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:35.625 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.609+0000 7fa640ecf700 1 -- 172.21.15.103:0/825998177 >> v1:172.21.15.86:6789/0 conn(0x7fa63c0b5800 legacy=0x7fa63c151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:35.625 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.609+0000 7fa640ecf700 1 -- 172.21.15.103:0/825998177 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63c151730 con 0x7fa63c0b5420 2020-04-22T14:10:35.625 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.609+0000 7fa640ecf700 1 --2- 172.21.15.103:0/825998177 >> v2:172.21.15.103:3300/0 conn(0x7fa63c0b5420 0x7fa63c0b1c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa63c064650 tx=0x7fa634010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.609+0000 7fa640ecf700 1 --2- 172.21.15.103:0/825998177 >> v2:172.21.15.103:3300/0 conn(0x7fa63c0b5420 0x7fa63c0b1c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa63c064650 tx=0x7fa634010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.609+0000 7fa640ecf700 1 --2- 172.21.15.103:0/825998177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa63c0b5420 0x7fa63c0b1c40 secure :-1 s=READY pgs=791 cs=0 l=1 rx=0x7fa63c064650 tx=0x7fa634010160).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:35.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.609+0000 7fa640ecf700 1 --2- 172.21.15.103:0/825998177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa63c0b5420 0x7fa63c0b1c40 secure :-1 s=THROTTLE_DONE pgs=791 cs=0 l=1 rx=0x7fa63c064650 tx=0x7fa634010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.609+0000 7fa639ffb700 1 -- 172.21.15.103:0/825998177 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa634011e60 con 0x7fa63c0b5420 2020-04-22T14:10:35.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.609+0000 7fa640ecf700 1 --2- 172.21.15.103:0/825998177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa63c0b5420 0x7fa63c0b1c40 secure :-1 s=THROTTLE_DONE pgs=791 cs=0 l=1 rx=0x7fa63c064650 tx=0x7fa634010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.609+0000 7fa640ecf700 1 --2- 172.21.15.103:0/825998177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa63c0b5420 0x7fa63c0b1c40 secure :-1 s=THROTTLE_DONE pgs=791 cs=0 l=1 rx=0x7fa63c064650 tx=0x7fa634010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.609+0000 7fa639ffb700 1 -- 172.21.15.103:0/825998177 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa634006c40 con 0x7fa63c0b5420 2020-04-22T14:10:35.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.609+0000 7fa639ffb700 1 -- 172.21.15.103:0/825998177 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa634006e70 con 0x7fa63c0b5420 2020-04-22T14:10:35.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.609+0000 7fa643133700 1 -- 172.21.15.103:0/825998177 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa63c0b2520 con 0x7fa63c0b5420 2020-04-22T14:10:35.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.609+0000 7fa643133700 1 -- 172.21.15.103:0/825998177 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa63c1548e0 con 0x7fa63c0b5420 2020-04-22T14:10:35.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.610+0000 7fa640ecf700 1 --2- 172.21.15.103:0/825998177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa63c0b5420 0x7fa63c0b1c40 secure :-1 s=THROTTLE_DONE pgs=791 cs=0 l=1 rx=0x7fa63c064650 tx=0x7fa634010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.610+0000 7fa643133700 1 -- 172.21.15.103:0/825998177 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa63c056c90 con 0x7fa63c0b5420 2020-04-22T14:10:35.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.610+0000 7fa639ffb700 1 -- 172.21.15.103:0/825998177 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fa634002730 con 0x7fa63c0b5420 2020-04-22T14:10:35.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.610+0000 7fa640ecf700 1 --2- 172.21.15.103:0/825998177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa63c0b5420 0x7fa63c0b1c40 secure :-1 s=THROTTLE_DONE pgs=791 cs=0 l=1 rx=0x7fa63c064650 tx=0x7fa634010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.610+0000 7fa639ffb700 1 --2- 172.21.15.103:0/825998177 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa61c04da20 0x7fa61c04fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:35.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.610+0000 7fa639ffb700 1 -- 172.21.15.103:0/825998177 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fa63400b0d0 con 0x7fa63c0b5420 2020-04-22T14:10:35.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.610+0000 7fa63bfff700 1 --2- 172.21.15.103:0/825998177 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa61c04da20 0x7fa61c04fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:35.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.611+0000 7fa63bfff700 1 --2- 172.21.15.103:0/825998177 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa61c04da20 0x7fa61c04fee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa63c0b6020 tx=0x7fa63000c670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.611+0000 7fa63bfff700 1 --2- 172.21.15.103:0/825998177 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa61c04da20 0x7fa61c04fee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa63c0b6020 tx=0x7fa63000c670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.611+0000 7fa63bfff700 1 --2- 172.21.15.103:0/825998177 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa61c04da20 0x7fa61c04fee0 secure :-1 s=READY pgs=297 cs=0 l=1 rx=0x7fa63c0b6020 tx=0x7fa63000c670).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:35.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.614+0000 7fa640ecf700 1 --2- 172.21.15.103:0/825998177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa63c0b5420 0x7fa63c0b1c40 secure :-1 s=THROTTLE_DONE pgs=791 cs=0 l=1 rx=0x7fa63c064650 tx=0x7fa634010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.614+0000 7fa639ffb700 1 -- 172.21.15.103:0/825998177 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fa63403d4b0 con 0x7fa63c0b5420 2020-04-22T14:10:35.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.756+0000 7fa643133700 1 -- 172.21.15.103:0/825998177 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fa63c06a960 con 0x7fa63c0b5420 2020-04-22T14:10:35.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.756+0000 7fa640ecf700 1 --2- 172.21.15.103:0/825998177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa63c0b5420 0x7fa63c0b1c40 secure :-1 s=THROTTLE_DONE pgs=791 cs=0 l=1 rx=0x7fa63c064650 tx=0x7fa634010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.756+0000 7fa639ffb700 1 -- 172.21.15.103:0/825998177 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v60) v1 ==== 110+0+10 (secure 0 0 0) 0x7fa634040ad0 con 0x7fa63c0b5420 2020-04-22T14:10:35.761 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:10:35.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.758+0000 7fa643133700 1 -- 172.21.15.103:0/825998177 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa61c04da20 msgr2=0x7fa61c04fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:35.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.758+0000 7fa643133700 1 --2- 172.21.15.103:0/825998177 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa61c04da20 0x7fa61c04fee0 secure :-1 s=READY pgs=297 cs=0 l=1 rx=0x7fa63c0b6020 tx=0x7fa63000c670).stop 2020-04-22T14:10:35.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.758+0000 7fa643133700 1 -- 172.21.15.103:0/825998177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa63c0b5420 msgr2=0x7fa63c0b1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:35.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.758+0000 7fa643133700 1 --2- 172.21.15.103:0/825998177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa63c0b5420 0x7fa63c0b1c40 secure :-1 s=READY pgs=791 cs=0 l=1 rx=0x7fa63c064650 tx=0x7fa634010160).stop 2020-04-22T14:10:35.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.758+0000 7fa643133700 1 -- 172.21.15.103:0/825998177 shutdown_connections 2020-04-22T14:10:35.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.758+0000 7fa643133700 1 --2- 172.21.15.103:0/825998177 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa61c04da20 0x7fa61c04fee0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:35.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.758+0000 7fa643133700 1 --2- 172.21.15.103:0/825998177 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa63c061790 0x7fa63c061c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:35.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.758+0000 7fa643133700 1 --2- 172.21.15.103:0/825998177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa63c0b5420 0x7fa63c0b1c40 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:35.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.758+0000 7fa643133700 1 -- 172.21.15.103:0/825998177 >> 172.21.15.103:0/825998177 conn(0x7fa63c05b7b0 msgr2=0x7fa63c144b30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:35.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.758+0000 7fa643133700 1 -- 172.21.15.103:0/825998177 shutdown_connections 2020-04-22T14:10:35.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.758+0000 7fa643133700 1 -- 172.21.15.103:0/825998177 wait complete. 2020-04-22T14:10:35.773 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:35.792 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:10:35.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.935+0000 7f640ba98700 1 Processor -- start 2020-04-22T14:10:35.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.935+0000 7f640ba98700 1 -- start start 2020-04-22T14:10:35.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.936+0000 7f640ba98700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f64040b4820 0x7f64040acb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:35.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.936+0000 7f640ba98700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64040af030 con 0x7f6404141f20 2020-04-22T14:10:35.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.936+0000 7f640ba98700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6404060250 con 0x7f6404061a30 2020-04-22T14:10:35.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.936+0000 7f640ba98700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64040623c0 con 0x7f64040b4820 2020-04-22T14:10:35.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.936+0000 7f6409033700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f64040b4820 0x7f64040acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:35.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.936+0000 7f6409834700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f6404061a30 0x7f64040ae920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43298/0 (socket says 172.21.15.103:43298) 2020-04-22T14:10:35.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.936+0000 7f6409834700 1 -- 172.21.15.103:0/2933520514 learned_addr learned my addr 172.21.15.103:0/2933520514 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:35.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.937+0000 7f6409033700 1 -- 172.21.15.103:0/2933520514 >> v1:172.21.15.103:6789/0 conn(0x7f6404061a30 legacy=0x7f64040ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:35.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.937+0000 7f6409033700 1 -- 172.21.15.103:0/2933520514 >> v1:172.21.15.86:6789/0 conn(0x7f6404141f20 legacy=0x7f6404142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:35.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.937+0000 7f6408832700 1 -- 172.21.15.103:0/2933520514 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2493619660 0 0) 0x7f6404060250 con 0x7f6404061a30 2020-04-22T14:10:35.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.937+0000 7f6409033700 1 -- 172.21.15.103:0/2933520514 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6404062660 con 0x7f64040b4820 2020-04-22T14:10:35.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.937+0000 7f6409033700 1 --2- 172.21.15.103:0/2933520514 >> v2:172.21.15.103:3300/0 conn(0x7f64040b4820 0x7f64040acb10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6400002f30 tx=0x7f6400007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.937+0000 7f6409033700 1 --2- 172.21.15.103:0/2933520514 >> v2:172.21.15.103:3300/0 conn(0x7f64040b4820 0x7f64040acb10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6400002f30 tx=0x7f6400007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.937+0000 7f6409033700 1 --2- 172.21.15.103:0/2933520514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64040b4820 0x7f64040acb10 secure :-1 s=READY pgs=793 cs=0 l=1 rx=0x7f6400002f30 tx=0x7f6400007a40).ready entity=mon.1 client_cookie=eaf7e03c4369487f server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:35.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.937+0000 7f6409033700 1 --2- 172.21.15.103:0/2933520514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64040b4820 0x7f64040acb10 secure :-1 s=THROTTLE_DONE pgs=793 cs=0 l=1 rx=0x7f6400002f30 tx=0x7f6400007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.937+0000 7f6408832700 1 -- 172.21.15.103:0/2933520514 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6400011470 con 0x7f64040b4820 2020-04-22T14:10:35.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.937+0000 7f6409033700 1 --2- 172.21.15.103:0/2933520514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64040b4820 0x7f64040acb10 secure :-1 s=THROTTLE_DONE pgs=793 cs=0 l=1 rx=0x7f6400002f30 tx=0x7f6400007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.937+0000 7f6409033700 1 --2- 172.21.15.103:0/2933520514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64040b4820 0x7f64040acb10 secure :-1 s=THROTTLE_DONE pgs=793 cs=0 l=1 rx=0x7f6400002f30 tx=0x7f6400007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.937+0000 7f6408832700 1 -- 172.21.15.103:0/2933520514 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64000115d0 con 0x7f64040b4820 2020-04-22T14:10:35.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.937+0000 7f6408832700 1 -- 172.21.15.103:0/2933520514 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64000119f0 con 0x7f64040b4820 2020-04-22T14:10:35.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.937+0000 7f640ba98700 1 -- 172.21.15.103:0/2933520514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64040b4820 msgr2=0x7f64040acb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:35.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.937+0000 7f640ba98700 1 --2- 172.21.15.103:0/2933520514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64040b4820 0x7f64040acb10 secure :-1 s=READY pgs=793 cs=0 l=1 rx=0x7f6400002f30 tx=0x7f6400007a40).stop 2020-04-22T14:10:35.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.937+0000 7f640ba98700 1 -- 172.21.15.103:0/2933520514 shutdown_connections 2020-04-22T14:10:35.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.937+0000 7f640ba98700 1 --2- 172.21.15.103:0/2933520514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64040b4820 0x7f64040acb10 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:35.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.937+0000 7f640ba98700 1 -- 172.21.15.103:0/2933520514 >> 172.21.15.103:0/2933520514 conn(0x7f640405b7b0 msgr2=0x7f64040b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:35.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.938+0000 7f640ba98700 1 -- 172.21.15.103:0/2933520514 shutdown_connections 2020-04-22T14:10:35.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.938+0000 7f640ba98700 1 -- 172.21.15.103:0/2933520514 wait complete. 2020-04-22T14:10:35.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.938+0000 7f640ba98700 1 Processor -- start 2020-04-22T14:10:35.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.938+0000 7f640ba98700 1 -- start start 2020-04-22T14:10:35.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.939+0000 7f640ba98700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6404141f20 0x7f64041390f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:35.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.939+0000 7f640ba98700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64040640f0 con 0x7f64040b4820 2020-04-22T14:10:35.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.939+0000 7f640ba98700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6404142420 con 0x7f6404061a30 2020-04-22T14:10:35.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.939+0000 7f640ba98700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6404064390 con 0x7f6404141f20 2020-04-22T14:10:35.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.939+0000 7f6409834700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f6404061a30 0x7f6404154120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43304/0 (socket says 172.21.15.103:43304) 2020-04-22T14:10:35.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.939+0000 7f6409834700 1 -- 172.21.15.103:0/3367758968 learned_addr learned my addr 172.21.15.103:0/3367758968 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:35.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.939+0000 7f640a035700 1 --2- 172.21.15.103:0/3367758968 >> v2:172.21.15.103:3300/0 conn(0x7f6404141f20 0x7f64041390f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:35.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.939+0000 7f63f2ffd700 1 -- 172.21.15.103:0/3367758968 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2814664297 0 0) 0x7f6404142420 con 0x7f6404061a30 2020-04-22T14:10:35.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.939+0000 7f63f2ffd700 1 -- 172.21.15.103:0/3367758968 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63e4002fe0 con 0x7f6404061a30 2020-04-22T14:10:35.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.940+0000 7f640a035700 1 -- 172.21.15.103:0/3367758968 >> v1:172.21.15.103:6789/0 conn(0x7f6404061a30 legacy=0x7f6404154120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:35.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.940+0000 7f640a035700 1 -- 172.21.15.103:0/3367758968 >> v1:172.21.15.86:6789/0 conn(0x7f64040b4820 legacy=0x7f6404154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:35.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.940+0000 7f640a035700 1 -- 172.21.15.103:0/3367758968 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64040644d0 con 0x7f6404141f20 2020-04-22T14:10:35.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.940+0000 7f640a035700 1 --2- 172.21.15.103:0/3367758968 >> v2:172.21.15.103:3300/0 conn(0x7f6404141f20 0x7f64041390f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f640405bc40 tx=0x7f63fc0021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.940+0000 7f640a035700 1 --2- 172.21.15.103:0/3367758968 >> v2:172.21.15.103:3300/0 conn(0x7f6404141f20 0x7f64041390f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f640405bc40 tx=0x7f63fc0021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.940+0000 7f640a035700 1 --2- 172.21.15.103:0/3367758968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6404141f20 0x7f64041390f0 secure :-1 s=READY pgs=795 cs=0 l=1 rx=0x7f640405bc40 tx=0x7f63fc0021b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:35.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.940+0000 7f640a035700 1 --2- 172.21.15.103:0/3367758968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6404141f20 0x7f64041390f0 secure :-1 s=THROTTLE_DONE pgs=795 cs=0 l=1 rx=0x7f640405bc40 tx=0x7f63fc0021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.940+0000 7f63f2ffd700 1 -- 172.21.15.103:0/3367758968 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63fc0101e0 con 0x7f6404141f20 2020-04-22T14:10:35.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.940+0000 7f640a035700 1 --2- 172.21.15.103:0/3367758968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6404141f20 0x7f64041390f0 secure :-1 s=THROTTLE_DONE pgs=795 cs=0 l=1 rx=0x7f640405bc40 tx=0x7f63fc0021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.940+0000 7f640a035700 1 --2- 172.21.15.103:0/3367758968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6404141f20 0x7f64041390f0 secure :-1 s=THROTTLE_DONE pgs=795 cs=0 l=1 rx=0x7f640405bc40 tx=0x7f63fc0021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.940+0000 7f63f2ffd700 1 -- 172.21.15.103:0/3367758968 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63fc010340 con 0x7f6404141f20 2020-04-22T14:10:35.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.940+0000 7f640ba98700 1 -- 172.21.15.103:0/3367758968 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6404144ae0 con 0x7f6404141f20 2020-04-22T14:10:35.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.940+0000 7f63f2ffd700 1 -- 172.21.15.103:0/3367758968 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63fc010720 con 0x7f6404141f20 2020-04-22T14:10:35.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.940+0000 7f640ba98700 1 -- 172.21.15.103:0/3367758968 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64041399e0 con 0x7f6404141f20 2020-04-22T14:10:35.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.941+0000 7f640a035700 1 --2- 172.21.15.103:0/3367758968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6404141f20 0x7f64041390f0 secure :-1 s=THROTTLE_DONE pgs=795 cs=0 l=1 rx=0x7f640405bc40 tx=0x7f63fc0021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.941+0000 7f63f2ffd700 1 -- 172.21.15.103:0/3367758968 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f63fc013070 con 0x7f6404141f20 2020-04-22T14:10:35.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.941+0000 7f640a035700 1 --2- 172.21.15.103:0/3367758968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6404141f20 0x7f64041390f0 secure :-1 s=THROTTLE_DONE pgs=795 cs=0 l=1 rx=0x7f640405bc40 tx=0x7f63fc0021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.941+0000 7f640ba98700 1 -- 172.21.15.103:0/3367758968 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6404056c90 con 0x7f6404141f20 2020-04-22T14:10:35.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.941+0000 7f63f2ffd700 1 --2- 172.21.15.103:0/3367758968 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f63e404dca0 0x7f63e4050160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:35.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.941+0000 7f63f2ffd700 1 -- 172.21.15.103:0/3367758968 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f63fc061350 con 0x7f6404141f20 2020-04-22T14:10:35.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.942+0000 7f6409834700 1 --2- 172.21.15.103:0/3367758968 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f63e404dca0 0x7f63e4050160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:35.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.942+0000 7f6409834700 1 --2- 172.21.15.103:0/3367758968 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f63e404dca0 0x7f63e4050160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f63f4000ff0 tx=0x7f63f40016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.942+0000 7f6409834700 1 --2- 172.21.15.103:0/3367758968 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f63e404dca0 0x7f63e4050160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f63f4000ff0 tx=0x7f63f40016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.942+0000 7f6409834700 1 --2- 172.21.15.103:0/3367758968 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f63e404dca0 0x7f63e4050160 secure :-1 s=READY pgs=298 cs=0 l=1 rx=0x7f63f4000ff0 tx=0x7f63f40016e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:35.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.945+0000 7f640a035700 1 --2- 172.21.15.103:0/3367758968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6404141f20 0x7f64041390f0 secure :-1 s=THROTTLE_DONE pgs=795 cs=0 l=1 rx=0x7f640405bc40 tx=0x7f63fc0021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:35.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:35.945+0000 7f63f2ffd700 1 -- 172.21.15.103:0/3367758968 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f63fc03c6d0 con 0x7f6404141f20 2020-04-22T14:10:36.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.088+0000 7f640ba98700 1 -- 172.21.15.103:0/3367758968 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f640406a960 con 0x7f6404141f20 2020-04-22T14:10:36.092 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.088+0000 7f640a035700 1 --2- 172.21.15.103:0/3367758968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6404141f20 0x7f64041390f0 secure :-1 s=THROTTLE_DONE pgs=795 cs=0 l=1 rx=0x7f640405bc40 tx=0x7f63fc0021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:36.092 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.088+0000 7f63f2ffd700 1 -- 172.21.15.103:0/3367758968 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v60) v1 ==== 92+0+10 (secure 0 0 0) 0x7f63fc03fcf0 con 0x7f6404141f20 2020-04-22T14:10:36.092 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:10:36.093 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.090+0000 7f640ba98700 1 -- 172.21.15.103:0/3367758968 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f63e404dca0 msgr2=0x7f63e4050160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:36.093 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.090+0000 7f640ba98700 1 --2- 172.21.15.103:0/3367758968 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f63e404dca0 0x7f63e4050160 secure :-1 s=READY pgs=298 cs=0 l=1 rx=0x7f63f4000ff0 tx=0x7f63f40016e0).stop 2020-04-22T14:10:36.093 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.090+0000 7f640ba98700 1 -- 172.21.15.103:0/3367758968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6404141f20 msgr2=0x7f64041390f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:36.093 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.090+0000 7f640ba98700 1 --2- 172.21.15.103:0/3367758968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6404141f20 0x7f64041390f0 secure :-1 s=READY pgs=795 cs=0 l=1 rx=0x7f640405bc40 tx=0x7f63fc0021b0).stop 2020-04-22T14:10:36.093 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.090+0000 7f640ba98700 1 -- 172.21.15.103:0/3367758968 shutdown_connections 2020-04-22T14:10:36.093 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.090+0000 7f640ba98700 1 --2- 172.21.15.103:0/3367758968 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f63e404dca0 0x7f63e4050160 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:36.094 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.090+0000 7f640ba98700 1 --2- 172.21.15.103:0/3367758968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6404141f20 0x7f64041390f0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:36.094 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.090+0000 7f640ba98700 1 -- 172.21.15.103:0/3367758968 >> 172.21.15.103:0/3367758968 conn(0x7f640405b7b0 msgr2=0x7f64040b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:36.094 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.090+0000 7f640ba98700 1 -- 172.21.15.103:0/3367758968 shutdown_connections 2020-04-22T14:10:36.094 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.090+0000 7f640ba98700 1 -- 172.21.15.103:0/3367758968 wait complete. 2020-04-22T14:10:36.103 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:36.116 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-04-22T14:10:36.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.259+0000 7f8689441700 1 Processor -- start 2020-04-22T14:10:36.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.259+0000 7f8689441700 1 -- start start 2020-04-22T14:10:36.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.260+0000 7f8689441700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f86840b6040 0x7f86840ac740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:36.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.260+0000 7f8689441700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8684064ec0 con 0x7f8684067170 2020-04-22T14:10:36.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.260+0000 7f8689441700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8684146870 con 0x7f86841426d0 2020-04-22T14:10:36.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.260+0000 7f8689441700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8684065af0 con 0x7f86840b6040 2020-04-22T14:10:36.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.260+0000 7f86837fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f86841426d0 0x7f8684142b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43312/0 (socket says 172.21.15.103:43312) 2020-04-22T14:10:36.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.260+0000 7f86837fe700 1 -- 172.21.15.103:0/1185474859 learned_addr learned my addr 172.21.15.103:0/1185474859 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:36.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.260+0000 7f8681ffb700 1 -- 172.21.15.103:0/1185474859 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2759400678 0 0) 0x7f8684146870 con 0x7f86841426d0 2020-04-22T14:10:36.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.260+0000 7f86827fc700 1 --2- 172.21.15.103:0/1185474859 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f86840b6040 0x7f86840ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:36.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.260+0000 7f8681ffb700 1 -- 172.21.15.103:0/1185474859 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8668003230 con 0x7f86841426d0 2020-04-22T14:10:36.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.261+0000 7f8681ffb700 1 -- 172.21.15.103:0/1185474859 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 638830582 0 0) 0x7f8668003230 con 0x7f86841426d0 2020-04-22T14:10:36.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.261+0000 7f8681ffb700 1 -- 172.21.15.103:0/1185474859 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f86840b6040 msgr2=0x7f86840ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:36.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.261+0000 7f8681ffb700 1 --2- 172.21.15.103:0/1185474859 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f86840b6040 0x7f86840ac740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:36.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.261+0000 7f8681ffb700 1 -- 172.21.15.103:0/1185474859 >> v1:172.21.15.86:6789/0 conn(0x7f8684067170 legacy=0x7f868413c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:36.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.261+0000 7f8681ffb700 1 -- 172.21.15.103:0/1185474859 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8684067550 con 0x7f86841426d0 2020-04-22T14:10:36.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.261+0000 7f8681ffb700 1 -- 172.21.15.103:0/1185474859 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f867c001a50 con 0x7f86841426d0 2020-04-22T14:10:36.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.261+0000 7f8681ffb700 1 -- 172.21.15.103:0/1185474859 >> v1:172.21.15.103:6789/0 conn(0x7f86841426d0 legacy=0x7f8684142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:36.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.261+0000 7f8681ffb700 1 --2- 172.21.15.103:0/1185474859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8668003720 0x7f8668003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:36.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.261+0000 7f8681ffb700 1 --2- 172.21.15.103:0/1185474859 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f86840b6040 0x7f86680044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:36.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.261+0000 7f8681ffb700 1 --2- 172.21.15.103:0/1185474859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8668004930 0x7f8668004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:36.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.261+0000 7f8681ffb700 1 -- 172.21.15.103:0/1185474859 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8684065af0 con 0x7f8668004930 2020-04-22T14:10:36.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.261+0000 7f8681ffb700 1 -- 172.21.15.103:0/1185474859 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8668005330 con 0x7f8668003720 2020-04-22T14:10:36.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.261+0000 7f8681ffb700 1 -- 172.21.15.103:0/1185474859 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8668004120 con 0x7f86840b6040 2020-04-22T14:10:36.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.261+0000 7f8682ffd700 1 --2- 172.21.15.103:0/1185474859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8668003720 0x7f8668003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:36.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.261+0000 7f86827fc700 1 --2- 172.21.15.103:0/1185474859 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f86840b6040 0x7f86680044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:36.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.261+0000 7f86837fe700 1 --2- 172.21.15.103:0/1185474859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8668004930 0x7f8668004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:36.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.261+0000 7f8682ffd700 1 -- 172.21.15.103:0/1185474859 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f86840b6040 msgr2=0x7f86680044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:36.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.261+0000 7f8682ffd700 1 --2- 172.21.15.103:0/1185474859 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f86840b6040 0x7f86680044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:36.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.261+0000 7f8682ffd700 1 -- 172.21.15.103:0/1185474859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8668004930 msgr2=0x7f8668004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:36.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.261+0000 7f8682ffd700 1 --2- 172.21.15.103:0/1185474859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8668004930 0x7f8668004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:36.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.261+0000 7f8682ffd700 1 -- 172.21.15.103:0/1185474859 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8668003230 con 0x7f8668003720 2020-04-22T14:10:36.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.261+0000 7f8682ffd700 1 --2- 172.21.15.103:0/1185474859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8668003720 0x7f8668003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f86840663d0 tx=0x7f8678018500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:36.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.261+0000 7f8682ffd700 1 --2- 172.21.15.103:0/1185474859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8668003720 0x7f8668003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f86840663d0 tx=0x7f8678018500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:36.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.261+0000 7f8682ffd700 1 --2- 172.21.15.103:0/1185474859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8668003720 0x7f8668003b40 secure :-1 s=READY pgs=797 cs=0 l=1 rx=0x7f86840663d0 tx=0x7f8678018500).ready entity=mon.1 client_cookie=df17fc7a4325203d server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:36.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.261+0000 7f8682ffd700 1 --2- 172.21.15.103:0/1185474859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8668003720 0x7f8668003b40 secure :-1 s=THROTTLE_DONE pgs=797 cs=0 l=1 rx=0x7f86840663d0 tx=0x7f8678018500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:36.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.261+0000 7f8681ffb700 1 -- 172.21.15.103:0/1185474859 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8678018e60 con 0x7f8668003720 2020-04-22T14:10:36.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.261+0000 7f8682ffd700 1 --2- 172.21.15.103:0/1185474859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8668003720 0x7f8668003b40 secure :-1 s=THROTTLE_DONE pgs=797 cs=0 l=1 rx=0x7f86840663d0 tx=0x7f8678018500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:36.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.261+0000 7f8681ffb700 1 -- 172.21.15.103:0/1185474859 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86780067e0 con 0x7f8668003720 2020-04-22T14:10:36.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.261+0000 7f8682ffd700 1 --2- 172.21.15.103:0/1185474859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8668003720 0x7f8668003b40 secure :-1 s=THROTTLE_DONE pgs=797 cs=0 l=1 rx=0x7f86840663d0 tx=0x7f8678018500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:36.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.261+0000 7f8689441700 1 -- 172.21.15.103:0/1185474859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8668003720 msgr2=0x7f8668003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:36.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.261+0000 7f8681ffb700 1 -- 172.21.15.103:0/1185474859 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8678006c00 con 0x7f8668003720 2020-04-22T14:10:36.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.261+0000 7f8689441700 1 --2- 172.21.15.103:0/1185474859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8668003720 0x7f8668003b40 secure :-1 s=READY pgs=797 cs=0 l=1 rx=0x7f86840663d0 tx=0x7f8678018500).stop 2020-04-22T14:10:36.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.261+0000 7f86837fe700 1 -- 172.21.15.103:0/1185474859 reap_dead start 2020-04-22T14:10:36.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.262+0000 7f8689441700 1 -- 172.21.15.103:0/1185474859 shutdown_connections 2020-04-22T14:10:36.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.262+0000 7f8689441700 1 -- 172.21.15.103:0/1185474859 >> 172.21.15.103:0/1185474859 conn(0x7f86840b9160 msgr2=0x7f868405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:36.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.262+0000 7f8689441700 1 -- 172.21.15.103:0/1185474859 shutdown_connections 2020-04-22T14:10:36.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.262+0000 7f8689441700 1 -- 172.21.15.103:0/1185474859 wait complete. 2020-04-22T14:10:36.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.263+0000 7f8689441700 1 Processor -- start 2020-04-22T14:10:36.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.263+0000 7f8689441700 1 -- start start 2020-04-22T14:10:36.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.263+0000 7f8689441700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f868413a8c0 0x7f8684139020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:36.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.263+0000 7f8689441700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8684134f40 0x7f86841353d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:36.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.264+0000 7f8689441700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f868413c150 con 0x7f8684063090 2020-04-22T14:10:36.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.264+0000 7f8689441700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8684135830 con 0x7f8684134f40 2020-04-22T14:10:36.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.264+0000 7f8689441700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8684145790 con 0x7f868413a8c0 2020-04-22T14:10:36.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.264+0000 7f8682ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f868413a8c0 0x7f8684139020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:36.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.264+0000 7f8682ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f868413a8c0 0x7f8684139020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51134/0 (socket says 172.21.15.103:51134) 2020-04-22T14:10:36.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.264+0000 7f8682ffd700 1 -- 172.21.15.103:0/596132747 learned_addr learned my addr 172.21.15.103:0/596132747 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:10:36.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.264+0000 7f86827fc700 1 --2- 172.21.15.103:0/596132747 >> v2:172.21.15.86:3300/0 conn(0x7f8684134f40 0x7f86841353d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:36.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.264+0000 7f8682ffd700 1 -- 172.21.15.103:0/596132747 >> v2:172.21.15.86:3300/0 conn(0x7f8684134f40 msgr2=0x7f86841353d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:36.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.264+0000 7f8682ffd700 1 --2- 172.21.15.103:0/596132747 >> v2:172.21.15.86:3300/0 conn(0x7f8684134f40 0x7f86841353d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:36.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.264+0000 7f8682ffd700 1 -- 172.21.15.103:0/596132747 >> v1:172.21.15.86:6789/0 conn(0x7f8684063090 legacy=0x7f86840634e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:36.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.264+0000 7f8682ffd700 1 -- 172.21.15.103:0/596132747 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f868413b040 con 0x7f868413a8c0 2020-04-22T14:10:36.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.264+0000 7f8682ffd700 1 --2- 172.21.15.103:0/596132747 >> v2:172.21.15.103:3300/0 conn(0x7f868413a8c0 0x7f8684139020 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f86840663d0 tx=0x7f8678018500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:36.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.264+0000 7f8682ffd700 1 --2- 172.21.15.103:0/596132747 >> v2:172.21.15.103:3300/0 conn(0x7f868413a8c0 0x7f8684139020 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f86840663d0 tx=0x7f8678018500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:36.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.264+0000 7f8682ffd700 1 --2- 172.21.15.103:0/596132747 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f868413a8c0 0x7f8684139020 secure :-1 s=READY pgs=798 cs=0 l=1 rx=0x7f86840663d0 tx=0x7f8678018500).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:36.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.264+0000 7f8682ffd700 1 --2- 172.21.15.103:0/596132747 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f868413a8c0 0x7f8684139020 secure :-1 s=THROTTLE_DONE pgs=798 cs=0 l=1 rx=0x7f86840663d0 tx=0x7f8678018500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:36.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.264+0000 7f8673fff700 1 -- 172.21.15.103:0/596132747 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8678001ea0 con 0x7f868413a8c0 2020-04-22T14:10:36.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.264+0000 7f8682ffd700 1 --2- 172.21.15.103:0/596132747 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f868413a8c0 0x7f8684139020 secure :-1 s=THROTTLE_DONE pgs=798 cs=0 l=1 rx=0x7f86840663d0 tx=0x7f8678018500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:36.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.264+0000 7f8682ffd700 1 --2- 172.21.15.103:0/596132747 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f868413a8c0 0x7f8684139020 secure :-1 s=THROTTLE_DONE pgs=798 cs=0 l=1 rx=0x7f86840663d0 tx=0x7f8678018500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:36.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.264+0000 7f8673fff700 1 -- 172.21.15.103:0/596132747 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8678017620 con 0x7f868413a8c0 2020-04-22T14:10:36.286 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.264+0000 7f8689441700 1 -- 172.21.15.103:0/596132747 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f868413aca0 con 0x7f868413a8c0 2020-04-22T14:10:36.286 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.264+0000 7f8673fff700 1 -- 172.21.15.103:0/596132747 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8678017a40 con 0x7f868413a8c0 2020-04-22T14:10:36.286 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.264+0000 7f8689441700 1 -- 172.21.15.103:0/596132747 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8684063bf0 con 0x7f868413a8c0 2020-04-22T14:10:36.286 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.265+0000 7f8682ffd700 1 --2- 172.21.15.103:0/596132747 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f868413a8c0 0x7f8684139020 secure :-1 s=THROTTLE_DONE pgs=798 cs=0 l=1 rx=0x7f86840663d0 tx=0x7f8678018500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:36.286 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.265+0000 7f8689441700 1 -- 172.21.15.103:0/596132747 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f868413b1d0 con 0x7f868413a8c0 2020-04-22T14:10:36.286 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.265+0000 7f8673fff700 1 -- 172.21.15.103:0/596132747 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f867801c240 con 0x7f868413a8c0 2020-04-22T14:10:36.286 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.265+0000 7f8682ffd700 1 --2- 172.21.15.103:0/596132747 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f868413a8c0 0x7f8684139020 secure :-1 s=THROTTLE_DONE pgs=798 cs=0 l=1 rx=0x7f86840663d0 tx=0x7f8678018500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:36.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.265+0000 7f8673fff700 1 --2- 172.21.15.103:0/596132747 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f866004d9a0 0x7f866004fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:36.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.265+0000 7f8673fff700 1 -- 172.21.15.103:0/596132747 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f8678069fc0 con 0x7f868413a8c0 2020-04-22T14:10:36.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.266+0000 7f86827fc700 1 --2- 172.21.15.103:0/596132747 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f866004d9a0 0x7f866004fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:36.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.266+0000 7f86827fc700 1 --2- 172.21.15.103:0/596132747 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f866004d9a0 0x7f866004fe60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8674002f30 tx=0x7f867400ca90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:36.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.266+0000 7f86827fc700 1 --2- 172.21.15.103:0/596132747 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f866004d9a0 0x7f866004fe60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8674002f30 tx=0x7f867400ca90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:36.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.266+0000 7f86827fc700 1 --2- 172.21.15.103:0/596132747 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f866004d9a0 0x7f866004fe60 secure :-1 s=READY pgs=299 cs=0 l=1 rx=0x7f8674002f30 tx=0x7f867400ca90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:36.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.269+0000 7f8682ffd700 1 --2- 172.21.15.103:0/596132747 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f868413a8c0 0x7f8684139020 secure :-1 s=THROTTLE_DONE pgs=798 cs=0 l=1 rx=0x7f86840663d0 tx=0x7f8678018500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:36.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.269+0000 7f8673fff700 1 -- 172.21.15.103:0/596132747 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f86780453a0 con 0x7f868413a8c0 2020-04-22T14:10:36.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.415+0000 7f8689441700 1 -- 172.21.15.103:0/596132747 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8684056c90 con 0x7f868413a8c0 2020-04-22T14:10:36.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.415+0000 7f8682ffd700 1 --2- 172.21.15.103:0/596132747 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f868413a8c0 0x7f8684139020 secure :-1 s=THROTTLE_DONE pgs=798 cs=0 l=1 rx=0x7f86840663d0 tx=0x7f8678018500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:36.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.415+0000 7f8673fff700 1 -- 172.21.15.103:0/596132747 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v60) v1 ==== 84+0+143 (secure 0 0 0) 0x7f86780489c0 con 0x7f868413a8c0 2020-04-22T14:10:36.419 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:10:36.419 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2020-04-22T14:10:36.419 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:36.419 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 1, 2020-04-22T14:10:36.419 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": "device_health_metrics" 2020-04-22T14:10:36.419 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:36.420 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:10:36.420 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 2, 2020-04-22T14:10:36.420 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": "rbd" 2020-04-22T14:10:36.420 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:36.420 INFO:teuthology.orchestra.run.smithi103.stdout:] 2020-04-22T14:10:36.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.416+0000 7f8689441700 1 -- 172.21.15.103:0/596132747 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f866004d9a0 msgr2=0x7f866004fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:36.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.416+0000 7f8689441700 1 --2- 172.21.15.103:0/596132747 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f866004d9a0 0x7f866004fe60 secure :-1 s=READY pgs=299 cs=0 l=1 rx=0x7f8674002f30 tx=0x7f867400ca90).stop 2020-04-22T14:10:36.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.416+0000 7f8689441700 1 -- 172.21.15.103:0/596132747 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f868413a8c0 msgr2=0x7f8684139020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:36.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.416+0000 7f8689441700 1 --2- 172.21.15.103:0/596132747 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f868413a8c0 0x7f8684139020 secure :-1 s=READY pgs=798 cs=0 l=1 rx=0x7f86840663d0 tx=0x7f8678018500).stop 2020-04-22T14:10:36.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.417+0000 7f8689441700 1 -- 172.21.15.103:0/596132747 shutdown_connections 2020-04-22T14:10:36.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.417+0000 7f8689441700 1 --2- 172.21.15.103:0/596132747 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f868413a8c0 0x7f8684139020 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:36.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.417+0000 7f8689441700 1 --2- 172.21.15.103:0/596132747 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f866004d9a0 0x7f866004fe60 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:36.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.417+0000 7f8689441700 1 --2- 172.21.15.103:0/596132747 >> v2:172.21.15.86:3300/0 conn(0x7f8684134f40 0x7f86841353d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:36.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.417+0000 7f8689441700 1 -- 172.21.15.103:0/596132747 >> 172.21.15.103:0/596132747 conn(0x7f86840b9160 msgr2=0x7f8684145f50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:36.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.417+0000 7f8689441700 1 -- 172.21.15.103:0/596132747 shutdown_connections 2020-04-22T14:10:36.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.417+0000 7f8689441700 1 -- 172.21.15.103:0/596132747 wait complete. 2020-04-22T14:10:36.430 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-04-22T14:10:36.430 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:36.444 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-04-22T14:10:36.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.590+0000 7fe5a3322700 1 Processor -- start 2020-04-22T14:10:36.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.590+0000 7fe5a3322700 1 -- start start 2020-04-22T14:10:36.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.591+0000 7fe5a3322700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe59c0ac950 0x7fe59c146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:36.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.591+0000 7fe5a3322700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe59c1467e0 con 0x7fe59c1470a0 2020-04-22T14:10:36.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.591+0000 7fe5a3322700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe59c060050 con 0x7fe59c0b9140 2020-04-22T14:10:36.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.591+0000 7fe5a3322700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c0602f0 con 0x7fe59c0ac950 2020-04-22T14:10:36.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.591+0000 7fe5a10be700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe59c0b9140 0x7fe59c12b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43332/0 (socket says 172.21.15.103:43332) 2020-04-22T14:10:36.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.591+0000 7fe5a10be700 1 -- 172.21.15.103:0/3872482715 learned_addr learned my addr 172.21.15.103:0/3872482715 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:36.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.591+0000 7fe5a08bd700 1 --2- 172.21.15.103:0/3872482715 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe59c0ac950 0x7fe59c146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:36.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.591+0000 7fe58ffff700 1 -- 172.21.15.103:0/3872482715 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4192630327 0 0) 0x7fe59c060050 con 0x7fe59c0b9140 2020-04-22T14:10:36.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.591+0000 7fe58ffff700 1 -- 172.21.15.103:0/3872482715 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe584003230 con 0x7fe59c0b9140 2020-04-22T14:10:36.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.591+0000 7fe58ffff700 1 -- 172.21.15.103:0/3872482715 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 536002778 0 0) 0x7fe59c1467e0 con 0x7fe59c1470a0 2020-04-22T14:10:36.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.591+0000 7fe58ffff700 1 -- 172.21.15.103:0/3872482715 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe59c060050 con 0x7fe59c1470a0 2020-04-22T14:10:36.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.591+0000 7fe58ffff700 1 -- 172.21.15.103:0/3872482715 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 407919206 0 0) 0x7fe584003230 con 0x7fe59c0b9140 2020-04-22T14:10:36.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.591+0000 7fe58ffff700 1 -- 172.21.15.103:0/3872482715 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe59c0ac950 msgr2=0x7fe59c146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:36.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.591+0000 7fe58ffff700 1 --2- 172.21.15.103:0/3872482715 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe59c0ac950 0x7fe59c146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:36.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.591+0000 7fe58ffff700 1 -- 172.21.15.103:0/3872482715 >> v1:172.21.15.86:6789/0 conn(0x7fe59c1470a0 legacy=0x7fe59c143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:36.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.591+0000 7fe58ffff700 1 -- 172.21.15.103:0/3872482715 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe59c0b9520 con 0x7fe59c0b9140 2020-04-22T14:10:36.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.591+0000 7fe58ffff700 1 -- 172.21.15.103:0/3872482715 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fe594001a50 con 0x7fe59c0b9140 2020-04-22T14:10:36.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.591+0000 7fe5a08bd700 1 --2- 172.21.15.103:0/3872482715 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe59c0ac950 0x7fe59c146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:10:36.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.591+0000 7fe58ffff700 1 -- 172.21.15.103:0/3872482715 >> v1:172.21.15.103:6789/0 conn(0x7fe59c0b9140 legacy=0x7fe59c12b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:36.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.591+0000 7fe58ffff700 1 --2- 172.21.15.103:0/3872482715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5840038b0 0x7fe584003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:36.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.591+0000 7fe58ffff700 1 --2- 172.21.15.103:0/3872482715 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe59c0ac950 0x7fe5840044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:36.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.591+0000 7fe58ffff700 1 --2- 172.21.15.103:0/3872482715 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe584004930 0x7fe584004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:36.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.592+0000 7fe58ffff700 1 -- 172.21.15.103:0/3872482715 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c0602f0 con 0x7fe584004930 2020-04-22T14:10:36.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.592+0000 7fe58ffff700 1 -- 172.21.15.103:0/3872482715 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe584005210 con 0x7fe5840038b0 2020-04-22T14:10:36.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.592+0000 7fe58ffff700 1 -- 172.21.15.103:0/3872482715 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe58400b720 con 0x7fe59c0ac950 2020-04-22T14:10:36.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.592+0000 7fe5a10be700 1 --2- 172.21.15.103:0/3872482715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5840038b0 0x7fe584003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:36.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.592+0000 7fe5a08bd700 1 --2- 172.21.15.103:0/3872482715 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe59c0ac950 0x7fe5840044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:36.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.592+0000 7fe5a18bf700 1 --2- 172.21.15.103:0/3872482715 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe584004930 0x7fe584004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:36.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.592+0000 7fe5a10be700 1 -- 172.21.15.103:0/3872482715 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe59c0ac950 msgr2=0x7fe5840044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:36.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.592+0000 7fe5a10be700 1 --2- 172.21.15.103:0/3872482715 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe59c0ac950 0x7fe5840044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:36.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.592+0000 7fe5a10be700 1 -- 172.21.15.103:0/3872482715 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe584004930 msgr2=0x7fe584004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:36.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.592+0000 7fe5a10be700 1 --2- 172.21.15.103:0/3872482715 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe584004930 0x7fe584004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:36.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.592+0000 7fe5a10be700 1 -- 172.21.15.103:0/3872482715 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe584003230 con 0x7fe5840038b0 2020-04-22T14:10:36.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.592+0000 7fe5a18bf700 1 --2- 172.21.15.103:0/3872482715 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe584004930 0x7fe584004db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:10:36.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.592+0000 7fe5a10be700 1 --2- 172.21.15.103:0/3872482715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5840038b0 0x7fe584003cb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe594001820 tx=0x7fe59c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:36.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.592+0000 7fe5a10be700 1 --2- 172.21.15.103:0/3872482715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5840038b0 0x7fe584003cb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe594001820 tx=0x7fe59c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:36.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.592+0000 7fe5a10be700 1 --2- 172.21.15.103:0/3872482715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5840038b0 0x7fe584003cb0 secure :-1 s=READY pgs=800 cs=0 l=1 rx=0x7fe594001820 tx=0x7fe59c0b96b0).ready entity=mon.1 client_cookie=f0e5246ce3e417be server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:36.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.592+0000 7fe5a10be700 1 --2- 172.21.15.103:0/3872482715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5840038b0 0x7fe584003cb0 secure :-1 s=THROTTLE_DONE pgs=800 cs=0 l=1 rx=0x7fe594001820 tx=0x7fe59c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:36.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.592+0000 7fe5a10be700 1 --2- 172.21.15.103:0/3872482715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5840038b0 0x7fe584003cb0 secure :-1 s=THROTTLE_DONE pgs=800 cs=0 l=1 rx=0x7fe594001820 tx=0x7fe59c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:36.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.592+0000 7fe58ffff700 1 -- 172.21.15.103:0/3872482715 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe59400e560 con 0x7fe5840038b0 2020-04-22T14:10:36.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.592+0000 7fe5a10be700 1 --2- 172.21.15.103:0/3872482715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5840038b0 0x7fe584003cb0 secure :-1 s=THROTTLE_DONE pgs=800 cs=0 l=1 rx=0x7fe594001820 tx=0x7fe59c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:36.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.592+0000 7fe58ffff700 1 -- 172.21.15.103:0/3872482715 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe59400e6c0 con 0x7fe5840038b0 2020-04-22T14:10:36.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.592+0000 7fe58ffff700 1 -- 172.21.15.103:0/3872482715 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5940100c0 con 0x7fe5840038b0 2020-04-22T14:10:36.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.592+0000 7fe5a3322700 1 -- 172.21.15.103:0/3872482715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5840038b0 msgr2=0x7fe584003cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:36.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.592+0000 7fe5a3322700 1 --2- 172.21.15.103:0/3872482715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5840038b0 0x7fe584003cb0 secure :-1 s=READY pgs=800 cs=0 l=1 rx=0x7fe594001820 tx=0x7fe59c0b96b0).stop 2020-04-22T14:10:36.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.592+0000 7fe5a18bf700 1 -- 172.21.15.103:0/3872482715 reap_dead start 2020-04-22T14:10:36.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.593+0000 7fe5a3322700 1 -- 172.21.15.103:0/3872482715 shutdown_connections 2020-04-22T14:10:36.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.593+0000 7fe5a3322700 1 -- 172.21.15.103:0/3872482715 >> 172.21.15.103:0/3872482715 conn(0x7fe59c05b7b0 msgr2=0x7fe59c0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:36.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.593+0000 7fe5a3322700 1 -- 172.21.15.103:0/3872482715 shutdown_connections 2020-04-22T14:10:36.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.593+0000 7fe5a3322700 1 -- 172.21.15.103:0/3872482715 wait complete. 2020-04-22T14:10:36.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.594+0000 7fe5a3322700 1 Processor -- start 2020-04-22T14:10:36.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.594+0000 7fe5a3322700 1 -- start start 2020-04-22T14:10:36.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.594+0000 7fe5a3322700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe59c0665f0 0x7fe59c128080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:36.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.594+0000 7fe5a3322700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe59c143220 con 0x7fe59c145230 2020-04-22T14:10:36.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.594+0000 7fe5a3322700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe59c065dd0 con 0x7fe59c1284e0 2020-04-22T14:10:36.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.594+0000 7fe5a3322700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c144930 con 0x7fe59c0665f0 2020-04-22T14:10:36.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.594+0000 7fe5a18bf700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe59c1284e0 0x7fe59c0656c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43348/0 (socket says 172.21.15.103:43348) 2020-04-22T14:10:36.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.594+0000 7fe5a18bf700 1 -- 172.21.15.103:0/3258654951 learned_addr learned my addr 172.21.15.103:0/3258654951 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:36.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.595+0000 7fe5a10be700 1 --2- 172.21.15.103:0/3258654951 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe59c0665f0 0x7fe59c128080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:36.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.595+0000 7fe58e7fc700 1 -- 172.21.15.103:0/3258654951 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1950272748 0 0) 0x7fe59c065dd0 con 0x7fe59c1284e0 2020-04-22T14:10:36.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.595+0000 7fe58e7fc700 1 -- 172.21.15.103:0/3258654951 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe57c002fe0 con 0x7fe59c1284e0 2020-04-22T14:10:36.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.595+0000 7fe58e7fc700 1 -- 172.21.15.103:0/3258654951 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3768821355 0 0) 0x7fe59c143220 con 0x7fe59c145230 2020-04-22T14:10:36.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.595+0000 7fe58e7fc700 1 -- 172.21.15.103:0/3258654951 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe59c065dd0 con 0x7fe59c145230 2020-04-22T14:10:36.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.595+0000 7fe58e7fc700 1 -- 172.21.15.103:0/3258654951 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3188064684 0 0) 0x7fe57c002fe0 con 0x7fe59c1284e0 2020-04-22T14:10:36.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.595+0000 7fe58e7fc700 1 -- 172.21.15.103:0/3258654951 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe59c143220 con 0x7fe59c1284e0 2020-04-22T14:10:36.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.595+0000 7fe58e7fc700 1 -- 172.21.15.103:0/3258654951 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fe590001e10 con 0x7fe59c1284e0 2020-04-22T14:10:36.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.595+0000 7fe5a10be700 1 -- 172.21.15.103:0/3258654951 >> v1:172.21.15.103:6789/0 conn(0x7fe59c1284e0 legacy=0x7fe59c0656c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:36.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.595+0000 7fe5a10be700 1 -- 172.21.15.103:0/3258654951 >> v1:172.21.15.86:6789/0 conn(0x7fe59c145230 legacy=0x7fe59c064fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:36.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.595+0000 7fe5a10be700 1 -- 172.21.15.103:0/3258654951 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe59c066cd0 con 0x7fe59c0665f0 2020-04-22T14:10:36.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.595+0000 7fe5a10be700 1 --2- 172.21.15.103:0/3258654951 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe59c0665f0 0x7fe59c128080 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe594001820 tx=0x7fe59c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:36.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.595+0000 7fe5a10be700 1 --2- 172.21.15.103:0/3258654951 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe59c0665f0 0x7fe59c128080 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe594001820 tx=0x7fe59c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:36.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.595+0000 7fe5a10be700 1 --2- 172.21.15.103:0/3258654951 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe59c0665f0 0x7fe59c128080 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7fe594001820 tx=0x7fe59c0b96b0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:36.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.595+0000 7fe5a10be700 1 --2- 172.21.15.103:0/3258654951 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe59c0665f0 0x7fe59c128080 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7fe594001820 tx=0x7fe59c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:36.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.595+0000 7fe58e7fc700 1 -- 172.21.15.103:0/3258654951 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe594001210 con 0x7fe59c0665f0 2020-04-22T14:10:36.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.595+0000 7fe5a10be700 1 --2- 172.21.15.103:0/3258654951 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe59c0665f0 0x7fe59c128080 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7fe594001820 tx=0x7fe59c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:36.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.595+0000 7fe5a3322700 1 -- 172.21.15.103:0/3258654951 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe59c063c20 con 0x7fe59c0665f0 2020-04-22T14:10:36.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.595+0000 7fe58e7fc700 1 -- 172.21.15.103:0/3258654951 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe594004b20 con 0x7fe59c0665f0 2020-04-22T14:10:36.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.595+0000 7fe5a10be700 1 --2- 172.21.15.103:0/3258654951 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe59c0665f0 0x7fe59c128080 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7fe594001820 tx=0x7fe59c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:36.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.595+0000 7fe58e7fc700 1 -- 172.21.15.103:0/3258654951 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe594004e80 con 0x7fe59c0665f0 2020-04-22T14:10:36.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.595+0000 7fe5a3322700 1 -- 172.21.15.103:0/3258654951 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe59c143480 con 0x7fe59c0665f0 2020-04-22T14:10:36.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.596+0000 7fe5a10be700 1 --2- 172.21.15.103:0/3258654951 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe59c0665f0 0x7fe59c128080 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7fe594001820 tx=0x7fe59c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:36.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.596+0000 7fe5a3322700 1 -- 172.21.15.103:0/3258654951 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe59c066a60 con 0x7fe59c0665f0 2020-04-22T14:10:36.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.596+0000 7fe58e7fc700 1 -- 172.21.15.103:0/3258654951 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fe594010570 con 0x7fe59c0665f0 2020-04-22T14:10:36.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.596+0000 7fe5a10be700 1 --2- 172.21.15.103:0/3258654951 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe59c0665f0 0x7fe59c128080 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7fe594001820 tx=0x7fe59c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:36.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.597+0000 7fe58e7fc700 1 --2- 172.21.15.103:0/3258654951 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe57c04e060 0x7fe57c050520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:36.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.597+0000 7fe58e7fc700 1 -- 172.21.15.103:0/3258654951 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fe5940616d0 con 0x7fe59c0665f0 2020-04-22T14:10:36.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.597+0000 7fe5a08bd700 1 --2- 172.21.15.103:0/3258654951 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe57c04e060 0x7fe57c050520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:36.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.597+0000 7fe5a08bd700 1 --2- 172.21.15.103:0/3258654951 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe57c04e060 0x7fe57c050520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe598003070 tx=0x7fe5980095d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:36.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.597+0000 7fe5a08bd700 1 --2- 172.21.15.103:0/3258654951 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe57c04e060 0x7fe57c050520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe598003070 tx=0x7fe5980095d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:36.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.597+0000 7fe5a08bd700 1 --2- 172.21.15.103:0/3258654951 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe57c04e060 0x7fe57c050520 secure :-1 s=READY pgs=300 cs=0 l=1 rx=0x7fe598003070 tx=0x7fe5980095d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:36.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.600+0000 7fe5a10be700 1 --2- 172.21.15.103:0/3258654951 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe59c0665f0 0x7fe59c128080 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7fe594001820 tx=0x7fe59c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:36.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.600+0000 7fe58e7fc700 1 -- 172.21.15.103:0/3258654951 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fe59403cb70 con 0x7fe59c0665f0 2020-04-22T14:10:36.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:36.743+0000 7fe5a3322700 1 -- 172.21.15.103:0/3258654951 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fe59c064d30 con 0x7fe59c0665f0 2020-04-22T14:10:37.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.416+0000 7fe5a10be700 1 --2- 172.21.15.103:0/3258654951 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe59c0665f0 0x7fe59c128080 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7fe594001820 tx=0x7fe59c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:37.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.416+0000 7fe58e7fc700 1 -- 172.21.15.103:0/3258654951 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v61) v1 ==== 133+0+0 (secure 0 0 0) 0x7fe594040190 con 0x7fe59c0665f0 2020-04-22T14:10:37.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.419+0000 7fe5a3322700 1 -- 172.21.15.103:0/3258654951 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe57c04e060 msgr2=0x7fe57c050520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:37.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.419+0000 7fe5a3322700 1 --2- 172.21.15.103:0/3258654951 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe57c04e060 0x7fe57c050520 secure :-1 s=READY pgs=300 cs=0 l=1 rx=0x7fe598003070 tx=0x7fe5980095d0).stop 2020-04-22T14:10:37.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.419+0000 7fe5a3322700 1 -- 172.21.15.103:0/3258654951 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe59c0665f0 msgr2=0x7fe59c128080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:37.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.419+0000 7fe5a3322700 1 --2- 172.21.15.103:0/3258654951 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe59c0665f0 0x7fe59c128080 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7fe594001820 tx=0x7fe59c0b96b0).stop 2020-04-22T14:10:37.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.419+0000 7fe5a3322700 1 -- 172.21.15.103:0/3258654951 shutdown_connections 2020-04-22T14:10:37.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.419+0000 7fe5a3322700 1 --2- 172.21.15.103:0/3258654951 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe57c04e060 0x7fe57c050520 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:37.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.419+0000 7fe5a3322700 1 --2- 172.21.15.103:0/3258654951 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe59c0665f0 0x7fe59c128080 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:37.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.419+0000 7fe5a3322700 1 -- 172.21.15.103:0/3258654951 >> 172.21.15.103:0/3258654951 conn(0x7fe59c05b7b0 msgr2=0x7fe59c141950 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:37.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.419+0000 7fe5a3322700 1 -- 172.21.15.103:0/3258654951 shutdown_connections 2020-04-22T14:10:37.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.419+0000 7fe5a3322700 1 -- 172.21.15.103:0/3258654951 wait complete. 2020-04-22T14:10:37.424 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' created 2020-04-22T14:10:37.434 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:37.448 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-04-22T14:10:37.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.597+0000 7fa0e9499700 1 Processor -- start 2020-04-22T14:10:37.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.597+0000 7fa0e9499700 1 -- start start 2020-04-22T14:10:37.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.598+0000 7fa0e9499700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa0e40b9140 0x7fa0e412b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:37.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.598+0000 7fa0e9499700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa0e412b670 0x7fa0e4143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:37.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.598+0000 7fa0e9499700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0e41467e0 con 0x7fa0e40ac950 2020-04-22T14:10:37.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.598+0000 7fa0e9499700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0e40602f0 con 0x7fa0e412b670 2020-04-22T14:10:37.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.598+0000 7fa0e9499700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e4060050 con 0x7fa0e40b9140 2020-04-22T14:10:37.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.598+0000 7fa0e2ffd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa0e40b9140 0x7fa0e412b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:37.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.598+0000 7fa0e37fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa0e412b670 0x7fa0e4143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:37.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.598+0000 7fa0e2ffd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa0e40b9140 0x7fa0e412b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:35940/0 (socket says 172.21.15.103:35940) 2020-04-22T14:10:37.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.598+0000 7fa0e2ffd700 1 -- 172.21.15.103:0/1128062334 learned_addr learned my addr 172.21.15.103:0/1128062334 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:10:37.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.599+0000 7fa0e37fe700 1 -- 172.21.15.103:0/1128062334 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa0e40b9140 msgr2=0x7fa0e412b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:37.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.599+0000 7fa0e37fe700 1 --2- 172.21.15.103:0/1128062334 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa0e40b9140 0x7fa0e412b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:37.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.599+0000 7fa0e37fe700 1 -- 172.21.15.103:0/1128062334 >> v1:172.21.15.86:6789/0 conn(0x7fa0e40ac950 legacy=0x7fa0e4146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:37.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.599+0000 7fa0e37fe700 1 -- 172.21.15.103:0/1128062334 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e40b9520 con 0x7fa0e412b670 2020-04-22T14:10:37.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.599+0000 7fa0e2ffd700 1 --2- 172.21.15.103:0/1128062334 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa0e40b9140 0x7fa0e412b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:10:37.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.599+0000 7fa0e37fe700 1 --2- 172.21.15.103:0/1128062334 >> v2:172.21.15.86:3300/0 conn(0x7fa0e412b670 0x7fa0e4143090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa0dc0032b0 tx=0x7fa0dc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:37.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.599+0000 7fa0e37fe700 1 --2- 172.21.15.103:0/1128062334 >> v2:172.21.15.86:3300/0 conn(0x7fa0e412b670 0x7fa0e4143090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa0dc0032b0 tx=0x7fa0dc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:37.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.599+0000 7fa0e37fe700 1 --2- 172.21.15.103:0/1128062334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0e412b670 0x7fa0e4143090 secure :-1 s=READY pgs=452 cs=0 l=1 rx=0x7fa0dc0032b0 tx=0x7fa0dc007dc0).ready entity=mon.0 client_cookie=2e20069d38a4f2fe server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:37.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.599+0000 7fa0e37fe700 1 --2- 172.21.15.103:0/1128062334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0e412b670 0x7fa0e4143090 secure :-1 s=THROTTLE_DONE pgs=452 cs=0 l=1 rx=0x7fa0dc0032b0 tx=0x7fa0dc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:37.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.599+0000 7fa0e1ffb700 1 -- 172.21.15.103:0/1128062334 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0dc011e20 con 0x7fa0e412b670 2020-04-22T14:10:37.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.599+0000 7fa0e37fe700 1 --2- 172.21.15.103:0/1128062334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0e412b670 0x7fa0e4143090 secure :-1 s=THROTTLE_DONE pgs=452 cs=0 l=1 rx=0x7fa0dc0032b0 tx=0x7fa0dc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:37.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.599+0000 7fa0e1ffb700 1 -- 172.21.15.103:0/1128062334 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0dc00a180 con 0x7fa0e412b670 2020-04-22T14:10:37.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.599+0000 7fa0e37fe700 1 --2- 172.21.15.103:0/1128062334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0e412b670 0x7fa0e4143090 secure :-1 s=THROTTLE_DONE pgs=452 cs=0 l=1 rx=0x7fa0dc0032b0 tx=0x7fa0dc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:37.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.599+0000 7fa0e1ffb700 1 -- 172.21.15.103:0/1128062334 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0dc00a560 con 0x7fa0e412b670 2020-04-22T14:10:37.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.599+0000 7fa0e9499700 1 -- 172.21.15.103:0/1128062334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0e412b670 msgr2=0x7fa0e4143090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:37.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.599+0000 7fa0e9499700 1 --2- 172.21.15.103:0/1128062334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0e412b670 0x7fa0e4143090 secure :-1 s=READY pgs=452 cs=0 l=1 rx=0x7fa0dc0032b0 tx=0x7fa0dc007dc0).stop 2020-04-22T14:10:37.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.600+0000 7fa0e9499700 1 -- 172.21.15.103:0/1128062334 shutdown_connections 2020-04-22T14:10:37.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.600+0000 7fa0e9499700 1 --2- 172.21.15.103:0/1128062334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0e412b670 0x7fa0e4143090 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:37.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.600+0000 7fa0e9499700 1 --2- 172.21.15.103:0/1128062334 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa0e40b9140 0x7fa0e412b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:37.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.600+0000 7fa0e9499700 1 -- 172.21.15.103:0/1128062334 >> 172.21.15.103:0/1128062334 conn(0x7fa0e405b7b0 msgr2=0x7fa0e40b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:37.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.600+0000 7fa0e9499700 1 -- 172.21.15.103:0/1128062334 shutdown_connections 2020-04-22T14:10:37.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.600+0000 7fa0e9499700 1 -- 172.21.15.103:0/1128062334 wait complete. 2020-04-22T14:10:37.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.601+0000 7fa0e9499700 1 Processor -- start 2020-04-22T14:10:37.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.601+0000 7fa0e9499700 1 -- start start 2020-04-22T14:10:37.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.601+0000 7fa0e9499700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa0e40ac950 0x7fa0e4145600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:37.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.601+0000 7fa0e9499700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa0e40b9140 0x7fa0e4063980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:37.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.601+0000 7fa0e9499700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0e40b2510 con 0x7fa0e412b670 2020-04-22T14:10:37.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.601+0000 7fa0e9499700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0e4142f80 con 0x7fa0e40ac950 2020-04-22T14:10:37.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.601+0000 7fa0e9499700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e4143220 con 0x7fa0e40b9140 2020-04-22T14:10:37.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.602+0000 7fa0e2ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa0e40ac950 0x7fa0e4145600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:37.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.602+0000 7fa0e2ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa0e40ac950 0x7fa0e4145600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51170/0 (socket says 172.21.15.103:51170) 2020-04-22T14:10:37.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.602+0000 7fa0e2ffd700 1 -- 172.21.15.103:0/105041867 learned_addr learned my addr 172.21.15.103:0/105041867 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:10:37.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.602+0000 7fa0e27fc700 1 --2- 172.21.15.103:0/105041867 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa0e40b9140 0x7fa0e4063980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:37.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.602+0000 7fa0e2ffd700 1 -- 172.21.15.103:0/105041867 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa0e40b9140 msgr2=0x7fa0e4063980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:37.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.602+0000 7fa0e2ffd700 1 --2- 172.21.15.103:0/105041867 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa0e40b9140 0x7fa0e4063980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:37.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.602+0000 7fa0e2ffd700 1 -- 172.21.15.103:0/105041867 >> v1:172.21.15.86:6789/0 conn(0x7fa0e412b670 legacy=0x7fa0e4062df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:37.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.602+0000 7fa0e2ffd700 1 -- 172.21.15.103:0/105041867 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e40b2940 con 0x7fa0e40ac950 2020-04-22T14:10:37.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.602+0000 7fa0e2ffd700 1 --2- 172.21.15.103:0/105041867 >> v2:172.21.15.103:3300/0 conn(0x7fa0e40ac950 0x7fa0e4145600 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa0cc002ef0 tx=0x7fa0cc010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:37.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.602+0000 7fa0e2ffd700 1 --2- 172.21.15.103:0/105041867 >> v2:172.21.15.103:3300/0 conn(0x7fa0e40ac950 0x7fa0e4145600 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa0cc002ef0 tx=0x7fa0cc010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:37.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.602+0000 7fa0e2ffd700 1 --2- 172.21.15.103:0/105041867 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0e40ac950 0x7fa0e4145600 secure :-1 s=READY pgs=802 cs=0 l=1 rx=0x7fa0cc002ef0 tx=0x7fa0cc010ed0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:37.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.602+0000 7fa0e2ffd700 1 --2- 172.21.15.103:0/105041867 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0e40ac950 0x7fa0e4145600 secure :-1 s=THROTTLE_DONE pgs=802 cs=0 l=1 rx=0x7fa0cc002ef0 tx=0x7fa0cc010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:37.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.602+0000 7fa0dbfff700 1 -- 172.21.15.103:0/105041867 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0cc012c60 con 0x7fa0e40ac950 2020-04-22T14:10:37.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.602+0000 7fa0e2ffd700 1 --2- 172.21.15.103:0/105041867 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0e40ac950 0x7fa0e4145600 secure :-1 s=THROTTLE_DONE pgs=802 cs=0 l=1 rx=0x7fa0cc002ef0 tx=0x7fa0cc010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:37.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.602+0000 7fa0dbfff700 1 -- 172.21.15.103:0/105041867 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0cc012dc0 con 0x7fa0e40ac950 2020-04-22T14:10:37.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.602+0000 7fa0e2ffd700 1 --2- 172.21.15.103:0/105041867 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0e40ac950 0x7fa0e4145600 secure :-1 s=THROTTLE_DONE pgs=802 cs=0 l=1 rx=0x7fa0cc002ef0 tx=0x7fa0cc010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:37.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.602+0000 7fa0e9499700 1 -- 172.21.15.103:0/105041867 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0e40b20f0 con 0x7fa0e40ac950 2020-04-22T14:10:37.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.602+0000 7fa0dbfff700 1 -- 172.21.15.103:0/105041867 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0cc0058b0 con 0x7fa0e40ac950 2020-04-22T14:10:37.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.602+0000 7fa0e9499700 1 -- 172.21.15.103:0/105041867 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0e4063de0 con 0x7fa0e40ac950 2020-04-22T14:10:37.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.603+0000 7fa0e2ffd700 1 --2- 172.21.15.103:0/105041867 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0e40ac950 0x7fa0e4145600 secure :-1 s=THROTTLE_DONE pgs=802 cs=0 l=1 rx=0x7fa0cc002ef0 tx=0x7fa0cc010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:37.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.603+0000 7fa0e9499700 1 -- 172.21.15.103:0/105041867 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0e4063740 con 0x7fa0e40ac950 2020-04-22T14:10:37.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.603+0000 7fa0dbfff700 1 -- 172.21.15.103:0/105041867 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fa0cc005b30 con 0x7fa0e40ac950 2020-04-22T14:10:37.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.603+0000 7fa0e2ffd700 1 --2- 172.21.15.103:0/105041867 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0e40ac950 0x7fa0e4145600 secure :-1 s=THROTTLE_DONE pgs=802 cs=0 l=1 rx=0x7fa0cc002ef0 tx=0x7fa0cc010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:37.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.603+0000 7fa0dbfff700 1 --2- 172.21.15.103:0/105041867 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa0c804d940 0x7fa0c804fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:37.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.603+0000 7fa0dbfff700 1 -- 172.21.15.103:0/105041867 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fa0cc0619c0 con 0x7fa0e40ac950 2020-04-22T14:10:37.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.604+0000 7fa0e27fc700 1 --2- 172.21.15.103:0/105041867 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa0c804d940 0x7fa0c804fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:37.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.604+0000 7fa0e27fc700 1 --2- 172.21.15.103:0/105041867 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa0c804d940 0x7fa0c804fe00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa0e4060f70 tx=0x7fa0d400c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:37.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.604+0000 7fa0e27fc700 1 --2- 172.21.15.103:0/105041867 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa0c804d940 0x7fa0c804fe00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa0e4060f70 tx=0x7fa0d400c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:37.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.604+0000 7fa0e27fc700 1 --2- 172.21.15.103:0/105041867 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa0c804d940 0x7fa0c804fe00 secure :-1 s=READY pgs=301 cs=0 l=1 rx=0x7fa0e4060f70 tx=0x7fa0d400c820).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:37.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.607+0000 7fa0e2ffd700 1 --2- 172.21.15.103:0/105041867 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0e40ac950 0x7fa0e4145600 secure :-1 s=THROTTLE_DONE pgs=802 cs=0 l=1 rx=0x7fa0cc002ef0 tx=0x7fa0cc010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:37.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.607+0000 7fa0dbfff700 1 -- 172.21.15.103:0/105041867 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fa0cc03ce60 con 0x7fa0e40ac950 2020-04-22T14:10:37.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:37.750+0000 7fa0e9499700 1 -- 172.21.15.103:0/105041867 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fa0e4056c90 con 0x7fa0e40ac950 2020-04-22T14:10:38.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.418+0000 7fa0e2ffd700 1 --2- 172.21.15.103:0/105041867 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0e40ac950 0x7fa0e4145600 secure :-1 s=THROTTLE_DONE pgs=802 cs=0 l=1 rx=0x7fa0cc002ef0 tx=0x7fa0cc010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:38.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.418+0000 7fa0dbfff700 1 -- 172.21.15.103:0/105041867 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v62) v1 ==== 125+0+0 (secure 0 0 0) 0x7fa0cc040480 con 0x7fa0e40ac950 2020-04-22T14:10:38.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.422+0000 7fa0e9499700 1 -- 172.21.15.103:0/105041867 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa0c804d940 msgr2=0x7fa0c804fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:38.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.422+0000 7fa0e9499700 1 --2- 172.21.15.103:0/105041867 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa0c804d940 0x7fa0c804fe00 secure :-1 s=READY pgs=301 cs=0 l=1 rx=0x7fa0e4060f70 tx=0x7fa0d400c820).stop 2020-04-22T14:10:38.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.422+0000 7fa0e9499700 1 -- 172.21.15.103:0/105041867 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0e40ac950 msgr2=0x7fa0e4145600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:38.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.422+0000 7fa0e9499700 1 --2- 172.21.15.103:0/105041867 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0e40ac950 0x7fa0e4145600 secure :-1 s=READY pgs=802 cs=0 l=1 rx=0x7fa0cc002ef0 tx=0x7fa0cc010ed0).stop 2020-04-22T14:10:38.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.423+0000 7fa0e9499700 1 -- 172.21.15.103:0/105041867 shutdown_connections 2020-04-22T14:10:38.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.423+0000 7fa0e9499700 1 --2- 172.21.15.103:0/105041867 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa0c804d940 0x7fa0c804fe00 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:38.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.423+0000 7fa0e9499700 1 --2- 172.21.15.103:0/105041867 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0e40ac950 0x7fa0e4145600 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:38.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.423+0000 7fa0e9499700 1 --2- 172.21.15.103:0/105041867 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa0e40b9140 0x7fa0e4063980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:38.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.423+0000 7fa0e9499700 1 -- 172.21.15.103:0/105041867 >> 172.21.15.103:0/105041867 conn(0x7fa0e405b7b0 msgr2=0x7fa0e4128ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:38.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.423+0000 7fa0e9499700 1 -- 172.21.15.103:0/105041867 shutdown_connections 2020-04-22T14:10:38.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.423+0000 7fa0e9499700 1 -- 172.21.15.103:0/105041867 wait complete. 2020-04-22T14:10:38.431 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' created 2020-04-22T14:10:38.440 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:38.461 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-04-22T14:10:38.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.612+0000 7f961b7d1700 1 Processor -- start 2020-04-22T14:10:38.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.613+0000 7f961b7d1700 1 -- start start 2020-04-22T14:10:38.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.613+0000 7f961b7d1700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f96140ac950 0x7f9614146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:38.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.613+0000 7f961b7d1700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96141467e0 con 0x7f96140b9140 2020-04-22T14:10:38.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.613+0000 7f961b7d1700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9614060050 con 0x7f96141470a0 2020-04-22T14:10:38.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.613+0000 7f961b7d1700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9614147530 con 0x7f96140ac950 2020-04-22T14:10:38.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.614+0000 7f9618d6c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f96140ac950 0x7f9614146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:38.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.614+0000 7f9619d6e700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f96141470a0 0x7f9614143090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43368/0 (socket says 172.21.15.103:43368) 2020-04-22T14:10:38.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.614+0000 7f9619d6e700 1 -- 172.21.15.103:0/829199012 learned_addr learned my addr 172.21.15.103:0/829199012 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:38.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.614+0000 7f9618d6c700 1 -- 172.21.15.103:0/829199012 >> v1:172.21.15.103:6789/0 conn(0x7f96141470a0 legacy=0x7f9614143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:38.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.614+0000 7f9618d6c700 1 -- 172.21.15.103:0/829199012 >> v1:172.21.15.86:6789/0 conn(0x7f96140b9140 legacy=0x7f961412b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:38.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.614+0000 7f9618d6c700 1 -- 172.21.15.103:0/829199012 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96140b9520 con 0x7f96140ac950 2020-04-22T14:10:38.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.614+0000 7f9618d6c700 1 --2- 172.21.15.103:0/829199012 >> v2:172.21.15.103:3300/0 conn(0x7f96140ac950 0x7f9614146c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f96140b6250 tx=0x7f9610007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:38.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.614+0000 7f9618d6c700 1 --2- 172.21.15.103:0/829199012 >> v2:172.21.15.103:3300/0 conn(0x7f96140ac950 0x7f9614146c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f96140b6250 tx=0x7f9610007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:38.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.614+0000 7f9618d6c700 1 --2- 172.21.15.103:0/829199012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96140ac950 0x7f9614146c40 secure :-1 s=READY pgs=804 cs=0 l=1 rx=0x7f96140b6250 tx=0x7f9610007a40).ready entity=mon.1 client_cookie=4eccaeaa848d1436 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:38.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.614+0000 7f9618d6c700 1 --2- 172.21.15.103:0/829199012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96140ac950 0x7f9614146c40 secure :-1 s=THROTTLE_DONE pgs=804 cs=0 l=1 rx=0x7f96140b6250 tx=0x7f9610007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:38.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.614+0000 7f9603fff700 1 -- 172.21.15.103:0/829199012 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9610011430 con 0x7f96140ac950 2020-04-22T14:10:38.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.614+0000 7f9618d6c700 1 --2- 172.21.15.103:0/829199012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96140ac950 0x7f9614146c40 secure :-1 s=THROTTLE_DONE pgs=804 cs=0 l=1 rx=0x7f96140b6250 tx=0x7f9610007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:38.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.614+0000 7f9618d6c700 1 --2- 172.21.15.103:0/829199012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96140ac950 0x7f9614146c40 secure :-1 s=THROTTLE_DONE pgs=804 cs=0 l=1 rx=0x7f96140b6250 tx=0x7f9610007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:38.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.614+0000 7f9603fff700 1 -- 172.21.15.103:0/829199012 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9610011590 con 0x7f96140ac950 2020-04-22T14:10:38.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.614+0000 7f9603fff700 1 -- 172.21.15.103:0/829199012 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96100119b0 con 0x7f96140ac950 2020-04-22T14:10:38.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.614+0000 7f961b7d1700 1 -- 172.21.15.103:0/829199012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96140ac950 msgr2=0x7f9614146c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:38.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.614+0000 7f961b7d1700 1 --2- 172.21.15.103:0/829199012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96140ac950 0x7f9614146c40 secure :-1 s=READY pgs=804 cs=0 l=1 rx=0x7f96140b6250 tx=0x7f9610007a40).stop 2020-04-22T14:10:38.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.615+0000 7f961b7d1700 1 -- 172.21.15.103:0/829199012 shutdown_connections 2020-04-22T14:10:38.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.615+0000 7f961b7d1700 1 --2- 172.21.15.103:0/829199012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96140ac950 0x7f9614146c40 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:38.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.615+0000 7f961b7d1700 1 -- 172.21.15.103:0/829199012 >> 172.21.15.103:0/829199012 conn(0x7f961405b7b0 msgr2=0x7f96140b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:38.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.615+0000 7f961b7d1700 1 -- 172.21.15.103:0/829199012 shutdown_connections 2020-04-22T14:10:38.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.615+0000 7f961b7d1700 1 -- 172.21.15.103:0/829199012 wait complete. 2020-04-22T14:10:38.625 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.616+0000 7f961b7d1700 1 Processor -- start 2020-04-22T14:10:38.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.616+0000 7f961b7d1700 1 -- start start 2020-04-22T14:10:38.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.616+0000 7f961b7d1700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96140ac950 0x7f9614127b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:38.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.616+0000 7f961b7d1700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f96140b9140 0x7f9614062db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:38.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.616+0000 7f961b7d1700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f96141470a0 0x7f96140b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:38.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.616+0000 7f961b7d1700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9614128610 con 0x7f96141470a0 2020-04-22T14:10:38.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.616+0000 7f961b7d1700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9614063730 con 0x7f96140b9140 2020-04-22T14:10:38.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.616+0000 7f961b7d1700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9614063210 con 0x7f96140ac950 2020-04-22T14:10:38.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.617+0000 7f9618d6c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f96140b9140 0x7f9614062db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:38.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.617+0000 7f9618d6c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f96140b9140 0x7f9614062db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51184/0 (socket says 172.21.15.103:51184) 2020-04-22T14:10:38.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.617+0000 7f9618d6c700 1 -- 172.21.15.103:0/2394127688 learned_addr learned my addr 172.21.15.103:0/2394127688 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:10:38.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.617+0000 7f9619d6e700 1 --2- 172.21.15.103:0/2394127688 >> v2:172.21.15.86:3300/0 conn(0x7f96141470a0 0x7f96140b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:38.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.617+0000 7f961956d700 1 --2- 172.21.15.103:0/2394127688 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96140ac950 0x7f9614127b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:38.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.617+0000 7f9618d6c700 1 -- 172.21.15.103:0/2394127688 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96140ac950 msgr2=0x7f9614127b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:38.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.617+0000 7f9618d6c700 1 --2- 172.21.15.103:0/2394127688 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96140ac950 0x7f9614127b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:38.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.617+0000 7f9618d6c700 1 -- 172.21.15.103:0/2394127688 >> v2:172.21.15.86:3300/0 conn(0x7f96141470a0 msgr2=0x7f96140b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:38.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.617+0000 7f9618d6c700 1 --2- 172.21.15.103:0/2394127688 >> v2:172.21.15.86:3300/0 conn(0x7f96141470a0 0x7f96140b3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:38.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.617+0000 7f9618d6c700 1 -- 172.21.15.103:0/2394127688 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96140639b0 con 0x7f96140b9140 2020-04-22T14:10:38.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.617+0000 7f961956d700 1 --2- 172.21.15.103:0/2394127688 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96140ac950 0x7f9614127b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:10:38.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.617+0000 7f9618d6c700 1 --2- 172.21.15.103:0/2394127688 >> v2:172.21.15.103:3300/0 conn(0x7f96140b9140 0x7f9614062db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f96140b6250 tx=0x7f9610007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:38.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.617+0000 7f9618d6c700 1 --2- 172.21.15.103:0/2394127688 >> v2:172.21.15.103:3300/0 conn(0x7f96140b9140 0x7f9614062db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f96140b6250 tx=0x7f9610007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:38.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.617+0000 7f9618d6c700 1 --2- 172.21.15.103:0/2394127688 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96140b9140 0x7f9614062db0 secure :-1 s=READY pgs=805 cs=0 l=1 rx=0x7f96140b6250 tx=0x7f9610007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:38.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.617+0000 7f9618d6c700 1 --2- 172.21.15.103:0/2394127688 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96140b9140 0x7f9614062db0 secure :-1 s=THROTTLE_DONE pgs=805 cs=0 l=1 rx=0x7f96140b6250 tx=0x7f9610007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:38.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.617+0000 7f96027fc700 1 -- 172.21.15.103:0/2394127688 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f961000f840 con 0x7f96140b9140 2020-04-22T14:10:38.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.617+0000 7f9618d6c700 1 --2- 172.21.15.103:0/2394127688 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96140b9140 0x7f9614062db0 secure :-1 s=THROTTLE_DONE pgs=805 cs=0 l=1 rx=0x7f96140b6250 tx=0x7f9610007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:38.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.617+0000 7f9618d6c700 1 --2- 172.21.15.103:0/2394127688 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96140b9140 0x7f9614062db0 secure :-1 s=THROTTLE_DONE pgs=805 cs=0 l=1 rx=0x7f96140b6250 tx=0x7f9610007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:38.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.617+0000 7f96027fc700 1 -- 172.21.15.103:0/2394127688 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9610007360 con 0x7f96140b9140 2020-04-22T14:10:38.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.617+0000 7f961b7d1700 1 -- 172.21.15.103:0/2394127688 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96140b5c10 con 0x7f96140b9140 2020-04-22T14:10:38.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.617+0000 7f96027fc700 1 -- 172.21.15.103:0/2394127688 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96100056c0 con 0x7f96140b9140 2020-04-22T14:10:38.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.617+0000 7f961b7d1700 1 -- 172.21.15.103:0/2394127688 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f961413ece0 con 0x7f96140b9140 2020-04-22T14:10:38.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.618+0000 7f9618d6c700 1 --2- 172.21.15.103:0/2394127688 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96140b9140 0x7f9614062db0 secure :-1 s=THROTTLE_DONE pgs=805 cs=0 l=1 rx=0x7f96140b6250 tx=0x7f9610007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:38.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.618+0000 7f96027fc700 1 -- 172.21.15.103:0/2394127688 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f9610005930 con 0x7f96140b9140 2020-04-22T14:10:38.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.618+0000 7f9618d6c700 1 --2- 172.21.15.103:0/2394127688 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96140b9140 0x7f9614062db0 secure :-1 s=THROTTLE_DONE pgs=805 cs=0 l=1 rx=0x7f96140b6250 tx=0x7f9610007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:38.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.618+0000 7f961b7d1700 1 -- 172.21.15.103:0/2394127688 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9614063b40 con 0x7f96140b9140 2020-04-22T14:10:38.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.618+0000 7f96027fc700 1 --2- 172.21.15.103:0/2394127688 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f95f404d910 0x7f95f404fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:38.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.618+0000 7f96027fc700 1 -- 172.21.15.103:0/2394127688 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f9610061cd0 con 0x7f96140b9140 2020-04-22T14:10:38.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.619+0000 7f961956d700 1 --2- 172.21.15.103:0/2394127688 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f95f404d910 0x7f95f404fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:38.632 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.619+0000 7f961956d700 1 --2- 172.21.15.103:0/2394127688 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f95f404d910 0x7f95f404fdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9604001f50 tx=0x7f96040027c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:38.632 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.619+0000 7f961956d700 1 --2- 172.21.15.103:0/2394127688 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f95f404d910 0x7f95f404fdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9604001f50 tx=0x7f96040027c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:38.632 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.619+0000 7f961956d700 1 --2- 172.21.15.103:0/2394127688 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f95f404d910 0x7f95f404fdd0 secure :-1 s=READY pgs=303 cs=0 l=1 rx=0x7f9604001f50 tx=0x7f96040027c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:38.632 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.622+0000 7f9618d6c700 1 --2- 172.21.15.103:0/2394127688 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96140b9140 0x7f9614062db0 secure :-1 s=THROTTLE_DONE pgs=805 cs=0 l=1 rx=0x7f96140b6250 tx=0x7f9610007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:38.632 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.623+0000 7f96027fc700 1 -- 172.21.15.103:0/2394127688 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f9614063b40 con 0x7f96140b9140 2020-04-22T14:10:38.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.814+0000 7f961b7d1700 1 -- 172.21.15.103:0/2394127688 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f9614063b40 con 0x7f96140b9140 2020-04-22T14:10:38.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.822+0000 7f9618d6c700 1 --2- 172.21.15.103:0/2394127688 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96140b9140 0x7f9614062db0 secure :-1 s=THROTTLE_DONE pgs=805 cs=0 l=1 rx=0x7f96140b6250 tx=0x7f9610007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:38.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.822+0000 7f96027fc700 1 -- 172.21.15.103:0/2394127688 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 11 and data pool 12 v33) v1 ==== 189+0+0 (secure 0 0 0) 0x7f9614063b40 con 0x7f96140b9140 2020-04-22T14:10:38.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.825+0000 7f961b7d1700 1 -- 172.21.15.103:0/2394127688 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f95f404d910 msgr2=0x7f95f404fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:38.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.825+0000 7f961b7d1700 1 --2- 172.21.15.103:0/2394127688 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f95f404d910 0x7f95f404fdd0 secure :-1 s=READY pgs=303 cs=0 l=1 rx=0x7f9604001f50 tx=0x7f96040027c0).stop 2020-04-22T14:10:38.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.825+0000 7f961b7d1700 1 -- 172.21.15.103:0/2394127688 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96140b9140 msgr2=0x7f9614062db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:38.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.825+0000 7f961b7d1700 1 --2- 172.21.15.103:0/2394127688 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96140b9140 0x7f9614062db0 secure :-1 s=READY pgs=805 cs=0 l=1 rx=0x7f96140b6250 tx=0x7f9610007a40).stop 2020-04-22T14:10:38.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.828+0000 7f961b7d1700 1 -- 172.21.15.103:0/2394127688 shutdown_connections 2020-04-22T14:10:38.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.828+0000 7f961b7d1700 1 --2- 172.21.15.103:0/2394127688 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f95f404d910 0x7f95f404fdd0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:38.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.828+0000 7f961b7d1700 1 --2- 172.21.15.103:0/2394127688 >> v2:172.21.15.86:3300/0 conn(0x7f96141470a0 0x7f96140b3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:38.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.828+0000 7f961b7d1700 1 --2- 172.21.15.103:0/2394127688 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96140ac950 0x7f9614127b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:38.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.828+0000 7f961b7d1700 1 --2- 172.21.15.103:0/2394127688 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96140b9140 0x7f9614062db0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:38.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.828+0000 7f961b7d1700 1 -- 172.21.15.103:0/2394127688 >> 172.21.15.103:0/2394127688 conn(0x7f961405b7b0 msgr2=0x7f96140b7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:38.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.830+0000 7f961b7d1700 1 -- 172.21.15.103:0/2394127688 shutdown_connections 2020-04-22T14:10:38.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:38.830+0000 7f961b7d1700 1 -- 172.21.15.103:0/2394127688 wait complete. 2020-04-22T14:10:38.834 INFO:teuthology.orchestra.run.smithi103.stderr:new fs with metadata pool 11 and data pool 12 2020-04-22T14:10:38.845 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:38.859 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:10:39.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.002+0000 7f114ea76700 1 Processor -- start 2020-04-22T14:10:39.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.003+0000 7f114ea76700 1 -- start start 2020-04-22T14:10:39.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.003+0000 7f114ea76700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f11481403f0 0x7f114805f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:39.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.003+0000 7f114ea76700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1148062aa0 0x7f11480b3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:39.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.003+0000 7f114ea76700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11480620c0 con 0x7f1148146480 2020-04-22T14:10:39.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.003+0000 7f114ea76700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1148147410 con 0x7f11481403f0 2020-04-22T14:10:39.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.003+0000 7f114ea76700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1148062360 con 0x7f1148062aa0 2020-04-22T14:10:39.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.003+0000 7f114d013700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1148062aa0 0x7f11480b3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:39.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.003+0000 7f1147fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f1148146480 0x7f11480b5690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43392/0 (socket says 172.21.15.103:43392) 2020-04-22T14:10:39.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.003+0000 7f1147fff700 1 -- 172.21.15.103:0/986387913 learned_addr learned my addr 172.21.15.103:0/986387913 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:39.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.004+0000 7f114c812700 1 --2- 172.21.15.103:0/986387913 >> v2:172.21.15.86:3300/0 conn(0x7f11481403f0 0x7f114805f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:39.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.004+0000 7f11477fe700 1 -- 172.21.15.103:0/986387913 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 386098786 0 0) 0x7f11480620c0 con 0x7f1148146480 2020-04-22T14:10:39.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.004+0000 7f11477fe700 1 -- 172.21.15.103:0/986387913 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1134003230 con 0x7f1148146480 2020-04-22T14:10:39.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.004+0000 7f114d013700 1 -- 172.21.15.103:0/986387913 >> v2:172.21.15.86:3300/0 conn(0x7f11481403f0 msgr2=0x7f114805f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:39.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.004+0000 7f114d013700 1 --2- 172.21.15.103:0/986387913 >> v2:172.21.15.86:3300/0 conn(0x7f11481403f0 0x7f114805f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:39.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.004+0000 7f114d013700 1 -- 172.21.15.103:0/986387913 >> v1:172.21.15.103:6789/0 conn(0x7f1148146480 legacy=0x7f11480b5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:39.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.004+0000 7f114d013700 1 -- 172.21.15.103:0/986387913 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1148062600 con 0x7f1148062aa0 2020-04-22T14:10:39.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.004+0000 7f114d013700 1 --2- 172.21.15.103:0/986387913 >> v2:172.21.15.103:3300/0 conn(0x7f1148062aa0 0x7f11480b3910 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f11400032b0 tx=0x7f1140007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.004+0000 7f114d013700 1 --2- 172.21.15.103:0/986387913 >> v2:172.21.15.103:3300/0 conn(0x7f1148062aa0 0x7f11480b3910 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f11400032b0 tx=0x7f1140007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.004+0000 7f114d013700 1 --2- 172.21.15.103:0/986387913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1148062aa0 0x7f11480b3910 secure :-1 s=READY pgs=807 cs=0 l=1 rx=0x7f11400032b0 tx=0x7f1140007dc0).ready entity=mon.1 client_cookie=c65e4055922db52e server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:39.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.004+0000 7f114d013700 1 --2- 172.21.15.103:0/986387913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1148062aa0 0x7f11480b3910 secure :-1 s=THROTTLE_DONE pgs=807 cs=0 l=1 rx=0x7f11400032b0 tx=0x7f1140007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.004+0000 7f11477fe700 1 -- 172.21.15.103:0/986387913 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1140011d70 con 0x7f1148062aa0 2020-04-22T14:10:39.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.004+0000 7f114d013700 1 --2- 172.21.15.103:0/986387913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1148062aa0 0x7f11480b3910 secure :-1 s=THROTTLE_DONE pgs=807 cs=0 l=1 rx=0x7f11400032b0 tx=0x7f1140007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.004+0000 7f114d013700 1 --2- 172.21.15.103:0/986387913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1148062aa0 0x7f11480b3910 secure :-1 s=THROTTLE_DONE pgs=807 cs=0 l=1 rx=0x7f11400032b0 tx=0x7f1140007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.004+0000 7f11477fe700 1 -- 172.21.15.103:0/986387913 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114000a180 con 0x7f1148062aa0 2020-04-22T14:10:39.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.004+0000 7f11477fe700 1 -- 172.21.15.103:0/986387913 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f114000a5a0 con 0x7f1148062aa0 2020-04-22T14:10:39.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.004+0000 7f114ea76700 1 -- 172.21.15.103:0/986387913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1148062aa0 msgr2=0x7f11480b3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:39.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.004+0000 7f114ea76700 1 --2- 172.21.15.103:0/986387913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1148062aa0 0x7f11480b3910 secure :-1 s=READY pgs=807 cs=0 l=1 rx=0x7f11400032b0 tx=0x7f1140007dc0).stop 2020-04-22T14:10:39.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.005+0000 7f114ea76700 1 -- 172.21.15.103:0/986387913 shutdown_connections 2020-04-22T14:10:39.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.005+0000 7f114ea76700 1 --2- 172.21.15.103:0/986387913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1148062aa0 0x7f11480b3910 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:39.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.005+0000 7f114ea76700 1 --2- 172.21.15.103:0/986387913 >> v2:172.21.15.86:3300/0 conn(0x7f11481403f0 0x7f114805f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:39.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.005+0000 7f114ea76700 1 -- 172.21.15.103:0/986387913 >> 172.21.15.103:0/986387913 conn(0x7f114805ad30 msgr2=0x7f114805b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:39.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.005+0000 7f114ea76700 1 -- 172.21.15.103:0/986387913 shutdown_connections 2020-04-22T14:10:39.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.005+0000 7f114ea76700 1 -- 172.21.15.103:0/986387913 wait complete. 2020-04-22T14:10:39.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.006+0000 7f114ea76700 1 Processor -- start 2020-04-22T14:10:39.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.006+0000 7f114ea76700 1 -- start start 2020-04-22T14:10:39.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.006+0000 7f114ea76700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1148062aa0 0x7f11480b8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:39.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.006+0000 7f114ea76700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1148146480 0x7f11481423d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:39.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.006+0000 7f114ea76700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11480b8690 con 0x7f11481403f0 2020-04-22T14:10:39.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.006+0000 7f114ea76700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1148142d80 con 0x7f1148146480 2020-04-22T14:10:39.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.006+0000 7f114ea76700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1148143020 con 0x7f1148062aa0 2020-04-22T14:10:39.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.006+0000 7f114c812700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1148062aa0 0x7f11480b8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:39.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.006+0000 7f114c812700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1148062aa0 0x7f11480b8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51206/0 (socket says 172.21.15.103:51206) 2020-04-22T14:10:39.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.007+0000 7f114c812700 1 -- 172.21.15.103:0/2744525925 learned_addr learned my addr 172.21.15.103:0/2744525925 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:10:39.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.007+0000 7f114d013700 1 --2- 172.21.15.103:0/2744525925 >> v2:172.21.15.86:3300/0 conn(0x7f1148146480 0x7f11481423d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:39.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.007+0000 7f114c812700 1 -- 172.21.15.103:0/2744525925 >> v2:172.21.15.86:3300/0 conn(0x7f1148146480 msgr2=0x7f11481423d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:39.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.007+0000 7f114c812700 1 --2- 172.21.15.103:0/2744525925 >> v2:172.21.15.86:3300/0 conn(0x7f1148146480 0x7f11481423d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:39.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.007+0000 7f114c812700 1 -- 172.21.15.103:0/2744525925 >> v1:172.21.15.86:6789/0 conn(0x7f11481403f0 legacy=0x7f1148143760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:39.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.007+0000 7f114c812700 1 -- 172.21.15.103:0/2744525925 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11481432c0 con 0x7f1148062aa0 2020-04-22T14:10:39.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.007+0000 7f114c812700 1 --2- 172.21.15.103:0/2744525925 >> v2:172.21.15.103:3300/0 conn(0x7f1148062aa0 0x7f11480b8230 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1138003070 tx=0x7f1138010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.007+0000 7f114c812700 1 --2- 172.21.15.103:0/2744525925 >> v2:172.21.15.103:3300/0 conn(0x7f1148062aa0 0x7f11480b8230 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1138003070 tx=0x7f1138010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.007+0000 7f114c812700 1 --2- 172.21.15.103:0/2744525925 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1148062aa0 0x7f11480b8230 secure :-1 s=READY pgs=808 cs=0 l=1 rx=0x7f1138003070 tx=0x7f1138010ce0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:39.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.007+0000 7f114c812700 1 --2- 172.21.15.103:0/2744525925 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1148062aa0 0x7f11480b8230 secure :-1 s=THROTTLE_DONE pgs=808 cs=0 l=1 rx=0x7f1138003070 tx=0x7f1138010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.007+0000 7f1145ffb700 1 -- 172.21.15.103:0/2744525925 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1138007560 con 0x7f1148062aa0 2020-04-22T14:10:39.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.007+0000 7f114c812700 1 --2- 172.21.15.103:0/2744525925 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1148062aa0 0x7f11480b8230 secure :-1 s=THROTTLE_DONE pgs=808 cs=0 l=1 rx=0x7f1138003070 tx=0x7f1138010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.007+0000 7f1145ffb700 1 -- 172.21.15.103:0/2744525925 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11380059c0 con 0x7f1148062aa0 2020-04-22T14:10:39.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.007+0000 7f114c812700 1 --2- 172.21.15.103:0/2744525925 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1148062aa0 0x7f11480b8230 secure :-1 s=THROTTLE_DONE pgs=808 cs=0 l=1 rx=0x7f1138003070 tx=0x7f1138010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.007+0000 7f114ea76700 1 -- 172.21.15.103:0/2744525925 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11480b9cc0 con 0x7f1148062aa0 2020-04-22T14:10:39.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.007+0000 7f1145ffb700 1 -- 172.21.15.103:0/2744525925 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1138005da0 con 0x7f1148062aa0 2020-04-22T14:10:39.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.007+0000 7f114ea76700 1 -- 172.21.15.103:0/2744525925 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11481429f0 con 0x7f1148062aa0 2020-04-22T14:10:39.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.008+0000 7f114c812700 1 --2- 172.21.15.103:0/2744525925 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1148062aa0 0x7f11480b8230 secure :-1 s=THROTTLE_DONE pgs=808 cs=0 l=1 rx=0x7f1138003070 tx=0x7f1138010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.008+0000 7f114ea76700 1 -- 172.21.15.103:0/2744525925 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1148056c90 con 0x7f1148062aa0 2020-04-22T14:10:39.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.008+0000 7f1145ffb700 1 -- 172.21.15.103:0/2744525925 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f1138008970 con 0x7f1148062aa0 2020-04-22T14:10:39.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.008+0000 7f114c812700 1 --2- 172.21.15.103:0/2744525925 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1148062aa0 0x7f11480b8230 secure :-1 s=THROTTLE_DONE pgs=808 cs=0 l=1 rx=0x7f1138003070 tx=0x7f1138010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.009+0000 7f1145ffb700 1 --2- 172.21.15.103:0/2744525925 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f112804d9d0 0x7f112804fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:39.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.009+0000 7f1145ffb700 1 -- 172.21.15.103:0/2744525925 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f11380616c0 con 0x7f1148062aa0 2020-04-22T14:10:39.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.009+0000 7f1147fff700 1 --2- 172.21.15.103:0/2744525925 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f112804d9d0 0x7f112804fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:39.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.009+0000 7f1147fff700 1 --2- 172.21.15.103:0/2744525925 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f112804d9d0 0x7f112804fe90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f11480b8db0 tx=0x7f113c001490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.009+0000 7f1147fff700 1 --2- 172.21.15.103:0/2744525925 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f112804d9d0 0x7f112804fe90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f11480b8db0 tx=0x7f113c001490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.009+0000 7f1147fff700 1 --2- 172.21.15.103:0/2744525925 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f112804d9d0 0x7f112804fe90 secure :-1 s=READY pgs=304 cs=0 l=1 rx=0x7f11480b8db0 tx=0x7f113c001490).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:39.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.013+0000 7f114c812700 1 --2- 172.21.15.103:0/2744525925 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1148062aa0 0x7f11480b8230 secure :-1 s=THROTTLE_DONE pgs=808 cs=0 l=1 rx=0x7f1138003070 tx=0x7f1138010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.013+0000 7f1145ffb700 1 -- 172.21.15.103:0/2744525925 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f113803ca40 con 0x7f1148062aa0 2020-04-22T14:10:39.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.154+0000 7f114ea76700 1 -- 172.21.15.103:0/2744525925 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f114805f740 con 0x7f1148062aa0 2020-04-22T14:10:39.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.155+0000 7f114c812700 1 --2- 172.21.15.103:0/2744525925 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1148062aa0 0x7f11480b8230 secure :-1 s=THROTTLE_DONE pgs=808 cs=0 l=1 rx=0x7f1138003070 tx=0x7f1138010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.155+0000 7f1145ffb700 1 -- 172.21.15.103:0/2744525925 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+16105 (secure 0 0 0) 0x7f1138040060 con 0x7f1148062aa0 2020-04-22T14:10:39.159 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:10:39.159 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":63,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:10:38.817439+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:10:36.758101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2020-04-22T14:10:37.765010+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:10:39.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.156+0000 7f114ea76700 1 -- 172.21.15.103:0/2744525925 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f112804d9d0 msgr2=0x7f112804fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:39.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.156+0000 7f114ea76700 1 --2- 172.21.15.103:0/2744525925 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f112804d9d0 0x7f112804fe90 secure :-1 s=READY pgs=304 cs=0 l=1 rx=0x7f11480b8db0 tx=0x7f113c001490).stop 2020-04-22T14:10:39.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.156+0000 7f114ea76700 1 -- 172.21.15.103:0/2744525925 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1148062aa0 msgr2=0x7f11480b8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:39.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.156+0000 7f114ea76700 1 --2- 172.21.15.103:0/2744525925 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1148062aa0 0x7f11480b8230 secure :-1 s=READY pgs=808 cs=0 l=1 rx=0x7f1138003070 tx=0x7f1138010ce0).stop 2020-04-22T14:10:39.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.156+0000 7f114ea76700 1 -- 172.21.15.103:0/2744525925 shutdown_connections 2020-04-22T14:10:39.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.156+0000 7f114ea76700 1 --2- 172.21.15.103:0/2744525925 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f112804d9d0 0x7f112804fe90 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:39.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.157+0000 7f114ea76700 1 --2- 172.21.15.103:0/2744525925 >> v2:172.21.15.86:3300/0 conn(0x7f1148146480 0x7f11481423d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:39.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.157+0000 7f114ea76700 1 --2- 172.21.15.103:0/2744525925 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1148062aa0 0x7f11480b8230 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:39.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.157+0000 7f114ea76700 1 -- 172.21.15.103:0/2744525925 >> 172.21.15.103:0/2744525925 conn(0x7f114805ad30 msgr2=0x7f1148144050 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:39.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.157+0000 7f114ea76700 1 -- 172.21.15.103:0/2744525925 shutdown_connections 2020-04-22T14:10:39.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.157+0000 7f114ea76700 1 -- 172.21.15.103:0/2744525925 wait complete. 2020-04-22T14:10:39.171 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:39.186 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:10:39.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.330+0000 7f6b29c81700 1 Processor -- start 2020-04-22T14:10:39.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.330+0000 7f6b29c81700 1 -- start start 2020-04-22T14:10:39.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.331+0000 7f6b29c81700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6b241464e0 0x7f6b24064540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:39.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.331+0000 7f6b29c81700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b24143300 con 0x7f6b2412c0d0 2020-04-22T14:10:39.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.331+0000 7f6b29c81700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b241435a0 con 0x7f6b24065fe0 2020-04-22T14:10:39.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.331+0000 7f6b29c81700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b24143840 con 0x7f6b241464e0 2020-04-22T14:10:39.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.331+0000 7f6b23fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6b241464e0 0x7f6b24064540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:39.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.331+0000 7f6b22ffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f6b24065fe0 0x7f6b24063e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43406/0 (socket says 172.21.15.103:43406) 2020-04-22T14:10:39.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.331+0000 7f6b22ffd700 1 -- 172.21.15.103:0/3838887437 learned_addr learned my addr 172.21.15.103:0/3838887437 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:39.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.331+0000 7f6b23fff700 1 -- 172.21.15.103:0/3838887437 >> v1:172.21.15.103:6789/0 conn(0x7f6b24065fe0 legacy=0x7f6b24063e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:39.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.331+0000 7f6b23fff700 1 -- 172.21.15.103:0/3838887437 >> v1:172.21.15.86:6789/0 conn(0x7f6b2412c0d0 legacy=0x7f6b2405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:39.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.331+0000 7f6b227fc700 1 -- 172.21.15.103:0/3838887437 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 461604666 0 0) 0x7f6b241435a0 con 0x7f6b24065fe0 2020-04-22T14:10:39.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.331+0000 7f6b23fff700 1 -- 172.21.15.103:0/3838887437 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b2405bb50 con 0x7f6b241464e0 2020-04-22T14:10:39.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.331+0000 7f6b23fff700 1 --2- 172.21.15.103:0/3838887437 >> v2:172.21.15.103:3300/0 conn(0x7f6b241464e0 0x7f6b24064540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6b24067620 tx=0x7f6b1c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.331+0000 7f6b23fff700 1 --2- 172.21.15.103:0/3838887437 >> v2:172.21.15.103:3300/0 conn(0x7f6b241464e0 0x7f6b24064540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6b24067620 tx=0x7f6b1c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.331+0000 7f6b23fff700 1 --2- 172.21.15.103:0/3838887437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b241464e0 0x7f6b24064540 secure :-1 s=READY pgs=810 cs=0 l=1 rx=0x7f6b24067620 tx=0x7f6b1c0088e0).ready entity=mon.1 client_cookie=5bb92756c2a848d5 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:39.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.331+0000 7f6b23fff700 1 --2- 172.21.15.103:0/3838887437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b241464e0 0x7f6b24064540 secure :-1 s=THROTTLE_DONE pgs=810 cs=0 l=1 rx=0x7f6b24067620 tx=0x7f6b1c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.331+0000 7f6b227fc700 1 -- 172.21.15.103:0/3838887437 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b1c008e40 con 0x7f6b241464e0 2020-04-22T14:10:39.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.331+0000 7f6b23fff700 1 --2- 172.21.15.103:0/3838887437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b241464e0 0x7f6b24064540 secure :-1 s=THROTTLE_DONE pgs=810 cs=0 l=1 rx=0x7f6b24067620 tx=0x7f6b1c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.331+0000 7f6b227fc700 1 -- 172.21.15.103:0/3838887437 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1c011660 con 0x7f6b241464e0 2020-04-22T14:10:39.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.331+0000 7f6b23fff700 1 --2- 172.21.15.103:0/3838887437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b241464e0 0x7f6b24064540 secure :-1 s=THROTTLE_DONE pgs=810 cs=0 l=1 rx=0x7f6b24067620 tx=0x7f6b1c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.331+0000 7f6b227fc700 1 -- 172.21.15.103:0/3838887437 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b1c011a80 con 0x7f6b241464e0 2020-04-22T14:10:39.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.331+0000 7f6b29c81700 1 -- 172.21.15.103:0/3838887437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b241464e0 msgr2=0x7f6b24064540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:39.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.331+0000 7f6b29c81700 1 --2- 172.21.15.103:0/3838887437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b241464e0 0x7f6b24064540 secure :-1 s=READY pgs=810 cs=0 l=1 rx=0x7f6b24067620 tx=0x7f6b1c0088e0).stop 2020-04-22T14:10:39.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.332+0000 7f6b29c81700 1 -- 172.21.15.103:0/3838887437 shutdown_connections 2020-04-22T14:10:39.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.332+0000 7f6b29c81700 1 --2- 172.21.15.103:0/3838887437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b241464e0 0x7f6b24064540 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:39.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.332+0000 7f6b29c81700 1 -- 172.21.15.103:0/3838887437 >> 172.21.15.103:0/3838887437 conn(0x7f6b240b9160 msgr2=0x7f6b2405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:39.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.332+0000 7f6b29c81700 1 -- 172.21.15.103:0/3838887437 shutdown_connections 2020-04-22T14:10:39.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.332+0000 7f6b29c81700 1 -- 172.21.15.103:0/3838887437 wait complete. 2020-04-22T14:10:39.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.333+0000 7f6b29c81700 1 Processor -- start 2020-04-22T14:10:39.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.333+0000 7f6b29c81700 1 -- start start 2020-04-22T14:10:39.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.334+0000 7f6b29c81700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6b2412c0d0 0x7f6b24142660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:39.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.334+0000 7f6b29c81700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b24141e40 con 0x7f6b241464e0 2020-04-22T14:10:39.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.334+0000 7f6b29c81700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b24142280 con 0x7f6b24065fe0 2020-04-22T14:10:39.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.334+0000 7f6b29c81700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b2411e9d0 con 0x7f6b2412c0d0 2020-04-22T14:10:39.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.334+0000 7f6b237fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f6b24065fe0 0x7f6b24144040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43410/0 (socket says 172.21.15.103:43410) 2020-04-22T14:10:39.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.334+0000 7f6b237fe700 1 -- 172.21.15.103:0/319539340 learned_addr learned my addr 172.21.15.103:0/319539340 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:39.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.334+0000 7f6b22ffd700 1 --2- 172.21.15.103:0/319539340 >> v2:172.21.15.103:3300/0 conn(0x7f6b2412c0d0 0x7f6b24142660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:39.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.334+0000 7f6b20ff9700 1 -- 172.21.15.103:0/319539340 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3671107669 0 0) 0x7f6b24142280 con 0x7f6b24065fe0 2020-04-22T14:10:39.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.334+0000 7f6b20ff9700 1 -- 172.21.15.103:0/319539340 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b08002fe0 con 0x7f6b24065fe0 2020-04-22T14:10:39.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.334+0000 7f6b20ff9700 1 -- 172.21.15.103:0/319539340 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3620462153 0 0) 0x7f6b2405bb50 con 0x7f6b241464e0 2020-04-22T14:10:39.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.334+0000 7f6b22ffd700 1 -- 172.21.15.103:0/319539340 >> v1:172.21.15.103:6789/0 conn(0x7f6b24065fe0 legacy=0x7f6b24144040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:39.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.334+0000 7f6b22ffd700 1 -- 172.21.15.103:0/319539340 >> v1:172.21.15.86:6789/0 conn(0x7f6b241464e0 legacy=0x7f6b24144750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:39.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.334+0000 7f6b22ffd700 1 -- 172.21.15.103:0/319539340 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b2411ec70 con 0x7f6b2412c0d0 2020-04-22T14:10:39.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.334+0000 7f6b22ffd700 1 --2- 172.21.15.103:0/319539340 >> v2:172.21.15.103:3300/0 conn(0x7f6b2412c0d0 0x7f6b24142660 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6b0c000f00 tx=0x7f6b0c010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.334+0000 7f6b22ffd700 1 --2- 172.21.15.103:0/319539340 >> v2:172.21.15.103:3300/0 conn(0x7f6b2412c0d0 0x7f6b24142660 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6b0c000f00 tx=0x7f6b0c010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.334+0000 7f6b22ffd700 1 --2- 172.21.15.103:0/319539340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b2412c0d0 0x7f6b24142660 secure :-1 s=READY pgs=812 cs=0 l=1 rx=0x7f6b0c000f00 tx=0x7f6b0c010c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:39.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.334+0000 7f6b22ffd700 1 --2- 172.21.15.103:0/319539340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b2412c0d0 0x7f6b24142660 secure :-1 s=THROTTLE_DONE pgs=812 cs=0 l=1 rx=0x7f6b0c000f00 tx=0x7f6b0c010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.334+0000 7f6b20ff9700 1 -- 172.21.15.103:0/319539340 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b0c005e30 con 0x7f6b2412c0d0 2020-04-22T14:10:39.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.334+0000 7f6b22ffd700 1 --2- 172.21.15.103:0/319539340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b2412c0d0 0x7f6b24142660 secure :-1 s=THROTTLE_DONE pgs=812 cs=0 l=1 rx=0x7f6b0c000f00 tx=0x7f6b0c010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.334+0000 7f6b22ffd700 1 --2- 172.21.15.103:0/319539340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b2412c0d0 0x7f6b24142660 secure :-1 s=THROTTLE_DONE pgs=812 cs=0 l=1 rx=0x7f6b0c000f00 tx=0x7f6b0c010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.334+0000 7f6b20ff9700 1 -- 172.21.15.103:0/319539340 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b0c0124d0 con 0x7f6b2412c0d0 2020-04-22T14:10:39.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.334+0000 7f6b20ff9700 1 -- 172.21.15.103:0/319539340 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b0c0128b0 con 0x7f6b2412c0d0 2020-04-22T14:10:39.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.334+0000 7f6b29c81700 1 -- 172.21.15.103:0/319539340 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b240acc50 con 0x7f6b2412c0d0 2020-04-22T14:10:39.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.335+0000 7f6b29c81700 1 -- 172.21.15.103:0/319539340 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b24063f40 con 0x7f6b2412c0d0 2020-04-22T14:10:39.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.335+0000 7f6b22ffd700 1 --2- 172.21.15.103:0/319539340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b2412c0d0 0x7f6b24142660 secure :-1 s=THROTTLE_DONE pgs=812 cs=0 l=1 rx=0x7f6b0c000f00 tx=0x7f6b0c010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.336+0000 7f6b29c81700 1 -- 172.21.15.103:0/319539340 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b24056c90 con 0x7f6b2412c0d0 2020-04-22T14:10:39.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.336+0000 7f6b20ff9700 1 -- 172.21.15.103:0/319539340 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f6b0c012b20 con 0x7f6b2412c0d0 2020-04-22T14:10:39.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.336+0000 7f6b22ffd700 1 --2- 172.21.15.103:0/319539340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b2412c0d0 0x7f6b24142660 secure :-1 s=THROTTLE_DONE pgs=812 cs=0 l=1 rx=0x7f6b0c000f00 tx=0x7f6b0c010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.336+0000 7f6b20ff9700 1 --2- 172.21.15.103:0/319539340 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6b0804dc50 0x7f6b08050110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:39.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.336+0000 7f6b20ff9700 1 -- 172.21.15.103:0/319539340 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6b0c0090c0 con 0x7f6b2412c0d0 2020-04-22T14:10:39.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.336+0000 7f6b237fe700 1 --2- 172.21.15.103:0/319539340 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6b0804dc50 0x7f6b08050110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:39.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.336+0000 7f6b237fe700 1 --2- 172.21.15.103:0/319539340 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6b0804dc50 0x7f6b08050110 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6b24065a20 tx=0x7f6b14001760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.337+0000 7f6b237fe700 1 --2- 172.21.15.103:0/319539340 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6b0804dc50 0x7f6b08050110 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6b24065a20 tx=0x7f6b14001760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.337+0000 7f6b237fe700 1 --2- 172.21.15.103:0/319539340 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6b0804dc50 0x7f6b08050110 secure :-1 s=READY pgs=305 cs=0 l=1 rx=0x7f6b24065a20 tx=0x7f6b14001760).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:39.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.340+0000 7f6b22ffd700 1 --2- 172.21.15.103:0/319539340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b2412c0d0 0x7f6b24142660 secure :-1 s=THROTTLE_DONE pgs=812 cs=0 l=1 rx=0x7f6b0c000f00 tx=0x7f6b0c010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.340+0000 7f6b20ff9700 1 -- 172.21.15.103:0/319539340 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f6b0c03ce60 con 0x7f6b2412c0d0 2020-04-22T14:10:39.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.482+0000 7f6b29c81700 1 -- 172.21.15.103:0/319539340 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b24147360 con 0x7f6b2412c0d0 2020-04-22T14:10:39.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.483+0000 7f6b22ffd700 1 --2- 172.21.15.103:0/319539340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b2412c0d0 0x7f6b24142660 secure :-1 s=THROTTLE_DONE pgs=812 cs=0 l=1 rx=0x7f6b0c000f00 tx=0x7f6b0c010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.483+0000 7f6b20ff9700 1 -- 172.21.15.103:0/319539340 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+16105 (secure 0 0 0) 0x7f6b0c040480 con 0x7f6b2412c0d0 2020-04-22T14:10:39.487 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:10:39.487 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":63,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:10:38.817439+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:10:36.758101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2020-04-22T14:10:37.765010+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:10:39.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.485+0000 7f6b29c81700 1 -- 172.21.15.103:0/319539340 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6b0804dc50 msgr2=0x7f6b08050110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:39.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.485+0000 7f6b29c81700 1 --2- 172.21.15.103:0/319539340 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6b0804dc50 0x7f6b08050110 secure :-1 s=READY pgs=305 cs=0 l=1 rx=0x7f6b24065a20 tx=0x7f6b14001760).stop 2020-04-22T14:10:39.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.485+0000 7f6b29c81700 1 -- 172.21.15.103:0/319539340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b2412c0d0 msgr2=0x7f6b24142660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:39.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.485+0000 7f6b29c81700 1 --2- 172.21.15.103:0/319539340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b2412c0d0 0x7f6b24142660 secure :-1 s=READY pgs=812 cs=0 l=1 rx=0x7f6b0c000f00 tx=0x7f6b0c010c40).stop 2020-04-22T14:10:39.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.485+0000 7f6b29c81700 1 -- 172.21.15.103:0/319539340 shutdown_connections 2020-04-22T14:10:39.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.485+0000 7f6b29c81700 1 --2- 172.21.15.103:0/319539340 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6b0804dc50 0x7f6b08050110 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:39.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.485+0000 7f6b29c81700 1 --2- 172.21.15.103:0/319539340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b2412c0d0 0x7f6b24142660 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:39.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.485+0000 7f6b29c81700 1 -- 172.21.15.103:0/319539340 >> 172.21.15.103:0/319539340 conn(0x7f6b240b9160 msgr2=0x7f6b24061dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:39.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.485+0000 7f6b29c81700 1 -- 172.21.15.103:0/319539340 shutdown_connections 2020-04-22T14:10:39.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.485+0000 7f6b29c81700 1 -- 172.21.15.103:0/319539340 wait complete. 2020-04-22T14:10:39.499 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:39.512 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-04-22T14:10:39.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.657+0000 7fc7ea84d700 1 Processor -- start 2020-04-22T14:10:39.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.657+0000 7fc7ea84d700 1 -- start start 2020-04-22T14:10:39.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.658+0000 7fc7ea84d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7e40b97a0 0x7fc7e41469a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:39.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.658+0000 7fc7ea84d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e4149bb0 con 0x7fc7e40b92f0 2020-04-22T14:10:39.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.658+0000 7fc7ea84d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e4149e50 con 0x7fc7e41403c0 2020-04-22T14:10:39.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.658+0000 7fc7ea84d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e414a0f0 con 0x7fc7e40b97a0 2020-04-22T14:10:39.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.658+0000 7fc7e3fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc7e41403c0 0x7fc7e4066c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43418/0 (socket says 172.21.15.103:43418) 2020-04-22T14:10:39.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.658+0000 7fc7e3fff700 1 -- 172.21.15.103:0/1783202098 learned_addr learned my addr 172.21.15.103:0/1783202098 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:39.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.658+0000 7fc7e8dea700 1 --2- 172.21.15.103:0/1783202098 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7e40b97a0 0x7fc7e41469a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:39.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.659+0000 7fc7e2ffd700 1 -- 172.21.15.103:0/1783202098 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 966868128 0 0) 0x7fc7e4149e50 con 0x7fc7e41403c0 2020-04-22T14:10:39.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.659+0000 7fc7e2ffd700 1 -- 172.21.15.103:0/1783202098 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7d0003230 con 0x7fc7e41403c0 2020-04-22T14:10:39.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.659+0000 7fc7e2ffd700 1 -- 172.21.15.103:0/1783202098 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4272903698 0 0) 0x7fc7e4149bb0 con 0x7fc7e40b92f0 2020-04-22T14:10:39.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.659+0000 7fc7e2ffd700 1 -- 172.21.15.103:0/1783202098 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7e4149e50 con 0x7fc7e40b92f0 2020-04-22T14:10:39.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.659+0000 7fc7e8dea700 1 -- 172.21.15.103:0/1783202098 >> v1:172.21.15.103:6789/0 conn(0x7fc7e41403c0 legacy=0x7fc7e4066c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:39.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.659+0000 7fc7e8dea700 1 -- 172.21.15.103:0/1783202098 >> v1:172.21.15.86:6789/0 conn(0x7fc7e40b92f0 legacy=0x7fc7e4146290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:39.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.659+0000 7fc7e8dea700 1 -- 172.21.15.103:0/1783202098 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e41407a0 con 0x7fc7e40b97a0 2020-04-22T14:10:39.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.659+0000 7fc7e8dea700 1 --2- 172.21.15.103:0/1783202098 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7e40b97a0 0x7fc7e41469a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc7dc0032b0 tx=0x7fc7dc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.659+0000 7fc7e8dea700 1 --2- 172.21.15.103:0/1783202098 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7e40b97a0 0x7fc7e41469a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc7dc0032b0 tx=0x7fc7dc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.659+0000 7fc7e8dea700 1 --2- 172.21.15.103:0/1783202098 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7e40b97a0 0x7fc7e41469a0 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7fc7dc0032b0 tx=0x7fc7dc008c60).ready entity=mon.2 client_cookie=a435030517e12412 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:39.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.659+0000 7fc7e8dea700 1 --2- 172.21.15.103:0/1783202098 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7e40b97a0 0x7fc7e41469a0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fc7dc0032b0 tx=0x7fc7dc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.659+0000 7fc7e2ffd700 1 -- 172.21.15.103:0/1783202098 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7dc011db0 con 0x7fc7e40b97a0 2020-04-22T14:10:39.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.659+0000 7fc7e8dea700 1 --2- 172.21.15.103:0/1783202098 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7e40b97a0 0x7fc7e41469a0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fc7dc0032b0 tx=0x7fc7dc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.659+0000 7fc7e8dea700 1 --2- 172.21.15.103:0/1783202098 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7e40b97a0 0x7fc7e41469a0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fc7dc0032b0 tx=0x7fc7dc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.659+0000 7fc7e2ffd700 1 -- 172.21.15.103:0/1783202098 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7dc00a180 con 0x7fc7e40b97a0 2020-04-22T14:10:39.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.659+0000 7fc7e2ffd700 1 -- 172.21.15.103:0/1783202098 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7dc00a520 con 0x7fc7e40b97a0 2020-04-22T14:10:39.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.659+0000 7fc7ea84d700 1 -- 172.21.15.103:0/1783202098 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7e40b97a0 msgr2=0x7fc7e41469a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:39.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.659+0000 7fc7ea84d700 1 --2- 172.21.15.103:0/1783202098 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7e40b97a0 0x7fc7e41469a0 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7fc7dc0032b0 tx=0x7fc7dc008c60).stop 2020-04-22T14:10:39.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.660+0000 7fc7ea84d700 1 -- 172.21.15.103:0/1783202098 shutdown_connections 2020-04-22T14:10:39.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.660+0000 7fc7ea84d700 1 --2- 172.21.15.103:0/1783202098 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7e40b97a0 0x7fc7e41469a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:39.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.660+0000 7fc7ea84d700 1 -- 172.21.15.103:0/1783202098 >> 172.21.15.103:0/1783202098 conn(0x7fc7e405ad30 msgr2=0x7fc7e405b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:39.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.660+0000 7fc7ea84d700 1 -- 172.21.15.103:0/1783202098 shutdown_connections 2020-04-22T14:10:39.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.660+0000 7fc7ea84d700 1 -- 172.21.15.103:0/1783202098 wait complete. 2020-04-22T14:10:39.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.661+0000 7fc7ea84d700 1 Processor -- start 2020-04-22T14:10:39.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.661+0000 7fc7ea84d700 1 -- start start 2020-04-22T14:10:39.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.661+0000 7fc7ea84d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc7e40b92f0 0x7fc7e413d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:39.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.661+0000 7fc7ea84d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7e41403c0 0x7fc7e4140990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:39.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.661+0000 7fc7ea84d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e4154150 con 0x7fc7e40b97a0 2020-04-22T14:10:39.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.661+0000 7fc7ea84d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7e4154900 con 0x7fc7e40b92f0 2020-04-22T14:10:39.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.661+0000 7fc7ea84d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e41543c0 con 0x7fc7e41403c0 2020-04-22T14:10:39.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.662+0000 7fc7e3fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc7e40b92f0 0x7fc7e413d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:39.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.662+0000 7fc7e3fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc7e40b92f0 0x7fc7e413d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:48464/0 (socket says 172.21.15.103:48464) 2020-04-22T14:10:39.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.662+0000 7fc7e8dea700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7e41403c0 0x7fc7e4140990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:39.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.662+0000 7fc7e3fff700 1 -- 172.21.15.103:0/616195900 learned_addr learned my addr 172.21.15.103:0/616195900 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:10:39.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.662+0000 7fc7e37fe700 1 --1- 172.21.15.103:0/616195900 >> v1:172.21.15.86:6789/0 conn(0x7fc7e40b97a0 0x7fc7e4153a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:60580/0 (socket says 172.21.15.103:60580) 2020-04-22T14:10:39.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.662+0000 7fc7e3fff700 1 -- 172.21.15.103:0/616195900 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7e41403c0 msgr2=0x7fc7e4140990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:39.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.662+0000 7fc7e3fff700 1 --2- 172.21.15.103:0/616195900 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7e41403c0 0x7fc7e4140990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:39.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.662+0000 7fc7e3fff700 1 -- 172.21.15.103:0/616195900 >> v1:172.21.15.86:6789/0 conn(0x7fc7e40b97a0 legacy=0x7fc7e4153a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:39.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.662+0000 7fc7e17fa700 1 -- 172.21.15.103:0/616195900 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2044373238 0 0) 0x7fc7e4154150 con 0x7fc7e40b97a0 2020-04-22T14:10:39.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.662+0000 7fc7e3fff700 1 -- 172.21.15.103:0/616195900 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e4154660 con 0x7fc7e40b92f0 2020-04-22T14:10:39.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.662+0000 7fc7e8dea700 1 --2- 172.21.15.103:0/616195900 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7e41403c0 0x7fc7e4140990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:10:39.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.662+0000 7fc7e3fff700 1 --2- 172.21.15.103:0/616195900 >> v2:172.21.15.86:3300/0 conn(0x7fc7e40b92f0 0x7fc7e413d550 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc7d40010d0 tx=0x7fc7d4010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.662+0000 7fc7e3fff700 1 --2- 172.21.15.103:0/616195900 >> v2:172.21.15.86:3300/0 conn(0x7fc7e40b92f0 0x7fc7e413d550 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc7d40010d0 tx=0x7fc7d4010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.662+0000 7fc7e3fff700 1 --2- 172.21.15.103:0/616195900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7e40b92f0 0x7fc7e413d550 secure :-1 s=READY pgs=460 cs=0 l=1 rx=0x7fc7d40010d0 tx=0x7fc7d4010970).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:39.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.663+0000 7fc7e3fff700 1 --2- 172.21.15.103:0/616195900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7e40b92f0 0x7fc7e413d550 secure :-1 s=THROTTLE_DONE pgs=460 cs=0 l=1 rx=0x7fc7d40010d0 tx=0x7fc7d4010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.663+0000 7fc7e3fff700 1 --2- 172.21.15.103:0/616195900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7e40b92f0 0x7fc7e413d550 secure :-1 s=THROTTLE_DONE pgs=460 cs=0 l=1 rx=0x7fc7d40010d0 tx=0x7fc7d4010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.663+0000 7fc7e17fa700 1 -- 172.21.15.103:0/616195900 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7d4005cc0 con 0x7fc7e40b92f0 2020-04-22T14:10:39.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.663+0000 7fc7e3fff700 1 --2- 172.21.15.103:0/616195900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7e40b92f0 0x7fc7e413d550 secure :-1 s=THROTTLE_DONE pgs=460 cs=0 l=1 rx=0x7fc7d40010d0 tx=0x7fc7d4010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.663+0000 7fc7e17fa700 1 -- 172.21.15.103:0/616195900 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d4005e20 con 0x7fc7e40b92f0 2020-04-22T14:10:39.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.663+0000 7fc7e17fa700 1 -- 172.21.15.103:0/616195900 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7d40062c0 con 0x7fc7e40b92f0 2020-04-22T14:10:39.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.663+0000 7fc7ea84d700 1 -- 172.21.15.103:0/616195900 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e4140df0 con 0x7fc7e40b92f0 2020-04-22T14:10:39.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.663+0000 7fc7ea84d700 1 -- 172.21.15.103:0/616195900 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e40b4020 con 0x7fc7e40b92f0 2020-04-22T14:10:39.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.664+0000 7fc7e3fff700 1 --2- 172.21.15.103:0/616195900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7e40b92f0 0x7fc7e413d550 secure :-1 s=THROTTLE_DONE pgs=460 cs=0 l=1 rx=0x7fc7d40010d0 tx=0x7fc7d4010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.664+0000 7fc7ea84d700 1 -- 172.21.15.103:0/616195900 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7e4056c90 con 0x7fc7e40b92f0 2020-04-22T14:10:39.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.664+0000 7fc7e17fa700 1 -- 172.21.15.103:0/616195900 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fc7d4006530 con 0x7fc7e40b92f0 2020-04-22T14:10:39.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.664+0000 7fc7e3fff700 1 --2- 172.21.15.103:0/616195900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7e40b92f0 0x7fc7e413d550 secure :-1 s=THROTTLE_DONE pgs=460 cs=0 l=1 rx=0x7fc7d40010d0 tx=0x7fc7d4010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.664+0000 7fc7e17fa700 1 --2- 172.21.15.103:0/616195900 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc7c404d8d0 0x7fc7c404fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:39.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.664+0000 7fc7e17fa700 1 -- 172.21.15.103:0/616195900 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc7d40090c0 con 0x7fc7e40b92f0 2020-04-22T14:10:39.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.664+0000 7fc7e37fe700 1 --2- 172.21.15.103:0/616195900 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc7c404d8d0 0x7fc7c404fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:39.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.665+0000 7fc7e37fe700 1 --2- 172.21.15.103:0/616195900 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc7c404d8d0 0x7fc7c404fd90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc7d80023a0 tx=0x7fc7d8002850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.665+0000 7fc7e37fe700 1 --2- 172.21.15.103:0/616195900 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc7c404d8d0 0x7fc7c404fd90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc7d80023a0 tx=0x7fc7d8002850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.665+0000 7fc7e37fe700 1 --2- 172.21.15.103:0/616195900 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc7c404d8d0 0x7fc7c404fd90 secure :-1 s=READY pgs=306 cs=0 l=1 rx=0x7fc7d80023a0 tx=0x7fc7d8002850).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:39.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.668+0000 7fc7e3fff700 1 --2- 172.21.15.103:0/616195900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7e40b92f0 0x7fc7e413d550 secure :-1 s=THROTTLE_DONE pgs=460 cs=0 l=1 rx=0x7fc7d40010d0 tx=0x7fc7d4010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:39.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.668+0000 7fc7e17fa700 1 -- 172.21.15.103:0/616195900 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fc7d403c870 con 0x7fc7e40b92f0 2020-04-22T14:10:39.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:39.858+0000 7fc7ea84d700 1 -- 172.21.15.103:0/616195900 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc7e405d3d0 con 0x7fc7e40b92f0 2020-04-22T14:10:40.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:40.662+0000 7fc7e3fff700 1 --2- 172.21.15.103:0/616195900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7e40b92f0 0x7fc7e413d550 secure :-1 s=READY pgs=460 cs=0 l=1 rx=0x7fc7d40010d0 tx=0x7fc7d4010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:40.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:40.827+0000 7fc7e3fff700 1 --2- 172.21.15.103:0/616195900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7e40b92f0 0x7fc7e413d550 secure :-1 s=THROTTLE_DONE pgs=460 cs=0 l=1 rx=0x7fc7d40010d0 tx=0x7fc7d4010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:40.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:40.827+0000 7fc7e17fa700 1 -- 172.21.15.103:0/616195900 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v36) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc7d403fe90 con 0x7fc7e40b92f0 2020-04-22T14:10:40.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:40.829+0000 7fc7ea84d700 1 -- 172.21.15.103:0/616195900 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc7c404d8d0 msgr2=0x7fc7c404fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:40.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:40.829+0000 7fc7ea84d700 1 --2- 172.21.15.103:0/616195900 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc7c404d8d0 0x7fc7c404fd90 secure :-1 s=READY pgs=306 cs=0 l=1 rx=0x7fc7d80023a0 tx=0x7fc7d8002850).stop 2020-04-22T14:10:40.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:40.829+0000 7fc7ea84d700 1 -- 172.21.15.103:0/616195900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7e40b92f0 msgr2=0x7fc7e413d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:40.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:40.829+0000 7fc7ea84d700 1 --2- 172.21.15.103:0/616195900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7e40b92f0 0x7fc7e413d550 secure :-1 s=READY pgs=460 cs=0 l=1 rx=0x7fc7d40010d0 tx=0x7fc7d4010970).stop 2020-04-22T14:10:40.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:40.829+0000 7fc7ea84d700 1 -- 172.21.15.103:0/616195900 shutdown_connections 2020-04-22T14:10:40.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:40.829+0000 7fc7ea84d700 1 --2- 172.21.15.103:0/616195900 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7e41403c0 0x7fc7e4140990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:40.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:40.829+0000 7fc7ea84d700 1 --2- 172.21.15.103:0/616195900 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc7c404d8d0 0x7fc7c404fd90 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:40.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:40.829+0000 7fc7ea84d700 1 --2- 172.21.15.103:0/616195900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7e40b92f0 0x7fc7e413d550 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:40.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:40.829+0000 7fc7ea84d700 1 -- 172.21.15.103:0/616195900 >> 172.21.15.103:0/616195900 conn(0x7fc7e405ad30 msgr2=0x7fc7e405f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:40.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:40.829+0000 7fc7ea84d700 1 -- 172.21.15.103:0/616195900 shutdown_connections 2020-04-22T14:10:40.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:40.829+0000 7fc7ea84d700 1 -- 172.21.15.103:0/616195900 wait complete. 2020-04-22T14:10:40.845 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:40.863 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:10:41.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.015+0000 7f96b1d1f700 1 Processor -- start 2020-04-22T14:10:41.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.015+0000 7f96b1d1f700 1 -- start start 2020-04-22T14:10:41.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.016+0000 7f96b1d1f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96ac0620a0 0x7f96ac0ac740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:41.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.016+0000 7f96b1d1f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f96ac144ad0 0x7f96ac129a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:41.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.016+0000 7f96b1d1f700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96ac148270 con 0x7f96ac144650 2020-04-22T14:10:41.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.016+0000 7f96b1d1f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96ac143f10 con 0x7f96ac144ad0 2020-04-22T14:10:41.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.016+0000 7f96b1d1f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96ac1441b0 con 0x7f96ac0620a0 2020-04-22T14:10:41.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.016+0000 7f96b151e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f96ac144ad0 0x7f96ac129a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:41.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.016+0000 7f96b151e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f96ac144ad0 0x7f96ac129a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51240/0 (socket says 172.21.15.103:51240) 2020-04-22T14:10:41.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.016+0000 7f96abfff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f96ac144650 0x7f96ac066120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43430/0 (socket says 172.21.15.103:43430) 2020-04-22T14:10:41.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.016+0000 7f96b151e700 1 -- 172.21.15.103:0/200609634 learned_addr learned my addr 172.21.15.103:0/200609634 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:10:41.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.016+0000 7f96b0d1d700 1 --2- 172.21.15.103:0/200609634 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96ac0620a0 0x7f96ac0ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:41.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.016+0000 7f96b151e700 1 -- 172.21.15.103:0/200609634 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96ac0620a0 msgr2=0x7f96ac0ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:41.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.016+0000 7f96b151e700 1 --2- 172.21.15.103:0/200609634 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96ac0620a0 0x7f96ac0ac740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:41.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.016+0000 7f96b151e700 1 -- 172.21.15.103:0/200609634 >> v1:172.21.15.103:6789/0 conn(0x7f96ac144650 legacy=0x7f96ac066120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:41.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.016+0000 7f96b151e700 1 -- 172.21.15.103:0/200609634 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96ac062480 con 0x7f96ac144ad0 2020-04-22T14:10:41.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.016+0000 7f96ab7fe700 1 -- 172.21.15.103:0/200609634 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1691201907 0 0) 0x7f96ac148270 con 0x7f96ac144650 2020-04-22T14:10:41.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.016+0000 7f96b0d1d700 1 --2- 172.21.15.103:0/200609634 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96ac0620a0 0x7f96ac0ac740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:10:41.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.016+0000 7f96b151e700 1 --2- 172.21.15.103:0/200609634 >> v2:172.21.15.103:3300/0 conn(0x7f96ac144ad0 0x7f96ac129a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f969c002f30 tx=0x7f969c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.016+0000 7f96b151e700 1 --2- 172.21.15.103:0/200609634 >> v2:172.21.15.103:3300/0 conn(0x7f96ac144ad0 0x7f96ac129a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f969c002f30 tx=0x7f969c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.016+0000 7f96b151e700 1 --2- 172.21.15.103:0/200609634 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96ac144ad0 0x7f96ac129a20 secure :-1 s=READY pgs=815 cs=0 l=1 rx=0x7f969c002f30 tx=0x7f969c007a40).ready entity=mon.1 client_cookie=1a8a388266df7a19 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:41.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.016+0000 7f96b151e700 1 --2- 172.21.15.103:0/200609634 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96ac144ad0 0x7f96ac129a20 secure :-1 s=THROTTLE_DONE pgs=815 cs=0 l=1 rx=0x7f969c002f30 tx=0x7f969c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.016+0000 7f96ab7fe700 1 -- 172.21.15.103:0/200609634 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f969c011720 con 0x7f96ac144ad0 2020-04-22T14:10:41.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.016+0000 7f96b151e700 1 --2- 172.21.15.103:0/200609634 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96ac144ad0 0x7f96ac129a20 secure :-1 s=THROTTLE_DONE pgs=815 cs=0 l=1 rx=0x7f969c002f30 tx=0x7f969c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.016+0000 7f96b151e700 1 --2- 172.21.15.103:0/200609634 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96ac144ad0 0x7f96ac129a20 secure :-1 s=THROTTLE_DONE pgs=815 cs=0 l=1 rx=0x7f969c002f30 tx=0x7f969c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.016+0000 7f96ab7fe700 1 -- 172.21.15.103:0/200609634 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969c0118c0 con 0x7f96ac144ad0 2020-04-22T14:10:41.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.016+0000 7f96ab7fe700 1 -- 172.21.15.103:0/200609634 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f969c011ca0 con 0x7f96ac144ad0 2020-04-22T14:10:41.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.016+0000 7f96b1d1f700 1 -- 172.21.15.103:0/200609634 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96ac144ad0 msgr2=0x7f96ac129a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:41.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.016+0000 7f96b1d1f700 1 --2- 172.21.15.103:0/200609634 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96ac144ad0 0x7f96ac129a20 secure :-1 s=READY pgs=815 cs=0 l=1 rx=0x7f969c002f30 tx=0x7f969c007a40).stop 2020-04-22T14:10:41.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.017+0000 7f96b1d1f700 1 -- 172.21.15.103:0/200609634 shutdown_connections 2020-04-22T14:10:41.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.017+0000 7f96b1d1f700 1 --2- 172.21.15.103:0/200609634 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96ac144ad0 0x7f96ac129a20 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:41.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.017+0000 7f96b1d1f700 1 --2- 172.21.15.103:0/200609634 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96ac0620a0 0x7f96ac0ac740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:41.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.017+0000 7f96b1d1f700 1 -- 172.21.15.103:0/200609634 >> 172.21.15.103:0/200609634 conn(0x7f96ac05b7c0 msgr2=0x7f96ac061610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:41.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.017+0000 7f96b1d1f700 1 -- 172.21.15.103:0/200609634 shutdown_connections 2020-04-22T14:10:41.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.017+0000 7f96b1d1f700 1 -- 172.21.15.103:0/200609634 wait complete. 2020-04-22T14:10:41.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.018+0000 7f96b1d1f700 1 Processor -- start 2020-04-22T14:10:41.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.018+0000 7f96b1d1f700 1 -- start start 2020-04-22T14:10:41.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.019+0000 7f96b1d1f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96ac0620a0 0x7f96ac155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:41.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.019+0000 7f96b1d1f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f96ac144650 0x7f96ac0b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:41.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.019+0000 7f96b1d1f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f96ac144ad0 0x7f96ac0b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:41.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.019+0000 7f96b1d1f700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96ac0b4ad0 con 0x7f96ac144650 2020-04-22T14:10:41.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.019+0000 7f96b1d1f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96ac0b4350 con 0x7f96ac144ad0 2020-04-22T14:10:41.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.019+0000 7f96b1d1f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96ac0b6680 con 0x7f96ac0620a0 2020-04-22T14:10:41.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.019+0000 7f96b151e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f96ac144ad0 0x7f96ac0b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:41.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.019+0000 7f96b151e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f96ac144ad0 0x7f96ac0b6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51248/0 (socket says 172.21.15.103:51248) 2020-04-22T14:10:41.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.019+0000 7f96b151e700 1 -- 172.21.15.103:0/3340460610 learned_addr learned my addr 172.21.15.103:0/3340460610 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:10:41.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.019+0000 7f96b0d1d700 1 --2- 172.21.15.103:0/3340460610 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96ac0620a0 0x7f96ac155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:41.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.019+0000 7f96abfff700 1 --2- 172.21.15.103:0/3340460610 >> v2:172.21.15.86:3300/0 conn(0x7f96ac144650 0x7f96ac0b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:41.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.019+0000 7f96b151e700 1 -- 172.21.15.103:0/3340460610 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96ac0620a0 msgr2=0x7f96ac155ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:41.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.019+0000 7f96b151e700 1 --2- 172.21.15.103:0/3340460610 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96ac0620a0 0x7f96ac155ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:41.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.019+0000 7f96b151e700 1 -- 172.21.15.103:0/3340460610 >> v2:172.21.15.86:3300/0 conn(0x7f96ac144650 msgr2=0x7f96ac0b3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:41.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.019+0000 7f96b151e700 1 --2- 172.21.15.103:0/3340460610 >> v2:172.21.15.86:3300/0 conn(0x7f96ac144650 0x7f96ac0b3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:41.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.019+0000 7f96b151e700 1 -- 172.21.15.103:0/3340460610 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96ac0b4590 con 0x7f96ac144ad0 2020-04-22T14:10:41.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.019+0000 7f96b151e700 1 --2- 172.21.15.103:0/3340460610 >> v2:172.21.15.103:3300/0 conn(0x7f96ac144ad0 0x7f96ac0b6220 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f969c002f30 tx=0x7f969c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.019+0000 7f96b151e700 1 --2- 172.21.15.103:0/3340460610 >> v2:172.21.15.103:3300/0 conn(0x7f96ac144ad0 0x7f96ac0b6220 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f969c002f30 tx=0x7f969c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.019+0000 7f96b151e700 1 --2- 172.21.15.103:0/3340460610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96ac144ad0 0x7f96ac0b6220 secure :-1 s=READY pgs=816 cs=0 l=1 rx=0x7f969c002f30 tx=0x7f969c007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:41.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.019+0000 7f96b151e700 1 --2- 172.21.15.103:0/3340460610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96ac144ad0 0x7f96ac0b6220 secure :-1 s=THROTTLE_DONE pgs=816 cs=0 l=1 rx=0x7f969c002f30 tx=0x7f969c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.019+0000 7f96b151e700 1 --2- 172.21.15.103:0/3340460610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96ac144ad0 0x7f96ac0b6220 secure :-1 s=THROTTLE_DONE pgs=816 cs=0 l=1 rx=0x7f969c002f30 tx=0x7f969c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.019+0000 7f96a9ffb700 1 -- 172.21.15.103:0/3340460610 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f969c0056c0 con 0x7f96ac144ad0 2020-04-22T14:10:41.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.019+0000 7f96b151e700 1 --2- 172.21.15.103:0/3340460610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96ac144ad0 0x7f96ac0b6220 secure :-1 s=THROTTLE_DONE pgs=816 cs=0 l=1 rx=0x7f969c002f30 tx=0x7f969c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.019+0000 7f96a9ffb700 1 -- 172.21.15.103:0/3340460610 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969c005820 con 0x7f96ac144ad0 2020-04-22T14:10:41.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.019+0000 7f96a9ffb700 1 -- 172.21.15.103:0/3340460610 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f969c005c00 con 0x7f96ac144ad0 2020-04-22T14:10:41.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.019+0000 7f96b1d1f700 1 -- 172.21.15.103:0/3340460610 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96ac0b4830 con 0x7f96ac144ad0 2020-04-22T14:10:41.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.020+0000 7f96b1d1f700 1 -- 172.21.15.103:0/3340460610 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96ac125c80 con 0x7f96ac144ad0 2020-04-22T14:10:41.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.020+0000 7f96b151e700 1 --2- 172.21.15.103:0/3340460610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96ac144ad0 0x7f96ac0b6220 secure :-1 s=THROTTLE_DONE pgs=816 cs=0 l=1 rx=0x7f969c002f30 tx=0x7f969c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.020+0000 7f96b1d1f700 1 -- 172.21.15.103:0/3340460610 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96ac056c90 con 0x7f96ac144ad0 2020-04-22T14:10:41.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.020+0000 7f96a9ffb700 1 -- 172.21.15.103:0/3340460610 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f969c005d60 con 0x7f96ac144ad0 2020-04-22T14:10:41.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.020+0000 7f96b151e700 1 --2- 172.21.15.103:0/3340460610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96ac144ad0 0x7f96ac0b6220 secure :-1 s=THROTTLE_DONE pgs=816 cs=0 l=1 rx=0x7f969c002f30 tx=0x7f969c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.021+0000 7f96a9ffb700 1 --2- 172.21.15.103:0/3340460610 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f968c04da30 0x7f968c04fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:41.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.021+0000 7f96a9ffb700 1 -- 172.21.15.103:0/3340460610 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f969c061c60 con 0x7f96ac144ad0 2020-04-22T14:10:41.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.021+0000 7f96b0d1d700 1 --2- 172.21.15.103:0/3340460610 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f968c04da30 0x7f968c04fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:41.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.021+0000 7f96b0d1d700 1 --2- 172.21.15.103:0/3340460610 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f968c04da30 0x7f968c04fef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f96a40032b0 tx=0x7f96a400e510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.021+0000 7f96b0d1d700 1 --2- 172.21.15.103:0/3340460610 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f968c04da30 0x7f968c04fef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f96a40032b0 tx=0x7f96a400e510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.021+0000 7f96b0d1d700 1 --2- 172.21.15.103:0/3340460610 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f968c04da30 0x7f968c04fef0 secure :-1 s=READY pgs=307 cs=0 l=1 rx=0x7f96a40032b0 tx=0x7f96a400e510).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:41.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.025+0000 7f96b151e700 1 --2- 172.21.15.103:0/3340460610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96ac144ad0 0x7f96ac0b6220 secure :-1 s=THROTTLE_DONE pgs=816 cs=0 l=1 rx=0x7f969c002f30 tx=0x7f969c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.025+0000 7f96a9ffb700 1 -- 172.21.15.103:0/3340460610 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f969c03d160 con 0x7f96ac144ad0 2020-04-22T14:10:41.217 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.214+0000 7f96b1d1f700 1 -- 172.21.15.103:0/3340460610 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96ac0ac980 con 0x7f96ac144ad0 2020-04-22T14:10:41.218 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.215+0000 7f96b151e700 1 --2- 172.21.15.103:0/3340460610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96ac144ad0 0x7f96ac0b6220 secure :-1 s=THROTTLE_DONE pgs=816 cs=0 l=1 rx=0x7f969c002f30 tx=0x7f969c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.218 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.215+0000 7f96a9ffb700 1 -- 172.21.15.103:0/3340460610 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+2143 (secure 0 0 0) 0x7f969c040780 con 0x7f96ac144ad0 2020-04-22T14:10:41.219 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:10:41.219 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5096,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1960145218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1960145218},{"type":"v1","addr":"172.21.15.86:6835","nonce":1960145218}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:10:40.825749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6289},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6289":{"gid":6289,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/2152235919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2152235919},{"type":"v1","addr":"172.21.15.103:6833","nonce":2152235919}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:10:41.220 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.216+0000 7f96b1d1f700 1 -- 172.21.15.103:0/3340460610 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f968c04da30 msgr2=0x7f968c04fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:41.220 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.216+0000 7f96b1d1f700 1 --2- 172.21.15.103:0/3340460610 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f968c04da30 0x7f968c04fef0 secure :-1 s=READY pgs=307 cs=0 l=1 rx=0x7f96a40032b0 tx=0x7f96a400e510).stop 2020-04-22T14:10:41.220 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.216+0000 7f96b1d1f700 1 -- 172.21.15.103:0/3340460610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96ac144ad0 msgr2=0x7f96ac0b6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:41.220 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.216+0000 7f96b1d1f700 1 --2- 172.21.15.103:0/3340460610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96ac144ad0 0x7f96ac0b6220 secure :-1 s=READY pgs=816 cs=0 l=1 rx=0x7f969c002f30 tx=0x7f969c007a40).stop 2020-04-22T14:10:41.221 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.216+0000 7f96b1d1f700 1 -- 172.21.15.103:0/3340460610 shutdown_connections 2020-04-22T14:10:41.221 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.216+0000 7f96b1d1f700 1 --2- 172.21.15.103:0/3340460610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96ac144ad0 0x7f96ac0b6220 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:41.221 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.216+0000 7f96b1d1f700 1 --2- 172.21.15.103:0/3340460610 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96ac0620a0 0x7f96ac155ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:41.221 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.216+0000 7f96b1d1f700 1 --2- 172.21.15.103:0/3340460610 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f968c04da30 0x7f968c04fef0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:41.221 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.216+0000 7f96b1d1f700 1 --2- 172.21.15.103:0/3340460610 >> v2:172.21.15.86:3300/0 conn(0x7f96ac144650 0x7f96ac0b3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:41.221 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.216+0000 7f96b1d1f700 1 -- 172.21.15.103:0/3340460610 >> 172.21.15.103:0/3340460610 conn(0x7f96ac05b7c0 msgr2=0x7f96ac063170 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:41.221 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.216+0000 7f96b1d1f700 1 -- 172.21.15.103:0/3340460610 shutdown_connections 2020-04-22T14:10:41.222 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.216+0000 7f96b1d1f700 1 -- 172.21.15.103:0/3340460610 wait complete. 2020-04-22T14:10:41.222 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 36 2020-04-22T14:10:41.230 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:41.243 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:10:41.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.396+0000 7f1ad92c2700 1 Processor -- start 2020-04-22T14:10:41.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.396+0000 7f1ad92c2700 1 -- start start 2020-04-22T14:10:41.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.396+0000 7f1ad92c2700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1ad412c0d0 0x7f1ad41464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:41.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.396+0000 7f1ad92c2700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ad4065fe0 0x7f1ad405b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:41.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.396+0000 7f1ad92c2700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad4143300 con 0x7f1ad405b8a0 2020-04-22T14:10:41.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.396+0000 7f1ad92c2700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad412c4b0 con 0x7f1ad412c0d0 2020-04-22T14:10:41.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.396+0000 7f1ad92c2700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad41435a0 con 0x7f1ad4065fe0 2020-04-22T14:10:41.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.397+0000 7f1aca7fc700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ad4065fe0 0x7f1ad405b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:41.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.397+0000 7f1ad2ffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1ad412c0d0 0x7f1ad41464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:41.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.397+0000 7f1aca7fc700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ad4065fe0 0x7f1ad405b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:36032/0 (socket says 172.21.15.103:36032) 2020-04-22T14:10:41.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.397+0000 7f1aca7fc700 1 -- 172.21.15.103:0/1465735501 learned_addr learned my addr 172.21.15.103:0/1465735501 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:10:41.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.397+0000 7f1ad2ffd700 1 -- 172.21.15.103:0/1465735501 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ad4065fe0 msgr2=0x7f1ad405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:41.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.397+0000 7f1ad2ffd700 1 --2- 172.21.15.103:0/1465735501 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ad4065fe0 0x7f1ad405b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:41.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.397+0000 7f1ad2ffd700 1 -- 172.21.15.103:0/1465735501 >> v1:172.21.15.86:6789/0 conn(0x7f1ad405b8a0 legacy=0x7f1ad4062ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:41.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.397+0000 7f1ad2ffd700 1 -- 172.21.15.103:0/1465735501 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad4143840 con 0x7f1ad412c0d0 2020-04-22T14:10:41.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.397+0000 7f1aca7fc700 1 --2- 172.21.15.103:0/1465735501 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ad4065fe0 0x7f1ad405b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:10:41.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.397+0000 7f1ad2ffd700 1 --2- 172.21.15.103:0/1465735501 >> v2:172.21.15.86:3300/0 conn(0x7f1ad412c0d0 0x7f1ad41464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1ac4002f30 tx=0x7f1ac4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.397+0000 7f1ad2ffd700 1 --2- 172.21.15.103:0/1465735501 >> v2:172.21.15.86:3300/0 conn(0x7f1ad412c0d0 0x7f1ad41464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1ac4002f30 tx=0x7f1ac4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.397+0000 7f1ad2ffd700 1 --2- 172.21.15.103:0/1465735501 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ad412c0d0 0x7f1ad41464e0 secure :-1 s=READY pgs=462 cs=0 l=1 rx=0x7f1ac4002f30 tx=0x7f1ac4007a40).ready entity=mon.0 client_cookie=6a7bdde5aa5c4a4f server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:41.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.397+0000 7f1ad2ffd700 1 --2- 172.21.15.103:0/1465735501 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ad412c0d0 0x7f1ad41464e0 secure :-1 s=THROTTLE_DONE pgs=462 cs=0 l=1 rx=0x7f1ac4002f30 tx=0x7f1ac4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.397+0000 7f1ad27fc700 1 -- 172.21.15.103:0/1465735501 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ac40113c0 con 0x7f1ad412c0d0 2020-04-22T14:10:41.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.397+0000 7f1ad2ffd700 1 --2- 172.21.15.103:0/1465735501 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ad412c0d0 0x7f1ad41464e0 secure :-1 s=THROTTLE_DONE pgs=462 cs=0 l=1 rx=0x7f1ac4002f30 tx=0x7f1ac4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.397+0000 7f1ad2ffd700 1 --2- 172.21.15.103:0/1465735501 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ad412c0d0 0x7f1ad41464e0 secure :-1 s=THROTTLE_DONE pgs=462 cs=0 l=1 rx=0x7f1ac4002f30 tx=0x7f1ac4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.397+0000 7f1ad27fc700 1 -- 172.21.15.103:0/1465735501 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac4011560 con 0x7f1ad412c0d0 2020-04-22T14:10:41.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.397+0000 7f1ad92c2700 1 -- 172.21.15.103:0/1465735501 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ad412c0d0 msgr2=0x7f1ad41464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:41.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.397+0000 7f1ad27fc700 1 -- 172.21.15.103:0/1465735501 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ac4011980 con 0x7f1ad412c0d0 2020-04-22T14:10:41.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.397+0000 7f1ad92c2700 1 --2- 172.21.15.103:0/1465735501 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ad412c0d0 0x7f1ad41464e0 secure :-1 s=READY pgs=462 cs=0 l=1 rx=0x7f1ac4002f30 tx=0x7f1ac4007a40).stop 2020-04-22T14:10:41.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.398+0000 7f1ad92c2700 1 -- 172.21.15.103:0/1465735501 shutdown_connections 2020-04-22T14:10:41.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.398+0000 7f1ad92c2700 1 --2- 172.21.15.103:0/1465735501 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ad412c0d0 0x7f1ad41464e0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:41.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.398+0000 7f1ad92c2700 1 --2- 172.21.15.103:0/1465735501 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ad4065fe0 0x7f1ad405b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:41.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.398+0000 7f1ad92c2700 1 -- 172.21.15.103:0/1465735501 >> 172.21.15.103:0/1465735501 conn(0x7f1ad40b9160 msgr2=0x7f1ad405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:41.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.398+0000 7f1ad92c2700 1 -- 172.21.15.103:0/1465735501 shutdown_connections 2020-04-22T14:10:41.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.398+0000 7f1ad92c2700 1 -- 172.21.15.103:0/1465735501 wait complete. 2020-04-22T14:10:41.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.399+0000 7f1ad92c2700 1 Processor -- start 2020-04-22T14:10:41.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.399+0000 7f1ad92c2700 1 -- start start 2020-04-22T14:10:41.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.400+0000 7f1ad92c2700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1ad405b8a0 0x7f1ad40b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:41.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.400+0000 7f1ad92c2700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ad4065fe0 0x7f1ad40b3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:41.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.400+0000 7f1ad92c2700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad40b5920 con 0x7f1ad412c0d0 2020-04-22T14:10:41.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.400+0000 7f1ad92c2700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad40b4390 con 0x7f1ad405b8a0 2020-04-22T14:10:41.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.400+0000 7f1ad92c2700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad40b4630 con 0x7f1ad4065fe0 2020-04-22T14:10:41.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.400+0000 7f1ad2ffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1ad405b8a0 0x7f1ad40b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:41.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.400+0000 7f1ad2ffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1ad405b8a0 0x7f1ad40b54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:48490/0 (socket says 172.21.15.103:48490) 2020-04-22T14:10:41.412 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.400+0000 7f1ad2ffd700 1 -- 172.21.15.103:0/4192256417 learned_addr learned my addr 172.21.15.103:0/4192256417 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:10:41.412 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.400+0000 7f1ad37fe700 1 --1- 172.21.15.103:0/4192256417 >> v1:172.21.15.86:6789/0 conn(0x7f1ad412c0d0 0x7f1ad4126fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:60606/0 (socket says 172.21.15.103:60606) 2020-04-22T14:10:41.412 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.400+0000 7f1aca7fc700 1 --2- 172.21.15.103:0/4192256417 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ad4065fe0 0x7f1ad40b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:41.412 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.400+0000 7f1ad2ffd700 1 -- 172.21.15.103:0/4192256417 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ad4065fe0 msgr2=0x7f1ad40b3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:41.412 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.400+0000 7f1ad2ffd700 1 --2- 172.21.15.103:0/4192256417 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ad4065fe0 0x7f1ad40b3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:41.412 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.400+0000 7f1ad2ffd700 1 -- 172.21.15.103:0/4192256417 >> v1:172.21.15.86:6789/0 conn(0x7f1ad412c0d0 legacy=0x7f1ad4126fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:41.413 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.400+0000 7f1ad0ff9700 1 -- 172.21.15.103:0/4192256417 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 139933568 0 0) 0x7f1ad4143300 con 0x7f1ad412c0d0 2020-04-22T14:10:41.413 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.400+0000 7f1ad2ffd700 1 -- 172.21.15.103:0/4192256417 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad40b48d0 con 0x7f1ad405b8a0 2020-04-22T14:10:41.413 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.400+0000 7f1aca7fc700 1 --2- 172.21.15.103:0/4192256417 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ad4065fe0 0x7f1ad40b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:10:41.413 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.400+0000 7f1ad2ffd700 1 --2- 172.21.15.103:0/4192256417 >> v2:172.21.15.86:3300/0 conn(0x7f1ad405b8a0 0x7f1ad40b54c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1ac4002f30 tx=0x7f1ac4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.413 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.400+0000 7f1ad2ffd700 1 --2- 172.21.15.103:0/4192256417 >> v2:172.21.15.86:3300/0 conn(0x7f1ad405b8a0 0x7f1ad40b54c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1ac4002f30 tx=0x7f1ac4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.413 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.400+0000 7f1ad2ffd700 1 --2- 172.21.15.103:0/4192256417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ad405b8a0 0x7f1ad40b54c0 secure :-1 s=READY pgs=464 cs=0 l=1 rx=0x7f1ac4002f30 tx=0x7f1ac4007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:41.413 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.401+0000 7f1ad2ffd700 1 --2- 172.21.15.103:0/4192256417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ad405b8a0 0x7f1ad40b54c0 secure :-1 s=THROTTLE_DONE pgs=464 cs=0 l=1 rx=0x7f1ac4002f30 tx=0x7f1ac4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.401+0000 7f1ad0ff9700 1 -- 172.21.15.103:0/4192256417 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ac40119a0 con 0x7f1ad405b8a0 2020-04-22T14:10:41.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.401+0000 7f1ad2ffd700 1 --2- 172.21.15.103:0/4192256417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ad405b8a0 0x7f1ad40b54c0 secure :-1 s=THROTTLE_DONE pgs=464 cs=0 l=1 rx=0x7f1ac4002f30 tx=0x7f1ac4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.401+0000 7f1ad0ff9700 1 -- 172.21.15.103:0/4192256417 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac4007170 con 0x7f1ad405b8a0 2020-04-22T14:10:41.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.401+0000 7f1ad2ffd700 1 --2- 172.21.15.103:0/4192256417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ad405b8a0 0x7f1ad40b54c0 secure :-1 s=THROTTLE_DONE pgs=464 cs=0 l=1 rx=0x7f1ac4002f30 tx=0x7f1ac4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.401+0000 7f1ad92c2700 1 -- 172.21.15.103:0/4192256417 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad41276e0 con 0x7f1ad405b8a0 2020-04-22T14:10:41.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.401+0000 7f1ad0ff9700 1 -- 172.21.15.103:0/4192256417 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ac4007510 con 0x7f1ad405b8a0 2020-04-22T14:10:41.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.401+0000 7f1ad92c2700 1 -- 172.21.15.103:0/4192256417 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad40b3f30 con 0x7f1ad405b8a0 2020-04-22T14:10:41.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.401+0000 7f1ad2ffd700 1 --2- 172.21.15.103:0/4192256417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ad405b8a0 0x7f1ad40b54c0 secure :-1 s=THROTTLE_DONE pgs=464 cs=0 l=1 rx=0x7f1ac4002f30 tx=0x7f1ac4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.402+0000 7f1ad92c2700 1 -- 172.21.15.103:0/4192256417 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad4056c90 con 0x7f1ad405b8a0 2020-04-22T14:10:41.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.402+0000 7f1ad0ff9700 1 -- 172.21.15.103:0/4192256417 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f1ac40056c0 con 0x7f1ad405b8a0 2020-04-22T14:10:41.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.402+0000 7f1ad2ffd700 1 --2- 172.21.15.103:0/4192256417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ad405b8a0 0x7f1ad40b54c0 secure :-1 s=THROTTLE_DONE pgs=464 cs=0 l=1 rx=0x7f1ac4002f30 tx=0x7f1ac4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.402+0000 7f1ad0ff9700 1 --2- 172.21.15.103:0/4192256417 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1ab804d8d0 0x7f1ab804fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:41.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.402+0000 7f1ad0ff9700 1 -- 172.21.15.103:0/4192256417 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1ac4061ba0 con 0x7f1ad405b8a0 2020-04-22T14:10:41.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.402+0000 7f1aca7fc700 1 --2- 172.21.15.103:0/4192256417 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1ab804d8d0 0x7f1ab804fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:41.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.402+0000 7f1aca7fc700 1 --2- 172.21.15.103:0/4192256417 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1ab804d8d0 0x7f1ab804fd90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1abc002f30 tx=0x7f1abc00b7f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.403+0000 7f1aca7fc700 1 --2- 172.21.15.103:0/4192256417 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1ab804d8d0 0x7f1ab804fd90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1abc002f30 tx=0x7f1abc00b7f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.403+0000 7f1aca7fc700 1 --2- 172.21.15.103:0/4192256417 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1ab804d8d0 0x7f1ab804fd90 secure :-1 s=READY pgs=308 cs=0 l=1 rx=0x7f1abc002f30 tx=0x7f1abc00b7f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:41.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.406+0000 7f1ad2ffd700 1 --2- 172.21.15.103:0/4192256417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ad405b8a0 0x7f1ad40b54c0 secure :-1 s=THROTTLE_DONE pgs=464 cs=0 l=1 rx=0x7f1ac4002f30 tx=0x7f1ac4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.406+0000 7f1ad0ff9700 1 -- 172.21.15.103:0/4192256417 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f1ac403d0a0 con 0x7f1ad405b8a0 2020-04-22T14:10:41.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.550+0000 7f1ad92c2700 1 -- 172.21.15.103:0/4192256417 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ad4147360 con 0x7f1ad405b8a0 2020-04-22T14:10:41.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.552+0000 7f1ad2ffd700 1 --2- 172.21.15.103:0/4192256417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ad405b8a0 0x7f1ad40b54c0 secure :-1 s=THROTTLE_DONE pgs=464 cs=0 l=1 rx=0x7f1ac4002f30 tx=0x7f1ac4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.552+0000 7f1ad0ff9700 1 -- 172.21.15.103:0/4192256417 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16092 (secure 0 0 0) 0x7f1ac40406c0 con 0x7f1ad405b8a0 2020-04-22T14:10:41.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.552+0000 7f1ad92c2700 1 -- 172.21.15.103:0/4192256417 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1ab804d8d0 msgr2=0x7f1ab804fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:41.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.552+0000 7f1ad92c2700 1 --2- 172.21.15.103:0/4192256417 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1ab804d8d0 0x7f1ab804fd90 secure :-1 s=READY pgs=308 cs=0 l=1 rx=0x7f1abc002f30 tx=0x7f1abc00b7f0).stop 2020-04-22T14:10:41.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.552+0000 7f1ad92c2700 1 -- 172.21.15.103:0/4192256417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ad405b8a0 msgr2=0x7f1ad40b54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:41.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.552+0000 7f1ad92c2700 1 --2- 172.21.15.103:0/4192256417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ad405b8a0 0x7f1ad40b54c0 secure :-1 s=READY pgs=464 cs=0 l=1 rx=0x7f1ac4002f30 tx=0x7f1ac4007a40).stop 2020-04-22T14:10:41.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.552+0000 7f1ad92c2700 1 -- 172.21.15.103:0/4192256417 shutdown_connections 2020-04-22T14:10:41.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.552+0000 7f1ad92c2700 1 --2- 172.21.15.103:0/4192256417 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1ab804d8d0 0x7f1ab804fd90 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:41.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.552+0000 7f1ad92c2700 1 --2- 172.21.15.103:0/4192256417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ad405b8a0 0x7f1ad40b54c0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:41.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.552+0000 7f1ad92c2700 1 --2- 172.21.15.103:0/4192256417 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ad4065fe0 0x7f1ad40b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:41.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.552+0000 7f1ad92c2700 1 -- 172.21.15.103:0/4192256417 >> 172.21.15.103:0/4192256417 conn(0x7f1ad40b9160 msgr2=0x7f1ad40643f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:41.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.552+0000 7f1ad92c2700 1 -- 172.21.15.103:0/4192256417 shutdown_connections 2020-04-22T14:10:41.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.552+0000 7f1ad92c2700 1 -- 172.21.15.103:0/4192256417 wait complete. 2020-04-22T14:10:41.569 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:10:41.569 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":64,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:10:39.819711+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:10:36.758101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2020-04-22T14:10:37.765010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:10:41.571 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:41.584 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:10:41.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.737+0000 7f83903dc700 1 Processor -- start 2020-04-22T14:10:41.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.737+0000 7f83903dc700 1 -- start start 2020-04-22T14:10:41.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.738+0000 7f83903dc700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8388152a90 0x7f83880b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:41.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.738+0000 7f83903dc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8388062170 0x7f83880b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:41.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.738+0000 7f83903dc700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8388152e70 con 0x7f83880b5210 2020-04-22T14:10:41.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.738+0000 7f83903dc700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83880614f0 con 0x7f8388062170 2020-04-22T14:10:41.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.738+0000 7f83903dc700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8388061790 con 0x7f8388152a90 2020-04-22T14:10:41.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.738+0000 7f838e178700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8388062170 0x7f83880b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:41.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.738+0000 7f838e178700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8388062170 0x7f83880b4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51266/0 (socket says 172.21.15.103:51266) 2020-04-22T14:10:41.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.738+0000 7f838e178700 1 -- 172.21.15.103:0/2695312097 learned_addr learned my addr 172.21.15.103:0/2695312097 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:10:41.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.738+0000 7f838e979700 1 --2- 172.21.15.103:0/2695312097 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8388152a90 0x7f83880b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:41.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.738+0000 7f838e178700 1 -- 172.21.15.103:0/2695312097 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8388152a90 msgr2=0x7f83880b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:41.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.738+0000 7f838e178700 1 --2- 172.21.15.103:0/2695312097 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8388152a90 0x7f83880b44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:41.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.738+0000 7f838e178700 1 -- 172.21.15.103:0/2695312097 >> v1:172.21.15.86:6789/0 conn(0x7f83880b5210 legacy=0x7f8388156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:41.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.738+0000 7f838e178700 1 -- 172.21.15.103:0/2695312097 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83880b56a0 con 0x7f8388062170 2020-04-22T14:10:41.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.738+0000 7f838e979700 1 --2- 172.21.15.103:0/2695312097 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8388152a90 0x7f83880b44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:10:41.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.738+0000 7f838e178700 1 --2- 172.21.15.103:0/2695312097 >> v2:172.21.15.103:3300/0 conn(0x7f8388062170 0x7f83880b4db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8388062550 tx=0x7f838805a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.738+0000 7f838e178700 1 --2- 172.21.15.103:0/2695312097 >> v2:172.21.15.103:3300/0 conn(0x7f8388062170 0x7f83880b4db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8388062550 tx=0x7f838805a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.738+0000 7f838e178700 1 --2- 172.21.15.103:0/2695312097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8388062170 0x7f83880b4db0 secure :-1 s=READY pgs=817 cs=0 l=1 rx=0x7f8388062550 tx=0x7f838805a720).ready entity=mon.1 client_cookie=ff877e7c32eb319 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:41.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.738+0000 7f838e178700 1 --2- 172.21.15.103:0/2695312097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8388062170 0x7f83880b4db0 secure :-1 s=THROTTLE_DONE pgs=817 cs=0 l=1 rx=0x7f8388062550 tx=0x7f838805a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.738+0000 7f838d977700 1 -- 172.21.15.103:0/2695312097 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83780116e0 con 0x7f8388062170 2020-04-22T14:10:41.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.738+0000 7f838e178700 1 --2- 172.21.15.103:0/2695312097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8388062170 0x7f83880b4db0 secure :-1 s=THROTTLE_DONE pgs=817 cs=0 l=1 rx=0x7f8388062550 tx=0x7f838805a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.738+0000 7f838e178700 1 --2- 172.21.15.103:0/2695312097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8388062170 0x7f83880b4db0 secure :-1 s=THROTTLE_DONE pgs=817 cs=0 l=1 rx=0x7f8388062550 tx=0x7f838805a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.739+0000 7f838d977700 1 -- 172.21.15.103:0/2695312097 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8378011840 con 0x7f8388062170 2020-04-22T14:10:41.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.739+0000 7f838d977700 1 -- 172.21.15.103:0/2695312097 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8378011c60 con 0x7f8388062170 2020-04-22T14:10:41.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.739+0000 7f83903dc700 1 -- 172.21.15.103:0/2695312097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8388062170 msgr2=0x7f83880b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:41.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.739+0000 7f83903dc700 1 --2- 172.21.15.103:0/2695312097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8388062170 0x7f83880b4db0 secure :-1 s=READY pgs=817 cs=0 l=1 rx=0x7f8388062550 tx=0x7f838805a720).stop 2020-04-22T14:10:41.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.739+0000 7f83903dc700 1 -- 172.21.15.103:0/2695312097 shutdown_connections 2020-04-22T14:10:41.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.739+0000 7f83903dc700 1 --2- 172.21.15.103:0/2695312097 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8388152a90 0x7f83880b44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:41.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.739+0000 7f83903dc700 1 --2- 172.21.15.103:0/2695312097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8388062170 0x7f83880b4db0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:41.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.739+0000 7f83903dc700 1 -- 172.21.15.103:0/2695312097 >> 172.21.15.103:0/2695312097 conn(0x7f838805ad30 msgr2=0x7f838805b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:41.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.739+0000 7f83903dc700 1 -- 172.21.15.103:0/2695312097 shutdown_connections 2020-04-22T14:10:41.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.739+0000 7f83903dc700 1 -- 172.21.15.103:0/2695312097 wait complete. 2020-04-22T14:10:41.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.740+0000 7f83903dc700 1 Processor -- start 2020-04-22T14:10:41.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.740+0000 7f83903dc700 1 -- start start 2020-04-22T14:10:41.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.741+0000 7f83903dc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8388062170 0x7f8388154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:41.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.741+0000 7f83903dc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8388152a90 0x7f838812aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:41.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.741+0000 7f83903dc700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8388139df0 con 0x7f83880b5210 2020-04-22T14:10:41.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.741+0000 7f83903dc700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8388154140 con 0x7f8388062170 2020-04-22T14:10:41.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.741+0000 7f83903dc700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8388138fa0 con 0x7f8388152a90 2020-04-22T14:10:41.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.741+0000 7f838f17a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8388152a90 0x7f838812aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:41.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.741+0000 7f838f17a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8388152a90 0x7f838812aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51276/0 (socket says 172.21.15.103:51276) 2020-04-22T14:10:41.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.741+0000 7f838f17a700 1 -- 172.21.15.103:0/2439060001 learned_addr learned my addr 172.21.15.103:0/2439060001 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:10:41.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.741+0000 7f838e979700 1 --2- 172.21.15.103:0/2439060001 >> v2:172.21.15.86:3300/0 conn(0x7f8388062170 0x7f8388154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:41.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.741+0000 7f838f17a700 1 -- 172.21.15.103:0/2439060001 >> v2:172.21.15.86:3300/0 conn(0x7f8388062170 msgr2=0x7f8388154ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:41.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.741+0000 7f838f17a700 1 --2- 172.21.15.103:0/2439060001 >> v2:172.21.15.86:3300/0 conn(0x7f8388062170 0x7f8388154ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:41.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.741+0000 7f838f17a700 1 -- 172.21.15.103:0/2439060001 >> v1:172.21.15.86:6789/0 conn(0x7f83880b5210 legacy=0x7f83881396e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:41.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.741+0000 7f838f17a700 1 -- 172.21.15.103:0/2439060001 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8388139240 con 0x7f8388152a90 2020-04-22T14:10:41.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.741+0000 7f838f17a700 1 --2- 172.21.15.103:0/2439060001 >> v2:172.21.15.103:3300/0 conn(0x7f8388152a90 0x7f838812aec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f83800022d0 tx=0x7f8380010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.741+0000 7f838f17a700 1 --2- 172.21.15.103:0/2439060001 >> v2:172.21.15.103:3300/0 conn(0x7f8388152a90 0x7f838812aec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f83800022d0 tx=0x7f8380010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.741+0000 7f838f17a700 1 --2- 172.21.15.103:0/2439060001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8388152a90 0x7f838812aec0 secure :-1 s=READY pgs=818 cs=0 l=1 rx=0x7f83800022d0 tx=0x7f8380010c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:41.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.741+0000 7f838f17a700 1 --2- 172.21.15.103:0/2439060001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8388152a90 0x7f838812aec0 secure :-1 s=THROTTLE_DONE pgs=818 cs=0 l=1 rx=0x7f83800022d0 tx=0x7f8380010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.742+0000 7f837f7fe700 1 -- 172.21.15.103:0/2439060001 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83800122b0 con 0x7f8388152a90 2020-04-22T14:10:41.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.742+0000 7f838f17a700 1 --2- 172.21.15.103:0/2439060001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8388152a90 0x7f838812aec0 secure :-1 s=THROTTLE_DONE pgs=818 cs=0 l=1 rx=0x7f83800022d0 tx=0x7f8380010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.742+0000 7f838f17a700 1 --2- 172.21.15.103:0/2439060001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8388152a90 0x7f838812aec0 secure :-1 s=THROTTLE_DONE pgs=818 cs=0 l=1 rx=0x7f83800022d0 tx=0x7f8380010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.742+0000 7f837f7fe700 1 -- 172.21.15.103:0/2439060001 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8380012410 con 0x7f8388152a90 2020-04-22T14:10:41.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.742+0000 7f83903dc700 1 -- 172.21.15.103:0/2439060001 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8388155e30 con 0x7f8388152a90 2020-04-22T14:10:41.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.742+0000 7f837f7fe700 1 -- 172.21.15.103:0/2439060001 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83800127f0 con 0x7f8388152a90 2020-04-22T14:10:41.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.742+0000 7f83903dc700 1 -- 172.21.15.103:0/2439060001 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8388153e30 con 0x7f8388152a90 2020-04-22T14:10:41.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.742+0000 7f838f17a700 1 --2- 172.21.15.103:0/2439060001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8388152a90 0x7f838812aec0 secure :-1 s=THROTTLE_DONE pgs=818 cs=0 l=1 rx=0x7f83800022d0 tx=0x7f8380010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.743+0000 7f837f7fe700 1 -- 172.21.15.103:0/2439060001 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f8380012a60 con 0x7f8388152a90 2020-04-22T14:10:41.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.743+0000 7f838f17a700 1 --2- 172.21.15.103:0/2439060001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8388152a90 0x7f838812aec0 secure :-1 s=THROTTLE_DONE pgs=818 cs=0 l=1 rx=0x7f83800022d0 tx=0x7f8380010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.743+0000 7f83903dc700 1 -- 172.21.15.103:0/2439060001 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8388056c90 con 0x7f8388152a90 2020-04-22T14:10:41.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.743+0000 7f837f7fe700 1 --2- 172.21.15.103:0/2439060001 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f837004d9e0 0x7f837004fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:41.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.743+0000 7f837f7fe700 1 -- 172.21.15.103:0/2439060001 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8380061b00 con 0x7f8388152a90 2020-04-22T14:10:41.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.743+0000 7f838e979700 1 --2- 172.21.15.103:0/2439060001 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f837004d9e0 0x7f837004fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:41.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.743+0000 7f838e979700 1 --2- 172.21.15.103:0/2439060001 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f837004d9e0 0x7f837004fea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8384002f30 tx=0x7f838400e190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.743+0000 7f838e979700 1 --2- 172.21.15.103:0/2439060001 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f837004d9e0 0x7f837004fea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8384002f30 tx=0x7f838400e190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.743+0000 7f838e979700 1 --2- 172.21.15.103:0/2439060001 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f837004d9e0 0x7f837004fea0 secure :-1 s=READY pgs=309 cs=0 l=1 rx=0x7f8384002f30 tx=0x7f838400e190).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:41.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.747+0000 7f838f17a700 1 --2- 172.21.15.103:0/2439060001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8388152a90 0x7f838812aec0 secure :-1 s=THROTTLE_DONE pgs=818 cs=0 l=1 rx=0x7f83800022d0 tx=0x7f8380010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.747+0000 7f837f7fe700 1 -- 172.21.15.103:0/2439060001 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f838003ce80 con 0x7f8388152a90 2020-04-22T14:10:41.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.943+0000 7f83903dc700 1 -- 172.21.15.103:0/2439060001 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f838806a8b0 con 0x7f8388152a90 2020-04-22T14:10:41.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.949+0000 7f838f17a700 1 --2- 172.21.15.103:0/2439060001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8388152a90 0x7f838812aec0 secure :-1 s=THROTTLE_DONE pgs=818 cs=0 l=1 rx=0x7f83800022d0 tx=0x7f8380010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:41.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.949+0000 7f837f7fe700 1 -- 172.21.15.103:0/2439060001 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v25) v1 ==== 184+0+0 (secure 0 0 0) 0x7f83800404a0 con 0x7f8388152a90 2020-04-22T14:10:41.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.950+0000 7f83903dc700 1 -- 172.21.15.103:0/2439060001 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f837004d9e0 msgr2=0x7f837004fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:41.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.950+0000 7f83903dc700 1 --2- 172.21.15.103:0/2439060001 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f837004d9e0 0x7f837004fea0 secure :-1 s=READY pgs=309 cs=0 l=1 rx=0x7f8384002f30 tx=0x7f838400e190).stop 2020-04-22T14:10:41.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.950+0000 7f83903dc700 1 -- 172.21.15.103:0/2439060001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8388152a90 msgr2=0x7f838812aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:41.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.950+0000 7f83903dc700 1 --2- 172.21.15.103:0/2439060001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8388152a90 0x7f838812aec0 secure :-1 s=READY pgs=818 cs=0 l=1 rx=0x7f83800022d0 tx=0x7f8380010c10).stop 2020-04-22T14:10:41.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.951+0000 7f83903dc700 1 -- 172.21.15.103:0/2439060001 shutdown_connections 2020-04-22T14:10:41.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.951+0000 7f83903dc700 1 --2- 172.21.15.103:0/2439060001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8388152a90 0x7f838812aec0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:41.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.951+0000 7f83903dc700 1 --2- 172.21.15.103:0/2439060001 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f837004d9e0 0x7f837004fea0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:41.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.951+0000 7f83903dc700 1 --2- 172.21.15.103:0/2439060001 >> v2:172.21.15.86:3300/0 conn(0x7f8388062170 0x7f8388154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:41.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.951+0000 7f83903dc700 1 -- 172.21.15.103:0/2439060001 >> 172.21.15.103:0/2439060001 conn(0x7f838805ad30 msgr2=0x7f83880b77b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:41.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.951+0000 7f83903dc700 1 -- 172.21.15.103:0/2439060001 shutdown_connections 2020-04-22T14:10:41.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:41.951+0000 7f83903dc700 1 -- 172.21.15.103:0/2439060001 wait complete. 2020-04-22T14:10:41.955 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.0 2020-04-22T14:10:41.964 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:41.982 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:10:42.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.131+0000 7f25950eb700 1 Processor -- start 2020-04-22T14:10:42.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.131+0000 7f25950eb700 1 -- start start 2020-04-22T14:10:42.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.132+0000 7f25950eb700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2590062170 0x7f25900b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:42.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.132+0000 7f25950eb700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25900b5210 0x7f25900adf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:42.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.132+0000 7f25950eb700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25900b5680 con 0x7f2590152a90 2020-04-22T14:10:42.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.132+0000 7f25950eb700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25900614f0 con 0x7f2590062170 2020-04-22T14:10:42.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.132+0000 7f25950eb700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2590061790 con 0x7f25900b5210 2020-04-22T14:10:42.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.132+0000 7f258f59e700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f2590152a90 0x7f25900b44d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43470/0 (socket says 172.21.15.103:43470) 2020-04-22T14:10:42.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.132+0000 7f258f59e700 1 -- 172.21.15.103:0/3874289801 learned_addr learned my addr 172.21.15.103:0/3874289801 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:42.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.132+0000 7f258ed9d700 1 --2- 172.21.15.103:0/3874289801 >> v2:172.21.15.86:3300/0 conn(0x7f2590062170 0x7f25900b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:42.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.132+0000 7f25948ea700 1 --2- 172.21.15.103:0/3874289801 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25900b5210 0x7f25900adf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:42.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.132+0000 7f258e59c700 1 -- 172.21.15.103:0/3874289801 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1667064341 0 0) 0x7f25900b5680 con 0x7f2590152a90 2020-04-22T14:10:42.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.132+0000 7f258e59c700 1 -- 172.21.15.103:0/3874289801 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2578003230 con 0x7f2590152a90 2020-04-22T14:10:42.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.132+0000 7f258ed9d700 1 -- 172.21.15.103:0/3874289801 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25900b5210 msgr2=0x7f25900adf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:42.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.132+0000 7f258ed9d700 1 --2- 172.21.15.103:0/3874289801 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25900b5210 0x7f25900adf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:42.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.132+0000 7f258ed9d700 1 -- 172.21.15.103:0/3874289801 >> v1:172.21.15.103:6789/0 conn(0x7f2590152a90 legacy=0x7f25900b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:42.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.132+0000 7f258ed9d700 1 -- 172.21.15.103:0/3874289801 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2590061a30 con 0x7f2590062170 2020-04-22T14:10:42.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.132+0000 7f25948ea700 1 --2- 172.21.15.103:0/3874289801 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25900b5210 0x7f25900adf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:10:42.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.132+0000 7f258ed9d700 1 --2- 172.21.15.103:0/3874289801 >> v2:172.21.15.86:3300/0 conn(0x7f2590062170 0x7f25900b4db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2584002f30 tx=0x7f259005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.132+0000 7f258ed9d700 1 --2- 172.21.15.103:0/3874289801 >> v2:172.21.15.86:3300/0 conn(0x7f2590062170 0x7f25900b4db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2584002f30 tx=0x7f259005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.132+0000 7f258ed9d700 1 --2- 172.21.15.103:0/3874289801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2590062170 0x7f25900b4db0 secure :-1 s=READY pgs=467 cs=0 l=1 rx=0x7f2584002f30 tx=0x7f259005a720).ready entity=mon.0 client_cookie=6be8b584c628fcbb server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:42.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.132+0000 7f258ed9d700 1 --2- 172.21.15.103:0/3874289801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2590062170 0x7f25900b4db0 secure :-1 s=THROTTLE_DONE pgs=467 cs=0 l=1 rx=0x7f2584002f30 tx=0x7f259005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.132+0000 7f258e59c700 1 -- 172.21.15.103:0/3874289801 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2584011310 con 0x7f2590062170 2020-04-22T14:10:42.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.132+0000 7f258ed9d700 1 --2- 172.21.15.103:0/3874289801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2590062170 0x7f25900b4db0 secure :-1 s=THROTTLE_DONE pgs=467 cs=0 l=1 rx=0x7f2584002f30 tx=0x7f259005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.133+0000 7f258ed9d700 1 --2- 172.21.15.103:0/3874289801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2590062170 0x7f25900b4db0 secure :-1 s=THROTTLE_DONE pgs=467 cs=0 l=1 rx=0x7f2584002f30 tx=0x7f259005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.133+0000 7f258e59c700 1 -- 172.21.15.103:0/3874289801 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25840114b0 con 0x7f2590062170 2020-04-22T14:10:42.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.133+0000 7f258e59c700 1 -- 172.21.15.103:0/3874289801 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25840118d0 con 0x7f2590062170 2020-04-22T14:10:42.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.133+0000 7f25950eb700 1 -- 172.21.15.103:0/3874289801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2590062170 msgr2=0x7f25900b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:42.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.133+0000 7f25950eb700 1 --2- 172.21.15.103:0/3874289801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2590062170 0x7f25900b4db0 secure :-1 s=READY pgs=467 cs=0 l=1 rx=0x7f2584002f30 tx=0x7f259005a720).stop 2020-04-22T14:10:42.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.133+0000 7f25950eb700 1 -- 172.21.15.103:0/3874289801 shutdown_connections 2020-04-22T14:10:42.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.133+0000 7f25950eb700 1 --2- 172.21.15.103:0/3874289801 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25900b5210 0x7f25900adf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:42.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.133+0000 7f25950eb700 1 --2- 172.21.15.103:0/3874289801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2590062170 0x7f25900b4db0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:42.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.133+0000 7f25950eb700 1 -- 172.21.15.103:0/3874289801 >> 172.21.15.103:0/3874289801 conn(0x7f259005ad30 msgr2=0x7f259005b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:42.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.133+0000 7f25950eb700 1 -- 172.21.15.103:0/3874289801 shutdown_connections 2020-04-22T14:10:42.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.133+0000 7f25950eb700 1 -- 172.21.15.103:0/3874289801 wait complete. 2020-04-22T14:10:42.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.134+0000 7f25950eb700 1 Processor -- start 2020-04-22T14:10:42.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.134+0000 7f25950eb700 1 -- start start 2020-04-22T14:10:42.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.135+0000 7f25950eb700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2590062170 0x7f259013efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:42.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.135+0000 7f25950eb700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2590152a90 0x7f25900661c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:42.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.135+0000 7f25950eb700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2590066620 con 0x7f25900b5210 2020-04-22T14:10:42.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.135+0000 7f25950eb700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25900657e0 con 0x7f2590062170 2020-04-22T14:10:42.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.135+0000 7f25950eb700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2590065a80 con 0x7f2590152a90 2020-04-22T14:10:42.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.135+0000 7f258f59e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2590062170 0x7f259013efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:42.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.135+0000 7f258f59e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2590062170 0x7f259013efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51290/0 (socket says 172.21.15.103:51290) 2020-04-22T14:10:42.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.135+0000 7f258f59e700 1 -- 172.21.15.103:0/2827577957 learned_addr learned my addr 172.21.15.103:0/2827577957 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:10:42.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.135+0000 7f25948ea700 1 --2- 172.21.15.103:0/2827577957 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2590152a90 0x7f25900661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:42.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.136+0000 7f258f59e700 1 -- 172.21.15.103:0/2827577957 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2590152a90 msgr2=0x7f25900661c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:42.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.136+0000 7f258f59e700 1 --2- 172.21.15.103:0/2827577957 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2590152a90 0x7f25900661c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:42.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.136+0000 7f258f59e700 1 -- 172.21.15.103:0/2827577957 >> v1:172.21.15.86:6789/0 conn(0x7f25900b5210 legacy=0x7f25900b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:42.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.136+0000 7f258f59e700 1 -- 172.21.15.103:0/2827577957 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2590065d20 con 0x7f2590062170 2020-04-22T14:10:42.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.136+0000 7f258f59e700 1 --2- 172.21.15.103:0/2827577957 >> v2:172.21.15.103:3300/0 conn(0x7f2590062170 0x7f259013efe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f25800010d0 tx=0x7f2580010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.136+0000 7f258f59e700 1 --2- 172.21.15.103:0/2827577957 >> v2:172.21.15.103:3300/0 conn(0x7f2590062170 0x7f259013efe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f25800010d0 tx=0x7f2580010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.136+0000 7f258f59e700 1 --2- 172.21.15.103:0/2827577957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2590062170 0x7f259013efe0 secure :-1 s=READY pgs=820 cs=0 l=1 rx=0x7f25800010d0 tx=0x7f2580010a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:42.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.136+0000 7f258f59e700 1 --2- 172.21.15.103:0/2827577957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2590062170 0x7f259013efe0 secure :-1 s=THROTTLE_DONE pgs=820 cs=0 l=1 rx=0x7f25800010d0 tx=0x7f2580010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.136+0000 7f2577fff700 1 -- 172.21.15.103:0/2827577957 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2580005cc0 con 0x7f2590062170 2020-04-22T14:10:42.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.136+0000 7f258f59e700 1 --2- 172.21.15.103:0/2827577957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2590062170 0x7f259013efe0 secure :-1 s=THROTTLE_DONE pgs=820 cs=0 l=1 rx=0x7f25800010d0 tx=0x7f2580010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.136+0000 7f258f59e700 1 --2- 172.21.15.103:0/2827577957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2590062170 0x7f259013efe0 secure :-1 s=THROTTLE_DONE pgs=820 cs=0 l=1 rx=0x7f25800010d0 tx=0x7f2580010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.136+0000 7f2577fff700 1 -- 172.21.15.103:0/2827577957 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2580005e20 con 0x7f2590062170 2020-04-22T14:10:42.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.136+0000 7f25950eb700 1 -- 172.21.15.103:0/2827577957 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25900654d0 con 0x7f2590062170 2020-04-22T14:10:42.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.136+0000 7f2577fff700 1 -- 172.21.15.103:0/2827577957 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25800122d0 con 0x7f2590062170 2020-04-22T14:10:42.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.136+0000 7f25950eb700 1 -- 172.21.15.103:0/2827577957 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25900b75d0 con 0x7f2590062170 2020-04-22T14:10:42.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.136+0000 7f258f59e700 1 --2- 172.21.15.103:0/2827577957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2590062170 0x7f259013efe0 secure :-1 s=THROTTLE_DONE pgs=820 cs=0 l=1 rx=0x7f25800010d0 tx=0x7f2580010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.137+0000 7f2577fff700 1 -- 172.21.15.103:0/2827577957 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f2580012500 con 0x7f2590062170 2020-04-22T14:10:42.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.137+0000 7f258f59e700 1 --2- 172.21.15.103:0/2827577957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2590062170 0x7f259013efe0 secure :-1 s=THROTTLE_DONE pgs=820 cs=0 l=1 rx=0x7f25800010d0 tx=0x7f2580010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.137+0000 7f25950eb700 1 -- 172.21.15.103:0/2827577957 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2590056c90 con 0x7f2590062170 2020-04-22T14:10:42.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.137+0000 7f2577fff700 1 --2- 172.21.15.103:0/2827577957 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f257004da10 0x7f257004fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:42.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.137+0000 7f2577fff700 1 -- 172.21.15.103:0/2827577957 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f25800090c0 con 0x7f2590062170 2020-04-22T14:10:42.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.137+0000 7f258ed9d700 1 --2- 172.21.15.103:0/2827577957 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f257004da10 0x7f257004fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:42.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.137+0000 7f258ed9d700 1 --2- 172.21.15.103:0/2827577957 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f257004da10 0x7f257004fed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f25900b28f0 tx=0x7f259005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.138+0000 7f258ed9d700 1 --2- 172.21.15.103:0/2827577957 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f257004da10 0x7f257004fed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f25900b28f0 tx=0x7f259005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.138+0000 7f258ed9d700 1 --2- 172.21.15.103:0/2827577957 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f257004da10 0x7f257004fed0 secure :-1 s=READY pgs=310 cs=0 l=1 rx=0x7f25900b28f0 tx=0x7f259005a720).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:42.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.141+0000 7f258f59e700 1 --2- 172.21.15.103:0/2827577957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2590062170 0x7f259013efe0 secure :-1 s=THROTTLE_DONE pgs=820 cs=0 l=1 rx=0x7f25800010d0 tx=0x7f2580010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.141+0000 7f2577fff700 1 -- 172.21.15.103:0/2827577957 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f258003ca60 con 0x7f2590062170 2020-04-22T14:10:42.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.332+0000 7f25950eb700 1 -- 172.21.15.103:0/2827577957 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f259006a8b0 con 0x7f2590062170 2020-04-22T14:10:42.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.339+0000 7f258f59e700 1 --2- 172.21.15.103:0/2827577957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2590062170 0x7f259013efe0 secure :-1 s=THROTTLE_DONE pgs=820 cs=0 l=1 rx=0x7f25800010d0 tx=0x7f2580010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.339+0000 7f2577fff700 1 -- 172.21.15.103:0/2827577957 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v26) v1 ==== 184+0+0 (secure 0 0 0) 0x7f2580040080 con 0x7f2590062170 2020-04-22T14:10:42.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.340+0000 7f25950eb700 1 -- 172.21.15.103:0/2827577957 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f257004da10 msgr2=0x7f257004fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:42.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.340+0000 7f25950eb700 1 --2- 172.21.15.103:0/2827577957 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f257004da10 0x7f257004fed0 secure :-1 s=READY pgs=310 cs=0 l=1 rx=0x7f25900b28f0 tx=0x7f259005a720).stop 2020-04-22T14:10:42.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.340+0000 7f25950eb700 1 -- 172.21.15.103:0/2827577957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2590062170 msgr2=0x7f259013efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:42.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.340+0000 7f25950eb700 1 --2- 172.21.15.103:0/2827577957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2590062170 0x7f259013efe0 secure :-1 s=READY pgs=820 cs=0 l=1 rx=0x7f25800010d0 tx=0x7f2580010a40).stop 2020-04-22T14:10:42.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.340+0000 7f25950eb700 1 -- 172.21.15.103:0/2827577957 shutdown_connections 2020-04-22T14:10:42.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.340+0000 7f25950eb700 1 --2- 172.21.15.103:0/2827577957 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f257004da10 0x7f257004fed0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:42.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.340+0000 7f25950eb700 1 --2- 172.21.15.103:0/2827577957 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2590152a90 0x7f25900661c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:42.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.340+0000 7f25950eb700 1 --2- 172.21.15.103:0/2827577957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2590062170 0x7f259013efe0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:42.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.340+0000 7f25950eb700 1 -- 172.21.15.103:0/2827577957 >> 172.21.15.103:0/2827577957 conn(0x7f259005ad30 msgr2=0x7f25901302a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:42.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.341+0000 7f25950eb700 1 -- 172.21.15.103:0/2827577957 shutdown_connections 2020-04-22T14:10:42.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.341+0000 7f25950eb700 1 -- 172.21.15.103:0/2827577957 wait complete. 2020-04-22T14:10:42.345 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.1 2020-04-22T14:10:42.354 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:42.369 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:10:42.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.519+0000 7fbf98a3a700 1 Processor -- start 2020-04-22T14:10:42.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.519+0000 7fbf98a3a700 1 -- start start 2020-04-22T14:10:42.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.520+0000 7fbf98a3a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbf94152a90 0x7fbf940b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:42.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.520+0000 7fbf98a3a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbf94062170 0x7fbf940b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:42.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.520+0000 7fbf98a3a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf94152e70 con 0x7fbf940b5210 2020-04-22T14:10:42.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.520+0000 7fbf98a3a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf940b5680 con 0x7fbf94062170 2020-04-22T14:10:42.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.520+0000 7fbf98a3a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf940614f0 con 0x7fbf94152a90 2020-04-22T14:10:42.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.520+0000 7fbf92d9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbf94152a90 0x7fbf940b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:42.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.520+0000 7fbf92d9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbf94152a90 0x7fbf940b44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51294/0 (socket says 172.21.15.103:51294) 2020-04-22T14:10:42.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.520+0000 7fbf92d9d700 1 -- 172.21.15.103:0/3959098295 learned_addr learned my addr 172.21.15.103:0/3959098295 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:10:42.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.520+0000 7fbf9259c700 1 --2- 172.21.15.103:0/3959098295 >> v2:172.21.15.86:3300/0 conn(0x7fbf94062170 0x7fbf940b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:42.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.520+0000 7fbf92d9d700 1 -- 172.21.15.103:0/3959098295 >> v2:172.21.15.86:3300/0 conn(0x7fbf94062170 msgr2=0x7fbf940b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:42.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.520+0000 7fbf92d9d700 1 --2- 172.21.15.103:0/3959098295 >> v2:172.21.15.86:3300/0 conn(0x7fbf94062170 0x7fbf940b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:42.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.521+0000 7fbf92d9d700 1 -- 172.21.15.103:0/3959098295 >> v1:172.21.15.86:6789/0 conn(0x7fbf940b5210 legacy=0x7fbf94156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:42.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.521+0000 7fbf92d9d700 1 -- 172.21.15.103:0/3959098295 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf94061790 con 0x7fbf94152a90 2020-04-22T14:10:42.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.521+0000 7fbf9259c700 1 --2- 172.21.15.103:0/3959098295 >> v2:172.21.15.86:3300/0 conn(0x7fbf94062170 0x7fbf940b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:10:42.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.521+0000 7fbf92d9d700 1 --2- 172.21.15.103:0/3959098295 >> v2:172.21.15.103:3300/0 conn(0x7fbf94152a90 0x7fbf940b44d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbf840032b0 tx=0x7fbf84007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.521+0000 7fbf92d9d700 1 --2- 172.21.15.103:0/3959098295 >> v2:172.21.15.103:3300/0 conn(0x7fbf94152a90 0x7fbf940b44d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbf840032b0 tx=0x7fbf84007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.521+0000 7fbf92d9d700 1 --2- 172.21.15.103:0/3959098295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf94152a90 0x7fbf940b44d0 secure :-1 s=READY pgs=821 cs=0 l=1 rx=0x7fbf840032b0 tx=0x7fbf84007dc0).ready entity=mon.1 client_cookie=e86848910b4aed71 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:42.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.521+0000 7fbf92d9d700 1 --2- 172.21.15.103:0/3959098295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf94152a90 0x7fbf940b44d0 secure :-1 s=THROTTLE_DONE pgs=821 cs=0 l=1 rx=0x7fbf840032b0 tx=0x7fbf84007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.521+0000 7fbf91d9b700 1 -- 172.21.15.103:0/3959098295 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf8400a180 con 0x7fbf94152a90 2020-04-22T14:10:42.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.521+0000 7fbf92d9d700 1 --2- 172.21.15.103:0/3959098295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf94152a90 0x7fbf940b44d0 secure :-1 s=THROTTLE_DONE pgs=821 cs=0 l=1 rx=0x7fbf840032b0 tx=0x7fbf84007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.521+0000 7fbf92d9d700 1 --2- 172.21.15.103:0/3959098295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf94152a90 0x7fbf940b44d0 secure :-1 s=THROTTLE_DONE pgs=821 cs=0 l=1 rx=0x7fbf840032b0 tx=0x7fbf84007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.521+0000 7fbf91d9b700 1 -- 172.21.15.103:0/3959098295 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf8400a2e0 con 0x7fbf94152a90 2020-04-22T14:10:42.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.521+0000 7fbf91d9b700 1 -- 172.21.15.103:0/3959098295 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf8400a700 con 0x7fbf94152a90 2020-04-22T14:10:42.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.521+0000 7fbf98a3a700 1 -- 172.21.15.103:0/3959098295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf94152a90 msgr2=0x7fbf940b44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:42.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.521+0000 7fbf98a3a700 1 --2- 172.21.15.103:0/3959098295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf94152a90 0x7fbf940b44d0 secure :-1 s=READY pgs=821 cs=0 l=1 rx=0x7fbf840032b0 tx=0x7fbf84007dc0).stop 2020-04-22T14:10:42.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.521+0000 7fbf98a3a700 1 -- 172.21.15.103:0/3959098295 shutdown_connections 2020-04-22T14:10:42.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.521+0000 7fbf98a3a700 1 --2- 172.21.15.103:0/3959098295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf94152a90 0x7fbf940b44d0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:42.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.521+0000 7fbf98a3a700 1 --2- 172.21.15.103:0/3959098295 >> v2:172.21.15.86:3300/0 conn(0x7fbf94062170 0x7fbf940b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:42.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.521+0000 7fbf98a3a700 1 -- 172.21.15.103:0/3959098295 >> 172.21.15.103:0/3959098295 conn(0x7fbf9405ad30 msgr2=0x7fbf9405b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:42.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.521+0000 7fbf98a3a700 1 -- 172.21.15.103:0/3959098295 shutdown_connections 2020-04-22T14:10:42.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.521+0000 7fbf98a3a700 1 -- 172.21.15.103:0/3959098295 wait complete. 2020-04-22T14:10:42.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.523+0000 7fbf98a3a700 1 Processor -- start 2020-04-22T14:10:42.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.523+0000 7fbf98a3a700 1 -- start start 2020-04-22T14:10:42.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.523+0000 7fbf98a3a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbf94062170 0x7fbf9407ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:42.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.523+0000 7fbf98a3a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbf940b5210 0x7fbf940b34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:42.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.523+0000 7fbf98a3a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf94152a90 0x7fbf9406f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:42.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.523+0000 7fbf98a3a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf94126d30 con 0x7fbf94062170 2020-04-22T14:10:42.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.523+0000 7fbf98a3a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf94066220 con 0x7fbf940b5210 2020-04-22T14:10:42.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.523+0000 7fbf98a3a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf940666c0 con 0x7fbf94152a90 2020-04-22T14:10:42.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.523+0000 7fbf9259c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbf940b5210 0x7fbf940b34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:42.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.523+0000 7fbf9259c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbf940b5210 0x7fbf940b34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51302/0 (socket says 172.21.15.103:51302) 2020-04-22T14:10:42.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.523+0000 7fbf9259c700 1 -- 172.21.15.103:0/1086722191 learned_addr learned my addr 172.21.15.103:0/1086722191 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:10:42.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.524+0000 7fbf9259c700 1 -- 172.21.15.103:0/1086722191 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf94152a90 msgr2=0x7fbf9406f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:42.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.524+0000 7fbf9259c700 1 --2- 172.21.15.103:0/1086722191 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf94152a90 0x7fbf9406f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:42.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.524+0000 7fbf9259c700 1 -- 172.21.15.103:0/1086722191 >> v2:172.21.15.86:3300/0 conn(0x7fbf94062170 msgr2=0x7fbf9407ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:42.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.524+0000 7fbf9259c700 1 --2- 172.21.15.103:0/1086722191 >> v2:172.21.15.86:3300/0 conn(0x7fbf94062170 0x7fbf9407ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:42.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.524+0000 7fbf9259c700 1 -- 172.21.15.103:0/1086722191 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf9407f570 con 0x7fbf940b5210 2020-04-22T14:10:42.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.524+0000 7fbf9259c700 1 --2- 172.21.15.103:0/1086722191 >> v2:172.21.15.103:3300/0 conn(0x7fbf940b5210 0x7fbf940b34a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbf88007920 tx=0x7fbf9405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.524+0000 7fbf9259c700 1 --2- 172.21.15.103:0/1086722191 >> v2:172.21.15.103:3300/0 conn(0x7fbf940b5210 0x7fbf940b34a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbf88007920 tx=0x7fbf9405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.524+0000 7fbf9259c700 1 --2- 172.21.15.103:0/1086722191 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf940b5210 0x7fbf940b34a0 secure :-1 s=READY pgs=822 cs=0 l=1 rx=0x7fbf88007920 tx=0x7fbf9405a720).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:42.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.524+0000 7fbf9259c700 1 --2- 172.21.15.103:0/1086722191 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf940b5210 0x7fbf940b34a0 secure :-1 s=THROTTLE_DONE pgs=822 cs=0 l=1 rx=0x7fbf88007920 tx=0x7fbf9405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.524+0000 7fbf9259c700 1 --2- 172.21.15.103:0/1086722191 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf940b5210 0x7fbf940b34a0 secure :-1 s=THROTTLE_DONE pgs=822 cs=0 l=1 rx=0x7fbf88007920 tx=0x7fbf9405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.524+0000 7fbf837fe700 1 -- 172.21.15.103:0/1086722191 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf88005e90 con 0x7fbf940b5210 2020-04-22T14:10:42.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.524+0000 7fbf9259c700 1 --2- 172.21.15.103:0/1086722191 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf940b5210 0x7fbf940b34a0 secure :-1 s=THROTTLE_DONE pgs=822 cs=0 l=1 rx=0x7fbf88007920 tx=0x7fbf9405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.524+0000 7fbf837fe700 1 -- 172.21.15.103:0/1086722191 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf88007180 con 0x7fbf940b5210 2020-04-22T14:10:42.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.524+0000 7fbf98a3a700 1 -- 172.21.15.103:0/1086722191 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf94126970 con 0x7fbf940b5210 2020-04-22T14:10:42.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.524+0000 7fbf837fe700 1 -- 172.21.15.103:0/1086722191 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf88007520 con 0x7fbf940b5210 2020-04-22T14:10:42.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.524+0000 7fbf98a3a700 1 -- 172.21.15.103:0/1086722191 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf940b3ac0 con 0x7fbf940b5210 2020-04-22T14:10:42.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.524+0000 7fbf9259c700 1 --2- 172.21.15.103:0/1086722191 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf940b5210 0x7fbf940b34a0 secure :-1 s=THROTTLE_DONE pgs=822 cs=0 l=1 rx=0x7fbf88007920 tx=0x7fbf9405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.525+0000 7fbf837fe700 1 -- 172.21.15.103:0/1086722191 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fbf880122a0 con 0x7fbf940b5210 2020-04-22T14:10:42.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.525+0000 7fbf9259c700 1 --2- 172.21.15.103:0/1086722191 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf940b5210 0x7fbf940b34a0 secure :-1 s=THROTTLE_DONE pgs=822 cs=0 l=1 rx=0x7fbf88007920 tx=0x7fbf9405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.525+0000 7fbf98a3a700 1 -- 172.21.15.103:0/1086722191 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf94056c90 con 0x7fbf940b5210 2020-04-22T14:10:42.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.525+0000 7fbf837fe700 1 --2- 172.21.15.103:0/1086722191 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbf7804d940 0x7fbf7804fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:42.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.525+0000 7fbf837fe700 1 -- 172.21.15.103:0/1086722191 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbf88061460 con 0x7fbf940b5210 2020-04-22T14:10:42.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.525+0000 7fbf92d9d700 1 --2- 172.21.15.103:0/1086722191 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbf7804d940 0x7fbf7804fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:42.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.526+0000 7fbf92d9d700 1 --2- 172.21.15.103:0/1086722191 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbf7804d940 0x7fbf7804fe00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbf840032b0 tx=0x7fbf84007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.526+0000 7fbf92d9d700 1 --2- 172.21.15.103:0/1086722191 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbf7804d940 0x7fbf7804fe00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbf840032b0 tx=0x7fbf84007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.526+0000 7fbf92d9d700 1 --2- 172.21.15.103:0/1086722191 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbf7804d940 0x7fbf7804fe00 secure :-1 s=READY pgs=311 cs=0 l=1 rx=0x7fbf840032b0 tx=0x7fbf84007dc0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:42.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.529+0000 7fbf9259c700 1 --2- 172.21.15.103:0/1086722191 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf940b5210 0x7fbf940b34a0 secure :-1 s=THROTTLE_DONE pgs=822 cs=0 l=1 rx=0x7fbf88007920 tx=0x7fbf9405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.529+0000 7fbf837fe700 1 -- 172.21.15.103:0/1086722191 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fbf8803c840 con 0x7fbf940b5210 2020-04-22T14:10:42.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.721+0000 7fbf98a3a700 1 -- 172.21.15.103:0/1086722191 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fbf940b3ac0 con 0x7fbf940b5210 2020-04-22T14:10:42.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.725+0000 7fbf9259c700 1 --2- 172.21.15.103:0/1086722191 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf940b5210 0x7fbf940b34a0 secure :-1 s=THROTTLE_DONE pgs=822 cs=0 l=1 rx=0x7fbf88007920 tx=0x7fbf9405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.725+0000 7fbf837fe700 1 -- 172.21.15.103:0/1086722191 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v27) v1 ==== 184+0+0 (secure 0 0 0) 0x7fbf940b3ac0 con 0x7fbf940b5210 2020-04-22T14:10:42.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.726+0000 7fbf98a3a700 1 -- 172.21.15.103:0/1086722191 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbf7804d940 msgr2=0x7fbf7804fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:42.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.726+0000 7fbf98a3a700 1 --2- 172.21.15.103:0/1086722191 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbf7804d940 0x7fbf7804fe00 secure :-1 s=READY pgs=311 cs=0 l=1 rx=0x7fbf840032b0 tx=0x7fbf84007dc0).stop 2020-04-22T14:10:42.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.726+0000 7fbf98a3a700 1 -- 172.21.15.103:0/1086722191 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf940b5210 msgr2=0x7fbf940b34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:42.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.726+0000 7fbf98a3a700 1 --2- 172.21.15.103:0/1086722191 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf940b5210 0x7fbf940b34a0 secure :-1 s=READY pgs=822 cs=0 l=1 rx=0x7fbf88007920 tx=0x7fbf9405a720).stop 2020-04-22T14:10:42.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.726+0000 7fbf98a3a700 1 -- 172.21.15.103:0/1086722191 shutdown_connections 2020-04-22T14:10:42.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.726+0000 7fbf98a3a700 1 --2- 172.21.15.103:0/1086722191 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbf7804d940 0x7fbf7804fe00 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:42.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.726+0000 7fbf98a3a700 1 --2- 172.21.15.103:0/1086722191 >> v2:172.21.15.86:3300/0 conn(0x7fbf94062170 0x7fbf9407ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:42.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.726+0000 7fbf98a3a700 1 --2- 172.21.15.103:0/1086722191 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf94152a90 0x7fbf9406f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:42.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.726+0000 7fbf98a3a700 1 --2- 172.21.15.103:0/1086722191 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf940b5210 0x7fbf940b34a0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:42.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.726+0000 7fbf98a3a700 1 -- 172.21.15.103:0/1086722191 >> 172.21.15.103:0/1086722191 conn(0x7fbf9405ad30 msgr2=0x7fbf94151f90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:42.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.726+0000 7fbf98a3a700 1 -- 172.21.15.103:0/1086722191 shutdown_connections 2020-04-22T14:10:42.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.726+0000 7fbf98a3a700 1 -- 172.21.15.103:0/1086722191 wait complete. 2020-04-22T14:10:42.736 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.2 2020-04-22T14:10:42.740 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:42.764 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:10:42.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.914+0000 7fd4b154e700 1 Processor -- start 2020-04-22T14:10:42.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.914+0000 7fd4b154e700 1 -- start start 2020-04-22T14:10:42.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.914+0000 7fd4b154e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd4ac0633c0 0x7fd4ac0b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:42.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.914+0000 7fd4b154e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4ac025b90 con 0x7fd4ac0b6350 2020-04-22T14:10:42.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.914+0000 7fd4b154e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4ac066ac0 con 0x7fd4ac0666e0 2020-04-22T14:10:42.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.914+0000 7fd4b154e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4ac024ea0 con 0x7fd4ac0633c0 2020-04-22T14:10:42.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.915+0000 7fd4abfff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd4ac0633c0 0x7fd4ac0b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:42.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.915+0000 7fd4b0d4d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd4ac0666e0 0x7fd4ac0b9880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43498/0 (socket says 172.21.15.103:43498) 2020-04-22T14:10:42.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.915+0000 7fd4b0d4d700 1 -- 172.21.15.103:0/900901268 learned_addr learned my addr 172.21.15.103:0/900901268 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:42.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.915+0000 7fd4abfff700 1 -- 172.21.15.103:0/900901268 >> v1:172.21.15.103:6789/0 conn(0x7fd4ac0666e0 legacy=0x7fd4ac0b9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:42.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.915+0000 7fd4abfff700 1 -- 172.21.15.103:0/900901268 >> v1:172.21.15.86:6789/0 conn(0x7fd4ac0b6350 legacy=0x7fd4ac0b6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:42.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.915+0000 7fd4ab7fe700 1 -- 172.21.15.103:0/900901268 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3228092817 0 0) 0x7fd4ac066ac0 con 0x7fd4ac0666e0 2020-04-22T14:10:42.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.915+0000 7fd4abfff700 1 -- 172.21.15.103:0/900901268 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ac155ff0 con 0x7fd4ac0633c0 2020-04-22T14:10:42.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.915+0000 7fd4abfff700 1 --2- 172.21.15.103:0/900901268 >> v2:172.21.15.103:3300/0 conn(0x7fd4ac0633c0 0x7fd4ac0b5ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd4a0002f30 tx=0x7fd4a0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.915+0000 7fd4abfff700 1 --2- 172.21.15.103:0/900901268 >> v2:172.21.15.103:3300/0 conn(0x7fd4ac0633c0 0x7fd4ac0b5ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd4a0002f30 tx=0x7fd4a0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.915+0000 7fd4abfff700 1 --2- 172.21.15.103:0/900901268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4ac0633c0 0x7fd4ac0b5ef0 secure :-1 s=READY pgs=824 cs=0 l=1 rx=0x7fd4a0002f30 tx=0x7fd4a0007a40).ready entity=mon.1 client_cookie=9da8501933a6a122 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:42.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.915+0000 7fd4abfff700 1 --2- 172.21.15.103:0/900901268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4ac0633c0 0x7fd4ac0b5ef0 secure :-1 s=THROTTLE_DONE pgs=824 cs=0 l=1 rx=0x7fd4a0002f30 tx=0x7fd4a0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.915+0000 7fd4ab7fe700 1 -- 172.21.15.103:0/900901268 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4a0011470 con 0x7fd4ac0633c0 2020-04-22T14:10:42.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.915+0000 7fd4abfff700 1 --2- 172.21.15.103:0/900901268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4ac0633c0 0x7fd4ac0b5ef0 secure :-1 s=THROTTLE_DONE pgs=824 cs=0 l=1 rx=0x7fd4a0002f30 tx=0x7fd4a0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.915+0000 7fd4ab7fe700 1 -- 172.21.15.103:0/900901268 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a00115d0 con 0x7fd4ac0633c0 2020-04-22T14:10:42.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.915+0000 7fd4abfff700 1 --2- 172.21.15.103:0/900901268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4ac0633c0 0x7fd4ac0b5ef0 secure :-1 s=THROTTLE_DONE pgs=824 cs=0 l=1 rx=0x7fd4a0002f30 tx=0x7fd4a0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.915+0000 7fd4b154e700 1 -- 172.21.15.103:0/900901268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4ac0633c0 msgr2=0x7fd4ac0b5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:42.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.915+0000 7fd4ab7fe700 1 -- 172.21.15.103:0/900901268 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4a00119f0 con 0x7fd4ac0633c0 2020-04-22T14:10:42.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.915+0000 7fd4b154e700 1 --2- 172.21.15.103:0/900901268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4ac0633c0 0x7fd4ac0b5ef0 secure :-1 s=READY pgs=824 cs=0 l=1 rx=0x7fd4a0002f30 tx=0x7fd4a0007a40).stop 2020-04-22T14:10:42.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.916+0000 7fd4b154e700 1 -- 172.21.15.103:0/900901268 shutdown_connections 2020-04-22T14:10:42.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.916+0000 7fd4b154e700 1 --2- 172.21.15.103:0/900901268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4ac0633c0 0x7fd4ac0b5ef0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:42.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.916+0000 7fd4b154e700 1 -- 172.21.15.103:0/900901268 >> 172.21.15.103:0/900901268 conn(0x7fd4ac060930 msgr2=0x7fd4ac060d40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:42.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.916+0000 7fd4b154e700 1 -- 172.21.15.103:0/900901268 shutdown_connections 2020-04-22T14:10:42.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.916+0000 7fd4b154e700 1 -- 172.21.15.103:0/900901268 wait complete. 2020-04-22T14:10:42.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.917+0000 7fd4b154e700 1 Processor -- start 2020-04-22T14:10:42.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.917+0000 7fd4b154e700 1 -- start start 2020-04-22T14:10:42.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.918+0000 7fd4b154e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd4ac0633c0 0x7fd4ac05b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:42.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.918+0000 7fd4b154e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4ac0666e0 0x7fd4ac120630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:42.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.918+0000 7fd4b154e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd4ac0b6350 0x7fd4ac0b2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:42.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.918+0000 7fd4b154e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4ac05b4c0 con 0x7fd4ac0633c0 2020-04-22T14:10:42.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.918+0000 7fd4b154e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4ac120a90 con 0x7fd4ac0b6350 2020-04-22T14:10:42.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.918+0000 7fd4b154e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac0b00b0 con 0x7fd4ac0666e0 2020-04-22T14:10:42.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.918+0000 7fd4b27b0700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd4ac0b6350 0x7fd4ac0b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:42.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.918+0000 7fd4b27b0700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd4ac0b6350 0x7fd4ac0b2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51316/0 (socket says 172.21.15.103:51316) 2020-04-22T14:10:42.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.918+0000 7fd4b27b0700 1 -- 172.21.15.103:0/2351553378 learned_addr learned my addr 172.21.15.103:0/2351553378 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:10:42.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.918+0000 7fd4b0d4d700 1 --2- 172.21.15.103:0/2351553378 >> v2:172.21.15.86:3300/0 conn(0x7fd4ac0633c0 0x7fd4ac05b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:42.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.918+0000 7fd4abfff700 1 --2- 172.21.15.103:0/2351553378 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4ac0666e0 0x7fd4ac120630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:42.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.918+0000 7fd4b27b0700 1 -- 172.21.15.103:0/2351553378 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4ac0666e0 msgr2=0x7fd4ac120630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:42.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.918+0000 7fd4b27b0700 1 --2- 172.21.15.103:0/2351553378 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4ac0666e0 0x7fd4ac120630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:42.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.918+0000 7fd4b27b0700 1 -- 172.21.15.103:0/2351553378 >> v2:172.21.15.86:3300/0 conn(0x7fd4ac0633c0 msgr2=0x7fd4ac05b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:42.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.918+0000 7fd4b27b0700 1 --2- 172.21.15.103:0/2351553378 >> v2:172.21.15.86:3300/0 conn(0x7fd4ac0633c0 0x7fd4ac05b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:42.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.918+0000 7fd4b27b0700 1 -- 172.21.15.103:0/2351553378 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ac0b0350 con 0x7fd4ac0b6350 2020-04-22T14:10:42.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.918+0000 7fd4abfff700 1 --2- 172.21.15.103:0/2351553378 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4ac0666e0 0x7fd4ac120630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:10:42.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.918+0000 7fd4b27b0700 1 --2- 172.21.15.103:0/2351553378 >> v2:172.21.15.103:3300/0 conn(0x7fd4ac0b6350 0x7fd4ac0b2290 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd4ac0ba430 tx=0x7fd4a40021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.918+0000 7fd4b27b0700 1 --2- 172.21.15.103:0/2351553378 >> v2:172.21.15.103:3300/0 conn(0x7fd4ac0b6350 0x7fd4ac0b2290 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd4ac0ba430 tx=0x7fd4a40021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.918+0000 7fd4b27b0700 1 --2- 172.21.15.103:0/2351553378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4ac0b6350 0x7fd4ac0b2290 secure :-1 s=READY pgs=825 cs=0 l=1 rx=0x7fd4ac0ba430 tx=0x7fd4a40021b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:42.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.918+0000 7fd4b27b0700 1 --2- 172.21.15.103:0/2351553378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4ac0b6350 0x7fd4ac0b2290 secure :-1 s=THROTTLE_DONE pgs=825 cs=0 l=1 rx=0x7fd4ac0ba430 tx=0x7fd4a40021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.918+0000 7fd4b27b0700 1 --2- 172.21.15.103:0/2351553378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4ac0b6350 0x7fd4ac0b2290 secure :-1 s=THROTTLE_DONE pgs=825 cs=0 l=1 rx=0x7fd4ac0ba430 tx=0x7fd4a40021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.918+0000 7fd4a97fa700 1 -- 172.21.15.103:0/2351553378 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4a40101e0 con 0x7fd4ac0b6350 2020-04-22T14:10:42.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.918+0000 7fd4b27b0700 1 --2- 172.21.15.103:0/2351553378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4ac0b6350 0x7fd4ac0b2290 secure :-1 s=THROTTLE_DONE pgs=825 cs=0 l=1 rx=0x7fd4ac0ba430 tx=0x7fd4a40021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.918+0000 7fd4a97fa700 1 -- 172.21.15.103:0/2351553378 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a4010340 con 0x7fd4ac0b6350 2020-04-22T14:10:42.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.918+0000 7fd4b154e700 1 -- 172.21.15.103:0/2351553378 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4ac0aeb90 con 0x7fd4ac0b6350 2020-04-22T14:10:42.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.918+0000 7fd4a97fa700 1 -- 172.21.15.103:0/2351553378 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4a4010760 con 0x7fd4ac0b6350 2020-04-22T14:10:42.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.918+0000 7fd4b154e700 1 -- 172.21.15.103:0/2351553378 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4ac0acfa0 con 0x7fd4ac0b6350 2020-04-22T14:10:42.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.919+0000 7fd4b27b0700 1 --2- 172.21.15.103:0/2351553378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4ac0b6350 0x7fd4ac0b2290 secure :-1 s=THROTTLE_DONE pgs=825 cs=0 l=1 rx=0x7fd4ac0ba430 tx=0x7fd4a40021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.919+0000 7fd4b154e700 1 -- 172.21.15.103:0/2351553378 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4ac056c90 con 0x7fd4ac0b6350 2020-04-22T14:10:42.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.919+0000 7fd4a97fa700 1 -- 172.21.15.103:0/2351553378 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fd4a4006860 con 0x7fd4ac0b6350 2020-04-22T14:10:42.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.919+0000 7fd4b27b0700 1 --2- 172.21.15.103:0/2351553378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4ac0b6350 0x7fd4ac0b2290 secure :-1 s=THROTTLE_DONE pgs=825 cs=0 l=1 rx=0x7fd4ac0ba430 tx=0x7fd4a40021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.920+0000 7fd4a97fa700 1 --2- 172.21.15.103:0/2351553378 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd48c04d9d0 0x7fd48c04fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:42.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.920+0000 7fd4a97fa700 1 -- 172.21.15.103:0/2351553378 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd4a4061620 con 0x7fd4ac0b6350 2020-04-22T14:10:42.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.920+0000 7fd4b0d4d700 1 --2- 172.21.15.103:0/2351553378 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd48c04d9d0 0x7fd48c04fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:42.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.920+0000 7fd4b0d4d700 1 --2- 172.21.15.103:0/2351553378 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd48c04d9d0 0x7fd48c04fe90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd49c000b80 tx=0x7fd49c001800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.920+0000 7fd4b0d4d700 1 --2- 172.21.15.103:0/2351553378 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd48c04d9d0 0x7fd48c04fe90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd49c000b80 tx=0x7fd49c001800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.920+0000 7fd4b0d4d700 1 --2- 172.21.15.103:0/2351553378 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd48c04d9d0 0x7fd48c04fe90 secure :-1 s=READY pgs=312 cs=0 l=1 rx=0x7fd49c000b80 tx=0x7fd49c001800).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:42.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.924+0000 7fd4b27b0700 1 --2- 172.21.15.103:0/2351553378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4ac0b6350 0x7fd4ac0b2290 secure :-1 s=THROTTLE_DONE pgs=825 cs=0 l=1 rx=0x7fd4ac0ba430 tx=0x7fd4a40021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:42.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:42.924+0000 7fd4a97fa700 1 -- 172.21.15.103:0/2351553378 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fd4a403cac0 con 0x7fd4ac0b6350 2020-04-22T14:10:43.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.113+0000 7fd4b154e700 1 -- 172.21.15.103:0/2351553378 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fd4ac06a8b0 con 0x7fd4ac0b6350 2020-04-22T14:10:43.120 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.117+0000 7fd4b27b0700 1 --2- 172.21.15.103:0/2351553378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4ac0b6350 0x7fd4ac0b2290 secure :-1 s=THROTTLE_DONE pgs=825 cs=0 l=1 rx=0x7fd4ac0ba430 tx=0x7fd4a40021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:43.120 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.117+0000 7fd4a97fa700 1 -- 172.21.15.103:0/2351553378 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v28) v1 ==== 184+0+0 (secure 0 0 0) 0x7fd4a40400e0 con 0x7fd4ac0b6350 2020-04-22T14:10:43.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.119+0000 7fd4b154e700 1 -- 172.21.15.103:0/2351553378 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd48c04d9d0 msgr2=0x7fd48c04fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:43.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.119+0000 7fd4b154e700 1 --2- 172.21.15.103:0/2351553378 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd48c04d9d0 0x7fd48c04fe90 secure :-1 s=READY pgs=312 cs=0 l=1 rx=0x7fd49c000b80 tx=0x7fd49c001800).stop 2020-04-22T14:10:43.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.119+0000 7fd4b154e700 1 -- 172.21.15.103:0/2351553378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4ac0b6350 msgr2=0x7fd4ac0b2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:43.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.119+0000 7fd4b154e700 1 --2- 172.21.15.103:0/2351553378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4ac0b6350 0x7fd4ac0b2290 secure :-1 s=READY pgs=825 cs=0 l=1 rx=0x7fd4ac0ba430 tx=0x7fd4a40021b0).stop 2020-04-22T14:10:43.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.119+0000 7fd4b154e700 1 -- 172.21.15.103:0/2351553378 shutdown_connections 2020-04-22T14:10:43.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.119+0000 7fd4b154e700 1 --2- 172.21.15.103:0/2351553378 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd48c04d9d0 0x7fd48c04fe90 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:43.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.119+0000 7fd4b154e700 1 --2- 172.21.15.103:0/2351553378 >> v2:172.21.15.86:3300/0 conn(0x7fd4ac0633c0 0x7fd4ac05b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:43.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.119+0000 7fd4b154e700 1 --2- 172.21.15.103:0/2351553378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4ac0b6350 0x7fd4ac0b2290 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:43.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.119+0000 7fd4b154e700 1 --2- 172.21.15.103:0/2351553378 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4ac0666e0 0x7fd4ac120630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:43.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.119+0000 7fd4b154e700 1 -- 172.21.15.103:0/2351553378 >> 172.21.15.103:0/2351553378 conn(0x7fd4ac060930 msgr2=0x7fd4ac0b98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:43.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.119+0000 7fd4b154e700 1 -- 172.21.15.103:0/2351553378 shutdown_connections 2020-04-22T14:10:43.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.119+0000 7fd4b154e700 1 -- 172.21.15.103:0/2351553378 wait complete. 2020-04-22T14:10:43.124 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.3 2020-04-22T14:10:43.132 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:43.145 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:10:43.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.289+0000 7f61a5835700 1 Processor -- start 2020-04-22T14:10:43.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.289+0000 7f61a5835700 1 -- start start 2020-04-22T14:10:43.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.290+0000 7f61a5835700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f61a0065fe0 0x7f61a01464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:43.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.290+0000 7f61a5835700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f61a0063e30 0x7f61a00642a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:43.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.290+0000 7f61a5835700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61a0143300 con 0x7f61a012c0d0 2020-04-22T14:10:43.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.290+0000 7f61a5835700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61a01435a0 con 0x7f61a0063e30 2020-04-22T14:10:43.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.290+0000 7f61a5835700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a0143840 con 0x7f61a0065fe0 2020-04-22T14:10:43.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.290+0000 7f619effd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f61a012c0d0 0x7f61a005b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43510/0 (socket says 172.21.15.103:43510) 2020-04-22T14:10:43.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.290+0000 7f619effd700 1 -- 172.21.15.103:0/186628119 learned_addr learned my addr 172.21.15.103:0/186628119 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:43.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.290+0000 7f619f7fe700 1 --2- 172.21.15.103:0/186628119 >> v2:172.21.15.86:3300/0 conn(0x7f61a0063e30 0x7f61a00642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:43.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.290+0000 7f619e7fc700 1 --2- 172.21.15.103:0/186628119 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f61a0065fe0 0x7f61a01464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:43.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.290+0000 7f619dffb700 1 -- 172.21.15.103:0/186628119 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1982660907 0 0) 0x7f61a0143300 con 0x7f61a012c0d0 2020-04-22T14:10:43.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.290+0000 7f619dffb700 1 -- 172.21.15.103:0/186628119 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6184003230 con 0x7f61a012c0d0 2020-04-22T14:10:43.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.291+0000 7f619dffb700 1 -- 172.21.15.103:0/186628119 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1926502844 0 0) 0x7f6184003230 con 0x7f61a012c0d0 2020-04-22T14:10:43.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.291+0000 7f619dffb700 1 -- 172.21.15.103:0/186628119 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f61a0065fe0 msgr2=0x7f61a01464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:43.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.291+0000 7f619dffb700 1 --2- 172.21.15.103:0/186628119 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f61a0065fe0 0x7f61a01464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:43.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.291+0000 7f619dffb700 1 -- 172.21.15.103:0/186628119 >> v2:172.21.15.86:3300/0 conn(0x7f61a0063e30 msgr2=0x7f61a00642a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:43.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.291+0000 7f619dffb700 1 --2- 172.21.15.103:0/186628119 >> v2:172.21.15.86:3300/0 conn(0x7f61a0063e30 0x7f61a00642a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:43.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.291+0000 7f619dffb700 1 -- 172.21.15.103:0/186628119 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a005bb50 con 0x7f61a012c0d0 2020-04-22T14:10:43.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.291+0000 7f619dffb700 1 -- 172.21.15.103:0/186628119 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f61940016d0 con 0x7f61a012c0d0 2020-04-22T14:10:43.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.291+0000 7f619dffb700 1 -- 172.21.15.103:0/186628119 >> v1:172.21.15.103:6789/0 conn(0x7f61a012c0d0 legacy=0x7f61a005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:43.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.291+0000 7f619dffb700 1 --2- 172.21.15.103:0/186628119 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6184003720 0x7f6184003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:43.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.291+0000 7f619dffb700 1 --2- 172.21.15.103:0/186628119 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f61a0065fe0 0x7f61840044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:43.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.291+0000 7f619dffb700 1 --2- 172.21.15.103:0/186628119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6184004930 0x7f6184004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:43.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.291+0000 7f619dffb700 1 -- 172.21.15.103:0/186628119 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a01435a0 con 0x7f6184003720 2020-04-22T14:10:43.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.291+0000 7f619dffb700 1 -- 172.21.15.103:0/186628119 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a0143840 con 0x7f6184004930 2020-04-22T14:10:43.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.291+0000 7f619dffb700 1 -- 172.21.15.103:0/186628119 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61840040f0 con 0x7f61a0065fe0 2020-04-22T14:10:43.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.291+0000 7f619f7fe700 1 --2- 172.21.15.103:0/186628119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6184004930 0x7f6184004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:43.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.291+0000 7f619effd700 1 --2- 172.21.15.103:0/186628119 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6184003720 0x7f6184003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:43.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.291+0000 7f619e7fc700 1 --2- 172.21.15.103:0/186628119 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f61a0065fe0 0x7f61840044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:43.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.291+0000 7f619f7fe700 1 -- 172.21.15.103:0/186628119 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f61a0065fe0 msgr2=0x7f61840044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:43.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.291+0000 7f619f7fe700 1 --2- 172.21.15.103:0/186628119 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f61a0065fe0 0x7f61840044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:43.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.291+0000 7f619f7fe700 1 -- 172.21.15.103:0/186628119 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6184003720 msgr2=0x7f6184003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:43.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.291+0000 7f619f7fe700 1 --2- 172.21.15.103:0/186628119 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6184003720 0x7f6184003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:43.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.291+0000 7f619f7fe700 1 -- 172.21.15.103:0/186628119 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6184003230 con 0x7f6184004930 2020-04-22T14:10:43.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.291+0000 7f619f7fe700 1 --2- 172.21.15.103:0/186628119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6184004930 0x7f6184004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f61980032b0 tx=0x7f61980103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:43.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.291+0000 7f619f7fe700 1 --2- 172.21.15.103:0/186628119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6184004930 0x7f6184004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f61980032b0 tx=0x7f61980103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:43.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.291+0000 7f619f7fe700 1 --2- 172.21.15.103:0/186628119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6184004930 0x7f6184004db0 secure :-1 s=READY pgs=827 cs=0 l=1 rx=0x7f61980032b0 tx=0x7f61980103a0).ready entity=mon.1 client_cookie=c1d2ebe875b3405d server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:43.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.291+0000 7f619f7fe700 1 --2- 172.21.15.103:0/186628119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6184004930 0x7f6184004db0 secure :-1 s=THROTTLE_DONE pgs=827 cs=0 l=1 rx=0x7f61980032b0 tx=0x7f61980103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:43.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.291+0000 7f619dffb700 1 -- 172.21.15.103:0/186628119 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61980112c0 con 0x7f6184004930 2020-04-22T14:10:43.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.291+0000 7f619f7fe700 1 --2- 172.21.15.103:0/186628119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6184004930 0x7f6184004db0 secure :-1 s=THROTTLE_DONE pgs=827 cs=0 l=1 rx=0x7f61980032b0 tx=0x7f61980103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:43.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.291+0000 7f619dffb700 1 -- 172.21.15.103:0/186628119 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6198011420 con 0x7f6184004930 2020-04-22T14:10:43.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.291+0000 7f619f7fe700 1 --2- 172.21.15.103:0/186628119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6184004930 0x7f6184004db0 secure :-1 s=THROTTLE_DONE pgs=827 cs=0 l=1 rx=0x7f61980032b0 tx=0x7f61980103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:43.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.291+0000 7f619dffb700 1 -- 172.21.15.103:0/186628119 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6198011800 con 0x7f6184004930 2020-04-22T14:10:43.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.291+0000 7f61a5835700 1 -- 172.21.15.103:0/186628119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6184004930 msgr2=0x7f6184004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:43.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.291+0000 7f61a5835700 1 --2- 172.21.15.103:0/186628119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6184004930 0x7f6184004db0 secure :-1 s=READY pgs=827 cs=0 l=1 rx=0x7f61980032b0 tx=0x7f61980103a0).stop 2020-04-22T14:10:43.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.291+0000 7f619f7fe700 1 -- 172.21.15.103:0/186628119 reap_dead start 2020-04-22T14:10:43.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.292+0000 7f61a5835700 1 -- 172.21.15.103:0/186628119 shutdown_connections 2020-04-22T14:10:43.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.292+0000 7f61a5835700 1 -- 172.21.15.103:0/186628119 >> 172.21.15.103:0/186628119 conn(0x7f61a00b9160 msgr2=0x7f61a005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:43.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.292+0000 7f61a5835700 1 -- 172.21.15.103:0/186628119 shutdown_connections 2020-04-22T14:10:43.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.292+0000 7f61a5835700 1 -- 172.21.15.103:0/186628119 wait complete. 2020-04-22T14:10:43.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.293+0000 7f61a5835700 1 Processor -- start 2020-04-22T14:10:43.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.293+0000 7f61a5835700 1 -- start start 2020-04-22T14:10:43.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.294+0000 7f61a5835700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f61a00aed30 0x7f61a00b5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:43.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.294+0000 7f61a5835700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61a00af110 con 0x7f61a00afa10 2020-04-22T14:10:43.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.294+0000 7f61a5835700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61a0127bd0 con 0x7f61a00b1fd0 2020-04-22T14:10:43.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.294+0000 7f61a5835700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a0153760 con 0x7f61a00aed30 2020-04-22T14:10:43.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.294+0000 7f619e7fc700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f61a00b1fd0 0x7f61a0152c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43522/0 (socket says 172.21.15.103:43522) 2020-04-22T14:10:43.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.294+0000 7f619e7fc700 1 -- 172.21.15.103:0/2597642164 learned_addr learned my addr 172.21.15.103:0/2597642164 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:43.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.294+0000 7f619effd700 1 --2- 172.21.15.103:0/2597642164 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f61a00aed30 0x7f61a00b5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:43.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.294+0000 7f618ffff700 1 -- 172.21.15.103:0/2597642164 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 667664018 0 0) 0x7f61a0127bd0 con 0x7f61a00b1fd0 2020-04-22T14:10:43.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.294+0000 7f618ffff700 1 -- 172.21.15.103:0/2597642164 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f617c002fe0 con 0x7f61a00b1fd0 2020-04-22T14:10:43.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.294+0000 7f618ffff700 1 -- 172.21.15.103:0/2597642164 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 769787253 0 0) 0x7f617c002fe0 con 0x7f61a00b1fd0 2020-04-22T14:10:43.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.294+0000 7f618ffff700 1 -- 172.21.15.103:0/2597642164 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f61a0127bd0 con 0x7f61a00b1fd0 2020-04-22T14:10:43.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.294+0000 7f618ffff700 1 -- 172.21.15.103:0/2597642164 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f6190001490 con 0x7f61a00b1fd0 2020-04-22T14:10:43.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.294+0000 7f618ffff700 1 -- 172.21.15.103:0/2597642164 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f61a00aed30 msgr2=0x7f61a00b5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:43.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.294+0000 7f618ffff700 1 --2- 172.21.15.103:0/2597642164 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f61a00aed30 0x7f61a00b5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:43.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.294+0000 7f618ffff700 1 -- 172.21.15.103:0/2597642164 >> v1:172.21.15.103:6789/0 conn(0x7f61a00b1fd0 legacy=0x7f61a0152c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:43.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.294+0000 7f618ffff700 1 -- 172.21.15.103:0/2597642164 >> v1:172.21.15.86:6789/0 conn(0x7f61a00afa10 legacy=0x7f61a014f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:43.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.294+0000 7f618ffff700 1 --2- 172.21.15.103:0/2597642164 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f61a00aed30 0x7f617c0049b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:43.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.294+0000 7f618ffff700 1 --2- 172.21.15.103:0/2597642164 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f617c004e10 0x7f617c003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:43.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.294+0000 7f618ffff700 1 --2- 172.21.15.103:0/2597642164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f617c003d80 0x7f617c004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:43.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.294+0000 7f618ffff700 1 -- 172.21.15.103:0/2597642164 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a0153760 con 0x7f617c003d80 2020-04-22T14:10:43.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.294+0000 7f618ffff700 1 -- 172.21.15.103:0/2597642164 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617c0047b0 con 0x7f617c004e10 2020-04-22T14:10:43.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.294+0000 7f618ffff700 1 -- 172.21.15.103:0/2597642164 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f617c005340 con 0x7f61a00aed30 2020-04-22T14:10:43.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.294+0000 7f619e7fc700 1 --2- 172.21.15.103:0/2597642164 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f617c004e10 0x7f617c003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:43.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.294+0000 7f619effd700 1 --2- 172.21.15.103:0/2597642164 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f61a00aed30 0x7f617c0049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:43.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.294+0000 7f619f7fe700 1 --2- 172.21.15.103:0/2597642164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f617c003d80 0x7f617c004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:43.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.295+0000 7f619e7fc700 1 -- 172.21.15.103:0/2597642164 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f61a00aed30 msgr2=0x7f617c0049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:43.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.295+0000 7f619e7fc700 1 --2- 172.21.15.103:0/2597642164 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f61a00aed30 0x7f617c0049b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:43.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.295+0000 7f619e7fc700 1 -- 172.21.15.103:0/2597642164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f617c003d80 msgr2=0x7f617c004200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:43.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.295+0000 7f619e7fc700 1 --2- 172.21.15.103:0/2597642164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f617c003d80 0x7f617c004200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:43.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.295+0000 7f619e7fc700 1 -- 172.21.15.103:0/2597642164 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a0153a00 con 0x7f617c004e10 2020-04-22T14:10:43.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.295+0000 7f61a5835700 1 -- 172.21.15.103:0/2597642164 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61a00b1b30 con 0x7f617c004e10 2020-04-22T14:10:43.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.295+0000 7f619e7fc700 1 --2- 172.21.15.103:0/2597642164 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f617c004e10 0x7f617c003920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6190007970 tx=0x7f619000d090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:43.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.295+0000 7f61a5835700 1 -- 172.21.15.103:0/2597642164 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61a00b5d40 con 0x7f617c004e10 2020-04-22T14:10:43.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.295+0000 7f619e7fc700 1 --2- 172.21.15.103:0/2597642164 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f617c004e10 0x7f617c003920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6190007970 tx=0x7f619000d090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:43.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.295+0000 7f619e7fc700 1 --2- 172.21.15.103:0/2597642164 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f617c004e10 0x7f617c003920 secure :-1 s=READY pgs=829 cs=0 l=1 rx=0x7f6190007970 tx=0x7f619000d090).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:43.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.295+0000 7f619e7fc700 1 --2- 172.21.15.103:0/2597642164 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f617c004e10 0x7f617c003920 secure :-1 s=THROTTLE_DONE pgs=829 cs=0 l=1 rx=0x7f6190007970 tx=0x7f619000d090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:43.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.295+0000 7f619e7fc700 1 --2- 172.21.15.103:0/2597642164 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f617c004e10 0x7f617c003920 secure :-1 s=THROTTLE_DONE pgs=829 cs=0 l=1 rx=0x7f6190007970 tx=0x7f619000d090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:43.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.295+0000 7f618ffff700 1 -- 172.21.15.103:0/2597642164 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6190011e40 con 0x7f617c004e10 2020-04-22T14:10:43.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.295+0000 7f619e7fc700 1 --2- 172.21.15.103:0/2597642164 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f617c004e10 0x7f617c003920 secure :-1 s=THROTTLE_DONE pgs=829 cs=0 l=1 rx=0x7f6190007970 tx=0x7f619000d090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:43.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.295+0000 7f618ffff700 1 -- 172.21.15.103:0/2597642164 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6190005aa0 con 0x7f617c004e10 2020-04-22T14:10:43.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.295+0000 7f618ffff700 1 -- 172.21.15.103:0/2597642164 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6190005e40 con 0x7f617c004e10 2020-04-22T14:10:43.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.296+0000 7f619e7fc700 1 --2- 172.21.15.103:0/2597642164 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f617c004e10 0x7f617c003920 secure :-1 s=THROTTLE_DONE pgs=829 cs=0 l=1 rx=0x7f6190007970 tx=0x7f619000d090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:43.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.296+0000 7f61a5835700 1 -- 172.21.15.103:0/2597642164 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6180003340 con 0x7f617c004e10 2020-04-22T14:10:43.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.296+0000 7f618ffff700 1 -- 172.21.15.103:0/2597642164 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f619000f1f0 con 0x7f617c004e10 2020-04-22T14:10:43.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.296+0000 7f619e7fc700 1 --2- 172.21.15.103:0/2597642164 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f617c004e10 0x7f617c003920 secure :-1 s=THROTTLE_DONE pgs=829 cs=0 l=1 rx=0x7f6190007970 tx=0x7f619000d090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:43.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.296+0000 7f618ffff700 1 --2- 172.21.15.103:0/2597642164 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f617c055b10 0x7f617c057fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:43.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.296+0000 7f618ffff700 1 -- 172.21.15.103:0/2597642164 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f61900619e0 con 0x7f617c004e10 2020-04-22T14:10:43.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.296+0000 7f619effd700 1 --2- 172.21.15.103:0/2597642164 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f617c055b10 0x7f617c057fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:43.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.297+0000 7f619effd700 1 --2- 172.21.15.103:0/2597642164 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f617c055b10 0x7f617c057fd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f61940013e0 tx=0x7f61a005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:43.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.297+0000 7f619effd700 1 --2- 172.21.15.103:0/2597642164 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f617c055b10 0x7f617c057fd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f61940013e0 tx=0x7f61a005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:43.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.297+0000 7f619effd700 1 --2- 172.21.15.103:0/2597642164 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f617c055b10 0x7f617c057fd0 secure :-1 s=READY pgs=313 cs=0 l=1 rx=0x7f61940013e0 tx=0x7f61a005bce0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:43.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.300+0000 7f619e7fc700 1 --2- 172.21.15.103:0/2597642164 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f617c004e10 0x7f617c003920 secure :-1 s=THROTTLE_DONE pgs=829 cs=0 l=1 rx=0x7f6190007970 tx=0x7f619000d090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:43.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.300+0000 7f618ffff700 1 -- 172.21.15.103:0/2597642164 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f619003cdc0 con 0x7f617c004e10 2020-04-22T14:10:43.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.489+0000 7f61a5835700 1 -- 172.21.15.103:0/2597642164 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61800036e0 con 0x7f617c004e10 2020-04-22T14:10:43.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.489+0000 7f619e7fc700 1 --2- 172.21.15.103:0/2597642164 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f617c004e10 0x7f617c003920 secure :-1 s=THROTTLE_DONE pgs=829 cs=0 l=1 rx=0x7f6190007970 tx=0x7f619000d090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:43.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.489+0000 7f618ffff700 1 -- 172.21.15.103:0/2597642164 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+2143 (secure 0 0 0) 0x7f61900403e0 con 0x7f617c004e10 2020-04-22T14:10:43.496 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:10:43.496 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5096,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1960145218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1960145218},{"type":"v1","addr":"172.21.15.86:6835","nonce":1960145218}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:10:40.825749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6289},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6289":{"gid":6289,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/2152235919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2152235919},{"type":"v1","addr":"172.21.15.103:6833","nonce":2152235919}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:10:43.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.490+0000 7f61a5835700 1 -- 172.21.15.103:0/2597642164 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f617c055b10 msgr2=0x7f617c057fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:43.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.490+0000 7f61a5835700 1 --2- 172.21.15.103:0/2597642164 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f617c055b10 0x7f617c057fd0 secure :-1 s=READY pgs=313 cs=0 l=1 rx=0x7f61940013e0 tx=0x7f61a005bce0).stop 2020-04-22T14:10:43.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.490+0000 7f61a5835700 1 -- 172.21.15.103:0/2597642164 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f617c004e10 msgr2=0x7f617c003920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:43.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.490+0000 7f61a5835700 1 --2- 172.21.15.103:0/2597642164 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f617c004e10 0x7f617c003920 secure :-1 s=READY pgs=829 cs=0 l=1 rx=0x7f6190007970 tx=0x7f619000d090).stop 2020-04-22T14:10:43.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.490+0000 7f619f7fe700 1 -- 172.21.15.103:0/2597642164 reap_dead start 2020-04-22T14:10:43.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.490+0000 7f619f7fe700 1 -- 172.21.15.103:0/2597642164 reap_dead start 2020-04-22T14:10:43.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.490+0000 7f61a5835700 1 -- 172.21.15.103:0/2597642164 shutdown_connections 2020-04-22T14:10:43.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.491+0000 7f61a5835700 1 -- 172.21.15.103:0/2597642164 >> 172.21.15.103:0/2597642164 conn(0x7f61a00b9160 msgr2=0x7f61a0061df0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:43.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.491+0000 7f61a5835700 1 -- 172.21.15.103:0/2597642164 shutdown_connections 2020-04-22T14:10:43.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:43.491+0000 7f61a5835700 1 -- 172.21.15.103:0/2597642164 wait complete. 2020-04-22T14:10:43.499 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 36 2020-04-22T14:10:43.706 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 6289}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 11, u'failed': [], u'epoch': 36, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [12], u'info': {u'gid_6289': {u'export_targets': [], u'name': u'a', u'incarnation': 33, u'state_seq': 3, u'state': u'up:active', u'gid': 6289, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 2152235919, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 2152235919, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/2152235919'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:10:38.817638+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:10:40.825749+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:10:43.707 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:10:43.707 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:43.722 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:10:43.881 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:10:43.882 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:10:43.882 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:10:43.882 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 6289, 2020-04-22T14:10:43.882 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:10:43.882 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:10:43.882 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 5.0604482329999998, 2020-04-22T14:10:43.882 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 36, 2020-04-22T14:10:43.883 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 64, 2020-04-22T14:10:43.883 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 64, 2020-04-22T14:10:43.883 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 10.278893812 2020-04-22T14:10:43.883 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:10:43.890 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 6289, "want_state": "up:active", "state": "up:active", "rank_uptime": 5.0604482329999998, "mdsmap_epoch": 36, "osdmap_epoch": 64, "osdmap_epoch_barrier": 64, "uptime": 10.278893812 } 2020-04-22T14:10:43.890 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:43.904 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:10:44.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.047+0000 7ff34ae5f700 1 Processor -- start 2020-04-22T14:10:44.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.047+0000 7ff34ae5f700 1 -- start start 2020-04-22T14:10:44.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.048+0000 7ff34ae5f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3441464e0 0x7ff344064540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:44.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.048+0000 7ff34ae5f700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff344143300 con 0x7ff344065fe0 2020-04-22T14:10:44.070 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.048+0000 7ff34ae5f700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3441435a0 con 0x7ff34412c0d0 2020-04-22T14:10:44.070 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.048+0000 7ff34ae5f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff344143840 con 0x7ff3441464e0 2020-04-22T14:10:44.070 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.048+0000 7ff348bfb700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff34412c0d0 0x7ff34405b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43534/0 (socket says 172.21.15.103:43534) 2020-04-22T14:10:44.070 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.048+0000 7ff348bfb700 1 -- 172.21.15.103:0/1333322080 learned_addr learned my addr 172.21.15.103:0/1333322080 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:44.070 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.049+0000 7ff3437fe700 1 -- 172.21.15.103:0/1333322080 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3460050855 0 0) 0x7ff3441435a0 con 0x7ff34412c0d0 2020-04-22T14:10:44.070 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.049+0000 7ff3493fc700 1 --2- 172.21.15.103:0/1333322080 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3441464e0 0x7ff344064540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:44.070 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.049+0000 7ff3437fe700 1 -- 172.21.15.103:0/1333322080 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff330003230 con 0x7ff34412c0d0 2020-04-22T14:10:44.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.049+0000 7ff3437fe700 1 -- 172.21.15.103:0/1333322080 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 194315405 0 0) 0x7ff330003230 con 0x7ff34412c0d0 2020-04-22T14:10:44.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.049+0000 7ff3437fe700 1 -- 172.21.15.103:0/1333322080 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3441464e0 msgr2=0x7ff344064540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:44.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.049+0000 7ff3437fe700 1 --2- 172.21.15.103:0/1333322080 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3441464e0 0x7ff344064540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:44.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.049+0000 7ff3437fe700 1 -- 172.21.15.103:0/1333322080 >> v1:172.21.15.86:6789/0 conn(0x7ff344065fe0 legacy=0x7ff344063e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:44.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.049+0000 7ff3437fe700 1 -- 172.21.15.103:0/1333322080 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff34405bb50 con 0x7ff34412c0d0 2020-04-22T14:10:44.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.049+0000 7ff3437fe700 1 -- 172.21.15.103:0/1333322080 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7ff3340016d0 con 0x7ff34412c0d0 2020-04-22T14:10:44.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.049+0000 7ff3437fe700 1 -- 172.21.15.103:0/1333322080 >> v1:172.21.15.103:6789/0 conn(0x7ff34412c0d0 legacy=0x7ff34405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:44.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.049+0000 7ff3437fe700 1 --2- 172.21.15.103:0/1333322080 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3441464e0 0x7ff330003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:44.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.049+0000 7ff3437fe700 1 --2- 172.21.15.103:0/1333322080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff330003bb0 0x7ff330004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:44.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.049+0000 7ff3437fe700 1 --2- 172.21.15.103:0/1333322080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3300045e0 0x7ff330004a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:44.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.049+0000 7ff3437fe700 1 -- 172.21.15.103:0/1333322080 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff344143840 con 0x7ff330003bb0 2020-04-22T14:10:44.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.049+0000 7ff3437fe700 1 -- 172.21.15.103:0/1333322080 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff330005010 con 0x7ff3300045e0 2020-04-22T14:10:44.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.049+0000 7ff3437fe700 1 -- 172.21.15.103:0/1333322080 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3300051d0 con 0x7ff3441464e0 2020-04-22T14:10:44.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.049+0000 7ff3493fc700 1 --2- 172.21.15.103:0/1333322080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3300045e0 0x7ff330004a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:44.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.049+0000 7ff348bfb700 1 --2- 172.21.15.103:0/1333322080 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3441464e0 0x7ff330003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:44.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.049+0000 7ff343fff700 1 --2- 172.21.15.103:0/1333322080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff330003bb0 0x7ff330004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:44.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.049+0000 7ff3493fc700 1 -- 172.21.15.103:0/1333322080 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3441464e0 msgr2=0x7ff330003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:44.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.049+0000 7ff3493fc700 1 --2- 172.21.15.103:0/1333322080 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3441464e0 0x7ff330003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:44.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.049+0000 7ff3493fc700 1 -- 172.21.15.103:0/1333322080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff330003bb0 msgr2=0x7ff330004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:44.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.049+0000 7ff3493fc700 1 --2- 172.21.15.103:0/1333322080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff330003bb0 0x7ff330004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:44.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.049+0000 7ff3493fc700 1 -- 172.21.15.103:0/1333322080 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff330003230 con 0x7ff3300045e0 2020-04-22T14:10:44.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.049+0000 7ff3493fc700 1 --2- 172.21.15.103:0/1333322080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3300045e0 0x7ff330004a60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff33c0032b0 tx=0x7ff33c0103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.049+0000 7ff3493fc700 1 --2- 172.21.15.103:0/1333322080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3300045e0 0x7ff330004a60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff33c0032b0 tx=0x7ff33c0103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.049+0000 7ff3493fc700 1 --2- 172.21.15.103:0/1333322080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3300045e0 0x7ff330004a60 secure :-1 s=READY pgs=831 cs=0 l=1 rx=0x7ff33c0032b0 tx=0x7ff33c0103a0).ready entity=mon.1 client_cookie=78097ea58e8f0fb6 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:44.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.050+0000 7ff3493fc700 1 --2- 172.21.15.103:0/1333322080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3300045e0 0x7ff330004a60 secure :-1 s=THROTTLE_DONE pgs=831 cs=0 l=1 rx=0x7ff33c0032b0 tx=0x7ff33c0103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.050+0000 7ff3437fe700 1 -- 172.21.15.103:0/1333322080 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff33c005a40 con 0x7ff3300045e0 2020-04-22T14:10:44.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.050+0000 7ff3493fc700 1 --2- 172.21.15.103:0/1333322080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3300045e0 0x7ff330004a60 secure :-1 s=THROTTLE_DONE pgs=831 cs=0 l=1 rx=0x7ff33c0032b0 tx=0x7ff33c0103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.050+0000 7ff3437fe700 1 -- 172.21.15.103:0/1333322080 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33c005ba0 con 0x7ff3300045e0 2020-04-22T14:10:44.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.050+0000 7ff3493fc700 1 --2- 172.21.15.103:0/1333322080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3300045e0 0x7ff330004a60 secure :-1 s=THROTTLE_DONE pgs=831 cs=0 l=1 rx=0x7ff33c0032b0 tx=0x7ff33c0103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.050+0000 7ff3437fe700 1 -- 172.21.15.103:0/1333322080 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff33c0110d0 con 0x7ff3300045e0 2020-04-22T14:10:44.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.050+0000 7ff34ae5f700 1 -- 172.21.15.103:0/1333322080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3300045e0 msgr2=0x7ff330004a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:44.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.050+0000 7ff34ae5f700 1 --2- 172.21.15.103:0/1333322080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3300045e0 0x7ff330004a60 secure :-1 s=READY pgs=831 cs=0 l=1 rx=0x7ff33c0032b0 tx=0x7ff33c0103a0).stop 2020-04-22T14:10:44.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.050+0000 7ff3493fc700 1 -- 172.21.15.103:0/1333322080 reap_dead start 2020-04-22T14:10:44.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.050+0000 7ff34ae5f700 1 -- 172.21.15.103:0/1333322080 shutdown_connections 2020-04-22T14:10:44.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.050+0000 7ff34ae5f700 1 -- 172.21.15.103:0/1333322080 >> 172.21.15.103:0/1333322080 conn(0x7ff3440b9160 msgr2=0x7ff34405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:44.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.050+0000 7ff34ae5f700 1 -- 172.21.15.103:0/1333322080 shutdown_connections 2020-04-22T14:10:44.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.050+0000 7ff34ae5f700 1 -- 172.21.15.103:0/1333322080 wait complete. 2020-04-22T14:10:44.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.051+0000 7ff34ae5f700 1 Processor -- start 2020-04-22T14:10:44.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.051+0000 7ff34ae5f700 1 -- start start 2020-04-22T14:10:44.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.052+0000 7ff34ae5f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff344127fb0 0x7ff344150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:44.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.052+0000 7ff34ae5f700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff344151480 con 0x7ff3440afba0 2020-04-22T14:10:44.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.052+0000 7ff34ae5f700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff344151720 con 0x7ff344145970 2020-04-22T14:10:44.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.052+0000 7ff34ae5f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3441519c0 con 0x7ff344127fb0 2020-04-22T14:10:44.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.052+0000 7ff348bfb700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff344127fb0 0x7ff344150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:44.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.052+0000 7ff343fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff344145970 0x7ff344126d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43548/0 (socket says 172.21.15.103:43548) 2020-04-22T14:10:44.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.052+0000 7ff343fff700 1 -- 172.21.15.103:0/2871059429 learned_addr learned my addr 172.21.15.103:0/2871059429 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:44.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.052+0000 7ff348bfb700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff344127fb0 0x7ff344150f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51356/0 (socket says 172.21.15.103:51356) 2020-04-22T14:10:44.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.052+0000 7ff348bfb700 1 -- 172.21.15.103:0/2871059429 >> v1:172.21.15.103:6789/0 conn(0x7ff344145970 legacy=0x7ff344126d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:44.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.052+0000 7ff348bfb700 1 -- 172.21.15.103:0/2871059429 >> v1:172.21.15.86:6789/0 conn(0x7ff3440afba0 legacy=0x7ff3440b0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:44.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.052+0000 7ff341ffb700 1 -- 172.21.15.103:0/2871059429 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3412214271 0 0) 0x7ff344151720 con 0x7ff344145970 2020-04-22T14:10:44.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.052+0000 7ff348bfb700 1 -- 172.21.15.103:0/2871059429 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff344128390 con 0x7ff344127fb0 2020-04-22T14:10:44.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.052+0000 7ff348bfb700 1 --2- 172.21.15.103:0/2871059429 >> v2:172.21.15.103:3300/0 conn(0x7ff344127fb0 0x7ff344150f40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff344145730 tx=0x7ff34405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.052+0000 7ff348bfb700 1 --2- 172.21.15.103:0/2871059429 >> v2:172.21.15.103:3300/0 conn(0x7ff344127fb0 0x7ff344150f40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff344145730 tx=0x7ff34405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.052+0000 7ff348bfb700 1 --2- 172.21.15.103:0/2871059429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff344127fb0 0x7ff344150f40 secure :-1 s=READY pgs=833 cs=0 l=1 rx=0x7ff344145730 tx=0x7ff34405bce0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:44.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.053+0000 7ff348bfb700 1 --2- 172.21.15.103:0/2871059429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff344127fb0 0x7ff344150f40 secure :-1 s=THROTTLE_DONE pgs=833 cs=0 l=1 rx=0x7ff344145730 tx=0x7ff34405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.053+0000 7ff341ffb700 1 -- 172.21.15.103:0/2871059429 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff33400e180 con 0x7ff344127fb0 2020-04-22T14:10:44.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.053+0000 7ff348bfb700 1 --2- 172.21.15.103:0/2871059429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff344127fb0 0x7ff344150f40 secure :-1 s=THROTTLE_DONE pgs=833 cs=0 l=1 rx=0x7ff344145730 tx=0x7ff34405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.053+0000 7ff348bfb700 1 --2- 172.21.15.103:0/2871059429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff344127fb0 0x7ff344150f40 secure :-1 s=THROTTLE_DONE pgs=833 cs=0 l=1 rx=0x7ff344145730 tx=0x7ff34405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.053+0000 7ff341ffb700 1 -- 172.21.15.103:0/2871059429 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33400e2e0 con 0x7ff344127fb0 2020-04-22T14:10:44.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.053+0000 7ff34ae5f700 1 -- 172.21.15.103:0/2871059429 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff344155300 con 0x7ff344127fb0 2020-04-22T14:10:44.080 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.053+0000 7ff341ffb700 1 -- 172.21.15.103:0/2871059429 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff33400e640 con 0x7ff344127fb0 2020-04-22T14:10:44.080 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.053+0000 7ff34ae5f700 1 -- 172.21.15.103:0/2871059429 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff344127650 con 0x7ff344127fb0 2020-04-22T14:10:44.080 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.053+0000 7ff348bfb700 1 --2- 172.21.15.103:0/2871059429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff344127fb0 0x7ff344150f40 secure :-1 s=THROTTLE_DONE pgs=833 cs=0 l=1 rx=0x7ff344145730 tx=0x7ff34405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.080 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.054+0000 7ff34ae5f700 1 -- 172.21.15.103:0/2871059429 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff344056c90 con 0x7ff344127fb0 2020-04-22T14:10:44.080 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.054+0000 7ff341ffb700 1 -- 172.21.15.103:0/2871059429 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ff334007280 con 0x7ff344127fb0 2020-04-22T14:10:44.080 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.054+0000 7ff348bfb700 1 --2- 172.21.15.103:0/2871059429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff344127fb0 0x7ff344150f40 secure :-1 s=THROTTLE_DONE pgs=833 cs=0 l=1 rx=0x7ff344145730 tx=0x7ff34405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.080 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.054+0000 7ff341ffb700 1 --2- 172.21.15.103:0/2871059429 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff32404d880 0x7ff32404fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:44.081 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.054+0000 7ff341ffb700 1 -- 172.21.15.103:0/2871059429 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff334061200 con 0x7ff344127fb0 2020-04-22T14:10:44.081 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.054+0000 7ff343fff700 1 --2- 172.21.15.103:0/2871059429 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff32404d880 0x7ff32404fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:44.081 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.054+0000 7ff343fff700 1 --2- 172.21.15.103:0/2871059429 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff32404d880 0x7ff32404fd40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff338000fa0 tx=0x7ff338003e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.081 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.054+0000 7ff343fff700 1 --2- 172.21.15.103:0/2871059429 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff32404d880 0x7ff32404fd40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff338000fa0 tx=0x7ff338003e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.081 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.054+0000 7ff343fff700 1 --2- 172.21.15.103:0/2871059429 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff32404d880 0x7ff32404fd40 secure :-1 s=READY pgs=314 cs=0 l=1 rx=0x7ff338000fa0 tx=0x7ff338003e30).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:44.081 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.058+0000 7ff348bfb700 1 --2- 172.21.15.103:0/2871059429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff344127fb0 0x7ff344150f40 secure :-1 s=THROTTLE_DONE pgs=833 cs=0 l=1 rx=0x7ff344145730 tx=0x7ff34405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.081 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.058+0000 7ff341ffb700 1 -- 172.21.15.103:0/2871059429 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ff33403c640 con 0x7ff344127fb0 2020-04-22T14:10:44.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.200+0000 7ff34ae5f700 1 -- 172.21.15.103:0/2871059429 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff344146ef0 con 0x7ff344127fb0 2020-04-22T14:10:44.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.201+0000 7ff348bfb700 1 --2- 172.21.15.103:0/2871059429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff344127fb0 0x7ff344150f40 secure :-1 s=THROTTLE_DONE pgs=833 cs=0 l=1 rx=0x7ff344145730 tx=0x7ff34405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.201+0000 7ff341ffb700 1 -- 172.21.15.103:0/2871059429 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16092 (secure 0 0 0) 0x7ff33403fc60 con 0x7ff344127fb0 2020-04-22T14:10:44.204 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:10:44.205 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":64,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:10:39.819711+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:10:36.758101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2020-04-22T14:10:37.765010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:10:44.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.202+0000 7ff34ae5f700 1 -- 172.21.15.103:0/2871059429 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff32404d880 msgr2=0x7ff32404fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:44.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.202+0000 7ff34ae5f700 1 --2- 172.21.15.103:0/2871059429 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff32404d880 0x7ff32404fd40 secure :-1 s=READY pgs=314 cs=0 l=1 rx=0x7ff338000fa0 tx=0x7ff338003e30).stop 2020-04-22T14:10:44.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.202+0000 7ff34ae5f700 1 -- 172.21.15.103:0/2871059429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff344127fb0 msgr2=0x7ff344150f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:44.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.202+0000 7ff34ae5f700 1 --2- 172.21.15.103:0/2871059429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff344127fb0 0x7ff344150f40 secure :-1 s=READY pgs=833 cs=0 l=1 rx=0x7ff344145730 tx=0x7ff34405bce0).stop 2020-04-22T14:10:44.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.202+0000 7ff34ae5f700 1 -- 172.21.15.103:0/2871059429 shutdown_connections 2020-04-22T14:10:44.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.202+0000 7ff34ae5f700 1 --2- 172.21.15.103:0/2871059429 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff32404d880 0x7ff32404fd40 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:44.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.202+0000 7ff34ae5f700 1 --2- 172.21.15.103:0/2871059429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff344127fb0 0x7ff344150f40 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:44.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.202+0000 7ff34ae5f700 1 -- 172.21.15.103:0/2871059429 >> 172.21.15.103:0/2871059429 conn(0x7ff3440b9160 msgr2=0x7ff344141de0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:44.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.202+0000 7ff34ae5f700 1 -- 172.21.15.103:0/2871059429 shutdown_connections 2020-04-22T14:10:44.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.202+0000 7ff34ae5f700 1 -- 172.21.15.103:0/2871059429 wait complete. 2020-04-22T14:10:44.221 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:10:36.758101+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 11, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'63', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:10:37.765010+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 12, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'64', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:10:44.221 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:44.235 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:10:44.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.381+0000 7f7989108700 1 Processor -- start 2020-04-22T14:10:44.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.381+0000 7f7989108700 1 -- start start 2020-04-22T14:10:44.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.382+0000 7f7989108700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f79840ac950 0x7f7984146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:44.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.382+0000 7f7989108700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f79841470a0 0x7f7984143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:44.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.382+0000 7f7989108700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79841467e0 con 0x7f79840b9140 2020-04-22T14:10:44.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.382+0000 7f7989108700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7984147530 con 0x7f79840ac950 2020-04-22T14:10:44.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.382+0000 7f7989108700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79840602f0 con 0x7f79841470a0 2020-04-22T14:10:44.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.382+0000 7f798359e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f79841470a0 0x7f7984143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:44.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.382+0000 7f798359e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f79841470a0 0x7f7984143090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51364/0 (socket says 172.21.15.103:51364) 2020-04-22T14:10:44.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.382+0000 7f798359e700 1 -- 172.21.15.103:0/2233249080 learned_addr learned my addr 172.21.15.103:0/2233249080 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:10:44.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.383+0000 7f798259c700 1 --2- 172.21.15.103:0/2233249080 >> v2:172.21.15.86:3300/0 conn(0x7f79840ac950 0x7f7984146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:44.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.383+0000 7f798359e700 1 -- 172.21.15.103:0/2233249080 >> v2:172.21.15.86:3300/0 conn(0x7f79840ac950 msgr2=0x7f7984146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:44.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.383+0000 7f798359e700 1 --2- 172.21.15.103:0/2233249080 >> v2:172.21.15.86:3300/0 conn(0x7f79840ac950 0x7f7984146c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:44.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.383+0000 7f798359e700 1 -- 172.21.15.103:0/2233249080 >> v1:172.21.15.86:6789/0 conn(0x7f79840b9140 legacy=0x7f798412b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:44.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.383+0000 7f798359e700 1 -- 172.21.15.103:0/2233249080 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7984060050 con 0x7f79841470a0 2020-04-22T14:10:44.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.383+0000 7f798359e700 1 --2- 172.21.15.103:0/2233249080 >> v2:172.21.15.103:3300/0 conn(0x7f79841470a0 0x7f7984143090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f79840b6250 tx=0x7f797c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.383+0000 7f798359e700 1 --2- 172.21.15.103:0/2233249080 >> v2:172.21.15.103:3300/0 conn(0x7f79841470a0 0x7f7984143090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f79840b6250 tx=0x7f797c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.383+0000 7f798359e700 1 --2- 172.21.15.103:0/2233249080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79841470a0 0x7f7984143090 secure :-1 s=READY pgs=834 cs=0 l=1 rx=0x7f79840b6250 tx=0x7f797c007dc0).ready entity=mon.1 client_cookie=ae5af7ae730ca3fa server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:44.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.383+0000 7f798359e700 1 --2- 172.21.15.103:0/2233249080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79841470a0 0x7f7984143090 secure :-1 s=THROTTLE_DONE pgs=834 cs=0 l=1 rx=0x7f79840b6250 tx=0x7f797c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.383+0000 7f798359e700 1 --2- 172.21.15.103:0/2233249080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79841470a0 0x7f7984143090 secure :-1 s=THROTTLE_DONE pgs=834 cs=0 l=1 rx=0x7f79840b6250 tx=0x7f797c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.383+0000 7f7981d9b700 1 -- 172.21.15.103:0/2233249080 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f797c00a180 con 0x7f79841470a0 2020-04-22T14:10:44.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.383+0000 7f798359e700 1 --2- 172.21.15.103:0/2233249080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79841470a0 0x7f7984143090 secure :-1 s=THROTTLE_DONE pgs=834 cs=0 l=1 rx=0x7f79840b6250 tx=0x7f797c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.383+0000 7f7981d9b700 1 -- 172.21.15.103:0/2233249080 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797c00a2e0 con 0x7f79841470a0 2020-04-22T14:10:44.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.383+0000 7f7981d9b700 1 -- 172.21.15.103:0/2233249080 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f797c00a6c0 con 0x7f79841470a0 2020-04-22T14:10:44.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.383+0000 7f7989108700 1 -- 172.21.15.103:0/2233249080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79841470a0 msgr2=0x7f7984143090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:44.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.383+0000 7f7989108700 1 --2- 172.21.15.103:0/2233249080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79841470a0 0x7f7984143090 secure :-1 s=READY pgs=834 cs=0 l=1 rx=0x7f79840b6250 tx=0x7f797c007dc0).stop 2020-04-22T14:10:44.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.383+0000 7f7989108700 1 -- 172.21.15.103:0/2233249080 shutdown_connections 2020-04-22T14:10:44.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.383+0000 7f7989108700 1 --2- 172.21.15.103:0/2233249080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79841470a0 0x7f7984143090 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:44.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.383+0000 7f7989108700 1 --2- 172.21.15.103:0/2233249080 >> v2:172.21.15.86:3300/0 conn(0x7f79840ac950 0x7f7984146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:44.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.383+0000 7f7989108700 1 -- 172.21.15.103:0/2233249080 >> 172.21.15.103:0/2233249080 conn(0x7f798405b7b0 msgr2=0x7f79840b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:44.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.383+0000 7f7989108700 1 -- 172.21.15.103:0/2233249080 shutdown_connections 2020-04-22T14:10:44.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.383+0000 7f7989108700 1 -- 172.21.15.103:0/2233249080 wait complete. 2020-04-22T14:10:44.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.384+0000 7f7989108700 1 Processor -- start 2020-04-22T14:10:44.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.384+0000 7f7989108700 1 -- start start 2020-04-22T14:10:44.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.385+0000 7f7989108700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f79840ac950 0x7f79840b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:44.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.385+0000 7f7989108700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7984142970 con 0x7f79840b9140 2020-04-22T14:10:44.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.385+0000 7f7989108700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7984142bd0 con 0x7f79841470a0 2020-04-22T14:10:44.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.385+0000 7f7989108700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79840b1630 con 0x7f79840ac950 2020-04-22T14:10:44.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.385+0000 7f798359e700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f79841470a0 0x7f7984143070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43564/0 (socket says 172.21.15.103:43564) 2020-04-22T14:10:44.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.385+0000 7f798359e700 1 -- 172.21.15.103:0/2890786096 learned_addr learned my addr 172.21.15.103:0/2890786096 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:44.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.385+0000 7f797bfff700 1 -- 172.21.15.103:0/2890786096 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 71907403 0 0) 0x7f7984142bd0 con 0x7f79841470a0 2020-04-22T14:10:44.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.385+0000 7f797bfff700 1 -- 172.21.15.103:0/2890786096 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7968002fe0 con 0x7f79841470a0 2020-04-22T14:10:44.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.385+0000 7f7982d9d700 1 --2- 172.21.15.103:0/2890786096 >> v2:172.21.15.86:3300/0 conn(0x7f79840ac950 0x7f79840b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:44.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.386+0000 7f797bfff700 1 -- 172.21.15.103:0/2890786096 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3226552767 0 0) 0x7f7968002fe0 con 0x7f79841470a0 2020-04-22T14:10:44.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.386+0000 7f797bfff700 1 -- 172.21.15.103:0/2890786096 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7984142bd0 con 0x7f79841470a0 2020-04-22T14:10:44.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.386+0000 7f797bfff700 1 -- 172.21.15.103:0/2890786096 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f797c0089e0 con 0x7f79841470a0 2020-04-22T14:10:44.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.386+0000 7f797bfff700 1 -- 172.21.15.103:0/2890786096 >> v2:172.21.15.86:3300/0 conn(0x7f79840ac950 msgr2=0x7f79840b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:44.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.386+0000 7f797bfff700 1 --2- 172.21.15.103:0/2890786096 >> v2:172.21.15.86:3300/0 conn(0x7f79840ac950 0x7f79840b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:44.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.386+0000 7f797bfff700 1 -- 172.21.15.103:0/2890786096 >> v1:172.21.15.103:6789/0 conn(0x7f79841470a0 legacy=0x7f7984143070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:44.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.386+0000 7f797bfff700 1 -- 172.21.15.103:0/2890786096 >> v1:172.21.15.86:6789/0 conn(0x7f79840b9140 legacy=0x7f7984126de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:44.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.386+0000 7f797bfff700 1 --2- 172.21.15.103:0/2890786096 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79680049b0 0x7f7968004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:44.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.386+0000 7f797bfff700 1 --2- 172.21.15.103:0/2890786096 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7968003920 0x7f7968003d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:44.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.386+0000 7f797bfff700 1 --2- 172.21.15.103:0/2890786096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79680041c0 0x7f796800b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:44.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.386+0000 7f797bfff700 1 -- 172.21.15.103:0/2890786096 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79840b1630 con 0x7f79680049b0 2020-04-22T14:10:44.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.386+0000 7f797bfff700 1 -- 172.21.15.103:0/2890786096 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7968004760 con 0x7f79680041c0 2020-04-22T14:10:44.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.386+0000 7f797bfff700 1 -- 172.21.15.103:0/2890786096 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f796800bbb0 con 0x7f7968003920 2020-04-22T14:10:44.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.386+0000 7f798359e700 1 --2- 172.21.15.103:0/2890786096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79680041c0 0x7f796800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:44.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.386+0000 7f7982d9d700 1 --2- 172.21.15.103:0/2890786096 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79680049b0 0x7f7968004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:44.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.386+0000 7f798259c700 1 --2- 172.21.15.103:0/2890786096 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7968003920 0x7f7968003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:44.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.386+0000 7f798359e700 1 -- 172.21.15.103:0/2890786096 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7968003920 msgr2=0x7f7968003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:44.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.386+0000 7f798359e700 1 --2- 172.21.15.103:0/2890786096 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7968003920 0x7f7968003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:44.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.386+0000 7f798359e700 1 -- 172.21.15.103:0/2890786096 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79680049b0 msgr2=0x7f7968004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:44.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.386+0000 7f798359e700 1 --2- 172.21.15.103:0/2890786096 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79680049b0 0x7f7968004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:44.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.386+0000 7f798359e700 1 -- 172.21.15.103:0/2890786096 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79840b2360 con 0x7f79680041c0 2020-04-22T14:10:44.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.386+0000 7f7989108700 1 -- 172.21.15.103:0/2890786096 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79841274f0 con 0x7f79680041c0 2020-04-22T14:10:44.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.386+0000 7f798359e700 1 --2- 172.21.15.103:0/2890786096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79680041c0 0x7f796800b750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f797c007e20 tx=0x7f797c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.386+0000 7f7989108700 1 -- 172.21.15.103:0/2890786096 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79840b13d0 con 0x7f79680041c0 2020-04-22T14:10:44.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.386+0000 7f798359e700 1 -- 172.21.15.103:0/2890786096 reap_dead start 2020-04-22T14:10:44.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.386+0000 7f798359e700 1 --2- 172.21.15.103:0/2890786096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79680041c0 0x7f796800b750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f797c007e20 tx=0x7f797c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.386+0000 7f798359e700 1 --2- 172.21.15.103:0/2890786096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79680041c0 0x7f796800b750 secure :-1 s=READY pgs=836 cs=0 l=1 rx=0x7f797c007e20 tx=0x7f797c007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:44.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.386+0000 7f798359e700 1 --2- 172.21.15.103:0/2890786096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79680041c0 0x7f796800b750 secure :-1 s=THROTTLE_DONE pgs=836 cs=0 l=1 rx=0x7f797c007e20 tx=0x7f797c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.386+0000 7f797bfff700 1 -- 172.21.15.103:0/2890786096 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f797c00a730 con 0x7f79680041c0 2020-04-22T14:10:44.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.386+0000 7f798359e700 1 --2- 172.21.15.103:0/2890786096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79680041c0 0x7f796800b750 secure :-1 s=THROTTLE_DONE pgs=836 cs=0 l=1 rx=0x7f797c007e20 tx=0x7f797c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.386+0000 7f798359e700 1 --2- 172.21.15.103:0/2890786096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79680041c0 0x7f796800b750 secure :-1 s=THROTTLE_DONE pgs=836 cs=0 l=1 rx=0x7f797c007e20 tx=0x7f797c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.386+0000 7f797bfff700 1 -- 172.21.15.103:0/2890786096 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797c005e20 con 0x7f79680041c0 2020-04-22T14:10:44.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.386+0000 7f797bfff700 1 -- 172.21.15.103:0/2890786096 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f797c007360 con 0x7f79680041c0 2020-04-22T14:10:44.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.387+0000 7f798359e700 1 --2- 172.21.15.103:0/2890786096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79680041c0 0x7f796800b750 secure :-1 s=THROTTLE_DONE pgs=836 cs=0 l=1 rx=0x7f797c007e20 tx=0x7f797c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.408 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.387+0000 7f7989108700 1 -- 172.21.15.103:0/2890786096 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f795c003340 con 0x7f79680041c0 2020-04-22T14:10:44.408 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.387+0000 7f797bfff700 1 -- 172.21.15.103:0/2890786096 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f797c0074c0 con 0x7f79680041c0 2020-04-22T14:10:44.408 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.387+0000 7f798359e700 1 --2- 172.21.15.103:0/2890786096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79680041c0 0x7f796800b750 secure :-1 s=THROTTLE_DONE pgs=836 cs=0 l=1 rx=0x7f797c007e20 tx=0x7f797c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.408 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.388+0000 7f797bfff700 1 --2- 172.21.15.103:0/2890786096 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7968051820 0x7f7968053ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:44.408 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.388+0000 7f797bfff700 1 -- 172.21.15.103:0/2890786096 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f797c062880 con 0x7f79680041c0 2020-04-22T14:10:44.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.388+0000 7f7982d9d700 1 --2- 172.21.15.103:0/2890786096 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7968051820 0x7f7968053ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:44.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.388+0000 7f7982d9d700 1 --2- 172.21.15.103:0/2890786096 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7968051820 0x7f7968053ce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f796c002f40 tx=0x7f796c007c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.388+0000 7f7982d9d700 1 --2- 172.21.15.103:0/2890786096 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7968051820 0x7f7968053ce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f796c002f40 tx=0x7f796c007c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.388+0000 7f7982d9d700 1 --2- 172.21.15.103:0/2890786096 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7968051820 0x7f7968053ce0 secure :-1 s=READY pgs=315 cs=0 l=1 rx=0x7f796c002f40 tx=0x7f796c007c70).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:44.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.391+0000 7f798359e700 1 --2- 172.21.15.103:0/2890786096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79680041c0 0x7f796800b750 secure :-1 s=THROTTLE_DONE pgs=836 cs=0 l=1 rx=0x7f797c007e20 tx=0x7f797c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.392+0000 7f797bfff700 1 -- 172.21.15.103:0/2890786096 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f797c03dd80 con 0x7f79680041c0 2020-04-22T14:10:44.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.533+0000 7f7989108700 1 -- 172.21.15.103:0/2890786096 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f795c002220 con 0x7f79680041c0 2020-04-22T14:10:44.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.534+0000 7f798359e700 1 --2- 172.21.15.103:0/2890786096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79680041c0 0x7f796800b750 secure :-1 s=THROTTLE_DONE pgs=836 cs=0 l=1 rx=0x7f797c007e20 tx=0x7f797c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.534+0000 7f797bfff700 1 -- 172.21.15.103:0/2890786096 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v64) v1 ==== 110+0+10 (secure 0 0 0) 0x7f797c0413a0 con 0x7f79680041c0 2020-04-22T14:10:44.538 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:10:44.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.535+0000 7f7989108700 1 -- 172.21.15.103:0/2890786096 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7968051820 msgr2=0x7f7968053ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:44.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.535+0000 7f7989108700 1 --2- 172.21.15.103:0/2890786096 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7968051820 0x7f7968053ce0 secure :-1 s=READY pgs=315 cs=0 l=1 rx=0x7f796c002f40 tx=0x7f796c007c70).stop 2020-04-22T14:10:44.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.535+0000 7f7989108700 1 -- 172.21.15.103:0/2890786096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79680041c0 msgr2=0x7f796800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:44.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.535+0000 7f7989108700 1 --2- 172.21.15.103:0/2890786096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79680041c0 0x7f796800b750 secure :-1 s=READY pgs=836 cs=0 l=1 rx=0x7f797c007e20 tx=0x7f797c007dc0).stop 2020-04-22T14:10:44.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.535+0000 7f7989108700 1 -- 172.21.15.103:0/2890786096 shutdown_connections 2020-04-22T14:10:44.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.535+0000 7f7989108700 1 --2- 172.21.15.103:0/2890786096 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7968051820 0x7f7968053ce0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:44.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.535+0000 7f7989108700 1 --2- 172.21.15.103:0/2890786096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79680041c0 0x7f796800b750 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:44.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.535+0000 7f7989108700 1 -- 172.21.15.103:0/2890786096 >> 172.21.15.103:0/2890786096 conn(0x7f798405b7b0 msgr2=0x7f79841278c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:44.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.535+0000 7f7989108700 1 -- 172.21.15.103:0/2890786096 shutdown_connections 2020-04-22T14:10:44.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.535+0000 7f7989108700 1 -- 172.21.15.103:0/2890786096 wait complete. 2020-04-22T14:10:44.549 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:44.563 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:10:44.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.708+0000 7fbc04a28700 1 Processor -- start 2020-04-22T14:10:44.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.708+0000 7fbc04a28700 1 -- start start 2020-04-22T14:10:44.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.709+0000 7fbc04a28700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbc00143090 0x7fbc00143520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:44.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.709+0000 7fbc04a28700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc001467e0 con 0x7fbc000b9140 2020-04-22T14:10:44.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.709+0000 7fbc04a28700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc00060050 con 0x7fbc000ac950 2020-04-22T14:10:44.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.709+0000 7fbc04a28700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc000602f0 con 0x7fbc00143090 2020-04-22T14:10:44.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.709+0000 7fbbfdd9b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fbc000ac950 0x7fbc00146c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43576/0 (socket says 172.21.15.103:43576) 2020-04-22T14:10:44.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.709+0000 7fbbfdd9b700 1 -- 172.21.15.103:0/1378298354 learned_addr learned my addr 172.21.15.103:0/1378298354 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:44.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.709+0000 7fbbfd59a700 1 -- 172.21.15.103:0/1378298354 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 554335132 0 0) 0x7fbc00060050 con 0x7fbc000ac950 2020-04-22T14:10:44.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.709+0000 7fbbfed9d700 1 --2- 172.21.15.103:0/1378298354 >> v2:172.21.15.86:3300/0 conn(0x7fbc00143090 0x7fbc00143520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:44.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.709+0000 7fbbfd59a700 1 -- 172.21.15.103:0/1378298354 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbe4003230 con 0x7fbc000ac950 2020-04-22T14:10:44.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.710+0000 7fbbfd59a700 1 -- 172.21.15.103:0/1378298354 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1952702917 0 0) 0x7fbbe4003230 con 0x7fbc000ac950 2020-04-22T14:10:44.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.710+0000 7fbbfd59a700 1 -- 172.21.15.103:0/1378298354 >> v2:172.21.15.86:3300/0 conn(0x7fbc00143090 msgr2=0x7fbc00143520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:44.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.710+0000 7fbbfd59a700 1 --2- 172.21.15.103:0/1378298354 >> v2:172.21.15.86:3300/0 conn(0x7fbc00143090 0x7fbc00143520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:44.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.710+0000 7fbbfd59a700 1 -- 172.21.15.103:0/1378298354 >> v1:172.21.15.86:6789/0 conn(0x7fbc000b9140 legacy=0x7fbc0012b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:44.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.710+0000 7fbbfd59a700 1 -- 172.21.15.103:0/1378298354 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc000b9520 con 0x7fbc000ac950 2020-04-22T14:10:44.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.710+0000 7fbbfd59a700 1 -- 172.21.15.103:0/1378298354 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fbbf0001710 con 0x7fbc000ac950 2020-04-22T14:10:44.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.710+0000 7fbbfd59a700 1 -- 172.21.15.103:0/1378298354 >> v1:172.21.15.103:6789/0 conn(0x7fbc000ac950 legacy=0x7fbc00146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:44.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.710+0000 7fbbfd59a700 1 --2- 172.21.15.103:0/1378298354 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbe4003720 0x7fbbe4003b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:44.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.710+0000 7fbbfd59a700 1 --2- 172.21.15.103:0/1378298354 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbe4004090 0x7fbbe4004570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:44.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.710+0000 7fbbfd59a700 1 --2- 172.21.15.103:0/1378298354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbe4004ae0 0x7fbbe4004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:44.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.710+0000 7fbbfd59a700 1 -- 172.21.15.103:0/1378298354 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc000602f0 con 0x7fbbe4003720 2020-04-22T14:10:44.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.710+0000 7fbbfd59a700 1 -- 172.21.15.103:0/1378298354 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe400b8b0 con 0x7fbbe4004ae0 2020-04-22T14:10:44.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.710+0000 7fbbfd59a700 1 -- 172.21.15.103:0/1378298354 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe400ba70 con 0x7fbbe4004090 2020-04-22T14:10:44.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.710+0000 7fbbfed9d700 1 --2- 172.21.15.103:0/1378298354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbe4004ae0 0x7fbbe4004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:44.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.710+0000 7fbbfe59c700 1 --2- 172.21.15.103:0/1378298354 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbe4003720 0x7fbbe4003b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:44.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.710+0000 7fbbfdd9b700 1 --2- 172.21.15.103:0/1378298354 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbe4004090 0x7fbbe4004570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:44.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.710+0000 7fbbfed9d700 1 -- 172.21.15.103:0/1378298354 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbe4004090 msgr2=0x7fbbe4004570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:44.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.710+0000 7fbbfed9d700 1 --2- 172.21.15.103:0/1378298354 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbe4004090 0x7fbbe4004570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:44.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.710+0000 7fbbfed9d700 1 -- 172.21.15.103:0/1378298354 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbe4003720 msgr2=0x7fbbe4003b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:44.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.710+0000 7fbbfed9d700 1 --2- 172.21.15.103:0/1378298354 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbe4003720 0x7fbbe4003b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:44.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.710+0000 7fbbfed9d700 1 -- 172.21.15.103:0/1378298354 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe4003230 con 0x7fbbe4004ae0 2020-04-22T14:10:44.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.710+0000 7fbbfed9d700 1 --2- 172.21.15.103:0/1378298354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbe4004ae0 0x7fbbe4004f90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbbf80032b0 tx=0x7fbbf8010350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.710+0000 7fbbfed9d700 1 -- 172.21.15.103:0/1378298354 reap_dead start 2020-04-22T14:10:44.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.710+0000 7fbbfed9d700 1 --2- 172.21.15.103:0/1378298354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbe4004ae0 0x7fbbe4004f90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbbf80032b0 tx=0x7fbbf8010350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.710+0000 7fbbfed9d700 1 --2- 172.21.15.103:0/1378298354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbe4004ae0 0x7fbbe4004f90 secure :-1 s=READY pgs=838 cs=0 l=1 rx=0x7fbbf80032b0 tx=0x7fbbf8010350).ready entity=mon.1 client_cookie=627865d692ebe0c1 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:44.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.710+0000 7fbbfed9d700 1 --2- 172.21.15.103:0/1378298354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbe4004ae0 0x7fbbe4004f90 secure :-1 s=THROTTLE_DONE pgs=838 cs=0 l=1 rx=0x7fbbf80032b0 tx=0x7fbbf8010350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.710+0000 7fbbfed9d700 1 --2- 172.21.15.103:0/1378298354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbe4004ae0 0x7fbbe4004f90 secure :-1 s=THROTTLE_DONE pgs=838 cs=0 l=1 rx=0x7fbbf80032b0 tx=0x7fbbf8010350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.710+0000 7fbbfd59a700 1 -- 172.21.15.103:0/1378298354 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbf8005a40 con 0x7fbbe4004ae0 2020-04-22T14:10:44.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.710+0000 7fbbfed9d700 1 --2- 172.21.15.103:0/1378298354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbe4004ae0 0x7fbbe4004f90 secure :-1 s=THROTTLE_DONE pgs=838 cs=0 l=1 rx=0x7fbbf80032b0 tx=0x7fbbf8010350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.710+0000 7fbbfd59a700 1 -- 172.21.15.103:0/1378298354 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf8005ba0 con 0x7fbbe4004ae0 2020-04-22T14:10:44.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.710+0000 7fbbfd59a700 1 -- 172.21.15.103:0/1378298354 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbf80110d0 con 0x7fbbe4004ae0 2020-04-22T14:10:44.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.710+0000 7fbc04a28700 1 -- 172.21.15.103:0/1378298354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbe4004ae0 msgr2=0x7fbbe4004f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:44.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.710+0000 7fbc04a28700 1 --2- 172.21.15.103:0/1378298354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbe4004ae0 0x7fbbe4004f90 secure :-1 s=READY pgs=838 cs=0 l=1 rx=0x7fbbf80032b0 tx=0x7fbbf8010350).stop 2020-04-22T14:10:44.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.711+0000 7fbc04a28700 1 -- 172.21.15.103:0/1378298354 shutdown_connections 2020-04-22T14:10:44.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.711+0000 7fbc04a28700 1 --2- 172.21.15.103:0/1378298354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbe4004ae0 0x7fbbe4004f90 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:44.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.711+0000 7fbc04a28700 1 -- 172.21.15.103:0/1378298354 >> 172.21.15.103:0/1378298354 conn(0x7fbc0005b7b0 msgr2=0x7fbc000b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:44.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.711+0000 7fbc04a28700 1 -- 172.21.15.103:0/1378298354 shutdown_connections 2020-04-22T14:10:44.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.711+0000 7fbc04a28700 1 -- 172.21.15.103:0/1378298354 wait complete. 2020-04-22T14:10:44.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.712+0000 7fbc04a28700 1 Processor -- start 2020-04-22T14:10:44.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.712+0000 7fbc04a28700 1 -- start start 2020-04-22T14:10:44.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.713+0000 7fbc04a28700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbe4004ae0 0x7fbc00142b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:44.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.713+0000 7fbc04a28700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc00128660 con 0x7fbc00127d40 2020-04-22T14:10:44.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.713+0000 7fbc04a28700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc001283c0 con 0x7fbc001267e0 2020-04-22T14:10:44.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.713+0000 7fbc04a28700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc001281a0 con 0x7fbbe4004ae0 2020-04-22T14:10:44.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.713+0000 7fbbfed9d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fbc001267e0 0x7fbc00126c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43590/0 (socket says 172.21.15.103:43590) 2020-04-22T14:10:44.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.713+0000 7fbbfed9d700 1 -- 172.21.15.103:0/642099217 learned_addr learned my addr 172.21.15.103:0/642099217 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:44.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.713+0000 7fbbfe59c700 1 --2- 172.21.15.103:0/642099217 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbe4004ae0 0x7fbc00142b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:44.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.713+0000 7fbbef7fe700 1 -- 172.21.15.103:0/642099217 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3444679130 0 0) 0x7fbc001283c0 con 0x7fbc001267e0 2020-04-22T14:10:44.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.713+0000 7fbbef7fe700 1 -- 172.21.15.103:0/642099217 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbdc002fe0 con 0x7fbc001267e0 2020-04-22T14:10:44.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.713+0000 7fbbef7fe700 1 -- 172.21.15.103:0/642099217 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1425127377 0 0) 0x7fbc00128660 con 0x7fbc00127d40 2020-04-22T14:10:44.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.713+0000 7fbbef7fe700 1 -- 172.21.15.103:0/642099217 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc001283c0 con 0x7fbc00127d40 2020-04-22T14:10:44.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.713+0000 7fbbef7fe700 1 -- 172.21.15.103:0/642099217 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3677644815 0 0) 0x7fbbdc002fe0 con 0x7fbc001267e0 2020-04-22T14:10:44.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.713+0000 7fbbef7fe700 1 -- 172.21.15.103:0/642099217 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbc00128660 con 0x7fbc001267e0 2020-04-22T14:10:44.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.713+0000 7fbbef7fe700 1 -- 172.21.15.103:0/642099217 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fbbf8010dc0 con 0x7fbc001267e0 2020-04-22T14:10:44.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.713+0000 7fbbef7fe700 1 -- 172.21.15.103:0/642099217 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbe4004ae0 msgr2=0x7fbc00142b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:44.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.713+0000 7fbbef7fe700 1 --2- 172.21.15.103:0/642099217 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbe4004ae0 0x7fbc00142b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:44.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.713+0000 7fbbef7fe700 1 -- 172.21.15.103:0/642099217 >> v1:172.21.15.103:6789/0 conn(0x7fbc001267e0 legacy=0x7fbc00126c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:44.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.713+0000 7fbbef7fe700 1 -- 172.21.15.103:0/642099217 >> v1:172.21.15.86:6789/0 conn(0x7fbc00127d40 legacy=0x7fbc00139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:44.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.713+0000 7fbbef7fe700 1 --2- 172.21.15.103:0/642099217 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbdc004b20 0x7fbbdc004f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:44.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.713+0000 7fbbef7fe700 1 --2- 172.21.15.103:0/642099217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbdc003ab0 0x7fbbdc003f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:44.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.713+0000 7fbbef7fe700 1 --2- 172.21.15.103:0/642099217 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbe4004ae0 0x7fbbdc004370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:44.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.713+0000 7fbbef7fe700 1 -- 172.21.15.103:0/642099217 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc001281a0 con 0x7fbbdc004b20 2020-04-22T14:10:44.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.713+0000 7fbbef7fe700 1 -- 172.21.15.103:0/642099217 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc0047d0 con 0x7fbbdc003ab0 2020-04-22T14:10:44.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.713+0000 7fbbef7fe700 1 -- 172.21.15.103:0/642099217 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc00b750 con 0x7fbbe4004ae0 2020-04-22T14:10:44.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.713+0000 7fbbfdd9b700 1 --2- 172.21.15.103:0/642099217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbdc003ab0 0x7fbbdc003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:44.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.713+0000 7fbbfe59c700 1 --2- 172.21.15.103:0/642099217 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbdc004b20 0x7fbbdc004f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:44.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.713+0000 7fbbfed9d700 1 --2- 172.21.15.103:0/642099217 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbe4004ae0 0x7fbbdc004370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:44.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.713+0000 7fbbfdd9b700 1 -- 172.21.15.103:0/642099217 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbe4004ae0 msgr2=0x7fbbdc004370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:44.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.713+0000 7fbbfdd9b700 1 --2- 172.21.15.103:0/642099217 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbe4004ae0 0x7fbbdc004370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:44.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.713+0000 7fbbfdd9b700 1 -- 172.21.15.103:0/642099217 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbdc004b20 msgr2=0x7fbbdc004f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:44.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.714+0000 7fbbfdd9b700 1 --2- 172.21.15.103:0/642099217 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbdc004b20 0x7fbbdc004f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:44.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.714+0000 7fbbfdd9b700 1 -- 172.21.15.103:0/642099217 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc00143770 con 0x7fbbdc003ab0 2020-04-22T14:10:44.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.714+0000 7fbc04a28700 1 -- 172.21.15.103:0/642099217 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc00142b00 con 0x7fbbdc003ab0 2020-04-22T14:10:44.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.714+0000 7fbbfed9d700 1 --2- 172.21.15.103:0/642099217 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbe4004ae0 0x7fbbdc004370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:10:44.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.714+0000 7fbbfdd9b700 1 --2- 172.21.15.103:0/642099217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbdc003ab0 0x7fbbdc003f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbbf0000f10 tx=0x7fbc000b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.714+0000 7fbc04a28700 1 -- 172.21.15.103:0/642099217 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc00144de0 con 0x7fbbdc003ab0 2020-04-22T14:10:44.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.714+0000 7fbbfdd9b700 1 --2- 172.21.15.103:0/642099217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbdc003ab0 0x7fbbdc003f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbbf0000f10 tx=0x7fbc000b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.714+0000 7fbbfdd9b700 1 --2- 172.21.15.103:0/642099217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbdc003ab0 0x7fbbdc003f10 secure :-1 s=READY pgs=840 cs=0 l=1 rx=0x7fbbf0000f10 tx=0x7fbc000b96b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:44.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.714+0000 7fbbfdd9b700 1 --2- 172.21.15.103:0/642099217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbdc003ab0 0x7fbbdc003f10 secure :-1 s=THROTTLE_DONE pgs=840 cs=0 l=1 rx=0x7fbbf0000f10 tx=0x7fbc000b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.714+0000 7fbbfdd9b700 1 --2- 172.21.15.103:0/642099217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbdc003ab0 0x7fbbdc003f10 secure :-1 s=THROTTLE_DONE pgs=840 cs=0 l=1 rx=0x7fbbf0000f10 tx=0x7fbc000b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.714+0000 7fbbfdd9b700 1 --2- 172.21.15.103:0/642099217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbdc003ab0 0x7fbbdc003f10 secure :-1 s=THROTTLE_DONE pgs=840 cs=0 l=1 rx=0x7fbbf0000f10 tx=0x7fbc000b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.714+0000 7fbbef7fe700 1 -- 172.21.15.103:0/642099217 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbf0007470 con 0x7fbbdc003ab0 2020-04-22T14:10:44.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.714+0000 7fbbef7fe700 1 -- 172.21.15.103:0/642099217 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf000cd80 con 0x7fbbdc003ab0 2020-04-22T14:10:44.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.714+0000 7fbbef7fe700 1 -- 172.21.15.103:0/642099217 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbf000e370 con 0x7fbbdc003ab0 2020-04-22T14:10:44.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.714+0000 7fbbfdd9b700 1 --2- 172.21.15.103:0/642099217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbdc003ab0 0x7fbbdc003f10 secure :-1 s=THROTTLE_DONE pgs=840 cs=0 l=1 rx=0x7fbbf0000f10 tx=0x7fbc000b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.715+0000 7fbc04a28700 1 -- 172.21.15.103:0/642099217 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbd8003340 con 0x7fbbdc003ab0 2020-04-22T14:10:44.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.715+0000 7fbbef7fe700 1 -- 172.21.15.103:0/642099217 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fbbf000e4d0 con 0x7fbbdc003ab0 2020-04-22T14:10:44.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.715+0000 7fbbfdd9b700 1 --2- 172.21.15.103:0/642099217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbdc003ab0 0x7fbbdc003f10 secure :-1 s=THROTTLE_DONE pgs=840 cs=0 l=1 rx=0x7fbbf0000f10 tx=0x7fbc000b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.715+0000 7fbbef7fe700 1 --2- 172.21.15.103:0/642099217 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbbdc055d90 0x7fbbdc058250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:44.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.715+0000 7fbbef7fe700 1 -- 172.21.15.103:0/642099217 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbbf0061100 con 0x7fbbdc003ab0 2020-04-22T14:10:44.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.715+0000 7fbbfe59c700 1 --2- 172.21.15.103:0/642099217 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbbdc055d90 0x7fbbdc058250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:44.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.716+0000 7fbbfe59c700 1 --2- 172.21.15.103:0/642099217 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbbdc055d90 0x7fbbdc058250 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbbf4001f50 tx=0x7fbbf400ca80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.716+0000 7fbbfe59c700 1 --2- 172.21.15.103:0/642099217 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbbdc055d90 0x7fbbdc058250 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbbf4001f50 tx=0x7fbbf400ca80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.716+0000 7fbbfe59c700 1 --2- 172.21.15.103:0/642099217 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbbdc055d90 0x7fbbdc058250 secure :-1 s=READY pgs=316 cs=0 l=1 rx=0x7fbbf4001f50 tx=0x7fbbf400ca80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:44.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.719+0000 7fbbfdd9b700 1 --2- 172.21.15.103:0/642099217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbdc003ab0 0x7fbbdc003f10 secure :-1 s=THROTTLE_DONE pgs=840 cs=0 l=1 rx=0x7fbbf0000f10 tx=0x7fbc000b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.719+0000 7fbbef7fe700 1 -- 172.21.15.103:0/642099217 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fbbf00660d0 con 0x7fbbdc003ab0 2020-04-22T14:10:44.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.861+0000 7fbc04a28700 1 -- 172.21.15.103:0/642099217 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbbd8002200 con 0x7fbbdc003ab0 2020-04-22T14:10:44.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.861+0000 7fbbfdd9b700 1 --2- 172.21.15.103:0/642099217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbdc003ab0 0x7fbbdc003f10 secure :-1 s=THROTTLE_DONE pgs=840 cs=0 l=1 rx=0x7fbbf0000f10 tx=0x7fbc000b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:44.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.861+0000 7fbbef7fe700 1 -- 172.21.15.103:0/642099217 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v64) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbbf003c5a0 con 0x7fbbdc003ab0 2020-04-22T14:10:44.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.862+0000 7fbc04a28700 1 -- 172.21.15.103:0/642099217 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbbdc055d90 msgr2=0x7fbbdc058250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:44.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.862+0000 7fbc04a28700 1 --2- 172.21.15.103:0/642099217 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbbdc055d90 0x7fbbdc058250 secure :-1 s=READY pgs=316 cs=0 l=1 rx=0x7fbbf4001f50 tx=0x7fbbf400ca80).stop 2020-04-22T14:10:44.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.862+0000 7fbc04a28700 1 -- 172.21.15.103:0/642099217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbdc003ab0 msgr2=0x7fbbdc003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:44.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.862+0000 7fbc04a28700 1 --2- 172.21.15.103:0/642099217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbdc003ab0 0x7fbbdc003f10 secure :-1 s=READY pgs=840 cs=0 l=1 rx=0x7fbbf0000f10 tx=0x7fbc000b96b0).stop 2020-04-22T14:10:44.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.862+0000 7fbbfed9d700 1 -- 172.21.15.103:0/642099217 reap_dead start 2020-04-22T14:10:44.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.862+0000 7fbc04a28700 1 -- 172.21.15.103:0/642099217 shutdown_connections 2020-04-22T14:10:44.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.862+0000 7fbc04a28700 1 --2- 172.21.15.103:0/642099217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbdc003ab0 0x7fbbdc003f10 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:44.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.862+0000 7fbc04a28700 1 -- 172.21.15.103:0/642099217 >> 172.21.15.103:0/642099217 conn(0x7fbc0005b7b0 msgr2=0x7fbc000ae680 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:44.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.862+0000 7fbc04a28700 1 -- 172.21.15.103:0/642099217 shutdown_connections 2020-04-22T14:10:44.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:44.862+0000 7fbc04a28700 1 -- 172.21.15.103:0/642099217 wait complete. 2020-04-22T14:10:44.872 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:10:44.876 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:44.890 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-22T14:10:45.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.036+0000 7f19f06fc700 1 Processor -- start 2020-04-22T14:10:45.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.036+0000 7f19f06fc700 1 -- start start 2020-04-22T14:10:45.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.037+0000 7f19f06fc700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19e8061a30 0x7f19e80b4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:45.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.037+0000 7f19f06fc700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19e80af030 con 0x7f19e80acb10 2020-04-22T14:10:45.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.037+0000 7f19f06fc700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19e8060250 con 0x7f19e8141f20 2020-04-22T14:10:45.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.037+0000 7f19f06fc700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e80623c0 con 0x7f19e8061a30 2020-04-22T14:10:45.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.037+0000 7f19eec99700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f19e8141f20 0x7f19e81423b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43600/0 (socket says 172.21.15.103:43600) 2020-04-22T14:10:45.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.037+0000 7f19eec99700 1 -- 172.21.15.103:0/2666618347 learned_addr learned my addr 172.21.15.103:0/2666618347 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:45.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.037+0000 7f19ed496700 1 -- 172.21.15.103:0/2666618347 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3309605996 0 0) 0x7f19e8060250 con 0x7f19e8141f20 2020-04-22T14:10:45.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.038+0000 7f19ee498700 1 --2- 172.21.15.103:0/2666618347 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19e8061a30 0x7f19e80b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:45.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.038+0000 7f19ed496700 1 -- 172.21.15.103:0/2666618347 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19d0003230 con 0x7f19e8141f20 2020-04-22T14:10:45.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.038+0000 7f19ed496700 1 -- 172.21.15.103:0/2666618347 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3176223326 0 0) 0x7f19d0003230 con 0x7f19e8141f20 2020-04-22T14:10:45.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.038+0000 7f19ed496700 1 -- 172.21.15.103:0/2666618347 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19e8061a30 msgr2=0x7f19e80b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:45.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.038+0000 7f19ed496700 1 --2- 172.21.15.103:0/2666618347 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19e8061a30 0x7f19e80b4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:45.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.038+0000 7f19ed496700 1 -- 172.21.15.103:0/2666618347 >> v1:172.21.15.86:6789/0 conn(0x7f19e80acb10 legacy=0x7f19e80ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:45.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.038+0000 7f19ed496700 1 -- 172.21.15.103:0/2666618347 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e8062660 con 0x7f19e8141f20 2020-04-22T14:10:45.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.038+0000 7f19ed496700 1 -- 172.21.15.103:0/2666618347 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f19e0001a50 con 0x7f19e8141f20 2020-04-22T14:10:45.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.038+0000 7f19ed496700 1 -- 172.21.15.103:0/2666618347 >> v1:172.21.15.103:6789/0 conn(0x7f19e8141f20 legacy=0x7f19e81423b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:45.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.038+0000 7f19ed496700 1 --2- 172.21.15.103:0/2666618347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19d0003720 0x7f19d0003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:45.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.038+0000 7f19ed496700 1 --2- 172.21.15.103:0/2666618347 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19e8061a30 0x7f19d0003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:45.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.038+0000 7f19ed496700 1 --2- 172.21.15.103:0/2666618347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19d0004520 0x7f19d00049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:45.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.038+0000 7f19ed496700 1 -- 172.21.15.103:0/2666618347 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e80623c0 con 0x7f19d0004520 2020-04-22T14:10:45.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.038+0000 7f19ed496700 1 -- 172.21.15.103:0/2666618347 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d0004ef0 con 0x7f19d0003720 2020-04-22T14:10:45.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.038+0000 7f19ed496700 1 -- 172.21.15.103:0/2666618347 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d00050b0 con 0x7f19e8061a30 2020-04-22T14:10:45.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.038+0000 7f19ee498700 1 --2- 172.21.15.103:0/2666618347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19d0003720 0x7f19d0003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:45.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.038+0000 7f19edc97700 1 --2- 172.21.15.103:0/2666618347 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19e8061a30 0x7f19d0003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:45.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.038+0000 7f19eec99700 1 --2- 172.21.15.103:0/2666618347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19d0004520 0x7f19d00049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:45.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.038+0000 7f19ee498700 1 -- 172.21.15.103:0/2666618347 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19e8061a30 msgr2=0x7f19d0003ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:45.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.038+0000 7f19ee498700 1 --2- 172.21.15.103:0/2666618347 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19e8061a30 0x7f19d0003ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:45.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.038+0000 7f19ee498700 1 -- 172.21.15.103:0/2666618347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19d0004520 msgr2=0x7f19d00049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:45.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.038+0000 7f19ee498700 1 --2- 172.21.15.103:0/2666618347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19d0004520 0x7f19d00049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:45.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.038+0000 7f19ee498700 1 -- 172.21.15.103:0/2666618347 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d0003230 con 0x7f19d0003720 2020-04-22T14:10:45.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.038+0000 7f19ee498700 1 --2- 172.21.15.103:0/2666618347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19d0003720 0x7f19d0003b00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f19d8002f30 tx=0x7f19d8010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.038+0000 7f19ee498700 1 --2- 172.21.15.103:0/2666618347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19d0003720 0x7f19d0003b00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f19d8002f30 tx=0x7f19d8010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.038+0000 7f19ee498700 1 --2- 172.21.15.103:0/2666618347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19d0003720 0x7f19d0003b00 secure :-1 s=READY pgs=842 cs=0 l=1 rx=0x7f19d8002f30 tx=0x7f19d8010020).ready entity=mon.1 client_cookie=af3396810af04531 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:45.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.038+0000 7f19ee498700 1 --2- 172.21.15.103:0/2666618347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19d0003720 0x7f19d0003b00 secure :-1 s=THROTTLE_DONE pgs=842 cs=0 l=1 rx=0x7f19d8002f30 tx=0x7f19d8010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.038+0000 7f19ed496700 1 -- 172.21.15.103:0/2666618347 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19d8008d30 con 0x7f19d0003720 2020-04-22T14:10:45.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.038+0000 7f19ee498700 1 --2- 172.21.15.103:0/2666618347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19d0003720 0x7f19d0003b00 secure :-1 s=THROTTLE_DONE pgs=842 cs=0 l=1 rx=0x7f19d8002f30 tx=0x7f19d8010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.039+0000 7f19ee498700 1 --2- 172.21.15.103:0/2666618347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19d0003720 0x7f19d0003b00 secure :-1 s=THROTTLE_DONE pgs=842 cs=0 l=1 rx=0x7f19d8002f30 tx=0x7f19d8010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.039+0000 7f19ed496700 1 -- 172.21.15.103:0/2666618347 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d8008e90 con 0x7f19d0003720 2020-04-22T14:10:45.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.039+0000 7f19ed496700 1 -- 172.21.15.103:0/2666618347 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19d8010a90 con 0x7f19d0003720 2020-04-22T14:10:45.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.039+0000 7f19f06fc700 1 -- 172.21.15.103:0/2666618347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19d0003720 msgr2=0x7f19d0003b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:45.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.039+0000 7f19f06fc700 1 --2- 172.21.15.103:0/2666618347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19d0003720 0x7f19d0003b00 secure :-1 s=READY pgs=842 cs=0 l=1 rx=0x7f19d8002f30 tx=0x7f19d8010020).stop 2020-04-22T14:10:45.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.039+0000 7f19eec99700 1 -- 172.21.15.103:0/2666618347 reap_dead start 2020-04-22T14:10:45.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.039+0000 7f19f06fc700 1 -- 172.21.15.103:0/2666618347 shutdown_connections 2020-04-22T14:10:45.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.039+0000 7f19f06fc700 1 -- 172.21.15.103:0/2666618347 >> 172.21.15.103:0/2666618347 conn(0x7f19e805b7b0 msgr2=0x7f19e80b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:45.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.039+0000 7f19f06fc700 1 -- 172.21.15.103:0/2666618347 shutdown_connections 2020-04-22T14:10:45.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.039+0000 7f19f06fc700 1 -- 172.21.15.103:0/2666618347 wait complete. 2020-04-22T14:10:45.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.040+0000 7f19f06fc700 1 Processor -- start 2020-04-22T14:10:45.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.040+0000 7f19f06fc700 1 -- start start 2020-04-22T14:10:45.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.041+0000 7f19f06fc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f19e8141750 0x7f19e8062e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:45.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.041+0000 7f19f06fc700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19e81577a0 0x7f19e8144c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:45.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.041+0000 7f19f06fc700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19e8153920 con 0x7f19e8141370 2020-04-22T14:10:45.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.041+0000 7f19f06fc700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19e80634b0 con 0x7f19e8141750 2020-04-22T14:10:45.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.041+0000 7f19f06fc700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e8157c50 con 0x7f19e81577a0 2020-04-22T14:10:45.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.041+0000 7f19edc97700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f19e8141750 0x7f19e8062e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:45.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.041+0000 7f19eec99700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19e81577a0 0x7f19e8144c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:45.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.041+0000 7f19edc97700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f19e8141750 0x7f19e8062e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:48654/0 (socket says 172.21.15.103:48654) 2020-04-22T14:10:45.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.041+0000 7f19edc97700 1 -- 172.21.15.103:0/1929000317 learned_addr learned my addr 172.21.15.103:0/1929000317 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:10:45.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.041+0000 7f19eec99700 1 -- 172.21.15.103:0/1929000317 >> v2:172.21.15.86:3300/0 conn(0x7f19e8141750 msgr2=0x7f19e8062e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:45.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.041+0000 7f19eec99700 1 --2- 172.21.15.103:0/1929000317 >> v2:172.21.15.86:3300/0 conn(0x7f19e8141750 0x7f19e8062e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:45.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.041+0000 7f19eec99700 1 -- 172.21.15.103:0/1929000317 >> v1:172.21.15.86:6789/0 conn(0x7f19e8141370 legacy=0x7f19e8064b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:45.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.041+0000 7f19eec99700 1 -- 172.21.15.103:0/1929000317 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e8065290 con 0x7f19e81577a0 2020-04-22T14:10:45.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.041+0000 7f19d77fe700 1 -- 172.21.15.103:0/1929000317 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3132654925 0 0) 0x7f19e8153920 con 0x7f19e8141370 2020-04-22T14:10:45.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.041+0000 7f19edc97700 1 --2- 172.21.15.103:0/1929000317 >> v2:172.21.15.86:3300/0 conn(0x7f19e8141750 0x7f19e8062e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:10:45.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.041+0000 7f19eec99700 1 --2- 172.21.15.103:0/1929000317 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19e81577a0 0x7f19e8144c80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f19e0001450 tx=0x7f19e00087f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.041+0000 7f19eec99700 1 --2- 172.21.15.103:0/1929000317 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19e81577a0 0x7f19e8144c80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f19e0001450 tx=0x7f19e00087f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.041+0000 7f19eec99700 1 --2- 172.21.15.103:0/1929000317 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19e81577a0 0x7f19e8144c80 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f19e0001450 tx=0x7f19e00087f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:45.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.041+0000 7f19eec99700 1 --2- 172.21.15.103:0/1929000317 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19e81577a0 0x7f19e8144c80 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f19e0001450 tx=0x7f19e00087f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.041+0000 7f19d77fe700 1 -- 172.21.15.103:0/1929000317 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19e0004d10 con 0x7f19e81577a0 2020-04-22T14:10:45.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.042+0000 7f19eec99700 1 --2- 172.21.15.103:0/1929000317 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19e81577a0 0x7f19e8144c80 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f19e0001450 tx=0x7f19e00087f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.042+0000 7f19f06fc700 1 -- 172.21.15.103:0/1929000317 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19e8063750 con 0x7f19e81577a0 2020-04-22T14:10:45.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.042+0000 7f19d77fe700 1 -- 172.21.15.103:0/1929000317 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e0004e70 con 0x7f19e81577a0 2020-04-22T14:10:45.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.042+0000 7f19eec99700 1 --2- 172.21.15.103:0/1929000317 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19e81577a0 0x7f19e8144c80 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f19e0001450 tx=0x7f19e00087f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.042+0000 7f19d77fe700 1 -- 172.21.15.103:0/1929000317 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19e0011a70 con 0x7f19e81577a0 2020-04-22T14:10:45.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.042+0000 7f19f06fc700 1 -- 172.21.15.103:0/1929000317 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19e8145320 con 0x7f19e81577a0 2020-04-22T14:10:45.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.042+0000 7f19eec99700 1 --2- 172.21.15.103:0/1929000317 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19e81577a0 0x7f19e8144c80 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f19e0001450 tx=0x7f19e00087f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.043+0000 7f19f06fc700 1 -- 172.21.15.103:0/1929000317 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19e8145620 con 0x7f19e81577a0 2020-04-22T14:10:45.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.043+0000 7f19d77fe700 1 -- 172.21.15.103:0/1929000317 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f19e0011bd0 con 0x7f19e81577a0 2020-04-22T14:10:45.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.043+0000 7f19eec99700 1 --2- 172.21.15.103:0/1929000317 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19e81577a0 0x7f19e8144c80 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f19e0001450 tx=0x7f19e00087f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.043+0000 7f19d77fe700 1 --2- 172.21.15.103:0/1929000317 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f19c804d6d0 0x7f19c804fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:45.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.043+0000 7f19d77fe700 1 -- 172.21.15.103:0/1929000317 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f19e0061210 con 0x7f19e81577a0 2020-04-22T14:10:45.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.043+0000 7f19ee498700 1 --2- 172.21.15.103:0/1929000317 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f19c804d6d0 0x7f19c804fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:45.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.043+0000 7f19ee498700 1 --2- 172.21.15.103:0/1929000317 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f19c804d6d0 0x7f19c804fb90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f19d8007fa0 tx=0x7f19d8010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.043+0000 7f19ee498700 1 --2- 172.21.15.103:0/1929000317 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f19c804d6d0 0x7f19c804fb90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f19d8007fa0 tx=0x7f19d8010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.043+0000 7f19ee498700 1 --2- 172.21.15.103:0/1929000317 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f19c804d6d0 0x7f19c804fb90 secure :-1 s=READY pgs=317 cs=0 l=1 rx=0x7f19d8007fa0 tx=0x7f19d8010020).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:45.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.047+0000 7f19eec99700 1 --2- 172.21.15.103:0/1929000317 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19e81577a0 0x7f19e8144c80 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f19e0001450 tx=0x7f19e00087f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.047+0000 7f19d77fe700 1 -- 172.21.15.103:0/1929000317 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f19e8145620 con 0x7f19e81577a0 2020-04-22T14:10:45.192 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.189+0000 7f19f06fc700 1 -- 172.21.15.103:0/1929000317 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f19e8145620 con 0x7f19e81577a0 2020-04-22T14:10:45.193 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.190+0000 7f19eec99700 1 --2- 172.21.15.103:0/1929000317 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19e81577a0 0x7f19e8144c80 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f19e0001450 tx=0x7f19e00087f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.193 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.190+0000 7f19d77fe700 1 -- 172.21.15.103:0/1929000317 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v64) v1 ==== 104+0+10 (secure 0 0 0) 0x7f19e8145620 con 0x7f19e81577a0 2020-04-22T14:10:45.193 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:10:45.194 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.191+0000 7f19f06fc700 1 -- 172.21.15.103:0/1929000317 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f19c804d6d0 msgr2=0x7f19c804fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:45.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.191+0000 7f19f06fc700 1 --2- 172.21.15.103:0/1929000317 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f19c804d6d0 0x7f19c804fb90 secure :-1 s=READY pgs=317 cs=0 l=1 rx=0x7f19d8007fa0 tx=0x7f19d8010020).stop 2020-04-22T14:10:45.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.191+0000 7f19f06fc700 1 -- 172.21.15.103:0/1929000317 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19e81577a0 msgr2=0x7f19e8144c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:45.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.191+0000 7f19f06fc700 1 --2- 172.21.15.103:0/1929000317 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19e81577a0 0x7f19e8144c80 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f19e0001450 tx=0x7f19e00087f0).stop 2020-04-22T14:10:45.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.191+0000 7f19f06fc700 1 -- 172.21.15.103:0/1929000317 shutdown_connections 2020-04-22T14:10:45.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.191+0000 7f19f06fc700 1 --2- 172.21.15.103:0/1929000317 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19e81577a0 0x7f19e8144c80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:45.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.191+0000 7f19f06fc700 1 --2- 172.21.15.103:0/1929000317 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f19c804d6d0 0x7f19c804fb90 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:45.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.191+0000 7f19f06fc700 1 --2- 172.21.15.103:0/1929000317 >> v2:172.21.15.86:3300/0 conn(0x7f19e8141750 0x7f19e8062e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:45.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.191+0000 7f19f06fc700 1 -- 172.21.15.103:0/1929000317 >> 172.21.15.103:0/1929000317 conn(0x7f19e805b7b0 msgr2=0x7f19e80b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:45.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.191+0000 7f19f06fc700 1 -- 172.21.15.103:0/1929000317 shutdown_connections 2020-04-22T14:10:45.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.191+0000 7f19f06fc700 1 -- 172.21.15.103:0/1929000317 wait complete. 2020-04-22T14:10:45.205 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:45.218 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-22T14:10:45.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.364+0000 7ff55724a700 1 Processor -- start 2020-04-22T14:10:45.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.364+0000 7ff55724a700 1 -- start start 2020-04-22T14:10:45.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.365+0000 7ff55724a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff5500b9140 0x7ff5500aed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:45.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.365+0000 7ff55724a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff5500af1f0 0x7ff550144660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:45.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.365+0000 7ff55724a700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff550144ac0 con 0x7ff5500b3bd0 2020-04-22T14:10:45.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.365+0000 7ff55724a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff550148310 con 0x7ff5500af1f0 2020-04-22T14:10:45.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.365+0000 7ff55724a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5501485b0 con 0x7ff5500b9140 2020-04-22T14:10:45.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.365+0000 7ff554fe6700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff5500b9140 0x7ff5500aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:45.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.365+0000 7ff54ffff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff5500b3bd0 0x7ff5500616b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43618/0 (socket says 172.21.15.103:43618) 2020-04-22T14:10:45.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.365+0000 7ff54ffff700 1 -- 172.21.15.103:0/1805463024 learned_addr learned my addr 172.21.15.103:0/1805463024 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:45.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.366+0000 7ff5557e7700 1 --2- 172.21.15.103:0/1805463024 >> v2:172.21.15.86:3300/0 conn(0x7ff5500af1f0 0x7ff550144660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:45.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.366+0000 7ff554fe6700 1 -- 172.21.15.103:0/1805463024 >> v2:172.21.15.86:3300/0 conn(0x7ff5500af1f0 msgr2=0x7ff550144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:45.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.366+0000 7ff554fe6700 1 --2- 172.21.15.103:0/1805463024 >> v2:172.21.15.86:3300/0 conn(0x7ff5500af1f0 0x7ff550144660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:45.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.366+0000 7ff554fe6700 1 -- 172.21.15.103:0/1805463024 >> v1:172.21.15.103:6789/0 conn(0x7ff5500b3bd0 legacy=0x7ff5500616b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:45.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.366+0000 7ff554fe6700 1 -- 172.21.15.103:0/1805463024 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5500b9520 con 0x7ff5500b9140 2020-04-22T14:10:45.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.366+0000 7ff54f7fe700 1 -- 172.21.15.103:0/1805463024 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 409535640 0 0) 0x7ff550144ac0 con 0x7ff5500b3bd0 2020-04-22T14:10:45.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.366+0000 7ff5557e7700 1 --2- 172.21.15.103:0/1805463024 >> v2:172.21.15.86:3300/0 conn(0x7ff5500af1f0 0x7ff550144660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:10:45.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.366+0000 7ff554fe6700 1 --2- 172.21.15.103:0/1805463024 >> v2:172.21.15.103:3300/0 conn(0x7ff5500b9140 0x7ff5500aed90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff540002f30 tx=0x7ff540007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.366+0000 7ff554fe6700 1 --2- 172.21.15.103:0/1805463024 >> v2:172.21.15.103:3300/0 conn(0x7ff5500b9140 0x7ff5500aed90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff540002f30 tx=0x7ff540007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.366+0000 7ff554fe6700 1 --2- 172.21.15.103:0/1805463024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5500b9140 0x7ff5500aed90 secure :-1 s=READY pgs=844 cs=0 l=1 rx=0x7ff540002f30 tx=0x7ff540007a40).ready entity=mon.1 client_cookie=9bfee3dd864aa215 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:45.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.366+0000 7ff554fe6700 1 --2- 172.21.15.103:0/1805463024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5500b9140 0x7ff5500aed90 secure :-1 s=THROTTLE_DONE pgs=844 cs=0 l=1 rx=0x7ff540002f30 tx=0x7ff540007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.366+0000 7ff54f7fe700 1 -- 172.21.15.103:0/1805463024 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff540011470 con 0x7ff5500b9140 2020-04-22T14:10:45.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.366+0000 7ff554fe6700 1 --2- 172.21.15.103:0/1805463024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5500b9140 0x7ff5500aed90 secure :-1 s=THROTTLE_DONE pgs=844 cs=0 l=1 rx=0x7ff540002f30 tx=0x7ff540007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.366+0000 7ff554fe6700 1 --2- 172.21.15.103:0/1805463024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5500b9140 0x7ff5500aed90 secure :-1 s=THROTTLE_DONE pgs=844 cs=0 l=1 rx=0x7ff540002f30 tx=0x7ff540007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.366+0000 7ff54f7fe700 1 -- 172.21.15.103:0/1805463024 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5400115d0 con 0x7ff5500b9140 2020-04-22T14:10:45.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.366+0000 7ff54f7fe700 1 -- 172.21.15.103:0/1805463024 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5400119b0 con 0x7ff5500b9140 2020-04-22T14:10:45.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.366+0000 7ff55724a700 1 -- 172.21.15.103:0/1805463024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5500b9140 msgr2=0x7ff5500aed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:45.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.366+0000 7ff55724a700 1 --2- 172.21.15.103:0/1805463024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5500b9140 0x7ff5500aed90 secure :-1 s=READY pgs=844 cs=0 l=1 rx=0x7ff540002f30 tx=0x7ff540007a40).stop 2020-04-22T14:10:45.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.366+0000 7ff55724a700 1 -- 172.21.15.103:0/1805463024 shutdown_connections 2020-04-22T14:10:45.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.366+0000 7ff55724a700 1 --2- 172.21.15.103:0/1805463024 >> v2:172.21.15.86:3300/0 conn(0x7ff5500af1f0 0x7ff550144660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:45.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.366+0000 7ff55724a700 1 --2- 172.21.15.103:0/1805463024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5500b9140 0x7ff5500aed90 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:45.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.366+0000 7ff55724a700 1 -- 172.21.15.103:0/1805463024 >> 172.21.15.103:0/1805463024 conn(0x7ff55005b7b0 msgr2=0x7ff5500b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:45.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.366+0000 7ff55724a700 1 -- 172.21.15.103:0/1805463024 shutdown_connections 2020-04-22T14:10:45.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.366+0000 7ff55724a700 1 -- 172.21.15.103:0/1805463024 wait complete. 2020-04-22T14:10:45.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.367+0000 7ff55724a700 1 Processor -- start 2020-04-22T14:10:45.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.367+0000 7ff55724a700 1 -- start start 2020-04-22T14:10:45.379 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.368+0000 7ff55724a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff5500af1f0 0x7ff550064710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:45.379 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.368+0000 7ff55724a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff5500b9140 0x7ff55013eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:45.379 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.368+0000 7ff55724a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff550064d40 con 0x7ff5500b3bd0 2020-04-22T14:10:45.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.368+0000 7ff55724a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff550065020 con 0x7ff5500b9140 2020-04-22T14:10:45.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.368+0000 7ff55724a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5500652c0 con 0x7ff5500af1f0 2020-04-22T14:10:45.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.368+0000 7ff5557e7700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff5500b9140 0x7ff55013eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:45.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.368+0000 7ff5557e7700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff5500b9140 0x7ff55013eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51436/0 (socket says 172.21.15.103:51436) 2020-04-22T14:10:45.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.368+0000 7ff5557e7700 1 -- 172.21.15.103:0/3064689108 learned_addr learned my addr 172.21.15.103:0/3064689108 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:10:45.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.369+0000 7ff554fe6700 1 --2- 172.21.15.103:0/3064689108 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff5500af1f0 0x7ff550064710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:45.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.369+0000 7ff5557e7700 1 -- 172.21.15.103:0/3064689108 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff5500af1f0 msgr2=0x7ff550064710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:45.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.369+0000 7ff5557e7700 1 --2- 172.21.15.103:0/3064689108 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff5500af1f0 0x7ff550064710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:45.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.369+0000 7ff5557e7700 1 -- 172.21.15.103:0/3064689108 >> v1:172.21.15.86:6789/0 conn(0x7ff5500b3bd0 legacy=0x7ff550145bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:45.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.369+0000 7ff5557e7700 1 -- 172.21.15.103:0/3064689108 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff55013f350 con 0x7ff5500b9140 2020-04-22T14:10:45.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.369+0000 7ff5557e7700 1 --2- 172.21.15.103:0/3064689108 >> v2:172.21.15.103:3300/0 conn(0x7ff5500b9140 0x7ff55013eef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff548003270 tx=0x7ff548010e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.369+0000 7ff5557e7700 1 --2- 172.21.15.103:0/3064689108 >> v2:172.21.15.103:3300/0 conn(0x7ff5500b9140 0x7ff55013eef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff548003270 tx=0x7ff548010e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.369+0000 7ff5557e7700 1 --2- 172.21.15.103:0/3064689108 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5500b9140 0x7ff55013eef0 secure :-1 s=READY pgs=845 cs=0 l=1 rx=0x7ff548003270 tx=0x7ff548010e70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:45.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.369+0000 7ff5557e7700 1 --2- 172.21.15.103:0/3064689108 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5500b9140 0x7ff55013eef0 secure :-1 s=THROTTLE_DONE pgs=845 cs=0 l=1 rx=0x7ff548003270 tx=0x7ff548010e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.369+0000 7ff54dffb700 1 -- 172.21.15.103:0/3064689108 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff548007370 con 0x7ff5500b9140 2020-04-22T14:10:45.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.369+0000 7ff5557e7700 1 --2- 172.21.15.103:0/3064689108 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5500b9140 0x7ff55013eef0 secure :-1 s=THROTTLE_DONE pgs=845 cs=0 l=1 rx=0x7ff548003270 tx=0x7ff548010e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.369+0000 7ff5557e7700 1 --2- 172.21.15.103:0/3064689108 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5500b9140 0x7ff55013eef0 secure :-1 s=THROTTLE_DONE pgs=845 cs=0 l=1 rx=0x7ff548003270 tx=0x7ff548010e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.369+0000 7ff54dffb700 1 -- 172.21.15.103:0/3064689108 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5480074d0 con 0x7ff5500b9140 2020-04-22T14:10:45.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.369+0000 7ff55724a700 1 -- 172.21.15.103:0/3064689108 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff55013f540 con 0x7ff5500b9140 2020-04-22T14:10:45.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.369+0000 7ff54dffb700 1 -- 172.21.15.103:0/3064689108 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5480078f0 con 0x7ff5500b9140 2020-04-22T14:10:45.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.369+0000 7ff55724a700 1 -- 172.21.15.103:0/3064689108 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff550155440 con 0x7ff5500b9140 2020-04-22T14:10:45.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.370+0000 7ff5557e7700 1 --2- 172.21.15.103:0/3064689108 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5500b9140 0x7ff55013eef0 secure :-1 s=THROTTLE_DONE pgs=845 cs=0 l=1 rx=0x7ff548003270 tx=0x7ff548010e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.370+0000 7ff54dffb700 1 -- 172.21.15.103:0/3064689108 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ff5480124d0 con 0x7ff5500b9140 2020-04-22T14:10:45.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.370+0000 7ff55724a700 1 -- 172.21.15.103:0/3064689108 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff55013f850 con 0x7ff5500b9140 2020-04-22T14:10:45.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.370+0000 7ff5557e7700 1 --2- 172.21.15.103:0/3064689108 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5500b9140 0x7ff55013eef0 secure :-1 s=THROTTLE_DONE pgs=845 cs=0 l=1 rx=0x7ff548003270 tx=0x7ff548010e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.370+0000 7ff54dffb700 1 --2- 172.21.15.103:0/3064689108 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff53004d930 0x7ff53004fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:45.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.370+0000 7ff54dffb700 1 -- 172.21.15.103:0/3064689108 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff548061610 con 0x7ff5500b9140 2020-04-22T14:10:45.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.370+0000 7ff554fe6700 1 --2- 172.21.15.103:0/3064689108 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff53004d930 0x7ff53004fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:45.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.371+0000 7ff554fe6700 1 --2- 172.21.15.103:0/3064689108 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff53004d930 0x7ff53004fdf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff540002f30 tx=0x7ff540007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.371+0000 7ff554fe6700 1 --2- 172.21.15.103:0/3064689108 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff53004d930 0x7ff53004fdf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff540002f30 tx=0x7ff540007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.371+0000 7ff554fe6700 1 --2- 172.21.15.103:0/3064689108 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff53004d930 0x7ff53004fdf0 secure :-1 s=READY pgs=318 cs=0 l=1 rx=0x7ff540002f30 tx=0x7ff540007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:45.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.374+0000 7ff5557e7700 1 --2- 172.21.15.103:0/3064689108 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5500b9140 0x7ff55013eef0 secure :-1 s=THROTTLE_DONE pgs=845 cs=0 l=1 rx=0x7ff548003270 tx=0x7ff548010e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.374+0000 7ff54dffb700 1 -- 172.21.15.103:0/3064689108 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ff54803ca50 con 0x7ff5500b9140 2020-04-22T14:10:45.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.519+0000 7ff55724a700 1 -- 172.21.15.103:0/3064689108 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff550155b20 con 0x7ff5500b9140 2020-04-22T14:10:45.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.520+0000 7ff5557e7700 1 --2- 172.21.15.103:0/3064689108 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5500b9140 0x7ff55013eef0 secure :-1 s=THROTTLE_DONE pgs=845 cs=0 l=1 rx=0x7ff548003270 tx=0x7ff548010e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.520+0000 7ff54dffb700 1 -- 172.21.15.103:0/3064689108 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v64) v1 ==== 100+0+10 (secure 0 0 0) 0x7ff548040070 con 0x7ff5500b9140 2020-04-22T14:10:45.523 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:10:45.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.521+0000 7ff55724a700 1 -- 172.21.15.103:0/3064689108 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff53004d930 msgr2=0x7ff53004fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:45.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.521+0000 7ff55724a700 1 --2- 172.21.15.103:0/3064689108 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff53004d930 0x7ff53004fdf0 secure :-1 s=READY pgs=318 cs=0 l=1 rx=0x7ff540002f30 tx=0x7ff540007a40).stop 2020-04-22T14:10:45.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.521+0000 7ff55724a700 1 -- 172.21.15.103:0/3064689108 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5500b9140 msgr2=0x7ff55013eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:45.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.521+0000 7ff55724a700 1 --2- 172.21.15.103:0/3064689108 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5500b9140 0x7ff55013eef0 secure :-1 s=READY pgs=845 cs=0 l=1 rx=0x7ff548003270 tx=0x7ff548010e70).stop 2020-04-22T14:10:45.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.521+0000 7ff55724a700 1 -- 172.21.15.103:0/3064689108 shutdown_connections 2020-04-22T14:10:45.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.521+0000 7ff55724a700 1 --2- 172.21.15.103:0/3064689108 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff53004d930 0x7ff53004fdf0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:45.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.521+0000 7ff55724a700 1 --2- 172.21.15.103:0/3064689108 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5500b9140 0x7ff55013eef0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:45.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.521+0000 7ff55724a700 1 --2- 172.21.15.103:0/3064689108 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff5500af1f0 0x7ff550064710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:45.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.521+0000 7ff55724a700 1 -- 172.21.15.103:0/3064689108 >> 172.21.15.103:0/3064689108 conn(0x7ff55005b7b0 msgr2=0x7ff5500b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:45.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.521+0000 7ff55724a700 1 -- 172.21.15.103:0/3064689108 shutdown_connections 2020-04-22T14:10:45.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.521+0000 7ff55724a700 1 -- 172.21.15.103:0/3064689108 wait complete. 2020-04-22T14:10:45.538 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-04-22T14:10:45.538 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:45.552 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:10:45.714 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.696+0000 7f41679a1700 1 Processor -- start 2020-04-22T14:10:45.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.696+0000 7f41679a1700 1 -- start start 2020-04-22T14:10:45.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.697+0000 7f41679a1700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f416005f2c0 0x7f41601464a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:45.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.697+0000 7f41679a1700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4160061fe0 con 0x7f41600b56c0 2020-04-22T14:10:45.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.697+0000 7f41679a1700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4160062280 con 0x7f41601403f0 2020-04-22T14:10:45.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.697+0000 7f41679a1700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4160062520 con 0x7f416005f2c0 2020-04-22T14:10:45.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.697+0000 7f416573d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f41601403f0 0x7f41600629c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43630/0 (socket says 172.21.15.103:43630) 2020-04-22T14:10:45.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.697+0000 7f416573d700 1 -- 172.21.15.103:0/2173690088 learned_addr learned my addr 172.21.15.103:0/2173690088 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:45.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.697+0000 7f4164f3c700 1 --2- 172.21.15.103:0/2173690088 >> v2:172.21.15.86:3300/0 conn(0x7f416005f2c0 0x7f41601464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:45.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.697+0000 7f414ffff700 1 -- 172.21.15.103:0/2173690088 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2442841818 0 0) 0x7f4160062280 con 0x7f41601403f0 2020-04-22T14:10:45.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.697+0000 7f414ffff700 1 -- 172.21.15.103:0/2173690088 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4148003230 con 0x7f41601403f0 2020-04-22T14:10:45.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.698+0000 7f414ffff700 1 -- 172.21.15.103:0/2173690088 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 864140808 0 0) 0x7f4148003230 con 0x7f41601403f0 2020-04-22T14:10:45.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.698+0000 7f414ffff700 1 -- 172.21.15.103:0/2173690088 >> v2:172.21.15.86:3300/0 conn(0x7f416005f2c0 msgr2=0x7f41601464a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:45.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.698+0000 7f414ffff700 1 --2- 172.21.15.103:0/2173690088 >> v2:172.21.15.86:3300/0 conn(0x7f416005f2c0 0x7f41601464a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:45.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.698+0000 7f414ffff700 1 -- 172.21.15.103:0/2173690088 >> v1:172.21.15.86:6789/0 conn(0x7f41600b56c0 legacy=0x7f41600b3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:45.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.698+0000 7f414ffff700 1 -- 172.21.15.103:0/2173690088 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41600b51c0 con 0x7f41601403f0 2020-04-22T14:10:45.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.698+0000 7f414ffff700 1 -- 172.21.15.103:0/2173690088 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f41500016d0 con 0x7f41601403f0 2020-04-22T14:10:45.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.698+0000 7f414ffff700 1 -- 172.21.15.103:0/2173690088 >> v1:172.21.15.103:6789/0 conn(0x7f41601403f0 legacy=0x7f41600629c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:45.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.698+0000 7f414ffff700 1 --2- 172.21.15.103:0/2173690088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4148003720 0x7f4148003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:45.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.698+0000 7f414ffff700 1 --2- 172.21.15.103:0/2173690088 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41480044d0 0x7f4148004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:45.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.698+0000 7f414ffff700 1 --2- 172.21.15.103:0/2173690088 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4148004db0 0x7f414800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:45.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.698+0000 7f414ffff700 1 -- 172.21.15.103:0/2173690088 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4160062520 con 0x7f41480044d0 2020-04-22T14:10:45.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.698+0000 7f414ffff700 1 -- 172.21.15.103:0/2173690088 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41480041c0 con 0x7f4148003720 2020-04-22T14:10:45.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.698+0000 7f414ffff700 1 -- 172.21.15.103:0/2173690088 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414800bb80 con 0x7f4148004db0 2020-04-22T14:10:45.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.698+0000 7f416573d700 1 --2- 172.21.15.103:0/2173690088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4148003720 0x7f4148003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:45.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.698+0000 7f4164f3c700 1 --2- 172.21.15.103:0/2173690088 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41480044d0 0x7f4148004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:45.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.698+0000 7f4165f3e700 1 --2- 172.21.15.103:0/2173690088 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4148004db0 0x7f414800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:45.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.698+0000 7f416573d700 1 -- 172.21.15.103:0/2173690088 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4148004db0 msgr2=0x7f414800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:45.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.698+0000 7f416573d700 1 --2- 172.21.15.103:0/2173690088 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4148004db0 0x7f414800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:45.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.698+0000 7f416573d700 1 -- 172.21.15.103:0/2173690088 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41480044d0 msgr2=0x7f4148004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:45.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.698+0000 7f416573d700 1 --2- 172.21.15.103:0/2173690088 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41480044d0 0x7f4148004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:45.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.698+0000 7f416573d700 1 -- 172.21.15.103:0/2173690088 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4148003230 con 0x7f4148003720 2020-04-22T14:10:45.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.698+0000 7f4165f3e700 1 --2- 172.21.15.103:0/2173690088 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4148004db0 0x7f414800b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:10:45.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.698+0000 7f4165f3e700 1 -- 172.21.15.103:0/2173690088 reap_dead start 2020-04-22T14:10:45.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.698+0000 7f416573d700 1 --2- 172.21.15.103:0/2173690088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4148003720 0x7f4148003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f41480054a0 tx=0x7f41600b5350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.698+0000 7f416573d700 1 --2- 172.21.15.103:0/2173690088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4148003720 0x7f4148003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f41480054a0 tx=0x7f41600b5350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.698+0000 7f416573d700 1 --2- 172.21.15.103:0/2173690088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4148003720 0x7f4148003b40 secure :-1 s=READY pgs=847 cs=0 l=1 rx=0x7f41480054a0 tx=0x7f41600b5350).ready entity=mon.1 client_cookie=1ecf474b79669f94 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:45.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.698+0000 7f416573d700 1 --2- 172.21.15.103:0/2173690088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4148003720 0x7f4148003b40 secure :-1 s=THROTTLE_DONE pgs=847 cs=0 l=1 rx=0x7f41480054a0 tx=0x7f41600b5350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.698+0000 7f414ffff700 1 -- 172.21.15.103:0/2173690088 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f415000ce80 con 0x7f4148003720 2020-04-22T14:10:45.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.698+0000 7f416573d700 1 --2- 172.21.15.103:0/2173690088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4148003720 0x7f4148003b40 secure :-1 s=THROTTLE_DONE pgs=847 cs=0 l=1 rx=0x7f41480054a0 tx=0x7f41600b5350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.698+0000 7f416573d700 1 --2- 172.21.15.103:0/2173690088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4148003720 0x7f4148003b40 secure :-1 s=THROTTLE_DONE pgs=847 cs=0 l=1 rx=0x7f41480054a0 tx=0x7f41600b5350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.698+0000 7f414ffff700 1 -- 172.21.15.103:0/2173690088 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f415000e370 con 0x7f4148003720 2020-04-22T14:10:45.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.698+0000 7f414ffff700 1 -- 172.21.15.103:0/2173690088 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41500100c0 con 0x7f4148003720 2020-04-22T14:10:45.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.698+0000 7f41679a1700 1 -- 172.21.15.103:0/2173690088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4148003720 msgr2=0x7f4148003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:45.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.698+0000 7f41679a1700 1 --2- 172.21.15.103:0/2173690088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4148003720 0x7f4148003b40 secure :-1 s=READY pgs=847 cs=0 l=1 rx=0x7f41480054a0 tx=0x7f41600b5350).stop 2020-04-22T14:10:45.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.699+0000 7f41679a1700 1 -- 172.21.15.103:0/2173690088 shutdown_connections 2020-04-22T14:10:45.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.699+0000 7f41679a1700 1 --2- 172.21.15.103:0/2173690088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4148003720 0x7f4148003b40 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:45.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.699+0000 7f41679a1700 1 -- 172.21.15.103:0/2173690088 >> 172.21.15.103:0/2173690088 conn(0x7f416005ad30 msgr2=0x7f416005b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:45.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.699+0000 7f41679a1700 1 -- 172.21.15.103:0/2173690088 shutdown_connections 2020-04-22T14:10:45.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.699+0000 7f41679a1700 1 -- 172.21.15.103:0/2173690088 wait complete. 2020-04-22T14:10:45.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.700+0000 7f41679a1700 1 Processor -- start 2020-04-22T14:10:45.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.700+0000 7f41679a1700 1 -- start start 2020-04-22T14:10:45.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.700+0000 7f41679a1700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f41601439e0 0x7f4160148ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:45.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.700+0000 7f41679a1700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41601430c0 0x7f41600aeb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:45.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.700+0000 7f41679a1700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4160149000 con 0x7f4148003720 2020-04-22T14:10:45.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.701+0000 7f41679a1700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4160143520 con 0x7f41601439e0 2020-04-22T14:10:45.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.701+0000 7f41679a1700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4160143790 con 0x7f41601430c0 2020-04-22T14:10:45.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.701+0000 7f416573d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f4148003720 0x7f416013f7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43642/0 (socket says 172.21.15.103:43642) 2020-04-22T14:10:45.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.701+0000 7f416573d700 1 -- 172.21.15.103:0/3687048224 learned_addr learned my addr 172.21.15.103:0/3687048224 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:45.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.701+0000 7f4164f3c700 1 --2- 172.21.15.103:0/3687048224 >> v2:172.21.15.86:3300/0 conn(0x7f41601439e0 0x7f4160148ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:45.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.701+0000 7f4165f3e700 1 --2- 172.21.15.103:0/3687048224 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41601430c0 0x7f41600aeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:45.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.701+0000 7f414e7fc700 1 -- 172.21.15.103:0/3687048224 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2398863946 0 0) 0x7f4148003230 con 0x7f4148003720 2020-04-22T14:10:45.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.701+0000 7f414e7fc700 1 -- 172.21.15.103:0/3687048224 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4140002fe0 con 0x7f4148003720 2020-04-22T14:10:45.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.701+0000 7f4164f3c700 1 -- 172.21.15.103:0/3687048224 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41601430c0 msgr2=0x7f41600aeb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:45.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.701+0000 7f4164f3c700 1 --2- 172.21.15.103:0/3687048224 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41601430c0 0x7f41600aeb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:45.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.701+0000 7f4164f3c700 1 -- 172.21.15.103:0/3687048224 >> v1:172.21.15.103:6789/0 conn(0x7f4148003720 legacy=0x7f416013f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:45.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.701+0000 7f4164f3c700 1 -- 172.21.15.103:0/3687048224 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41600ae430 con 0x7f41601439e0 2020-04-22T14:10:45.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.701+0000 7f4164f3c700 1 --2- 172.21.15.103:0/3687048224 >> v2:172.21.15.86:3300/0 conn(0x7f41601439e0 0x7f4160148ba0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f415c002f30 tx=0x7f415c010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.701+0000 7f4164f3c700 1 --2- 172.21.15.103:0/3687048224 >> v2:172.21.15.86:3300/0 conn(0x7f41601439e0 0x7f4160148ba0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f415c002f30 tx=0x7f415c010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.701+0000 7f4164f3c700 1 --2- 172.21.15.103:0/3687048224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41601439e0 0x7f4160148ba0 secure :-1 s=READY pgs=480 cs=0 l=1 rx=0x7f415c002f30 tx=0x7f415c010b20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:45.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.701+0000 7f4164f3c700 1 --2- 172.21.15.103:0/3687048224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41601439e0 0x7f4160148ba0 secure :-1 s=THROTTLE_DONE pgs=480 cs=0 l=1 rx=0x7f415c002f30 tx=0x7f415c010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.701+0000 7f414e7fc700 1 -- 172.21.15.103:0/3687048224 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f415c005ca0 con 0x7f41601439e0 2020-04-22T14:10:45.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.701+0000 7f4164f3c700 1 --2- 172.21.15.103:0/3687048224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41601439e0 0x7f4160148ba0 secure :-1 s=THROTTLE_DONE pgs=480 cs=0 l=1 rx=0x7f415c002f30 tx=0x7f415c010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.701+0000 7f414e7fc700 1 -- 172.21.15.103:0/3687048224 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f415c005e00 con 0x7f41601439e0 2020-04-22T14:10:45.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.701+0000 7f4164f3c700 1 --2- 172.21.15.103:0/3687048224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41601439e0 0x7f4160148ba0 secure :-1 s=THROTTLE_DONE pgs=480 cs=0 l=1 rx=0x7f415c002f30 tx=0x7f415c010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.701+0000 7f41679a1700 1 -- 172.21.15.103:0/3687048224 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41600ae6d0 con 0x7f41601439e0 2020-04-22T14:10:45.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.701+0000 7f414e7fc700 1 -- 172.21.15.103:0/3687048224 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f415c007370 con 0x7f41601439e0 2020-04-22T14:10:45.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.702+0000 7f41679a1700 1 -- 172.21.15.103:0/3687048224 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f416013fed0 con 0x7f41601439e0 2020-04-22T14:10:45.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.702+0000 7f4164f3c700 1 --2- 172.21.15.103:0/3687048224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41601439e0 0x7f4160148ba0 secure :-1 s=THROTTLE_DONE pgs=480 cs=0 l=1 rx=0x7f415c002f30 tx=0x7f415c010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.702+0000 7f41679a1700 1 -- 172.21.15.103:0/3687048224 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4160056c90 con 0x7f41601439e0 2020-04-22T14:10:45.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.702+0000 7f414e7fc700 1 -- 172.21.15.103:0/3687048224 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f415c009490 con 0x7f41601439e0 2020-04-22T14:10:45.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.703+0000 7f4164f3c700 1 --2- 172.21.15.103:0/3687048224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41601439e0 0x7f4160148ba0 secure :-1 s=THROTTLE_DONE pgs=480 cs=0 l=1 rx=0x7f415c002f30 tx=0x7f415c010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.703+0000 7f414e7fc700 1 --2- 172.21.15.103:0/3687048224 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f414004dc60 0x7f4140050120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:45.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.703+0000 7f414e7fc700 1 -- 172.21.15.103:0/3687048224 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f415c0613e0 con 0x7f41601439e0 2020-04-22T14:10:45.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.703+0000 7f416573d700 1 --2- 172.21.15.103:0/3687048224 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f414004dc60 0x7f4140050120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:45.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.703+0000 7f416573d700 1 --2- 172.21.15.103:0/3687048224 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f414004dc60 0x7f4140050120 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4150001190 tx=0x7f41600b5350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.703+0000 7f416573d700 1 --2- 172.21.15.103:0/3687048224 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f414004dc60 0x7f4140050120 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4150001190 tx=0x7f41600b5350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.703+0000 7f416573d700 1 --2- 172.21.15.103:0/3687048224 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f414004dc60 0x7f4140050120 secure :-1 s=READY pgs=319 cs=0 l=1 rx=0x7f4150001190 tx=0x7f41600b5350).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:45.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.707+0000 7f4164f3c700 1 --2- 172.21.15.103:0/3687048224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41601439e0 0x7f4160148ba0 secure :-1 s=THROTTLE_DONE pgs=480 cs=0 l=1 rx=0x7f415c002f30 tx=0x7f415c010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.707+0000 7f414e7fc700 1 -- 172.21.15.103:0/3687048224 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f415c03c760 con 0x7f41601439e0 2020-04-22T14:10:45.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.896+0000 7f41679a1700 1 -- 172.21.15.103:0/3687048224 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f41600afe50 con 0x7f41601439e0 2020-04-22T14:10:45.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.896+0000 7f4164f3c700 1 --2- 172.21.15.103:0/3687048224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41601439e0 0x7f4160148ba0 secure :-1 s=THROTTLE_DONE pgs=480 cs=0 l=1 rx=0x7f415c002f30 tx=0x7f415c010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:45.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.896+0000 7f414e7fc700 1 -- 172.21.15.103:0/3687048224 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+2143 (secure 0 0 0) 0x7f415c03fd80 con 0x7f41601439e0 2020-04-22T14:10:45.900 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:10:45.901 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5096,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1960145218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1960145218},{"type":"v1","addr":"172.21.15.86:6835","nonce":1960145218}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:10:40.825749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6289},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6289":{"gid":6289,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/2152235919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2152235919},{"type":"v1","addr":"172.21.15.103:6833","nonce":2152235919}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:10:45.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.898+0000 7f41679a1700 1 -- 172.21.15.103:0/3687048224 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f414004dc60 msgr2=0x7f4140050120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:45.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.898+0000 7f41679a1700 1 --2- 172.21.15.103:0/3687048224 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f414004dc60 0x7f4140050120 secure :-1 s=READY pgs=319 cs=0 l=1 rx=0x7f4150001190 tx=0x7f41600b5350).stop 2020-04-22T14:10:45.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.898+0000 7f41679a1700 1 -- 172.21.15.103:0/3687048224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41601439e0 msgr2=0x7f4160148ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:45.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.898+0000 7f41679a1700 1 --2- 172.21.15.103:0/3687048224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41601439e0 0x7f4160148ba0 secure :-1 s=READY pgs=480 cs=0 l=1 rx=0x7f415c002f30 tx=0x7f415c010b20).stop 2020-04-22T14:10:45.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.898+0000 7f41679a1700 1 -- 172.21.15.103:0/3687048224 shutdown_connections 2020-04-22T14:10:45.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.898+0000 7f41679a1700 1 --2- 172.21.15.103:0/3687048224 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41601430c0 0x7f41600aeb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:45.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.898+0000 7f41679a1700 1 --2- 172.21.15.103:0/3687048224 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f414004dc60 0x7f4140050120 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:45.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.898+0000 7f41679a1700 1 --2- 172.21.15.103:0/3687048224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41601439e0 0x7f4160148ba0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:45.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.898+0000 7f41679a1700 1 -- 172.21.15.103:0/3687048224 >> 172.21.15.103:0/3687048224 conn(0x7f416005ad30 msgr2=0x7f41600b8f70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:45.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.898+0000 7f41679a1700 1 -- 172.21.15.103:0/3687048224 shutdown_connections 2020-04-22T14:10:45.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:45.898+0000 7f41679a1700 1 -- 172.21.15.103:0/3687048224 wait complete. 2020-04-22T14:10:45.904 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 36 2020-04-22T14:10:46.113 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 6289}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 11, u'failed': [], u'epoch': 36, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [12], u'info': {u'gid_6289': {u'export_targets': [], u'name': u'a', u'incarnation': 33, u'state_seq': 3, u'state': u'up:active', u'gid': 6289, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 2152235919, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 2152235919, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/2152235919'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:10:38.817638+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:10:40.825749+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:10:46.113 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:10:46.113 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:46.128 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:10:46.286 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:10:46.286 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:10:46.287 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:10:46.287 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 6289, 2020-04-22T14:10:46.287 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:10:46.287 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:10:46.287 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 7.4652138590000003, 2020-04-22T14:10:46.287 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 36, 2020-04-22T14:10:46.287 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 64, 2020-04-22T14:10:46.288 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 64, 2020-04-22T14:10:46.288 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 12.683659281000001 2020-04-22T14:10:46.288 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:10:46.295 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 6289, "want_state": "up:active", "state": "up:active", "rank_uptime": 7.4652138590000003, "mdsmap_epoch": 36, "osdmap_epoch": 64, "osdmap_epoch_barrier": 64, "uptime": 12.683659281000001 } 2020-04-22T14:10:46.295 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-04-22T14:10:46.296 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:10:46.296 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:46.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:46.310 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:10:46.370 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:10:46.370 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:10:46.371 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:10:46.371 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:46.371 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:10:46.371 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:46.371 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:10:46.371 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:10:46.371 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:10:46.372 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:10:46.372 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:10:46.372 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:10:46.372 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:10:46.372 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:10:46.372 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:10:46.372 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42194sec preferred_lft 42194sec 2020-04-22T14:10:46.373 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:10:46.373 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:46.373 INFO:teuthology.orchestra.run.smithi103.stdout:18: brx.1@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:10:46.373 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 86:6a:e2:0f:ca:92 brd ff:ff:ff:ff:ff:ff link-netnsid 1 2020-04-22T14:10:46.373 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-04-22T14:10:46.373 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:46.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:46.424 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:10:46.499 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:46.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:46.550 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge con-name ceph-brx ifname ceph-brx stp no' 2020-04-22T14:10:46.663 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' (606a42d6-cea1-405a-8661-003fefae55b7) successfully added. 2020-04-22T14:10:46.664 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:46.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:46.679 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection modify ceph-brx ipv4.addresses 192.168.255.254/16 ipv4.method manual' 2020-04-22T14:10:46.790 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:46.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:46.804 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up ceph-brx' 2020-04-22T14:10:46.914 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (master waiting for slaves) (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/21) 2020-04-22T14:10:46.914 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:46.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:46.941 INFO:teuthology.orchestra.run.smithi103:> touch /tmp/python-ceph-brx 2020-04-22T14:10:47.000 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:47.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:47.048 INFO:teuthology.orchestra.run.smithi103:> cat /proc/sys/net/ipv4/ip_forward 2020-04-22T14:10:47.106 INFO:teuthology.orchestra.run.smithi103.stdout:0 2020-04-22T14:10:47.106 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:47.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:47.157 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 0 > /tmp/python-ceph-brx' 2020-04-22T14:10:47.236 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:47.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:47.279 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 1 > /proc/sys/net/ipv4/ip_forward' 2020-04-22T14:10:47.355 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:47.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:47.399 INFO:teuthology.orchestra.run.smithi103:> route 2020-04-22T14:10:47.463 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2020-04-22T14:10:47.463 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-04-22T14:10:47.463 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 102 0 0 enp3s0f1 2020-04-22T14:10:47.463 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 102 0 0 enp3s0f1 2020-04-22T14:10:47.464 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 425 0 0 ceph-brx 2020-04-22T14:10:47.464 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:47.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:47.509 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-04-22T14:10:47.585 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:47.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:47.631 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-04-22T14:10:47.707 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:47.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:47.753 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-04-22T14:10:47.828 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:47.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:47.876 INFO:teuthology.orchestra.run.smithi103:> ip netns list 2020-04-22T14:10:47.936 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:47.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:47.984 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:10:48.043 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 1 2020-04-22T14:10:48.044 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:48.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:48.091 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:10:48.166 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:48.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:48.214 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0' 2020-04-22T14:10:48.290 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-04-22T14:10:48.290 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:48.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:48.335 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0' 2020-04-22T14:10:48.411 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:48.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:48.458 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0' 2020-04-22T14:10:48.571 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:48.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:48.585 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up' 2020-04-22T14:10:48.692 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:48.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:48.706 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up' 2020-04-22T14:10:48.812 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:48.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:48.826 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254' 2020-04-22T14:10:48.933 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:48.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:48.947 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:10:49.022 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:49.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:49.075 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge-slave con-name brx.0 ifname brx.0 master ceph-brx' 2020-04-22T14:10:49.183 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.0' (c3b14acb-5ee5-4601-a6c3-3fdb893b60f6) successfully added. 2020-04-22T14:10:49.184 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:49.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:49.212 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up brx.0' 2020-04-22T14:10:49.369 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/22) 2020-04-22T14:10:49.420 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-04-22T14:10:49.420 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi103.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-04-22T14:10:49.420 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:49.434 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:10:49.435 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:10:49.493 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:49.542 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:10:49.542 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:10:49.610 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:10:49.621 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:10:49.621 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:49.664 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:10:49.664 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:10:49.724 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-04-22T14:10:49.725 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:49.772 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:10:49.814 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:49.828 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:10:49.828 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:10:49.898 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:10:49.903 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:2020-04-22T14:10:49.901+0000 7fc1ec9171c0 -1 init, newargv = 0x5611cca8c760 newargc=9 2020-04-22T14:10:49.903 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[66898]: starting ceph client 2020-04-22T14:10:49.908 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[66898]: starting fuse 2020-04-22T14:10:49.917 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:10:49.918 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:49.940 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:10:49.941 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:10:49.999 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:10:50.000 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2020-04-22T14:10:50.000 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:50.048 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:10:50.048 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:10:50.049 INFO:teuthology.orchestra.run.smithi103:> import glob 2020-04-22T14:10:50.049 INFO:teuthology.orchestra.run.smithi103:> import re 2020-04-22T14:10:50.049 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:10:50.049 INFO:teuthology.orchestra.run.smithi103:> import subprocess 2020-04-22T14:10:50.049 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:10:50.049 INFO:teuthology.orchestra.run.smithi103:> def find_socket(client_name): 2020-04-22T14:10:50.049 INFO:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-04-22T14:10:50.049 INFO:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2020-04-22T14:10:50.050 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:10:50.050 INFO:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2020-04-22T14:10:50.050 INFO:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2020-04-22T14:10:50.050 INFO:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2020-04-22T14:10:50.050 INFO:teuthology.orchestra.run.smithi103:> return files[0] 2020-04-22T14:10:50.050 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:10:50.050 INFO:teuthology.orchestra.run.smithi103:> for f in files: 2020-04-22T14:10:50.050 INFO:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:10:50.051 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:10:50.051 INFO:teuthology.orchestra.run.smithi103:> return f 2020-04-22T14:10:50.051 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:10:50.051 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:10:50.051 INFO:teuthology.orchestra.run.smithi103:> print(find_socket("client.0")) 2020-04-22T14:10:50.051 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:10:50.156 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.0.66898.asok 2020-04-22T14:10:50.157 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.66898.asok 2020-04-22T14:10:50.157 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:50.178 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:10:50.178 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.66898.asok status 2020-04-22T14:10:50.336 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:10:50.336 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2020-04-22T14:10:50.336 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:10:50.336 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:10:50.336 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "0", 2020-04-22T14:10:50.337 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:10:50.337 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-04-22T14:10:50.337 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "66898", 2020-04-22T14:10:50.337 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:10:50.337 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:50.337 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2020-04-22T14:10:50.337 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2020-04-22T14:10:50.338 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 5189, 2020-04-22T14:10:50.338 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2020-04-22T14:10:50.338 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:10:50.338 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:10:50.338 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5189 2020-04-22T14:10:50.338 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:50.338 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:10:50.338 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:10:50.339 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:0", 2020-04-22T14:10:50.339 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 3218856707 2020-04-22T14:10:50.339 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:50.339 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:50.339 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:10:50.339 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:10:50.339 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:0", 2020-04-22T14:10:50.340 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 3218856707 2020-04-22T14:10:50.340 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:50.340 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.5189 172.21.15.103:0/3218856707", 2020-04-22T14:10:50.340 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "172.21.15.103:0/3218856707", 2020-04-22T14:10:50.340 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2020-04-22T14:10:50.340 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 36, 2020-04-22T14:10:50.340 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 64, 2020-04-22T14:10:50.341 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2020-04-22T14:10:50.341 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklisted": false 2020-04-22T14:10:50.341 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:10:50.341 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:50.371 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:10:50.371 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-22T14:10:50.371 INFO:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:10:50.433 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2020-04-22T14:10:50.589 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-04-22T14:10:50.589 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:50.603 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:10:50.604 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:10:50.682 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:50.727 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:10:50.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.871+0000 7fca20527700 1 Processor -- start 2020-04-22T14:10:50.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.871+0000 7fca20527700 1 -- start start 2020-04-22T14:10:50.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.872+0000 7fca20527700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fca18065fe0 0x7fca181464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:50.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.872+0000 7fca20527700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fca18063e30 0x7fca180642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:50.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.872+0000 7fca20527700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca18143300 con 0x7fca1812c0d0 2020-04-22T14:10:50.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.872+0000 7fca20527700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca181435a0 con 0x7fca18065fe0 2020-04-22T14:10:50.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.872+0000 7fca20527700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca18143840 con 0x7fca18063e30 2020-04-22T14:10:50.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.872+0000 7fca1eac4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fca18063e30 0x7fca180642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:50.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.872+0000 7fca1dac2700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fca18065fe0 0x7fca181464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:50.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.872+0000 7fca1dac2700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fca18065fe0 0x7fca181464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:48706/0 (socket says 172.21.15.103:48706) 2020-04-22T14:10:50.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.872+0000 7fca1eac4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fca18063e30 0x7fca180642c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:36252/0 (socket says 172.21.15.103:36252) 2020-04-22T14:10:50.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.872+0000 7fca1dac2700 1 -- 172.21.15.103:0/4012482420 learned_addr learned my addr 172.21.15.103:0/4012482420 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:10:50.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.872+0000 7fca1e2c3700 1 --1- 172.21.15.103:0/4012482420 >> v1:172.21.15.86:6789/0 conn(0x7fca1812c0d0 0x7fca1805b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:60820/0 (socket says 172.21.15.103:60820) 2020-04-22T14:10:50.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.873+0000 7fca1dac2700 1 -- 172.21.15.103:0/4012482420 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fca18063e30 msgr2=0x7fca180642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:50.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.873+0000 7fca1dac2700 1 --2- 172.21.15.103:0/4012482420 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fca18063e30 0x7fca180642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:50.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.873+0000 7fca1dac2700 1 -- 172.21.15.103:0/4012482420 >> v1:172.21.15.86:6789/0 conn(0x7fca1812c0d0 legacy=0x7fca1805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:50.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.873+0000 7fca1d2c1700 1 -- 172.21.15.103:0/4012482420 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2349033227 0 0) 0x7fca18143300 con 0x7fca1812c0d0 2020-04-22T14:10:50.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.873+0000 7fca1dac2700 1 -- 172.21.15.103:0/4012482420 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca1805bb50 con 0x7fca18065fe0 2020-04-22T14:10:50.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.873+0000 7fca1eac4700 1 --2- 172.21.15.103:0/4012482420 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fca18063e30 0x7fca180642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:10:50.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.873+0000 7fca1dac2700 1 --2- 172.21.15.103:0/4012482420 >> v2:172.21.15.86:3300/0 conn(0x7fca18065fe0 0x7fca181464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fca14002f30 tx=0x7fca14007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:50.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.873+0000 7fca1dac2700 1 --2- 172.21.15.103:0/4012482420 >> v2:172.21.15.86:3300/0 conn(0x7fca18065fe0 0x7fca181464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fca14002f30 tx=0x7fca14007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:50.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.873+0000 7fca1dac2700 1 --2- 172.21.15.103:0/4012482420 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca18065fe0 0x7fca181464e0 secure :-1 s=READY pgs=484 cs=0 l=1 rx=0x7fca14002f30 tx=0x7fca14007a40).ready entity=mon.0 client_cookie=1ca807c3448ba80f server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:50.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.873+0000 7fca1dac2700 1 --2- 172.21.15.103:0/4012482420 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca18065fe0 0x7fca181464e0 secure :-1 s=THROTTLE_DONE pgs=484 cs=0 l=1 rx=0x7fca14002f30 tx=0x7fca14007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:50.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.873+0000 7fca1d2c1700 1 -- 172.21.15.103:0/4012482420 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca14011670 con 0x7fca18065fe0 2020-04-22T14:10:50.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.873+0000 7fca1dac2700 1 --2- 172.21.15.103:0/4012482420 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca18065fe0 0x7fca181464e0 secure :-1 s=THROTTLE_DONE pgs=484 cs=0 l=1 rx=0x7fca14002f30 tx=0x7fca14007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:50.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.873+0000 7fca1d2c1700 1 -- 172.21.15.103:0/4012482420 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca14011810 con 0x7fca18065fe0 2020-04-22T14:10:50.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.873+0000 7fca1dac2700 1 --2- 172.21.15.103:0/4012482420 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca18065fe0 0x7fca181464e0 secure :-1 s=THROTTLE_DONE pgs=484 cs=0 l=1 rx=0x7fca14002f30 tx=0x7fca14007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:50.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.873+0000 7fca20527700 1 -- 172.21.15.103:0/4012482420 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca18065fe0 msgr2=0x7fca181464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:50.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.873+0000 7fca20527700 1 --2- 172.21.15.103:0/4012482420 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca18065fe0 0x7fca181464e0 secure :-1 s=READY pgs=484 cs=0 l=1 rx=0x7fca14002f30 tx=0x7fca14007a40).stop 2020-04-22T14:10:50.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.873+0000 7fca1d2c1700 1 -- 172.21.15.103:0/4012482420 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca14011bf0 con 0x7fca18065fe0 2020-04-22T14:10:50.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.874+0000 7fca20527700 1 -- 172.21.15.103:0/4012482420 shutdown_connections 2020-04-22T14:10:50.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.874+0000 7fca20527700 1 --2- 172.21.15.103:0/4012482420 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fca18063e30 0x7fca180642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:50.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.874+0000 7fca20527700 1 --2- 172.21.15.103:0/4012482420 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca18065fe0 0x7fca181464e0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:50.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.874+0000 7fca20527700 1 -- 172.21.15.103:0/4012482420 >> 172.21.15.103:0/4012482420 conn(0x7fca180b9160 msgr2=0x7fca1805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:50.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.874+0000 7fca20527700 1 -- 172.21.15.103:0/4012482420 shutdown_connections 2020-04-22T14:10:50.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.874+0000 7fca20527700 1 -- 172.21.15.103:0/4012482420 wait complete. 2020-04-22T14:10:50.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.875+0000 7fca20527700 1 Processor -- start 2020-04-22T14:10:50.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.875+0000 7fca20527700 1 -- start start 2020-04-22T14:10:50.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.875+0000 7fca20527700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fca18063e30 0x7fca18154900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:50.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.875+0000 7fca20527700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fca1812c0d0 0x7fca18122920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:50.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.875+0000 7fca20527700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca18122d80 con 0x7fca18065fe0 2020-04-22T14:10:50.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.875+0000 7fca20527700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca181485b0 con 0x7fca1812c0d0 2020-04-22T14:10:50.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.875+0000 7fca20527700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca18154d60 con 0x7fca18063e30 2020-04-22T14:10:50.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.876+0000 7fca1eac4700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fca1812c0d0 0x7fca18122920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:50.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.876+0000 7fca1eac4700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fca1812c0d0 0x7fca18122920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51484/0 (socket says 172.21.15.103:51484) 2020-04-22T14:10:50.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.876+0000 7fca1eac4700 1 -- 172.21.15.103:0/1449741394 learned_addr learned my addr 172.21.15.103:0/1449741394 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:10:50.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.876+0000 7fca1e2c3700 1 --2- 172.21.15.103:0/1449741394 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fca18063e30 0x7fca18154900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:50.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.876+0000 7fca1eac4700 1 -- 172.21.15.103:0/1449741394 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fca18063e30 msgr2=0x7fca18154900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:50.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.876+0000 7fca1eac4700 1 --2- 172.21.15.103:0/1449741394 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fca18063e30 0x7fca18154900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:50.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.876+0000 7fca1eac4700 1 -- 172.21.15.103:0/1449741394 >> v1:172.21.15.86:6789/0 conn(0x7fca18065fe0 legacy=0x7fca180b7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:50.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.876+0000 7fca1eac4700 1 -- 172.21.15.103:0/1449741394 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca18157670 con 0x7fca1812c0d0 2020-04-22T14:10:50.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.876+0000 7fca1eac4700 1 --2- 172.21.15.103:0/1449741394 >> v2:172.21.15.103:3300/0 conn(0x7fca1812c0d0 0x7fca18122920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fca18124430 tx=0x7fca10011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:50.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.876+0000 7fca1eac4700 1 --2- 172.21.15.103:0/1449741394 >> v2:172.21.15.103:3300/0 conn(0x7fca1812c0d0 0x7fca18122920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fca18124430 tx=0x7fca10011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:50.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.876+0000 7fca1eac4700 1 --2- 172.21.15.103:0/1449741394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca1812c0d0 0x7fca18122920 secure :-1 s=READY pgs=850 cs=0 l=1 rx=0x7fca18124430 tx=0x7fca10011130).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:50.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.876+0000 7fca1eac4700 1 --2- 172.21.15.103:0/1449741394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca1812c0d0 0x7fca18122920 secure :-1 s=THROTTLE_DONE pgs=850 cs=0 l=1 rx=0x7fca18124430 tx=0x7fca10011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:50.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.876+0000 7fca077fe700 1 -- 172.21.15.103:0/1449741394 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca10005e30 con 0x7fca1812c0d0 2020-04-22T14:10:50.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.876+0000 7fca1eac4700 1 --2- 172.21.15.103:0/1449741394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca1812c0d0 0x7fca18122920 secure :-1 s=THROTTLE_DONE pgs=850 cs=0 l=1 rx=0x7fca18124430 tx=0x7fca10011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:50.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.876+0000 7fca1eac4700 1 --2- 172.21.15.103:0/1449741394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca1812c0d0 0x7fca18122920 secure :-1 s=THROTTLE_DONE pgs=850 cs=0 l=1 rx=0x7fca18124430 tx=0x7fca10011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:50.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.876+0000 7fca077fe700 1 -- 172.21.15.103:0/1449741394 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca1000cbf0 con 0x7fca1812c0d0 2020-04-22T14:10:50.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.876+0000 7fca077fe700 1 -- 172.21.15.103:0/1449741394 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca1000cd60 con 0x7fca1812c0d0 2020-04-22T14:10:50.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.876+0000 7fca20527700 1 -- 172.21.15.103:0/1449741394 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca18157910 con 0x7fca1812c0d0 2020-04-22T14:10:50.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.876+0000 7fca20527700 1 -- 172.21.15.103:0/1449741394 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca181572f0 con 0x7fca1812c0d0 2020-04-22T14:10:50.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.877+0000 7fca1eac4700 1 --2- 172.21.15.103:0/1449741394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca1812c0d0 0x7fca18122920 secure :-1 s=THROTTLE_DONE pgs=850 cs=0 l=1 rx=0x7fca18124430 tx=0x7fca10011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:50.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.877+0000 7fca20527700 1 -- 172.21.15.103:0/1449741394 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca18158210 con 0x7fca1812c0d0 2020-04-22T14:10:50.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.877+0000 7fca077fe700 1 -- 172.21.15.103:0/1449741394 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fca1000e1a0 con 0x7fca1812c0d0 2020-04-22T14:10:50.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.877+0000 7fca1eac4700 1 --2- 172.21.15.103:0/1449741394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca1812c0d0 0x7fca18122920 secure :-1 s=THROTTLE_DONE pgs=850 cs=0 l=1 rx=0x7fca18124430 tx=0x7fca10011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:50.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.877+0000 7fca077fe700 1 --2- 172.21.15.103:0/1449741394 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc9f804d930 0x7fc9f804fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:50.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.878+0000 7fca077fe700 1 -- 172.21.15.103:0/1449741394 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fca100615e0 con 0x7fca1812c0d0 2020-04-22T14:10:50.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.878+0000 7fca1e2c3700 1 --2- 172.21.15.103:0/1449741394 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc9f804d930 0x7fc9f804fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:50.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.878+0000 7fca1e2c3700 1 --2- 172.21.15.103:0/1449741394 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc9f804d930 0x7fc9f804fdf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fca08000b80 tx=0x7fca08001940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:50.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.878+0000 7fca1e2c3700 1 --2- 172.21.15.103:0/1449741394 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc9f804d930 0x7fc9f804fdf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fca08000b80 tx=0x7fca08001940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:50.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.878+0000 7fca1e2c3700 1 --2- 172.21.15.103:0/1449741394 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc9f804d930 0x7fc9f804fdf0 secure :-1 s=READY pgs=320 cs=0 l=1 rx=0x7fca08000b80 tx=0x7fca08001940).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:50.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.881+0000 7fca1eac4700 1 --2- 172.21.15.103:0/1449741394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca1812c0d0 0x7fca18122920 secure :-1 s=THROTTLE_DONE pgs=850 cs=0 l=1 rx=0x7fca18124430 tx=0x7fca10011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:50.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:50.882+0000 7fca077fe700 1 -- 172.21.15.103:0/1449741394 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fca1003c960 con 0x7fca1812c0d0 2020-04-22T14:10:51.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.023+0000 7fca20527700 1 -- 172.21.15.103:0/1449741394 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca18056c90 con 0x7fca1812c0d0 2020-04-22T14:10:51.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.024+0000 7fca1eac4700 1 --2- 172.21.15.103:0/1449741394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca1812c0d0 0x7fca18122920 secure :-1 s=THROTTLE_DONE pgs=850 cs=0 l=1 rx=0x7fca18124430 tx=0x7fca10011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.024+0000 7fca077fe700 1 -- 172.21.15.103:0/1449741394 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16092 (secure 0 0 0) 0x7fca1003ff80 con 0x7fca1812c0d0 2020-04-22T14:10:51.026 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:10:51.026 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":64,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:10:39.819711+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:10:36.758101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2020-04-22T14:10:37.765010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:10:51.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.025+0000 7fca20527700 1 -- 172.21.15.103:0/1449741394 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc9f804d930 msgr2=0x7fc9f804fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:51.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.025+0000 7fca20527700 1 --2- 172.21.15.103:0/1449741394 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc9f804d930 0x7fc9f804fdf0 secure :-1 s=READY pgs=320 cs=0 l=1 rx=0x7fca08000b80 tx=0x7fca08001940).stop 2020-04-22T14:10:51.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.025+0000 7fca20527700 1 -- 172.21.15.103:0/1449741394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca1812c0d0 msgr2=0x7fca18122920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:51.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.025+0000 7fca20527700 1 --2- 172.21.15.103:0/1449741394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca1812c0d0 0x7fca18122920 secure :-1 s=READY pgs=850 cs=0 l=1 rx=0x7fca18124430 tx=0x7fca10011130).stop 2020-04-22T14:10:51.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.025+0000 7fca20527700 1 -- 172.21.15.103:0/1449741394 shutdown_connections 2020-04-22T14:10:51.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.025+0000 7fca20527700 1 --2- 172.21.15.103:0/1449741394 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc9f804d930 0x7fc9f804fdf0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:51.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.025+0000 7fca20527700 1 --2- 172.21.15.103:0/1449741394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca1812c0d0 0x7fca18122920 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:51.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.025+0000 7fca20527700 1 --2- 172.21.15.103:0/1449741394 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fca18063e30 0x7fca18154900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:51.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.025+0000 7fca20527700 1 -- 172.21.15.103:0/1449741394 >> 172.21.15.103:0/1449741394 conn(0x7fca180b9160 msgr2=0x7fca180615e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:51.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.025+0000 7fca20527700 1 -- 172.21.15.103:0/1449741394 shutdown_connections 2020-04-22T14:10:51.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.025+0000 7fca20527700 1 -- 172.21.15.103:0/1449741394 wait complete. 2020-04-22T14:10:51.037 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:10:36.758101+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 11, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'63', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:10:37.765010+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 12, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'64', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:10:51.038 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:51.051 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:10:51.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.198+0000 7fb12892d700 1 Processor -- start 2020-04-22T14:10:51.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.198+0000 7fb12892d700 1 -- start start 2020-04-22T14:10:51.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.199+0000 7fb12892d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb1240b9140 0x7fb12412b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:51.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.199+0000 7fb12892d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb1240ac950 0x7fb12412b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:51.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.199+0000 7fb12892d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1241467e0 con 0x7fb124146c40 2020-04-22T14:10:51.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.199+0000 7fb12892d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1240602f0 con 0x7fb1240ac950 2020-04-22T14:10:51.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.199+0000 7fb12892d700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb124060050 con 0x7fb1240b9140 2020-04-22T14:10:51.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.199+0000 7fb12259c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb1240b9140 0x7fb12412b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:51.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.199+0000 7fb12259c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb1240b9140 0x7fb12412b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51488/0 (socket says 172.21.15.103:51488) 2020-04-22T14:10:51.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.199+0000 7fb12259c700 1 -- 172.21.15.103:0/1237150354 learned_addr learned my addr 172.21.15.103:0/1237150354 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:10:51.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.199+0000 7fb121d9b700 1 --2- 172.21.15.103:0/1237150354 >> v2:172.21.15.86:3300/0 conn(0x7fb1240ac950 0x7fb12412b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:51.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.200+0000 7fb12259c700 1 -- 172.21.15.103:0/1237150354 >> v2:172.21.15.86:3300/0 conn(0x7fb1240ac950 msgr2=0x7fb12412b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:51.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.200+0000 7fb12259c700 1 --2- 172.21.15.103:0/1237150354 >> v2:172.21.15.86:3300/0 conn(0x7fb1240ac950 0x7fb12412b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:51.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.200+0000 7fb12259c700 1 -- 172.21.15.103:0/1237150354 >> v1:172.21.15.86:6789/0 conn(0x7fb124146c40 legacy=0x7fb124143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:51.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.200+0000 7fb12259c700 1 -- 172.21.15.103:0/1237150354 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1240b9520 con 0x7fb1240b9140 2020-04-22T14:10:51.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.200+0000 7fb12259c700 1 --2- 172.21.15.103:0/1237150354 >> v2:172.21.15.103:3300/0 conn(0x7fb1240b9140 0x7fb12412b210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb118002f30 tx=0x7fb118007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.200+0000 7fb12259c700 1 --2- 172.21.15.103:0/1237150354 >> v2:172.21.15.103:3300/0 conn(0x7fb1240b9140 0x7fb12412b210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb118002f30 tx=0x7fb118007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.200+0000 7fb12259c700 1 --2- 172.21.15.103:0/1237150354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1240b9140 0x7fb12412b210 secure :-1 s=READY pgs=851 cs=0 l=1 rx=0x7fb118002f30 tx=0x7fb118007a40).ready entity=mon.1 client_cookie=973c568517b9781e server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:51.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.200+0000 7fb12259c700 1 --2- 172.21.15.103:0/1237150354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1240b9140 0x7fb12412b210 secure :-1 s=THROTTLE_DONE pgs=851 cs=0 l=1 rx=0x7fb118002f30 tx=0x7fb118007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.200+0000 7fb12259c700 1 --2- 172.21.15.103:0/1237150354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1240b9140 0x7fb12412b210 secure :-1 s=THROTTLE_DONE pgs=851 cs=0 l=1 rx=0x7fb118002f30 tx=0x7fb118007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.200+0000 7fb12159a700 1 -- 172.21.15.103:0/1237150354 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb118011670 con 0x7fb1240b9140 2020-04-22T14:10:51.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.200+0000 7fb12259c700 1 --2- 172.21.15.103:0/1237150354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1240b9140 0x7fb12412b210 secure :-1 s=THROTTLE_DONE pgs=851 cs=0 l=1 rx=0x7fb118002f30 tx=0x7fb118007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.200+0000 7fb12159a700 1 -- 172.21.15.103:0/1237150354 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1180117d0 con 0x7fb1240b9140 2020-04-22T14:10:51.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.200+0000 7fb12159a700 1 -- 172.21.15.103:0/1237150354 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb118011bf0 con 0x7fb1240b9140 2020-04-22T14:10:51.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.200+0000 7fb12892d700 1 -- 172.21.15.103:0/1237150354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1240b9140 msgr2=0x7fb12412b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:51.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.200+0000 7fb12892d700 1 --2- 172.21.15.103:0/1237150354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1240b9140 0x7fb12412b210 secure :-1 s=READY pgs=851 cs=0 l=1 rx=0x7fb118002f30 tx=0x7fb118007a40).stop 2020-04-22T14:10:51.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.200+0000 7fb12892d700 1 -- 172.21.15.103:0/1237150354 shutdown_connections 2020-04-22T14:10:51.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.200+0000 7fb12892d700 1 --2- 172.21.15.103:0/1237150354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1240b9140 0x7fb12412b210 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:51.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.200+0000 7fb12892d700 1 --2- 172.21.15.103:0/1237150354 >> v2:172.21.15.86:3300/0 conn(0x7fb1240ac950 0x7fb12412b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:51.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.200+0000 7fb12892d700 1 -- 172.21.15.103:0/1237150354 >> 172.21.15.103:0/1237150354 conn(0x7fb12405b7b0 msgr2=0x7fb1240b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:51.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.200+0000 7fb12892d700 1 -- 172.21.15.103:0/1237150354 shutdown_connections 2020-04-22T14:10:51.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.200+0000 7fb12892d700 1 -- 172.21.15.103:0/1237150354 wait complete. 2020-04-22T14:10:51.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.201+0000 7fb12892d700 1 Processor -- start 2020-04-22T14:10:51.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.201+0000 7fb12892d700 1 -- start start 2020-04-22T14:10:51.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.202+0000 7fb12892d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb1240b9140 0x7fb1241273b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:51.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.202+0000 7fb12892d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb12413dc60 con 0x7fb124146c40 2020-04-22T14:10:51.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.202+0000 7fb12892d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb12413df00 con 0x7fb1240ac950 2020-04-22T14:10:51.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.202+0000 7fb12892d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb12413e3a0 con 0x7fb1240b9140 2020-04-22T14:10:51.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.202+0000 7fb12259c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb1240ac950 0x7fb124126ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43682/0 (socket says 172.21.15.103:43682) 2020-04-22T14:10:51.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.202+0000 7fb12259c700 1 -- 172.21.15.103:0/2324144441 learned_addr learned my addr 172.21.15.103:0/2324144441 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:51.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.202+0000 7fb121d9b700 1 --2- 172.21.15.103:0/2324144441 >> v2:172.21.15.86:3300/0 conn(0x7fb1240b9140 0x7fb1241273b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:51.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.202+0000 7fb1137fe700 1 -- 172.21.15.103:0/2324144441 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3920943783 0 0) 0x7fb12413df00 con 0x7fb1240ac950 2020-04-22T14:10:51.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.202+0000 7fb1137fe700 1 -- 172.21.15.103:0/2324144441 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb100002fe0 con 0x7fb1240ac950 2020-04-22T14:10:51.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.203+0000 7fb121d9b700 1 -- 172.21.15.103:0/2324144441 >> v1:172.21.15.103:6789/0 conn(0x7fb1240ac950 legacy=0x7fb124126ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:51.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.203+0000 7fb1137fe700 1 -- 172.21.15.103:0/2324144441 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 938645180 0 0) 0x7fb100002fe0 con 0x7fb1240ac950 2020-04-22T14:10:51.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.203+0000 7fb121d9b700 1 -- 172.21.15.103:0/2324144441 >> v1:172.21.15.86:6789/0 conn(0x7fb124146c40 legacy=0x7fb1240b0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:51.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.203+0000 7fb121d9b700 1 -- 172.21.15.103:0/2324144441 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1240af7f0 con 0x7fb1240b9140 2020-04-22T14:10:51.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.203+0000 7fb121d9b700 1 --2- 172.21.15.103:0/2324144441 >> v2:172.21.15.86:3300/0 conn(0x7fb1240b9140 0x7fb1241273b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb11c001360 tx=0x7fb114010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.214 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.203+0000 7fb121d9b700 1 --2- 172.21.15.103:0/2324144441 >> v2:172.21.15.86:3300/0 conn(0x7fb1240b9140 0x7fb1241273b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb11c001360 tx=0x7fb114010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.214 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.203+0000 7fb121d9b700 1 --2- 172.21.15.103:0/2324144441 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1240b9140 0x7fb1241273b0 secure :-1 s=READY pgs=488 cs=0 l=1 rx=0x7fb11c001360 tx=0x7fb114010bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:51.214 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.203+0000 7fb121d9b700 1 --2- 172.21.15.103:0/2324144441 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1240b9140 0x7fb1241273b0 secure :-1 s=THROTTLE_DONE pgs=488 cs=0 l=1 rx=0x7fb11c001360 tx=0x7fb114010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.214 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.203+0000 7fb1137fe700 1 -- 172.21.15.103:0/2324144441 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb118011e60 con 0x7fb1240b9140 2020-04-22T14:10:51.214 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.203+0000 7fb121d9b700 1 --2- 172.21.15.103:0/2324144441 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1240b9140 0x7fb1241273b0 secure :-1 s=THROTTLE_DONE pgs=488 cs=0 l=1 rx=0x7fb11c001360 tx=0x7fb114010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.214 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.203+0000 7fb1137fe700 1 -- 172.21.15.103:0/2324144441 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1140058b0 con 0x7fb1240b9140 2020-04-22T14:10:51.214 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.203+0000 7fb12892d700 1 -- 172.21.15.103:0/2324144441 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1240afa40 con 0x7fb1240b9140 2020-04-22T14:10:51.214 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.203+0000 7fb121d9b700 1 --2- 172.21.15.103:0/2324144441 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1240b9140 0x7fb1241273b0 secure :-1 s=THROTTLE_DONE pgs=488 cs=0 l=1 rx=0x7fb11c001360 tx=0x7fb114010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.203+0000 7fb1137fe700 1 -- 172.21.15.103:0/2324144441 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb114005c10 con 0x7fb1240b9140 2020-04-22T14:10:51.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.203+0000 7fb12892d700 1 -- 172.21.15.103:0/2324144441 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1241295c0 con 0x7fb1240b9140 2020-04-22T14:10:51.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.204+0000 7fb121d9b700 1 --2- 172.21.15.103:0/2324144441 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1240b9140 0x7fb1241273b0 secure :-1 s=THROTTLE_DONE pgs=488 cs=0 l=1 rx=0x7fb11c001360 tx=0x7fb114010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.204+0000 7fb12892d700 1 -- 172.21.15.103:0/2324144441 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb12413e090 con 0x7fb1240b9140 2020-04-22T14:10:51.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.204+0000 7fb1137fe700 1 -- 172.21.15.103:0/2324144441 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fb1140123d0 con 0x7fb1240b9140 2020-04-22T14:10:51.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.204+0000 7fb121d9b700 1 --2- 172.21.15.103:0/2324144441 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1240b9140 0x7fb1241273b0 secure :-1 s=THROTTLE_DONE pgs=488 cs=0 l=1 rx=0x7fb11c001360 tx=0x7fb114010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.204+0000 7fb1137fe700 1 --2- 172.21.15.103:0/2324144441 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb10004dca0 0x7fb100050160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:51.216 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.204+0000 7fb1137fe700 1 -- 172.21.15.103:0/2324144441 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb11400d080 con 0x7fb1240b9140 2020-04-22T14:10:51.216 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.205+0000 7fb12259c700 1 --2- 172.21.15.103:0/2324144441 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb10004dca0 0x7fb100050160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:51.216 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.205+0000 7fb12259c700 1 --2- 172.21.15.103:0/2324144441 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb10004dca0 0x7fb100050160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb118011fc0 tx=0x7fb118007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.216 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.205+0000 7fb12259c700 1 --2- 172.21.15.103:0/2324144441 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb10004dca0 0x7fb100050160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb118011fc0 tx=0x7fb118007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.216 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.205+0000 7fb12259c700 1 --2- 172.21.15.103:0/2324144441 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb10004dca0 0x7fb100050160 secure :-1 s=READY pgs=321 cs=0 l=1 rx=0x7fb118011fc0 tx=0x7fb118007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:51.216 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.208+0000 7fb121d9b700 1 --2- 172.21.15.103:0/2324144441 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1240b9140 0x7fb1241273b0 secure :-1 s=THROTTLE_DONE pgs=488 cs=0 l=1 rx=0x7fb11c001360 tx=0x7fb114010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.217 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.208+0000 7fb1137fe700 1 -- 172.21.15.103:0/2324144441 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fb114033440 con 0x7fb1240b9140 2020-04-22T14:10:51.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.353+0000 7fb12892d700 1 -- 172.21.15.103:0/2324144441 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb124056c90 con 0x7fb1240b9140 2020-04-22T14:10:51.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.354+0000 7fb121d9b700 1 --2- 172.21.15.103:0/2324144441 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1240b9140 0x7fb1241273b0 secure :-1 s=THROTTLE_DONE pgs=488 cs=0 l=1 rx=0x7fb11c001360 tx=0x7fb114010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.354+0000 7fb1137fe700 1 -- 172.21.15.103:0/2324144441 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v64) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb11403c270 con 0x7fb1240b9140 2020-04-22T14:10:51.356 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:10:51.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.355+0000 7fb12892d700 1 -- 172.21.15.103:0/2324144441 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb10004dca0 msgr2=0x7fb100050160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:51.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.355+0000 7fb12892d700 1 --2- 172.21.15.103:0/2324144441 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb10004dca0 0x7fb100050160 secure :-1 s=READY pgs=321 cs=0 l=1 rx=0x7fb118011fc0 tx=0x7fb118007a40).stop 2020-04-22T14:10:51.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.355+0000 7fb12892d700 1 -- 172.21.15.103:0/2324144441 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1240b9140 msgr2=0x7fb1241273b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:51.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.355+0000 7fb12892d700 1 --2- 172.21.15.103:0/2324144441 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1240b9140 0x7fb1241273b0 secure :-1 s=READY pgs=488 cs=0 l=1 rx=0x7fb11c001360 tx=0x7fb114010bd0).stop 2020-04-22T14:10:51.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.355+0000 7fb12892d700 1 -- 172.21.15.103:0/2324144441 shutdown_connections 2020-04-22T14:10:51.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.355+0000 7fb12892d700 1 --2- 172.21.15.103:0/2324144441 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb10004dca0 0x7fb100050160 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:51.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.355+0000 7fb12892d700 1 --2- 172.21.15.103:0/2324144441 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1240b9140 0x7fb1241273b0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:51.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.355+0000 7fb12892d700 1 -- 172.21.15.103:0/2324144441 >> 172.21.15.103:0/2324144441 conn(0x7fb12405b7b0 msgr2=0x7fb12414df40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:51.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.355+0000 7fb12892d700 1 -- 172.21.15.103:0/2324144441 shutdown_connections 2020-04-22T14:10:51.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.355+0000 7fb12892d700 1 -- 172.21.15.103:0/2324144441 wait complete. 2020-04-22T14:10:51.369 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:51.383 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:10:51.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.531+0000 7fd2d86af700 1 Processor -- start 2020-04-22T14:10:51.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.531+0000 7fd2d86af700 1 -- start start 2020-04-22T14:10:51.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.532+0000 7fd2d86af700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2d00b3bd0 0x7fd2d0143650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:51.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.532+0000 7fd2d86af700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2d0148310 con 0x7fd2d00b9140 2020-04-22T14:10:51.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.532+0000 7fd2d86af700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2d01485b0 con 0x7fd2d0143ab0 2020-04-22T14:10:51.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.532+0000 7fd2d86af700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d00b9520 con 0x7fd2d00b3bd0 2020-04-22T14:10:51.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.532+0000 7fd2d6c4c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd2d0143ab0 0x7fd2d0143f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43692/0 (socket says 172.21.15.103:43692) 2020-04-22T14:10:51.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.532+0000 7fd2d6c4c700 1 -- 172.21.15.103:0/3928190359 learned_addr learned my addr 172.21.15.103:0/3928190359 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:51.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.532+0000 7fd2d5c4a700 1 --2- 172.21.15.103:0/3928190359 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2d00b3bd0 0x7fd2d0143650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:51.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.532+0000 7fd2d5449700 1 -- 172.21.15.103:0/3928190359 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1325248475 0 0) 0x7fd2d01485b0 con 0x7fd2d0143ab0 2020-04-22T14:10:51.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.532+0000 7fd2d5449700 1 -- 172.21.15.103:0/3928190359 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2b8003230 con 0x7fd2d0143ab0 2020-04-22T14:10:51.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.533+0000 7fd2d5449700 1 -- 172.21.15.103:0/3928190359 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4263010466 0 0) 0x7fd2d0148310 con 0x7fd2d00b9140 2020-04-22T14:10:51.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.533+0000 7fd2d5449700 1 -- 172.21.15.103:0/3928190359 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2d01485b0 con 0x7fd2d00b9140 2020-04-22T14:10:51.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.533+0000 7fd2d5449700 1 -- 172.21.15.103:0/3928190359 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4176113500 0 0) 0x7fd2b8003230 con 0x7fd2d0143ab0 2020-04-22T14:10:51.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.533+0000 7fd2d5449700 1 -- 172.21.15.103:0/3928190359 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2d00b3bd0 msgr2=0x7fd2d0143650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:51.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.533+0000 7fd2d5449700 1 --2- 172.21.15.103:0/3928190359 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2d00b3bd0 0x7fd2d0143650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:51.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.533+0000 7fd2d5449700 1 -- 172.21.15.103:0/3928190359 >> v1:172.21.15.86:6789/0 conn(0x7fd2d00b9140 legacy=0x7fd2d00aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:51.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.533+0000 7fd2d5449700 1 -- 172.21.15.103:0/3928190359 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d00b3050 con 0x7fd2d0143ab0 2020-04-22T14:10:51.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.533+0000 7fd2d5449700 1 -- 172.21.15.103:0/3928190359 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fd2c8001a50 con 0x7fd2d0143ab0 2020-04-22T14:10:51.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.533+0000 7fd2d5449700 1 -- 172.21.15.103:0/3928190359 >> v1:172.21.15.103:6789/0 conn(0x7fd2d0143ab0 legacy=0x7fd2d0143f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:51.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.533+0000 7fd2d5449700 1 --2- 172.21.15.103:0/3928190359 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2d00b3bd0 0x7fd2b80038b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:51.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.533+0000 7fd2d5449700 1 --2- 172.21.15.103:0/3928190359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2b8003d60 0x7fd2b80044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:51.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.533+0000 7fd2d5449700 1 --2- 172.21.15.103:0/3928190359 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2b8004930 0x7fd2b8004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:51.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.533+0000 7fd2d5449700 1 -- 172.21.15.103:0/3928190359 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d00b9520 con 0x7fd2b8004930 2020-04-22T14:10:51.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.533+0000 7fd2d5449700 1 -- 172.21.15.103:0/3928190359 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b8005210 con 0x7fd2b8003d60 2020-04-22T14:10:51.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.533+0000 7fd2d5449700 1 -- 172.21.15.103:0/3928190359 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b800b720 con 0x7fd2d00b3bd0 2020-04-22T14:10:51.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.533+0000 7fd2d5c4a700 1 --2- 172.21.15.103:0/3928190359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2b8003d60 0x7fd2b80044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:51.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.533+0000 7fd2d644b700 1 --2- 172.21.15.103:0/3928190359 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2d00b3bd0 0x7fd2b80038b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:51.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.533+0000 7fd2d6c4c700 1 --2- 172.21.15.103:0/3928190359 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2b8004930 0x7fd2b8004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:51.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.533+0000 7fd2d5c4a700 1 -- 172.21.15.103:0/3928190359 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2d00b3bd0 msgr2=0x7fd2b80038b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:51.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.533+0000 7fd2d5c4a700 1 --2- 172.21.15.103:0/3928190359 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2d00b3bd0 0x7fd2b80038b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:51.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.533+0000 7fd2d5c4a700 1 -- 172.21.15.103:0/3928190359 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2b8004930 msgr2=0x7fd2b8004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:51.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.533+0000 7fd2d5c4a700 1 --2- 172.21.15.103:0/3928190359 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2b8004930 0x7fd2b8004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:51.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.533+0000 7fd2d5c4a700 1 -- 172.21.15.103:0/3928190359 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b8003230 con 0x7fd2b8003d60 2020-04-22T14:10:51.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.533+0000 7fd2d5c4a700 1 --2- 172.21.15.103:0/3928190359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2b8003d60 0x7fd2b80044d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd2cc002f30 tx=0x7fd2b8004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.533+0000 7fd2d5c4a700 1 --2- 172.21.15.103:0/3928190359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2b8003d60 0x7fd2b80044d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd2cc002f30 tx=0x7fd2b8004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.533+0000 7fd2d5c4a700 1 --2- 172.21.15.103:0/3928190359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2b8003d60 0x7fd2b80044d0 secure :-1 s=READY pgs=854 cs=0 l=1 rx=0x7fd2cc002f30 tx=0x7fd2b8004420).ready entity=mon.1 client_cookie=cf57083e7863c2bc server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:51.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.533+0000 7fd2d5c4a700 1 --2- 172.21.15.103:0/3928190359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2b8003d60 0x7fd2b80044d0 secure :-1 s=THROTTLE_DONE pgs=854 cs=0 l=1 rx=0x7fd2cc002f30 tx=0x7fd2b8004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.533+0000 7fd2d5c4a700 1 --2- 172.21.15.103:0/3928190359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2b8003d60 0x7fd2b80044d0 secure :-1 s=THROTTLE_DONE pgs=854 cs=0 l=1 rx=0x7fd2cc002f30 tx=0x7fd2b8004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.533+0000 7fd2d5449700 1 -- 172.21.15.103:0/3928190359 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2cc008dd0 con 0x7fd2b8003d60 2020-04-22T14:10:51.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.533+0000 7fd2d5c4a700 1 --2- 172.21.15.103:0/3928190359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2b8003d60 0x7fd2b80044d0 secure :-1 s=THROTTLE_DONE pgs=854 cs=0 l=1 rx=0x7fd2cc002f30 tx=0x7fd2b8004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.533+0000 7fd2d5449700 1 -- 172.21.15.103:0/3928190359 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2cc010820 con 0x7fd2b8003d60 2020-04-22T14:10:51.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.533+0000 7fd2d5449700 1 -- 172.21.15.103:0/3928190359 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2cc010bc0 con 0x7fd2b8003d60 2020-04-22T14:10:51.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.534+0000 7fd2d86af700 1 -- 172.21.15.103:0/3928190359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2b8003d60 msgr2=0x7fd2b80044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:51.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.534+0000 7fd2d86af700 1 --2- 172.21.15.103:0/3928190359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2b8003d60 0x7fd2b80044d0 secure :-1 s=READY pgs=854 cs=0 l=1 rx=0x7fd2cc002f30 tx=0x7fd2b8004420).stop 2020-04-22T14:10:51.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.534+0000 7fd2d6c4c700 1 -- 172.21.15.103:0/3928190359 reap_dead start 2020-04-22T14:10:51.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.534+0000 7fd2d86af700 1 -- 172.21.15.103:0/3928190359 shutdown_connections 2020-04-22T14:10:51.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.534+0000 7fd2d86af700 1 -- 172.21.15.103:0/3928190359 >> 172.21.15.103:0/3928190359 conn(0x7fd2d005b7b0 msgr2=0x7fd2d00b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:51.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.534+0000 7fd2d86af700 1 -- 172.21.15.103:0/3928190359 shutdown_connections 2020-04-22T14:10:51.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.534+0000 7fd2d86af700 1 -- 172.21.15.103:0/3928190359 wait complete. 2020-04-22T14:10:51.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.535+0000 7fd2d86af700 1 Processor -- start 2020-04-22T14:10:51.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.535+0000 7fd2d86af700 1 -- start start 2020-04-22T14:10:51.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.536+0000 7fd2d86af700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2d0146990 0x7fd2d0145770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:51.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.536+0000 7fd2d86af700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd2d0145bd0 0x7fd2d0137f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:51.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.536+0000 7fd2d86af700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd2d01383e0 0x7fd2d00b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:51.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.536+0000 7fd2d86af700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2d0138830 con 0x7fd2d0145bd0 2020-04-22T14:10:51.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.536+0000 7fd2d86af700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2d00af920 con 0x7fd2d01383e0 2020-04-22T14:10:51.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.536+0000 7fd2d86af700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d00afbc0 con 0x7fd2d0146990 2020-04-22T14:10:51.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.536+0000 7fd2d6c4c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd2d01383e0 0x7fd2d00b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:51.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.536+0000 7fd2d6c4c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd2d01383e0 0x7fd2d00b0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51516/0 (socket says 172.21.15.103:51516) 2020-04-22T14:10:51.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.536+0000 7fd2d6c4c700 1 -- 172.21.15.103:0/3792312438 learned_addr learned my addr 172.21.15.103:0/3792312438 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:10:51.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.536+0000 7fd2d644b700 1 --2- 172.21.15.103:0/3792312438 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2d0146990 0x7fd2d0145770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:51.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.536+0000 7fd2d5c4a700 1 --2- 172.21.15.103:0/3792312438 >> v2:172.21.15.86:3300/0 conn(0x7fd2d0145bd0 0x7fd2d0137f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:51.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.536+0000 7fd2d6c4c700 1 -- 172.21.15.103:0/3792312438 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2d0146990 msgr2=0x7fd2d0145770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:51.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.536+0000 7fd2d6c4c700 1 --2- 172.21.15.103:0/3792312438 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2d0146990 0x7fd2d0145770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:51.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.536+0000 7fd2d6c4c700 1 -- 172.21.15.103:0/3792312438 >> v2:172.21.15.86:3300/0 conn(0x7fd2d0145bd0 msgr2=0x7fd2d0137f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:51.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.536+0000 7fd2d6c4c700 1 --2- 172.21.15.103:0/3792312438 >> v2:172.21.15.86:3300/0 conn(0x7fd2d0145bd0 0x7fd2d0137f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:51.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.536+0000 7fd2d6c4c700 1 -- 172.21.15.103:0/3792312438 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d00afe60 con 0x7fd2d01383e0 2020-04-22T14:10:51.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.536+0000 7fd2d6c4c700 1 --2- 172.21.15.103:0/3792312438 >> v2:172.21.15.103:3300/0 conn(0x7fd2d01383e0 0x7fd2d00b0cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd2c0001190 tx=0x7fd2d00b31e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.536+0000 7fd2d6c4c700 1 --2- 172.21.15.103:0/3792312438 >> v2:172.21.15.103:3300/0 conn(0x7fd2d01383e0 0x7fd2d00b0cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd2c0001190 tx=0x7fd2d00b31e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.536+0000 7fd2d6c4c700 1 --2- 172.21.15.103:0/3792312438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2d01383e0 0x7fd2d00b0cd0 secure :-1 s=READY pgs=855 cs=0 l=1 rx=0x7fd2c0001190 tx=0x7fd2d00b31e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:51.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.536+0000 7fd2d6c4c700 1 --2- 172.21.15.103:0/3792312438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2d01383e0 0x7fd2d00b0cd0 secure :-1 s=THROTTLE_DONE pgs=855 cs=0 l=1 rx=0x7fd2c0001190 tx=0x7fd2d00b31e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.536+0000 7fd2d6c4c700 1 --2- 172.21.15.103:0/3792312438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2d01383e0 0x7fd2d00b0cd0 secure :-1 s=THROTTLE_DONE pgs=855 cs=0 l=1 rx=0x7fd2c0001190 tx=0x7fd2d00b31e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.536+0000 7fd2bf7fe700 1 -- 172.21.15.103:0/3792312438 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2c800ce60 con 0x7fd2d01383e0 2020-04-22T14:10:51.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.536+0000 7fd2d6c4c700 1 --2- 172.21.15.103:0/3792312438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2d01383e0 0x7fd2d00b0cd0 secure :-1 s=THROTTLE_DONE pgs=855 cs=0 l=1 rx=0x7fd2c0001190 tx=0x7fd2d00b31e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.536+0000 7fd2bf7fe700 1 -- 172.21.15.103:0/3792312438 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c8009920 con 0x7fd2d01383e0 2020-04-22T14:10:51.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.536+0000 7fd2d86af700 1 -- 172.21.15.103:0/3792312438 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2d00b0100 con 0x7fd2d01383e0 2020-04-22T14:10:51.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.536+0000 7fd2bf7fe700 1 -- 172.21.15.103:0/3792312438 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2c8009c80 con 0x7fd2d01383e0 2020-04-22T14:10:51.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.536+0000 7fd2d86af700 1 -- 172.21.15.103:0/3792312438 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d00b1130 con 0x7fd2d01383e0 2020-04-22T14:10:51.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.537+0000 7fd2d6c4c700 1 --2- 172.21.15.103:0/3792312438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2d01383e0 0x7fd2d00b0cd0 secure :-1 s=THROTTLE_DONE pgs=855 cs=0 l=1 rx=0x7fd2c0001190 tx=0x7fd2d00b31e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.537+0000 7fd2bf7fe700 1 -- 172.21.15.103:0/3792312438 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fd2c8001510 con 0x7fd2d01383e0 2020-04-22T14:10:51.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.537+0000 7fd2d6c4c700 1 --2- 172.21.15.103:0/3792312438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2d01383e0 0x7fd2d00b0cd0 secure :-1 s=THROTTLE_DONE pgs=855 cs=0 l=1 rx=0x7fd2c0001190 tx=0x7fd2d00b31e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.537+0000 7fd2d86af700 1 -- 172.21.15.103:0/3792312438 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2d0056c90 con 0x7fd2d01383e0 2020-04-22T14:10:51.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.538+0000 7fd2bf7fe700 1 --2- 172.21.15.103:0/3792312438 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2b004d880 0x7fd2b004fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:51.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.538+0000 7fd2bf7fe700 1 -- 172.21.15.103:0/3792312438 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd2c8060e60 con 0x7fd2d01383e0 2020-04-22T14:10:51.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.538+0000 7fd2d644b700 1 --2- 172.21.15.103:0/3792312438 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2b004d880 0x7fd2b004fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:51.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.538+0000 7fd2d644b700 1 --2- 172.21.15.103:0/3792312438 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2b004d880 0x7fd2b004fd40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd2c00010d0 tx=0x7fd2c00012b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.538+0000 7fd2d644b700 1 --2- 172.21.15.103:0/3792312438 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2b004d880 0x7fd2b004fd40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd2c00010d0 tx=0x7fd2c00012b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.538+0000 7fd2d644b700 1 --2- 172.21.15.103:0/3792312438 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2b004d880 0x7fd2b004fd40 secure :-1 s=READY pgs=322 cs=0 l=1 rx=0x7fd2c00010d0 tx=0x7fd2c00012b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:51.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.542+0000 7fd2d6c4c700 1 --2- 172.21.15.103:0/3792312438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2d01383e0 0x7fd2d00b0cd0 secure :-1 s=THROTTLE_DONE pgs=855 cs=0 l=1 rx=0x7fd2c0001190 tx=0x7fd2d00b31e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.542+0000 7fd2bf7fe700 1 -- 172.21.15.103:0/3792312438 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fd2c803c1e0 con 0x7fd2d01383e0 2020-04-22T14:10:51.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.686+0000 7fd2d86af700 1 -- 172.21.15.103:0/3792312438 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd2d006a960 con 0x7fd2d01383e0 2020-04-22T14:10:51.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.686+0000 7fd2d6c4c700 1 --2- 172.21.15.103:0/3792312438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2d01383e0 0x7fd2d00b0cd0 secure :-1 s=THROTTLE_DONE pgs=855 cs=0 l=1 rx=0x7fd2c0001190 tx=0x7fd2d00b31e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.686+0000 7fd2bf7fe700 1 -- 172.21.15.103:0/3792312438 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v64) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd2c803f800 con 0x7fd2d01383e0 2020-04-22T14:10:51.689 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:10:51.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.688+0000 7fd2d86af700 1 -- 172.21.15.103:0/3792312438 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2b004d880 msgr2=0x7fd2b004fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:51.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.688+0000 7fd2d86af700 1 --2- 172.21.15.103:0/3792312438 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2b004d880 0x7fd2b004fd40 secure :-1 s=READY pgs=322 cs=0 l=1 rx=0x7fd2c00010d0 tx=0x7fd2c00012b0).stop 2020-04-22T14:10:51.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.688+0000 7fd2d86af700 1 -- 172.21.15.103:0/3792312438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2d01383e0 msgr2=0x7fd2d00b0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:51.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.688+0000 7fd2d86af700 1 --2- 172.21.15.103:0/3792312438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2d01383e0 0x7fd2d00b0cd0 secure :-1 s=READY pgs=855 cs=0 l=1 rx=0x7fd2c0001190 tx=0x7fd2d00b31e0).stop 2020-04-22T14:10:51.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.688+0000 7fd2d86af700 1 -- 172.21.15.103:0/3792312438 shutdown_connections 2020-04-22T14:10:51.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.688+0000 7fd2d86af700 1 --2- 172.21.15.103:0/3792312438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2d01383e0 0x7fd2d00b0cd0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:51.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.688+0000 7fd2d86af700 1 --2- 172.21.15.103:0/3792312438 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2d0146990 0x7fd2d0145770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:51.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.688+0000 7fd2d86af700 1 --2- 172.21.15.103:0/3792312438 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2b004d880 0x7fd2b004fd40 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:51.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.688+0000 7fd2d86af700 1 --2- 172.21.15.103:0/3792312438 >> v2:172.21.15.86:3300/0 conn(0x7fd2d0145bd0 0x7fd2d0137f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:51.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.688+0000 7fd2d86af700 1 -- 172.21.15.103:0/3792312438 >> 172.21.15.103:0/3792312438 conn(0x7fd2d005b7b0 msgr2=0x7fd2d00b68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:51.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.688+0000 7fd2d86af700 1 -- 172.21.15.103:0/3792312438 shutdown_connections 2020-04-22T14:10:51.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.688+0000 7fd2d86af700 1 -- 172.21.15.103:0/3792312438 wait complete. 2020-04-22T14:10:51.704 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:51.717 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-22T14:10:51.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.863+0000 7f43dae3b700 1 Processor -- start 2020-04-22T14:10:51.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.863+0000 7f43dae3b700 1 -- start start 2020-04-22T14:10:51.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.864+0000 7f43dae3b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f43d40b8e00 0x7f43d40af010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:51.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.864+0000 7f43dae3b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43d405fed0 0x7f43d40b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:51.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.864+0000 7f43dae3b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d40b29b0 con 0x7f43d40b91e0 2020-04-22T14:10:51.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.864+0000 7f43dae3b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d40b4270 con 0x7f43d40b8e00 2020-04-22T14:10:51.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.864+0000 7f43dae3b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d40b4510 con 0x7f43d405fed0 2020-04-22T14:10:51.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.864+0000 7f43da63a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43d405fed0 0x7f43d40b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:51.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.864+0000 7f43d9e39700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f43d40b8e00 0x7f43d40af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:51.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.864+0000 7f43da63a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43d405fed0 0x7f43d40b1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:36300/0 (socket says 172.21.15.103:36300) 2020-04-22T14:10:51.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.864+0000 7f43da63a700 1 -- 172.21.15.103:0/3019372009 learned_addr learned my addr 172.21.15.103:0/3019372009 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:10:51.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.864+0000 7f43d9638700 1 --1- 172.21.15.103:0/3019372009 >> v1:172.21.15.86:6789/0 conn(0x7f43d40b91e0 0x7f43d4142f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:60866/0 (socket says 172.21.15.103:60866) 2020-04-22T14:10:51.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.865+0000 7f43da63a700 1 -- 172.21.15.103:0/3019372009 >> v2:172.21.15.86:3300/0 conn(0x7f43d40b8e00 msgr2=0x7f43d40af010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:51.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.865+0000 7f43da63a700 1 --2- 172.21.15.103:0/3019372009 >> v2:172.21.15.86:3300/0 conn(0x7f43d40b8e00 0x7f43d40af010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:51.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.865+0000 7f43da63a700 1 -- 172.21.15.103:0/3019372009 >> v1:172.21.15.86:6789/0 conn(0x7f43d40b91e0 legacy=0x7f43d4142f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:51.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.865+0000 7f43da63a700 1 -- 172.21.15.103:0/3019372009 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d40b2020 con 0x7f43d405fed0 2020-04-22T14:10:51.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.865+0000 7f43da63a700 1 --2- 172.21.15.103:0/3019372009 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43d405fed0 0x7f43d40b1bc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f43cc0032b0 tx=0x7f43cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.865+0000 7f43da63a700 1 --2- 172.21.15.103:0/3019372009 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43d405fed0 0x7f43d40b1bc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f43cc0032b0 tx=0x7f43cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.865+0000 7f43da63a700 1 --2- 172.21.15.103:0/3019372009 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43d405fed0 0x7f43d40b1bc0 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f43cc0032b0 tx=0x7f43cc007dc0).ready entity=mon.2 client_cookie=97b675f8b91eec24 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:51.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.865+0000 7f43da63a700 1 --2- 172.21.15.103:0/3019372009 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43d405fed0 0x7f43d40b1bc0 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f43cc0032b0 tx=0x7f43cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.865+0000 7f43d8e37700 1 -- 172.21.15.103:0/3019372009 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43cc00a180 con 0x7f43d405fed0 2020-04-22T14:10:51.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.865+0000 7f43da63a700 1 --2- 172.21.15.103:0/3019372009 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43d405fed0 0x7f43d40b1bc0 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f43cc0032b0 tx=0x7f43cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.865+0000 7f43d8e37700 1 -- 172.21.15.103:0/3019372009 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43cc00a320 con 0x7f43d405fed0 2020-04-22T14:10:51.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.865+0000 7f43da63a700 1 --2- 172.21.15.103:0/3019372009 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43d405fed0 0x7f43d40b1bc0 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f43cc0032b0 tx=0x7f43cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.865+0000 7f43d8e37700 1 -- 172.21.15.103:0/3019372009 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43cc00a740 con 0x7f43d405fed0 2020-04-22T14:10:51.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.865+0000 7f43dae3b700 1 -- 172.21.15.103:0/3019372009 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43d405fed0 msgr2=0x7f43d40b1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:51.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.865+0000 7f43dae3b700 1 --2- 172.21.15.103:0/3019372009 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43d405fed0 0x7f43d40b1bc0 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f43cc0032b0 tx=0x7f43cc007dc0).stop 2020-04-22T14:10:51.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.866+0000 7f43dae3b700 1 -- 172.21.15.103:0/3019372009 shutdown_connections 2020-04-22T14:10:51.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.866+0000 7f43dae3b700 1 --2- 172.21.15.103:0/3019372009 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43d405fed0 0x7f43d40b1bc0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:51.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.866+0000 7f43dae3b700 1 --2- 172.21.15.103:0/3019372009 >> v2:172.21.15.86:3300/0 conn(0x7f43d40b8e00 0x7f43d40af010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:51.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.866+0000 7f43dae3b700 1 -- 172.21.15.103:0/3019372009 >> 172.21.15.103:0/3019372009 conn(0x7f43d405b780 msgr2=0x7f43d40b8530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:51.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.866+0000 7f43dae3b700 1 -- 172.21.15.103:0/3019372009 shutdown_connections 2020-04-22T14:10:51.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.866+0000 7f43dae3b700 1 -- 172.21.15.103:0/3019372009 wait complete. 2020-04-22T14:10:51.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.867+0000 7f43dae3b700 1 Processor -- start 2020-04-22T14:10:51.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.867+0000 7f43dae3b700 1 -- start start 2020-04-22T14:10:51.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.867+0000 7f43dae3b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f43d40b8e00 0x7f43d41511f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:51.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.867+0000 7f43dae3b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43d40b91e0 0x7f43d4142590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:51.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.867+0000 7f43dae3b700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d41541f0 con 0x7f43d405fed0 2020-04-22T14:10:51.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.867+0000 7f43dae3b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d4154010 con 0x7f43d40b8e00 2020-04-22T14:10:51.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.867+0000 7f43dae3b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d4065750 con 0x7f43d40b91e0 2020-04-22T14:10:51.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.867+0000 7f43d9e39700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f43d405fed0 0x7f43d4150ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43714/0 (socket says 172.21.15.103:43714) 2020-04-22T14:10:51.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.867+0000 7f43d9e39700 1 -- 172.21.15.103:0/2380776086 learned_addr learned my addr 172.21.15.103:0/2380776086 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:51.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.867+0000 7f43da63a700 1 --2- 172.21.15.103:0/2380776086 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43d40b91e0 0x7f43d4142590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:51.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.867+0000 7f43d9638700 1 --2- 172.21.15.103:0/2380776086 >> v2:172.21.15.86:3300/0 conn(0x7f43d40b8e00 0x7f43d41511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:51.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.868+0000 7f43c2ffd700 1 -- 172.21.15.103:0/2380776086 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 854791091 0 0) 0x7f43d41541f0 con 0x7f43d405fed0 2020-04-22T14:10:51.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.868+0000 7f43c2ffd700 1 -- 172.21.15.103:0/2380776086 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43b4002fe0 con 0x7f43d405fed0 2020-04-22T14:10:51.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.868+0000 7f43da63a700 1 -- 172.21.15.103:0/2380776086 >> v2:172.21.15.86:3300/0 conn(0x7f43d40b8e00 msgr2=0x7f43d41511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:51.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.868+0000 7f43da63a700 1 --2- 172.21.15.103:0/2380776086 >> v2:172.21.15.86:3300/0 conn(0x7f43d40b8e00 0x7f43d41511f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:51.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.868+0000 7f43da63a700 1 -- 172.21.15.103:0/2380776086 >> v1:172.21.15.103:6789/0 conn(0x7f43d405fed0 legacy=0x7f43d4150ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:51.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.868+0000 7f43da63a700 1 -- 172.21.15.103:0/2380776086 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d4154490 con 0x7f43d40b91e0 2020-04-22T14:10:51.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.868+0000 7f43da63a700 1 --2- 172.21.15.103:0/2380776086 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43d40b91e0 0x7f43d4142590 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f43d4063430 tx=0x7f43cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.868+0000 7f43da63a700 1 --2- 172.21.15.103:0/2380776086 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43d40b91e0 0x7f43d4142590 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f43d4063430 tx=0x7f43cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.868+0000 7f43da63a700 1 --2- 172.21.15.103:0/2380776086 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43d40b91e0 0x7f43d4142590 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7f43d4063430 tx=0x7f43cc007dc0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:51.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.868+0000 7f43da63a700 1 --2- 172.21.15.103:0/2380776086 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43d40b91e0 0x7f43d4142590 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f43d4063430 tx=0x7f43cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.868+0000 7f43c2ffd700 1 -- 172.21.15.103:0/2380776086 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43cc00ae60 con 0x7f43d40b91e0 2020-04-22T14:10:51.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.868+0000 7f43da63a700 1 --2- 172.21.15.103:0/2380776086 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43d40b91e0 0x7f43d4142590 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f43d4063430 tx=0x7f43cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.868+0000 7f43c2ffd700 1 -- 172.21.15.103:0/2380776086 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43cc005c30 con 0x7f43d40b91e0 2020-04-22T14:10:51.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.868+0000 7f43dae3b700 1 -- 172.21.15.103:0/2380776086 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d4154930 con 0x7f43d40b91e0 2020-04-22T14:10:51.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.868+0000 7f43da63a700 1 --2- 172.21.15.103:0/2380776086 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43d40b91e0 0x7f43d4142590 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f43d4063430 tx=0x7f43cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.868+0000 7f43c2ffd700 1 -- 172.21.15.103:0/2380776086 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43cc007170 con 0x7f43d40b91e0 2020-04-22T14:10:51.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.868+0000 7f43dae3b700 1 -- 172.21.15.103:0/2380776086 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d4153a70 con 0x7f43d40b91e0 2020-04-22T14:10:51.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.869+0000 7f43da63a700 1 --2- 172.21.15.103:0/2380776086 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43d40b91e0 0x7f43d4142590 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f43d4063430 tx=0x7f43cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.869+0000 7f43dae3b700 1 -- 172.21.15.103:0/2380776086 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d4153d80 con 0x7f43d40b91e0 2020-04-22T14:10:51.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.869+0000 7f43c2ffd700 1 -- 172.21.15.103:0/2380776086 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f43cc007370 con 0x7f43d40b91e0 2020-04-22T14:10:51.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.869+0000 7f43da63a700 1 --2- 172.21.15.103:0/2380776086 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43d40b91e0 0x7f43d4142590 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f43d4063430 tx=0x7f43cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.869+0000 7f43c2ffd700 1 --2- 172.21.15.103:0/2380776086 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f43b404dc70 0x7f43b4050130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:51.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.870+0000 7f43c2ffd700 1 -- 172.21.15.103:0/2380776086 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f43cc062120 con 0x7f43d40b91e0 2020-04-22T14:10:51.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.870+0000 7f43d9e39700 1 --2- 172.21.15.103:0/2380776086 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f43b404dc70 0x7f43b4050130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:51.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.870+0000 7f43d9e39700 1 --2- 172.21.15.103:0/2380776086 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f43b404dc70 0x7f43b4050130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f43c4002f30 tx=0x7f43c40090b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.870+0000 7f43d9e39700 1 --2- 172.21.15.103:0/2380776086 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f43b404dc70 0x7f43b4050130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f43c4002f30 tx=0x7f43c40090b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.870+0000 7f43d9e39700 1 --2- 172.21.15.103:0/2380776086 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f43b404dc70 0x7f43b4050130 secure :-1 s=READY pgs=323 cs=0 l=1 rx=0x7f43c4002f30 tx=0x7f43c40090b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:51.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.873+0000 7f43da63a700 1 --2- 172.21.15.103:0/2380776086 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43d40b91e0 0x7f43d4142590 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f43d4063430 tx=0x7f43cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:51.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:51.873+0000 7f43c2ffd700 1 -- 172.21.15.103:0/2380776086 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f43cc03d500 con 0x7f43d40b91e0 2020-04-22T14:10:51.885 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:10:51.902 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:10:51.944 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:51.958 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:10:52.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.018+0000 7f43dae3b700 1 -- 172.21.15.103:0/2380776086 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f43d40ae400 con 0x7f43d40b91e0 2020-04-22T14:10:52.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.019+0000 7f43da63a700 1 --2- 172.21.15.103:0/2380776086 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43d40b91e0 0x7f43d4142590 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f43d4063430 tx=0x7f43cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:52.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.019+0000 7f43c2ffd700 1 -- 172.21.15.103:0/2380776086 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v64) v1 ==== 104+0+10 (secure 0 0 0) 0x7f43cc040b20 con 0x7f43d40b91e0 2020-04-22T14:10:52.021 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:10:52.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.021+0000 7f43dae3b700 1 -- 172.21.15.103:0/2380776086 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f43b404dc70 msgr2=0x7f43b4050130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:52.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.021+0000 7f43dae3b700 1 --2- 172.21.15.103:0/2380776086 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f43b404dc70 0x7f43b4050130 secure :-1 s=READY pgs=323 cs=0 l=1 rx=0x7f43c4002f30 tx=0x7f43c40090b0).stop 2020-04-22T14:10:52.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.021+0000 7f43dae3b700 1 -- 172.21.15.103:0/2380776086 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43d40b91e0 msgr2=0x7f43d4142590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:52.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.021+0000 7f43dae3b700 1 --2- 172.21.15.103:0/2380776086 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43d40b91e0 0x7f43d4142590 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7f43d4063430 tx=0x7f43cc007dc0).stop 2020-04-22T14:10:52.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.021+0000 7f43dae3b700 1 -- 172.21.15.103:0/2380776086 shutdown_connections 2020-04-22T14:10:52.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.021+0000 7f43dae3b700 1 --2- 172.21.15.103:0/2380776086 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43d40b91e0 0x7f43d4142590 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:52.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.021+0000 7f43dae3b700 1 --2- 172.21.15.103:0/2380776086 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f43b404dc70 0x7f43b4050130 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:52.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.021+0000 7f43dae3b700 1 --2- 172.21.15.103:0/2380776086 >> v2:172.21.15.86:3300/0 conn(0x7f43d40b8e00 0x7f43d41511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:52.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.021+0000 7f43dae3b700 1 -- 172.21.15.103:0/2380776086 >> 172.21.15.103:0/2380776086 conn(0x7f43d405b780 msgr2=0x7f43d4143190 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:52.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.021+0000 7f43dae3b700 1 -- 172.21.15.103:0/2380776086 shutdown_connections 2020-04-22T14:10:52.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.021+0000 7f43dae3b700 1 -- 172.21.15.103:0/2380776086 wait complete. 2020-04-22T14:10:52.034 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:52.087 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-22T14:10:52.246 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.244+0000 7fd94b4c4700 1 Processor -- start 2020-04-22T14:10:52.247 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.244+0000 7fd94b4c4700 1 -- start start 2020-04-22T14:10:52.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.245+0000 7fd94b4c4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd9440b9890 0x7fd944146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:52.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.245+0000 7fd94b4c4700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9440b6eb0 con 0x7fd9441434b0 2020-04-22T14:10:52.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.245+0000 7fd94b4c4700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd94414a810 con 0x7fd944143930 2020-04-22T14:10:52.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.245+0000 7fd94b4c4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd94405fbc0 con 0x7fd9440b9890 2020-04-22T14:10:52.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.245+0000 7fd949a61700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd944143930 0x7fd94414a100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43726/0 (socket says 172.21.15.103:43726) 2020-04-22T14:10:52.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.245+0000 7fd949a61700 1 -- 172.21.15.103:0/2026605241 learned_addr learned my addr 172.21.15.103:0/2026605241 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:52.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.245+0000 7fd933fff700 1 -- 172.21.15.103:0/2026605241 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 552886981 0 0) 0x7fd94414a810 con 0x7fd944143930 2020-04-22T14:10:52.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.245+0000 7fd933fff700 1 -- 172.21.15.103:0/2026605241 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd92c003230 con 0x7fd944143930 2020-04-22T14:10:52.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.245+0000 7fd949260700 1 --2- 172.21.15.103:0/2026605241 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd9440b9890 0x7fd944146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:52.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.246+0000 7fd933fff700 1 -- 172.21.15.103:0/2026605241 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3954354341 0 0) 0x7fd92c003230 con 0x7fd944143930 2020-04-22T14:10:52.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.246+0000 7fd933fff700 1 -- 172.21.15.103:0/2026605241 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd9440b9890 msgr2=0x7fd944146fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:52.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.246+0000 7fd933fff700 1 --2- 172.21.15.103:0/2026605241 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd9440b9890 0x7fd944146fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:52.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.246+0000 7fd933fff700 1 -- 172.21.15.103:0/2026605241 >> v1:172.21.15.86:6789/0 conn(0x7fd9441434b0 legacy=0x7fd9441499f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:52.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.246+0000 7fd933fff700 1 -- 172.21.15.103:0/2026605241 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd94405fe60 con 0x7fd944143930 2020-04-22T14:10:52.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.246+0000 7fd933fff700 1 -- 172.21.15.103:0/2026605241 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fd93c001a50 con 0x7fd944143930 2020-04-22T14:10:52.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.246+0000 7fd933fff700 1 -- 172.21.15.103:0/2026605241 >> v1:172.21.15.103:6789/0 conn(0x7fd944143930 legacy=0x7fd94414a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:52.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.246+0000 7fd933fff700 1 --2- 172.21.15.103:0/2026605241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd92c003720 0x7fd92c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:52.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.246+0000 7fd933fff700 1 --2- 172.21.15.103:0/2026605241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd92c004060 0x7fd92c004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:52.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.246+0000 7fd933fff700 1 --2- 172.21.15.103:0/2026605241 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd9440b9890 0x7fd92c004af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:52.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.246+0000 7fd933fff700 1 -- 172.21.15.103:0/2026605241 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94405fbc0 con 0x7fd92c004060 2020-04-22T14:10:52.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.246+0000 7fd933fff700 1 -- 172.21.15.103:0/2026605241 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd92c004fa0 con 0x7fd92c003720 2020-04-22T14:10:52.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.246+0000 7fd933fff700 1 -- 172.21.15.103:0/2026605241 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd92c005160 con 0x7fd9440b9890 2020-04-22T14:10:52.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.246+0000 7fd949260700 1 --2- 172.21.15.103:0/2026605241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd92c003720 0x7fd92c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:52.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.246+0000 7fd949a61700 1 --2- 172.21.15.103:0/2026605241 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd9440b9890 0x7fd92c004af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:52.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.246+0000 7fd948a5f700 1 --2- 172.21.15.103:0/2026605241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd92c004060 0x7fd92c004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:52.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.246+0000 7fd949260700 1 -- 172.21.15.103:0/2026605241 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd9440b9890 msgr2=0x7fd92c004af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:52.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.246+0000 7fd949260700 1 --2- 172.21.15.103:0/2026605241 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd9440b9890 0x7fd92c004af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:52.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.246+0000 7fd949260700 1 -- 172.21.15.103:0/2026605241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd92c004060 msgr2=0x7fd92c004530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:52.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.246+0000 7fd949260700 1 --2- 172.21.15.103:0/2026605241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd92c004060 0x7fd92c004530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:52.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.246+0000 7fd949260700 1 -- 172.21.15.103:0/2026605241 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd92c003230 con 0x7fd92c003720 2020-04-22T14:10:52.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.246+0000 7fd948a5f700 1 --2- 172.21.15.103:0/2026605241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd92c004060 0x7fd92c004530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:10:52.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.246+0000 7fd949260700 1 --2- 172.21.15.103:0/2026605241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd92c003720 0x7fd92c003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd940002f30 tx=0x7fd940010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:52.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.246+0000 7fd949260700 1 --2- 172.21.15.103:0/2026605241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd92c003720 0x7fd92c003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd940002f30 tx=0x7fd940010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:52.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.246+0000 7fd949260700 1 --2- 172.21.15.103:0/2026605241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd92c003720 0x7fd92c003b40 secure :-1 s=READY pgs=858 cs=0 l=1 rx=0x7fd940002f30 tx=0x7fd940010020).ready entity=mon.1 client_cookie=d29bd2451da77f77 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:52.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.246+0000 7fd949260700 1 --2- 172.21.15.103:0/2026605241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd92c003720 0x7fd92c003b40 secure :-1 s=THROTTLE_DONE pgs=858 cs=0 l=1 rx=0x7fd940002f30 tx=0x7fd940010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:52.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.246+0000 7fd933fff700 1 -- 172.21.15.103:0/2026605241 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd940008d30 con 0x7fd92c003720 2020-04-22T14:10:52.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.246+0000 7fd949260700 1 --2- 172.21.15.103:0/2026605241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd92c003720 0x7fd92c003b40 secure :-1 s=THROTTLE_DONE pgs=858 cs=0 l=1 rx=0x7fd940002f30 tx=0x7fd940010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:52.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.246+0000 7fd949260700 1 --2- 172.21.15.103:0/2026605241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd92c003720 0x7fd92c003b40 secure :-1 s=THROTTLE_DONE pgs=858 cs=0 l=1 rx=0x7fd940002f30 tx=0x7fd940010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:52.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.246+0000 7fd933fff700 1 -- 172.21.15.103:0/2026605241 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd940008e90 con 0x7fd92c003720 2020-04-22T14:10:52.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.246+0000 7fd933fff700 1 -- 172.21.15.103:0/2026605241 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd940010b40 con 0x7fd92c003720 2020-04-22T14:10:52.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.246+0000 7fd94b4c4700 1 -- 172.21.15.103:0/2026605241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd92c003720 msgr2=0x7fd92c003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:52.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.246+0000 7fd94b4c4700 1 --2- 172.21.15.103:0/2026605241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd92c003720 0x7fd92c003b40 secure :-1 s=READY pgs=858 cs=0 l=1 rx=0x7fd940002f30 tx=0x7fd940010020).stop 2020-04-22T14:10:52.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.246+0000 7fd949a61700 1 -- 172.21.15.103:0/2026605241 reap_dead start 2020-04-22T14:10:52.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.247+0000 7fd94b4c4700 1 -- 172.21.15.103:0/2026605241 shutdown_connections 2020-04-22T14:10:52.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.247+0000 7fd94b4c4700 1 -- 172.21.15.103:0/2026605241 >> 172.21.15.103:0/2026605241 conn(0x7fd94405ad30 msgr2=0x7fd94405b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:52.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.247+0000 7fd94b4c4700 1 -- 172.21.15.103:0/2026605241 shutdown_connections 2020-04-22T14:10:52.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.247+0000 7fd94b4c4700 1 -- 172.21.15.103:0/2026605241 wait complete. 2020-04-22T14:10:52.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.248+0000 7fd94b4c4700 1 Processor -- start 2020-04-22T14:10:52.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.248+0000 7fd94b4c4700 1 -- start start 2020-04-22T14:10:52.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.249+0000 7fd94b4c4700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd9441546e0 0x7fd9440ace50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:52.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.249+0000 7fd94b4c4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd94412bde0 0x7fd94412c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:52.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.249+0000 7fd94b4c4700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd944154bc0 con 0x7fd94412b820 2020-04-22T14:10:52.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.249+0000 7fd94b4c4700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9441465c0 con 0x7fd9441546e0 2020-04-22T14:10:52.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.249+0000 7fd94b4c4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd94412ee50 con 0x7fd94412bde0 2020-04-22T14:10:52.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.249+0000 7fd948a5f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd9441546e0 0x7fd9440ace50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:52.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.249+0000 7fd948a5f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd9441546e0 0x7fd9440ace50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:48778/0 (socket says 172.21.15.103:48778) 2020-04-22T14:10:52.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.249+0000 7fd948a5f700 1 -- 172.21.15.103:0/3766403130 learned_addr learned my addr 172.21.15.103:0/3766403130 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:10:52.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.249+0000 7fd949a61700 1 --2- 172.21.15.103:0/3766403130 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd94412bde0 0x7fd94412c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:52.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.249+0000 7fd949a61700 1 -- 172.21.15.103:0/3766403130 >> v2:172.21.15.86:3300/0 conn(0x7fd9441546e0 msgr2=0x7fd9440ace50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:52.263 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.249+0000 7fd949a61700 1 --2- 172.21.15.103:0/3766403130 >> v2:172.21.15.86:3300/0 conn(0x7fd9441546e0 0x7fd9440ace50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:52.263 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.249+0000 7fd9327fc700 1 -- 172.21.15.103:0/3766403130 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2864866880 0 0) 0x7fd944154bc0 con 0x7fd94412b820 2020-04-22T14:10:52.263 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.249+0000 7fd949a61700 1 -- 172.21.15.103:0/3766403130 >> v1:172.21.15.86:6789/0 conn(0x7fd94412b820 legacy=0x7fd9440ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:52.263 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.249+0000 7fd949a61700 1 -- 172.21.15.103:0/3766403130 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9440ad2b0 con 0x7fd94412bde0 2020-04-22T14:10:52.263 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.249+0000 7fd948a5f700 1 --2- 172.21.15.103:0/3766403130 >> v2:172.21.15.86:3300/0 conn(0x7fd9441546e0 0x7fd9440ace50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:10:52.263 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.249+0000 7fd949a61700 1 --2- 172.21.15.103:0/3766403130 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd94412bde0 0x7fd94412c270 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd93c001450 tx=0x7fd93c0088b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:52.263 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.249+0000 7fd949a61700 1 --2- 172.21.15.103:0/3766403130 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd94412bde0 0x7fd94412c270 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd93c001450 tx=0x7fd93c0088b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:52.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.249+0000 7fd949a61700 1 --2- 172.21.15.103:0/3766403130 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd94412bde0 0x7fd94412c270 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7fd93c001450 tx=0x7fd93c0088b0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:52.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.249+0000 7fd949a61700 1 --2- 172.21.15.103:0/3766403130 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd94412bde0 0x7fd94412c270 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7fd93c001450 tx=0x7fd93c0088b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:52.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.249+0000 7fd9327fc700 1 -- 172.21.15.103:0/3766403130 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd93c011860 con 0x7fd94412bde0 2020-04-22T14:10:52.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.250+0000 7fd949a61700 1 --2- 172.21.15.103:0/3766403130 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd94412bde0 0x7fd94412c270 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7fd93c001450 tx=0x7fd93c0088b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:52.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.250+0000 7fd94b4c4700 1 -- 172.21.15.103:0/3766403130 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd944143dc0 con 0x7fd94412bde0 2020-04-22T14:10:52.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.250+0000 7fd9327fc700 1 -- 172.21.15.103:0/3766403130 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd93c0119c0 con 0x7fd94412bde0 2020-04-22T14:10:52.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.250+0000 7fd949a61700 1 --2- 172.21.15.103:0/3766403130 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd94412bde0 0x7fd94412c270 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7fd93c001450 tx=0x7fd93c0088b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:52.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.250+0000 7fd9327fc700 1 -- 172.21.15.103:0/3766403130 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd93c011d20 con 0x7fd94412bde0 2020-04-22T14:10:52.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.250+0000 7fd94b4c4700 1 -- 172.21.15.103:0/3766403130 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd94412c890 con 0x7fd94412bde0 2020-04-22T14:10:52.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.250+0000 7fd949a61700 1 --2- 172.21.15.103:0/3766403130 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd94412bde0 0x7fd94412c270 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7fd93c001450 tx=0x7fd93c0088b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:52.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.251+0000 7fd94b4c4700 1 -- 172.21.15.103:0/3766403130 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd944143fb0 con 0x7fd94412bde0 2020-04-22T14:10:52.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.251+0000 7fd9327fc700 1 -- 172.21.15.103:0/3766403130 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fd93c004930 con 0x7fd94412bde0 2020-04-22T14:10:52.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.251+0000 7fd949a61700 1 --2- 172.21.15.103:0/3766403130 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd94412bde0 0x7fd94412c270 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7fd93c001450 tx=0x7fd93c0088b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:52.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.251+0000 7fd9327fc700 1 --2- 172.21.15.103:0/3766403130 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd92404d8d0 0x7fd92404fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:52.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.251+0000 7fd9327fc700 1 -- 172.21.15.103:0/3766403130 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd93c060ed0 con 0x7fd94412bde0 2020-04-22T14:10:52.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.251+0000 7fd949260700 1 --2- 172.21.15.103:0/3766403130 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd92404d8d0 0x7fd92404fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:52.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.251+0000 7fd949260700 1 --2- 172.21.15.103:0/3766403130 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd92404d8d0 0x7fd92404fd90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd940007fa0 tx=0x7fd940010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:52.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.251+0000 7fd949260700 1 --2- 172.21.15.103:0/3766403130 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd92404d8d0 0x7fd92404fd90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd940007fa0 tx=0x7fd940010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:52.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.251+0000 7fd949260700 1 --2- 172.21.15.103:0/3766403130 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd92404d8d0 0x7fd92404fd90 secure :-1 s=READY pgs=324 cs=0 l=1 rx=0x7fd940007fa0 tx=0x7fd940010020).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:52.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.254+0000 7fd949a61700 1 --2- 172.21.15.103:0/3766403130 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd94412bde0 0x7fd94412c270 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7fd93c001450 tx=0x7fd93c0088b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:52.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.254+0000 7fd9327fc700 1 -- 172.21.15.103:0/3766403130 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fd93c03c2b0 con 0x7fd94412bde0 2020-04-22T14:10:52.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.397+0000 7fd94b4c4700 1 -- 172.21.15.103:0/3766403130 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd944056c90 con 0x7fd94412bde0 2020-04-22T14:10:52.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.398+0000 7fd949a61700 1 --2- 172.21.15.103:0/3766403130 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd94412bde0 0x7fd94412c270 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7fd93c001450 tx=0x7fd93c0088b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:52.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.398+0000 7fd9327fc700 1 -- 172.21.15.103:0/3766403130 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v64) v1 ==== 100+0+10 (secure 0 0 0) 0x7fd93c03f8d0 con 0x7fd94412bde0 2020-04-22T14:10:52.400 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:10:52.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.399+0000 7fd94b4c4700 1 -- 172.21.15.103:0/3766403130 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd92404d8d0 msgr2=0x7fd92404fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:52.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.399+0000 7fd94b4c4700 1 --2- 172.21.15.103:0/3766403130 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd92404d8d0 0x7fd92404fd90 secure :-1 s=READY pgs=324 cs=0 l=1 rx=0x7fd940007fa0 tx=0x7fd940010020).stop 2020-04-22T14:10:52.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.399+0000 7fd94b4c4700 1 -- 172.21.15.103:0/3766403130 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd94412bde0 msgr2=0x7fd94412c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:52.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.399+0000 7fd94b4c4700 1 --2- 172.21.15.103:0/3766403130 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd94412bde0 0x7fd94412c270 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7fd93c001450 tx=0x7fd93c0088b0).stop 2020-04-22T14:10:52.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.399+0000 7fd94b4c4700 1 -- 172.21.15.103:0/3766403130 shutdown_connections 2020-04-22T14:10:52.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.399+0000 7fd94b4c4700 1 --2- 172.21.15.103:0/3766403130 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd94412bde0 0x7fd94412c270 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:52.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.399+0000 7fd94b4c4700 1 --2- 172.21.15.103:0/3766403130 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd92404d8d0 0x7fd92404fd90 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:52.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.399+0000 7fd94b4c4700 1 --2- 172.21.15.103:0/3766403130 >> v2:172.21.15.86:3300/0 conn(0x7fd9441546e0 0x7fd9440ace50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:52.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.399+0000 7fd94b4c4700 1 -- 172.21.15.103:0/3766403130 >> 172.21.15.103:0/3766403130 conn(0x7fd94405ad30 msgr2=0x7fd9440b7480 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:52.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.399+0000 7fd94b4c4700 1 -- 172.21.15.103:0/3766403130 shutdown_connections 2020-04-22T14:10:52.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.399+0000 7fd94b4c4700 1 -- 172.21.15.103:0/3766403130 wait complete. 2020-04-22T14:10:52.411 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-04-22T14:10:52.412 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:52.425 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:10:52.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.568+0000 7f5ad80bf700 1 Processor -- start 2020-04-22T14:10:52.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.569+0000 7f5ad80bf700 1 -- start start 2020-04-22T14:10:52.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.569+0000 7f5ad80bf700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5ad0065fe0 0x7f5ad01464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:52.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.569+0000 7f5ad80bf700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ad0143300 con 0x7f5ad0063e30 2020-04-22T14:10:52.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.569+0000 7f5ad80bf700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ad01435a0 con 0x7f5ad012c0d0 2020-04-22T14:10:52.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.569+0000 7f5ad80bf700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad0143840 con 0x7f5ad0065fe0 2020-04-22T14:10:52.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.570+0000 7f5ad5e5b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f5ad012c0d0 0x7f5ad005b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43742/0 (socket says 172.21.15.103:43742) 2020-04-22T14:10:52.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.570+0000 7f5ad5e5b700 1 -- 172.21.15.103:0/3545460989 learned_addr learned my addr 172.21.15.103:0/3545460989 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:52.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.570+0000 7f5ad4e59700 1 -- 172.21.15.103:0/3545460989 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2490630298 0 0) 0x7f5ad01435a0 con 0x7f5ad012c0d0 2020-04-22T14:10:52.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.570+0000 7f5ad4e59700 1 -- 172.21.15.103:0/3545460989 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ab8003230 con 0x7f5ad012c0d0 2020-04-22T14:10:52.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.570+0000 7f5ad565a700 1 --2- 172.21.15.103:0/3545460989 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5ad0065fe0 0x7f5ad01464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:52.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.570+0000 7f5ad4e59700 1 -- 172.21.15.103:0/3545460989 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2706178805 0 0) 0x7f5ab8003230 con 0x7f5ad012c0d0 2020-04-22T14:10:52.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.570+0000 7f5ad4e59700 1 -- 172.21.15.103:0/3545460989 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5ad0065fe0 msgr2=0x7f5ad01464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:52.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.570+0000 7f5ad4e59700 1 --2- 172.21.15.103:0/3545460989 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5ad0065fe0 0x7f5ad01464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:52.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.570+0000 7f5ad4e59700 1 -- 172.21.15.103:0/3545460989 >> v1:172.21.15.86:6789/0 conn(0x7f5ad0063e30 legacy=0x7f5ad00642a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:52.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.570+0000 7f5ad4e59700 1 -- 172.21.15.103:0/3545460989 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad005bb50 con 0x7f5ad012c0d0 2020-04-22T14:10:52.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.570+0000 7f5ad4e59700 1 -- 172.21.15.103:0/3545460989 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f5acc001710 con 0x7f5ad012c0d0 2020-04-22T14:10:52.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.570+0000 7f5ad4e59700 1 -- 172.21.15.103:0/3545460989 >> v1:172.21.15.103:6789/0 conn(0x7f5ad012c0d0 legacy=0x7f5ad005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:52.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.570+0000 7f5ad4e59700 1 --2- 172.21.15.103:0/3545460989 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ab8003720 0x7f5ab8003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:52.582 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.570+0000 7f5ad4e59700 1 --2- 172.21.15.103:0/3545460989 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5ad0065fe0 0x7f5ab8003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:52.582 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.570+0000 7f5ad4e59700 1 --2- 172.21.15.103:0/3545460989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ab8004520 0x7f5ab80049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:52.582 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.570+0000 7f5ad4e59700 1 -- 172.21.15.103:0/3545460989 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad0143840 con 0x7f5ab8003720 2020-04-22T14:10:52.582 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.570+0000 7f5ad4e59700 1 -- 172.21.15.103:0/3545460989 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab8004f80 con 0x7f5ab8004520 2020-04-22T14:10:52.582 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.570+0000 7f5ad4e59700 1 -- 172.21.15.103:0/3545460989 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab8005140 con 0x7f5ad0065fe0 2020-04-22T14:10:52.582 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.570+0000 7f5ad665c700 1 --2- 172.21.15.103:0/3545460989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ab8004520 0x7f5ab80049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:52.582 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.570+0000 7f5ad5e5b700 1 --2- 172.21.15.103:0/3545460989 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ab8003720 0x7f5ab8003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:52.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.570+0000 7f5ad565a700 1 --2- 172.21.15.103:0/3545460989 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5ad0065fe0 0x7f5ab8003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:52.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.571+0000 7f5ad665c700 1 -- 172.21.15.103:0/3545460989 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5ad0065fe0 msgr2=0x7f5ab8003ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:52.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.571+0000 7f5ad665c700 1 --2- 172.21.15.103:0/3545460989 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5ad0065fe0 0x7f5ab8003ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:52.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.571+0000 7f5ad665c700 1 -- 172.21.15.103:0/3545460989 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ab8003720 msgr2=0x7f5ab8003b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:52.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.571+0000 7f5ad665c700 1 --2- 172.21.15.103:0/3545460989 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ab8003720 0x7f5ab8003b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:52.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.571+0000 7f5ad665c700 1 -- 172.21.15.103:0/3545460989 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab8003230 con 0x7f5ab8004520 2020-04-22T14:10:52.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.571+0000 7f5ad665c700 1 --2- 172.21.15.103:0/3545460989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ab8004520 0x7f5ab80049d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5ac8001360 tx=0x7f5ac8010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:52.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.571+0000 7f5ad665c700 1 --2- 172.21.15.103:0/3545460989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ab8004520 0x7f5ab80049d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5ac8001360 tx=0x7f5ac8010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:52.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.571+0000 7f5ad665c700 1 --2- 172.21.15.103:0/3545460989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ab8004520 0x7f5ab80049d0 secure :-1 s=READY pgs=860 cs=0 l=1 rx=0x7f5ac8001360 tx=0x7f5ac8010160).ready entity=mon.1 client_cookie=7d1524abf9e26644 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:52.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.571+0000 7f5ad665c700 1 --2- 172.21.15.103:0/3545460989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ab8004520 0x7f5ab80049d0 secure :-1 s=THROTTLE_DONE pgs=860 cs=0 l=1 rx=0x7f5ac8001360 tx=0x7f5ac8010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:52.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.571+0000 7f5ad4e59700 1 -- 172.21.15.103:0/3545460989 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ac8006c40 con 0x7f5ab8004520 2020-04-22T14:10:52.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.571+0000 7f5ad665c700 1 --2- 172.21.15.103:0/3545460989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ab8004520 0x7f5ab80049d0 secure :-1 s=THROTTLE_DONE pgs=860 cs=0 l=1 rx=0x7f5ac8001360 tx=0x7f5ac8010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:52.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.571+0000 7f5ad665c700 1 --2- 172.21.15.103:0/3545460989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ab8004520 0x7f5ab80049d0 secure :-1 s=THROTTLE_DONE pgs=860 cs=0 l=1 rx=0x7f5ac8001360 tx=0x7f5ac8010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:52.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.571+0000 7f5ad4e59700 1 -- 172.21.15.103:0/3545460989 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac8006de0 con 0x7f5ab8004520 2020-04-22T14:10:52.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.571+0000 7f5ad4e59700 1 -- 172.21.15.103:0/3545460989 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ac8002730 con 0x7f5ab8004520 2020-04-22T14:10:52.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.571+0000 7f5ad80bf700 1 -- 172.21.15.103:0/3545460989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ab8004520 msgr2=0x7f5ab80049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:52.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.571+0000 7f5ad80bf700 1 --2- 172.21.15.103:0/3545460989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ab8004520 0x7f5ab80049d0 secure :-1 s=READY pgs=860 cs=0 l=1 rx=0x7f5ac8001360 tx=0x7f5ac8010160).stop 2020-04-22T14:10:52.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.571+0000 7f5ad665c700 1 -- 172.21.15.103:0/3545460989 reap_dead start 2020-04-22T14:10:52.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.572+0000 7f5ad80bf700 1 -- 172.21.15.103:0/3545460989 shutdown_connections 2020-04-22T14:10:52.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.572+0000 7f5ad80bf700 1 -- 172.21.15.103:0/3545460989 >> 172.21.15.103:0/3545460989 conn(0x7f5ad00b9160 msgr2=0x7f5ad005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:52.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.572+0000 7f5ad80bf700 1 -- 172.21.15.103:0/3545460989 shutdown_connections 2020-04-22T14:10:52.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.572+0000 7f5ad80bf700 1 -- 172.21.15.103:0/3545460989 wait complete. 2020-04-22T14:10:52.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.573+0000 7f5ad80bf700 1 Processor -- start 2020-04-22T14:10:52.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.573+0000 7f5ad80bf700 1 -- start start 2020-04-22T14:10:52.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.573+0000 7f5ad80bf700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5ad00b3680 0x7f5ad00b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:52.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.573+0000 7f5ad80bf700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ad012af60 con 0x7f5ad00b5590 2020-04-22T14:10:52.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.573+0000 7f5ad80bf700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ad00b6180 con 0x7f5ad00b2c90 2020-04-22T14:10:52.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.573+0000 7f5ad80bf700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad012a1c0 con 0x7f5ad00b3680 2020-04-22T14:10:52.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.573+0000 7f5ad5e5b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f5ad00b2c90 0x7f5ad012a850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43752/0 (socket says 172.21.15.103:43752) 2020-04-22T14:10:52.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.573+0000 7f5ad5e5b700 1 -- 172.21.15.103:0/3412751656 learned_addr learned my addr 172.21.15.103:0/3412751656 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:52.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.573+0000 7f5ad565a700 1 --2- 172.21.15.103:0/3412751656 >> v2:172.21.15.103:3300/0 conn(0x7f5ad00b3680 0x7f5ad00b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:52.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.573+0000 7f5ac2ffd700 1 -- 172.21.15.103:0/3412751656 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1581027413 0 0) 0x7f5ad00b6180 con 0x7f5ad00b2c90 2020-04-22T14:10:52.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.573+0000 7f5ac2ffd700 1 -- 172.21.15.103:0/3412751656 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ab0002fe0 con 0x7f5ad00b2c90 2020-04-22T14:10:52.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.574+0000 7f5ad565a700 1 -- 172.21.15.103:0/3412751656 >> v1:172.21.15.103:6789/0 conn(0x7f5ad00b2c90 legacy=0x7f5ad012a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:52.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.574+0000 7f5ad565a700 1 -- 172.21.15.103:0/3412751656 >> v1:172.21.15.86:6789/0 conn(0x7f5ad00b5590 legacy=0x7f5ad00b1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:52.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.574+0000 7f5ad565a700 1 -- 172.21.15.103:0/3412751656 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad012a3b0 con 0x7f5ad00b3680 2020-04-22T14:10:52.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.574+0000 7f5ad565a700 1 --2- 172.21.15.103:0/3412751656 >> v2:172.21.15.103:3300/0 conn(0x7f5ad00b3680 0x7f5ad00b3b10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5ad0153a40 tx=0x7f5ac4010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:52.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.574+0000 7f5ad565a700 1 --2- 172.21.15.103:0/3412751656 >> v2:172.21.15.103:3300/0 conn(0x7f5ad00b3680 0x7f5ad00b3b10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5ad0153a40 tx=0x7f5ac4010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:52.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.574+0000 7f5ad565a700 1 --2- 172.21.15.103:0/3412751656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ad00b3680 0x7f5ad00b3b10 secure :-1 s=READY pgs=862 cs=0 l=1 rx=0x7f5ad0153a40 tx=0x7f5ac4010b70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:52.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.574+0000 7f5ad565a700 1 --2- 172.21.15.103:0/3412751656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ad00b3680 0x7f5ad00b3b10 secure :-1 s=THROTTLE_DONE pgs=862 cs=0 l=1 rx=0x7f5ad0153a40 tx=0x7f5ac4010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:52.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.574+0000 7f5ac2ffd700 1 -- 172.21.15.103:0/3412751656 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ac4005e40 con 0x7f5ad00b3680 2020-04-22T14:10:52.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.574+0000 7f5ad565a700 1 --2- 172.21.15.103:0/3412751656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ad00b3680 0x7f5ad00b3b10 secure :-1 s=THROTTLE_DONE pgs=862 cs=0 l=1 rx=0x7f5ad0153a40 tx=0x7f5ac4010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:52.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.574+0000 7f5ad565a700 1 --2- 172.21.15.103:0/3412751656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ad00b3680 0x7f5ad00b3b10 secure :-1 s=THROTTLE_DONE pgs=862 cs=0 l=1 rx=0x7f5ad0153a40 tx=0x7f5ac4010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:52.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.574+0000 7f5ac2ffd700 1 -- 172.21.15.103:0/3412751656 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac4007180 con 0x7f5ad00b3680 2020-04-22T14:10:52.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.574+0000 7f5ad80bf700 1 -- 172.21.15.103:0/3412751656 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad00b3070 con 0x7f5ad00b3680 2020-04-22T14:10:52.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.574+0000 7f5ac2ffd700 1 -- 172.21.15.103:0/3412751656 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ac4007560 con 0x7f5ad00b3680 2020-04-22T14:10:52.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.574+0000 7f5ad80bf700 1 -- 172.21.15.103:0/3412751656 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad00b22d0 con 0x7f5ad00b3680 2020-04-22T14:10:52.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.575+0000 7f5ad565a700 1 --2- 172.21.15.103:0/3412751656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ad00b3680 0x7f5ad00b3b10 secure :-1 s=THROTTLE_DONE pgs=862 cs=0 l=1 rx=0x7f5ad0153a40 tx=0x7f5ac4010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:52.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.575+0000 7f5ac2ffd700 1 -- 172.21.15.103:0/3412751656 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f5ac4008460 con 0x7f5ad00b3680 2020-04-22T14:10:52.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.575+0000 7f5ad565a700 1 --2- 172.21.15.103:0/3412751656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ad00b3680 0x7f5ad00b3b10 secure :-1 s=THROTTLE_DONE pgs=862 cs=0 l=1 rx=0x7f5ad0153a40 tx=0x7f5ac4010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:52.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.575+0000 7f5ad80bf700 1 -- 172.21.15.103:0/3412751656 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ad0056c90 con 0x7f5ad00b3680 2020-04-22T14:10:52.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.575+0000 7f5ac2ffd700 1 --2- 172.21.15.103:0/3412751656 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5ab004dcc0 0x7f5ab0050180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:52.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.575+0000 7f5ac2ffd700 1 -- 172.21.15.103:0/3412751656 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5ac4061410 con 0x7f5ad00b3680 2020-04-22T14:10:52.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.576+0000 7f5ad5e5b700 1 --2- 172.21.15.103:0/3412751656 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5ab004dcc0 0x7f5ab0050180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:52.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.576+0000 7f5ad5e5b700 1 --2- 172.21.15.103:0/3412751656 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5ab004dcc0 0x7f5ab0050180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5acc004520 tx=0x7f5ad005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:52.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.576+0000 7f5ad5e5b700 1 --2- 172.21.15.103:0/3412751656 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5ab004dcc0 0x7f5ab0050180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5acc004520 tx=0x7f5ad005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:52.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.576+0000 7f5ad5e5b700 1 --2- 172.21.15.103:0/3412751656 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5ab004dcc0 0x7f5ab0050180 secure :-1 s=READY pgs=325 cs=0 l=1 rx=0x7f5acc004520 tx=0x7f5ad005bce0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:52.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.580+0000 7f5ad565a700 1 --2- 172.21.15.103:0/3412751656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ad00b3680 0x7f5ad00b3b10 secure :-1 s=THROTTLE_DONE pgs=862 cs=0 l=1 rx=0x7f5ad0153a40 tx=0x7f5ac4010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:52.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.580+0000 7f5ac2ffd700 1 -- 172.21.15.103:0/3412751656 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f5ac403c790 con 0x7f5ad00b3680 2020-04-22T14:10:52.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.769+0000 7f5ad80bf700 1 -- 172.21.15.103:0/3412751656 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ad0147360 con 0x7f5ad00b3680 2020-04-22T14:10:52.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.770+0000 7f5ad565a700 1 --2- 172.21.15.103:0/3412751656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ad00b3680 0x7f5ad00b3b10 secure :-1 s=THROTTLE_DONE pgs=862 cs=0 l=1 rx=0x7f5ad0153a40 tx=0x7f5ac4010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:52.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.770+0000 7f5ac2ffd700 1 -- 172.21.15.103:0/3412751656 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+2143 (secure 0 0 0) 0x7f5ac403fdb0 con 0x7f5ad00b3680 2020-04-22T14:10:52.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.771+0000 7f5ad80bf700 1 -- 172.21.15.103:0/3412751656 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5ab004dcc0 msgr2=0x7f5ab0050180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:52.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.771+0000 7f5ad80bf700 1 --2- 172.21.15.103:0/3412751656 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5ab004dcc0 0x7f5ab0050180 secure :-1 s=READY pgs=325 cs=0 l=1 rx=0x7f5acc004520 tx=0x7f5ad005bce0).stop 2020-04-22T14:10:52.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.771+0000 7f5ad80bf700 1 -- 172.21.15.103:0/3412751656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ad00b3680 msgr2=0x7f5ad00b3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:52.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.771+0000 7f5ad80bf700 1 --2- 172.21.15.103:0/3412751656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ad00b3680 0x7f5ad00b3b10 secure :-1 s=READY pgs=862 cs=0 l=1 rx=0x7f5ad0153a40 tx=0x7f5ac4010b70).stop 2020-04-22T14:10:52.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.771+0000 7f5ad80bf700 1 -- 172.21.15.103:0/3412751656 shutdown_connections 2020-04-22T14:10:52.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.771+0000 7f5ad80bf700 1 --2- 172.21.15.103:0/3412751656 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5ab004dcc0 0x7f5ab0050180 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:52.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.771+0000 7f5ad80bf700 1 --2- 172.21.15.103:0/3412751656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ad00b3680 0x7f5ad00b3b10 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:52.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.771+0000 7f5ad80bf700 1 -- 172.21.15.103:0/3412751656 >> 172.21.15.103:0/3412751656 conn(0x7f5ad00b9160 msgr2=0x7f5ad005ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:52.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.771+0000 7f5ad80bf700 1 -- 172.21.15.103:0/3412751656 shutdown_connections 2020-04-22T14:10:52.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:52.771+0000 7f5ad80bf700 1 -- 172.21.15.103:0/3412751656 wait complete. 2020-04-22T14:10:52.880 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 36 2020-04-22T14:10:52.880 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:10:52.880 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5096,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1960145218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1960145218},{"type":"v1","addr":"172.21.15.86:6835","nonce":1960145218}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:10:40.825749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6289},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6289":{"gid":6289,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/2152235919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2152235919},{"type":"v1","addr":"172.21.15.103:6833","nonce":2152235919}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:10:53.089 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 6289}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 11, u'failed': [], u'epoch': 36, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [12], u'info': {u'gid_6289': {u'export_targets': [], u'name': u'a', u'incarnation': 33, u'state_seq': 3, u'state': u'up:active', u'gid': 6289, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 2152235919, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 2152235919, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/2152235919'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:10:38.817638+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:10:40.825749+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:10:53.089 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:10:53.089 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:53.104 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:10:53.263 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:10:53.263 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:10:53.263 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:10:53.264 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 6289, 2020-04-22T14:10:53.264 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:10:53.264 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:10:53.264 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 14.441649682, 2020-04-22T14:10:53.264 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 36, 2020-04-22T14:10:53.264 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 64, 2020-04-22T14:10:53.265 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 64, 2020-04-22T14:10:53.265 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 19.660095711 2020-04-22T14:10:53.265 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:10:53.271 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 6289, "want_state": "up:active", "state": "up:active", "rank_uptime": 14.441649682, "mdsmap_epoch": 36, "osdmap_epoch": 64, "osdmap_epoch_barrier": 64, "uptime": 19.660095711 } 2020-04-22T14:10:53.271 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-04-22T14:10:53.272 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-04-22T14:10:53.272 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:53.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:53.286 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:10:53.356 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:10:53.356 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:10:53.357 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:10:53.357 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:53.357 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:10:53.357 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:53.357 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:10:53.357 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:10:53.357 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:10:53.358 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:10:53.358 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:10:53.358 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:10:53.358 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:10:53.358 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:10:53.358 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:10:53.358 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42187sec preferred_lft 42187sec 2020-04-22T14:10:53.359 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:10:53.359 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:53.359 INFO:teuthology.orchestra.run.smithi103.stdout:18: brx.1@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:10:53.359 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 86:6a:e2:0f:ca:92 brd ff:ff:ff:ff:ff:ff link-netnsid 1 2020-04-22T14:10:53.359 INFO:teuthology.orchestra.run.smithi103.stdout:19: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:10:53.359 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether d6:00:10:e7:64:03 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:10:53.359 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:10:53.360 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:53.360 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::9a:8537:4603:d6d8/64 scope link noprefixroute 2020-04-22T14:10:53.360 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:53.360 INFO:teuthology.orchestra.run.smithi103.stdout:20: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-04-22T14:10:53.360 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether d6:00:10:e7:64:03 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2020-04-22T14:10:53.360 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:53.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:53.404 INFO:teuthology.orchestra.run.smithi103:> ip netns list 2020-04-22T14:10:53.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2020-04-22T14:10:53.466 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:53.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:53.515 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:10:53.580 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2020-04-22T14:10:53.581 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 1 2020-04-22T14:10:53.581 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:53.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:53.628 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:10:53.689 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2020-04-22T14:10:53.689 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 1 2020-04-22T14:10:53.689 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:53.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:53.736 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:10:53.795 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2020-04-22T14:10:53.795 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 1 2020-04-22T14:10:53.795 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:53.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:53.843 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:10:53.921 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:53.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:53.965 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 2' 2020-04-22T14:10:54.042 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:54.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:54.086 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr' 2020-04-22T14:10:54.194 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:10:54.194 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:10:54.194 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:10:54.194 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:54.195 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:10:54.195 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:54.195 INFO:teuthology.orchestra.run.smithi103.stdout:2: veth0@if20: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:10:54.195 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 7a:26:fd:72:d9:4b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:10:54.195 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2020-04-22T14:10:54.195 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:54.195 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::7826:fdff:fe72:d94b/64 scope link 2020-04-22T14:10:54.196 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:54.196 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:54.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:54.234 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr' 2020-04-22T14:10:54.345 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:10:54.345 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:10:54.345 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:10:54.345 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:54.346 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:10:54.346 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:54.346 INFO:teuthology.orchestra.run.smithi103.stdout:2: veth0@if20: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:10:54.346 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 7a:26:fd:72:d9:4b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:10:54.346 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2020-04-22T14:10:54.346 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:54.347 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::7826:fdff:fe72:d94b/64 scope link 2020-04-22T14:10:54.347 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:54.347 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.2/16 2020-04-22T14:10:54.347 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:54.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:54.374 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.2' 2020-04-22T14:10:54.456 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:54.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:54.498 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0' 2020-04-22T14:10:54.610 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:54.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:54.624 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up' 2020-04-22T14:10:54.734 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:54.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:54.761 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up' 2020-04-22T14:10:54.887 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:54.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:54.914 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254' 2020-04-22T14:10:55.055 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:55.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:55.085 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:10:55.174 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:55.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:55.236 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge-slave con-name brx.2 ifname brx.2 master ceph-brx' 2020-04-22T14:10:55.355 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.2' (87d9c886-d0a8-4ea3-83e8-eceb1cb68de5) successfully added. 2020-04-22T14:10:55.356 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:55.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:55.394 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up brx.2' 2020-04-22T14:10:55.557 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/23) 2020-04-22T14:10:55.608 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2020-04-22T14:10:55.608 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi103.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2020-04-22T14:10:55.609 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:55.623 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:10:55.624 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:10:55.683 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:55.741 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:10:55.741 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:10:55.809 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:10:55.817 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:10:55.817 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:55.864 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:10:55.864 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:10:55.923 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:10:55.923 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [47] 2020-04-22T14:10:55.923 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:55.976 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:10:56.018 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:56.032 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:10:56.033 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:10:56.105 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:10:56.106 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:10:56.107 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:56.107 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:2020-04-22T14:10:56.105+0000 7f38c9db51c0 -1 init, newargv = 0x55c8b7e7df20 newargc=9 2020-04-22T14:10:56.107 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[68218]: starting ceph client 2020-04-22T14:10:56.111 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[68218]: starting fuse 2020-04-22T14:10:56.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:10:56.125 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:10:56.183 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:10:56.183 INFO:teuthology.orchestra.run.smithi103.stdout:49 2020-04-22T14:10:56.183 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47, 49] 2020-04-22T14:10:56.184 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:56.233 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:10:56.233 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:10:56.234 INFO:teuthology.orchestra.run.smithi103:> import glob 2020-04-22T14:10:56.234 INFO:teuthology.orchestra.run.smithi103:> import re 2020-04-22T14:10:56.234 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:10:56.234 INFO:teuthology.orchestra.run.smithi103:> import subprocess 2020-04-22T14:10:56.234 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:10:56.234 INFO:teuthology.orchestra.run.smithi103:> def find_socket(client_name): 2020-04-22T14:10:56.234 INFO:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2020-04-22T14:10:56.234 INFO:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2020-04-22T14:10:56.235 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:10:56.235 INFO:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2020-04-22T14:10:56.235 INFO:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2020-04-22T14:10:56.235 INFO:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2020-04-22T14:10:56.235 INFO:teuthology.orchestra.run.smithi103:> return files[0] 2020-04-22T14:10:56.235 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:10:56.235 INFO:teuthology.orchestra.run.smithi103:> for f in files: 2020-04-22T14:10:56.235 INFO:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:10:56.236 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:10:56.236 INFO:teuthology.orchestra.run.smithi103:> return f 2020-04-22T14:10:56.236 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:10:56.236 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:10:56.236 INFO:teuthology.orchestra.run.smithi103:> print(find_socket("client.1")) 2020-04-22T14:10:56.236 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:10:56.341 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.1.68218.asok 2020-04-22T14:10:56.342 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.68218.asok 2020-04-22T14:10:56.342 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:56.356 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:10:56.356 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.68218.asok status 2020-04-22T14:10:56.515 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:10:56.515 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2020-04-22T14:10:56.515 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:10:56.516 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:10:56.516 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "1", 2020-04-22T14:10:56.516 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:10:56.516 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2020-04-22T14:10:56.516 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "68218", 2020-04-22T14:10:56.516 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:10:56.516 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:56.517 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2020-04-22T14:10:56.517 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2020-04-22T14:10:56.517 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 5222, 2020-04-22T14:10:56.517 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2020-04-22T14:10:56.517 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:10:56.517 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:10:56.517 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5222 2020-04-22T14:10:56.518 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:56.518 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:10:56.518 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:10:56.518 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.2:0", 2020-04-22T14:10:56.518 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 3474589177 2020-04-22T14:10:56.518 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:10:56.518 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:56.519 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:10:56.519 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:10:56.519 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.2:0", 2020-04-22T14:10:56.519 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 3474589177 2020-04-22T14:10:56.519 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:10:56.519 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.5222 192.168.0.2:0/3474589177", 2020-04-22T14:10:56.519 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.2:0/3474589177", 2020-04-22T14:10:56.519 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2020-04-22T14:10:56.520 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 36, 2020-04-22T14:10:56.520 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 64, 2020-04-22T14:10:56.520 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2020-04-22T14:10:56.520 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklisted": false 2020-04-22T14:10:56.520 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:10:56.521 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:56.534 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:10:56.534 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-22T14:10:56.534 INFO:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:10:56.602 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2020-04-22T14:10:56.602 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-04-22T14:10:56.602 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:56.647 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:10:56.648 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:10:56.718 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:56.770 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok config get mds_reconnect_timeout 2020-04-22T14:10:56.922 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:10:56.922 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_reconnect_timeout": "45.000000" 2020-04-22T14:10:56.922 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:10:56.930 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_reconnect_timeout": "45.000000" } 2020-04-22T14:10:56.930 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:56.943 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok config get ms_max_backoff 2020-04-22T14:10:57.095 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:10:57.096 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_max_backoff": "15.000000" 2020-04-22T14:10:57.096 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:10:57.104 INFO:tasks.cephfs.filesystem:_json_asok output: { "ms_max_backoff": "15.000000" } 2020-04-22T14:10:57.104 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2020-04-22T14:10:57.104 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:57.118 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-04-22T14:10:57.118 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:10:57.195 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[68218]: fuse finished with error 0 and tester_r 0 2020-04-22T14:10:57.226 INFO:teuthology.orchestra.run:waiting for 900 2020-04-22T14:10:57.301 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-04-22T14:10:57.301 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:10:57.301 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:57.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:57.315 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:10:57.390 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:57.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:57.440 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down brx.2' 2020-04-22T14:10:57.599 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.2' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/23) 2020-04-22T14:10:57.600 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:57.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:57.614 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete brx.2' 2020-04-22T14:10:57.723 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.2' (87d9c886-d0a8-4ea3-83e8-eceb1cb68de5) successfully deleted. 2020-04-22T14:10:57.723 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:57.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:57.754 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:10:57.862 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:57.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:57.887 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:10:57.946 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:10:57.947 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:10:57.947 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:10:57.947 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:57.947 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:10:57.947 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:57.947 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:10:57.948 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:10:57.948 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:10:57.948 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:10:57.948 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:10:57.948 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:10:57.948 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:10:57.948 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:10:57.949 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:10:57.949 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42182sec preferred_lft 42182sec 2020-04-22T14:10:57.949 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:10:57.949 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:57.949 INFO:teuthology.orchestra.run.smithi103.stdout:18: brx.1@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:10:57.949 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 86:6a:e2:0f:ca:92 brd ff:ff:ff:ff:ff:ff link-netnsid 1 2020-04-22T14:10:57.949 INFO:teuthology.orchestra.run.smithi103.stdout:19: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:10:57.949 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether d6:00:10:e7:64:03 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:10:57.950 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:10:57.950 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:57.950 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::9a:8537:4603:d6d8/64 scope link noprefixroute 2020-04-22T14:10:57.950 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:10:57.950 INFO:teuthology.orchestra.run.smithi103.stdout:20: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-04-22T14:10:57.950 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether d6:00:10:e7:64:03 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2020-04-22T14:10:57.951 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:57.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:57.996 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:10:58.076 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:58.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:58.125 INFO:teuthology.orchestra.run.smithi103:> nmcli connection show 2020-04-22T14:10:58.206 INFO:teuthology.orchestra.run.smithi103.stdout:NAME UUID TYPE DEVICE 2020-04-22T14:10:58.206 INFO:teuthology.orchestra.run.smithi103.stdout:System enp3s0f1 b0a308d1-bd90-60af-eb7c-0183bb425a1a ethernet enp3s0f1 2020-04-22T14:10:58.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-brx 606a42d6-cea1-405a-8661-003fefae55b7 bridge ceph-brx 2020-04-22T14:10:58.207 INFO:teuthology.orchestra.run.smithi103.stdout:brx.0 c3b14acb-5ee5-4601-a6c3-3fdb893b60f6 ethernet brx.0 2020-04-22T14:10:58.207 INFO:teuthology.orchestra.run.smithi103.stdout:eno1 206ad60d-195e-4d4b-a9fe-a5dd1f33a67d ethernet -- 2020-04-22T14:10:58.207 INFO:teuthology.orchestra.run.smithi103.stdout:eno2 894a7dd2-d329-4985-9ef9-84a92c6e1c6c ethernet -- 2020-04-22T14:10:58.207 INFO:teuthology.orchestra.run.smithi103.stdout:enp3s0f0 5a3237ce-06ab-4ae0-818b-45bdf036cb08 ethernet -- 2020-04-22T14:10:58.207 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:58.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:58.251 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:10:58.313 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:58.358 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-04-22T14:10:58.358 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:10:58.358 INFO:teuthology.orchestra.run.smithi103:> import time 2020-04-22T14:10:58.358 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:10:58.359 INFO:teuthology.orchestra.run.smithi103:> path = "/home/ubuntu/cephtest/mnt.0/subdir" 2020-04-22T14:10:58.359 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:10:58.359 INFO:teuthology.orchestra.run.smithi103:> print("Starting creation...") 2020-04-22T14:10:58.359 INFO:teuthology.orchestra.run.smithi103:> start = time.time() 2020-04-22T14:10:58.359 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:10:58.359 INFO:teuthology.orchestra.run.smithi103:> os.mkdir(path) 2020-04-22T14:10:58.359 INFO:teuthology.orchestra.run.smithi103:> dfd = os.open(path, os.O_DIRECTORY) 2020-04-22T14:10:58.359 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:10:58.360 INFO:teuthology.orchestra.run.smithi103:> fd = open(os.path.join(path, "childfile"), "w") 2020-04-22T14:10:58.360 INFO:teuthology.orchestra.run.smithi103:> print("Finished creation in {0}s".format(time.time() - start)) 2020-04-22T14:10:58.360 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:10:58.360 INFO:teuthology.orchestra.run.smithi103:> print("Starting fsync...") 2020-04-22T14:10:58.360 INFO:teuthology.orchestra.run.smithi103:> start = time.time() 2020-04-22T14:10:58.360 INFO:teuthology.orchestra.run.smithi103:> if False: 2020-04-22T14:10:58.360 INFO:teuthology.orchestra.run.smithi103:> os.fsync(dfd) 2020-04-22T14:10:58.361 INFO:teuthology.orchestra.run.smithi103:> else: 2020-04-22T14:10:58.361 INFO:teuthology.orchestra.run.smithi103:> os.fsync(fd) 2020-04-22T14:10:58.361 INFO:teuthology.orchestra.run.smithi103:> print("Finished fsync in {0}s".format(time.time() - start)) 2020-04-22T14:10:58.361 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:10:58.485 INFO:teuthology.orchestra.run.smithi103.stdout:Starting creation... 2020-04-22T14:10:58.485 INFO:teuthology.orchestra.run.smithi103.stdout:Finished creation in 0.006414890289306641s 2020-04-22T14:10:58.485 INFO:teuthology.orchestra.run.smithi103.stdout:Starting fsync... 2020-04-22T14:10:58.485 INFO:teuthology.orchestra.run.smithi103.stdout:Finished fsync in 0.002206563949584961s 2020-04-22T14:10:58.666 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-04-22T14:10:58.666 INFO:teuthology.orchestra.run:waiting for 300 2020-04-22T14:10:58.666 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-04-22T14:10:58.667 INFO:teuthology.orchestra.run:waiting for 300 2020-04-22T14:10:58.677 INFO:tasks.ceph.mds.b:Stopped 2020-04-22T14:10:58.677 DEBUG:teuthology.parallel:result is None 2020-04-22T14:10:58.714 INFO:tasks.ceph.mds.a:Stopped 2020-04-22T14:10:58.715 DEBUG:teuthology.parallel:result is None 2020-04-22T14:10:58.715 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:58.715 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:58.770 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mds fail b 2020-04-22T14:10:58.770 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mds fail a 2020-04-22T14:10:58.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.917+0000 7f7976939700 1 Processor -- start 2020-04-22T14:10:58.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.918+0000 7f7976939700 1 -- start start 2020-04-22T14:10:58.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.918+0000 7f7976939700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7970146210 0x7f79701465f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:58.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.918+0000 7f7976939700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f79700af280 0x7f7970141cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:58.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.918+0000 7f7976939700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79700adad0 con 0x7f7970142150 2020-04-22T14:10:58.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.918+0000 7f7976939700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79700add70 con 0x7f79700af280 2020-04-22T14:10:58.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.918+0000 7f7976939700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7970146a50 con 0x7f7970146210 2020-04-22T14:10:58.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.918+0000 7f796ffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7970146210 0x7f79701465f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:58.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.918+0000 7f796ffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7970146210 0x7f79701465f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51588/0 (socket says 172.21.15.103:51588) 2020-04-22T14:10:58.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.918+0000 7f7974ed6700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f7970142150 0x7f79700b3e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43782/0 (socket says 172.21.15.103:43782) 2020-04-22T14:10:58.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.918+0000 7f796ffff700 1 -- 172.21.15.103:0/1426108427 learned_addr learned my addr 172.21.15.103:0/1426108427 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:10:58.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.919+0000 7f796f7fe700 1 --2- 172.21.15.103:0/1426108427 >> v2:172.21.15.86:3300/0 conn(0x7f79700af280 0x7f7970141cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:58.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.919+0000 7f796ffff700 1 -- 172.21.15.103:0/1426108427 >> v2:172.21.15.86:3300/0 conn(0x7f79700af280 msgr2=0x7f7970141cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:58.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.919+0000 7f796ffff700 1 --2- 172.21.15.103:0/1426108427 >> v2:172.21.15.86:3300/0 conn(0x7f79700af280 0x7f7970141cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:58.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.919+0000 7f796effd700 1 -- 172.21.15.103:0/1426108427 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2391507530 0 0) 0x7f79700adad0 con 0x7f7970142150 2020-04-22T14:10:58.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.919+0000 7f796ffff700 1 -- 172.21.15.103:0/1426108427 >> v1:172.21.15.103:6789/0 conn(0x7f7970142150 legacy=0x7f79700b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:58.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.919+0000 7f796ffff700 1 -- 172.21.15.103:0/1426108427 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79700af750 con 0x7f7970146210 2020-04-22T14:10:58.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.919+0000 7f796ffff700 1 --2- 172.21.15.103:0/1426108427 >> v2:172.21.15.103:3300/0 conn(0x7f7970146210 0x7f79701465f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7960002f30 tx=0x7f7960007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:58.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.919+0000 7f796ffff700 1 --2- 172.21.15.103:0/1426108427 >> v2:172.21.15.103:3300/0 conn(0x7f7970146210 0x7f79701465f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7960002f30 tx=0x7f7960007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:58.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.919+0000 7f796ffff700 1 --2- 172.21.15.103:0/1426108427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7970146210 0x7f79701465f0 secure :-1 s=READY pgs=865 cs=0 l=1 rx=0x7f7960002f30 tx=0x7f7960007a40).ready entity=mon.1 client_cookie=a372af196ec31d12 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:58.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.919+0000 7f796ffff700 1 --2- 172.21.15.103:0/1426108427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7970146210 0x7f79701465f0 secure :-1 s=THROTTLE_DONE pgs=865 cs=0 l=1 rx=0x7f7960002f30 tx=0x7f7960007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:58.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.919+0000 7f796effd700 1 -- 172.21.15.103:0/1426108427 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7960009e40 con 0x7f7970146210 2020-04-22T14:10:58.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.919+0000 7f796ffff700 1 --2- 172.21.15.103:0/1426108427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7970146210 0x7f79701465f0 secure :-1 s=THROTTLE_DONE pgs=865 cs=0 l=1 rx=0x7f7960002f30 tx=0x7f7960007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:58.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.919+0000 7f796ffff700 1 --2- 172.21.15.103:0/1426108427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7970146210 0x7f79701465f0 secure :-1 s=THROTTLE_DONE pgs=865 cs=0 l=1 rx=0x7f7960002f30 tx=0x7f7960007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:58.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.919+0000 7f796effd700 1 -- 172.21.15.103:0/1426108427 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7960012a20 con 0x7f7970146210 2020-04-22T14:10:58.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.919+0000 7f796effd700 1 -- 172.21.15.103:0/1426108427 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7960012e00 con 0x7f7970146210 2020-04-22T14:10:58.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.919+0000 7f7976939700 1 -- 172.21.15.103:0/1426108427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7970146210 msgr2=0x7f79701465f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:58.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.919+0000 7f7976939700 1 --2- 172.21.15.103:0/1426108427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7970146210 0x7f79701465f0 secure :-1 s=READY pgs=865 cs=0 l=1 rx=0x7f7960002f30 tx=0x7f7960007a40).stop 2020-04-22T14:10:58.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7f7976939700 1 -- 172.21.15.103:0/1426108427 shutdown_connections 2020-04-22T14:10:58.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7f7976939700 1 --2- 172.21.15.103:0/1426108427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7970146210 0x7f79701465f0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:58.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7f7976939700 1 --2- 172.21.15.103:0/1426108427 >> v2:172.21.15.86:3300/0 conn(0x7f79700af280 0x7f7970141cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:58.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7f7976939700 1 -- 172.21.15.103:0/1426108427 >> 172.21.15.103:0/1426108427 conn(0x7f79700b86b0 msgr2=0x7f79700b8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:58.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7f7976939700 1 -- 172.21.15.103:0/1426108427 shutdown_connections 2020-04-22T14:10:58.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7f7976939700 1 -- 172.21.15.103:0/1426108427 wait complete. 2020-04-22T14:10:58.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.921+0000 7f7976939700 1 Processor -- start 2020-04-22T14:10:58.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.921+0000 7f7976939700 1 -- start start 2020-04-22T14:10:58.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.922+0000 7f7976939700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7970142150 0x7f7970062c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:58.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.922+0000 7f7976939700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7970065d20 con 0x7f7970146210 2020-04-22T14:10:58.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.922+0000 7f7976939700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7970062240 con 0x7f79700af280 2020-04-22T14:10:58.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.922+0000 7f7976939700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79700624e0 con 0x7f7970142150 2020-04-22T14:10:58.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.922+0000 7f796ffff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f79700af280 0x7f7970154e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43796/0 (socket says 172.21.15.103:43796) 2020-04-22T14:10:58.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.922+0000 7f796ffff700 1 -- 172.21.15.103:0/3382999336 learned_addr learned my addr 172.21.15.103:0/3382999336 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:58.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.922+0000 7f796f7fe700 1 --2- 172.21.15.103:0/3382999336 >> v2:172.21.15.86:3300/0 conn(0x7f7970142150 0x7f7970062c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:58.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.922+0000 7f796d7fa700 1 -- 172.21.15.103:0/3382999336 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1732846236 0 0) 0x7f7970062240 con 0x7f79700af280 2020-04-22T14:10:58.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.922+0000 7f796d7fa700 1 -- 172.21.15.103:0/3382999336 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7950002fe0 con 0x7f79700af280 2020-04-22T14:10:58.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.923+0000 7f796d7fa700 1 -- 172.21.15.103:0/3382999336 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1443004627 0 0) 0x7f7950002fe0 con 0x7f79700af280 2020-04-22T14:10:58.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.923+0000 7f796d7fa700 1 -- 172.21.15.103:0/3382999336 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7970062240 con 0x7f79700af280 2020-04-22T14:10:58.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.923+0000 7f796d7fa700 1 -- 172.21.15.103:0/3382999336 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f7960009e40 con 0x7f79700af280 2020-04-22T14:10:58.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.923+0000 7f796f7fe700 1 -- 172.21.15.103:0/3382999336 >> v1:172.21.15.103:6789/0 conn(0x7f79700af280 legacy=0x7f7970154e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:58.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.923+0000 7f796f7fe700 1 -- 172.21.15.103:0/3382999336 >> v1:172.21.15.86:6789/0 conn(0x7f7970146210 legacy=0x7f7970140ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:58.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.923+0000 7f796f7fe700 1 -- 172.21.15.103:0/3382999336 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7970062780 con 0x7f7970142150 2020-04-22T14:10:58.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.923+0000 7f796f7fe700 1 --2- 172.21.15.103:0/3382999336 >> v2:172.21.15.86:3300/0 conn(0x7f7970142150 0x7f7970062c20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7968001320 tx=0x7f7964010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:58.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.923+0000 7f796f7fe700 1 --2- 172.21.15.103:0/3382999336 >> v2:172.21.15.86:3300/0 conn(0x7f7970142150 0x7f7970062c20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7968001320 tx=0x7f7964010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:58.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.923+0000 7f796f7fe700 1 --2- 172.21.15.103:0/3382999336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7970142150 0x7f7970062c20 secure :-1 s=READY pgs=500 cs=0 l=1 rx=0x7f7968001320 tx=0x7f7964010b10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:58.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.923+0000 7f796f7fe700 1 --2- 172.21.15.103:0/3382999336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7970142150 0x7f7970062c20 secure :-1 s=THROTTLE_DONE pgs=500 cs=0 l=1 rx=0x7f7968001320 tx=0x7f7964010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:58.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.923+0000 7f796d7fa700 1 -- 172.21.15.103:0/3382999336 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7964007560 con 0x7f7970142150 2020-04-22T14:10:58.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.923+0000 7f796f7fe700 1 --2- 172.21.15.103:0/3382999336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7970142150 0x7f7970062c20 secure :-1 s=THROTTLE_DONE pgs=500 cs=0 l=1 rx=0x7f7968001320 tx=0x7f7964010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:58.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.923+0000 7f796f7fe700 1 --2- 172.21.15.103:0/3382999336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7970142150 0x7f7970062c20 secure :-1 s=THROTTLE_DONE pgs=500 cs=0 l=1 rx=0x7f7968001320 tx=0x7f7964010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:58.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.923+0000 7f796d7fa700 1 -- 172.21.15.103:0/3382999336 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79640058a0 con 0x7f7970142150 2020-04-22T14:10:58.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.923+0000 7f7976939700 1 -- 172.21.15.103:0/3382999336 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7970155520 con 0x7f7970142150 2020-04-22T14:10:58.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.923+0000 7f796d7fa700 1 -- 172.21.15.103:0/3382999336 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7964005c00 con 0x7f7970142150 2020-04-22T14:10:58.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.923+0000 7f7976939700 1 -- 172.21.15.103:0/3382999336 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79700637a0 con 0x7f7970142150 2020-04-22T14:10:58.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.924+0000 7f796f7fe700 1 --2- 172.21.15.103:0/3382999336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7970142150 0x7f7970062c20 secure :-1 s=THROTTLE_DONE pgs=500 cs=0 l=1 rx=0x7f7968001320 tx=0x7f7964010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:58.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.924+0000 7f7976939700 1 -- 172.21.15.103:0/3382999336 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7970056c90 con 0x7f7970142150 2020-04-22T14:10:58.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.924+0000 7f796d7fa700 1 -- 172.21.15.103:0/3382999336 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f796400e220 con 0x7f7970142150 2020-04-22T14:10:58.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.924+0000 7f796f7fe700 1 --2- 172.21.15.103:0/3382999336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7970142150 0x7f7970062c20 secure :-1 s=THROTTLE_DONE pgs=500 cs=0 l=1 rx=0x7f7968001320 tx=0x7f7964010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:58.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.925+0000 7f796d7fa700 1 --2- 172.21.15.103:0/3382999336 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f795004def0 0x7f79500503b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:58.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.925+0000 7f796d7fa700 1 -- 172.21.15.103:0/3382999336 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f79640611f0 con 0x7f7970142150 2020-04-22T14:10:58.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.925+0000 7f796ffff700 1 --2- 172.21.15.103:0/3382999336 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f795004def0 0x7f79500503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:58.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.925+0000 7f796ffff700 1 --2- 172.21.15.103:0/3382999336 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f795004def0 0x7f79500503b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f79600113f0 tx=0x7f7960003030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:58.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.925+0000 7f796ffff700 1 --2- 172.21.15.103:0/3382999336 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f795004def0 0x7f79500503b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f79600113f0 tx=0x7f7960003030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:58.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.925+0000 7f796ffff700 1 --2- 172.21.15.103:0/3382999336 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f795004def0 0x7f79500503b0 secure :-1 s=READY pgs=326 cs=0 l=1 rx=0x7f79600113f0 tx=0x7f7960003030).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:58.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.928+0000 7f796f7fe700 1 --2- 172.21.15.103:0/3382999336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7970142150 0x7f7970062c20 secure :-1 s=THROTTLE_DONE pgs=500 cs=0 l=1 rx=0x7f7968001320 tx=0x7f7964010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:58.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.928+0000 7f796d7fa700 1 -- 172.21.15.103:0/3382999336 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f796403c570 con 0x7f7970142150 2020-04-22T14:10:58.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.918+0000 7ff063fff700 1 Processor -- start 2020-04-22T14:10:58.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.918+0000 7ff063fff700 1 -- start start 2020-04-22T14:10:58.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.919+0000 7ff063fff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff06405b110 0x7ff064150d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:58.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.919+0000 7ff063fff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff06405f360 con 0x7ff06405fd40 2020-04-22T14:10:58.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.919+0000 7ff063fff700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff06405f600 con 0x7ff06405ad30 2020-04-22T14:10:58.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.919+0000 7ff063fff700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff064063090 con 0x7ff06405b110 2020-04-22T14:10:58.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.919+0000 7ff062ffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff06405ad30 0x7ff064062980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43784/0 (socket says 172.21.15.103:43784) 2020-04-22T14:10:58.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.919+0000 7ff062ffd700 1 -- 172.21.15.103:0/2556060569 learned_addr learned my addr 172.21.15.103:0/2556060569 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:58.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.919+0000 7ff0637fe700 1 --2- 172.21.15.103:0/2556060569 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff06405b110 0x7ff064150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:58.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.919+0000 7ff061ffb700 1 -- 172.21.15.103:0/2556060569 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 410500688 0 0) 0x7ff06405f600 con 0x7ff06405ad30 2020-04-22T14:10:58.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.919+0000 7ff061ffb700 1 -- 172.21.15.103:0/2556060569 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff048003230 con 0x7ff06405ad30 2020-04-22T14:10:58.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.919+0000 7ff061ffb700 1 -- 172.21.15.103:0/2556060569 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2116194420 0 0) 0x7ff06405f360 con 0x7ff06405fd40 2020-04-22T14:10:58.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.919+0000 7ff061ffb700 1 -- 172.21.15.103:0/2556060569 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff06405f600 con 0x7ff06405fd40 2020-04-22T14:10:58.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7ff061ffb700 1 -- 172.21.15.103:0/2556060569 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3114134227 0 0) 0x7ff048003230 con 0x7ff06405ad30 2020-04-22T14:10:58.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7ff061ffb700 1 -- 172.21.15.103:0/2556060569 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff06405b110 msgr2=0x7ff064150d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:58.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7ff061ffb700 1 --2- 172.21.15.103:0/2556060569 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff06405b110 0x7ff064150d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:58.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7ff061ffb700 1 -- 172.21.15.103:0/2556060569 >> v1:172.21.15.86:6789/0 conn(0x7ff06405fd40 legacy=0x7ff06414d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:58.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7ff061ffb700 1 -- 172.21.15.103:0/2556060569 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff06405f8a0 con 0x7ff06405ad30 2020-04-22T14:10:58.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7ff061ffb700 1 -- 172.21.15.103:0/2556060569 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7ff054001710 con 0x7ff06405ad30 2020-04-22T14:10:58.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7ff061ffb700 1 -- 172.21.15.103:0/2556060569 >> v1:172.21.15.103:6789/0 conn(0x7ff06405ad30 legacy=0x7ff064062980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:58.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7ff061ffb700 1 --2- 172.21.15.103:0/2556060569 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0480038b0 0x7ff048003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:58.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7ff061ffb700 1 --2- 172.21.15.103:0/2556060569 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0480044d0 0x7ff048004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:58.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7ff061ffb700 1 --2- 172.21.15.103:0/2556060569 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff048004db0 0x7ff04800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:10:58.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7ff061ffb700 1 -- 172.21.15.103:0/2556060569 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff064063090 con 0x7ff048004db0 2020-04-22T14:10:58.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7ff061ffb700 1 -- 172.21.15.103:0/2556060569 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff048005350 con 0x7ff0480044d0 2020-04-22T14:10:58.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7ff061ffb700 1 -- 172.21.15.103:0/2556060569 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff04800bb80 con 0x7ff0480038b0 2020-04-22T14:10:58.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7ff0637fe700 1 --2- 172.21.15.103:0/2556060569 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff06405b110 0x7ff064150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:10:58.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7ff0627fc700 1 --2- 172.21.15.103:0/2556060569 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0480044d0 0x7ff048004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:58.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7ff062ffd700 1 --2- 172.21.15.103:0/2556060569 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0480038b0 0x7ff048003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:58.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7ff0637fe700 1 --2- 172.21.15.103:0/2556060569 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff048004db0 0x7ff04800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:58.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7ff0627fc700 1 -- 172.21.15.103:0/2556060569 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0480038b0 msgr2=0x7ff048003cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:58.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7ff0627fc700 1 --2- 172.21.15.103:0/2556060569 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0480038b0 0x7ff048003cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:58.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7ff0627fc700 1 -- 172.21.15.103:0/2556060569 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff048004db0 msgr2=0x7ff04800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:10:58.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7ff0627fc700 1 --2- 172.21.15.103:0/2556060569 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff048004db0 0x7ff04800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:10:58.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7ff0627fc700 1 -- 172.21.15.103:0/2556060569 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff048003230 con 0x7ff0480044d0 2020-04-22T14:10:58.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7ff0637fe700 1 --2- 172.21.15.103:0/2556060569 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff048004db0 0x7ff04800b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:10:58.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7ff062ffd700 1 --2- 172.21.15.103:0/2556060569 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0480038b0 0x7ff048003cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:10:58.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7ff0627fc700 1 --2- 172.21.15.103:0/2556060569 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0480044d0 0x7ff048004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff048004440 tx=0x7ff058001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:58.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7ff0627fc700 1 --2- 172.21.15.103:0/2556060569 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0480044d0 0x7ff048004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff048004440 tx=0x7ff058001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:58.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7ff0627fc700 1 --2- 172.21.15.103:0/2556060569 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0480044d0 0x7ff048004950 secure :-1 s=READY pgs=867 cs=0 l=1 rx=0x7ff048004440 tx=0x7ff058001e40).ready entity=mon.1 client_cookie=341dc8944e40b12f server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:58.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7ff0627fc700 1 --2- 172.21.15.103:0/2556060569 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0480044d0 0x7ff048004950 secure :-1 s=THROTTLE_DONE pgs=867 cs=0 l=1 rx=0x7ff048004440 tx=0x7ff058001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:58.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7ff061ffb700 1 -- 172.21.15.103:0/2556060569 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff05800c920 con 0x7ff0480044d0 2020-04-22T14:10:58.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7ff0627fc700 1 --2- 172.21.15.103:0/2556060569 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0480044d0 0x7ff048004950 secure :-1 s=THROTTLE_DONE pgs=867 cs=0 l=1 rx=0x7ff048004440 tx=0x7ff058001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:58.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7ff0627fc700 1 --2- 172.21.15.103:0/2556060569 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0480044d0 0x7ff048004950 secure :-1 s=THROTTLE_DONE pgs=867 cs=0 l=1 rx=0x7ff048004440 tx=0x7ff058001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:58.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7ff061ffb700 1 -- 172.21.15.103:0/2556060569 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05800cac0 con 0x7ff0480044d0 2020-04-22T14:10:58.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7ff061ffb700 1 -- 172.21.15.103:0/2556060569 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff05800cea0 con 0x7ff0480044d0 2020-04-22T14:10:58.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7ff063fff700 1 -- 172.21.15.103:0/2556060569 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0480044d0 msgr2=0x7ff048004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:58.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7ff063fff700 1 --2- 172.21.15.103:0/2556060569 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0480044d0 0x7ff048004950 secure :-1 s=READY pgs=867 cs=0 l=1 rx=0x7ff048004440 tx=0x7ff058001e40).stop 2020-04-22T14:10:58.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.920+0000 7ff0637fe700 1 -- 172.21.15.103:0/2556060569 reap_dead start 2020-04-22T14:10:58.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.921+0000 7ff063fff700 1 -- 172.21.15.103:0/2556060569 shutdown_connections 2020-04-22T14:10:58.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.921+0000 7ff063fff700 1 -- 172.21.15.103:0/2556060569 >> 172.21.15.103:0/2556060569 conn(0x7ff0640b95b0 msgr2=0x7ff0640b99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:58.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.921+0000 7ff063fff700 1 -- 172.21.15.103:0/2556060569 shutdown_connections 2020-04-22T14:10:58.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.921+0000 7ff063fff700 1 -- 172.21.15.103:0/2556060569 wait complete. 2020-04-22T14:10:58.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.922+0000 7ff063fff700 1 Processor -- start 2020-04-22T14:10:58.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.922+0000 7ff063fff700 1 -- start start 2020-04-22T14:10:58.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.923+0000 7ff063fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff064148570 0x7ff064147610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:58.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.923+0000 7ff063fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff06413c4d0 0x7ff06413c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:58.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.923+0000 7ff063fff700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff064064840 con 0x7ff064146260 2020-04-22T14:10:58.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.923+0000 7ff063fff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff064064ae0 con 0x7ff06413c4d0 2020-04-22T14:10:58.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.923+0000 7ff063fff700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff064064d80 con 0x7ff064148570 2020-04-22T14:10:58.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.923+0000 7ff0627fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff064148570 0x7ff064147610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:58.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.923+0000 7ff062ffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff064146260 0x7ff0640b6cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43802/0 (socket says 172.21.15.103:43802) 2020-04-22T14:10:58.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.923+0000 7ff062ffd700 1 -- 172.21.15.103:0/977502622 learned_addr learned my addr 172.21.15.103:0/977502622 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:10:58.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.923+0000 7ff0637fe700 1 --2- 172.21.15.103:0/977502622 >> v2:172.21.15.86:3300/0 conn(0x7ff06413c4d0 0x7ff06413c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:58.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.923+0000 7ff0627fc700 1 -- 172.21.15.103:0/977502622 >> v2:172.21.15.86:3300/0 conn(0x7ff06413c4d0 msgr2=0x7ff06413c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:58.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.923+0000 7ff053fff700 1 -- 172.21.15.103:0/977502622 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1755444797 0 0) 0x7ff064064840 con 0x7ff064146260 2020-04-22T14:10:58.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.923+0000 7ff0627fc700 1 --2- 172.21.15.103:0/977502622 >> v2:172.21.15.86:3300/0 conn(0x7ff06413c4d0 0x7ff06413c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:58.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.923+0000 7ff0627fc700 1 -- 172.21.15.103:0/977502622 >> v1:172.21.15.103:6789/0 conn(0x7ff064146260 legacy=0x7ff0640b6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:58.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.924+0000 7ff0627fc700 1 -- 172.21.15.103:0/977502622 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff064146640 con 0x7ff064148570 2020-04-22T14:10:58.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.924+0000 7ff0627fc700 1 --2- 172.21.15.103:0/977502622 >> v2:172.21.15.103:3300/0 conn(0x7ff064148570 0x7ff064147610 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff064147520 tx=0x7ff058001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:58.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.924+0000 7ff0627fc700 1 --2- 172.21.15.103:0/977502622 >> v2:172.21.15.103:3300/0 conn(0x7ff064148570 0x7ff064147610 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff064147520 tx=0x7ff058001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:58.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.924+0000 7ff0627fc700 1 --2- 172.21.15.103:0/977502622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff064148570 0x7ff064147610 secure :-1 s=READY pgs=870 cs=0 l=1 rx=0x7ff064147520 tx=0x7ff058001e40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:58.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.924+0000 7ff0627fc700 1 --2- 172.21.15.103:0/977502622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff064148570 0x7ff064147610 secure :-1 s=THROTTLE_DONE pgs=870 cs=0 l=1 rx=0x7ff064147520 tx=0x7ff058001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:58.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.924+0000 7ff053fff700 1 -- 172.21.15.103:0/977502622 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff05800c730 con 0x7ff064148570 2020-04-22T14:10:58.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.924+0000 7ff063fff700 1 -- 172.21.15.103:0/977502622 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0640644c0 con 0x7ff064148570 2020-04-22T14:10:58.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.924+0000 7ff063fff700 1 -- 172.21.15.103:0/977502622 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff064065460 con 0x7ff064148570 2020-04-22T14:10:58.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.924+0000 7ff0627fc700 1 --2- 172.21.15.103:0/977502622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff064148570 0x7ff064147610 secure :-1 s=THROTTLE_DONE pgs=870 cs=0 l=1 rx=0x7ff064147520 tx=0x7ff058001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:58.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.924+0000 7ff0627fc700 1 --2- 172.21.15.103:0/977502622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff064148570 0x7ff064147610 secure :-1 s=THROTTLE_DONE pgs=870 cs=0 l=1 rx=0x7ff064147520 tx=0x7ff058001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:58.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.924+0000 7ff053fff700 1 -- 172.21.15.103:0/977502622 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05800c890 con 0x7ff064148570 2020-04-22T14:10:58.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.924+0000 7ff053fff700 1 -- 172.21.15.103:0/977502622 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff058001470 con 0x7ff064148570 2020-04-22T14:10:58.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.925+0000 7ff0627fc700 1 --2- 172.21.15.103:0/977502622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff064148570 0x7ff064147610 secure :-1 s=THROTTLE_DONE pgs=870 cs=0 l=1 rx=0x7ff064147520 tx=0x7ff058001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:58.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.925+0000 7ff063fff700 1 -- 172.21.15.103:0/977502622 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff044003340 con 0x7ff064148570 2020-04-22T14:10:58.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.925+0000 7ff053fff700 1 -- 172.21.15.103:0/977502622 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ff05800cbf0 con 0x7ff064148570 2020-04-22T14:10:58.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.925+0000 7ff0627fc700 1 --2- 172.21.15.103:0/977502622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff064148570 0x7ff064147610 secure :-1 s=THROTTLE_DONE pgs=870 cs=0 l=1 rx=0x7ff064147520 tx=0x7ff058001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:58.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.926+0000 7ff053fff700 1 --2- 172.21.15.103:0/977502622 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff04004d710 0x7ff04004fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:10:58.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.926+0000 7ff053fff700 1 -- 172.21.15.103:0/977502622 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff058061610 con 0x7ff064148570 2020-04-22T14:10:58.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.926+0000 7ff062ffd700 1 --2- 172.21.15.103:0/977502622 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff04004d710 0x7ff04004fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:10:58.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.926+0000 7ff062ffd700 1 --2- 172.21.15.103:0/977502622 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff04004d710 0x7ff04004fbd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff054001e80 tx=0x7ff06405bb20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:58.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.926+0000 7ff062ffd700 1 --2- 172.21.15.103:0/977502622 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff04004d710 0x7ff04004fbd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff054001e80 tx=0x7ff06405bb20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:58.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.926+0000 7ff062ffd700 1 --2- 172.21.15.103:0/977502622 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff04004d710 0x7ff04004fbd0 secure :-1 s=READY pgs=327 cs=0 l=1 rx=0x7ff054001e80 tx=0x7ff06405bb20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:10:58.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.930+0000 7ff0627fc700 1 --2- 172.21.15.103:0/977502622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff064148570 0x7ff064147610 secure :-1 s=THROTTLE_DONE pgs=870 cs=0 l=1 rx=0x7ff064147520 tx=0x7ff058001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:58.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:58.930+0000 7ff053fff700 1 -- 172.21.15.103:0/977502622 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ff05803cab0 con 0x7ff064148570 2020-04-22T14:10:59.133 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:59.131+0000 7f7976939700 1 -- 172.21.15.103:0/3382999336 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7f797005a640 con 0x7f7970142150 2020-04-22T14:10:59.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:59.135+0000 7ff063fff700 1 -- 172.21.15.103:0/977502622 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7ff0440021d0 con 0x7ff064148570 2020-04-22T14:10:59.480 INFO:tasks.ceph.mon.b.smithi086.stderr:2020-04-22T14:10:59.478+0000 7fbdbf880700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-04-22T14:10:59.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:59.481+0000 7f796f7fe700 1 --2- 172.21.15.103:0/3382999336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7970142150 0x7f7970062c20 secure :-1 s=THROTTLE_DONE pgs=500 cs=0 l=1 rx=0x7f7968001320 tx=0x7f7964010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:59.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:59.481+0000 7f796d7fa700 1 -- 172.21.15.103:0/3382999336 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 6289 v37) v1 ==== 95+0+0 (secure 0 0 0) 0x7f796403fb90 con 0x7f7970142150 2020-04-22T14:10:59.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:59.482+0000 7ff0627fc700 1 --2- 172.21.15.103:0/977502622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff064148570 0x7ff064147610 secure :-1 s=THROTTLE_DONE pgs=870 cs=0 l=1 rx=0x7ff064147520 tx=0x7ff058001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:10:59.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:59.482+0000 7ff053fff700 1 -- 172.21.15.103:0/977502622 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 5096 v37) v1 ==== 95+0+0 (secure 0 0 0) 0x7ff0580400d0 con 0x7ff064148570 2020-04-22T14:10:59.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:59.483+0000 7f7976939700 1 -- 172.21.15.103:0/3382999336 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f795004def0 msgr2=0x7f79500503b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:59.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:59.483+0000 7f7976939700 1 --2- 172.21.15.103:0/3382999336 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f795004def0 0x7f79500503b0 secure :-1 s=READY pgs=326 cs=0 l=1 rx=0x7f79600113f0 tx=0x7f7960003030).stop 2020-04-22T14:10:59.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:59.483+0000 7f7976939700 1 -- 172.21.15.103:0/3382999336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7970142150 msgr2=0x7f7970062c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:59.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:59.483+0000 7f7976939700 1 --2- 172.21.15.103:0/3382999336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7970142150 0x7f7970062c20 secure :-1 s=READY pgs=500 cs=0 l=1 rx=0x7f7968001320 tx=0x7f7964010b10).stop 2020-04-22T14:10:59.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:59.483+0000 7f7976939700 1 -- 172.21.15.103:0/3382999336 shutdown_connections 2020-04-22T14:10:59.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:59.484+0000 7f7976939700 1 --2- 172.21.15.103:0/3382999336 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f795004def0 0x7f79500503b0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:59.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:59.484+0000 7f7976939700 1 --2- 172.21.15.103:0/3382999336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7970142150 0x7f7970062c20 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:59.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:59.484+0000 7f7976939700 1 -- 172.21.15.103:0/3382999336 >> 172.21.15.103:0/3382999336 conn(0x7f79700b86b0 msgr2=0x7f79700b19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:59.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:59.484+0000 7f7976939700 1 -- 172.21.15.103:0/3382999336 shutdown_connections 2020-04-22T14:10:59.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:59.484+0000 7f7976939700 1 -- 172.21.15.103:0/3382999336 wait complete. 2020-04-22T14:10:59.489 INFO:teuthology.orchestra.run.smithi103.stderr:failed mds gid 6289 2020-04-22T14:10:59.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:59.483+0000 7ff063fff700 1 -- 172.21.15.103:0/977502622 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff04004d710 msgr2=0x7ff04004fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:59.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:59.483+0000 7ff063fff700 1 --2- 172.21.15.103:0/977502622 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff04004d710 0x7ff04004fbd0 secure :-1 s=READY pgs=327 cs=0 l=1 rx=0x7ff054001e80 tx=0x7ff06405bb20).stop 2020-04-22T14:10:59.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:59.483+0000 7ff063fff700 1 -- 172.21.15.103:0/977502622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff064148570 msgr2=0x7ff064147610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:10:59.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:59.483+0000 7ff063fff700 1 --2- 172.21.15.103:0/977502622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff064148570 0x7ff064147610 secure :-1 s=READY pgs=870 cs=0 l=1 rx=0x7ff064147520 tx=0x7ff058001e40).stop 2020-04-22T14:10:59.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:59.483+0000 7ff063fff700 1 -- 172.21.15.103:0/977502622 shutdown_connections 2020-04-22T14:10:59.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:59.483+0000 7ff063fff700 1 --2- 172.21.15.103:0/977502622 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff04004d710 0x7ff04004fbd0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:59.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:59.483+0000 7ff063fff700 1 --2- 172.21.15.103:0/977502622 >> v2:172.21.15.86:3300/0 conn(0x7ff06413c4d0 0x7ff06413c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:59.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:59.483+0000 7ff063fff700 1 --2- 172.21.15.103:0/977502622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff064148570 0x7ff064147610 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:10:59.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:59.483+0000 7ff063fff700 1 -- 172.21.15.103:0/977502622 >> 172.21.15.103:0/977502622 conn(0x7ff0640b95b0 msgr2=0x7ff06413f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:10:59.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:59.484+0000 7ff063fff700 1 -- 172.21.15.103:0/977502622 shutdown_connections 2020-04-22T14:10:59.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:10:59.484+0000 7ff063fff700 1 -- 172.21.15.103:0/977502622 wait complete. 2020-04-22T14:10:59.492 INFO:teuthology.orchestra.run.smithi103.stderr:failed mds gid 5096 2020-04-22T14:10:59.498 DEBUG:teuthology.parallel:result is '' 2020-04-22T14:10:59.499 DEBUG:teuthology.parallel:result is '' 2020-04-22T14:10:59.499 INFO:tasks.cephfs.mount:Killing connection on ubuntu@smithi103.front.sepia.ceph.com... 2020-04-22T14:10:59.499 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:10:59.500 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:59.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:59.554 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip link set brx.0 down' 2020-04-22T14:10:59.638 INFO:tasks.cephfs.mount:Cleaning up killed connection on ubuntu@smithi103.front.sepia.ceph.com 2020-04-22T14:10:59.638 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2020-04-22T14:10:59.638 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:59.685 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-04-22T14:10:59.685 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:10:59.762 INFO:teuthology.orchestra.run:waiting for 900 2020-04-22T14:10:59.762 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:10:59.762 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:10:59.763 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:59.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:59.827 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:10:59.902 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:10:59.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:10:59.959 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down brx.0' 2020-04-22T14:11:00.117 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.0' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/22) 2020-04-22T14:11:00.117 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:00.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:11:00.131 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete brx.0' 2020-04-22T14:11:00.239 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.0' (c3b14acb-5ee5-4601-a6c3-3fdb893b60f6) successfully deleted. 2020-04-22T14:11:00.240 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:00.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:11:00.269 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:11:00.377 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:00.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:11:00.402 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:11:00.460 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:11:00.460 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:11:00.461 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:11:00.461 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:11:00.461 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:11:00.461 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:11:00.461 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:11:00.461 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:11:00.461 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:11:00.462 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:11:00.462 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:11:00.462 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:11:00.462 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:11:00.462 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:11:00.462 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:11:00.462 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42180sec preferred_lft 42180sec 2020-04-22T14:11:00.463 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:11:00.463 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:11:00.463 INFO:teuthology.orchestra.run.smithi103.stdout:18: brx.1@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:11:00.463 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 86:6a:e2:0f:ca:92 brd ff:ff:ff:ff:ff:ff link-netnsid 1 2020-04-22T14:11:00.463 INFO:teuthology.orchestra.run.smithi103.stdout:19: ceph-brx: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:11:00.463 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:11:00.463 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:11:00.463 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:11:00.464 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::9a:8537:4603:d6d8/64 scope link noprefixroute 2020-04-22T14:11:00.464 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:11:00.464 INFO:teuthology.orchestra.run.smithi103.stdout:20: brx.0@if2: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:11:00.464 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether d6:00:10:e7:64:03 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:11:00.464 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:00.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:11:00.510 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:11:00.586 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:00.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:11:00.636 INFO:teuthology.orchestra.run.smithi103:> nmcli connection show 2020-04-22T14:11:00.713 INFO:teuthology.orchestra.run.smithi103.stdout:NAME UUID TYPE DEVICE 2020-04-22T14:11:00.714 INFO:teuthology.orchestra.run.smithi103.stdout:System enp3s0f1 b0a308d1-bd90-60af-eb7c-0183bb425a1a ethernet enp3s0f1 2020-04-22T14:11:00.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-brx 606a42d6-cea1-405a-8661-003fefae55b7 bridge ceph-brx 2020-04-22T14:11:00.714 INFO:teuthology.orchestra.run.smithi103.stdout:eno1 206ad60d-195e-4d4b-a9fe-a5dd1f33a67d ethernet -- 2020-04-22T14:11:00.714 INFO:teuthology.orchestra.run.smithi103.stdout:eno2 894a7dd2-d329-4985-9ef9-84a92c6e1c6c ethernet -- 2020-04-22T14:11:00.714 INFO:teuthology.orchestra.run.smithi103.stdout:enp3s0f0 5a3237ce-06ab-4ae0-818b-45bdf036cb08 ethernet -- 2020-04-22T14:11:00.714 INFO:tasks.cephfs.mount:Removing the 'ceph-brx' 2020-04-22T14:11:00.715 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:00.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:11:00.759 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down ceph-brx' 2020-04-22T14:11:00.917 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/21) 2020-04-22T14:11:00.918 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:00.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:11:00.933 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete ceph-brx' 2020-04-22T14:11:01.040 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' (606a42d6-cea1-405a-8661-003fefae55b7) successfully deleted. 2020-04-22T14:11:01.041 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:01.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:11:01.080 INFO:teuthology.orchestra.run.smithi103:> route 2020-04-22T14:11:01.143 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2020-04-22T14:11:01.143 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-04-22T14:11:01.143 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 102 0 0 enp3s0f1 2020-04-22T14:11:01.143 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 102 0 0 enp3s0f1 2020-04-22T14:11:01.144 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:01.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:11:01.188 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -D FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-04-22T14:11:01.297 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:01.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:11:01.321 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -D FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-04-22T14:11:01.400 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:01.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:11:01.453 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -t nat -D POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-04-22T14:11:01.562 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:01.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:11:01.585 INFO:teuthology.orchestra.run.smithi103:> cat /tmp/python-ceph-brx 2020-04-22T14:11:01.649 INFO:teuthology.orchestra.run.smithi103.stdout:0 2020-04-22T14:11:01.649 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:01.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:11:01.693 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 0 > /proc/sys/net/ipv4/ip_forward' 2020-04-22T14:11:01.768 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:01.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:11:01.816 INFO:teuthology.orchestra.run.smithi103:> rm -f /tmp/python-ceph-brx 2020-04-22T14:11:01.895 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:01.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:11:01.944 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:11:02.003 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:02.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:11:02.053 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:11:02.106 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-04-22T14:11:02.115 INFO:teuthology.orchestra.run.smithi103.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2020-04-22T14:11:02.115 INFO:tasks.ceph.mds.a:Restarting daemon 2020-04-22T14:11:02.116 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:02.116 INFO:tasks.ceph.mds.b:Restarting daemon 2020-04-22T14:11:02.116 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:11:02.135 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-04-22T14:11:02.160 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-04-22T14:11:02.177 INFO:tasks.ceph.mds.b:Started 2020-04-22T14:11:02.178 DEBUG:teuthology.parallel:result is None 2020-04-22T14:11:02.202 INFO:tasks.ceph.mds.a:Started 2020-04-22T14:11:02.202 DEBUG:teuthology.parallel:result is None 2020-04-22T14:11:02.202 INFO:tasks.cephfs.test_client_recovery:Waiting for reconnect... 2020-04-22T14:11:02.202 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:02.216 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:11:02.262 INFO:tasks.ceph.mds.b.smithi086.stdout:starting mds.b at 2020-04-22T14:11:02.276 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2020-04-22T14:11:02.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.361+0000 7fc32eda6700 1 Processor -- start 2020-04-22T14:11:02.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.361+0000 7fc32eda6700 1 -- start start 2020-04-22T14:11:02.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.362+0000 7fc32eda6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3280b63d0 0x7fc3280b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:02.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.362+0000 7fc32eda6700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc32814a3a0 0x7fc3280664d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:02.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.362+0000 7fc32eda6700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3280608e0 con 0x7fc32813ff10 2020-04-22T14:11:02.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.362+0000 7fc32eda6700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc328060b80 con 0x7fc32814a3a0 2020-04-22T14:11:02.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.362+0000 7fc32eda6700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc328060e20 con 0x7fc3280b63d0 2020-04-22T14:11:02.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.363+0000 7fc327fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc32814a3a0 0x7fc3280664d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:02.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.363+0000 7fc32cb42700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3280b63d0 0x7fc3280b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:02.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.363+0000 7fc327fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc32814a3a0 0x7fc3280664d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:48868/0 (socket says 172.21.15.103:48868) 2020-04-22T14:11:02.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.363+0000 7fc32d343700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fc32813ff10 0x7fc328146370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:60984/0 (socket says 172.21.15.103:60984) 2020-04-22T14:11:02.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.363+0000 7fc327fff700 1 -- 172.21.15.103:0/74451138 learned_addr learned my addr 172.21.15.103:0/74451138 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:02.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.363+0000 7fc32cb42700 1 -- 172.21.15.103:0/74451138 >> v2:172.21.15.86:3300/0 conn(0x7fc32814a3a0 msgr2=0x7fc3280664d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:02.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.363+0000 7fc32cb42700 1 --2- 172.21.15.103:0/74451138 >> v2:172.21.15.86:3300/0 conn(0x7fc32814a3a0 0x7fc3280664d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:02.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.363+0000 7fc32cb42700 1 -- 172.21.15.103:0/74451138 >> v1:172.21.15.86:6789/0 conn(0x7fc32813ff10 legacy=0x7fc328146370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:02.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.363+0000 7fc32cb42700 1 -- 172.21.15.103:0/74451138 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3280b67b0 con 0x7fc3280b63d0 2020-04-22T14:11:02.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.363+0000 7fc327fff700 1 --2- 172.21.15.103:0/74451138 >> v2:172.21.15.86:3300/0 conn(0x7fc32814a3a0 0x7fc3280664d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:11:02.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.363+0000 7fc32cb42700 1 --2- 172.21.15.103:0/74451138 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3280b63d0 0x7fc3280b41b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc318002f30 tx=0x7fc318007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:02.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.363+0000 7fc32cb42700 1 --2- 172.21.15.103:0/74451138 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3280b63d0 0x7fc3280b41b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc318002f30 tx=0x7fc318007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:02.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.363+0000 7fc32cb42700 1 --2- 172.21.15.103:0/74451138 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3280b63d0 0x7fc3280b41b0 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7fc318002f30 tx=0x7fc318007a40).ready entity=mon.2 client_cookie=c33f5381580c7f0d server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:02.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.363+0000 7fc32cb42700 1 --2- 172.21.15.103:0/74451138 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3280b63d0 0x7fc3280b41b0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7fc318002f30 tx=0x7fc318007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:02.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.363+0000 7fc3277fe700 1 -- 172.21.15.103:0/74451138 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3180113c0 con 0x7fc3280b63d0 2020-04-22T14:11:02.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.363+0000 7fc32cb42700 1 --2- 172.21.15.103:0/74451138 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3280b63d0 0x7fc3280b41b0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7fc318002f30 tx=0x7fc318007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:02.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.363+0000 7fc32cb42700 1 --2- 172.21.15.103:0/74451138 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3280b63d0 0x7fc3280b41b0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7fc318002f30 tx=0x7fc318007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:02.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.363+0000 7fc3277fe700 1 -- 172.21.15.103:0/74451138 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc318011560 con 0x7fc3280b63d0 2020-04-22T14:11:02.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.363+0000 7fc3277fe700 1 -- 172.21.15.103:0/74451138 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc318011980 con 0x7fc3280b63d0 2020-04-22T14:11:02.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.363+0000 7fc32eda6700 1 -- 172.21.15.103:0/74451138 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3280b63d0 msgr2=0x7fc3280b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:02.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.363+0000 7fc32eda6700 1 --2- 172.21.15.103:0/74451138 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3280b63d0 0x7fc3280b41b0 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7fc318002f30 tx=0x7fc318007a40).stop 2020-04-22T14:11:02.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.364+0000 7fc32eda6700 1 -- 172.21.15.103:0/74451138 shutdown_connections 2020-04-22T14:11:02.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.364+0000 7fc32eda6700 1 --2- 172.21.15.103:0/74451138 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3280b63d0 0x7fc3280b41b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:02.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.364+0000 7fc32eda6700 1 --2- 172.21.15.103:0/74451138 >> v2:172.21.15.86:3300/0 conn(0x7fc32814a3a0 0x7fc3280664d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:02.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.364+0000 7fc32eda6700 1 -- 172.21.15.103:0/74451138 >> 172.21.15.103:0/74451138 conn(0x7fc32805f2c0 msgr2=0x7fc328066e20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:02.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.364+0000 7fc32eda6700 1 -- 172.21.15.103:0/74451138 shutdown_connections 2020-04-22T14:11:02.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.364+0000 7fc32eda6700 1 -- 172.21.15.103:0/74451138 wait complete. 2020-04-22T14:11:02.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.365+0000 7fc32eda6700 1 Processor -- start 2020-04-22T14:11:02.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.365+0000 7fc32eda6700 1 -- start start 2020-04-22T14:11:02.378 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.365+0000 7fc32eda6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3280b63d0 0x7fc328131650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:02.378 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.365+0000 7fc32eda6700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc32813ff10 0x7fc328146900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:02.378 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.365+0000 7fc32eda6700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc328131cd0 con 0x7fc32814a3a0 2020-04-22T14:11:02.379 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.365+0000 7fc32eda6700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc328131ab0 con 0x7fc32813ff10 2020-04-22T14:11:02.379 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.365+0000 7fc32eda6700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc328143260 con 0x7fc3280b63d0 2020-04-22T14:11:02.379 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.366+0000 7fc32cb42700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3280b63d0 0x7fc328131650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:02.379 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.366+0000 7fc32cb42700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3280b63d0 0x7fc328131650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:36418/0 (socket says 172.21.15.103:36418) 2020-04-22T14:11:02.379 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.366+0000 7fc32cb42700 1 -- 172.21.15.103:0/967690475 learned_addr learned my addr 172.21.15.103:0/967690475 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:02.379 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.366+0000 7fc327fff700 1 --2- 172.21.15.103:0/967690475 >> v2:172.21.15.86:3300/0 conn(0x7fc32813ff10 0x7fc328146900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:02.379 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.366+0000 7fc32cb42700 1 -- 172.21.15.103:0/967690475 >> v2:172.21.15.86:3300/0 conn(0x7fc32813ff10 msgr2=0x7fc328146900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:02.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.366+0000 7fc32cb42700 1 --2- 172.21.15.103:0/967690475 >> v2:172.21.15.86:3300/0 conn(0x7fc32813ff10 0x7fc328146900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:02.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.366+0000 7fc32cb42700 1 -- 172.21.15.103:0/967690475 >> v1:172.21.15.86:6789/0 conn(0x7fc32814a3a0 legacy=0x7fc3280b9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:02.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.366+0000 7fc32cb42700 1 -- 172.21.15.103:0/967690475 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc328131f70 con 0x7fc3280b63d0 2020-04-22T14:11:02.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.366+0000 7fc32cb42700 1 --2- 172.21.15.103:0/967690475 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3280b63d0 0x7fc328131650 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc318002f30 tx=0x7fc318007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:02.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.366+0000 7fc32cb42700 1 --2- 172.21.15.103:0/967690475 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3280b63d0 0x7fc328131650 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc318002f30 tx=0x7fc318007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:02.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.366+0000 7fc32cb42700 1 --2- 172.21.15.103:0/967690475 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3280b63d0 0x7fc328131650 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7fc318002f30 tx=0x7fc318007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:02.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.366+0000 7fc32cb42700 1 --2- 172.21.15.103:0/967690475 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3280b63d0 0x7fc328131650 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7fc318002f30 tx=0x7fc318007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:02.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.366+0000 7fc325ffb700 1 -- 172.21.15.103:0/967690475 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc31800f860 con 0x7fc3280b63d0 2020-04-22T14:11:02.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.366+0000 7fc32cb42700 1 --2- 172.21.15.103:0/967690475 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3280b63d0 0x7fc328131650 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7fc318002f30 tx=0x7fc318007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:02.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.366+0000 7fc32cb42700 1 --2- 172.21.15.103:0/967690475 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3280b63d0 0x7fc328131650 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7fc318002f30 tx=0x7fc318007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:02.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.366+0000 7fc325ffb700 1 -- 172.21.15.103:0/967690475 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc318007360 con 0x7fc3280b63d0 2020-04-22T14:11:02.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.366+0000 7fc32eda6700 1 -- 172.21.15.103:0/967690475 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc328132210 con 0x7fc3280b63d0 2020-04-22T14:11:02.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.366+0000 7fc325ffb700 1 -- 172.21.15.103:0/967690475 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3180056c0 con 0x7fc3280b63d0 2020-04-22T14:11:02.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.366+0000 7fc32eda6700 1 -- 172.21.15.103:0/967690475 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3280b9c30 con 0x7fc3280b63d0 2020-04-22T14:11:02.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.367+0000 7fc32cb42700 1 --2- 172.21.15.103:0/967690475 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3280b63d0 0x7fc328131650 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7fc318002f30 tx=0x7fc318007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:02.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.367+0000 7fc325ffb700 1 -- 172.21.15.103:0/967690475 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fc318005930 con 0x7fc3280b63d0 2020-04-22T14:11:02.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.367+0000 7fc32cb42700 1 --2- 172.21.15.103:0/967690475 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3280b63d0 0x7fc328131650 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7fc318002f30 tx=0x7fc318007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:02.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.367+0000 7fc32eda6700 1 -- 172.21.15.103:0/967690475 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc328056c90 con 0x7fc3280b63d0 2020-04-22T14:11:02.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.367+0000 7fc325ffb700 1 --2- 172.21.15.103:0/967690475 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc30804d9d0 0x7fc30804fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:02.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.368+0000 7fc325ffb700 1 -- 172.21.15.103:0/967690475 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fc318061cd0 con 0x7fc3280b63d0 2020-04-22T14:11:02.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.368+0000 7fc327fff700 1 --2- 172.21.15.103:0/967690475 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc30804d9d0 0x7fc30804fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:02.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.368+0000 7fc327fff700 1 --2- 172.21.15.103:0/967690475 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc30804d9d0 0x7fc30804fe90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc31c002f30 tx=0x7fc31c00f590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:02.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.368+0000 7fc327fff700 1 --2- 172.21.15.103:0/967690475 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc30804d9d0 0x7fc30804fe90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc31c002f30 tx=0x7fc31c00f590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:02.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.368+0000 7fc327fff700 1 --2- 172.21.15.103:0/967690475 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc30804d9d0 0x7fc30804fe90 secure :-1 s=READY pgs=328 cs=0 l=1 rx=0x7fc31c002f30 tx=0x7fc31c00f590).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:02.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.371+0000 7fc32cb42700 1 --2- 172.21.15.103:0/967690475 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3280b63d0 0x7fc328131650 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7fc318002f30 tx=0x7fc318007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:02.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.371+0000 7fc325ffb700 1 -- 172.21.15.103:0/967690475 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fc31803d170 con 0x7fc3280b63d0 2020-04-22T14:11:02.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.568+0000 7fc32eda6700 1 -- 172.21.15.103:0/967690475 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc328063740 con 0x7fc3280b63d0 2020-04-22T14:11:02.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.569+0000 7fc32cb42700 1 --2- 172.21.15.103:0/967690475 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3280b63d0 0x7fc328131650 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7fc318002f30 tx=0x7fc318007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:02.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.569+0000 7fc325ffb700 1 -- 172.21.15.103:0/967690475 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+1792 (secure 0 0 0) 0x7fc318040790 con 0x7fc3280b63d0 2020-04-22T14:11:02.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.570+0000 7fc32eda6700 1 -- 172.21.15.103:0/967690475 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc30804d9d0 msgr2=0x7fc30804fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:02.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.570+0000 7fc32eda6700 1 --2- 172.21.15.103:0/967690475 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc30804d9d0 0x7fc30804fe90 secure :-1 s=READY pgs=328 cs=0 l=1 rx=0x7fc31c002f30 tx=0x7fc31c00f590).stop 2020-04-22T14:11:02.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.570+0000 7fc32eda6700 1 -- 172.21.15.103:0/967690475 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3280b63d0 msgr2=0x7fc328131650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:02.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.570+0000 7fc32eda6700 1 --2- 172.21.15.103:0/967690475 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3280b63d0 0x7fc328131650 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7fc318002f30 tx=0x7fc318007a40).stop 2020-04-22T14:11:02.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.570+0000 7fc32eda6700 1 -- 172.21.15.103:0/967690475 shutdown_connections 2020-04-22T14:11:02.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.570+0000 7fc32eda6700 1 --2- 172.21.15.103:0/967690475 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3280b63d0 0x7fc328131650 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:02.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.570+0000 7fc32eda6700 1 --2- 172.21.15.103:0/967690475 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc30804d9d0 0x7fc30804fe90 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:02.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.570+0000 7fc32eda6700 1 --2- 172.21.15.103:0/967690475 >> v2:172.21.15.86:3300/0 conn(0x7fc32813ff10 0x7fc328146900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:02.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.570+0000 7fc32eda6700 1 -- 172.21.15.103:0/967690475 >> 172.21.15.103:0/967690475 conn(0x7fc32805f2c0 msgr2=0x7fc328062650 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:02.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.570+0000 7fc32eda6700 1 -- 172.21.15.103:0/967690475 shutdown_connections 2020-04-22T14:11:02.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:02.570+0000 7fc32eda6700 1 -- 172.21.15.103:0/967690475 wait complete. 2020-04-22T14:11:02.575 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 39 2020-04-22T14:11:02.575 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:02.576 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:02.498177+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:replay","state_seq":1,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:11:02.583 INFO:tasks.cephfs.filesystem:mapped states [u'up:replay'] to None 2020-04-22T14:11:03.583 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:03.601 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:11:03.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.755+0000 7f52de890700 1 Processor -- start 2020-04-22T14:11:03.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.756+0000 7f52de890700 1 -- start start 2020-04-22T14:11:03.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.756+0000 7f52de890700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f52d81464e0 0x7f52d8064540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:03.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.756+0000 7f52de890700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d8143300 con 0x7f52d812c0d0 2020-04-22T14:11:03.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.756+0000 7f52de890700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d81435a0 con 0x7f52d8065fe0 2020-04-22T14:11:03.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.756+0000 7f52de890700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d8143840 con 0x7f52d81464e0 2020-04-22T14:11:03.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.756+0000 7f52d77fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f52d8065fe0 0x7f52d8063e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43852/0 (socket says 172.21.15.103:43852) 2020-04-22T14:11:03.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.756+0000 7f52d77fe700 1 -- 172.21.15.103:0/2567906743 learned_addr learned my addr 172.21.15.103:0/2567906743 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:03.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.757+0000 7f52dce2d700 1 --2- 172.21.15.103:0/2567906743 >> v2:172.21.15.86:3300/0 conn(0x7f52d81464e0 0x7f52d8064540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:03.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.757+0000 7f52d6ffd700 1 -- 172.21.15.103:0/2567906743 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 331416886 0 0) 0x7f52d81435a0 con 0x7f52d8065fe0 2020-04-22T14:11:03.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.757+0000 7f52d6ffd700 1 -- 172.21.15.103:0/2567906743 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52c4003230 con 0x7f52d8065fe0 2020-04-22T14:11:03.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.757+0000 7f52d6ffd700 1 -- 172.21.15.103:0/2567906743 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2873164234 0 0) 0x7f52c4003230 con 0x7f52d8065fe0 2020-04-22T14:11:03.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.757+0000 7f52d6ffd700 1 -- 172.21.15.103:0/2567906743 >> v2:172.21.15.86:3300/0 conn(0x7f52d81464e0 msgr2=0x7f52d8064540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:03.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.757+0000 7f52d6ffd700 1 --2- 172.21.15.103:0/2567906743 >> v2:172.21.15.86:3300/0 conn(0x7f52d81464e0 0x7f52d8064540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:03.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.757+0000 7f52d6ffd700 1 -- 172.21.15.103:0/2567906743 >> v1:172.21.15.86:6789/0 conn(0x7f52d812c0d0 legacy=0x7f52d805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:03.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.757+0000 7f52d6ffd700 1 -- 172.21.15.103:0/2567906743 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d805bb50 con 0x7f52d8065fe0 2020-04-22T14:11:03.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.757+0000 7f52d6ffd700 1 -- 172.21.15.103:0/2567906743 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f52cc0016d0 con 0x7f52d8065fe0 2020-04-22T14:11:03.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.757+0000 7f52d6ffd700 1 -- 172.21.15.103:0/2567906743 >> v1:172.21.15.103:6789/0 conn(0x7f52d8065fe0 legacy=0x7f52d8063e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:03.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.757+0000 7f52d6ffd700 1 --2- 172.21.15.103:0/2567906743 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f52c4003720 0x7f52c4003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:03.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.757+0000 7f52d6ffd700 1 --2- 172.21.15.103:0/2567906743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52c4004020 0x7f52c40044f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:03.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.757+0000 7f52d6ffd700 1 --2- 172.21.15.103:0/2567906743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52c4004a90 0x7f52c4004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:03.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.757+0000 7f52d6ffd700 1 -- 172.21.15.103:0/2567906743 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d8143840 con 0x7f52c4004020 2020-04-22T14:11:03.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.757+0000 7f52d6ffd700 1 -- 172.21.15.103:0/2567906743 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c400b860 con 0x7f52c4004a90 2020-04-22T14:11:03.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.757+0000 7f52d6ffd700 1 -- 172.21.15.103:0/2567906743 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c400ba20 con 0x7f52c4003720 2020-04-22T14:11:03.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.757+0000 7f52dce2d700 1 --2- 172.21.15.103:0/2567906743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52c4004a90 0x7f52c4004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:03.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.757+0000 7f52d7fff700 1 --2- 172.21.15.103:0/2567906743 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f52c4003720 0x7f52c4003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:03.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.757+0000 7f52d77fe700 1 --2- 172.21.15.103:0/2567906743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52c4004020 0x7f52c40044f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:03.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.757+0000 7f52dce2d700 1 -- 172.21.15.103:0/2567906743 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f52c4003720 msgr2=0x7f52c4003b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:03.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.758+0000 7f52dce2d700 1 --2- 172.21.15.103:0/2567906743 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f52c4003720 0x7f52c4003b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:03.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.758+0000 7f52dce2d700 1 -- 172.21.15.103:0/2567906743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52c4004020 msgr2=0x7f52c40044f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:03.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.758+0000 7f52dce2d700 1 --2- 172.21.15.103:0/2567906743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52c4004020 0x7f52c40044f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:03.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.758+0000 7f52dce2d700 1 -- 172.21.15.103:0/2567906743 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c4003230 con 0x7f52c4004a90 2020-04-22T14:11:03.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.758+0000 7f52dce2d700 1 --2- 172.21.15.103:0/2567906743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52c4004a90 0x7f52c4004f40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f52d00032b0 tx=0x7f52d00103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:03.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.758+0000 7f52dce2d700 1 -- 172.21.15.103:0/2567906743 reap_dead start 2020-04-22T14:11:03.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.758+0000 7f52dce2d700 1 --2- 172.21.15.103:0/2567906743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52c4004a90 0x7f52c4004f40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f52d00032b0 tx=0x7f52d00103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:03.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.758+0000 7f52dce2d700 1 --2- 172.21.15.103:0/2567906743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52c4004a90 0x7f52c4004f40 secure :-1 s=READY pgs=875 cs=0 l=1 rx=0x7f52d00032b0 tx=0x7f52d00103a0).ready entity=mon.1 client_cookie=d89721e5720bab7f server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:03.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.758+0000 7f52dce2d700 1 --2- 172.21.15.103:0/2567906743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52c4004a90 0x7f52c4004f40 secure :-1 s=THROTTLE_DONE pgs=875 cs=0 l=1 rx=0x7f52d00032b0 tx=0x7f52d00103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:03.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.758+0000 7f52d6ffd700 1 -- 172.21.15.103:0/2567906743 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52d0005a40 con 0x7f52c4004a90 2020-04-22T14:11:03.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.758+0000 7f52dce2d700 1 --2- 172.21.15.103:0/2567906743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52c4004a90 0x7f52c4004f40 secure :-1 s=THROTTLE_DONE pgs=875 cs=0 l=1 rx=0x7f52d00032b0 tx=0x7f52d00103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:03.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.758+0000 7f52d6ffd700 1 -- 172.21.15.103:0/2567906743 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d0005ba0 con 0x7f52c4004a90 2020-04-22T14:11:03.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.758+0000 7f52dce2d700 1 --2- 172.21.15.103:0/2567906743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52c4004a90 0x7f52c4004f40 secure :-1 s=THROTTLE_DONE pgs=875 cs=0 l=1 rx=0x7f52d00032b0 tx=0x7f52d00103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:03.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.758+0000 7f52d6ffd700 1 -- 172.21.15.103:0/2567906743 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52d00110d0 con 0x7f52c4004a90 2020-04-22T14:11:03.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.758+0000 7f52de890700 1 -- 172.21.15.103:0/2567906743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52c4004a90 msgr2=0x7f52c4004f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:03.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.758+0000 7f52de890700 1 --2- 172.21.15.103:0/2567906743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52c4004a90 0x7f52c4004f40 secure :-1 s=READY pgs=875 cs=0 l=1 rx=0x7f52d00032b0 tx=0x7f52d00103a0).stop 2020-04-22T14:11:03.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.758+0000 7f52de890700 1 -- 172.21.15.103:0/2567906743 shutdown_connections 2020-04-22T14:11:03.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.758+0000 7f52de890700 1 --2- 172.21.15.103:0/2567906743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52c4004a90 0x7f52c4004f40 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:03.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.758+0000 7f52de890700 1 -- 172.21.15.103:0/2567906743 >> 172.21.15.103:0/2567906743 conn(0x7f52d80b9160 msgr2=0x7f52d805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:03.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.758+0000 7f52de890700 1 -- 172.21.15.103:0/2567906743 shutdown_connections 2020-04-22T14:11:03.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.758+0000 7f52de890700 1 -- 172.21.15.103:0/2567906743 wait complete. 2020-04-22T14:11:03.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.759+0000 7f52de890700 1 Processor -- start 2020-04-22T14:11:03.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.759+0000 7f52de890700 1 -- start start 2020-04-22T14:11:03.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.760+0000 7f52de890700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f52c4004a90 0x7f52d80af5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:03.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.760+0000 7f52de890700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f52d8063f40 0x7f52d80ac740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:03.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.760+0000 7f52de890700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d80643c0 con 0x7f52d80ae130 2020-04-22T14:11:03.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.760+0000 7f52de890700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d80b0f20 con 0x7f52d8063f40 2020-04-22T14:11:03.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.760+0000 7f52de890700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d811d620 con 0x7f52c4004a90 2020-04-22T14:11:03.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.760+0000 7f52d7fff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f52c4004a90 0x7f52d80af5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:03.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.760+0000 7f52d77fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f52d8063f40 0x7f52d80ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:03.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.761+0000 7f52d77fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f52d8063f40 0x7f52d80ac740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:48908/0 (socket says 172.21.15.103:48908) 2020-04-22T14:11:03.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.761+0000 7f52d7fff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f52c4004a90 0x7f52d80af5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:36450/0 (socket says 172.21.15.103:36450) 2020-04-22T14:11:03.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.761+0000 7f52d77fe700 1 -- 172.21.15.103:0/1384047678 learned_addr learned my addr 172.21.15.103:0/1384047678 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:03.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.761+0000 7f52d77fe700 1 -- 172.21.15.103:0/1384047678 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f52c4004a90 msgr2=0x7f52d80af5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:03.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.761+0000 7f52d77fe700 1 --2- 172.21.15.103:0/1384047678 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f52c4004a90 0x7f52d80af5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:03.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.761+0000 7f52d77fe700 1 -- 172.21.15.103:0/1384047678 >> v1:172.21.15.86:6789/0 conn(0x7f52d80ae130 legacy=0x7f52d80b15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:03.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.761+0000 7f52d57fa700 1 -- 172.21.15.103:0/1384047678 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3578305261 0 0) 0x7f52d80643c0 con 0x7f52d80ae130 2020-04-22T14:11:03.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.761+0000 7f52d77fe700 1 -- 172.21.15.103:0/1384047678 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d80b1110 con 0x7f52d8063f40 2020-04-22T14:11:03.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.761+0000 7f52d77fe700 1 --2- 172.21.15.103:0/1384047678 >> v2:172.21.15.86:3300/0 conn(0x7f52d8063f40 0x7f52d80ac740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f52cc0013e0 tx=0x7f52d805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:03.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.761+0000 7f52d77fe700 1 --2- 172.21.15.103:0/1384047678 >> v2:172.21.15.86:3300/0 conn(0x7f52d8063f40 0x7f52d80ac740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f52cc0013e0 tx=0x7f52d805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:03.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.761+0000 7f52d77fe700 1 --2- 172.21.15.103:0/1384047678 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52d8063f40 0x7f52d80ac740 secure :-1 s=READY pgs=509 cs=0 l=1 rx=0x7f52cc0013e0 tx=0x7f52d805bce0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:03.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.761+0000 7f52d77fe700 1 --2- 172.21.15.103:0/1384047678 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52d8063f40 0x7f52d80ac740 secure :-1 s=THROTTLE_DONE pgs=509 cs=0 l=1 rx=0x7f52cc0013e0 tx=0x7f52d805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:03.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.761+0000 7f52d57fa700 1 -- 172.21.15.103:0/1384047678 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52cc00ce70 con 0x7f52d8063f40 2020-04-22T14:11:03.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.761+0000 7f52d77fe700 1 --2- 172.21.15.103:0/1384047678 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52d8063f40 0x7f52d80ac740 secure :-1 s=THROTTLE_DONE pgs=509 cs=0 l=1 rx=0x7f52cc0013e0 tx=0x7f52d805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:03.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.761+0000 7f52d77fe700 1 --2- 172.21.15.103:0/1384047678 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52d8063f40 0x7f52d80ac740 secure :-1 s=THROTTLE_DONE pgs=509 cs=0 l=1 rx=0x7f52cc0013e0 tx=0x7f52d805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:03.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.761+0000 7f52d57fa700 1 -- 172.21.15.103:0/1384047678 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52cc00e370 con 0x7f52d8063f40 2020-04-22T14:11:03.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.761+0000 7f52de890700 1 -- 172.21.15.103:0/1384047678 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d811d270 con 0x7f52d8063f40 2020-04-22T14:11:03.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.761+0000 7f52d57fa700 1 -- 172.21.15.103:0/1384047678 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52cc00e6d0 con 0x7f52d8063f40 2020-04-22T14:11:03.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.761+0000 7f52de890700 1 -- 172.21.15.103:0/1384047678 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d8064d10 con 0x7f52d8063f40 2020-04-22T14:11:03.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.762+0000 7f52d77fe700 1 --2- 172.21.15.103:0/1384047678 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52d8063f40 0x7f52d80ac740 secure :-1 s=THROTTLE_DONE pgs=509 cs=0 l=1 rx=0x7f52cc0013e0 tx=0x7f52d805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:03.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.762+0000 7f52de890700 1 -- 172.21.15.103:0/1384047678 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d811d790 con 0x7f52d8063f40 2020-04-22T14:11:03.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.763+0000 7f52d57fa700 1 -- 172.21.15.103:0/1384047678 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f52cc007280 con 0x7f52d8063f40 2020-04-22T14:11:03.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.763+0000 7f52d77fe700 1 --2- 172.21.15.103:0/1384047678 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52d8063f40 0x7f52d80ac740 secure :-1 s=THROTTLE_DONE pgs=509 cs=0 l=1 rx=0x7f52cc0013e0 tx=0x7f52d805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:03.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.763+0000 7f52d57fa700 1 --2- 172.21.15.103:0/1384047678 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f52b804d750 0x7f52b804fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:03.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.763+0000 7f52d57fa700 1 -- 172.21.15.103:0/1384047678 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f52cc061100 con 0x7f52d8063f40 2020-04-22T14:11:03.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.763+0000 7f52d7fff700 1 --2- 172.21.15.103:0/1384047678 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f52b804d750 0x7f52b804fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:03.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.763+0000 7f52d7fff700 1 --2- 172.21.15.103:0/1384047678 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f52b804d750 0x7f52b804fc10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f52c8000fe0 tx=0x7f52c800c8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:03.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.763+0000 7f52d7fff700 1 --2- 172.21.15.103:0/1384047678 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f52b804d750 0x7f52b804fc10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f52c8000fe0 tx=0x7f52c800c8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:03.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.763+0000 7f52d7fff700 1 --2- 172.21.15.103:0/1384047678 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f52b804d750 0x7f52b804fc10 secure :-1 s=READY pgs=330 cs=0 l=1 rx=0x7f52c8000fe0 tx=0x7f52c800c8d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:03.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.767+0000 7f52d77fe700 1 --2- 172.21.15.103:0/1384047678 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52d8063f40 0x7f52d80ac740 secure :-1 s=THROTTLE_DONE pgs=509 cs=0 l=1 rx=0x7f52cc0013e0 tx=0x7f52d805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:03.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.767+0000 7f52d57fa700 1 -- 172.21.15.103:0/1384047678 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f52cc03c4e0 con 0x7f52d8063f40 2020-04-22T14:11:03.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.956+0000 7f52de890700 1 -- 172.21.15.103:0/1384047678 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52d8056c90 con 0x7f52d8063f40 2020-04-22T14:11:03.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.957+0000 7f52d77fe700 1 --2- 172.21.15.103:0/1384047678 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52d8063f40 0x7f52d80ac740 secure :-1 s=THROTTLE_DONE pgs=509 cs=0 l=1 rx=0x7f52cc0013e0 tx=0x7f52d805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:03.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.957+0000 7f52d57fa700 1 -- 172.21.15.103:0/1384047678 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+1795 (secure 0 0 0) 0x7f52cc03fb00 con 0x7f52d8063f40 2020-04-22T14:11:03.960 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:03.960 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:03.499587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:11:03.961 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.958+0000 7f52de890700 1 -- 172.21.15.103:0/1384047678 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f52b804d750 msgr2=0x7f52b804fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:03.961 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.958+0000 7f52de890700 1 --2- 172.21.15.103:0/1384047678 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f52b804d750 0x7f52b804fc10 secure :-1 s=READY pgs=330 cs=0 l=1 rx=0x7f52c8000fe0 tx=0x7f52c800c8d0).stop 2020-04-22T14:11:03.961 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.958+0000 7f52de890700 1 -- 172.21.15.103:0/1384047678 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52d8063f40 msgr2=0x7f52d80ac740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:03.961 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.958+0000 7f52de890700 1 --2- 172.21.15.103:0/1384047678 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52d8063f40 0x7f52d80ac740 secure :-1 s=READY pgs=509 cs=0 l=1 rx=0x7f52cc0013e0 tx=0x7f52d805bce0).stop 2020-04-22T14:11:03.961 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.958+0000 7f52de890700 1 -- 172.21.15.103:0/1384047678 shutdown_connections 2020-04-22T14:11:03.961 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.958+0000 7f52de890700 1 --2- 172.21.15.103:0/1384047678 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f52c4004a90 0x7f52d80af5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:03.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.958+0000 7f52de890700 1 --2- 172.21.15.103:0/1384047678 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f52b804d750 0x7f52b804fc10 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:03.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.958+0000 7f52de890700 1 --2- 172.21.15.103:0/1384047678 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52d8063f40 0x7f52d80ac740 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:03.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.959+0000 7f52de890700 1 -- 172.21.15.103:0/1384047678 >> 172.21.15.103:0/1384047678 conn(0x7f52d80b9160 msgr2=0x7f52d80b5900 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:03.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.959+0000 7f52de890700 1 -- 172.21.15.103:0/1384047678 shutdown_connections 2020-04-22T14:11:03.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:03.959+0000 7f52de890700 1 -- 172.21.15.103:0/1384047678 wait complete. 2020-04-22T14:11:03.962 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 40 2020-04-22T14:11:03.971 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to up:reconnect 2020-04-22T14:11:03.971 INFO:tasks.cephfs.filesystem:reached state 'up:reconnect' in 1.76851606369s 2020-04-22T14:11:03.971 INFO:tasks.cephfs.test_client_recovery:Waiting for active... 2020-04-22T14:11:03.971 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:03.986 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:11:04.133 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.131+0000 7fc89b09d700 1 Processor -- start 2020-04-22T14:11:04.133 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.131+0000 7fc89b09d700 1 -- start start 2020-04-22T14:11:04.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.132+0000 7fc89b09d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc89405b7c0 0x7fc8940b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:04.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.132+0000 7fc89b09d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8940b5900 con 0x7fc8940ad850 2020-04-22T14:11:04.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.132+0000 7fc89b09d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8940b5ba0 con 0x7fc8941441f0 2020-04-22T14:11:04.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.132+0000 7fc89b09d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8940b5e40 con 0x7fc89405b7c0 2020-04-22T14:11:04.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.132+0000 7fc893fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc8941441f0 0x7fc894144820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43872/0 (socket says 172.21.15.103:43872) 2020-04-22T14:11:04.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.132+0000 7fc893fff700 1 -- 172.21.15.103:0/1195433596 learned_addr learned my addr 172.21.15.103:0/1195433596 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:04.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.132+0000 7fc898e39700 1 --2- 172.21.15.103:0/1195433596 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc89405b7c0 0x7fc8940b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:04.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.132+0000 7fc8937fe700 1 -- 172.21.15.103:0/1195433596 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1564124621 0 0) 0x7fc8940b5ba0 con 0x7fc8941441f0 2020-04-22T14:11:04.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.132+0000 7fc8937fe700 1 -- 172.21.15.103:0/1195433596 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc880003230 con 0x7fc8941441f0 2020-04-22T14:11:04.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.132+0000 7fc8937fe700 1 -- 172.21.15.103:0/1195433596 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 477291914 0 0) 0x7fc8940b5900 con 0x7fc8940ad850 2020-04-22T14:11:04.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.132+0000 7fc898e39700 1 -- 172.21.15.103:0/1195433596 >> v1:172.21.15.103:6789/0 conn(0x7fc8941441f0 legacy=0x7fc894144820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:04.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.132+0000 7fc898e39700 1 -- 172.21.15.103:0/1195433596 >> v1:172.21.15.86:6789/0 conn(0x7fc8940ad850 legacy=0x7fc8940adc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:04.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.132+0000 7fc898e39700 1 -- 172.21.15.103:0/1195433596 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc89405bba0 con 0x7fc89405b7c0 2020-04-22T14:11:04.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.132+0000 7fc898e39700 1 --2- 172.21.15.103:0/1195433596 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc89405b7c0 0x7fc8940b50d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc8880017f0 tx=0x7fc88c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:04.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.132+0000 7fc898e39700 1 --2- 172.21.15.103:0/1195433596 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc89405b7c0 0x7fc8940b50d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc8880017f0 tx=0x7fc88c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:04.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.132+0000 7fc898e39700 1 --2- 172.21.15.103:0/1195433596 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc89405b7c0 0x7fc8940b50d0 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7fc8880017f0 tx=0x7fc88c008c60).ready entity=mon.2 client_cookie=cd81b097c4ddf594 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:04.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.133+0000 7fc898e39700 1 --2- 172.21.15.103:0/1195433596 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc89405b7c0 0x7fc8940b50d0 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7fc8880017f0 tx=0x7fc88c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:04.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.133+0000 7fc8937fe700 1 -- 172.21.15.103:0/1195433596 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc888001650 con 0x7fc89405b7c0 2020-04-22T14:11:04.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.133+0000 7fc898e39700 1 --2- 172.21.15.103:0/1195433596 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc89405b7c0 0x7fc8940b50d0 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7fc8880017f0 tx=0x7fc88c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:04.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.133+0000 7fc898e39700 1 --2- 172.21.15.103:0/1195433596 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc89405b7c0 0x7fc8940b50d0 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7fc8880017f0 tx=0x7fc88c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:04.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.133+0000 7fc8937fe700 1 -- 172.21.15.103:0/1195433596 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88c0109c0 con 0x7fc89405b7c0 2020-04-22T14:11:04.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.133+0000 7fc8937fe700 1 -- 172.21.15.103:0/1195433596 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc88c010d20 con 0x7fc89405b7c0 2020-04-22T14:11:04.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.133+0000 7fc89b09d700 1 -- 172.21.15.103:0/1195433596 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc89405b7c0 msgr2=0x7fc8940b50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:04.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.133+0000 7fc89b09d700 1 --2- 172.21.15.103:0/1195433596 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc89405b7c0 0x7fc8940b50d0 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7fc8880017f0 tx=0x7fc88c008c60).stop 2020-04-22T14:11:04.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.133+0000 7fc89b09d700 1 -- 172.21.15.103:0/1195433596 shutdown_connections 2020-04-22T14:11:04.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.133+0000 7fc89b09d700 1 --2- 172.21.15.103:0/1195433596 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc89405b7c0 0x7fc8940b50d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:04.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.133+0000 7fc89b09d700 1 -- 172.21.15.103:0/1195433596 >> 172.21.15.103:0/1195433596 conn(0x7fc8940b9160 msgr2=0x7fc89405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:04.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.133+0000 7fc89b09d700 1 -- 172.21.15.103:0/1195433596 shutdown_connections 2020-04-22T14:11:04.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.133+0000 7fc89b09d700 1 -- 172.21.15.103:0/1195433596 wait complete. 2020-04-22T14:11:04.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.134+0000 7fc89b09d700 1 Processor -- start 2020-04-22T14:11:04.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.134+0000 7fc89b09d700 1 -- start start 2020-04-22T14:11:04.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.135+0000 7fc89b09d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc89405b7c0 0x7fc894140bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:04.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.135+0000 7fc89b09d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc8940ad850 0x7fc89413e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:04.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.135+0000 7fc89b09d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc894147b20 con 0x7fc8941441f0 2020-04-22T14:11:04.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.135+0000 7fc89b09d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc894147dc0 con 0x7fc89405b7c0 2020-04-22T14:11:04.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.135+0000 7fc89b09d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc894148060 con 0x7fc8940ad850 2020-04-22T14:11:04.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.135+0000 7fc89963a700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc8941441f0 0x7fc89413d340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43878/0 (socket says 172.21.15.103:43878) 2020-04-22T14:11:04.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.135+0000 7fc89963a700 1 -- 172.21.15.103:0/1386153442 learned_addr learned my addr 172.21.15.103:0/1386153442 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:04.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.135+0000 7fc893fff700 1 --2- 172.21.15.103:0/1386153442 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc8940ad850 0x7fc89413e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:04.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.135+0000 7fc898e39700 1 --2- 172.21.15.103:0/1386153442 >> v2:172.21.15.86:3300/0 conn(0x7fc89405b7c0 0x7fc894140bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:04.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.135+0000 7fc891ffb700 1 -- 172.21.15.103:0/1386153442 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 452921570 0 0) 0x7fc894147b20 con 0x7fc8941441f0 2020-04-22T14:11:04.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.135+0000 7fc891ffb700 1 -- 172.21.15.103:0/1386153442 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc874002fe0 con 0x7fc8941441f0 2020-04-22T14:11:04.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.136+0000 7fc898e39700 1 -- 172.21.15.103:0/1386153442 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc8940ad850 msgr2=0x7fc89413e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:04.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.136+0000 7fc898e39700 1 --2- 172.21.15.103:0/1386153442 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc8940ad850 0x7fc89413e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:04.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.136+0000 7fc898e39700 1 -- 172.21.15.103:0/1386153442 >> v1:172.21.15.103:6789/0 conn(0x7fc8941441f0 legacy=0x7fc89413d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:04.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.136+0000 7fc898e39700 1 -- 172.21.15.103:0/1386153442 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8940aea90 con 0x7fc89405b7c0 2020-04-22T14:11:04.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.136+0000 7fc893fff700 1 --2- 172.21.15.103:0/1386153442 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc8940ad850 0x7fc89413e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:11:04.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.136+0000 7fc898e39700 1 --2- 172.21.15.103:0/1386153442 >> v2:172.21.15.86:3300/0 conn(0x7fc89405b7c0 0x7fc894140bb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc884001b00 tx=0x7fc89405bd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:04.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.136+0000 7fc898e39700 1 --2- 172.21.15.103:0/1386153442 >> v2:172.21.15.86:3300/0 conn(0x7fc89405b7c0 0x7fc894140bb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc884001b00 tx=0x7fc89405bd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:04.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.136+0000 7fc898e39700 1 --2- 172.21.15.103:0/1386153442 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc89405b7c0 0x7fc894140bb0 secure :-1 s=READY pgs=511 cs=0 l=1 rx=0x7fc884001b00 tx=0x7fc89405bd30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:04.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.136+0000 7fc898e39700 1 --2- 172.21.15.103:0/1386153442 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc89405b7c0 0x7fc894140bb0 secure :-1 s=THROTTLE_DONE pgs=511 cs=0 l=1 rx=0x7fc884001b00 tx=0x7fc89405bd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:04.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.136+0000 7fc891ffb700 1 -- 172.21.15.103:0/1386153442 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc884001960 con 0x7fc89405b7c0 2020-04-22T14:11:04.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.136+0000 7fc898e39700 1 --2- 172.21.15.103:0/1386153442 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc89405b7c0 0x7fc894140bb0 secure :-1 s=THROTTLE_DONE pgs=511 cs=0 l=1 rx=0x7fc884001b00 tx=0x7fc89405bd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:04.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.136+0000 7fc891ffb700 1 -- 172.21.15.103:0/1386153442 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88c007ec0 con 0x7fc89405b7c0 2020-04-22T14:11:04.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.136+0000 7fc898e39700 1 --2- 172.21.15.103:0/1386153442 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc89405b7c0 0x7fc894140bb0 secure :-1 s=THROTTLE_DONE pgs=511 cs=0 l=1 rx=0x7fc884001b00 tx=0x7fc89405bd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:04.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.136+0000 7fc89b09d700 1 -- 172.21.15.103:0/1386153442 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc894148440 con 0x7fc89405b7c0 2020-04-22T14:11:04.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.136+0000 7fc891ffb700 1 -- 172.21.15.103:0/1386153442 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc88c005a40 con 0x7fc89405b7c0 2020-04-22T14:11:04.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.136+0000 7fc89b09d700 1 -- 172.21.15.103:0/1386153442 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc894140770 con 0x7fc89405b7c0 2020-04-22T14:11:04.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.137+0000 7fc898e39700 1 --2- 172.21.15.103:0/1386153442 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc89405b7c0 0x7fc894140bb0 secure :-1 s=THROTTLE_DONE pgs=511 cs=0 l=1 rx=0x7fc884001b00 tx=0x7fc89405bd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:04.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.137+0000 7fc89b09d700 1 -- 172.21.15.103:0/1386153442 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8941445d0 con 0x7fc89405b7c0 2020-04-22T14:11:04.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.137+0000 7fc891ffb700 1 -- 172.21.15.103:0/1386153442 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fc88c005c40 con 0x7fc89405b7c0 2020-04-22T14:11:04.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.137+0000 7fc898e39700 1 --2- 172.21.15.103:0/1386153442 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc89405b7c0 0x7fc894140bb0 secure :-1 s=THROTTLE_DONE pgs=511 cs=0 l=1 rx=0x7fc884001b00 tx=0x7fc89405bd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:04.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.137+0000 7fc891ffb700 1 --2- 172.21.15.103:0/1386153442 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc87404dd30 0x7fc8740501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:04.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.137+0000 7fc891ffb700 1 -- 172.21.15.103:0/1386153442 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fc88c061120 con 0x7fc89405b7c0 2020-04-22T14:11:04.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.137+0000 7fc893fff700 1 --2- 172.21.15.103:0/1386153442 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc87404dd30 0x7fc8740501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:04.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.138+0000 7fc893fff700 1 --2- 172.21.15.103:0/1386153442 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc87404dd30 0x7fc8740501f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc888001830 tx=0x7fc88800ce80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:04.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.138+0000 7fc893fff700 1 --2- 172.21.15.103:0/1386153442 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc87404dd30 0x7fc8740501f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc888001830 tx=0x7fc88800ce80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:04.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.138+0000 7fc893fff700 1 --2- 172.21.15.103:0/1386153442 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc87404dd30 0x7fc8740501f0 secure :-1 s=READY pgs=331 cs=0 l=1 rx=0x7fc888001830 tx=0x7fc88800ce80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:04.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.141+0000 7fc898e39700 1 --2- 172.21.15.103:0/1386153442 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc89405b7c0 0x7fc894140bb0 secure :-1 s=THROTTLE_DONE pgs=511 cs=0 l=1 rx=0x7fc884001b00 tx=0x7fc89405bd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:04.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.141+0000 7fc891ffb700 1 -- 172.21.15.103:0/1386153442 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fc88c03c5c0 con 0x7fc89405b7c0 2020-04-22T14:11:04.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.332+0000 7fc89b09d700 1 -- 172.21.15.103:0/1386153442 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8941481d0 con 0x7fc89405b7c0 2020-04-22T14:11:04.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.333+0000 7fc898e39700 1 --2- 172.21.15.103:0/1386153442 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc89405b7c0 0x7fc894140bb0 secure :-1 s=THROTTLE_DONE pgs=511 cs=0 l=1 rx=0x7fc884001b00 tx=0x7fc89405bd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:04.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.333+0000 7fc891ffb700 1 -- 172.21.15.103:0/1386153442 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+1795 (secure 0 0 0) 0x7fc88c0150e0 con 0x7fc89405b7c0 2020-04-22T14:11:04.335 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:04.335 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:03.499587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:11:04.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.334+0000 7fc89b09d700 1 -- 172.21.15.103:0/1386153442 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc87404dd30 msgr2=0x7fc8740501f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:04.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.334+0000 7fc89b09d700 1 --2- 172.21.15.103:0/1386153442 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc87404dd30 0x7fc8740501f0 secure :-1 s=READY pgs=331 cs=0 l=1 rx=0x7fc888001830 tx=0x7fc88800ce80).stop 2020-04-22T14:11:04.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.334+0000 7fc89b09d700 1 -- 172.21.15.103:0/1386153442 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc89405b7c0 msgr2=0x7fc894140bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:04.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.334+0000 7fc89b09d700 1 --2- 172.21.15.103:0/1386153442 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc89405b7c0 0x7fc894140bb0 secure :-1 s=READY pgs=511 cs=0 l=1 rx=0x7fc884001b00 tx=0x7fc89405bd30).stop 2020-04-22T14:11:04.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.334+0000 7fc89b09d700 1 -- 172.21.15.103:0/1386153442 shutdown_connections 2020-04-22T14:11:04.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.334+0000 7fc89b09d700 1 --2- 172.21.15.103:0/1386153442 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc87404dd30 0x7fc8740501f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:04.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.334+0000 7fc89b09d700 1 --2- 172.21.15.103:0/1386153442 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc89405b7c0 0x7fc894140bb0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:04.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.334+0000 7fc89b09d700 1 --2- 172.21.15.103:0/1386153442 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc8940ad850 0x7fc89413e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:04.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.334+0000 7fc89b09d700 1 -- 172.21.15.103:0/1386153442 >> 172.21.15.103:0/1386153442 conn(0x7fc8940b9160 msgr2=0x7fc8940b7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:04.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.334+0000 7fc89b09d700 1 -- 172.21.15.103:0/1386153442 shutdown_connections 2020-04-22T14:11:04.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:04.334+0000 7fc89b09d700 1 -- 172.21.15.103:0/1386153442 wait complete. 2020-04-22T14:11:04.338 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 40 2020-04-22T14:11:04.347 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:11:05.348 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:05.365 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:11:05.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.520+0000 7f8ff0799700 1 Processor -- start 2020-04-22T14:11:05.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.520+0000 7f8ff0799700 1 -- start start 2020-04-22T14:11:05.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.521+0000 7f8ff0799700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8fe81464e0 0x7f8fe8064540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:05.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.521+0000 7f8ff0799700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fe8143300 con 0x7f8fe8065fe0 2020-04-22T14:11:05.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.521+0000 7f8ff0799700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fe81435a0 con 0x7f8fe812c0d0 2020-04-22T14:11:05.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.521+0000 7f8ff0799700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fe8143840 con 0x7f8fe81464e0 2020-04-22T14:11:05.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.521+0000 7f8feed36700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8fe81464e0 0x7f8fe8064540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:05.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.522+0000 7f8fee535700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f8fe812c0d0 0x7f8fe805b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43884/0 (socket says 172.21.15.103:43884) 2020-04-22T14:11:05.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.522+0000 7f8fee535700 1 -- 172.21.15.103:0/912224704 learned_addr learned my addr 172.21.15.103:0/912224704 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:05.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.522+0000 7f8fed533700 1 -- 172.21.15.103:0/912224704 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3663542667 0 0) 0x7f8fe81435a0 con 0x7f8fe812c0d0 2020-04-22T14:11:05.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.522+0000 7f8fed533700 1 -- 172.21.15.103:0/912224704 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fd0003230 con 0x7f8fe812c0d0 2020-04-22T14:11:05.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.522+0000 7f8feed36700 1 -- 172.21.15.103:0/912224704 >> v1:172.21.15.103:6789/0 conn(0x7f8fe812c0d0 legacy=0x7f8fe805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:05.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.522+0000 7f8feed36700 1 -- 172.21.15.103:0/912224704 >> v1:172.21.15.86:6789/0 conn(0x7f8fe8065fe0 legacy=0x7f8fe8063e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:05.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.522+0000 7f8feed36700 1 -- 172.21.15.103:0/912224704 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe805bb50 con 0x7f8fe81464e0 2020-04-22T14:11:05.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.522+0000 7f8feed36700 1 --2- 172.21.15.103:0/912224704 >> v2:172.21.15.103:3300/0 conn(0x7f8fe81464e0 0x7f8fe8064540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8fe8067620 tx=0x7f8fe0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:05.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.522+0000 7f8feed36700 1 --2- 172.21.15.103:0/912224704 >> v2:172.21.15.103:3300/0 conn(0x7f8fe81464e0 0x7f8fe8064540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8fe8067620 tx=0x7f8fe0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:05.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.522+0000 7f8feed36700 1 --2- 172.21.15.103:0/912224704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fe81464e0 0x7f8fe8064540 secure :-1 s=READY pgs=879 cs=0 l=1 rx=0x7f8fe8067620 tx=0x7f8fe0008c60).ready entity=mon.1 client_cookie=3724f2d0d8efdf47 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:05.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.522+0000 7f8feed36700 1 --2- 172.21.15.103:0/912224704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fe81464e0 0x7f8fe8064540 secure :-1 s=THROTTLE_DONE pgs=879 cs=0 l=1 rx=0x7f8fe8067620 tx=0x7f8fe0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:05.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.522+0000 7f8fed533700 1 -- 172.21.15.103:0/912224704 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fe0011de0 con 0x7f8fe81464e0 2020-04-22T14:11:05.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.522+0000 7f8feed36700 1 --2- 172.21.15.103:0/912224704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fe81464e0 0x7f8fe8064540 secure :-1 s=THROTTLE_DONE pgs=879 cs=0 l=1 rx=0x7f8fe8067620 tx=0x7f8fe0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:05.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.522+0000 7f8feed36700 1 --2- 172.21.15.103:0/912224704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fe81464e0 0x7f8fe8064540 secure :-1 s=THROTTLE_DONE pgs=879 cs=0 l=1 rx=0x7f8fe8067620 tx=0x7f8fe0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:05.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.522+0000 7f8fed533700 1 -- 172.21.15.103:0/912224704 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe000a180 con 0x7f8fe81464e0 2020-04-22T14:11:05.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.522+0000 7f8fed533700 1 -- 172.21.15.103:0/912224704 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fe000a5a0 con 0x7f8fe81464e0 2020-04-22T14:11:05.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.522+0000 7f8ff0799700 1 -- 172.21.15.103:0/912224704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fe81464e0 msgr2=0x7f8fe8064540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:05.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.522+0000 7f8ff0799700 1 --2- 172.21.15.103:0/912224704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fe81464e0 0x7f8fe8064540 secure :-1 s=READY pgs=879 cs=0 l=1 rx=0x7f8fe8067620 tx=0x7f8fe0008c60).stop 2020-04-22T14:11:05.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.523+0000 7f8ff0799700 1 -- 172.21.15.103:0/912224704 shutdown_connections 2020-04-22T14:11:05.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.523+0000 7f8ff0799700 1 --2- 172.21.15.103:0/912224704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fe81464e0 0x7f8fe8064540 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:05.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.523+0000 7f8ff0799700 1 -- 172.21.15.103:0/912224704 >> 172.21.15.103:0/912224704 conn(0x7f8fe80b9160 msgr2=0x7f8fe805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:05.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.523+0000 7f8ff0799700 1 -- 172.21.15.103:0/912224704 shutdown_connections 2020-04-22T14:11:05.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.523+0000 7f8ff0799700 1 -- 172.21.15.103:0/912224704 wait complete. 2020-04-22T14:11:05.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.524+0000 7f8ff0799700 1 Processor -- start 2020-04-22T14:11:05.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.524+0000 7f8ff0799700 1 -- start start 2020-04-22T14:11:05.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.524+0000 7f8ff0799700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8fe8065fe0 0x7f8fe80acb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:05.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.524+0000 7f8ff0799700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8fe81464e0 0x7f8fe8142480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:05.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.524+0000 7f8ff0799700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fe8155170 con 0x7f8fe812c0d0 2020-04-22T14:11:05.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.524+0000 7f8ff0799700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fe8155410 con 0x7f8fe8065fe0 2020-04-22T14:11:05.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.524+0000 7f8ff0799700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe81556b0 con 0x7f8fe81464e0 2020-04-22T14:11:05.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.525+0000 7f8fee535700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8fe8065fe0 0x7f8fe80acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:05.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.525+0000 7f8fee535700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8fe8065fe0 0x7f8fe80acb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51698/0 (socket says 172.21.15.103:51698) 2020-04-22T14:11:05.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.525+0000 7f8fee535700 1 -- 172.21.15.103:0/823945072 learned_addr learned my addr 172.21.15.103:0/823945072 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:05.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.525+0000 7f8fee535700 1 -- 172.21.15.103:0/823945072 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8fe81464e0 msgr2=0x7f8fe8142480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:05.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.525+0000 7f8feed36700 1 --2- 172.21.15.103:0/823945072 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8fe81464e0 0x7f8fe8142480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:05.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.525+0000 7f8fee535700 1 --2- 172.21.15.103:0/823945072 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8fe81464e0 0x7f8fe8142480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:05.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.525+0000 7f8fee535700 1 -- 172.21.15.103:0/823945072 >> v1:172.21.15.86:6789/0 conn(0x7f8fe812c0d0 legacy=0x7f8fe8144cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:05.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.525+0000 7f8fee535700 1 -- 172.21.15.103:0/823945072 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe81453d0 con 0x7f8fe8065fe0 2020-04-22T14:11:05.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.525+0000 7f8fee535700 1 --2- 172.21.15.103:0/823945072 >> v2:172.21.15.103:3300/0 conn(0x7f8fe8065fe0 0x7f8fe80acb10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8fe8126b00 tx=0x7f8fe4010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:05.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.525+0000 7f8fee535700 1 --2- 172.21.15.103:0/823945072 >> v2:172.21.15.103:3300/0 conn(0x7f8fe8065fe0 0x7f8fe80acb10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8fe8126b00 tx=0x7f8fe4010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:05.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.525+0000 7f8fee535700 1 --2- 172.21.15.103:0/823945072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fe8065fe0 0x7f8fe80acb10 secure :-1 s=READY pgs=880 cs=0 l=1 rx=0x7f8fe8126b00 tx=0x7f8fe4010a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:05.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.525+0000 7f8fee535700 1 --2- 172.21.15.103:0/823945072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fe8065fe0 0x7f8fe80acb10 secure :-1 s=THROTTLE_DONE pgs=880 cs=0 l=1 rx=0x7f8fe8126b00 tx=0x7f8fe4010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:05.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.525+0000 7f8fee535700 1 --2- 172.21.15.103:0/823945072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fe8065fe0 0x7f8fe80acb10 secure :-1 s=THROTTLE_DONE pgs=880 cs=0 l=1 rx=0x7f8fe8126b00 tx=0x7f8fe4010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:05.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.525+0000 7f8fdb7fe700 1 -- 172.21.15.103:0/823945072 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fe4005cc0 con 0x7f8fe8065fe0 2020-04-22T14:11:05.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.525+0000 7f8fee535700 1 --2- 172.21.15.103:0/823945072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fe8065fe0 0x7f8fe80acb10 secure :-1 s=THROTTLE_DONE pgs=880 cs=0 l=1 rx=0x7f8fe8126b00 tx=0x7f8fe4010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:05.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.525+0000 7f8fdb7fe700 1 -- 172.21.15.103:0/823945072 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe4005e20 con 0x7f8fe8065fe0 2020-04-22T14:11:05.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.525+0000 7f8ff0799700 1 -- 172.21.15.103:0/823945072 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fe812a200 con 0x7f8fe8065fe0 2020-04-22T14:11:05.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.525+0000 7f8fdb7fe700 1 -- 172.21.15.103:0/823945072 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fe40062c0 con 0x7f8fe8065fe0 2020-04-22T14:11:05.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.525+0000 7f8ff0799700 1 -- 172.21.15.103:0/823945072 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fe80ae070 con 0x7f8fe8065fe0 2020-04-22T14:11:05.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.526+0000 7f8fee535700 1 --2- 172.21.15.103:0/823945072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fe8065fe0 0x7f8fe80acb10 secure :-1 s=THROTTLE_DONE pgs=880 cs=0 l=1 rx=0x7f8fe8126b00 tx=0x7f8fe4010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:05.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.526+0000 7f8fdb7fe700 1 -- 172.21.15.103:0/823945072 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f8fe40064f0 con 0x7f8fe8065fe0 2020-04-22T14:11:05.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.526+0000 7f8fee535700 1 --2- 172.21.15.103:0/823945072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fe8065fe0 0x7f8fe80acb10 secure :-1 s=THROTTLE_DONE pgs=880 cs=0 l=1 rx=0x7f8fe8126b00 tx=0x7f8fe4010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:05.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.526+0000 7f8ff0799700 1 -- 172.21.15.103:0/823945072 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fe8155850 con 0x7f8fe8065fe0 2020-04-22T14:11:05.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.527+0000 7f8fdb7fe700 1 --2- 172.21.15.103:0/823945072 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8fc804d9a0 0x7f8fc804fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:05.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.527+0000 7f8fdb7fe700 1 -- 172.21.15.103:0/823945072 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f8fe40090c0 con 0x7f8fe8065fe0 2020-04-22T14:11:05.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.527+0000 7f8fedd34700 1 --2- 172.21.15.103:0/823945072 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8fc804d9a0 0x7f8fc804fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:05.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.527+0000 7f8fedd34700 1 --2- 172.21.15.103:0/823945072 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8fc804d9a0 0x7f8fc804fe60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8fdc001fe0 tx=0x7f8fdc002500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:05.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.527+0000 7f8fedd34700 1 --2- 172.21.15.103:0/823945072 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8fc804d9a0 0x7f8fc804fe60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8fdc001fe0 tx=0x7f8fdc002500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:05.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.527+0000 7f8fedd34700 1 --2- 172.21.15.103:0/823945072 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8fc804d9a0 0x7f8fc804fe60 secure :-1 s=READY pgs=332 cs=0 l=1 rx=0x7f8fdc001fe0 tx=0x7f8fdc002500).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:05.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.531+0000 7f8fee535700 1 --2- 172.21.15.103:0/823945072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fe8065fe0 0x7f8fe80acb10 secure :-1 s=THROTTLE_DONE pgs=880 cs=0 l=1 rx=0x7f8fe8126b00 tx=0x7f8fe4010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:05.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.531+0000 7f8fdb7fe700 1 -- 172.21.15.103:0/823945072 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f8fe403ca10 con 0x7f8fe8065fe0 2020-04-22T14:11:05.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.722+0000 7f8ff0799700 1 -- 172.21.15.103:0/823945072 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8fe8056c90 con 0x7f8fe8065fe0 2020-04-22T14:11:05.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.722+0000 7f8fee535700 1 --2- 172.21.15.103:0/823945072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fe8065fe0 0x7f8fe80acb10 secure :-1 s=THROTTLE_DONE pgs=880 cs=0 l=1 rx=0x7f8fe8126b00 tx=0x7f8fe4010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:05.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.722+0000 7f8fdb7fe700 1 -- 172.21.15.103:0/823945072 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+1795 (secure 0 0 0) 0x7f8fe4040030 con 0x7f8fe8065fe0 2020-04-22T14:11:05.726 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:05.726 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:03.499587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:11:05.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.723+0000 7f8ff0799700 1 -- 172.21.15.103:0/823945072 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8fc804d9a0 msgr2=0x7f8fc804fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:05.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.723+0000 7f8ff0799700 1 --2- 172.21.15.103:0/823945072 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8fc804d9a0 0x7f8fc804fe60 secure :-1 s=READY pgs=332 cs=0 l=1 rx=0x7f8fdc001fe0 tx=0x7f8fdc002500).stop 2020-04-22T14:11:05.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.723+0000 7f8ff0799700 1 -- 172.21.15.103:0/823945072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fe8065fe0 msgr2=0x7f8fe80acb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:05.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.723+0000 7f8ff0799700 1 --2- 172.21.15.103:0/823945072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fe8065fe0 0x7f8fe80acb10 secure :-1 s=READY pgs=880 cs=0 l=1 rx=0x7f8fe8126b00 tx=0x7f8fe4010a40).stop 2020-04-22T14:11:05.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.724+0000 7f8ff0799700 1 -- 172.21.15.103:0/823945072 shutdown_connections 2020-04-22T14:11:05.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.724+0000 7f8ff0799700 1 --2- 172.21.15.103:0/823945072 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8fc804d9a0 0x7f8fc804fe60 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:05.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.724+0000 7f8ff0799700 1 --2- 172.21.15.103:0/823945072 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8fe81464e0 0x7f8fe8142480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:05.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.724+0000 7f8ff0799700 1 --2- 172.21.15.103:0/823945072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fe8065fe0 0x7f8fe80acb10 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:05.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.724+0000 7f8ff0799700 1 -- 172.21.15.103:0/823945072 >> 172.21.15.103:0/823945072 conn(0x7f8fe80b9160 msgr2=0x7f8fe80b6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:05.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.724+0000 7f8ff0799700 1 -- 172.21.15.103:0/823945072 shutdown_connections 2020-04-22T14:11:05.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:05.724+0000 7f8ff0799700 1 -- 172.21.15.103:0/823945072 wait complete. 2020-04-22T14:11:05.728 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 40 2020-04-22T14:11:05.736 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:11:06.737 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:06.753 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:11:06.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.907+0000 7f2241bda700 1 Processor -- start 2020-04-22T14:11:06.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.907+0000 7f2241bda700 1 -- start start 2020-04-22T14:11:06.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.908+0000 7f2241bda700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f223c1441f0 0x7f223c144820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:06.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.908+0000 7f2241bda700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f223c144c80 0x7f223c0ad850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:06.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.908+0000 7f2241bda700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f223c0b5900 con 0x7f223c05b7c0 2020-04-22T14:11:06.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.908+0000 7f2241bda700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f223c0b5ba0 con 0x7f223c1441f0 2020-04-22T14:11:06.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.908+0000 7f2241bda700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f223c0b5e40 con 0x7f223c144c80 2020-04-22T14:11:06.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.908+0000 7f223affd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f223c1441f0 0x7f223c144820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:06.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.908+0000 7f223affd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f223c1441f0 0x7f223c144820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51710/0 (socket says 172.21.15.103:51710) 2020-04-22T14:11:06.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.908+0000 7f223affd700 1 -- 172.21.15.103:0/2749171782 learned_addr learned my addr 172.21.15.103:0/2749171782 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:06.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.908+0000 7f223bfff700 1 --2- 172.21.15.103:0/2749171782 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f223c144c80 0x7f223c0ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:06.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.908+0000 7f223affd700 1 -- 172.21.15.103:0/2749171782 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f223c144c80 msgr2=0x7f223c0ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:06.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.908+0000 7f223affd700 1 --2- 172.21.15.103:0/2749171782 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f223c144c80 0x7f223c0ad850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:06.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.908+0000 7f223affd700 1 -- 172.21.15.103:0/2749171782 >> v1:172.21.15.86:6789/0 conn(0x7f223c05b7c0 legacy=0x7f223c0b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:06.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.908+0000 7f223affd700 1 -- 172.21.15.103:0/2749171782 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223c05bba0 con 0x7f223c1441f0 2020-04-22T14:11:06.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.908+0000 7f223bfff700 1 --2- 172.21.15.103:0/2749171782 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f223c144c80 0x7f223c0ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:11:06.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.908+0000 7f223affd700 1 --2- 172.21.15.103:0/2749171782 >> v2:172.21.15.103:3300/0 conn(0x7f223c1441f0 0x7f223c144820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2230002f30 tx=0x7f2230007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:06.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.908+0000 7f223affd700 1 --2- 172.21.15.103:0/2749171782 >> v2:172.21.15.103:3300/0 conn(0x7f223c1441f0 0x7f223c144820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2230002f30 tx=0x7f2230007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:06.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.908+0000 7f223affd700 1 --2- 172.21.15.103:0/2749171782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f223c1441f0 0x7f223c144820 secure :-1 s=READY pgs=881 cs=0 l=1 rx=0x7f2230002f30 tx=0x7f2230007a40).ready entity=mon.1 client_cookie=fa3e28bea4d55709 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:06.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.908+0000 7f223affd700 1 --2- 172.21.15.103:0/2749171782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f223c1441f0 0x7f223c144820 secure :-1 s=THROTTLE_DONE pgs=881 cs=0 l=1 rx=0x7f2230002f30 tx=0x7f2230007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:06.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.908+0000 7f223a7fc700 1 -- 172.21.15.103:0/2749171782 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2230008e10 con 0x7f223c1441f0 2020-04-22T14:11:06.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.909+0000 7f223affd700 1 --2- 172.21.15.103:0/2749171782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f223c1441f0 0x7f223c144820 secure :-1 s=THROTTLE_DONE pgs=881 cs=0 l=1 rx=0x7f2230002f30 tx=0x7f2230007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:06.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.909+0000 7f223affd700 1 --2- 172.21.15.103:0/2749171782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f223c1441f0 0x7f223c144820 secure :-1 s=THROTTLE_DONE pgs=881 cs=0 l=1 rx=0x7f2230002f30 tx=0x7f2230007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:06.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.909+0000 7f223a7fc700 1 -- 172.21.15.103:0/2749171782 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22300107c0 con 0x7f223c1441f0 2020-04-22T14:11:06.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.909+0000 7f223a7fc700 1 -- 172.21.15.103:0/2749171782 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2230010be0 con 0x7f223c1441f0 2020-04-22T14:11:06.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.909+0000 7f2241bda700 1 -- 172.21.15.103:0/2749171782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f223c1441f0 msgr2=0x7f223c144820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:06.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.909+0000 7f2241bda700 1 --2- 172.21.15.103:0/2749171782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f223c1441f0 0x7f223c144820 secure :-1 s=READY pgs=881 cs=0 l=1 rx=0x7f2230002f30 tx=0x7f2230007a40).stop 2020-04-22T14:11:06.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.909+0000 7f2241bda700 1 -- 172.21.15.103:0/2749171782 shutdown_connections 2020-04-22T14:11:06.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.909+0000 7f2241bda700 1 --2- 172.21.15.103:0/2749171782 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f223c144c80 0x7f223c0ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:06.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.909+0000 7f2241bda700 1 --2- 172.21.15.103:0/2749171782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f223c1441f0 0x7f223c144820 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:06.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.909+0000 7f2241bda700 1 -- 172.21.15.103:0/2749171782 >> 172.21.15.103:0/2749171782 conn(0x7f223c0b9160 msgr2=0x7f223c05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:06.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.909+0000 7f2241bda700 1 -- 172.21.15.103:0/2749171782 shutdown_connections 2020-04-22T14:11:06.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.909+0000 7f2241bda700 1 -- 172.21.15.103:0/2749171782 wait complete. 2020-04-22T14:11:06.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.910+0000 7f2241bda700 1 Processor -- start 2020-04-22T14:11:06.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.910+0000 7f2241bda700 1 -- start start 2020-04-22T14:11:06.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.911+0000 7f2241bda700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f223c1441f0 0x7f223c0b2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:06.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.911+0000 7f2241bda700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f223c144c80 0x7f223c062e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:06.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.911+0000 7f2241bda700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f223c0632c0 con 0x7f223c05b7c0 2020-04-22T14:11:06.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.911+0000 7f2241bda700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f223c145420 con 0x7f223c1441f0 2020-04-22T14:11:06.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.911+0000 7f2241bda700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f223c1456c0 con 0x7f223c144c80 2020-04-22T14:11:06.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.911+0000 7f223affd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f223c1441f0 0x7f223c0b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:06.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.911+0000 7f223b7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f223c05b7c0 0x7f223c1551b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43902/0 (socket says 172.21.15.103:43902) 2020-04-22T14:11:06.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.911+0000 7f223affd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f223c1441f0 0x7f223c0b2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51714/0 (socket says 172.21.15.103:51714) 2020-04-22T14:11:06.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.911+0000 7f223b7fe700 1 -- 172.21.15.103:0/1022463707 learned_addr learned my addr 172.21.15.103:0/1022463707 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:06.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.911+0000 7f223bfff700 1 --2- 172.21.15.103:0/1022463707 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f223c144c80 0x7f223c062e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:06.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.911+0000 7f223affd700 1 -- 172.21.15.103:0/1022463707 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f223c144c80 msgr2=0x7f223c062e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:06.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.911+0000 7f223affd700 1 --2- 172.21.15.103:0/1022463707 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f223c144c80 0x7f223c062e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:06.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.911+0000 7f223affd700 1 -- 172.21.15.103:0/1022463707 >> v1:172.21.15.103:6789/0 conn(0x7f223c05b7c0 legacy=0x7f223c1551b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:06.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.911+0000 7f2238ff9700 1 -- 172.21.15.103:0/1022463707 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1926261403 0 0) 0x7f223c0b5900 con 0x7f223c05b7c0 2020-04-22T14:11:06.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.911+0000 7f223affd700 1 -- 172.21.15.103:0/1022463707 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223c154190 con 0x7f223c1441f0 2020-04-22T14:11:06.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.911+0000 7f223affd700 1 --2- 172.21.15.103:0/1022463707 >> v2:172.21.15.103:3300/0 conn(0x7f223c1441f0 0x7f223c0b2600 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2230002f30 tx=0x7f2230007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:06.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.912+0000 7f223affd700 1 --2- 172.21.15.103:0/1022463707 >> v2:172.21.15.103:3300/0 conn(0x7f223c1441f0 0x7f223c0b2600 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2230002f30 tx=0x7f2230007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:06.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.912+0000 7f223affd700 1 --2- 172.21.15.103:0/1022463707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f223c1441f0 0x7f223c0b2600 secure :-1 s=READY pgs=883 cs=0 l=1 rx=0x7f2230002f30 tx=0x7f2230007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:06.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.912+0000 7f223affd700 1 --2- 172.21.15.103:0/1022463707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f223c1441f0 0x7f223c0b2600 secure :-1 s=THROTTLE_DONE pgs=883 cs=0 l=1 rx=0x7f2230002f30 tx=0x7f2230007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:06.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.912+0000 7f2238ff9700 1 -- 172.21.15.103:0/1022463707 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f223000f8b0 con 0x7f223c1441f0 2020-04-22T14:11:06.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.912+0000 7f223affd700 1 --2- 172.21.15.103:0/1022463707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f223c1441f0 0x7f223c0b2600 secure :-1 s=THROTTLE_DONE pgs=883 cs=0 l=1 rx=0x7f2230002f30 tx=0x7f2230007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:06.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.912+0000 7f223affd700 1 --2- 172.21.15.103:0/1022463707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f223c1441f0 0x7f223c0b2600 secure :-1 s=THROTTLE_DONE pgs=883 cs=0 l=1 rx=0x7f2230002f30 tx=0x7f2230007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:06.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.912+0000 7f2238ff9700 1 -- 172.21.15.103:0/1022463707 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2230007170 con 0x7f223c1441f0 2020-04-22T14:11:06.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.912+0000 7f2241bda700 1 -- 172.21.15.103:0/1022463707 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f223c1558c0 con 0x7f223c1441f0 2020-04-22T14:11:06.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.912+0000 7f2238ff9700 1 -- 172.21.15.103:0/1022463707 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2230007550 con 0x7f223c1441f0 2020-04-22T14:11:06.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.912+0000 7f2241bda700 1 -- 172.21.15.103:0/1022463707 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f223c0648e0 con 0x7f223c1441f0 2020-04-22T14:11:06.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.912+0000 7f223affd700 1 --2- 172.21.15.103:0/1022463707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f223c1441f0 0x7f223c0b2600 secure :-1 s=THROTTLE_DONE pgs=883 cs=0 l=1 rx=0x7f2230002f30 tx=0x7f2230007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:06.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.913+0000 7f223affd700 1 --2- 172.21.15.103:0/1022463707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f223c1441f0 0x7f223c0b2600 secure :-1 s=THROTTLE_DONE pgs=883 cs=0 l=1 rx=0x7f2230002f30 tx=0x7f2230007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:06.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.913+0000 7f2238ff9700 1 -- 172.21.15.103:0/1022463707 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f22300056c0 con 0x7f223c1441f0 2020-04-22T14:11:06.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.913+0000 7f2241bda700 1 -- 172.21.15.103:0/1022463707 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f223c145260 con 0x7f223c1441f0 2020-04-22T14:11:06.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.913+0000 7f2238ff9700 1 --2- 172.21.15.103:0/1022463707 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f221c04d870 0x7f221c04fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:06.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.913+0000 7f2238ff9700 1 -- 172.21.15.103:0/1022463707 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f22300615d0 con 0x7f223c1441f0 2020-04-22T14:11:06.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.913+0000 7f223b7fe700 1 --2- 172.21.15.103:0/1022463707 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f221c04d870 0x7f221c04fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:06.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.914+0000 7f223b7fe700 1 --2- 172.21.15.103:0/1022463707 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f221c04d870 0x7f221c04fd30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f222c001260 tx=0x7f222c0017e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:06.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.914+0000 7f223b7fe700 1 --2- 172.21.15.103:0/1022463707 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f221c04d870 0x7f221c04fd30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f222c001260 tx=0x7f222c0017e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:06.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.914+0000 7f223b7fe700 1 --2- 172.21.15.103:0/1022463707 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f221c04d870 0x7f221c04fd30 secure :-1 s=READY pgs=334 cs=0 l=1 rx=0x7f222c001260 tx=0x7f222c0017e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:06.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.917+0000 7f223affd700 1 --2- 172.21.15.103:0/1022463707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f223c1441f0 0x7f223c0b2600 secure :-1 s=THROTTLE_DONE pgs=883 cs=0 l=1 rx=0x7f2230002f30 tx=0x7f2230007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:06.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:06.917+0000 7f2238ff9700 1 -- 172.21.15.103:0/1022463707 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f223003c970 con 0x7f223c1441f0 2020-04-22T14:11:07.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:07.111+0000 7f2241bda700 1 -- 172.21.15.103:0/1022463707 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f223c056c90 con 0x7f223c1441f0 2020-04-22T14:11:07.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:07.111+0000 7f223affd700 1 --2- 172.21.15.103:0/1022463707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f223c1441f0 0x7f223c0b2600 secure :-1 s=THROTTLE_DONE pgs=883 cs=0 l=1 rx=0x7f2230002f30 tx=0x7f2230007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:07.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:07.111+0000 7f2238ff9700 1 -- 172.21.15.103:0/1022463707 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f223003ff90 con 0x7f223c1441f0 2020-04-22T14:11:07.114 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:07.114 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/1837726033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1837726033},{"type":"v1","addr":"172.21.15.86:6835","nonce":1837726033}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:03.499587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:11:07.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:07.112+0000 7f2241bda700 1 -- 172.21.15.103:0/1022463707 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f221c04d870 msgr2=0x7f221c04fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:07.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:07.112+0000 7f2241bda700 1 --2- 172.21.15.103:0/1022463707 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f221c04d870 0x7f221c04fd30 secure :-1 s=READY pgs=334 cs=0 l=1 rx=0x7f222c001260 tx=0x7f222c0017e0).stop 2020-04-22T14:11:07.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:07.112+0000 7f2241bda700 1 -- 172.21.15.103:0/1022463707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f223c1441f0 msgr2=0x7f223c0b2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:07.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:07.112+0000 7f2241bda700 1 --2- 172.21.15.103:0/1022463707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f223c1441f0 0x7f223c0b2600 secure :-1 s=READY pgs=883 cs=0 l=1 rx=0x7f2230002f30 tx=0x7f2230007a40).stop 2020-04-22T14:11:07.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:07.112+0000 7f2241bda700 1 -- 172.21.15.103:0/1022463707 shutdown_connections 2020-04-22T14:11:07.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:07.112+0000 7f2241bda700 1 --2- 172.21.15.103:0/1022463707 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f221c04d870 0x7f221c04fd30 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:07.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:07.112+0000 7f2241bda700 1 --2- 172.21.15.103:0/1022463707 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f223c144c80 0x7f223c062e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:07.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:07.112+0000 7f2241bda700 1 --2- 172.21.15.103:0/1022463707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f223c1441f0 0x7f223c0b2600 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:07.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:07.112+0000 7f2241bda700 1 -- 172.21.15.103:0/1022463707 >> 172.21.15.103:0/1022463707 conn(0x7f223c0b9160 msgr2=0x7f223c066ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:07.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:07.113+0000 7f2241bda700 1 -- 172.21.15.103:0/1022463707 shutdown_connections 2020-04-22T14:11:07.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:07.113+0000 7f2241bda700 1 -- 172.21.15.103:0/1022463707 wait complete. 2020-04-22T14:11:07.117 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 41 2020-04-22T14:11:07.125 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:11:08.126 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:08.144 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:11:08.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.297+0000 7f23e590a700 1 Processor -- start 2020-04-22T14:11:08.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.297+0000 7f23e590a700 1 -- start start 2020-04-22T14:11:08.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.298+0000 7f23e590a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f23e0065fe0 0x7f23e01464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:08.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.298+0000 7f23e590a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f23e0063e30 0x7f23e00642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:08.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.298+0000 7f23e590a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23e0143300 con 0x7f23e012c0d0 2020-04-22T14:11:08.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.298+0000 7f23e590a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23e01435a0 con 0x7f23e0065fe0 2020-04-22T14:11:08.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.298+0000 7f23e590a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23e0143840 con 0x7f23e0063e30 2020-04-22T14:11:08.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.298+0000 7f23df7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f23e0063e30 0x7f23e00642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:08.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.298+0000 7f23df7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f23e0063e30 0x7f23e00642c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51722/0 (socket says 172.21.15.103:51722) 2020-04-22T14:11:08.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.298+0000 7f23df7fe700 1 -- 172.21.15.103:0/2348147422 learned_addr learned my addr 172.21.15.103:0/2348147422 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:08.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.299+0000 7f23de7fc700 1 --2- 172.21.15.103:0/2348147422 >> v2:172.21.15.86:3300/0 conn(0x7f23e0065fe0 0x7f23e01464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:08.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.299+0000 7f23df7fe700 1 -- 172.21.15.103:0/2348147422 >> v2:172.21.15.86:3300/0 conn(0x7f23e0065fe0 msgr2=0x7f23e01464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:08.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.299+0000 7f23df7fe700 1 --2- 172.21.15.103:0/2348147422 >> v2:172.21.15.86:3300/0 conn(0x7f23e0065fe0 0x7f23e01464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:08.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.299+0000 7f23df7fe700 1 -- 172.21.15.103:0/2348147422 >> v1:172.21.15.86:6789/0 conn(0x7f23e012c0d0 legacy=0x7f23e005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:08.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.299+0000 7f23df7fe700 1 -- 172.21.15.103:0/2348147422 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e005bb50 con 0x7f23e0063e30 2020-04-22T14:11:08.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.299+0000 7f23df7fe700 1 --2- 172.21.15.103:0/2348147422 >> v2:172.21.15.103:3300/0 conn(0x7f23e0063e30 0x7f23e00642c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f23e00669a0 tx=0x7f23d8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:08.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.299+0000 7f23df7fe700 1 --2- 172.21.15.103:0/2348147422 >> v2:172.21.15.103:3300/0 conn(0x7f23e0063e30 0x7f23e00642c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f23e00669a0 tx=0x7f23d8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:08.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.299+0000 7f23df7fe700 1 --2- 172.21.15.103:0/2348147422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23e0063e30 0x7f23e00642c0 secure :-1 s=READY pgs=884 cs=0 l=1 rx=0x7f23e00669a0 tx=0x7f23d8007dc0).ready entity=mon.1 client_cookie=1c4ee1a60c458aac server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:08.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.299+0000 7f23df7fe700 1 --2- 172.21.15.103:0/2348147422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23e0063e30 0x7f23e00642c0 secure :-1 s=THROTTLE_DONE pgs=884 cs=0 l=1 rx=0x7f23e00669a0 tx=0x7f23d8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:08.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.299+0000 7f23ddffb700 1 -- 172.21.15.103:0/2348147422 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23d800a180 con 0x7f23e0063e30 2020-04-22T14:11:08.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.299+0000 7f23df7fe700 1 --2- 172.21.15.103:0/2348147422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23e0063e30 0x7f23e00642c0 secure :-1 s=THROTTLE_DONE pgs=884 cs=0 l=1 rx=0x7f23e00669a0 tx=0x7f23d8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:08.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.299+0000 7f23df7fe700 1 --2- 172.21.15.103:0/2348147422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23e0063e30 0x7f23e00642c0 secure :-1 s=THROTTLE_DONE pgs=884 cs=0 l=1 rx=0x7f23e00669a0 tx=0x7f23d8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:08.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.299+0000 7f23ddffb700 1 -- 172.21.15.103:0/2348147422 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d800a2e0 con 0x7f23e0063e30 2020-04-22T14:11:08.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.299+0000 7f23ddffb700 1 -- 172.21.15.103:0/2348147422 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23d800a6c0 con 0x7f23e0063e30 2020-04-22T14:11:08.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.299+0000 7f23e590a700 1 -- 172.21.15.103:0/2348147422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23e0063e30 msgr2=0x7f23e00642c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:08.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.299+0000 7f23e590a700 1 --2- 172.21.15.103:0/2348147422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23e0063e30 0x7f23e00642c0 secure :-1 s=READY pgs=884 cs=0 l=1 rx=0x7f23e00669a0 tx=0x7f23d8007dc0).stop 2020-04-22T14:11:08.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.299+0000 7f23e590a700 1 -- 172.21.15.103:0/2348147422 shutdown_connections 2020-04-22T14:11:08.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.299+0000 7f23e590a700 1 --2- 172.21.15.103:0/2348147422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23e0063e30 0x7f23e00642c0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:08.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.299+0000 7f23e590a700 1 --2- 172.21.15.103:0/2348147422 >> v2:172.21.15.86:3300/0 conn(0x7f23e0065fe0 0x7f23e01464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:08.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.299+0000 7f23e590a700 1 -- 172.21.15.103:0/2348147422 >> 172.21.15.103:0/2348147422 conn(0x7f23e00b9160 msgr2=0x7f23e005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:08.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.300+0000 7f23e590a700 1 -- 172.21.15.103:0/2348147422 shutdown_connections 2020-04-22T14:11:08.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.300+0000 7f23e590a700 1 -- 172.21.15.103:0/2348147422 wait complete. 2020-04-22T14:11:08.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.300+0000 7f23e590a700 1 Processor -- start 2020-04-22T14:11:08.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.301+0000 7f23e590a700 1 -- start start 2020-04-22T14:11:08.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.301+0000 7f23e590a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f23e0063e30 0x7f23e00b0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:08.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.301+0000 7f23e590a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f23e0065fe0 0x7f23e00b0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:08.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.301+0000 7f23e590a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23e0155150 con 0x7f23e012c0d0 2020-04-22T14:11:08.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.301+0000 7f23e590a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23e01553f0 con 0x7f23e0063e30 2020-04-22T14:11:08.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.301+0000 7f23e590a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23e0155690 con 0x7f23e0065fe0 2020-04-22T14:11:08.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.301+0000 7f23de7fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f23e0065fe0 0x7f23e00b0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:08.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.301+0000 7f23de7fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f23e0065fe0 0x7f23e00b0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51728/0 (socket says 172.21.15.103:51728) 2020-04-22T14:11:08.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.301+0000 7f23de7fc700 1 -- 172.21.15.103:0/155712756 learned_addr learned my addr 172.21.15.103:0/155712756 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:08.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.301+0000 7f23deffd700 1 --2- 172.21.15.103:0/155712756 >> v2:172.21.15.86:3300/0 conn(0x7f23e0063e30 0x7f23e00b0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:08.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.302+0000 7f23de7fc700 1 -- 172.21.15.103:0/155712756 >> v2:172.21.15.86:3300/0 conn(0x7f23e0063e30 msgr2=0x7f23e00b0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:08.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.302+0000 7f23de7fc700 1 --2- 172.21.15.103:0/155712756 >> v2:172.21.15.86:3300/0 conn(0x7f23e0063e30 0x7f23e00b0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:08.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.302+0000 7f23de7fc700 1 -- 172.21.15.103:0/155712756 >> v1:172.21.15.86:6789/0 conn(0x7f23e012c0d0 legacy=0x7f23e0128090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:08.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.302+0000 7f23de7fc700 1 -- 172.21.15.103:0/155712756 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e01287a0 con 0x7f23e0065fe0 2020-04-22T14:11:08.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.302+0000 7f23de7fc700 1 --2- 172.21.15.103:0/155712756 >> v2:172.21.15.103:3300/0 conn(0x7f23e0065fe0 0x7f23e00b0c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f23e012aec0 tx=0x7f23d0010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:08.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.302+0000 7f23de7fc700 1 --2- 172.21.15.103:0/155712756 >> v2:172.21.15.103:3300/0 conn(0x7f23e0065fe0 0x7f23e00b0c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f23e012aec0 tx=0x7f23d0010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:08.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.302+0000 7f23de7fc700 1 --2- 172.21.15.103:0/155712756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23e0065fe0 0x7f23e00b0c40 secure :-1 s=READY pgs=885 cs=0 l=1 rx=0x7f23e012aec0 tx=0x7f23d0010ae0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:08.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.302+0000 7f23de7fc700 1 --2- 172.21.15.103:0/155712756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23e0065fe0 0x7f23e00b0c40 secure :-1 s=THROTTLE_DONE pgs=885 cs=0 l=1 rx=0x7f23e012aec0 tx=0x7f23d0010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:08.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.302+0000 7f23d7fff700 1 -- 172.21.15.103:0/155712756 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23d0008ea0 con 0x7f23e0065fe0 2020-04-22T14:11:08.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.302+0000 7f23de7fc700 1 --2- 172.21.15.103:0/155712756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23e0065fe0 0x7f23e00b0c40 secure :-1 s=THROTTLE_DONE pgs=885 cs=0 l=1 rx=0x7f23e012aec0 tx=0x7f23d0010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:08.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.302+0000 7f23de7fc700 1 --2- 172.21.15.103:0/155712756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23e0065fe0 0x7f23e00b0c40 secure :-1 s=THROTTLE_DONE pgs=885 cs=0 l=1 rx=0x7f23e012aec0 tx=0x7f23d0010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:08.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.302+0000 7f23d7fff700 1 -- 172.21.15.103:0/155712756 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d0007360 con 0x7f23e0065fe0 2020-04-22T14:11:08.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.302+0000 7f23e590a700 1 -- 172.21.15.103:0/155712756 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23e0155b30 con 0x7f23e0065fe0 2020-04-22T14:11:08.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.302+0000 7f23d7fff700 1 -- 172.21.15.103:0/155712756 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23d0007590 con 0x7f23e0065fe0 2020-04-22T14:11:08.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.302+0000 7f23e590a700 1 -- 172.21.15.103:0/155712756 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23e00b5480 con 0x7f23e0065fe0 2020-04-22T14:11:08.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.303+0000 7f23de7fc700 1 --2- 172.21.15.103:0/155712756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23e0065fe0 0x7f23e00b0c40 secure :-1 s=THROTTLE_DONE pgs=885 cs=0 l=1 rx=0x7f23e012aec0 tx=0x7f23d0010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:08.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.303+0000 7f23e590a700 1 -- 172.21.15.103:0/155712756 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23e00b4630 con 0x7f23e0065fe0 2020-04-22T14:11:08.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.303+0000 7f23d7fff700 1 -- 172.21.15.103:0/155712756 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f23d00058b0 con 0x7f23e0065fe0 2020-04-22T14:11:08.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.303+0000 7f23de7fc700 1 --2- 172.21.15.103:0/155712756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23e0065fe0 0x7f23e00b0c40 secure :-1 s=THROTTLE_DONE pgs=885 cs=0 l=1 rx=0x7f23e012aec0 tx=0x7f23d0010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:08.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.303+0000 7f23d7fff700 1 --2- 172.21.15.103:0/155712756 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f23c404da60 0x7f23c404ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:08.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.303+0000 7f23d7fff700 1 -- 172.21.15.103:0/155712756 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f23d0060fe0 con 0x7f23e0065fe0 2020-04-22T14:11:08.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.303+0000 7f23deffd700 1 --2- 172.21.15.103:0/155712756 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f23c404da60 0x7f23c404ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:08.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.304+0000 7f23deffd700 1 --2- 172.21.15.103:0/155712756 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f23c404da60 0x7f23c404ff20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f23c8001f50 tx=0x7f23c80027c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:08.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.304+0000 7f23deffd700 1 --2- 172.21.15.103:0/155712756 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f23c404da60 0x7f23c404ff20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f23c8001f50 tx=0x7f23c80027c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:08.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.304+0000 7f23deffd700 1 --2- 172.21.15.103:0/155712756 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f23c404da60 0x7f23c404ff20 secure :-1 s=READY pgs=335 cs=0 l=1 rx=0x7f23c8001f50 tx=0x7f23c80027c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:08.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.307+0000 7f23de7fc700 1 --2- 172.21.15.103:0/155712756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23e0065fe0 0x7f23e00b0c40 secure :-1 s=THROTTLE_DONE pgs=885 cs=0 l=1 rx=0x7f23e012aec0 tx=0x7f23d0010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:08.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.307+0000 7f23d7fff700 1 -- 172.21.15.103:0/155712756 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f23d003c420 con 0x7f23e0065fe0 2020-04-22T14:11:08.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.498+0000 7f23e590a700 1 -- 172.21.15.103:0/155712756 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23e0056c90 con 0x7f23e0065fe0 2020-04-22T14:11:08.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.499+0000 7f23de7fc700 1 --2- 172.21.15.103:0/155712756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23e0065fe0 0x7f23e00b0c40 secure :-1 s=THROTTLE_DONE pgs=885 cs=0 l=1 rx=0x7f23e012aec0 tx=0x7f23d0010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:08.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.499+0000 7f23d7fff700 1 -- 172.21.15.103:0/155712756 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f23d003fa40 con 0x7f23e0065fe0 2020-04-22T14:11:08.502 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:08.502 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/1837726033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1837726033},{"type":"v1","addr":"172.21.15.86:6835","nonce":1837726033}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:03.499587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:11:08.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.500+0000 7f23e590a700 1 -- 172.21.15.103:0/155712756 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f23c404da60 msgr2=0x7f23c404ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:08.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.500+0000 7f23e590a700 1 --2- 172.21.15.103:0/155712756 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f23c404da60 0x7f23c404ff20 secure :-1 s=READY pgs=335 cs=0 l=1 rx=0x7f23c8001f50 tx=0x7f23c80027c0).stop 2020-04-22T14:11:08.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.500+0000 7f23e590a700 1 -- 172.21.15.103:0/155712756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23e0065fe0 msgr2=0x7f23e00b0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:08.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.500+0000 7f23e590a700 1 --2- 172.21.15.103:0/155712756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23e0065fe0 0x7f23e00b0c40 secure :-1 s=READY pgs=885 cs=0 l=1 rx=0x7f23e012aec0 tx=0x7f23d0010ae0).stop 2020-04-22T14:11:08.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.500+0000 7f23e590a700 1 -- 172.21.15.103:0/155712756 shutdown_connections 2020-04-22T14:11:08.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.500+0000 7f23e590a700 1 --2- 172.21.15.103:0/155712756 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f23c404da60 0x7f23c404ff20 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:08.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.500+0000 7f23e590a700 1 --2- 172.21.15.103:0/155712756 >> v2:172.21.15.86:3300/0 conn(0x7f23e0063e30 0x7f23e00b0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:08.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.500+0000 7f23e590a700 1 --2- 172.21.15.103:0/155712756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23e0065fe0 0x7f23e00b0c40 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:08.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.500+0000 7f23e590a700 1 -- 172.21.15.103:0/155712756 >> 172.21.15.103:0/155712756 conn(0x7f23e00b9160 msgr2=0x7f23e0064210 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:08.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.500+0000 7f23e590a700 1 -- 172.21.15.103:0/155712756 shutdown_connections 2020-04-22T14:11:08.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:08.500+0000 7f23e590a700 1 -- 172.21.15.103:0/155712756 wait complete. 2020-04-22T14:11:08.504 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 41 2020-04-22T14:11:08.513 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:11:09.514 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:09.531 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:11:09.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.686+0000 7f499e2ee700 1 Processor -- start 2020-04-22T14:11:09.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.686+0000 7f499e2ee700 1 -- start start 2020-04-22T14:11:09.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.687+0000 7f499e2ee700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f499805b7c0 0x7f49980665a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:09.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.687+0000 7f499e2ee700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f49980b4ec0 0x7f49980b5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:09.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.687+0000 7f499e2ee700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49980651f0 con 0x7f499814a640 2020-04-22T14:11:09.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.687+0000 7f499e2ee700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4998066b90 con 0x7f49980b4ec0 2020-04-22T14:11:09.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.687+0000 7f499e2ee700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4998066e30 con 0x7f499805b7c0 2020-04-22T14:11:09.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.687+0000 7f499c88b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f49980b4ec0 0x7f49980b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:09.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.687+0000 7f498ffff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f499814a640 0x7f49981336b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43928/0 (socket says 172.21.15.103:43928) 2020-04-22T14:11:09.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.687+0000 7f498ffff700 1 -- 172.21.15.103:0/2561793731 learned_addr learned my addr 172.21.15.103:0/2561793731 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:09.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.687+0000 7f4997fff700 1 --2- 172.21.15.103:0/2561793731 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f499805b7c0 0x7f49980665a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:09.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.688+0000 7f499c88b700 1 -- 172.21.15.103:0/2561793731 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f499805b7c0 msgr2=0x7f49980665a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:09.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.688+0000 7f499c88b700 1 --2- 172.21.15.103:0/2561793731 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f499805b7c0 0x7f49980665a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:09.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.688+0000 7f499c88b700 1 -- 172.21.15.103:0/2561793731 >> v1:172.21.15.103:6789/0 conn(0x7f499814a640 legacy=0x7f49981336b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:09.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.688+0000 7f499c88b700 1 -- 172.21.15.103:0/2561793731 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49980670d0 con 0x7f49980b4ec0 2020-04-22T14:11:09.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.688+0000 7f49977fe700 1 -- 172.21.15.103:0/2561793731 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4177328584 0 0) 0x7f49980651f0 con 0x7f499814a640 2020-04-22T14:11:09.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.688+0000 7f499c88b700 1 --2- 172.21.15.103:0/2561793731 >> v2:172.21.15.103:3300/0 conn(0x7f49980b4ec0 0x7f49980b5350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f49900032b0 tx=0x7f4990007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:09.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.688+0000 7f499c88b700 1 --2- 172.21.15.103:0/2561793731 >> v2:172.21.15.103:3300/0 conn(0x7f49980b4ec0 0x7f49980b5350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f49900032b0 tx=0x7f4990007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:09.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.688+0000 7f499c88b700 1 --2- 172.21.15.103:0/2561793731 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49980b4ec0 0x7f49980b5350 secure :-1 s=READY pgs=887 cs=0 l=1 rx=0x7f49900032b0 tx=0x7f4990007dc0).ready entity=mon.1 client_cookie=4d16e65f8082cbc7 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:09.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.688+0000 7f499c88b700 1 --2- 172.21.15.103:0/2561793731 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49980b4ec0 0x7f49980b5350 secure :-1 s=THROTTLE_DONE pgs=887 cs=0 l=1 rx=0x7f49900032b0 tx=0x7f4990007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:09.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.688+0000 7f49977fe700 1 -- 172.21.15.103:0/2561793731 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f499000a180 con 0x7f49980b4ec0 2020-04-22T14:11:09.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.688+0000 7f499c88b700 1 --2- 172.21.15.103:0/2561793731 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49980b4ec0 0x7f49980b5350 secure :-1 s=THROTTLE_DONE pgs=887 cs=0 l=1 rx=0x7f49900032b0 tx=0x7f4990007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:09.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.688+0000 7f49977fe700 1 -- 172.21.15.103:0/2561793731 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499000a320 con 0x7f49980b4ec0 2020-04-22T14:11:09.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.688+0000 7f499c88b700 1 --2- 172.21.15.103:0/2561793731 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49980b4ec0 0x7f49980b5350 secure :-1 s=THROTTLE_DONE pgs=887 cs=0 l=1 rx=0x7f49900032b0 tx=0x7f4990007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:09.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.688+0000 7f49977fe700 1 -- 172.21.15.103:0/2561793731 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f499000a700 con 0x7f49980b4ec0 2020-04-22T14:11:09.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.688+0000 7f499e2ee700 1 -- 172.21.15.103:0/2561793731 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49980b4ec0 msgr2=0x7f49980b5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:09.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.688+0000 7f499e2ee700 1 --2- 172.21.15.103:0/2561793731 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49980b4ec0 0x7f49980b5350 secure :-1 s=READY pgs=887 cs=0 l=1 rx=0x7f49900032b0 tx=0x7f4990007dc0).stop 2020-04-22T14:11:09.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.688+0000 7f499e2ee700 1 -- 172.21.15.103:0/2561793731 shutdown_connections 2020-04-22T14:11:09.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.688+0000 7f499e2ee700 1 --2- 172.21.15.103:0/2561793731 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49980b4ec0 0x7f49980b5350 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:09.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.688+0000 7f499e2ee700 1 --2- 172.21.15.103:0/2561793731 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f499805b7c0 0x7f49980665a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:09.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.688+0000 7f499e2ee700 1 -- 172.21.15.103:0/2561793731 >> 172.21.15.103:0/2561793731 conn(0x7f49980b9160 msgr2=0x7f499805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:09.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.688+0000 7f499e2ee700 1 -- 172.21.15.103:0/2561793731 shutdown_connections 2020-04-22T14:11:09.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.689+0000 7f499e2ee700 1 -- 172.21.15.103:0/2561793731 wait complete. 2020-04-22T14:11:09.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.689+0000 7f499e2ee700 1 Processor -- start 2020-04-22T14:11:09.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.690+0000 7f499e2ee700 1 -- start start 2020-04-22T14:11:09.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.690+0000 7f499e2ee700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f49980b4ec0 0x7f49980ae650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:09.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.690+0000 7f499e2ee700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f499814a640 0x7f49980ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:09.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.690+0000 7f499e2ee700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49980ad920 con 0x7f499805b7c0 2020-04-22T14:11:09.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.690+0000 7f499e2ee700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49980ad710 con 0x7f49980b4ec0 2020-04-22T14:11:09.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.690+0000 7f499e2ee700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49980adbc0 con 0x7f499814a640 2020-04-22T14:11:09.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.690+0000 7f498ffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f49980b4ec0 0x7f49980ae650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:09.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.690+0000 7f4997fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f499805b7c0 0x7f4998149aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43930/0 (socket says 172.21.15.103:43930) 2020-04-22T14:11:09.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.690+0000 7f4997fff700 1 -- 172.21.15.103:0/2620432617 learned_addr learned my addr 172.21.15.103:0/2620432617 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:09.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.691+0000 7f498ffff700 1 -- 172.21.15.103:0/2620432617 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f499814a640 msgr2=0x7f49980ad2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:09.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.691+0000 7f498ffff700 1 --2- 172.21.15.103:0/2620432617 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f499814a640 0x7f49980ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:09.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.691+0000 7f498ffff700 1 -- 172.21.15.103:0/2620432617 >> v1:172.21.15.103:6789/0 conn(0x7f499805b7c0 legacy=0x7f4998149aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:09.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.691+0000 7f4995ffb700 1 -- 172.21.15.103:0/2620432617 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 769877049 0 0) 0x7f49980ad920 con 0x7f499805b7c0 2020-04-22T14:11:09.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.691+0000 7f498ffff700 1 -- 172.21.15.103:0/2620432617 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49980b00a0 con 0x7f49980b4ec0 2020-04-22T14:11:09.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.691+0000 7f498ffff700 1 --2- 172.21.15.103:0/2620432617 >> v2:172.21.15.103:3300/0 conn(0x7f49980b4ec0 0x7f49980ae650 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4980000e90 tx=0x7f4980010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:09.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.691+0000 7f498ffff700 1 --2- 172.21.15.103:0/2620432617 >> v2:172.21.15.103:3300/0 conn(0x7f49980b4ec0 0x7f49980ae650 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4980000e90 tx=0x7f4980010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:09.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.691+0000 7f498ffff700 1 --2- 172.21.15.103:0/2620432617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49980b4ec0 0x7f49980ae650 secure :-1 s=READY pgs=889 cs=0 l=1 rx=0x7f4980000e90 tx=0x7f4980010970).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:09.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.691+0000 7f498ffff700 1 --2- 172.21.15.103:0/2620432617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49980b4ec0 0x7f49980ae650 secure :-1 s=THROTTLE_DONE pgs=889 cs=0 l=1 rx=0x7f4980000e90 tx=0x7f4980010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:09.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.691+0000 7f4995ffb700 1 -- 172.21.15.103:0/2620432617 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4980005ca0 con 0x7f49980b4ec0 2020-04-22T14:11:09.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.691+0000 7f498ffff700 1 --2- 172.21.15.103:0/2620432617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49980b4ec0 0x7f49980ae650 secure :-1 s=THROTTLE_DONE pgs=889 cs=0 l=1 rx=0x7f4980000e90 tx=0x7f4980010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:09.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.691+0000 7f4995ffb700 1 -- 172.21.15.103:0/2620432617 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4980005e00 con 0x7f49980b4ec0 2020-04-22T14:11:09.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.691+0000 7f499e2ee700 1 -- 172.21.15.103:0/2620432617 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f499814a1b0 con 0x7f49980b4ec0 2020-04-22T14:11:09.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.691+0000 7f498ffff700 1 --2- 172.21.15.103:0/2620432617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49980b4ec0 0x7f49980ae650 secure :-1 s=THROTTLE_DONE pgs=889 cs=0 l=1 rx=0x7f4980000e90 tx=0x7f4980010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:09.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.691+0000 7f4995ffb700 1 -- 172.21.15.103:0/2620432617 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49800062c0 con 0x7f49980b4ec0 2020-04-22T14:11:09.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.691+0000 7f499e2ee700 1 -- 172.21.15.103:0/2620432617 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f499812fc60 con 0x7f49980b4ec0 2020-04-22T14:11:09.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.692+0000 7f498ffff700 1 --2- 172.21.15.103:0/2620432617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49980b4ec0 0x7f49980ae650 secure :-1 s=THROTTLE_DONE pgs=889 cs=0 l=1 rx=0x7f4980000e90 tx=0x7f4980010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:09.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.692+0000 7f499e2ee700 1 -- 172.21.15.103:0/2620432617 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49980b0290 con 0x7f49980b4ec0 2020-04-22T14:11:09.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.692+0000 7f4995ffb700 1 -- 172.21.15.103:0/2620432617 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f4980006540 con 0x7f49980b4ec0 2020-04-22T14:11:09.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.692+0000 7f498ffff700 1 --2- 172.21.15.103:0/2620432617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49980b4ec0 0x7f49980ae650 secure :-1 s=THROTTLE_DONE pgs=889 cs=0 l=1 rx=0x7f4980000e90 tx=0x7f4980010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:09.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.692+0000 7f4995ffb700 1 --2- 172.21.15.103:0/2620432617 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f497c04d830 0x7f497c04fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:09.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.692+0000 7f4995ffb700 1 -- 172.21.15.103:0/2620432617 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f49800090c0 con 0x7f49980b4ec0 2020-04-22T14:11:09.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.693+0000 7f4997fff700 1 --2- 172.21.15.103:0/2620432617 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f497c04d830 0x7f497c04fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:09.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.693+0000 7f4997fff700 1 --2- 172.21.15.103:0/2620432617 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f497c04d830 0x7f497c04fcf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4988007a40 tx=0x7f4988002360).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:09.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.693+0000 7f4997fff700 1 --2- 172.21.15.103:0/2620432617 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f497c04d830 0x7f497c04fcf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4988007a40 tx=0x7f4988002360).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:09.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.693+0000 7f4997fff700 1 --2- 172.21.15.103:0/2620432617 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f497c04d830 0x7f497c04fcf0 secure :-1 s=READY pgs=336 cs=0 l=1 rx=0x7f4988007a40 tx=0x7f4988002360).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:09.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.696+0000 7f498ffff700 1 --2- 172.21.15.103:0/2620432617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49980b4ec0 0x7f49980ae650 secure :-1 s=THROTTLE_DONE pgs=889 cs=0 l=1 rx=0x7f4980000e90 tx=0x7f4980010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:09.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.696+0000 7f4995ffb700 1 -- 172.21.15.103:0/2620432617 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f498003c920 con 0x7f49980b4ec0 2020-04-22T14:11:09.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.886+0000 7f499e2ee700 1 -- 172.21.15.103:0/2620432617 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4998056c90 con 0x7f49980b4ec0 2020-04-22T14:11:09.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.887+0000 7f498ffff700 1 --2- 172.21.15.103:0/2620432617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49980b4ec0 0x7f49980ae650 secure :-1 s=THROTTLE_DONE pgs=889 cs=0 l=1 rx=0x7f4980000e90 tx=0x7f4980010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:09.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.887+0000 7f4995ffb700 1 -- 172.21.15.103:0/2620432617 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f498003ff40 con 0x7f49980b4ec0 2020-04-22T14:11:09.890 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:09.890 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/1837726033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1837726033},{"type":"v1","addr":"172.21.15.86:6835","nonce":1837726033}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:03.499587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:11:09.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.888+0000 7f499e2ee700 1 -- 172.21.15.103:0/2620432617 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f497c04d830 msgr2=0x7f497c04fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:09.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.888+0000 7f499e2ee700 1 --2- 172.21.15.103:0/2620432617 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f497c04d830 0x7f497c04fcf0 secure :-1 s=READY pgs=336 cs=0 l=1 rx=0x7f4988007a40 tx=0x7f4988002360).stop 2020-04-22T14:11:09.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.888+0000 7f499e2ee700 1 -- 172.21.15.103:0/2620432617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49980b4ec0 msgr2=0x7f49980ae650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:09.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.888+0000 7f499e2ee700 1 --2- 172.21.15.103:0/2620432617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49980b4ec0 0x7f49980ae650 secure :-1 s=READY pgs=889 cs=0 l=1 rx=0x7f4980000e90 tx=0x7f4980010970).stop 2020-04-22T14:11:09.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.888+0000 7f499e2ee700 1 -- 172.21.15.103:0/2620432617 shutdown_connections 2020-04-22T14:11:09.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.888+0000 7f499e2ee700 1 --2- 172.21.15.103:0/2620432617 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f497c04d830 0x7f497c04fcf0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:09.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.888+0000 7f499e2ee700 1 --2- 172.21.15.103:0/2620432617 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f499814a640 0x7f49980ad2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:09.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.888+0000 7f499e2ee700 1 --2- 172.21.15.103:0/2620432617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49980b4ec0 0x7f49980ae650 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:09.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.888+0000 7f499e2ee700 1 -- 172.21.15.103:0/2620432617 >> 172.21.15.103:0/2620432617 conn(0x7f49980b9160 msgr2=0x7f4998131b00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:09.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.888+0000 7f499e2ee700 1 -- 172.21.15.103:0/2620432617 shutdown_connections 2020-04-22T14:11:09.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:09.888+0000 7f499e2ee700 1 -- 172.21.15.103:0/2620432617 wait complete. 2020-04-22T14:11:09.893 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 41 2020-04-22T14:11:09.901 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:11:10.902 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:10.928 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:11:11.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.084+0000 7f0312529700 1 Processor -- start 2020-04-22T14:11:11.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.084+0000 7f0312529700 1 -- start start 2020-04-22T14:11:11.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.084+0000 7f0312529700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f030c05b7c0 0x7f030c146cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:11.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.084+0000 7f0312529700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f030c0b5a80 0x7f030c0b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:11.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.085+0000 7f0312529700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f030c062ab0 con 0x7f030c149860 2020-04-22T14:11:11.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.085+0000 7f0312529700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f030c0b6390 con 0x7f030c05b7c0 2020-04-22T14:11:11.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.085+0000 7f0312529700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f030c0b4640 con 0x7f030c0b5a80 2020-04-22T14:11:11.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.085+0000 7f030bfff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f030c05b7c0 0x7f030c146cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:11.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.085+0000 7f0310ac6700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f030c149860 0x7f030c149cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43942/0 (socket says 172.21.15.103:43942) 2020-04-22T14:11:11.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.085+0000 7f0310ac6700 1 -- 172.21.15.103:0/3171459469 learned_addr learned my addr 172.21.15.103:0/3171459469 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:11.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.085+0000 7f0303fff700 1 --2- 172.21.15.103:0/3171459469 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f030c0b5a80 0x7f030c0b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:11.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.085+0000 7f030bfff700 1 -- 172.21.15.103:0/3171459469 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f030c0b5a80 msgr2=0x7f030c0b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:11.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.085+0000 7f030bfff700 1 --2- 172.21.15.103:0/3171459469 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f030c0b5a80 0x7f030c0b5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:11.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.085+0000 7f030bfff700 1 -- 172.21.15.103:0/3171459469 >> v1:172.21.15.103:6789/0 conn(0x7f030c149860 legacy=0x7f030c149cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:11.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.085+0000 7f030b7fe700 1 -- 172.21.15.103:0/3171459469 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3785193445 0 0) 0x7f030c062ab0 con 0x7f030c149860 2020-04-22T14:11:11.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.085+0000 7f030bfff700 1 -- 172.21.15.103:0/3171459469 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f030c063220 con 0x7f030c05b7c0 2020-04-22T14:11:11.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.085+0000 7f0303fff700 1 --2- 172.21.15.103:0/3171459469 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f030c0b5a80 0x7f030c0b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:11:11.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.085+0000 7f030bfff700 1 --2- 172.21.15.103:0/3171459469 >> v2:172.21.15.103:3300/0 conn(0x7f030c05b7c0 0x7f030c146cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f02fc002f30 tx=0x7f02fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:11.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.085+0000 7f030bfff700 1 --2- 172.21.15.103:0/3171459469 >> v2:172.21.15.103:3300/0 conn(0x7f030c05b7c0 0x7f030c146cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f02fc002f30 tx=0x7f02fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:11.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.085+0000 7f030bfff700 1 --2- 172.21.15.103:0/3171459469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f030c05b7c0 0x7f030c146cd0 secure :-1 s=READY pgs=891 cs=0 l=1 rx=0x7f02fc002f30 tx=0x7f02fc007a40).ready entity=mon.1 client_cookie=7a333382862a70d0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:11.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.085+0000 7f030bfff700 1 --2- 172.21.15.103:0/3171459469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f030c05b7c0 0x7f030c146cd0 secure :-1 s=THROTTLE_DONE pgs=891 cs=0 l=1 rx=0x7f02fc002f30 tx=0x7f02fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:11.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.085+0000 7f030b7fe700 1 -- 172.21.15.103:0/3171459469 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02fc011470 con 0x7f030c05b7c0 2020-04-22T14:11:11.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.085+0000 7f030bfff700 1 --2- 172.21.15.103:0/3171459469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f030c05b7c0 0x7f030c146cd0 secure :-1 s=THROTTLE_DONE pgs=891 cs=0 l=1 rx=0x7f02fc002f30 tx=0x7f02fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:11.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.085+0000 7f030bfff700 1 --2- 172.21.15.103:0/3171459469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f030c05b7c0 0x7f030c146cd0 secure :-1 s=THROTTLE_DONE pgs=891 cs=0 l=1 rx=0x7f02fc002f30 tx=0x7f02fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:11.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.085+0000 7f030b7fe700 1 -- 172.21.15.103:0/3171459469 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02fc011610 con 0x7f030c05b7c0 2020-04-22T14:11:11.092 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.085+0000 7f030b7fe700 1 -- 172.21.15.103:0/3171459469 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02fc0119f0 con 0x7f030c05b7c0 2020-04-22T14:11:11.092 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.085+0000 7f0312529700 1 -- 172.21.15.103:0/3171459469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f030c05b7c0 msgr2=0x7f030c146cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:11.092 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.085+0000 7f0312529700 1 --2- 172.21.15.103:0/3171459469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f030c05b7c0 0x7f030c146cd0 secure :-1 s=READY pgs=891 cs=0 l=1 rx=0x7f02fc002f30 tx=0x7f02fc007a40).stop 2020-04-22T14:11:11.092 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.086+0000 7f0312529700 1 -- 172.21.15.103:0/3171459469 shutdown_connections 2020-04-22T14:11:11.092 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.086+0000 7f0312529700 1 --2- 172.21.15.103:0/3171459469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f030c05b7c0 0x7f030c146cd0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:11.092 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.086+0000 7f0312529700 1 --2- 172.21.15.103:0/3171459469 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f030c0b5a80 0x7f030c0b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:11.092 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.086+0000 7f0312529700 1 -- 172.21.15.103:0/3171459469 >> 172.21.15.103:0/3171459469 conn(0x7f030c0b9160 msgr2=0x7f030c05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:11.093 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.086+0000 7f0312529700 1 -- 172.21.15.103:0/3171459469 shutdown_connections 2020-04-22T14:11:11.093 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.086+0000 7f0312529700 1 -- 172.21.15.103:0/3171459469 wait complete. 2020-04-22T14:11:11.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.087+0000 7f0312529700 1 Processor -- start 2020-04-22T14:11:11.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.087+0000 7f0312529700 1 -- start start 2020-04-22T14:11:11.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.088+0000 7f0312529700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f030c05b7c0 0x7f030c063520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:11.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.088+0000 7f0312529700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f030c149860 0x7f030c0656d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:11.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.088+0000 7f0312529700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f030c065b30 con 0x7f030c0b5a80 2020-04-22T14:11:11.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.088+0000 7f0312529700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f030c143490 con 0x7f030c05b7c0 2020-04-22T14:11:11.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.088+0000 7f0312529700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f030c153c10 con 0x7f030c149860 2020-04-22T14:11:11.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.088+0000 7f0310ac6700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f030c149860 0x7f030c0656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:11.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.088+0000 7f0310ac6700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f030c149860 0x7f030c0656d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51758/0 (socket says 172.21.15.103:51758) 2020-04-22T14:11:11.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.088+0000 7f0310ac6700 1 -- 172.21.15.103:0/3892418996 learned_addr learned my addr 172.21.15.103:0/3892418996 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:11.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.088+0000 7f030bfff700 1 --2- 172.21.15.103:0/3892418996 >> v2:172.21.15.86:3300/0 conn(0x7f030c05b7c0 0x7f030c063520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:11.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.088+0000 7f0310ac6700 1 -- 172.21.15.103:0/3892418996 >> v2:172.21.15.86:3300/0 conn(0x7f030c05b7c0 msgr2=0x7f030c063520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:11.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.088+0000 7f0310ac6700 1 --2- 172.21.15.103:0/3892418996 >> v2:172.21.15.86:3300/0 conn(0x7f030c05b7c0 0x7f030c063520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:11.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.088+0000 7f0310ac6700 1 -- 172.21.15.103:0/3892418996 >> v1:172.21.15.86:6789/0 conn(0x7f030c0b5a80 legacy=0x7f030c063b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:11.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.088+0000 7f0310ac6700 1 -- 172.21.15.103:0/3892418996 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f030c153eb0 con 0x7f030c149860 2020-04-22T14:11:11.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.088+0000 7f030bfff700 1 --2- 172.21.15.103:0/3892418996 >> v2:172.21.15.86:3300/0 conn(0x7f030c05b7c0 0x7f030c063520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:11:11.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.088+0000 7f0310ac6700 1 --2- 172.21.15.103:0/3892418996 >> v2:172.21.15.103:3300/0 conn(0x7f030c149860 0x7f030c0656d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f030c143260 tx=0x7f0304010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:11.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.088+0000 7f0310ac6700 1 --2- 172.21.15.103:0/3892418996 >> v2:172.21.15.103:3300/0 conn(0x7f030c149860 0x7f030c0656d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f030c143260 tx=0x7f0304010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:11.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.088+0000 7f0310ac6700 1 --2- 172.21.15.103:0/3892418996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f030c149860 0x7f030c0656d0 secure :-1 s=READY pgs=892 cs=0 l=1 rx=0x7f030c143260 tx=0x7f0304010d50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:11.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.088+0000 7f0310ac6700 1 --2- 172.21.15.103:0/3892418996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f030c149860 0x7f030c0656d0 secure :-1 s=THROTTLE_DONE pgs=892 cs=0 l=1 rx=0x7f030c143260 tx=0x7f0304010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:11.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.088+0000 7f0310ac6700 1 --2- 172.21.15.103:0/3892418996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f030c149860 0x7f030c0656d0 secure :-1 s=THROTTLE_DONE pgs=892 cs=0 l=1 rx=0x7f030c143260 tx=0x7f0304010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:11.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.088+0000 7f0309ffb700 1 -- 172.21.15.103:0/3892418996 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0304005e30 con 0x7f030c149860 2020-04-22T14:11:11.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.088+0000 7f0310ac6700 1 --2- 172.21.15.103:0/3892418996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f030c149860 0x7f030c0656d0 secure :-1 s=THROTTLE_DONE pgs=892 cs=0 l=1 rx=0x7f030c143260 tx=0x7f0304010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:11.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.088+0000 7f0309ffb700 1 -- 172.21.15.103:0/3892418996 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03040125a0 con 0x7f030c149860 2020-04-22T14:11:11.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.088+0000 7f0312529700 1 -- 172.21.15.103:0/3892418996 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f030c1538c0 con 0x7f030c149860 2020-04-22T14:11:11.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.088+0000 7f0309ffb700 1 -- 172.21.15.103:0/3892418996 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0304012980 con 0x7f030c149860 2020-04-22T14:11:11.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.088+0000 7f0312529700 1 -- 172.21.15.103:0/3892418996 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f030c064470 con 0x7f030c149860 2020-04-22T14:11:11.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.089+0000 7f0310ac6700 1 --2- 172.21.15.103:0/3892418996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f030c149860 0x7f030c0656d0 secure :-1 s=THROTTLE_DONE pgs=892 cs=0 l=1 rx=0x7f030c143260 tx=0x7f0304010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:11.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.089+0000 7f0312529700 1 -- 172.21.15.103:0/3892418996 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f030c056c90 con 0x7f030c149860 2020-04-22T14:11:11.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.089+0000 7f0309ffb700 1 -- 172.21.15.103:0/3892418996 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f0304012bf0 con 0x7f030c149860 2020-04-22T14:11:11.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.089+0000 7f0310ac6700 1 --2- 172.21.15.103:0/3892418996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f030c149860 0x7f030c0656d0 secure :-1 s=THROTTLE_DONE pgs=892 cs=0 l=1 rx=0x7f030c143260 tx=0x7f0304010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:11.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.090+0000 7f0309ffb700 1 --2- 172.21.15.103:0/3892418996 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f02f004d9d0 0x7f02f004fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:11.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.090+0000 7f0309ffb700 1 -- 172.21.15.103:0/3892418996 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f03040090c0 con 0x7f030c149860 2020-04-22T14:11:11.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.090+0000 7f030bfff700 1 --2- 172.21.15.103:0/3892418996 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f02f004d9d0 0x7f02f004fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:11.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.090+0000 7f030bfff700 1 --2- 172.21.15.103:0/3892418996 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f02f004d9d0 0x7f02f004fe90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f02fc002f30 tx=0x7f02fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:11.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.090+0000 7f030bfff700 1 --2- 172.21.15.103:0/3892418996 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f02f004d9d0 0x7f02f004fe90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f02fc002f30 tx=0x7f02fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:11.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.090+0000 7f030bfff700 1 --2- 172.21.15.103:0/3892418996 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f02f004d9d0 0x7f02f004fe90 secure :-1 s=READY pgs=337 cs=0 l=1 rx=0x7f02fc002f30 tx=0x7f02fc007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:11.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.094+0000 7f0310ac6700 1 --2- 172.21.15.103:0/3892418996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f030c149860 0x7f030c0656d0 secure :-1 s=THROTTLE_DONE pgs=892 cs=0 l=1 rx=0x7f030c143260 tx=0x7f0304010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:11.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.094+0000 7f0309ffb700 1 -- 172.21.15.103:0/3892418996 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f030403ce70 con 0x7f030c149860 2020-04-22T14:11:11.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.286+0000 7f0312529700 1 -- 172.21.15.103:0/3892418996 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f030c065b30 con 0x7f030c149860 2020-04-22T14:11:11.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.286+0000 7f0310ac6700 1 --2- 172.21.15.103:0/3892418996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f030c149860 0x7f030c0656d0 secure :-1 s=THROTTLE_DONE pgs=892 cs=0 l=1 rx=0x7f030c143260 tx=0x7f0304010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:11.289 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.286+0000 7f0309ffb700 1 -- 172.21.15.103:0/3892418996 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f030c065b30 con 0x7f030c149860 2020-04-22T14:11:11.289 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:11.289 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/1837726033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1837726033},{"type":"v1","addr":"172.21.15.86:6835","nonce":1837726033}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:03.499587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:11:11.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.287+0000 7f0312529700 1 -- 172.21.15.103:0/3892418996 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f02f004d9d0 msgr2=0x7f02f004fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:11.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.287+0000 7f0312529700 1 --2- 172.21.15.103:0/3892418996 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f02f004d9d0 0x7f02f004fe90 secure :-1 s=READY pgs=337 cs=0 l=1 rx=0x7f02fc002f30 tx=0x7f02fc007a40).stop 2020-04-22T14:11:11.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.287+0000 7f0312529700 1 -- 172.21.15.103:0/3892418996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f030c149860 msgr2=0x7f030c0656d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:11.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.287+0000 7f0312529700 1 --2- 172.21.15.103:0/3892418996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f030c149860 0x7f030c0656d0 secure :-1 s=READY pgs=892 cs=0 l=1 rx=0x7f030c143260 tx=0x7f0304010d50).stop 2020-04-22T14:11:11.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.288+0000 7f0312529700 1 -- 172.21.15.103:0/3892418996 shutdown_connections 2020-04-22T14:11:11.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.288+0000 7f0312529700 1 --2- 172.21.15.103:0/3892418996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f030c149860 0x7f030c0656d0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:11.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.288+0000 7f0312529700 1 --2- 172.21.15.103:0/3892418996 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f02f004d9d0 0x7f02f004fe90 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:11.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.288+0000 7f0312529700 1 --2- 172.21.15.103:0/3892418996 >> v2:172.21.15.86:3300/0 conn(0x7f030c05b7c0 0x7f030c063520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:11.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.288+0000 7f0312529700 1 -- 172.21.15.103:0/3892418996 >> 172.21.15.103:0/3892418996 conn(0x7f030c0b9160 msgr2=0x7f030c0b0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:11.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.288+0000 7f0312529700 1 -- 172.21.15.103:0/3892418996 shutdown_connections 2020-04-22T14:11:11.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:11.288+0000 7f0312529700 1 -- 172.21.15.103:0/3892418996 wait complete. 2020-04-22T14:11:11.292 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 41 2020-04-22T14:11:11.301 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:11:12.302 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:12.319 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:11:12.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.474+0000 7f4d53d9e700 1 Processor -- start 2020-04-22T14:11:12.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.475+0000 7f4d53d9e700 1 -- start start 2020-04-22T14:11:12.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.475+0000 7f4d53d9e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4d4c0b6040 0x7f4d4c0ac740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:12.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.475+0000 7f4d53d9e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d4c064ec0 con 0x7f4d4c067170 2020-04-22T14:11:12.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.475+0000 7f4d53d9e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d4c146870 con 0x7f4d4c1426d0 2020-04-22T14:11:12.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.475+0000 7f4d53d9e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d4c065af0 con 0x7f4d4c0b6040 2020-04-22T14:11:12.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.475+0000 7f4d51339700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4d4c0b6040 0x7f4d4c0ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:12.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.476+0000 7f4d5233b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f4d4c1426d0 0x7f4d4c142b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43956/0 (socket says 172.21.15.103:43956) 2020-04-22T14:11:12.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.476+0000 7f4d5233b700 1 -- 172.21.15.103:0/3627554724 learned_addr learned my addr 172.21.15.103:0/3627554724 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:12.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.476+0000 7f4d51339700 1 -- 172.21.15.103:0/3627554724 >> v1:172.21.15.103:6789/0 conn(0x7f4d4c1426d0 legacy=0x7f4d4c142b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:12.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.476+0000 7f4d51339700 1 -- 172.21.15.103:0/3627554724 >> v1:172.21.15.86:6789/0 conn(0x7f4d4c067170 legacy=0x7f4d4c13c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:12.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.476+0000 7f4d50b38700 1 -- 172.21.15.103:0/3627554724 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2354678215 0 0) 0x7f4d4c146870 con 0x7f4d4c1426d0 2020-04-22T14:11:12.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.476+0000 7f4d51339700 1 -- 172.21.15.103:0/3627554724 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4c067550 con 0x7f4d4c0b6040 2020-04-22T14:11:12.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.476+0000 7f4d51339700 1 --2- 172.21.15.103:0/3627554724 >> v2:172.21.15.103:3300/0 conn(0x7f4d4c0b6040 0x7f4d4c0ac740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4d4c066130 tx=0x7f4d400088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:12.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.476+0000 7f4d51339700 1 --2- 172.21.15.103:0/3627554724 >> v2:172.21.15.103:3300/0 conn(0x7f4d4c0b6040 0x7f4d4c0ac740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4d4c066130 tx=0x7f4d400088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:12.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.476+0000 7f4d51339700 1 --2- 172.21.15.103:0/3627554724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d4c0b6040 0x7f4d4c0ac740 secure :-1 s=READY pgs=894 cs=0 l=1 rx=0x7f4d4c066130 tx=0x7f4d400088e0).ready entity=mon.1 client_cookie=d1f6c982fa77b0ba server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:12.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.476+0000 7f4d51339700 1 --2- 172.21.15.103:0/3627554724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d4c0b6040 0x7f4d4c0ac740 secure :-1 s=THROTTLE_DONE pgs=894 cs=0 l=1 rx=0x7f4d4c066130 tx=0x7f4d400088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:12.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.476+0000 7f4d50b38700 1 -- 172.21.15.103:0/3627554724 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d40012730 con 0x7f4d4c0b6040 2020-04-22T14:11:12.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.476+0000 7f4d51339700 1 --2- 172.21.15.103:0/3627554724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d4c0b6040 0x7f4d4c0ac740 secure :-1 s=THROTTLE_DONE pgs=894 cs=0 l=1 rx=0x7f4d4c066130 tx=0x7f4d400088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:12.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.476+0000 7f4d50b38700 1 -- 172.21.15.103:0/3627554724 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d40012890 con 0x7f4d4c0b6040 2020-04-22T14:11:12.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.476+0000 7f4d51339700 1 --2- 172.21.15.103:0/3627554724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d4c0b6040 0x7f4d4c0ac740 secure :-1 s=THROTTLE_DONE pgs=894 cs=0 l=1 rx=0x7f4d4c066130 tx=0x7f4d400088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:12.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.476+0000 7f4d50b38700 1 -- 172.21.15.103:0/3627554724 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d40012c70 con 0x7f4d4c0b6040 2020-04-22T14:11:12.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.476+0000 7f4d53d9e700 1 -- 172.21.15.103:0/3627554724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d4c0b6040 msgr2=0x7f4d4c0ac740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:12.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.476+0000 7f4d53d9e700 1 --2- 172.21.15.103:0/3627554724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d4c0b6040 0x7f4d4c0ac740 secure :-1 s=READY pgs=894 cs=0 l=1 rx=0x7f4d4c066130 tx=0x7f4d400088e0).stop 2020-04-22T14:11:12.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.477+0000 7f4d53d9e700 1 -- 172.21.15.103:0/3627554724 shutdown_connections 2020-04-22T14:11:12.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.477+0000 7f4d53d9e700 1 --2- 172.21.15.103:0/3627554724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d4c0b6040 0x7f4d4c0ac740 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:12.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.477+0000 7f4d53d9e700 1 -- 172.21.15.103:0/3627554724 >> 172.21.15.103:0/3627554724 conn(0x7f4d4c0b9160 msgr2=0x7f4d4c05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:12.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.477+0000 7f4d53d9e700 1 -- 172.21.15.103:0/3627554724 shutdown_connections 2020-04-22T14:11:12.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.477+0000 7f4d53d9e700 1 -- 172.21.15.103:0/3627554724 wait complete. 2020-04-22T14:11:12.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.478+0000 7f4d53d9e700 1 Processor -- start 2020-04-22T14:11:12.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.478+0000 7f4d53d9e700 1 -- start start 2020-04-22T14:11:12.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.478+0000 7f4d53d9e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d4c0b6040 0x7f4d4c145510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:12.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.478+0000 7f4d53d9e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4d4c1426d0 0x7f4d4c135400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:12.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.478+0000 7f4d53d9e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d4c153020 con 0x7f4d4c067170 2020-04-22T14:11:12.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.478+0000 7f4d53d9e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d4c1532c0 con 0x7f4d4c1426d0 2020-04-22T14:11:12.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.478+0000 7f4d53d9e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c153560 con 0x7f4d4c0b6040 2020-04-22T14:11:12.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.478+0000 7f4d51b3a700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f4d4c067170 0x7f4d4c134cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43958/0 (socket says 172.21.15.103:43958) 2020-04-22T14:11:12.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.478+0000 7f4d51b3a700 1 -- 172.21.15.103:0/4027466929 learned_addr learned my addr 172.21.15.103:0/4027466929 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:12.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.479+0000 7f4d5233b700 1 --2- 172.21.15.103:0/4027466929 >> v2:172.21.15.86:3300/0 conn(0x7f4d4c1426d0 0x7f4d4c135400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:12.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.479+0000 7f4d51339700 1 --2- 172.21.15.103:0/4027466929 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d4c0b6040 0x7f4d4c145510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:12.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.479+0000 7f4d3effd700 1 -- 172.21.15.103:0/4027466929 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3199774802 0 0) 0x7f4d4c153020 con 0x7f4d4c067170 2020-04-22T14:11:12.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.479+0000 7f4d3effd700 1 -- 172.21.15.103:0/4027466929 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d2c002fe0 con 0x7f4d4c067170 2020-04-22T14:11:12.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.479+0000 7f4d3effd700 1 -- 172.21.15.103:0/4027466929 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3759663270 0 0) 0x7f4d2c002fe0 con 0x7f4d4c067170 2020-04-22T14:11:12.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.479+0000 7f4d3effd700 1 -- 172.21.15.103:0/4027466929 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4d4c153020 con 0x7f4d4c067170 2020-04-22T14:11:12.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.479+0000 7f4d3effd700 1 -- 172.21.15.103:0/4027466929 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f4d48002910 con 0x7f4d4c067170 2020-04-22T14:11:12.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.479+0000 7f4d3effd700 1 -- 172.21.15.103:0/4027466929 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d4c0b6040 msgr2=0x7f4d4c145510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:12.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.479+0000 7f4d3effd700 1 --2- 172.21.15.103:0/4027466929 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d4c0b6040 0x7f4d4c145510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:12.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.479+0000 7f4d3effd700 1 -- 172.21.15.103:0/4027466929 >> v2:172.21.15.86:3300/0 conn(0x7f4d4c1426d0 msgr2=0x7f4d4c135400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:12.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.479+0000 7f4d3effd700 1 --2- 172.21.15.103:0/4027466929 >> v2:172.21.15.86:3300/0 conn(0x7f4d4c1426d0 0x7f4d4c135400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:12.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.479+0000 7f4d3effd700 1 -- 172.21.15.103:0/4027466929 >> v1:172.21.15.103:6789/0 conn(0x7f4d4c067170 legacy=0x7f4d4c134cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:12.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.479+0000 7f4d3effd700 1 --2- 172.21.15.103:0/4027466929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d2c0049b0 0x7f4d2c004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:12.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.479+0000 7f4d3effd700 1 --2- 172.21.15.103:0/4027466929 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d2c003920 0x7f4d2c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:12.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.479+0000 7f4d3effd700 1 --2- 172.21.15.103:0/4027466929 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d4c0b6040 0x7f4d2c004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:12.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.479+0000 7f4d3effd700 1 -- 172.21.15.103:0/4027466929 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c1532c0 con 0x7f4d2c003920 2020-04-22T14:11:12.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.479+0000 7f4d3effd700 1 -- 172.21.15.103:0/4027466929 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c153560 con 0x7f4d2c0049b0 2020-04-22T14:11:12.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.479+0000 7f4d3effd700 1 -- 172.21.15.103:0/4027466929 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c004660 con 0x7f4d4c0b6040 2020-04-22T14:11:12.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.479+0000 7f4d51b3a700 1 --2- 172.21.15.103:0/4027466929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d2c0049b0 0x7f4d2c004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:12.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.479+0000 7f4d51339700 1 --2- 172.21.15.103:0/4027466929 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d2c003920 0x7f4d2c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:12.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.479+0000 7f4d5233b700 1 --2- 172.21.15.103:0/4027466929 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d4c0b6040 0x7f4d2c004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:12.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.479+0000 7f4d51b3a700 1 -- 172.21.15.103:0/4027466929 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d4c0b6040 msgr2=0x7f4d2c004200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:12.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.479+0000 7f4d51b3a700 1 --2- 172.21.15.103:0/4027466929 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d4c0b6040 0x7f4d2c004200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:12.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.479+0000 7f4d51b3a700 1 -- 172.21.15.103:0/4027466929 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d2c003920 msgr2=0x7f4d2c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:12.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.479+0000 7f4d51b3a700 1 --2- 172.21.15.103:0/4027466929 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d2c003920 0x7f4d2c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:12.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.479+0000 7f4d51b3a700 1 -- 172.21.15.103:0/4027466929 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4c153a00 con 0x7f4d2c0049b0 2020-04-22T14:11:12.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.479+0000 7f4d53d9e700 1 -- 172.21.15.103:0/4027466929 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d4c13a680 con 0x7f4d2c0049b0 2020-04-22T14:11:12.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.480+0000 7f4d51b3a700 1 --2- 172.21.15.103:0/4027466929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d2c0049b0 0x7f4d2c004dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4d48002620 tx=0x7f4d48011400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:12.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.480+0000 7f4d53d9e700 1 -- 172.21.15.103:0/4027466929 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d4c152db0 con 0x7f4d2c0049b0 2020-04-22T14:11:12.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.480+0000 7f4d51b3a700 1 --2- 172.21.15.103:0/4027466929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d2c0049b0 0x7f4d2c004dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4d48002620 tx=0x7f4d48011400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:12.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.480+0000 7f4d51b3a700 1 --2- 172.21.15.103:0/4027466929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d2c0049b0 0x7f4d2c004dd0 secure :-1 s=READY pgs=896 cs=0 l=1 rx=0x7f4d48002620 tx=0x7f4d48011400).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:12.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.480+0000 7f4d51b3a700 1 --2- 172.21.15.103:0/4027466929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d2c0049b0 0x7f4d2c004dd0 secure :-1 s=THROTTLE_DONE pgs=896 cs=0 l=1 rx=0x7f4d48002620 tx=0x7f4d48011400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:12.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.480+0000 7f4d3effd700 1 -- 172.21.15.103:0/4027466929 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d48011d60 con 0x7f4d2c0049b0 2020-04-22T14:11:12.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.480+0000 7f4d51b3a700 1 --2- 172.21.15.103:0/4027466929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d2c0049b0 0x7f4d2c004dd0 secure :-1 s=THROTTLE_DONE pgs=896 cs=0 l=1 rx=0x7f4d48002620 tx=0x7f4d48011400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:12.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.480+0000 7f4d3effd700 1 -- 172.21.15.103:0/4027466929 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d480101c0 con 0x7f4d2c0049b0 2020-04-22T14:11:12.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.480+0000 7f4d51b3a700 1 --2- 172.21.15.103:0/4027466929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d2c0049b0 0x7f4d2c004dd0 secure :-1 s=THROTTLE_DONE pgs=896 cs=0 l=1 rx=0x7f4d48002620 tx=0x7f4d48011400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:12.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.480+0000 7f4d3effd700 1 -- 172.21.15.103:0/4027466929 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d48010560 con 0x7f4d2c0049b0 2020-04-22T14:11:12.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.481+0000 7f4d51b3a700 1 --2- 172.21.15.103:0/4027466929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d2c0049b0 0x7f4d2c004dd0 secure :-1 s=THROTTLE_DONE pgs=896 cs=0 l=1 rx=0x7f4d48002620 tx=0x7f4d48011400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:12.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.481+0000 7f4d53d9e700 1 -- 172.21.15.103:0/4027466929 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d4c153760 con 0x7f4d2c0049b0 2020-04-22T14:11:12.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.481+0000 7f4d3effd700 1 -- 172.21.15.103:0/4027466929 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f4d480106c0 con 0x7f4d2c0049b0 2020-04-22T14:11:12.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.481+0000 7f4d51b3a700 1 --2- 172.21.15.103:0/4027466929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d2c0049b0 0x7f4d2c004dd0 secure :-1 s=THROTTLE_DONE pgs=896 cs=0 l=1 rx=0x7f4d48002620 tx=0x7f4d48011400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:12.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.481+0000 7f4d3effd700 1 --2- 172.21.15.103:0/4027466929 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4d2c055bb0 0x7f4d2c058070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:12.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.481+0000 7f4d3effd700 1 -- 172.21.15.103:0/4027466929 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f4d48061670 con 0x7f4d2c0049b0 2020-04-22T14:11:12.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.481+0000 7f4d51339700 1 --2- 172.21.15.103:0/4027466929 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4d2c055bb0 0x7f4d2c058070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:12.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.482+0000 7f4d51339700 1 --2- 172.21.15.103:0/4027466929 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4d2c055bb0 0x7f4d2c058070 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4d4c066130 tx=0x7f4d4c0676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:12.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.482+0000 7f4d51339700 1 --2- 172.21.15.103:0/4027466929 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4d2c055bb0 0x7f4d2c058070 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4d4c066130 tx=0x7f4d4c0676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:12.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.482+0000 7f4d51339700 1 --2- 172.21.15.103:0/4027466929 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4d2c055bb0 0x7f4d2c058070 secure :-1 s=READY pgs=338 cs=0 l=1 rx=0x7f4d4c066130 tx=0x7f4d4c0676e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:12.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.485+0000 7f4d51b3a700 1 --2- 172.21.15.103:0/4027466929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d2c0049b0 0x7f4d2c004dd0 secure :-1 s=THROTTLE_DONE pgs=896 cs=0 l=1 rx=0x7f4d48002620 tx=0x7f4d48011400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:12.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.485+0000 7f4d3effd700 1 -- 172.21.15.103:0/4027466929 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f4d4c153760 con 0x7f4d2c0049b0 2020-04-22T14:11:12.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.682+0000 7f4d53d9e700 1 -- 172.21.15.103:0/4027466929 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d4c153760 con 0x7f4d2c0049b0 2020-04-22T14:11:12.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.682+0000 7f4d51b3a700 1 --2- 172.21.15.103:0/4027466929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d2c0049b0 0x7f4d2c004dd0 secure :-1 s=THROTTLE_DONE pgs=896 cs=0 l=1 rx=0x7f4d48002620 tx=0x7f4d48011400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:12.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.682+0000 7f4d3effd700 1 -- 172.21.15.103:0/4027466929 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f4d4c153760 con 0x7f4d2c0049b0 2020-04-22T14:11:12.685 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:12.685 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/1837726033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1837726033},{"type":"v1","addr":"172.21.15.86:6835","nonce":1837726033}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:03.499587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:11:12.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.684+0000 7f4d53d9e700 1 -- 172.21.15.103:0/4027466929 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4d2c055bb0 msgr2=0x7f4d2c058070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:12.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.684+0000 7f4d53d9e700 1 --2- 172.21.15.103:0/4027466929 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4d2c055bb0 0x7f4d2c058070 secure :-1 s=READY pgs=338 cs=0 l=1 rx=0x7f4d4c066130 tx=0x7f4d4c0676e0).stop 2020-04-22T14:11:12.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.684+0000 7f4d53d9e700 1 -- 172.21.15.103:0/4027466929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d2c0049b0 msgr2=0x7f4d2c004dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:12.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.684+0000 7f4d53d9e700 1 --2- 172.21.15.103:0/4027466929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d2c0049b0 0x7f4d2c004dd0 secure :-1 s=READY pgs=896 cs=0 l=1 rx=0x7f4d48002620 tx=0x7f4d48011400).stop 2020-04-22T14:11:12.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.684+0000 7f4d5233b700 1 -- 172.21.15.103:0/4027466929 reap_dead start 2020-04-22T14:11:12.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.684+0000 7f4d5233b700 1 -- 172.21.15.103:0/4027466929 reap_dead start 2020-04-22T14:11:12.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.684+0000 7f4d53d9e700 1 -- 172.21.15.103:0/4027466929 shutdown_connections 2020-04-22T14:11:12.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.684+0000 7f4d53d9e700 1 -- 172.21.15.103:0/4027466929 >> 172.21.15.103:0/4027466929 conn(0x7f4d4c0b9160 msgr2=0x7f4d4c062020 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:12.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.684+0000 7f4d53d9e700 1 -- 172.21.15.103:0/4027466929 shutdown_connections 2020-04-22T14:11:12.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:12.684+0000 7f4d53d9e700 1 -- 172.21.15.103:0/4027466929 wait complete. 2020-04-22T14:11:12.688 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 41 2020-04-22T14:11:12.696 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:11:13.697 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:13.721 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:11:13.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.875+0000 7fe8505d6700 1 Processor -- start 2020-04-22T14:11:13.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.875+0000 7fe8505d6700 1 -- start start 2020-04-22T14:11:13.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.876+0000 7fe8505d6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe848140320 0x7fe8480ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:13.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.876+0000 7fe8505d6700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe8480bd1b0 0x7fe8480bd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:13.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.876+0000 7fe8505d6700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe84814a710 con 0x7fe84814a2b0 2020-04-22T14:11:13.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.876+0000 7fe8505d6700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8481462f0 con 0x7fe8480bd1b0 2020-04-22T14:11:13.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.876+0000 7fe8505d6700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe848146590 con 0x7fe848140320 2020-04-22T14:11:13.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.876+0000 7fe84e372700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe848140320 0x7fe8480ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:13.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.876+0000 7fe84eb73700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe8480bd1b0 0x7fe8480bd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:13.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.876+0000 7fe84e372700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe848140320 0x7fe8480ae1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:36560/0 (socket says 172.21.15.103:36560) 2020-04-22T14:11:13.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.876+0000 7fe84e372700 1 -- 172.21.15.103:0/3214830059 learned_addr learned my addr 172.21.15.103:0/3214830059 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:13.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.877+0000 7fe84e372700 1 -- 172.21.15.103:0/3214830059 >> v2:172.21.15.86:3300/0 conn(0x7fe8480bd1b0 msgr2=0x7fe8480bd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:13.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.877+0000 7fe84e372700 1 --2- 172.21.15.103:0/3214830059 >> v2:172.21.15.86:3300/0 conn(0x7fe8480bd1b0 0x7fe8480bd640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:13.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.877+0000 7fe84e372700 1 -- 172.21.15.103:0/3214830059 >> v1:172.21.15.86:6789/0 conn(0x7fe84814a2b0 legacy=0x7fe848146cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:13.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.877+0000 7fe84e372700 1 -- 172.21.15.103:0/3214830059 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe848146830 con 0x7fe848140320 2020-04-22T14:11:13.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.877+0000 7fe84e372700 1 --2- 172.21.15.103:0/3214830059 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe848140320 0x7fe8480ae1a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe83c002f30 tx=0x7fe83c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:13.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.877+0000 7fe84e372700 1 --2- 172.21.15.103:0/3214830059 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe848140320 0x7fe8480ae1a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe83c002f30 tx=0x7fe83c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:13.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.877+0000 7fe84e372700 1 --2- 172.21.15.103:0/3214830059 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe848140320 0x7fe8480ae1a0 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7fe83c002f30 tx=0x7fe83c007a40).ready entity=mon.2 client_cookie=2b4a55620d2e8408 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:13.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.877+0000 7fe84e372700 1 --2- 172.21.15.103:0/3214830059 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe848140320 0x7fe8480ae1a0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7fe83c002f30 tx=0x7fe83c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:13.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.877+0000 7fe84d370700 1 -- 172.21.15.103:0/3214830059 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe83c011670 con 0x7fe848140320 2020-04-22T14:11:13.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.877+0000 7fe84e372700 1 --2- 172.21.15.103:0/3214830059 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe848140320 0x7fe8480ae1a0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7fe83c002f30 tx=0x7fe83c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:13.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.877+0000 7fe84e372700 1 --2- 172.21.15.103:0/3214830059 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe848140320 0x7fe8480ae1a0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7fe83c002f30 tx=0x7fe83c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:13.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.877+0000 7fe84d370700 1 -- 172.21.15.103:0/3214830059 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83c011810 con 0x7fe848140320 2020-04-22T14:11:13.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.877+0000 7fe84d370700 1 -- 172.21.15.103:0/3214830059 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe83c011c30 con 0x7fe848140320 2020-04-22T14:11:13.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.877+0000 7fe8505d6700 1 -- 172.21.15.103:0/3214830059 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe848140320 msgr2=0x7fe8480ae1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:13.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.877+0000 7fe8505d6700 1 --2- 172.21.15.103:0/3214830059 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe848140320 0x7fe8480ae1a0 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7fe83c002f30 tx=0x7fe83c007a40).stop 2020-04-22T14:11:13.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.878+0000 7fe8505d6700 1 -- 172.21.15.103:0/3214830059 shutdown_connections 2020-04-22T14:11:13.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.878+0000 7fe8505d6700 1 --2- 172.21.15.103:0/3214830059 >> v2:172.21.15.86:3300/0 conn(0x7fe8480bd1b0 0x7fe8480bd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:13.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.878+0000 7fe8505d6700 1 --2- 172.21.15.103:0/3214830059 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe848140320 0x7fe8480ae1a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:13.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.878+0000 7fe8505d6700 1 -- 172.21.15.103:0/3214830059 >> 172.21.15.103:0/3214830059 conn(0x7fe84805f2c0 msgr2=0x7fe8480bcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:13.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.878+0000 7fe8505d6700 1 -- 172.21.15.103:0/3214830059 shutdown_connections 2020-04-22T14:11:13.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.878+0000 7fe8505d6700 1 -- 172.21.15.103:0/3214830059 wait complete. 2020-04-22T14:11:13.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.879+0000 7fe8505d6700 1 Processor -- start 2020-04-22T14:11:13.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.879+0000 7fe8505d6700 1 -- start start 2020-04-22T14:11:13.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.879+0000 7fe8505d6700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe848140320 0x7fe848143360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:13.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.879+0000 7fe8505d6700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe84814a2b0 0x7fe848143960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:13.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.879+0000 7fe8505d6700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8480b2e60 con 0x7fe8480bd1b0 2020-04-22T14:11:13.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.879+0000 7fe8505d6700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe848154930 con 0x7fe848140320 2020-04-22T14:11:13.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.879+0000 7fe8505d6700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe848154bd0 con 0x7fe84814a2b0 2020-04-22T14:11:13.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.879+0000 7fe84eb73700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe84814a2b0 0x7fe848143960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:13.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.879+0000 7fe84e372700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe8480bd1b0 0x7fe8480b2750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43980/0 (socket says 172.21.15.103:43980) 2020-04-22T14:11:13.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.879+0000 7fe84eb73700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe84814a2b0 0x7fe848143960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51792/0 (socket says 172.21.15.103:51792) 2020-04-22T14:11:13.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.879+0000 7fe84e372700 1 -- 172.21.15.103:0/3195735061 learned_addr learned my addr 172.21.15.103:0/3195735061 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:13.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.879+0000 7fe84db71700 1 --2- 172.21.15.103:0/3195735061 >> v2:172.21.15.86:3300/0 conn(0x7fe848140320 0x7fe848143360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:13.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.880+0000 7fe84eb73700 1 -- 172.21.15.103:0/3195735061 >> v2:172.21.15.86:3300/0 conn(0x7fe848140320 msgr2=0x7fe848143360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:13.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.880+0000 7fe84eb73700 1 --2- 172.21.15.103:0/3195735061 >> v2:172.21.15.86:3300/0 conn(0x7fe848140320 0x7fe848143360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:13.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.880+0000 7fe84eb73700 1 -- 172.21.15.103:0/3195735061 >> v1:172.21.15.103:6789/0 conn(0x7fe8480bd1b0 legacy=0x7fe8480b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:13.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.880+0000 7fe83b7fe700 1 -- 172.21.15.103:0/3195735061 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2517844801 0 0) 0x7fe8480b2e60 con 0x7fe8480bd1b0 2020-04-22T14:11:13.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.880+0000 7fe84eb73700 1 -- 172.21.15.103:0/3195735061 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8481572c0 con 0x7fe84814a2b0 2020-04-22T14:11:13.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.880+0000 7fe84eb73700 1 --2- 172.21.15.103:0/3195735061 >> v2:172.21.15.103:3300/0 conn(0x7fe84814a2b0 0x7fe848143960 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe8400032b0 tx=0x7fe840010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:13.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.880+0000 7fe84eb73700 1 --2- 172.21.15.103:0/3195735061 >> v2:172.21.15.103:3300/0 conn(0x7fe84814a2b0 0x7fe848143960 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe8400032b0 tx=0x7fe840010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:13.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.880+0000 7fe84eb73700 1 --2- 172.21.15.103:0/3195735061 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe84814a2b0 0x7fe848143960 secure :-1 s=READY pgs=898 cs=0 l=1 rx=0x7fe8400032b0 tx=0x7fe840010ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:13.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.880+0000 7fe84eb73700 1 --2- 172.21.15.103:0/3195735061 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe84814a2b0 0x7fe848143960 secure :-1 s=THROTTLE_DONE pgs=898 cs=0 l=1 rx=0x7fe8400032b0 tx=0x7fe840010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:13.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.880+0000 7fe83b7fe700 1 -- 172.21.15.103:0/3195735061 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe84000e370 con 0x7fe84814a2b0 2020-04-22T14:11:13.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.880+0000 7fe84eb73700 1 --2- 172.21.15.103:0/3195735061 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe84814a2b0 0x7fe848143960 secure :-1 s=THROTTLE_DONE pgs=898 cs=0 l=1 rx=0x7fe8400032b0 tx=0x7fe840010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:13.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.880+0000 7fe83b7fe700 1 -- 172.21.15.103:0/3195735061 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe840005c30 con 0x7fe84814a2b0 2020-04-22T14:11:13.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.880+0000 7fe84eb73700 1 --2- 172.21.15.103:0/3195735061 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe84814a2b0 0x7fe848143960 secure :-1 s=THROTTLE_DONE pgs=898 cs=0 l=1 rx=0x7fe8400032b0 tx=0x7fe840010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:13.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.880+0000 7fe8505d6700 1 -- 172.21.15.103:0/3195735061 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe84813f830 con 0x7fe84814a2b0 2020-04-22T14:11:13.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.880+0000 7fe83b7fe700 1 -- 172.21.15.103:0/3195735061 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe840012910 con 0x7fe84814a2b0 2020-04-22T14:11:13.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.880+0000 7fe8505d6700 1 -- 172.21.15.103:0/3195735061 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8481486d0 con 0x7fe84814a2b0 2020-04-22T14:11:13.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.881+0000 7fe84eb73700 1 --2- 172.21.15.103:0/3195735061 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe84814a2b0 0x7fe848143960 secure :-1 s=THROTTLE_DONE pgs=898 cs=0 l=1 rx=0x7fe8400032b0 tx=0x7fe840010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:13.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.881+0000 7fe83b7fe700 1 -- 172.21.15.103:0/3195735061 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fe840012b10 con 0x7fe84814a2b0 2020-04-22T14:11:13.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.881+0000 7fe84eb73700 1 --2- 172.21.15.103:0/3195735061 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe84814a2b0 0x7fe848143960 secure :-1 s=THROTTLE_DONE pgs=898 cs=0 l=1 rx=0x7fe8400032b0 tx=0x7fe840010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:13.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.881+0000 7fe8505d6700 1 -- 172.21.15.103:0/3195735061 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe848154780 con 0x7fe84814a2b0 2020-04-22T14:11:13.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.881+0000 7fe83b7fe700 1 --2- 172.21.15.103:0/3195735061 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe82804d820 0x7fe82804fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:13.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.881+0000 7fe83b7fe700 1 -- 172.21.15.103:0/3195735061 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fe840061380 con 0x7fe84814a2b0 2020-04-22T14:11:13.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.882+0000 7fe84e372700 1 --2- 172.21.15.103:0/3195735061 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe82804d820 0x7fe82804fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:13.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.882+0000 7fe84e372700 1 --2- 172.21.15.103:0/3195735061 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe82804d820 0x7fe82804fce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe83c008320 tx=0x7fe83c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:13.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.882+0000 7fe84e372700 1 --2- 172.21.15.103:0/3195735061 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe82804d820 0x7fe82804fce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe83c008320 tx=0x7fe83c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:13.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.882+0000 7fe84e372700 1 --2- 172.21.15.103:0/3195735061 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe82804d820 0x7fe82804fce0 secure :-1 s=READY pgs=339 cs=0 l=1 rx=0x7fe83c008320 tx=0x7fe83c007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:13.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.885+0000 7fe84eb73700 1 --2- 172.21.15.103:0/3195735061 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe84814a2b0 0x7fe848143960 secure :-1 s=THROTTLE_DONE pgs=898 cs=0 l=1 rx=0x7fe8400032b0 tx=0x7fe840010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:13.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:13.885+0000 7fe83b7fe700 1 -- 172.21.15.103:0/3195735061 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fe84003c700 con 0x7fe84814a2b0 2020-04-22T14:11:14.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:14.073+0000 7fe8505d6700 1 -- 172.21.15.103:0/3195735061 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe848056c90 con 0x7fe84814a2b0 2020-04-22T14:11:14.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:14.073+0000 7fe84eb73700 1 --2- 172.21.15.103:0/3195735061 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe84814a2b0 0x7fe848143960 secure :-1 s=THROTTLE_DONE pgs=898 cs=0 l=1 rx=0x7fe8400032b0 tx=0x7fe840010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:14.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:14.073+0000 7fe83b7fe700 1 -- 172.21.15.103:0/3195735061 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2147 (secure 0 0 0) 0x7fe84003fd20 con 0x7fe84814a2b0 2020-04-22T14:11:14.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:14.075+0000 7fe8505d6700 1 -- 172.21.15.103:0/3195735061 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe82804d820 msgr2=0x7fe82804fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:14.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:14.075+0000 7fe8505d6700 1 --2- 172.21.15.103:0/3195735061 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe82804d820 0x7fe82804fce0 secure :-1 s=READY pgs=339 cs=0 l=1 rx=0x7fe83c008320 tx=0x7fe83c007a40).stop 2020-04-22T14:11:14.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:14.075+0000 7fe8505d6700 1 -- 172.21.15.103:0/3195735061 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe84814a2b0 msgr2=0x7fe848143960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:14.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:14.075+0000 7fe8505d6700 1 --2- 172.21.15.103:0/3195735061 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe84814a2b0 0x7fe848143960 secure :-1 s=READY pgs=898 cs=0 l=1 rx=0x7fe8400032b0 tx=0x7fe840010ec0).stop 2020-04-22T14:11:14.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:14.075+0000 7fe8505d6700 1 -- 172.21.15.103:0/3195735061 shutdown_connections 2020-04-22T14:11:14.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:14.075+0000 7fe8505d6700 1 --2- 172.21.15.103:0/3195735061 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe84814a2b0 0x7fe848143960 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:14.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:14.075+0000 7fe8505d6700 1 --2- 172.21.15.103:0/3195735061 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe82804d820 0x7fe82804fce0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:14.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:14.075+0000 7fe8505d6700 1 --2- 172.21.15.103:0/3195735061 >> v2:172.21.15.86:3300/0 conn(0x7fe848140320 0x7fe848143360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:14.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:14.075+0000 7fe8505d6700 1 -- 172.21.15.103:0/3195735061 >> 172.21.15.103:0/3195735061 conn(0x7fe84805f2c0 msgr2=0x7fe84805ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:14.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:14.075+0000 7fe8505d6700 1 -- 172.21.15.103:0/3195735061 shutdown_connections 2020-04-22T14:11:14.087 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:14.075+0000 7fe8505d6700 1 -- 172.21.15.103:0/3195735061 wait complete. 2020-04-22T14:11:14.087 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 41 2020-04-22T14:11:14.087 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:14.087 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/1837726033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1837726033},{"type":"v1","addr":"172.21.15.86:6835","nonce":1837726033}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:03.499587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:11:14.088 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:11:15.089 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:15.105 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:11:15.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.259+0000 7fd79bb62700 1 Processor -- start 2020-04-22T14:11:15.263 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.260+0000 7fd79bb62700 1 -- start start 2020-04-22T14:11:15.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.260+0000 7fd79bb62700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd7940b6040 0x7fd7940ac740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:15.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.260+0000 7fd79bb62700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd794064ec0 con 0x7fd794067170 2020-04-22T14:11:15.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.260+0000 7fd79bb62700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd794146870 con 0x7fd7941426d0 2020-04-22T14:11:15.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.260+0000 7fd79bb62700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd794065af0 con 0x7fd7940b6040 2020-04-22T14:11:15.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.261+0000 7fd7990fd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd7940b6040 0x7fd7940ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:15.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.261+0000 7fd79a0ff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd7941426d0 0x7fd794142b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43986/0 (socket says 172.21.15.103:43986) 2020-04-22T14:11:15.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.261+0000 7fd79a0ff700 1 -- 172.21.15.103:0/842264583 learned_addr learned my addr 172.21.15.103:0/842264583 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:15.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.261+0000 7fd7990fd700 1 -- 172.21.15.103:0/842264583 >> v1:172.21.15.103:6789/0 conn(0x7fd7941426d0 legacy=0x7fd794142b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:15.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.261+0000 7fd7990fd700 1 -- 172.21.15.103:0/842264583 >> v1:172.21.15.86:6789/0 conn(0x7fd794067170 legacy=0x7fd79413c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:15.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.261+0000 7fd7988fc700 1 -- 172.21.15.103:0/842264583 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1819876084 0 0) 0x7fd794146870 con 0x7fd7941426d0 2020-04-22T14:11:15.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.261+0000 7fd7990fd700 1 -- 172.21.15.103:0/842264583 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd794067550 con 0x7fd7940b6040 2020-04-22T14:11:15.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.261+0000 7fd7990fd700 1 --2- 172.21.15.103:0/842264583 >> v2:172.21.15.103:3300/0 conn(0x7fd7940b6040 0x7fd7940ac740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd794066130 tx=0x7fd790009980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:15.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.261+0000 7fd7990fd700 1 --2- 172.21.15.103:0/842264583 >> v2:172.21.15.103:3300/0 conn(0x7fd7940b6040 0x7fd7940ac740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd794066130 tx=0x7fd790009980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:15.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.261+0000 7fd7990fd700 1 --2- 172.21.15.103:0/842264583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7940b6040 0x7fd7940ac740 secure :-1 s=READY pgs=900 cs=0 l=1 rx=0x7fd794066130 tx=0x7fd790009980).ready entity=mon.1 client_cookie=62e4a3d515ef0841 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:15.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.261+0000 7fd7990fd700 1 --2- 172.21.15.103:0/842264583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7940b6040 0x7fd7940ac740 secure :-1 s=THROTTLE_DONE pgs=900 cs=0 l=1 rx=0x7fd794066130 tx=0x7fd790009980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:15.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.261+0000 7fd7988fc700 1 -- 172.21.15.103:0/842264583 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd790013ce0 con 0x7fd7940b6040 2020-04-22T14:11:15.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.261+0000 7fd7990fd700 1 --2- 172.21.15.103:0/842264583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7940b6040 0x7fd7940ac740 secure :-1 s=THROTTLE_DONE pgs=900 cs=0 l=1 rx=0x7fd794066130 tx=0x7fd790009980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:15.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.261+0000 7fd7988fc700 1 -- 172.21.15.103:0/842264583 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd790013e40 con 0x7fd7940b6040 2020-04-22T14:11:15.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.261+0000 7fd7990fd700 1 --2- 172.21.15.103:0/842264583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7940b6040 0x7fd7940ac740 secure :-1 s=THROTTLE_DONE pgs=900 cs=0 l=1 rx=0x7fd794066130 tx=0x7fd790009980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:15.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.261+0000 7fd7988fc700 1 -- 172.21.15.103:0/842264583 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd79000d370 con 0x7fd7940b6040 2020-04-22T14:11:15.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.261+0000 7fd79bb62700 1 -- 172.21.15.103:0/842264583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7940b6040 msgr2=0x7fd7940ac740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:15.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.261+0000 7fd79bb62700 1 --2- 172.21.15.103:0/842264583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7940b6040 0x7fd7940ac740 secure :-1 s=READY pgs=900 cs=0 l=1 rx=0x7fd794066130 tx=0x7fd790009980).stop 2020-04-22T14:11:15.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.262+0000 7fd79bb62700 1 -- 172.21.15.103:0/842264583 shutdown_connections 2020-04-22T14:11:15.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.262+0000 7fd79bb62700 1 --2- 172.21.15.103:0/842264583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7940b6040 0x7fd7940ac740 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:15.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.262+0000 7fd79bb62700 1 -- 172.21.15.103:0/842264583 >> 172.21.15.103:0/842264583 conn(0x7fd7940b9160 msgr2=0x7fd79405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:15.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.262+0000 7fd79bb62700 1 -- 172.21.15.103:0/842264583 shutdown_connections 2020-04-22T14:11:15.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.262+0000 7fd79bb62700 1 -- 172.21.15.103:0/842264583 wait complete. 2020-04-22T14:11:15.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.263+0000 7fd79bb62700 1 Processor -- start 2020-04-22T14:11:15.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.263+0000 7fd79bb62700 1 -- start start 2020-04-22T14:11:15.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.263+0000 7fd79bb62700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd7941426d0 0x7fd794145510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:15.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.263+0000 7fd79bb62700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7941532c0 con 0x7fd794067170 2020-04-22T14:11:15.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.263+0000 7fd79bb62700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd794153560 con 0x7fd7940b6040 2020-04-22T14:11:15.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.263+0000 7fd79bb62700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd794153a00 con 0x7fd7941426d0 2020-04-22T14:11:15.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.264+0000 7fd7990fd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd7940b6040 0x7fd79413c270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:43992/0 (socket says 172.21.15.103:43992) 2020-04-22T14:11:15.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.264+0000 7fd7990fd700 1 -- 172.21.15.103:0/2217718813 learned_addr learned my addr 172.21.15.103:0/2217718813 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:15.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.264+0000 7fd79a0ff700 1 --2- 172.21.15.103:0/2217718813 >> v2:172.21.15.86:3300/0 conn(0x7fd7941426d0 0x7fd794145510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:15.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.264+0000 7fd782ffd700 1 -- 172.21.15.103:0/2217718813 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 559652828 0 0) 0x7fd794153560 con 0x7fd7940b6040 2020-04-22T14:11:15.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.264+0000 7fd782ffd700 1 -- 172.21.15.103:0/2217718813 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd774002fe0 con 0x7fd7940b6040 2020-04-22T14:11:15.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.264+0000 7fd782ffd700 1 -- 172.21.15.103:0/2217718813 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3383882982 0 0) 0x7fd7941532c0 con 0x7fd794067170 2020-04-22T14:11:15.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.264+0000 7fd782ffd700 1 -- 172.21.15.103:0/2217718813 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd794153560 con 0x7fd794067170 2020-04-22T14:11:15.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.264+0000 7fd782ffd700 1 -- 172.21.15.103:0/2217718813 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1461146324 0 0) 0x7fd774002fe0 con 0x7fd7940b6040 2020-04-22T14:11:15.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.264+0000 7fd782ffd700 1 -- 172.21.15.103:0/2217718813 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd7941532c0 con 0x7fd7940b6040 2020-04-22T14:11:15.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.264+0000 7fd782ffd700 1 -- 172.21.15.103:0/2217718813 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fd790002f30 con 0x7fd7940b6040 2020-04-22T14:11:15.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.264+0000 7fd782ffd700 1 -- 172.21.15.103:0/2217718813 >> v2:172.21.15.86:3300/0 conn(0x7fd7941426d0 msgr2=0x7fd794145510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:15.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.264+0000 7fd782ffd700 1 --2- 172.21.15.103:0/2217718813 >> v2:172.21.15.86:3300/0 conn(0x7fd7941426d0 0x7fd794145510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:15.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.264+0000 7fd782ffd700 1 -- 172.21.15.103:0/2217718813 >> v1:172.21.15.103:6789/0 conn(0x7fd7940b6040 legacy=0x7fd79413c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:15.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.264+0000 7fd782ffd700 1 -- 172.21.15.103:0/2217718813 >> v1:172.21.15.86:6789/0 conn(0x7fd794067170 legacy=0x7fd794134cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:15.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.264+0000 7fd782ffd700 1 --2- 172.21.15.103:0/2217718813 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd774004b20 0x7fd774004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:15.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.264+0000 7fd782ffd700 1 --2- 172.21.15.103:0/2217718813 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd774003ab0 0x7fd774003f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:15.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.264+0000 7fd782ffd700 1 --2- 172.21.15.103:0/2217718813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd774004370 0x7fd77400b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:15.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.264+0000 7fd782ffd700 1 -- 172.21.15.103:0/2217718813 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd794153a00 con 0x7fd774003ab0 2020-04-22T14:11:15.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.264+0000 7fd782ffd700 1 -- 172.21.15.103:0/2217718813 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77400bbb0 con 0x7fd774004370 2020-04-22T14:11:15.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.264+0000 7fd782ffd700 1 -- 172.21.15.103:0/2217718813 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd77400bcf0 con 0x7fd774004b20 2020-04-22T14:11:15.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.264+0000 7fd79a0ff700 1 --2- 172.21.15.103:0/2217718813 >> v2:172.21.15.86:3300/0 conn(0x7fd7941426d0 0x7fd794145510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:11:15.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.264+0000 7fd79a0ff700 1 --2- 172.21.15.103:0/2217718813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd774004370 0x7fd77400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:15.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.264+0000 7fd7990fd700 1 --2- 172.21.15.103:0/2217718813 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd774003ab0 0x7fd774003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:15.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.264+0000 7fd7998fe700 1 --2- 172.21.15.103:0/2217718813 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd774004b20 0x7fd774004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:15.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.265+0000 7fd79a0ff700 1 -- 172.21.15.103:0/2217718813 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd774004b20 msgr2=0x7fd774004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:15.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.265+0000 7fd79a0ff700 1 --2- 172.21.15.103:0/2217718813 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd774004b20 0x7fd774004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:15.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.265+0000 7fd79a0ff700 1 -- 172.21.15.103:0/2217718813 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd774003ab0 msgr2=0x7fd774003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:15.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.265+0000 7fd79a0ff700 1 --2- 172.21.15.103:0/2217718813 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd774003ab0 0x7fd774003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:15.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.265+0000 7fd79a0ff700 1 -- 172.21.15.103:0/2217718813 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd79413a680 con 0x7fd774004370 2020-04-22T14:11:15.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.265+0000 7fd79bb62700 1 -- 172.21.15.103:0/2217718813 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd794152bf0 con 0x7fd774004370 2020-04-22T14:11:15.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.265+0000 7fd79bb62700 1 -- 172.21.15.103:0/2217718813 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7941355c0 con 0x7fd774004370 2020-04-22T14:11:15.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.265+0000 7fd79a0ff700 1 --2- 172.21.15.103:0/2217718813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd774004370 0x7fd77400b750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd78c001210 tx=0x7fd774004a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:15.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.265+0000 7fd79a0ff700 1 -- 172.21.15.103:0/2217718813 reap_dead start 2020-04-22T14:11:15.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.265+0000 7fd79a0ff700 1 --2- 172.21.15.103:0/2217718813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd774004370 0x7fd77400b750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd78c001210 tx=0x7fd774004a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:15.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.265+0000 7fd79a0ff700 1 --2- 172.21.15.103:0/2217718813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd774004370 0x7fd77400b750 secure :-1 s=READY pgs=902 cs=0 l=1 rx=0x7fd78c001210 tx=0x7fd774004a60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:15.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.265+0000 7fd79a0ff700 1 --2- 172.21.15.103:0/2217718813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd774004370 0x7fd77400b750 secure :-1 s=THROTTLE_DONE pgs=902 cs=0 l=1 rx=0x7fd78c001210 tx=0x7fd774004a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:15.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.265+0000 7fd79a0ff700 1 --2- 172.21.15.103:0/2217718813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd774004370 0x7fd77400b750 secure :-1 s=THROTTLE_DONE pgs=902 cs=0 l=1 rx=0x7fd78c001210 tx=0x7fd774004a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:15.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.265+0000 7fd782ffd700 1 -- 172.21.15.103:0/2217718813 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd78c001d50 con 0x7fd774004370 2020-04-22T14:11:15.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.265+0000 7fd79a0ff700 1 --2- 172.21.15.103:0/2217718813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd774004370 0x7fd77400b750 secure :-1 s=THROTTLE_DONE pgs=902 cs=0 l=1 rx=0x7fd78c001210 tx=0x7fd774004a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:15.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.265+0000 7fd782ffd700 1 -- 172.21.15.103:0/2217718813 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78c001eb0 con 0x7fd774004370 2020-04-22T14:11:15.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.265+0000 7fd782ffd700 1 -- 172.21.15.103:0/2217718813 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd78c005b30 con 0x7fd774004370 2020-04-22T14:11:15.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.265+0000 7fd79a0ff700 1 --2- 172.21.15.103:0/2217718813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd774004370 0x7fd77400b750 secure :-1 s=THROTTLE_DONE pgs=902 cs=0 l=1 rx=0x7fd78c001210 tx=0x7fd774004a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:15.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.266+0000 7fd782ffd700 1 -- 172.21.15.103:0/2217718813 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fd78c005c90 con 0x7fd774004370 2020-04-22T14:11:15.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.266+0000 7fd79a0ff700 1 --2- 172.21.15.103:0/2217718813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd774004370 0x7fd77400b750 secure :-1 s=THROTTLE_DONE pgs=902 cs=0 l=1 rx=0x7fd78c001210 tx=0x7fd774004a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:15.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.266+0000 7fd79bb62700 1 -- 172.21.15.103:0/2217718813 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd794152f00 con 0x7fd774004370 2020-04-22T14:11:15.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.266+0000 7fd782ffd700 1 --2- 172.21.15.103:0/2217718813 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd774051a50 0x7fd774053f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:15.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.266+0000 7fd782ffd700 1 -- 172.21.15.103:0/2217718813 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fd78c0100c0 con 0x7fd774004370 2020-04-22T14:11:15.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.266+0000 7fd7998fe700 1 --2- 172.21.15.103:0/2217718813 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd774051a50 0x7fd774053f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:15.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.267+0000 7fd7998fe700 1 --2- 172.21.15.103:0/2217718813 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd774051a50 0x7fd774053f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd784000e90 tx=0x7fd78400c640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:15.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.267+0000 7fd7998fe700 1 --2- 172.21.15.103:0/2217718813 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd774051a50 0x7fd774053f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd784000e90 tx=0x7fd78400c640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:15.289 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.267+0000 7fd7998fe700 1 --2- 172.21.15.103:0/2217718813 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd774051a50 0x7fd774053f10 secure :-1 s=READY pgs=340 cs=0 l=1 rx=0x7fd784000e90 tx=0x7fd78400c640).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:15.289 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.270+0000 7fd79a0ff700 1 --2- 172.21.15.103:0/2217718813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd774004370 0x7fd77400b750 secure :-1 s=THROTTLE_DONE pgs=902 cs=0 l=1 rx=0x7fd78c001210 tx=0x7fd774004a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:15.289 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.270+0000 7fd782ffd700 1 -- 172.21.15.103:0/2217718813 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fd78c03c560 con 0x7fd774004370 2020-04-22T14:11:15.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.459+0000 7fd79bb62700 1 -- 172.21.15.103:0/2217718813 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd794056c90 con 0x7fd774004370 2020-04-22T14:11:15.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.459+0000 7fd79a0ff700 1 --2- 172.21.15.103:0/2217718813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd774004370 0x7fd77400b750 secure :-1 s=THROTTLE_DONE pgs=902 cs=0 l=1 rx=0x7fd78c001210 tx=0x7fd774004a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:15.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.459+0000 7fd782ffd700 1 -- 172.21.15.103:0/2217718813 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2147 (secure 0 0 0) 0x7fd78c03fb80 con 0x7fd774004370 2020-04-22T14:11:15.463 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:15.464 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/1837726033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1837726033},{"type":"v1","addr":"172.21.15.86:6835","nonce":1837726033}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:03.499587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:11:15.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.460+0000 7fd79bb62700 1 -- 172.21.15.103:0/2217718813 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd774051a50 msgr2=0x7fd774053f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:15.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.460+0000 7fd79bb62700 1 --2- 172.21.15.103:0/2217718813 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd774051a50 0x7fd774053f10 secure :-1 s=READY pgs=340 cs=0 l=1 rx=0x7fd784000e90 tx=0x7fd78400c640).stop 2020-04-22T14:11:15.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.460+0000 7fd79bb62700 1 -- 172.21.15.103:0/2217718813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd774004370 msgr2=0x7fd77400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:15.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.460+0000 7fd79bb62700 1 --2- 172.21.15.103:0/2217718813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd774004370 0x7fd77400b750 secure :-1 s=READY pgs=902 cs=0 l=1 rx=0x7fd78c001210 tx=0x7fd774004a60).stop 2020-04-22T14:11:15.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.461+0000 7fd79bb62700 1 -- 172.21.15.103:0/2217718813 shutdown_connections 2020-04-22T14:11:15.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.461+0000 7fd79bb62700 1 --2- 172.21.15.103:0/2217718813 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd774051a50 0x7fd774053f10 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:15.466 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.461+0000 7fd79bb62700 1 --2- 172.21.15.103:0/2217718813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd774004370 0x7fd77400b750 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:15.466 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.461+0000 7fd79bb62700 1 -- 172.21.15.103:0/2217718813 >> 172.21.15.103:0/2217718813 conn(0x7fd7940b9160 msgr2=0x7fd794062020 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:15.466 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.461+0000 7fd79bb62700 1 -- 172.21.15.103:0/2217718813 shutdown_connections 2020-04-22T14:11:15.466 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:15.461+0000 7fd79bb62700 1 -- 172.21.15.103:0/2217718813 wait complete. 2020-04-22T14:11:15.466 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 41 2020-04-22T14:11:15.474 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:11:16.475 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:16.491 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:11:16.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.646+0000 7f1d58cae700 1 Processor -- start 2020-04-22T14:11:16.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.646+0000 7f1d58cae700 1 -- start start 2020-04-22T14:11:16.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.647+0000 7f1d58cae700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1d5412c0d0 0x7f1d541464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:16.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.647+0000 7f1d58cae700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1d54065fe0 0x7f1d5405b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:16.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.647+0000 7f1d58cae700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d5405b8a0 0x7f1d54062ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:16.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.647+0000 7f1d58cae700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d5412c4b0 con 0x7f1d54065fe0 2020-04-22T14:11:16.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.647+0000 7f1d58cae700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d54143300 con 0x7f1d5412c0d0 2020-04-22T14:11:16.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.647+0000 7f1d58cae700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d541435a0 con 0x7f1d5405b8a0 2020-04-22T14:11:16.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.647+0000 7f1d5259c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1d5412c0d0 0x7f1d541464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:16.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.647+0000 7f1d5259c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1d5412c0d0 0x7f1d541464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51814/0 (socket says 172.21.15.103:51814) 2020-04-22T14:11:16.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.647+0000 7f1d5259c700 1 -- 172.21.15.103:0/3226469797 learned_addr learned my addr 172.21.15.103:0/3226469797 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:16.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.647+0000 7f1d52d9d700 1 --2- 172.21.15.103:0/3226469797 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d5405b8a0 0x7f1d54062ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:16.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.647+0000 7f1d51d9b700 1 --2- 172.21.15.103:0/3226469797 >> v2:172.21.15.86:3300/0 conn(0x7f1d54065fe0 0x7f1d5405b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:16.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.647+0000 7f1d5259c700 1 -- 172.21.15.103:0/3226469797 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d5405b8a0 msgr2=0x7f1d54062ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:16.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.647+0000 7f1d5259c700 1 --2- 172.21.15.103:0/3226469797 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d5405b8a0 0x7f1d54062ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:16.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.647+0000 7f1d5259c700 1 -- 172.21.15.103:0/3226469797 >> v2:172.21.15.86:3300/0 conn(0x7f1d54065fe0 msgr2=0x7f1d5405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:16.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.647+0000 7f1d5259c700 1 --2- 172.21.15.103:0/3226469797 >> v2:172.21.15.86:3300/0 conn(0x7f1d54065fe0 0x7f1d5405b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:16.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.647+0000 7f1d5259c700 1 -- 172.21.15.103:0/3226469797 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d54143840 con 0x7f1d5412c0d0 2020-04-22T14:11:16.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.647+0000 7f1d51d9b700 1 --2- 172.21.15.103:0/3226469797 >> v2:172.21.15.86:3300/0 conn(0x7f1d54065fe0 0x7f1d5405b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:11:16.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.648+0000 7f1d5259c700 1 --2- 172.21.15.103:0/3226469797 >> v2:172.21.15.103:3300/0 conn(0x7f1d5412c0d0 0x7f1d541464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1d48002f30 tx=0x7f1d48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:16.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.648+0000 7f1d5259c700 1 --2- 172.21.15.103:0/3226469797 >> v2:172.21.15.103:3300/0 conn(0x7f1d5412c0d0 0x7f1d541464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1d48002f30 tx=0x7f1d48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:16.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.648+0000 7f1d5259c700 1 --2- 172.21.15.103:0/3226469797 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d5412c0d0 0x7f1d541464e0 secure :-1 s=READY pgs=903 cs=0 l=1 rx=0x7f1d48002f30 tx=0x7f1d48007a40).ready entity=mon.1 client_cookie=af6a890338eae4fd server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:16.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.648+0000 7f1d5259c700 1 --2- 172.21.15.103:0/3226469797 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d5412c0d0 0x7f1d541464e0 secure :-1 s=THROTTLE_DONE pgs=903 cs=0 l=1 rx=0x7f1d48002f30 tx=0x7f1d48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:16.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.648+0000 7f1d5159a700 1 -- 172.21.15.103:0/3226469797 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d48011720 con 0x7f1d5412c0d0 2020-04-22T14:11:16.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.648+0000 7f1d5259c700 1 --2- 172.21.15.103:0/3226469797 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d5412c0d0 0x7f1d541464e0 secure :-1 s=THROTTLE_DONE pgs=903 cs=0 l=1 rx=0x7f1d48002f30 tx=0x7f1d48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:16.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.648+0000 7f1d5259c700 1 --2- 172.21.15.103:0/3226469797 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d5412c0d0 0x7f1d541464e0 secure :-1 s=THROTTLE_DONE pgs=903 cs=0 l=1 rx=0x7f1d48002f30 tx=0x7f1d48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:16.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.648+0000 7f1d5159a700 1 -- 172.21.15.103:0/3226469797 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d48011880 con 0x7f1d5412c0d0 2020-04-22T14:11:16.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.648+0000 7f1d5159a700 1 -- 172.21.15.103:0/3226469797 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d48011ca0 con 0x7f1d5412c0d0 2020-04-22T14:11:16.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.648+0000 7f1d58cae700 1 -- 172.21.15.103:0/3226469797 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d5412c0d0 msgr2=0x7f1d541464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:16.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.648+0000 7f1d58cae700 1 --2- 172.21.15.103:0/3226469797 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d5412c0d0 0x7f1d541464e0 secure :-1 s=READY pgs=903 cs=0 l=1 rx=0x7f1d48002f30 tx=0x7f1d48007a40).stop 2020-04-22T14:11:16.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.648+0000 7f1d58cae700 1 -- 172.21.15.103:0/3226469797 shutdown_connections 2020-04-22T14:11:16.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.648+0000 7f1d58cae700 1 --2- 172.21.15.103:0/3226469797 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d5405b8a0 0x7f1d54062ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:16.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.648+0000 7f1d58cae700 1 --2- 172.21.15.103:0/3226469797 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d5412c0d0 0x7f1d541464e0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:16.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.648+0000 7f1d58cae700 1 --2- 172.21.15.103:0/3226469797 >> v2:172.21.15.86:3300/0 conn(0x7f1d54065fe0 0x7f1d5405b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:16.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.648+0000 7f1d58cae700 1 -- 172.21.15.103:0/3226469797 >> 172.21.15.103:0/3226469797 conn(0x7f1d540b9160 msgr2=0x7f1d5405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:16.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.648+0000 7f1d58cae700 1 -- 172.21.15.103:0/3226469797 shutdown_connections 2020-04-22T14:11:16.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.648+0000 7f1d58cae700 1 -- 172.21.15.103:0/3226469797 wait complete. 2020-04-22T14:11:16.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.649+0000 7f1d58cae700 1 Processor -- start 2020-04-22T14:11:16.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.649+0000 7f1d58cae700 1 -- start start 2020-04-22T14:11:16.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.650+0000 7f1d58cae700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1d5405b8a0 0x7f1d5414bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:16.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.650+0000 7f1d58cae700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d541224e0 con 0x7f1d5412c0d0 2020-04-22T14:11:16.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.650+0000 7f1d58cae700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d5414c1f0 con 0x7f1d54065fe0 2020-04-22T14:11:16.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.650+0000 7f1d58cae700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d54128090 con 0x7f1d5405b8a0 2020-04-22T14:11:16.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.650+0000 7f1d5259c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1d5405b8a0 0x7f1d5414bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:16.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.650+0000 7f1d5259c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1d5405b8a0 0x7f1d5414bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51820/0 (socket says 172.21.15.103:51820) 2020-04-22T14:11:16.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.650+0000 7f1d5259c700 1 -- 172.21.15.103:0/532388012 learned_addr learned my addr 172.21.15.103:0/532388012 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:16.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.650+0000 7f1d51d9b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f1d54065fe0 0x7f1d54142210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44012/0 (socket says 172.21.15.103:44012) 2020-04-22T14:11:16.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.650+0000 7f1d5259c700 1 -- 172.21.15.103:0/532388012 >> v1:172.21.15.103:6789/0 conn(0x7f1d54065fe0 legacy=0x7f1d54142210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:16.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.650+0000 7f1d5259c700 1 -- 172.21.15.103:0/532388012 >> v1:172.21.15.86:6789/0 conn(0x7f1d5412c0d0 legacy=0x7f1d54122910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:16.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.650+0000 7f1d437fe700 1 -- 172.21.15.103:0/532388012 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3672373368 0 0) 0x7f1d44001ec0 con 0x7f1d54065fe0 2020-04-22T14:11:16.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.650+0000 7f1d5259c700 1 -- 172.21.15.103:0/532388012 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d54128330 con 0x7f1d5405b8a0 2020-04-22T14:11:16.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.650+0000 7f1d5259c700 1 --2- 172.21.15.103:0/532388012 >> v2:172.21.15.103:3300/0 conn(0x7f1d5405b8a0 0x7f1d5414bd90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1d48002f30 tx=0x7f1d48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:16.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.651+0000 7f1d5259c700 1 --2- 172.21.15.103:0/532388012 >> v2:172.21.15.103:3300/0 conn(0x7f1d5405b8a0 0x7f1d5414bd90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1d48002f30 tx=0x7f1d48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:16.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.651+0000 7f1d5259c700 1 --2- 172.21.15.103:0/532388012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d5405b8a0 0x7f1d5414bd90 secure :-1 s=READY pgs=905 cs=0 l=1 rx=0x7f1d48002f30 tx=0x7f1d48007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:16.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.651+0000 7f1d5259c700 1 --2- 172.21.15.103:0/532388012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d5405b8a0 0x7f1d5414bd90 secure :-1 s=THROTTLE_DONE pgs=905 cs=0 l=1 rx=0x7f1d48002f30 tx=0x7f1d48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:16.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.651+0000 7f1d437fe700 1 -- 172.21.15.103:0/532388012 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d48007170 con 0x7f1d5405b8a0 2020-04-22T14:11:16.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.651+0000 7f1d5259c700 1 --2- 172.21.15.103:0/532388012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d5405b8a0 0x7f1d5414bd90 secure :-1 s=THROTTLE_DONE pgs=905 cs=0 l=1 rx=0x7f1d48002f30 tx=0x7f1d48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:16.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.651+0000 7f1d5259c700 1 --2- 172.21.15.103:0/532388012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d5405b8a0 0x7f1d5414bd90 secure :-1 s=THROTTLE_DONE pgs=905 cs=0 l=1 rx=0x7f1d48002f30 tx=0x7f1d48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:16.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.651+0000 7f1d437fe700 1 -- 172.21.15.103:0/532388012 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d480072d0 con 0x7f1d5405b8a0 2020-04-22T14:11:16.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.651+0000 7f1d437fe700 1 -- 172.21.15.103:0/532388012 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d480056c0 con 0x7f1d5405b8a0 2020-04-22T14:11:16.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.651+0000 7f1d58cae700 1 -- 172.21.15.103:0/532388012 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d54142920 con 0x7f1d5405b8a0 2020-04-22T14:11:16.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.651+0000 7f1d58cae700 1 -- 172.21.15.103:0/532388012 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d54124040 con 0x7f1d5405b8a0 2020-04-22T14:11:16.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.651+0000 7f1d5259c700 1 --2- 172.21.15.103:0/532388012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d5405b8a0 0x7f1d5414bd90 secure :-1 s=THROTTLE_DONE pgs=905 cs=0 l=1 rx=0x7f1d48002f30 tx=0x7f1d48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:16.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.652+0000 7f1d437fe700 1 -- 172.21.15.103:0/532388012 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f1d48005870 con 0x7f1d5405b8a0 2020-04-22T14:11:16.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.652+0000 7f1d5259c700 1 --2- 172.21.15.103:0/532388012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d5405b8a0 0x7f1d5414bd90 secure :-1 s=THROTTLE_DONE pgs=905 cs=0 l=1 rx=0x7f1d48002f30 tx=0x7f1d48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:16.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.652+0000 7f1d58cae700 1 -- 172.21.15.103:0/532388012 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d54122670 con 0x7f1d5405b8a0 2020-04-22T14:11:16.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.652+0000 7f1d437fe700 1 --2- 172.21.15.103:0/532388012 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1d3004d8b0 0x7f1d3004fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:16.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.652+0000 7f1d437fe700 1 -- 172.21.15.103:0/532388012 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f1d48061ce0 con 0x7f1d5405b8a0 2020-04-22T14:11:16.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.652+0000 7f1d51d9b700 1 --2- 172.21.15.103:0/532388012 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1d3004d8b0 0x7f1d3004fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:16.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.652+0000 7f1d51d9b700 1 --2- 172.21.15.103:0/532388012 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1d3004d8b0 0x7f1d3004fd70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1d44003070 tx=0x7f1d44002500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:16.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.653+0000 7f1d51d9b700 1 --2- 172.21.15.103:0/532388012 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1d3004d8b0 0x7f1d3004fd70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1d44003070 tx=0x7f1d44002500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:16.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.653+0000 7f1d51d9b700 1 --2- 172.21.15.103:0/532388012 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1d3004d8b0 0x7f1d3004fd70 secure :-1 s=READY pgs=341 cs=0 l=1 rx=0x7f1d44003070 tx=0x7f1d44002500).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:16.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.656+0000 7f1d5259c700 1 --2- 172.21.15.103:0/532388012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d5405b8a0 0x7f1d5414bd90 secure :-1 s=THROTTLE_DONE pgs=905 cs=0 l=1 rx=0x7f1d48002f30 tx=0x7f1d48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:16.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.656+0000 7f1d437fe700 1 -- 172.21.15.103:0/532388012 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f1d54122670 con 0x7f1d5405b8a0 2020-04-22T14:11:16.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.846+0000 7f1d58cae700 1 -- 172.21.15.103:0/532388012 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d54122670 con 0x7f1d5405b8a0 2020-04-22T14:11:16.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.847+0000 7f1d5259c700 1 --2- 172.21.15.103:0/532388012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d5405b8a0 0x7f1d5414bd90 secure :-1 s=THROTTLE_DONE pgs=905 cs=0 l=1 rx=0x7f1d48002f30 tx=0x7f1d48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:16.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.847+0000 7f1d437fe700 1 -- 172.21.15.103:0/532388012 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f1d54122670 con 0x7f1d5405b8a0 2020-04-22T14:11:16.850 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:16.850 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/1837726033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1837726033},{"type":"v1","addr":"172.21.15.86:6835","nonce":1837726033}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:03.499587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:11:16.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.848+0000 7f1d58cae700 1 -- 172.21.15.103:0/532388012 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1d3004d8b0 msgr2=0x7f1d3004fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:16.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.848+0000 7f1d58cae700 1 --2- 172.21.15.103:0/532388012 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1d3004d8b0 0x7f1d3004fd70 secure :-1 s=READY pgs=341 cs=0 l=1 rx=0x7f1d44003070 tx=0x7f1d44002500).stop 2020-04-22T14:11:16.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.848+0000 7f1d58cae700 1 -- 172.21.15.103:0/532388012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d5405b8a0 msgr2=0x7f1d5414bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:16.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.848+0000 7f1d58cae700 1 --2- 172.21.15.103:0/532388012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d5405b8a0 0x7f1d5414bd90 secure :-1 s=READY pgs=905 cs=0 l=1 rx=0x7f1d48002f30 tx=0x7f1d48007a40).stop 2020-04-22T14:11:16.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.848+0000 7f1d58cae700 1 -- 172.21.15.103:0/532388012 shutdown_connections 2020-04-22T14:11:16.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.848+0000 7f1d58cae700 1 --2- 172.21.15.103:0/532388012 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1d3004d8b0 0x7f1d3004fd70 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:16.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.848+0000 7f1d58cae700 1 --2- 172.21.15.103:0/532388012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d5405b8a0 0x7f1d5414bd90 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:16.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.848+0000 7f1d58cae700 1 -- 172.21.15.103:0/532388012 >> 172.21.15.103:0/532388012 conn(0x7f1d540b9160 msgr2=0x7f1d54146330 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:16.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.848+0000 7f1d58cae700 1 -- 172.21.15.103:0/532388012 shutdown_connections 2020-04-22T14:11:16.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:16.848+0000 7f1d58cae700 1 -- 172.21.15.103:0/532388012 wait complete. 2020-04-22T14:11:16.853 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 41 2020-04-22T14:11:16.861 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:11:17.862 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:17.878 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:11:18.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.030+0000 7fab5bdb8700 1 Processor -- start 2020-04-22T14:11:18.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.030+0000 7fab5bdb8700 1 -- start start 2020-04-22T14:11:18.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.031+0000 7fab5bdb8700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fab54067170 0x7fab540b6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:18.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.031+0000 7fab5bdb8700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab541426d0 0x7fab54142b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:18.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.031+0000 7fab5bdb8700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab54064ec0 con 0x7fab540ac740 2020-04-22T14:11:18.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.031+0000 7fab5bdb8700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab54065af0 con 0x7fab54067170 2020-04-22T14:11:18.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.031+0000 7fab5bdb8700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab54146870 con 0x7fab541426d0 2020-04-22T14:11:18.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.031+0000 7fab59353700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fab540ac740 0x7fab5413c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44018/0 (socket says 172.21.15.103:44018) 2020-04-22T14:11:18.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.031+0000 7fab59353700 1 -- 172.21.15.103:0/2261966337 learned_addr learned my addr 172.21.15.103:0/2261966337 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:18.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.031+0000 7fab5a355700 1 --2- 172.21.15.103:0/2261966337 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab541426d0 0x7fab54142b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:18.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.031+0000 7fab59b54700 1 --2- 172.21.15.103:0/2261966337 >> v2:172.21.15.86:3300/0 conn(0x7fab54067170 0x7fab540b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:18.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.032+0000 7fab58b52700 1 -- 172.21.15.103:0/2261966337 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 606244262 0 0) 0x7fab54064ec0 con 0x7fab540ac740 2020-04-22T14:11:18.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.032+0000 7fab58b52700 1 -- 172.21.15.103:0/2261966337 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab3c003230 con 0x7fab540ac740 2020-04-22T14:11:18.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.032+0000 7fab5a355700 1 -- 172.21.15.103:0/2261966337 >> v2:172.21.15.86:3300/0 conn(0x7fab54067170 msgr2=0x7fab540b6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:18.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.032+0000 7fab5a355700 1 --2- 172.21.15.103:0/2261966337 >> v2:172.21.15.86:3300/0 conn(0x7fab54067170 0x7fab540b6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:18.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.032+0000 7fab5a355700 1 -- 172.21.15.103:0/2261966337 >> v1:172.21.15.103:6789/0 conn(0x7fab540ac740 legacy=0x7fab5413c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:18.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.032+0000 7fab5a355700 1 -- 172.21.15.103:0/2261966337 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab54067550 con 0x7fab541426d0 2020-04-22T14:11:18.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.032+0000 7fab59b54700 1 --2- 172.21.15.103:0/2261966337 >> v2:172.21.15.86:3300/0 conn(0x7fab54067170 0x7fab540b6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:11:18.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.032+0000 7fab5a355700 1 --2- 172.21.15.103:0/2261966337 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab541426d0 0x7fab54142b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fab4c0032b0 tx=0x7fab4c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:18.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.032+0000 7fab5a355700 1 --2- 172.21.15.103:0/2261966337 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab541426d0 0x7fab54142b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fab4c0032b0 tx=0x7fab4c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:18.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.032+0000 7fab5a355700 1 --2- 172.21.15.103:0/2261966337 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab541426d0 0x7fab54142b40 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7fab4c0032b0 tx=0x7fab4c007dc0).ready entity=mon.2 client_cookie=89f539275d2414f9 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:18.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.032+0000 7fab5a355700 1 --2- 172.21.15.103:0/2261966337 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab541426d0 0x7fab54142b40 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fab4c0032b0 tx=0x7fab4c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:18.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.032+0000 7fab58b52700 1 -- 172.21.15.103:0/2261966337 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab4c011d70 con 0x7fab541426d0 2020-04-22T14:11:18.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.032+0000 7fab5a355700 1 --2- 172.21.15.103:0/2261966337 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab541426d0 0x7fab54142b40 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fab4c0032b0 tx=0x7fab4c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:18.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.032+0000 7fab58b52700 1 -- 172.21.15.103:0/2261966337 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4c00a180 con 0x7fab541426d0 2020-04-22T14:11:18.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.032+0000 7fab5a355700 1 --2- 172.21.15.103:0/2261966337 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab541426d0 0x7fab54142b40 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fab4c0032b0 tx=0x7fab4c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:18.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.032+0000 7fab58b52700 1 -- 172.21.15.103:0/2261966337 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab4c00a560 con 0x7fab541426d0 2020-04-22T14:11:18.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.032+0000 7fab5bdb8700 1 -- 172.21.15.103:0/2261966337 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab541426d0 msgr2=0x7fab54142b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:18.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.032+0000 7fab5bdb8700 1 --2- 172.21.15.103:0/2261966337 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab541426d0 0x7fab54142b40 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7fab4c0032b0 tx=0x7fab4c007dc0).stop 2020-04-22T14:11:18.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.033+0000 7fab5bdb8700 1 -- 172.21.15.103:0/2261966337 shutdown_connections 2020-04-22T14:11:18.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.033+0000 7fab5bdb8700 1 --2- 172.21.15.103:0/2261966337 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab541426d0 0x7fab54142b40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:18.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.033+0000 7fab5bdb8700 1 --2- 172.21.15.103:0/2261966337 >> v2:172.21.15.86:3300/0 conn(0x7fab54067170 0x7fab540b6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:18.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.033+0000 7fab5bdb8700 1 -- 172.21.15.103:0/2261966337 >> 172.21.15.103:0/2261966337 conn(0x7fab540b9160 msgr2=0x7fab5405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:18.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.033+0000 7fab5bdb8700 1 -- 172.21.15.103:0/2261966337 shutdown_connections 2020-04-22T14:11:18.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.033+0000 7fab5bdb8700 1 -- 172.21.15.103:0/2261966337 wait complete. 2020-04-22T14:11:18.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.034+0000 7fab5bdb8700 1 Processor -- start 2020-04-22T14:11:18.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.034+0000 7fab5bdb8700 1 -- start start 2020-04-22T14:11:18.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.034+0000 7fab5bdb8700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fab54067170 0x7fab540b3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:18.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.034+0000 7fab5bdb8700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab541426d0 0x7fab5413b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:18.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.034+0000 7fab5bdb8700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab5414bd30 con 0x7fab540ac740 2020-04-22T14:11:18.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.034+0000 7fab5bdb8700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab541583c0 con 0x7fab54067170 2020-04-22T14:11:18.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.034+0000 7fab5bdb8700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab540b3c80 con 0x7fab541426d0 2020-04-22T14:11:18.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.035+0000 7fab59b54700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fab54067170 0x7fab540b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:18.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.035+0000 7fab59b54700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fab54067170 0x7fab540b3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51834/0 (socket says 172.21.15.103:51834) 2020-04-22T14:11:18.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.035+0000 7fab59b54700 1 -- 172.21.15.103:0/1280733797 learned_addr learned my addr 172.21.15.103:0/1280733797 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:18.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.035+0000 7fab5a355700 1 --2- 172.21.15.103:0/1280733797 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab541426d0 0x7fab5413b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:18.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.035+0000 7fab59b54700 1 -- 172.21.15.103:0/1280733797 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab541426d0 msgr2=0x7fab5413b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:18.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.035+0000 7fab59b54700 1 --2- 172.21.15.103:0/1280733797 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab541426d0 0x7fab5413b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:18.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.035+0000 7fab59b54700 1 -- 172.21.15.103:0/1280733797 >> v1:172.21.15.86:6789/0 conn(0x7fab540ac740 legacy=0x7fab54157cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:18.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.035+0000 7fab59b54700 1 -- 172.21.15.103:0/1280733797 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab54157570 con 0x7fab54067170 2020-04-22T14:11:18.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.035+0000 7fab59b54700 1 --2- 172.21.15.103:0/1280733797 >> v2:172.21.15.103:3300/0 conn(0x7fab54067170 0x7fab540b3820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fab54064a60 tx=0x7fab44010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:18.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.035+0000 7fab59b54700 1 --2- 172.21.15.103:0/1280733797 >> v2:172.21.15.103:3300/0 conn(0x7fab54067170 0x7fab540b3820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fab54064a60 tx=0x7fab44010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:18.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.035+0000 7fab59b54700 1 --2- 172.21.15.103:0/1280733797 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab54067170 0x7fab540b3820 secure :-1 s=READY pgs=907 cs=0 l=1 rx=0x7fab54064a60 tx=0x7fab44010f60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:18.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.035+0000 7fab59b54700 1 --2- 172.21.15.103:0/1280733797 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab54067170 0x7fab540b3820 secure :-1 s=THROTTLE_DONE pgs=907 cs=0 l=1 rx=0x7fab54064a60 tx=0x7fab44010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:18.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.035+0000 7fab42ffd700 1 -- 172.21.15.103:0/1280733797 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab44007560 con 0x7fab54067170 2020-04-22T14:11:18.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.035+0000 7fab59b54700 1 --2- 172.21.15.103:0/1280733797 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab54067170 0x7fab540b3820 secure :-1 s=THROTTLE_DONE pgs=907 cs=0 l=1 rx=0x7fab54064a60 tx=0x7fab44010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:18.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.035+0000 7fab42ffd700 1 -- 172.21.15.103:0/1280733797 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab440059c0 con 0x7fab54067170 2020-04-22T14:11:18.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.035+0000 7fab5bdb8700 1 -- 172.21.15.103:0/1280733797 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab54157810 con 0x7fab54067170 2020-04-22T14:11:18.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.035+0000 7fab59b54700 1 --2- 172.21.15.103:0/1280733797 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab54067170 0x7fab540b3820 secure :-1 s=THROTTLE_DONE pgs=907 cs=0 l=1 rx=0x7fab54064a60 tx=0x7fab44010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:18.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.035+0000 7fab42ffd700 1 -- 172.21.15.103:0/1280733797 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab44005d60 con 0x7fab54067170 2020-04-22T14:11:18.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.035+0000 7fab5bdb8700 1 -- 172.21.15.103:0/1280733797 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab5413bc40 con 0x7fab54067170 2020-04-22T14:11:18.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.036+0000 7fab59b54700 1 --2- 172.21.15.103:0/1280733797 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab54067170 0x7fab540b3820 secure :-1 s=THROTTLE_DONE pgs=907 cs=0 l=1 rx=0x7fab54064a60 tx=0x7fab44010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:18.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.036+0000 7fab42ffd700 1 -- 172.21.15.103:0/1280733797 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fab440101a0 con 0x7fab54067170 2020-04-22T14:11:18.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.036+0000 7fab59b54700 1 --2- 172.21.15.103:0/1280733797 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab54067170 0x7fab540b3820 secure :-1 s=THROTTLE_DONE pgs=907 cs=0 l=1 rx=0x7fab54064a60 tx=0x7fab44010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:18.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.036+0000 7fab5bdb8700 1 -- 172.21.15.103:0/1280733797 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab54056c90 con 0x7fab54067170 2020-04-22T14:11:18.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.036+0000 7fab42ffd700 1 --2- 172.21.15.103:0/1280733797 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fab3404d960 0x7fab3404fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:18.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.037+0000 7fab42ffd700 1 -- 172.21.15.103:0/1280733797 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fab44061730 con 0x7fab54067170 2020-04-22T14:11:18.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.037+0000 7fab59353700 1 --2- 172.21.15.103:0/1280733797 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fab3404d960 0x7fab3404fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:18.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.037+0000 7fab59353700 1 --2- 172.21.15.103:0/1280733797 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fab3404d960 0x7fab3404fe20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fab500010d0 tx=0x7fab50001400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:18.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.037+0000 7fab59353700 1 --2- 172.21.15.103:0/1280733797 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fab3404d960 0x7fab3404fe20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fab500010d0 tx=0x7fab50001400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:18.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.037+0000 7fab59353700 1 --2- 172.21.15.103:0/1280733797 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fab3404d960 0x7fab3404fe20 secure :-1 s=READY pgs=342 cs=0 l=1 rx=0x7fab500010d0 tx=0x7fab50001400).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:18.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.041+0000 7fab59b54700 1 --2- 172.21.15.103:0/1280733797 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab54067170 0x7fab540b3820 secure :-1 s=THROTTLE_DONE pgs=907 cs=0 l=1 rx=0x7fab54064a60 tx=0x7fab44010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:18.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.041+0000 7fab42ffd700 1 -- 172.21.15.103:0/1280733797 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fab4403cab0 con 0x7fab54067170 2020-04-22T14:11:18.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.229+0000 7fab5bdb8700 1 -- 172.21.15.103:0/1280733797 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab540650f0 con 0x7fab54067170 2020-04-22T14:11:18.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.229+0000 7fab59b54700 1 --2- 172.21.15.103:0/1280733797 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab54067170 0x7fab540b3820 secure :-1 s=THROTTLE_DONE pgs=907 cs=0 l=1 rx=0x7fab54064a60 tx=0x7fab44010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:18.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.229+0000 7fab42ffd700 1 -- 172.21.15.103:0/1280733797 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2147 (secure 0 0 0) 0x7fab440400d0 con 0x7fab54067170 2020-04-22T14:11:18.233 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:18.233 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/1837726033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1837726033},{"type":"v1","addr":"172.21.15.86:6835","nonce":1837726033}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:03.499587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:11:18.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.230+0000 7fab5bdb8700 1 -- 172.21.15.103:0/1280733797 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fab3404d960 msgr2=0x7fab3404fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:18.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.230+0000 7fab5bdb8700 1 --2- 172.21.15.103:0/1280733797 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fab3404d960 0x7fab3404fe20 secure :-1 s=READY pgs=342 cs=0 l=1 rx=0x7fab500010d0 tx=0x7fab50001400).stop 2020-04-22T14:11:18.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.230+0000 7fab5bdb8700 1 -- 172.21.15.103:0/1280733797 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab54067170 msgr2=0x7fab540b3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:18.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.230+0000 7fab5bdb8700 1 --2- 172.21.15.103:0/1280733797 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab54067170 0x7fab540b3820 secure :-1 s=READY pgs=907 cs=0 l=1 rx=0x7fab54064a60 tx=0x7fab44010f60).stop 2020-04-22T14:11:18.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.230+0000 7fab5bdb8700 1 -- 172.21.15.103:0/1280733797 shutdown_connections 2020-04-22T14:11:18.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.231+0000 7fab5bdb8700 1 --2- 172.21.15.103:0/1280733797 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fab3404d960 0x7fab3404fe20 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:18.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.231+0000 7fab5bdb8700 1 --2- 172.21.15.103:0/1280733797 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab541426d0 0x7fab5413b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:18.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.231+0000 7fab5bdb8700 1 --2- 172.21.15.103:0/1280733797 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab54067170 0x7fab540b3820 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:18.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.231+0000 7fab5bdb8700 1 -- 172.21.15.103:0/1280733797 >> 172.21.15.103:0/1280733797 conn(0x7fab540b9160 msgr2=0x7fab540b7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:18.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.231+0000 7fab5bdb8700 1 -- 172.21.15.103:0/1280733797 shutdown_connections 2020-04-22T14:11:18.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:18.231+0000 7fab5bdb8700 1 -- 172.21.15.103:0/1280733797 wait complete. 2020-04-22T14:11:18.236 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 41 2020-04-22T14:11:18.244 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:11:19.245 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:19.262 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:11:19.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.416+0000 7f83256be700 1 Processor -- start 2020-04-22T14:11:19.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.416+0000 7f83256be700 1 -- start start 2020-04-22T14:11:19.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.417+0000 7f83256be700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f832012c0d0 0x7f83201464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:19.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.417+0000 7f83256be700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8320065fe0 0x7f832005b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:19.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.417+0000 7f83256be700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f832005b8a0 0x7f8320062ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:19.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.417+0000 7f83256be700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f832012c4b0 con 0x7f832005b8a0 2020-04-22T14:11:19.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.417+0000 7f83256be700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8320143300 con 0x7f8320065fe0 2020-04-22T14:11:19.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.417+0000 7f83256be700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83201435a0 con 0x7f832012c0d0 2020-04-22T14:11:19.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.417+0000 7f831e7fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8320065fe0 0x7f832005b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:19.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.417+0000 7f831e7fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8320065fe0 0x7f832005b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51842/0 (socket says 172.21.15.103:51842) 2020-04-22T14:11:19.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.417+0000 7f831e7fc700 1 -- 172.21.15.103:0/906907553 learned_addr learned my addr 172.21.15.103:0/906907553 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:19.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.418+0000 7f831f7fe700 1 --2- 172.21.15.103:0/906907553 >> v2:172.21.15.86:3300/0 conn(0x7f832005b8a0 0x7f8320062ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:19.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.418+0000 7f831effd700 1 --2- 172.21.15.103:0/906907553 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f832012c0d0 0x7f83201464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:19.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.418+0000 7f831e7fc700 1 -- 172.21.15.103:0/906907553 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f832012c0d0 msgr2=0x7f83201464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:19.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.418+0000 7f831e7fc700 1 --2- 172.21.15.103:0/906907553 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f832012c0d0 0x7f83201464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:19.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.418+0000 7f831e7fc700 1 -- 172.21.15.103:0/906907553 >> v2:172.21.15.86:3300/0 conn(0x7f832005b8a0 msgr2=0x7f8320062ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:19.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.418+0000 7f831e7fc700 1 --2- 172.21.15.103:0/906907553 >> v2:172.21.15.86:3300/0 conn(0x7f832005b8a0 0x7f8320062ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:19.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.418+0000 7f831e7fc700 1 -- 172.21.15.103:0/906907553 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8320143840 con 0x7f8320065fe0 2020-04-22T14:11:19.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.418+0000 7f831effd700 1 --2- 172.21.15.103:0/906907553 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f832012c0d0 0x7f83201464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:11:19.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.418+0000 7f831f7fe700 1 --2- 172.21.15.103:0/906907553 >> v2:172.21.15.86:3300/0 conn(0x7f832005b8a0 0x7f8320062ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:11:19.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.418+0000 7f831e7fc700 1 --2- 172.21.15.103:0/906907553 >> v2:172.21.15.103:3300/0 conn(0x7f8320065fe0 0x7f832005b440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8310002f30 tx=0x7f8310007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:19.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.418+0000 7f831e7fc700 1 --2- 172.21.15.103:0/906907553 >> v2:172.21.15.103:3300/0 conn(0x7f8320065fe0 0x7f832005b440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8310002f30 tx=0x7f8310007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:19.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.418+0000 7f831e7fc700 1 --2- 172.21.15.103:0/906907553 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8320065fe0 0x7f832005b440 secure :-1 s=READY pgs=908 cs=0 l=1 rx=0x7f8310002f30 tx=0x7f8310007a40).ready entity=mon.1 client_cookie=5a7e544a4da7e075 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:19.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.418+0000 7f831e7fc700 1 --2- 172.21.15.103:0/906907553 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8320065fe0 0x7f832005b440 secure :-1 s=THROTTLE_DONE pgs=908 cs=0 l=1 rx=0x7f8310002f30 tx=0x7f8310007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:19.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.418+0000 7f831e7fc700 1 --2- 172.21.15.103:0/906907553 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8320065fe0 0x7f832005b440 secure :-1 s=THROTTLE_DONE pgs=908 cs=0 l=1 rx=0x7f8310002f30 tx=0x7f8310007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:19.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.418+0000 7f831dffb700 1 -- 172.21.15.103:0/906907553 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8310011720 con 0x7f8320065fe0 2020-04-22T14:11:19.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.418+0000 7f831e7fc700 1 --2- 172.21.15.103:0/906907553 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8320065fe0 0x7f832005b440 secure :-1 s=THROTTLE_DONE pgs=908 cs=0 l=1 rx=0x7f8310002f30 tx=0x7f8310007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:19.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.418+0000 7f831dffb700 1 -- 172.21.15.103:0/906907553 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8310011880 con 0x7f8320065fe0 2020-04-22T14:11:19.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.418+0000 7f831dffb700 1 -- 172.21.15.103:0/906907553 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8310011ca0 con 0x7f8320065fe0 2020-04-22T14:11:19.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.418+0000 7f83256be700 1 -- 172.21.15.103:0/906907553 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8320065fe0 msgr2=0x7f832005b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:19.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.418+0000 7f83256be700 1 --2- 172.21.15.103:0/906907553 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8320065fe0 0x7f832005b440 secure :-1 s=READY pgs=908 cs=0 l=1 rx=0x7f8310002f30 tx=0x7f8310007a40).stop 2020-04-22T14:11:19.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.419+0000 7f83256be700 1 -- 172.21.15.103:0/906907553 shutdown_connections 2020-04-22T14:11:19.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.419+0000 7f83256be700 1 --2- 172.21.15.103:0/906907553 >> v2:172.21.15.86:3300/0 conn(0x7f832005b8a0 0x7f8320062ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:19.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.419+0000 7f83256be700 1 --2- 172.21.15.103:0/906907553 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f832012c0d0 0x7f83201464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:19.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.419+0000 7f83256be700 1 --2- 172.21.15.103:0/906907553 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8320065fe0 0x7f832005b440 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:19.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.419+0000 7f83256be700 1 -- 172.21.15.103:0/906907553 >> 172.21.15.103:0/906907553 conn(0x7f83200b9160 msgr2=0x7f832005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:19.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.419+0000 7f83256be700 1 -- 172.21.15.103:0/906907553 shutdown_connections 2020-04-22T14:11:19.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.419+0000 7f83256be700 1 -- 172.21.15.103:0/906907553 wait complete. 2020-04-22T14:11:19.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.420+0000 7f83256be700 1 Processor -- start 2020-04-22T14:11:19.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.420+0000 7f83256be700 1 -- start start 2020-04-22T14:11:19.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.420+0000 7f83256be700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f832005b8a0 0x7f83200b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:19.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.420+0000 7f83256be700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f832012c0d0 0x7f83200b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:19.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.420+0000 7f83256be700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83200b7550 con 0x7f8320065fe0 2020-04-22T14:11:19.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.420+0000 7f83256be700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83200b1cb0 con 0x7f832012c0d0 2020-04-22T14:11:19.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.420+0000 7f83256be700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8320129c50 con 0x7f832005b8a0 2020-04-22T14:11:19.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.420+0000 7f831e7fc700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f8320065fe0 0x7f83200b15a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44042/0 (socket says 172.21.15.103:44042) 2020-04-22T14:11:19.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.420+0000 7f831e7fc700 1 -- 172.21.15.103:0/2151217544 learned_addr learned my addr 172.21.15.103:0/2151217544 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:19.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.421+0000 7f831effd700 1 --2- 172.21.15.103:0/2151217544 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f832005b8a0 0x7f83200b0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:19.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.421+0000 7f831f7fe700 1 --2- 172.21.15.103:0/2151217544 >> v2:172.21.15.86:3300/0 conn(0x7f832012c0d0 0x7f83200b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:19.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.421+0000 7f8317fff700 1 -- 172.21.15.103:0/2151217544 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1614426465 0 0) 0x7f8320143840 con 0x7f8320065fe0 2020-04-22T14:11:19.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.421+0000 7f8317fff700 1 -- 172.21.15.103:0/2151217544 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8304002fe0 con 0x7f8320065fe0 2020-04-22T14:11:19.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.421+0000 7f8317fff700 1 -- 172.21.15.103:0/2151217544 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2890875881 0 0) 0x7f8304002fe0 con 0x7f8320065fe0 2020-04-22T14:11:19.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.421+0000 7f831effd700 1 -- 172.21.15.103:0/2151217544 >> v2:172.21.15.86:3300/0 conn(0x7f832012c0d0 msgr2=0x7f83200b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:19.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.421+0000 7f831effd700 1 --2- 172.21.15.103:0/2151217544 >> v2:172.21.15.86:3300/0 conn(0x7f832012c0d0 0x7f83200b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:19.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.421+0000 7f831effd700 1 -- 172.21.15.103:0/2151217544 >> v1:172.21.15.103:6789/0 conn(0x7f8320065fe0 legacy=0x7f83200b15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:19.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.421+0000 7f831effd700 1 -- 172.21.15.103:0/2151217544 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8320157b80 con 0x7f832005b8a0 2020-04-22T14:11:19.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.421+0000 7f831f7fe700 1 --2- 172.21.15.103:0/2151217544 >> v2:172.21.15.86:3300/0 conn(0x7f832012c0d0 0x7f83200b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:11:19.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.421+0000 7f831effd700 1 --2- 172.21.15.103:0/2151217544 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f832005b8a0 0x7f83200b0b50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8310008740 tx=0x7f8308010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:19.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.421+0000 7f831effd700 1 --2- 172.21.15.103:0/2151217544 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f832005b8a0 0x7f83200b0b50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8310008740 tx=0x7f8308010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:19.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.421+0000 7f831effd700 1 --2- 172.21.15.103:0/2151217544 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f832005b8a0 0x7f83200b0b50 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7f8310008740 tx=0x7f8308010a50).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:19.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.421+0000 7f831effd700 1 --2- 172.21.15.103:0/2151217544 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f832005b8a0 0x7f83200b0b50 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f8310008740 tx=0x7f8308010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:19.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.421+0000 7f8317fff700 1 -- 172.21.15.103:0/2151217544 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83100085e0 con 0x7f832005b8a0 2020-04-22T14:11:19.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.421+0000 7f831effd700 1 --2- 172.21.15.103:0/2151217544 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f832005b8a0 0x7f83200b0b50 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f8310008740 tx=0x7f8308010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:19.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.421+0000 7f831effd700 1 --2- 172.21.15.103:0/2151217544 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f832005b8a0 0x7f83200b0b50 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f8310008740 tx=0x7f8308010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:19.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.421+0000 7f8317fff700 1 -- 172.21.15.103:0/2151217544 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8308007370 con 0x7f832005b8a0 2020-04-22T14:11:19.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.421+0000 7f8317fff700 1 -- 172.21.15.103:0/2151217544 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83080059c0 con 0x7f832005b8a0 2020-04-22T14:11:19.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.421+0000 7f83256be700 1 -- 172.21.15.103:0/2151217544 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8320129ef0 con 0x7f832005b8a0 2020-04-22T14:11:19.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.421+0000 7f83256be700 1 -- 172.21.15.103:0/2151217544 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f832012a890 con 0x7f832005b8a0 2020-04-22T14:11:19.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.422+0000 7f831effd700 1 --2- 172.21.15.103:0/2151217544 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f832005b8a0 0x7f83200b0b50 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f8310008740 tx=0x7f8308010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:19.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.422+0000 7f83256be700 1 -- 172.21.15.103:0/2151217544 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8320056c90 con 0x7f832005b8a0 2020-04-22T14:11:19.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.422+0000 7f8317fff700 1 -- 172.21.15.103:0/2151217544 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f8308005c30 con 0x7f832005b8a0 2020-04-22T14:11:19.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.423+0000 7f831effd700 1 --2- 172.21.15.103:0/2151217544 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f832005b8a0 0x7f83200b0b50 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f8310008740 tx=0x7f8308010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:19.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.423+0000 7f8317fff700 1 --2- 172.21.15.103:0/2151217544 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f830404dd30 0x7f83040501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:19.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.423+0000 7f8317fff700 1 -- 172.21.15.103:0/2151217544 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f8308007e40 con 0x7f832005b8a0 2020-04-22T14:11:19.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.423+0000 7f831e7fc700 1 --2- 172.21.15.103:0/2151217544 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f830404dd30 0x7f83040501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:19.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.423+0000 7f831e7fc700 1 --2- 172.21.15.103:0/2151217544 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f830404dd30 0x7f83040501f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8310008780 tx=0x7f8310007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:19.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.423+0000 7f831e7fc700 1 --2- 172.21.15.103:0/2151217544 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f830404dd30 0x7f83040501f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8310008780 tx=0x7f8310007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:19.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.423+0000 7f831e7fc700 1 --2- 172.21.15.103:0/2151217544 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f830404dd30 0x7f83040501f0 secure :-1 s=READY pgs=343 cs=0 l=1 rx=0x7f8310008780 tx=0x7f8310007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:19.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.426+0000 7f831effd700 1 --2- 172.21.15.103:0/2151217544 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f832005b8a0 0x7f83200b0b50 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f8310008740 tx=0x7f8308010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:19.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.426+0000 7f8317fff700 1 -- 172.21.15.103:0/2151217544 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f830803c060 con 0x7f832005b8a0 2020-04-22T14:11:19.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.616+0000 7f83256be700 1 -- 172.21.15.103:0/2151217544 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8320147360 con 0x7f832005b8a0 2020-04-22T14:11:19.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.617+0000 7f831effd700 1 --2- 172.21.15.103:0/2151217544 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f832005b8a0 0x7f83200b0b50 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f8310008740 tx=0x7f8308010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:19.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.617+0000 7f8317fff700 1 -- 172.21.15.103:0/2151217544 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f830803f680 con 0x7f832005b8a0 2020-04-22T14:11:19.620 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:19.620 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/1837726033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1837726033},{"type":"v1","addr":"172.21.15.86:6835","nonce":1837726033}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:03.499587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:11:19.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.618+0000 7f83256be700 1 -- 172.21.15.103:0/2151217544 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f830404dd30 msgr2=0x7f83040501f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:19.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.618+0000 7f83256be700 1 --2- 172.21.15.103:0/2151217544 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f830404dd30 0x7f83040501f0 secure :-1 s=READY pgs=343 cs=0 l=1 rx=0x7f8310008780 tx=0x7f8310007a40).stop 2020-04-22T14:11:19.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.618+0000 7f83256be700 1 -- 172.21.15.103:0/2151217544 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f832005b8a0 msgr2=0x7f83200b0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:19.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.618+0000 7f83256be700 1 --2- 172.21.15.103:0/2151217544 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f832005b8a0 0x7f83200b0b50 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7f8310008740 tx=0x7f8308010a50).stop 2020-04-22T14:11:19.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.618+0000 7f83256be700 1 -- 172.21.15.103:0/2151217544 shutdown_connections 2020-04-22T14:11:19.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.618+0000 7f83256be700 1 --2- 172.21.15.103:0/2151217544 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f830404dd30 0x7f83040501f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:19.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.618+0000 7f83256be700 1 --2- 172.21.15.103:0/2151217544 >> v2:172.21.15.86:3300/0 conn(0x7f832012c0d0 0x7f83200b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:19.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.618+0000 7f83256be700 1 --2- 172.21.15.103:0/2151217544 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f832005b8a0 0x7f83200b0b50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:19.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.618+0000 7f83256be700 1 -- 172.21.15.103:0/2151217544 >> 172.21.15.103:0/2151217544 conn(0x7f83200b9160 msgr2=0x7f8320064e10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:19.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.618+0000 7f83256be700 1 -- 172.21.15.103:0/2151217544 shutdown_connections 2020-04-22T14:11:19.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:19.618+0000 7f83256be700 1 -- 172.21.15.103:0/2151217544 wait complete. 2020-04-22T14:11:19.623 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 41 2020-04-22T14:11:19.632 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:11:20.633 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:20.650 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:11:20.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.805+0000 7f6426198700 1 Processor -- start 2020-04-22T14:11:20.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.805+0000 7f6426198700 1 -- start start 2020-04-22T14:11:20.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.806+0000 7f6426198700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f64200665a0 0x7f642014a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:20.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.806+0000 7f6426198700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f64200b4ec0 0x7f64200b5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:20.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.806+0000 7f6426198700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64200651f0 con 0x7f642005b7c0 2020-04-22T14:11:20.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.806+0000 7f6426198700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6420066b90 con 0x7f64200b4ec0 2020-04-22T14:11:20.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.806+0000 7f6426198700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6420066e30 con 0x7f64200665a0 2020-04-22T14:11:20.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.806+0000 7f641f7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f642005b7c0 0x7f64201336b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44046/0 (socket says 172.21.15.103:44046) 2020-04-22T14:11:20.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.806+0000 7f641ffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f64200b4ec0 0x7f64200b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:20.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.806+0000 7f641f7fe700 1 -- 172.21.15.103:0/1778198796 learned_addr learned my addr 172.21.15.103:0/1778198796 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:20.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.806+0000 7f6417fff700 1 --2- 172.21.15.103:0/1778198796 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f64200665a0 0x7f642014a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:20.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.806+0000 7f641ffff700 1 -- 172.21.15.103:0/1778198796 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f64200665a0 msgr2=0x7f642014a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:20.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.806+0000 7f641ffff700 1 --2- 172.21.15.103:0/1778198796 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f64200665a0 0x7f642014a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:20.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.806+0000 7f641ffff700 1 -- 172.21.15.103:0/1778198796 >> v1:172.21.15.103:6789/0 conn(0x7f642005b7c0 legacy=0x7f64201336b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:20.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.806+0000 7f641ffff700 1 -- 172.21.15.103:0/1778198796 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64200670d0 con 0x7f64200b4ec0 2020-04-22T14:11:20.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.806+0000 7f641effd700 1 -- 172.21.15.103:0/1778198796 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 121979231 0 0) 0x7f64200651f0 con 0x7f642005b7c0 2020-04-22T14:11:20.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.806+0000 7f6417fff700 1 --2- 172.21.15.103:0/1778198796 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f64200665a0 0x7f642014a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:11:20.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.806+0000 7f641ffff700 1 --2- 172.21.15.103:0/1778198796 >> v2:172.21.15.103:3300/0 conn(0x7f64200b4ec0 0x7f64200b5350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6420066ab0 tx=0x7f6418008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:20.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.806+0000 7f641ffff700 1 --2- 172.21.15.103:0/1778198796 >> v2:172.21.15.103:3300/0 conn(0x7f64200b4ec0 0x7f64200b5350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6420066ab0 tx=0x7f6418008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:20.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.806+0000 7f641ffff700 1 --2- 172.21.15.103:0/1778198796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64200b4ec0 0x7f64200b5350 secure :-1 s=READY pgs=911 cs=0 l=1 rx=0x7f6420066ab0 tx=0x7f6418008c60).ready entity=mon.1 client_cookie=46aed1d4e3e9b406 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:20.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.807+0000 7f641ffff700 1 --2- 172.21.15.103:0/1778198796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64200b4ec0 0x7f64200b5350 secure :-1 s=THROTTLE_DONE pgs=911 cs=0 l=1 rx=0x7f6420066ab0 tx=0x7f6418008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:20.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.807+0000 7f641effd700 1 -- 172.21.15.103:0/1778198796 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f641800a180 con 0x7f64200b4ec0 2020-04-22T14:11:20.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.807+0000 7f641ffff700 1 --2- 172.21.15.103:0/1778198796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64200b4ec0 0x7f64200b5350 secure :-1 s=THROTTLE_DONE pgs=911 cs=0 l=1 rx=0x7f6420066ab0 tx=0x7f6418008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:20.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.807+0000 7f641effd700 1 -- 172.21.15.103:0/1778198796 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f641800a320 con 0x7f64200b4ec0 2020-04-22T14:11:20.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.807+0000 7f641ffff700 1 --2- 172.21.15.103:0/1778198796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64200b4ec0 0x7f64200b5350 secure :-1 s=THROTTLE_DONE pgs=911 cs=0 l=1 rx=0x7f6420066ab0 tx=0x7f6418008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:20.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.807+0000 7f641effd700 1 -- 172.21.15.103:0/1778198796 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f641800a700 con 0x7f64200b4ec0 2020-04-22T14:11:20.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.807+0000 7f6426198700 1 -- 172.21.15.103:0/1778198796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64200b4ec0 msgr2=0x7f64200b5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:20.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.807+0000 7f6426198700 1 --2- 172.21.15.103:0/1778198796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64200b4ec0 0x7f64200b5350 secure :-1 s=READY pgs=911 cs=0 l=1 rx=0x7f6420066ab0 tx=0x7f6418008c60).stop 2020-04-22T14:11:20.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.807+0000 7f6426198700 1 -- 172.21.15.103:0/1778198796 shutdown_connections 2020-04-22T14:11:20.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.807+0000 7f6426198700 1 --2- 172.21.15.103:0/1778198796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64200b4ec0 0x7f64200b5350 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:20.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.807+0000 7f6426198700 1 --2- 172.21.15.103:0/1778198796 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f64200665a0 0x7f642014a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:20.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.807+0000 7f6426198700 1 -- 172.21.15.103:0/1778198796 >> 172.21.15.103:0/1778198796 conn(0x7f64200b9160 msgr2=0x7f642005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:20.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.807+0000 7f6426198700 1 -- 172.21.15.103:0/1778198796 shutdown_connections 2020-04-22T14:11:20.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.807+0000 7f6426198700 1 -- 172.21.15.103:0/1778198796 wait complete. 2020-04-22T14:11:20.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.808+0000 7f6426198700 1 Processor -- start 2020-04-22T14:11:20.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.808+0000 7f6426198700 1 -- start start 2020-04-22T14:11:20.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.809+0000 7f6426198700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f64200665a0 0x7f64200b4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:20.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.809+0000 7f6426198700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64200af410 con 0x7f642005b7c0 2020-04-22T14:11:20.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.809+0000 7f6426198700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64200af6b0 con 0x7f64200b4ec0 2020-04-22T14:11:20.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.809+0000 7f6426198700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64200b1c20 con 0x7f64200665a0 2020-04-22T14:11:20.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.809+0000 7f6417fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f64200665a0 0x7f64200b4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:20.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.809+0000 7f6417fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f64200665a0 0x7f64200b4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51864/0 (socket says 172.21.15.103:51864) 2020-04-22T14:11:20.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.809+0000 7f641ffff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f64200b4ec0 0x7f64200afb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44056/0 (socket says 172.21.15.103:44056) 2020-04-22T14:11:20.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.809+0000 7f6417fff700 1 -- 172.21.15.103:0/1108667978 learned_addr learned my addr 172.21.15.103:0/1108667978 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:20.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.809+0000 7f6417fff700 1 -- 172.21.15.103:0/1108667978 >> v1:172.21.15.103:6789/0 conn(0x7f64200b4ec0 legacy=0x7f64200afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:20.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.809+0000 7f6417fff700 1 -- 172.21.15.103:0/1108667978 >> v1:172.21.15.86:6789/0 conn(0x7f642005b7c0 legacy=0x7f64201314b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:20.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.809+0000 7f641d7fa700 1 -- 172.21.15.103:0/1108667978 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1452885407 0 0) 0x7f64200af6b0 con 0x7f64200b4ec0 2020-04-22T14:11:20.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.809+0000 7f6417fff700 1 -- 172.21.15.103:0/1108667978 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6420131bc0 con 0x7f64200665a0 2020-04-22T14:11:20.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.809+0000 7f6417fff700 1 --2- 172.21.15.103:0/1108667978 >> v2:172.21.15.103:3300/0 conn(0x7f64200665a0 0x7f64200b4380 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6408002f30 tx=0x7f6408010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:20.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.809+0000 7f6417fff700 1 --2- 172.21.15.103:0/1108667978 >> v2:172.21.15.103:3300/0 conn(0x7f64200665a0 0x7f64200b4380 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6408002f30 tx=0x7f6408010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:20.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.809+0000 7f6417fff700 1 --2- 172.21.15.103:0/1108667978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64200665a0 0x7f64200b4380 secure :-1 s=READY pgs=913 cs=0 l=1 rx=0x7f6408002f30 tx=0x7f6408010b70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:20.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.809+0000 7f6417fff700 1 --2- 172.21.15.103:0/1108667978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64200665a0 0x7f64200b4380 secure :-1 s=THROTTLE_DONE pgs=913 cs=0 l=1 rx=0x7f6408002f30 tx=0x7f6408010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:20.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.809+0000 7f641d7fa700 1 -- 172.21.15.103:0/1108667978 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64080056c0 con 0x7f64200665a0 2020-04-22T14:11:20.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.809+0000 7f6417fff700 1 --2- 172.21.15.103:0/1108667978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64200665a0 0x7f64200b4380 secure :-1 s=THROTTLE_DONE pgs=913 cs=0 l=1 rx=0x7f6408002f30 tx=0x7f6408010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:20.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.809+0000 7f6417fff700 1 --2- 172.21.15.103:0/1108667978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64200665a0 0x7f64200b4380 secure :-1 s=THROTTLE_DONE pgs=913 cs=0 l=1 rx=0x7f6408002f30 tx=0x7f6408010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:20.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.810+0000 7f641d7fa700 1 -- 172.21.15.103:0/1108667978 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6408005820 con 0x7f64200665a0 2020-04-22T14:11:20.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.810+0000 7f641d7fa700 1 -- 172.21.15.103:0/1108667978 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6408005c40 con 0x7f64200665a0 2020-04-22T14:11:20.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.810+0000 7f6426198700 1 -- 172.21.15.103:0/1108667978 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64200b15f0 con 0x7f64200665a0 2020-04-22T14:11:20.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.810+0000 7f6426198700 1 -- 172.21.15.103:0/1108667978 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64201328e0 con 0x7f64200665a0 2020-04-22T14:11:20.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.810+0000 7f6417fff700 1 --2- 172.21.15.103:0/1108667978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64200665a0 0x7f64200b4380 secure :-1 s=THROTTLE_DONE pgs=913 cs=0 l=1 rx=0x7f6408002f30 tx=0x7f6408010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:20.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.810+0000 7f6426198700 1 -- 172.21.15.103:0/1108667978 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64200b1a90 con 0x7f64200665a0 2020-04-22T14:11:20.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.811+0000 7f641d7fa700 1 -- 172.21.15.103:0/1108667978 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f64080125a0 con 0x7f64200665a0 2020-04-22T14:11:20.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.811+0000 7f6417fff700 1 --2- 172.21.15.103:0/1108667978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64200665a0 0x7f64200b4380 secure :-1 s=THROTTLE_DONE pgs=913 cs=0 l=1 rx=0x7f6408002f30 tx=0x7f6408010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:20.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.811+0000 7f641d7fa700 1 --2- 172.21.15.103:0/1108667978 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f640404d880 0x7f640404fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:20.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.811+0000 7f641d7fa700 1 -- 172.21.15.103:0/1108667978 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f6408061430 con 0x7f64200665a0 2020-04-22T14:11:20.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.811+0000 7f641f7fe700 1 --2- 172.21.15.103:0/1108667978 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f640404d880 0x7f640404fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:20.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.811+0000 7f641f7fe700 1 --2- 172.21.15.103:0/1108667978 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f640404d880 0x7f640404fd40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6420133150 tx=0x7f6410001470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:20.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.811+0000 7f641f7fe700 1 --2- 172.21.15.103:0/1108667978 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f640404d880 0x7f640404fd40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6420133150 tx=0x7f6410001470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:20.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.811+0000 7f641f7fe700 1 --2- 172.21.15.103:0/1108667978 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f640404d880 0x7f640404fd40 secure :-1 s=READY pgs=344 cs=0 l=1 rx=0x7f6420133150 tx=0x7f6410001470).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:20.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.815+0000 7f6417fff700 1 --2- 172.21.15.103:0/1108667978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64200665a0 0x7f64200b4380 secure :-1 s=THROTTLE_DONE pgs=913 cs=0 l=1 rx=0x7f6408002f30 tx=0x7f6408010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:20.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:20.815+0000 7f641d7fa700 1 -- 172.21.15.103:0/1108667978 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f640803c870 con 0x7f64200665a0 2020-04-22T14:11:21.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:21.006+0000 7f6426198700 1 -- 172.21.15.103:0/1108667978 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64200af840 con 0x7f64200665a0 2020-04-22T14:11:21.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:21.006+0000 7f6417fff700 1 --2- 172.21.15.103:0/1108667978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64200665a0 0x7f64200b4380 secure :-1 s=THROTTLE_DONE pgs=913 cs=0 l=1 rx=0x7f6408002f30 tx=0x7f6408010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:21.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:21.006+0000 7f641d7fa700 1 -- 172.21.15.103:0/1108667978 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f640803fe90 con 0x7f64200665a0 2020-04-22T14:11:21.010 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:21.010 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/1837726033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1837726033},{"type":"v1","addr":"172.21.15.86:6835","nonce":1837726033}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:03.499587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:11:21.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:21.008+0000 7f6426198700 1 -- 172.21.15.103:0/1108667978 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f640404d880 msgr2=0x7f640404fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:21.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:21.008+0000 7f6426198700 1 --2- 172.21.15.103:0/1108667978 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f640404d880 0x7f640404fd40 secure :-1 s=READY pgs=344 cs=0 l=1 rx=0x7f6420133150 tx=0x7f6410001470).stop 2020-04-22T14:11:21.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:21.008+0000 7f6426198700 1 -- 172.21.15.103:0/1108667978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64200665a0 msgr2=0x7f64200b4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:21.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:21.008+0000 7f6426198700 1 --2- 172.21.15.103:0/1108667978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64200665a0 0x7f64200b4380 secure :-1 s=READY pgs=913 cs=0 l=1 rx=0x7f6408002f30 tx=0x7f6408010b70).stop 2020-04-22T14:11:21.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:21.008+0000 7f6426198700 1 -- 172.21.15.103:0/1108667978 shutdown_connections 2020-04-22T14:11:21.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:21.008+0000 7f6426198700 1 --2- 172.21.15.103:0/1108667978 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f640404d880 0x7f640404fd40 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:21.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:21.008+0000 7f6426198700 1 --2- 172.21.15.103:0/1108667978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64200665a0 0x7f64200b4380 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:21.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:21.008+0000 7f6426198700 1 -- 172.21.15.103:0/1108667978 >> 172.21.15.103:0/1108667978 conn(0x7f64200b9160 msgr2=0x7f642014a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:21.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:21.008+0000 7f6426198700 1 -- 172.21.15.103:0/1108667978 shutdown_connections 2020-04-22T14:11:21.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:21.008+0000 7f6426198700 1 -- 172.21.15.103:0/1108667978 wait complete. 2020-04-22T14:11:21.013 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 41 2020-04-22T14:11:21.021 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:11:22.022 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:22.040 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:11:22.083 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:11:22.101 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:11:22.145 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:22.162 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:11:22.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.202+0000 7fab0581c700 1 Processor -- start 2020-04-22T14:11:22.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.203+0000 7fab0581c700 1 -- start start 2020-04-22T14:11:22.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.203+0000 7fab0581c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab00140320 0x7fab000ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:22.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.203+0000 7fab0581c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fab000bd1b0 0x7fab000bd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:22.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.203+0000 7fab0581c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab0014a710 con 0x7fab0014a2b0 2020-04-22T14:11:22.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.203+0000 7fab0581c700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab001462f0 con 0x7fab000bd1b0 2020-04-22T14:11:22.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.204+0000 7fab0581c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab00146590 con 0x7fab00140320 2020-04-22T14:11:22.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.204+0000 7faaff7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fab000bd1b0 0x7fab000bd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:22.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.204+0000 7faafe7fc700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fab0014a2b0 0x7fab00146cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44060/0 (socket says 172.21.15.103:44060) 2020-04-22T14:11:22.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.204+0000 7faafe7fc700 1 -- 172.21.15.103:0/3160463928 learned_addr learned my addr 172.21.15.103:0/3160463928 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:22.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.204+0000 7faafeffd700 1 --2- 172.21.15.103:0/3160463928 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab00140320 0x7fab000ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:22.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.204+0000 7faaff7fe700 1 -- 172.21.15.103:0/3160463928 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab00140320 msgr2=0x7fab000ae1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:22.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.204+0000 7faaff7fe700 1 --2- 172.21.15.103:0/3160463928 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab00140320 0x7fab000ae1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:22.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.204+0000 7faaff7fe700 1 -- 172.21.15.103:0/3160463928 >> v1:172.21.15.103:6789/0 conn(0x7fab0014a2b0 legacy=0x7fab00146cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:22.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.204+0000 7faafdffb700 1 -- 172.21.15.103:0/3160463928 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 267409832 0 0) 0x7fab0014a710 con 0x7fab0014a2b0 2020-04-22T14:11:22.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.204+0000 7faaff7fe700 1 -- 172.21.15.103:0/3160463928 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab00146830 con 0x7fab000bd1b0 2020-04-22T14:11:22.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.204+0000 7faafeffd700 1 --2- 172.21.15.103:0/3160463928 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab00140320 0x7fab000ae1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:11:22.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.204+0000 7faaff7fe700 1 --2- 172.21.15.103:0/3160463928 >> v2:172.21.15.103:3300/0 conn(0x7fab000bd1b0 0x7fab000bd640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7faaf0002f30 tx=0x7faaf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:22.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.204+0000 7faaff7fe700 1 --2- 172.21.15.103:0/3160463928 >> v2:172.21.15.103:3300/0 conn(0x7fab000bd1b0 0x7fab000bd640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7faaf0002f30 tx=0x7faaf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:22.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.204+0000 7faaff7fe700 1 --2- 172.21.15.103:0/3160463928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab000bd1b0 0x7fab000bd640 secure :-1 s=READY pgs=915 cs=0 l=1 rx=0x7faaf0002f30 tx=0x7faaf0007a40).ready entity=mon.1 client_cookie=d421485259a4896e server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:22.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.204+0000 7faaff7fe700 1 --2- 172.21.15.103:0/3160463928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab000bd1b0 0x7fab000bd640 secure :-1 s=THROTTLE_DONE pgs=915 cs=0 l=1 rx=0x7faaf0002f30 tx=0x7faaf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:22.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.204+0000 7faafdffb700 1 -- 172.21.15.103:0/3160463928 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faaf0011470 con 0x7fab000bd1b0 2020-04-22T14:11:22.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.204+0000 7faaff7fe700 1 --2- 172.21.15.103:0/3160463928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab000bd1b0 0x7fab000bd640 secure :-1 s=THROTTLE_DONE pgs=915 cs=0 l=1 rx=0x7faaf0002f30 tx=0x7faaf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:22.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.204+0000 7faaff7fe700 1 --2- 172.21.15.103:0/3160463928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab000bd1b0 0x7fab000bd640 secure :-1 s=THROTTLE_DONE pgs=915 cs=0 l=1 rx=0x7faaf0002f30 tx=0x7faaf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:22.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.204+0000 7faafdffb700 1 -- 172.21.15.103:0/3160463928 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf0011610 con 0x7fab000bd1b0 2020-04-22T14:11:22.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.204+0000 7faafdffb700 1 -- 172.21.15.103:0/3160463928 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faaf00119f0 con 0x7fab000bd1b0 2020-04-22T14:11:22.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.204+0000 7fab0581c700 1 -- 172.21.15.103:0/3160463928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab000bd1b0 msgr2=0x7fab000bd640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:22.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.204+0000 7fab0581c700 1 --2- 172.21.15.103:0/3160463928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab000bd1b0 0x7fab000bd640 secure :-1 s=READY pgs=915 cs=0 l=1 rx=0x7faaf0002f30 tx=0x7faaf0007a40).stop 2020-04-22T14:11:22.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.205+0000 7fab0581c700 1 -- 172.21.15.103:0/3160463928 shutdown_connections 2020-04-22T14:11:22.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.205+0000 7fab0581c700 1 --2- 172.21.15.103:0/3160463928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab000bd1b0 0x7fab000bd640 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:22.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.205+0000 7fab0581c700 1 --2- 172.21.15.103:0/3160463928 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab00140320 0x7fab000ae1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:22.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.205+0000 7fab0581c700 1 -- 172.21.15.103:0/3160463928 >> 172.21.15.103:0/3160463928 conn(0x7fab0005f2c0 msgr2=0x7fab000bcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:22.214 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.205+0000 7fab0581c700 1 -- 172.21.15.103:0/3160463928 shutdown_connections 2020-04-22T14:11:22.214 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.205+0000 7fab0581c700 1 -- 172.21.15.103:0/3160463928 wait complete. 2020-04-22T14:11:22.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.206+0000 7fab0581c700 1 Processor -- start 2020-04-22T14:11:22.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.206+0000 7fab0581c700 1 -- start start 2020-04-22T14:11:22.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.207+0000 7fab0581c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fab00140320 0x7fab001436e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:22.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.207+0000 7fab0581c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab0014a2b0 0x7fab00148ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:22.225 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.207+0000 7fab0581c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab00148f20 con 0x7fab000bd1b0 2020-04-22T14:11:22.225 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.207+0000 7fab0581c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab00154290 con 0x7fab00140320 2020-04-22T14:11:22.225 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.207+0000 7fab0581c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab000b24c0 con 0x7fab0014a2b0 2020-04-22T14:11:22.225 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.207+0000 7faafeffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fab000bd1b0 0x7fab00153b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44064/0 (socket says 172.21.15.103:44064) 2020-04-22T14:11:22.226 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.207+0000 7faafeffd700 1 -- 172.21.15.103:0/3856533643 learned_addr learned my addr 172.21.15.103:0/3856533643 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:22.227 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.207+0000 7faaff7fe700 1 --2- 172.21.15.103:0/3856533643 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab0014a2b0 0x7fab00148ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:22.227 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.207+0000 7faaf7fff700 1 -- 172.21.15.103:0/3856533643 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4270037540 0 0) 0x7faaf80080e0 con 0x7fab000bd1b0 2020-04-22T14:11:22.227 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.207+0000 7faaf7fff700 1 -- 172.21.15.103:0/3856533643 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faae4002fe0 con 0x7fab000bd1b0 2020-04-22T14:11:22.228 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.207+0000 7faafe7fc700 1 --2- 172.21.15.103:0/3856533643 >> v2:172.21.15.86:3300/0 conn(0x7fab00140320 0x7fab001436e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:22.228 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.207+0000 7faaf7fff700 1 -- 172.21.15.103:0/3856533643 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1491434061 0 0) 0x7faae4002fe0 con 0x7fab000bd1b0 2020-04-22T14:11:22.228 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.207+0000 7faaf7fff700 1 -- 172.21.15.103:0/3856533643 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7faaf80080e0 con 0x7fab000bd1b0 2020-04-22T14:11:22.228 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.207+0000 7faaf7fff700 1 -- 172.21.15.103:0/3856533643 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7faaf80088f0 con 0x7fab000bd1b0 2020-04-22T14:11:22.228 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.207+0000 7faaf7fff700 1 -- 172.21.15.103:0/3856533643 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab0014a2b0 msgr2=0x7fab00148ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:22.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.207+0000 7faaf7fff700 1 --2- 172.21.15.103:0/3856533643 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab0014a2b0 0x7fab00148ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:22.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.207+0000 7faaf7fff700 1 -- 172.21.15.103:0/3856533643 >> v2:172.21.15.86:3300/0 conn(0x7fab00140320 msgr2=0x7fab001436e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:22.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.207+0000 7faaf7fff700 1 --2- 172.21.15.103:0/3856533643 >> v2:172.21.15.86:3300/0 conn(0x7fab00140320 0x7fab001436e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:22.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.207+0000 7faaf7fff700 1 -- 172.21.15.103:0/3856533643 >> v1:172.21.15.103:6789/0 conn(0x7fab000bd1b0 legacy=0x7fab00153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:22.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.207+0000 7faaf7fff700 1 --2- 172.21.15.103:0/3856533643 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faae40049b0 0x7faae4004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:22.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.207+0000 7faaf7fff700 1 --2- 172.21.15.103:0/3856533643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faae40052a0 0x7faae4003980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:22.231 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.207+0000 7faaf7fff700 1 --2- 172.21.15.103:0/3856533643 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faae4003f80 0x7faae4004400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:22.231 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.207+0000 7faaf7fff700 1 -- 172.21.15.103:0/3856533643 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab00154290 con 0x7faae40052a0 2020-04-22T14:11:22.231 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.207+0000 7faaf7fff700 1 -- 172.21.15.103:0/3856533643 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab000b24c0 con 0x7faae4003f80 2020-04-22T14:11:22.231 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.207+0000 7faaf7fff700 1 -- 172.21.15.103:0/3856533643 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae400b990 con 0x7faae40049b0 2020-04-22T14:11:22.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.207+0000 7faaff7fe700 1 --2- 172.21.15.103:0/3856533643 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fab0014a2b0 0x7fab00148ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:11:22.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.208+0000 7faafeffd700 1 --2- 172.21.15.103:0/3856533643 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faae40049b0 0x7faae4004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:22.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.208+0000 7faafe7fc700 1 --2- 172.21.15.103:0/3856533643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faae40052a0 0x7faae4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:22.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.208+0000 7faaff7fe700 1 --2- 172.21.15.103:0/3856533643 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faae4003f80 0x7faae4004400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:22.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.208+0000 7faaff7fe700 1 -- 172.21.15.103:0/3856533643 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faae40049b0 msgr2=0x7faae4004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:22.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.208+0000 7faaff7fe700 1 --2- 172.21.15.103:0/3856533643 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faae40049b0 0x7faae4004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:22.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.208+0000 7faaff7fe700 1 -- 172.21.15.103:0/3856533643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faae40052a0 msgr2=0x7faae4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:22.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.208+0000 7faaff7fe700 1 --2- 172.21.15.103:0/3856533643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faae40052a0 0x7faae4003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:22.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.208+0000 7faaff7fe700 1 -- 172.21.15.103:0/3856533643 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab000b01e0 con 0x7faae4003f80 2020-04-22T14:11:22.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.208+0000 7fab0581c700 1 -- 172.21.15.103:0/3856533643 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab000b2720 con 0x7faae4003f80 2020-04-22T14:11:22.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.208+0000 7faaff7fe700 1 --2- 172.21.15.103:0/3856533643 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faae4003f80 0x7faae4004400 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faaf0002f30 tx=0x7faaf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:22.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.208+0000 7fab0581c700 1 -- 172.21.15.103:0/3856533643 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab001432c0 con 0x7faae4003f80 2020-04-22T14:11:22.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.208+0000 7faaff7fe700 1 --2- 172.21.15.103:0/3856533643 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faae4003f80 0x7faae4004400 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faaf0002f30 tx=0x7faaf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:22.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.208+0000 7faaff7fe700 1 --2- 172.21.15.103:0/3856533643 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faae4003f80 0x7faae4004400 secure :-1 s=READY pgs=917 cs=0 l=1 rx=0x7faaf0002f30 tx=0x7faaf0007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:22.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.208+0000 7faaff7fe700 1 --2- 172.21.15.103:0/3856533643 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faae4003f80 0x7faae4004400 secure :-1 s=THROTTLE_DONE pgs=917 cs=0 l=1 rx=0x7faaf0002f30 tx=0x7faaf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:22.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.208+0000 7faaff7fe700 1 --2- 172.21.15.103:0/3856533643 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faae4003f80 0x7faae4004400 secure :-1 s=THROTTLE_DONE pgs=917 cs=0 l=1 rx=0x7faaf0002f30 tx=0x7faaf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:22.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.208+0000 7faaff7fe700 1 --2- 172.21.15.103:0/3856533643 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faae4003f80 0x7faae4004400 secure :-1 s=THROTTLE_DONE pgs=917 cs=0 l=1 rx=0x7faaf0002f30 tx=0x7faaf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:22.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.208+0000 7faaf7fff700 1 -- 172.21.15.103:0/3856533643 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faaf0007360 con 0x7faae4003f80 2020-04-22T14:11:22.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.209+0000 7faaf7fff700 1 -- 172.21.15.103:0/3856533643 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf00074c0 con 0x7faae4003f80 2020-04-22T14:11:22.237 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.209+0000 7faaf7fff700 1 -- 172.21.15.103:0/3856533643 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faaf00058b0 con 0x7faae4003f80 2020-04-22T14:11:22.237 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.209+0000 7faaff7fe700 1 --2- 172.21.15.103:0/3856533643 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faae4003f80 0x7faae4004400 secure :-1 s=THROTTLE_DONE pgs=917 cs=0 l=1 rx=0x7faaf0002f30 tx=0x7faaf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:22.237 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.209+0000 7fab0581c700 1 -- 172.21.15.103:0/3856533643 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faad8003340 con 0x7faae4003f80 2020-04-22T14:11:22.237 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.209+0000 7faaf7fff700 1 -- 172.21.15.103:0/3856533643 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7faaf0005a10 con 0x7faae4003f80 2020-04-22T14:11:22.237 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.209+0000 7faaff7fe700 1 --2- 172.21.15.103:0/3856533643 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faae4003f80 0x7faae4004400 secure :-1 s=THROTTLE_DONE pgs=917 cs=0 l=1 rx=0x7faaf0002f30 tx=0x7faaf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:22.238 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.210+0000 7faaf7fff700 1 --2- 172.21.15.103:0/3856533643 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faae40561b0 0x7faae4058670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:22.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.210+0000 7faaf7fff700 1 -- 172.21.15.103:0/3856533643 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6159+0+0 (secure 0 0 0) 0x7faaf0061ab0 con 0x7faae4003f80 2020-04-22T14:11:22.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.210+0000 7faafeffd700 1 --2- 172.21.15.103:0/3856533643 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faae40561b0 0x7faae4058670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:22.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.210+0000 7faafeffd700 1 --2- 172.21.15.103:0/3856533643 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faae40561b0 0x7faae4058670 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faaf8007e50 tx=0x7faaf800d760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:22.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.210+0000 7faafeffd700 1 --2- 172.21.15.103:0/3856533643 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faae40561b0 0x7faae4058670 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faaf8007e50 tx=0x7faaf800d760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:22.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.210+0000 7faafeffd700 1 --2- 172.21.15.103:0/3856533643 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faae40561b0 0x7faae4058670 secure :-1 s=READY pgs=345 cs=0 l=1 rx=0x7faaf8007e50 tx=0x7faaf800d760).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:22.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.214+0000 7faaff7fe700 1 --2- 172.21.15.103:0/3856533643 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faae4003f80 0x7faae4004400 secure :-1 s=THROTTLE_DONE pgs=917 cs=0 l=1 rx=0x7faaf0002f30 tx=0x7faaf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:22.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.214+0000 7faaf7fff700 1 -- 172.21.15.103:0/3856533643 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7faaf003cff0 con 0x7faae4003f80 2020-04-22T14:11:22.413 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.409+0000 7fab0581c700 1 -- 172.21.15.103:0/3856533643 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faad80036e0 con 0x7faae4003f80 2020-04-22T14:11:22.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.410+0000 7faaff7fe700 1 --2- 172.21.15.103:0/3856533643 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faae4003f80 0x7faae4004400 secure :-1 s=THROTTLE_DONE pgs=917 cs=0 l=1 rx=0x7faaf0002f30 tx=0x7faaf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:22.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.410+0000 7faaf7fff700 1 -- 172.21.15.103:0/3856533643 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2147 (secure 0 0 0) 0x7faaf0040610 con 0x7faae4003f80 2020-04-22T14:11:22.414 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:22.414 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/1837726033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1837726033},{"type":"v1","addr":"172.21.15.86:6835","nonce":1837726033}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:03.499587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:11:22.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.411+0000 7fab0581c700 1 -- 172.21.15.103:0/3856533643 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faae40561b0 msgr2=0x7faae4058670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:22.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.411+0000 7fab0581c700 1 --2- 172.21.15.103:0/3856533643 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faae40561b0 0x7faae4058670 secure :-1 s=READY pgs=345 cs=0 l=1 rx=0x7faaf8007e50 tx=0x7faaf800d760).stop 2020-04-22T14:11:22.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.411+0000 7fab0581c700 1 -- 172.21.15.103:0/3856533643 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faae4003f80 msgr2=0x7faae4004400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:22.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.411+0000 7fab0581c700 1 --2- 172.21.15.103:0/3856533643 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faae4003f80 0x7faae4004400 secure :-1 s=READY pgs=917 cs=0 l=1 rx=0x7faaf0002f30 tx=0x7faaf0007a40).stop 2020-04-22T14:11:22.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.411+0000 7faaff7fe700 1 -- 172.21.15.103:0/3856533643 reap_dead start 2020-04-22T14:11:22.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.411+0000 7faaff7fe700 1 -- 172.21.15.103:0/3856533643 reap_dead start 2020-04-22T14:11:22.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.412+0000 7fab0581c700 1 -- 172.21.15.103:0/3856533643 shutdown_connections 2020-04-22T14:11:22.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.412+0000 7fab0581c700 1 -- 172.21.15.103:0/3856533643 >> 172.21.15.103:0/3856533643 conn(0x7fab0005f2c0 msgr2=0x7fab000adc40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:22.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.412+0000 7fab0581c700 1 -- 172.21.15.103:0/3856533643 shutdown_connections 2020-04-22T14:11:22.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:22.412+0000 7fab0581c700 1 -- 172.21.15.103:0/3856533643 wait complete. 2020-04-22T14:11:22.424 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 41 2020-04-22T14:11:22.430 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:11:23.431 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:23.448 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:11:23.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.603+0000 7fa3bd482700 1 Processor -- start 2020-04-22T14:11:23.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.603+0000 7fa3bd482700 1 -- start start 2020-04-22T14:11:23.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.604+0000 7fa3bd482700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa3b812c0d0 0x7fa3b81464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:23.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.604+0000 7fa3bd482700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3b8063e30 0x7fa3b80642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:23.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.604+0000 7fa3bd482700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3b8143300 con 0x7fa3b8065fe0 2020-04-22T14:11:23.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.604+0000 7fa3bd482700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b81435a0 con 0x7fa3b812c0d0 2020-04-22T14:11:23.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.604+0000 7fa3bd482700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b8143840 con 0x7fa3b8063e30 2020-04-22T14:11:23.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.604+0000 7fa3b6ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa3b812c0d0 0x7fa3b81464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:23.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.604+0000 7fa3b6ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa3b812c0d0 0x7fa3b81464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51888/0 (socket says 172.21.15.103:51888) 2020-04-22T14:11:23.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.604+0000 7fa3b6ffd700 1 -- 172.21.15.103:0/3598738845 learned_addr learned my addr 172.21.15.103:0/3598738845 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:23.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.604+0000 7fa3b77fe700 1 --2- 172.21.15.103:0/3598738845 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3b8063e30 0x7fa3b80642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:23.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.604+0000 7fa3b6ffd700 1 -- 172.21.15.103:0/3598738845 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3b8063e30 msgr2=0x7fa3b80642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:23.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.604+0000 7fa3b6ffd700 1 --2- 172.21.15.103:0/3598738845 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3b8063e30 0x7fa3b80642c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:23.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.604+0000 7fa3b6ffd700 1 -- 172.21.15.103:0/3598738845 >> v1:172.21.15.86:6789/0 conn(0x7fa3b8065fe0 legacy=0x7fa3b805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:23.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.604+0000 7fa3b6ffd700 1 -- 172.21.15.103:0/3598738845 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b805bb50 con 0x7fa3b812c0d0 2020-04-22T14:11:23.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.604+0000 7fa3b6ffd700 1 --2- 172.21.15.103:0/3598738845 >> v2:172.21.15.103:3300/0 conn(0x7fa3b812c0d0 0x7fa3b81464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa3b80b85b0 tx=0x7fa3ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:23.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.605+0000 7fa3b6ffd700 1 --2- 172.21.15.103:0/3598738845 >> v2:172.21.15.103:3300/0 conn(0x7fa3b812c0d0 0x7fa3b81464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa3b80b85b0 tx=0x7fa3ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:23.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.605+0000 7fa3b6ffd700 1 --2- 172.21.15.103:0/3598738845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3b812c0d0 0x7fa3b81464e0 secure :-1 s=READY pgs=918 cs=0 l=1 rx=0x7fa3b80b85b0 tx=0x7fa3ac007a40).ready entity=mon.1 client_cookie=54a361ac12369d22 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:23.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.605+0000 7fa3b6ffd700 1 --2- 172.21.15.103:0/3598738845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3b812c0d0 0x7fa3b81464e0 secure :-1 s=THROTTLE_DONE pgs=918 cs=0 l=1 rx=0x7fa3b80b85b0 tx=0x7fa3ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:23.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.605+0000 7fa3b5ffb700 1 -- 172.21.15.103:0/3598738845 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3ac0116e0 con 0x7fa3b812c0d0 2020-04-22T14:11:23.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.605+0000 7fa3b6ffd700 1 --2- 172.21.15.103:0/3598738845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3b812c0d0 0x7fa3b81464e0 secure :-1 s=THROTTLE_DONE pgs=918 cs=0 l=1 rx=0x7fa3b80b85b0 tx=0x7fa3ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:23.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.605+0000 7fa3b5ffb700 1 -- 172.21.15.103:0/3598738845 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3ac011840 con 0x7fa3b812c0d0 2020-04-22T14:11:23.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.605+0000 7fa3b6ffd700 1 --2- 172.21.15.103:0/3598738845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3b812c0d0 0x7fa3b81464e0 secure :-1 s=THROTTLE_DONE pgs=918 cs=0 l=1 rx=0x7fa3b80b85b0 tx=0x7fa3ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:23.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.605+0000 7fa3b5ffb700 1 -- 172.21.15.103:0/3598738845 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3ac011c60 con 0x7fa3b812c0d0 2020-04-22T14:11:23.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.605+0000 7fa3bd482700 1 -- 172.21.15.103:0/3598738845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3b812c0d0 msgr2=0x7fa3b81464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:23.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.605+0000 7fa3bd482700 1 --2- 172.21.15.103:0/3598738845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3b812c0d0 0x7fa3b81464e0 secure :-1 s=READY pgs=918 cs=0 l=1 rx=0x7fa3b80b85b0 tx=0x7fa3ac007a40).stop 2020-04-22T14:11:23.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.605+0000 7fa3bd482700 1 -- 172.21.15.103:0/3598738845 shutdown_connections 2020-04-22T14:11:23.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.605+0000 7fa3bd482700 1 --2- 172.21.15.103:0/3598738845 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3b8063e30 0x7fa3b80642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:23.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.605+0000 7fa3bd482700 1 --2- 172.21.15.103:0/3598738845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3b812c0d0 0x7fa3b81464e0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:23.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.605+0000 7fa3bd482700 1 -- 172.21.15.103:0/3598738845 >> 172.21.15.103:0/3598738845 conn(0x7fa3b80b9160 msgr2=0x7fa3b805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:23.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.605+0000 7fa3bd482700 1 -- 172.21.15.103:0/3598738845 shutdown_connections 2020-04-22T14:11:23.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.605+0000 7fa3bd482700 1 -- 172.21.15.103:0/3598738845 wait complete. 2020-04-22T14:11:23.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.606+0000 7fa3bd482700 1 Processor -- start 2020-04-22T14:11:23.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.606+0000 7fa3bd482700 1 -- start start 2020-04-22T14:11:23.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.607+0000 7fa3bd482700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3b8063e30 0x7fa3b80b4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:23.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.607+0000 7fa3bd482700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa3b8065fe0 0x7fa3b8152b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:23.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.607+0000 7fa3bd482700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3b8152fc0 con 0x7fa3b812c0d0 2020-04-22T14:11:23.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.607+0000 7fa3bd482700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b80b48b0 con 0x7fa3b8065fe0 2020-04-22T14:11:23.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.607+0000 7fa3bd482700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b8152180 con 0x7fa3b8063e30 2020-04-22T14:11:23.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.607+0000 7fa3b77fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa3b812c0d0 0x7fa3b8155e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44088/0 (socket says 172.21.15.103:44088) 2020-04-22T14:11:23.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.607+0000 7fa3b67fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa3b8065fe0 0x7fa3b8152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:23.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.607+0000 7fa3b77fe700 1 -- 172.21.15.103:0/2539978135 learned_addr learned my addr 172.21.15.103:0/2539978135 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:23.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.607+0000 7fa3b6ffd700 1 --2- 172.21.15.103:0/2539978135 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3b8063e30 0x7fa3b80b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:23.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.607+0000 7fa3b67fc700 1 -- 172.21.15.103:0/2539978135 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3b8063e30 msgr2=0x7fa3b80b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:23.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.607+0000 7fa3b67fc700 1 --2- 172.21.15.103:0/2539978135 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3b8063e30 0x7fa3b80b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:23.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.607+0000 7fa3b67fc700 1 -- 172.21.15.103:0/2539978135 >> v1:172.21.15.103:6789/0 conn(0x7fa3b812c0d0 legacy=0x7fa3b8155e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:23.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.607+0000 7fa3a7fff700 1 -- 172.21.15.103:0/2539978135 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1155658601 0 0) 0x7fa3b8152fc0 con 0x7fa3b812c0d0 2020-04-22T14:11:23.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.607+0000 7fa3b67fc700 1 -- 172.21.15.103:0/2539978135 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b8152420 con 0x7fa3b8065fe0 2020-04-22T14:11:23.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.607+0000 7fa3b6ffd700 1 --2- 172.21.15.103:0/2539978135 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3b8063e30 0x7fa3b80b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:11:23.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.607+0000 7fa3b67fc700 1 --2- 172.21.15.103:0/2539978135 >> v2:172.21.15.103:3300/0 conn(0x7fa3b8065fe0 0x7fa3b8152b60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa3a8002f40 tx=0x7fa3a8010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:23.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.608+0000 7fa3b67fc700 1 --2- 172.21.15.103:0/2539978135 >> v2:172.21.15.103:3300/0 conn(0x7fa3b8065fe0 0x7fa3b8152b60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa3a8002f40 tx=0x7fa3a8010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:23.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.608+0000 7fa3b67fc700 1 --2- 172.21.15.103:0/2539978135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3b8065fe0 0x7fa3b8152b60 secure :-1 s=READY pgs=920 cs=0 l=1 rx=0x7fa3a8002f40 tx=0x7fa3a8010900).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:23.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.608+0000 7fa3b67fc700 1 --2- 172.21.15.103:0/2539978135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3b8065fe0 0x7fa3b8152b60 secure :-1 s=THROTTLE_DONE pgs=920 cs=0 l=1 rx=0x7fa3a8002f40 tx=0x7fa3a8010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:23.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.608+0000 7fa3a7fff700 1 -- 172.21.15.103:0/2539978135 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3a8005cf0 con 0x7fa3b8065fe0 2020-04-22T14:11:23.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.608+0000 7fa3b67fc700 1 --2- 172.21.15.103:0/2539978135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3b8065fe0 0x7fa3b8152b60 secure :-1 s=THROTTLE_DONE pgs=920 cs=0 l=1 rx=0x7fa3a8002f40 tx=0x7fa3a8010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:23.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.608+0000 7fa3b67fc700 1 --2- 172.21.15.103:0/2539978135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3b8065fe0 0x7fa3b8152b60 secure :-1 s=THROTTLE_DONE pgs=920 cs=0 l=1 rx=0x7fa3a8002f40 tx=0x7fa3a8010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:23.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.608+0000 7fa3a7fff700 1 -- 172.21.15.103:0/2539978135 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a8005e50 con 0x7fa3b8065fe0 2020-04-22T14:11:23.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.608+0000 7fa3bd482700 1 -- 172.21.15.103:0/2539978135 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3b81526c0 con 0x7fa3b8065fe0 2020-04-22T14:11:23.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.608+0000 7fa3a7fff700 1 -- 172.21.15.103:0/2539978135 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3a8006230 con 0x7fa3b8065fe0 2020-04-22T14:11:23.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.608+0000 7fa3bd482700 1 -- 172.21.15.103:0/2539978135 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b80b5c90 con 0x7fa3b8065fe0 2020-04-22T14:11:23.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.608+0000 7fa3b67fc700 1 --2- 172.21.15.103:0/2539978135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3b8065fe0 0x7fa3b8152b60 secure :-1 s=THROTTLE_DONE pgs=920 cs=0 l=1 rx=0x7fa3a8002f40 tx=0x7fa3a8010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:23.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.609+0000 7fa3bd482700 1 -- 172.21.15.103:0/2539978135 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b8152880 con 0x7fa3b8065fe0 2020-04-22T14:11:23.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.609+0000 7fa3a7fff700 1 -- 172.21.15.103:0/2539978135 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fa3a8002180 con 0x7fa3b8065fe0 2020-04-22T14:11:23.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.609+0000 7fa3b67fc700 1 --2- 172.21.15.103:0/2539978135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3b8065fe0 0x7fa3b8152b60 secure :-1 s=THROTTLE_DONE pgs=920 cs=0 l=1 rx=0x7fa3a8002f40 tx=0x7fa3a8010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:23.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.609+0000 7fa3a7fff700 1 --2- 172.21.15.103:0/2539978135 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa39404d900 0x7fa39404fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:23.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.609+0000 7fa3a7fff700 1 -- 172.21.15.103:0/2539978135 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fa3a8061060 con 0x7fa3b8065fe0 2020-04-22T14:11:23.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.609+0000 7fa3b6ffd700 1 --2- 172.21.15.103:0/2539978135 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa39404d900 0x7fa39404fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:23.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.610+0000 7fa3b6ffd700 1 --2- 172.21.15.103:0/2539978135 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa39404d900 0x7fa39404fdc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa3b80b85b0 tx=0x7fa3ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:23.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.610+0000 7fa3b6ffd700 1 --2- 172.21.15.103:0/2539978135 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa39404d900 0x7fa39404fdc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa3b80b85b0 tx=0x7fa3ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:23.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.610+0000 7fa3b6ffd700 1 --2- 172.21.15.103:0/2539978135 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa39404d900 0x7fa39404fdc0 secure :-1 s=READY pgs=346 cs=0 l=1 rx=0x7fa3b80b85b0 tx=0x7fa3ac007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:23.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.613+0000 7fa3b67fc700 1 --2- 172.21.15.103:0/2539978135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3b8065fe0 0x7fa3b8152b60 secure :-1 s=THROTTLE_DONE pgs=920 cs=0 l=1 rx=0x7fa3a8002f40 tx=0x7fa3a8010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:23.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.613+0000 7fa3a7fff700 1 -- 172.21.15.103:0/2539978135 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fa3a80660d0 con 0x7fa3b8065fe0 2020-04-22T14:11:23.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.803+0000 7fa3bd482700 1 -- 172.21.15.103:0/2539978135 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3b8056c90 con 0x7fa3b8065fe0 2020-04-22T14:11:23.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.804+0000 7fa3b67fc700 1 --2- 172.21.15.103:0/2539978135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3b8065fe0 0x7fa3b8152b60 secure :-1 s=THROTTLE_DONE pgs=920 cs=0 l=1 rx=0x7fa3a8002f40 tx=0x7fa3a8010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:23.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.804+0000 7fa3a7fff700 1 -- 172.21.15.103:0/2539978135 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2147 (secure 0 0 0) 0x7fa3a803c440 con 0x7fa3b8065fe0 2020-04-22T14:11:23.808 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:23.808 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/1837726033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1837726033},{"type":"v1","addr":"172.21.15.86:6835","nonce":1837726033}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:03.499587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:11:23.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.805+0000 7fa3bd482700 1 -- 172.21.15.103:0/2539978135 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa39404d900 msgr2=0x7fa39404fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:23.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.805+0000 7fa3bd482700 1 --2- 172.21.15.103:0/2539978135 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa39404d900 0x7fa39404fdc0 secure :-1 s=READY pgs=346 cs=0 l=1 rx=0x7fa3b80b85b0 tx=0x7fa3ac007a40).stop 2020-04-22T14:11:23.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.805+0000 7fa3bd482700 1 -- 172.21.15.103:0/2539978135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3b8065fe0 msgr2=0x7fa3b8152b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:23.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.805+0000 7fa3bd482700 1 --2- 172.21.15.103:0/2539978135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3b8065fe0 0x7fa3b8152b60 secure :-1 s=READY pgs=920 cs=0 l=1 rx=0x7fa3a8002f40 tx=0x7fa3a8010900).stop 2020-04-22T14:11:23.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.805+0000 7fa3bd482700 1 -- 172.21.15.103:0/2539978135 shutdown_connections 2020-04-22T14:11:23.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.805+0000 7fa3bd482700 1 --2- 172.21.15.103:0/2539978135 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa39404d900 0x7fa39404fdc0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:23.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.805+0000 7fa3bd482700 1 --2- 172.21.15.103:0/2539978135 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3b8063e30 0x7fa3b80b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:23.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.805+0000 7fa3bd482700 1 --2- 172.21.15.103:0/2539978135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3b8065fe0 0x7fa3b8152b60 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:23.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.805+0000 7fa3bd482700 1 -- 172.21.15.103:0/2539978135 >> 172.21.15.103:0/2539978135 conn(0x7fa3b80b9160 msgr2=0x7fa3b805ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:23.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.805+0000 7fa3bd482700 1 -- 172.21.15.103:0/2539978135 shutdown_connections 2020-04-22T14:11:23.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:23.805+0000 7fa3bd482700 1 -- 172.21.15.103:0/2539978135 wait complete. 2020-04-22T14:11:23.811 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 41 2020-04-22T14:11:23.819 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:11:24.820 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:24.837 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:11:24.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.990+0000 7fb4720cf700 1 Processor -- start 2020-04-22T14:11:24.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.990+0000 7fb4720cf700 1 -- start start 2020-04-22T14:11:24.996 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.991+0000 7fb4720cf700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb46c1464e0 0x7fb46c064540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:24.996 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.991+0000 7fb4720cf700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb46c143300 con 0x7fb46c12c0d0 2020-04-22T14:11:24.996 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.991+0000 7fb4720cf700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb46c1435a0 con 0x7fb46c065fe0 2020-04-22T14:11:24.996 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.991+0000 7fb4720cf700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb46c143840 con 0x7fb46c1464e0 2020-04-22T14:11:24.996 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.991+0000 7fb46affd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb46c065fe0 0x7fb46c063e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44094/0 (socket says 172.21.15.103:44094) 2020-04-22T14:11:24.997 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.991+0000 7fb46affd700 1 -- 172.21.15.103:0/3925853994 learned_addr learned my addr 172.21.15.103:0/3925853994 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:24.997 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.991+0000 7fb46bfff700 1 --2- 172.21.15.103:0/3925853994 >> v2:172.21.15.86:3300/0 conn(0x7fb46c1464e0 0x7fb46c064540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:24.997 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.991+0000 7fb46a7fc700 1 -- 172.21.15.103:0/3925853994 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1988179370 0 0) 0x7fb46c1435a0 con 0x7fb46c065fe0 2020-04-22T14:11:24.997 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.991+0000 7fb46a7fc700 1 -- 172.21.15.103:0/3925853994 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb458003230 con 0x7fb46c065fe0 2020-04-22T14:11:24.997 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.991+0000 7fb46a7fc700 1 -- 172.21.15.103:0/3925853994 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 840055490 0 0) 0x7fb458003230 con 0x7fb46c065fe0 2020-04-22T14:11:24.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.991+0000 7fb46bfff700 1 -- 172.21.15.103:0/3925853994 >> v1:172.21.15.103:6789/0 conn(0x7fb46c065fe0 legacy=0x7fb46c063e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:24.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.991+0000 7fb46bfff700 1 -- 172.21.15.103:0/3925853994 >> v1:172.21.15.86:6789/0 conn(0x7fb46c12c0d0 legacy=0x7fb46c05b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:24.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.991+0000 7fb46bfff700 1 -- 172.21.15.103:0/3925853994 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb46c05bb50 con 0x7fb46c1464e0 2020-04-22T14:11:24.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.992+0000 7fb46bfff700 1 --2- 172.21.15.103:0/3925853994 >> v2:172.21.15.86:3300/0 conn(0x7fb46c1464e0 0x7fb46c064540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb46c067500 tx=0x7fb4640088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:24.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.992+0000 7fb46bfff700 1 --2- 172.21.15.103:0/3925853994 >> v2:172.21.15.86:3300/0 conn(0x7fb46c1464e0 0x7fb46c064540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb46c067500 tx=0x7fb4640088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:24.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.992+0000 7fb46bfff700 1 --2- 172.21.15.103:0/3925853994 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb46c1464e0 0x7fb46c064540 secure :-1 s=READY pgs=525 cs=0 l=1 rx=0x7fb46c067500 tx=0x7fb4640088e0).ready entity=mon.0 client_cookie=54102d0313b6e8b1 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:24.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.992+0000 7fb46bfff700 1 --2- 172.21.15.103:0/3925853994 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb46c1464e0 0x7fb46c064540 secure :-1 s=THROTTLE_DONE pgs=525 cs=0 l=1 rx=0x7fb46c067500 tx=0x7fb4640088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:24.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.992+0000 7fb46a7fc700 1 -- 172.21.15.103:0/3925853994 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4600016d0 con 0x7fb46c1464e0 2020-04-22T14:11:24.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.992+0000 7fb46bfff700 1 --2- 172.21.15.103:0/3925853994 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb46c1464e0 0x7fb46c064540 secure :-1 s=THROTTLE_DONE pgs=525 cs=0 l=1 rx=0x7fb46c067500 tx=0x7fb4640088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:24.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.992+0000 7fb46a7fc700 1 -- 172.21.15.103:0/3925853994 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb464008b40 con 0x7fb46c1464e0 2020-04-22T14:11:24.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.992+0000 7fb46bfff700 1 --2- 172.21.15.103:0/3925853994 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb46c1464e0 0x7fb46c064540 secure :-1 s=THROTTLE_DONE pgs=525 cs=0 l=1 rx=0x7fb46c067500 tx=0x7fb4640088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:25.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.992+0000 7fb46a7fc700 1 -- 172.21.15.103:0/3925853994 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb464008ea0 con 0x7fb46c1464e0 2020-04-22T14:11:25.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.992+0000 7fb4720cf700 1 -- 172.21.15.103:0/3925853994 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb46c1464e0 msgr2=0x7fb46c064540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:25.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.992+0000 7fb4720cf700 1 --2- 172.21.15.103:0/3925853994 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb46c1464e0 0x7fb46c064540 secure :-1 s=READY pgs=525 cs=0 l=1 rx=0x7fb46c067500 tx=0x7fb4640088e0).stop 2020-04-22T14:11:25.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.992+0000 7fb4720cf700 1 -- 172.21.15.103:0/3925853994 shutdown_connections 2020-04-22T14:11:25.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.992+0000 7fb4720cf700 1 --2- 172.21.15.103:0/3925853994 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb46c1464e0 0x7fb46c064540 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:25.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.992+0000 7fb4720cf700 1 -- 172.21.15.103:0/3925853994 >> 172.21.15.103:0/3925853994 conn(0x7fb46c0b9160 msgr2=0x7fb46c05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:25.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.992+0000 7fb4720cf700 1 -- 172.21.15.103:0/3925853994 shutdown_connections 2020-04-22T14:11:25.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.992+0000 7fb4720cf700 1 -- 172.21.15.103:0/3925853994 wait complete. 2020-04-22T14:11:25.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.993+0000 7fb4720cf700 1 Processor -- start 2020-04-22T14:11:25.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.994+0000 7fb4720cf700 1 -- start start 2020-04-22T14:11:25.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.994+0000 7fb4720cf700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb46c065fe0 0x7fb46c1422c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:25.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.994+0000 7fb4720cf700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb46c12c0d0 0x7fb46c144f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:25.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.994+0000 7fb4720cf700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb46c11e960 con 0x7fb46c1464e0 2020-04-22T14:11:25.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.994+0000 7fb4720cf700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb46c120070 con 0x7fb46c065fe0 2020-04-22T14:11:25.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.994+0000 7fb4720cf700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c127dd0 con 0x7fb46c12c0d0 2020-04-22T14:11:25.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.994+0000 7fb46b7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb46c065fe0 0x7fb46c1422c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:25.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.994+0000 7fb46b7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb46c065fe0 0x7fb46c1422c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51908/0 (socket says 172.21.15.103:51908) 2020-04-22T14:11:25.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.994+0000 7fb46b7fe700 1 -- 172.21.15.103:0/4256710885 learned_addr learned my addr 172.21.15.103:0/4256710885 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:25.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.995+0000 7fb46affd700 1 --2- 172.21.15.103:0/4256710885 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb46c12c0d0 0x7fb46c144f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:25.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.995+0000 7fb46b7fe700 1 -- 172.21.15.103:0/4256710885 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb46c12c0d0 msgr2=0x7fb46c144f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:25.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.995+0000 7fb46b7fe700 1 --2- 172.21.15.103:0/4256710885 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb46c12c0d0 0x7fb46c144f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:25.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.995+0000 7fb46b7fe700 1 -- 172.21.15.103:0/4256710885 >> v1:172.21.15.86:6789/0 conn(0x7fb46c1464e0 legacy=0x7fb46c12a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:25.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.995+0000 7fb46b7fe700 1 -- 172.21.15.103:0/4256710885 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb46c129490 con 0x7fb46c065fe0 2020-04-22T14:11:25.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.995+0000 7fb46b7fe700 1 --2- 172.21.15.103:0/4256710885 >> v2:172.21.15.103:3300/0 conn(0x7fb46c065fe0 0x7fb46c1422c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb45c001510 tx=0x7fb45c010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:25.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.995+0000 7fb46b7fe700 1 --2- 172.21.15.103:0/4256710885 >> v2:172.21.15.103:3300/0 conn(0x7fb46c065fe0 0x7fb46c1422c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb45c001510 tx=0x7fb45c010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:25.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.995+0000 7fb46b7fe700 1 --2- 172.21.15.103:0/4256710885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb46c065fe0 0x7fb46c1422c0 secure :-1 s=READY pgs=922 cs=0 l=1 rx=0x7fb45c001510 tx=0x7fb45c010f20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:25.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.995+0000 7fb46b7fe700 1 --2- 172.21.15.103:0/4256710885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb46c065fe0 0x7fb46c1422c0 secure :-1 s=THROTTLE_DONE pgs=922 cs=0 l=1 rx=0x7fb45c001510 tx=0x7fb45c010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:25.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.995+0000 7fb468ff9700 1 -- 172.21.15.103:0/4256710885 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb45c0101e0 con 0x7fb46c065fe0 2020-04-22T14:11:25.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.995+0000 7fb46b7fe700 1 --2- 172.21.15.103:0/4256710885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb46c065fe0 0x7fb46c1422c0 secure :-1 s=THROTTLE_DONE pgs=922 cs=0 l=1 rx=0x7fb45c001510 tx=0x7fb45c010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:25.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.995+0000 7fb468ff9700 1 -- 172.21.15.103:0/4256710885 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45c010340 con 0x7fb46c065fe0 2020-04-22T14:11:25.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.995+0000 7fb46b7fe700 1 --2- 172.21.15.103:0/4256710885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb46c065fe0 0x7fb46c1422c0 secure :-1 s=THROTTLE_DONE pgs=922 cs=0 l=1 rx=0x7fb45c001510 tx=0x7fb45c010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:25.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.995+0000 7fb4720cf700 1 -- 172.21.15.103:0/4256710885 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb46c129730 con 0x7fb46c065fe0 2020-04-22T14:11:25.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.995+0000 7fb468ff9700 1 -- 172.21.15.103:0/4256710885 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb45c010760 con 0x7fb46c065fe0 2020-04-22T14:11:25.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.995+0000 7fb4720cf700 1 -- 172.21.15.103:0/4256710885 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb46c120670 con 0x7fb46c065fe0 2020-04-22T14:11:25.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.996+0000 7fb46b7fe700 1 --2- 172.21.15.103:0/4256710885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb46c065fe0 0x7fb46c1422c0 secure :-1 s=THROTTLE_DONE pgs=922 cs=0 l=1 rx=0x7fb45c001510 tx=0x7fb45c010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:25.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.996+0000 7fb4720cf700 1 -- 172.21.15.103:0/4256710885 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb46c12a600 con 0x7fb46c065fe0 2020-04-22T14:11:25.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.996+0000 7fb468ff9700 1 -- 172.21.15.103:0/4256710885 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fb45c006860 con 0x7fb46c065fe0 2020-04-22T14:11:25.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.996+0000 7fb46b7fe700 1 --2- 172.21.15.103:0/4256710885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb46c065fe0 0x7fb46c1422c0 secure :-1 s=THROTTLE_DONE pgs=922 cs=0 l=1 rx=0x7fb45c001510 tx=0x7fb45c010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:25.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.996+0000 7fb468ff9700 1 --2- 172.21.15.103:0/4256710885 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb44c04d9a0 0x7fb44c04fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:25.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.996+0000 7fb468ff9700 1 -- 172.21.15.103:0/4256710885 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fb45c061720 con 0x7fb46c065fe0 2020-04-22T14:11:25.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.997+0000 7fb46affd700 1 --2- 172.21.15.103:0/4256710885 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb44c04d9a0 0x7fb44c04fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:25.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.997+0000 7fb46affd700 1 --2- 172.21.15.103:0/4256710885 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb44c04d9a0 0x7fb44c04fe60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb460001930 tx=0x7fb460001e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:25.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.997+0000 7fb46affd700 1 --2- 172.21.15.103:0/4256710885 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb44c04d9a0 0x7fb44c04fe60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb460001930 tx=0x7fb460001e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:25.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:24.997+0000 7fb46affd700 1 --2- 172.21.15.103:0/4256710885 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb44c04d9a0 0x7fb44c04fe60 secure :-1 s=READY pgs=347 cs=0 l=1 rx=0x7fb460001930 tx=0x7fb460001e20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:25.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:25.000+0000 7fb46b7fe700 1 --2- 172.21.15.103:0/4256710885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb46c065fe0 0x7fb46c1422c0 secure :-1 s=THROTTLE_DONE pgs=922 cs=0 l=1 rx=0x7fb45c001510 tx=0x7fb45c010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:25.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:25.000+0000 7fb468ff9700 1 -- 172.21.15.103:0/4256710885 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fb45c03caa0 con 0x7fb46c065fe0 2020-04-22T14:11:25.194 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:25.191+0000 7fb4720cf700 1 -- 172.21.15.103:0/4256710885 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb46c056c90 con 0x7fb46c065fe0 2020-04-22T14:11:25.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:25.191+0000 7fb46b7fe700 1 --2- 172.21.15.103:0/4256710885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb46c065fe0 0x7fb46c1422c0 secure :-1 s=THROTTLE_DONE pgs=922 cs=0 l=1 rx=0x7fb45c001510 tx=0x7fb45c010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:25.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:25.191+0000 7fb468ff9700 1 -- 172.21.15.103:0/4256710885 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2147 (secure 0 0 0) 0x7fb45c0400c0 con 0x7fb46c065fe0 2020-04-22T14:11:25.195 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:25.195 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/1837726033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1837726033},{"type":"v1","addr":"172.21.15.86:6835","nonce":1837726033}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:03.499587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:11:25.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:25.192+0000 7fb4720cf700 1 -- 172.21.15.103:0/4256710885 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb44c04d9a0 msgr2=0x7fb44c04fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:25.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:25.192+0000 7fb4720cf700 1 --2- 172.21.15.103:0/4256710885 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb44c04d9a0 0x7fb44c04fe60 secure :-1 s=READY pgs=347 cs=0 l=1 rx=0x7fb460001930 tx=0x7fb460001e20).stop 2020-04-22T14:11:25.197 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:25.192+0000 7fb4720cf700 1 -- 172.21.15.103:0/4256710885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb46c065fe0 msgr2=0x7fb46c1422c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:25.197 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:25.192+0000 7fb4720cf700 1 --2- 172.21.15.103:0/4256710885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb46c065fe0 0x7fb46c1422c0 secure :-1 s=READY pgs=922 cs=0 l=1 rx=0x7fb45c001510 tx=0x7fb45c010f20).stop 2020-04-22T14:11:25.197 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:25.193+0000 7fb4720cf700 1 -- 172.21.15.103:0/4256710885 shutdown_connections 2020-04-22T14:11:25.197 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:25.193+0000 7fb4720cf700 1 --2- 172.21.15.103:0/4256710885 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb44c04d9a0 0x7fb44c04fe60 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:25.197 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:25.193+0000 7fb4720cf700 1 --2- 172.21.15.103:0/4256710885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb46c065fe0 0x7fb46c1422c0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:25.197 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:25.193+0000 7fb4720cf700 1 --2- 172.21.15.103:0/4256710885 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb46c12c0d0 0x7fb46c144f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:25.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:25.193+0000 7fb4720cf700 1 -- 172.21.15.103:0/4256710885 >> 172.21.15.103:0/4256710885 conn(0x7fb46c0b9160 msgr2=0x7fb46c061dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:25.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:25.193+0000 7fb4720cf700 1 -- 172.21.15.103:0/4256710885 shutdown_connections 2020-04-22T14:11:25.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:25.193+0000 7fb4720cf700 1 -- 172.21.15.103:0/4256710885 wait complete. 2020-04-22T14:11:25.198 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 41 2020-04-22T14:11:25.207 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:11:26.208 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:26.225 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:11:26.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.380+0000 7f15a92f4700 1 Processor -- start 2020-04-22T14:11:26.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.380+0000 7f15a92f4700 1 -- start start 2020-04-22T14:11:26.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.381+0000 7f15a92f4700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f15a4065fe0 0x7f15a41464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:26.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.381+0000 7f15a92f4700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15a4143300 con 0x7f15a4063e30 2020-04-22T14:11:26.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.381+0000 7f15a92f4700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15a41435a0 con 0x7f15a412c0d0 2020-04-22T14:11:26.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.381+0000 7f15a92f4700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15a4143840 con 0x7f15a4065fe0 2020-04-22T14:11:26.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.381+0000 7f15a27fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f15a4065fe0 0x7f15a41464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:26.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.381+0000 7f15a2ffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f15a412c0d0 0x7f15a405b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44106/0 (socket says 172.21.15.103:44106) 2020-04-22T14:11:26.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.381+0000 7f15a2ffd700 1 -- 172.21.15.103:0/4266166686 learned_addr learned my addr 172.21.15.103:0/4266166686 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:26.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.381+0000 7f15a27fc700 1 -- 172.21.15.103:0/4266166686 >> v1:172.21.15.103:6789/0 conn(0x7f15a412c0d0 legacy=0x7f15a405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:26.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.381+0000 7f15a27fc700 1 -- 172.21.15.103:0/4266166686 >> v1:172.21.15.86:6789/0 conn(0x7f15a4063e30 legacy=0x7f15a40642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:26.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.381+0000 7f15a27fc700 1 -- 172.21.15.103:0/4266166686 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a405bb50 con 0x7f15a4065fe0 2020-04-22T14:11:26.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.381+0000 7f15a27fc700 1 --2- 172.21.15.103:0/4266166686 >> v2:172.21.15.103:3300/0 conn(0x7f15a4065fe0 0x7f15a41464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f15a40669a0 tx=0x7f1590007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:26.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.381+0000 7f15a27fc700 1 --2- 172.21.15.103:0/4266166686 >> v2:172.21.15.103:3300/0 conn(0x7f15a4065fe0 0x7f15a41464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f15a40669a0 tx=0x7f1590007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:26.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.381+0000 7f15a27fc700 1 --2- 172.21.15.103:0/4266166686 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15a4065fe0 0x7f15a41464e0 secure :-1 s=READY pgs=924 cs=0 l=1 rx=0x7f15a40669a0 tx=0x7f1590007a40).ready entity=mon.1 client_cookie=e5f504e95a5a645d server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:26.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.381+0000 7f15a27fc700 1 --2- 172.21.15.103:0/4266166686 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15a4065fe0 0x7f15a41464e0 secure :-1 s=THROTTLE_DONE pgs=924 cs=0 l=1 rx=0x7f15a40669a0 tx=0x7f1590007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:26.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.381+0000 7f15a1ffb700 1 -- 172.21.15.103:0/4266166686 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1590011430 con 0x7f15a4065fe0 2020-04-22T14:11:26.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.381+0000 7f15a27fc700 1 --2- 172.21.15.103:0/4266166686 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15a4065fe0 0x7f15a41464e0 secure :-1 s=THROTTLE_DONE pgs=924 cs=0 l=1 rx=0x7f15a40669a0 tx=0x7f1590007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:26.408 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.381+0000 7f15a27fc700 1 --2- 172.21.15.103:0/4266166686 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15a4065fe0 0x7f15a41464e0 secure :-1 s=THROTTLE_DONE pgs=924 cs=0 l=1 rx=0x7f15a40669a0 tx=0x7f1590007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:26.408 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.381+0000 7f15a1ffb700 1 -- 172.21.15.103:0/4266166686 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1590011590 con 0x7f15a4065fe0 2020-04-22T14:11:26.408 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.381+0000 7f15a1ffb700 1 -- 172.21.15.103:0/4266166686 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15900119b0 con 0x7f15a4065fe0 2020-04-22T14:11:26.408 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.381+0000 7f15a92f4700 1 -- 172.21.15.103:0/4266166686 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15a4065fe0 msgr2=0x7f15a41464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:26.408 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.381+0000 7f15a92f4700 1 --2- 172.21.15.103:0/4266166686 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15a4065fe0 0x7f15a41464e0 secure :-1 s=READY pgs=924 cs=0 l=1 rx=0x7f15a40669a0 tx=0x7f1590007a40).stop 2020-04-22T14:11:26.408 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.382+0000 7f15a92f4700 1 -- 172.21.15.103:0/4266166686 shutdown_connections 2020-04-22T14:11:26.408 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.382+0000 7f15a92f4700 1 --2- 172.21.15.103:0/4266166686 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15a4065fe0 0x7f15a41464e0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:26.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.382+0000 7f15a92f4700 1 -- 172.21.15.103:0/4266166686 >> 172.21.15.103:0/4266166686 conn(0x7f15a40b9160 msgr2=0x7f15a405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:26.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.382+0000 7f15a92f4700 1 -- 172.21.15.103:0/4266166686 shutdown_connections 2020-04-22T14:11:26.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.382+0000 7f15a92f4700 1 -- 172.21.15.103:0/4266166686 wait complete. 2020-04-22T14:11:26.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.383+0000 7f15a92f4700 1 Processor -- start 2020-04-22T14:11:26.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.383+0000 7f15a92f4700 1 -- start start 2020-04-22T14:11:26.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.384+0000 7f15a92f4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15a4063e30 0x7f15a40b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:26.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.384+0000 7f15a92f4700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f15a4065fe0 0x7f15a40b1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:26.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.384+0000 7f15a92f4700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f15a412c0d0 0x7f15a40b6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:26.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.384+0000 7f15a92f4700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15a40b6d80 con 0x7f15a412c0d0 2020-04-22T14:11:26.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.384+0000 7f15a92f4700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15a40b2b70 con 0x7f15a4065fe0 2020-04-22T14:11:26.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.384+0000 7f15a92f4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a40b2e10 con 0x7f15a4063e30 2020-04-22T14:11:26.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.384+0000 7f15a27fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f15a4065fe0 0x7f15a40b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:26.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.384+0000 7f15a27fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f15a4065fe0 0x7f15a40b1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51924/0 (socket says 172.21.15.103:51924) 2020-04-22T14:11:26.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.384+0000 7f15a27fc700 1 -- 172.21.15.103:0/3540214031 learned_addr learned my addr 172.21.15.103:0/3540214031 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:26.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.384+0000 7f15a2ffd700 1 --2- 172.21.15.103:0/3540214031 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15a4063e30 0x7f15a40b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:26.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.384+0000 7f15a37fe700 1 --2- 172.21.15.103:0/3540214031 >> v2:172.21.15.86:3300/0 conn(0x7f15a412c0d0 0x7f15a40b6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:26.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.384+0000 7f15a27fc700 1 -- 172.21.15.103:0/3540214031 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15a4063e30 msgr2=0x7f15a40b25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:26.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.384+0000 7f15a27fc700 1 --2- 172.21.15.103:0/3540214031 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15a4063e30 0x7f15a40b25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:26.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.384+0000 7f15a27fc700 1 -- 172.21.15.103:0/3540214031 >> v2:172.21.15.86:3300/0 conn(0x7f15a412c0d0 msgr2=0x7f15a40b6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:26.412 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.384+0000 7f15a27fc700 1 --2- 172.21.15.103:0/3540214031 >> v2:172.21.15.86:3300/0 conn(0x7f15a412c0d0 0x7f15a40b6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:26.412 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.384+0000 7f15a27fc700 1 -- 172.21.15.103:0/3540214031 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a40b30b0 con 0x7f15a4065fe0 2020-04-22T14:11:26.412 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.384+0000 7f15a2ffd700 1 --2- 172.21.15.103:0/3540214031 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15a4063e30 0x7f15a40b25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:11:26.412 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.384+0000 7f15a27fc700 1 --2- 172.21.15.103:0/3540214031 >> v2:172.21.15.103:3300/0 conn(0x7f15a4065fe0 0x7f15a40b1260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f15a40669a0 tx=0x7f1590007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:26.412 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.384+0000 7f15a27fc700 1 --2- 172.21.15.103:0/3540214031 >> v2:172.21.15.103:3300/0 conn(0x7f15a4065fe0 0x7f15a40b1260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f15a40669a0 tx=0x7f1590007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:26.412 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.384+0000 7f15a27fc700 1 --2- 172.21.15.103:0/3540214031 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15a4065fe0 0x7f15a40b1260 secure :-1 s=READY pgs=925 cs=0 l=1 rx=0x7f15a40669a0 tx=0x7f1590007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:26.412 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.384+0000 7f15a27fc700 1 --2- 172.21.15.103:0/3540214031 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15a4065fe0 0x7f15a40b1260 secure :-1 s=THROTTLE_DONE pgs=925 cs=0 l=1 rx=0x7f15a40669a0 tx=0x7f1590007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:26.413 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.384+0000 7f15a27fc700 1 --2- 172.21.15.103:0/3540214031 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15a4065fe0 0x7f15a40b1260 secure :-1 s=THROTTLE_DONE pgs=925 cs=0 l=1 rx=0x7f15a40669a0 tx=0x7f1590007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:26.413 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.384+0000 7f159bfff700 1 -- 172.21.15.103:0/3540214031 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1590007170 con 0x7f15a4065fe0 2020-04-22T14:11:26.413 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.384+0000 7f15a27fc700 1 --2- 172.21.15.103:0/3540214031 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15a4065fe0 0x7f15a40b1260 secure :-1 s=THROTTLE_DONE pgs=925 cs=0 l=1 rx=0x7f15a40669a0 tx=0x7f1590007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:26.413 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.384+0000 7f159bfff700 1 -- 172.21.15.103:0/3540214031 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15900072d0 con 0x7f15a4065fe0 2020-04-22T14:11:26.413 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.384+0000 7f15a92f4700 1 -- 172.21.15.103:0/3540214031 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15a40b2350 con 0x7f15a4065fe0 2020-04-22T14:11:26.413 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.384+0000 7f159bfff700 1 -- 172.21.15.103:0/3540214031 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15900056c0 con 0x7f15a4065fe0 2020-04-22T14:11:26.413 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.384+0000 7f15a92f4700 1 -- 172.21.15.103:0/3540214031 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15a40aebf0 con 0x7f15a4065fe0 2020-04-22T14:11:26.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.385+0000 7f15a27fc700 1 --2- 172.21.15.103:0/3540214031 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15a4065fe0 0x7f15a40b1260 secure :-1 s=THROTTLE_DONE pgs=925 cs=0 l=1 rx=0x7f15a40669a0 tx=0x7f1590007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:26.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.385+0000 7f159bfff700 1 -- 172.21.15.103:0/3540214031 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f1590005930 con 0x7f15a4065fe0 2020-04-22T14:11:26.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.385+0000 7f15a27fc700 1 --2- 172.21.15.103:0/3540214031 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15a4065fe0 0x7f15a40b1260 secure :-1 s=THROTTLE_DONE pgs=925 cs=0 l=1 rx=0x7f15a40669a0 tx=0x7f1590007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:26.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.385+0000 7f15a92f4700 1 -- 172.21.15.103:0/3540214031 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15a40b3240 con 0x7f15a4065fe0 2020-04-22T14:11:26.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.386+0000 7f159bfff700 1 --2- 172.21.15.103:0/3540214031 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f158004da00 0x7f158004fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:26.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.386+0000 7f159bfff700 1 -- 172.21.15.103:0/3540214031 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f1590061c80 con 0x7f15a4065fe0 2020-04-22T14:11:26.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.386+0000 7f15a2ffd700 1 --2- 172.21.15.103:0/3540214031 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f158004da00 0x7f158004fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:26.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.386+0000 7f15a2ffd700 1 --2- 172.21.15.103:0/3540214031 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f158004da00 0x7f158004fec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f15a40b85b0 tx=0x7f159c001a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:26.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.386+0000 7f15a2ffd700 1 --2- 172.21.15.103:0/3540214031 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f158004da00 0x7f158004fec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f15a40b85b0 tx=0x7f159c001a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:26.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.386+0000 7f15a2ffd700 1 --2- 172.21.15.103:0/3540214031 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f158004da00 0x7f158004fec0 secure :-1 s=READY pgs=348 cs=0 l=1 rx=0x7f15a40b85b0 tx=0x7f159c001a60).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:26.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.390+0000 7f15a27fc700 1 --2- 172.21.15.103:0/3540214031 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15a4065fe0 0x7f15a40b1260 secure :-1 s=THROTTLE_DONE pgs=925 cs=0 l=1 rx=0x7f15a40669a0 tx=0x7f1590007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:26.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.390+0000 7f159bfff700 1 -- 172.21.15.103:0/3540214031 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f159003d180 con 0x7f15a4065fe0 2020-04-22T14:11:26.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.580+0000 7f15a92f4700 1 -- 172.21.15.103:0/3540214031 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f15a40af280 con 0x7f15a4065fe0 2020-04-22T14:11:26.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.581+0000 7f15a27fc700 1 --2- 172.21.15.103:0/3540214031 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15a4065fe0 0x7f15a40b1260 secure :-1 s=THROTTLE_DONE pgs=925 cs=0 l=1 rx=0x7f15a40669a0 tx=0x7f1590007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:26.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.581+0000 7f159bfff700 1 -- 172.21.15.103:0/3540214031 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f15900407a0 con 0x7f15a4065fe0 2020-04-22T14:11:26.585 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:26.585 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/1837726033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1837726033},{"type":"v1","addr":"172.21.15.86:6835","nonce":1837726033}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:03.499587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:11:26.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.582+0000 7f15a92f4700 1 -- 172.21.15.103:0/3540214031 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f158004da00 msgr2=0x7f158004fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:26.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.582+0000 7f15a92f4700 1 --2- 172.21.15.103:0/3540214031 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f158004da00 0x7f158004fec0 secure :-1 s=READY pgs=348 cs=0 l=1 rx=0x7f15a40b85b0 tx=0x7f159c001a60).stop 2020-04-22T14:11:26.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.582+0000 7f15a92f4700 1 -- 172.21.15.103:0/3540214031 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15a4065fe0 msgr2=0x7f15a40b1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:26.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.582+0000 7f15a92f4700 1 --2- 172.21.15.103:0/3540214031 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15a4065fe0 0x7f15a40b1260 secure :-1 s=READY pgs=925 cs=0 l=1 rx=0x7f15a40669a0 tx=0x7f1590007a40).stop 2020-04-22T14:11:26.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.582+0000 7f15a92f4700 1 -- 172.21.15.103:0/3540214031 shutdown_connections 2020-04-22T14:11:26.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.582+0000 7f15a92f4700 1 --2- 172.21.15.103:0/3540214031 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f158004da00 0x7f158004fec0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:26.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.582+0000 7f15a92f4700 1 --2- 172.21.15.103:0/3540214031 >> v2:172.21.15.86:3300/0 conn(0x7f15a412c0d0 0x7f15a40b6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:26.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.582+0000 7f15a92f4700 1 --2- 172.21.15.103:0/3540214031 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15a4063e30 0x7f15a40b25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:26.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.582+0000 7f15a92f4700 1 --2- 172.21.15.103:0/3540214031 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15a4065fe0 0x7f15a40b1260 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:26.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.582+0000 7f15a92f4700 1 -- 172.21.15.103:0/3540214031 >> 172.21.15.103:0/3540214031 conn(0x7f15a40b9160 msgr2=0x7f15a4064a90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:26.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.582+0000 7f15a92f4700 1 -- 172.21.15.103:0/3540214031 shutdown_connections 2020-04-22T14:11:26.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:26.582+0000 7f15a92f4700 1 -- 172.21.15.103:0/3540214031 wait complete. 2020-04-22T14:11:26.588 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 41 2020-04-22T14:11:26.596 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:11:27.601 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:27.619 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:11:27.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.773+0000 7f74d7e0b700 1 Processor -- start 2020-04-22T14:11:27.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.774+0000 7f74d7e0b700 1 -- start start 2020-04-22T14:11:27.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.774+0000 7f74d7e0b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f74d012c0d0 0x7f74d01464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:27.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.774+0000 7f74d7e0b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74d0143300 con 0x7f74d0063e30 2020-04-22T14:11:27.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.774+0000 7f74d7e0b700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74d01435a0 con 0x7f74d0065fe0 2020-04-22T14:11:27.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.774+0000 7f74d7e0b700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74d0143840 con 0x7f74d012c0d0 2020-04-22T14:11:27.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.775+0000 7f74d5ba7700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f74d012c0d0 0x7f74d01464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:27.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.775+0000 7f74d53a6700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f74d0065fe0 0x7f74d005b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44120/0 (socket says 172.21.15.103:44120) 2020-04-22T14:11:27.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.775+0000 7f74d5ba7700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f74d012c0d0 0x7f74d01464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51932/0 (socket says 172.21.15.103:51932) 2020-04-22T14:11:27.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.775+0000 7f74d53a6700 1 -- 172.21.15.103:0/4225834850 learned_addr learned my addr 172.21.15.103:0/4225834850 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:27.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.775+0000 7f74d5ba7700 1 -- 172.21.15.103:0/4225834850 >> v1:172.21.15.103:6789/0 conn(0x7f74d0065fe0 legacy=0x7f74d005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:27.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.775+0000 7f74d5ba7700 1 -- 172.21.15.103:0/4225834850 >> v1:172.21.15.86:6789/0 conn(0x7f74d0063e30 legacy=0x7f74d00642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:27.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.775+0000 7f74d4ba5700 1 -- 172.21.15.103:0/4225834850 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4094387023 0 0) 0x7f74d01435a0 con 0x7f74d0065fe0 2020-04-22T14:11:27.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.775+0000 7f74d5ba7700 1 -- 172.21.15.103:0/4225834850 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d005bb50 con 0x7f74d012c0d0 2020-04-22T14:11:27.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.775+0000 7f74d5ba7700 1 --2- 172.21.15.103:0/4225834850 >> v2:172.21.15.103:3300/0 conn(0x7f74d012c0d0 0x7f74d01464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f74c0002f30 tx=0x7f74c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:27.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.775+0000 7f74d5ba7700 1 --2- 172.21.15.103:0/4225834850 >> v2:172.21.15.103:3300/0 conn(0x7f74d012c0d0 0x7f74d01464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f74c0002f30 tx=0x7f74c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:27.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.775+0000 7f74d5ba7700 1 --2- 172.21.15.103:0/4225834850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74d012c0d0 0x7f74d01464e0 secure :-1 s=READY pgs=927 cs=0 l=1 rx=0x7f74c0002f30 tx=0x7f74c0007a40).ready entity=mon.1 client_cookie=90c4e7f99ba21aa9 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:27.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.775+0000 7f74d5ba7700 1 --2- 172.21.15.103:0/4225834850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74d012c0d0 0x7f74d01464e0 secure :-1 s=THROTTLE_DONE pgs=927 cs=0 l=1 rx=0x7f74c0002f30 tx=0x7f74c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:27.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.775+0000 7f74d4ba5700 1 -- 172.21.15.103:0/4225834850 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74c0011470 con 0x7f74d012c0d0 2020-04-22T14:11:27.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.775+0000 7f74d5ba7700 1 --2- 172.21.15.103:0/4225834850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74d012c0d0 0x7f74d01464e0 secure :-1 s=THROTTLE_DONE pgs=927 cs=0 l=1 rx=0x7f74c0002f30 tx=0x7f74c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:27.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.775+0000 7f74d4ba5700 1 -- 172.21.15.103:0/4225834850 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c00115d0 con 0x7f74d012c0d0 2020-04-22T14:11:27.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.775+0000 7f74d5ba7700 1 --2- 172.21.15.103:0/4225834850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74d012c0d0 0x7f74d01464e0 secure :-1 s=THROTTLE_DONE pgs=927 cs=0 l=1 rx=0x7f74c0002f30 tx=0x7f74c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:27.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.775+0000 7f74d4ba5700 1 -- 172.21.15.103:0/4225834850 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74c00119f0 con 0x7f74d012c0d0 2020-04-22T14:11:27.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.775+0000 7f74d7e0b700 1 -- 172.21.15.103:0/4225834850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74d012c0d0 msgr2=0x7f74d01464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:27.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.775+0000 7f74d7e0b700 1 --2- 172.21.15.103:0/4225834850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74d012c0d0 0x7f74d01464e0 secure :-1 s=READY pgs=927 cs=0 l=1 rx=0x7f74c0002f30 tx=0x7f74c0007a40).stop 2020-04-22T14:11:27.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.776+0000 7f74d7e0b700 1 -- 172.21.15.103:0/4225834850 shutdown_connections 2020-04-22T14:11:27.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.776+0000 7f74d7e0b700 1 --2- 172.21.15.103:0/4225834850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74d012c0d0 0x7f74d01464e0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:27.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.776+0000 7f74d7e0b700 1 -- 172.21.15.103:0/4225834850 >> 172.21.15.103:0/4225834850 conn(0x7f74d00b9160 msgr2=0x7f74d005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:27.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.776+0000 7f74d7e0b700 1 -- 172.21.15.103:0/4225834850 shutdown_connections 2020-04-22T14:11:27.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.776+0000 7f74d7e0b700 1 -- 172.21.15.103:0/4225834850 wait complete. 2020-04-22T14:11:27.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.777+0000 7f74d7e0b700 1 Processor -- start 2020-04-22T14:11:27.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.777+0000 7f74d7e0b700 1 -- start start 2020-04-22T14:11:27.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.777+0000 7f74d7e0b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f74d0065fe0 0x7f74d00b1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:27.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.778+0000 7f74d7e0b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f74d012c0d0 0x7f74d0142010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:27.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.778+0000 7f74d7e0b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74d00b2e10 con 0x7f74d0063e30 2020-04-22T14:11:27.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.778+0000 7f74d7e0b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74d0142470 con 0x7f74d012c0d0 2020-04-22T14:11:27.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.778+0000 7f74d7e0b700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74d00b3090 con 0x7f74d0065fe0 2020-04-22T14:11:27.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.778+0000 7f74d53a6700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f74d0065fe0 0x7f74d00b1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:27.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.778+0000 7f74d53a6700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f74d0065fe0 0x7f74d00b1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51938/0 (socket says 172.21.15.103:51938) 2020-04-22T14:11:27.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.778+0000 7f74d53a6700 1 -- 172.21.15.103:0/92707037 learned_addr learned my addr 172.21.15.103:0/92707037 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:27.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.778+0000 7f74d63a8700 1 --2- 172.21.15.103:0/92707037 >> v2:172.21.15.86:3300/0 conn(0x7f74d012c0d0 0x7f74d0142010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:27.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.778+0000 7f74d53a6700 1 -- 172.21.15.103:0/92707037 >> v2:172.21.15.86:3300/0 conn(0x7f74d012c0d0 msgr2=0x7f74d0142010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:27.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.778+0000 7f74d53a6700 1 --2- 172.21.15.103:0/92707037 >> v2:172.21.15.86:3300/0 conn(0x7f74d012c0d0 0x7f74d0142010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:27.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.778+0000 7f74d53a6700 1 -- 172.21.15.103:0/92707037 >> v1:172.21.15.86:6789/0 conn(0x7f74d0063e30 legacy=0x7f74d00adee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:27.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.778+0000 7f74d53a6700 1 -- 172.21.15.103:0/92707037 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d00b3330 con 0x7f74d0065fe0 2020-04-22T14:11:27.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.778+0000 7f74d63a8700 1 --2- 172.21.15.103:0/92707037 >> v2:172.21.15.86:3300/0 conn(0x7f74d012c0d0 0x7f74d0142010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:11:27.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.778+0000 7f74d53a6700 1 --2- 172.21.15.103:0/92707037 >> v2:172.21.15.103:3300/0 conn(0x7f74d0065fe0 0x7f74d00b1ad0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f74d0145970 tx=0x7f74cc0109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:27.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.778+0000 7f74d53a6700 1 --2- 172.21.15.103:0/92707037 >> v2:172.21.15.103:3300/0 conn(0x7f74d0065fe0 0x7f74d00b1ad0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f74d0145970 tx=0x7f74cc0109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:27.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.778+0000 7f74d53a6700 1 --2- 172.21.15.103:0/92707037 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74d0065fe0 0x7f74d00b1ad0 secure :-1 s=READY pgs=928 cs=0 l=1 rx=0x7f74d0145970 tx=0x7f74cc0109d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:27.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.778+0000 7f74d53a6700 1 --2- 172.21.15.103:0/92707037 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74d0065fe0 0x7f74d00b1ad0 secure :-1 s=THROTTLE_DONE pgs=928 cs=0 l=1 rx=0x7f74d0145970 tx=0x7f74cc0109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:27.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.778+0000 7f74d53a6700 1 --2- 172.21.15.103:0/92707037 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74d0065fe0 0x7f74d00b1ad0 secure :-1 s=THROTTLE_DONE pgs=928 cs=0 l=1 rx=0x7f74d0145970 tx=0x7f74cc0109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:27.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.778+0000 7f74beffd700 1 -- 172.21.15.103:0/92707037 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74cc005ca0 con 0x7f74d0065fe0 2020-04-22T14:11:27.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.778+0000 7f74d53a6700 1 --2- 172.21.15.103:0/92707037 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74d0065fe0 0x7f74d00b1ad0 secure :-1 s=THROTTLE_DONE pgs=928 cs=0 l=1 rx=0x7f74d0145970 tx=0x7f74cc0109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:27.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.778+0000 7f74beffd700 1 -- 172.21.15.103:0/92707037 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74cc005e00 con 0x7f74d0065fe0 2020-04-22T14:11:27.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.778+0000 7f74d7e0b700 1 -- 172.21.15.103:0/92707037 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74d00b2a80 con 0x7f74d0065fe0 2020-04-22T14:11:27.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.778+0000 7f74beffd700 1 -- 172.21.15.103:0/92707037 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74cc0062c0 con 0x7f74d0065fe0 2020-04-22T14:11:27.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.778+0000 7f74d7e0b700 1 -- 172.21.15.103:0/92707037 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74d0145150 con 0x7f74d0065fe0 2020-04-22T14:11:27.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.779+0000 7f74d53a6700 1 --2- 172.21.15.103:0/92707037 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74d0065fe0 0x7f74d00b1ad0 secure :-1 s=THROTTLE_DONE pgs=928 cs=0 l=1 rx=0x7f74d0145970 tx=0x7f74cc0109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:27.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.779+0000 7f74beffd700 1 -- 172.21.15.103:0/92707037 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f74cc006530 con 0x7f74d0065fe0 2020-04-22T14:11:27.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.779+0000 7f74d53a6700 1 --2- 172.21.15.103:0/92707037 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74d0065fe0 0x7f74d00b1ad0 secure :-1 s=THROTTLE_DONE pgs=928 cs=0 l=1 rx=0x7f74d0145970 tx=0x7f74cc0109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:27.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.779+0000 7f74d7e0b700 1 -- 172.21.15.103:0/92707037 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74d0056c90 con 0x7f74d0065fe0 2020-04-22T14:11:27.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.780+0000 7f74beffd700 1 --2- 172.21.15.103:0/92707037 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f74b004d9c0 0x7f74b004fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:27.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.780+0000 7f74beffd700 1 -- 172.21.15.103:0/92707037 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f74cc0090c0 con 0x7f74d0065fe0 2020-04-22T14:11:27.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.780+0000 7f74d5ba7700 1 --2- 172.21.15.103:0/92707037 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f74b004d9c0 0x7f74b004fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:27.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.780+0000 7f74d5ba7700 1 --2- 172.21.15.103:0/92707037 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f74b004d9c0 0x7f74b004fe80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f74c0002f30 tx=0x7f74c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:27.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.780+0000 7f74d5ba7700 1 --2- 172.21.15.103:0/92707037 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f74b004d9c0 0x7f74b004fe80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f74c0002f30 tx=0x7f74c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:27.792 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.780+0000 7f74d5ba7700 1 --2- 172.21.15.103:0/92707037 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f74b004d9c0 0x7f74b004fe80 secure :-1 s=READY pgs=349 cs=0 l=1 rx=0x7f74c0002f30 tx=0x7f74c0007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:27.792 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.784+0000 7f74d53a6700 1 --2- 172.21.15.103:0/92707037 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74d0065fe0 0x7f74d00b1ad0 secure :-1 s=THROTTLE_DONE pgs=928 cs=0 l=1 rx=0x7f74d0145970 tx=0x7f74cc0109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:27.792 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.784+0000 7f74beffd700 1 -- 172.21.15.103:0/92707037 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f74cc03c920 con 0x7f74d0065fe0 2020-04-22T14:11:27.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.973+0000 7f74d7e0b700 1 -- 172.21.15.103:0/92707037 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f74d00b6210 con 0x7f74d0065fe0 2020-04-22T14:11:27.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.973+0000 7f74d53a6700 1 --2- 172.21.15.103:0/92707037 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74d0065fe0 0x7f74d00b1ad0 secure :-1 s=THROTTLE_DONE pgs=928 cs=0 l=1 rx=0x7f74d0145970 tx=0x7f74cc0109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:27.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.973+0000 7f74beffd700 1 -- 172.21.15.103:0/92707037 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f74cc03ff40 con 0x7f74d0065fe0 2020-04-22T14:11:27.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.975+0000 7f74d7e0b700 1 -- 172.21.15.103:0/92707037 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f74b004d9c0 msgr2=0x7f74b004fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:27.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.975+0000 7f74d7e0b700 1 --2- 172.21.15.103:0/92707037 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f74b004d9c0 0x7f74b004fe80 secure :-1 s=READY pgs=349 cs=0 l=1 rx=0x7f74c0002f30 tx=0x7f74c0007a40).stop 2020-04-22T14:11:27.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.975+0000 7f74d7e0b700 1 -- 172.21.15.103:0/92707037 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74d0065fe0 msgr2=0x7f74d00b1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:27.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.975+0000 7f74d7e0b700 1 --2- 172.21.15.103:0/92707037 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74d0065fe0 0x7f74d00b1ad0 secure :-1 s=READY pgs=928 cs=0 l=1 rx=0x7f74d0145970 tx=0x7f74cc0109d0).stop 2020-04-22T14:11:27.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.975+0000 7f74d7e0b700 1 -- 172.21.15.103:0/92707037 shutdown_connections 2020-04-22T14:11:27.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.975+0000 7f74d7e0b700 1 --2- 172.21.15.103:0/92707037 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f74b004d9c0 0x7f74b004fe80 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:27.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.975+0000 7f74d7e0b700 1 --2- 172.21.15.103:0/92707037 >> v2:172.21.15.86:3300/0 conn(0x7f74d012c0d0 0x7f74d0142010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:27.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.975+0000 7f74d7e0b700 1 --2- 172.21.15.103:0/92707037 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74d0065fe0 0x7f74d00b1ad0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:27.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.975+0000 7f74d7e0b700 1 -- 172.21.15.103:0/92707037 >> 172.21.15.103:0/92707037 conn(0x7f74d00b9160 msgr2=0x7f74d0120810 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:27.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.975+0000 7f74d7e0b700 1 -- 172.21.15.103:0/92707037 shutdown_connections 2020-04-22T14:11:27.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:27.975+0000 7f74d7e0b700 1 -- 172.21.15.103:0/92707037 wait complete. 2020-04-22T14:11:27.984 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 41 2020-04-22T14:11:27.984 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:27.984 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/1837726033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1837726033},{"type":"v1","addr":"172.21.15.86:6835","nonce":1837726033}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:03.499587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:11:27.988 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:11:28.988 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:29.005 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:11:29.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.160+0000 7f5930f42700 1 Processor -- start 2020-04-22T14:11:29.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.161+0000 7f5930f42700 1 -- start start 2020-04-22T14:11:29.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.161+0000 7f5930f42700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f592c0b6040 0x7f592c0ac740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:29.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.161+0000 7f5930f42700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f592c064ec0 con 0x7f592c1426d0 2020-04-22T14:11:29.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.161+0000 7f5930f42700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f592c146870 con 0x7f592c067170 2020-04-22T14:11:29.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.161+0000 7f5930f42700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f592c065af0 con 0x7f592c0b6040 2020-04-22T14:11:29.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.162+0000 7f592a59c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f592c067170 0x7f592c13c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44134/0 (socket says 172.21.15.103:44134) 2020-04-22T14:11:29.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.162+0000 7f592a59c700 1 -- 172.21.15.103:0/1318979416 learned_addr learned my addr 172.21.15.103:0/1318979416 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:29.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.162+0000 7f592959a700 1 -- 172.21.15.103:0/1318979416 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1264519288 0 0) 0x7f592c146870 con 0x7f592c067170 2020-04-22T14:11:29.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.162+0000 7f5929d9b700 1 --2- 172.21.15.103:0/1318979416 >> v2:172.21.15.86:3300/0 conn(0x7f592c0b6040 0x7f592c0ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:29.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.162+0000 7f592959a700 1 -- 172.21.15.103:0/1318979416 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f590c003230 con 0x7f592c067170 2020-04-22T14:11:29.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.162+0000 7f592959a700 1 -- 172.21.15.103:0/1318979416 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 917489678 0 0) 0x7f590c003230 con 0x7f592c067170 2020-04-22T14:11:29.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.162+0000 7f592959a700 1 -- 172.21.15.103:0/1318979416 >> v2:172.21.15.86:3300/0 conn(0x7f592c0b6040 msgr2=0x7f592c0ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:29.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.162+0000 7f592959a700 1 --2- 172.21.15.103:0/1318979416 >> v2:172.21.15.86:3300/0 conn(0x7f592c0b6040 0x7f592c0ac740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:29.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.162+0000 7f592959a700 1 -- 172.21.15.103:0/1318979416 >> v1:172.21.15.86:6789/0 conn(0x7f592c1426d0 legacy=0x7f592c142b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:29.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.162+0000 7f592959a700 1 -- 172.21.15.103:0/1318979416 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592c067550 con 0x7f592c067170 2020-04-22T14:11:29.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.162+0000 7f592959a700 1 -- 172.21.15.103:0/1318979416 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f591c0016d0 con 0x7f592c067170 2020-04-22T14:11:29.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.162+0000 7f592959a700 1 -- 172.21.15.103:0/1318979416 >> v1:172.21.15.103:6789/0 conn(0x7f592c067170 legacy=0x7f592c13c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:29.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.162+0000 7f592959a700 1 --2- 172.21.15.103:0/1318979416 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f590c003720 0x7f590c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:29.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.162+0000 7f592959a700 1 --2- 172.21.15.103:0/1318979416 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f590c0044d0 0x7f590c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:29.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.162+0000 7f592959a700 1 --2- 172.21.15.103:0/1318979416 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f590c004db0 0x7f590c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:29.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.162+0000 7f592959a700 1 -- 172.21.15.103:0/1318979416 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c065af0 con 0x7f590c003720 2020-04-22T14:11:29.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.162+0000 7f592959a700 1 -- 172.21.15.103:0/1318979416 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590c0041c0 con 0x7f590c004db0 2020-04-22T14:11:29.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.162+0000 7f592959a700 1 -- 172.21.15.103:0/1318979416 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f590c00bb80 con 0x7f590c0044d0 2020-04-22T14:11:29.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.162+0000 7f592ad9d700 1 --2- 172.21.15.103:0/1318979416 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f590c004db0 0x7f590c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:29.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.162+0000 7f592a59c700 1 --2- 172.21.15.103:0/1318979416 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f590c003720 0x7f590c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:29.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.162+0000 7f5929d9b700 1 --2- 172.21.15.103:0/1318979416 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f590c0044d0 0x7f590c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:29.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.163+0000 7f592ad9d700 1 -- 172.21.15.103:0/1318979416 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f590c0044d0 msgr2=0x7f590c004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:29.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.163+0000 7f592ad9d700 1 --2- 172.21.15.103:0/1318979416 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f590c0044d0 0x7f590c004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:29.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.163+0000 7f592ad9d700 1 -- 172.21.15.103:0/1318979416 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f590c003720 msgr2=0x7f590c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:29.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.163+0000 7f592ad9d700 1 --2- 172.21.15.103:0/1318979416 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f590c003720 0x7f590c003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:29.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.163+0000 7f592ad9d700 1 -- 172.21.15.103:0/1318979416 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f590c003230 con 0x7f590c004db0 2020-04-22T14:11:29.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.163+0000 7f592ad9d700 1 --2- 172.21.15.103:0/1318979416 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f590c004db0 0x7f590c00b720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f590c0054a0 tx=0x7f59240122b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:29.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.163+0000 7f592ad9d700 1 -- 172.21.15.103:0/1318979416 reap_dead start 2020-04-22T14:11:29.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.163+0000 7f592ad9d700 1 --2- 172.21.15.103:0/1318979416 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f590c004db0 0x7f590c00b720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f590c0054a0 tx=0x7f59240122b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:29.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.163+0000 7f592ad9d700 1 --2- 172.21.15.103:0/1318979416 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f590c004db0 0x7f590c00b720 secure :-1 s=READY pgs=930 cs=0 l=1 rx=0x7f590c0054a0 tx=0x7f59240122b0).ready entity=mon.1 client_cookie=2d3a57c5edc862ed server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:29.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.163+0000 7f592ad9d700 1 --2- 172.21.15.103:0/1318979416 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f590c004db0 0x7f590c00b720 secure :-1 s=THROTTLE_DONE pgs=930 cs=0 l=1 rx=0x7f590c0054a0 tx=0x7f59240122b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:29.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.163+0000 7f592959a700 1 -- 172.21.15.103:0/1318979416 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5924006c40 con 0x7f590c004db0 2020-04-22T14:11:29.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.163+0000 7f592ad9d700 1 --2- 172.21.15.103:0/1318979416 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f590c004db0 0x7f590c00b720 secure :-1 s=THROTTLE_DONE pgs=930 cs=0 l=1 rx=0x7f590c0054a0 tx=0x7f59240122b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:29.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.163+0000 7f592959a700 1 -- 172.21.15.103:0/1318979416 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5924006da0 con 0x7f590c004db0 2020-04-22T14:11:29.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.163+0000 7f592ad9d700 1 --2- 172.21.15.103:0/1318979416 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f590c004db0 0x7f590c00b720 secure :-1 s=THROTTLE_DONE pgs=930 cs=0 l=1 rx=0x7f590c0054a0 tx=0x7f59240122b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:29.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.163+0000 7f5930f42700 1 -- 172.21.15.103:0/1318979416 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f590c004db0 msgr2=0x7f590c00b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:29.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.163+0000 7f592959a700 1 -- 172.21.15.103:0/1318979416 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5924002640 con 0x7f590c004db0 2020-04-22T14:11:29.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.163+0000 7f5930f42700 1 --2- 172.21.15.103:0/1318979416 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f590c004db0 0x7f590c00b720 secure :-1 s=READY pgs=930 cs=0 l=1 rx=0x7f590c0054a0 tx=0x7f59240122b0).stop 2020-04-22T14:11:29.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.163+0000 7f5930f42700 1 -- 172.21.15.103:0/1318979416 shutdown_connections 2020-04-22T14:11:29.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.163+0000 7f5930f42700 1 --2- 172.21.15.103:0/1318979416 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f590c004db0 0x7f590c00b720 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:29.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.163+0000 7f5930f42700 1 -- 172.21.15.103:0/1318979416 >> 172.21.15.103:0/1318979416 conn(0x7f592c0b9160 msgr2=0x7f592c05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:29.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.164+0000 7f5930f42700 1 -- 172.21.15.103:0/1318979416 shutdown_connections 2020-04-22T14:11:29.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.164+0000 7f5930f42700 1 -- 172.21.15.103:0/1318979416 wait complete. 2020-04-22T14:11:29.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.164+0000 7f5930f42700 1 Processor -- start 2020-04-22T14:11:29.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.165+0000 7f5930f42700 1 -- start start 2020-04-22T14:11:29.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.165+0000 7f5930f42700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f592c0b3200 0x7f592c0b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:29.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.165+0000 7f5930f42700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f592c063c70 0x7f592c137e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:29.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.165+0000 7f5930f42700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f592c0b3940 con 0x7f590c004db0 2020-04-22T14:11:29.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.165+0000 7f5930f42700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f592c064120 con 0x7f592c0b3200 2020-04-22T14:11:29.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.165+0000 7f5930f42700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f592c0b36a0 con 0x7f592c063c70 2020-04-22T14:11:29.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.165+0000 7f592a59c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f590c004db0 0x7f592c0aebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44146/0 (socket says 172.21.15.103:44146) 2020-04-22T14:11:29.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.165+0000 7f592a59c700 1 -- 172.21.15.103:0/2328057228 learned_addr learned my addr 172.21.15.103:0/2328057228 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:29.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.165+0000 7f5929d9b700 1 --2- 172.21.15.103:0/2328057228 >> v2:172.21.15.103:3300/0 conn(0x7f592c0b3200 0x7f592c0b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:29.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.165+0000 7f592ad9d700 1 --2- 172.21.15.103:0/2328057228 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f592c063c70 0x7f592c137e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:29.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.166+0000 7f5929d9b700 1 -- 172.21.15.103:0/2328057228 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f592c063c70 msgr2=0x7f592c137e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:29.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.166+0000 7f5929d9b700 1 --2- 172.21.15.103:0/2328057228 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f592c063c70 0x7f592c137e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:29.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.166+0000 7f5929d9b700 1 -- 172.21.15.103:0/2328057228 >> v1:172.21.15.103:6789/0 conn(0x7f590c004db0 legacy=0x7f592c0aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:29.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.166+0000 7f59237fe700 1 -- 172.21.15.103:0/2328057228 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 111712931 0 0) 0x7f592c0b3940 con 0x7f590c004db0 2020-04-22T14:11:29.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.166+0000 7f5929d9b700 1 -- 172.21.15.103:0/2328057228 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592c0ad160 con 0x7f592c0b3200 2020-04-22T14:11:29.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.166+0000 7f5929d9b700 1 --2- 172.21.15.103:0/2328057228 >> v2:172.21.15.103:3300/0 conn(0x7f592c0b3200 0x7f592c0b3b10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5914002f30 tx=0x7f591400c380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:29.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.166+0000 7f5929d9b700 1 --2- 172.21.15.103:0/2328057228 >> v2:172.21.15.103:3300/0 conn(0x7f592c0b3200 0x7f592c0b3b10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5914002f30 tx=0x7f591400c380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:29.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.166+0000 7f5929d9b700 1 --2- 172.21.15.103:0/2328057228 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f592c0b3200 0x7f592c0b3b10 secure :-1 s=READY pgs=932 cs=0 l=1 rx=0x7f5914002f30 tx=0x7f591400c380).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:29.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.166+0000 7f5929d9b700 1 --2- 172.21.15.103:0/2328057228 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f592c0b3200 0x7f592c0b3b10 secure :-1 s=THROTTLE_DONE pgs=932 cs=0 l=1 rx=0x7f5914002f30 tx=0x7f591400c380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:29.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.166+0000 7f59237fe700 1 -- 172.21.15.103:0/2328057228 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5914005e90 con 0x7f592c0b3200 2020-04-22T14:11:29.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.166+0000 7f5929d9b700 1 --2- 172.21.15.103:0/2328057228 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f592c0b3200 0x7f592c0b3b10 secure :-1 s=THROTTLE_DONE pgs=932 cs=0 l=1 rx=0x7f5914002f30 tx=0x7f591400c380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:29.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.166+0000 7f5929d9b700 1 --2- 172.21.15.103:0/2328057228 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f592c0b3200 0x7f592c0b3b10 secure :-1 s=THROTTLE_DONE pgs=932 cs=0 l=1 rx=0x7f5914002f30 tx=0x7f591400c380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:29.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.166+0000 7f59237fe700 1 -- 172.21.15.103:0/2328057228 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5914007180 con 0x7f592c0b3200 2020-04-22T14:11:29.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.166+0000 7f5930f42700 1 -- 172.21.15.103:0/2328057228 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f592c0b1290 con 0x7f592c0b3200 2020-04-22T14:11:29.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.166+0000 7f59237fe700 1 -- 172.21.15.103:0/2328057228 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59140074e0 con 0x7f592c0b3200 2020-04-22T14:11:29.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.166+0000 7f5930f42700 1 -- 172.21.15.103:0/2328057228 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f592c1384b0 con 0x7f592c0b3200 2020-04-22T14:11:29.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.166+0000 7f5929d9b700 1 --2- 172.21.15.103:0/2328057228 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f592c0b3200 0x7f592c0b3b10 secure :-1 s=THROTTLE_DONE pgs=932 cs=0 l=1 rx=0x7f5914002f30 tx=0x7f591400c380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:29.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.167+0000 7f59237fe700 1 -- 172.21.15.103:0/2328057228 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f5914009490 con 0x7f592c0b3200 2020-04-22T14:11:29.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.167+0000 7f5929d9b700 1 --2- 172.21.15.103:0/2328057228 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f592c0b3200 0x7f592c0b3b10 secure :-1 s=THROTTLE_DONE pgs=932 cs=0 l=1 rx=0x7f5914002f30 tx=0x7f591400c380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:29.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.167+0000 7f5930f42700 1 -- 172.21.15.103:0/2328057228 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f592c1387c0 con 0x7f592c0b3200 2020-04-22T14:11:29.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.167+0000 7f59237fe700 1 --2- 172.21.15.103:0/2328057228 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f591004d8c0 0x7f591004fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:29.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.167+0000 7f59237fe700 1 -- 172.21.15.103:0/2328057228 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f59140611d0 con 0x7f592c0b3200 2020-04-22T14:11:29.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.167+0000 7f592a59c700 1 --2- 172.21.15.103:0/2328057228 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f591004d8c0 0x7f591004fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:29.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.168+0000 7f592a59c700 1 --2- 172.21.15.103:0/2328057228 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f591004d8c0 0x7f591004fd80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f591c001170 tx=0x7f592c0676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:29.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.168+0000 7f592a59c700 1 --2- 172.21.15.103:0/2328057228 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f591004d8c0 0x7f591004fd80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f591c001170 tx=0x7f592c0676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:29.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.168+0000 7f592a59c700 1 --2- 172.21.15.103:0/2328057228 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f591004d8c0 0x7f591004fd80 secure :-1 s=READY pgs=350 cs=0 l=1 rx=0x7f591c001170 tx=0x7f592c0676e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:29.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.171+0000 7f5929d9b700 1 --2- 172.21.15.103:0/2328057228 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f592c0b3200 0x7f592c0b3b10 secure :-1 s=THROTTLE_DONE pgs=932 cs=0 l=1 rx=0x7f5914002f30 tx=0x7f591400c380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:29.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.171+0000 7f59237fe700 1 -- 172.21.15.103:0/2328057228 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f591403c550 con 0x7f592c0b3200 2020-04-22T14:11:29.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.358+0000 7f5930f42700 1 -- 172.21.15.103:0/2328057228 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f592c056c90 con 0x7f592c0b3200 2020-04-22T14:11:29.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.359+0000 7f5929d9b700 1 --2- 172.21.15.103:0/2328057228 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f592c0b3200 0x7f592c0b3b10 secure :-1 s=THROTTLE_DONE pgs=932 cs=0 l=1 rx=0x7f5914002f30 tx=0x7f591400c380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:29.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.359+0000 7f59237fe700 1 -- 172.21.15.103:0/2328057228 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f591403fb70 con 0x7f592c0b3200 2020-04-22T14:11:29.362 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:29.363 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/1837726033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1837726033},{"type":"v1","addr":"172.21.15.86:6835","nonce":1837726033}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:03.499587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:11:29.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.360+0000 7f5930f42700 1 -- 172.21.15.103:0/2328057228 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f591004d8c0 msgr2=0x7f591004fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:29.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.360+0000 7f5930f42700 1 --2- 172.21.15.103:0/2328057228 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f591004d8c0 0x7f591004fd80 secure :-1 s=READY pgs=350 cs=0 l=1 rx=0x7f591c001170 tx=0x7f592c0676e0).stop 2020-04-22T14:11:29.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.360+0000 7f5930f42700 1 -- 172.21.15.103:0/2328057228 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f592c0b3200 msgr2=0x7f592c0b3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:29.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.360+0000 7f5930f42700 1 --2- 172.21.15.103:0/2328057228 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f592c0b3200 0x7f592c0b3b10 secure :-1 s=READY pgs=932 cs=0 l=1 rx=0x7f5914002f30 tx=0x7f591400c380).stop 2020-04-22T14:11:29.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.360+0000 7f5930f42700 1 -- 172.21.15.103:0/2328057228 shutdown_connections 2020-04-22T14:11:29.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.360+0000 7f5930f42700 1 --2- 172.21.15.103:0/2328057228 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f591004d8c0 0x7f591004fd80 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:29.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.360+0000 7f5930f42700 1 --2- 172.21.15.103:0/2328057228 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f592c063c70 0x7f592c137e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:29.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.360+0000 7f5930f42700 1 --2- 172.21.15.103:0/2328057228 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f592c0b3200 0x7f592c0b3b10 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:29.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.360+0000 7f5930f42700 1 -- 172.21.15.103:0/2328057228 >> 172.21.15.103:0/2328057228 conn(0x7f592c0b9160 msgr2=0x7f592c146da0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:29.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.360+0000 7f5930f42700 1 -- 172.21.15.103:0/2328057228 shutdown_connections 2020-04-22T14:11:29.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:29.360+0000 7f5930f42700 1 -- 172.21.15.103:0/2328057228 wait complete. 2020-04-22T14:11:29.365 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 41 2020-04-22T14:11:29.373 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:11:30.374 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:30.391 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:11:30.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.546+0000 7f23ac2bf700 1 Processor -- start 2020-04-22T14:11:30.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.546+0000 7f23ac2bf700 1 -- start start 2020-04-22T14:11:30.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.547+0000 7f23ac2bf700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23a41464e0 0x7f23a4064540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:30.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.547+0000 7f23ac2bf700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23a4143300 con 0x7f23a412c0d0 2020-04-22T14:11:30.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.547+0000 7f23ac2bf700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23a41435a0 con 0x7f23a4065fe0 2020-04-22T14:11:30.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.547+0000 7f23ac2bf700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a4143840 con 0x7f23a41464e0 2020-04-22T14:11:30.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.547+0000 7f23a985a700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f23a4065fe0 0x7f23a4063e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44154/0 (socket says 172.21.15.103:44154) 2020-04-22T14:11:30.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.547+0000 7f23a985a700 1 -- 172.21.15.103:0/1903072094 learned_addr learned my addr 172.21.15.103:0/1903072094 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:30.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.547+0000 7f23aa85c700 1 --2- 172.21.15.103:0/1903072094 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23a41464e0 0x7f23a4064540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:30.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.547+0000 7f23a9059700 1 -- 172.21.15.103:0/1903072094 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3199826779 0 0) 0x7f23a41435a0 con 0x7f23a4065fe0 2020-04-22T14:11:30.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.547+0000 7f23a9059700 1 -- 172.21.15.103:0/1903072094 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f238c003230 con 0x7f23a4065fe0 2020-04-22T14:11:30.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.548+0000 7f23a9059700 1 -- 172.21.15.103:0/1903072094 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 933955911 0 0) 0x7f238c003230 con 0x7f23a4065fe0 2020-04-22T14:11:30.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.548+0000 7f23a9059700 1 -- 172.21.15.103:0/1903072094 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23a41464e0 msgr2=0x7f23a4064540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:30.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.548+0000 7f23a9059700 1 --2- 172.21.15.103:0/1903072094 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23a41464e0 0x7f23a4064540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:30.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.548+0000 7f23a9059700 1 -- 172.21.15.103:0/1903072094 >> v1:172.21.15.86:6789/0 conn(0x7f23a412c0d0 legacy=0x7f23a405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:30.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.548+0000 7f23a9059700 1 -- 172.21.15.103:0/1903072094 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a405bb50 con 0x7f23a4065fe0 2020-04-22T14:11:30.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.548+0000 7f23a9059700 1 -- 172.21.15.103:0/1903072094 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f23a00016d0 con 0x7f23a4065fe0 2020-04-22T14:11:30.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.548+0000 7f23a9059700 1 -- 172.21.15.103:0/1903072094 >> v1:172.21.15.103:6789/0 conn(0x7f23a4065fe0 legacy=0x7f23a4063e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:30.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.548+0000 7f23a9059700 1 --2- 172.21.15.103:0/1903072094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f238c003750 0x7f238c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:30.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.548+0000 7f23a9059700 1 --2- 172.21.15.103:0/1903072094 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23a41464e0 0x7f238c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:30.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.548+0000 7f23a9059700 1 --2- 172.21.15.103:0/1903072094 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f238c004930 0x7f238c004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:30.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.548+0000 7f23a9059700 1 -- 172.21.15.103:0/1903072094 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a4143840 con 0x7f238c004930 2020-04-22T14:11:30.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.548+0000 7f23a9059700 1 -- 172.21.15.103:0/1903072094 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238c005330 con 0x7f238c003750 2020-04-22T14:11:30.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.548+0000 7f23a9059700 1 -- 172.21.15.103:0/1903072094 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f238c004150 con 0x7f23a41464e0 2020-04-22T14:11:30.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.548+0000 7f23aa05b700 1 --2- 172.21.15.103:0/1903072094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f238c003750 0x7f238c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:30.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.548+0000 7f23a985a700 1 --2- 172.21.15.103:0/1903072094 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23a41464e0 0x7f238c0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:30.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.548+0000 7f23aa85c700 1 --2- 172.21.15.103:0/1903072094 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f238c004930 0x7f238c004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:30.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.548+0000 7f23aa05b700 1 -- 172.21.15.103:0/1903072094 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23a41464e0 msgr2=0x7f238c0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:30.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.548+0000 7f23aa05b700 1 --2- 172.21.15.103:0/1903072094 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23a41464e0 0x7f238c0044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:30.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.548+0000 7f23aa05b700 1 -- 172.21.15.103:0/1903072094 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f238c004930 msgr2=0x7f238c004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:30.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.548+0000 7f23aa05b700 1 --2- 172.21.15.103:0/1903072094 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f238c004930 0x7f238c004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:30.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.548+0000 7f23aa05b700 1 -- 172.21.15.103:0/1903072094 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238c003230 con 0x7f238c003750 2020-04-22T14:11:30.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.548+0000 7f23aa05b700 1 --2- 172.21.15.103:0/1903072094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f238c003750 0x7f238c003b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f23a40b85b0 tx=0x7f239400fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:30.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.548+0000 7f23aa05b700 1 --2- 172.21.15.103:0/1903072094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f238c003750 0x7f238c003b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f23a40b85b0 tx=0x7f239400fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:30.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.548+0000 7f23aa05b700 1 --2- 172.21.15.103:0/1903072094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f238c003750 0x7f238c003b70 secure :-1 s=READY pgs=934 cs=0 l=1 rx=0x7f23a40b85b0 tx=0x7f239400fcf0).ready entity=mon.1 client_cookie=56028ec3abccef7b server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:30.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.548+0000 7f23aa05b700 1 --2- 172.21.15.103:0/1903072094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f238c003750 0x7f238c003b70 secure :-1 s=THROTTLE_DONE pgs=934 cs=0 l=1 rx=0x7f23a40b85b0 tx=0x7f239400fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:30.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.548+0000 7f23a9059700 1 -- 172.21.15.103:0/1903072094 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2394003560 con 0x7f238c003750 2020-04-22T14:11:30.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.548+0000 7f23aa05b700 1 --2- 172.21.15.103:0/1903072094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f238c003750 0x7f238c003b70 secure :-1 s=THROTTLE_DONE pgs=934 cs=0 l=1 rx=0x7f23a40b85b0 tx=0x7f239400fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:30.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.548+0000 7f23aa05b700 1 --2- 172.21.15.103:0/1903072094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f238c003750 0x7f238c003b70 secure :-1 s=THROTTLE_DONE pgs=934 cs=0 l=1 rx=0x7f23a40b85b0 tx=0x7f239400fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:30.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.548+0000 7f23a9059700 1 -- 172.21.15.103:0/1903072094 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2394003700 con 0x7f238c003750 2020-04-22T14:11:30.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.548+0000 7f23a9059700 1 -- 172.21.15.103:0/1903072094 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2394003b20 con 0x7f238c003750 2020-04-22T14:11:30.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.548+0000 7f23ac2bf700 1 -- 172.21.15.103:0/1903072094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f238c003750 msgr2=0x7f238c003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:30.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.548+0000 7f23ac2bf700 1 --2- 172.21.15.103:0/1903072094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f238c003750 0x7f238c003b70 secure :-1 s=READY pgs=934 cs=0 l=1 rx=0x7f23a40b85b0 tx=0x7f239400fcf0).stop 2020-04-22T14:11:30.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.548+0000 7f23aa85c700 1 -- 172.21.15.103:0/1903072094 reap_dead start 2020-04-22T14:11:30.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.549+0000 7f23ac2bf700 1 -- 172.21.15.103:0/1903072094 shutdown_connections 2020-04-22T14:11:30.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.549+0000 7f23ac2bf700 1 -- 172.21.15.103:0/1903072094 >> 172.21.15.103:0/1903072094 conn(0x7f23a40b9160 msgr2=0x7f23a405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:30.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.549+0000 7f23ac2bf700 1 -- 172.21.15.103:0/1903072094 shutdown_connections 2020-04-22T14:11:30.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.549+0000 7f23ac2bf700 1 -- 172.21.15.103:0/1903072094 wait complete. 2020-04-22T14:11:30.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.550+0000 7f23ac2bf700 1 Processor -- start 2020-04-22T14:11:30.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.550+0000 7f23ac2bf700 1 -- start start 2020-04-22T14:11:30.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.550+0000 7f23ac2bf700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f23a411d960 0x7f23a4145330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:30.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.551+0000 7f23ac2bf700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23a414b990 0x7f23a4141bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:30.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.551+0000 7f23ac2bf700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23a414c0d0 con 0x7f23a4142030 2020-04-22T14:11:30.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.551+0000 7f23ac2bf700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23a414be30 con 0x7f23a411d960 2020-04-22T14:11:30.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.551+0000 7f23ac2bf700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a411ef50 con 0x7f23a414b990 2020-04-22T14:11:30.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.551+0000 7f23aa05b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f23a411d960 0x7f23a4145330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:30.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.551+0000 7f23aa05b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f23a411d960 0x7f23a4145330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:49208/0 (socket says 172.21.15.103:49208) 2020-04-22T14:11:30.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.551+0000 7f23a985a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23a414b990 0x7f23a4141bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:30.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.551+0000 7f23aa05b700 1 -- 172.21.15.103:0/3131051154 learned_addr learned my addr 172.21.15.103:0/3131051154 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:30.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.551+0000 7f23a985a700 1 -- 172.21.15.103:0/3131051154 >> v2:172.21.15.86:3300/0 conn(0x7f23a411d960 msgr2=0x7f23a4145330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:30.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.551+0000 7f23a985a700 1 --2- 172.21.15.103:0/3131051154 >> v2:172.21.15.86:3300/0 conn(0x7f23a411d960 0x7f23a4145330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:30.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.551+0000 7f23a985a700 1 -- 172.21.15.103:0/3131051154 >> v1:172.21.15.86:6789/0 conn(0x7f23a4142030 legacy=0x7f23a4143c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:30.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.551+0000 7f23a985a700 1 -- 172.21.15.103:0/3131051154 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a411dd40 con 0x7f23a414b990 2020-04-22T14:11:30.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.551+0000 7f23aa05b700 1 --2- 172.21.15.103:0/3131051154 >> v2:172.21.15.86:3300/0 conn(0x7f23a411d960 0x7f23a4145330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:11:30.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.551+0000 7f23a985a700 1 --2- 172.21.15.103:0/3131051154 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23a414b990 0x7f23a4141bd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f23a00013e0 tx=0x7f23a405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:30.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.551+0000 7f23a985a700 1 --2- 172.21.15.103:0/3131051154 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23a414b990 0x7f23a4141bd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f23a00013e0 tx=0x7f23a405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:30.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.551+0000 7f23a985a700 1 --2- 172.21.15.103:0/3131051154 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23a414b990 0x7f23a4141bd0 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7f23a00013e0 tx=0x7f23a405bce0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:30.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.551+0000 7f23a985a700 1 --2- 172.21.15.103:0/3131051154 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23a414b990 0x7f23a4141bd0 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f23a00013e0 tx=0x7f23a405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:30.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.551+0000 7f23937fe700 1 -- 172.21.15.103:0/3131051154 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23a000e550 con 0x7f23a414b990 2020-04-22T14:11:30.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.551+0000 7f23a985a700 1 --2- 172.21.15.103:0/3131051154 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23a414b990 0x7f23a4141bd0 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f23a00013e0 tx=0x7f23a405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:30.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.551+0000 7f23937fe700 1 -- 172.21.15.103:0/3131051154 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a000e6b0 con 0x7f23a414b990 2020-04-22T14:11:30.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.551+0000 7f23a985a700 1 --2- 172.21.15.103:0/3131051154 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23a414b990 0x7f23a4141bd0 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f23a00013e0 tx=0x7f23a405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:30.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.551+0000 7f23ac2bf700 1 -- 172.21.15.103:0/3131051154 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23a4142490 con 0x7f23a414b990 2020-04-22T14:11:30.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.551+0000 7f23937fe700 1 -- 172.21.15.103:0/3131051154 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23a000ca80 con 0x7f23a414b990 2020-04-22T14:11:30.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.551+0000 7f23ac2bf700 1 -- 172.21.15.103:0/3131051154 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23a4120400 con 0x7f23a414b990 2020-04-22T14:11:30.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.552+0000 7f23a985a700 1 --2- 172.21.15.103:0/3131051154 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23a414b990 0x7f23a4141bd0 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f23a00013e0 tx=0x7f23a405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:30.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.553+0000 7f23937fe700 1 -- 172.21.15.103:0/3131051154 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f23a000ccc0 con 0x7f23a414b990 2020-04-22T14:11:30.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.553+0000 7f23a985a700 1 --2- 172.21.15.103:0/3131051154 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23a414b990 0x7f23a4141bd0 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f23a00013e0 tx=0x7f23a405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:30.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.553+0000 7f23ac2bf700 1 -- 172.21.15.103:0/3131051154 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23a4056c90 con 0x7f23a414b990 2020-04-22T14:11:30.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.553+0000 7f23937fe700 1 --2- 172.21.15.103:0/3131051154 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f238404d7e0 0x7f238404fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:30.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.553+0000 7f23937fe700 1 -- 172.21.15.103:0/3131051154 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f23a0061080 con 0x7f23a414b990 2020-04-22T14:11:30.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.553+0000 7f23aa05b700 1 --2- 172.21.15.103:0/3131051154 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f238404d7e0 0x7f238404fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:30.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.553+0000 7f23aa05b700 1 --2- 172.21.15.103:0/3131051154 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f238404d7e0 0x7f238404fca0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f23a40b85b0 tx=0x7f239400fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:30.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.553+0000 7f23aa05b700 1 --2- 172.21.15.103:0/3131051154 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f238404d7e0 0x7f238404fca0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f23a40b85b0 tx=0x7f239400fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:30.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.553+0000 7f23aa05b700 1 --2- 172.21.15.103:0/3131051154 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f238404d7e0 0x7f238404fca0 secure :-1 s=READY pgs=351 cs=0 l=1 rx=0x7f23a40b85b0 tx=0x7f239400fcf0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:30.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.557+0000 7f23a985a700 1 --2- 172.21.15.103:0/3131051154 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23a414b990 0x7f23a4141bd0 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f23a00013e0 tx=0x7f23a405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:30.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.557+0000 7f23937fe700 1 -- 172.21.15.103:0/3131051154 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f23a003c460 con 0x7f23a414b990 2020-04-22T14:11:30.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.748+0000 7f23ac2bf700 1 -- 172.21.15.103:0/3131051154 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23a40b54f0 con 0x7f23a414b990 2020-04-22T14:11:30.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.749+0000 7f23a985a700 1 --2- 172.21.15.103:0/3131051154 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23a414b990 0x7f23a4141bd0 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f23a00013e0 tx=0x7f23a405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:30.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.749+0000 7f23937fe700 1 -- 172.21.15.103:0/3131051154 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f23a003fa80 con 0x7f23a414b990 2020-04-22T14:11:30.752 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:30.752 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/1837726033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1837726033},{"type":"v1","addr":"172.21.15.86:6835","nonce":1837726033}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:03.499587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:11:30.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.750+0000 7f23ac2bf700 1 -- 172.21.15.103:0/3131051154 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f238404d7e0 msgr2=0x7f238404fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:30.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.750+0000 7f23ac2bf700 1 --2- 172.21.15.103:0/3131051154 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f238404d7e0 0x7f238404fca0 secure :-1 s=READY pgs=351 cs=0 l=1 rx=0x7f23a40b85b0 tx=0x7f239400fcf0).stop 2020-04-22T14:11:30.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.750+0000 7f23ac2bf700 1 -- 172.21.15.103:0/3131051154 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23a414b990 msgr2=0x7f23a4141bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:30.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.750+0000 7f23ac2bf700 1 --2- 172.21.15.103:0/3131051154 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23a414b990 0x7f23a4141bd0 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7f23a00013e0 tx=0x7f23a405bce0).stop 2020-04-22T14:11:30.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.750+0000 7f23ac2bf700 1 -- 172.21.15.103:0/3131051154 shutdown_connections 2020-04-22T14:11:30.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.750+0000 7f23ac2bf700 1 --2- 172.21.15.103:0/3131051154 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f238404d7e0 0x7f238404fca0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:30.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.750+0000 7f23ac2bf700 1 --2- 172.21.15.103:0/3131051154 >> v2:172.21.15.86:3300/0 conn(0x7f23a411d960 0x7f23a4145330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:30.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.750+0000 7f23ac2bf700 1 --2- 172.21.15.103:0/3131051154 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23a414b990 0x7f23a4141bd0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:30.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.750+0000 7f23ac2bf700 1 -- 172.21.15.103:0/3131051154 >> 172.21.15.103:0/3131051154 conn(0x7f23a40b9160 msgr2=0x7f23a40b5860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:30.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.750+0000 7f23ac2bf700 1 -- 172.21.15.103:0/3131051154 shutdown_connections 2020-04-22T14:11:30.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:30.750+0000 7f23ac2bf700 1 -- 172.21.15.103:0/3131051154 wait complete. 2020-04-22T14:11:30.755 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 41 2020-04-22T14:11:30.763 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:11:31.765 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:31.781 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:11:31.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.936+0000 7f540eb9f700 1 Processor -- start 2020-04-22T14:11:31.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.936+0000 7f540eb9f700 1 -- start start 2020-04-22T14:11:31.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.937+0000 7f540eb9f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f54080654e0 0x7f54080664a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:31.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.937+0000 7f540eb9f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5408142320 0x7f5408063340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:31.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.937+0000 7f540eb9f700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5408066a20 con 0x7f54080ad150 2020-04-22T14:11:31.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.937+0000 7f540eb9f700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54080adf30 con 0x7f54080654e0 2020-04-22T14:11:31.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.937+0000 7f540eb9f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54081427a0 con 0x7f5408142320 2020-04-22T14:11:31.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.938+0000 7f540e39e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5408142320 0x7f5408063340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:31.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.938+0000 7f540d39c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f54080654e0 0x7f54080664a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:31.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.938+0000 7f540e39e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5408142320 0x7f5408063340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:36762/0 (socket says 172.21.15.103:36762) 2020-04-22T14:11:31.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.938+0000 7f540e39e700 1 -- 172.21.15.103:0/355217192 learned_addr learned my addr 172.21.15.103:0/355217192 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:31.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.938+0000 7f540db9d700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f54080ad150 0x7f5408141c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:33098/0 (socket says 172.21.15.103:33098) 2020-04-22T14:11:31.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.938+0000 7f540d39c700 1 -- 172.21.15.103:0/355217192 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5408142320 msgr2=0x7f5408063340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:31.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.938+0000 7f540d39c700 1 --2- 172.21.15.103:0/355217192 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5408142320 0x7f5408063340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:31.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.938+0000 7f540d39c700 1 -- 172.21.15.103:0/355217192 >> v1:172.21.15.86:6789/0 conn(0x7f54080ad150 legacy=0x7f5408141c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:31.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.938+0000 7f540cb9b700 1 -- 172.21.15.103:0/355217192 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1090969424 0 0) 0x7f5408066a20 con 0x7f54080ad150 2020-04-22T14:11:31.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.938+0000 7f540d39c700 1 -- 172.21.15.103:0/355217192 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54080ad7f0 con 0x7f54080654e0 2020-04-22T14:11:31.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.938+0000 7f540e39e700 1 --2- 172.21.15.103:0/355217192 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5408142320 0x7f5408063340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:11:31.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.938+0000 7f540d39c700 1 --2- 172.21.15.103:0/355217192 >> v2:172.21.15.86:3300/0 conn(0x7f54080654e0 0x7f54080664a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f54080ae070 tx=0x7f53fc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:31.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.938+0000 7f540d39c700 1 --2- 172.21.15.103:0/355217192 >> v2:172.21.15.86:3300/0 conn(0x7f54080654e0 0x7f54080664a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f54080ae070 tx=0x7f53fc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:31.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.938+0000 7f540d39c700 1 --2- 172.21.15.103:0/355217192 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54080654e0 0x7f54080664a0 secure :-1 s=READY pgs=533 cs=0 l=1 rx=0x7f54080ae070 tx=0x7f53fc0088e0).ready entity=mon.0 client_cookie=477c0e18a513ec81 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:31.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.938+0000 7f540d39c700 1 --2- 172.21.15.103:0/355217192 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54080654e0 0x7f54080664a0 secure :-1 s=THROTTLE_DONE pgs=533 cs=0 l=1 rx=0x7f54080ae070 tx=0x7f53fc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:31.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.938+0000 7f540cb9b700 1 -- 172.21.15.103:0/355217192 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53fc008e40 con 0x7f54080654e0 2020-04-22T14:11:31.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.938+0000 7f540d39c700 1 --2- 172.21.15.103:0/355217192 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54080654e0 0x7f54080664a0 secure :-1 s=THROTTLE_DONE pgs=533 cs=0 l=1 rx=0x7f54080ae070 tx=0x7f53fc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:31.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.938+0000 7f540cb9b700 1 -- 172.21.15.103:0/355217192 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53fc0115b0 con 0x7f54080654e0 2020-04-22T14:11:31.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.938+0000 7f540d39c700 1 --2- 172.21.15.103:0/355217192 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54080654e0 0x7f54080664a0 secure :-1 s=THROTTLE_DONE pgs=533 cs=0 l=1 rx=0x7f54080ae070 tx=0x7f53fc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:31.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.938+0000 7f540cb9b700 1 -- 172.21.15.103:0/355217192 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53fc011990 con 0x7f54080654e0 2020-04-22T14:11:31.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.938+0000 7f540eb9f700 1 -- 172.21.15.103:0/355217192 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54080654e0 msgr2=0x7f54080664a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:31.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.938+0000 7f540eb9f700 1 --2- 172.21.15.103:0/355217192 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54080654e0 0x7f54080664a0 secure :-1 s=READY pgs=533 cs=0 l=1 rx=0x7f54080ae070 tx=0x7f53fc0088e0).stop 2020-04-22T14:11:31.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.939+0000 7f540eb9f700 1 -- 172.21.15.103:0/355217192 shutdown_connections 2020-04-22T14:11:31.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.939+0000 7f540eb9f700 1 --2- 172.21.15.103:0/355217192 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5408142320 0x7f5408063340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:31.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.939+0000 7f540eb9f700 1 --2- 172.21.15.103:0/355217192 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54080654e0 0x7f54080664a0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:31.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.939+0000 7f540eb9f700 1 -- 172.21.15.103:0/355217192 >> 172.21.15.103:0/355217192 conn(0x7f540805b7c0 msgr2=0x7f5408061610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:31.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.939+0000 7f540eb9f700 1 -- 172.21.15.103:0/355217192 shutdown_connections 2020-04-22T14:11:31.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.939+0000 7f540eb9f700 1 -- 172.21.15.103:0/355217192 wait complete. 2020-04-22T14:11:31.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.940+0000 7f540eb9f700 1 Processor -- start 2020-04-22T14:11:31.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.940+0000 7f540eb9f700 1 -- start start 2020-04-22T14:11:31.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.940+0000 7f540eb9f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5408142320 0x7f540812dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:31.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.940+0000 7f540eb9f700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54080b0050 con 0x7f54080ad150 2020-04-22T14:11:31.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.941+0000 7f540eb9f700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f540812e180 con 0x7f54080654e0 2020-04-22T14:11:31.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.941+0000 7f540eb9f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54080b0d50 con 0x7f5408142320 2020-04-22T14:11:31.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.941+0000 7f540e39e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5408142320 0x7f540812dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:31.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.941+0000 7f540db9d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f54080654e0 0x7f54080af230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44180/0 (socket says 172.21.15.103:44180) 2020-04-22T14:11:31.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.941+0000 7f540db9d700 1 -- 172.21.15.103:0/1297953672 learned_addr learned my addr 172.21.15.103:0/1297953672 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:31.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.941+0000 7f540e39e700 1 -- 172.21.15.103:0/1297953672 >> v1:172.21.15.103:6789/0 conn(0x7f54080654e0 legacy=0x7f54080af230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:31.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.941+0000 7f540e39e700 1 -- 172.21.15.103:0/1297953672 >> v1:172.21.15.86:6789/0 conn(0x7f54080ad150 legacy=0x7f54080af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:31.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.941+0000 7f53faffd700 1 -- 172.21.15.103:0/1297953672 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 544739117 0 0) 0x7f540812e180 con 0x7f54080654e0 2020-04-22T14:11:31.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.941+0000 7f540e39e700 1 -- 172.21.15.103:0/1297953672 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540812b3d0 con 0x7f5408142320 2020-04-22T14:11:31.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.941+0000 7f540e39e700 1 --2- 172.21.15.103:0/1297953672 >> v2:172.21.15.103:3300/0 conn(0x7f5408142320 0x7f540812dc80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f54000032b0 tx=0x7f54000110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:31.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.941+0000 7f540e39e700 1 --2- 172.21.15.103:0/1297953672 >> v2:172.21.15.103:3300/0 conn(0x7f5408142320 0x7f540812dc80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f54000032b0 tx=0x7f54000110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:31.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.941+0000 7f540e39e700 1 --2- 172.21.15.103:0/1297953672 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5408142320 0x7f540812dc80 secure :-1 s=READY pgs=936 cs=0 l=1 rx=0x7f54000032b0 tx=0x7f54000110f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:31.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.941+0000 7f540e39e700 1 --2- 172.21.15.103:0/1297953672 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5408142320 0x7f540812dc80 secure :-1 s=THROTTLE_DONE pgs=936 cs=0 l=1 rx=0x7f54000032b0 tx=0x7f54000110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:31.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.941+0000 7f53faffd700 1 -- 172.21.15.103:0/1297953672 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5400005e30 con 0x7f5408142320 2020-04-22T14:11:31.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.941+0000 7f540e39e700 1 --2- 172.21.15.103:0/1297953672 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5408142320 0x7f540812dc80 secure :-1 s=THROTTLE_DONE pgs=936 cs=0 l=1 rx=0x7f54000032b0 tx=0x7f54000110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:31.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.941+0000 7f540eb9f700 1 -- 172.21.15.103:0/1297953672 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54080b2200 con 0x7f5408142320 2020-04-22T14:11:31.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.941+0000 7f53faffd700 1 -- 172.21.15.103:0/1297953672 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5400012b70 con 0x7f5408142320 2020-04-22T14:11:31.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.941+0000 7f540e39e700 1 --2- 172.21.15.103:0/1297953672 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5408142320 0x7f540812dc80 secure :-1 s=THROTTLE_DONE pgs=936 cs=0 l=1 rx=0x7f54000032b0 tx=0x7f54000110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:31.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.941+0000 7f53faffd700 1 -- 172.21.15.103:0/1297953672 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5400007180 con 0x7f5408142320 2020-04-22T14:11:31.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.941+0000 7f540eb9f700 1 -- 172.21.15.103:0/1297953672 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54080b2b40 con 0x7f5408142320 2020-04-22T14:11:31.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.942+0000 7f540e39e700 1 --2- 172.21.15.103:0/1297953672 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5408142320 0x7f540812dc80 secure :-1 s=THROTTLE_DONE pgs=936 cs=0 l=1 rx=0x7f54000032b0 tx=0x7f54000110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:31.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.942+0000 7f53faffd700 1 -- 172.21.15.103:0/1297953672 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f540000e1a0 con 0x7f5408142320 2020-04-22T14:11:31.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.942+0000 7f540e39e700 1 --2- 172.21.15.103:0/1297953672 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5408142320 0x7f540812dc80 secure :-1 s=THROTTLE_DONE pgs=936 cs=0 l=1 rx=0x7f54000032b0 tx=0x7f54000110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:31.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.942+0000 7f540eb9f700 1 -- 172.21.15.103:0/1297953672 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5408056c90 con 0x7f5408142320 2020-04-22T14:11:31.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.943+0000 7f53faffd700 1 --2- 172.21.15.103:0/1297953672 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f53e804d7a0 0x7f53e804fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:31.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.943+0000 7f53faffd700 1 -- 172.21.15.103:0/1297953672 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f5400061570 con 0x7f5408142320 2020-04-22T14:11:31.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.943+0000 7f540db9d700 1 --2- 172.21.15.103:0/1297953672 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f53e804d7a0 0x7f53e804fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:31.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.943+0000 7f540db9d700 1 --2- 172.21.15.103:0/1297953672 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f53e804d7a0 0x7f53e804fc60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5404001320 tx=0x7f54040017e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:31.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.943+0000 7f540db9d700 1 --2- 172.21.15.103:0/1297953672 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f53e804d7a0 0x7f53e804fc60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5404001320 tx=0x7f54040017e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:31.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.943+0000 7f540db9d700 1 --2- 172.21.15.103:0/1297953672 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f53e804d7a0 0x7f53e804fc60 secure :-1 s=READY pgs=352 cs=0 l=1 rx=0x7f5404001320 tx=0x7f54040017e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:31.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.947+0000 7f540e39e700 1 --2- 172.21.15.103:0/1297953672 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5408142320 0x7f540812dc80 secure :-1 s=THROTTLE_DONE pgs=936 cs=0 l=1 rx=0x7f54000032b0 tx=0x7f54000110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:31.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:31.947+0000 7f53faffd700 1 -- 172.21.15.103:0/1297953672 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f540003ca70 con 0x7f5408142320 2020-04-22T14:11:32.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:32.133+0000 7f540eb9f700 1 -- 172.21.15.103:0/1297953672 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f54080b82c0 con 0x7f5408142320 2020-04-22T14:11:32.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:32.133+0000 7f540e39e700 1 --2- 172.21.15.103:0/1297953672 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5408142320 0x7f540812dc80 secure :-1 s=THROTTLE_DONE pgs=936 cs=0 l=1 rx=0x7f54000032b0 tx=0x7f54000110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:32.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:32.134+0000 7f53faffd700 1 -- 172.21.15.103:0/1297953672 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f5400040090 con 0x7f5408142320 2020-04-22T14:11:32.137 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:32.138 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/1837726033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1837726033},{"type":"v1","addr":"172.21.15.86:6835","nonce":1837726033}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:03.499587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:11:32.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:32.135+0000 7f540eb9f700 1 -- 172.21.15.103:0/1297953672 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f53e804d7a0 msgr2=0x7f53e804fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:32.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:32.135+0000 7f540eb9f700 1 --2- 172.21.15.103:0/1297953672 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f53e804d7a0 0x7f53e804fc60 secure :-1 s=READY pgs=352 cs=0 l=1 rx=0x7f5404001320 tx=0x7f54040017e0).stop 2020-04-22T14:11:32.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:32.135+0000 7f540eb9f700 1 -- 172.21.15.103:0/1297953672 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5408142320 msgr2=0x7f540812dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:32.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:32.135+0000 7f540eb9f700 1 --2- 172.21.15.103:0/1297953672 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5408142320 0x7f540812dc80 secure :-1 s=READY pgs=936 cs=0 l=1 rx=0x7f54000032b0 tx=0x7f54000110f0).stop 2020-04-22T14:11:32.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:32.135+0000 7f540eb9f700 1 -- 172.21.15.103:0/1297953672 shutdown_connections 2020-04-22T14:11:32.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:32.135+0000 7f540eb9f700 1 --2- 172.21.15.103:0/1297953672 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f53e804d7a0 0x7f53e804fc60 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:32.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:32.135+0000 7f540eb9f700 1 --2- 172.21.15.103:0/1297953672 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5408142320 0x7f540812dc80 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:32.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:32.135+0000 7f540eb9f700 1 -- 172.21.15.103:0/1297953672 >> 172.21.15.103:0/1297953672 conn(0x7f540805b7c0 msgr2=0x7f5408063930 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:32.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:32.135+0000 7f540eb9f700 1 -- 172.21.15.103:0/1297953672 shutdown_connections 2020-04-22T14:11:32.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:32.135+0000 7f540eb9f700 1 -- 172.21.15.103:0/1297953672 wait complete. 2020-04-22T14:11:32.140 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 41 2020-04-22T14:11:32.148 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:11:33.149 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:33.166 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:11:33.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.318+0000 7f76184d2700 1 Processor -- start 2020-04-22T14:11:33.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.318+0000 7f76184d2700 1 -- start start 2020-04-22T14:11:33.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.319+0000 7f76184d2700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7610140320 0x7f76100ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:33.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.319+0000 7f76184d2700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f76100bd1b0 0x7f76100bd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:33.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.319+0000 7f76184d2700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f761014a710 con 0x7f761014a2b0 2020-04-22T14:11:33.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.319+0000 7f76184d2700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76101462f0 con 0x7f76100bd1b0 2020-04-22T14:11:33.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.319+0000 7f76184d2700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7610146590 con 0x7f7610140320 2020-04-22T14:11:33.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.319+0000 7f7616a6f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f76100bd1b0 0x7f76100bd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:33.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.319+0000 7f761626e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7610140320 0x7f76100ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:33.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.319+0000 7f761626e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7610140320 0x7f76100ae1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:36776/0 (socket says 172.21.15.103:36776) 2020-04-22T14:11:33.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.319+0000 7f7616a6f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f76100bd1b0 0x7f76100bd640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:49232/0 (socket says 172.21.15.103:49232) 2020-04-22T14:11:33.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.319+0000 7f761626e700 1 -- 172.21.15.103:0/2617888528 learned_addr learned my addr 172.21.15.103:0/2617888528 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:33.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.319+0000 7f7615a6d700 1 --1- 172.21.15.103:0/2617888528 >> v1:172.21.15.86:6789/0 conn(0x7f761014a2b0 0x7f7610146cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:33116/0 (socket says 172.21.15.103:33116) 2020-04-22T14:11:33.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.320+0000 7f7616a6f700 1 -- 172.21.15.103:0/2617888528 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7610140320 msgr2=0x7f76100ae1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:33.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.320+0000 7f7616a6f700 1 --2- 172.21.15.103:0/2617888528 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7610140320 0x7f76100ae1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:33.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.320+0000 7f7616a6f700 1 -- 172.21.15.103:0/2617888528 >> v1:172.21.15.86:6789/0 conn(0x7f761014a2b0 legacy=0x7f7610146cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:33.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.320+0000 7f761526c700 1 -- 172.21.15.103:0/2617888528 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1844745693 0 0) 0x7f761014a710 con 0x7f761014a2b0 2020-04-22T14:11:33.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.320+0000 7f7616a6f700 1 -- 172.21.15.103:0/2617888528 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7610146830 con 0x7f76100bd1b0 2020-04-22T14:11:33.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.320+0000 7f761626e700 1 --2- 172.21.15.103:0/2617888528 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7610140320 0x7f76100ae1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:11:33.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.320+0000 7f7616a6f700 1 --2- 172.21.15.103:0/2617888528 >> v2:172.21.15.86:3300/0 conn(0x7f76100bd1b0 0x7f76100bd640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f76080032b0 tx=0x7f7608007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:33.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.320+0000 7f7616a6f700 1 --2- 172.21.15.103:0/2617888528 >> v2:172.21.15.86:3300/0 conn(0x7f76100bd1b0 0x7f76100bd640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f76080032b0 tx=0x7f7608007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:33.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.320+0000 7f7616a6f700 1 --2- 172.21.15.103:0/2617888528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76100bd1b0 0x7f76100bd640 secure :-1 s=READY pgs=536 cs=0 l=1 rx=0x7f76080032b0 tx=0x7f7608007dc0).ready entity=mon.0 client_cookie=46fad0c1dd54abd6 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:33.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.320+0000 7f7616a6f700 1 --2- 172.21.15.103:0/2617888528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76100bd1b0 0x7f76100bd640 secure :-1 s=THROTTLE_DONE pgs=536 cs=0 l=1 rx=0x7f76080032b0 tx=0x7f7608007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:33.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.320+0000 7f761526c700 1 -- 172.21.15.103:0/2617888528 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7608011e20 con 0x7f76100bd1b0 2020-04-22T14:11:33.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.320+0000 7f7616a6f700 1 --2- 172.21.15.103:0/2617888528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76100bd1b0 0x7f76100bd640 secure :-1 s=THROTTLE_DONE pgs=536 cs=0 l=1 rx=0x7f76080032b0 tx=0x7f7608007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:33.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.320+0000 7f761526c700 1 -- 172.21.15.103:0/2617888528 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760800a180 con 0x7f76100bd1b0 2020-04-22T14:11:33.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.320+0000 7f7616a6f700 1 --2- 172.21.15.103:0/2617888528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76100bd1b0 0x7f76100bd640 secure :-1 s=THROTTLE_DONE pgs=536 cs=0 l=1 rx=0x7f76080032b0 tx=0x7f7608007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:33.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.320+0000 7f76184d2700 1 -- 172.21.15.103:0/2617888528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76100bd1b0 msgr2=0x7f76100bd640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:33.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.320+0000 7f761526c700 1 -- 172.21.15.103:0/2617888528 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f760800a520 con 0x7f76100bd1b0 2020-04-22T14:11:33.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.320+0000 7f76184d2700 1 --2- 172.21.15.103:0/2617888528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76100bd1b0 0x7f76100bd640 secure :-1 s=READY pgs=536 cs=0 l=1 rx=0x7f76080032b0 tx=0x7f7608007dc0).stop 2020-04-22T14:11:33.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.321+0000 7f76184d2700 1 -- 172.21.15.103:0/2617888528 shutdown_connections 2020-04-22T14:11:33.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.321+0000 7f76184d2700 1 --2- 172.21.15.103:0/2617888528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76100bd1b0 0x7f76100bd640 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:33.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.321+0000 7f76184d2700 1 --2- 172.21.15.103:0/2617888528 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7610140320 0x7f76100ae1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:33.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.321+0000 7f76184d2700 1 -- 172.21.15.103:0/2617888528 >> 172.21.15.103:0/2617888528 conn(0x7f761005f2c0 msgr2=0x7f76100bcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:33.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.321+0000 7f76184d2700 1 -- 172.21.15.103:0/2617888528 shutdown_connections 2020-04-22T14:11:33.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.321+0000 7f76184d2700 1 -- 172.21.15.103:0/2617888528 wait complete. 2020-04-22T14:11:33.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.322+0000 7f76184d2700 1 Processor -- start 2020-04-22T14:11:33.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.322+0000 7f76184d2700 1 -- start start 2020-04-22T14:11:33.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.323+0000 7f76184d2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f76100bd1b0 0x7f7610143670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:33.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.323+0000 7f76184d2700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f761014a2b0 0x7f76100b2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:33.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.323+0000 7f76184d2700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7610134ea0 con 0x7f7610140320 2020-04-22T14:11:33.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.323+0000 7f76184d2700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7610140700 con 0x7f761014a2b0 2020-04-22T14:11:33.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.323+0000 7f76184d2700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76101409a0 con 0x7f76100bd1b0 2020-04-22T14:11:33.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.323+0000 7f761626e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f76100bd1b0 0x7f7610143670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:33.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.323+0000 7f761626e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f76100bd1b0 0x7f7610143670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52006/0 (socket says 172.21.15.103:52006) 2020-04-22T14:11:33.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.323+0000 7f761626e700 1 -- 172.21.15.103:0/866091545 learned_addr learned my addr 172.21.15.103:0/866091545 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:33.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.323+0000 7f7616a6f700 1 --2- 172.21.15.103:0/866091545 >> v2:172.21.15.86:3300/0 conn(0x7f761014a2b0 0x7f76100b2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:33.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.323+0000 7f761626e700 1 -- 172.21.15.103:0/866091545 >> v2:172.21.15.86:3300/0 conn(0x7f761014a2b0 msgr2=0x7f76100b2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:33.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.323+0000 7f761626e700 1 --2- 172.21.15.103:0/866091545 >> v2:172.21.15.86:3300/0 conn(0x7f761014a2b0 0x7f76100b2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:33.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.323+0000 7f761626e700 1 -- 172.21.15.103:0/866091545 >> v1:172.21.15.86:6789/0 conn(0x7f7610140320 legacy=0x7f7610153b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:33.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.323+0000 7f761626e700 1 -- 172.21.15.103:0/866091545 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7610140c40 con 0x7f76100bd1b0 2020-04-22T14:11:33.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.323+0000 7f761626e700 1 --2- 172.21.15.103:0/866091545 >> v2:172.21.15.103:3300/0 conn(0x7f76100bd1b0 0x7f7610143670 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f76100b2220 tx=0x7f7604010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:33.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.323+0000 7f761626e700 1 --2- 172.21.15.103:0/866091545 >> v2:172.21.15.103:3300/0 conn(0x7f76100bd1b0 0x7f7610143670 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f76100b2220 tx=0x7f7604010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:33.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.323+0000 7f761626e700 1 --2- 172.21.15.103:0/866091545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76100bd1b0 0x7f7610143670 secure :-1 s=READY pgs=937 cs=0 l=1 rx=0x7f76100b2220 tx=0x7f7604010ed0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:33.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.323+0000 7f761626e700 1 --2- 172.21.15.103:0/866091545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76100bd1b0 0x7f7610143670 secure :-1 s=THROTTLE_DONE pgs=937 cs=0 l=1 rx=0x7f76100b2220 tx=0x7f7604010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:33.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.323+0000 7f76037fe700 1 -- 172.21.15.103:0/866091545 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7604012c70 con 0x7f76100bd1b0 2020-04-22T14:11:33.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.323+0000 7f761626e700 1 --2- 172.21.15.103:0/866091545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76100bd1b0 0x7f7610143670 secure :-1 s=THROTTLE_DONE pgs=937 cs=0 l=1 rx=0x7f76100b2220 tx=0x7f7604010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:33.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.323+0000 7f76184d2700 1 -- 172.21.15.103:0/866091545 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7610140ee0 con 0x7f76100bd1b0 2020-04-22T14:11:33.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.323+0000 7f76037fe700 1 -- 172.21.15.103:0/866091545 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7604012dd0 con 0x7f76100bd1b0 2020-04-22T14:11:33.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.323+0000 7f761626e700 1 --2- 172.21.15.103:0/866091545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76100bd1b0 0x7f7610143670 secure :-1 s=THROTTLE_DONE pgs=937 cs=0 l=1 rx=0x7f76100b2220 tx=0x7f7604010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:33.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.323+0000 7f76037fe700 1 -- 172.21.15.103:0/866091545 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76040058b0 con 0x7f76100bd1b0 2020-04-22T14:11:33.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.323+0000 7f76184d2700 1 -- 172.21.15.103:0/866091545 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76100b0e10 con 0x7f76100bd1b0 2020-04-22T14:11:33.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.324+0000 7f761626e700 1 --2- 172.21.15.103:0/866091545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76100bd1b0 0x7f7610143670 secure :-1 s=THROTTLE_DONE pgs=937 cs=0 l=1 rx=0x7f76100b2220 tx=0x7f7604010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:33.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.325+0000 7f76184d2700 1 -- 172.21.15.103:0/866091545 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7610141070 con 0x7f76100bd1b0 2020-04-22T14:11:33.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.325+0000 7f76037fe700 1 -- 172.21.15.103:0/866091545 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f7604005b70 con 0x7f76100bd1b0 2020-04-22T14:11:33.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.325+0000 7f761626e700 1 --2- 172.21.15.103:0/866091545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76100bd1b0 0x7f7610143670 secure :-1 s=THROTTLE_DONE pgs=937 cs=0 l=1 rx=0x7f76100b2220 tx=0x7f7604010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:33.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.325+0000 7f76037fe700 1 --2- 172.21.15.103:0/866091545 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f75f004d900 0x7f75f004fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:33.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.325+0000 7f76037fe700 1 -- 172.21.15.103:0/866091545 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f76040619c0 con 0x7f76100bd1b0 2020-04-22T14:11:33.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.325+0000 7f7615a6d700 1 --2- 172.21.15.103:0/866091545 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f75f004d900 0x7f75f004fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:33.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.325+0000 7f7615a6d700 1 --2- 172.21.15.103:0/866091545 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f75f004d900 0x7f75f004fdc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7610142a50 tx=0x7f760c001590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:33.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.325+0000 7f7615a6d700 1 --2- 172.21.15.103:0/866091545 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f75f004d900 0x7f75f004fdc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7610142a50 tx=0x7f760c001590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:33.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.325+0000 7f7615a6d700 1 --2- 172.21.15.103:0/866091545 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f75f004d900 0x7f75f004fdc0 secure :-1 s=READY pgs=353 cs=0 l=1 rx=0x7f7610142a50 tx=0x7f760c001590).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:33.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.329+0000 7f761626e700 1 --2- 172.21.15.103:0/866091545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76100bd1b0 0x7f7610143670 secure :-1 s=THROTTLE_DONE pgs=937 cs=0 l=1 rx=0x7f76100b2220 tx=0x7f7604010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:33.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.329+0000 7f76037fe700 1 -- 172.21.15.103:0/866091545 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f760403cd40 con 0x7f76100bd1b0 2020-04-22T14:11:33.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.521+0000 7f76184d2700 1 -- 172.21.15.103:0/866091545 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7610056c90 con 0x7f76100bd1b0 2020-04-22T14:11:33.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.522+0000 7f761626e700 1 --2- 172.21.15.103:0/866091545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76100bd1b0 0x7f7610143670 secure :-1 s=THROTTLE_DONE pgs=937 cs=0 l=1 rx=0x7f76100b2220 tx=0x7f7604010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:33.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.522+0000 7f76037fe700 1 -- 172.21.15.103:0/866091545 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f7604040360 con 0x7f76100bd1b0 2020-04-22T14:11:33.525 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:33.526 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/1837726033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1837726033},{"type":"v1","addr":"172.21.15.86:6835","nonce":1837726033}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:03.499587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:11:33.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.523+0000 7f76184d2700 1 -- 172.21.15.103:0/866091545 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f75f004d900 msgr2=0x7f75f004fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:33.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.523+0000 7f76184d2700 1 --2- 172.21.15.103:0/866091545 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f75f004d900 0x7f75f004fdc0 secure :-1 s=READY pgs=353 cs=0 l=1 rx=0x7f7610142a50 tx=0x7f760c001590).stop 2020-04-22T14:11:33.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.523+0000 7f76184d2700 1 -- 172.21.15.103:0/866091545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76100bd1b0 msgr2=0x7f7610143670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:33.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.523+0000 7f76184d2700 1 --2- 172.21.15.103:0/866091545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76100bd1b0 0x7f7610143670 secure :-1 s=READY pgs=937 cs=0 l=1 rx=0x7f76100b2220 tx=0x7f7604010ed0).stop 2020-04-22T14:11:33.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.523+0000 7f76184d2700 1 -- 172.21.15.103:0/866091545 shutdown_connections 2020-04-22T14:11:33.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.523+0000 7f76184d2700 1 --2- 172.21.15.103:0/866091545 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f75f004d900 0x7f75f004fdc0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:33.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.523+0000 7f76184d2700 1 --2- 172.21.15.103:0/866091545 >> v2:172.21.15.86:3300/0 conn(0x7f761014a2b0 0x7f76100b2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:33.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.523+0000 7f76184d2700 1 --2- 172.21.15.103:0/866091545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76100bd1b0 0x7f7610143670 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:33.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.523+0000 7f76184d2700 1 -- 172.21.15.103:0/866091545 >> 172.21.15.103:0/866091545 conn(0x7f761005f2c0 msgr2=0x7f7610148820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:33.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.523+0000 7f76184d2700 1 -- 172.21.15.103:0/866091545 shutdown_connections 2020-04-22T14:11:33.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:33.523+0000 7f76184d2700 1 -- 172.21.15.103:0/866091545 wait complete. 2020-04-22T14:11:33.529 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 41 2020-04-22T14:11:33.537 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:11:34.537 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:34.554 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:11:34.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.707+0000 7f969fbe7700 1 Processor -- start 2020-04-22T14:11:34.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.707+0000 7f969fbe7700 1 -- start start 2020-04-22T14:11:34.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.707+0000 7f969fbe7700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96980b6040 0x7f96980ac740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:34.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.707+0000 7f969fbe7700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f96981426d0 0x7f9698142b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:34.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.707+0000 7f969fbe7700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9698064ec0 con 0x7f9698067170 2020-04-22T14:11:34.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.707+0000 7f969fbe7700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9698065af0 con 0x7f96981426d0 2020-04-22T14:11:34.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.707+0000 7f969fbe7700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9698146870 con 0x7f96980b6040 2020-04-22T14:11:34.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.708+0000 7f969e184700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f96981426d0 0x7f9698142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:34.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.708+0000 7f969e184700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f96981426d0 0x7f9698142b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52012/0 (socket says 172.21.15.103:52012) 2020-04-22T14:11:34.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.708+0000 7f969d983700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f9698067170 0x7f969813c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44202/0 (socket says 172.21.15.103:44202) 2020-04-22T14:11:34.714 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.708+0000 7f969e184700 1 -- 172.21.15.103:0/160240736 learned_addr learned my addr 172.21.15.103:0/160240736 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:34.714 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.708+0000 7f969d182700 1 --2- 172.21.15.103:0/160240736 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96980b6040 0x7f96980ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:34.714 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.708+0000 7f969e184700 1 -- 172.21.15.103:0/160240736 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96980b6040 msgr2=0x7f96980ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:34.714 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.708+0000 7f969e184700 1 --2- 172.21.15.103:0/160240736 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96980b6040 0x7f96980ac740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:34.714 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.708+0000 7f969e184700 1 -- 172.21.15.103:0/160240736 >> v1:172.21.15.103:6789/0 conn(0x7f9698067170 legacy=0x7f969813c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:34.714 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.708+0000 7f969c981700 1 -- 172.21.15.103:0/160240736 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 964879688 0 0) 0x7f9698064ec0 con 0x7f9698067170 2020-04-22T14:11:34.714 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.708+0000 7f969e184700 1 -- 172.21.15.103:0/160240736 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9698067550 con 0x7f96981426d0 2020-04-22T14:11:34.714 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.708+0000 7f969d182700 1 --2- 172.21.15.103:0/160240736 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96980b6040 0x7f96980ac740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:11:34.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.708+0000 7f969e184700 1 --2- 172.21.15.103:0/160240736 >> v2:172.21.15.103:3300/0 conn(0x7f96981426d0 0x7f9698142b80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f96900032b0 tx=0x7f9690007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:34.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.708+0000 7f969e184700 1 --2- 172.21.15.103:0/160240736 >> v2:172.21.15.103:3300/0 conn(0x7f96981426d0 0x7f9698142b80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f96900032b0 tx=0x7f9690007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:34.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.708+0000 7f969e184700 1 --2- 172.21.15.103:0/160240736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96981426d0 0x7f9698142b80 secure :-1 s=READY pgs=939 cs=0 l=1 rx=0x7f96900032b0 tx=0x7f9690007dc0).ready entity=mon.1 client_cookie=8f2a77b51d8a97b7 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:34.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.708+0000 7f969e184700 1 --2- 172.21.15.103:0/160240736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96981426d0 0x7f9698142b80 secure :-1 s=THROTTLE_DONE pgs=939 cs=0 l=1 rx=0x7f96900032b0 tx=0x7f9690007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:34.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.708+0000 7f969c981700 1 -- 172.21.15.103:0/160240736 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f969000a180 con 0x7f96981426d0 2020-04-22T14:11:34.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.708+0000 7f969e184700 1 --2- 172.21.15.103:0/160240736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96981426d0 0x7f9698142b80 secure :-1 s=THROTTLE_DONE pgs=939 cs=0 l=1 rx=0x7f96900032b0 tx=0x7f9690007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:34.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.708+0000 7f969e184700 1 --2- 172.21.15.103:0/160240736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96981426d0 0x7f9698142b80 secure :-1 s=THROTTLE_DONE pgs=939 cs=0 l=1 rx=0x7f96900032b0 tx=0x7f9690007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:34.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.708+0000 7f969c981700 1 -- 172.21.15.103:0/160240736 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969000a320 con 0x7f96981426d0 2020-04-22T14:11:34.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.708+0000 7f969c981700 1 -- 172.21.15.103:0/160240736 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f969000a700 con 0x7f96981426d0 2020-04-22T14:11:34.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.708+0000 7f969fbe7700 1 -- 172.21.15.103:0/160240736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96981426d0 msgr2=0x7f9698142b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:34.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.708+0000 7f969fbe7700 1 --2- 172.21.15.103:0/160240736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96981426d0 0x7f9698142b80 secure :-1 s=READY pgs=939 cs=0 l=1 rx=0x7f96900032b0 tx=0x7f9690007dc0).stop 2020-04-22T14:11:34.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.709+0000 7f969fbe7700 1 -- 172.21.15.103:0/160240736 shutdown_connections 2020-04-22T14:11:34.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.709+0000 7f969fbe7700 1 --2- 172.21.15.103:0/160240736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96981426d0 0x7f9698142b80 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:34.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.709+0000 7f969fbe7700 1 --2- 172.21.15.103:0/160240736 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96980b6040 0x7f96980ac740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:34.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.709+0000 7f969fbe7700 1 -- 172.21.15.103:0/160240736 >> 172.21.15.103:0/160240736 conn(0x7f96980b9160 msgr2=0x7f969805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:34.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.709+0000 7f969fbe7700 1 -- 172.21.15.103:0/160240736 shutdown_connections 2020-04-22T14:11:34.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.709+0000 7f969fbe7700 1 -- 172.21.15.103:0/160240736 wait complete. 2020-04-22T14:11:34.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.710+0000 7f969fbe7700 1 Processor -- start 2020-04-22T14:11:34.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.710+0000 7f969fbe7700 1 -- start start 2020-04-22T14:11:34.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.711+0000 7f969fbe7700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9698067170 0x7f96980645c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:34.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.711+0000 7f969fbe7700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f96981426d0 0x7f9698144f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:34.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.711+0000 7f969fbe7700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96981453a0 con 0x7f96980b6040 2020-04-22T14:11:34.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.711+0000 7f969fbe7700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f969813b480 con 0x7f96981426d0 2020-04-22T14:11:34.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.711+0000 7f969fbe7700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96981406e0 con 0x7f9698067170 2020-04-22T14:11:34.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.711+0000 7f969d983700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9698067170 0x7f96980645c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:34.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.711+0000 7f969e184700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f96981426d0 0x7f9698144f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:34.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.711+0000 7f969d983700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9698067170 0x7f96980645c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:36794/0 (socket says 172.21.15.103:36794) 2020-04-22T14:11:34.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.711+0000 7f969d983700 1 -- 172.21.15.103:0/378005762 learned_addr learned my addr 172.21.15.103:0/378005762 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:34.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.711+0000 7f969d983700 1 -- 172.21.15.103:0/378005762 >> v2:172.21.15.86:3300/0 conn(0x7f96981426d0 msgr2=0x7f9698144f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:34.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.711+0000 7f969d983700 1 --2- 172.21.15.103:0/378005762 >> v2:172.21.15.86:3300/0 conn(0x7f96981426d0 0x7f9698144f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:34.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.711+0000 7f969d983700 1 -- 172.21.15.103:0/378005762 >> v1:172.21.15.86:6789/0 conn(0x7f96980b6040 legacy=0x7f9698137fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:34.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.711+0000 7f969d983700 1 -- 172.21.15.103:0/378005762 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f969813b1e0 con 0x7f9698067170 2020-04-22T14:11:34.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.711+0000 7f969d983700 1 --2- 172.21.15.103:0/378005762 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9698067170 0x7f96980645c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9688000b80 tx=0x7f9688010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:34.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.711+0000 7f969d983700 1 --2- 172.21.15.103:0/378005762 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9698067170 0x7f96980645c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9688000b80 tx=0x7f9688010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:34.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.711+0000 7f969d983700 1 --2- 172.21.15.103:0/378005762 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9698067170 0x7f96980645c0 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7f9688000b80 tx=0x7f9688010940).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:34.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.712+0000 7f969d983700 1 --2- 172.21.15.103:0/378005762 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9698067170 0x7f96980645c0 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f9688000b80 tx=0x7f9688010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:34.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.712+0000 7f9686ffd700 1 -- 172.21.15.103:0/378005762 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9688011650 con 0x7f9698067170 2020-04-22T14:11:34.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.712+0000 7f969d983700 1 --2- 172.21.15.103:0/378005762 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9698067170 0x7f96980645c0 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f9688000b80 tx=0x7f9688010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:34.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.712+0000 7f969d983700 1 --2- 172.21.15.103:0/378005762 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9698067170 0x7f96980645c0 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f9688000b80 tx=0x7f9688010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:34.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.712+0000 7f9686ffd700 1 -- 172.21.15.103:0/378005762 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96880117b0 con 0x7f9698067170 2020-04-22T14:11:34.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.712+0000 7f9686ffd700 1 -- 172.21.15.103:0/378005762 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9688011bd0 con 0x7f9698067170 2020-04-22T14:11:34.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.712+0000 7f969fbe7700 1 -- 172.21.15.103:0/378005762 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96981386e0 con 0x7f9698067170 2020-04-22T14:11:34.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.712+0000 7f969fbe7700 1 -- 172.21.15.103:0/378005762 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f969813ad90 con 0x7f9698067170 2020-04-22T14:11:34.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.712+0000 7f969d983700 1 --2- 172.21.15.103:0/378005762 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9698067170 0x7f96980645c0 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f9688000b80 tx=0x7f9688010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:34.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.713+0000 7f9686ffd700 1 -- 172.21.15.103:0/378005762 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f968800b370 con 0x7f9698067170 2020-04-22T14:11:34.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.713+0000 7f969d983700 1 --2- 172.21.15.103:0/378005762 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9698067170 0x7f96980645c0 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f9688000b80 tx=0x7f9688010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:34.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.713+0000 7f969fbe7700 1 -- 172.21.15.103:0/378005762 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9698140850 con 0x7f9698067170 2020-04-22T14:11:34.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.713+0000 7f9686ffd700 1 --2- 172.21.15.103:0/378005762 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f967804d900 0x7f967804fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:34.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.713+0000 7f9686ffd700 1 -- 172.21.15.103:0/378005762 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f9688061640 con 0x7f9698067170 2020-04-22T14:11:34.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.713+0000 7f969d182700 1 --2- 172.21.15.103:0/378005762 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f967804d900 0x7f967804fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:34.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.714+0000 7f969d182700 1 --2- 172.21.15.103:0/378005762 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f967804d900 0x7f967804fdc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f96981459d0 tx=0x7f9694007e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:34.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.714+0000 7f969d182700 1 --2- 172.21.15.103:0/378005762 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f967804d900 0x7f967804fdc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f96981459d0 tx=0x7f9694007e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:34.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.714+0000 7f969d182700 1 --2- 172.21.15.103:0/378005762 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f967804d900 0x7f967804fdc0 secure :-1 s=READY pgs=354 cs=0 l=1 rx=0x7f96981459d0 tx=0x7f9694007e30).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:34.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.717+0000 7f969d983700 1 --2- 172.21.15.103:0/378005762 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9698067170 0x7f96980645c0 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f9688000b80 tx=0x7f9688010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:34.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.717+0000 7f9686ffd700 1 -- 172.21.15.103:0/378005762 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f968803c9c0 con 0x7f9698067170 2020-04-22T14:11:34.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.906+0000 7f969fbe7700 1 -- 172.21.15.103:0/378005762 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9698056c90 con 0x7f9698067170 2020-04-22T14:11:34.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.907+0000 7f969d983700 1 --2- 172.21.15.103:0/378005762 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9698067170 0x7f96980645c0 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f9688000b80 tx=0x7f9688010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:34.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.907+0000 7f9686ffd700 1 -- 172.21.15.103:0/378005762 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f968803ffe0 con 0x7f9698067170 2020-04-22T14:11:34.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.909+0000 7f969fbe7700 1 -- 172.21.15.103:0/378005762 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f967804d900 msgr2=0x7f967804fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:34.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.909+0000 7f969fbe7700 1 --2- 172.21.15.103:0/378005762 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f967804d900 0x7f967804fdc0 secure :-1 s=READY pgs=354 cs=0 l=1 rx=0x7f96981459d0 tx=0x7f9694007e30).stop 2020-04-22T14:11:34.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.909+0000 7f969fbe7700 1 -- 172.21.15.103:0/378005762 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9698067170 msgr2=0x7f96980645c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:34.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.909+0000 7f969fbe7700 1 --2- 172.21.15.103:0/378005762 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9698067170 0x7f96980645c0 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7f9688000b80 tx=0x7f9688010940).stop 2020-04-22T14:11:34.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.909+0000 7f969fbe7700 1 -- 172.21.15.103:0/378005762 shutdown_connections 2020-04-22T14:11:34.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.909+0000 7f969fbe7700 1 --2- 172.21.15.103:0/378005762 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f967804d900 0x7f967804fdc0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:34.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.909+0000 7f969fbe7700 1 --2- 172.21.15.103:0/378005762 >> v2:172.21.15.86:3300/0 conn(0x7f96981426d0 0x7f9698144f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:34.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.909+0000 7f969fbe7700 1 --2- 172.21.15.103:0/378005762 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9698067170 0x7f96980645c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:34.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.909+0000 7f969fbe7700 1 -- 172.21.15.103:0/378005762 >> 172.21.15.103:0/378005762 conn(0x7f96980b9160 msgr2=0x7f9698142ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:34.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.909+0000 7f969fbe7700 1 -- 172.21.15.103:0/378005762 shutdown_connections 2020-04-22T14:11:34.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:34.909+0000 7f969fbe7700 1 -- 172.21.15.103:0/378005762 wait complete. 2020-04-22T14:11:34.915 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 41 2020-04-22T14:11:34.915 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:34.915 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/1837726033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1837726033},{"type":"v1","addr":"172.21.15.86:6835","nonce":1837726033}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:03.499587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:11:34.922 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:11:35.923 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:35.941 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:11:36.097 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.094+0000 7f18e9a1a700 1 Processor -- start 2020-04-22T14:11:36.097 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.094+0000 7f18e9a1a700 1 -- start start 2020-04-22T14:11:36.100 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.095+0000 7f18e9a1a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f18e412c0d0 0x7f18e41464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:36.100 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.095+0000 7f18e9a1a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18e4065fe0 0x7f18e405b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:36.100 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.095+0000 7f18e9a1a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e4143300 con 0x7f18e405b8a0 2020-04-22T14:11:36.101 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.095+0000 7f18e9a1a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e412c4b0 con 0x7f18e412c0d0 2020-04-22T14:11:36.101 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.095+0000 7f18e9a1a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e41435a0 con 0x7f18e4065fe0 2020-04-22T14:11:36.101 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.095+0000 7f18e2ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f18e412c0d0 0x7f18e41464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:36.101 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.095+0000 7f18e2ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f18e412c0d0 0x7f18e41464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52024/0 (socket says 172.21.15.103:52024) 2020-04-22T14:11:36.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.095+0000 7f18e2ffd700 1 -- 172.21.15.103:0/897649836 learned_addr learned my addr 172.21.15.103:0/897649836 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:36.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.095+0000 7f18e27fc700 1 --2- 172.21.15.103:0/897649836 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18e4065fe0 0x7f18e405b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:36.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.095+0000 7f18e2ffd700 1 -- 172.21.15.103:0/897649836 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18e4065fe0 msgr2=0x7f18e405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:36.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.095+0000 7f18e2ffd700 1 --2- 172.21.15.103:0/897649836 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18e4065fe0 0x7f18e405b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:36.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.095+0000 7f18e2ffd700 1 -- 172.21.15.103:0/897649836 >> v1:172.21.15.86:6789/0 conn(0x7f18e405b8a0 legacy=0x7f18e4062ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:36.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.095+0000 7f18e2ffd700 1 -- 172.21.15.103:0/897649836 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e4143840 con 0x7f18e412c0d0 2020-04-22T14:11:36.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.095+0000 7f18e2ffd700 1 --2- 172.21.15.103:0/897649836 >> v2:172.21.15.103:3300/0 conn(0x7f18e412c0d0 0x7f18e41464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f18e40613e0 tx=0x7f18d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:36.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.095+0000 7f18e2ffd700 1 --2- 172.21.15.103:0/897649836 >> v2:172.21.15.103:3300/0 conn(0x7f18e412c0d0 0x7f18e41464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f18e40613e0 tx=0x7f18d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:36.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.095+0000 7f18e2ffd700 1 --2- 172.21.15.103:0/897649836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18e412c0d0 0x7f18e41464e0 secure :-1 s=READY pgs=940 cs=0 l=1 rx=0x7f18e40613e0 tx=0x7f18d8007a40).ready entity=mon.1 client_cookie=66581fc2adbb66f2 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:36.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.096+0000 7f18e2ffd700 1 --2- 172.21.15.103:0/897649836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18e412c0d0 0x7f18e41464e0 secure :-1 s=THROTTLE_DONE pgs=940 cs=0 l=1 rx=0x7f18e40613e0 tx=0x7f18d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:36.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.096+0000 7f18e1ffb700 1 -- 172.21.15.103:0/897649836 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18d80116e0 con 0x7f18e412c0d0 2020-04-22T14:11:36.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.096+0000 7f18e2ffd700 1 --2- 172.21.15.103:0/897649836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18e412c0d0 0x7f18e41464e0 secure :-1 s=THROTTLE_DONE pgs=940 cs=0 l=1 rx=0x7f18e40613e0 tx=0x7f18d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:36.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.096+0000 7f18e2ffd700 1 --2- 172.21.15.103:0/897649836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18e412c0d0 0x7f18e41464e0 secure :-1 s=THROTTLE_DONE pgs=940 cs=0 l=1 rx=0x7f18e40613e0 tx=0x7f18d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:36.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.096+0000 7f18e1ffb700 1 -- 172.21.15.103:0/897649836 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d8011840 con 0x7f18e412c0d0 2020-04-22T14:11:36.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.096+0000 7f18e1ffb700 1 -- 172.21.15.103:0/897649836 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18d8011c60 con 0x7f18e412c0d0 2020-04-22T14:11:36.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.096+0000 7f18e9a1a700 1 -- 172.21.15.103:0/897649836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18e412c0d0 msgr2=0x7f18e41464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:36.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.096+0000 7f18e9a1a700 1 --2- 172.21.15.103:0/897649836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18e412c0d0 0x7f18e41464e0 secure :-1 s=READY pgs=940 cs=0 l=1 rx=0x7f18e40613e0 tx=0x7f18d8007a40).stop 2020-04-22T14:11:36.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.096+0000 7f18e9a1a700 1 -- 172.21.15.103:0/897649836 shutdown_connections 2020-04-22T14:11:36.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.096+0000 7f18e9a1a700 1 --2- 172.21.15.103:0/897649836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18e412c0d0 0x7f18e41464e0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:36.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.096+0000 7f18e9a1a700 1 --2- 172.21.15.103:0/897649836 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18e4065fe0 0x7f18e405b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:36.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.096+0000 7f18e9a1a700 1 -- 172.21.15.103:0/897649836 >> 172.21.15.103:0/897649836 conn(0x7f18e40b9160 msgr2=0x7f18e405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:36.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.096+0000 7f18e9a1a700 1 -- 172.21.15.103:0/897649836 shutdown_connections 2020-04-22T14:11:36.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.096+0000 7f18e9a1a700 1 -- 172.21.15.103:0/897649836 wait complete. 2020-04-22T14:11:36.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.097+0000 7f18e9a1a700 1 Processor -- start 2020-04-22T14:11:36.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.097+0000 7f18e9a1a700 1 -- start start 2020-04-22T14:11:36.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.098+0000 7f18e9a1a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18e405b8a0 0x7f18e4124a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:36.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.098+0000 7f18e9a1a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f18e4065fe0 0x7f18e4128e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:36.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.098+0000 7f18e9a1a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e4154cc0 con 0x7f18e412c0d0 2020-04-22T14:11:36.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.098+0000 7f18e9a1a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e40ae110 con 0x7f18e4065fe0 2020-04-22T14:11:36.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.098+0000 7f18e9a1a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e4154f60 con 0x7f18e405b8a0 2020-04-22T14:11:36.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.098+0000 7f18e27fc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f18e4065fe0 0x7f18e4128e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:36.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.098+0000 7f18e2ffd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18e405b8a0 0x7f18e4124a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:36.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.098+0000 7f18e2ffd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18e405b8a0 0x7f18e4124a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:36806/0 (socket says 172.21.15.103:36806) 2020-04-22T14:11:36.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.098+0000 7f18e2ffd700 1 -- 172.21.15.103:0/2627816247 learned_addr learned my addr 172.21.15.103:0/2627816247 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:36.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.098+0000 7f18e2ffd700 1 -- 172.21.15.103:0/2627816247 >> v2:172.21.15.86:3300/0 conn(0x7f18e4065fe0 msgr2=0x7f18e4128e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:36.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.098+0000 7f18e2ffd700 1 --2- 172.21.15.103:0/2627816247 >> v2:172.21.15.86:3300/0 conn(0x7f18e4065fe0 0x7f18e4128e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:36.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.098+0000 7f18e2ffd700 1 -- 172.21.15.103:0/2627816247 >> v1:172.21.15.86:6789/0 conn(0x7f18e412c0d0 legacy=0x7f18e4141e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:36.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.098+0000 7f18d3fff700 1 -- 172.21.15.103:0/2627816247 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1386179248 0 0) 0x7f18e4154cc0 con 0x7f18e412c0d0 2020-04-22T14:11:36.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.099+0000 7f18e2ffd700 1 -- 172.21.15.103:0/2627816247 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e4142550 con 0x7f18e405b8a0 2020-04-22T14:11:36.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.099+0000 7f18e27fc700 1 --2- 172.21.15.103:0/2627816247 >> v2:172.21.15.86:3300/0 conn(0x7f18e4065fe0 0x7f18e4128e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:11:36.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.099+0000 7f18e2ffd700 1 --2- 172.21.15.103:0/2627816247 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18e405b8a0 0x7f18e4124a30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f18e40613e0 tx=0x7f18d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:36.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.099+0000 7f18e2ffd700 1 --2- 172.21.15.103:0/2627816247 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18e405b8a0 0x7f18e4124a30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f18e40613e0 tx=0x7f18d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:36.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.099+0000 7f18e2ffd700 1 --2- 172.21.15.103:0/2627816247 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18e405b8a0 0x7f18e4124a30 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7f18e40613e0 tx=0x7f18d8007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:36.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.099+0000 7f18e2ffd700 1 --2- 172.21.15.103:0/2627816247 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18e405b8a0 0x7f18e4124a30 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f18e40613e0 tx=0x7f18d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:36.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.099+0000 7f18d3fff700 1 -- 172.21.15.103:0/2627816247 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18d8011e50 con 0x7f18e405b8a0 2020-04-22T14:11:36.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.099+0000 7f18e2ffd700 1 --2- 172.21.15.103:0/2627816247 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18e405b8a0 0x7f18e4124a30 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f18e40613e0 tx=0x7f18d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:36.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.099+0000 7f18e9a1a700 1 -- 172.21.15.103:0/2627816247 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e41427a0 con 0x7f18e405b8a0 2020-04-22T14:11:36.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.099+0000 7f18d3fff700 1 -- 172.21.15.103:0/2627816247 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d8007360 con 0x7f18e405b8a0 2020-04-22T14:11:36.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.099+0000 7f18e2ffd700 1 --2- 172.21.15.103:0/2627816247 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18e405b8a0 0x7f18e4124a30 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f18e40613e0 tx=0x7f18d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:36.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.099+0000 7f18d3fff700 1 -- 172.21.15.103:0/2627816247 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18d80074d0 con 0x7f18e405b8a0 2020-04-22T14:11:36.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.099+0000 7f18e9a1a700 1 -- 172.21.15.103:0/2627816247 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e40b7150 con 0x7f18e405b8a0 2020-04-22T14:11:36.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.100+0000 7f18e2ffd700 1 --2- 172.21.15.103:0/2627816247 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18e405b8a0 0x7f18e4124a30 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f18e40613e0 tx=0x7f18d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:36.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.100+0000 7f18d3fff700 1 -- 172.21.15.103:0/2627816247 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f18d80058b0 con 0x7f18e405b8a0 2020-04-22T14:11:36.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.100+0000 7f18e2ffd700 1 --2- 172.21.15.103:0/2627816247 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18e405b8a0 0x7f18e4124a30 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f18e40613e0 tx=0x7f18d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:36.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.100+0000 7f18e9a1a700 1 -- 172.21.15.103:0/2627816247 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e4056c90 con 0x7f18e405b8a0 2020-04-22T14:11:36.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.100+0000 7f18d3fff700 1 --2- 172.21.15.103:0/2627816247 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f18c004d8a0 0x7f18c004fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:36.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.100+0000 7f18d3fff700 1 -- 172.21.15.103:0/2627816247 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f18d8061d10 con 0x7f18e405b8a0 2020-04-22T14:11:36.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.100+0000 7f18e27fc700 1 --2- 172.21.15.103:0/2627816247 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f18c004d8a0 0x7f18c004fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:36.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.101+0000 7f18e27fc700 1 --2- 172.21.15.103:0/2627816247 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f18c004d8a0 0x7f18c004fd60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f18d4002f30 tx=0x7f18d400ccd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:36.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.101+0000 7f18e27fc700 1 --2- 172.21.15.103:0/2627816247 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f18c004d8a0 0x7f18c004fd60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f18d4002f30 tx=0x7f18d400ccd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:36.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.101+0000 7f18e27fc700 1 --2- 172.21.15.103:0/2627816247 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f18c004d8a0 0x7f18c004fd60 secure :-1 s=READY pgs=355 cs=0 l=1 rx=0x7f18d4002f30 tx=0x7f18d400ccd0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:36.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.104+0000 7f18e2ffd700 1 --2- 172.21.15.103:0/2627816247 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18e405b8a0 0x7f18e4124a30 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f18e40613e0 tx=0x7f18d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:36.117 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.104+0000 7f18d3fff700 1 -- 172.21.15.103:0/2627816247 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f18d803d210 con 0x7f18e405b8a0 2020-04-22T14:11:36.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.292+0000 7f18e9a1a700 1 -- 172.21.15.103:0/2627816247 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18e4147360 con 0x7f18e405b8a0 2020-04-22T14:11:36.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.294+0000 7f18e2ffd700 1 --2- 172.21.15.103:0/2627816247 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18e405b8a0 0x7f18e4124a30 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f18e40613e0 tx=0x7f18d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:36.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.294+0000 7f18d3fff700 1 -- 172.21.15.103:0/2627816247 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f18d8040830 con 0x7f18e405b8a0 2020-04-22T14:11:36.296 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:36.296 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/1837726033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1837726033},{"type":"v1","addr":"172.21.15.86:6835","nonce":1837726033}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:03.499587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:11:36.297 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.294+0000 7f18e9a1a700 1 -- 172.21.15.103:0/2627816247 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f18c004d8a0 msgr2=0x7f18c004fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:36.298 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.294+0000 7f18e9a1a700 1 --2- 172.21.15.103:0/2627816247 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f18c004d8a0 0x7f18c004fd60 secure :-1 s=READY pgs=355 cs=0 l=1 rx=0x7f18d4002f30 tx=0x7f18d400ccd0).stop 2020-04-22T14:11:36.298 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.294+0000 7f18e9a1a700 1 -- 172.21.15.103:0/2627816247 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18e405b8a0 msgr2=0x7f18e4124a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:36.298 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.294+0000 7f18e9a1a700 1 --2- 172.21.15.103:0/2627816247 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18e405b8a0 0x7f18e4124a30 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7f18e40613e0 tx=0x7f18d8007a40).stop 2020-04-22T14:11:36.298 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.294+0000 7f18e9a1a700 1 -- 172.21.15.103:0/2627816247 shutdown_connections 2020-04-22T14:11:36.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.294+0000 7f18e9a1a700 1 --2- 172.21.15.103:0/2627816247 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18e405b8a0 0x7f18e4124a30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:36.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.294+0000 7f18e9a1a700 1 --2- 172.21.15.103:0/2627816247 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f18c004d8a0 0x7f18c004fd60 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:36.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.294+0000 7f18e9a1a700 1 --2- 172.21.15.103:0/2627816247 >> v2:172.21.15.86:3300/0 conn(0x7f18e4065fe0 0x7f18e4128e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:36.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.294+0000 7f18e9a1a700 1 -- 172.21.15.103:0/2627816247 >> 172.21.15.103:0/2627816247 conn(0x7f18e40b9160 msgr2=0x7f18e40646f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:36.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.294+0000 7f18e9a1a700 1 -- 172.21.15.103:0/2627816247 shutdown_connections 2020-04-22T14:11:36.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:36.294+0000 7f18e9a1a700 1 -- 172.21.15.103:0/2627816247 wait complete. 2020-04-22T14:11:36.300 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 41 2020-04-22T14:11:36.308 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:11:37.309 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:37.324 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:11:37.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.471+0000 7fc995725700 1 Processor -- start 2020-04-22T14:11:37.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.471+0000 7fc995725700 1 -- start start 2020-04-22T14:11:37.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.472+0000 7fc995725700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9900654e0 0x7fc9900664a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:37.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.472+0000 7fc995725700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc990142320 0x7fc990063340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:37.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.472+0000 7fc995725700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc990066a20 con 0x7fc9900ad150 2020-04-22T14:11:37.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.472+0000 7fc995725700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9900adf30 con 0x7fc990142320 2020-04-22T14:11:37.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.472+0000 7fc995725700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9900ad7f0 con 0x7fc9900654e0 2020-04-22T14:11:37.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.472+0000 7fc98ffff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc9900ad150 0x7fc990141c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44226/0 (socket says 172.21.15.103:44226) 2020-04-22T14:11:37.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.472+0000 7fc98ffff700 1 -- 172.21.15.103:0/2761705819 learned_addr learned my addr 172.21.15.103:0/2761705819 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:37.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.472+0000 7fc98f7fe700 1 --2- 172.21.15.103:0/2761705819 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9900654e0 0x7fc9900664a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:37.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.472+0000 7fc994f24700 1 --2- 172.21.15.103:0/2761705819 >> v2:172.21.15.86:3300/0 conn(0x7fc990142320 0x7fc990063340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:37.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.472+0000 7fc98effd700 1 -- 172.21.15.103:0/2761705819 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4114660580 0 0) 0x7fc990066a20 con 0x7fc9900ad150 2020-04-22T14:11:37.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.472+0000 7fc98effd700 1 -- 172.21.15.103:0/2761705819 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc97c003230 con 0x7fc9900ad150 2020-04-22T14:11:37.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.472+0000 7fc98effd700 1 -- 172.21.15.103:0/2761705819 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3268754531 0 0) 0x7fc97c003230 con 0x7fc9900ad150 2020-04-22T14:11:37.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.472+0000 7fc98effd700 1 -- 172.21.15.103:0/2761705819 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9900654e0 msgr2=0x7fc9900664a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:37.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.472+0000 7fc98effd700 1 --2- 172.21.15.103:0/2761705819 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9900654e0 0x7fc9900664a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:37.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.472+0000 7fc98effd700 1 -- 172.21.15.103:0/2761705819 >> v2:172.21.15.86:3300/0 conn(0x7fc990142320 msgr2=0x7fc990063340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:37.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.472+0000 7fc98effd700 1 --2- 172.21.15.103:0/2761705819 >> v2:172.21.15.86:3300/0 conn(0x7fc990142320 0x7fc990063340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:37.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.472+0000 7fc98effd700 1 -- 172.21.15.103:0/2761705819 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9900ada90 con 0x7fc9900ad150 2020-04-22T14:11:37.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.472+0000 7fc98effd700 1 -- 172.21.15.103:0/2761705819 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fc9800016d0 con 0x7fc9900ad150 2020-04-22T14:11:37.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.472+0000 7fc98effd700 1 -- 172.21.15.103:0/2761705819 >> v1:172.21.15.103:6789/0 conn(0x7fc9900ad150 legacy=0x7fc990141c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:37.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.472+0000 7fc98effd700 1 --2- 172.21.15.103:0/2761705819 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9900654e0 0x7fc97c003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:37.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.472+0000 7fc98effd700 1 --2- 172.21.15.103:0/2761705819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc97c003b80 0x7fc97c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:37.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.472+0000 7fc98effd700 1 --2- 172.21.15.103:0/2761705819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc97c0045c0 0x7fc97c004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:37.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.472+0000 7fc98effd700 1 -- 172.21.15.103:0/2761705819 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9900adf30 con 0x7fc97c0045c0 2020-04-22T14:11:37.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.472+0000 7fc98effd700 1 -- 172.21.15.103:0/2761705819 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9900ad7f0 con 0x7fc97c003b80 2020-04-22T14:11:37.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.472+0000 7fc98effd700 1 -- 172.21.15.103:0/2761705819 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c005050 con 0x7fc9900654e0 2020-04-22T14:11:37.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.472+0000 7fc98f7fe700 1 --2- 172.21.15.103:0/2761705819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc97c003b80 0x7fc97c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:37.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.472+0000 7fc98ffff700 1 --2- 172.21.15.103:0/2761705819 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9900654e0 0x7fc97c003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:37.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.473+0000 7fc994f24700 1 --2- 172.21.15.103:0/2761705819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc97c0045c0 0x7fc97c004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:37.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.473+0000 7fc98f7fe700 1 -- 172.21.15.103:0/2761705819 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9900654e0 msgr2=0x7fc97c003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:37.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.473+0000 7fc98f7fe700 1 --2- 172.21.15.103:0/2761705819 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9900654e0 0x7fc97c003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:37.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.473+0000 7fc98f7fe700 1 -- 172.21.15.103:0/2761705819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc97c0045c0 msgr2=0x7fc97c004a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:37.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.473+0000 7fc98f7fe700 1 --2- 172.21.15.103:0/2761705819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc97c0045c0 0x7fc97c004a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:37.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.473+0000 7fc98f7fe700 1 -- 172.21.15.103:0/2761705819 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc97c003230 con 0x7fc97c003b80 2020-04-22T14:11:37.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.473+0000 7fc98f7fe700 1 --2- 172.21.15.103:0/2761705819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc97c003b80 0x7fc97c003fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc984008910 tx=0x7fc984010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:37.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.473+0000 7fc98f7fe700 1 --2- 172.21.15.103:0/2761705819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc97c003b80 0x7fc97c003fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc984008910 tx=0x7fc984010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:37.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.473+0000 7fc98f7fe700 1 --2- 172.21.15.103:0/2761705819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc97c003b80 0x7fc97c003fe0 secure :-1 s=READY pgs=942 cs=0 l=1 rx=0x7fc984008910 tx=0x7fc984010050).ready entity=mon.1 client_cookie=6479c52bdb19f061 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:37.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.473+0000 7fc98f7fe700 1 --2- 172.21.15.103:0/2761705819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc97c003b80 0x7fc97c003fe0 secure :-1 s=THROTTLE_DONE pgs=942 cs=0 l=1 rx=0x7fc984008910 tx=0x7fc984010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:37.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.473+0000 7fc98f7fe700 1 --2- 172.21.15.103:0/2761705819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc97c003b80 0x7fc97c003fe0 secure :-1 s=THROTTLE_DONE pgs=942 cs=0 l=1 rx=0x7fc984008910 tx=0x7fc984010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:37.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.473+0000 7fc98effd700 1 -- 172.21.15.103:0/2761705819 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc984008d30 con 0x7fc97c003b80 2020-04-22T14:11:37.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.473+0000 7fc98f7fe700 1 --2- 172.21.15.103:0/2761705819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc97c003b80 0x7fc97c003fe0 secure :-1 s=THROTTLE_DONE pgs=942 cs=0 l=1 rx=0x7fc984008910 tx=0x7fc984010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:37.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.473+0000 7fc98effd700 1 -- 172.21.15.103:0/2761705819 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc984008e90 con 0x7fc97c003b80 2020-04-22T14:11:37.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.473+0000 7fc98effd700 1 -- 172.21.15.103:0/2761705819 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc984010a80 con 0x7fc97c003b80 2020-04-22T14:11:37.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.473+0000 7fc995725700 1 -- 172.21.15.103:0/2761705819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc97c003b80 msgr2=0x7fc97c003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:37.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.473+0000 7fc995725700 1 --2- 172.21.15.103:0/2761705819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc97c003b80 0x7fc97c003fe0 secure :-1 s=READY pgs=942 cs=0 l=1 rx=0x7fc984008910 tx=0x7fc984010050).stop 2020-04-22T14:11:37.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.473+0000 7fc994f24700 1 -- 172.21.15.103:0/2761705819 reap_dead start 2020-04-22T14:11:37.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.473+0000 7fc995725700 1 -- 172.21.15.103:0/2761705819 shutdown_connections 2020-04-22T14:11:37.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.473+0000 7fc995725700 1 -- 172.21.15.103:0/2761705819 >> 172.21.15.103:0/2761705819 conn(0x7fc99005b7c0 msgr2=0x7fc990061610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:37.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.474+0000 7fc995725700 1 -- 172.21.15.103:0/2761705819 shutdown_connections 2020-04-22T14:11:37.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.474+0000 7fc995725700 1 -- 172.21.15.103:0/2761705819 wait complete. 2020-04-22T14:11:37.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.474+0000 7fc995725700 1 Processor -- start 2020-04-22T14:11:37.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.474+0000 7fc995725700 1 -- start start 2020-04-22T14:11:37.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.475+0000 7fc995725700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc9900af870 0x7fc990153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:37.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.475+0000 7fc995725700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc990153570 0x7fc9900b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:37.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.475+0000 7fc995725700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc99014f490 con 0x7fc990152d30 2020-04-22T14:11:37.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.475+0000 7fc995725700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc99014f6c0 con 0x7fc9900af870 2020-04-22T14:11:37.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.475+0000 7fc995725700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc99014f960 con 0x7fc990153570 2020-04-22T14:11:37.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.475+0000 7fc994f24700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc990153570 0x7fc9900b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:37.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.475+0000 7fc994f24700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc990153570 0x7fc9900b4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52052/0 (socket says 172.21.15.103:52052) 2020-04-22T14:11:37.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.475+0000 7fc994f24700 1 -- 172.21.15.103:0/1898710255 learned_addr learned my addr 172.21.15.103:0/1898710255 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:37.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.476+0000 7fc994f24700 1 -- 172.21.15.103:0/1898710255 >> v2:172.21.15.86:3300/0 conn(0x7fc9900af870 msgr2=0x7fc990153110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:37.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.476+0000 7fc994f24700 1 --2- 172.21.15.103:0/1898710255 >> v2:172.21.15.86:3300/0 conn(0x7fc9900af870 0x7fc990153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:37.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.476+0000 7fc994f24700 1 -- 172.21.15.103:0/1898710255 >> v1:172.21.15.86:6789/0 conn(0x7fc990152d30 legacy=0x7fc99014fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:37.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.476+0000 7fc994f24700 1 -- 172.21.15.103:0/1898710255 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9900b0030 con 0x7fc990153570 2020-04-22T14:11:37.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.476+0000 7fc994f24700 1 --2- 172.21.15.103:0/1898710255 >> v2:172.21.15.103:3300/0 conn(0x7fc990153570 0x7fc9900b4f50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc9900b0570 tx=0x7fc988010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:37.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.476+0000 7fc994f24700 1 --2- 172.21.15.103:0/1898710255 >> v2:172.21.15.103:3300/0 conn(0x7fc990153570 0x7fc9900b4f50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc9900b0570 tx=0x7fc988010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:37.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.476+0000 7fc994f24700 1 --2- 172.21.15.103:0/1898710255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc990153570 0x7fc9900b4f50 secure :-1 s=READY pgs=943 cs=0 l=1 rx=0x7fc9900b0570 tx=0x7fc988010e40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:37.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.476+0000 7fc994f24700 1 --2- 172.21.15.103:0/1898710255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc990153570 0x7fc9900b4f50 secure :-1 s=THROTTLE_DONE pgs=943 cs=0 l=1 rx=0x7fc9900b0570 tx=0x7fc988010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:37.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.476+0000 7fc98d7fa700 1 -- 172.21.15.103:0/1898710255 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc988005e20 con 0x7fc990153570 2020-04-22T14:11:37.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.476+0000 7fc994f24700 1 --2- 172.21.15.103:0/1898710255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc990153570 0x7fc9900b4f50 secure :-1 s=THROTTLE_DONE pgs=943 cs=0 l=1 rx=0x7fc9900b0570 tx=0x7fc988010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:37.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.476+0000 7fc994f24700 1 --2- 172.21.15.103:0/1898710255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc990153570 0x7fc9900b4f50 secure :-1 s=THROTTLE_DONE pgs=943 cs=0 l=1 rx=0x7fc9900b0570 tx=0x7fc988010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:37.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.476+0000 7fc98d7fa700 1 -- 172.21.15.103:0/1898710255 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9880127b0 con 0x7fc990153570 2020-04-22T14:11:37.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.476+0000 7fc995725700 1 -- 172.21.15.103:0/1898710255 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9900b53b0 con 0x7fc990153570 2020-04-22T14:11:37.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.476+0000 7fc98d7fa700 1 -- 172.21.15.103:0/1898710255 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc988012b50 con 0x7fc990153570 2020-04-22T14:11:37.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.476+0000 7fc995725700 1 -- 172.21.15.103:0/1898710255 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9900b1460 con 0x7fc990153570 2020-04-22T14:11:37.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.477+0000 7fc994f24700 1 --2- 172.21.15.103:0/1898710255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc990153570 0x7fc9900b4f50 secure :-1 s=THROTTLE_DONE pgs=943 cs=0 l=1 rx=0x7fc9900b0570 tx=0x7fc988010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:37.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.477+0000 7fc995725700 1 -- 172.21.15.103:0/1898710255 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc990056c90 con 0x7fc990153570 2020-04-22T14:11:37.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.477+0000 7fc98d7fa700 1 -- 172.21.15.103:0/1898710255 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fc988012cb0 con 0x7fc990153570 2020-04-22T14:11:37.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.477+0000 7fc994f24700 1 --2- 172.21.15.103:0/1898710255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc990153570 0x7fc9900b4f50 secure :-1 s=THROTTLE_DONE pgs=943 cs=0 l=1 rx=0x7fc9900b0570 tx=0x7fc988010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:37.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.477+0000 7fc98d7fa700 1 --2- 172.21.15.103:0/1898710255 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc97004da30 0x7fc97004fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:37.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.477+0000 7fc98d7fa700 1 -- 172.21.15.103:0/1898710255 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fc988061600 con 0x7fc990153570 2020-04-22T14:11:37.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.477+0000 7fc98ffff700 1 --2- 172.21.15.103:0/1898710255 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc97004da30 0x7fc97004fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:37.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.478+0000 7fc98ffff700 1 --2- 172.21.15.103:0/1898710255 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc97004da30 0x7fc97004fef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc9800013e0 tx=0x7fc980001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:37.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.478+0000 7fc98ffff700 1 --2- 172.21.15.103:0/1898710255 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc97004da30 0x7fc97004fef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc9800013e0 tx=0x7fc980001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:37.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.478+0000 7fc98ffff700 1 --2- 172.21.15.103:0/1898710255 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc97004da30 0x7fc97004fef0 secure :-1 s=READY pgs=356 cs=0 l=1 rx=0x7fc9800013e0 tx=0x7fc980001700).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:37.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.481+0000 7fc994f24700 1 --2- 172.21.15.103:0/1898710255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc990153570 0x7fc9900b4f50 secure :-1 s=THROTTLE_DONE pgs=943 cs=0 l=1 rx=0x7fc9900b0570 tx=0x7fc988010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:37.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.481+0000 7fc98d7fa700 1 -- 172.21.15.103:0/1898710255 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fc98803c9e0 con 0x7fc990153570 2020-04-22T14:11:37.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.675+0000 7fc995725700 1 -- 172.21.15.103:0/1898710255 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc99005cc80 con 0x7fc990153570 2020-04-22T14:11:37.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.675+0000 7fc994f24700 1 --2- 172.21.15.103:0/1898710255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc990153570 0x7fc9900b4f50 secure :-1 s=THROTTLE_DONE pgs=943 cs=0 l=1 rx=0x7fc9900b0570 tx=0x7fc988010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:37.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.675+0000 7fc98d7fa700 1 -- 172.21.15.103:0/1898710255 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2147 (secure 0 0 0) 0x7fc988040000 con 0x7fc990153570 2020-04-22T14:11:37.679 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:37.679 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/1837726033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1837726033},{"type":"v1","addr":"172.21.15.86:6835","nonce":1837726033}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:03.499587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:11:37.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.677+0000 7fc995725700 1 -- 172.21.15.103:0/1898710255 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc97004da30 msgr2=0x7fc97004fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:37.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.677+0000 7fc995725700 1 --2- 172.21.15.103:0/1898710255 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc97004da30 0x7fc97004fef0 secure :-1 s=READY pgs=356 cs=0 l=1 rx=0x7fc9800013e0 tx=0x7fc980001700).stop 2020-04-22T14:11:37.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.677+0000 7fc995725700 1 -- 172.21.15.103:0/1898710255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc990153570 msgr2=0x7fc9900b4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:37.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.677+0000 7fc995725700 1 --2- 172.21.15.103:0/1898710255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc990153570 0x7fc9900b4f50 secure :-1 s=READY pgs=943 cs=0 l=1 rx=0x7fc9900b0570 tx=0x7fc988010e40).stop 2020-04-22T14:11:37.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.677+0000 7fc995725700 1 -- 172.21.15.103:0/1898710255 shutdown_connections 2020-04-22T14:11:37.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.677+0000 7fc995725700 1 --2- 172.21.15.103:0/1898710255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc990153570 0x7fc9900b4f50 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:37.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.677+0000 7fc995725700 1 --2- 172.21.15.103:0/1898710255 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc97004da30 0x7fc97004fef0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:37.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.677+0000 7fc995725700 1 --2- 172.21.15.103:0/1898710255 >> v2:172.21.15.86:3300/0 conn(0x7fc9900af870 0x7fc990153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:37.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.677+0000 7fc995725700 1 -- 172.21.15.103:0/1898710255 >> 172.21.15.103:0/1898710255 conn(0x7fc99005b7c0 msgr2=0x7fc9900646e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:37.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.677+0000 7fc995725700 1 -- 172.21.15.103:0/1898710255 shutdown_connections 2020-04-22T14:11:37.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:37.677+0000 7fc995725700 1 -- 172.21.15.103:0/1898710255 wait complete. 2020-04-22T14:11:37.682 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 41 2020-04-22T14:11:37.690 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:11:38.691 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:38.708 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:11:38.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.864+0000 7f490f87d700 1 Processor -- start 2020-04-22T14:11:38.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.865+0000 7f490f87d700 1 -- start start 2020-04-22T14:11:38.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.865+0000 7f490f87d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f49080b6040 0x7f49080ac740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:38.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.865+0000 7f490f87d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f49081426d0 0x7f4908142b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:38.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.865+0000 7f490f87d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4908064ec0 con 0x7f4908067170 2020-04-22T14:11:38.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.865+0000 7f490f87d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4908065af0 con 0x7f49081426d0 2020-04-22T14:11:38.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.865+0000 7f490f87d700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4908146870 con 0x7f49080b6040 2020-04-22T14:11:38.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.865+0000 7f490ce18700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f49080b6040 0x7f49080ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:38.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.865+0000 7f490d619700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f4908067170 0x7f490813c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44250/0 (socket says 172.21.15.103:44250) 2020-04-22T14:11:38.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.866+0000 7f490d619700 1 -- 172.21.15.103:0/3718762961 learned_addr learned my addr 172.21.15.103:0/3718762961 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:38.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.866+0000 7f490de1a700 1 --2- 172.21.15.103:0/3718762961 >> v2:172.21.15.86:3300/0 conn(0x7f49081426d0 0x7f4908142b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:38.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.866+0000 7f490ce18700 1 -- 172.21.15.103:0/3718762961 >> v2:172.21.15.86:3300/0 conn(0x7f49081426d0 msgr2=0x7f4908142b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:38.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.866+0000 7f490ce18700 1 --2- 172.21.15.103:0/3718762961 >> v2:172.21.15.86:3300/0 conn(0x7f49081426d0 0x7f4908142b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:38.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.866+0000 7f490ce18700 1 -- 172.21.15.103:0/3718762961 >> v1:172.21.15.103:6789/0 conn(0x7f4908067170 legacy=0x7f490813c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:38.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.866+0000 7f48fbfff700 1 -- 172.21.15.103:0/3718762961 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 690893063 0 0) 0x7f4908064ec0 con 0x7f4908067170 2020-04-22T14:11:38.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.866+0000 7f490ce18700 1 -- 172.21.15.103:0/3718762961 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4908067550 con 0x7f49080b6040 2020-04-22T14:11:38.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.866+0000 7f490ce18700 1 --2- 172.21.15.103:0/3718762961 >> v2:172.21.15.103:3300/0 conn(0x7f49080b6040 0x7f49080ac740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4908066db0 tx=0x7f48fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:38.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.866+0000 7f490ce18700 1 --2- 172.21.15.103:0/3718762961 >> v2:172.21.15.103:3300/0 conn(0x7f49080b6040 0x7f49080ac740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4908066db0 tx=0x7f48fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:38.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.866+0000 7f490ce18700 1 --2- 172.21.15.103:0/3718762961 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49080b6040 0x7f49080ac740 secure :-1 s=READY pgs=945 cs=0 l=1 rx=0x7f4908066db0 tx=0x7f48fc007a40).ready entity=mon.1 client_cookie=f2919d54219d413b server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:38.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.866+0000 7f490ce18700 1 --2- 172.21.15.103:0/3718762961 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49080b6040 0x7f49080ac740 secure :-1 s=THROTTLE_DONE pgs=945 cs=0 l=1 rx=0x7f4908066db0 tx=0x7f48fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:38.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.866+0000 7f48fbfff700 1 -- 172.21.15.103:0/3718762961 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48fc011430 con 0x7f49080b6040 2020-04-22T14:11:38.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.866+0000 7f490ce18700 1 --2- 172.21.15.103:0/3718762961 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49080b6040 0x7f49080ac740 secure :-1 s=THROTTLE_DONE pgs=945 cs=0 l=1 rx=0x7f4908066db0 tx=0x7f48fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:38.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.866+0000 7f48fbfff700 1 -- 172.21.15.103:0/3718762961 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48fc0115d0 con 0x7f49080b6040 2020-04-22T14:11:38.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.866+0000 7f490ce18700 1 --2- 172.21.15.103:0/3718762961 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49080b6040 0x7f49080ac740 secure :-1 s=THROTTLE_DONE pgs=945 cs=0 l=1 rx=0x7f4908066db0 tx=0x7f48fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:38.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.866+0000 7f48fbfff700 1 -- 172.21.15.103:0/3718762961 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48fc0119b0 con 0x7f49080b6040 2020-04-22T14:11:38.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.866+0000 7f490f87d700 1 -- 172.21.15.103:0/3718762961 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49080b6040 msgr2=0x7f49080ac740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:38.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.866+0000 7f490f87d700 1 --2- 172.21.15.103:0/3718762961 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49080b6040 0x7f49080ac740 secure :-1 s=READY pgs=945 cs=0 l=1 rx=0x7f4908066db0 tx=0x7f48fc007a40).stop 2020-04-22T14:11:38.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.867+0000 7f490f87d700 1 -- 172.21.15.103:0/3718762961 shutdown_connections 2020-04-22T14:11:38.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.867+0000 7f490f87d700 1 --2- 172.21.15.103:0/3718762961 >> v2:172.21.15.86:3300/0 conn(0x7f49081426d0 0x7f4908142b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:38.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.867+0000 7f490f87d700 1 --2- 172.21.15.103:0/3718762961 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49080b6040 0x7f49080ac740 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:38.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.867+0000 7f490f87d700 1 -- 172.21.15.103:0/3718762961 >> 172.21.15.103:0/3718762961 conn(0x7f49080b9160 msgr2=0x7f490805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:38.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.867+0000 7f490f87d700 1 -- 172.21.15.103:0/3718762961 shutdown_connections 2020-04-22T14:11:38.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.867+0000 7f490f87d700 1 -- 172.21.15.103:0/3718762961 wait complete. 2020-04-22T14:11:38.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.868+0000 7f490f87d700 1 Processor -- start 2020-04-22T14:11:38.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.868+0000 7f490f87d700 1 -- start start 2020-04-22T14:11:38.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.868+0000 7f490f87d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4908067170 0x7f4908145680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:38.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.868+0000 7f490f87d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f49081426d0 0x7f4908063e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:38.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.868+0000 7f490f87d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4908064260 con 0x7f49080b6040 2020-04-22T14:11:38.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.868+0000 7f490f87d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4908145ae0 con 0x7f49081426d0 2020-04-22T14:11:38.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.868+0000 7f490f87d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f490812f840 con 0x7f4908067170 2020-04-22T14:11:38.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.868+0000 7f490ce18700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f49080b6040 0x7f49081313d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44256/0 (socket says 172.21.15.103:44256) 2020-04-22T14:11:38.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.868+0000 7f490ce18700 1 -- 172.21.15.103:0/2277471892 learned_addr learned my addr 172.21.15.103:0/2277471892 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:38.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.869+0000 7f48fa7fc700 1 -- 172.21.15.103:0/2277471892 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1149804447 0 0) 0x7f4908067550 con 0x7f49080b6040 2020-04-22T14:11:38.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.869+0000 7f490de1a700 1 --2- 172.21.15.103:0/2277471892 >> v2:172.21.15.86:3300/0 conn(0x7f49081426d0 0x7f4908063e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:38.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.869+0000 7f490d619700 1 --2- 172.21.15.103:0/2277471892 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4908067170 0x7f4908145680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:38.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.869+0000 7f48fa7fc700 1 -- 172.21.15.103:0/2277471892 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48e8002fe0 con 0x7f49080b6040 2020-04-22T14:11:38.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.869+0000 7f48fa7fc700 1 -- 172.21.15.103:0/2277471892 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1750190804 0 0) 0x7f48e8002fe0 con 0x7f49080b6040 2020-04-22T14:11:38.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.869+0000 7f48fa7fc700 1 -- 172.21.15.103:0/2277471892 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4908067550 con 0x7f49080b6040 2020-04-22T14:11:38.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.869+0000 7f48fa7fc700 1 -- 172.21.15.103:0/2277471892 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f48fc002f30 con 0x7f49080b6040 2020-04-22T14:11:38.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.869+0000 7f48fa7fc700 1 -- 172.21.15.103:0/2277471892 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4908067170 msgr2=0x7f4908145680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:38.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.869+0000 7f48fa7fc700 1 --2- 172.21.15.103:0/2277471892 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4908067170 0x7f4908145680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:38.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.869+0000 7f48fa7fc700 1 -- 172.21.15.103:0/2277471892 >> v2:172.21.15.86:3300/0 conn(0x7f49081426d0 msgr2=0x7f4908063e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:38.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.869+0000 7f48fa7fc700 1 --2- 172.21.15.103:0/2277471892 >> v2:172.21.15.86:3300/0 conn(0x7f49081426d0 0x7f4908063e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:38.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.869+0000 7f48fa7fc700 1 -- 172.21.15.103:0/2277471892 >> v1:172.21.15.103:6789/0 conn(0x7f49080b6040 legacy=0x7f49081313d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:38.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.869+0000 7f48fa7fc700 1 --2- 172.21.15.103:0/2277471892 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4908067170 0x7f48e80049b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:38.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.869+0000 7f48fa7fc700 1 --2- 172.21.15.103:0/2277471892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48e8004e10 0x7f48e8005230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:38.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.869+0000 7f48fa7fc700 1 --2- 172.21.15.103:0/2277471892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48e8003a30 0x7f48e8003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:38.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.869+0000 7f48fa7fc700 1 -- 172.21.15.103:0/2277471892 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490812f840 con 0x7f48e8004e10 2020-04-22T14:11:38.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.869+0000 7f48fa7fc700 1 -- 172.21.15.103:0/2277471892 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e80044f0 con 0x7f48e8003a30 2020-04-22T14:11:38.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.869+0000 7f48fa7fc700 1 -- 172.21.15.103:0/2277471892 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e80046b0 con 0x7f4908067170 2020-04-22T14:11:38.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.869+0000 7f490de1a700 1 --2- 172.21.15.103:0/2277471892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48e8003a30 0x7f48e8003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:38.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.869+0000 7f490d619700 1 --2- 172.21.15.103:0/2277471892 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4908067170 0x7f48e80049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:38.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.869+0000 7f490ce18700 1 --2- 172.21.15.103:0/2277471892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48e8004e10 0x7f48e8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:38.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.869+0000 7f490de1a700 1 -- 172.21.15.103:0/2277471892 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4908067170 msgr2=0x7f48e80049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:38.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.869+0000 7f490de1a700 1 --2- 172.21.15.103:0/2277471892 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4908067170 0x7f48e80049b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:38.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.869+0000 7f490de1a700 1 -- 172.21.15.103:0/2277471892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48e8004e10 msgr2=0x7f48e8005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:38.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.869+0000 7f490de1a700 1 --2- 172.21.15.103:0/2277471892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48e8004e10 0x7f48e8005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:38.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.869+0000 7f490de1a700 1 -- 172.21.15.103:0/2277471892 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4908144f40 con 0x7f48e8003a30 2020-04-22T14:11:38.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.869+0000 7f490f87d700 1 -- 172.21.15.103:0/2277471892 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4908131ae0 con 0x7f48e8003a30 2020-04-22T14:11:38.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.869+0000 7f490de1a700 1 --2- 172.21.15.103:0/2277471892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48e8003a30 0x7f48e8003eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f49000032b0 tx=0x7f4900010f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:38.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.869+0000 7f490de1a700 1 --2- 172.21.15.103:0/2277471892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48e8003a30 0x7f48e8003eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f49000032b0 tx=0x7f4900010f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:38.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.870+0000 7f490de1a700 1 --2- 172.21.15.103:0/2277471892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48e8003a30 0x7f48e8003eb0 secure :-1 s=READY pgs=947 cs=0 l=1 rx=0x7f49000032b0 tx=0x7f4900010f90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:38.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.870+0000 7f490de1a700 1 --2- 172.21.15.103:0/2277471892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48e8003a30 0x7f48e8003eb0 secure :-1 s=THROTTLE_DONE pgs=947 cs=0 l=1 rx=0x7f49000032b0 tx=0x7f4900010f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:38.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.870+0000 7f490f87d700 1 -- 172.21.15.103:0/2277471892 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4908145840 con 0x7f48e8003a30 2020-04-22T14:11:38.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.870+0000 7f48fa7fc700 1 -- 172.21.15.103:0/2277471892 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4900005e20 con 0x7f48e8003a30 2020-04-22T14:11:38.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.870+0000 7f490de1a700 1 --2- 172.21.15.103:0/2277471892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48e8003a30 0x7f48e8003eb0 secure :-1 s=THROTTLE_DONE pgs=947 cs=0 l=1 rx=0x7f49000032b0 tx=0x7f4900010f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:38.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.870+0000 7f490de1a700 1 --2- 172.21.15.103:0/2277471892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48e8003a30 0x7f48e8003eb0 secure :-1 s=THROTTLE_DONE pgs=947 cs=0 l=1 rx=0x7f49000032b0 tx=0x7f4900010f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:38.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.870+0000 7f48fa7fc700 1 -- 172.21.15.103:0/2277471892 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4900011810 con 0x7f48e8003a30 2020-04-22T14:11:38.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.870+0000 7f48fa7fc700 1 -- 172.21.15.103:0/2277471892 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4900011bb0 con 0x7f48e8003a30 2020-04-22T14:11:38.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.870+0000 7f490de1a700 1 --2- 172.21.15.103:0/2277471892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48e8003a30 0x7f48e8003eb0 secure :-1 s=THROTTLE_DONE pgs=947 cs=0 l=1 rx=0x7f49000032b0 tx=0x7f4900010f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:38.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.871+0000 7f490f87d700 1 -- 172.21.15.103:0/2277471892 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4908056c90 con 0x7f48e8003a30 2020-04-22T14:11:38.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.871+0000 7f48fa7fc700 1 -- 172.21.15.103:0/2277471892 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f4900011d10 con 0x7f48e8003a30 2020-04-22T14:11:38.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.871+0000 7f490de1a700 1 --2- 172.21.15.103:0/2277471892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48e8003a30 0x7f48e8003eb0 secure :-1 s=THROTTLE_DONE pgs=947 cs=0 l=1 rx=0x7f49000032b0 tx=0x7f4900010f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:38.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.871+0000 7f48fa7fc700 1 --2- 172.21.15.103:0/2277471892 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f48e805a0d0 0x7f48e805c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:38.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.871+0000 7f48fa7fc700 1 -- 172.21.15.103:0/2277471892 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f4900061430 con 0x7f48e8003a30 2020-04-22T14:11:38.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.871+0000 7f490d619700 1 --2- 172.21.15.103:0/2277471892 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f48e805a0d0 0x7f48e805c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:38.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.872+0000 7f490d619700 1 --2- 172.21.15.103:0/2277471892 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f48e805a0d0 0x7f48e805c590 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4904000b80 tx=0x7f490400ca90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:38.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.872+0000 7f490d619700 1 --2- 172.21.15.103:0/2277471892 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f48e805a0d0 0x7f48e805c590 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4904000b80 tx=0x7f490400ca90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:38.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.872+0000 7f490d619700 1 --2- 172.21.15.103:0/2277471892 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f48e805a0d0 0x7f48e805c590 secure :-1 s=READY pgs=357 cs=0 l=1 rx=0x7f4904000b80 tx=0x7f490400ca90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:38.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.875+0000 7f490de1a700 1 --2- 172.21.15.103:0/2277471892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48e8003a30 0x7f48e8003eb0 secure :-1 s=THROTTLE_DONE pgs=947 cs=0 l=1 rx=0x7f49000032b0 tx=0x7f4900010f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:38.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:38.875+0000 7f48fa7fc700 1 -- 172.21.15.103:0/2277471892 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f490003c870 con 0x7f48e8003a30 2020-04-22T14:11:39.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:39.064+0000 7f490f87d700 1 -- 172.21.15.103:0/2277471892 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f490805a640 con 0x7f48e8003a30 2020-04-22T14:11:39.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:39.065+0000 7f490de1a700 1 --2- 172.21.15.103:0/2277471892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48e8003a30 0x7f48e8003eb0 secure :-1 s=THROTTLE_DONE pgs=947 cs=0 l=1 rx=0x7f49000032b0 tx=0x7f4900010f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:39.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:39.065+0000 7f48fa7fc700 1 -- 172.21.15.103:0/2277471892 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f490003fe90 con 0x7f48e8003a30 2020-04-22T14:11:39.067 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:39.068 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/1837726033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1837726033},{"type":"v1","addr":"172.21.15.86:6835","nonce":1837726033}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:03.499587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:11:39.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:39.066+0000 7f490f87d700 1 -- 172.21.15.103:0/2277471892 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f48e805a0d0 msgr2=0x7f48e805c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:39.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:39.066+0000 7f490f87d700 1 --2- 172.21.15.103:0/2277471892 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f48e805a0d0 0x7f48e805c590 secure :-1 s=READY pgs=357 cs=0 l=1 rx=0x7f4904000b80 tx=0x7f490400ca90).stop 2020-04-22T14:11:39.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:39.066+0000 7f490f87d700 1 -- 172.21.15.103:0/2277471892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48e8003a30 msgr2=0x7f48e8003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:39.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:39.066+0000 7f490f87d700 1 --2- 172.21.15.103:0/2277471892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48e8003a30 0x7f48e8003eb0 secure :-1 s=READY pgs=947 cs=0 l=1 rx=0x7f49000032b0 tx=0x7f4900010f90).stop 2020-04-22T14:11:39.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:39.066+0000 7f490de1a700 1 -- 172.21.15.103:0/2277471892 reap_dead start 2020-04-22T14:11:39.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:39.066+0000 7f490de1a700 1 -- 172.21.15.103:0/2277471892 reap_dead start 2020-04-22T14:11:39.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:39.066+0000 7f490f87d700 1 -- 172.21.15.103:0/2277471892 shutdown_connections 2020-04-22T14:11:39.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:39.066+0000 7f490f87d700 1 -- 172.21.15.103:0/2277471892 >> 172.21.15.103:0/2277471892 conn(0x7f49080b9160 msgr2=0x7f4908061b30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:39.070 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:39.066+0000 7f490f87d700 1 -- 172.21.15.103:0/2277471892 shutdown_connections 2020-04-22T14:11:39.070 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:39.066+0000 7f490f87d700 1 -- 172.21.15.103:0/2277471892 wait complete. 2020-04-22T14:11:39.070 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 41 2020-04-22T14:11:39.085 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:11:40.087 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:40.104 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:11:40.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.257+0000 7fe55e7fd700 1 Processor -- start 2020-04-22T14:11:40.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.258+0000 7fe55e7fd700 1 -- start start 2020-04-22T14:11:40.263 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.258+0000 7fe55e7fd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe558065fe0 0x7fe5581464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:40.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.258+0000 7fe55e7fd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe558063e30 0x7fe5580642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:40.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.258+0000 7fe55e7fd700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe558143300 con 0x7fe55812c0d0 2020-04-22T14:11:40.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.258+0000 7fe55e7fd700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5581435a0 con 0x7fe558065fe0 2020-04-22T14:11:40.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.258+0000 7fe55e7fd700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe558143840 con 0x7fe558063e30 2020-04-22T14:11:40.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.258+0000 7fe557fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe55812c0d0 0x7fe55805b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44266/0 (socket says 172.21.15.103:44266) 2020-04-22T14:11:40.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.258+0000 7fe557fff700 1 -- 172.21.15.103:0/910154970 learned_addr learned my addr 172.21.15.103:0/910154970 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:40.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.259+0000 7fe55cd9a700 1 --2- 172.21.15.103:0/910154970 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe558063e30 0x7fe5580642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:40.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.259+0000 7fe54ffff700 1 --2- 172.21.15.103:0/910154970 >> v2:172.21.15.86:3300/0 conn(0x7fe558065fe0 0x7fe5581464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:40.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.259+0000 7fe5577fe700 1 -- 172.21.15.103:0/910154970 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1715812995 0 0) 0x7fe558143300 con 0x7fe55812c0d0 2020-04-22T14:11:40.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.259+0000 7fe5577fe700 1 -- 172.21.15.103:0/910154970 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe538003230 con 0x7fe55812c0d0 2020-04-22T14:11:40.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.259+0000 7fe5577fe700 1 -- 172.21.15.103:0/910154970 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3726829521 0 0) 0x7fe538003230 con 0x7fe55812c0d0 2020-04-22T14:11:40.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.259+0000 7fe5577fe700 1 -- 172.21.15.103:0/910154970 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe558063e30 msgr2=0x7fe5580642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:40.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.259+0000 7fe5577fe700 1 --2- 172.21.15.103:0/910154970 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe558063e30 0x7fe5580642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:40.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.259+0000 7fe5577fe700 1 -- 172.21.15.103:0/910154970 >> v2:172.21.15.86:3300/0 conn(0x7fe558065fe0 msgr2=0x7fe5581464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:40.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.259+0000 7fe5577fe700 1 --2- 172.21.15.103:0/910154970 >> v2:172.21.15.86:3300/0 conn(0x7fe558065fe0 0x7fe5581464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:40.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.259+0000 7fe5577fe700 1 -- 172.21.15.103:0/910154970 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe55805bb50 con 0x7fe55812c0d0 2020-04-22T14:11:40.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.259+0000 7fe5577fe700 1 -- 172.21.15.103:0/910154970 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fe5480016d0 con 0x7fe55812c0d0 2020-04-22T14:11:40.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.259+0000 7fe5577fe700 1 -- 172.21.15.103:0/910154970 >> v1:172.21.15.103:6789/0 conn(0x7fe55812c0d0 legacy=0x7fe55805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:40.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.259+0000 7fe5577fe700 1 --2- 172.21.15.103:0/910154970 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe558063e30 0x7fe538003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:40.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.259+0000 7fe5577fe700 1 --2- 172.21.15.103:0/910154970 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe538003b80 0x7fe538003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:40.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.259+0000 7fe5577fe700 1 --2- 172.21.15.103:0/910154970 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5380045c0 0x7fe538004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:40.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.259+0000 7fe5577fe700 1 -- 172.21.15.103:0/910154970 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5581435a0 con 0x7fe5380045c0 2020-04-22T14:11:40.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.259+0000 7fe5577fe700 1 -- 172.21.15.103:0/910154970 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe558143840 con 0x7fe538003b80 2020-04-22T14:11:40.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.259+0000 7fe5577fe700 1 -- 172.21.15.103:0/910154970 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe538005050 con 0x7fe558063e30 2020-04-22T14:11:40.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.259+0000 7fe54ffff700 1 --2- 172.21.15.103:0/910154970 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe538003b80 0x7fe538003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:40.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.259+0000 7fe557fff700 1 --2- 172.21.15.103:0/910154970 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe558063e30 0x7fe538003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:40.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.259+0000 7fe55cd9a700 1 --2- 172.21.15.103:0/910154970 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5380045c0 0x7fe538004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:40.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.259+0000 7fe54ffff700 1 -- 172.21.15.103:0/910154970 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe558063e30 msgr2=0x7fe538003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:40.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.259+0000 7fe54ffff700 1 --2- 172.21.15.103:0/910154970 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe558063e30 0x7fe538003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:40.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.259+0000 7fe54ffff700 1 -- 172.21.15.103:0/910154970 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5380045c0 msgr2=0x7fe538004a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:40.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.259+0000 7fe54ffff700 1 --2- 172.21.15.103:0/910154970 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5380045c0 0x7fe538004a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:40.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.259+0000 7fe54ffff700 1 -- 172.21.15.103:0/910154970 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe538003230 con 0x7fe538003b80 2020-04-22T14:11:40.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.259+0000 7fe54ffff700 1 --2- 172.21.15.103:0/910154970 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe538003b80 0x7fe538003fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe540002f30 tx=0x7fe540010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:40.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.260+0000 7fe54ffff700 1 --2- 172.21.15.103:0/910154970 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe538003b80 0x7fe538003fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe540002f30 tx=0x7fe540010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:40.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.260+0000 7fe54ffff700 1 --2- 172.21.15.103:0/910154970 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe538003b80 0x7fe538003fe0 secure :-1 s=READY pgs=949 cs=0 l=1 rx=0x7fe540002f30 tx=0x7fe540010020).ready entity=mon.1 client_cookie=8f9f58e80e9318d server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:40.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.260+0000 7fe54ffff700 1 --2- 172.21.15.103:0/910154970 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe538003b80 0x7fe538003fe0 secure :-1 s=THROTTLE_DONE pgs=949 cs=0 l=1 rx=0x7fe540002f30 tx=0x7fe540010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:40.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.260+0000 7fe5577fe700 1 -- 172.21.15.103:0/910154970 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe540008df0 con 0x7fe538003b80 2020-04-22T14:11:40.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.260+0000 7fe54ffff700 1 --2- 172.21.15.103:0/910154970 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe538003b80 0x7fe538003fe0 secure :-1 s=THROTTLE_DONE pgs=949 cs=0 l=1 rx=0x7fe540002f30 tx=0x7fe540010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:40.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.260+0000 7fe5577fe700 1 -- 172.21.15.103:0/910154970 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5400108a0 con 0x7fe538003b80 2020-04-22T14:11:40.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.260+0000 7fe54ffff700 1 --2- 172.21.15.103:0/910154970 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe538003b80 0x7fe538003fe0 secure :-1 s=THROTTLE_DONE pgs=949 cs=0 l=1 rx=0x7fe540002f30 tx=0x7fe540010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:40.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.260+0000 7fe55e7fd700 1 -- 172.21.15.103:0/910154970 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe538003b80 msgr2=0x7fe538003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:40.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.260+0000 7fe5577fe700 1 -- 172.21.15.103:0/910154970 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe540010c40 con 0x7fe538003b80 2020-04-22T14:11:40.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.260+0000 7fe55e7fd700 1 --2- 172.21.15.103:0/910154970 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe538003b80 0x7fe538003fe0 secure :-1 s=READY pgs=949 cs=0 l=1 rx=0x7fe540002f30 tx=0x7fe540010020).stop 2020-04-22T14:11:40.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.260+0000 7fe55cd9a700 1 -- 172.21.15.103:0/910154970 reap_dead start 2020-04-22T14:11:40.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.260+0000 7fe55e7fd700 1 -- 172.21.15.103:0/910154970 shutdown_connections 2020-04-22T14:11:40.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.260+0000 7fe55e7fd700 1 -- 172.21.15.103:0/910154970 >> 172.21.15.103:0/910154970 conn(0x7fe5580b9160 msgr2=0x7fe55805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:40.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.260+0000 7fe55e7fd700 1 -- 172.21.15.103:0/910154970 shutdown_connections 2020-04-22T14:11:40.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.260+0000 7fe55e7fd700 1 -- 172.21.15.103:0/910154970 wait complete. 2020-04-22T14:11:40.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.261+0000 7fe55e7fd700 1 Processor -- start 2020-04-22T14:11:40.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.261+0000 7fe55e7fd700 1 -- start start 2020-04-22T14:11:40.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.262+0000 7fe55e7fd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe5580b5ac0 0x7fe5580b0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:40.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.262+0000 7fe55e7fd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe5581277e0 0x7fe5580ad830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:40.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.262+0000 7fe55e7fd700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe558129370 con 0x7fe5580b5ea0 2020-04-22T14:11:40.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.262+0000 7fe55e7fd700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5580b6300 con 0x7fe5581277e0 2020-04-22T14:11:40.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.262+0000 7fe55e7fd700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5580adc90 con 0x7fe5580b5ac0 2020-04-22T14:11:40.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.262+0000 7fe55cd9a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe5581277e0 0x7fe5580ad830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:40.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.262+0000 7fe55cd9a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe5581277e0 0x7fe5580ad830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52092/0 (socket says 172.21.15.103:52092) 2020-04-22T14:11:40.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.262+0000 7fe55cd9a700 1 -- 172.21.15.103:0/1810436439 learned_addr learned my addr 172.21.15.103:0/1810436439 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:40.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.262+0000 7fe557fff700 1 --2- 172.21.15.103:0/1810436439 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe5580b5ac0 0x7fe5580b0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:40.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.262+0000 7fe55cd9a700 1 -- 172.21.15.103:0/1810436439 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe5580b5ac0 msgr2=0x7fe5580b0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:40.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.262+0000 7fe55cd9a700 1 --2- 172.21.15.103:0/1810436439 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe5580b5ac0 0x7fe5580b0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:40.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.262+0000 7fe55cd9a700 1 -- 172.21.15.103:0/1810436439 >> v1:172.21.15.86:6789/0 conn(0x7fe5580b5ea0 legacy=0x7fe5581270d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:40.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.262+0000 7fe55cd9a700 1 -- 172.21.15.103:0/1810436439 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5581295a0 con 0x7fe5581277e0 2020-04-22T14:11:40.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.262+0000 7fe55cd9a700 1 --2- 172.21.15.103:0/1810436439 >> v2:172.21.15.103:3300/0 conn(0x7fe5581277e0 0x7fe5580ad830 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe5480010d0 tx=0x7fe550008090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:40.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.262+0000 7fe55cd9a700 1 --2- 172.21.15.103:0/1810436439 >> v2:172.21.15.103:3300/0 conn(0x7fe5581277e0 0x7fe5580ad830 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe5480010d0 tx=0x7fe550008090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:40.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.262+0000 7fe55cd9a700 1 --2- 172.21.15.103:0/1810436439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5581277e0 0x7fe5580ad830 secure :-1 s=READY pgs=950 cs=0 l=1 rx=0x7fe5480010d0 tx=0x7fe550008090).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:40.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.263+0000 7fe55cd9a700 1 --2- 172.21.15.103:0/1810436439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5581277e0 0x7fe5580ad830 secure :-1 s=THROTTLE_DONE pgs=950 cs=0 l=1 rx=0x7fe5480010d0 tx=0x7fe550008090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:40.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.263+0000 7fe555ffb700 1 -- 172.21.15.103:0/1810436439 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe550005e20 con 0x7fe5581277e0 2020-04-22T14:11:40.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.263+0000 7fe55cd9a700 1 --2- 172.21.15.103:0/1810436439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5581277e0 0x7fe5580ad830 secure :-1 s=THROTTLE_DONE pgs=950 cs=0 l=1 rx=0x7fe5480010d0 tx=0x7fe550008090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:40.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.263+0000 7fe55cd9a700 1 --2- 172.21.15.103:0/1810436439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5581277e0 0x7fe5580ad830 secure :-1 s=THROTTLE_DONE pgs=950 cs=0 l=1 rx=0x7fe5480010d0 tx=0x7fe550008090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:40.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.263+0000 7fe555ffb700 1 -- 172.21.15.103:0/1810436439 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe550008700 con 0x7fe5581277e0 2020-04-22T14:11:40.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.263+0000 7fe55e7fd700 1 -- 172.21.15.103:0/1810436439 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe558129840 con 0x7fe5581277e0 2020-04-22T14:11:40.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.263+0000 7fe555ffb700 1 -- 172.21.15.103:0/1810436439 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe550008ae0 con 0x7fe5581277e0 2020-04-22T14:11:40.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.263+0000 7fe55e7fd700 1 -- 172.21.15.103:0/1810436439 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe55812a140 con 0x7fe5581277e0 2020-04-22T14:11:40.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.263+0000 7fe55cd9a700 1 --2- 172.21.15.103:0/1810436439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5581277e0 0x7fe5580ad830 secure :-1 s=THROTTLE_DONE pgs=950 cs=0 l=1 rx=0x7fe5480010d0 tx=0x7fe550008090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:40.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.264+0000 7fe55e7fd700 1 -- 172.21.15.103:0/1810436439 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe558056c90 con 0x7fe5581277e0 2020-04-22T14:11:40.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.264+0000 7fe555ffb700 1 -- 172.21.15.103:0/1810436439 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fe550008c40 con 0x7fe5581277e0 2020-04-22T14:11:40.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.264+0000 7fe55cd9a700 1 --2- 172.21.15.103:0/1810436439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5581277e0 0x7fe5580ad830 secure :-1 s=THROTTLE_DONE pgs=950 cs=0 l=1 rx=0x7fe5480010d0 tx=0x7fe550008090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:40.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.264+0000 7fe555ffb700 1 --2- 172.21.15.103:0/1810436439 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe53c04d8d0 0x7fe53c04fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:40.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.264+0000 7fe555ffb700 1 -- 172.21.15.103:0/1810436439 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fe5500612b0 con 0x7fe5581277e0 2020-04-22T14:11:40.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.264+0000 7fe557fff700 1 --2- 172.21.15.103:0/1810436439 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe53c04d8d0 0x7fe53c04fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:40.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.264+0000 7fe557fff700 1 --2- 172.21.15.103:0/1810436439 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe53c04d8d0 0x7fe53c04fd90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe5480013e0 tx=0x7fe55805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:40.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.264+0000 7fe557fff700 1 --2- 172.21.15.103:0/1810436439 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe53c04d8d0 0x7fe53c04fd90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe5480013e0 tx=0x7fe55805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:40.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.264+0000 7fe557fff700 1 --2- 172.21.15.103:0/1810436439 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe53c04d8d0 0x7fe53c04fd90 secure :-1 s=READY pgs=358 cs=0 l=1 rx=0x7fe5480013e0 tx=0x7fe55805bce0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:40.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.268+0000 7fe55cd9a700 1 --2- 172.21.15.103:0/1810436439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5581277e0 0x7fe5580ad830 secure :-1 s=THROTTLE_DONE pgs=950 cs=0 l=1 rx=0x7fe5480010d0 tx=0x7fe550008090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:40.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.268+0000 7fe555ffb700 1 -- 172.21.15.103:0/1810436439 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fe55003c630 con 0x7fe5581277e0 2020-04-22T14:11:40.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.456+0000 7fe55e7fd700 1 -- 172.21.15.103:0/1810436439 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5580ad610 con 0x7fe5581277e0 2020-04-22T14:11:40.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.457+0000 7fe55cd9a700 1 --2- 172.21.15.103:0/1810436439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5581277e0 0x7fe5580ad830 secure :-1 s=THROTTLE_DONE pgs=950 cs=0 l=1 rx=0x7fe5480010d0 tx=0x7fe550008090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:40.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.457+0000 7fe555ffb700 1 -- 172.21.15.103:0/1810436439 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2147 (secure 0 0 0) 0x7fe55003fc50 con 0x7fe5581277e0 2020-04-22T14:11:40.459 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:40.460 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/1837726033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1837726033},{"type":"v1","addr":"172.21.15.86:6835","nonce":1837726033}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:03.499587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:11:40.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.458+0000 7fe55e7fd700 1 -- 172.21.15.103:0/1810436439 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe53c04d8d0 msgr2=0x7fe53c04fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:40.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.458+0000 7fe55e7fd700 1 --2- 172.21.15.103:0/1810436439 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe53c04d8d0 0x7fe53c04fd90 secure :-1 s=READY pgs=358 cs=0 l=1 rx=0x7fe5480013e0 tx=0x7fe55805bce0).stop 2020-04-22T14:11:40.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.458+0000 7fe55e7fd700 1 -- 172.21.15.103:0/1810436439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5581277e0 msgr2=0x7fe5580ad830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:40.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.458+0000 7fe55e7fd700 1 --2- 172.21.15.103:0/1810436439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5581277e0 0x7fe5580ad830 secure :-1 s=READY pgs=950 cs=0 l=1 rx=0x7fe5480010d0 tx=0x7fe550008090).stop 2020-04-22T14:11:40.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.458+0000 7fe55e7fd700 1 -- 172.21.15.103:0/1810436439 shutdown_connections 2020-04-22T14:11:40.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.458+0000 7fe55e7fd700 1 --2- 172.21.15.103:0/1810436439 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe53c04d8d0 0x7fe53c04fd90 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:40.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.458+0000 7fe55e7fd700 1 --2- 172.21.15.103:0/1810436439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5581277e0 0x7fe5580ad830 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:40.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.458+0000 7fe55e7fd700 1 --2- 172.21.15.103:0/1810436439 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe5580b5ac0 0x7fe5580b0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:40.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.458+0000 7fe55e7fd700 1 -- 172.21.15.103:0/1810436439 >> 172.21.15.103:0/1810436439 conn(0x7fe5580b9160 msgr2=0x7fe558064db0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:40.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.458+0000 7fe55e7fd700 1 -- 172.21.15.103:0/1810436439 shutdown_connections 2020-04-22T14:11:40.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:40.458+0000 7fe55e7fd700 1 -- 172.21.15.103:0/1810436439 wait complete. 2020-04-22T14:11:40.462 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 41 2020-04-22T14:11:40.470 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:11:41.471 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:41.488 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:11:41.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.643+0000 7fcc27da7700 1 Processor -- start 2020-04-22T14:11:41.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.643+0000 7fcc27da7700 1 -- start start 2020-04-22T14:11:41.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.644+0000 7fcc27da7700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcc2012c0d0 0x7fcc201464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:41.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.644+0000 7fcc27da7700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc20143300 con 0x7fcc20065fe0 2020-04-22T14:11:41.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.644+0000 7fcc27da7700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc201435a0 con 0x7fcc20063e30 2020-04-22T14:11:41.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.644+0000 7fcc27da7700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc20143840 con 0x7fcc2012c0d0 2020-04-22T14:11:41.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.644+0000 7fcc25b43700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcc2012c0d0 0x7fcc201464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:41.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.644+0000 7fcc26344700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fcc20063e30 0x7fcc200642c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44290/0 (socket says 172.21.15.103:44290) 2020-04-22T14:11:41.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.644+0000 7fcc26344700 1 -- 172.21.15.103:0/2067446507 learned_addr learned my addr 172.21.15.103:0/2067446507 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:41.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.644+0000 7fcc24b41700 1 -- 172.21.15.103:0/2067446507 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3190550388 0 0) 0x7fcc201435a0 con 0x7fcc20063e30 2020-04-22T14:11:41.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.644+0000 7fcc24b41700 1 -- 172.21.15.103:0/2067446507 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc08003230 con 0x7fcc20063e30 2020-04-22T14:11:41.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.644+0000 7fcc25b43700 1 -- 172.21.15.103:0/2067446507 >> v1:172.21.15.103:6789/0 conn(0x7fcc20063e30 legacy=0x7fcc200642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:41.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.644+0000 7fcc25b43700 1 -- 172.21.15.103:0/2067446507 >> v1:172.21.15.86:6789/0 conn(0x7fcc20065fe0 legacy=0x7fcc2005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:41.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.644+0000 7fcc25b43700 1 -- 172.21.15.103:0/2067446507 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc2005bb50 con 0x7fcc2012c0d0 2020-04-22T14:11:41.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.645+0000 7fcc25b43700 1 --2- 172.21.15.103:0/2067446507 >> v2:172.21.15.103:3300/0 conn(0x7fcc2012c0d0 0x7fcc201464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcc10002f30 tx=0x7fcc10007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:41.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.645+0000 7fcc25b43700 1 --2- 172.21.15.103:0/2067446507 >> v2:172.21.15.103:3300/0 conn(0x7fcc2012c0d0 0x7fcc201464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcc10002f30 tx=0x7fcc10007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:41.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.645+0000 7fcc25b43700 1 --2- 172.21.15.103:0/2067446507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc2012c0d0 0x7fcc201464e0 secure :-1 s=READY pgs=952 cs=0 l=1 rx=0x7fcc10002f30 tx=0x7fcc10007a40).ready entity=mon.1 client_cookie=9be91cd2db24b976 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:41.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.645+0000 7fcc25b43700 1 --2- 172.21.15.103:0/2067446507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc2012c0d0 0x7fcc201464e0 secure :-1 s=THROTTLE_DONE pgs=952 cs=0 l=1 rx=0x7fcc10002f30 tx=0x7fcc10007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:41.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.645+0000 7fcc24b41700 1 -- 172.21.15.103:0/2067446507 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc100113c0 con 0x7fcc2012c0d0 2020-04-22T14:11:41.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.645+0000 7fcc25b43700 1 --2- 172.21.15.103:0/2067446507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc2012c0d0 0x7fcc201464e0 secure :-1 s=THROTTLE_DONE pgs=952 cs=0 l=1 rx=0x7fcc10002f30 tx=0x7fcc10007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:41.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.645+0000 7fcc25b43700 1 --2- 172.21.15.103:0/2067446507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc2012c0d0 0x7fcc201464e0 secure :-1 s=THROTTLE_DONE pgs=952 cs=0 l=1 rx=0x7fcc10002f30 tx=0x7fcc10007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:41.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.645+0000 7fcc24b41700 1 -- 172.21.15.103:0/2067446507 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc10011520 con 0x7fcc2012c0d0 2020-04-22T14:11:41.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.645+0000 7fcc24b41700 1 -- 172.21.15.103:0/2067446507 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc10011900 con 0x7fcc2012c0d0 2020-04-22T14:11:41.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.645+0000 7fcc27da7700 1 -- 172.21.15.103:0/2067446507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc2012c0d0 msgr2=0x7fcc201464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:41.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.645+0000 7fcc27da7700 1 --2- 172.21.15.103:0/2067446507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc2012c0d0 0x7fcc201464e0 secure :-1 s=READY pgs=952 cs=0 l=1 rx=0x7fcc10002f30 tx=0x7fcc10007a40).stop 2020-04-22T14:11:41.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.645+0000 7fcc27da7700 1 -- 172.21.15.103:0/2067446507 shutdown_connections 2020-04-22T14:11:41.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.645+0000 7fcc27da7700 1 --2- 172.21.15.103:0/2067446507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc2012c0d0 0x7fcc201464e0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:41.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.645+0000 7fcc27da7700 1 -- 172.21.15.103:0/2067446507 >> 172.21.15.103:0/2067446507 conn(0x7fcc200b9160 msgr2=0x7fcc2005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:41.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.645+0000 7fcc27da7700 1 -- 172.21.15.103:0/2067446507 shutdown_connections 2020-04-22T14:11:41.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.645+0000 7fcc27da7700 1 -- 172.21.15.103:0/2067446507 wait complete. 2020-04-22T14:11:41.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.646+0000 7fcc27da7700 1 Processor -- start 2020-04-22T14:11:41.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.646+0000 7fcc27da7700 1 -- start start 2020-04-22T14:11:41.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.647+0000 7fcc27da7700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcc20063e30 0x7fcc200b7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:41.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.647+0000 7fcc27da7700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcc2012c0d0 0x7fcc200aefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:41.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.647+0000 7fcc27da7700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc20124a60 con 0x7fcc20065fe0 2020-04-22T14:11:41.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.647+0000 7fcc27da7700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc200af430 con 0x7fcc20063e30 2020-04-22T14:11:41.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.647+0000 7fcc27da7700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc20124d00 con 0x7fcc2012c0d0 2020-04-22T14:11:41.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.647+0000 7fcc25342700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fcc20065fe0 0x7fcc200af820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44294/0 (socket says 172.21.15.103:44294) 2020-04-22T14:11:41.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.647+0000 7fcc25342700 1 -- 172.21.15.103:0/996983271 learned_addr learned my addr 172.21.15.103:0/996983271 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:41.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.647+0000 7fcc0effd700 1 -- 172.21.15.103:0/996983271 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2163423332 0 0) 0x7fcc20124a60 con 0x7fcc20065fe0 2020-04-22T14:11:41.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.647+0000 7fcc0effd700 1 -- 172.21.15.103:0/996983271 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc00002fe0 con 0x7fcc20065fe0 2020-04-22T14:11:41.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.647+0000 7fcc25b43700 1 --2- 172.21.15.103:0/996983271 >> v2:172.21.15.86:3300/0 conn(0x7fcc20063e30 0x7fcc200b7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:41.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.647+0000 7fcc26344700 1 --2- 172.21.15.103:0/996983271 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcc2012c0d0 0x7fcc200aefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:41.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.647+0000 7fcc0effd700 1 -- 172.21.15.103:0/996983271 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 182788201 0 0) 0x7fcc00002fe0 con 0x7fcc20065fe0 2020-04-22T14:11:41.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.648+0000 7fcc0effd700 1 -- 172.21.15.103:0/996983271 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcc20124a60 con 0x7fcc20065fe0 2020-04-22T14:11:41.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.648+0000 7fcc0effd700 1 -- 172.21.15.103:0/996983271 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fcc1c001960 con 0x7fcc20065fe0 2020-04-22T14:11:41.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.648+0000 7fcc0effd700 1 -- 172.21.15.103:0/996983271 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcc2012c0d0 msgr2=0x7fcc200aefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:41.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.648+0000 7fcc0effd700 1 --2- 172.21.15.103:0/996983271 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcc2012c0d0 0x7fcc200aefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:41.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.648+0000 7fcc0effd700 1 -- 172.21.15.103:0/996983271 >> v2:172.21.15.86:3300/0 conn(0x7fcc20063e30 msgr2=0x7fcc200b7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:41.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.648+0000 7fcc0effd700 1 --2- 172.21.15.103:0/996983271 >> v2:172.21.15.86:3300/0 conn(0x7fcc20063e30 0x7fcc200b7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:41.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.648+0000 7fcc0effd700 1 -- 172.21.15.103:0/996983271 >> v1:172.21.15.103:6789/0 conn(0x7fcc20065fe0 legacy=0x7fcc200af820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:41.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.648+0000 7fcc0effd700 1 --2- 172.21.15.103:0/996983271 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcc2012c0d0 0x7fcc000049b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:41.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.648+0000 7fcc0effd700 1 --2- 172.21.15.103:0/996983271 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc00004e10 0x7fcc00005230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:41.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.648+0000 7fcc0effd700 1 --2- 172.21.15.103:0/996983271 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcc00003a30 0x7fcc00003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:41.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.648+0000 7fcc0effd700 1 -- 172.21.15.103:0/996983271 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc20124d00 con 0x7fcc00003a30 2020-04-22T14:11:41.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.648+0000 7fcc0effd700 1 -- 172.21.15.103:0/996983271 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc00004580 con 0x7fcc00004e10 2020-04-22T14:11:41.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.648+0000 7fcc0effd700 1 -- 172.21.15.103:0/996983271 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc00004740 con 0x7fcc2012c0d0 2020-04-22T14:11:41.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.648+0000 7fcc25342700 1 --2- 172.21.15.103:0/996983271 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc00004e10 0x7fcc00005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:41.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.648+0000 7fcc25b43700 1 --2- 172.21.15.103:0/996983271 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcc2012c0d0 0x7fcc000049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:41.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.648+0000 7fcc26344700 1 --2- 172.21.15.103:0/996983271 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcc00003a30 0x7fcc00003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:41.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.648+0000 7fcc25342700 1 -- 172.21.15.103:0/996983271 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcc2012c0d0 msgr2=0x7fcc000049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:41.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.648+0000 7fcc25342700 1 --2- 172.21.15.103:0/996983271 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcc2012c0d0 0x7fcc000049b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:41.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.648+0000 7fcc25342700 1 -- 172.21.15.103:0/996983271 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcc00003a30 msgr2=0x7fcc00003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:41.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.648+0000 7fcc25342700 1 --2- 172.21.15.103:0/996983271 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcc00003a30 0x7fcc00003eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:41.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.648+0000 7fcc25342700 1 -- 172.21.15.103:0/996983271 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc20124fa0 con 0x7fcc00004e10 2020-04-22T14:11:41.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.648+0000 7fcc27da7700 1 -- 172.21.15.103:0/996983271 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc200aff30 con 0x7fcc00004e10 2020-04-22T14:11:41.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.648+0000 7fcc26344700 1 --2- 172.21.15.103:0/996983271 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcc00003a30 0x7fcc00003eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:11:41.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.648+0000 7fcc25342700 1 --2- 172.21.15.103:0/996983271 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc00004e10 0x7fcc00005230 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcc1c001670 tx=0x7fcc1c011480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:41.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.648+0000 7fcc27da7700 1 -- 172.21.15.103:0/996983271 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc200af210 con 0x7fcc00004e10 2020-04-22T14:11:41.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.648+0000 7fcc25342700 1 --2- 172.21.15.103:0/996983271 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc00004e10 0x7fcc00005230 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcc1c001670 tx=0x7fcc1c011480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:41.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.648+0000 7fcc25342700 1 --2- 172.21.15.103:0/996983271 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc00004e10 0x7fcc00005230 secure :-1 s=READY pgs=954 cs=0 l=1 rx=0x7fcc1c001670 tx=0x7fcc1c011480).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:41.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.648+0000 7fcc25342700 1 --2- 172.21.15.103:0/996983271 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc00004e10 0x7fcc00005230 secure :-1 s=THROTTLE_DONE pgs=954 cs=0 l=1 rx=0x7fcc1c001670 tx=0x7fcc1c011480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:41.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.648+0000 7fcc0effd700 1 -- 172.21.15.103:0/996983271 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc1c011e90 con 0x7fcc00004e10 2020-04-22T14:11:41.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.648+0000 7fcc25342700 1 --2- 172.21.15.103:0/996983271 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc00004e10 0x7fcc00005230 secure :-1 s=THROTTLE_DONE pgs=954 cs=0 l=1 rx=0x7fcc1c001670 tx=0x7fcc1c011480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:41.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.648+0000 7fcc25342700 1 --2- 172.21.15.103:0/996983271 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc00004e10 0x7fcc00005230 secure :-1 s=THROTTLE_DONE pgs=954 cs=0 l=1 rx=0x7fcc1c001670 tx=0x7fcc1c011480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:41.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.648+0000 7fcc0effd700 1 -- 172.21.15.103:0/996983271 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1c0054d0 con 0x7fcc00004e10 2020-04-22T14:11:41.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.648+0000 7fcc0effd700 1 -- 172.21.15.103:0/996983271 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc1c005830 con 0x7fcc00004e10 2020-04-22T14:11:41.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.649+0000 7fcc25342700 1 --2- 172.21.15.103:0/996983271 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc00004e10 0x7fcc00005230 secure :-1 s=THROTTLE_DONE pgs=954 cs=0 l=1 rx=0x7fcc1c001670 tx=0x7fcc1c011480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:41.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.649+0000 7fcc27da7700 1 -- 172.21.15.103:0/996983271 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc20056c90 con 0x7fcc00004e10 2020-04-22T14:11:41.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.649+0000 7fcc0effd700 1 -- 172.21.15.103:0/996983271 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fcc1c005990 con 0x7fcc00004e10 2020-04-22T14:11:41.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.649+0000 7fcc25342700 1 --2- 172.21.15.103:0/996983271 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc00004e10 0x7fcc00005230 secure :-1 s=THROTTLE_DONE pgs=954 cs=0 l=1 rx=0x7fcc1c001670 tx=0x7fcc1c011480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:41.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.650+0000 7fcc0effd700 1 --2- 172.21.15.103:0/996983271 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcc00055db0 0x7fcc00058270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:41.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.650+0000 7fcc0effd700 1 -- 172.21.15.103:0/996983271 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fcc1c061710 con 0x7fcc00004e10 2020-04-22T14:11:41.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.650+0000 7fcc25b43700 1 --2- 172.21.15.103:0/996983271 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcc00055db0 0x7fcc00058270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:41.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.650+0000 7fcc25b43700 1 --2- 172.21.15.103:0/996983271 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcc00055db0 0x7fcc00058270 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcc10002f30 tx=0x7fcc10007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:41.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.650+0000 7fcc25b43700 1 --2- 172.21.15.103:0/996983271 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcc00055db0 0x7fcc00058270 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcc10002f30 tx=0x7fcc10007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:41.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.650+0000 7fcc25b43700 1 --2- 172.21.15.103:0/996983271 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcc00055db0 0x7fcc00058270 secure :-1 s=READY pgs=359 cs=0 l=1 rx=0x7fcc10002f30 tx=0x7fcc10007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:41.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.654+0000 7fcc25342700 1 --2- 172.21.15.103:0/996983271 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc00004e10 0x7fcc00005230 secure :-1 s=THROTTLE_DONE pgs=954 cs=0 l=1 rx=0x7fcc1c001670 tx=0x7fcc1c011480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:41.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.654+0000 7fcc0effd700 1 -- 172.21.15.103:0/996983271 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fcc1c03cb50 con 0x7fcc00004e10 2020-04-22T14:11:41.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.843+0000 7fcc27da7700 1 -- 172.21.15.103:0/996983271 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc20147360 con 0x7fcc00004e10 2020-04-22T14:11:41.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.844+0000 7fcc25342700 1 --2- 172.21.15.103:0/996983271 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc00004e10 0x7fcc00005230 secure :-1 s=THROTTLE_DONE pgs=954 cs=0 l=1 rx=0x7fcc1c001670 tx=0x7fcc1c011480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:41.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.844+0000 7fcc0effd700 1 -- 172.21.15.103:0/996983271 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2147 (secure 0 0 0) 0x7fcc1c040170 con 0x7fcc00004e10 2020-04-22T14:11:41.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.845+0000 7fcc27da7700 1 -- 172.21.15.103:0/996983271 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcc00055db0 msgr2=0x7fcc00058270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:41.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.845+0000 7fcc27da7700 1 --2- 172.21.15.103:0/996983271 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcc00055db0 0x7fcc00058270 secure :-1 s=READY pgs=359 cs=0 l=1 rx=0x7fcc10002f30 tx=0x7fcc10007a40).stop 2020-04-22T14:11:41.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.845+0000 7fcc27da7700 1 -- 172.21.15.103:0/996983271 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc00004e10 msgr2=0x7fcc00005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:41.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.845+0000 7fcc27da7700 1 --2- 172.21.15.103:0/996983271 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc00004e10 0x7fcc00005230 secure :-1 s=READY pgs=954 cs=0 l=1 rx=0x7fcc1c001670 tx=0x7fcc1c011480).stop 2020-04-22T14:11:41.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.845+0000 7fcc26344700 1 -- 172.21.15.103:0/996983271 reap_dead start 2020-04-22T14:11:41.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.845+0000 7fcc27da7700 1 -- 172.21.15.103:0/996983271 shutdown_connections 2020-04-22T14:11:41.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.845+0000 7fcc27da7700 1 -- 172.21.15.103:0/996983271 >> 172.21.15.103:0/996983271 conn(0x7fcc200b9160 msgr2=0x7fcc2012b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:41.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.845+0000 7fcc27da7700 1 -- 172.21.15.103:0/996983271 shutdown_connections 2020-04-22T14:11:41.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:41.845+0000 7fcc27da7700 1 -- 172.21.15.103:0/996983271 wait complete. 2020-04-22T14:11:41.852 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 41 2020-04-22T14:11:41.852 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:41.852 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/1837726033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1837726033},{"type":"v1","addr":"172.21.15.86:6835","nonce":1837726033}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:03.499587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:11:41.857 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:11:42.858 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:42.876 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:11:43.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.034+0000 7f8569a08700 1 Processor -- start 2020-04-22T14:11:43.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.034+0000 7f8569a08700 1 -- start start 2020-04-22T14:11:43.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.035+0000 7f8569a08700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8564065fe0 0x7f85641464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:43.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.035+0000 7f8569a08700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8564063e30 0x7f85640642a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:43.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.035+0000 7f8569a08700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8564143300 con 0x7f856412c0d0 2020-04-22T14:11:43.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.035+0000 7f8569a08700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85641435a0 con 0x7f8564063e30 2020-04-22T14:11:43.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.035+0000 7f8569a08700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8564143840 con 0x7f8564065fe0 2020-04-22T14:11:43.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.035+0000 7f85637fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8564063e30 0x7f85640642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:43.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.035+0000 7f8562ffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f856412c0d0 0x7f856405b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44306/0 (socket says 172.21.15.103:44306) 2020-04-22T14:11:43.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.035+0000 7f8562ffd700 1 -- 172.21.15.103:0/1732141139 learned_addr learned my addr 172.21.15.103:0/1732141139 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:43.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.035+0000 7f85627fc700 1 --2- 172.21.15.103:0/1732141139 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8564065fe0 0x7f85641464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:43.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.035+0000 7f85637fe700 1 -- 172.21.15.103:0/1732141139 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8564065fe0 msgr2=0x7f85641464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:43.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.035+0000 7f85637fe700 1 --2- 172.21.15.103:0/1732141139 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8564065fe0 0x7f85641464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:43.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.035+0000 7f85637fe700 1 -- 172.21.15.103:0/1732141139 >> v1:172.21.15.103:6789/0 conn(0x7f856412c0d0 legacy=0x7f856405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:43.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.035+0000 7f85637fe700 1 -- 172.21.15.103:0/1732141139 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f856405bb50 con 0x7f8564063e30 2020-04-22T14:11:43.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.035+0000 7f8561ffb700 1 -- 172.21.15.103:0/1732141139 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2998592351 0 0) 0x7f8564143300 con 0x7f856412c0d0 2020-04-22T14:11:43.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.035+0000 7f85637fe700 1 --2- 172.21.15.103:0/1732141139 >> v2:172.21.15.103:3300/0 conn(0x7f8564063e30 0x7f85640642a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f855c0032b0 tx=0x7f855c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:43.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.035+0000 7f85637fe700 1 --2- 172.21.15.103:0/1732141139 >> v2:172.21.15.103:3300/0 conn(0x7f8564063e30 0x7f85640642a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f855c0032b0 tx=0x7f855c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:43.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.035+0000 7f85637fe700 1 --2- 172.21.15.103:0/1732141139 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8564063e30 0x7f85640642a0 secure :-1 s=READY pgs=956 cs=0 l=1 rx=0x7f855c0032b0 tx=0x7f855c007dc0).ready entity=mon.1 client_cookie=fab102580b6188b8 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:43.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.035+0000 7f85637fe700 1 --2- 172.21.15.103:0/1732141139 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8564063e30 0x7f85640642a0 secure :-1 s=THROTTLE_DONE pgs=956 cs=0 l=1 rx=0x7f855c0032b0 tx=0x7f855c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:43.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.035+0000 7f8561ffb700 1 -- 172.21.15.103:0/1732141139 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f855c00a180 con 0x7f8564063e30 2020-04-22T14:11:43.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.035+0000 7f85637fe700 1 --2- 172.21.15.103:0/1732141139 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8564063e30 0x7f85640642a0 secure :-1 s=THROTTLE_DONE pgs=956 cs=0 l=1 rx=0x7f855c0032b0 tx=0x7f855c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:43.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.035+0000 7f85637fe700 1 --2- 172.21.15.103:0/1732141139 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8564063e30 0x7f85640642a0 secure :-1 s=THROTTLE_DONE pgs=956 cs=0 l=1 rx=0x7f855c0032b0 tx=0x7f855c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:43.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.035+0000 7f8561ffb700 1 -- 172.21.15.103:0/1732141139 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f855c00a320 con 0x7f8564063e30 2020-04-22T14:11:43.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.035+0000 7f8561ffb700 1 -- 172.21.15.103:0/1732141139 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f855c00a700 con 0x7f8564063e30 2020-04-22T14:11:43.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.035+0000 7f8569a08700 1 -- 172.21.15.103:0/1732141139 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8564063e30 msgr2=0x7f85640642a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:43.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.035+0000 7f8569a08700 1 --2- 172.21.15.103:0/1732141139 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8564063e30 0x7f85640642a0 secure :-1 s=READY pgs=956 cs=0 l=1 rx=0x7f855c0032b0 tx=0x7f855c007dc0).stop 2020-04-22T14:11:43.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.036+0000 7f8569a08700 1 -- 172.21.15.103:0/1732141139 shutdown_connections 2020-04-22T14:11:43.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.036+0000 7f8569a08700 1 --2- 172.21.15.103:0/1732141139 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8564063e30 0x7f85640642a0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:43.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.036+0000 7f8569a08700 1 --2- 172.21.15.103:0/1732141139 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8564065fe0 0x7f85641464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:43.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.036+0000 7f8569a08700 1 -- 172.21.15.103:0/1732141139 >> 172.21.15.103:0/1732141139 conn(0x7f85640b9160 msgr2=0x7f856405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:43.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.036+0000 7f8569a08700 1 -- 172.21.15.103:0/1732141139 shutdown_connections 2020-04-22T14:11:43.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.036+0000 7f8569a08700 1 -- 172.21.15.103:0/1732141139 wait complete. 2020-04-22T14:11:43.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.037+0000 7f8569a08700 1 Processor -- start 2020-04-22T14:11:43.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.037+0000 7f8569a08700 1 -- start start 2020-04-22T14:11:43.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.038+0000 7f8569a08700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8564063e30 0x7f85640ad260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:43.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.038+0000 7f8569a08700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8564065fe0 0x7f856412a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:43.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.038+0000 7f8569a08700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8564155120 con 0x7f856412c0d0 2020-04-22T14:11:43.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.038+0000 7f8569a08700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85640af860 con 0x7f8564063e30 2020-04-22T14:11:43.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.038+0000 7f8569a08700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85641553c0 con 0x7f8564065fe0 2020-04-22T14:11:43.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.038+0000 7f85637fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f856412c0d0 0x7f8564141f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44316/0 (socket says 172.21.15.103:44316) 2020-04-22T14:11:43.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.038+0000 7f85637fe700 1 -- 172.21.15.103:0/2655137578 learned_addr learned my addr 172.21.15.103:0/2655137578 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:43.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.038+0000 7f85627fc700 1 --2- 172.21.15.103:0/2655137578 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8564065fe0 0x7f856412a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:43.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.038+0000 7f8562ffd700 1 --2- 172.21.15.103:0/2655137578 >> v2:172.21.15.86:3300/0 conn(0x7f8564063e30 0x7f85640ad260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:43.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.038+0000 7f8553fff700 1 -- 172.21.15.103:0/2655137578 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2788942966 0 0) 0x7f8564155120 con 0x7f856412c0d0 2020-04-22T14:11:43.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.038+0000 7f8553fff700 1 -- 172.21.15.103:0/2655137578 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8540002fe0 con 0x7f856412c0d0 2020-04-22T14:11:43.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.038+0000 7f8562ffd700 1 -- 172.21.15.103:0/2655137578 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8564065fe0 msgr2=0x7f856412a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:43.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.038+0000 7f8562ffd700 1 --2- 172.21.15.103:0/2655137578 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8564065fe0 0x7f856412a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:43.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.038+0000 7f8553fff700 1 -- 172.21.15.103:0/2655137578 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1340712287 0 0) 0x7f8540002fe0 con 0x7f856412c0d0 2020-04-22T14:11:43.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.038+0000 7f8562ffd700 1 -- 172.21.15.103:0/2655137578 >> v1:172.21.15.103:6789/0 conn(0x7f856412c0d0 legacy=0x7f8564141f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:43.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.038+0000 7f8562ffd700 1 -- 172.21.15.103:0/2655137578 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8564155660 con 0x7f8564063e30 2020-04-22T14:11:43.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.038+0000 7f85627fc700 1 --2- 172.21.15.103:0/2655137578 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8564065fe0 0x7f856412a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:11:43.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.038+0000 7f8562ffd700 1 --2- 172.21.15.103:0/2655137578 >> v2:172.21.15.86:3300/0 conn(0x7f8564063e30 0x7f85640ad260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f855c00af30 tx=0x7f8558010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:43.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.038+0000 7f8562ffd700 1 --2- 172.21.15.103:0/2655137578 >> v2:172.21.15.86:3300/0 conn(0x7f8564063e30 0x7f85640ad260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f855c00af30 tx=0x7f8558010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:43.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.038+0000 7f8562ffd700 1 --2- 172.21.15.103:0/2655137578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8564063e30 0x7f85640ad260 secure :-1 s=READY pgs=543 cs=0 l=1 rx=0x7f855c00af30 tx=0x7f8558010900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:43.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.039+0000 7f8562ffd700 1 --2- 172.21.15.103:0/2655137578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8564063e30 0x7f85640ad260 secure :-1 s=THROTTLE_DONE pgs=543 cs=0 l=1 rx=0x7f855c00af30 tx=0x7f8558010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:43.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.039+0000 7f8553fff700 1 -- 172.21.15.103:0/2655137578 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f855c00ad90 con 0x7f8564063e30 2020-04-22T14:11:43.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.039+0000 7f8562ffd700 1 --2- 172.21.15.103:0/2655137578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8564063e30 0x7f85640ad260 secure :-1 s=THROTTLE_DONE pgs=543 cs=0 l=1 rx=0x7f855c00af30 tx=0x7f8558010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:43.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.039+0000 7f8553fff700 1 -- 172.21.15.103:0/2655137578 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8558005ab0 con 0x7f8564063e30 2020-04-22T14:11:43.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.039+0000 7f8569a08700 1 -- 172.21.15.103:0/2655137578 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8564154e10 con 0x7f8564063e30 2020-04-22T14:11:43.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.039+0000 7f8562ffd700 1 --2- 172.21.15.103:0/2655137578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8564063e30 0x7f85640ad260 secure :-1 s=THROTTLE_DONE pgs=543 cs=0 l=1 rx=0x7f855c00af30 tx=0x7f8558010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:43.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.039+0000 7f8553fff700 1 -- 172.21.15.103:0/2655137578 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8558005e10 con 0x7f8564063e30 2020-04-22T14:11:43.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.039+0000 7f8569a08700 1 -- 172.21.15.103:0/2655137578 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85641427e0 con 0x7f8564063e30 2020-04-22T14:11:43.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.039+0000 7f8562ffd700 1 --2- 172.21.15.103:0/2655137578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8564063e30 0x7f85640ad260 secure :-1 s=THROTTLE_DONE pgs=543 cs=0 l=1 rx=0x7f855c00af30 tx=0x7f8558010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:43.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.040+0000 7f8569a08700 1 -- 172.21.15.103:0/2655137578 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8564056c90 con 0x7f8564063e30 2020-04-22T14:11:43.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.040+0000 7f8553fff700 1 -- 172.21.15.103:0/2655137578 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f855800a360 con 0x7f8564063e30 2020-04-22T14:11:43.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.040+0000 7f8562ffd700 1 --2- 172.21.15.103:0/2655137578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8564063e30 0x7f85640ad260 secure :-1 s=THROTTLE_DONE pgs=543 cs=0 l=1 rx=0x7f855c00af30 tx=0x7f8558010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:43.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.040+0000 7f8553fff700 1 --2- 172.21.15.103:0/2655137578 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f854004dc50 0x7f8540050110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:43.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.040+0000 7f8553fff700 1 -- 172.21.15.103:0/2655137578 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f85580090c0 con 0x7f8564063e30 2020-04-22T14:11:43.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.040+0000 7f85627fc700 1 --2- 172.21.15.103:0/2655137578 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f854004dc50 0x7f8540050110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:43.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.040+0000 7f85627fc700 1 --2- 172.21.15.103:0/2655137578 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f854004dc50 0x7f8540050110 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8554002f30 tx=0x7f855400bb80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:43.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.041+0000 7f85627fc700 1 --2- 172.21.15.103:0/2655137578 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f854004dc50 0x7f8540050110 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8554002f30 tx=0x7f855400bb80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:43.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.041+0000 7f85627fc700 1 --2- 172.21.15.103:0/2655137578 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f854004dc50 0x7f8540050110 secure :-1 s=READY pgs=360 cs=0 l=1 rx=0x7f8554002f30 tx=0x7f855400bb80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:43.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.044+0000 7f8562ffd700 1 --2- 172.21.15.103:0/2655137578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8564063e30 0x7f85640ad260 secure :-1 s=THROTTLE_DONE pgs=543 cs=0 l=1 rx=0x7f855c00af30 tx=0x7f8558010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:43.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.044+0000 7f8553fff700 1 -- 172.21.15.103:0/2655137578 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f855803c420 con 0x7f8564063e30 2020-04-22T14:11:43.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.231+0000 7f8569a08700 1 -- 172.21.15.103:0/2655137578 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f856412c610 con 0x7f8564063e30 2020-04-22T14:11:43.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.231+0000 7f8562ffd700 1 --2- 172.21.15.103:0/2655137578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8564063e30 0x7f85640ad260 secure :-1 s=THROTTLE_DONE pgs=543 cs=0 l=1 rx=0x7f855c00af30 tx=0x7f8558010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:43.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.232+0000 7f8553fff700 1 -- 172.21.15.103:0/2655137578 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f855803fa40 con 0x7f8564063e30 2020-04-22T14:11:43.234 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:43.234 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/1837726033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1837726033},{"type":"v1","addr":"172.21.15.86:6835","nonce":1837726033}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:03.499587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:11:43.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.233+0000 7f8569a08700 1 -- 172.21.15.103:0/2655137578 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f854004dc50 msgr2=0x7f8540050110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:43.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.233+0000 7f8569a08700 1 --2- 172.21.15.103:0/2655137578 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f854004dc50 0x7f8540050110 secure :-1 s=READY pgs=360 cs=0 l=1 rx=0x7f8554002f30 tx=0x7f855400bb80).stop 2020-04-22T14:11:43.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.233+0000 7f8569a08700 1 -- 172.21.15.103:0/2655137578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8564063e30 msgr2=0x7f85640ad260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:43.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.233+0000 7f8569a08700 1 --2- 172.21.15.103:0/2655137578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8564063e30 0x7f85640ad260 secure :-1 s=READY pgs=543 cs=0 l=1 rx=0x7f855c00af30 tx=0x7f8558010900).stop 2020-04-22T14:11:43.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.233+0000 7f8569a08700 1 -- 172.21.15.103:0/2655137578 shutdown_connections 2020-04-22T14:11:43.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.233+0000 7f8569a08700 1 --2- 172.21.15.103:0/2655137578 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f854004dc50 0x7f8540050110 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:43.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.233+0000 7f8569a08700 1 --2- 172.21.15.103:0/2655137578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8564063e30 0x7f85640ad260 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:43.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.233+0000 7f8569a08700 1 --2- 172.21.15.103:0/2655137578 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8564065fe0 0x7f856412a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:43.237 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.233+0000 7f8569a08700 1 -- 172.21.15.103:0/2655137578 >> 172.21.15.103:0/2655137578 conn(0x7f85640b9160 msgr2=0x7f8564064210 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:43.237 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.233+0000 7f8569a08700 1 -- 172.21.15.103:0/2655137578 shutdown_connections 2020-04-22T14:11:43.237 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:43.233+0000 7f8569a08700 1 -- 172.21.15.103:0/2655137578 wait complete. 2020-04-22T14:11:43.237 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 41 2020-04-22T14:11:43.245 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:11:44.247 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:44.264 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:11:44.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.418+0000 7fdd6c41f700 1 Processor -- start 2020-04-22T14:11:44.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.418+0000 7fdd6c41f700 1 -- start start 2020-04-22T14:11:44.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.419+0000 7fdd6c41f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdd64065fe0 0x7fdd641464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:44.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.419+0000 7fdd6c41f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdd64063e30 0x7fdd640642a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:44.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.419+0000 7fdd6c41f700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd64143300 con 0x7fdd6412c0d0 2020-04-22T14:11:44.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.419+0000 7fdd6c41f700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd641435a0 con 0x7fdd64063e30 2020-04-22T14:11:44.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.419+0000 7fdd6c41f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd64143840 con 0x7fdd64065fe0 2020-04-22T14:11:44.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.419+0000 7fdd6a1bb700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fdd6412c0d0 0x7fdd6405b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44320/0 (socket says 172.21.15.103:44320) 2020-04-22T14:11:44.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.419+0000 7fdd6a1bb700 1 -- 172.21.15.103:0/2342391538 learned_addr learned my addr 172.21.15.103:0/2342391538 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:44.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.419+0000 7fdd6a9bc700 1 --2- 172.21.15.103:0/2342391538 >> v2:172.21.15.86:3300/0 conn(0x7fdd64063e30 0x7fdd640642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:44.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.419+0000 7fdd699ba700 1 --2- 172.21.15.103:0/2342391538 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdd64065fe0 0x7fdd641464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:44.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.419+0000 7fdd691b9700 1 -- 172.21.15.103:0/2342391538 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2722689450 0 0) 0x7fdd64143300 con 0x7fdd6412c0d0 2020-04-22T14:11:44.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.419+0000 7fdd691b9700 1 -- 172.21.15.103:0/2342391538 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd4c003230 con 0x7fdd6412c0d0 2020-04-22T14:11:44.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.419+0000 7fdd691b9700 1 -- 172.21.15.103:0/2342391538 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1811483322 0 0) 0x7fdd4c003230 con 0x7fdd6412c0d0 2020-04-22T14:11:44.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.419+0000 7fdd691b9700 1 -- 172.21.15.103:0/2342391538 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdd64065fe0 msgr2=0x7fdd641464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:44.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.419+0000 7fdd691b9700 1 --2- 172.21.15.103:0/2342391538 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdd64065fe0 0x7fdd641464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:44.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.419+0000 7fdd691b9700 1 -- 172.21.15.103:0/2342391538 >> v2:172.21.15.86:3300/0 conn(0x7fdd64063e30 msgr2=0x7fdd640642a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:44.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.419+0000 7fdd691b9700 1 --2- 172.21.15.103:0/2342391538 >> v2:172.21.15.86:3300/0 conn(0x7fdd64063e30 0x7fdd640642a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:44.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.419+0000 7fdd691b9700 1 -- 172.21.15.103:0/2342391538 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd6405bb50 con 0x7fdd6412c0d0 2020-04-22T14:11:44.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.420+0000 7fdd691b9700 1 -- 172.21.15.103:0/2342391538 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fdd540016d0 con 0x7fdd6412c0d0 2020-04-22T14:11:44.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.420+0000 7fdd6a9bc700 1 --2- 172.21.15.103:0/2342391538 >> v2:172.21.15.86:3300/0 conn(0x7fdd64063e30 0x7fdd640642a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:11:44.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.420+0000 7fdd691b9700 1 -- 172.21.15.103:0/2342391538 >> v1:172.21.15.103:6789/0 conn(0x7fdd6412c0d0 legacy=0x7fdd6405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:44.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.420+0000 7fdd691b9700 1 --2- 172.21.15.103:0/2342391538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd4c003720 0x7fdd4c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:44.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.420+0000 7fdd691b9700 1 --2- 172.21.15.103:0/2342391538 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdd64065fe0 0x7fdd4c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:44.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.420+0000 7fdd691b9700 1 --2- 172.21.15.103:0/2342391538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd4c004930 0x7fdd4c004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:44.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.420+0000 7fdd691b9700 1 -- 172.21.15.103:0/2342391538 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd641435a0 con 0x7fdd4c004930 2020-04-22T14:11:44.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.420+0000 7fdd691b9700 1 -- 172.21.15.103:0/2342391538 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd64143840 con 0x7fdd4c003720 2020-04-22T14:11:44.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.420+0000 7fdd691b9700 1 -- 172.21.15.103:0/2342391538 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c0040f0 con 0x7fdd64065fe0 2020-04-22T14:11:44.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.420+0000 7fdd6a1bb700 1 --2- 172.21.15.103:0/2342391538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd4c003720 0x7fdd4c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:44.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.420+0000 7fdd699ba700 1 --2- 172.21.15.103:0/2342391538 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdd64065fe0 0x7fdd4c0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:44.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.420+0000 7fdd6a9bc700 1 --2- 172.21.15.103:0/2342391538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd4c004930 0x7fdd4c004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:44.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.420+0000 7fdd6a1bb700 1 -- 172.21.15.103:0/2342391538 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdd64065fe0 msgr2=0x7fdd4c0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:44.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.420+0000 7fdd6a1bb700 1 --2- 172.21.15.103:0/2342391538 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdd64065fe0 0x7fdd4c0044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:44.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.420+0000 7fdd6a1bb700 1 -- 172.21.15.103:0/2342391538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd4c004930 msgr2=0x7fdd4c004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:44.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.420+0000 7fdd6a1bb700 1 --2- 172.21.15.103:0/2342391538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd4c004930 0x7fdd4c004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:44.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.420+0000 7fdd6a1bb700 1 -- 172.21.15.103:0/2342391538 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd4c003230 con 0x7fdd4c003720 2020-04-22T14:11:44.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.420+0000 7fdd6a9bc700 1 --2- 172.21.15.103:0/2342391538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd4c004930 0x7fdd4c004db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:11:44.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.420+0000 7fdd6a1bb700 1 --2- 172.21.15.103:0/2342391538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd4c003720 0x7fdd4c003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdd540013e0 tx=0x7fdd6405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:44.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.420+0000 7fdd6a1bb700 1 --2- 172.21.15.103:0/2342391538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd4c003720 0x7fdd4c003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdd540013e0 tx=0x7fdd6405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:44.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.420+0000 7fdd6a1bb700 1 --2- 172.21.15.103:0/2342391538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd4c003720 0x7fdd4c003b40 secure :-1 s=READY pgs=959 cs=0 l=1 rx=0x7fdd540013e0 tx=0x7fdd6405bce0).ready entity=mon.1 client_cookie=156afd57f0919b0f server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:44.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.420+0000 7fdd6a1bb700 1 --2- 172.21.15.103:0/2342391538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd4c003720 0x7fdd4c003b40 secure :-1 s=THROTTLE_DONE pgs=959 cs=0 l=1 rx=0x7fdd540013e0 tx=0x7fdd6405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:44.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.420+0000 7fdd691b9700 1 -- 172.21.15.103:0/2342391538 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd5400e180 con 0x7fdd4c003720 2020-04-22T14:11:44.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.420+0000 7fdd6a1bb700 1 --2- 172.21.15.103:0/2342391538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd4c003720 0x7fdd4c003b40 secure :-1 s=THROTTLE_DONE pgs=959 cs=0 l=1 rx=0x7fdd540013e0 tx=0x7fdd6405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:44.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.420+0000 7fdd691b9700 1 -- 172.21.15.103:0/2342391538 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5400e320 con 0x7fdd4c003720 2020-04-22T14:11:44.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.420+0000 7fdd6a1bb700 1 --2- 172.21.15.103:0/2342391538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd4c003720 0x7fdd4c003b40 secure :-1 s=THROTTLE_DONE pgs=959 cs=0 l=1 rx=0x7fdd540013e0 tx=0x7fdd6405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:44.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.420+0000 7fdd691b9700 1 -- 172.21.15.103:0/2342391538 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd5400e6c0 con 0x7fdd4c003720 2020-04-22T14:11:44.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.420+0000 7fdd6c41f700 1 -- 172.21.15.103:0/2342391538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd4c003720 msgr2=0x7fdd4c003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:44.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.420+0000 7fdd6c41f700 1 --2- 172.21.15.103:0/2342391538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd4c003720 0x7fdd4c003b40 secure :-1 s=READY pgs=959 cs=0 l=1 rx=0x7fdd540013e0 tx=0x7fdd6405bce0).stop 2020-04-22T14:11:44.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.420+0000 7fdd6a9bc700 1 -- 172.21.15.103:0/2342391538 reap_dead start 2020-04-22T14:11:44.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.421+0000 7fdd6c41f700 1 -- 172.21.15.103:0/2342391538 shutdown_connections 2020-04-22T14:11:44.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.421+0000 7fdd6c41f700 1 -- 172.21.15.103:0/2342391538 >> 172.21.15.103:0/2342391538 conn(0x7fdd640b9160 msgr2=0x7fdd6405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:44.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.421+0000 7fdd6c41f700 1 -- 172.21.15.103:0/2342391538 shutdown_connections 2020-04-22T14:11:44.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.421+0000 7fdd6c41f700 1 -- 172.21.15.103:0/2342391538 wait complete. 2020-04-22T14:11:44.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.422+0000 7fdd6c41f700 1 Processor -- start 2020-04-22T14:11:44.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.422+0000 7fdd6c41f700 1 -- start start 2020-04-22T14:11:44.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.422+0000 7fdd6c41f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdd6414cca0 0x7fdd640b57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:44.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.422+0000 7fdd6c41f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdd640af670 0x7fdd640afb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:44.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.422+0000 7fdd6c41f700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd640b27a0 con 0x7fdd64154640 2020-04-22T14:11:44.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.422+0000 7fdd6c41f700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd64154ad0 con 0x7fdd640af670 2020-04-22T14:11:44.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.422+0000 7fdd6c41f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd64157100 con 0x7fdd6414cca0 2020-04-22T14:11:44.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.423+0000 7fdd6a1bb700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdd6414cca0 0x7fdd640b57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:44.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.423+0000 7fdd6a1bb700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdd6414cca0 0x7fdd640b57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52142/0 (socket says 172.21.15.103:52142) 2020-04-22T14:11:44.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.423+0000 7fdd6a1bb700 1 -- 172.21.15.103:0/985316476 learned_addr learned my addr 172.21.15.103:0/985316476 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:44.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.423+0000 7fdd6a9bc700 1 --2- 172.21.15.103:0/985316476 >> v2:172.21.15.86:3300/0 conn(0x7fdd640af670 0x7fdd640afb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:44.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.423+0000 7fdd6a1bb700 1 -- 172.21.15.103:0/985316476 >> v2:172.21.15.86:3300/0 conn(0x7fdd640af670 msgr2=0x7fdd640afb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:44.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.423+0000 7fdd6a1bb700 1 --2- 172.21.15.103:0/985316476 >> v2:172.21.15.86:3300/0 conn(0x7fdd640af670 0x7fdd640afb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:44.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.423+0000 7fdd6a1bb700 1 -- 172.21.15.103:0/985316476 >> v1:172.21.15.86:6789/0 conn(0x7fdd64154640 legacy=0x7fdd640b2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:44.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.423+0000 7fdd6a1bb700 1 -- 172.21.15.103:0/985316476 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd640b5e10 con 0x7fdd6414cca0 2020-04-22T14:11:44.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.423+0000 7fdd6a1bb700 1 --2- 172.21.15.103:0/985316476 >> v2:172.21.15.103:3300/0 conn(0x7fdd6414cca0 0x7fdd640b57e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdd540013e0 tx=0x7fdd6405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:44.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.423+0000 7fdd6a1bb700 1 --2- 172.21.15.103:0/985316476 >> v2:172.21.15.103:3300/0 conn(0x7fdd6414cca0 0x7fdd640b57e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdd540013e0 tx=0x7fdd6405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:44.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.423+0000 7fdd6a1bb700 1 --2- 172.21.15.103:0/985316476 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd6414cca0 0x7fdd640b57e0 secure :-1 s=READY pgs=960 cs=0 l=1 rx=0x7fdd540013e0 tx=0x7fdd6405bce0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:44.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.423+0000 7fdd6a1bb700 1 --2- 172.21.15.103:0/985316476 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd6414cca0 0x7fdd640b57e0 secure :-1 s=THROTTLE_DONE pgs=960 cs=0 l=1 rx=0x7fdd540013e0 tx=0x7fdd6405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:44.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.423+0000 7fdd537fe700 1 -- 172.21.15.103:0/985316476 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd540016d0 con 0x7fdd6414cca0 2020-04-22T14:11:44.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.423+0000 7fdd6a1bb700 1 --2- 172.21.15.103:0/985316476 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd6414cca0 0x7fdd640b57e0 secure :-1 s=THROTTLE_DONE pgs=960 cs=0 l=1 rx=0x7fdd540013e0 tx=0x7fdd6405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:44.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.423+0000 7fdd6a1bb700 1 --2- 172.21.15.103:0/985316476 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd6414cca0 0x7fdd640b57e0 secure :-1 s=THROTTLE_DONE pgs=960 cs=0 l=1 rx=0x7fdd540013e0 tx=0x7fdd6405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:44.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.423+0000 7fdd537fe700 1 -- 172.21.15.103:0/985316476 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5400fe60 con 0x7fdd6414cca0 2020-04-22T14:11:44.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.423+0000 7fdd6c41f700 1 -- 172.21.15.103:0/985316476 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd640b60b0 con 0x7fdd6414cca0 2020-04-22T14:11:44.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.423+0000 7fdd537fe700 1 -- 172.21.15.103:0/985316476 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd540106b0 con 0x7fdd6414cca0 2020-04-22T14:11:44.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.423+0000 7fdd6c41f700 1 -- 172.21.15.103:0/985316476 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd640b0000 con 0x7fdd6414cca0 2020-04-22T14:11:44.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.424+0000 7fdd6a1bb700 1 --2- 172.21.15.103:0/985316476 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd6414cca0 0x7fdd640b57e0 secure :-1 s=THROTTLE_DONE pgs=960 cs=0 l=1 rx=0x7fdd540013e0 tx=0x7fdd6405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:44.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.424+0000 7fdd537fe700 1 -- 172.21.15.103:0/985316476 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fdd540045b0 con 0x7fdd6414cca0 2020-04-22T14:11:44.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.424+0000 7fdd6a1bb700 1 --2- 172.21.15.103:0/985316476 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd6414cca0 0x7fdd640b57e0 secure :-1 s=THROTTLE_DONE pgs=960 cs=0 l=1 rx=0x7fdd540013e0 tx=0x7fdd6405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:44.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.424+0000 7fdd6c41f700 1 -- 172.21.15.103:0/985316476 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd64157240 con 0x7fdd6414cca0 2020-04-22T14:11:44.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.424+0000 7fdd537fe700 1 --2- 172.21.15.103:0/985316476 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdd4404d8b0 0x7fdd4404fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:44.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.424+0000 7fdd537fe700 1 -- 172.21.15.103:0/985316476 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fdd54061c00 con 0x7fdd6414cca0 2020-04-22T14:11:44.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.425+0000 7fdd699ba700 1 --2- 172.21.15.103:0/985316476 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdd4404d8b0 0x7fdd4404fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:44.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.425+0000 7fdd699ba700 1 --2- 172.21.15.103:0/985316476 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdd4404d8b0 0x7fdd4404fd70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdd640ad810 tx=0x7fdd6000c700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:44.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.425+0000 7fdd699ba700 1 --2- 172.21.15.103:0/985316476 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdd4404d8b0 0x7fdd4404fd70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdd640ad810 tx=0x7fdd6000c700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:44.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.425+0000 7fdd699ba700 1 --2- 172.21.15.103:0/985316476 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdd4404d8b0 0x7fdd4404fd70 secure :-1 s=READY pgs=361 cs=0 l=1 rx=0x7fdd640ad810 tx=0x7fdd6000c700).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:44.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.429+0000 7fdd6a1bb700 1 --2- 172.21.15.103:0/985316476 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd6414cca0 0x7fdd640b57e0 secure :-1 s=THROTTLE_DONE pgs=960 cs=0 l=1 rx=0x7fdd540013e0 tx=0x7fdd6405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:44.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.429+0000 7fdd537fe700 1 -- 172.21.15.103:0/985316476 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fdd5403cf80 con 0x7fdd6414cca0 2020-04-22T14:11:44.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.618+0000 7fdd6c41f700 1 -- 172.21.15.103:0/985316476 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdd64056c90 con 0x7fdd6414cca0 2020-04-22T14:11:44.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.618+0000 7fdd6a1bb700 1 --2- 172.21.15.103:0/985316476 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd6414cca0 0x7fdd640b57e0 secure :-1 s=THROTTLE_DONE pgs=960 cs=0 l=1 rx=0x7fdd540013e0 tx=0x7fdd6405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:44.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.618+0000 7fdd537fe700 1 -- 172.21.15.103:0/985316476 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2147 (secure 0 0 0) 0x7fdd540405a0 con 0x7fdd6414cca0 2020-04-22T14:11:44.621 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:44.621 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/1837726033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1837726033},{"type":"v1","addr":"172.21.15.86:6835","nonce":1837726033}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:03.499587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:11:44.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.620+0000 7fdd6c41f700 1 -- 172.21.15.103:0/985316476 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdd4404d8b0 msgr2=0x7fdd4404fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:44.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.620+0000 7fdd6c41f700 1 --2- 172.21.15.103:0/985316476 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdd4404d8b0 0x7fdd4404fd70 secure :-1 s=READY pgs=361 cs=0 l=1 rx=0x7fdd640ad810 tx=0x7fdd6000c700).stop 2020-04-22T14:11:44.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.620+0000 7fdd6c41f700 1 -- 172.21.15.103:0/985316476 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd6414cca0 msgr2=0x7fdd640b57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:44.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.620+0000 7fdd6c41f700 1 --2- 172.21.15.103:0/985316476 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd6414cca0 0x7fdd640b57e0 secure :-1 s=READY pgs=960 cs=0 l=1 rx=0x7fdd540013e0 tx=0x7fdd6405bce0).stop 2020-04-22T14:11:44.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.620+0000 7fdd6c41f700 1 -- 172.21.15.103:0/985316476 shutdown_connections 2020-04-22T14:11:44.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.620+0000 7fdd6c41f700 1 --2- 172.21.15.103:0/985316476 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdd4404d8b0 0x7fdd4404fd70 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:44.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.620+0000 7fdd6c41f700 1 --2- 172.21.15.103:0/985316476 >> v2:172.21.15.86:3300/0 conn(0x7fdd640af670 0x7fdd640afb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:44.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.620+0000 7fdd6c41f700 1 --2- 172.21.15.103:0/985316476 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd6414cca0 0x7fdd640b57e0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:44.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.620+0000 7fdd6c41f700 1 -- 172.21.15.103:0/985316476 >> 172.21.15.103:0/985316476 conn(0x7fdd640b9160 msgr2=0x7fdd6414dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:44.624 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.620+0000 7fdd6c41f700 1 -- 172.21.15.103:0/985316476 shutdown_connections 2020-04-22T14:11:44.624 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:44.620+0000 7fdd6c41f700 1 -- 172.21.15.103:0/985316476 wait complete. 2020-04-22T14:11:44.624 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 41 2020-04-22T14:11:44.634 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:11:45.635 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:45.665 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:11:45.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.809+0000 7f96fd1a1700 1 Processor -- start 2020-04-22T14:11:45.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.809+0000 7f96fd1a1700 1 -- start start 2020-04-22T14:11:45.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.810+0000 7f96fd1a1700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96f812c0d0 0x7f96f81464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:45.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.810+0000 7f96fd1a1700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f96f8063e30 0x7f96f80642a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:45.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.810+0000 7f96fd1a1700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96f8143300 con 0x7f96f8065fe0 2020-04-22T14:11:45.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.810+0000 7f96fd1a1700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96f81435a0 con 0x7f96f8063e30 2020-04-22T14:11:45.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.810+0000 7f96fd1a1700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f8143840 con 0x7f96f812c0d0 2020-04-22T14:11:45.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.810+0000 7f96f759e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f96f8063e30 0x7f96f80642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:45.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.810+0000 7f96f759e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f96f8063e30 0x7f96f80642a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52150/0 (socket says 172.21.15.103:52150) 2020-04-22T14:11:45.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.810+0000 7f96f659c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f96f8065fe0 0x7f96f805b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44340/0 (socket says 172.21.15.103:44340) 2020-04-22T14:11:45.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.810+0000 7f96f759e700 1 -- 172.21.15.103:0/4245118900 learned_addr learned my addr 172.21.15.103:0/4245118900 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:45.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.810+0000 7f96f6d9d700 1 --2- 172.21.15.103:0/4245118900 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96f812c0d0 0x7f96f81464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:45.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.811+0000 7f96f759e700 1 -- 172.21.15.103:0/4245118900 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96f812c0d0 msgr2=0x7f96f81464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:45.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.811+0000 7f96f759e700 1 --2- 172.21.15.103:0/4245118900 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96f812c0d0 0x7f96f81464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:45.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.811+0000 7f96f759e700 1 -- 172.21.15.103:0/4245118900 >> v1:172.21.15.103:6789/0 conn(0x7f96f8065fe0 legacy=0x7f96f805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:45.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.811+0000 7f96f5d9b700 1 -- 172.21.15.103:0/4245118900 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2060041691 0 0) 0x7f96f8143300 con 0x7f96f8065fe0 2020-04-22T14:11:45.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.811+0000 7f96f759e700 1 -- 172.21.15.103:0/4245118900 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f805bb50 con 0x7f96f8063e30 2020-04-22T14:11:45.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.811+0000 7f96f6d9d700 1 --2- 172.21.15.103:0/4245118900 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96f812c0d0 0x7f96f81464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:11:45.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.811+0000 7f96f759e700 1 --2- 172.21.15.103:0/4245118900 >> v2:172.21.15.103:3300/0 conn(0x7f96f8063e30 0x7f96f80642a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f96f00032b0 tx=0x7f96f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:45.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.811+0000 7f96f759e700 1 --2- 172.21.15.103:0/4245118900 >> v2:172.21.15.103:3300/0 conn(0x7f96f8063e30 0x7f96f80642a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f96f00032b0 tx=0x7f96f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:45.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.811+0000 7f96f759e700 1 --2- 172.21.15.103:0/4245118900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96f8063e30 0x7f96f80642a0 secure :-1 s=READY pgs=962 cs=0 l=1 rx=0x7f96f00032b0 tx=0x7f96f0007dc0).ready entity=mon.1 client_cookie=424e6b6dcba560c3 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:45.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.811+0000 7f96f759e700 1 --2- 172.21.15.103:0/4245118900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96f8063e30 0x7f96f80642a0 secure :-1 s=THROTTLE_DONE pgs=962 cs=0 l=1 rx=0x7f96f00032b0 tx=0x7f96f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:45.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.811+0000 7f96f5d9b700 1 -- 172.21.15.103:0/4245118900 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96f000a180 con 0x7f96f8063e30 2020-04-22T14:11:45.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.811+0000 7f96f759e700 1 --2- 172.21.15.103:0/4245118900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96f8063e30 0x7f96f80642a0 secure :-1 s=THROTTLE_DONE pgs=962 cs=0 l=1 rx=0x7f96f00032b0 tx=0x7f96f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:45.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.811+0000 7f96f759e700 1 --2- 172.21.15.103:0/4245118900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96f8063e30 0x7f96f80642a0 secure :-1 s=THROTTLE_DONE pgs=962 cs=0 l=1 rx=0x7f96f00032b0 tx=0x7f96f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:45.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.811+0000 7f96f5d9b700 1 -- 172.21.15.103:0/4245118900 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f000a320 con 0x7f96f8063e30 2020-04-22T14:11:45.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.811+0000 7f96f5d9b700 1 -- 172.21.15.103:0/4245118900 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96f000a700 con 0x7f96f8063e30 2020-04-22T14:11:45.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.811+0000 7f96fd1a1700 1 -- 172.21.15.103:0/4245118900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96f8063e30 msgr2=0x7f96f80642a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:45.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.811+0000 7f96fd1a1700 1 --2- 172.21.15.103:0/4245118900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96f8063e30 0x7f96f80642a0 secure :-1 s=READY pgs=962 cs=0 l=1 rx=0x7f96f00032b0 tx=0x7f96f0007dc0).stop 2020-04-22T14:11:45.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.811+0000 7f96fd1a1700 1 -- 172.21.15.103:0/4245118900 shutdown_connections 2020-04-22T14:11:45.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.811+0000 7f96fd1a1700 1 --2- 172.21.15.103:0/4245118900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96f8063e30 0x7f96f80642a0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:45.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.811+0000 7f96fd1a1700 1 --2- 172.21.15.103:0/4245118900 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96f812c0d0 0x7f96f81464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:45.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.811+0000 7f96fd1a1700 1 -- 172.21.15.103:0/4245118900 >> 172.21.15.103:0/4245118900 conn(0x7f96f80b9160 msgr2=0x7f96f805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:45.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.811+0000 7f96fd1a1700 1 -- 172.21.15.103:0/4245118900 shutdown_connections 2020-04-22T14:11:45.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.811+0000 7f96fd1a1700 1 -- 172.21.15.103:0/4245118900 wait complete. 2020-04-22T14:11:45.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.812+0000 7f96fd1a1700 1 Processor -- start 2020-04-22T14:11:45.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.812+0000 7f96fd1a1700 1 -- start start 2020-04-22T14:11:45.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.813+0000 7f96fd1a1700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f96f8065fe0 0x7f96f80acaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:45.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.813+0000 7f96fd1a1700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96f812c0d0 0x7f96f8126a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:45.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.813+0000 7f96fd1a1700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96f8126e60 con 0x7f96f8063e30 2020-04-22T14:11:45.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.813+0000 7f96fd1a1700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96f81509a0 con 0x7f96f8065fe0 2020-04-22T14:11:45.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.813+0000 7f96fd1a1700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f812a8a0 con 0x7f96f812c0d0 2020-04-22T14:11:45.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.813+0000 7f96f6d9d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f96f8063e30 0x7f96f80b3db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44344/0 (socket says 172.21.15.103:44344) 2020-04-22T14:11:45.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.813+0000 7f96f6d9d700 1 -- 172.21.15.103:0/4035264581 learned_addr learned my addr 172.21.15.103:0/4035264581 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:45.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.813+0000 7f96effff700 1 -- 172.21.15.103:0/4035264581 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4196272055 0 0) 0x7f96e0001ec0 con 0x7f96f8063e30 2020-04-22T14:11:45.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.813+0000 7f96f759e700 1 --2- 172.21.15.103:0/4035264581 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96f812c0d0 0x7f96f8126a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:45.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.813+0000 7f96effff700 1 -- 172.21.15.103:0/4035264581 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96dc002fe0 con 0x7f96f8063e30 2020-04-22T14:11:45.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.813+0000 7f96f659c700 1 --2- 172.21.15.103:0/4035264581 >> v2:172.21.15.86:3300/0 conn(0x7f96f8065fe0 0x7f96f80acaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:45.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.814+0000 7f96effff700 1 -- 172.21.15.103:0/4035264581 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3175348225 0 0) 0x7f96dc002fe0 con 0x7f96f8063e30 2020-04-22T14:11:45.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.814+0000 7f96effff700 1 -- 172.21.15.103:0/4035264581 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f96e0001ec0 con 0x7f96f8063e30 2020-04-22T14:11:45.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.814+0000 7f96effff700 1 -- 172.21.15.103:0/4035264581 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f96e00026d0 con 0x7f96f8063e30 2020-04-22T14:11:45.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.814+0000 7f96effff700 1 -- 172.21.15.103:0/4035264581 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96f812c0d0 msgr2=0x7f96f8126a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:45.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.814+0000 7f96effff700 1 --2- 172.21.15.103:0/4035264581 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96f812c0d0 0x7f96f8126a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:45.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.814+0000 7f96effff700 1 -- 172.21.15.103:0/4035264581 >> v2:172.21.15.86:3300/0 conn(0x7f96f8065fe0 msgr2=0x7f96f80acaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:45.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.814+0000 7f96effff700 1 --2- 172.21.15.103:0/4035264581 >> v2:172.21.15.86:3300/0 conn(0x7f96f8065fe0 0x7f96f80acaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:45.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.814+0000 7f96effff700 1 -- 172.21.15.103:0/4035264581 >> v1:172.21.15.103:6789/0 conn(0x7f96f8063e30 legacy=0x7f96f80b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:45.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.814+0000 7f96effff700 1 --2- 172.21.15.103:0/4035264581 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96dc0049b0 0x7f96dc004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:45.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.814+0000 7f96effff700 1 --2- 172.21.15.103:0/4035264581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96dc003920 0x7f96dc003d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:45.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.814+0000 7f96effff700 1 --2- 172.21.15.103:0/4035264581 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96f812c0d0 0x7f96dc0041c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:45.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.814+0000 7f96effff700 1 -- 172.21.15.103:0/4035264581 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f81509a0 con 0x7f96dc0049b0 2020-04-22T14:11:45.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.814+0000 7f96effff700 1 -- 172.21.15.103:0/4035264581 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f812a8a0 con 0x7f96dc003920 2020-04-22T14:11:45.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.814+0000 7f96effff700 1 -- 172.21.15.103:0/4035264581 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96dc0054c0 con 0x7f96f812c0d0 2020-04-22T14:11:45.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.814+0000 7f96f659c700 1 --2- 172.21.15.103:0/4035264581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96dc003920 0x7f96dc003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:45.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.814+0000 7f96f6d9d700 1 --2- 172.21.15.103:0/4035264581 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96dc0049b0 0x7f96dc004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:45.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.814+0000 7f96f759e700 1 --2- 172.21.15.103:0/4035264581 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96f812c0d0 0x7f96dc0041c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:45.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.814+0000 7f96f659c700 1 -- 172.21.15.103:0/4035264581 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96f812c0d0 msgr2=0x7f96dc0041c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:45.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.814+0000 7f96f659c700 1 --2- 172.21.15.103:0/4035264581 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96f812c0d0 0x7f96dc0041c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:45.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.814+0000 7f96f659c700 1 -- 172.21.15.103:0/4035264581 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96dc0049b0 msgr2=0x7f96dc004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:45.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.814+0000 7f96f659c700 1 --2- 172.21.15.103:0/4035264581 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96dc0049b0 0x7f96dc004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:45.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.814+0000 7f96f659c700 1 -- 172.21.15.103:0/4035264581 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f812ab40 con 0x7f96dc003920 2020-04-22T14:11:45.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.814+0000 7f96f6d9d700 1 --2- 172.21.15.103:0/4035264581 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96dc0049b0 0x7f96dc004dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:11:45.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.814+0000 7f96fd1a1700 1 -- 172.21.15.103:0/4035264581 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96f80ad430 con 0x7f96dc003920 2020-04-22T14:11:45.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.814+0000 7f96fd1a1700 1 -- 172.21.15.103:0/4035264581 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96f8129840 con 0x7f96dc003920 2020-04-22T14:11:45.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.814+0000 7f96f659c700 1 --2- 172.21.15.103:0/4035264581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96dc003920 0x7f96dc003d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f96dc005650 tx=0x7f96e8010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:45.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.814+0000 7f96f659c700 1 --2- 172.21.15.103:0/4035264581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96dc003920 0x7f96dc003d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f96dc005650 tx=0x7f96e8010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:45.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.814+0000 7f96f659c700 1 --2- 172.21.15.103:0/4035264581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96dc003920 0x7f96dc003d60 secure :-1 s=READY pgs=964 cs=0 l=1 rx=0x7f96dc005650 tx=0x7f96e8010c70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:45.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.814+0000 7f96f659c700 1 --2- 172.21.15.103:0/4035264581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96dc003920 0x7f96dc003d60 secure :-1 s=THROTTLE_DONE pgs=964 cs=0 l=1 rx=0x7f96dc005650 tx=0x7f96e8010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:45.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.814+0000 7f96effff700 1 -- 172.21.15.103:0/4035264581 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96e800c940 con 0x7f96dc003920 2020-04-22T14:11:45.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.814+0000 7f96f659c700 1 --2- 172.21.15.103:0/4035264581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96dc003920 0x7f96dc003d60 secure :-1 s=THROTTLE_DONE pgs=964 cs=0 l=1 rx=0x7f96dc005650 tx=0x7f96e8010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:45.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.814+0000 7f96effff700 1 -- 172.21.15.103:0/4035264581 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e800caa0 con 0x7f96dc003920 2020-04-22T14:11:45.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.814+0000 7f96f659c700 1 --2- 172.21.15.103:0/4035264581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96dc003920 0x7f96dc003d60 secure :-1 s=THROTTLE_DONE pgs=964 cs=0 l=1 rx=0x7f96dc005650 tx=0x7f96e8010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:45.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.814+0000 7f96effff700 1 -- 172.21.15.103:0/4035264581 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96e800ce80 con 0x7f96dc003920 2020-04-22T14:11:45.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.815+0000 7f96f659c700 1 --2- 172.21.15.103:0/4035264581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96dc003920 0x7f96dc003d60 secure :-1 s=THROTTLE_DONE pgs=964 cs=0 l=1 rx=0x7f96dc005650 tx=0x7f96e8010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:45.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.815+0000 7f96fd1a1700 1 -- 172.21.15.103:0/4035264581 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96d0003340 con 0x7f96dc003920 2020-04-22T14:11:45.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.815+0000 7f96effff700 1 -- 172.21.15.103:0/4035264581 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f96e80044f0 con 0x7f96dc003920 2020-04-22T14:11:45.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.815+0000 7f96f659c700 1 --2- 172.21.15.103:0/4035264581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96dc003920 0x7f96dc003d60 secure :-1 s=THROTTLE_DONE pgs=964 cs=0 l=1 rx=0x7f96dc005650 tx=0x7f96e8010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:45.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.816+0000 7f96effff700 1 --2- 172.21.15.103:0/4035264581 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f96dc055a70 0x7f96dc057f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:45.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.816+0000 7f96effff700 1 -- 172.21.15.103:0/4035264581 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f96e8060fe0 con 0x7f96dc003920 2020-04-22T14:11:45.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.816+0000 7f96f6d9d700 1 --2- 172.21.15.103:0/4035264581 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f96dc055a70 0x7f96dc057f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:45.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.816+0000 7f96f6d9d700 1 --2- 172.21.15.103:0/4035264581 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f96dc055a70 0x7f96dc057f30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f96e0007ad0 tx=0x7f96e000e2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:45.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.816+0000 7f96f6d9d700 1 --2- 172.21.15.103:0/4035264581 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f96dc055a70 0x7f96dc057f30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f96e0007ad0 tx=0x7f96e000e2e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:45.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.816+0000 7f96f6d9d700 1 --2- 172.21.15.103:0/4035264581 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f96dc055a70 0x7f96dc057f30 secure :-1 s=READY pgs=362 cs=0 l=1 rx=0x7f96e0007ad0 tx=0x7f96e000e2e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:45.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.820+0000 7f96f659c700 1 --2- 172.21.15.103:0/4035264581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96dc003920 0x7f96dc003d60 secure :-1 s=THROTTLE_DONE pgs=964 cs=0 l=1 rx=0x7f96dc005650 tx=0x7f96e8010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:45.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:45.820+0000 7f96effff700 1 -- 172.21.15.103:0/4035264581 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f96e803c3c0 con 0x7f96dc003920 2020-04-22T14:11:46.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:46.007+0000 7f96fd1a1700 1 -- 172.21.15.103:0/4035264581 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96d00036e0 con 0x7f96dc003920 2020-04-22T14:11:46.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:46.007+0000 7f96f659c700 1 --2- 172.21.15.103:0/4035264581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96dc003920 0x7f96dc003d60 secure :-1 s=THROTTLE_DONE pgs=964 cs=0 l=1 rx=0x7f96dc005650 tx=0x7f96e8010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:46.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:46.007+0000 7f96effff700 1 -- 172.21.15.103:0/4035264581 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f96e803f9e0 con 0x7f96dc003920 2020-04-22T14:11:46.010 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:46.010 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/1837726033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1837726033},{"type":"v1","addr":"172.21.15.86:6835","nonce":1837726033}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:03.499587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:11:46.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:46.009+0000 7f96fd1a1700 1 -- 172.21.15.103:0/4035264581 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f96dc055a70 msgr2=0x7f96dc057f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:46.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:46.009+0000 7f96fd1a1700 1 --2- 172.21.15.103:0/4035264581 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f96dc055a70 0x7f96dc057f30 secure :-1 s=READY pgs=362 cs=0 l=1 rx=0x7f96e0007ad0 tx=0x7f96e000e2e0).stop 2020-04-22T14:11:46.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:46.009+0000 7f96fd1a1700 1 -- 172.21.15.103:0/4035264581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96dc003920 msgr2=0x7f96dc003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:46.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:46.009+0000 7f96fd1a1700 1 --2- 172.21.15.103:0/4035264581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96dc003920 0x7f96dc003d60 secure :-1 s=READY pgs=964 cs=0 l=1 rx=0x7f96dc005650 tx=0x7f96e8010c70).stop 2020-04-22T14:11:46.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:46.009+0000 7f96f759e700 1 -- 172.21.15.103:0/4035264581 reap_dead start 2020-04-22T14:11:46.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:46.009+0000 7f96f759e700 1 -- 172.21.15.103:0/4035264581 reap_dead start 2020-04-22T14:11:46.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:46.009+0000 7f96fd1a1700 1 -- 172.21.15.103:0/4035264581 shutdown_connections 2020-04-22T14:11:46.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:46.009+0000 7f96fd1a1700 1 -- 172.21.15.103:0/4035264581 >> 172.21.15.103:0/4035264581 conn(0x7f96f80b9160 msgr2=0x7f96f80b6f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:46.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:46.009+0000 7f96fd1a1700 1 -- 172.21.15.103:0/4035264581 shutdown_connections 2020-04-22T14:11:46.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:46.009+0000 7f96fd1a1700 1 -- 172.21.15.103:0/4035264581 wait complete. 2020-04-22T14:11:46.014 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 41 2020-04-22T14:11:46.021 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:11:47.023 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:47.041 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:11:47.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.194+0000 7f23db19d700 1 Processor -- start 2020-04-22T14:11:47.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.194+0000 7f23db19d700 1 -- start start 2020-04-22T14:11:47.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.195+0000 7f23db19d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f23d40b0ed0 0x7f23d4061410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:47.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.195+0000 7f23db19d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23d40647e0 con 0x7f23d41402c0 2020-04-22T14:11:47.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.195+0000 7f23db19d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23d405fed0 con 0x7f23d4064030 2020-04-22T14:11:47.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.195+0000 7f23db19d700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23d4060170 con 0x7f23d40b0ed0 2020-04-22T14:11:47.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.195+0000 7f23da19b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f23d40b0ed0 0x7f23d4061410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:47.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.195+0000 7f23da19b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f23d40b0ed0 0x7f23d4061410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52168/0 (socket says 172.21.15.103:52168) 2020-04-22T14:11:47.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.195+0000 7f23d999a700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f23d4064030 0x7f23d413fbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44358/0 (socket says 172.21.15.103:44358) 2020-04-22T14:11:47.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.195+0000 7f23da19b700 1 -- 172.21.15.103:0/1074359648 learned_addr learned my addr 172.21.15.103:0/1074359648 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:47.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.196+0000 7f23da19b700 1 -- 172.21.15.103:0/1074359648 >> v1:172.21.15.103:6789/0 conn(0x7f23d4064030 legacy=0x7f23d413fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:47.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.196+0000 7f23da19b700 1 -- 172.21.15.103:0/1074359648 >> v1:172.21.15.86:6789/0 conn(0x7f23d41402c0 legacy=0x7f23d41496f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:47.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.196+0000 7f23da19b700 1 -- 172.21.15.103:0/1074359648 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d4060410 con 0x7f23d40b0ed0 2020-04-22T14:11:47.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.196+0000 7f23da19b700 1 --2- 172.21.15.103:0/1074359648 >> v2:172.21.15.103:3300/0 conn(0x7f23d40b0ed0 0x7f23d4061410 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f23d40b58e0 tx=0x7f23cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:47.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.196+0000 7f23da19b700 1 --2- 172.21.15.103:0/1074359648 >> v2:172.21.15.103:3300/0 conn(0x7f23d40b0ed0 0x7f23d4061410 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f23d40b58e0 tx=0x7f23cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:47.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.196+0000 7f23da19b700 1 --2- 172.21.15.103:0/1074359648 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23d40b0ed0 0x7f23d4061410 secure :-1 s=READY pgs=966 cs=0 l=1 rx=0x7f23d40b58e0 tx=0x7f23cc007dc0).ready entity=mon.1 client_cookie=b4ed92ce5ecee1f8 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:47.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.196+0000 7f23da19b700 1 --2- 172.21.15.103:0/1074359648 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23d40b0ed0 0x7f23d4061410 secure :-1 s=THROTTLE_DONE pgs=966 cs=0 l=1 rx=0x7f23d40b58e0 tx=0x7f23cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:47.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.196+0000 7f23da19b700 1 --2- 172.21.15.103:0/1074359648 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23d40b0ed0 0x7f23d4061410 secure :-1 s=THROTTLE_DONE pgs=966 cs=0 l=1 rx=0x7f23d40b58e0 tx=0x7f23cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:47.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.196+0000 7f23d9199700 1 -- 172.21.15.103:0/1074359648 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23cc00a180 con 0x7f23d40b0ed0 2020-04-22T14:11:47.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.196+0000 7f23da19b700 1 --2- 172.21.15.103:0/1074359648 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23d40b0ed0 0x7f23d4061410 secure :-1 s=THROTTLE_DONE pgs=966 cs=0 l=1 rx=0x7f23d40b58e0 tx=0x7f23cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:47.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.196+0000 7f23d9199700 1 -- 172.21.15.103:0/1074359648 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23cc00a2e0 con 0x7f23d40b0ed0 2020-04-22T14:11:47.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.196+0000 7f23d9199700 1 -- 172.21.15.103:0/1074359648 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23cc00a700 con 0x7f23d40b0ed0 2020-04-22T14:11:47.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.196+0000 7f23db19d700 1 -- 172.21.15.103:0/1074359648 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23d40b0ed0 msgr2=0x7f23d4061410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:47.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.196+0000 7f23db19d700 1 --2- 172.21.15.103:0/1074359648 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23d40b0ed0 0x7f23d4061410 secure :-1 s=READY pgs=966 cs=0 l=1 rx=0x7f23d40b58e0 tx=0x7f23cc007dc0).stop 2020-04-22T14:11:47.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.197+0000 7f23db19d700 1 -- 172.21.15.103:0/1074359648 shutdown_connections 2020-04-22T14:11:47.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.197+0000 7f23db19d700 1 --2- 172.21.15.103:0/1074359648 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23d40b0ed0 0x7f23d4061410 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:47.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.197+0000 7f23db19d700 1 -- 172.21.15.103:0/1074359648 >> 172.21.15.103:0/1074359648 conn(0x7f23d405ad30 msgr2=0x7f23d405b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:47.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.197+0000 7f23db19d700 1 -- 172.21.15.103:0/1074359648 shutdown_connections 2020-04-22T14:11:47.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.197+0000 7f23db19d700 1 -- 172.21.15.103:0/1074359648 wait complete. 2020-04-22T14:11:47.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.198+0000 7f23db19d700 1 Processor -- start 2020-04-22T14:11:47.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.198+0000 7f23db19d700 1 -- start start 2020-04-22T14:11:47.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.198+0000 7f23db19d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23d40b0ed0 0x7f23d4064b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:47.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.198+0000 7f23db19d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f23d41402c0 0x7f23d40b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:47.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.198+0000 7f23db19d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23d40b4520 con 0x7f23d4064030 2020-04-22T14:11:47.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.198+0000 7f23db19d700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23d4147110 con 0x7f23d41402c0 2020-04-22T14:11:47.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.198+0000 7f23db19d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d41473b0 con 0x7f23d40b0ed0 2020-04-22T14:11:47.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.198+0000 7f23da99c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f23d41402c0 0x7f23d40b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:47.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.198+0000 7f23da99c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f23d41402c0 0x7f23d40b40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52174/0 (socket says 172.21.15.103:52174) 2020-04-22T14:11:47.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.198+0000 7f23da99c700 1 -- 172.21.15.103:0/3010574452 learned_addr learned my addr 172.21.15.103:0/3010574452 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:47.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.198+0000 7f23d999a700 1 --2- 172.21.15.103:0/3010574452 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23d40b0ed0 0x7f23d4064b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:47.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.199+0000 7f23da99c700 1 -- 172.21.15.103:0/3010574452 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23d40b0ed0 msgr2=0x7f23d4064b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:47.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.199+0000 7f23da99c700 1 --2- 172.21.15.103:0/3010574452 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23d40b0ed0 0x7f23d4064b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:47.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.199+0000 7f23da99c700 1 -- 172.21.15.103:0/3010574452 >> v1:172.21.15.86:6789/0 conn(0x7f23d4064030 legacy=0x7f23d4153af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:47.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.199+0000 7f23da99c700 1 -- 172.21.15.103:0/3010574452 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d4154200 con 0x7f23d41402c0 2020-04-22T14:11:47.244 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.199+0000 7f23d999a700 1 --2- 172.21.15.103:0/3010574452 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23d40b0ed0 0x7f23d4064b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:11:47.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.199+0000 7f23da99c700 1 --2- 172.21.15.103:0/3010574452 >> v2:172.21.15.103:3300/0 conn(0x7f23d41402c0 0x7f23d40b40c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f23d0001fe0 tx=0x7f23d00023c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:47.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.199+0000 7f23da99c700 1 --2- 172.21.15.103:0/3010574452 >> v2:172.21.15.103:3300/0 conn(0x7f23d41402c0 0x7f23d40b40c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f23d0001fe0 tx=0x7f23d00023c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:47.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.199+0000 7f23da99c700 1 --2- 172.21.15.103:0/3010574452 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23d41402c0 0x7f23d40b40c0 secure :-1 s=READY pgs=967 cs=0 l=1 rx=0x7f23d0001fe0 tx=0x7f23d00023c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:47.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.199+0000 7f23da99c700 1 --2- 172.21.15.103:0/3010574452 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23d41402c0 0x7f23d40b40c0 secure :-1 s=THROTTLE_DONE pgs=967 cs=0 l=1 rx=0x7f23d0001fe0 tx=0x7f23d00023c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:47.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.199+0000 7f23da99c700 1 --2- 172.21.15.103:0/3010574452 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23d41402c0 0x7f23d40b40c0 secure :-1 s=THROTTLE_DONE pgs=967 cs=0 l=1 rx=0x7f23d0001fe0 tx=0x7f23d00023c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:47.246 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.199+0000 7f23c37fe700 1 -- 172.21.15.103:0/3010574452 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23d000cc20 con 0x7f23d41402c0 2020-04-22T14:11:47.246 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.199+0000 7f23da99c700 1 --2- 172.21.15.103:0/3010574452 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23d41402c0 0x7f23d40b40c0 secure :-1 s=THROTTLE_DONE pgs=967 cs=0 l=1 rx=0x7f23d0001fe0 tx=0x7f23d00023c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:47.246 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.199+0000 7f23c37fe700 1 -- 172.21.15.103:0/3010574452 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d000cd80 con 0x7f23d41402c0 2020-04-22T14:11:47.246 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.199+0000 7f23db19d700 1 -- 172.21.15.103:0/3010574452 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d4146990 con 0x7f23d41402c0 2020-04-22T14:11:47.246 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.199+0000 7f23c37fe700 1 -- 172.21.15.103:0/3010574452 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23d000e370 con 0x7f23d41402c0 2020-04-22T14:11:47.247 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.199+0000 7f23db19d700 1 -- 172.21.15.103:0/3010574452 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d4146e60 con 0x7f23d41402c0 2020-04-22T14:11:47.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.200+0000 7f23da99c700 1 --2- 172.21.15.103:0/3010574452 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23d41402c0 0x7f23d40b40c0 secure :-1 s=THROTTLE_DONE pgs=967 cs=0 l=1 rx=0x7f23d0001fe0 tx=0x7f23d00023c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:47.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.200+0000 7f23c37fe700 1 -- 172.21.15.103:0/3010574452 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f23d000e5e0 con 0x7f23d41402c0 2020-04-22T14:11:47.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.200+0000 7f23da99c700 1 --2- 172.21.15.103:0/3010574452 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23d41402c0 0x7f23d40b40c0 secure :-1 s=THROTTLE_DONE pgs=967 cs=0 l=1 rx=0x7f23d0001fe0 tx=0x7f23d00023c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:47.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.200+0000 7f23db19d700 1 -- 172.21.15.103:0/3010574452 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23d4056c90 con 0x7f23d41402c0 2020-04-22T14:11:47.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.200+0000 7f23c37fe700 1 --2- 172.21.15.103:0/3010574452 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f23b404da20 0x7f23b404fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:47.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.200+0000 7f23c37fe700 1 -- 172.21.15.103:0/3010574452 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f23d00610e0 con 0x7f23d41402c0 2020-04-22T14:11:47.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.201+0000 7f23da19b700 1 --2- 172.21.15.103:0/3010574452 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f23b404da20 0x7f23b404fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:47.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.201+0000 7f23da19b700 1 --2- 172.21.15.103:0/3010574452 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f23b404da20 0x7f23b404fee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f23d4140850 tx=0x7f23cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:47.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.201+0000 7f23da19b700 1 --2- 172.21.15.103:0/3010574452 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f23b404da20 0x7f23b404fee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f23d4140850 tx=0x7f23cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:47.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.201+0000 7f23da19b700 1 --2- 172.21.15.103:0/3010574452 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f23b404da20 0x7f23b404fee0 secure :-1 s=READY pgs=363 cs=0 l=1 rx=0x7f23d4140850 tx=0x7f23cc007dc0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:47.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.205+0000 7f23da99c700 1 --2- 172.21.15.103:0/3010574452 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23d41402c0 0x7f23d40b40c0 secure :-1 s=THROTTLE_DONE pgs=967 cs=0 l=1 rx=0x7f23d0001fe0 tx=0x7f23d00023c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:47.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.205+0000 7f23c37fe700 1 -- 172.21.15.103:0/3010574452 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f23d003c520 con 0x7f23d41402c0 2020-04-22T14:11:47.397 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.395+0000 7f23db19d700 1 -- 172.21.15.103:0/3010574452 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23d41543f0 con 0x7f23d41402c0 2020-04-22T14:11:47.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.395+0000 7f23da99c700 1 --2- 172.21.15.103:0/3010574452 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23d41402c0 0x7f23d40b40c0 secure :-1 s=THROTTLE_DONE pgs=967 cs=0 l=1 rx=0x7f23d0001fe0 tx=0x7f23d00023c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:47.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.395+0000 7f23c37fe700 1 -- 172.21.15.103:0/3010574452 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f23d41543f0 con 0x7f23d41402c0 2020-04-22T14:11:47.398 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:47.398 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/1837726033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1837726033},{"type":"v1","addr":"172.21.15.86:6835","nonce":1837726033}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:03.499587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:11:47.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.397+0000 7f23db19d700 1 -- 172.21.15.103:0/3010574452 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f23b404da20 msgr2=0x7f23b404fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:47.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.397+0000 7f23db19d700 1 --2- 172.21.15.103:0/3010574452 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f23b404da20 0x7f23b404fee0 secure :-1 s=READY pgs=363 cs=0 l=1 rx=0x7f23d4140850 tx=0x7f23cc007dc0).stop 2020-04-22T14:11:47.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.397+0000 7f23db19d700 1 -- 172.21.15.103:0/3010574452 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23d41402c0 msgr2=0x7f23d40b40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:47.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.397+0000 7f23db19d700 1 --2- 172.21.15.103:0/3010574452 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23d41402c0 0x7f23d40b40c0 secure :-1 s=READY pgs=967 cs=0 l=1 rx=0x7f23d0001fe0 tx=0x7f23d00023c0).stop 2020-04-22T14:11:47.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.397+0000 7f23db19d700 1 -- 172.21.15.103:0/3010574452 shutdown_connections 2020-04-22T14:11:47.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.397+0000 7f23db19d700 1 --2- 172.21.15.103:0/3010574452 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f23b404da20 0x7f23b404fee0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:47.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.397+0000 7f23db19d700 1 --2- 172.21.15.103:0/3010574452 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23d41402c0 0x7f23d40b40c0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:47.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.397+0000 7f23db19d700 1 --2- 172.21.15.103:0/3010574452 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23d40b0ed0 0x7f23d4064b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:47.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.397+0000 7f23db19d700 1 -- 172.21.15.103:0/3010574452 >> 172.21.15.103:0/3010574452 conn(0x7f23d405ad30 msgr2=0x7f23d40b9620 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:47.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.397+0000 7f23db19d700 1 -- 172.21.15.103:0/3010574452 shutdown_connections 2020-04-22T14:11:47.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:47.397+0000 7f23db19d700 1 -- 172.21.15.103:0/3010574452 wait complete. 2020-04-22T14:11:47.401 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 41 2020-04-22T14:11:47.409 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:11:48.410 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:48.426 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:11:48.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.577+0000 7f91f04c8700 1 Processor -- start 2020-04-22T14:11:48.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.577+0000 7f91f04c8700 1 -- start start 2020-04-22T14:11:48.582 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.578+0000 7f91f04c8700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f91e80b63d0 0x7f91e80b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:48.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.578+0000 7f91f04c8700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f91e814a3a0 0x7f91e80664d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:48.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.578+0000 7f91f04c8700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f91e813ff10 0x7f91e81403a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:48.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.578+0000 7f91f04c8700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91e80608e0 con 0x7f91e814a3a0 2020-04-22T14:11:48.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.578+0000 7f91f04c8700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91e8060b80 con 0x7f91e80b63d0 2020-04-22T14:11:48.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.578+0000 7f91f04c8700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e8060e20 con 0x7f91e813ff10 2020-04-22T14:11:48.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.578+0000 7f91ee264700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f91e80b63d0 0x7f91e80b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:48.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.579+0000 7f91ee264700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f91e80b63d0 0x7f91e80b41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52180/0 (socket says 172.21.15.103:52180) 2020-04-22T14:11:48.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.579+0000 7f91ee264700 1 -- 172.21.15.103:0/2175205519 learned_addr learned my addr 172.21.15.103:0/2175205519 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:48.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.579+0000 7f91eea65700 1 --2- 172.21.15.103:0/2175205519 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f91e813ff10 0x7f91e81403a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:48.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.579+0000 7f91eda63700 1 --2- 172.21.15.103:0/2175205519 >> v2:172.21.15.86:3300/0 conn(0x7f91e814a3a0 0x7f91e80664d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:48.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.579+0000 7f91ee264700 1 -- 172.21.15.103:0/2175205519 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f91e813ff10 msgr2=0x7f91e81403a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:48.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.579+0000 7f91ee264700 1 --2- 172.21.15.103:0/2175205519 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f91e813ff10 0x7f91e81403a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:48.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.579+0000 7f91ee264700 1 -- 172.21.15.103:0/2175205519 >> v2:172.21.15.86:3300/0 conn(0x7f91e814a3a0 msgr2=0x7f91e80664d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:48.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.579+0000 7f91ee264700 1 --2- 172.21.15.103:0/2175205519 >> v2:172.21.15.86:3300/0 conn(0x7f91e814a3a0 0x7f91e80664d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:48.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.579+0000 7f91ee264700 1 -- 172.21.15.103:0/2175205519 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e8140800 con 0x7f91e80b63d0 2020-04-22T14:11:48.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.579+0000 7f91eda63700 1 --2- 172.21.15.103:0/2175205519 >> v2:172.21.15.86:3300/0 conn(0x7f91e814a3a0 0x7f91e80664d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:11:48.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.579+0000 7f91ee264700 1 --2- 172.21.15.103:0/2175205519 >> v2:172.21.15.103:3300/0 conn(0x7f91e80b63d0 0x7f91e80b41b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f91e00032b0 tx=0x7f91e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:48.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.579+0000 7f91ee264700 1 --2- 172.21.15.103:0/2175205519 >> v2:172.21.15.103:3300/0 conn(0x7f91e80b63d0 0x7f91e80b41b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f91e00032b0 tx=0x7f91e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:48.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.579+0000 7f91ee264700 1 --2- 172.21.15.103:0/2175205519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91e80b63d0 0x7f91e80b41b0 secure :-1 s=READY pgs=968 cs=0 l=1 rx=0x7f91e00032b0 tx=0x7f91e0007dc0).ready entity=mon.1 client_cookie=48f47cf8b2a09ac3 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:48.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.579+0000 7f91ee264700 1 --2- 172.21.15.103:0/2175205519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91e80b63d0 0x7f91e80b41b0 secure :-1 s=THROTTLE_DONE pgs=968 cs=0 l=1 rx=0x7f91e00032b0 tx=0x7f91e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:48.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.579+0000 7f91ed262700 1 -- 172.21.15.103:0/2175205519 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91e000a180 con 0x7f91e80b63d0 2020-04-22T14:11:48.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.579+0000 7f91ee264700 1 --2- 172.21.15.103:0/2175205519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91e80b63d0 0x7f91e80b41b0 secure :-1 s=THROTTLE_DONE pgs=968 cs=0 l=1 rx=0x7f91e00032b0 tx=0x7f91e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:48.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.579+0000 7f91ed262700 1 -- 172.21.15.103:0/2175205519 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e000a2e0 con 0x7f91e80b63d0 2020-04-22T14:11:48.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.579+0000 7f91ee264700 1 --2- 172.21.15.103:0/2175205519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91e80b63d0 0x7f91e80b41b0 secure :-1 s=THROTTLE_DONE pgs=968 cs=0 l=1 rx=0x7f91e00032b0 tx=0x7f91e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:48.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.579+0000 7f91ed262700 1 -- 172.21.15.103:0/2175205519 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91e000a700 con 0x7f91e80b63d0 2020-04-22T14:11:48.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.579+0000 7f91f04c8700 1 -- 172.21.15.103:0/2175205519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91e80b63d0 msgr2=0x7f91e80b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:48.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.579+0000 7f91f04c8700 1 --2- 172.21.15.103:0/2175205519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91e80b63d0 0x7f91e80b41b0 secure :-1 s=READY pgs=968 cs=0 l=1 rx=0x7f91e00032b0 tx=0x7f91e0007dc0).stop 2020-04-22T14:11:48.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.580+0000 7f91f04c8700 1 -- 172.21.15.103:0/2175205519 shutdown_connections 2020-04-22T14:11:48.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.580+0000 7f91f04c8700 1 --2- 172.21.15.103:0/2175205519 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f91e813ff10 0x7f91e81403a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:48.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.580+0000 7f91f04c8700 1 --2- 172.21.15.103:0/2175205519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91e80b63d0 0x7f91e80b41b0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:48.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.580+0000 7f91f04c8700 1 --2- 172.21.15.103:0/2175205519 >> v2:172.21.15.86:3300/0 conn(0x7f91e814a3a0 0x7f91e80664d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:48.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.580+0000 7f91f04c8700 1 -- 172.21.15.103:0/2175205519 >> 172.21.15.103:0/2175205519 conn(0x7f91e805f2c0 msgr2=0x7f91e8066e20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:48.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.580+0000 7f91f04c8700 1 -- 172.21.15.103:0/2175205519 shutdown_connections 2020-04-22T14:11:48.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.580+0000 7f91f04c8700 1 -- 172.21.15.103:0/2175205519 wait complete. 2020-04-22T14:11:48.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.581+0000 7f91f04c8700 1 Processor -- start 2020-04-22T14:11:48.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.581+0000 7f91f04c8700 1 -- start start 2020-04-22T14:11:48.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.581+0000 7f91f04c8700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f91e80b63d0 0x7f91e8141da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:48.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.581+0000 7f91f04c8700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f91e814a3a0 0x7f91e8145920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:48.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.581+0000 7f91f04c8700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91e8146a90 con 0x7f91e813ff10 2020-04-22T14:11:48.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.581+0000 7f91f04c8700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91e8142320 con 0x7f91e814a3a0 2020-04-22T14:11:48.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.581+0000 7f91f04c8700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91e81425c0 con 0x7f91e80b63d0 2020-04-22T14:11:48.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.581+0000 7f91ee264700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f91e80b63d0 0x7f91e8141da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:48.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.581+0000 7f91ee264700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f91e80b63d0 0x7f91e8141da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52186/0 (socket says 172.21.15.103:52186) 2020-04-22T14:11:48.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.581+0000 7f91eda63700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f91e813ff10 0x7f91e813e030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44378/0 (socket says 172.21.15.103:44378) 2020-04-22T14:11:48.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.581+0000 7f91ee264700 1 -- 172.21.15.103:0/957638039 learned_addr learned my addr 172.21.15.103:0/957638039 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:48.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.582+0000 7f91eea65700 1 --2- 172.21.15.103:0/957638039 >> v2:172.21.15.86:3300/0 conn(0x7f91e814a3a0 0x7f91e8145920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:48.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.582+0000 7f91ee264700 1 -- 172.21.15.103:0/957638039 >> v2:172.21.15.86:3300/0 conn(0x7f91e814a3a0 msgr2=0x7f91e8145920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:48.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.582+0000 7f91ee264700 1 --2- 172.21.15.103:0/957638039 >> v2:172.21.15.86:3300/0 conn(0x7f91e814a3a0 0x7f91e8145920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:48.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.582+0000 7f91ee264700 1 -- 172.21.15.103:0/957638039 >> v1:172.21.15.103:6789/0 conn(0x7f91e813ff10 legacy=0x7f91e813e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:48.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.582+0000 7f91db7fe700 1 -- 172.21.15.103:0/957638039 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 722645274 0 0) 0x7f91e8146a90 con 0x7f91e813ff10 2020-04-22T14:11:48.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.582+0000 7f91ee264700 1 -- 172.21.15.103:0/957638039 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e8142860 con 0x7f91e80b63d0 2020-04-22T14:11:48.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.582+0000 7f91eea65700 1 --2- 172.21.15.103:0/957638039 >> v2:172.21.15.86:3300/0 conn(0x7f91e814a3a0 0x7f91e8145920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:11:48.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.582+0000 7f91ee264700 1 --2- 172.21.15.103:0/957638039 >> v2:172.21.15.103:3300/0 conn(0x7f91e80b63d0 0x7f91e8141da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f91e00032b0 tx=0x7f91e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:48.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.582+0000 7f91ee264700 1 --2- 172.21.15.103:0/957638039 >> v2:172.21.15.103:3300/0 conn(0x7f91e80b63d0 0x7f91e8141da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f91e00032b0 tx=0x7f91e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:48.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.582+0000 7f91ee264700 1 --2- 172.21.15.103:0/957638039 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91e80b63d0 0x7f91e8141da0 secure :-1 s=READY pgs=970 cs=0 l=1 rx=0x7f91e00032b0 tx=0x7f91e0007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:48.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.582+0000 7f91ee264700 1 --2- 172.21.15.103:0/957638039 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91e80b63d0 0x7f91e8141da0 secure :-1 s=THROTTLE_DONE pgs=970 cs=0 l=1 rx=0x7f91e00032b0 tx=0x7f91e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:48.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.582+0000 7f91db7fe700 1 -- 172.21.15.103:0/957638039 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91e0005c30 con 0x7f91e80b63d0 2020-04-22T14:11:48.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.582+0000 7f91ee264700 1 --2- 172.21.15.103:0/957638039 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91e80b63d0 0x7f91e8141da0 secure :-1 s=THROTTLE_DONE pgs=970 cs=0 l=1 rx=0x7f91e00032b0 tx=0x7f91e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:48.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.582+0000 7f91f04c8700 1 -- 172.21.15.103:0/957638039 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e813e740 con 0x7f91e80b63d0 2020-04-22T14:11:48.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.582+0000 7f91db7fe700 1 -- 172.21.15.103:0/957638039 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e0005d90 con 0x7f91e80b63d0 2020-04-22T14:11:48.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.582+0000 7f91ee264700 1 --2- 172.21.15.103:0/957638039 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91e80b63d0 0x7f91e8141da0 secure :-1 s=THROTTLE_DONE pgs=970 cs=0 l=1 rx=0x7f91e00032b0 tx=0x7f91e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:48.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.582+0000 7f91db7fe700 1 -- 172.21.15.103:0/957638039 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91e000f7a0 con 0x7f91e80b63d0 2020-04-22T14:11:48.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.582+0000 7f91f04c8700 1 -- 172.21.15.103:0/957638039 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e80b3220 con 0x7f91e80b63d0 2020-04-22T14:11:48.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.583+0000 7f91ee264700 1 --2- 172.21.15.103:0/957638039 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91e80b63d0 0x7f91e8141da0 secure :-1 s=THROTTLE_DONE pgs=970 cs=0 l=1 rx=0x7f91e00032b0 tx=0x7f91e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:48.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.583+0000 7f91db7fe700 1 -- 172.21.15.103:0/957638039 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f91e000f9e0 con 0x7f91e80b63d0 2020-04-22T14:11:48.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.583+0000 7f91ee264700 1 --2- 172.21.15.103:0/957638039 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91e80b63d0 0x7f91e8141da0 secure :-1 s=THROTTLE_DONE pgs=970 cs=0 l=1 rx=0x7f91e00032b0 tx=0x7f91e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:48.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.583+0000 7f91f04c8700 1 -- 172.21.15.103:0/957638039 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e8056c90 con 0x7f91e80b63d0 2020-04-22T14:11:48.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.583+0000 7f91db7fe700 1 --2- 172.21.15.103:0/957638039 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f91c804d830 0x7f91c804fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:48.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.583+0000 7f91db7fe700 1 -- 172.21.15.103:0/957638039 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f91e0062480 con 0x7f91e80b63d0 2020-04-22T14:11:48.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.584+0000 7f91eda63700 1 --2- 172.21.15.103:0/957638039 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f91c804d830 0x7f91c804fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:48.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.584+0000 7f91eda63700 1 --2- 172.21.15.103:0/957638039 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f91c804d830 0x7f91c804fcf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f91dc003070 tx=0x7f91dc002390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:48.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.584+0000 7f91eda63700 1 --2- 172.21.15.103:0/957638039 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f91c804d830 0x7f91c804fcf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f91dc003070 tx=0x7f91dc002390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:48.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.584+0000 7f91eda63700 1 --2- 172.21.15.103:0/957638039 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f91c804d830 0x7f91c804fcf0 secure :-1 s=READY pgs=364 cs=0 l=1 rx=0x7f91dc003070 tx=0x7f91dc002390).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:48.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.587+0000 7f91ee264700 1 --2- 172.21.15.103:0/957638039 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91e80b63d0 0x7f91e8141da0 secure :-1 s=THROTTLE_DONE pgs=970 cs=0 l=1 rx=0x7f91e00032b0 tx=0x7f91e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:48.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.587+0000 7f91db7fe700 1 -- 172.21.15.103:0/957638039 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f91e003d980 con 0x7f91e80b63d0 2020-04-22T14:11:48.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.775+0000 7f91f04c8700 1 -- 172.21.15.103:0/957638039 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91e805a640 con 0x7f91e80b63d0 2020-04-22T14:11:48.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.775+0000 7f91ee264700 1 --2- 172.21.15.103:0/957638039 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91e80b63d0 0x7f91e8141da0 secure :-1 s=THROTTLE_DONE pgs=970 cs=0 l=1 rx=0x7f91e00032b0 tx=0x7f91e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:48.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.775+0000 7f91db7fe700 1 -- 172.21.15.103:0/957638039 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f91e0040fa0 con 0x7f91e80b63d0 2020-04-22T14:11:48.778 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:48.778 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/1837726033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1837726033},{"type":"v1","addr":"172.21.15.86:6835","nonce":1837726033}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:03.499587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:11:48.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.776+0000 7f91f04c8700 1 -- 172.21.15.103:0/957638039 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f91c804d830 msgr2=0x7f91c804fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:48.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.776+0000 7f91f04c8700 1 --2- 172.21.15.103:0/957638039 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f91c804d830 0x7f91c804fcf0 secure :-1 s=READY pgs=364 cs=0 l=1 rx=0x7f91dc003070 tx=0x7f91dc002390).stop 2020-04-22T14:11:48.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.777+0000 7f91f04c8700 1 -- 172.21.15.103:0/957638039 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91e80b63d0 msgr2=0x7f91e8141da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:48.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.777+0000 7f91f04c8700 1 --2- 172.21.15.103:0/957638039 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91e80b63d0 0x7f91e8141da0 secure :-1 s=READY pgs=970 cs=0 l=1 rx=0x7f91e00032b0 tx=0x7f91e0007dc0).stop 2020-04-22T14:11:48.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.777+0000 7f91f04c8700 1 -- 172.21.15.103:0/957638039 shutdown_connections 2020-04-22T14:11:48.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.777+0000 7f91f04c8700 1 --2- 172.21.15.103:0/957638039 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f91c804d830 0x7f91c804fcf0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:48.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.777+0000 7f91f04c8700 1 --2- 172.21.15.103:0/957638039 >> v2:172.21.15.86:3300/0 conn(0x7f91e814a3a0 0x7f91e8145920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:48.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.777+0000 7f91f04c8700 1 --2- 172.21.15.103:0/957638039 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91e80b63d0 0x7f91e8141da0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:48.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.777+0000 7f91f04c8700 1 -- 172.21.15.103:0/957638039 >> 172.21.15.103:0/957638039 conn(0x7f91e805f2c0 msgr2=0x7f91e813f200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:48.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.777+0000 7f91f04c8700 1 -- 172.21.15.103:0/957638039 shutdown_connections 2020-04-22T14:11:48.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:48.777+0000 7f91f04c8700 1 -- 172.21.15.103:0/957638039 wait complete. 2020-04-22T14:11:48.781 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 41 2020-04-22T14:11:48.789 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:11:49.789 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:49.806 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:11:49.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.961+0000 7f9a59eee700 1 Processor -- start 2020-04-22T14:11:49.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.961+0000 7f9a59eee700 1 -- start start 2020-04-22T14:11:49.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.961+0000 7f9a59eee700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a5412c0d0 0x7f9a541464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:49.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.961+0000 7f9a59eee700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9a54063e30 0x7f9a540642a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:49.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.961+0000 7f9a59eee700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a54143300 con 0x7f9a54065fe0 2020-04-22T14:11:49.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.961+0000 7f9a59eee700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a541435a0 con 0x7f9a54063e30 2020-04-22T14:11:49.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.961+0000 7f9a59eee700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a54143840 con 0x7f9a5412c0d0 2020-04-22T14:11:49.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.961+0000 7f9a53fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9a54063e30 0x7f9a540642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:49.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.961+0000 7f9a52ffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f9a54065fe0 0x7f9a5405b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44384/0 (socket says 172.21.15.103:44384) 2020-04-22T14:11:49.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.962+0000 7f9a52ffd700 1 -- 172.21.15.103:0/3000991252 learned_addr learned my addr 172.21.15.103:0/3000991252 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:49.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.962+0000 7f9a537fe700 1 --2- 172.21.15.103:0/3000991252 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a5412c0d0 0x7f9a541464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:49.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.962+0000 7f9a53fff700 1 -- 172.21.15.103:0/3000991252 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a5412c0d0 msgr2=0x7f9a541464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:49.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.962+0000 7f9a53fff700 1 --2- 172.21.15.103:0/3000991252 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a5412c0d0 0x7f9a541464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:49.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.962+0000 7f9a53fff700 1 -- 172.21.15.103:0/3000991252 >> v1:172.21.15.103:6789/0 conn(0x7f9a54065fe0 legacy=0x7f9a5405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:49.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.962+0000 7f9a53fff700 1 -- 172.21.15.103:0/3000991252 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a5405bb50 con 0x7f9a54063e30 2020-04-22T14:11:49.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.962+0000 7f9a527fc700 1 -- 172.21.15.103:0/3000991252 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2633379721 0 0) 0x7f9a54143300 con 0x7f9a54065fe0 2020-04-22T14:11:49.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.962+0000 7f9a537fe700 1 --2- 172.21.15.103:0/3000991252 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a5412c0d0 0x7f9a541464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:11:49.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.962+0000 7f9a53fff700 1 --2- 172.21.15.103:0/3000991252 >> v2:172.21.15.103:3300/0 conn(0x7f9a54063e30 0x7f9a540642a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9a4c0032b0 tx=0x7f9a4c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:49.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.962+0000 7f9a53fff700 1 --2- 172.21.15.103:0/3000991252 >> v2:172.21.15.103:3300/0 conn(0x7f9a54063e30 0x7f9a540642a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9a4c0032b0 tx=0x7f9a4c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:49.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.962+0000 7f9a53fff700 1 --2- 172.21.15.103:0/3000991252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a54063e30 0x7f9a540642a0 secure :-1 s=READY pgs=972 cs=0 l=1 rx=0x7f9a4c0032b0 tx=0x7f9a4c007dc0).ready entity=mon.1 client_cookie=a8ebe7708ba2327b server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:49.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.962+0000 7f9a53fff700 1 --2- 172.21.15.103:0/3000991252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a54063e30 0x7f9a540642a0 secure :-1 s=THROTTLE_DONE pgs=972 cs=0 l=1 rx=0x7f9a4c0032b0 tx=0x7f9a4c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:49.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.962+0000 7f9a527fc700 1 -- 172.21.15.103:0/3000991252 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a4c00a180 con 0x7f9a54063e30 2020-04-22T14:11:49.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.962+0000 7f9a53fff700 1 --2- 172.21.15.103:0/3000991252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a54063e30 0x7f9a540642a0 secure :-1 s=THROTTLE_DONE pgs=972 cs=0 l=1 rx=0x7f9a4c0032b0 tx=0x7f9a4c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:49.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.962+0000 7f9a527fc700 1 -- 172.21.15.103:0/3000991252 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a4c00a320 con 0x7f9a54063e30 2020-04-22T14:11:49.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.962+0000 7f9a53fff700 1 --2- 172.21.15.103:0/3000991252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a54063e30 0x7f9a540642a0 secure :-1 s=THROTTLE_DONE pgs=972 cs=0 l=1 rx=0x7f9a4c0032b0 tx=0x7f9a4c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:49.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.962+0000 7f9a59eee700 1 -- 172.21.15.103:0/3000991252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a54063e30 msgr2=0x7f9a540642a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:49.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.962+0000 7f9a59eee700 1 --2- 172.21.15.103:0/3000991252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a54063e30 0x7f9a540642a0 secure :-1 s=READY pgs=972 cs=0 l=1 rx=0x7f9a4c0032b0 tx=0x7f9a4c007dc0).stop 2020-04-22T14:11:49.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.962+0000 7f9a527fc700 1 -- 172.21.15.103:0/3000991252 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a4c00a700 con 0x7f9a54063e30 2020-04-22T14:11:49.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.963+0000 7f9a59eee700 1 -- 172.21.15.103:0/3000991252 shutdown_connections 2020-04-22T14:11:49.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.963+0000 7f9a59eee700 1 --2- 172.21.15.103:0/3000991252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a54063e30 0x7f9a540642a0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:49.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.963+0000 7f9a59eee700 1 --2- 172.21.15.103:0/3000991252 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a5412c0d0 0x7f9a541464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:49.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.963+0000 7f9a59eee700 1 -- 172.21.15.103:0/3000991252 >> 172.21.15.103:0/3000991252 conn(0x7f9a540b9160 msgr2=0x7f9a5405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:49.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.963+0000 7f9a59eee700 1 -- 172.21.15.103:0/3000991252 shutdown_connections 2020-04-22T14:11:49.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.963+0000 7f9a59eee700 1 -- 172.21.15.103:0/3000991252 wait complete. 2020-04-22T14:11:49.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.964+0000 7f9a59eee700 1 Processor -- start 2020-04-22T14:11:49.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.964+0000 7f9a59eee700 1 -- start start 2020-04-22T14:11:49.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.964+0000 7f9a59eee700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9a54063e30 0x7f9a5414f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:49.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.964+0000 7f9a59eee700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9a54065fe0 0x7f9a540b7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:49.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.964+0000 7f9a59eee700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a5412c0d0 0x7f9a54142180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:49.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.964+0000 7f9a59eee700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a540b8080 con 0x7f9a54063e30 2020-04-22T14:11:49.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.964+0000 7f9a59eee700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a54150a80 con 0x7f9a54065fe0 2020-04-22T14:11:49.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.964+0000 7f9a59eee700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a54150d20 con 0x7f9a5412c0d0 2020-04-22T14:11:49.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.965+0000 7f9a52ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9a54065fe0 0x7f9a540b7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:49.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.965+0000 7f9a52ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9a54065fe0 0x7f9a540b7c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52202/0 (socket says 172.21.15.103:52202) 2020-04-22T14:11:49.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.965+0000 7f9a52ffd700 1 -- 172.21.15.103:0/3446969359 learned_addr learned my addr 172.21.15.103:0/3446969359 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:49.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.965+0000 7f9a53fff700 1 --2- 172.21.15.103:0/3446969359 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a5412c0d0 0x7f9a54142180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:49.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.965+0000 7f9a537fe700 1 --2- 172.21.15.103:0/3446969359 >> v2:172.21.15.86:3300/0 conn(0x7f9a54063e30 0x7f9a5414f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:49.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.965+0000 7f9a52ffd700 1 -- 172.21.15.103:0/3446969359 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a5412c0d0 msgr2=0x7f9a54142180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:49.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.965+0000 7f9a52ffd700 1 --2- 172.21.15.103:0/3446969359 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a5412c0d0 0x7f9a54142180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:49.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.965+0000 7f9a52ffd700 1 -- 172.21.15.103:0/3446969359 >> v2:172.21.15.86:3300/0 conn(0x7f9a54063e30 msgr2=0x7f9a5414f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:49.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.965+0000 7f9a52ffd700 1 --2- 172.21.15.103:0/3446969359 >> v2:172.21.15.86:3300/0 conn(0x7f9a54063e30 0x7f9a5414f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:49.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.965+0000 7f9a52ffd700 1 -- 172.21.15.103:0/3446969359 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a54150fc0 con 0x7f9a54065fe0 2020-04-22T14:11:49.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.965+0000 7f9a537fe700 1 --2- 172.21.15.103:0/3446969359 >> v2:172.21.15.86:3300/0 conn(0x7f9a54063e30 0x7f9a5414f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:11:49.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.965+0000 7f9a52ffd700 1 --2- 172.21.15.103:0/3446969359 >> v2:172.21.15.103:3300/0 conn(0x7f9a54065fe0 0x7f9a540b7c20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9a48000b80 tx=0x7f9a48001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:49.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.965+0000 7f9a52ffd700 1 --2- 172.21.15.103:0/3446969359 >> v2:172.21.15.103:3300/0 conn(0x7f9a54065fe0 0x7f9a540b7c20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9a48000b80 tx=0x7f9a48001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:49.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.965+0000 7f9a52ffd700 1 --2- 172.21.15.103:0/3446969359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a54065fe0 0x7f9a540b7c20 secure :-1 s=READY pgs=973 cs=0 l=1 rx=0x7f9a48000b80 tx=0x7f9a48001e40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:49.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.965+0000 7f9a52ffd700 1 --2- 172.21.15.103:0/3446969359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a54065fe0 0x7f9a540b7c20 secure :-1 s=THROTTLE_DONE pgs=973 cs=0 l=1 rx=0x7f9a48000b80 tx=0x7f9a48001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:49.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.965+0000 7f9a50ff9700 1 -- 172.21.15.103:0/3446969359 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a4800ca40 con 0x7f9a54065fe0 2020-04-22T14:11:49.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.965+0000 7f9a52ffd700 1 --2- 172.21.15.103:0/3446969359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a54065fe0 0x7f9a540b7c20 secure :-1 s=THROTTLE_DONE pgs=973 cs=0 l=1 rx=0x7f9a48000b80 tx=0x7f9a48001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:49.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.965+0000 7f9a50ff9700 1 -- 172.21.15.103:0/3446969359 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a4800cba0 con 0x7f9a54065fe0 2020-04-22T14:11:49.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.965+0000 7f9a52ffd700 1 --2- 172.21.15.103:0/3446969359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a54065fe0 0x7f9a540b7c20 secure :-1 s=THROTTLE_DONE pgs=973 cs=0 l=1 rx=0x7f9a48000b80 tx=0x7f9a48001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:49.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.965+0000 7f9a59eee700 1 -- 172.21.15.103:0/3446969359 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a541506d0 con 0x7f9a54065fe0 2020-04-22T14:11:49.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.965+0000 7f9a50ff9700 1 -- 172.21.15.103:0/3446969359 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a480120e0 con 0x7f9a54065fe0 2020-04-22T14:11:49.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.965+0000 7f9a59eee700 1 -- 172.21.15.103:0/3446969359 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a5414acd0 con 0x7f9a54065fe0 2020-04-22T14:11:49.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.966+0000 7f9a52ffd700 1 --2- 172.21.15.103:0/3446969359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a54065fe0 0x7f9a540b7c20 secure :-1 s=THROTTLE_DONE pgs=973 cs=0 l=1 rx=0x7f9a48000b80 tx=0x7f9a48001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:49.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.966+0000 7f9a59eee700 1 -- 172.21.15.103:0/3446969359 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a54151150 con 0x7f9a54065fe0 2020-04-22T14:11:49.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.966+0000 7f9a50ff9700 1 -- 172.21.15.103:0/3446969359 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f9a480055c0 con 0x7f9a54065fe0 2020-04-22T14:11:49.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.966+0000 7f9a52ffd700 1 --2- 172.21.15.103:0/3446969359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a54065fe0 0x7f9a540b7c20 secure :-1 s=THROTTLE_DONE pgs=973 cs=0 l=1 rx=0x7f9a48000b80 tx=0x7f9a48001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:49.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.967+0000 7f9a50ff9700 1 --2- 172.21.15.103:0/3446969359 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9a3404d9e0 0x7f9a3404fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:49.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.967+0000 7f9a50ff9700 1 -- 172.21.15.103:0/3446969359 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f9a480100c0 con 0x7f9a54065fe0 2020-04-22T14:11:49.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.967+0000 7f9a537fe700 1 --2- 172.21.15.103:0/3446969359 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9a3404d9e0 0x7f9a3404fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:49.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.967+0000 7f9a537fe700 1 --2- 172.21.15.103:0/3446969359 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9a3404d9e0 0x7f9a3404fea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9a44002f30 tx=0x7f9a44007d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:49.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.967+0000 7f9a537fe700 1 --2- 172.21.15.103:0/3446969359 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9a3404d9e0 0x7f9a3404fea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9a44002f30 tx=0x7f9a44007d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:49.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.967+0000 7f9a537fe700 1 --2- 172.21.15.103:0/3446969359 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9a3404d9e0 0x7f9a3404fea0 secure :-1 s=READY pgs=365 cs=0 l=1 rx=0x7f9a44002f30 tx=0x7f9a44007d90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:49.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.971+0000 7f9a52ffd700 1 --2- 172.21.15.103:0/3446969359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a54065fe0 0x7f9a540b7c20 secure :-1 s=THROTTLE_DONE pgs=973 cs=0 l=1 rx=0x7f9a48000b80 tx=0x7f9a48001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:49.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:49.971+0000 7f9a50ff9700 1 -- 172.21.15.103:0/3446969359 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f9a4803c510 con 0x7f9a54065fe0 2020-04-22T14:11:50.162 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:50.160+0000 7f9a59eee700 1 -- 172.21.15.103:0/3446969359 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a54056c90 con 0x7f9a54065fe0 2020-04-22T14:11:50.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:50.160+0000 7f9a52ffd700 1 --2- 172.21.15.103:0/3446969359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a54065fe0 0x7f9a540b7c20 secure :-1 s=THROTTLE_DONE pgs=973 cs=0 l=1 rx=0x7f9a48000b80 tx=0x7f9a48001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:50.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:50.160+0000 7f9a50ff9700 1 -- 172.21.15.103:0/3446969359 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f9a4803fb30 con 0x7f9a54065fe0 2020-04-22T14:11:50.163 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:50.163 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/1837726033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1837726033},{"type":"v1","addr":"172.21.15.86:6835","nonce":1837726033}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:03.499587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:11:50.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:50.162+0000 7f9a59eee700 1 -- 172.21.15.103:0/3446969359 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9a3404d9e0 msgr2=0x7f9a3404fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:50.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:50.162+0000 7f9a59eee700 1 --2- 172.21.15.103:0/3446969359 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9a3404d9e0 0x7f9a3404fea0 secure :-1 s=READY pgs=365 cs=0 l=1 rx=0x7f9a44002f30 tx=0x7f9a44007d90).stop 2020-04-22T14:11:50.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:50.162+0000 7f9a59eee700 1 -- 172.21.15.103:0/3446969359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a54065fe0 msgr2=0x7f9a540b7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:50.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:50.162+0000 7f9a59eee700 1 --2- 172.21.15.103:0/3446969359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a54065fe0 0x7f9a540b7c20 secure :-1 s=READY pgs=973 cs=0 l=1 rx=0x7f9a48000b80 tx=0x7f9a48001e40).stop 2020-04-22T14:11:50.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:50.162+0000 7f9a59eee700 1 -- 172.21.15.103:0/3446969359 shutdown_connections 2020-04-22T14:11:50.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:50.162+0000 7f9a59eee700 1 --2- 172.21.15.103:0/3446969359 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9a3404d9e0 0x7f9a3404fea0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:50.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:50.162+0000 7f9a59eee700 1 --2- 172.21.15.103:0/3446969359 >> v2:172.21.15.86:3300/0 conn(0x7f9a54063e30 0x7f9a5414f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:50.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:50.162+0000 7f9a59eee700 1 --2- 172.21.15.103:0/3446969359 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a5412c0d0 0x7f9a54142180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:50.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:50.162+0000 7f9a59eee700 1 --2- 172.21.15.103:0/3446969359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a54065fe0 0x7f9a540b7c20 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:50.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:50.162+0000 7f9a59eee700 1 -- 172.21.15.103:0/3446969359 >> 172.21.15.103:0/3446969359 conn(0x7f9a540b9160 msgr2=0x7f9a54064210 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:50.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:50.162+0000 7f9a59eee700 1 -- 172.21.15.103:0/3446969359 shutdown_connections 2020-04-22T14:11:50.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:50.162+0000 7f9a59eee700 1 -- 172.21.15.103:0/3446969359 wait complete. 2020-04-22T14:11:50.166 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 41 2020-04-22T14:11:50.174 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:11:51.175 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:51.191 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:11:51.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.348+0000 7f457916f700 1 Processor -- start 2020-04-22T14:11:51.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.348+0000 7f457916f700 1 -- start start 2020-04-22T14:11:51.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.349+0000 7f457916f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f457412c0d0 0x7f45741464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:51.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.349+0000 7f457916f700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4574143300 con 0x7f4574065fe0 2020-04-22T14:11:51.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.349+0000 7f457916f700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45741435a0 con 0x7f4574063e30 2020-04-22T14:11:51.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.349+0000 7f457916f700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4574143840 con 0x7f457412c0d0 2020-04-22T14:11:51.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.349+0000 7f457359e700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f4574063e30 0x7f45740642c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44398/0 (socket says 172.21.15.103:44398) 2020-04-22T14:11:51.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.349+0000 7f457359e700 1 -- 172.21.15.103:0/10328878 learned_addr learned my addr 172.21.15.103:0/10328878 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:51.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.349+0000 7f4572d9d700 1 --2- 172.21.15.103:0/10328878 >> v2:172.21.15.86:3300/0 conn(0x7f457412c0d0 0x7f45741464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:51.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.349+0000 7f4571d9b700 1 -- 172.21.15.103:0/10328878 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 498184616 0 0) 0x7f45741435a0 con 0x7f4574063e30 2020-04-22T14:11:51.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.349+0000 7f4571d9b700 1 -- 172.21.15.103:0/10328878 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4558003230 con 0x7f4574063e30 2020-04-22T14:11:51.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.349+0000 7f4572d9d700 1 -- 172.21.15.103:0/10328878 >> v1:172.21.15.103:6789/0 conn(0x7f4574063e30 legacy=0x7f45740642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:51.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.349+0000 7f4571d9b700 1 -- 172.21.15.103:0/10328878 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1239675757 0 0) 0x7f4558003230 con 0x7f4574063e30 2020-04-22T14:11:51.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.349+0000 7f4572d9d700 1 -- 172.21.15.103:0/10328878 >> v1:172.21.15.86:6789/0 conn(0x7f4574065fe0 legacy=0x7f457405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:51.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.350+0000 7f4572d9d700 1 -- 172.21.15.103:0/10328878 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f457405bb50 con 0x7f457412c0d0 2020-04-22T14:11:51.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.350+0000 7f4572d9d700 1 --2- 172.21.15.103:0/10328878 >> v2:172.21.15.86:3300/0 conn(0x7f457412c0d0 0x7f45741464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4568001450 tx=0x7f456c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:51.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.350+0000 7f4572d9d700 1 --2- 172.21.15.103:0/10328878 >> v2:172.21.15.86:3300/0 conn(0x7f457412c0d0 0x7f45741464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4568001450 tx=0x7f456c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:51.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.350+0000 7f4572d9d700 1 --2- 172.21.15.103:0/10328878 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f457412c0d0 0x7f45741464e0 secure :-1 s=READY pgs=548 cs=0 l=1 rx=0x7f4568001450 tx=0x7f456c007a40).ready entity=mon.0 client_cookie=79d97de6844d1d5c server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:51.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.350+0000 7f4572d9d700 1 --2- 172.21.15.103:0/10328878 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f457412c0d0 0x7f45741464e0 secure :-1 s=THROTTLE_DONE pgs=548 cs=0 l=1 rx=0x7f4568001450 tx=0x7f456c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:51.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.350+0000 7f4571d9b700 1 -- 172.21.15.103:0/10328878 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45640016d0 con 0x7f457412c0d0 2020-04-22T14:11:51.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.350+0000 7f4572d9d700 1 --2- 172.21.15.103:0/10328878 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f457412c0d0 0x7f45741464e0 secure :-1 s=THROTTLE_DONE pgs=548 cs=0 l=1 rx=0x7f4568001450 tx=0x7f456c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:51.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.350+0000 7f4572d9d700 1 --2- 172.21.15.103:0/10328878 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f457412c0d0 0x7f45741464e0 secure :-1 s=THROTTLE_DONE pgs=548 cs=0 l=1 rx=0x7f4568001450 tx=0x7f456c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:51.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.350+0000 7f4571d9b700 1 -- 172.21.15.103:0/10328878 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f456c008b40 con 0x7f457412c0d0 2020-04-22T14:11:51.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.350+0000 7f4571d9b700 1 -- 172.21.15.103:0/10328878 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f456c008ea0 con 0x7f457412c0d0 2020-04-22T14:11:51.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.350+0000 7f457916f700 1 -- 172.21.15.103:0/10328878 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f457412c0d0 msgr2=0x7f45741464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:51.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.350+0000 7f457916f700 1 --2- 172.21.15.103:0/10328878 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f457412c0d0 0x7f45741464e0 secure :-1 s=READY pgs=548 cs=0 l=1 rx=0x7f4568001450 tx=0x7f456c007a40).stop 2020-04-22T14:11:51.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.350+0000 7f457916f700 1 -- 172.21.15.103:0/10328878 shutdown_connections 2020-04-22T14:11:51.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.350+0000 7f457916f700 1 --2- 172.21.15.103:0/10328878 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f457412c0d0 0x7f45741464e0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:51.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.350+0000 7f457916f700 1 -- 172.21.15.103:0/10328878 >> 172.21.15.103:0/10328878 conn(0x7f45740b9160 msgr2=0x7f457405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:51.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.350+0000 7f457916f700 1 -- 172.21.15.103:0/10328878 shutdown_connections 2020-04-22T14:11:51.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.351+0000 7f457916f700 1 -- 172.21.15.103:0/10328878 wait complete. 2020-04-22T14:11:51.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.352+0000 7f457916f700 1 Processor -- start 2020-04-22T14:11:51.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.352+0000 7f457916f700 1 -- start start 2020-04-22T14:11:51.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.352+0000 7f457916f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4574065fe0 0x7f45740b4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:51.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.352+0000 7f457916f700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45740b45b0 con 0x7f4574063e30 2020-04-22T14:11:51.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.352+0000 7f457916f700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45740b1170 con 0x7f457412c0d0 2020-04-22T14:11:51.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.352+0000 7f457916f700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45740b1410 con 0x7f4574065fe0 2020-04-22T14:11:51.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.352+0000 7f457359e700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f457412c0d0 0x7f45740acbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44408/0 (socket says 172.21.15.103:44408) 2020-04-22T14:11:51.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.352+0000 7f457359e700 1 -- 172.21.15.103:0/2933965187 learned_addr learned my addr 172.21.15.103:0/2933965187 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:51.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.352+0000 7f457259c700 1 --2- 172.21.15.103:0/2933965187 >> v2:172.21.15.86:3300/0 conn(0x7f4574065fe0 0x7f45740b4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:51.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.353+0000 7f4563fff700 1 -- 172.21.15.103:0/2933965187 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2972817850 0 0) 0x7f45740b1170 con 0x7f457412c0d0 2020-04-22T14:11:51.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.353+0000 7f4563fff700 1 -- 172.21.15.103:0/2933965187 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4550002fe0 con 0x7f457412c0d0 2020-04-22T14:11:51.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.353+0000 7f457259c700 1 -- 172.21.15.103:0/2933965187 >> v1:172.21.15.103:6789/0 conn(0x7f457412c0d0 legacy=0x7f45740acbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:51.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.353+0000 7f4563fff700 1 -- 172.21.15.103:0/2933965187 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 684198339 0 0) 0x7f457405bb50 con 0x7f4574063e30 2020-04-22T14:11:51.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.353+0000 7f457259c700 1 -- 172.21.15.103:0/2933965187 >> v1:172.21.15.86:6789/0 conn(0x7f4574063e30 legacy=0x7f4574128070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:51.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.353+0000 7f457259c700 1 -- 172.21.15.103:0/2933965187 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45740b0e90 con 0x7f4574065fe0 2020-04-22T14:11:51.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.353+0000 7f457259c700 1 --2- 172.21.15.103:0/2933965187 >> v2:172.21.15.86:3300/0 conn(0x7f4574065fe0 0x7f45740b4150 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4568001490 tx=0x7f456800c830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:51.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.353+0000 7f457259c700 1 --2- 172.21.15.103:0/2933965187 >> v2:172.21.15.86:3300/0 conn(0x7f4574065fe0 0x7f45740b4150 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4568001490 tx=0x7f456800c830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:51.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.353+0000 7f457259c700 1 --2- 172.21.15.103:0/2933965187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4574065fe0 0x7f45740b4150 secure :-1 s=READY pgs=550 cs=0 l=1 rx=0x7f4568001490 tx=0x7f456800c830).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:51.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.353+0000 7f457259c700 1 --2- 172.21.15.103:0/2933965187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4574065fe0 0x7f45740b4150 secure :-1 s=THROTTLE_DONE pgs=550 cs=0 l=1 rx=0x7f4568001490 tx=0x7f456800c830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:51.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.353+0000 7f4563fff700 1 -- 172.21.15.103:0/2933965187 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45680101e0 con 0x7f4574065fe0 2020-04-22T14:11:51.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.353+0000 7f457259c700 1 --2- 172.21.15.103:0/2933965187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4574065fe0 0x7f45740b4150 secure :-1 s=THROTTLE_DONE pgs=550 cs=0 l=1 rx=0x7f4568001490 tx=0x7f456800c830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:51.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.353+0000 7f457259c700 1 --2- 172.21.15.103:0/2933965187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4574065fe0 0x7f45740b4150 secure :-1 s=THROTTLE_DONE pgs=550 cs=0 l=1 rx=0x7f4568001490 tx=0x7f456800c830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:51.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.353+0000 7f4563fff700 1 -- 172.21.15.103:0/2933965187 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4568010340 con 0x7f4574065fe0 2020-04-22T14:11:51.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.353+0000 7f457916f700 1 -- 172.21.15.103:0/2933965187 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45740ae540 con 0x7f4574065fe0 2020-04-22T14:11:51.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.353+0000 7f4563fff700 1 -- 172.21.15.103:0/2933965187 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45680106e0 con 0x7f4574065fe0 2020-04-22T14:11:51.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.353+0000 7f457916f700 1 -- 172.21.15.103:0/2933965187 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45740b5420 con 0x7f4574065fe0 2020-04-22T14:11:51.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.354+0000 7f457259c700 1 --2- 172.21.15.103:0/2933965187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4574065fe0 0x7f45740b4150 secure :-1 s=THROTTLE_DONE pgs=550 cs=0 l=1 rx=0x7f4568001490 tx=0x7f456800c830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:51.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.354+0000 7f457916f700 1 -- 172.21.15.103:0/2933965187 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4574056c90 con 0x7f4574065fe0 2020-04-22T14:11:51.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.354+0000 7f4563fff700 1 -- 172.21.15.103:0/2933965187 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f4568006860 con 0x7f4574065fe0 2020-04-22T14:11:51.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.354+0000 7f457259c700 1 --2- 172.21.15.103:0/2933965187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4574065fe0 0x7f45740b4150 secure :-1 s=THROTTLE_DONE pgs=550 cs=0 l=1 rx=0x7f4568001490 tx=0x7f456800c830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:51.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.355+0000 7f4563fff700 1 --2- 172.21.15.103:0/2933965187 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f455004dc50 0x7f4550050110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:51.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.355+0000 7f4563fff700 1 -- 172.21.15.103:0/2933965187 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f4568061340 con 0x7f4574065fe0 2020-04-22T14:11:51.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.355+0000 7f4572d9d700 1 --2- 172.21.15.103:0/2933965187 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f455004dc50 0x7f4550050110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:51.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.355+0000 7f4572d9d700 1 --2- 172.21.15.103:0/2933965187 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f455004dc50 0x7f4550050110 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f456c008320 tx=0x7f456c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:51.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.355+0000 7f4572d9d700 1 --2- 172.21.15.103:0/2933965187 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f455004dc50 0x7f4550050110 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f456c008320 tx=0x7f456c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:51.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.355+0000 7f4572d9d700 1 --2- 172.21.15.103:0/2933965187 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f455004dc50 0x7f4550050110 secure :-1 s=READY pgs=366 cs=0 l=1 rx=0x7f456c008320 tx=0x7f456c007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:51.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.358+0000 7f457259c700 1 --2- 172.21.15.103:0/2933965187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4574065fe0 0x7f45740b4150 secure :-1 s=THROTTLE_DONE pgs=550 cs=0 l=1 rx=0x7f4568001490 tx=0x7f456800c830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:51.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.358+0000 7f4563fff700 1 -- 172.21.15.103:0/2933965187 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f456803c7e0 con 0x7f4574065fe0 2020-04-22T14:11:51.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.547+0000 7f457916f700 1 -- 172.21.15.103:0/2933965187 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f457406a4f0 con 0x7f4574065fe0 2020-04-22T14:11:51.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.547+0000 7f457259c700 1 --2- 172.21.15.103:0/2933965187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4574065fe0 0x7f45740b4150 secure :-1 s=THROTTLE_DONE pgs=550 cs=0 l=1 rx=0x7f4568001490 tx=0x7f456800c830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:51.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.547+0000 7f4563fff700 1 -- 172.21.15.103:0/2933965187 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f456803fe00 con 0x7f4574065fe0 2020-04-22T14:11:51.550 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:51.550 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/1837726033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1837726033},{"type":"v1","addr":"172.21.15.86:6835","nonce":1837726033}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:03.499587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:11:51.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.548+0000 7f457916f700 1 -- 172.21.15.103:0/2933965187 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f455004dc50 msgr2=0x7f4550050110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:51.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.548+0000 7f457916f700 1 --2- 172.21.15.103:0/2933965187 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f455004dc50 0x7f4550050110 secure :-1 s=READY pgs=366 cs=0 l=1 rx=0x7f456c008320 tx=0x7f456c007a40).stop 2020-04-22T14:11:51.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.548+0000 7f457916f700 1 -- 172.21.15.103:0/2933965187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4574065fe0 msgr2=0x7f45740b4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:51.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.549+0000 7f457916f700 1 --2- 172.21.15.103:0/2933965187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4574065fe0 0x7f45740b4150 secure :-1 s=READY pgs=550 cs=0 l=1 rx=0x7f4568001490 tx=0x7f456800c830).stop 2020-04-22T14:11:51.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.549+0000 7f457916f700 1 -- 172.21.15.103:0/2933965187 shutdown_connections 2020-04-22T14:11:51.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.549+0000 7f457916f700 1 --2- 172.21.15.103:0/2933965187 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f455004dc50 0x7f4550050110 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:51.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.549+0000 7f457916f700 1 --2- 172.21.15.103:0/2933965187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4574065fe0 0x7f45740b4150 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:51.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.549+0000 7f457916f700 1 -- 172.21.15.103:0/2933965187 >> 172.21.15.103:0/2933965187 conn(0x7f45740b9160 msgr2=0x7f4574064280 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:51.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.549+0000 7f457916f700 1 -- 172.21.15.103:0/2933965187 shutdown_connections 2020-04-22T14:11:51.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:51.549+0000 7f457916f700 1 -- 172.21.15.103:0/2933965187 wait complete. 2020-04-22T14:11:51.553 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 41 2020-04-22T14:11:51.561 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:11:52.269 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:11:52.286 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:11:52.328 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:52.346 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:11:52.562 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:52.583 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:11:52.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.743+0000 7f2c6e4a1700 1 Processor -- start 2020-04-22T14:11:52.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.743+0000 7f2c6e4a1700 1 -- start start 2020-04-22T14:11:52.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.744+0000 7f2c6e4a1700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2c68140320 0x7f2c680ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:52.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.744+0000 7f2c6e4a1700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c6814a740 con 0x7f2c680bd1b0 2020-04-22T14:11:52.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.744+0000 7f2c6e4a1700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c681462f0 con 0x7f2c6814a2b0 2020-04-22T14:11:52.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.744+0000 7f2c6e4a1700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c68146590 con 0x7f2c68140320 2020-04-22T14:11:52.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.744+0000 7f2c5ffff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f2c6814a2b0 0x7f2c68146cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44414/0 (socket says 172.21.15.103:44414) 2020-04-22T14:11:52.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.744+0000 7f2c5ffff700 1 -- 172.21.15.103:0/1496516586 learned_addr learned my addr 172.21.15.103:0/1496516586 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:52.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.745+0000 7f2c677fe700 1 -- 172.21.15.103:0/1496516586 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 53963864 0 0) 0x7f2c681462f0 con 0x7f2c6814a2b0 2020-04-22T14:11:52.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.745+0000 7f2c67fff700 1 --2- 172.21.15.103:0/1496516586 >> v2:172.21.15.86:3300/0 conn(0x7f2c68140320 0x7f2c680ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:52.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.745+0000 7f2c677fe700 1 -- 172.21.15.103:0/1496516586 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c48003230 con 0x7f2c6814a2b0 2020-04-22T14:11:52.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.745+0000 7f2c677fe700 1 -- 172.21.15.103:0/1496516586 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4097604610 0 0) 0x7f2c48003230 con 0x7f2c6814a2b0 2020-04-22T14:11:52.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.745+0000 7f2c677fe700 1 -- 172.21.15.103:0/1496516586 >> v2:172.21.15.86:3300/0 conn(0x7f2c68140320 msgr2=0x7f2c680ae1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:52.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.745+0000 7f2c677fe700 1 --2- 172.21.15.103:0/1496516586 >> v2:172.21.15.86:3300/0 conn(0x7f2c68140320 0x7f2c680ae1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:52.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.745+0000 7f2c677fe700 1 -- 172.21.15.103:0/1496516586 >> v1:172.21.15.86:6789/0 conn(0x7f2c680bd1b0 legacy=0x7f2c680ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:52.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.745+0000 7f2c677fe700 1 -- 172.21.15.103:0/1496516586 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c68146830 con 0x7f2c6814a2b0 2020-04-22T14:11:52.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.745+0000 7f2c677fe700 1 -- 172.21.15.103:0/1496516586 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f2c500016d0 con 0x7f2c6814a2b0 2020-04-22T14:11:52.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.745+0000 7f2c677fe700 1 -- 172.21.15.103:0/1496516586 >> v1:172.21.15.103:6789/0 conn(0x7f2c6814a2b0 legacy=0x7f2c68146cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:52.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.745+0000 7f2c677fe700 1 --2- 172.21.15.103:0/1496516586 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c48003720 0x7f2c48003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:52.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.745+0000 7f2c677fe700 1 --2- 172.21.15.103:0/1496516586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c480044d0 0x7f2c48004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:52.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.745+0000 7f2c677fe700 1 --2- 172.21.15.103:0/1496516586 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2c48004db0 0x7f2c4800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:52.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.745+0000 7f2c677fe700 1 -- 172.21.15.103:0/1496516586 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c68146590 con 0x7f2c48003720 2020-04-22T14:11:52.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.745+0000 7f2c677fe700 1 -- 172.21.15.103:0/1496516586 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c480041c0 con 0x7f2c480044d0 2020-04-22T14:11:52.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.745+0000 7f2c677fe700 1 -- 172.21.15.103:0/1496516586 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4800bb80 con 0x7f2c48004db0 2020-04-22T14:11:52.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.745+0000 7f2c5ffff700 1 --2- 172.21.15.103:0/1496516586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c480044d0 0x7f2c48004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:52.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.745+0000 7f2c67fff700 1 --2- 172.21.15.103:0/1496516586 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c48003720 0x7f2c48003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:52.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.745+0000 7f2c6ca3e700 1 --2- 172.21.15.103:0/1496516586 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2c48004db0 0x7f2c4800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:52.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.745+0000 7f2c5ffff700 1 -- 172.21.15.103:0/1496516586 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2c48004db0 msgr2=0x7f2c4800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:52.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.745+0000 7f2c5ffff700 1 --2- 172.21.15.103:0/1496516586 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2c48004db0 0x7f2c4800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:52.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.745+0000 7f2c5ffff700 1 -- 172.21.15.103:0/1496516586 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c48003720 msgr2=0x7f2c48003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:52.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.745+0000 7f2c5ffff700 1 --2- 172.21.15.103:0/1496516586 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c48003720 0x7f2c48003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:52.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.745+0000 7f2c5ffff700 1 -- 172.21.15.103:0/1496516586 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c48003230 con 0x7f2c480044d0 2020-04-22T14:11:52.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.745+0000 7f2c6ca3e700 1 --2- 172.21.15.103:0/1496516586 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2c48004db0 0x7f2c4800b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:11:52.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.745+0000 7f2c6ca3e700 1 -- 172.21.15.103:0/1496516586 reap_dead start 2020-04-22T14:11:52.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.745+0000 7f2c5ffff700 1 --2- 172.21.15.103:0/1496516586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c480044d0 0x7f2c48004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2c480054a0 tx=0x7f2c68143ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:52.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.745+0000 7f2c5ffff700 1 --2- 172.21.15.103:0/1496516586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c480044d0 0x7f2c48004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2c480054a0 tx=0x7f2c68143ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:52.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.745+0000 7f2c5ffff700 1 --2- 172.21.15.103:0/1496516586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c480044d0 0x7f2c48004950 secure :-1 s=READY pgs=977 cs=0 l=1 rx=0x7f2c480054a0 tx=0x7f2c68143ee0).ready entity=mon.1 client_cookie=ce9cc385f1640bb server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:52.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.746+0000 7f2c5ffff700 1 --2- 172.21.15.103:0/1496516586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c480044d0 0x7f2c48004950 secure :-1 s=THROTTLE_DONE pgs=977 cs=0 l=1 rx=0x7f2c480054a0 tx=0x7f2c68143ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:52.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.746+0000 7f2c677fe700 1 -- 172.21.15.103:0/1496516586 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c5000ce80 con 0x7f2c480044d0 2020-04-22T14:11:52.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.746+0000 7f2c5ffff700 1 --2- 172.21.15.103:0/1496516586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c480044d0 0x7f2c48004950 secure :-1 s=THROTTLE_DONE pgs=977 cs=0 l=1 rx=0x7f2c480054a0 tx=0x7f2c68143ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:52.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.746+0000 7f2c5ffff700 1 --2- 172.21.15.103:0/1496516586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c480044d0 0x7f2c48004950 secure :-1 s=THROTTLE_DONE pgs=977 cs=0 l=1 rx=0x7f2c480054a0 tx=0x7f2c68143ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:52.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.746+0000 7f2c677fe700 1 -- 172.21.15.103:0/1496516586 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c5000e370 con 0x7f2c480044d0 2020-04-22T14:11:52.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.746+0000 7f2c677fe700 1 -- 172.21.15.103:0/1496516586 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c500100c0 con 0x7f2c480044d0 2020-04-22T14:11:52.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.746+0000 7f2c6e4a1700 1 -- 172.21.15.103:0/1496516586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c480044d0 msgr2=0x7f2c48004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:52.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.746+0000 7f2c6e4a1700 1 --2- 172.21.15.103:0/1496516586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c480044d0 0x7f2c48004950 secure :-1 s=READY pgs=977 cs=0 l=1 rx=0x7f2c480054a0 tx=0x7f2c68143ee0).stop 2020-04-22T14:11:52.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.746+0000 7f2c6e4a1700 1 -- 172.21.15.103:0/1496516586 shutdown_connections 2020-04-22T14:11:52.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.746+0000 7f2c6e4a1700 1 --2- 172.21.15.103:0/1496516586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c480044d0 0x7f2c48004950 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:52.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.746+0000 7f2c6e4a1700 1 -- 172.21.15.103:0/1496516586 >> 172.21.15.103:0/1496516586 conn(0x7f2c6805f2c0 msgr2=0x7f2c680bcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:52.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.746+0000 7f2c6e4a1700 1 -- 172.21.15.103:0/1496516586 shutdown_connections 2020-04-22T14:11:52.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.746+0000 7f2c6e4a1700 1 -- 172.21.15.103:0/1496516586 wait complete. 2020-04-22T14:11:52.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.747+0000 7f2c6e4a1700 1 Processor -- start 2020-04-22T14:11:52.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.747+0000 7f2c6e4a1700 1 -- start start 2020-04-22T14:11:52.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.748+0000 7f2c6e4a1700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2c6813f830 0x7f2c680b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:52.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.748+0000 7f2c6e4a1700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c681580f0 con 0x7f2c480044d0 2020-04-22T14:11:52.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.748+0000 7f2c6e4a1700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c680b2a90 con 0x7f2c681437b0 2020-04-22T14:11:52.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.748+0000 7f2c6e4a1700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c6813fc40 con 0x7f2c6813f830 2020-04-22T14:11:52.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.748+0000 7f2c5ffff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f2c681437b0 0x7f2c680bb440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44424/0 (socket says 172.21.15.103:44424) 2020-04-22T14:11:52.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.748+0000 7f2c5ffff700 1 -- 172.21.15.103:0/727431893 learned_addr learned my addr 172.21.15.103:0/727431893 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:52.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.748+0000 7f2c6ca3e700 1 --2- 172.21.15.103:0/727431893 >> v2:172.21.15.103:3300/0 conn(0x7f2c6813f830 0x7f2c680b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:52.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.748+0000 7f2c6ca3e700 1 -- 172.21.15.103:0/727431893 >> v1:172.21.15.103:6789/0 conn(0x7f2c681437b0 legacy=0x7f2c680bb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:52.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.748+0000 7f2c65ffb700 1 -- 172.21.15.103:0/727431893 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2224145673 0 0) 0x7f2c681580f0 con 0x7f2c480044d0 2020-04-22T14:11:52.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.748+0000 7f2c6ca3e700 1 -- 172.21.15.103:0/727431893 >> v1:172.21.15.86:6789/0 conn(0x7f2c480044d0 legacy=0x7f2c680af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:52.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.748+0000 7f2c6ca3e700 1 -- 172.21.15.103:0/727431893 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c680afdd0 con 0x7f2c6813f830 2020-04-22T14:11:52.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.748+0000 7f2c6ca3e700 1 --2- 172.21.15.103:0/727431893 >> v2:172.21.15.103:3300/0 conn(0x7f2c6813f830 0x7f2c680b2f30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2c500010d0 tx=0x7f2c60010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:52.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.748+0000 7f2c6ca3e700 1 --2- 172.21.15.103:0/727431893 >> v2:172.21.15.103:3300/0 conn(0x7f2c6813f830 0x7f2c680b2f30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2c500010d0 tx=0x7f2c60010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:52.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.748+0000 7f2c6ca3e700 1 --2- 172.21.15.103:0/727431893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c6813f830 0x7f2c680b2f30 secure :-1 s=READY pgs=979 cs=0 l=1 rx=0x7f2c500010d0 tx=0x7f2c60010a50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:52.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.748+0000 7f2c6ca3e700 1 --2- 172.21.15.103:0/727431893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c6813f830 0x7f2c680b2f30 secure :-1 s=THROTTLE_DONE pgs=979 cs=0 l=1 rx=0x7f2c500010d0 tx=0x7f2c60010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:52.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.748+0000 7f2c6ca3e700 1 --2- 172.21.15.103:0/727431893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c6813f830 0x7f2c680b2f30 secure :-1 s=THROTTLE_DONE pgs=979 cs=0 l=1 rx=0x7f2c500010d0 tx=0x7f2c60010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:52.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.748+0000 7f2c65ffb700 1 -- 172.21.15.103:0/727431893 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c60002220 con 0x7f2c6813f830 2020-04-22T14:11:52.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.748+0000 7f2c6ca3e700 1 --2- 172.21.15.103:0/727431893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c6813f830 0x7f2c680b2f30 secure :-1 s=THROTTLE_DONE pgs=979 cs=0 l=1 rx=0x7f2c500010d0 tx=0x7f2c60010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:52.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.748+0000 7f2c65ffb700 1 -- 172.21.15.103:0/727431893 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c60002380 con 0x7f2c6813f830 2020-04-22T14:11:52.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.749+0000 7f2c6e4a1700 1 -- 172.21.15.103:0/727431893 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c680b2780 con 0x7f2c6813f830 2020-04-22T14:11:52.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.749+0000 7f2c65ffb700 1 -- 172.21.15.103:0/727431893 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c600026e0 con 0x7f2c6813f830 2020-04-22T14:11:52.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.749+0000 7f2c6e4a1700 1 -- 172.21.15.103:0/727431893 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c68157d30 con 0x7f2c6813f830 2020-04-22T14:11:52.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.749+0000 7f2c6ca3e700 1 --2- 172.21.15.103:0/727431893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c6813f830 0x7f2c680b2f30 secure :-1 s=THROTTLE_DONE pgs=979 cs=0 l=1 rx=0x7f2c500010d0 tx=0x7f2c60010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:52.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.750+0000 7f2c6e4a1700 1 -- 172.21.15.103:0/727431893 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c680b2c20 con 0x7f2c6813f830 2020-04-22T14:11:52.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.750+0000 7f2c65ffb700 1 -- 172.21.15.103:0/727431893 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f2c60002840 con 0x7f2c6813f830 2020-04-22T14:11:52.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.750+0000 7f2c6ca3e700 1 --2- 172.21.15.103:0/727431893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c6813f830 0x7f2c680b2f30 secure :-1 s=THROTTLE_DONE pgs=979 cs=0 l=1 rx=0x7f2c500010d0 tx=0x7f2c60010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:52.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.750+0000 7f2c65ffb700 1 --2- 172.21.15.103:0/727431893 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2c4c04d760 0x7f2c4c04fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:52.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.750+0000 7f2c65ffb700 1 -- 172.21.15.103:0/727431893 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f2c60061200 con 0x7f2c6813f830 2020-04-22T14:11:52.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.750+0000 7f2c67fff700 1 --2- 172.21.15.103:0/727431893 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2c4c04d760 0x7f2c4c04fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:52.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.750+0000 7f2c67fff700 1 --2- 172.21.15.103:0/727431893 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2c4c04d760 0x7f2c4c04fc20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2c58002ed0 tx=0x7f2c5800c930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:52.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.751+0000 7f2c67fff700 1 --2- 172.21.15.103:0/727431893 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2c4c04d760 0x7f2c4c04fc20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2c58002ed0 tx=0x7f2c5800c930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:52.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.751+0000 7f2c67fff700 1 --2- 172.21.15.103:0/727431893 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2c4c04d760 0x7f2c4c04fc20 secure :-1 s=READY pgs=367 cs=0 l=1 rx=0x7f2c58002ed0 tx=0x7f2c5800c930).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:52.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.754+0000 7f2c6ca3e700 1 --2- 172.21.15.103:0/727431893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c6813f830 0x7f2c680b2f30 secure :-1 s=THROTTLE_DONE pgs=979 cs=0 l=1 rx=0x7f2c500010d0 tx=0x7f2c60010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:52.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.754+0000 7f2c65ffb700 1 -- 172.21.15.103:0/727431893 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f2c6003c580 con 0x7f2c6813f830 2020-04-22T14:11:52.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.942+0000 7f2c6e4a1700 1 -- 172.21.15.103:0/727431893 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c68056c90 con 0x7f2c6813f830 2020-04-22T14:11:52.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.943+0000 7f2c6ca3e700 1 --2- 172.21.15.103:0/727431893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c6813f830 0x7f2c680b2f30 secure :-1 s=THROTTLE_DONE pgs=979 cs=0 l=1 rx=0x7f2c500010d0 tx=0x7f2c60010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:52.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.943+0000 7f2c65ffb700 1 -- 172.21.15.103:0/727431893 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f2c6003fba0 con 0x7f2c6813f830 2020-04-22T14:11:52.945 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:52.946 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/1837726033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1837726033},{"type":"v1","addr":"172.21.15.86:6835","nonce":1837726033}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:03.499587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:11:52.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.944+0000 7f2c6e4a1700 1 -- 172.21.15.103:0/727431893 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2c4c04d760 msgr2=0x7f2c4c04fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:52.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.944+0000 7f2c6e4a1700 1 --2- 172.21.15.103:0/727431893 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2c4c04d760 0x7f2c4c04fc20 secure :-1 s=READY pgs=367 cs=0 l=1 rx=0x7f2c58002ed0 tx=0x7f2c5800c930).stop 2020-04-22T14:11:52.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.944+0000 7f2c6e4a1700 1 -- 172.21.15.103:0/727431893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c6813f830 msgr2=0x7f2c680b2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:52.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.944+0000 7f2c6e4a1700 1 --2- 172.21.15.103:0/727431893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c6813f830 0x7f2c680b2f30 secure :-1 s=READY pgs=979 cs=0 l=1 rx=0x7f2c500010d0 tx=0x7f2c60010a50).stop 2020-04-22T14:11:52.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.944+0000 7f2c6e4a1700 1 -- 172.21.15.103:0/727431893 shutdown_connections 2020-04-22T14:11:52.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.944+0000 7f2c6e4a1700 1 --2- 172.21.15.103:0/727431893 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2c4c04d760 0x7f2c4c04fc20 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:52.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.944+0000 7f2c6e4a1700 1 --2- 172.21.15.103:0/727431893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c6813f830 0x7f2c680b2f30 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:52.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.944+0000 7f2c6e4a1700 1 -- 172.21.15.103:0/727431893 >> 172.21.15.103:0/727431893 conn(0x7f2c6805f2c0 msgr2=0x7f2c680adc40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:52.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.944+0000 7f2c6e4a1700 1 -- 172.21.15.103:0/727431893 shutdown_connections 2020-04-22T14:11:52.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:52.944+0000 7f2c6e4a1700 1 -- 172.21.15.103:0/727431893 wait complete. 2020-04-22T14:11:52.948 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 41 2020-04-22T14:11:52.956 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:11:53.957 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:53.974 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:11:54.132 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.130+0000 7fcb005c8700 1 Processor -- start 2020-04-22T14:11:54.132 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.130+0000 7fcb005c8700 1 -- start start 2020-04-22T14:11:54.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.131+0000 7fcb005c8700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcaf8065fe0 0x7fcaf81464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:54.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.131+0000 7fcb005c8700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcaf8063e30 0x7fcaf80642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:54.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.131+0000 7fcb005c8700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaf8143300 con 0x7fcaf812c0d0 2020-04-22T14:11:54.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.131+0000 7fcb005c8700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaf81435a0 con 0x7fcaf8065fe0 2020-04-22T14:11:54.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.131+0000 7fcb005c8700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf8143840 con 0x7fcaf8063e30 2020-04-22T14:11:54.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.131+0000 7fcafe364700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fcaf812c0d0 0x7fcaf805b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44430/0 (socket says 172.21.15.103:44430) 2020-04-22T14:11:54.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.131+0000 7fcafe364700 1 -- 172.21.15.103:0/403554236 learned_addr learned my addr 172.21.15.103:0/403554236 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:54.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.131+0000 7fcafeb65700 1 --2- 172.21.15.103:0/403554236 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcaf8063e30 0x7fcaf80642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:54.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.131+0000 7fcafdb63700 1 --2- 172.21.15.103:0/403554236 >> v2:172.21.15.86:3300/0 conn(0x7fcaf8065fe0 0x7fcaf81464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:54.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.131+0000 7fcafd362700 1 -- 172.21.15.103:0/403554236 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3018429038 0 0) 0x7fcaf8143300 con 0x7fcaf812c0d0 2020-04-22T14:11:54.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.131+0000 7fcafd362700 1 -- 172.21.15.103:0/403554236 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcae0003230 con 0x7fcaf812c0d0 2020-04-22T14:11:54.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.131+0000 7fcafd362700 1 -- 172.21.15.103:0/403554236 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 774090774 0 0) 0x7fcae0003230 con 0x7fcaf812c0d0 2020-04-22T14:11:54.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.132+0000 7fcafd362700 1 -- 172.21.15.103:0/403554236 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcaf8063e30 msgr2=0x7fcaf80642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:54.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.132+0000 7fcafd362700 1 --2- 172.21.15.103:0/403554236 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcaf8063e30 0x7fcaf80642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:54.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.132+0000 7fcafd362700 1 -- 172.21.15.103:0/403554236 >> v2:172.21.15.86:3300/0 conn(0x7fcaf8065fe0 msgr2=0x7fcaf81464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:54.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.132+0000 7fcafd362700 1 --2- 172.21.15.103:0/403554236 >> v2:172.21.15.86:3300/0 conn(0x7fcaf8065fe0 0x7fcaf81464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:54.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.132+0000 7fcafd362700 1 -- 172.21.15.103:0/403554236 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf805bb50 con 0x7fcaf812c0d0 2020-04-22T14:11:54.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.132+0000 7fcafd362700 1 -- 172.21.15.103:0/403554236 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fcaec0016d0 con 0x7fcaf812c0d0 2020-04-22T14:11:54.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.132+0000 7fcafdb63700 1 --2- 172.21.15.103:0/403554236 >> v2:172.21.15.86:3300/0 conn(0x7fcaf8065fe0 0x7fcaf81464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:11:54.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.132+0000 7fcafd362700 1 -- 172.21.15.103:0/403554236 >> v1:172.21.15.103:6789/0 conn(0x7fcaf812c0d0 legacy=0x7fcaf805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:54.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.132+0000 7fcafd362700 1 --2- 172.21.15.103:0/403554236 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcae0003720 0x7fcae0003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:54.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.132+0000 7fcafd362700 1 --2- 172.21.15.103:0/403554236 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcaf8063e30 0x7fcae00044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:54.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.132+0000 7fcafd362700 1 --2- 172.21.15.103:0/403554236 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcae0004930 0x7fcae0004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:54.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.132+0000 7fcafd362700 1 -- 172.21.15.103:0/403554236 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf81435a0 con 0x7fcae0003720 2020-04-22T14:11:54.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.132+0000 7fcafd362700 1 -- 172.21.15.103:0/403554236 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf8143840 con 0x7fcae0004930 2020-04-22T14:11:54.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.132+0000 7fcafd362700 1 -- 172.21.15.103:0/403554236 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae00040f0 con 0x7fcaf8063e30 2020-04-22T14:11:54.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.132+0000 7fcafeb65700 1 --2- 172.21.15.103:0/403554236 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcae0004930 0x7fcae0004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:54.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.132+0000 7fcafdb63700 1 --2- 172.21.15.103:0/403554236 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcaf8063e30 0x7fcae00044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:54.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.132+0000 7fcafe364700 1 --2- 172.21.15.103:0/403554236 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcae0003720 0x7fcae0003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:54.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.132+0000 7fcafeb65700 1 -- 172.21.15.103:0/403554236 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcaf8063e30 msgr2=0x7fcae00044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:54.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.132+0000 7fcafeb65700 1 --2- 172.21.15.103:0/403554236 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcaf8063e30 0x7fcae00044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:54.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.132+0000 7fcafeb65700 1 -- 172.21.15.103:0/403554236 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcae0003720 msgr2=0x7fcae0003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:54.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.132+0000 7fcafeb65700 1 --2- 172.21.15.103:0/403554236 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcae0003720 0x7fcae0003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:54.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.132+0000 7fcafeb65700 1 -- 172.21.15.103:0/403554236 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae0003230 con 0x7fcae0004930 2020-04-22T14:11:54.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.132+0000 7fcafe364700 1 --2- 172.21.15.103:0/403554236 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcae0003720 0x7fcae0003b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:11:54.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.132+0000 7fcafeb65700 1 --2- 172.21.15.103:0/403554236 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcae0004930 0x7fcae0004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcaf00032b0 tx=0x7fcaf00103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:54.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.132+0000 7fcafeb65700 1 --2- 172.21.15.103:0/403554236 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcae0004930 0x7fcae0004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcaf00032b0 tx=0x7fcaf00103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:54.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.132+0000 7fcafeb65700 1 --2- 172.21.15.103:0/403554236 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcae0004930 0x7fcae0004db0 secure :-1 s=READY pgs=981 cs=0 l=1 rx=0x7fcaf00032b0 tx=0x7fcaf00103a0).ready entity=mon.1 client_cookie=9e38846f281dc492 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:54.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.132+0000 7fcafeb65700 1 --2- 172.21.15.103:0/403554236 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcae0004930 0x7fcae0004db0 secure :-1 s=THROTTLE_DONE pgs=981 cs=0 l=1 rx=0x7fcaf00032b0 tx=0x7fcaf00103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:54.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.132+0000 7fcafd362700 1 -- 172.21.15.103:0/403554236 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcaf0005c30 con 0x7fcae0004930 2020-04-22T14:11:54.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.132+0000 7fcafeb65700 1 --2- 172.21.15.103:0/403554236 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcae0004930 0x7fcae0004db0 secure :-1 s=THROTTLE_DONE pgs=981 cs=0 l=1 rx=0x7fcaf00032b0 tx=0x7fcaf00103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:54.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.132+0000 7fcafeb65700 1 --2- 172.21.15.103:0/403554236 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcae0004930 0x7fcae0004db0 secure :-1 s=THROTTLE_DONE pgs=981 cs=0 l=1 rx=0x7fcaf00032b0 tx=0x7fcaf00103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:54.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.132+0000 7fcafd362700 1 -- 172.21.15.103:0/403554236 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf0005d90 con 0x7fcae0004930 2020-04-22T14:11:54.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.132+0000 7fcafd362700 1 -- 172.21.15.103:0/403554236 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcaf00112c0 con 0x7fcae0004930 2020-04-22T14:11:54.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.132+0000 7fcb005c8700 1 -- 172.21.15.103:0/403554236 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcae0004930 msgr2=0x7fcae0004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:54.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.132+0000 7fcb005c8700 1 --2- 172.21.15.103:0/403554236 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcae0004930 0x7fcae0004db0 secure :-1 s=READY pgs=981 cs=0 l=1 rx=0x7fcaf00032b0 tx=0x7fcaf00103a0).stop 2020-04-22T14:11:54.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.132+0000 7fcafeb65700 1 -- 172.21.15.103:0/403554236 reap_dead start 2020-04-22T14:11:54.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.133+0000 7fcb005c8700 1 -- 172.21.15.103:0/403554236 shutdown_connections 2020-04-22T14:11:54.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.133+0000 7fcb005c8700 1 -- 172.21.15.103:0/403554236 >> 172.21.15.103:0/403554236 conn(0x7fcaf80b9160 msgr2=0x7fcaf805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:54.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.133+0000 7fcb005c8700 1 -- 172.21.15.103:0/403554236 shutdown_connections 2020-04-22T14:11:54.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.133+0000 7fcb005c8700 1 -- 172.21.15.103:0/403554236 wait complete. 2020-04-22T14:11:54.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.134+0000 7fcb005c8700 1 Processor -- start 2020-04-22T14:11:54.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.134+0000 7fcb005c8700 1 -- start start 2020-04-22T14:11:54.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.135+0000 7fcb005c8700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcaf814d2d0 0x7fcaf812b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:54.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.135+0000 7fcb005c8700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaf814b890 con 0x7fcaf8149c00 2020-04-22T14:11:54.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.135+0000 7fcb005c8700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaf80aeca0 con 0x7fcaf8149820 2020-04-22T14:11:54.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.135+0000 7fcb005c8700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf80aeac0 con 0x7fcaf814d2d0 2020-04-22T14:11:54.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.135+0000 7fcafe364700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fcaf8149820 0x7fcaf814aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44440/0 (socket says 172.21.15.103:44440) 2020-04-22T14:11:54.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.135+0000 7fcafe364700 1 -- 172.21.15.103:0/3732163090 learned_addr learned my addr 172.21.15.103:0/3732163090 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:54.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.135+0000 7fcafeb65700 1 --2- 172.21.15.103:0/3732163090 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcaf814d2d0 0x7fcaf812b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:54.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.135+0000 7fcaeb7fe700 1 -- 172.21.15.103:0/3732163090 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4199465640 0 0) 0x7fcaf80aeca0 con 0x7fcaf8149820 2020-04-22T14:11:54.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.135+0000 7fcaeb7fe700 1 -- 172.21.15.103:0/3732163090 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcad8002fe0 con 0x7fcaf8149820 2020-04-22T14:11:54.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.135+0000 7fcaeb7fe700 1 -- 172.21.15.103:0/3732163090 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1507838001 0 0) 0x7fcaf814b890 con 0x7fcaf8149c00 2020-04-22T14:11:54.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.135+0000 7fcaeb7fe700 1 -- 172.21.15.103:0/3732163090 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcaf80aeca0 con 0x7fcaf8149c00 2020-04-22T14:11:54.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.135+0000 7fcaeb7fe700 1 -- 172.21.15.103:0/3732163090 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1445318072 0 0) 0x7fcad8002fe0 con 0x7fcaf8149820 2020-04-22T14:11:54.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.135+0000 7fcafeb65700 1 -- 172.21.15.103:0/3732163090 >> v1:172.21.15.103:6789/0 conn(0x7fcaf8149820 legacy=0x7fcaf814aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:54.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.135+0000 7fcafeb65700 1 -- 172.21.15.103:0/3732163090 >> v1:172.21.15.86:6789/0 conn(0x7fcaf8149c00 legacy=0x7fcaf814b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:54.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.135+0000 7fcafeb65700 1 -- 172.21.15.103:0/3732163090 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf80aef40 con 0x7fcaf814d2d0 2020-04-22T14:11:54.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.135+0000 7fcafeb65700 1 --2- 172.21.15.103:0/3732163090 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcaf814d2d0 0x7fcaf812b4f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcaec000f50 tx=0x7fcaf00103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:54.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.135+0000 7fcafeb65700 1 --2- 172.21.15.103:0/3732163090 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcaf814d2d0 0x7fcaf812b4f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcaec000f50 tx=0x7fcaf00103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:54.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.135+0000 7fcafeb65700 1 --2- 172.21.15.103:0/3732163090 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcaf814d2d0 0x7fcaf812b4f0 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7fcaec000f50 tx=0x7fcaf00103a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:54.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.135+0000 7fcafeb65700 1 --2- 172.21.15.103:0/3732163090 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcaf814d2d0 0x7fcaf812b4f0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7fcaec000f50 tx=0x7fcaf00103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:54.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.135+0000 7fcaeb7fe700 1 -- 172.21.15.103:0/3732163090 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcaec0047a0 con 0x7fcaf814d2d0 2020-04-22T14:11:54.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.136+0000 7fcafeb65700 1 --2- 172.21.15.103:0/3732163090 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcaf814d2d0 0x7fcaf812b4f0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7fcaec000f50 tx=0x7fcaf00103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:54.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.136+0000 7fcafeb65700 1 --2- 172.21.15.103:0/3732163090 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcaf814d2d0 0x7fcaf812b4f0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7fcaec000f50 tx=0x7fcaf00103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:54.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.136+0000 7fcaeb7fe700 1 -- 172.21.15.103:0/3732163090 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf000fbc0 con 0x7fcaf814d2d0 2020-04-22T14:11:54.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.136+0000 7fcb005c8700 1 -- 172.21.15.103:0/3732163090 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaf812b000 con 0x7fcaf814d2d0 2020-04-22T14:11:54.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.136+0000 7fcaeb7fe700 1 -- 172.21.15.103:0/3732163090 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcaf0005c30 con 0x7fcaf814d2d0 2020-04-22T14:11:54.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.136+0000 7fcb005c8700 1 -- 172.21.15.103:0/3732163090 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaf80b5e60 con 0x7fcaf814d2d0 2020-04-22T14:11:54.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.136+0000 7fcafeb65700 1 --2- 172.21.15.103:0/3732163090 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcaf814d2d0 0x7fcaf812b4f0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7fcaec000f50 tx=0x7fcaf00103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:54.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.137+0000 7fcb005c8700 1 -- 172.21.15.103:0/3732163090 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaf8056c90 con 0x7fcaf814d2d0 2020-04-22T14:11:54.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.137+0000 7fcaeb7fe700 1 -- 172.21.15.103:0/3732163090 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fcaf0014240 con 0x7fcaf814d2d0 2020-04-22T14:11:54.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.137+0000 7fcafeb65700 1 --2- 172.21.15.103:0/3732163090 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcaf814d2d0 0x7fcaf812b4f0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7fcaec000f50 tx=0x7fcaf00103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:54.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.137+0000 7fcaeb7fe700 1 --2- 172.21.15.103:0/3732163090 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcad804de10 0x7fcad80502d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:54.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.137+0000 7fcaeb7fe700 1 -- 172.21.15.103:0/3732163090 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6202+0+0 (secure 0 0 0) 0x7fcaf0061300 con 0x7fcaf814d2d0 2020-04-22T14:11:54.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.137+0000 7fcafe364700 1 --2- 172.21.15.103:0/3732163090 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcad804de10 0x7fcad80502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:54.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.137+0000 7fcafe364700 1 --2- 172.21.15.103:0/3732163090 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcad804de10 0x7fcad80502d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcaec001930 tx=0x7fcaf805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:54.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.137+0000 7fcafe364700 1 --2- 172.21.15.103:0/3732163090 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcad804de10 0x7fcad80502d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcaec001930 tx=0x7fcaf805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:54.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.137+0000 7fcafe364700 1 --2- 172.21.15.103:0/3732163090 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcad804de10 0x7fcad80502d0 secure :-1 s=READY pgs=368 cs=0 l=1 rx=0x7fcaec001930 tx=0x7fcaf805bce0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:54.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.141+0000 7fcafeb65700 1 --2- 172.21.15.103:0/3732163090 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcaf814d2d0 0x7fcaf812b4f0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7fcaec000f50 tx=0x7fcaf00103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:54.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.141+0000 7fcaeb7fe700 1 -- 172.21.15.103:0/3732163090 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fcaf003c6e0 con 0x7fcaf814d2d0 2020-04-22T14:11:54.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.329+0000 7fcb005c8700 1 -- 172.21.15.103:0/3732163090 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcaf80663c0 con 0x7fcaf814d2d0 2020-04-22T14:11:54.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.330+0000 7fcafeb65700 1 --2- 172.21.15.103:0/3732163090 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcaf814d2d0 0x7fcaf812b4f0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7fcaec000f50 tx=0x7fcaf00103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:54.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.330+0000 7fcaeb7fe700 1 -- 172.21.15.103:0/3732163090 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+2145 (secure 0 0 0) 0x7fcaf003fd00 con 0x7fcaf814d2d0 2020-04-22T14:11:54.332 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:54.333 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/1837726033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1837726033},{"type":"v1","addr":"172.21.15.86:6835","nonce":1837726033}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:53.376259+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:rejoin","state_seq":15,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:11:54.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.331+0000 7fcb005c8700 1 -- 172.21.15.103:0/3732163090 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcad804de10 msgr2=0x7fcad80502d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:54.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.331+0000 7fcb005c8700 1 --2- 172.21.15.103:0/3732163090 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcad804de10 0x7fcad80502d0 secure :-1 s=READY pgs=368 cs=0 l=1 rx=0x7fcaec001930 tx=0x7fcaf805bce0).stop 2020-04-22T14:11:54.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.331+0000 7fcb005c8700 1 -- 172.21.15.103:0/3732163090 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcaf814d2d0 msgr2=0x7fcaf812b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:54.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.331+0000 7fcb005c8700 1 --2- 172.21.15.103:0/3732163090 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcaf814d2d0 0x7fcaf812b4f0 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7fcaec000f50 tx=0x7fcaf00103a0).stop 2020-04-22T14:11:54.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.331+0000 7fcb005c8700 1 -- 172.21.15.103:0/3732163090 shutdown_connections 2020-04-22T14:11:54.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.331+0000 7fcb005c8700 1 --2- 172.21.15.103:0/3732163090 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcad804de10 0x7fcad80502d0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:54.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.331+0000 7fcb005c8700 1 --2- 172.21.15.103:0/3732163090 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcaf814d2d0 0x7fcaf812b4f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:54.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.331+0000 7fcb005c8700 1 -- 172.21.15.103:0/3732163090 >> 172.21.15.103:0/3732163090 conn(0x7fcaf80b9160 msgr2=0x7fcaf80615e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:54.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.331+0000 7fcb005c8700 1 -- 172.21.15.103:0/3732163090 shutdown_connections 2020-04-22T14:11:54.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:54.331+0000 7fcb005c8700 1 -- 172.21.15.103:0/3732163090 wait complete. 2020-04-22T14:11:54.335 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 42 2020-04-22T14:11:54.343 INFO:tasks.cephfs.filesystem:mapped states [u'up:rejoin'] to None 2020-04-22T14:11:55.345 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:55.362 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:11:55.517 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.515+0000 7fb050f03700 1 Processor -- start 2020-04-22T14:11:55.517 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.515+0000 7fb050f03700 1 -- start start 2020-04-22T14:11:55.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.516+0000 7fb050f03700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb04c12c0d0 0x7fb04c1464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:55.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.516+0000 7fb050f03700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb04c065fe0 0x7fb04c05b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:55.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.516+0000 7fb050f03700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb04c05b8a0 0x7fb04c062ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:55.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.516+0000 7fb050f03700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb04c12c4b0 con 0x7fb04c05b8a0 2020-04-22T14:11:55.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.516+0000 7fb050f03700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb04c143300 con 0x7fb04c065fe0 2020-04-22T14:11:55.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.516+0000 7fb050f03700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c1435a0 con 0x7fb04c12c0d0 2020-04-22T14:11:55.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.516+0000 7fb049d9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb04c065fe0 0x7fb04c05b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:55.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.516+0000 7fb049d9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb04c065fe0 0x7fb04c05b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52260/0 (socket says 172.21.15.103:52260) 2020-04-22T14:11:55.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.516+0000 7fb049d9b700 1 -- 172.21.15.103:0/3527066014 learned_addr learned my addr 172.21.15.103:0/3527066014 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:55.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.516+0000 7fb04ad9d700 1 --2- 172.21.15.103:0/3527066014 >> v2:172.21.15.86:3300/0 conn(0x7fb04c05b8a0 0x7fb04c062ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:55.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.516+0000 7fb04a59c700 1 --2- 172.21.15.103:0/3527066014 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb04c12c0d0 0x7fb04c1464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:55.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.516+0000 7fb049d9b700 1 -- 172.21.15.103:0/3527066014 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb04c12c0d0 msgr2=0x7fb04c1464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:55.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.516+0000 7fb049d9b700 1 --2- 172.21.15.103:0/3527066014 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb04c12c0d0 0x7fb04c1464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:55.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.516+0000 7fb049d9b700 1 -- 172.21.15.103:0/3527066014 >> v2:172.21.15.86:3300/0 conn(0x7fb04c05b8a0 msgr2=0x7fb04c062ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:55.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.516+0000 7fb049d9b700 1 --2- 172.21.15.103:0/3527066014 >> v2:172.21.15.86:3300/0 conn(0x7fb04c05b8a0 0x7fb04c062ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:55.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.517+0000 7fb049d9b700 1 -- 172.21.15.103:0/3527066014 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04c143840 con 0x7fb04c065fe0 2020-04-22T14:11:55.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.517+0000 7fb04ad9d700 1 --2- 172.21.15.103:0/3527066014 >> v2:172.21.15.86:3300/0 conn(0x7fb04c05b8a0 0x7fb04c062ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:11:55.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.517+0000 7fb049d9b700 1 --2- 172.21.15.103:0/3527066014 >> v2:172.21.15.103:3300/0 conn(0x7fb04c065fe0 0x7fb04c05b440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb03c002f30 tx=0x7fb03c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:55.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.517+0000 7fb049d9b700 1 --2- 172.21.15.103:0/3527066014 >> v2:172.21.15.103:3300/0 conn(0x7fb04c065fe0 0x7fb04c05b440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb03c002f30 tx=0x7fb03c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:55.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.517+0000 7fb049d9b700 1 --2- 172.21.15.103:0/3527066014 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb04c065fe0 0x7fb04c05b440 secure :-1 s=READY pgs=983 cs=0 l=1 rx=0x7fb03c002f30 tx=0x7fb03c007a40).ready entity=mon.1 client_cookie=9c691bbfff97b17b server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:55.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.517+0000 7fb049d9b700 1 --2- 172.21.15.103:0/3527066014 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb04c065fe0 0x7fb04c05b440 secure :-1 s=THROTTLE_DONE pgs=983 cs=0 l=1 rx=0x7fb03c002f30 tx=0x7fb03c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:55.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.517+0000 7fb04959a700 1 -- 172.21.15.103:0/3527066014 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb03c011720 con 0x7fb04c065fe0 2020-04-22T14:11:55.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.517+0000 7fb049d9b700 1 --2- 172.21.15.103:0/3527066014 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb04c065fe0 0x7fb04c05b440 secure :-1 s=THROTTLE_DONE pgs=983 cs=0 l=1 rx=0x7fb03c002f30 tx=0x7fb03c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:55.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.517+0000 7fb04959a700 1 -- 172.21.15.103:0/3527066014 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03c011880 con 0x7fb04c065fe0 2020-04-22T14:11:55.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.517+0000 7fb049d9b700 1 --2- 172.21.15.103:0/3527066014 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb04c065fe0 0x7fb04c05b440 secure :-1 s=THROTTLE_DONE pgs=983 cs=0 l=1 rx=0x7fb03c002f30 tx=0x7fb03c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:55.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.517+0000 7fb04959a700 1 -- 172.21.15.103:0/3527066014 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb03c011ca0 con 0x7fb04c065fe0 2020-04-22T14:11:55.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.517+0000 7fb050f03700 1 -- 172.21.15.103:0/3527066014 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb04c065fe0 msgr2=0x7fb04c05b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:55.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.517+0000 7fb050f03700 1 --2- 172.21.15.103:0/3527066014 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb04c065fe0 0x7fb04c05b440 secure :-1 s=READY pgs=983 cs=0 l=1 rx=0x7fb03c002f30 tx=0x7fb03c007a40).stop 2020-04-22T14:11:55.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.517+0000 7fb050f03700 1 -- 172.21.15.103:0/3527066014 shutdown_connections 2020-04-22T14:11:55.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.517+0000 7fb050f03700 1 --2- 172.21.15.103:0/3527066014 >> v2:172.21.15.86:3300/0 conn(0x7fb04c05b8a0 0x7fb04c062ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:55.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.517+0000 7fb050f03700 1 --2- 172.21.15.103:0/3527066014 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb04c12c0d0 0x7fb04c1464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:55.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.517+0000 7fb050f03700 1 --2- 172.21.15.103:0/3527066014 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb04c065fe0 0x7fb04c05b440 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:55.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.517+0000 7fb050f03700 1 -- 172.21.15.103:0/3527066014 >> 172.21.15.103:0/3527066014 conn(0x7fb04c0b9160 msgr2=0x7fb04c05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:55.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.517+0000 7fb050f03700 1 -- 172.21.15.103:0/3527066014 shutdown_connections 2020-04-22T14:11:55.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.517+0000 7fb050f03700 1 -- 172.21.15.103:0/3527066014 wait complete. 2020-04-22T14:11:55.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.518+0000 7fb050f03700 1 Processor -- start 2020-04-22T14:11:55.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.518+0000 7fb050f03700 1 -- start start 2020-04-22T14:11:55.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.519+0000 7fb050f03700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb04c05b8a0 0x7fb04c121a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:55.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.519+0000 7fb050f03700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb04c12c0d0 0x7fb04c142690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:55.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.519+0000 7fb050f03700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb04c0628f0 con 0x7fb04c065fe0 2020-04-22T14:11:55.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.519+0000 7fb050f03700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb04c1245a0 con 0x7fb04c12c0d0 2020-04-22T14:11:55.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.519+0000 7fb050f03700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c124840 con 0x7fb04c05b8a0 2020-04-22T14:11:55.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.519+0000 7fb04ad9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb04c12c0d0 0x7fb04c142690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:55.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.519+0000 7fb04ad9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb04c12c0d0 0x7fb04c142690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52268/0 (socket says 172.21.15.103:52268) 2020-04-22T14:11:55.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.519+0000 7fb04ad9d700 1 -- 172.21.15.103:0/1545674353 learned_addr learned my addr 172.21.15.103:0/1545674353 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:55.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.519+0000 7fb04a59c700 1 --2- 172.21.15.103:0/1545674353 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb04c05b8a0 0x7fb04c121a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:55.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.519+0000 7fb04ad9d700 1 -- 172.21.15.103:0/1545674353 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb04c05b8a0 msgr2=0x7fb04c121a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:55.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.519+0000 7fb04ad9d700 1 --2- 172.21.15.103:0/1545674353 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb04c05b8a0 0x7fb04c121a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:55.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.519+0000 7fb04ad9d700 1 -- 172.21.15.103:0/1545674353 >> v1:172.21.15.86:6789/0 conn(0x7fb04c065fe0 legacy=0x7fb04c141f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:55.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.519+0000 7fb04ad9d700 1 -- 172.21.15.103:0/1545674353 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04c063d30 con 0x7fb04c12c0d0 2020-04-22T14:11:55.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.520+0000 7fb04ad9d700 1 --2- 172.21.15.103:0/1545674353 >> v2:172.21.15.103:3300/0 conn(0x7fb04c12c0d0 0x7fb04c142690 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb0440032b0 tx=0x7fb044010e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:55.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.520+0000 7fb04ad9d700 1 --2- 172.21.15.103:0/1545674353 >> v2:172.21.15.103:3300/0 conn(0x7fb04c12c0d0 0x7fb04c142690 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb0440032b0 tx=0x7fb044010e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:55.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.520+0000 7fb04ad9d700 1 --2- 172.21.15.103:0/1545674353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb04c12c0d0 0x7fb04c142690 secure :-1 s=READY pgs=984 cs=0 l=1 rx=0x7fb0440032b0 tx=0x7fb044010e50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:55.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.520+0000 7fb04ad9d700 1 --2- 172.21.15.103:0/1545674353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb04c12c0d0 0x7fb04c142690 secure :-1 s=THROTTLE_DONE pgs=984 cs=0 l=1 rx=0x7fb0440032b0 tx=0x7fb044010e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:55.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.520+0000 7fb04ad9d700 1 --2- 172.21.15.103:0/1545674353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb04c12c0d0 0x7fb04c142690 secure :-1 s=THROTTLE_DONE pgs=984 cs=0 l=1 rx=0x7fb0440032b0 tx=0x7fb044010e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:55.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.520+0000 7fb03b7fe700 1 -- 172.21.15.103:0/1545674353 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb044005e30 con 0x7fb04c12c0d0 2020-04-22T14:11:55.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.520+0000 7fb04ad9d700 1 --2- 172.21.15.103:0/1545674353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb04c12c0d0 0x7fb04c142690 secure :-1 s=THROTTLE_DONE pgs=984 cs=0 l=1 rx=0x7fb0440032b0 tx=0x7fb044010e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:55.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.520+0000 7fb03b7fe700 1 -- 172.21.15.103:0/1545674353 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb044007560 con 0x7fb04c12c0d0 2020-04-22T14:11:55.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.520+0000 7fb050f03700 1 -- 172.21.15.103:0/1545674353 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb04c063f80 con 0x7fb04c12c0d0 2020-04-22T14:11:55.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.520+0000 7fb03b7fe700 1 -- 172.21.15.103:0/1545674353 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0440124f0 con 0x7fb04c12c0d0 2020-04-22T14:11:55.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.520+0000 7fb050f03700 1 -- 172.21.15.103:0/1545674353 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb04c147b20 con 0x7fb04c12c0d0 2020-04-22T14:11:55.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.521+0000 7fb04ad9d700 1 --2- 172.21.15.103:0/1545674353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb04c12c0d0 0x7fb04c142690 secure :-1 s=THROTTLE_DONE pgs=984 cs=0 l=1 rx=0x7fb0440032b0 tx=0x7fb044010e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:55.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.521+0000 7fb03b7fe700 1 -- 172.21.15.103:0/1545674353 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fb0440101a0 con 0x7fb04c12c0d0 2020-04-22T14:11:55.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.521+0000 7fb04ad9d700 1 --2- 172.21.15.103:0/1545674353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb04c12c0d0 0x7fb04c142690 secure :-1 s=THROTTLE_DONE pgs=984 cs=0 l=1 rx=0x7fb0440032b0 tx=0x7fb044010e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:55.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.521+0000 7fb050f03700 1 -- 172.21.15.103:0/1545674353 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb04c056c90 con 0x7fb04c12c0d0 2020-04-22T14:11:55.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.521+0000 7fb03b7fe700 1 --2- 172.21.15.103:0/1545674353 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb02804da20 0x7fb02804fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:55.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.521+0000 7fb03b7fe700 1 -- 172.21.15.103:0/1545674353 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6202+0+0 (secure 0 0 0) 0x7fb044061460 con 0x7fb04c12c0d0 2020-04-22T14:11:55.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.521+0000 7fb04a59c700 1 --2- 172.21.15.103:0/1545674353 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb02804da20 0x7fb02804fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:55.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.522+0000 7fb04a59c700 1 --2- 172.21.15.103:0/1545674353 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb02804da20 0x7fb02804fee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb040002f30 tx=0x7fb04000cf80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:55.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.522+0000 7fb04a59c700 1 --2- 172.21.15.103:0/1545674353 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb02804da20 0x7fb02804fee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb040002f30 tx=0x7fb04000cf80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:55.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.522+0000 7fb04a59c700 1 --2- 172.21.15.103:0/1545674353 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb02804da20 0x7fb02804fee0 secure :-1 s=READY pgs=369 cs=0 l=1 rx=0x7fb040002f30 tx=0x7fb04000cf80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:55.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.525+0000 7fb04ad9d700 1 --2- 172.21.15.103:0/1545674353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb04c12c0d0 0x7fb04c142690 secure :-1 s=THROTTLE_DONE pgs=984 cs=0 l=1 rx=0x7fb0440032b0 tx=0x7fb044010e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:55.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.525+0000 7fb03b7fe700 1 -- 172.21.15.103:0/1545674353 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fb04403c840 con 0x7fb04c12c0d0 2020-04-22T14:11:55.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.716+0000 7fb050f03700 1 -- 172.21.15.103:0/1545674353 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb04c147360 con 0x7fb04c12c0d0 2020-04-22T14:11:55.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.717+0000 7fb04ad9d700 1 --2- 172.21.15.103:0/1545674353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb04c12c0d0 0x7fb04c142690 secure :-1 s=THROTTLE_DONE pgs=984 cs=0 l=1 rx=0x7fb0440032b0 tx=0x7fb044010e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:55.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.717+0000 7fb03b7fe700 1 -- 172.21.15.103:0/1545674353 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+2145 (secure 0 0 0) 0x7fb04403fe60 con 0x7fb04c12c0d0 2020-04-22T14:11:55.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.718+0000 7fb050f03700 1 -- 172.21.15.103:0/1545674353 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb02804da20 msgr2=0x7fb02804fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:55.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.718+0000 7fb050f03700 1 --2- 172.21.15.103:0/1545674353 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb02804da20 0x7fb02804fee0 secure :-1 s=READY pgs=369 cs=0 l=1 rx=0x7fb040002f30 tx=0x7fb04000cf80).stop 2020-04-22T14:11:55.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.718+0000 7fb050f03700 1 -- 172.21.15.103:0/1545674353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb04c12c0d0 msgr2=0x7fb04c142690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:55.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.718+0000 7fb050f03700 1 --2- 172.21.15.103:0/1545674353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb04c12c0d0 0x7fb04c142690 secure :-1 s=READY pgs=984 cs=0 l=1 rx=0x7fb0440032b0 tx=0x7fb044010e50).stop 2020-04-22T14:11:55.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.718+0000 7fb050f03700 1 -- 172.21.15.103:0/1545674353 shutdown_connections 2020-04-22T14:11:55.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.718+0000 7fb050f03700 1 --2- 172.21.15.103:0/1545674353 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb02804da20 0x7fb02804fee0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:55.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.718+0000 7fb050f03700 1 --2- 172.21.15.103:0/1545674353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb04c12c0d0 0x7fb04c142690 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:55.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.718+0000 7fb050f03700 1 --2- 172.21.15.103:0/1545674353 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb04c05b8a0 0x7fb04c121a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:55.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.718+0000 7fb050f03700 1 -- 172.21.15.103:0/1545674353 >> 172.21.15.103:0/1545674353 conn(0x7fb04c0b9160 msgr2=0x7fb04c1254d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:55.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.718+0000 7fb050f03700 1 -- 172.21.15.103:0/1545674353 shutdown_connections 2020-04-22T14:11:55.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.718+0000 7fb050f03700 1 -- 172.21.15.103:0/1545674353 wait complete. 2020-04-22T14:11:55.724 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 43 2020-04-22T14:11:55.724 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:55.724 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/1837726033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1837726033},{"type":"v1","addr":"172.21.15.86:6835","nonce":1837726033}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:54.377522+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":16,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:11:55.736 INFO:tasks.cephfs.filesystem:mapped states [u'up:active'] to up:active 2020-04-22T14:11:55.736 INFO:tasks.cephfs.filesystem:reached state 'up:active' in 51.7647738457s 2020-04-22T14:11:55.736 INFO:tasks.cephfs.test_client_recovery:Reached active... 2020-04-22T14:11:55.736 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:55.751 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:11:55.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.893+0000 7f1745143700 1 Processor -- start 2020-04-22T14:11:55.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.893+0000 7f1745143700 1 -- start start 2020-04-22T14:11:55.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.894+0000 7f1745143700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f174012c0d0 0x7f17401464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:55.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.894+0000 7f1745143700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1740063e30 0x7f17400642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:55.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.894+0000 7f1745143700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1740143300 con 0x7f1740065fe0 2020-04-22T14:11:55.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.894+0000 7f1745143700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17401435a0 con 0x7f1740063e30 2020-04-22T14:11:55.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.894+0000 7f1745143700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1740143840 con 0x7f174012c0d0 2020-04-22T14:11:55.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.894+0000 7f173ed9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f174012c0d0 0x7f17401464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:55.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.894+0000 7f173ed9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f174012c0d0 0x7f17401464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52272/0 (socket says 172.21.15.103:52272) 2020-04-22T14:11:55.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.894+0000 7f173ed9d700 1 -- 172.21.15.103:0/2382922321 learned_addr learned my addr 172.21.15.103:0/2382922321 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:55.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.895+0000 7f173f59e700 1 --2- 172.21.15.103:0/2382922321 >> v2:172.21.15.86:3300/0 conn(0x7f1740063e30 0x7f17400642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:55.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.895+0000 7f173ed9d700 1 -- 172.21.15.103:0/2382922321 >> v2:172.21.15.86:3300/0 conn(0x7f1740063e30 msgr2=0x7f17400642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:55.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.895+0000 7f173ed9d700 1 --2- 172.21.15.103:0/2382922321 >> v2:172.21.15.86:3300/0 conn(0x7f1740063e30 0x7f17400642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:55.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.895+0000 7f173ed9d700 1 -- 172.21.15.103:0/2382922321 >> v1:172.21.15.86:6789/0 conn(0x7f1740065fe0 legacy=0x7f174005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:55.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.895+0000 7f173ed9d700 1 -- 172.21.15.103:0/2382922321 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f174005bb50 con 0x7f174012c0d0 2020-04-22T14:11:55.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.895+0000 7f173ed9d700 1 --2- 172.21.15.103:0/2382922321 >> v2:172.21.15.103:3300/0 conn(0x7f174012c0d0 0x7f17401464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f17400669a0 tx=0x7f1730007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:55.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.895+0000 7f173ed9d700 1 --2- 172.21.15.103:0/2382922321 >> v2:172.21.15.103:3300/0 conn(0x7f174012c0d0 0x7f17401464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f17400669a0 tx=0x7f1730007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:55.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.895+0000 7f173ed9d700 1 --2- 172.21.15.103:0/2382922321 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f174012c0d0 0x7f17401464e0 secure :-1 s=READY pgs=985 cs=0 l=1 rx=0x7f17400669a0 tx=0x7f1730007a40).ready entity=mon.1 client_cookie=b8591634602012f6 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:55.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.895+0000 7f173ed9d700 1 --2- 172.21.15.103:0/2382922321 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f174012c0d0 0x7f17401464e0 secure :-1 s=THROTTLE_DONE pgs=985 cs=0 l=1 rx=0x7f17400669a0 tx=0x7f1730007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:55.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.895+0000 7f173dd9b700 1 -- 172.21.15.103:0/2382922321 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17300116e0 con 0x7f174012c0d0 2020-04-22T14:11:55.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.895+0000 7f173ed9d700 1 --2- 172.21.15.103:0/2382922321 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f174012c0d0 0x7f17401464e0 secure :-1 s=THROTTLE_DONE pgs=985 cs=0 l=1 rx=0x7f17400669a0 tx=0x7f1730007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:55.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.895+0000 7f173ed9d700 1 --2- 172.21.15.103:0/2382922321 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f174012c0d0 0x7f17401464e0 secure :-1 s=THROTTLE_DONE pgs=985 cs=0 l=1 rx=0x7f17400669a0 tx=0x7f1730007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:55.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.895+0000 7f173dd9b700 1 -- 172.21.15.103:0/2382922321 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1730011840 con 0x7f174012c0d0 2020-04-22T14:11:55.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.895+0000 7f173dd9b700 1 -- 172.21.15.103:0/2382922321 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1730011c20 con 0x7f174012c0d0 2020-04-22T14:11:55.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.895+0000 7f1745143700 1 -- 172.21.15.103:0/2382922321 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f174012c0d0 msgr2=0x7f17401464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:55.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.895+0000 7f1745143700 1 --2- 172.21.15.103:0/2382922321 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f174012c0d0 0x7f17401464e0 secure :-1 s=READY pgs=985 cs=0 l=1 rx=0x7f17400669a0 tx=0x7f1730007a40).stop 2020-04-22T14:11:55.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.895+0000 7f1745143700 1 -- 172.21.15.103:0/2382922321 shutdown_connections 2020-04-22T14:11:55.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.895+0000 7f1745143700 1 --2- 172.21.15.103:0/2382922321 >> v2:172.21.15.86:3300/0 conn(0x7f1740063e30 0x7f17400642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:55.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.895+0000 7f1745143700 1 --2- 172.21.15.103:0/2382922321 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f174012c0d0 0x7f17401464e0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:55.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.895+0000 7f1745143700 1 -- 172.21.15.103:0/2382922321 >> 172.21.15.103:0/2382922321 conn(0x7f17400b9160 msgr2=0x7f174005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:55.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.896+0000 7f1745143700 1 -- 172.21.15.103:0/2382922321 shutdown_connections 2020-04-22T14:11:55.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.896+0000 7f1745143700 1 -- 172.21.15.103:0/2382922321 wait complete. 2020-04-22T14:11:55.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.896+0000 7f1745143700 1 Processor -- start 2020-04-22T14:11:55.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.896+0000 7f1745143700 1 -- start start 2020-04-22T14:11:55.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.897+0000 7f1745143700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1740063e30 0x7f17400aeb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:55.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.897+0000 7f1745143700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17400ae400 con 0x7f1740065fe0 2020-04-22T14:11:55.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.897+0000 7f1745143700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1740154ae0 con 0x7f174012c0d0 2020-04-22T14:11:55.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.897+0000 7f1745143700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17400ae080 con 0x7f1740063e30 2020-04-22T14:11:55.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.897+0000 7f173f59e700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f174012c0d0 0x7f17400b3f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44470/0 (socket says 172.21.15.103:44470) 2020-04-22T14:11:55.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.897+0000 7f173f59e700 1 -- 172.21.15.103:0/3893995272 learned_addr learned my addr 172.21.15.103:0/3893995272 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:55.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.897+0000 7f173ed9d700 1 --2- 172.21.15.103:0/3893995272 >> v2:172.21.15.86:3300/0 conn(0x7f1740063e30 0x7f17400aeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:55.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.897+0000 7f172ffff700 1 -- 172.21.15.103:0/3893995272 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4061196279 0 0) 0x7f1740154ae0 con 0x7f174012c0d0 2020-04-22T14:11:55.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.897+0000 7f172ffff700 1 -- 172.21.15.103:0/3893995272 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f171c002fe0 con 0x7f174012c0d0 2020-04-22T14:11:55.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.898+0000 7f172ffff700 1 -- 172.21.15.103:0/3893995272 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 493979312 0 0) 0x7f171c002fe0 con 0x7f174012c0d0 2020-04-22T14:11:55.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.898+0000 7f172ffff700 1 -- 172.21.15.103:0/3893995272 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1740154ae0 con 0x7f174012c0d0 2020-04-22T14:11:55.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.898+0000 7f172ffff700 1 -- 172.21.15.103:0/3893995272 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f17380018e0 con 0x7f174012c0d0 2020-04-22T14:11:55.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.898+0000 7f172ffff700 1 -- 172.21.15.103:0/3893995272 >> v2:172.21.15.86:3300/0 conn(0x7f1740063e30 msgr2=0x7f17400aeb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:55.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.898+0000 7f172ffff700 1 --2- 172.21.15.103:0/3893995272 >> v2:172.21.15.86:3300/0 conn(0x7f1740063e30 0x7f17400aeb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:55.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.898+0000 7f172ffff700 1 -- 172.21.15.103:0/3893995272 >> v1:172.21.15.103:6789/0 conn(0x7f174012c0d0 legacy=0x7f17400b3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:55.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.898+0000 7f172ffff700 1 -- 172.21.15.103:0/3893995272 >> v1:172.21.15.86:6789/0 conn(0x7f1740065fe0 legacy=0x7f1740154240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:55.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.898+0000 7f172ffff700 1 --2- 172.21.15.103:0/3893995272 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f171c0049b0 0x7f171c004db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:55.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.898+0000 7f172ffff700 1 --2- 172.21.15.103:0/3893995272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f171c003920 0x7f171c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:55.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.898+0000 7f172ffff700 1 --2- 172.21.15.103:0/3893995272 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f171c0041e0 0x7f171c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:55.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.898+0000 7f172ffff700 1 -- 172.21.15.103:0/3893995272 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17400ae080 con 0x7f171c0041e0 2020-04-22T14:11:55.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.898+0000 7f172ffff700 1 -- 172.21.15.103:0/3893995272 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f171c004780 con 0x7f171c003920 2020-04-22T14:11:55.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.898+0000 7f172ffff700 1 -- 172.21.15.103:0/3893995272 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f171c00bbb0 con 0x7f171c0049b0 2020-04-22T14:11:55.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.898+0000 7f173e59c700 1 --2- 172.21.15.103:0/3893995272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f171c003920 0x7f171c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:55.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.898+0000 7f173ed9d700 1 --2- 172.21.15.103:0/3893995272 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f171c0049b0 0x7f171c004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:55.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.898+0000 7f173f59e700 1 --2- 172.21.15.103:0/3893995272 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f171c0041e0 0x7f171c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:55.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.898+0000 7f173e59c700 1 -- 172.21.15.103:0/3893995272 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f171c0049b0 msgr2=0x7f171c004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:55.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.898+0000 7f173e59c700 1 --2- 172.21.15.103:0/3893995272 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f171c0049b0 0x7f171c004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:55.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.898+0000 7f173e59c700 1 -- 172.21.15.103:0/3893995272 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f171c0041e0 msgr2=0x7f171c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:55.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.898+0000 7f173e59c700 1 --2- 172.21.15.103:0/3893995272 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f171c0041e0 0x7f171c00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:55.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.898+0000 7f173f59e700 1 -- 172.21.15.103:0/3893995272 reap_dead start 2020-04-22T14:11:55.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.898+0000 7f173e59c700 1 -- 172.21.15.103:0/3893995272 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f171c002fe0 con 0x7f171c003920 2020-04-22T14:11:55.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.898+0000 7f1745143700 1 -- 172.21.15.103:0/3893995272 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17400b3b90 con 0x7f171c003920 2020-04-22T14:11:55.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.898+0000 7f173e59c700 1 --2- 172.21.15.103:0/3893995272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f171c003920 0x7f171c003d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f171c0048f0 tx=0x7f1734012a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:55.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.898+0000 7f1745143700 1 -- 172.21.15.103:0/3893995272 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17400aed50 con 0x7f171c003920 2020-04-22T14:11:55.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.898+0000 7f173e59c700 1 --2- 172.21.15.103:0/3893995272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f171c003920 0x7f171c003d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f171c0048f0 tx=0x7f1734012a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:55.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.898+0000 7f173e59c700 1 --2- 172.21.15.103:0/3893995272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f171c003920 0x7f171c003d80 secure :-1 s=READY pgs=987 cs=0 l=1 rx=0x7f171c0048f0 tx=0x7f1734012a50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:55.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.898+0000 7f173e59c700 1 --2- 172.21.15.103:0/3893995272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f171c003920 0x7f171c003d80 secure :-1 s=THROTTLE_DONE pgs=987 cs=0 l=1 rx=0x7f171c0048f0 tx=0x7f1734012a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:55.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.898+0000 7f172ffff700 1 -- 172.21.15.103:0/3893995272 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1734006cc0 con 0x7f171c003920 2020-04-22T14:11:55.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.898+0000 7f173e59c700 1 --2- 172.21.15.103:0/3893995272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f171c003920 0x7f171c003d80 secure :-1 s=THROTTLE_DONE pgs=987 cs=0 l=1 rx=0x7f171c0048f0 tx=0x7f1734012a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:55.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.898+0000 7f173e59c700 1 --2- 172.21.15.103:0/3893995272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f171c003920 0x7f171c003d80 secure :-1 s=THROTTLE_DONE pgs=987 cs=0 l=1 rx=0x7f171c0048f0 tx=0x7f1734012a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:55.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.898+0000 7f172ffff700 1 -- 172.21.15.103:0/3893995272 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1734006e20 con 0x7f171c003920 2020-04-22T14:11:55.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.898+0000 7f172ffff700 1 -- 172.21.15.103:0/3893995272 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f173400a4a0 con 0x7f171c003920 2020-04-22T14:11:55.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.899+0000 7f173e59c700 1 --2- 172.21.15.103:0/3893995272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f171c003920 0x7f171c003d80 secure :-1 s=THROTTLE_DONE pgs=987 cs=0 l=1 rx=0x7f171c0048f0 tx=0x7f1734012a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:55.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.899+0000 7f1745143700 1 -- 172.21.15.103:0/3893995272 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1720003340 con 0x7f171c003920 2020-04-22T14:11:55.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.899+0000 7f172ffff700 1 -- 172.21.15.103:0/3893995272 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f173400a600 con 0x7f171c003920 2020-04-22T14:11:55.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.899+0000 7f173e59c700 1 --2- 172.21.15.103:0/3893995272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f171c003920 0x7f171c003d80 secure :-1 s=THROTTLE_DONE pgs=987 cs=0 l=1 rx=0x7f171c0048f0 tx=0x7f1734012a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:55.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.900+0000 7f172ffff700 1 --2- 172.21.15.103:0/3893995272 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f171c051820 0x7f171c053ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:55.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.900+0000 7f172ffff700 1 -- 172.21.15.103:0/3893995272 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f1734063080 con 0x7f171c003920 2020-04-22T14:11:55.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.900+0000 7f173ed9d700 1 --2- 172.21.15.103:0/3893995272 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f171c051820 0x7f171c053ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:55.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.900+0000 7f173ed9d700 1 --2- 172.21.15.103:0/3893995272 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f171c051820 0x7f171c053ce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f17400669a0 tx=0x7f1730007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:55.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.900+0000 7f173ed9d700 1 --2- 172.21.15.103:0/3893995272 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f171c051820 0x7f171c053ce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f17400669a0 tx=0x7f1730007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:55.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.900+0000 7f173ed9d700 1 --2- 172.21.15.103:0/3893995272 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f171c051820 0x7f171c053ce0 secure :-1 s=READY pgs=370 cs=0 l=1 rx=0x7f17400669a0 tx=0x7f1730007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:55.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.904+0000 7f173e59c700 1 --2- 172.21.15.103:0/3893995272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f171c003920 0x7f171c003d80 secure :-1 s=THROTTLE_DONE pgs=987 cs=0 l=1 rx=0x7f171c0048f0 tx=0x7f1734012a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:55.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:55.904+0000 7f172ffff700 1 -- 172.21.15.103:0/3893995272 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f173403e520 con 0x7f171c003920 2020-04-22T14:11:56.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.049+0000 7f1745143700 1 -- 172.21.15.103:0/3893995272 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17200021d0 con 0x7f171c003920 2020-04-22T14:11:56.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.050+0000 7f173e59c700 1 --2- 172.21.15.103:0/3893995272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f171c003920 0x7f171c003d80 secure :-1 s=THROTTLE_DONE pgs=987 cs=0 l=1 rx=0x7f171c0048f0 tx=0x7f1734012a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.050+0000 7f172ffff700 1 -- 172.21.15.103:0/3893995272 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+16286 (secure 0 0 0) 0x7f1734041b40 con 0x7f171c003920 2020-04-22T14:11:56.053 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:56.053 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":67,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:11:52.372240+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:10:36.758101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2020-04-22T14:10:37.765010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.103:0/3218856707":"2020-04-22T15:11:52.279816+0000","172.21.15.103:6833/2152235919":"2020-04-23T14:10:59.132933+0000","172.21.15.103:6832/2152235919":"2020-04-23T14:10:59.132933+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:11:56.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.052+0000 7f1745143700 1 -- 172.21.15.103:0/3893995272 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f171c051820 msgr2=0x7f171c053ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:56.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.052+0000 7f1745143700 1 --2- 172.21.15.103:0/3893995272 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f171c051820 0x7f171c053ce0 secure :-1 s=READY pgs=370 cs=0 l=1 rx=0x7f17400669a0 tx=0x7f1730007a40).stop 2020-04-22T14:11:56.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.052+0000 7f1745143700 1 -- 172.21.15.103:0/3893995272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f171c003920 msgr2=0x7f171c003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:56.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.052+0000 7f1745143700 1 --2- 172.21.15.103:0/3893995272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f171c003920 0x7f171c003d80 secure :-1 s=READY pgs=987 cs=0 l=1 rx=0x7f171c0048f0 tx=0x7f1734012a50).stop 2020-04-22T14:11:56.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.052+0000 7f1745143700 1 -- 172.21.15.103:0/3893995272 shutdown_connections 2020-04-22T14:11:56.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.052+0000 7f1745143700 1 --2- 172.21.15.103:0/3893995272 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f171c051820 0x7f171c053ce0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:56.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.052+0000 7f1745143700 1 --2- 172.21.15.103:0/3893995272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f171c003920 0x7f171c003d80 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:56.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.052+0000 7f1745143700 1 -- 172.21.15.103:0/3893995272 >> 172.21.15.103:0/3893995272 conn(0x7f17400b9160 msgr2=0x7f1740064810 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:56.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.052+0000 7f1745143700 1 -- 172.21.15.103:0/3893995272 shutdown_connections 2020-04-22T14:11:56.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.052+0000 7f1745143700 1 -- 172.21.15.103:0/3893995272 wait complete. 2020-04-22T14:11:56.064 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:10:36.758101+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 11, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'63', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:10:37.765010+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 12, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'64', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:11:56.065 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:56.078 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:11:56.228 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.225+0000 7fc7b4aee700 1 Processor -- start 2020-04-22T14:11:56.228 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.226+0000 7fc7b4aee700 1 -- start start 2020-04-22T14:11:56.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.226+0000 7fc7b4aee700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc7b005b780 0x7fc7b0146410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:56.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.226+0000 7fc7b4aee700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7b0146870 0x7fc7b0146d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:56.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.226+0000 7fc7b4aee700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7b005f2c0 con 0x7fc7b00b0ed0 2020-04-22T14:11:56.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.226+0000 7fc7b4aee700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b0149e40 con 0x7fc7b005b780 2020-04-22T14:11:56.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.226+0000 7fc7b4aee700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b014a0e0 con 0x7fc7b0146870 2020-04-22T14:11:56.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.226+0000 7fc7aeffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc7b005b780 0x7fc7b0146410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:56.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.226+0000 7fc7aeffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc7b005b780 0x7fc7b0146410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52294/0 (socket says 172.21.15.103:52294) 2020-04-22T14:11:56.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.226+0000 7fc7aeffd700 1 -- 172.21.15.103:0/3267229867 learned_addr learned my addr 172.21.15.103:0/3267229867 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:56.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.227+0000 7fc7affff700 1 --2- 172.21.15.103:0/3267229867 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7b0146870 0x7fc7b0146d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:56.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.227+0000 7fc7aeffd700 1 -- 172.21.15.103:0/3267229867 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7b0146870 msgr2=0x7fc7b0146d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:56.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.227+0000 7fc7aeffd700 1 --2- 172.21.15.103:0/3267229867 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7b0146870 0x7fc7b0146d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:56.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.227+0000 7fc7aeffd700 1 -- 172.21.15.103:0/3267229867 >> v1:172.21.15.86:6789/0 conn(0x7fc7b00b0ed0 legacy=0x7fc7b01435f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:56.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.227+0000 7fc7aeffd700 1 -- 172.21.15.103:0/3267229867 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b014a380 con 0x7fc7b005b780 2020-04-22T14:11:56.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.227+0000 7fc7aeffd700 1 --2- 172.21.15.103:0/3267229867 >> v2:172.21.15.103:3300/0 conn(0x7fc7b005b780 0x7fc7b0146410 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc7b006ae90 tx=0x7fc7a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.227+0000 7fc7aeffd700 1 --2- 172.21.15.103:0/3267229867 >> v2:172.21.15.103:3300/0 conn(0x7fc7b005b780 0x7fc7b0146410 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc7b006ae90 tx=0x7fc7a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.227+0000 7fc7aeffd700 1 --2- 172.21.15.103:0/3267229867 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7b005b780 0x7fc7b0146410 secure :-1 s=READY pgs=988 cs=0 l=1 rx=0x7fc7b006ae90 tx=0x7fc7a4007a40).ready entity=mon.1 client_cookie=63f238dfd7207dde server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:56.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.227+0000 7fc7aeffd700 1 --2- 172.21.15.103:0/3267229867 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7b005b780 0x7fc7b0146410 secure :-1 s=THROTTLE_DONE pgs=988 cs=0 l=1 rx=0x7fc7b006ae90 tx=0x7fc7a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.227+0000 7fc7ae7fc700 1 -- 172.21.15.103:0/3267229867 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7a40116e0 con 0x7fc7b005b780 2020-04-22T14:11:56.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.227+0000 7fc7aeffd700 1 --2- 172.21.15.103:0/3267229867 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7b005b780 0x7fc7b0146410 secure :-1 s=THROTTLE_DONE pgs=988 cs=0 l=1 rx=0x7fc7b006ae90 tx=0x7fc7a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.227+0000 7fc7aeffd700 1 --2- 172.21.15.103:0/3267229867 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7b005b780 0x7fc7b0146410 secure :-1 s=THROTTLE_DONE pgs=988 cs=0 l=1 rx=0x7fc7b006ae90 tx=0x7fc7a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.227+0000 7fc7ae7fc700 1 -- 172.21.15.103:0/3267229867 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a4011840 con 0x7fc7b005b780 2020-04-22T14:11:56.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.227+0000 7fc7ae7fc700 1 -- 172.21.15.103:0/3267229867 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7a4011c60 con 0x7fc7b005b780 2020-04-22T14:11:56.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.227+0000 7fc7b4aee700 1 -- 172.21.15.103:0/3267229867 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7b005b780 msgr2=0x7fc7b0146410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:56.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.227+0000 7fc7b4aee700 1 --2- 172.21.15.103:0/3267229867 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7b005b780 0x7fc7b0146410 secure :-1 s=READY pgs=988 cs=0 l=1 rx=0x7fc7b006ae90 tx=0x7fc7a4007a40).stop 2020-04-22T14:11:56.237 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.227+0000 7fc7b4aee700 1 -- 172.21.15.103:0/3267229867 shutdown_connections 2020-04-22T14:11:56.237 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.227+0000 7fc7b4aee700 1 --2- 172.21.15.103:0/3267229867 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7b0146870 0x7fc7b0146d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:56.237 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.227+0000 7fc7b4aee700 1 --2- 172.21.15.103:0/3267229867 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7b005b780 0x7fc7b0146410 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:56.237 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.227+0000 7fc7b4aee700 1 -- 172.21.15.103:0/3267229867 >> 172.21.15.103:0/3267229867 conn(0x7fc7b00614d0 msgr2=0x7fc7b00618e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:56.237 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.227+0000 7fc7b4aee700 1 -- 172.21.15.103:0/3267229867 shutdown_connections 2020-04-22T14:11:56.237 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.227+0000 7fc7b4aee700 1 -- 172.21.15.103:0/3267229867 wait complete. 2020-04-22T14:11:56.237 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.228+0000 7fc7b4aee700 1 Processor -- start 2020-04-22T14:11:56.238 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.229+0000 7fc7b4aee700 1 -- start start 2020-04-22T14:11:56.238 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.229+0000 7fc7b4aee700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc7b005b780 0x7fc7b00b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:56.238 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.229+0000 7fc7b4aee700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7b0146870 0x7fc7b01433c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:56.238 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.229+0000 7fc7b4aee700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7b0141210 con 0x7fc7b00b0ed0 2020-04-22T14:11:56.238 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.229+0000 7fc7b4aee700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b01414b0 con 0x7fc7b005b780 2020-04-22T14:11:56.238 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.229+0000 7fc7b4aee700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b0141750 con 0x7fc7b0146870 2020-04-22T14:11:56.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.229+0000 7fc7af7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc7b005b780 0x7fc7b00b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:56.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.229+0000 7fc7aeffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc7b00b0ed0 0x7fc7b0145cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44488/0 (socket says 172.21.15.103:44488) 2020-04-22T14:11:56.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.229+0000 7fc7aeffd700 1 -- 172.21.15.103:0/2505221345 learned_addr learned my addr 172.21.15.103:0/2505221345 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:56.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.229+0000 7fc7affff700 1 --2- 172.21.15.103:0/2505221345 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7b0146870 0x7fc7b01433c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:56.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.230+0000 7fc7af7fe700 1 -- 172.21.15.103:0/2505221345 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7b0146870 msgr2=0x7fc7b01433c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:56.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.230+0000 7fc7af7fe700 1 --2- 172.21.15.103:0/2505221345 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7b0146870 0x7fc7b01433c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:56.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.230+0000 7fc7af7fe700 1 -- 172.21.15.103:0/2505221345 >> v1:172.21.15.103:6789/0 conn(0x7fc7b00b0ed0 legacy=0x7fc7b0145cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:56.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.230+0000 7fc7af7fe700 1 -- 172.21.15.103:0/2505221345 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b00b49a0 con 0x7fc7b005b780 2020-04-22T14:11:56.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.230+0000 7fc7acff9700 1 -- 172.21.15.103:0/2505221345 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 464979861 0 0) 0x7fc7b0141210 con 0x7fc7b00b0ed0 2020-04-22T14:11:56.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.230+0000 7fc7af7fe700 1 --2- 172.21.15.103:0/2505221345 >> v2:172.21.15.103:3300/0 conn(0x7fc7b005b780 0x7fc7b00b39a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc7a0002f40 tx=0x7fc7a0010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.230+0000 7fc7af7fe700 1 --2- 172.21.15.103:0/2505221345 >> v2:172.21.15.103:3300/0 conn(0x7fc7b005b780 0x7fc7b00b39a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc7a0002f40 tx=0x7fc7a0010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.230+0000 7fc7af7fe700 1 --2- 172.21.15.103:0/2505221345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7b005b780 0x7fc7b00b39a0 secure :-1 s=READY pgs=990 cs=0 l=1 rx=0x7fc7a0002f40 tx=0x7fc7a0010830).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:56.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.230+0000 7fc7af7fe700 1 --2- 172.21.15.103:0/2505221345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7b005b780 0x7fc7b00b39a0 secure :-1 s=THROTTLE_DONE pgs=990 cs=0 l=1 rx=0x7fc7a0002f40 tx=0x7fc7a0010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.230+0000 7fc7acff9700 1 -- 172.21.15.103:0/2505221345 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7a00059f0 con 0x7fc7b005b780 2020-04-22T14:11:56.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.230+0000 7fc7af7fe700 1 --2- 172.21.15.103:0/2505221345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7b005b780 0x7fc7b00b39a0 secure :-1 s=THROTTLE_DONE pgs=990 cs=0 l=1 rx=0x7fc7a0002f40 tx=0x7fc7a0010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.230+0000 7fc7acff9700 1 -- 172.21.15.103:0/2505221345 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a0005b90 con 0x7fc7b005b780 2020-04-22T14:11:56.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.230+0000 7fc7af7fe700 1 --2- 172.21.15.103:0/2505221345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7b005b780 0x7fc7b00b39a0 secure :-1 s=THROTTLE_DONE pgs=990 cs=0 l=1 rx=0x7fc7a0002f40 tx=0x7fc7a0010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.230+0000 7fc7acff9700 1 -- 172.21.15.103:0/2505221345 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7a0011160 con 0x7fc7b005b780 2020-04-22T14:11:56.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.230+0000 7fc7b4aee700 1 -- 172.21.15.103:0/2505221345 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7b0146400 con 0x7fc7b005b780 2020-04-22T14:11:56.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.230+0000 7fc7b4aee700 1 -- 172.21.15.103:0/2505221345 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b00b2540 con 0x7fc7b005b780 2020-04-22T14:11:56.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.230+0000 7fc7af7fe700 1 --2- 172.21.15.103:0/2505221345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7b005b780 0x7fc7b00b39a0 secure :-1 s=THROTTLE_DONE pgs=990 cs=0 l=1 rx=0x7fc7a0002f40 tx=0x7fc7a0010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.231+0000 7fc7b4aee700 1 -- 172.21.15.103:0/2505221345 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7b0056c90 con 0x7fc7b005b780 2020-04-22T14:11:56.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.231+0000 7fc7acff9700 1 -- 172.21.15.103:0/2505221345 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fc7a00113e0 con 0x7fc7b005b780 2020-04-22T14:11:56.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.231+0000 7fc7af7fe700 1 --2- 172.21.15.103:0/2505221345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7b005b780 0x7fc7b00b39a0 secure :-1 s=THROTTLE_DONE pgs=990 cs=0 l=1 rx=0x7fc7a0002f40 tx=0x7fc7a0010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.231+0000 7fc7acff9700 1 --2- 172.21.15.103:0/2505221345 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc79004d880 0x7fc79004fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:56.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.231+0000 7fc7acff9700 1 -- 172.21.15.103:0/2505221345 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6202+0+0 (secure 0 0 0) 0x7fc7a0060f70 con 0x7fc7b005b780 2020-04-22T14:11:56.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.231+0000 7fc7aeffd700 1 --2- 172.21.15.103:0/2505221345 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc79004d880 0x7fc79004fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:56.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.232+0000 7fc7aeffd700 1 --2- 172.21.15.103:0/2505221345 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc79004d880 0x7fc79004fd40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc7a4000b80 tx=0x7fc7a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.232+0000 7fc7aeffd700 1 --2- 172.21.15.103:0/2505221345 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc79004d880 0x7fc79004fd40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc7a4000b80 tx=0x7fc7a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.232+0000 7fc7aeffd700 1 --2- 172.21.15.103:0/2505221345 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc79004d880 0x7fc79004fd40 secure :-1 s=READY pgs=371 cs=0 l=1 rx=0x7fc7a4000b80 tx=0x7fc7a4007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:56.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.235+0000 7fc7af7fe700 1 --2- 172.21.15.103:0/2505221345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7b005b780 0x7fc7b00b39a0 secure :-1 s=THROTTLE_DONE pgs=990 cs=0 l=1 rx=0x7fc7a0002f40 tx=0x7fc7a0010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.235+0000 7fc7acff9700 1 -- 172.21.15.103:0/2505221345 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fc7a003c350 con 0x7fc7b005b780 2020-04-22T14:11:56.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.376+0000 7fc7b4aee700 1 -- 172.21.15.103:0/2505221345 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc7b00b4b30 con 0x7fc7b005b780 2020-04-22T14:11:56.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.377+0000 7fc7af7fe700 1 --2- 172.21.15.103:0/2505221345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7b005b780 0x7fc7b00b39a0 secure :-1 s=THROTTLE_DONE pgs=990 cs=0 l=1 rx=0x7fc7a0002f40 tx=0x7fc7a0010830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.377+0000 7fc7acff9700 1 -- 172.21.15.103:0/2505221345 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v67) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc7a003f970 con 0x7fc7b005b780 2020-04-22T14:11:56.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.378+0000 7fc7b4aee700 1 -- 172.21.15.103:0/2505221345 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc79004d880 msgr2=0x7fc79004fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:56.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.378+0000 7fc7b4aee700 1 --2- 172.21.15.103:0/2505221345 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc79004d880 0x7fc79004fd40 secure :-1 s=READY pgs=371 cs=0 l=1 rx=0x7fc7a4000b80 tx=0x7fc7a4007a40).stop 2020-04-22T14:11:56.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.378+0000 7fc7b4aee700 1 -- 172.21.15.103:0/2505221345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7b005b780 msgr2=0x7fc7b00b39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:56.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.378+0000 7fc7b4aee700 1 --2- 172.21.15.103:0/2505221345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7b005b780 0x7fc7b00b39a0 secure :-1 s=READY pgs=990 cs=0 l=1 rx=0x7fc7a0002f40 tx=0x7fc7a0010830).stop 2020-04-22T14:11:56.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.378+0000 7fc7b4aee700 1 -- 172.21.15.103:0/2505221345 shutdown_connections 2020-04-22T14:11:56.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.378+0000 7fc7b4aee700 1 --2- 172.21.15.103:0/2505221345 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc79004d880 0x7fc79004fd40 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:56.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.378+0000 7fc7b4aee700 1 --2- 172.21.15.103:0/2505221345 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7b0146870 0x7fc7b01433c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:56.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.378+0000 7fc7b4aee700 1 --2- 172.21.15.103:0/2505221345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7b005b780 0x7fc7b00b39a0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:56.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.378+0000 7fc7b4aee700 1 -- 172.21.15.103:0/2505221345 >> 172.21.15.103:0/2505221345 conn(0x7fc7b00614d0 msgr2=0x7fc7b00b70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:56.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.378+0000 7fc7b4aee700 1 -- 172.21.15.103:0/2505221345 shutdown_connections 2020-04-22T14:11:56.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.378+0000 7fc7b4aee700 1 -- 172.21.15.103:0/2505221345 wait complete. 2020-04-22T14:11:56.391 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:11:56.392 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:56.408 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:11:56.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.555+0000 7fa6c825e700 1 Processor -- start 2020-04-22T14:11:56.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.555+0000 7fa6c825e700 1 -- start start 2020-04-22T14:11:56.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.556+0000 7fa6c825e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa6c00b9140 0x7fa6c012b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:56.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.556+0000 7fa6c825e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa6c012b670 0x7fa6c0143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:56.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.556+0000 7fa6c825e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6c01467e0 con 0x7fa6c00ac950 2020-04-22T14:11:56.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.556+0000 7fa6c825e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6c00602f0 con 0x7fa6c012b670 2020-04-22T14:11:56.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.556+0000 7fa6c825e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c0060050 con 0x7fa6c00b9140 2020-04-22T14:11:56.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.557+0000 7fa6c67fb700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa6c012b670 0x7fa6c0143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:56.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.557+0000 7fa6c5ffa700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa6c00b9140 0x7fa6c012b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:56.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.557+0000 7fa6c57f9700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fa6c00ac950 0x7fa6c0146c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:33418/0 (socket says 172.21.15.103:33418) 2020-04-22T14:11:56.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.557+0000 7fa6c5ffa700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa6c00b9140 0x7fa6c012b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:37082/0 (socket says 172.21.15.103:37082) 2020-04-22T14:11:56.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.557+0000 7fa6c67fb700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa6c012b670 0x7fa6c0143090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:49536/0 (socket says 172.21.15.103:49536) 2020-04-22T14:11:56.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.557+0000 7fa6c57f9700 1 -- 172.21.15.103:0/2354923159 learned_addr learned my addr 172.21.15.103:0/2354923159 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:56.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.557+0000 7fa6c67fb700 1 -- 172.21.15.103:0/2354923159 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa6c00b9140 msgr2=0x7fa6c012b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:56.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.557+0000 7fa6c67fb700 1 --2- 172.21.15.103:0/2354923159 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa6c00b9140 0x7fa6c012b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:56.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.557+0000 7fa6c67fb700 1 -- 172.21.15.103:0/2354923159 >> v1:172.21.15.86:6789/0 conn(0x7fa6c00ac950 legacy=0x7fa6c0146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:56.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.557+0000 7fa6c67fb700 1 -- 172.21.15.103:0/2354923159 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c00b9520 con 0x7fa6c012b670 2020-04-22T14:11:56.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.557+0000 7fa6c4ff8700 1 -- 172.21.15.103:0/2354923159 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 792368866 0 0) 0x7fa6c01467e0 con 0x7fa6c00ac950 2020-04-22T14:11:56.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.557+0000 7fa6c67fb700 1 --2- 172.21.15.103:0/2354923159 >> v2:172.21.15.86:3300/0 conn(0x7fa6c012b670 0x7fa6c0143090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa6b80032b0 tx=0x7fa6b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.557+0000 7fa6c67fb700 1 --2- 172.21.15.103:0/2354923159 >> v2:172.21.15.86:3300/0 conn(0x7fa6c012b670 0x7fa6c0143090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa6b80032b0 tx=0x7fa6b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.557+0000 7fa6c67fb700 1 --2- 172.21.15.103:0/2354923159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6c012b670 0x7fa6c0143090 secure :-1 s=READY pgs=558 cs=0 l=1 rx=0x7fa6b80032b0 tx=0x7fa6b8007dc0).ready entity=mon.0 client_cookie=65beedf61cf71a2 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:56.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.557+0000 7fa6c67fb700 1 --2- 172.21.15.103:0/2354923159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6c012b670 0x7fa6c0143090 secure :-1 s=THROTTLE_DONE pgs=558 cs=0 l=1 rx=0x7fa6b80032b0 tx=0x7fa6b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.557+0000 7fa6c4ff8700 1 -- 172.21.15.103:0/2354923159 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6b8011e20 con 0x7fa6c012b670 2020-04-22T14:11:56.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.557+0000 7fa6c67fb700 1 --2- 172.21.15.103:0/2354923159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6c012b670 0x7fa6c0143090 secure :-1 s=THROTTLE_DONE pgs=558 cs=0 l=1 rx=0x7fa6b80032b0 tx=0x7fa6b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.557+0000 7fa6c67fb700 1 --2- 172.21.15.103:0/2354923159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6c012b670 0x7fa6c0143090 secure :-1 s=THROTTLE_DONE pgs=558 cs=0 l=1 rx=0x7fa6b80032b0 tx=0x7fa6b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.557+0000 7fa6c4ff8700 1 -- 172.21.15.103:0/2354923159 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b800a180 con 0x7fa6c012b670 2020-04-22T14:11:56.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.557+0000 7fa6c4ff8700 1 -- 172.21.15.103:0/2354923159 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6b800a520 con 0x7fa6c012b670 2020-04-22T14:11:56.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.557+0000 7fa6c825e700 1 -- 172.21.15.103:0/2354923159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6c012b670 msgr2=0x7fa6c0143090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:56.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.557+0000 7fa6c825e700 1 --2- 172.21.15.103:0/2354923159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6c012b670 0x7fa6c0143090 secure :-1 s=READY pgs=558 cs=0 l=1 rx=0x7fa6b80032b0 tx=0x7fa6b8007dc0).stop 2020-04-22T14:11:56.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.558+0000 7fa6c825e700 1 -- 172.21.15.103:0/2354923159 shutdown_connections 2020-04-22T14:11:56.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.558+0000 7fa6c825e700 1 --2- 172.21.15.103:0/2354923159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6c012b670 0x7fa6c0143090 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:56.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.558+0000 7fa6c825e700 1 --2- 172.21.15.103:0/2354923159 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa6c00b9140 0x7fa6c012b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:56.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.558+0000 7fa6c825e700 1 -- 172.21.15.103:0/2354923159 >> 172.21.15.103:0/2354923159 conn(0x7fa6c005b7b0 msgr2=0x7fa6c00b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:56.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.558+0000 7fa6c825e700 1 -- 172.21.15.103:0/2354923159 shutdown_connections 2020-04-22T14:11:56.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.558+0000 7fa6c825e700 1 -- 172.21.15.103:0/2354923159 wait complete. 2020-04-22T14:11:56.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.559+0000 7fa6c825e700 1 Processor -- start 2020-04-22T14:11:56.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.559+0000 7fa6c825e700 1 -- start start 2020-04-22T14:11:56.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.559+0000 7fa6c825e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa6c00ac950 0x7fa6c0127fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:56.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.559+0000 7fa6c825e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa6c00b9140 0x7fa6c0151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:56.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.559+0000 7fa6c825e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6c0144b10 con 0x7fa6c012b670 2020-04-22T14:11:56.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.559+0000 7fa6c825e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6c01432d0 con 0x7fa6c00ac950 2020-04-22T14:11:56.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.559+0000 7fa6c825e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6c0155a30 con 0x7fa6c00b9140 2020-04-22T14:11:56.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.559+0000 7fa6c57f9700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa6c00b9140 0x7fa6c0151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:56.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.560+0000 7fa6c57f9700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa6c00b9140 0x7fa6c0151090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52310/0 (socket says 172.21.15.103:52310) 2020-04-22T14:11:56.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.560+0000 7fa6c57f9700 1 -- 172.21.15.103:0/4223371555 learned_addr learned my addr 172.21.15.103:0/4223371555 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:56.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.560+0000 7fa6c5ffa700 1 --2- 172.21.15.103:0/4223371555 >> v2:172.21.15.86:3300/0 conn(0x7fa6c00ac950 0x7fa6c0127fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:56.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.560+0000 7fa6c57f9700 1 -- 172.21.15.103:0/4223371555 >> v2:172.21.15.86:3300/0 conn(0x7fa6c00ac950 msgr2=0x7fa6c0127fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:56.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.560+0000 7fa6c57f9700 1 --2- 172.21.15.103:0/4223371555 >> v2:172.21.15.86:3300/0 conn(0x7fa6c00ac950 0x7fa6c0127fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:56.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.560+0000 7fa6c57f9700 1 -- 172.21.15.103:0/4223371555 >> v1:172.21.15.86:6789/0 conn(0x7fa6c012b670 legacy=0x7fa6c00b5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:56.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.560+0000 7fa6c57f9700 1 -- 172.21.15.103:0/4223371555 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c0144db0 con 0x7fa6c00b9140 2020-04-22T14:11:56.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.560+0000 7fa6c5ffa700 1 --2- 172.21.15.103:0/4223371555 >> v2:172.21.15.86:3300/0 conn(0x7fa6c00ac950 0x7fa6c0127fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:11:56.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.560+0000 7fa6c57f9700 1 --2- 172.21.15.103:0/4223371555 >> v2:172.21.15.103:3300/0 conn(0x7fa6c00b9140 0x7fa6c0151090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa6c00b21b0 tx=0x7fa6b4001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.560+0000 7fa6c57f9700 1 --2- 172.21.15.103:0/4223371555 >> v2:172.21.15.103:3300/0 conn(0x7fa6c00b9140 0x7fa6c0151090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa6c00b21b0 tx=0x7fa6b4001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.560+0000 7fa6c57f9700 1 --2- 172.21.15.103:0/4223371555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6c00b9140 0x7fa6c0151090 secure :-1 s=READY pgs=991 cs=0 l=1 rx=0x7fa6c00b21b0 tx=0x7fa6b4001e40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:56.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.560+0000 7fa6c57f9700 1 --2- 172.21.15.103:0/4223371555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6c00b9140 0x7fa6c0151090 secure :-1 s=THROTTLE_DONE pgs=991 cs=0 l=1 rx=0x7fa6c00b21b0 tx=0x7fa6b4001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.560+0000 7fa6b2ffd700 1 -- 172.21.15.103:0/4223371555 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6b400ca40 con 0x7fa6c00b9140 2020-04-22T14:11:56.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.560+0000 7fa6c57f9700 1 --2- 172.21.15.103:0/4223371555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6c00b9140 0x7fa6c0151090 secure :-1 s=THROTTLE_DONE pgs=991 cs=0 l=1 rx=0x7fa6c00b21b0 tx=0x7fa6b4001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.560+0000 7fa6c57f9700 1 --2- 172.21.15.103:0/4223371555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6c00b9140 0x7fa6c0151090 secure :-1 s=THROTTLE_DONE pgs=991 cs=0 l=1 rx=0x7fa6c00b21b0 tx=0x7fa6b4001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.560+0000 7fa6b2ffd700 1 -- 172.21.15.103:0/4223371555 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b400cba0 con 0x7fa6c00b9140 2020-04-22T14:11:56.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.560+0000 7fa6b2ffd700 1 -- 172.21.15.103:0/4223371555 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6b400d0d0 con 0x7fa6c00b9140 2020-04-22T14:11:56.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.560+0000 7fa6c825e700 1 -- 172.21.15.103:0/4223371555 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6c00b59d0 con 0x7fa6c00b9140 2020-04-22T14:11:56.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.560+0000 7fa6c825e700 1 -- 172.21.15.103:0/4223371555 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6c0155570 con 0x7fa6c00b9140 2020-04-22T14:11:56.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.561+0000 7fa6c57f9700 1 --2- 172.21.15.103:0/4223371555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6c00b9140 0x7fa6c0151090 secure :-1 s=THROTTLE_DONE pgs=991 cs=0 l=1 rx=0x7fa6c00b21b0 tx=0x7fa6b4001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.561+0000 7fa6b2ffd700 1 -- 172.21.15.103:0/4223371555 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fa6b40055c0 con 0x7fa6c00b9140 2020-04-22T14:11:56.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.561+0000 7fa6c57f9700 1 --2- 172.21.15.103:0/4223371555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6c00b9140 0x7fa6c0151090 secure :-1 s=THROTTLE_DONE pgs=991 cs=0 l=1 rx=0x7fa6c00b21b0 tx=0x7fa6b4001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.561+0000 7fa6c825e700 1 -- 172.21.15.103:0/4223371555 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6c0056c90 con 0x7fa6c00b9140 2020-04-22T14:11:56.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.562+0000 7fa6b2ffd700 1 --2- 172.21.15.103:0/4223371555 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa6a004d9e0 0x7fa6a004fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:56.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.562+0000 7fa6b2ffd700 1 -- 172.21.15.103:0/4223371555 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6202+0+0 (secure 0 0 0) 0x7fa6b40100c0 con 0x7fa6c00b9140 2020-04-22T14:11:56.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.562+0000 7fa6c5ffa700 1 --2- 172.21.15.103:0/4223371555 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa6a004d9e0 0x7fa6a004fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:56.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.562+0000 7fa6c5ffa700 1 --2- 172.21.15.103:0/4223371555 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa6a004d9e0 0x7fa6a004fea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa6bc002f30 tx=0x7fa6bc008830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.562+0000 7fa6c5ffa700 1 --2- 172.21.15.103:0/4223371555 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa6a004d9e0 0x7fa6a004fea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa6bc002f30 tx=0x7fa6bc008830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.562+0000 7fa6c5ffa700 1 --2- 172.21.15.103:0/4223371555 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa6a004d9e0 0x7fa6a004fea0 secure :-1 s=READY pgs=372 cs=0 l=1 rx=0x7fa6bc002f30 tx=0x7fa6bc008830).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:56.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.566+0000 7fa6c57f9700 1 --2- 172.21.15.103:0/4223371555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6c00b9140 0x7fa6c0151090 secure :-1 s=THROTTLE_DONE pgs=991 cs=0 l=1 rx=0x7fa6c00b21b0 tx=0x7fa6b4001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.566+0000 7fa6b2ffd700 1 -- 172.21.15.103:0/4223371555 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fa6b403c390 con 0x7fa6c00b9140 2020-04-22T14:11:56.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.708+0000 7fa6c825e700 1 -- 172.21.15.103:0/4223371555 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa6c0066ce0 con 0x7fa6c00b9140 2020-04-22T14:11:56.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.709+0000 7fa6c57f9700 1 --2- 172.21.15.103:0/4223371555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6c00b9140 0x7fa6c0151090 secure :-1 s=THROTTLE_DONE pgs=991 cs=0 l=1 rx=0x7fa6c00b21b0 tx=0x7fa6b4001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.709+0000 7fa6b2ffd700 1 -- 172.21.15.103:0/4223371555 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v67) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa6b403f9b0 con 0x7fa6c00b9140 2020-04-22T14:11:56.711 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:11:56.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.710+0000 7fa6c825e700 1 -- 172.21.15.103:0/4223371555 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa6a004d9e0 msgr2=0x7fa6a004fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:56.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.710+0000 7fa6c825e700 1 --2- 172.21.15.103:0/4223371555 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa6a004d9e0 0x7fa6a004fea0 secure :-1 s=READY pgs=372 cs=0 l=1 rx=0x7fa6bc002f30 tx=0x7fa6bc008830).stop 2020-04-22T14:11:56.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.710+0000 7fa6c825e700 1 -- 172.21.15.103:0/4223371555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6c00b9140 msgr2=0x7fa6c0151090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:56.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.710+0000 7fa6c825e700 1 --2- 172.21.15.103:0/4223371555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6c00b9140 0x7fa6c0151090 secure :-1 s=READY pgs=991 cs=0 l=1 rx=0x7fa6c00b21b0 tx=0x7fa6b4001e40).stop 2020-04-22T14:11:56.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.710+0000 7fa6c825e700 1 -- 172.21.15.103:0/4223371555 shutdown_connections 2020-04-22T14:11:56.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.710+0000 7fa6c825e700 1 --2- 172.21.15.103:0/4223371555 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa6a004d9e0 0x7fa6a004fea0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:56.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.710+0000 7fa6c825e700 1 --2- 172.21.15.103:0/4223371555 >> v2:172.21.15.86:3300/0 conn(0x7fa6c00ac950 0x7fa6c0127fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:56.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.710+0000 7fa6c825e700 1 --2- 172.21.15.103:0/4223371555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6c00b9140 0x7fa6c0151090 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:56.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.710+0000 7fa6c825e700 1 -- 172.21.15.103:0/4223371555 >> 172.21.15.103:0/4223371555 conn(0x7fa6c005b7b0 msgr2=0x7fa6c00b6690 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:56.714 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.710+0000 7fa6c825e700 1 -- 172.21.15.103:0/4223371555 shutdown_connections 2020-04-22T14:11:56.714 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.710+0000 7fa6c825e700 1 -- 172.21.15.103:0/4223371555 wait complete. 2020-04-22T14:11:56.722 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:56.735 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-22T14:11:56.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.901+0000 7fa6d9bab700 1 Processor -- start 2020-04-22T14:11:56.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.902+0000 7fa6d9bab700 1 -- start start 2020-04-22T14:11:56.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.902+0000 7fa6d9bab700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa6d40b0ed0 0x7fa6d405b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:56.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.902+0000 7fa6d9bab700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa6d41435f0 0x7fa6d4143a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:56.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.902+0000 7fa6d9bab700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6d405f2c0 con 0x7fa6d40b7120 2020-04-22T14:11:56.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.902+0000 7fa6d9bab700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d4143ed0 con 0x7fa6d40b0ed0 2020-04-22T14:11:56.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.902+0000 7fa6d9bab700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d4149e40 con 0x7fa6d41435f0 2020-04-22T14:11:56.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.902+0000 7fa6d3fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa6d41435f0 0x7fa6d4143a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:56.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.902+0000 7fa6d3fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa6d41435f0 0x7fa6d4143a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52318/0 (socket says 172.21.15.103:52318) 2020-04-22T14:11:56.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.902+0000 7fa6d3fff700 1 -- 172.21.15.103:0/2394959596 learned_addr learned my addr 172.21.15.103:0/2394959596 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:56.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.903+0000 7fa6d8ba9700 1 --2- 172.21.15.103:0/2394959596 >> v2:172.21.15.86:3300/0 conn(0x7fa6d40b0ed0 0x7fa6d405b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:56.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.903+0000 7fa6d3fff700 1 -- 172.21.15.103:0/2394959596 >> v2:172.21.15.86:3300/0 conn(0x7fa6d40b0ed0 msgr2=0x7fa6d405b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:56.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.903+0000 7fa6d3fff700 1 --2- 172.21.15.103:0/2394959596 >> v2:172.21.15.86:3300/0 conn(0x7fa6d40b0ed0 0x7fa6d405b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:56.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.903+0000 7fa6d3fff700 1 -- 172.21.15.103:0/2394959596 >> v1:172.21.15.86:6789/0 conn(0x7fa6d40b7120 legacy=0x7fa6d40b75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:56.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.903+0000 7fa6d3fff700 1 -- 172.21.15.103:0/2394959596 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d414a0e0 con 0x7fa6d41435f0 2020-04-22T14:11:56.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.903+0000 7fa6d8ba9700 1 --2- 172.21.15.103:0/2394959596 >> v2:172.21.15.86:3300/0 conn(0x7fa6d40b0ed0 0x7fa6d405b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:11:56.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.903+0000 7fa6d3fff700 1 --2- 172.21.15.103:0/2394959596 >> v2:172.21.15.103:3300/0 conn(0x7fa6d41435f0 0x7fa6d4143a70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa6d406ae90 tx=0x7fa6c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.903+0000 7fa6d3fff700 1 --2- 172.21.15.103:0/2394959596 >> v2:172.21.15.103:3300/0 conn(0x7fa6d41435f0 0x7fa6d4143a70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa6d406ae90 tx=0x7fa6c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.903+0000 7fa6d3fff700 1 --2- 172.21.15.103:0/2394959596 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6d41435f0 0x7fa6d4143a70 secure :-1 s=READY pgs=992 cs=0 l=1 rx=0x7fa6d406ae90 tx=0x7fa6c0007a40).ready entity=mon.1 client_cookie=5b44498cd361cdf9 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:56.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.903+0000 7fa6d3fff700 1 --2- 172.21.15.103:0/2394959596 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6d41435f0 0x7fa6d4143a70 secure :-1 s=THROTTLE_DONE pgs=992 cs=0 l=1 rx=0x7fa6d406ae90 tx=0x7fa6c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.903+0000 7fa6d37fe700 1 -- 172.21.15.103:0/2394959596 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6c00116e0 con 0x7fa6d41435f0 2020-04-22T14:11:56.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.903+0000 7fa6d3fff700 1 --2- 172.21.15.103:0/2394959596 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6d41435f0 0x7fa6d4143a70 secure :-1 s=THROTTLE_DONE pgs=992 cs=0 l=1 rx=0x7fa6d406ae90 tx=0x7fa6c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.903+0000 7fa6d3fff700 1 --2- 172.21.15.103:0/2394959596 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6d41435f0 0x7fa6d4143a70 secure :-1 s=THROTTLE_DONE pgs=992 cs=0 l=1 rx=0x7fa6d406ae90 tx=0x7fa6c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.903+0000 7fa6d37fe700 1 -- 172.21.15.103:0/2394959596 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c0011840 con 0x7fa6d41435f0 2020-04-22T14:11:56.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.903+0000 7fa6d37fe700 1 -- 172.21.15.103:0/2394959596 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6c0011c20 con 0x7fa6d41435f0 2020-04-22T14:11:56.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.903+0000 7fa6d9bab700 1 -- 172.21.15.103:0/2394959596 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6d41435f0 msgr2=0x7fa6d4143a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:56.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.903+0000 7fa6d9bab700 1 --2- 172.21.15.103:0/2394959596 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6d41435f0 0x7fa6d4143a70 secure :-1 s=READY pgs=992 cs=0 l=1 rx=0x7fa6d406ae90 tx=0x7fa6c0007a40).stop 2020-04-22T14:11:56.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.903+0000 7fa6d9bab700 1 -- 172.21.15.103:0/2394959596 shutdown_connections 2020-04-22T14:11:56.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.903+0000 7fa6d9bab700 1 --2- 172.21.15.103:0/2394959596 >> v2:172.21.15.86:3300/0 conn(0x7fa6d40b0ed0 0x7fa6d405b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:56.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.903+0000 7fa6d9bab700 1 --2- 172.21.15.103:0/2394959596 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6d41435f0 0x7fa6d4143a70 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:56.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.903+0000 7fa6d9bab700 1 -- 172.21.15.103:0/2394959596 >> 172.21.15.103:0/2394959596 conn(0x7fa6d40614d0 msgr2=0x7fa6d40618e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:56.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.904+0000 7fa6d9bab700 1 -- 172.21.15.103:0/2394959596 shutdown_connections 2020-04-22T14:11:56.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.904+0000 7fa6d9bab700 1 -- 172.21.15.103:0/2394959596 wait complete. 2020-04-22T14:11:56.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.904+0000 7fa6d9bab700 1 Processor -- start 2020-04-22T14:11:56.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.904+0000 7fa6d9bab700 1 -- start start 2020-04-22T14:11:56.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.905+0000 7fa6d9bab700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa6d40b7120 0x7fa6d40b3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:56.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.905+0000 7fa6d9bab700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa6d41435f0 0x7fa6d4131710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:56.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.905+0000 7fa6d9bab700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6d40b42e0 con 0x7fa6d40b0ed0 2020-04-22T14:11:56.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.905+0000 7fa6d9bab700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d40b4580 con 0x7fa6d41435f0 2020-04-22T14:11:56.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.905+0000 7fa6d9bab700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d40b4820 con 0x7fa6d40b7120 2020-04-22T14:11:56.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.905+0000 7fa6d3fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa6d40b7120 0x7fa6d40b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:56.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.905+0000 7fa6d3fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa6d40b7120 0x7fa6d40b3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52324/0 (socket says 172.21.15.103:52324) 2020-04-22T14:11:56.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.905+0000 7fa6d3fff700 1 -- 172.21.15.103:0/3486683213 learned_addr learned my addr 172.21.15.103:0/3486683213 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:56.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.905+0000 7fa6d93aa700 1 --2- 172.21.15.103:0/3486683213 >> v2:172.21.15.86:3300/0 conn(0x7fa6d41435f0 0x7fa6d4131710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:56.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.906+0000 7fa6d3fff700 1 -- 172.21.15.103:0/3486683213 >> v2:172.21.15.86:3300/0 conn(0x7fa6d41435f0 msgr2=0x7fa6d4131710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:56.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.906+0000 7fa6d3fff700 1 --2- 172.21.15.103:0/3486683213 >> v2:172.21.15.86:3300/0 conn(0x7fa6d41435f0 0x7fa6d4131710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:56.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.906+0000 7fa6d3fff700 1 -- 172.21.15.103:0/3486683213 >> v1:172.21.15.86:6789/0 conn(0x7fa6d40b0ed0 legacy=0x7fa6d4131000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:56.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.906+0000 7fa6d3fff700 1 -- 172.21.15.103:0/3486683213 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d40b3f60 con 0x7fa6d40b7120 2020-04-22T14:11:56.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.906+0000 7fa6d3fff700 1 --2- 172.21.15.103:0/3486683213 >> v2:172.21.15.103:3300/0 conn(0x7fa6d40b7120 0x7fa6d40b3040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa6d406ae90 tx=0x7fa6c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.906+0000 7fa6d3fff700 1 --2- 172.21.15.103:0/3486683213 >> v2:172.21.15.103:3300/0 conn(0x7fa6d40b7120 0x7fa6d40b3040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa6d406ae90 tx=0x7fa6c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.906+0000 7fa6d3fff700 1 --2- 172.21.15.103:0/3486683213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6d40b7120 0x7fa6d40b3040 secure :-1 s=READY pgs=993 cs=0 l=1 rx=0x7fa6d406ae90 tx=0x7fa6c0007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:56.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.906+0000 7fa6d3fff700 1 --2- 172.21.15.103:0/3486683213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6d40b7120 0x7fa6d40b3040 secure :-1 s=THROTTLE_DONE pgs=993 cs=0 l=1 rx=0x7fa6d406ae90 tx=0x7fa6c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.906+0000 7fa6d1ffb700 1 -- 172.21.15.103:0/3486683213 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6c0011ce0 con 0x7fa6d40b7120 2020-04-22T14:11:56.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.906+0000 7fa6d3fff700 1 --2- 172.21.15.103:0/3486683213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6d40b7120 0x7fa6d40b3040 secure :-1 s=THROTTLE_DONE pgs=993 cs=0 l=1 rx=0x7fa6d406ae90 tx=0x7fa6c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.906+0000 7fa6d3fff700 1 --2- 172.21.15.103:0/3486683213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6d40b7120 0x7fa6d40b3040 secure :-1 s=THROTTLE_DONE pgs=993 cs=0 l=1 rx=0x7fa6d406ae90 tx=0x7fa6c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.906+0000 7fa6d1ffb700 1 -- 172.21.15.103:0/3486683213 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c0007360 con 0x7fa6d40b7120 2020-04-22T14:11:56.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.906+0000 7fa6d9bab700 1 -- 172.21.15.103:0/3486683213 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d41405c0 con 0x7fa6d40b7120 2020-04-22T14:11:56.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.906+0000 7fa6d1ffb700 1 -- 172.21.15.103:0/3486683213 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6c0007590 con 0x7fa6d40b7120 2020-04-22T14:11:56.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.906+0000 7fa6d9bab700 1 -- 172.21.15.103:0/3486683213 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d41321a0 con 0x7fa6d40b7120 2020-04-22T14:11:56.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.906+0000 7fa6d3fff700 1 --2- 172.21.15.103:0/3486683213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6d40b7120 0x7fa6d40b3040 secure :-1 s=THROTTLE_DONE pgs=993 cs=0 l=1 rx=0x7fa6d406ae90 tx=0x7fa6c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.907+0000 7fa6d1ffb700 1 -- 172.21.15.103:0/3486683213 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fa6c00058b0 con 0x7fa6d40b7120 2020-04-22T14:11:56.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.907+0000 7fa6d3fff700 1 --2- 172.21.15.103:0/3486683213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6d40b7120 0x7fa6d40b3040 secure :-1 s=THROTTLE_DONE pgs=993 cs=0 l=1 rx=0x7fa6d406ae90 tx=0x7fa6c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.907+0000 7fa6d9bab700 1 -- 172.21.15.103:0/3486683213 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6d4056c90 con 0x7fa6d40b7120 2020-04-22T14:11:56.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.907+0000 7fa6d1ffb700 1 --2- 172.21.15.103:0/3486683213 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa6bc04d980 0x7fa6bc04fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:56.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.907+0000 7fa6d1ffb700 1 -- 172.21.15.103:0/3486683213 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6202+0+0 (secure 0 0 0) 0x7fa6c0061d10 con 0x7fa6d40b7120 2020-04-22T14:11:56.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.907+0000 7fa6d8ba9700 1 --2- 172.21.15.103:0/3486683213 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa6bc04d980 0x7fa6bc04fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:56.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.908+0000 7fa6d8ba9700 1 --2- 172.21.15.103:0/3486683213 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa6bc04d980 0x7fa6bc04fe40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa6d41450a0 tx=0x7fa6c80011d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.908+0000 7fa6d8ba9700 1 --2- 172.21.15.103:0/3486683213 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa6bc04d980 0x7fa6bc04fe40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa6d41450a0 tx=0x7fa6c80011d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.908+0000 7fa6d8ba9700 1 --2- 172.21.15.103:0/3486683213 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa6bc04d980 0x7fa6bc04fe40 secure :-1 s=READY pgs=373 cs=0 l=1 rx=0x7fa6d41450a0 tx=0x7fa6c80011d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:56.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.911+0000 7fa6d3fff700 1 --2- 172.21.15.103:0/3486683213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6d40b7120 0x7fa6d40b3040 secure :-1 s=THROTTLE_DONE pgs=993 cs=0 l=1 rx=0x7fa6d406ae90 tx=0x7fa6c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:56.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:56.911+0000 7fa6d1ffb700 1 -- 172.21.15.103:0/3486683213 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fa6c003d210 con 0x7fa6d40b7120 2020-04-22T14:11:57.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.055+0000 7fa6d9bab700 1 -- 172.21.15.103:0/3486683213 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa6d40b4150 con 0x7fa6d40b7120 2020-04-22T14:11:57.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.055+0000 7fa6d3fff700 1 --2- 172.21.15.103:0/3486683213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6d40b7120 0x7fa6d40b3040 secure :-1 s=THROTTLE_DONE pgs=993 cs=0 l=1 rx=0x7fa6d406ae90 tx=0x7fa6c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:57.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.055+0000 7fa6d1ffb700 1 -- 172.21.15.103:0/3486683213 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v67) v1 ==== 104+0+10 (secure 0 0 0) 0x7fa6c0040830 con 0x7fa6d40b7120 2020-04-22T14:11:57.058 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:11:57.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.057+0000 7fa6d9bab700 1 -- 172.21.15.103:0/3486683213 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa6bc04d980 msgr2=0x7fa6bc04fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:57.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.057+0000 7fa6d9bab700 1 --2- 172.21.15.103:0/3486683213 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa6bc04d980 0x7fa6bc04fe40 secure :-1 s=READY pgs=373 cs=0 l=1 rx=0x7fa6d41450a0 tx=0x7fa6c80011d0).stop 2020-04-22T14:11:57.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.057+0000 7fa6d9bab700 1 -- 172.21.15.103:0/3486683213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6d40b7120 msgr2=0x7fa6d40b3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:57.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.057+0000 7fa6d9bab700 1 --2- 172.21.15.103:0/3486683213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6d40b7120 0x7fa6d40b3040 secure :-1 s=READY pgs=993 cs=0 l=1 rx=0x7fa6d406ae90 tx=0x7fa6c0007a40).stop 2020-04-22T14:11:57.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.057+0000 7fa6d9bab700 1 -- 172.21.15.103:0/3486683213 shutdown_connections 2020-04-22T14:11:57.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.057+0000 7fa6d9bab700 1 --2- 172.21.15.103:0/3486683213 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa6bc04d980 0x7fa6bc04fe40 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:57.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.057+0000 7fa6d9bab700 1 --2- 172.21.15.103:0/3486683213 >> v2:172.21.15.86:3300/0 conn(0x7fa6d41435f0 0x7fa6d4131710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:57.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.057+0000 7fa6d9bab700 1 --2- 172.21.15.103:0/3486683213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6d40b7120 0x7fa6d40b3040 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:57.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.057+0000 7fa6d9bab700 1 -- 172.21.15.103:0/3486683213 >> 172.21.15.103:0/3486683213 conn(0x7fa6d40614d0 msgr2=0x7fa6d40b7570 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:57.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.057+0000 7fa6d9bab700 1 -- 172.21.15.103:0/3486683213 shutdown_connections 2020-04-22T14:11:57.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.057+0000 7fa6d9bab700 1 -- 172.21.15.103:0/3486683213 wait complete. 2020-04-22T14:11:57.069 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:57.083 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-22T14:11:57.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.230+0000 7f1136dae700 1 Processor -- start 2020-04-22T14:11:57.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.230+0000 7f1136dae700 1 -- start start 2020-04-22T14:11:57.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.230+0000 7f1136dae700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f11300b3bd0 0x7f1130143650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:57.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.230+0000 7f1136dae700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1130148310 con 0x7f1130143ab0 2020-04-22T14:11:57.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.230+0000 7f1136dae700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11301485b0 con 0x7f11300b9140 2020-04-22T14:11:57.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.230+0000 7f1136dae700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11300b9520 con 0x7f11300b3bd0 2020-04-22T14:11:57.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.230+0000 7f112ffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f11300b3bd0 0x7f1130143650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:57.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.230+0000 7f1134b4a700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f11300b9140 0x7f11300aed90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44520/0 (socket says 172.21.15.103:44520) 2020-04-22T14:11:57.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.230+0000 7f1134b4a700 1 -- 172.21.15.103:0/3399566046 learned_addr learned my addr 172.21.15.103:0/3399566046 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:57.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.231+0000 7f112ffff700 1 -- 172.21.15.103:0/3399566046 >> v1:172.21.15.103:6789/0 conn(0x7f11300b9140 legacy=0x7f11300aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:57.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.231+0000 7f112ffff700 1 -- 172.21.15.103:0/3399566046 >> v1:172.21.15.86:6789/0 conn(0x7f1130143ab0 legacy=0x7f1130143f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:57.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.231+0000 7f112ffff700 1 -- 172.21.15.103:0/3399566046 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11300b3050 con 0x7f11300b3bd0 2020-04-22T14:11:57.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.231+0000 7f112ffff700 1 --2- 172.21.15.103:0/3399566046 >> v2:172.21.15.103:3300/0 conn(0x7f11300b3bd0 0x7f1130143650 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1124002f30 tx=0x7f1124007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:57.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.231+0000 7f112ffff700 1 --2- 172.21.15.103:0/3399566046 >> v2:172.21.15.103:3300/0 conn(0x7f11300b3bd0 0x7f1130143650 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1124002f30 tx=0x7f1124007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:57.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.231+0000 7f112ffff700 1 --2- 172.21.15.103:0/3399566046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11300b3bd0 0x7f1130143650 secure :-1 s=READY pgs=995 cs=0 l=1 rx=0x7f1124002f30 tx=0x7f1124007a40).ready entity=mon.1 client_cookie=1858199c1e94615 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:57.237 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.231+0000 7f112ffff700 1 --2- 172.21.15.103:0/3399566046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11300b3bd0 0x7f1130143650 secure :-1 s=THROTTLE_DONE pgs=995 cs=0 l=1 rx=0x7f1124002f30 tx=0x7f1124007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:57.237 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.231+0000 7f112f7fe700 1 -- 172.21.15.103:0/3399566046 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1124011470 con 0x7f11300b3bd0 2020-04-22T14:11:57.237 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.231+0000 7f112ffff700 1 --2- 172.21.15.103:0/3399566046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11300b3bd0 0x7f1130143650 secure :-1 s=THROTTLE_DONE pgs=995 cs=0 l=1 rx=0x7f1124002f30 tx=0x7f1124007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:57.237 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.231+0000 7f112ffff700 1 --2- 172.21.15.103:0/3399566046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11300b3bd0 0x7f1130143650 secure :-1 s=THROTTLE_DONE pgs=995 cs=0 l=1 rx=0x7f1124002f30 tx=0x7f1124007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:57.237 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.231+0000 7f112f7fe700 1 -- 172.21.15.103:0/3399566046 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11240115d0 con 0x7f11300b3bd0 2020-04-22T14:11:57.237 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.231+0000 7f112f7fe700 1 -- 172.21.15.103:0/3399566046 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11240119f0 con 0x7f11300b3bd0 2020-04-22T14:11:57.237 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.231+0000 7f1136dae700 1 -- 172.21.15.103:0/3399566046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11300b3bd0 msgr2=0x7f1130143650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:57.238 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.231+0000 7f1136dae700 1 --2- 172.21.15.103:0/3399566046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11300b3bd0 0x7f1130143650 secure :-1 s=READY pgs=995 cs=0 l=1 rx=0x7f1124002f30 tx=0x7f1124007a40).stop 2020-04-22T14:11:57.238 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.232+0000 7f1136dae700 1 -- 172.21.15.103:0/3399566046 shutdown_connections 2020-04-22T14:11:57.238 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.232+0000 7f1136dae700 1 --2- 172.21.15.103:0/3399566046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11300b3bd0 0x7f1130143650 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:57.238 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.232+0000 7f1136dae700 1 -- 172.21.15.103:0/3399566046 >> 172.21.15.103:0/3399566046 conn(0x7f113005b7b0 msgr2=0x7f11300b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:57.238 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.232+0000 7f1136dae700 1 -- 172.21.15.103:0/3399566046 shutdown_connections 2020-04-22T14:11:57.238 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.232+0000 7f1136dae700 1 -- 172.21.15.103:0/3399566046 wait complete. 2020-04-22T14:11:57.238 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.232+0000 7f1136dae700 1 Processor -- start 2020-04-22T14:11:57.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.233+0000 7f1136dae700 1 -- start start 2020-04-22T14:11:57.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.233+0000 7f1136dae700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1130143ab0 0x7f1130151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:57.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.233+0000 7f1136dae700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f113013fbd0 con 0x7f11300b9140 2020-04-22T14:11:57.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.233+0000 7f1136dae700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1130146930 con 0x7f11300b3bd0 2020-04-22T14:11:57.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.233+0000 7f1136dae700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1130146d70 con 0x7f1130143ab0 2020-04-22T14:11:57.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.233+0000 7f1134b4a700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f11300b3bd0 0x7f113012eca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44528/0 (socket says 172.21.15.103:44528) 2020-04-22T14:11:57.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.233+0000 7f1134b4a700 1 -- 172.21.15.103:0/4246634355 learned_addr learned my addr 172.21.15.103:0/4246634355 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:57.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.233+0000 7f113534b700 1 --2- 172.21.15.103:0/4246634355 >> v2:172.21.15.103:3300/0 conn(0x7f1130143ab0 0x7f1130151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:57.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.234+0000 7f112dffb700 1 -- 172.21.15.103:0/4246634355 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1042201719 0 0) 0x7f1130146930 con 0x7f11300b3bd0 2020-04-22T14:11:57.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.234+0000 7f112dffb700 1 -- 172.21.15.103:0/4246634355 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1110002fe0 con 0x7f11300b3bd0 2020-04-22T14:11:57.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.234+0000 7f113534b700 1 -- 172.21.15.103:0/4246634355 >> v1:172.21.15.103:6789/0 conn(0x7f11300b3bd0 legacy=0x7f113012eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:57.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.234+0000 7f113534b700 1 -- 172.21.15.103:0/4246634355 >> v1:172.21.15.86:6789/0 conn(0x7f11300b9140 legacy=0x7f1130140070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:57.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.234+0000 7f113534b700 1 -- 172.21.15.103:0/4246634355 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1130142ec0 con 0x7f1130143ab0 2020-04-22T14:11:57.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.234+0000 7f113534b700 1 --2- 172.21.15.103:0/4246634355 >> v2:172.21.15.103:3300/0 conn(0x7f1130143ab0 0x7f1130151a50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1130067530 tx=0x7f1128010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:57.244 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.234+0000 7f113534b700 1 --2- 172.21.15.103:0/4246634355 >> v2:172.21.15.103:3300/0 conn(0x7f1130143ab0 0x7f1130151a50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1130067530 tx=0x7f1128010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:57.244 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.234+0000 7f113534b700 1 --2- 172.21.15.103:0/4246634355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1130143ab0 0x7f1130151a50 secure :-1 s=READY pgs=997 cs=0 l=1 rx=0x7f1130067530 tx=0x7f1128010ba0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:57.244 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.234+0000 7f113534b700 1 --2- 172.21.15.103:0/4246634355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1130143ab0 0x7f1130151a50 secure :-1 s=THROTTLE_DONE pgs=997 cs=0 l=1 rx=0x7f1130067530 tx=0x7f1128010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:57.244 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.234+0000 7f112dffb700 1 -- 172.21.15.103:0/4246634355 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1128002240 con 0x7f1130143ab0 2020-04-22T14:11:57.244 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.234+0000 7f113534b700 1 --2- 172.21.15.103:0/4246634355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1130143ab0 0x7f1130151a50 secure :-1 s=THROTTLE_DONE pgs=997 cs=0 l=1 rx=0x7f1130067530 tx=0x7f1128010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:57.244 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.234+0000 7f113534b700 1 --2- 172.21.15.103:0/4246634355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1130143ab0 0x7f1130151a50 secure :-1 s=THROTTLE_DONE pgs=997 cs=0 l=1 rx=0x7f1130067530 tx=0x7f1128010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:57.244 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.234+0000 7f112dffb700 1 -- 172.21.15.103:0/4246634355 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11280023a0 con 0x7f1130143ab0 2020-04-22T14:11:57.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.234+0000 7f112dffb700 1 -- 172.21.15.103:0/4246634355 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1128002780 con 0x7f1130143ab0 2020-04-22T14:11:57.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.234+0000 7f1136dae700 1 -- 172.21.15.103:0/4246634355 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11301479a0 con 0x7f1130143ab0 2020-04-22T14:11:57.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.234+0000 7f1136dae700 1 -- 172.21.15.103:0/4246634355 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f113012f570 con 0x7f1130143ab0 2020-04-22T14:11:57.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.235+0000 7f113534b700 1 --2- 172.21.15.103:0/4246634355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1130143ab0 0x7f1130151a50 secure :-1 s=THROTTLE_DONE pgs=997 cs=0 l=1 rx=0x7f1130067530 tx=0x7f1128010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:57.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.235+0000 7f1136dae700 1 -- 172.21.15.103:0/4246634355 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1130147cb0 con 0x7f1130143ab0 2020-04-22T14:11:57.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.235+0000 7f112dffb700 1 -- 172.21.15.103:0/4246634355 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f11280029f0 con 0x7f1130143ab0 2020-04-22T14:11:57.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.235+0000 7f113534b700 1 --2- 172.21.15.103:0/4246634355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1130143ab0 0x7f1130151a50 secure :-1 s=THROTTLE_DONE pgs=997 cs=0 l=1 rx=0x7f1130067530 tx=0x7f1128010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:57.246 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.235+0000 7f112dffb700 1 --2- 172.21.15.103:0/4246634355 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f111004dcf0 0x7f11100501b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:57.246 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.235+0000 7f112dffb700 1 -- 172.21.15.103:0/4246634355 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f11280618f0 con 0x7f1130143ab0 2020-04-22T14:11:57.246 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.235+0000 7f1134b4a700 1 --2- 172.21.15.103:0/4246634355 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f111004dcf0 0x7f11100501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:57.246 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.236+0000 7f1134b4a700 1 --2- 172.21.15.103:0/4246634355 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f111004dcf0 0x7f11100501b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1120000eb0 tx=0x7f1120001660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:57.246 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.236+0000 7f1134b4a700 1 --2- 172.21.15.103:0/4246634355 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f111004dcf0 0x7f11100501b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1120000eb0 tx=0x7f1120001660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:57.246 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.236+0000 7f1134b4a700 1 --2- 172.21.15.103:0/4246634355 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f111004dcf0 0x7f11100501b0 secure :-1 s=READY pgs=374 cs=0 l=1 rx=0x7f1120000eb0 tx=0x7f1120001660).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:57.246 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.239+0000 7f113534b700 1 --2- 172.21.15.103:0/4246634355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1130143ab0 0x7f1130151a50 secure :-1 s=THROTTLE_DONE pgs=997 cs=0 l=1 rx=0x7f1130067530 tx=0x7f1128010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:57.247 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.239+0000 7f112dffb700 1 -- 172.21.15.103:0/4246634355 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f1130147cb0 con 0x7f1130143ab0 2020-04-22T14:11:57.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.382+0000 7f1136dae700 1 -- 172.21.15.103:0/4246634355 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1130147cb0 con 0x7f1130143ab0 2020-04-22T14:11:57.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.382+0000 7f113534b700 1 --2- 172.21.15.103:0/4246634355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1130143ab0 0x7f1130151a50 secure :-1 s=THROTTLE_DONE pgs=997 cs=0 l=1 rx=0x7f1130067530 tx=0x7f1128010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:57.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.382+0000 7f112dffb700 1 -- 172.21.15.103:0/4246634355 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v67) v1 ==== 100+0+10 (secure 0 0 0) 0x7f1130147cb0 con 0x7f1130143ab0 2020-04-22T14:11:57.385 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:11:57.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.383+0000 7f1136dae700 1 -- 172.21.15.103:0/4246634355 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f111004dcf0 msgr2=0x7f11100501b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:57.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.383+0000 7f1136dae700 1 --2- 172.21.15.103:0/4246634355 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f111004dcf0 0x7f11100501b0 secure :-1 s=READY pgs=374 cs=0 l=1 rx=0x7f1120000eb0 tx=0x7f1120001660).stop 2020-04-22T14:11:57.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.383+0000 7f1136dae700 1 -- 172.21.15.103:0/4246634355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1130143ab0 msgr2=0x7f1130151a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:57.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.383+0000 7f1136dae700 1 --2- 172.21.15.103:0/4246634355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1130143ab0 0x7f1130151a50 secure :-1 s=READY pgs=997 cs=0 l=1 rx=0x7f1130067530 tx=0x7f1128010ba0).stop 2020-04-22T14:11:57.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.383+0000 7f1136dae700 1 -- 172.21.15.103:0/4246634355 shutdown_connections 2020-04-22T14:11:57.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.383+0000 7f1136dae700 1 --2- 172.21.15.103:0/4246634355 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f111004dcf0 0x7f11100501b0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:57.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.383+0000 7f1136dae700 1 --2- 172.21.15.103:0/4246634355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1130143ab0 0x7f1130151a50 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:57.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.383+0000 7f1136dae700 1 -- 172.21.15.103:0/4246634355 >> 172.21.15.103:0/4246634355 conn(0x7f113005b7b0 msgr2=0x7f113013f250 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:57.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.383+0000 7f1136dae700 1 -- 172.21.15.103:0/4246634355 shutdown_connections 2020-04-22T14:11:57.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.383+0000 7f1136dae700 1 -- 172.21.15.103:0/4246634355 wait complete. 2020-04-22T14:11:57.396 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-04-22T14:11:57.396 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:57.409 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:11:57.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.554+0000 7f6fe3283700 1 Processor -- start 2020-04-22T14:11:57.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.554+0000 7f6fe3283700 1 -- start start 2020-04-22T14:11:57.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.555+0000 7f6fe3283700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6fdc143f90 0x7f6fdc0b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:57.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.555+0000 7f6fe3283700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6fdc05f3e0 0x7f6fdc1448d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:11:57.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.555+0000 7f6fe3283700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fdc062950 con 0x7f6fdc0b2940 2020-04-22T14:11:57.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.555+0000 7f6fe3283700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fdc062bf0 con 0x7f6fdc143f90 2020-04-22T14:11:57.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.555+0000 7f6fe3283700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc144430 con 0x7f6fdc05f3e0 2020-04-22T14:11:57.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.555+0000 7f6fe081e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6fdc143f90 0x7f6fdc0b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:57.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.555+0000 7f6fe101f700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f6fdc0b2940 0x7f6fdc143880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44534/0 (socket says 172.21.15.103:44534) 2020-04-22T14:11:57.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.555+0000 7f6fe101f700 1 -- 172.21.15.103:0/2137640591 learned_addr learned my addr 172.21.15.103:0/2137640591 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:11:57.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.555+0000 7f6fe1820700 1 --2- 172.21.15.103:0/2137640591 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6fdc05f3e0 0x7f6fdc1448d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:57.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.555+0000 7f6fe081e700 1 -- 172.21.15.103:0/2137640591 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6fdc05f3e0 msgr2=0x7f6fdc1448d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:11:57.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.556+0000 7f6fe081e700 1 --2- 172.21.15.103:0/2137640591 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6fdc05f3e0 0x7f6fdc1448d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:57.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.555+0000 7f6fcffff700 1 -- 172.21.15.103:0/2137640591 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 505963442 0 0) 0x7f6fdc062950 con 0x7f6fdc0b2940 2020-04-22T14:11:57.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.556+0000 7f6fe081e700 1 -- 172.21.15.103:0/2137640591 >> v1:172.21.15.103:6789/0 conn(0x7f6fdc0b2940 legacy=0x7f6fdc143880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:57.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.556+0000 7f6fe081e700 1 -- 172.21.15.103:0/2137640591 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fdc0b2d20 con 0x7f6fdc143f90 2020-04-22T14:11:57.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.556+0000 7f6fe081e700 1 --2- 172.21.15.103:0/2137640591 >> v2:172.21.15.103:3300/0 conn(0x7f6fdc143f90 0x7f6fdc0b40f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6fd0002f30 tx=0x7f6fd0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:57.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.556+0000 7f6fe081e700 1 --2- 172.21.15.103:0/2137640591 >> v2:172.21.15.103:3300/0 conn(0x7f6fdc143f90 0x7f6fdc0b40f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6fd0002f30 tx=0x7f6fd0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:57.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.556+0000 7f6fe081e700 1 --2- 172.21.15.103:0/2137640591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fdc143f90 0x7f6fdc0b40f0 secure :-1 s=READY pgs=999 cs=0 l=1 rx=0x7f6fd0002f30 tx=0x7f6fd0007a40).ready entity=mon.1 client_cookie=ee2ee5d2592ceccd server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:57.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.556+0000 7f6fe081e700 1 --2- 172.21.15.103:0/2137640591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fdc143f90 0x7f6fdc0b40f0 secure :-1 s=THROTTLE_DONE pgs=999 cs=0 l=1 rx=0x7f6fd0002f30 tx=0x7f6fd0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:57.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.556+0000 7f6fcffff700 1 -- 172.21.15.103:0/2137640591 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fd0011470 con 0x7f6fdc143f90 2020-04-22T14:11:57.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.556+0000 7f6fe081e700 1 --2- 172.21.15.103:0/2137640591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fdc143f90 0x7f6fdc0b40f0 secure :-1 s=THROTTLE_DONE pgs=999 cs=0 l=1 rx=0x7f6fd0002f30 tx=0x7f6fd0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:57.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.556+0000 7f6fe081e700 1 --2- 172.21.15.103:0/2137640591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fdc143f90 0x7f6fdc0b40f0 secure :-1 s=THROTTLE_DONE pgs=999 cs=0 l=1 rx=0x7f6fd0002f30 tx=0x7f6fd0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:57.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.556+0000 7f6fcffff700 1 -- 172.21.15.103:0/2137640591 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd0011610 con 0x7f6fdc143f90 2020-04-22T14:11:57.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.556+0000 7f6fcffff700 1 -- 172.21.15.103:0/2137640591 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fd00119f0 con 0x7f6fdc143f90 2020-04-22T14:11:57.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.556+0000 7f6fe3283700 1 -- 172.21.15.103:0/2137640591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fdc143f90 msgr2=0x7f6fdc0b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:57.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.556+0000 7f6fe3283700 1 --2- 172.21.15.103:0/2137640591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fdc143f90 0x7f6fdc0b40f0 secure :-1 s=READY pgs=999 cs=0 l=1 rx=0x7f6fd0002f30 tx=0x7f6fd0007a40).stop 2020-04-22T14:11:57.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.556+0000 7f6fe3283700 1 -- 172.21.15.103:0/2137640591 shutdown_connections 2020-04-22T14:11:57.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.556+0000 7f6fe3283700 1 --2- 172.21.15.103:0/2137640591 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6fdc05f3e0 0x7f6fdc1448d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:11:57.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.556+0000 7f6fe3283700 1 --2- 172.21.15.103:0/2137640591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fdc143f90 0x7f6fdc0b40f0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:57.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.556+0000 7f6fe3283700 1 -- 172.21.15.103:0/2137640591 >> 172.21.15.103:0/2137640591 conn(0x7f6fdc05ad30 msgr2=0x7f6fdc05b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:57.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.556+0000 7f6fe3283700 1 -- 172.21.15.103:0/2137640591 shutdown_connections 2020-04-22T14:11:57.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.556+0000 7f6fe3283700 1 -- 172.21.15.103:0/2137640591 wait complete. 2020-04-22T14:11:57.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.557+0000 7f6fe3283700 1 Processor -- start 2020-04-22T14:11:57.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.557+0000 7f6fe3283700 1 -- start start 2020-04-22T14:11:57.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.558+0000 7f6fe3283700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6fdc05f3e0 0x7f6fdc13dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:57.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.558+0000 7f6fe3283700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6fdc143f90 0x7f6fdc13fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:57.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.558+0000 7f6fe3283700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fdc0add00 con 0x7f6fdc0b2940 2020-04-22T14:11:57.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.558+0000 7f6fe3283700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fdc0adfa0 con 0x7f6fdc143f90 2020-04-22T14:11:57.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.558+0000 7f6fe3283700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fdc0ac740 con 0x7f6fdc05f3e0 2020-04-22T14:11:57.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.558+0000 7f6fe101f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6fdc05f3e0 0x7f6fdc13dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:57.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.558+0000 7f6fe101f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6fdc05f3e0 0x7f6fdc13dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52352/0 (socket says 172.21.15.103:52352) 2020-04-22T14:11:57.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.558+0000 7f6fe081e700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f6fdc0b2940 0x7f6fdc131600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44540/0 (socket says 172.21.15.103:44540) 2020-04-22T14:11:57.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.558+0000 7f6fe101f700 1 -- 172.21.15.103:0/4174027514 learned_addr learned my addr 172.21.15.103:0/4174027514 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:11:57.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.558+0000 7f6fe1820700 1 --2- 172.21.15.103:0/4174027514 >> v2:172.21.15.86:3300/0 conn(0x7f6fdc143f90 0x7f6fdc13fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:57.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.558+0000 7f6fe101f700 1 -- 172.21.15.103:0/4174027514 >> v2:172.21.15.86:3300/0 conn(0x7f6fdc143f90 msgr2=0x7f6fdc13fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:57.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.558+0000 7f6fe101f700 1 --2- 172.21.15.103:0/4174027514 >> v2:172.21.15.86:3300/0 conn(0x7f6fdc143f90 0x7f6fdc13fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:57.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.558+0000 7f6fce7fc700 1 -- 172.21.15.103:0/4174027514 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2334018411 0 0) 0x7f6fdc0add00 con 0x7f6fdc0b2940 2020-04-22T14:11:57.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.558+0000 7f6fe101f700 1 -- 172.21.15.103:0/4174027514 >> v1:172.21.15.103:6789/0 conn(0x7f6fdc0b2940 legacy=0x7f6fdc131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:57.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.558+0000 7f6fe101f700 1 -- 172.21.15.103:0/4174027514 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fdc0ac880 con 0x7f6fdc05f3e0 2020-04-22T14:11:57.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.558+0000 7f6fe101f700 1 --2- 172.21.15.103:0/4174027514 >> v2:172.21.15.103:3300/0 conn(0x7f6fdc05f3e0 0x7f6fdc13dda0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6fd4000f00 tx=0x7f6fd4010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:57.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.559+0000 7f6fe101f700 1 --2- 172.21.15.103:0/4174027514 >> v2:172.21.15.103:3300/0 conn(0x7f6fdc05f3e0 0x7f6fdc13dda0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6fd4000f00 tx=0x7f6fd4010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:57.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.559+0000 7f6fe101f700 1 --2- 172.21.15.103:0/4174027514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fdc05f3e0 0x7f6fdc13dda0 secure :-1 s=READY pgs=1001 cs=0 l=1 rx=0x7f6fd4000f00 tx=0x7f6fd4010d90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:57.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.559+0000 7f6fe101f700 1 --2- 172.21.15.103:0/4174027514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fdc05f3e0 0x7f6fdc13dda0 secure :-1 s=THROTTLE_DONE pgs=1001 cs=0 l=1 rx=0x7f6fd4000f00 tx=0x7f6fd4010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:57.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.559+0000 7f6fce7fc700 1 -- 172.21.15.103:0/4174027514 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fd4005e30 con 0x7f6fdc05f3e0 2020-04-22T14:11:57.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.559+0000 7f6fe101f700 1 --2- 172.21.15.103:0/4174027514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fdc05f3e0 0x7f6fdc13dda0 secure :-1 s=THROTTLE_DONE pgs=1001 cs=0 l=1 rx=0x7f6fd4000f00 tx=0x7f6fd4010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:57.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.559+0000 7f6fe101f700 1 --2- 172.21.15.103:0/4174027514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fdc05f3e0 0x7f6fdc13dda0 secure :-1 s=THROTTLE_DONE pgs=1001 cs=0 l=1 rx=0x7f6fd4000f00 tx=0x7f6fd4010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:57.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.559+0000 7f6fce7fc700 1 -- 172.21.15.103:0/4174027514 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd4012620 con 0x7f6fdc05f3e0 2020-04-22T14:11:57.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.559+0000 7f6fe3283700 1 -- 172.21.15.103:0/4174027514 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fdc0aecd0 con 0x7f6fdc05f3e0 2020-04-22T14:11:57.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.559+0000 7f6fce7fc700 1 -- 172.21.15.103:0/4174027514 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fd40129c0 con 0x7f6fdc05f3e0 2020-04-22T14:11:57.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.559+0000 7f6fe3283700 1 -- 172.21.15.103:0/4174027514 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fdc0acd40 con 0x7f6fdc05f3e0 2020-04-22T14:11:57.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.559+0000 7f6fe101f700 1 --2- 172.21.15.103:0/4174027514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fdc05f3e0 0x7f6fdc13dda0 secure :-1 s=THROTTLE_DONE pgs=1001 cs=0 l=1 rx=0x7f6fd4000f00 tx=0x7f6fd4010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:57.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.560+0000 7f6fce7fc700 1 -- 172.21.15.103:0/4174027514 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f6fd4012bc0 con 0x7f6fdc05f3e0 2020-04-22T14:11:57.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.560+0000 7f6fe101f700 1 --2- 172.21.15.103:0/4174027514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fdc05f3e0 0x7f6fdc13dda0 secure :-1 s=THROTTLE_DONE pgs=1001 cs=0 l=1 rx=0x7f6fd4000f00 tx=0x7f6fd4010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:57.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.560+0000 7f6fe3283700 1 -- 172.21.15.103:0/4174027514 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fdc0adb30 con 0x7f6fdc05f3e0 2020-04-22T14:11:57.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.560+0000 7f6fce7fc700 1 --2- 172.21.15.103:0/4174027514 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6fbc04d7b0 0x7f6fbc04fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:11:57.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.560+0000 7f6fce7fc700 1 -- 172.21.15.103:0/4174027514 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f6fd40090c0 con 0x7f6fdc05f3e0 2020-04-22T14:11:57.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.560+0000 7f6fe081e700 1 --2- 172.21.15.103:0/4174027514 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6fbc04d7b0 0x7f6fbc04fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:11:57.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.560+0000 7f6fe081e700 1 --2- 172.21.15.103:0/4174027514 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6fbc04d7b0 0x7f6fbc04fc70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6fd00084c0 tx=0x7f6fd0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:57.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.561+0000 7f6fe081e700 1 --2- 172.21.15.103:0/4174027514 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6fbc04d7b0 0x7f6fbc04fc70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6fd00084c0 tx=0x7f6fd0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:57.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.561+0000 7f6fe081e700 1 --2- 172.21.15.103:0/4174027514 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6fbc04d7b0 0x7f6fbc04fc70 secure :-1 s=READY pgs=375 cs=0 l=1 rx=0x7f6fd00084c0 tx=0x7f6fd0007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:11:57.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.564+0000 7f6fe101f700 1 --2- 172.21.15.103:0/4174027514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fdc05f3e0 0x7f6fdc13dda0 secure :-1 s=THROTTLE_DONE pgs=1001 cs=0 l=1 rx=0x7f6fd4000f00 tx=0x7f6fd4010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:57.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.564+0000 7f6fce7fc700 1 -- 172.21.15.103:0/4174027514 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f6fd403cd30 con 0x7f6fdc05f3e0 2020-04-22T14:11:57.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.753+0000 7f6fe3283700 1 -- 172.21.15.103:0/4174027514 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6fdc056c90 con 0x7f6fdc05f3e0 2020-04-22T14:11:57.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.753+0000 7f6fe101f700 1 --2- 172.21.15.103:0/4174027514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fdc05f3e0 0x7f6fdc13dda0 secure :-1 s=THROTTLE_DONE pgs=1001 cs=0 l=1 rx=0x7f6fd4000f00 tx=0x7f6fd4010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:11:57.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.753+0000 7f6fce7fc700 1 -- 172.21.15.103:0/4174027514 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+2145 (secure 0 0 0) 0x7f6fd4040350 con 0x7f6fdc05f3e0 2020-04-22T14:11:57.756 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:11:57.756 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/1837726033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1837726033},{"type":"v1","addr":"172.21.15.86:6835","nonce":1837726033}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:54.377522+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":16,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:11:57.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.755+0000 7f6fe3283700 1 -- 172.21.15.103:0/4174027514 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6fbc04d7b0 msgr2=0x7f6fbc04fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:57.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.755+0000 7f6fe3283700 1 --2- 172.21.15.103:0/4174027514 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6fbc04d7b0 0x7f6fbc04fc70 secure :-1 s=READY pgs=375 cs=0 l=1 rx=0x7f6fd00084c0 tx=0x7f6fd0007a40).stop 2020-04-22T14:11:57.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.755+0000 7f6fe3283700 1 -- 172.21.15.103:0/4174027514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fdc05f3e0 msgr2=0x7f6fdc13dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:11:57.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.755+0000 7f6fe3283700 1 --2- 172.21.15.103:0/4174027514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fdc05f3e0 0x7f6fdc13dda0 secure :-1 s=READY pgs=1001 cs=0 l=1 rx=0x7f6fd4000f00 tx=0x7f6fd4010d90).stop 2020-04-22T14:11:57.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.755+0000 7f6fe3283700 1 -- 172.21.15.103:0/4174027514 shutdown_connections 2020-04-22T14:11:57.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.755+0000 7f6fe3283700 1 --2- 172.21.15.103:0/4174027514 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6fbc04d7b0 0x7f6fbc04fc70 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:57.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.755+0000 7f6fe3283700 1 --2- 172.21.15.103:0/4174027514 >> v2:172.21.15.86:3300/0 conn(0x7f6fdc143f90 0x7f6fdc13fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:57.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.755+0000 7f6fe3283700 1 --2- 172.21.15.103:0/4174027514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fdc05f3e0 0x7f6fdc13dda0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:11:57.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.755+0000 7f6fe3283700 1 -- 172.21.15.103:0/4174027514 >> 172.21.15.103:0/4174027514 conn(0x7f6fdc05ad30 msgr2=0x7f6fdc05b110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:11:57.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.755+0000 7f6fe3283700 1 -- 172.21.15.103:0/4174027514 shutdown_connections 2020-04-22T14:11:57.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:11:57.755+0000 7f6fe3283700 1 -- 172.21.15.103:0/4174027514 wait complete. 2020-04-22T14:11:57.759 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 43 2020-04-22T14:11:57.977 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 6532}, u'last_failure_osd_epoch': 65, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 11, u'failed': [], u'epoch': 43, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [12], u'info': {u'gid_6532': {u'export_targets': [], u'name': u'a', u'incarnation': 39, u'state_seq': 16, u'state': u'up:active', u'gid': 6532, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 2753934632, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 2753934632, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/2753934632'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:10:38.817638+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:11:54.377522+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:11:57.978 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:11:57.978 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:57.992 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:11:58.150 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:11:58.150 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:11:58.151 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:11:58.151 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 6532, 2020-04-22T14:11:58.151 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:11:58.151 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:11:58.151 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 55.649097058000002, 2020-04-22T14:11:58.151 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 43, 2020-04-22T14:11:58.151 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 67, 2020-04-22T14:11:58.152 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 67, 2020-04-22T14:11:58.152 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 55.872891619000001 2020-04-22T14:11:58.152 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:11:58.159 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 6532, "want_state": "up:active", "state": "up:active", "rank_uptime": 55.649097058000002, "mdsmap_epoch": 43, "osdmap_epoch": 67, "osdmap_epoch_barrier": 67, "uptime": 55.872891619000001 } 2020-04-22T14:11:58.159 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-04-22T14:11:58.159 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-04-22T14:11:58.159 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:58.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:11:58.172 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:11:58.231 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:11:58.232 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:11:58.232 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:11:58.232 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:11:58.232 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:11:58.232 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:11:58.232 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:11:58.232 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:11:58.233 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:11:58.233 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:11:58.233 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:11:58.233 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:11:58.233 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:11:58.233 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:11:58.233 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:11:58.233 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42122sec preferred_lft 42122sec 2020-04-22T14:11:58.234 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:11:58.234 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:11:58.234 INFO:teuthology.orchestra.run.smithi103.stdout:18: brx.1@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:11:58.234 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 86:6a:e2:0f:ca:92 brd ff:ff:ff:ff:ff:ff link-netnsid 1 2020-04-22T14:11:58.235 INFO:teuthology.orchestra.run.smithi103.stdout:20: brx.0@if2: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:11:58.235 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether d6:00:10:e7:64:03 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:11:58.235 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-04-22T14:11:58.235 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:58.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:11:58.286 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:11:58.368 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:58.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:11:58.416 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge con-name ceph-brx ifname ceph-brx stp no' 2020-04-22T14:11:58.524 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' (d5614ed3-5c8f-4058-8ede-e23c83dae48a) successfully added. 2020-04-22T14:11:58.524 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:58.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:11:58.542 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection modify ceph-brx ipv4.addresses 192.168.255.254/16 ipv4.method manual' 2020-04-22T14:11:58.659 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:58.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:11:58.674 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up ceph-brx' 2020-04-22T14:11:58.786 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (master waiting for slaves) (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/25) 2020-04-22T14:11:58.787 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:58.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:11:58.802 INFO:teuthology.orchestra.run.smithi103:> touch /tmp/python-ceph-brx 2020-04-22T14:11:58.861 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:58.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:11:58.910 INFO:teuthology.orchestra.run.smithi103:> cat /proc/sys/net/ipv4/ip_forward 2020-04-22T14:11:58.970 INFO:teuthology.orchestra.run.smithi103.stdout:0 2020-04-22T14:11:58.970 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:59.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:11:59.018 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 0 > /tmp/python-ceph-brx' 2020-04-22T14:11:59.097 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:59.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:11:59.141 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 1 > /proc/sys/net/ipv4/ip_forward' 2020-04-22T14:11:59.219 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:59.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:11:59.262 INFO:teuthology.orchestra.run.smithi103:> route 2020-04-22T14:11:59.321 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2020-04-22T14:11:59.321 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-04-22T14:11:59.321 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 102 0 0 enp3s0f1 2020-04-22T14:11:59.321 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 102 0 0 enp3s0f1 2020-04-22T14:11:59.322 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 425 0 0 ceph-brx 2020-04-22T14:11:59.322 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:59.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:11:59.370 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-04-22T14:11:59.444 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:59.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:11:59.493 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-04-22T14:11:59.568 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:59.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:11:59.615 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-04-22T14:11:59.691 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:59.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:11:59.742 INFO:teuthology.orchestra.run.smithi103:> ip netns list 2020-04-22T14:11:59.802 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:59.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:11:59.856 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:11:59.917 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 2020-04-22T14:11:59.917 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 1 2020-04-22T14:11:59.917 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:11:59.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:11:59.965 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:12:00.023 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 2020-04-22T14:12:00.023 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 1 2020-04-22T14:12:00.024 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:00.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:00.071 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:12:00.129 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 2020-04-22T14:12:00.130 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 1 2020-04-22T14:12:00.130 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:00.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:00.178 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:12:00.254 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:00.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:00.303 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 2' 2020-04-22T14:12:00.381 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2020-04-22T14:12:00.381 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:00.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:00.424 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.2' 2020-04-22T14:12:00.502 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:00.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:00.547 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0' 2020-04-22T14:12:00.654 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:00.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:00.668 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up' 2020-04-22T14:12:00.781 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:00.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:00.796 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up' 2020-04-22T14:12:00.907 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:00.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:00.920 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254' 2020-04-22T14:12:01.040 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:01.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:01.053 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:12:01.129 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:01.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:01.179 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge-slave con-name brx.2 ifname brx.2 master ceph-brx' 2020-04-22T14:12:01.290 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.2' (f9e592cb-ba26-47e4-84b9-8977d58afed0) successfully added. 2020-04-22T14:12:01.290 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:01.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:01.318 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up brx.2' 2020-04-22T14:12:01.477 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/26) 2020-04-22T14:12:01.543 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2020-04-22T14:12:01.543 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi103.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2020-04-22T14:12:01.543 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:01.565 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:12:01.565 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:12:01.624 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:01.672 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:12:01.673 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:12:01.739 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:12:01.746 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:12:01.747 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:01.793 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:12:01.794 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:12:01.853 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-04-22T14:12:01.853 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:01.901 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:12:01.944 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:01.960 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:12:01.960 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:12:02.028 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:12:02.032 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:2020-04-22T14:12:02.030+0000 7f1fd63f61c0 -1 init, newargv = 0x55e963cb0030 newargc=9 2020-04-22T14:12:02.032 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[73520]: starting ceph client 2020-04-22T14:12:02.035 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:12:02.036 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:02.037 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[73520]: starting fuse 2020-04-22T14:12:02.050 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:12:02.050 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:12:02.115 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:12:02.115 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2020-04-22T14:12:02.115 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:02.159 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:12:02.160 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:12:02.160 INFO:teuthology.orchestra.run.smithi103:> import glob 2020-04-22T14:12:02.160 INFO:teuthology.orchestra.run.smithi103:> import re 2020-04-22T14:12:02.160 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:12:02.160 INFO:teuthology.orchestra.run.smithi103:> import subprocess 2020-04-22T14:12:02.160 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:12:02.161 INFO:teuthology.orchestra.run.smithi103:> def find_socket(client_name): 2020-04-22T14:12:02.161 INFO:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2020-04-22T14:12:02.161 INFO:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2020-04-22T14:12:02.161 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:12:02.161 INFO:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2020-04-22T14:12:02.161 INFO:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2020-04-22T14:12:02.161 INFO:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2020-04-22T14:12:02.161 INFO:teuthology.orchestra.run.smithi103:> return files[0] 2020-04-22T14:12:02.161 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:12:02.162 INFO:teuthology.orchestra.run.smithi103:> for f in files: 2020-04-22T14:12:02.162 INFO:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:12:02.162 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:12:02.162 INFO:teuthology.orchestra.run.smithi103:> return f 2020-04-22T14:12:02.162 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:12:02.162 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:12:02.162 INFO:teuthology.orchestra.run.smithi103:> print(find_socket("client.1")) 2020-04-22T14:12:02.162 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:12:02.274 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.1.73520.asok 2020-04-22T14:12:02.274 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.73520.asok 2020-04-22T14:12:02.275 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:02.289 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:12:02.289 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.73520.asok status 2020-04-22T14:12:02.448 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:12:02.449 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2020-04-22T14:12:02.449 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:12:02.449 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:12:02.449 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "1", 2020-04-22T14:12:02.449 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:12:02.449 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2020-04-22T14:12:02.450 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "73520", 2020-04-22T14:12:02.450 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:12:02.450 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:02.450 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2020-04-22T14:12:02.450 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2020-04-22T14:12:02.450 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 6907, 2020-04-22T14:12:02.450 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2020-04-22T14:12:02.451 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:12:02.451 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:12:02.451 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 6907 2020-04-22T14:12:02.451 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:02.451 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:12:02.451 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:12:02.451 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:12:02.451 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 2831883145 2020-04-22T14:12:02.452 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:02.452 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:02.452 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:12:02.452 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:12:02.452 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:12:02.452 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 2831883145 2020-04-22T14:12:02.454 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:02.454 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.6907 192.168.0.1:0/2831883145", 2020-04-22T14:12:02.454 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.1:0/2831883145", 2020-04-22T14:12:02.455 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2020-04-22T14:12:02.455 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 43, 2020-04-22T14:12:02.455 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 67, 2020-04-22T14:12:02.455 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2020-04-22T14:12:02.455 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklisted": false 2020-04-22T14:12:02.455 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:12:02.456 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:02.469 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:12:02.469 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-22T14:12:02.469 INFO:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:12:02.542 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2020-04-22T14:12:02.542 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-04-22T14:12:02.543 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:02.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:12:02.592 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:12:02.685 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:02.746 INFO:teuthology.orchestra.run.smithi103:> cd /home/ubuntu/cephtest/mnt.1 && sudo ls subdir/childfile 2020-04-22T14:12:02.838 INFO:teuthology.orchestra.run.smithi103.stdout:subdir/childfile 2020-04-22T14:12:02.839 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-04-22T14:12:02.839 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:12:02.871 INFO:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:12:02.982 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:03.013 INFO:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:12:03.121 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-04-22T14:12:03.122 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:12:03.122 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:03.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:03.182 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:12:03.261 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:12:03.262 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:12:03.262 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:12:03.262 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:03.262 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:12:03.262 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:03.262 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:12:03.262 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:12:03.263 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:12:03.263 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:12:03.263 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:12:03.263 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:12:03.263 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:12:03.263 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:12:03.264 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:12:03.264 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42117sec preferred_lft 42117sec 2020-04-22T14:12:03.264 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:12:03.264 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:03.264 INFO:teuthology.orchestra.run.smithi103.stdout:18: brx.1@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:12:03.264 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 86:6a:e2:0f:ca:92 brd ff:ff:ff:ff:ff:ff link-netnsid 1 2020-04-22T14:12:03.264 INFO:teuthology.orchestra.run.smithi103.stdout:20: brx.0@if2: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:12:03.265 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether d6:00:10:e7:64:03 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:12:03.265 INFO:teuthology.orchestra.run.smithi103.stdout:22: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:12:03.265 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 22:d1:35:4c:97:3b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:12:03.265 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:12:03.265 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:03.265 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::4de9:92ad:664b:a2d9/64 scope link noprefixroute 2020-04-22T14:12:03.265 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:03.266 INFO:teuthology.orchestra.run.smithi103.stdout:23: brx.2@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-04-22T14:12:03.266 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 22:d1:35:4c:97:3b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2020-04-22T14:12:03.266 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:03.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:03.310 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:12:03.385 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:03.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:03.436 INFO:teuthology.orchestra.run.smithi103:> nmcli connection show 2020-04-22T14:12:03.512 INFO:teuthology.orchestra.run.smithi103.stdout:NAME UUID TYPE DEVICE 2020-04-22T14:12:03.512 INFO:teuthology.orchestra.run.smithi103.stdout:System enp3s0f1 b0a308d1-bd90-60af-eb7c-0183bb425a1a ethernet enp3s0f1 2020-04-22T14:12:03.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-brx d5614ed3-5c8f-4058-8ede-e23c83dae48a bridge ceph-brx 2020-04-22T14:12:03.513 INFO:teuthology.orchestra.run.smithi103.stdout:brx.2 f9e592cb-ba26-47e4-84b9-8977d58afed0 ethernet brx.2 2020-04-22T14:12:03.513 INFO:teuthology.orchestra.run.smithi103.stdout:eno1 206ad60d-195e-4d4b-a9fe-a5dd1f33a67d ethernet -- 2020-04-22T14:12:03.513 INFO:teuthology.orchestra.run.smithi103.stdout:eno2 894a7dd2-d329-4985-9ef9-84a92c6e1c6c ethernet -- 2020-04-22T14:12:03.513 INFO:teuthology.orchestra.run.smithi103.stdout:enp3s0f0 5a3237ce-06ab-4ae0-818b-45bdf036cb08 ethernet -- 2020-04-22T14:12:03.513 INFO:teuthology.orchestra.run.smithi103.stdout:Wired connection 1 182c9abc-02cb-3996-b501-afab098f7c50 ethernet -- 2020-04-22T14:12:03.514 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:03.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:03.561 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:12:03.620 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2020-04-22T14:12:03.620 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:03.668 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-04-22T14:12:03.668 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:12:03.749 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[73520]: fuse finished with error 0 and tester_r 0 2020-04-22T14:12:03.826 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-04-22T14:12:03.826 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:12:03.826 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:03.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:03.850 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:12:03.958 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:03.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:03.979 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down brx.2' 2020-04-22T14:12:04.137 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.2' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/26) 2020-04-22T14:12:04.137 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:04.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:04.150 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete brx.2' 2020-04-22T14:12:04.259 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.2' (f9e592cb-ba26-47e4-84b9-8977d58afed0) successfully deleted. 2020-04-22T14:12:04.259 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:04.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:04.288 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:12:04.368 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:04.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:04.417 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:12:04.476 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:12:04.476 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:12:04.476 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:12:04.477 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:04.477 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:12:04.477 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:04.477 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:12:04.477 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:12:04.477 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:12:04.477 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:12:04.478 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:12:04.478 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:12:04.478 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:12:04.478 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:12:04.478 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:12:04.478 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42116sec preferred_lft 42116sec 2020-04-22T14:12:04.478 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:12:04.478 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:04.479 INFO:teuthology.orchestra.run.smithi103.stdout:18: brx.1@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:12:04.479 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 86:6a:e2:0f:ca:92 brd ff:ff:ff:ff:ff:ff link-netnsid 1 2020-04-22T14:12:04.479 INFO:teuthology.orchestra.run.smithi103.stdout:20: brx.0@if2: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:12:04.479 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether d6:00:10:e7:64:03 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:12:04.479 INFO:teuthology.orchestra.run.smithi103.stdout:22: ceph-brx: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:12:04.479 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:12:04.479 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:12:04.480 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:04.480 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::4de9:92ad:664b:a2d9/64 scope link noprefixroute 2020-04-22T14:12:04.480 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:04.480 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:04.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:04.524 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:12:04.603 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:04.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:04.649 INFO:teuthology.orchestra.run.smithi103:> nmcli connection show 2020-04-22T14:12:04.726 INFO:teuthology.orchestra.run.smithi103.stdout:NAME UUID TYPE DEVICE 2020-04-22T14:12:04.727 INFO:teuthology.orchestra.run.smithi103.stdout:System enp3s0f1 b0a308d1-bd90-60af-eb7c-0183bb425a1a ethernet enp3s0f1 2020-04-22T14:12:04.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-brx d5614ed3-5c8f-4058-8ede-e23c83dae48a bridge ceph-brx 2020-04-22T14:12:04.727 INFO:teuthology.orchestra.run.smithi103.stdout:eno1 206ad60d-195e-4d4b-a9fe-a5dd1f33a67d ethernet -- 2020-04-22T14:12:04.727 INFO:teuthology.orchestra.run.smithi103.stdout:eno2 894a7dd2-d329-4985-9ef9-84a92c6e1c6c ethernet -- 2020-04-22T14:12:04.727 INFO:teuthology.orchestra.run.smithi103.stdout:enp3s0f0 5a3237ce-06ab-4ae0-818b-45bdf036cb08 ethernet -- 2020-04-22T14:12:04.727 INFO:teuthology.orchestra.run.smithi103.stdout:Wired connection 1 182c9abc-02cb-3996-b501-afab098f7c50 ethernet -- 2020-04-22T14:12:04.727 INFO:tasks.cephfs.mount:Removing the 'ceph-brx' 2020-04-22T14:12:04.728 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:04.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:04.771 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down ceph-brx' 2020-04-22T14:12:04.928 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/25) 2020-04-22T14:12:04.928 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:04.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:04.942 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete ceph-brx' 2020-04-22T14:12:05.049 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' (d5614ed3-5c8f-4058-8ede-e23c83dae48a) successfully deleted. 2020-04-22T14:12:05.050 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:05.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:05.078 INFO:teuthology.orchestra.run.smithi103:> route 2020-04-22T14:12:05.137 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2020-04-22T14:12:05.138 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-04-22T14:12:05.138 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 102 0 0 enp3s0f1 2020-04-22T14:12:05.138 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 102 0 0 enp3s0f1 2020-04-22T14:12:05.138 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:05.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:05.188 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -D FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-04-22T14:12:05.296 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:05.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:05.319 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -D FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-04-22T14:12:05.428 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:05.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:05.457 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -t nat -D POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-04-22T14:12:05.532 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:05.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:05.585 INFO:teuthology.orchestra.run.smithi103:> cat /tmp/python-ceph-brx 2020-04-22T14:12:05.647 INFO:teuthology.orchestra.run.smithi103.stdout:0 2020-04-22T14:12:05.647 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:05.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:05.696 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 0 > /proc/sys/net/ipv4/ip_forward' 2020-04-22T14:12:05.776 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:05.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:05.823 INFO:teuthology.orchestra.run.smithi103:> rm -f /tmp/python-ceph-brx 2020-04-22T14:12:05.880 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:05.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:05.928 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:12:06.012 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.2' netns for '/home/ubuntu/cephtest/mnt.2' 2020-04-22T14:12:06.012 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:12:06.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:06.036 INFO:teuthology.orchestra.run.smithi086:> ip addr 2020-04-22T14:12:06.095 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:12:06.095 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:12:06.095 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:12:06.095 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:06.095 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2020-04-22T14:12:06.096 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:06.096 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:12:06.096 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:12:06.096 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:12:06.096 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:12:06.096 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:12:06.096 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:12:06.097 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:12:06.097 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:12:06.097 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:12:06.097 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 42088sec preferred_lft 42088sec 2020-04-22T14:12:06.097 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2020-04-22T14:12:06.097 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:06.098 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:12:06.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:06.148 INFO:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.2) 2020-04-22T14:12:06.208 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.3' netns for '/home/ubuntu/cephtest/mnt.3' 2020-04-22T14:12:06.209 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:12:06.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:06.259 INFO:teuthology.orchestra.run.smithi086:> ip addr 2020-04-22T14:12:06.332 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:12:06.332 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:12:06.332 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:12:06.332 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:06.333 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2020-04-22T14:12:06.333 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:06.333 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:12:06.333 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:12:06.333 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:12:06.334 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:12:06.334 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:12:06.334 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:12:06.334 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:12:06.334 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:12:06.334 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:12:06.334 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 42088sec preferred_lft 42088sec 2020-04-22T14:12:06.334 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2020-04-22T14:12:06.335 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:06.335 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:12:06.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:06.379 INFO:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.3) 2020-04-22T14:12:06.439 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:06.457 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_create_fsync' 2020-04-22T14:12:06.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.602+0000 7f1a2987a700 1 Processor -- start 2020-04-22T14:12:06.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.602+0000 7f1a2987a700 1 -- start start 2020-04-22T14:12:06.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.603+0000 7f1a2987a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1a24065fe0 0x7f1a241464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:06.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.603+0000 7f1a2987a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1a24063e30 0x7f1a240642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:06.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.603+0000 7f1a2987a700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a24143300 con 0x7f1a2412c0d0 2020-04-22T14:12:06.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.603+0000 7f1a2987a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a241435a0 con 0x7f1a24063e30 2020-04-22T14:12:06.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.603+0000 7f1a2987a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a24143840 con 0x7f1a24065fe0 2020-04-22T14:12:06.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.603+0000 7f1a227fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1a24065fe0 0x7f1a241464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:06.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.603+0000 7f1a22ffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f1a2412c0d0 0x7f1a2405b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44568/0 (socket says 172.21.15.103:44568) 2020-04-22T14:12:06.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.603+0000 7f1a22ffd700 1 -- 172.21.15.103:0/2206207708 learned_addr learned my addr 172.21.15.103:0/2206207708 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:06.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.604+0000 7f1a237fe700 1 --2- 172.21.15.103:0/2206207708 >> v2:172.21.15.86:3300/0 conn(0x7f1a24063e30 0x7f1a240642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:06.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.604+0000 7f1a227fc700 1 -- 172.21.15.103:0/2206207708 >> v2:172.21.15.86:3300/0 conn(0x7f1a24063e30 msgr2=0x7f1a240642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:06.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.604+0000 7f1a227fc700 1 --2- 172.21.15.103:0/2206207708 >> v2:172.21.15.86:3300/0 conn(0x7f1a24063e30 0x7f1a240642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:06.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.604+0000 7f1a227fc700 1 -- 172.21.15.103:0/2206207708 >> v1:172.21.15.103:6789/0 conn(0x7f1a2412c0d0 legacy=0x7f1a2405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:06.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.604+0000 7f1a227fc700 1 -- 172.21.15.103:0/2206207708 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a2405bb50 con 0x7f1a24065fe0 2020-04-22T14:12:06.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.604+0000 7f1a21ffb700 1 -- 172.21.15.103:0/2206207708 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1129393411 0 0) 0x7f1a24143300 con 0x7f1a2412c0d0 2020-04-22T14:12:06.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.604+0000 7f1a227fc700 1 --2- 172.21.15.103:0/2206207708 >> v2:172.21.15.103:3300/0 conn(0x7f1a24065fe0 0x7f1a241464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1a14002f30 tx=0x7f1a14007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:06.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.604+0000 7f1a227fc700 1 --2- 172.21.15.103:0/2206207708 >> v2:172.21.15.103:3300/0 conn(0x7f1a24065fe0 0x7f1a241464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1a14002f30 tx=0x7f1a14007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:06.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.604+0000 7f1a227fc700 1 --2- 172.21.15.103:0/2206207708 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a24065fe0 0x7f1a241464e0 secure :-1 s=READY pgs=1007 cs=0 l=1 rx=0x7f1a14002f30 tx=0x7f1a14007a40).ready entity=mon.1 client_cookie=4d36ad084c5ab3c2 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:06.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.604+0000 7f1a227fc700 1 --2- 172.21.15.103:0/2206207708 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a24065fe0 0x7f1a241464e0 secure :-1 s=THROTTLE_DONE pgs=1007 cs=0 l=1 rx=0x7f1a14002f30 tx=0x7f1a14007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:06.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.604+0000 7f1a21ffb700 1 -- 172.21.15.103:0/2206207708 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a14011470 con 0x7f1a24065fe0 2020-04-22T14:12:06.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.604+0000 7f1a227fc700 1 --2- 172.21.15.103:0/2206207708 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a24065fe0 0x7f1a241464e0 secure :-1 s=THROTTLE_DONE pgs=1007 cs=0 l=1 rx=0x7f1a14002f30 tx=0x7f1a14007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:06.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.604+0000 7f1a21ffb700 1 -- 172.21.15.103:0/2206207708 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a140115d0 con 0x7f1a24065fe0 2020-04-22T14:12:06.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.604+0000 7f1a227fc700 1 --2- 172.21.15.103:0/2206207708 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a24065fe0 0x7f1a241464e0 secure :-1 s=THROTTLE_DONE pgs=1007 cs=0 l=1 rx=0x7f1a14002f30 tx=0x7f1a14007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:06.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.604+0000 7f1a21ffb700 1 -- 172.21.15.103:0/2206207708 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a140119b0 con 0x7f1a24065fe0 2020-04-22T14:12:06.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.604+0000 7f1a2987a700 1 -- 172.21.15.103:0/2206207708 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a24065fe0 msgr2=0x7f1a241464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:06.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.604+0000 7f1a2987a700 1 --2- 172.21.15.103:0/2206207708 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a24065fe0 0x7f1a241464e0 secure :-1 s=READY pgs=1007 cs=0 l=1 rx=0x7f1a14002f30 tx=0x7f1a14007a40).stop 2020-04-22T14:12:06.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.604+0000 7f1a2987a700 1 -- 172.21.15.103:0/2206207708 shutdown_connections 2020-04-22T14:12:06.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.604+0000 7f1a2987a700 1 --2- 172.21.15.103:0/2206207708 >> v2:172.21.15.86:3300/0 conn(0x7f1a24063e30 0x7f1a240642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:06.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.604+0000 7f1a2987a700 1 --2- 172.21.15.103:0/2206207708 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a24065fe0 0x7f1a241464e0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:06.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.604+0000 7f1a2987a700 1 -- 172.21.15.103:0/2206207708 >> 172.21.15.103:0/2206207708 conn(0x7f1a240b9160 msgr2=0x7f1a2405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:06.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.604+0000 7f1a2987a700 1 -- 172.21.15.103:0/2206207708 shutdown_connections 2020-04-22T14:12:06.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.604+0000 7f1a2987a700 1 -- 172.21.15.103:0/2206207708 wait complete. 2020-04-22T14:12:06.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.605+0000 7f1a2987a700 1 Processor -- start 2020-04-22T14:12:06.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.605+0000 7f1a2987a700 1 -- start start 2020-04-22T14:12:06.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.606+0000 7f1a2987a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1a24063e30 0x7f1a24145940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:06.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.606+0000 7f1a2987a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1a2412c0d0 0x7f1a240b5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:06.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.606+0000 7f1a2987a700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a240b1de0 con 0x7f1a24065fe0 2020-04-22T14:12:06.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.606+0000 7f1a2987a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a241548e0 con 0x7f1a2412c0d0 2020-04-22T14:12:06.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.606+0000 7f1a2987a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a24126c30 con 0x7f1a24063e30 2020-04-22T14:12:06.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.606+0000 7f1a227fc700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f1a24065fe0 0x7f1a24126520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44574/0 (socket says 172.21.15.103:44574) 2020-04-22T14:12:06.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.606+0000 7f1a227fc700 1 -- 172.21.15.103:0/1548007668 learned_addr learned my addr 172.21.15.103:0/1548007668 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:06.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.606+0000 7f1a237fe700 1 --2- 172.21.15.103:0/1548007668 >> v2:172.21.15.103:3300/0 conn(0x7f1a2412c0d0 0x7f1a240b5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:06.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.606+0000 7f1a22ffd700 1 --2- 172.21.15.103:0/1548007668 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1a24063e30 0x7f1a24145940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:06.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.606+0000 7f1a13fff700 1 -- 172.21.15.103:0/1548007668 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2636445451 0 0) 0x7f1a240b1de0 con 0x7f1a24065fe0 2020-04-22T14:12:06.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.606+0000 7f1a13fff700 1 -- 172.21.15.103:0/1548007668 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a00002fe0 con 0x7f1a24065fe0 2020-04-22T14:12:06.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.606+0000 7f1a237fe700 1 -- 172.21.15.103:0/1548007668 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1a24063e30 msgr2=0x7f1a24145940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:06.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.606+0000 7f1a237fe700 1 --2- 172.21.15.103:0/1548007668 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1a24063e30 0x7f1a24145940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:06.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.606+0000 7f1a237fe700 1 -- 172.21.15.103:0/1548007668 >> v1:172.21.15.103:6789/0 conn(0x7f1a24065fe0 legacy=0x7f1a24126520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:06.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.606+0000 7f1a237fe700 1 -- 172.21.15.103:0/1548007668 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a240b1ad0 con 0x7f1a2412c0d0 2020-04-22T14:12:06.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.606+0000 7f1a237fe700 1 --2- 172.21.15.103:0/1548007668 >> v2:172.21.15.103:3300/0 conn(0x7f1a2412c0d0 0x7f1a240b5140 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1a1c0032b0 tx=0x7f1a1c010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:06.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.607+0000 7f1a237fe700 1 --2- 172.21.15.103:0/1548007668 >> v2:172.21.15.103:3300/0 conn(0x7f1a2412c0d0 0x7f1a240b5140 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1a1c0032b0 tx=0x7f1a1c010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:06.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.607+0000 7f1a237fe700 1 --2- 172.21.15.103:0/1548007668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a2412c0d0 0x7f1a240b5140 secure :-1 s=READY pgs=1009 cs=0 l=1 rx=0x7f1a1c0032b0 tx=0x7f1a1c010e40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:06.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.607+0000 7f1a237fe700 1 --2- 172.21.15.103:0/1548007668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a2412c0d0 0x7f1a240b5140 secure :-1 s=THROTTLE_DONE pgs=1009 cs=0 l=1 rx=0x7f1a1c0032b0 tx=0x7f1a1c010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:06.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.607+0000 7f1a13fff700 1 -- 172.21.15.103:0/1548007668 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a1c005e20 con 0x7f1a2412c0d0 2020-04-22T14:12:06.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.607+0000 7f1a237fe700 1 --2- 172.21.15.103:0/1548007668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a2412c0d0 0x7f1a240b5140 secure :-1 s=THROTTLE_DONE pgs=1009 cs=0 l=1 rx=0x7f1a1c0032b0 tx=0x7f1a1c010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:06.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.607+0000 7f1a13fff700 1 -- 172.21.15.103:0/1548007668 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1c012820 con 0x7f1a2412c0d0 2020-04-22T14:12:06.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.607+0000 7f1a237fe700 1 --2- 172.21.15.103:0/1548007668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a2412c0d0 0x7f1a240b5140 secure :-1 s=THROTTLE_DONE pgs=1009 cs=0 l=1 rx=0x7f1a1c0032b0 tx=0x7f1a1c010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:06.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.607+0000 7f1a2987a700 1 -- 172.21.15.103:0/1548007668 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a24128180 con 0x7f1a2412c0d0 2020-04-22T14:12:06.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.607+0000 7f1a13fff700 1 -- 172.21.15.103:0/1548007668 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a1c012c00 con 0x7f1a2412c0d0 2020-04-22T14:12:06.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.607+0000 7f1a2987a700 1 -- 172.21.15.103:0/1548007668 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a241276f0 con 0x7f1a2412c0d0 2020-04-22T14:12:06.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.607+0000 7f1a237fe700 1 --2- 172.21.15.103:0/1548007668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a2412c0d0 0x7f1a240b5140 secure :-1 s=THROTTLE_DONE pgs=1009 cs=0 l=1 rx=0x7f1a1c0032b0 tx=0x7f1a1c010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:06.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.608+0000 7f1a2987a700 1 -- 172.21.15.103:0/1548007668 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a241546c0 con 0x7f1a2412c0d0 2020-04-22T14:12:06.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.608+0000 7f1a13fff700 1 -- 172.21.15.103:0/1548007668 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f1a1c010190 con 0x7f1a2412c0d0 2020-04-22T14:12:06.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.608+0000 7f1a237fe700 1 --2- 172.21.15.103:0/1548007668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a2412c0d0 0x7f1a240b5140 secure :-1 s=THROTTLE_DONE pgs=1009 cs=0 l=1 rx=0x7f1a1c0032b0 tx=0x7f1a1c010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:06.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.608+0000 7f1a13fff700 1 --2- 172.21.15.103:0/1548007668 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1a0004dcb0 0x7f1a00050170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:06.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.608+0000 7f1a13fff700 1 -- 172.21.15.103:0/1548007668 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f1a1c061490 con 0x7f1a2412c0d0 2020-04-22T14:12:06.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.608+0000 7f1a22ffd700 1 --2- 172.21.15.103:0/1548007668 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1a0004dcb0 0x7f1a00050170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:06.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.608+0000 7f1a22ffd700 1 --2- 172.21.15.103:0/1548007668 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1a0004dcb0 0x7f1a00050170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1a18000b80 tx=0x7f1a18001800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:06.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.609+0000 7f1a22ffd700 1 --2- 172.21.15.103:0/1548007668 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1a0004dcb0 0x7f1a00050170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1a18000b80 tx=0x7f1a18001800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:06.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.609+0000 7f1a22ffd700 1 --2- 172.21.15.103:0/1548007668 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1a0004dcb0 0x7f1a00050170 secure :-1 s=READY pgs=376 cs=0 l=1 rx=0x7f1a18000b80 tx=0x7f1a18001800).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:06.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.612+0000 7f1a237fe700 1 --2- 172.21.15.103:0/1548007668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a2412c0d0 0x7f1a240b5140 secure :-1 s=THROTTLE_DONE pgs=1009 cs=0 l=1 rx=0x7f1a1c0032b0 tx=0x7f1a1c010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:06.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.612+0000 7f1a13fff700 1 -- 172.21.15.103:0/1548007668 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f1a1c03c870 con 0x7f1a2412c0d0 2020-04-22T14:12:06.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:06.805+0000 7f1a2987a700 1 -- 172.21.15.103:0/1548007668 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_create_fsync"]} v 0) v1 -- 0x7f1a240b1f70 con 0x7f1a2412c0d0 2020-04-22T14:12:07.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.421+0000 7f1a237fe700 1 --2- 172.21.15.103:0/1548007668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a2412c0d0 0x7f1a240b5140 secure :-1 s=THROTTLE_DONE pgs=1009 cs=0 l=1 rx=0x7f1a1c0032b0 tx=0x7f1a1c010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:07.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.421+0000 7f1a13fff700 1 -- 172.21.15.103:0/1548007668 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_create_fsync"]}]=0 v400) v1 ==== 149+0+0 (secure 0 0 0) 0x7f1a1c03fe90 con 0x7f1a2412c0d0 2020-04-22T14:12:07.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.423+0000 7f1a2987a700 1 -- 172.21.15.103:0/1548007668 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1a0004dcb0 msgr2=0x7f1a00050170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:07.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.423+0000 7f1a2987a700 1 --2- 172.21.15.103:0/1548007668 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1a0004dcb0 0x7f1a00050170 secure :-1 s=READY pgs=376 cs=0 l=1 rx=0x7f1a18000b80 tx=0x7f1a18001800).stop 2020-04-22T14:12:07.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.423+0000 7f1a2987a700 1 -- 172.21.15.103:0/1548007668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a2412c0d0 msgr2=0x7f1a240b5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:07.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.423+0000 7f1a2987a700 1 --2- 172.21.15.103:0/1548007668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a2412c0d0 0x7f1a240b5140 secure :-1 s=READY pgs=1009 cs=0 l=1 rx=0x7f1a1c0032b0 tx=0x7f1a1c010e40).stop 2020-04-22T14:12:07.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.423+0000 7f1a2987a700 1 -- 172.21.15.103:0/1548007668 shutdown_connections 2020-04-22T14:12:07.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.423+0000 7f1a2987a700 1 --2- 172.21.15.103:0/1548007668 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1a0004dcb0 0x7f1a00050170 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:07.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.423+0000 7f1a2987a700 1 --2- 172.21.15.103:0/1548007668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a2412c0d0 0x7f1a240b5140 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:07.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.423+0000 7f1a2987a700 1 --2- 172.21.15.103:0/1548007668 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1a24063e30 0x7f1a24145940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:07.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.423+0000 7f1a2987a700 1 -- 172.21.15.103:0/1548007668 >> 172.21.15.103:0/1548007668 conn(0x7f1a240b9160 msgr2=0x7f1a2412b000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:07.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.424+0000 7f1a2987a700 1 -- 172.21.15.103:0/1548007668 shutdown_connections 2020-04-22T14:12:07.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.424+0000 7f1a2987a700 1 -- 172.21.15.103:0/1548007668 wait complete. 2020-04-22T14:12:07.439 INFO:tasks.cephfs_test_runner:test_create_fsync (tasks.cephfs.test_client_recovery.TestClientRecovery) ... ok 2020-04-22T14:12:07.439 INFO:tasks.cephfs_test_runner:Starting test: test_dir_fsync (tasks.cephfs.test_client_recovery.TestClientRecovery) 2020-04-22T14:12:07.439 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:07.454 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_dir_fsync' 2020-04-22T14:12:07.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.601+0000 7ff8de491700 1 Processor -- start 2020-04-22T14:12:07.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.601+0000 7ff8de491700 1 -- start start 2020-04-22T14:12:07.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.602+0000 7ff8de491700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff8d812c0d0 0x7ff8d81464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:07.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.602+0000 7ff8de491700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8d8143300 con 0x7ff8d8063e30 2020-04-22T14:12:07.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.602+0000 7ff8de491700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8d81435a0 con 0x7ff8d8065fe0 2020-04-22T14:12:07.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.602+0000 7ff8de491700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d8143840 con 0x7ff8d812c0d0 2020-04-22T14:12:07.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.602+0000 7ff8cffff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff8d8065fe0 0x7ff8d805b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44582/0 (socket says 172.21.15.103:44582) 2020-04-22T14:12:07.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.602+0000 7ff8cffff700 1 -- 172.21.15.103:0/3498404314 learned_addr learned my addr 172.21.15.103:0/3498404314 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:07.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.602+0000 7ff8d7fff700 1 --2- 172.21.15.103:0/3498404314 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff8d812c0d0 0x7ff8d81464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:07.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.602+0000 7ff8d77fe700 1 -- 172.21.15.103:0/3498404314 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 874033259 0 0) 0x7ff8d81435a0 con 0x7ff8d8065fe0 2020-04-22T14:12:07.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.602+0000 7ff8d77fe700 1 -- 172.21.15.103:0/3498404314 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8b8003230 con 0x7ff8d8065fe0 2020-04-22T14:12:07.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.603+0000 7ff8d77fe700 1 -- 172.21.15.103:0/3498404314 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3354464344 0 0) 0x7ff8d8143300 con 0x7ff8d8063e30 2020-04-22T14:12:07.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.603+0000 7ff8d77fe700 1 -- 172.21.15.103:0/3498404314 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8d81435a0 con 0x7ff8d8063e30 2020-04-22T14:12:07.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.603+0000 7ff8d77fe700 1 -- 172.21.15.103:0/3498404314 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 253643656 0 0) 0x7ff8b8003230 con 0x7ff8d8065fe0 2020-04-22T14:12:07.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.603+0000 7ff8d77fe700 1 -- 172.21.15.103:0/3498404314 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff8d812c0d0 msgr2=0x7ff8d81464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:07.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.603+0000 7ff8d77fe700 1 --2- 172.21.15.103:0/3498404314 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff8d812c0d0 0x7ff8d81464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:07.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.603+0000 7ff8d77fe700 1 -- 172.21.15.103:0/3498404314 >> v1:172.21.15.86:6789/0 conn(0x7ff8d8063e30 legacy=0x7ff8d80642a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:07.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.603+0000 7ff8d77fe700 1 -- 172.21.15.103:0/3498404314 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d805bb50 con 0x7ff8d8065fe0 2020-04-22T14:12:07.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.603+0000 7ff8d77fe700 1 -- 172.21.15.103:0/3498404314 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7ff8c00016d0 con 0x7ff8d8065fe0 2020-04-22T14:12:07.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.603+0000 7ff8d77fe700 1 -- 172.21.15.103:0/3498404314 >> v1:172.21.15.103:6789/0 conn(0x7ff8d8065fe0 legacy=0x7ff8d805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:07.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.603+0000 7ff8d77fe700 1 --2- 172.21.15.103:0/3498404314 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8b80038b0 0x7ff8b8003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:07.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.603+0000 7ff8d77fe700 1 --2- 172.21.15.103:0/3498404314 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff8d812c0d0 0x7ff8b80044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:07.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.603+0000 7ff8d77fe700 1 --2- 172.21.15.103:0/3498404314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8b8004930 0x7ff8b8004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:07.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.603+0000 7ff8d77fe700 1 -- 172.21.15.103:0/3498404314 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d8143840 con 0x7ff8b80038b0 2020-04-22T14:12:07.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.603+0000 7ff8d77fe700 1 -- 172.21.15.103:0/3498404314 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b8005210 con 0x7ff8b8004930 2020-04-22T14:12:07.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.603+0000 7ff8d77fe700 1 -- 172.21.15.103:0/3498404314 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b800b720 con 0x7ff8d812c0d0 2020-04-22T14:12:07.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.603+0000 7ff8dca2e700 1 --2- 172.21.15.103:0/3498404314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8b8004930 0x7ff8b8004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:07.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.603+0000 7ff8d7fff700 1 --2- 172.21.15.103:0/3498404314 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8b80038b0 0x7ff8b8003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:07.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.603+0000 7ff8cffff700 1 --2- 172.21.15.103:0/3498404314 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff8d812c0d0 0x7ff8b80044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:07.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.603+0000 7ff8dca2e700 1 -- 172.21.15.103:0/3498404314 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff8d812c0d0 msgr2=0x7ff8b80044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:07.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.603+0000 7ff8dca2e700 1 --2- 172.21.15.103:0/3498404314 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff8d812c0d0 0x7ff8b80044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:07.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.603+0000 7ff8dca2e700 1 -- 172.21.15.103:0/3498404314 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8b80038b0 msgr2=0x7ff8b8003cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:07.624 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.603+0000 7ff8dca2e700 1 --2- 172.21.15.103:0/3498404314 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8b80038b0 0x7ff8b8003cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:07.625 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.603+0000 7ff8dca2e700 1 -- 172.21.15.103:0/3498404314 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b8003230 con 0x7ff8b8004930 2020-04-22T14:12:07.625 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.603+0000 7ff8dca2e700 1 --2- 172.21.15.103:0/3498404314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8b8004930 0x7ff8b8004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff8d0001450 tx=0x7ff8d00101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:07.625 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.603+0000 7ff8dca2e700 1 --2- 172.21.15.103:0/3498404314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8b8004930 0x7ff8b8004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff8d0001450 tx=0x7ff8d00101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:07.625 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.603+0000 7ff8dca2e700 1 --2- 172.21.15.103:0/3498404314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8b8004930 0x7ff8b8004db0 secure :-1 s=READY pgs=1011 cs=0 l=1 rx=0x7ff8d0001450 tx=0x7ff8d00101d0).ready entity=mon.1 client_cookie=765d1a7cdb7960ca server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:07.625 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.603+0000 7ff8dca2e700 1 --2- 172.21.15.103:0/3498404314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8b8004930 0x7ff8b8004db0 secure :-1 s=THROTTLE_DONE pgs=1011 cs=0 l=1 rx=0x7ff8d0001450 tx=0x7ff8d00101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:07.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.603+0000 7ff8d77fe700 1 -- 172.21.15.103:0/3498404314 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8d0010e30 con 0x7ff8b8004930 2020-04-22T14:12:07.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.603+0000 7ff8dca2e700 1 --2- 172.21.15.103:0/3498404314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8b8004930 0x7ff8b8004db0 secure :-1 s=THROTTLE_DONE pgs=1011 cs=0 l=1 rx=0x7ff8d0001450 tx=0x7ff8d00101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:07.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.604+0000 7ff8dca2e700 1 --2- 172.21.15.103:0/3498404314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8b8004930 0x7ff8b8004db0 secure :-1 s=THROTTLE_DONE pgs=1011 cs=0 l=1 rx=0x7ff8d0001450 tx=0x7ff8d00101d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:07.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.604+0000 7ff8d77fe700 1 -- 172.21.15.103:0/3498404314 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d0006860 con 0x7ff8b8004930 2020-04-22T14:12:07.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.604+0000 7ff8d77fe700 1 -- 172.21.15.103:0/3498404314 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8d0006c80 con 0x7ff8b8004930 2020-04-22T14:12:07.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.604+0000 7ff8de491700 1 -- 172.21.15.103:0/3498404314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8b8004930 msgr2=0x7ff8b8004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:07.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.604+0000 7ff8de491700 1 --2- 172.21.15.103:0/3498404314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8b8004930 0x7ff8b8004db0 secure :-1 s=READY pgs=1011 cs=0 l=1 rx=0x7ff8d0001450 tx=0x7ff8d00101d0).stop 2020-04-22T14:12:07.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.604+0000 7ff8dca2e700 1 -- 172.21.15.103:0/3498404314 reap_dead start 2020-04-22T14:12:07.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.604+0000 7ff8de491700 1 -- 172.21.15.103:0/3498404314 shutdown_connections 2020-04-22T14:12:07.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.604+0000 7ff8de491700 1 -- 172.21.15.103:0/3498404314 >> 172.21.15.103:0/3498404314 conn(0x7ff8d80b9160 msgr2=0x7ff8d805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:07.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.604+0000 7ff8de491700 1 -- 172.21.15.103:0/3498404314 shutdown_connections 2020-04-22T14:12:07.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.604+0000 7ff8de491700 1 -- 172.21.15.103:0/3498404314 wait complete. 2020-04-22T14:12:07.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.605+0000 7ff8de491700 1 Processor -- start 2020-04-22T14:12:07.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.605+0000 7ff8de491700 1 -- start start 2020-04-22T14:12:07.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.606+0000 7ff8de491700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff8d8145100 0x7ff8d80b0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:07.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.606+0000 7ff8de491700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff8d8142620 0x7ff8d80ac950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:07.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.606+0000 7ff8de491700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8d80b0490 con 0x7ff8d8154540 2020-04-22T14:12:07.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.606+0000 7ff8de491700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8d81549f0 con 0x7ff8d8142620 2020-04-22T14:12:07.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.606+0000 7ff8de491700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8d80af650 con 0x7ff8d8145100 2020-04-22T14:12:07.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.606+0000 7ff8d7fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff8d8145100 0x7ff8d80b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:07.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.606+0000 7ff8cffff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff8d8154540 0x7ff8d8141f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44594/0 (socket says 172.21.15.103:44594) 2020-04-22T14:12:07.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.606+0000 7ff8cffff700 1 -- 172.21.15.103:0/3300264999 learned_addr learned my addr 172.21.15.103:0/3300264999 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:07.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.606+0000 7ff8dca2e700 1 --2- 172.21.15.103:0/3300264999 >> v2:172.21.15.86:3300/0 conn(0x7ff8d8142620 0x7ff8d80ac950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:07.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.606+0000 7ff8d7fff700 1 -- 172.21.15.103:0/3300264999 >> v2:172.21.15.86:3300/0 conn(0x7ff8d8142620 msgr2=0x7ff8d80ac950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:07.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.606+0000 7ff8d7fff700 1 --2- 172.21.15.103:0/3300264999 >> v2:172.21.15.86:3300/0 conn(0x7ff8d8142620 0x7ff8d80ac950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:07.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.606+0000 7ff8d5ffb700 1 -- 172.21.15.103:0/3300264999 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 601737724 0 0) 0x7ff8d80b0490 con 0x7ff8d8154540 2020-04-22T14:12:07.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.606+0000 7ff8d7fff700 1 -- 172.21.15.103:0/3300264999 >> v1:172.21.15.103:6789/0 conn(0x7ff8d8154540 legacy=0x7ff8d8141f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:07.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.606+0000 7ff8d7fff700 1 -- 172.21.15.103:0/3300264999 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d80af8f0 con 0x7ff8d8145100 2020-04-22T14:12:07.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.606+0000 7ff8dca2e700 1 --2- 172.21.15.103:0/3300264999 >> v2:172.21.15.86:3300/0 conn(0x7ff8d8142620 0x7ff8d80ac950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:12:07.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.606+0000 7ff8d7fff700 1 --2- 172.21.15.103:0/3300264999 >> v2:172.21.15.103:3300/0 conn(0x7ff8d8145100 0x7ff8d80b0030 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff8c8002f30 tx=0x7ff8c8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:07.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.606+0000 7ff8d7fff700 1 --2- 172.21.15.103:0/3300264999 >> v2:172.21.15.103:3300/0 conn(0x7ff8d8145100 0x7ff8d80b0030 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff8c8002f30 tx=0x7ff8c8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:07.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.606+0000 7ff8d7fff700 1 --2- 172.21.15.103:0/3300264999 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8d8145100 0x7ff8d80b0030 secure :-1 s=READY pgs=1013 cs=0 l=1 rx=0x7ff8c8002f30 tx=0x7ff8c8010b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:07.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.606+0000 7ff8d7fff700 1 --2- 172.21.15.103:0/3300264999 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8d8145100 0x7ff8d80b0030 secure :-1 s=THROTTLE_DONE pgs=1013 cs=0 l=1 rx=0x7ff8c8002f30 tx=0x7ff8c8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:07.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.606+0000 7ff8d5ffb700 1 -- 172.21.15.103:0/3300264999 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8c8005e90 con 0x7ff8d8145100 2020-04-22T14:12:07.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.606+0000 7ff8d7fff700 1 --2- 172.21.15.103:0/3300264999 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8d8145100 0x7ff8d80b0030 secure :-1 s=THROTTLE_DONE pgs=1013 cs=0 l=1 rx=0x7ff8c8002f30 tx=0x7ff8c8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:07.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.606+0000 7ff8d7fff700 1 --2- 172.21.15.103:0/3300264999 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8d8145100 0x7ff8d80b0030 secure :-1 s=THROTTLE_DONE pgs=1013 cs=0 l=1 rx=0x7ff8c8002f30 tx=0x7ff8c8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:07.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.606+0000 7ff8d5ffb700 1 -- 172.21.15.103:0/3300264999 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c8007180 con 0x7ff8d8145100 2020-04-22T14:12:07.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.606+0000 7ff8de491700 1 -- 172.21.15.103:0/3300264999 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8d80afb90 con 0x7ff8d8145100 2020-04-22T14:12:07.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.606+0000 7ff8d5ffb700 1 -- 172.21.15.103:0/3300264999 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8c8007520 con 0x7ff8d8145100 2020-04-22T14:12:07.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.606+0000 7ff8de491700 1 -- 172.21.15.103:0/3300264999 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d80af3c0 con 0x7ff8d8145100 2020-04-22T14:12:07.632 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.607+0000 7ff8d7fff700 1 --2- 172.21.15.103:0/3300264999 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8d8145100 0x7ff8d80b0030 secure :-1 s=THROTTLE_DONE pgs=1013 cs=0 l=1 rx=0x7ff8c8002f30 tx=0x7ff8c8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:07.633 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.607+0000 7ff8de491700 1 -- 172.21.15.103:0/3300264999 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8d8056c90 con 0x7ff8d8145100 2020-04-22T14:12:07.633 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.607+0000 7ff8d5ffb700 1 -- 172.21.15.103:0/3300264999 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ff8c8009490 con 0x7ff8d8145100 2020-04-22T14:12:07.633 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.607+0000 7ff8d7fff700 1 --2- 172.21.15.103:0/3300264999 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8d8145100 0x7ff8d80b0030 secure :-1 s=THROTTLE_DONE pgs=1013 cs=0 l=1 rx=0x7ff8c8002f30 tx=0x7ff8c8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:07.633 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.608+0000 7ff8d5ffb700 1 --2- 172.21.15.103:0/3300264999 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff8bc04d7b0 0x7ff8bc04fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:07.633 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.608+0000 7ff8d5ffb700 1 -- 172.21.15.103:0/3300264999 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6202+0+0 (secure 0 0 0) 0x7ff8c80616a0 con 0x7ff8d8145100 2020-04-22T14:12:07.633 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.608+0000 7ff8cffff700 1 --2- 172.21.15.103:0/3300264999 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff8bc04d7b0 0x7ff8bc04fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:07.633 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.608+0000 7ff8cffff700 1 --2- 172.21.15.103:0/3300264999 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff8bc04d7b0 0x7ff8bc04fc70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff8c000fa40 tx=0x7ff8d805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:07.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.608+0000 7ff8cffff700 1 --2- 172.21.15.103:0/3300264999 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff8bc04d7b0 0x7ff8bc04fc70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff8c000fa40 tx=0x7ff8d805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:07.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.608+0000 7ff8cffff700 1 --2- 172.21.15.103:0/3300264999 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff8bc04d7b0 0x7ff8bc04fc70 secure :-1 s=READY pgs=377 cs=0 l=1 rx=0x7ff8c000fa40 tx=0x7ff8d805bce0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:07.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.612+0000 7ff8d7fff700 1 --2- 172.21.15.103:0/3300264999 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8d8145100 0x7ff8d80b0030 secure :-1 s=THROTTLE_DONE pgs=1013 cs=0 l=1 rx=0x7ff8c8002f30 tx=0x7ff8c8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:07.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.612+0000 7ff8d5ffb700 1 -- 172.21.15.103:0/3300264999 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ff8c803ca20 con 0x7ff8d8145100 2020-04-22T14:12:07.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:07.805+0000 7ff8de491700 1 -- 172.21.15.103:0/3300264999 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_dir_fsync"]} v 0) v1 -- 0x7ff8d8147360 con 0x7ff8d8145100 2020-04-22T14:12:08.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.427+0000 7ff8d7fff700 1 --2- 172.21.15.103:0/3300264999 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8d8145100 0x7ff8d80b0030 secure :-1 s=THROTTLE_DONE pgs=1013 cs=0 l=1 rx=0x7ff8c8002f30 tx=0x7ff8c8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:08.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.427+0000 7ff8d5ffb700 1 -- 172.21.15.103:0/3300264999 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_dir_fsync"]}]=0 v401) v1 ==== 149+0+0 (secure 0 0 0) 0x7ff8c8040040 con 0x7ff8d8145100 2020-04-22T14:12:08.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.429+0000 7ff8de491700 1 -- 172.21.15.103:0/3300264999 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff8bc04d7b0 msgr2=0x7ff8bc04fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:08.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.429+0000 7ff8de491700 1 --2- 172.21.15.103:0/3300264999 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff8bc04d7b0 0x7ff8bc04fc70 secure :-1 s=READY pgs=377 cs=0 l=1 rx=0x7ff8c000fa40 tx=0x7ff8d805bce0).stop 2020-04-22T14:12:08.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.429+0000 7ff8de491700 1 -- 172.21.15.103:0/3300264999 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8d8145100 msgr2=0x7ff8d80b0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:08.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.429+0000 7ff8de491700 1 --2- 172.21.15.103:0/3300264999 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8d8145100 0x7ff8d80b0030 secure :-1 s=READY pgs=1013 cs=0 l=1 rx=0x7ff8c8002f30 tx=0x7ff8c8010b90).stop 2020-04-22T14:12:08.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.429+0000 7ff8de491700 1 -- 172.21.15.103:0/3300264999 shutdown_connections 2020-04-22T14:12:08.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.429+0000 7ff8de491700 1 --2- 172.21.15.103:0/3300264999 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff8bc04d7b0 0x7ff8bc04fc70 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:08.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.429+0000 7ff8de491700 1 --2- 172.21.15.103:0/3300264999 >> v2:172.21.15.86:3300/0 conn(0x7ff8d8142620 0x7ff8d80ac950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:08.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.429+0000 7ff8de491700 1 --2- 172.21.15.103:0/3300264999 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8d8145100 0x7ff8d80b0030 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:08.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.429+0000 7ff8de491700 1 -- 172.21.15.103:0/3300264999 >> 172.21.15.103:0/3300264999 conn(0x7ff8d80b9160 msgr2=0x7ff8d8061ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:08.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.429+0000 7ff8de491700 1 -- 172.21.15.103:0/3300264999 shutdown_connections 2020-04-22T14:12:08.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.429+0000 7ff8de491700 1 -- 172.21.15.103:0/3300264999 wait complete. 2020-04-22T14:12:08.443 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-04-22T14:12:08.443 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:12:08.465 INFO:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:12:08.557 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:08.572 INFO:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:12:08.663 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-04-22T14:12:08.663 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:08.689 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2020-04-22T14:12:08.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.833+0000 7ffba0279700 1 Processor -- start 2020-04-22T14:12:08.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.833+0000 7ffba0279700 1 -- start start 2020-04-22T14:12:08.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.834+0000 7ffba0279700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb9812c0d0 0x7ffb981464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:08.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.834+0000 7ffba0279700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffb98063e30 0x7ffb980642a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:08.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.834+0000 7ffba0279700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb98143300 con 0x7ffb98065fe0 2020-04-22T14:12:08.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.834+0000 7ffba0279700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb981435a0 con 0x7ffb98063e30 2020-04-22T14:12:08.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.834+0000 7ffba0279700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb98143840 con 0x7ffb9812c0d0 2020-04-22T14:12:08.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.834+0000 7ffb9e816700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffb98063e30 0x7ffb980642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:08.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.834+0000 7ffb9e816700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffb98063e30 0x7ffb980642a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52410/0 (socket says 172.21.15.103:52410) 2020-04-22T14:12:08.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.834+0000 7ffb9e816700 1 -- 172.21.15.103:0/3032188350 learned_addr learned my addr 172.21.15.103:0/3032188350 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:08.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.835+0000 7ffb9e015700 1 --2- 172.21.15.103:0/3032188350 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb9812c0d0 0x7ffb981464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:08.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.835+0000 7ffb9e816700 1 -- 172.21.15.103:0/3032188350 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb9812c0d0 msgr2=0x7ffb981464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:08.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.835+0000 7ffb9e816700 1 --2- 172.21.15.103:0/3032188350 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb9812c0d0 0x7ffb981464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:08.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.835+0000 7ffb9e816700 1 -- 172.21.15.103:0/3032188350 >> v1:172.21.15.86:6789/0 conn(0x7ffb98065fe0 legacy=0x7ffb9805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:08.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.835+0000 7ffb9e816700 1 -- 172.21.15.103:0/3032188350 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb9805bb50 con 0x7ffb98063e30 2020-04-22T14:12:08.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.835+0000 7ffb9e816700 1 --2- 172.21.15.103:0/3032188350 >> v2:172.21.15.103:3300/0 conn(0x7ffb98063e30 0x7ffb980642a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ffb980669a0 tx=0x7ffb90007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:08.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.835+0000 7ffb9e816700 1 --2- 172.21.15.103:0/3032188350 >> v2:172.21.15.103:3300/0 conn(0x7ffb98063e30 0x7ffb980642a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ffb980669a0 tx=0x7ffb90007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:08.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.835+0000 7ffb9e816700 1 --2- 172.21.15.103:0/3032188350 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb98063e30 0x7ffb980642a0 secure :-1 s=READY pgs=1014 cs=0 l=1 rx=0x7ffb980669a0 tx=0x7ffb90007dc0).ready entity=mon.1 client_cookie=3fa5966f21d94f51 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:08.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.835+0000 7ffb9e816700 1 --2- 172.21.15.103:0/3032188350 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb98063e30 0x7ffb980642a0 secure :-1 s=THROTTLE_DONE pgs=1014 cs=0 l=1 rx=0x7ffb980669a0 tx=0x7ffb90007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:08.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.835+0000 7ffb9e816700 1 --2- 172.21.15.103:0/3032188350 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb98063e30 0x7ffb980642a0 secure :-1 s=THROTTLE_DONE pgs=1014 cs=0 l=1 rx=0x7ffb980669a0 tx=0x7ffb90007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:08.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.835+0000 7ffb9d013700 1 -- 172.21.15.103:0/3032188350 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb9000a180 con 0x7ffb98063e30 2020-04-22T14:12:08.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.835+0000 7ffb9e816700 1 --2- 172.21.15.103:0/3032188350 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb98063e30 0x7ffb980642a0 secure :-1 s=THROTTLE_DONE pgs=1014 cs=0 l=1 rx=0x7ffb980669a0 tx=0x7ffb90007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:08.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.835+0000 7ffb9d013700 1 -- 172.21.15.103:0/3032188350 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb9000a2e0 con 0x7ffb98063e30 2020-04-22T14:12:08.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.835+0000 7ffb9d013700 1 -- 172.21.15.103:0/3032188350 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb9000a700 con 0x7ffb98063e30 2020-04-22T14:12:08.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.835+0000 7ffba0279700 1 -- 172.21.15.103:0/3032188350 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb98063e30 msgr2=0x7ffb980642a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:08.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.835+0000 7ffba0279700 1 --2- 172.21.15.103:0/3032188350 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb98063e30 0x7ffb980642a0 secure :-1 s=READY pgs=1014 cs=0 l=1 rx=0x7ffb980669a0 tx=0x7ffb90007dc0).stop 2020-04-22T14:12:08.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.836+0000 7ffba0279700 1 -- 172.21.15.103:0/3032188350 shutdown_connections 2020-04-22T14:12:08.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.836+0000 7ffba0279700 1 --2- 172.21.15.103:0/3032188350 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb98063e30 0x7ffb980642a0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:08.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.836+0000 7ffba0279700 1 --2- 172.21.15.103:0/3032188350 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb9812c0d0 0x7ffb981464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:08.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.836+0000 7ffba0279700 1 -- 172.21.15.103:0/3032188350 >> 172.21.15.103:0/3032188350 conn(0x7ffb980b9160 msgr2=0x7ffb9805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:08.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.836+0000 7ffba0279700 1 -- 172.21.15.103:0/3032188350 shutdown_connections 2020-04-22T14:12:08.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.836+0000 7ffba0279700 1 -- 172.21.15.103:0/3032188350 wait complete. 2020-04-22T14:12:08.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.837+0000 7ffba0279700 1 Processor -- start 2020-04-22T14:12:08.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.837+0000 7ffba0279700 1 -- start start 2020-04-22T14:12:08.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.837+0000 7ffba0279700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffb98065fe0 0x7ffb980b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:08.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.837+0000 7ffba0279700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ffb9812c0d0 0x7ffb980b0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:08.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.837+0000 7ffba0279700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb980b43d0 con 0x7ffb98063e30 2020-04-22T14:12:08.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.837+0000 7ffba0279700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb980b4670 con 0x7ffb9812c0d0 2020-04-22T14:12:08.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.837+0000 7ffba0279700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb98151e80 con 0x7ffb98065fe0 2020-04-22T14:12:08.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.837+0000 7ffb9e015700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ffb98063e30 0x7ffb980b3ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44606/0 (socket says 172.21.15.103:44606) 2020-04-22T14:12:08.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.837+0000 7ffb9e015700 1 -- 172.21.15.103:0/1817023787 learned_addr learned my addr 172.21.15.103:0/1817023787 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:08.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.837+0000 7ffb9d814700 1 --2- 172.21.15.103:0/1817023787 >> v2:172.21.15.103:3300/0 conn(0x7ffb98065fe0 0x7ffb980b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:08.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.837+0000 7ffb9e816700 1 --2- 172.21.15.103:0/1817023787 >> v2:172.21.15.86:3300/0 conn(0x7ffb9812c0d0 0x7ffb980b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:08.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.837+0000 7ffb877fe700 1 -- 172.21.15.103:0/1817023787 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1120199431 0 0) 0x7ffb980b43d0 con 0x7ffb98063e30 2020-04-22T14:12:08.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.838+0000 7ffb877fe700 1 -- 172.21.15.103:0/1817023787 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb78002fe0 con 0x7ffb98063e30 2020-04-22T14:12:08.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.838+0000 7ffb9d814700 1 -- 172.21.15.103:0/1817023787 >> v2:172.21.15.86:3300/0 conn(0x7ffb9812c0d0 msgr2=0x7ffb980b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:08.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.838+0000 7ffb9d814700 1 --2- 172.21.15.103:0/1817023787 >> v2:172.21.15.86:3300/0 conn(0x7ffb9812c0d0 0x7ffb980b0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:08.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.838+0000 7ffb9d814700 1 -- 172.21.15.103:0/1817023787 >> v1:172.21.15.103:6789/0 conn(0x7ffb98063e30 legacy=0x7ffb980b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:08.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.838+0000 7ffb9d814700 1 -- 172.21.15.103:0/1817023787 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb98155f80 con 0x7ffb98065fe0 2020-04-22T14:12:08.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.838+0000 7ffb9d814700 1 --2- 172.21.15.103:0/1817023787 >> v2:172.21.15.103:3300/0 conn(0x7ffb98065fe0 0x7ffb980b54c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffb94001f50 tx=0x7ffb94010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:08.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.838+0000 7ffb9d814700 1 --2- 172.21.15.103:0/1817023787 >> v2:172.21.15.103:3300/0 conn(0x7ffb98065fe0 0x7ffb980b54c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffb94001f50 tx=0x7ffb94010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:08.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.838+0000 7ffb9d814700 1 --2- 172.21.15.103:0/1817023787 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb98065fe0 0x7ffb980b54c0 secure :-1 s=READY pgs=1016 cs=0 l=1 rx=0x7ffb94001f50 tx=0x7ffb94010850).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:08.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.838+0000 7ffb9d814700 1 --2- 172.21.15.103:0/1817023787 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb98065fe0 0x7ffb980b54c0 secure :-1 s=THROTTLE_DONE pgs=1016 cs=0 l=1 rx=0x7ffb94001f50 tx=0x7ffb94010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:08.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.838+0000 7ffb877fe700 1 -- 172.21.15.103:0/1817023787 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb94006bc0 con 0x7ffb98065fe0 2020-04-22T14:12:08.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.838+0000 7ffb9d814700 1 --2- 172.21.15.103:0/1817023787 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb98065fe0 0x7ffb980b54c0 secure :-1 s=THROTTLE_DONE pgs=1016 cs=0 l=1 rx=0x7ffb94001f50 tx=0x7ffb94010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:08.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.838+0000 7ffb9d814700 1 --2- 172.21.15.103:0/1817023787 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb98065fe0 0x7ffb980b54c0 secure :-1 s=THROTTLE_DONE pgs=1016 cs=0 l=1 rx=0x7ffb94001f50 tx=0x7ffb94010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:08.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.838+0000 7ffb877fe700 1 -- 172.21.15.103:0/1817023787 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb94006d20 con 0x7ffb98065fe0 2020-04-22T14:12:08.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.838+0000 7ffba0279700 1 -- 172.21.15.103:0/1817023787 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb980b08b0 con 0x7ffb98065fe0 2020-04-22T14:12:08.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.838+0000 7ffb877fe700 1 -- 172.21.15.103:0/1817023787 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb94006e90 con 0x7ffb98065fe0 2020-04-22T14:12:08.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.838+0000 7ffba0279700 1 -- 172.21.15.103:0/1817023787 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb980adaa0 con 0x7ffb98065fe0 2020-04-22T14:12:08.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.839+0000 7ffb9d814700 1 --2- 172.21.15.103:0/1817023787 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb98065fe0 0x7ffb980b54c0 secure :-1 s=THROTTLE_DONE pgs=1016 cs=0 l=1 rx=0x7ffb94001f50 tx=0x7ffb94010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:08.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.839+0000 7ffb877fe700 1 -- 172.21.15.103:0/1817023787 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ffb940083c0 con 0x7ffb98065fe0 2020-04-22T14:12:08.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.839+0000 7ffb9d814700 1 --2- 172.21.15.103:0/1817023787 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb98065fe0 0x7ffb980b54c0 secure :-1 s=THROTTLE_DONE pgs=1016 cs=0 l=1 rx=0x7ffb94001f50 tx=0x7ffb94010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:08.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.839+0000 7ffba0279700 1 -- 172.21.15.103:0/1817023787 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb981561d0 con 0x7ffb98065fe0 2020-04-22T14:12:08.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.839+0000 7ffb877fe700 1 --2- 172.21.15.103:0/1817023787 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffb7804dc50 0x7ffb78050110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:08.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.839+0000 7ffb877fe700 1 -- 172.21.15.103:0/1817023787 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6202+0+0 (secure 0 0 0) 0x7ffb94011e40 con 0x7ffb98065fe0 2020-04-22T14:12:08.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.839+0000 7ffb9e015700 1 --2- 172.21.15.103:0/1817023787 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffb7804dc50 0x7ffb78050110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:08.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.840+0000 7ffb9e015700 1 --2- 172.21.15.103:0/1817023787 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffb7804dc50 0x7ffb78050110 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffb88002f30 tx=0x7ffb88002340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:08.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.840+0000 7ffb9e015700 1 --2- 172.21.15.103:0/1817023787 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffb7804dc50 0x7ffb78050110 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffb88002f30 tx=0x7ffb88002340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:08.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.840+0000 7ffb9e015700 1 --2- 172.21.15.103:0/1817023787 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffb7804dc50 0x7ffb78050110 secure :-1 s=READY pgs=378 cs=0 l=1 rx=0x7ffb88002f30 tx=0x7ffb88002340).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:08.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.843+0000 7ffb9d814700 1 --2- 172.21.15.103:0/1817023787 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb98065fe0 0x7ffb980b54c0 secure :-1 s=THROTTLE_DONE pgs=1016 cs=0 l=1 rx=0x7ffb94001f50 tx=0x7ffb94010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:08.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.843+0000 7ffb877fe700 1 -- 172.21.15.103:0/1817023787 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ffb9403c9a0 con 0x7ffb98065fe0 2020-04-22T14:12:08.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.986+0000 7ffba0279700 1 -- 172.21.15.103:0/1817023787 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ffb98056c90 con 0x7ffb98065fe0 2020-04-22T14:12:08.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.987+0000 7ffb9d814700 1 --2- 172.21.15.103:0/1817023787 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb98065fe0 0x7ffb980b54c0 secure :-1 s=THROTTLE_DONE pgs=1016 cs=0 l=1 rx=0x7ffb94001f50 tx=0x7ffb94010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:08.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.987+0000 7ffb877fe700 1 -- 172.21.15.103:0/1817023787 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v67) v1 ==== 81+0+33928 (secure 0 0 0) 0x7ffb9403ffc0 con 0x7ffb98065fe0 2020-04-22T14:12:08.991 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:12:08.991 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:12:08.991 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 67, 2020-04-22T14:12:08.991 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:12:08.991 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2020-04-22T14:02:06.484738+0000", 2020-04-22T14:12:08.991 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2020-04-22T14:11:52.372240+0000", 2020-04-22T14:12:08.992 INFO:teuthology.orchestra.run.smithi103.stdout: "last_up_change": "2020-04-22T14:02:18.623774+0000", 2020-04-22T14:12:08.992 INFO:teuthology.orchestra.run.smithi103.stdout: "last_in_change": "2020-04-22T14:02:18.623774+0000", 2020-04-22T14:12:08.992 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-04-22T14:12:08.992 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_num": 5799936, 2020-04-22T14:12:08.992 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_set": [ 2020-04-22T14:12:08.992 INFO:teuthology.orchestra.run.smithi103.stdout: "pglog_hardlimit", 2020-04-22T14:12:08.992 INFO:teuthology.orchestra.run.smithi103.stdout: "purged_snapdirs", 2020-04-22T14:12:08.993 INFO:teuthology.orchestra.run.smithi103.stdout: "recovery_deletes", 2020-04-22T14:12:08.993 INFO:teuthology.orchestra.run.smithi103.stdout: "sortbitwise" 2020-04-22T14:12:08.993 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:12:08.993 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_version": 5, 2020-04-22T14:12:08.993 INFO:teuthology.orchestra.run.smithi103.stdout: "full_ratio": 0.94999998807907104, 2020-04-22T14:12:08.993 INFO:teuthology.orchestra.run.smithi103.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-04-22T14:12:08.994 INFO:teuthology.orchestra.run.smithi103.stdout: "nearfull_ratio": 0.85000002384185791, 2020-04-22T14:12:08.994 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_snapshot": "", 2020-04-22T14:12:08.994 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_max": 12, 2020-04-22T14:12:08.994 INFO:teuthology.orchestra.run.smithi103.stdout: "max_osd": 8, 2020-04-22T14:12:08.994 INFO:teuthology.orchestra.run.smithi103.stdout: "require_min_compat_client": "luminous", 2020-04-22T14:12:08.994 INFO:teuthology.orchestra.run.smithi103.stdout: "min_compat_client": "jewel", 2020-04-22T14:12:08.994 INFO:teuthology.orchestra.run.smithi103.stdout: "require_osd_release": "pacific", 2020-04-22T14:12:08.995 INFO:teuthology.orchestra.run.smithi103.stdout: "pools": [ 2020-04-22T14:12:08.995 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:08.995 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 1, 2020-04-22T14:12:08.995 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "device_health_metrics", 2020-04-22T14:12:08.995 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:02:09.565655+0000", 2020-04-22T14:12:08.995 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:12:08.995 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:12:08.996 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:12:08.996 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:12:08.996 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:12:08.996 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:12:08.996 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:12:08.997 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:12:08.997 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 1, 2020-04-22T14:12:08.997 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 1, 2020-04-22T14:12:08.997 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 1, 2020-04-22T14:12:08.997 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 1, 2020-04-22T14:12:08.997 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 1, 2020-04-22T14:12:08.997 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:12:08.998 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:12:08.998 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:12:08.998 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:12:08.998 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:12:08.998 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:12:08.998 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:12:08.999 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:08.999 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "17", 2020-04-22T14:12:08.999 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:12:08.999 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:12:08.999 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:12:08.999 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:12:08.999 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:12:09.000 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:12:09.000 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:12:09.000 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:12:09.000 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:12:09.000 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:12:09.000 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:12:09.001 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:12:09.001 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:12:09.001 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:12:09.001 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:12:09.001 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:12:09.001 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:12:09.001 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:12:09.002 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:12:09.002 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:12:09.002 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:12:09.002 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:12:09.002 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:12:09.002 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:12:09.002 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:12:09.003 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:12:09.003 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.003 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:12:09.003 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:12:09.003 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:12:09.003 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:12:09.003 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:12:09.004 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:12:09.004 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:12:09.004 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:12:09.004 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:12:09.004 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:12:09.004 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:12:09.005 INFO:teuthology.orchestra.run.smithi103.stdout: "options": { 2020-04-22T14:12:09.005 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_min": 1 2020-04-22T14:12:09.005 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.005 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:12:09.005 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_devicehealth": {} 2020-04-22T14:12:09.006 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.006 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.006 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.007 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 2, 2020-04-22T14:12:09.007 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "rbd", 2020-04-22T14:12:09.007 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:02:22.733031+0000", 2020-04-22T14:12:09.007 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:12:09.007 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:12:09.008 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:12:09.008 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:12:09.008 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:12:09.009 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:12:09.009 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:12:09.009 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:12:09.009 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 8, 2020-04-22T14:12:09.009 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 8, 2020-04-22T14:12:09.010 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 8, 2020-04-22T14:12:09.010 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 8, 2020-04-22T14:12:09.010 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 8, 2020-04-22T14:12:09.010 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:12:09.010 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:12:09.011 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:12:09.011 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:12:09.011 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:12:09.011 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:12:09.011 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:12:09.011 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.011 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "20", 2020-04-22T14:12:09.012 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:12:09.012 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:12:09.012 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:12:09.012 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:12:09.012 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:12:09.012 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:12:09.012 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:12:09.013 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:12:09.013 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:12:09.013 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:12:09.013 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:12:09.013 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:12:09.013 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:12:09.014 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:12:09.014 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:12:09.014 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:12:09.014 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:12:09.015 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:12:09.015 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:12:09.015 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:12:09.015 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:12:09.015 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:12:09.016 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:12:09.016 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:12:09.016 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:12:09.016 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:12:09.016 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.017 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:12:09.017 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:12:09.017 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:12:09.017 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:12:09.017 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:12:09.017 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:12:09.018 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:12:09.018 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:12:09.018 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:12:09.018 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:12:09.018 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:12:09.018 INFO:teuthology.orchestra.run.smithi103.stdout: "options": {}, 2020-04-22T14:12:09.018 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:12:09.019 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd": {} 2020-04-22T14:12:09.019 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.019 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.019 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.020 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 11, 2020-04-22T14:12:09.020 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "cephfs_metadata", 2020-04-22T14:12:09.020 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:10:36.758101+0000", 2020-04-22T14:12:09.020 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:12:09.020 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:12:09.021 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:12:09.021 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:12:09.021 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:12:09.021 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:12:09.021 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:12:09.021 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:12:09.021 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 8, 2020-04-22T14:12:09.022 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 8, 2020-04-22T14:12:09.022 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 8, 2020-04-22T14:12:09.022 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 8, 2020-04-22T14:12:09.022 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 8, 2020-04-22T14:12:09.022 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:12:09.022 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:12:09.022 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:12:09.023 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:12:09.023 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:12:09.023 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:12:09.023 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:12:09.023 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.023 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "63", 2020-04-22T14:12:09.024 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:12:09.024 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:12:09.024 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:12:09.024 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:12:09.024 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:12:09.024 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:12:09.024 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:12:09.025 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:12:09.025 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:12:09.025 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:12:09.025 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:12:09.025 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:12:09.025 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:12:09.026 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:12:09.026 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:12:09.026 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:12:09.026 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:12:09.026 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:12:09.026 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:12:09.027 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:12:09.027 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:12:09.027 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:12:09.028 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:12:09.028 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:12:09.028 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:12:09.029 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:12:09.029 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.029 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:12:09.030 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:12:09.031 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:12:09.031 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:12:09.031 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:12:09.032 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:12:09.032 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:12:09.032 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:12:09.032 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:12:09.033 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:12:09.033 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:12:09.033 INFO:teuthology.orchestra.run.smithi103.stdout: "options": { 2020-04-22T14:12:09.033 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_bias": 4, 2020-04-22T14:12:09.033 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_min": 16, 2020-04-22T14:12:09.033 INFO:teuthology.orchestra.run.smithi103.stdout: "recovery_priority": 5 2020-04-22T14:12:09.034 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.034 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:12:09.034 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs": { 2020-04-22T14:12:09.034 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": "cephfs" 2020-04-22T14:12:09.036 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.036 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.036 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.036 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.036 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 12, 2020-04-22T14:12:09.036 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "cephfs_data", 2020-04-22T14:12:09.037 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:10:37.765010+0000", 2020-04-22T14:12:09.037 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:12:09.037 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:12:09.037 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:12:09.037 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:12:09.038 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:12:09.038 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:12:09.038 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:12:09.038 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:12:09.038 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 8, 2020-04-22T14:12:09.038 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 8, 2020-04-22T14:12:09.039 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 8, 2020-04-22T14:12:09.039 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 8, 2020-04-22T14:12:09.039 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 8, 2020-04-22T14:12:09.039 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:12:09.039 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:12:09.039 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:12:09.040 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:12:09.040 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:12:09.040 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:12:09.040 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:12:09.040 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.041 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "64", 2020-04-22T14:12:09.041 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:12:09.041 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:12:09.041 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:12:09.041 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:12:09.041 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:12:09.041 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:12:09.042 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:12:09.042 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:12:09.042 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:12:09.042 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:12:09.042 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:12:09.042 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:12:09.043 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:12:09.043 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:12:09.043 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:12:09.043 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:12:09.044 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:12:09.044 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:12:09.044 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:12:09.044 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:12:09.045 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:12:09.045 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:12:09.045 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:12:09.046 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:12:09.046 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:12:09.046 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:12:09.046 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.046 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:12:09.046 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:12:09.046 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:12:09.047 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:12:09.047 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:12:09.047 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:12:09.047 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:12:09.047 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:12:09.047 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:12:09.048 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:12:09.048 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:12:09.048 INFO:teuthology.orchestra.run.smithi103.stdout: "options": {}, 2020-04-22T14:12:09.048 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:12:09.048 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs": { 2020-04-22T14:12:09.048 INFO:teuthology.orchestra.run.smithi103.stdout: "data": "cephfs" 2020-04-22T14:12:09.049 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.049 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.049 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.049 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:12:09.049 INFO:teuthology.orchestra.run.smithi103.stdout: "osds": [ 2020-04-22T14:12:09.049 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.049 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 0, 2020-04-22T14:12:09.050 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "3546145b-bd93-4a79-b6fe-3158153b8f05", 2020-04-22T14:12:09.050 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:12:09.050 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:12:09.050 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:12:09.050 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:12:09.050 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:12:09.051 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:12:09.051 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:12:09.051 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 62, 2020-04-22T14:12:09.051 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:12:09.051 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:12:09.051 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:12:09.051 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:12:09.052 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.052 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:12:09.052 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6800", 2020-04-22T14:12:09.052 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:12:09.052 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.053 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.053 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:12:09.053 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6801", 2020-04-22T14:12:09.053 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:12:09.053 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.054 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:12:09.055 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.055 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:12:09.056 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:12:09.056 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.056 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:12:09.056 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6802", 2020-04-22T14:12:09.056 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:12:09.056 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.057 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.057 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:12:09.057 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6803", 2020-04-22T14:12:09.057 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:12:09.058 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.058 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:12:09.058 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.058 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:12:09.058 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:12:09.058 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.059 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:12:09.059 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6806", 2020-04-22T14:12:09.059 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:12:09.059 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.059 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.059 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:12:09.059 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6807", 2020-04-22T14:12:09.060 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:12:09.060 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.060 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:12:09.060 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.060 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:12:09.060 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:12:09.060 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.061 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:12:09.061 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6804", 2020-04-22T14:12:09.061 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:12:09.061 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.061 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.061 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:12:09.061 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6805", 2020-04-22T14:12:09.062 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:12:09.062 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.062 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:12:09.062 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.063 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6801/33072", 2020-04-22T14:12:09.063 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6803/33072", 2020-04-22T14:12:09.063 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6807/33072", 2020-04-22T14:12:09.063 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6805/33072", 2020-04-22T14:12:09.063 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:12:09.064 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:12:09.064 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:12:09.064 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:12:09.064 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.064 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.064 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 1, 2020-04-22T14:12:09.064 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "65ca5f7d-2ea6-4de6-a034-08a0a99aa80d", 2020-04-22T14:12:09.065 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:12:09.065 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:12:09.065 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:12:09.065 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:12:09.065 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:12:09.065 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:12:09.066 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:12:09.066 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 62, 2020-04-22T14:12:09.066 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:12:09.066 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:12:09.066 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:12:09.066 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:12:09.066 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.067 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:12:09.067 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6808", 2020-04-22T14:12:09.067 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:12:09.067 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.067 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.067 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:12:09.067 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6809", 2020-04-22T14:12:09.068 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:12:09.068 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.068 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:12:09.068 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.069 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:12:09.069 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:12:09.069 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.069 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:12:09.069 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6810", 2020-04-22T14:12:09.069 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:12:09.070 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.070 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.070 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:12:09.070 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6811", 2020-04-22T14:12:09.070 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:12:09.071 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.071 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:12:09.071 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.071 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:12:09.071 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:12:09.072 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.072 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:12:09.072 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6814", 2020-04-22T14:12:09.072 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:12:09.072 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.072 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.072 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:12:09.073 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6815", 2020-04-22T14:12:09.073 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:12:09.073 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.073 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:12:09.073 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.073 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:12:09.073 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:12:09.074 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.074 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:12:09.074 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6812", 2020-04-22T14:12:09.074 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:12:09.074 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.074 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.075 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:12:09.075 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6813", 2020-04-22T14:12:09.075 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:12:09.075 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.075 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:12:09.075 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.075 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6809/33103", 2020-04-22T14:12:09.076 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6811/33103", 2020-04-22T14:12:09.076 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6815/33103", 2020-04-22T14:12:09.076 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6813/33103", 2020-04-22T14:12:09.077 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:12:09.077 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:12:09.077 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:12:09.078 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:12:09.078 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.078 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.078 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 2, 2020-04-22T14:12:09.079 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "f2e9bf44-c844-48d7-b6c2-f08ea71189b4", 2020-04-22T14:12:09.079 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:12:09.079 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:12:09.079 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:12:09.079 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:12:09.080 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:12:09.080 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:12:09.080 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:12:09.080 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 61, 2020-04-22T14:12:09.080 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:12:09.080 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:12:09.080 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:12:09.081 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:12:09.081 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.081 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:12:09.081 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6816", 2020-04-22T14:12:09.082 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:12:09.082 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.082 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.082 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:12:09.082 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6817", 2020-04-22T14:12:09.082 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:12:09.083 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.083 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:12:09.083 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.083 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:12:09.083 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:12:09.083 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.083 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:12:09.084 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6818", 2020-04-22T14:12:09.084 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:12:09.084 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.084 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.084 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:12:09.084 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6819", 2020-04-22T14:12:09.085 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:12:09.085 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.085 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:12:09.085 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.085 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:12:09.085 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:12:09.086 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.086 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:12:09.086 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6822", 2020-04-22T14:12:09.086 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:12:09.086 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.086 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.087 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:12:09.087 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6823", 2020-04-22T14:12:09.087 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:12:09.087 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.088 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:12:09.088 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.088 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:12:09.088 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:12:09.089 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.089 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:12:09.089 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6820", 2020-04-22T14:12:09.089 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:12:09.089 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.090 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.090 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:12:09.090 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6821", 2020-04-22T14:12:09.091 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:12:09.091 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.091 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:12:09.091 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.091 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6817/33153", 2020-04-22T14:12:09.092 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6819/33153", 2020-04-22T14:12:09.092 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6823/33153", 2020-04-22T14:12:09.092 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6821/33153", 2020-04-22T14:12:09.092 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:12:09.092 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:12:09.092 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:12:09.092 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:12:09.093 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.093 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.093 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 3, 2020-04-22T14:12:09.093 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "0ab87fee-a427-4906-851a-b9bd8c2e5645", 2020-04-22T14:12:09.093 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:12:09.093 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:12:09.093 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:12:09.093 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:12:09.094 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:12:09.094 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:12:09.094 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:12:09.094 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 50, 2020-04-22T14:12:09.094 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:12:09.094 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:12:09.094 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:12:09.094 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:12:09.095 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.095 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:12:09.095 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6824", 2020-04-22T14:12:09.095 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:12:09.095 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.095 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.095 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:12:09.095 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6825", 2020-04-22T14:12:09.096 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:12:09.096 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.096 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:12:09.096 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.096 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:12:09.096 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:12:09.096 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.097 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:12:09.097 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6826", 2020-04-22T14:12:09.097 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:12:09.097 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.097 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.097 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:12:09.097 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6827", 2020-04-22T14:12:09.098 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:12:09.098 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.098 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:12:09.098 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.098 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:12:09.098 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:12:09.098 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.098 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:12:09.099 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6830", 2020-04-22T14:12:09.099 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:12:09.099 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.099 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.099 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:12:09.099 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6831", 2020-04-22T14:12:09.099 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:12:09.099 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.100 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:12:09.100 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.100 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:12:09.100 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:12:09.100 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.100 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:12:09.100 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6828", 2020-04-22T14:12:09.101 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:12:09.101 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.101 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.101 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:12:09.101 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6829", 2020-04-22T14:12:09.101 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:12:09.101 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.101 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:12:09.102 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.102 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6825/33183", 2020-04-22T14:12:09.102 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6827/33183", 2020-04-22T14:12:09.102 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6831/33183", 2020-04-22T14:12:09.102 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6829/33183", 2020-04-22T14:12:09.102 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:12:09.102 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:12:09.102 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:12:09.103 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:12:09.103 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.103 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.103 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 4, 2020-04-22T14:12:09.103 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "2565df7d-2eff-484b-a3cd-ed7715e5d875", 2020-04-22T14:12:09.103 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:12:09.103 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:12:09.103 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:12:09.104 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:12:09.104 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:12:09.104 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:12:09.104 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:12:09.104 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 62, 2020-04-22T14:12:09.104 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:12:09.104 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:12:09.105 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:12:09.105 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:12:09.105 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.105 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:12:09.105 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6802", 2020-04-22T14:12:09.105 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:12:09.105 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.106 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.106 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:12:09.106 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6803", 2020-04-22T14:12:09.106 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:12:09.106 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.106 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:12:09.106 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.106 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:12:09.107 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:12:09.107 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.107 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:12:09.107 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6804", 2020-04-22T14:12:09.107 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:12:09.107 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.107 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.107 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:12:09.108 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6805", 2020-04-22T14:12:09.108 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:12:09.108 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.108 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:12:09.108 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.108 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:12:09.108 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:12:09.108 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.109 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:12:09.109 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6808", 2020-04-22T14:12:09.109 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:12:09.109 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.109 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.109 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:12:09.109 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6809", 2020-04-22T14:12:09.110 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:12:09.110 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.110 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:12:09.110 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.110 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:12:09.110 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:12:09.110 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.110 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:12:09.111 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6806", 2020-04-22T14:12:09.111 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:12:09.111 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.111 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.111 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:12:09.111 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6807", 2020-04-22T14:12:09.111 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:12:09.111 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.112 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:12:09.112 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.112 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6803/33506", 2020-04-22T14:12:09.112 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6805/33506", 2020-04-22T14:12:09.112 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6809/33506", 2020-04-22T14:12:09.112 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6807/33506", 2020-04-22T14:12:09.112 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:12:09.112 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:12:09.113 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:12:09.113 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:12:09.113 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.113 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.113 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 5, 2020-04-22T14:12:09.113 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "bcfd7a16-6914-4152-8647-a481917fe19d", 2020-04-22T14:12:09.113 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:12:09.114 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:12:09.114 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:12:09.114 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:12:09.114 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:12:09.114 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:12:09.114 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:12:09.114 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 61, 2020-04-22T14:12:09.114 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:12:09.115 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:12:09.115 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:12:09.115 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:12:09.115 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.115 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:12:09.115 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6810", 2020-04-22T14:12:09.115 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:12:09.115 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.116 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.116 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:12:09.116 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6811", 2020-04-22T14:12:09.116 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:12:09.116 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.116 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:12:09.116 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.116 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:12:09.117 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:12:09.117 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.117 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:12:09.117 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6812", 2020-04-22T14:12:09.117 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:12:09.117 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.117 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.118 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:12:09.118 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6813", 2020-04-22T14:12:09.118 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:12:09.118 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.118 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:12:09.118 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.118 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:12:09.118 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:12:09.119 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.119 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:12:09.119 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6816", 2020-04-22T14:12:09.119 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:12:09.119 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.119 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.119 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:12:09.119 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6817", 2020-04-22T14:12:09.120 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:12:09.120 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.120 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:12:09.120 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.120 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:12:09.120 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:12:09.120 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.121 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:12:09.121 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6814", 2020-04-22T14:12:09.121 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:12:09.121 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.121 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.121 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:12:09.121 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6815", 2020-04-22T14:12:09.121 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:12:09.122 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.122 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:12:09.122 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.122 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6811/33554", 2020-04-22T14:12:09.123 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6813/33554", 2020-04-22T14:12:09.123 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6817/33554", 2020-04-22T14:12:09.123 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6815/33554", 2020-04-22T14:12:09.123 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:12:09.123 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:12:09.123 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:12:09.123 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:12:09.124 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.124 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.124 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 6, 2020-04-22T14:12:09.124 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050", 2020-04-22T14:12:09.124 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:12:09.124 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:12:09.124 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:12:09.125 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:12:09.125 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:12:09.125 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:12:09.125 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:12:09.125 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 62, 2020-04-22T14:12:09.125 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:12:09.125 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:12:09.125 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:12:09.126 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:12:09.126 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.126 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:12:09.126 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6818", 2020-04-22T14:12:09.126 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:12:09.126 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.126 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.126 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:12:09.127 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6819", 2020-04-22T14:12:09.127 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:12:09.127 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.127 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:12:09.127 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.127 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:12:09.127 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:12:09.128 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.128 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:12:09.128 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6820", 2020-04-22T14:12:09.128 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:12:09.128 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.128 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.128 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:12:09.128 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6821", 2020-04-22T14:12:09.129 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:12:09.129 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.129 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:12:09.129 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.129 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:12:09.129 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:12:09.129 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.129 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:12:09.130 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6824", 2020-04-22T14:12:09.130 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:12:09.130 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.130 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.130 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:12:09.130 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6825", 2020-04-22T14:12:09.130 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:12:09.130 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.131 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:12:09.131 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.131 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:12:09.131 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:12:09.131 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.131 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:12:09.131 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6822", 2020-04-22T14:12:09.132 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:12:09.132 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.132 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.132 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:12:09.132 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6823", 2020-04-22T14:12:09.132 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:12:09.132 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.132 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:12:09.133 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.133 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6819/33601", 2020-04-22T14:12:09.133 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6821/33601", 2020-04-22T14:12:09.133 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6825/33601", 2020-04-22T14:12:09.133 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6823/33601", 2020-04-22T14:12:09.133 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:12:09.133 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:12:09.133 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:12:09.134 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:12:09.134 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.134 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.134 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 7, 2020-04-22T14:12:09.134 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "340eece1-4c39-47cd-b95f-9cfa5dcfe361", 2020-04-22T14:12:09.134 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:12:09.134 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:12:09.135 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:12:09.135 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:12:09.135 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:12:09.135 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:12:09.135 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:12:09.135 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 61, 2020-04-22T14:12:09.135 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:12:09.135 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:12:09.136 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:12:09.136 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:12:09.136 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.136 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:12:09.136 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6826", 2020-04-22T14:12:09.136 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:12:09.136 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.136 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.137 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:12:09.137 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6827", 2020-04-22T14:12:09.137 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:12:09.137 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.137 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:12:09.137 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.137 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:12:09.137 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:12:09.138 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.138 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:12:09.138 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6828", 2020-04-22T14:12:09.138 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:12:09.138 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.138 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.138 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:12:09.138 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6829", 2020-04-22T14:12:09.139 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:12:09.139 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.139 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:12:09.139 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.139 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:12:09.139 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:12:09.139 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.140 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:12:09.140 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6832", 2020-04-22T14:12:09.140 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:12:09.140 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.140 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.140 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:12:09.140 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6833", 2020-04-22T14:12:09.140 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:12:09.141 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.141 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:12:09.141 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.141 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:12:09.141 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:12:09.141 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.141 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:12:09.141 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6830", 2020-04-22T14:12:09.142 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:12:09.142 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.142 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.142 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:12:09.142 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6831", 2020-04-22T14:12:09.142 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:12:09.142 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.142 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:12:09.143 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.143 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6827/33629", 2020-04-22T14:12:09.143 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6829/33629", 2020-04-22T14:12:09.143 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6833/33629", 2020-04-22T14:12:09.143 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6831/33629", 2020-04-22T14:12:09.143 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:12:09.143 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:12:09.144 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:12:09.144 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:12:09.144 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.144 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:12:09.144 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_xinfo": [ 2020-04-22T14:12:09.144 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.144 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 0, 2020-04-22T14:12:09.144 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:12:09.145 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:12:09.145 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:12:09.145 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:12:09.145 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:12:09.145 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.384360+0000", 2020-04-22T14:12:09.145 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:12:09.145 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.145 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.146 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 1, 2020-04-22T14:12:09.146 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:12:09.146 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:12:09.146 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:12:09.146 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:12:09.146 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:12:09.146 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.503590+0000", 2020-04-22T14:12:09.146 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:12:09.147 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.147 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.147 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 2, 2020-04-22T14:12:09.147 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:12:09.147 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:12:09.147 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:12:09.147 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:12:09.148 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:12:09.148 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.525058+0000", 2020-04-22T14:12:09.148 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:12:09.148 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.148 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.148 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 3, 2020-04-22T14:12:09.148 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:12:09.148 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:12:09.149 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:12:09.149 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:12:09.149 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:12:09.149 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.599729+0000", 2020-04-22T14:12:09.149 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:12:09.149 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.149 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.149 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 4, 2020-04-22T14:12:09.150 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:12:09.150 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:12:09.150 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:12:09.150 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:12:09.150 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:12:09.150 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.600919+0000", 2020-04-22T14:12:09.150 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:12:09.150 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.151 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.151 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 5, 2020-04-22T14:12:09.151 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:12:09.151 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:12:09.151 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:12:09.151 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:12:09.151 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:12:09.152 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.654718+0000", 2020-04-22T14:12:09.152 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:12:09.152 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.152 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.152 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 6, 2020-04-22T14:12:09.152 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:12:09.152 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:12:09.152 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:12:09.153 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:12:09.153 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:12:09.153 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.718342+0000", 2020-04-22T14:12:09.153 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:12:09.153 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.153 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:09.153 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 7, 2020-04-22T14:12:09.154 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:12:09.154 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:12:09.154 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:12:09.154 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:12:09.154 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:12:09.154 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.839089+0000", 2020-04-22T14:12:09.154 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:12:09.154 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.155 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:12:09.155 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_upmap": [], 2020-04-22T14:12:09.155 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_upmap_items": [], 2020-04-22T14:12:09.155 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_temp": [], 2020-04-22T14:12:09.155 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_temp": [], 2020-04-22T14:12:09.155 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklist": { 2020-04-22T14:12:09.155 INFO:teuthology.orchestra.run.smithi103.stdout: "172.21.15.103:0/3218856707": "2020-04-22T15:11:52.279816+0000", 2020-04-22T14:12:09.156 INFO:teuthology.orchestra.run.smithi103.stdout: "172.21.15.103:6833/2152235919": "2020-04-23T14:10:59.132933+0000", 2020-04-22T14:12:09.156 INFO:teuthology.orchestra.run.smithi103.stdout: "172.21.15.103:6832/2152235919": "2020-04-23T14:10:59.132933+0000" 2020-04-22T14:12:09.156 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.156 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profiles": { 2020-04-22T14:12:09.156 INFO:teuthology.orchestra.run.smithi103.stdout: "default": { 2020-04-22T14:12:09.156 INFO:teuthology.orchestra.run.smithi103.stdout: "crush-failure-domain": "osd", 2020-04-22T14:12:09.156 INFO:teuthology.orchestra.run.smithi103.stdout: "k": "2", 2020-04-22T14:12:09.156 INFO:teuthology.orchestra.run.smithi103.stdout: "m": "1", 2020-04-22T14:12:09.157 INFO:teuthology.orchestra.run.smithi103.stdout: "plugin": "jerasure", 2020-04-22T14:12:09.157 INFO:teuthology.orchestra.run.smithi103.stdout: "ruleset-failure-domain": "osd", 2020-04-22T14:12:09.157 INFO:teuthology.orchestra.run.smithi103.stdout: "technique": "reed_sol_van" 2020-04-22T14:12:09.157 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:09.157 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:09.157 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps_queue": [], 2020-04-22T14:12:09.157 INFO:teuthology.orchestra.run.smithi103.stdout: "new_removed_snaps": [], 2020-04-22T14:12:09.157 INFO:teuthology.orchestra.run.smithi103.stdout: "new_purged_snaps": [], 2020-04-22T14:12:09.158 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_node_flags": {}, 2020-04-22T14:12:09.158 INFO:teuthology.orchestra.run.smithi103.stdout: "device_class_flags": {} 2020-04-22T14:12:09.158 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:12:09.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.988+0000 7ffba0279700 1 -- 172.21.15.103:0/1817023787 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffb7804dc50 msgr2=0x7ffb78050110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:09.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.988+0000 7ffba0279700 1 --2- 172.21.15.103:0/1817023787 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffb7804dc50 0x7ffb78050110 secure :-1 s=READY pgs=378 cs=0 l=1 rx=0x7ffb88002f30 tx=0x7ffb88002340).stop 2020-04-22T14:12:09.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.988+0000 7ffba0279700 1 -- 172.21.15.103:0/1817023787 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb98065fe0 msgr2=0x7ffb980b54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:09.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.988+0000 7ffba0279700 1 --2- 172.21.15.103:0/1817023787 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb98065fe0 0x7ffb980b54c0 secure :-1 s=READY pgs=1016 cs=0 l=1 rx=0x7ffb94001f50 tx=0x7ffb94010850).stop 2020-04-22T14:12:09.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.988+0000 7ffba0279700 1 -- 172.21.15.103:0/1817023787 shutdown_connections 2020-04-22T14:12:09.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.988+0000 7ffba0279700 1 --2- 172.21.15.103:0/1817023787 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffb7804dc50 0x7ffb78050110 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:09.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.988+0000 7ffba0279700 1 --2- 172.21.15.103:0/1817023787 >> v2:172.21.15.86:3300/0 conn(0x7ffb9812c0d0 0x7ffb980b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:09.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.988+0000 7ffba0279700 1 --2- 172.21.15.103:0/1817023787 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb98065fe0 0x7ffb980b54c0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:09.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.988+0000 7ffba0279700 1 -- 172.21.15.103:0/1817023787 >> 172.21.15.103:0/1817023787 conn(0x7ffb980b9160 msgr2=0x7ffb9805ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:09.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.988+0000 7ffba0279700 1 -- 172.21.15.103:0/1817023787 shutdown_connections 2020-04-22T14:12:09.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:08.988+0000 7ffba0279700 1 -- 172.21.15.103:0/1817023787 wait complete. 2020-04-22T14:12:09.162 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:09.176 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:12:09.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.319+0000 7f952d6e2700 1 Processor -- start 2020-04-22T14:12:09.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.319+0000 7f952d6e2700 1 -- start start 2020-04-22T14:12:09.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.319+0000 7f952d6e2700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f95281428d0 0x7f9528142cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:09.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.320+0000 7f952d6e2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f95280b6480 0x7f95280b4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:09.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.320+0000 7f952d6e2700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9528066ce0 con 0x7f95280b6000 2020-04-22T14:12:09.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.320+0000 7f952d6e2700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9528066f80 con 0x7f95281428d0 2020-04-22T14:12:09.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.320+0000 7f952d6e2700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9528067220 con 0x7f95280b6480 2020-04-22T14:12:09.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.320+0000 7f952cee1700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f95280b6480 0x7f95280b4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:09.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.320+0000 7f95277fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f95280b6000 0x7f95280b2ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44616/0 (socket says 172.21.15.103:44616) 2020-04-22T14:12:09.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.320+0000 7f95277fe700 1 -- 172.21.15.103:0/2128728832 learned_addr learned my addr 172.21.15.103:0/2128728832 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:09.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.320+0000 7f9527fff700 1 --2- 172.21.15.103:0/2128728832 >> v2:172.21.15.86:3300/0 conn(0x7f95281428d0 0x7f9528142cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:09.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.320+0000 7f952cee1700 1 -- 172.21.15.103:0/2128728832 >> v2:172.21.15.86:3300/0 conn(0x7f95281428d0 msgr2=0x7f9528142cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:09.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.320+0000 7f952cee1700 1 --2- 172.21.15.103:0/2128728832 >> v2:172.21.15.86:3300/0 conn(0x7f95281428d0 0x7f9528142cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:09.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.320+0000 7f952cee1700 1 -- 172.21.15.103:0/2128728832 >> v1:172.21.15.103:6789/0 conn(0x7f95280b6000 legacy=0x7f95280b2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:09.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.320+0000 7f952cee1700 1 -- 172.21.15.103:0/2128728832 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95280b31f0 con 0x7f95280b6480 2020-04-22T14:12:09.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.320+0000 7f9526ffd700 1 -- 172.21.15.103:0/2128728832 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 403092957 0 0) 0x7f9528066ce0 con 0x7f95280b6000 2020-04-22T14:12:09.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.320+0000 7f952cee1700 1 --2- 172.21.15.103:0/2128728832 >> v2:172.21.15.103:3300/0 conn(0x7f95280b6480 0x7f95280b4200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f95200032b0 tx=0x7f9520007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:09.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.320+0000 7f952cee1700 1 --2- 172.21.15.103:0/2128728832 >> v2:172.21.15.103:3300/0 conn(0x7f95280b6480 0x7f95280b4200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f95200032b0 tx=0x7f9520007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:09.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.320+0000 7f952cee1700 1 --2- 172.21.15.103:0/2128728832 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95280b6480 0x7f95280b4200 secure :-1 s=READY pgs=1018 cs=0 l=1 rx=0x7f95200032b0 tx=0x7f9520007dc0).ready entity=mon.1 client_cookie=eecb212af8b45e82 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:09.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.320+0000 7f952cee1700 1 --2- 172.21.15.103:0/2128728832 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95280b6480 0x7f95280b4200 secure :-1 s=THROTTLE_DONE pgs=1018 cs=0 l=1 rx=0x7f95200032b0 tx=0x7f9520007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:09.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.320+0000 7f9526ffd700 1 -- 172.21.15.103:0/2128728832 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f952000a180 con 0x7f95280b6480 2020-04-22T14:12:09.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.320+0000 7f952cee1700 1 --2- 172.21.15.103:0/2128728832 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95280b6480 0x7f95280b4200 secure :-1 s=THROTTLE_DONE pgs=1018 cs=0 l=1 rx=0x7f95200032b0 tx=0x7f9520007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:09.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.320+0000 7f952cee1700 1 --2- 172.21.15.103:0/2128728832 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95280b6480 0x7f95280b4200 secure :-1 s=THROTTLE_DONE pgs=1018 cs=0 l=1 rx=0x7f95200032b0 tx=0x7f9520007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:09.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.320+0000 7f9526ffd700 1 -- 172.21.15.103:0/2128728832 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952000a2e0 con 0x7f95280b6480 2020-04-22T14:12:09.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.320+0000 7f9526ffd700 1 -- 172.21.15.103:0/2128728832 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f952000a6c0 con 0x7f95280b6480 2020-04-22T14:12:09.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.320+0000 7f952d6e2700 1 -- 172.21.15.103:0/2128728832 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95280b6480 msgr2=0x7f95280b4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:09.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.320+0000 7f952d6e2700 1 --2- 172.21.15.103:0/2128728832 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95280b6480 0x7f95280b4200 secure :-1 s=READY pgs=1018 cs=0 l=1 rx=0x7f95200032b0 tx=0x7f9520007dc0).stop 2020-04-22T14:12:09.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.321+0000 7f952d6e2700 1 -- 172.21.15.103:0/2128728832 shutdown_connections 2020-04-22T14:12:09.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.321+0000 7f952d6e2700 1 --2- 172.21.15.103:0/2128728832 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95280b6480 0x7f95280b4200 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:09.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.321+0000 7f952d6e2700 1 --2- 172.21.15.103:0/2128728832 >> v2:172.21.15.86:3300/0 conn(0x7f95281428d0 0x7f9528142cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:09.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.321+0000 7f952d6e2700 1 -- 172.21.15.103:0/2128728832 >> 172.21.15.103:0/2128728832 conn(0x7f952805fdc0 msgr2=0x7f95280601d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:09.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.321+0000 7f952d6e2700 1 -- 172.21.15.103:0/2128728832 shutdown_connections 2020-04-22T14:12:09.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.321+0000 7f952d6e2700 1 -- 172.21.15.103:0/2128728832 wait complete. 2020-04-22T14:12:09.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.322+0000 7f952d6e2700 1 Processor -- start 2020-04-22T14:12:09.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.322+0000 7f952d6e2700 1 -- start start 2020-04-22T14:12:09.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.322+0000 7f952d6e2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f95280b6000 0x7f9528063580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:09.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.322+0000 7f952d6e2700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f95281428d0 0x7f952813c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:09.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.322+0000 7f952d6e2700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f952813d4e0 con 0x7f95280b6480 2020-04-22T14:12:09.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.322+0000 7f952d6e2700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f952813dda0 con 0x7f95281428d0 2020-04-22T14:12:09.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.322+0000 7f952d6e2700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9528063b40 con 0x7f95280b6000 2020-04-22T14:12:09.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.323+0000 7f9527fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f95280b6000 0x7f9528063580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:09.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.323+0000 7f95277fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f95280b6480 0x7f952813d690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44622/0 (socket says 172.21.15.103:44622) 2020-04-22T14:12:09.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.323+0000 7f9527fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f95280b6000 0x7f9528063580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52430/0 (socket says 172.21.15.103:52430) 2020-04-22T14:12:09.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.323+0000 7f95277fe700 1 -- 172.21.15.103:0/2986596248 learned_addr learned my addr 172.21.15.103:0/2986596248 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:09.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.323+0000 7f952cee1700 1 --2- 172.21.15.103:0/2986596248 >> v2:172.21.15.86:3300/0 conn(0x7f95281428d0 0x7f952813c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:09.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.323+0000 7f9527fff700 1 -- 172.21.15.103:0/2986596248 >> v2:172.21.15.86:3300/0 conn(0x7f95281428d0 msgr2=0x7f952813c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:09.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.323+0000 7f9527fff700 1 --2- 172.21.15.103:0/2986596248 >> v2:172.21.15.86:3300/0 conn(0x7f95281428d0 0x7f952813c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:09.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.323+0000 7f9527fff700 1 -- 172.21.15.103:0/2986596248 >> v1:172.21.15.103:6789/0 conn(0x7f95280b6480 legacy=0x7f952813d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:09.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.323+0000 7f95257fa700 1 -- 172.21.15.103:0/2986596248 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4008070704 0 0) 0x7f952813d4e0 con 0x7f95280b6480 2020-04-22T14:12:09.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.323+0000 7f9527fff700 1 -- 172.21.15.103:0/2986596248 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9528063de0 con 0x7f95280b6000 2020-04-22T14:12:09.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.323+0000 7f9527fff700 1 --2- 172.21.15.103:0/2986596248 >> v2:172.21.15.103:3300/0 conn(0x7f95280b6000 0x7f9528063580 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9518002f30 tx=0x7f9518010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:09.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.323+0000 7f9527fff700 1 --2- 172.21.15.103:0/2986596248 >> v2:172.21.15.103:3300/0 conn(0x7f95280b6000 0x7f9528063580 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9518002f30 tx=0x7f9518010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:09.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.323+0000 7f9527fff700 1 --2- 172.21.15.103:0/2986596248 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95280b6000 0x7f9528063580 secure :-1 s=READY pgs=1020 cs=0 l=1 rx=0x7f9518002f30 tx=0x7f9518010b70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:09.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.323+0000 7f9527fff700 1 --2- 172.21.15.103:0/2986596248 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95280b6000 0x7f9528063580 secure :-1 s=THROTTLE_DONE pgs=1020 cs=0 l=1 rx=0x7f9518002f30 tx=0x7f9518010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:09.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.323+0000 7f95257fa700 1 -- 172.21.15.103:0/2986596248 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9518005b40 con 0x7f95280b6000 2020-04-22T14:12:09.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.323+0000 7f9527fff700 1 --2- 172.21.15.103:0/2986596248 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95280b6000 0x7f9528063580 secure :-1 s=THROTTLE_DONE pgs=1020 cs=0 l=1 rx=0x7f9518002f30 tx=0x7f9518010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:09.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.323+0000 7f9527fff700 1 --2- 172.21.15.103:0/2986596248 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95280b6000 0x7f9528063580 secure :-1 s=THROTTLE_DONE pgs=1020 cs=0 l=1 rx=0x7f9518002f30 tx=0x7f9518010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:09.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.323+0000 7f95257fa700 1 -- 172.21.15.103:0/2986596248 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9518005ca0 con 0x7f95280b6000 2020-04-22T14:12:09.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.323+0000 7f952d6e2700 1 -- 172.21.15.103:0/2986596248 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9528064080 con 0x7f95280b6000 2020-04-22T14:12:09.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.323+0000 7f95257fa700 1 -- 172.21.15.103:0/2986596248 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9518005e50 con 0x7f95280b6000 2020-04-22T14:12:09.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.323+0000 7f952d6e2700 1 -- 172.21.15.103:0/2986596248 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f952813a7f0 con 0x7f95280b6000 2020-04-22T14:12:09.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.324+0000 7f9527fff700 1 --2- 172.21.15.103:0/2986596248 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95280b6000 0x7f9528063580 secure :-1 s=THROTTLE_DONE pgs=1020 cs=0 l=1 rx=0x7f9518002f30 tx=0x7f9518010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:09.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.324+0000 7f952d6e2700 1 -- 172.21.15.103:0/2986596248 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9528064240 con 0x7f95280b6000 2020-04-22T14:12:09.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.324+0000 7f95257fa700 1 -- 172.21.15.103:0/2986596248 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f95180071a0 con 0x7f95280b6000 2020-04-22T14:12:09.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.324+0000 7f9527fff700 1 --2- 172.21.15.103:0/2986596248 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95280b6000 0x7f9528063580 secure :-1 s=THROTTLE_DONE pgs=1020 cs=0 l=1 rx=0x7f9518002f30 tx=0x7f9518010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:09.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.325+0000 7f95257fa700 1 --2- 172.21.15.103:0/2986596248 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f950804d990 0x7f950804fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:09.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.325+0000 7f95257fa700 1 -- 172.21.15.103:0/2986596248 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f9518061720 con 0x7f95280b6000 2020-04-22T14:12:09.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.325+0000 7f95277fe700 1 --2- 172.21.15.103:0/2986596248 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f950804d990 0x7f950804fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:09.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.325+0000 7f95277fe700 1 --2- 172.21.15.103:0/2986596248 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f950804d990 0x7f950804fe50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f951c001130 tx=0x7f951c0016a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:09.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.325+0000 7f95277fe700 1 --2- 172.21.15.103:0/2986596248 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f950804d990 0x7f950804fe50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f951c001130 tx=0x7f951c0016a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:09.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.325+0000 7f95277fe700 1 --2- 172.21.15.103:0/2986596248 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f950804d990 0x7f950804fe50 secure :-1 s=READY pgs=379 cs=0 l=1 rx=0x7f951c001130 tx=0x7f951c0016a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:09.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.328+0000 7f9527fff700 1 --2- 172.21.15.103:0/2986596248 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95280b6000 0x7f9528063580 secure :-1 s=THROTTLE_DONE pgs=1020 cs=0 l=1 rx=0x7f9518002f30 tx=0x7f9518010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:09.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.328+0000 7f95257fa700 1 -- 172.21.15.103:0/2986596248 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f951803cb00 con 0x7f95280b6000 2020-04-22T14:12:09.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.519+0000 7f952d6e2700 1 -- 172.21.15.103:0/2986596248 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9528056c90 con 0x7f95280b6000 2020-04-22T14:12:09.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.520+0000 7f9527fff700 1 --2- 172.21.15.103:0/2986596248 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95280b6000 0x7f9528063580 secure :-1 s=THROTTLE_DONE pgs=1020 cs=0 l=1 rx=0x7f9518002f30 tx=0x7f9518010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:09.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.520+0000 7f95257fa700 1 -- 172.21.15.103:0/2986596248 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+2145 (secure 0 0 0) 0x7f9518040120 con 0x7f95280b6000 2020-04-22T14:12:09.524 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:12:09.524 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/1837726033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1837726033},{"type":"v1","addr":"172.21.15.86:6835","nonce":1837726033}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:11:54.377522+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":65,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":16,"addr":"172.21.15.103:6833/2753934632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2753934632},{"type":"v1","addr":"172.21.15.103:6833","nonce":2753934632}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:12:09.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.521+0000 7f952d6e2700 1 -- 172.21.15.103:0/2986596248 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f950804d990 msgr2=0x7f950804fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:09.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.521+0000 7f952d6e2700 1 --2- 172.21.15.103:0/2986596248 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f950804d990 0x7f950804fe50 secure :-1 s=READY pgs=379 cs=0 l=1 rx=0x7f951c001130 tx=0x7f951c0016a0).stop 2020-04-22T14:12:09.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.521+0000 7f952d6e2700 1 -- 172.21.15.103:0/2986596248 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95280b6000 msgr2=0x7f9528063580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:09.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.521+0000 7f952d6e2700 1 --2- 172.21.15.103:0/2986596248 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95280b6000 0x7f9528063580 secure :-1 s=READY pgs=1020 cs=0 l=1 rx=0x7f9518002f30 tx=0x7f9518010b70).stop 2020-04-22T14:12:09.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.521+0000 7f952d6e2700 1 -- 172.21.15.103:0/2986596248 shutdown_connections 2020-04-22T14:12:09.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.521+0000 7f952d6e2700 1 --2- 172.21.15.103:0/2986596248 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f950804d990 0x7f950804fe50 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:09.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.521+0000 7f952d6e2700 1 --2- 172.21.15.103:0/2986596248 >> v2:172.21.15.86:3300/0 conn(0x7f95281428d0 0x7f952813c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:09.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.521+0000 7f952d6e2700 1 --2- 172.21.15.103:0/2986596248 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95280b6000 0x7f9528063580 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:09.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.521+0000 7f952d6e2700 1 -- 172.21.15.103:0/2986596248 >> 172.21.15.103:0/2986596248 conn(0x7f952805fdc0 msgr2=0x7f952813ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:09.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.521+0000 7f952d6e2700 1 -- 172.21.15.103:0/2986596248 shutdown_connections 2020-04-22T14:12:09.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.521+0000 7f952d6e2700 1 -- 172.21.15.103:0/2986596248 wait complete. 2020-04-22T14:12:09.527 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 43 2020-04-22T14:12:09.534 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:09.548 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2020-04-22T14:12:09.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.693+0000 7f3c4781e700 1 Processor -- start 2020-04-22T14:12:09.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.693+0000 7f3c4781e700 1 -- start start 2020-04-22T14:12:09.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.694+0000 7f3c4781e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3c400b4320 0x7f3c400b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:09.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.694+0000 7f3c4781e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3c400b4700 0x7f3c400b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:09.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.694+0000 7f3c4781e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c400b2530 0x7f3c400afa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:09.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.694+0000 7f3c4781e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c400b2ac0 con 0x7f3c400b4700 2020-04-22T14:12:09.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.694+0000 7f3c4781e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c400b0e90 con 0x7f3c400b4320 2020-04-22T14:12:09.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.694+0000 7f3c4781e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c400b1130 con 0x7f3c400b2530 2020-04-22T14:12:09.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.694+0000 7f3c455ba700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3c400b4320 0x7f3c400b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:09.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.694+0000 7f3c455ba700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3c400b4320 0x7f3c400b15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52440/0 (socket says 172.21.15.103:52440) 2020-04-22T14:12:09.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.694+0000 7f3c455ba700 1 -- 172.21.15.103:0/2722190196 learned_addr learned my addr 172.21.15.103:0/2722190196 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:09.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.694+0000 7f3c45dbb700 1 --2- 172.21.15.103:0/2722190196 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c400b2530 0x7f3c400afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:09.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.694+0000 7f3c455ba700 1 -- 172.21.15.103:0/2722190196 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c400b2530 msgr2=0x7f3c400afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:09.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.694+0000 7f3c44db9700 1 --2- 172.21.15.103:0/2722190196 >> v2:172.21.15.86:3300/0 conn(0x7f3c400b4700 0x7f3c400b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:09.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.694+0000 7f3c455ba700 1 --2- 172.21.15.103:0/2722190196 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c400b2530 0x7f3c400afa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:09.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.694+0000 7f3c455ba700 1 -- 172.21.15.103:0/2722190196 >> v2:172.21.15.86:3300/0 conn(0x7f3c400b4700 msgr2=0x7f3c400b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:09.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.694+0000 7f3c455ba700 1 --2- 172.21.15.103:0/2722190196 >> v2:172.21.15.86:3300/0 conn(0x7f3c400b4700 0x7f3c400b1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:09.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.694+0000 7f3c455ba700 1 -- 172.21.15.103:0/2722190196 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c400ae500 con 0x7f3c400b4320 2020-04-22T14:12:09.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.695+0000 7f3c45dbb700 1 --2- 172.21.15.103:0/2722190196 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c400b2530 0x7f3c400afa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:12:09.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.695+0000 7f3c455ba700 1 --2- 172.21.15.103:0/2722190196 >> v2:172.21.15.103:3300/0 conn(0x7f3c400b4320 0x7f3c400b15d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3c34002f30 tx=0x7f3c34007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:09.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.695+0000 7f3c455ba700 1 --2- 172.21.15.103:0/2722190196 >> v2:172.21.15.103:3300/0 conn(0x7f3c400b4320 0x7f3c400b15d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3c34002f30 tx=0x7f3c34007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:09.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.695+0000 7f3c455ba700 1 --2- 172.21.15.103:0/2722190196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c400b4320 0x7f3c400b15d0 secure :-1 s=READY pgs=1021 cs=0 l=1 rx=0x7f3c34002f30 tx=0x7f3c34007a40).ready entity=mon.1 client_cookie=71c4d8591d9dd1ab server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:09.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.695+0000 7f3c455ba700 1 --2- 172.21.15.103:0/2722190196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c400b4320 0x7f3c400b15d0 secure :-1 s=THROTTLE_DONE pgs=1021 cs=0 l=1 rx=0x7f3c34002f30 tx=0x7f3c34007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:09.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.695+0000 7f3c33fff700 1 -- 172.21.15.103:0/2722190196 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c34011720 con 0x7f3c400b4320 2020-04-22T14:12:09.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.695+0000 7f3c455ba700 1 --2- 172.21.15.103:0/2722190196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c400b4320 0x7f3c400b15d0 secure :-1 s=THROTTLE_DONE pgs=1021 cs=0 l=1 rx=0x7f3c34002f30 tx=0x7f3c34007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:09.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.695+0000 7f3c33fff700 1 -- 172.21.15.103:0/2722190196 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c34011880 con 0x7f3c400b4320 2020-04-22T14:12:09.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.695+0000 7f3c455ba700 1 --2- 172.21.15.103:0/2722190196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c400b4320 0x7f3c400b15d0 secure :-1 s=THROTTLE_DONE pgs=1021 cs=0 l=1 rx=0x7f3c34002f30 tx=0x7f3c34007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:09.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.695+0000 7f3c33fff700 1 -- 172.21.15.103:0/2722190196 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c34011ca0 con 0x7f3c400b4320 2020-04-22T14:12:09.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.695+0000 7f3c4781e700 1 -- 172.21.15.103:0/2722190196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c400b4320 msgr2=0x7f3c400b15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:09.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.695+0000 7f3c4781e700 1 --2- 172.21.15.103:0/2722190196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c400b4320 0x7f3c400b15d0 secure :-1 s=READY pgs=1021 cs=0 l=1 rx=0x7f3c34002f30 tx=0x7f3c34007a40).stop 2020-04-22T14:12:09.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.695+0000 7f3c4781e700 1 -- 172.21.15.103:0/2722190196 shutdown_connections 2020-04-22T14:12:09.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.695+0000 7f3c4781e700 1 --2- 172.21.15.103:0/2722190196 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c400b2530 0x7f3c400afa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:09.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.695+0000 7f3c4781e700 1 --2- 172.21.15.103:0/2722190196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c400b4320 0x7f3c400b15d0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:09.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.695+0000 7f3c4781e700 1 --2- 172.21.15.103:0/2722190196 >> v2:172.21.15.86:3300/0 conn(0x7f3c400b4700 0x7f3c400b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:09.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.695+0000 7f3c4781e700 1 -- 172.21.15.103:0/2722190196 >> 172.21.15.103:0/2722190196 conn(0x7f3c400b86b0 msgr2=0x7f3c400b8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:09.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.695+0000 7f3c4781e700 1 -- 172.21.15.103:0/2722190196 shutdown_connections 2020-04-22T14:12:09.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.695+0000 7f3c4781e700 1 -- 172.21.15.103:0/2722190196 wait complete. 2020-04-22T14:12:09.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.696+0000 7f3c4781e700 1 Processor -- start 2020-04-22T14:12:09.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.696+0000 7f3c4781e700 1 -- start start 2020-04-22T14:12:09.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.697+0000 7f3c4781e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c400b2530 0x7f3c40137580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:09.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.697+0000 7f3c4781e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3c400b4320 0x7f3c40124980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:09.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.697+0000 7f3c4781e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3c400b4700 0x7f3c40124de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:09.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.697+0000 7f3c4781e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c401379e0 con 0x7f3c400b4320 2020-04-22T14:12:09.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.697+0000 7f3c4781e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c40063fa0 con 0x7f3c400b4700 2020-04-22T14:12:09.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.697+0000 7f3c4781e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c400635c0 con 0x7f3c400b2530 2020-04-22T14:12:09.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.697+0000 7f3c45dbb700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3c400b4700 0x7f3c40124de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:09.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.697+0000 7f3c45dbb700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3c400b4700 0x7f3c40124de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52448/0 (socket says 172.21.15.103:52448) 2020-04-22T14:12:09.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.697+0000 7f3c45dbb700 1 -- 172.21.15.103:0/1952353980 learned_addr learned my addr 172.21.15.103:0/1952353980 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:09.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.697+0000 7f3c455ba700 1 --2- 172.21.15.103:0/1952353980 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c400b2530 0x7f3c40137580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:09.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.697+0000 7f3c44db9700 1 --2- 172.21.15.103:0/1952353980 >> v2:172.21.15.86:3300/0 conn(0x7f3c400b4320 0x7f3c40124980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:09.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.697+0000 7f3c45dbb700 1 -- 172.21.15.103:0/1952353980 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c400b2530 msgr2=0x7f3c40137580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:09.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.697+0000 7f3c45dbb700 1 --2- 172.21.15.103:0/1952353980 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c400b2530 0x7f3c40137580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:09.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.697+0000 7f3c45dbb700 1 -- 172.21.15.103:0/1952353980 >> v2:172.21.15.86:3300/0 conn(0x7f3c400b4320 msgr2=0x7f3c40124980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:09.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.697+0000 7f3c45dbb700 1 --2- 172.21.15.103:0/1952353980 >> v2:172.21.15.86:3300/0 conn(0x7f3c400b4320 0x7f3c40124980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:09.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.697+0000 7f3c45dbb700 1 -- 172.21.15.103:0/1952353980 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c40063860 con 0x7f3c400b4700 2020-04-22T14:12:09.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.697+0000 7f3c44db9700 1 --2- 172.21.15.103:0/1952353980 >> v2:172.21.15.86:3300/0 conn(0x7f3c400b4320 0x7f3c40124980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:12:09.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.697+0000 7f3c45dbb700 1 --2- 172.21.15.103:0/1952353980 >> v2:172.21.15.103:3300/0 conn(0x7f3c400b4700 0x7f3c40124de0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3c380032b0 tx=0x7f3c38010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:09.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.698+0000 7f3c45dbb700 1 --2- 172.21.15.103:0/1952353980 >> v2:172.21.15.103:3300/0 conn(0x7f3c400b4700 0x7f3c40124de0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3c380032b0 tx=0x7f3c38010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:09.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.698+0000 7f3c45dbb700 1 --2- 172.21.15.103:0/1952353980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c400b4700 0x7f3c40124de0 secure :-1 s=READY pgs=1022 cs=0 l=1 rx=0x7f3c380032b0 tx=0x7f3c38010de0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:09.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.698+0000 7f3c45dbb700 1 --2- 172.21.15.103:0/1952353980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c400b4700 0x7f3c40124de0 secure :-1 s=THROTTLE_DONE pgs=1022 cs=0 l=1 rx=0x7f3c380032b0 tx=0x7f3c38010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:09.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.698+0000 7f3c45dbb700 1 --2- 172.21.15.103:0/1952353980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c400b4700 0x7f3c40124de0 secure :-1 s=THROTTLE_DONE pgs=1022 cs=0 l=1 rx=0x7f3c380032b0 tx=0x7f3c38010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:09.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.698+0000 7f3c45dbb700 1 --2- 172.21.15.103:0/1952353980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c400b4700 0x7f3c40124de0 secure :-1 s=THROTTLE_DONE pgs=1022 cs=0 l=1 rx=0x7f3c380032b0 tx=0x7f3c38010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:09.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.698+0000 7f3c327fc700 1 -- 172.21.15.103:0/1952353980 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c38007370 con 0x7f3c400b4700 2020-04-22T14:12:09.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.698+0000 7f3c327fc700 1 -- 172.21.15.103:0/1952353980 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c380074d0 con 0x7f3c400b4700 2020-04-22T14:12:09.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.698+0000 7f3c4781e700 1 -- 172.21.15.103:0/1952353980 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c40063b00 con 0x7f3c400b4700 2020-04-22T14:12:09.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.698+0000 7f3c327fc700 1 -- 172.21.15.103:0/1952353980 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c380078b0 con 0x7f3c400b4700 2020-04-22T14:12:09.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.698+0000 7f3c4781e700 1 -- 172.21.15.103:0/1952353980 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c40141490 con 0x7f3c400b4700 2020-04-22T14:12:09.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.698+0000 7f3c45dbb700 1 --2- 172.21.15.103:0/1952353980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c400b4700 0x7f3c40124de0 secure :-1 s=THROTTLE_DONE pgs=1022 cs=0 l=1 rx=0x7f3c380032b0 tx=0x7f3c38010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:09.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.699+0000 7f3c45dbb700 1 --2- 172.21.15.103:0/1952353980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c400b4700 0x7f3c40124de0 secure :-1 s=THROTTLE_DONE pgs=1022 cs=0 l=1 rx=0x7f3c380032b0 tx=0x7f3c38010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:09.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.699+0000 7f3c327fc700 1 -- 172.21.15.103:0/1952353980 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f3c38012480 con 0x7f3c400b4700 2020-04-22T14:12:09.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.699+0000 7f3c4781e700 1 -- 172.21.15.103:0/1952353980 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c40063cc0 con 0x7f3c400b4700 2020-04-22T14:12:09.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.699+0000 7f3c327fc700 1 --2- 172.21.15.103:0/1952353980 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3c2004da20 0x7f3c2004fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:09.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.699+0000 7f3c327fc700 1 -- 172.21.15.103:0/1952353980 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f3c38061680 con 0x7f3c400b4700 2020-04-22T14:12:09.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.699+0000 7f3c455ba700 1 --2- 172.21.15.103:0/1952353980 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3c2004da20 0x7f3c2004fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:09.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.699+0000 7f3c455ba700 1 --2- 172.21.15.103:0/1952353980 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3c2004da20 0x7f3c2004fee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3c34002f30 tx=0x7f3c34007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:09.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.700+0000 7f3c455ba700 1 --2- 172.21.15.103:0/1952353980 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3c2004da20 0x7f3c2004fee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3c34002f30 tx=0x7f3c34007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:09.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.700+0000 7f3c455ba700 1 --2- 172.21.15.103:0/1952353980 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3c2004da20 0x7f3c2004fee0 secure :-1 s=READY pgs=380 cs=0 l=1 rx=0x7f3c34002f30 tx=0x7f3c34007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:09.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.703+0000 7f3c45dbb700 1 --2- 172.21.15.103:0/1952353980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c400b4700 0x7f3c40124de0 secure :-1 s=THROTTLE_DONE pgs=1022 cs=0 l=1 rx=0x7f3c380032b0 tx=0x7f3c38010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:09.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.703+0000 7f3c327fc700 1 -- 172.21.15.103:0/1952353980 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f3c3803c9c0 con 0x7f3c400b4700 2020-04-22T14:12:09.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:09.893+0000 7f3c4781e700 1 -- 172.21.15.103:0/1952353980 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f3c40056c90 con 0x7f3c400b4700 2020-04-22T14:12:10.429 INFO:tasks.ceph.mon.b.smithi086.stderr:2020-04-22T14:12:10.426+0000 7fbdbf880700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-04-22T14:12:10.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.434+0000 7f3c45dbb700 1 --2- 172.21.15.103:0/1952353980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c400b4700 0x7f3c40124de0 secure :-1 s=THROTTLE_DONE pgs=1022 cs=0 l=1 rx=0x7f3c380032b0 tx=0x7f3c38010de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:10.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.434+0000 7f3c327fc700 1 -- 172.21.15.103:0/1952353980 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v44) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3c3803ffe0 con 0x7f3c400b4700 2020-04-22T14:12:10.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.436+0000 7f3c4781e700 1 -- 172.21.15.103:0/1952353980 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3c2004da20 msgr2=0x7f3c2004fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:10.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.436+0000 7f3c4781e700 1 --2- 172.21.15.103:0/1952353980 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3c2004da20 0x7f3c2004fee0 secure :-1 s=READY pgs=380 cs=0 l=1 rx=0x7f3c34002f30 tx=0x7f3c34007a40).stop 2020-04-22T14:12:10.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.436+0000 7f3c4781e700 1 -- 172.21.15.103:0/1952353980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c400b4700 msgr2=0x7f3c40124de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:10.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.436+0000 7f3c4781e700 1 --2- 172.21.15.103:0/1952353980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c400b4700 0x7f3c40124de0 secure :-1 s=READY pgs=1022 cs=0 l=1 rx=0x7f3c380032b0 tx=0x7f3c38010de0).stop 2020-04-22T14:12:10.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.436+0000 7f3c4781e700 1 -- 172.21.15.103:0/1952353980 shutdown_connections 2020-04-22T14:12:10.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.436+0000 7f3c4781e700 1 --2- 172.21.15.103:0/1952353980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c400b4700 0x7f3c40124de0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:10.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.436+0000 7f3c4781e700 1 --2- 172.21.15.103:0/1952353980 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c400b2530 0x7f3c40137580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:10.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.436+0000 7f3c4781e700 1 --2- 172.21.15.103:0/1952353980 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3c2004da20 0x7f3c2004fee0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:10.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.436+0000 7f3c4781e700 1 --2- 172.21.15.103:0/1952353980 >> v2:172.21.15.86:3300/0 conn(0x7f3c400b4320 0x7f3c40124980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:10.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.436+0000 7f3c4781e700 1 -- 172.21.15.103:0/1952353980 >> 172.21.15.103:0/1952353980 conn(0x7f3c400b86b0 msgr2=0x7f3c400b14f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:10.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.436+0000 7f3c4781e700 1 -- 172.21.15.103:0/1952353980 shutdown_connections 2020-04-22T14:12:10.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.436+0000 7f3c4781e700 1 -- 172.21.15.103:0/1952353980 wait complete. 2020-04-22T14:12:10.441 INFO:teuthology.orchestra.run.smithi103.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2020-04-22T14:12:10.451 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:10.459 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2020-04-22T14:12:10.465 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:12:10.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.612+0000 7f572557e700 1 Processor -- start 2020-04-22T14:12:10.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.612+0000 7f572557e700 1 -- start start 2020-04-22T14:12:10.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.613+0000 7f572557e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5720067170 0x7f57200b6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:10.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.613+0000 7f572557e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f57200ac740 0x7f572013c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:10.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.613+0000 7f572557e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5720064ec0 con 0x7f572013c7e0 2020-04-22T14:12:10.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.613+0000 7f572557e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5720065af0 con 0x7f5720067170 2020-04-22T14:12:10.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.613+0000 7f572557e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5720146870 con 0x7f57200ac740 2020-04-22T14:12:10.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.613+0000 7f571e7fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f57200ac740 0x7f572013c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:10.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.613+0000 7f571e7fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f57200ac740 0x7f572013c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52464/0 (socket says 172.21.15.103:52464) 2020-04-22T14:12:10.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.613+0000 7f571e7fc700 1 -- 172.21.15.103:0/2119331084 learned_addr learned my addr 172.21.15.103:0/2119331084 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:10.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.613+0000 7f571effd700 1 --2- 172.21.15.103:0/2119331084 >> v2:172.21.15.86:3300/0 conn(0x7f5720067170 0x7f57200b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:10.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.613+0000 7f571e7fc700 1 -- 172.21.15.103:0/2119331084 >> v2:172.21.15.86:3300/0 conn(0x7f5720067170 msgr2=0x7f57200b6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:10.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.613+0000 7f571e7fc700 1 --2- 172.21.15.103:0/2119331084 >> v2:172.21.15.86:3300/0 conn(0x7f5720067170 0x7f57200b6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:10.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.613+0000 7f571e7fc700 1 -- 172.21.15.103:0/2119331084 >> v1:172.21.15.86:6789/0 conn(0x7f572013c7e0 legacy=0x7f57200b4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:10.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.613+0000 7f571e7fc700 1 -- 172.21.15.103:0/2119331084 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5720067550 con 0x7f57200ac740 2020-04-22T14:12:10.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.613+0000 7f571e7fc700 1 --2- 172.21.15.103:0/2119331084 >> v2:172.21.15.103:3300/0 conn(0x7f57200ac740 0x7f572013c380 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5708002f30 tx=0x7f5708007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:10.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.614+0000 7f571e7fc700 1 --2- 172.21.15.103:0/2119331084 >> v2:172.21.15.103:3300/0 conn(0x7f57200ac740 0x7f572013c380 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5708002f30 tx=0x7f5708007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:10.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.614+0000 7f571e7fc700 1 --2- 172.21.15.103:0/2119331084 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57200ac740 0x7f572013c380 secure :-1 s=READY pgs=1027 cs=0 l=1 rx=0x7f5708002f30 tx=0x7f5708007a40).ready entity=mon.1 client_cookie=c3f9e87c88384300 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:10.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.614+0000 7f571e7fc700 1 --2- 172.21.15.103:0/2119331084 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57200ac740 0x7f572013c380 secure :-1 s=THROTTLE_DONE pgs=1027 cs=0 l=1 rx=0x7f5708002f30 tx=0x7f5708007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:10.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.614+0000 7f571dffb700 1 -- 172.21.15.103:0/2119331084 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5708011670 con 0x7f57200ac740 2020-04-22T14:12:10.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.614+0000 7f571e7fc700 1 --2- 172.21.15.103:0/2119331084 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57200ac740 0x7f572013c380 secure :-1 s=THROTTLE_DONE pgs=1027 cs=0 l=1 rx=0x7f5708002f30 tx=0x7f5708007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:10.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.614+0000 7f571dffb700 1 -- 172.21.15.103:0/2119331084 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57080117d0 con 0x7f57200ac740 2020-04-22T14:12:10.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.614+0000 7f571e7fc700 1 --2- 172.21.15.103:0/2119331084 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57200ac740 0x7f572013c380 secure :-1 s=THROTTLE_DONE pgs=1027 cs=0 l=1 rx=0x7f5708002f30 tx=0x7f5708007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:10.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.614+0000 7f571dffb700 1 -- 172.21.15.103:0/2119331084 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5708011bf0 con 0x7f57200ac740 2020-04-22T14:12:10.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.614+0000 7f572557e700 1 -- 172.21.15.103:0/2119331084 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57200ac740 msgr2=0x7f572013c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:10.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.614+0000 7f572557e700 1 --2- 172.21.15.103:0/2119331084 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57200ac740 0x7f572013c380 secure :-1 s=READY pgs=1027 cs=0 l=1 rx=0x7f5708002f30 tx=0x7f5708007a40).stop 2020-04-22T14:12:10.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.614+0000 7f572557e700 1 -- 172.21.15.103:0/2119331084 shutdown_connections 2020-04-22T14:12:10.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.614+0000 7f572557e700 1 --2- 172.21.15.103:0/2119331084 >> v2:172.21.15.86:3300/0 conn(0x7f5720067170 0x7f57200b6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:10.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.614+0000 7f572557e700 1 --2- 172.21.15.103:0/2119331084 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57200ac740 0x7f572013c380 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:10.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.614+0000 7f572557e700 1 -- 172.21.15.103:0/2119331084 >> 172.21.15.103:0/2119331084 conn(0x7f57200b9160 msgr2=0x7f572005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:10.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.614+0000 7f572557e700 1 -- 172.21.15.103:0/2119331084 shutdown_connections 2020-04-22T14:12:10.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.614+0000 7f572557e700 1 -- 172.21.15.103:0/2119331084 wait complete. 2020-04-22T14:12:10.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.615+0000 7f572557e700 1 Processor -- start 2020-04-22T14:12:10.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.615+0000 7f572557e700 1 -- start start 2020-04-22T14:12:10.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.616+0000 7f572557e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5720067170 0x7f5720153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:10.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.616+0000 7f572557e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f572013c7e0 0x7f572014f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:10.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.616+0000 7f572557e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5720141f90 con 0x7f57200ac740 2020-04-22T14:12:10.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.616+0000 7f572557e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5720142230 con 0x7f572013c7e0 2020-04-22T14:12:10.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.616+0000 7f572557e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5720062ad0 con 0x7f5720067170 2020-04-22T14:12:10.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.616+0000 7f571effd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5720067170 0x7f5720153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:10.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.616+0000 7f571effd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5720067170 0x7f5720153940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52468/0 (socket says 172.21.15.103:52468) 2020-04-22T14:12:10.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.616+0000 7f571effd700 1 -- 172.21.15.103:0/2688886804 learned_addr learned my addr 172.21.15.103:0/2688886804 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:10.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.616+0000 7f571f7fe700 1 --2- 172.21.15.103:0/2688886804 >> v2:172.21.15.86:3300/0 conn(0x7f572013c7e0 0x7f572014f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:10.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.616+0000 7f571effd700 1 -- 172.21.15.103:0/2688886804 >> v2:172.21.15.86:3300/0 conn(0x7f572013c7e0 msgr2=0x7f572014f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:10.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.616+0000 7f571effd700 1 --2- 172.21.15.103:0/2688886804 >> v2:172.21.15.86:3300/0 conn(0x7f572013c7e0 0x7f572014f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:10.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.616+0000 7f571effd700 1 -- 172.21.15.103:0/2688886804 >> v1:172.21.15.86:6789/0 conn(0x7f57200ac740 legacy=0x7f572014ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:10.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.616+0000 7f571effd700 1 -- 172.21.15.103:0/2688886804 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572013f620 con 0x7f5720067170 2020-04-22T14:12:10.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.616+0000 7f571effd700 1 --2- 172.21.15.103:0/2688886804 >> v2:172.21.15.103:3300/0 conn(0x7f5720067170 0x7f5720153940 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f57201410a0 tx=0x7f5710010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:10.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.616+0000 7f571effd700 1 --2- 172.21.15.103:0/2688886804 >> v2:172.21.15.103:3300/0 conn(0x7f5720067170 0x7f5720153940 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f57201410a0 tx=0x7f5710010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:10.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.616+0000 7f571effd700 1 --2- 172.21.15.103:0/2688886804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5720067170 0x7f5720153940 secure :-1 s=READY pgs=1028 cs=0 l=1 rx=0x7f57201410a0 tx=0x7f5710010d40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:10.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.616+0000 7f571effd700 1 --2- 172.21.15.103:0/2688886804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5720067170 0x7f5720153940 secure :-1 s=THROTTLE_DONE pgs=1028 cs=0 l=1 rx=0x7f57201410a0 tx=0x7f5710010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:10.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.617+0000 7f5717fff700 1 -- 172.21.15.103:0/2688886804 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5710005e90 con 0x7f5720067170 2020-04-22T14:12:10.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.617+0000 7f571effd700 1 --2- 172.21.15.103:0/2688886804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5720067170 0x7f5720153940 secure :-1 s=THROTTLE_DONE pgs=1028 cs=0 l=1 rx=0x7f57201410a0 tx=0x7f5710010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:10.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.617+0000 7f571effd700 1 --2- 172.21.15.103:0/2688886804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5720067170 0x7f5720153940 secure :-1 s=THROTTLE_DONE pgs=1028 cs=0 l=1 rx=0x7f57201410a0 tx=0x7f5710010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:10.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.617+0000 7f5717fff700 1 -- 172.21.15.103:0/2688886804 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5710007180 con 0x7f5720067170 2020-04-22T14:12:10.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.617+0000 7f5717fff700 1 -- 172.21.15.103:0/2688886804 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5710007520 con 0x7f5720067170 2020-04-22T14:12:10.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.617+0000 7f572557e700 1 -- 172.21.15.103:0/2688886804 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5720141c10 con 0x7f5720067170 2020-04-22T14:12:10.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.617+0000 7f572557e700 1 -- 172.21.15.103:0/2688886804 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57201533f0 con 0x7f5720067170 2020-04-22T14:12:10.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.617+0000 7f571effd700 1 --2- 172.21.15.103:0/2688886804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5720067170 0x7f5720153940 secure :-1 s=THROTTLE_DONE pgs=1028 cs=0 l=1 rx=0x7f57201410a0 tx=0x7f5710010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:10.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.618+0000 7f572557e700 1 -- 172.21.15.103:0/2688886804 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5720056c90 con 0x7f5720067170 2020-04-22T14:12:10.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.618+0000 7f5717fff700 1 -- 172.21.15.103:0/2688886804 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f57100123b0 con 0x7f5720067170 2020-04-22T14:12:10.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.618+0000 7f571effd700 1 --2- 172.21.15.103:0/2688886804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5720067170 0x7f5720153940 secure :-1 s=THROTTLE_DONE pgs=1028 cs=0 l=1 rx=0x7f57201410a0 tx=0x7f5710010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:10.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.618+0000 7f5717fff700 1 --2- 172.21.15.103:0/2688886804 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f570404d9a0 0x7f570404fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:10.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.618+0000 7f5717fff700 1 -- 172.21.15.103:0/2688886804 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6288+0+0 (secure 0 0 0) 0x7f5710061a10 con 0x7f5720067170 2020-04-22T14:12:10.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.618+0000 7f571e7fc700 1 --2- 172.21.15.103:0/2688886804 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f570404d9a0 0x7f570404fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:10.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.618+0000 7f571e7fc700 1 --2- 172.21.15.103:0/2688886804 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f570404d9a0 0x7f570404fe60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5708002f30 tx=0x7f5708007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:10.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.618+0000 7f571e7fc700 1 --2- 172.21.15.103:0/2688886804 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f570404d9a0 0x7f570404fe60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5708002f30 tx=0x7f5708007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:10.632 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.618+0000 7f571e7fc700 1 --2- 172.21.15.103:0/2688886804 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f570404d9a0 0x7f570404fe60 secure :-1 s=READY pgs=381 cs=0 l=1 rx=0x7f5708002f30 tx=0x7f5708007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:10.632 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.622+0000 7f571effd700 1 --2- 172.21.15.103:0/2688886804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5720067170 0x7f5720153940 secure :-1 s=THROTTLE_DONE pgs=1028 cs=0 l=1 rx=0x7f57201410a0 tx=0x7f5710010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:10.632 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.622+0000 7f5717fff700 1 -- 172.21.15.103:0/2688886804 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f571003cdf0 con 0x7f5720067170 2020-04-22T14:12:10.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.811+0000 7f572557e700 1 -- 172.21.15.103:0/2688886804 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5720141da0 con 0x7f5720067170 2020-04-22T14:12:10.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.811+0000 7f571effd700 1 --2- 172.21.15.103:0/2688886804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5720067170 0x7f5720153940 secure :-1 s=THROTTLE_DONE pgs=1028 cs=0 l=1 rx=0x7f57201410a0 tx=0x7f5710010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:10.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.811+0000 7f5717fff700 1 -- 172.21.15.103:0/2688886804 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+1779 (secure 0 0 0) 0x7f5710040410 con 0x7f5720067170 2020-04-22T14:12:10.815 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:12:10.815 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/1837726033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1837726033},{"type":"v1","addr":"172.21.15.86:6835","nonce":1837726033}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":44,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:10:38.817638+0000","modified":"2020-04-22T14:12:10.427483+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":68,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-04-22T14:12:10.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.813+0000 7f572557e700 1 -- 172.21.15.103:0/2688886804 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f570404d9a0 msgr2=0x7f570404fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:10.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.813+0000 7f572557e700 1 --2- 172.21.15.103:0/2688886804 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f570404d9a0 0x7f570404fe60 secure :-1 s=READY pgs=381 cs=0 l=1 rx=0x7f5708002f30 tx=0x7f5708007a40).stop 2020-04-22T14:12:10.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.813+0000 7f572557e700 1 -- 172.21.15.103:0/2688886804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5720067170 msgr2=0x7f5720153940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:10.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.813+0000 7f572557e700 1 --2- 172.21.15.103:0/2688886804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5720067170 0x7f5720153940 secure :-1 s=READY pgs=1028 cs=0 l=1 rx=0x7f57201410a0 tx=0x7f5710010d40).stop 2020-04-22T14:12:10.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.813+0000 7f572557e700 1 -- 172.21.15.103:0/2688886804 shutdown_connections 2020-04-22T14:12:10.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.813+0000 7f572557e700 1 --2- 172.21.15.103:0/2688886804 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f570404d9a0 0x7f570404fe60 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:10.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.813+0000 7f572557e700 1 --2- 172.21.15.103:0/2688886804 >> v2:172.21.15.86:3300/0 conn(0x7f572013c7e0 0x7f572014f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:10.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.813+0000 7f572557e700 1 --2- 172.21.15.103:0/2688886804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5720067170 0x7f5720153940 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:10.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.813+0000 7f572557e700 1 -- 172.21.15.103:0/2688886804 >> 172.21.15.103:0/2688886804 conn(0x7f57200b9160 msgr2=0x7f57200b4810 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:10.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.813+0000 7f572557e700 1 -- 172.21.15.103:0/2688886804 shutdown_connections 2020-04-22T14:12:10.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.813+0000 7f572557e700 1 -- 172.21.15.103:0/2688886804 wait complete. 2020-04-22T14:12:10.818 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 44 2020-04-22T14:12:10.827 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:10.840 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-04-22T14:12:10.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.985+0000 7fb7809c7700 1 Processor -- start 2020-04-22T14:12:10.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.985+0000 7fb7809c7700 1 -- start start 2020-04-22T14:12:10.991 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.986+0000 7fb7809c7700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb77c0b7c20 0x7fb77c0643b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:10.991 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.986+0000 7fb7809c7700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb77c065d30 0x7fb77c0661c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:10.991 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.986+0000 7fb7809c7700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb77c0b7240 con 0x7fb77c147b60 2020-04-22T14:12:10.991 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.986+0000 7fb7809c7700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb77c0b74e0 con 0x7fb77c065d30 2020-04-22T14:12:10.991 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.986+0000 7fb7809c7700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c0b7780 con 0x7fb77c0b7c20 2020-04-22T14:12:10.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.986+0000 7fb77ad9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb77c065d30 0x7fb77c0661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:10.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.986+0000 7fb77a59c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb77c147b60 0x7fb77c141320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44666/0 (socket says 172.21.15.103:44666) 2020-04-22T14:12:10.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.986+0000 7fb77ad9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb77c065d30 0x7fb77c0661c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52476/0 (socket says 172.21.15.103:52476) 2020-04-22T14:12:10.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.986+0000 7fb77a59c700 1 -- 172.21.15.103:0/3189920279 learned_addr learned my addr 172.21.15.103:0/3189920279 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:10.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.987+0000 7fb779d9b700 1 --2- 172.21.15.103:0/3189920279 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb77c0b7c20 0x7fb77c0643b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:10.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.987+0000 7fb77ad9d700 1 -- 172.21.15.103:0/3189920279 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb77c0b7c20 msgr2=0x7fb77c0643b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:10.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.987+0000 7fb77ad9d700 1 --2- 172.21.15.103:0/3189920279 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb77c0b7c20 0x7fb77c0643b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:10.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.987+0000 7fb77ad9d700 1 -- 172.21.15.103:0/3189920279 >> v1:172.21.15.103:6789/0 conn(0x7fb77c147b60 legacy=0x7fb77c141320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:10.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.987+0000 7fb77959a700 1 -- 172.21.15.103:0/3189920279 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3231387333 0 0) 0x7fb77c0b7240 con 0x7fb77c147b60 2020-04-22T14:12:10.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.987+0000 7fb77ad9d700 1 -- 172.21.15.103:0/3189920279 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb77c064810 con 0x7fb77c065d30 2020-04-22T14:12:10.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.987+0000 7fb77ad9d700 1 --2- 172.21.15.103:0/3189920279 >> v2:172.21.15.103:3300/0 conn(0x7fb77c065d30 0x7fb77c0661c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb7740032b0 tx=0x7fb774007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:10.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.987+0000 7fb77ad9d700 1 --2- 172.21.15.103:0/3189920279 >> v2:172.21.15.103:3300/0 conn(0x7fb77c065d30 0x7fb77c0661c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb7740032b0 tx=0x7fb774007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:10.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.987+0000 7fb77ad9d700 1 --2- 172.21.15.103:0/3189920279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb77c065d30 0x7fb77c0661c0 secure :-1 s=READY pgs=1030 cs=0 l=1 rx=0x7fb7740032b0 tx=0x7fb774007dc0).ready entity=mon.1 client_cookie=e353802af0bc8719 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:10.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.987+0000 7fb77ad9d700 1 --2- 172.21.15.103:0/3189920279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb77c065d30 0x7fb77c0661c0 secure :-1 s=THROTTLE_DONE pgs=1030 cs=0 l=1 rx=0x7fb7740032b0 tx=0x7fb774007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:10.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.987+0000 7fb77959a700 1 -- 172.21.15.103:0/3189920279 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb77400a180 con 0x7fb77c065d30 2020-04-22T14:12:10.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.987+0000 7fb77ad9d700 1 --2- 172.21.15.103:0/3189920279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb77c065d30 0x7fb77c0661c0 secure :-1 s=THROTTLE_DONE pgs=1030 cs=0 l=1 rx=0x7fb7740032b0 tx=0x7fb774007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:10.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.987+0000 7fb77959a700 1 -- 172.21.15.103:0/3189920279 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77400a320 con 0x7fb77c065d30 2020-04-22T14:12:10.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.987+0000 7fb77ad9d700 1 --2- 172.21.15.103:0/3189920279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb77c065d30 0x7fb77c0661c0 secure :-1 s=THROTTLE_DONE pgs=1030 cs=0 l=1 rx=0x7fb7740032b0 tx=0x7fb774007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:10.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.987+0000 7fb77959a700 1 -- 172.21.15.103:0/3189920279 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb77400a700 con 0x7fb77c065d30 2020-04-22T14:12:10.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.987+0000 7fb7809c7700 1 -- 172.21.15.103:0/3189920279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb77c065d30 msgr2=0x7fb77c0661c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:10.996 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.987+0000 7fb7809c7700 1 --2- 172.21.15.103:0/3189920279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb77c065d30 0x7fb77c0661c0 secure :-1 s=READY pgs=1030 cs=0 l=1 rx=0x7fb7740032b0 tx=0x7fb774007dc0).stop 2020-04-22T14:12:10.996 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.987+0000 7fb7809c7700 1 -- 172.21.15.103:0/3189920279 shutdown_connections 2020-04-22T14:12:10.996 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.987+0000 7fb7809c7700 1 --2- 172.21.15.103:0/3189920279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb77c065d30 0x7fb77c0661c0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:10.996 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.987+0000 7fb7809c7700 1 --2- 172.21.15.103:0/3189920279 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb77c0b7c20 0x7fb77c0643b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:10.996 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.987+0000 7fb7809c7700 1 -- 172.21.15.103:0/3189920279 >> 172.21.15.103:0/3189920279 conn(0x7fb77c05ad30 msgr2=0x7fb77c05b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:10.997 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.987+0000 7fb7809c7700 1 -- 172.21.15.103:0/3189920279 shutdown_connections 2020-04-22T14:12:10.997 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.987+0000 7fb7809c7700 1 -- 172.21.15.103:0/3189920279 wait complete. 2020-04-22T14:12:11.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.988+0000 7fb7809c7700 1 Processor -- start 2020-04-22T14:12:11.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.988+0000 7fb7809c7700 1 -- start start 2020-04-22T14:12:11.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.989+0000 7fb7809c7700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb77c0b7c20 0x7fb77c12d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:11.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.989+0000 7fb7809c7700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb77c147b60 0x7fb77c0baff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:11.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.989+0000 7fb7809c7700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb77c129bd0 con 0x7fb77c065d30 2020-04-22T14:12:11.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.989+0000 7fb7809c7700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb77c143600 con 0x7fb77c147b60 2020-04-22T14:12:11.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.989+0000 7fb7809c7700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c1519a0 con 0x7fb77c0b7c20 2020-04-22T14:12:11.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.989+0000 7fb77ad9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb77c147b60 0x7fb77c0baff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:11.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.989+0000 7fb77ad9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb77c147b60 0x7fb77c0baff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52482/0 (socket says 172.21.15.103:52482) 2020-04-22T14:12:11.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.989+0000 7fb77ad9d700 1 -- 172.21.15.103:0/3557593039 learned_addr learned my addr 172.21.15.103:0/3557593039 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:11.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.989+0000 7fb779d9b700 1 --2- 172.21.15.103:0/3557593039 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb77c0b7c20 0x7fb77c12d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:11.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.989+0000 7fb77ad9d700 1 -- 172.21.15.103:0/3557593039 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb77c0b7c20 msgr2=0x7fb77c12d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:11.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.989+0000 7fb77ad9d700 1 --2- 172.21.15.103:0/3557593039 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb77c0b7c20 0x7fb77c12d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:11.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.989+0000 7fb77ad9d700 1 -- 172.21.15.103:0/3557593039 >> v1:172.21.15.86:6789/0 conn(0x7fb77c065d30 legacy=0x7fb77c0ba8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:11.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.989+0000 7fb77ad9d700 1 -- 172.21.15.103:0/3557593039 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb77c151c40 con 0x7fb77c147b60 2020-04-22T14:12:11.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.989+0000 7fb77ad9d700 1 --2- 172.21.15.103:0/3557593039 >> v2:172.21.15.103:3300/0 conn(0x7fb77c147b60 0x7fb77c0baff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb77c142500 tx=0x7fb774007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:11.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.990+0000 7fb77ad9d700 1 --2- 172.21.15.103:0/3557593039 >> v2:172.21.15.103:3300/0 conn(0x7fb77c147b60 0x7fb77c0baff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb77c142500 tx=0x7fb774007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:11.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.990+0000 7fb77ad9d700 1 --2- 172.21.15.103:0/3557593039 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb77c147b60 0x7fb77c0baff0 secure :-1 s=READY pgs=1031 cs=0 l=1 rx=0x7fb77c142500 tx=0x7fb774007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:11.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.990+0000 7fb77ad9d700 1 --2- 172.21.15.103:0/3557593039 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb77c147b60 0x7fb77c0baff0 secure :-1 s=THROTTLE_DONE pgs=1031 cs=0 l=1 rx=0x7fb77c142500 tx=0x7fb774007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:11.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.990+0000 7fb76b7fe700 1 -- 172.21.15.103:0/3557593039 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb774005c30 con 0x7fb77c147b60 2020-04-22T14:12:11.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.990+0000 7fb77ad9d700 1 --2- 172.21.15.103:0/3557593039 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb77c147b60 0x7fb77c0baff0 secure :-1 s=THROTTLE_DONE pgs=1031 cs=0 l=1 rx=0x7fb77c142500 tx=0x7fb774007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:11.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.990+0000 7fb77ad9d700 1 --2- 172.21.15.103:0/3557593039 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb77c147b60 0x7fb77c0baff0 secure :-1 s=THROTTLE_DONE pgs=1031 cs=0 l=1 rx=0x7fb77c142500 tx=0x7fb774007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:11.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.990+0000 7fb76b7fe700 1 -- 172.21.15.103:0/3557593039 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb774005d90 con 0x7fb77c147b60 2020-04-22T14:12:11.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.990+0000 7fb7809c7700 1 -- 172.21.15.103:0/3557593039 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb77c151ee0 con 0x7fb77c147b60 2020-04-22T14:12:11.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.990+0000 7fb76b7fe700 1 -- 172.21.15.103:0/3557593039 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb77400f7a0 con 0x7fb77c147b60 2020-04-22T14:12:11.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.990+0000 7fb7809c7700 1 -- 172.21.15.103:0/3557593039 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb77c152380 con 0x7fb77c147b60 2020-04-22T14:12:11.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.990+0000 7fb77ad9d700 1 --2- 172.21.15.103:0/3557593039 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb77c147b60 0x7fb77c0baff0 secure :-1 s=THROTTLE_DONE pgs=1031 cs=0 l=1 rx=0x7fb77c142500 tx=0x7fb774007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:11.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.991+0000 7fb7809c7700 1 -- 172.21.15.103:0/3557593039 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb77c056c90 con 0x7fb77c147b60 2020-04-22T14:12:11.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.991+0000 7fb76b7fe700 1 -- 172.21.15.103:0/3557593039 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fb77400f900 con 0x7fb77c147b60 2020-04-22T14:12:11.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.991+0000 7fb77ad9d700 1 --2- 172.21.15.103:0/3557593039 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb77c147b60 0x7fb77c0baff0 secure :-1 s=THROTTLE_DONE pgs=1031 cs=0 l=1 rx=0x7fb77c142500 tx=0x7fb774007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:11.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.991+0000 7fb76b7fe700 1 --2- 172.21.15.103:0/3557593039 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb75804d9d0 0x7fb75804fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:11.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.991+0000 7fb76b7fe700 1 -- 172.21.15.103:0/3557593039 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6288+0+0 (secure 0 0 0) 0x7fb774062610 con 0x7fb77c147b60 2020-04-22T14:12:11.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.991+0000 7fb77a59c700 1 --2- 172.21.15.103:0/3557593039 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb75804d9d0 0x7fb75804fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:11.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.991+0000 7fb77a59c700 1 --2- 172.21.15.103:0/3557593039 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb75804d9d0 0x7fb75804fe90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb770000b80 tx=0x7fb7700013c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:11.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.992+0000 7fb77a59c700 1 --2- 172.21.15.103:0/3557593039 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb75804d9d0 0x7fb75804fe90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb770000b80 tx=0x7fb7700013c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:11.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.992+0000 7fb77a59c700 1 --2- 172.21.15.103:0/3557593039 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb75804d9d0 0x7fb75804fe90 secure :-1 s=READY pgs=382 cs=0 l=1 rx=0x7fb770000b80 tx=0x7fb7700013c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:11.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.995+0000 7fb77ad9d700 1 --2- 172.21.15.103:0/3557593039 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb77c147b60 0x7fb77c0baff0 secure :-1 s=THROTTLE_DONE pgs=1031 cs=0 l=1 rx=0x7fb77c142500 tx=0x7fb774007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:11.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:10.995+0000 7fb76b7fe700 1 -- 172.21.15.103:0/3557593039 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fb77403d9f0 con 0x7fb77c147b60 2020-04-22T14:12:11.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.182+0000 7fb7809c7700 1 -- 172.21.15.103:0/3557593039 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb77c06a960 con 0x7fb77c147b60 2020-04-22T14:12:11.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.433+0000 7fb77ad9d700 1 --2- 172.21.15.103:0/3557593039 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb77c147b60 0x7fb77c0baff0 secure :-1 s=THROTTLE_DONE pgs=1031 cs=0 l=1 rx=0x7fb77c142500 tx=0x7fb774007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:11.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.433+0000 7fb76b7fe700 1 -- 172.21.15.103:0/3557593039 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v45) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb774041010 con 0x7fb77c147b60 2020-04-22T14:12:11.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.435+0000 7fb7809c7700 1 -- 172.21.15.103:0/3557593039 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb75804d9d0 msgr2=0x7fb75804fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:11.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.435+0000 7fb7809c7700 1 --2- 172.21.15.103:0/3557593039 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb75804d9d0 0x7fb75804fe90 secure :-1 s=READY pgs=382 cs=0 l=1 rx=0x7fb770000b80 tx=0x7fb7700013c0).stop 2020-04-22T14:12:11.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.435+0000 7fb7809c7700 1 -- 172.21.15.103:0/3557593039 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb77c147b60 msgr2=0x7fb77c0baff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:11.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.435+0000 7fb7809c7700 1 --2- 172.21.15.103:0/3557593039 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb77c147b60 0x7fb77c0baff0 secure :-1 s=READY pgs=1031 cs=0 l=1 rx=0x7fb77c142500 tx=0x7fb774007dc0).stop 2020-04-22T14:12:11.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.435+0000 7fb7809c7700 1 -- 172.21.15.103:0/3557593039 shutdown_connections 2020-04-22T14:12:11.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.435+0000 7fb7809c7700 1 --2- 172.21.15.103:0/3557593039 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb75804d9d0 0x7fb75804fe90 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:11.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.435+0000 7fb7809c7700 1 --2- 172.21.15.103:0/3557593039 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb77c147b60 0x7fb77c0baff0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:11.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.435+0000 7fb7809c7700 1 --2- 172.21.15.103:0/3557593039 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb77c0b7c20 0x7fb77c12d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:11.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.435+0000 7fb7809c7700 1 -- 172.21.15.103:0/3557593039 >> 172.21.15.103:0/3557593039 conn(0x7fb77c05ad30 msgr2=0x7fb77c12c420 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:11.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.435+0000 7fb7809c7700 1 -- 172.21.15.103:0/3557593039 shutdown_connections 2020-04-22T14:12:11.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.435+0000 7fb7809c7700 1 -- 172.21.15.103:0/3557593039 wait complete. 2020-04-22T14:12:11.449 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:11.462 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-04-22T14:12:11.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.609+0000 7f19f977f700 1 Processor -- start 2020-04-22T14:12:11.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.609+0000 7f19f977f700 1 -- start start 2020-04-22T14:12:11.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.610+0000 7f19f977f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f19f40b9140 0x7f19f412b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:11.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.610+0000 7f19f977f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19f412b670 0x7f19f4143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:11.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.610+0000 7f19f977f700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19f41467e0 con 0x7f19f40ac950 2020-04-22T14:12:11.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.610+0000 7f19f977f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19f40602f0 con 0x7f19f40b9140 2020-04-22T14:12:11.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.610+0000 7f19f977f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f4060050 con 0x7f19f412b670 2020-04-22T14:12:11.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.610+0000 7f19f2ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f19f40b9140 0x7f19f412b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:11.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.610+0000 7f19f27fc700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f19f40ac950 0x7f19f4146c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44680/0 (socket says 172.21.15.103:44680) 2020-04-22T14:12:11.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.610+0000 7f19f27fc700 1 -- 172.21.15.103:0/1106854671 learned_addr learned my addr 172.21.15.103:0/1106854671 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:11.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.610+0000 7f19f37fe700 1 --2- 172.21.15.103:0/1106854671 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19f412b670 0x7f19f4143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:11.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.610+0000 7f19f2ffd700 1 -- 172.21.15.103:0/1106854671 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19f412b670 msgr2=0x7f19f4143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:11.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.611+0000 7f19f2ffd700 1 --2- 172.21.15.103:0/1106854671 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19f412b670 0x7f19f4143090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:11.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.611+0000 7f19f2ffd700 1 -- 172.21.15.103:0/1106854671 >> v1:172.21.15.103:6789/0 conn(0x7f19f40ac950 legacy=0x7f19f4146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:11.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.611+0000 7f19f1ffb700 1 -- 172.21.15.103:0/1106854671 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 283328940 0 0) 0x7f19f41467e0 con 0x7f19f40ac950 2020-04-22T14:12:11.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.611+0000 7f19f2ffd700 1 -- 172.21.15.103:0/1106854671 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f40b9520 con 0x7f19f40b9140 2020-04-22T14:12:11.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.611+0000 7f19f37fe700 1 --2- 172.21.15.103:0/1106854671 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19f412b670 0x7f19f4143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:12:11.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.611+0000 7f19f2ffd700 1 --2- 172.21.15.103:0/1106854671 >> v2:172.21.15.103:3300/0 conn(0x7f19f40b9140 0x7f19f412b210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f19e8002f30 tx=0x7f19e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:11.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.611+0000 7f19f2ffd700 1 --2- 172.21.15.103:0/1106854671 >> v2:172.21.15.103:3300/0 conn(0x7f19f40b9140 0x7f19f412b210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f19e8002f30 tx=0x7f19e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:11.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.611+0000 7f19f2ffd700 1 --2- 172.21.15.103:0/1106854671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19f40b9140 0x7f19f412b210 secure :-1 s=READY pgs=1033 cs=0 l=1 rx=0x7f19e8002f30 tx=0x7f19e8007a40).ready entity=mon.1 client_cookie=f5abe7977b37466d server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:11.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.611+0000 7f19f2ffd700 1 --2- 172.21.15.103:0/1106854671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19f40b9140 0x7f19f412b210 secure :-1 s=THROTTLE_DONE pgs=1033 cs=0 l=1 rx=0x7f19e8002f30 tx=0x7f19e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:11.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.611+0000 7f19f1ffb700 1 -- 172.21.15.103:0/1106854671 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19e8011470 con 0x7f19f40b9140 2020-04-22T14:12:11.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.611+0000 7f19f2ffd700 1 --2- 172.21.15.103:0/1106854671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19f40b9140 0x7f19f412b210 secure :-1 s=THROTTLE_DONE pgs=1033 cs=0 l=1 rx=0x7f19e8002f30 tx=0x7f19e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:11.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.611+0000 7f19f2ffd700 1 --2- 172.21.15.103:0/1106854671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19f40b9140 0x7f19f412b210 secure :-1 s=THROTTLE_DONE pgs=1033 cs=0 l=1 rx=0x7f19e8002f30 tx=0x7f19e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:11.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.611+0000 7f19f1ffb700 1 -- 172.21.15.103:0/1106854671 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e8011610 con 0x7f19f40b9140 2020-04-22T14:12:11.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.611+0000 7f19f1ffb700 1 -- 172.21.15.103:0/1106854671 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19e80119f0 con 0x7f19f40b9140 2020-04-22T14:12:11.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.611+0000 7f19f977f700 1 -- 172.21.15.103:0/1106854671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19f40b9140 msgr2=0x7f19f412b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:11.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.611+0000 7f19f977f700 1 --2- 172.21.15.103:0/1106854671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19f40b9140 0x7f19f412b210 secure :-1 s=READY pgs=1033 cs=0 l=1 rx=0x7f19e8002f30 tx=0x7f19e8007a40).stop 2020-04-22T14:12:11.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.611+0000 7f19f977f700 1 -- 172.21.15.103:0/1106854671 shutdown_connections 2020-04-22T14:12:11.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.611+0000 7f19f977f700 1 --2- 172.21.15.103:0/1106854671 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19f412b670 0x7f19f4143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:11.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.611+0000 7f19f977f700 1 --2- 172.21.15.103:0/1106854671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19f40b9140 0x7f19f412b210 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:11.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.611+0000 7f19f977f700 1 -- 172.21.15.103:0/1106854671 >> 172.21.15.103:0/1106854671 conn(0x7f19f405b7b0 msgr2=0x7f19f40b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:11.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.611+0000 7f19f977f700 1 -- 172.21.15.103:0/1106854671 shutdown_connections 2020-04-22T14:12:11.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.611+0000 7f19f977f700 1 -- 172.21.15.103:0/1106854671 wait complete. 2020-04-22T14:12:11.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.612+0000 7f19f977f700 1 Processor -- start 2020-04-22T14:12:11.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.612+0000 7f19f977f700 1 -- start start 2020-04-22T14:12:11.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.613+0000 7f19f977f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19f40b9140 0x7f19f40b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:11.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.613+0000 7f19f977f700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19f413a6c0 con 0x7f19f412b670 2020-04-22T14:12:11.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.613+0000 7f19f977f700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19f413a960 con 0x7f19f40ac950 2020-04-22T14:12:11.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.613+0000 7f19f2ffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f19f40ac950 0x7f19f40b1db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44682/0 (socket says 172.21.15.103:44682) 2020-04-22T14:12:11.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.613+0000 7f19f2ffd700 1 -- 172.21.15.103:0/771915935 learned_addr learned my addr 172.21.15.103:0/771915935 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:11.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.613+0000 7f19f977f700 1 -- 172.21.15.103:0/771915935 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f40b40a0 con 0x7f19f40b9140 2020-04-22T14:12:11.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.613+0000 7f19e3fff700 1 -- 172.21.15.103:0/771915935 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1101088811 0 0) 0x7f19f413a960 con 0x7f19f40ac950 2020-04-22T14:12:11.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.613+0000 7f19e3fff700 1 -- 172.21.15.103:0/771915935 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19d0002fe0 con 0x7f19f40ac950 2020-04-22T14:12:11.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.613+0000 7f19f27fc700 1 --2- 172.21.15.103:0/771915935 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19f40b9140 0x7f19f40b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:11.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.614+0000 7f19e3fff700 1 -- 172.21.15.103:0/771915935 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1262295725 0 0) 0x7f19d0002fe0 con 0x7f19f40ac950 2020-04-22T14:12:11.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.614+0000 7f19e3fff700 1 -- 172.21.15.103:0/771915935 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f19f413a960 con 0x7f19f40ac950 2020-04-22T14:12:11.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.614+0000 7f19e3fff700 1 -- 172.21.15.103:0/771915935 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f19e8008e10 con 0x7f19f40ac950 2020-04-22T14:12:11.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.614+0000 7f19e3fff700 1 -- 172.21.15.103:0/771915935 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19f40b9140 msgr2=0x7f19f40b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:11.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.614+0000 7f19e3fff700 1 --2- 172.21.15.103:0/771915935 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19f40b9140 0x7f19f40b49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:11.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.614+0000 7f19e3fff700 1 -- 172.21.15.103:0/771915935 >> v1:172.21.15.103:6789/0 conn(0x7f19f40ac950 legacy=0x7f19f40b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:11.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.614+0000 7f19e3fff700 1 -- 172.21.15.103:0/771915935 >> v1:172.21.15.86:6789/0 conn(0x7f19f412b670 legacy=0x7f19f413c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:11.632 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.614+0000 7f19e3fff700 1 --2- 172.21.15.103:0/771915935 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19f40b9140 0x7f19d00049b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:11.632 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.614+0000 7f19e3fff700 1 --2- 172.21.15.103:0/771915935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19d0004e10 0x7f19d0005230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:11.632 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.614+0000 7f19e3fff700 1 --2- 172.21.15.103:0/771915935 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19d00039e0 0x7f19d0003e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:11.632 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.614+0000 7f19e3fff700 1 -- 172.21.15.103:0/771915935 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d0004470 con 0x7f19d00039e0 2020-04-22T14:12:11.632 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.614+0000 7f19e3fff700 1 -- 172.21.15.103:0/771915935 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d00045e0 con 0x7f19d0004e10 2020-04-22T14:12:11.632 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.614+0000 7f19e3fff700 1 -- 172.21.15.103:0/771915935 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d00047a0 con 0x7f19f40b9140 2020-04-22T14:12:11.632 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.614+0000 7f19f27fc700 1 --2- 172.21.15.103:0/771915935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19d0004e10 0x7f19d0005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:11.633 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.614+0000 7f19f37fe700 1 --2- 172.21.15.103:0/771915935 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19d00039e0 0x7f19d0003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:11.633 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.614+0000 7f19f2ffd700 1 --2- 172.21.15.103:0/771915935 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19f40b9140 0x7f19d00049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:11.633 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.614+0000 7f19f27fc700 1 -- 172.21.15.103:0/771915935 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19f40b9140 msgr2=0x7f19d00049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:11.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.614+0000 7f19f27fc700 1 --2- 172.21.15.103:0/771915935 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19f40b9140 0x7f19d00049b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:11.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.614+0000 7f19f27fc700 1 -- 172.21.15.103:0/771915935 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19d00039e0 msgr2=0x7f19d0003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:11.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.614+0000 7f19f27fc700 1 --2- 172.21.15.103:0/771915935 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19d00039e0 0x7f19d0003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:11.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.614+0000 7f19f27fc700 1 -- 172.21.15.103:0/771915935 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f413ae00 con 0x7f19d0004e10 2020-04-22T14:12:11.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.614+0000 7f19f977f700 1 -- 172.21.15.103:0/771915935 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f40b3050 con 0x7f19d0004e10 2020-04-22T14:12:11.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.614+0000 7f19f27fc700 1 --2- 172.21.15.103:0/771915935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19d0004e10 0x7f19d0005230 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f19e4000b80 tx=0x7f19e4010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:11.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.614+0000 7f19f977f700 1 -- 172.21.15.103:0/771915935 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19f413b390 con 0x7f19d0004e10 2020-04-22T14:12:11.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.614+0000 7f19f27fc700 1 --2- 172.21.15.103:0/771915935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19d0004e10 0x7f19d0005230 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f19e4000b80 tx=0x7f19e4010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:11.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.614+0000 7f19f27fc700 1 --2- 172.21.15.103:0/771915935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19d0004e10 0x7f19d0005230 secure :-1 s=READY pgs=1035 cs=0 l=1 rx=0x7f19e4000b80 tx=0x7f19e4010d30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:11.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.614+0000 7f19f27fc700 1 --2- 172.21.15.103:0/771915935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19d0004e10 0x7f19d0005230 secure :-1 s=THROTTLE_DONE pgs=1035 cs=0 l=1 rx=0x7f19e4000b80 tx=0x7f19e4010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:11.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.614+0000 7f19e3fff700 1 -- 172.21.15.103:0/771915935 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19e40126b0 con 0x7f19d0004e10 2020-04-22T14:12:11.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.614+0000 7f19f27fc700 1 --2- 172.21.15.103:0/771915935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19d0004e10 0x7f19d0005230 secure :-1 s=THROTTLE_DONE pgs=1035 cs=0 l=1 rx=0x7f19e4000b80 tx=0x7f19e4010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:11.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.614+0000 7f19f27fc700 1 --2- 172.21.15.103:0/771915935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19d0004e10 0x7f19d0005230 secure :-1 s=THROTTLE_DONE pgs=1035 cs=0 l=1 rx=0x7f19e4000b80 tx=0x7f19e4010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:11.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.614+0000 7f19e3fff700 1 -- 172.21.15.103:0/771915935 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e4012810 con 0x7f19d0004e10 2020-04-22T14:12:11.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.614+0000 7f19e3fff700 1 -- 172.21.15.103:0/771915935 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19e4012bb0 con 0x7f19d0004e10 2020-04-22T14:12:11.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.615+0000 7f19f27fc700 1 --2- 172.21.15.103:0/771915935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19d0004e10 0x7f19d0005230 secure :-1 s=THROTTLE_DONE pgs=1035 cs=0 l=1 rx=0x7f19e4000b80 tx=0x7f19e4010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:11.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.615+0000 7f19f977f700 1 -- 172.21.15.103:0/771915935 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19d4003340 con 0x7f19d0004e10 2020-04-22T14:12:11.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.615+0000 7f19e3fff700 1 -- 172.21.15.103:0/771915935 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f19e4012d10 con 0x7f19d0004e10 2020-04-22T14:12:11.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.615+0000 7f19f27fc700 1 --2- 172.21.15.103:0/771915935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19d0004e10 0x7f19d0005230 secure :-1 s=THROTTLE_DONE pgs=1035 cs=0 l=1 rx=0x7f19e4000b80 tx=0x7f19e4010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:11.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.615+0000 7f19e3fff700 1 --2- 172.21.15.103:0/771915935 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f19d0055d30 0x7f19d00581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:11.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.616+0000 7f19e3fff700 1 -- 172.21.15.103:0/771915935 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6288+0+0 (secure 0 0 0) 0x7f19e4061380 con 0x7f19d0004e10 2020-04-22T14:12:11.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.616+0000 7f19f2ffd700 1 --2- 172.21.15.103:0/771915935 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f19d0055d30 0x7f19d00581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:11.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.616+0000 7f19f2ffd700 1 --2- 172.21.15.103:0/771915935 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f19d0055d30 0x7f19d00581f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f19e8008300 tx=0x7f19e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:11.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.616+0000 7f19f2ffd700 1 --2- 172.21.15.103:0/771915935 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f19d0055d30 0x7f19d00581f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f19e8008300 tx=0x7f19e8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:11.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.616+0000 7f19f2ffd700 1 --2- 172.21.15.103:0/771915935 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f19d0055d30 0x7f19d00581f0 secure :-1 s=READY pgs=384 cs=0 l=1 rx=0x7f19e8008300 tx=0x7f19e8007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:11.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.619+0000 7f19f27fc700 1 --2- 172.21.15.103:0/771915935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19d0004e10 0x7f19d0005230 secure :-1 s=THROTTLE_DONE pgs=1035 cs=0 l=1 rx=0x7f19e4000b80 tx=0x7f19e4010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:11.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.620+0000 7f19e3fff700 1 -- 172.21.15.103:0/771915935 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f19e403c880 con 0x7f19d0004e10 2020-04-22T14:12:11.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:11.761+0000 7f19f977f700 1 -- 172.21.15.103:0/771915935 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f19d4002280 con 0x7f19d0004e10 2020-04-22T14:12:12.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.444+0000 7f19f27fc700 1 --2- 172.21.15.103:0/771915935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19d0004e10 0x7f19d0005230 secure :-1 s=THROTTLE_DONE pgs=1035 cs=0 l=1 rx=0x7f19e4000b80 tx=0x7f19e4010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:12.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.444+0000 7f19e3fff700 1 -- 172.21.15.103:0/771915935 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v69) v1 ==== 185+0+0 (secure 0 0 0) 0x7f19e403fea0 con 0x7f19d0004e10 2020-04-22T14:12:12.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.446+0000 7f19f977f700 1 -- 172.21.15.103:0/771915935 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f19d0055d30 msgr2=0x7f19d00581f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:12.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.446+0000 7f19f977f700 1 --2- 172.21.15.103:0/771915935 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f19d0055d30 0x7f19d00581f0 secure :-1 s=READY pgs=384 cs=0 l=1 rx=0x7f19e8008300 tx=0x7f19e8007a40).stop 2020-04-22T14:12:12.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.446+0000 7f19f977f700 1 -- 172.21.15.103:0/771915935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19d0004e10 msgr2=0x7f19d0005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:12.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.446+0000 7f19f977f700 1 --2- 172.21.15.103:0/771915935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19d0004e10 0x7f19d0005230 secure :-1 s=READY pgs=1035 cs=0 l=1 rx=0x7f19e4000b80 tx=0x7f19e4010d30).stop 2020-04-22T14:12:12.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.446+0000 7f19f37fe700 1 -- 172.21.15.103:0/771915935 reap_dead start 2020-04-22T14:12:12.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.447+0000 7f19f977f700 1 -- 172.21.15.103:0/771915935 shutdown_connections 2020-04-22T14:12:12.451 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.447+0000 7f19f977f700 1 --2- 172.21.15.103:0/771915935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19d0004e10 0x7f19d0005230 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:12.451 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.447+0000 7f19f977f700 1 -- 172.21.15.103:0/771915935 >> 172.21.15.103:0/771915935 conn(0x7f19f405b7b0 msgr2=0x7f19f4128d90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:12.451 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.447+0000 7f19f977f700 1 -- 172.21.15.103:0/771915935 shutdown_connections 2020-04-22T14:12:12.451 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.447+0000 7f19f977f700 1 -- 172.21.15.103:0/771915935 wait complete. 2020-04-22T14:12:12.451 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' removed 2020-04-22T14:12:12.463 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:12.479 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2020-04-22T14:12:12.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.634+0000 7f0edef79700 1 Processor -- start 2020-04-22T14:12:12.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.634+0000 7f0edef79700 1 -- start start 2020-04-22T14:12:12.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.635+0000 7f0edef79700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0ed8061a30 0x7f0ed80b4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:12.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.635+0000 7f0edef79700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0ed80acb10 0x7f0ed80ae920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:12.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.635+0000 7f0edef79700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ed8060250 con 0x7f0ed80aed80 2020-04-22T14:12:12.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.635+0000 7f0edef79700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed80623c0 con 0x7f0ed8061a30 2020-04-22T14:12:12.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.635+0000 7f0edef79700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed8062660 con 0x7f0ed80acb10 2020-04-22T14:12:12.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.635+0000 7f0edcd15700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0ed8061a30 0x7f0ed80b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:12.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.635+0000 7f0edcd15700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0ed8061a30 0x7f0ed80b4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:49738/0 (socket says 172.21.15.103:49738) 2020-04-22T14:12:12.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.635+0000 7f0edcd15700 1 -- 172.21.15.103:0/1513501273 learned_addr learned my addr 172.21.15.103:0/1513501273 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:12.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.635+0000 7f0ed7fff700 1 --2- 172.21.15.103:0/1513501273 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0ed80acb10 0x7f0ed80ae920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:12.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.635+0000 7f0ed7fff700 1 -- 172.21.15.103:0/1513501273 >> v2:172.21.15.86:3300/0 conn(0x7f0ed8061a30 msgr2=0x7f0ed80b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:12.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.635+0000 7f0ed7fff700 1 --2- 172.21.15.103:0/1513501273 >> v2:172.21.15.86:3300/0 conn(0x7f0ed8061a30 0x7f0ed80b4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:12.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.635+0000 7f0ed7fff700 1 -- 172.21.15.103:0/1513501273 >> v1:172.21.15.86:6789/0 conn(0x7f0ed80aed80 legacy=0x7f0ed80b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:12.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.635+0000 7f0ed77fe700 1 -- 172.21.15.103:0/1513501273 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1743250746 0 0) 0x7f0ed8060250 con 0x7f0ed80aed80 2020-04-22T14:12:12.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.635+0000 7f0ed7fff700 1 -- 172.21.15.103:0/1513501273 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed8061e10 con 0x7f0ed80acb10 2020-04-22T14:12:12.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.635+0000 7f0edcd15700 1 --2- 172.21.15.103:0/1513501273 >> v2:172.21.15.86:3300/0 conn(0x7f0ed8061a30 0x7f0ed80b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:12:12.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.635+0000 7f0ed7fff700 1 --2- 172.21.15.103:0/1513501273 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0ed80acb10 0x7f0ed80ae920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0ecc0032b0 tx=0x7f0ecc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:12.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.635+0000 7f0ed7fff700 1 --2- 172.21.15.103:0/1513501273 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0ed80acb10 0x7f0ed80ae920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0ecc0032b0 tx=0x7f0ecc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:12.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.635+0000 7f0ed7fff700 1 --2- 172.21.15.103:0/1513501273 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0ed80acb10 0x7f0ed80ae920 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f0ecc0032b0 tx=0x7f0ecc007dc0).ready entity=mon.2 client_cookie=68c428d22998f669 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:12.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.636+0000 7f0ed7fff700 1 --2- 172.21.15.103:0/1513501273 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0ed80acb10 0x7f0ed80ae920 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f0ecc0032b0 tx=0x7f0ecc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:12.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.636+0000 7f0ed77fe700 1 -- 172.21.15.103:0/1513501273 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ecc011e20 con 0x7f0ed80acb10 2020-04-22T14:12:12.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.636+0000 7f0ed7fff700 1 --2- 172.21.15.103:0/1513501273 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0ed80acb10 0x7f0ed80ae920 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f0ecc0032b0 tx=0x7f0ecc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:12.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.636+0000 7f0ed7fff700 1 --2- 172.21.15.103:0/1513501273 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0ed80acb10 0x7f0ed80ae920 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f0ecc0032b0 tx=0x7f0ecc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:12.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.636+0000 7f0ed77fe700 1 -- 172.21.15.103:0/1513501273 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ecc00a180 con 0x7f0ed80acb10 2020-04-22T14:12:12.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.636+0000 7f0ed77fe700 1 -- 172.21.15.103:0/1513501273 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ecc00a520 con 0x7f0ed80acb10 2020-04-22T14:12:12.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.636+0000 7f0edef79700 1 -- 172.21.15.103:0/1513501273 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0ed80acb10 msgr2=0x7f0ed80ae920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:12.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.636+0000 7f0edef79700 1 --2- 172.21.15.103:0/1513501273 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0ed80acb10 0x7f0ed80ae920 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f0ecc0032b0 tx=0x7f0ecc007dc0).stop 2020-04-22T14:12:12.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.636+0000 7f0edef79700 1 -- 172.21.15.103:0/1513501273 shutdown_connections 2020-04-22T14:12:12.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.636+0000 7f0edef79700 1 --2- 172.21.15.103:0/1513501273 >> v2:172.21.15.86:3300/0 conn(0x7f0ed8061a30 0x7f0ed80b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:12.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.636+0000 7f0edef79700 1 --2- 172.21.15.103:0/1513501273 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0ed80acb10 0x7f0ed80ae920 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:12.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.636+0000 7f0edef79700 1 -- 172.21.15.103:0/1513501273 >> 172.21.15.103:0/1513501273 conn(0x7f0ed805b7b0 msgr2=0x7f0ed80b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:12.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.636+0000 7f0edef79700 1 -- 172.21.15.103:0/1513501273 shutdown_connections 2020-04-22T14:12:12.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.636+0000 7f0edef79700 1 -- 172.21.15.103:0/1513501273 wait complete. 2020-04-22T14:12:12.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.637+0000 7f0edef79700 1 Processor -- start 2020-04-22T14:12:12.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.637+0000 7f0edef79700 1 -- start start 2020-04-22T14:12:12.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.638+0000 7f0edef79700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0ed8061a30 0x7f0ed8140580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:12.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.638+0000 7f0edef79700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0ed80acb10 0x7f0ed8065e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:12.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.638+0000 7f0edef79700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0ed80aed80 0x7f0ed8064c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:12.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.638+0000 7f0edef79700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed8064260 con 0x7f0ed8061a30 2020-04-22T14:12:12.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.638+0000 7f0edef79700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed8064500 con 0x7f0ed80acb10 2020-04-22T14:12:12.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.638+0000 7f0edef79700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed80647a0 con 0x7f0ed80aed80 2020-04-22T14:12:12.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.638+0000 7f0ed7fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0ed80acb10 0x7f0ed8065e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:12.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.638+0000 7f0ed7fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0ed80acb10 0x7f0ed8065e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52514/0 (socket says 172.21.15.103:52514) 2020-04-22T14:12:12.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.638+0000 7f0ed7fff700 1 -- 172.21.15.103:0/964828836 learned_addr learned my addr 172.21.15.103:0/964828836 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:12.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.638+0000 7f0edd516700 1 --2- 172.21.15.103:0/964828836 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0ed80aed80 0x7f0ed8064c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:12.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.638+0000 7f0edcd15700 1 --2- 172.21.15.103:0/964828836 >> v2:172.21.15.86:3300/0 conn(0x7f0ed8061a30 0x7f0ed8140580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:12.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.639+0000 7f0ed7fff700 1 -- 172.21.15.103:0/964828836 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0ed80aed80 msgr2=0x7f0ed8064c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:12.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.639+0000 7f0ed7fff700 1 --2- 172.21.15.103:0/964828836 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0ed80aed80 0x7f0ed8064c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:12.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.639+0000 7f0ed7fff700 1 -- 172.21.15.103:0/964828836 >> v2:172.21.15.86:3300/0 conn(0x7f0ed8061a30 msgr2=0x7f0ed8140580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:12.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.639+0000 7f0ed7fff700 1 --2- 172.21.15.103:0/964828836 >> v2:172.21.15.86:3300/0 conn(0x7f0ed8061a30 0x7f0ed8140580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:12.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.639+0000 7f0ed7fff700 1 -- 172.21.15.103:0/964828836 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed8063f90 con 0x7f0ed80acb10 2020-04-22T14:12:12.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.639+0000 7f0edcd15700 1 --2- 172.21.15.103:0/964828836 >> v2:172.21.15.86:3300/0 conn(0x7f0ed8061a30 0x7f0ed8140580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:12:12.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.639+0000 7f0ed7fff700 1 --2- 172.21.15.103:0/964828836 >> v2:172.21.15.103:3300/0 conn(0x7f0ed80acb10 0x7f0ed8065e10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0ecc0032b0 tx=0x7f0ecc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:12.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.639+0000 7f0ed7fff700 1 --2- 172.21.15.103:0/964828836 >> v2:172.21.15.103:3300/0 conn(0x7f0ed80acb10 0x7f0ed8065e10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0ecc0032b0 tx=0x7f0ecc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:12.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.639+0000 7f0ed7fff700 1 --2- 172.21.15.103:0/964828836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ed80acb10 0x7f0ed8065e10 secure :-1 s=READY pgs=1036 cs=0 l=1 rx=0x7f0ecc0032b0 tx=0x7f0ecc007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:12.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.639+0000 7f0ed7fff700 1 --2- 172.21.15.103:0/964828836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ed80acb10 0x7f0ed8065e10 secure :-1 s=THROTTLE_DONE pgs=1036 cs=0 l=1 rx=0x7f0ecc0032b0 tx=0x7f0ecc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:12.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.639+0000 7f0ed5ffb700 1 -- 172.21.15.103:0/964828836 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ecc005c30 con 0x7f0ed80acb10 2020-04-22T14:12:12.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.639+0000 7f0ed7fff700 1 --2- 172.21.15.103:0/964828836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ed80acb10 0x7f0ed8065e10 secure :-1 s=THROTTLE_DONE pgs=1036 cs=0 l=1 rx=0x7f0ecc0032b0 tx=0x7f0ecc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:12.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.639+0000 7f0ed7fff700 1 --2- 172.21.15.103:0/964828836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ed80acb10 0x7f0ed8065e10 secure :-1 s=THROTTLE_DONE pgs=1036 cs=0 l=1 rx=0x7f0ecc0032b0 tx=0x7f0ecc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:12.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.639+0000 7f0ed5ffb700 1 -- 172.21.15.103:0/964828836 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ecc005d90 con 0x7f0ed80acb10 2020-04-22T14:12:12.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.639+0000 7f0edef79700 1 -- 172.21.15.103:0/964828836 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed8066270 con 0x7f0ed80acb10 2020-04-22T14:12:12.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.639+0000 7f0ed5ffb700 1 -- 172.21.15.103:0/964828836 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ecc00f7a0 con 0x7f0ed80acb10 2020-04-22T14:12:12.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.639+0000 7f0edef79700 1 -- 172.21.15.103:0/964828836 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed8062d60 con 0x7f0ed80acb10 2020-04-22T14:12:12.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.640+0000 7f0ed7fff700 1 --2- 172.21.15.103:0/964828836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ed80acb10 0x7f0ed8065e10 secure :-1 s=THROTTLE_DONE pgs=1036 cs=0 l=1 rx=0x7f0ecc0032b0 tx=0x7f0ecc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:12.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.640+0000 7f0edef79700 1 -- 172.21.15.103:0/964828836 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ed80aebb0 con 0x7f0ed80acb10 2020-04-22T14:12:12.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.640+0000 7f0ed5ffb700 1 -- 172.21.15.103:0/964828836 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f0ecc00f9d0 con 0x7f0ed80acb10 2020-04-22T14:12:12.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.640+0000 7f0ed7fff700 1 --2- 172.21.15.103:0/964828836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ed80acb10 0x7f0ed8065e10 secure :-1 s=THROTTLE_DONE pgs=1036 cs=0 l=1 rx=0x7f0ecc0032b0 tx=0x7f0ecc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:12.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.640+0000 7f0ed5ffb700 1 --2- 172.21.15.103:0/964828836 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0eb804d960 0x7f0eb804fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:12.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.640+0000 7f0ed5ffb700 1 -- 172.21.15.103:0/964828836 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5850+0+0 (secure 0 0 0) 0x7f0ecc062390 con 0x7f0ed80acb10 2020-04-22T14:12:12.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.641+0000 7f0edcd15700 1 --2- 172.21.15.103:0/964828836 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0eb804d960 0x7f0eb804fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:12.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.641+0000 7f0edcd15700 1 --2- 172.21.15.103:0/964828836 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0eb804d960 0x7f0eb804fe20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0ec8002f30 tx=0x7f0ec800ca40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:12.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.641+0000 7f0edcd15700 1 --2- 172.21.15.103:0/964828836 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0eb804d960 0x7f0eb804fe20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0ec8002f30 tx=0x7f0ec800ca40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:12.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.641+0000 7f0edcd15700 1 --2- 172.21.15.103:0/964828836 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0eb804d960 0x7f0eb804fe20 secure :-1 s=READY pgs=385 cs=0 l=1 rx=0x7f0ec8002f30 tx=0x7f0ec800ca40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:12.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.644+0000 7f0ed7fff700 1 --2- 172.21.15.103:0/964828836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ed80acb10 0x7f0ed8065e10 secure :-1 s=THROTTLE_DONE pgs=1036 cs=0 l=1 rx=0x7f0ecc0032b0 tx=0x7f0ecc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:12.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.644+0000 7f0ed5ffb700 1 -- 172.21.15.103:0/964828836 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f0ecc03d890 con 0x7f0ed80acb10 2020-04-22T14:12:12.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:12.785+0000 7f0edef79700 1 -- 172.21.15.103:0/964828836 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0ed8056c90 con 0x7f0ed80acb10 2020-04-22T14:12:13.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.446+0000 7f0ed7fff700 1 --2- 172.21.15.103:0/964828836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ed80acb10 0x7f0ed8065e10 secure :-1 s=THROTTLE_DONE pgs=1036 cs=0 l=1 rx=0x7f0ecc0032b0 tx=0x7f0ecc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:13.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.446+0000 7f0ed5ffb700 1 -- 172.21.15.103:0/964828836 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v70) v1 ==== 173+0+0 (secure 0 0 0) 0x7f0ecc040eb0 con 0x7f0ed80acb10 2020-04-22T14:12:13.452 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.448+0000 7f0edef79700 1 -- 172.21.15.103:0/964828836 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0eb804d960 msgr2=0x7f0eb804fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:13.452 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.449+0000 7f0edef79700 1 --2- 172.21.15.103:0/964828836 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0eb804d960 0x7f0eb804fe20 secure :-1 s=READY pgs=385 cs=0 l=1 rx=0x7f0ec8002f30 tx=0x7f0ec800ca40).stop 2020-04-22T14:12:13.452 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.449+0000 7f0edef79700 1 -- 172.21.15.103:0/964828836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ed80acb10 msgr2=0x7f0ed8065e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:13.453 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.449+0000 7f0edef79700 1 --2- 172.21.15.103:0/964828836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ed80acb10 0x7f0ed8065e10 secure :-1 s=READY pgs=1036 cs=0 l=1 rx=0x7f0ecc0032b0 tx=0x7f0ecc007dc0).stop 2020-04-22T14:12:13.453 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.449+0000 7f0edef79700 1 -- 172.21.15.103:0/964828836 shutdown_connections 2020-04-22T14:12:13.453 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.449+0000 7f0edef79700 1 --2- 172.21.15.103:0/964828836 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0eb804d960 0x7f0eb804fe20 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:13.453 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.449+0000 7f0edef79700 1 --2- 172.21.15.103:0/964828836 >> v2:172.21.15.86:3300/0 conn(0x7f0ed8061a30 0x7f0ed8140580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:13.453 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.449+0000 7f0edef79700 1 --2- 172.21.15.103:0/964828836 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0ed80aed80 0x7f0ed8064c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:13.453 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.449+0000 7f0edef79700 1 --2- 172.21.15.103:0/964828836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ed80acb10 0x7f0ed8065e10 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:13.453 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.449+0000 7f0edef79700 1 -- 172.21.15.103:0/964828836 >> 172.21.15.103:0/964828836 conn(0x7f0ed805b7b0 msgr2=0x7f0ed80b3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:13.454 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.449+0000 7f0edef79700 1 -- 172.21.15.103:0/964828836 shutdown_connections 2020-04-22T14:12:13.454 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.449+0000 7f0edef79700 1 -- 172.21.15.103:0/964828836 wait complete. 2020-04-22T14:12:13.454 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' removed 2020-04-22T14:12:13.466 INFO:tasks.ceph.mds.a:Restarting daemon 2020-04-22T14:12:13.466 INFO:tasks.ceph.mds.a:Stopping old one... 2020-04-22T14:12:13.466 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-04-22T14:12:13.466 INFO:teuthology.orchestra.run:waiting for 300 2020-04-22T14:12:13.466 INFO:tasks.ceph.mds.b:Restarting daemon 2020-04-22T14:12:13.467 INFO:tasks.ceph.mds.b:Stopping old one... 2020-04-22T14:12:13.467 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-04-22T14:12:13.467 INFO:teuthology.orchestra.run:waiting for 300 2020-04-22T14:12:13.477 INFO:tasks.ceph.mds.a:Stopped 2020-04-22T14:12:13.477 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:13.479 INFO:tasks.ceph.mds.b:Stopped 2020-04-22T14:12:13.479 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:12:13.544 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-04-22T14:12:13.545 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-04-22T14:12:13.582 INFO:tasks.ceph.mds.b:Started 2020-04-22T14:12:13.583 DEBUG:teuthology.parallel:result is None 2020-04-22T14:12:13.583 INFO:tasks.ceph.mds.a:Started 2020-04-22T14:12:13.584 DEBUG:teuthology.parallel:result is None 2020-04-22T14:12:13.585 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:13.599 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2020-04-22T14:12:13.660 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2020-04-22T14:12:13.662 INFO:tasks.ceph.mds.b.smithi086.stdout:starting mds.b at 2020-04-22T14:12:13.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.746+0000 7f4f0ebd6700 1 Processor -- start 2020-04-22T14:12:13.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.746+0000 7f4f0ebd6700 1 -- start start 2020-04-22T14:12:13.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.747+0000 7f4f0ebd6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f080b4880 0x7f4f08060910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:13.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.747+0000 7f4f0ebd6700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4f080b0d80 0x7f4f080b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:13.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.747+0000 7f4f0ebd6700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f08149a70 con 0x7f4f08060d70 2020-04-22T14:12:13.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.747+0000 7f4f0ebd6700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f080b1690 con 0x7f4f080b0d80 2020-04-22T14:12:13.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.747+0000 7f4f0ebd6700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f08149cd0 con 0x7f4f080b4880 2020-04-22T14:12:13.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.747+0000 7f4f0d173700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4f080b0d80 0x7f4f080b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:13.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.747+0000 7f4f07fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f4f08060d70 0x7f4f0814a170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44722/0 (socket says 172.21.15.103:44722) 2020-04-22T14:12:13.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.747+0000 7f4f07fff700 1 -- 172.21.15.103:0/2574706835 learned_addr learned my addr 172.21.15.103:0/2574706835 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:13.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.747+0000 7f4f0c972700 1 --2- 172.21.15.103:0/2574706835 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f080b4880 0x7f4f08060910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:13.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.747+0000 7f4f0d173700 1 -- 172.21.15.103:0/2574706835 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f080b4880 msgr2=0x7f4f08060910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:13.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.747+0000 7f4f0d173700 1 --2- 172.21.15.103:0/2574706835 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f080b4880 0x7f4f08060910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:13.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.748+0000 7f4f0d173700 1 -- 172.21.15.103:0/2574706835 >> v1:172.21.15.103:6789/0 conn(0x7f4f08060d70 legacy=0x7f4f0814a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:13.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.747+0000 7f4f077fe700 1 -- 172.21.15.103:0/2574706835 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1993664269 0 0) 0x7f4f08149a70 con 0x7f4f08060d70 2020-04-22T14:12:13.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.748+0000 7f4f0d173700 1 -- 172.21.15.103:0/2574706835 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f080b4c60 con 0x7f4f080b0d80 2020-04-22T14:12:13.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.748+0000 7f4f0c972700 1 --2- 172.21.15.103:0/2574706835 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f080b4880 0x7f4f08060910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:12:13.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.748+0000 7f4f0d173700 1 --2- 172.21.15.103:0/2574706835 >> v2:172.21.15.103:3300/0 conn(0x7f4f080b0d80 0x7f4f080b1230 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4f000032b0 tx=0x7f4f00007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:13.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.748+0000 7f4f0d173700 1 --2- 172.21.15.103:0/2574706835 >> v2:172.21.15.103:3300/0 conn(0x7f4f080b0d80 0x7f4f080b1230 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4f000032b0 tx=0x7f4f00007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:13.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.748+0000 7f4f0d173700 1 --2- 172.21.15.103:0/2574706835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f080b0d80 0x7f4f080b1230 secure :-1 s=READY pgs=1041 cs=0 l=1 rx=0x7f4f000032b0 tx=0x7f4f00007dc0).ready entity=mon.1 client_cookie=654b9d74796fd153 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:13.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.748+0000 7f4f0d173700 1 --2- 172.21.15.103:0/2574706835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f080b0d80 0x7f4f080b1230 secure :-1 s=THROTTLE_DONE pgs=1041 cs=0 l=1 rx=0x7f4f000032b0 tx=0x7f4f00007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:13.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.748+0000 7f4f077fe700 1 -- 172.21.15.103:0/2574706835 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f00010e60 con 0x7f4f080b0d80 2020-04-22T14:12:13.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.748+0000 7f4f0d173700 1 --2- 172.21.15.103:0/2574706835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f080b0d80 0x7f4f080b1230 secure :-1 s=THROTTLE_DONE pgs=1041 cs=0 l=1 rx=0x7f4f000032b0 tx=0x7f4f00007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:13.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.748+0000 7f4f077fe700 1 -- 172.21.15.103:0/2574706835 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f000110d0 con 0x7f4f080b0d80 2020-04-22T14:12:13.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.748+0000 7f4f0d173700 1 --2- 172.21.15.103:0/2574706835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f080b0d80 0x7f4f080b1230 secure :-1 s=THROTTLE_DONE pgs=1041 cs=0 l=1 rx=0x7f4f000032b0 tx=0x7f4f00007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:13.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.748+0000 7f4f077fe700 1 -- 172.21.15.103:0/2574706835 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f000114b0 con 0x7f4f080b0d80 2020-04-22T14:12:13.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.748+0000 7f4f0ebd6700 1 -- 172.21.15.103:0/2574706835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f080b0d80 msgr2=0x7f4f080b1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:13.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.748+0000 7f4f0ebd6700 1 --2- 172.21.15.103:0/2574706835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f080b0d80 0x7f4f080b1230 secure :-1 s=READY pgs=1041 cs=0 l=1 rx=0x7f4f000032b0 tx=0x7f4f00007dc0).stop 2020-04-22T14:12:13.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.748+0000 7f4f0ebd6700 1 -- 172.21.15.103:0/2574706835 shutdown_connections 2020-04-22T14:12:13.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.748+0000 7f4f0ebd6700 1 --2- 172.21.15.103:0/2574706835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f080b0d80 0x7f4f080b1230 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:13.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.748+0000 7f4f0ebd6700 1 --2- 172.21.15.103:0/2574706835 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f080b4880 0x7f4f08060910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:13.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.748+0000 7f4f0ebd6700 1 -- 172.21.15.103:0/2574706835 >> 172.21.15.103:0/2574706835 conn(0x7f4f080ba8d0 msgr2=0x7f4f080bace0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:13.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.748+0000 7f4f0ebd6700 1 -- 172.21.15.103:0/2574706835 shutdown_connections 2020-04-22T14:12:13.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.748+0000 7f4f0ebd6700 1 -- 172.21.15.103:0/2574706835 wait complete. 2020-04-22T14:12:13.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.749+0000 7f4f0ebd6700 1 Processor -- start 2020-04-22T14:12:13.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.749+0000 7f4f0ebd6700 1 -- start start 2020-04-22T14:12:13.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.750+0000 7f4f0ebd6700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4f08060d70 0x7f4f080b9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:13.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.750+0000 7f4f0ebd6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f080b4880 0x7f4f08157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:13.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.750+0000 7f4f0ebd6700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f08064df0 con 0x7f4f080b0d80 2020-04-22T14:12:13.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.750+0000 7f4f0ebd6700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f0813dd10 con 0x7f4f08060d70 2020-04-22T14:12:13.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.750+0000 7f4f0ebd6700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f08148420 con 0x7f4f080b4880 2020-04-22T14:12:13.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.750+0000 7f4f07fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f4f080b0d80 0x7f4f08156f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44730/0 (socket says 172.21.15.103:44730) 2020-04-22T14:12:13.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.750+0000 7f4f07fff700 1 -- 172.21.15.103:0/2280361418 learned_addr learned my addr 172.21.15.103:0/2280361418 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:13.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.750+0000 7f4f0c972700 1 --2- 172.21.15.103:0/2280361418 >> v2:172.21.15.86:3300/0 conn(0x7f4f08060d70 0x7f4f080b9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:13.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.750+0000 7f4f0d173700 1 --2- 172.21.15.103:0/2280361418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f080b4880 0x7f4f08157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:13.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.750+0000 7f4f05ffb700 1 -- 172.21.15.103:0/2280361418 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1629703231 0 0) 0x7f4f08064df0 con 0x7f4f080b0d80 2020-04-22T14:12:13.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.751+0000 7f4f05ffb700 1 -- 172.21.15.103:0/2280361418 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ee8002fe0 con 0x7f4f080b0d80 2020-04-22T14:12:13.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.751+0000 7f4f05ffb700 1 -- 172.21.15.103:0/2280361418 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1819011648 0 0) 0x7f4ee8002fe0 con 0x7f4f080b0d80 2020-04-22T14:12:13.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.751+0000 7f4f05ffb700 1 -- 172.21.15.103:0/2280361418 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4f08064df0 con 0x7f4f080b0d80 2020-04-22T14:12:13.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.751+0000 7f4f05ffb700 1 -- 172.21.15.103:0/2280361418 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f4efc0018e0 con 0x7f4f080b0d80 2020-04-22T14:12:13.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.751+0000 7f4f05ffb700 1 -- 172.21.15.103:0/2280361418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f080b4880 msgr2=0x7f4f08157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:13.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.751+0000 7f4f05ffb700 1 --2- 172.21.15.103:0/2280361418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f080b4880 0x7f4f08157960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:13.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.751+0000 7f4f05ffb700 1 -- 172.21.15.103:0/2280361418 >> v2:172.21.15.86:3300/0 conn(0x7f4f08060d70 msgr2=0x7f4f080b9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:13.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.751+0000 7f4f05ffb700 1 --2- 172.21.15.103:0/2280361418 >> v2:172.21.15.86:3300/0 conn(0x7f4f08060d70 0x7f4f080b9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:13.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.751+0000 7f4f05ffb700 1 -- 172.21.15.103:0/2280361418 >> v1:172.21.15.103:6789/0 conn(0x7f4f080b0d80 legacy=0x7f4f08156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:13.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.751+0000 7f4f05ffb700 1 --2- 172.21.15.103:0/2280361418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ee80049b0 0x7f4ee8004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:13.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.751+0000 7f4f05ffb700 1 --2- 172.21.15.103:0/2280361418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ee80052a0 0x7f4ee80039c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:13.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.751+0000 7f4f05ffb700 1 --2- 172.21.15.103:0/2280361418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4ee8003f10 0x7f4ee8004370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:13.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.751+0000 7f4f05ffb700 1 -- 172.21.15.103:0/2280361418 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0813dd10 con 0x7f4ee80052a0 2020-04-22T14:12:13.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.751+0000 7f4f05ffb700 1 -- 172.21.15.103:0/2280361418 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f08148420 con 0x7f4ee80049b0 2020-04-22T14:12:13.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.751+0000 7f4f05ffb700 1 -- 172.21.15.103:0/2280361418 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee800b860 con 0x7f4ee8003f10 2020-04-22T14:12:13.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.751+0000 7f4f0d173700 1 --2- 172.21.15.103:0/2280361418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f080b4880 0x7f4f08157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:12:13.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.751+0000 7f4f0c972700 1 --2- 172.21.15.103:0/2280361418 >> v2:172.21.15.86:3300/0 conn(0x7f4f08060d70 0x7f4f080b9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:12:13.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.751+0000 7f4f07fff700 1 --2- 172.21.15.103:0/2280361418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ee80052a0 0x7f4ee80039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:13.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.751+0000 7f4f0c972700 1 --2- 172.21.15.103:0/2280361418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ee80049b0 0x7f4ee8004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:13.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.751+0000 7f4f0d173700 1 --2- 172.21.15.103:0/2280361418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4ee8003f10 0x7f4ee8004370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:13.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.751+0000 7f4f0c972700 1 -- 172.21.15.103:0/2280361418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4ee8003f10 msgr2=0x7f4ee8004370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:13.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.751+0000 7f4f0c972700 1 --2- 172.21.15.103:0/2280361418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4ee8003f10 0x7f4ee8004370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:13.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.751+0000 7f4f0c972700 1 -- 172.21.15.103:0/2280361418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ee80052a0 msgr2=0x7f4ee80039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:13.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.751+0000 7f4f0c972700 1 --2- 172.21.15.103:0/2280361418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ee80052a0 0x7f4ee80039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:13.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.751+0000 7f4f0c972700 1 -- 172.21.15.103:0/2280361418 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f08148680 con 0x7f4ee80049b0 2020-04-22T14:12:13.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.751+0000 7f4f0ebd6700 1 -- 172.21.15.103:0/2280361418 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f08157680 con 0x7f4ee80049b0 2020-04-22T14:12:13.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.751+0000 7f4f0c972700 1 --2- 172.21.15.103:0/2280361418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ee80049b0 0x7f4ee8004dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4ef8002f30 tx=0x7f4ef8011170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:13.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.751+0000 7f4f0ebd6700 1 -- 172.21.15.103:0/2280361418 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f08146670 con 0x7f4ee80049b0 2020-04-22T14:12:13.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.751+0000 7f4f0c972700 1 --2- 172.21.15.103:0/2280361418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ee80049b0 0x7f4ee8004dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4ef8002f30 tx=0x7f4ef8011170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:13.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.751+0000 7f4f0c972700 1 --2- 172.21.15.103:0/2280361418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ee80049b0 0x7f4ee8004dd0 secure :-1 s=READY pgs=1043 cs=0 l=1 rx=0x7f4ef8002f30 tx=0x7f4ef8011170).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:13.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.752+0000 7f4f0c972700 1 --2- 172.21.15.103:0/2280361418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ee80049b0 0x7f4ee8004dd0 secure :-1 s=THROTTLE_DONE pgs=1043 cs=0 l=1 rx=0x7f4ef8002f30 tx=0x7f4ef8011170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:13.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.752+0000 7f4f05ffb700 1 -- 172.21.15.103:0/2280361418 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ef8008e60 con 0x7f4ee80049b0 2020-04-22T14:12:13.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.752+0000 7f4f0c972700 1 --2- 172.21.15.103:0/2280361418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ee80049b0 0x7f4ee8004dd0 secure :-1 s=THROTTLE_DONE pgs=1043 cs=0 l=1 rx=0x7f4ef8002f30 tx=0x7f4ef8011170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:13.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.752+0000 7f4f05ffb700 1 -- 172.21.15.103:0/2280361418 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef800cb80 con 0x7f4ee80049b0 2020-04-22T14:12:13.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.752+0000 7f4f0c972700 1 --2- 172.21.15.103:0/2280361418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ee80049b0 0x7f4ee8004dd0 secure :-1 s=THROTTLE_DONE pgs=1043 cs=0 l=1 rx=0x7f4ef8002f30 tx=0x7f4ef8011170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:13.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.752+0000 7f4f05ffb700 1 -- 172.21.15.103:0/2280361418 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ef800b270 con 0x7f4ee80049b0 2020-04-22T14:12:13.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.752+0000 7f4f0c972700 1 --2- 172.21.15.103:0/2280361418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ee80049b0 0x7f4ee8004dd0 secure :-1 s=THROTTLE_DONE pgs=1043 cs=0 l=1 rx=0x7f4ef8002f30 tx=0x7f4ef8011170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:13.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.752+0000 7f4f0ebd6700 1 -- 172.21.15.103:0/2280361418 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ee4003340 con 0x7f4ee80049b0 2020-04-22T14:12:13.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.753+0000 7f4f05ffb700 1 -- 172.21.15.103:0/2280361418 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f4ef800b3d0 con 0x7f4ee80049b0 2020-04-22T14:12:13.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.753+0000 7f4f0c972700 1 --2- 172.21.15.103:0/2280361418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ee80049b0 0x7f4ee8004dd0 secure :-1 s=THROTTLE_DONE pgs=1043 cs=0 l=1 rx=0x7f4ef8002f30 tx=0x7f4ef8011170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:13.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.753+0000 7f4f05ffb700 1 --2- 172.21.15.103:0/2280361418 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4ee8056010 0x7f4ee80584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:13.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.753+0000 7f4f05ffb700 1 -- 172.21.15.103:0/2280361418 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f4ef8061640 con 0x7f4ee80049b0 2020-04-22T14:12:13.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.753+0000 7f4f07fff700 1 --2- 172.21.15.103:0/2280361418 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4ee8056010 0x7f4ee80584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:13.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.753+0000 7f4f07fff700 1 --2- 172.21.15.103:0/2280361418 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4ee8056010 0x7f4ee80584d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4efc005540 tx=0x7f4efc0055c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:13.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.753+0000 7f4f07fff700 1 --2- 172.21.15.103:0/2280361418 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4ee8056010 0x7f4ee80584d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4efc005540 tx=0x7f4efc0055c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:13.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.753+0000 7f4f07fff700 1 --2- 172.21.15.103:0/2280361418 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4ee8056010 0x7f4ee80584d0 secure :-1 s=READY pgs=386 cs=0 l=1 rx=0x7f4efc005540 tx=0x7f4efc0055c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:13.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.757+0000 7f4f0c972700 1 --2- 172.21.15.103:0/2280361418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ee80049b0 0x7f4ee8004dd0 secure :-1 s=THROTTLE_DONE pgs=1043 cs=0 l=1 rx=0x7f4ef8002f30 tx=0x7f4ef8011170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:13.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.757+0000 7f4f05ffb700 1 -- 172.21.15.103:0/2280361418 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f4ef803ca20 con 0x7f4ee80049b0 2020-04-22T14:12:13.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:13.914+0000 7f4f0ebd6700 1 -- 172.21.15.103:0/2280361418 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f4ee40036e0 con 0x7f4ee80049b0 2020-04-22T14:12:14.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.690+0000 7f4f0c972700 1 --2- 172.21.15.103:0/2280361418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ee80049b0 0x7f4ee8004dd0 secure :-1 s=THROTTLE_DONE pgs=1043 cs=0 l=1 rx=0x7f4ef8002f30 tx=0x7f4ef8011170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:14.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.690+0000 7f4f05ffb700 1 -- 172.21.15.103:0/2280361418 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v73) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4ef8040040 con 0x7f4ee80049b0 2020-04-22T14:12:14.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.692+0000 7f4f0ebd6700 1 -- 172.21.15.103:0/2280361418 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4ee8056010 msgr2=0x7f4ee80584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:14.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.692+0000 7f4f0ebd6700 1 --2- 172.21.15.103:0/2280361418 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4ee8056010 0x7f4ee80584d0 secure :-1 s=READY pgs=386 cs=0 l=1 rx=0x7f4efc005540 tx=0x7f4efc0055c0).stop 2020-04-22T14:12:14.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.692+0000 7f4f0ebd6700 1 -- 172.21.15.103:0/2280361418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ee80049b0 msgr2=0x7f4ee8004dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:14.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.692+0000 7f4f0ebd6700 1 --2- 172.21.15.103:0/2280361418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ee80049b0 0x7f4ee8004dd0 secure :-1 s=READY pgs=1043 cs=0 l=1 rx=0x7f4ef8002f30 tx=0x7f4ef8011170).stop 2020-04-22T14:12:14.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.692+0000 7f4f0d173700 1 -- 172.21.15.103:0/2280361418 reap_dead start 2020-04-22T14:12:14.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.692+0000 7f4f0d173700 1 -- 172.21.15.103:0/2280361418 reap_dead start 2020-04-22T14:12:14.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.692+0000 7f4f0ebd6700 1 -- 172.21.15.103:0/2280361418 shutdown_connections 2020-04-22T14:12:14.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.692+0000 7f4f0ebd6700 1 -- 172.21.15.103:0/2280361418 >> 172.21.15.103:0/2280361418 conn(0x7f4f080ba8d0 msgr2=0x7f4f081450d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:14.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.692+0000 7f4f0ebd6700 1 -- 172.21.15.103:0/2280361418 shutdown_connections 2020-04-22T14:12:14.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.692+0000 7f4f0ebd6700 1 -- 172.21.15.103:0/2280361418 wait complete. 2020-04-22T14:12:14.697 INFO:teuthology.orchestra.run.smithi103.stderr: removed all blacklist entries 2020-04-22T14:12:14.707 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2020-04-22T14:12:14.707 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:14.766 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2020-04-22T14:12:14.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.914+0000 7fdc52a74700 1 Processor -- start 2020-04-22T14:12:14.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.914+0000 7fdc52a74700 1 -- start start 2020-04-22T14:12:14.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.915+0000 7fdc52a74700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdc4c0ac740 0x7fdc4c142de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:14.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.915+0000 7fdc52a74700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc4c064ec0 con 0x7fdc4c0b6040 2020-04-22T14:12:14.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.915+0000 7fdc52a74700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc4c146870 con 0x7fdc4c067170 2020-04-22T14:12:14.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.915+0000 7fdc52a74700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc4c065af0 con 0x7fdc4c0ac740 2020-04-22T14:12:14.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.915+0000 7fdc50810700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fdc4c067170 0x7fdc4c13c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44748/0 (socket says 172.21.15.103:44748) 2020-04-22T14:12:14.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.915+0000 7fdc50810700 1 -- 172.21.15.103:0/1832120062 learned_addr learned my addr 172.21.15.103:0/1832120062 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:14.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.915+0000 7fdc51011700 1 --2- 172.21.15.103:0/1832120062 >> v2:172.21.15.86:3300/0 conn(0x7fdc4c0ac740 0x7fdc4c142de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:14.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.916+0000 7fdc4b7fe700 1 -- 172.21.15.103:0/1832120062 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3610781696 0 0) 0x7fdc4c146870 con 0x7fdc4c067170 2020-04-22T14:12:14.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.916+0000 7fdc4b7fe700 1 -- 172.21.15.103:0/1832120062 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc38003230 con 0x7fdc4c067170 2020-04-22T14:12:14.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.916+0000 7fdc4b7fe700 1 -- 172.21.15.103:0/1832120062 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 102563017 0 0) 0x7fdc38003230 con 0x7fdc4c067170 2020-04-22T14:12:14.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.916+0000 7fdc4b7fe700 1 -- 172.21.15.103:0/1832120062 >> v2:172.21.15.86:3300/0 conn(0x7fdc4c0ac740 msgr2=0x7fdc4c142de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:14.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.916+0000 7fdc4b7fe700 1 --2- 172.21.15.103:0/1832120062 >> v2:172.21.15.86:3300/0 conn(0x7fdc4c0ac740 0x7fdc4c142de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:14.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.916+0000 7fdc4b7fe700 1 -- 172.21.15.103:0/1832120062 >> v1:172.21.15.86:6789/0 conn(0x7fdc4c0b6040 legacy=0x7fdc4c1426d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:14.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.916+0000 7fdc4b7fe700 1 -- 172.21.15.103:0/1832120062 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc4c067550 con 0x7fdc4c067170 2020-04-22T14:12:14.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.916+0000 7fdc4b7fe700 1 -- 172.21.15.103:0/1832120062 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fdc44001a50 con 0x7fdc4c067170 2020-04-22T14:12:14.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.916+0000 7fdc4b7fe700 1 -- 172.21.15.103:0/1832120062 >> v1:172.21.15.103:6789/0 conn(0x7fdc4c067170 legacy=0x7fdc4c13c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:14.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.916+0000 7fdc4b7fe700 1 --2- 172.21.15.103:0/1832120062 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc38003720 0x7fdc38003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:14.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.916+0000 7fdc4b7fe700 1 --2- 172.21.15.103:0/1832120062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc380044d0 0x7fdc38004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:14.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.916+0000 7fdc4b7fe700 1 --2- 172.21.15.103:0/1832120062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc38004db0 0x7fdc3800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:14.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.916+0000 7fdc4b7fe700 1 -- 172.21.15.103:0/1832120062 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4c065af0 con 0x7fdc38004db0 2020-04-22T14:12:14.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.916+0000 7fdc4b7fe700 1 -- 172.21.15.103:0/1832120062 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc380041c0 con 0x7fdc380044d0 2020-04-22T14:12:14.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.916+0000 7fdc4b7fe700 1 -- 172.21.15.103:0/1832120062 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3800bb80 con 0x7fdc38003720 2020-04-22T14:12:14.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.916+0000 7fdc4bfff700 1 --2- 172.21.15.103:0/1832120062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc380044d0 0x7fdc38004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:14.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.916+0000 7fdc51011700 1 --2- 172.21.15.103:0/1832120062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc38004db0 0x7fdc3800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:14.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.916+0000 7fdc50810700 1 --2- 172.21.15.103:0/1832120062 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc38003720 0x7fdc38003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:14.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.916+0000 7fdc4bfff700 1 -- 172.21.15.103:0/1832120062 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc38003720 msgr2=0x7fdc38003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:14.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.916+0000 7fdc4bfff700 1 --2- 172.21.15.103:0/1832120062 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc38003720 0x7fdc38003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:14.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.916+0000 7fdc4bfff700 1 -- 172.21.15.103:0/1832120062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc38004db0 msgr2=0x7fdc3800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:14.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.916+0000 7fdc4bfff700 1 --2- 172.21.15.103:0/1832120062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc38004db0 0x7fdc3800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:14.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.916+0000 7fdc51011700 1 -- 172.21.15.103:0/1832120062 reap_dead start 2020-04-22T14:12:14.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.916+0000 7fdc4bfff700 1 -- 172.21.15.103:0/1832120062 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc38003230 con 0x7fdc380044d0 2020-04-22T14:12:14.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.916+0000 7fdc4bfff700 1 --2- 172.21.15.103:0/1832120062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc380044d0 0x7fdc38004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdc380054a0 tx=0x7fdc4000fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:14.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.916+0000 7fdc4bfff700 1 --2- 172.21.15.103:0/1832120062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc380044d0 0x7fdc38004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdc380054a0 tx=0x7fdc4000fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:14.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.916+0000 7fdc4bfff700 1 --2- 172.21.15.103:0/1832120062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc380044d0 0x7fdc38004950 secure :-1 s=READY pgs=1045 cs=0 l=1 rx=0x7fdc380054a0 tx=0x7fdc4000fc70).ready entity=mon.1 client_cookie=5465504d3d623c12 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:14.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.916+0000 7fdc4bfff700 1 --2- 172.21.15.103:0/1832120062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc380044d0 0x7fdc38004950 secure :-1 s=THROTTLE_DONE pgs=1045 cs=0 l=1 rx=0x7fdc380054a0 tx=0x7fdc4000fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:14.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.916+0000 7fdc4bfff700 1 --2- 172.21.15.103:0/1832120062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc380044d0 0x7fdc38004950 secure :-1 s=THROTTLE_DONE pgs=1045 cs=0 l=1 rx=0x7fdc380054a0 tx=0x7fdc4000fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:14.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.916+0000 7fdc4b7fe700 1 -- 172.21.15.103:0/1832120062 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc40010890 con 0x7fdc380044d0 2020-04-22T14:12:14.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.917+0000 7fdc4bfff700 1 --2- 172.21.15.103:0/1832120062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc380044d0 0x7fdc38004950 secure :-1 s=THROTTLE_DONE pgs=1045 cs=0 l=1 rx=0x7fdc380054a0 tx=0x7fdc4000fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:14.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.917+0000 7fdc4b7fe700 1 -- 172.21.15.103:0/1832120062 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc400064e0 con 0x7fdc380044d0 2020-04-22T14:12:14.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.917+0000 7fdc4b7fe700 1 -- 172.21.15.103:0/1832120062 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc40006880 con 0x7fdc380044d0 2020-04-22T14:12:14.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.917+0000 7fdc52a74700 1 -- 172.21.15.103:0/1832120062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc380044d0 msgr2=0x7fdc38004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:14.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.917+0000 7fdc52a74700 1 --2- 172.21.15.103:0/1832120062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc380044d0 0x7fdc38004950 secure :-1 s=READY pgs=1045 cs=0 l=1 rx=0x7fdc380054a0 tx=0x7fdc4000fc70).stop 2020-04-22T14:12:14.961 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.917+0000 7fdc52a74700 1 -- 172.21.15.103:0/1832120062 shutdown_connections 2020-04-22T14:12:14.961 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.917+0000 7fdc52a74700 1 --2- 172.21.15.103:0/1832120062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc380044d0 0x7fdc38004950 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:14.961 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.917+0000 7fdc52a74700 1 -- 172.21.15.103:0/1832120062 >> 172.21.15.103:0/1832120062 conn(0x7fdc4c0b9160 msgr2=0x7fdc4c05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:14.961 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.917+0000 7fdc52a74700 1 -- 172.21.15.103:0/1832120062 shutdown_connections 2020-04-22T14:12:14.961 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.917+0000 7fdc52a74700 1 -- 172.21.15.103:0/1832120062 wait complete. 2020-04-22T14:12:14.961 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.918+0000 7fdc52a74700 1 Processor -- start 2020-04-22T14:12:14.961 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.918+0000 7fdc52a74700 1 -- start start 2020-04-22T14:12:14.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.919+0000 7fdc52a74700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdc380044d0 0x7fdc4c154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:14.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.919+0000 7fdc52a74700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc4c136930 0x7fdc4c157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:14.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.919+0000 7fdc52a74700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc4c136da0 con 0x7fdc4c13a660 2020-04-22T14:12:14.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.919+0000 7fdc52a74700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc4c133a40 con 0x7fdc380044d0 2020-04-22T14:12:14.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.919+0000 7fdc52a74700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4c153700 con 0x7fdc4c136930 2020-04-22T14:12:14.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.919+0000 7fdc50810700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdc380044d0 0x7fdc4c154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:14.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.919+0000 7fdc50810700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdc380044d0 0x7fdc4c154360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52566/0 (socket says 172.21.15.103:52566) 2020-04-22T14:12:14.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.919+0000 7fdc50810700 1 -- 172.21.15.103:0/362967136 learned_addr learned my addr 172.21.15.103:0/362967136 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:14.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.919+0000 7fdc51011700 1 --2- 172.21.15.103:0/362967136 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc4c136930 0x7fdc4c157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:14.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.919+0000 7fdc50810700 1 -- 172.21.15.103:0/362967136 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc4c136930 msgr2=0x7fdc4c157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:14.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.919+0000 7fdc49ffb700 1 -- 172.21.15.103:0/362967136 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1672732954 0 0) 0x7fdc4c136da0 con 0x7fdc4c13a660 2020-04-22T14:12:14.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.919+0000 7fdc50810700 1 --2- 172.21.15.103:0/362967136 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc4c136930 0x7fdc4c157730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:14.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.919+0000 7fdc50810700 1 -- 172.21.15.103:0/362967136 >> v1:172.21.15.103:6789/0 conn(0x7fdc4c13a660 legacy=0x7fdc4c139920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:14.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.919+0000 7fdc50810700 1 -- 172.21.15.103:0/362967136 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc4c153980 con 0x7fdc380044d0 2020-04-22T14:12:14.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.919+0000 7fdc50810700 1 --2- 172.21.15.103:0/362967136 >> v2:172.21.15.103:3300/0 conn(0x7fdc380044d0 0x7fdc4c154360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdc44001f20 tx=0x7fdc4c0676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:14.964 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.919+0000 7fdc50810700 1 --2- 172.21.15.103:0/362967136 >> v2:172.21.15.103:3300/0 conn(0x7fdc380044d0 0x7fdc4c154360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdc44001f20 tx=0x7fdc4c0676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:14.964 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.919+0000 7fdc50810700 1 --2- 172.21.15.103:0/362967136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc380044d0 0x7fdc4c154360 secure :-1 s=READY pgs=1047 cs=0 l=1 rx=0x7fdc44001f20 tx=0x7fdc4c0676e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:14.964 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.919+0000 7fdc50810700 1 --2- 172.21.15.103:0/362967136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc380044d0 0x7fdc4c154360 secure :-1 s=THROTTLE_DONE pgs=1047 cs=0 l=1 rx=0x7fdc44001f20 tx=0x7fdc4c0676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:14.964 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.919+0000 7fdc49ffb700 1 -- 172.21.15.103:0/362967136 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc44011e90 con 0x7fdc380044d0 2020-04-22T14:12:14.964 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.919+0000 7fdc50810700 1 --2- 172.21.15.103:0/362967136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc380044d0 0x7fdc4c154360 secure :-1 s=THROTTLE_DONE pgs=1047 cs=0 l=1 rx=0x7fdc44001f20 tx=0x7fdc4c0676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:14.964 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.919+0000 7fdc50810700 1 --2- 172.21.15.103:0/362967136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc380044d0 0x7fdc4c154360 secure :-1 s=THROTTLE_DONE pgs=1047 cs=0 l=1 rx=0x7fdc44001f20 tx=0x7fdc4c0676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:14.964 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.919+0000 7fdc49ffb700 1 -- 172.21.15.103:0/362967136 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4400cd70 con 0x7fdc380044d0 2020-04-22T14:12:14.965 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.919+0000 7fdc52a74700 1 -- 172.21.15.103:0/362967136 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc4c153c80 con 0x7fdc380044d0 2020-04-22T14:12:14.965 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.920+0000 7fdc49ffb700 1 -- 172.21.15.103:0/362967136 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc4400e360 con 0x7fdc380044d0 2020-04-22T14:12:14.965 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.920+0000 7fdc52a74700 1 -- 172.21.15.103:0/362967136 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc4c13a030 con 0x7fdc380044d0 2020-04-22T14:12:14.965 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.920+0000 7fdc50810700 1 --2- 172.21.15.103:0/362967136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc380044d0 0x7fdc4c154360 secure :-1 s=THROTTLE_DONE pgs=1047 cs=0 l=1 rx=0x7fdc44001f20 tx=0x7fdc4c0676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:14.965 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.920+0000 7fdc49ffb700 1 -- 172.21.15.103:0/362967136 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fdc4400e590 con 0x7fdc380044d0 2020-04-22T14:12:14.965 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.920+0000 7fdc50810700 1 --2- 172.21.15.103:0/362967136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc380044d0 0x7fdc4c154360 secure :-1 s=THROTTLE_DONE pgs=1047 cs=0 l=1 rx=0x7fdc44001f20 tx=0x7fdc4c0676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:14.965 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.921+0000 7fdc52a74700 1 -- 172.21.15.103:0/362967136 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc4c056c90 con 0x7fdc380044d0 2020-04-22T14:12:14.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.921+0000 7fdc49ffb700 1 --2- 172.21.15.103:0/362967136 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdc2c04d870 0x7fdc2c04fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:14.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.921+0000 7fdc49ffb700 1 -- 172.21.15.103:0/362967136 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fdc44061160 con 0x7fdc380044d0 2020-04-22T14:12:14.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.921+0000 7fdc4bfff700 1 --2- 172.21.15.103:0/362967136 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdc2c04d870 0x7fdc2c04fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:14.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.921+0000 7fdc4bfff700 1 --2- 172.21.15.103:0/362967136 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdc2c04d870 0x7fdc2c04fd30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdc400018b0 tx=0x7fdc4000fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:14.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.921+0000 7fdc4bfff700 1 --2- 172.21.15.103:0/362967136 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdc2c04d870 0x7fdc2c04fd30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdc400018b0 tx=0x7fdc4000fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:14.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.921+0000 7fdc4bfff700 1 --2- 172.21.15.103:0/362967136 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdc2c04d870 0x7fdc2c04fd30 secure :-1 s=READY pgs=389 cs=0 l=1 rx=0x7fdc400018b0 tx=0x7fdc4000fc70).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:14.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.925+0000 7fdc50810700 1 --2- 172.21.15.103:0/362967136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc380044d0 0x7fdc4c154360 secure :-1 s=THROTTLE_DONE pgs=1047 cs=0 l=1 rx=0x7fdc44001f20 tx=0x7fdc4c0676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:14.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:14.925+0000 7fdc49ffb700 1 -- 172.21.15.103:0/362967136 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fdc4403c540 con 0x7fdc380044d0 2020-04-22T14:12:15.119 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.116+0000 7fdc52a74700 1 -- 172.21.15.103:0/362967136 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fdc4c0b40c0 con 0x7fdc380044d0 2020-04-22T14:12:15.120 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.116+0000 7fdc50810700 1 --2- 172.21.15.103:0/362967136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc380044d0 0x7fdc4c154360 secure :-1 s=THROTTLE_DONE pgs=1047 cs=0 l=1 rx=0x7fdc44001f20 tx=0x7fdc4c0676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:15.120 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.116+0000 7fdc49ffb700 1 -- 172.21.15.103:0/362967136 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v28) v1 ==== 80+0+4513 (secure 0 0 0) 0x7fdc4403fb60 con 0x7fdc380044d0 2020-04-22T14:12:15.120 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:12:15.120 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:12:15.120 INFO:teuthology.orchestra.run.smithi103.stdout: "auth_dump": [ 2020-04-22T14:12:15.120 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:15.121 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.a", 2020-04-22T14:12:15.121 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBeliD5IBAAjC7UikdEP8FeE2rKs/ympw==", 2020-04-22T14:12:15.121 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:12:15.121 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:12:15.122 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:12:15.122 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:12:15.122 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:12:15.122 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:15.122 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:15.122 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:15.123 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.b", 2020-04-22T14:12:15.123 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBepkqQLBAA4aMKXxROQugglhm4aBd1Iw==", 2020-04-22T14:12:15.123 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:12:15.123 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:12:15.123 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:12:15.123 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:12:15.123 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:12:15.124 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:15.124 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:15.124 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:15.124 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.0", 2020-04-22T14:12:15.124 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA2TqBehMJiBxAARaWo32QGx49PxImGafnOFw==", 2020-04-22T14:12:15.124 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:12:15.124 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:12:15.125 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:12:15.125 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:12:15.125 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:15.125 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:15.125 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:15.125 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.1", 2020-04-22T14:12:15.125 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA4TqBeiAAcKRAAEHuaqbsB+NLUTSgFOCOFZg==", 2020-04-22T14:12:15.125 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:12:15.126 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:12:15.126 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:12:15.126 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:12:15.126 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:15.126 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:15.126 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:15.126 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.2", 2020-04-22T14:12:15.127 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA7TqBebeRzDxAAsjRyvJektq7MQ+334kU+UQ==", 2020-04-22T14:12:15.127 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:12:15.127 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:12:15.127 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:12:15.127 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:12:15.127 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:15.127 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:15.127 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:15.128 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.3", 2020-04-22T14:12:15.128 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA9TqBehxmSMRAATZ0o/ZnxHp2m/tqLmv6JwA==", 2020-04-22T14:12:15.128 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:12:15.128 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:12:15.128 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:12:15.128 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:12:15.130 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:15.130 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:15.130 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:15.130 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.4", 2020-04-22T14:12:15.130 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBETqBePwJSBRAAXgMKuX3EILi3gy8QzR4cig==", 2020-04-22T14:12:15.131 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:12:15.131 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:12:15.131 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:12:15.131 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:12:15.131 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:15.131 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:15.131 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:15.132 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.5", 2020-04-22T14:12:15.132 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBGTqBe5l++KRAAHIWG6bBnru2EVXv/drAL0g==", 2020-04-22T14:12:15.132 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:12:15.132 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:12:15.132 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:12:15.132 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:12:15.132 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:15.132 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:15.133 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:15.133 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.6", 2020-04-22T14:12:15.133 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBJTqBe88rTEBAAO2Z78NZLTYIbBpYovBSHVQ==", 2020-04-22T14:12:15.133 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:12:15.133 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:12:15.133 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:12:15.133 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:12:15.134 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:15.134 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:15.134 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:15.134 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.7", 2020-04-22T14:12:15.134 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBLTqBeGNFIMxAARIXhPNM6xurdnDv8+xZqUw==", 2020-04-22T14:12:15.134 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:12:15.134 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:12:15.137 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:12:15.137 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:12:15.137 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:15.137 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:15.137 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:15.138 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.0", 2020-04-22T14:12:15.138 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBe5ooUNxAA9zBtv6+i3Xl9iYtRl4xKGg==", 2020-04-22T14:12:15.138 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:12:15.138 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:12:15.138 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:12:15.138 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:12:15.138 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:15.138 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:15.139 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:15.139 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.1", 2020-04-22T14:12:15.139 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAyTqBe0bioBBAAVpoQouA/QICwqRoaFbjkiA==", 2020-04-22T14:12:15.139 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:12:15.139 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:12:15.139 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:12:15.139 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:12:15.140 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:15.140 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:15.140 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:15.140 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.2", 2020-04-22T14:12:15.140 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAyTqBemwpXCxAAObNL96zS67nMEe4MLjrEtw==", 2020-04-22T14:12:15.140 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:12:15.140 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:12:15.141 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:12:15.141 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:12:15.141 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:15.141 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:15.141 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:15.141 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.3", 2020-04-22T14:12:15.141 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAyTqBemGxNFBAAlqvB8FeZbMRwvzVjBpH/tA==", 2020-04-22T14:12:15.142 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:12:15.142 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:12:15.142 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:12:15.142 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:12:15.142 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:15.142 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:15.142 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:15.142 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.admin", 2020-04-22T14:12:15.143 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAwTqBeSx5dHxAAH0jPkaiWEwpr66ROWwbU8Q==", 2020-04-22T14:12:15.143 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:12:15.143 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2020-04-22T14:12:15.143 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:12:15.143 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:12:15.143 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:12:15.143 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:15.144 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:15.144 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:15.144 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mgr.x", 2020-04-22T14:12:15.144 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBe3YVhGhAAWAf6f9sV3bzoucBBPS3j2g==", 2020-04-22T14:12:15.144 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:12:15.144 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2020-04-22T14:12:15.144 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile mgr", 2020-04-22T14:12:15.144 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:12:15.145 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:15.145 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:15.145 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:15.145 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mgr.y", 2020-04-22T14:12:15.145 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBeX8AXExAAhh/N+/ogdKlxmkveSM60+g==", 2020-04-22T14:12:15.145 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:12:15.145 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2020-04-22T14:12:15.146 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile mgr", 2020-04-22T14:12:15.146 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:12:15.146 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:15.146 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:15.146 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:12:15.146 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:12:15.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.118+0000 7fdc52a74700 1 -- 172.21.15.103:0/362967136 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdc2c04d870 msgr2=0x7fdc2c04fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:15.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.118+0000 7fdc52a74700 1 --2- 172.21.15.103:0/362967136 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdc2c04d870 0x7fdc2c04fd30 secure :-1 s=READY pgs=389 cs=0 l=1 rx=0x7fdc400018b0 tx=0x7fdc4000fc70).stop 2020-04-22T14:12:15.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.118+0000 7fdc52a74700 1 -- 172.21.15.103:0/362967136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc380044d0 msgr2=0x7fdc4c154360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:15.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.118+0000 7fdc52a74700 1 --2- 172.21.15.103:0/362967136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc380044d0 0x7fdc4c154360 secure :-1 s=READY pgs=1047 cs=0 l=1 rx=0x7fdc44001f20 tx=0x7fdc4c0676e0).stop 2020-04-22T14:12:15.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.118+0000 7fdc52a74700 1 -- 172.21.15.103:0/362967136 shutdown_connections 2020-04-22T14:12:15.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.118+0000 7fdc52a74700 1 --2- 172.21.15.103:0/362967136 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdc2c04d870 0x7fdc2c04fd30 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:15.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.118+0000 7fdc52a74700 1 --2- 172.21.15.103:0/362967136 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc4c136930 0x7fdc4c157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:15.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.118+0000 7fdc52a74700 1 --2- 172.21.15.103:0/362967136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc380044d0 0x7fdc4c154360 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:15.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.118+0000 7fdc52a74700 1 -- 172.21.15.103:0/362967136 >> 172.21.15.103:0/362967136 conn(0x7fdc4c0b9160 msgr2=0x7fdc4c133d00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:15.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.118+0000 7fdc52a74700 1 -- 172.21.15.103:0/362967136 shutdown_connections 2020-04-22T14:12:15.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.118+0000 7fdc52a74700 1 -- 172.21.15.103:0/362967136 wait complete. 2020-04-22T14:12:15.150 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:15.163 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:12:15.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.317+0000 7fd2365ce700 1 Processor -- start 2020-04-22T14:12:15.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.317+0000 7fd2365ce700 1 -- start start 2020-04-22T14:12:15.324 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.318+0000 7fd2365ce700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd2301403f0 0x7fd23005f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:15.324 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.318+0000 7fd2365ce700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd2300b56c0 0x7fd2300b5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:15.324 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.318+0000 7fd2365ce700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd230061fe0 con 0x7fd2301464a0 2020-04-22T14:12:15.324 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.318+0000 7fd2365ce700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd230062280 con 0x7fd2300b56c0 2020-04-22T14:12:15.324 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.318+0000 7fd2365ce700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd230062520 con 0x7fd2301403f0 2020-04-22T14:12:15.324 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.318+0000 7fd22ffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd2301403f0 0x7fd23005f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:15.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.318+0000 7fd22ffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd2301403f0 0x7fd23005f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52574/0 (socket says 172.21.15.103:52574) 2020-04-22T14:12:15.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.318+0000 7fd22ffff700 1 -- 172.21.15.103:0/6974605 learned_addr learned my addr 172.21.15.103:0/6974605 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:15.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.319+0000 7fd234b6b700 1 --2- 172.21.15.103:0/6974605 >> v2:172.21.15.86:3300/0 conn(0x7fd2300b56c0 0x7fd2300b5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:15.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.319+0000 7fd22ffff700 1 -- 172.21.15.103:0/6974605 >> v2:172.21.15.86:3300/0 conn(0x7fd2300b56c0 msgr2=0x7fd2300b5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:15.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.319+0000 7fd22ffff700 1 --2- 172.21.15.103:0/6974605 >> v2:172.21.15.86:3300/0 conn(0x7fd2300b56c0 0x7fd2300b5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:15.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.319+0000 7fd22ffff700 1 -- 172.21.15.103:0/6974605 >> v1:172.21.15.86:6789/0 conn(0x7fd2301464a0 legacy=0x7fd2300629c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:15.326 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.319+0000 7fd22ffff700 1 -- 172.21.15.103:0/6974605 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2300b51c0 con 0x7fd2301403f0 2020-04-22T14:12:15.326 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.319+0000 7fd22ffff700 1 --2- 172.21.15.103:0/6974605 >> v2:172.21.15.103:3300/0 conn(0x7fd2301403f0 0x7fd23005f2c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd2300b1050 tx=0x7fd220007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:15.326 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.319+0000 7fd22ffff700 1 --2- 172.21.15.103:0/6974605 >> v2:172.21.15.103:3300/0 conn(0x7fd2301403f0 0x7fd23005f2c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd2300b1050 tx=0x7fd220007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:15.326 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.319+0000 7fd22ffff700 1 --2- 172.21.15.103:0/6974605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2301403f0 0x7fd23005f2c0 secure :-1 s=READY pgs=1048 cs=0 l=1 rx=0x7fd2300b1050 tx=0x7fd220007a40).ready entity=mon.1 client_cookie=e6119adc8359575e server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:15.326 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.319+0000 7fd22ffff700 1 --2- 172.21.15.103:0/6974605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2301403f0 0x7fd23005f2c0 secure :-1 s=THROTTLE_DONE pgs=1048 cs=0 l=1 rx=0x7fd2300b1050 tx=0x7fd220007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:15.326 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.319+0000 7fd22effd700 1 -- 172.21.15.103:0/6974605 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2200116e0 con 0x7fd2301403f0 2020-04-22T14:12:15.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.319+0000 7fd22ffff700 1 --2- 172.21.15.103:0/6974605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2301403f0 0x7fd23005f2c0 secure :-1 s=THROTTLE_DONE pgs=1048 cs=0 l=1 rx=0x7fd2300b1050 tx=0x7fd220007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:15.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.319+0000 7fd22ffff700 1 --2- 172.21.15.103:0/6974605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2301403f0 0x7fd23005f2c0 secure :-1 s=THROTTLE_DONE pgs=1048 cs=0 l=1 rx=0x7fd2300b1050 tx=0x7fd220007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:15.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.319+0000 7fd22effd700 1 -- 172.21.15.103:0/6974605 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd220011840 con 0x7fd2301403f0 2020-04-22T14:12:15.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.319+0000 7fd22effd700 1 -- 172.21.15.103:0/6974605 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd220011c20 con 0x7fd2301403f0 2020-04-22T14:12:15.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.319+0000 7fd2365ce700 1 -- 172.21.15.103:0/6974605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2301403f0 msgr2=0x7fd23005f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:15.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.319+0000 7fd2365ce700 1 --2- 172.21.15.103:0/6974605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2301403f0 0x7fd23005f2c0 secure :-1 s=READY pgs=1048 cs=0 l=1 rx=0x7fd2300b1050 tx=0x7fd220007a40).stop 2020-04-22T14:12:15.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.319+0000 7fd2365ce700 1 -- 172.21.15.103:0/6974605 shutdown_connections 2020-04-22T14:12:15.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.319+0000 7fd2365ce700 1 --2- 172.21.15.103:0/6974605 >> v2:172.21.15.86:3300/0 conn(0x7fd2300b56c0 0x7fd2300b5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:15.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.319+0000 7fd2365ce700 1 --2- 172.21.15.103:0/6974605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2301403f0 0x7fd23005f2c0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:15.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.319+0000 7fd2365ce700 1 -- 172.21.15.103:0/6974605 >> 172.21.15.103:0/6974605 conn(0x7fd23005ad30 msgr2=0x7fd23005b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:15.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.319+0000 7fd2365ce700 1 -- 172.21.15.103:0/6974605 shutdown_connections 2020-04-22T14:12:15.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.320+0000 7fd2365ce700 1 -- 172.21.15.103:0/6974605 wait complete. 2020-04-22T14:12:15.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.320+0000 7fd2365ce700 1 Processor -- start 2020-04-22T14:12:15.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.320+0000 7fd2365ce700 1 -- start start 2020-04-22T14:12:15.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.321+0000 7fd2365ce700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd2300b56c0 0x7fd230140fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:15.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.321+0000 7fd2365ce700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2301403f0 0x7fd230145380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:15.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.321+0000 7fd2365ce700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd2301464a0 0x7fd2300ae490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:15.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.321+0000 7fd2365ce700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd230136350 con 0x7fd2301464a0 2020-04-22T14:12:15.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.321+0000 7fd2365ce700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2301580e0 con 0x7fd2300b56c0 2020-04-22T14:12:15.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.321+0000 7fd2365ce700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2301457e0 con 0x7fd2301403f0 2020-04-22T14:12:15.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.321+0000 7fd22ffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd2300b56c0 0x7fd230140fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:15.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.321+0000 7fd22ffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd2300b56c0 0x7fd230140fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52578/0 (socket says 172.21.15.103:52578) 2020-04-22T14:12:15.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.321+0000 7fd22ffff700 1 -- 172.21.15.103:0/219375914 learned_addr learned my addr 172.21.15.103:0/219375914 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:15.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.322+0000 7fd234b6b700 1 --2- 172.21.15.103:0/219375914 >> v2:172.21.15.86:3300/0 conn(0x7fd2301464a0 0x7fd2300ae490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:15.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.322+0000 7fd22f7fe700 1 --2- 172.21.15.103:0/219375914 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2301403f0 0x7fd230145380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:15.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.322+0000 7fd22ffff700 1 -- 172.21.15.103:0/219375914 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2301403f0 msgr2=0x7fd230145380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:15.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.322+0000 7fd22ffff700 1 --2- 172.21.15.103:0/219375914 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2301403f0 0x7fd230145380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:15.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.322+0000 7fd22ffff700 1 -- 172.21.15.103:0/219375914 >> v2:172.21.15.86:3300/0 conn(0x7fd2301464a0 msgr2=0x7fd2300ae490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:15.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.322+0000 7fd22ffff700 1 --2- 172.21.15.103:0/219375914 >> v2:172.21.15.86:3300/0 conn(0x7fd2301464a0 0x7fd2300ae490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:15.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.322+0000 7fd22ffff700 1 -- 172.21.15.103:0/219375914 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd230157e40 con 0x7fd2300b56c0 2020-04-22T14:12:15.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.322+0000 7fd22ffff700 1 --2- 172.21.15.103:0/219375914 >> v2:172.21.15.103:3300/0 conn(0x7fd2300b56c0 0x7fd230140fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd2300b1050 tx=0x7fd220007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:15.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.322+0000 7fd22ffff700 1 --2- 172.21.15.103:0/219375914 >> v2:172.21.15.103:3300/0 conn(0x7fd2300b56c0 0x7fd230140fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd2300b1050 tx=0x7fd220007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:15.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.322+0000 7fd22ffff700 1 --2- 172.21.15.103:0/219375914 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2300b56c0 0x7fd230140fa0 secure :-1 s=READY pgs=1049 cs=0 l=1 rx=0x7fd2300b1050 tx=0x7fd220007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:15.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.322+0000 7fd22ffff700 1 --2- 172.21.15.103:0/219375914 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2300b56c0 0x7fd230140fa0 secure :-1 s=THROTTLE_DONE pgs=1049 cs=0 l=1 rx=0x7fd2300b1050 tx=0x7fd220007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:15.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.322+0000 7fd22d7fa700 1 -- 172.21.15.103:0/219375914 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd220007360 con 0x7fd2300b56c0 2020-04-22T14:12:15.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.322+0000 7fd22ffff700 1 --2- 172.21.15.103:0/219375914 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2300b56c0 0x7fd230140fa0 secure :-1 s=THROTTLE_DONE pgs=1049 cs=0 l=1 rx=0x7fd2300b1050 tx=0x7fd220007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:15.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.322+0000 7fd22ffff700 1 --2- 172.21.15.103:0/219375914 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2300b56c0 0x7fd230140fa0 secure :-1 s=THROTTLE_DONE pgs=1049 cs=0 l=1 rx=0x7fd2300b1050 tx=0x7fd220007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:15.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.322+0000 7fd22d7fa700 1 -- 172.21.15.103:0/219375914 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd220007500 con 0x7fd2300b56c0 2020-04-22T14:12:15.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.322+0000 7fd2365ce700 1 -- 172.21.15.103:0/219375914 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2301428d0 con 0x7fd2300b56c0 2020-04-22T14:12:15.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.322+0000 7fd22d7fa700 1 -- 172.21.15.103:0/219375914 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2200058b0 con 0x7fd2300b56c0 2020-04-22T14:12:15.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.322+0000 7fd2365ce700 1 -- 172.21.15.103:0/219375914 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2300ae8f0 con 0x7fd2300b56c0 2020-04-22T14:12:15.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.323+0000 7fd22ffff700 1 --2- 172.21.15.103:0/219375914 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2300b56c0 0x7fd230140fa0 secure :-1 s=THROTTLE_DONE pgs=1049 cs=0 l=1 rx=0x7fd2300b1050 tx=0x7fd220007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:15.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.323+0000 7fd2365ce700 1 -- 172.21.15.103:0/219375914 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd230056c90 con 0x7fd2300b56c0 2020-04-22T14:12:15.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.323+0000 7fd22d7fa700 1 -- 172.21.15.103:0/219375914 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fd220005b20 con 0x7fd2300b56c0 2020-04-22T14:12:15.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.323+0000 7fd22ffff700 1 --2- 172.21.15.103:0/219375914 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2300b56c0 0x7fd230140fa0 secure :-1 s=THROTTLE_DONE pgs=1049 cs=0 l=1 rx=0x7fd2300b1050 tx=0x7fd220007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:15.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.323+0000 7fd22d7fa700 1 --2- 172.21.15.103:0/219375914 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd21004daa0 0x7fd21004ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:15.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.323+0000 7fd22d7fa700 1 -- 172.21.15.103:0/219375914 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fd220061a00 con 0x7fd2300b56c0 2020-04-22T14:12:15.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.324+0000 7fd22f7fe700 1 --2- 172.21.15.103:0/219375914 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd21004daa0 0x7fd21004ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:15.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.324+0000 7fd22f7fe700 1 --2- 172.21.15.103:0/219375914 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd21004daa0 0x7fd21004ff60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd224001f50 tx=0x7fd224003960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:15.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.324+0000 7fd22f7fe700 1 --2- 172.21.15.103:0/219375914 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd21004daa0 0x7fd21004ff60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd224001f50 tx=0x7fd224003960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:15.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.324+0000 7fd22f7fe700 1 --2- 172.21.15.103:0/219375914 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd21004daa0 0x7fd21004ff60 secure :-1 s=READY pgs=390 cs=0 l=1 rx=0x7fd224001f50 tx=0x7fd224003960).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:15.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.327+0000 7fd22ffff700 1 --2- 172.21.15.103:0/219375914 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2300b56c0 0x7fd230140fa0 secure :-1 s=THROTTLE_DONE pgs=1049 cs=0 l=1 rx=0x7fd2300b1050 tx=0x7fd220007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:15.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.327+0000 7fd22d7fa700 1 -- 172.21.15.103:0/219375914 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fd22003cf80 con 0x7fd2300b56c0 2020-04-22T14:12:15.476 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.473+0000 7fd2365ce700 1 -- 172.21.15.103:0/219375914 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd23006a8b0 con 0x7fd2300b56c0 2020-04-22T14:12:15.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.474+0000 7fd22ffff700 1 --2- 172.21.15.103:0/219375914 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2300b56c0 0x7fd230140fa0 secure :-1 s=THROTTLE_DONE pgs=1049 cs=0 l=1 rx=0x7fd2300b1050 tx=0x7fd220007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:15.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.474+0000 7fd22d7fa700 1 -- 172.21.15.103:0/219375914 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+13233 (secure 0 0 0) 0x7fd220040520 con 0x7fd2300b56c0 2020-04-22T14:12:15.477 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:12:15.477 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":73,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:12:14.687405+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:12:15.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.475+0000 7fd2365ce700 1 -- 172.21.15.103:0/219375914 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd21004daa0 msgr2=0x7fd21004ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:15.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.475+0000 7fd2365ce700 1 --2- 172.21.15.103:0/219375914 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd21004daa0 0x7fd21004ff60 secure :-1 s=READY pgs=390 cs=0 l=1 rx=0x7fd224001f50 tx=0x7fd224003960).stop 2020-04-22T14:12:15.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.475+0000 7fd2365ce700 1 -- 172.21.15.103:0/219375914 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2300b56c0 msgr2=0x7fd230140fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:15.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.475+0000 7fd2365ce700 1 --2- 172.21.15.103:0/219375914 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2300b56c0 0x7fd230140fa0 secure :-1 s=READY pgs=1049 cs=0 l=1 rx=0x7fd2300b1050 tx=0x7fd220007a40).stop 2020-04-22T14:12:15.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.475+0000 7fd2365ce700 1 -- 172.21.15.103:0/219375914 shutdown_connections 2020-04-22T14:12:15.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.475+0000 7fd2365ce700 1 --2- 172.21.15.103:0/219375914 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd21004daa0 0x7fd21004ff60 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:15.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.475+0000 7fd2365ce700 1 --2- 172.21.15.103:0/219375914 >> v2:172.21.15.86:3300/0 conn(0x7fd2301464a0 0x7fd2300ae490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:15.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.475+0000 7fd2365ce700 1 --2- 172.21.15.103:0/219375914 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2300b56c0 0x7fd230140fa0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:15.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.475+0000 7fd2365ce700 1 --2- 172.21.15.103:0/219375914 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2301403f0 0x7fd230145380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:15.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.475+0000 7fd2365ce700 1 -- 172.21.15.103:0/219375914 >> 172.21.15.103:0/219375914 conn(0x7fd23005ad30 msgr2=0x7fd23005c620 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:15.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.475+0000 7fd2365ce700 1 -- 172.21.15.103:0/219375914 shutdown_connections 2020-04-22T14:12:15.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.475+0000 7fd2365ce700 1 -- 172.21.15.103:0/219375914 wait complete. 2020-04-22T14:12:15.489 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:12:15.489 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:15.503 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:12:15.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.650+0000 7fef9ccf6700 1 Processor -- start 2020-04-22T14:12:15.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.650+0000 7fef9ccf6700 1 -- start start 2020-04-22T14:12:15.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.651+0000 7fef9ccf6700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fef98146fc0 0x7fef980b65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:15.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.651+0000 7fef9ccf6700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9805fbc0 con 0x7fef98143bc0 2020-04-22T14:12:15.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.651+0000 7fef9ccf6700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9805fe60 con 0x7fef980b9890 2020-04-22T14:12:15.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.651+0000 7fef9ccf6700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef98060100 con 0x7fef98146fc0 2020-04-22T14:12:15.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.651+0000 7fef9659c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fef980b9890 0x7fef981434b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44776/0 (socket says 172.21.15.103:44776) 2020-04-22T14:12:15.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.651+0000 7fef9659c700 1 -- 172.21.15.103:0/3442031977 learned_addr learned my addr 172.21.15.103:0/3442031977 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:15.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.651+0000 7fef96d9d700 1 --2- 172.21.15.103:0/3442031977 >> v2:172.21.15.86:3300/0 conn(0x7fef98146fc0 0x7fef980b65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:15.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.651+0000 7fef9559a700 1 -- 172.21.15.103:0/3442031977 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2058113512 0 0) 0x7fef9805fe60 con 0x7fef980b9890 2020-04-22T14:12:15.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.651+0000 7fef9559a700 1 -- 172.21.15.103:0/3442031977 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef78003230 con 0x7fef980b9890 2020-04-22T14:12:15.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.652+0000 7fef9559a700 1 -- 172.21.15.103:0/3442031977 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 618979524 0 0) 0x7fef78003230 con 0x7fef980b9890 2020-04-22T14:12:15.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.652+0000 7fef9559a700 1 -- 172.21.15.103:0/3442031977 >> v2:172.21.15.86:3300/0 conn(0x7fef98146fc0 msgr2=0x7fef980b65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:15.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.652+0000 7fef9559a700 1 --2- 172.21.15.103:0/3442031977 >> v2:172.21.15.86:3300/0 conn(0x7fef98146fc0 0x7fef980b65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:15.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.652+0000 7fef9559a700 1 -- 172.21.15.103:0/3442031977 >> v1:172.21.15.86:6789/0 conn(0x7fef98143bc0 legacy=0x7fef980b5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:15.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.652+0000 7fef9559a700 1 -- 172.21.15.103:0/3442031977 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef980b9c70 con 0x7fef980b9890 2020-04-22T14:12:15.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.652+0000 7fef9559a700 1 -- 172.21.15.103:0/3442031977 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fef88001a50 con 0x7fef980b9890 2020-04-22T14:12:15.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.652+0000 7fef9559a700 1 -- 172.21.15.103:0/3442031977 >> v1:172.21.15.103:6789/0 conn(0x7fef980b9890 legacy=0x7fef981434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:15.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.652+0000 7fef9559a700 1 --2- 172.21.15.103:0/3442031977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef78003720 0x7fef78003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:15.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.652+0000 7fef9559a700 1 --2- 172.21.15.103:0/3442031977 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fef780044d0 0x7fef78004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:15.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.652+0000 7fef9559a700 1 --2- 172.21.15.103:0/3442031977 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef78004db0 0x7fef7800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:15.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.652+0000 7fef9559a700 1 -- 172.21.15.103:0/3442031977 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef98060100 con 0x7fef78003720 2020-04-22T14:12:15.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.652+0000 7fef9559a700 1 -- 172.21.15.103:0/3442031977 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef780041c0 con 0x7fef78004db0 2020-04-22T14:12:15.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.652+0000 7fef9559a700 1 -- 172.21.15.103:0/3442031977 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef7800bb80 con 0x7fef780044d0 2020-04-22T14:12:15.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.652+0000 7fef96d9d700 1 --2- 172.21.15.103:0/3442031977 >> v2:172.21.15.86:3300/0 conn(0x7fef98146fc0 0x7fef980b65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:12:15.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.652+0000 7fef96d9d700 1 --2- 172.21.15.103:0/3442031977 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef78004db0 0x7fef7800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:15.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.652+0000 7fef9659c700 1 --2- 172.21.15.103:0/3442031977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef78003720 0x7fef78003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:15.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.652+0000 7fef95d9b700 1 --2- 172.21.15.103:0/3442031977 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fef780044d0 0x7fef78004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:15.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.652+0000 7fef96d9d700 1 -- 172.21.15.103:0/3442031977 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fef780044d0 msgr2=0x7fef78004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:15.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.652+0000 7fef96d9d700 1 --2- 172.21.15.103:0/3442031977 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fef780044d0 0x7fef78004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:15.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.652+0000 7fef96d9d700 1 -- 172.21.15.103:0/3442031977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef78003720 msgr2=0x7fef78003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:15.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.652+0000 7fef96d9d700 1 --2- 172.21.15.103:0/3442031977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef78003720 0x7fef78003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:15.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.652+0000 7fef96d9d700 1 -- 172.21.15.103:0/3442031977 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef78003230 con 0x7fef78004db0 2020-04-22T14:12:15.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.652+0000 7fef96d9d700 1 --2- 172.21.15.103:0/3442031977 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef78004db0 0x7fef7800b720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fef780054a0 tx=0x7fef9000bf70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:15.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.652+0000 7fef96d9d700 1 -- 172.21.15.103:0/3442031977 reap_dead start 2020-04-22T14:12:15.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.652+0000 7fef96d9d700 1 --2- 172.21.15.103:0/3442031977 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef78004db0 0x7fef7800b720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fef780054a0 tx=0x7fef9000bf70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:15.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.652+0000 7fef96d9d700 1 --2- 172.21.15.103:0/3442031977 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef78004db0 0x7fef7800b720 secure :-1 s=READY pgs=1051 cs=0 l=1 rx=0x7fef780054a0 tx=0x7fef9000bf70).ready entity=mon.1 client_cookie=6c0395d98eb95469 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:15.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.652+0000 7fef96d9d700 1 --2- 172.21.15.103:0/3442031977 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef78004db0 0x7fef7800b720 secure :-1 s=THROTTLE_DONE pgs=1051 cs=0 l=1 rx=0x7fef780054a0 tx=0x7fef9000bf70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:15.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.652+0000 7fef96d9d700 1 --2- 172.21.15.103:0/3442031977 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef78004db0 0x7fef7800b720 secure :-1 s=THROTTLE_DONE pgs=1051 cs=0 l=1 rx=0x7fef780054a0 tx=0x7fef9000bf70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:15.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.652+0000 7fef9559a700 1 -- 172.21.15.103:0/3442031977 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef90011c30 con 0x7fef78004db0 2020-04-22T14:12:15.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.652+0000 7fef96d9d700 1 --2- 172.21.15.103:0/3442031977 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef78004db0 0x7fef7800b720 secure :-1 s=THROTTLE_DONE pgs=1051 cs=0 l=1 rx=0x7fef780054a0 tx=0x7fef9000bf70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:15.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.652+0000 7fef9559a700 1 -- 172.21.15.103:0/3442031977 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef90011d90 con 0x7fef78004db0 2020-04-22T14:12:15.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.652+0000 7fef9559a700 1 -- 172.21.15.103:0/3442031977 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef900058b0 con 0x7fef78004db0 2020-04-22T14:12:15.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.652+0000 7fef9ccf6700 1 -- 172.21.15.103:0/3442031977 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef78004db0 msgr2=0x7fef7800b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:15.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.652+0000 7fef9ccf6700 1 --2- 172.21.15.103:0/3442031977 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef78004db0 0x7fef7800b720 secure :-1 s=READY pgs=1051 cs=0 l=1 rx=0x7fef780054a0 tx=0x7fef9000bf70).stop 2020-04-22T14:12:15.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.653+0000 7fef9ccf6700 1 -- 172.21.15.103:0/3442031977 shutdown_connections 2020-04-22T14:12:15.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.653+0000 7fef9ccf6700 1 --2- 172.21.15.103:0/3442031977 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef78004db0 0x7fef7800b720 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:15.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.653+0000 7fef9ccf6700 1 -- 172.21.15.103:0/3442031977 >> 172.21.15.103:0/3442031977 conn(0x7fef9805ad30 msgr2=0x7fef9805b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:15.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.653+0000 7fef9ccf6700 1 -- 172.21.15.103:0/3442031977 shutdown_connections 2020-04-22T14:12:15.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.653+0000 7fef9ccf6700 1 -- 172.21.15.103:0/3442031977 wait complete. 2020-04-22T14:12:15.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.654+0000 7fef9ccf6700 1 Processor -- start 2020-04-22T14:12:15.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.654+0000 7fef9ccf6700 1 -- start start 2020-04-22T14:12:15.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.655+0000 7fef9ccf6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fef78004db0 0x7fef98157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:15.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.655+0000 7fef9ccf6700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fef980bbee0 0x7fef980b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:15.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.655+0000 7fef9ccf6700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef980bc340 con 0x7fef9812e310 2020-04-22T14:12:15.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.655+0000 7fef9ccf6700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef980b07f0 con 0x7fef980bbee0 2020-04-22T14:12:15.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.655+0000 7fef9ccf6700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef980b0a90 con 0x7fef78004db0 2020-04-22T14:12:15.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.655+0000 7fef95d9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fef980bbee0 0x7fef980b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:15.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.655+0000 7fef95d9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fef980bbee0 0x7fef980b00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52600/0 (socket says 172.21.15.103:52600) 2020-04-22T14:12:15.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.655+0000 7fef95d9b700 1 -- 172.21.15.103:0/1926307963 learned_addr learned my addr 172.21.15.103:0/1926307963 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:15.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.655+0000 7fef96d9d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fef9812e310 0x7fef9812e780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44792/0 (socket says 172.21.15.103:44792) 2020-04-22T14:12:15.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.655+0000 7fef9659c700 1 --2- 172.21.15.103:0/1926307963 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fef78004db0 0x7fef98157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:15.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.655+0000 7fef95d9b700 1 -- 172.21.15.103:0/1926307963 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fef78004db0 msgr2=0x7fef98157060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:15.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.655+0000 7fef95d9b700 1 --2- 172.21.15.103:0/1926307963 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fef78004db0 0x7fef98157060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:15.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.655+0000 7fef95d9b700 1 -- 172.21.15.103:0/1926307963 >> v1:172.21.15.103:6789/0 conn(0x7fef9812e310 legacy=0x7fef9812e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:15.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.655+0000 7fef95d9b700 1 -- 172.21.15.103:0/1926307963 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef980b0d30 con 0x7fef980bbee0 2020-04-22T14:12:15.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.655+0000 7fef8f7fe700 1 -- 172.21.15.103:0/1926307963 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1672363938 0 0) 0x7fef78003230 con 0x7fef9812e310 2020-04-22T14:12:15.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.655+0000 7fef9659c700 1 --2- 172.21.15.103:0/1926307963 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fef78004db0 0x7fef98157060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:12:15.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.655+0000 7fef95d9b700 1 --2- 172.21.15.103:0/1926307963 >> v2:172.21.15.103:3300/0 conn(0x7fef980bbee0 0x7fef980b00e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fef980b4ba0 tx=0x7fef80010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:15.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.655+0000 7fef95d9b700 1 --2- 172.21.15.103:0/1926307963 >> v2:172.21.15.103:3300/0 conn(0x7fef980bbee0 0x7fef980b00e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fef980b4ba0 tx=0x7fef80010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:15.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.655+0000 7fef95d9b700 1 --2- 172.21.15.103:0/1926307963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef980bbee0 0x7fef980b00e0 secure :-1 s=READY pgs=1053 cs=0 l=1 rx=0x7fef980b4ba0 tx=0x7fef80010ba0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:15.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.655+0000 7fef95d9b700 1 --2- 172.21.15.103:0/1926307963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef980bbee0 0x7fef980b00e0 secure :-1 s=THROTTLE_DONE pgs=1053 cs=0 l=1 rx=0x7fef980b4ba0 tx=0x7fef80010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:15.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.655+0000 7fef8f7fe700 1 -- 172.21.15.103:0/1926307963 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef8000c840 con 0x7fef980bbee0 2020-04-22T14:12:15.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.655+0000 7fef95d9b700 1 --2- 172.21.15.103:0/1926307963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef980bbee0 0x7fef980b00e0 secure :-1 s=THROTTLE_DONE pgs=1053 cs=0 l=1 rx=0x7fef980b4ba0 tx=0x7fef80010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:15.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.655+0000 7fef95d9b700 1 --2- 172.21.15.103:0/1926307963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef980bbee0 0x7fef980b00e0 secure :-1 s=THROTTLE_DONE pgs=1053 cs=0 l=1 rx=0x7fef980b4ba0 tx=0x7fef80010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:15.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.655+0000 7fef8f7fe700 1 -- 172.21.15.103:0/1926307963 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8000c9a0 con 0x7fef980bbee0 2020-04-22T14:12:15.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.655+0000 7fef9ccf6700 1 -- 172.21.15.103:0/1926307963 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef980b0540 con 0x7fef980bbee0 2020-04-22T14:12:15.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.655+0000 7fef8f7fe700 1 -- 172.21.15.103:0/1926307963 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef8000cd40 con 0x7fef980bbee0 2020-04-22T14:12:15.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.655+0000 7fef9ccf6700 1 -- 172.21.15.103:0/1926307963 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef980ac740 con 0x7fef980bbee0 2020-04-22T14:12:15.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.656+0000 7fef95d9b700 1 --2- 172.21.15.103:0/1926307963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef980bbee0 0x7fef980b00e0 secure :-1 s=THROTTLE_DONE pgs=1053 cs=0 l=1 rx=0x7fef980b4ba0 tx=0x7fef80010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:15.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.656+0000 7fef8f7fe700 1 -- 172.21.15.103:0/1926307963 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fef800064e0 con 0x7fef980bbee0 2020-04-22T14:12:15.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.656+0000 7fef95d9b700 1 --2- 172.21.15.103:0/1926307963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef980bbee0 0x7fef980b00e0 secure :-1 s=THROTTLE_DONE pgs=1053 cs=0 l=1 rx=0x7fef980b4ba0 tx=0x7fef80010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:15.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.657+0000 7fef9ccf6700 1 -- 172.21.15.103:0/1926307963 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef98056c90 con 0x7fef980bbee0 2020-04-22T14:12:15.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.657+0000 7fef8f7fe700 1 --2- 172.21.15.103:0/1926307963 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fef7c04d8f0 0x7fef7c04fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:15.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.657+0000 7fef8f7fe700 1 -- 172.21.15.103:0/1926307963 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fef80061260 con 0x7fef980bbee0 2020-04-22T14:12:15.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.657+0000 7fef9659c700 1 --2- 172.21.15.103:0/1926307963 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fef7c04d8f0 0x7fef7c04fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:15.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.657+0000 7fef9659c700 1 --2- 172.21.15.103:0/1926307963 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fef7c04d8f0 0x7fef7c04fdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fef88001760 tx=0x7fef980b9e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:15.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.657+0000 7fef9659c700 1 --2- 172.21.15.103:0/1926307963 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fef7c04d8f0 0x7fef7c04fdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fef88001760 tx=0x7fef980b9e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:15.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.657+0000 7fef9659c700 1 --2- 172.21.15.103:0/1926307963 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fef7c04d8f0 0x7fef7c04fdb0 secure :-1 s=READY pgs=391 cs=0 l=1 rx=0x7fef88001760 tx=0x7fef980b9e00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:15.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.661+0000 7fef95d9b700 1 --2- 172.21.15.103:0/1926307963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef980bbee0 0x7fef980b00e0 secure :-1 s=THROTTLE_DONE pgs=1053 cs=0 l=1 rx=0x7fef980b4ba0 tx=0x7fef80010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:15.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.661+0000 7fef8f7fe700 1 -- 172.21.15.103:0/1926307963 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fef8003c5e0 con 0x7fef980bbee0 2020-04-22T14:12:15.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.806+0000 7fef9ccf6700 1 -- 172.21.15.103:0/1926307963 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fef980b39e0 con 0x7fef980bbee0 2020-04-22T14:12:15.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.806+0000 7fef95d9b700 1 --2- 172.21.15.103:0/1926307963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef980bbee0 0x7fef980b00e0 secure :-1 s=THROTTLE_DONE pgs=1053 cs=0 l=1 rx=0x7fef980b4ba0 tx=0x7fef80010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:15.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.806+0000 7fef8f7fe700 1 -- 172.21.15.103:0/1926307963 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v73) v1 ==== 110+0+10 (secure 0 0 0) 0x7fef8003fc00 con 0x7fef980bbee0 2020-04-22T14:12:15.810 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:12:15.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.808+0000 7fef9ccf6700 1 -- 172.21.15.103:0/1926307963 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fef7c04d8f0 msgr2=0x7fef7c04fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:15.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.808+0000 7fef9ccf6700 1 --2- 172.21.15.103:0/1926307963 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fef7c04d8f0 0x7fef7c04fdb0 secure :-1 s=READY pgs=391 cs=0 l=1 rx=0x7fef88001760 tx=0x7fef980b9e00).stop 2020-04-22T14:12:15.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.808+0000 7fef9ccf6700 1 -- 172.21.15.103:0/1926307963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef980bbee0 msgr2=0x7fef980b00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:15.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.808+0000 7fef9ccf6700 1 --2- 172.21.15.103:0/1926307963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef980bbee0 0x7fef980b00e0 secure :-1 s=READY pgs=1053 cs=0 l=1 rx=0x7fef980b4ba0 tx=0x7fef80010ba0).stop 2020-04-22T14:12:15.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.808+0000 7fef9ccf6700 1 -- 172.21.15.103:0/1926307963 shutdown_connections 2020-04-22T14:12:15.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.808+0000 7fef9ccf6700 1 --2- 172.21.15.103:0/1926307963 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fef7c04d8f0 0x7fef7c04fdb0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:15.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.808+0000 7fef9ccf6700 1 --2- 172.21.15.103:0/1926307963 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fef78004db0 0x7fef98157060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:15.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.808+0000 7fef9ccf6700 1 --2- 172.21.15.103:0/1926307963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef980bbee0 0x7fef980b00e0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:15.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.808+0000 7fef9ccf6700 1 -- 172.21.15.103:0/1926307963 >> 172.21.15.103:0/1926307963 conn(0x7fef9805ad30 msgr2=0x7fef980b7480 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:15.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.808+0000 7fef9ccf6700 1 -- 172.21.15.103:0/1926307963 shutdown_connections 2020-04-22T14:12:15.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.808+0000 7fef9ccf6700 1 -- 172.21.15.103:0/1926307963 wait complete. 2020-04-22T14:12:15.821 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:15.835 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:12:15.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.980+0000 7f6cd6498700 1 Processor -- start 2020-04-22T14:12:15.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.980+0000 7f6cd6498700 1 -- start start 2020-04-22T14:12:15.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.981+0000 7f6cd6498700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6cd00b9140 0x7f6cd00b4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:15.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.981+0000 7f6cd6498700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6cd00af390 0x7f6cd0061f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:15.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.981+0000 7f6cd6498700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6cd014ddb0 0x7f6cd014e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:15.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.981+0000 7f6cd6498700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cd00b49d0 con 0x7f6cd014ddb0 2020-04-22T14:12:15.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.981+0000 7f6cd6498700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cd0061830 con 0x7f6cd00b9140 2020-04-22T14:12:15.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.981+0000 7f6cd6498700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd0061ad0 con 0x7f6cd00af390 2020-04-22T14:12:15.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.981+0000 7f6ccffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6cd00b9140 0x7f6cd00b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:15.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.981+0000 7f6ccffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6cd00b9140 0x7f6cd00b4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52606/0 (socket says 172.21.15.103:52606) 2020-04-22T14:12:15.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.981+0000 7f6ccffff700 1 -- 172.21.15.103:0/2134579261 learned_addr learned my addr 172.21.15.103:0/2134579261 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:15.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.981+0000 7f6cd4a35700 1 --2- 172.21.15.103:0/2134579261 >> v2:172.21.15.86:3300/0 conn(0x7f6cd014ddb0 0x7f6cd014e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:15.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.981+0000 7f6cc7fff700 1 --2- 172.21.15.103:0/2134579261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6cd00af390 0x7f6cd0061f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:15.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.981+0000 7f6ccffff700 1 -- 172.21.15.103:0/2134579261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6cd00af390 msgr2=0x7f6cd0061f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:15.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.981+0000 7f6ccffff700 1 --2- 172.21.15.103:0/2134579261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6cd00af390 0x7f6cd0061f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:15.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.981+0000 7f6ccffff700 1 -- 172.21.15.103:0/2134579261 >> v2:172.21.15.86:3300/0 conn(0x7f6cd014ddb0 msgr2=0x7f6cd014e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:15.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.981+0000 7f6ccffff700 1 --2- 172.21.15.103:0/2134579261 >> v2:172.21.15.86:3300/0 conn(0x7f6cd014ddb0 0x7f6cd014e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:15.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.981+0000 7f6ccffff700 1 -- 172.21.15.103:0/2134579261 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd00b9520 con 0x7f6cd00b9140 2020-04-22T14:12:15.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.981+0000 7f6cc7fff700 1 --2- 172.21.15.103:0/2134579261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6cd00af390 0x7f6cd0061f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:12:15.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.981+0000 7f6ccffff700 1 --2- 172.21.15.103:0/2134579261 >> v2:172.21.15.103:3300/0 conn(0x7f6cd00b9140 0x7f6cd00b4570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6cc0002f30 tx=0x7f6cc0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:15.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.981+0000 7f6ccffff700 1 --2- 172.21.15.103:0/2134579261 >> v2:172.21.15.103:3300/0 conn(0x7f6cd00b9140 0x7f6cd00b4570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6cc0002f30 tx=0x7f6cc0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:15.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.981+0000 7f6ccffff700 1 --2- 172.21.15.103:0/2134579261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6cd00b9140 0x7f6cd00b4570 secure :-1 s=READY pgs=1054 cs=0 l=1 rx=0x7f6cc0002f30 tx=0x7f6cc0007a40).ready entity=mon.1 client_cookie=19506505f4efa15a server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:15.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.982+0000 7f6ccffff700 1 --2- 172.21.15.103:0/2134579261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6cd00b9140 0x7f6cd00b4570 secure :-1 s=THROTTLE_DONE pgs=1054 cs=0 l=1 rx=0x7f6cc0002f30 tx=0x7f6cc0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:15.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.982+0000 7f6ccf7fe700 1 -- 172.21.15.103:0/2134579261 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6cc0011670 con 0x7f6cd00b9140 2020-04-22T14:12:15.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.982+0000 7f6ccffff700 1 --2- 172.21.15.103:0/2134579261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6cd00b9140 0x7f6cd00b4570 secure :-1 s=THROTTLE_DONE pgs=1054 cs=0 l=1 rx=0x7f6cc0002f30 tx=0x7f6cc0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:15.991 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.982+0000 7f6ccffff700 1 --2- 172.21.15.103:0/2134579261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6cd00b9140 0x7f6cd00b4570 secure :-1 s=THROTTLE_DONE pgs=1054 cs=0 l=1 rx=0x7f6cc0002f30 tx=0x7f6cc0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:15.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.982+0000 7f6ccf7fe700 1 -- 172.21.15.103:0/2134579261 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc00117d0 con 0x7f6cd00b9140 2020-04-22T14:12:15.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.982+0000 7f6ccf7fe700 1 -- 172.21.15.103:0/2134579261 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6cc0011bf0 con 0x7f6cd00b9140 2020-04-22T14:12:15.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.982+0000 7f6cd6498700 1 -- 172.21.15.103:0/2134579261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6cd00b9140 msgr2=0x7f6cd00b4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:15.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.982+0000 7f6cd6498700 1 --2- 172.21.15.103:0/2134579261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6cd00b9140 0x7f6cd00b4570 secure :-1 s=READY pgs=1054 cs=0 l=1 rx=0x7f6cc0002f30 tx=0x7f6cc0007a40).stop 2020-04-22T14:12:15.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.982+0000 7f6cd6498700 1 -- 172.21.15.103:0/2134579261 shutdown_connections 2020-04-22T14:12:15.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.982+0000 7f6cd6498700 1 --2- 172.21.15.103:0/2134579261 >> v2:172.21.15.86:3300/0 conn(0x7f6cd014ddb0 0x7f6cd014e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:15.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.982+0000 7f6cd6498700 1 --2- 172.21.15.103:0/2134579261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6cd00b9140 0x7f6cd00b4570 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:15.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.982+0000 7f6cd6498700 1 --2- 172.21.15.103:0/2134579261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6cd00af390 0x7f6cd0061f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:15.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.982+0000 7f6cd6498700 1 -- 172.21.15.103:0/2134579261 >> 172.21.15.103:0/2134579261 conn(0x7f6cd005b7b0 msgr2=0x7f6cd00b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:15.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.982+0000 7f6cd6498700 1 -- 172.21.15.103:0/2134579261 shutdown_connections 2020-04-22T14:12:15.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.982+0000 7f6cd6498700 1 -- 172.21.15.103:0/2134579261 wait complete. 2020-04-22T14:12:15.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.983+0000 7f6cd6498700 1 Processor -- start 2020-04-22T14:12:15.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.983+0000 7f6cd6498700 1 -- start start 2020-04-22T14:12:15.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.984+0000 7f6cd6498700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6cd00af390 0x7f6cd00626e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:15.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.984+0000 7f6cd6498700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6cd00b9140 0x7f6cd00b0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:15.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.984+0000 7f6cd6498700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cd0149fe0 con 0x7f6cd014ddb0 2020-04-22T14:12:15.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.984+0000 7f6cd6498700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cd0062b40 con 0x7f6cd00af390 2020-04-22T14:12:16.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.984+0000 7f6cd6498700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd00b05f0 con 0x7f6cd00b9140 2020-04-22T14:12:16.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.984+0000 7f6ccffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6cd00af390 0x7f6cd00626e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:16.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.984+0000 7f6ccffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6cd00af390 0x7f6cd00626e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52612/0 (socket says 172.21.15.103:52612) 2020-04-22T14:12:16.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.984+0000 7f6ccffff700 1 -- 172.21.15.103:0/3656494011 learned_addr learned my addr 172.21.15.103:0/3656494011 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:16.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.984+0000 7f6cc7fff700 1 --2- 172.21.15.103:0/3656494011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6cd00b9140 0x7f6cd00b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:16.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.984+0000 7f6ccffff700 1 -- 172.21.15.103:0/3656494011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6cd00b9140 msgr2=0x7f6cd00b0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:16.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.984+0000 7f6ccffff700 1 --2- 172.21.15.103:0/3656494011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6cd00b9140 0x7f6cd00b0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:16.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.984+0000 7f6ccffff700 1 -- 172.21.15.103:0/3656494011 >> v1:172.21.15.103:6789/0 conn(0x7f6cd014ddb0 legacy=0x7f6cd0145f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:16.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.984+0000 7f6ccdffb700 1 -- 172.21.15.103:0/3656494011 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3085218507 0 0) 0x7f6cd0149fe0 con 0x7f6cd014ddb0 2020-04-22T14:12:16.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.984+0000 7f6ccffff700 1 -- 172.21.15.103:0/3656494011 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd0065810 con 0x7f6cd00af390 2020-04-22T14:12:16.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.984+0000 7f6ccffff700 1 --2- 172.21.15.103:0/3656494011 >> v2:172.21.15.103:3300/0 conn(0x7f6cd00af390 0x7f6cd00626e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6cc0002f30 tx=0x7f6cc0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.984+0000 7f6ccffff700 1 --2- 172.21.15.103:0/3656494011 >> v2:172.21.15.103:3300/0 conn(0x7f6cd00af390 0x7f6cd00626e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6cc0002f30 tx=0x7f6cc0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.984+0000 7f6ccffff700 1 --2- 172.21.15.103:0/3656494011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6cd00af390 0x7f6cd00626e0 secure :-1 s=READY pgs=1056 cs=0 l=1 rx=0x7f6cc0002f30 tx=0x7f6cc0007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:16.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.984+0000 7f6ccffff700 1 --2- 172.21.15.103:0/3656494011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6cd00af390 0x7f6cd00626e0 secure :-1 s=THROTTLE_DONE pgs=1056 cs=0 l=1 rx=0x7f6cc0002f30 tx=0x7f6cc0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.984+0000 7f6ccdffb700 1 -- 172.21.15.103:0/3656494011 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6cc0011e60 con 0x7f6cd00af390 2020-04-22T14:12:16.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.984+0000 7f6ccffff700 1 --2- 172.21.15.103:0/3656494011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6cd00af390 0x7f6cd00626e0 secure :-1 s=THROTTLE_DONE pgs=1056 cs=0 l=1 rx=0x7f6cc0002f30 tx=0x7f6cc0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.984+0000 7f6ccffff700 1 --2- 172.21.15.103:0/3656494011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6cd00af390 0x7f6cd00626e0 secure :-1 s=THROTTLE_DONE pgs=1056 cs=0 l=1 rx=0x7f6cc0002f30 tx=0x7f6cc0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.984+0000 7f6ccdffb700 1 -- 172.21.15.103:0/3656494011 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc0007170 con 0x7f6cd00af390 2020-04-22T14:12:16.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.984+0000 7f6cd6498700 1 -- 172.21.15.103:0/3656494011 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cd0065ab0 con 0x7f6cd00af390 2020-04-22T14:12:16.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.984+0000 7f6ccdffb700 1 -- 172.21.15.103:0/3656494011 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6cc00074d0 con 0x7f6cd00af390 2020-04-22T14:12:16.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.985+0000 7f6cd6498700 1 -- 172.21.15.103:0/3656494011 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cd014c240 con 0x7f6cd00af390 2020-04-22T14:12:16.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.985+0000 7f6ccffff700 1 --2- 172.21.15.103:0/3656494011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6cd00af390 0x7f6cd00626e0 secure :-1 s=THROTTLE_DONE pgs=1056 cs=0 l=1 rx=0x7f6cc0002f30 tx=0x7f6cc0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.985+0000 7f6cd6498700 1 -- 172.21.15.103:0/3656494011 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cd0056c90 con 0x7f6cd00af390 2020-04-22T14:12:16.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.985+0000 7f6ccdffb700 1 -- 172.21.15.103:0/3656494011 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f6cc00056c0 con 0x7f6cd00af390 2020-04-22T14:12:16.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.986+0000 7f6ccffff700 1 --2- 172.21.15.103:0/3656494011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6cd00af390 0x7f6cd00626e0 secure :-1 s=THROTTLE_DONE pgs=1056 cs=0 l=1 rx=0x7f6cc0002f30 tx=0x7f6cc0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.986+0000 7f6ccdffb700 1 --2- 172.21.15.103:0/3656494011 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6cb404d7e0 0x7f6cb404fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:16.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.986+0000 7f6ccdffb700 1 -- 172.21.15.103:0/3656494011 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f6cc0061ac0 con 0x7f6cd00af390 2020-04-22T14:12:16.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.986+0000 7f6cc7fff700 1 --2- 172.21.15.103:0/3656494011 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6cb404d7e0 0x7f6cb404fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:16.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.986+0000 7f6cc7fff700 1 --2- 172.21.15.103:0/3656494011 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6cb404d7e0 0x7f6cb404fca0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6cb8002f30 tx=0x7f6cb8006e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.986+0000 7f6cc7fff700 1 --2- 172.21.15.103:0/3656494011 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6cb404d7e0 0x7f6cb404fca0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6cb8002f30 tx=0x7f6cb8006e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.986+0000 7f6cc7fff700 1 --2- 172.21.15.103:0/3656494011 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6cb404d7e0 0x7f6cb404fca0 secure :-1 s=READY pgs=392 cs=0 l=1 rx=0x7f6cb8002f30 tx=0x7f6cb8006e40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:16.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.990+0000 7f6ccffff700 1 --2- 172.21.15.103:0/3656494011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6cd00af390 0x7f6cd00626e0 secure :-1 s=THROTTLE_DONE pgs=1056 cs=0 l=1 rx=0x7f6cc0002f30 tx=0x7f6cc0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:15.990+0000 7f6ccdffb700 1 -- 172.21.15.103:0/3656494011 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f6cc003cf00 con 0x7f6cd00af390 2020-04-22T14:12:16.134 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.131+0000 7f6cd6498700 1 -- 172.21.15.103:0/3656494011 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6cd006a960 con 0x7f6cd00af390 2020-04-22T14:12:16.135 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.131+0000 7f6ccffff700 1 --2- 172.21.15.103:0/3656494011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6cd00af390 0x7f6cd00626e0 secure :-1 s=THROTTLE_DONE pgs=1056 cs=0 l=1 rx=0x7f6cc0002f30 tx=0x7f6cc0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.135 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.131+0000 7f6ccdffb700 1 -- 172.21.15.103:0/3656494011 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v73) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6cc0040520 con 0x7f6cd00af390 2020-04-22T14:12:16.135 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:12:16.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.132+0000 7f6cd6498700 1 -- 172.21.15.103:0/3656494011 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6cb404d7e0 msgr2=0x7f6cb404fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:16.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.132+0000 7f6cd6498700 1 --2- 172.21.15.103:0/3656494011 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6cb404d7e0 0x7f6cb404fca0 secure :-1 s=READY pgs=392 cs=0 l=1 rx=0x7f6cb8002f30 tx=0x7f6cb8006e40).stop 2020-04-22T14:12:16.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.132+0000 7f6cd6498700 1 -- 172.21.15.103:0/3656494011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6cd00af390 msgr2=0x7f6cd00626e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:16.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.132+0000 7f6cd6498700 1 --2- 172.21.15.103:0/3656494011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6cd00af390 0x7f6cd00626e0 secure :-1 s=READY pgs=1056 cs=0 l=1 rx=0x7f6cc0002f30 tx=0x7f6cc0007a40).stop 2020-04-22T14:12:16.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.133+0000 7f6cd6498700 1 -- 172.21.15.103:0/3656494011 shutdown_connections 2020-04-22T14:12:16.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.133+0000 7f6cd6498700 1 --2- 172.21.15.103:0/3656494011 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6cb404d7e0 0x7f6cb404fca0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:16.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.133+0000 7f6cd6498700 1 --2- 172.21.15.103:0/3656494011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6cd00af390 0x7f6cd00626e0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:16.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.133+0000 7f6cd6498700 1 --2- 172.21.15.103:0/3656494011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6cd00b9140 0x7f6cd00b0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:16.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.133+0000 7f6cd6498700 1 -- 172.21.15.103:0/3656494011 >> 172.21.15.103:0/3656494011 conn(0x7f6cd005b7b0 msgr2=0x7f6cd0065f70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:16.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.133+0000 7f6cd6498700 1 -- 172.21.15.103:0/3656494011 shutdown_connections 2020-04-22T14:12:16.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.133+0000 7f6cd6498700 1 -- 172.21.15.103:0/3656494011 wait complete. 2020-04-22T14:12:16.146 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:16.160 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-04-22T14:12:16.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.303+0000 7f38f7d87700 1 Processor -- start 2020-04-22T14:12:16.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.303+0000 7f38f7d87700 1 -- start start 2020-04-22T14:12:16.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.304+0000 7f38f7d87700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f38f0065fe0 0x7f38f01464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:16.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.304+0000 7f38f7d87700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38f0143300 con 0x7f38f012c0d0 2020-04-22T14:12:16.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.304+0000 7f38f7d87700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38f01435a0 con 0x7f38f0063e30 2020-04-22T14:12:16.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.304+0000 7f38f7d87700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38f0143840 con 0x7f38f0065fe0 2020-04-22T14:12:16.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.304+0000 7f38f5322700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f38f0065fe0 0x7f38f01464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:16.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.304+0000 7f38f6324700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f38f0063e30 0x7f38f00642c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44812/0 (socket says 172.21.15.103:44812) 2020-04-22T14:12:16.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.304+0000 7f38f6324700 1 -- 172.21.15.103:0/1429104198 learned_addr learned my addr 172.21.15.103:0/1429104198 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:16.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.304+0000 7f38f5322700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f38f0065fe0 0x7f38f01464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52620/0 (socket says 172.21.15.103:52620) 2020-04-22T14:12:16.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.304+0000 7f38f5322700 1 -- 172.21.15.103:0/1429104198 >> v1:172.21.15.103:6789/0 conn(0x7f38f0063e30 legacy=0x7f38f00642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:16.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.304+0000 7f38f5322700 1 -- 172.21.15.103:0/1429104198 >> v1:172.21.15.86:6789/0 conn(0x7f38f012c0d0 legacy=0x7f38f005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:16.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.304+0000 7f38f4b21700 1 -- 172.21.15.103:0/1429104198 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1882871895 0 0) 0x7f38f01435a0 con 0x7f38f0063e30 2020-04-22T14:12:16.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.304+0000 7f38f5322700 1 -- 172.21.15.103:0/1429104198 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f005bb50 con 0x7f38f0065fe0 2020-04-22T14:12:16.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.304+0000 7f38f5322700 1 --2- 172.21.15.103:0/1429104198 >> v2:172.21.15.103:3300/0 conn(0x7f38f0065fe0 0x7f38f01464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f38f00669a0 tx=0x7f38ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.305+0000 7f38f5322700 1 --2- 172.21.15.103:0/1429104198 >> v2:172.21.15.103:3300/0 conn(0x7f38f0065fe0 0x7f38f01464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f38f00669a0 tx=0x7f38ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.305+0000 7f38f5322700 1 --2- 172.21.15.103:0/1429104198 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38f0065fe0 0x7f38f01464e0 secure :-1 s=READY pgs=1058 cs=0 l=1 rx=0x7f38f00669a0 tx=0x7f38ec007a40).ready entity=mon.1 client_cookie=7a8fbd6bfb7ccb2e server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:16.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.305+0000 7f38f5322700 1 --2- 172.21.15.103:0/1429104198 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38f0065fe0 0x7f38f01464e0 secure :-1 s=THROTTLE_DONE pgs=1058 cs=0 l=1 rx=0x7f38f00669a0 tx=0x7f38ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.305+0000 7f38f4b21700 1 -- 172.21.15.103:0/1429104198 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38ec011430 con 0x7f38f0065fe0 2020-04-22T14:12:16.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.305+0000 7f38f5322700 1 --2- 172.21.15.103:0/1429104198 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38f0065fe0 0x7f38f01464e0 secure :-1 s=THROTTLE_DONE pgs=1058 cs=0 l=1 rx=0x7f38f00669a0 tx=0x7f38ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.305+0000 7f38f5322700 1 --2- 172.21.15.103:0/1429104198 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38f0065fe0 0x7f38f01464e0 secure :-1 s=THROTTLE_DONE pgs=1058 cs=0 l=1 rx=0x7f38f00669a0 tx=0x7f38ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.305+0000 7f38f4b21700 1 -- 172.21.15.103:0/1429104198 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38ec011590 con 0x7f38f0065fe0 2020-04-22T14:12:16.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.305+0000 7f38f4b21700 1 -- 172.21.15.103:0/1429104198 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38ec011970 con 0x7f38f0065fe0 2020-04-22T14:12:16.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.305+0000 7f38f7d87700 1 -- 172.21.15.103:0/1429104198 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38f0065fe0 msgr2=0x7f38f01464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:16.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.305+0000 7f38f7d87700 1 --2- 172.21.15.103:0/1429104198 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38f0065fe0 0x7f38f01464e0 secure :-1 s=READY pgs=1058 cs=0 l=1 rx=0x7f38f00669a0 tx=0x7f38ec007a40).stop 2020-04-22T14:12:16.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.305+0000 7f38f7d87700 1 -- 172.21.15.103:0/1429104198 shutdown_connections 2020-04-22T14:12:16.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.305+0000 7f38f7d87700 1 --2- 172.21.15.103:0/1429104198 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38f0065fe0 0x7f38f01464e0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:16.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.305+0000 7f38f7d87700 1 -- 172.21.15.103:0/1429104198 >> 172.21.15.103:0/1429104198 conn(0x7f38f00b9160 msgr2=0x7f38f005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:16.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.305+0000 7f38f7d87700 1 -- 172.21.15.103:0/1429104198 shutdown_connections 2020-04-22T14:12:16.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.305+0000 7f38f7d87700 1 -- 172.21.15.103:0/1429104198 wait complete. 2020-04-22T14:12:16.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.306+0000 7f38f7d87700 1 Processor -- start 2020-04-22T14:12:16.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.306+0000 7f38f7d87700 1 -- start start 2020-04-22T14:12:16.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.307+0000 7f38f7d87700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38f0065fe0 0x7f38f012a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:16.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.307+0000 7f38f7d87700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38f0128f90 con 0x7f38f0063e30 2020-04-22T14:12:16.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.307+0000 7f38f7d87700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38f00af290 con 0x7f38f012c0d0 2020-04-22T14:12:16.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.307+0000 7f38f7d87700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f00af420 con 0x7f38f0065fe0 2020-04-22T14:12:16.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.307+0000 7f38f6324700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f38f012c0d0 0x7f38f0125e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44818/0 (socket says 172.21.15.103:44818) 2020-04-22T14:12:16.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.307+0000 7f38f6324700 1 -- 172.21.15.103:0/958706767 learned_addr learned my addr 172.21.15.103:0/958706767 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:16.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.307+0000 7f38deffd700 1 -- 172.21.15.103:0/958706767 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2579189741 0 0) 0x7f38f00af290 con 0x7f38f012c0d0 2020-04-22T14:12:16.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.307+0000 7f38deffd700 1 -- 172.21.15.103:0/958706767 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38d0002fe0 con 0x7f38f012c0d0 2020-04-22T14:12:16.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.307+0000 7f38f5322700 1 --2- 172.21.15.103:0/958706767 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38f0065fe0 0x7f38f012a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:16.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.307+0000 7f38deffd700 1 -- 172.21.15.103:0/958706767 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3551418162 0 0) 0x7f38d0002fe0 con 0x7f38f012c0d0 2020-04-22T14:12:16.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.308+0000 7f38deffd700 1 -- 172.21.15.103:0/958706767 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f38f00af290 con 0x7f38f012c0d0 2020-04-22T14:12:16.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.308+0000 7f38deffd700 1 -- 172.21.15.103:0/958706767 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f38e8001be0 con 0x7f38f012c0d0 2020-04-22T14:12:16.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.308+0000 7f38deffd700 1 -- 172.21.15.103:0/958706767 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38f0065fe0 msgr2=0x7f38f012a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:16.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.308+0000 7f38deffd700 1 --2- 172.21.15.103:0/958706767 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38f0065fe0 0x7f38f012a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:16.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.308+0000 7f38deffd700 1 -- 172.21.15.103:0/958706767 >> v1:172.21.15.103:6789/0 conn(0x7f38f012c0d0 legacy=0x7f38f0125e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:16.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.308+0000 7f38deffd700 1 -- 172.21.15.103:0/958706767 >> v1:172.21.15.86:6789/0 conn(0x7f38f0063e30 legacy=0x7f38f0124a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:16.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.308+0000 7f38deffd700 1 --2- 172.21.15.103:0/958706767 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38d00049b0 0x7f38d0004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:16.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.308+0000 7f38deffd700 1 --2- 172.21.15.103:0/958706767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38d0005240 0x7f38d0003960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:16.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.308+0000 7f38deffd700 1 --2- 172.21.15.103:0/958706767 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38f0065fe0 0x7f38d0003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:16.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.308+0000 7f38deffd700 1 -- 172.21.15.103:0/958706767 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f00af420 con 0x7f38d00049b0 2020-04-22T14:12:16.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.308+0000 7f38deffd700 1 -- 172.21.15.103:0/958706767 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d00043a0 con 0x7f38d0005240 2020-04-22T14:12:16.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.308+0000 7f38deffd700 1 -- 172.21.15.103:0/958706767 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d0004560 con 0x7f38f0065fe0 2020-04-22T14:12:16.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.308+0000 7f38f5322700 1 --2- 172.21.15.103:0/958706767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38d0005240 0x7f38d0003960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:16.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.308+0000 7f38f6324700 1 --2- 172.21.15.103:0/958706767 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38f0065fe0 0x7f38d0003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:16.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.308+0000 7f38f5b23700 1 --2- 172.21.15.103:0/958706767 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38d00049b0 0x7f38d0004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:16.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.308+0000 7f38f5322700 1 -- 172.21.15.103:0/958706767 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38f0065fe0 msgr2=0x7f38d0003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:16.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.308+0000 7f38f5322700 1 --2- 172.21.15.103:0/958706767 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38f0065fe0 0x7f38d0003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:16.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.308+0000 7f38f5322700 1 -- 172.21.15.103:0/958706767 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38d00049b0 msgr2=0x7f38d0004d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:16.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.308+0000 7f38f5322700 1 --2- 172.21.15.103:0/958706767 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38d00049b0 0x7f38d0004d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:16.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.308+0000 7f38f5322700 1 -- 172.21.15.103:0/958706767 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f0154d70 con 0x7f38d0005240 2020-04-22T14:12:16.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.308+0000 7f38f7d87700 1 -- 172.21.15.103:0/958706767 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38f0125190 con 0x7f38d0005240 2020-04-22T14:12:16.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.308+0000 7f38f6324700 1 --2- 172.21.15.103:0/958706767 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38f0065fe0 0x7f38d0003ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:12:16.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.308+0000 7f38f5322700 1 --2- 172.21.15.103:0/958706767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38d0005240 0x7f38d0003960 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f38f00669a0 tx=0x7f38ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.308+0000 7f38f7d87700 1 -- 172.21.15.103:0/958706767 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38f0128d20 con 0x7f38d0005240 2020-04-22T14:12:16.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.308+0000 7f38f5322700 1 --2- 172.21.15.103:0/958706767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38d0005240 0x7f38d0003960 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f38f00669a0 tx=0x7f38ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.308+0000 7f38f5322700 1 --2- 172.21.15.103:0/958706767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38d0005240 0x7f38d0003960 secure :-1 s=READY pgs=1060 cs=0 l=1 rx=0x7f38f00669a0 tx=0x7f38ec007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:16.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.308+0000 7f38f5322700 1 --2- 172.21.15.103:0/958706767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38d0005240 0x7f38d0003960 secure :-1 s=THROTTLE_DONE pgs=1060 cs=0 l=1 rx=0x7f38f00669a0 tx=0x7f38ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.308+0000 7f38deffd700 1 -- 172.21.15.103:0/958706767 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38ec007360 con 0x7f38d0005240 2020-04-22T14:12:16.324 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.308+0000 7f38f5322700 1 --2- 172.21.15.103:0/958706767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38d0005240 0x7f38d0003960 secure :-1 s=THROTTLE_DONE pgs=1060 cs=0 l=1 rx=0x7f38f00669a0 tx=0x7f38ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.324 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.308+0000 7f38f5322700 1 --2- 172.21.15.103:0/958706767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38d0005240 0x7f38d0003960 secure :-1 s=THROTTLE_DONE pgs=1060 cs=0 l=1 rx=0x7f38f00669a0 tx=0x7f38ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.324 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.308+0000 7f38deffd700 1 -- 172.21.15.103:0/958706767 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38ec0074c0 con 0x7f38d0005240 2020-04-22T14:12:16.324 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.308+0000 7f38deffd700 1 -- 172.21.15.103:0/958706767 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38ec0058b0 con 0x7f38d0005240 2020-04-22T14:12:16.324 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.309+0000 7f38f5322700 1 --2- 172.21.15.103:0/958706767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38d0005240 0x7f38d0003960 secure :-1 s=THROTTLE_DONE pgs=1060 cs=0 l=1 rx=0x7f38f00669a0 tx=0x7f38ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.324 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.309+0000 7f38f7d87700 1 -- 172.21.15.103:0/958706767 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38f00aec30 con 0x7f38d0005240 2020-04-22T14:12:16.324 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.309+0000 7f38deffd700 1 -- 172.21.15.103:0/958706767 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f38ec005a10 con 0x7f38d0005240 2020-04-22T14:12:16.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.309+0000 7f38f5322700 1 --2- 172.21.15.103:0/958706767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38d0005240 0x7f38d0003960 secure :-1 s=THROTTLE_DONE pgs=1060 cs=0 l=1 rx=0x7f38f00669a0 tx=0x7f38ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.309+0000 7f38deffd700 1 --2- 172.21.15.103:0/958706767 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f38d00559f0 0x7f38d0057eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:16.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.310+0000 7f38deffd700 1 -- 172.21.15.103:0/958706767 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f38ec061e10 con 0x7f38d0005240 2020-04-22T14:12:16.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.310+0000 7f38f5b23700 1 --2- 172.21.15.103:0/958706767 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f38d00559f0 0x7f38d0057eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:16.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.310+0000 7f38f5b23700 1 --2- 172.21.15.103:0/958706767 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f38d00559f0 0x7f38d0057eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f38e0000e90 tx=0x7f38e0001870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.310+0000 7f38f5b23700 1 --2- 172.21.15.103:0/958706767 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f38d00559f0 0x7f38d0057eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f38e0000e90 tx=0x7f38e0001870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.310+0000 7f38f5b23700 1 --2- 172.21.15.103:0/958706767 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f38d00559f0 0x7f38d0057eb0 secure :-1 s=READY pgs=393 cs=0 l=1 rx=0x7f38e0000e90 tx=0x7f38e0001870).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:16.326 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.314+0000 7f38f5322700 1 --2- 172.21.15.103:0/958706767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38d0005240 0x7f38d0003960 secure :-1 s=THROTTLE_DONE pgs=1060 cs=0 l=1 rx=0x7f38f00669a0 tx=0x7f38ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.326 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.314+0000 7f38deffd700 1 -- 172.21.15.103:0/958706767 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f38ec03d310 con 0x7f38d0005240 2020-04-22T14:12:16.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.458+0000 7f38f7d87700 1 -- 172.21.15.103:0/958706767 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f38f0056c90 con 0x7f38d0005240 2020-04-22T14:12:16.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.458+0000 7f38f5322700 1 --2- 172.21.15.103:0/958706767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38d0005240 0x7f38d0003960 secure :-1 s=THROTTLE_DONE pgs=1060 cs=0 l=1 rx=0x7f38f00669a0 tx=0x7f38ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.458+0000 7f38deffd700 1 -- 172.21.15.103:0/958706767 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v73) v1 ==== 84+0+143 (secure 0 0 0) 0x7f38ec040930 con 0x7f38d0005240 2020-04-22T14:12:16.462 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:12:16.462 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2020-04-22T14:12:16.462 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:16.462 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 1, 2020-04-22T14:12:16.462 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": "device_health_metrics" 2020-04-22T14:12:16.462 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:16.463 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:12:16.463 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 2, 2020-04-22T14:12:16.463 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": "rbd" 2020-04-22T14:12:16.463 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:16.463 INFO:teuthology.orchestra.run.smithi103.stdout:] 2020-04-22T14:12:16.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.459+0000 7f38f7d87700 1 -- 172.21.15.103:0/958706767 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f38d00559f0 msgr2=0x7f38d0057eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:16.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.459+0000 7f38f7d87700 1 --2- 172.21.15.103:0/958706767 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f38d00559f0 0x7f38d0057eb0 secure :-1 s=READY pgs=393 cs=0 l=1 rx=0x7f38e0000e90 tx=0x7f38e0001870).stop 2020-04-22T14:12:16.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.459+0000 7f38f7d87700 1 -- 172.21.15.103:0/958706767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38d0005240 msgr2=0x7f38d0003960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:16.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.459+0000 7f38f7d87700 1 --2- 172.21.15.103:0/958706767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38d0005240 0x7f38d0003960 secure :-1 s=READY pgs=1060 cs=0 l=1 rx=0x7f38f00669a0 tx=0x7f38ec007a40).stop 2020-04-22T14:12:16.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.459+0000 7f38f6324700 1 -- 172.21.15.103:0/958706767 reap_dead start 2020-04-22T14:12:16.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.460+0000 7f38f6324700 1 -- 172.21.15.103:0/958706767 reap_dead start 2020-04-22T14:12:16.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.460+0000 7f38f7d87700 1 -- 172.21.15.103:0/958706767 shutdown_connections 2020-04-22T14:12:16.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.460+0000 7f38f7d87700 1 -- 172.21.15.103:0/958706767 >> 172.21.15.103:0/958706767 conn(0x7f38f00b9160 msgr2=0x7f38f00615e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:16.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.460+0000 7f38f7d87700 1 -- 172.21.15.103:0/958706767 shutdown_connections 2020-04-22T14:12:16.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.460+0000 7f38f7d87700 1 -- 172.21.15.103:0/958706767 wait complete. 2020-04-22T14:12:16.473 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-04-22T14:12:16.473 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:16.486 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-04-22T14:12:16.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.632+0000 7fc6c8099700 1 Processor -- start 2020-04-22T14:12:16.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.632+0000 7fc6c8099700 1 -- start start 2020-04-22T14:12:16.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.633+0000 7fc6c8099700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc6c0061a30 0x7fc6c00b4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:16.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.633+0000 7fc6c8099700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc6c00acb10 0x7fc6c00ae920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:16.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.633+0000 7fc6c8099700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c0060250 con 0x7fc6c00aed80 2020-04-22T14:12:16.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.633+0000 7fc6c8099700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6c00623c0 con 0x7fc6c0061a30 2020-04-22T14:12:16.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.633+0000 7fc6c8099700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6c0062660 con 0x7fc6c00acb10 2020-04-22T14:12:16.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.633+0000 7fc6c5634700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc6c00acb10 0x7fc6c00ae920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:16.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.633+0000 7fc6c5634700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc6c00acb10 0x7fc6c00ae920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52640/0 (socket says 172.21.15.103:52640) 2020-04-22T14:12:16.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.633+0000 7fc6c6636700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc6c00aed80 0x7fc6c00b3050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44832/0 (socket says 172.21.15.103:44832) 2020-04-22T14:12:16.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.633+0000 7fc6c5634700 1 -- 172.21.15.103:0/1584332802 learned_addr learned my addr 172.21.15.103:0/1584332802 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:16.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.633+0000 7fc6c5e35700 1 --2- 172.21.15.103:0/1584332802 >> v2:172.21.15.86:3300/0 conn(0x7fc6c0061a30 0x7fc6c00b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:16.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.633+0000 7fc6c5634700 1 -- 172.21.15.103:0/1584332802 >> v2:172.21.15.86:3300/0 conn(0x7fc6c0061a30 msgr2=0x7fc6c00b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:16.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.633+0000 7fc6c5634700 1 --2- 172.21.15.103:0/1584332802 >> v2:172.21.15.86:3300/0 conn(0x7fc6c0061a30 0x7fc6c00b4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:16.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.633+0000 7fc6c5634700 1 -- 172.21.15.103:0/1584332802 >> v1:172.21.15.103:6789/0 conn(0x7fc6c00aed80 legacy=0x7fc6c00b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:16.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.633+0000 7fc6c4e33700 1 -- 172.21.15.103:0/1584332802 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1765460330 0 0) 0x7fc6c0060250 con 0x7fc6c00aed80 2020-04-22T14:12:16.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.633+0000 7fc6c5634700 1 -- 172.21.15.103:0/1584332802 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c00acfc0 con 0x7fc6c00acb10 2020-04-22T14:12:16.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.633+0000 7fc6c5634700 1 --2- 172.21.15.103:0/1584332802 >> v2:172.21.15.103:3300/0 conn(0x7fc6c00acb10 0x7fc6c00ae920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc6bc002f30 tx=0x7fc6bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.633+0000 7fc6c5634700 1 --2- 172.21.15.103:0/1584332802 >> v2:172.21.15.103:3300/0 conn(0x7fc6c00acb10 0x7fc6c00ae920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc6bc002f30 tx=0x7fc6bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.633+0000 7fc6c5634700 1 --2- 172.21.15.103:0/1584332802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6c00acb10 0x7fc6c00ae920 secure :-1 s=READY pgs=1062 cs=0 l=1 rx=0x7fc6bc002f30 tx=0x7fc6bc007a40).ready entity=mon.1 client_cookie=6a27c58609945fde server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:16.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.634+0000 7fc6c5634700 1 --2- 172.21.15.103:0/1584332802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6c00acb10 0x7fc6c00ae920 secure :-1 s=THROTTLE_DONE pgs=1062 cs=0 l=1 rx=0x7fc6bc002f30 tx=0x7fc6bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.634+0000 7fc6c4e33700 1 -- 172.21.15.103:0/1584332802 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6bc011670 con 0x7fc6c00acb10 2020-04-22T14:12:16.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.634+0000 7fc6c5634700 1 --2- 172.21.15.103:0/1584332802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6c00acb10 0x7fc6c00ae920 secure :-1 s=THROTTLE_DONE pgs=1062 cs=0 l=1 rx=0x7fc6bc002f30 tx=0x7fc6bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.634+0000 7fc6c4e33700 1 -- 172.21.15.103:0/1584332802 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6bc0117d0 con 0x7fc6c00acb10 2020-04-22T14:12:16.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.634+0000 7fc6c5634700 1 --2- 172.21.15.103:0/1584332802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6c00acb10 0x7fc6c00ae920 secure :-1 s=THROTTLE_DONE pgs=1062 cs=0 l=1 rx=0x7fc6bc002f30 tx=0x7fc6bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.634+0000 7fc6c8099700 1 -- 172.21.15.103:0/1584332802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6c00acb10 msgr2=0x7fc6c00ae920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:16.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.634+0000 7fc6c4e33700 1 -- 172.21.15.103:0/1584332802 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6bc011bb0 con 0x7fc6c00acb10 2020-04-22T14:12:16.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.634+0000 7fc6c8099700 1 --2- 172.21.15.103:0/1584332802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6c00acb10 0x7fc6c00ae920 secure :-1 s=READY pgs=1062 cs=0 l=1 rx=0x7fc6bc002f30 tx=0x7fc6bc007a40).stop 2020-04-22T14:12:16.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.634+0000 7fc6c8099700 1 -- 172.21.15.103:0/1584332802 shutdown_connections 2020-04-22T14:12:16.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.634+0000 7fc6c8099700 1 --2- 172.21.15.103:0/1584332802 >> v2:172.21.15.86:3300/0 conn(0x7fc6c0061a30 0x7fc6c00b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:16.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.634+0000 7fc6c8099700 1 --2- 172.21.15.103:0/1584332802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6c00acb10 0x7fc6c00ae920 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:16.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.634+0000 7fc6c8099700 1 -- 172.21.15.103:0/1584332802 >> 172.21.15.103:0/1584332802 conn(0x7fc6c005b7b0 msgr2=0x7fc6c00b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:16.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.634+0000 7fc6c8099700 1 -- 172.21.15.103:0/1584332802 shutdown_connections 2020-04-22T14:12:16.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.634+0000 7fc6c8099700 1 -- 172.21.15.103:0/1584332802 wait complete. 2020-04-22T14:12:16.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.635+0000 7fc6c8099700 1 Processor -- start 2020-04-22T14:12:16.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.636+0000 7fc6c8099700 1 -- start start 2020-04-22T14:12:16.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.637+0000 7fc6c8099700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6c00aed80 0x7fc6c0065160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:16.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.637+0000 7fc6c8099700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c0066160 con 0x7fc6c0061a30 2020-04-22T14:12:16.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.637+0000 7fc6c8099700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c0066400 con 0x7fc6c00acb10 2020-04-22T14:12:16.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.637+0000 7fc6c8099700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c0065de0 con 0x7fc6c00aed80 2020-04-22T14:12:16.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.637+0000 7fc6c5634700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc6c00acb10 0x7fc6c0154fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44836/0 (socket says 172.21.15.103:44836) 2020-04-22T14:12:16.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.637+0000 7fc6c5634700 1 -- 172.21.15.103:0/1114376261 learned_addr learned my addr 172.21.15.103:0/1114376261 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:16.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.637+0000 7fc6c6636700 1 --2- 172.21.15.103:0/1114376261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6c00aed80 0x7fc6c0065160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:16.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.637+0000 7fc6b2ffd700 1 -- 172.21.15.103:0/1114376261 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1189644385 0 0) 0x7fc6c0066400 con 0x7fc6c00acb10 2020-04-22T14:12:16.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.637+0000 7fc6b2ffd700 1 -- 172.21.15.103:0/1114376261 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6a0002fe0 con 0x7fc6c00acb10 2020-04-22T14:12:16.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.637+0000 7fc6b2ffd700 1 -- 172.21.15.103:0/1114376261 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1810545871 0 0) 0x7fc6c0066160 con 0x7fc6c0061a30 2020-04-22T14:12:16.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.637+0000 7fc6b2ffd700 1 -- 172.21.15.103:0/1114376261 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6c0066400 con 0x7fc6c0061a30 2020-04-22T14:12:16.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.637+0000 7fc6b2ffd700 1 -- 172.21.15.103:0/1114376261 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1332119248 0 0) 0x7fc6a0002fe0 con 0x7fc6c00acb10 2020-04-22T14:12:16.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.637+0000 7fc6b2ffd700 1 -- 172.21.15.103:0/1114376261 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc6c0066160 con 0x7fc6c00acb10 2020-04-22T14:12:16.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.637+0000 7fc6b2ffd700 1 -- 172.21.15.103:0/1114376261 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fc6bc011e30 con 0x7fc6c00acb10 2020-04-22T14:12:16.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.637+0000 7fc6b2ffd700 1 -- 172.21.15.103:0/1114376261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6c00aed80 msgr2=0x7fc6c0065160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:16.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.637+0000 7fc6b2ffd700 1 --2- 172.21.15.103:0/1114376261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6c00aed80 0x7fc6c0065160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:16.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.637+0000 7fc6b2ffd700 1 -- 172.21.15.103:0/1114376261 >> v1:172.21.15.103:6789/0 conn(0x7fc6c00acb10 legacy=0x7fc6c0154fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:16.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.637+0000 7fc6b2ffd700 1 -- 172.21.15.103:0/1114376261 >> v1:172.21.15.86:6789/0 conn(0x7fc6c0061a30 legacy=0x7fc6c013d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:16.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.637+0000 7fc6b2ffd700 1 --2- 172.21.15.103:0/1114376261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6a0004b20 0x7fc6a0004f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:16.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.637+0000 7fc6b2ffd700 1 --2- 172.21.15.103:0/1114376261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6a0003ab0 0x7fc6a0003f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:16.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.637+0000 7fc6b2ffd700 1 --2- 172.21.15.103:0/1114376261 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6a0004370 0x7fc6a000fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:16.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.637+0000 7fc6b2ffd700 1 -- 172.21.15.103:0/1114376261 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c0065de0 con 0x7fc6a0004370 2020-04-22T14:12:16.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.637+0000 7fc6b2ffd700 1 -- 172.21.15.103:0/1114376261 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a00048b0 con 0x7fc6a0003ab0 2020-04-22T14:12:16.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.637+0000 7fc6b2ffd700 1 -- 172.21.15.103:0/1114376261 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a000ffc0 con 0x7fc6a0004b20 2020-04-22T14:12:16.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.637+0000 7fc6c6636700 1 --2- 172.21.15.103:0/1114376261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6c00aed80 0x7fc6c0065160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:12:16.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.637+0000 7fc6c5634700 1 --2- 172.21.15.103:0/1114376261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6a0003ab0 0x7fc6a0003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:16.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.637+0000 7fc6c5e35700 1 --2- 172.21.15.103:0/1114376261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6a0004b20 0x7fc6a0004f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:16.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.638+0000 7fc6c6636700 1 --2- 172.21.15.103:0/1114376261 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6a0004370 0x7fc6a000fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:16.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.638+0000 7fc6c5634700 1 -- 172.21.15.103:0/1114376261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6a0004b20 msgr2=0x7fc6a0004f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:16.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.638+0000 7fc6c5634700 1 --2- 172.21.15.103:0/1114376261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6a0004b20 0x7fc6a0004f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:16.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.638+0000 7fc6c5634700 1 -- 172.21.15.103:0/1114376261 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6a0004370 msgr2=0x7fc6a000fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:16.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.638+0000 7fc6c5634700 1 --2- 172.21.15.103:0/1114376261 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6a0004370 0x7fc6a000fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:16.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.638+0000 7fc6c5634700 1 -- 172.21.15.103:0/1114376261 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a0002fe0 con 0x7fc6a0003ab0 2020-04-22T14:12:16.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.638+0000 7fc6c8099700 1 -- 172.21.15.103:0/1114376261 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c0065160 con 0x7fc6a0003ab0 2020-04-22T14:12:16.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.638+0000 7fc6c5e35700 1 --2- 172.21.15.103:0/1114376261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6a0004b20 0x7fc6a0004f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:12:16.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.638+0000 7fc6c6636700 1 --2- 172.21.15.103:0/1114376261 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6a0004370 0x7fc6a000fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:12:16.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.638+0000 7fc6c5634700 1 --2- 172.21.15.103:0/1114376261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6a0003ab0 0x7fc6a0003f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc6bc010250 tx=0x7fc6bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.638+0000 7fc6c8099700 1 -- 172.21.15.103:0/1114376261 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c00b1f40 con 0x7fc6a0003ab0 2020-04-22T14:12:16.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.638+0000 7fc6c5634700 1 --2- 172.21.15.103:0/1114376261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6a0003ab0 0x7fc6a0003f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc6bc010250 tx=0x7fc6bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.638+0000 7fc6c5634700 1 --2- 172.21.15.103:0/1114376261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6a0003ab0 0x7fc6a0003f10 secure :-1 s=READY pgs=1064 cs=0 l=1 rx=0x7fc6bc010250 tx=0x7fc6bc007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:16.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.638+0000 7fc6c5634700 1 --2- 172.21.15.103:0/1114376261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6a0003ab0 0x7fc6a0003f10 secure :-1 s=THROTTLE_DONE pgs=1064 cs=0 l=1 rx=0x7fc6bc010250 tx=0x7fc6bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.638+0000 7fc6c5634700 1 --2- 172.21.15.103:0/1114376261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6a0003ab0 0x7fc6a0003f10 secure :-1 s=THROTTLE_DONE pgs=1064 cs=0 l=1 rx=0x7fc6bc010250 tx=0x7fc6bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.638+0000 7fc6c5634700 1 --2- 172.21.15.103:0/1114376261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6a0003ab0 0x7fc6a0003f10 secure :-1 s=THROTTLE_DONE pgs=1064 cs=0 l=1 rx=0x7fc6bc010250 tx=0x7fc6bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.638+0000 7fc6b2ffd700 1 -- 172.21.15.103:0/1114376261 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6bc008730 con 0x7fc6a0003ab0 2020-04-22T14:12:16.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.638+0000 7fc6b2ffd700 1 -- 172.21.15.103:0/1114376261 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6bc00f900 con 0x7fc6a0003ab0 2020-04-22T14:12:16.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.638+0000 7fc6b2ffd700 1 -- 172.21.15.103:0/1114376261 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6bc00ae40 con 0x7fc6a0003ab0 2020-04-22T14:12:16.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.638+0000 7fc6c5634700 1 --2- 172.21.15.103:0/1114376261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6a0003ab0 0x7fc6a0003f10 secure :-1 s=THROTTLE_DONE pgs=1064 cs=0 l=1 rx=0x7fc6bc010250 tx=0x7fc6bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.639+0000 7fc6c8099700 1 -- 172.21.15.103:0/1114376261 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc69c003340 con 0x7fc6a0003ab0 2020-04-22T14:12:16.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.639+0000 7fc6b2ffd700 1 -- 172.21.15.103:0/1114376261 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fc6bc007360 con 0x7fc6a0003ab0 2020-04-22T14:12:16.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.639+0000 7fc6c5634700 1 --2- 172.21.15.103:0/1114376261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6a0003ab0 0x7fc6a0003f10 secure :-1 s=THROTTLE_DONE pgs=1064 cs=0 l=1 rx=0x7fc6bc010250 tx=0x7fc6bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.639+0000 7fc6b2ffd700 1 --2- 172.21.15.103:0/1114376261 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc6a005a600 0x7fc6a005cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:16.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.639+0000 7fc6b2ffd700 1 -- 172.21.15.103:0/1114376261 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fc6bc062480 con 0x7fc6a0003ab0 2020-04-22T14:12:16.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.639+0000 7fc6c5e35700 1 --2- 172.21.15.103:0/1114376261 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc6a005a600 0x7fc6a005cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:16.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.639+0000 7fc6c5e35700 1 --2- 172.21.15.103:0/1114376261 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc6a005a600 0x7fc6a005cac0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc6b8007ca0 tx=0x7fc6b8008b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.640+0000 7fc6c5e35700 1 --2- 172.21.15.103:0/1114376261 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc6a005a600 0x7fc6a005cac0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc6b8007ca0 tx=0x7fc6b8008b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.640+0000 7fc6c5e35700 1 --2- 172.21.15.103:0/1114376261 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc6a005a600 0x7fc6a005cac0 secure :-1 s=READY pgs=394 cs=0 l=1 rx=0x7fc6b8007ca0 tx=0x7fc6b8008b60).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:16.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.643+0000 7fc6c5634700 1 --2- 172.21.15.103:0/1114376261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6a0003ab0 0x7fc6a0003f10 secure :-1 s=THROTTLE_DONE pgs=1064 cs=0 l=1 rx=0x7fc6bc010250 tx=0x7fc6bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:16.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.643+0000 7fc6b2ffd700 1 -- 172.21.15.103:0/1114376261 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fc6bc03d980 con 0x7fc6a0003ab0 2020-04-22T14:12:16.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:16.784+0000 7fc6c8099700 1 -- 172.21.15.103:0/1114376261 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fc69c002200 con 0x7fc6a0003ab0 2020-04-22T14:12:17.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.471+0000 7fc6c5634700 1 --2- 172.21.15.103:0/1114376261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6a0003ab0 0x7fc6a0003f10 secure :-1 s=THROTTLE_DONE pgs=1064 cs=0 l=1 rx=0x7fc6bc010250 tx=0x7fc6bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:17.475 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.471+0000 7fc6b2ffd700 1 -- 172.21.15.103:0/1114376261 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v74) v1 ==== 133+0+0 (secure 0 0 0) 0x7fc6bc040fa0 con 0x7fc6a0003ab0 2020-04-22T14:12:17.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.473+0000 7fc6c8099700 1 -- 172.21.15.103:0/1114376261 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc6a005a600 msgr2=0x7fc6a005cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:17.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.473+0000 7fc6c8099700 1 --2- 172.21.15.103:0/1114376261 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc6a005a600 0x7fc6a005cac0 secure :-1 s=READY pgs=394 cs=0 l=1 rx=0x7fc6b8007ca0 tx=0x7fc6b8008b60).stop 2020-04-22T14:12:17.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.473+0000 7fc6c8099700 1 -- 172.21.15.103:0/1114376261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6a0003ab0 msgr2=0x7fc6a0003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:17.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.473+0000 7fc6c8099700 1 --2- 172.21.15.103:0/1114376261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6a0003ab0 0x7fc6a0003f10 secure :-1 s=READY pgs=1064 cs=0 l=1 rx=0x7fc6bc010250 tx=0x7fc6bc007a40).stop 2020-04-22T14:12:17.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.474+0000 7fc6c6636700 1 -- 172.21.15.103:0/1114376261 reap_dead start 2020-04-22T14:12:17.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.474+0000 7fc6c8099700 1 -- 172.21.15.103:0/1114376261 shutdown_connections 2020-04-22T14:12:17.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.474+0000 7fc6c8099700 1 -- 172.21.15.103:0/1114376261 >> 172.21.15.103:0/1114376261 conn(0x7fc6c005b7b0 msgr2=0x7fc6c00b3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:17.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.474+0000 7fc6c8099700 1 -- 172.21.15.103:0/1114376261 shutdown_connections 2020-04-22T14:12:17.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.474+0000 7fc6c8099700 1 -- 172.21.15.103:0/1114376261 wait complete. 2020-04-22T14:12:17.478 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' created 2020-04-22T14:12:17.489 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:17.504 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-04-22T14:12:17.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.654+0000 7faeff5d1700 1 Processor -- start 2020-04-22T14:12:17.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.654+0000 7faeff5d1700 1 -- start start 2020-04-22T14:12:17.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.655+0000 7faeff5d1700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faef8061a30 0x7faef80b4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:17.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.655+0000 7faeff5d1700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7faef80acb10 0x7faef80ae920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:17.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.655+0000 7faeff5d1700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faef8060250 con 0x7faef80aed80 2020-04-22T14:12:17.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.655+0000 7faeff5d1700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faef80b94d0 con 0x7faef80acb10 2020-04-22T14:12:17.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.655+0000 7faeff5d1700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faef80623c0 con 0x7faef8061a30 2020-04-22T14:12:17.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.655+0000 7faefcb6c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7faef80acb10 0x7faef80ae920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:17.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.655+0000 7faefdb6e700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7faef80aed80 0x7faef80b8dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44852/0 (socket says 172.21.15.103:44852) 2020-04-22T14:12:17.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.655+0000 7faefcb6c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7faef80acb10 0x7faef80ae920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52658/0 (socket says 172.21.15.103:52658) 2020-04-22T14:12:17.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.655+0000 7faefdb6e700 1 -- 172.21.15.103:0/2899486761 learned_addr learned my addr 172.21.15.103:0/2899486761 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:17.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.656+0000 7faefd36d700 1 --2- 172.21.15.103:0/2899486761 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faef8061a30 0x7faef80b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:17.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.656+0000 7faefcb6c700 1 -- 172.21.15.103:0/2899486761 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faef8061a30 msgr2=0x7faef80b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:17.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.656+0000 7faefcb6c700 1 --2- 172.21.15.103:0/2899486761 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faef8061a30 0x7faef80b4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:17.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.656+0000 7faefcb6c700 1 -- 172.21.15.103:0/2899486761 >> v1:172.21.15.103:6789/0 conn(0x7faef80aed80 legacy=0x7faef80b8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:17.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.656+0000 7faefcb6c700 1 -- 172.21.15.103:0/2899486761 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef8062660 con 0x7faef80acb10 2020-04-22T14:12:17.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.656+0000 7faee7fff700 1 -- 172.21.15.103:0/2899486761 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1060483563 0 0) 0x7faef8060250 con 0x7faef80aed80 2020-04-22T14:12:17.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.656+0000 7faefcb6c700 1 --2- 172.21.15.103:0/2899486761 >> v2:172.21.15.103:3300/0 conn(0x7faef80acb10 0x7faef80ae920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7faef4002f30 tx=0x7faef4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:17.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.656+0000 7faefcb6c700 1 --2- 172.21.15.103:0/2899486761 >> v2:172.21.15.103:3300/0 conn(0x7faef80acb10 0x7faef80ae920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7faef4002f30 tx=0x7faef4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:17.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.656+0000 7faefcb6c700 1 --2- 172.21.15.103:0/2899486761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faef80acb10 0x7faef80ae920 secure :-1 s=READY pgs=1066 cs=0 l=1 rx=0x7faef4002f30 tx=0x7faef4007a40).ready entity=mon.1 client_cookie=aaa5cd8b2c1e4769 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:17.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.656+0000 7faefcb6c700 1 --2- 172.21.15.103:0/2899486761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faef80acb10 0x7faef80ae920 secure :-1 s=THROTTLE_DONE pgs=1066 cs=0 l=1 rx=0x7faef4002f30 tx=0x7faef4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:17.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.656+0000 7faee7fff700 1 -- 172.21.15.103:0/2899486761 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faef4011470 con 0x7faef80acb10 2020-04-22T14:12:17.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.656+0000 7faefcb6c700 1 --2- 172.21.15.103:0/2899486761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faef80acb10 0x7faef80ae920 secure :-1 s=THROTTLE_DONE pgs=1066 cs=0 l=1 rx=0x7faef4002f30 tx=0x7faef4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:17.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.656+0000 7faefcb6c700 1 --2- 172.21.15.103:0/2899486761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faef80acb10 0x7faef80ae920 secure :-1 s=THROTTLE_DONE pgs=1066 cs=0 l=1 rx=0x7faef4002f30 tx=0x7faef4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:17.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.656+0000 7faee7fff700 1 -- 172.21.15.103:0/2899486761 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef4011610 con 0x7faef80acb10 2020-04-22T14:12:17.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.656+0000 7faee7fff700 1 -- 172.21.15.103:0/2899486761 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faef40119f0 con 0x7faef80acb10 2020-04-22T14:12:17.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.656+0000 7faeff5d1700 1 -- 172.21.15.103:0/2899486761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faef80acb10 msgr2=0x7faef80ae920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:17.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.656+0000 7faeff5d1700 1 --2- 172.21.15.103:0/2899486761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faef80acb10 0x7faef80ae920 secure :-1 s=READY pgs=1066 cs=0 l=1 rx=0x7faef4002f30 tx=0x7faef4007a40).stop 2020-04-22T14:12:17.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.656+0000 7faeff5d1700 1 -- 172.21.15.103:0/2899486761 shutdown_connections 2020-04-22T14:12:17.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.656+0000 7faeff5d1700 1 --2- 172.21.15.103:0/2899486761 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faef8061a30 0x7faef80b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:17.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.656+0000 7faeff5d1700 1 --2- 172.21.15.103:0/2899486761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faef80acb10 0x7faef80ae920 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:17.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.656+0000 7faeff5d1700 1 -- 172.21.15.103:0/2899486761 >> 172.21.15.103:0/2899486761 conn(0x7faef805b7b0 msgr2=0x7faef80b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:17.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.657+0000 7faeff5d1700 1 -- 172.21.15.103:0/2899486761 shutdown_connections 2020-04-22T14:12:17.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.657+0000 7faeff5d1700 1 -- 172.21.15.103:0/2899486761 wait complete. 2020-04-22T14:12:17.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.658+0000 7faeff5d1700 1 Processor -- start 2020-04-22T14:12:17.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.658+0000 7faeff5d1700 1 -- start start 2020-04-22T14:12:17.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.658+0000 7faeff5d1700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7faef8061a30 0x7faef80b1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:17.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.658+0000 7faeff5d1700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faef80acb10 0x7faef81549b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:17.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.658+0000 7faeff5d1700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7faef80aed80 0x7faef8144280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:17.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.658+0000 7faeff5d1700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faef80b1c80 con 0x7faef80aed80 2020-04-22T14:12:17.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.658+0000 7faeff5d1700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faef80b1f20 con 0x7faef8061a30 2020-04-22T14:12:17.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.658+0000 7faeff5d1700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faef80b21c0 con 0x7faef80acb10 2020-04-22T14:12:17.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.658+0000 7faefd36d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7faef8061a30 0x7faef80b1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:17.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.658+0000 7faefd36d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7faef8061a30 0x7faef80b1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52664/0 (socket says 172.21.15.103:52664) 2020-04-22T14:12:17.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.658+0000 7faefd36d700 1 -- 172.21.15.103:0/1957556913 learned_addr learned my addr 172.21.15.103:0/1957556913 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:17.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.658+0000 7faefcb6c700 1 --2- 172.21.15.103:0/1957556913 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faef80acb10 0x7faef81549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:17.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.658+0000 7faefdb6e700 1 --2- 172.21.15.103:0/1957556913 >> v2:172.21.15.86:3300/0 conn(0x7faef80aed80 0x7faef8144280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:17.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.659+0000 7faefd36d700 1 -- 172.21.15.103:0/1957556913 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faef80acb10 msgr2=0x7faef81549b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:17.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.659+0000 7faefd36d700 1 --2- 172.21.15.103:0/1957556913 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faef80acb10 0x7faef81549b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:17.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.659+0000 7faefd36d700 1 -- 172.21.15.103:0/1957556913 >> v2:172.21.15.86:3300/0 conn(0x7faef80aed80 msgr2=0x7faef8144280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:17.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.659+0000 7faefd36d700 1 --2- 172.21.15.103:0/1957556913 >> v2:172.21.15.86:3300/0 conn(0x7faef80aed80 0x7faef8144280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:17.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.659+0000 7faefd36d700 1 -- 172.21.15.103:0/1957556913 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef80b02a0 con 0x7faef8061a30 2020-04-22T14:12:17.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.659+0000 7faefcb6c700 1 --2- 172.21.15.103:0/1957556913 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faef80acb10 0x7faef81549b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:12:17.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.659+0000 7faefdb6e700 1 --2- 172.21.15.103:0/1957556913 >> v2:172.21.15.86:3300/0 conn(0x7faef80aed80 0x7faef8144280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:12:17.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.659+0000 7faefd36d700 1 --2- 172.21.15.103:0/1957556913 >> v2:172.21.15.103:3300/0 conn(0x7faef8061a30 0x7faef80b1700 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faee8002f30 tx=0x7faee8010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:17.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.659+0000 7faefd36d700 1 --2- 172.21.15.103:0/1957556913 >> v2:172.21.15.103:3300/0 conn(0x7faef8061a30 0x7faef80b1700 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faee8002f30 tx=0x7faee8010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:17.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.659+0000 7faefd36d700 1 --2- 172.21.15.103:0/1957556913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faef8061a30 0x7faef80b1700 secure :-1 s=READY pgs=1067 cs=0 l=1 rx=0x7faee8002f30 tx=0x7faee8010ce0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:17.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.659+0000 7faefd36d700 1 --2- 172.21.15.103:0/1957556913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faef8061a30 0x7faef80b1700 secure :-1 s=THROTTLE_DONE pgs=1067 cs=0 l=1 rx=0x7faee8002f30 tx=0x7faee8010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:17.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.659+0000 7faee67fc700 1 -- 172.21.15.103:0/1957556913 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faee8012b50 con 0x7faef8061a30 2020-04-22T14:12:17.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.659+0000 7faefd36d700 1 --2- 172.21.15.103:0/1957556913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faef8061a30 0x7faef80b1700 secure :-1 s=THROTTLE_DONE pgs=1067 cs=0 l=1 rx=0x7faee8002f30 tx=0x7faee8010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:17.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.659+0000 7faee67fc700 1 -- 172.21.15.103:0/1957556913 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee8012cb0 con 0x7faef8061a30 2020-04-22T14:12:17.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.659+0000 7faefd36d700 1 --2- 172.21.15.103:0/1957556913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faef8061a30 0x7faef80b1700 secure :-1 s=THROTTLE_DONE pgs=1067 cs=0 l=1 rx=0x7faee8002f30 tx=0x7faee8010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:17.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.659+0000 7faeff5d1700 1 -- 172.21.15.103:0/1957556913 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faef80b2660 con 0x7faef8061a30 2020-04-22T14:12:17.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.659+0000 7faee67fc700 1 -- 172.21.15.103:0/1957556913 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faee8012e60 con 0x7faef8061a30 2020-04-22T14:12:17.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.659+0000 7faeff5d1700 1 -- 172.21.15.103:0/1957556913 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faef8139da0 con 0x7faef8061a30 2020-04-22T14:12:17.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.659+0000 7faefd36d700 1 --2- 172.21.15.103:0/1957556913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faef8061a30 0x7faef80b1700 secure :-1 s=THROTTLE_DONE pgs=1067 cs=0 l=1 rx=0x7faee8002f30 tx=0x7faee8010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:17.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.660+0000 7faee67fc700 1 -- 172.21.15.103:0/1957556913 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7faee8007190 con 0x7faef8061a30 2020-04-22T14:12:17.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.660+0000 7faefd36d700 1 --2- 172.21.15.103:0/1957556913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faef8061a30 0x7faef80b1700 secure :-1 s=THROTTLE_DONE pgs=1067 cs=0 l=1 rx=0x7faee8002f30 tx=0x7faee8010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:17.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.660+0000 7faeff5d1700 1 -- 172.21.15.103:0/1957556913 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faef8056c90 con 0x7faef8061a30 2020-04-22T14:12:17.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.660+0000 7faee67fc700 1 --2- 172.21.15.103:0/1957556913 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faed804d9e0 0x7faed804fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:17.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.660+0000 7faee67fc700 1 -- 172.21.15.103:0/1957556913 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5607+0+0 (secure 0 0 0) 0x7faee8061a70 con 0x7faef8061a30 2020-04-22T14:12:17.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.660+0000 7faefcb6c700 1 --2- 172.21.15.103:0/1957556913 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faed804d9e0 0x7faed804fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:17.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.661+0000 7faefcb6c700 1 --2- 172.21.15.103:0/1957556913 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faed804d9e0 0x7faed804fea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faef4002f30 tx=0x7faef4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:17.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.661+0000 7faefcb6c700 1 --2- 172.21.15.103:0/1957556913 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faed804d9e0 0x7faed804fea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faef4002f30 tx=0x7faef4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:17.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.661+0000 7faefcb6c700 1 --2- 172.21.15.103:0/1957556913 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faed804d9e0 0x7faed804fea0 secure :-1 s=READY pgs=395 cs=0 l=1 rx=0x7faef4002f30 tx=0x7faef4007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:17.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.664+0000 7faefd36d700 1 --2- 172.21.15.103:0/1957556913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faef8061a30 0x7faef80b1700 secure :-1 s=THROTTLE_DONE pgs=1067 cs=0 l=1 rx=0x7faee8002f30 tx=0x7faee8010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:17.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.664+0000 7faee67fc700 1 -- 172.21.15.103:0/1957556913 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7faee803ce50 con 0x7faef8061a30 2020-04-22T14:12:17.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:17.804+0000 7faeff5d1700 1 -- 172.21.15.103:0/1957556913 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7faef813a480 con 0x7faef8061a30 2020-04-22T14:12:18.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.476+0000 7faefd36d700 1 --2- 172.21.15.103:0/1957556913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faef8061a30 0x7faef80b1700 secure :-1 s=THROTTLE_DONE pgs=1067 cs=0 l=1 rx=0x7faee8002f30 tx=0x7faee8010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:18.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.476+0000 7faee67fc700 1 -- 172.21.15.103:0/1957556913 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v75) v1 ==== 125+0+0 (secure 0 0 0) 0x7faee8040470 con 0x7faef8061a30 2020-04-22T14:12:18.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.479+0000 7faeff5d1700 1 -- 172.21.15.103:0/1957556913 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faed804d9e0 msgr2=0x7faed804fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:18.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.479+0000 7faeff5d1700 1 --2- 172.21.15.103:0/1957556913 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faed804d9e0 0x7faed804fea0 secure :-1 s=READY pgs=395 cs=0 l=1 rx=0x7faef4002f30 tx=0x7faef4007a40).stop 2020-04-22T14:12:18.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.479+0000 7faeff5d1700 1 -- 172.21.15.103:0/1957556913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faef8061a30 msgr2=0x7faef80b1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:18.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.479+0000 7faeff5d1700 1 --2- 172.21.15.103:0/1957556913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faef8061a30 0x7faef80b1700 secure :-1 s=READY pgs=1067 cs=0 l=1 rx=0x7faee8002f30 tx=0x7faee8010ce0).stop 2020-04-22T14:12:18.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.481+0000 7faeff5d1700 1 -- 172.21.15.103:0/1957556913 shutdown_connections 2020-04-22T14:12:18.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.481+0000 7faeff5d1700 1 --2- 172.21.15.103:0/1957556913 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faed804d9e0 0x7faed804fea0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:18.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.481+0000 7faeff5d1700 1 --2- 172.21.15.103:0/1957556913 >> v2:172.21.15.86:3300/0 conn(0x7faef80aed80 0x7faef8144280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:18.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.481+0000 7faeff5d1700 1 --2- 172.21.15.103:0/1957556913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faef8061a30 0x7faef80b1700 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:18.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.481+0000 7faeff5d1700 1 --2- 172.21.15.103:0/1957556913 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faef80acb10 0x7faef81549b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:18.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.481+0000 7faeff5d1700 1 -- 172.21.15.103:0/1957556913 >> 172.21.15.103:0/1957556913 conn(0x7faef805b7b0 msgr2=0x7faef8140db0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:18.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.481+0000 7faeff5d1700 1 -- 172.21.15.103:0/1957556913 shutdown_connections 2020-04-22T14:12:18.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.481+0000 7faeff5d1700 1 -- 172.21.15.103:0/1957556913 wait complete. 2020-04-22T14:12:18.493 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' created 2020-04-22T14:12:18.497 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:18.517 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-04-22T14:12:18.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.670+0000 7fbb33d08700 1 Processor -- start 2020-04-22T14:12:18.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.670+0000 7fbb33d08700 1 -- start start 2020-04-22T14:12:18.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.671+0000 7fbb33d08700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbb2c0ac950 0x7fbb2c146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:18.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.671+0000 7fbb33d08700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb2c1467e0 con 0x7fbb2c1470a0 2020-04-22T14:12:18.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.671+0000 7fbb33d08700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb2c060050 con 0x7fbb2c0b9140 2020-04-22T14:12:18.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.671+0000 7fbb33d08700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb2c147530 con 0x7fbb2c0ac950 2020-04-22T14:12:18.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.671+0000 7fbb31aa4700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fbb2c0b9140 0x7fbb2c12b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44862/0 (socket says 172.21.15.103:44862) 2020-04-22T14:12:18.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.671+0000 7fbb31aa4700 1 -- 172.21.15.103:0/626041687 learned_addr learned my addr 172.21.15.103:0/626041687 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:18.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.671+0000 7fbb312a3700 1 --2- 172.21.15.103:0/626041687 >> v2:172.21.15.86:3300/0 conn(0x7fbb2c0ac950 0x7fbb2c146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:18.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.671+0000 7fbb30aa2700 1 -- 172.21.15.103:0/626041687 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4057211344 0 0) 0x7fbb2c060050 con 0x7fbb2c0b9140 2020-04-22T14:12:18.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.671+0000 7fbb30aa2700 1 -- 172.21.15.103:0/626041687 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb14003230 con 0x7fbb2c0b9140 2020-04-22T14:12:18.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.671+0000 7fbb30aa2700 1 -- 172.21.15.103:0/626041687 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3368494544 0 0) 0x7fbb14003230 con 0x7fbb2c0b9140 2020-04-22T14:12:18.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.671+0000 7fbb30aa2700 1 -- 172.21.15.103:0/626041687 >> v2:172.21.15.86:3300/0 conn(0x7fbb2c0ac950 msgr2=0x7fbb2c146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:18.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.671+0000 7fbb30aa2700 1 --2- 172.21.15.103:0/626041687 >> v2:172.21.15.86:3300/0 conn(0x7fbb2c0ac950 0x7fbb2c146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:18.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.671+0000 7fbb30aa2700 1 -- 172.21.15.103:0/626041687 >> v1:172.21.15.86:6789/0 conn(0x7fbb2c1470a0 legacy=0x7fbb2c143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:18.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.671+0000 7fbb30aa2700 1 -- 172.21.15.103:0/626041687 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2c0b9520 con 0x7fbb2c0b9140 2020-04-22T14:12:18.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.671+0000 7fbb30aa2700 1 -- 172.21.15.103:0/626041687 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fbb24001a90 con 0x7fbb2c0b9140 2020-04-22T14:12:18.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.671+0000 7fbb30aa2700 1 -- 172.21.15.103:0/626041687 >> v1:172.21.15.103:6789/0 conn(0x7fbb2c0b9140 legacy=0x7fbb2c12b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:18.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.671+0000 7fbb30aa2700 1 --2- 172.21.15.103:0/626041687 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb14003720 0x7fbb14003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:18.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.671+0000 7fbb30aa2700 1 --2- 172.21.15.103:0/626041687 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb140044d0 0x7fbb14004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:18.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.671+0000 7fbb30aa2700 1 --2- 172.21.15.103:0/626041687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb14004db0 0x7fbb1400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:18.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.671+0000 7fbb30aa2700 1 -- 172.21.15.103:0/626041687 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb140041c0 con 0x7fbb14004db0 2020-04-22T14:12:18.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.671+0000 7fbb30aa2700 1 -- 172.21.15.103:0/626041687 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb14004330 con 0x7fbb14003720 2020-04-22T14:12:18.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.671+0000 7fbb30aa2700 1 -- 172.21.15.103:0/626041687 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1400bbd0 con 0x7fbb140044d0 2020-04-22T14:12:18.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.671+0000 7fbb31aa4700 1 --2- 172.21.15.103:0/626041687 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb14003720 0x7fbb14003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:18.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.672+0000 7fbb312a3700 1 --2- 172.21.15.103:0/626041687 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb140044d0 0x7fbb14004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:18.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.672+0000 7fbb322a5700 1 --2- 172.21.15.103:0/626041687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb14004db0 0x7fbb1400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:18.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.672+0000 7fbb31aa4700 1 -- 172.21.15.103:0/626041687 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb140044d0 msgr2=0x7fbb14004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:18.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.672+0000 7fbb31aa4700 1 --2- 172.21.15.103:0/626041687 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb140044d0 0x7fbb14004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:18.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.672+0000 7fbb31aa4700 1 -- 172.21.15.103:0/626041687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb14004db0 msgr2=0x7fbb1400b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:18.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.672+0000 7fbb31aa4700 1 --2- 172.21.15.103:0/626041687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb14004db0 0x7fbb1400b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:18.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.672+0000 7fbb322a5700 1 -- 172.21.15.103:0/626041687 reap_dead start 2020-04-22T14:12:18.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.672+0000 7fbb31aa4700 1 -- 172.21.15.103:0/626041687 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb14003230 con 0x7fbb14003720 2020-04-22T14:12:18.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.672+0000 7fbb312a3700 1 --2- 172.21.15.103:0/626041687 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb140044d0 0x7fbb14004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:12:18.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.672+0000 7fbb31aa4700 1 --2- 172.21.15.103:0/626041687 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb14003720 0x7fbb14003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbb240017a0 tx=0x7fbb2c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:18.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.672+0000 7fbb31aa4700 1 --2- 172.21.15.103:0/626041687 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb14003720 0x7fbb14003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbb240017a0 tx=0x7fbb2c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:18.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.672+0000 7fbb31aa4700 1 --2- 172.21.15.103:0/626041687 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb14003720 0x7fbb14003b40 secure :-1 s=READY pgs=1069 cs=0 l=1 rx=0x7fbb240017a0 tx=0x7fbb2c0b96b0).ready entity=mon.1 client_cookie=47b7f5315da64353 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:18.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.672+0000 7fbb31aa4700 1 --2- 172.21.15.103:0/626041687 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb14003720 0x7fbb14003b40 secure :-1 s=THROTTLE_DONE pgs=1069 cs=0 l=1 rx=0x7fbb240017a0 tx=0x7fbb2c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:18.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.672+0000 7fbb30aa2700 1 -- 172.21.15.103:0/626041687 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb24005d40 con 0x7fbb14003720 2020-04-22T14:12:18.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.672+0000 7fbb31aa4700 1 --2- 172.21.15.103:0/626041687 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb14003720 0x7fbb14003b40 secure :-1 s=THROTTLE_DONE pgs=1069 cs=0 l=1 rx=0x7fbb240017a0 tx=0x7fbb2c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:18.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.672+0000 7fbb31aa4700 1 --2- 172.21.15.103:0/626041687 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb14003720 0x7fbb14003b40 secure :-1 s=THROTTLE_DONE pgs=1069 cs=0 l=1 rx=0x7fbb240017a0 tx=0x7fbb2c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:18.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.672+0000 7fbb30aa2700 1 -- 172.21.15.103:0/626041687 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb24004d20 con 0x7fbb14003720 2020-04-22T14:12:18.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.672+0000 7fbb30aa2700 1 -- 172.21.15.103:0/626041687 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb24005ea0 con 0x7fbb14003720 2020-04-22T14:12:18.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.672+0000 7fbb33d08700 1 -- 172.21.15.103:0/626041687 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb14003720 msgr2=0x7fbb14003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:18.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.672+0000 7fbb33d08700 1 --2- 172.21.15.103:0/626041687 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb14003720 0x7fbb14003b40 secure :-1 s=READY pgs=1069 cs=0 l=1 rx=0x7fbb240017a0 tx=0x7fbb2c0b96b0).stop 2020-04-22T14:12:18.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.672+0000 7fbb33d08700 1 -- 172.21.15.103:0/626041687 shutdown_connections 2020-04-22T14:12:18.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.672+0000 7fbb33d08700 1 --2- 172.21.15.103:0/626041687 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb14003720 0x7fbb14003b40 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:18.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.672+0000 7fbb33d08700 1 -- 172.21.15.103:0/626041687 >> 172.21.15.103:0/626041687 conn(0x7fbb2c05b7b0 msgr2=0x7fbb2c0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:18.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.673+0000 7fbb33d08700 1 -- 172.21.15.103:0/626041687 shutdown_connections 2020-04-22T14:12:18.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.673+0000 7fbb33d08700 1 -- 172.21.15.103:0/626041687 wait complete. 2020-04-22T14:12:18.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.673+0000 7fbb33d08700 1 Processor -- start 2020-04-22T14:12:18.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.674+0000 7fbb33d08700 1 -- start start 2020-04-22T14:12:18.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.674+0000 7fbb33d08700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbb2c128680 0x7fbb2c143090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:18.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.674+0000 7fbb33d08700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbb2c142150 0x7fbb2c0b5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:18.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.674+0000 7fbb33d08700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb2c0b5960 con 0x7fbb14003720 2020-04-22T14:12:18.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.674+0000 7fbb33d08700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb2c143660 con 0x7fbb2c128680 2020-04-22T14:12:18.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.674+0000 7fbb33d08700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb2c1441a0 con 0x7fbb2c142150 2020-04-22T14:12:18.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.674+0000 7fbb31aa4700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fbb14003720 0x7fbb2c127f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44874/0 (socket says 172.21.15.103:44874) 2020-04-22T14:12:18.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.674+0000 7fbb31aa4700 1 -- 172.21.15.103:0/122629749 learned_addr learned my addr 172.21.15.103:0/122629749 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:18.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.674+0000 7fbb322a5700 1 --2- 172.21.15.103:0/122629749 >> v2:172.21.15.103:3300/0 conn(0x7fbb2c142150 0x7fbb2c0b5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:18.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.674+0000 7fbb312a3700 1 --2- 172.21.15.103:0/122629749 >> v2:172.21.15.86:3300/0 conn(0x7fbb2c128680 0x7fbb2c143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:18.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.674+0000 7fbb1effd700 1 -- 172.21.15.103:0/122629749 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1074695177 0 0) 0x7fbb14003230 con 0x7fbb14003720 2020-04-22T14:12:18.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.674+0000 7fbb1effd700 1 -- 172.21.15.103:0/122629749 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb0c002fe0 con 0x7fbb14003720 2020-04-22T14:12:18.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.675+0000 7fbb322a5700 1 -- 172.21.15.103:0/122629749 >> v2:172.21.15.86:3300/0 conn(0x7fbb2c128680 msgr2=0x7fbb2c143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:18.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.675+0000 7fbb322a5700 1 --2- 172.21.15.103:0/122629749 >> v2:172.21.15.86:3300/0 conn(0x7fbb2c128680 0x7fbb2c143090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:18.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.675+0000 7fbb322a5700 1 -- 172.21.15.103:0/122629749 >> v1:172.21.15.103:6789/0 conn(0x7fbb14003720 legacy=0x7fbb2c127f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:18.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.675+0000 7fbb322a5700 1 -- 172.21.15.103:0/122629749 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2c144440 con 0x7fbb2c142150 2020-04-22T14:12:18.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.675+0000 7fbb322a5700 1 --2- 172.21.15.103:0/122629749 >> v2:172.21.15.103:3300/0 conn(0x7fbb2c142150 0x7fbb2c0b5500 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbb2c0645e0 tx=0x7fbb280105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:18.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.675+0000 7fbb322a5700 1 --2- 172.21.15.103:0/122629749 >> v2:172.21.15.103:3300/0 conn(0x7fbb2c142150 0x7fbb2c0b5500 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbb2c0645e0 tx=0x7fbb280105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:18.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.675+0000 7fbb322a5700 1 --2- 172.21.15.103:0/122629749 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb2c142150 0x7fbb2c0b5500 secure :-1 s=READY pgs=1071 cs=0 l=1 rx=0x7fbb2c0645e0 tx=0x7fbb280105e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:18.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.675+0000 7fbb322a5700 1 --2- 172.21.15.103:0/122629749 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb2c142150 0x7fbb2c0b5500 secure :-1 s=THROTTLE_DONE pgs=1071 cs=0 l=1 rx=0x7fbb2c0645e0 tx=0x7fbb280105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:18.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.675+0000 7fbb1effd700 1 -- 172.21.15.103:0/122629749 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb28010e80 con 0x7fbb2c142150 2020-04-22T14:12:18.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.675+0000 7fbb322a5700 1 --2- 172.21.15.103:0/122629749 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb2c142150 0x7fbb2c0b5500 secure :-1 s=THROTTLE_DONE pgs=1071 cs=0 l=1 rx=0x7fbb2c0645e0 tx=0x7fbb280105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:18.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.675+0000 7fbb1effd700 1 -- 172.21.15.103:0/122629749 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb280018b0 con 0x7fbb2c142150 2020-04-22T14:12:18.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.675+0000 7fbb322a5700 1 --2- 172.21.15.103:0/122629749 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb2c142150 0x7fbb2c0b5500 secure :-1 s=THROTTLE_DONE pgs=1071 cs=0 l=1 rx=0x7fbb2c0645e0 tx=0x7fbb280105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:18.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.675+0000 7fbb33d08700 1 -- 172.21.15.103:0/122629749 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb2c062220 con 0x7fbb2c142150 2020-04-22T14:12:18.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.675+0000 7fbb1effd700 1 -- 172.21.15.103:0/122629749 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb28001c10 con 0x7fbb2c142150 2020-04-22T14:12:18.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.675+0000 7fbb33d08700 1 -- 172.21.15.103:0/122629749 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb2c1448e0 con 0x7fbb2c142150 2020-04-22T14:12:18.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.676+0000 7fbb322a5700 1 --2- 172.21.15.103:0/122629749 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb2c142150 0x7fbb2c0b5500 secure :-1 s=THROTTLE_DONE pgs=1071 cs=0 l=1 rx=0x7fbb2c0645e0 tx=0x7fbb280105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:18.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.676+0000 7fbb1effd700 1 -- 172.21.15.103:0/122629749 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fbb28001d70 con 0x7fbb2c142150 2020-04-22T14:12:18.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.676+0000 7fbb322a5700 1 --2- 172.21.15.103:0/122629749 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb2c142150 0x7fbb2c0b5500 secure :-1 s=THROTTLE_DONE pgs=1071 cs=0 l=1 rx=0x7fbb2c0645e0 tx=0x7fbb280105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:18.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.676+0000 7fbb1effd700 1 --2- 172.21.15.103:0/122629749 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbb0c04dcc0 0x7fbb0c050180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:18.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.676+0000 7fbb1effd700 1 -- 172.21.15.103:0/122629749 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5957+0+0 (secure 0 0 0) 0x7fbb28060810 con 0x7fbb2c142150 2020-04-22T14:12:18.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.676+0000 7fbb33d08700 1 -- 172.21.15.103:0/122629749 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb2c056c90 con 0x7fbb2c142150 2020-04-22T14:12:18.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.676+0000 7fbb31aa4700 1 --2- 172.21.15.103:0/122629749 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbb0c04dcc0 0x7fbb0c050180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:18.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.677+0000 7fbb31aa4700 1 --2- 172.21.15.103:0/122629749 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbb0c04dcc0 0x7fbb0c050180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbb24001cf0 tx=0x7fbb2c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:18.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.677+0000 7fbb31aa4700 1 --2- 172.21.15.103:0/122629749 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbb0c04dcc0 0x7fbb0c050180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbb24001cf0 tx=0x7fbb2c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:18.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.677+0000 7fbb31aa4700 1 --2- 172.21.15.103:0/122629749 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbb0c04dcc0 0x7fbb0c050180 secure :-1 s=READY pgs=396 cs=0 l=1 rx=0x7fbb24001cf0 tx=0x7fbb2c0b96b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:18.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.681+0000 7fbb322a5700 1 --2- 172.21.15.103:0/122629749 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb2c142150 0x7fbb2c0b5500 secure :-1 s=THROTTLE_DONE pgs=1071 cs=0 l=1 rx=0x7fbb2c0645e0 tx=0x7fbb280105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:18.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.681+0000 7fbb1effd700 1 -- 172.21.15.103:0/122629749 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fbb2803bc50 con 0x7fbb2c142150 2020-04-22T14:12:18.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.871+0000 7fbb33d08700 1 -- 172.21.15.103:0/122629749 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fbb2c06a960 con 0x7fbb2c142150 2020-04-22T14:12:18.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.881+0000 7fbb322a5700 1 --2- 172.21.15.103:0/122629749 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb2c142150 0x7fbb2c0b5500 secure :-1 s=THROTTLE_DONE pgs=1071 cs=0 l=1 rx=0x7fbb2c0645e0 tx=0x7fbb280105e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:18.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.881+0000 7fbb1effd700 1 -- 172.21.15.103:0/122629749 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 13 and data pool 14 v47) v1 ==== 189+0+0 (secure 0 0 0) 0x7fbb2803f270 con 0x7fbb2c142150 2020-04-22T14:12:18.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.885+0000 7fbb33d08700 1 -- 172.21.15.103:0/122629749 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbb0c04dcc0 msgr2=0x7fbb0c050180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:18.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.885+0000 7fbb33d08700 1 --2- 172.21.15.103:0/122629749 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbb0c04dcc0 0x7fbb0c050180 secure :-1 s=READY pgs=396 cs=0 l=1 rx=0x7fbb24001cf0 tx=0x7fbb2c0b96b0).stop 2020-04-22T14:12:18.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.885+0000 7fbb33d08700 1 -- 172.21.15.103:0/122629749 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb2c142150 msgr2=0x7fbb2c0b5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:18.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.885+0000 7fbb33d08700 1 --2- 172.21.15.103:0/122629749 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb2c142150 0x7fbb2c0b5500 secure :-1 s=READY pgs=1071 cs=0 l=1 rx=0x7fbb2c0645e0 tx=0x7fbb280105e0).stop 2020-04-22T14:12:18.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.885+0000 7fbb33d08700 1 -- 172.21.15.103:0/122629749 shutdown_connections 2020-04-22T14:12:18.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.885+0000 7fbb33d08700 1 --2- 172.21.15.103:0/122629749 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb2c142150 0x7fbb2c0b5500 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:18.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.885+0000 7fbb33d08700 1 --2- 172.21.15.103:0/122629749 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbb0c04dcc0 0x7fbb0c050180 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:18.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.885+0000 7fbb33d08700 1 --2- 172.21.15.103:0/122629749 >> v2:172.21.15.86:3300/0 conn(0x7fbb2c128680 0x7fbb2c143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:18.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.885+0000 7fbb33d08700 1 -- 172.21.15.103:0/122629749 >> 172.21.15.103:0/122629749 conn(0x7fbb2c05b7b0 msgr2=0x7fbb2c145cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:18.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.885+0000 7fbb33d08700 1 -- 172.21.15.103:0/122629749 shutdown_connections 2020-04-22T14:12:18.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:18.885+0000 7fbb33d08700 1 -- 172.21.15.103:0/122629749 wait complete. 2020-04-22T14:12:18.890 INFO:teuthology.orchestra.run.smithi103.stderr:new fs with metadata pool 13 and data pool 14 2020-04-22T14:12:18.902 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:18.915 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:12:19.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.058+0000 7f1727ad3700 1 Processor -- start 2020-04-22T14:12:19.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.058+0000 7f1727ad3700 1 -- start start 2020-04-22T14:12:19.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.059+0000 7f1727ad3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f172012c0d0 0x7f17201464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:19.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.059+0000 7f1727ad3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1720063e30 0x7f17200642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:19.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.059+0000 7f1727ad3700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1720143300 con 0x7f1720065fe0 2020-04-22T14:12:19.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.059+0000 7f1727ad3700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17201435a0 con 0x7f1720063e30 2020-04-22T14:12:19.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.059+0000 7f1727ad3700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1720143840 con 0x7f172012c0d0 2020-04-22T14:12:19.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.059+0000 7f172586f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f172012c0d0 0x7f17201464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:19.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.059+0000 7f172586f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f172012c0d0 0x7f17201464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52702/0 (socket says 172.21.15.103:52702) 2020-04-22T14:12:19.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.059+0000 7f172586f700 1 -- 172.21.15.103:0/3830182500 learned_addr learned my addr 172.21.15.103:0/3830182500 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:19.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.059+0000 7f172586f700 1 -- 172.21.15.103:0/3830182500 >> v2:172.21.15.86:3300/0 conn(0x7f1720063e30 msgr2=0x7f17200642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:19.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.059+0000 7f172586f700 1 --2- 172.21.15.103:0/3830182500 >> v2:172.21.15.86:3300/0 conn(0x7f1720063e30 0x7f17200642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:19.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.059+0000 7f172586f700 1 -- 172.21.15.103:0/3830182500 >> v1:172.21.15.86:6789/0 conn(0x7f1720065fe0 legacy=0x7f172005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:19.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.059+0000 7f172586f700 1 -- 172.21.15.103:0/3830182500 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f172005bb50 con 0x7f172012c0d0 2020-04-22T14:12:19.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.059+0000 7f172586f700 1 --2- 172.21.15.103:0/3830182500 >> v2:172.21.15.103:3300/0 conn(0x7f172012c0d0 0x7f17201464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f17200669a0 tx=0x7f1718007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.059+0000 7f172586f700 1 --2- 172.21.15.103:0/3830182500 >> v2:172.21.15.103:3300/0 conn(0x7f172012c0d0 0x7f17201464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f17200669a0 tx=0x7f1718007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.059+0000 7f172586f700 1 --2- 172.21.15.103:0/3830182500 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f172012c0d0 0x7f17201464e0 secure :-1 s=READY pgs=1072 cs=0 l=1 rx=0x7f17200669a0 tx=0x7f1718007dc0).ready entity=mon.1 client_cookie=6e7068fc72394804 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:19.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.059+0000 7f172586f700 1 --2- 172.21.15.103:0/3830182500 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f172012c0d0 0x7f17201464e0 secure :-1 s=THROTTLE_DONE pgs=1072 cs=0 l=1 rx=0x7f17200669a0 tx=0x7f1718007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.059+0000 7f172486d700 1 -- 172.21.15.103:0/3830182500 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f171800a180 con 0x7f172012c0d0 2020-04-22T14:12:19.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.059+0000 7f172586f700 1 --2- 172.21.15.103:0/3830182500 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f172012c0d0 0x7f17201464e0 secure :-1 s=THROTTLE_DONE pgs=1072 cs=0 l=1 rx=0x7f17200669a0 tx=0x7f1718007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.059+0000 7f172586f700 1 --2- 172.21.15.103:0/3830182500 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f172012c0d0 0x7f17201464e0 secure :-1 s=THROTTLE_DONE pgs=1072 cs=0 l=1 rx=0x7f17200669a0 tx=0x7f1718007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.059+0000 7f172486d700 1 -- 172.21.15.103:0/3830182500 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171800a2e0 con 0x7f172012c0d0 2020-04-22T14:12:19.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.059+0000 7f172486d700 1 -- 172.21.15.103:0/3830182500 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f171800a6c0 con 0x7f172012c0d0 2020-04-22T14:12:19.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.059+0000 7f1727ad3700 1 -- 172.21.15.103:0/3830182500 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f172012c0d0 msgr2=0x7f17201464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:19.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.059+0000 7f1727ad3700 1 --2- 172.21.15.103:0/3830182500 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f172012c0d0 0x7f17201464e0 secure :-1 s=READY pgs=1072 cs=0 l=1 rx=0x7f17200669a0 tx=0x7f1718007dc0).stop 2020-04-22T14:12:19.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.060+0000 7f1727ad3700 1 -- 172.21.15.103:0/3830182500 shutdown_connections 2020-04-22T14:12:19.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.060+0000 7f1727ad3700 1 --2- 172.21.15.103:0/3830182500 >> v2:172.21.15.86:3300/0 conn(0x7f1720063e30 0x7f17200642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:19.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.060+0000 7f1727ad3700 1 --2- 172.21.15.103:0/3830182500 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f172012c0d0 0x7f17201464e0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:19.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.060+0000 7f1727ad3700 1 -- 172.21.15.103:0/3830182500 >> 172.21.15.103:0/3830182500 conn(0x7f17200b9160 msgr2=0x7f172005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:19.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.060+0000 7f1727ad3700 1 -- 172.21.15.103:0/3830182500 shutdown_connections 2020-04-22T14:12:19.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.060+0000 7f1727ad3700 1 -- 172.21.15.103:0/3830182500 wait complete. 2020-04-22T14:12:19.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.061+0000 7f1727ad3700 1 Processor -- start 2020-04-22T14:12:19.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.061+0000 7f1727ad3700 1 -- start start 2020-04-22T14:12:19.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.061+0000 7f1727ad3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1720063e30 0x7f17200af150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:19.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.062+0000 7f1727ad3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f172012c0d0 0x7f17200b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:19.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.062+0000 7f1727ad3700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1720154cd0 con 0x7f1720065fe0 2020-04-22T14:12:19.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.062+0000 7f1727ad3700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1720154f70 con 0x7f1720063e30 2020-04-22T14:12:19.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.062+0000 7f1727ad3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17201295b0 con 0x7f172012c0d0 2020-04-22T14:12:19.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.062+0000 7f172586f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1720063e30 0x7f17200af150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:19.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.062+0000 7f172586f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1720063e30 0x7f17200af150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52708/0 (socket says 172.21.15.103:52708) 2020-04-22T14:12:19.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.062+0000 7f172586f700 1 -- 172.21.15.103:0/2004537001 learned_addr learned my addr 172.21.15.103:0/2004537001 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:19.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.062+0000 7f1726070700 1 --2- 172.21.15.103:0/2004537001 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f172012c0d0 0x7f17200b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:19.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.062+0000 7f172586f700 1 -- 172.21.15.103:0/2004537001 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f172012c0d0 msgr2=0x7f17200b3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:19.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.062+0000 7f172586f700 1 --2- 172.21.15.103:0/2004537001 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f172012c0d0 0x7f17200b3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:19.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.062+0000 7f172586f700 1 -- 172.21.15.103:0/2004537001 >> v1:172.21.15.86:6789/0 conn(0x7f1720065fe0 legacy=0x7f17201544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:19.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.062+0000 7f172586f700 1 -- 172.21.15.103:0/2004537001 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17200acb80 con 0x7f1720063e30 2020-04-22T14:12:19.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.062+0000 7f172586f700 1 --2- 172.21.15.103:0/2004537001 >> v2:172.21.15.103:3300/0 conn(0x7f1720063e30 0x7f17200af150 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f17200669a0 tx=0x7f1718007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.062+0000 7f172586f700 1 --2- 172.21.15.103:0/2004537001 >> v2:172.21.15.103:3300/0 conn(0x7f1720063e30 0x7f17200af150 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f17200669a0 tx=0x7f1718007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.062+0000 7f172586f700 1 --2- 172.21.15.103:0/2004537001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1720063e30 0x7f17200af150 secure :-1 s=READY pgs=1073 cs=0 l=1 rx=0x7f17200669a0 tx=0x7f1718007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:19.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.062+0000 7f172586f700 1 --2- 172.21.15.103:0/2004537001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1720063e30 0x7f17200af150 secure :-1 s=THROTTLE_DONE pgs=1073 cs=0 l=1 rx=0x7f17200669a0 tx=0x7f1718007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.062+0000 7f172586f700 1 --2- 172.21.15.103:0/2004537001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1720063e30 0x7f17200af150 secure :-1 s=THROTTLE_DONE pgs=1073 cs=0 l=1 rx=0x7f17200669a0 tx=0x7f1718007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.062+0000 7f170effd700 1 -- 172.21.15.103:0/2004537001 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1718005c30 con 0x7f1720063e30 2020-04-22T14:12:19.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.062+0000 7f172586f700 1 --2- 172.21.15.103:0/2004537001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1720063e30 0x7f17200af150 secure :-1 s=THROTTLE_DONE pgs=1073 cs=0 l=1 rx=0x7f17200669a0 tx=0x7f1718007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.062+0000 7f170effd700 1 -- 172.21.15.103:0/2004537001 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1718005d90 con 0x7f1720063e30 2020-04-22T14:12:19.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.062+0000 7f1727ad3700 1 -- 172.21.15.103:0/2004537001 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17200ace30 con 0x7f1720063e30 2020-04-22T14:12:19.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.062+0000 7f170effd700 1 -- 172.21.15.103:0/2004537001 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f171800f7a0 con 0x7f1720063e30 2020-04-22T14:12:19.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.062+0000 7f1727ad3700 1 -- 172.21.15.103:0/2004537001 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17200ad300 con 0x7f1720063e30 2020-04-22T14:12:19.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.063+0000 7f172586f700 1 --2- 172.21.15.103:0/2004537001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1720063e30 0x7f17200af150 secure :-1 s=THROTTLE_DONE pgs=1073 cs=0 l=1 rx=0x7f17200669a0 tx=0x7f1718007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.064+0000 7f170effd700 1 -- 172.21.15.103:0/2004537001 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f171800fa10 con 0x7f1720063e30 2020-04-22T14:12:19.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.064+0000 7f172586f700 1 --2- 172.21.15.103:0/2004537001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1720063e30 0x7f17200af150 secure :-1 s=THROTTLE_DONE pgs=1073 cs=0 l=1 rx=0x7f17200669a0 tx=0x7f1718007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.064+0000 7f1727ad3700 1 -- 172.21.15.103:0/2004537001 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1720056c90 con 0x7f1720063e30 2020-04-22T14:12:19.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.064+0000 7f170effd700 1 --2- 172.21.15.103:0/2004537001 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f170004da10 0x7f170004fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:19.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.064+0000 7f170effd700 1 -- 172.21.15.103:0/2004537001 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1718062550 con 0x7f1720063e30 2020-04-22T14:12:19.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.064+0000 7f172506e700 1 --2- 172.21.15.103:0/2004537001 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f170004da10 0x7f170004fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:19.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.064+0000 7f172506e700 1 --2- 172.21.15.103:0/2004537001 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f170004da10 0x7f170004fed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f172012a9b0 tx=0x7f17100089e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.064+0000 7f172506e700 1 --2- 172.21.15.103:0/2004537001 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f170004da10 0x7f170004fed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f172012a9b0 tx=0x7f17100089e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.064+0000 7f172506e700 1 --2- 172.21.15.103:0/2004537001 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f170004da10 0x7f170004fed0 secure :-1 s=READY pgs=397 cs=0 l=1 rx=0x7f172012a9b0 tx=0x7f17100089e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:19.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.068+0000 7f172586f700 1 --2- 172.21.15.103:0/2004537001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1720063e30 0x7f17200af150 secure :-1 s=THROTTLE_DONE pgs=1073 cs=0 l=1 rx=0x7f17200669a0 tx=0x7f1718007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.080 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.068+0000 7f170effd700 1 -- 172.21.15.103:0/2004537001 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f171803da50 con 0x7f1720063e30 2020-04-22T14:12:19.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.212+0000 7f1727ad3700 1 -- 172.21.15.103:0/2004537001 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1720147360 con 0x7f1720063e30 2020-04-22T14:12:19.216 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.213+0000 7f172586f700 1 --2- 172.21.15.103:0/2004537001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1720063e30 0x7f17200af150 secure :-1 s=THROTTLE_DONE pgs=1073 cs=0 l=1 rx=0x7f17200669a0 tx=0x7f1718007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.217 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.213+0000 7f170effd700 1 -- 172.21.15.103:0/2004537001 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16105 (secure 0 0 0) 0x7f1718041070 con 0x7f1720063e30 2020-04-22T14:12:19.217 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:12:19.217 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":76,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:12:18.873678+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:12:16.799055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2020-04-22T14:12:17.819603+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:12:19.218 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.215+0000 7f1727ad3700 1 -- 172.21.15.103:0/2004537001 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f170004da10 msgr2=0x7f170004fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:19.218 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.215+0000 7f1727ad3700 1 --2- 172.21.15.103:0/2004537001 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f170004da10 0x7f170004fed0 secure :-1 s=READY pgs=397 cs=0 l=1 rx=0x7f172012a9b0 tx=0x7f17100089e0).stop 2020-04-22T14:12:19.219 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.215+0000 7f1727ad3700 1 -- 172.21.15.103:0/2004537001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1720063e30 msgr2=0x7f17200af150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:19.219 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.215+0000 7f1727ad3700 1 --2- 172.21.15.103:0/2004537001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1720063e30 0x7f17200af150 secure :-1 s=READY pgs=1073 cs=0 l=1 rx=0x7f17200669a0 tx=0x7f1718007dc0).stop 2020-04-22T14:12:19.219 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.215+0000 7f1727ad3700 1 -- 172.21.15.103:0/2004537001 shutdown_connections 2020-04-22T14:12:19.219 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.215+0000 7f1727ad3700 1 --2- 172.21.15.103:0/2004537001 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f170004da10 0x7f170004fed0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:19.219 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.215+0000 7f1727ad3700 1 --2- 172.21.15.103:0/2004537001 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f172012c0d0 0x7f17200b3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:19.220 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.215+0000 7f1727ad3700 1 --2- 172.21.15.103:0/2004537001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1720063e30 0x7f17200af150 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:19.220 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.215+0000 7f1727ad3700 1 -- 172.21.15.103:0/2004537001 >> 172.21.15.103:0/2004537001 conn(0x7f17200b9160 msgr2=0x7f17200615c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:19.220 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.215+0000 7f1727ad3700 1 -- 172.21.15.103:0/2004537001 shutdown_connections 2020-04-22T14:12:19.220 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.215+0000 7f1727ad3700 1 -- 172.21.15.103:0/2004537001 wait complete. 2020-04-22T14:12:19.229 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:19.243 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:12:19.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.387+0000 7f50f26a4700 1 Processor -- start 2020-04-22T14:12:19.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.387+0000 7f50f26a4700 1 -- start start 2020-04-22T14:12:19.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.388+0000 7f50f26a4700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f50ec12c0d0 0x7f50ec1464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:19.395 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.388+0000 7f50f26a4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f50ec063e30 0x7f50ec0642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:19.395 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.388+0000 7f50f26a4700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50ec143300 con 0x7f50ec065fe0 2020-04-22T14:12:19.395 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.388+0000 7f50f26a4700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50ec1435a0 con 0x7f50ec12c0d0 2020-04-22T14:12:19.395 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.388+0000 7f50f26a4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50ec143840 con 0x7f50ec063e30 2020-04-22T14:12:19.395 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.388+0000 7f50eb7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f50ec065fe0 0x7f50ec05b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44906/0 (socket says 172.21.15.103:44906) 2020-04-22T14:12:19.395 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.388+0000 7f50eb7fe700 1 -- 172.21.15.103:0/3131279090 learned_addr learned my addr 172.21.15.103:0/3131279090 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:19.395 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.388+0000 7f50eaffd700 1 -- 172.21.15.103:0/3131279090 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2023311559 0 0) 0x7f50ec143300 con 0x7f50ec065fe0 2020-04-22T14:12:19.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.388+0000 7f50f0c41700 1 --2- 172.21.15.103:0/3131279090 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f50ec063e30 0x7f50ec0642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:19.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.389+0000 7f50eaffd700 1 -- 172.21.15.103:0/3131279090 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50d8003230 con 0x7f50ec065fe0 2020-04-22T14:12:19.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.389+0000 7f50ebfff700 1 --2- 172.21.15.103:0/3131279090 >> v2:172.21.15.86:3300/0 conn(0x7f50ec12c0d0 0x7f50ec1464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:19.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.389+0000 7f50eaffd700 1 -- 172.21.15.103:0/3131279090 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 949520112 0 0) 0x7f50d8003230 con 0x7f50ec065fe0 2020-04-22T14:12:19.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.389+0000 7f50eaffd700 1 -- 172.21.15.103:0/3131279090 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f50ec063e30 msgr2=0x7f50ec0642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:19.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.389+0000 7f50eaffd700 1 --2- 172.21.15.103:0/3131279090 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f50ec063e30 0x7f50ec0642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:19.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.389+0000 7f50eaffd700 1 -- 172.21.15.103:0/3131279090 >> v2:172.21.15.86:3300/0 conn(0x7f50ec12c0d0 msgr2=0x7f50ec1464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:19.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.389+0000 7f50eaffd700 1 --2- 172.21.15.103:0/3131279090 >> v2:172.21.15.86:3300/0 conn(0x7f50ec12c0d0 0x7f50ec1464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:19.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.389+0000 7f50eaffd700 1 -- 172.21.15.103:0/3131279090 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50ec05bb50 con 0x7f50ec065fe0 2020-04-22T14:12:19.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.389+0000 7f50eaffd700 1 -- 172.21.15.103:0/3131279090 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f50e00016d0 con 0x7f50ec065fe0 2020-04-22T14:12:19.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.389+0000 7f50eaffd700 1 -- 172.21.15.103:0/3131279090 >> v1:172.21.15.103:6789/0 conn(0x7f50ec065fe0 legacy=0x7f50ec05b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:19.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.389+0000 7f50eaffd700 1 --2- 172.21.15.103:0/3131279090 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f50ec063e30 0x7f50d8003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:19.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.389+0000 7f50eaffd700 1 --2- 172.21.15.103:0/3131279090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50d8003b80 0x7f50d8003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:19.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.389+0000 7f50eaffd700 1 --2- 172.21.15.103:0/3131279090 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50d80045c0 0x7f50d8004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:19.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.389+0000 7f50eaffd700 1 -- 172.21.15.103:0/3131279090 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ec1435a0 con 0x7f50d80045c0 2020-04-22T14:12:19.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.389+0000 7f50eaffd700 1 -- 172.21.15.103:0/3131279090 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ec143840 con 0x7f50d8003b80 2020-04-22T14:12:19.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.389+0000 7f50eaffd700 1 -- 172.21.15.103:0/3131279090 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50d8005050 con 0x7f50ec063e30 2020-04-22T14:12:19.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.389+0000 7f50eb7fe700 1 --2- 172.21.15.103:0/3131279090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50d8003b80 0x7f50d8003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:19.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.389+0000 7f50ebfff700 1 --2- 172.21.15.103:0/3131279090 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f50ec063e30 0x7f50d8003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:19.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.389+0000 7f50f0c41700 1 --2- 172.21.15.103:0/3131279090 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50d80045c0 0x7f50d8004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:19.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.389+0000 7f50eb7fe700 1 -- 172.21.15.103:0/3131279090 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f50ec063e30 msgr2=0x7f50d8003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:19.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.389+0000 7f50eb7fe700 1 --2- 172.21.15.103:0/3131279090 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f50ec063e30 0x7f50d8003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:19.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.389+0000 7f50eb7fe700 1 -- 172.21.15.103:0/3131279090 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50d80045c0 msgr2=0x7f50d8004a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:19.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.389+0000 7f50eb7fe700 1 --2- 172.21.15.103:0/3131279090 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50d80045c0 0x7f50d8004a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:19.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.389+0000 7f50eb7fe700 1 -- 172.21.15.103:0/3131279090 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d8003230 con 0x7f50d8003b80 2020-04-22T14:12:19.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.389+0000 7f50eb7fe700 1 --2- 172.21.15.103:0/3131279090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50d8003b80 0x7f50d8003fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f50e00013e0 tx=0x7f50ec05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.389+0000 7f50eb7fe700 1 --2- 172.21.15.103:0/3131279090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50d8003b80 0x7f50d8003fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f50e00013e0 tx=0x7f50ec05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.389+0000 7f50eb7fe700 1 --2- 172.21.15.103:0/3131279090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50d8003b80 0x7f50d8003fe0 secure :-1 s=READY pgs=1075 cs=0 l=1 rx=0x7f50e00013e0 tx=0x7f50ec05bce0).ready entity=mon.1 client_cookie=ee261786551066cc server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:19.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.390+0000 7f50eb7fe700 1 --2- 172.21.15.103:0/3131279090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50d8003b80 0x7f50d8003fe0 secure :-1 s=THROTTLE_DONE pgs=1075 cs=0 l=1 rx=0x7f50e00013e0 tx=0x7f50ec05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.390+0000 7f50eaffd700 1 -- 172.21.15.103:0/3131279090 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50e000ca80 con 0x7f50d8003b80 2020-04-22T14:12:19.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.390+0000 7f50eb7fe700 1 --2- 172.21.15.103:0/3131279090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50d8003b80 0x7f50d8003fe0 secure :-1 s=THROTTLE_DONE pgs=1075 cs=0 l=1 rx=0x7f50e00013e0 tx=0x7f50ec05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.390+0000 7f50eb7fe700 1 --2- 172.21.15.103:0/3131279090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50d8003b80 0x7f50d8003fe0 secure :-1 s=THROTTLE_DONE pgs=1075 cs=0 l=1 rx=0x7f50e00013e0 tx=0x7f50ec05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.390+0000 7f50eaffd700 1 -- 172.21.15.103:0/3131279090 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e000cbe0 con 0x7f50d8003b80 2020-04-22T14:12:19.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.390+0000 7f50eaffd700 1 -- 172.21.15.103:0/3131279090 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50e00111d0 con 0x7f50d8003b80 2020-04-22T14:12:19.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.390+0000 7f50f26a4700 1 -- 172.21.15.103:0/3131279090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50d8003b80 msgr2=0x7f50d8003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:19.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.390+0000 7f50f26a4700 1 --2- 172.21.15.103:0/3131279090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50d8003b80 0x7f50d8003fe0 secure :-1 s=READY pgs=1075 cs=0 l=1 rx=0x7f50e00013e0 tx=0x7f50ec05bce0).stop 2020-04-22T14:12:19.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.390+0000 7f50f0c41700 1 -- 172.21.15.103:0/3131279090 reap_dead start 2020-04-22T14:12:19.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.390+0000 7f50f26a4700 1 -- 172.21.15.103:0/3131279090 shutdown_connections 2020-04-22T14:12:19.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.390+0000 7f50f26a4700 1 -- 172.21.15.103:0/3131279090 >> 172.21.15.103:0/3131279090 conn(0x7f50ec0b9160 msgr2=0x7f50ec05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:19.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.390+0000 7f50f26a4700 1 -- 172.21.15.103:0/3131279090 shutdown_connections 2020-04-22T14:12:19.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.390+0000 7f50f26a4700 1 -- 172.21.15.103:0/3131279090 wait complete. 2020-04-22T14:12:19.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.391+0000 7f50f26a4700 1 Processor -- start 2020-04-22T14:12:19.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.391+0000 7f50f26a4700 1 -- start start 2020-04-22T14:12:19.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.392+0000 7f50f26a4700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f50ec12a420 0x7f50ec15ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:19.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.392+0000 7f50f26a4700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50ec0afb70 con 0x7f50ec0b4a20 2020-04-22T14:12:19.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.392+0000 7f50f26a4700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50ec0afe10 con 0x7f50ec0b39d0 2020-04-22T14:12:19.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.392+0000 7f50f26a4700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50ec0b12c0 con 0x7f50ec12a420 2020-04-22T14:12:19.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.392+0000 7f50ebfff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f50ec0b39d0 0x7f50ec0b3db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44918/0 (socket says 172.21.15.103:44918) 2020-04-22T14:12:19.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.392+0000 7f50ebfff700 1 -- 172.21.15.103:0/3467663361 learned_addr learned my addr 172.21.15.103:0/3467663361 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:19.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.392+0000 7f50e97fa700 1 -- 172.21.15.103:0/3467663361 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2268159908 0 0) 0x7f50ec0afe10 con 0x7f50ec0b39d0 2020-04-22T14:12:19.412 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.392+0000 7f50e97fa700 1 -- 172.21.15.103:0/3467663361 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50cc002fe0 con 0x7f50ec0b39d0 2020-04-22T14:12:19.412 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.392+0000 7f50f0c41700 1 --2- 172.21.15.103:0/3467663361 >> v2:172.21.15.86:3300/0 conn(0x7f50ec12a420 0x7f50ec15ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:19.412 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.392+0000 7f50e97fa700 1 -- 172.21.15.103:0/3467663361 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3904454794 0 0) 0x7f50cc002fe0 con 0x7f50ec0b39d0 2020-04-22T14:12:19.412 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.392+0000 7f50e97fa700 1 -- 172.21.15.103:0/3467663361 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f50ec0afe10 con 0x7f50ec0b39d0 2020-04-22T14:12:19.412 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.392+0000 7f50e97fa700 1 -- 172.21.15.103:0/3467663361 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f50dc001490 con 0x7f50ec0b39d0 2020-04-22T14:12:19.412 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.393+0000 7f50e97fa700 1 -- 172.21.15.103:0/3467663361 >> v2:172.21.15.86:3300/0 conn(0x7f50ec12a420 msgr2=0x7f50ec15ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:19.412 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.393+0000 7f50e97fa700 1 --2- 172.21.15.103:0/3467663361 >> v2:172.21.15.86:3300/0 conn(0x7f50ec12a420 0x7f50ec15ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:19.413 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.393+0000 7f50e97fa700 1 -- 172.21.15.103:0/3467663361 >> v1:172.21.15.103:6789/0 conn(0x7f50ec0b39d0 legacy=0x7f50ec0b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:19.413 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.393+0000 7f50e97fa700 1 -- 172.21.15.103:0/3467663361 >> v1:172.21.15.86:6789/0 conn(0x7f50ec0b4a20 legacy=0x7f50ec129d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:19.413 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.393+0000 7f50e97fa700 1 --2- 172.21.15.103:0/3467663361 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f50cc004a00 0x7f50cc004de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:19.413 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.393+0000 7f50e97fa700 1 --2- 172.21.15.103:0/3467663361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50cc003920 0x7f50cc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:19.413 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.393+0000 7f50e97fa700 1 --2- 172.21.15.103:0/3467663361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50cc004200 0x7f50cc00b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:19.413 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.393+0000 7f50e97fa700 1 -- 172.21.15.103:0/3467663361 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ec0b12c0 con 0x7f50cc003920 2020-04-22T14:12:19.413 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.393+0000 7f50e97fa700 1 -- 172.21.15.103:0/3467663361 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc00bbb0 con 0x7f50cc004200 2020-04-22T14:12:19.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.393+0000 7f50e97fa700 1 -- 172.21.15.103:0/3467663361 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc00df00 con 0x7f50cc004a00 2020-04-22T14:12:19.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.393+0000 7f50f0c41700 1 --2- 172.21.15.103:0/3467663361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50cc004200 0x7f50cc00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:19.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.393+0000 7f50ebfff700 1 --2- 172.21.15.103:0/3467663361 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f50cc004a00 0x7f50cc004de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:19.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.393+0000 7f50eb7fe700 1 --2- 172.21.15.103:0/3467663361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50cc003920 0x7f50cc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:19.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.393+0000 7f50f0c41700 1 -- 172.21.15.103:0/3467663361 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f50cc004a00 msgr2=0x7f50cc004de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:19.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.393+0000 7f50f0c41700 1 --2- 172.21.15.103:0/3467663361 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f50cc004a00 0x7f50cc004de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:19.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.393+0000 7f50f0c41700 1 -- 172.21.15.103:0/3467663361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50cc003920 msgr2=0x7f50cc003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:19.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.393+0000 7f50f0c41700 1 --2- 172.21.15.103:0/3467663361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50cc003920 0x7f50cc003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:19.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.393+0000 7f50f0c41700 1 -- 172.21.15.103:0/3467663361 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50ec0b44c0 con 0x7f50cc004200 2020-04-22T14:12:19.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.393+0000 7f50f26a4700 1 -- 172.21.15.103:0/3467663361 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50ec1506e0 con 0x7f50cc004200 2020-04-22T14:12:19.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.393+0000 7f50f0c41700 1 --2- 172.21.15.103:0/3467663361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50cc004200 0x7f50cc00b750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f50e00010d0 tx=0x7f50e4010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.393+0000 7f50f26a4700 1 -- 172.21.15.103:0/3467663361 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50ec0b5300 con 0x7f50cc004200 2020-04-22T14:12:19.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.393+0000 7f50f0c41700 1 -- 172.21.15.103:0/3467663361 reap_dead start 2020-04-22T14:12:19.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.393+0000 7f50f0c41700 1 --2- 172.21.15.103:0/3467663361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50cc004200 0x7f50cc00b750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f50e00010d0 tx=0x7f50e4010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.393+0000 7f50f0c41700 1 --2- 172.21.15.103:0/3467663361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50cc004200 0x7f50cc00b750 secure :-1 s=READY pgs=1077 cs=0 l=1 rx=0x7f50e00010d0 tx=0x7f50e4010ea0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:19.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.393+0000 7f50f0c41700 1 --2- 172.21.15.103:0/3467663361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50cc004200 0x7f50cc00b750 secure :-1 s=THROTTLE_DONE pgs=1077 cs=0 l=1 rx=0x7f50e00010d0 tx=0x7f50e4010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.393+0000 7f50e97fa700 1 -- 172.21.15.103:0/3467663361 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50e4005e20 con 0x7f50cc004200 2020-04-22T14:12:19.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.393+0000 7f50f0c41700 1 --2- 172.21.15.103:0/3467663361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50cc004200 0x7f50cc00b750 secure :-1 s=THROTTLE_DONE pgs=1077 cs=0 l=1 rx=0x7f50e00010d0 tx=0x7f50e4010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.393+0000 7f50f0c41700 1 --2- 172.21.15.103:0/3467663361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50cc004200 0x7f50cc00b750 secure :-1 s=THROTTLE_DONE pgs=1077 cs=0 l=1 rx=0x7f50e00010d0 tx=0x7f50e4010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.393+0000 7f50e97fa700 1 -- 172.21.15.103:0/3467663361 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e4012760 con 0x7f50cc004200 2020-04-22T14:12:19.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.393+0000 7f50e97fa700 1 -- 172.21.15.103:0/3467663361 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50e4012ac0 con 0x7f50cc004200 2020-04-22T14:12:19.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.394+0000 7f50f0c41700 1 --2- 172.21.15.103:0/3467663361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50cc004200 0x7f50cc00b750 secure :-1 s=THROTTLE_DONE pgs=1077 cs=0 l=1 rx=0x7f50e00010d0 tx=0x7f50e4010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.394+0000 7f50f26a4700 1 -- 172.21.15.103:0/3467663361 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50c8003340 con 0x7f50cc004200 2020-04-22T14:12:19.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.394+0000 7f50e97fa700 1 -- 172.21.15.103:0/3467663361 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f50e4012c20 con 0x7f50cc004200 2020-04-22T14:12:19.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.394+0000 7f50f0c41700 1 --2- 172.21.15.103:0/3467663361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50cc004200 0x7f50cc00b750 secure :-1 s=THROTTLE_DONE pgs=1077 cs=0 l=1 rx=0x7f50e00010d0 tx=0x7f50e4010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.394+0000 7f50e97fa700 1 --2- 172.21.15.103:0/3467663361 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f50cc053370 0x7f50cc055830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:19.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.395+0000 7f50e97fa700 1 -- 172.21.15.103:0/3467663361 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f50e40612d0 con 0x7f50cc004200 2020-04-22T14:12:19.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.395+0000 7f50ebfff700 1 --2- 172.21.15.103:0/3467663361 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f50cc053370 0x7f50cc055830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:19.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.395+0000 7f50ebfff700 1 --2- 172.21.15.103:0/3467663361 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f50cc053370 0x7f50cc055830 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f50dc007fe0 tx=0x7f50dc008240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.395+0000 7f50ebfff700 1 --2- 172.21.15.103:0/3467663361 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f50cc053370 0x7f50cc055830 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f50dc007fe0 tx=0x7f50dc008240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.395+0000 7f50ebfff700 1 --2- 172.21.15.103:0/3467663361 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f50cc053370 0x7f50cc055830 secure :-1 s=READY pgs=398 cs=0 l=1 rx=0x7f50dc007fe0 tx=0x7f50dc008240).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:19.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.399+0000 7f50f0c41700 1 --2- 172.21.15.103:0/3467663361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50cc004200 0x7f50cc00b750 secure :-1 s=THROTTLE_DONE pgs=1077 cs=0 l=1 rx=0x7f50e00010d0 tx=0x7f50e4010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.399+0000 7f50e97fa700 1 -- 172.21.15.103:0/3467663361 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f50e403c7d0 con 0x7f50cc004200 2020-04-22T14:12:19.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.543+0000 7f50f26a4700 1 -- 172.21.15.103:0/3467663361 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50c80021d0 con 0x7f50cc004200 2020-04-22T14:12:19.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.544+0000 7f50f0c41700 1 --2- 172.21.15.103:0/3467663361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50cc004200 0x7f50cc00b750 secure :-1 s=THROTTLE_DONE pgs=1077 cs=0 l=1 rx=0x7f50e00010d0 tx=0x7f50e4010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.544+0000 7f50e97fa700 1 -- 172.21.15.103:0/3467663361 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16105 (secure 0 0 0) 0x7f50e403fdf0 con 0x7f50cc004200 2020-04-22T14:12:19.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.545+0000 7f50f26a4700 1 -- 172.21.15.103:0/3467663361 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f50cc053370 msgr2=0x7f50cc055830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:19.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.545+0000 7f50f26a4700 1 --2- 172.21.15.103:0/3467663361 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f50cc053370 0x7f50cc055830 secure :-1 s=READY pgs=398 cs=0 l=1 rx=0x7f50dc007fe0 tx=0x7f50dc008240).stop 2020-04-22T14:12:19.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.545+0000 7f50f26a4700 1 -- 172.21.15.103:0/3467663361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50cc004200 msgr2=0x7f50cc00b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:19.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.545+0000 7f50f26a4700 1 --2- 172.21.15.103:0/3467663361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50cc004200 0x7f50cc00b750 secure :-1 s=READY pgs=1077 cs=0 l=1 rx=0x7f50e00010d0 tx=0x7f50e4010ea0).stop 2020-04-22T14:12:19.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.545+0000 7f50f26a4700 1 -- 172.21.15.103:0/3467663361 shutdown_connections 2020-04-22T14:12:19.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.545+0000 7f50f26a4700 1 --2- 172.21.15.103:0/3467663361 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f50cc053370 0x7f50cc055830 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:19.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.545+0000 7f50f26a4700 1 --2- 172.21.15.103:0/3467663361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50cc004200 0x7f50cc00b750 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:19.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.545+0000 7f50f26a4700 1 -- 172.21.15.103:0/3467663361 >> 172.21.15.103:0/3467663361 conn(0x7f50ec0b9160 msgr2=0x7f50ec12ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:19.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.546+0000 7f50f26a4700 1 -- 172.21.15.103:0/3467663361 shutdown_connections 2020-04-22T14:12:19.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.546+0000 7f50f26a4700 1 -- 172.21.15.103:0/3467663361 wait complete. 2020-04-22T14:12:19.553 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:12:19.553 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":76,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:12:18.873678+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:12:16.799055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2020-04-22T14:12:17.819603+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:12:19.560 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:19.587 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-04-22T14:12:19.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.734+0000 7f3e0c6b4700 1 Processor -- start 2020-04-22T14:12:19.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.734+0000 7f3e0c6b4700 1 -- start start 2020-04-22T14:12:19.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.735+0000 7f3e0c6b4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e040acb10 0x7f3e04142630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:19.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.735+0000 7f3e0c6b4700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e040af030 con 0x7f3e04061a30 2020-04-22T14:12:19.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.735+0000 7f3e0c6b4700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e04060250 con 0x7f3e040b4820 2020-04-22T14:12:19.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.735+0000 7f3e0c6b4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e040623c0 con 0x7f3e040acb10 2020-04-22T14:12:19.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.735+0000 7f3e09c4f700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f3e040b4820 0x7f3e04141f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44932/0 (socket says 172.21.15.103:44932) 2020-04-22T14:12:19.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.735+0000 7f3e09c4f700 1 -- 172.21.15.103:0/900884323 learned_addr learned my addr 172.21.15.103:0/900884323 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:19.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.735+0000 7f3e0944e700 1 -- 172.21.15.103:0/900884323 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1930031202 0 0) 0x7f3e04060250 con 0x7f3e040b4820 2020-04-22T14:12:19.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.735+0000 7f3e0ac51700 1 --2- 172.21.15.103:0/900884323 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e040acb10 0x7f3e04142630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:19.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.735+0000 7f3e0944e700 1 -- 172.21.15.103:0/900884323 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dec003230 con 0x7f3e040b4820 2020-04-22T14:12:19.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.735+0000 7f3e0944e700 1 -- 172.21.15.103:0/900884323 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3089983820 0 0) 0x7f3dec003230 con 0x7f3e040b4820 2020-04-22T14:12:19.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.735+0000 7f3e0944e700 1 -- 172.21.15.103:0/900884323 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e040acb10 msgr2=0x7f3e04142630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:19.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.735+0000 7f3e0944e700 1 --2- 172.21.15.103:0/900884323 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e040acb10 0x7f3e04142630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:19.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.735+0000 7f3e0944e700 1 -- 172.21.15.103:0/900884323 >> v1:172.21.15.86:6789/0 conn(0x7f3e04061a30 legacy=0x7f3e040ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:19.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.735+0000 7f3e0944e700 1 -- 172.21.15.103:0/900884323 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e04062660 con 0x7f3e040b4820 2020-04-22T14:12:19.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.735+0000 7f3e0944e700 1 -- 172.21.15.103:0/900884323 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f3e000016d0 con 0x7f3e040b4820 2020-04-22T14:12:19.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.735+0000 7f3e0944e700 1 -- 172.21.15.103:0/900884323 >> v1:172.21.15.103:6789/0 conn(0x7f3e040b4820 legacy=0x7f3e04141f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:19.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.735+0000 7f3e0944e700 1 --2- 172.21.15.103:0/900884323 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e040acb10 0x7f3dec003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:19.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.735+0000 7f3e0944e700 1 --2- 172.21.15.103:0/900884323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dec003b80 0x7f3dec003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:19.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.736+0000 7f3e0944e700 1 --2- 172.21.15.103:0/900884323 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3dec0045c0 0x7f3dec004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:19.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.736+0000 7f3e0944e700 1 -- 172.21.15.103:0/900884323 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e040623c0 con 0x7f3dec0045c0 2020-04-22T14:12:19.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.736+0000 7f3e0944e700 1 -- 172.21.15.103:0/900884323 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec004fd0 con 0x7f3dec003b80 2020-04-22T14:12:19.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.736+0000 7f3e0944e700 1 -- 172.21.15.103:0/900884323 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec005190 con 0x7f3e040acb10 2020-04-22T14:12:19.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.736+0000 7f3e09c4f700 1 --2- 172.21.15.103:0/900884323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dec003b80 0x7f3dec003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:19.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.736+0000 7f3e0ac51700 1 --2- 172.21.15.103:0/900884323 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3dec0045c0 0x7f3dec004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:19.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.736+0000 7f3e0a450700 1 --2- 172.21.15.103:0/900884323 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e040acb10 0x7f3dec003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:19.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.736+0000 7f3e09c4f700 1 -- 172.21.15.103:0/900884323 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e040acb10 msgr2=0x7f3dec003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:19.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.736+0000 7f3e09c4f700 1 --2- 172.21.15.103:0/900884323 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e040acb10 0x7f3dec003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:19.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.736+0000 7f3e09c4f700 1 -- 172.21.15.103:0/900884323 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3dec0045c0 msgr2=0x7f3dec004a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:19.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.736+0000 7f3e09c4f700 1 --2- 172.21.15.103:0/900884323 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3dec0045c0 0x7f3dec004a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:19.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.736+0000 7f3e09c4f700 1 -- 172.21.15.103:0/900884323 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dec003230 con 0x7f3dec003b80 2020-04-22T14:12:19.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.736+0000 7f3e0ac51700 1 --2- 172.21.15.103:0/900884323 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3dec0045c0 0x7f3dec004a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:12:19.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.736+0000 7f3e0a450700 1 --2- 172.21.15.103:0/900884323 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e040acb10 0x7f3dec003720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:12:19.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.736+0000 7f3e09c4f700 1 --2- 172.21.15.103:0/900884323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dec003b80 0x7f3dec003fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3e000013e0 tx=0x7f3e04066ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.736+0000 7f3e09c4f700 1 --2- 172.21.15.103:0/900884323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dec003b80 0x7f3dec003fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3e000013e0 tx=0x7f3e04066ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.736+0000 7f3e09c4f700 1 --2- 172.21.15.103:0/900884323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dec003b80 0x7f3dec003fe0 secure :-1 s=READY pgs=1079 cs=0 l=1 rx=0x7f3e000013e0 tx=0x7f3e04066ea0).ready entity=mon.1 client_cookie=664e377298fd4fc8 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:19.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.736+0000 7f3e09c4f700 1 --2- 172.21.15.103:0/900884323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dec003b80 0x7f3dec003fe0 secure :-1 s=THROTTLE_DONE pgs=1079 cs=0 l=1 rx=0x7f3e000013e0 tx=0x7f3e04066ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.736+0000 7f3e0944e700 1 -- 172.21.15.103:0/900884323 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e0000ce70 con 0x7f3dec003b80 2020-04-22T14:12:19.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.736+0000 7f3e09c4f700 1 --2- 172.21.15.103:0/900884323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dec003b80 0x7f3dec003fe0 secure :-1 s=THROTTLE_DONE pgs=1079 cs=0 l=1 rx=0x7f3e000013e0 tx=0x7f3e04066ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.736+0000 7f3e09c4f700 1 --2- 172.21.15.103:0/900884323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dec003b80 0x7f3dec003fe0 secure :-1 s=THROTTLE_DONE pgs=1079 cs=0 l=1 rx=0x7f3e000013e0 tx=0x7f3e04066ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.736+0000 7f3e0944e700 1 -- 172.21.15.103:0/900884323 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0000e370 con 0x7f3dec003b80 2020-04-22T14:12:19.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.736+0000 7f3e0944e700 1 -- 172.21.15.103:0/900884323 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e0000e750 con 0x7f3dec003b80 2020-04-22T14:12:19.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.736+0000 7f3e0c6b4700 1 -- 172.21.15.103:0/900884323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dec003b80 msgr2=0x7f3dec003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:19.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.736+0000 7f3e0c6b4700 1 --2- 172.21.15.103:0/900884323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dec003b80 0x7f3dec003fe0 secure :-1 s=READY pgs=1079 cs=0 l=1 rx=0x7f3e000013e0 tx=0x7f3e04066ea0).stop 2020-04-22T14:12:19.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.736+0000 7f3e0ac51700 1 -- 172.21.15.103:0/900884323 reap_dead start 2020-04-22T14:12:19.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.737+0000 7f3e0c6b4700 1 -- 172.21.15.103:0/900884323 shutdown_connections 2020-04-22T14:12:19.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.737+0000 7f3e0c6b4700 1 -- 172.21.15.103:0/900884323 >> 172.21.15.103:0/900884323 conn(0x7f3e0405b7b0 msgr2=0x7f3e040b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:19.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.737+0000 7f3e0c6b4700 1 -- 172.21.15.103:0/900884323 shutdown_connections 2020-04-22T14:12:19.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.737+0000 7f3e0c6b4700 1 -- 172.21.15.103:0/900884323 wait complete. 2020-04-22T14:12:19.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.738+0000 7f3e0c6b4700 1 Processor -- start 2020-04-22T14:12:19.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.738+0000 7f3e0c6b4700 1 -- start start 2020-04-22T14:12:19.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.738+0000 7f3e0c6b4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e04144280 0x7f3e04112650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:19.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.738+0000 7f3e0c6b4700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3e041545d0 0x7f3e041515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:19.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.738+0000 7f3e0c6b4700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e040646a0 con 0x7f3e041135b0 2020-04-22T14:12:19.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.738+0000 7f3e0c6b4700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e04064940 con 0x7f3e041545d0 2020-04-22T14:12:19.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.738+0000 7f3e0c6b4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e04064be0 con 0x7f3e04144280 2020-04-22T14:12:19.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.738+0000 7f3e09c4f700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f3e041135b0 0x7f3e04153ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44946/0 (socket says 172.21.15.103:44946) 2020-04-22T14:12:19.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.738+0000 7f3e09c4f700 1 -- 172.21.15.103:0/682900227 learned_addr learned my addr 172.21.15.103:0/682900227 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:19.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.739+0000 7f3df77fe700 1 -- 172.21.15.103:0/682900227 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1740054285 0 0) 0x7f3e040646a0 con 0x7f3e041135b0 2020-04-22T14:12:19.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.739+0000 7f3df77fe700 1 -- 172.21.15.103:0/682900227 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3de4002fe0 con 0x7f3e041135b0 2020-04-22T14:12:19.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.739+0000 7f3e0a450700 1 --2- 172.21.15.103:0/682900227 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e04144280 0x7f3e04112650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:19.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.739+0000 7f3e0ac51700 1 --2- 172.21.15.103:0/682900227 >> v2:172.21.15.86:3300/0 conn(0x7f3e041545d0 0x7f3e041515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:19.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.739+0000 7f3df77fe700 1 -- 172.21.15.103:0/682900227 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1995613630 0 0) 0x7f3de4002fe0 con 0x7f3e041135b0 2020-04-22T14:12:19.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.739+0000 7f3df77fe700 1 -- 172.21.15.103:0/682900227 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3e040646a0 con 0x7f3e041135b0 2020-04-22T14:12:19.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.739+0000 7f3df77fe700 1 -- 172.21.15.103:0/682900227 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f3e0000ce70 con 0x7f3e041135b0 2020-04-22T14:12:19.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.739+0000 7f3df77fe700 1 -- 172.21.15.103:0/682900227 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e04144280 msgr2=0x7f3e04112650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:19.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.739+0000 7f3df77fe700 1 --2- 172.21.15.103:0/682900227 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e04144280 0x7f3e04112650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:19.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.739+0000 7f3df77fe700 1 -- 172.21.15.103:0/682900227 >> v2:172.21.15.86:3300/0 conn(0x7f3e041545d0 msgr2=0x7f3e041515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:19.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.739+0000 7f3df77fe700 1 --2- 172.21.15.103:0/682900227 >> v2:172.21.15.86:3300/0 conn(0x7f3e041545d0 0x7f3e041515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:19.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.739+0000 7f3df77fe700 1 -- 172.21.15.103:0/682900227 >> v1:172.21.15.103:6789/0 conn(0x7f3e041135b0 legacy=0x7f3e04153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:19.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.739+0000 7f3df77fe700 1 --2- 172.21.15.103:0/682900227 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3de40049b0 0x7f3de4004df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:19.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.739+0000 7f3df77fe700 1 --2- 172.21.15.103:0/682900227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3de4003920 0x7f3de4003d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:19.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.739+0000 7f3df77fe700 1 --2- 172.21.15.103:0/682900227 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e04144280 0x7f3de40041e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:19.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.739+0000 7f3df77fe700 1 -- 172.21.15.103:0/682900227 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e04064940 con 0x7f3de4003920 2020-04-22T14:12:19.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.739+0000 7f3df77fe700 1 -- 172.21.15.103:0/682900227 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e04064be0 con 0x7f3de40049b0 2020-04-22T14:12:19.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.739+0000 7f3df77fe700 1 -- 172.21.15.103:0/682900227 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de4004640 con 0x7f3e04144280 2020-04-22T14:12:19.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.739+0000 7f3e0a450700 1 --2- 172.21.15.103:0/682900227 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3de40049b0 0x7f3de4004df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:19.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.739+0000 7f3e09c4f700 1 --2- 172.21.15.103:0/682900227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3de4003920 0x7f3de4003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:19.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.739+0000 7f3e0ac51700 1 --2- 172.21.15.103:0/682900227 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e04144280 0x7f3de40041e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:19.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.739+0000 7f3e0a450700 1 -- 172.21.15.103:0/682900227 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e04144280 msgr2=0x7f3de40041e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:19.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.739+0000 7f3e0a450700 1 --2- 172.21.15.103:0/682900227 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e04144280 0x7f3de40041e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:19.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.739+0000 7f3e0a450700 1 -- 172.21.15.103:0/682900227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3de4003920 msgr2=0x7f3de4003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:19.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.739+0000 7f3e0a450700 1 --2- 172.21.15.103:0/682900227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3de4003920 0x7f3de4003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:19.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.739+0000 7f3e0a450700 1 -- 172.21.15.103:0/682900227 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e04144660 con 0x7f3de40049b0 2020-04-22T14:12:19.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.739+0000 7f3e0c6b4700 1 -- 172.21.15.103:0/682900227 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e04151a00 con 0x7f3de40049b0 2020-04-22T14:12:19.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.739+0000 7f3e0ac51700 1 --2- 172.21.15.103:0/682900227 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e04144280 0x7f3de40041e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:12:19.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.739+0000 7f3e0a450700 1 --2- 172.21.15.103:0/682900227 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3de40049b0 0x7f3de4004df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3e0405bc40 tx=0x7f3df8010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.739+0000 7f3e0c6b4700 1 -- 172.21.15.103:0/682900227 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e04112650 con 0x7f3de40049b0 2020-04-22T14:12:19.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.739+0000 7f3e0a450700 1 --2- 172.21.15.103:0/682900227 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3de40049b0 0x7f3de4004df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3e0405bc40 tx=0x7f3df8010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.739+0000 7f3e0a450700 1 --2- 172.21.15.103:0/682900227 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3de40049b0 0x7f3de4004df0 secure :-1 s=READY pgs=1081 cs=0 l=1 rx=0x7f3e0405bc40 tx=0x7f3df8010df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:19.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.740+0000 7f3e0a450700 1 --2- 172.21.15.103:0/682900227 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3de40049b0 0x7f3de4004df0 secure :-1 s=THROTTLE_DONE pgs=1081 cs=0 l=1 rx=0x7f3e0405bc40 tx=0x7f3df8010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.740+0000 7f3df77fe700 1 -- 172.21.15.103:0/682900227 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3df8011bf0 con 0x7f3de40049b0 2020-04-22T14:12:19.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.740+0000 7f3e0a450700 1 --2- 172.21.15.103:0/682900227 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3de40049b0 0x7f3de4004df0 secure :-1 s=THROTTLE_DONE pgs=1081 cs=0 l=1 rx=0x7f3e0405bc40 tx=0x7f3df8010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.740+0000 7f3e0a450700 1 --2- 172.21.15.103:0/682900227 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3de40049b0 0x7f3de4004df0 secure :-1 s=THROTTLE_DONE pgs=1081 cs=0 l=1 rx=0x7f3e0405bc40 tx=0x7f3df8010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.740+0000 7f3df77fe700 1 -- 172.21.15.103:0/682900227 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df8011d50 con 0x7f3de40049b0 2020-04-22T14:12:19.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.740+0000 7f3df77fe700 1 -- 172.21.15.103:0/682900227 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3df80064e0 con 0x7f3de40049b0 2020-04-22T14:12:19.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.740+0000 7f3e0a450700 1 --2- 172.21.15.103:0/682900227 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3de40049b0 0x7f3de4004df0 secure :-1 s=THROTTLE_DONE pgs=1081 cs=0 l=1 rx=0x7f3e0405bc40 tx=0x7f3df8010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.740+0000 7f3e0c6b4700 1 -- 172.21.15.103:0/682900227 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3de0003340 con 0x7f3de40049b0 2020-04-22T14:12:19.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.741+0000 7f3e0a450700 1 --2- 172.21.15.103:0/682900227 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3de40049b0 0x7f3de4004df0 secure :-1 s=THROTTLE_DONE pgs=1081 cs=0 l=1 rx=0x7f3e0405bc40 tx=0x7f3df8010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.741+0000 7f3df77fe700 1 -- 172.21.15.103:0/682900227 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f3df8006640 con 0x7f3de40049b0 2020-04-22T14:12:19.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.741+0000 7f3df77fe700 1 --2- 172.21.15.103:0/682900227 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3de4055b60 0x7f3de4058020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:19.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.741+0000 7f3df77fe700 1 -- 172.21.15.103:0/682900227 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3df8061090 con 0x7f3de40049b0 2020-04-22T14:12:19.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.741+0000 7f3e09c4f700 1 --2- 172.21.15.103:0/682900227 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3de4055b60 0x7f3de4058020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:19.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.742+0000 7f3e09c4f700 1 --2- 172.21.15.103:0/682900227 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3de4055b60 0x7f3de4058020 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3e00001d50 tx=0x7f3e04066ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.742+0000 7f3e09c4f700 1 --2- 172.21.15.103:0/682900227 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3de4055b60 0x7f3de4058020 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3e00001d50 tx=0x7f3e04066ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.742+0000 7f3e09c4f700 1 --2- 172.21.15.103:0/682900227 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3de4055b60 0x7f3de4058020 secure :-1 s=READY pgs=399 cs=0 l=1 rx=0x7f3e00001d50 tx=0x7f3e04066ea0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:19.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.745+0000 7f3e0a450700 1 --2- 172.21.15.103:0/682900227 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3de40049b0 0x7f3de4004df0 secure :-1 s=THROTTLE_DONE pgs=1081 cs=0 l=1 rx=0x7f3e0405bc40 tx=0x7f3df8010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:19.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.745+0000 7f3df77fe700 1 -- 172.21.15.103:0/682900227 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f3df803c4d0 con 0x7f3de40049b0 2020-04-22T14:12:19.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:19.936+0000 7f3e0c6b4700 1 -- 172.21.15.103:0/682900227 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f3de0002220 con 0x7f3de40049b0 2020-04-22T14:12:20.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:20.739+0000 7f3e0a450700 1 --2- 172.21.15.103:0/682900227 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3de40049b0 0x7f3de4004df0 secure :-1 s=READY pgs=1081 cs=0 l=1 rx=0x7f3e0405bc40 tx=0x7f3df8010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:20.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:20.887+0000 7f3e0a450700 1 --2- 172.21.15.103:0/682900227 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3de40049b0 0x7f3de4004df0 secure :-1 s=THROTTLE_DONE pgs=1081 cs=0 l=1 rx=0x7f3e0405bc40 tx=0x7f3df8010df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:20.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:20.887+0000 7f3df77fe700 1 -- 172.21.15.103:0/682900227 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v50) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3df803faf0 con 0x7f3de40049b0 2020-04-22T14:12:20.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:20.889+0000 7f3e0c6b4700 1 -- 172.21.15.103:0/682900227 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3de4055b60 msgr2=0x7f3de4058020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:20.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:20.890+0000 7f3e0c6b4700 1 --2- 172.21.15.103:0/682900227 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3de4055b60 0x7f3de4058020 secure :-1 s=READY pgs=399 cs=0 l=1 rx=0x7f3e00001d50 tx=0x7f3e04066ea0).stop 2020-04-22T14:12:20.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:20.890+0000 7f3e0c6b4700 1 -- 172.21.15.103:0/682900227 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3de40049b0 msgr2=0x7f3de4004df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:20.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:20.890+0000 7f3e0c6b4700 1 --2- 172.21.15.103:0/682900227 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3de40049b0 0x7f3de4004df0 secure :-1 s=READY pgs=1081 cs=0 l=1 rx=0x7f3e0405bc40 tx=0x7f3df8010df0).stop 2020-04-22T14:12:20.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:20.890+0000 7f3e0ac51700 1 -- 172.21.15.103:0/682900227 reap_dead start 2020-04-22T14:12:20.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:20.890+0000 7f3e0c6b4700 1 -- 172.21.15.103:0/682900227 shutdown_connections 2020-04-22T14:12:20.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:20.890+0000 7f3e0c6b4700 1 -- 172.21.15.103:0/682900227 >> 172.21.15.103:0/682900227 conn(0x7f3e0405b7b0 msgr2=0x7f3e040b5000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:20.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:20.890+0000 7f3e0c6b4700 1 -- 172.21.15.103:0/682900227 shutdown_connections 2020-04-22T14:12:20.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:20.890+0000 7f3e0c6b4700 1 -- 172.21.15.103:0/682900227 wait complete. 2020-04-22T14:12:20.905 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:20.921 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:12:21.070 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.067+0000 7f7b8cf32700 1 Processor -- start 2020-04-22T14:12:21.070 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.067+0000 7f7b8cf32700 1 -- start start 2020-04-22T14:12:21.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.068+0000 7f7b8cf32700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b8812c0d0 0x7f7b881464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:21.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.068+0000 7f7b8cf32700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7b88065fe0 0x7f7b8805b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:21.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.068+0000 7f7b8cf32700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b88143300 con 0x7f7b8805b8a0 2020-04-22T14:12:21.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.068+0000 7f7b8cf32700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b8812c4b0 con 0x7f7b88065fe0 2020-04-22T14:12:21.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.068+0000 7f7b8cf32700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b881435a0 con 0x7f7b8812c0d0 2020-04-22T14:12:21.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.068+0000 7f7b85d9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7b88065fe0 0x7f7b8805b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:21.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.068+0000 7f7b85d9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7b88065fe0 0x7f7b8805b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:50000/0 (socket says 172.21.15.103:50000) 2020-04-22T14:12:21.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.068+0000 7f7b8659c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b8812c0d0 0x7f7b881464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:21.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.068+0000 7f7b85d9b700 1 -- 172.21.15.103:0/248547238 learned_addr learned my addr 172.21.15.103:0/248547238 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:21.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.068+0000 7f7b85d9b700 1 -- 172.21.15.103:0/248547238 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b8812c0d0 msgr2=0x7f7b881464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:21.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.068+0000 7f7b85d9b700 1 --2- 172.21.15.103:0/248547238 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b8812c0d0 0x7f7b881464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:21.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.068+0000 7f7b85d9b700 1 -- 172.21.15.103:0/248547238 >> v1:172.21.15.86:6789/0 conn(0x7f7b8805b8a0 legacy=0x7f7b88062ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:21.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.068+0000 7f7b85d9b700 1 -- 172.21.15.103:0/248547238 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b88143840 con 0x7f7b88065fe0 2020-04-22T14:12:21.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.068+0000 7f7b8659c700 1 --2- 172.21.15.103:0/248547238 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b8812c0d0 0x7f7b881464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:12:21.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.068+0000 7f7b85d9b700 1 --2- 172.21.15.103:0/248547238 >> v2:172.21.15.86:3300/0 conn(0x7f7b88065fe0 0x7f7b8805b440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7b78002f30 tx=0x7f7b78007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.069+0000 7f7b85d9b700 1 --2- 172.21.15.103:0/248547238 >> v2:172.21.15.86:3300/0 conn(0x7f7b88065fe0 0x7f7b8805b440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7b78002f30 tx=0x7f7b78007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.069+0000 7f7b85d9b700 1 --2- 172.21.15.103:0/248547238 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b88065fe0 0x7f7b8805b440 secure :-1 s=READY pgs=587 cs=0 l=1 rx=0x7f7b78002f30 tx=0x7f7b78007a40).ready entity=mon.0 client_cookie=2009d26ec986039a server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:21.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.069+0000 7f7b85d9b700 1 --2- 172.21.15.103:0/248547238 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b88065fe0 0x7f7b8805b440 secure :-1 s=THROTTLE_DONE pgs=587 cs=0 l=1 rx=0x7f7b78002f30 tx=0x7f7b78007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.069+0000 7f7b8559a700 1 -- 172.21.15.103:0/248547238 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b78011670 con 0x7f7b88065fe0 2020-04-22T14:12:21.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.069+0000 7f7b85d9b700 1 --2- 172.21.15.103:0/248547238 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b88065fe0 0x7f7b8805b440 secure :-1 s=THROTTLE_DONE pgs=587 cs=0 l=1 rx=0x7f7b78002f30 tx=0x7f7b78007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.069+0000 7f7b8559a700 1 -- 172.21.15.103:0/248547238 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b78011810 con 0x7f7b88065fe0 2020-04-22T14:12:21.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.069+0000 7f7b85d9b700 1 --2- 172.21.15.103:0/248547238 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b88065fe0 0x7f7b8805b440 secure :-1 s=THROTTLE_DONE pgs=587 cs=0 l=1 rx=0x7f7b78002f30 tx=0x7f7b78007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.069+0000 7f7b8cf32700 1 -- 172.21.15.103:0/248547238 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b88065fe0 msgr2=0x7f7b8805b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:21.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.069+0000 7f7b8cf32700 1 --2- 172.21.15.103:0/248547238 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b88065fe0 0x7f7b8805b440 secure :-1 s=READY pgs=587 cs=0 l=1 rx=0x7f7b78002f30 tx=0x7f7b78007a40).stop 2020-04-22T14:12:21.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.069+0000 7f7b8559a700 1 -- 172.21.15.103:0/248547238 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b78011c30 con 0x7f7b88065fe0 2020-04-22T14:12:21.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.069+0000 7f7b8cf32700 1 -- 172.21.15.103:0/248547238 shutdown_connections 2020-04-22T14:12:21.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.069+0000 7f7b8cf32700 1 --2- 172.21.15.103:0/248547238 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b8812c0d0 0x7f7b881464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:21.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.069+0000 7f7b8cf32700 1 --2- 172.21.15.103:0/248547238 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b88065fe0 0x7f7b8805b440 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:21.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.069+0000 7f7b8cf32700 1 -- 172.21.15.103:0/248547238 >> 172.21.15.103:0/248547238 conn(0x7f7b880b9160 msgr2=0x7f7b8805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:21.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.069+0000 7f7b8cf32700 1 -- 172.21.15.103:0/248547238 shutdown_connections 2020-04-22T14:12:21.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.069+0000 7f7b8cf32700 1 -- 172.21.15.103:0/248547238 wait complete. 2020-04-22T14:12:21.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.070+0000 7f7b8cf32700 1 Processor -- start 2020-04-22T14:12:21.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.070+0000 7f7b8cf32700 1 -- start start 2020-04-22T14:12:21.082 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.071+0000 7f7b8cf32700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7b8805b8a0 0x7f7b880adc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:21.082 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.071+0000 7f7b8cf32700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b88065fe0 0x7f7b880af490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:21.082 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.071+0000 7f7b8cf32700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b880ad230 con 0x7f7b8812c0d0 2020-04-22T14:12:21.082 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.071+0000 7f7b8cf32700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b88128d00 con 0x7f7b8805b8a0 2020-04-22T14:12:21.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.071+0000 7f7b8cf32700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b880afa80 con 0x7f7b88065fe0 2020-04-22T14:12:21.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.071+0000 7f7b85d9b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b88065fe0 0x7f7b880af490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:21.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.071+0000 7f7b8659c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7b8805b8a0 0x7f7b880adc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:21.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.071+0000 7f7b85d9b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b88065fe0 0x7f7b880af490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:37550/0 (socket says 172.21.15.103:37550) 2020-04-22T14:12:21.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.071+0000 7f7b85d9b700 1 -- 172.21.15.103:0/630549270 learned_addr learned my addr 172.21.15.103:0/630549270 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:21.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.072+0000 7f7b8659c700 1 -- 172.21.15.103:0/630549270 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b88065fe0 msgr2=0x7f7b880af490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:21.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.072+0000 7f7b8659c700 1 --2- 172.21.15.103:0/630549270 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b88065fe0 0x7f7b880af490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:21.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.072+0000 7f7b8659c700 1 -- 172.21.15.103:0/630549270 >> v1:172.21.15.86:6789/0 conn(0x7f7b8812c0d0 legacy=0x7f7b880b3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:21.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.072+0000 7f7b8659c700 1 -- 172.21.15.103:0/630549270 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b880afd20 con 0x7f7b8805b8a0 2020-04-22T14:12:21.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.072+0000 7f7b85d9b700 1 --2- 172.21.15.103:0/630549270 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b88065fe0 0x7f7b880af490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:12:21.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.072+0000 7f7b8659c700 1 --2- 172.21.15.103:0/630549270 >> v2:172.21.15.86:3300/0 conn(0x7f7b8805b8a0 0x7f7b880adc70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7b800032b0 tx=0x7f7b800110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.072+0000 7f7b8659c700 1 --2- 172.21.15.103:0/630549270 >> v2:172.21.15.86:3300/0 conn(0x7f7b8805b8a0 0x7f7b880adc70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7b800032b0 tx=0x7f7b800110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.072+0000 7f7b8659c700 1 --2- 172.21.15.103:0/630549270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b8805b8a0 0x7f7b880adc70 secure :-1 s=READY pgs=589 cs=0 l=1 rx=0x7f7b800032b0 tx=0x7f7b800110f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:21.087 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.072+0000 7f7b8659c700 1 --2- 172.21.15.103:0/630549270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b8805b8a0 0x7f7b880adc70 secure :-1 s=THROTTLE_DONE pgs=589 cs=0 l=1 rx=0x7f7b800032b0 tx=0x7f7b800110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.087 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.072+0000 7f7b7f7fe700 1 -- 172.21.15.103:0/630549270 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b80012980 con 0x7f7b8805b8a0 2020-04-22T14:12:21.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.072+0000 7f7b8659c700 1 --2- 172.21.15.103:0/630549270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b8805b8a0 0x7f7b880adc70 secure :-1 s=THROTTLE_DONE pgs=589 cs=0 l=1 rx=0x7f7b800032b0 tx=0x7f7b800110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.072+0000 7f7b7f7fe700 1 -- 172.21.15.103:0/630549270 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b80012ae0 con 0x7f7b8805b8a0 2020-04-22T14:12:21.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.072+0000 7f7b8659c700 1 --2- 172.21.15.103:0/630549270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b8805b8a0 0x7f7b880adc70 secure :-1 s=THROTTLE_DONE pgs=589 cs=0 l=1 rx=0x7f7b800032b0 tx=0x7f7b800110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.072+0000 7f7b7f7fe700 1 -- 172.21.15.103:0/630549270 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b80007180 con 0x7f7b8805b8a0 2020-04-22T14:12:21.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.072+0000 7f7b8cf32700 1 -- 172.21.15.103:0/630549270 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b880affc0 con 0x7f7b8805b8a0 2020-04-22T14:12:21.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.072+0000 7f7b8cf32700 1 -- 172.21.15.103:0/630549270 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b880b44d0 con 0x7f7b8805b8a0 2020-04-22T14:12:21.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.073+0000 7f7b8659c700 1 --2- 172.21.15.103:0/630549270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b8805b8a0 0x7f7b880adc70 secure :-1 s=THROTTLE_DONE pgs=589 cs=0 l=1 rx=0x7f7b800032b0 tx=0x7f7b800110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.073+0000 7f7b8cf32700 1 -- 172.21.15.103:0/630549270 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b880af8f0 con 0x7f7b8805b8a0 2020-04-22T14:12:21.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.073+0000 7f7b7f7fe700 1 -- 172.21.15.103:0/630549270 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f7b8000b280 con 0x7f7b8805b8a0 2020-04-22T14:12:21.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.073+0000 7f7b8659c700 1 --2- 172.21.15.103:0/630549270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b8805b8a0 0x7f7b880adc70 secure :-1 s=THROTTLE_DONE pgs=589 cs=0 l=1 rx=0x7f7b800032b0 tx=0x7f7b800110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.074+0000 7f7b7f7fe700 1 --2- 172.21.15.103:0/630549270 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7b6c04d9a0 0x7f7b6c04fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:21.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.074+0000 7f7b7f7fe700 1 -- 172.21.15.103:0/630549270 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7b800617d0 con 0x7f7b8805b8a0 2020-04-22T14:12:21.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.074+0000 7f7b85d9b700 1 --2- 172.21.15.103:0/630549270 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7b6c04d9a0 0x7f7b6c04fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:21.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.074+0000 7f7b85d9b700 1 --2- 172.21.15.103:0/630549270 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7b6c04d9a0 0x7f7b6c04fe60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7b78002f30 tx=0x7f7b78007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.074+0000 7f7b85d9b700 1 --2- 172.21.15.103:0/630549270 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7b6c04d9a0 0x7f7b6c04fe60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7b78002f30 tx=0x7f7b78007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.074+0000 7f7b85d9b700 1 --2- 172.21.15.103:0/630549270 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7b6c04d9a0 0x7f7b6c04fe60 secure :-1 s=READY pgs=400 cs=0 l=1 rx=0x7f7b78002f30 tx=0x7f7b78007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:21.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.078+0000 7f7b8659c700 1 --2- 172.21.15.103:0/630549270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b8805b8a0 0x7f7b880adc70 secure :-1 s=THROTTLE_DONE pgs=589 cs=0 l=1 rx=0x7f7b800032b0 tx=0x7f7b800110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.078+0000 7f7b7f7fe700 1 -- 172.21.15.103:0/630549270 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f7b8003cb50 con 0x7f7b8805b8a0 2020-04-22T14:12:21.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.267+0000 7f7b8cf32700 1 -- 172.21.15.103:0/630549270 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b88056c90 con 0x7f7b8805b8a0 2020-04-22T14:12:21.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.267+0000 7f7b8659c700 1 --2- 172.21.15.103:0/630549270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b8805b8a0 0x7f7b880adc70 secure :-1 s=THROTTLE_DONE pgs=589 cs=0 l=1 rx=0x7f7b800032b0 tx=0x7f7b800110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.267+0000 7f7b7f7fe700 1 -- 172.21.15.103:0/630549270 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2137 (secure 0 0 0) 0x7f7b8000b510 con 0x7f7b8805b8a0 2020-04-22T14:12:21.271 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:12:21.272 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5435,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3857335366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3857335366},{"type":"v1","addr":"172.21.15.86:6835","nonce":3857335366}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":46}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:20.884022+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6513},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6513":{"gid":6513,"name":"a","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/46849623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":46849623},{"type":"v1","addr":"172.21.15.103:6833","nonce":46849623}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:12:21.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.269+0000 7f7b8cf32700 1 -- 172.21.15.103:0/630549270 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7b6c04d9a0 msgr2=0x7f7b6c04fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:21.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.269+0000 7f7b8cf32700 1 --2- 172.21.15.103:0/630549270 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7b6c04d9a0 0x7f7b6c04fe60 secure :-1 s=READY pgs=400 cs=0 l=1 rx=0x7f7b78002f30 tx=0x7f7b78007a40).stop 2020-04-22T14:12:21.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.269+0000 7f7b8cf32700 1 -- 172.21.15.103:0/630549270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b8805b8a0 msgr2=0x7f7b880adc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:21.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.269+0000 7f7b8cf32700 1 --2- 172.21.15.103:0/630549270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b8805b8a0 0x7f7b880adc70 secure :-1 s=READY pgs=589 cs=0 l=1 rx=0x7f7b800032b0 tx=0x7f7b800110f0).stop 2020-04-22T14:12:21.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.269+0000 7f7b8cf32700 1 -- 172.21.15.103:0/630549270 shutdown_connections 2020-04-22T14:12:21.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.269+0000 7f7b8cf32700 1 --2- 172.21.15.103:0/630549270 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7b6c04d9a0 0x7f7b6c04fe60 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:21.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.269+0000 7f7b8cf32700 1 --2- 172.21.15.103:0/630549270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b8805b8a0 0x7f7b880adc70 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:21.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.269+0000 7f7b8cf32700 1 --2- 172.21.15.103:0/630549270 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b88065fe0 0x7f7b880af490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:21.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.269+0000 7f7b8cf32700 1 -- 172.21.15.103:0/630549270 >> 172.21.15.103:0/630549270 conn(0x7f7b880b9160 msgr2=0x7f7b88063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:21.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.269+0000 7f7b8cf32700 1 -- 172.21.15.103:0/630549270 shutdown_connections 2020-04-22T14:12:21.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.269+0000 7f7b8cf32700 1 -- 172.21.15.103:0/630549270 wait complete. 2020-04-22T14:12:21.274 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 50 2020-04-22T14:12:21.283 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:21.300 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:12:21.454 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.442+0000 7f689bf26700 1 Processor -- start 2020-04-22T14:12:21.454 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.442+0000 7f689bf26700 1 -- start start 2020-04-22T14:12:21.454 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.443+0000 7f689bf26700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f68941441f0 0x7f6894144820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:21.454 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.443+0000 7f689bf26700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6894144c80 0x7f68940ad850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:21.455 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.443+0000 7f689bf26700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68940b5900 con 0x7f689405b7c0 2020-04-22T14:12:21.455 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.443+0000 7f689bf26700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68940b5ba0 con 0x7f6894144c80 2020-04-22T14:12:21.455 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.443+0000 7f689bf26700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68940b5e40 con 0x7f68941441f0 2020-04-22T14:12:21.455 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.443+0000 7f68994c1700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f68941441f0 0x7f6894144820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:21.455 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.443+0000 7f689a4c3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6894144c80 0x7f68940ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:21.455 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.443+0000 7f689a4c3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6894144c80 0x7f68940ad850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:50012/0 (socket says 172.21.15.103:50012) 2020-04-22T14:12:21.455 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.443+0000 7f68994c1700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f68941441f0 0x7f6894144820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:37562/0 (socket says 172.21.15.103:37562) 2020-04-22T14:12:21.456 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.443+0000 7f689a4c3700 1 -- 172.21.15.103:0/1874052502 learned_addr learned my addr 172.21.15.103:0/1874052502 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:21.456 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.443+0000 7f689a4c3700 1 -- 172.21.15.103:0/1874052502 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f68941441f0 msgr2=0x7f6894144820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:21.456 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.443+0000 7f689a4c3700 1 --2- 172.21.15.103:0/1874052502 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f68941441f0 0x7f6894144820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:21.456 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.443+0000 7f689a4c3700 1 -- 172.21.15.103:0/1874052502 >> v1:172.21.15.86:6789/0 conn(0x7f689405b7c0 legacy=0x7f68940b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:21.456 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.443+0000 7f689a4c3700 1 -- 172.21.15.103:0/1874052502 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f689405bba0 con 0x7f6894144c80 2020-04-22T14:12:21.456 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.443+0000 7f6898cc0700 1 -- 172.21.15.103:0/1874052502 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3005713936 0 0) 0x7f68940b5900 con 0x7f689405b7c0 2020-04-22T14:12:21.456 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.444+0000 7f689a4c3700 1 --2- 172.21.15.103:0/1874052502 >> v2:172.21.15.86:3300/0 conn(0x7f6894144c80 0x7f68940ad850 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f688c0032b0 tx=0x7f688c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.444+0000 7f689a4c3700 1 --2- 172.21.15.103:0/1874052502 >> v2:172.21.15.86:3300/0 conn(0x7f6894144c80 0x7f68940ad850 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f688c0032b0 tx=0x7f688c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.444+0000 7f689a4c3700 1 --2- 172.21.15.103:0/1874052502 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6894144c80 0x7f68940ad850 secure :-1 s=READY pgs=591 cs=0 l=1 rx=0x7f688c0032b0 tx=0x7f688c007dc0).ready entity=mon.0 client_cookie=41a76e6a27e77295 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:21.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.444+0000 7f689a4c3700 1 --2- 172.21.15.103:0/1874052502 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6894144c80 0x7f68940ad850 secure :-1 s=THROTTLE_DONE pgs=591 cs=0 l=1 rx=0x7f688c0032b0 tx=0x7f688c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.444+0000 7f6898cc0700 1 -- 172.21.15.103:0/1874052502 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f688c010e70 con 0x7f6894144c80 2020-04-22T14:12:21.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.444+0000 7f689a4c3700 1 --2- 172.21.15.103:0/1874052502 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6894144c80 0x7f68940ad850 secure :-1 s=THROTTLE_DONE pgs=591 cs=0 l=1 rx=0x7f688c0032b0 tx=0x7f688c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.444+0000 7f6898cc0700 1 -- 172.21.15.103:0/1874052502 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688c0110d0 con 0x7f6894144c80 2020-04-22T14:12:21.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.444+0000 7f689a4c3700 1 --2- 172.21.15.103:0/1874052502 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6894144c80 0x7f68940ad850 secure :-1 s=THROTTLE_DONE pgs=591 cs=0 l=1 rx=0x7f688c0032b0 tx=0x7f688c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.444+0000 7f6898cc0700 1 -- 172.21.15.103:0/1874052502 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f688c0114b0 con 0x7f6894144c80 2020-04-22T14:12:21.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.444+0000 7f689bf26700 1 -- 172.21.15.103:0/1874052502 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6894144c80 msgr2=0x7f68940ad850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:21.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.444+0000 7f689bf26700 1 --2- 172.21.15.103:0/1874052502 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6894144c80 0x7f68940ad850 secure :-1 s=READY pgs=591 cs=0 l=1 rx=0x7f688c0032b0 tx=0x7f688c007dc0).stop 2020-04-22T14:12:21.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.444+0000 7f689bf26700 1 -- 172.21.15.103:0/1874052502 shutdown_connections 2020-04-22T14:12:21.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.444+0000 7f689bf26700 1 --2- 172.21.15.103:0/1874052502 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6894144c80 0x7f68940ad850 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:21.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.444+0000 7f689bf26700 1 --2- 172.21.15.103:0/1874052502 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f68941441f0 0x7f6894144820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:21.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.444+0000 7f689bf26700 1 -- 172.21.15.103:0/1874052502 >> 172.21.15.103:0/1874052502 conn(0x7f68940b9160 msgr2=0x7f689405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:21.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.444+0000 7f689bf26700 1 -- 172.21.15.103:0/1874052502 shutdown_connections 2020-04-22T14:12:21.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.444+0000 7f689bf26700 1 -- 172.21.15.103:0/1874052502 wait complete. 2020-04-22T14:12:21.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.445+0000 7f689bf26700 1 Processor -- start 2020-04-22T14:12:21.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.445+0000 7f689bf26700 1 -- start start 2020-04-22T14:12:21.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.446+0000 7f689bf26700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f689405b7c0 0x7f68940b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:21.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.446+0000 7f689bf26700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6894144c80 0x7f68940b6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:21.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.446+0000 7f689bf26700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f689413f660 con 0x7f68941441f0 2020-04-22T14:12:21.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.446+0000 7f689bf26700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68940b6de0 con 0x7f689405b7c0 2020-04-22T14:12:21.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.446+0000 7f689bf26700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f689413f900 con 0x7f6894144c80 2020-04-22T14:12:21.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.446+0000 7f689a4c3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6894144c80 0x7f68940b6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:21.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.446+0000 7f689a4c3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6894144c80 0x7f68940b6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52790/0 (socket says 172.21.15.103:52790) 2020-04-22T14:12:21.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.446+0000 7f689a4c3700 1 -- 172.21.15.103:0/108418334 learned_addr learned my addr 172.21.15.103:0/108418334 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:21.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.446+0000 7f6899cc2700 1 --2- 172.21.15.103:0/108418334 >> v2:172.21.15.86:3300/0 conn(0x7f689405b7c0 0x7f68940b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:21.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.446+0000 7f689a4c3700 1 -- 172.21.15.103:0/108418334 >> v2:172.21.15.86:3300/0 conn(0x7f689405b7c0 msgr2=0x7f68940b7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:21.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.446+0000 7f689a4c3700 1 --2- 172.21.15.103:0/108418334 >> v2:172.21.15.86:3300/0 conn(0x7f689405b7c0 0x7f68940b7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:21.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.446+0000 7f689a4c3700 1 -- 172.21.15.103:0/108418334 >> v1:172.21.15.86:6789/0 conn(0x7f68941441f0 legacy=0x7f6894138500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:21.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.446+0000 7f689a4c3700 1 -- 172.21.15.103:0/108418334 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6894138c10 con 0x7f6894144c80 2020-04-22T14:12:21.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.446+0000 7f689a4c3700 1 --2- 172.21.15.103:0/108418334 >> v2:172.21.15.103:3300/0 conn(0x7f6894144c80 0x7f68940b6980 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6894151930 tx=0x7f688c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.446+0000 7f689a4c3700 1 --2- 172.21.15.103:0/108418334 >> v2:172.21.15.103:3300/0 conn(0x7f6894144c80 0x7f68940b6980 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6894151930 tx=0x7f688c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.446+0000 7f689a4c3700 1 --2- 172.21.15.103:0/108418334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6894144c80 0x7f68940b6980 secure :-1 s=READY pgs=1082 cs=0 l=1 rx=0x7f6894151930 tx=0x7f688c007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:21.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.447+0000 7f689a4c3700 1 --2- 172.21.15.103:0/108418334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6894144c80 0x7f68940b6980 secure :-1 s=THROTTLE_DONE pgs=1082 cs=0 l=1 rx=0x7f6894151930 tx=0x7f688c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.447+0000 7f6882ffd700 1 -- 172.21.15.103:0/108418334 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f688c010590 con 0x7f6894144c80 2020-04-22T14:12:21.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.447+0000 7f689a4c3700 1 --2- 172.21.15.103:0/108418334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6894144c80 0x7f68940b6980 secure :-1 s=THROTTLE_DONE pgs=1082 cs=0 l=1 rx=0x7f6894151930 tx=0x7f688c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.447+0000 7f689a4c3700 1 --2- 172.21.15.103:0/108418334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6894144c80 0x7f68940b6980 secure :-1 s=THROTTLE_DONE pgs=1082 cs=0 l=1 rx=0x7f6894151930 tx=0x7f688c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.447+0000 7f6882ffd700 1 -- 172.21.15.103:0/108418334 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688c011530 con 0x7f6894144c80 2020-04-22T14:12:21.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.447+0000 7f689bf26700 1 -- 172.21.15.103:0/108418334 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68941451d0 con 0x7f6894144c80 2020-04-22T14:12:21.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.447+0000 7f6882ffd700 1 -- 172.21.15.103:0/108418334 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f688c005e20 con 0x7f6894144c80 2020-04-22T14:12:21.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.447+0000 7f689bf26700 1 -- 172.21.15.103:0/108418334 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f689413fda0 con 0x7f6894144c80 2020-04-22T14:12:21.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.447+0000 7f689a4c3700 1 --2- 172.21.15.103:0/108418334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6894144c80 0x7f68940b6980 secure :-1 s=THROTTLE_DONE pgs=1082 cs=0 l=1 rx=0x7f6894151930 tx=0x7f688c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.466 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.448+0000 7f6882ffd700 1 -- 172.21.15.103:0/108418334 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f688c00f2b0 con 0x7f6894144c80 2020-04-22T14:12:21.466 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.448+0000 7f689a4c3700 1 --2- 172.21.15.103:0/108418334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6894144c80 0x7f68940b6980 secure :-1 s=THROTTLE_DONE pgs=1082 cs=0 l=1 rx=0x7f6894151930 tx=0x7f688c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.466 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.448+0000 7f689bf26700 1 -- 172.21.15.103:0/108418334 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f689413e800 con 0x7f6894144c80 2020-04-22T14:12:21.466 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.448+0000 7f6882ffd700 1 --2- 172.21.15.103:0/108418334 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f687404da60 0x7f687404ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:21.466 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.448+0000 7f6882ffd700 1 -- 172.21.15.103:0/108418334 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f688c061c80 con 0x7f6894144c80 2020-04-22T14:12:21.466 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.448+0000 7f6899cc2700 1 --2- 172.21.15.103:0/108418334 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f687404da60 0x7f687404ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:21.466 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.448+0000 7f6899cc2700 1 --2- 172.21.15.103:0/108418334 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f687404da60 0x7f687404ff20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6884000b80 tx=0x7f6884001790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.448+0000 7f6899cc2700 1 --2- 172.21.15.103:0/108418334 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f687404da60 0x7f687404ff20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6884000b80 tx=0x7f6884001790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.448+0000 7f6899cc2700 1 --2- 172.21.15.103:0/108418334 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f687404da60 0x7f687404ff20 secure :-1 s=READY pgs=401 cs=0 l=1 rx=0x7f6884000b80 tx=0x7f6884001790).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:21.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.452+0000 7f689a4c3700 1 --2- 172.21.15.103:0/108418334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6894144c80 0x7f68940b6980 secure :-1 s=THROTTLE_DONE pgs=1082 cs=0 l=1 rx=0x7f6894151930 tx=0x7f688c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.452+0000 7f6882ffd700 1 -- 172.21.15.103:0/108418334 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f688c03d0c0 con 0x7f6894144c80 2020-04-22T14:12:21.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.597+0000 7f689bf26700 1 -- 172.21.15.103:0/108418334 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6894056c90 con 0x7f6894144c80 2020-04-22T14:12:21.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.598+0000 7f689a4c3700 1 --2- 172.21.15.103:0/108418334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6894144c80 0x7f68940b6980 secure :-1 s=THROTTLE_DONE pgs=1082 cs=0 l=1 rx=0x7f6894151930 tx=0x7f688c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.598+0000 7f6882ffd700 1 -- 172.21.15.103:0/108418334 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16092 (secure 0 0 0) 0x7f688c0406e0 con 0x7f6894144c80 2020-04-22T14:12:21.602 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:12:21.602 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":77,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:12:19.875997+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:12:16.799055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2020-04-22T14:12:17.819603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:12:21.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.599+0000 7f689bf26700 1 -- 172.21.15.103:0/108418334 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f687404da60 msgr2=0x7f687404ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:21.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.599+0000 7f689bf26700 1 --2- 172.21.15.103:0/108418334 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f687404da60 0x7f687404ff20 secure :-1 s=READY pgs=401 cs=0 l=1 rx=0x7f6884000b80 tx=0x7f6884001790).stop 2020-04-22T14:12:21.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.599+0000 7f689bf26700 1 -- 172.21.15.103:0/108418334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6894144c80 msgr2=0x7f68940b6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:21.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.599+0000 7f689bf26700 1 --2- 172.21.15.103:0/108418334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6894144c80 0x7f68940b6980 secure :-1 s=READY pgs=1082 cs=0 l=1 rx=0x7f6894151930 tx=0x7f688c007dc0).stop 2020-04-22T14:12:21.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.599+0000 7f689bf26700 1 -- 172.21.15.103:0/108418334 shutdown_connections 2020-04-22T14:12:21.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.599+0000 7f689bf26700 1 --2- 172.21.15.103:0/108418334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6894144c80 0x7f68940b6980 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:21.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.599+0000 7f689bf26700 1 --2- 172.21.15.103:0/108418334 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f687404da60 0x7f687404ff20 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:21.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.599+0000 7f689bf26700 1 --2- 172.21.15.103:0/108418334 >> v2:172.21.15.86:3300/0 conn(0x7f689405b7c0 0x7f68940b7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:21.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.599+0000 7f689bf26700 1 -- 172.21.15.103:0/108418334 >> 172.21.15.103:0/108418334 conn(0x7f68940b9160 msgr2=0x7f68940b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:21.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.599+0000 7f689bf26700 1 -- 172.21.15.103:0/108418334 shutdown_connections 2020-04-22T14:12:21.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.599+0000 7f689bf26700 1 -- 172.21.15.103:0/108418334 wait complete. 2020-04-22T14:12:21.614 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:21.628 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:12:21.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.776+0000 7fb59ae19700 1 Processor -- start 2020-04-22T14:12:21.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.777+0000 7fb59ae19700 1 -- start start 2020-04-22T14:12:21.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.777+0000 7fb59ae19700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb594062170 0x7fb5940b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:21.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.777+0000 7fb59ae19700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb5940b5210 0x7fb5940adf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:21.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.777+0000 7fb59ae19700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5940b5650 con 0x7fb594152a90 2020-04-22T14:12:21.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.777+0000 7fb59ae19700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5940614f0 con 0x7fb594062170 2020-04-22T14:12:21.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.777+0000 7fb59ae19700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb594061790 con 0x7fb5940b5210 2020-04-22T14:12:21.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.777+0000 7fb599bb7700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb5940b5210 0x7fb5940adf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:21.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.777+0000 7fb599bb7700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb5940b5210 0x7fb5940adf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52794/0 (socket says 172.21.15.103:52794) 2020-04-22T14:12:21.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.777+0000 7fb599bb7700 1 -- 172.21.15.103:0/4107259129 learned_addr learned my addr 172.21.15.103:0/4107259129 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:21.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.777+0000 7fb5993b6700 1 --1- 172.21.15.103:0/4107259129 >> v1:172.21.15.103:6789/0 conn(0x7fb594152a90 0x7fb5940b44d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44984/0 (socket says 172.21.15.103:44984) 2020-04-22T14:12:21.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.778+0000 7fb598bb5700 1 --2- 172.21.15.103:0/4107259129 >> v2:172.21.15.86:3300/0 conn(0x7fb594062170 0x7fb5940b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:21.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.778+0000 7fb599bb7700 1 -- 172.21.15.103:0/4107259129 >> v2:172.21.15.86:3300/0 conn(0x7fb594062170 msgr2=0x7fb5940b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:21.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.778+0000 7fb599bb7700 1 --2- 172.21.15.103:0/4107259129 >> v2:172.21.15.86:3300/0 conn(0x7fb594062170 0x7fb5940b4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:21.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.778+0000 7fb599bb7700 1 -- 172.21.15.103:0/4107259129 >> v1:172.21.15.103:6789/0 conn(0x7fb594152a90 legacy=0x7fb5940b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:21.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.778+0000 7fb58bfff700 1 -- 172.21.15.103:0/4107259129 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3879233739 0 0) 0x7fb5940b5650 con 0x7fb594152a90 2020-04-22T14:12:21.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.778+0000 7fb599bb7700 1 -- 172.21.15.103:0/4107259129 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb594061a30 con 0x7fb5940b5210 2020-04-22T14:12:21.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.778+0000 7fb599bb7700 1 --2- 172.21.15.103:0/4107259129 >> v2:172.21.15.103:3300/0 conn(0x7fb5940b5210 0x7fb5940adf50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb58c002f30 tx=0x7fb58c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.778+0000 7fb599bb7700 1 --2- 172.21.15.103:0/4107259129 >> v2:172.21.15.103:3300/0 conn(0x7fb5940b5210 0x7fb5940adf50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb58c002f30 tx=0x7fb58c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.778+0000 7fb599bb7700 1 --2- 172.21.15.103:0/4107259129 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5940b5210 0x7fb5940adf50 secure :-1 s=READY pgs=1084 cs=0 l=1 rx=0x7fb58c002f30 tx=0x7fb58c007a40).ready entity=mon.1 client_cookie=aff2654c65ea2f48 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:21.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.778+0000 7fb599bb7700 1 --2- 172.21.15.103:0/4107259129 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5940b5210 0x7fb5940adf50 secure :-1 s=THROTTLE_DONE pgs=1084 cs=0 l=1 rx=0x7fb58c002f30 tx=0x7fb58c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.778+0000 7fb58bfff700 1 -- 172.21.15.103:0/4107259129 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb58c011720 con 0x7fb5940b5210 2020-04-22T14:12:21.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.778+0000 7fb599bb7700 1 --2- 172.21.15.103:0/4107259129 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5940b5210 0x7fb5940adf50 secure :-1 s=THROTTLE_DONE pgs=1084 cs=0 l=1 rx=0x7fb58c002f30 tx=0x7fb58c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.778+0000 7fb599bb7700 1 --2- 172.21.15.103:0/4107259129 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5940b5210 0x7fb5940adf50 secure :-1 s=THROTTLE_DONE pgs=1084 cs=0 l=1 rx=0x7fb58c002f30 tx=0x7fb58c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.778+0000 7fb58bfff700 1 -- 172.21.15.103:0/4107259129 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58c011880 con 0x7fb5940b5210 2020-04-22T14:12:21.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.778+0000 7fb58bfff700 1 -- 172.21.15.103:0/4107259129 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb58c011c60 con 0x7fb5940b5210 2020-04-22T14:12:21.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.778+0000 7fb59ae19700 1 -- 172.21.15.103:0/4107259129 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5940b5210 msgr2=0x7fb5940adf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:21.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.778+0000 7fb59ae19700 1 --2- 172.21.15.103:0/4107259129 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5940b5210 0x7fb5940adf50 secure :-1 s=READY pgs=1084 cs=0 l=1 rx=0x7fb58c002f30 tx=0x7fb58c007a40).stop 2020-04-22T14:12:21.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.779+0000 7fb59ae19700 1 -- 172.21.15.103:0/4107259129 shutdown_connections 2020-04-22T14:12:21.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.779+0000 7fb59ae19700 1 --2- 172.21.15.103:0/4107259129 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5940b5210 0x7fb5940adf50 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:21.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.779+0000 7fb59ae19700 1 --2- 172.21.15.103:0/4107259129 >> v2:172.21.15.86:3300/0 conn(0x7fb594062170 0x7fb5940b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:21.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.779+0000 7fb59ae19700 1 -- 172.21.15.103:0/4107259129 >> 172.21.15.103:0/4107259129 conn(0x7fb59405ad30 msgr2=0x7fb59405b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:21.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.779+0000 7fb59ae19700 1 -- 172.21.15.103:0/4107259129 shutdown_connections 2020-04-22T14:12:21.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.779+0000 7fb59ae19700 1 -- 172.21.15.103:0/4107259129 wait complete. 2020-04-22T14:12:21.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.780+0000 7fb59ae19700 1 Processor -- start 2020-04-22T14:12:21.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.780+0000 7fb59ae19700 1 -- start start 2020-04-22T14:12:21.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.781+0000 7fb59ae19700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb594062170 0x7fb594138650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:21.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.781+0000 7fb59ae19700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb5940b5210 0x7fb5941284d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:21.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.781+0000 7fb59ae19700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb594138c00 con 0x7fb594152a90 2020-04-22T14:12:21.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.781+0000 7fb59ae19700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5940b2170 con 0x7fb5940b5210 2020-04-22T14:12:21.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.781+0000 7fb59ae19700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5940b2410 con 0x7fb594062170 2020-04-22T14:12:21.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.781+0000 7fb5993b6700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb594062170 0x7fb594138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:21.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.781+0000 7fb5993b6700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb594062170 0x7fb594138650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52798/0 (socket says 172.21.15.103:52798) 2020-04-22T14:12:21.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.781+0000 7fb599bb7700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb594152a90 0x7fb59412c460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44992/0 (socket says 172.21.15.103:44992) 2020-04-22T14:12:21.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.781+0000 7fb5993b6700 1 -- 172.21.15.103:0/2614130324 learned_addr learned my addr 172.21.15.103:0/2614130324 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:21.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.781+0000 7fb598bb5700 1 --2- 172.21.15.103:0/2614130324 >> v2:172.21.15.86:3300/0 conn(0x7fb5940b5210 0x7fb5941284d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:21.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.781+0000 7fb5993b6700 1 -- 172.21.15.103:0/2614130324 >> v2:172.21.15.86:3300/0 conn(0x7fb5940b5210 msgr2=0x7fb5941284d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:21.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.781+0000 7fb5993b6700 1 --2- 172.21.15.103:0/2614130324 >> v2:172.21.15.86:3300/0 conn(0x7fb5940b5210 0x7fb5941284d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:21.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.781+0000 7fb5993b6700 1 -- 172.21.15.103:0/2614130324 >> v1:172.21.15.103:6789/0 conn(0x7fb594152a90 legacy=0x7fb59412c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:21.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.781+0000 7fb589ffb700 1 -- 172.21.15.103:0/2614130324 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4056925714 0 0) 0x7fb594138c00 con 0x7fb594152a90 2020-04-22T14:12:21.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.781+0000 7fb5993b6700 1 -- 172.21.15.103:0/2614130324 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb594065ed0 con 0x7fb594062170 2020-04-22T14:12:21.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.781+0000 7fb598bb5700 1 --2- 172.21.15.103:0/2614130324 >> v2:172.21.15.86:3300/0 conn(0x7fb5940b5210 0x7fb5941284d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:12:21.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.781+0000 7fb5993b6700 1 --2- 172.21.15.103:0/2614130324 >> v2:172.21.15.103:3300/0 conn(0x7fb594062170 0x7fb594138650 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb590000f00 tx=0x7fb590010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.781+0000 7fb5993b6700 1 --2- 172.21.15.103:0/2614130324 >> v2:172.21.15.103:3300/0 conn(0x7fb594062170 0x7fb594138650 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb590000f00 tx=0x7fb590010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.781+0000 7fb5993b6700 1 --2- 172.21.15.103:0/2614130324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb594062170 0x7fb594138650 secure :-1 s=READY pgs=1086 cs=0 l=1 rx=0x7fb590000f00 tx=0x7fb590010d70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:21.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.781+0000 7fb5993b6700 1 --2- 172.21.15.103:0/2614130324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb594062170 0x7fb594138650 secure :-1 s=THROTTLE_DONE pgs=1086 cs=0 l=1 rx=0x7fb590000f00 tx=0x7fb590010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.781+0000 7fb589ffb700 1 -- 172.21.15.103:0/2614130324 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb590004c50 con 0x7fb594062170 2020-04-22T14:12:21.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.781+0000 7fb5993b6700 1 --2- 172.21.15.103:0/2614130324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb594062170 0x7fb594138650 secure :-1 s=THROTTLE_DONE pgs=1086 cs=0 l=1 rx=0x7fb590000f00 tx=0x7fb590010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.781+0000 7fb5993b6700 1 --2- 172.21.15.103:0/2614130324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb594062170 0x7fb594138650 secure :-1 s=THROTTLE_DONE pgs=1086 cs=0 l=1 rx=0x7fb590000f00 tx=0x7fb590010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.781+0000 7fb589ffb700 1 -- 172.21.15.103:0/2614130324 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb590004db0 con 0x7fb594062170 2020-04-22T14:12:21.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.781+0000 7fb59ae19700 1 -- 172.21.15.103:0/2614130324 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb59412cb70 con 0x7fb594062170 2020-04-22T14:12:21.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.781+0000 7fb589ffb700 1 -- 172.21.15.103:0/2614130324 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb590012900 con 0x7fb594062170 2020-04-22T14:12:21.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.781+0000 7fb59ae19700 1 -- 172.21.15.103:0/2614130324 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5940662c0 con 0x7fb594062170 2020-04-22T14:12:21.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.782+0000 7fb5993b6700 1 --2- 172.21.15.103:0/2614130324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb594062170 0x7fb594138650 secure :-1 s=THROTTLE_DONE pgs=1086 cs=0 l=1 rx=0x7fb590000f00 tx=0x7fb590010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.782+0000 7fb589ffb700 1 -- 172.21.15.103:0/2614130324 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fb590012b70 con 0x7fb594062170 2020-04-22T14:12:21.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.782+0000 7fb5993b6700 1 --2- 172.21.15.103:0/2614130324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb594062170 0x7fb594138650 secure :-1 s=THROTTLE_DONE pgs=1086 cs=0 l=1 rx=0x7fb590000f00 tx=0x7fb590010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.782+0000 7fb59ae19700 1 -- 172.21.15.103:0/2614130324 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb594056c90 con 0x7fb594062170 2020-04-22T14:12:21.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.783+0000 7fb589ffb700 1 --2- 172.21.15.103:0/2614130324 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb57404d920 0x7fb57404fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:21.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.783+0000 7fb589ffb700 1 -- 172.21.15.103:0/2614130324 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb5900615f0 con 0x7fb594062170 2020-04-22T14:12:21.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.783+0000 7fb598bb5700 1 --2- 172.21.15.103:0/2614130324 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb57404d920 0x7fb57404fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:21.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.783+0000 7fb598bb5700 1 --2- 172.21.15.103:0/2614130324 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb57404d920 0x7fb57404fde0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb584002f30 tx=0x7fb59405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.783+0000 7fb598bb5700 1 --2- 172.21.15.103:0/2614130324 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb57404d920 0x7fb57404fde0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb584002f30 tx=0x7fb59405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.783+0000 7fb598bb5700 1 --2- 172.21.15.103:0/2614130324 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb57404d920 0x7fb57404fde0 secure :-1 s=READY pgs=402 cs=0 l=1 rx=0x7fb584002f30 tx=0x7fb59405a720).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:21.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.787+0000 7fb5993b6700 1 --2- 172.21.15.103:0/2614130324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb594062170 0x7fb594138650 secure :-1 s=THROTTLE_DONE pgs=1086 cs=0 l=1 rx=0x7fb590000f00 tx=0x7fb590010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.787+0000 7fb589ffb700 1 -- 172.21.15.103:0/2614130324 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fb59003c9d0 con 0x7fb594062170 2020-04-22T14:12:21.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.977+0000 7fb59ae19700 1 -- 172.21.15.103:0/2614130324 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fb5940b1940 con 0x7fb594062170 2020-04-22T14:12:21.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.982+0000 7fb5993b6700 1 --2- 172.21.15.103:0/2614130324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb594062170 0x7fb594138650 secure :-1 s=THROTTLE_DONE pgs=1086 cs=0 l=1 rx=0x7fb590000f00 tx=0x7fb590010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:21.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.982+0000 7fb589ffb700 1 -- 172.21.15.103:0/2614130324 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v29) v1 ==== 184+0+0 (secure 0 0 0) 0x7fb59003fff0 con 0x7fb594062170 2020-04-22T14:12:21.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.983+0000 7fb59ae19700 1 -- 172.21.15.103:0/2614130324 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb57404d920 msgr2=0x7fb57404fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:21.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.983+0000 7fb59ae19700 1 --2- 172.21.15.103:0/2614130324 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb57404d920 0x7fb57404fde0 secure :-1 s=READY pgs=402 cs=0 l=1 rx=0x7fb584002f30 tx=0x7fb59405a720).stop 2020-04-22T14:12:21.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.983+0000 7fb59ae19700 1 -- 172.21.15.103:0/2614130324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb594062170 msgr2=0x7fb594138650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:21.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.983+0000 7fb59ae19700 1 --2- 172.21.15.103:0/2614130324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb594062170 0x7fb594138650 secure :-1 s=READY pgs=1086 cs=0 l=1 rx=0x7fb590000f00 tx=0x7fb590010d70).stop 2020-04-22T14:12:21.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.983+0000 7fb59ae19700 1 -- 172.21.15.103:0/2614130324 shutdown_connections 2020-04-22T14:12:21.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.983+0000 7fb59ae19700 1 --2- 172.21.15.103:0/2614130324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb594062170 0x7fb594138650 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:21.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.983+0000 7fb59ae19700 1 --2- 172.21.15.103:0/2614130324 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb57404d920 0x7fb57404fde0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:21.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.983+0000 7fb59ae19700 1 --2- 172.21.15.103:0/2614130324 >> v2:172.21.15.86:3300/0 conn(0x7fb5940b5210 0x7fb5941284d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:21.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.983+0000 7fb59ae19700 1 -- 172.21.15.103:0/2614130324 >> 172.21.15.103:0/2614130324 conn(0x7fb59405ad30 msgr2=0x7fb5940b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:21.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.983+0000 7fb59ae19700 1 -- 172.21.15.103:0/2614130324 shutdown_connections 2020-04-22T14:12:21.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:21.983+0000 7fb59ae19700 1 -- 172.21.15.103:0/2614130324 wait complete. 2020-04-22T14:12:21.989 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.0 2020-04-22T14:12:21.997 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:22.010 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:12:22.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.160+0000 7ff09455d700 1 Processor -- start 2020-04-22T14:12:22.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.160+0000 7ff09455d700 1 -- start start 2020-04-22T14:12:22.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.161+0000 7ff09455d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff08c062170 0x7ff08c0b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:22.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.161+0000 7ff09455d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff08c152e70 con 0x7ff08c152a90 2020-04-22T14:12:22.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.161+0000 7ff09455d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff08c0b5650 con 0x7ff08c0b5210 2020-04-22T14:12:22.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.161+0000 7ff09455d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff08c0614f0 con 0x7ff08c062170 2020-04-22T14:12:22.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.161+0000 7ff0932fb700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff08c0b5210 0x7ff08c0adf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44996/0 (socket says 172.21.15.103:44996) 2020-04-22T14:12:22.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.161+0000 7ff0932fb700 1 -- 172.21.15.103:0/1865585927 learned_addr learned my addr 172.21.15.103:0/1865585927 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:22.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.161+0000 7ff0922f9700 1 --2- 172.21.15.103:0/1865585927 >> v2:172.21.15.86:3300/0 conn(0x7ff08c062170 0x7ff08c0b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:22.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.162+0000 7ff091af8700 1 -- 172.21.15.103:0/1865585927 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4244874829 0 0) 0x7ff08c0b5650 con 0x7ff08c0b5210 2020-04-22T14:12:22.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.162+0000 7ff091af8700 1 -- 172.21.15.103:0/1865585927 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff078003230 con 0x7ff08c0b5210 2020-04-22T14:12:22.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.162+0000 7ff0922f9700 1 -- 172.21.15.103:0/1865585927 >> v1:172.21.15.103:6789/0 conn(0x7ff08c0b5210 legacy=0x7ff08c0adf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:22.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.162+0000 7ff091af8700 1 -- 172.21.15.103:0/1865585927 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2711699524 0 0) 0x7ff078003230 con 0x7ff08c0b5210 2020-04-22T14:12:22.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.162+0000 7ff0922f9700 1 -- 172.21.15.103:0/1865585927 >> v1:172.21.15.86:6789/0 conn(0x7ff08c152a90 legacy=0x7ff08c0b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:22.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.162+0000 7ff0922f9700 1 -- 172.21.15.103:0/1865585927 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff08c061790 con 0x7ff08c062170 2020-04-22T14:12:22.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.162+0000 7ff0922f9700 1 --2- 172.21.15.103:0/1865585927 >> v2:172.21.15.86:3300/0 conn(0x7ff08c062170 0x7ff08c0b4db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff084001bf0 tx=0x7ff08c05a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.162+0000 7ff0922f9700 1 --2- 172.21.15.103:0/1865585927 >> v2:172.21.15.86:3300/0 conn(0x7ff08c062170 0x7ff08c0b4db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff084001bf0 tx=0x7ff08c05a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.162+0000 7ff0922f9700 1 --2- 172.21.15.103:0/1865585927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff08c062170 0x7ff08c0b4db0 secure :-1 s=READY pgs=594 cs=0 l=1 rx=0x7ff084001bf0 tx=0x7ff08c05a720).ready entity=mon.0 client_cookie=95ad5456f6454b39 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:22.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.162+0000 7ff0922f9700 1 --2- 172.21.15.103:0/1865585927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff08c062170 0x7ff08c0b4db0 secure :-1 s=THROTTLE_DONE pgs=594 cs=0 l=1 rx=0x7ff084001bf0 tx=0x7ff08c05a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.162+0000 7ff091af8700 1 -- 172.21.15.103:0/1865585927 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff084001a50 con 0x7ff08c062170 2020-04-22T14:12:22.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.162+0000 7ff0922f9700 1 --2- 172.21.15.103:0/1865585927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff08c062170 0x7ff08c0b4db0 secure :-1 s=THROTTLE_DONE pgs=594 cs=0 l=1 rx=0x7ff084001bf0 tx=0x7ff08c05a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.162+0000 7ff0922f9700 1 --2- 172.21.15.103:0/1865585927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff08c062170 0x7ff08c0b4db0 secure :-1 s=THROTTLE_DONE pgs=594 cs=0 l=1 rx=0x7ff084001bf0 tx=0x7ff08c05a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.162+0000 7ff091af8700 1 -- 172.21.15.103:0/1865585927 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff07c008b40 con 0x7ff08c062170 2020-04-22T14:12:22.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.162+0000 7ff091af8700 1 -- 172.21.15.103:0/1865585927 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff07c011740 con 0x7ff08c062170 2020-04-22T14:12:22.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.162+0000 7ff09455d700 1 -- 172.21.15.103:0/1865585927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff08c062170 msgr2=0x7ff08c0b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:22.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.162+0000 7ff09455d700 1 --2- 172.21.15.103:0/1865585927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff08c062170 0x7ff08c0b4db0 secure :-1 s=READY pgs=594 cs=0 l=1 rx=0x7ff084001bf0 tx=0x7ff08c05a720).stop 2020-04-22T14:12:22.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.163+0000 7ff09455d700 1 -- 172.21.15.103:0/1865585927 shutdown_connections 2020-04-22T14:12:22.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.163+0000 7ff09455d700 1 --2- 172.21.15.103:0/1865585927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff08c062170 0x7ff08c0b4db0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:22.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.163+0000 7ff09455d700 1 -- 172.21.15.103:0/1865585927 >> 172.21.15.103:0/1865585927 conn(0x7ff08c05ad30 msgr2=0x7ff08c05b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:22.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.163+0000 7ff09455d700 1 -- 172.21.15.103:0/1865585927 shutdown_connections 2020-04-22T14:12:22.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.163+0000 7ff09455d700 1 -- 172.21.15.103:0/1865585927 wait complete. 2020-04-22T14:12:22.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.164+0000 7ff09455d700 1 Processor -- start 2020-04-22T14:12:22.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.164+0000 7ff09455d700 1 -- start start 2020-04-22T14:12:22.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.165+0000 7ff09455d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff08c0b5210 0x7ff08c127270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:22.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.165+0000 7ff09455d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff08c152a90 0x7ff08c064920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:22.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.165+0000 7ff09455d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff08c063f40 con 0x7ff08c062170 2020-04-22T14:12:22.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.165+0000 7ff09455d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff08c066660 con 0x7ff08c0b5210 2020-04-22T14:12:22.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.165+0000 7ff09455d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff08c0641e0 con 0x7ff08c152a90 2020-04-22T14:12:22.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.165+0000 7ff0922f9700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff08c0b5210 0x7ff08c127270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:22.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.165+0000 7ff0922f9700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff08c0b5210 0x7ff08c127270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:50044/0 (socket says 172.21.15.103:50044) 2020-04-22T14:12:22.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.165+0000 7ff0922f9700 1 -- 172.21.15.103:0/2499923273 learned_addr learned my addr 172.21.15.103:0/2499923273 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:22.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.165+0000 7ff0932fb700 1 --2- 172.21.15.103:0/2499923273 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff08c152a90 0x7ff08c064920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:22.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.165+0000 7ff0932fb700 1 -- 172.21.15.103:0/2499923273 >> v2:172.21.15.86:3300/0 conn(0x7ff08c0b5210 msgr2=0x7ff08c127270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:22.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.165+0000 7ff0932fb700 1 --2- 172.21.15.103:0/2499923273 >> v2:172.21.15.86:3300/0 conn(0x7ff08c0b5210 0x7ff08c127270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:22.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.165+0000 7ff0932fb700 1 -- 172.21.15.103:0/2499923273 >> v1:172.21.15.86:6789/0 conn(0x7ff08c062170 legacy=0x7ff08c0b1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:22.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.165+0000 7ff0932fb700 1 -- 172.21.15.103:0/2499923273 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff08c064480 con 0x7ff08c152a90 2020-04-22T14:12:22.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.165+0000 7ff0922f9700 1 --2- 172.21.15.103:0/2499923273 >> v2:172.21.15.86:3300/0 conn(0x7ff08c0b5210 0x7ff08c127270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:12:22.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.165+0000 7ff0932fb700 1 --2- 172.21.15.103:0/2499923273 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff08c152a90 0x7ff08c064920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff084001cb0 tx=0x7ff08400c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.165+0000 7ff0932fb700 1 --2- 172.21.15.103:0/2499923273 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff08c152a90 0x7ff08c064920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff084001cb0 tx=0x7ff08400c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.165+0000 7ff0932fb700 1 --2- 172.21.15.103:0/2499923273 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff08c152a90 0x7ff08c064920 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7ff084001cb0 tx=0x7ff08400c890).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:22.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.165+0000 7ff0932fb700 1 --2- 172.21.15.103:0/2499923273 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff08c152a90 0x7ff08c064920 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7ff084001cb0 tx=0x7ff08400c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.165+0000 7ff0837fe700 1 -- 172.21.15.103:0/2499923273 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff08400ccd0 con 0x7ff08c152a90 2020-04-22T14:12:22.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.165+0000 7ff0932fb700 1 --2- 172.21.15.103:0/2499923273 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff08c152a90 0x7ff08c064920 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7ff084001cb0 tx=0x7ff08400c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.165+0000 7ff0837fe700 1 -- 172.21.15.103:0/2499923273 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08400ce30 con 0x7ff08c152a90 2020-04-22T14:12:22.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.165+0000 7ff0932fb700 1 --2- 172.21.15.103:0/2499923273 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff08c152a90 0x7ff08c064920 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7ff084001cb0 tx=0x7ff08400c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.165+0000 7ff09455d700 1 -- 172.21.15.103:0/2499923273 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff08c064d80 con 0x7ff08c152a90 2020-04-22T14:12:22.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.165+0000 7ff0837fe700 1 -- 172.21.15.103:0/2499923273 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff084004a60 con 0x7ff08c152a90 2020-04-22T14:12:22.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.166+0000 7ff09455d700 1 -- 172.21.15.103:0/2499923273 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff08c065330 con 0x7ff08c152a90 2020-04-22T14:12:22.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.166+0000 7ff0932fb700 1 --2- 172.21.15.103:0/2499923273 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff08c152a90 0x7ff08c064920 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7ff084001cb0 tx=0x7ff08400c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.167+0000 7ff0837fe700 1 -- 172.21.15.103:0/2499923273 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ff084004ca0 con 0x7ff08c152a90 2020-04-22T14:12:22.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.167+0000 7ff0932fb700 1 --2- 172.21.15.103:0/2499923273 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff08c152a90 0x7ff08c064920 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7ff084001cb0 tx=0x7ff08400c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.167+0000 7ff09455d700 1 -- 172.21.15.103:0/2499923273 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff08c056c90 con 0x7ff08c152a90 2020-04-22T14:12:22.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.167+0000 7ff0837fe700 1 --2- 172.21.15.103:0/2499923273 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff07404d9c0 0x7ff07404fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:22.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.167+0000 7ff0837fe700 1 -- 172.21.15.103:0/2499923273 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff084061480 con 0x7ff08c152a90 2020-04-22T14:12:22.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.167+0000 7ff092afa700 1 --2- 172.21.15.103:0/2499923273 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff07404d9c0 0x7ff07404fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:22.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.167+0000 7ff092afa700 1 --2- 172.21.15.103:0/2499923273 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff07404d9c0 0x7ff07404fe80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff08c0b2af0 tx=0x7ff088002520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.167+0000 7ff092afa700 1 --2- 172.21.15.103:0/2499923273 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff07404d9c0 0x7ff07404fe80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff08c0b2af0 tx=0x7ff088002520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.167+0000 7ff092afa700 1 --2- 172.21.15.103:0/2499923273 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff07404d9c0 0x7ff07404fe80 secure :-1 s=READY pgs=403 cs=0 l=1 rx=0x7ff08c0b2af0 tx=0x7ff088002520).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:22.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.171+0000 7ff0932fb700 1 --2- 172.21.15.103:0/2499923273 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff08c152a90 0x7ff08c064920 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7ff084001cb0 tx=0x7ff08400c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.171+0000 7ff0837fe700 1 -- 172.21.15.103:0/2499923273 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ff08403c800 con 0x7ff08c152a90 2020-04-22T14:12:22.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.362+0000 7ff09455d700 1 -- 172.21.15.103:0/2499923273 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7ff08c06a8b0 con 0x7ff08c152a90 2020-04-22T14:12:22.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.366+0000 7ff0932fb700 1 --2- 172.21.15.103:0/2499923273 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff08c152a90 0x7ff08c064920 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7ff084001cb0 tx=0x7ff08400c890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.366+0000 7ff0837fe700 1 -- 172.21.15.103:0/2499923273 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v30) v1 ==== 184+0+0 (secure 0 0 0) 0x7ff08403fe20 con 0x7ff08c152a90 2020-04-22T14:12:22.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.368+0000 7ff09455d700 1 -- 172.21.15.103:0/2499923273 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff07404d9c0 msgr2=0x7ff07404fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:22.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.368+0000 7ff09455d700 1 --2- 172.21.15.103:0/2499923273 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff07404d9c0 0x7ff07404fe80 secure :-1 s=READY pgs=403 cs=0 l=1 rx=0x7ff08c0b2af0 tx=0x7ff088002520).stop 2020-04-22T14:12:22.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.368+0000 7ff09455d700 1 -- 172.21.15.103:0/2499923273 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff08c152a90 msgr2=0x7ff08c064920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:22.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.368+0000 7ff09455d700 1 --2- 172.21.15.103:0/2499923273 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff08c152a90 0x7ff08c064920 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7ff084001cb0 tx=0x7ff08400c890).stop 2020-04-22T14:12:22.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.368+0000 7ff09455d700 1 -- 172.21.15.103:0/2499923273 shutdown_connections 2020-04-22T14:12:22.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.368+0000 7ff09455d700 1 --2- 172.21.15.103:0/2499923273 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff08c152a90 0x7ff08c064920 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:22.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.368+0000 7ff09455d700 1 --2- 172.21.15.103:0/2499923273 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff07404d9c0 0x7ff07404fe80 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:22.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.368+0000 7ff09455d700 1 --2- 172.21.15.103:0/2499923273 >> v2:172.21.15.86:3300/0 conn(0x7ff08c0b5210 0x7ff08c127270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:22.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.368+0000 7ff09455d700 1 -- 172.21.15.103:0/2499923273 >> 172.21.15.103:0/2499923273 conn(0x7ff08c05ad30 msgr2=0x7ff08c0b39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:22.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.368+0000 7ff09455d700 1 -- 172.21.15.103:0/2499923273 shutdown_connections 2020-04-22T14:12:22.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.368+0000 7ff09455d700 1 -- 172.21.15.103:0/2499923273 wait complete. 2020-04-22T14:12:22.373 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.1 2020-04-22T14:12:22.385 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:22.401 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:12:22.491 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:12:22.509 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:12:22.552 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:22.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.551+0000 7f99acf3a700 1 Processor -- start 2020-04-22T14:12:22.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.551+0000 7f99acf3a700 1 -- start start 2020-04-22T14:12:22.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.553+0000 7f99acf3a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f99a8062170 0x7f99a80b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:22.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.553+0000 7f99acf3a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a8152e70 con 0x7f99a8152a90 2020-04-22T14:12:22.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.553+0000 7f99acf3a700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a80b56a0 con 0x7f99a80b5210 2020-04-22T14:12:22.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.553+0000 7f99acf3a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a80614f0 con 0x7f99a8062170 2020-04-22T14:12:22.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.553+0000 7f99a759e700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f99a80b5210 0x7f99a80adf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45012/0 (socket says 172.21.15.103:45012) 2020-04-22T14:12:22.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.553+0000 7f99a759e700 1 -- 172.21.15.103:0/107529282 learned_addr learned my addr 172.21.15.103:0/107529282 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:22.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.553+0000 7f99a659c700 1 --2- 172.21.15.103:0/107529282 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f99a8062170 0x7f99a80b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:22.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.553+0000 7f99a5d9b700 1 -- 172.21.15.103:0/107529282 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2998458891 0 0) 0x7f99a80b56a0 con 0x7f99a80b5210 2020-04-22T14:12:22.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.553+0000 7f99a5d9b700 1 -- 172.21.15.103:0/107529282 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9990003230 con 0x7f99a80b5210 2020-04-22T14:12:22.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.553+0000 7f99a5d9b700 1 -- 172.21.15.103:0/107529282 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2211502035 0 0) 0x7f99a8152e70 con 0x7f99a8152a90 2020-04-22T14:12:22.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.553+0000 7f99a5d9b700 1 -- 172.21.15.103:0/107529282 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99a80b56a0 con 0x7f99a8152a90 2020-04-22T14:12:22.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.553+0000 7f99a659c700 1 -- 172.21.15.103:0/107529282 >> v1:172.21.15.103:6789/0 conn(0x7f99a80b5210 legacy=0x7f99a80adf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:22.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.553+0000 7f99a659c700 1 -- 172.21.15.103:0/107529282 >> v1:172.21.15.86:6789/0 conn(0x7f99a8152a90 legacy=0x7f99a80b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:22.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.553+0000 7f99a659c700 1 -- 172.21.15.103:0/107529282 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a8061790 con 0x7f99a8062170 2020-04-22T14:12:22.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.553+0000 7f99a659c700 1 --2- 172.21.15.103:0/107529282 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f99a8062170 0x7f99a80b4db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f999c002f30 tx=0x7f99a805a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.553+0000 7f99a659c700 1 --2- 172.21.15.103:0/107529282 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f99a8062170 0x7f99a80b4db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f999c002f30 tx=0x7f99a805a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.553+0000 7f99a659c700 1 --2- 172.21.15.103:0/107529282 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f99a8062170 0x7f99a80b4db0 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7f999c002f30 tx=0x7f99a805a720).ready entity=mon.2 client_cookie=45f2500336fdf836 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:22.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.554+0000 7f99a659c700 1 --2- 172.21.15.103:0/107529282 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f99a8062170 0x7f99a80b4db0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f999c002f30 tx=0x7f99a805a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.554+0000 7f99a5d9b700 1 -- 172.21.15.103:0/107529282 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f999c008e40 con 0x7f99a8062170 2020-04-22T14:12:22.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.554+0000 7f99a659c700 1 --2- 172.21.15.103:0/107529282 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f99a8062170 0x7f99a80b4db0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f999c002f30 tx=0x7f99a805a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.554+0000 7f99a659c700 1 --2- 172.21.15.103:0/107529282 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f99a8062170 0x7f99a80b4db0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f999c002f30 tx=0x7f99a805a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.554+0000 7f99a5d9b700 1 -- 172.21.15.103:0/107529282 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f999c011500 con 0x7f99a8062170 2020-04-22T14:12:22.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.554+0000 7f99a5d9b700 1 -- 172.21.15.103:0/107529282 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f999c011920 con 0x7f99a8062170 2020-04-22T14:12:22.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.554+0000 7f99acf3a700 1 -- 172.21.15.103:0/107529282 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f99a8062170 msgr2=0x7f99a80b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:22.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.554+0000 7f99acf3a700 1 --2- 172.21.15.103:0/107529282 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f99a8062170 0x7f99a80b4db0 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7f999c002f30 tx=0x7f99a805a720).stop 2020-04-22T14:12:22.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.554+0000 7f99acf3a700 1 -- 172.21.15.103:0/107529282 shutdown_connections 2020-04-22T14:12:22.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.554+0000 7f99acf3a700 1 --2- 172.21.15.103:0/107529282 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f99a8062170 0x7f99a80b4db0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:22.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.554+0000 7f99acf3a700 1 -- 172.21.15.103:0/107529282 >> 172.21.15.103:0/107529282 conn(0x7f99a805ad30 msgr2=0x7f99a805b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:22.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.554+0000 7f99acf3a700 1 -- 172.21.15.103:0/107529282 shutdown_connections 2020-04-22T14:12:22.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.554+0000 7f99acf3a700 1 -- 172.21.15.103:0/107529282 wait complete. 2020-04-22T14:12:22.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.555+0000 7f99acf3a700 1 Processor -- start 2020-04-22T14:12:22.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.555+0000 7f99acf3a700 1 -- start start 2020-04-22T14:12:22.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.556+0000 7f99acf3a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f99a8062170 0x7f99a80ae260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:22.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.556+0000 7f99acf3a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f99a80b5210 0x7f99a80b7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:22.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.556+0000 7f99acf3a700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a80ae6c0 con 0x7f99a8152a90 2020-04-22T14:12:22.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.556+0000 7f99acf3a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a806f7f0 con 0x7f99a80b5210 2020-04-22T14:12:22.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.556+0000 7f99acf3a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a806fa90 con 0x7f99a8062170 2020-04-22T14:12:22.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.556+0000 7f99a6d9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f99a8062170 0x7f99a80ae260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:22.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.556+0000 7f99a759e700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f99a8152a90 0x7f99a8141280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45018/0 (socket says 172.21.15.103:45018) 2020-04-22T14:12:22.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.556+0000 7f99a759e700 1 -- 172.21.15.103:0/2705399781 learned_addr learned my addr 172.21.15.103:0/2705399781 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:22.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.556+0000 7f99a6d9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f99a8062170 0x7f99a80ae260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52824/0 (socket says 172.21.15.103:52824) 2020-04-22T14:12:22.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.556+0000 7f99a659c700 1 --2- 172.21.15.103:0/2705399781 >> v2:172.21.15.86:3300/0 conn(0x7f99a80b5210 0x7f99a80b7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:22.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.556+0000 7f99977fe700 1 -- 172.21.15.103:0/2705399781 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2231330453 0 0) 0x7f9990003230 con 0x7f99a8152a90 2020-04-22T14:12:22.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.556+0000 7f99977fe700 1 -- 172.21.15.103:0/2705399781 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f998c003230 con 0x7f99a8152a90 2020-04-22T14:12:22.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.557+0000 7f99a6d9d700 1 -- 172.21.15.103:0/2705399781 >> v2:172.21.15.86:3300/0 conn(0x7f99a80b5210 msgr2=0x7f99a80b7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:22.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.557+0000 7f99a6d9d700 1 --2- 172.21.15.103:0/2705399781 >> v2:172.21.15.86:3300/0 conn(0x7f99a80b5210 0x7f99a80b7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:22.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.557+0000 7f99a6d9d700 1 -- 172.21.15.103:0/2705399781 >> v1:172.21.15.103:6789/0 conn(0x7f99a8152a90 legacy=0x7f99a8141280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:22.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.557+0000 7f99a6d9d700 1 -- 172.21.15.103:0/2705399781 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a806fd30 con 0x7f99a8062170 2020-04-22T14:12:22.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.557+0000 7f99a6d9d700 1 --2- 172.21.15.103:0/2705399781 >> v2:172.21.15.103:3300/0 conn(0x7f99a8062170 0x7f99a80ae260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f99980010d0 tx=0x7f99980108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.557+0000 7f99a6d9d700 1 --2- 172.21.15.103:0/2705399781 >> v2:172.21.15.103:3300/0 conn(0x7f99a8062170 0x7f99a80ae260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f99980010d0 tx=0x7f99980108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.557+0000 7f99a6d9d700 1 --2- 172.21.15.103:0/2705399781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99a8062170 0x7f99a80ae260 secure :-1 s=READY pgs=1090 cs=0 l=1 rx=0x7f99980010d0 tx=0x7f99980108a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:22.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.557+0000 7f99a6d9d700 1 --2- 172.21.15.103:0/2705399781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99a8062170 0x7f99a80ae260 secure :-1 s=THROTTLE_DONE pgs=1090 cs=0 l=1 rx=0x7f99980010d0 tx=0x7f99980108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.557+0000 7f99977fe700 1 -- 172.21.15.103:0/2705399781 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9998006bc0 con 0x7f99a8062170 2020-04-22T14:12:22.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.557+0000 7f99a6d9d700 1 --2- 172.21.15.103:0/2705399781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99a8062170 0x7f99a80ae260 secure :-1 s=THROTTLE_DONE pgs=1090 cs=0 l=1 rx=0x7f99980010d0 tx=0x7f99980108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.557+0000 7f99a6d9d700 1 --2- 172.21.15.103:0/2705399781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99a8062170 0x7f99a80ae260 secure :-1 s=THROTTLE_DONE pgs=1090 cs=0 l=1 rx=0x7f99980010d0 tx=0x7f99980108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.557+0000 7f99977fe700 1 -- 172.21.15.103:0/2705399781 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9998011e90 con 0x7f99a8062170 2020-04-22T14:12:22.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.557+0000 7f99acf3a700 1 -- 172.21.15.103:0/2705399781 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a806ffd0 con 0x7f99a8062170 2020-04-22T14:12:22.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.557+0000 7f99977fe700 1 -- 172.21.15.103:0/2705399781 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9998008180 con 0x7f99a8062170 2020-04-22T14:12:22.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.557+0000 7f99acf3a700 1 -- 172.21.15.103:0/2705399781 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a80b7c10 con 0x7f99a8062170 2020-04-22T14:12:22.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.558+0000 7f99a6d9d700 1 --2- 172.21.15.103:0/2705399781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99a8062170 0x7f99a80ae260 secure :-1 s=THROTTLE_DONE pgs=1090 cs=0 l=1 rx=0x7f99980010d0 tx=0x7f99980108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.558+0000 7f99977fe700 1 -- 172.21.15.103:0/2705399781 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f99980083f0 con 0x7f99a8062170 2020-04-22T14:12:22.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.558+0000 7f99a6d9d700 1 --2- 172.21.15.103:0/2705399781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99a8062170 0x7f99a80ae260 secure :-1 s=THROTTLE_DONE pgs=1090 cs=0 l=1 rx=0x7f99980010d0 tx=0x7f99980108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.558+0000 7f99acf3a700 1 -- 172.21.15.103:0/2705399781 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99a80701d0 con 0x7f99a8062170 2020-04-22T14:12:22.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.558+0000 7f99977fe700 1 --2- 172.21.15.103:0/2705399781 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f998c04dd40 0x7f998c050200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:22.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.558+0000 7f99977fe700 1 -- 172.21.15.103:0/2705399781 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9998061460 con 0x7f99a8062170 2020-04-22T14:12:22.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.558+0000 7f99a659c700 1 --2- 172.21.15.103:0/2705399781 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f998c04dd40 0x7f998c050200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:22.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.559+0000 7f99a659c700 1 --2- 172.21.15.103:0/2705399781 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f998c04dd40 0x7f998c050200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f999c002f30 tx=0x7f99a805a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.559+0000 7f99a659c700 1 --2- 172.21.15.103:0/2705399781 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f998c04dd40 0x7f998c050200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f999c002f30 tx=0x7f99a805a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.559+0000 7f99a659c700 1 --2- 172.21.15.103:0/2705399781 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f998c04dd40 0x7f998c050200 secure :-1 s=READY pgs=404 cs=0 l=1 rx=0x7f999c002f30 tx=0x7f99a805a720).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:22.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.562+0000 7f99a6d9d700 1 --2- 172.21.15.103:0/2705399781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99a8062170 0x7f99a80ae260 secure :-1 s=THROTTLE_DONE pgs=1090 cs=0 l=1 rx=0x7f99980010d0 tx=0x7f99980108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.562+0000 7f99977fe700 1 -- 172.21.15.103:0/2705399781 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f99a80701d0 con 0x7f99a8062170 2020-04-22T14:12:22.573 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:12:22.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.764+0000 7f99acf3a700 1 -- 172.21.15.103:0/2705399781 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f99a80701d0 con 0x7f99a8062170 2020-04-22T14:12:22.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.768+0000 7f99a6d9d700 1 --2- 172.21.15.103:0/2705399781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99a8062170 0x7f99a80ae260 secure :-1 s=THROTTLE_DONE pgs=1090 cs=0 l=1 rx=0x7f99980010d0 tx=0x7f99980108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.768+0000 7f99977fe700 1 -- 172.21.15.103:0/2705399781 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v31) v1 ==== 184+0+0 (secure 0 0 0) 0x7f99a80701d0 con 0x7f99a8062170 2020-04-22T14:12:22.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.769+0000 7f99acf3a700 1 -- 172.21.15.103:0/2705399781 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f998c04dd40 msgr2=0x7f998c050200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:22.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.769+0000 7f99acf3a700 1 --2- 172.21.15.103:0/2705399781 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f998c04dd40 0x7f998c050200 secure :-1 s=READY pgs=404 cs=0 l=1 rx=0x7f999c002f30 tx=0x7f99a805a720).stop 2020-04-22T14:12:22.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.769+0000 7f99acf3a700 1 -- 172.21.15.103:0/2705399781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99a8062170 msgr2=0x7f99a80ae260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:22.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.769+0000 7f99acf3a700 1 --2- 172.21.15.103:0/2705399781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99a8062170 0x7f99a80ae260 secure :-1 s=READY pgs=1090 cs=0 l=1 rx=0x7f99980010d0 tx=0x7f99980108a0).stop 2020-04-22T14:12:22.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.770+0000 7f99acf3a700 1 -- 172.21.15.103:0/2705399781 shutdown_connections 2020-04-22T14:12:22.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.770+0000 7f99acf3a700 1 --2- 172.21.15.103:0/2705399781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99a8062170 0x7f99a80ae260 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:22.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.770+0000 7f99acf3a700 1 --2- 172.21.15.103:0/2705399781 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f998c04dd40 0x7f998c050200 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:22.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.770+0000 7f99acf3a700 1 --2- 172.21.15.103:0/2705399781 >> v2:172.21.15.86:3300/0 conn(0x7f99a80b5210 0x7f99a80b7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:22.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.770+0000 7f99acf3a700 1 -- 172.21.15.103:0/2705399781 >> 172.21.15.103:0/2705399781 conn(0x7f99a805ad30 msgr2=0x7f99a8131180 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:22.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.770+0000 7f99acf3a700 1 -- 172.21.15.103:0/2705399781 shutdown_connections 2020-04-22T14:12:22.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.770+0000 7f99acf3a700 1 -- 172.21.15.103:0/2705399781 wait complete. 2020-04-22T14:12:22.775 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.2 2020-04-22T14:12:22.783 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:22.798 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:12:22.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.947+0000 7f70d6dc9700 1 Processor -- start 2020-04-22T14:12:22.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.948+0000 7f70d6dc9700 1 -- start start 2020-04-22T14:12:22.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.948+0000 7f70d6dc9700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f70d0152a90 0x7f70d00b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:22.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.948+0000 7f70d6dc9700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f70d0062170 0x7f70d00b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:22.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.948+0000 7f70d6dc9700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70d00b5210 0x7f70d0156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:22.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.948+0000 7f70d6dc9700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70d00b5650 con 0x7f70d0152a90 2020-04-22T14:12:22.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.948+0000 7f70d6dc9700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70d00614f0 con 0x7f70d0062170 2020-04-22T14:12:22.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.948+0000 7f70d6dc9700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d0061790 con 0x7f70d00b5210 2020-04-22T14:12:22.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.948+0000 7f70d4b65700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f70d0062170 0x7f70d00b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:22.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.948+0000 7f70d4b65700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f70d0062170 0x7f70d00b4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52832/0 (socket says 172.21.15.103:52832) 2020-04-22T14:12:22.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.948+0000 7f70d4b65700 1 -- 172.21.15.103:0/1495852739 learned_addr learned my addr 172.21.15.103:0/1495852739 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:22.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.949+0000 7f70d5b67700 1 --2- 172.21.15.103:0/1495852739 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70d00b5210 0x7f70d0156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:22.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.949+0000 7f70d5366700 1 --2- 172.21.15.103:0/1495852739 >> v2:172.21.15.86:3300/0 conn(0x7f70d0152a90 0x7f70d00b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:22.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.949+0000 7f70d4b65700 1 -- 172.21.15.103:0/1495852739 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70d00b5210 msgr2=0x7f70d0156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:22.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.949+0000 7f70d4b65700 1 --2- 172.21.15.103:0/1495852739 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70d00b5210 0x7f70d0156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:22.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.949+0000 7f70d4b65700 1 -- 172.21.15.103:0/1495852739 >> v2:172.21.15.86:3300/0 conn(0x7f70d0152a90 msgr2=0x7f70d00b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:22.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.949+0000 7f70d4b65700 1 --2- 172.21.15.103:0/1495852739 >> v2:172.21.15.86:3300/0 conn(0x7f70d0152a90 0x7f70d00b44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:22.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.949+0000 7f70d4b65700 1 -- 172.21.15.103:0/1495852739 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d0061a30 con 0x7f70d0062170 2020-04-22T14:12:22.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.949+0000 7f70d4b65700 1 --2- 172.21.15.103:0/1495852739 >> v2:172.21.15.103:3300/0 conn(0x7f70d0062170 0x7f70d00b4db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f70c0002f30 tx=0x7f70d005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.949+0000 7f70d4b65700 1 --2- 172.21.15.103:0/1495852739 >> v2:172.21.15.103:3300/0 conn(0x7f70d0062170 0x7f70d00b4db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f70c0002f30 tx=0x7f70d005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.949+0000 7f70d4b65700 1 --2- 172.21.15.103:0/1495852739 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70d0062170 0x7f70d00b4db0 secure :-1 s=READY pgs=1091 cs=0 l=1 rx=0x7f70c0002f30 tx=0x7f70d005a720).ready entity=mon.1 client_cookie=f48425884d6b7fe8 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:22.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.949+0000 7f70d4b65700 1 --2- 172.21.15.103:0/1495852739 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70d0062170 0x7f70d00b4db0 secure :-1 s=THROTTLE_DONE pgs=1091 cs=0 l=1 rx=0x7f70c0002f30 tx=0x7f70d005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.949+0000 7f70c7fff700 1 -- 172.21.15.103:0/1495852739 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70c0011720 con 0x7f70d0062170 2020-04-22T14:12:22.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.949+0000 7f70d4b65700 1 --2- 172.21.15.103:0/1495852739 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70d0062170 0x7f70d00b4db0 secure :-1 s=THROTTLE_DONE pgs=1091 cs=0 l=1 rx=0x7f70c0002f30 tx=0x7f70d005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.949+0000 7f70c7fff700 1 -- 172.21.15.103:0/1495852739 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c0011880 con 0x7f70d0062170 2020-04-22T14:12:22.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.949+0000 7f70d4b65700 1 --2- 172.21.15.103:0/1495852739 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70d0062170 0x7f70d00b4db0 secure :-1 s=THROTTLE_DONE pgs=1091 cs=0 l=1 rx=0x7f70c0002f30 tx=0x7f70d005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.949+0000 7f70c7fff700 1 -- 172.21.15.103:0/1495852739 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70c0011ca0 con 0x7f70d0062170 2020-04-22T14:12:22.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.949+0000 7f70d6dc9700 1 -- 172.21.15.103:0/1495852739 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70d0062170 msgr2=0x7f70d00b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:22.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.949+0000 7f70d6dc9700 1 --2- 172.21.15.103:0/1495852739 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70d0062170 0x7f70d00b4db0 secure :-1 s=READY pgs=1091 cs=0 l=1 rx=0x7f70c0002f30 tx=0x7f70d005a720).stop 2020-04-22T14:12:22.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.949+0000 7f70d6dc9700 1 -- 172.21.15.103:0/1495852739 shutdown_connections 2020-04-22T14:12:22.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.949+0000 7f70d6dc9700 1 --2- 172.21.15.103:0/1495852739 >> v2:172.21.15.86:3300/0 conn(0x7f70d0152a90 0x7f70d00b44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:22.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.950+0000 7f70d6dc9700 1 --2- 172.21.15.103:0/1495852739 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70d00b5210 0x7f70d0156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:22.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.950+0000 7f70d6dc9700 1 --2- 172.21.15.103:0/1495852739 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70d0062170 0x7f70d00b4db0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:22.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.950+0000 7f70d6dc9700 1 -- 172.21.15.103:0/1495852739 >> 172.21.15.103:0/1495852739 conn(0x7f70d005ad30 msgr2=0x7f70d005b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:22.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.950+0000 7f70d6dc9700 1 -- 172.21.15.103:0/1495852739 shutdown_connections 2020-04-22T14:12:22.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.950+0000 7f70d6dc9700 1 -- 172.21.15.103:0/1495852739 wait complete. 2020-04-22T14:12:22.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.951+0000 7f70d6dc9700 1 Processor -- start 2020-04-22T14:12:22.961 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.951+0000 7f70d6dc9700 1 -- start start 2020-04-22T14:12:22.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.952+0000 7f70d6dc9700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f70d0152a90 0x7f70d0140270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:22.964 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.952+0000 7f70d6dc9700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d0154250 con 0x7f70d0062170 2020-04-22T14:12:22.964 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.952+0000 7f70d6dc9700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d01544f0 con 0x7f70d00b5210 2020-04-22T14:12:22.964 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.952+0000 7f70d6dc9700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70d00661f0 con 0x7f70d0152a90 2020-04-22T14:12:22.964 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.952+0000 7f70d5b67700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f70d0152a90 0x7f70d0140270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:22.964 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.952+0000 7f70d5b67700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f70d0152a90 0x7f70d0140270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52842/0 (socket says 172.21.15.103:52842) 2020-04-22T14:12:22.964 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.952+0000 7f70d4b65700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f70d00b5210 0x7f70d00639b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45030/0 (socket says 172.21.15.103:45030) 2020-04-22T14:12:22.965 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.952+0000 7f70d5b67700 1 -- 172.21.15.103:0/541949125 learned_addr learned my addr 172.21.15.103:0/541949125 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:22.965 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.952+0000 7f70d5b67700 1 -- 172.21.15.103:0/541949125 >> v1:172.21.15.103:6789/0 conn(0x7f70d00b5210 legacy=0x7f70d00639b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:22.965 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.952+0000 7f70d5b67700 1 -- 172.21.15.103:0/541949125 >> v1:172.21.15.86:6789/0 conn(0x7f70d0062170 legacy=0x7f70d00ae0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:22.965 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.952+0000 7f70c5ffb700 1 -- 172.21.15.103:0/541949125 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3423098682 0 0) 0x7f70d01544f0 con 0x7f70d00b5210 2020-04-22T14:12:22.965 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.952+0000 7f70d5b67700 1 -- 172.21.15.103:0/541949125 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d0154790 con 0x7f70d0152a90 2020-04-22T14:12:22.965 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.952+0000 7f70d5b67700 1 --2- 172.21.15.103:0/541949125 >> v2:172.21.15.103:3300/0 conn(0x7f70d0152a90 0x7f70d0140270 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f70c8002f30 tx=0x7f70c8010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.952+0000 7f70d5b67700 1 --2- 172.21.15.103:0/541949125 >> v2:172.21.15.103:3300/0 conn(0x7f70d0152a90 0x7f70d0140270 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f70c8002f30 tx=0x7f70c8010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.952+0000 7f70d5b67700 1 --2- 172.21.15.103:0/541949125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70d0152a90 0x7f70d0140270 secure :-1 s=READY pgs=1093 cs=0 l=1 rx=0x7f70c8002f30 tx=0x7f70c8010bc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:22.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.952+0000 7f70d5b67700 1 --2- 172.21.15.103:0/541949125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70d0152a90 0x7f70d0140270 secure :-1 s=THROTTLE_DONE pgs=1093 cs=0 l=1 rx=0x7f70c8002f30 tx=0x7f70c8010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.952+0000 7f70c5ffb700 1 -- 172.21.15.103:0/541949125 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70c8012a80 con 0x7f70d0152a90 2020-04-22T14:12:22.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.952+0000 7f70d5b67700 1 --2- 172.21.15.103:0/541949125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70d0152a90 0x7f70d0140270 secure :-1 s=THROTTLE_DONE pgs=1093 cs=0 l=1 rx=0x7f70c8002f30 tx=0x7f70c8010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.952+0000 7f70d5b67700 1 --2- 172.21.15.103:0/541949125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70d0152a90 0x7f70d0140270 secure :-1 s=THROTTLE_DONE pgs=1093 cs=0 l=1 rx=0x7f70c8002f30 tx=0x7f70c8010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.952+0000 7f70c5ffb700 1 -- 172.21.15.103:0/541949125 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c8012be0 con 0x7f70d0152a90 2020-04-22T14:12:22.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.952+0000 7f70d6dc9700 1 -- 172.21.15.103:0/541949125 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d0154c30 con 0x7f70d0152a90 2020-04-22T14:12:22.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.952+0000 7f70c5ffb700 1 -- 172.21.15.103:0/541949125 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70c80091c0 con 0x7f70d0152a90 2020-04-22T14:12:22.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.952+0000 7f70d6dc9700 1 -- 172.21.15.103:0/541949125 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d0153df0 con 0x7f70d0152a90 2020-04-22T14:12:22.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.953+0000 7f70d5b67700 1 --2- 172.21.15.103:0/541949125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70d0152a90 0x7f70d0140270 secure :-1 s=THROTTLE_DONE pgs=1093 cs=0 l=1 rx=0x7f70c8002f30 tx=0x7f70c8010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.953+0000 7f70d6dc9700 1 -- 172.21.15.103:0/541949125 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d0154920 con 0x7f70d0152a90 2020-04-22T14:12:22.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.953+0000 7f70c5ffb700 1 -- 172.21.15.103:0/541949125 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f70c8013070 con 0x7f70d0152a90 2020-04-22T14:12:22.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.953+0000 7f70d5b67700 1 --2- 172.21.15.103:0/541949125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70d0152a90 0x7f70d0140270 secure :-1 s=THROTTLE_DONE pgs=1093 cs=0 l=1 rx=0x7f70c8002f30 tx=0x7f70c8010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.954+0000 7f70c5ffb700 1 --2- 172.21.15.103:0/541949125 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f70b004d840 0x7f70b004fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:22.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.954+0000 7f70c5ffb700 1 -- 172.21.15.103:0/541949125 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f70c8061750 con 0x7f70d0152a90 2020-04-22T14:12:22.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.954+0000 7f70d5366700 1 --2- 172.21.15.103:0/541949125 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f70b004d840 0x7f70b004fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:22.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.954+0000 7f70d5366700 1 --2- 172.21.15.103:0/541949125 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f70b004d840 0x7f70b004fd00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f70d00aee20 tx=0x7f70cc008ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.954+0000 7f70d5366700 1 --2- 172.21.15.103:0/541949125 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f70b004d840 0x7f70b004fd00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f70d00aee20 tx=0x7f70cc008ff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.954+0000 7f70d5366700 1 --2- 172.21.15.103:0/541949125 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f70b004d840 0x7f70b004fd00 secure :-1 s=READY pgs=405 cs=0 l=1 rx=0x7f70d00aee20 tx=0x7f70cc008ff0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:22.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.958+0000 7f70d5b67700 1 --2- 172.21.15.103:0/541949125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70d0152a90 0x7f70d0140270 secure :-1 s=THROTTLE_DONE pgs=1093 cs=0 l=1 rx=0x7f70c8002f30 tx=0x7f70c8010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:22.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:22.958+0000 7f70c5ffb700 1 -- 172.21.15.103:0/541949125 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f70c803cad0 con 0x7f70d0152a90 2020-04-22T14:12:23.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.147+0000 7f70d6dc9700 1 -- 172.21.15.103:0/541949125 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f70d0056c90 con 0x7f70d0152a90 2020-04-22T14:12:23.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.152+0000 7f70d5b67700 1 --2- 172.21.15.103:0/541949125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70d0152a90 0x7f70d0140270 secure :-1 s=THROTTLE_DONE pgs=1093 cs=0 l=1 rx=0x7f70c8002f30 tx=0x7f70c8010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:23.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.152+0000 7f70c5ffb700 1 -- 172.21.15.103:0/541949125 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v32) v1 ==== 184+0+0 (secure 0 0 0) 0x7f70c80400f0 con 0x7f70d0152a90 2020-04-22T14:12:23.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.153+0000 7f70d6dc9700 1 -- 172.21.15.103:0/541949125 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f70b004d840 msgr2=0x7f70b004fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:23.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.153+0000 7f70d6dc9700 1 --2- 172.21.15.103:0/541949125 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f70b004d840 0x7f70b004fd00 secure :-1 s=READY pgs=405 cs=0 l=1 rx=0x7f70d00aee20 tx=0x7f70cc008ff0).stop 2020-04-22T14:12:23.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.153+0000 7f70d6dc9700 1 -- 172.21.15.103:0/541949125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70d0152a90 msgr2=0x7f70d0140270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:23.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.153+0000 7f70d6dc9700 1 --2- 172.21.15.103:0/541949125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70d0152a90 0x7f70d0140270 secure :-1 s=READY pgs=1093 cs=0 l=1 rx=0x7f70c8002f30 tx=0x7f70c8010bc0).stop 2020-04-22T14:12:23.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.153+0000 7f70d6dc9700 1 -- 172.21.15.103:0/541949125 shutdown_connections 2020-04-22T14:12:23.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.153+0000 7f70d6dc9700 1 --2- 172.21.15.103:0/541949125 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f70b004d840 0x7f70b004fd00 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:23.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.153+0000 7f70d6dc9700 1 --2- 172.21.15.103:0/541949125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70d0152a90 0x7f70d0140270 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:23.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.153+0000 7f70d6dc9700 1 -- 172.21.15.103:0/541949125 >> 172.21.15.103:0/541949125 conn(0x7f70d005ad30 msgr2=0x7f70d0130080 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:23.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.153+0000 7f70d6dc9700 1 -- 172.21.15.103:0/541949125 shutdown_connections 2020-04-22T14:12:23.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.153+0000 7f70d6dc9700 1 -- 172.21.15.103:0/541949125 wait complete. 2020-04-22T14:12:23.159 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.3 2020-04-22T14:12:23.167 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:23.186 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:12:23.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.329+0000 7f6b5eec3700 1 Processor -- start 2020-04-22T14:12:23.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.329+0000 7f6b5eec3700 1 -- start start 2020-04-22T14:12:23.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.329+0000 7f6b5eec3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6b5812c0d0 0x7f6b581464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:23.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.329+0000 7f6b5eec3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6b58065fe0 0x7f6b5805b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:23.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.329+0000 7f6b5eec3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b5805b8a0 0x7f6b58062ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:23.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.329+0000 7f6b5eec3700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b5812c4b0 con 0x7f6b58065fe0 2020-04-22T14:12:23.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.329+0000 7f6b5eec3700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b58143300 con 0x7f6b5812c0d0 2020-04-22T14:12:23.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.329+0000 7f6b5eec3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b581435a0 con 0x7f6b5805b8a0 2020-04-22T14:12:23.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.330+0000 7f6b5cc5f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6b5812c0d0 0x7f6b581464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:23.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.330+0000 7f6b5cc5f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6b5812c0d0 0x7f6b581464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52846/0 (socket says 172.21.15.103:52846) 2020-04-22T14:12:23.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.330+0000 7f6b5cc5f700 1 -- 172.21.15.103:0/3406481331 learned_addr learned my addr 172.21.15.103:0/3406481331 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:23.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.330+0000 7f6b57fff700 1 --2- 172.21.15.103:0/3406481331 >> v2:172.21.15.86:3300/0 conn(0x7f6b58065fe0 0x7f6b5805b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:23.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.330+0000 7f6b5d460700 1 --2- 172.21.15.103:0/3406481331 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b5805b8a0 0x7f6b58062ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:23.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.330+0000 7f6b5cc5f700 1 -- 172.21.15.103:0/3406481331 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b5805b8a0 msgr2=0x7f6b58062ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:23.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.330+0000 7f6b5cc5f700 1 --2- 172.21.15.103:0/3406481331 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b5805b8a0 0x7f6b58062ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:23.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.330+0000 7f6b5cc5f700 1 -- 172.21.15.103:0/3406481331 >> v2:172.21.15.86:3300/0 conn(0x7f6b58065fe0 msgr2=0x7f6b5805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:23.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.330+0000 7f6b5cc5f700 1 --2- 172.21.15.103:0/3406481331 >> v2:172.21.15.86:3300/0 conn(0x7f6b58065fe0 0x7f6b5805b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:23.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.330+0000 7f6b5cc5f700 1 -- 172.21.15.103:0/3406481331 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b58143840 con 0x7f6b5812c0d0 2020-04-22T14:12:23.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.330+0000 7f6b5cc5f700 1 --2- 172.21.15.103:0/3406481331 >> v2:172.21.15.103:3300/0 conn(0x7f6b5812c0d0 0x7f6b581464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6b48002f30 tx=0x7f6b48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:23.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.330+0000 7f6b5cc5f700 1 --2- 172.21.15.103:0/3406481331 >> v2:172.21.15.103:3300/0 conn(0x7f6b5812c0d0 0x7f6b581464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6b48002f30 tx=0x7f6b48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:23.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.330+0000 7f6b5cc5f700 1 --2- 172.21.15.103:0/3406481331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b5812c0d0 0x7f6b581464e0 secure :-1 s=READY pgs=1094 cs=0 l=1 rx=0x7f6b48002f30 tx=0x7f6b48007a40).ready entity=mon.1 client_cookie=205a0eafef8cb1b6 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:23.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.330+0000 7f6b5cc5f700 1 --2- 172.21.15.103:0/3406481331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b5812c0d0 0x7f6b581464e0 secure :-1 s=THROTTLE_DONE pgs=1094 cs=0 l=1 rx=0x7f6b48002f30 tx=0x7f6b48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:23.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.330+0000 7f6b577fe700 1 -- 172.21.15.103:0/3406481331 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b480115c0 con 0x7f6b5812c0d0 2020-04-22T14:12:23.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.330+0000 7f6b5cc5f700 1 --2- 172.21.15.103:0/3406481331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b5812c0d0 0x7f6b581464e0 secure :-1 s=THROTTLE_DONE pgs=1094 cs=0 l=1 rx=0x7f6b48002f30 tx=0x7f6b48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:23.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.330+0000 7f6b5cc5f700 1 --2- 172.21.15.103:0/3406481331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b5812c0d0 0x7f6b581464e0 secure :-1 s=THROTTLE_DONE pgs=1094 cs=0 l=1 rx=0x7f6b48002f30 tx=0x7f6b48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:23.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.330+0000 7f6b577fe700 1 -- 172.21.15.103:0/3406481331 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b48011720 con 0x7f6b5812c0d0 2020-04-22T14:12:23.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.330+0000 7f6b577fe700 1 -- 172.21.15.103:0/3406481331 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b48011b40 con 0x7f6b5812c0d0 2020-04-22T14:12:23.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.330+0000 7f6b5eec3700 1 -- 172.21.15.103:0/3406481331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b5812c0d0 msgr2=0x7f6b581464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:23.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.330+0000 7f6b5eec3700 1 --2- 172.21.15.103:0/3406481331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b5812c0d0 0x7f6b581464e0 secure :-1 s=READY pgs=1094 cs=0 l=1 rx=0x7f6b48002f30 tx=0x7f6b48007a40).stop 2020-04-22T14:12:23.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.331+0000 7f6b5eec3700 1 -- 172.21.15.103:0/3406481331 shutdown_connections 2020-04-22T14:12:23.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.331+0000 7f6b5eec3700 1 --2- 172.21.15.103:0/3406481331 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b5805b8a0 0x7f6b58062ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:23.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.331+0000 7f6b5eec3700 1 --2- 172.21.15.103:0/3406481331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b5812c0d0 0x7f6b581464e0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:23.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.331+0000 7f6b5eec3700 1 --2- 172.21.15.103:0/3406481331 >> v2:172.21.15.86:3300/0 conn(0x7f6b58065fe0 0x7f6b5805b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:23.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.331+0000 7f6b5eec3700 1 -- 172.21.15.103:0/3406481331 >> 172.21.15.103:0/3406481331 conn(0x7f6b580b9160 msgr2=0x7f6b5805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:23.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.331+0000 7f6b5eec3700 1 -- 172.21.15.103:0/3406481331 shutdown_connections 2020-04-22T14:12:23.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.331+0000 7f6b5eec3700 1 -- 172.21.15.103:0/3406481331 wait complete. 2020-04-22T14:12:23.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.332+0000 7f6b5eec3700 1 Processor -- start 2020-04-22T14:12:23.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.332+0000 7f6b5eec3700 1 -- start start 2020-04-22T14:12:23.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.332+0000 7f6b5eec3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b58065fe0 0x7f6b580ae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:23.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.332+0000 7f6b5eec3700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b58145f70 con 0x7f6b5805b8a0 2020-04-22T14:12:23.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.332+0000 7f6b5eec3700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b58145cd0 con 0x7f6b5812c0d0 2020-04-22T14:12:23.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.332+0000 7f6b5eec3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5813f910 con 0x7f6b58065fe0 2020-04-22T14:12:23.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.333+0000 7f6b5d460700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f6b5812c0d0 0x7f6b58157110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45046/0 (socket says 172.21.15.103:45046) 2020-04-22T14:12:23.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.333+0000 7f6b5d460700 1 -- 172.21.15.103:0/2995320207 learned_addr learned my addr 172.21.15.103:0/2995320207 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:23.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.333+0000 7f6b57fff700 1 --2- 172.21.15.103:0/2995320207 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b58065fe0 0x7f6b580ae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:23.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.333+0000 7f6b55ffb700 1 -- 172.21.15.103:0/2995320207 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2664844071 0 0) 0x7f6b58145cd0 con 0x7f6b5812c0d0 2020-04-22T14:12:23.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.333+0000 7f6b55ffb700 1 -- 172.21.15.103:0/2995320207 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b38002fe0 con 0x7f6b5812c0d0 2020-04-22T14:12:23.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.333+0000 7f6b55ffb700 1 -- 172.21.15.103:0/2995320207 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 382869896 0 0) 0x7f6b58145f70 con 0x7f6b5805b8a0 2020-04-22T14:12:23.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.333+0000 7f6b55ffb700 1 -- 172.21.15.103:0/2995320207 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b58145cd0 con 0x7f6b5805b8a0 2020-04-22T14:12:23.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.333+0000 7f6b55ffb700 1 -- 172.21.15.103:0/2995320207 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 217100646 0 0) 0x7f6b38002fe0 con 0x7f6b5812c0d0 2020-04-22T14:12:23.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.333+0000 7f6b55ffb700 1 -- 172.21.15.103:0/2995320207 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6b58145f70 con 0x7f6b5812c0d0 2020-04-22T14:12:23.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.333+0000 7f6b55ffb700 1 -- 172.21.15.103:0/2995320207 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f6b50001850 con 0x7f6b5812c0d0 2020-04-22T14:12:23.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.333+0000 7f6b55ffb700 1 -- 172.21.15.103:0/2995320207 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b58065fe0 msgr2=0x7f6b580ae0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:23.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.333+0000 7f6b55ffb700 1 --2- 172.21.15.103:0/2995320207 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b58065fe0 0x7f6b580ae0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:23.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.333+0000 7f6b55ffb700 1 -- 172.21.15.103:0/2995320207 >> v1:172.21.15.103:6789/0 conn(0x7f6b5812c0d0 legacy=0x7f6b58157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:23.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.333+0000 7f6b55ffb700 1 -- 172.21.15.103:0/2995320207 >> v1:172.21.15.86:6789/0 conn(0x7f6b5805b8a0 legacy=0x7f6b5812a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:23.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.333+0000 7f6b55ffb700 1 --2- 172.21.15.103:0/2995320207 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b38004b20 0x7f6b38004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:23.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.333+0000 7f6b55ffb700 1 --2- 172.21.15.103:0/2995320207 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b38003800 0x7f6b38003c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:23.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.333+0000 7f6b55ffb700 1 --2- 172.21.15.103:0/2995320207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b380040e0 0x7f6b3800b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:23.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.333+0000 7f6b55ffb700 1 -- 172.21.15.103:0/2995320207 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5813f910 con 0x7f6b38003800 2020-04-22T14:12:23.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.333+0000 7f6b55ffb700 1 -- 172.21.15.103:0/2995320207 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b38004650 con 0x7f6b380040e0 2020-04-22T14:12:23.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.333+0000 7f6b55ffb700 1 -- 172.21.15.103:0/2995320207 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3800bbb0 con 0x7f6b38004b20 2020-04-22T14:12:23.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.333+0000 7f6b57fff700 1 --2- 172.21.15.103:0/2995320207 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b58065fe0 0x7f6b580ae0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:12:23.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.333+0000 7f6b5d460700 1 --2- 172.21.15.103:0/2995320207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b380040e0 0x7f6b3800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:23.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.333+0000 7f6b5cc5f700 1 --2- 172.21.15.103:0/2995320207 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b38004b20 0x7f6b38004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:23.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.333+0000 7f6b57fff700 1 --2- 172.21.15.103:0/2995320207 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b38003800 0x7f6b38003c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:23.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.333+0000 7f6b5d460700 1 -- 172.21.15.103:0/2995320207 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b38004b20 msgr2=0x7f6b38004f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:23.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.333+0000 7f6b5d460700 1 --2- 172.21.15.103:0/2995320207 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b38004b20 0x7f6b38004f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:23.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.333+0000 7f6b5d460700 1 -- 172.21.15.103:0/2995320207 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b38003800 msgr2=0x7f6b38003c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:23.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.333+0000 7f6b5d460700 1 --2- 172.21.15.103:0/2995320207 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b38003800 0x7f6b38003c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:23.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.333+0000 7f6b5d460700 1 -- 172.21.15.103:0/2995320207 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b58144d50 con 0x7f6b380040e0 2020-04-22T14:12:23.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.333+0000 7f6b5eec3700 1 -- 172.21.15.103:0/2995320207 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b5813fdb0 con 0x7f6b380040e0 2020-04-22T14:12:23.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.333+0000 7f6b5d460700 1 --2- 172.21.15.103:0/2995320207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b380040e0 0x7f6b3800b750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6b50001620 tx=0x7f6b50011a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:23.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.333+0000 7f6b5eec3700 1 -- 172.21.15.103:0/2995320207 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b581459f0 con 0x7f6b380040e0 2020-04-22T14:12:23.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.334+0000 7f6b5d460700 1 --2- 172.21.15.103:0/2995320207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b380040e0 0x7f6b3800b750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6b50001620 tx=0x7f6b50011a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:23.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.334+0000 7f6b5d460700 1 --2- 172.21.15.103:0/2995320207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b380040e0 0x7f6b3800b750 secure :-1 s=READY pgs=1096 cs=0 l=1 rx=0x7f6b50001620 tx=0x7f6b50011a20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:23.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.334+0000 7f6b5d460700 1 --2- 172.21.15.103:0/2995320207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b380040e0 0x7f6b3800b750 secure :-1 s=THROTTLE_DONE pgs=1096 cs=0 l=1 rx=0x7f6b50001620 tx=0x7f6b50011a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:23.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.334+0000 7f6b55ffb700 1 -- 172.21.15.103:0/2995320207 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b50005e20 con 0x7f6b380040e0 2020-04-22T14:12:23.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.334+0000 7f6b5d460700 1 --2- 172.21.15.103:0/2995320207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b380040e0 0x7f6b3800b750 secure :-1 s=THROTTLE_DONE pgs=1096 cs=0 l=1 rx=0x7f6b50001620 tx=0x7f6b50011a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:23.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.334+0000 7f6b5d460700 1 --2- 172.21.15.103:0/2995320207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b380040e0 0x7f6b3800b750 secure :-1 s=THROTTLE_DONE pgs=1096 cs=0 l=1 rx=0x7f6b50001620 tx=0x7f6b50011a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:23.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.334+0000 7f6b55ffb700 1 -- 172.21.15.103:0/2995320207 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b5000d470 con 0x7f6b380040e0 2020-04-22T14:12:23.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.334+0000 7f6b55ffb700 1 -- 172.21.15.103:0/2995320207 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b5000d7d0 con 0x7f6b380040e0 2020-04-22T14:12:23.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.334+0000 7f6b5d460700 1 --2- 172.21.15.103:0/2995320207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b380040e0 0x7f6b3800b750 secure :-1 s=THROTTLE_DONE pgs=1096 cs=0 l=1 rx=0x7f6b50001620 tx=0x7f6b50011a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:23.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.334+0000 7f6b5eec3700 1 -- 172.21.15.103:0/2995320207 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b34003340 con 0x7f6b380040e0 2020-04-22T14:12:23.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.335+0000 7f6b55ffb700 1 -- 172.21.15.103:0/2995320207 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f6b5000d930 con 0x7f6b380040e0 2020-04-22T14:12:23.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.335+0000 7f6b5d460700 1 --2- 172.21.15.103:0/2995320207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b380040e0 0x7f6b3800b750 secure :-1 s=THROTTLE_DONE pgs=1096 cs=0 l=1 rx=0x7f6b50001620 tx=0x7f6b50011a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:23.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.335+0000 7f6b55ffb700 1 --2- 172.21.15.103:0/2995320207 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6b380562e0 0x7f6b380587a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:23.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.335+0000 7f6b55ffb700 1 -- 172.21.15.103:0/2995320207 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6b50061c50 con 0x7f6b380040e0 2020-04-22T14:12:23.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.335+0000 7f6b5cc5f700 1 --2- 172.21.15.103:0/2995320207 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6b380562e0 0x7f6b380587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:23.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.335+0000 7f6b5cc5f700 1 --2- 172.21.15.103:0/2995320207 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6b380562e0 0x7f6b380587a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6b48007ed0 tx=0x7f6b48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:23.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.335+0000 7f6b5cc5f700 1 --2- 172.21.15.103:0/2995320207 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6b380562e0 0x7f6b380587a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6b48007ed0 tx=0x7f6b48007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:23.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.335+0000 7f6b5cc5f700 1 --2- 172.21.15.103:0/2995320207 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6b380562e0 0x7f6b380587a0 secure :-1 s=READY pgs=406 cs=0 l=1 rx=0x7f6b48007ed0 tx=0x7f6b48007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:23.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.339+0000 7f6b5d460700 1 --2- 172.21.15.103:0/2995320207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b380040e0 0x7f6b3800b750 secure :-1 s=THROTTLE_DONE pgs=1096 cs=0 l=1 rx=0x7f6b50001620 tx=0x7f6b50011a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:23.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.339+0000 7f6b55ffb700 1 -- 172.21.15.103:0/2995320207 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f6b5003d090 con 0x7f6b380040e0 2020-04-22T14:12:23.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.530+0000 7f6b5eec3700 1 -- 172.21.15.103:0/2995320207 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b340036e0 con 0x7f6b380040e0 2020-04-22T14:12:23.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.531+0000 7f6b5d460700 1 --2- 172.21.15.103:0/2995320207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b380040e0 0x7f6b3800b750 secure :-1 s=THROTTLE_DONE pgs=1096 cs=0 l=1 rx=0x7f6b50001620 tx=0x7f6b50011a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:23.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.531+0000 7f6b55ffb700 1 -- 172.21.15.103:0/2995320207 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2137 (secure 0 0 0) 0x7f6b500406b0 con 0x7f6b380040e0 2020-04-22T14:12:23.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.532+0000 7f6b5eec3700 1 -- 172.21.15.103:0/2995320207 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6b380562e0 msgr2=0x7f6b380587a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:23.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.532+0000 7f6b5eec3700 1 --2- 172.21.15.103:0/2995320207 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6b380562e0 0x7f6b380587a0 secure :-1 s=READY pgs=406 cs=0 l=1 rx=0x7f6b48007ed0 tx=0x7f6b48007a40).stop 2020-04-22T14:12:23.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.532+0000 7f6b5eec3700 1 -- 172.21.15.103:0/2995320207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b380040e0 msgr2=0x7f6b3800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:23.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.532+0000 7f6b5eec3700 1 --2- 172.21.15.103:0/2995320207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b380040e0 0x7f6b3800b750 secure :-1 s=READY pgs=1096 cs=0 l=1 rx=0x7f6b50001620 tx=0x7f6b50011a20).stop 2020-04-22T14:12:23.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.532+0000 7f6b5d460700 1 -- 172.21.15.103:0/2995320207 reap_dead start 2020-04-22T14:12:23.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.532+0000 7f6b5eec3700 1 -- 172.21.15.103:0/2995320207 shutdown_connections 2020-04-22T14:12:23.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.532+0000 7f6b5eec3700 1 --2- 172.21.15.103:0/2995320207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b380040e0 0x7f6b3800b750 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:23.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.532+0000 7f6b5eec3700 1 -- 172.21.15.103:0/2995320207 >> 172.21.15.103:0/2995320207 conn(0x7f6b580b9160 msgr2=0x7f6b58062120 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:23.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.532+0000 7f6b5eec3700 1 -- 172.21.15.103:0/2995320207 shutdown_connections 2020-04-22T14:12:23.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:23.532+0000 7f6b5eec3700 1 -- 172.21.15.103:0/2995320207 wait complete. 2020-04-22T14:12:23.539 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 50 2020-04-22T14:12:23.539 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:12:23.539 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5435,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3857335366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3857335366},{"type":"v1","addr":"172.21.15.86:6835","nonce":3857335366}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":46}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:20.884022+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6513},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6513":{"gid":6513,"name":"a","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/46849623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":46849623},{"type":"v1","addr":"172.21.15.103:6833","nonce":46849623}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:12:23.751 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 6513}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 13, u'failed': [], u'epoch': 50, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [14], u'info': {u'gid_6513': {u'export_targets': [], u'name': u'a', u'incarnation': 47, u'state_seq': 3, u'state': u'up:active', u'gid': 6513, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 46849623, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 46849623, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/46849623'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:12:18.873897+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:12:20.884022+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:12:23.751 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:12:23.752 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:23.767 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:12:23.930 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:12:23.930 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:12:23.930 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:12:23.931 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 6513, 2020-04-22T14:12:23.931 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:12:23.931 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:12:23.931 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 5.0524922109999997, 2020-04-22T14:12:23.931 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 50, 2020-04-22T14:12:23.931 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 77, 2020-04-22T14:12:23.931 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 77, 2020-04-22T14:12:23.932 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 10.268082481 2020-04-22T14:12:23.932 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:12:23.938 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 6513, "want_state": "up:active", "state": "up:active", "rank_uptime": 5.0524922109999997, "mdsmap_epoch": 50, "osdmap_epoch": 77, "osdmap_epoch_barrier": 77, "uptime": 10.268082481 } 2020-04-22T14:12:23.938 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:23.952 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:12:24.097 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.094+0000 7f106bf8a700 1 Processor -- start 2020-04-22T14:12:24.098 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.094+0000 7f106bf8a700 1 -- start start 2020-04-22T14:12:24.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.095+0000 7f106bf8a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1064065fe0 0x7f10641464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:24.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.095+0000 7f106bf8a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1064143300 con 0x7f106412c0d0 2020-04-22T14:12:24.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.095+0000 7f106bf8a700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10641435a0 con 0x7f1064063e30 2020-04-22T14:12:24.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.095+0000 7f106bf8a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1064143840 con 0x7f1064065fe0 2020-04-22T14:12:24.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.095+0000 7f106a527700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f1064063e30 0x7f10640642c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45060/0 (socket says 172.21.15.103:45060) 2020-04-22T14:12:24.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.095+0000 7f106a527700 1 -- 172.21.15.103:0/2427802866 learned_addr learned my addr 172.21.15.103:0/2427802866 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:24.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.096+0000 7f1069525700 1 --2- 172.21.15.103:0/2427802866 >> v2:172.21.15.86:3300/0 conn(0x7f1064065fe0 0x7f10641464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:24.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.096+0000 7f1068d24700 1 -- 172.21.15.103:0/2427802866 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3307686069 0 0) 0x7f10641435a0 con 0x7f1064063e30 2020-04-22T14:12:24.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.096+0000 7f1068d24700 1 -- 172.21.15.103:0/2427802866 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f104c003230 con 0x7f1064063e30 2020-04-22T14:12:24.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.096+0000 7f1068d24700 1 -- 172.21.15.103:0/2427802866 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2852891888 0 0) 0x7f104c003230 con 0x7f1064063e30 2020-04-22T14:12:24.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.096+0000 7f1068d24700 1 -- 172.21.15.103:0/2427802866 >> v2:172.21.15.86:3300/0 conn(0x7f1064065fe0 msgr2=0x7f10641464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:24.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.096+0000 7f1068d24700 1 --2- 172.21.15.103:0/2427802866 >> v2:172.21.15.86:3300/0 conn(0x7f1064065fe0 0x7f10641464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:24.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.096+0000 7f1068d24700 1 -- 172.21.15.103:0/2427802866 >> v1:172.21.15.86:6789/0 conn(0x7f106412c0d0 legacy=0x7f106405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:24.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.096+0000 7f1068d24700 1 -- 172.21.15.103:0/2427802866 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106405bb50 con 0x7f1064063e30 2020-04-22T14:12:24.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.096+0000 7f1068d24700 1 -- 172.21.15.103:0/2427802866 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f105c001a50 con 0x7f1064063e30 2020-04-22T14:12:24.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.096+0000 7f1068d24700 1 -- 172.21.15.103:0/2427802866 >> v1:172.21.15.103:6789/0 conn(0x7f1064063e30 legacy=0x7f10640642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:24.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.096+0000 7f1068d24700 1 --2- 172.21.15.103:0/2427802866 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f104c003720 0x7f104c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:24.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.096+0000 7f1068d24700 1 --2- 172.21.15.103:0/2427802866 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f104c0044d0 0x7f104c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:24.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.096+0000 7f1068d24700 1 --2- 172.21.15.103:0/2427802866 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f104c004db0 0x7f104c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:24.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.096+0000 7f1068d24700 1 -- 172.21.15.103:0/2427802866 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1064143840 con 0x7f104c003720 2020-04-22T14:12:24.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.096+0000 7f1068d24700 1 -- 172.21.15.103:0/2427802866 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104c0041c0 con 0x7f104c0044d0 2020-04-22T14:12:24.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.096+0000 7f1068d24700 1 -- 172.21.15.103:0/2427802866 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f104c00dd90 con 0x7f104c004db0 2020-04-22T14:12:24.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.096+0000 7f1069525700 1 --2- 172.21.15.103:0/2427802866 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f104c0044d0 0x7f104c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:24.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.096+0000 7f1069d26700 1 --2- 172.21.15.103:0/2427802866 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f104c003720 0x7f104c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:24.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.096+0000 7f106a527700 1 --2- 172.21.15.103:0/2427802866 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f104c004db0 0x7f104c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:24.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.096+0000 7f1069525700 1 -- 172.21.15.103:0/2427802866 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f104c004db0 msgr2=0x7f104c00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:24.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.096+0000 7f1069525700 1 --2- 172.21.15.103:0/2427802866 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f104c004db0 0x7f104c00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:24.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.096+0000 7f1069525700 1 -- 172.21.15.103:0/2427802866 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f104c003720 msgr2=0x7f104c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:24.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.096+0000 7f1069525700 1 --2- 172.21.15.103:0/2427802866 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f104c003720 0x7f104c003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:24.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.096+0000 7f1069525700 1 -- 172.21.15.103:0/2427802866 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f104c003230 con 0x7f104c0044d0 2020-04-22T14:12:24.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.096+0000 7f106a527700 1 -- 172.21.15.103:0/2427802866 reap_dead start 2020-04-22T14:12:24.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.096+0000 7f1069525700 1 --2- 172.21.15.103:0/2427802866 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f104c0044d0 0x7f104c004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f104c0054a0 tx=0x7f1060010100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.096+0000 7f1069525700 1 --2- 172.21.15.103:0/2427802866 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f104c0044d0 0x7f104c004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f104c0054a0 tx=0x7f1060010100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.096+0000 7f1069525700 1 --2- 172.21.15.103:0/2427802866 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f104c0044d0 0x7f104c004950 secure :-1 s=READY pgs=1098 cs=0 l=1 rx=0x7f104c0054a0 tx=0x7f1060010100).ready entity=mon.1 client_cookie=308c07b2b06b4631 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:24.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.097+0000 7f1069525700 1 --2- 172.21.15.103:0/2427802866 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f104c0044d0 0x7f104c004950 secure :-1 s=THROTTLE_DONE pgs=1098 cs=0 l=1 rx=0x7f104c0054a0 tx=0x7f1060010100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.097+0000 7f1069525700 1 --2- 172.21.15.103:0/2427802866 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f104c0044d0 0x7f104c004950 secure :-1 s=THROTTLE_DONE pgs=1098 cs=0 l=1 rx=0x7f104c0054a0 tx=0x7f1060010100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.097+0000 7f1069525700 1 --2- 172.21.15.103:0/2427802866 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f104c0044d0 0x7f104c004950 secure :-1 s=THROTTLE_DONE pgs=1098 cs=0 l=1 rx=0x7f104c0054a0 tx=0x7f1060010100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.097+0000 7f1068d24700 1 -- 172.21.15.103:0/2427802866 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1060010dd0 con 0x7f104c0044d0 2020-04-22T14:12:24.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.097+0000 7f1068d24700 1 -- 172.21.15.103:0/2427802866 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1060008950 con 0x7f104c0044d0 2020-04-22T14:12:24.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.097+0000 7f1068d24700 1 -- 172.21.15.103:0/2427802866 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1060008cf0 con 0x7f104c0044d0 2020-04-22T14:12:24.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.097+0000 7f106bf8a700 1 -- 172.21.15.103:0/2427802866 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f104c0044d0 msgr2=0x7f104c004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:24.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.097+0000 7f106bf8a700 1 --2- 172.21.15.103:0/2427802866 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f104c0044d0 0x7f104c004950 secure :-1 s=READY pgs=1098 cs=0 l=1 rx=0x7f104c0054a0 tx=0x7f1060010100).stop 2020-04-22T14:12:24.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.097+0000 7f106bf8a700 1 -- 172.21.15.103:0/2427802866 shutdown_connections 2020-04-22T14:12:24.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.097+0000 7f106bf8a700 1 --2- 172.21.15.103:0/2427802866 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f104c0044d0 0x7f104c004950 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:24.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.097+0000 7f106bf8a700 1 -- 172.21.15.103:0/2427802866 >> 172.21.15.103:0/2427802866 conn(0x7f10640b9160 msgr2=0x7f106405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:24.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.097+0000 7f106bf8a700 1 -- 172.21.15.103:0/2427802866 shutdown_connections 2020-04-22T14:12:24.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.097+0000 7f106bf8a700 1 -- 172.21.15.103:0/2427802866 wait complete. 2020-04-22T14:12:24.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.098+0000 7f106bf8a700 1 Processor -- start 2020-04-22T14:12:24.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.098+0000 7f106bf8a700 1 -- start start 2020-04-22T14:12:24.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.099+0000 7f106bf8a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10640b5aa0 0x7f10641279c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:24.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.099+0000 7f106bf8a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f106412aa90 con 0x7f106412a630 2020-04-22T14:12:24.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.099+0000 7f106bf8a700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10640b1c40 con 0x7f104c0044d0 2020-04-22T14:12:24.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.099+0000 7f106bf8a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10640b1ee0 con 0x7f10640b5aa0 2020-04-22T14:12:24.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.099+0000 7f1069d26700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f104c0044d0 0x7f10641272b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45068/0 (socket says 172.21.15.103:45068) 2020-04-22T14:12:24.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.099+0000 7f1069d26700 1 -- 172.21.15.103:0/947954116 learned_addr learned my addr 172.21.15.103:0/947954116 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:24.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.099+0000 7f1069525700 1 --2- 172.21.15.103:0/947954116 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10640b5aa0 0x7f10641279c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:24.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.099+0000 7f1052ffd700 1 -- 172.21.15.103:0/947954116 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 18389687 0 0) 0x7f10640b1c40 con 0x7f104c0044d0 2020-04-22T14:12:24.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.099+0000 7f1052ffd700 1 -- 172.21.15.103:0/947954116 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1044002fe0 con 0x7f104c0044d0 2020-04-22T14:12:24.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.099+0000 7f1052ffd700 1 -- 172.21.15.103:0/947954116 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1216524446 0 0) 0x7f106405bb50 con 0x7f106412a630 2020-04-22T14:12:24.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.099+0000 7f1052ffd700 1 -- 172.21.15.103:0/947954116 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10640b1c40 con 0x7f106412a630 2020-04-22T14:12:24.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.099+0000 7f1069525700 1 -- 172.21.15.103:0/947954116 >> v1:172.21.15.103:6789/0 conn(0x7f104c0044d0 legacy=0x7f10641272b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:24.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.099+0000 7f1052ffd700 1 -- 172.21.15.103:0/947954116 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1686603497 0 0) 0x7f1044002fe0 con 0x7f104c0044d0 2020-04-22T14:12:24.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.099+0000 7f1069525700 1 -- 172.21.15.103:0/947954116 >> v1:172.21.15.86:6789/0 conn(0x7f106412a630 legacy=0x7f10640ac820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:24.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.099+0000 7f1069525700 1 -- 172.21.15.103:0/947954116 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10640b1970 con 0x7f10640b5aa0 2020-04-22T14:12:24.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.099+0000 7f1069525700 1 --2- 172.21.15.103:0/947954116 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10640b5aa0 0x7f10641279c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f10540012e0 tx=0x7f1060010100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.099+0000 7f1069525700 1 --2- 172.21.15.103:0/947954116 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10640b5aa0 0x7f10641279c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f10540012e0 tx=0x7f1060010100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.099+0000 7f1069525700 1 --2- 172.21.15.103:0/947954116 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10640b5aa0 0x7f10641279c0 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7f10540012e0 tx=0x7f1060010100).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:24.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.100+0000 7f1069525700 1 --2- 172.21.15.103:0/947954116 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10640b5aa0 0x7f10641279c0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f10540012e0 tx=0x7f1060010100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.100+0000 7f1052ffd700 1 -- 172.21.15.103:0/947954116 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1054001c40 con 0x7f10640b5aa0 2020-04-22T14:12:24.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.100+0000 7f1069525700 1 --2- 172.21.15.103:0/947954116 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10640b5aa0 0x7f10641279c0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f10540012e0 tx=0x7f1060010100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.100+0000 7f106bf8a700 1 -- 172.21.15.103:0/947954116 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10640b5760 con 0x7f10640b5aa0 2020-04-22T14:12:24.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.100+0000 7f1052ffd700 1 -- 172.21.15.103:0/947954116 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106000f760 con 0x7f10640b5aa0 2020-04-22T14:12:24.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.100+0000 7f1069525700 1 --2- 172.21.15.103:0/947954116 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10640b5aa0 0x7f10641279c0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f10540012e0 tx=0x7f1060010100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.100+0000 7f1052ffd700 1 -- 172.21.15.103:0/947954116 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10600058b0 con 0x7f10640b5aa0 2020-04-22T14:12:24.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.100+0000 7f106bf8a700 1 -- 172.21.15.103:0/947954116 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10640afae0 con 0x7f10640b5aa0 2020-04-22T14:12:24.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.100+0000 7f1069525700 1 --2- 172.21.15.103:0/947954116 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10640b5aa0 0x7f10641279c0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f10540012e0 tx=0x7f1060010100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.101+0000 7f106bf8a700 1 -- 172.21.15.103:0/947954116 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1064056c90 con 0x7f10640b5aa0 2020-04-22T14:12:24.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.101+0000 7f1052ffd700 1 -- 172.21.15.103:0/947954116 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f1060005a10 con 0x7f10640b5aa0 2020-04-22T14:12:24.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.101+0000 7f1069525700 1 --2- 172.21.15.103:0/947954116 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10640b5aa0 0x7f10641279c0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f10540012e0 tx=0x7f1060010100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.101+0000 7f1052ffd700 1 --2- 172.21.15.103:0/947954116 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f104404de10 0x7f10440502d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:24.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.101+0000 7f1052ffd700 1 -- 172.21.15.103:0/947954116 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f10600610c0 con 0x7f10640b5aa0 2020-04-22T14:12:24.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.101+0000 7f1069d26700 1 --2- 172.21.15.103:0/947954116 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f104404de10 0x7f10440502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:24.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.102+0000 7f1069d26700 1 --2- 172.21.15.103:0/947954116 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f104404de10 0x7f10440502d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1054001460 tx=0x7f10540095f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.117 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.102+0000 7f1069d26700 1 --2- 172.21.15.103:0/947954116 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f104404de10 0x7f10440502d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1054001460 tx=0x7f10540095f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.117 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.102+0000 7f1069d26700 1 --2- 172.21.15.103:0/947954116 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f104404de10 0x7f10440502d0 secure :-1 s=READY pgs=407 cs=0 l=1 rx=0x7f1054001460 tx=0x7f10540095f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:24.117 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.105+0000 7f1069525700 1 --2- 172.21.15.103:0/947954116 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10640b5aa0 0x7f10641279c0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f10540012e0 tx=0x7f1060010100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.117 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.105+0000 7f1052ffd700 1 -- 172.21.15.103:0/947954116 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f106003c5c0 con 0x7f10640b5aa0 2020-04-22T14:12:24.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.248+0000 7f106bf8a700 1 -- 172.21.15.103:0/947954116 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1064147360 con 0x7f10640b5aa0 2020-04-22T14:12:24.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.250+0000 7f1069525700 1 --2- 172.21.15.103:0/947954116 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10640b5aa0 0x7f10641279c0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f10540012e0 tx=0x7f1060010100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.250+0000 7f1052ffd700 1 -- 172.21.15.103:0/947954116 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16092 (secure 0 0 0) 0x7f106003fbe0 con 0x7f10640b5aa0 2020-04-22T14:12:24.253 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:12:24.253 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":77,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:12:19.875997+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:12:16.799055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2020-04-22T14:12:17.819603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:12:24.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.251+0000 7f106bf8a700 1 -- 172.21.15.103:0/947954116 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f104404de10 msgr2=0x7f10440502d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:24.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.251+0000 7f106bf8a700 1 --2- 172.21.15.103:0/947954116 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f104404de10 0x7f10440502d0 secure :-1 s=READY pgs=407 cs=0 l=1 rx=0x7f1054001460 tx=0x7f10540095f0).stop 2020-04-22T14:12:24.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.251+0000 7f106bf8a700 1 -- 172.21.15.103:0/947954116 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10640b5aa0 msgr2=0x7f10641279c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:24.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.251+0000 7f106bf8a700 1 --2- 172.21.15.103:0/947954116 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10640b5aa0 0x7f10641279c0 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7f10540012e0 tx=0x7f1060010100).stop 2020-04-22T14:12:24.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.251+0000 7f106bf8a700 1 -- 172.21.15.103:0/947954116 shutdown_connections 2020-04-22T14:12:24.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.251+0000 7f106bf8a700 1 --2- 172.21.15.103:0/947954116 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f104404de10 0x7f10440502d0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:24.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.251+0000 7f106bf8a700 1 --2- 172.21.15.103:0/947954116 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10640b5aa0 0x7f10641279c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:24.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.251+0000 7f106bf8a700 1 -- 172.21.15.103:0/947954116 >> 172.21.15.103:0/947954116 conn(0x7f10640b9160 msgr2=0x7f1064062040 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:24.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.251+0000 7f106bf8a700 1 -- 172.21.15.103:0/947954116 shutdown_connections 2020-04-22T14:12:24.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.251+0000 7f106bf8a700 1 -- 172.21.15.103:0/947954116 wait complete. 2020-04-22T14:12:24.265 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:12:16.799055+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 13, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'76', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:12:17.819603+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 14, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'77', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:12:24.267 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:24.281 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:12:24.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.426+0000 7f3620262700 1 Processor -- start 2020-04-22T14:12:24.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.427+0000 7f3620262700 1 -- start start 2020-04-22T14:12:24.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.427+0000 7f3620262700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f36180b4820 0x7f36180acb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:24.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.427+0000 7f3620262700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36180af030 con 0x7f3618061a30 2020-04-22T14:12:24.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.427+0000 7f3620262700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3618060250 con 0x7f3618141f20 2020-04-22T14:12:24.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.427+0000 7f3620262700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36180623c0 con 0x7f36180b4820 2020-04-22T14:12:24.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.428+0000 7f361e7ff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f3618141f20 0x7f3618142380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45078/0 (socket says 172.21.15.103:45078) 2020-04-22T14:12:24.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.428+0000 7f361e7ff700 1 -- 172.21.15.103:0/523193507 learned_addr learned my addr 172.21.15.103:0/523193507 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:24.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.428+0000 7f361cffc700 1 -- 172.21.15.103:0/523193507 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 370583052 0 0) 0x7f3618060250 con 0x7f3618141f20 2020-04-22T14:12:24.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.428+0000 7f361d7fd700 1 --2- 172.21.15.103:0/523193507 >> v2:172.21.15.86:3300/0 conn(0x7f36180b4820 0x7f36180acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:24.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.428+0000 7f361cffc700 1 -- 172.21.15.103:0/523193507 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3600003230 con 0x7f3618141f20 2020-04-22T14:12:24.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.428+0000 7f361cffc700 1 -- 172.21.15.103:0/523193507 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1721656998 0 0) 0x7f3600003230 con 0x7f3618141f20 2020-04-22T14:12:24.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.428+0000 7f361cffc700 1 -- 172.21.15.103:0/523193507 >> v2:172.21.15.86:3300/0 conn(0x7f36180b4820 msgr2=0x7f36180acb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:24.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.428+0000 7f361cffc700 1 --2- 172.21.15.103:0/523193507 >> v2:172.21.15.86:3300/0 conn(0x7f36180b4820 0x7f36180acb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:24.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.428+0000 7f361cffc700 1 -- 172.21.15.103:0/523193507 >> v1:172.21.15.86:6789/0 conn(0x7f3618061a30 legacy=0x7f36180ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:24.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.428+0000 7f361cffc700 1 -- 172.21.15.103:0/523193507 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3618062660 con 0x7f3618141f20 2020-04-22T14:12:24.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.428+0000 7f361cffc700 1 -- 172.21.15.103:0/523193507 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f3610001a50 con 0x7f3618141f20 2020-04-22T14:12:24.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.428+0000 7f361cffc700 1 -- 172.21.15.103:0/523193507 >> v1:172.21.15.103:6789/0 conn(0x7f3618141f20 legacy=0x7f3618142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:24.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.428+0000 7f361cffc700 1 --2- 172.21.15.103:0/523193507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3600003720 0x7f3600003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:24.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.428+0000 7f361cffc700 1 --2- 172.21.15.103:0/523193507 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36000044d0 0x7f3600004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:24.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.428+0000 7f361cffc700 1 --2- 172.21.15.103:0/523193507 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3600004db0 0x7f360000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:24.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.428+0000 7f361cffc700 1 -- 172.21.15.103:0/523193507 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36180623c0 con 0x7f36000044d0 2020-04-22T14:12:24.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.428+0000 7f361cffc700 1 -- 172.21.15.103:0/523193507 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36000041c0 con 0x7f3600003720 2020-04-22T14:12:24.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.428+0000 7f361cffc700 1 -- 172.21.15.103:0/523193507 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f360000bb80 con 0x7f3600004db0 2020-04-22T14:12:24.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.428+0000 7f361dffe700 1 --2- 172.21.15.103:0/523193507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3600003720 0x7f3600003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:24.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.428+0000 7f361d7fd700 1 --2- 172.21.15.103:0/523193507 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36000044d0 0x7f3600004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:24.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.428+0000 7f361e7ff700 1 --2- 172.21.15.103:0/523193507 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3600004db0 0x7f360000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:24.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.429+0000 7f361dffe700 1 -- 172.21.15.103:0/523193507 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3600004db0 msgr2=0x7f360000b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:24.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.429+0000 7f361dffe700 1 --2- 172.21.15.103:0/523193507 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3600004db0 0x7f360000b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:24.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.429+0000 7f361dffe700 1 -- 172.21.15.103:0/523193507 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36000044d0 msgr2=0x7f3600004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:24.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.429+0000 7f361dffe700 1 --2- 172.21.15.103:0/523193507 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36000044d0 0x7f3600004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:24.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.429+0000 7f361dffe700 1 -- 172.21.15.103:0/523193507 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3600003230 con 0x7f3600003720 2020-04-22T14:12:24.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.429+0000 7f361e7ff700 1 --2- 172.21.15.103:0/523193507 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3600004db0 0x7f360000b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:12:24.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.429+0000 7f361e7ff700 1 -- 172.21.15.103:0/523193507 reap_dead start 2020-04-22T14:12:24.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.429+0000 7f361dffe700 1 --2- 172.21.15.103:0/523193507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3600003720 0x7f3600003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f36000054a0 tx=0x7f361400fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.429+0000 7f361dffe700 1 --2- 172.21.15.103:0/523193507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3600003720 0x7f3600003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f36000054a0 tx=0x7f361400fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.429+0000 7f361dffe700 1 --2- 172.21.15.103:0/523193507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3600003720 0x7f3600003b40 secure :-1 s=READY pgs=1101 cs=0 l=1 rx=0x7f36000054a0 tx=0x7f361400fd20).ready entity=mon.1 client_cookie=8151a9d22b99aa server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:24.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.429+0000 7f361dffe700 1 --2- 172.21.15.103:0/523193507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3600003720 0x7f3600003b40 secure :-1 s=THROTTLE_DONE pgs=1101 cs=0 l=1 rx=0x7f36000054a0 tx=0x7f361400fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.429+0000 7f361dffe700 1 --2- 172.21.15.103:0/523193507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3600003720 0x7f3600003b40 secure :-1 s=THROTTLE_DONE pgs=1101 cs=0 l=1 rx=0x7f36000054a0 tx=0x7f361400fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.429+0000 7f361cffc700 1 -- 172.21.15.103:0/523193507 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3614003560 con 0x7f3600003720 2020-04-22T14:12:24.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.429+0000 7f361dffe700 1 --2- 172.21.15.103:0/523193507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3600003720 0x7f3600003b40 secure :-1 s=THROTTLE_DONE pgs=1101 cs=0 l=1 rx=0x7f36000054a0 tx=0x7f361400fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.429+0000 7f361cffc700 1 -- 172.21.15.103:0/523193507 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36140036c0 con 0x7f3600003720 2020-04-22T14:12:24.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.429+0000 7f361cffc700 1 -- 172.21.15.103:0/523193507 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3614003aa0 con 0x7f3600003720 2020-04-22T14:12:24.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.429+0000 7f3620262700 1 -- 172.21.15.103:0/523193507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3600003720 msgr2=0x7f3600003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:24.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.429+0000 7f3620262700 1 --2- 172.21.15.103:0/523193507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3600003720 0x7f3600003b40 secure :-1 s=READY pgs=1101 cs=0 l=1 rx=0x7f36000054a0 tx=0x7f361400fd20).stop 2020-04-22T14:12:24.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.429+0000 7f3620262700 1 -- 172.21.15.103:0/523193507 shutdown_connections 2020-04-22T14:12:24.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.429+0000 7f3620262700 1 --2- 172.21.15.103:0/523193507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3600003720 0x7f3600003b40 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:24.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.429+0000 7f3620262700 1 -- 172.21.15.103:0/523193507 >> 172.21.15.103:0/523193507 conn(0x7f361805b7b0 msgr2=0x7f36180b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:24.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.430+0000 7f3620262700 1 -- 172.21.15.103:0/523193507 shutdown_connections 2020-04-22T14:12:24.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.430+0000 7f3620262700 1 -- 172.21.15.103:0/523193507 wait complete. 2020-04-22T14:12:24.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.430+0000 7f3620262700 1 Processor -- start 2020-04-22T14:12:24.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.431+0000 7f3620262700 1 -- start start 2020-04-22T14:12:24.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.431+0000 7f3620262700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3600003720 0x7f3618132cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:24.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.431+0000 7f3620262700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3618142420 con 0x7f36181451f0 2020-04-22T14:12:24.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.431+0000 7f3620262700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36180b21d0 con 0x7f36180b1d80 2020-04-22T14:12:24.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.431+0000 7f3620262700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3618143840 con 0x7f3600003720 2020-04-22T14:12:24.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.431+0000 7f361dffe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3600003720 0x7f3618132cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:24.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.431+0000 7f361dffe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3600003720 0x7f3618132cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52898/0 (socket says 172.21.15.103:52898) 2020-04-22T14:12:24.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.431+0000 7f361dffe700 1 -- 172.21.15.103:0/1441990284 learned_addr learned my addr 172.21.15.103:0/1441990284 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:24.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.432+0000 7f361dffe700 1 -- 172.21.15.103:0/1441990284 >> v1:172.21.15.103:6789/0 conn(0x7f36180b1d80 legacy=0x7f3618063130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:24.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.432+0000 7f361dffe700 1 -- 172.21.15.103:0/1441990284 >> v1:172.21.15.86:6789/0 conn(0x7f36181451f0 legacy=0x7f3618062a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:24.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.432+0000 7f361dffe700 1 -- 172.21.15.103:0/1441990284 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3618142650 con 0x7f3600003720 2020-04-22T14:12:24.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.432+0000 7f3606ffd700 1 -- 172.21.15.103:0/1441990284 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4052803394 0 0) 0x7f36180b21d0 con 0x7f36180b1d80 2020-04-22T14:12:24.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.432+0000 7f361dffe700 1 --2- 172.21.15.103:0/1441990284 >> v2:172.21.15.103:3300/0 conn(0x7f3600003720 0x7f3618132cb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f36181429d0 tx=0x7f361400fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.432+0000 7f361dffe700 1 --2- 172.21.15.103:0/1441990284 >> v2:172.21.15.103:3300/0 conn(0x7f3600003720 0x7f3618132cb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f36181429d0 tx=0x7f361400fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.432+0000 7f361dffe700 1 --2- 172.21.15.103:0/1441990284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3600003720 0x7f3618132cb0 secure :-1 s=READY pgs=1103 cs=0 l=1 rx=0x7f36181429d0 tx=0x7f361400fd20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:24.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.432+0000 7f361dffe700 1 --2- 172.21.15.103:0/1441990284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3600003720 0x7f3618132cb0 secure :-1 s=THROTTLE_DONE pgs=1103 cs=0 l=1 rx=0x7f36181429d0 tx=0x7f361400fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.432+0000 7f3606ffd700 1 -- 172.21.15.103:0/1441990284 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3614010110 con 0x7f3600003720 2020-04-22T14:12:24.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.432+0000 7f361dffe700 1 --2- 172.21.15.103:0/1441990284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3600003720 0x7f3618132cb0 secure :-1 s=THROTTLE_DONE pgs=1103 cs=0 l=1 rx=0x7f36181429d0 tx=0x7f361400fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.432+0000 7f361dffe700 1 --2- 172.21.15.103:0/1441990284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3600003720 0x7f3618132cb0 secure :-1 s=THROTTLE_DONE pgs=1103 cs=0 l=1 rx=0x7f36181429d0 tx=0x7f361400fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.432+0000 7f3606ffd700 1 -- 172.21.15.103:0/1441990284 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3614008370 con 0x7f3600003720 2020-04-22T14:12:24.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.432+0000 7f3620262700 1 -- 172.21.15.103:0/1441990284 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3618143ae0 con 0x7f3600003720 2020-04-22T14:12:24.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.432+0000 7f3606ffd700 1 -- 172.21.15.103:0/1441990284 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3614008bb0 con 0x7f3600003720 2020-04-22T14:12:24.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.432+0000 7f3620262700 1 -- 172.21.15.103:0/1441990284 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3618142d30 con 0x7f3600003720 2020-04-22T14:12:24.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.432+0000 7f361dffe700 1 --2- 172.21.15.103:0/1441990284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3600003720 0x7f3618132cb0 secure :-1 s=THROTTLE_DONE pgs=1103 cs=0 l=1 rx=0x7f36181429d0 tx=0x7f361400fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.433+0000 7f3606ffd700 1 -- 172.21.15.103:0/1441990284 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f36140064e0 con 0x7f3600003720 2020-04-22T14:12:24.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.433+0000 7f361dffe700 1 --2- 172.21.15.103:0/1441990284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3600003720 0x7f3618132cb0 secure :-1 s=THROTTLE_DONE pgs=1103 cs=0 l=1 rx=0x7f36181429d0 tx=0x7f361400fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.433+0000 7f3620262700 1 -- 172.21.15.103:0/1441990284 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3618056c90 con 0x7f3600003720 2020-04-22T14:12:24.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.433+0000 7f3606ffd700 1 --2- 172.21.15.103:0/1441990284 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f35f804d820 0x7f35f804fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:24.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.433+0000 7f3606ffd700 1 -- 172.21.15.103:0/1441990284 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3614061e00 con 0x7f3600003720 2020-04-22T14:12:24.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.433+0000 7f361d7fd700 1 --2- 172.21.15.103:0/1441990284 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f35f804d820 0x7f35f804fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:24.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.434+0000 7f361d7fd700 1 --2- 172.21.15.103:0/1441990284 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f35f804d820 0x7f35f804fce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3618136af0 tx=0x7f3608008080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.451 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.434+0000 7f361d7fd700 1 --2- 172.21.15.103:0/1441990284 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f35f804d820 0x7f35f804fce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3618136af0 tx=0x7f3608008080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.451 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.434+0000 7f361d7fd700 1 --2- 172.21.15.103:0/1441990284 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f35f804d820 0x7f35f804fce0 secure :-1 s=READY pgs=408 cs=0 l=1 rx=0x7f3618136af0 tx=0x7f3608008080).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:24.451 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.437+0000 7f361dffe700 1 --2- 172.21.15.103:0/1441990284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3600003720 0x7f3618132cb0 secure :-1 s=THROTTLE_DONE pgs=1103 cs=0 l=1 rx=0x7f36181429d0 tx=0x7f361400fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.451 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.437+0000 7f3606ffd700 1 -- 172.21.15.103:0/1441990284 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f361403d240 con 0x7f3600003720 2020-04-22T14:12:24.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.581+0000 7f3620262700 1 -- 172.21.15.103:0/1441990284 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f361806a960 con 0x7f3600003720 2020-04-22T14:12:24.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.582+0000 7f361dffe700 1 --2- 172.21.15.103:0/1441990284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3600003720 0x7f3618132cb0 secure :-1 s=THROTTLE_DONE pgs=1103 cs=0 l=1 rx=0x7f36181429d0 tx=0x7f361400fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.582+0000 7f3606ffd700 1 -- 172.21.15.103:0/1441990284 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v77) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3614040860 con 0x7f3600003720 2020-04-22T14:12:24.585 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:12:24.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.583+0000 7f3620262700 1 -- 172.21.15.103:0/1441990284 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f35f804d820 msgr2=0x7f35f804fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:24.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.583+0000 7f3620262700 1 --2- 172.21.15.103:0/1441990284 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f35f804d820 0x7f35f804fce0 secure :-1 s=READY pgs=408 cs=0 l=1 rx=0x7f3618136af0 tx=0x7f3608008080).stop 2020-04-22T14:12:24.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.583+0000 7f3620262700 1 -- 172.21.15.103:0/1441990284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3600003720 msgr2=0x7f3618132cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:24.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.583+0000 7f3620262700 1 --2- 172.21.15.103:0/1441990284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3600003720 0x7f3618132cb0 secure :-1 s=READY pgs=1103 cs=0 l=1 rx=0x7f36181429d0 tx=0x7f361400fd20).stop 2020-04-22T14:12:24.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.583+0000 7f3620262700 1 -- 172.21.15.103:0/1441990284 shutdown_connections 2020-04-22T14:12:24.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.583+0000 7f3620262700 1 --2- 172.21.15.103:0/1441990284 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f35f804d820 0x7f35f804fce0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:24.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.583+0000 7f3620262700 1 --2- 172.21.15.103:0/1441990284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3600003720 0x7f3618132cb0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:24.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.583+0000 7f3620262700 1 -- 172.21.15.103:0/1441990284 >> 172.21.15.103:0/1441990284 conn(0x7f361805b7b0 msgr2=0x7f36180ade70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:24.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.583+0000 7f3620262700 1 -- 172.21.15.103:0/1441990284 shutdown_connections 2020-04-22T14:12:24.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.583+0000 7f3620262700 1 -- 172.21.15.103:0/1441990284 wait complete. 2020-04-22T14:12:24.598 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:24.612 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:12:24.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.758+0000 7f5e89104700 1 Processor -- start 2020-04-22T14:12:24.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.758+0000 7f5e89104700 1 -- start start 2020-04-22T14:12:24.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.759+0000 7f5e89104700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e840b8fc0 0x7f5e840ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:24.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.759+0000 7f5e89104700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5e84066be0 0x7f5e8414b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:24.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.759+0000 7f5e89104700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5e84147750 0x7f5e84147b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:24.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.759+0000 7f5e89104700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e840676a0 con 0x7f5e84147750 2020-04-22T14:12:24.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.759+0000 7f5e89104700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e84067160 con 0x7f5e84066be0 2020-04-22T14:12:24.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.759+0000 7f5e89104700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e84067400 con 0x7f5e840b8fc0 2020-04-22T14:12:24.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.759+0000 7f5e837fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5e84066be0 0x7f5e8414b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:24.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.759+0000 7f5e837fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5e84066be0 0x7f5e8414b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52908/0 (socket says 172.21.15.103:52908) 2020-04-22T14:12:24.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.759+0000 7f5e837fe700 1 -- 172.21.15.103:0/18492079 learned_addr learned my addr 172.21.15.103:0/18492079 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:24.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.759+0000 7f5e88903700 1 --2- 172.21.15.103:0/18492079 >> v2:172.21.15.86:3300/0 conn(0x7f5e84147750 0x7f5e84147b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:24.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.759+0000 7f5e83fff700 1 --2- 172.21.15.103:0/18492079 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e840b8fc0 0x7f5e840ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:24.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.759+0000 7f5e837fe700 1 -- 172.21.15.103:0/18492079 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e840b8fc0 msgr2=0x7f5e840ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:24.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.759+0000 7f5e837fe700 1 --2- 172.21.15.103:0/18492079 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e840b8fc0 0x7f5e840ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:24.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.759+0000 7f5e837fe700 1 -- 172.21.15.103:0/18492079 >> v2:172.21.15.86:3300/0 conn(0x7f5e84147750 msgr2=0x7f5e84147b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:24.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.759+0000 7f5e837fe700 1 --2- 172.21.15.103:0/18492079 >> v2:172.21.15.86:3300/0 conn(0x7f5e84147750 0x7f5e84147b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:24.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.759+0000 7f5e837fe700 1 -- 172.21.15.103:0/18492079 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e8414b540 con 0x7f5e84066be0 2020-04-22T14:12:24.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.759+0000 7f5e83fff700 1 --2- 172.21.15.103:0/18492079 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e840b8fc0 0x7f5e840ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:12:24.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.760+0000 7f5e837fe700 1 --2- 172.21.15.103:0/18492079 >> v2:172.21.15.103:3300/0 conn(0x7f5e84066be0 0x7f5e8414b0e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5e78002f30 tx=0x7f5e78007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.760+0000 7f5e837fe700 1 --2- 172.21.15.103:0/18492079 >> v2:172.21.15.103:3300/0 conn(0x7f5e84066be0 0x7f5e8414b0e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5e78002f30 tx=0x7f5e78007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.760+0000 7f5e837fe700 1 --2- 172.21.15.103:0/18492079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e84066be0 0x7f5e8414b0e0 secure :-1 s=READY pgs=1104 cs=0 l=1 rx=0x7f5e78002f30 tx=0x7f5e78007a40).ready entity=mon.1 client_cookie=979a95b76d4e9498 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:24.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.760+0000 7f5e837fe700 1 --2- 172.21.15.103:0/18492079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e84066be0 0x7f5e8414b0e0 secure :-1 s=THROTTLE_DONE pgs=1104 cs=0 l=1 rx=0x7f5e78002f30 tx=0x7f5e78007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.760+0000 7f5e82ffd700 1 -- 172.21.15.103:0/18492079 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e78011720 con 0x7f5e84066be0 2020-04-22T14:12:24.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.760+0000 7f5e837fe700 1 --2- 172.21.15.103:0/18492079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e84066be0 0x7f5e8414b0e0 secure :-1 s=THROTTLE_DONE pgs=1104 cs=0 l=1 rx=0x7f5e78002f30 tx=0x7f5e78007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.760+0000 7f5e82ffd700 1 -- 172.21.15.103:0/18492079 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e78011880 con 0x7f5e84066be0 2020-04-22T14:12:24.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.760+0000 7f5e837fe700 1 --2- 172.21.15.103:0/18492079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e84066be0 0x7f5e8414b0e0 secure :-1 s=THROTTLE_DONE pgs=1104 cs=0 l=1 rx=0x7f5e78002f30 tx=0x7f5e78007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.760+0000 7f5e89104700 1 -- 172.21.15.103:0/18492079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e84066be0 msgr2=0x7f5e8414b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:24.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.760+0000 7f5e82ffd700 1 -- 172.21.15.103:0/18492079 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e78011ca0 con 0x7f5e84066be0 2020-04-22T14:12:24.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.760+0000 7f5e89104700 1 --2- 172.21.15.103:0/18492079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e84066be0 0x7f5e8414b0e0 secure :-1 s=READY pgs=1104 cs=0 l=1 rx=0x7f5e78002f30 tx=0x7f5e78007a40).stop 2020-04-22T14:12:24.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.760+0000 7f5e89104700 1 -- 172.21.15.103:0/18492079 shutdown_connections 2020-04-22T14:12:24.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.760+0000 7f5e89104700 1 --2- 172.21.15.103:0/18492079 >> v2:172.21.15.86:3300/0 conn(0x7f5e84147750 0x7f5e84147b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:24.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.760+0000 7f5e89104700 1 --2- 172.21.15.103:0/18492079 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e840b8fc0 0x7f5e840ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:24.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.760+0000 7f5e89104700 1 --2- 172.21.15.103:0/18492079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e84066be0 0x7f5e8414b0e0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:24.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.760+0000 7f5e89104700 1 -- 172.21.15.103:0/18492079 >> 172.21.15.103:0/18492079 conn(0x7f5e8405b780 msgr2=0x7f5e840b8530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:24.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.760+0000 7f5e89104700 1 -- 172.21.15.103:0/18492079 shutdown_connections 2020-04-22T14:12:24.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.760+0000 7f5e89104700 1 -- 172.21.15.103:0/18492079 wait complete. 2020-04-22T14:12:24.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.761+0000 7f5e89104700 1 Processor -- start 2020-04-22T14:12:24.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.761+0000 7f5e89104700 1 -- start start 2020-04-22T14:12:24.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.762+0000 7f5e89104700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5e84066be0 0x7f5e84149e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:24.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.762+0000 7f5e89104700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e840b8fc0 0x7f5e84145100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:24.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.762+0000 7f5e89104700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e84145560 con 0x7f5e84147750 2020-04-22T14:12:24.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.762+0000 7f5e89104700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e8414ca50 con 0x7f5e84066be0 2020-04-22T14:12:24.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.762+0000 7f5e89104700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8414d200 con 0x7f5e840b8fc0 2020-04-22T14:12:24.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.762+0000 7f5e88903700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f5e84147750 0x7f5e84141ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45106/0 (socket says 172.21.15.103:45106) 2020-04-22T14:12:24.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.762+0000 7f5e88903700 1 -- 172.21.15.103:0/3768399563 learned_addr learned my addr 172.21.15.103:0/3768399563 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:24.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.762+0000 7f5e83fff700 1 --2- 172.21.15.103:0/3768399563 >> v2:172.21.15.86:3300/0 conn(0x7f5e84066be0 0x7f5e84149e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:24.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.762+0000 7f5e837fe700 1 --2- 172.21.15.103:0/3768399563 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e840b8fc0 0x7f5e84145100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:24.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.762+0000 7f5e817fa700 1 -- 172.21.15.103:0/3768399563 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 715488554 0 0) 0x7f5e7c001210 con 0x7f5e84147750 2020-04-22T14:12:24.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.762+0000 7f5e817fa700 1 -- 172.21.15.103:0/3768399563 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e64002fe0 con 0x7f5e84147750 2020-04-22T14:12:24.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.763+0000 7f5e817fa700 1 -- 172.21.15.103:0/3768399563 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3682402472 0 0) 0x7f5e64002fe0 con 0x7f5e84147750 2020-04-22T14:12:24.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.763+0000 7f5e817fa700 1 -- 172.21.15.103:0/3768399563 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5e7c001210 con 0x7f5e84147750 2020-04-22T14:12:24.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.763+0000 7f5e817fa700 1 -- 172.21.15.103:0/3768399563 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f5e7c001a60 con 0x7f5e84147750 2020-04-22T14:12:24.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.763+0000 7f5e817fa700 1 -- 172.21.15.103:0/3768399563 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e840b8fc0 msgr2=0x7f5e84145100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:24.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.763+0000 7f5e817fa700 1 --2- 172.21.15.103:0/3768399563 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e840b8fc0 0x7f5e84145100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:24.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.763+0000 7f5e817fa700 1 -- 172.21.15.103:0/3768399563 >> v2:172.21.15.86:3300/0 conn(0x7f5e84066be0 msgr2=0x7f5e84149e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:24.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.763+0000 7f5e817fa700 1 --2- 172.21.15.103:0/3768399563 >> v2:172.21.15.86:3300/0 conn(0x7f5e84066be0 0x7f5e84149e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:24.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.763+0000 7f5e817fa700 1 -- 172.21.15.103:0/3768399563 >> v1:172.21.15.103:6789/0 conn(0x7f5e84147750 legacy=0x7f5e84141ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:24.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.763+0000 7f5e817fa700 1 --2- 172.21.15.103:0/3768399563 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e640049b0 0x7f5e64004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:24.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.763+0000 7f5e817fa700 1 --2- 172.21.15.103:0/3768399563 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e840b8fc0 0x7f5e64003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:24.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.763+0000 7f5e817fa700 1 --2- 172.21.15.103:0/3768399563 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e64003d80 0x7f5e640041e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:24.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.763+0000 7f5e817fa700 1 -- 172.21.15.103:0/3768399563 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8414ca50 con 0x7f5e640049b0 2020-04-22T14:12:24.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.763+0000 7f5e817fa700 1 -- 172.21.15.103:0/3768399563 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8414d200 con 0x7f5e64003d80 2020-04-22T14:12:24.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.763+0000 7f5e817fa700 1 -- 172.21.15.103:0/3768399563 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e64005360 con 0x7f5e840b8fc0 2020-04-22T14:12:24.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.763+0000 7f5e88903700 1 --2- 172.21.15.103:0/3768399563 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e64003d80 0x7f5e640041e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:24.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.763+0000 7f5e83fff700 1 --2- 172.21.15.103:0/3768399563 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e640049b0 0x7f5e64004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:24.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.763+0000 7f5e837fe700 1 --2- 172.21.15.103:0/3768399563 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e840b8fc0 0x7f5e64003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:24.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.763+0000 7f5e88903700 1 -- 172.21.15.103:0/3768399563 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e840b8fc0 msgr2=0x7f5e64003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:24.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.763+0000 7f5e88903700 1 --2- 172.21.15.103:0/3768399563 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e840b8fc0 0x7f5e64003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:24.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.763+0000 7f5e88903700 1 -- 172.21.15.103:0/3768399563 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e640049b0 msgr2=0x7f5e64004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:24.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.763+0000 7f5e88903700 1 --2- 172.21.15.103:0/3768399563 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e640049b0 0x7f5e64004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:24.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.763+0000 7f5e88903700 1 -- 172.21.15.103:0/3768399563 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e8414d4a0 con 0x7f5e64003d80 2020-04-22T14:12:24.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.763+0000 7f5e89104700 1 -- 172.21.15.103:0/3768399563 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e8414d740 con 0x7f5e64003d80 2020-04-22T14:12:24.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.763+0000 7f5e88903700 1 --2- 172.21.15.103:0/3768399563 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e64003d80 0x7f5e640041e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5e7c0017f0 tx=0x7f5e7c011a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.763+0000 7f5e89104700 1 -- 172.21.15.103:0/3768399563 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e8414dbe0 con 0x7f5e64003d80 2020-04-22T14:12:24.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.763+0000 7f5e88903700 1 --2- 172.21.15.103:0/3768399563 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e64003d80 0x7f5e640041e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5e7c0017f0 tx=0x7f5e7c011a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.763+0000 7f5e88903700 1 --2- 172.21.15.103:0/3768399563 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e64003d80 0x7f5e640041e0 secure :-1 s=READY pgs=1106 cs=0 l=1 rx=0x7f5e7c0017f0 tx=0x7f5e7c011a90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:24.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.763+0000 7f5e88903700 1 --2- 172.21.15.103:0/3768399563 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e64003d80 0x7f5e640041e0 secure :-1 s=THROTTLE_DONE pgs=1106 cs=0 l=1 rx=0x7f5e7c0017f0 tx=0x7f5e7c011a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.763+0000 7f5e817fa700 1 -- 172.21.15.103:0/3768399563 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e7c0137f0 con 0x7f5e64003d80 2020-04-22T14:12:24.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.763+0000 7f5e88903700 1 --2- 172.21.15.103:0/3768399563 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e64003d80 0x7f5e640041e0 secure :-1 s=THROTTLE_DONE pgs=1106 cs=0 l=1 rx=0x7f5e7c0017f0 tx=0x7f5e7c011a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.763+0000 7f5e88903700 1 --2- 172.21.15.103:0/3768399563 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e64003d80 0x7f5e640041e0 secure :-1 s=THROTTLE_DONE pgs=1106 cs=0 l=1 rx=0x7f5e7c0017f0 tx=0x7f5e7c011a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.763+0000 7f5e817fa700 1 -- 172.21.15.103:0/3768399563 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7c013950 con 0x7f5e64003d80 2020-04-22T14:12:24.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.763+0000 7f5e817fa700 1 -- 172.21.15.103:0/3768399563 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e7c013d30 con 0x7f5e64003d80 2020-04-22T14:12:24.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.764+0000 7f5e88903700 1 --2- 172.21.15.103:0/3768399563 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e64003d80 0x7f5e640041e0 secure :-1 s=THROTTLE_DONE pgs=1106 cs=0 l=1 rx=0x7f5e7c0017f0 tx=0x7f5e7c011a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.764+0000 7f5e89104700 1 -- 172.21.15.103:0/3768399563 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e60003340 con 0x7f5e64003d80 2020-04-22T14:12:24.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.764+0000 7f5e817fa700 1 -- 172.21.15.103:0/3768399563 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f5e7c00f190 con 0x7f5e64003d80 2020-04-22T14:12:24.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.764+0000 7f5e88903700 1 --2- 172.21.15.103:0/3768399563 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e64003d80 0x7f5e640041e0 secure :-1 s=THROTTLE_DONE pgs=1106 cs=0 l=1 rx=0x7f5e7c0017f0 tx=0x7f5e7c011a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.765+0000 7f5e817fa700 1 --2- 172.21.15.103:0/3768399563 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5e64055b20 0x7f5e64057fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:24.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.765+0000 7f5e817fa700 1 -- 172.21.15.103:0/3768399563 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5e7c0100c0 con 0x7f5e64003d80 2020-04-22T14:12:24.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.765+0000 7f5e83fff700 1 --2- 172.21.15.103:0/3768399563 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5e64055b20 0x7f5e64057fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:24.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.765+0000 7f5e83fff700 1 --2- 172.21.15.103:0/3768399563 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5e64055b20 0x7f5e64057fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5e74002f30 tx=0x7f5e7400eb20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.765+0000 7f5e83fff700 1 --2- 172.21.15.103:0/3768399563 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5e64055b20 0x7f5e64057fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5e74002f30 tx=0x7f5e7400eb20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.765+0000 7f5e83fff700 1 --2- 172.21.15.103:0/3768399563 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5e64055b20 0x7f5e64057fe0 secure :-1 s=READY pgs=409 cs=0 l=1 rx=0x7f5e74002f30 tx=0x7f5e7400eb20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:24.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.769+0000 7f5e88903700 1 --2- 172.21.15.103:0/3768399563 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e64003d80 0x7f5e640041e0 secure :-1 s=THROTTLE_DONE pgs=1106 cs=0 l=1 rx=0x7f5e7c0017f0 tx=0x7f5e7c011a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.769+0000 7f5e817fa700 1 -- 172.21.15.103:0/3768399563 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f5e7c03cf40 con 0x7f5e64003d80 2020-04-22T14:12:24.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.910+0000 7f5e89104700 1 -- 172.21.15.103:0/3768399563 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5e60002200 con 0x7f5e64003d80 2020-04-22T14:12:24.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.910+0000 7f5e88903700 1 --2- 172.21.15.103:0/3768399563 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e64003d80 0x7f5e640041e0 secure :-1 s=THROTTLE_DONE pgs=1106 cs=0 l=1 rx=0x7f5e7c0017f0 tx=0x7f5e7c011a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:24.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.910+0000 7f5e817fa700 1 -- 172.21.15.103:0/3768399563 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v77) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5e7c040560 con 0x7f5e64003d80 2020-04-22T14:12:24.914 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:12:24.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.911+0000 7f5e89104700 1 -- 172.21.15.103:0/3768399563 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5e64055b20 msgr2=0x7f5e64057fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:24.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.911+0000 7f5e89104700 1 --2- 172.21.15.103:0/3768399563 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5e64055b20 0x7f5e64057fe0 secure :-1 s=READY pgs=409 cs=0 l=1 rx=0x7f5e74002f30 tx=0x7f5e7400eb20).stop 2020-04-22T14:12:24.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.912+0000 7f5e89104700 1 -- 172.21.15.103:0/3768399563 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e64003d80 msgr2=0x7f5e640041e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:24.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.912+0000 7f5e88903700 1 -- 172.21.15.103:0/3768399563 reap_dead start 2020-04-22T14:12:24.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.912+0000 7f5e89104700 1 --2- 172.21.15.103:0/3768399563 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e64003d80 0x7f5e640041e0 secure :-1 s=READY pgs=1106 cs=0 l=1 rx=0x7f5e7c0017f0 tx=0x7f5e7c011a90).stop 2020-04-22T14:12:24.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.912+0000 7f5e89104700 1 -- 172.21.15.103:0/3768399563 shutdown_connections 2020-04-22T14:12:24.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.912+0000 7f5e89104700 1 --2- 172.21.15.103:0/3768399563 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e64003d80 0x7f5e640041e0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:24.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.912+0000 7f5e89104700 1 -- 172.21.15.103:0/3768399563 >> 172.21.15.103:0/3768399563 conn(0x7f5e8405b780 msgr2=0x7f5e8405c640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:24.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.912+0000 7f5e89104700 1 -- 172.21.15.103:0/3768399563 shutdown_connections 2020-04-22T14:12:24.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:24.912+0000 7f5e89104700 1 -- 172.21.15.103:0/3768399563 wait complete. 2020-04-22T14:12:24.925 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:24.940 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-22T14:12:25.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.086+0000 7f663704c700 1 Processor -- start 2020-04-22T14:12:25.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.086+0000 7f663704c700 1 -- start start 2020-04-22T14:12:25.092 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.086+0000 7f663704c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66300b9140 0x7f663012b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:25.092 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.086+0000 7f663704c700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66301467e0 con 0x7f66300ac950 2020-04-22T14:12:25.093 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.086+0000 7f663704c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6630060050 con 0x7f663012b670 2020-04-22T14:12:25.093 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.086+0000 7f663704c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66300602f0 con 0x7f66300b9140 2020-04-22T14:12:25.093 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.087+0000 7f66355e9700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f663012b670 0x7f6630143090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45116/0 (socket says 172.21.15.103:45116) 2020-04-22T14:12:25.093 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.087+0000 7f66355e9700 1 -- 172.21.15.103:0/651952366 learned_addr learned my addr 172.21.15.103:0/651952366 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:25.093 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.087+0000 7f6634de8700 1 --2- 172.21.15.103:0/651952366 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66300b9140 0x7f663012b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:25.093 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.087+0000 7f662f7fe700 1 -- 172.21.15.103:0/651952366 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3019017231 0 0) 0x7f6630060050 con 0x7f663012b670 2020-04-22T14:12:25.093 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.087+0000 7f662f7fe700 1 -- 172.21.15.103:0/651952366 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f661c003230 con 0x7f663012b670 2020-04-22T14:12:25.094 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.087+0000 7f662f7fe700 1 -- 172.21.15.103:0/651952366 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3572787773 0 0) 0x7f66301467e0 con 0x7f66300ac950 2020-04-22T14:12:25.094 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.087+0000 7f662f7fe700 1 -- 172.21.15.103:0/651952366 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6630060050 con 0x7f66300ac950 2020-04-22T14:12:25.094 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.087+0000 7f662f7fe700 1 -- 172.21.15.103:0/651952366 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2844553179 0 0) 0x7f661c003230 con 0x7f663012b670 2020-04-22T14:12:25.094 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.087+0000 7f6634de8700 1 -- 172.21.15.103:0/651952366 >> v1:172.21.15.103:6789/0 conn(0x7f663012b670 legacy=0x7f6630143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:25.094 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.087+0000 7f6634de8700 1 -- 172.21.15.103:0/651952366 >> v1:172.21.15.86:6789/0 conn(0x7f66300ac950 legacy=0x7f6630146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:25.094 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.087+0000 7f6634de8700 1 -- 172.21.15.103:0/651952366 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66300b9520 con 0x7f66300b9140 2020-04-22T14:12:25.094 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.087+0000 7f6634de8700 1 --2- 172.21.15.103:0/651952366 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66300b9140 0x7f663012b210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6628001bf0 tx=0x7f66200088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.095 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.087+0000 7f6634de8700 1 --2- 172.21.15.103:0/651952366 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66300b9140 0x7f663012b210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6628001bf0 tx=0x7f66200088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.095 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.087+0000 7f6634de8700 1 --2- 172.21.15.103:0/651952366 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66300b9140 0x7f663012b210 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7f6628001bf0 tx=0x7f66200088e0).ready entity=mon.2 client_cookie=238811a0665a9ffe server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:25.095 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.087+0000 7f6634de8700 1 --2- 172.21.15.103:0/651952366 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66300b9140 0x7f663012b210 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f6628001bf0 tx=0x7f66200088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.095 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.087+0000 7f662f7fe700 1 -- 172.21.15.103:0/651952366 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6628001a50 con 0x7f66300b9140 2020-04-22T14:12:25.095 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.088+0000 7f6634de8700 1 --2- 172.21.15.103:0/651952366 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66300b9140 0x7f663012b210 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f6628001bf0 tx=0x7f66200088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.095 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.088+0000 7f6634de8700 1 --2- 172.21.15.103:0/651952366 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66300b9140 0x7f663012b210 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f6628001bf0 tx=0x7f66200088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.095 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.088+0000 7f662f7fe700 1 -- 172.21.15.103:0/651952366 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6620011210 con 0x7f66300b9140 2020-04-22T14:12:25.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.088+0000 7f662f7fe700 1 -- 172.21.15.103:0/651952366 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66200115f0 con 0x7f66300b9140 2020-04-22T14:12:25.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.088+0000 7f663704c700 1 -- 172.21.15.103:0/651952366 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66300b9140 msgr2=0x7f663012b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:25.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.088+0000 7f663704c700 1 --2- 172.21.15.103:0/651952366 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66300b9140 0x7f663012b210 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7f6628001bf0 tx=0x7f66200088e0).stop 2020-04-22T14:12:25.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.088+0000 7f663704c700 1 -- 172.21.15.103:0/651952366 shutdown_connections 2020-04-22T14:12:25.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.088+0000 7f663704c700 1 --2- 172.21.15.103:0/651952366 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66300b9140 0x7f663012b210 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:25.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.088+0000 7f663704c700 1 -- 172.21.15.103:0/651952366 >> 172.21.15.103:0/651952366 conn(0x7f663005b7b0 msgr2=0x7f66300b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:25.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.088+0000 7f663704c700 1 -- 172.21.15.103:0/651952366 shutdown_connections 2020-04-22T14:12:25.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.088+0000 7f663704c700 1 -- 172.21.15.103:0/651952366 wait complete. 2020-04-22T14:12:25.097 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.089+0000 7f663704c700 1 Processor -- start 2020-04-22T14:12:25.097 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.089+0000 7f663704c700 1 -- start start 2020-04-22T14:12:25.101 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.090+0000 7f663704c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66300ac950 0x7f6630153e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:25.101 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.090+0000 7f663704c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f663012b670 0x7f66300b1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:25.101 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.090+0000 7f663704c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66300b1cd0 con 0x7f66300b9140 2020-04-22T14:12:25.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.090+0000 7f663704c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6630066410 con 0x7f663012b670 2020-04-22T14:12:25.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.090+0000 7f663704c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66300666b0 con 0x7f66300ac950 2020-04-22T14:12:25.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.090+0000 7f662ffff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f66300b9140 0x7f6630126d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45124/0 (socket says 172.21.15.103:45124) 2020-04-22T14:12:25.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.090+0000 7f662ffff700 1 -- 172.21.15.103:0/350560183 learned_addr learned my addr 172.21.15.103:0/350560183 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:25.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.090+0000 7f6634de8700 1 --2- 172.21.15.103:0/350560183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66300ac950 0x7f6630153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:25.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.090+0000 7f66355e9700 1 --2- 172.21.15.103:0/350560183 >> v2:172.21.15.86:3300/0 conn(0x7f663012b670 0x7f66300b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:25.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.090+0000 7f662dffb700 1 -- 172.21.15.103:0/350560183 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 526518548 0 0) 0x7f6630060050 con 0x7f66300b9140 2020-04-22T14:12:25.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.090+0000 7f662dffb700 1 -- 172.21.15.103:0/350560183 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6610002fe0 con 0x7f66300b9140 2020-04-22T14:12:25.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.090+0000 7f6634de8700 1 -- 172.21.15.103:0/350560183 >> v2:172.21.15.86:3300/0 conn(0x7f663012b670 msgr2=0x7f66300b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:25.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.090+0000 7f6634de8700 1 --2- 172.21.15.103:0/350560183 >> v2:172.21.15.86:3300/0 conn(0x7f663012b670 0x7f66300b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:25.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.090+0000 7f6634de8700 1 -- 172.21.15.103:0/350560183 >> v1:172.21.15.103:6789/0 conn(0x7f66300b9140 legacy=0x7f6630126d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:25.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.090+0000 7f6634de8700 1 -- 172.21.15.103:0/350560183 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6630066950 con 0x7f66300ac950 2020-04-22T14:12:25.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.090+0000 7f6634de8700 1 --2- 172.21.15.103:0/350560183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66300ac950 0x7f6630153e10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6628001bf0 tx=0x7f66300b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.091+0000 7f6634de8700 1 --2- 172.21.15.103:0/350560183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66300ac950 0x7f6630153e10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6628001bf0 tx=0x7f66300b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.091+0000 7f6634de8700 1 --2- 172.21.15.103:0/350560183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66300ac950 0x7f6630153e10 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7f6628001bf0 tx=0x7f66300b96b0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:25.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.091+0000 7f6634de8700 1 --2- 172.21.15.103:0/350560183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66300ac950 0x7f6630153e10 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f6628001bf0 tx=0x7f66300b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.091+0000 7f662dffb700 1 -- 172.21.15.103:0/350560183 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f662000f820 con 0x7f66300ac950 2020-04-22T14:12:25.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.091+0000 7f6634de8700 1 --2- 172.21.15.103:0/350560183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66300ac950 0x7f6630153e10 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f6628001bf0 tx=0x7f66300b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.091+0000 7f6634de8700 1 --2- 172.21.15.103:0/350560183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66300ac950 0x7f6630153e10 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f6628001bf0 tx=0x7f66300b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.091+0000 7f662dffb700 1 -- 172.21.15.103:0/350560183 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6620007360 con 0x7f66300ac950 2020-04-22T14:12:25.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.091+0000 7f662dffb700 1 -- 172.21.15.103:0/350560183 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6620011a70 con 0x7f66300ac950 2020-04-22T14:12:25.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.091+0000 7f663704c700 1 -- 172.21.15.103:0/350560183 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6630127420 con 0x7f66300ac950 2020-04-22T14:12:25.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.091+0000 7f663704c700 1 -- 172.21.15.103:0/350560183 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6630065ea0 con 0x7f66300ac950 2020-04-22T14:12:25.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.092+0000 7f6634de8700 1 --2- 172.21.15.103:0/350560183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66300ac950 0x7f6630153e10 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f6628001bf0 tx=0x7f66300b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.092+0000 7f663704c700 1 -- 172.21.15.103:0/350560183 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6630066d10 con 0x7f66300ac950 2020-04-22T14:12:25.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.092+0000 7f662dffb700 1 -- 172.21.15.103:0/350560183 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f6620011c70 con 0x7f66300ac950 2020-04-22T14:12:25.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.092+0000 7f6634de8700 1 --2- 172.21.15.103:0/350560183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66300ac950 0x7f6630153e10 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f6628001bf0 tx=0x7f66300b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.092+0000 7f662dffb700 1 --2- 172.21.15.103:0/350560183 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f661004dcc0 0x7f6610050180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:25.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.092+0000 7f662dffb700 1 -- 172.21.15.103:0/350560183 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6620061ac0 con 0x7f66300ac950 2020-04-22T14:12:25.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.092+0000 7f662ffff700 1 --2- 172.21.15.103:0/350560183 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f661004dcc0 0x7f6610050180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:25.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.093+0000 7f662ffff700 1 --2- 172.21.15.103:0/350560183 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f661004dcc0 0x7f6610050180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6624001050 tx=0x7f66240027e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.093+0000 7f662ffff700 1 --2- 172.21.15.103:0/350560183 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f661004dcc0 0x7f6610050180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6624001050 tx=0x7f66240027e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.093+0000 7f662ffff700 1 --2- 172.21.15.103:0/350560183 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f661004dcc0 0x7f6610050180 secure :-1 s=READY pgs=410 cs=0 l=1 rx=0x7f6624001050 tx=0x7f66240027e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:25.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.096+0000 7f6634de8700 1 --2- 172.21.15.103:0/350560183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66300ac950 0x7f6630153e10 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f6628001bf0 tx=0x7f66300b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.096+0000 7f662dffb700 1 -- 172.21.15.103:0/350560183 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f662003cfc0 con 0x7f66300ac950 2020-04-22T14:12:25.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.238+0000 7f663704c700 1 -- 172.21.15.103:0/350560183 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6630066ae0 con 0x7f66300ac950 2020-04-22T14:12:25.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.239+0000 7f6634de8700 1 --2- 172.21.15.103:0/350560183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66300ac950 0x7f6630153e10 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f6628001bf0 tx=0x7f66300b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.239+0000 7f662dffb700 1 -- 172.21.15.103:0/350560183 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v77) v1 ==== 104+0+10 (secure 0 0 0) 0x7f66200405e0 con 0x7f66300ac950 2020-04-22T14:12:25.242 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:12:25.244 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.240+0000 7f663704c700 1 -- 172.21.15.103:0/350560183 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f661004dcc0 msgr2=0x7f6610050180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:25.244 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.240+0000 7f663704c700 1 --2- 172.21.15.103:0/350560183 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f661004dcc0 0x7f6610050180 secure :-1 s=READY pgs=410 cs=0 l=1 rx=0x7f6624001050 tx=0x7f66240027e0).stop 2020-04-22T14:12:25.244 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.240+0000 7f663704c700 1 -- 172.21.15.103:0/350560183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66300ac950 msgr2=0x7f6630153e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:25.244 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.240+0000 7f663704c700 1 --2- 172.21.15.103:0/350560183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66300ac950 0x7f6630153e10 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7f6628001bf0 tx=0x7f66300b96b0).stop 2020-04-22T14:12:25.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.240+0000 7f663704c700 1 -- 172.21.15.103:0/350560183 shutdown_connections 2020-04-22T14:12:25.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.240+0000 7f663704c700 1 --2- 172.21.15.103:0/350560183 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f661004dcc0 0x7f6610050180 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:25.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.240+0000 7f663704c700 1 --2- 172.21.15.103:0/350560183 >> v2:172.21.15.86:3300/0 conn(0x7f663012b670 0x7f66300b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:25.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.240+0000 7f663704c700 1 --2- 172.21.15.103:0/350560183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66300ac950 0x7f6630153e10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:25.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.240+0000 7f663704c700 1 -- 172.21.15.103:0/350560183 >> 172.21.15.103:0/350560183 conn(0x7f663005b7b0 msgr2=0x7f66301278c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:25.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.240+0000 7f663704c700 1 -- 172.21.15.103:0/350560183 shutdown_connections 2020-04-22T14:12:25.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.240+0000 7f663704c700 1 -- 172.21.15.103:0/350560183 wait complete. 2020-04-22T14:12:25.253 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:25.277 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-22T14:12:25.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.423+0000 7fd91d41d700 1 Processor -- start 2020-04-22T14:12:25.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.424+0000 7fd91d41d700 1 -- start start 2020-04-22T14:12:25.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.424+0000 7fd91d41d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd9180ac950 0x7fd918146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:25.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.424+0000 7fd91d41d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd9181470a0 0x7fd918143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:25.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.424+0000 7fd91d41d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9181467e0 con 0x7fd9180b9140 2020-04-22T14:12:25.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.424+0000 7fd91d41d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd918147530 con 0x7fd9181470a0 2020-04-22T14:12:25.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.424+0000 7fd91d41d700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9180602f0 con 0x7fd9180ac950 2020-04-22T14:12:25.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.425+0000 7fd9167fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd9180ac950 0x7fd918146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:25.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.425+0000 7fd916ffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd9180b9140 0x7fd91812b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45130/0 (socket says 172.21.15.103:45130) 2020-04-22T14:12:25.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.425+0000 7fd916ffd700 1 -- 172.21.15.103:0/3512231180 learned_addr learned my addr 172.21.15.103:0/3512231180 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:25.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.425+0000 7fd9177fe700 1 --2- 172.21.15.103:0/3512231180 >> v2:172.21.15.86:3300/0 conn(0x7fd9181470a0 0x7fd918143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:25.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.425+0000 7fd9167fc700 1 -- 172.21.15.103:0/3512231180 >> v2:172.21.15.86:3300/0 conn(0x7fd9181470a0 msgr2=0x7fd918143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:25.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.425+0000 7fd9167fc700 1 --2- 172.21.15.103:0/3512231180 >> v2:172.21.15.86:3300/0 conn(0x7fd9181470a0 0x7fd918143090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:25.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.425+0000 7fd9167fc700 1 -- 172.21.15.103:0/3512231180 >> v1:172.21.15.103:6789/0 conn(0x7fd9180b9140 legacy=0x7fd91812b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:25.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.425+0000 7fd9167fc700 1 -- 172.21.15.103:0/3512231180 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd918060050 con 0x7fd9180ac950 2020-04-22T14:12:25.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.425+0000 7fd915ffb700 1 -- 172.21.15.103:0/3512231180 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 817950848 0 0) 0x7fd9181467e0 con 0x7fd9180b9140 2020-04-22T14:12:25.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.425+0000 7fd9167fc700 1 --2- 172.21.15.103:0/3512231180 >> v2:172.21.15.103:3300/0 conn(0x7fd9180ac950 0x7fd918146c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd900002f30 tx=0x7fd900007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.425+0000 7fd9167fc700 1 --2- 172.21.15.103:0/3512231180 >> v2:172.21.15.103:3300/0 conn(0x7fd9180ac950 0x7fd918146c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd900002f30 tx=0x7fd900007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.425+0000 7fd9167fc700 1 --2- 172.21.15.103:0/3512231180 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9180ac950 0x7fd918146c40 secure :-1 s=READY pgs=1110 cs=0 l=1 rx=0x7fd900002f30 tx=0x7fd900007a40).ready entity=mon.1 client_cookie=beb56ffc78c3654c server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:25.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.425+0000 7fd9167fc700 1 --2- 172.21.15.103:0/3512231180 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9180ac950 0x7fd918146c40 secure :-1 s=THROTTLE_DONE pgs=1110 cs=0 l=1 rx=0x7fd900002f30 tx=0x7fd900007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.425+0000 7fd915ffb700 1 -- 172.21.15.103:0/3512231180 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9000113c0 con 0x7fd9180ac950 2020-04-22T14:12:25.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.425+0000 7fd9167fc700 1 --2- 172.21.15.103:0/3512231180 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9180ac950 0x7fd918146c40 secure :-1 s=THROTTLE_DONE pgs=1110 cs=0 l=1 rx=0x7fd900002f30 tx=0x7fd900007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.425+0000 7fd9167fc700 1 --2- 172.21.15.103:0/3512231180 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9180ac950 0x7fd918146c40 secure :-1 s=THROTTLE_DONE pgs=1110 cs=0 l=1 rx=0x7fd900002f30 tx=0x7fd900007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.425+0000 7fd915ffb700 1 -- 172.21.15.103:0/3512231180 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd900011520 con 0x7fd9180ac950 2020-04-22T14:12:25.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.425+0000 7fd915ffb700 1 -- 172.21.15.103:0/3512231180 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd900011900 con 0x7fd9180ac950 2020-04-22T14:12:25.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.425+0000 7fd91d41d700 1 -- 172.21.15.103:0/3512231180 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9180ac950 msgr2=0x7fd918146c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:25.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.425+0000 7fd91d41d700 1 --2- 172.21.15.103:0/3512231180 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9180ac950 0x7fd918146c40 secure :-1 s=READY pgs=1110 cs=0 l=1 rx=0x7fd900002f30 tx=0x7fd900007a40).stop 2020-04-22T14:12:25.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.426+0000 7fd91d41d700 1 -- 172.21.15.103:0/3512231180 shutdown_connections 2020-04-22T14:12:25.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.426+0000 7fd91d41d700 1 --2- 172.21.15.103:0/3512231180 >> v2:172.21.15.86:3300/0 conn(0x7fd9181470a0 0x7fd918143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:25.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.426+0000 7fd91d41d700 1 --2- 172.21.15.103:0/3512231180 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9180ac950 0x7fd918146c40 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:25.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.426+0000 7fd91d41d700 1 -- 172.21.15.103:0/3512231180 >> 172.21.15.103:0/3512231180 conn(0x7fd91805b7b0 msgr2=0x7fd9180b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:25.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.426+0000 7fd91d41d700 1 -- 172.21.15.103:0/3512231180 shutdown_connections 2020-04-22T14:12:25.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.426+0000 7fd91d41d700 1 -- 172.21.15.103:0/3512231180 wait complete. 2020-04-22T14:12:25.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.427+0000 7fd91d41d700 1 Processor -- start 2020-04-22T14:12:25.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.427+0000 7fd91d41d700 1 -- start start 2020-04-22T14:12:25.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.427+0000 7fd91d41d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd9180ac950 0x7fd918144c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:25.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.427+0000 7fd91d41d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9180b0810 con 0x7fd9181470a0 2020-04-22T14:12:25.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.427+0000 7fd91d41d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9180b2040 con 0x7fd9180b9140 2020-04-22T14:12:25.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.427+0000 7fd91d41d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9180b2780 con 0x7fd9180ac950 2020-04-22T14:12:25.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.428+0000 7fd9167fc700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd9180b9140 0x7fd9181282d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45138/0 (socket says 172.21.15.103:45138) 2020-04-22T14:12:25.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.428+0000 7fd9167fc700 1 -- 172.21.15.103:0/162528438 learned_addr learned my addr 172.21.15.103:0/162528438 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:25.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.428+0000 7fd916ffd700 1 --2- 172.21.15.103:0/162528438 >> v2:172.21.15.86:3300/0 conn(0x7fd9180ac950 0x7fd918144c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:25.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.428+0000 7fd90ffff700 1 -- 172.21.15.103:0/162528438 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 593980102 0 0) 0x7fd9180b2040 con 0x7fd9180b9140 2020-04-22T14:12:25.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.428+0000 7fd90ffff700 1 -- 172.21.15.103:0/162528438 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8fc002fe0 con 0x7fd9180b9140 2020-04-22T14:12:25.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.428+0000 7fd90ffff700 1 -- 172.21.15.103:0/162528438 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4147049615 0 0) 0x7fd8fc002fe0 con 0x7fd9180b9140 2020-04-22T14:12:25.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.428+0000 7fd90ffff700 1 -- 172.21.15.103:0/162528438 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd9180b2040 con 0x7fd9180b9140 2020-04-22T14:12:25.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.428+0000 7fd90ffff700 1 -- 172.21.15.103:0/162528438 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fd900008e10 con 0x7fd9180b9140 2020-04-22T14:12:25.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.428+0000 7fd90ffff700 1 -- 172.21.15.103:0/162528438 >> v2:172.21.15.86:3300/0 conn(0x7fd9180ac950 msgr2=0x7fd918144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:25.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.428+0000 7fd90ffff700 1 --2- 172.21.15.103:0/162528438 >> v2:172.21.15.86:3300/0 conn(0x7fd9180ac950 0x7fd918144c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:25.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.428+0000 7fd90ffff700 1 -- 172.21.15.103:0/162528438 >> v1:172.21.15.103:6789/0 conn(0x7fd9180b9140 legacy=0x7fd9181282d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:25.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.428+0000 7fd90ffff700 1 -- 172.21.15.103:0/162528438 >> v1:172.21.15.86:6789/0 conn(0x7fd9181470a0 legacy=0x7fd9181438e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:25.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.428+0000 7fd90ffff700 1 --2- 172.21.15.103:0/162528438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8fc0049b0 0x7fd8fc004db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:25.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.428+0000 7fd90ffff700 1 --2- 172.21.15.103:0/162528438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8fc003920 0x7fd8fc003d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:25.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.428+0000 7fd90ffff700 1 --2- 172.21.15.103:0/162528438 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd8fc0041e0 0x7fd8fc00b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:25.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.428+0000 7fd90ffff700 1 -- 172.21.15.103:0/162528438 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9180b2780 con 0x7fd8fc003920 2020-04-22T14:12:25.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.428+0000 7fd90ffff700 1 -- 172.21.15.103:0/162528438 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc004750 con 0x7fd8fc0049b0 2020-04-22T14:12:25.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.428+0000 7fd90ffff700 1 -- 172.21.15.103:0/162528438 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc00bbb0 con 0x7fd8fc0041e0 2020-04-22T14:12:25.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.428+0000 7fd916ffd700 1 --2- 172.21.15.103:0/162528438 >> v2:172.21.15.86:3300/0 conn(0x7fd9180ac950 0x7fd918144c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:12:25.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.428+0000 7fd916ffd700 1 --2- 172.21.15.103:0/162528438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8fc0049b0 0x7fd8fc004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:25.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.428+0000 7fd9167fc700 1 --2- 172.21.15.103:0/162528438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8fc003920 0x7fd8fc003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:25.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.428+0000 7fd9177fe700 1 --2- 172.21.15.103:0/162528438 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd8fc0041e0 0x7fd8fc00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:25.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.429+0000 7fd916ffd700 1 -- 172.21.15.103:0/162528438 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd8fc0041e0 msgr2=0x7fd8fc00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:25.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.429+0000 7fd916ffd700 1 --2- 172.21.15.103:0/162528438 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd8fc0041e0 0x7fd8fc00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:25.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.429+0000 7fd916ffd700 1 -- 172.21.15.103:0/162528438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8fc003920 msgr2=0x7fd8fc003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:25.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.429+0000 7fd916ffd700 1 --2- 172.21.15.103:0/162528438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8fc003920 0x7fd8fc003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:25.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.429+0000 7fd916ffd700 1 -- 172.21.15.103:0/162528438 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd918157c50 con 0x7fd8fc0049b0 2020-04-22T14:12:25.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.429+0000 7fd91d41d700 1 -- 172.21.15.103:0/162528438 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9180b2270 con 0x7fd8fc0049b0 2020-04-22T14:12:25.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.429+0000 7fd9177fe700 1 -- 172.21.15.103:0/162528438 reap_dead start 2020-04-22T14:12:25.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.429+0000 7fd916ffd700 1 --2- 172.21.15.103:0/162528438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8fc0049b0 0x7fd8fc004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd908000b80 tx=0x7fd908010fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.429+0000 7fd91d41d700 1 -- 172.21.15.103:0/162528438 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd918144eb0 con 0x7fd8fc0049b0 2020-04-22T14:12:25.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.429+0000 7fd916ffd700 1 --2- 172.21.15.103:0/162528438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8fc0049b0 0x7fd8fc004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd908000b80 tx=0x7fd908010fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.429+0000 7fd916ffd700 1 --2- 172.21.15.103:0/162528438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8fc0049b0 0x7fd8fc004db0 secure :-1 s=READY pgs=1112 cs=0 l=1 rx=0x7fd908000b80 tx=0x7fd908010fb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:25.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.429+0000 7fd916ffd700 1 --2- 172.21.15.103:0/162528438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8fc0049b0 0x7fd8fc004db0 secure :-1 s=THROTTLE_DONE pgs=1112 cs=0 l=1 rx=0x7fd908000b80 tx=0x7fd908010fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.429+0000 7fd90ffff700 1 -- 172.21.15.103:0/162528438 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9080100c0 con 0x7fd8fc0049b0 2020-04-22T14:12:25.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.429+0000 7fd916ffd700 1 --2- 172.21.15.103:0/162528438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8fc0049b0 0x7fd8fc004db0 secure :-1 s=THROTTLE_DONE pgs=1112 cs=0 l=1 rx=0x7fd908000b80 tx=0x7fd908010fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.429+0000 7fd90ffff700 1 -- 172.21.15.103:0/162528438 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd908010220 con 0x7fd8fc0049b0 2020-04-22T14:12:25.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.429+0000 7fd916ffd700 1 --2- 172.21.15.103:0/162528438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8fc0049b0 0x7fd8fc004db0 secure :-1 s=THROTTLE_DONE pgs=1112 cs=0 l=1 rx=0x7fd908000b80 tx=0x7fd908010fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.429+0000 7fd90ffff700 1 -- 172.21.15.103:0/162528438 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9080105c0 con 0x7fd8fc0049b0 2020-04-22T14:12:25.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.429+0000 7fd916ffd700 1 --2- 172.21.15.103:0/162528438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8fc0049b0 0x7fd8fc004db0 secure :-1 s=THROTTLE_DONE pgs=1112 cs=0 l=1 rx=0x7fd908000b80 tx=0x7fd908010fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.430+0000 7fd90ffff700 1 -- 172.21.15.103:0/162528438 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fd90800c600 con 0x7fd8fc0049b0 2020-04-22T14:12:25.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.430+0000 7fd916ffd700 1 --2- 172.21.15.103:0/162528438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8fc0049b0 0x7fd8fc004db0 secure :-1 s=THROTTLE_DONE pgs=1112 cs=0 l=1 rx=0x7fd908000b80 tx=0x7fd908010fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.430+0000 7fd91d41d700 1 -- 172.21.15.103:0/162528438 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8f0003340 con 0x7fd8fc0049b0 2020-04-22T14:12:25.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.430+0000 7fd90ffff700 1 --2- 172.21.15.103:0/162528438 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd8fc0518f0 0x7fd8fc053db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:25.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.430+0000 7fd90ffff700 1 -- 172.21.15.103:0/162528438 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd908060e40 con 0x7fd8fc0049b0 2020-04-22T14:12:25.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.430+0000 7fd9167fc700 1 --2- 172.21.15.103:0/162528438 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd8fc0518f0 0x7fd8fc053db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:25.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.430+0000 7fd9167fc700 1 --2- 172.21.15.103:0/162528438 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd8fc0518f0 0x7fd8fc053db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd900010190 tx=0x7fd900007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.430+0000 7fd9167fc700 1 --2- 172.21.15.103:0/162528438 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd8fc0518f0 0x7fd8fc053db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd900010190 tx=0x7fd900007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.430+0000 7fd9167fc700 1 --2- 172.21.15.103:0/162528438 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd8fc0518f0 0x7fd8fc053db0 secure :-1 s=READY pgs=411 cs=0 l=1 rx=0x7fd900010190 tx=0x7fd900007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:25.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.434+0000 7fd916ffd700 1 --2- 172.21.15.103:0/162528438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8fc0049b0 0x7fd8fc004db0 secure :-1 s=THROTTLE_DONE pgs=1112 cs=0 l=1 rx=0x7fd908000b80 tx=0x7fd908010fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.434+0000 7fd90ffff700 1 -- 172.21.15.103:0/162528438 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fd90803fc50 con 0x7fd8fc0049b0 2020-04-22T14:12:25.582 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.579+0000 7fd91d41d700 1 -- 172.21.15.103:0/162528438 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd8f0002200 con 0x7fd8fc0049b0 2020-04-22T14:12:25.582 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.579+0000 7fd916ffd700 1 --2- 172.21.15.103:0/162528438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8fc0049b0 0x7fd8fc004db0 secure :-1 s=THROTTLE_DONE pgs=1112 cs=0 l=1 rx=0x7fd908000b80 tx=0x7fd908010fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.582 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.579+0000 7fd90ffff700 1 -- 172.21.15.103:0/162528438 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v77) v1 ==== 100+0+10 (secure 0 0 0) 0x7fd90803f7e0 con 0x7fd8fc0049b0 2020-04-22T14:12:25.583 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:12:25.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.581+0000 7fd91d41d700 1 -- 172.21.15.103:0/162528438 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd8fc0518f0 msgr2=0x7fd8fc053db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:25.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.581+0000 7fd91d41d700 1 --2- 172.21.15.103:0/162528438 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd8fc0518f0 0x7fd8fc053db0 secure :-1 s=READY pgs=411 cs=0 l=1 rx=0x7fd900010190 tx=0x7fd900007a40).stop 2020-04-22T14:12:25.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.581+0000 7fd91d41d700 1 -- 172.21.15.103:0/162528438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8fc0049b0 msgr2=0x7fd8fc004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:25.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.581+0000 7fd91d41d700 1 --2- 172.21.15.103:0/162528438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8fc0049b0 0x7fd8fc004db0 secure :-1 s=READY pgs=1112 cs=0 l=1 rx=0x7fd908000b80 tx=0x7fd908010fb0).stop 2020-04-22T14:12:25.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.581+0000 7fd91d41d700 1 -- 172.21.15.103:0/162528438 shutdown_connections 2020-04-22T14:12:25.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.581+0000 7fd91d41d700 1 --2- 172.21.15.103:0/162528438 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd8fc0518f0 0x7fd8fc053db0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:25.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.581+0000 7fd91d41d700 1 --2- 172.21.15.103:0/162528438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8fc0049b0 0x7fd8fc004db0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:25.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.581+0000 7fd91d41d700 1 -- 172.21.15.103:0/162528438 >> 172.21.15.103:0/162528438 conn(0x7fd91805b7b0 msgr2=0x7fd918129620 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:25.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.581+0000 7fd91d41d700 1 -- 172.21.15.103:0/162528438 shutdown_connections 2020-04-22T14:12:25.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.581+0000 7fd91d41d700 1 -- 172.21.15.103:0/162528438 wait complete. 2020-04-22T14:12:25.594 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-04-22T14:12:25.594 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:25.608 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:12:25.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.750+0000 7fd045be9700 1 Processor -- start 2020-04-22T14:12:25.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.750+0000 7fd045be9700 1 -- start start 2020-04-22T14:12:25.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.751+0000 7fd045be9700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd04014ca00 0x7fd04014edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:25.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.751+0000 7fd045be9700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0400ae860 con 0x7fd0401441f0 2020-04-22T14:12:25.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.751+0000 7fd045be9700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0400b5900 con 0x7fd04005b7c0 2020-04-22T14:12:25.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.751+0000 7fd045be9700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0400b5ba0 con 0x7fd04014ca00 2020-04-22T14:12:25.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.751+0000 7fd03ffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd04014ca00 0x7fd04014edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:25.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.751+0000 7fd03ffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd04014ca00 0x7fd04014edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52960/0 (socket says 172.21.15.103:52960) 2020-04-22T14:12:25.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.751+0000 7fd03ffff700 1 -- 172.21.15.103:0/1600901633 learned_addr learned my addr 172.21.15.103:0/1600901633 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:25.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.751+0000 7fd03f7fe700 1 --1- 172.21.15.103:0/1600901633 >> v1:172.21.15.103:6789/0 conn(0x7fd04005b7c0 0x7fd0400b50d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45150/0 (socket says 172.21.15.103:45150) 2020-04-22T14:12:25.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.751+0000 7fd03ffff700 1 -- 172.21.15.103:0/1600901633 >> v1:172.21.15.103:6789/0 conn(0x7fd04005b7c0 legacy=0x7fd0400b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:25.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.751+0000 7fd03ffff700 1 -- 172.21.15.103:0/1600901633 >> v1:172.21.15.86:6789/0 conn(0x7fd0401441f0 legacy=0x7fd040144820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:25.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.751+0000 7fd03e7fc700 1 -- 172.21.15.103:0/1600901633 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2588034978 0 0) 0x7fd0400b5900 con 0x7fd04005b7c0 2020-04-22T14:12:25.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.751+0000 7fd03ffff700 1 -- 172.21.15.103:0/1600901633 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0400b5e40 con 0x7fd04014ca00 2020-04-22T14:12:25.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.751+0000 7fd03ffff700 1 --2- 172.21.15.103:0/1600901633 >> v2:172.21.15.103:3300/0 conn(0x7fd04014ca00 0x7fd04014edf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd0380032b0 tx=0x7fd038007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.751+0000 7fd03ffff700 1 --2- 172.21.15.103:0/1600901633 >> v2:172.21.15.103:3300/0 conn(0x7fd04014ca00 0x7fd04014edf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd0380032b0 tx=0x7fd038007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.751+0000 7fd03ffff700 1 --2- 172.21.15.103:0/1600901633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd04014ca00 0x7fd04014edf0 secure :-1 s=READY pgs=1114 cs=0 l=1 rx=0x7fd0380032b0 tx=0x7fd038007dc0).ready entity=mon.1 client_cookie=6b20cf9bc1ba4b94 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:25.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.751+0000 7fd03ffff700 1 --2- 172.21.15.103:0/1600901633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd04014ca00 0x7fd04014edf0 secure :-1 s=THROTTLE_DONE pgs=1114 cs=0 l=1 rx=0x7fd0380032b0 tx=0x7fd038007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.751+0000 7fd03e7fc700 1 -- 172.21.15.103:0/1600901633 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0380110d0 con 0x7fd04014ca00 2020-04-22T14:12:25.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.751+0000 7fd03ffff700 1 --2- 172.21.15.103:0/1600901633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd04014ca00 0x7fd04014edf0 secure :-1 s=THROTTLE_DONE pgs=1114 cs=0 l=1 rx=0x7fd0380032b0 tx=0x7fd038007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.751+0000 7fd03e7fc700 1 -- 172.21.15.103:0/1600901633 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd038011270 con 0x7fd04014ca00 2020-04-22T14:12:25.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.751+0000 7fd03ffff700 1 --2- 172.21.15.103:0/1600901633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd04014ca00 0x7fd04014edf0 secure :-1 s=THROTTLE_DONE pgs=1114 cs=0 l=1 rx=0x7fd0380032b0 tx=0x7fd038007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.752+0000 7fd03e7fc700 1 -- 172.21.15.103:0/1600901633 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd038011690 con 0x7fd04014ca00 2020-04-22T14:12:25.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.752+0000 7fd045be9700 1 -- 172.21.15.103:0/1600901633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd04014ca00 msgr2=0x7fd04014edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:25.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.752+0000 7fd045be9700 1 --2- 172.21.15.103:0/1600901633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd04014ca00 0x7fd04014edf0 secure :-1 s=READY pgs=1114 cs=0 l=1 rx=0x7fd0380032b0 tx=0x7fd038007dc0).stop 2020-04-22T14:12:25.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.752+0000 7fd045be9700 1 -- 172.21.15.103:0/1600901633 shutdown_connections 2020-04-22T14:12:25.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.752+0000 7fd045be9700 1 --2- 172.21.15.103:0/1600901633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd04014ca00 0x7fd04014edf0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:25.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.752+0000 7fd045be9700 1 -- 172.21.15.103:0/1600901633 >> 172.21.15.103:0/1600901633 conn(0x7fd0400b9160 msgr2=0x7fd04005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:25.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.752+0000 7fd045be9700 1 -- 172.21.15.103:0/1600901633 shutdown_connections 2020-04-22T14:12:25.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.752+0000 7fd045be9700 1 -- 172.21.15.103:0/1600901633 wait complete. 2020-04-22T14:12:25.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.753+0000 7fd045be9700 1 Processor -- start 2020-04-22T14:12:25.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.753+0000 7fd045be9700 1 -- start start 2020-04-22T14:12:25.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.754+0000 7fd045be9700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd0401441f0 0x7fd040149ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:25.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.754+0000 7fd045be9700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd04014ca00 0x7fd04013d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:25.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.754+0000 7fd045be9700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd04014b7e0 con 0x7fd04005b7c0 2020-04-22T14:12:25.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.754+0000 7fd045be9700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd04014ba80 con 0x7fd0401441f0 2020-04-22T14:12:25.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.754+0000 7fd045be9700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd04014bd20 con 0x7fd04014ca00 2020-04-22T14:12:25.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.754+0000 7fd03effd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd0401441f0 0x7fd040149ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:25.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.754+0000 7fd03effd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd0401441f0 0x7fd040149ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52964/0 (socket says 172.21.15.103:52964) 2020-04-22T14:12:25.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.754+0000 7fd03effd700 1 -- 172.21.15.103:0/1491017644 learned_addr learned my addr 172.21.15.103:0/1491017644 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:25.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.754+0000 7fd03ffff700 1 --2- 172.21.15.103:0/1491017644 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd04014ca00 0x7fd04013d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:25.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.754+0000 7fd03cff9700 1 -- 172.21.15.103:0/1491017644 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 960940000 0 0) 0x7fd04014b7e0 con 0x7fd04005b7c0 2020-04-22T14:12:25.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.754+0000 7fd03effd700 1 -- 172.21.15.103:0/1491017644 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd04014ca00 msgr2=0x7fd04013d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:25.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.754+0000 7fd03effd700 1 --2- 172.21.15.103:0/1491017644 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd04014ca00 0x7fd04013d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:25.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.754+0000 7fd03effd700 1 -- 172.21.15.103:0/1491017644 >> v1:172.21.15.86:6789/0 conn(0x7fd04005b7c0 legacy=0x7fd040127ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:25.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.754+0000 7fd03effd700 1 -- 172.21.15.103:0/1491017644 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd040128700 con 0x7fd0401441f0 2020-04-22T14:12:25.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.754+0000 7fd03effd700 1 --2- 172.21.15.103:0/1491017644 >> v2:172.21.15.103:3300/0 conn(0x7fd0401441f0 0x7fd040149ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd0400613e0 tx=0x7fd02800c3e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.754+0000 7fd03effd700 1 --2- 172.21.15.103:0/1491017644 >> v2:172.21.15.103:3300/0 conn(0x7fd0401441f0 0x7fd040149ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd0400613e0 tx=0x7fd02800c3e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.754+0000 7fd03effd700 1 --2- 172.21.15.103:0/1491017644 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0401441f0 0x7fd040149ed0 secure :-1 s=READY pgs=1115 cs=0 l=1 rx=0x7fd0400613e0 tx=0x7fd02800c3e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:25.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.754+0000 7fd03effd700 1 --2- 172.21.15.103:0/1491017644 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0401441f0 0x7fd040149ed0 secure :-1 s=THROTTLE_DONE pgs=1115 cs=0 l=1 rx=0x7fd0400613e0 tx=0x7fd02800c3e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.754+0000 7fd03cff9700 1 -- 172.21.15.103:0/1491017644 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd02800cc20 con 0x7fd0401441f0 2020-04-22T14:12:25.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.754+0000 7fd03effd700 1 --2- 172.21.15.103:0/1491017644 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0401441f0 0x7fd040149ed0 secure :-1 s=THROTTLE_DONE pgs=1115 cs=0 l=1 rx=0x7fd0400613e0 tx=0x7fd02800c3e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.754+0000 7fd03effd700 1 --2- 172.21.15.103:0/1491017644 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0401441f0 0x7fd040149ed0 secure :-1 s=THROTTLE_DONE pgs=1115 cs=0 l=1 rx=0x7fd0400613e0 tx=0x7fd02800c3e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.754+0000 7fd03cff9700 1 -- 172.21.15.103:0/1491017644 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd02800cd80 con 0x7fd0401441f0 2020-04-22T14:12:25.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.755+0000 7fd045be9700 1 -- 172.21.15.103:0/1491017644 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd04014c1c0 con 0x7fd0401441f0 2020-04-22T14:12:25.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.755+0000 7fd03cff9700 1 -- 172.21.15.103:0/1491017644 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd028011140 con 0x7fd0401441f0 2020-04-22T14:12:25.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.755+0000 7fd045be9700 1 -- 172.21.15.103:0/1491017644 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd04014b060 con 0x7fd0401441f0 2020-04-22T14:12:25.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.755+0000 7fd03effd700 1 --2- 172.21.15.103:0/1491017644 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0401441f0 0x7fd040149ed0 secure :-1 s=THROTTLE_DONE pgs=1115 cs=0 l=1 rx=0x7fd0400613e0 tx=0x7fd02800c3e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.755+0000 7fd045be9700 1 -- 172.21.15.103:0/1491017644 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd040056c90 con 0x7fd0401441f0 2020-04-22T14:12:25.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.756+0000 7fd03cff9700 1 -- 172.21.15.103:0/1491017644 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fd0280064e0 con 0x7fd0401441f0 2020-04-22T14:12:25.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.756+0000 7fd03effd700 1 --2- 172.21.15.103:0/1491017644 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0401441f0 0x7fd040149ed0 secure :-1 s=THROTTLE_DONE pgs=1115 cs=0 l=1 rx=0x7fd0400613e0 tx=0x7fd02800c3e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.756+0000 7fd03cff9700 1 --2- 172.21.15.103:0/1491017644 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd02404d8d0 0x7fd02404fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:25.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.756+0000 7fd03cff9700 1 -- 172.21.15.103:0/1491017644 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd028060e90 con 0x7fd0401441f0 2020-04-22T14:12:25.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.756+0000 7fd03f7fe700 1 --2- 172.21.15.103:0/1491017644 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd02404d8d0 0x7fd02404fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:25.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.756+0000 7fd03f7fe700 1 --2- 172.21.15.103:0/1491017644 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd02404d8d0 0x7fd02404fd90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd030001070 tx=0x7fd0300016a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.756+0000 7fd03f7fe700 1 --2- 172.21.15.103:0/1491017644 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd02404d8d0 0x7fd02404fd90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd030001070 tx=0x7fd0300016a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.756+0000 7fd03f7fe700 1 --2- 172.21.15.103:0/1491017644 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd02404d8d0 0x7fd02404fd90 secure :-1 s=READY pgs=412 cs=0 l=1 rx=0x7fd030001070 tx=0x7fd0300016a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:25.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.760+0000 7fd03effd700 1 --2- 172.21.15.103:0/1491017644 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0401441f0 0x7fd040149ed0 secure :-1 s=THROTTLE_DONE pgs=1115 cs=0 l=1 rx=0x7fd0400613e0 tx=0x7fd02800c3e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.760+0000 7fd03cff9700 1 -- 172.21.15.103:0/1491017644 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fd02803c210 con 0x7fd0401441f0 2020-04-22T14:12:25.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.948+0000 7fd045be9700 1 -- 172.21.15.103:0/1491017644 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd040125c70 con 0x7fd0401441f0 2020-04-22T14:12:25.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.949+0000 7fd03effd700 1 --2- 172.21.15.103:0/1491017644 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0401441f0 0x7fd040149ed0 secure :-1 s=THROTTLE_DONE pgs=1115 cs=0 l=1 rx=0x7fd0400613e0 tx=0x7fd02800c3e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:25.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.949+0000 7fd03cff9700 1 -- 172.21.15.103:0/1491017644 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2137 (secure 0 0 0) 0x7fd02803f830 con 0x7fd0401441f0 2020-04-22T14:12:25.952 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:12:25.953 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5435,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3857335366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3857335366},{"type":"v1","addr":"172.21.15.86:6835","nonce":3857335366}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":46}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:20.884022+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6513},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6513":{"gid":6513,"name":"a","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/46849623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":46849623},{"type":"v1","addr":"172.21.15.103:6833","nonce":46849623}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:12:25.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.950+0000 7fd045be9700 1 -- 172.21.15.103:0/1491017644 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd02404d8d0 msgr2=0x7fd02404fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:25.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.950+0000 7fd045be9700 1 --2- 172.21.15.103:0/1491017644 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd02404d8d0 0x7fd02404fd90 secure :-1 s=READY pgs=412 cs=0 l=1 rx=0x7fd030001070 tx=0x7fd0300016a0).stop 2020-04-22T14:12:25.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.950+0000 7fd045be9700 1 -- 172.21.15.103:0/1491017644 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0401441f0 msgr2=0x7fd040149ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:25.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.950+0000 7fd045be9700 1 --2- 172.21.15.103:0/1491017644 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0401441f0 0x7fd040149ed0 secure :-1 s=READY pgs=1115 cs=0 l=1 rx=0x7fd0400613e0 tx=0x7fd02800c3e0).stop 2020-04-22T14:12:25.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.950+0000 7fd045be9700 1 -- 172.21.15.103:0/1491017644 shutdown_connections 2020-04-22T14:12:25.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.950+0000 7fd045be9700 1 --2- 172.21.15.103:0/1491017644 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd02404d8d0 0x7fd02404fd90 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:25.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.950+0000 7fd045be9700 1 --2- 172.21.15.103:0/1491017644 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd04014ca00 0x7fd04013d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:25.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.950+0000 7fd045be9700 1 --2- 172.21.15.103:0/1491017644 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0401441f0 0x7fd040149ed0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:25.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.950+0000 7fd045be9700 1 -- 172.21.15.103:0/1491017644 >> 172.21.15.103:0/1491017644 conn(0x7fd0400b9160 msgr2=0x7fd040143350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:25.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.950+0000 7fd045be9700 1 -- 172.21.15.103:0/1491017644 shutdown_connections 2020-04-22T14:12:25.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:25.950+0000 7fd045be9700 1 -- 172.21.15.103:0/1491017644 wait complete. 2020-04-22T14:12:25.955 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 50 2020-04-22T14:12:26.173 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 6513}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 13, u'failed': [], u'epoch': 50, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [14], u'info': {u'gid_6513': {u'export_targets': [], u'name': u'a', u'incarnation': 47, u'state_seq': 3, u'state': u'up:active', u'gid': 6513, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 46849623, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 46849623, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/46849623'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:12:18.873897+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:12:20.884022+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:12:26.173 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:12:26.173 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:26.187 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:12:26.345 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:12:26.345 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:12:26.345 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:12:26.346 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 6513, 2020-04-22T14:12:26.346 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:12:26.346 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:12:26.346 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 7.4678251690000002, 2020-04-22T14:12:26.346 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 50, 2020-04-22T14:12:26.346 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 77, 2020-04-22T14:12:26.346 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 77, 2020-04-22T14:12:26.347 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 12.683414806 2020-04-22T14:12:26.347 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:12:26.353 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 6513, "want_state": "up:active", "state": "up:active", "rank_uptime": 7.4678251690000002, "mdsmap_epoch": 50, "osdmap_epoch": 77, "osdmap_epoch_barrier": 77, "uptime": 12.683414806 } 2020-04-22T14:12:26.354 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-04-22T14:12:26.354 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:12:26.354 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:26.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:26.377 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:12:26.431 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:12:26.432 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:12:26.432 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:12:26.432 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:26.432 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:12:26.433 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:26.433 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:12:26.433 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:12:26.433 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:12:26.433 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:12:26.434 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:12:26.434 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:12:26.434 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:12:26.434 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:12:26.434 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:12:26.435 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42094sec preferred_lft 42094sec 2020-04-22T14:12:26.435 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:12:26.435 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:26.435 INFO:teuthology.orchestra.run.smithi103.stdout:20: brx.0@if2: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:12:26.435 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether d6:00:10:e7:64:03 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:12:26.436 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-04-22T14:12:26.436 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:26.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:26.480 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:12:26.557 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:26.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:26.606 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge con-name ceph-brx ifname ceph-brx stp no' 2020-04-22T14:12:26.725 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' (34a6fbe6-e468-4fa3-8cac-1c995a594c03) successfully added. 2020-04-22T14:12:26.725 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:26.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:26.740 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection modify ceph-brx ipv4.addresses 192.168.255.254/16 ipv4.method manual' 2020-04-22T14:12:26.854 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:26.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:26.890 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up ceph-brx' 2020-04-22T14:12:26.999 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (master waiting for slaves) (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/28) 2020-04-22T14:12:27.000 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:27.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:27.015 INFO:teuthology.orchestra.run.smithi103:> touch /tmp/python-ceph-brx 2020-04-22T14:12:27.071 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:27.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:27.121 INFO:teuthology.orchestra.run.smithi103:> cat /proc/sys/net/ipv4/ip_forward 2020-04-22T14:12:27.198 INFO:teuthology.orchestra.run.smithi103.stdout:0 2020-04-22T14:12:27.198 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:27.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:27.243 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 0 > /tmp/python-ceph-brx' 2020-04-22T14:12:27.323 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:27.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:27.370 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 1 > /proc/sys/net/ipv4/ip_forward' 2020-04-22T14:12:27.445 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:27.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:27.490 INFO:teuthology.orchestra.run.smithi103:> route 2020-04-22T14:12:27.552 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2020-04-22T14:12:27.552 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-04-22T14:12:27.553 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 102 0 0 enp3s0f1 2020-04-22T14:12:27.553 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 102 0 0 enp3s0f1 2020-04-22T14:12:27.553 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 425 0 0 ceph-brx 2020-04-22T14:12:27.553 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:27.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:27.599 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-04-22T14:12:27.675 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:27.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:27.725 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-04-22T14:12:27.800 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:27.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:27.858 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-04-22T14:12:27.935 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:27.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:27.984 INFO:teuthology.orchestra.run.smithi103:> ip netns list 2020-04-22T14:12:28.047 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:28.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:28.098 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:12:28.156 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 2020-04-22T14:12:28.156 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:28.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:28.205 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:12:28.265 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 2020-04-22T14:12:28.265 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:28.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:28.317 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:12:28.393 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:28.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:28.451 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 1' 2020-04-22T14:12:28.530 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-04-22T14:12:28.530 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:28.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:28.574 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.1' 2020-04-22T14:12:28.650 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:28.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:28.696 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0' 2020-04-22T14:12:28.806 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:28.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:28.820 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up' 2020-04-22T14:12:28.941 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:28.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:28.957 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up' 2020-04-22T14:12:29.081 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:29.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:29.110 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254' 2020-04-22T14:12:29.217 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:29.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:29.245 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:12:29.322 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:29.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:29.373 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge-slave con-name brx.1 ifname brx.1 master ceph-brx' 2020-04-22T14:12:29.482 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.1' (daef9b2c-b3ac-4cb8-a7b5-7d42a481ed10) successfully added. 2020-04-22T14:12:29.483 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:29.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:29.511 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up brx.1' 2020-04-22T14:12:29.668 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/29) 2020-04-22T14:12:29.718 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-04-22T14:12:29.719 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi103.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-04-22T14:12:29.719 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:29.740 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:12:29.750 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:12:29.803 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:29.849 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:12:29.849 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:12:29.918 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:12:29.929 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:12:29.929 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:29.974 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:12:29.974 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:12:30.039 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-04-22T14:12:30.040 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:30.086 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:12:30.129 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:30.143 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:12:30.143 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:12:30.212 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:12:30.219 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:12:30.219 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:30.220 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:2020-04-22T14:12:30.217+0000 7f960f13d1c0 -1 init, newargv = 0x55bc5c48a760 newargc=9 2020-04-22T14:12:30.220 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[77745]: starting ceph client 2020-04-22T14:12:30.224 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[77745]: starting fuse 2020-04-22T14:12:30.233 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:12:30.234 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:12:30.293 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:12:30.293 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2020-04-22T14:12:30.293 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:30.341 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:12:30.342 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:12:30.342 INFO:teuthology.orchestra.run.smithi103:> import glob 2020-04-22T14:12:30.342 INFO:teuthology.orchestra.run.smithi103:> import re 2020-04-22T14:12:30.342 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:12:30.342 INFO:teuthology.orchestra.run.smithi103:> import subprocess 2020-04-22T14:12:30.342 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:12:30.342 INFO:teuthology.orchestra.run.smithi103:> def find_socket(client_name): 2020-04-22T14:12:30.342 INFO:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-04-22T14:12:30.343 INFO:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2020-04-22T14:12:30.343 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:12:30.343 INFO:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2020-04-22T14:12:30.343 INFO:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2020-04-22T14:12:30.343 INFO:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2020-04-22T14:12:30.343 INFO:teuthology.orchestra.run.smithi103:> return files[0] 2020-04-22T14:12:30.343 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:12:30.343 INFO:teuthology.orchestra.run.smithi103:> for f in files: 2020-04-22T14:12:30.344 INFO:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:12:30.344 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:12:30.344 INFO:teuthology.orchestra.run.smithi103:> return f 2020-04-22T14:12:30.344 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:12:30.344 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:12:30.344 INFO:teuthology.orchestra.run.smithi103:> print(find_socket("client.0")) 2020-04-22T14:12:30.344 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:12:30.450 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.0.77745.asok 2020-04-22T14:12:30.450 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.77745.asok 2020-04-22T14:12:30.451 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:30.469 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:12:30.469 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.77745.asok status 2020-04-22T14:12:30.629 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:12:30.629 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2020-04-22T14:12:30.629 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:12:30.629 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:12:30.629 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "0", 2020-04-22T14:12:30.629 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:12:30.630 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-04-22T14:12:30.630 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "77745", 2020-04-22T14:12:30.630 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:12:30.630 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:30.630 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2020-04-22T14:12:30.630 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2020-04-22T14:12:30.630 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 5546, 2020-04-22T14:12:30.631 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2020-04-22T14:12:30.631 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:12:30.631 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:12:30.631 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5546 2020-04-22T14:12:30.631 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:30.631 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:12:30.631 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:12:30.631 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:0", 2020-04-22T14:12:30.632 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 3734229525 2020-04-22T14:12:30.632 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:30.632 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:30.632 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:12:30.632 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:12:30.632 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:0", 2020-04-22T14:12:30.632 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 3734229525 2020-04-22T14:12:30.633 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:30.633 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.5546 172.21.15.103:0/3734229525", 2020-04-22T14:12:30.633 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "172.21.15.103:0/3734229525", 2020-04-22T14:12:30.633 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2020-04-22T14:12:30.633 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 50, 2020-04-22T14:12:30.633 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 77, 2020-04-22T14:12:30.633 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2020-04-22T14:12:30.634 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklisted": false 2020-04-22T14:12:30.634 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:12:30.634 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:30.650 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:12:30.651 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-22T14:12:30.651 INFO:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:12:30.711 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2020-04-22T14:12:30.711 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-04-22T14:12:30.711 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:30.759 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:12:30.760 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:12:30.836 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:30.882 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:12:31.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.027+0000 7f49c702d700 1 Processor -- start 2020-04-22T14:12:31.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.027+0000 7f49c702d700 1 -- start start 2020-04-22T14:12:31.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.027+0000 7f49c702d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f49c0065fe0 0x7f49c01464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:31.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.027+0000 7f49c702d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f49c0063e30 0x7f49c00642a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:31.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.027+0000 7f49c702d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49c0143300 con 0x7f49c012c0d0 2020-04-22T14:12:31.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.027+0000 7f49c702d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49c01435a0 con 0x7f49c0063e30 2020-04-22T14:12:31.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.027+0000 7f49c702d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c0143840 con 0x7f49c0065fe0 2020-04-22T14:12:31.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.028+0000 7f49c55ca700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f49c0063e30 0x7f49c00642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:31.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.028+0000 7f49bffff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f49c0065fe0 0x7f49c01464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:31.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.028+0000 7f49c55ca700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f49c0063e30 0x7f49c00642a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:50222/0 (socket says 172.21.15.103:50222) 2020-04-22T14:12:31.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.028+0000 7f49bffff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f49c0065fe0 0x7f49c01464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:37764/0 (socket says 172.21.15.103:37764) 2020-04-22T14:12:31.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.028+0000 7f49c55ca700 1 -- 172.21.15.103:0/1815918333 learned_addr learned my addr 172.21.15.103:0/1815918333 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:31.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.028+0000 7f49bffff700 1 -- 172.21.15.103:0/1815918333 >> v2:172.21.15.86:3300/0 conn(0x7f49c0063e30 msgr2=0x7f49c00642a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:31.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.028+0000 7f49bffff700 1 --2- 172.21.15.103:0/1815918333 >> v2:172.21.15.86:3300/0 conn(0x7f49c0063e30 0x7f49c00642a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:31.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.028+0000 7f49bffff700 1 -- 172.21.15.103:0/1815918333 >> v1:172.21.15.86:6789/0 conn(0x7f49c012c0d0 legacy=0x7f49c005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:31.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.028+0000 7f49bffff700 1 -- 172.21.15.103:0/1815918333 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c005bb50 con 0x7f49c0065fe0 2020-04-22T14:12:31.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.028+0000 7f49bffff700 1 --2- 172.21.15.103:0/1815918333 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f49c0065fe0 0x7f49c01464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f49b4002f30 tx=0x7f49b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.028+0000 7f49bffff700 1 --2- 172.21.15.103:0/1815918333 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f49c0065fe0 0x7f49c01464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f49b4002f30 tx=0x7f49b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.028+0000 7f49bffff700 1 --2- 172.21.15.103:0/1815918333 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f49c0065fe0 0x7f49c01464e0 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7f49b4002f30 tx=0x7f49b4007a40).ready entity=mon.2 client_cookie=ce23ee457953d487 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:31.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.028+0000 7f49bffff700 1 --2- 172.21.15.103:0/1815918333 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f49c0065fe0 0x7f49c01464e0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f49b4002f30 tx=0x7f49b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.028+0000 7f49bf7fe700 1 -- 172.21.15.103:0/1815918333 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49b40113c0 con 0x7f49c0065fe0 2020-04-22T14:12:31.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.028+0000 7f49bffff700 1 --2- 172.21.15.103:0/1815918333 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f49c0065fe0 0x7f49c01464e0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f49b4002f30 tx=0x7f49b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.028+0000 7f49bffff700 1 --2- 172.21.15.103:0/1815918333 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f49c0065fe0 0x7f49c01464e0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f49b4002f30 tx=0x7f49b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.029+0000 7f49bf7fe700 1 -- 172.21.15.103:0/1815918333 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b4011560 con 0x7f49c0065fe0 2020-04-22T14:12:31.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.029+0000 7f49bf7fe700 1 -- 172.21.15.103:0/1815918333 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49b4011980 con 0x7f49c0065fe0 2020-04-22T14:12:31.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.029+0000 7f49c702d700 1 -- 172.21.15.103:0/1815918333 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f49c0065fe0 msgr2=0x7f49c01464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:31.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.029+0000 7f49c702d700 1 --2- 172.21.15.103:0/1815918333 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f49c0065fe0 0x7f49c01464e0 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7f49b4002f30 tx=0x7f49b4007a40).stop 2020-04-22T14:12:31.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.029+0000 7f49c702d700 1 -- 172.21.15.103:0/1815918333 shutdown_connections 2020-04-22T14:12:31.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.029+0000 7f49c702d700 1 --2- 172.21.15.103:0/1815918333 >> v2:172.21.15.86:3300/0 conn(0x7f49c0063e30 0x7f49c00642a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:31.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.029+0000 7f49c702d700 1 --2- 172.21.15.103:0/1815918333 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f49c0065fe0 0x7f49c01464e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:31.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.029+0000 7f49c702d700 1 -- 172.21.15.103:0/1815918333 >> 172.21.15.103:0/1815918333 conn(0x7f49c00b9160 msgr2=0x7f49c005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:31.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.029+0000 7f49c702d700 1 -- 172.21.15.103:0/1815918333 shutdown_connections 2020-04-22T14:12:31.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.029+0000 7f49c702d700 1 -- 172.21.15.103:0/1815918333 wait complete. 2020-04-22T14:12:31.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.030+0000 7f49c702d700 1 Processor -- start 2020-04-22T14:12:31.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.030+0000 7f49c702d700 1 -- start start 2020-04-22T14:12:31.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.031+0000 7f49c702d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f49c0065fe0 0x7f49c0128cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:31.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.031+0000 7f49c702d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f49c012c0d0 0x7f49c00b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:31.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.031+0000 7f49c702d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49c00b5920 con 0x7f49c0063e30 2020-04-22T14:12:31.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.031+0000 7f49c702d700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49c00b1b70 con 0x7f49c0065fe0 2020-04-22T14:12:31.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.031+0000 7f49c702d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c00b1e10 con 0x7f49c012c0d0 2020-04-22T14:12:31.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.031+0000 7f49bffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f49c0065fe0 0x7f49c0128cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:31.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.031+0000 7f49bffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f49c0065fe0 0x7f49c0128cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52996/0 (socket says 172.21.15.103:52996) 2020-04-22T14:12:31.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.031+0000 7f49bffff700 1 -- 172.21.15.103:0/3907382306 learned_addr learned my addr 172.21.15.103:0/3907382306 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:31.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.031+0000 7f49c4dc9700 1 --1- 172.21.15.103:0/3907382306 >> v1:172.21.15.86:6789/0 conn(0x7f49c0063e30 0x7f49c0129630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:34106/0 (socket says 172.21.15.103:34106) 2020-04-22T14:12:31.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.031+0000 7f49c55ca700 1 --2- 172.21.15.103:0/3907382306 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f49c012c0d0 0x7f49c00b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:31.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.031+0000 7f49bffff700 1 -- 172.21.15.103:0/3907382306 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f49c012c0d0 msgr2=0x7f49c00b54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:31.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.031+0000 7f49bdffb700 1 -- 172.21.15.103:0/3907382306 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1248395355 0 0) 0x7f49c0143300 con 0x7f49c0063e30 2020-04-22T14:12:31.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.031+0000 7f49bffff700 1 --2- 172.21.15.103:0/3907382306 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f49c012c0d0 0x7f49c00b54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:31.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.031+0000 7f49bffff700 1 -- 172.21.15.103:0/3907382306 >> v1:172.21.15.86:6789/0 conn(0x7f49c0063e30 legacy=0x7f49c0129630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:31.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.031+0000 7f49bffff700 1 -- 172.21.15.103:0/3907382306 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c00b20b0 con 0x7f49c0065fe0 2020-04-22T14:12:31.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.031+0000 7f49bffff700 1 --2- 172.21.15.103:0/3907382306 >> v2:172.21.15.103:3300/0 conn(0x7f49c0065fe0 0x7f49c0128cf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f49b4002f30 tx=0x7f49b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.031+0000 7f49bffff700 1 --2- 172.21.15.103:0/3907382306 >> v2:172.21.15.103:3300/0 conn(0x7f49c0065fe0 0x7f49c0128cf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f49b4002f30 tx=0x7f49b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.031+0000 7f49bffff700 1 --2- 172.21.15.103:0/3907382306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49c0065fe0 0x7f49c0128cf0 secure :-1 s=READY pgs=1116 cs=0 l=1 rx=0x7f49b4002f30 tx=0x7f49b4007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:31.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.031+0000 7f49bffff700 1 --2- 172.21.15.103:0/3907382306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49c0065fe0 0x7f49c0128cf0 secure :-1 s=THROTTLE_DONE pgs=1116 cs=0 l=1 rx=0x7f49b4002f30 tx=0x7f49b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.031+0000 7f49bdffb700 1 -- 172.21.15.103:0/3907382306 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49b40119e0 con 0x7f49c0065fe0 2020-04-22T14:12:31.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.032+0000 7f49bffff700 1 --2- 172.21.15.103:0/3907382306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49c0065fe0 0x7f49c0128cf0 secure :-1 s=THROTTLE_DONE pgs=1116 cs=0 l=1 rx=0x7f49b4002f30 tx=0x7f49b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.032+0000 7f49bffff700 1 --2- 172.21.15.103:0/3907382306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49c0065fe0 0x7f49c0128cf0 secure :-1 s=THROTTLE_DONE pgs=1116 cs=0 l=1 rx=0x7f49b4002f30 tx=0x7f49b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.032+0000 7f49bdffb700 1 -- 172.21.15.103:0/3907382306 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b4007170 con 0x7f49c0065fe0 2020-04-22T14:12:31.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.032+0000 7f49c702d700 1 -- 172.21.15.103:0/3907382306 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c00b2550 con 0x7f49c0065fe0 2020-04-22T14:12:31.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.032+0000 7f49bdffb700 1 -- 172.21.15.103:0/3907382306 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49b40074d0 con 0x7f49c0065fe0 2020-04-22T14:12:31.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.032+0000 7f49c702d700 1 -- 172.21.15.103:0/3907382306 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c012c910 con 0x7f49c0065fe0 2020-04-22T14:12:31.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.032+0000 7f49bffff700 1 --2- 172.21.15.103:0/3907382306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49c0065fe0 0x7f49c0128cf0 secure :-1 s=THROTTLE_DONE pgs=1116 cs=0 l=1 rx=0x7f49b4002f30 tx=0x7f49b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.033+0000 7f49c702d700 1 -- 172.21.15.103:0/3907382306 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49c0056c90 con 0x7f49c0065fe0 2020-04-22T14:12:31.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.033+0000 7f49bdffb700 1 -- 172.21.15.103:0/3907382306 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f49b40056c0 con 0x7f49c0065fe0 2020-04-22T14:12:31.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.033+0000 7f49bffff700 1 --2- 172.21.15.103:0/3907382306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49c0065fe0 0x7f49c0128cf0 secure :-1 s=THROTTLE_DONE pgs=1116 cs=0 l=1 rx=0x7f49b4002f30 tx=0x7f49b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.033+0000 7f49bdffb700 1 --2- 172.21.15.103:0/3907382306 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f49a004d810 0x7f49a004fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:31.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.033+0000 7f49bdffb700 1 -- 172.21.15.103:0/3907382306 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f49b4061de0 con 0x7f49c0065fe0 2020-04-22T14:12:31.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.033+0000 7f49c4dc9700 1 --2- 172.21.15.103:0/3907382306 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f49a004d810 0x7f49a004fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:31.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.033+0000 7f49c4dc9700 1 --2- 172.21.15.103:0/3907382306 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f49a004d810 0x7f49a004fcd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f49b00011a0 tx=0x7f49b0001720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.034+0000 7f49c4dc9700 1 --2- 172.21.15.103:0/3907382306 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f49a004d810 0x7f49a004fcd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f49b00011a0 tx=0x7f49b0001720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.034+0000 7f49c4dc9700 1 --2- 172.21.15.103:0/3907382306 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f49a004d810 0x7f49a004fcd0 secure :-1 s=READY pgs=413 cs=0 l=1 rx=0x7f49b00011a0 tx=0x7f49b0001720).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:31.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.037+0000 7f49bffff700 1 --2- 172.21.15.103:0/3907382306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49c0065fe0 0x7f49c0128cf0 secure :-1 s=THROTTLE_DONE pgs=1116 cs=0 l=1 rx=0x7f49b4002f30 tx=0x7f49b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.070 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.037+0000 7f49bdffb700 1 -- 172.21.15.103:0/3907382306 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f49b403d2e0 con 0x7f49c0065fe0 2020-04-22T14:12:31.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.179+0000 7f49c702d700 1 -- 172.21.15.103:0/3907382306 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49c0147360 con 0x7f49c0065fe0 2020-04-22T14:12:31.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.179+0000 7f49bffff700 1 --2- 172.21.15.103:0/3907382306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49c0065fe0 0x7f49c0128cf0 secure :-1 s=THROTTLE_DONE pgs=1116 cs=0 l=1 rx=0x7f49b4002f30 tx=0x7f49b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.180+0000 7f49bdffb700 1 -- 172.21.15.103:0/3907382306 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16092 (secure 0 0 0) 0x7f49b4040900 con 0x7f49c0065fe0 2020-04-22T14:12:31.182 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:12:31.182 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":77,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:12:19.875997+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:12:16.799055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2020-04-22T14:12:17.819603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:12:31.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.181+0000 7f49c702d700 1 -- 172.21.15.103:0/3907382306 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f49a004d810 msgr2=0x7f49a004fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:31.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.181+0000 7f49c702d700 1 --2- 172.21.15.103:0/3907382306 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f49a004d810 0x7f49a004fcd0 secure :-1 s=READY pgs=413 cs=0 l=1 rx=0x7f49b00011a0 tx=0x7f49b0001720).stop 2020-04-22T14:12:31.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.181+0000 7f49c702d700 1 -- 172.21.15.103:0/3907382306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49c0065fe0 msgr2=0x7f49c0128cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:31.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.181+0000 7f49c702d700 1 --2- 172.21.15.103:0/3907382306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49c0065fe0 0x7f49c0128cf0 secure :-1 s=READY pgs=1116 cs=0 l=1 rx=0x7f49b4002f30 tx=0x7f49b4007a40).stop 2020-04-22T14:12:31.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.181+0000 7f49c702d700 1 -- 172.21.15.103:0/3907382306 shutdown_connections 2020-04-22T14:12:31.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.181+0000 7f49c702d700 1 --2- 172.21.15.103:0/3907382306 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f49a004d810 0x7f49a004fcd0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:31.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.181+0000 7f49c702d700 1 --2- 172.21.15.103:0/3907382306 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f49c012c0d0 0x7f49c00b54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:31.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.181+0000 7f49c702d700 1 --2- 172.21.15.103:0/3907382306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49c0065fe0 0x7f49c0128cf0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:31.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.181+0000 7f49c702d700 1 -- 172.21.15.103:0/3907382306 >> 172.21.15.103:0/3907382306 conn(0x7f49c00b9160 msgr2=0x7f49c0062a90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:31.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.181+0000 7f49c702d700 1 -- 172.21.15.103:0/3907382306 shutdown_connections 2020-04-22T14:12:31.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.181+0000 7f49c702d700 1 -- 172.21.15.103:0/3907382306 wait complete. 2020-04-22T14:12:31.194 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:12:16.799055+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 13, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'76', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:12:17.819603+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 14, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'77', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:12:31.194 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:31.208 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:12:31.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.355+0000 7fd37b544700 1 Processor -- start 2020-04-22T14:12:31.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.355+0000 7fd37b544700 1 -- start start 2020-04-22T14:12:31.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.356+0000 7fd37b544700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd3740b9140 0x7fd37412b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:31.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.356+0000 7fd37b544700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3741467e0 con 0x7fd37412b670 2020-04-22T14:12:31.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.356+0000 7fd37b544700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd374060050 con 0x7fd3740ac950 2020-04-22T14:12:31.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.356+0000 7fd37b544700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3740602f0 con 0x7fd3740b9140 2020-04-22T14:12:31.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.356+0000 7fd378adf700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd3740ac950 0x7fd374146c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45190/0 (socket says 172.21.15.103:45190) 2020-04-22T14:12:31.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.356+0000 7fd378adf700 1 -- 172.21.15.103:0/43684668 learned_addr learned my addr 172.21.15.103:0/43684668 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:31.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.356+0000 7fd3792e0700 1 --2- 172.21.15.103:0/43684668 >> v2:172.21.15.86:3300/0 conn(0x7fd3740b9140 0x7fd37412b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:31.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.356+0000 7fd367fff700 1 -- 172.21.15.103:0/43684668 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 237638088 0 0) 0x7fd374060050 con 0x7fd3740ac950 2020-04-22T14:12:31.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.356+0000 7fd367fff700 1 -- 172.21.15.103:0/43684668 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd35c003230 con 0x7fd3740ac950 2020-04-22T14:12:31.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.356+0000 7fd367fff700 1 -- 172.21.15.103:0/43684668 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3254119137 0 0) 0x7fd35c003230 con 0x7fd3740ac950 2020-04-22T14:12:31.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.356+0000 7fd367fff700 1 -- 172.21.15.103:0/43684668 >> v2:172.21.15.86:3300/0 conn(0x7fd3740b9140 msgr2=0x7fd37412b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:31.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.356+0000 7fd367fff700 1 --2- 172.21.15.103:0/43684668 >> v2:172.21.15.86:3300/0 conn(0x7fd3740b9140 0x7fd37412b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:31.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.356+0000 7fd367fff700 1 -- 172.21.15.103:0/43684668 >> v1:172.21.15.86:6789/0 conn(0x7fd37412b670 legacy=0x7fd374143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:31.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.356+0000 7fd367fff700 1 -- 172.21.15.103:0/43684668 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3740b9520 con 0x7fd3740ac950 2020-04-22T14:12:31.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.356+0000 7fd367fff700 1 -- 172.21.15.103:0/43684668 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fd368001710 con 0x7fd3740ac950 2020-04-22T14:12:31.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.356+0000 7fd367fff700 1 -- 172.21.15.103:0/43684668 >> v1:172.21.15.103:6789/0 conn(0x7fd3740ac950 legacy=0x7fd374146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:31.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.356+0000 7fd367fff700 1 --2- 172.21.15.103:0/43684668 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd35c003720 0x7fd35c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:31.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.356+0000 7fd367fff700 1 --2- 172.21.15.103:0/43684668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd35c0044d0 0x7fd35c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:31.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.357+0000 7fd367fff700 1 --2- 172.21.15.103:0/43684668 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd35c004db0 0x7fd35c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:31.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.357+0000 7fd367fff700 1 -- 172.21.15.103:0/43684668 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3740602f0 con 0x7fd35c004db0 2020-04-22T14:12:31.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.357+0000 7fd367fff700 1 -- 172.21.15.103:0/43684668 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35c0041c0 con 0x7fd35c0044d0 2020-04-22T14:12:31.378 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.357+0000 7fd367fff700 1 -- 172.21.15.103:0/43684668 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd35c00bb80 con 0x7fd35c003720 2020-04-22T14:12:31.378 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.357+0000 7fd3792e0700 1 --2- 172.21.15.103:0/43684668 >> v2:172.21.15.86:3300/0 conn(0x7fd3740b9140 0x7fd37412b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:12:31.378 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.357+0000 7fd378adf700 1 --2- 172.21.15.103:0/43684668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd35c0044d0 0x7fd35c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:31.378 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.357+0000 7fd379ae1700 1 --2- 172.21.15.103:0/43684668 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd35c004db0 0x7fd35c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:31.378 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.357+0000 7fd3792e0700 1 --2- 172.21.15.103:0/43684668 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd35c003720 0x7fd35c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:31.378 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.357+0000 7fd378adf700 1 -- 172.21.15.103:0/43684668 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd35c003720 msgr2=0x7fd35c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:31.378 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.357+0000 7fd378adf700 1 --2- 172.21.15.103:0/43684668 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd35c003720 0x7fd35c003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:31.379 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.357+0000 7fd378adf700 1 -- 172.21.15.103:0/43684668 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd35c004db0 msgr2=0x7fd35c00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:31.379 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.357+0000 7fd378adf700 1 --2- 172.21.15.103:0/43684668 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd35c004db0 0x7fd35c00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:31.379 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.357+0000 7fd378adf700 1 -- 172.21.15.103:0/43684668 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd35c003230 con 0x7fd35c0044d0 2020-04-22T14:12:31.379 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.357+0000 7fd379ae1700 1 -- 172.21.15.103:0/43684668 reap_dead start 2020-04-22T14:12:31.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.357+0000 7fd3792e0700 1 --2- 172.21.15.103:0/43684668 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd35c003720 0x7fd35c003b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:12:31.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.357+0000 7fd378adf700 1 --2- 172.21.15.103:0/43684668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd35c0044d0 0x7fd35c004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd35c0054a0 tx=0x7fd3740b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.357+0000 7fd378adf700 1 --2- 172.21.15.103:0/43684668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd35c0044d0 0x7fd35c004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd35c0054a0 tx=0x7fd3740b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.357+0000 7fd378adf700 1 --2- 172.21.15.103:0/43684668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd35c0044d0 0x7fd35c004950 secure :-1 s=READY pgs=1118 cs=0 l=1 rx=0x7fd35c0054a0 tx=0x7fd3740b96b0).ready entity=mon.1 client_cookie=7f9571fada882eab server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:31.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.357+0000 7fd378adf700 1 --2- 172.21.15.103:0/43684668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd35c0044d0 0x7fd35c004950 secure :-1 s=THROTTLE_DONE pgs=1118 cs=0 l=1 rx=0x7fd35c0054a0 tx=0x7fd3740b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.357+0000 7fd367fff700 1 -- 172.21.15.103:0/43684668 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd368010370 con 0x7fd35c0044d0 2020-04-22T14:12:31.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.357+0000 7fd378adf700 1 --2- 172.21.15.103:0/43684668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd35c0044d0 0x7fd35c004950 secure :-1 s=THROTTLE_DONE pgs=1118 cs=0 l=1 rx=0x7fd35c0054a0 tx=0x7fd3740b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.357+0000 7fd378adf700 1 --2- 172.21.15.103:0/43684668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd35c0044d0 0x7fd35c004950 secure :-1 s=THROTTLE_DONE pgs=1118 cs=0 l=1 rx=0x7fd35c0054a0 tx=0x7fd3740b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.357+0000 7fd367fff700 1 -- 172.21.15.103:0/43684668 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3680104d0 con 0x7fd35c0044d0 2020-04-22T14:12:31.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.357+0000 7fd367fff700 1 -- 172.21.15.103:0/43684668 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3680108b0 con 0x7fd35c0044d0 2020-04-22T14:12:31.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.357+0000 7fd37b544700 1 -- 172.21.15.103:0/43684668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd35c0044d0 msgr2=0x7fd35c004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:31.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.357+0000 7fd37b544700 1 --2- 172.21.15.103:0/43684668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd35c0044d0 0x7fd35c004950 secure :-1 s=READY pgs=1118 cs=0 l=1 rx=0x7fd35c0054a0 tx=0x7fd3740b96b0).stop 2020-04-22T14:12:31.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.358+0000 7fd37b544700 1 -- 172.21.15.103:0/43684668 shutdown_connections 2020-04-22T14:12:31.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.358+0000 7fd37b544700 1 --2- 172.21.15.103:0/43684668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd35c0044d0 0x7fd35c004950 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:31.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.358+0000 7fd37b544700 1 -- 172.21.15.103:0/43684668 >> 172.21.15.103:0/43684668 conn(0x7fd37405b7b0 msgr2=0x7fd3740b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:31.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.358+0000 7fd37b544700 1 -- 172.21.15.103:0/43684668 shutdown_connections 2020-04-22T14:12:31.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.358+0000 7fd37b544700 1 -- 172.21.15.103:0/43684668 wait complete. 2020-04-22T14:12:31.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.359+0000 7fd37b544700 1 Processor -- start 2020-04-22T14:12:31.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.359+0000 7fd37b544700 1 -- start start 2020-04-22T14:12:31.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.359+0000 7fd37b544700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd3741436e0 0x7fd3740b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:31.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.359+0000 7fd37b544700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd3741540d0 0x7fd3741544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:31.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.359+0000 7fd37b544700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd374065e30 con 0x7fd35c0044d0 2020-04-22T14:12:31.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.359+0000 7fd37b544700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd374065c40 con 0x7fd3741436e0 2020-04-22T14:12:31.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.359+0000 7fd37b544700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3740b1790 con 0x7fd3741540d0 2020-04-22T14:12:31.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.360+0000 7fd3792e0700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd35c0044d0 0x7fd374142fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45202/0 (socket says 172.21.15.103:45202) 2020-04-22T14:12:31.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.360+0000 7fd3792e0700 1 -- 172.21.15.103:0/480588816 learned_addr learned my addr 172.21.15.103:0/480588816 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:31.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.360+0000 7fd379ae1700 1 --2- 172.21.15.103:0/480588816 >> v2:172.21.15.103:3300/0 conn(0x7fd3741540d0 0x7fd3741544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:31.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.360+0000 7fd378adf700 1 --2- 172.21.15.103:0/480588816 >> v2:172.21.15.86:3300/0 conn(0x7fd3741436e0 0x7fd3740b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:31.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.360+0000 7fd379ae1700 1 -- 172.21.15.103:0/480588816 >> v2:172.21.15.86:3300/0 conn(0x7fd3741436e0 msgr2=0x7fd3740b5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:31.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.360+0000 7fd379ae1700 1 --2- 172.21.15.103:0/480588816 >> v2:172.21.15.86:3300/0 conn(0x7fd3741436e0 0x7fd3740b5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:31.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.360+0000 7fd3667fc700 1 -- 172.21.15.103:0/480588816 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4126306417 0 0) 0x7fd374065e30 con 0x7fd35c0044d0 2020-04-22T14:12:31.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.360+0000 7fd379ae1700 1 -- 172.21.15.103:0/480588816 >> v1:172.21.15.103:6789/0 conn(0x7fd35c0044d0 legacy=0x7fd374142fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:31.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.360+0000 7fd379ae1700 1 -- 172.21.15.103:0/480588816 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3740660d0 con 0x7fd3741540d0 2020-04-22T14:12:31.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.360+0000 7fd379ae1700 1 --2- 172.21.15.103:0/480588816 >> v2:172.21.15.103:3300/0 conn(0x7fd3741540d0 0x7fd3741544f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd3740ae680 tx=0x7fd370003e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.360+0000 7fd379ae1700 1 --2- 172.21.15.103:0/480588816 >> v2:172.21.15.103:3300/0 conn(0x7fd3741540d0 0x7fd3741544f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd3740ae680 tx=0x7fd370003e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.360+0000 7fd379ae1700 1 --2- 172.21.15.103:0/480588816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3741540d0 0x7fd3741544f0 secure :-1 s=READY pgs=1120 cs=0 l=1 rx=0x7fd3740ae680 tx=0x7fd370003e80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:31.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.360+0000 7fd379ae1700 1 --2- 172.21.15.103:0/480588816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3741540d0 0x7fd3741544f0 secure :-1 s=THROTTLE_DONE pgs=1120 cs=0 l=1 rx=0x7fd3740ae680 tx=0x7fd370003e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.360+0000 7fd3667fc700 1 -- 172.21.15.103:0/480588816 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd370001e60 con 0x7fd3741540d0 2020-04-22T14:12:31.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.360+0000 7fd379ae1700 1 --2- 172.21.15.103:0/480588816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3741540d0 0x7fd3741544f0 secure :-1 s=THROTTLE_DONE pgs=1120 cs=0 l=1 rx=0x7fd3740ae680 tx=0x7fd370003e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.360+0000 7fd379ae1700 1 --2- 172.21.15.103:0/480588816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3741540d0 0x7fd3741544f0 secure :-1 s=THROTTLE_DONE pgs=1120 cs=0 l=1 rx=0x7fd3740ae680 tx=0x7fd370003e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.360+0000 7fd3667fc700 1 -- 172.21.15.103:0/480588816 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd370001190 con 0x7fd3741540d0 2020-04-22T14:12:31.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.360+0000 7fd3667fc700 1 -- 172.21.15.103:0/480588816 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd37000ca00 con 0x7fd3741540d0 2020-04-22T14:12:31.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.360+0000 7fd37b544700 1 -- 172.21.15.103:0/480588816 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd374066570 con 0x7fd3741540d0 2020-04-22T14:12:31.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.360+0000 7fd37b544700 1 -- 172.21.15.103:0/480588816 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd374154b90 con 0x7fd3741540d0 2020-04-22T14:12:31.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.361+0000 7fd379ae1700 1 --2- 172.21.15.103:0/480588816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3741540d0 0x7fd3741544f0 secure :-1 s=THROTTLE_DONE pgs=1120 cs=0 l=1 rx=0x7fd3740ae680 tx=0x7fd370003e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.361+0000 7fd3667fc700 1 -- 172.21.15.103:0/480588816 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fd37000cb60 con 0x7fd3741540d0 2020-04-22T14:12:31.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.361+0000 7fd379ae1700 1 --2- 172.21.15.103:0/480588816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3741540d0 0x7fd3741544f0 secure :-1 s=THROTTLE_DONE pgs=1120 cs=0 l=1 rx=0x7fd3740ae680 tx=0x7fd370003e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.361+0000 7fd37b544700 1 -- 172.21.15.103:0/480588816 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd374066260 con 0x7fd3741540d0 2020-04-22T14:12:31.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.361+0000 7fd3667fc700 1 --2- 172.21.15.103:0/480588816 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd35404d890 0x7fd35404fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:31.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.361+0000 7fd3667fc700 1 -- 172.21.15.103:0/480588816 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd370060bd0 con 0x7fd3741540d0 2020-04-22T14:12:31.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.362+0000 7fd3792e0700 1 --2- 172.21.15.103:0/480588816 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd35404d890 0x7fd35404fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:31.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.362+0000 7fd3792e0700 1 --2- 172.21.15.103:0/480588816 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd35404d890 0x7fd35404fd50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd36c008320 tx=0x7fd36c00ce00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.362+0000 7fd3792e0700 1 --2- 172.21.15.103:0/480588816 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd35404d890 0x7fd35404fd50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd36c008320 tx=0x7fd36c00ce00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.362+0000 7fd3792e0700 1 --2- 172.21.15.103:0/480588816 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd35404d890 0x7fd35404fd50 secure :-1 s=READY pgs=414 cs=0 l=1 rx=0x7fd36c008320 tx=0x7fd36c00ce00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:31.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.365+0000 7fd379ae1700 1 --2- 172.21.15.103:0/480588816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3741540d0 0x7fd3741544f0 secure :-1 s=THROTTLE_DONE pgs=1120 cs=0 l=1 rx=0x7fd3740ae680 tx=0x7fd370003e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.365+0000 7fd3667fc700 1 -- 172.21.15.103:0/480588816 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fd37003bf50 con 0x7fd3741540d0 2020-04-22T14:12:31.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.508+0000 7fd37b544700 1 -- 172.21.15.103:0/480588816 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd374056c90 con 0x7fd3741540d0 2020-04-22T14:12:31.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.509+0000 7fd379ae1700 1 --2- 172.21.15.103:0/480588816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3741540d0 0x7fd3741544f0 secure :-1 s=THROTTLE_DONE pgs=1120 cs=0 l=1 rx=0x7fd3740ae680 tx=0x7fd370003e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.509+0000 7fd3667fc700 1 -- 172.21.15.103:0/480588816 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v77) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd37003f570 con 0x7fd3741540d0 2020-04-22T14:12:31.511 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:12:31.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.510+0000 7fd37b544700 1 -- 172.21.15.103:0/480588816 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd35404d890 msgr2=0x7fd35404fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:31.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.510+0000 7fd37b544700 1 --2- 172.21.15.103:0/480588816 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd35404d890 0x7fd35404fd50 secure :-1 s=READY pgs=414 cs=0 l=1 rx=0x7fd36c008320 tx=0x7fd36c00ce00).stop 2020-04-22T14:12:31.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.510+0000 7fd37b544700 1 -- 172.21.15.103:0/480588816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3741540d0 msgr2=0x7fd3741544f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:31.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.510+0000 7fd37b544700 1 --2- 172.21.15.103:0/480588816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3741540d0 0x7fd3741544f0 secure :-1 s=READY pgs=1120 cs=0 l=1 rx=0x7fd3740ae680 tx=0x7fd370003e80).stop 2020-04-22T14:12:31.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.510+0000 7fd37b544700 1 -- 172.21.15.103:0/480588816 shutdown_connections 2020-04-22T14:12:31.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.510+0000 7fd37b544700 1 --2- 172.21.15.103:0/480588816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3741540d0 0x7fd3741544f0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:31.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.510+0000 7fd37b544700 1 --2- 172.21.15.103:0/480588816 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd35404d890 0x7fd35404fd50 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:31.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.510+0000 7fd37b544700 1 --2- 172.21.15.103:0/480588816 >> v2:172.21.15.86:3300/0 conn(0x7fd3741436e0 0x7fd3740b5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:31.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.510+0000 7fd37b544700 1 -- 172.21.15.103:0/480588816 >> 172.21.15.103:0/480588816 conn(0x7fd37405b7b0 msgr2=0x7fd374127890 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:31.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.510+0000 7fd37b544700 1 -- 172.21.15.103:0/480588816 shutdown_connections 2020-04-22T14:12:31.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.510+0000 7fd37b544700 1 -- 172.21.15.103:0/480588816 wait complete. 2020-04-22T14:12:31.522 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:31.536 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:12:31.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.684+0000 7f51d6f3f700 1 Processor -- start 2020-04-22T14:12:31.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.684+0000 7f51d6f3f700 1 -- start start 2020-04-22T14:12:31.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.685+0000 7f51d6f3f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f51d00ac950 0x7f51d0146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:31.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.685+0000 7f51d6f3f700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51d01467e0 con 0x7f51d01470a0 2020-04-22T14:12:31.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.685+0000 7f51d6f3f700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51d0060050 con 0x7f51d00b9140 2020-04-22T14:12:31.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.685+0000 7f51d6f3f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d00602f0 con 0x7f51d00ac950 2020-04-22T14:12:31.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.685+0000 7f51d4cdb700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f51d00b9140 0x7f51d012b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45210/0 (socket says 172.21.15.103:45210) 2020-04-22T14:12:31.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.685+0000 7f51d4cdb700 1 -- 172.21.15.103:0/2187883962 learned_addr learned my addr 172.21.15.103:0/2187883962 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:31.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.685+0000 7f51cffff700 1 --2- 172.21.15.103:0/2187883962 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f51d00ac950 0x7f51d0146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:31.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.685+0000 7f51cf7fe700 1 -- 172.21.15.103:0/2187883962 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3252567399 0 0) 0x7f51d0060050 con 0x7f51d00b9140 2020-04-22T14:12:31.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.685+0000 7f51cf7fe700 1 -- 172.21.15.103:0/2187883962 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51bc003230 con 0x7f51d00b9140 2020-04-22T14:12:31.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.685+0000 7f51cf7fe700 1 -- 172.21.15.103:0/2187883962 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 118818156 0 0) 0x7f51d01467e0 con 0x7f51d01470a0 2020-04-22T14:12:31.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.685+0000 7f51cf7fe700 1 -- 172.21.15.103:0/2187883962 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51d0060050 con 0x7f51d01470a0 2020-04-22T14:12:31.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.685+0000 7f51cffff700 1 -- 172.21.15.103:0/2187883962 >> v1:172.21.15.103:6789/0 conn(0x7f51d00b9140 legacy=0x7f51d012b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:31.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.685+0000 7f51cffff700 1 -- 172.21.15.103:0/2187883962 >> v1:172.21.15.86:6789/0 conn(0x7f51d01470a0 legacy=0x7f51d0143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:31.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.685+0000 7f51cffff700 1 -- 172.21.15.103:0/2187883962 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d00b9520 con 0x7f51d00ac950 2020-04-22T14:12:31.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.685+0000 7f51cffff700 1 --2- 172.21.15.103:0/2187883962 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f51d00ac950 0x7f51d0146c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f51c4002f30 tx=0x7f51c40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.685+0000 7f51cffff700 1 --2- 172.21.15.103:0/2187883962 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f51d00ac950 0x7f51d0146c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f51c4002f30 tx=0x7f51c40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.685+0000 7f51cffff700 1 --2- 172.21.15.103:0/2187883962 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f51d00ac950 0x7f51d0146c40 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7f51c4002f30 tx=0x7f51c40088e0).ready entity=mon.2 client_cookie=4a01c1104a4e5122 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:31.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.686+0000 7f51cffff700 1 --2- 172.21.15.103:0/2187883962 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f51d00ac950 0x7f51d0146c40 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f51c4002f30 tx=0x7f51c40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.686+0000 7f51cf7fe700 1 -- 172.21.15.103:0/2187883962 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51c4008e40 con 0x7f51d00ac950 2020-04-22T14:12:31.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.686+0000 7f51cffff700 1 --2- 172.21.15.103:0/2187883962 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f51d00ac950 0x7f51d0146c40 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f51c4002f30 tx=0x7f51c40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.686+0000 7f51cffff700 1 --2- 172.21.15.103:0/2187883962 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f51d00ac950 0x7f51d0146c40 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f51c4002f30 tx=0x7f51c40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.686+0000 7f51cf7fe700 1 -- 172.21.15.103:0/2187883962 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c4011540 con 0x7f51d00ac950 2020-04-22T14:12:31.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.686+0000 7f51cf7fe700 1 -- 172.21.15.103:0/2187883962 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51c4011920 con 0x7f51d00ac950 2020-04-22T14:12:31.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.686+0000 7f51d6f3f700 1 -- 172.21.15.103:0/2187883962 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f51d00ac950 msgr2=0x7f51d0146c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:31.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.686+0000 7f51d6f3f700 1 --2- 172.21.15.103:0/2187883962 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f51d00ac950 0x7f51d0146c40 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7f51c4002f30 tx=0x7f51c40088e0).stop 2020-04-22T14:12:31.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.686+0000 7f51d6f3f700 1 -- 172.21.15.103:0/2187883962 shutdown_connections 2020-04-22T14:12:31.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.686+0000 7f51d6f3f700 1 --2- 172.21.15.103:0/2187883962 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f51d00ac950 0x7f51d0146c40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:31.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.686+0000 7f51d6f3f700 1 -- 172.21.15.103:0/2187883962 >> 172.21.15.103:0/2187883962 conn(0x7f51d005b7b0 msgr2=0x7f51d00b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:31.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.686+0000 7f51d6f3f700 1 -- 172.21.15.103:0/2187883962 shutdown_connections 2020-04-22T14:12:31.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.686+0000 7f51d6f3f700 1 -- 172.21.15.103:0/2187883962 wait complete. 2020-04-22T14:12:31.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.687+0000 7f51d6f3f700 1 Processor -- start 2020-04-22T14:12:31.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.687+0000 7f51d6f3f700 1 -- start start 2020-04-22T14:12:31.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.688+0000 7f51d6f3f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f51d00ac950 0x7f51d0142a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:31.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.688+0000 7f51d6f3f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f51d01470a0 0x7f51d00b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:31.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.688+0000 7f51d6f3f700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51d00b0ed0 con 0x7f51d00b9140 2020-04-22T14:12:31.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.688+0000 7f51d6f3f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51d00b1170 con 0x7f51d00ac950 2020-04-22T14:12:31.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.688+0000 7f51d6f3f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d00b1410 con 0x7f51d01470a0 2020-04-22T14:12:31.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.688+0000 7f51d4cdb700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f51d00ac950 0x7f51d0142a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:31.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.688+0000 7f51cffff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f51d00b9140 0x7f51d0145080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45218/0 (socket says 172.21.15.103:45218) 2020-04-22T14:12:31.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.688+0000 7f51cffff700 1 -- 172.21.15.103:0/3647019951 learned_addr learned my addr 172.21.15.103:0/3647019951 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:31.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.688+0000 7f51d54dc700 1 --2- 172.21.15.103:0/3647019951 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f51d01470a0 0x7f51d00b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:31.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.688+0000 7f51d4cdb700 1 -- 172.21.15.103:0/3647019951 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f51d01470a0 msgr2=0x7f51d00b55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:31.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.688+0000 7f51d4cdb700 1 --2- 172.21.15.103:0/3647019951 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f51d01470a0 0x7f51d00b55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:31.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.688+0000 7f51d4cdb700 1 -- 172.21.15.103:0/3647019951 >> v1:172.21.15.103:6789/0 conn(0x7f51d00b9140 legacy=0x7f51d0145080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:31.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.688+0000 7f51d4cdb700 1 -- 172.21.15.103:0/3647019951 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d0151810 con 0x7f51d00ac950 2020-04-22T14:12:31.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.688+0000 7f51cdffb700 1 -- 172.21.15.103:0/3647019951 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3317129159 0 0) 0x7f51d00b0ed0 con 0x7f51d00b9140 2020-04-22T14:12:31.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.688+0000 7f51d54dc700 1 --2- 172.21.15.103:0/3647019951 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f51d01470a0 0x7f51d00b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:12:31.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.688+0000 7f51d4cdb700 1 --2- 172.21.15.103:0/3647019951 >> v2:172.21.15.103:3300/0 conn(0x7f51d00ac950 0x7f51d0142a70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f51c8001450 tx=0x7f51c8010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.688+0000 7f51d4cdb700 1 --2- 172.21.15.103:0/3647019951 >> v2:172.21.15.103:3300/0 conn(0x7f51d00ac950 0x7f51d0142a70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f51c8001450 tx=0x7f51c8010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.688+0000 7f51d4cdb700 1 --2- 172.21.15.103:0/3647019951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51d00ac950 0x7f51d0142a70 secure :-1 s=READY pgs=1123 cs=0 l=1 rx=0x7f51c8001450 tx=0x7f51c8010ce0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:31.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.689+0000 7f51d4cdb700 1 --2- 172.21.15.103:0/3647019951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51d00ac950 0x7f51d0142a70 secure :-1 s=THROTTLE_DONE pgs=1123 cs=0 l=1 rx=0x7f51c8001450 tx=0x7f51c8010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.689+0000 7f51cdffb700 1 -- 172.21.15.103:0/3647019951 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51c8005e50 con 0x7f51d00ac950 2020-04-22T14:12:31.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.689+0000 7f51d4cdb700 1 --2- 172.21.15.103:0/3647019951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51d00ac950 0x7f51d0142a70 secure :-1 s=THROTTLE_DONE pgs=1123 cs=0 l=1 rx=0x7f51c8001450 tx=0x7f51c8010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.689+0000 7f51d4cdb700 1 --2- 172.21.15.103:0/3647019951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51d00ac950 0x7f51d0142a70 secure :-1 s=THROTTLE_DONE pgs=1123 cs=0 l=1 rx=0x7f51c8001450 tx=0x7f51c8010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.689+0000 7f51cdffb700 1 -- 172.21.15.103:0/3647019951 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c8012570 con 0x7f51d00ac950 2020-04-22T14:12:31.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.689+0000 7f51cdffb700 1 -- 172.21.15.103:0/3647019951 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51c8012910 con 0x7f51d00ac950 2020-04-22T14:12:31.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.689+0000 7f51d6f3f700 1 -- 172.21.15.103:0/3647019951 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51d0151ac0 con 0x7f51d00ac950 2020-04-22T14:12:31.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.689+0000 7f51d6f3f700 1 -- 172.21.15.103:0/3647019951 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51d0154530 con 0x7f51d00ac950 2020-04-22T14:12:31.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.689+0000 7f51d4cdb700 1 --2- 172.21.15.103:0/3647019951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51d00ac950 0x7f51d0142a70 secure :-1 s=THROTTLE_DONE pgs=1123 cs=0 l=1 rx=0x7f51c8001450 tx=0x7f51c8010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.690+0000 7f51d6f3f700 1 -- 172.21.15.103:0/3647019951 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51d0154bc0 con 0x7f51d00ac950 2020-04-22T14:12:31.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.690+0000 7f51cdffb700 1 -- 172.21.15.103:0/3647019951 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f51c8012a70 con 0x7f51d00ac950 2020-04-22T14:12:31.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.690+0000 7f51d4cdb700 1 --2- 172.21.15.103:0/3647019951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51d00ac950 0x7f51d0142a70 secure :-1 s=THROTTLE_DONE pgs=1123 cs=0 l=1 rx=0x7f51c8001450 tx=0x7f51c8010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.690+0000 7f51cdffb700 1 --2- 172.21.15.103:0/3647019951 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f51b004d950 0x7f51b004fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:31.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.690+0000 7f51cdffb700 1 -- 172.21.15.103:0/3647019951 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f51c80090c0 con 0x7f51d00ac950 2020-04-22T14:12:31.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.690+0000 7f51cffff700 1 --2- 172.21.15.103:0/3647019951 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f51b004d950 0x7f51b004fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:31.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.691+0000 7f51cffff700 1 --2- 172.21.15.103:0/3647019951 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f51b004d950 0x7f51b004fe10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f51c4008320 tx=0x7f51d00b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.691+0000 7f51cffff700 1 --2- 172.21.15.103:0/3647019951 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f51b004d950 0x7f51b004fe10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f51c4008320 tx=0x7f51d00b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.691+0000 7f51cffff700 1 --2- 172.21.15.103:0/3647019951 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f51b004d950 0x7f51b004fe10 secure :-1 s=READY pgs=415 cs=0 l=1 rx=0x7f51c4008320 tx=0x7f51d00b96b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:31.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.694+0000 7f51d4cdb700 1 --2- 172.21.15.103:0/3647019951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51d00ac950 0x7f51d0142a70 secure :-1 s=THROTTLE_DONE pgs=1123 cs=0 l=1 rx=0x7f51c8001450 tx=0x7f51c8010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.694+0000 7f51cdffb700 1 -- 172.21.15.103:0/3647019951 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f51c803cf70 con 0x7f51d00ac950 2020-04-22T14:12:31.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.836+0000 7f51d6f3f700 1 -- 172.21.15.103:0/3647019951 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f51d0056c90 con 0x7f51d00ac950 2020-04-22T14:12:31.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.836+0000 7f51d4cdb700 1 --2- 172.21.15.103:0/3647019951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51d00ac950 0x7f51d0142a70 secure :-1 s=THROTTLE_DONE pgs=1123 cs=0 l=1 rx=0x7f51c8001450 tx=0x7f51c8010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:31.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.836+0000 7f51cdffb700 1 -- 172.21.15.103:0/3647019951 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v77) v1 ==== 92+0+10 (secure 0 0 0) 0x7f51c8040590 con 0x7f51d00ac950 2020-04-22T14:12:31.839 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:12:31.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.837+0000 7f51d6f3f700 1 -- 172.21.15.103:0/3647019951 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f51b004d950 msgr2=0x7f51b004fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:31.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.837+0000 7f51d6f3f700 1 --2- 172.21.15.103:0/3647019951 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f51b004d950 0x7f51b004fe10 secure :-1 s=READY pgs=415 cs=0 l=1 rx=0x7f51c4008320 tx=0x7f51d00b96b0).stop 2020-04-22T14:12:31.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.837+0000 7f51d6f3f700 1 -- 172.21.15.103:0/3647019951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51d00ac950 msgr2=0x7f51d0142a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:31.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.837+0000 7f51d6f3f700 1 --2- 172.21.15.103:0/3647019951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51d00ac950 0x7f51d0142a70 secure :-1 s=READY pgs=1123 cs=0 l=1 rx=0x7f51c8001450 tx=0x7f51c8010ce0).stop 2020-04-22T14:12:31.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.838+0000 7f51d6f3f700 1 -- 172.21.15.103:0/3647019951 shutdown_connections 2020-04-22T14:12:31.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.838+0000 7f51d6f3f700 1 --2- 172.21.15.103:0/3647019951 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f51b004d950 0x7f51b004fe10 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:31.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.838+0000 7f51d6f3f700 1 --2- 172.21.15.103:0/3647019951 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f51d01470a0 0x7f51d00b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:31.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.838+0000 7f51d6f3f700 1 --2- 172.21.15.103:0/3647019951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51d00ac950 0x7f51d0142a70 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:31.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.838+0000 7f51d6f3f700 1 -- 172.21.15.103:0/3647019951 >> 172.21.15.103:0/3647019951 conn(0x7f51d005b7b0 msgr2=0x7f51d00b67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:31.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.838+0000 7f51d6f3f700 1 -- 172.21.15.103:0/3647019951 shutdown_connections 2020-04-22T14:12:31.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:31.838+0000 7f51d6f3f700 1 -- 172.21.15.103:0/3647019951 wait complete. 2020-04-22T14:12:31.850 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:31.863 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-22T14:12:32.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.009+0000 7f36a4836700 1 Processor -- start 2020-04-22T14:12:32.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.009+0000 7f36a4836700 1 -- start start 2020-04-22T14:12:32.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.010+0000 7f36a4836700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f36a00b9140 0x7f36a012b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:32.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.010+0000 7f36a4836700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a01467e0 con 0x7f36a012b670 2020-04-22T14:12:32.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.010+0000 7f36a4836700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a0060050 con 0x7f36a00ac950 2020-04-22T14:12:32.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.010+0000 7f36a4836700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36a00602f0 con 0x7f36a00b9140 2020-04-22T14:12:32.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.010+0000 7f369dd9b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f36a00ac950 0x7f36a0146c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45228/0 (socket says 172.21.15.103:45228) 2020-04-22T14:12:32.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.010+0000 7f369dd9b700 1 -- 172.21.15.103:0/3768089502 learned_addr learned my addr 172.21.15.103:0/3768089502 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:32.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.011+0000 7f369e59c700 1 --2- 172.21.15.103:0/3768089502 >> v2:172.21.15.86:3300/0 conn(0x7f36a00b9140 0x7f36a012b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:32.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.011+0000 7f369d59a700 1 -- 172.21.15.103:0/3768089502 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 330325745 0 0) 0x7f36a0060050 con 0x7f36a00ac950 2020-04-22T14:12:32.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.011+0000 7f369d59a700 1 -- 172.21.15.103:0/3768089502 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3684003230 con 0x7f36a00ac950 2020-04-22T14:12:32.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.011+0000 7f369d59a700 1 -- 172.21.15.103:0/3768089502 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1380214935 0 0) 0x7f3684003230 con 0x7f36a00ac950 2020-04-22T14:12:32.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.011+0000 7f369d59a700 1 -- 172.21.15.103:0/3768089502 >> v2:172.21.15.86:3300/0 conn(0x7f36a00b9140 msgr2=0x7f36a012b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:32.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.011+0000 7f369d59a700 1 --2- 172.21.15.103:0/3768089502 >> v2:172.21.15.86:3300/0 conn(0x7f36a00b9140 0x7f36a012b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:32.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.011+0000 7f369d59a700 1 -- 172.21.15.103:0/3768089502 >> v1:172.21.15.86:6789/0 conn(0x7f36a012b670 legacy=0x7f36a0143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:32.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.011+0000 7f369d59a700 1 -- 172.21.15.103:0/3768089502 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a00b9520 con 0x7f36a00ac950 2020-04-22T14:12:32.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.011+0000 7f369d59a700 1 -- 172.21.15.103:0/3768089502 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f3690001710 con 0x7f36a00ac950 2020-04-22T14:12:32.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.011+0000 7f369d59a700 1 -- 172.21.15.103:0/3768089502 >> v1:172.21.15.103:6789/0 conn(0x7f36a00ac950 legacy=0x7f36a0146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:32.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.011+0000 7f369d59a700 1 --2- 172.21.15.103:0/3768089502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3684003720 0x7f3684003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:32.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.011+0000 7f369d59a700 1 --2- 172.21.15.103:0/3768089502 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36840044d0 0x7f3684004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:32.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.011+0000 7f369d59a700 1 --2- 172.21.15.103:0/3768089502 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3684004db0 0x7f368400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:32.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.011+0000 7f369d59a700 1 -- 172.21.15.103:0/3768089502 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a00602f0 con 0x7f36840044d0 2020-04-22T14:12:32.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.011+0000 7f369d59a700 1 -- 172.21.15.103:0/3768089502 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36840041c0 con 0x7f3684003720 2020-04-22T14:12:32.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.011+0000 7f369d59a700 1 -- 172.21.15.103:0/3768089502 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f368400bb80 con 0x7f3684004db0 2020-04-22T14:12:32.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.011+0000 7f369e59c700 1 --2- 172.21.15.103:0/3768089502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3684003720 0x7f3684003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:32.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.011+0000 7f369dd9b700 1 --2- 172.21.15.103:0/3768089502 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36840044d0 0x7f3684004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:32.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.011+0000 7f369ed9d700 1 --2- 172.21.15.103:0/3768089502 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3684004db0 0x7f368400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:32.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.011+0000 7f369e59c700 1 -- 172.21.15.103:0/3768089502 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3684004db0 msgr2=0x7f368400b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:32.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.011+0000 7f369e59c700 1 --2- 172.21.15.103:0/3768089502 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3684004db0 0x7f368400b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:32.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.011+0000 7f369e59c700 1 -- 172.21.15.103:0/3768089502 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36840044d0 msgr2=0x7f3684004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:32.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.011+0000 7f369e59c700 1 --2- 172.21.15.103:0/3768089502 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36840044d0 0x7f3684004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:32.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.011+0000 7f369e59c700 1 -- 172.21.15.103:0/3768089502 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3684003230 con 0x7f3684003720 2020-04-22T14:12:32.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.011+0000 7f369ed9d700 1 -- 172.21.15.103:0/3768089502 reap_dead start 2020-04-22T14:12:32.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.011+0000 7f369e59c700 1 --2- 172.21.15.103:0/3768089502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3684003720 0x7f3684003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f36840054a0 tx=0x7f3694010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.011+0000 7f369e59c700 1 --2- 172.21.15.103:0/3768089502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3684003720 0x7f3684003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f36840054a0 tx=0x7f3694010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.011+0000 7f369e59c700 1 --2- 172.21.15.103:0/3768089502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3684003720 0x7f3684003b40 secure :-1 s=READY pgs=1125 cs=0 l=1 rx=0x7f36840054a0 tx=0x7f3694010050).ready entity=mon.1 client_cookie=211ada994fa0207b server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:32.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.012+0000 7f369e59c700 1 --2- 172.21.15.103:0/3768089502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3684003720 0x7f3684003b40 secure :-1 s=THROTTLE_DONE pgs=1125 cs=0 l=1 rx=0x7f36840054a0 tx=0x7f3694010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.012+0000 7f369d59a700 1 -- 172.21.15.103:0/3768089502 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3694010d20 con 0x7f3684003720 2020-04-22T14:12:32.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.012+0000 7f369e59c700 1 --2- 172.21.15.103:0/3768089502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3684003720 0x7f3684003b40 secure :-1 s=THROTTLE_DONE pgs=1125 cs=0 l=1 rx=0x7f36840054a0 tx=0x7f3694010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.012+0000 7f369e59c700 1 --2- 172.21.15.103:0/3768089502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3684003720 0x7f3684003b40 secure :-1 s=THROTTLE_DONE pgs=1125 cs=0 l=1 rx=0x7f36840054a0 tx=0x7f3694010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.012+0000 7f369d59a700 1 -- 172.21.15.103:0/3768089502 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3694010e80 con 0x7f3684003720 2020-04-22T14:12:32.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.012+0000 7f369d59a700 1 -- 172.21.15.103:0/3768089502 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3694008b10 con 0x7f3684003720 2020-04-22T14:12:32.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.012+0000 7f36a4836700 1 -- 172.21.15.103:0/3768089502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3684003720 msgr2=0x7f3684003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:32.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.012+0000 7f36a4836700 1 --2- 172.21.15.103:0/3768089502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3684003720 0x7f3684003b40 secure :-1 s=READY pgs=1125 cs=0 l=1 rx=0x7f36840054a0 tx=0x7f3694010050).stop 2020-04-22T14:12:32.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.012+0000 7f36a4836700 1 -- 172.21.15.103:0/3768089502 shutdown_connections 2020-04-22T14:12:32.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.012+0000 7f36a4836700 1 --2- 172.21.15.103:0/3768089502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3684003720 0x7f3684003b40 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:32.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.012+0000 7f36a4836700 1 -- 172.21.15.103:0/3768089502 >> 172.21.15.103:0/3768089502 conn(0x7f36a005b7b0 msgr2=0x7f36a00b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:32.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.012+0000 7f36a4836700 1 -- 172.21.15.103:0/3768089502 shutdown_connections 2020-04-22T14:12:32.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.012+0000 7f36a4836700 1 -- 172.21.15.103:0/3768089502 wait complete. 2020-04-22T14:12:32.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.013+0000 7f36a4836700 1 Processor -- start 2020-04-22T14:12:32.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.013+0000 7f36a4836700 1 -- start start 2020-04-22T14:12:32.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.014+0000 7f36a4836700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3684003720 0x7f36a00aff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:32.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.014+0000 7f36a4836700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a00b2220 con 0x7f36a00b1dc0 2020-04-22T14:12:32.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.014+0000 7f36a4836700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a00b11b0 con 0x7f36a0124590 2020-04-22T14:12:32.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.014+0000 7f36a4836700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a00b1450 con 0x7f3684003720 2020-04-22T14:12:32.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.014+0000 7f369ed9d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f36a0124590 0x7f36a0129110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45240/0 (socket says 172.21.15.103:45240) 2020-04-22T14:12:32.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.014+0000 7f369ed9d700 1 -- 172.21.15.103:0/2882546482 learned_addr learned my addr 172.21.15.103:0/2882546482 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:32.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.014+0000 7f369e59c700 1 --2- 172.21.15.103:0/2882546482 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3684003720 0x7f36a00aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:32.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.014+0000 7f368f7fe700 1 -- 172.21.15.103:0/2882546482 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2617586152 0 0) 0x7f36a00b11b0 con 0x7f36a0124590 2020-04-22T14:12:32.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.014+0000 7f368f7fe700 1 -- 172.21.15.103:0/2882546482 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f367c002fe0 con 0x7f36a0124590 2020-04-22T14:12:32.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.014+0000 7f368f7fe700 1 -- 172.21.15.103:0/2882546482 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3885621926 0 0) 0x7f36a00b9520 con 0x7f36a00b1dc0 2020-04-22T14:12:32.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.014+0000 7f368f7fe700 1 -- 172.21.15.103:0/2882546482 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36a00b11b0 con 0x7f36a00b1dc0 2020-04-22T14:12:32.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.014+0000 7f369e59c700 1 -- 172.21.15.103:0/2882546482 >> v1:172.21.15.103:6789/0 conn(0x7f36a0124590 legacy=0x7f36a0129110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:32.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.014+0000 7f369e59c700 1 -- 172.21.15.103:0/2882546482 >> v1:172.21.15.86:6789/0 conn(0x7f36a00b1dc0 legacy=0x7f36a0123e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:32.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.014+0000 7f369e59c700 1 -- 172.21.15.103:0/2882546482 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a012aa50 con 0x7f3684003720 2020-04-22T14:12:32.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.014+0000 7f369e59c700 1 --2- 172.21.15.103:0/2882546482 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3684003720 0x7f36a00aff10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f36840054a0 tx=0x7f3694010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.014+0000 7f369e59c700 1 --2- 172.21.15.103:0/2882546482 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3684003720 0x7f36a00aff10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f36840054a0 tx=0x7f3694010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.014+0000 7f369e59c700 1 --2- 172.21.15.103:0/2882546482 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3684003720 0x7f36a00aff10 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7f36840054a0 tx=0x7f3694010050).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:32.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.015+0000 7f369e59c700 1 --2- 172.21.15.103:0/2882546482 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3684003720 0x7f36a00aff10 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f36840054a0 tx=0x7f3694010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.015+0000 7f368f7fe700 1 -- 172.21.15.103:0/2882546482 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f369400f820 con 0x7f3684003720 2020-04-22T14:12:32.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.015+0000 7f369e59c700 1 --2- 172.21.15.103:0/2882546482 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3684003720 0x7f36a00aff10 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f36840054a0 tx=0x7f3694010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.015+0000 7f369e59c700 1 --2- 172.21.15.103:0/2882546482 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3684003720 0x7f36a00aff10 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f36840054a0 tx=0x7f3694010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.015+0000 7f368f7fe700 1 -- 172.21.15.103:0/2882546482 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36940058b0 con 0x7f3684003720 2020-04-22T14:12:32.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.015+0000 7f36a4836700 1 -- 172.21.15.103:0/2882546482 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a00b0df0 con 0x7f3684003720 2020-04-22T14:12:32.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.015+0000 7f368f7fe700 1 -- 172.21.15.103:0/2882546482 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3694005c10 con 0x7f3684003720 2020-04-22T14:12:32.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.015+0000 7f36a4836700 1 -- 172.21.15.103:0/2882546482 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a01299e0 con 0x7f3684003720 2020-04-22T14:12:32.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.015+0000 7f369e59c700 1 --2- 172.21.15.103:0/2882546482 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3684003720 0x7f36a00aff10 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f36840054a0 tx=0x7f3694010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.016+0000 7f36a4836700 1 -- 172.21.15.103:0/2882546482 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a0056c90 con 0x7f3684003720 2020-04-22T14:12:32.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.016+0000 7f368f7fe700 1 -- 172.21.15.103:0/2882546482 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f3694014240 con 0x7f3684003720 2020-04-22T14:12:32.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.016+0000 7f369e59c700 1 --2- 172.21.15.103:0/2882546482 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3684003720 0x7f36a00aff10 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f36840054a0 tx=0x7f3694010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.016+0000 7f368f7fe700 1 --2- 172.21.15.103:0/2882546482 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f367c04de50 0x7f367c050310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:32.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.016+0000 7f368f7fe700 1 -- 172.21.15.103:0/2882546482 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3694061560 con 0x7f3684003720 2020-04-22T14:12:32.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.016+0000 7f369dd9b700 1 --2- 172.21.15.103:0/2882546482 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f367c04de50 0x7f367c050310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:32.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.016+0000 7f369dd9b700 1 --2- 172.21.15.103:0/2882546482 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f367c04de50 0x7f367c050310 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3690001970 tx=0x7f36a00b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.016+0000 7f369dd9b700 1 --2- 172.21.15.103:0/2882546482 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f367c04de50 0x7f367c050310 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3690001970 tx=0x7f36a00b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.016+0000 7f369dd9b700 1 --2- 172.21.15.103:0/2882546482 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f367c04de50 0x7f367c050310 secure :-1 s=READY pgs=416 cs=0 l=1 rx=0x7f3690001970 tx=0x7f36a00b96b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:32.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.020+0000 7f369e59c700 1 --2- 172.21.15.103:0/2882546482 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3684003720 0x7f36a00aff10 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f36840054a0 tx=0x7f3694010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.020+0000 7f368f7fe700 1 -- 172.21.15.103:0/2882546482 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f369403ca00 con 0x7f3684003720 2020-04-22T14:12:32.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.161+0000 7f36a4836700 1 -- 172.21.15.103:0/2882546482 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f36a00ad820 con 0x7f3684003720 2020-04-22T14:12:32.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.161+0000 7f369e59c700 1 --2- 172.21.15.103:0/2882546482 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3684003720 0x7f36a00aff10 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7f36840054a0 tx=0x7f3694010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.161+0000 7f368f7fe700 1 -- 172.21.15.103:0/2882546482 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v77) v1 ==== 104+0+10 (secure 0 0 0) 0x7f3694040020 con 0x7f3684003720 2020-04-22T14:12:32.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.163+0000 7f36a4836700 1 -- 172.21.15.103:0/2882546482 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f367c04de50 msgr2=0x7f367c050310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:32.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.163+0000 7f36a4836700 1 --2- 172.21.15.103:0/2882546482 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f367c04de50 0x7f367c050310 secure :-1 s=READY pgs=416 cs=0 l=1 rx=0x7f3690001970 tx=0x7f36a00b96b0).stop 2020-04-22T14:12:32.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.163+0000 7f36a4836700 1 -- 172.21.15.103:0/2882546482 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3684003720 msgr2=0x7f36a00aff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:32.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.163+0000 7f36a4836700 1 --2- 172.21.15.103:0/2882546482 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3684003720 0x7f36a00aff10 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7f36840054a0 tx=0x7f3694010050).stop 2020-04-22T14:12:32.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.163+0000 7f36a4836700 1 -- 172.21.15.103:0/2882546482 shutdown_connections 2020-04-22T14:12:32.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.163+0000 7f36a4836700 1 --2- 172.21.15.103:0/2882546482 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f367c04de50 0x7f367c050310 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:32.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.163+0000 7f36a4836700 1 --2- 172.21.15.103:0/2882546482 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3684003720 0x7f36a00aff10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:32.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.163+0000 7f36a4836700 1 -- 172.21.15.103:0/2882546482 >> 172.21.15.103:0/2882546482 conn(0x7f36a005b7b0 msgr2=0x7f36a00ae6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:32.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.163+0000 7f36a4836700 1 -- 172.21.15.103:0/2882546482 shutdown_connections 2020-04-22T14:12:32.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.163+0000 7f36a4836700 1 -- 172.21.15.103:0/2882546482 wait complete. 2020-04-22T14:12:32.170 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:12:32.175 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:32.188 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-22T14:12:32.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.339+0000 7fdd40aae700 1 Processor -- start 2020-04-22T14:12:32.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.339+0000 7fdd40aae700 1 -- start start 2020-04-22T14:12:32.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.340+0000 7fdd40aae700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdd3c05fed0 0x7fdd3c0af010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:32.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.340+0000 7fdd40aae700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd3c0b29b0 con 0x7fdd3c0b8e00 2020-04-22T14:12:32.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.340+0000 7fdd40aae700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd3c0b4270 con 0x7fdd3c0b91e0 2020-04-22T14:12:32.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.340+0000 7fdd40aae700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3c0b4510 con 0x7fdd3c05fed0 2020-04-22T14:12:32.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.340+0000 7fdd3affd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fdd3c0b91e0 0x7fdd3c0b1bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45244/0 (socket says 172.21.15.103:45244) 2020-04-22T14:12:32.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.340+0000 7fdd3affd700 1 -- 172.21.15.103:0/100934086 learned_addr learned my addr 172.21.15.103:0/100934086 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:32.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.340+0000 7fdd3bfff700 1 --2- 172.21.15.103:0/100934086 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdd3c05fed0 0x7fdd3c0af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:32.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.341+0000 7fdd3a7fc700 1 -- 172.21.15.103:0/100934086 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2853926376 0 0) 0x7fdd3c0b4270 con 0x7fdd3c0b91e0 2020-04-22T14:12:32.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.341+0000 7fdd3a7fc700 1 -- 172.21.15.103:0/100934086 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd28003230 con 0x7fdd3c0b91e0 2020-04-22T14:12:32.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.341+0000 7fdd3a7fc700 1 -- 172.21.15.103:0/100934086 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1757825096 0 0) 0x7fdd3c0b29b0 con 0x7fdd3c0b8e00 2020-04-22T14:12:32.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.341+0000 7fdd3a7fc700 1 -- 172.21.15.103:0/100934086 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd3c0b4270 con 0x7fdd3c0b8e00 2020-04-22T14:12:32.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.341+0000 7fdd3bfff700 1 -- 172.21.15.103:0/100934086 >> v1:172.21.15.103:6789/0 conn(0x7fdd3c0b91e0 legacy=0x7fdd3c0b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:32.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.341+0000 7fdd3bfff700 1 -- 172.21.15.103:0/100934086 >> v1:172.21.15.86:6789/0 conn(0x7fdd3c0b8e00 legacy=0x7fdd3c142f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:32.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.341+0000 7fdd3bfff700 1 -- 172.21.15.103:0/100934086 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd3c0b22d0 con 0x7fdd3c05fed0 2020-04-22T14:12:32.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.341+0000 7fdd3bfff700 1 --2- 172.21.15.103:0/100934086 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdd3c05fed0 0x7fdd3c0af010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdd340032b0 tx=0x7fdd34008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.341+0000 7fdd3bfff700 1 --2- 172.21.15.103:0/100934086 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdd3c05fed0 0x7fdd3c0af010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdd340032b0 tx=0x7fdd34008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.341+0000 7fdd3bfff700 1 --2- 172.21.15.103:0/100934086 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdd3c05fed0 0x7fdd3c0af010 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7fdd340032b0 tx=0x7fdd34008c60).ready entity=mon.2 client_cookie=c7a0d02dff07148e server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:32.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.341+0000 7fdd3bfff700 1 --2- 172.21.15.103:0/100934086 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdd3c05fed0 0x7fdd3c0af010 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7fdd340032b0 tx=0x7fdd34008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.341+0000 7fdd3a7fc700 1 -- 172.21.15.103:0/100934086 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd34011db0 con 0x7fdd3c05fed0 2020-04-22T14:12:32.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.341+0000 7fdd3bfff700 1 --2- 172.21.15.103:0/100934086 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdd3c05fed0 0x7fdd3c0af010 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7fdd340032b0 tx=0x7fdd34008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.341+0000 7fdd3bfff700 1 --2- 172.21.15.103:0/100934086 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdd3c05fed0 0x7fdd3c0af010 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7fdd340032b0 tx=0x7fdd34008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.341+0000 7fdd3a7fc700 1 -- 172.21.15.103:0/100934086 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3400a180 con 0x7fdd3c05fed0 2020-04-22T14:12:32.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.341+0000 7fdd3a7fc700 1 -- 172.21.15.103:0/100934086 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd3400a5a0 con 0x7fdd3c05fed0 2020-04-22T14:12:32.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.341+0000 7fdd40aae700 1 -- 172.21.15.103:0/100934086 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdd3c05fed0 msgr2=0x7fdd3c0af010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:32.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.341+0000 7fdd40aae700 1 --2- 172.21.15.103:0/100934086 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdd3c05fed0 0x7fdd3c0af010 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7fdd340032b0 tx=0x7fdd34008c60).stop 2020-04-22T14:12:32.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.342+0000 7fdd40aae700 1 -- 172.21.15.103:0/100934086 shutdown_connections 2020-04-22T14:12:32.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.342+0000 7fdd40aae700 1 --2- 172.21.15.103:0/100934086 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdd3c05fed0 0x7fdd3c0af010 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:32.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.342+0000 7fdd40aae700 1 -- 172.21.15.103:0/100934086 >> 172.21.15.103:0/100934086 conn(0x7fdd3c05b780 msgr2=0x7fdd3c0b8530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:32.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.342+0000 7fdd40aae700 1 -- 172.21.15.103:0/100934086 shutdown_connections 2020-04-22T14:12:32.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.342+0000 7fdd40aae700 1 -- 172.21.15.103:0/100934086 wait complete. 2020-04-22T14:12:32.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.343+0000 7fdd40aae700 1 Processor -- start 2020-04-22T14:12:32.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.343+0000 7fdd40aae700 1 -- start start 2020-04-22T14:12:32.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.343+0000 7fdd40aae700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdd3c0b8e00 0x7fdd3c111d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:32.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.343+0000 7fdd40aae700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd3c065d70 con 0x7fdd3c0b91e0 2020-04-22T14:12:32.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.343+0000 7fdd40aae700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd3c062890 con 0x7fdd3c05fed0 2020-04-22T14:12:32.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.343+0000 7fdd40aae700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd3c062ac0 con 0x7fdd3c0b8e00 2020-04-22T14:12:32.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.343+0000 7fdd3affd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdd3c0b8e00 0x7fdd3c111d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:32.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.343+0000 7fdd3b7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fdd3c05fed0 0x7fdd3c134990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45250/0 (socket says 172.21.15.103:45250) 2020-04-22T14:12:32.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.344+0000 7fdd3b7fe700 1 -- 172.21.15.103:0/2134634584 learned_addr learned my addr 172.21.15.103:0/2134634584 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:32.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.344+0000 7fdd3affd700 1 -- 172.21.15.103:0/2134634584 >> v1:172.21.15.103:6789/0 conn(0x7fdd3c05fed0 legacy=0x7fdd3c134990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:32.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.344+0000 7fdd38ff9700 1 -- 172.21.15.103:0/2134634584 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 977844584 0 0) 0x7fdd3c062890 con 0x7fdd3c05fed0 2020-04-22T14:12:32.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.344+0000 7fdd3affd700 1 -- 172.21.15.103:0/2134634584 >> v1:172.21.15.86:6789/0 conn(0x7fdd3c0b91e0 legacy=0x7fdd3c0634a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:32.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.344+0000 7fdd3affd700 1 -- 172.21.15.103:0/2134634584 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd3c062d60 con 0x7fdd3c0b8e00 2020-04-22T14:12:32.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.344+0000 7fdd3affd700 1 --2- 172.21.15.103:0/2134634584 >> v2:172.21.15.103:3300/0 conn(0x7fdd3c0b8e00 0x7fdd3c111d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdd300010d0 tx=0x7fdd30012bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.344+0000 7fdd3affd700 1 --2- 172.21.15.103:0/2134634584 >> v2:172.21.15.103:3300/0 conn(0x7fdd3c0b8e00 0x7fdd3c111d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdd300010d0 tx=0x7fdd30012bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.344+0000 7fdd3affd700 1 --2- 172.21.15.103:0/2134634584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd3c0b8e00 0x7fdd3c111d60 secure :-1 s=READY pgs=1129 cs=0 l=1 rx=0x7fdd300010d0 tx=0x7fdd30012bb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:32.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.344+0000 7fdd3affd700 1 --2- 172.21.15.103:0/2134634584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd3c0b8e00 0x7fdd3c111d60 secure :-1 s=THROTTLE_DONE pgs=1129 cs=0 l=1 rx=0x7fdd300010d0 tx=0x7fdd30012bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.344+0000 7fdd38ff9700 1 -- 172.21.15.103:0/2134634584 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd30005cc0 con 0x7fdd3c0b8e00 2020-04-22T14:12:32.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.344+0000 7fdd3affd700 1 --2- 172.21.15.103:0/2134634584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd3c0b8e00 0x7fdd3c111d60 secure :-1 s=THROTTLE_DONE pgs=1129 cs=0 l=1 rx=0x7fdd300010d0 tx=0x7fdd30012bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.344+0000 7fdd3affd700 1 --2- 172.21.15.103:0/2134634584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd3c0b8e00 0x7fdd3c111d60 secure :-1 s=THROTTLE_DONE pgs=1129 cs=0 l=1 rx=0x7fdd300010d0 tx=0x7fdd30012bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.344+0000 7fdd38ff9700 1 -- 172.21.15.103:0/2134634584 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd30005e20 con 0x7fdd3c0b8e00 2020-04-22T14:12:32.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.344+0000 7fdd40aae700 1 -- 172.21.15.103:0/2134634584 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd3c063000 con 0x7fdd3c0b8e00 2020-04-22T14:12:32.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.344+0000 7fdd38ff9700 1 -- 172.21.15.103:0/2134634584 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd30014440 con 0x7fdd3c0b8e00 2020-04-22T14:12:32.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.344+0000 7fdd40aae700 1 -- 172.21.15.103:0/2134634584 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd3c1350a0 con 0x7fdd3c0b8e00 2020-04-22T14:12:32.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.345+0000 7fdd3affd700 1 --2- 172.21.15.103:0/2134634584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd3c0b8e00 0x7fdd3c111d60 secure :-1 s=THROTTLE_DONE pgs=1129 cs=0 l=1 rx=0x7fdd300010d0 tx=0x7fdd30012bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.345+0000 7fdd40aae700 1 -- 172.21.15.103:0/2134634584 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd3c0631c0 con 0x7fdd3c0b8e00 2020-04-22T14:12:32.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.345+0000 7fdd38ff9700 1 -- 172.21.15.103:0/2134634584 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fdd30014630 con 0x7fdd3c0b8e00 2020-04-22T14:12:32.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.345+0000 7fdd3affd700 1 --2- 172.21.15.103:0/2134634584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd3c0b8e00 0x7fdd3c111d60 secure :-1 s=THROTTLE_DONE pgs=1129 cs=0 l=1 rx=0x7fdd300010d0 tx=0x7fdd30012bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.345+0000 7fdd38ff9700 1 --2- 172.21.15.103:0/2134634584 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdd1c04d740 0x7fdd1c04fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:32.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.345+0000 7fdd38ff9700 1 -- 172.21.15.103:0/2134634584 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdd300090c0 con 0x7fdd3c0b8e00 2020-04-22T14:12:32.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.346+0000 7fdd3b7fe700 1 --2- 172.21.15.103:0/2134634584 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdd1c04d740 0x7fdd1c04fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:32.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.346+0000 7fdd3b7fe700 1 --2- 172.21.15.103:0/2134634584 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdd1c04d740 0x7fdd1c04fc00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdd2c0023a0 tx=0x7fdd2c002860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.346+0000 7fdd3b7fe700 1 --2- 172.21.15.103:0/2134634584 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdd1c04d740 0x7fdd1c04fc00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdd2c0023a0 tx=0x7fdd2c002860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.346+0000 7fdd3b7fe700 1 --2- 172.21.15.103:0/2134634584 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdd1c04d740 0x7fdd1c04fc00 secure :-1 s=READY pgs=417 cs=0 l=1 rx=0x7fdd2c0023a0 tx=0x7fdd2c002860).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:32.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.349+0000 7fdd3affd700 1 --2- 172.21.15.103:0/2134634584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd3c0b8e00 0x7fdd3c111d60 secure :-1 s=THROTTLE_DONE pgs=1129 cs=0 l=1 rx=0x7fdd300010d0 tx=0x7fdd30012bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.350+0000 7fdd38ff9700 1 -- 172.21.15.103:0/2134634584 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fdd3003ee00 con 0x7fdd3c0b8e00 2020-04-22T14:12:32.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.491+0000 7fdd40aae700 1 -- 172.21.15.103:0/2134634584 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdd3c056c90 con 0x7fdd3c0b8e00 2020-04-22T14:12:32.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.491+0000 7fdd3affd700 1 --2- 172.21.15.103:0/2134634584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd3c0b8e00 0x7fdd3c111d60 secure :-1 s=THROTTLE_DONE pgs=1129 cs=0 l=1 rx=0x7fdd300010d0 tx=0x7fdd30012bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.491+0000 7fdd38ff9700 1 -- 172.21.15.103:0/2134634584 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v77) v1 ==== 100+0+10 (secure 0 0 0) 0x7fdd30042420 con 0x7fdd3c0b8e00 2020-04-22T14:12:32.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.493+0000 7fdd40aae700 1 -- 172.21.15.103:0/2134634584 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdd1c04d740 msgr2=0x7fdd1c04fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:32.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.493+0000 7fdd40aae700 1 --2- 172.21.15.103:0/2134634584 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdd1c04d740 0x7fdd1c04fc00 secure :-1 s=READY pgs=417 cs=0 l=1 rx=0x7fdd2c0023a0 tx=0x7fdd2c002860).stop 2020-04-22T14:12:32.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.493+0000 7fdd40aae700 1 -- 172.21.15.103:0/2134634584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd3c0b8e00 msgr2=0x7fdd3c111d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:32.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.493+0000 7fdd40aae700 1 --2- 172.21.15.103:0/2134634584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd3c0b8e00 0x7fdd3c111d60 secure :-1 s=READY pgs=1129 cs=0 l=1 rx=0x7fdd300010d0 tx=0x7fdd30012bb0).stop 2020-04-22T14:12:32.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.493+0000 7fdd40aae700 1 -- 172.21.15.103:0/2134634584 shutdown_connections 2020-04-22T14:12:32.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.493+0000 7fdd40aae700 1 --2- 172.21.15.103:0/2134634584 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdd1c04d740 0x7fdd1c04fc00 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:32.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.493+0000 7fdd40aae700 1 --2- 172.21.15.103:0/2134634584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd3c0b8e00 0x7fdd3c111d60 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:32.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.493+0000 7fdd40aae700 1 -- 172.21.15.103:0/2134634584 >> 172.21.15.103:0/2134634584 conn(0x7fdd3c05b780 msgr2=0x7fdd3c0b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:32.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.493+0000 7fdd40aae700 1 -- 172.21.15.103:0/2134634584 shutdown_connections 2020-04-22T14:12:32.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.493+0000 7fdd40aae700 1 -- 172.21.15.103:0/2134634584 wait complete. 2020-04-22T14:12:32.506 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:12:32.507 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-04-22T14:12:32.507 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:32.521 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:12:32.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.665+0000 7f1ac9213700 1 Processor -- start 2020-04-22T14:12:32.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.665+0000 7f1ac9213700 1 -- start start 2020-04-22T14:12:32.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.666+0000 7f1ac9213700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ac40620a0 0x7f1ac4142e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:32.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.666+0000 7f1ac9213700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ac4143810 con 0x7f1ac4143280 2020-04-22T14:12:32.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.666+0000 7f1ac9213700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ac4143ab0 con 0x7f1ac40ad900 2020-04-22T14:12:32.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.666+0000 7f1ac9213700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac4143d50 con 0x7f1ac40620a0 2020-04-22T14:12:32.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.666+0000 7f1ac8a12700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f1ac40ad900 0x7f1ac40addb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45262/0 (socket says 172.21.15.103:45262) 2020-04-22T14:12:32.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.666+0000 7f1ac8a12700 1 -- 172.21.15.103:0/540758984 learned_addr learned my addr 172.21.15.103:0/540758984 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:32.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.666+0000 7f1ac3fff700 1 --2- 172.21.15.103:0/540758984 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ac40620a0 0x7f1ac4142e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:32.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.666+0000 7f1ac2ffd700 1 -- 172.21.15.103:0/540758984 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3934501848 0 0) 0x7f1ac4143ab0 con 0x7f1ac40ad900 2020-04-22T14:12:32.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.666+0000 7f1ac2ffd700 1 -- 172.21.15.103:0/540758984 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ab0003230 con 0x7f1ac40ad900 2020-04-22T14:12:32.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.666+0000 7f1ac2ffd700 1 -- 172.21.15.103:0/540758984 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1817686176 0 0) 0x7f1ac4143810 con 0x7f1ac4143280 2020-04-22T14:12:32.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.666+0000 7f1ac2ffd700 1 -- 172.21.15.103:0/540758984 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ac4143ab0 con 0x7f1ac4143280 2020-04-22T14:12:32.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.666+0000 7f1ac2ffd700 1 -- 172.21.15.103:0/540758984 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3718518197 0 0) 0x7f1ab0003230 con 0x7f1ac40ad900 2020-04-22T14:12:32.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.666+0000 7f1ac2ffd700 1 -- 172.21.15.103:0/540758984 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ac40620a0 msgr2=0x7f1ac4142e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:32.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.666+0000 7f1ac2ffd700 1 --2- 172.21.15.103:0/540758984 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ac40620a0 0x7f1ac4142e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:32.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.666+0000 7f1ac2ffd700 1 -- 172.21.15.103:0/540758984 >> v1:172.21.15.86:6789/0 conn(0x7f1ac4143280 legacy=0x7f1ac4146ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:32.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.666+0000 7f1ac2ffd700 1 -- 172.21.15.103:0/540758984 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac4062480 con 0x7f1ac40ad900 2020-04-22T14:12:32.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.666+0000 7f1ac2ffd700 1 -- 172.21.15.103:0/540758984 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f1abc001a50 con 0x7f1ac40ad900 2020-04-22T14:12:32.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.666+0000 7f1ac3fff700 1 --2- 172.21.15.103:0/540758984 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ac40620a0 0x7f1ac4142e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:12:32.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.666+0000 7f1ac2ffd700 1 -- 172.21.15.103:0/540758984 >> v1:172.21.15.103:6789/0 conn(0x7f1ac40ad900 legacy=0x7f1ac40addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:32.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.666+0000 7f1ac2ffd700 1 --2- 172.21.15.103:0/540758984 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ac40620a0 0x7f1ab00038b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:32.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.666+0000 7f1ac2ffd700 1 --2- 172.21.15.103:0/540758984 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ab0003d60 0x7f1ab00044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:32.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.666+0000 7f1ac2ffd700 1 --2- 172.21.15.103:0/540758984 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ab0004930 0x7f1ab0004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:32.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.666+0000 7f1ac2ffd700 1 -- 172.21.15.103:0/540758984 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac4143d50 con 0x7f1ab0004930 2020-04-22T14:12:32.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.666+0000 7f1ac2ffd700 1 -- 172.21.15.103:0/540758984 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab0005240 con 0x7f1ab0003d60 2020-04-22T14:12:32.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.666+0000 7f1ac2ffd700 1 -- 172.21.15.103:0/540758984 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab000b720 con 0x7f1ac40620a0 2020-04-22T14:12:32.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.666+0000 7f1ac37fe700 1 --2- 172.21.15.103:0/540758984 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ab0003d60 0x7f1ab00044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:32.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.667+0000 7f1ac3fff700 1 --2- 172.21.15.103:0/540758984 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ac40620a0 0x7f1ab00038b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:32.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.667+0000 7f1ac8a12700 1 --2- 172.21.15.103:0/540758984 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ab0004930 0x7f1ab0004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:32.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.667+0000 7f1ac37fe700 1 -- 172.21.15.103:0/540758984 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ac40620a0 msgr2=0x7f1ab00038b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:32.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.667+0000 7f1ac37fe700 1 --2- 172.21.15.103:0/540758984 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ac40620a0 0x7f1ab00038b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:32.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.667+0000 7f1ac37fe700 1 -- 172.21.15.103:0/540758984 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ab0004930 msgr2=0x7f1ab0004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:32.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.667+0000 7f1ac37fe700 1 --2- 172.21.15.103:0/540758984 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ab0004930 0x7f1ab0004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:32.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.667+0000 7f1ac37fe700 1 -- 172.21.15.103:0/540758984 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab0003230 con 0x7f1ab0003d60 2020-04-22T14:12:32.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.667+0000 7f1ac37fe700 1 --2- 172.21.15.103:0/540758984 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ab0003d60 0x7f1ab00044d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1ab80010d0 tx=0x7f1ab800fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.667+0000 7f1ac37fe700 1 --2- 172.21.15.103:0/540758984 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ab0003d60 0x7f1ab00044d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1ab80010d0 tx=0x7f1ab800fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.667+0000 7f1ac37fe700 1 --2- 172.21.15.103:0/540758984 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ab0003d60 0x7f1ab00044d0 secure :-1 s=READY pgs=1131 cs=0 l=1 rx=0x7f1ab80010d0 tx=0x7f1ab800fe50).ready entity=mon.1 client_cookie=aca6a953b0d56aec server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:32.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.667+0000 7f1ac37fe700 1 --2- 172.21.15.103:0/540758984 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ab0003d60 0x7f1ab00044d0 secure :-1 s=THROTTLE_DONE pgs=1131 cs=0 l=1 rx=0x7f1ab80010d0 tx=0x7f1ab800fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.667+0000 7f1ac2ffd700 1 -- 172.21.15.103:0/540758984 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ab8011bb0 con 0x7f1ab0003d60 2020-04-22T14:12:32.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.667+0000 7f1ac37fe700 1 --2- 172.21.15.103:0/540758984 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ab0003d60 0x7f1ab00044d0 secure :-1 s=THROTTLE_DONE pgs=1131 cs=0 l=1 rx=0x7f1ab80010d0 tx=0x7f1ab800fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.667+0000 7f1ac2ffd700 1 -- 172.21.15.103:0/540758984 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab8011d50 con 0x7f1ab0003d60 2020-04-22T14:12:32.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.667+0000 7f1ac37fe700 1 --2- 172.21.15.103:0/540758984 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ab0003d60 0x7f1ab00044d0 secure :-1 s=THROTTLE_DONE pgs=1131 cs=0 l=1 rx=0x7f1ab80010d0 tx=0x7f1ab800fe50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.667+0000 7f1ac2ffd700 1 -- 172.21.15.103:0/540758984 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ab80066d0 con 0x7f1ab0003d60 2020-04-22T14:12:32.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.667+0000 7f1ac9213700 1 -- 172.21.15.103:0/540758984 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ab0003d60 msgr2=0x7f1ab00044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:32.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.667+0000 7f1ac9213700 1 --2- 172.21.15.103:0/540758984 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ab0003d60 0x7f1ab00044d0 secure :-1 s=READY pgs=1131 cs=0 l=1 rx=0x7f1ab80010d0 tx=0x7f1ab800fe50).stop 2020-04-22T14:12:32.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.667+0000 7f1ac8a12700 1 -- 172.21.15.103:0/540758984 reap_dead start 2020-04-22T14:12:32.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.668+0000 7f1ac9213700 1 -- 172.21.15.103:0/540758984 shutdown_connections 2020-04-22T14:12:32.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.668+0000 7f1ac9213700 1 -- 172.21.15.103:0/540758984 >> 172.21.15.103:0/540758984 conn(0x7f1ac405b7c0 msgr2=0x7f1ac4061610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:32.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.668+0000 7f1ac9213700 1 -- 172.21.15.103:0/540758984 shutdown_connections 2020-04-22T14:12:32.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.668+0000 7f1ac9213700 1 -- 172.21.15.103:0/540758984 wait complete. 2020-04-22T14:12:32.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.668+0000 7f1ac9213700 1 Processor -- start 2020-04-22T14:12:32.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.669+0000 7f1ac9213700 1 -- start start 2020-04-22T14:12:32.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.669+0000 7f1ac9213700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ac414d290 0x7f1ac414d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:32.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.669+0000 7f1ac9213700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1ac41416a0 0x7f1ac4141af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:32.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.669+0000 7f1ac9213700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ac414db70 con 0x7f1ac4062cb0 2020-04-22T14:12:32.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.669+0000 7f1ac9213700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ac413c290 con 0x7f1ac41416a0 2020-04-22T14:12:32.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.669+0000 7f1ac9213700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac413c530 con 0x7f1ac414d290 2020-04-22T14:12:32.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.669+0000 7f1ac3fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f1ac4062cb0 0x7f1ac41540b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45270/0 (socket says 172.21.15.103:45270) 2020-04-22T14:12:32.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.669+0000 7f1ac3fff700 1 -- 172.21.15.103:0/3868792486 learned_addr learned my addr 172.21.15.103:0/3868792486 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:32.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.670+0000 7f1ac8a12700 1 --2- 172.21.15.103:0/3868792486 >> v2:172.21.15.86:3300/0 conn(0x7f1ac41416a0 0x7f1ac4141af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:32.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.670+0000 7f1ac37fe700 1 --2- 172.21.15.103:0/3868792486 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ac414d290 0x7f1ac414d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:32.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.670+0000 7f1ac17fa700 1 -- 172.21.15.103:0/3868792486 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4030761522 0 0) 0x7f1ac414db70 con 0x7f1ac4062cb0 2020-04-22T14:12:32.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.670+0000 7f1ac17fa700 1 -- 172.21.15.103:0/3868792486 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1aa4002fe0 con 0x7f1ac4062cb0 2020-04-22T14:12:32.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.670+0000 7f1ac17fa700 1 -- 172.21.15.103:0/3868792486 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1875358374 0 0) 0x7f1aa4002fe0 con 0x7f1ac4062cb0 2020-04-22T14:12:32.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.670+0000 7f1ac17fa700 1 -- 172.21.15.103:0/3868792486 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1ac414db70 con 0x7f1ac4062cb0 2020-04-22T14:12:32.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.670+0000 7f1ac17fa700 1 -- 172.21.15.103:0/3868792486 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f1ab4001490 con 0x7f1ac4062cb0 2020-04-22T14:12:32.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.670+0000 7f1ac8a12700 1 -- 172.21.15.103:0/3868792486 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ac414d290 msgr2=0x7f1ac414d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:32.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.670+0000 7f1ac8a12700 1 --2- 172.21.15.103:0/3868792486 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ac414d290 0x7f1ac414d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:32.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.670+0000 7f1ac8a12700 1 -- 172.21.15.103:0/3868792486 >> v1:172.21.15.103:6789/0 conn(0x7f1ac4062cb0 legacy=0x7f1ac41540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:32.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.670+0000 7f1ac8a12700 1 -- 172.21.15.103:0/3868792486 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac4063090 con 0x7f1ac41416a0 2020-04-22T14:12:32.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.670+0000 7f1ac37fe700 1 --2- 172.21.15.103:0/3868792486 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ac414d290 0x7f1ac414d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:12:32.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.670+0000 7f1ac8a12700 1 --2- 172.21.15.103:0/3868792486 >> v2:172.21.15.86:3300/0 conn(0x7f1ac41416a0 0x7f1ac4141af0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1ab8001190 tx=0x7f1ac4062610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.670+0000 7f1ac8a12700 1 --2- 172.21.15.103:0/3868792486 >> v2:172.21.15.86:3300/0 conn(0x7f1ac41416a0 0x7f1ac4141af0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1ab8001190 tx=0x7f1ac4062610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.670+0000 7f1ac8a12700 1 --2- 172.21.15.103:0/3868792486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ac41416a0 0x7f1ac4141af0 secure :-1 s=READY pgs=618 cs=0 l=1 rx=0x7f1ab8001190 tx=0x7f1ac4062610).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:32.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.670+0000 7f1ac8a12700 1 --2- 172.21.15.103:0/3868792486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ac41416a0 0x7f1ac4141af0 secure :-1 s=THROTTLE_DONE pgs=618 cs=0 l=1 rx=0x7f1ab8001190 tx=0x7f1ac4062610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.670+0000 7f1ac17fa700 1 -- 172.21.15.103:0/3868792486 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1abc00ce60 con 0x7f1ac41416a0 2020-04-22T14:12:32.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.670+0000 7f1ac8a12700 1 --2- 172.21.15.103:0/3868792486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ac41416a0 0x7f1ac4141af0 secure :-1 s=THROTTLE_DONE pgs=618 cs=0 l=1 rx=0x7f1ab8001190 tx=0x7f1ac4062610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.670+0000 7f1ac8a12700 1 --2- 172.21.15.103:0/3868792486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ac41416a0 0x7f1ac4141af0 secure :-1 s=THROTTLE_DONE pgs=618 cs=0 l=1 rx=0x7f1ab8001190 tx=0x7f1ac4062610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.670+0000 7f1ac17fa700 1 -- 172.21.15.103:0/3868792486 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1abc009980 con 0x7f1ac41416a0 2020-04-22T14:12:32.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.670+0000 7f1ac9213700 1 -- 172.21.15.103:0/3868792486 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ac413bf80 con 0x7f1ac41416a0 2020-04-22T14:12:32.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.670+0000 7f1ac17fa700 1 -- 172.21.15.103:0/3868792486 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1abc009ce0 con 0x7f1ac41416a0 2020-04-22T14:12:32.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.670+0000 7f1ac9213700 1 -- 172.21.15.103:0/3868792486 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ac40afcc0 con 0x7f1ac41416a0 2020-04-22T14:12:32.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.671+0000 7f1ac8a12700 1 --2- 172.21.15.103:0/3868792486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ac41416a0 0x7f1ac4141af0 secure :-1 s=THROTTLE_DONE pgs=618 cs=0 l=1 rx=0x7f1ab8001190 tx=0x7f1ac4062610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.671+0000 7f1ac9213700 1 -- 172.21.15.103:0/3868792486 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ac4056c90 con 0x7f1ac41416a0 2020-04-22T14:12:32.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.672+0000 7f1ac17fa700 1 -- 172.21.15.103:0/3868792486 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f1abc00e160 con 0x7f1ac41416a0 2020-04-22T14:12:32.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.672+0000 7f1ac8a12700 1 --2- 172.21.15.103:0/3868792486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ac41416a0 0x7f1ac4141af0 secure :-1 s=THROTTLE_DONE pgs=618 cs=0 l=1 rx=0x7f1ab8001190 tx=0x7f1ac4062610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.672+0000 7f1ac17fa700 1 --2- 172.21.15.103:0/3868792486 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1aa404df60 0x7f1aa4050420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:32.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.672+0000 7f1ac17fa700 1 -- 172.21.15.103:0/3868792486 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1abc060f50 con 0x7f1ac41416a0 2020-04-22T14:12:32.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.672+0000 7f1ac3fff700 1 --2- 172.21.15.103:0/3868792486 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1aa404df60 0x7f1aa4050420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:32.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.672+0000 7f1ac3fff700 1 --2- 172.21.15.103:0/3868792486 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1aa404df60 0x7f1aa4050420 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1ab4007d20 tx=0x7f1ab4007720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.672+0000 7f1ac3fff700 1 --2- 172.21.15.103:0/3868792486 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1aa404df60 0x7f1aa4050420 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1ab4007d20 tx=0x7f1ab4007720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.672+0000 7f1ac3fff700 1 --2- 172.21.15.103:0/3868792486 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1aa404df60 0x7f1aa4050420 secure :-1 s=READY pgs=418 cs=0 l=1 rx=0x7f1ab4007d20 tx=0x7f1ab4007720).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:32.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.675+0000 7f1ac8a12700 1 --2- 172.21.15.103:0/3868792486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ac41416a0 0x7f1ac4141af0 secure :-1 s=THROTTLE_DONE pgs=618 cs=0 l=1 rx=0x7f1ab8001190 tx=0x7f1ac4062610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.675+0000 7f1ac17fa700 1 -- 172.21.15.103:0/3868792486 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f1abc03c2d0 con 0x7f1ac41416a0 2020-04-22T14:12:32.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.864+0000 7f1ac9213700 1 -- 172.21.15.103:0/3868792486 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ac40b49e0 con 0x7f1ac41416a0 2020-04-22T14:12:32.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.865+0000 7f1ac8a12700 1 --2- 172.21.15.103:0/3868792486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ac41416a0 0x7f1ac4141af0 secure :-1 s=THROTTLE_DONE pgs=618 cs=0 l=1 rx=0x7f1ab8001190 tx=0x7f1ac4062610).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:32.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.865+0000 7f1ac17fa700 1 -- 172.21.15.103:0/3868792486 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2137 (secure 0 0 0) 0x7f1abc03f8f0 con 0x7f1ac41416a0 2020-04-22T14:12:32.867 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:12:32.868 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5435,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3857335366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3857335366},{"type":"v1","addr":"172.21.15.86:6835","nonce":3857335366}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":46}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:20.884022+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6513},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6513":{"gid":6513,"name":"a","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/46849623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":46849623},{"type":"v1","addr":"172.21.15.103:6833","nonce":46849623}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:12:32.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.866+0000 7f1ac9213700 1 -- 172.21.15.103:0/3868792486 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1aa404df60 msgr2=0x7f1aa4050420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:32.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.866+0000 7f1ac9213700 1 --2- 172.21.15.103:0/3868792486 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1aa404df60 0x7f1aa4050420 secure :-1 s=READY pgs=418 cs=0 l=1 rx=0x7f1ab4007d20 tx=0x7f1ab4007720).stop 2020-04-22T14:12:32.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.866+0000 7f1ac9213700 1 -- 172.21.15.103:0/3868792486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ac41416a0 msgr2=0x7f1ac4141af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:32.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.866+0000 7f1ac9213700 1 --2- 172.21.15.103:0/3868792486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ac41416a0 0x7f1ac4141af0 secure :-1 s=READY pgs=618 cs=0 l=1 rx=0x7f1ab8001190 tx=0x7f1ac4062610).stop 2020-04-22T14:12:32.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.866+0000 7f1ac9213700 1 -- 172.21.15.103:0/3868792486 shutdown_connections 2020-04-22T14:12:32.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.866+0000 7f1ac9213700 1 --2- 172.21.15.103:0/3868792486 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1aa404df60 0x7f1aa4050420 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:32.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.866+0000 7f1ac9213700 1 --2- 172.21.15.103:0/3868792486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ac41416a0 0x7f1ac4141af0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:32.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.866+0000 7f1ac9213700 1 --2- 172.21.15.103:0/3868792486 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ac414d290 0x7f1ac414d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:32.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.866+0000 7f1ac9213700 1 -- 172.21.15.103:0/3868792486 >> 172.21.15.103:0/3868792486 conn(0x7f1ac405b7c0 msgr2=0x7f1ac412bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:32.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.866+0000 7f1ac9213700 1 -- 172.21.15.103:0/3868792486 shutdown_connections 2020-04-22T14:12:32.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:32.866+0000 7f1ac9213700 1 -- 172.21.15.103:0/3868792486 wait complete. 2020-04-22T14:12:32.870 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 50 2020-04-22T14:12:33.080 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 6513}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 13, u'failed': [], u'epoch': 50, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [14], u'info': {u'gid_6513': {u'export_targets': [], u'name': u'a', u'incarnation': 47, u'state_seq': 3, u'state': u'up:active', u'gid': 6513, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 46849623, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 46849623, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/46849623'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:12:18.873897+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:12:20.884022+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:12:33.080 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:12:33.081 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:33.094 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:12:33.252 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:12:33.252 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:12:33.253 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:12:33.253 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 6513, 2020-04-22T14:12:33.253 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:12:33.253 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:12:33.253 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 14.375041779, 2020-04-22T14:12:33.253 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 50, 2020-04-22T14:12:33.253 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 77, 2020-04-22T14:12:33.254 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 77, 2020-04-22T14:12:33.254 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 19.590635618 2020-04-22T14:12:33.254 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:12:33.264 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 6513, "want_state": "up:active", "state": "up:active", "rank_uptime": 14.375041779, "mdsmap_epoch": 50, "osdmap_epoch": 77, "osdmap_epoch_barrier": 77, "uptime": 19.590635618 } 2020-04-22T14:12:33.264 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-04-22T14:12:33.265 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-04-22T14:12:33.265 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:33.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:33.278 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:12:33.337 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:12:33.337 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:12:33.337 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:12:33.337 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:33.337 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:12:33.338 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:33.338 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:12:33.338 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:12:33.338 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:12:33.338 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:12:33.338 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:12:33.338 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:12:33.339 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:12:33.339 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:12:33.339 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:12:33.339 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42087sec preferred_lft 42087sec 2020-04-22T14:12:33.339 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:12:33.339 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:33.339 INFO:teuthology.orchestra.run.smithi103.stdout:20: brx.0@if2: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:12:33.340 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether d6:00:10:e7:64:03 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:12:33.340 INFO:teuthology.orchestra.run.smithi103.stdout:24: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:12:33.340 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether ce:89:5a:9a:cb:19 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:12:33.340 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:12:33.340 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:33.340 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::d064:7006:1dc4:a222/64 scope link noprefixroute 2020-04-22T14:12:33.340 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:33.341 INFO:teuthology.orchestra.run.smithi103.stdout:25: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-04-22T14:12:33.341 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether ce:89:5a:9a:cb:19 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2020-04-22T14:12:33.341 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:33.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:33.400 INFO:teuthology.orchestra.run.smithi103:> ip netns list 2020-04-22T14:12:33.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 1) 2020-04-22T14:12:33.468 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:33.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:33.527 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:12:33.591 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 2020-04-22T14:12:33.591 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 1 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2020-04-22T14:12:33.591 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:33.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:33.640 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:12:33.700 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 2020-04-22T14:12:33.700 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 1 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2020-04-22T14:12:33.700 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:33.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:33.748 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:12:33.806 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 2020-04-22T14:12:33.807 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 1 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2020-04-22T14:12:33.807 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:33.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:33.857 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:12:33.931 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:33.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:33.980 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 2' 2020-04-22T14:12:34.057 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:34.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:34.102 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr' 2020-04-22T14:12:34.177 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:12:34.177 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:12:34.177 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:12:34.177 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:34.178 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:12:34.178 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:34.178 INFO:teuthology.orchestra.run.smithi103.stdout:2: veth0@if25: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:12:34.178 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 36:a3:e3:b5:c4:ba brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:12:34.178 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2020-04-22T14:12:34.178 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:34.178 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::34a3:e3ff:feb5:c4ba/64 scope link 2020-04-22T14:12:34.179 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:34.209 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:34.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:34.242 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr' 2020-04-22T14:12:34.328 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:12:34.328 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:12:34.328 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:12:34.329 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:34.329 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:12:34.329 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:34.330 INFO:teuthology.orchestra.run.smithi103.stdout:2: veth0@if25: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:12:34.330 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 36:a3:e3:b5:c4:ba brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:12:34.330 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2020-04-22T14:12:34.330 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:34.330 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::34a3:e3ff:feb5:c4ba/64 scope link 2020-04-22T14:12:34.331 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:34.361 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.2/16 2020-04-22T14:12:34.361 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:34.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:34.386 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.2' 2020-04-22T14:12:34.461 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:34.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:34.508 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0' 2020-04-22T14:12:34.621 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:34.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:34.642 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up' 2020-04-22T14:12:34.750 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:34.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:34.765 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up' 2020-04-22T14:12:34.878 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:34.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:34.892 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254' 2020-04-22T14:12:35.005 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:35.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:35.045 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:12:35.121 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:35.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:35.170 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge-slave con-name brx.2 ifname brx.2 master ceph-brx' 2020-04-22T14:12:35.283 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.2' (5d7d8af1-1e3a-4f77-9ea9-bf8e57dc9003) successfully added. 2020-04-22T14:12:35.283 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:35.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:35.311 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up brx.2' 2020-04-22T14:12:35.482 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/30) 2020-04-22T14:12:35.535 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2020-04-22T14:12:35.535 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi103.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2020-04-22T14:12:35.535 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:35.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:12:35.555 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:12:35.617 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:35.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:12:35.665 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:12:35.733 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:12:35.740 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:12:35.741 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:35.786 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:12:35.786 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:12:35.846 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:12:35.846 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [47] 2020-04-22T14:12:35.846 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:35.899 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:12:35.941 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:35.954 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:12:35.954 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:12:36.027 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:2020-04-22T14:12:36.025+0000 7f7f8f9251c0 -1 init, newargv = 0x55fef7e3b120 newargc=9 2020-04-22T14:12:36.027 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[79025]: starting ceph client 2020-04-22T14:12:36.032 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[79025]: starting fuse 2020-04-22T14:12:36.035 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:12:36.040 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:12:36.040 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:36.089 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:12:36.089 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:12:36.149 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:12:36.149 INFO:teuthology.orchestra.run.smithi103.stdout:49 2020-04-22T14:12:36.149 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47, 49] 2020-04-22T14:12:36.149 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:36.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:12:36.206 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:12:36.206 INFO:teuthology.orchestra.run.smithi103:> import glob 2020-04-22T14:12:36.206 INFO:teuthology.orchestra.run.smithi103:> import re 2020-04-22T14:12:36.206 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:12:36.206 INFO:teuthology.orchestra.run.smithi103:> import subprocess 2020-04-22T14:12:36.207 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:12:36.207 INFO:teuthology.orchestra.run.smithi103:> def find_socket(client_name): 2020-04-22T14:12:36.207 INFO:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2020-04-22T14:12:36.207 INFO:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2020-04-22T14:12:36.207 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:12:36.207 INFO:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2020-04-22T14:12:36.207 INFO:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2020-04-22T14:12:36.207 INFO:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2020-04-22T14:12:36.208 INFO:teuthology.orchestra.run.smithi103:> return files[0] 2020-04-22T14:12:36.208 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:12:36.208 INFO:teuthology.orchestra.run.smithi103:> for f in files: 2020-04-22T14:12:36.208 INFO:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:12:36.208 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:12:36.208 INFO:teuthology.orchestra.run.smithi103:> return f 2020-04-22T14:12:36.208 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:12:36.208 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:12:36.208 INFO:teuthology.orchestra.run.smithi103:> print(find_socket("client.1")) 2020-04-22T14:12:36.209 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:12:36.317 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.1.79025.asok 2020-04-22T14:12:36.317 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.79025.asok 2020-04-22T14:12:36.317 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:36.331 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:12:36.331 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.79025.asok status 2020-04-22T14:12:36.489 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:12:36.489 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2020-04-22T14:12:36.489 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:12:36.490 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:12:36.490 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "1", 2020-04-22T14:12:36.490 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:12:36.490 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2020-04-22T14:12:36.490 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "79025", 2020-04-22T14:12:36.490 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:12:36.490 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:36.490 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2020-04-22T14:12:36.491 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2020-04-22T14:12:36.491 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 7264, 2020-04-22T14:12:36.491 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2020-04-22T14:12:36.491 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:12:36.491 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:12:36.491 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 7264 2020-04-22T14:12:36.491 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:36.492 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:12:36.492 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:12:36.492 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.2:0", 2020-04-22T14:12:36.492 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 2358627582 2020-04-22T14:12:36.492 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:12:36.492 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:36.492 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:12:36.492 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:12:36.493 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.2:0", 2020-04-22T14:12:36.493 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 2358627582 2020-04-22T14:12:36.493 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:12:36.493 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.7264 192.168.0.2:0/2358627582", 2020-04-22T14:12:36.493 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.2:0/2358627582", 2020-04-22T14:12:36.493 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2020-04-22T14:12:36.493 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 50, 2020-04-22T14:12:36.494 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 77, 2020-04-22T14:12:36.494 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2020-04-22T14:12:36.494 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklisted": false 2020-04-22T14:12:36.494 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:12:36.494 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:36.520 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:12:36.521 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-22T14:12:36.521 INFO:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:12:36.581 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2020-04-22T14:12:36.581 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-04-22T14:12:36.581 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:36.633 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:12:36.633 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:12:36.710 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:36.755 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok config get mds_reconnect_timeout 2020-04-22T14:12:36.909 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:12:36.910 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_reconnect_timeout": "45.000000" 2020-04-22T14:12:36.910 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:12:36.918 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_reconnect_timeout": "45.000000" } 2020-04-22T14:12:36.918 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:36.935 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok config get ms_max_backoff 2020-04-22T14:12:37.092 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:12:37.092 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_max_backoff": "15.000000" 2020-04-22T14:12:37.092 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:12:37.100 INFO:tasks.cephfs.filesystem:_json_asok output: { "ms_max_backoff": "15.000000" } 2020-04-22T14:12:37.100 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2020-04-22T14:12:37.100 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:37.114 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-04-22T14:12:37.115 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:12:37.195 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[79025]: fuse finished with error 0 and tester_r 0 2020-04-22T14:12:37.198 INFO:teuthology.orchestra.run:waiting for 900 2020-04-22T14:12:37.221 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-04-22T14:12:37.222 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:12:37.222 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:37.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:37.275 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:12:37.350 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:37.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:37.401 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down brx.2' 2020-04-22T14:12:37.559 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.2' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/30) 2020-04-22T14:12:37.560 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:37.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:37.589 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete brx.2' 2020-04-22T14:12:37.703 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.2' (5d7d8af1-1e3a-4f77-9ea9-bf8e57dc9003) successfully deleted. 2020-04-22T14:12:37.704 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:37.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:37.726 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:12:37.803 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:37.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:37.857 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:12:37.917 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:12:37.917 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:12:37.917 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:12:37.917 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:37.917 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:12:37.918 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:37.918 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:12:37.918 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:12:37.918 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:12:37.918 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:12:37.918 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:12:37.918 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:12:37.919 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:12:37.919 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:12:37.919 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:12:37.919 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42082sec preferred_lft 42082sec 2020-04-22T14:12:37.919 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:12:37.919 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:37.919 INFO:teuthology.orchestra.run.smithi103.stdout:20: brx.0@if2: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:12:37.920 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether d6:00:10:e7:64:03 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:12:37.920 INFO:teuthology.orchestra.run.smithi103.stdout:24: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:12:37.920 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether ce:89:5a:9a:cb:19 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:12:37.920 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:12:37.920 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:37.920 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::d064:7006:1dc4:a222/64 scope link noprefixroute 2020-04-22T14:12:37.920 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:37.921 INFO:teuthology.orchestra.run.smithi103.stdout:25: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-04-22T14:12:37.921 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether ce:89:5a:9a:cb:19 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2020-04-22T14:12:37.921 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:37.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:37.964 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:12:38.039 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:38.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:38.091 INFO:teuthology.orchestra.run.smithi103:> nmcli connection show 2020-04-22T14:12:38.169 INFO:teuthology.orchestra.run.smithi103.stdout:NAME UUID TYPE DEVICE 2020-04-22T14:12:38.170 INFO:teuthology.orchestra.run.smithi103.stdout:System enp3s0f1 b0a308d1-bd90-60af-eb7c-0183bb425a1a ethernet enp3s0f1 2020-04-22T14:12:38.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-brx 34a6fbe6-e468-4fa3-8cac-1c995a594c03 bridge ceph-brx 2020-04-22T14:12:38.170 INFO:teuthology.orchestra.run.smithi103.stdout:brx.1 daef9b2c-b3ac-4cb8-a7b5-7d42a481ed10 ethernet brx.1 2020-04-22T14:12:38.170 INFO:teuthology.orchestra.run.smithi103.stdout:eno1 206ad60d-195e-4d4b-a9fe-a5dd1f33a67d ethernet -- 2020-04-22T14:12:38.170 INFO:teuthology.orchestra.run.smithi103.stdout:eno2 894a7dd2-d329-4985-9ef9-84a92c6e1c6c ethernet -- 2020-04-22T14:12:38.170 INFO:teuthology.orchestra.run.smithi103.stdout:enp3s0f0 5a3237ce-06ab-4ae0-818b-45bdf036cb08 ethernet -- 2020-04-22T14:12:38.171 INFO:teuthology.orchestra.run.smithi103.stdout:Wired connection 1 182c9abc-02cb-3996-b501-afab098f7c50 ethernet -- 2020-04-22T14:12:38.171 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:38.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:38.216 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:12:38.275 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:38.323 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-04-22T14:12:38.323 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:12:38.323 INFO:teuthology.orchestra.run.smithi103:> import time 2020-04-22T14:12:38.324 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:12:38.324 INFO:teuthology.orchestra.run.smithi103:> path = "/home/ubuntu/cephtest/mnt.0/subdir" 2020-04-22T14:12:38.324 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:12:38.324 INFO:teuthology.orchestra.run.smithi103:> print("Starting creation...") 2020-04-22T14:12:38.324 INFO:teuthology.orchestra.run.smithi103:> start = time.time() 2020-04-22T14:12:38.324 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:12:38.324 INFO:teuthology.orchestra.run.smithi103:> os.mkdir(path) 2020-04-22T14:12:38.325 INFO:teuthology.orchestra.run.smithi103:> dfd = os.open(path, os.O_DIRECTORY) 2020-04-22T14:12:38.325 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:12:38.325 INFO:teuthology.orchestra.run.smithi103:> fd = open(os.path.join(path, "childfile"), "w") 2020-04-22T14:12:38.325 INFO:teuthology.orchestra.run.smithi103:> print("Finished creation in {0}s".format(time.time() - start)) 2020-04-22T14:12:38.325 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:12:38.325 INFO:teuthology.orchestra.run.smithi103:> print("Starting fsync...") 2020-04-22T14:12:38.325 INFO:teuthology.orchestra.run.smithi103:> start = time.time() 2020-04-22T14:12:38.325 INFO:teuthology.orchestra.run.smithi103:> if True: 2020-04-22T14:12:38.325 INFO:teuthology.orchestra.run.smithi103:> os.fsync(dfd) 2020-04-22T14:12:38.326 INFO:teuthology.orchestra.run.smithi103:> else: 2020-04-22T14:12:38.326 INFO:teuthology.orchestra.run.smithi103:> os.fsync(fd) 2020-04-22T14:12:38.326 INFO:teuthology.orchestra.run.smithi103:> print("Finished fsync in {0}s".format(time.time() - start)) 2020-04-22T14:12:38.326 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:12:38.448 INFO:teuthology.orchestra.run.smithi103.stdout:Starting creation... 2020-04-22T14:12:38.448 INFO:teuthology.orchestra.run.smithi103.stdout:Finished creation in 0.0059795379638671875s 2020-04-22T14:12:38.449 INFO:teuthology.orchestra.run.smithi103.stdout:Starting fsync... 2020-04-22T14:12:38.449 INFO:teuthology.orchestra.run.smithi103.stdout:Finished fsync in 0.002099752426147461s 2020-04-22T14:12:38.630 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-04-22T14:12:38.630 INFO:teuthology.orchestra.run:waiting for 300 2020-04-22T14:12:38.630 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-04-22T14:12:38.631 INFO:teuthology.orchestra.run:waiting for 300 2020-04-22T14:12:38.641 INFO:tasks.ceph.mds.b:Stopped 2020-04-22T14:12:38.641 DEBUG:teuthology.parallel:result is None 2020-04-22T14:12:38.678 INFO:tasks.ceph.mds.a:Stopped 2020-04-22T14:12:38.678 DEBUG:teuthology.parallel:result is None 2020-04-22T14:12:38.679 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:38.679 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:38.732 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mds fail b 2020-04-22T14:12:38.733 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mds fail a 2020-04-22T14:12:38.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.881+0000 7f1e29701700 1 Processor -- start 2020-04-22T14:12:38.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.881+0000 7f1e29701700 1 -- start start 2020-04-22T14:12:38.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.881+0000 7fc30b02d700 1 Processor -- start 2020-04-22T14:12:38.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.881+0000 7fc30b02d700 1 -- start start 2020-04-22T14:12:38.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.881+0000 7fc30b02d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc304143320 0x7fc30414da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:38.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.881+0000 7fc30b02d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc304062fa0 con 0x7fc3040b6580 2020-04-22T14:12:38.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.881+0000 7fc30b02d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc304063240 con 0x7fc304061020 2020-04-22T14:12:38.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.881+0000 7fc30b02d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3040634e0 con 0x7fc304143320 2020-04-22T14:12:38.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.882+0000 7fc303fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc304061020 0x7fc304143ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45300/0 (socket says 172.21.15.103:45300) 2020-04-22T14:12:38.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.882+0000 7fc303fff700 1 -- 172.21.15.103:0/433114529 learned_addr learned my addr 172.21.15.103:0/433114529 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:38.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.882+0000 7fc3095ca700 1 --2- 172.21.15.103:0/433114529 >> v2:172.21.15.86:3300/0 conn(0x7fc304143320 0x7fc30414da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:38.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.882+0000 7fc3037fe700 1 -- 172.21.15.103:0/433114529 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1091076914 0 0) 0x7fc304063240 con 0x7fc304061020 2020-04-22T14:12:38.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.882+0000 7fc3037fe700 1 -- 172.21.15.103:0/433114529 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2e8003230 con 0x7fc304061020 2020-04-22T14:12:38.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.882+0000 7fc3037fe700 1 -- 172.21.15.103:0/433114529 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 165198510 0 0) 0x7fc304062fa0 con 0x7fc3040b6580 2020-04-22T14:12:38.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.882+0000 7fc3037fe700 1 -- 172.21.15.103:0/433114529 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc304063240 con 0x7fc3040b6580 2020-04-22T14:12:38.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.882+0000 7fc3037fe700 1 -- 172.21.15.103:0/433114529 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 780382652 0 0) 0x7fc2e8003230 con 0x7fc304061020 2020-04-22T14:12:38.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.882+0000 7fc3037fe700 1 -- 172.21.15.103:0/433114529 >> v2:172.21.15.86:3300/0 conn(0x7fc304143320 msgr2=0x7fc30414da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:38.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.882+0000 7fc3037fe700 1 --2- 172.21.15.103:0/433114529 >> v2:172.21.15.86:3300/0 conn(0x7fc304143320 0x7fc30414da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:38.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.882+0000 7fc3037fe700 1 -- 172.21.15.103:0/433114529 >> v1:172.21.15.86:6789/0 conn(0x7fc3040b6580 legacy=0x7fc304062770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:38.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.882+0000 7fc3037fe700 1 -- 172.21.15.103:0/433114529 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3040b6960 con 0x7fc304061020 2020-04-22T14:12:38.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.882+0000 7fc3037fe700 1 -- 172.21.15.103:0/433114529 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fc2f00016d0 con 0x7fc304061020 2020-04-22T14:12:38.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.882+0000 7fc3037fe700 1 -- 172.21.15.103:0/433114529 >> v1:172.21.15.103:6789/0 conn(0x7fc304061020 legacy=0x7fc304143ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:38.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.882+0000 7fc3037fe700 1 --2- 172.21.15.103:0/433114529 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2e80038b0 0x7fc2e8003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:38.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.882+0000 7fc3037fe700 1 --2- 172.21.15.103:0/433114529 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2e80044d0 0x7fc2e8004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:38.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.882+0000 7fc3037fe700 1 --2- 172.21.15.103:0/433114529 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2e8004db0 0x7fc2e800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:38.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.882+0000 7fc3037fe700 1 -- 172.21.15.103:0/433114529 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3040634e0 con 0x7fc2e8004db0 2020-04-22T14:12:38.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.883+0000 7fc3037fe700 1 -- 172.21.15.103:0/433114529 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e80053a0 con 0x7fc2e80044d0 2020-04-22T14:12:38.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.883+0000 7fc3037fe700 1 -- 172.21.15.103:0/433114529 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e800bc00 con 0x7fc2e80038b0 2020-04-22T14:12:38.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.883+0000 7fc303fff700 1 --2- 172.21.15.103:0/433114529 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2e80044d0 0x7fc2e8004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:38.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.883+0000 7fc3095ca700 1 --2- 172.21.15.103:0/433114529 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2e8004db0 0x7fc2e800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:38.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.883+0000 7fc308dc9700 1 --2- 172.21.15.103:0/433114529 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2e80038b0 0x7fc2e8003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:38.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.883+0000 7fc303fff700 1 -- 172.21.15.103:0/433114529 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2e80038b0 msgr2=0x7fc2e8003cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:38.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.883+0000 7fc303fff700 1 --2- 172.21.15.103:0/433114529 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2e80038b0 0x7fc2e8003cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:38.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.883+0000 7fc303fff700 1 -- 172.21.15.103:0/433114529 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2e8004db0 msgr2=0x7fc2e800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:38.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.883+0000 7fc303fff700 1 --2- 172.21.15.103:0/433114529 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2e8004db0 0x7fc2e800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:38.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.883+0000 7fc303fff700 1 -- 172.21.15.103:0/433114529 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e8003230 con 0x7fc2e80044d0 2020-04-22T14:12:38.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.883+0000 7fc303fff700 1 --2- 172.21.15.103:0/433114529 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2e80044d0 0x7fc2e8004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc2f00014a0 tx=0x7fc3040b6af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:38.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.883+0000 7fc3095ca700 1 -- 172.21.15.103:0/433114529 reap_dead start 2020-04-22T14:12:38.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.883+0000 7fc303fff700 1 --2- 172.21.15.103:0/433114529 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2e80044d0 0x7fc2e8004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc2f00014a0 tx=0x7fc3040b6af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:38.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.883+0000 7fc303fff700 1 --2- 172.21.15.103:0/433114529 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2e80044d0 0x7fc2e8004950 secure :-1 s=READY pgs=1139 cs=0 l=1 rx=0x7fc2f00014a0 tx=0x7fc3040b6af0).ready entity=mon.1 client_cookie=28d50524cf35d73b server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:38.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.883+0000 7fc303fff700 1 --2- 172.21.15.103:0/433114529 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2e80044d0 0x7fc2e8004950 secure :-1 s=THROTTLE_DONE pgs=1139 cs=0 l=1 rx=0x7fc2f00014a0 tx=0x7fc3040b6af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:38.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.883+0000 7fc3037fe700 1 -- 172.21.15.103:0/433114529 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2f0010d40 con 0x7fc2e80044d0 2020-04-22T14:12:38.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.883+0000 7fc303fff700 1 --2- 172.21.15.103:0/433114529 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2e80044d0 0x7fc2e8004950 secure :-1 s=THROTTLE_DONE pgs=1139 cs=0 l=1 rx=0x7fc2f00014a0 tx=0x7fc3040b6af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:38.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.883+0000 7fc3037fe700 1 -- 172.21.15.103:0/433114529 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f00101c0 con 0x7fc2e80044d0 2020-04-22T14:12:38.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.883+0000 7fc303fff700 1 --2- 172.21.15.103:0/433114529 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2e80044d0 0x7fc2e8004950 secure :-1 s=THROTTLE_DONE pgs=1139 cs=0 l=1 rx=0x7fc2f00014a0 tx=0x7fc3040b6af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:38.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.883+0000 7fc3037fe700 1 -- 172.21.15.103:0/433114529 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2f0010ea0 con 0x7fc2e80044d0 2020-04-22T14:12:38.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.883+0000 7fc30b02d700 1 -- 172.21.15.103:0/433114529 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2e80044d0 msgr2=0x7fc2e8004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:38.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.883+0000 7fc30b02d700 1 --2- 172.21.15.103:0/433114529 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2e80044d0 0x7fc2e8004950 secure :-1 s=READY pgs=1139 cs=0 l=1 rx=0x7fc2f00014a0 tx=0x7fc3040b6af0).stop 2020-04-22T14:12:38.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.884+0000 7fc30b02d700 1 -- 172.21.15.103:0/433114529 shutdown_connections 2020-04-22T14:12:38.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.884+0000 7fc30b02d700 1 --2- 172.21.15.103:0/433114529 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2e80044d0 0x7fc2e8004950 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:38.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.884+0000 7fc30b02d700 1 -- 172.21.15.103:0/433114529 >> 172.21.15.103:0/433114529 conn(0x7fc30405fd90 msgr2=0x7fc304060580 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:38.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.884+0000 7fc30b02d700 1 -- 172.21.15.103:0/433114529 shutdown_connections 2020-04-22T14:12:38.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.884+0000 7fc30b02d700 1 -- 172.21.15.103:0/433114529 wait complete. 2020-04-22T14:12:38.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.885+0000 7fc30b02d700 1 Processor -- start 2020-04-22T14:12:38.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.885+0000 7fc30b02d700 1 -- start start 2020-04-22T14:12:38.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.886+0000 7fc30b02d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc2e80044d0 0x7fc304066630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:38.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.886+0000 7fc30b02d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc304153360 0x7fc3041427e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:38.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.886+0000 7fc30b02d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3040acac0 con 0x7fc304064140 2020-04-22T14:12:38.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.886+0000 7fc30b02d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3040acd60 con 0x7fc304153360 2020-04-22T14:12:38.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.886+0000 7fc30b02d700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3040ad000 con 0x7fc2e80044d0 2020-04-22T14:12:38.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.886+0000 7fc308dc9700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc2e80044d0 0x7fc304066630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:38.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.886+0000 7fc308dc9700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc2e80044d0 0x7fc304066630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53132/0 (socket says 172.21.15.103:53132) 2020-04-22T14:12:38.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.886+0000 7fc308dc9700 1 -- 172.21.15.103:0/3075083127 learned_addr learned my addr 172.21.15.103:0/3075083127 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:38.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.886+0000 7fc3095ca700 1 --2- 172.21.15.103:0/3075083127 >> v2:172.21.15.86:3300/0 conn(0x7fc304153360 0x7fc3041427e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:38.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.887+0000 7fc308dc9700 1 -- 172.21.15.103:0/3075083127 >> v2:172.21.15.86:3300/0 conn(0x7fc304153360 msgr2=0x7fc3041427e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:38.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.887+0000 7fc308dc9700 1 --2- 172.21.15.103:0/3075083127 >> v2:172.21.15.86:3300/0 conn(0x7fc304153360 0x7fc3041427e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:38.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.887+0000 7fc308dc9700 1 -- 172.21.15.103:0/3075083127 >> v1:172.21.15.103:6789/0 conn(0x7fc304064140 legacy=0x7fc304152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:38.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.887+0000 7fc301ffb700 1 -- 172.21.15.103:0/3075083127 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1587215696 0 0) 0x7fc3040acac0 con 0x7fc304064140 2020-04-22T14:12:38.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.887+0000 7fc308dc9700 1 -- 172.21.15.103:0/3075083127 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3040ac740 con 0x7fc2e80044d0 2020-04-22T14:12:38.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.887+0000 7fc308dc9700 1 --2- 172.21.15.103:0/3075083127 >> v2:172.21.15.103:3300/0 conn(0x7fc2e80044d0 0x7fc304066630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc2f80012d0 tx=0x7fc2f8010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:38.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.887+0000 7fc308dc9700 1 --2- 172.21.15.103:0/3075083127 >> v2:172.21.15.103:3300/0 conn(0x7fc2e80044d0 0x7fc304066630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc2f80012d0 tx=0x7fc2f8010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:38.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.887+0000 7fc308dc9700 1 --2- 172.21.15.103:0/3075083127 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2e80044d0 0x7fc304066630 secure :-1 s=READY pgs=1143 cs=0 l=1 rx=0x7fc2f80012d0 tx=0x7fc2f8010c80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:38.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.887+0000 7fc308dc9700 1 --2- 172.21.15.103:0/3075083127 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2e80044d0 0x7fc304066630 secure :-1 s=THROTTLE_DONE pgs=1143 cs=0 l=1 rx=0x7fc2f80012d0 tx=0x7fc2f8010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:38.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.887+0000 7fc308dc9700 1 --2- 172.21.15.103:0/3075083127 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2e80044d0 0x7fc304066630 secure :-1 s=THROTTLE_DONE pgs=1143 cs=0 l=1 rx=0x7fc2f80012d0 tx=0x7fc2f8010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:38.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.887+0000 7fc301ffb700 1 -- 172.21.15.103:0/3075083127 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2f8012700 con 0x7fc2e80044d0 2020-04-22T14:12:38.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.887+0000 7fc308dc9700 1 --2- 172.21.15.103:0/3075083127 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2e80044d0 0x7fc304066630 secure :-1 s=THROTTLE_DONE pgs=1143 cs=0 l=1 rx=0x7fc2f80012d0 tx=0x7fc2f8010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:38.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.887+0000 7fc301ffb700 1 -- 172.21.15.103:0/3075083127 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f80128a0 con 0x7fc2e80044d0 2020-04-22T14:12:38.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.887+0000 7fc301ffb700 1 -- 172.21.15.103:0/3075083127 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2f8012c80 con 0x7fc2e80044d0 2020-04-22T14:12:38.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.888+0000 7fc30b02d700 1 -- 172.21.15.103:0/3075083127 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc304156d80 con 0x7fc2e80044d0 2020-04-22T14:12:38.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.888+0000 7fc30b02d700 1 -- 172.21.15.103:0/3075083127 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc304157270 con 0x7fc2e80044d0 2020-04-22T14:12:38.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.889+0000 7fc308dc9700 1 --2- 172.21.15.103:0/3075083127 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2e80044d0 0x7fc304066630 secure :-1 s=THROTTLE_DONE pgs=1143 cs=0 l=1 rx=0x7fc2f80012d0 tx=0x7fc2f8010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:38.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.889+0000 7fc30b02d700 1 -- 172.21.15.103:0/3075083127 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3040ad1d0 con 0x7fc2e80044d0 2020-04-22T14:12:38.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.889+0000 7fc301ffb700 1 -- 172.21.15.103:0/3075083127 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fc2f80064e0 con 0x7fc2e80044d0 2020-04-22T14:12:38.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.889+0000 7fc308dc9700 1 --2- 172.21.15.103:0/3075083127 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2e80044d0 0x7fc304066630 secure :-1 s=THROTTLE_DONE pgs=1143 cs=0 l=1 rx=0x7fc2f80012d0 tx=0x7fc2f8010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:38.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.889+0000 7fc301ffb700 1 --2- 172.21.15.103:0/3075083127 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc2ec04d840 0x7fc2ec04fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:38.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.890+0000 7fc301ffb700 1 -- 172.21.15.103:0/3075083127 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc2f8061170 con 0x7fc2e80044d0 2020-04-22T14:12:38.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.890+0000 7fc303fff700 1 --2- 172.21.15.103:0/3075083127 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc2ec04d840 0x7fc2ec04fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:38.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.890+0000 7fc303fff700 1 --2- 172.21.15.103:0/3075083127 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc2ec04d840 0x7fc2ec04fd00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc2f000baa0 tx=0x7fc3040b6af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:38.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.890+0000 7fc303fff700 1 --2- 172.21.15.103:0/3075083127 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc2ec04d840 0x7fc2ec04fd00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc2f000baa0 tx=0x7fc3040b6af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:38.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.890+0000 7fc303fff700 1 --2- 172.21.15.103:0/3075083127 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc2ec04d840 0x7fc2ec04fd00 secure :-1 s=READY pgs=420 cs=0 l=1 rx=0x7fc2f000baa0 tx=0x7fc3040b6af0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:38.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.881+0000 7f1e29701700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1e2405fdf0 0x7f1e240b5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:38.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.881+0000 7f1e29701700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e2414a930 con 0x7f1e2414a460 2020-04-22T14:12:38.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.882+0000 7f1e29701700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e24146630 con 0x7f1e240bcc00 2020-04-22T14:12:38.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.882+0000 7f1e29701700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e24147480 con 0x7f1e2405fdf0 2020-04-22T14:12:38.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.882+0000 7f1e23fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f1e240bcc00 0x7f1e24146d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45302/0 (socket says 172.21.15.103:45302) 2020-04-22T14:12:38.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.882+0000 7f1e23fff700 1 -- 172.21.15.103:0/2936073026 learned_addr learned my addr 172.21.15.103:0/2936073026 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:38.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.882+0000 7f1e28f00700 1 --2- 172.21.15.103:0/2936073026 >> v2:172.21.15.86:3300/0 conn(0x7f1e2405fdf0 0x7f1e240b5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:38.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.882+0000 7f1e22ffd700 1 -- 172.21.15.103:0/2936073026 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3982874608 0 0) 0x7f1e24146630 con 0x7f1e240bcc00 2020-04-22T14:12:38.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.882+0000 7f1e22ffd700 1 -- 172.21.15.103:0/2936073026 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e10003230 con 0x7f1e240bcc00 2020-04-22T14:12:38.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.882+0000 7f1e22ffd700 1 -- 172.21.15.103:0/2936073026 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3392528089 0 0) 0x7f1e10003230 con 0x7f1e240bcc00 2020-04-22T14:12:38.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.882+0000 7f1e22ffd700 1 -- 172.21.15.103:0/2936073026 >> v2:172.21.15.86:3300/0 conn(0x7f1e2405fdf0 msgr2=0x7f1e240b5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:38.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.882+0000 7f1e22ffd700 1 --2- 172.21.15.103:0/2936073026 >> v2:172.21.15.86:3300/0 conn(0x7f1e2405fdf0 0x7f1e240b5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:38.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.882+0000 7f1e22ffd700 1 -- 172.21.15.103:0/2936073026 >> v1:172.21.15.86:6789/0 conn(0x7f1e2414a460 legacy=0x7f1e24143640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:38.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.882+0000 7f1e22ffd700 1 -- 172.21.15.103:0/2936073026 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e241468d0 con 0x7f1e240bcc00 2020-04-22T14:12:38.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.882+0000 7f1e22ffd700 1 -- 172.21.15.103:0/2936073026 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f1e14001710 con 0x7f1e240bcc00 2020-04-22T14:12:38.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.882+0000 7f1e22ffd700 1 -- 172.21.15.103:0/2936073026 >> v1:172.21.15.103:6789/0 conn(0x7f1e240bcc00 legacy=0x7f1e24146d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:38.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.882+0000 7f1e22ffd700 1 --2- 172.21.15.103:0/2936073026 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1e10003720 0x7f1e10003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:38.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.882+0000 7f1e22ffd700 1 --2- 172.21.15.103:0/2936073026 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e100044d0 0x7f1e10004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:38.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.882+0000 7f1e22ffd700 1 --2- 172.21.15.103:0/2936073026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e10004db0 0x7f1e1000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:38.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.882+0000 7f1e22ffd700 1 -- 172.21.15.103:0/2936073026 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e24147480 con 0x7f1e100044d0 2020-04-22T14:12:38.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.882+0000 7f1e22ffd700 1 -- 172.21.15.103:0/2936073026 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e100041c0 con 0x7f1e10004db0 2020-04-22T14:12:38.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.882+0000 7f1e22ffd700 1 -- 172.21.15.103:0/2936073026 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1000bb80 con 0x7f1e10003720 2020-04-22T14:12:38.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.882+0000 7f1e28f00700 1 --2- 172.21.15.103:0/2936073026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e10004db0 0x7f1e1000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:38.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.883+0000 7f1e237fe700 1 --2- 172.21.15.103:0/2936073026 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e100044d0 0x7f1e10004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:38.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.883+0000 7f1e23fff700 1 --2- 172.21.15.103:0/2936073026 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1e10003720 0x7f1e10003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:38.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.883+0000 7f1e28f00700 1 -- 172.21.15.103:0/2936073026 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1e10003720 msgr2=0x7f1e10003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:38.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.883+0000 7f1e28f00700 1 --2- 172.21.15.103:0/2936073026 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1e10003720 0x7f1e10003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:38.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.883+0000 7f1e28f00700 1 -- 172.21.15.103:0/2936073026 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e100044d0 msgr2=0x7f1e10004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:38.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.883+0000 7f1e28f00700 1 --2- 172.21.15.103:0/2936073026 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e100044d0 0x7f1e10004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:38.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.883+0000 7f1e28f00700 1 -- 172.21.15.103:0/2936073026 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e10003230 con 0x7f1e10004db0 2020-04-22T14:12:38.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.883+0000 7f1e28f00700 1 --2- 172.21.15.103:0/2936073026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e10004db0 0x7f1e1000b720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1e100054a0 tx=0x7f1e1c0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:38.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.883+0000 7f1e28f00700 1 -- 172.21.15.103:0/2936073026 reap_dead start 2020-04-22T14:12:38.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.883+0000 7f1e28f00700 1 --2- 172.21.15.103:0/2936073026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e10004db0 0x7f1e1000b720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1e100054a0 tx=0x7f1e1c0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:38.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.883+0000 7f1e28f00700 1 --2- 172.21.15.103:0/2936073026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e10004db0 0x7f1e1000b720 secure :-1 s=READY pgs=1138 cs=0 l=1 rx=0x7f1e100054a0 tx=0x7f1e1c0103d0).ready entity=mon.1 client_cookie=97f0996a8a103fae server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:38.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.883+0000 7f1e28f00700 1 --2- 172.21.15.103:0/2936073026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e10004db0 0x7f1e1000b720 secure :-1 s=THROTTLE_DONE pgs=1138 cs=0 l=1 rx=0x7f1e100054a0 tx=0x7f1e1c0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:38.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.883+0000 7f1e22ffd700 1 -- 172.21.15.103:0/2936073026 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e1c005a40 con 0x7f1e10004db0 2020-04-22T14:12:38.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.883+0000 7f1e28f00700 1 --2- 172.21.15.103:0/2936073026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e10004db0 0x7f1e1000b720 secure :-1 s=THROTTLE_DONE pgs=1138 cs=0 l=1 rx=0x7f1e100054a0 tx=0x7f1e1c0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:38.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.883+0000 7f1e28f00700 1 --2- 172.21.15.103:0/2936073026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e10004db0 0x7f1e1000b720 secure :-1 s=THROTTLE_DONE pgs=1138 cs=0 l=1 rx=0x7f1e100054a0 tx=0x7f1e1c0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:38.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.883+0000 7f1e22ffd700 1 -- 172.21.15.103:0/2936073026 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1c005ba0 con 0x7f1e10004db0 2020-04-22T14:12:38.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.883+0000 7f1e22ffd700 1 -- 172.21.15.103:0/2936073026 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e1c0110d0 con 0x7f1e10004db0 2020-04-22T14:12:38.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.883+0000 7f1e29701700 1 -- 172.21.15.103:0/2936073026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e10004db0 msgr2=0x7f1e1000b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:38.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.883+0000 7f1e29701700 1 --2- 172.21.15.103:0/2936073026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e10004db0 0x7f1e1000b720 secure :-1 s=READY pgs=1138 cs=0 l=1 rx=0x7f1e100054a0 tx=0x7f1e1c0103d0).stop 2020-04-22T14:12:38.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.884+0000 7f1e29701700 1 -- 172.21.15.103:0/2936073026 shutdown_connections 2020-04-22T14:12:38.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.884+0000 7f1e29701700 1 --2- 172.21.15.103:0/2936073026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e10004db0 0x7f1e1000b720 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:38.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.884+0000 7f1e29701700 1 -- 172.21.15.103:0/2936073026 >> 172.21.15.103:0/2936073026 conn(0x7f1e24069f30 msgr2=0x7f1e240658e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:38.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.884+0000 7f1e29701700 1 -- 172.21.15.103:0/2936073026 shutdown_connections 2020-04-22T14:12:38.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.884+0000 7f1e29701700 1 -- 172.21.15.103:0/2936073026 wait complete. 2020-04-22T14:12:38.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.885+0000 7f1e29701700 1 Processor -- start 2020-04-22T14:12:38.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.885+0000 7f1e29701700 1 -- start start 2020-04-22T14:12:38.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.886+0000 7f1e29701700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1e10004db0 0x7f1e2411f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:38.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.886+0000 7f1e29701700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1e24144cc0 0x7f1e241423e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:38.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.886+0000 7f1e29701700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e24143ec0 con 0x7f1e24144830 2020-04-22T14:12:38.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.886+0000 7f1e29701700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e2411f760 con 0x7f1e10004db0 2020-04-22T14:12:38.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.886+0000 7f1e29701700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e241440f0 con 0x7f1e24144cc0 2020-04-22T14:12:38.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.886+0000 7f1e28f00700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1e24144cc0 0x7f1e241423e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:38.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.886+0000 7f1e237fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f1e24144830 0x7f1e240ad230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45330/0 (socket says 172.21.15.103:45330) 2020-04-22T14:12:38.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.886+0000 7f1e237fe700 1 -- 172.21.15.103:0/3766758466 learned_addr learned my addr 172.21.15.103:0/3766758466 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:38.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.886+0000 7f1e28f00700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1e24144cc0 0x7f1e241423e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53142/0 (socket says 172.21.15.103:53142) 2020-04-22T14:12:38.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.886+0000 7f1e23fff700 1 --2- 172.21.15.103:0/3766758466 >> v2:172.21.15.86:3300/0 conn(0x7f1e10004db0 0x7f1e2411f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:38.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.886+0000 7f1e28f00700 1 -- 172.21.15.103:0/3766758466 >> v2:172.21.15.86:3300/0 conn(0x7f1e10004db0 msgr2=0x7f1e2411f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:38.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.886+0000 7f1e28f00700 1 --2- 172.21.15.103:0/3766758466 >> v2:172.21.15.86:3300/0 conn(0x7f1e10004db0 0x7f1e2411f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:38.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.886+0000 7f1e28f00700 1 -- 172.21.15.103:0/3766758466 >> v1:172.21.15.103:6789/0 conn(0x7f1e24144830 legacy=0x7f1e240ad230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:38.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.886+0000 7f1e28f00700 1 -- 172.21.15.103:0/3766758466 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e24144390 con 0x7f1e24144cc0 2020-04-22T14:12:38.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.887+0000 7f1e28f00700 1 --2- 172.21.15.103:0/3766758466 >> v2:172.21.15.103:3300/0 conn(0x7f1e24144cc0 0x7f1e241423e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1e100054a0 tx=0x7f1e1c0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:38.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.887+0000 7f1e28f00700 1 --2- 172.21.15.103:0/3766758466 >> v2:172.21.15.103:3300/0 conn(0x7f1e24144cc0 0x7f1e241423e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1e100054a0 tx=0x7f1e1c0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:38.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.887+0000 7f1e28f00700 1 --2- 172.21.15.103:0/3766758466 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e24144cc0 0x7f1e241423e0 secure :-1 s=READY pgs=1142 cs=0 l=1 rx=0x7f1e100054a0 tx=0x7f1e1c0103d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:38.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.887+0000 7f1e28f00700 1 --2- 172.21.15.103:0/3766758466 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e24144cc0 0x7f1e241423e0 secure :-1 s=THROTTLE_DONE pgs=1142 cs=0 l=1 rx=0x7f1e100054a0 tx=0x7f1e1c0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:38.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.887+0000 7f1e217fa700 1 -- 172.21.15.103:0/3766758466 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e1c005c30 con 0x7f1e24144cc0 2020-04-22T14:12:38.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.887+0000 7f1e28f00700 1 --2- 172.21.15.103:0/3766758466 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e24144cc0 0x7f1e241423e0 secure :-1 s=THROTTLE_DONE pgs=1142 cs=0 l=1 rx=0x7f1e100054a0 tx=0x7f1e1c0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:38.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.887+0000 7f1e217fa700 1 -- 172.21.15.103:0/3766758466 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1c005d90 con 0x7f1e24144cc0 2020-04-22T14:12:38.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.887+0000 7f1e28f00700 1 --2- 172.21.15.103:0/3766758466 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e24144cc0 0x7f1e241423e0 secure :-1 s=THROTTLE_DONE pgs=1142 cs=0 l=1 rx=0x7f1e100054a0 tx=0x7f1e1c0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:38.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.887+0000 7f1e29701700 1 -- 172.21.15.103:0/3766758466 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e240ad940 con 0x7f1e24144cc0 2020-04-22T14:12:38.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.887+0000 7f1e217fa700 1 -- 172.21.15.103:0/3766758466 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e1c00e600 con 0x7f1e24144cc0 2020-04-22T14:12:38.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.887+0000 7f1e29701700 1 -- 172.21.15.103:0/3766758466 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e24142a80 con 0x7f1e24144cc0 2020-04-22T14:12:38.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.888+0000 7f1e28f00700 1 --2- 172.21.15.103:0/3766758466 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e24144cc0 0x7f1e241423e0 secure :-1 s=THROTTLE_DONE pgs=1142 cs=0 l=1 rx=0x7f1e100054a0 tx=0x7f1e1c0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:38.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.888+0000 7f1e29701700 1 -- 172.21.15.103:0/3766758466 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e240adb30 con 0x7f1e24144cc0 2020-04-22T14:12:38.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.888+0000 7f1e217fa700 1 -- 172.21.15.103:0/3766758466 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f1e1c00e830 con 0x7f1e24144cc0 2020-04-22T14:12:38.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.888+0000 7f1e28f00700 1 --2- 172.21.15.103:0/3766758466 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e24144cc0 0x7f1e241423e0 secure :-1 s=THROTTLE_DONE pgs=1142 cs=0 l=1 rx=0x7f1e100054a0 tx=0x7f1e1c0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:38.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.889+0000 7f1e217fa700 1 --2- 172.21.15.103:0/3766758466 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1e0404d9d0 0x7f1e0404fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:38.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.889+0000 7f1e217fa700 1 -- 172.21.15.103:0/3766758466 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1e1c061a30 con 0x7f1e24144cc0 2020-04-22T14:12:38.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.889+0000 7f1e23fff700 1 --2- 172.21.15.103:0/3766758466 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1e0404d9d0 0x7f1e0404fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:38.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.889+0000 7f1e23fff700 1 --2- 172.21.15.103:0/3766758466 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1e0404d9d0 0x7f1e0404fe90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1e14001420 tx=0x7f1e1400f9e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:38.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.889+0000 7f1e23fff700 1 --2- 172.21.15.103:0/3766758466 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1e0404d9d0 0x7f1e0404fe90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1e14001420 tx=0x7f1e1400f9e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:38.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.889+0000 7f1e23fff700 1 --2- 172.21.15.103:0/3766758466 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1e0404d9d0 0x7f1e0404fe90 secure :-1 s=READY pgs=419 cs=0 l=1 rx=0x7f1e14001420 tx=0x7f1e1400f9e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:38.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.893+0000 7f1e28f00700 1 --2- 172.21.15.103:0/3766758466 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e24144cc0 0x7f1e241423e0 secure :-1 s=THROTTLE_DONE pgs=1142 cs=0 l=1 rx=0x7f1e100054a0 tx=0x7f1e1c0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:38.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.893+0000 7f1e217fa700 1 -- 172.21.15.103:0/3766758466 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f1e1c03ced0 con 0x7f1e24144cc0 2020-04-22T14:12:38.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.897+0000 7fc308dc9700 1 --2- 172.21.15.103:0/3075083127 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2e80044d0 0x7fc304066630 secure :-1 s=THROTTLE_DONE pgs=1143 cs=0 l=1 rx=0x7fc2f80012d0 tx=0x7fc2f8010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:38.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:38.897+0000 7fc301ffb700 1 -- 172.21.15.103:0/3075083127 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fc2f803c550 con 0x7fc2e80044d0 2020-04-22T14:12:39.099 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:39.096+0000 7f1e29701700 1 -- 172.21.15.103:0/3766758466 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7f1e24056c90 con 0x7f1e24144cc0 2020-04-22T14:12:39.099 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:39.097+0000 7fc30b02d700 1 -- 172.21.15.103:0/3075083127 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7fc304157270 con 0x7fc2e80044d0 2020-04-22T14:12:39.546 INFO:tasks.ceph.mon.b.smithi086.stderr:2020-04-22T14:12:39.544+0000 7fbdbf880700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-04-22T14:12:39.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:39.557+0000 7f1e28f00700 1 --2- 172.21.15.103:0/3766758466 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e24144cc0 0x7f1e241423e0 secure :-1 s=THROTTLE_DONE pgs=1142 cs=0 l=1 rx=0x7f1e100054a0 tx=0x7f1e1c0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:39.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:39.557+0000 7f1e217fa700 1 -- 172.21.15.103:0/3766758466 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 6513 v51) v1 ==== 95+0+0 (secure 0 0 0) 0x7f1e1c0404f0 con 0x7f1e24144cc0 2020-04-22T14:12:39.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:39.558+0000 7fc308dc9700 1 --2- 172.21.15.103:0/3075083127 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2e80044d0 0x7fc304066630 secure :-1 s=THROTTLE_DONE pgs=1143 cs=0 l=1 rx=0x7fc2f80012d0 tx=0x7fc2f8010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:39.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:39.558+0000 7fc301ffb700 1 -- 172.21.15.103:0/3075083127 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 5435 v51) v1 ==== 95+0+0 (secure 0 0 0) 0x7fc304157270 con 0x7fc2e80044d0 2020-04-22T14:12:39.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:39.559+0000 7fc30b02d700 1 -- 172.21.15.103:0/3075083127 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc2ec04d840 msgr2=0x7fc2ec04fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:39.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:39.559+0000 7fc30b02d700 1 --2- 172.21.15.103:0/3075083127 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc2ec04d840 0x7fc2ec04fd00 secure :-1 s=READY pgs=420 cs=0 l=1 rx=0x7fc2f000baa0 tx=0x7fc3040b6af0).stop 2020-04-22T14:12:39.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:39.559+0000 7fc30b02d700 1 -- 172.21.15.103:0/3075083127 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2e80044d0 msgr2=0x7fc304066630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:39.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:39.559+0000 7fc30b02d700 1 --2- 172.21.15.103:0/3075083127 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2e80044d0 0x7fc304066630 secure :-1 s=READY pgs=1143 cs=0 l=1 rx=0x7fc2f80012d0 tx=0x7fc2f8010c80).stop 2020-04-22T14:12:39.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:39.560+0000 7fc30b02d700 1 -- 172.21.15.103:0/3075083127 shutdown_connections 2020-04-22T14:12:39.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:39.560+0000 7fc30b02d700 1 --2- 172.21.15.103:0/3075083127 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc2ec04d840 0x7fc2ec04fd00 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:39.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:39.560+0000 7fc30b02d700 1 --2- 172.21.15.103:0/3075083127 >> v2:172.21.15.86:3300/0 conn(0x7fc304153360 0x7fc3041427e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:39.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:39.560+0000 7fc30b02d700 1 --2- 172.21.15.103:0/3075083127 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2e80044d0 0x7fc304066630 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:39.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:39.560+0000 7fc30b02d700 1 -- 172.21.15.103:0/3075083127 >> 172.21.15.103:0/3075083127 conn(0x7fc30405fd90 msgr2=0x7fc3041400e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:39.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:39.560+0000 7fc30b02d700 1 -- 172.21.15.103:0/3075083127 shutdown_connections 2020-04-22T14:12:39.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:39.560+0000 7fc30b02d700 1 -- 172.21.15.103:0/3075083127 wait complete. 2020-04-22T14:12:39.564 INFO:teuthology.orchestra.run.smithi103.stderr:failed mds gid 5435 2020-04-22T14:12:39.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:39.559+0000 7f1e29701700 1 -- 172.21.15.103:0/3766758466 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1e0404d9d0 msgr2=0x7f1e0404fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:39.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:39.559+0000 7f1e29701700 1 --2- 172.21.15.103:0/3766758466 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1e0404d9d0 0x7f1e0404fe90 secure :-1 s=READY pgs=419 cs=0 l=1 rx=0x7f1e14001420 tx=0x7f1e1400f9e0).stop 2020-04-22T14:12:39.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:39.559+0000 7f1e29701700 1 -- 172.21.15.103:0/3766758466 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e24144cc0 msgr2=0x7f1e241423e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:39.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:39.559+0000 7f1e29701700 1 --2- 172.21.15.103:0/3766758466 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e24144cc0 0x7f1e241423e0 secure :-1 s=READY pgs=1142 cs=0 l=1 rx=0x7f1e100054a0 tx=0x7f1e1c0103d0).stop 2020-04-22T14:12:39.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:39.560+0000 7f1e29701700 1 -- 172.21.15.103:0/3766758466 shutdown_connections 2020-04-22T14:12:39.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:39.560+0000 7f1e29701700 1 --2- 172.21.15.103:0/3766758466 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e24144cc0 0x7f1e241423e0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:39.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:39.560+0000 7f1e29701700 1 --2- 172.21.15.103:0/3766758466 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1e0404d9d0 0x7f1e0404fe90 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:39.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:39.560+0000 7f1e29701700 1 --2- 172.21.15.103:0/3766758466 >> v2:172.21.15.86:3300/0 conn(0x7f1e10004db0 0x7f1e2411f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:39.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:39.560+0000 7f1e29701700 1 -- 172.21.15.103:0/3766758466 >> 172.21.15.103:0/3766758466 conn(0x7f1e24069f30 msgr2=0x7f1e240bcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:39.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:39.560+0000 7f1e29701700 1 -- 172.21.15.103:0/3766758466 shutdown_connections 2020-04-22T14:12:39.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:39.560+0000 7f1e29701700 1 -- 172.21.15.103:0/3766758466 wait complete. 2020-04-22T14:12:39.566 INFO:teuthology.orchestra.run.smithi103.stderr:failed mds gid 6513 2020-04-22T14:12:39.574 DEBUG:teuthology.parallel:result is '' 2020-04-22T14:12:39.575 DEBUG:teuthology.parallel:result is '' 2020-04-22T14:12:39.575 INFO:tasks.cephfs.mount:Killing connection on ubuntu@smithi103.front.sepia.ceph.com... 2020-04-22T14:12:39.575 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:12:39.575 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:39.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:39.589 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip link set brx.1 down' 2020-04-22T14:12:39.700 INFO:tasks.cephfs.mount:Cleaning up killed connection on ubuntu@smithi103.front.sepia.ceph.com 2020-04-22T14:12:39.701 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2020-04-22T14:12:39.701 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:39.722 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-04-22T14:12:39.722 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:12:39.830 INFO:teuthology.orchestra.run:waiting for 900 2020-04-22T14:12:39.831 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:12:39.831 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:12:39.831 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:39.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:39.872 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:12:39.949 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:39.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:39.999 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down brx.1' 2020-04-22T14:12:40.165 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.1' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/29) 2020-04-22T14:12:40.165 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:40.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:40.179 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete brx.1' 2020-04-22T14:12:40.287 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.1' (daef9b2c-b3ac-4cb8-a7b5-7d42a481ed10) successfully deleted. 2020-04-22T14:12:40.287 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:40.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:40.316 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:12:40.426 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:40.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:40.447 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:12:40.505 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:12:40.506 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:12:40.506 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:12:40.506 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:40.506 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:12:40.506 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:40.506 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:12:40.506 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:12:40.507 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:12:40.507 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:12:40.507 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:12:40.507 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:12:40.507 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:12:40.507 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:12:40.507 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:12:40.508 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42080sec preferred_lft 42080sec 2020-04-22T14:12:40.508 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:12:40.508 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:40.508 INFO:teuthology.orchestra.run.smithi103.stdout:20: brx.0@if2: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:12:40.508 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether d6:00:10:e7:64:03 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:12:40.508 INFO:teuthology.orchestra.run.smithi103.stdout:24: ceph-brx: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:12:40.508 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:12:40.509 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:12:40.509 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:40.509 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::d064:7006:1dc4:a222/64 scope link noprefixroute 2020-04-22T14:12:40.509 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:12:40.509 INFO:teuthology.orchestra.run.smithi103.stdout:25: brx.1@if2: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:12:40.509 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether ce:89:5a:9a:cb:19 brd ff:ff:ff:ff:ff:ff link-netnsid 1 2020-04-22T14:12:40.510 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:40.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:40.568 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:12:40.648 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:40.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:40.693 INFO:teuthology.orchestra.run.smithi103:> nmcli connection show 2020-04-22T14:12:40.773 INFO:teuthology.orchestra.run.smithi103.stdout:NAME UUID TYPE DEVICE 2020-04-22T14:12:40.773 INFO:teuthology.orchestra.run.smithi103.stdout:System enp3s0f1 b0a308d1-bd90-60af-eb7c-0183bb425a1a ethernet enp3s0f1 2020-04-22T14:12:40.773 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-brx 34a6fbe6-e468-4fa3-8cac-1c995a594c03 bridge ceph-brx 2020-04-22T14:12:40.773 INFO:teuthology.orchestra.run.smithi103.stdout:eno1 206ad60d-195e-4d4b-a9fe-a5dd1f33a67d ethernet -- 2020-04-22T14:12:40.773 INFO:teuthology.orchestra.run.smithi103.stdout:eno2 894a7dd2-d329-4985-9ef9-84a92c6e1c6c ethernet -- 2020-04-22T14:12:40.773 INFO:teuthology.orchestra.run.smithi103.stdout:enp3s0f0 5a3237ce-06ab-4ae0-818b-45bdf036cb08 ethernet -- 2020-04-22T14:12:40.773 INFO:teuthology.orchestra.run.smithi103.stdout:Wired connection 1 182c9abc-02cb-3996-b501-afab098f7c50 ethernet -- 2020-04-22T14:12:40.774 INFO:tasks.cephfs.mount:Removing the 'ceph-brx' 2020-04-22T14:12:40.774 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:40.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:40.815 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down ceph-brx' 2020-04-22T14:12:40.976 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/28) 2020-04-22T14:12:40.976 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:40.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:40.990 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete ceph-brx' 2020-04-22T14:12:41.100 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' (34a6fbe6-e468-4fa3-8cac-1c995a594c03) successfully deleted. 2020-04-22T14:12:41.100 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:41.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:41.131 INFO:teuthology.orchestra.run.smithi103:> route 2020-04-22T14:12:41.194 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2020-04-22T14:12:41.194 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-04-22T14:12:41.194 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 102 0 0 enp3s0f1 2020-04-22T14:12:41.195 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 102 0 0 enp3s0f1 2020-04-22T14:12:41.195 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:41.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:41.251 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -D FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-04-22T14:12:41.366 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:41.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:41.390 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -D FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-04-22T14:12:41.498 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:41.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:41.526 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -t nat -D POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-04-22T14:12:41.634 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:41.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:41.663 INFO:teuthology.orchestra.run.smithi103:> cat /tmp/python-ceph-brx 2020-04-22T14:12:41.722 INFO:teuthology.orchestra.run.smithi103.stdout:0 2020-04-22T14:12:41.722 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:41.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:41.770 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 0 > /proc/sys/net/ipv4/ip_forward' 2020-04-22T14:12:41.848 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:41.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:41.896 INFO:teuthology.orchestra.run.smithi103:> rm -f /tmp/python-ceph-brx 2020-04-22T14:12:41.952 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:42.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:42.004 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:12:42.065 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:42.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:12:42.113 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:12:42.169 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-04-22T14:12:42.174 INFO:teuthology.orchestra.run.smithi103.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2020-04-22T14:12:42.174 INFO:tasks.ceph.mds.a:Restarting daemon 2020-04-22T14:12:42.174 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:42.175 INFO:tasks.ceph.mds.b:Restarting daemon 2020-04-22T14:12:42.175 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:12:42.192 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-04-22T14:12:42.223 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-04-22T14:12:42.234 INFO:tasks.ceph.mds.b:Started 2020-04-22T14:12:42.235 DEBUG:teuthology.parallel:result is None 2020-04-22T14:12:42.266 INFO:tasks.ceph.mds.a:Started 2020-04-22T14:12:42.266 DEBUG:teuthology.parallel:result is None 2020-04-22T14:12:42.266 INFO:tasks.cephfs.test_client_recovery:Waiting for reconnect... 2020-04-22T14:12:42.266 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:42.280 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:12:42.315 INFO:tasks.ceph.mds.b.smithi086.stdout:starting mds.b at 2020-04-22T14:12:42.341 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2020-04-22T14:12:42.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.426+0000 7f7df76ba700 1 Processor -- start 2020-04-22T14:12:42.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.426+0000 7f7df76ba700 1 -- start start 2020-04-22T14:12:42.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.427+0000 7f7df76ba700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7df0065fe0 0x7f7df01464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:42.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.427+0000 7f7df76ba700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7df0063e30 0x7f7df00642a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:42.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.427+0000 7f7df76ba700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7df0143300 con 0x7f7df012c0d0 2020-04-22T14:12:42.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.427+0000 7f7df76ba700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7df01435a0 con 0x7f7df0063e30 2020-04-22T14:12:42.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.427+0000 7f7df76ba700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df0143840 con 0x7f7df0065fe0 2020-04-22T14:12:42.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.427+0000 7f7df5456700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f7df012c0d0 0x7f7df005b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45358/0 (socket says 172.21.15.103:45358) 2020-04-22T14:12:42.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.427+0000 7f7df5456700 1 -- 172.21.15.103:0/1443587631 learned_addr learned my addr 172.21.15.103:0/1443587631 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:42.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.427+0000 7f7deffff700 1 -- 172.21.15.103:0/1443587631 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2000095574 0 0) 0x7f7df0143300 con 0x7f7df012c0d0 2020-04-22T14:12:42.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.427+0000 7f7df5c57700 1 --2- 172.21.15.103:0/1443587631 >> v2:172.21.15.86:3300/0 conn(0x7f7df0063e30 0x7f7df00642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:42.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.427+0000 7f7df4c55700 1 --2- 172.21.15.103:0/1443587631 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7df0065fe0 0x7f7df01464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:42.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.427+0000 7f7deffff700 1 -- 172.21.15.103:0/1443587631 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ddc003230 con 0x7f7df012c0d0 2020-04-22T14:12:42.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.428+0000 7f7deffff700 1 -- 172.21.15.103:0/1443587631 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 852602683 0 0) 0x7f7ddc003230 con 0x7f7df012c0d0 2020-04-22T14:12:42.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.428+0000 7f7deffff700 1 -- 172.21.15.103:0/1443587631 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7df0065fe0 msgr2=0x7f7df01464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:42.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.428+0000 7f7deffff700 1 --2- 172.21.15.103:0/1443587631 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7df0065fe0 0x7f7df01464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:42.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.428+0000 7f7deffff700 1 -- 172.21.15.103:0/1443587631 >> v2:172.21.15.86:3300/0 conn(0x7f7df0063e30 msgr2=0x7f7df00642a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:42.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.428+0000 7f7deffff700 1 --2- 172.21.15.103:0/1443587631 >> v2:172.21.15.86:3300/0 conn(0x7f7df0063e30 0x7f7df00642a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:42.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.428+0000 7f7deffff700 1 -- 172.21.15.103:0/1443587631 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df005bb50 con 0x7f7df012c0d0 2020-04-22T14:12:42.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.428+0000 7f7deffff700 1 -- 172.21.15.103:0/1443587631 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f7de8001a50 con 0x7f7df012c0d0 2020-04-22T14:12:42.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.428+0000 7f7deffff700 1 -- 172.21.15.103:0/1443587631 >> v1:172.21.15.103:6789/0 conn(0x7f7df012c0d0 legacy=0x7f7df005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:42.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.428+0000 7f7deffff700 1 --2- 172.21.15.103:0/1443587631 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ddc003720 0x7f7ddc003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:42.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.428+0000 7f7deffff700 1 --2- 172.21.15.103:0/1443587631 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7df0065fe0 0x7f7ddc0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:42.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.428+0000 7f7deffff700 1 --2- 172.21.15.103:0/1443587631 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ddc004930 0x7f7ddc004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:42.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.428+0000 7f7deffff700 1 -- 172.21.15.103:0/1443587631 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df01435a0 con 0x7f7ddc004930 2020-04-22T14:12:42.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.428+0000 7f7deffff700 1 -- 172.21.15.103:0/1443587631 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df0143840 con 0x7f7ddc003720 2020-04-22T14:12:42.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.428+0000 7f7deffff700 1 -- 172.21.15.103:0/1443587631 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc0040f0 con 0x7f7df0065fe0 2020-04-22T14:12:42.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.428+0000 7f7df5456700 1 --2- 172.21.15.103:0/1443587631 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ddc003720 0x7f7ddc003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:42.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.428+0000 7f7df4c55700 1 --2- 172.21.15.103:0/1443587631 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7df0065fe0 0x7f7ddc0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:42.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.428+0000 7f7df5c57700 1 --2- 172.21.15.103:0/1443587631 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ddc004930 0x7f7ddc004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:42.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.428+0000 7f7df5456700 1 -- 172.21.15.103:0/1443587631 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7df0065fe0 msgr2=0x7f7ddc0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:42.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.428+0000 7f7df5456700 1 --2- 172.21.15.103:0/1443587631 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7df0065fe0 0x7f7ddc0044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:42.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.428+0000 7f7df5456700 1 -- 172.21.15.103:0/1443587631 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ddc004930 msgr2=0x7f7ddc004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:42.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.428+0000 7f7df5456700 1 --2- 172.21.15.103:0/1443587631 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ddc004930 0x7f7ddc004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:42.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.428+0000 7f7df5456700 1 -- 172.21.15.103:0/1443587631 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ddc003230 con 0x7f7ddc003720 2020-04-22T14:12:42.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.428+0000 7f7df5456700 1 --2- 172.21.15.103:0/1443587631 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ddc003720 0x7f7ddc003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7de8001760 tx=0x7f7df005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:42.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.428+0000 7f7df5456700 1 --2- 172.21.15.103:0/1443587631 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ddc003720 0x7f7ddc003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7de8001760 tx=0x7f7df005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:42.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.428+0000 7f7df5456700 1 --2- 172.21.15.103:0/1443587631 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ddc003720 0x7f7ddc003b40 secure :-1 s=READY pgs=1150 cs=0 l=1 rx=0x7f7de8001760 tx=0x7f7df005bce0).ready entity=mon.1 client_cookie=7b3614b84a40be0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:42.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.428+0000 7f7df5456700 1 --2- 172.21.15.103:0/1443587631 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ddc003720 0x7f7ddc003b40 secure :-1 s=THROTTLE_DONE pgs=1150 cs=0 l=1 rx=0x7f7de8001760 tx=0x7f7df005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:42.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.428+0000 7f7deffff700 1 -- 172.21.15.103:0/1443587631 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7de8005d40 con 0x7f7ddc003720 2020-04-22T14:12:42.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.428+0000 7f7df5456700 1 --2- 172.21.15.103:0/1443587631 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ddc003720 0x7f7ddc003b40 secure :-1 s=THROTTLE_DONE pgs=1150 cs=0 l=1 rx=0x7f7de8001760 tx=0x7f7df005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:42.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.428+0000 7f7deffff700 1 -- 172.21.15.103:0/1443587631 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de8014280 con 0x7f7ddc003720 2020-04-22T14:12:42.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.428+0000 7f7df5456700 1 --2- 172.21.15.103:0/1443587631 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ddc003720 0x7f7ddc003b40 secure :-1 s=THROTTLE_DONE pgs=1150 cs=0 l=1 rx=0x7f7de8001760 tx=0x7f7df005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:42.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.428+0000 7f7df76ba700 1 -- 172.21.15.103:0/1443587631 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ddc003720 msgr2=0x7f7ddc003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:42.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.428+0000 7f7deffff700 1 -- 172.21.15.103:0/1443587631 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7de80146a0 con 0x7f7ddc003720 2020-04-22T14:12:42.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.428+0000 7f7df76ba700 1 --2- 172.21.15.103:0/1443587631 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ddc003720 0x7f7ddc003b40 secure :-1 s=READY pgs=1150 cs=0 l=1 rx=0x7f7de8001760 tx=0x7f7df005bce0).stop 2020-04-22T14:12:42.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.428+0000 7f7df5c57700 1 -- 172.21.15.103:0/1443587631 reap_dead start 2020-04-22T14:12:42.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.429+0000 7f7df76ba700 1 -- 172.21.15.103:0/1443587631 shutdown_connections 2020-04-22T14:12:42.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.429+0000 7f7df76ba700 1 -- 172.21.15.103:0/1443587631 >> 172.21.15.103:0/1443587631 conn(0x7f7df00b9160 msgr2=0x7f7df005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:42.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.429+0000 7f7df76ba700 1 -- 172.21.15.103:0/1443587631 shutdown_connections 2020-04-22T14:12:42.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.429+0000 7f7df76ba700 1 -- 172.21.15.103:0/1443587631 wait complete. 2020-04-22T14:12:42.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.430+0000 7f7df76ba700 1 Processor -- start 2020-04-22T14:12:42.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.430+0000 7f7df76ba700 1 -- start start 2020-04-22T14:12:42.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.431+0000 7f7df76ba700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7df00ae860 0x7f7df00b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:42.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.431+0000 7f7df76ba700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7df01532b0 0x7f7df00b2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:42.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.431+0000 7f7df76ba700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7df00af8f0 con 0x7f7df0152ed0 2020-04-22T14:12:42.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.431+0000 7f7df76ba700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7df0153770 con 0x7f7df01532b0 2020-04-22T14:12:42.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.431+0000 7f7df76ba700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df0153a10 con 0x7f7df00ae860 2020-04-22T14:12:42.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.431+0000 7f7df4c55700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7df00ae860 0x7f7df00b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:42.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.431+0000 7f7df4c55700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7df00ae860 0x7f7df00b0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:37960/0 (socket says 172.21.15.103:37960) 2020-04-22T14:12:42.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.431+0000 7f7df4c55700 1 -- 172.21.15.103:0/3135423256 learned_addr learned my addr 172.21.15.103:0/3135423256 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:42.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.431+0000 7f7df5c57700 1 --2- 172.21.15.103:0/3135423256 >> v2:172.21.15.86:3300/0 conn(0x7f7df01532b0 0x7f7df00b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:42.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.431+0000 7f7df4c55700 1 -- 172.21.15.103:0/3135423256 >> v2:172.21.15.86:3300/0 conn(0x7f7df01532b0 msgr2=0x7f7df00b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:42.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.431+0000 7f7df4c55700 1 --2- 172.21.15.103:0/3135423256 >> v2:172.21.15.86:3300/0 conn(0x7f7df01532b0 0x7f7df00b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:42.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.431+0000 7f7df4c55700 1 -- 172.21.15.103:0/3135423256 >> v1:172.21.15.86:6789/0 conn(0x7f7df0152ed0 legacy=0x7f7df0128d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:42.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.431+0000 7f7df4c55700 1 -- 172.21.15.103:0/3135423256 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df00afd50 con 0x7f7df00ae860 2020-04-22T14:12:42.444 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.431+0000 7f7df4c55700 1 --2- 172.21.15.103:0/3135423256 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7df00ae860 0x7f7df00b0be0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7de4003070 tx=0x7f7de4010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:42.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.431+0000 7f7df4c55700 1 --2- 172.21.15.103:0/3135423256 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7df00ae860 0x7f7df00b0be0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7de4003070 tx=0x7f7de4010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:42.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.431+0000 7f7df4c55700 1 --2- 172.21.15.103:0/3135423256 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7df00ae860 0x7f7df00b0be0 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7f7de4003070 tx=0x7f7de4010e40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:42.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.431+0000 7f7df4c55700 1 --2- 172.21.15.103:0/3135423256 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7df00ae860 0x7f7df00b0be0 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f7de4003070 tx=0x7f7de4010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:42.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.431+0000 7f7dee7fc700 1 -- 172.21.15.103:0/3135423256 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7de4005e90 con 0x7f7df00ae860 2020-04-22T14:12:42.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.431+0000 7f7df4c55700 1 --2- 172.21.15.103:0/3135423256 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7df00ae860 0x7f7df00b0be0 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f7de4003070 tx=0x7f7de4010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:42.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.431+0000 7f7df4c55700 1 --2- 172.21.15.103:0/3135423256 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7df00ae860 0x7f7df00b0be0 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f7de4003070 tx=0x7f7de4010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:42.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.431+0000 7f7dee7fc700 1 -- 172.21.15.103:0/3135423256 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de4007180 con 0x7f7df00ae860 2020-04-22T14:12:42.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.431+0000 7f7df76ba700 1 -- 172.21.15.103:0/3135423256 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7df0129430 con 0x7f7df00ae860 2020-04-22T14:12:42.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.431+0000 7f7dee7fc700 1 -- 172.21.15.103:0/3135423256 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7de400c470 con 0x7f7df00ae860 2020-04-22T14:12:42.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.431+0000 7f7df76ba700 1 -- 172.21.15.103:0/3135423256 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7df00b2b20 con 0x7f7df00ae860 2020-04-22T14:12:42.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.432+0000 7f7df4c55700 1 --2- 172.21.15.103:0/3135423256 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7df00ae860 0x7f7df00b0be0 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f7de4003070 tx=0x7f7de4010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:42.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.432+0000 7f7dee7fc700 1 -- 172.21.15.103:0/3135423256 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f7de400e1a0 con 0x7f7df00ae860 2020-04-22T14:12:42.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.432+0000 7f7df4c55700 1 --2- 172.21.15.103:0/3135423256 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7df00ae860 0x7f7df00b0be0 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f7de4003070 tx=0x7f7de4010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:42.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.432+0000 7f7df76ba700 1 -- 172.21.15.103:0/3135423256 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7df00affa0 con 0x7f7df00ae860 2020-04-22T14:12:42.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.432+0000 7f7dee7fc700 1 --2- 172.21.15.103:0/3135423256 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7dd004d930 0x7f7dd004fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:42.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.432+0000 7f7dee7fc700 1 -- 172.21.15.103:0/3135423256 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f7de4061180 con 0x7f7df00ae860 2020-04-22T14:12:42.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.433+0000 7f7df5456700 1 --2- 172.21.15.103:0/3135423256 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7dd004d930 0x7f7dd004fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:42.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.433+0000 7f7df5456700 1 --2- 172.21.15.103:0/3135423256 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7dd004d930 0x7f7dd004fdf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7df00b1610 tx=0x7f7df005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:42.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.433+0000 7f7df5456700 1 --2- 172.21.15.103:0/3135423256 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7dd004d930 0x7f7dd004fdf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7df00b1610 tx=0x7f7df005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:42.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.433+0000 7f7df5456700 1 --2- 172.21.15.103:0/3135423256 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7dd004d930 0x7f7dd004fdf0 secure :-1 s=READY pgs=421 cs=0 l=1 rx=0x7f7df00b1610 tx=0x7f7df005bce0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:42.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.436+0000 7f7df4c55700 1 --2- 172.21.15.103:0/3135423256 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7df00ae860 0x7f7df00b0be0 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f7de4003070 tx=0x7f7de4010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:42.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.436+0000 7f7dee7fc700 1 -- 172.21.15.103:0/3135423256 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f7de403c560 con 0x7f7df00ae860 2020-04-22T14:12:42.633 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.631+0000 7f7df76ba700 1 -- 172.21.15.103:0/3135423256 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7df0056c90 con 0x7f7df00ae860 2020-04-22T14:12:42.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.632+0000 7f7df4c55700 1 --2- 172.21.15.103:0/3135423256 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7df00ae860 0x7f7df00b0be0 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f7de4003070 tx=0x7f7de4010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:42.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.632+0000 7f7dee7fc700 1 -- 172.21.15.103:0/3135423256 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+2144 (secure 0 0 0) 0x7f7de403fb80 con 0x7f7df00ae860 2020-04-22T14:12:42.634 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:12:42.634 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:42.567294+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:replay","state_seq":1,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:12:42.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.633+0000 7f7df76ba700 1 -- 172.21.15.103:0/3135423256 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7dd004d930 msgr2=0x7f7dd004fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:42.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.633+0000 7f7df76ba700 1 --2- 172.21.15.103:0/3135423256 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7dd004d930 0x7f7dd004fdf0 secure :-1 s=READY pgs=421 cs=0 l=1 rx=0x7f7df00b1610 tx=0x7f7df005bce0).stop 2020-04-22T14:12:42.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.633+0000 7f7df76ba700 1 -- 172.21.15.103:0/3135423256 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7df00ae860 msgr2=0x7f7df00b0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:42.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.633+0000 7f7df76ba700 1 --2- 172.21.15.103:0/3135423256 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7df00ae860 0x7f7df00b0be0 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7f7de4003070 tx=0x7f7de4010e40).stop 2020-04-22T14:12:42.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.633+0000 7f7df76ba700 1 -- 172.21.15.103:0/3135423256 shutdown_connections 2020-04-22T14:12:42.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.633+0000 7f7df76ba700 1 --2- 172.21.15.103:0/3135423256 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7dd004d930 0x7f7dd004fdf0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:42.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.633+0000 7f7df76ba700 1 --2- 172.21.15.103:0/3135423256 >> v2:172.21.15.86:3300/0 conn(0x7f7df01532b0 0x7f7df00b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:42.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.633+0000 7f7df76ba700 1 --2- 172.21.15.103:0/3135423256 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7df00ae860 0x7f7df00b0be0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:42.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.633+0000 7f7df76ba700 1 -- 172.21.15.103:0/3135423256 >> 172.21.15.103:0/3135423256 conn(0x7f7df00b9160 msgr2=0x7f7df00642a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:42.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.633+0000 7f7df76ba700 1 -- 172.21.15.103:0/3135423256 shutdown_connections 2020-04-22T14:12:42.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:42.633+0000 7f7df76ba700 1 -- 172.21.15.103:0/3135423256 wait complete. 2020-04-22T14:12:42.637 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 53 2020-04-22T14:12:42.646 INFO:tasks.cephfs.filesystem:mapped states [u'up:replay'] to None 2020-04-22T14:12:43.646 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:43.667 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:12:43.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.823+0000 7ff93a1b5700 1 Processor -- start 2020-04-22T14:12:43.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.823+0000 7ff93a1b5700 1 -- start start 2020-04-22T14:12:43.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.824+0000 7ff93a1b5700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff934067170 0x7ff9340b6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:43.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.824+0000 7ff93a1b5700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff934064ec0 con 0x7ff9341426d0 2020-04-22T14:12:43.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.824+0000 7ff93a1b5700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff934146870 con 0x7ff9340ac740 2020-04-22T14:12:43.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.824+0000 7ff93a1b5700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff934065af0 con 0x7ff934067170 2020-04-22T14:12:43.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.824+0000 7ff9337fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff934067170 0x7ff9340b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:43.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.824+0000 7ff932ffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff9340ac740 0x7ff93413c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45390/0 (socket says 172.21.15.103:45390) 2020-04-22T14:12:43.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.824+0000 7ff932ffd700 1 -- 172.21.15.103:0/1203691491 learned_addr learned my addr 172.21.15.103:0/1203691491 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:43.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.824+0000 7ff9337fe700 1 -- 172.21.15.103:0/1203691491 >> v1:172.21.15.103:6789/0 conn(0x7ff9340ac740 legacy=0x7ff93413c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:43.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.825+0000 7ff9337fe700 1 -- 172.21.15.103:0/1203691491 >> v1:172.21.15.86:6789/0 conn(0x7ff9341426d0 legacy=0x7ff934142b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:43.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.824+0000 7ff9327fc700 1 -- 172.21.15.103:0/1203691491 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3794576564 0 0) 0x7ff934146870 con 0x7ff9340ac740 2020-04-22T14:12:43.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.825+0000 7ff9337fe700 1 -- 172.21.15.103:0/1203691491 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff934067550 con 0x7ff934067170 2020-04-22T14:12:43.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.825+0000 7ff9337fe700 1 --2- 172.21.15.103:0/1203691491 >> v2:172.21.15.103:3300/0 conn(0x7ff934067170 0x7ff9340b6040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff934066db0 tx=0x7ff9240088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:43.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.825+0000 7ff9337fe700 1 --2- 172.21.15.103:0/1203691491 >> v2:172.21.15.103:3300/0 conn(0x7ff934067170 0x7ff9340b6040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff934066db0 tx=0x7ff9240088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:43.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.825+0000 7ff9337fe700 1 --2- 172.21.15.103:0/1203691491 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff934067170 0x7ff9340b6040 secure :-1 s=READY pgs=1152 cs=0 l=1 rx=0x7ff934066db0 tx=0x7ff9240088e0).ready entity=mon.1 client_cookie=9c2d1a533984c261 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:43.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.825+0000 7ff9337fe700 1 --2- 172.21.15.103:0/1203691491 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff934067170 0x7ff9340b6040 secure :-1 s=THROTTLE_DONE pgs=1152 cs=0 l=1 rx=0x7ff934066db0 tx=0x7ff9240088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:43.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.825+0000 7ff9327fc700 1 -- 172.21.15.103:0/1203691491 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff924008e40 con 0x7ff934067170 2020-04-22T14:12:43.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.825+0000 7ff9337fe700 1 --2- 172.21.15.103:0/1203691491 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff934067170 0x7ff9340b6040 secure :-1 s=THROTTLE_DONE pgs=1152 cs=0 l=1 rx=0x7ff934066db0 tx=0x7ff9240088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:43.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.825+0000 7ff9337fe700 1 --2- 172.21.15.103:0/1203691491 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff934067170 0x7ff9340b6040 secure :-1 s=THROTTLE_DONE pgs=1152 cs=0 l=1 rx=0x7ff934066db0 tx=0x7ff9240088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:43.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.825+0000 7ff9327fc700 1 -- 172.21.15.103:0/1203691491 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff924012770 con 0x7ff934067170 2020-04-22T14:12:43.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.825+0000 7ff9327fc700 1 -- 172.21.15.103:0/1203691491 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff924012b90 con 0x7ff934067170 2020-04-22T14:12:43.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.825+0000 7ff93a1b5700 1 -- 172.21.15.103:0/1203691491 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff934067170 msgr2=0x7ff9340b6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:43.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.825+0000 7ff93a1b5700 1 --2- 172.21.15.103:0/1203691491 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff934067170 0x7ff9340b6040 secure :-1 s=READY pgs=1152 cs=0 l=1 rx=0x7ff934066db0 tx=0x7ff9240088e0).stop 2020-04-22T14:12:43.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.825+0000 7ff93a1b5700 1 -- 172.21.15.103:0/1203691491 shutdown_connections 2020-04-22T14:12:43.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.825+0000 7ff93a1b5700 1 --2- 172.21.15.103:0/1203691491 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff934067170 0x7ff9340b6040 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:43.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.825+0000 7ff93a1b5700 1 -- 172.21.15.103:0/1203691491 >> 172.21.15.103:0/1203691491 conn(0x7ff9340b9160 msgr2=0x7ff93405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:43.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.825+0000 7ff93a1b5700 1 -- 172.21.15.103:0/1203691491 shutdown_connections 2020-04-22T14:12:43.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.825+0000 7ff93a1b5700 1 -- 172.21.15.103:0/1203691491 wait complete. 2020-04-22T14:12:43.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.826+0000 7ff93a1b5700 1 Processor -- start 2020-04-22T14:12:43.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.826+0000 7ff93a1b5700 1 -- start start 2020-04-22T14:12:43.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.827+0000 7ff93a1b5700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff934067170 0x7ff934064280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:43.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.827+0000 7ff93a1b5700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9340646e0 con 0x7ff9340ac740 2020-04-22T14:12:43.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.827+0000 7ff93a1b5700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff934137170 con 0x7ff9341426d0 2020-04-22T14:12:43.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.827+0000 7ff93a1b5700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff934136790 con 0x7ff934067170 2020-04-22T14:12:43.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.827+0000 7ff933fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff9341426d0 0x7ff934155040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45398/0 (socket says 172.21.15.103:45398) 2020-04-22T14:12:43.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.827+0000 7ff933fff700 1 -- 172.21.15.103:0/3353724819 learned_addr learned my addr 172.21.15.103:0/3353724819 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:43.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.827+0000 7ff9337fe700 1 --2- 172.21.15.103:0/3353724819 >> v2:172.21.15.86:3300/0 conn(0x7ff934067170 0x7ff934064280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:43.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.827+0000 7ff930ff9700 1 -- 172.21.15.103:0/3353724819 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 752684906 0 0) 0x7ff934137170 con 0x7ff9341426d0 2020-04-22T14:12:43.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.827+0000 7ff930ff9700 1 -- 172.21.15.103:0/3353724819 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff914002fe0 con 0x7ff9341426d0 2020-04-22T14:12:43.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.828+0000 7ff930ff9700 1 -- 172.21.15.103:0/3353724819 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 466388158 0 0) 0x7ff928000fc0 con 0x7ff9340ac740 2020-04-22T14:12:43.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.828+0000 7ff930ff9700 1 -- 172.21.15.103:0/3353724819 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff934137170 con 0x7ff9340ac740 2020-04-22T14:12:43.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.828+0000 7ff930ff9700 1 -- 172.21.15.103:0/3353724819 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 366232833 0 0) 0x7ff914002fe0 con 0x7ff9341426d0 2020-04-22T14:12:43.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.828+0000 7ff930ff9700 1 -- 172.21.15.103:0/3353724819 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff928000fc0 con 0x7ff9341426d0 2020-04-22T14:12:43.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.828+0000 7ff930ff9700 1 -- 172.21.15.103:0/3353724819 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7ff92c001c30 con 0x7ff9341426d0 2020-04-22T14:12:43.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.828+0000 7ff9337fe700 1 -- 172.21.15.103:0/3353724819 >> v1:172.21.15.103:6789/0 conn(0x7ff9341426d0 legacy=0x7ff934155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:43.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.828+0000 7ff9337fe700 1 -- 172.21.15.103:0/3353724819 >> v1:172.21.15.86:6789/0 conn(0x7ff9340ac740 legacy=0x7ff934139030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:43.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.828+0000 7ff9337fe700 1 -- 172.21.15.103:0/3353724819 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff934136a30 con 0x7ff934067170 2020-04-22T14:12:43.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.828+0000 7ff9337fe700 1 --2- 172.21.15.103:0/3353724819 >> v2:172.21.15.86:3300/0 conn(0x7ff934067170 0x7ff934064280 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff934066db0 tx=0x7ff924008fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:43.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.828+0000 7ff9337fe700 1 --2- 172.21.15.103:0/3353724819 >> v2:172.21.15.86:3300/0 conn(0x7ff934067170 0x7ff934064280 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff934066db0 tx=0x7ff924008fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:43.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.828+0000 7ff9337fe700 1 --2- 172.21.15.103:0/3353724819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff934067170 0x7ff934064280 secure :-1 s=READY pgs=629 cs=0 l=1 rx=0x7ff934066db0 tx=0x7ff924008fa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:43.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.828+0000 7ff9337fe700 1 --2- 172.21.15.103:0/3353724819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff934067170 0x7ff934064280 secure :-1 s=THROTTLE_DONE pgs=629 cs=0 l=1 rx=0x7ff934066db0 tx=0x7ff924008fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:43.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.828+0000 7ff930ff9700 1 -- 172.21.15.103:0/3353724819 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff924012cf0 con 0x7ff934067170 2020-04-22T14:12:43.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.828+0000 7ff9337fe700 1 --2- 172.21.15.103:0/3353724819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff934067170 0x7ff934064280 secure :-1 s=THROTTLE_DONE pgs=629 cs=0 l=1 rx=0x7ff934066db0 tx=0x7ff924008fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:43.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.828+0000 7ff9337fe700 1 --2- 172.21.15.103:0/3353724819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff934067170 0x7ff934064280 secure :-1 s=THROTTLE_DONE pgs=629 cs=0 l=1 rx=0x7ff934066db0 tx=0x7ff924008fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:43.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.828+0000 7ff930ff9700 1 -- 172.21.15.103:0/3353724819 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff924012e50 con 0x7ff934067170 2020-04-22T14:12:43.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.828+0000 7ff93a1b5700 1 -- 172.21.15.103:0/3353724819 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff934136cd0 con 0x7ff934067170 2020-04-22T14:12:43.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.828+0000 7ff930ff9700 1 -- 172.21.15.103:0/3353724819 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff924007360 con 0x7ff934067170 2020-04-22T14:12:43.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.828+0000 7ff93a1b5700 1 -- 172.21.15.103:0/3353724819 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9341314c0 con 0x7ff934067170 2020-04-22T14:12:43.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.829+0000 7ff9337fe700 1 --2- 172.21.15.103:0/3353724819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff934067170 0x7ff934064280 secure :-1 s=THROTTLE_DONE pgs=629 cs=0 l=1 rx=0x7ff934066db0 tx=0x7ff924008fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:43.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.829+0000 7ff93a1b5700 1 -- 172.21.15.103:0/3353724819 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff934056c90 con 0x7ff934067170 2020-04-22T14:12:43.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.829+0000 7ff930ff9700 1 -- 172.21.15.103:0/3353724819 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ff9240056c0 con 0x7ff934067170 2020-04-22T14:12:43.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.829+0000 7ff9337fe700 1 --2- 172.21.15.103:0/3353724819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff934067170 0x7ff934064280 secure :-1 s=THROTTLE_DONE pgs=629 cs=0 l=1 rx=0x7ff934066db0 tx=0x7ff924008fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:43.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.830+0000 7ff930ff9700 1 --2- 172.21.15.103:0/3353724819 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff91404e050 0x7ff914050510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:43.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.830+0000 7ff930ff9700 1 -- 172.21.15.103:0/3353724819 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6159+0+0 (secure 0 0 0) 0x7ff924061b80 con 0x7ff934067170 2020-04-22T14:12:43.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.830+0000 7ff932ffd700 1 --2- 172.21.15.103:0/3353724819 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff91404e050 0x7ff914050510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:43.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.830+0000 7ff932ffd700 1 --2- 172.21.15.103:0/3353724819 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff91404e050 0x7ff914050510 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff928001150 tx=0x7ff9280017e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:43.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.830+0000 7ff932ffd700 1 --2- 172.21.15.103:0/3353724819 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff91404e050 0x7ff914050510 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff928001150 tx=0x7ff9280017e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:43.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.830+0000 7ff932ffd700 1 --2- 172.21.15.103:0/3353724819 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff91404e050 0x7ff914050510 secure :-1 s=READY pgs=424 cs=0 l=1 rx=0x7ff928001150 tx=0x7ff9280017e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:43.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.833+0000 7ff9337fe700 1 --2- 172.21.15.103:0/3353724819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff934067170 0x7ff934064280 secure :-1 s=THROTTLE_DONE pgs=629 cs=0 l=1 rx=0x7ff934066db0 tx=0x7ff924008fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:43.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:43.833+0000 7ff930ff9700 1 -- 172.21.15.103:0/3353724819 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ff92403cf60 con 0x7ff934067170 2020-04-22T14:12:44.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.021+0000 7ff93a1b5700 1 -- 172.21.15.103:0/3353724819 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9340b40c0 con 0x7ff934067170 2020-04-22T14:12:44.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.022+0000 7ff9337fe700 1 --2- 172.21.15.103:0/3353724819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff934067170 0x7ff934064280 secure :-1 s=THROTTLE_DONE pgs=629 cs=0 l=1 rx=0x7ff934066db0 tx=0x7ff924008fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:44.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.022+0000 7ff930ff9700 1 -- 172.21.15.103:0/3353724819 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2147 (secure 0 0 0) 0x7ff924040580 con 0x7ff934067170 2020-04-22T14:12:44.024 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:12:44.025 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:43.570838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:12:44.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.023+0000 7ff93a1b5700 1 -- 172.21.15.103:0/3353724819 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff91404e050 msgr2=0x7ff914050510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:44.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.023+0000 7ff93a1b5700 1 --2- 172.21.15.103:0/3353724819 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff91404e050 0x7ff914050510 secure :-1 s=READY pgs=424 cs=0 l=1 rx=0x7ff928001150 tx=0x7ff9280017e0).stop 2020-04-22T14:12:44.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.023+0000 7ff93a1b5700 1 -- 172.21.15.103:0/3353724819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff934067170 msgr2=0x7ff934064280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:44.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.023+0000 7ff93a1b5700 1 --2- 172.21.15.103:0/3353724819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff934067170 0x7ff934064280 secure :-1 s=READY pgs=629 cs=0 l=1 rx=0x7ff934066db0 tx=0x7ff924008fa0).stop 2020-04-22T14:12:44.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.023+0000 7ff93a1b5700 1 -- 172.21.15.103:0/3353724819 shutdown_connections 2020-04-22T14:12:44.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.023+0000 7ff93a1b5700 1 --2- 172.21.15.103:0/3353724819 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff91404e050 0x7ff914050510 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:44.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.023+0000 7ff93a1b5700 1 --2- 172.21.15.103:0/3353724819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff934067170 0x7ff934064280 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:44.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.023+0000 7ff93a1b5700 1 -- 172.21.15.103:0/3353724819 >> 172.21.15.103:0/3353724819 conn(0x7ff9340b9160 msgr2=0x7ff9340b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:44.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.023+0000 7ff93a1b5700 1 -- 172.21.15.103:0/3353724819 shutdown_connections 2020-04-22T14:12:44.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.023+0000 7ff93a1b5700 1 -- 172.21.15.103:0/3353724819 wait complete. 2020-04-22T14:12:44.027 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 54 2020-04-22T14:12:44.036 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to up:reconnect 2020-04-22T14:12:44.036 INFO:tasks.cephfs.filesystem:reached state 'up:reconnect' in 1.76951313019s 2020-04-22T14:12:44.036 INFO:tasks.cephfs.test_client_recovery:Waiting for active... 2020-04-22T14:12:44.036 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:44.049 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:12:44.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.193+0000 7fa4be9bf700 1 Processor -- start 2020-04-22T14:12:44.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.193+0000 7fa4be9bf700 1 -- start start 2020-04-22T14:12:44.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.193+0000 7fa4be9bf700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa4b812c0d0 0x7fa4b81464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:44.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.193+0000 7fa4be9bf700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4b8065fe0 0x7fa4b805b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:44.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.193+0000 7fa4be9bf700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa4b805b8a0 0x7fa4b8062ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:44.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.193+0000 7fa4be9bf700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b812c4b0 con 0x7fa4b812c0d0 2020-04-22T14:12:44.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.193+0000 7fa4be9bf700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b8143300 con 0x7fa4b805b8a0 2020-04-22T14:12:44.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.193+0000 7fa4be9bf700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b81435a0 con 0x7fa4b8065fe0 2020-04-22T14:12:44.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.194+0000 7fa4bcf5c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa4b805b8a0 0x7fa4b8062ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:44.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.194+0000 7fa4bcf5c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa4b805b8a0 0x7fa4b8062ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53212/0 (socket says 172.21.15.103:53212) 2020-04-22T14:12:44.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.194+0000 7fa4bcf5c700 1 -- 172.21.15.103:0/1527148865 learned_addr learned my addr 172.21.15.103:0/1527148865 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:44.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.194+0000 7fa4bcf5c700 1 -- 172.21.15.103:0/1527148865 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4b8065fe0 msgr2=0x7fa4b805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:44.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.194+0000 7fa4b7fff700 1 --2- 172.21.15.103:0/1527148865 >> v2:172.21.15.86:3300/0 conn(0x7fa4b812c0d0 0x7fa4b81464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:44.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.194+0000 7fa4affff700 1 --2- 172.21.15.103:0/1527148865 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4b8065fe0 0x7fa4b805b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:44.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.194+0000 7fa4bcf5c700 1 --2- 172.21.15.103:0/1527148865 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4b8065fe0 0x7fa4b805b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:44.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.194+0000 7fa4bcf5c700 1 -- 172.21.15.103:0/1527148865 >> v2:172.21.15.86:3300/0 conn(0x7fa4b812c0d0 msgr2=0x7fa4b81464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:44.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.194+0000 7fa4bcf5c700 1 --2- 172.21.15.103:0/1527148865 >> v2:172.21.15.86:3300/0 conn(0x7fa4b812c0d0 0x7fa4b81464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:44.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.194+0000 7fa4bcf5c700 1 -- 172.21.15.103:0/1527148865 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b8143840 con 0x7fa4b805b8a0 2020-04-22T14:12:44.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.194+0000 7fa4b7fff700 1 --2- 172.21.15.103:0/1527148865 >> v2:172.21.15.86:3300/0 conn(0x7fa4b812c0d0 0x7fa4b81464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:12:44.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.194+0000 7fa4bcf5c700 1 --2- 172.21.15.103:0/1527148865 >> v2:172.21.15.103:3300/0 conn(0x7fa4b805b8a0 0x7fa4b8062ab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa4b8067620 tx=0x7fa4b0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:44.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.194+0000 7fa4bcf5c700 1 --2- 172.21.15.103:0/1527148865 >> v2:172.21.15.103:3300/0 conn(0x7fa4b805b8a0 0x7fa4b8062ab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa4b8067620 tx=0x7fa4b0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:44.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.194+0000 7fa4bcf5c700 1 --2- 172.21.15.103:0/1527148865 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4b805b8a0 0x7fa4b8062ab0 secure :-1 s=READY pgs=1154 cs=0 l=1 rx=0x7fa4b8067620 tx=0x7fa4b0008c60).ready entity=mon.1 client_cookie=569b827e1cbb91db server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:44.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.194+0000 7fa4bcf5c700 1 --2- 172.21.15.103:0/1527148865 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4b805b8a0 0x7fa4b8062ab0 secure :-1 s=THROTTLE_DONE pgs=1154 cs=0 l=1 rx=0x7fa4b8067620 tx=0x7fa4b0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:44.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.194+0000 7fa4bcf5c700 1 --2- 172.21.15.103:0/1527148865 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4b805b8a0 0x7fa4b8062ab0 secure :-1 s=THROTTLE_DONE pgs=1154 cs=0 l=1 rx=0x7fa4b8067620 tx=0x7fa4b0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:44.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.194+0000 7fa4b77fe700 1 -- 172.21.15.103:0/1527148865 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4b000a180 con 0x7fa4b805b8a0 2020-04-22T14:12:44.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.194+0000 7fa4bcf5c700 1 --2- 172.21.15.103:0/1527148865 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4b805b8a0 0x7fa4b8062ab0 secure :-1 s=THROTTLE_DONE pgs=1154 cs=0 l=1 rx=0x7fa4b8067620 tx=0x7fa4b0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:44.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.194+0000 7fa4b77fe700 1 -- 172.21.15.103:0/1527148865 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b000a2e0 con 0x7fa4b805b8a0 2020-04-22T14:12:44.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.194+0000 7fa4b77fe700 1 -- 172.21.15.103:0/1527148865 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4b000a700 con 0x7fa4b805b8a0 2020-04-22T14:12:44.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.194+0000 7fa4be9bf700 1 -- 172.21.15.103:0/1527148865 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4b805b8a0 msgr2=0x7fa4b8062ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:44.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.194+0000 7fa4be9bf700 1 --2- 172.21.15.103:0/1527148865 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4b805b8a0 0x7fa4b8062ab0 secure :-1 s=READY pgs=1154 cs=0 l=1 rx=0x7fa4b8067620 tx=0x7fa4b0008c60).stop 2020-04-22T14:12:44.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.195+0000 7fa4be9bf700 1 -- 172.21.15.103:0/1527148865 shutdown_connections 2020-04-22T14:12:44.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.195+0000 7fa4be9bf700 1 --2- 172.21.15.103:0/1527148865 >> v2:172.21.15.86:3300/0 conn(0x7fa4b812c0d0 0x7fa4b81464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:44.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.195+0000 7fa4be9bf700 1 --2- 172.21.15.103:0/1527148865 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4b805b8a0 0x7fa4b8062ab0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:44.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.195+0000 7fa4be9bf700 1 --2- 172.21.15.103:0/1527148865 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4b8065fe0 0x7fa4b805b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:44.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.195+0000 7fa4be9bf700 1 -- 172.21.15.103:0/1527148865 >> 172.21.15.103:0/1527148865 conn(0x7fa4b80b9160 msgr2=0x7fa4b805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:44.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.195+0000 7fa4be9bf700 1 -- 172.21.15.103:0/1527148865 shutdown_connections 2020-04-22T14:12:44.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.195+0000 7fa4be9bf700 1 -- 172.21.15.103:0/1527148865 wait complete. 2020-04-22T14:12:44.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.196+0000 7fa4be9bf700 1 Processor -- start 2020-04-22T14:12:44.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.196+0000 7fa4be9bf700 1 -- start start 2020-04-22T14:12:44.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.196+0000 7fa4be9bf700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa4b805b8a0 0x7fa4b8127180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:44.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.196+0000 7fa4be9bf700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa4b8065fe0 0x7fa4b814b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:44.216 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.196+0000 7fa4be9bf700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4b812c0d0 0x7fa4b814be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:44.216 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.196+0000 7fa4be9bf700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b813caf0 con 0x7fa4b8065fe0 2020-04-22T14:12:44.216 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.196+0000 7fa4be9bf700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b8127a20 con 0x7fa4b805b8a0 2020-04-22T14:12:44.216 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.196+0000 7fa4be9bf700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b8127cc0 con 0x7fa4b812c0d0 2020-04-22T14:12:44.216 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.196+0000 7fa4b7fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa4b805b8a0 0x7fa4b8127180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:44.217 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.196+0000 7fa4b7fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa4b805b8a0 0x7fa4b8127180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53216/0 (socket says 172.21.15.103:53216) 2020-04-22T14:12:44.217 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.196+0000 7fa4b7fff700 1 -- 172.21.15.103:0/4008161746 learned_addr learned my addr 172.21.15.103:0/4008161746 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:44.217 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.197+0000 7fa4bcf5c700 1 --2- 172.21.15.103:0/4008161746 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4b812c0d0 0x7fa4b814be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:44.217 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.197+0000 7fa4affff700 1 --2- 172.21.15.103:0/4008161746 >> v2:172.21.15.86:3300/0 conn(0x7fa4b8065fe0 0x7fa4b814b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:44.217 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.197+0000 7fa4b7fff700 1 -- 172.21.15.103:0/4008161746 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4b812c0d0 msgr2=0x7fa4b814be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:44.217 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.197+0000 7fa4b7fff700 1 --2- 172.21.15.103:0/4008161746 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4b812c0d0 0x7fa4b814be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:44.217 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.197+0000 7fa4b7fff700 1 -- 172.21.15.103:0/4008161746 >> v2:172.21.15.86:3300/0 conn(0x7fa4b8065fe0 msgr2=0x7fa4b814b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:44.218 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.197+0000 7fa4b7fff700 1 --2- 172.21.15.103:0/4008161746 >> v2:172.21.15.86:3300/0 conn(0x7fa4b8065fe0 0x7fa4b814b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:44.218 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.197+0000 7fa4b7fff700 1 -- 172.21.15.103:0/4008161746 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b8127f60 con 0x7fa4b805b8a0 2020-04-22T14:12:44.218 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.197+0000 7fa4affff700 1 --2- 172.21.15.103:0/4008161746 >> v2:172.21.15.86:3300/0 conn(0x7fa4b8065fe0 0x7fa4b814b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:12:44.219 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.197+0000 7fa4bcf5c700 1 --2- 172.21.15.103:0/4008161746 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4b812c0d0 0x7fa4b814be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:12:44.219 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.197+0000 7fa4b7fff700 1 --2- 172.21.15.103:0/4008161746 >> v2:172.21.15.103:3300/0 conn(0x7fa4b805b8a0 0x7fa4b8127180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa4a8002f30 tx=0x7fa4a8010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:44.219 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.197+0000 7fa4b7fff700 1 --2- 172.21.15.103:0/4008161746 >> v2:172.21.15.103:3300/0 conn(0x7fa4b805b8a0 0x7fa4b8127180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa4a8002f30 tx=0x7fa4a8010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:44.219 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.197+0000 7fa4b7fff700 1 --2- 172.21.15.103:0/4008161746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4b805b8a0 0x7fa4b8127180 secure :-1 s=READY pgs=1155 cs=0 l=1 rx=0x7fa4a8002f30 tx=0x7fa4a8010b70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:44.219 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.197+0000 7fa4b7fff700 1 --2- 172.21.15.103:0/4008161746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4b805b8a0 0x7fa4b8127180 secure :-1 s=THROTTLE_DONE pgs=1155 cs=0 l=1 rx=0x7fa4a8002f30 tx=0x7fa4a8010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:44.219 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.197+0000 7fa4b7fff700 1 --2- 172.21.15.103:0/4008161746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4b805b8a0 0x7fa4b8127180 secure :-1 s=THROTTLE_DONE pgs=1155 cs=0 l=1 rx=0x7fa4a8002f30 tx=0x7fa4a8010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:44.219 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.197+0000 7fa4b5ffb700 1 -- 172.21.15.103:0/4008161746 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4a8008e80 con 0x7fa4b805b8a0 2020-04-22T14:12:44.220 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.197+0000 7fa4b7fff700 1 --2- 172.21.15.103:0/4008161746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4b805b8a0 0x7fa4b8127180 secure :-1 s=THROTTLE_DONE pgs=1155 cs=0 l=1 rx=0x7fa4a8002f30 tx=0x7fa4a8010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:44.220 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.197+0000 7fa4b5ffb700 1 -- 172.21.15.103:0/4008161746 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a8007180 con 0x7fa4b805b8a0 2020-04-22T14:12:44.220 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.197+0000 7fa4be9bf700 1 -- 172.21.15.103:0/4008161746 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4b81275e0 con 0x7fa4b805b8a0 2020-04-22T14:12:44.220 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.197+0000 7fa4b5ffb700 1 -- 172.21.15.103:0/4008161746 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4a8007560 con 0x7fa4b805b8a0 2020-04-22T14:12:44.220 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.197+0000 7fa4be9bf700 1 -- 172.21.15.103:0/4008161746 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4b81572b0 con 0x7fa4b805b8a0 2020-04-22T14:12:44.220 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.198+0000 7fa4b7fff700 1 --2- 172.21.15.103:0/4008161746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4b805b8a0 0x7fa4b8127180 secure :-1 s=THROTTLE_DONE pgs=1155 cs=0 l=1 rx=0x7fa4a8002f30 tx=0x7fa4a8010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:44.221 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.198+0000 7fa4be9bf700 1 -- 172.21.15.103:0/4008161746 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4b8127890 con 0x7fa4b805b8a0 2020-04-22T14:12:44.221 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.198+0000 7fa4b5ffb700 1 -- 172.21.15.103:0/4008161746 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fa4a80059c0 con 0x7fa4b805b8a0 2020-04-22T14:12:44.221 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.198+0000 7fa4b7fff700 1 --2- 172.21.15.103:0/4008161746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4b805b8a0 0x7fa4b8127180 secure :-1 s=THROTTLE_DONE pgs=1155 cs=0 l=1 rx=0x7fa4a8002f30 tx=0x7fa4a8010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:44.221 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.198+0000 7fa4b5ffb700 1 --2- 172.21.15.103:0/4008161746 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa49c04da70 0x7fa49c04ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:44.222 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.199+0000 7fa4b5ffb700 1 -- 172.21.15.103:0/4008161746 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fa4a80612d0 con 0x7fa4b805b8a0 2020-04-22T14:12:44.222 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.199+0000 7fa4affff700 1 --2- 172.21.15.103:0/4008161746 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa49c04da70 0x7fa49c04ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:44.222 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.199+0000 7fa4affff700 1 --2- 172.21.15.103:0/4008161746 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa49c04da70 0x7fa49c04ff30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa4a0002f30 tx=0x7fa4a0007f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:44.222 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.199+0000 7fa4affff700 1 --2- 172.21.15.103:0/4008161746 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa49c04da70 0x7fa49c04ff30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa4a0002f30 tx=0x7fa4a0007f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:44.222 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.199+0000 7fa4affff700 1 --2- 172.21.15.103:0/4008161746 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa49c04da70 0x7fa49c04ff30 secure :-1 s=READY pgs=425 cs=0 l=1 rx=0x7fa4a0002f30 tx=0x7fa4a0007f40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:44.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.202+0000 7fa4b7fff700 1 --2- 172.21.15.103:0/4008161746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4b805b8a0 0x7fa4b8127180 secure :-1 s=THROTTLE_DONE pgs=1155 cs=0 l=1 rx=0x7fa4a8002f30 tx=0x7fa4a8010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:44.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.202+0000 7fa4b5ffb700 1 -- 172.21.15.103:0/4008161746 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fa4a803c770 con 0x7fa4b805b8a0 2020-04-22T14:12:44.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.392+0000 7fa4be9bf700 1 -- 172.21.15.103:0/4008161746 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4b8056c90 con 0x7fa4b805b8a0 2020-04-22T14:12:44.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.392+0000 7fa4b7fff700 1 --2- 172.21.15.103:0/4008161746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4b805b8a0 0x7fa4b8127180 secure :-1 s=THROTTLE_DONE pgs=1155 cs=0 l=1 rx=0x7fa4a8002f30 tx=0x7fa4a8010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:44.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.392+0000 7fa4b5ffb700 1 -- 172.21.15.103:0/4008161746 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2147 (secure 0 0 0) 0x7fa4a803fd90 con 0x7fa4b805b8a0 2020-04-22T14:12:44.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.393+0000 7fa4be9bf700 1 -- 172.21.15.103:0/4008161746 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa49c04da70 msgr2=0x7fa49c04ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:44.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.393+0000 7fa4be9bf700 1 --2- 172.21.15.103:0/4008161746 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa49c04da70 0x7fa49c04ff30 secure :-1 s=READY pgs=425 cs=0 l=1 rx=0x7fa4a0002f30 tx=0x7fa4a0007f40).stop 2020-04-22T14:12:44.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.393+0000 7fa4be9bf700 1 -- 172.21.15.103:0/4008161746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4b805b8a0 msgr2=0x7fa4b8127180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:44.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.393+0000 7fa4be9bf700 1 --2- 172.21.15.103:0/4008161746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4b805b8a0 0x7fa4b8127180 secure :-1 s=READY pgs=1155 cs=0 l=1 rx=0x7fa4a8002f30 tx=0x7fa4a8010b70).stop 2020-04-22T14:12:44.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.393+0000 7fa4be9bf700 1 -- 172.21.15.103:0/4008161746 shutdown_connections 2020-04-22T14:12:44.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.393+0000 7fa4be9bf700 1 --2- 172.21.15.103:0/4008161746 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4b812c0d0 0x7fa4b814be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:44.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.393+0000 7fa4be9bf700 1 --2- 172.21.15.103:0/4008161746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4b805b8a0 0x7fa4b8127180 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:44.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.393+0000 7fa4be9bf700 1 --2- 172.21.15.103:0/4008161746 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa49c04da70 0x7fa49c04ff30 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:44.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.393+0000 7fa4be9bf700 1 --2- 172.21.15.103:0/4008161746 >> v2:172.21.15.86:3300/0 conn(0x7fa4b8065fe0 0x7fa4b814b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:44.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.393+0000 7fa4be9bf700 1 -- 172.21.15.103:0/4008161746 >> 172.21.15.103:0/4008161746 conn(0x7fa4b80b9160 msgr2=0x7fa4b8146330 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:44.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.393+0000 7fa4be9bf700 1 -- 172.21.15.103:0/4008161746 shutdown_connections 2020-04-22T14:12:44.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:44.393+0000 7fa4be9bf700 1 -- 172.21.15.103:0/4008161746 wait complete. 2020-04-22T14:12:44.402 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 54 2020-04-22T14:12:44.402 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:12:44.403 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:43.570838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:12:44.412 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:12:45.413 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:45.430 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:12:45.590 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.588+0000 7f8ee665c700 1 Processor -- start 2020-04-22T14:12:45.590 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.588+0000 7f8ee665c700 1 -- start start 2020-04-22T14:12:45.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.588+0000 7f8ee665c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ee0067170 0x7f8ee00b6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:45.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.588+0000 7f8ee665c700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ee0064ec0 con 0x7f8ee00ac740 2020-04-22T14:12:45.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.589+0000 7f8ee665c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ee0146870 con 0x7f8ee01426d0 2020-04-22T14:12:45.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.589+0000 7f8ee665c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee0065af0 con 0x7f8ee0067170 2020-04-22T14:12:45.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.589+0000 7f8ee4bf9700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f8ee01426d0 0x7f8ee0142b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45414/0 (socket says 172.21.15.103:45414) 2020-04-22T14:12:45.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.589+0000 7f8ee4bf9700 1 -- 172.21.15.103:0/37769593 learned_addr learned my addr 172.21.15.103:0/37769593 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:45.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.589+0000 7f8edf7fe700 1 -- 172.21.15.103:0/37769593 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3085330809 0 0) 0x7f8ee0146870 con 0x7f8ee01426d0 2020-04-22T14:12:45.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.589+0000 7f8edffff700 1 --2- 172.21.15.103:0/37769593 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ee0067170 0x7f8ee00b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:45.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.589+0000 7f8edf7fe700 1 -- 172.21.15.103:0/37769593 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ec0003230 con 0x7f8ee01426d0 2020-04-22T14:12:45.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.589+0000 7f8edf7fe700 1 -- 172.21.15.103:0/37769593 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3124739337 0 0) 0x7f8ec0003230 con 0x7f8ee01426d0 2020-04-22T14:12:45.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.589+0000 7f8edf7fe700 1 -- 172.21.15.103:0/37769593 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ee0067170 msgr2=0x7f8ee00b6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:45.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.589+0000 7f8edf7fe700 1 --2- 172.21.15.103:0/37769593 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ee0067170 0x7f8ee00b6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:45.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.589+0000 7f8edf7fe700 1 -- 172.21.15.103:0/37769593 >> v1:172.21.15.86:6789/0 conn(0x7f8ee00ac740 legacy=0x7f8ee013c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:45.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.589+0000 7f8edf7fe700 1 -- 172.21.15.103:0/37769593 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee0067550 con 0x7f8ee01426d0 2020-04-22T14:12:45.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.589+0000 7f8edf7fe700 1 -- 172.21.15.103:0/37769593 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f8ed8001a50 con 0x7f8ee01426d0 2020-04-22T14:12:45.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.589+0000 7f8edf7fe700 1 -- 172.21.15.103:0/37769593 >> v1:172.21.15.103:6789/0 conn(0x7f8ee01426d0 legacy=0x7f8ee0142b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:45.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.589+0000 7f8edf7fe700 1 --2- 172.21.15.103:0/37769593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ec0003720 0x7f8ec0003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:45.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.589+0000 7f8edf7fe700 1 --2- 172.21.15.103:0/37769593 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ee0067170 0x7f8ec00044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:45.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.589+0000 7f8edf7fe700 1 --2- 172.21.15.103:0/37769593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ec0004930 0x7f8ec0004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:45.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.589+0000 7f8edf7fe700 1 -- 172.21.15.103:0/37769593 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee0065af0 con 0x7f8ec0003720 2020-04-22T14:12:45.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.589+0000 7f8edf7fe700 1 -- 172.21.15.103:0/37769593 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec0005300 con 0x7f8ec0004930 2020-04-22T14:12:45.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.589+0000 7f8edf7fe700 1 -- 172.21.15.103:0/37769593 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec00040f0 con 0x7f8ee0067170 2020-04-22T14:12:45.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.589+0000 7f8edffff700 1 --2- 172.21.15.103:0/37769593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ec0003720 0x7f8ec0003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:45.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.589+0000 7f8ee4bf9700 1 --2- 172.21.15.103:0/37769593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ec0004930 0x7f8ec0004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:45.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.589+0000 7f8ed7fff700 1 --2- 172.21.15.103:0/37769593 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ee0067170 0x7f8ec00044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:45.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.590+0000 7f8ee4bf9700 1 -- 172.21.15.103:0/37769593 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ee0067170 msgr2=0x7f8ec00044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:45.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.590+0000 7f8ee4bf9700 1 --2- 172.21.15.103:0/37769593 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ee0067170 0x7f8ec00044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:45.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.590+0000 7f8ee4bf9700 1 -- 172.21.15.103:0/37769593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ec0003720 msgr2=0x7f8ec0003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:45.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.590+0000 7f8ee4bf9700 1 --2- 172.21.15.103:0/37769593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ec0003720 0x7f8ec0003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:45.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.590+0000 7f8ee4bf9700 1 -- 172.21.15.103:0/37769593 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec0003230 con 0x7f8ec0004930 2020-04-22T14:12:45.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.590+0000 7f8ee4bf9700 1 --2- 172.21.15.103:0/37769593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ec0004930 0x7f8ec0004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8ed8001760 tx=0x7f8ee00acbc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:45.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.590+0000 7f8ee4bf9700 1 --2- 172.21.15.103:0/37769593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ec0004930 0x7f8ec0004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8ed8001760 tx=0x7f8ee00acbc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:45.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.590+0000 7f8ee4bf9700 1 --2- 172.21.15.103:0/37769593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ec0004930 0x7f8ec0004db0 secure :-1 s=READY pgs=1157 cs=0 l=1 rx=0x7f8ed8001760 tx=0x7f8ee00acbc0).ready entity=mon.1 client_cookie=eaedacd00826273d server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:45.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.590+0000 7f8ee4bf9700 1 --2- 172.21.15.103:0/37769593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ec0004930 0x7f8ec0004db0 secure :-1 s=THROTTLE_DONE pgs=1157 cs=0 l=1 rx=0x7f8ed8001760 tx=0x7f8ee00acbc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:45.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.590+0000 7f8edf7fe700 1 -- 172.21.15.103:0/37769593 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ed800e560 con 0x7f8ec0004930 2020-04-22T14:12:45.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.590+0000 7f8ee4bf9700 1 --2- 172.21.15.103:0/37769593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ec0004930 0x7f8ec0004db0 secure :-1 s=THROTTLE_DONE pgs=1157 cs=0 l=1 rx=0x7f8ed8001760 tx=0x7f8ee00acbc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:45.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.590+0000 7f8edf7fe700 1 -- 172.21.15.103:0/37769593 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed800e700 con 0x7f8ec0004930 2020-04-22T14:12:45.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.590+0000 7f8ee4bf9700 1 --2- 172.21.15.103:0/37769593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ec0004930 0x7f8ec0004db0 secure :-1 s=THROTTLE_DONE pgs=1157 cs=0 l=1 rx=0x7f8ed8001760 tx=0x7f8ee00acbc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:45.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.590+0000 7f8edf7fe700 1 -- 172.21.15.103:0/37769593 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ed80100c0 con 0x7f8ec0004930 2020-04-22T14:12:45.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.590+0000 7f8ee665c700 1 -- 172.21.15.103:0/37769593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ec0004930 msgr2=0x7f8ec0004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:45.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.590+0000 7f8ee665c700 1 --2- 172.21.15.103:0/37769593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ec0004930 0x7f8ec0004db0 secure :-1 s=READY pgs=1157 cs=0 l=1 rx=0x7f8ed8001760 tx=0x7f8ee00acbc0).stop 2020-04-22T14:12:45.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.590+0000 7f8ee4bf9700 1 -- 172.21.15.103:0/37769593 reap_dead start 2020-04-22T14:12:45.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.591+0000 7f8ee665c700 1 -- 172.21.15.103:0/37769593 shutdown_connections 2020-04-22T14:12:45.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.591+0000 7f8ee665c700 1 -- 172.21.15.103:0/37769593 >> 172.21.15.103:0/37769593 conn(0x7f8ee00b9160 msgr2=0x7f8ee005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:45.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.591+0000 7f8ee665c700 1 -- 172.21.15.103:0/37769593 shutdown_connections 2020-04-22T14:12:45.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.591+0000 7f8ee665c700 1 -- 172.21.15.103:0/37769593 wait complete. 2020-04-22T14:12:45.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.592+0000 7f8ee665c700 1 Processor -- start 2020-04-22T14:12:45.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.592+0000 7f8ee665c700 1 -- start start 2020-04-22T14:12:45.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.592+0000 7f8ee665c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ee01450f0 0x7f8ee00ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:45.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.592+0000 7f8ee665c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8ee00af190 0x7f8ee00af5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:45.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.592+0000 7f8ee665c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ee00b3140 con 0x7f8ee00b2ad0 2020-04-22T14:12:45.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.592+0000 7f8ee665c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ee00b3dd0 con 0x7f8ee00af190 2020-04-22T14:12:45.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.592+0000 7f8ee665c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee00aea50 con 0x7f8ee01450f0 2020-04-22T14:12:45.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.592+0000 7f8ed7fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f8ee00b2ad0 0x7f8ee0136150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45426/0 (socket says 172.21.15.103:45426) 2020-04-22T14:12:45.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.592+0000 7f8ed7fff700 1 -- 172.21.15.103:0/1125686410 learned_addr learned my addr 172.21.15.103:0/1125686410 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:45.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.592+0000 7f8edffff700 1 --2- 172.21.15.103:0/1125686410 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ee01450f0 0x7f8ee00ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:45.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.592+0000 7f8ee4bf9700 1 --2- 172.21.15.103:0/1125686410 >> v2:172.21.15.86:3300/0 conn(0x7f8ee00af190 0x7f8ee00af5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:45.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.593+0000 7f8eddffb700 1 -- 172.21.15.103:0/1125686410 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 833519785 0 0) 0x7f8ee00b3140 con 0x7f8ee00b2ad0 2020-04-22T14:12:45.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.593+0000 7f8eddffb700 1 -- 172.21.15.103:0/1125686410 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ec4002fe0 con 0x7f8ee00b2ad0 2020-04-22T14:12:45.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.593+0000 7f8eddffb700 1 -- 172.21.15.103:0/1125686410 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2882496628 0 0) 0x7f8ec4002fe0 con 0x7f8ee00b2ad0 2020-04-22T14:12:45.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.593+0000 7f8ee4bf9700 1 -- 172.21.15.103:0/1125686410 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ee01450f0 msgr2=0x7f8ee00ae4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:45.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.593+0000 7f8ee4bf9700 1 --2- 172.21.15.103:0/1125686410 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ee01450f0 0x7f8ee00ae4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:45.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.593+0000 7f8ee4bf9700 1 -- 172.21.15.103:0/1125686410 >> v1:172.21.15.103:6789/0 conn(0x7f8ee00b2ad0 legacy=0x7f8ee0136150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:45.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.593+0000 7f8ee4bf9700 1 -- 172.21.15.103:0/1125686410 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee00aecf0 con 0x7f8ee00af190 2020-04-22T14:12:45.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.593+0000 7f8edffff700 1 --2- 172.21.15.103:0/1125686410 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ee01450f0 0x7f8ee00ae4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:12:45.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.593+0000 7f8ee4bf9700 1 --2- 172.21.15.103:0/1125686410 >> v2:172.21.15.86:3300/0 conn(0x7f8ee00af190 0x7f8ee00af5f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8ec80021e0 tx=0x7f8ee00acbc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:45.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.593+0000 7f8ee4bf9700 1 --2- 172.21.15.103:0/1125686410 >> v2:172.21.15.86:3300/0 conn(0x7f8ee00af190 0x7f8ee00af5f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8ec80021e0 tx=0x7f8ee00acbc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:45.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.593+0000 7f8ee4bf9700 1 --2- 172.21.15.103:0/1125686410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ee00af190 0x7f8ee00af5f0 secure :-1 s=READY pgs=631 cs=0 l=1 rx=0x7f8ec80021e0 tx=0x7f8ee00acbc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:45.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.593+0000 7f8ee4bf9700 1 --2- 172.21.15.103:0/1125686410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ee00af190 0x7f8ee00af5f0 secure :-1 s=THROTTLE_DONE pgs=631 cs=0 l=1 rx=0x7f8ec80021e0 tx=0x7f8ee00acbc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:45.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.593+0000 7f8eddffb700 1 -- 172.21.15.103:0/1125686410 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ec8002080 con 0x7f8ee00af190 2020-04-22T14:12:45.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.593+0000 7f8ee4bf9700 1 --2- 172.21.15.103:0/1125686410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ee00af190 0x7f8ee00af5f0 secure :-1 s=THROTTLE_DONE pgs=631 cs=0 l=1 rx=0x7f8ec80021e0 tx=0x7f8ee00acbc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:45.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.593+0000 7f8eddffb700 1 -- 172.21.15.103:0/1125686410 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed800e9c0 con 0x7f8ee00af190 2020-04-22T14:12:45.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.593+0000 7f8ee4bf9700 1 --2- 172.21.15.103:0/1125686410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ee00af190 0x7f8ee00af5f0 secure :-1 s=THROTTLE_DONE pgs=631 cs=0 l=1 rx=0x7f8ec80021e0 tx=0x7f8ee00acbc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:45.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.593+0000 7f8ee665c700 1 -- 172.21.15.103:0/1125686410 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ee01454d0 con 0x7f8ee00af190 2020-04-22T14:12:45.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.593+0000 7f8eddffb700 1 -- 172.21.15.103:0/1125686410 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ed8004930 con 0x7f8ee00af190 2020-04-22T14:12:45.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.593+0000 7f8ee665c700 1 -- 172.21.15.103:0/1125686410 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ee0136a20 con 0x7f8ee00af190 2020-04-22T14:12:45.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.594+0000 7f8ee4bf9700 1 --2- 172.21.15.103:0/1125686410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ee00af190 0x7f8ee00af5f0 secure :-1 s=THROTTLE_DONE pgs=631 cs=0 l=1 rx=0x7f8ec80021e0 tx=0x7f8ee00acbc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:45.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.594+0000 7f8ee665c700 1 -- 172.21.15.103:0/1125686410 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ee00aee80 con 0x7f8ee00af190 2020-04-22T14:12:45.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.594+0000 7f8eddffb700 1 -- 172.21.15.103:0/1125686410 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f8ed8004a90 con 0x7f8ee00af190 2020-04-22T14:12:45.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.594+0000 7f8ee4bf9700 1 --2- 172.21.15.103:0/1125686410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ee00af190 0x7f8ee00af5f0 secure :-1 s=THROTTLE_DONE pgs=631 cs=0 l=1 rx=0x7f8ec80021e0 tx=0x7f8ee00acbc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:45.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.595+0000 7f8eddffb700 1 --2- 172.21.15.103:0/1125686410 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8ec404dce0 0x7f8ec40501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:45.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.595+0000 7f8eddffb700 1 -- 172.21.15.103:0/1125686410 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f8ed8061540 con 0x7f8ee00af190 2020-04-22T14:12:45.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.595+0000 7f8edffff700 1 --2- 172.21.15.103:0/1125686410 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8ec404dce0 0x7f8ec40501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:45.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.595+0000 7f8edffff700 1 --2- 172.21.15.103:0/1125686410 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8ec404dce0 0x7f8ec40501a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8ed0002f30 tx=0x7f8ed000cf20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:45.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.595+0000 7f8edffff700 1 --2- 172.21.15.103:0/1125686410 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8ec404dce0 0x7f8ec40501a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8ed0002f30 tx=0x7f8ed000cf20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:45.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.595+0000 7f8edffff700 1 --2- 172.21.15.103:0/1125686410 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8ec404dce0 0x7f8ec40501a0 secure :-1 s=READY pgs=426 cs=0 l=1 rx=0x7f8ed0002f30 tx=0x7f8ed000cf20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:45.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.599+0000 7f8ee4bf9700 1 --2- 172.21.15.103:0/1125686410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ee00af190 0x7f8ee00af5f0 secure :-1 s=THROTTLE_DONE pgs=631 cs=0 l=1 rx=0x7f8ec80021e0 tx=0x7f8ee00acbc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:45.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.599+0000 7f8eddffb700 1 -- 172.21.15.103:0/1125686410 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f8ed803ca40 con 0x7f8ee00af190 2020-04-22T14:12:45.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.791+0000 7f8ee665c700 1 -- 172.21.15.103:0/1125686410 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ee0056c90 con 0x7f8ee00af190 2020-04-22T14:12:45.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.791+0000 7f8ee4bf9700 1 --2- 172.21.15.103:0/1125686410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ee00af190 0x7f8ee00af5f0 secure :-1 s=THROTTLE_DONE pgs=631 cs=0 l=1 rx=0x7f8ec80021e0 tx=0x7f8ee00acbc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:45.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.791+0000 7f8eddffb700 1 -- 172.21.15.103:0/1125686410 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f8ed8040060 con 0x7f8ee00af190 2020-04-22T14:12:45.794 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:12:45.794 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:43.570838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:12:45.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.793+0000 7f8ee665c700 1 -- 172.21.15.103:0/1125686410 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8ec404dce0 msgr2=0x7f8ec40501a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:45.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.793+0000 7f8ee665c700 1 --2- 172.21.15.103:0/1125686410 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8ec404dce0 0x7f8ec40501a0 secure :-1 s=READY pgs=426 cs=0 l=1 rx=0x7f8ed0002f30 tx=0x7f8ed000cf20).stop 2020-04-22T14:12:45.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.793+0000 7f8ee665c700 1 -- 172.21.15.103:0/1125686410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ee00af190 msgr2=0x7f8ee00af5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:45.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.793+0000 7f8ee665c700 1 --2- 172.21.15.103:0/1125686410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ee00af190 0x7f8ee00af5f0 secure :-1 s=READY pgs=631 cs=0 l=1 rx=0x7f8ec80021e0 tx=0x7f8ee00acbc0).stop 2020-04-22T14:12:45.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.793+0000 7f8ee665c700 1 -- 172.21.15.103:0/1125686410 shutdown_connections 2020-04-22T14:12:45.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.793+0000 7f8ee665c700 1 --2- 172.21.15.103:0/1125686410 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8ec404dce0 0x7f8ec40501a0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:45.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.793+0000 7f8ee665c700 1 --2- 172.21.15.103:0/1125686410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ee00af190 0x7f8ee00af5f0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:45.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.793+0000 7f8ee665c700 1 --2- 172.21.15.103:0/1125686410 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ee01450f0 0x7f8ee00ae4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:45.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.793+0000 7f8ee665c700 1 -- 172.21.15.103:0/1125686410 >> 172.21.15.103:0/1125686410 conn(0x7f8ee00b9160 msgr2=0x7f8ee0137f40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:45.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.793+0000 7f8ee665c700 1 -- 172.21.15.103:0/1125686410 shutdown_connections 2020-04-22T14:12:45.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:45.793+0000 7f8ee665c700 1 -- 172.21.15.103:0/1125686410 wait complete. 2020-04-22T14:12:45.797 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 54 2020-04-22T14:12:45.805 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:12:46.807 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:46.824 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:12:46.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.977+0000 7f20e81a8700 1 Processor -- start 2020-04-22T14:12:46.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.977+0000 7f20e81a8700 1 -- start start 2020-04-22T14:12:46.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.978+0000 7f20e81a8700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f20e01464e0 0x7f20e0064540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:46.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.978+0000 7f20e81a8700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20e0143300 con 0x7f20e0065fe0 2020-04-22T14:12:46.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.978+0000 7f20e81a8700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20e01435a0 con 0x7f20e012c0d0 2020-04-22T14:12:46.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.978+0000 7f20e81a8700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20e0143840 con 0x7f20e01464e0 2020-04-22T14:12:46.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.978+0000 7f20e6745700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f20e01464e0 0x7f20e0064540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:46.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.978+0000 7f20e5f44700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f20e012c0d0 0x7f20e005b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45432/0 (socket says 172.21.15.103:45432) 2020-04-22T14:12:46.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.978+0000 7f20e5f44700 1 -- 172.21.15.103:0/4277874841 learned_addr learned my addr 172.21.15.103:0/4277874841 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:46.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.978+0000 7f20e6745700 1 -- 172.21.15.103:0/4277874841 >> v1:172.21.15.103:6789/0 conn(0x7f20e012c0d0 legacy=0x7f20e005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:46.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.978+0000 7f20e6745700 1 -- 172.21.15.103:0/4277874841 >> v1:172.21.15.86:6789/0 conn(0x7f20e0065fe0 legacy=0x7f20e0063e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:46.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.978+0000 7f20e4f42700 1 -- 172.21.15.103:0/4277874841 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4147913469 0 0) 0x7f20e01435a0 con 0x7f20e012c0d0 2020-04-22T14:12:46.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.978+0000 7f20e6745700 1 -- 172.21.15.103:0/4277874841 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e005bb50 con 0x7f20e01464e0 2020-04-22T14:12:46.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.978+0000 7f20e6745700 1 --2- 172.21.15.103:0/4277874841 >> v2:172.21.15.103:3300/0 conn(0x7f20e01464e0 0x7f20e0064540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f20e0067620 tx=0x7f20dc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:46.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.978+0000 7f20e6745700 1 --2- 172.21.15.103:0/4277874841 >> v2:172.21.15.103:3300/0 conn(0x7f20e01464e0 0x7f20e0064540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f20e0067620 tx=0x7f20dc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:46.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.978+0000 7f20e6745700 1 --2- 172.21.15.103:0/4277874841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20e01464e0 0x7f20e0064540 secure :-1 s=READY pgs=1160 cs=0 l=1 rx=0x7f20e0067620 tx=0x7f20dc0088e0).ready entity=mon.1 client_cookie=5c7e31ddd00069a5 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:46.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.978+0000 7f20e6745700 1 --2- 172.21.15.103:0/4277874841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20e01464e0 0x7f20e0064540 secure :-1 s=THROTTLE_DONE pgs=1160 cs=0 l=1 rx=0x7f20e0067620 tx=0x7f20dc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:46.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.978+0000 7f20e4f42700 1 -- 172.21.15.103:0/4277874841 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20dc008e40 con 0x7f20e01464e0 2020-04-22T14:12:46.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.978+0000 7f20e6745700 1 --2- 172.21.15.103:0/4277874841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20e01464e0 0x7f20e0064540 secure :-1 s=THROTTLE_DONE pgs=1160 cs=0 l=1 rx=0x7f20e0067620 tx=0x7f20dc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:46.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.978+0000 7f20e4f42700 1 -- 172.21.15.103:0/4277874841 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20dc013830 con 0x7f20e01464e0 2020-04-22T14:12:46.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.978+0000 7f20e6745700 1 --2- 172.21.15.103:0/4277874841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20e01464e0 0x7f20e0064540 secure :-1 s=THROTTLE_DONE pgs=1160 cs=0 l=1 rx=0x7f20e0067620 tx=0x7f20dc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:46.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.978+0000 7f20e4f42700 1 -- 172.21.15.103:0/4277874841 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20dc013c10 con 0x7f20e01464e0 2020-04-22T14:12:46.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.978+0000 7f20e81a8700 1 -- 172.21.15.103:0/4277874841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20e01464e0 msgr2=0x7f20e0064540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:46.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.978+0000 7f20e81a8700 1 --2- 172.21.15.103:0/4277874841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20e01464e0 0x7f20e0064540 secure :-1 s=READY pgs=1160 cs=0 l=1 rx=0x7f20e0067620 tx=0x7f20dc0088e0).stop 2020-04-22T14:12:46.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.979+0000 7f20e81a8700 1 -- 172.21.15.103:0/4277874841 shutdown_connections 2020-04-22T14:12:46.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.979+0000 7f20e81a8700 1 --2- 172.21.15.103:0/4277874841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20e01464e0 0x7f20e0064540 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:46.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.979+0000 7f20e81a8700 1 -- 172.21.15.103:0/4277874841 >> 172.21.15.103:0/4277874841 conn(0x7f20e00b9160 msgr2=0x7f20e005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:46.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.979+0000 7f20e81a8700 1 -- 172.21.15.103:0/4277874841 shutdown_connections 2020-04-22T14:12:46.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.979+0000 7f20e81a8700 1 -- 172.21.15.103:0/4277874841 wait complete. 2020-04-22T14:12:46.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.980+0000 7f20e81a8700 1 Processor -- start 2020-04-22T14:12:46.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.980+0000 7f20e81a8700 1 -- start start 2020-04-22T14:12:46.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.981+0000 7f20e81a8700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f20e0065fe0 0x7f20e0153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:46.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.981+0000 7f20e81a8700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f20e012c0d0 0x7f20e00b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:46.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.981+0000 7f20e81a8700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f20e01464e0 0x7f20e00b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:46.991 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.981+0000 7f20e81a8700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20e00b2b00 con 0x7f20e0065fe0 2020-04-22T14:12:46.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.981+0000 7f20e81a8700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20e00b2da0 con 0x7f20e01464e0 2020-04-22T14:12:46.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.981+0000 7f20e81a8700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e00b3040 con 0x7f20e012c0d0 2020-04-22T14:12:46.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.981+0000 7f20e6745700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f20e01464e0 0x7f20e00b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:46.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.981+0000 7f20e6745700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f20e01464e0 0x7f20e00b34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53252/0 (socket says 172.21.15.103:53252) 2020-04-22T14:12:46.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.981+0000 7f20e6745700 1 -- 172.21.15.103:0/2646071361 learned_addr learned my addr 172.21.15.103:0/2646071361 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:46.992 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.981+0000 7f20e5f44700 1 --2- 172.21.15.103:0/2646071361 >> v2:172.21.15.86:3300/0 conn(0x7f20e0065fe0 0x7f20e0153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:46.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.981+0000 7f20e5743700 1 --2- 172.21.15.103:0/2646071361 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f20e012c0d0 0x7f20e00b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:46.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.981+0000 7f20e6745700 1 -- 172.21.15.103:0/2646071361 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f20e012c0d0 msgr2=0x7f20e00b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:46.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.981+0000 7f20e6745700 1 --2- 172.21.15.103:0/2646071361 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f20e012c0d0 0x7f20e00b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:46.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.981+0000 7f20e6745700 1 -- 172.21.15.103:0/2646071361 >> v2:172.21.15.86:3300/0 conn(0x7f20e0065fe0 msgr2=0x7f20e0153f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:46.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.981+0000 7f20e6745700 1 --2- 172.21.15.103:0/2646071361 >> v2:172.21.15.86:3300/0 conn(0x7f20e0065fe0 0x7f20e0153f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:46.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.981+0000 7f20e6745700 1 -- 172.21.15.103:0/2646071361 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e0144400 con 0x7f20e01464e0 2020-04-22T14:12:46.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.981+0000 7f20e5f44700 1 --2- 172.21.15.103:0/2646071361 >> v2:172.21.15.86:3300/0 conn(0x7f20e0065fe0 0x7f20e0153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:12:46.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.981+0000 7f20e6745700 1 --2- 172.21.15.103:0/2646071361 >> v2:172.21.15.103:3300/0 conn(0x7f20e01464e0 0x7f20e00b34e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f20e0067620 tx=0x7f20e005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:46.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.981+0000 7f20e6745700 1 --2- 172.21.15.103:0/2646071361 >> v2:172.21.15.103:3300/0 conn(0x7f20e01464e0 0x7f20e00b34e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f20e0067620 tx=0x7f20e005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:46.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.981+0000 7f20e6745700 1 --2- 172.21.15.103:0/2646071361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20e01464e0 0x7f20e00b34e0 secure :-1 s=READY pgs=1161 cs=0 l=1 rx=0x7f20e0067620 tx=0x7f20e005bce0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:46.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.981+0000 7f20e6745700 1 --2- 172.21.15.103:0/2646071361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20e01464e0 0x7f20e00b34e0 secure :-1 s=THROTTLE_DONE pgs=1161 cs=0 l=1 rx=0x7f20e0067620 tx=0x7f20e005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:46.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.981+0000 7f20ceffd700 1 -- 172.21.15.103:0/2646071361 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20dc011b80 con 0x7f20e01464e0 2020-04-22T14:12:46.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.981+0000 7f20e6745700 1 --2- 172.21.15.103:0/2646071361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20e01464e0 0x7f20e00b34e0 secure :-1 s=THROTTLE_DONE pgs=1161 cs=0 l=1 rx=0x7f20e0067620 tx=0x7f20e005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:46.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.981+0000 7f20e6745700 1 --2- 172.21.15.103:0/2646071361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20e01464e0 0x7f20e00b34e0 secure :-1 s=THROTTLE_DONE pgs=1161 cs=0 l=1 rx=0x7f20e0067620 tx=0x7f20e005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:46.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.981+0000 7f20ceffd700 1 -- 172.21.15.103:0/2646071361 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20dc013cd0 con 0x7f20e01464e0 2020-04-22T14:12:46.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.981+0000 7f20e81a8700 1 -- 172.21.15.103:0/2646071361 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e00b1170 con 0x7f20e01464e0 2020-04-22T14:12:46.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.981+0000 7f20ceffd700 1 -- 172.21.15.103:0/2646071361 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20dc011170 con 0x7f20e01464e0 2020-04-22T14:12:46.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.981+0000 7f20e81a8700 1 -- 172.21.15.103:0/2646071361 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20e00b3fa0 con 0x7f20e01464e0 2020-04-22T14:12:46.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.982+0000 7f20e6745700 1 --2- 172.21.15.103:0/2646071361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20e01464e0 0x7f20e00b34e0 secure :-1 s=THROTTLE_DONE pgs=1161 cs=0 l=1 rx=0x7f20e0067620 tx=0x7f20e005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:46.996 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.982+0000 7f20ceffd700 1 -- 172.21.15.103:0/2646071361 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f20dc007190 con 0x7f20e01464e0 2020-04-22T14:12:46.996 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.982+0000 7f20e6745700 1 --2- 172.21.15.103:0/2646071361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20e01464e0 0x7f20e00b34e0 secure :-1 s=THROTTLE_DONE pgs=1161 cs=0 l=1 rx=0x7f20e0067620 tx=0x7f20e005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:46.996 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.983+0000 7f20e81a8700 1 -- 172.21.15.103:0/2646071361 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20e0056c90 con 0x7f20e01464e0 2020-04-22T14:12:46.996 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.983+0000 7f20ceffd700 1 --2- 172.21.15.103:0/2646071361 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f20c004d9e0 0x7f20c004fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:46.997 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.983+0000 7f20ceffd700 1 -- 172.21.15.103:0/2646071361 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f20dc061740 con 0x7f20e01464e0 2020-04-22T14:12:46.997 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.983+0000 7f20e5f44700 1 --2- 172.21.15.103:0/2646071361 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f20c004d9e0 0x7f20c004fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:46.997 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.983+0000 7f20e5f44700 1 --2- 172.21.15.103:0/2646071361 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f20c004d9e0 0x7f20c004fea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f20d8000f00 tx=0x7f20d8001a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:46.997 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.983+0000 7f20e5f44700 1 --2- 172.21.15.103:0/2646071361 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f20c004d9e0 0x7f20c004fea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f20d8000f00 tx=0x7f20d8001a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:46.997 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.983+0000 7f20e5f44700 1 --2- 172.21.15.103:0/2646071361 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f20c004d9e0 0x7f20c004fea0 secure :-1 s=READY pgs=427 cs=0 l=1 rx=0x7f20d8000f00 tx=0x7f20d8001a90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:46.997 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.987+0000 7f20e6745700 1 --2- 172.21.15.103:0/2646071361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20e01464e0 0x7f20e00b34e0 secure :-1 s=THROTTLE_DONE pgs=1161 cs=0 l=1 rx=0x7f20e0067620 tx=0x7f20e005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:46.997 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:46.987+0000 7f20ceffd700 1 -- 172.21.15.103:0/2646071361 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f20dc03cb20 con 0x7f20e01464e0 2020-04-22T14:12:47.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:47.173+0000 7f20e81a8700 1 -- 172.21.15.103:0/2646071361 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20e00b3fa0 con 0x7f20e01464e0 2020-04-22T14:12:47.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:47.173+0000 7f20e6745700 1 --2- 172.21.15.103:0/2646071361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20e01464e0 0x7f20e00b34e0 secure :-1 s=THROTTLE_DONE pgs=1161 cs=0 l=1 rx=0x7f20e0067620 tx=0x7f20e005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:47.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:47.173+0000 7f20ceffd700 1 -- 172.21.15.103:0/2646071361 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f20e00b3fa0 con 0x7f20e01464e0 2020-04-22T14:12:47.176 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:12:47.176 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:43.570838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:12:47.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:47.174+0000 7f20e81a8700 1 -- 172.21.15.103:0/2646071361 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f20c004d9e0 msgr2=0x7f20c004fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:47.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:47.174+0000 7f20e81a8700 1 --2- 172.21.15.103:0/2646071361 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f20c004d9e0 0x7f20c004fea0 secure :-1 s=READY pgs=427 cs=0 l=1 rx=0x7f20d8000f00 tx=0x7f20d8001a90).stop 2020-04-22T14:12:47.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:47.175+0000 7f20e81a8700 1 -- 172.21.15.103:0/2646071361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20e01464e0 msgr2=0x7f20e00b34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:47.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:47.175+0000 7f20e81a8700 1 --2- 172.21.15.103:0/2646071361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20e01464e0 0x7f20e00b34e0 secure :-1 s=READY pgs=1161 cs=0 l=1 rx=0x7f20e0067620 tx=0x7f20e005bce0).stop 2020-04-22T14:12:47.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:47.175+0000 7f20e81a8700 1 -- 172.21.15.103:0/2646071361 shutdown_connections 2020-04-22T14:12:47.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:47.175+0000 7f20e81a8700 1 --2- 172.21.15.103:0/2646071361 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f20c004d9e0 0x7f20c004fea0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:47.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:47.175+0000 7f20e81a8700 1 --2- 172.21.15.103:0/2646071361 >> v2:172.21.15.86:3300/0 conn(0x7f20e0065fe0 0x7f20e0153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:47.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:47.175+0000 7f20e81a8700 1 --2- 172.21.15.103:0/2646071361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20e01464e0 0x7f20e00b34e0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:47.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:47.175+0000 7f20e81a8700 1 --2- 172.21.15.103:0/2646071361 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f20e012c0d0 0x7f20e00b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:47.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:47.175+0000 7f20e81a8700 1 -- 172.21.15.103:0/2646071361 >> 172.21.15.103:0/2646071361 conn(0x7f20e00b9160 msgr2=0x7f20e0129ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:47.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:47.175+0000 7f20e81a8700 1 -- 172.21.15.103:0/2646071361 shutdown_connections 2020-04-22T14:12:47.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:47.175+0000 7f20e81a8700 1 -- 172.21.15.103:0/2646071361 wait complete. 2020-04-22T14:12:47.179 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 54 2020-04-22T14:12:47.187 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:12:48.188 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:48.204 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:12:48.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.358+0000 7f557e710700 1 Processor -- start 2020-04-22T14:12:48.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.358+0000 7f557e710700 1 -- start start 2020-04-22T14:12:48.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.359+0000 7f557e710700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f557812c0d0 0x7f55781464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:48.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.359+0000 7f557e710700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5578065fe0 0x7f557805b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:48.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.359+0000 7f557e710700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f557805b8a0 0x7f5578062ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:48.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.359+0000 7f557e710700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f557812c4b0 con 0x7f5578065fe0 2020-04-22T14:12:48.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.359+0000 7f557e710700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5578143300 con 0x7f557805b8a0 2020-04-22T14:12:48.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.359+0000 7f557e710700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55781435a0 con 0x7f557812c0d0 2020-04-22T14:12:48.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.359+0000 7f557ccad700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f557805b8a0 0x7f5578062ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:48.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.359+0000 7f557ccad700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f557805b8a0 0x7f5578062ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53260/0 (socket says 172.21.15.103:53260) 2020-04-22T14:12:48.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.359+0000 7f557ccad700 1 -- 172.21.15.103:0/3726537040 learned_addr learned my addr 172.21.15.103:0/3726537040 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:48.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.359+0000 7f5577fff700 1 --2- 172.21.15.103:0/3726537040 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f557812c0d0 0x7f55781464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:48.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.359+0000 7f55777fe700 1 --2- 172.21.15.103:0/3726537040 >> v2:172.21.15.86:3300/0 conn(0x7f5578065fe0 0x7f557805b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:48.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.359+0000 7f557ccad700 1 -- 172.21.15.103:0/3726537040 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f557812c0d0 msgr2=0x7f55781464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:48.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.359+0000 7f557ccad700 1 --2- 172.21.15.103:0/3726537040 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f557812c0d0 0x7f55781464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:48.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.359+0000 7f557ccad700 1 -- 172.21.15.103:0/3726537040 >> v2:172.21.15.86:3300/0 conn(0x7f5578065fe0 msgr2=0x7f557805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:48.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.359+0000 7f557ccad700 1 --2- 172.21.15.103:0/3726537040 >> v2:172.21.15.86:3300/0 conn(0x7f5578065fe0 0x7f557805b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:48.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.359+0000 7f557ccad700 1 -- 172.21.15.103:0/3726537040 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5578143840 con 0x7f557805b8a0 2020-04-22T14:12:48.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.359+0000 7f5577fff700 1 --2- 172.21.15.103:0/3726537040 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f557812c0d0 0x7f55781464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:12:48.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.359+0000 7f55777fe700 1 --2- 172.21.15.103:0/3726537040 >> v2:172.21.15.86:3300/0 conn(0x7f5578065fe0 0x7f557805b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:12:48.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.359+0000 7f557ccad700 1 --2- 172.21.15.103:0/3726537040 >> v2:172.21.15.103:3300/0 conn(0x7f557805b8a0 0x7f5578062ab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f55700032b0 tx=0x7f5570007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:48.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.359+0000 7f557ccad700 1 --2- 172.21.15.103:0/3726537040 >> v2:172.21.15.103:3300/0 conn(0x7f557805b8a0 0x7f5578062ab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f55700032b0 tx=0x7f5570007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:48.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.359+0000 7f557ccad700 1 --2- 172.21.15.103:0/3726537040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f557805b8a0 0x7f5578062ab0 secure :-1 s=READY pgs=1162 cs=0 l=1 rx=0x7f55700032b0 tx=0x7f5570007dc0).ready entity=mon.1 client_cookie=e9409537790a49f0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:48.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.360+0000 7f557ccad700 1 --2- 172.21.15.103:0/3726537040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f557805b8a0 0x7f5578062ab0 secure :-1 s=THROTTLE_DONE pgs=1162 cs=0 l=1 rx=0x7f55700032b0 tx=0x7f5570007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:48.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.360+0000 7f5576ffd700 1 -- 172.21.15.103:0/3726537040 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f557000a180 con 0x7f557805b8a0 2020-04-22T14:12:48.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.360+0000 7f557ccad700 1 --2- 172.21.15.103:0/3726537040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f557805b8a0 0x7f5578062ab0 secure :-1 s=THROTTLE_DONE pgs=1162 cs=0 l=1 rx=0x7f55700032b0 tx=0x7f5570007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:48.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.360+0000 7f557ccad700 1 --2- 172.21.15.103:0/3726537040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f557805b8a0 0x7f5578062ab0 secure :-1 s=THROTTLE_DONE pgs=1162 cs=0 l=1 rx=0x7f55700032b0 tx=0x7f5570007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:48.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.360+0000 7f5576ffd700 1 -- 172.21.15.103:0/3726537040 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557000a2e0 con 0x7f557805b8a0 2020-04-22T14:12:48.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.360+0000 7f5576ffd700 1 -- 172.21.15.103:0/3726537040 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f557000a700 con 0x7f557805b8a0 2020-04-22T14:12:48.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.360+0000 7f557e710700 1 -- 172.21.15.103:0/3726537040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f557805b8a0 msgr2=0x7f5578062ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:48.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.360+0000 7f557e710700 1 --2- 172.21.15.103:0/3726537040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f557805b8a0 0x7f5578062ab0 secure :-1 s=READY pgs=1162 cs=0 l=1 rx=0x7f55700032b0 tx=0x7f5570007dc0).stop 2020-04-22T14:12:48.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.360+0000 7f557e710700 1 -- 172.21.15.103:0/3726537040 shutdown_connections 2020-04-22T14:12:48.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.360+0000 7f557e710700 1 --2- 172.21.15.103:0/3726537040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f557805b8a0 0x7f5578062ab0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:48.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.360+0000 7f557e710700 1 --2- 172.21.15.103:0/3726537040 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f557812c0d0 0x7f55781464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:48.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.360+0000 7f557e710700 1 --2- 172.21.15.103:0/3726537040 >> v2:172.21.15.86:3300/0 conn(0x7f5578065fe0 0x7f557805b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:48.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.360+0000 7f557e710700 1 -- 172.21.15.103:0/3726537040 >> 172.21.15.103:0/3726537040 conn(0x7f55780b9160 msgr2=0x7f557805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:48.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.360+0000 7f557e710700 1 -- 172.21.15.103:0/3726537040 shutdown_connections 2020-04-22T14:12:48.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.360+0000 7f557e710700 1 -- 172.21.15.103:0/3726537040 wait complete. 2020-04-22T14:12:48.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.361+0000 7f557e710700 1 Processor -- start 2020-04-22T14:12:48.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.361+0000 7f557e710700 1 -- start start 2020-04-22T14:12:48.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.362+0000 7f557e710700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f557805b8a0 0x7f5578124f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:48.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.362+0000 7f557e710700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f557812c0d0 0x7f5578063570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:48.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.362+0000 7f557e710700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55780639d0 con 0x7f5578065fe0 2020-04-22T14:12:48.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.362+0000 7f557e710700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5578125420 con 0x7f557805b8a0 2020-04-22T14:12:48.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.362+0000 7f557e710700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55781256c0 con 0x7f557812c0d0 2020-04-22T14:12:48.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.362+0000 7f5577fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f557805b8a0 0x7f5578124f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:48.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.362+0000 7f55777fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f5578065fe0 0x7f55781511b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45456/0 (socket says 172.21.15.103:45456) 2020-04-22T14:12:48.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.362+0000 7f5577fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f557805b8a0 0x7f5578124f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53262/0 (socket says 172.21.15.103:53262) 2020-04-22T14:12:48.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.362+0000 7f55777fe700 1 -- 172.21.15.103:0/1007742967 learned_addr learned my addr 172.21.15.103:0/1007742967 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:48.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.362+0000 7f557ccad700 1 --2- 172.21.15.103:0/1007742967 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f557812c0d0 0x7f5578063570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:48.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.362+0000 7f5577fff700 1 -- 172.21.15.103:0/1007742967 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f557812c0d0 msgr2=0x7f5578063570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:48.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.362+0000 7f5577fff700 1 --2- 172.21.15.103:0/1007742967 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f557812c0d0 0x7f5578063570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:48.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.362+0000 7f5577fff700 1 -- 172.21.15.103:0/1007742967 >> v1:172.21.15.103:6789/0 conn(0x7f5578065fe0 legacy=0x7f55781511b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:48.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.362+0000 7f5577fff700 1 -- 172.21.15.103:0/1007742967 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5578125960 con 0x7f557805b8a0 2020-04-22T14:12:48.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.362+0000 7f55757fa700 1 -- 172.21.15.103:0/1007742967 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1996650126 0 0) 0x7f556c001ec0 con 0x7f5578065fe0 2020-04-22T14:12:48.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.362+0000 7f557ccad700 1 --2- 172.21.15.103:0/1007742967 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f557812c0d0 0x7f5578063570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:12:48.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.362+0000 7f5577fff700 1 --2- 172.21.15.103:0/1007742967 >> v2:172.21.15.103:3300/0 conn(0x7f557805b8a0 0x7f5578124f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5568002f30 tx=0x7f5568010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:48.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.362+0000 7f5577fff700 1 --2- 172.21.15.103:0/1007742967 >> v2:172.21.15.103:3300/0 conn(0x7f557805b8a0 0x7f5578124f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5568002f30 tx=0x7f5568010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:48.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.363+0000 7f5577fff700 1 --2- 172.21.15.103:0/1007742967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f557805b8a0 0x7f5578124f10 secure :-1 s=READY pgs=1164 cs=0 l=1 rx=0x7f5568002f30 tx=0x7f5568010a80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:48.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.363+0000 7f5577fff700 1 --2- 172.21.15.103:0/1007742967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f557805b8a0 0x7f5578124f10 secure :-1 s=THROTTLE_DONE pgs=1164 cs=0 l=1 rx=0x7f5568002f30 tx=0x7f5568010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:48.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.363+0000 7f55757fa700 1 -- 172.21.15.103:0/1007742967 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5568005e90 con 0x7f557805b8a0 2020-04-22T14:12:48.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.363+0000 7f5577fff700 1 --2- 172.21.15.103:0/1007742967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f557805b8a0 0x7f5578124f10 secure :-1 s=THROTTLE_DONE pgs=1164 cs=0 l=1 rx=0x7f5568002f30 tx=0x7f5568010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:48.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.363+0000 7f5577fff700 1 --2- 172.21.15.103:0/1007742967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f557805b8a0 0x7f5578124f10 secure :-1 s=THROTTLE_DONE pgs=1164 cs=0 l=1 rx=0x7f5568002f30 tx=0x7f5568010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:48.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.363+0000 7f55757fa700 1 -- 172.21.15.103:0/1007742967 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5568007180 con 0x7f557805b8a0 2020-04-22T14:12:48.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.363+0000 7f557e710700 1 -- 172.21.15.103:0/1007742967 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55781518c0 con 0x7f557805b8a0 2020-04-22T14:12:48.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.363+0000 7f55757fa700 1 -- 172.21.15.103:0/1007742967 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5568007520 con 0x7f557805b8a0 2020-04-22T14:12:48.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.363+0000 7f557e710700 1 -- 172.21.15.103:0/1007742967 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5578155d40 con 0x7f557805b8a0 2020-04-22T14:12:48.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.363+0000 7f5577fff700 1 --2- 172.21.15.103:0/1007742967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f557805b8a0 0x7f5578124f10 secure :-1 s=THROTTLE_DONE pgs=1164 cs=0 l=1 rx=0x7f5568002f30 tx=0x7f5568010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:48.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.364+0000 7f557e710700 1 -- 172.21.15.103:0/1007742967 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5578056c90 con 0x7f557805b8a0 2020-04-22T14:12:48.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.364+0000 7f55757fa700 1 -- 172.21.15.103:0/1007742967 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f5568012120 con 0x7f557805b8a0 2020-04-22T14:12:48.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.364+0000 7f5577fff700 1 --2- 172.21.15.103:0/1007742967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f557805b8a0 0x7f5578124f10 secure :-1 s=THROTTLE_DONE pgs=1164 cs=0 l=1 rx=0x7f5568002f30 tx=0x7f5568010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:48.378 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.364+0000 7f55757fa700 1 --2- 172.21.15.103:0/1007742967 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f555804d890 0x7f555804fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:48.378 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.364+0000 7f55757fa700 1 -- 172.21.15.103:0/1007742967 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f5568061360 con 0x7f557805b8a0 2020-04-22T14:12:48.378 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.364+0000 7f55777fe700 1 --2- 172.21.15.103:0/1007742967 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f555804d890 0x7f555804fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:48.378 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.365+0000 7f55777fe700 1 --2- 172.21.15.103:0/1007742967 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f555804d890 0x7f555804fd50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f556c007a40 tx=0x7f556c007ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:48.378 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.365+0000 7f55777fe700 1 --2- 172.21.15.103:0/1007742967 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f555804d890 0x7f555804fd50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f556c007a40 tx=0x7f556c007ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:48.378 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.365+0000 7f55777fe700 1 --2- 172.21.15.103:0/1007742967 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f555804d890 0x7f555804fd50 secure :-1 s=READY pgs=428 cs=0 l=1 rx=0x7f556c007a40 tx=0x7f556c007ae0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:48.378 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.368+0000 7f5577fff700 1 --2- 172.21.15.103:0/1007742967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f557805b8a0 0x7f5578124f10 secure :-1 s=THROTTLE_DONE pgs=1164 cs=0 l=1 rx=0x7f5568002f30 tx=0x7f5568010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:48.379 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.368+0000 7f55757fa700 1 -- 172.21.15.103:0/1007742967 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f556803c6e0 con 0x7f557805b8a0 2020-04-22T14:12:48.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.560+0000 7f557e710700 1 -- 172.21.15.103:0/1007742967 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5578147360 con 0x7f557805b8a0 2020-04-22T14:12:48.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.560+0000 7f5577fff700 1 --2- 172.21.15.103:0/1007742967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f557805b8a0 0x7f5578124f10 secure :-1 s=THROTTLE_DONE pgs=1164 cs=0 l=1 rx=0x7f5568002f30 tx=0x7f5568010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:48.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.560+0000 7f55757fa700 1 -- 172.21.15.103:0/1007742967 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f556803fd00 con 0x7f557805b8a0 2020-04-22T14:12:48.563 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:12:48.563 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:43.570838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:12:48.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.561+0000 7f557e710700 1 -- 172.21.15.103:0/1007742967 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f555804d890 msgr2=0x7f555804fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:48.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.562+0000 7f557e710700 1 --2- 172.21.15.103:0/1007742967 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f555804d890 0x7f555804fd50 secure :-1 s=READY pgs=428 cs=0 l=1 rx=0x7f556c007a40 tx=0x7f556c007ae0).stop 2020-04-22T14:12:48.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.562+0000 7f557e710700 1 -- 172.21.15.103:0/1007742967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f557805b8a0 msgr2=0x7f5578124f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:48.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.562+0000 7f557e710700 1 --2- 172.21.15.103:0/1007742967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f557805b8a0 0x7f5578124f10 secure :-1 s=READY pgs=1164 cs=0 l=1 rx=0x7f5568002f30 tx=0x7f5568010a80).stop 2020-04-22T14:12:48.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.562+0000 7f557e710700 1 -- 172.21.15.103:0/1007742967 shutdown_connections 2020-04-22T14:12:48.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.562+0000 7f557e710700 1 --2- 172.21.15.103:0/1007742967 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f555804d890 0x7f555804fd50 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:48.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.562+0000 7f557e710700 1 --2- 172.21.15.103:0/1007742967 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f557812c0d0 0x7f5578063570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:48.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.562+0000 7f557e710700 1 --2- 172.21.15.103:0/1007742967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f557805b8a0 0x7f5578124f10 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:48.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.562+0000 7f557e710700 1 -- 172.21.15.103:0/1007742967 >> 172.21.15.103:0/1007742967 conn(0x7f55780b9160 msgr2=0x7f55780b56f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:48.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.562+0000 7f557e710700 1 -- 172.21.15.103:0/1007742967 shutdown_connections 2020-04-22T14:12:48.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:48.562+0000 7f557e710700 1 -- 172.21.15.103:0/1007742967 wait complete. 2020-04-22T14:12:48.566 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 54 2020-04-22T14:12:48.574 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:12:49.575 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:49.594 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:12:49.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.747+0000 7f05b6e54700 1 Processor -- start 2020-04-22T14:12:49.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.747+0000 7f05b6e54700 1 -- start start 2020-04-22T14:12:49.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.748+0000 7f05b6e54700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f05b0067170 0x7f05b00b6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:49.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.748+0000 7f05b6e54700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f05b00ac740 0x7f05b013c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:49.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.748+0000 7f05b6e54700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f05b013c7e0 0x7f05b00b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:49.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.748+0000 7f05b6e54700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b0065af0 con 0x7f05b00ac740 2020-04-22T14:12:49.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.748+0000 7f05b6e54700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b0064ec0 con 0x7f05b0067170 2020-04-22T14:12:49.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.748+0000 7f05b6e54700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b0146870 con 0x7f05b013c7e0 2020-04-22T14:12:49.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.748+0000 7f05b4bf0700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f05b0067170 0x7f05b00b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:49.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.748+0000 7f05b4bf0700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f05b0067170 0x7f05b00b6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53274/0 (socket says 172.21.15.103:53274) 2020-04-22T14:12:49.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.748+0000 7f05b4bf0700 1 -- 172.21.15.103:0/1058336363 learned_addr learned my addr 172.21.15.103:0/1058336363 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:49.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.749+0000 7f05b53f1700 1 --2- 172.21.15.103:0/1058336363 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f05b013c7e0 0x7f05b00b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:49.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.749+0000 7f05affff700 1 --2- 172.21.15.103:0/1058336363 >> v2:172.21.15.86:3300/0 conn(0x7f05b00ac740 0x7f05b013c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:49.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.749+0000 7f05b4bf0700 1 -- 172.21.15.103:0/1058336363 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f05b013c7e0 msgr2=0x7f05b00b4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:49.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.749+0000 7f05b4bf0700 1 --2- 172.21.15.103:0/1058336363 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f05b013c7e0 0x7f05b00b4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:49.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.749+0000 7f05b4bf0700 1 -- 172.21.15.103:0/1058336363 >> v2:172.21.15.86:3300/0 conn(0x7f05b00ac740 msgr2=0x7f05b013c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:49.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.749+0000 7f05b4bf0700 1 --2- 172.21.15.103:0/1058336363 >> v2:172.21.15.86:3300/0 conn(0x7f05b00ac740 0x7f05b013c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:49.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.749+0000 7f05b4bf0700 1 -- 172.21.15.103:0/1058336363 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b0067550 con 0x7f05b0067170 2020-04-22T14:12:49.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.749+0000 7f05b4bf0700 1 --2- 172.21.15.103:0/1058336363 >> v2:172.21.15.103:3300/0 conn(0x7f05b0067170 0x7f05b00b6040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f05a0002f30 tx=0x7f05a0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:49.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.749+0000 7f05b4bf0700 1 --2- 172.21.15.103:0/1058336363 >> v2:172.21.15.103:3300/0 conn(0x7f05b0067170 0x7f05b00b6040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f05a0002f30 tx=0x7f05a0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:49.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.749+0000 7f05b4bf0700 1 --2- 172.21.15.103:0/1058336363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05b0067170 0x7f05b00b6040 secure :-1 s=READY pgs=1165 cs=0 l=1 rx=0x7f05a0002f30 tx=0x7f05a0007a40).ready entity=mon.1 client_cookie=58aefe21aea23d65 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:49.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.749+0000 7f05b4bf0700 1 --2- 172.21.15.103:0/1058336363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05b0067170 0x7f05b00b6040 secure :-1 s=THROTTLE_DONE pgs=1165 cs=0 l=1 rx=0x7f05a0002f30 tx=0x7f05a0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:49.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.749+0000 7f05af7fe700 1 -- 172.21.15.103:0/1058336363 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05a0011720 con 0x7f05b0067170 2020-04-22T14:12:49.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.749+0000 7f05b4bf0700 1 --2- 172.21.15.103:0/1058336363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05b0067170 0x7f05b00b6040 secure :-1 s=THROTTLE_DONE pgs=1165 cs=0 l=1 rx=0x7f05a0002f30 tx=0x7f05a0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:49.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.749+0000 7f05af7fe700 1 -- 172.21.15.103:0/1058336363 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a0011880 con 0x7f05b0067170 2020-04-22T14:12:49.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.749+0000 7f05b4bf0700 1 --2- 172.21.15.103:0/1058336363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05b0067170 0x7f05b00b6040 secure :-1 s=THROTTLE_DONE pgs=1165 cs=0 l=1 rx=0x7f05a0002f30 tx=0x7f05a0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:49.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.749+0000 7f05af7fe700 1 -- 172.21.15.103:0/1058336363 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05a0011ca0 con 0x7f05b0067170 2020-04-22T14:12:49.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.749+0000 7f05b6e54700 1 -- 172.21.15.103:0/1058336363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05b0067170 msgr2=0x7f05b00b6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:49.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.749+0000 7f05b6e54700 1 --2- 172.21.15.103:0/1058336363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05b0067170 0x7f05b00b6040 secure :-1 s=READY pgs=1165 cs=0 l=1 rx=0x7f05a0002f30 tx=0x7f05a0007a40).stop 2020-04-22T14:12:49.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.749+0000 7f05b6e54700 1 -- 172.21.15.103:0/1058336363 shutdown_connections 2020-04-22T14:12:49.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.749+0000 7f05b6e54700 1 --2- 172.21.15.103:0/1058336363 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f05b013c7e0 0x7f05b00b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:49.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.749+0000 7f05b6e54700 1 --2- 172.21.15.103:0/1058336363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05b0067170 0x7f05b00b6040 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:49.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.749+0000 7f05b6e54700 1 --2- 172.21.15.103:0/1058336363 >> v2:172.21.15.86:3300/0 conn(0x7f05b00ac740 0x7f05b013c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:49.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.749+0000 7f05b6e54700 1 -- 172.21.15.103:0/1058336363 >> 172.21.15.103:0/1058336363 conn(0x7f05b00b9160 msgr2=0x7f05b005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:49.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.750+0000 7f05b6e54700 1 -- 172.21.15.103:0/1058336363 shutdown_connections 2020-04-22T14:12:49.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.750+0000 7f05b6e54700 1 -- 172.21.15.103:0/1058336363 wait complete. 2020-04-22T14:12:49.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.751+0000 7f05b6e54700 1 Processor -- start 2020-04-22T14:12:49.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.751+0000 7f05b6e54700 1 -- start start 2020-04-22T14:12:49.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.751+0000 7f05b6e54700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f05b0067170 0x7f05b00b3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:49.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.751+0000 7f05b6e54700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f05b00ac740 0x7f05b0142b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:49.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.751+0000 7f05b6e54700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05b0154a50 con 0x7f05b013c7e0 2020-04-22T14:12:49.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.751+0000 7f05b6e54700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b0139df0 con 0x7f05b00ac740 2020-04-22T14:12:49.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.751+0000 7f05b6e54700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b0154070 con 0x7f05b0067170 2020-04-22T14:12:49.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.752+0000 7f05b53f1700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f05b013c7e0 0x7f05b01402c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45470/0 (socket says 172.21.15.103:45470) 2020-04-22T14:12:49.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.752+0000 7f05b53f1700 1 -- 172.21.15.103:0/4293424167 learned_addr learned my addr 172.21.15.103:0/4293424167 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:49.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.752+0000 7f05b4bf0700 1 --2- 172.21.15.103:0/4293424167 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f05b0067170 0x7f05b00b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:49.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.752+0000 7f05affff700 1 --2- 172.21.15.103:0/4293424167 >> v2:172.21.15.86:3300/0 conn(0x7f05b00ac740 0x7f05b0142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:49.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.752+0000 7f05adffb700 1 -- 172.21.15.103:0/4293424167 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 949082887 0 0) 0x7f05b0154a50 con 0x7f05b013c7e0 2020-04-22T14:12:49.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.752+0000 7f05adffb700 1 -- 172.21.15.103:0/4293424167 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0590002fe0 con 0x7f05b013c7e0 2020-04-22T14:12:49.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.752+0000 7f05adffb700 1 -- 172.21.15.103:0/4293424167 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 964621054 0 0) 0x7f0590002fe0 con 0x7f05b013c7e0 2020-04-22T14:12:49.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.752+0000 7f05adffb700 1 -- 172.21.15.103:0/4293424167 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f05b0154a50 con 0x7f05b013c7e0 2020-04-22T14:12:49.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.752+0000 7f05adffb700 1 -- 172.21.15.103:0/4293424167 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f05a8002a90 con 0x7f05b013c7e0 2020-04-22T14:12:49.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.752+0000 7f05adffb700 1 -- 172.21.15.103:0/4293424167 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f05b0067170 msgr2=0x7f05b00b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:49.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.752+0000 7f05adffb700 1 --2- 172.21.15.103:0/4293424167 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f05b0067170 0x7f05b00b3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:49.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.752+0000 7f05adffb700 1 -- 172.21.15.103:0/4293424167 >> v2:172.21.15.86:3300/0 conn(0x7f05b00ac740 msgr2=0x7f05b0142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:49.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.752+0000 7f05adffb700 1 --2- 172.21.15.103:0/4293424167 >> v2:172.21.15.86:3300/0 conn(0x7f05b00ac740 0x7f05b0142b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:49.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.752+0000 7f05adffb700 1 -- 172.21.15.103:0/4293424167 >> v1:172.21.15.103:6789/0 conn(0x7f05b013c7e0 legacy=0x7f05b01402c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:49.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.752+0000 7f05adffb700 1 --2- 172.21.15.103:0/4293424167 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05900049b0 0x7f0590004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:49.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.752+0000 7f05adffb700 1 --2- 172.21.15.103:0/4293424167 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f05b0067170 0x7f0590003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:49.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.752+0000 7f05adffb700 1 --2- 172.21.15.103:0/4293424167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0590003d80 0x7f0590004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:49.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.752+0000 7f05adffb700 1 -- 172.21.15.103:0/4293424167 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b0139df0 con 0x7f05900049b0 2020-04-22T14:12:49.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.752+0000 7f05adffb700 1 -- 172.21.15.103:0/4293424167 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b0154070 con 0x7f0590003d80 2020-04-22T14:12:49.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.752+0000 7f05adffb700 1 -- 172.21.15.103:0/4293424167 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0590005380 con 0x7f05b0067170 2020-04-22T14:12:49.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.752+0000 7f05b53f1700 1 --2- 172.21.15.103:0/4293424167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0590003d80 0x7f0590004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:49.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.752+0000 7f05affff700 1 --2- 172.21.15.103:0/4293424167 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f05b0067170 0x7f0590003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:49.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.752+0000 7f05b4bf0700 1 --2- 172.21.15.103:0/4293424167 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05900049b0 0x7f0590004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:49.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.753+0000 7f05b53f1700 1 -- 172.21.15.103:0/4293424167 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f05b0067170 msgr2=0x7f0590003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:49.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.753+0000 7f05b53f1700 1 --2- 172.21.15.103:0/4293424167 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f05b0067170 0x7f0590003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:49.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.753+0000 7f05b53f1700 1 -- 172.21.15.103:0/4293424167 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05900049b0 msgr2=0x7f0590004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:49.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.753+0000 7f05b53f1700 1 --2- 172.21.15.103:0/4293424167 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05900049b0 0x7f0590004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:49.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.753+0000 7f05b53f1700 1 -- 172.21.15.103:0/4293424167 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b0154310 con 0x7f0590003d80 2020-04-22T14:12:49.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.753+0000 7f05b6e54700 1 -- 172.21.15.103:0/4293424167 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05b01545b0 con 0x7f0590003d80 2020-04-22T14:12:49.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.753+0000 7f05b53f1700 1 --2- 172.21.15.103:0/4293424167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0590003d80 0x7f0590004200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f05a8002820 tx=0x7f05a80117b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:49.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.753+0000 7f05b6e54700 1 -- 172.21.15.103:0/4293424167 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05b00b39e0 con 0x7f0590003d80 2020-04-22T14:12:49.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.753+0000 7f05b53f1700 1 --2- 172.21.15.103:0/4293424167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0590003d80 0x7f0590004200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f05a8002820 tx=0x7f05a80117b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:49.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.753+0000 7f05b53f1700 1 --2- 172.21.15.103:0/4293424167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0590003d80 0x7f0590004200 secure :-1 s=READY pgs=1167 cs=0 l=1 rx=0x7f05a8002820 tx=0x7f05a80117b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:49.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.753+0000 7f05b53f1700 1 --2- 172.21.15.103:0/4293424167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0590003d80 0x7f0590004200 secure :-1 s=THROTTLE_DONE pgs=1167 cs=0 l=1 rx=0x7f05a8002820 tx=0x7f05a80117b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:49.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.753+0000 7f05b53f1700 1 --2- 172.21.15.103:0/4293424167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0590003d80 0x7f0590004200 secure :-1 s=THROTTLE_DONE pgs=1167 cs=0 l=1 rx=0x7f05a8002820 tx=0x7f05a80117b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:49.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.753+0000 7f05adffb700 1 -- 172.21.15.103:0/4293424167 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05a8005e30 con 0x7f0590003d80 2020-04-22T14:12:49.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.753+0000 7f05b53f1700 1 --2- 172.21.15.103:0/4293424167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0590003d80 0x7f0590004200 secure :-1 s=THROTTLE_DONE pgs=1167 cs=0 l=1 rx=0x7f05a8002820 tx=0x7f05a80117b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:49.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.753+0000 7f05adffb700 1 -- 172.21.15.103:0/4293424167 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a8007560 con 0x7f0590003d80 2020-04-22T14:12:49.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.753+0000 7f05adffb700 1 -- 172.21.15.103:0/4293424167 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05a80101a0 con 0x7f0590003d80 2020-04-22T14:12:49.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.753+0000 7f05b53f1700 1 --2- 172.21.15.103:0/4293424167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0590003d80 0x7f0590004200 secure :-1 s=THROTTLE_DONE pgs=1167 cs=0 l=1 rx=0x7f05a8002820 tx=0x7f05a80117b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:49.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.754+0000 7f05b6e54700 1 -- 172.21.15.103:0/4293424167 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f058c003340 con 0x7f0590003d80 2020-04-22T14:12:49.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.754+0000 7f05adffb700 1 -- 172.21.15.103:0/4293424167 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f05a8010300 con 0x7f0590003d80 2020-04-22T14:12:49.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.754+0000 7f05b53f1700 1 --2- 172.21.15.103:0/4293424167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0590003d80 0x7f0590004200 secure :-1 s=THROTTLE_DONE pgs=1167 cs=0 l=1 rx=0x7f05a8002820 tx=0x7f05a80117b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:49.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.754+0000 7f05adffb700 1 --2- 172.21.15.103:0/4293424167 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0590055b40 0x7f0590058000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:49.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.754+0000 7f05adffb700 1 -- 172.21.15.103:0/4293424167 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f05a800ee40 con 0x7f0590003d80 2020-04-22T14:12:49.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.754+0000 7f05b4bf0700 1 --2- 172.21.15.103:0/4293424167 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0590055b40 0x7f0590058000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:49.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.755+0000 7f05b4bf0700 1 --2- 172.21.15.103:0/4293424167 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0590055b40 0x7f0590058000 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f05a0002f30 tx=0x7f05a0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:49.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.755+0000 7f05b4bf0700 1 --2- 172.21.15.103:0/4293424167 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0590055b40 0x7f0590058000 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f05a0002f30 tx=0x7f05a0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:49.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.755+0000 7f05b4bf0700 1 --2- 172.21.15.103:0/4293424167 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0590055b40 0x7f0590058000 secure :-1 s=READY pgs=429 cs=0 l=1 rx=0x7f05a0002f30 tx=0x7f05a0007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:49.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.758+0000 7f05b53f1700 1 --2- 172.21.15.103:0/4293424167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0590003d80 0x7f0590004200 secure :-1 s=THROTTLE_DONE pgs=1167 cs=0 l=1 rx=0x7f05a8002820 tx=0x7f05a80117b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:49.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.758+0000 7f05adffb700 1 -- 172.21.15.103:0/4293424167 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f05a803d680 con 0x7f0590003d80 2020-04-22T14:12:49.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.946+0000 7f05b6e54700 1 -- 172.21.15.103:0/4293424167 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f058c0036e0 con 0x7f0590003d80 2020-04-22T14:12:49.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.947+0000 7f05b53f1700 1 --2- 172.21.15.103:0/4293424167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0590003d80 0x7f0590004200 secure :-1 s=THROTTLE_DONE pgs=1167 cs=0 l=1 rx=0x7f05a8002820 tx=0x7f05a80117b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:49.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.947+0000 7f05adffb700 1 -- 172.21.15.103:0/4293424167 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f05a8040ca0 con 0x7f0590003d80 2020-04-22T14:12:49.950 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:12:49.950 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:43.570838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:12:49.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.948+0000 7f05b6e54700 1 -- 172.21.15.103:0/4293424167 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0590055b40 msgr2=0x7f0590058000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:49.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.948+0000 7f05b6e54700 1 --2- 172.21.15.103:0/4293424167 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0590055b40 0x7f0590058000 secure :-1 s=READY pgs=429 cs=0 l=1 rx=0x7f05a0002f30 tx=0x7f05a0007a40).stop 2020-04-22T14:12:49.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.948+0000 7f05b6e54700 1 -- 172.21.15.103:0/4293424167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0590003d80 msgr2=0x7f0590004200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:49.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.948+0000 7f05b6e54700 1 --2- 172.21.15.103:0/4293424167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0590003d80 0x7f0590004200 secure :-1 s=READY pgs=1167 cs=0 l=1 rx=0x7f05a8002820 tx=0x7f05a80117b0).stop 2020-04-22T14:12:49.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.948+0000 7f05b53f1700 1 -- 172.21.15.103:0/4293424167 reap_dead start 2020-04-22T14:12:49.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.948+0000 7f05b53f1700 1 -- 172.21.15.103:0/4293424167 reap_dead start 2020-04-22T14:12:49.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.948+0000 7f05b6e54700 1 -- 172.21.15.103:0/4293424167 shutdown_connections 2020-04-22T14:12:49.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.948+0000 7f05b6e54700 1 -- 172.21.15.103:0/4293424167 >> 172.21.15.103:0/4293424167 conn(0x7f05b00b9160 msgr2=0x7f05b01437f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:49.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.948+0000 7f05b6e54700 1 -- 172.21.15.103:0/4293424167 shutdown_connections 2020-04-22T14:12:49.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:49.948+0000 7f05b6e54700 1 -- 172.21.15.103:0/4293424167 wait complete. 2020-04-22T14:12:49.952 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 54 2020-04-22T14:12:49.961 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:12:50.961 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:50.978 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:12:51.133 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.131+0000 7f92228fe700 1 Processor -- start 2020-04-22T14:12:51.133 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.131+0000 7f92228fe700 1 -- start start 2020-04-22T14:12:51.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.132+0000 7f92228fe700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f921c0b6040 0x7f921c0ac740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:51.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.132+0000 7f92228fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f921c1426d0 0x7f921c142b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:51.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.132+0000 7f92228fe700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f921c064ec0 con 0x7f921c067170 2020-04-22T14:12:51.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.132+0000 7f92228fe700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f921c065af0 con 0x7f921c1426d0 2020-04-22T14:12:51.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.132+0000 7f92228fe700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f921c146870 con 0x7f921c0b6040 2020-04-22T14:12:51.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.132+0000 7f921bfff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f921c067170 0x7f921c13c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45480/0 (socket says 172.21.15.103:45480) 2020-04-22T14:12:51.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.132+0000 7f921bfff700 1 -- 172.21.15.103:0/2928037056 learned_addr learned my addr 172.21.15.103:0/2928037056 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:51.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.132+0000 7f921b7fe700 1 --2- 172.21.15.103:0/2928037056 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f921c0b6040 0x7f921c0ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:51.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.132+0000 7f921affd700 1 -- 172.21.15.103:0/2928037056 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1095475938 0 0) 0x7f921c064ec0 con 0x7f921c067170 2020-04-22T14:12:51.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.132+0000 7f9220e9b700 1 --2- 172.21.15.103:0/2928037056 >> v2:172.21.15.86:3300/0 conn(0x7f921c1426d0 0x7f921c142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:51.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.132+0000 7f921affd700 1 -- 172.21.15.103:0/2928037056 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9208003230 con 0x7f921c067170 2020-04-22T14:12:51.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.133+0000 7f921affd700 1 -- 172.21.15.103:0/2928037056 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3658616708 0 0) 0x7f9208003230 con 0x7f921c067170 2020-04-22T14:12:51.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.133+0000 7f921affd700 1 -- 172.21.15.103:0/2928037056 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f921c0b6040 msgr2=0x7f921c0ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:51.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.133+0000 7f921affd700 1 --2- 172.21.15.103:0/2928037056 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f921c0b6040 0x7f921c0ac740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:51.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.133+0000 7f921affd700 1 -- 172.21.15.103:0/2928037056 >> v2:172.21.15.86:3300/0 conn(0x7f921c1426d0 msgr2=0x7f921c142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:51.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.133+0000 7f921affd700 1 --2- 172.21.15.103:0/2928037056 >> v2:172.21.15.86:3300/0 conn(0x7f921c1426d0 0x7f921c142b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:51.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.133+0000 7f921affd700 1 -- 172.21.15.103:0/2928037056 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f921c067550 con 0x7f921c067170 2020-04-22T14:12:51.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.133+0000 7f921affd700 1 -- 172.21.15.103:0/2928037056 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f920c0016d0 con 0x7f921c067170 2020-04-22T14:12:51.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.133+0000 7f921affd700 1 -- 172.21.15.103:0/2928037056 >> v1:172.21.15.103:6789/0 conn(0x7f921c067170 legacy=0x7f921c13c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:51.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.133+0000 7f921affd700 1 --2- 172.21.15.103:0/2928037056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9208003720 0x7f9208003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:51.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.133+0000 7f921affd700 1 --2- 172.21.15.103:0/2928037056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9208004060 0x7f9208004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:51.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.133+0000 7f921affd700 1 --2- 172.21.15.103:0/2928037056 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f921c0b6040 0x7f9208004ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:51.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.133+0000 7f921affd700 1 -- 172.21.15.103:0/2928037056 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921c065af0 con 0x7f9208003720 2020-04-22T14:12:51.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.133+0000 7f921affd700 1 -- 172.21.15.103:0/2928037056 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921c146870 con 0x7f9208004060 2020-04-22T14:12:51.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.133+0000 7f921affd700 1 -- 172.21.15.103:0/2928037056 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9208005020 con 0x7f921c0b6040 2020-04-22T14:12:51.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.133+0000 7f921b7fe700 1 --2- 172.21.15.103:0/2928037056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9208004060 0x7f9208004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:51.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.133+0000 7f921bfff700 1 --2- 172.21.15.103:0/2928037056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9208003720 0x7f9208003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:51.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.133+0000 7f9220e9b700 1 --2- 172.21.15.103:0/2928037056 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f921c0b6040 0x7f9208004ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:51.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.133+0000 7f921b7fe700 1 -- 172.21.15.103:0/2928037056 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f921c0b6040 msgr2=0x7f9208004ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:51.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.133+0000 7f921b7fe700 1 --2- 172.21.15.103:0/2928037056 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f921c0b6040 0x7f9208004ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:51.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.133+0000 7f921b7fe700 1 -- 172.21.15.103:0/2928037056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9208003720 msgr2=0x7f9208003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:51.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.133+0000 7f921b7fe700 1 --2- 172.21.15.103:0/2928037056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9208003720 0x7f9208003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:51.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.133+0000 7f921b7fe700 1 -- 172.21.15.103:0/2928037056 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9208003230 con 0x7f9208004060 2020-04-22T14:12:51.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.133+0000 7f921b7fe700 1 --2- 172.21.15.103:0/2928037056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9208004060 0x7f9208004530 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9210002f30 tx=0x7f9210010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:51.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.133+0000 7f921b7fe700 1 --2- 172.21.15.103:0/2928037056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9208004060 0x7f9208004530 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9210002f30 tx=0x7f9210010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:51.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.133+0000 7f921b7fe700 1 --2- 172.21.15.103:0/2928037056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9208004060 0x7f9208004530 secure :-1 s=READY pgs=1169 cs=0 l=1 rx=0x7f9210002f30 tx=0x7f9210010020).ready entity=mon.1 client_cookie=5811140b32330ec2 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:51.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.133+0000 7f921b7fe700 1 --2- 172.21.15.103:0/2928037056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9208004060 0x7f9208004530 secure :-1 s=THROTTLE_DONE pgs=1169 cs=0 l=1 rx=0x7f9210002f30 tx=0x7f9210010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:51.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.133+0000 7f921affd700 1 -- 172.21.15.103:0/2928037056 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9210008d00 con 0x7f9208004060 2020-04-22T14:12:51.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.133+0000 7f921b7fe700 1 --2- 172.21.15.103:0/2928037056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9208004060 0x7f9208004530 secure :-1 s=THROTTLE_DONE pgs=1169 cs=0 l=1 rx=0x7f9210002f30 tx=0x7f9210010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:51.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.133+0000 7f921b7fe700 1 --2- 172.21.15.103:0/2928037056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9208004060 0x7f9208004530 secure :-1 s=THROTTLE_DONE pgs=1169 cs=0 l=1 rx=0x7f9210002f30 tx=0x7f9210010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:51.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.133+0000 7f921affd700 1 -- 172.21.15.103:0/2928037056 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9210008e60 con 0x7f9208004060 2020-04-22T14:12:51.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.133+0000 7f921affd700 1 -- 172.21.15.103:0/2928037056 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9210010a90 con 0x7f9208004060 2020-04-22T14:12:51.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.133+0000 7f92228fe700 1 -- 172.21.15.103:0/2928037056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9208004060 msgr2=0x7f9208004530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:51.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.133+0000 7f92228fe700 1 --2- 172.21.15.103:0/2928037056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9208004060 0x7f9208004530 secure :-1 s=READY pgs=1169 cs=0 l=1 rx=0x7f9210002f30 tx=0x7f9210010020).stop 2020-04-22T14:12:51.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.133+0000 7f9220e9b700 1 -- 172.21.15.103:0/2928037056 reap_dead start 2020-04-22T14:12:51.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.134+0000 7f92228fe700 1 -- 172.21.15.103:0/2928037056 shutdown_connections 2020-04-22T14:12:51.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.134+0000 7f92228fe700 1 -- 172.21.15.103:0/2928037056 >> 172.21.15.103:0/2928037056 conn(0x7f921c0b9160 msgr2=0x7f921c05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:51.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.134+0000 7f92228fe700 1 -- 172.21.15.103:0/2928037056 shutdown_connections 2020-04-22T14:12:51.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.134+0000 7f92228fe700 1 -- 172.21.15.103:0/2928037056 wait complete. 2020-04-22T14:12:51.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.135+0000 7f92228fe700 1 Processor -- start 2020-04-22T14:12:51.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.135+0000 7f92228fe700 1 -- start start 2020-04-22T14:12:51.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.136+0000 7f92228fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f921c13bea0 0x7f921c13e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:51.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.136+0000 7f92228fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f921c139800 0x7f921c13a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:51.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.136+0000 7f92228fe700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f921c13e940 con 0x7f921c143a70 2020-04-22T14:12:51.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.136+0000 7f92228fe700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f921c139fe0 con 0x7f921c139800 2020-04-22T14:12:51.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.136+0000 7f92228fe700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f921c13a280 con 0x7f921c13bea0 2020-04-22T14:12:51.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.136+0000 7f921bfff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f921c13bea0 0x7f921c13e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:51.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.136+0000 7f921b7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f921c143a70 0x7f921c1390f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45492/0 (socket says 172.21.15.103:45492) 2020-04-22T14:12:51.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.136+0000 7f921b7fe700 1 -- 172.21.15.103:0/3884023313 learned_addr learned my addr 172.21.15.103:0/3884023313 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:51.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.136+0000 7f9220e9b700 1 --2- 172.21.15.103:0/3884023313 >> v2:172.21.15.86:3300/0 conn(0x7f921c139800 0x7f921c13a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:51.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.136+0000 7f921bfff700 1 -- 172.21.15.103:0/3884023313 >> v2:172.21.15.86:3300/0 conn(0x7f921c139800 msgr2=0x7f921c13a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:51.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.136+0000 7f921bfff700 1 --2- 172.21.15.103:0/3884023313 >> v2:172.21.15.86:3300/0 conn(0x7f921c139800 0x7f921c13a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:51.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.136+0000 7f92197fa700 1 -- 172.21.15.103:0/3884023313 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 683489521 0 0) 0x7f921c13e940 con 0x7f921c143a70 2020-04-22T14:12:51.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.136+0000 7f921bfff700 1 -- 172.21.15.103:0/3884023313 >> v1:172.21.15.103:6789/0 conn(0x7f921c143a70 legacy=0x7f921c1390f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:51.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.136+0000 7f921bfff700 1 -- 172.21.15.103:0/3884023313 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f921c13a520 con 0x7f921c13bea0 2020-04-22T14:12:51.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.136+0000 7f921bfff700 1 --2- 172.21.15.103:0/3884023313 >> v2:172.21.15.103:3300/0 conn(0x7f921c13bea0 0x7f921c13e4e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f920c0013e0 tx=0x7f921c146770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:51.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.136+0000 7f921bfff700 1 --2- 172.21.15.103:0/3884023313 >> v2:172.21.15.103:3300/0 conn(0x7f921c13bea0 0x7f921c13e4e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f920c0013e0 tx=0x7f921c146770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:51.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.136+0000 7f921bfff700 1 --2- 172.21.15.103:0/3884023313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f921c13bea0 0x7f921c13e4e0 secure :-1 s=READY pgs=1171 cs=0 l=1 rx=0x7f920c0013e0 tx=0x7f921c146770).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:51.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.136+0000 7f921bfff700 1 --2- 172.21.15.103:0/3884023313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f921c13bea0 0x7f921c13e4e0 secure :-1 s=THROTTLE_DONE pgs=1171 cs=0 l=1 rx=0x7f920c0013e0 tx=0x7f921c146770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:51.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.136+0000 7f92197fa700 1 -- 172.21.15.103:0/3884023313 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f920c00ed60 con 0x7f921c13bea0 2020-04-22T14:12:51.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.136+0000 7f921bfff700 1 --2- 172.21.15.103:0/3884023313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f921c13bea0 0x7f921c13e4e0 secure :-1 s=THROTTLE_DONE pgs=1171 cs=0 l=1 rx=0x7f920c0013e0 tx=0x7f921c146770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:51.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.136+0000 7f921bfff700 1 --2- 172.21.15.103:0/3884023313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f921c13bea0 0x7f921c13e4e0 secure :-1 s=THROTTLE_DONE pgs=1171 cs=0 l=1 rx=0x7f920c0013e0 tx=0x7f921c146770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:51.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.136+0000 7f92197fa700 1 -- 172.21.15.103:0/3884023313 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f920c011870 con 0x7f921c13bea0 2020-04-22T14:12:51.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.136+0000 7f92197fa700 1 -- 172.21.15.103:0/3884023313 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f920c011c10 con 0x7f921c13bea0 2020-04-22T14:12:51.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.136+0000 7f92228fe700 1 -- 172.21.15.103:0/3884023313 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f921c13c280 con 0x7f921c13bea0 2020-04-22T14:12:51.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.136+0000 7f92228fe700 1 -- 172.21.15.103:0/3884023313 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f921c13ed40 con 0x7f921c13bea0 2020-04-22T14:12:51.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.137+0000 7f921bfff700 1 --2- 172.21.15.103:0/3884023313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f921c13bea0 0x7f921c13e4e0 secure :-1 s=THROTTLE_DONE pgs=1171 cs=0 l=1 rx=0x7f920c0013e0 tx=0x7f921c146770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:51.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.138+0000 7f92228fe700 1 -- 172.21.15.103:0/3884023313 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f921c056c90 con 0x7f921c13bea0 2020-04-22T14:12:51.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.138+0000 7f92197fa700 1 -- 172.21.15.103:0/3884023313 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f920c00f080 con 0x7f921c13bea0 2020-04-22T14:12:51.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.138+0000 7f921bfff700 1 --2- 172.21.15.103:0/3884023313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f921c13bea0 0x7f921c13e4e0 secure :-1 s=THROTTLE_DONE pgs=1171 cs=0 l=1 rx=0x7f920c0013e0 tx=0x7f921c146770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:51.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.138+0000 7f92197fa700 1 --2- 172.21.15.103:0/3884023313 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f91fc04d7a0 0x7f91fc04fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:51.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.138+0000 7f92197fa700 1 -- 172.21.15.103:0/3884023313 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f920c060f90 con 0x7f921c13bea0 2020-04-22T14:12:51.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.138+0000 7f921b7fe700 1 --2- 172.21.15.103:0/3884023313 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f91fc04d7a0 0x7f91fc04fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:51.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.138+0000 7f921b7fe700 1 --2- 172.21.15.103:0/3884023313 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f91fc04d7a0 0x7f91fc04fc60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9210007fa0 tx=0x7f9210010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:51.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.138+0000 7f921b7fe700 1 --2- 172.21.15.103:0/3884023313 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f91fc04d7a0 0x7f91fc04fc60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9210007fa0 tx=0x7f9210010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:51.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.138+0000 7f921b7fe700 1 --2- 172.21.15.103:0/3884023313 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f91fc04d7a0 0x7f91fc04fc60 secure :-1 s=READY pgs=430 cs=0 l=1 rx=0x7f9210007fa0 tx=0x7f9210010020).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:51.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.142+0000 7f921bfff700 1 --2- 172.21.15.103:0/3884023313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f921c13bea0 0x7f921c13e4e0 secure :-1 s=THROTTLE_DONE pgs=1171 cs=0 l=1 rx=0x7f920c0013e0 tx=0x7f921c146770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:51.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.142+0000 7f92197fa700 1 -- 172.21.15.103:0/3884023313 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f920c03c310 con 0x7f921c13bea0 2020-04-22T14:12:51.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.329+0000 7f92228fe700 1 -- 172.21.15.103:0/3884023313 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f921c0b40c0 con 0x7f921c13bea0 2020-04-22T14:12:51.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.330+0000 7f921bfff700 1 --2- 172.21.15.103:0/3884023313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f921c13bea0 0x7f921c13e4e0 secure :-1 s=THROTTLE_DONE pgs=1171 cs=0 l=1 rx=0x7f920c0013e0 tx=0x7f921c146770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:51.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.330+0000 7f92197fa700 1 -- 172.21.15.103:0/3884023313 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f920c03f930 con 0x7f921c13bea0 2020-04-22T14:12:51.333 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:12:51.333 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:43.570838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:12:51.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.331+0000 7f92228fe700 1 -- 172.21.15.103:0/3884023313 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f91fc04d7a0 msgr2=0x7f91fc04fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:51.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.331+0000 7f92228fe700 1 --2- 172.21.15.103:0/3884023313 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f91fc04d7a0 0x7f91fc04fc60 secure :-1 s=READY pgs=430 cs=0 l=1 rx=0x7f9210007fa0 tx=0x7f9210010020).stop 2020-04-22T14:12:51.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.331+0000 7f92228fe700 1 -- 172.21.15.103:0/3884023313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f921c13bea0 msgr2=0x7f921c13e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:51.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.331+0000 7f92228fe700 1 --2- 172.21.15.103:0/3884023313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f921c13bea0 0x7f921c13e4e0 secure :-1 s=READY pgs=1171 cs=0 l=1 rx=0x7f920c0013e0 tx=0x7f921c146770).stop 2020-04-22T14:12:51.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.331+0000 7f92228fe700 1 -- 172.21.15.103:0/3884023313 shutdown_connections 2020-04-22T14:12:51.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.331+0000 7f92228fe700 1 --2- 172.21.15.103:0/3884023313 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f91fc04d7a0 0x7f91fc04fc60 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:51.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.331+0000 7f92228fe700 1 --2- 172.21.15.103:0/3884023313 >> v2:172.21.15.86:3300/0 conn(0x7f921c139800 0x7f921c13a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:51.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.331+0000 7f92228fe700 1 --2- 172.21.15.103:0/3884023313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f921c13bea0 0x7f921c13e4e0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:51.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.331+0000 7f92228fe700 1 -- 172.21.15.103:0/3884023313 >> 172.21.15.103:0/3884023313 conn(0x7f921c0b9160 msgr2=0x7f921c141c80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:51.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.331+0000 7f92228fe700 1 -- 172.21.15.103:0/3884023313 shutdown_connections 2020-04-22T14:12:51.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:51.331+0000 7f92228fe700 1 -- 172.21.15.103:0/3884023313 wait complete. 2020-04-22T14:12:51.339 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 54 2020-04-22T14:12:51.344 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:12:52.345 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:52.362 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:12:52.517 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.515+0000 7f27ca24d700 1 Processor -- start 2020-04-22T14:12:52.517 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.515+0000 7f27ca24d700 1 -- start start 2020-04-22T14:12:52.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.516+0000 7f27ca24d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27c4067170 0x7f27c40b6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:52.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.516+0000 7f27ca24d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27c4064ec0 con 0x7f27c40ac740 2020-04-22T14:12:52.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.516+0000 7f27ca24d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27c4146870 con 0x7f27c41426d0 2020-04-22T14:12:52.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.516+0000 7f27ca24d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c4065af0 con 0x7f27c4067170 2020-04-22T14:12:52.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.516+0000 7f27c3fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f27c41426d0 0x7f27c4142b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45500/0 (socket says 172.21.15.103:45500) 2020-04-22T14:12:52.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.516+0000 7f27c3fff700 1 -- 172.21.15.103:0/1762244418 learned_addr learned my addr 172.21.15.103:0/1762244418 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:52.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.516+0000 7f27c37fe700 1 --2- 172.21.15.103:0/1762244418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27c4067170 0x7f27c40b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:52.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.516+0000 7f27c27fc700 1 -- 172.21.15.103:0/1762244418 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1930797865 0 0) 0x7f27c4146870 con 0x7f27c41426d0 2020-04-22T14:12:52.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.516+0000 7f27c27fc700 1 -- 172.21.15.103:0/1762244418 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27b0003230 con 0x7f27c41426d0 2020-04-22T14:12:52.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.516+0000 7f27c27fc700 1 -- 172.21.15.103:0/1762244418 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3183857887 0 0) 0x7f27c4064ec0 con 0x7f27c40ac740 2020-04-22T14:12:52.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.516+0000 7f27c27fc700 1 -- 172.21.15.103:0/1762244418 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27c4146870 con 0x7f27c40ac740 2020-04-22T14:12:52.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.516+0000 7f27c27fc700 1 -- 172.21.15.103:0/1762244418 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3798319467 0 0) 0x7f27b0003230 con 0x7f27c41426d0 2020-04-22T14:12:52.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.516+0000 7f27c27fc700 1 -- 172.21.15.103:0/1762244418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27c4067170 msgr2=0x7f27c40b6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:52.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.516+0000 7f27c27fc700 1 --2- 172.21.15.103:0/1762244418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27c4067170 0x7f27c40b6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:52.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.516+0000 7f27c27fc700 1 -- 172.21.15.103:0/1762244418 >> v1:172.21.15.86:6789/0 conn(0x7f27c40ac740 legacy=0x7f27c413c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:52.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.516+0000 7f27c27fc700 1 -- 172.21.15.103:0/1762244418 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c4067550 con 0x7f27c41426d0 2020-04-22T14:12:52.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.516+0000 7f27c27fc700 1 -- 172.21.15.103:0/1762244418 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f27bc001a50 con 0x7f27c41426d0 2020-04-22T14:12:52.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.516+0000 7f27c27fc700 1 -- 172.21.15.103:0/1762244418 >> v1:172.21.15.103:6789/0 conn(0x7f27c41426d0 legacy=0x7f27c4142b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:52.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.516+0000 7f27c27fc700 1 --2- 172.21.15.103:0/1762244418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27b00038b0 0x7f27b0003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:52.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.516+0000 7f27c27fc700 1 --2- 172.21.15.103:0/1762244418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27b00044d0 0x7f27b0004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:52.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.516+0000 7f27c27fc700 1 --2- 172.21.15.103:0/1762244418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27b0004db0 0x7f27b000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:52.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.516+0000 7f27c27fc700 1 -- 172.21.15.103:0/1762244418 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c4065af0 con 0x7f27b00038b0 2020-04-22T14:12:52.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.517+0000 7f27c27fc700 1 -- 172.21.15.103:0/1762244418 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b0005320 con 0x7f27b0004db0 2020-04-22T14:12:52.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.517+0000 7f27c27fc700 1 -- 172.21.15.103:0/1762244418 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b000cc90 con 0x7f27b00044d0 2020-04-22T14:12:52.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.517+0000 7f27c37fe700 1 --2- 172.21.15.103:0/1762244418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27c4067170 0x7f27c40b6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:12:52.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.517+0000 7f27c3fff700 1 --2- 172.21.15.103:0/1762244418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27b0004db0 0x7f27b000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:52.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.517+0000 7f27c2ffd700 1 --2- 172.21.15.103:0/1762244418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27b00044d0 0x7f27b0004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:52.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.517+0000 7f27c37fe700 1 --2- 172.21.15.103:0/1762244418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27b00038b0 0x7f27b0003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:52.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.517+0000 7f27c3fff700 1 -- 172.21.15.103:0/1762244418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27b00044d0 msgr2=0x7f27b0004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:52.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.517+0000 7f27c3fff700 1 --2- 172.21.15.103:0/1762244418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27b00044d0 0x7f27b0004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:52.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.517+0000 7f27c3fff700 1 -- 172.21.15.103:0/1762244418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27b00038b0 msgr2=0x7f27b0003cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:52.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.517+0000 7f27c3fff700 1 --2- 172.21.15.103:0/1762244418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27b00038b0 0x7f27b0003cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:52.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.517+0000 7f27c3fff700 1 -- 172.21.15.103:0/1762244418 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b0003230 con 0x7f27b0004db0 2020-04-22T14:12:52.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.517+0000 7f27c3fff700 1 --2- 172.21.15.103:0/1762244418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27b0004db0 0x7f27b000b720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f27bc001820 tx=0x7f27c40acbc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:52.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.517+0000 7f27c3fff700 1 --2- 172.21.15.103:0/1762244418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27b0004db0 0x7f27b000b720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f27bc001820 tx=0x7f27c40acbc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:52.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.517+0000 7f27c3fff700 1 --2- 172.21.15.103:0/1762244418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27b0004db0 0x7f27b000b720 secure :-1 s=READY pgs=1173 cs=0 l=1 rx=0x7f27bc001820 tx=0x7f27c40acbc0).ready entity=mon.1 client_cookie=cd1eb78f82d2e0df server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:52.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.517+0000 7f27c3fff700 1 --2- 172.21.15.103:0/1762244418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27b0004db0 0x7f27b000b720 secure :-1 s=THROTTLE_DONE pgs=1173 cs=0 l=1 rx=0x7f27bc001820 tx=0x7f27c40acbc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:52.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.517+0000 7f27c27fc700 1 -- 172.21.15.103:0/1762244418 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27bc011ea0 con 0x7f27b0004db0 2020-04-22T14:12:52.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.517+0000 7f27c3fff700 1 --2- 172.21.15.103:0/1762244418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27b0004db0 0x7f27b000b720 secure :-1 s=THROTTLE_DONE pgs=1173 cs=0 l=1 rx=0x7f27bc001820 tx=0x7f27c40acbc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:52.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.517+0000 7f27c3fff700 1 --2- 172.21.15.103:0/1762244418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27b0004db0 0x7f27b000b720 secure :-1 s=THROTTLE_DONE pgs=1173 cs=0 l=1 rx=0x7f27bc001820 tx=0x7f27c40acbc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:52.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.517+0000 7f27c27fc700 1 -- 172.21.15.103:0/1762244418 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27bc00e370 con 0x7f27b0004db0 2020-04-22T14:12:52.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.517+0000 7f27c27fc700 1 -- 172.21.15.103:0/1762244418 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27bc00e750 con 0x7f27b0004db0 2020-04-22T14:12:52.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.517+0000 7f27ca24d700 1 -- 172.21.15.103:0/1762244418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27b0004db0 msgr2=0x7f27b000b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:52.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.517+0000 7f27ca24d700 1 --2- 172.21.15.103:0/1762244418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27b0004db0 0x7f27b000b720 secure :-1 s=READY pgs=1173 cs=0 l=1 rx=0x7f27bc001820 tx=0x7f27c40acbc0).stop 2020-04-22T14:12:52.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.517+0000 7f27c3fff700 1 -- 172.21.15.103:0/1762244418 reap_dead start 2020-04-22T14:12:52.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.518+0000 7f27ca24d700 1 -- 172.21.15.103:0/1762244418 shutdown_connections 2020-04-22T14:12:52.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.518+0000 7f27ca24d700 1 -- 172.21.15.103:0/1762244418 >> 172.21.15.103:0/1762244418 conn(0x7f27c40b9160 msgr2=0x7f27c405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:52.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.518+0000 7f27ca24d700 1 -- 172.21.15.103:0/1762244418 shutdown_connections 2020-04-22T14:12:52.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.518+0000 7f27ca24d700 1 -- 172.21.15.103:0/1762244418 wait complete. 2020-04-22T14:12:52.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.519+0000 7f27ca24d700 1 Processor -- start 2020-04-22T14:12:52.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.519+0000 7f27ca24d700 1 -- start start 2020-04-22T14:12:52.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.520+0000 7f27ca24d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27c413dc20 0x7f27c413f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:52.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.520+0000 7f27ca24d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f27c413fa60 0x7f27c4155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:52.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.520+0000 7f27ca24d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27c413ff80 con 0x7f27c41559a0 2020-04-22T14:12:52.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.520+0000 7f27ca24d700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27c4154e00 con 0x7f27c413fa60 2020-04-22T14:12:52.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.520+0000 7f27ca24d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c41550a0 con 0x7f27c413dc20 2020-04-22T14:12:52.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.520+0000 7f27c2ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f27c413fa60 0x7f27c4155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:52.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.520+0000 7f27c2ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f27c413fa60 0x7f27c4155540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53322/0 (socket says 172.21.15.103:53322) 2020-04-22T14:12:52.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.520+0000 7f27c2ffd700 1 -- 172.21.15.103:0/2109844375 learned_addr learned my addr 172.21.15.103:0/2109844375 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:52.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.520+0000 7f27c37fe700 1 --2- 172.21.15.103:0/2109844375 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27c413dc20 0x7f27c413f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:52.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.520+0000 7f27c2ffd700 1 -- 172.21.15.103:0/2109844375 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27c413dc20 msgr2=0x7f27c413f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:52.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.520+0000 7f27c2ffd700 1 --2- 172.21.15.103:0/2109844375 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27c413dc20 0x7f27c413f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:52.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.520+0000 7f27c2ffd700 1 -- 172.21.15.103:0/2109844375 >> v1:172.21.15.86:6789/0 conn(0x7f27c41559a0 legacy=0x7f27c413ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:52.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.520+0000 7f27c2ffd700 1 -- 172.21.15.103:0/2109844375 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c413e000 con 0x7f27c413fa60 2020-04-22T14:12:52.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.520+0000 7f27c2ffd700 1 --2- 172.21.15.103:0/2109844375 >> v2:172.21.15.103:3300/0 conn(0x7f27c413fa60 0x7f27c4155540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f27b80010d0 tx=0x7f27b8010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:52.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.520+0000 7f27c2ffd700 1 --2- 172.21.15.103:0/2109844375 >> v2:172.21.15.103:3300/0 conn(0x7f27c413fa60 0x7f27c4155540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f27b80010d0 tx=0x7f27b8010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:52.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.520+0000 7f27c2ffd700 1 --2- 172.21.15.103:0/2109844375 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27c413fa60 0x7f27c4155540 secure :-1 s=READY pgs=1174 cs=0 l=1 rx=0x7f27b80010d0 tx=0x7f27b8010b70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:52.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.520+0000 7f27c2ffd700 1 --2- 172.21.15.103:0/2109844375 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27c413fa60 0x7f27c4155540 secure :-1 s=THROTTLE_DONE pgs=1174 cs=0 l=1 rx=0x7f27b80010d0 tx=0x7f27b8010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:52.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.520+0000 7f27c0ff9700 1 -- 172.21.15.103:0/2109844375 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27b800cc20 con 0x7f27c413fa60 2020-04-22T14:12:52.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.520+0000 7f27c2ffd700 1 --2- 172.21.15.103:0/2109844375 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27c413fa60 0x7f27c4155540 secure :-1 s=THROTTLE_DONE pgs=1174 cs=0 l=1 rx=0x7f27b80010d0 tx=0x7f27b8010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:52.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.520+0000 7f27c0ff9700 1 -- 172.21.15.103:0/2109844375 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b800cdc0 con 0x7f27c413fa60 2020-04-22T14:12:52.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.520+0000 7f27c2ffd700 1 --2- 172.21.15.103:0/2109844375 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27c413fa60 0x7f27c4155540 secure :-1 s=THROTTLE_DONE pgs=1174 cs=0 l=1 rx=0x7f27b80010d0 tx=0x7f27b8010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:52.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.520+0000 7f27ca24d700 1 -- 172.21.15.103:0/2109844375 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27c40b4b00 con 0x7f27c413fa60 2020-04-22T14:12:52.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.520+0000 7f27c0ff9700 1 -- 172.21.15.103:0/2109844375 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27b80123c0 con 0x7f27c413fa60 2020-04-22T14:12:52.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.520+0000 7f27ca24d700 1 -- 172.21.15.103:0/2109844375 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27c41520c0 con 0x7f27c413fa60 2020-04-22T14:12:52.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.521+0000 7f27c2ffd700 1 --2- 172.21.15.103:0/2109844375 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27c413fa60 0x7f27c4155540 secure :-1 s=THROTTLE_DONE pgs=1174 cs=0 l=1 rx=0x7f27b80010d0 tx=0x7f27b8010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:52.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.521+0000 7f27ca24d700 1 -- 172.21.15.103:0/2109844375 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27c4056c90 con 0x7f27c413fa60 2020-04-22T14:12:52.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.521+0000 7f27c0ff9700 1 -- 172.21.15.103:0/2109844375 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f27b8012680 con 0x7f27c413fa60 2020-04-22T14:12:52.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.521+0000 7f27c2ffd700 1 --2- 172.21.15.103:0/2109844375 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27c413fa60 0x7f27c4155540 secure :-1 s=THROTTLE_DONE pgs=1174 cs=0 l=1 rx=0x7f27b80010d0 tx=0x7f27b8010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:52.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.522+0000 7f27c0ff9700 1 --2- 172.21.15.103:0/2109844375 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f27a404d850 0x7f27a404fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:52.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.522+0000 7f27c0ff9700 1 -- 172.21.15.103:0/2109844375 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f27b8061620 con 0x7f27c413fa60 2020-04-22T14:12:52.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.522+0000 7f27c37fe700 1 --2- 172.21.15.103:0/2109844375 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f27a404d850 0x7f27a404fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:52.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.522+0000 7f27c37fe700 1 --2- 172.21.15.103:0/2109844375 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f27a404d850 0x7f27a404fd10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f27b4002f30 tx=0x7f27b4007bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:52.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.522+0000 7f27c37fe700 1 --2- 172.21.15.103:0/2109844375 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f27a404d850 0x7f27a404fd10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f27b4002f30 tx=0x7f27b4007bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:52.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.522+0000 7f27c37fe700 1 --2- 172.21.15.103:0/2109844375 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f27a404d850 0x7f27a404fd10 secure :-1 s=READY pgs=431 cs=0 l=1 rx=0x7f27b4002f30 tx=0x7f27b4007bd0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:52.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.526+0000 7f27c2ffd700 1 --2- 172.21.15.103:0/2109844375 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27c413fa60 0x7f27c4155540 secure :-1 s=THROTTLE_DONE pgs=1174 cs=0 l=1 rx=0x7f27b80010d0 tx=0x7f27b8010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:52.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.526+0000 7f27c0ff9700 1 -- 172.21.15.103:0/2109844375 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f27b803cac0 con 0x7f27c413fa60 2020-04-22T14:12:52.692 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:12:52.709 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:12:52.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.715+0000 7f27ca24d700 1 -- 172.21.15.103:0/2109844375 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27c4142300 con 0x7f27c413fa60 2020-04-22T14:12:52.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.715+0000 7f27c2ffd700 1 --2- 172.21.15.103:0/2109844375 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27c413fa60 0x7f27c4155540 secure :-1 s=THROTTLE_DONE pgs=1174 cs=0 l=1 rx=0x7f27b80010d0 tx=0x7f27b8010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:52.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.715+0000 7f27c0ff9700 1 -- 172.21.15.103:0/2109844375 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f27b80400e0 con 0x7f27c413fa60 2020-04-22T14:12:52.718 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:12:52.718 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:43.570838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:12:52.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.716+0000 7f27ca24d700 1 -- 172.21.15.103:0/2109844375 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f27a404d850 msgr2=0x7f27a404fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:52.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.716+0000 7f27ca24d700 1 --2- 172.21.15.103:0/2109844375 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f27a404d850 0x7f27a404fd10 secure :-1 s=READY pgs=431 cs=0 l=1 rx=0x7f27b4002f30 tx=0x7f27b4007bd0).stop 2020-04-22T14:12:52.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.716+0000 7f27ca24d700 1 -- 172.21.15.103:0/2109844375 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27c413fa60 msgr2=0x7f27c4155540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:52.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.716+0000 7f27ca24d700 1 --2- 172.21.15.103:0/2109844375 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27c413fa60 0x7f27c4155540 secure :-1 s=READY pgs=1174 cs=0 l=1 rx=0x7f27b80010d0 tx=0x7f27b8010b70).stop 2020-04-22T14:12:52.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.716+0000 7f27ca24d700 1 -- 172.21.15.103:0/2109844375 shutdown_connections 2020-04-22T14:12:52.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.716+0000 7f27ca24d700 1 --2- 172.21.15.103:0/2109844375 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f27a404d850 0x7f27a404fd10 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:52.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.716+0000 7f27ca24d700 1 --2- 172.21.15.103:0/2109844375 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27c413dc20 0x7f27c413f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:52.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.716+0000 7f27ca24d700 1 --2- 172.21.15.103:0/2109844375 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27c413fa60 0x7f27c4155540 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:52.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.716+0000 7f27ca24d700 1 -- 172.21.15.103:0/2109844375 >> 172.21.15.103:0/2109844375 conn(0x7f27c40b9160 msgr2=0x7f27c4062cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:52.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.717+0000 7f27ca24d700 1 -- 172.21.15.103:0/2109844375 shutdown_connections 2020-04-22T14:12:52.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:52.717+0000 7f27ca24d700 1 -- 172.21.15.103:0/2109844375 wait complete. 2020-04-22T14:12:52.721 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 54 2020-04-22T14:12:52.729 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:12:52.751 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:52.765 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:12:53.730 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:53.747 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:12:53.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.903+0000 7fe8b1aec700 1 Processor -- start 2020-04-22T14:12:53.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.903+0000 7fe8b1aec700 1 -- start start 2020-04-22T14:12:53.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.903+0000 7fe8b1aec700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8ac0b95c0 0x7fe8ac0b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:53.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.903+0000 7fe8b1aec700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe8ac13fdf0 0x7fe8ac140240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:53.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.903+0000 7fe8b1aec700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8ac0b4b60 con 0x7fe8ac143bf0 2020-04-22T14:12:53.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.903+0000 7fe8b1aec700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8ac0b4e00 con 0x7fe8ac13fdf0 2020-04-22T14:12:53.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.903+0000 7fe8b1aec700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac0b50a0 con 0x7fe8ac0b95c0 2020-04-22T14:12:53.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.904+0000 7fe8ab7fe700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8ac0b95c0 0x7fe8ac0b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:53.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.904+0000 7fe8abfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe8ac13fdf0 0x7fe8ac140240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:53.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.904+0000 7fe8ab7fe700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8ac0b95c0 0x7fe8ac0b45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:38106/0 (socket says 172.21.15.103:38106) 2020-04-22T14:12:53.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.904+0000 7fe8abfff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe8ac13fdf0 0x7fe8ac140240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:50560/0 (socket says 172.21.15.103:50560) 2020-04-22T14:12:53.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.904+0000 7fe8ab7fe700 1 -- 172.21.15.103:0/993356785 learned_addr learned my addr 172.21.15.103:0/993356785 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:53.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.904+0000 7fe8aaffd700 1 --1- 172.21.15.103:0/993356785 >> v1:172.21.15.86:6789/0 conn(0x7fe8ac143bf0 0x7fe8ac066de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:34442/0 (socket says 172.21.15.103:34442) 2020-04-22T14:12:53.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.904+0000 7fe8abfff700 1 -- 172.21.15.103:0/993356785 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8ac0b95c0 msgr2=0x7fe8ac0b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:53.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.904+0000 7fe8abfff700 1 --2- 172.21.15.103:0/993356785 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8ac0b95c0 0x7fe8ac0b45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:53.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.904+0000 7fe8abfff700 1 -- 172.21.15.103:0/993356785 >> v1:172.21.15.86:6789/0 conn(0x7fe8ac143bf0 legacy=0x7fe8ac066de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:53.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.904+0000 7fe8aa7fc700 1 -- 172.21.15.103:0/993356785 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2530254278 0 0) 0x7fe8ac0b4b60 con 0x7fe8ac143bf0 2020-04-22T14:12:53.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.904+0000 7fe8abfff700 1 -- 172.21.15.103:0/993356785 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8ac144050 con 0x7fe8ac13fdf0 2020-04-22T14:12:53.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.904+0000 7fe8ab7fe700 1 --2- 172.21.15.103:0/993356785 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8ac0b95c0 0x7fe8ac0b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:12:53.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.904+0000 7fe8abfff700 1 --2- 172.21.15.103:0/993356785 >> v2:172.21.15.86:3300/0 conn(0x7fe8ac13fdf0 0x7fe8ac140240 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe8a4002f30 tx=0x7fe8a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:53.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.904+0000 7fe8abfff700 1 --2- 172.21.15.103:0/993356785 >> v2:172.21.15.86:3300/0 conn(0x7fe8ac13fdf0 0x7fe8ac140240 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe8a4002f30 tx=0x7fe8a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:53.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.904+0000 7fe8abfff700 1 --2- 172.21.15.103:0/993356785 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8ac13fdf0 0x7fe8ac140240 secure :-1 s=READY pgs=636 cs=0 l=1 rx=0x7fe8a4002f30 tx=0x7fe8a4007a40).ready entity=mon.0 client_cookie=75ba61e667fb0122 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:53.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.904+0000 7fe8abfff700 1 --2- 172.21.15.103:0/993356785 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8ac13fdf0 0x7fe8ac140240 secure :-1 s=THROTTLE_DONE pgs=636 cs=0 l=1 rx=0x7fe8a4002f30 tx=0x7fe8a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:53.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.904+0000 7fe8aa7fc700 1 -- 172.21.15.103:0/993356785 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8a40113c0 con 0x7fe8ac13fdf0 2020-04-22T14:12:53.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.904+0000 7fe8abfff700 1 --2- 172.21.15.103:0/993356785 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8ac13fdf0 0x7fe8ac140240 secure :-1 s=THROTTLE_DONE pgs=636 cs=0 l=1 rx=0x7fe8a4002f30 tx=0x7fe8a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:53.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.905+0000 7fe8aa7fc700 1 -- 172.21.15.103:0/993356785 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a4011560 con 0x7fe8ac13fdf0 2020-04-22T14:12:53.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.905+0000 7fe8abfff700 1 --2- 172.21.15.103:0/993356785 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8ac13fdf0 0x7fe8ac140240 secure :-1 s=THROTTLE_DONE pgs=636 cs=0 l=1 rx=0x7fe8a4002f30 tx=0x7fe8a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:53.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.905+0000 7fe8aa7fc700 1 -- 172.21.15.103:0/993356785 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8a4011940 con 0x7fe8ac13fdf0 2020-04-22T14:12:53.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.905+0000 7fe8b1aec700 1 -- 172.21.15.103:0/993356785 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8ac13fdf0 msgr2=0x7fe8ac140240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:53.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.905+0000 7fe8b1aec700 1 --2- 172.21.15.103:0/993356785 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8ac13fdf0 0x7fe8ac140240 secure :-1 s=READY pgs=636 cs=0 l=1 rx=0x7fe8a4002f30 tx=0x7fe8a4007a40).stop 2020-04-22T14:12:53.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.905+0000 7fe8b1aec700 1 -- 172.21.15.103:0/993356785 shutdown_connections 2020-04-22T14:12:53.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.905+0000 7fe8b1aec700 1 --2- 172.21.15.103:0/993356785 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8ac13fdf0 0x7fe8ac140240 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:53.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.905+0000 7fe8b1aec700 1 --2- 172.21.15.103:0/993356785 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8ac0b95c0 0x7fe8ac0b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:53.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.905+0000 7fe8b1aec700 1 -- 172.21.15.103:0/993356785 >> 172.21.15.103:0/993356785 conn(0x7fe8ac05b800 msgr2=0x7fe8ac0b8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:53.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.905+0000 7fe8b1aec700 1 -- 172.21.15.103:0/993356785 shutdown_connections 2020-04-22T14:12:53.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.905+0000 7fe8b1aec700 1 -- 172.21.15.103:0/993356785 wait complete. 2020-04-22T14:12:53.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.906+0000 7fe8b1aec700 1 Processor -- start 2020-04-22T14:12:53.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.906+0000 7fe8b1aec700 1 -- start start 2020-04-22T14:12:53.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.907+0000 7fe8b1aec700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8ac0b95c0 0x7fe8ac0619f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:53.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.907+0000 7fe8b1aec700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe8ac143bf0 0x7fe8ac1428b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:53.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.907+0000 7fe8b1aec700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8ac061f70 con 0x7fe8ac13fdf0 2020-04-22T14:12:53.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.907+0000 7fe8b1aec700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8ac140450 con 0x7fe8ac143bf0 2020-04-22T14:12:53.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.907+0000 7fe8b1aec700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac062210 con 0x7fe8ac0b95c0 2020-04-22T14:12:53.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.907+0000 7fe8aaffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe8ac13fdf0 0x7fe8ac0b7fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45524/0 (socket says 172.21.15.103:45524) 2020-04-22T14:12:53.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.907+0000 7fe8aaffd700 1 -- 172.21.15.103:0/61190679 learned_addr learned my addr 172.21.15.103:0/61190679 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:53.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.907+0000 7fe8ab7fe700 1 --2- 172.21.15.103:0/61190679 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8ac0b95c0 0x7fe8ac0619f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:53.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.907+0000 7fe8abfff700 1 --2- 172.21.15.103:0/61190679 >> v2:172.21.15.86:3300/0 conn(0x7fe8ac143bf0 0x7fe8ac1428b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:53.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.907+0000 7fe8a8ff9700 1 -- 172.21.15.103:0/61190679 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3587506560 0 0) 0x7fe8ac061f70 con 0x7fe8ac13fdf0 2020-04-22T14:12:53.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.907+0000 7fe8a8ff9700 1 -- 172.21.15.103:0/61190679 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe890002fe0 con 0x7fe8ac13fdf0 2020-04-22T14:12:53.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.907+0000 7fe8ab7fe700 1 -- 172.21.15.103:0/61190679 >> v2:172.21.15.86:3300/0 conn(0x7fe8ac143bf0 msgr2=0x7fe8ac1428b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:53.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.907+0000 7fe8ab7fe700 1 --2- 172.21.15.103:0/61190679 >> v2:172.21.15.86:3300/0 conn(0x7fe8ac143bf0 0x7fe8ac1428b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:53.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.907+0000 7fe8ab7fe700 1 -- 172.21.15.103:0/61190679 >> v1:172.21.15.103:6789/0 conn(0x7fe8ac13fdf0 legacy=0x7fe8ac0b7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:53.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.907+0000 7fe8ab7fe700 1 -- 172.21.15.103:0/61190679 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8ac0624b0 con 0x7fe8ac0b95c0 2020-04-22T14:12:53.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.907+0000 7fe8abfff700 1 --2- 172.21.15.103:0/61190679 >> v2:172.21.15.86:3300/0 conn(0x7fe8ac143bf0 0x7fe8ac1428b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:12:53.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.907+0000 7fe8ab7fe700 1 --2- 172.21.15.103:0/61190679 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8ac0b95c0 0x7fe8ac0619f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe89c0032b0 tx=0x7fe89c0110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:53.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.908+0000 7fe8ab7fe700 1 --2- 172.21.15.103:0/61190679 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8ac0b95c0 0x7fe8ac0619f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe89c0032b0 tx=0x7fe89c0110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:53.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.908+0000 7fe8ab7fe700 1 --2- 172.21.15.103:0/61190679 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8ac0b95c0 0x7fe8ac0619f0 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7fe89c0032b0 tx=0x7fe89c0110f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:53.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.908+0000 7fe8ab7fe700 1 --2- 172.21.15.103:0/61190679 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8ac0b95c0 0x7fe8ac0619f0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fe89c0032b0 tx=0x7fe89c0110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:53.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.908+0000 7fe8a8ff9700 1 -- 172.21.15.103:0/61190679 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe89c007370 con 0x7fe8ac0b95c0 2020-04-22T14:12:53.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.908+0000 7fe8ab7fe700 1 --2- 172.21.15.103:0/61190679 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8ac0b95c0 0x7fe8ac0619f0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fe89c0032b0 tx=0x7fe89c0110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:53.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.908+0000 7fe8ab7fe700 1 --2- 172.21.15.103:0/61190679 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8ac0b95c0 0x7fe8ac0619f0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fe89c0032b0 tx=0x7fe89c0110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:53.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.908+0000 7fe8a8ff9700 1 -- 172.21.15.103:0/61190679 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89c0074d0 con 0x7fe8ac0b95c0 2020-04-22T14:12:53.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.908+0000 7fe8a8ff9700 1 -- 172.21.15.103:0/61190679 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe89c0078b0 con 0x7fe8ac0b95c0 2020-04-22T14:12:53.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.908+0000 7fe8b1aec700 1 -- 172.21.15.103:0/61190679 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8ac0b86d0 con 0x7fe8ac0b95c0 2020-04-22T14:12:53.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.908+0000 7fe8b1aec700 1 -- 172.21.15.103:0/61190679 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8ac13f320 con 0x7fe8ac0b95c0 2020-04-22T14:12:53.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.909+0000 7fe8ab7fe700 1 --2- 172.21.15.103:0/61190679 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8ac0b95c0 0x7fe8ac0619f0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fe89c0032b0 tx=0x7fe89c0110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:53.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.909+0000 7fe8b1aec700 1 -- 172.21.15.103:0/61190679 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8ac056c90 con 0x7fe8ac0b95c0 2020-04-22T14:12:53.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.909+0000 7fe8a8ff9700 1 -- 172.21.15.103:0/61190679 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fe89c00b280 con 0x7fe8ac0b95c0 2020-04-22T14:12:53.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.909+0000 7fe8ab7fe700 1 --2- 172.21.15.103:0/61190679 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8ac0b95c0 0x7fe8ac0619f0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fe89c0032b0 tx=0x7fe89c0110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:53.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.909+0000 7fe8a8ff9700 1 --2- 172.21.15.103:0/61190679 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe89004dcc0 0x7fe890050180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:53.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.909+0000 7fe8a8ff9700 1 -- 172.21.15.103:0/61190679 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fe89c0616d0 con 0x7fe8ac0b95c0 2020-04-22T14:12:53.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.909+0000 7fe8aaffd700 1 --2- 172.21.15.103:0/61190679 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe89004dcc0 0x7fe890050180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:53.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.910+0000 7fe8aaffd700 1 --2- 172.21.15.103:0/61190679 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe89004dcc0 0x7fe890050180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe8940010a0 tx=0x7fe894001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:53.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.910+0000 7fe8aaffd700 1 --2- 172.21.15.103:0/61190679 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe89004dcc0 0x7fe890050180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe8940010a0 tx=0x7fe894001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:53.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.910+0000 7fe8aaffd700 1 --2- 172.21.15.103:0/61190679 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe89004dcc0 0x7fe890050180 secure :-1 s=READY pgs=432 cs=0 l=1 rx=0x7fe8940010a0 tx=0x7fe894001840).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:53.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.913+0000 7fe8ab7fe700 1 --2- 172.21.15.103:0/61190679 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8ac0b95c0 0x7fe8ac0619f0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fe89c0032b0 tx=0x7fe89c0110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:53.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:53.913+0000 7fe8a8ff9700 1 -- 172.21.15.103:0/61190679 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fe89c03ca50 con 0x7fe8ac0b95c0 2020-04-22T14:12:54.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:54.100+0000 7fe8b1aec700 1 -- 172.21.15.103:0/61190679 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe8ac1405e0 con 0x7fe8ac0b95c0 2020-04-22T14:12:54.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:54.101+0000 7fe8ab7fe700 1 --2- 172.21.15.103:0/61190679 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8ac0b95c0 0x7fe8ac0619f0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fe89c0032b0 tx=0x7fe89c0110f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:54.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:54.101+0000 7fe8a8ff9700 1 -- 172.21.15.103:0/61190679 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2147 (secure 0 0 0) 0x7fe89c040070 con 0x7fe8ac0b95c0 2020-04-22T14:12:54.103 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:12:54.103 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:43.570838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:12:54.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:54.102+0000 7fe8b1aec700 1 -- 172.21.15.103:0/61190679 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe89004dcc0 msgr2=0x7fe890050180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:54.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:54.102+0000 7fe8b1aec700 1 --2- 172.21.15.103:0/61190679 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe89004dcc0 0x7fe890050180 secure :-1 s=READY pgs=432 cs=0 l=1 rx=0x7fe8940010a0 tx=0x7fe894001840).stop 2020-04-22T14:12:54.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:54.102+0000 7fe8b1aec700 1 -- 172.21.15.103:0/61190679 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8ac0b95c0 msgr2=0x7fe8ac0619f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:54.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:54.102+0000 7fe8b1aec700 1 --2- 172.21.15.103:0/61190679 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8ac0b95c0 0x7fe8ac0619f0 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7fe89c0032b0 tx=0x7fe89c0110f0).stop 2020-04-22T14:12:54.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:54.102+0000 7fe8b1aec700 1 -- 172.21.15.103:0/61190679 shutdown_connections 2020-04-22T14:12:54.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:54.102+0000 7fe8b1aec700 1 --2- 172.21.15.103:0/61190679 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe89004dcc0 0x7fe890050180 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:54.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:54.102+0000 7fe8b1aec700 1 --2- 172.21.15.103:0/61190679 >> v2:172.21.15.86:3300/0 conn(0x7fe8ac143bf0 0x7fe8ac1428b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:54.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:54.102+0000 7fe8b1aec700 1 --2- 172.21.15.103:0/61190679 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8ac0b95c0 0x7fe8ac0619f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:54.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:54.102+0000 7fe8b1aec700 1 -- 172.21.15.103:0/61190679 >> 172.21.15.103:0/61190679 conn(0x7fe8ac05b800 msgr2=0x7fe8ac143170 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:54.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:54.102+0000 7fe8b1aec700 1 -- 172.21.15.103:0/61190679 shutdown_connections 2020-04-22T14:12:54.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:54.102+0000 7fe8b1aec700 1 -- 172.21.15.103:0/61190679 wait complete. 2020-04-22T14:12:54.106 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 54 2020-04-22T14:12:54.115 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:12:55.117 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:55.143 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:12:55.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.292+0000 7f60a5ccc700 1 Processor -- start 2020-04-22T14:12:55.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.292+0000 7f60a5ccc700 1 -- start start 2020-04-22T14:12:55.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.293+0000 7f60a5ccc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f60a0065fe0 0x7f60a01464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:55.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.293+0000 7f60a5ccc700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a0143300 con 0x7f60a0063e30 2020-04-22T14:12:55.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.293+0000 7f60a5ccc700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a01435a0 con 0x7f60a012c0d0 2020-04-22T14:12:55.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.293+0000 7f60a5ccc700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60a0143840 con 0x7f60a0065fe0 2020-04-22T14:12:55.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.293+0000 7f609effd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f60a0065fe0 0x7f60a01464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:55.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.293+0000 7f609f7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f60a012c0d0 0x7f60a005b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45530/0 (socket says 172.21.15.103:45530) 2020-04-22T14:12:55.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.293+0000 7f609f7fe700 1 -- 172.21.15.103:0/2497159034 learned_addr learned my addr 172.21.15.103:0/2497159034 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:55.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.293+0000 7f609effd700 1 -- 172.21.15.103:0/2497159034 >> v1:172.21.15.103:6789/0 conn(0x7f60a012c0d0 legacy=0x7f60a005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:55.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.293+0000 7f609effd700 1 -- 172.21.15.103:0/2497159034 >> v1:172.21.15.86:6789/0 conn(0x7f60a0063e30 legacy=0x7f60a00642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:55.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.294+0000 7f609effd700 1 -- 172.21.15.103:0/2497159034 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a005bb50 con 0x7f60a0065fe0 2020-04-22T14:12:55.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.294+0000 7f609effd700 1 --2- 172.21.15.103:0/2497159034 >> v2:172.21.15.103:3300/0 conn(0x7f60a0065fe0 0x7f60a01464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f60a00669a0 tx=0x7f6094007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:55.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.294+0000 7f609effd700 1 --2- 172.21.15.103:0/2497159034 >> v2:172.21.15.103:3300/0 conn(0x7f60a0065fe0 0x7f60a01464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f60a00669a0 tx=0x7f6094007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:55.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.294+0000 7f609effd700 1 --2- 172.21.15.103:0/2497159034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60a0065fe0 0x7f60a01464e0 secure :-1 s=READY pgs=1177 cs=0 l=1 rx=0x7f60a00669a0 tx=0x7f6094007a40).ready entity=mon.1 client_cookie=a21c27edc494c6a0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:55.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.294+0000 7f609effd700 1 --2- 172.21.15.103:0/2497159034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60a0065fe0 0x7f60a01464e0 secure :-1 s=THROTTLE_DONE pgs=1177 cs=0 l=1 rx=0x7f60a00669a0 tx=0x7f6094007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:55.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.294+0000 7f609e7fc700 1 -- 172.21.15.103:0/2497159034 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6094011430 con 0x7f60a0065fe0 2020-04-22T14:12:55.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.294+0000 7f609effd700 1 --2- 172.21.15.103:0/2497159034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60a0065fe0 0x7f60a01464e0 secure :-1 s=THROTTLE_DONE pgs=1177 cs=0 l=1 rx=0x7f60a00669a0 tx=0x7f6094007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:55.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.294+0000 7f609effd700 1 --2- 172.21.15.103:0/2497159034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60a0065fe0 0x7f60a01464e0 secure :-1 s=THROTTLE_DONE pgs=1177 cs=0 l=1 rx=0x7f60a00669a0 tx=0x7f6094007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:55.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.294+0000 7f609e7fc700 1 -- 172.21.15.103:0/2497159034 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6094011590 con 0x7f60a0065fe0 2020-04-22T14:12:55.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.294+0000 7f609e7fc700 1 -- 172.21.15.103:0/2497159034 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60940119b0 con 0x7f60a0065fe0 2020-04-22T14:12:55.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.294+0000 7f60a5ccc700 1 -- 172.21.15.103:0/2497159034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60a0065fe0 msgr2=0x7f60a01464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:55.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.294+0000 7f60a5ccc700 1 --2- 172.21.15.103:0/2497159034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60a0065fe0 0x7f60a01464e0 secure :-1 s=READY pgs=1177 cs=0 l=1 rx=0x7f60a00669a0 tx=0x7f6094007a40).stop 2020-04-22T14:12:55.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.294+0000 7f60a5ccc700 1 -- 172.21.15.103:0/2497159034 shutdown_connections 2020-04-22T14:12:55.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.294+0000 7f60a5ccc700 1 --2- 172.21.15.103:0/2497159034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60a0065fe0 0x7f60a01464e0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:55.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.294+0000 7f60a5ccc700 1 -- 172.21.15.103:0/2497159034 >> 172.21.15.103:0/2497159034 conn(0x7f60a00b9160 msgr2=0x7f60a005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:55.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.294+0000 7f60a5ccc700 1 -- 172.21.15.103:0/2497159034 shutdown_connections 2020-04-22T14:12:55.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.294+0000 7f60a5ccc700 1 -- 172.21.15.103:0/2497159034 wait complete. 2020-04-22T14:12:55.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.295+0000 7f60a5ccc700 1 Processor -- start 2020-04-22T14:12:55.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.295+0000 7f60a5ccc700 1 -- start start 2020-04-22T14:12:55.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.296+0000 7f60a5ccc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f60a0063e30 0x7f60a01475a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:55.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.296+0000 7f60a5ccc700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f60a0065fe0 0x7f60a012b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:55.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.296+0000 7f60a5ccc700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a0142710 con 0x7f60a012c0d0 2020-04-22T14:12:55.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.296+0000 7f60a5ccc700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60a0147b20 con 0x7f60a0063e30 2020-04-22T14:12:55.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.296+0000 7f60a5ccc700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a0147dc0 con 0x7f60a0065fe0 2020-04-22T14:12:55.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.296+0000 7f609f7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f60a0063e30 0x7f60a01475a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:55.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.296+0000 7f609f7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f60a0063e30 0x7f60a01475a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53346/0 (socket says 172.21.15.103:53346) 2020-04-22T14:12:55.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.296+0000 7f609f7fe700 1 -- 172.21.15.103:0/2032802201 learned_addr learned my addr 172.21.15.103:0/2032802201 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:55.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.296+0000 7f609f7fe700 1 -- 172.21.15.103:0/2032802201 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f60a0065fe0 msgr2=0x7f60a012b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:55.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.296+0000 7f609f7fe700 1 --2- 172.21.15.103:0/2032802201 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f60a0065fe0 0x7f60a012b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:55.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.296+0000 7f609f7fe700 1 -- 172.21.15.103:0/2032802201 >> v1:172.21.15.86:6789/0 conn(0x7f60a012c0d0 legacy=0x7f60a0125d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:55.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.297+0000 7f609f7fe700 1 -- 172.21.15.103:0/2032802201 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a0148060 con 0x7f60a0063e30 2020-04-22T14:12:55.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.297+0000 7f609f7fe700 1 --2- 172.21.15.103:0/2032802201 >> v2:172.21.15.103:3300/0 conn(0x7f60a0063e30 0x7f60a01475a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f60a00b8150 tx=0x7f6090010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:55.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.297+0000 7f609f7fe700 1 --2- 172.21.15.103:0/2032802201 >> v2:172.21.15.103:3300/0 conn(0x7f60a0063e30 0x7f60a01475a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f60a00b8150 tx=0x7f6090010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:55.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.297+0000 7f609f7fe700 1 --2- 172.21.15.103:0/2032802201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60a0063e30 0x7f60a01475a0 secure :-1 s=READY pgs=1178 cs=0 l=1 rx=0x7f60a00b8150 tx=0x7f6090010a60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:55.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.297+0000 7f609f7fe700 1 --2- 172.21.15.103:0/2032802201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60a0063e30 0x7f60a01475a0 secure :-1 s=THROTTLE_DONE pgs=1178 cs=0 l=1 rx=0x7f60a00b8150 tx=0x7f6090010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:55.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.297+0000 7f609cff9700 1 -- 172.21.15.103:0/2032802201 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6090005ca0 con 0x7f60a0063e30 2020-04-22T14:12:55.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.297+0000 7f609f7fe700 1 --2- 172.21.15.103:0/2032802201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60a0063e30 0x7f60a01475a0 secure :-1 s=THROTTLE_DONE pgs=1178 cs=0 l=1 rx=0x7f60a00b8150 tx=0x7f6090010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:55.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.297+0000 7f609f7fe700 1 --2- 172.21.15.103:0/2032802201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60a0063e30 0x7f60a01475a0 secure :-1 s=THROTTLE_DONE pgs=1178 cs=0 l=1 rx=0x7f60a00b8150 tx=0x7f6090010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:55.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.297+0000 7f609cff9700 1 -- 172.21.15.103:0/2032802201 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6090005e00 con 0x7f60a0063e30 2020-04-22T14:12:55.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.297+0000 7f60a5ccc700 1 -- 172.21.15.103:0/2032802201 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60a00b78b0 con 0x7f60a0063e30 2020-04-22T14:12:55.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.297+0000 7f609cff9700 1 -- 172.21.15.103:0/2032802201 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60900062c0 con 0x7f60a0063e30 2020-04-22T14:12:55.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.297+0000 7f60a5ccc700 1 -- 172.21.15.103:0/2032802201 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60a01264a0 con 0x7f60a0063e30 2020-04-22T14:12:55.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.297+0000 7f609f7fe700 1 --2- 172.21.15.103:0/2032802201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60a0063e30 0x7f60a01475a0 secure :-1 s=THROTTLE_DONE pgs=1178 cs=0 l=1 rx=0x7f60a00b8150 tx=0x7f6090010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:55.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.298+0000 7f60a5ccc700 1 -- 172.21.15.103:0/2032802201 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60a0056c90 con 0x7f60a0063e30 2020-04-22T14:12:55.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.298+0000 7f609cff9700 1 -- 172.21.15.103:0/2032802201 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f60900064f0 con 0x7f60a0063e30 2020-04-22T14:12:55.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.298+0000 7f609f7fe700 1 --2- 172.21.15.103:0/2032802201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60a0063e30 0x7f60a01475a0 secure :-1 s=THROTTLE_DONE pgs=1178 cs=0 l=1 rx=0x7f60a00b8150 tx=0x7f6090010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:55.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.298+0000 7f609cff9700 1 --2- 172.21.15.103:0/2032802201 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f608004daa0 0x7f608004ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:55.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.298+0000 7f609cff9700 1 -- 172.21.15.103:0/2032802201 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f60900090c0 con 0x7f60a0063e30 2020-04-22T14:12:55.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.298+0000 7f609effd700 1 --2- 172.21.15.103:0/2032802201 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f608004daa0 0x7f608004ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:55.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.299+0000 7f609effd700 1 --2- 172.21.15.103:0/2032802201 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f608004daa0 0x7f608004ff60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f60a00669a0 tx=0x7f6094007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:55.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.299+0000 7f609effd700 1 --2- 172.21.15.103:0/2032802201 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f608004daa0 0x7f608004ff60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f60a00669a0 tx=0x7f6094007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:55.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.299+0000 7f609effd700 1 --2- 172.21.15.103:0/2032802201 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f608004daa0 0x7f608004ff60 secure :-1 s=READY pgs=433 cs=0 l=1 rx=0x7f60a00669a0 tx=0x7f6094007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:55.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.302+0000 7f609f7fe700 1 --2- 172.21.15.103:0/2032802201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60a0063e30 0x7f60a01475a0 secure :-1 s=THROTTLE_DONE pgs=1178 cs=0 l=1 rx=0x7f60a00b8150 tx=0x7f6090010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:55.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.302+0000 7f609cff9700 1 -- 172.21.15.103:0/2032802201 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f609003c9d0 con 0x7f60a0063e30 2020-04-22T14:12:55.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.491+0000 7f60a5ccc700 1 -- 172.21.15.103:0/2032802201 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60a00b5900 con 0x7f60a0063e30 2020-04-22T14:12:55.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.491+0000 7f609f7fe700 1 --2- 172.21.15.103:0/2032802201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60a0063e30 0x7f60a01475a0 secure :-1 s=THROTTLE_DONE pgs=1178 cs=0 l=1 rx=0x7f60a00b8150 tx=0x7f6090010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:55.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.491+0000 7f609cff9700 1 -- 172.21.15.103:0/2032802201 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f609003fff0 con 0x7f60a0063e30 2020-04-22T14:12:55.494 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:12:55.494 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:43.570838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:12:55.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.492+0000 7f60a5ccc700 1 -- 172.21.15.103:0/2032802201 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f608004daa0 msgr2=0x7f608004ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:55.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.492+0000 7f60a5ccc700 1 --2- 172.21.15.103:0/2032802201 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f608004daa0 0x7f608004ff60 secure :-1 s=READY pgs=433 cs=0 l=1 rx=0x7f60a00669a0 tx=0x7f6094007a40).stop 2020-04-22T14:12:55.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.493+0000 7f60a5ccc700 1 -- 172.21.15.103:0/2032802201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60a0063e30 msgr2=0x7f60a01475a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:55.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.493+0000 7f60a5ccc700 1 --2- 172.21.15.103:0/2032802201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60a0063e30 0x7f60a01475a0 secure :-1 s=READY pgs=1178 cs=0 l=1 rx=0x7f60a00b8150 tx=0x7f6090010a60).stop 2020-04-22T14:12:55.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.493+0000 7f60a5ccc700 1 -- 172.21.15.103:0/2032802201 shutdown_connections 2020-04-22T14:12:55.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.493+0000 7f60a5ccc700 1 --2- 172.21.15.103:0/2032802201 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f608004daa0 0x7f608004ff60 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:55.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.493+0000 7f60a5ccc700 1 --2- 172.21.15.103:0/2032802201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60a0063e30 0x7f60a01475a0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:55.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.493+0000 7f60a5ccc700 1 --2- 172.21.15.103:0/2032802201 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f60a0065fe0 0x7f60a012b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:55.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.493+0000 7f60a5ccc700 1 -- 172.21.15.103:0/2032802201 >> 172.21.15.103:0/2032802201 conn(0x7f60a00b9160 msgr2=0x7f60a00b4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:55.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.493+0000 7f60a5ccc700 1 -- 172.21.15.103:0/2032802201 shutdown_connections 2020-04-22T14:12:55.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:55.493+0000 7f60a5ccc700 1 -- 172.21.15.103:0/2032802201 wait complete. 2020-04-22T14:12:55.497 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 54 2020-04-22T14:12:55.505 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:12:56.506 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:56.524 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:12:56.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.679+0000 7f558d597700 1 Processor -- start 2020-04-22T14:12:56.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.679+0000 7f558d597700 1 -- start start 2020-04-22T14:12:56.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.680+0000 7f558d597700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f558814ca00 0x7f558814edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:56.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.680+0000 7f558d597700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55880ae860 con 0x7f558805b7c0 2020-04-22T14:12:56.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.680+0000 7f558d597700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55880b5900 con 0x7f55881441f0 2020-04-22T14:12:56.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.680+0000 7f558d597700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55880b5ba0 con 0x7f558814ca00 2020-04-22T14:12:56.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.680+0000 7f55867fc700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f55881441f0 0x7f5588144820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45544/0 (socket says 172.21.15.103:45544) 2020-04-22T14:12:56.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.680+0000 7f55867fc700 1 -- 172.21.15.103:0/3111787330 learned_addr learned my addr 172.21.15.103:0/3111787330 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:56.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.680+0000 7f55877fe700 1 --2- 172.21.15.103:0/3111787330 >> v2:172.21.15.86:3300/0 conn(0x7f558814ca00 0x7f558814edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:56.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.680+0000 7f5585ffb700 1 -- 172.21.15.103:0/3111787330 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3601808181 0 0) 0x7f55880b5900 con 0x7f55881441f0 2020-04-22T14:12:56.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.681+0000 7f5585ffb700 1 -- 172.21.15.103:0/3111787330 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5568003230 con 0x7f55881441f0 2020-04-22T14:12:56.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.681+0000 7f5585ffb700 1 -- 172.21.15.103:0/3111787330 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2774558358 0 0) 0x7f55880ae860 con 0x7f558805b7c0 2020-04-22T14:12:56.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.681+0000 7f5585ffb700 1 -- 172.21.15.103:0/3111787330 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55880b5900 con 0x7f558805b7c0 2020-04-22T14:12:56.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.681+0000 7f5585ffb700 1 -- 172.21.15.103:0/3111787330 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3052647416 0 0) 0x7f5568003230 con 0x7f55881441f0 2020-04-22T14:12:56.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.681+0000 7f5585ffb700 1 -- 172.21.15.103:0/3111787330 >> v2:172.21.15.86:3300/0 conn(0x7f558814ca00 msgr2=0x7f558814edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:56.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.681+0000 7f5585ffb700 1 --2- 172.21.15.103:0/3111787330 >> v2:172.21.15.86:3300/0 conn(0x7f558814ca00 0x7f558814edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:56.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.681+0000 7f5585ffb700 1 -- 172.21.15.103:0/3111787330 >> v1:172.21.15.86:6789/0 conn(0x7f558805b7c0 legacy=0x7f55880b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:56.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.681+0000 7f5585ffb700 1 -- 172.21.15.103:0/3111787330 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55880b5e40 con 0x7f55881441f0 2020-04-22T14:12:56.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.681+0000 7f5585ffb700 1 -- 172.21.15.103:0/3111787330 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f5578001710 con 0x7f55881441f0 2020-04-22T14:12:56.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.681+0000 7f5585ffb700 1 -- 172.21.15.103:0/3111787330 >> v1:172.21.15.103:6789/0 conn(0x7f55881441f0 legacy=0x7f5588144820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:56.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.681+0000 7f5585ffb700 1 --2- 172.21.15.103:0/3111787330 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5568003900 0x7f5568003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:56.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.681+0000 7f5585ffb700 1 --2- 172.21.15.103:0/3111787330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f55680044d0 0x7f5568004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:56.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.681+0000 7f5585ffb700 1 --2- 172.21.15.103:0/3111787330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5568004db0 0x7f556800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:56.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.681+0000 7f5585ffb700 1 -- 172.21.15.103:0/3111787330 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55880b5ba0 con 0x7f55680044d0 2020-04-22T14:12:56.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.681+0000 7f5585ffb700 1 -- 172.21.15.103:0/3111787330 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556800bb80 con 0x7f5568004db0 2020-04-22T14:12:56.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.681+0000 7f5585ffb700 1 -- 172.21.15.103:0/3111787330 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f556800bcc0 con 0x7f5568003900 2020-04-22T14:12:56.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.681+0000 7f55877fe700 1 --2- 172.21.15.103:0/3111787330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5568004db0 0x7f556800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:56.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.681+0000 7f55867fc700 1 --2- 172.21.15.103:0/3111787330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f55680044d0 0x7f5568004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:56.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.681+0000 7f5586ffd700 1 --2- 172.21.15.103:0/3111787330 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5568003900 0x7f5568003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:56.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.681+0000 7f55877fe700 1 -- 172.21.15.103:0/3111787330 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5568003900 msgr2=0x7f5568003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:56.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.681+0000 7f55877fe700 1 --2- 172.21.15.103:0/3111787330 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5568003900 0x7f5568003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:56.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.681+0000 7f55877fe700 1 -- 172.21.15.103:0/3111787330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f55680044d0 msgr2=0x7f5568004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:56.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.681+0000 7f55877fe700 1 --2- 172.21.15.103:0/3111787330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f55680044d0 0x7f5568004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:56.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.681+0000 7f55877fe700 1 -- 172.21.15.103:0/3111787330 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5568003230 con 0x7f5568004db0 2020-04-22T14:12:56.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.681+0000 7f5586ffd700 1 --2- 172.21.15.103:0/3111787330 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5568003900 0x7f5568003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:12:56.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.681+0000 7f55877fe700 1 --2- 172.21.15.103:0/3111787330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5568004db0 0x7f556800b720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f55800032b0 tx=0x7f55800103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:56.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.681+0000 7f55877fe700 1 -- 172.21.15.103:0/3111787330 reap_dead start 2020-04-22T14:12:56.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.681+0000 7f55877fe700 1 --2- 172.21.15.103:0/3111787330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5568004db0 0x7f556800b720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f55800032b0 tx=0x7f55800103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:56.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.681+0000 7f55877fe700 1 --2- 172.21.15.103:0/3111787330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5568004db0 0x7f556800b720 secure :-1 s=READY pgs=1180 cs=0 l=1 rx=0x7f55800032b0 tx=0x7f55800103d0).ready entity=mon.1 client_cookie=a297dc55b5a8252f server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:56.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.682+0000 7f55877fe700 1 --2- 172.21.15.103:0/3111787330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5568004db0 0x7f556800b720 secure :-1 s=THROTTLE_DONE pgs=1180 cs=0 l=1 rx=0x7f55800032b0 tx=0x7f55800103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:56.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.682+0000 7f5585ffb700 1 -- 172.21.15.103:0/3111787330 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5580005c30 con 0x7f5568004db0 2020-04-22T14:12:56.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.682+0000 7f55877fe700 1 --2- 172.21.15.103:0/3111787330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5568004db0 0x7f556800b720 secure :-1 s=THROTTLE_DONE pgs=1180 cs=0 l=1 rx=0x7f55800032b0 tx=0x7f55800103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:56.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.682+0000 7f5585ffb700 1 -- 172.21.15.103:0/3111787330 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5580005d90 con 0x7f5568004db0 2020-04-22T14:12:56.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.682+0000 7f55877fe700 1 --2- 172.21.15.103:0/3111787330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5568004db0 0x7f556800b720 secure :-1 s=THROTTLE_DONE pgs=1180 cs=0 l=1 rx=0x7f55800032b0 tx=0x7f55800103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:56.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.682+0000 7f5585ffb700 1 -- 172.21.15.103:0/3111787330 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55800112c0 con 0x7f5568004db0 2020-04-22T14:12:56.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.682+0000 7f558d597700 1 -- 172.21.15.103:0/3111787330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5568004db0 msgr2=0x7f556800b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:56.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.682+0000 7f558d597700 1 --2- 172.21.15.103:0/3111787330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5568004db0 0x7f556800b720 secure :-1 s=READY pgs=1180 cs=0 l=1 rx=0x7f55800032b0 tx=0x7f55800103d0).stop 2020-04-22T14:12:56.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.682+0000 7f558d597700 1 -- 172.21.15.103:0/3111787330 shutdown_connections 2020-04-22T14:12:56.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.682+0000 7f558d597700 1 --2- 172.21.15.103:0/3111787330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5568004db0 0x7f556800b720 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:56.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.682+0000 7f558d597700 1 -- 172.21.15.103:0/3111787330 >> 172.21.15.103:0/3111787330 conn(0x7f55880b9160 msgr2=0x7f558805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:56.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.682+0000 7f558d597700 1 -- 172.21.15.103:0/3111787330 shutdown_connections 2020-04-22T14:12:56.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.682+0000 7f558d597700 1 -- 172.21.15.103:0/3111787330 wait complete. 2020-04-22T14:12:56.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.683+0000 7f558d597700 1 Processor -- start 2020-04-22T14:12:56.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.683+0000 7f558d597700 1 -- start start 2020-04-22T14:12:56.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.684+0000 7f558d597700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f558813e7d0 0x7f55881363c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:56.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.684+0000 7f558d597700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5588140150 0x7f5588155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:56.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.684+0000 7f558d597700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55881405c0 con 0x7f5568004db0 2020-04-22T14:12:56.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.684+0000 7f558d597700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5588136820 con 0x7f5588140150 2020-04-22T14:12:56.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.684+0000 7f558d597700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55881412d0 con 0x7f558813e7d0 2020-04-22T14:12:56.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.684+0000 7f55877fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5588140150 0x7f5588155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:56.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.684+0000 7f5586ffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f5568004db0 0x7f5588154e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45558/0 (socket says 172.21.15.103:45558) 2020-04-22T14:12:56.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.684+0000 7f5586ffd700 1 -- 172.21.15.103:0/3778602373 learned_addr learned my addr 172.21.15.103:0/3778602373 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:56.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.684+0000 7f55867fc700 1 --2- 172.21.15.103:0/3778602373 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f558813e7d0 0x7f55881363c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:56.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.684+0000 7f55877fe700 1 -- 172.21.15.103:0/3778602373 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f558813e7d0 msgr2=0x7f55881363c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:56.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.684+0000 7f55877fe700 1 --2- 172.21.15.103:0/3778602373 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f558813e7d0 0x7f55881363c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:56.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.684+0000 7f557ffff700 1 -- 172.21.15.103:0/3778602373 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4265697455 0 0) 0x7f55881405c0 con 0x7f5568004db0 2020-04-22T14:12:56.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.684+0000 7f55877fe700 1 -- 172.21.15.103:0/3778602373 >> v1:172.21.15.103:6789/0 conn(0x7f5568004db0 legacy=0x7f5588154e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:56.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.684+0000 7f55877fe700 1 -- 172.21.15.103:0/3778602373 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f558813d7b0 con 0x7f5588140150 2020-04-22T14:12:56.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.684+0000 7f55877fe700 1 --2- 172.21.15.103:0/3778602373 >> v2:172.21.15.103:3300/0 conn(0x7f5588140150 0x7f5588155570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f55800032b0 tx=0x7f55800103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:56.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.684+0000 7f55877fe700 1 --2- 172.21.15.103:0/3778602373 >> v2:172.21.15.103:3300/0 conn(0x7f5588140150 0x7f5588155570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f55800032b0 tx=0x7f55800103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:56.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.684+0000 7f55877fe700 1 --2- 172.21.15.103:0/3778602373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5588140150 0x7f5588155570 secure :-1 s=READY pgs=1182 cs=0 l=1 rx=0x7f55800032b0 tx=0x7f55800103d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:56.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.685+0000 7f55877fe700 1 --2- 172.21.15.103:0/3778602373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5588140150 0x7f5588155570 secure :-1 s=THROTTLE_DONE pgs=1182 cs=0 l=1 rx=0x7f55800032b0 tx=0x7f55800103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:56.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.685+0000 7f557ffff700 1 -- 172.21.15.103:0/3778602373 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f558000fbf0 con 0x7f5588140150 2020-04-22T14:12:56.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.685+0000 7f55877fe700 1 --2- 172.21.15.103:0/3778602373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5588140150 0x7f5588155570 secure :-1 s=THROTTLE_DONE pgs=1182 cs=0 l=1 rx=0x7f55800032b0 tx=0x7f55800103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:56.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.685+0000 7f55877fe700 1 --2- 172.21.15.103:0/3778602373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5588140150 0x7f5588155570 secure :-1 s=THROTTLE_DONE pgs=1182 cs=0 l=1 rx=0x7f55800032b0 tx=0x7f55800103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:56.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.685+0000 7f557ffff700 1 -- 172.21.15.103:0/3778602373 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5580005c30 con 0x7f5588140150 2020-04-22T14:12:56.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.685+0000 7f558d597700 1 -- 172.21.15.103:0/3778602373 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f558813da50 con 0x7f5588140150 2020-04-22T14:12:56.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.685+0000 7f557ffff700 1 -- 172.21.15.103:0/3778602373 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55800116b0 con 0x7f5588140150 2020-04-22T14:12:56.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.685+0000 7f558d597700 1 -- 172.21.15.103:0/3778602373 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5588155c10 con 0x7f5588140150 2020-04-22T14:12:56.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.685+0000 7f55877fe700 1 --2- 172.21.15.103:0/3778602373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5588140150 0x7f5588155570 secure :-1 s=THROTTLE_DONE pgs=1182 cs=0 l=1 rx=0x7f55800032b0 tx=0x7f55800103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:56.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.686+0000 7f558d597700 1 -- 172.21.15.103:0/3778602373 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f558813de40 con 0x7f5588140150 2020-04-22T14:12:56.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.686+0000 7f557ffff700 1 -- 172.21.15.103:0/3778602373 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f5580011810 con 0x7f5588140150 2020-04-22T14:12:56.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.686+0000 7f55877fe700 1 --2- 172.21.15.103:0/3778602373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5588140150 0x7f5588155570 secure :-1 s=THROTTLE_DONE pgs=1182 cs=0 l=1 rx=0x7f55800032b0 tx=0x7f55800103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:56.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.686+0000 7f557ffff700 1 --2- 172.21.15.103:0/3778602373 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f556c04d890 0x7f556c04fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:56.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.686+0000 7f557ffff700 1 -- 172.21.15.103:0/3778602373 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f5580061a40 con 0x7f5588140150 2020-04-22T14:12:56.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.686+0000 7f5586ffd700 1 --2- 172.21.15.103:0/3778602373 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f556c04d890 0x7f556c04fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:56.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.686+0000 7f5586ffd700 1 --2- 172.21.15.103:0/3778602373 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f556c04d890 0x7f556c04fd50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f55700015c0 tx=0x7f5570003820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:56.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.686+0000 7f5586ffd700 1 --2- 172.21.15.103:0/3778602373 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f556c04d890 0x7f556c04fd50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f55700015c0 tx=0x7f5570003820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:56.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.686+0000 7f5586ffd700 1 --2- 172.21.15.103:0/3778602373 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f556c04d890 0x7f556c04fd50 secure :-1 s=READY pgs=434 cs=0 l=1 rx=0x7f55700015c0 tx=0x7f5570003820).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:56.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.690+0000 7f55877fe700 1 --2- 172.21.15.103:0/3778602373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5588140150 0x7f5588155570 secure :-1 s=THROTTLE_DONE pgs=1182 cs=0 l=1 rx=0x7f55800032b0 tx=0x7f55800103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:56.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.690+0000 7f557ffff700 1 -- 172.21.15.103:0/3778602373 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f558003ce80 con 0x7f5588140150 2020-04-22T14:12:56.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.878+0000 7f558d597700 1 -- 172.21.15.103:0/3778602373 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5588137e80 con 0x7f5588140150 2020-04-22T14:12:56.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.878+0000 7f55877fe700 1 --2- 172.21.15.103:0/3778602373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5588140150 0x7f5588155570 secure :-1 s=THROTTLE_DONE pgs=1182 cs=0 l=1 rx=0x7f55800032b0 tx=0x7f55800103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:56.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.879+0000 7f557ffff700 1 -- 172.21.15.103:0/3778602373 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f55800404a0 con 0x7f5588140150 2020-04-22T14:12:56.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.880+0000 7f558d597700 1 -- 172.21.15.103:0/3778602373 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f556c04d890 msgr2=0x7f556c04fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:56.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.880+0000 7f558d597700 1 --2- 172.21.15.103:0/3778602373 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f556c04d890 0x7f556c04fd50 secure :-1 s=READY pgs=434 cs=0 l=1 rx=0x7f55700015c0 tx=0x7f5570003820).stop 2020-04-22T14:12:56.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.880+0000 7f558d597700 1 -- 172.21.15.103:0/3778602373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5588140150 msgr2=0x7f5588155570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:56.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.880+0000 7f558d597700 1 --2- 172.21.15.103:0/3778602373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5588140150 0x7f5588155570 secure :-1 s=READY pgs=1182 cs=0 l=1 rx=0x7f55800032b0 tx=0x7f55800103d0).stop 2020-04-22T14:12:56.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.880+0000 7f558d597700 1 -- 172.21.15.103:0/3778602373 shutdown_connections 2020-04-22T14:12:56.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.880+0000 7f558d597700 1 --2- 172.21.15.103:0/3778602373 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f556c04d890 0x7f556c04fd50 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:56.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.880+0000 7f558d597700 1 --2- 172.21.15.103:0/3778602373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5588140150 0x7f5588155570 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:56.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.880+0000 7f558d597700 1 --2- 172.21.15.103:0/3778602373 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f558813e7d0 0x7f55881363c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:56.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.880+0000 7f558d597700 1 -- 172.21.15.103:0/3778602373 >> 172.21.15.103:0/3778602373 conn(0x7f55880b9160 msgr2=0x7f5588066cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:56.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.880+0000 7f558d597700 1 -- 172.21.15.103:0/3778602373 shutdown_connections 2020-04-22T14:12:56.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:56.880+0000 7f558d597700 1 -- 172.21.15.103:0/3778602373 wait complete. 2020-04-22T14:12:56.885 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:12:56.885 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:43.570838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:12:56.886 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 54 2020-04-22T14:12:56.893 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:12:57.895 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:57.911 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:12:58.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.066+0000 7fae76c7b700 1 Processor -- start 2020-04-22T14:12:58.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.066+0000 7fae76c7b700 1 -- start start 2020-04-22T14:12:58.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.067+0000 7fae76c7b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fae70065fe0 0x7fae701464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:58.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.067+0000 7fae76c7b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fae70063e30 0x7fae700642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:58.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.067+0000 7fae76c7b700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae70143300 con 0x7fae7012c0d0 2020-04-22T14:12:58.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.067+0000 7fae76c7b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae701435a0 con 0x7fae70065fe0 2020-04-22T14:12:58.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.067+0000 7fae76c7b700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae70143840 con 0x7fae70063e30 2020-04-22T14:12:58.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.067+0000 7fae75218700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fae70063e30 0x7fae700642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:58.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.067+0000 7fae74a17700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fae7012c0d0 0x7fae7005b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45564/0 (socket says 172.21.15.103:45564) 2020-04-22T14:12:58.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.067+0000 7fae74a17700 1 -- 172.21.15.103:0/3892997629 learned_addr learned my addr 172.21.15.103:0/3892997629 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:58.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.067+0000 7fae6ffff700 1 --2- 172.21.15.103:0/3892997629 >> v2:172.21.15.86:3300/0 conn(0x7fae70065fe0 0x7fae701464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:58.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.067+0000 7fae75218700 1 -- 172.21.15.103:0/3892997629 >> v2:172.21.15.86:3300/0 conn(0x7fae70065fe0 msgr2=0x7fae701464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:12:58.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.067+0000 7fae75218700 1 --2- 172.21.15.103:0/3892997629 >> v2:172.21.15.86:3300/0 conn(0x7fae70065fe0 0x7fae701464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:58.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.067+0000 7fae75218700 1 -- 172.21.15.103:0/3892997629 >> v1:172.21.15.103:6789/0 conn(0x7fae7012c0d0 legacy=0x7fae7005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:58.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.067+0000 7fae75218700 1 -- 172.21.15.103:0/3892997629 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7005bb50 con 0x7fae70063e30 2020-04-22T14:12:58.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.067+0000 7fae6f7fe700 1 -- 172.21.15.103:0/3892997629 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3855718743 0 0) 0x7fae70143300 con 0x7fae7012c0d0 2020-04-22T14:12:58.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.067+0000 7fae6ffff700 1 --2- 172.21.15.103:0/3892997629 >> v2:172.21.15.86:3300/0 conn(0x7fae70065fe0 0x7fae701464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:12:58.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.067+0000 7fae75218700 1 --2- 172.21.15.103:0/3892997629 >> v2:172.21.15.103:3300/0 conn(0x7fae70063e30 0x7fae700642c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fae680032b0 tx=0x7fae68007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:58.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.067+0000 7fae75218700 1 --2- 172.21.15.103:0/3892997629 >> v2:172.21.15.103:3300/0 conn(0x7fae70063e30 0x7fae700642c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fae680032b0 tx=0x7fae68007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:58.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.067+0000 7fae75218700 1 --2- 172.21.15.103:0/3892997629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae70063e30 0x7fae700642c0 secure :-1 s=READY pgs=1184 cs=0 l=1 rx=0x7fae680032b0 tx=0x7fae68007dc0).ready entity=mon.1 client_cookie=ff21eadb1b000dca server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:58.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.067+0000 7fae75218700 1 --2- 172.21.15.103:0/3892997629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae70063e30 0x7fae700642c0 secure :-1 s=THROTTLE_DONE pgs=1184 cs=0 l=1 rx=0x7fae680032b0 tx=0x7fae68007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:58.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.067+0000 7fae6f7fe700 1 -- 172.21.15.103:0/3892997629 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae6800a180 con 0x7fae70063e30 2020-04-22T14:12:58.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.067+0000 7fae75218700 1 --2- 172.21.15.103:0/3892997629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae70063e30 0x7fae700642c0 secure :-1 s=THROTTLE_DONE pgs=1184 cs=0 l=1 rx=0x7fae680032b0 tx=0x7fae68007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:58.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.067+0000 7fae6f7fe700 1 -- 172.21.15.103:0/3892997629 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6800a2e0 con 0x7fae70063e30 2020-04-22T14:12:58.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.067+0000 7fae75218700 1 --2- 172.21.15.103:0/3892997629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae70063e30 0x7fae700642c0 secure :-1 s=THROTTLE_DONE pgs=1184 cs=0 l=1 rx=0x7fae680032b0 tx=0x7fae68007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:58.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.067+0000 7fae6f7fe700 1 -- 172.21.15.103:0/3892997629 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae6800a6c0 con 0x7fae70063e30 2020-04-22T14:12:58.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.067+0000 7fae76c7b700 1 -- 172.21.15.103:0/3892997629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae70063e30 msgr2=0x7fae700642c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:58.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.067+0000 7fae76c7b700 1 --2- 172.21.15.103:0/3892997629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae70063e30 0x7fae700642c0 secure :-1 s=READY pgs=1184 cs=0 l=1 rx=0x7fae680032b0 tx=0x7fae68007dc0).stop 2020-04-22T14:12:58.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.068+0000 7fae76c7b700 1 -- 172.21.15.103:0/3892997629 shutdown_connections 2020-04-22T14:12:58.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.068+0000 7fae76c7b700 1 --2- 172.21.15.103:0/3892997629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae70063e30 0x7fae700642c0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:58.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.068+0000 7fae76c7b700 1 --2- 172.21.15.103:0/3892997629 >> v2:172.21.15.86:3300/0 conn(0x7fae70065fe0 0x7fae701464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:12:58.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.068+0000 7fae76c7b700 1 -- 172.21.15.103:0/3892997629 >> 172.21.15.103:0/3892997629 conn(0x7fae700b9160 msgr2=0x7fae7005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:58.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.068+0000 7fae76c7b700 1 -- 172.21.15.103:0/3892997629 shutdown_connections 2020-04-22T14:12:58.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.068+0000 7fae76c7b700 1 -- 172.21.15.103:0/3892997629 wait complete. 2020-04-22T14:12:58.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.069+0000 7fae76c7b700 1 Processor -- start 2020-04-22T14:12:58.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.069+0000 7fae76c7b700 1 -- start start 2020-04-22T14:12:58.081 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.070+0000 7fae76c7b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fae70065fe0 0x7fae700b0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:58.082 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.070+0000 7fae76c7b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fae7012c0d0 0x7fae700b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:58.082 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.070+0000 7fae76c7b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae700b10a0 con 0x7fae70063e30 2020-04-22T14:12:58.082 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.070+0000 7fae76c7b700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae700b1da0 con 0x7fae7012c0d0 2020-04-22T14:12:58.082 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.070+0000 7fae76c7b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae700b2040 con 0x7fae70065fe0 2020-04-22T14:12:58.082 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.070+0000 7fae75218700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fae7012c0d0 0x7fae700b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:58.082 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.070+0000 7fae75218700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fae7012c0d0 0x7fae700b14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53384/0 (socket says 172.21.15.103:53384) 2020-04-22T14:12:58.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.070+0000 7fae75218700 1 -- 172.21.15.103:0/973640927 learned_addr learned my addr 172.21.15.103:0/973640927 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:58.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.070+0000 7fae6ffff700 1 --2- 172.21.15.103:0/973640927 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fae70065fe0 0x7fae700b0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:58.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.070+0000 7fae75218700 1 -- 172.21.15.103:0/973640927 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fae70065fe0 msgr2=0x7fae700b0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:58.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.070+0000 7fae75218700 1 --2- 172.21.15.103:0/973640927 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fae70065fe0 0x7fae700b0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:58.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.070+0000 7fae75218700 1 -- 172.21.15.103:0/973640927 >> v1:172.21.15.86:6789/0 conn(0x7fae70063e30 legacy=0x7fae70141eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:58.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.070+0000 7fae75218700 1 -- 172.21.15.103:0/973640927 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae700b22e0 con 0x7fae7012c0d0 2020-04-22T14:12:58.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.070+0000 7fae75218700 1 --2- 172.21.15.103:0/973640927 >> v2:172.21.15.103:3300/0 conn(0x7fae7012c0d0 0x7fae700b14f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fae680032b0 tx=0x7fae68007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:58.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.070+0000 7fae75218700 1 --2- 172.21.15.103:0/973640927 >> v2:172.21.15.103:3300/0 conn(0x7fae7012c0d0 0x7fae700b14f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fae680032b0 tx=0x7fae68007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:58.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.070+0000 7fae75218700 1 --2- 172.21.15.103:0/973640927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae7012c0d0 0x7fae700b14f0 secure :-1 s=READY pgs=1185 cs=0 l=1 rx=0x7fae680032b0 tx=0x7fae68007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:58.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.070+0000 7fae75218700 1 --2- 172.21.15.103:0/973640927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae7012c0d0 0x7fae700b14f0 secure :-1 s=THROTTLE_DONE pgs=1185 cs=0 l=1 rx=0x7fae680032b0 tx=0x7fae68007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:58.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.070+0000 7fae6dffb700 1 -- 172.21.15.103:0/973640927 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae68005c30 con 0x7fae7012c0d0 2020-04-22T14:12:58.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.070+0000 7fae75218700 1 --2- 172.21.15.103:0/973640927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae7012c0d0 0x7fae700b14f0 secure :-1 s=THROTTLE_DONE pgs=1185 cs=0 l=1 rx=0x7fae680032b0 tx=0x7fae68007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:58.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.070+0000 7fae75218700 1 --2- 172.21.15.103:0/973640927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae7012c0d0 0x7fae700b14f0 secure :-1 s=THROTTLE_DONE pgs=1185 cs=0 l=1 rx=0x7fae680032b0 tx=0x7fae68007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:58.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.070+0000 7fae6dffb700 1 -- 172.21.15.103:0/973640927 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae68005d90 con 0x7fae7012c0d0 2020-04-22T14:12:58.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.070+0000 7fae76c7b700 1 -- 172.21.15.103:0/973640927 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae700b1950 con 0x7fae7012c0d0 2020-04-22T14:12:58.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.070+0000 7fae6dffb700 1 -- 172.21.15.103:0/973640927 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae6800f7a0 con 0x7fae7012c0d0 2020-04-22T14:12:58.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.071+0000 7fae76c7b700 1 -- 172.21.15.103:0/973640927 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae70142800 con 0x7fae7012c0d0 2020-04-22T14:12:58.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.071+0000 7fae75218700 1 --2- 172.21.15.103:0/973640927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae7012c0d0 0x7fae700b14f0 secure :-1 s=THROTTLE_DONE pgs=1185 cs=0 l=1 rx=0x7fae680032b0 tx=0x7fae68007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:58.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.071+0000 7fae76c7b700 1 -- 172.21.15.103:0/973640927 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae700b4500 con 0x7fae7012c0d0 2020-04-22T14:12:58.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.072+0000 7fae6dffb700 1 -- 172.21.15.103:0/973640927 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fae6800f9a0 con 0x7fae7012c0d0 2020-04-22T14:12:58.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.072+0000 7fae75218700 1 --2- 172.21.15.103:0/973640927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae7012c0d0 0x7fae700b14f0 secure :-1 s=THROTTLE_DONE pgs=1185 cs=0 l=1 rx=0x7fae680032b0 tx=0x7fae68007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:58.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.072+0000 7fae6dffb700 1 --2- 172.21.15.103:0/973640927 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fae5004d960 0x7fae5004fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:58.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.072+0000 7fae6dffb700 1 -- 172.21.15.103:0/973640927 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fae68062710 con 0x7fae7012c0d0 2020-04-22T14:12:58.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.072+0000 7fae74a17700 1 --2- 172.21.15.103:0/973640927 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fae5004d960 0x7fae5004fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:58.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.072+0000 7fae74a17700 1 --2- 172.21.15.103:0/973640927 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fae5004d960 0x7fae5004fe20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fae70065e20 tx=0x7fae60001470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:58.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.072+0000 7fae74a17700 1 --2- 172.21.15.103:0/973640927 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fae5004d960 0x7fae5004fe20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fae70065e20 tx=0x7fae60001470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:58.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.072+0000 7fae74a17700 1 --2- 172.21.15.103:0/973640927 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fae5004d960 0x7fae5004fe20 secure :-1 s=READY pgs=435 cs=0 l=1 rx=0x7fae70065e20 tx=0x7fae60001470).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:58.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.076+0000 7fae75218700 1 --2- 172.21.15.103:0/973640927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae7012c0d0 0x7fae700b14f0 secure :-1 s=THROTTLE_DONE pgs=1185 cs=0 l=1 rx=0x7fae680032b0 tx=0x7fae68007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:58.087 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.076+0000 7fae6dffb700 1 -- 172.21.15.103:0/973640927 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fae6803dbb0 con 0x7fae7012c0d0 2020-04-22T14:12:58.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.264+0000 7fae76c7b700 1 -- 172.21.15.103:0/973640927 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fae70056c90 con 0x7fae7012c0d0 2020-04-22T14:12:58.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.265+0000 7fae75218700 1 --2- 172.21.15.103:0/973640927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae7012c0d0 0x7fae700b14f0 secure :-1 s=THROTTLE_DONE pgs=1185 cs=0 l=1 rx=0x7fae680032b0 tx=0x7fae68007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:58.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.265+0000 7fae6dffb700 1 -- 172.21.15.103:0/973640927 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2147 (secure 0 0 0) 0x7fae680411d0 con 0x7fae7012c0d0 2020-04-22T14:12:58.269 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:12:58.269 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:43.570838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:12:58.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.266+0000 7fae76c7b700 1 -- 172.21.15.103:0/973640927 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fae5004d960 msgr2=0x7fae5004fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:58.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.266+0000 7fae76c7b700 1 --2- 172.21.15.103:0/973640927 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fae5004d960 0x7fae5004fe20 secure :-1 s=READY pgs=435 cs=0 l=1 rx=0x7fae70065e20 tx=0x7fae60001470).stop 2020-04-22T14:12:58.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.266+0000 7fae76c7b700 1 -- 172.21.15.103:0/973640927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae7012c0d0 msgr2=0x7fae700b14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:58.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.266+0000 7fae76c7b700 1 --2- 172.21.15.103:0/973640927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae7012c0d0 0x7fae700b14f0 secure :-1 s=READY pgs=1185 cs=0 l=1 rx=0x7fae680032b0 tx=0x7fae68007dc0).stop 2020-04-22T14:12:58.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.266+0000 7fae76c7b700 1 -- 172.21.15.103:0/973640927 shutdown_connections 2020-04-22T14:12:58.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.266+0000 7fae76c7b700 1 --2- 172.21.15.103:0/973640927 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fae5004d960 0x7fae5004fe20 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:58.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.266+0000 7fae76c7b700 1 --2- 172.21.15.103:0/973640927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae7012c0d0 0x7fae700b14f0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:58.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.266+0000 7fae76c7b700 1 --2- 172.21.15.103:0/973640927 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fae70065fe0 0x7fae700b0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:58.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.266+0000 7fae76c7b700 1 -- 172.21.15.103:0/973640927 >> 172.21.15.103:0/973640927 conn(0x7fae700b9160 msgr2=0x7fae700615e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:58.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.266+0000 7fae76c7b700 1 -- 172.21.15.103:0/973640927 shutdown_connections 2020-04-22T14:12:58.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:58.266+0000 7fae76c7b700 1 -- 172.21.15.103:0/973640927 wait complete. 2020-04-22T14:12:58.271 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 54 2020-04-22T14:12:58.279 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:12:59.281 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:12:59.299 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:12:59.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.454+0000 7f8ab947c700 1 Processor -- start 2020-04-22T14:12:59.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.454+0000 7f8ab947c700 1 -- start start 2020-04-22T14:12:59.476 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.455+0000 7f8ab947c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8ab414a2b0 0x7f8ab40ac740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:12:59.476 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.455+0000 7f8ab947c700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ab414a720 con 0x7f8ab4140320 2020-04-22T14:12:59.476 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.455+0000 7f8ab947c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ab41462f0 con 0x7f8ab40ae1a0 2020-04-22T14:12:59.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.456+0000 7f8ab947c700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ab4146590 con 0x7f8ab414a2b0 2020-04-22T14:12:59.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.456+0000 7f8ab37fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8ab414a2b0 0x7f8ab40ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:59.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.456+0000 7f8ab27fc700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f8ab40ae1a0 0x7f8ab40bd1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45578/0 (socket says 172.21.15.103:45578) 2020-04-22T14:12:59.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.456+0000 7f8ab27fc700 1 -- 172.21.15.103:0/931424806 learned_addr learned my addr 172.21.15.103:0/931424806 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:12:59.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.456+0000 7f8ab37fe700 1 -- 172.21.15.103:0/931424806 >> v1:172.21.15.103:6789/0 conn(0x7f8ab40ae1a0 legacy=0x7f8ab40bd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:59.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.456+0000 7f8ab37fe700 1 -- 172.21.15.103:0/931424806 >> v1:172.21.15.86:6789/0 conn(0x7f8ab4140320 legacy=0x7f8ab4146cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:59.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.456+0000 7f8ab1ffb700 1 -- 172.21.15.103:0/931424806 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 472623536 0 0) 0x7f8ab41462f0 con 0x7f8ab40ae1a0 2020-04-22T14:12:59.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.456+0000 7f8ab37fe700 1 -- 172.21.15.103:0/931424806 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab4146830 con 0x7f8ab414a2b0 2020-04-22T14:12:59.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.456+0000 7f8ab37fe700 1 --2- 172.21.15.103:0/931424806 >> v2:172.21.15.103:3300/0 conn(0x7f8ab414a2b0 0x7f8ab40ac740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8aa4002f30 tx=0x7f8aa4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:59.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.456+0000 7f8ab37fe700 1 --2- 172.21.15.103:0/931424806 >> v2:172.21.15.103:3300/0 conn(0x7f8ab414a2b0 0x7f8ab40ac740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8aa4002f30 tx=0x7f8aa4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:59.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.456+0000 7f8ab37fe700 1 --2- 172.21.15.103:0/931424806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ab414a2b0 0x7f8ab40ac740 secure :-1 s=READY pgs=1187 cs=0 l=1 rx=0x7f8aa4002f30 tx=0x7f8aa4007a40).ready entity=mon.1 client_cookie=945cbd50d7b19024 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:59.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.456+0000 7f8ab37fe700 1 --2- 172.21.15.103:0/931424806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ab414a2b0 0x7f8ab40ac740 secure :-1 s=THROTTLE_DONE pgs=1187 cs=0 l=1 rx=0x7f8aa4002f30 tx=0x7f8aa4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:59.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.456+0000 7f8ab1ffb700 1 -- 172.21.15.103:0/931424806 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8aa4011470 con 0x7f8ab414a2b0 2020-04-22T14:12:59.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.456+0000 7f8ab37fe700 1 --2- 172.21.15.103:0/931424806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ab414a2b0 0x7f8ab40ac740 secure :-1 s=THROTTLE_DONE pgs=1187 cs=0 l=1 rx=0x7f8aa4002f30 tx=0x7f8aa4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:59.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.456+0000 7f8ab1ffb700 1 -- 172.21.15.103:0/931424806 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa40115d0 con 0x7f8ab414a2b0 2020-04-22T14:12:59.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.456+0000 7f8ab37fe700 1 --2- 172.21.15.103:0/931424806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ab414a2b0 0x7f8ab40ac740 secure :-1 s=THROTTLE_DONE pgs=1187 cs=0 l=1 rx=0x7f8aa4002f30 tx=0x7f8aa4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:59.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.456+0000 7f8ab947c700 1 -- 172.21.15.103:0/931424806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ab414a2b0 msgr2=0x7f8ab40ac740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:59.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.456+0000 7f8ab1ffb700 1 -- 172.21.15.103:0/931424806 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8aa40119f0 con 0x7f8ab414a2b0 2020-04-22T14:12:59.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.456+0000 7f8ab947c700 1 --2- 172.21.15.103:0/931424806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ab414a2b0 0x7f8ab40ac740 secure :-1 s=READY pgs=1187 cs=0 l=1 rx=0x7f8aa4002f30 tx=0x7f8aa4007a40).stop 2020-04-22T14:12:59.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.457+0000 7f8ab947c700 1 -- 172.21.15.103:0/931424806 shutdown_connections 2020-04-22T14:12:59.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.457+0000 7f8ab947c700 1 --2- 172.21.15.103:0/931424806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ab414a2b0 0x7f8ab40ac740 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:59.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.457+0000 7f8ab947c700 1 -- 172.21.15.103:0/931424806 >> 172.21.15.103:0/931424806 conn(0x7f8ab405f2c0 msgr2=0x7f8ab40bcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:59.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.457+0000 7f8ab947c700 1 -- 172.21.15.103:0/931424806 shutdown_connections 2020-04-22T14:12:59.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.457+0000 7f8ab947c700 1 -- 172.21.15.103:0/931424806 wait complete. 2020-04-22T14:12:59.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.458+0000 7f8ab947c700 1 Processor -- start 2020-04-22T14:12:59.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.458+0000 7f8ab947c700 1 -- start start 2020-04-22T14:12:59.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.458+0000 7f8ab947c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8ab4140320 0x7f8ab4140a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:59.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.458+0000 7f8ab947c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ab414a2b0 0x7f8ab413cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:59.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.458+0000 7f8ab947c700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ab4141ff0 con 0x7f8ab40ae1a0 2020-04-22T14:12:59.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.458+0000 7f8ab947c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ab413d3e0 con 0x7f8ab4140320 2020-04-22T14:12:59.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.459+0000 7f8ab947c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab4141d50 con 0x7f8ab414a2b0 2020-04-22T14:12:59.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.459+0000 7f8ab27fc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8ab4140320 0x7f8ab4140a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:59.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.459+0000 7f8ab37fe700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ab414a2b0 0x7f8ab413cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:59.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.459+0000 7f8ab27fc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8ab4140320 0x7f8ab4140a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:50626/0 (socket says 172.21.15.103:50626) 2020-04-22T14:12:59.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.459+0000 7f8ab27fc700 1 -- 172.21.15.103:0/2371776257 learned_addr learned my addr 172.21.15.103:0/2371776257 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:12:59.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.459+0000 7f8aa3fff700 1 -- 172.21.15.103:0/2371776257 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3106554032 0 0) 0x7f8ab4141ff0 con 0x7f8ab40ae1a0 2020-04-22T14:12:59.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.459+0000 7f8aa3fff700 1 -- 172.21.15.103:0/2371776257 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a90002fe0 con 0x7f8ab40ae1a0 2020-04-22T14:12:59.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.459+0000 7f8ab37fe700 1 -- 172.21.15.103:0/2371776257 >> v2:172.21.15.86:3300/0 conn(0x7f8ab4140320 msgr2=0x7f8ab4140a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:59.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.459+0000 7f8ab37fe700 1 --2- 172.21.15.103:0/2371776257 >> v2:172.21.15.86:3300/0 conn(0x7f8ab4140320 0x7f8ab4140a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:59.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.459+0000 7f8ab37fe700 1 -- 172.21.15.103:0/2371776257 >> v1:172.21.15.86:6789/0 conn(0x7f8ab40ae1a0 legacy=0x7f8ab4142720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:59.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.459+0000 7f8ab37fe700 1 -- 172.21.15.103:0/2371776257 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab4144050 con 0x7f8ab414a2b0 2020-04-22T14:12:59.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.459+0000 7f8ab27fc700 1 --2- 172.21.15.103:0/2371776257 >> v2:172.21.15.86:3300/0 conn(0x7f8ab4140320 0x7f8ab4140a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:12:59.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.459+0000 7f8ab37fe700 1 --2- 172.21.15.103:0/2371776257 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ab414a2b0 0x7f8ab413cf80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8aa4002f30 tx=0x7f8aa4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:59.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.459+0000 7f8ab37fe700 1 --2- 172.21.15.103:0/2371776257 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ab414a2b0 0x7f8ab413cf80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8aa4002f30 tx=0x7f8aa4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:59.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.459+0000 7f8ab37fe700 1 --2- 172.21.15.103:0/2371776257 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ab414a2b0 0x7f8ab413cf80 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7f8aa4002f30 tx=0x7f8aa4007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:59.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.459+0000 7f8ab37fe700 1 --2- 172.21.15.103:0/2371776257 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ab414a2b0 0x7f8ab413cf80 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f8aa4002f30 tx=0x7f8aa4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:59.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.459+0000 7f8aa3fff700 1 -- 172.21.15.103:0/2371776257 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8aa4011ab0 con 0x7f8ab414a2b0 2020-04-22T14:12:59.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.459+0000 7f8ab37fe700 1 --2- 172.21.15.103:0/2371776257 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ab414a2b0 0x7f8ab413cf80 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f8aa4002f30 tx=0x7f8aa4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:59.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.459+0000 7f8ab947c700 1 -- 172.21.15.103:0/2371776257 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ab4146260 con 0x7f8ab414a2b0 2020-04-22T14:12:59.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.459+0000 7f8aa3fff700 1 -- 172.21.15.103:0/2371776257 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa4007170 con 0x7f8ab414a2b0 2020-04-22T14:12:59.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.459+0000 7f8ab37fe700 1 --2- 172.21.15.103:0/2371776257 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ab414a2b0 0x7f8ab413cf80 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f8aa4002f30 tx=0x7f8aa4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:59.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.460+0000 7f8aa3fff700 1 -- 172.21.15.103:0/2371776257 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8aa4007590 con 0x7f8ab414a2b0 2020-04-22T14:12:59.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.460+0000 7f8ab947c700 1 -- 172.21.15.103:0/2371776257 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ab41418e0 con 0x7f8ab414a2b0 2020-04-22T14:12:59.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.460+0000 7f8ab37fe700 1 --2- 172.21.15.103:0/2371776257 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ab414a2b0 0x7f8ab413cf80 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f8aa4002f30 tx=0x7f8aa4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:59.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.460+0000 7f8ab947c700 1 -- 172.21.15.103:0/2371776257 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ab4056c90 con 0x7f8ab414a2b0 2020-04-22T14:12:59.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.461+0000 7f8aa3fff700 1 -- 172.21.15.103:0/2371776257 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f8aa40056c0 con 0x7f8ab414a2b0 2020-04-22T14:12:59.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.461+0000 7f8ab37fe700 1 --2- 172.21.15.103:0/2371776257 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ab414a2b0 0x7f8ab413cf80 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f8aa4002f30 tx=0x7f8aa4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:59.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.461+0000 7f8aa3fff700 1 --2- 172.21.15.103:0/2371776257 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8a9004dce0 0x7f8a900501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:12:59.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.461+0000 7f8aa3fff700 1 -- 172.21.15.103:0/2371776257 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f8aa4061c00 con 0x7f8ab414a2b0 2020-04-22T14:12:59.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.461+0000 7f8ab2ffd700 1 --2- 172.21.15.103:0/2371776257 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8a9004dce0 0x7f8a900501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:12:59.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.461+0000 7f8ab2ffd700 1 --2- 172.21.15.103:0/2371776257 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8a9004dce0 0x7f8a900501a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8aac001000 tx=0x7f8aac0026a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:59.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.461+0000 7f8ab2ffd700 1 --2- 172.21.15.103:0/2371776257 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8a9004dce0 0x7f8a900501a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8aac001000 tx=0x7f8aac0026a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:59.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.461+0000 7f8ab2ffd700 1 --2- 172.21.15.103:0/2371776257 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8a9004dce0 0x7f8a900501a0 secure :-1 s=READY pgs=436 cs=0 l=1 rx=0x7f8aac001000 tx=0x7f8aac0026a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:12:59.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.465+0000 7f8ab37fe700 1 --2- 172.21.15.103:0/2371776257 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ab414a2b0 0x7f8ab413cf80 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f8aa4002f30 tx=0x7f8aa4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:59.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.465+0000 7f8aa3fff700 1 -- 172.21.15.103:0/2371776257 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f8aa403d040 con 0x7f8ab414a2b0 2020-04-22T14:12:59.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.654+0000 7f8ab947c700 1 -- 172.21.15.103:0/2371776257 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ab405f710 con 0x7f8ab414a2b0 2020-04-22T14:12:59.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.654+0000 7f8ab37fe700 1 --2- 172.21.15.103:0/2371776257 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ab414a2b0 0x7f8ab413cf80 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f8aa4002f30 tx=0x7f8aa4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:12:59.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.654+0000 7f8aa3fff700 1 -- 172.21.15.103:0/2371776257 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f8aa4040660 con 0x7f8ab414a2b0 2020-04-22T14:12:59.658 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:12:59.658 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:43.570838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:12:59.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.656+0000 7f8ab947c700 1 -- 172.21.15.103:0/2371776257 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8a9004dce0 msgr2=0x7f8a900501a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:59.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.656+0000 7f8ab947c700 1 --2- 172.21.15.103:0/2371776257 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8a9004dce0 0x7f8a900501a0 secure :-1 s=READY pgs=436 cs=0 l=1 rx=0x7f8aac001000 tx=0x7f8aac0026a0).stop 2020-04-22T14:12:59.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.656+0000 7f8ab947c700 1 -- 172.21.15.103:0/2371776257 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ab414a2b0 msgr2=0x7f8ab413cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:12:59.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.656+0000 7f8ab947c700 1 --2- 172.21.15.103:0/2371776257 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ab414a2b0 0x7f8ab413cf80 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7f8aa4002f30 tx=0x7f8aa4007a40).stop 2020-04-22T14:12:59.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.656+0000 7f8ab947c700 1 -- 172.21.15.103:0/2371776257 shutdown_connections 2020-04-22T14:12:59.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.656+0000 7f8ab947c700 1 --2- 172.21.15.103:0/2371776257 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ab414a2b0 0x7f8ab413cf80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:59.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.656+0000 7f8ab947c700 1 --2- 172.21.15.103:0/2371776257 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8a9004dce0 0x7f8a900501a0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:59.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.656+0000 7f8ab947c700 1 --2- 172.21.15.103:0/2371776257 >> v2:172.21.15.86:3300/0 conn(0x7f8ab4140320 0x7f8ab4140a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:12:59.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.656+0000 7f8ab947c700 1 -- 172.21.15.103:0/2371776257 >> 172.21.15.103:0/2371776257 conn(0x7f8ab405f2c0 msgr2=0x7f8ab41489a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:12:59.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.656+0000 7f8ab947c700 1 -- 172.21.15.103:0/2371776257 shutdown_connections 2020-04-22T14:12:59.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:12:59.656+0000 7f8ab947c700 1 -- 172.21.15.103:0/2371776257 wait complete. 2020-04-22T14:12:59.661 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 54 2020-04-22T14:12:59.669 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:13:00.670 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:00.692 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:13:00.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.845+0000 7fbca7eb1700 1 Processor -- start 2020-04-22T14:13:00.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.845+0000 7fbca7eb1700 1 -- start start 2020-04-22T14:13:00.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.846+0000 7fbca7eb1700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbca0067170 0x7fbca00b6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:00.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.846+0000 7fbca7eb1700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbca01426d0 0x7fbca0142b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:00.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.846+0000 7fbca7eb1700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbca0064ec0 con 0x7fbca00ac740 2020-04-22T14:13:00.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.846+0000 7fbca7eb1700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbca0065af0 con 0x7fbca01426d0 2020-04-22T14:13:00.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.846+0000 7fbca7eb1700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca0146870 con 0x7fbca0067170 2020-04-22T14:13:00.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.846+0000 7fbca644e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbca01426d0 0x7fbca0142b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:00.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.846+0000 7fbca544c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fbca00ac740 0x7fbca013c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45592/0 (socket says 172.21.15.103:45592) 2020-04-22T14:13:00.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.846+0000 7fbca544c700 1 -- 172.21.15.103:0/1217183886 learned_addr learned my addr 172.21.15.103:0/1217183886 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:00.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.846+0000 7fbca5c4d700 1 --2- 172.21.15.103:0/1217183886 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbca0067170 0x7fbca00b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:00.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.846+0000 7fbca644e700 1 -- 172.21.15.103:0/1217183886 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbca0067170 msgr2=0x7fbca00b6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:00.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.846+0000 7fbca644e700 1 --2- 172.21.15.103:0/1217183886 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbca0067170 0x7fbca00b6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:00.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.846+0000 7fbca644e700 1 -- 172.21.15.103:0/1217183886 >> v1:172.21.15.103:6789/0 conn(0x7fbca00ac740 legacy=0x7fbca013c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:00.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.846+0000 7fbca644e700 1 -- 172.21.15.103:0/1217183886 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca0067550 con 0x7fbca01426d0 2020-04-22T14:13:00.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.846+0000 7fbca4c4b700 1 -- 172.21.15.103:0/1217183886 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2264238112 0 0) 0x7fbca0064ec0 con 0x7fbca00ac740 2020-04-22T14:13:00.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.847+0000 7fbca644e700 1 --2- 172.21.15.103:0/1217183886 >> v2:172.21.15.103:3300/0 conn(0x7fbca01426d0 0x7fbca0142b60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbc980032b0 tx=0x7fbc98007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:00.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.847+0000 7fbca644e700 1 --2- 172.21.15.103:0/1217183886 >> v2:172.21.15.103:3300/0 conn(0x7fbca01426d0 0x7fbca0142b60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbc980032b0 tx=0x7fbc98007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:00.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.847+0000 7fbca644e700 1 --2- 172.21.15.103:0/1217183886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbca01426d0 0x7fbca0142b60 secure :-1 s=READY pgs=1189 cs=0 l=1 rx=0x7fbc980032b0 tx=0x7fbc98007dc0).ready entity=mon.1 client_cookie=78db713b3a61f1ea server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:00.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.847+0000 7fbca644e700 1 --2- 172.21.15.103:0/1217183886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbca01426d0 0x7fbca0142b60 secure :-1 s=THROTTLE_DONE pgs=1189 cs=0 l=1 rx=0x7fbc980032b0 tx=0x7fbc98007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:00.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.847+0000 7fbca644e700 1 --2- 172.21.15.103:0/1217183886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbca01426d0 0x7fbca0142b60 secure :-1 s=THROTTLE_DONE pgs=1189 cs=0 l=1 rx=0x7fbc980032b0 tx=0x7fbc98007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:00.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.847+0000 7fbca4c4b700 1 -- 172.21.15.103:0/1217183886 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc9800a180 con 0x7fbca01426d0 2020-04-22T14:13:00.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.847+0000 7fbca644e700 1 --2- 172.21.15.103:0/1217183886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbca01426d0 0x7fbca0142b60 secure :-1 s=THROTTLE_DONE pgs=1189 cs=0 l=1 rx=0x7fbc980032b0 tx=0x7fbc98007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:00.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.847+0000 7fbca4c4b700 1 -- 172.21.15.103:0/1217183886 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9800a320 con 0x7fbca01426d0 2020-04-22T14:13:00.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.847+0000 7fbca4c4b700 1 -- 172.21.15.103:0/1217183886 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc9800a700 con 0x7fbca01426d0 2020-04-22T14:13:00.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.847+0000 7fbca7eb1700 1 -- 172.21.15.103:0/1217183886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbca01426d0 msgr2=0x7fbca0142b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:00.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.847+0000 7fbca7eb1700 1 --2- 172.21.15.103:0/1217183886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbca01426d0 0x7fbca0142b60 secure :-1 s=READY pgs=1189 cs=0 l=1 rx=0x7fbc980032b0 tx=0x7fbc98007dc0).stop 2020-04-22T14:13:00.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.847+0000 7fbca7eb1700 1 -- 172.21.15.103:0/1217183886 shutdown_connections 2020-04-22T14:13:00.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.847+0000 7fbca7eb1700 1 --2- 172.21.15.103:0/1217183886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbca01426d0 0x7fbca0142b60 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:00.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.847+0000 7fbca7eb1700 1 --2- 172.21.15.103:0/1217183886 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbca0067170 0x7fbca00b6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:00.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.847+0000 7fbca7eb1700 1 -- 172.21.15.103:0/1217183886 >> 172.21.15.103:0/1217183886 conn(0x7fbca00b9160 msgr2=0x7fbca005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:00.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.847+0000 7fbca7eb1700 1 -- 172.21.15.103:0/1217183886 shutdown_connections 2020-04-22T14:13:00.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.847+0000 7fbca7eb1700 1 -- 172.21.15.103:0/1217183886 wait complete. 2020-04-22T14:13:00.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.848+0000 7fbca7eb1700 1 Processor -- start 2020-04-22T14:13:00.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.848+0000 7fbca7eb1700 1 -- start start 2020-04-22T14:13:00.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.849+0000 7fbca7eb1700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbca00ac740 0x7fbca01512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:00.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.849+0000 7fbca7eb1700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbca01426d0 0x7fbca0139470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:00.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.849+0000 7fbca7eb1700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbca0138d30 con 0x7fbca0067170 2020-04-22T14:13:00.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.849+0000 7fbca7eb1700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbca0138fd0 con 0x7fbca01426d0 2020-04-22T14:13:00.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.849+0000 7fbca7eb1700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbca0151740 con 0x7fbca00ac740 2020-04-22T14:13:00.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.849+0000 7fbca544c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbca00ac740 0x7fbca01512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:00.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.849+0000 7fbca544c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbca00ac740 0x7fbca01512e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53408/0 (socket says 172.21.15.103:53408) 2020-04-22T14:13:00.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.849+0000 7fbca544c700 1 -- 172.21.15.103:0/1708493704 learned_addr learned my addr 172.21.15.103:0/1708493704 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:00.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.849+0000 7fbca644e700 1 --2- 172.21.15.103:0/1708493704 >> v2:172.21.15.86:3300/0 conn(0x7fbca01426d0 0x7fbca0139470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:00.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.849+0000 7fbca544c700 1 -- 172.21.15.103:0/1708493704 >> v2:172.21.15.86:3300/0 conn(0x7fbca01426d0 msgr2=0x7fbca0139470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:00.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.849+0000 7fbca544c700 1 --2- 172.21.15.103:0/1708493704 >> v2:172.21.15.86:3300/0 conn(0x7fbca01426d0 0x7fbca0139470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:00.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.849+0000 7fbca544c700 1 -- 172.21.15.103:0/1708493704 >> v1:172.21.15.86:6789/0 conn(0x7fbca0067170 legacy=0x7fbca0144cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:00.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.849+0000 7fbca544c700 1 -- 172.21.15.103:0/1708493704 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca01398d0 con 0x7fbca00ac740 2020-04-22T14:13:00.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.849+0000 7fbca544c700 1 --2- 172.21.15.103:0/1708493704 >> v2:172.21.15.103:3300/0 conn(0x7fbca00ac740 0x7fbca01512e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbc9c000b80 tx=0x7fbc9c010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:00.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.850+0000 7fbca544c700 1 --2- 172.21.15.103:0/1708493704 >> v2:172.21.15.103:3300/0 conn(0x7fbca00ac740 0x7fbca01512e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbc9c000b80 tx=0x7fbc9c010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:00.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.850+0000 7fbca544c700 1 --2- 172.21.15.103:0/1708493704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbca00ac740 0x7fbca01512e0 secure :-1 s=READY pgs=1190 cs=0 l=1 rx=0x7fbc9c000b80 tx=0x7fbc9c010980).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:00.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.850+0000 7fbca544c700 1 --2- 172.21.15.103:0/1708493704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbca00ac740 0x7fbca01512e0 secure :-1 s=THROTTLE_DONE pgs=1190 cs=0 l=1 rx=0x7fbc9c000b80 tx=0x7fbc9c010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:00.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.850+0000 7fbca544c700 1 --2- 172.21.15.103:0/1708493704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbca00ac740 0x7fbca01512e0 secure :-1 s=THROTTLE_DONE pgs=1190 cs=0 l=1 rx=0x7fbc9c000b80 tx=0x7fbc9c010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:00.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.850+0000 7fbc8effd700 1 -- 172.21.15.103:0/1708493704 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc9c005ca0 con 0x7fbca00ac740 2020-04-22T14:13:00.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.850+0000 7fbca544c700 1 --2- 172.21.15.103:0/1708493704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbca00ac740 0x7fbca01512e0 secure :-1 s=THROTTLE_DONE pgs=1190 cs=0 l=1 rx=0x7fbc9c000b80 tx=0x7fbc9c010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:00.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.850+0000 7fbc8effd700 1 -- 172.21.15.103:0/1708493704 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9c005e00 con 0x7fbca00ac740 2020-04-22T14:13:00.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.850+0000 7fbca7eb1700 1 -- 172.21.15.103:0/1708493704 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbca0139e70 con 0x7fbca00ac740 2020-04-22T14:13:00.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.850+0000 7fbc8effd700 1 -- 172.21.15.103:0/1708493704 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc9c0062c0 con 0x7fbca00ac740 2020-04-22T14:13:00.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.850+0000 7fbca7eb1700 1 -- 172.21.15.103:0/1708493704 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbca013b590 con 0x7fbca00ac740 2020-04-22T14:13:00.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.850+0000 7fbca544c700 1 --2- 172.21.15.103:0/1708493704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbca00ac740 0x7fbca01512e0 secure :-1 s=THROTTLE_DONE pgs=1190 cs=0 l=1 rx=0x7fbc9c000b80 tx=0x7fbc9c010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:00.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.851+0000 7fbc8effd700 1 -- 172.21.15.103:0/1708493704 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fbc9c006530 con 0x7fbca00ac740 2020-04-22T14:13:00.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.851+0000 7fbca544c700 1 --2- 172.21.15.103:0/1708493704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbca00ac740 0x7fbca01512e0 secure :-1 s=THROTTLE_DONE pgs=1190 cs=0 l=1 rx=0x7fbc9c000b80 tx=0x7fbc9c010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:00.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.851+0000 7fbca7eb1700 1 -- 172.21.15.103:0/1708493704 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbca0056c90 con 0x7fbca00ac740 2020-04-22T14:13:00.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.851+0000 7fbc8effd700 1 --2- 172.21.15.103:0/1708493704 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbc8004d9a0 0x7fbc8004fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:00.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.851+0000 7fbc8effd700 1 -- 172.21.15.103:0/1708493704 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fbc9c0090c0 con 0x7fbca00ac740 2020-04-22T14:13:00.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.851+0000 7fbca5c4d700 1 --2- 172.21.15.103:0/1708493704 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbc8004d9a0 0x7fbc8004fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:00.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.851+0000 7fbca5c4d700 1 --2- 172.21.15.103:0/1708493704 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbc8004d9a0 0x7fbc8004fe60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbca01458f0 tx=0x7fbc90008d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:00.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.851+0000 7fbca5c4d700 1 --2- 172.21.15.103:0/1708493704 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbc8004d9a0 0x7fbc8004fe60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbca01458f0 tx=0x7fbc90008d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:00.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.852+0000 7fbca5c4d700 1 --2- 172.21.15.103:0/1708493704 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbc8004d9a0 0x7fbc8004fe60 secure :-1 s=READY pgs=437 cs=0 l=1 rx=0x7fbca01458f0 tx=0x7fbc90008d10).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:00.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.855+0000 7fbca544c700 1 --2- 172.21.15.103:0/1708493704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbca00ac740 0x7fbca01512e0 secure :-1 s=THROTTLE_DONE pgs=1190 cs=0 l=1 rx=0x7fbc9c000b80 tx=0x7fbc9c010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:00.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:00.855+0000 7fbc8effd700 1 -- 172.21.15.103:0/1708493704 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fbc9c03c950 con 0x7fbca00ac740 2020-04-22T14:13:01.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:01.041+0000 7fbca7eb1700 1 -- 172.21.15.103:0/1708493704 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbca013bc20 con 0x7fbca00ac740 2020-04-22T14:13:01.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:01.041+0000 7fbca544c700 1 --2- 172.21.15.103:0/1708493704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbca00ac740 0x7fbca01512e0 secure :-1 s=THROTTLE_DONE pgs=1190 cs=0 l=1 rx=0x7fbc9c000b80 tx=0x7fbc9c010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:01.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:01.041+0000 7fbc8effd700 1 -- 172.21.15.103:0/1708493704 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2147 (secure 0 0 0) 0x7fbc9c03ff70 con 0x7fbca00ac740 2020-04-22T14:13:01.045 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:13:01.045 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:43.570838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:13:01.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:01.043+0000 7fbca7eb1700 1 -- 172.21.15.103:0/1708493704 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbc8004d9a0 msgr2=0x7fbc8004fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:01.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:01.043+0000 7fbca7eb1700 1 --2- 172.21.15.103:0/1708493704 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbc8004d9a0 0x7fbc8004fe60 secure :-1 s=READY pgs=437 cs=0 l=1 rx=0x7fbca01458f0 tx=0x7fbc90008d10).stop 2020-04-22T14:13:01.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:01.043+0000 7fbca7eb1700 1 -- 172.21.15.103:0/1708493704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbca00ac740 msgr2=0x7fbca01512e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:01.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:01.043+0000 7fbca7eb1700 1 --2- 172.21.15.103:0/1708493704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbca00ac740 0x7fbca01512e0 secure :-1 s=READY pgs=1190 cs=0 l=1 rx=0x7fbc9c000b80 tx=0x7fbc9c010980).stop 2020-04-22T14:13:01.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:01.043+0000 7fbca7eb1700 1 -- 172.21.15.103:0/1708493704 shutdown_connections 2020-04-22T14:13:01.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:01.043+0000 7fbca7eb1700 1 --2- 172.21.15.103:0/1708493704 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbc8004d9a0 0x7fbc8004fe60 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:01.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:01.043+0000 7fbca7eb1700 1 --2- 172.21.15.103:0/1708493704 >> v2:172.21.15.86:3300/0 conn(0x7fbca01426d0 0x7fbca0139470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:01.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:01.043+0000 7fbca7eb1700 1 --2- 172.21.15.103:0/1708493704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbca00ac740 0x7fbca01512e0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:01.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:01.043+0000 7fbca7eb1700 1 -- 172.21.15.103:0/1708493704 >> 172.21.15.103:0/1708493704 conn(0x7fbca00b9160 msgr2=0x7fbca0063bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:01.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:01.043+0000 7fbca7eb1700 1 -- 172.21.15.103:0/1708493704 shutdown_connections 2020-04-22T14:13:01.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:01.043+0000 7fbca7eb1700 1 -- 172.21.15.103:0/1708493704 wait complete. 2020-04-22T14:13:01.048 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 54 2020-04-22T14:13:01.057 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:13:02.060 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:02.077 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:13:02.231 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.228+0000 7f8b4ca1a700 1 Processor -- start 2020-04-22T14:13:02.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.228+0000 7f8b4ca1a700 1 -- start start 2020-04-22T14:13:02.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.229+0000 7f8b4ca1a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8b48140320 0x7f8b480ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:02.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.229+0000 7f8b4ca1a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8b480bd1b0 0x7f8b480bd620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:02.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.229+0000 7f8b4ca1a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b4814a740 con 0x7f8b4814a2b0 2020-04-22T14:13:02.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.229+0000 7f8b4ca1a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b481462f0 con 0x7f8b480bd1b0 2020-04-22T14:13:02.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.229+0000 7f8b4ca1a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b48146590 con 0x7f8b48140320 2020-04-22T14:13:02.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.229+0000 7f8b4659c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8b48140320 0x7f8b480ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:02.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.229+0000 7f8b4659c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8b48140320 0x7f8b480ae1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53414/0 (socket says 172.21.15.103:53414) 2020-04-22T14:13:02.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.229+0000 7f8b4659c700 1 -- 172.21.15.103:0/931415986 learned_addr learned my addr 172.21.15.103:0/931415986 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:02.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.229+0000 7f8b46d9d700 1 --2- 172.21.15.103:0/931415986 >> v2:172.21.15.86:3300/0 conn(0x7f8b480bd1b0 0x7f8b480bd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:02.244 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.229+0000 7f8b4659c700 1 -- 172.21.15.103:0/931415986 >> v2:172.21.15.86:3300/0 conn(0x7f8b480bd1b0 msgr2=0x7f8b480bd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:02.244 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.229+0000 7f8b4659c700 1 --2- 172.21.15.103:0/931415986 >> v2:172.21.15.86:3300/0 conn(0x7f8b480bd1b0 0x7f8b480bd620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:02.244 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.229+0000 7f8b4659c700 1 -- 172.21.15.103:0/931415986 >> v1:172.21.15.86:6789/0 conn(0x7f8b4814a2b0 legacy=0x7f8b48146cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:02.244 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.229+0000 7f8b4659c700 1 -- 172.21.15.103:0/931415986 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b48146830 con 0x7f8b48140320 2020-04-22T14:13:02.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.230+0000 7f8b4659c700 1 --2- 172.21.15.103:0/931415986 >> v2:172.21.15.103:3300/0 conn(0x7f8b48140320 0x7f8b480ae1a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8b48146bb0 tx=0x7f8b30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:02.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.230+0000 7f8b4659c700 1 --2- 172.21.15.103:0/931415986 >> v2:172.21.15.103:3300/0 conn(0x7f8b48140320 0x7f8b480ae1a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8b48146bb0 tx=0x7f8b30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:02.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.230+0000 7f8b4659c700 1 --2- 172.21.15.103:0/931415986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b48140320 0x7f8b480ae1a0 secure :-1 s=READY pgs=1191 cs=0 l=1 rx=0x7f8b48146bb0 tx=0x7f8b30007a40).ready entity=mon.1 client_cookie=bf375b9f19e5ebf0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:02.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.230+0000 7f8b4659c700 1 --2- 172.21.15.103:0/931415986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b48140320 0x7f8b480ae1a0 secure :-1 s=THROTTLE_DONE pgs=1191 cs=0 l=1 rx=0x7f8b48146bb0 tx=0x7f8b30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:02.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.230+0000 7f8b4559a700 1 -- 172.21.15.103:0/931415986 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b300116e0 con 0x7f8b48140320 2020-04-22T14:13:02.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.230+0000 7f8b4659c700 1 --2- 172.21.15.103:0/931415986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b48140320 0x7f8b480ae1a0 secure :-1 s=THROTTLE_DONE pgs=1191 cs=0 l=1 rx=0x7f8b48146bb0 tx=0x7f8b30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:02.246 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.230+0000 7f8b4559a700 1 -- 172.21.15.103:0/931415986 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b30011840 con 0x7f8b48140320 2020-04-22T14:13:02.246 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.230+0000 7f8b4659c700 1 --2- 172.21.15.103:0/931415986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b48140320 0x7f8b480ae1a0 secure :-1 s=THROTTLE_DONE pgs=1191 cs=0 l=1 rx=0x7f8b48146bb0 tx=0x7f8b30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:02.246 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.230+0000 7f8b4559a700 1 -- 172.21.15.103:0/931415986 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b30011c20 con 0x7f8b48140320 2020-04-22T14:13:02.246 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.230+0000 7f8b4ca1a700 1 -- 172.21.15.103:0/931415986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b48140320 msgr2=0x7f8b480ae1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:02.246 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.230+0000 7f8b4ca1a700 1 --2- 172.21.15.103:0/931415986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b48140320 0x7f8b480ae1a0 secure :-1 s=READY pgs=1191 cs=0 l=1 rx=0x7f8b48146bb0 tx=0x7f8b30007a40).stop 2020-04-22T14:13:02.246 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.230+0000 7f8b4ca1a700 1 -- 172.21.15.103:0/931415986 shutdown_connections 2020-04-22T14:13:02.247 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.230+0000 7f8b4ca1a700 1 --2- 172.21.15.103:0/931415986 >> v2:172.21.15.86:3300/0 conn(0x7f8b480bd1b0 0x7f8b480bd620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:02.247 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.230+0000 7f8b4ca1a700 1 --2- 172.21.15.103:0/931415986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b48140320 0x7f8b480ae1a0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:02.247 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.230+0000 7f8b4ca1a700 1 -- 172.21.15.103:0/931415986 >> 172.21.15.103:0/931415986 conn(0x7f8b4805f2c0 msgr2=0x7f8b480bcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:02.247 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.230+0000 7f8b4ca1a700 1 -- 172.21.15.103:0/931415986 shutdown_connections 2020-04-22T14:13:02.247 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.230+0000 7f8b4ca1a700 1 -- 172.21.15.103:0/931415986 wait complete. 2020-04-22T14:13:02.247 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.231+0000 7f8b4ca1a700 1 Processor -- start 2020-04-22T14:13:02.247 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.231+0000 7f8b4ca1a700 1 -- start start 2020-04-22T14:13:02.248 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.232+0000 7f8b4ca1a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8b480bd1b0 0x7f8b48061fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:02.248 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.232+0000 7f8b4ca1a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b48140320 0x7f8b480b8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:02.248 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.232+0000 7f8b4ca1a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8b4814a2b0 0x7f8b4813f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:02.248 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.232+0000 7f8b4ca1a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b480b87e0 con 0x7f8b4814a2b0 2020-04-22T14:13:02.248 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.232+0000 7f8b4ca1a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b48159220 con 0x7f8b480bd1b0 2020-04-22T14:13:02.248 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.232+0000 7f8b4ca1a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b48065a20 con 0x7f8b48140320 2020-04-22T14:13:02.248 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.232+0000 7f8b4659c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8b480bd1b0 0x7f8b48061fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:02.249 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.232+0000 7f8b4659c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8b480bd1b0 0x7f8b48061fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53418/0 (socket says 172.21.15.103:53418) 2020-04-22T14:13:02.249 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.232+0000 7f8b4659c700 1 -- 172.21.15.103:0/1381006659 learned_addr learned my addr 172.21.15.103:0/1381006659 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:02.249 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.232+0000 7f8b45d9b700 1 --2- 172.21.15.103:0/1381006659 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b48140320 0x7f8b480b8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:02.249 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.232+0000 7f8b46d9d700 1 --2- 172.21.15.103:0/1381006659 >> v2:172.21.15.86:3300/0 conn(0x7f8b4814a2b0 0x7f8b4813f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:02.249 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.232+0000 7f8b4659c700 1 -- 172.21.15.103:0/1381006659 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b48140320 msgr2=0x7f8b480b8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:02.249 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.232+0000 7f8b4659c700 1 --2- 172.21.15.103:0/1381006659 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b48140320 0x7f8b480b8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:02.249 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.232+0000 7f8b4659c700 1 -- 172.21.15.103:0/1381006659 >> v2:172.21.15.86:3300/0 conn(0x7f8b4814a2b0 msgr2=0x7f8b4813f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:02.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.232+0000 7f8b4659c700 1 --2- 172.21.15.103:0/1381006659 >> v2:172.21.15.86:3300/0 conn(0x7f8b4814a2b0 0x7f8b4813f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:02.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.232+0000 7f8b4659c700 1 -- 172.21.15.103:0/1381006659 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b48065cc0 con 0x7f8b480bd1b0 2020-04-22T14:13:02.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.232+0000 7f8b4659c700 1 --2- 172.21.15.103:0/1381006659 >> v2:172.21.15.103:3300/0 conn(0x7f8b480bd1b0 0x7f8b48061fd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8b48146bb0 tx=0x7f8b30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:02.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.233+0000 7f8b4659c700 1 --2- 172.21.15.103:0/1381006659 >> v2:172.21.15.103:3300/0 conn(0x7f8b480bd1b0 0x7f8b48061fd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8b48146bb0 tx=0x7f8b30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:02.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.233+0000 7f8b4659c700 1 --2- 172.21.15.103:0/1381006659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b480bd1b0 0x7f8b48061fd0 secure :-1 s=READY pgs=1192 cs=0 l=1 rx=0x7f8b48146bb0 tx=0x7f8b30007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:02.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.233+0000 7f8b4659c700 1 --2- 172.21.15.103:0/1381006659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b480bd1b0 0x7f8b48061fd0 secure :-1 s=THROTTLE_DONE pgs=1192 cs=0 l=1 rx=0x7f8b48146bb0 tx=0x7f8b30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:02.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.233+0000 7f8b3f7fe700 1 -- 172.21.15.103:0/1381006659 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b30007360 con 0x7f8b480bd1b0 2020-04-22T14:13:02.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.233+0000 7f8b4659c700 1 --2- 172.21.15.103:0/1381006659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b480bd1b0 0x7f8b48061fd0 secure :-1 s=THROTTLE_DONE pgs=1192 cs=0 l=1 rx=0x7f8b48146bb0 tx=0x7f8b30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:02.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.233+0000 7f8b4659c700 1 --2- 172.21.15.103:0/1381006659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b480bd1b0 0x7f8b48061fd0 secure :-1 s=THROTTLE_DONE pgs=1192 cs=0 l=1 rx=0x7f8b48146bb0 tx=0x7f8b30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:02.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.233+0000 7f8b3f7fe700 1 -- 172.21.15.103:0/1381006659 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b300074c0 con 0x7f8b480bd1b0 2020-04-22T14:13:02.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.233+0000 7f8b4ca1a700 1 -- 172.21.15.103:0/1381006659 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b48066160 con 0x7f8b480bd1b0 2020-04-22T14:13:02.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.233+0000 7f8b3f7fe700 1 -- 172.21.15.103:0/1381006659 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b300058b0 con 0x7f8b480bd1b0 2020-04-22T14:13:02.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.233+0000 7f8b4ca1a700 1 -- 172.21.15.103:0/1381006659 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b48158df0 con 0x7f8b480bd1b0 2020-04-22T14:13:02.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.233+0000 7f8b4659c700 1 --2- 172.21.15.103:0/1381006659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b480bd1b0 0x7f8b48061fd0 secure :-1 s=THROTTLE_DONE pgs=1192 cs=0 l=1 rx=0x7f8b48146bb0 tx=0x7f8b30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:02.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.234+0000 7f8b3f7fe700 1 -- 172.21.15.103:0/1381006659 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f8b30005d30 con 0x7f8b480bd1b0 2020-04-22T14:13:02.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.234+0000 7f8b4659c700 1 --2- 172.21.15.103:0/1381006659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b480bd1b0 0x7f8b48061fd0 secure :-1 s=THROTTLE_DONE pgs=1192 cs=0 l=1 rx=0x7f8b48146bb0 tx=0x7f8b30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:02.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.234+0000 7f8b4ca1a700 1 -- 172.21.15.103:0/1381006659 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b48065ec0 con 0x7f8b480bd1b0 2020-04-22T14:13:02.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.234+0000 7f8b3f7fe700 1 --2- 172.21.15.103:0/1381006659 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8b2c04d930 0x7f8b2c04fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:02.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.234+0000 7f8b3f7fe700 1 -- 172.21.15.103:0/1381006659 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f8b30062030 con 0x7f8b480bd1b0 2020-04-22T14:13:02.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.234+0000 7f8b45d9b700 1 --2- 172.21.15.103:0/1381006659 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8b2c04d930 0x7f8b2c04fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:02.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.234+0000 7f8b45d9b700 1 --2- 172.21.15.103:0/1381006659 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8b2c04d930 0x7f8b2c04fdf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8b38001f50 tx=0x7f8b380027b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:02.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.235+0000 7f8b45d9b700 1 --2- 172.21.15.103:0/1381006659 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8b2c04d930 0x7f8b2c04fdf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8b38001f50 tx=0x7f8b380027b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:02.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.235+0000 7f8b45d9b700 1 --2- 172.21.15.103:0/1381006659 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8b2c04d930 0x7f8b2c04fdf0 secure :-1 s=READY pgs=438 cs=0 l=1 rx=0x7f8b38001f50 tx=0x7f8b380027b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:02.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.238+0000 7f8b4659c700 1 --2- 172.21.15.103:0/1381006659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b480bd1b0 0x7f8b48061fd0 secure :-1 s=THROTTLE_DONE pgs=1192 cs=0 l=1 rx=0x7f8b48146bb0 tx=0x7f8b30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:02.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.238+0000 7f8b3f7fe700 1 -- 172.21.15.103:0/1381006659 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f8b48065ec0 con 0x7f8b480bd1b0 2020-04-22T14:13:02.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.428+0000 7f8b4ca1a700 1 -- 172.21.15.103:0/1381006659 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b48065ec0 con 0x7f8b480bd1b0 2020-04-22T14:13:02.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.428+0000 7f8b4659c700 1 --2- 172.21.15.103:0/1381006659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b480bd1b0 0x7f8b48061fd0 secure :-1 s=THROTTLE_DONE pgs=1192 cs=0 l=1 rx=0x7f8b48146bb0 tx=0x7f8b30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:02.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.428+0000 7f8b3f7fe700 1 -- 172.21.15.103:0/1381006659 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f8b48065ec0 con 0x7f8b480bd1b0 2020-04-22T14:13:02.432 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:13:02.432 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:43.570838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:13:02.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.429+0000 7f8b4ca1a700 1 -- 172.21.15.103:0/1381006659 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8b2c04d930 msgr2=0x7f8b2c04fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:02.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.429+0000 7f8b4ca1a700 1 --2- 172.21.15.103:0/1381006659 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8b2c04d930 0x7f8b2c04fdf0 secure :-1 s=READY pgs=438 cs=0 l=1 rx=0x7f8b38001f50 tx=0x7f8b380027b0).stop 2020-04-22T14:13:02.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.429+0000 7f8b4ca1a700 1 -- 172.21.15.103:0/1381006659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b480bd1b0 msgr2=0x7f8b48061fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:02.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.429+0000 7f8b4ca1a700 1 --2- 172.21.15.103:0/1381006659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b480bd1b0 0x7f8b48061fd0 secure :-1 s=READY pgs=1192 cs=0 l=1 rx=0x7f8b48146bb0 tx=0x7f8b30007a40).stop 2020-04-22T14:13:02.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.429+0000 7f8b4ca1a700 1 -- 172.21.15.103:0/1381006659 shutdown_connections 2020-04-22T14:13:02.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.429+0000 7f8b4ca1a700 1 --2- 172.21.15.103:0/1381006659 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8b2c04d930 0x7f8b2c04fdf0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:02.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.429+0000 7f8b4ca1a700 1 --2- 172.21.15.103:0/1381006659 >> v2:172.21.15.86:3300/0 conn(0x7f8b4814a2b0 0x7f8b4813f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:02.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.429+0000 7f8b4ca1a700 1 --2- 172.21.15.103:0/1381006659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b480bd1b0 0x7f8b48061fd0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:02.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.429+0000 7f8b4ca1a700 1 --2- 172.21.15.103:0/1381006659 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b48140320 0x7f8b480b8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:02.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.429+0000 7f8b4ca1a700 1 -- 172.21.15.103:0/1381006659 >> 172.21.15.103:0/1381006659 conn(0x7f8b4805f2c0 msgr2=0x7f8b480adc40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:02.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.430+0000 7f8b4ca1a700 1 -- 172.21.15.103:0/1381006659 shutdown_connections 2020-04-22T14:13:02.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:02.430+0000 7f8b4ca1a700 1 -- 172.21.15.103:0/1381006659 wait complete. 2020-04-22T14:13:02.436 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 54 2020-04-22T14:13:02.457 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:13:03.458 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:03.475 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:13:03.632 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.628+0000 7fd99aacf700 1 Processor -- start 2020-04-22T14:13:03.632 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.628+0000 7fd99aacf700 1 -- start start 2020-04-22T14:13:03.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.629+0000 7fd99aacf700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd9941441f0 0x7fd994144820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:03.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.629+0000 7fd99aacf700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd994144c80 0x7fd9940ad850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:03.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.629+0000 7fd99aacf700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9940b5900 con 0x7fd99405b7c0 2020-04-22T14:13:03.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.629+0000 7fd99aacf700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9940b5ba0 con 0x7fd994144c80 2020-04-22T14:13:03.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.629+0000 7fd99aacf700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9940b5e40 con 0x7fd9941441f0 2020-04-22T14:13:03.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.629+0000 7fd993fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd9941441f0 0x7fd994144820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:03.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.629+0000 7fd993fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd9941441f0 0x7fd994144820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53428/0 (socket says 172.21.15.103:53428) 2020-04-22T14:13:03.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.630+0000 7fd993fff700 1 -- 172.21.15.103:0/1296830783 learned_addr learned my addr 172.21.15.103:0/1296830783 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:03.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.630+0000 7fd99906c700 1 --2- 172.21.15.103:0/1296830783 >> v2:172.21.15.86:3300/0 conn(0x7fd994144c80 0x7fd9940ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:03.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.630+0000 7fd993fff700 1 -- 172.21.15.103:0/1296830783 >> v2:172.21.15.86:3300/0 conn(0x7fd994144c80 msgr2=0x7fd9940ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:03.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.630+0000 7fd993fff700 1 --2- 172.21.15.103:0/1296830783 >> v2:172.21.15.86:3300/0 conn(0x7fd994144c80 0x7fd9940ad850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:03.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.630+0000 7fd993fff700 1 -- 172.21.15.103:0/1296830783 >> v1:172.21.15.86:6789/0 conn(0x7fd99405b7c0 legacy=0x7fd9940b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:03.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.630+0000 7fd993fff700 1 -- 172.21.15.103:0/1296830783 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd99405bba0 con 0x7fd9941441f0 2020-04-22T14:13:03.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.630+0000 7fd993fff700 1 --2- 172.21.15.103:0/1296830783 >> v2:172.21.15.103:3300/0 conn(0x7fd9941441f0 0x7fd994144820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd988002f30 tx=0x7fd988007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:03.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.630+0000 7fd993fff700 1 --2- 172.21.15.103:0/1296830783 >> v2:172.21.15.103:3300/0 conn(0x7fd9941441f0 0x7fd994144820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd988002f30 tx=0x7fd988007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:03.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.630+0000 7fd993fff700 1 --2- 172.21.15.103:0/1296830783 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9941441f0 0x7fd994144820 secure :-1 s=READY pgs=1193 cs=0 l=1 rx=0x7fd988002f30 tx=0x7fd988007a40).ready entity=mon.1 client_cookie=2a0384d1f1fc8919 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:03.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.630+0000 7fd993fff700 1 --2- 172.21.15.103:0/1296830783 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9941441f0 0x7fd994144820 secure :-1 s=THROTTLE_DONE pgs=1193 cs=0 l=1 rx=0x7fd988002f30 tx=0x7fd988007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:03.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.630+0000 7fd9937fe700 1 -- 172.21.15.103:0/1296830783 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd988008e10 con 0x7fd9941441f0 2020-04-22T14:13:03.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.630+0000 7fd993fff700 1 --2- 172.21.15.103:0/1296830783 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9941441f0 0x7fd994144820 secure :-1 s=THROTTLE_DONE pgs=1193 cs=0 l=1 rx=0x7fd988002f30 tx=0x7fd988007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:03.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.630+0000 7fd993fff700 1 --2- 172.21.15.103:0/1296830783 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9941441f0 0x7fd994144820 secure :-1 s=THROTTLE_DONE pgs=1193 cs=0 l=1 rx=0x7fd988002f30 tx=0x7fd988007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:03.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.630+0000 7fd9937fe700 1 -- 172.21.15.103:0/1296830783 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9880107c0 con 0x7fd9941441f0 2020-04-22T14:13:03.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.630+0000 7fd9937fe700 1 -- 172.21.15.103:0/1296830783 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd988010be0 con 0x7fd9941441f0 2020-04-22T14:13:03.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.630+0000 7fd99aacf700 1 -- 172.21.15.103:0/1296830783 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9941441f0 msgr2=0x7fd994144820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:03.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.630+0000 7fd99aacf700 1 --2- 172.21.15.103:0/1296830783 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9941441f0 0x7fd994144820 secure :-1 s=READY pgs=1193 cs=0 l=1 rx=0x7fd988002f30 tx=0x7fd988007a40).stop 2020-04-22T14:13:03.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.631+0000 7fd99aacf700 1 -- 172.21.15.103:0/1296830783 shutdown_connections 2020-04-22T14:13:03.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.631+0000 7fd99aacf700 1 --2- 172.21.15.103:0/1296830783 >> v2:172.21.15.86:3300/0 conn(0x7fd994144c80 0x7fd9940ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:03.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.631+0000 7fd99aacf700 1 --2- 172.21.15.103:0/1296830783 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9941441f0 0x7fd994144820 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:03.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.631+0000 7fd99aacf700 1 -- 172.21.15.103:0/1296830783 >> 172.21.15.103:0/1296830783 conn(0x7fd9940b9160 msgr2=0x7fd99405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:03.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.631+0000 7fd99aacf700 1 -- 172.21.15.103:0/1296830783 shutdown_connections 2020-04-22T14:13:03.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.631+0000 7fd99aacf700 1 -- 172.21.15.103:0/1296830783 wait complete. 2020-04-22T14:13:03.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.632+0000 7fd99aacf700 1 Processor -- start 2020-04-22T14:13:03.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.632+0000 7fd99aacf700 1 -- start start 2020-04-22T14:13:03.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.633+0000 7fd99aacf700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd99405b7c0 0x7fd994147700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:03.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.633+0000 7fd99aacf700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd9941441f0 0x7fd99413e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:03.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.633+0000 7fd99aacf700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd994147b60 con 0x7fd994144c80 2020-04-22T14:13:03.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.633+0000 7fd99aacf700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd99413f070 con 0x7fd99405b7c0 2020-04-22T14:13:03.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.633+0000 7fd99aacf700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd99413f310 con 0x7fd9941441f0 2020-04-22T14:13:03.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.633+0000 7fd993fff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd9941441f0 0x7fd99413e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:03.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.633+0000 7fd99886b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd99405b7c0 0x7fd994147700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:03.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.633+0000 7fd99886b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd99405b7c0 0x7fd994147700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:50664/0 (socket says 172.21.15.103:50664) 2020-04-22T14:13:03.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.633+0000 7fd99906c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fd994144c80 0x7fd99413a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:34550/0 (socket says 172.21.15.103:34550) 2020-04-22T14:13:03.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.633+0000 7fd993fff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd9941441f0 0x7fd99413e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:38212/0 (socket says 172.21.15.103:38212) 2020-04-22T14:13:03.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.633+0000 7fd99886b700 1 -- 172.21.15.103:0/3958082117 learned_addr learned my addr 172.21.15.103:0/3958082117 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:03.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.633+0000 7fd991ffb700 1 -- 172.21.15.103:0/3958082117 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3269336471 0 0) 0x7fd98c001210 con 0x7fd994144c80 2020-04-22T14:13:03.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.633+0000 7fd991ffb700 1 -- 172.21.15.103:0/3958082117 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd974002fe0 con 0x7fd994144c80 2020-04-22T14:13:03.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.633+0000 7fd993fff700 1 -- 172.21.15.103:0/3958082117 >> v2:172.21.15.86:3300/0 conn(0x7fd99405b7c0 msgr2=0x7fd994147700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:03.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.633+0000 7fd993fff700 1 --2- 172.21.15.103:0/3958082117 >> v2:172.21.15.86:3300/0 conn(0x7fd99405b7c0 0x7fd994147700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:03.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.633+0000 7fd993fff700 1 -- 172.21.15.103:0/3958082117 >> v1:172.21.15.86:6789/0 conn(0x7fd994144c80 legacy=0x7fd99413a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:03.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.633+0000 7fd993fff700 1 -- 172.21.15.103:0/3958082117 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd994145ab0 con 0x7fd9941441f0 2020-04-22T14:13:03.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.633+0000 7fd99886b700 1 --2- 172.21.15.103:0/3958082117 >> v2:172.21.15.86:3300/0 conn(0x7fd99405b7c0 0x7fd994147700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:13:03.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.633+0000 7fd993fff700 1 --2- 172.21.15.103:0/3958082117 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd9941441f0 0x7fd99413e7d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd988002f30 tx=0x7fd988007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:03.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.633+0000 7fd993fff700 1 --2- 172.21.15.103:0/3958082117 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd9941441f0 0x7fd99413e7d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd988002f30 tx=0x7fd988007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:03.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.633+0000 7fd993fff700 1 --2- 172.21.15.103:0/3958082117 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd9941441f0 0x7fd99413e7d0 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7fd988002f30 tx=0x7fd988007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:03.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.634+0000 7fd993fff700 1 --2- 172.21.15.103:0/3958082117 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd9941441f0 0x7fd99413e7d0 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7fd988002f30 tx=0x7fd988007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:03.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.634+0000 7fd991ffb700 1 -- 172.21.15.103:0/3958082117 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9880102e0 con 0x7fd9941441f0 2020-04-22T14:13:03.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.634+0000 7fd993fff700 1 --2- 172.21.15.103:0/3958082117 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd9941441f0 0x7fd99413e7d0 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7fd988002f30 tx=0x7fd988007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:03.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.634+0000 7fd993fff700 1 --2- 172.21.15.103:0/3958082117 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd9941441f0 0x7fd99413e7d0 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7fd988002f30 tx=0x7fd988007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:03.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.634+0000 7fd991ffb700 1 -- 172.21.15.103:0/3958082117 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd988009e80 con 0x7fd9941441f0 2020-04-22T14:13:03.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.634+0000 7fd99aacf700 1 -- 172.21.15.103:0/3958082117 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd99413acc0 con 0x7fd9941441f0 2020-04-22T14:13:03.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.634+0000 7fd991ffb700 1 -- 172.21.15.103:0/3958082117 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd98800f900 con 0x7fd9941441f0 2020-04-22T14:13:03.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.634+0000 7fd99aacf700 1 -- 172.21.15.103:0/3958082117 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd99413ec30 con 0x7fd9941441f0 2020-04-22T14:13:03.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.634+0000 7fd993fff700 1 --2- 172.21.15.103:0/3958082117 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd9941441f0 0x7fd99413e7d0 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7fd988002f30 tx=0x7fd988007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:03.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.635+0000 7fd99aacf700 1 -- 172.21.15.103:0/3958082117 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd994145ca0 con 0x7fd9941441f0 2020-04-22T14:13:03.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.635+0000 7fd991ffb700 1 -- 172.21.15.103:0/3958082117 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fd9880056c0 con 0x7fd9941441f0 2020-04-22T14:13:03.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.635+0000 7fd993fff700 1 --2- 172.21.15.103:0/3958082117 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd9941441f0 0x7fd99413e7d0 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7fd988002f30 tx=0x7fd988007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:03.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.635+0000 7fd991ffb700 1 --2- 172.21.15.103:0/3958082117 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd97404de10 0x7fd9740502d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:03.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.635+0000 7fd991ffb700 1 -- 172.21.15.103:0/3958082117 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fd988061330 con 0x7fd9941441f0 2020-04-22T14:13:03.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.635+0000 7fd99886b700 1 --2- 172.21.15.103:0/3958082117 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd97404de10 0x7fd9740502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:03.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.635+0000 7fd99886b700 1 --2- 172.21.15.103:0/3958082117 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd97404de10 0x7fd9740502d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd9940613e0 tx=0x7fd984001410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:03.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.636+0000 7fd99886b700 1 --2- 172.21.15.103:0/3958082117 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd97404de10 0x7fd9740502d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd9940613e0 tx=0x7fd984001410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:03.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.636+0000 7fd99886b700 1 --2- 172.21.15.103:0/3958082117 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd97404de10 0x7fd9740502d0 secure :-1 s=READY pgs=439 cs=0 l=1 rx=0x7fd9940613e0 tx=0x7fd984001410).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:03.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.641+0000 7fd993fff700 1 --2- 172.21.15.103:0/3958082117 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd9941441f0 0x7fd99413e7d0 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7fd988002f30 tx=0x7fd988007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:03.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.641+0000 7fd991ffb700 1 -- 172.21.15.103:0/3958082117 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fd98803c7d0 con 0x7fd9941441f0 2020-04-22T14:13:03.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.828+0000 7fd99aacf700 1 -- 172.21.15.103:0/3958082117 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd994056c90 con 0x7fd9941441f0 2020-04-22T14:13:03.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.829+0000 7fd993fff700 1 --2- 172.21.15.103:0/3958082117 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd9941441f0 0x7fd99413e7d0 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7fd988002f30 tx=0x7fd988007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:03.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.829+0000 7fd991ffb700 1 -- 172.21.15.103:0/3958082117 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2147 (secure 0 0 0) 0x7fd98803fdf0 con 0x7fd9941441f0 2020-04-22T14:13:03.832 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:13:03.833 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:43.570838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:13:03.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.830+0000 7fd99aacf700 1 -- 172.21.15.103:0/3958082117 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd97404de10 msgr2=0x7fd9740502d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:03.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.830+0000 7fd99aacf700 1 --2- 172.21.15.103:0/3958082117 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd97404de10 0x7fd9740502d0 secure :-1 s=READY pgs=439 cs=0 l=1 rx=0x7fd9940613e0 tx=0x7fd984001410).stop 2020-04-22T14:13:03.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.830+0000 7fd99aacf700 1 -- 172.21.15.103:0/3958082117 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd9941441f0 msgr2=0x7fd99413e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:03.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.830+0000 7fd99aacf700 1 --2- 172.21.15.103:0/3958082117 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd9941441f0 0x7fd99413e7d0 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7fd988002f30 tx=0x7fd988007a40).stop 2020-04-22T14:13:03.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.830+0000 7fd99aacf700 1 -- 172.21.15.103:0/3958082117 shutdown_connections 2020-04-22T14:13:03.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.830+0000 7fd99aacf700 1 --2- 172.21.15.103:0/3958082117 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd97404de10 0x7fd9740502d0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:03.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.830+0000 7fd99aacf700 1 --2- 172.21.15.103:0/3958082117 >> v2:172.21.15.86:3300/0 conn(0x7fd99405b7c0 0x7fd994147700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:03.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.830+0000 7fd99aacf700 1 --2- 172.21.15.103:0/3958082117 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd9941441f0 0x7fd99413e7d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:03.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.830+0000 7fd99aacf700 1 -- 172.21.15.103:0/3958082117 >> 172.21.15.103:0/3958082117 conn(0x7fd9940b9160 msgr2=0x7fd9940621f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:03.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.830+0000 7fd99aacf700 1 -- 172.21.15.103:0/3958082117 shutdown_connections 2020-04-22T14:13:03.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:03.830+0000 7fd99aacf700 1 -- 172.21.15.103:0/3958082117 wait complete. 2020-04-22T14:13:03.836 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 54 2020-04-22T14:13:03.844 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:13:04.845 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:04.861 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:13:05.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.020+0000 7f9dc4557700 1 Processor -- start 2020-04-22T14:13:05.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.020+0000 7f9dc4557700 1 -- start start 2020-04-22T14:13:05.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.021+0000 7f9dc4557700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9dbc065fe0 0x7f9dbc1464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:05.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.021+0000 7f9dc4557700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9dbc063e30 0x7f9dbc0642a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:05.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.021+0000 7f9dc4557700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dbc143300 con 0x7f9dbc12c0d0 2020-04-22T14:13:05.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.021+0000 7f9dc4557700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dbc1435a0 con 0x7f9dbc063e30 2020-04-22T14:13:05.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.021+0000 7f9dc4557700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc143840 con 0x7f9dbc065fe0 2020-04-22T14:13:05.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.021+0000 7f9dc22f3700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f9dbc12c0d0 0x7f9dbc05b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45630/0 (socket says 172.21.15.103:45630) 2020-04-22T14:13:05.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.021+0000 7f9dc22f3700 1 -- 172.21.15.103:0/1316511568 learned_addr learned my addr 172.21.15.103:0/1316511568 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:05.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.021+0000 7f9dc1af2700 1 --2- 172.21.15.103:0/1316511568 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9dbc065fe0 0x7f9dbc1464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:05.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.021+0000 7f9dc12f1700 1 -- 172.21.15.103:0/1316511568 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2552551426 0 0) 0x7f9dbc143300 con 0x7f9dbc12c0d0 2020-04-22T14:13:05.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.021+0000 7f9dc2af4700 1 --2- 172.21.15.103:0/1316511568 >> v2:172.21.15.86:3300/0 conn(0x7f9dbc063e30 0x7f9dbc0642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:05.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.021+0000 7f9dc12f1700 1 -- 172.21.15.103:0/1316511568 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9da4003230 con 0x7f9dbc12c0d0 2020-04-22T14:13:05.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.021+0000 7f9dc12f1700 1 -- 172.21.15.103:0/1316511568 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4009461329 0 0) 0x7f9da4003230 con 0x7f9dbc12c0d0 2020-04-22T14:13:05.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.021+0000 7f9dc12f1700 1 -- 172.21.15.103:0/1316511568 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9dbc065fe0 msgr2=0x7f9dbc1464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:05.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.021+0000 7f9dc12f1700 1 --2- 172.21.15.103:0/1316511568 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9dbc065fe0 0x7f9dbc1464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:05.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.021+0000 7f9dc12f1700 1 -- 172.21.15.103:0/1316511568 >> v2:172.21.15.86:3300/0 conn(0x7f9dbc063e30 msgr2=0x7f9dbc0642a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:05.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.021+0000 7f9dc12f1700 1 --2- 172.21.15.103:0/1316511568 >> v2:172.21.15.86:3300/0 conn(0x7f9dbc063e30 0x7f9dbc0642a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:05.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.021+0000 7f9dc12f1700 1 -- 172.21.15.103:0/1316511568 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dbc05bb50 con 0x7f9dbc12c0d0 2020-04-22T14:13:05.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.021+0000 7f9dc12f1700 1 -- 172.21.15.103:0/1316511568 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f9dac0016d0 con 0x7f9dbc12c0d0 2020-04-22T14:13:05.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.021+0000 7f9dc12f1700 1 -- 172.21.15.103:0/1316511568 >> v1:172.21.15.103:6789/0 conn(0x7f9dbc12c0d0 legacy=0x7f9dbc05b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:05.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.021+0000 7f9dc12f1700 1 --2- 172.21.15.103:0/1316511568 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9da4003720 0x7f9da4003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:05.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.021+0000 7f9dc12f1700 1 --2- 172.21.15.103:0/1316511568 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9dbc065fe0 0x7f9da40044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:05.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.021+0000 7f9dc12f1700 1 --2- 172.21.15.103:0/1316511568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9da4004930 0x7f9da4004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:05.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.021+0000 7f9dc12f1700 1 -- 172.21.15.103:0/1316511568 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc1435a0 con 0x7f9da4004930 2020-04-22T14:13:05.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.021+0000 7f9dc12f1700 1 -- 172.21.15.103:0/1316511568 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc143840 con 0x7f9da4003720 2020-04-22T14:13:05.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.021+0000 7f9dc12f1700 1 -- 172.21.15.103:0/1316511568 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da40040f0 con 0x7f9dbc065fe0 2020-04-22T14:13:05.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.021+0000 7f9dc22f3700 1 --2- 172.21.15.103:0/1316511568 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9da4003720 0x7f9da4003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:05.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.022+0000 7f9dc1af2700 1 --2- 172.21.15.103:0/1316511568 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9dbc065fe0 0x7f9da40044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:05.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.022+0000 7f9dc2af4700 1 --2- 172.21.15.103:0/1316511568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9da4004930 0x7f9da4004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:05.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.022+0000 7f9dc22f3700 1 -- 172.21.15.103:0/1316511568 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9dbc065fe0 msgr2=0x7f9da40044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:05.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.022+0000 7f9dc22f3700 1 --2- 172.21.15.103:0/1316511568 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9dbc065fe0 0x7f9da40044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:05.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.022+0000 7f9dc22f3700 1 -- 172.21.15.103:0/1316511568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9da4004930 msgr2=0x7f9da4004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:05.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.022+0000 7f9dc22f3700 1 --2- 172.21.15.103:0/1316511568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9da4004930 0x7f9da4004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:05.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.022+0000 7f9dc22f3700 1 -- 172.21.15.103:0/1316511568 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da4003230 con 0x7f9da4003720 2020-04-22T14:13:05.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.022+0000 7f9dc22f3700 1 --2- 172.21.15.103:0/1316511568 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9da4003720 0x7f9da4003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9dac0013e0 tx=0x7f9dbc05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:05.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.022+0000 7f9dc22f3700 1 --2- 172.21.15.103:0/1316511568 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9da4003720 0x7f9da4003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9dac0013e0 tx=0x7f9dbc05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:05.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.022+0000 7f9dc22f3700 1 --2- 172.21.15.103:0/1316511568 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9da4003720 0x7f9da4003b40 secure :-1 s=READY pgs=1195 cs=0 l=1 rx=0x7f9dac0013e0 tx=0x7f9dbc05bce0).ready entity=mon.1 client_cookie=75e21d72c8701d68 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:05.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.022+0000 7f9dc22f3700 1 --2- 172.21.15.103:0/1316511568 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9da4003720 0x7f9da4003b40 secure :-1 s=THROTTLE_DONE pgs=1195 cs=0 l=1 rx=0x7f9dac0013e0 tx=0x7f9dbc05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:05.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.022+0000 7f9dc22f3700 1 --2- 172.21.15.103:0/1316511568 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9da4003720 0x7f9da4003b40 secure :-1 s=THROTTLE_DONE pgs=1195 cs=0 l=1 rx=0x7f9dac0013e0 tx=0x7f9dbc05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:05.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.022+0000 7f9dc12f1700 1 -- 172.21.15.103:0/1316511568 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9dac00e180 con 0x7f9da4003720 2020-04-22T14:13:05.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.022+0000 7f9dc22f3700 1 --2- 172.21.15.103:0/1316511568 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9da4003720 0x7f9da4003b40 secure :-1 s=THROTTLE_DONE pgs=1195 cs=0 l=1 rx=0x7f9dac0013e0 tx=0x7f9dbc05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:05.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.022+0000 7f9dc12f1700 1 -- 172.21.15.103:0/1316511568 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dac00e320 con 0x7f9da4003720 2020-04-22T14:13:05.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.022+0000 7f9dc12f1700 1 -- 172.21.15.103:0/1316511568 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9dac0100c0 con 0x7f9da4003720 2020-04-22T14:13:05.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.022+0000 7f9dc4557700 1 -- 172.21.15.103:0/1316511568 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9da4003720 msgr2=0x7f9da4003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:05.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.022+0000 7f9dc4557700 1 --2- 172.21.15.103:0/1316511568 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9da4003720 0x7f9da4003b40 secure :-1 s=READY pgs=1195 cs=0 l=1 rx=0x7f9dac0013e0 tx=0x7f9dbc05bce0).stop 2020-04-22T14:13:05.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.022+0000 7f9dc2af4700 1 -- 172.21.15.103:0/1316511568 reap_dead start 2020-04-22T14:13:05.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.023+0000 7f9dc4557700 1 -- 172.21.15.103:0/1316511568 shutdown_connections 2020-04-22T14:13:05.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.023+0000 7f9dc4557700 1 -- 172.21.15.103:0/1316511568 >> 172.21.15.103:0/1316511568 conn(0x7f9dbc0b9160 msgr2=0x7f9dbc05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:05.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.023+0000 7f9dc4557700 1 -- 172.21.15.103:0/1316511568 shutdown_connections 2020-04-22T14:13:05.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.023+0000 7f9dc4557700 1 -- 172.21.15.103:0/1316511568 wait complete. 2020-04-22T14:13:05.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.024+0000 7f9dc4557700 1 Processor -- start 2020-04-22T14:13:05.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.024+0000 7f9dc4557700 1 -- start start 2020-04-22T14:13:05.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.024+0000 7f9dc4557700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9dbc152ed0 0x7f9dbc0b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:05.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.024+0000 7f9dc4557700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9dbc1532b0 0x7f9dbc0b2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:05.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.024+0000 7f9dc4557700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dbc0af8f0 con 0x7f9dbc0ae860 2020-04-22T14:13:05.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.024+0000 7f9dc4557700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dbc153770 con 0x7f9dbc1532b0 2020-04-22T14:13:05.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.024+0000 7f9dc4557700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dbc153a10 con 0x7f9dbc152ed0 2020-04-22T14:13:05.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.024+0000 7f9dc22f3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9dbc152ed0 0x7f9dbc0b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:05.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.024+0000 7f9dc1af2700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f9dbc0ae860 0x7f9dbc128d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45642/0 (socket says 172.21.15.103:45642) 2020-04-22T14:13:05.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.024+0000 7f9dc22f3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9dbc152ed0 0x7f9dbc0b0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53450/0 (socket says 172.21.15.103:53450) 2020-04-22T14:13:05.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.024+0000 7f9dc1af2700 1 -- 172.21.15.103:0/3772104580 learned_addr learned my addr 172.21.15.103:0/3772104580 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:05.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.024+0000 7f9dc2af4700 1 --2- 172.21.15.103:0/3772104580 >> v2:172.21.15.86:3300/0 conn(0x7f9dbc1532b0 0x7f9dbc0b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:05.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.025+0000 7f9dc22f3700 1 -- 172.21.15.103:0/3772104580 >> v2:172.21.15.86:3300/0 conn(0x7f9dbc1532b0 msgr2=0x7f9dbc0b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:05.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.025+0000 7f9dc22f3700 1 --2- 172.21.15.103:0/3772104580 >> v2:172.21.15.86:3300/0 conn(0x7f9dbc1532b0 0x7f9dbc0b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:05.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.025+0000 7f9dc22f3700 1 -- 172.21.15.103:0/3772104580 >> v1:172.21.15.103:6789/0 conn(0x7f9dbc0ae860 legacy=0x7f9dbc128d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:05.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.025+0000 7f9dc22f3700 1 -- 172.21.15.103:0/3772104580 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dbc0afd50 con 0x7f9dbc152ed0 2020-04-22T14:13:05.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.025+0000 7f9dab7fe700 1 -- 172.21.15.103:0/3772104580 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 958686415 0 0) 0x7f9dbc0af8f0 con 0x7f9dbc0ae860 2020-04-22T14:13:05.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.025+0000 7f9dc22f3700 1 --2- 172.21.15.103:0/3772104580 >> v2:172.21.15.103:3300/0 conn(0x7f9dbc152ed0 0x7f9dbc0b0be0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9dac0013e0 tx=0x7f9dbc05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:05.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.025+0000 7f9dc22f3700 1 --2- 172.21.15.103:0/3772104580 >> v2:172.21.15.103:3300/0 conn(0x7f9dbc152ed0 0x7f9dbc0b0be0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9dac0013e0 tx=0x7f9dbc05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:05.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.025+0000 7f9dc22f3700 1 --2- 172.21.15.103:0/3772104580 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dbc152ed0 0x7f9dbc0b0be0 secure :-1 s=READY pgs=1197 cs=0 l=1 rx=0x7f9dac0013e0 tx=0x7f9dbc05bce0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:05.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.025+0000 7f9dc22f3700 1 --2- 172.21.15.103:0/3772104580 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dbc152ed0 0x7f9dbc0b0be0 secure :-1 s=THROTTLE_DONE pgs=1197 cs=0 l=1 rx=0x7f9dac0013e0 tx=0x7f9dbc05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:05.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.025+0000 7f9dab7fe700 1 -- 172.21.15.103:0/3772104580 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9dac00e660 con 0x7f9dbc152ed0 2020-04-22T14:13:05.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.025+0000 7f9dc22f3700 1 --2- 172.21.15.103:0/3772104580 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dbc152ed0 0x7f9dbc0b0be0 secure :-1 s=THROTTLE_DONE pgs=1197 cs=0 l=1 rx=0x7f9dac0013e0 tx=0x7f9dbc05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:05.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.025+0000 7f9dc22f3700 1 --2- 172.21.15.103:0/3772104580 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dbc152ed0 0x7f9dbc0b0be0 secure :-1 s=THROTTLE_DONE pgs=1197 cs=0 l=1 rx=0x7f9dac0013e0 tx=0x7f9dbc05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:05.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.025+0000 7f9dab7fe700 1 -- 172.21.15.103:0/3772104580 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dac0104c0 con 0x7f9dbc152ed0 2020-04-22T14:13:05.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.025+0000 7f9dc4557700 1 -- 172.21.15.103:0/3772104580 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dbc129430 con 0x7f9dbc152ed0 2020-04-22T14:13:05.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.025+0000 7f9dab7fe700 1 -- 172.21.15.103:0/3772104580 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9dac010820 con 0x7f9dbc152ed0 2020-04-22T14:13:05.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.025+0000 7f9dc4557700 1 -- 172.21.15.103:0/3772104580 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dbc0b2b20 con 0x7f9dbc152ed0 2020-04-22T14:13:05.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.026+0000 7f9dc22f3700 1 --2- 172.21.15.103:0/3772104580 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dbc152ed0 0x7f9dbc0b0be0 secure :-1 s=THROTTLE_DONE pgs=1197 cs=0 l=1 rx=0x7f9dac0013e0 tx=0x7f9dbc05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:05.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.026+0000 7f9dab7fe700 1 -- 172.21.15.103:0/3772104580 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f9dac0045b0 con 0x7f9dbc152ed0 2020-04-22T14:13:05.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.026+0000 7f9dc22f3700 1 --2- 172.21.15.103:0/3772104580 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dbc152ed0 0x7f9dbc0b0be0 secure :-1 s=THROTTLE_DONE pgs=1197 cs=0 l=1 rx=0x7f9dac0013e0 tx=0x7f9dbc05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:05.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.026+0000 7f9dc4557700 1 -- 172.21.15.103:0/3772104580 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dbc0affc0 con 0x7f9dbc152ed0 2020-04-22T14:13:05.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.026+0000 7f9dab7fe700 1 --2- 172.21.15.103:0/3772104580 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9d9c04d7a0 0x7f9d9c04fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:05.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.026+0000 7f9dab7fe700 1 -- 172.21.15.103:0/3772104580 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f9dac0637b0 con 0x7f9dbc152ed0 2020-04-22T14:13:05.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.027+0000 7f9dc1af2700 1 --2- 172.21.15.103:0/3772104580 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9d9c04d7a0 0x7f9d9c04fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:05.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.027+0000 7f9dc1af2700 1 --2- 172.21.15.103:0/3772104580 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9d9c04d7a0 0x7f9d9c04fc60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9db8008330 tx=0x7f9db800ca10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:05.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.027+0000 7f9dc1af2700 1 --2- 172.21.15.103:0/3772104580 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9d9c04d7a0 0x7f9d9c04fc60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9db8008330 tx=0x7f9db800ca10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:05.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.027+0000 7f9dc1af2700 1 --2- 172.21.15.103:0/3772104580 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9d9c04d7a0 0x7f9d9c04fc60 secure :-1 s=READY pgs=440 cs=0 l=1 rx=0x7f9db8008330 tx=0x7f9db800ca10).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:05.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.031+0000 7f9dc22f3700 1 --2- 172.21.15.103:0/3772104580 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dbc152ed0 0x7f9dbc0b0be0 secure :-1 s=THROTTLE_DONE pgs=1197 cs=0 l=1 rx=0x7f9dac0013e0 tx=0x7f9dbc05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:05.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.031+0000 7f9dab7fe700 1 -- 172.21.15.103:0/3772104580 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f9dac03ec10 con 0x7f9dbc152ed0 2020-04-22T14:13:05.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.219+0000 7f9dc4557700 1 -- 172.21.15.103:0/3772104580 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9dbc056c90 con 0x7f9dbc152ed0 2020-04-22T14:13:05.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.219+0000 7f9dc22f3700 1 --2- 172.21.15.103:0/3772104580 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dbc152ed0 0x7f9dbc0b0be0 secure :-1 s=THROTTLE_DONE pgs=1197 cs=0 l=1 rx=0x7f9dac0013e0 tx=0x7f9dbc05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:05.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.219+0000 7f9dab7fe700 1 -- 172.21.15.103:0/3772104580 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f9dac042230 con 0x7f9dbc152ed0 2020-04-22T14:13:05.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.220+0000 7f9dc4557700 1 -- 172.21.15.103:0/3772104580 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9d9c04d7a0 msgr2=0x7f9d9c04fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:05.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.220+0000 7f9dc4557700 1 --2- 172.21.15.103:0/3772104580 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9d9c04d7a0 0x7f9d9c04fc60 secure :-1 s=READY pgs=440 cs=0 l=1 rx=0x7f9db8008330 tx=0x7f9db800ca10).stop 2020-04-22T14:13:05.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.220+0000 7f9dc4557700 1 -- 172.21.15.103:0/3772104580 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dbc152ed0 msgr2=0x7f9dbc0b0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:05.225 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.220+0000 7f9dc4557700 1 --2- 172.21.15.103:0/3772104580 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dbc152ed0 0x7f9dbc0b0be0 secure :-1 s=READY pgs=1197 cs=0 l=1 rx=0x7f9dac0013e0 tx=0x7f9dbc05bce0).stop 2020-04-22T14:13:05.225 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.220+0000 7f9dc4557700 1 -- 172.21.15.103:0/3772104580 shutdown_connections 2020-04-22T14:13:05.225 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.220+0000 7f9dc4557700 1 --2- 172.21.15.103:0/3772104580 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9d9c04d7a0 0x7f9d9c04fc60 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:05.225 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.220+0000 7f9dc4557700 1 --2- 172.21.15.103:0/3772104580 >> v2:172.21.15.86:3300/0 conn(0x7f9dbc1532b0 0x7f9dbc0b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:05.225 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.220+0000 7f9dc4557700 1 --2- 172.21.15.103:0/3772104580 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dbc152ed0 0x7f9dbc0b0be0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:05.225 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.220+0000 7f9dc4557700 1 -- 172.21.15.103:0/3772104580 >> 172.21.15.103:0/3772104580 conn(0x7f9dbc0b9160 msgr2=0x7f9dbc0642a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:05.225 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.220+0000 7f9dc4557700 1 -- 172.21.15.103:0/3772104580 shutdown_connections 2020-04-22T14:13:05.225 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:05.220+0000 7f9dc4557700 1 -- 172.21.15.103:0/3772104580 wait complete. 2020-04-22T14:13:05.226 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:13:05.226 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:43.570838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:13:05.226 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 54 2020-04-22T14:13:05.233 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:13:06.235 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:06.252 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:13:06.408 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.405+0000 7f7ca8499700 1 Processor -- start 2020-04-22T14:13:06.408 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.405+0000 7f7ca8499700 1 -- start start 2020-04-22T14:13:06.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.406+0000 7f7ca8499700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ca0065fe0 0x7f7ca01464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:06.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.406+0000 7f7ca8499700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7ca0063e30 0x7f7ca00642a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:06.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.406+0000 7f7ca8499700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca0143300 con 0x7f7ca012c0d0 2020-04-22T14:13:06.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.406+0000 7f7ca8499700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca01435a0 con 0x7f7ca0063e30 2020-04-22T14:13:06.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.406+0000 7f7ca8499700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca0143840 con 0x7f7ca0065fe0 2020-04-22T14:13:06.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.406+0000 7f7ca6a36700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7ca0063e30 0x7f7ca00642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:06.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.406+0000 7f7ca6a36700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7ca0063e30 0x7f7ca00642a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53458/0 (socket says 172.21.15.103:53458) 2020-04-22T14:13:06.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.406+0000 7f7ca6a36700 1 -- 172.21.15.103:0/1122159439 learned_addr learned my addr 172.21.15.103:0/1122159439 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:06.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.406+0000 7f7ca5a34700 1 --2- 172.21.15.103:0/1122159439 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ca0065fe0 0x7f7ca01464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:06.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.406+0000 7f7ca6a36700 1 -- 172.21.15.103:0/1122159439 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ca0065fe0 msgr2=0x7f7ca01464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:06.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.406+0000 7f7ca6a36700 1 --2- 172.21.15.103:0/1122159439 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ca0065fe0 0x7f7ca01464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:06.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.406+0000 7f7ca6a36700 1 -- 172.21.15.103:0/1122159439 >> v1:172.21.15.86:6789/0 conn(0x7f7ca012c0d0 legacy=0x7f7ca005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:06.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.406+0000 7f7ca6a36700 1 -- 172.21.15.103:0/1122159439 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca005bb50 con 0x7f7ca0063e30 2020-04-22T14:13:06.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.406+0000 7f7ca6a36700 1 --2- 172.21.15.103:0/1122159439 >> v2:172.21.15.103:3300/0 conn(0x7f7ca0063e30 0x7f7ca00642a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7c90002f30 tx=0x7f7c90007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:06.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.406+0000 7f7ca6a36700 1 --2- 172.21.15.103:0/1122159439 >> v2:172.21.15.103:3300/0 conn(0x7f7ca0063e30 0x7f7ca00642a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7c90002f30 tx=0x7f7c90007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:06.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.406+0000 7f7ca6a36700 1 --2- 172.21.15.103:0/1122159439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ca0063e30 0x7f7ca00642a0 secure :-1 s=READY pgs=1198 cs=0 l=1 rx=0x7f7c90002f30 tx=0x7f7c90007a40).ready entity=mon.1 client_cookie=898c1ed27648f8fb server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:06.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.407+0000 7f7ca6a36700 1 --2- 172.21.15.103:0/1122159439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ca0063e30 0x7f7ca00642a0 secure :-1 s=THROTTLE_DONE pgs=1198 cs=0 l=1 rx=0x7f7c90002f30 tx=0x7f7c90007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:06.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.407+0000 7f7ca5233700 1 -- 172.21.15.103:0/1122159439 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c90011720 con 0x7f7ca0063e30 2020-04-22T14:13:06.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.407+0000 7f7ca6a36700 1 --2- 172.21.15.103:0/1122159439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ca0063e30 0x7f7ca00642a0 secure :-1 s=THROTTLE_DONE pgs=1198 cs=0 l=1 rx=0x7f7c90002f30 tx=0x7f7c90007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:06.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.407+0000 7f7ca6a36700 1 --2- 172.21.15.103:0/1122159439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ca0063e30 0x7f7ca00642a0 secure :-1 s=THROTTLE_DONE pgs=1198 cs=0 l=1 rx=0x7f7c90002f30 tx=0x7f7c90007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:06.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.407+0000 7f7ca5233700 1 -- 172.21.15.103:0/1122159439 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c900118c0 con 0x7f7ca0063e30 2020-04-22T14:13:06.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.407+0000 7f7ca5233700 1 -- 172.21.15.103:0/1122159439 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c90011ce0 con 0x7f7ca0063e30 2020-04-22T14:13:06.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.407+0000 7f7ca8499700 1 -- 172.21.15.103:0/1122159439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ca0063e30 msgr2=0x7f7ca00642a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:06.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.407+0000 7f7ca8499700 1 --2- 172.21.15.103:0/1122159439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ca0063e30 0x7f7ca00642a0 secure :-1 s=READY pgs=1198 cs=0 l=1 rx=0x7f7c90002f30 tx=0x7f7c90007a40).stop 2020-04-22T14:13:06.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.407+0000 7f7ca8499700 1 -- 172.21.15.103:0/1122159439 shutdown_connections 2020-04-22T14:13:06.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.407+0000 7f7ca8499700 1 --2- 172.21.15.103:0/1122159439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ca0063e30 0x7f7ca00642a0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:06.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.407+0000 7f7ca8499700 1 --2- 172.21.15.103:0/1122159439 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ca0065fe0 0x7f7ca01464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:06.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.407+0000 7f7ca8499700 1 -- 172.21.15.103:0/1122159439 >> 172.21.15.103:0/1122159439 conn(0x7f7ca00b9160 msgr2=0x7f7ca005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:06.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.407+0000 7f7ca8499700 1 -- 172.21.15.103:0/1122159439 shutdown_connections 2020-04-22T14:13:06.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.407+0000 7f7ca8499700 1 -- 172.21.15.103:0/1122159439 wait complete. 2020-04-22T14:13:06.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.408+0000 7f7ca8499700 1 Processor -- start 2020-04-22T14:13:06.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.408+0000 7f7ca8499700 1 -- start start 2020-04-22T14:13:06.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.409+0000 7f7ca8499700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ca0065fe0 0x7f7ca0129f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:06.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.409+0000 7f7ca8499700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7ca012c0d0 0x7f7ca00b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:06.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.409+0000 7f7ca8499700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca00b5920 con 0x7f7ca0063e30 2020-04-22T14:13:06.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.409+0000 7f7ca8499700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca0157280 con 0x7f7ca012c0d0 2020-04-22T14:13:06.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.409+0000 7f7ca8499700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca0157520 con 0x7f7ca0065fe0 2020-04-22T14:13:06.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.409+0000 7f7ca6235700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f7ca0063e30 0x7f7ca0141fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45654/0 (socket says 172.21.15.103:45654) 2020-04-22T14:13:06.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.409+0000 7f7ca6235700 1 -- 172.21.15.103:0/3179550188 learned_addr learned my addr 172.21.15.103:0/3179550188 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:06.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.409+0000 7f7ca5a34700 1 --2- 172.21.15.103:0/3179550188 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ca0065fe0 0x7f7ca0129f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:06.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.409+0000 7f7ca6a36700 1 --2- 172.21.15.103:0/3179550188 >> v2:172.21.15.86:3300/0 conn(0x7f7ca012c0d0 0x7f7ca00b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:06.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.409+0000 7f7c9f7fe700 1 -- 172.21.15.103:0/3179550188 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2773081546 0 0) 0x7f7ca0143300 con 0x7f7ca0063e30 2020-04-22T14:13:06.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.409+0000 7f7c9f7fe700 1 -- 172.21.15.103:0/3179550188 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c80002fe0 con 0x7f7ca0063e30 2020-04-22T14:13:06.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.409+0000 7f7c9f7fe700 1 -- 172.21.15.103:0/3179550188 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1371934885 0 0) 0x7f7c80002fe0 con 0x7f7ca0063e30 2020-04-22T14:13:06.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.409+0000 7f7c9f7fe700 1 -- 172.21.15.103:0/3179550188 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7ca0143300 con 0x7f7ca0063e30 2020-04-22T14:13:06.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.409+0000 7f7c9f7fe700 1 -- 172.21.15.103:0/3179550188 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f7c98001930 con 0x7f7ca0063e30 2020-04-22T14:13:06.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.410+0000 7f7c9f7fe700 1 -- 172.21.15.103:0/3179550188 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ca0065fe0 msgr2=0x7f7ca0129f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:06.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.410+0000 7f7c9f7fe700 1 --2- 172.21.15.103:0/3179550188 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ca0065fe0 0x7f7ca0129f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:06.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.410+0000 7f7c9f7fe700 1 -- 172.21.15.103:0/3179550188 >> v2:172.21.15.86:3300/0 conn(0x7f7ca012c0d0 msgr2=0x7f7ca00b54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:06.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.410+0000 7f7c9f7fe700 1 --2- 172.21.15.103:0/3179550188 >> v2:172.21.15.86:3300/0 conn(0x7f7ca012c0d0 0x7f7ca00b54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:06.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.410+0000 7f7c9f7fe700 1 -- 172.21.15.103:0/3179550188 >> v1:172.21.15.103:6789/0 conn(0x7f7ca0063e30 legacy=0x7f7ca0141fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:06.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.410+0000 7f7c9f7fe700 1 --2- 172.21.15.103:0/3179550188 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c800049b0 0x7f7c80004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:06.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.410+0000 7f7c9f7fe700 1 --2- 172.21.15.103:0/3179550188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c800052a0 0x7f7c800039c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:06.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.410+0000 7f7c9f7fe700 1 --2- 172.21.15.103:0/3179550188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c80003f30 0x7f7c80004370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:06.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.410+0000 7f7c9f7fe700 1 -- 172.21.15.103:0/3179550188 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca0157280 con 0x7f7c800052a0 2020-04-22T14:13:06.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.410+0000 7f7c9f7fe700 1 -- 172.21.15.103:0/3179550188 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca0157520 con 0x7f7c80003f30 2020-04-22T14:13:06.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.410+0000 7f7c9f7fe700 1 -- 172.21.15.103:0/3179550188 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8000b8e0 con 0x7f7c800049b0 2020-04-22T14:13:06.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.410+0000 7f7ca6a36700 1 --2- 172.21.15.103:0/3179550188 >> v2:172.21.15.86:3300/0 conn(0x7f7ca012c0d0 0x7f7ca00b54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:13:06.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.410+0000 7f7ca5a34700 1 --2- 172.21.15.103:0/3179550188 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ca0065fe0 0x7f7ca0129f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:13:06.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.410+0000 7f7ca6a36700 1 --2- 172.21.15.103:0/3179550188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c80003f30 0x7f7c80004370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:06.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.410+0000 7f7ca6235700 1 --2- 172.21.15.103:0/3179550188 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c800049b0 0x7f7c80004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:06.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.410+0000 7f7ca5a34700 1 --2- 172.21.15.103:0/3179550188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c800052a0 0x7f7c800039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:06.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.410+0000 7f7ca6a36700 1 -- 172.21.15.103:0/3179550188 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c800049b0 msgr2=0x7f7c80004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:06.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.410+0000 7f7ca6a36700 1 --2- 172.21.15.103:0/3179550188 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c800049b0 0x7f7c80004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:06.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.410+0000 7f7ca6a36700 1 -- 172.21.15.103:0/3179550188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c800052a0 msgr2=0x7f7c800039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:06.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.410+0000 7f7ca6a36700 1 --2- 172.21.15.103:0/3179550188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c800052a0 0x7f7c800039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:06.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.410+0000 7f7ca6a36700 1 -- 172.21.15.103:0/3179550188 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca01577c0 con 0x7f7c80003f30 2020-04-22T14:13:06.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.410+0000 7f7ca5a34700 1 --2- 172.21.15.103:0/3179550188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c800052a0 0x7f7c800039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:13:06.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.410+0000 7f7ca8499700 1 -- 172.21.15.103:0/3179550188 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca01426e0 con 0x7f7c80003f30 2020-04-22T14:13:06.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.410+0000 7f7ca6a36700 1 --2- 172.21.15.103:0/3179550188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c80003f30 0x7f7c80004370 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7c90002f30 tx=0x7f7c90007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:06.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.410+0000 7f7ca8499700 1 -- 172.21.15.103:0/3179550188 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca012a0c0 con 0x7f7c80003f30 2020-04-22T14:13:06.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.410+0000 7f7ca6a36700 1 --2- 172.21.15.103:0/3179550188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c80003f30 0x7f7c80004370 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7c90002f30 tx=0x7f7c90007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:06.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.410+0000 7f7ca6a36700 1 --2- 172.21.15.103:0/3179550188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c80003f30 0x7f7c80004370 secure :-1 s=READY pgs=1200 cs=0 l=1 rx=0x7f7c90002f30 tx=0x7f7c90007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:06.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.410+0000 7f7ca6a36700 1 --2- 172.21.15.103:0/3179550188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c80003f30 0x7f7c80004370 secure :-1 s=THROTTLE_DONE pgs=1200 cs=0 l=1 rx=0x7f7c90002f30 tx=0x7f7c90007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:06.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.410+0000 7f7c9f7fe700 1 -- 172.21.15.103:0/3179550188 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c90007360 con 0x7f7c80003f30 2020-04-22T14:13:06.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.410+0000 7f7ca6a36700 1 --2- 172.21.15.103:0/3179550188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c80003f30 0x7f7c80004370 secure :-1 s=THROTTLE_DONE pgs=1200 cs=0 l=1 rx=0x7f7c90002f30 tx=0x7f7c90007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:06.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.410+0000 7f7ca6a36700 1 --2- 172.21.15.103:0/3179550188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c80003f30 0x7f7c80004370 secure :-1 s=THROTTLE_DONE pgs=1200 cs=0 l=1 rx=0x7f7c90002f30 tx=0x7f7c90007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:06.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.410+0000 7f7c9f7fe700 1 -- 172.21.15.103:0/3179550188 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c900074c0 con 0x7f7c80003f30 2020-04-22T14:13:06.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.410+0000 7f7c9f7fe700 1 -- 172.21.15.103:0/3179550188 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c90007630 con 0x7f7c80003f30 2020-04-22T14:13:06.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.411+0000 7f7ca6a36700 1 --2- 172.21.15.103:0/3179550188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c80003f30 0x7f7c80004370 secure :-1 s=THROTTLE_DONE pgs=1200 cs=0 l=1 rx=0x7f7c90002f30 tx=0x7f7c90007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:06.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.411+0000 7f7c9f7fe700 1 -- 172.21.15.103:0/3179550188 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f7c900058b0 con 0x7f7c80003f30 2020-04-22T14:13:06.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.411+0000 7f7ca6a36700 1 --2- 172.21.15.103:0/3179550188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c80003f30 0x7f7c80004370 secure :-1 s=THROTTLE_DONE pgs=1200 cs=0 l=1 rx=0x7f7c90002f30 tx=0x7f7c90007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:06.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.411+0000 7f7ca8499700 1 -- 172.21.15.103:0/3179550188 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca0056c90 con 0x7f7c80003f30 2020-04-22T14:13:06.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.411+0000 7f7c9f7fe700 1 --2- 172.21.15.103:0/3179550188 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7c800560a0 0x7f7c80058560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:06.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.412+0000 7f7c9f7fe700 1 -- 172.21.15.103:0/3179550188 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f7c900620e0 con 0x7f7c80003f30 2020-04-22T14:13:06.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.412+0000 7f7ca6235700 1 --2- 172.21.15.103:0/3179550188 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7c800560a0 0x7f7c80058560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:06.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.412+0000 7f7ca6235700 1 --2- 172.21.15.103:0/3179550188 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7c800560a0 0x7f7c80058560 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7c98001640 tx=0x7f7c980054d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:06.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.412+0000 7f7ca6235700 1 --2- 172.21.15.103:0/3179550188 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7c800560a0 0x7f7c80058560 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7c98001640 tx=0x7f7c980054d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:06.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.412+0000 7f7ca6235700 1 --2- 172.21.15.103:0/3179550188 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7c800560a0 0x7f7c80058560 secure :-1 s=READY pgs=441 cs=0 l=1 rx=0x7f7c98001640 tx=0x7f7c980054d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:06.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.415+0000 7f7ca6a36700 1 --2- 172.21.15.103:0/3179550188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c80003f30 0x7f7c80004370 secure :-1 s=THROTTLE_DONE pgs=1200 cs=0 l=1 rx=0x7f7c90002f30 tx=0x7f7c90007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:06.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.415+0000 7f7c9f7fe700 1 -- 172.21.15.103:0/3179550188 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f7c9003d5e0 con 0x7f7c80003f30 2020-04-22T14:13:06.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.605+0000 7f7ca8499700 1 -- 172.21.15.103:0/3179550188 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ca0142870 con 0x7f7c80003f30 2020-04-22T14:13:06.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.605+0000 7f7ca6a36700 1 --2- 172.21.15.103:0/3179550188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c80003f30 0x7f7c80004370 secure :-1 s=THROTTLE_DONE pgs=1200 cs=0 l=1 rx=0x7f7c90002f30 tx=0x7f7c90007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:06.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.605+0000 7f7c9f7fe700 1 -- 172.21.15.103:0/3179550188 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f7ca0142870 con 0x7f7c80003f30 2020-04-22T14:13:06.609 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:13:06.609 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:43.570838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:13:06.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.607+0000 7f7ca8499700 1 -- 172.21.15.103:0/3179550188 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7c800560a0 msgr2=0x7f7c80058560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:06.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.607+0000 7f7ca8499700 1 --2- 172.21.15.103:0/3179550188 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7c800560a0 0x7f7c80058560 secure :-1 s=READY pgs=441 cs=0 l=1 rx=0x7f7c98001640 tx=0x7f7c980054d0).stop 2020-04-22T14:13:06.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.607+0000 7f7ca8499700 1 -- 172.21.15.103:0/3179550188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c80003f30 msgr2=0x7f7c80004370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:06.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.607+0000 7f7ca8499700 1 --2- 172.21.15.103:0/3179550188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c80003f30 0x7f7c80004370 secure :-1 s=READY pgs=1200 cs=0 l=1 rx=0x7f7c90002f30 tx=0x7f7c90007a40).stop 2020-04-22T14:13:06.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.607+0000 7f7ca6a36700 1 -- 172.21.15.103:0/3179550188 reap_dead start 2020-04-22T14:13:06.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.607+0000 7f7ca6a36700 1 -- 172.21.15.103:0/3179550188 reap_dead start 2020-04-22T14:13:06.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.607+0000 7f7ca8499700 1 -- 172.21.15.103:0/3179550188 shutdown_connections 2020-04-22T14:13:06.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.607+0000 7f7ca8499700 1 -- 172.21.15.103:0/3179550188 >> 172.21.15.103:0/3179550188 conn(0x7f7ca00b9160 msgr2=0x7f7ca012b200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:06.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.607+0000 7f7ca8499700 1 -- 172.21.15.103:0/3179550188 shutdown_connections 2020-04-22T14:13:06.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:06.607+0000 7f7ca8499700 1 -- 172.21.15.103:0/3179550188 wait complete. 2020-04-22T14:13:06.612 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 54 2020-04-22T14:13:06.628 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:13:07.628 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:07.645 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:13:07.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.800+0000 7fe94b4e5700 1 Processor -- start 2020-04-22T14:13:07.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.800+0000 7fe94b4e5700 1 -- start start 2020-04-22T14:13:07.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.801+0000 7fe94b4e5700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe94412c0d0 0x7fe9441464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:07.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.801+0000 7fe94b4e5700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe944143300 con 0x7fe944063e30 2020-04-22T14:13:07.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.801+0000 7fe94b4e5700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9441435a0 con 0x7fe944065fe0 2020-04-22T14:13:07.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.801+0000 7fe94b4e5700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe944143840 con 0x7fe94412c0d0 2020-04-22T14:13:07.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.801+0000 7fe949281700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe94412c0d0 0x7fe9441464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:07.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.801+0000 7fe948a80700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe944065fe0 0x7fe94405b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45668/0 (socket says 172.21.15.103:45668) 2020-04-22T14:13:07.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.801+0000 7fe948a80700 1 -- 172.21.15.103:0/2448516370 learned_addr learned my addr 172.21.15.103:0/2448516370 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:07.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.801+0000 7fe949281700 1 -- 172.21.15.103:0/2448516370 >> v1:172.21.15.103:6789/0 conn(0x7fe944065fe0 legacy=0x7fe94405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:07.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.801+0000 7fe949281700 1 -- 172.21.15.103:0/2448516370 >> v1:172.21.15.86:6789/0 conn(0x7fe944063e30 legacy=0x7fe9440642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:07.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.801+0000 7fe933fff700 1 -- 172.21.15.103:0/2448516370 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 628440745 0 0) 0x7fe9441435a0 con 0x7fe944065fe0 2020-04-22T14:13:07.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.801+0000 7fe949281700 1 -- 172.21.15.103:0/2448516370 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe94405bb50 con 0x7fe94412c0d0 2020-04-22T14:13:07.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.801+0000 7fe949281700 1 --2- 172.21.15.103:0/2448516370 >> v2:172.21.15.103:3300/0 conn(0x7fe94412c0d0 0x7fe9441464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe940002f30 tx=0x7fe940007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:07.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.801+0000 7fe949281700 1 --2- 172.21.15.103:0/2448516370 >> v2:172.21.15.103:3300/0 conn(0x7fe94412c0d0 0x7fe9441464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe940002f30 tx=0x7fe940007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:07.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.802+0000 7fe949281700 1 --2- 172.21.15.103:0/2448516370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe94412c0d0 0x7fe9441464e0 secure :-1 s=READY pgs=1202 cs=0 l=1 rx=0x7fe940002f30 tx=0x7fe940007a40).ready entity=mon.1 client_cookie=6f51a0acf2d2b370 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:07.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.802+0000 7fe949281700 1 --2- 172.21.15.103:0/2448516370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe94412c0d0 0x7fe9441464e0 secure :-1 s=THROTTLE_DONE pgs=1202 cs=0 l=1 rx=0x7fe940002f30 tx=0x7fe940007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:07.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.802+0000 7fe933fff700 1 -- 172.21.15.103:0/2448516370 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe940011470 con 0x7fe94412c0d0 2020-04-22T14:13:07.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.802+0000 7fe949281700 1 --2- 172.21.15.103:0/2448516370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe94412c0d0 0x7fe9441464e0 secure :-1 s=THROTTLE_DONE pgs=1202 cs=0 l=1 rx=0x7fe940002f30 tx=0x7fe940007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:07.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.802+0000 7fe949281700 1 --2- 172.21.15.103:0/2448516370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe94412c0d0 0x7fe9441464e0 secure :-1 s=THROTTLE_DONE pgs=1202 cs=0 l=1 rx=0x7fe940002f30 tx=0x7fe940007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:07.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.802+0000 7fe933fff700 1 -- 172.21.15.103:0/2448516370 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9400115d0 con 0x7fe94412c0d0 2020-04-22T14:13:07.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.802+0000 7fe933fff700 1 -- 172.21.15.103:0/2448516370 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9400119f0 con 0x7fe94412c0d0 2020-04-22T14:13:07.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.802+0000 7fe94b4e5700 1 -- 172.21.15.103:0/2448516370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe94412c0d0 msgr2=0x7fe9441464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:07.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.802+0000 7fe94b4e5700 1 --2- 172.21.15.103:0/2448516370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe94412c0d0 0x7fe9441464e0 secure :-1 s=READY pgs=1202 cs=0 l=1 rx=0x7fe940002f30 tx=0x7fe940007a40).stop 2020-04-22T14:13:07.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.802+0000 7fe94b4e5700 1 -- 172.21.15.103:0/2448516370 shutdown_connections 2020-04-22T14:13:07.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.802+0000 7fe94b4e5700 1 --2- 172.21.15.103:0/2448516370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe94412c0d0 0x7fe9441464e0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:07.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.802+0000 7fe94b4e5700 1 -- 172.21.15.103:0/2448516370 >> 172.21.15.103:0/2448516370 conn(0x7fe9440b9160 msgr2=0x7fe94405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:07.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.802+0000 7fe94b4e5700 1 -- 172.21.15.103:0/2448516370 shutdown_connections 2020-04-22T14:13:07.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.802+0000 7fe94b4e5700 1 -- 172.21.15.103:0/2448516370 wait complete. 2020-04-22T14:13:07.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.803+0000 7fe94b4e5700 1 Processor -- start 2020-04-22T14:13:07.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.803+0000 7fe94b4e5700 1 -- start start 2020-04-22T14:13:07.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.804+0000 7fe94b4e5700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe944065fe0 0x7fe944151570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:07.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.804+0000 7fe94b4e5700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe94412c0d0 0x7fe944062ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:07.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.804+0000 7fe94b4e5700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe944063300 con 0x7fe944063e30 2020-04-22T14:13:07.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.804+0000 7fe94b4e5700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9440b4150 con 0x7fe94412c0d0 2020-04-22T14:13:07.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.804+0000 7fe94b4e5700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9440b43f0 con 0x7fe944065fe0 2020-04-22T14:13:07.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.804+0000 7fe949a82700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe94412c0d0 0x7fe944062ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:07.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.804+0000 7fe949281700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe944063e30 0x7fe9440b02c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45672/0 (socket says 172.21.15.103:45672) 2020-04-22T14:13:07.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.804+0000 7fe949281700 1 -- 172.21.15.103:0/2611055517 learned_addr learned my addr 172.21.15.103:0/2611055517 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:07.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.804+0000 7fe948a80700 1 --2- 172.21.15.103:0/2611055517 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe944065fe0 0x7fe944151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:07.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.804+0000 7fe949a82700 1 -- 172.21.15.103:0/2611055517 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe944065fe0 msgr2=0x7fe944151570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:07.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.804+0000 7fe949a82700 1 --2- 172.21.15.103:0/2611055517 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe944065fe0 0x7fe944151570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:07.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.804+0000 7fe949a82700 1 -- 172.21.15.103:0/2611055517 >> v1:172.21.15.103:6789/0 conn(0x7fe944063e30 legacy=0x7fe9440b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:07.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.804+0000 7fe9327fc700 1 -- 172.21.15.103:0/2611055517 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 231757072 0 0) 0x7fe94405bb50 con 0x7fe944063e30 2020-04-22T14:13:07.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.804+0000 7fe949a82700 1 -- 172.21.15.103:0/2611055517 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9440b3a10 con 0x7fe94412c0d0 2020-04-22T14:13:07.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.805+0000 7fe949a82700 1 --2- 172.21.15.103:0/2611055517 >> v2:172.21.15.103:3300/0 conn(0x7fe94412c0d0 0x7fe944062ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe9440669a0 tx=0x7fe93c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:07.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.805+0000 7fe949a82700 1 --2- 172.21.15.103:0/2611055517 >> v2:172.21.15.103:3300/0 conn(0x7fe94412c0d0 0x7fe944062ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe9440669a0 tx=0x7fe93c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:07.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.805+0000 7fe949a82700 1 --2- 172.21.15.103:0/2611055517 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe94412c0d0 0x7fe944062ea0 secure :-1 s=READY pgs=1204 cs=0 l=1 rx=0x7fe9440669a0 tx=0x7fe93c010c50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:07.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.805+0000 7fe949a82700 1 --2- 172.21.15.103:0/2611055517 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe94412c0d0 0x7fe944062ea0 secure :-1 s=THROTTLE_DONE pgs=1204 cs=0 l=1 rx=0x7fe9440669a0 tx=0x7fe93c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:07.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.805+0000 7fe9327fc700 1 -- 172.21.15.103:0/2611055517 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe93c0122f0 con 0x7fe94412c0d0 2020-04-22T14:13:07.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.805+0000 7fe949a82700 1 --2- 172.21.15.103:0/2611055517 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe94412c0d0 0x7fe944062ea0 secure :-1 s=THROTTLE_DONE pgs=1204 cs=0 l=1 rx=0x7fe9440669a0 tx=0x7fe93c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:07.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.805+0000 7fe949a82700 1 --2- 172.21.15.103:0/2611055517 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe94412c0d0 0x7fe944062ea0 secure :-1 s=THROTTLE_DONE pgs=1204 cs=0 l=1 rx=0x7fe9440669a0 tx=0x7fe93c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:07.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.805+0000 7fe9327fc700 1 -- 172.21.15.103:0/2611055517 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe93c012450 con 0x7fe94412c0d0 2020-04-22T14:13:07.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.805+0000 7fe94b4e5700 1 -- 172.21.15.103:0/2611055517 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9440b3c60 con 0x7fe94412c0d0 2020-04-22T14:13:07.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.805+0000 7fe9327fc700 1 -- 172.21.15.103:0/2611055517 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe93c012830 con 0x7fe94412c0d0 2020-04-22T14:13:07.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.805+0000 7fe94b4e5700 1 -- 172.21.15.103:0/2611055517 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9440adbc0 con 0x7fe94412c0d0 2020-04-22T14:13:07.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.805+0000 7fe949a82700 1 --2- 172.21.15.103:0/2611055517 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe94412c0d0 0x7fe944062ea0 secure :-1 s=THROTTLE_DONE pgs=1204 cs=0 l=1 rx=0x7fe9440669a0 tx=0x7fe93c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:07.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.806+0000 7fe9327fc700 1 -- 172.21.15.103:0/2611055517 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fe93c012aa0 con 0x7fe94412c0d0 2020-04-22T14:13:07.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.806+0000 7fe949a82700 1 --2- 172.21.15.103:0/2611055517 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe94412c0d0 0x7fe944062ea0 secure :-1 s=THROTTLE_DONE pgs=1204 cs=0 l=1 rx=0x7fe9440669a0 tx=0x7fe93c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:07.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.806+0000 7fe94b4e5700 1 -- 172.21.15.103:0/2611055517 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9440b45f0 con 0x7fe94412c0d0 2020-04-22T14:13:07.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.806+0000 7fe9327fc700 1 --2- 172.21.15.103:0/2611055517 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe92404fa80 0x7fe924051f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:07.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.806+0000 7fe9327fc700 1 -- 172.21.15.103:0/2611055517 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fe93c0619d0 con 0x7fe94412c0d0 2020-04-22T14:13:07.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.806+0000 7fe949281700 1 --2- 172.21.15.103:0/2611055517 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe92404fa80 0x7fe924051f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:07.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.807+0000 7fe949281700 1 --2- 172.21.15.103:0/2611055517 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe92404fa80 0x7fe924051f40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe9400078a0 tx=0x7fe940007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:07.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.807+0000 7fe949281700 1 --2- 172.21.15.103:0/2611055517 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe92404fa80 0x7fe924051f40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe9400078a0 tx=0x7fe940007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:07.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.807+0000 7fe949281700 1 --2- 172.21.15.103:0/2611055517 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe92404fa80 0x7fe924051f40 secure :-1 s=READY pgs=442 cs=0 l=1 rx=0x7fe9400078a0 tx=0x7fe940007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:07.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.810+0000 7fe949a82700 1 --2- 172.21.15.103:0/2611055517 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe94412c0d0 0x7fe944062ea0 secure :-1 s=THROTTLE_DONE pgs=1204 cs=0 l=1 rx=0x7fe9440669a0 tx=0x7fe93c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:07.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:07.810+0000 7fe9327fc700 1 -- 172.21.15.103:0/2611055517 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fe93c03cdb0 con 0x7fe94412c0d0 2020-04-22T14:13:08.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:08.003+0000 7fe94b4e5700 1 -- 172.21.15.103:0/2611055517 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe9440b3f40 con 0x7fe94412c0d0 2020-04-22T14:13:08.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:08.003+0000 7fe949a82700 1 --2- 172.21.15.103:0/2611055517 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe94412c0d0 0x7fe944062ea0 secure :-1 s=THROTTLE_DONE pgs=1204 cs=0 l=1 rx=0x7fe9440669a0 tx=0x7fe93c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:08.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:08.004+0000 7fe9327fc700 1 -- 172.21.15.103:0/2611055517 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2147 (secure 0 0 0) 0x7fe93c0403d0 con 0x7fe94412c0d0 2020-04-22T14:13:08.007 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:13:08.007 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:43.570838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:13:08.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:08.005+0000 7fe94b4e5700 1 -- 172.21.15.103:0/2611055517 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe92404fa80 msgr2=0x7fe924051f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:08.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:08.005+0000 7fe94b4e5700 1 --2- 172.21.15.103:0/2611055517 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe92404fa80 0x7fe924051f40 secure :-1 s=READY pgs=442 cs=0 l=1 rx=0x7fe9400078a0 tx=0x7fe940007a40).stop 2020-04-22T14:13:08.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:08.005+0000 7fe94b4e5700 1 -- 172.21.15.103:0/2611055517 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe94412c0d0 msgr2=0x7fe944062ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:08.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:08.005+0000 7fe94b4e5700 1 --2- 172.21.15.103:0/2611055517 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe94412c0d0 0x7fe944062ea0 secure :-1 s=READY pgs=1204 cs=0 l=1 rx=0x7fe9440669a0 tx=0x7fe93c010c50).stop 2020-04-22T14:13:08.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:08.005+0000 7fe94b4e5700 1 -- 172.21.15.103:0/2611055517 shutdown_connections 2020-04-22T14:13:08.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:08.005+0000 7fe94b4e5700 1 --2- 172.21.15.103:0/2611055517 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe92404fa80 0x7fe924051f40 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:08.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:08.005+0000 7fe94b4e5700 1 --2- 172.21.15.103:0/2611055517 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe94412c0d0 0x7fe944062ea0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:08.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:08.005+0000 7fe94b4e5700 1 --2- 172.21.15.103:0/2611055517 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe944065fe0 0x7fe944151570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:08.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:08.005+0000 7fe94b4e5700 1 -- 172.21.15.103:0/2611055517 >> 172.21.15.103:0/2611055517 conn(0x7fe9440b9160 msgr2=0x7fe9440645b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:08.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:08.005+0000 7fe94b4e5700 1 -- 172.21.15.103:0/2611055517 shutdown_connections 2020-04-22T14:13:08.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:08.005+0000 7fe94b4e5700 1 -- 172.21.15.103:0/2611055517 wait complete. 2020-04-22T14:13:08.010 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 54 2020-04-22T14:13:08.018 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:13:09.019 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:09.035 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:13:09.192 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.188+0000 7f5a36f85700 1 Processor -- start 2020-04-22T14:13:09.192 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.188+0000 7f5a36f85700 1 -- start start 2020-04-22T14:13:09.194 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.189+0000 7f5a36f85700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a3012c0d0 0x7f5a301464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:09.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.189+0000 7f5a36f85700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5a30065fe0 0x7f5a3005b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:09.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.189+0000 7f5a36f85700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a30143300 con 0x7f5a3005b8a0 2020-04-22T14:13:09.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.189+0000 7f5a36f85700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a3012c4b0 con 0x7f5a30065fe0 2020-04-22T14:13:09.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.189+0000 7f5a36f85700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a301435a0 con 0x7f5a3012c0d0 2020-04-22T14:13:09.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.190+0000 7f5a2ffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5a30065fe0 0x7f5a3005b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:09.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.190+0000 7f5a34d21700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a3012c0d0 0x7f5a301464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:09.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.190+0000 7f5a35522700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f5a3005b8a0 0x7f5a30062ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:34604/0 (socket says 172.21.15.103:34604) 2020-04-22T14:13:09.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.190+0000 7f5a35522700 1 -- 172.21.15.103:0/3424563223 learned_addr learned my addr 172.21.15.103:0/3424563223 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:09.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.190+0000 7f5a2f7fe700 1 -- 172.21.15.103:0/3424563223 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 671776383 0 0) 0x7f5a30143300 con 0x7f5a3005b8a0 2020-04-22T14:13:09.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.190+0000 7f5a2f7fe700 1 -- 172.21.15.103:0/3424563223 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a1c003230 con 0x7f5a3005b8a0 2020-04-22T14:13:09.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.190+0000 7f5a34d21700 1 -- 172.21.15.103:0/3424563223 >> v2:172.21.15.86:3300/0 conn(0x7f5a30065fe0 msgr2=0x7f5a3005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:09.197 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.190+0000 7f5a34d21700 1 --2- 172.21.15.103:0/3424563223 >> v2:172.21.15.86:3300/0 conn(0x7f5a30065fe0 0x7f5a3005b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:09.197 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.190+0000 7f5a34d21700 1 -- 172.21.15.103:0/3424563223 >> v1:172.21.15.86:6789/0 conn(0x7f5a3005b8a0 legacy=0x7f5a30062ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:09.197 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.190+0000 7f5a34d21700 1 -- 172.21.15.103:0/3424563223 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a30143840 con 0x7f5a3012c0d0 2020-04-22T14:13:09.197 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.190+0000 7f5a2ffff700 1 --2- 172.21.15.103:0/3424563223 >> v2:172.21.15.86:3300/0 conn(0x7f5a30065fe0 0x7f5a3005b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:13:09.197 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.190+0000 7f5a34d21700 1 --2- 172.21.15.103:0/3424563223 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a3012c0d0 0x7f5a301464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5a20002f30 tx=0x7f5a20007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:09.197 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.190+0000 7f5a34d21700 1 --2- 172.21.15.103:0/3424563223 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a3012c0d0 0x7f5a301464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5a20002f30 tx=0x7f5a20007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:09.197 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.190+0000 7f5a34d21700 1 --2- 172.21.15.103:0/3424563223 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a3012c0d0 0x7f5a301464e0 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7f5a20002f30 tx=0x7f5a20007a40).ready entity=mon.2 client_cookie=9681c4c06933c712 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:09.197 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.190+0000 7f5a34d21700 1 --2- 172.21.15.103:0/3424563223 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a3012c0d0 0x7f5a301464e0 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f5a20002f30 tx=0x7f5a20007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:09.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.190+0000 7f5a2f7fe700 1 -- 172.21.15.103:0/3424563223 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a20011310 con 0x7f5a3012c0d0 2020-04-22T14:13:09.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.190+0000 7f5a34d21700 1 --2- 172.21.15.103:0/3424563223 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a3012c0d0 0x7f5a301464e0 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f5a20002f30 tx=0x7f5a20007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:09.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.190+0000 7f5a34d21700 1 --2- 172.21.15.103:0/3424563223 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a3012c0d0 0x7f5a301464e0 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f5a20002f30 tx=0x7f5a20007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:09.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.190+0000 7f5a2f7fe700 1 -- 172.21.15.103:0/3424563223 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a200114b0 con 0x7f5a3012c0d0 2020-04-22T14:13:09.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.190+0000 7f5a2f7fe700 1 -- 172.21.15.103:0/3424563223 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a20011890 con 0x7f5a3012c0d0 2020-04-22T14:13:09.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.191+0000 7f5a36f85700 1 -- 172.21.15.103:0/3424563223 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a3012c0d0 msgr2=0x7f5a301464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:09.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.191+0000 7f5a36f85700 1 --2- 172.21.15.103:0/3424563223 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a3012c0d0 0x7f5a301464e0 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7f5a20002f30 tx=0x7f5a20007a40).stop 2020-04-22T14:13:09.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.191+0000 7f5a36f85700 1 -- 172.21.15.103:0/3424563223 shutdown_connections 2020-04-22T14:13:09.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.191+0000 7f5a36f85700 1 --2- 172.21.15.103:0/3424563223 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a3012c0d0 0x7f5a301464e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:09.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.191+0000 7f5a36f85700 1 --2- 172.21.15.103:0/3424563223 >> v2:172.21.15.86:3300/0 conn(0x7f5a30065fe0 0x7f5a3005b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:09.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.191+0000 7f5a36f85700 1 -- 172.21.15.103:0/3424563223 >> 172.21.15.103:0/3424563223 conn(0x7f5a300b9160 msgr2=0x7f5a3005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:09.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.191+0000 7f5a36f85700 1 -- 172.21.15.103:0/3424563223 shutdown_connections 2020-04-22T14:13:09.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.191+0000 7f5a36f85700 1 -- 172.21.15.103:0/3424563223 wait complete. 2020-04-22T14:13:09.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.192+0000 7f5a36f85700 1 Processor -- start 2020-04-22T14:13:09.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.192+0000 7f5a36f85700 1 -- start start 2020-04-22T14:13:09.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.193+0000 7f5a36f85700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a3005b8a0 0x7f5a300b7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:09.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.193+0000 7f5a36f85700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5a30065fe0 0x7f5a300ae950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:09.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.193+0000 7f5a36f85700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a300af260 con 0x7f5a3012c0d0 2020-04-22T14:13:09.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.193+0000 7f5a36f85700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a300b2d00 con 0x7f5a30065fe0 2020-04-22T14:13:09.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.193+0000 7f5a36f85700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a300af500 con 0x7f5a3005b8a0 2020-04-22T14:13:09.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.193+0000 7f5a2ffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5a30065fe0 0x7f5a300ae950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:09.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.193+0000 7f5a35522700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f5a3012c0d0 0x7f5a30126df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45688/0 (socket says 172.21.15.103:45688) 2020-04-22T14:13:09.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.193+0000 7f5a35522700 1 -- 172.21.15.103:0/339509852 learned_addr learned my addr 172.21.15.103:0/339509852 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:09.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.193+0000 7f5a34d21700 1 --2- 172.21.15.103:0/339509852 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a3005b8a0 0x7f5a300b7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:09.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.193+0000 7f5a2ffff700 1 -- 172.21.15.103:0/339509852 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a3005b8a0 msgr2=0x7f5a300b7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:09.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.193+0000 7f5a2ffff700 1 --2- 172.21.15.103:0/339509852 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a3005b8a0 0x7f5a300b7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:09.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.193+0000 7f5a2ffff700 1 -- 172.21.15.103:0/339509852 >> v1:172.21.15.103:6789/0 conn(0x7f5a3012c0d0 legacy=0x7f5a30126df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:09.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.193+0000 7f5a2dffb700 1 -- 172.21.15.103:0/339509852 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 125626946 0 0) 0x7f5a300af260 con 0x7f5a3012c0d0 2020-04-22T14:13:09.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.193+0000 7f5a2ffff700 1 -- 172.21.15.103:0/339509852 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a300af7a0 con 0x7f5a30065fe0 2020-04-22T14:13:09.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.193+0000 7f5a34d21700 1 --2- 172.21.15.103:0/339509852 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a3005b8a0 0x7f5a300b7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:13:09.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.193+0000 7f5a2ffff700 1 --2- 172.21.15.103:0/339509852 >> v2:172.21.15.103:3300/0 conn(0x7f5a30065fe0 0x7f5a300ae950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5a24002f30 tx=0x7f5a24010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:09.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.193+0000 7f5a2ffff700 1 --2- 172.21.15.103:0/339509852 >> v2:172.21.15.103:3300/0 conn(0x7f5a30065fe0 0x7f5a300ae950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5a24002f30 tx=0x7f5a24010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:09.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.193+0000 7f5a2ffff700 1 --2- 172.21.15.103:0/339509852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a30065fe0 0x7f5a300ae950 secure :-1 s=READY pgs=1206 cs=0 l=1 rx=0x7f5a24002f30 tx=0x7f5a24010e30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:09.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.194+0000 7f5a2ffff700 1 --2- 172.21.15.103:0/339509852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a30065fe0 0x7f5a300ae950 secure :-1 s=THROTTLE_DONE pgs=1206 cs=0 l=1 rx=0x7f5a24002f30 tx=0x7f5a24010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:09.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.194+0000 7f5a2dffb700 1 -- 172.21.15.103:0/339509852 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a24012980 con 0x7f5a30065fe0 2020-04-22T14:13:09.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.194+0000 7f5a2ffff700 1 --2- 172.21.15.103:0/339509852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a30065fe0 0x7f5a300ae950 secure :-1 s=THROTTLE_DONE pgs=1206 cs=0 l=1 rx=0x7f5a24002f30 tx=0x7f5a24010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:09.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.194+0000 7f5a2ffff700 1 --2- 172.21.15.103:0/339509852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a30065fe0 0x7f5a300ae950 secure :-1 s=THROTTLE_DONE pgs=1206 cs=0 l=1 rx=0x7f5a24002f30 tx=0x7f5a24010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:09.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.194+0000 7f5a2dffb700 1 -- 172.21.15.103:0/339509852 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a24012b20 con 0x7f5a30065fe0 2020-04-22T14:13:09.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.194+0000 7f5a36f85700 1 -- 172.21.15.103:0/339509852 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a300b2ec0 con 0x7f5a30065fe0 2020-04-22T14:13:09.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.194+0000 7f5a2dffb700 1 -- 172.21.15.103:0/339509852 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a240056c0 con 0x7f5a30065fe0 2020-04-22T14:13:09.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.194+0000 7f5a36f85700 1 -- 172.21.15.103:0/339509852 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a300aedb0 con 0x7f5a30065fe0 2020-04-22T14:13:09.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.194+0000 7f5a2ffff700 1 --2- 172.21.15.103:0/339509852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a30065fe0 0x7f5a300ae950 secure :-1 s=THROTTLE_DONE pgs=1206 cs=0 l=1 rx=0x7f5a24002f30 tx=0x7f5a24010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:09.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.195+0000 7f5a36f85700 1 -- 172.21.15.103:0/339509852 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a300af090 con 0x7f5a30065fe0 2020-04-22T14:13:09.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.195+0000 7f5a2dffb700 1 -- 172.21.15.103:0/339509852 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f5a240071a0 con 0x7f5a30065fe0 2020-04-22T14:13:09.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.195+0000 7f5a2ffff700 1 --2- 172.21.15.103:0/339509852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a30065fe0 0x7f5a300ae950 secure :-1 s=THROTTLE_DONE pgs=1206 cs=0 l=1 rx=0x7f5a24002f30 tx=0x7f5a24010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:09.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.195+0000 7f5a2dffb700 1 --2- 172.21.15.103:0/339509852 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5a1004d8b0 0x7f5a1004fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:09.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.195+0000 7f5a2dffb700 1 -- 172.21.15.103:0/339509852 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f5a240612b0 con 0x7f5a30065fe0 2020-04-22T14:13:09.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.195+0000 7f5a34d21700 1 --2- 172.21.15.103:0/339509852 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5a1004d8b0 0x7f5a1004fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:09.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.195+0000 7f5a34d21700 1 --2- 172.21.15.103:0/339509852 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5a1004d8b0 0x7f5a1004fd70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5a20002f30 tx=0x7f5a20007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:09.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.196+0000 7f5a34d21700 1 --2- 172.21.15.103:0/339509852 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5a1004d8b0 0x7f5a1004fd70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5a20002f30 tx=0x7f5a20007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:09.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.196+0000 7f5a34d21700 1 --2- 172.21.15.103:0/339509852 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5a1004d8b0 0x7f5a1004fd70 secure :-1 s=READY pgs=443 cs=0 l=1 rx=0x7f5a20002f30 tx=0x7f5a20007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:09.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.199+0000 7f5a2ffff700 1 --2- 172.21.15.103:0/339509852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a30065fe0 0x7f5a300ae950 secure :-1 s=THROTTLE_DONE pgs=1206 cs=0 l=1 rx=0x7f5a24002f30 tx=0x7f5a24010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:09.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.199+0000 7f5a2dffb700 1 -- 172.21.15.103:0/339509852 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f5a2403c6f0 con 0x7f5a30065fe0 2020-04-22T14:13:09.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.387+0000 7f5a36f85700 1 -- 172.21.15.103:0/339509852 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a30056c90 con 0x7f5a30065fe0 2020-04-22T14:13:09.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.388+0000 7f5a2ffff700 1 --2- 172.21.15.103:0/339509852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a30065fe0 0x7f5a300ae950 secure :-1 s=THROTTLE_DONE pgs=1206 cs=0 l=1 rx=0x7f5a24002f30 tx=0x7f5a24010e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:09.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.388+0000 7f5a2dffb700 1 -- 172.21.15.103:0/339509852 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f5a2403fd10 con 0x7f5a30065fe0 2020-04-22T14:13:09.391 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:13:09.392 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:43.570838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:13:09.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.389+0000 7f5a36f85700 1 -- 172.21.15.103:0/339509852 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5a1004d8b0 msgr2=0x7f5a1004fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:09.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.389+0000 7f5a36f85700 1 --2- 172.21.15.103:0/339509852 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5a1004d8b0 0x7f5a1004fd70 secure :-1 s=READY pgs=443 cs=0 l=1 rx=0x7f5a20002f30 tx=0x7f5a20007a40).stop 2020-04-22T14:13:09.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.389+0000 7f5a36f85700 1 -- 172.21.15.103:0/339509852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a30065fe0 msgr2=0x7f5a300ae950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:09.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.389+0000 7f5a36f85700 1 --2- 172.21.15.103:0/339509852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a30065fe0 0x7f5a300ae950 secure :-1 s=READY pgs=1206 cs=0 l=1 rx=0x7f5a24002f30 tx=0x7f5a24010e30).stop 2020-04-22T14:13:09.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.389+0000 7f5a36f85700 1 -- 172.21.15.103:0/339509852 shutdown_connections 2020-04-22T14:13:09.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.389+0000 7f5a36f85700 1 --2- 172.21.15.103:0/339509852 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5a1004d8b0 0x7f5a1004fd70 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:09.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.389+0000 7f5a36f85700 1 --2- 172.21.15.103:0/339509852 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a3005b8a0 0x7f5a300b7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:09.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.389+0000 7f5a36f85700 1 --2- 172.21.15.103:0/339509852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a30065fe0 0x7f5a300ae950 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:09.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.389+0000 7f5a36f85700 1 -- 172.21.15.103:0/339509852 >> 172.21.15.103:0/339509852 conn(0x7f5a300b9160 msgr2=0x7f5a3012b000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:09.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.389+0000 7f5a36f85700 1 -- 172.21.15.103:0/339509852 shutdown_connections 2020-04-22T14:13:09.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:09.389+0000 7f5a36f85700 1 -- 172.21.15.103:0/339509852 wait complete. 2020-04-22T14:13:09.394 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 54 2020-04-22T14:13:09.403 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:13:10.405 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:10.422 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:13:10.582 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.575+0000 7f1d673a1700 1 Processor -- start 2020-04-22T14:13:10.582 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.575+0000 7f1d673a1700 1 -- start start 2020-04-22T14:13:10.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.576+0000 7f1d673a1700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1d600620a0 0x7f1d60142e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:10.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.576+0000 7f1d673a1700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d60143280 0x7f1d60146ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:10.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.576+0000 7f1d673a1700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d60143810 con 0x7f1d60146f30 2020-04-22T14:13:10.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.576+0000 7f1d673a1700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d601473e0 con 0x7f1d600620a0 2020-04-22T14:13:10.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.576+0000 7f1d673a1700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d60143ab0 con 0x7f1d60143280 2020-04-22T14:13:10.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.577+0000 7f1d6639f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1d600620a0 0x7f1d60142e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:10.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.577+0000 7f1d65b9e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d60143280 0x7f1d60146ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:10.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.577+0000 7f1d66ba0700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f1d60146f30 0x7f1d60063a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:34616/0 (socket says 172.21.15.103:34616) 2020-04-22T14:13:10.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.577+0000 7f1d66ba0700 1 -- 172.21.15.103:0/171282522 learned_addr learned my addr 172.21.15.103:0/171282522 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:10.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.577+0000 7f1d6639f700 1 -- 172.21.15.103:0/171282522 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d60143280 msgr2=0x7f1d60146ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:10.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.577+0000 7f1d6639f700 1 --2- 172.21.15.103:0/171282522 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d60143280 0x7f1d60146ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:10.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.577+0000 7f1d6639f700 1 -- 172.21.15.103:0/171282522 >> v1:172.21.15.86:6789/0 conn(0x7f1d60146f30 legacy=0x7f1d60063a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:10.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.577+0000 7f1d6539d700 1 -- 172.21.15.103:0/171282522 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3424962856 0 0) 0x7f1d60143810 con 0x7f1d60146f30 2020-04-22T14:13:10.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.577+0000 7f1d6639f700 1 -- 172.21.15.103:0/171282522 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d60143d50 con 0x7f1d600620a0 2020-04-22T14:13:10.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.577+0000 7f1d65b9e700 1 --2- 172.21.15.103:0/171282522 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d60143280 0x7f1d60146ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:13:10.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.577+0000 7f1d6639f700 1 --2- 172.21.15.103:0/171282522 >> v2:172.21.15.86:3300/0 conn(0x7f1d600620a0 0x7f1d60142e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1d5c002f30 tx=0x7f1d5c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:10.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.577+0000 7f1d6639f700 1 --2- 172.21.15.103:0/171282522 >> v2:172.21.15.86:3300/0 conn(0x7f1d600620a0 0x7f1d60142e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1d5c002f30 tx=0x7f1d5c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:10.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.577+0000 7f1d6639f700 1 --2- 172.21.15.103:0/171282522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d600620a0 0x7f1d60142e20 secure :-1 s=READY pgs=651 cs=0 l=1 rx=0x7f1d5c002f30 tx=0x7f1d5c007a40).ready entity=mon.0 client_cookie=a3a38e5d7f23b492 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:10.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.577+0000 7f1d6639f700 1 --2- 172.21.15.103:0/171282522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d600620a0 0x7f1d60142e20 secure :-1 s=THROTTLE_DONE pgs=651 cs=0 l=1 rx=0x7f1d5c002f30 tx=0x7f1d5c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:10.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.577+0000 7f1d6539d700 1 -- 172.21.15.103:0/171282522 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d5c012860 con 0x7f1d600620a0 2020-04-22T14:13:10.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.577+0000 7f1d6639f700 1 --2- 172.21.15.103:0/171282522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d600620a0 0x7f1d60142e20 secure :-1 s=THROTTLE_DONE pgs=651 cs=0 l=1 rx=0x7f1d5c002f30 tx=0x7f1d5c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:10.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.577+0000 7f1d6539d700 1 -- 172.21.15.103:0/171282522 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d5c012a00 con 0x7f1d600620a0 2020-04-22T14:13:10.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.577+0000 7f1d6639f700 1 --2- 172.21.15.103:0/171282522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d600620a0 0x7f1d60142e20 secure :-1 s=THROTTLE_DONE pgs=651 cs=0 l=1 rx=0x7f1d5c002f30 tx=0x7f1d5c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:10.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.577+0000 7f1d6539d700 1 -- 172.21.15.103:0/171282522 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d5c012de0 con 0x7f1d600620a0 2020-04-22T14:13:10.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.577+0000 7f1d673a1700 1 -- 172.21.15.103:0/171282522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d600620a0 msgr2=0x7f1d60142e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:10.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.577+0000 7f1d673a1700 1 --2- 172.21.15.103:0/171282522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d600620a0 0x7f1d60142e20 secure :-1 s=READY pgs=651 cs=0 l=1 rx=0x7f1d5c002f30 tx=0x7f1d5c007a40).stop 2020-04-22T14:13:10.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.578+0000 7f1d673a1700 1 -- 172.21.15.103:0/171282522 shutdown_connections 2020-04-22T14:13:10.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.578+0000 7f1d673a1700 1 --2- 172.21.15.103:0/171282522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d600620a0 0x7f1d60142e20 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:10.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.578+0000 7f1d673a1700 1 --2- 172.21.15.103:0/171282522 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d60143280 0x7f1d60146ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:10.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.578+0000 7f1d673a1700 1 -- 172.21.15.103:0/171282522 >> 172.21.15.103:0/171282522 conn(0x7f1d6005b7c0 msgr2=0x7f1d60061610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:10.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.578+0000 7f1d673a1700 1 -- 172.21.15.103:0/171282522 shutdown_connections 2020-04-22T14:13:10.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.578+0000 7f1d673a1700 1 -- 172.21.15.103:0/171282522 wait complete. 2020-04-22T14:13:10.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.579+0000 7f1d673a1700 1 Processor -- start 2020-04-22T14:13:10.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.579+0000 7f1d673a1700 1 -- start start 2020-04-22T14:13:10.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.580+0000 7f1d673a1700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d600620a0 0x7f1d6013d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:10.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.580+0000 7f1d673a1700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1d60146f30 0x7f1d6013fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:10.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.580+0000 7f1d673a1700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d60140c20 con 0x7f1d60143280 2020-04-22T14:13:10.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.580+0000 7f1d673a1700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d600b6a10 con 0x7f1d60146f30 2020-04-22T14:13:10.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.580+0000 7f1d673a1700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d600b6cb0 con 0x7f1d600620a0 2020-04-22T14:13:10.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.580+0000 7f1d66ba0700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1d60146f30 0x7f1d6013fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:10.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.580+0000 7f1d66ba0700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1d60146f30 0x7f1d6013fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53508/0 (socket says 172.21.15.103:53508) 2020-04-22T14:13:10.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.580+0000 7f1d66ba0700 1 -- 172.21.15.103:0/3005013985 learned_addr learned my addr 172.21.15.103:0/3005013985 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:10.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.580+0000 7f1d6639f700 1 --2- 172.21.15.103:0/3005013985 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d600620a0 0x7f1d6013d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:10.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.580+0000 7f1d66ba0700 1 -- 172.21.15.103:0/3005013985 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d600620a0 msgr2=0x7f1d6013d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:10.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.580+0000 7f1d66ba0700 1 --2- 172.21.15.103:0/3005013985 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d600620a0 0x7f1d6013d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:10.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.580+0000 7f1d4f7fe700 1 -- 172.21.15.103:0/3005013985 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3364561622 0 0) 0x7f1d60140c20 con 0x7f1d60143280 2020-04-22T14:13:10.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.580+0000 7f1d66ba0700 1 -- 172.21.15.103:0/3005013985 >> v1:172.21.15.86:6789/0 conn(0x7f1d60143280 legacy=0x7f1d60140dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:10.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.580+0000 7f1d66ba0700 1 -- 172.21.15.103:0/3005013985 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d600b6f50 con 0x7f1d60146f30 2020-04-22T14:13:10.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.580+0000 7f1d66ba0700 1 --2- 172.21.15.103:0/3005013985 >> v2:172.21.15.103:3300/0 conn(0x7f1d60146f30 0x7f1d6013fa60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1d58001210 tx=0x7f1d58010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:10.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.580+0000 7f1d66ba0700 1 --2- 172.21.15.103:0/3005013985 >> v2:172.21.15.103:3300/0 conn(0x7f1d60146f30 0x7f1d6013fa60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1d58001210 tx=0x7f1d58010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:10.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.580+0000 7f1d66ba0700 1 --2- 172.21.15.103:0/3005013985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d60146f30 0x7f1d6013fa60 secure :-1 s=READY pgs=1207 cs=0 l=1 rx=0x7f1d58001210 tx=0x7f1d58010cc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:10.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.580+0000 7f1d66ba0700 1 --2- 172.21.15.103:0/3005013985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d60146f30 0x7f1d6013fa60 secure :-1 s=THROTTLE_DONE pgs=1207 cs=0 l=1 rx=0x7f1d58001210 tx=0x7f1d58010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:10.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.580+0000 7f1d4f7fe700 1 -- 172.21.15.103:0/3005013985 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d58005e30 con 0x7f1d60146f30 2020-04-22T14:13:10.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.580+0000 7f1d66ba0700 1 --2- 172.21.15.103:0/3005013985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d60146f30 0x7f1d6013fa60 secure :-1 s=THROTTLE_DONE pgs=1207 cs=0 l=1 rx=0x7f1d58001210 tx=0x7f1d58010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:10.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.580+0000 7f1d4f7fe700 1 -- 172.21.15.103:0/3005013985 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d58012550 con 0x7f1d60146f30 2020-04-22T14:13:10.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.580+0000 7f1d66ba0700 1 --2- 172.21.15.103:0/3005013985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d60146f30 0x7f1d6013fa60 secure :-1 s=THROTTLE_DONE pgs=1207 cs=0 l=1 rx=0x7f1d58001210 tx=0x7f1d58010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:10.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.580+0000 7f1d4f7fe700 1 -- 172.21.15.103:0/3005013985 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d58012930 con 0x7f1d60146f30 2020-04-22T14:13:10.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.580+0000 7f1d673a1700 1 -- 172.21.15.103:0/3005013985 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d601414e0 con 0x7f1d60146f30 2020-04-22T14:13:10.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.580+0000 7f1d673a1700 1 -- 172.21.15.103:0/3005013985 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d6013ac20 con 0x7f1d60146f30 2020-04-22T14:13:10.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.581+0000 7f1d66ba0700 1 --2- 172.21.15.103:0/3005013985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d60146f30 0x7f1d6013fa60 secure :-1 s=THROTTLE_DONE pgs=1207 cs=0 l=1 rx=0x7f1d58001210 tx=0x7f1d58010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:10.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.582+0000 7f1d4f7fe700 1 -- 172.21.15.103:0/3005013985 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f1d58012bb0 con 0x7f1d60146f30 2020-04-22T14:13:10.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.582+0000 7f1d66ba0700 1 --2- 172.21.15.103:0/3005013985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d60146f30 0x7f1d6013fa60 secure :-1 s=THROTTLE_DONE pgs=1207 cs=0 l=1 rx=0x7f1d58001210 tx=0x7f1d58010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:10.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.582+0000 7f1d673a1700 1 -- 172.21.15.103:0/3005013985 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d60056c90 con 0x7f1d60146f30 2020-04-22T14:13:10.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.582+0000 7f1d4f7fe700 1 --2- 172.21.15.103:0/3005013985 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1d4004d7e0 0x7f1d4004fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:10.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.582+0000 7f1d4f7fe700 1 -- 172.21.15.103:0/3005013985 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f1d580090c0 con 0x7f1d60146f30 2020-04-22T14:13:10.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.582+0000 7f1d6639f700 1 --2- 172.21.15.103:0/3005013985 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1d4004d7e0 0x7f1d4004fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:10.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.582+0000 7f1d6639f700 1 --2- 172.21.15.103:0/3005013985 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1d4004d7e0 0x7f1d4004fca0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1d5c002f30 tx=0x7f1d5c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:10.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.582+0000 7f1d6639f700 1 --2- 172.21.15.103:0/3005013985 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1d4004d7e0 0x7f1d4004fca0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1d5c002f30 tx=0x7f1d5c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:10.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.582+0000 7f1d6639f700 1 --2- 172.21.15.103:0/3005013985 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1d4004d7e0 0x7f1d4004fca0 secure :-1 s=READY pgs=444 cs=0 l=1 rx=0x7f1d5c002f30 tx=0x7f1d5c007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:10.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.586+0000 7f1d66ba0700 1 --2- 172.21.15.103:0/3005013985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d60146f30 0x7f1d6013fa60 secure :-1 s=THROTTLE_DONE pgs=1207 cs=0 l=1 rx=0x7f1d58001210 tx=0x7f1d58010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:10.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.586+0000 7f1d4f7fe700 1 -- 172.21.15.103:0/3005013985 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f1d5803cfd0 con 0x7f1d60146f30 2020-04-22T14:13:10.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.773+0000 7f1d673a1700 1 -- 172.21.15.103:0/3005013985 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d600b49e0 con 0x7f1d60146f30 2020-04-22T14:13:10.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.774+0000 7f1d66ba0700 1 --2- 172.21.15.103:0/3005013985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d60146f30 0x7f1d6013fa60 secure :-1 s=THROTTLE_DONE pgs=1207 cs=0 l=1 rx=0x7f1d58001210 tx=0x7f1d58010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:10.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.774+0000 7f1d4f7fe700 1 -- 172.21.15.103:0/3005013985 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f1d580405f0 con 0x7f1d60146f30 2020-04-22T14:13:10.777 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:13:10.778 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:43.570838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:13:10.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.775+0000 7f1d673a1700 1 -- 172.21.15.103:0/3005013985 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1d4004d7e0 msgr2=0x7f1d4004fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:10.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.775+0000 7f1d673a1700 1 --2- 172.21.15.103:0/3005013985 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1d4004d7e0 0x7f1d4004fca0 secure :-1 s=READY pgs=444 cs=0 l=1 rx=0x7f1d5c002f30 tx=0x7f1d5c007a40).stop 2020-04-22T14:13:10.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.775+0000 7f1d673a1700 1 -- 172.21.15.103:0/3005013985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d60146f30 msgr2=0x7f1d6013fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:10.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.775+0000 7f1d673a1700 1 --2- 172.21.15.103:0/3005013985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d60146f30 0x7f1d6013fa60 secure :-1 s=READY pgs=1207 cs=0 l=1 rx=0x7f1d58001210 tx=0x7f1d58010cc0).stop 2020-04-22T14:13:10.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.775+0000 7f1d673a1700 1 -- 172.21.15.103:0/3005013985 shutdown_connections 2020-04-22T14:13:10.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.775+0000 7f1d673a1700 1 --2- 172.21.15.103:0/3005013985 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1d4004d7e0 0x7f1d4004fca0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:10.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.775+0000 7f1d673a1700 1 --2- 172.21.15.103:0/3005013985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d60146f30 0x7f1d6013fa60 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:10.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.775+0000 7f1d673a1700 1 --2- 172.21.15.103:0/3005013985 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d600620a0 0x7f1d6013d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:10.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.775+0000 7f1d673a1700 1 -- 172.21.15.103:0/3005013985 >> 172.21.15.103:0/3005013985 conn(0x7f1d6005b7c0 msgr2=0x7f1d60144ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:10.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.775+0000 7f1d673a1700 1 -- 172.21.15.103:0/3005013985 shutdown_connections 2020-04-22T14:13:10.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:10.775+0000 7f1d673a1700 1 -- 172.21.15.103:0/3005013985 wait complete. 2020-04-22T14:13:10.780 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 54 2020-04-22T14:13:10.789 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:13:11.789 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:11.806 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:13:11.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.960+0000 7f734fb58700 1 Processor -- start 2020-04-22T14:13:11.964 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.960+0000 7f734fb58700 1 -- start start 2020-04-22T14:13:11.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.961+0000 7f734fb58700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7348145960 0x7f7348145dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:11.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.961+0000 7f734fb58700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7348064fd0 0x7f7348065430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:11.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.961+0000 7f734fb58700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73480b79f0 con 0x7f73480b0ed0 2020-04-22T14:13:11.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.961+0000 7f734fb58700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73480b77f0 con 0x7f7348145960 2020-04-22T14:13:11.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.961+0000 7f734fb58700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73480b7c90 con 0x7f7348064fd0 2020-04-22T14:13:11.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.961+0000 7f734d0f3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7348145960 0x7f7348145dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:11.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.961+0000 7f734d8f4700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f73480b0ed0 0x7f73480b70e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45702/0 (socket says 172.21.15.103:45702) 2020-04-22T14:13:11.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.961+0000 7f734d8f4700 1 -- 172.21.15.103:0/1152146675 learned_addr learned my addr 172.21.15.103:0/1152146675 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:11.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.962+0000 7f734d0f3700 1 -- 172.21.15.103:0/1152146675 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7348064fd0 msgr2=0x7f7348065430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:11.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.962+0000 7f734d0f3700 1 --2- 172.21.15.103:0/1152146675 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7348064fd0 0x7f7348065430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:11.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.962+0000 7f734d0f3700 1 -- 172.21.15.103:0/1152146675 >> v1:172.21.15.103:6789/0 conn(0x7f73480b0ed0 legacy=0x7f73480b70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:11.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.962+0000 7f734d0f3700 1 -- 172.21.15.103:0/1152146675 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73480b7f30 con 0x7f7348145960 2020-04-22T14:13:11.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.962+0000 7f734c8f2700 1 -- 172.21.15.103:0/1152146675 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2102303004 0 0) 0x7f73480b79f0 con 0x7f73480b0ed0 2020-04-22T14:13:11.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.962+0000 7f734d0f3700 1 --2- 172.21.15.103:0/1152146675 >> v2:172.21.15.103:3300/0 conn(0x7f7348145960 0x7f7348145dc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f733c002f30 tx=0x7f733c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:11.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.962+0000 7f734d0f3700 1 --2- 172.21.15.103:0/1152146675 >> v2:172.21.15.103:3300/0 conn(0x7f7348145960 0x7f7348145dc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f733c002f30 tx=0x7f733c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:11.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.962+0000 7f734d0f3700 1 --2- 172.21.15.103:0/1152146675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7348145960 0x7f7348145dc0 secure :-1 s=READY pgs=1209 cs=0 l=1 rx=0x7f733c002f30 tx=0x7f733c007a40).ready entity=mon.1 client_cookie=33806a301975fa00 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:11.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.962+0000 7f734d0f3700 1 --2- 172.21.15.103:0/1152146675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7348145960 0x7f7348145dc0 secure :-1 s=THROTTLE_DONE pgs=1209 cs=0 l=1 rx=0x7f733c002f30 tx=0x7f733c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:11.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.962+0000 7f734c8f2700 1 -- 172.21.15.103:0/1152146675 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f733c011470 con 0x7f7348145960 2020-04-22T14:13:11.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.962+0000 7f734d0f3700 1 --2- 172.21.15.103:0/1152146675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7348145960 0x7f7348145dc0 secure :-1 s=THROTTLE_DONE pgs=1209 cs=0 l=1 rx=0x7f733c002f30 tx=0x7f733c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:11.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.962+0000 7f734c8f2700 1 -- 172.21.15.103:0/1152146675 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733c011610 con 0x7f7348145960 2020-04-22T14:13:11.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.962+0000 7f734d0f3700 1 --2- 172.21.15.103:0/1152146675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7348145960 0x7f7348145dc0 secure :-1 s=THROTTLE_DONE pgs=1209 cs=0 l=1 rx=0x7f733c002f30 tx=0x7f733c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:11.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.962+0000 7f734c8f2700 1 -- 172.21.15.103:0/1152146675 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f733c0119f0 con 0x7f7348145960 2020-04-22T14:13:11.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.962+0000 7f734fb58700 1 -- 172.21.15.103:0/1152146675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7348145960 msgr2=0x7f7348145dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:11.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.962+0000 7f734fb58700 1 --2- 172.21.15.103:0/1152146675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7348145960 0x7f7348145dc0 secure :-1 s=READY pgs=1209 cs=0 l=1 rx=0x7f733c002f30 tx=0x7f733c007a40).stop 2020-04-22T14:13:11.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.962+0000 7f734fb58700 1 -- 172.21.15.103:0/1152146675 shutdown_connections 2020-04-22T14:13:11.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.962+0000 7f734fb58700 1 --2- 172.21.15.103:0/1152146675 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7348064fd0 0x7f7348065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:11.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.962+0000 7f734fb58700 1 --2- 172.21.15.103:0/1152146675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7348145960 0x7f7348145dc0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:11.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.962+0000 7f734fb58700 1 -- 172.21.15.103:0/1152146675 >> 172.21.15.103:0/1152146675 conn(0x7f734805f2c0 msgr2=0x7f7348061fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:11.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.963+0000 7f734fb58700 1 -- 172.21.15.103:0/1152146675 shutdown_connections 2020-04-22T14:13:11.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.963+0000 7f734fb58700 1 -- 172.21.15.103:0/1152146675 wait complete. 2020-04-22T14:13:11.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.963+0000 7f734fb58700 1 Processor -- start 2020-04-22T14:13:11.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.964+0000 7f734fb58700 1 -- start start 2020-04-22T14:13:11.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.964+0000 7f734fb58700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7348064fd0 0x7f73481429d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:11.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.964+0000 7f734fb58700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7348145960 0x7f7348157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:11.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.964+0000 7f734fb58700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73480bb480 con 0x7f73480b0ed0 2020-04-22T14:13:11.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.964+0000 7f734fb58700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73480b97c0 con 0x7f7348064fd0 2020-04-22T14:13:11.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.964+0000 7f734fb58700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7348149cc0 con 0x7f7348145960 2020-04-22T14:13:11.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.964+0000 7f734d0f3700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f73480b0ed0 0x7f7348156f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45710/0 (socket says 172.21.15.103:45710) 2020-04-22T14:13:11.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.964+0000 7f734d0f3700 1 -- 172.21.15.103:0/1730214691 learned_addr learned my addr 172.21.15.103:0/1730214691 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:11.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.964+0000 7f7346ffd700 1 -- 172.21.15.103:0/1730214691 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 125265699 0 0) 0x7f73480bb480 con 0x7f73480b0ed0 2020-04-22T14:13:11.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.964+0000 7f7346ffd700 1 -- 172.21.15.103:0/1730214691 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7328002fe0 con 0x7f73480b0ed0 2020-04-22T14:13:11.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.964+0000 7f734e0f5700 1 --2- 172.21.15.103:0/1730214691 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7348145960 0x7f7348157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:11.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.965+0000 7f734d8f4700 1 --2- 172.21.15.103:0/1730214691 >> v2:172.21.15.86:3300/0 conn(0x7f7348064fd0 0x7f73481429d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:11.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.965+0000 7f7346ffd700 1 -- 172.21.15.103:0/1730214691 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2822520358 0 0) 0x7f7328002fe0 con 0x7f73480b0ed0 2020-04-22T14:13:11.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.965+0000 7f7346ffd700 1 -- 172.21.15.103:0/1730214691 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f73480bb480 con 0x7f73480b0ed0 2020-04-22T14:13:11.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.965+0000 7f7346ffd700 1 -- 172.21.15.103:0/1730214691 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f733c008e10 con 0x7f73480b0ed0 2020-04-22T14:13:11.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.965+0000 7f7346ffd700 1 -- 172.21.15.103:0/1730214691 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7348145960 msgr2=0x7f7348157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:11.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.965+0000 7f7346ffd700 1 --2- 172.21.15.103:0/1730214691 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7348145960 0x7f7348157670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:11.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.965+0000 7f7346ffd700 1 -- 172.21.15.103:0/1730214691 >> v2:172.21.15.86:3300/0 conn(0x7f7348064fd0 msgr2=0x7f73481429d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:11.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.965+0000 7f7346ffd700 1 --2- 172.21.15.103:0/1730214691 >> v2:172.21.15.86:3300/0 conn(0x7f7348064fd0 0x7f73481429d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:11.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.965+0000 7f7346ffd700 1 -- 172.21.15.103:0/1730214691 >> v1:172.21.15.103:6789/0 conn(0x7f73480b0ed0 legacy=0x7f7348156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:11.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.965+0000 7f7346ffd700 1 --2- 172.21.15.103:0/1730214691 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7348145960 0x7f73280049b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:11.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.965+0000 7f7346ffd700 1 --2- 172.21.15.103:0/1730214691 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7328004e10 0x7f7328003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:11.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.965+0000 7f7346ffd700 1 --2- 172.21.15.103:0/1730214691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7328003d80 0x7f7328004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:11.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.965+0000 7f7346ffd700 1 -- 172.21.15.103:0/1730214691 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73480b97c0 con 0x7f7328004e10 2020-04-22T14:13:11.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.965+0000 7f7346ffd700 1 -- 172.21.15.103:0/1730214691 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7348149cc0 con 0x7f7328003d80 2020-04-22T14:13:11.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.965+0000 7f7346ffd700 1 -- 172.21.15.103:0/1730214691 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7328005330 con 0x7f7348145960 2020-04-22T14:13:11.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.965+0000 7f734e0f5700 1 --2- 172.21.15.103:0/1730214691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7328003d80 0x7f7328004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:11.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.965+0000 7f734d8f4700 1 --2- 172.21.15.103:0/1730214691 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7348145960 0x7f73280049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:11.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.965+0000 7f734d0f3700 1 --2- 172.21.15.103:0/1730214691 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7328004e10 0x7f7328003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:11.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.965+0000 7f734e0f5700 1 -- 172.21.15.103:0/1730214691 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7348145960 msgr2=0x7f73280049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:11.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.965+0000 7f734e0f5700 1 --2- 172.21.15.103:0/1730214691 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7348145960 0x7f73280049b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:11.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.965+0000 7f734e0f5700 1 -- 172.21.15.103:0/1730214691 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7328004e10 msgr2=0x7f7328003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:11.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.965+0000 7f734e0f5700 1 --2- 172.21.15.103:0/1730214691 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7328004e10 0x7f7328003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:11.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.965+0000 7f734e0f5700 1 -- 172.21.15.103:0/1730214691 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73480bb720 con 0x7f7328003d80 2020-04-22T14:13:11.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.965+0000 7f734fb58700 1 -- 172.21.15.103:0/1730214691 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73480bb100 con 0x7f7328003d80 2020-04-22T14:13:11.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.965+0000 7f734e0f5700 1 --2- 172.21.15.103:0/1730214691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7328003d80 0x7f7328004200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7340002f30 tx=0x7f7340010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:11.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.965+0000 7f734fb58700 1 -- 172.21.15.103:0/1730214691 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7348147ae0 con 0x7f7328003d80 2020-04-22T14:13:11.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.965+0000 7f734e0f5700 1 --2- 172.21.15.103:0/1730214691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7328003d80 0x7f7328004200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7340002f30 tx=0x7f7340010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:11.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.965+0000 7f734e0f5700 1 --2- 172.21.15.103:0/1730214691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7328003d80 0x7f7328004200 secure :-1 s=READY pgs=1211 cs=0 l=1 rx=0x7f7340002f30 tx=0x7f7340010bf0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:11.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.965+0000 7f734e0f5700 1 --2- 172.21.15.103:0/1730214691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7328003d80 0x7f7328004200 secure :-1 s=THROTTLE_DONE pgs=1211 cs=0 l=1 rx=0x7f7340002f30 tx=0x7f7340010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:11.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.965+0000 7f7346ffd700 1 -- 172.21.15.103:0/1730214691 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7340008c20 con 0x7f7328003d80 2020-04-22T14:13:11.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.965+0000 7f734e0f5700 1 --2- 172.21.15.103:0/1730214691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7328003d80 0x7f7328004200 secure :-1 s=THROTTLE_DONE pgs=1211 cs=0 l=1 rx=0x7f7340002f30 tx=0x7f7340010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:11.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.965+0000 7f7346ffd700 1 -- 172.21.15.103:0/1730214691 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7340000e90 con 0x7f7328003d80 2020-04-22T14:13:11.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.965+0000 7f734e0f5700 1 --2- 172.21.15.103:0/1730214691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7328003d80 0x7f7328004200 secure :-1 s=THROTTLE_DONE pgs=1211 cs=0 l=1 rx=0x7f7340002f30 tx=0x7f7340010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:11.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.966+0000 7f7346ffd700 1 -- 172.21.15.103:0/1730214691 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7340012220 con 0x7f7328003d80 2020-04-22T14:13:11.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.966+0000 7f734e0f5700 1 --2- 172.21.15.103:0/1730214691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7328003d80 0x7f7328004200 secure :-1 s=THROTTLE_DONE pgs=1211 cs=0 l=1 rx=0x7f7340002f30 tx=0x7f7340010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:11.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.966+0000 7f734fb58700 1 -- 172.21.15.103:0/1730214691 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73480bb290 con 0x7f7328003d80 2020-04-22T14:13:11.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.966+0000 7f7346ffd700 1 -- 172.21.15.103:0/1730214691 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f7340012380 con 0x7f7328003d80 2020-04-22T14:13:11.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.966+0000 7f734e0f5700 1 --2- 172.21.15.103:0/1730214691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7328003d80 0x7f7328004200 secure :-1 s=THROTTLE_DONE pgs=1211 cs=0 l=1 rx=0x7f7340002f30 tx=0x7f7340010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:11.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.967+0000 7f7346ffd700 1 --2- 172.21.15.103:0/1730214691 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7328055b20 0x7f7328057fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:11.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.967+0000 7f7346ffd700 1 -- 172.21.15.103:0/1730214691 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f7340061080 con 0x7f7328003d80 2020-04-22T14:13:11.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.967+0000 7f734d8f4700 1 --2- 172.21.15.103:0/1730214691 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7328055b20 0x7f7328057fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:11.997 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.967+0000 7f734d8f4700 1 --2- 172.21.15.103:0/1730214691 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7328055b20 0x7f7328057fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7338000f00 tx=0x7f733800cef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:11.997 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.967+0000 7f734d8f4700 1 --2- 172.21.15.103:0/1730214691 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7328055b20 0x7f7328057fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7338000f00 tx=0x7f733800cef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:11.997 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.967+0000 7f734d8f4700 1 --2- 172.21.15.103:0/1730214691 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7328055b20 0x7f7328057fe0 secure :-1 s=READY pgs=445 cs=0 l=1 rx=0x7f7338000f00 tx=0x7f733800cef0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:11.997 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.971+0000 7f734e0f5700 1 --2- 172.21.15.103:0/1730214691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7328003d80 0x7f7328004200 secure :-1 s=THROTTLE_DONE pgs=1211 cs=0 l=1 rx=0x7f7340002f30 tx=0x7f7340010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:11.997 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:11.971+0000 7f7346ffd700 1 -- 172.21.15.103:0/1730214691 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f734003c460 con 0x7f7328003d80 2020-04-22T14:13:12.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:12.157+0000 7f734fb58700 1 -- 172.21.15.103:0/1730214691 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7348056c90 con 0x7f7328003d80 2020-04-22T14:13:12.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:12.157+0000 7f734e0f5700 1 --2- 172.21.15.103:0/1730214691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7328003d80 0x7f7328004200 secure :-1 s=THROTTLE_DONE pgs=1211 cs=0 l=1 rx=0x7f7340002f30 tx=0x7f7340010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:12.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:12.157+0000 7f7346ffd700 1 -- 172.21.15.103:0/1730214691 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f7340012080 con 0x7f7328003d80 2020-04-22T14:13:12.161 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:13:12.161 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:43.570838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:13:12.162 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:12.158+0000 7f734fb58700 1 -- 172.21.15.103:0/1730214691 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7328055b20 msgr2=0x7f7328057fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:12.162 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:12.158+0000 7f734fb58700 1 --2- 172.21.15.103:0/1730214691 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7328055b20 0x7f7328057fe0 secure :-1 s=READY pgs=445 cs=0 l=1 rx=0x7f7338000f00 tx=0x7f733800cef0).stop 2020-04-22T14:13:12.162 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:12.158+0000 7f734fb58700 1 -- 172.21.15.103:0/1730214691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7328003d80 msgr2=0x7f7328004200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:12.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:12.158+0000 7f734fb58700 1 --2- 172.21.15.103:0/1730214691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7328003d80 0x7f7328004200 secure :-1 s=READY pgs=1211 cs=0 l=1 rx=0x7f7340002f30 tx=0x7f7340010bf0).stop 2020-04-22T14:13:12.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:12.158+0000 7f734e0f5700 1 -- 172.21.15.103:0/1730214691 reap_dead start 2020-04-22T14:13:12.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:12.159+0000 7f734e0f5700 1 -- 172.21.15.103:0/1730214691 reap_dead start 2020-04-22T14:13:12.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:12.159+0000 7f734fb58700 1 -- 172.21.15.103:0/1730214691 shutdown_connections 2020-04-22T14:13:12.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:12.159+0000 7f734fb58700 1 -- 172.21.15.103:0/1730214691 >> 172.21.15.103:0/1730214691 conn(0x7f734805f2c0 msgr2=0x7f7348143df0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:12.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:12.159+0000 7f734fb58700 1 -- 172.21.15.103:0/1730214691 shutdown_connections 2020-04-22T14:13:12.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:12.159+0000 7f734fb58700 1 -- 172.21.15.103:0/1730214691 wait complete. 2020-04-22T14:13:12.164 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 54 2020-04-22T14:13:12.172 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:13:13.173 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:13.189 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:13:13.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.343+0000 7fa8081ad700 1 Processor -- start 2020-04-22T14:13:13.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.343+0000 7fa8081ad700 1 -- start start 2020-04-22T14:13:13.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.344+0000 7fa8081ad700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa800065fe0 0x7fa8001464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:13.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.344+0000 7fa8081ad700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa800063e30 0x7fa8000642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:13.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.344+0000 7fa8081ad700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa800143300 con 0x7fa80012c0d0 2020-04-22T14:13:13.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.344+0000 7fa8081ad700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8001435a0 con 0x7fa800065fe0 2020-04-22T14:13:13.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.344+0000 7fa8081ad700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa800143840 con 0x7fa800063e30 2020-04-22T14:13:13.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.344+0000 7fa80674a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa800063e30 0x7fa8000642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:13.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.344+0000 7fa80674a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa800063e30 0x7fa8000642c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53534/0 (socket says 172.21.15.103:53534) 2020-04-22T14:13:13.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.344+0000 7fa80674a700 1 -- 172.21.15.103:0/252283609 learned_addr learned my addr 172.21.15.103:0/252283609 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:13.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.344+0000 7fa805748700 1 --2- 172.21.15.103:0/252283609 >> v2:172.21.15.86:3300/0 conn(0x7fa800065fe0 0x7fa8001464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:13.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.344+0000 7fa80674a700 1 -- 172.21.15.103:0/252283609 >> v2:172.21.15.86:3300/0 conn(0x7fa800065fe0 msgr2=0x7fa8001464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:13.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.344+0000 7fa80674a700 1 --2- 172.21.15.103:0/252283609 >> v2:172.21.15.86:3300/0 conn(0x7fa800065fe0 0x7fa8001464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:13.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.344+0000 7fa80674a700 1 -- 172.21.15.103:0/252283609 >> v1:172.21.15.86:6789/0 conn(0x7fa80012c0d0 legacy=0x7fa80005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:13.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.344+0000 7fa80674a700 1 -- 172.21.15.103:0/252283609 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa80005bb50 con 0x7fa800063e30 2020-04-22T14:13:13.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.344+0000 7fa80674a700 1 --2- 172.21.15.103:0/252283609 >> v2:172.21.15.103:3300/0 conn(0x7fa800063e30 0x7fa8000642c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa7fc002f30 tx=0x7fa7fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:13.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.344+0000 7fa80674a700 1 --2- 172.21.15.103:0/252283609 >> v2:172.21.15.103:3300/0 conn(0x7fa800063e30 0x7fa8000642c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa7fc002f30 tx=0x7fa7fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:13.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.344+0000 7fa80674a700 1 --2- 172.21.15.103:0/252283609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa800063e30 0x7fa8000642c0 secure :-1 s=READY pgs=1212 cs=0 l=1 rx=0x7fa7fc002f30 tx=0x7fa7fc007a40).ready entity=mon.1 client_cookie=de745e0b59c6867f server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:13.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.344+0000 7fa80674a700 1 --2- 172.21.15.103:0/252283609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa800063e30 0x7fa8000642c0 secure :-1 s=THROTTLE_DONE pgs=1212 cs=0 l=1 rx=0x7fa7fc002f30 tx=0x7fa7fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:13.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.344+0000 7fa804f47700 1 -- 172.21.15.103:0/252283609 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7fc011720 con 0x7fa800063e30 2020-04-22T14:13:13.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.344+0000 7fa80674a700 1 --2- 172.21.15.103:0/252283609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa800063e30 0x7fa8000642c0 secure :-1 s=THROTTLE_DONE pgs=1212 cs=0 l=1 rx=0x7fa7fc002f30 tx=0x7fa7fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:13.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.344+0000 7fa804f47700 1 -- 172.21.15.103:0/252283609 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7fc011880 con 0x7fa800063e30 2020-04-22T14:13:13.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.344+0000 7fa80674a700 1 --2- 172.21.15.103:0/252283609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa800063e30 0x7fa8000642c0 secure :-1 s=THROTTLE_DONE pgs=1212 cs=0 l=1 rx=0x7fa7fc002f30 tx=0x7fa7fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:13.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.344+0000 7fa8081ad700 1 -- 172.21.15.103:0/252283609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa800063e30 msgr2=0x7fa8000642c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:13.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.344+0000 7fa804f47700 1 -- 172.21.15.103:0/252283609 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7fc011ca0 con 0x7fa800063e30 2020-04-22T14:13:13.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.344+0000 7fa8081ad700 1 --2- 172.21.15.103:0/252283609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa800063e30 0x7fa8000642c0 secure :-1 s=READY pgs=1212 cs=0 l=1 rx=0x7fa7fc002f30 tx=0x7fa7fc007a40).stop 2020-04-22T14:13:13.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.345+0000 7fa8081ad700 1 -- 172.21.15.103:0/252283609 shutdown_connections 2020-04-22T14:13:13.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.345+0000 7fa8081ad700 1 --2- 172.21.15.103:0/252283609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa800063e30 0x7fa8000642c0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:13.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.345+0000 7fa8081ad700 1 --2- 172.21.15.103:0/252283609 >> v2:172.21.15.86:3300/0 conn(0x7fa800065fe0 0x7fa8001464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:13.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.345+0000 7fa8081ad700 1 -- 172.21.15.103:0/252283609 >> 172.21.15.103:0/252283609 conn(0x7fa8000b9160 msgr2=0x7fa80005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:13.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.345+0000 7fa8081ad700 1 -- 172.21.15.103:0/252283609 shutdown_connections 2020-04-22T14:13:13.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.345+0000 7fa8081ad700 1 -- 172.21.15.103:0/252283609 wait complete. 2020-04-22T14:13:13.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.346+0000 7fa8081ad700 1 Processor -- start 2020-04-22T14:13:13.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.346+0000 7fa8081ad700 1 -- start start 2020-04-22T14:13:13.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.347+0000 7fa8081ad700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa800065fe0 0x7fa800142110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:13.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.347+0000 7fa8081ad700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa80012c0d0 0x7fa800127390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:13.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.347+0000 7fa8081ad700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8001234a0 con 0x7fa800063e30 2020-04-22T14:13:13.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.347+0000 7fa8081ad700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa800123740 con 0x7fa80012c0d0 2020-04-22T14:13:13.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.347+0000 7fa8081ad700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa800123be0 con 0x7fa800065fe0 2020-04-22T14:13:13.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.347+0000 7fa805f49700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa800063e30 0x7fa800144d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45728/0 (socket says 172.21.15.103:45728) 2020-04-22T14:13:13.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.347+0000 7fa805f49700 1 -- 172.21.15.103:0/2901920949 learned_addr learned my addr 172.21.15.103:0/2901920949 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:13.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.347+0000 7fa805748700 1 --2- 172.21.15.103:0/2901920949 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa800065fe0 0x7fa800142110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:13.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.347+0000 7fa80674a700 1 --2- 172.21.15.103:0/2901920949 >> v2:172.21.15.86:3300/0 conn(0x7fa80012c0d0 0x7fa800127390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:13.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.347+0000 7fa7eeffd700 1 -- 172.21.15.103:0/2901920949 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 332779212 0 0) 0x7fa8001234a0 con 0x7fa800063e30 2020-04-22T14:13:13.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.347+0000 7fa7eeffd700 1 -- 172.21.15.103:0/2901920949 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7e0002fe0 con 0x7fa800063e30 2020-04-22T14:13:13.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.347+0000 7fa805748700 1 -- 172.21.15.103:0/2901920949 >> v2:172.21.15.86:3300/0 conn(0x7fa80012c0d0 msgr2=0x7fa800127390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:13.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.347+0000 7fa805748700 1 --2- 172.21.15.103:0/2901920949 >> v2:172.21.15.86:3300/0 conn(0x7fa80012c0d0 0x7fa800127390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:13.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.347+0000 7fa805748700 1 -- 172.21.15.103:0/2901920949 >> v1:172.21.15.103:6789/0 conn(0x7fa800063e30 legacy=0x7fa800144d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:13.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.347+0000 7fa7eeffd700 1 -- 172.21.15.103:0/2901920949 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 454284434 0 0) 0x7fa7e0002fe0 con 0x7fa800063e30 2020-04-22T14:13:13.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.347+0000 7fa805748700 1 -- 172.21.15.103:0/2901920949 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa800123d20 con 0x7fa800065fe0 2020-04-22T14:13:13.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.347+0000 7fa80674a700 1 --2- 172.21.15.103:0/2901920949 >> v2:172.21.15.86:3300/0 conn(0x7fa80012c0d0 0x7fa800127390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:13:13.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.347+0000 7fa805748700 1 --2- 172.21.15.103:0/2901920949 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa800065fe0 0x7fa800142110 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa7f8001e50 tx=0x7fa7f0010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:13.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.348+0000 7fa805748700 1 --2- 172.21.15.103:0/2901920949 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa800065fe0 0x7fa800142110 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa7f8001e50 tx=0x7fa7f0010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:13.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.348+0000 7fa805748700 1 --2- 172.21.15.103:0/2901920949 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa800065fe0 0x7fa800142110 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7fa7f8001e50 tx=0x7fa7f0010bb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:13.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.348+0000 7fa805748700 1 --2- 172.21.15.103:0/2901920949 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa800065fe0 0x7fa800142110 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7fa7f8001e50 tx=0x7fa7f0010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:13.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.348+0000 7fa7eeffd700 1 -- 172.21.15.103:0/2901920949 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7f8001cb0 con 0x7fa800065fe0 2020-04-22T14:13:13.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.348+0000 7fa805748700 1 --2- 172.21.15.103:0/2901920949 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa800065fe0 0x7fa800142110 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7fa7f8001e50 tx=0x7fa7f0010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:13.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.348+0000 7fa8081ad700 1 -- 172.21.15.103:0/2901920949 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa800142820 con 0x7fa800065fe0 2020-04-22T14:13:13.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.348+0000 7fa7eeffd700 1 -- 172.21.15.103:0/2901920949 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f0005ca0 con 0x7fa800065fe0 2020-04-22T14:13:13.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.348+0000 7fa805748700 1 --2- 172.21.15.103:0/2901920949 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa800065fe0 0x7fa800142110 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7fa7f8001e50 tx=0x7fa7f0010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:13.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.348+0000 7fa7eeffd700 1 -- 172.21.15.103:0/2901920949 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7f0005e10 con 0x7fa800065fe0 2020-04-22T14:13:13.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.348+0000 7fa8081ad700 1 -- 172.21.15.103:0/2901920949 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8001277f0 con 0x7fa800065fe0 2020-04-22T14:13:13.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.348+0000 7fa805748700 1 --2- 172.21.15.103:0/2901920949 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa800065fe0 0x7fa800142110 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7fa7f8001e50 tx=0x7fa7f0010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:13.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.349+0000 7fa805748700 1 --2- 172.21.15.103:0/2901920949 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa800065fe0 0x7fa800142110 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7fa7f8001e50 tx=0x7fa7f0010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:13.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.349+0000 7fa7eeffd700 1 -- 172.21.15.103:0/2901920949 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fa7f0007370 con 0x7fa800065fe0 2020-04-22T14:13:13.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.349+0000 7fa8081ad700 1 -- 172.21.15.103:0/2901920949 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8001232d0 con 0x7fa800065fe0 2020-04-22T14:13:13.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.349+0000 7fa7eeffd700 1 --2- 172.21.15.103:0/2901920949 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa7e004dcf0 0x7fa7e00501b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:13.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.349+0000 7fa7eeffd700 1 -- 172.21.15.103:0/2901920949 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fa7f0060ef0 con 0x7fa800065fe0 2020-04-22T14:13:13.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.349+0000 7fa805f49700 1 --2- 172.21.15.103:0/2901920949 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa7e004dcf0 0x7fa7e00501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:13.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.350+0000 7fa805f49700 1 --2- 172.21.15.103:0/2901920949 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa7e004dcf0 0x7fa7e00501b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa7f8001550 tx=0x7fa7f800a0e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:13.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.350+0000 7fa805f49700 1 --2- 172.21.15.103:0/2901920949 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa7e004dcf0 0x7fa7e00501b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa7f8001550 tx=0x7fa7f800a0e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:13.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.350+0000 7fa805f49700 1 --2- 172.21.15.103:0/2901920949 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa7e004dcf0 0x7fa7e00501b0 secure :-1 s=READY pgs=446 cs=0 l=1 rx=0x7fa7f8001550 tx=0x7fa7f800a0e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:13.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.353+0000 7fa805748700 1 --2- 172.21.15.103:0/2901920949 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa800065fe0 0x7fa800142110 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7fa7f8001e50 tx=0x7fa7f0010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:13.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.353+0000 7fa7eeffd700 1 -- 172.21.15.103:0/2901920949 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fa7f003c290 con 0x7fa800065fe0 2020-04-22T14:13:13.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.548+0000 7fa8081ad700 1 -- 172.21.15.103:0/2901920949 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa800124200 con 0x7fa800065fe0 2020-04-22T14:13:13.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.549+0000 7fa805748700 1 --2- 172.21.15.103:0/2901920949 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa800065fe0 0x7fa800142110 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7fa7f8001e50 tx=0x7fa7f0010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:13.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.549+0000 7fa7eeffd700 1 -- 172.21.15.103:0/2901920949 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2147 (secure 0 0 0) 0x7fa7f003f8b0 con 0x7fa800065fe0 2020-04-22T14:13:13.552 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:13:13.552 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:43.570838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:13:13.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.550+0000 7fa8081ad700 1 -- 172.21.15.103:0/2901920949 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa7e004dcf0 msgr2=0x7fa7e00501b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:13.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.550+0000 7fa8081ad700 1 --2- 172.21.15.103:0/2901920949 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa7e004dcf0 0x7fa7e00501b0 secure :-1 s=READY pgs=446 cs=0 l=1 rx=0x7fa7f8001550 tx=0x7fa7f800a0e0).stop 2020-04-22T14:13:13.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.550+0000 7fa8081ad700 1 -- 172.21.15.103:0/2901920949 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa800065fe0 msgr2=0x7fa800142110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:13.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.550+0000 7fa8081ad700 1 --2- 172.21.15.103:0/2901920949 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa800065fe0 0x7fa800142110 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7fa7f8001e50 tx=0x7fa7f0010bb0).stop 2020-04-22T14:13:13.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.550+0000 7fa8081ad700 1 -- 172.21.15.103:0/2901920949 shutdown_connections 2020-04-22T14:13:13.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.550+0000 7fa8081ad700 1 --2- 172.21.15.103:0/2901920949 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa7e004dcf0 0x7fa7e00501b0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:13.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.550+0000 7fa8081ad700 1 --2- 172.21.15.103:0/2901920949 >> v2:172.21.15.86:3300/0 conn(0x7fa80012c0d0 0x7fa800127390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:13.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.550+0000 7fa8081ad700 1 --2- 172.21.15.103:0/2901920949 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa800065fe0 0x7fa800142110 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:13.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.550+0000 7fa8081ad700 1 -- 172.21.15.103:0/2901920949 >> 172.21.15.103:0/2901920949 conn(0x7fa8000b9160 msgr2=0x7fa8000b4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:13.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.550+0000 7fa8081ad700 1 -- 172.21.15.103:0/2901920949 shutdown_connections 2020-04-22T14:13:13.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:13.550+0000 7fa8081ad700 1 -- 172.21.15.103:0/2901920949 wait complete. 2020-04-22T14:13:13.555 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 54 2020-04-22T14:13:13.564 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:13:14.565 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:14.581 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:13:14.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.735+0000 7ff47a5a0700 1 Processor -- start 2020-04-22T14:13:14.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.735+0000 7ff47a5a0700 1 -- start start 2020-04-22T14:13:14.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.736+0000 7ff47a5a0700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4740665a0 0x7ff47414a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:14.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.736+0000 7ff47a5a0700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff4740b4ec0 0x7ff4740b5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:14.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.736+0000 7ff47a5a0700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4740651f0 con 0x7ff47405b7c0 2020-04-22T14:13:14.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.736+0000 7ff47a5a0700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff474066b90 con 0x7ff4740b4ec0 2020-04-22T14:13:14.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.736+0000 7ff47a5a0700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff474066e30 con 0x7ff4740665a0 2020-04-22T14:13:14.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.736+0000 7ff478b3d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff4740b4ec0 0x7ff4740b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:14.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.736+0000 7ff4737fe700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4740665a0 0x7ff47414a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:14.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.736+0000 7ff478b3d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff4740b4ec0 0x7ff4740b5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:50780/0 (socket says 172.21.15.103:50780) 2020-04-22T14:13:14.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.736+0000 7ff4737fe700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4740665a0 0x7ff47414a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:38326/0 (socket says 172.21.15.103:38326) 2020-04-22T14:13:14.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.736+0000 7ff473fff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7ff47405b7c0 0x7ff4741336b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:34660/0 (socket says 172.21.15.103:34660) 2020-04-22T14:13:14.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.736+0000 7ff478b3d700 1 -- 172.21.15.103:0/1528574639 learned_addr learned my addr 172.21.15.103:0/1528574639 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:14.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.736+0000 7ff478b3d700 1 -- 172.21.15.103:0/1528574639 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4740665a0 msgr2=0x7ff47414a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:14.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.736+0000 7ff478b3d700 1 --2- 172.21.15.103:0/1528574639 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4740665a0 0x7ff47414a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:14.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.736+0000 7ff478b3d700 1 -- 172.21.15.103:0/1528574639 >> v1:172.21.15.86:6789/0 conn(0x7ff47405b7c0 legacy=0x7ff4741336b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:14.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.736+0000 7ff478b3d700 1 -- 172.21.15.103:0/1528574639 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4740670d0 con 0x7ff4740b4ec0 2020-04-22T14:13:14.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.736+0000 7ff472ffd700 1 -- 172.21.15.103:0/1528574639 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2826499662 0 0) 0x7ff4740651f0 con 0x7ff47405b7c0 2020-04-22T14:13:14.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.737+0000 7ff478b3d700 1 --2- 172.21.15.103:0/1528574639 >> v2:172.21.15.86:3300/0 conn(0x7ff4740b4ec0 0x7ff4740b5350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff474066ab0 tx=0x7ff46c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:14.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.737+0000 7ff478b3d700 1 --2- 172.21.15.103:0/1528574639 >> v2:172.21.15.86:3300/0 conn(0x7ff4740b4ec0 0x7ff4740b5350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff474066ab0 tx=0x7ff46c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:14.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.737+0000 7ff478b3d700 1 --2- 172.21.15.103:0/1528574639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4740b4ec0 0x7ff4740b5350 secure :-1 s=READY pgs=655 cs=0 l=1 rx=0x7ff474066ab0 tx=0x7ff46c008c60).ready entity=mon.0 client_cookie=e7f2bb3ec1fedb9f server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:14.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.737+0000 7ff478b3d700 1 --2- 172.21.15.103:0/1528574639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4740b4ec0 0x7ff4740b5350 secure :-1 s=THROTTLE_DONE pgs=655 cs=0 l=1 rx=0x7ff474066ab0 tx=0x7ff46c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:14.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.737+0000 7ff472ffd700 1 -- 172.21.15.103:0/1528574639 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff46c00a180 con 0x7ff4740b4ec0 2020-04-22T14:13:14.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.737+0000 7ff478b3d700 1 --2- 172.21.15.103:0/1528574639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4740b4ec0 0x7ff4740b5350 secure :-1 s=THROTTLE_DONE pgs=655 cs=0 l=1 rx=0x7ff474066ab0 tx=0x7ff46c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:14.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.737+0000 7ff472ffd700 1 -- 172.21.15.103:0/1528574639 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46c00a320 con 0x7ff4740b4ec0 2020-04-22T14:13:14.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.737+0000 7ff478b3d700 1 --2- 172.21.15.103:0/1528574639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4740b4ec0 0x7ff4740b5350 secure :-1 s=THROTTLE_DONE pgs=655 cs=0 l=1 rx=0x7ff474066ab0 tx=0x7ff46c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:14.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.737+0000 7ff472ffd700 1 -- 172.21.15.103:0/1528574639 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff46c00a700 con 0x7ff4740b4ec0 2020-04-22T14:13:14.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.737+0000 7ff47a5a0700 1 -- 172.21.15.103:0/1528574639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4740b4ec0 msgr2=0x7ff4740b5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:14.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.737+0000 7ff47a5a0700 1 --2- 172.21.15.103:0/1528574639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4740b4ec0 0x7ff4740b5350 secure :-1 s=READY pgs=655 cs=0 l=1 rx=0x7ff474066ab0 tx=0x7ff46c008c60).stop 2020-04-22T14:13:14.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.737+0000 7ff47a5a0700 1 -- 172.21.15.103:0/1528574639 shutdown_connections 2020-04-22T14:13:14.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.737+0000 7ff47a5a0700 1 --2- 172.21.15.103:0/1528574639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4740b4ec0 0x7ff4740b5350 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:14.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.737+0000 7ff47a5a0700 1 --2- 172.21.15.103:0/1528574639 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4740665a0 0x7ff47414a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:14.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.737+0000 7ff47a5a0700 1 -- 172.21.15.103:0/1528574639 >> 172.21.15.103:0/1528574639 conn(0x7ff4740b9160 msgr2=0x7ff47405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:14.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.737+0000 7ff47a5a0700 1 -- 172.21.15.103:0/1528574639 shutdown_connections 2020-04-22T14:13:14.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.737+0000 7ff47a5a0700 1 -- 172.21.15.103:0/1528574639 wait complete. 2020-04-22T14:13:14.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.738+0000 7ff47a5a0700 1 Processor -- start 2020-04-22T14:13:14.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.738+0000 7ff47a5a0700 1 -- start start 2020-04-22T14:13:14.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.739+0000 7ff47a5a0700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4740665a0 0x7ff4740b2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:14.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.739+0000 7ff47a5a0700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff4740b4ec0 0x7ff47415b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:14.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.739+0000 7ff47a5a0700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4740aea70 con 0x7ff47405b7c0 2020-04-22T14:13:14.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.739+0000 7ff47a5a0700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff47412f500 con 0x7ff4740b4ec0 2020-04-22T14:13:14.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.739+0000 7ff47a5a0700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4740aed10 con 0x7ff4740665a0 2020-04-22T14:13:14.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.739+0000 7ff478b3d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff4740b4ec0 0x7ff47415b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:14.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.739+0000 7ff478b3d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff4740b4ec0 0x7ff47415b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53556/0 (socket says 172.21.15.103:53556) 2020-04-22T14:13:14.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.739+0000 7ff478b3d700 1 -- 172.21.15.103:0/144138394 learned_addr learned my addr 172.21.15.103:0/144138394 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:14.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.740+0000 7ff4737fe700 1 --2- 172.21.15.103:0/144138394 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4740665a0 0x7ff4740b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:14.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.740+0000 7ff478b3d700 1 -- 172.21.15.103:0/144138394 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4740665a0 msgr2=0x7ff4740b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:14.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.740+0000 7ff478b3d700 1 --2- 172.21.15.103:0/144138394 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4740665a0 0x7ff4740b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:14.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.740+0000 7ff478b3d700 1 -- 172.21.15.103:0/144138394 >> v1:172.21.15.86:6789/0 conn(0x7ff47405b7c0 legacy=0x7ff47411a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:14.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.740+0000 7ff478b3d700 1 -- 172.21.15.103:0/144138394 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4740aefb0 con 0x7ff4740b4ec0 2020-04-22T14:13:14.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.740+0000 7ff478b3d700 1 --2- 172.21.15.103:0/144138394 >> v2:172.21.15.103:3300/0 conn(0x7ff4740b4ec0 0x7ff47415b180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff474066ab0 tx=0x7ff474064760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:14.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.740+0000 7ff478b3d700 1 --2- 172.21.15.103:0/144138394 >> v2:172.21.15.103:3300/0 conn(0x7ff4740b4ec0 0x7ff47415b180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff474066ab0 tx=0x7ff474064760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:14.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.740+0000 7ff478b3d700 1 --2- 172.21.15.103:0/144138394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4740b4ec0 0x7ff47415b180 secure :-1 s=READY pgs=1214 cs=0 l=1 rx=0x7ff474066ab0 tx=0x7ff474064760).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:14.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.740+0000 7ff478b3d700 1 --2- 172.21.15.103:0/144138394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4740b4ec0 0x7ff47415b180 secure :-1 s=THROTTLE_DONE pgs=1214 cs=0 l=1 rx=0x7ff474066ab0 tx=0x7ff474064760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:14.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.740+0000 7ff4717fa700 1 -- 172.21.15.103:0/144138394 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff46c005c30 con 0x7ff4740b4ec0 2020-04-22T14:13:14.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.740+0000 7ff478b3d700 1 --2- 172.21.15.103:0/144138394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4740b4ec0 0x7ff47415b180 secure :-1 s=THROTTLE_DONE pgs=1214 cs=0 l=1 rx=0x7ff474066ab0 tx=0x7ff474064760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:14.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.740+0000 7ff47a5a0700 1 -- 172.21.15.103:0/144138394 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff47415bcb0 con 0x7ff4740b4ec0 2020-04-22T14:13:14.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.740+0000 7ff4717fa700 1 -- 172.21.15.103:0/144138394 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46c005dd0 con 0x7ff4740b4ec0 2020-04-22T14:13:14.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.740+0000 7ff478b3d700 1 --2- 172.21.15.103:0/144138394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4740b4ec0 0x7ff47415b180 secure :-1 s=THROTTLE_DONE pgs=1214 cs=0 l=1 rx=0x7ff474066ab0 tx=0x7ff474064760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:14.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.740+0000 7ff4717fa700 1 -- 172.21.15.103:0/144138394 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff46c00f7a0 con 0x7ff4740b4ec0 2020-04-22T14:13:14.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.740+0000 7ff47a5a0700 1 -- 172.21.15.103:0/144138394 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4740b0f90 con 0x7ff4740b4ec0 2020-04-22T14:13:14.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.741+0000 7ff478b3d700 1 --2- 172.21.15.103:0/144138394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4740b4ec0 0x7ff47415b180 secure :-1 s=THROTTLE_DONE pgs=1214 cs=0 l=1 rx=0x7ff474066ab0 tx=0x7ff474064760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:14.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.741+0000 7ff47a5a0700 1 -- 172.21.15.103:0/144138394 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff47415b960 con 0x7ff4740b4ec0 2020-04-22T14:13:14.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.741+0000 7ff4717fa700 1 -- 172.21.15.103:0/144138394 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ff46c00fa60 con 0x7ff4740b4ec0 2020-04-22T14:13:14.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.741+0000 7ff478b3d700 1 --2- 172.21.15.103:0/144138394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4740b4ec0 0x7ff47415b180 secure :-1 s=THROTTLE_DONE pgs=1214 cs=0 l=1 rx=0x7ff474066ab0 tx=0x7ff474064760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:14.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.741+0000 7ff4717fa700 1 --2- 172.21.15.103:0/144138394 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff45404d900 0x7ff45404fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:14.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.741+0000 7ff4717fa700 1 -- 172.21.15.103:0/144138394 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6159+0+0 (secure 0 0 0) 0x7ff46c0623b0 con 0x7ff4740b4ec0 2020-04-22T14:13:14.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.742+0000 7ff473fff700 1 --2- 172.21.15.103:0/144138394 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff45404d900 0x7ff45404fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:14.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.742+0000 7ff473fff700 1 --2- 172.21.15.103:0/144138394 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff45404d900 0x7ff45404fdc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff4740645c0 tx=0x7ff464001530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:14.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.742+0000 7ff473fff700 1 --2- 172.21.15.103:0/144138394 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff45404d900 0x7ff45404fdc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff4740645c0 tx=0x7ff464001530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:14.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.742+0000 7ff473fff700 1 --2- 172.21.15.103:0/144138394 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff45404d900 0x7ff45404fdc0 secure :-1 s=READY pgs=447 cs=0 l=1 rx=0x7ff4740645c0 tx=0x7ff464001530).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:14.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.745+0000 7ff478b3d700 1 --2- 172.21.15.103:0/144138394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4740b4ec0 0x7ff47415b180 secure :-1 s=THROTTLE_DONE pgs=1214 cs=0 l=1 rx=0x7ff474066ab0 tx=0x7ff474064760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:14.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.746+0000 7ff4717fa700 1 -- 172.21.15.103:0/144138394 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ff47415b960 con 0x7ff4740b4ec0 2020-04-22T14:13:14.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.935+0000 7ff47a5a0700 1 -- 172.21.15.103:0/144138394 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4740af1b0 con 0x7ff4740b4ec0 2020-04-22T14:13:14.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.935+0000 7ff478b3d700 1 --2- 172.21.15.103:0/144138394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4740b4ec0 0x7ff47415b180 secure :-1 s=THROTTLE_DONE pgs=1214 cs=0 l=1 rx=0x7ff474066ab0 tx=0x7ff474064760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:14.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.935+0000 7ff4717fa700 1 -- 172.21.15.103:0/144138394 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2147 (secure 0 0 0) 0x7ff4740af1b0 con 0x7ff4740b4ec0 2020-04-22T14:13:14.939 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:13:14.939 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:43.570838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:13:14.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.936+0000 7ff47a5a0700 1 -- 172.21.15.103:0/144138394 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff45404d900 msgr2=0x7ff45404fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:14.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.936+0000 7ff47a5a0700 1 --2- 172.21.15.103:0/144138394 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff45404d900 0x7ff45404fdc0 secure :-1 s=READY pgs=447 cs=0 l=1 rx=0x7ff4740645c0 tx=0x7ff464001530).stop 2020-04-22T14:13:14.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.936+0000 7ff47a5a0700 1 -- 172.21.15.103:0/144138394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4740b4ec0 msgr2=0x7ff47415b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:14.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.936+0000 7ff47a5a0700 1 --2- 172.21.15.103:0/144138394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4740b4ec0 0x7ff47415b180 secure :-1 s=READY pgs=1214 cs=0 l=1 rx=0x7ff474066ab0 tx=0x7ff474064760).stop 2020-04-22T14:13:14.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.937+0000 7ff47a5a0700 1 -- 172.21.15.103:0/144138394 shutdown_connections 2020-04-22T14:13:14.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.937+0000 7ff47a5a0700 1 --2- 172.21.15.103:0/144138394 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff45404d900 0x7ff45404fdc0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:14.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.937+0000 7ff47a5a0700 1 --2- 172.21.15.103:0/144138394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4740b4ec0 0x7ff47415b180 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:14.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.937+0000 7ff47a5a0700 1 --2- 172.21.15.103:0/144138394 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4740665a0 0x7ff4740b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:14.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.937+0000 7ff47a5a0700 1 -- 172.21.15.103:0/144138394 >> 172.21.15.103:0/144138394 conn(0x7ff4740b9160 msgr2=0x7ff474131cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:14.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.937+0000 7ff47a5a0700 1 -- 172.21.15.103:0/144138394 shutdown_connections 2020-04-22T14:13:14.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:14.937+0000 7ff47a5a0700 1 -- 172.21.15.103:0/144138394 wait complete. 2020-04-22T14:13:14.942 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 54 2020-04-22T14:13:14.950 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:13:15.951 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:15.971 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:13:16.127 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.124+0000 7fd3fbfff700 1 Processor -- start 2020-04-22T14:13:16.127 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.124+0000 7fd3fbfff700 1 -- start start 2020-04-22T14:13:16.130 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.125+0000 7fd3fbfff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd3fc146ad0 0x7fd3fc146f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:16.130 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.125+0000 7fd3fbfff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3fc143810 con 0x7fd3fc0ad900 2020-04-22T14:13:16.130 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.125+0000 7fd3fbfff700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3fc143ab0 con 0x7fd3fc0620a0 2020-04-22T14:13:16.130 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.125+0000 7fd3fbfff700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3fc1473b0 con 0x7fd3fc146ad0 2020-04-22T14:13:16.130 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.125+0000 7fd3faffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd3fc0620a0 0x7fd3fc142e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45750/0 (socket says 172.21.15.103:45750) 2020-04-22T14:13:16.131 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.125+0000 7fd3faffd700 1 -- 172.21.15.103:0/546238252 learned_addr learned my addr 172.21.15.103:0/546238252 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:16.131 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.125+0000 7fd3fa7fc700 1 --2- 172.21.15.103:0/546238252 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd3fc146ad0 0x7fd3fc146f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:16.131 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.125+0000 7fd3f9ffb700 1 -- 172.21.15.103:0/546238252 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 936073883 0 0) 0x7fd3fc143ab0 con 0x7fd3fc0620a0 2020-04-22T14:13:16.131 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.125+0000 7fd3f9ffb700 1 -- 172.21.15.103:0/546238252 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3e0003230 con 0x7fd3fc0620a0 2020-04-22T14:13:16.131 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.125+0000 7fd3f9ffb700 1 -- 172.21.15.103:0/546238252 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2747558077 0 0) 0x7fd3fc143810 con 0x7fd3fc0ad900 2020-04-22T14:13:16.131 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.126+0000 7fd3f9ffb700 1 -- 172.21.15.103:0/546238252 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3fc143ab0 con 0x7fd3fc0ad900 2020-04-22T14:13:16.131 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.126+0000 7fd3fa7fc700 1 -- 172.21.15.103:0/546238252 >> v1:172.21.15.103:6789/0 conn(0x7fd3fc0620a0 legacy=0x7fd3fc142e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:16.132 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.126+0000 7fd3f9ffb700 1 -- 172.21.15.103:0/546238252 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3595253313 0 0) 0x7fd3e0003230 con 0x7fd3fc0620a0 2020-04-22T14:13:16.132 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.126+0000 7fd3fa7fc700 1 -- 172.21.15.103:0/546238252 >> v1:172.21.15.86:6789/0 conn(0x7fd3fc0ad900 legacy=0x7fd3fc0addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:16.132 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.126+0000 7fd3fa7fc700 1 -- 172.21.15.103:0/546238252 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3fc143d50 con 0x7fd3fc146ad0 2020-04-22T14:13:16.132 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.126+0000 7fd3fa7fc700 1 --2- 172.21.15.103:0/546238252 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd3fc146ad0 0x7fd3fc146f50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd3f40010d0 tx=0x7fd3f0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:16.132 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.126+0000 7fd3fa7fc700 1 --2- 172.21.15.103:0/546238252 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd3fc146ad0 0x7fd3fc146f50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd3f40010d0 tx=0x7fd3f0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:16.132 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.126+0000 7fd3fa7fc700 1 --2- 172.21.15.103:0/546238252 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd3fc146ad0 0x7fd3fc146f50 secure :-1 s=READY pgs=116 cs=0 l=1 rx=0x7fd3f40010d0 tx=0x7fd3f0008c60).ready entity=mon.2 client_cookie=76648ec52e221747 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:16.132 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.126+0000 7fd3fa7fc700 1 --2- 172.21.15.103:0/546238252 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd3fc146ad0 0x7fd3fc146f50 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7fd3f40010d0 tx=0x7fd3f0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:16.133 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.126+0000 7fd3f9ffb700 1 -- 172.21.15.103:0/546238252 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3f40016d0 con 0x7fd3fc146ad0 2020-04-22T14:13:16.133 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.126+0000 7fd3fa7fc700 1 --2- 172.21.15.103:0/546238252 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd3fc146ad0 0x7fd3fc146f50 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7fd3f40010d0 tx=0x7fd3f0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:16.133 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.126+0000 7fd3f9ffb700 1 -- 172.21.15.103:0/546238252 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f0010b00 con 0x7fd3fc146ad0 2020-04-22T14:13:16.133 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.126+0000 7fd3fa7fc700 1 --2- 172.21.15.103:0/546238252 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd3fc146ad0 0x7fd3fc146f50 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7fd3f40010d0 tx=0x7fd3f0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:16.133 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.126+0000 7fd3f9ffb700 1 -- 172.21.15.103:0/546238252 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3f0010e60 con 0x7fd3fc146ad0 2020-04-22T14:13:16.133 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.126+0000 7fd3fbfff700 1 -- 172.21.15.103:0/546238252 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd3fc146ad0 msgr2=0x7fd3fc146f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:16.133 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.126+0000 7fd3fbfff700 1 --2- 172.21.15.103:0/546238252 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd3fc146ad0 0x7fd3fc146f50 secure :-1 s=READY pgs=116 cs=0 l=1 rx=0x7fd3f40010d0 tx=0x7fd3f0008c60).stop 2020-04-22T14:13:16.133 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.126+0000 7fd3fbfff700 1 -- 172.21.15.103:0/546238252 shutdown_connections 2020-04-22T14:13:16.134 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.126+0000 7fd3fbfff700 1 --2- 172.21.15.103:0/546238252 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd3fc146ad0 0x7fd3fc146f50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:16.134 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.127+0000 7fd3fbfff700 1 -- 172.21.15.103:0/546238252 >> 172.21.15.103:0/546238252 conn(0x7fd3fc05b7c0 msgr2=0x7fd3fc061610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:16.134 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.127+0000 7fd3fbfff700 1 -- 172.21.15.103:0/546238252 shutdown_connections 2020-04-22T14:13:16.134 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.127+0000 7fd3fbfff700 1 -- 172.21.15.103:0/546238252 wait complete. 2020-04-22T14:13:16.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.128+0000 7fd3fbfff700 1 Processor -- start 2020-04-22T14:13:16.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.128+0000 7fd3fbfff700 1 -- start start 2020-04-22T14:13:16.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.128+0000 7fd3fbfff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd3fc0ad900 0x7fd3fc12eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:16.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.128+0000 7fd3fbfff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3fc142d50 con 0x7fd3fc0620a0 2020-04-22T14:13:16.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.128+0000 7fd3fbfff700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3fc153df0 con 0x7fd3fc146ad0 2020-04-22T14:13:16.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.128+0000 7fd3fbfff700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3fc154090 con 0x7fd3fc0ad900 2020-04-22T14:13:16.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.128+0000 7fd3fa7fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd3fc0ad900 0x7fd3fc12eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:16.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.128+0000 7fd3fa7fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd3fc0ad900 0x7fd3fc12eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53566/0 (socket says 172.21.15.103:53566) 2020-04-22T14:13:16.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.128+0000 7fd3fa7fc700 1 -- 172.21.15.103:0/4003080944 learned_addr learned my addr 172.21.15.103:0/4003080944 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:16.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.129+0000 7fd3fa7fc700 1 -- 172.21.15.103:0/4003080944 >> v1:172.21.15.103:6789/0 conn(0x7fd3fc146ad0 legacy=0x7fd3fc0b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:16.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.129+0000 7fd3ebfff700 1 -- 172.21.15.103:0/4003080944 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 68898504 0 0) 0x7fd3fc153df0 con 0x7fd3fc146ad0 2020-04-22T14:13:16.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.129+0000 7fd3fa7fc700 1 -- 172.21.15.103:0/4003080944 >> v1:172.21.15.86:6789/0 conn(0x7fd3fc0620a0 legacy=0x7fd3fc0b0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:16.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.129+0000 7fd3fa7fc700 1 -- 172.21.15.103:0/4003080944 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3fc154330 con 0x7fd3fc0ad900 2020-04-22T14:13:16.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.129+0000 7fd3fa7fc700 1 --2- 172.21.15.103:0/4003080944 >> v2:172.21.15.103:3300/0 conn(0x7fd3fc0ad900 0x7fd3fc12eee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd3f40010d0 tx=0x7fd3f0008290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:16.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.129+0000 7fd3fa7fc700 1 --2- 172.21.15.103:0/4003080944 >> v2:172.21.15.103:3300/0 conn(0x7fd3fc0ad900 0x7fd3fc12eee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd3f40010d0 tx=0x7fd3f0008290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:16.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.129+0000 7fd3fa7fc700 1 --2- 172.21.15.103:0/4003080944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3fc0ad900 0x7fd3fc12eee0 secure :-1 s=READY pgs=1217 cs=0 l=1 rx=0x7fd3f40010d0 tx=0x7fd3f0008290).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:16.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.129+0000 7fd3fa7fc700 1 --2- 172.21.15.103:0/4003080944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3fc0ad900 0x7fd3fc12eee0 secure :-1 s=THROTTLE_DONE pgs=1217 cs=0 l=1 rx=0x7fd3f40010d0 tx=0x7fd3f0008290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:16.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.129+0000 7fd3ebfff700 1 -- 172.21.15.103:0/4003080944 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3f0017590 con 0x7fd3fc0ad900 2020-04-22T14:13:16.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.129+0000 7fd3fa7fc700 1 --2- 172.21.15.103:0/4003080944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3fc0ad900 0x7fd3fc12eee0 secure :-1 s=THROTTLE_DONE pgs=1217 cs=0 l=1 rx=0x7fd3f40010d0 tx=0x7fd3f0008290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:16.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.129+0000 7fd3fbfff700 1 -- 172.21.15.103:0/4003080944 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3fc13f750 con 0x7fd3fc0ad900 2020-04-22T14:13:16.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.129+0000 7fd3ebfff700 1 -- 172.21.15.103:0/4003080944 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f00176f0 con 0x7fd3fc0ad900 2020-04-22T14:13:16.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.129+0000 7fd3fa7fc700 1 --2- 172.21.15.103:0/4003080944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3fc0ad900 0x7fd3fc12eee0 secure :-1 s=THROTTLE_DONE pgs=1217 cs=0 l=1 rx=0x7fd3f40010d0 tx=0x7fd3f0008290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:16.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.129+0000 7fd3ebfff700 1 -- 172.21.15.103:0/4003080944 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3f0017a90 con 0x7fd3fc0ad900 2020-04-22T14:13:16.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.129+0000 7fd3fbfff700 1 -- 172.21.15.103:0/4003080944 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3fc1547d0 con 0x7fd3fc0ad900 2020-04-22T14:13:16.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.130+0000 7fd3fa7fc700 1 --2- 172.21.15.103:0/4003080944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3fc0ad900 0x7fd3fc12eee0 secure :-1 s=THROTTLE_DONE pgs=1217 cs=0 l=1 rx=0x7fd3f40010d0 tx=0x7fd3f0008290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:16.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.130+0000 7fd3fbfff700 1 -- 172.21.15.103:0/4003080944 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3fc1544c0 con 0x7fd3fc0ad900 2020-04-22T14:13:16.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.130+0000 7fd3ebfff700 1 -- 172.21.15.103:0/4003080944 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fd3f000c0b0 con 0x7fd3fc0ad900 2020-04-22T14:13:16.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.130+0000 7fd3fa7fc700 1 --2- 172.21.15.103:0/4003080944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3fc0ad900 0x7fd3fc12eee0 secure :-1 s=THROTTLE_DONE pgs=1217 cs=0 l=1 rx=0x7fd3f40010d0 tx=0x7fd3f0008290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:16.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.130+0000 7fd3ebfff700 1 --2- 172.21.15.103:0/4003080944 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd3d804d7a0 0x7fd3d804fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:16.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.131+0000 7fd3ebfff700 1 -- 172.21.15.103:0/4003080944 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fd3f0064160 con 0x7fd3fc0ad900 2020-04-22T14:13:16.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.131+0000 7fd3faffd700 1 --2- 172.21.15.103:0/4003080944 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd3d804d7a0 0x7fd3d804fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:16.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.131+0000 7fd3faffd700 1 --2- 172.21.15.103:0/4003080944 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd3d804d7a0 0x7fd3d804fc60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd3fc140370 tx=0x7fd3f4001360).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:16.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.131+0000 7fd3faffd700 1 --2- 172.21.15.103:0/4003080944 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd3d804d7a0 0x7fd3d804fc60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd3fc140370 tx=0x7fd3f4001360).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:16.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.131+0000 7fd3faffd700 1 --2- 172.21.15.103:0/4003080944 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd3d804d7a0 0x7fd3d804fc60 secure :-1 s=READY pgs=448 cs=0 l=1 rx=0x7fd3fc140370 tx=0x7fd3f4001360).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:16.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.135+0000 7fd3fa7fc700 1 --2- 172.21.15.103:0/4003080944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3fc0ad900 0x7fd3fc12eee0 secure :-1 s=THROTTLE_DONE pgs=1217 cs=0 l=1 rx=0x7fd3f40010d0 tx=0x7fd3f0008290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:16.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.135+0000 7fd3ebfff700 1 -- 172.21.15.103:0/4003080944 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fd3f003f4e0 con 0x7fd3fc0ad900 2020-04-22T14:13:16.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.325+0000 7fd3fbfff700 1 -- 172.21.15.103:0/4003080944 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3fc056c90 con 0x7fd3fc0ad900 2020-04-22T14:13:16.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.325+0000 7fd3fa7fc700 1 --2- 172.21.15.103:0/4003080944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3fc0ad900 0x7fd3fc12eee0 secure :-1 s=THROTTLE_DONE pgs=1217 cs=0 l=1 rx=0x7fd3f40010d0 tx=0x7fd3f0008290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:16.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.325+0000 7fd3ebfff700 1 -- 172.21.15.103:0/4003080944 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2147 (secure 0 0 0) 0x7fd3f0042b00 con 0x7fd3fc0ad900 2020-04-22T14:13:16.329 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:13:16.329 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:43.570838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:13:16.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.327+0000 7fd3fbfff700 1 -- 172.21.15.103:0/4003080944 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd3d804d7a0 msgr2=0x7fd3d804fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:16.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.327+0000 7fd3fbfff700 1 --2- 172.21.15.103:0/4003080944 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd3d804d7a0 0x7fd3d804fc60 secure :-1 s=READY pgs=448 cs=0 l=1 rx=0x7fd3fc140370 tx=0x7fd3f4001360).stop 2020-04-22T14:13:16.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.327+0000 7fd3fbfff700 1 -- 172.21.15.103:0/4003080944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3fc0ad900 msgr2=0x7fd3fc12eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:16.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.327+0000 7fd3fbfff700 1 --2- 172.21.15.103:0/4003080944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3fc0ad900 0x7fd3fc12eee0 secure :-1 s=READY pgs=1217 cs=0 l=1 rx=0x7fd3f40010d0 tx=0x7fd3f0008290).stop 2020-04-22T14:13:16.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.327+0000 7fd3fbfff700 1 -- 172.21.15.103:0/4003080944 shutdown_connections 2020-04-22T14:13:16.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.327+0000 7fd3fbfff700 1 --2- 172.21.15.103:0/4003080944 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd3d804d7a0 0x7fd3d804fc60 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:16.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.327+0000 7fd3fbfff700 1 --2- 172.21.15.103:0/4003080944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3fc0ad900 0x7fd3fc12eee0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:16.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.327+0000 7fd3fbfff700 1 -- 172.21.15.103:0/4003080944 >> 172.21.15.103:0/4003080944 conn(0x7fd3fc05b7c0 msgr2=0x7fd3fc065d80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:16.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.327+0000 7fd3fbfff700 1 -- 172.21.15.103:0/4003080944 shutdown_connections 2020-04-22T14:13:16.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:16.327+0000 7fd3fbfff700 1 -- 172.21.15.103:0/4003080944 wait complete. 2020-04-22T14:13:16.332 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 54 2020-04-22T14:13:16.342 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:13:17.343 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:17.360 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:13:17.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.512+0000 7f39bead1700 1 Processor -- start 2020-04-22T14:13:17.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.512+0000 7f39bead1700 1 -- start start 2020-04-22T14:13:17.519 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.513+0000 7f39bead1700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f39b8140320 0x7f39b80ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:17.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.513+0000 7f39bead1700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39b814a740 con 0x7f39b80bd1b0 2020-04-22T14:13:17.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.513+0000 7f39bead1700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39b81462f0 con 0x7f39b814a2b0 2020-04-22T14:13:17.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.513+0000 7f39bead1700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39b8146590 con 0x7f39b8140320 2020-04-22T14:13:17.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.513+0000 7f39b7fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f39b814a2b0 0x7f39b8146cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45762/0 (socket says 172.21.15.103:45762) 2020-04-22T14:13:17.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.513+0000 7f39b7fff700 1 -- 172.21.15.103:0/2757795482 learned_addr learned my addr 172.21.15.103:0/2757795482 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:17.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.514+0000 7f39bc86d700 1 --2- 172.21.15.103:0/2757795482 >> v2:172.21.15.86:3300/0 conn(0x7f39b8140320 0x7f39b80ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:17.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.514+0000 7f39b77fe700 1 -- 172.21.15.103:0/2757795482 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3649799127 0 0) 0x7f39b81462f0 con 0x7f39b814a2b0 2020-04-22T14:13:17.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.514+0000 7f39b77fe700 1 -- 172.21.15.103:0/2757795482 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39a4003230 con 0x7f39b814a2b0 2020-04-22T14:13:17.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.514+0000 7f39b77fe700 1 -- 172.21.15.103:0/2757795482 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1863701600 0 0) 0x7f39a4003230 con 0x7f39b814a2b0 2020-04-22T14:13:17.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.514+0000 7f39b77fe700 1 -- 172.21.15.103:0/2757795482 >> v2:172.21.15.86:3300/0 conn(0x7f39b8140320 msgr2=0x7f39b80ae1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:17.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.514+0000 7f39b77fe700 1 --2- 172.21.15.103:0/2757795482 >> v2:172.21.15.86:3300/0 conn(0x7f39b8140320 0x7f39b80ae1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:17.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.514+0000 7f39b77fe700 1 -- 172.21.15.103:0/2757795482 >> v1:172.21.15.86:6789/0 conn(0x7f39b80bd1b0 legacy=0x7f39b80ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:17.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.514+0000 7f39b77fe700 1 -- 172.21.15.103:0/2757795482 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b8146830 con 0x7f39b814a2b0 2020-04-22T14:13:17.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.514+0000 7f39b77fe700 1 -- 172.21.15.103:0/2757795482 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f39ac0016d0 con 0x7f39b814a2b0 2020-04-22T14:13:17.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.514+0000 7f39b77fe700 1 -- 172.21.15.103:0/2757795482 >> v1:172.21.15.103:6789/0 conn(0x7f39b814a2b0 legacy=0x7f39b8146cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:17.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.514+0000 7f39b77fe700 1 --2- 172.21.15.103:0/2757795482 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f39a4003720 0x7f39a4003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:17.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.514+0000 7f39b77fe700 1 --2- 172.21.15.103:0/2757795482 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39a40044d0 0x7f39a4004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:17.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.514+0000 7f39b77fe700 1 --2- 172.21.15.103:0/2757795482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39a4004db0 0x7f39a400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:17.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.514+0000 7f39b77fe700 1 -- 172.21.15.103:0/2757795482 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b8146590 con 0x7f39a40044d0 2020-04-22T14:13:17.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.514+0000 7f39b77fe700 1 -- 172.21.15.103:0/2757795482 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a40041c0 con 0x7f39a4004db0 2020-04-22T14:13:17.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.514+0000 7f39b77fe700 1 -- 172.21.15.103:0/2757795482 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a400bb80 con 0x7f39a4003720 2020-04-22T14:13:17.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.514+0000 7f39bd06e700 1 --2- 172.21.15.103:0/2757795482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39a4004db0 0x7f39a400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:17.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.514+0000 7f39b7fff700 1 --2- 172.21.15.103:0/2757795482 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39a40044d0 0x7f39a4004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:17.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.514+0000 7f39bc86d700 1 --2- 172.21.15.103:0/2757795482 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f39a4003720 0x7f39a4003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:17.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.514+0000 7f39bd06e700 1 -- 172.21.15.103:0/2757795482 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f39a4003720 msgr2=0x7f39a4003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:17.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.514+0000 7f39bd06e700 1 --2- 172.21.15.103:0/2757795482 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f39a4003720 0x7f39a4003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:17.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.514+0000 7f39bd06e700 1 -- 172.21.15.103:0/2757795482 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39a40044d0 msgr2=0x7f39a4004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:17.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.514+0000 7f39bd06e700 1 --2- 172.21.15.103:0/2757795482 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39a40044d0 0x7f39a4004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:17.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.514+0000 7f39bd06e700 1 -- 172.21.15.103:0/2757795482 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a4003230 con 0x7f39a4004db0 2020-04-22T14:13:17.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.514+0000 7f39bd06e700 1 --2- 172.21.15.103:0/2757795482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39a4004db0 0x7f39a400b720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f39a40054a0 tx=0x7f39b0010090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:17.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.514+0000 7f39bd06e700 1 -- 172.21.15.103:0/2757795482 reap_dead start 2020-04-22T14:13:17.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.514+0000 7f39bd06e700 1 --2- 172.21.15.103:0/2757795482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39a4004db0 0x7f39a400b720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f39a40054a0 tx=0x7f39b0010090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:17.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.515+0000 7f39bd06e700 1 --2- 172.21.15.103:0/2757795482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39a4004db0 0x7f39a400b720 secure :-1 s=READY pgs=1219 cs=0 l=1 rx=0x7f39a40054a0 tx=0x7f39b0010090).ready entity=mon.1 client_cookie=5b5d8d86487820b2 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:17.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.515+0000 7f39bd06e700 1 --2- 172.21.15.103:0/2757795482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39a4004db0 0x7f39a400b720 secure :-1 s=THROTTLE_DONE pgs=1219 cs=0 l=1 rx=0x7f39a40054a0 tx=0x7f39b0010090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:17.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.515+0000 7f39bd06e700 1 --2- 172.21.15.103:0/2757795482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39a4004db0 0x7f39a400b720 secure :-1 s=THROTTLE_DONE pgs=1219 cs=0 l=1 rx=0x7f39a40054a0 tx=0x7f39b0010090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:17.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.515+0000 7f39b77fe700 1 -- 172.21.15.103:0/2757795482 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39b0006c40 con 0x7f39a4004db0 2020-04-22T14:13:17.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.515+0000 7f39bd06e700 1 --2- 172.21.15.103:0/2757795482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39a4004db0 0x7f39a400b720 secure :-1 s=THROTTLE_DONE pgs=1219 cs=0 l=1 rx=0x7f39a40054a0 tx=0x7f39b0010090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:17.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.515+0000 7f39b77fe700 1 -- 172.21.15.103:0/2757795482 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b0006da0 con 0x7f39a4004db0 2020-04-22T14:13:17.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.515+0000 7f39b77fe700 1 -- 172.21.15.103:0/2757795482 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39b0002730 con 0x7f39a4004db0 2020-04-22T14:13:17.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.515+0000 7f39bead1700 1 -- 172.21.15.103:0/2757795482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39a4004db0 msgr2=0x7f39a400b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:17.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.515+0000 7f39bead1700 1 --2- 172.21.15.103:0/2757795482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39a4004db0 0x7f39a400b720 secure :-1 s=READY pgs=1219 cs=0 l=1 rx=0x7f39a40054a0 tx=0x7f39b0010090).stop 2020-04-22T14:13:17.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.515+0000 7f39bead1700 1 -- 172.21.15.103:0/2757795482 shutdown_connections 2020-04-22T14:13:17.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.515+0000 7f39bead1700 1 --2- 172.21.15.103:0/2757795482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39a4004db0 0x7f39a400b720 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:17.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.515+0000 7f39bead1700 1 -- 172.21.15.103:0/2757795482 >> 172.21.15.103:0/2757795482 conn(0x7f39b805f2c0 msgr2=0x7f39b80bcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:17.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.515+0000 7f39bead1700 1 -- 172.21.15.103:0/2757795482 shutdown_connections 2020-04-22T14:13:17.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.515+0000 7f39bead1700 1 -- 172.21.15.103:0/2757795482 wait complete. 2020-04-22T14:13:17.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.516+0000 7f39bead1700 1 Processor -- start 2020-04-22T14:13:17.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.516+0000 7f39bead1700 1 -- start start 2020-04-22T14:13:17.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.517+0000 7f39bead1700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f39a4004db0 0x7f39b8157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:17.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.517+0000 7f39bead1700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f39b813eca0 0x7f39b8141dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:17.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.517+0000 7f39bead1700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39b8156e40 con 0x7f39b8145250 2020-04-22T14:13:17.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.517+0000 7f39bead1700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39b8143d20 con 0x7f39a4004db0 2020-04-22T14:13:17.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.517+0000 7f39bead1700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b8157070 con 0x7f39b813eca0 2020-04-22T14:13:17.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.517+0000 7f39bc86d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f39a4004db0 0x7f39b8157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:17.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.517+0000 7f39bc86d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f39a4004db0 0x7f39b8157a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53582/0 (socket says 172.21.15.103:53582) 2020-04-22T14:13:17.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.517+0000 7f39bc86d700 1 -- 172.21.15.103:0/934970795 learned_addr learned my addr 172.21.15.103:0/934970795 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:17.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.517+0000 7f39b7fff700 1 --2- 172.21.15.103:0/934970795 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f39b813eca0 0x7f39b8141dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:17.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.517+0000 7f39bc86d700 1 -- 172.21.15.103:0/934970795 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f39b813eca0 msgr2=0x7f39b8141dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:17.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.517+0000 7f39bc86d700 1 --2- 172.21.15.103:0/934970795 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f39b813eca0 0x7f39b8141dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:17.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.517+0000 7f39bc86d700 1 -- 172.21.15.103:0/934970795 >> v1:172.21.15.86:6789/0 conn(0x7f39b8145250 legacy=0x7f39b813d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:17.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.517+0000 7f39bc86d700 1 -- 172.21.15.103:0/934970795 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b81456c0 con 0x7f39a4004db0 2020-04-22T14:13:17.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.517+0000 7f39bc86d700 1 --2- 172.21.15.103:0/934970795 >> v2:172.21.15.103:3300/0 conn(0x7f39a4004db0 0x7f39b8157a50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f39b813f100 tx=0x7f39a8010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:17.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.517+0000 7f39bc86d700 1 --2- 172.21.15.103:0/934970795 >> v2:172.21.15.103:3300/0 conn(0x7f39a4004db0 0x7f39b8157a50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f39b813f100 tx=0x7f39a8010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:17.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.517+0000 7f39bc86d700 1 --2- 172.21.15.103:0/934970795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39a4004db0 0x7f39b8157a50 secure :-1 s=READY pgs=1220 cs=0 l=1 rx=0x7f39b813f100 tx=0x7f39a8010b40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:17.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.518+0000 7f39bc86d700 1 --2- 172.21.15.103:0/934970795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39a4004db0 0x7f39b8157a50 secure :-1 s=THROTTLE_DONE pgs=1220 cs=0 l=1 rx=0x7f39b813f100 tx=0x7f39a8010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:17.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.518+0000 7f39b5ffb700 1 -- 172.21.15.103:0/934970795 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39a8005aa0 con 0x7f39a4004db0 2020-04-22T14:13:17.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.518+0000 7f39bc86d700 1 --2- 172.21.15.103:0/934970795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39a4004db0 0x7f39b8157a50 secure :-1 s=THROTTLE_DONE pgs=1220 cs=0 l=1 rx=0x7f39b813f100 tx=0x7f39a8010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:17.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.518+0000 7f39b5ffb700 1 -- 172.21.15.103:0/934970795 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a8005c00 con 0x7f39a4004db0 2020-04-22T14:13:17.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.518+0000 7f39bc86d700 1 --2- 172.21.15.103:0/934970795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39a4004db0 0x7f39b8157a50 secure :-1 s=THROTTLE_DONE pgs=1220 cs=0 l=1 rx=0x7f39b813f100 tx=0x7f39a8010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:17.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.518+0000 7f39bead1700 1 -- 172.21.15.103:0/934970795 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39b8157310 con 0x7f39a4004db0 2020-04-22T14:13:17.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.518+0000 7f39b5ffb700 1 -- 172.21.15.103:0/934970795 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39a8005e30 con 0x7f39a4004db0 2020-04-22T14:13:17.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.518+0000 7f39bead1700 1 -- 172.21.15.103:0/934970795 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39b813e020 con 0x7f39a4004db0 2020-04-22T14:13:17.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.518+0000 7f39bc86d700 1 --2- 172.21.15.103:0/934970795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39a4004db0 0x7f39b8157a50 secure :-1 s=THROTTLE_DONE pgs=1220 cs=0 l=1 rx=0x7f39b813f100 tx=0x7f39a8010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:17.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.519+0000 7f39bead1700 1 -- 172.21.15.103:0/934970795 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39b8157730 con 0x7f39a4004db0 2020-04-22T14:13:17.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.519+0000 7f39b5ffb700 1 -- 172.21.15.103:0/934970795 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f39a8007160 con 0x7f39a4004db0 2020-04-22T14:13:17.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.519+0000 7f39bc86d700 1 --2- 172.21.15.103:0/934970795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39a4004db0 0x7f39b8157a50 secure :-1 s=THROTTLE_DONE pgs=1220 cs=0 l=1 rx=0x7f39b813f100 tx=0x7f39a8010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:17.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.519+0000 7f39b5ffb700 1 --2- 172.21.15.103:0/934970795 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f399804d870 0x7f399804fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:17.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.519+0000 7f39b5ffb700 1 -- 172.21.15.103:0/934970795 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f39a80612b0 con 0x7f39a4004db0 2020-04-22T14:13:17.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.519+0000 7f39b7fff700 1 --2- 172.21.15.103:0/934970795 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f399804d870 0x7f399804fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:17.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.519+0000 7f39b7fff700 1 --2- 172.21.15.103:0/934970795 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f399804d870 0x7f399804fd30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f39ac0013e0 tx=0x7f39b8143ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:17.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.519+0000 7f39b7fff700 1 --2- 172.21.15.103:0/934970795 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f399804d870 0x7f399804fd30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f39ac0013e0 tx=0x7f39b8143ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:17.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.519+0000 7f39b7fff700 1 --2- 172.21.15.103:0/934970795 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f399804d870 0x7f399804fd30 secure :-1 s=READY pgs=449 cs=0 l=1 rx=0x7f39ac0013e0 tx=0x7f39b8143ee0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:17.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.523+0000 7f39bc86d700 1 --2- 172.21.15.103:0/934970795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39a4004db0 0x7f39b8157a50 secure :-1 s=THROTTLE_DONE pgs=1220 cs=0 l=1 rx=0x7f39b813f100 tx=0x7f39a8010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:17.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.523+0000 7f39b5ffb700 1 -- 172.21.15.103:0/934970795 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f39a803c6f0 con 0x7f39a4004db0 2020-04-22T14:13:17.714 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.711+0000 7f39bead1700 1 -- 172.21.15.103:0/934970795 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39b8056c90 con 0x7f39a4004db0 2020-04-22T14:13:17.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.711+0000 7f39bc86d700 1 --2- 172.21.15.103:0/934970795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39a4004db0 0x7f39b8157a50 secure :-1 s=THROTTLE_DONE pgs=1220 cs=0 l=1 rx=0x7f39b813f100 tx=0x7f39a8010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:17.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.711+0000 7f39b5ffb700 1 -- 172.21.15.103:0/934970795 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f39a803fd10 con 0x7f39a4004db0 2020-04-22T14:13:17.715 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:13:17.715 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:43.570838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:13:17.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.713+0000 7f39bead1700 1 -- 172.21.15.103:0/934970795 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f399804d870 msgr2=0x7f399804fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:17.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.713+0000 7f39bead1700 1 --2- 172.21.15.103:0/934970795 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f399804d870 0x7f399804fd30 secure :-1 s=READY pgs=449 cs=0 l=1 rx=0x7f39ac0013e0 tx=0x7f39b8143ee0).stop 2020-04-22T14:13:17.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.713+0000 7f39bead1700 1 -- 172.21.15.103:0/934970795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39a4004db0 msgr2=0x7f39b8157a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:17.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.713+0000 7f39bead1700 1 --2- 172.21.15.103:0/934970795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39a4004db0 0x7f39b8157a50 secure :-1 s=READY pgs=1220 cs=0 l=1 rx=0x7f39b813f100 tx=0x7f39a8010b40).stop 2020-04-22T14:13:17.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.713+0000 7f39bead1700 1 -- 172.21.15.103:0/934970795 shutdown_connections 2020-04-22T14:13:17.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.713+0000 7f39bead1700 1 --2- 172.21.15.103:0/934970795 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f399804d870 0x7f399804fd30 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:17.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.713+0000 7f39bead1700 1 --2- 172.21.15.103:0/934970795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39a4004db0 0x7f39b8157a50 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:17.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.713+0000 7f39bead1700 1 --2- 172.21.15.103:0/934970795 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f39b813eca0 0x7f39b8141dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:17.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.713+0000 7f39bead1700 1 -- 172.21.15.103:0/934970795 >> 172.21.15.103:0/934970795 conn(0x7f39b805f2c0 msgr2=0x7f39b80adc40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:17.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.713+0000 7f39bead1700 1 -- 172.21.15.103:0/934970795 shutdown_connections 2020-04-22T14:13:17.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:17.713+0000 7f39bead1700 1 -- 172.21.15.103:0/934970795 wait complete. 2020-04-22T14:13:17.718 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 54 2020-04-22T14:13:17.726 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:13:18.728 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:18.746 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:13:18.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.907+0000 7fa855fc0700 1 Processor -- start 2020-04-22T14:13:18.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.907+0000 7fa855fc0700 1 -- start start 2020-04-22T14:13:18.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.907+0000 7fa855fc0700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa85014ca00 0x7fa85014edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:18.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.907+0000 7fa855fc0700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8500ae860 con 0x7fa8501441f0 2020-04-22T14:13:18.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.907+0000 7fa855fc0700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8500b5900 con 0x7fa85005b7c0 2020-04-22T14:13:18.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.907+0000 7fa855fc0700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8500b5ba0 con 0x7fa85014ca00 2020-04-22T14:13:18.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.908+0000 7fa84f7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa85005b7c0 0x7fa8500b50d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45780/0 (socket says 172.21.15.103:45780) 2020-04-22T14:13:18.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.908+0000 7fa84f7fe700 1 -- 172.21.15.103:0/765649333 learned_addr learned my addr 172.21.15.103:0/765649333 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:18.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.908+0000 7fa84ffff700 1 --2- 172.21.15.103:0/765649333 >> v2:172.21.15.86:3300/0 conn(0x7fa85014ca00 0x7fa85014edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:18.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.908+0000 7fa84e7fc700 1 -- 172.21.15.103:0/765649333 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1202687198 0 0) 0x7fa8500b5900 con 0x7fa85005b7c0 2020-04-22T14:13:18.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.908+0000 7fa84e7fc700 1 -- 172.21.15.103:0/765649333 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa83c003230 con 0x7fa85005b7c0 2020-04-22T14:13:18.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.908+0000 7fa84e7fc700 1 -- 172.21.15.103:0/765649333 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3515348594 0 0) 0x7fa83c003230 con 0x7fa85005b7c0 2020-04-22T14:13:18.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.908+0000 7fa84e7fc700 1 -- 172.21.15.103:0/765649333 >> v2:172.21.15.86:3300/0 conn(0x7fa85014ca00 msgr2=0x7fa85014edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:18.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.908+0000 7fa84e7fc700 1 --2- 172.21.15.103:0/765649333 >> v2:172.21.15.86:3300/0 conn(0x7fa85014ca00 0x7fa85014edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:18.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.908+0000 7fa84e7fc700 1 -- 172.21.15.103:0/765649333 >> v1:172.21.15.86:6789/0 conn(0x7fa8501441f0 legacy=0x7fa850144820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:18.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.908+0000 7fa84e7fc700 1 -- 172.21.15.103:0/765649333 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8500b5e40 con 0x7fa85005b7c0 2020-04-22T14:13:18.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.908+0000 7fa84e7fc700 1 -- 172.21.15.103:0/765649333 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fa840001710 con 0x7fa85005b7c0 2020-04-22T14:13:18.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.908+0000 7fa84e7fc700 1 -- 172.21.15.103:0/765649333 >> v1:172.21.15.103:6789/0 conn(0x7fa85005b7c0 legacy=0x7fa8500b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:18.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.908+0000 7fa84e7fc700 1 --2- 172.21.15.103:0/765649333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa83c003720 0x7fa83c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:18.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.908+0000 7fa84e7fc700 1 --2- 172.21.15.103:0/765649333 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa83c0044d0 0x7fa83c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:18.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.908+0000 7fa84e7fc700 1 --2- 172.21.15.103:0/765649333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa83c004db0 0x7fa83c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:18.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.908+0000 7fa84e7fc700 1 -- 172.21.15.103:0/765649333 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8500b5ba0 con 0x7fa83c004db0 2020-04-22T14:13:18.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.908+0000 7fa84e7fc700 1 -- 172.21.15.103:0/765649333 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c0041c0 con 0x7fa83c003720 2020-04-22T14:13:18.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.908+0000 7fa84e7fc700 1 -- 172.21.15.103:0/765649333 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c00bb80 con 0x7fa83c0044d0 2020-04-22T14:13:18.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.908+0000 7fa84f7fe700 1 --2- 172.21.15.103:0/765649333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa83c003720 0x7fa83c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:18.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.908+0000 7fa84ffff700 1 --2- 172.21.15.103:0/765649333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa83c004db0 0x7fa83c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:18.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.908+0000 7fa84effd700 1 --2- 172.21.15.103:0/765649333 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa83c0044d0 0x7fa83c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:18.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.908+0000 7fa84f7fe700 1 -- 172.21.15.103:0/765649333 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa83c0044d0 msgr2=0x7fa83c004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:18.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.908+0000 7fa84f7fe700 1 --2- 172.21.15.103:0/765649333 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa83c0044d0 0x7fa83c004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:18.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.908+0000 7fa84f7fe700 1 -- 172.21.15.103:0/765649333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa83c004db0 msgr2=0x7fa83c00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:18.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.908+0000 7fa84f7fe700 1 --2- 172.21.15.103:0/765649333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa83c004db0 0x7fa83c00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:18.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.909+0000 7fa84ffff700 1 -- 172.21.15.103:0/765649333 reap_dead start 2020-04-22T14:13:18.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.909+0000 7fa84f7fe700 1 -- 172.21.15.103:0/765649333 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83c003230 con 0x7fa83c003720 2020-04-22T14:13:18.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.909+0000 7fa84f7fe700 1 --2- 172.21.15.103:0/765649333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa83c003720 0x7fa83c003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa83c0054a0 tx=0x7fa840001cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:18.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.909+0000 7fa84f7fe700 1 --2- 172.21.15.103:0/765649333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa83c003720 0x7fa83c003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa83c0054a0 tx=0x7fa840001cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:18.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.909+0000 7fa84f7fe700 1 --2- 172.21.15.103:0/765649333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa83c003720 0x7fa83c003b40 secure :-1 s=READY pgs=1222 cs=0 l=1 rx=0x7fa83c0054a0 tx=0x7fa840001cb0).ready entity=mon.1 client_cookie=c6510a34cba867b server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:18.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.909+0000 7fa84f7fe700 1 --2- 172.21.15.103:0/765649333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa83c003720 0x7fa83c003b40 secure :-1 s=THROTTLE_DONE pgs=1222 cs=0 l=1 rx=0x7fa83c0054a0 tx=0x7fa840001cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:18.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.909+0000 7fa84e7fc700 1 -- 172.21.15.103:0/765649333 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa840010370 con 0x7fa83c003720 2020-04-22T14:13:18.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.909+0000 7fa84f7fe700 1 --2- 172.21.15.103:0/765649333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa83c003720 0x7fa83c003b40 secure :-1 s=THROTTLE_DONE pgs=1222 cs=0 l=1 rx=0x7fa83c0054a0 tx=0x7fa840001cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:18.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.909+0000 7fa84f7fe700 1 --2- 172.21.15.103:0/765649333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa83c003720 0x7fa83c003b40 secure :-1 s=THROTTLE_DONE pgs=1222 cs=0 l=1 rx=0x7fa83c0054a0 tx=0x7fa840001cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:18.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.909+0000 7fa84e7fc700 1 -- 172.21.15.103:0/765649333 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa840010510 con 0x7fa83c003720 2020-04-22T14:13:18.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.909+0000 7fa84e7fc700 1 -- 172.21.15.103:0/765649333 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8400108f0 con 0x7fa83c003720 2020-04-22T14:13:18.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.909+0000 7fa855fc0700 1 -- 172.21.15.103:0/765649333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa83c003720 msgr2=0x7fa83c003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:18.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.909+0000 7fa855fc0700 1 --2- 172.21.15.103:0/765649333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa83c003720 0x7fa83c003b40 secure :-1 s=READY pgs=1222 cs=0 l=1 rx=0x7fa83c0054a0 tx=0x7fa840001cb0).stop 2020-04-22T14:13:18.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.909+0000 7fa855fc0700 1 -- 172.21.15.103:0/765649333 shutdown_connections 2020-04-22T14:13:18.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.909+0000 7fa855fc0700 1 --2- 172.21.15.103:0/765649333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa83c003720 0x7fa83c003b40 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:18.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.909+0000 7fa855fc0700 1 -- 172.21.15.103:0/765649333 >> 172.21.15.103:0/765649333 conn(0x7fa8500b9160 msgr2=0x7fa85005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:18.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.909+0000 7fa855fc0700 1 -- 172.21.15.103:0/765649333 shutdown_connections 2020-04-22T14:13:18.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.909+0000 7fa855fc0700 1 -- 172.21.15.103:0/765649333 wait complete. 2020-04-22T14:13:18.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.910+0000 7fa855fc0700 1 Processor -- start 2020-04-22T14:13:18.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.911+0000 7fa855fc0700 1 -- start start 2020-04-22T14:13:18.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.911+0000 7fa855fc0700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa83c003720 0x7fa850140fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:18.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.911+0000 7fa855fc0700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa8501391d0 0x7fa85013f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:18.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.911+0000 7fa855fc0700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa85013c1a0 con 0x7fa8500b0540 2020-04-22T14:13:18.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.911+0000 7fa855fc0700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa85013bfc0 con 0x7fa8501391d0 2020-04-22T14:13:18.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.911+0000 7fa855fc0700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa85013c440 con 0x7fa83c003720 2020-04-22T14:13:18.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.911+0000 7fa84f7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa83c003720 0x7fa850140fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:18.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.911+0000 7fa84f7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa83c003720 0x7fa850140fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53602/0 (socket says 172.21.15.103:53602) 2020-04-22T14:13:18.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.911+0000 7fa84effd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa8500b0540 0x7fa850138ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45794/0 (socket says 172.21.15.103:45794) 2020-04-22T14:13:18.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.911+0000 7fa84f7fe700 1 -- 172.21.15.103:0/3614346667 learned_addr learned my addr 172.21.15.103:0/3614346667 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:18.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.912+0000 7fa84ffff700 1 --2- 172.21.15.103:0/3614346667 >> v2:172.21.15.86:3300/0 conn(0x7fa8501391d0 0x7fa85013f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:18.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.912+0000 7fa84f7fe700 1 -- 172.21.15.103:0/3614346667 >> v2:172.21.15.86:3300/0 conn(0x7fa8501391d0 msgr2=0x7fa85013f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:18.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.912+0000 7fa84f7fe700 1 --2- 172.21.15.103:0/3614346667 >> v2:172.21.15.86:3300/0 conn(0x7fa8501391d0 0x7fa85013f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:18.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.912+0000 7fa84f7fe700 1 -- 172.21.15.103:0/3614346667 >> v1:172.21.15.103:6789/0 conn(0x7fa8500b0540 legacy=0x7fa850138ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:18.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.912+0000 7fa84cff9700 1 -- 172.21.15.103:0/3614346667 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 937592382 0 0) 0x7fa85013c1a0 con 0x7fa8500b0540 2020-04-22T14:13:18.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.912+0000 7fa84f7fe700 1 -- 172.21.15.103:0/3614346667 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa85013c8e0 con 0x7fa83c003720 2020-04-22T14:13:18.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.912+0000 7fa84ffff700 1 --2- 172.21.15.103:0/3614346667 >> v2:172.21.15.86:3300/0 conn(0x7fa8501391d0 0x7fa85013f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:13:18.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.912+0000 7fa84f7fe700 1 --2- 172.21.15.103:0/3614346667 >> v2:172.21.15.103:3300/0 conn(0x7fa83c003720 0x7fa850140fd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa83c0054a0 tx=0x7fa840001cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:18.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.912+0000 7fa84f7fe700 1 --2- 172.21.15.103:0/3614346667 >> v2:172.21.15.103:3300/0 conn(0x7fa83c003720 0x7fa850140fd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa83c0054a0 tx=0x7fa840001cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:18.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.912+0000 7fa84f7fe700 1 --2- 172.21.15.103:0/3614346667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa83c003720 0x7fa850140fd0 secure :-1 s=READY pgs=1224 cs=0 l=1 rx=0x7fa83c0054a0 tx=0x7fa840001cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:18.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.912+0000 7fa84f7fe700 1 --2- 172.21.15.103:0/3614346667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa83c003720 0x7fa850140fd0 secure :-1 s=THROTTLE_DONE pgs=1224 cs=0 l=1 rx=0x7fa83c0054a0 tx=0x7fa840001cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:18.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.912+0000 7fa84cff9700 1 -- 172.21.15.103:0/3614346667 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8400048f0 con 0x7fa83c003720 2020-04-22T14:13:18.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.912+0000 7fa84f7fe700 1 --2- 172.21.15.103:0/3614346667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa83c003720 0x7fa850140fd0 secure :-1 s=THROTTLE_DONE pgs=1224 cs=0 l=1 rx=0x7fa83c0054a0 tx=0x7fa840001cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:18.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.912+0000 7fa84cff9700 1 -- 172.21.15.103:0/3614346667 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa840004a50 con 0x7fa83c003720 2020-04-22T14:13:18.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.912+0000 7fa84f7fe700 1 --2- 172.21.15.103:0/3614346667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa83c003720 0x7fa850140fd0 secure :-1 s=THROTTLE_DONE pgs=1224 cs=0 l=1 rx=0x7fa83c0054a0 tx=0x7fa840001cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:18.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.912+0000 7fa855fc0700 1 -- 172.21.15.103:0/3614346667 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8500b09a0 con 0x7fa83c003720 2020-04-22T14:13:18.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.912+0000 7fa84cff9700 1 -- 172.21.15.103:0/3614346667 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa840004e30 con 0x7fa83c003720 2020-04-22T14:13:18.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.912+0000 7fa855fc0700 1 -- 172.21.15.103:0/3614346667 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa85013f900 con 0x7fa83c003720 2020-04-22T14:13:18.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.913+0000 7fa84f7fe700 1 --2- 172.21.15.103:0/3614346667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa83c003720 0x7fa850140fd0 secure :-1 s=THROTTLE_DONE pgs=1224 cs=0 l=1 rx=0x7fa83c0054a0 tx=0x7fa840001cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:18.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.913+0000 7fa855fc0700 1 -- 172.21.15.103:0/3614346667 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa850056c90 con 0x7fa83c003720 2020-04-22T14:13:18.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.913+0000 7fa84cff9700 1 -- 172.21.15.103:0/3614346667 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fa8400152f0 con 0x7fa83c003720 2020-04-22T14:13:18.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.913+0000 7fa84f7fe700 1 --2- 172.21.15.103:0/3614346667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa83c003720 0x7fa850140fd0 secure :-1 s=THROTTLE_DONE pgs=1224 cs=0 l=1 rx=0x7fa83c0054a0 tx=0x7fa840001cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:18.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.913+0000 7fa84cff9700 1 --2- 172.21.15.103:0/3614346667 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa83004d7a0 0x7fa83004fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:18.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.913+0000 7fa84cff9700 1 -- 172.21.15.103:0/3614346667 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fa840061cf0 con 0x7fa83c003720 2020-04-22T14:13:18.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.914+0000 7fa84effd700 1 --2- 172.21.15.103:0/3614346667 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa83004d7a0 0x7fa83004fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:18.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.914+0000 7fa84effd700 1 --2- 172.21.15.103:0/3614346667 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa83004d7a0 0x7fa83004fc60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa844001370 tx=0x7fa844003830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:18.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.914+0000 7fa84effd700 1 --2- 172.21.15.103:0/3614346667 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa83004d7a0 0x7fa83004fc60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa844001370 tx=0x7fa844003830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:18.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.914+0000 7fa84effd700 1 --2- 172.21.15.103:0/3614346667 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa83004d7a0 0x7fa83004fc60 secure :-1 s=READY pgs=450 cs=0 l=1 rx=0x7fa844001370 tx=0x7fa844003830).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:18.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.917+0000 7fa84f7fe700 1 --2- 172.21.15.103:0/3614346667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa83c003720 0x7fa850140fd0 secure :-1 s=THROTTLE_DONE pgs=1224 cs=0 l=1 rx=0x7fa83c0054a0 tx=0x7fa840001cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:18.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:18.917+0000 7fa84cff9700 1 -- 172.21.15.103:0/3614346667 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fa84003d130 con 0x7fa83c003720 2020-04-22T14:13:19.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:19.110+0000 7fa855fc0700 1 -- 172.21.15.103:0/3614346667 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa8501419f0 con 0x7fa83c003720 2020-04-22T14:13:19.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:19.111+0000 7fa84f7fe700 1 --2- 172.21.15.103:0/3614346667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa83c003720 0x7fa850140fd0 secure :-1 s=THROTTLE_DONE pgs=1224 cs=0 l=1 rx=0x7fa83c0054a0 tx=0x7fa840001cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:19.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:19.111+0000 7fa84cff9700 1 -- 172.21.15.103:0/3614346667 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2147 (secure 0 0 0) 0x7fa840040750 con 0x7fa83c003720 2020-04-22T14:13:19.114 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:13:19.115 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:43.570838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:13:19.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:19.112+0000 7fa855fc0700 1 -- 172.21.15.103:0/3614346667 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa83004d7a0 msgr2=0x7fa83004fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:19.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:19.112+0000 7fa855fc0700 1 --2- 172.21.15.103:0/3614346667 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa83004d7a0 0x7fa83004fc60 secure :-1 s=READY pgs=450 cs=0 l=1 rx=0x7fa844001370 tx=0x7fa844003830).stop 2020-04-22T14:13:19.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:19.112+0000 7fa855fc0700 1 -- 172.21.15.103:0/3614346667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa83c003720 msgr2=0x7fa850140fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:19.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:19.112+0000 7fa855fc0700 1 --2- 172.21.15.103:0/3614346667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa83c003720 0x7fa850140fd0 secure :-1 s=READY pgs=1224 cs=0 l=1 rx=0x7fa83c0054a0 tx=0x7fa840001cb0).stop 2020-04-22T14:13:19.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:19.112+0000 7fa855fc0700 1 -- 172.21.15.103:0/3614346667 shutdown_connections 2020-04-22T14:13:19.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:19.112+0000 7fa855fc0700 1 --2- 172.21.15.103:0/3614346667 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa83004d7a0 0x7fa83004fc60 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:19.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:19.112+0000 7fa855fc0700 1 --2- 172.21.15.103:0/3614346667 >> v2:172.21.15.86:3300/0 conn(0x7fa8501391d0 0x7fa85013f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:19.117 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:19.112+0000 7fa855fc0700 1 --2- 172.21.15.103:0/3614346667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa83c003720 0x7fa850140fd0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:19.117 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:19.112+0000 7fa855fc0700 1 -- 172.21.15.103:0/3614346667 >> 172.21.15.103:0/3614346667 conn(0x7fa8500b9160 msgr2=0x7fa850066cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:19.117 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:19.112+0000 7fa855fc0700 1 -- 172.21.15.103:0/3614346667 shutdown_connections 2020-04-22T14:13:19.117 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:19.112+0000 7fa855fc0700 1 -- 172.21.15.103:0/3614346667 wait complete. 2020-04-22T14:13:19.117 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 54 2020-04-22T14:13:19.143 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:13:20.144 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:20.170 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:13:20.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.322+0000 7f3ea0713700 1 Processor -- start 2020-04-22T14:13:20.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.322+0000 7f3ea0713700 1 -- start start 2020-04-22T14:13:20.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.323+0000 7f3ea0713700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e9812c0d0 0x7f3e981464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:20.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.323+0000 7f3ea0713700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e98143300 con 0x7f3e98065fe0 2020-04-22T14:13:20.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.323+0000 7f3ea0713700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e981435a0 con 0x7f3e98063e30 2020-04-22T14:13:20.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.323+0000 7f3ea0713700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e98143840 con 0x7f3e9812c0d0 2020-04-22T14:13:20.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.323+0000 7f3e9ecb0700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f3e98063e30 0x7f3e980642a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45804/0 (socket says 172.21.15.103:45804) 2020-04-22T14:13:20.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.323+0000 7f3e9ecb0700 1 -- 172.21.15.103:0/2501487405 learned_addr learned my addr 172.21.15.103:0/2501487405 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:20.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.323+0000 7f3e9e4af700 1 --2- 172.21.15.103:0/2501487405 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e9812c0d0 0x7f3e981464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:20.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.323+0000 7f3e9d4ad700 1 -- 172.21.15.103:0/2501487405 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3136803954 0 0) 0x7f3e981435a0 con 0x7f3e98063e30 2020-04-22T14:13:20.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.323+0000 7f3e9d4ad700 1 -- 172.21.15.103:0/2501487405 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e80003230 con 0x7f3e98063e30 2020-04-22T14:13:20.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.323+0000 7f3e9d4ad700 1 -- 172.21.15.103:0/2501487405 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 891801170 0 0) 0x7f3e80003230 con 0x7f3e98063e30 2020-04-22T14:13:20.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.323+0000 7f3e9d4ad700 1 -- 172.21.15.103:0/2501487405 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e9812c0d0 msgr2=0x7f3e981464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:20.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.323+0000 7f3e9d4ad700 1 --2- 172.21.15.103:0/2501487405 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e9812c0d0 0x7f3e981464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:20.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.323+0000 7f3e9d4ad700 1 -- 172.21.15.103:0/2501487405 >> v1:172.21.15.86:6789/0 conn(0x7f3e98065fe0 legacy=0x7f3e9805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:20.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.323+0000 7f3e9d4ad700 1 -- 172.21.15.103:0/2501487405 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e9805bb50 con 0x7f3e98063e30 2020-04-22T14:13:20.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.324+0000 7f3e9d4ad700 1 -- 172.21.15.103:0/2501487405 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f3e90001a50 con 0x7f3e98063e30 2020-04-22T14:13:20.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.324+0000 7f3e9d4ad700 1 -- 172.21.15.103:0/2501487405 >> v1:172.21.15.103:6789/0 conn(0x7f3e98063e30 legacy=0x7f3e980642a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:20.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.324+0000 7f3e9d4ad700 1 --2- 172.21.15.103:0/2501487405 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e9812c0d0 0x7f3e80003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:20.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.324+0000 7f3e9d4ad700 1 --2- 172.21.15.103:0/2501487405 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e80003b80 0x7f3e80003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:20.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.324+0000 7f3e9d4ad700 1 --2- 172.21.15.103:0/2501487405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e80004570 0x7f3e800049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:20.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.324+0000 7f3e9d4ad700 1 -- 172.21.15.103:0/2501487405 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e98143840 con 0x7f3e80004570 2020-04-22T14:13:20.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.324+0000 7f3e9d4ad700 1 -- 172.21.15.103:0/2501487405 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e80004f80 con 0x7f3e80003b80 2020-04-22T14:13:20.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.324+0000 7f3e9d4ad700 1 -- 172.21.15.103:0/2501487405 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e80005140 con 0x7f3e9812c0d0 2020-04-22T14:13:20.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.324+0000 7f3e9dcae700 1 --2- 172.21.15.103:0/2501487405 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e80003b80 0x7f3e80003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:20.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.324+0000 7f3e9e4af700 1 --2- 172.21.15.103:0/2501487405 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e9812c0d0 0x7f3e80003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:20.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.324+0000 7f3e9ecb0700 1 --2- 172.21.15.103:0/2501487405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e80004570 0x7f3e800049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:20.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.324+0000 7f3e9dcae700 1 -- 172.21.15.103:0/2501487405 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e9812c0d0 msgr2=0x7f3e80003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:20.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.324+0000 7f3e9dcae700 1 --2- 172.21.15.103:0/2501487405 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e9812c0d0 0x7f3e80003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:20.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.324+0000 7f3e9dcae700 1 -- 172.21.15.103:0/2501487405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e80004570 msgr2=0x7f3e800049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:20.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.324+0000 7f3e9dcae700 1 --2- 172.21.15.103:0/2501487405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e80004570 0x7f3e800049d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:20.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.324+0000 7f3e9dcae700 1 -- 172.21.15.103:0/2501487405 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e80003230 con 0x7f3e80003b80 2020-04-22T14:13:20.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.324+0000 7f3e9dcae700 1 --2- 172.21.15.103:0/2501487405 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e80003b80 0x7f3e80003fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3e94000fe0 tx=0x7f3e94011fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:20.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.324+0000 7f3e9dcae700 1 --2- 172.21.15.103:0/2501487405 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e80003b80 0x7f3e80003fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3e94000fe0 tx=0x7f3e94011fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:20.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.324+0000 7f3e9dcae700 1 --2- 172.21.15.103:0/2501487405 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e80003b80 0x7f3e80003fe0 secure :-1 s=READY pgs=1226 cs=0 l=1 rx=0x7f3e94000fe0 tx=0x7f3e94011fe0).ready entity=mon.1 client_cookie=8cc97d754d73c06c server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:20.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.324+0000 7f3e9dcae700 1 --2- 172.21.15.103:0/2501487405 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e80003b80 0x7f3e80003fe0 secure :-1 s=THROTTLE_DONE pgs=1226 cs=0 l=1 rx=0x7f3e94000fe0 tx=0x7f3e94011fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:20.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.324+0000 7f3e9dcae700 1 --2- 172.21.15.103:0/2501487405 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e80003b80 0x7f3e80003fe0 secure :-1 s=THROTTLE_DONE pgs=1226 cs=0 l=1 rx=0x7f3e94000fe0 tx=0x7f3e94011fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:20.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.324+0000 7f3e9dcae700 1 --2- 172.21.15.103:0/2501487405 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e80003b80 0x7f3e80003fe0 secure :-1 s=THROTTLE_DONE pgs=1226 cs=0 l=1 rx=0x7f3e94000fe0 tx=0x7f3e94011fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:20.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.324+0000 7f3e9d4ad700 1 -- 172.21.15.103:0/2501487405 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e94003560 con 0x7f3e80003b80 2020-04-22T14:13:20.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.324+0000 7f3e9d4ad700 1 -- 172.21.15.103:0/2501487405 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e940036c0 con 0x7f3e80003b80 2020-04-22T14:13:20.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.324+0000 7f3e9d4ad700 1 -- 172.21.15.103:0/2501487405 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e94003ae0 con 0x7f3e80003b80 2020-04-22T14:13:20.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.324+0000 7f3ea0713700 1 -- 172.21.15.103:0/2501487405 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e80003b80 msgr2=0x7f3e80003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:20.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.324+0000 7f3ea0713700 1 --2- 172.21.15.103:0/2501487405 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e80003b80 0x7f3e80003fe0 secure :-1 s=READY pgs=1226 cs=0 l=1 rx=0x7f3e94000fe0 tx=0x7f3e94011fe0).stop 2020-04-22T14:13:20.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.324+0000 7f3e9ecb0700 1 -- 172.21.15.103:0/2501487405 reap_dead start 2020-04-22T14:13:20.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.325+0000 7f3ea0713700 1 -- 172.21.15.103:0/2501487405 shutdown_connections 2020-04-22T14:13:20.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.325+0000 7f3ea0713700 1 -- 172.21.15.103:0/2501487405 >> 172.21.15.103:0/2501487405 conn(0x7f3e980b9160 msgr2=0x7f3e9805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:20.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.325+0000 7f3ea0713700 1 -- 172.21.15.103:0/2501487405 shutdown_connections 2020-04-22T14:13:20.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.325+0000 7f3ea0713700 1 -- 172.21.15.103:0/2501487405 wait complete. 2020-04-22T14:13:20.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.326+0000 7f3ea0713700 1 Processor -- start 2020-04-22T14:13:20.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.326+0000 7f3ea0713700 1 -- start start 2020-04-22T14:13:20.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.327+0000 7f3ea0713700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3e980628d0 0x7f3e98127480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:20.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.327+0000 7f3ea0713700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e980afe80 con 0x7f3e980af960 2020-04-22T14:13:20.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.327+0000 7f3ea0713700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e980ad2d0 con 0x7f3e981278e0 2020-04-22T14:13:20.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.327+0000 7f3ea0713700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e980ad570 con 0x7f3e980628d0 2020-04-22T14:13:20.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.327+0000 7f3e9dcae700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f3e981278e0 0x7f3e980af250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45814/0 (socket says 172.21.15.103:45814) 2020-04-22T14:13:20.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.327+0000 7f3e9dcae700 1 -- 172.21.15.103:0/2288765201 learned_addr learned my addr 172.21.15.103:0/2288765201 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:20.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.327+0000 7f3e9e4af700 1 --2- 172.21.15.103:0/2288765201 >> v2:172.21.15.86:3300/0 conn(0x7f3e980628d0 0x7f3e98127480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:20.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.327+0000 7f3e877fe700 1 -- 172.21.15.103:0/2288765201 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1174722326 0 0) 0x7f3e980ad2d0 con 0x7f3e981278e0 2020-04-22T14:13:20.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.327+0000 7f3e877fe700 1 -- 172.21.15.103:0/2288765201 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e78002fe0 con 0x7f3e981278e0 2020-04-22T14:13:20.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.327+0000 7f3e877fe700 1 -- 172.21.15.103:0/2288765201 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 201935820 0 0) 0x7f3e78002fe0 con 0x7f3e981278e0 2020-04-22T14:13:20.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.327+0000 7f3e9e4af700 1 -- 172.21.15.103:0/2288765201 >> v1:172.21.15.103:6789/0 conn(0x7f3e981278e0 legacy=0x7f3e980af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:20.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.327+0000 7f3e9e4af700 1 -- 172.21.15.103:0/2288765201 >> v1:172.21.15.86:6789/0 conn(0x7f3e980af960 legacy=0x7f3e980ada10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:20.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.327+0000 7f3e9e4af700 1 -- 172.21.15.103:0/2288765201 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e98062cb0 con 0x7f3e980628d0 2020-04-22T14:13:20.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.327+0000 7f3e9e4af700 1 --2- 172.21.15.103:0/2288765201 >> v2:172.21.15.86:3300/0 conn(0x7f3e980628d0 0x7f3e98127480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3e90001450 tx=0x7f3e88010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:20.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.327+0000 7f3e9e4af700 1 --2- 172.21.15.103:0/2288765201 >> v2:172.21.15.86:3300/0 conn(0x7f3e980628d0 0x7f3e98127480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3e90001450 tx=0x7f3e88010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:20.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.327+0000 7f3e9e4af700 1 --2- 172.21.15.103:0/2288765201 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e980628d0 0x7f3e98127480 secure :-1 s=READY pgs=664 cs=0 l=1 rx=0x7f3e90001450 tx=0x7f3e88010c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:20.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.327+0000 7f3e9e4af700 1 --2- 172.21.15.103:0/2288765201 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e980628d0 0x7f3e98127480 secure :-1 s=THROTTLE_DONE pgs=664 cs=0 l=1 rx=0x7f3e90001450 tx=0x7f3e88010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:20.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.327+0000 7f3e877fe700 1 -- 172.21.15.103:0/2288765201 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e94001210 con 0x7f3e980628d0 2020-04-22T14:13:20.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.327+0000 7f3e9e4af700 1 --2- 172.21.15.103:0/2288765201 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e980628d0 0x7f3e98127480 secure :-1 s=THROTTLE_DONE pgs=664 cs=0 l=1 rx=0x7f3e90001450 tx=0x7f3e88010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:20.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.327+0000 7f3e877fe700 1 -- 172.21.15.103:0/2288765201 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e880058b0 con 0x7f3e980628d0 2020-04-22T14:13:20.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.327+0000 7f3ea0713700 1 -- 172.21.15.103:0/2288765201 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e980ae120 con 0x7f3e980628d0 2020-04-22T14:13:20.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.327+0000 7f3e9e4af700 1 --2- 172.21.15.103:0/2288765201 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e980628d0 0x7f3e98127480 secure :-1 s=THROTTLE_DONE pgs=664 cs=0 l=1 rx=0x7f3e90001450 tx=0x7f3e88010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:20.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.327+0000 7f3e877fe700 1 -- 172.21.15.103:0/2288765201 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e88005c10 con 0x7f3e980628d0 2020-04-22T14:13:20.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.327+0000 7f3ea0713700 1 -- 172.21.15.103:0/2288765201 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e980ae610 con 0x7f3e980628d0 2020-04-22T14:13:20.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.328+0000 7f3e9e4af700 1 --2- 172.21.15.103:0/2288765201 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e980628d0 0x7f3e98127480 secure :-1 s=THROTTLE_DONE pgs=664 cs=0 l=1 rx=0x7f3e90001450 tx=0x7f3e88010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:20.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.329+0000 7f3ea0713700 1 -- 172.21.15.103:0/2288765201 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e980aeca0 con 0x7f3e980628d0 2020-04-22T14:13:20.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.329+0000 7f3e877fe700 1 -- 172.21.15.103:0/2288765201 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f3e88007160 con 0x7f3e980628d0 2020-04-22T14:13:20.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.329+0000 7f3e9e4af700 1 --2- 172.21.15.103:0/2288765201 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e980628d0 0x7f3e98127480 secure :-1 s=THROTTLE_DONE pgs=664 cs=0 l=1 rx=0x7f3e90001450 tx=0x7f3e88010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:20.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.329+0000 7f3e877fe700 1 --2- 172.21.15.103:0/2288765201 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3e7804dc20 0x7f3e780500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:20.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.329+0000 7f3e877fe700 1 -- 172.21.15.103:0/2288765201 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f3e88060f10 con 0x7f3e980628d0 2020-04-22T14:13:20.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.329+0000 7f3e9dcae700 1 --2- 172.21.15.103:0/2288765201 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3e7804dc20 0x7f3e780500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:20.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.329+0000 7f3e9dcae700 1 --2- 172.21.15.103:0/2288765201 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3e7804dc20 0x7f3e780500e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3e940010d0 tx=0x7f3e94011fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:20.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.329+0000 7f3e9dcae700 1 --2- 172.21.15.103:0/2288765201 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3e7804dc20 0x7f3e780500e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3e940010d0 tx=0x7f3e94011fe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:20.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.329+0000 7f3e9dcae700 1 --2- 172.21.15.103:0/2288765201 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3e7804dc20 0x7f3e780500e0 secure :-1 s=READY pgs=451 cs=0 l=1 rx=0x7f3e940010d0 tx=0x7f3e94011fe0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:20.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.334+0000 7f3e9e4af700 1 --2- 172.21.15.103:0/2288765201 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e980628d0 0x7f3e98127480 secure :-1 s=THROTTLE_DONE pgs=664 cs=0 l=1 rx=0x7f3e90001450 tx=0x7f3e88010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:20.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.334+0000 7f3e877fe700 1 -- 172.21.15.103:0/2288765201 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f3e8803c290 con 0x7f3e980628d0 2020-04-22T14:13:20.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.523+0000 7f3ea0713700 1 -- 172.21.15.103:0/2288765201 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e98056c90 con 0x7f3e980628d0 2020-04-22T14:13:20.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.524+0000 7f3e9e4af700 1 --2- 172.21.15.103:0/2288765201 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e980628d0 0x7f3e98127480 secure :-1 s=THROTTLE_DONE pgs=664 cs=0 l=1 rx=0x7f3e90001450 tx=0x7f3e88010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:20.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.524+0000 7f3e877fe700 1 -- 172.21.15.103:0/2288765201 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f3e8803f8b0 con 0x7f3e980628d0 2020-04-22T14:13:20.528 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:13:20.528 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:43.570838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:13:20.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.526+0000 7f3ea0713700 1 -- 172.21.15.103:0/2288765201 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3e7804dc20 msgr2=0x7f3e780500e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:20.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.526+0000 7f3ea0713700 1 --2- 172.21.15.103:0/2288765201 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3e7804dc20 0x7f3e780500e0 secure :-1 s=READY pgs=451 cs=0 l=1 rx=0x7f3e940010d0 tx=0x7f3e94011fe0).stop 2020-04-22T14:13:20.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.526+0000 7f3ea0713700 1 -- 172.21.15.103:0/2288765201 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e980628d0 msgr2=0x7f3e98127480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:20.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.526+0000 7f3ea0713700 1 --2- 172.21.15.103:0/2288765201 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e980628d0 0x7f3e98127480 secure :-1 s=READY pgs=664 cs=0 l=1 rx=0x7f3e90001450 tx=0x7f3e88010c00).stop 2020-04-22T14:13:20.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.526+0000 7f3ea0713700 1 -- 172.21.15.103:0/2288765201 shutdown_connections 2020-04-22T14:13:20.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.526+0000 7f3ea0713700 1 --2- 172.21.15.103:0/2288765201 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3e7804dc20 0x7f3e780500e0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:20.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.526+0000 7f3ea0713700 1 --2- 172.21.15.103:0/2288765201 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e980628d0 0x7f3e98127480 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:20.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.526+0000 7f3ea0713700 1 -- 172.21.15.103:0/2288765201 >> 172.21.15.103:0/2288765201 conn(0x7f3e980b9160 msgr2=0x7f3e98143d90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:20.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.526+0000 7f3ea0713700 1 -- 172.21.15.103:0/2288765201 shutdown_connections 2020-04-22T14:13:20.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:20.526+0000 7f3ea0713700 1 -- 172.21.15.103:0/2288765201 wait complete. 2020-04-22T14:13:20.531 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 54 2020-04-22T14:13:20.539 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:13:21.540 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:21.557 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:13:21.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.710+0000 7ff71227b700 1 Processor -- start 2020-04-22T14:13:21.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.710+0000 7ff71227b700 1 -- start start 2020-04-22T14:13:21.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.711+0000 7ff71227b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff70c065fe0 0x7ff70c1464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:21.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.711+0000 7ff71227b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff70c063e30 0x7ff70c0642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:21.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.711+0000 7ff71227b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff70c143300 con 0x7ff70c12c0d0 2020-04-22T14:13:21.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.711+0000 7ff71227b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff70c1435a0 con 0x7ff70c065fe0 2020-04-22T14:13:21.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.711+0000 7ff71227b700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff70c143840 con 0x7ff70c063e30 2020-04-22T14:13:21.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.711+0000 7ff710818700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff70c063e30 0x7ff70c0642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:21.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.711+0000 7ff710818700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff70c063e30 0x7ff70c0642c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53630/0 (socket says 172.21.15.103:53630) 2020-04-22T14:13:21.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.711+0000 7ff710818700 1 -- 172.21.15.103:0/320709002 learned_addr learned my addr 172.21.15.103:0/320709002 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:21.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.711+0000 7ff70b7fe700 1 --2- 172.21.15.103:0/320709002 >> v2:172.21.15.86:3300/0 conn(0x7ff70c065fe0 0x7ff70c1464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:21.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.711+0000 7ff710818700 1 -- 172.21.15.103:0/320709002 >> v2:172.21.15.86:3300/0 conn(0x7ff70c065fe0 msgr2=0x7ff70c1464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:21.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.711+0000 7ff710818700 1 --2- 172.21.15.103:0/320709002 >> v2:172.21.15.86:3300/0 conn(0x7ff70c065fe0 0x7ff70c1464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:21.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.711+0000 7ff710818700 1 -- 172.21.15.103:0/320709002 >> v1:172.21.15.86:6789/0 conn(0x7ff70c12c0d0 legacy=0x7ff70c05b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:21.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.711+0000 7ff710818700 1 -- 172.21.15.103:0/320709002 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff70c05bb50 con 0x7ff70c063e30 2020-04-22T14:13:21.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.711+0000 7ff70b7fe700 1 --2- 172.21.15.103:0/320709002 >> v2:172.21.15.86:3300/0 conn(0x7ff70c065fe0 0x7ff70c1464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:13:21.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.712+0000 7ff710818700 1 --2- 172.21.15.103:0/320709002 >> v2:172.21.15.103:3300/0 conn(0x7ff70c063e30 0x7ff70c0642c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff70c0669a0 tx=0x7ff704007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:21.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.712+0000 7ff710818700 1 --2- 172.21.15.103:0/320709002 >> v2:172.21.15.103:3300/0 conn(0x7ff70c063e30 0x7ff70c0642c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff70c0669a0 tx=0x7ff704007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:21.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.712+0000 7ff710818700 1 --2- 172.21.15.103:0/320709002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff70c063e30 0x7ff70c0642c0 secure :-1 s=READY pgs=1228 cs=0 l=1 rx=0x7ff70c0669a0 tx=0x7ff704007dc0).ready entity=mon.1 client_cookie=93f39cb86da01a23 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:21.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.712+0000 7ff710818700 1 --2- 172.21.15.103:0/320709002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff70c063e30 0x7ff70c0642c0 secure :-1 s=THROTTLE_DONE pgs=1228 cs=0 l=1 rx=0x7ff70c0669a0 tx=0x7ff704007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:21.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.712+0000 7ff70affd700 1 -- 172.21.15.103:0/320709002 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff70400a180 con 0x7ff70c063e30 2020-04-22T14:13:21.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.712+0000 7ff710818700 1 --2- 172.21.15.103:0/320709002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff70c063e30 0x7ff70c0642c0 secure :-1 s=THROTTLE_DONE pgs=1228 cs=0 l=1 rx=0x7ff70c0669a0 tx=0x7ff704007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:21.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.712+0000 7ff710818700 1 --2- 172.21.15.103:0/320709002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff70c063e30 0x7ff70c0642c0 secure :-1 s=THROTTLE_DONE pgs=1228 cs=0 l=1 rx=0x7ff70c0669a0 tx=0x7ff704007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:21.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.712+0000 7ff70affd700 1 -- 172.21.15.103:0/320709002 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff70400a2e0 con 0x7ff70c063e30 2020-04-22T14:13:21.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.712+0000 7ff70affd700 1 -- 172.21.15.103:0/320709002 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff70400a6c0 con 0x7ff70c063e30 2020-04-22T14:13:21.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.712+0000 7ff71227b700 1 -- 172.21.15.103:0/320709002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff70c063e30 msgr2=0x7ff70c0642c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:21.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.712+0000 7ff71227b700 1 --2- 172.21.15.103:0/320709002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff70c063e30 0x7ff70c0642c0 secure :-1 s=READY pgs=1228 cs=0 l=1 rx=0x7ff70c0669a0 tx=0x7ff704007dc0).stop 2020-04-22T14:13:21.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.712+0000 7ff71227b700 1 -- 172.21.15.103:0/320709002 shutdown_connections 2020-04-22T14:13:21.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.712+0000 7ff71227b700 1 --2- 172.21.15.103:0/320709002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff70c063e30 0x7ff70c0642c0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:21.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.712+0000 7ff71227b700 1 --2- 172.21.15.103:0/320709002 >> v2:172.21.15.86:3300/0 conn(0x7ff70c065fe0 0x7ff70c1464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:21.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.712+0000 7ff71227b700 1 -- 172.21.15.103:0/320709002 >> 172.21.15.103:0/320709002 conn(0x7ff70c0b9160 msgr2=0x7ff70c05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:21.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.712+0000 7ff71227b700 1 -- 172.21.15.103:0/320709002 shutdown_connections 2020-04-22T14:13:21.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.712+0000 7ff71227b700 1 -- 172.21.15.103:0/320709002 wait complete. 2020-04-22T14:13:21.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.713+0000 7ff71227b700 1 Processor -- start 2020-04-22T14:13:21.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.713+0000 7ff71227b700 1 -- start start 2020-04-22T14:13:21.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.714+0000 7ff71227b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff70c065fe0 0x7ff70c0b4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:21.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.714+0000 7ff71227b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff70c12c0d0 0x7ff70c1543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:21.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.714+0000 7ff71227b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff70c0b45e0 con 0x7ff70c063e30 2020-04-22T14:13:21.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.714+0000 7ff71227b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff70c155010 con 0x7ff70c12c0d0 2020-04-22T14:13:21.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.714+0000 7ff71227b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff70c0b3d90 con 0x7ff70c065fe0 2020-04-22T14:13:21.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.714+0000 7ff70b7fe700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff70c065fe0 0x7ff70c0b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:21.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.714+0000 7ff710818700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff70c12c0d0 0x7ff70c1543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:21.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.714+0000 7ff70b7fe700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff70c065fe0 0x7ff70c0b4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:38416/0 (socket says 172.21.15.103:38416) 2020-04-22T14:13:21.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.714+0000 7ff70bfff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7ff70c063e30 0x7ff70c127060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:34750/0 (socket says 172.21.15.103:34750) 2020-04-22T14:13:21.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.714+0000 7ff70b7fe700 1 -- 172.21.15.103:0/544227393 learned_addr learned my addr 172.21.15.103:0/544227393 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:21.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.715+0000 7ff70b7fe700 1 -- 172.21.15.103:0/544227393 >> v2:172.21.15.86:3300/0 conn(0x7ff70c12c0d0 msgr2=0x7ff70c1543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:21.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.715+0000 7ff70b7fe700 1 --2- 172.21.15.103:0/544227393 >> v2:172.21.15.86:3300/0 conn(0x7ff70c12c0d0 0x7ff70c1543f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:21.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.715+0000 7ff70b7fe700 1 -- 172.21.15.103:0/544227393 >> v1:172.21.15.86:6789/0 conn(0x7ff70c063e30 legacy=0x7ff70c127060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:21.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.715+0000 7ff70b7fe700 1 -- 172.21.15.103:0/544227393 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff70c154b70 con 0x7ff70c065fe0 2020-04-22T14:13:21.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.715+0000 7ff70b7fe700 1 --2- 172.21.15.103:0/544227393 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff70c065fe0 0x7ff70c0b4180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff700002f30 tx=0x7ff700010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:21.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.715+0000 7ff70b7fe700 1 --2- 172.21.15.103:0/544227393 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff70c065fe0 0x7ff70c0b4180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff700002f30 tx=0x7ff700010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:21.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.715+0000 7ff70b7fe700 1 --2- 172.21.15.103:0/544227393 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff70c065fe0 0x7ff70c0b4180 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7ff700002f30 tx=0x7ff700010ab0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:21.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.715+0000 7ff70b7fe700 1 --2- 172.21.15.103:0/544227393 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff70c065fe0 0x7ff70c0b4180 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7ff700002f30 tx=0x7ff700010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:21.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.715+0000 7ff7097fa700 1 -- 172.21.15.103:0/544227393 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff700007180 con 0x7ff70c065fe0 2020-04-22T14:13:21.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.715+0000 7ff70b7fe700 1 --2- 172.21.15.103:0/544227393 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff70c065fe0 0x7ff70c0b4180 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7ff700002f30 tx=0x7ff700010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:21.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.715+0000 7ff70b7fe700 1 --2- 172.21.15.103:0/544227393 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff70c065fe0 0x7ff70c0b4180 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7ff700002f30 tx=0x7ff700010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:21.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.715+0000 7ff7097fa700 1 -- 172.21.15.103:0/544227393 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff700007320 con 0x7ff70c065fe0 2020-04-22T14:13:21.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.715+0000 7ff71227b700 1 -- 172.21.15.103:0/544227393 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff70c0b3ac0 con 0x7ff70c065fe0 2020-04-22T14:13:21.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.715+0000 7ff7097fa700 1 -- 172.21.15.103:0/544227393 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7000059c0 con 0x7ff70c065fe0 2020-04-22T14:13:21.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.715+0000 7ff71227b700 1 -- 172.21.15.103:0/544227393 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff70c127770 con 0x7ff70c065fe0 2020-04-22T14:13:21.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.716+0000 7ff70b7fe700 1 --2- 172.21.15.103:0/544227393 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff70c065fe0 0x7ff70c0b4180 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7ff700002f30 tx=0x7ff700010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:21.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.716+0000 7ff71227b700 1 -- 172.21.15.103:0/544227393 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff70c128bf0 con 0x7ff70c065fe0 2020-04-22T14:13:21.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.716+0000 7ff7097fa700 1 -- 172.21.15.103:0/544227393 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ff700005c30 con 0x7ff70c065fe0 2020-04-22T14:13:21.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.716+0000 7ff70b7fe700 1 --2- 172.21.15.103:0/544227393 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff70c065fe0 0x7ff70c0b4180 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7ff700002f30 tx=0x7ff700010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:21.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.716+0000 7ff7097fa700 1 --2- 172.21.15.103:0/544227393 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff6ec04da20 0x7ff6ec04fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:21.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.717+0000 7ff7097fa700 1 -- 172.21.15.103:0/544227393 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6159+0+0 (secure 0 0 0) 0x7ff700061290 con 0x7ff70c065fe0 2020-04-22T14:13:21.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.717+0000 7ff70bfff700 1 --2- 172.21.15.103:0/544227393 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff6ec04da20 0x7ff6ec04fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:21.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.717+0000 7ff70bfff700 1 --2- 172.21.15.103:0/544227393 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff6ec04da20 0x7ff6ec04fee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff70c154ef0 tx=0x7ff6fc002530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:21.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.717+0000 7ff70bfff700 1 --2- 172.21.15.103:0/544227393 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff6ec04da20 0x7ff6ec04fee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff70c154ef0 tx=0x7ff6fc002530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:21.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.717+0000 7ff70bfff700 1 --2- 172.21.15.103:0/544227393 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff6ec04da20 0x7ff6ec04fee0 secure :-1 s=READY pgs=452 cs=0 l=1 rx=0x7ff70c154ef0 tx=0x7ff6fc002530).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:21.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.720+0000 7ff70b7fe700 1 --2- 172.21.15.103:0/544227393 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff70c065fe0 0x7ff70c0b4180 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7ff700002f30 tx=0x7ff700010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:21.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.720+0000 7ff7097fa700 1 -- 172.21.15.103:0/544227393 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ff70003c670 con 0x7ff70c065fe0 2020-04-22T14:13:21.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.910+0000 7ff71227b700 1 -- 172.21.15.103:0/544227393 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff70c056c90 con 0x7ff70c065fe0 2020-04-22T14:13:21.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.911+0000 7ff70b7fe700 1 --2- 172.21.15.103:0/544227393 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff70c065fe0 0x7ff70c0b4180 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7ff700002f30 tx=0x7ff700010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:21.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.911+0000 7ff7097fa700 1 -- 172.21.15.103:0/544227393 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2147 (secure 0 0 0) 0x7ff70003fc90 con 0x7ff70c065fe0 2020-04-22T14:13:21.914 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:13:21.914 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:43.570838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:13:21.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.913+0000 7ff71227b700 1 -- 172.21.15.103:0/544227393 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff6ec04da20 msgr2=0x7ff6ec04fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:21.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.913+0000 7ff71227b700 1 --2- 172.21.15.103:0/544227393 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff6ec04da20 0x7ff6ec04fee0 secure :-1 s=READY pgs=452 cs=0 l=1 rx=0x7ff70c154ef0 tx=0x7ff6fc002530).stop 2020-04-22T14:13:21.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.913+0000 7ff71227b700 1 -- 172.21.15.103:0/544227393 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff70c065fe0 msgr2=0x7ff70c0b4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:21.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.913+0000 7ff71227b700 1 --2- 172.21.15.103:0/544227393 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff70c065fe0 0x7ff70c0b4180 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7ff700002f30 tx=0x7ff700010ab0).stop 2020-04-22T14:13:21.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.913+0000 7ff71227b700 1 -- 172.21.15.103:0/544227393 shutdown_connections 2020-04-22T14:13:21.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.913+0000 7ff71227b700 1 --2- 172.21.15.103:0/544227393 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff6ec04da20 0x7ff6ec04fee0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:21.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.913+0000 7ff71227b700 1 --2- 172.21.15.103:0/544227393 >> v2:172.21.15.86:3300/0 conn(0x7ff70c12c0d0 0x7ff70c1543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:21.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.913+0000 7ff71227b700 1 --2- 172.21.15.103:0/544227393 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff70c065fe0 0x7ff70c0b4180 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:21.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.913+0000 7ff71227b700 1 -- 172.21.15.103:0/544227393 >> 172.21.15.103:0/544227393 conn(0x7ff70c0b9160 msgr2=0x7ff70c064360 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:21.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.913+0000 7ff71227b700 1 -- 172.21.15.103:0/544227393 shutdown_connections 2020-04-22T14:13:21.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:21.913+0000 7ff71227b700 1 -- 172.21.15.103:0/544227393 wait complete. 2020-04-22T14:13:21.917 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 54 2020-04-22T14:13:21.925 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:13:22.869 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:13:22.886 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:13:22.926 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:22.929 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:22.941 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:13:22.943 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:13:23.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.088+0000 7f70a5609700 1 Processor -- start 2020-04-22T14:13:23.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.089+0000 7f70a5609700 1 -- start start 2020-04-22T14:13:23.094 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.089+0000 7f70a5609700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f70a0067170 0x7f70a00b6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:23.094 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.089+0000 7f70a5609700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70a01426d0 0x7f70a0142b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:23.094 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.089+0000 7f70a5609700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70a0064ec0 con 0x7f70a00ac740 2020-04-22T14:13:23.094 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.089+0000 7f70a5609700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70a0065af0 con 0x7f70a0067170 2020-04-22T14:13:23.094 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.089+0000 7f70a5609700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a0146870 con 0x7f70a01426d0 2020-04-22T14:13:23.094 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.090+0000 7f709effd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f70a0067170 0x7f70a00b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:23.094 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.090+0000 7f709effd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f70a0067170 0x7f70a00b6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53644/0 (socket says 172.21.15.103:53644) 2020-04-22T14:13:23.095 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.090+0000 7f709effd700 1 -- 172.21.15.103:0/835374072 learned_addr learned my addr 172.21.15.103:0/835374072 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:23.095 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.090+0000 7f709f7fe700 1 --2- 172.21.15.103:0/835374072 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70a01426d0 0x7f70a0142b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:23.095 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.090+0000 7f709effd700 1 -- 172.21.15.103:0/835374072 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70a01426d0 msgr2=0x7f70a0142b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:23.095 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.090+0000 7f709effd700 1 --2- 172.21.15.103:0/835374072 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70a01426d0 0x7f70a0142b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:23.095 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.090+0000 7f709effd700 1 -- 172.21.15.103:0/835374072 >> v1:172.21.15.86:6789/0 conn(0x7f70a00ac740 legacy=0x7f70a013c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:23.095 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.090+0000 7f709effd700 1 -- 172.21.15.103:0/835374072 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a0067550 con 0x7f70a0067170 2020-04-22T14:13:23.095 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.090+0000 7f709f7fe700 1 --2- 172.21.15.103:0/835374072 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70a01426d0 0x7f70a0142b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:13:23.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.090+0000 7f709effd700 1 --2- 172.21.15.103:0/835374072 >> v2:172.21.15.103:3300/0 conn(0x7f70a0067170 0x7f70a00b6040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f70a005bdf0 tx=0x7f7088007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:23.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.090+0000 7f709effd700 1 --2- 172.21.15.103:0/835374072 >> v2:172.21.15.103:3300/0 conn(0x7f70a0067170 0x7f70a00b6040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f70a005bdf0 tx=0x7f7088007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:23.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.090+0000 7f709effd700 1 --2- 172.21.15.103:0/835374072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70a0067170 0x7f70a00b6040 secure :-1 s=READY pgs=1229 cs=0 l=1 rx=0x7f70a005bdf0 tx=0x7f7088007a40).ready entity=mon.1 client_cookie=8e162bc9ead363ae server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:23.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.090+0000 7f709effd700 1 --2- 172.21.15.103:0/835374072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70a0067170 0x7f70a00b6040 secure :-1 s=THROTTLE_DONE pgs=1229 cs=0 l=1 rx=0x7f70a005bdf0 tx=0x7f7088007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:23.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.090+0000 7f709dffb700 1 -- 172.21.15.103:0/835374072 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70880116e0 con 0x7f70a0067170 2020-04-22T14:13:23.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.090+0000 7f709effd700 1 --2- 172.21.15.103:0/835374072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70a0067170 0x7f70a00b6040 secure :-1 s=THROTTLE_DONE pgs=1229 cs=0 l=1 rx=0x7f70a005bdf0 tx=0x7f7088007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:23.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.090+0000 7f709effd700 1 --2- 172.21.15.103:0/835374072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70a0067170 0x7f70a00b6040 secure :-1 s=THROTTLE_DONE pgs=1229 cs=0 l=1 rx=0x7f70a005bdf0 tx=0x7f7088007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:23.097 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.090+0000 7f709dffb700 1 -- 172.21.15.103:0/835374072 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7088011840 con 0x7f70a0067170 2020-04-22T14:13:23.097 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.090+0000 7f709dffb700 1 -- 172.21.15.103:0/835374072 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7088011c60 con 0x7f70a0067170 2020-04-22T14:13:23.097 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.090+0000 7f70a5609700 1 -- 172.21.15.103:0/835374072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70a0067170 msgr2=0x7f70a00b6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:23.097 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.090+0000 7f70a5609700 1 --2- 172.21.15.103:0/835374072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70a0067170 0x7f70a00b6040 secure :-1 s=READY pgs=1229 cs=0 l=1 rx=0x7f70a005bdf0 tx=0x7f7088007a40).stop 2020-04-22T14:13:23.097 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.091+0000 7f70a5609700 1 -- 172.21.15.103:0/835374072 shutdown_connections 2020-04-22T14:13:23.097 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.091+0000 7f70a5609700 1 --2- 172.21.15.103:0/835374072 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70a01426d0 0x7f70a0142b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:23.097 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.091+0000 7f70a5609700 1 --2- 172.21.15.103:0/835374072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70a0067170 0x7f70a00b6040 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:23.098 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.091+0000 7f70a5609700 1 -- 172.21.15.103:0/835374072 >> 172.21.15.103:0/835374072 conn(0x7f70a00b9160 msgr2=0x7f70a005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:23.098 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.091+0000 7f70a5609700 1 -- 172.21.15.103:0/835374072 shutdown_connections 2020-04-22T14:13:23.098 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.091+0000 7f70a5609700 1 -- 172.21.15.103:0/835374072 wait complete. 2020-04-22T14:13:23.098 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.092+0000 7f70a5609700 1 Processor -- start 2020-04-22T14:13:23.099 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.092+0000 7f70a5609700 1 -- start start 2020-04-22T14:13:23.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.092+0000 7f70a5609700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f70a0067170 0x7f70a013f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:23.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.092+0000 7f70a5609700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f70a00ac740 0x7f70a00645b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:23.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.092+0000 7f70a5609700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70a013c9f0 con 0x7f70a01426d0 2020-04-22T14:13:23.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.092+0000 7f70a5609700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70a0064a10 con 0x7f70a0067170 2020-04-22T14:13:23.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.092+0000 7f70a5609700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70a013ef50 con 0x7f70a00ac740 2020-04-22T14:13:23.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.092+0000 7f709e7fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f70a00ac740 0x7f70a00645b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:23.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.092+0000 7f709e7fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f70a00ac740 0x7f70a00645b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53652/0 (socket says 172.21.15.103:53652) 2020-04-22T14:13:23.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.092+0000 7f709e7fc700 1 -- 172.21.15.103:0/581718239 learned_addr learned my addr 172.21.15.103:0/581718239 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:23.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.093+0000 7f709effd700 1 --2- 172.21.15.103:0/581718239 >> v2:172.21.15.86:3300/0 conn(0x7f70a0067170 0x7f70a013f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:23.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.093+0000 7f709e7fc700 1 -- 172.21.15.103:0/581718239 >> v2:172.21.15.86:3300/0 conn(0x7f70a0067170 msgr2=0x7f70a013f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:23.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.093+0000 7f709e7fc700 1 --2- 172.21.15.103:0/581718239 >> v2:172.21.15.86:3300/0 conn(0x7f70a0067170 0x7f70a013f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:23.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.093+0000 7f709e7fc700 1 -- 172.21.15.103:0/581718239 >> v1:172.21.15.86:6789/0 conn(0x7f70a01426d0 legacy=0x7f70a0130e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:23.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.093+0000 7f709e7fc700 1 -- 172.21.15.103:0/581718239 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a013f1f0 con 0x7f70a00ac740 2020-04-22T14:13:23.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.093+0000 7f709effd700 1 --2- 172.21.15.103:0/581718239 >> v2:172.21.15.86:3300/0 conn(0x7f70a0067170 0x7f70a013f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:13:23.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.093+0000 7f709e7fc700 1 --2- 172.21.15.103:0/581718239 >> v2:172.21.15.103:3300/0 conn(0x7f70a00ac740 0x7f70a00645b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7090001f50 tx=0x7f70900109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:23.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.093+0000 7f709e7fc700 1 --2- 172.21.15.103:0/581718239 >> v2:172.21.15.103:3300/0 conn(0x7f70a00ac740 0x7f70a00645b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7090001f50 tx=0x7f70900109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:23.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.093+0000 7f709e7fc700 1 --2- 172.21.15.103:0/581718239 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70a00ac740 0x7f70a00645b0 secure :-1 s=READY pgs=1230 cs=0 l=1 rx=0x7f7090001f50 tx=0x7f70900109a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:23.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.093+0000 7f709e7fc700 1 --2- 172.21.15.103:0/581718239 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70a00ac740 0x7f70a00645b0 secure :-1 s=THROTTLE_DONE pgs=1230 cs=0 l=1 rx=0x7f7090001f50 tx=0x7f70900109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:23.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.093+0000 7f709e7fc700 1 --2- 172.21.15.103:0/581718239 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70a00ac740 0x7f70a00645b0 secure :-1 s=THROTTLE_DONE pgs=1230 cs=0 l=1 rx=0x7f7090001f50 tx=0x7f70900109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:23.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.093+0000 7f7097fff700 1 -- 172.21.15.103:0/581718239 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7090006bc0 con 0x7f70a00ac740 2020-04-22T14:13:23.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.093+0000 7f709e7fc700 1 --2- 172.21.15.103:0/581718239 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70a00ac740 0x7f70a00645b0 secure :-1 s=THROTTLE_DONE pgs=1230 cs=0 l=1 rx=0x7f7090001f50 tx=0x7f70900109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:23.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.093+0000 7f7097fff700 1 -- 172.21.15.103:0/581718239 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7090006d20 con 0x7f70a00ac740 2020-04-22T14:13:23.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.093+0000 7f70a5609700 1 -- 172.21.15.103:0/581718239 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70a013c670 con 0x7f70a00ac740 2020-04-22T14:13:23.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.093+0000 7f7097fff700 1 -- 172.21.15.103:0/581718239 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7090008370 con 0x7f70a00ac740 2020-04-22T14:13:23.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.093+0000 7f70a5609700 1 -- 172.21.15.103:0/581718239 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70a013cfc0 con 0x7f70a00ac740 2020-04-22T14:13:23.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.094+0000 7f709e7fc700 1 --2- 172.21.15.103:0/581718239 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70a00ac740 0x7f70a00645b0 secure :-1 s=THROTTLE_DONE pgs=1230 cs=0 l=1 rx=0x7f7090001f50 tx=0x7f70900109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:23.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.094+0000 7f70a5609700 1 -- 172.21.15.103:0/581718239 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70a0056c90 con 0x7f70a00ac740 2020-04-22T14:13:23.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.094+0000 7f7097fff700 1 -- 172.21.15.103:0/581718239 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f70900084d0 con 0x7f70a00ac740 2020-04-22T14:13:23.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.094+0000 7f709e7fc700 1 --2- 172.21.15.103:0/581718239 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70a00ac740 0x7f70a00645b0 secure :-1 s=THROTTLE_DONE pgs=1230 cs=0 l=1 rx=0x7f7090001f50 tx=0x7f70900109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:23.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.094+0000 7f7097fff700 1 --2- 172.21.15.103:0/581718239 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f708404d930 0x7f708404fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:23.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.094+0000 7f7097fff700 1 -- 172.21.15.103:0/581718239 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f70900616f0 con 0x7f70a00ac740 2020-04-22T14:13:23.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.095+0000 7f709effd700 1 --2- 172.21.15.103:0/581718239 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f708404d930 0x7f708404fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:23.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.095+0000 7f709effd700 1 --2- 172.21.15.103:0/581718239 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f708404d930 0x7f708404fdf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f70a005bdf0 tx=0x7f7088007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:23.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.095+0000 7f709effd700 1 --2- 172.21.15.103:0/581718239 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f708404d930 0x7f708404fdf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f70a005bdf0 tx=0x7f7088007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:23.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.095+0000 7f709effd700 1 --2- 172.21.15.103:0/581718239 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f708404d930 0x7f708404fdf0 secure :-1 s=READY pgs=453 cs=0 l=1 rx=0x7f70a005bdf0 tx=0x7f7088007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:23.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.098+0000 7f709e7fc700 1 --2- 172.21.15.103:0/581718239 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70a00ac740 0x7f70a00645b0 secure :-1 s=THROTTLE_DONE pgs=1230 cs=0 l=1 rx=0x7f7090001f50 tx=0x7f70900109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:23.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.099+0000 7f7097fff700 1 -- 172.21.15.103:0/581718239 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f709003ca70 con 0x7f70a00ac740 2020-04-22T14:13:23.289 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.287+0000 7f70a5609700 1 -- 172.21.15.103:0/581718239 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70a013c800 con 0x7f70a00ac740 2020-04-22T14:13:23.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.288+0000 7f709e7fc700 1 --2- 172.21.15.103:0/581718239 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70a00ac740 0x7f70a00645b0 secure :-1 s=THROTTLE_DONE pgs=1230 cs=0 l=1 rx=0x7f7090001f50 tx=0x7f70900109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:23.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.288+0000 7f7097fff700 1 -- 172.21.15.103:0/581718239 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f7090040090 con 0x7f70a00ac740 2020-04-22T14:13:23.290 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:13:23.290 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:43.570838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:13:23.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.289+0000 7f70a5609700 1 -- 172.21.15.103:0/581718239 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f708404d930 msgr2=0x7f708404fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:23.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.289+0000 7f70a5609700 1 --2- 172.21.15.103:0/581718239 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f708404d930 0x7f708404fdf0 secure :-1 s=READY pgs=453 cs=0 l=1 rx=0x7f70a005bdf0 tx=0x7f7088007a40).stop 2020-04-22T14:13:23.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.289+0000 7f70a5609700 1 -- 172.21.15.103:0/581718239 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70a00ac740 msgr2=0x7f70a00645b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:23.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.289+0000 7f70a5609700 1 --2- 172.21.15.103:0/581718239 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70a00ac740 0x7f70a00645b0 secure :-1 s=READY pgs=1230 cs=0 l=1 rx=0x7f7090001f50 tx=0x7f70900109a0).stop 2020-04-22T14:13:23.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.289+0000 7f70a5609700 1 -- 172.21.15.103:0/581718239 shutdown_connections 2020-04-22T14:13:23.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.289+0000 7f70a5609700 1 --2- 172.21.15.103:0/581718239 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f708404d930 0x7f708404fdf0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:23.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.289+0000 7f70a5609700 1 --2- 172.21.15.103:0/581718239 >> v2:172.21.15.86:3300/0 conn(0x7f70a0067170 0x7f70a013f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:23.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.289+0000 7f70a5609700 1 --2- 172.21.15.103:0/581718239 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70a00ac740 0x7f70a00645b0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:23.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.289+0000 7f70a5609700 1 -- 172.21.15.103:0/581718239 >> 172.21.15.103:0/581718239 conn(0x7f70a00b9160 msgr2=0x7f70a00b4360 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:23.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.289+0000 7f70a5609700 1 -- 172.21.15.103:0/581718239 shutdown_connections 2020-04-22T14:13:23.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:23.289+0000 7f70a5609700 1 -- 172.21.15.103:0/581718239 wait complete. 2020-04-22T14:13:23.294 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 54 2020-04-22T14:13:23.301 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:13:24.303 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:24.322 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:13:24.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.480+0000 7f45403ae700 1 Processor -- start 2020-04-22T14:13:24.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.480+0000 7f45403ae700 1 -- start start 2020-04-22T14:13:24.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.481+0000 7f45403ae700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f453805b7c0 0x7f45380b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:24.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.481+0000 7f45403ae700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45381441f0 0x7f4538144820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:24.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.481+0000 7f45403ae700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45380ae860 con 0x7f4538144c80 2020-04-22T14:13:24.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.481+0000 7f45403ae700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45380b5900 con 0x7f453805b7c0 2020-04-22T14:13:24.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.481+0000 7f45403ae700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45380b5ba0 con 0x7f45381441f0 2020-04-22T14:13:24.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.482+0000 7f453e14a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f453805b7c0 0x7f45380b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:24.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.482+0000 7f453e14a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f453805b7c0 0x7f45380b50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53658/0 (socket says 172.21.15.103:53658) 2020-04-22T14:13:24.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.482+0000 7f453e14a700 1 -- 172.21.15.103:0/4166215985 learned_addr learned my addr 172.21.15.103:0/4166215985 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:24.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.482+0000 7f453d949700 1 --2- 172.21.15.103:0/4166215985 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45381441f0 0x7f4538144820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:24.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.482+0000 7f453e14a700 1 -- 172.21.15.103:0/4166215985 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45381441f0 msgr2=0x7f4538144820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:24.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.482+0000 7f453e14a700 1 --2- 172.21.15.103:0/4166215985 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45381441f0 0x7f4538144820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:24.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.482+0000 7f453e14a700 1 -- 172.21.15.103:0/4166215985 >> v1:172.21.15.86:6789/0 conn(0x7f4538144c80 legacy=0x7f4538147670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:24.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.482+0000 7f453e14a700 1 -- 172.21.15.103:0/4166215985 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45380b5e40 con 0x7f453805b7c0 2020-04-22T14:13:24.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.482+0000 7f453e14a700 1 --2- 172.21.15.103:0/4166215985 >> v2:172.21.15.103:3300/0 conn(0x7f453805b7c0 0x7f45380b50d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4534002f30 tx=0x7f4534007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:24.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.482+0000 7f453e14a700 1 --2- 172.21.15.103:0/4166215985 >> v2:172.21.15.103:3300/0 conn(0x7f453805b7c0 0x7f45380b50d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4534002f30 tx=0x7f4534007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:24.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.482+0000 7f453e14a700 1 --2- 172.21.15.103:0/4166215985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f453805b7c0 0x7f45380b50d0 secure :-1 s=READY pgs=1231 cs=0 l=1 rx=0x7f4534002f30 tx=0x7f4534007a40).ready entity=mon.1 client_cookie=55e4240492621580 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:24.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.482+0000 7f453e14a700 1 --2- 172.21.15.103:0/4166215985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f453805b7c0 0x7f45380b50d0 secure :-1 s=THROTTLE_DONE pgs=1231 cs=0 l=1 rx=0x7f4534002f30 tx=0x7f4534007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:24.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.482+0000 7f453d148700 1 -- 172.21.15.103:0/4166215985 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4534008e10 con 0x7f453805b7c0 2020-04-22T14:13:24.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.482+0000 7f453e14a700 1 --2- 172.21.15.103:0/4166215985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f453805b7c0 0x7f45380b50d0 secure :-1 s=THROTTLE_DONE pgs=1231 cs=0 l=1 rx=0x7f4534002f30 tx=0x7f4534007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:24.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.482+0000 7f453e14a700 1 --2- 172.21.15.103:0/4166215985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f453805b7c0 0x7f45380b50d0 secure :-1 s=THROTTLE_DONE pgs=1231 cs=0 l=1 rx=0x7f4534002f30 tx=0x7f4534007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:24.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.482+0000 7f453d148700 1 -- 172.21.15.103:0/4166215985 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45340107c0 con 0x7f453805b7c0 2020-04-22T14:13:24.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.482+0000 7f453d148700 1 -- 172.21.15.103:0/4166215985 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4534010be0 con 0x7f453805b7c0 2020-04-22T14:13:24.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.482+0000 7f45403ae700 1 -- 172.21.15.103:0/4166215985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f453805b7c0 msgr2=0x7f45380b50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:24.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.482+0000 7f45403ae700 1 --2- 172.21.15.103:0/4166215985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f453805b7c0 0x7f45380b50d0 secure :-1 s=READY pgs=1231 cs=0 l=1 rx=0x7f4534002f30 tx=0x7f4534007a40).stop 2020-04-22T14:13:24.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.483+0000 7f45403ae700 1 -- 172.21.15.103:0/4166215985 shutdown_connections 2020-04-22T14:13:24.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.483+0000 7f45403ae700 1 --2- 172.21.15.103:0/4166215985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f453805b7c0 0x7f45380b50d0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:24.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.483+0000 7f45403ae700 1 --2- 172.21.15.103:0/4166215985 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45381441f0 0x7f4538144820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:24.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.483+0000 7f45403ae700 1 -- 172.21.15.103:0/4166215985 >> 172.21.15.103:0/4166215985 conn(0x7f45380b9160 msgr2=0x7f453805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:24.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.483+0000 7f45403ae700 1 -- 172.21.15.103:0/4166215985 shutdown_connections 2020-04-22T14:13:24.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.483+0000 7f45403ae700 1 -- 172.21.15.103:0/4166215985 wait complete. 2020-04-22T14:13:24.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.484+0000 7f45403ae700 1 Processor -- start 2020-04-22T14:13:24.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.484+0000 7f45403ae700 1 -- start start 2020-04-22T14:13:24.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.485+0000 7f45403ae700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f453805b7c0 0x7f45380ae9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:24.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.485+0000 7f45403ae700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4538147660 con 0x7f45381441f0 2020-04-22T14:13:24.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.485+0000 7f45403ae700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4538147900 con 0x7f4538144c80 2020-04-22T14:13:24.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.485+0000 7f45403ae700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4538147ba0 con 0x7f453805b7c0 2020-04-22T14:13:24.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.485+0000 7f453e14a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f453805b7c0 0x7f45380ae9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:24.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.485+0000 7f453e94b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f4538144c80 0x7f453813e5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45858/0 (socket says 172.21.15.103:45858) 2020-04-22T14:13:24.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.485+0000 7f453e14a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f453805b7c0 0x7f45380ae9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53664/0 (socket says 172.21.15.103:53664) 2020-04-22T14:13:24.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.485+0000 7f453e94b700 1 -- 172.21.15.103:0/3559671979 learned_addr learned my addr 172.21.15.103:0/3559671979 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:24.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.485+0000 7f453e14a700 1 -- 172.21.15.103:0/3559671979 >> v1:172.21.15.103:6789/0 conn(0x7f4538144c80 legacy=0x7f453813e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:24.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.485+0000 7f453e14a700 1 -- 172.21.15.103:0/3559671979 >> v1:172.21.15.86:6789/0 conn(0x7f45381441f0 legacy=0x7f453813c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:24.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.485+0000 7f452b7fe700 1 -- 172.21.15.103:0/3559671979 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4156363580 0 0) 0x7f4538147900 con 0x7f4538144c80 2020-04-22T14:13:24.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.485+0000 7f453e14a700 1 -- 172.21.15.103:0/3559671979 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f453813cdf0 con 0x7f453805b7c0 2020-04-22T14:13:24.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.485+0000 7f453e14a700 1 --2- 172.21.15.103:0/3559671979 >> v2:172.21.15.103:3300/0 conn(0x7f453805b7c0 0x7f45380ae9f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4538140e30 tx=0x7f4534007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:24.517 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.485+0000 7f453e14a700 1 --2- 172.21.15.103:0/3559671979 >> v2:172.21.15.103:3300/0 conn(0x7f453805b7c0 0x7f45380ae9f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4538140e30 tx=0x7f4534007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:24.518 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.485+0000 7f453e14a700 1 --2- 172.21.15.103:0/3559671979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f453805b7c0 0x7f45380ae9f0 secure :-1 s=READY pgs=1233 cs=0 l=1 rx=0x7f4538140e30 tx=0x7f4534007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:24.518 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.485+0000 7f453e14a700 1 --2- 172.21.15.103:0/3559671979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f453805b7c0 0x7f45380ae9f0 secure :-1 s=THROTTLE_DONE pgs=1233 cs=0 l=1 rx=0x7f4538140e30 tx=0x7f4534007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:24.518 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.485+0000 7f452b7fe700 1 -- 172.21.15.103:0/3559671979 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4534010c20 con 0x7f453805b7c0 2020-04-22T14:13:24.518 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.485+0000 7f453e14a700 1 --2- 172.21.15.103:0/3559671979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f453805b7c0 0x7f45380ae9f0 secure :-1 s=THROTTLE_DONE pgs=1233 cs=0 l=1 rx=0x7f4538140e30 tx=0x7f4534007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:24.518 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.485+0000 7f453e14a700 1 --2- 172.21.15.103:0/3559671979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f453805b7c0 0x7f45380ae9f0 secure :-1 s=THROTTLE_DONE pgs=1233 cs=0 l=1 rx=0x7f4538140e30 tx=0x7f4534007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:24.518 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.485+0000 7f452b7fe700 1 -- 172.21.15.103:0/3559671979 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4534007170 con 0x7f453805b7c0 2020-04-22T14:13:24.518 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.485+0000 7f45403ae700 1 -- 172.21.15.103:0/3559671979 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45381472a0 con 0x7f453805b7c0 2020-04-22T14:13:24.519 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.485+0000 7f452b7fe700 1 -- 172.21.15.103:0/3559671979 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45340074d0 con 0x7f453805b7c0 2020-04-22T14:13:24.519 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.485+0000 7f45403ae700 1 -- 172.21.15.103:0/3559671979 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4538141a00 con 0x7f453805b7c0 2020-04-22T14:13:24.519 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.486+0000 7f453e14a700 1 --2- 172.21.15.103:0/3559671979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f453805b7c0 0x7f45380ae9f0 secure :-1 s=THROTTLE_DONE pgs=1233 cs=0 l=1 rx=0x7f4538140e30 tx=0x7f4534007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:24.519 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.486+0000 7f452b7fe700 1 -- 172.21.15.103:0/3559671979 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f45340056c0 con 0x7f453805b7c0 2020-04-22T14:13:24.519 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.486+0000 7f453e14a700 1 --2- 172.21.15.103:0/3559671979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f453805b7c0 0x7f45380ae9f0 secure :-1 s=THROTTLE_DONE pgs=1233 cs=0 l=1 rx=0x7f4538140e30 tx=0x7f4534007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:24.519 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.487+0000 7f45403ae700 1 -- 172.21.15.103:0/3559671979 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4538147d40 con 0x7f453805b7c0 2020-04-22T14:13:24.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.487+0000 7f452b7fe700 1 --2- 172.21.15.103:0/3559671979 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f451804d900 0x7f451804fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:24.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.487+0000 7f452b7fe700 1 -- 172.21.15.103:0/3559671979 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f45340614f0 con 0x7f453805b7c0 2020-04-22T14:13:24.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.487+0000 7f453d949700 1 --2- 172.21.15.103:0/3559671979 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f451804d900 0x7f451804fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:24.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.487+0000 7f453d949700 1 --2- 172.21.15.103:0/3559671979 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f451804d900 0x7f451804fdc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f453813d530 tx=0x7f452c008d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:24.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.487+0000 7f453d949700 1 --2- 172.21.15.103:0/3559671979 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f451804d900 0x7f451804fdc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f453813d530 tx=0x7f452c008d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:24.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.487+0000 7f453d949700 1 --2- 172.21.15.103:0/3559671979 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f451804d900 0x7f451804fdc0 secure :-1 s=READY pgs=454 cs=0 l=1 rx=0x7f453813d530 tx=0x7f452c008d00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:24.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.491+0000 7f453e14a700 1 --2- 172.21.15.103:0/3559671979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f453805b7c0 0x7f45380ae9f0 secure :-1 s=THROTTLE_DONE pgs=1233 cs=0 l=1 rx=0x7f4538140e30 tx=0x7f4534007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:24.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.491+0000 7f452b7fe700 1 -- 172.21.15.103:0/3559671979 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f453403c930 con 0x7f453805b7c0 2020-04-22T14:13:24.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.682+0000 7f45403ae700 1 -- 172.21.15.103:0/3559671979 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f453813af90 con 0x7f453805b7c0 2020-04-22T14:13:24.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.682+0000 7f453e14a700 1 --2- 172.21.15.103:0/3559671979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f453805b7c0 0x7f45380ae9f0 secure :-1 s=THROTTLE_DONE pgs=1233 cs=0 l=1 rx=0x7f4538140e30 tx=0x7f4534007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:24.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.682+0000 7f452b7fe700 1 -- 172.21.15.103:0/3559671979 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f453403ff50 con 0x7f453805b7c0 2020-04-22T14:13:24.685 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:13:24.685 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:43.570838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:13:24.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.684+0000 7f45403ae700 1 -- 172.21.15.103:0/3559671979 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f451804d900 msgr2=0x7f451804fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:24.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.684+0000 7f45403ae700 1 --2- 172.21.15.103:0/3559671979 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f451804d900 0x7f451804fdc0 secure :-1 s=READY pgs=454 cs=0 l=1 rx=0x7f453813d530 tx=0x7f452c008d00).stop 2020-04-22T14:13:24.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.684+0000 7f45403ae700 1 -- 172.21.15.103:0/3559671979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f453805b7c0 msgr2=0x7f45380ae9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:24.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.684+0000 7f45403ae700 1 --2- 172.21.15.103:0/3559671979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f453805b7c0 0x7f45380ae9f0 secure :-1 s=READY pgs=1233 cs=0 l=1 rx=0x7f4538140e30 tx=0x7f4534007a40).stop 2020-04-22T14:13:24.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.684+0000 7f45403ae700 1 -- 172.21.15.103:0/3559671979 shutdown_connections 2020-04-22T14:13:24.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.684+0000 7f45403ae700 1 --2- 172.21.15.103:0/3559671979 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f451804d900 0x7f451804fdc0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:24.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.684+0000 7f45403ae700 1 --2- 172.21.15.103:0/3559671979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f453805b7c0 0x7f45380ae9f0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:24.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.684+0000 7f45403ae700 1 -- 172.21.15.103:0/3559671979 >> 172.21.15.103:0/3559671979 conn(0x7f45380b9160 msgr2=0x7f4538061720 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:24.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.684+0000 7f45403ae700 1 -- 172.21.15.103:0/3559671979 shutdown_connections 2020-04-22T14:13:24.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:24.684+0000 7f45403ae700 1 -- 172.21.15.103:0/3559671979 wait complete. 2020-04-22T14:13:24.689 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 54 2020-04-22T14:13:24.696 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:13:25.697 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:25.716 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:13:25.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.872+0000 7fbd30c44700 1 Processor -- start 2020-04-22T14:13:25.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.872+0000 7fbd30c44700 1 -- start start 2020-04-22T14:13:25.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.873+0000 7fbd30c44700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbd2c05b7c0 0x7fbd2c0665a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:25.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.873+0000 7fbd30c44700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbd2c14a640 0x7fbd2c1336b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:25.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.873+0000 7fbd30c44700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbd2c133b10 0x7fbd2c14dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:25.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.873+0000 7fbd30c44700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd2c0651f0 con 0x7fbd2c133b10 2020-04-22T14:13:25.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.873+0000 7fbd30c44700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd2c066b90 con 0x7fbd2c14a640 2020-04-22T14:13:25.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.873+0000 7fbd30c44700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c066e30 con 0x7fbd2c05b7c0 2020-04-22T14:13:25.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.873+0000 7fbd23fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbd2c14a640 0x7fbd2c1336b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:25.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.873+0000 7fbd23fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbd2c14a640 0x7fbd2c1336b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53674/0 (socket says 172.21.15.103:53674) 2020-04-22T14:13:25.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.873+0000 7fbd23fff700 1 -- 172.21.15.103:0/2689503264 learned_addr learned my addr 172.21.15.103:0/2689503264 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:25.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.873+0000 7fbd2ad9d700 1 --2- 172.21.15.103:0/2689503264 >> v2:172.21.15.86:3300/0 conn(0x7fbd2c133b10 0x7fbd2c14dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:25.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.873+0000 7fbd2a59c700 1 --2- 172.21.15.103:0/2689503264 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbd2c05b7c0 0x7fbd2c0665a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:25.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.873+0000 7fbd23fff700 1 -- 172.21.15.103:0/2689503264 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbd2c05b7c0 msgr2=0x7fbd2c0665a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:25.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.873+0000 7fbd23fff700 1 --2- 172.21.15.103:0/2689503264 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbd2c05b7c0 0x7fbd2c0665a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:25.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.873+0000 7fbd23fff700 1 -- 172.21.15.103:0/2689503264 >> v2:172.21.15.86:3300/0 conn(0x7fbd2c133b10 msgr2=0x7fbd2c14dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:25.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.873+0000 7fbd23fff700 1 --2- 172.21.15.103:0/2689503264 >> v2:172.21.15.86:3300/0 conn(0x7fbd2c133b10 0x7fbd2c14dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:25.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.873+0000 7fbd23fff700 1 -- 172.21.15.103:0/2689503264 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2c0670d0 con 0x7fbd2c14a640 2020-04-22T14:13:25.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.873+0000 7fbd23fff700 1 --2- 172.21.15.103:0/2689503264 >> v2:172.21.15.103:3300/0 conn(0x7fbd2c14a640 0x7fbd2c1336b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbd14002f30 tx=0x7fbd14007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:25.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.873+0000 7fbd23fff700 1 --2- 172.21.15.103:0/2689503264 >> v2:172.21.15.103:3300/0 conn(0x7fbd2c14a640 0x7fbd2c1336b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbd14002f30 tx=0x7fbd14007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:25.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.873+0000 7fbd23fff700 1 --2- 172.21.15.103:0/2689503264 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd2c14a640 0x7fbd2c1336b0 secure :-1 s=READY pgs=1234 cs=0 l=1 rx=0x7fbd14002f30 tx=0x7fbd14007a40).ready entity=mon.1 client_cookie=b76df5444a4dbca5 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:25.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.873+0000 7fbd23fff700 1 --2- 172.21.15.103:0/2689503264 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd2c14a640 0x7fbd2c1336b0 secure :-1 s=THROTTLE_DONE pgs=1234 cs=0 l=1 rx=0x7fbd14002f30 tx=0x7fbd14007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:25.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.873+0000 7fbd29d9b700 1 -- 172.21.15.103:0/2689503264 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd140115c0 con 0x7fbd2c14a640 2020-04-22T14:13:25.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.873+0000 7fbd23fff700 1 --2- 172.21.15.103:0/2689503264 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd2c14a640 0x7fbd2c1336b0 secure :-1 s=THROTTLE_DONE pgs=1234 cs=0 l=1 rx=0x7fbd14002f30 tx=0x7fbd14007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:25.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.874+0000 7fbd23fff700 1 --2- 172.21.15.103:0/2689503264 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd2c14a640 0x7fbd2c1336b0 secure :-1 s=THROTTLE_DONE pgs=1234 cs=0 l=1 rx=0x7fbd14002f30 tx=0x7fbd14007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:25.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.874+0000 7fbd29d9b700 1 -- 172.21.15.103:0/2689503264 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd14011720 con 0x7fbd2c14a640 2020-04-22T14:13:25.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.874+0000 7fbd29d9b700 1 -- 172.21.15.103:0/2689503264 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd14011b40 con 0x7fbd2c14a640 2020-04-22T14:13:25.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.874+0000 7fbd30c44700 1 -- 172.21.15.103:0/2689503264 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd2c14a640 msgr2=0x7fbd2c1336b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:25.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.874+0000 7fbd30c44700 1 --2- 172.21.15.103:0/2689503264 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd2c14a640 0x7fbd2c1336b0 secure :-1 s=READY pgs=1234 cs=0 l=1 rx=0x7fbd14002f30 tx=0x7fbd14007a40).stop 2020-04-22T14:13:25.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.874+0000 7fbd30c44700 1 -- 172.21.15.103:0/2689503264 shutdown_connections 2020-04-22T14:13:25.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.874+0000 7fbd30c44700 1 --2- 172.21.15.103:0/2689503264 >> v2:172.21.15.86:3300/0 conn(0x7fbd2c133b10 0x7fbd2c14dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:25.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.874+0000 7fbd30c44700 1 --2- 172.21.15.103:0/2689503264 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbd2c05b7c0 0x7fbd2c0665a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:25.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.874+0000 7fbd30c44700 1 --2- 172.21.15.103:0/2689503264 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd2c14a640 0x7fbd2c1336b0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:25.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.874+0000 7fbd30c44700 1 -- 172.21.15.103:0/2689503264 >> 172.21.15.103:0/2689503264 conn(0x7fbd2c0b9160 msgr2=0x7fbd2c05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:25.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.874+0000 7fbd30c44700 1 -- 172.21.15.103:0/2689503264 shutdown_connections 2020-04-22T14:13:25.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.874+0000 7fbd30c44700 1 -- 172.21.15.103:0/2689503264 wait complete. 2020-04-22T14:13:25.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.875+0000 7fbd30c44700 1 Processor -- start 2020-04-22T14:13:25.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.875+0000 7fbd30c44700 1 -- start start 2020-04-22T14:13:25.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.876+0000 7fbd30c44700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbd2c14a640 0x7fbd2c0b0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:25.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.876+0000 7fbd30c44700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd2c0aec10 con 0x7fbd2c05b7c0 2020-04-22T14:13:25.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.876+0000 7fbd30c44700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd2c0b0590 con 0x7fbd2c133b10 2020-04-22T14:13:25.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.876+0000 7fbd30c44700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd2c0b0830 con 0x7fbd2c14a640 2020-04-22T14:13:25.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.876+0000 7fbd2ad9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbd2c14a640 0x7fbd2c0b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:25.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.876+0000 7fbd23fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fbd2c133b10 0x7fbd2c0ac8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45870/0 (socket says 172.21.15.103:45870) 2020-04-22T14:13:25.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.876+0000 7fbd23fff700 1 -- 172.21.15.103:0/1682038665 learned_addr learned my addr 172.21.15.103:0/1682038665 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:25.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.876+0000 7fbd2ad9d700 1 -- 172.21.15.103:0/1682038665 >> v1:172.21.15.103:6789/0 conn(0x7fbd2c133b10 legacy=0x7fbd2c0ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:25.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.876+0000 7fbd2ad9d700 1 -- 172.21.15.103:0/1682038665 >> v1:172.21.15.86:6789/0 conn(0x7fbd2c05b7c0 legacy=0x7fbd2c0b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:25.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.876+0000 7fbd2ad9d700 1 -- 172.21.15.103:0/1682038665 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2c0b0ad0 con 0x7fbd2c14a640 2020-04-22T14:13:25.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.876+0000 7fbd237fe700 1 -- 172.21.15.103:0/1682038665 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2833580109 0 0) 0x7fbd2c0b0590 con 0x7fbd2c133b10 2020-04-22T14:13:25.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.876+0000 7fbd2ad9d700 1 --2- 172.21.15.103:0/1682038665 >> v2:172.21.15.103:3300/0 conn(0x7fbd2c14a640 0x7fbd2c0b0080 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbd240032b0 tx=0x7fbd24010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:25.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.876+0000 7fbd2ad9d700 1 --2- 172.21.15.103:0/1682038665 >> v2:172.21.15.103:3300/0 conn(0x7fbd2c14a640 0x7fbd2c0b0080 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbd240032b0 tx=0x7fbd24010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:25.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.876+0000 7fbd2ad9d700 1 --2- 172.21.15.103:0/1682038665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd2c14a640 0x7fbd2c0b0080 secure :-1 s=READY pgs=1236 cs=0 l=1 rx=0x7fbd240032b0 tx=0x7fbd24010ed0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:25.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.876+0000 7fbd2ad9d700 1 --2- 172.21.15.103:0/1682038665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd2c14a640 0x7fbd2c0b0080 secure :-1 s=THROTTLE_DONE pgs=1236 cs=0 l=1 rx=0x7fbd240032b0 tx=0x7fbd24010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:25.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.876+0000 7fbd237fe700 1 -- 172.21.15.103:0/1682038665 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd24011be0 con 0x7fbd2c14a640 2020-04-22T14:13:25.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.876+0000 7fbd2ad9d700 1 --2- 172.21.15.103:0/1682038665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd2c14a640 0x7fbd2c0b0080 secure :-1 s=THROTTLE_DONE pgs=1236 cs=0 l=1 rx=0x7fbd240032b0 tx=0x7fbd24010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:25.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.876+0000 7fbd2ad9d700 1 --2- 172.21.15.103:0/1682038665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd2c14a640 0x7fbd2c0b0080 secure :-1 s=THROTTLE_DONE pgs=1236 cs=0 l=1 rx=0x7fbd240032b0 tx=0x7fbd24010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:25.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.876+0000 7fbd237fe700 1 -- 172.21.15.103:0/1682038665 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd24011d40 con 0x7fbd2c14a640 2020-04-22T14:13:25.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.876+0000 7fbd30c44700 1 -- 172.21.15.103:0/1682038665 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd2c0b7e30 con 0x7fbd2c14a640 2020-04-22T14:13:25.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.876+0000 7fbd237fe700 1 -- 172.21.15.103:0/1682038665 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd2400e8b0 con 0x7fbd2c14a640 2020-04-22T14:13:25.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.876+0000 7fbd30c44700 1 -- 172.21.15.103:0/1682038665 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd2c0b1130 con 0x7fbd2c14a640 2020-04-22T14:13:25.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.877+0000 7fbd2ad9d700 1 --2- 172.21.15.103:0/1682038665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd2c14a640 0x7fbd2c0b0080 secure :-1 s=THROTTLE_DONE pgs=1236 cs=0 l=1 rx=0x7fbd240032b0 tx=0x7fbd24010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:25.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.878+0000 7fbd237fe700 1 -- 172.21.15.103:0/1682038665 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fbd24010160 con 0x7fbd2c14a640 2020-04-22T14:13:25.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.878+0000 7fbd2ad9d700 1 --2- 172.21.15.103:0/1682038665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd2c14a640 0x7fbd2c0b0080 secure :-1 s=THROTTLE_DONE pgs=1236 cs=0 l=1 rx=0x7fbd240032b0 tx=0x7fbd24010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:25.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.878+0000 7fbd30c44700 1 -- 172.21.15.103:0/1682038665 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd2c0b0c60 con 0x7fbd2c14a640 2020-04-22T14:13:25.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.878+0000 7fbd237fe700 1 --2- 172.21.15.103:0/1682038665 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbd1004d8b0 0x7fbd1004fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:25.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.878+0000 7fbd237fe700 1 -- 172.21.15.103:0/1682038665 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fbd24061260 con 0x7fbd2c14a640 2020-04-22T14:13:25.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.878+0000 7fbd2a59c700 1 --2- 172.21.15.103:0/1682038665 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbd1004d8b0 0x7fbd1004fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:25.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.878+0000 7fbd2a59c700 1 --2- 172.21.15.103:0/1682038665 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbd1004d8b0 0x7fbd1004fd70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbd2c14f670 tx=0x7fbd1c007ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:25.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.878+0000 7fbd2a59c700 1 --2- 172.21.15.103:0/1682038665 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbd1004d8b0 0x7fbd1004fd70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbd2c14f670 tx=0x7fbd1c007ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:25.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.878+0000 7fbd2a59c700 1 --2- 172.21.15.103:0/1682038665 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbd1004d8b0 0x7fbd1004fd70 secure :-1 s=READY pgs=455 cs=0 l=1 rx=0x7fbd2c14f670 tx=0x7fbd1c007ae0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:25.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.882+0000 7fbd2ad9d700 1 --2- 172.21.15.103:0/1682038665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd2c14a640 0x7fbd2c0b0080 secure :-1 s=THROTTLE_DONE pgs=1236 cs=0 l=1 rx=0x7fbd240032b0 tx=0x7fbd24010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:25.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:25.882+0000 7fbd237fe700 1 -- 172.21.15.103:0/1682038665 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fbd2403c5e0 con 0x7fbd2c14a640 2020-04-22T14:13:26.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:26.069+0000 7fbd30c44700 1 -- 172.21.15.103:0/1682038665 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd2c056c90 con 0x7fbd2c14a640 2020-04-22T14:13:26.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:26.070+0000 7fbd2ad9d700 1 --2- 172.21.15.103:0/1682038665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd2c14a640 0x7fbd2c0b0080 secure :-1 s=THROTTLE_DONE pgs=1236 cs=0 l=1 rx=0x7fbd240032b0 tx=0x7fbd24010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:26.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:26.070+0000 7fbd237fe700 1 -- 172.21.15.103:0/1682038665 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2147 (secure 0 0 0) 0x7fbd2403fc00 con 0x7fbd2c14a640 2020-04-22T14:13:26.072 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:13:26.073 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:43.570838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:13:26.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:26.071+0000 7fbd30c44700 1 -- 172.21.15.103:0/1682038665 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbd1004d8b0 msgr2=0x7fbd1004fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:26.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:26.071+0000 7fbd30c44700 1 --2- 172.21.15.103:0/1682038665 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbd1004d8b0 0x7fbd1004fd70 secure :-1 s=READY pgs=455 cs=0 l=1 rx=0x7fbd2c14f670 tx=0x7fbd1c007ae0).stop 2020-04-22T14:13:26.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:26.071+0000 7fbd30c44700 1 -- 172.21.15.103:0/1682038665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd2c14a640 msgr2=0x7fbd2c0b0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:26.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:26.071+0000 7fbd30c44700 1 --2- 172.21.15.103:0/1682038665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd2c14a640 0x7fbd2c0b0080 secure :-1 s=READY pgs=1236 cs=0 l=1 rx=0x7fbd240032b0 tx=0x7fbd24010ed0).stop 2020-04-22T14:13:26.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:26.071+0000 7fbd30c44700 1 -- 172.21.15.103:0/1682038665 shutdown_connections 2020-04-22T14:13:26.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:26.071+0000 7fbd30c44700 1 --2- 172.21.15.103:0/1682038665 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbd1004d8b0 0x7fbd1004fd70 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:26.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:26.071+0000 7fbd30c44700 1 --2- 172.21.15.103:0/1682038665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd2c14a640 0x7fbd2c0b0080 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:26.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:26.071+0000 7fbd30c44700 1 -- 172.21.15.103:0/1682038665 >> 172.21.15.103:0/1682038665 conn(0x7fbd2c0b9160 msgr2=0x7fbd2c14aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:26.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:26.071+0000 7fbd30c44700 1 -- 172.21.15.103:0/1682038665 shutdown_connections 2020-04-22T14:13:26.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:26.071+0000 7fbd30c44700 1 -- 172.21.15.103:0/1682038665 wait complete. 2020-04-22T14:13:26.075 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 54 2020-04-22T14:13:26.083 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:13:27.084 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:27.099 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:13:27.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.248+0000 7fdde0250700 1 Processor -- start 2020-04-22T14:13:27.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.248+0000 7fdde0250700 1 -- start start 2020-04-22T14:13:27.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.249+0000 7fdde0250700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fddd80b6040 0x7fddd80ac740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:27.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.249+0000 7fdde0250700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fddd81426d0 0x7fddd8142b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:27.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.249+0000 7fdde0250700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd8064ec0 con 0x7fddd8067170 2020-04-22T14:13:27.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.249+0000 7fdde0250700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd8065af0 con 0x7fddd81426d0 2020-04-22T14:13:27.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.249+0000 7fdde0250700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd8146870 con 0x7fddd80b6040 2020-04-22T14:13:27.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.249+0000 7fdddd7eb700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fddd80b6040 0x7fddd80ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:27.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.249+0000 7fdddd7eb700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fddd80b6040 0x7fddd80ac740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:38466/0 (socket says 172.21.15.103:38466) 2020-04-22T14:13:27.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.249+0000 7fdddd7eb700 1 -- 172.21.15.103:0/210159537 learned_addr learned my addr 172.21.15.103:0/210159537 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:27.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.249+0000 7fddde7ed700 1 --2- 172.21.15.103:0/210159537 >> v2:172.21.15.86:3300/0 conn(0x7fddd81426d0 0x7fddd8142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:27.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.249+0000 7fddddfec700 1 --1- 172.21.15.103:0/210159537 >> v1:172.21.15.86:6789/0 conn(0x7fddd8067170 0x7fddd813c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:34800/0 (socket says 172.21.15.103:34800) 2020-04-22T14:13:27.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.249+0000 7fdddd7eb700 1 -- 172.21.15.103:0/210159537 >> v2:172.21.15.86:3300/0 conn(0x7fddd81426d0 msgr2=0x7fddd8142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:27.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.249+0000 7fdddd7eb700 1 --2- 172.21.15.103:0/210159537 >> v2:172.21.15.86:3300/0 conn(0x7fddd81426d0 0x7fddd8142b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:27.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.250+0000 7fdddd7eb700 1 -- 172.21.15.103:0/210159537 >> v1:172.21.15.86:6789/0 conn(0x7fddd8067170 legacy=0x7fddd813c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:27.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.250+0000 7fdddd7eb700 1 -- 172.21.15.103:0/210159537 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd8067550 con 0x7fddd80b6040 2020-04-22T14:13:27.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.250+0000 7fdddcfea700 1 -- 172.21.15.103:0/210159537 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3676902559 0 0) 0x7fddd8064ec0 con 0x7fddd8067170 2020-04-22T14:13:27.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.250+0000 7fddde7ed700 1 --2- 172.21.15.103:0/210159537 >> v2:172.21.15.86:3300/0 conn(0x7fddd81426d0 0x7fddd8142b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:13:27.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.250+0000 7fdddd7eb700 1 --2- 172.21.15.103:0/210159537 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fddd80b6040 0x7fddd80ac740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fddc8002f30 tx=0x7fddc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:27.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.250+0000 7fdddd7eb700 1 --2- 172.21.15.103:0/210159537 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fddd80b6040 0x7fddd80ac740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fddc8002f30 tx=0x7fddc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:27.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.250+0000 7fdddd7eb700 1 --2- 172.21.15.103:0/210159537 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fddd80b6040 0x7fddd80ac740 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7fddc8002f30 tx=0x7fddc8007a40).ready entity=mon.2 client_cookie=51999fac331e8604 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:27.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.250+0000 7fdddd7eb700 1 --2- 172.21.15.103:0/210159537 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fddd80b6040 0x7fddd80ac740 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7fddc8002f30 tx=0x7fddc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:27.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.250+0000 7fdddcfea700 1 -- 172.21.15.103:0/210159537 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddc8011670 con 0x7fddd80b6040 2020-04-22T14:13:27.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.250+0000 7fdddd7eb700 1 --2- 172.21.15.103:0/210159537 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fddd80b6040 0x7fddd80ac740 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7fddc8002f30 tx=0x7fddc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:27.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.250+0000 7fdddcfea700 1 -- 172.21.15.103:0/210159537 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc8011810 con 0x7fddd80b6040 2020-04-22T14:13:27.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.250+0000 7fdddd7eb700 1 --2- 172.21.15.103:0/210159537 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fddd80b6040 0x7fddd80ac740 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7fddc8002f30 tx=0x7fddc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:27.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.250+0000 7fdde0250700 1 -- 172.21.15.103:0/210159537 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fddd80b6040 msgr2=0x7fddd80ac740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:27.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.250+0000 7fdddcfea700 1 -- 172.21.15.103:0/210159537 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddc8011bf0 con 0x7fddd80b6040 2020-04-22T14:13:27.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.250+0000 7fdde0250700 1 --2- 172.21.15.103:0/210159537 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fddd80b6040 0x7fddd80ac740 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7fddc8002f30 tx=0x7fddc8007a40).stop 2020-04-22T14:13:27.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.250+0000 7fdde0250700 1 -- 172.21.15.103:0/210159537 shutdown_connections 2020-04-22T14:13:27.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.250+0000 7fdde0250700 1 --2- 172.21.15.103:0/210159537 >> v2:172.21.15.86:3300/0 conn(0x7fddd81426d0 0x7fddd8142b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:27.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.250+0000 7fdde0250700 1 --2- 172.21.15.103:0/210159537 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fddd80b6040 0x7fddd80ac740 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:27.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.250+0000 7fdde0250700 1 -- 172.21.15.103:0/210159537 >> 172.21.15.103:0/210159537 conn(0x7fddd80b9160 msgr2=0x7fddd805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:27.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.251+0000 7fdde0250700 1 -- 172.21.15.103:0/210159537 shutdown_connections 2020-04-22T14:13:27.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.251+0000 7fdde0250700 1 -- 172.21.15.103:0/210159537 wait complete. 2020-04-22T14:13:27.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.251+0000 7fdde0250700 1 Processor -- start 2020-04-22T14:13:27.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.251+0000 7fdde0250700 1 -- start start 2020-04-22T14:13:27.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.252+0000 7fdde0250700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fddd8067170 0x7fddd8140610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:27.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.252+0000 7fdde0250700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fddd80b6040 0x7fddd813d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:27.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.252+0000 7fdde0250700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fddd81426d0 0x7fddd8147120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:27.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.252+0000 7fdde0250700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd813bde0 con 0x7fddd8067170 2020-04-22T14:13:27.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.252+0000 7fdde0250700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd813d9a0 con 0x7fddd81426d0 2020-04-22T14:13:27.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.252+0000 7fdde0250700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd813ce00 con 0x7fddd80b6040 2020-04-22T14:13:27.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.252+0000 7fddde7ed700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fddd81426d0 0x7fddd8147120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:27.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.252+0000 7fddde7ed700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fddd81426d0 0x7fddd8147120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53696/0 (socket says 172.21.15.103:53696) 2020-04-22T14:13:27.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.252+0000 7fddde7ed700 1 -- 172.21.15.103:0/2386264050 learned_addr learned my addr 172.21.15.103:0/2386264050 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:27.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.252+0000 7fdddd7eb700 1 --2- 172.21.15.103:0/2386264050 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fddd80b6040 0x7fddd813d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:27.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.252+0000 7fddddfec700 1 --2- 172.21.15.103:0/2386264050 >> v2:172.21.15.86:3300/0 conn(0x7fddd8067170 0x7fddd8140610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:27.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.253+0000 7fddde7ed700 1 -- 172.21.15.103:0/2386264050 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fddd80b6040 msgr2=0x7fddd813d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:27.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.253+0000 7fddde7ed700 1 --2- 172.21.15.103:0/2386264050 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fddd80b6040 0x7fddd813d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:27.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.253+0000 7fddde7ed700 1 -- 172.21.15.103:0/2386264050 >> v2:172.21.15.86:3300/0 conn(0x7fddd8067170 msgr2=0x7fddd8140610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:27.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.253+0000 7fddde7ed700 1 --2- 172.21.15.103:0/2386264050 >> v2:172.21.15.86:3300/0 conn(0x7fddd8067170 0x7fddd8140610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:27.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.253+0000 7fddde7ed700 1 -- 172.21.15.103:0/2386264050 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd813d0a0 con 0x7fddd81426d0 2020-04-22T14:13:27.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.253+0000 7fdddd7eb700 1 --2- 172.21.15.103:0/2386264050 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fddd80b6040 0x7fddd813d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:13:27.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.253+0000 7fddde7ed700 1 --2- 172.21.15.103:0/2386264050 >> v2:172.21.15.103:3300/0 conn(0x7fddd81426d0 0x7fddd8147120 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fddd00033f0 tx=0x7fddd0011190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:27.263 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.253+0000 7fddde7ed700 1 --2- 172.21.15.103:0/2386264050 >> v2:172.21.15.103:3300/0 conn(0x7fddd81426d0 0x7fddd8147120 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fddd00033f0 tx=0x7fddd0011190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:27.263 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.253+0000 7fddde7ed700 1 --2- 172.21.15.103:0/2386264050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddd81426d0 0x7fddd8147120 secure :-1 s=READY pgs=1237 cs=0 l=1 rx=0x7fddd00033f0 tx=0x7fddd0011190).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:27.263 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.253+0000 7fddde7ed700 1 --2- 172.21.15.103:0/2386264050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddd81426d0 0x7fddd8147120 secure :-1 s=THROTTLE_DONE pgs=1237 cs=0 l=1 rx=0x7fddd00033f0 tx=0x7fddd0011190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:27.263 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.253+0000 7fddc6ffd700 1 -- 172.21.15.103:0/2386264050 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddd000ce50 con 0x7fddd81426d0 2020-04-22T14:13:27.263 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.253+0000 7fddde7ed700 1 --2- 172.21.15.103:0/2386264050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddd81426d0 0x7fddd8147120 secure :-1 s=THROTTLE_DONE pgs=1237 cs=0 l=1 rx=0x7fddd00033f0 tx=0x7fddd0011190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:27.263 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.253+0000 7fdde0250700 1 -- 172.21.15.103:0/2386264050 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd813cb20 con 0x7fddd81426d0 2020-04-22T14:13:27.263 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.253+0000 7fddc6ffd700 1 -- 172.21.15.103:0/2386264050 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd000eac0 con 0x7fddd81426d0 2020-04-22T14:13:27.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.253+0000 7fddde7ed700 1 --2- 172.21.15.103:0/2386264050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddd81426d0 0x7fddd8147120 secure :-1 s=THROTTLE_DONE pgs=1237 cs=0 l=1 rx=0x7fddd00033f0 tx=0x7fddd0011190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:27.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.253+0000 7fddc6ffd700 1 -- 172.21.15.103:0/2386264050 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddd000e180 con 0x7fddd81426d0 2020-04-22T14:13:27.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.253+0000 7fdde0250700 1 -- 172.21.15.103:0/2386264050 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd8147820 con 0x7fddd81426d0 2020-04-22T14:13:27.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.253+0000 7fddde7ed700 1 --2- 172.21.15.103:0/2386264050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddd81426d0 0x7fddd8147120 secure :-1 s=THROTTLE_DONE pgs=1237 cs=0 l=1 rx=0x7fddd00033f0 tx=0x7fddd0011190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:27.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.254+0000 7fddc6ffd700 1 -- 172.21.15.103:0/2386264050 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fddd000e400 con 0x7fddd81426d0 2020-04-22T14:13:27.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.254+0000 7fddde7ed700 1 --2- 172.21.15.103:0/2386264050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddd81426d0 0x7fddd8147120 secure :-1 s=THROTTLE_DONE pgs=1237 cs=0 l=1 rx=0x7fddd00033f0 tx=0x7fddd0011190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:27.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.254+0000 7fdde0250700 1 -- 172.21.15.103:0/2386264050 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd8147b80 con 0x7fddd81426d0 2020-04-22T14:13:27.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.254+0000 7fddc6ffd700 1 --2- 172.21.15.103:0/2386264050 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fddb804d8a0 0x7fddb804fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:27.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.254+0000 7fddc6ffd700 1 -- 172.21.15.103:0/2386264050 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fddd0061560 con 0x7fddd81426d0 2020-04-22T14:13:27.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.254+0000 7fddddfec700 1 --2- 172.21.15.103:0/2386264050 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fddb804d8a0 0x7fddb804fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:27.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.254+0000 7fddddfec700 1 --2- 172.21.15.103:0/2386264050 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fddb804d8a0 0x7fddb804fd60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fddd4000b80 tx=0x7fddd4001940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:27.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.255+0000 7fddddfec700 1 --2- 172.21.15.103:0/2386264050 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fddb804d8a0 0x7fddb804fd60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fddd4000b80 tx=0x7fddd4001940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:27.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.255+0000 7fddddfec700 1 --2- 172.21.15.103:0/2386264050 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fddb804d8a0 0x7fddb804fd60 secure :-1 s=READY pgs=456 cs=0 l=1 rx=0x7fddd4000b80 tx=0x7fddd4001940).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:27.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.258+0000 7fddde7ed700 1 --2- 172.21.15.103:0/2386264050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddd81426d0 0x7fddd8147120 secure :-1 s=THROTTLE_DONE pgs=1237 cs=0 l=1 rx=0x7fddd00033f0 tx=0x7fddd0011190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:27.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.258+0000 7fddc6ffd700 1 -- 172.21.15.103:0/2386264050 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fddd003c8e0 con 0x7fddd81426d0 2020-04-22T14:13:27.453 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.450+0000 7fdde0250700 1 -- 172.21.15.103:0/2386264050 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fddd8056c90 con 0x7fddd81426d0 2020-04-22T14:13:27.453 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.451+0000 7fddde7ed700 1 --2- 172.21.15.103:0/2386264050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddd81426d0 0x7fddd8147120 secure :-1 s=THROTTLE_DONE pgs=1237 cs=0 l=1 rx=0x7fddd00033f0 tx=0x7fddd0011190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:27.453 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.451+0000 7fddc6ffd700 1 -- 172.21.15.103:0/2386264050 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2147 (secure 0 0 0) 0x7fddd003ff00 con 0x7fddd81426d0 2020-04-22T14:13:27.454 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:13:27.454 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:43.570838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:13:27.455 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.452+0000 7fdde0250700 1 -- 172.21.15.103:0/2386264050 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fddb804d8a0 msgr2=0x7fddb804fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:27.455 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.452+0000 7fdde0250700 1 --2- 172.21.15.103:0/2386264050 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fddb804d8a0 0x7fddb804fd60 secure :-1 s=READY pgs=456 cs=0 l=1 rx=0x7fddd4000b80 tx=0x7fddd4001940).stop 2020-04-22T14:13:27.455 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.452+0000 7fdde0250700 1 -- 172.21.15.103:0/2386264050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddd81426d0 msgr2=0x7fddd8147120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:27.455 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.452+0000 7fdde0250700 1 --2- 172.21.15.103:0/2386264050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddd81426d0 0x7fddd8147120 secure :-1 s=READY pgs=1237 cs=0 l=1 rx=0x7fddd00033f0 tx=0x7fddd0011190).stop 2020-04-22T14:13:27.455 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.452+0000 7fdde0250700 1 -- 172.21.15.103:0/2386264050 shutdown_connections 2020-04-22T14:13:27.456 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.452+0000 7fdde0250700 1 --2- 172.21.15.103:0/2386264050 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fddb804d8a0 0x7fddb804fd60 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:27.456 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.452+0000 7fdde0250700 1 --2- 172.21.15.103:0/2386264050 >> v2:172.21.15.86:3300/0 conn(0x7fddd8067170 0x7fddd8140610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:27.456 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.452+0000 7fdde0250700 1 --2- 172.21.15.103:0/2386264050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddd81426d0 0x7fddd8147120 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:27.456 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.452+0000 7fdde0250700 1 --2- 172.21.15.103:0/2386264050 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fddd80b6040 0x7fddd813d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:27.456 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.452+0000 7fdde0250700 1 -- 172.21.15.103:0/2386264050 >> 172.21.15.103:0/2386264050 conn(0x7fddd80b9160 msgr2=0x7fddd8061670 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:27.456 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.452+0000 7fdde0250700 1 -- 172.21.15.103:0/2386264050 shutdown_connections 2020-04-22T14:13:27.456 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:27.452+0000 7fdde0250700 1 -- 172.21.15.103:0/2386264050 wait complete. 2020-04-22T14:13:27.457 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 54 2020-04-22T14:13:27.465 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:13:28.466 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:28.483 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:13:28.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.638+0000 7f23137e3700 1 Processor -- start 2020-04-22T14:13:28.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.638+0000 7f23137e3700 1 -- start start 2020-04-22T14:13:28.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.639+0000 7f23137e3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f230c12c0d0 0x7f230c1464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:28.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.639+0000 7f23137e3700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f230c143300 con 0x7f230c065fe0 2020-04-22T14:13:28.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.639+0000 7f23137e3700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f230c1435a0 con 0x7f230c063e30 2020-04-22T14:13:28.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.639+0000 7f23137e3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f230c143840 con 0x7f230c12c0d0 2020-04-22T14:13:28.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.639+0000 7f2311d80700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f230c063e30 0x7f230c0642a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45892/0 (socket says 172.21.15.103:45892) 2020-04-22T14:13:28.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.639+0000 7f2311d80700 1 -- 172.21.15.103:0/3361967923 learned_addr learned my addr 172.21.15.103:0/3361967923 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:28.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.639+0000 7f231157f700 1 --2- 172.21.15.103:0/3361967923 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f230c12c0d0 0x7f230c1464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:28.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.639+0000 7f22fffff700 1 -- 172.21.15.103:0/3361967923 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2034001973 0 0) 0x7f230c1435a0 con 0x7f230c063e30 2020-04-22T14:13:28.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.639+0000 7f22fffff700 1 -- 172.21.15.103:0/3361967923 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22f4003230 con 0x7f230c063e30 2020-04-22T14:13:28.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.640+0000 7f22fffff700 1 -- 172.21.15.103:0/3361967923 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1156610454 0 0) 0x7f230c143300 con 0x7f230c065fe0 2020-04-22T14:13:28.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.640+0000 7f22fffff700 1 -- 172.21.15.103:0/3361967923 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f230c1435a0 con 0x7f230c065fe0 2020-04-22T14:13:28.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.640+0000 7f22fffff700 1 -- 172.21.15.103:0/3361967923 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2349763206 0 0) 0x7f22f4003230 con 0x7f230c063e30 2020-04-22T14:13:28.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.640+0000 7f22fffff700 1 -- 172.21.15.103:0/3361967923 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f230c12c0d0 msgr2=0x7f230c1464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:28.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.640+0000 7f22fffff700 1 --2- 172.21.15.103:0/3361967923 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f230c12c0d0 0x7f230c1464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:28.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.640+0000 7f22fffff700 1 -- 172.21.15.103:0/3361967923 >> v1:172.21.15.86:6789/0 conn(0x7f230c065fe0 legacy=0x7f230c05b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:28.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.640+0000 7f22fffff700 1 -- 172.21.15.103:0/3361967923 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f230c05bb50 con 0x7f230c063e30 2020-04-22T14:13:28.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.640+0000 7f22fffff700 1 -- 172.21.15.103:0/3361967923 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f2304001a50 con 0x7f230c063e30 2020-04-22T14:13:28.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.640+0000 7f22fffff700 1 -- 172.21.15.103:0/3361967923 >> v1:172.21.15.103:6789/0 conn(0x7f230c063e30 legacy=0x7f230c0642a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:28.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.640+0000 7f22fffff700 1 --2- 172.21.15.103:0/3361967923 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22f40038b0 0x7f22f4003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:28.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.640+0000 7f22fffff700 1 --2- 172.21.15.103:0/3361967923 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f230c12c0d0 0x7f22f40044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:28.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.640+0000 7f22fffff700 1 --2- 172.21.15.103:0/3361967923 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22f4004930 0x7f22f4004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:28.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.640+0000 7f22fffff700 1 -- 172.21.15.103:0/3361967923 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230c143840 con 0x7f22f4004930 2020-04-22T14:13:28.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.640+0000 7f22fffff700 1 -- 172.21.15.103:0/3361967923 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f4005210 con 0x7f22f40038b0 2020-04-22T14:13:28.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.640+0000 7f22fffff700 1 -- 172.21.15.103:0/3361967923 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f4005350 con 0x7f230c12c0d0 2020-04-22T14:13:28.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.640+0000 7f231157f700 1 --2- 172.21.15.103:0/3361967923 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22f40038b0 0x7f22f4003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:28.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.640+0000 7f2310d7e700 1 --2- 172.21.15.103:0/3361967923 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f230c12c0d0 0x7f22f40044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:28.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.640+0000 7f2311d80700 1 --2- 172.21.15.103:0/3361967923 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22f4004930 0x7f22f4004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:28.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.640+0000 7f231157f700 1 -- 172.21.15.103:0/3361967923 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f230c12c0d0 msgr2=0x7f22f40044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:28.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.640+0000 7f231157f700 1 --2- 172.21.15.103:0/3361967923 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f230c12c0d0 0x7f22f40044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:28.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.640+0000 7f231157f700 1 -- 172.21.15.103:0/3361967923 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22f4004930 msgr2=0x7f22f4004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:28.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.640+0000 7f231157f700 1 --2- 172.21.15.103:0/3361967923 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22f4004930 0x7f22f4004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:28.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.640+0000 7f231157f700 1 -- 172.21.15.103:0/3361967923 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f4003230 con 0x7f22f40038b0 2020-04-22T14:13:28.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.640+0000 7f2311d80700 1 --2- 172.21.15.103:0/3361967923 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22f4004930 0x7f22f4004db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:13:28.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.640+0000 7f231157f700 1 --2- 172.21.15.103:0/3361967923 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22f40038b0 0x7f22f4003cb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2308002f30 tx=0x7f2308010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:28.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.640+0000 7f231157f700 1 --2- 172.21.15.103:0/3361967923 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22f40038b0 0x7f22f4003cb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2308002f30 tx=0x7f2308010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:28.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.640+0000 7f231157f700 1 --2- 172.21.15.103:0/3361967923 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22f40038b0 0x7f22f4003cb0 secure :-1 s=READY pgs=1239 cs=0 l=1 rx=0x7f2308002f30 tx=0x7f2308010020).ready entity=mon.1 client_cookie=395d52dbd66145bc server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:28.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.640+0000 7f231157f700 1 --2- 172.21.15.103:0/3361967923 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22f40038b0 0x7f22f4003cb0 secure :-1 s=THROTTLE_DONE pgs=1239 cs=0 l=1 rx=0x7f2308002f30 tx=0x7f2308010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:28.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.640+0000 7f22fffff700 1 -- 172.21.15.103:0/3361967923 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2308008d30 con 0x7f22f40038b0 2020-04-22T14:13:28.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.640+0000 7f231157f700 1 --2- 172.21.15.103:0/3361967923 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22f40038b0 0x7f22f4003cb0 secure :-1 s=THROTTLE_DONE pgs=1239 cs=0 l=1 rx=0x7f2308002f30 tx=0x7f2308010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:28.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.640+0000 7f231157f700 1 --2- 172.21.15.103:0/3361967923 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22f40038b0 0x7f22f4003cb0 secure :-1 s=THROTTLE_DONE pgs=1239 cs=0 l=1 rx=0x7f2308002f30 tx=0x7f2308010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:28.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.640+0000 7f22fffff700 1 -- 172.21.15.103:0/3361967923 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2308008e90 con 0x7f22f40038b0 2020-04-22T14:13:28.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.640+0000 7f22fffff700 1 -- 172.21.15.103:0/3361967923 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2308010b40 con 0x7f22f40038b0 2020-04-22T14:13:28.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.640+0000 7f23137e3700 1 -- 172.21.15.103:0/3361967923 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22f40038b0 msgr2=0x7f22f4003cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:28.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.640+0000 7f23137e3700 1 --2- 172.21.15.103:0/3361967923 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22f40038b0 0x7f22f4003cb0 secure :-1 s=READY pgs=1239 cs=0 l=1 rx=0x7f2308002f30 tx=0x7f2308010020).stop 2020-04-22T14:13:28.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.640+0000 7f2311d80700 1 -- 172.21.15.103:0/3361967923 reap_dead start 2020-04-22T14:13:28.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.641+0000 7f23137e3700 1 -- 172.21.15.103:0/3361967923 shutdown_connections 2020-04-22T14:13:28.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.641+0000 7f23137e3700 1 -- 172.21.15.103:0/3361967923 >> 172.21.15.103:0/3361967923 conn(0x7f230c0b9160 msgr2=0x7f230c05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:28.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.641+0000 7f23137e3700 1 -- 172.21.15.103:0/3361967923 shutdown_connections 2020-04-22T14:13:28.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.641+0000 7f23137e3700 1 -- 172.21.15.103:0/3361967923 wait complete. 2020-04-22T14:13:28.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.642+0000 7f23137e3700 1 Processor -- start 2020-04-22T14:13:28.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.642+0000 7f23137e3700 1 -- start start 2020-04-22T14:13:28.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.643+0000 7f23137e3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f230c0628d0 0x7f230c128030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:28.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.643+0000 7f23137e3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f230c14ffe0 0x7f230c150460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:28.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.643+0000 7f23137e3700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f230c14f900 con 0x7f230c1299e0 2020-04-22T14:13:28.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.643+0000 7f23137e3700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f230c129400 con 0x7f230c0628d0 2020-04-22T14:13:28.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.643+0000 7f23137e3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f230c14fb40 con 0x7f230c14ffe0 2020-04-22T14:13:28.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.643+0000 7f2311d80700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f230c14ffe0 0x7f230c150460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:28.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.643+0000 7f231157f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f230c0628d0 0x7f230c128030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:28.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.643+0000 7f2310d7e700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f230c1299e0 0x7f230c141f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:34828/0 (socket says 172.21.15.103:34828) 2020-04-22T14:13:28.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.643+0000 7f2310d7e700 1 -- 172.21.15.103:0/191785652 learned_addr learned my addr 172.21.15.103:0/191785652 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:28.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.643+0000 7f2311d80700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f230c14ffe0 0x7f230c150460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:38494/0 (socket says 172.21.15.103:38494) 2020-04-22T14:13:28.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.643+0000 7f231157f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f230c0628d0 0x7f230c128030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:50944/0 (socket says 172.21.15.103:50944) 2020-04-22T14:13:28.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.643+0000 7f231157f700 1 -- 172.21.15.103:0/191785652 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f230c14ffe0 msgr2=0x7f230c150460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:28.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.643+0000 7f231157f700 1 --2- 172.21.15.103:0/191785652 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f230c14ffe0 0x7f230c150460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:28.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.643+0000 7f231157f700 1 -- 172.21.15.103:0/191785652 >> v1:172.21.15.86:6789/0 conn(0x7f230c1299e0 legacy=0x7f230c141f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:28.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.643+0000 7f22fe7fc700 1 -- 172.21.15.103:0/191785652 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2344537302 0 0) 0x7f230c1435a0 con 0x7f230c1299e0 2020-04-22T14:13:28.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.643+0000 7f231157f700 1 -- 172.21.15.103:0/191785652 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f230c062cb0 con 0x7f230c0628d0 2020-04-22T14:13:28.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.643+0000 7f2311d80700 1 --2- 172.21.15.103:0/191785652 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f230c14ffe0 0x7f230c150460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:13:28.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.643+0000 7f231157f700 1 --2- 172.21.15.103:0/191785652 >> v2:172.21.15.86:3300/0 conn(0x7f230c0628d0 0x7f230c128030 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2308002f30 tx=0x7f2308010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:28.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.643+0000 7f231157f700 1 --2- 172.21.15.103:0/191785652 >> v2:172.21.15.86:3300/0 conn(0x7f230c0628d0 0x7f230c128030 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2308002f30 tx=0x7f2308010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:28.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.643+0000 7f231157f700 1 --2- 172.21.15.103:0/191785652 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f230c0628d0 0x7f230c128030 secure :-1 s=READY pgs=675 cs=0 l=1 rx=0x7f2308002f30 tx=0x7f2308010020).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:28.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.643+0000 7f231157f700 1 --2- 172.21.15.103:0/191785652 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f230c0628d0 0x7f230c128030 secure :-1 s=THROTTLE_DONE pgs=675 cs=0 l=1 rx=0x7f2308002f30 tx=0x7f2308010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:28.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.643+0000 7f22fe7fc700 1 -- 172.21.15.103:0/191785652 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f230800f750 con 0x7f230c0628d0 2020-04-22T14:13:28.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.643+0000 7f231157f700 1 --2- 172.21.15.103:0/191785652 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f230c0628d0 0x7f230c128030 secure :-1 s=THROTTLE_DONE pgs=675 cs=0 l=1 rx=0x7f2308002f30 tx=0x7f2308010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:28.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.644+0000 7f23137e3700 1 -- 172.21.15.103:0/191785652 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f230c142690 con 0x7f230c0628d0 2020-04-22T14:13:28.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.644+0000 7f231157f700 1 --2- 172.21.15.103:0/191785652 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f230c0628d0 0x7f230c128030 secure :-1 s=THROTTLE_DONE pgs=675 cs=0 l=1 rx=0x7f2308002f30 tx=0x7f2308010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:28.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.644+0000 7f22fe7fc700 1 -- 172.21.15.103:0/191785652 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23080056c0 con 0x7f230c0628d0 2020-04-22T14:13:28.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.644+0000 7f22fe7fc700 1 -- 172.21.15.103:0/191785652 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2308005a60 con 0x7f230c0628d0 2020-04-22T14:13:28.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.644+0000 7f23137e3700 1 -- 172.21.15.103:0/191785652 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f230c1508c0 con 0x7f230c0628d0 2020-04-22T14:13:28.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.644+0000 7f231157f700 1 --2- 172.21.15.103:0/191785652 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f230c0628d0 0x7f230c128030 secure :-1 s=THROTTLE_DONE pgs=675 cs=0 l=1 rx=0x7f2308002f30 tx=0x7f2308010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:28.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.645+0000 7f23137e3700 1 -- 172.21.15.103:0/191785652 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f230c129210 con 0x7f230c0628d0 2020-04-22T14:13:28.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.645+0000 7f22fe7fc700 1 -- 172.21.15.103:0/191785652 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f2308005c60 con 0x7f230c0628d0 2020-04-22T14:13:28.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.645+0000 7f231157f700 1 --2- 172.21.15.103:0/191785652 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f230c0628d0 0x7f230c128030 secure :-1 s=THROTTLE_DONE pgs=675 cs=0 l=1 rx=0x7f2308002f30 tx=0x7f2308010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:28.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.645+0000 7f22fe7fc700 1 --2- 172.21.15.103:0/191785652 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f22ec04d8b0 0x7f22ec04fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:28.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.645+0000 7f22fe7fc700 1 -- 172.21.15.103:0/191785652 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f2308061360 con 0x7f230c0628d0 2020-04-22T14:13:28.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.645+0000 7f2310d7e700 1 --2- 172.21.15.103:0/191785652 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f22ec04d8b0 0x7f22ec04fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:28.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.645+0000 7f2310d7e700 1 --2- 172.21.15.103:0/191785652 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f22ec04d8b0 0x7f22ec04fd70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2300001bb0 tx=0x7f230000cb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:28.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.645+0000 7f2310d7e700 1 --2- 172.21.15.103:0/191785652 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f22ec04d8b0 0x7f22ec04fd70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2300001bb0 tx=0x7f230000cb00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:28.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.645+0000 7f2310d7e700 1 --2- 172.21.15.103:0/191785652 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f22ec04d8b0 0x7f22ec04fd70 secure :-1 s=READY pgs=457 cs=0 l=1 rx=0x7f2300001bb0 tx=0x7f230000cb00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:28.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.648+0000 7f231157f700 1 --2- 172.21.15.103:0/191785652 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f230c0628d0 0x7f230c128030 secure :-1 s=THROTTLE_DONE pgs=675 cs=0 l=1 rx=0x7f2308002f30 tx=0x7f2308010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:28.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.648+0000 7f22fe7fc700 1 -- 172.21.15.103:0/191785652 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f230803c860 con 0x7f230c0628d0 2020-04-22T14:13:28.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.841+0000 7f23137e3700 1 -- 172.21.15.103:0/191785652 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f230c056c90 con 0x7f230c0628d0 2020-04-22T14:13:28.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.842+0000 7f231157f700 1 --2- 172.21.15.103:0/191785652 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f230c0628d0 0x7f230c128030 secure :-1 s=THROTTLE_DONE pgs=675 cs=0 l=1 rx=0x7f2308002f30 tx=0x7f2308010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:28.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.842+0000 7f22fe7fc700 1 -- 172.21.15.103:0/191785652 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f230803fe80 con 0x7f230c0628d0 2020-04-22T14:13:28.844 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:13:28.844 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:43.570838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:13:28.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.843+0000 7f23137e3700 1 -- 172.21.15.103:0/191785652 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f22ec04d8b0 msgr2=0x7f22ec04fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:28.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.843+0000 7f23137e3700 1 --2- 172.21.15.103:0/191785652 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f22ec04d8b0 0x7f22ec04fd70 secure :-1 s=READY pgs=457 cs=0 l=1 rx=0x7f2300001bb0 tx=0x7f230000cb00).stop 2020-04-22T14:13:28.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.843+0000 7f23137e3700 1 -- 172.21.15.103:0/191785652 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f230c0628d0 msgr2=0x7f230c128030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:28.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.843+0000 7f23137e3700 1 --2- 172.21.15.103:0/191785652 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f230c0628d0 0x7f230c128030 secure :-1 s=READY pgs=675 cs=0 l=1 rx=0x7f2308002f30 tx=0x7f2308010020).stop 2020-04-22T14:13:28.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.843+0000 7f23137e3700 1 -- 172.21.15.103:0/191785652 shutdown_connections 2020-04-22T14:13:28.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.843+0000 7f23137e3700 1 --2- 172.21.15.103:0/191785652 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f230c14ffe0 0x7f230c150460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:28.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.843+0000 7f23137e3700 1 --2- 172.21.15.103:0/191785652 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f22ec04d8b0 0x7f22ec04fd70 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:28.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.843+0000 7f23137e3700 1 --2- 172.21.15.103:0/191785652 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f230c0628d0 0x7f230c128030 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:28.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.843+0000 7f23137e3700 1 -- 172.21.15.103:0/191785652 >> 172.21.15.103:0/191785652 conn(0x7f230c0b9160 msgr2=0x7f230c0b7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:28.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.843+0000 7f23137e3700 1 -- 172.21.15.103:0/191785652 shutdown_connections 2020-04-22T14:13:28.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:28.843+0000 7f23137e3700 1 -- 172.21.15.103:0/191785652 wait complete. 2020-04-22T14:13:28.855 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 54 2020-04-22T14:13:28.856 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:13:29.857 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:29.885 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:13:30.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.038+0000 7f3c06430700 1 Processor -- start 2020-04-22T14:13:30.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.038+0000 7f3c06430700 1 -- start start 2020-04-22T14:13:30.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.039+0000 7f3c06430700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3c00065fe0 0x7f3c001464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:30.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.039+0000 7f3c06430700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c00063e30 0x7f3c000642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:30.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.039+0000 7f3c06430700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c00143300 con 0x7f3c0012c0d0 2020-04-22T14:13:30.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.039+0000 7f3c06430700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c001435a0 con 0x7f3c00065fe0 2020-04-22T14:13:30.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.039+0000 7f3c06430700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c00143840 con 0x7f3c00063e30 2020-04-22T14:13:30.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.039+0000 7f3bff7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3c00065fe0 0x7f3c001464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:30.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.039+0000 7f3bff7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3c00065fe0 0x7f3c001464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53720/0 (socket says 172.21.15.103:53720) 2020-04-22T14:13:30.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.039+0000 7f3bff7fe700 1 -- 172.21.15.103:0/2327494104 learned_addr learned my addr 172.21.15.103:0/2327494104 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:30.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.039+0000 7f3c049cd700 1 --2- 172.21.15.103:0/2327494104 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c00063e30 0x7f3c000642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:30.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.039+0000 7f3bff7fe700 1 -- 172.21.15.103:0/2327494104 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c00063e30 msgr2=0x7f3c000642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:30.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.039+0000 7f3bff7fe700 1 --2- 172.21.15.103:0/2327494104 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c00063e30 0x7f3c000642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:30.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.039+0000 7f3bff7fe700 1 -- 172.21.15.103:0/2327494104 >> v1:172.21.15.86:6789/0 conn(0x7f3c0012c0d0 legacy=0x7f3c0005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:30.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.040+0000 7f3bff7fe700 1 -- 172.21.15.103:0/2327494104 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c0005bb50 con 0x7f3c00065fe0 2020-04-22T14:13:30.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.040+0000 7f3bff7fe700 1 --2- 172.21.15.103:0/2327494104 >> v2:172.21.15.103:3300/0 conn(0x7f3c00065fe0 0x7f3c001464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3c000b85b0 tx=0x7f3bf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:30.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.040+0000 7f3bff7fe700 1 --2- 172.21.15.103:0/2327494104 >> v2:172.21.15.103:3300/0 conn(0x7f3c00065fe0 0x7f3c001464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3c000b85b0 tx=0x7f3bf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:30.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.040+0000 7f3bff7fe700 1 --2- 172.21.15.103:0/2327494104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c00065fe0 0x7f3c001464e0 secure :-1 s=READY pgs=1240 cs=0 l=1 rx=0x7f3c000b85b0 tx=0x7f3bf0007a40).ready entity=mon.1 client_cookie=db9dd5b3bffe53cb server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:30.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.040+0000 7f3bff7fe700 1 --2- 172.21.15.103:0/2327494104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c00065fe0 0x7f3c001464e0 secure :-1 s=THROTTLE_DONE pgs=1240 cs=0 l=1 rx=0x7f3c000b85b0 tx=0x7f3bf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:30.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.040+0000 7f3bff7fe700 1 --2- 172.21.15.103:0/2327494104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c00065fe0 0x7f3c001464e0 secure :-1 s=THROTTLE_DONE pgs=1240 cs=0 l=1 rx=0x7f3c000b85b0 tx=0x7f3bf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:30.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.040+0000 7f3bff7fe700 1 --2- 172.21.15.103:0/2327494104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c00065fe0 0x7f3c001464e0 secure :-1 s=THROTTLE_DONE pgs=1240 cs=0 l=1 rx=0x7f3c000b85b0 tx=0x7f3bf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:30.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.040+0000 7f3bfeffd700 1 -- 172.21.15.103:0/2327494104 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bf00116e0 con 0x7f3c00065fe0 2020-04-22T14:13:30.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.040+0000 7f3bfeffd700 1 -- 172.21.15.103:0/2327494104 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf0011840 con 0x7f3c00065fe0 2020-04-22T14:13:30.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.040+0000 7f3bfeffd700 1 -- 172.21.15.103:0/2327494104 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bf0011c60 con 0x7f3c00065fe0 2020-04-22T14:13:30.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.040+0000 7f3c06430700 1 -- 172.21.15.103:0/2327494104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c00065fe0 msgr2=0x7f3c001464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:30.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.040+0000 7f3c06430700 1 --2- 172.21.15.103:0/2327494104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c00065fe0 0x7f3c001464e0 secure :-1 s=READY pgs=1240 cs=0 l=1 rx=0x7f3c000b85b0 tx=0x7f3bf0007a40).stop 2020-04-22T14:13:30.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.040+0000 7f3c06430700 1 -- 172.21.15.103:0/2327494104 shutdown_connections 2020-04-22T14:13:30.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.040+0000 7f3c06430700 1 --2- 172.21.15.103:0/2327494104 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c00063e30 0x7f3c000642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:30.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.040+0000 7f3c06430700 1 --2- 172.21.15.103:0/2327494104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c00065fe0 0x7f3c001464e0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:30.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.040+0000 7f3c06430700 1 -- 172.21.15.103:0/2327494104 >> 172.21.15.103:0/2327494104 conn(0x7f3c000b9160 msgr2=0x7f3c0005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:30.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.040+0000 7f3c06430700 1 -- 172.21.15.103:0/2327494104 shutdown_connections 2020-04-22T14:13:30.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.040+0000 7f3c06430700 1 -- 172.21.15.103:0/2327494104 wait complete. 2020-04-22T14:13:30.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.041+0000 7f3c06430700 1 Processor -- start 2020-04-22T14:13:30.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.041+0000 7f3c06430700 1 -- start start 2020-04-22T14:13:30.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.042+0000 7f3c06430700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c00065fe0 0x7f3c00142210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:30.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.042+0000 7f3c06430700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3c0012c0d0 0x7f3c00064a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:30.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.042+0000 7f3c06430700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c00064e60 con 0x7f3c00063e30 2020-04-22T14:13:30.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.042+0000 7f3c06430700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c00128e20 con 0x7f3c0012c0d0 2020-04-22T14:13:30.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.042+0000 7f3c06430700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c001290c0 con 0x7f3c00065fe0 2020-04-22T14:13:30.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.043+0000 7f3bff7fe700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c00065fe0 0x7f3c00142210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:30.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.043+0000 7f3c049cd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3c0012c0d0 0x7f3c00064a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:30.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.043+0000 7f3c049cd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3c0012c0d0 0x7f3c00064a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:50962/0 (socket says 172.21.15.103:50962) 2020-04-22T14:13:30.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.043+0000 7f3c049cd700 1 -- 172.21.15.103:0/1726377048 learned_addr learned my addr 172.21.15.103:0/1726377048 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:30.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.043+0000 7f3bff7fe700 1 -- 172.21.15.103:0/1726377048 >> v2:172.21.15.86:3300/0 conn(0x7f3c0012c0d0 msgr2=0x7f3c00064a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:30.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.043+0000 7f3bff7fe700 1 --2- 172.21.15.103:0/1726377048 >> v2:172.21.15.86:3300/0 conn(0x7f3c0012c0d0 0x7f3c00064a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:30.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.043+0000 7f3bff7fe700 1 -- 172.21.15.103:0/1726377048 >> v1:172.21.15.86:6789/0 conn(0x7f3c00063e30 legacy=0x7f3c00125ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:30.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.043+0000 7f3bff7fe700 1 -- 172.21.15.103:0/1726377048 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c00129360 con 0x7f3c00065fe0 2020-04-22T14:13:30.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.043+0000 7f3bff7fe700 1 --2- 172.21.15.103:0/1726377048 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c00065fe0 0x7f3c00142210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3c000b85b0 tx=0x7f3bf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:30.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.043+0000 7f3bff7fe700 1 --2- 172.21.15.103:0/1726377048 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c00065fe0 0x7f3c00142210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3c000b85b0 tx=0x7f3bf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:30.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.043+0000 7f3bff7fe700 1 --2- 172.21.15.103:0/1726377048 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c00065fe0 0x7f3c00142210 secure :-1 s=READY pgs=119 cs=0 l=1 rx=0x7f3c000b85b0 tx=0x7f3bf0007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:30.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.043+0000 7f3bff7fe700 1 --2- 172.21.15.103:0/1726377048 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c00065fe0 0x7f3c00142210 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7f3c000b85b0 tx=0x7f3bf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:30.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.043+0000 7f3bfd7fa700 1 -- 172.21.15.103:0/1726377048 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bf0007170 con 0x7f3c00065fe0 2020-04-22T14:13:30.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.043+0000 7f3bff7fe700 1 --2- 172.21.15.103:0/1726377048 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c00065fe0 0x7f3c00142210 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7f3c000b85b0 tx=0x7f3bf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:30.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.043+0000 7f3bfd7fa700 1 -- 172.21.15.103:0/1726377048 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf00072d0 con 0x7f3c00065fe0 2020-04-22T14:13:30.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.043+0000 7f3c06430700 1 -- 172.21.15.103:0/1726377048 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c00128aa0 con 0x7f3c00065fe0 2020-04-22T14:13:30.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.043+0000 7f3bff7fe700 1 --2- 172.21.15.103:0/1726377048 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c00065fe0 0x7f3c00142210 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7f3c000b85b0 tx=0x7f3bf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:30.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.043+0000 7f3bfd7fa700 1 -- 172.21.15.103:0/1726377048 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bf00056c0 con 0x7f3c00065fe0 2020-04-22T14:13:30.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.043+0000 7f3c06430700 1 -- 172.21.15.103:0/1726377048 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c0012b750 con 0x7f3c00065fe0 2020-04-22T14:13:30.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.044+0000 7f3bff7fe700 1 --2- 172.21.15.103:0/1726377048 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c00065fe0 0x7f3c00142210 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7f3c000b85b0 tx=0x7f3bf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:30.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.044+0000 7f3c06430700 1 -- 172.21.15.103:0/1726377048 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c00129720 con 0x7f3c00065fe0 2020-04-22T14:13:30.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.045+0000 7f3bfd7fa700 1 -- 172.21.15.103:0/1726377048 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f3bf00058c0 con 0x7f3c00065fe0 2020-04-22T14:13:30.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.045+0000 7f3bff7fe700 1 --2- 172.21.15.103:0/1726377048 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c00065fe0 0x7f3c00142210 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7f3c000b85b0 tx=0x7f3bf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:30.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.045+0000 7f3bfd7fa700 1 --2- 172.21.15.103:0/1726377048 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3be004d9f0 0x7f3be004feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:30.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.045+0000 7f3bfd7fa700 1 -- 172.21.15.103:0/1726377048 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f3bf0061b40 con 0x7f3c00065fe0 2020-04-22T14:13:30.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.045+0000 7f3bfffff700 1 --2- 172.21.15.103:0/1726377048 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3be004d9f0 0x7f3be004feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:30.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.045+0000 7f3bfffff700 1 --2- 172.21.15.103:0/1726377048 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3be004d9f0 0x7f3be004feb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3c00147a10 tx=0x7f3bf4007b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:30.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.045+0000 7f3bfffff700 1 --2- 172.21.15.103:0/1726377048 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3be004d9f0 0x7f3be004feb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3c00147a10 tx=0x7f3bf4007b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:30.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.045+0000 7f3bfffff700 1 --2- 172.21.15.103:0/1726377048 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3be004d9f0 0x7f3be004feb0 secure :-1 s=READY pgs=458 cs=0 l=1 rx=0x7f3c00147a10 tx=0x7f3bf4007b60).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:30.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.048+0000 7f3bff7fe700 1 --2- 172.21.15.103:0/1726377048 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c00065fe0 0x7f3c00142210 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7f3c000b85b0 tx=0x7f3bf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:30.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.048+0000 7f3bfd7fa700 1 -- 172.21.15.103:0/1726377048 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f3bf003cf80 con 0x7f3c00065fe0 2020-04-22T14:13:30.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.236+0000 7f3c06430700 1 -- 172.21.15.103:0/1726377048 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c00056c90 con 0x7f3c00065fe0 2020-04-22T14:13:30.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.236+0000 7f3bff7fe700 1 --2- 172.21.15.103:0/1726377048 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c00065fe0 0x7f3c00142210 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7f3c000b85b0 tx=0x7f3bf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:30.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.236+0000 7f3bfd7fa700 1 -- 172.21.15.103:0/1726377048 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f3bf00405a0 con 0x7f3c00065fe0 2020-04-22T14:13:30.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.238+0000 7f3c06430700 1 -- 172.21.15.103:0/1726377048 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3be004d9f0 msgr2=0x7f3be004feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:30.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.238+0000 7f3c06430700 1 --2- 172.21.15.103:0/1726377048 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3be004d9f0 0x7f3be004feb0 secure :-1 s=READY pgs=458 cs=0 l=1 rx=0x7f3c00147a10 tx=0x7f3bf4007b60).stop 2020-04-22T14:13:30.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.238+0000 7f3c06430700 1 -- 172.21.15.103:0/1726377048 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c00065fe0 msgr2=0x7f3c00142210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:30.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.238+0000 7f3c06430700 1 --2- 172.21.15.103:0/1726377048 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c00065fe0 0x7f3c00142210 secure :-1 s=READY pgs=119 cs=0 l=1 rx=0x7f3c000b85b0 tx=0x7f3bf0007a40).stop 2020-04-22T14:13:30.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.238+0000 7f3c06430700 1 -- 172.21.15.103:0/1726377048 shutdown_connections 2020-04-22T14:13:30.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.238+0000 7f3c06430700 1 --2- 172.21.15.103:0/1726377048 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3be004d9f0 0x7f3be004feb0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:30.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.238+0000 7f3c06430700 1 --2- 172.21.15.103:0/1726377048 >> v2:172.21.15.86:3300/0 conn(0x7f3c0012c0d0 0x7f3c00064a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:30.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.238+0000 7f3c06430700 1 --2- 172.21.15.103:0/1726377048 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c00065fe0 0x7f3c00142210 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:30.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.238+0000 7f3c06430700 1 -- 172.21.15.103:0/1726377048 >> 172.21.15.103:0/1726377048 conn(0x7f3c000b9160 msgr2=0x7f3c000b7910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:30.244 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.238+0000 7f3c06430700 1 -- 172.21.15.103:0/1726377048 shutdown_connections 2020-04-22T14:13:30.244 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:30.238+0000 7f3c06430700 1 -- 172.21.15.103:0/1726377048 wait complete. 2020-04-22T14:13:30.244 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 54 2020-04-22T14:13:30.244 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:13:30.244 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:43.570838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:13:30.250 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:13:31.253 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:31.268 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:13:31.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.417+0000 7fd20d320700 1 Processor -- start 2020-04-22T14:13:31.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.417+0000 7fd20d320700 1 -- start start 2020-04-22T14:13:31.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.418+0000 7fd20d320700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd208146250 0x7fd208062910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:31.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.418+0000 7fd20d320700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd20813c420 0x7fd20813c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:31.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.418+0000 7fd20d320700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd208144140 con 0x7fd208062d70 2020-04-22T14:13:31.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.418+0000 7fd20d320700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2080b1990 con 0x7fd208146250 2020-04-22T14:13:31.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.418+0000 7fd20d320700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2080b1b80 con 0x7fd20813c420 2020-04-22T14:13:31.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.418+0000 7fd1fffff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd208062d70 0x7fd208143a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45924/0 (socket says 172.21.15.103:45924) 2020-04-22T14:13:31.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.418+0000 7fd1fffff700 1 -- 172.21.15.103:0/702183493 learned_addr learned my addr 172.21.15.103:0/702183493 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:31.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.418+0000 7fd206ffd700 1 --2- 172.21.15.103:0/702183493 >> v2:172.21.15.86:3300/0 conn(0x7fd208146250 0x7fd208062910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:31.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.418+0000 7fd2077fe700 1 --2- 172.21.15.103:0/702183493 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd20813c420 0x7fd20813c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:31.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.418+0000 7fd2067fc700 1 -- 172.21.15.103:0/702183493 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3092771301 0 0) 0x7fd208144140 con 0x7fd208062d70 2020-04-22T14:13:31.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.418+0000 7fd2067fc700 1 -- 172.21.15.103:0/702183493 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1e8003230 con 0x7fd208062d70 2020-04-22T14:13:31.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.418+0000 7fd2067fc700 1 -- 172.21.15.103:0/702183493 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2642997939 0 0) 0x7fd1e8003230 con 0x7fd208062d70 2020-04-22T14:13:31.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.418+0000 7fd2067fc700 1 -- 172.21.15.103:0/702183493 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd20813c420 msgr2=0x7fd20813c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:31.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.418+0000 7fd2067fc700 1 --2- 172.21.15.103:0/702183493 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd20813c420 0x7fd20813c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:31.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.418+0000 7fd2067fc700 1 -- 172.21.15.103:0/702183493 >> v2:172.21.15.86:3300/0 conn(0x7fd208146250 msgr2=0x7fd208062910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:31.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.418+0000 7fd2067fc700 1 --2- 172.21.15.103:0/702183493 >> v2:172.21.15.86:3300/0 conn(0x7fd208146250 0x7fd208062910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:31.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.418+0000 7fd2067fc700 1 -- 172.21.15.103:0/702183493 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2080b1e20 con 0x7fd208062d70 2020-04-22T14:13:31.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.418+0000 7fd2067fc700 1 -- 172.21.15.103:0/702183493 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fd1f00016d0 con 0x7fd208062d70 2020-04-22T14:13:31.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.418+0000 7fd2067fc700 1 -- 172.21.15.103:0/702183493 >> v1:172.21.15.103:6789/0 conn(0x7fd208062d70 legacy=0x7fd208143a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:31.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.418+0000 7fd2067fc700 1 --2- 172.21.15.103:0/702183493 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd1e8003720 0x7fd1e8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:31.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.418+0000 7fd2067fc700 1 --2- 172.21.15.103:0/702183493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1e8004010 0x7fd1e80044f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:31.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.418+0000 7fd2067fc700 1 --2- 172.21.15.103:0/702183493 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd1e8004a60 0x7fd1e8004ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:31.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.418+0000 7fd2067fc700 1 -- 172.21.15.103:0/702183493 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2080b1b80 con 0x7fd1e8004a60 2020-04-22T14:13:31.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.418+0000 7fd2067fc700 1 -- 172.21.15.103:0/702183493 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e800b810 con 0x7fd1e8004010 2020-04-22T14:13:31.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.418+0000 7fd2067fc700 1 -- 172.21.15.103:0/702183493 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e800b9d0 con 0x7fd1e8003720 2020-04-22T14:13:31.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.419+0000 7fd2077fe700 1 --2- 172.21.15.103:0/702183493 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd20813c420 0x7fd20813c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:13:31.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.419+0000 7fd1fffff700 1 --2- 172.21.15.103:0/702183493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1e8004010 0x7fd1e80044f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:31.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.419+0000 7fd206ffd700 1 --2- 172.21.15.103:0/702183493 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd1e8003720 0x7fd1e8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:31.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.419+0000 7fd2077fe700 1 --2- 172.21.15.103:0/702183493 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd1e8004a60 0x7fd1e8004ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:31.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.419+0000 7fd1fffff700 1 -- 172.21.15.103:0/702183493 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd1e8003720 msgr2=0x7fd1e8003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:31.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.419+0000 7fd1fffff700 1 --2- 172.21.15.103:0/702183493 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd1e8003720 0x7fd1e8003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:31.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.419+0000 7fd1fffff700 1 -- 172.21.15.103:0/702183493 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd1e8004a60 msgr2=0x7fd1e8004ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:31.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.419+0000 7fd1fffff700 1 --2- 172.21.15.103:0/702183493 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd1e8004a60 0x7fd1e8004ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:31.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.419+0000 7fd1fffff700 1 -- 172.21.15.103:0/702183493 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e8003230 con 0x7fd1e8004010 2020-04-22T14:13:31.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.419+0000 7fd2077fe700 1 --2- 172.21.15.103:0/702183493 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd1e8004a60 0x7fd1e8004ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:13:31.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.419+0000 7fd1fffff700 1 --2- 172.21.15.103:0/702183493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1e8004010 0x7fd1e80044f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd1f00013e0 tx=0x7fd2080b1cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:31.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.419+0000 7fd1fffff700 1 --2- 172.21.15.103:0/702183493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1e8004010 0x7fd1e80044f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd1f00013e0 tx=0x7fd2080b1cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:31.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.419+0000 7fd1fffff700 1 --2- 172.21.15.103:0/702183493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1e8004010 0x7fd1e80044f0 secure :-1 s=READY pgs=1242 cs=0 l=1 rx=0x7fd1f00013e0 tx=0x7fd2080b1cf0).ready entity=mon.1 client_cookie=ec66d77b760240d3 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:31.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.419+0000 7fd1fffff700 1 --2- 172.21.15.103:0/702183493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1e8004010 0x7fd1e80044f0 secure :-1 s=THROTTLE_DONE pgs=1242 cs=0 l=1 rx=0x7fd1f00013e0 tx=0x7fd2080b1cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:31.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.419+0000 7fd2067fc700 1 -- 172.21.15.103:0/702183493 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1f000ce70 con 0x7fd1e8004010 2020-04-22T14:13:31.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.419+0000 7fd1fffff700 1 --2- 172.21.15.103:0/702183493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1e8004010 0x7fd1e80044f0 secure :-1 s=THROTTLE_DONE pgs=1242 cs=0 l=1 rx=0x7fd1f00013e0 tx=0x7fd2080b1cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:31.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.419+0000 7fd1fffff700 1 --2- 172.21.15.103:0/702183493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1e8004010 0x7fd1e80044f0 secure :-1 s=THROTTLE_DONE pgs=1242 cs=0 l=1 rx=0x7fd1f00013e0 tx=0x7fd2080b1cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:31.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.419+0000 7fd2067fc700 1 -- 172.21.15.103:0/702183493 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f000e370 con 0x7fd1e8004010 2020-04-22T14:13:31.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.419+0000 7fd2067fc700 1 -- 172.21.15.103:0/702183493 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1f000e750 con 0x7fd1e8004010 2020-04-22T14:13:31.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.419+0000 7fd20d320700 1 -- 172.21.15.103:0/702183493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1e8004010 msgr2=0x7fd1e80044f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:31.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.419+0000 7fd20d320700 1 --2- 172.21.15.103:0/702183493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1e8004010 0x7fd1e80044f0 secure :-1 s=READY pgs=1242 cs=0 l=1 rx=0x7fd1f00013e0 tx=0x7fd2080b1cf0).stop 2020-04-22T14:13:31.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.419+0000 7fd2077fe700 1 -- 172.21.15.103:0/702183493 reap_dead start 2020-04-22T14:13:31.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.419+0000 7fd20d320700 1 -- 172.21.15.103:0/702183493 shutdown_connections 2020-04-22T14:13:31.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.420+0000 7fd20d320700 1 -- 172.21.15.103:0/702183493 >> 172.21.15.103:0/702183493 conn(0x7fd20805ad30 msgr2=0x7fd20805b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:31.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.420+0000 7fd20d320700 1 -- 172.21.15.103:0/702183493 shutdown_connections 2020-04-22T14:13:31.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.420+0000 7fd20d320700 1 -- 172.21.15.103:0/702183493 wait complete. 2020-04-22T14:13:31.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.420+0000 7fd20d320700 1 Processor -- start 2020-04-22T14:13:31.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.421+0000 7fd20d320700 1 -- start start 2020-04-22T14:13:31.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.421+0000 7fd20d320700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd208143b90 0x7fd2081330e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:31.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.421+0000 7fd20d320700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd208132980 0x7fd2080ac740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:31.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.421+0000 7fd20d320700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2080af6e0 con 0x7fd208143f70 2020-04-22T14:13:31.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.421+0000 7fd20d320700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd208063970 con 0x7fd208143b90 2020-04-22T14:13:31.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.421+0000 7fd20d320700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd208063c10 con 0x7fd208132980 2020-04-22T14:13:31.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.421+0000 7fd2077fe700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd208132980 0x7fd2080ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:31.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.422+0000 7fd2077fe700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd208132980 0x7fd2080ac740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:38528/0 (socket says 172.21.15.103:38528) 2020-04-22T14:13:31.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.422+0000 7fd206ffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd208143b90 0x7fd2081330e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:31.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.422+0000 7fd2077fe700 1 -- 172.21.15.103:0/2483866163 learned_addr learned my addr 172.21.15.103:0/2483866163 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:31.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.422+0000 7fd2077fe700 1 -- 172.21.15.103:0/2483866163 >> v2:172.21.15.86:3300/0 conn(0x7fd208143b90 msgr2=0x7fd2081330e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:31.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.422+0000 7fd2077fe700 1 --2- 172.21.15.103:0/2483866163 >> v2:172.21.15.86:3300/0 conn(0x7fd208143b90 0x7fd2081330e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:31.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.422+0000 7fd2077fe700 1 -- 172.21.15.103:0/2483866163 >> v1:172.21.15.86:6789/0 conn(0x7fd208143f70 legacy=0x7fd208064350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:31.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.422+0000 7fd2077fe700 1 -- 172.21.15.103:0/2483866163 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd208063eb0 con 0x7fd208132980 2020-04-22T14:13:31.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.422+0000 7fd2077fe700 1 --2- 172.21.15.103:0/2483866163 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd208132980 0x7fd2080ac740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd1f0001930 tx=0x7fd200007ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:31.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.422+0000 7fd2077fe700 1 --2- 172.21.15.103:0/2483866163 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd208132980 0x7fd2080ac740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd1f0001930 tx=0x7fd200007ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:31.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.422+0000 7fd2077fe700 1 --2- 172.21.15.103:0/2483866163 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd208132980 0x7fd2080ac740 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7fd1f0001930 tx=0x7fd200007ee0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:31.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.422+0000 7fd2077fe700 1 --2- 172.21.15.103:0/2483866163 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd208132980 0x7fd2080ac740 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fd1f0001930 tx=0x7fd200007ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:31.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.422+0000 7fd204ff9700 1 -- 172.21.15.103:0/2483866163 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd20000aae0 con 0x7fd208132980 2020-04-22T14:13:31.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.422+0000 7fd2077fe700 1 --2- 172.21.15.103:0/2483866163 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd208132980 0x7fd2080ac740 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fd1f0001930 tx=0x7fd200007ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:31.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.422+0000 7fd204ff9700 1 -- 172.21.15.103:0/2483866163 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20000ac40 con 0x7fd208132980 2020-04-22T14:13:31.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.422+0000 7fd2077fe700 1 --2- 172.21.15.103:0/2483866163 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd208132980 0x7fd2080ac740 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fd1f0001930 tx=0x7fd200007ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:31.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.422+0000 7fd20d320700 1 -- 172.21.15.103:0/2483866163 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2080acba0 con 0x7fd208132980 2020-04-22T14:13:31.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.422+0000 7fd204ff9700 1 -- 172.21.15.103:0/2483866163 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd20000adb0 con 0x7fd208132980 2020-04-22T14:13:31.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.422+0000 7fd20d320700 1 -- 172.21.15.103:0/2483866163 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2080ad0f0 con 0x7fd208132980 2020-04-22T14:13:31.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.423+0000 7fd2077fe700 1 --2- 172.21.15.103:0/2483866163 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd208132980 0x7fd2080ac740 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fd1f0001930 tx=0x7fd200007ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:31.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.423+0000 7fd20d320700 1 -- 172.21.15.103:0/2483866163 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd208062be0 con 0x7fd208132980 2020-04-22T14:13:31.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.423+0000 7fd204ff9700 1 -- 172.21.15.103:0/2483866163 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fd20000d280 con 0x7fd208132980 2020-04-22T14:13:31.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.423+0000 7fd2077fe700 1 --2- 172.21.15.103:0/2483866163 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd208132980 0x7fd2080ac740 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fd1f0001930 tx=0x7fd200007ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:31.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.424+0000 7fd204ff9700 1 --2- 172.21.15.103:0/2483866163 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd1ec04da00 0x7fd1ec04fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:31.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.424+0000 7fd204ff9700 1 -- 172.21.15.103:0/2483866163 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fd200063210 con 0x7fd208132980 2020-04-22T14:13:31.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.424+0000 7fd206ffd700 1 --2- 172.21.15.103:0/2483866163 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd1ec04da00 0x7fd1ec04fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:31.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.424+0000 7fd206ffd700 1 --2- 172.21.15.103:0/2483866163 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd1ec04da00 0x7fd1ec04fec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd1f8002f30 tx=0x7fd1f8003030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:31.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.424+0000 7fd206ffd700 1 --2- 172.21.15.103:0/2483866163 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd1ec04da00 0x7fd1ec04fec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd1f8002f30 tx=0x7fd1f8003030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:31.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.424+0000 7fd206ffd700 1 --2- 172.21.15.103:0/2483866163 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd1ec04da00 0x7fd1ec04fec0 secure :-1 s=READY pgs=459 cs=0 l=1 rx=0x7fd1f8002f30 tx=0x7fd1f8003030).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:31.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.428+0000 7fd2077fe700 1 --2- 172.21.15.103:0/2483866163 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd208132980 0x7fd2080ac740 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fd1f0001930 tx=0x7fd200007ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:31.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.428+0000 7fd204ff9700 1 -- 172.21.15.103:0/2483866163 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fd20003e590 con 0x7fd208132980 2020-04-22T14:13:31.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.621+0000 7fd20d320700 1 -- 172.21.15.103:0/2483866163 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd208056c90 con 0x7fd208132980 2020-04-22T14:13:31.624 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.621+0000 7fd2077fe700 1 --2- 172.21.15.103:0/2483866163 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd208132980 0x7fd2080ac740 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7fd1f0001930 tx=0x7fd200007ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:31.624 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.621+0000 7fd204ff9700 1 -- 172.21.15.103:0/2483866163 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2147 (secure 0 0 0) 0x7fd200041bb0 con 0x7fd208132980 2020-04-22T14:13:31.624 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:13:31.624 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:43.570838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:13:31.625 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.623+0000 7fd20d320700 1 -- 172.21.15.103:0/2483866163 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd1ec04da00 msgr2=0x7fd1ec04fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:31.625 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.623+0000 7fd20d320700 1 --2- 172.21.15.103:0/2483866163 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd1ec04da00 0x7fd1ec04fec0 secure :-1 s=READY pgs=459 cs=0 l=1 rx=0x7fd1f8002f30 tx=0x7fd1f8003030).stop 2020-04-22T14:13:31.625 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.623+0000 7fd20d320700 1 -- 172.21.15.103:0/2483866163 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd208132980 msgr2=0x7fd2080ac740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:31.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.623+0000 7fd20d320700 1 --2- 172.21.15.103:0/2483866163 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd208132980 0x7fd2080ac740 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7fd1f0001930 tx=0x7fd200007ee0).stop 2020-04-22T14:13:31.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.623+0000 7fd20d320700 1 -- 172.21.15.103:0/2483866163 shutdown_connections 2020-04-22T14:13:31.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.623+0000 7fd20d320700 1 --2- 172.21.15.103:0/2483866163 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd208132980 0x7fd2080ac740 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:31.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.623+0000 7fd20d320700 1 --2- 172.21.15.103:0/2483866163 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd1ec04da00 0x7fd1ec04fec0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:31.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.623+0000 7fd20d320700 1 --2- 172.21.15.103:0/2483866163 >> v2:172.21.15.86:3300/0 conn(0x7fd208143b90 0x7fd2081330e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:31.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.623+0000 7fd20d320700 1 -- 172.21.15.103:0/2483866163 >> 172.21.15.103:0/2483866163 conn(0x7fd20805ad30 msgr2=0x7fd2080b86f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:31.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.623+0000 7fd20d320700 1 -- 172.21.15.103:0/2483866163 shutdown_connections 2020-04-22T14:13:31.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:31.623+0000 7fd20d320700 1 -- 172.21.15.103:0/2483866163 wait complete. 2020-04-22T14:13:31.627 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 54 2020-04-22T14:13:31.635 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:13:32.636 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:32.653 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:13:32.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.805+0000 7f4dae426700 1 Processor -- start 2020-04-22T14:13:32.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.805+0000 7f4dae426700 1 -- start start 2020-04-22T14:13:32.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.806+0000 7f4dae426700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4da81441f0 0x7f4da8144820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:32.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.806+0000 7f4dae426700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4da8144c80 0x7f4da80ad850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:32.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.806+0000 7f4dae426700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4da80b5900 con 0x7f4da805b7c0 2020-04-22T14:13:32.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.806+0000 7f4dae426700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4da80b5ba0 con 0x7f4da8144c80 2020-04-22T14:13:32.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.806+0000 7f4dae426700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4da80b5e40 con 0x7f4da81441f0 2020-04-22T14:13:32.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.806+0000 7f4da77fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4da81441f0 0x7f4da8144820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:32.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.806+0000 7f4da77fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4da81441f0 0x7f4da8144820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53754/0 (socket says 172.21.15.103:53754) 2020-04-22T14:13:32.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.806+0000 7f4da77fe700 1 -- 172.21.15.103:0/2927718322 learned_addr learned my addr 172.21.15.103:0/2927718322 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:32.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.806+0000 7f4dac9c3700 1 --2- 172.21.15.103:0/2927718322 >> v2:172.21.15.86:3300/0 conn(0x7f4da8144c80 0x7f4da80ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:32.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.806+0000 7f4da77fe700 1 -- 172.21.15.103:0/2927718322 >> v2:172.21.15.86:3300/0 conn(0x7f4da8144c80 msgr2=0x7f4da80ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:32.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.806+0000 7f4da77fe700 1 --2- 172.21.15.103:0/2927718322 >> v2:172.21.15.86:3300/0 conn(0x7f4da8144c80 0x7f4da80ad850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:32.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.806+0000 7f4da77fe700 1 -- 172.21.15.103:0/2927718322 >> v1:172.21.15.86:6789/0 conn(0x7f4da805b7c0 legacy=0x7f4da80b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:32.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.806+0000 7f4da77fe700 1 -- 172.21.15.103:0/2927718322 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da805bba0 con 0x7f4da81441f0 2020-04-22T14:13:32.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.806+0000 7f4da77fe700 1 --2- 172.21.15.103:0/2927718322 >> v2:172.21.15.103:3300/0 conn(0x7f4da81441f0 0x7f4da8144820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4da80613e0 tx=0x7f4d9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:32.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.807+0000 7f4da77fe700 1 --2- 172.21.15.103:0/2927718322 >> v2:172.21.15.103:3300/0 conn(0x7f4da81441f0 0x7f4da8144820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4da80613e0 tx=0x7f4d9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:32.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.807+0000 7f4da77fe700 1 --2- 172.21.15.103:0/2927718322 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4da81441f0 0x7f4da8144820 secure :-1 s=READY pgs=1243 cs=0 l=1 rx=0x7f4da80613e0 tx=0x7f4d9c007a40).ready entity=mon.1 client_cookie=2906e824e4cab714 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:32.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.807+0000 7f4da77fe700 1 --2- 172.21.15.103:0/2927718322 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4da81441f0 0x7f4da8144820 secure :-1 s=THROTTLE_DONE pgs=1243 cs=0 l=1 rx=0x7f4da80613e0 tx=0x7f4d9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:32.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.807+0000 7f4da6ffd700 1 -- 172.21.15.103:0/2927718322 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d9c008e10 con 0x7f4da81441f0 2020-04-22T14:13:32.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.807+0000 7f4da77fe700 1 --2- 172.21.15.103:0/2927718322 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4da81441f0 0x7f4da8144820 secure :-1 s=THROTTLE_DONE pgs=1243 cs=0 l=1 rx=0x7f4da80613e0 tx=0x7f4d9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:32.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.807+0000 7f4da77fe700 1 --2- 172.21.15.103:0/2927718322 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4da81441f0 0x7f4da8144820 secure :-1 s=THROTTLE_DONE pgs=1243 cs=0 l=1 rx=0x7f4da80613e0 tx=0x7f4d9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:32.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.807+0000 7f4da6ffd700 1 -- 172.21.15.103:0/2927718322 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d9c010780 con 0x7f4da81441f0 2020-04-22T14:13:32.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.807+0000 7f4da6ffd700 1 -- 172.21.15.103:0/2927718322 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d9c010b20 con 0x7f4da81441f0 2020-04-22T14:13:32.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.807+0000 7f4dae426700 1 -- 172.21.15.103:0/2927718322 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4da81441f0 msgr2=0x7f4da8144820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:32.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.807+0000 7f4dae426700 1 --2- 172.21.15.103:0/2927718322 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4da81441f0 0x7f4da8144820 secure :-1 s=READY pgs=1243 cs=0 l=1 rx=0x7f4da80613e0 tx=0x7f4d9c007a40).stop 2020-04-22T14:13:32.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.807+0000 7f4dae426700 1 -- 172.21.15.103:0/2927718322 shutdown_connections 2020-04-22T14:13:32.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.807+0000 7f4dae426700 1 --2- 172.21.15.103:0/2927718322 >> v2:172.21.15.86:3300/0 conn(0x7f4da8144c80 0x7f4da80ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:32.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.807+0000 7f4dae426700 1 --2- 172.21.15.103:0/2927718322 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4da81441f0 0x7f4da8144820 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:32.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.807+0000 7f4dae426700 1 -- 172.21.15.103:0/2927718322 >> 172.21.15.103:0/2927718322 conn(0x7f4da80b9160 msgr2=0x7f4da805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:32.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.807+0000 7f4dae426700 1 -- 172.21.15.103:0/2927718322 shutdown_connections 2020-04-22T14:13:32.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.807+0000 7f4dae426700 1 -- 172.21.15.103:0/2927718322 wait complete. 2020-04-22T14:13:32.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.808+0000 7f4dae426700 1 Processor -- start 2020-04-22T14:13:32.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.808+0000 7f4dae426700 1 -- start start 2020-04-22T14:13:32.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.809+0000 7f4dae426700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4da805b7c0 0x7f4da8147710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:32.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.809+0000 7f4dae426700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4da8147b70 con 0x7f4da81441f0 2020-04-22T14:13:32.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.809+0000 7f4dae426700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4da813ad20 con 0x7f4da8144c80 2020-04-22T14:13:32.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.809+0000 7f4dae426700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4da8147db0 con 0x7f4da805b7c0 2020-04-22T14:13:32.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.809+0000 7f4da7fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4da805b7c0 0x7f4da8147710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:32.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.809+0000 7f4dac9c3700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f4da8144c80 0x7f4da81553c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45954/0 (socket says 172.21.15.103:45954) 2020-04-22T14:13:32.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.809+0000 7f4dac9c3700 1 -- 172.21.15.103:0/1555413976 learned_addr learned my addr 172.21.15.103:0/1555413976 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:32.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.809+0000 7f4da7fff700 1 -- 172.21.15.103:0/1555413976 >> v1:172.21.15.103:6789/0 conn(0x7f4da8144c80 legacy=0x7f4da81553c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:32.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.809+0000 7f4da7fff700 1 -- 172.21.15.103:0/1555413976 >> v1:172.21.15.86:6789/0 conn(0x7f4da81441f0 legacy=0x7f4da813e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:32.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.809+0000 7f4da57fa700 1 -- 172.21.15.103:0/1555413976 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3482417967 0 0) 0x7f4da813ad20 con 0x7f4da8144c80 2020-04-22T14:13:32.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.809+0000 7f4da7fff700 1 -- 172.21.15.103:0/1555413976 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da8154f20 con 0x7f4da805b7c0 2020-04-22T14:13:32.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.810+0000 7f4da7fff700 1 --2- 172.21.15.103:0/1555413976 >> v2:172.21.15.103:3300/0 conn(0x7f4da805b7c0 0x7f4da8147710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4d98001f50 tx=0x7f4d98010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:32.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.810+0000 7f4da7fff700 1 --2- 172.21.15.103:0/1555413976 >> v2:172.21.15.103:3300/0 conn(0x7f4da805b7c0 0x7f4da8147710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4d98001f50 tx=0x7f4d98010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:32.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.810+0000 7f4da7fff700 1 --2- 172.21.15.103:0/1555413976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4da805b7c0 0x7f4da8147710 secure :-1 s=READY pgs=1245 cs=0 l=1 rx=0x7f4d98001f50 tx=0x7f4d98010900).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:32.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.810+0000 7f4da7fff700 1 --2- 172.21.15.103:0/1555413976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4da805b7c0 0x7f4da8147710 secure :-1 s=THROTTLE_DONE pgs=1245 cs=0 l=1 rx=0x7f4d98001f50 tx=0x7f4d98010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:32.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.810+0000 7f4da57fa700 1 -- 172.21.15.103:0/1555413976 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d98006bc0 con 0x7f4da805b7c0 2020-04-22T14:13:32.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.810+0000 7f4da7fff700 1 --2- 172.21.15.103:0/1555413976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4da805b7c0 0x7f4da8147710 secure :-1 s=THROTTLE_DONE pgs=1245 cs=0 l=1 rx=0x7f4d98001f50 tx=0x7f4d98010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:32.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.810+0000 7f4dae426700 1 -- 172.21.15.103:0/1555413976 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da813ecd0 con 0x7f4da805b7c0 2020-04-22T14:13:32.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.810+0000 7f4da57fa700 1 -- 172.21.15.103:0/1555413976 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d98006d60 con 0x7f4da805b7c0 2020-04-22T14:13:32.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.810+0000 7f4da7fff700 1 --2- 172.21.15.103:0/1555413976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4da805b7c0 0x7f4da8147710 secure :-1 s=THROTTLE_DONE pgs=1245 cs=0 l=1 rx=0x7f4d98001f50 tx=0x7f4d98010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:32.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.810+0000 7f4da57fa700 1 -- 172.21.15.103:0/1555413976 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d98008370 con 0x7f4da805b7c0 2020-04-22T14:13:32.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.810+0000 7f4dae426700 1 -- 172.21.15.103:0/1555413976 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da8147210 con 0x7f4da805b7c0 2020-04-22T14:13:32.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.810+0000 7f4da7fff700 1 --2- 172.21.15.103:0/1555413976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4da805b7c0 0x7f4da8147710 secure :-1 s=THROTTLE_DONE pgs=1245 cs=0 l=1 rx=0x7f4d98001f50 tx=0x7f4d98010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:32.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.811+0000 7f4dae426700 1 -- 172.21.15.103:0/1555413976 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4da8056c90 con 0x7f4da805b7c0 2020-04-22T14:13:32.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.811+0000 7f4da57fa700 1 -- 172.21.15.103:0/1555413976 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f4d980085e0 con 0x7f4da805b7c0 2020-04-22T14:13:32.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.811+0000 7f4da7fff700 1 --2- 172.21.15.103:0/1555413976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4da805b7c0 0x7f4da8147710 secure :-1 s=THROTTLE_DONE pgs=1245 cs=0 l=1 rx=0x7f4d98001f50 tx=0x7f4d98010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:32.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.811+0000 7f4da57fa700 1 --2- 172.21.15.103:0/1555413976 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4d8804d860 0x7f4d8804fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:32.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.811+0000 7f4da57fa700 1 -- 172.21.15.103:0/1555413976 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f4d98061530 con 0x7f4da805b7c0 2020-04-22T14:13:32.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.812+0000 7f4da77fe700 1 --2- 172.21.15.103:0/1555413976 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4d8804d860 0x7f4d8804fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:32.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.812+0000 7f4da77fe700 1 --2- 172.21.15.103:0/1555413976 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4d8804d860 0x7f4d8804fd20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4da8141280 tx=0x7f4d9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:32.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.812+0000 7f4da77fe700 1 --2- 172.21.15.103:0/1555413976 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4d8804d860 0x7f4d8804fd20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4da8141280 tx=0x7f4d9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:32.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.812+0000 7f4da77fe700 1 --2- 172.21.15.103:0/1555413976 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4d8804d860 0x7f4d8804fd20 secure :-1 s=READY pgs=460 cs=0 l=1 rx=0x7f4da8141280 tx=0x7f4d9c007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:32.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.816+0000 7f4da7fff700 1 --2- 172.21.15.103:0/1555413976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4da805b7c0 0x7f4da8147710 secure :-1 s=THROTTLE_DONE pgs=1245 cs=0 l=1 rx=0x7f4d98001f50 tx=0x7f4d98010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:32.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:32.816+0000 7f4da57fa700 1 -- 172.21.15.103:0/1555413976 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f4d9803c9d0 con 0x7f4da805b7c0 2020-04-22T14:13:33.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:33.005+0000 7f4dae426700 1 -- 172.21.15.103:0/1555413976 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4da80b4eb0 con 0x7f4da805b7c0 2020-04-22T14:13:33.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:33.005+0000 7f4da7fff700 1 --2- 172.21.15.103:0/1555413976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4da805b7c0 0x7f4da8147710 secure :-1 s=THROTTLE_DONE pgs=1245 cs=0 l=1 rx=0x7f4d98001f50 tx=0x7f4d98010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:33.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:33.005+0000 7f4da57fa700 1 -- 172.21.15.103:0/1555413976 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2147 (secure 0 0 0) 0x7f4d9803fff0 con 0x7f4da805b7c0 2020-04-22T14:13:33.008 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:13:33.008 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:12:43.570838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:13:33.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:33.007+0000 7f4dae426700 1 -- 172.21.15.103:0/1555413976 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4d8804d860 msgr2=0x7f4d8804fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:33.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:33.007+0000 7f4dae426700 1 --2- 172.21.15.103:0/1555413976 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4d8804d860 0x7f4d8804fd20 secure :-1 s=READY pgs=460 cs=0 l=1 rx=0x7f4da8141280 tx=0x7f4d9c007a40).stop 2020-04-22T14:13:33.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:33.007+0000 7f4dae426700 1 -- 172.21.15.103:0/1555413976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4da805b7c0 msgr2=0x7f4da8147710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:33.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:33.007+0000 7f4dae426700 1 --2- 172.21.15.103:0/1555413976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4da805b7c0 0x7f4da8147710 secure :-1 s=READY pgs=1245 cs=0 l=1 rx=0x7f4d98001f50 tx=0x7f4d98010900).stop 2020-04-22T14:13:33.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:33.007+0000 7f4dae426700 1 -- 172.21.15.103:0/1555413976 shutdown_connections 2020-04-22T14:13:33.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:33.007+0000 7f4dae426700 1 --2- 172.21.15.103:0/1555413976 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4d8804d860 0x7f4d8804fd20 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:33.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:33.007+0000 7f4dae426700 1 --2- 172.21.15.103:0/1555413976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4da805b7c0 0x7f4da8147710 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:33.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:33.007+0000 7f4dae426700 1 -- 172.21.15.103:0/1555413976 >> 172.21.15.103:0/1555413976 conn(0x7f4da80b9160 msgr2=0x7f4da805ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:33.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:33.007+0000 7f4dae426700 1 -- 172.21.15.103:0/1555413976 shutdown_connections 2020-04-22T14:13:33.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:33.007+0000 7f4dae426700 1 -- 172.21.15.103:0/1555413976 wait complete. 2020-04-22T14:13:33.011 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 54 2020-04-22T14:13:33.019 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:13:34.020 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:34.037 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:13:34.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.193+0000 7f4f7b59e700 1 Processor -- start 2020-04-22T14:13:34.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.193+0000 7f4f7b59e700 1 -- start start 2020-04-22T14:13:34.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.194+0000 7f4f7b59e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4f7c0620a0 0x7f4f7c0ac740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:34.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.194+0000 7f4f7b59e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f7c144650 0x7f4f7c144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:34.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.194+0000 7f4f7b59e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f7c148270 con 0x7f4f7c066120 2020-04-22T14:13:34.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.194+0000 7f4f7b59e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f7c143f10 con 0x7f4f7c0620a0 2020-04-22T14:13:34.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.194+0000 7f4f7b59e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c1441b0 con 0x7f4f7c144650 2020-04-22T14:13:34.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.194+0000 7f4f7a59c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4f7c0620a0 0x7f4f7c0ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:34.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.194+0000 7f4f7a59c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4f7c0620a0 0x7f4f7c0ac740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53768/0 (socket says 172.21.15.103:53768) 2020-04-22T14:13:34.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.194+0000 7f4f7a59c700 1 -- 172.21.15.103:0/595649548 learned_addr learned my addr 172.21.15.103:0/595649548 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:34.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.194+0000 7f4f79d9b700 1 --2- 172.21.15.103:0/595649548 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f7c144650 0x7f4f7c144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:34.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.194+0000 7f4f7a59c700 1 -- 172.21.15.103:0/595649548 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f7c144650 msgr2=0x7f4f7c144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:34.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.194+0000 7f4f7a59c700 1 --2- 172.21.15.103:0/595649548 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f7c144650 0x7f4f7c144ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:34.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.194+0000 7f4f7a59c700 1 -- 172.21.15.103:0/595649548 >> v1:172.21.15.86:6789/0 conn(0x7f4f7c066120 legacy=0x7f4f7c129a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:34.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.194+0000 7f4f7a59c700 1 -- 172.21.15.103:0/595649548 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f7c062480 con 0x7f4f7c0620a0 2020-04-22T14:13:34.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.194+0000 7f4f79d9b700 1 --2- 172.21.15.103:0/595649548 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f7c144650 0x7f4f7c144ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:13:34.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.194+0000 7f4f7a59c700 1 --2- 172.21.15.103:0/595649548 >> v2:172.21.15.103:3300/0 conn(0x7f4f7c0620a0 0x7f4f7c0ac740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4f74002f30 tx=0x7f4f74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:34.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.194+0000 7f4f7a59c700 1 --2- 172.21.15.103:0/595649548 >> v2:172.21.15.103:3300/0 conn(0x7f4f7c0620a0 0x7f4f7c0ac740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4f74002f30 tx=0x7f4f74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:34.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.194+0000 7f4f7a59c700 1 --2- 172.21.15.103:0/595649548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f7c0620a0 0x7f4f7c0ac740 secure :-1 s=READY pgs=1246 cs=0 l=1 rx=0x7f4f74002f30 tx=0x7f4f74007a40).ready entity=mon.1 client_cookie=e3962a4ba11097e8 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:34.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.194+0000 7f4f7a59c700 1 --2- 172.21.15.103:0/595649548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f7c0620a0 0x7f4f7c0ac740 secure :-1 s=THROTTLE_DONE pgs=1246 cs=0 l=1 rx=0x7f4f74002f30 tx=0x7f4f74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:34.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.194+0000 7f4f7959a700 1 -- 172.21.15.103:0/595649548 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f74011720 con 0x7f4f7c0620a0 2020-04-22T14:13:34.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.194+0000 7f4f7a59c700 1 --2- 172.21.15.103:0/595649548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f7c0620a0 0x7f4f7c0ac740 secure :-1 s=THROTTLE_DONE pgs=1246 cs=0 l=1 rx=0x7f4f74002f30 tx=0x7f4f74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:34.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.194+0000 7f4f7959a700 1 -- 172.21.15.103:0/595649548 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f740118c0 con 0x7f4f7c0620a0 2020-04-22T14:13:34.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.194+0000 7f4f7a59c700 1 --2- 172.21.15.103:0/595649548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f7c0620a0 0x7f4f7c0ac740 secure :-1 s=THROTTLE_DONE pgs=1246 cs=0 l=1 rx=0x7f4f74002f30 tx=0x7f4f74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:34.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.194+0000 7f4f7959a700 1 -- 172.21.15.103:0/595649548 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f74011ce0 con 0x7f4f7c0620a0 2020-04-22T14:13:34.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.194+0000 7f4f7b59e700 1 -- 172.21.15.103:0/595649548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f7c0620a0 msgr2=0x7f4f7c0ac740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:34.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.195+0000 7f4f7b59e700 1 --2- 172.21.15.103:0/595649548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f7c0620a0 0x7f4f7c0ac740 secure :-1 s=READY pgs=1246 cs=0 l=1 rx=0x7f4f74002f30 tx=0x7f4f74007a40).stop 2020-04-22T14:13:34.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.195+0000 7f4f7b59e700 1 -- 172.21.15.103:0/595649548 shutdown_connections 2020-04-22T14:13:34.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.195+0000 7f4f7b59e700 1 --2- 172.21.15.103:0/595649548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f7c0620a0 0x7f4f7c0ac740 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:34.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.195+0000 7f4f7b59e700 1 --2- 172.21.15.103:0/595649548 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f7c144650 0x7f4f7c144ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:34.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.195+0000 7f4f7b59e700 1 -- 172.21.15.103:0/595649548 >> 172.21.15.103:0/595649548 conn(0x7f4f7c05b7c0 msgr2=0x7f4f7c061610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:34.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.195+0000 7f4f7b59e700 1 -- 172.21.15.103:0/595649548 shutdown_connections 2020-04-22T14:13:34.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.195+0000 7f4f7b59e700 1 -- 172.21.15.103:0/595649548 wait complete. 2020-04-22T14:13:34.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.196+0000 7f4f7b59e700 1 Processor -- start 2020-04-22T14:13:34.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.196+0000 7f4f7b59e700 1 -- start start 2020-04-22T14:13:34.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.197+0000 7f4f7b59e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4f7c0620a0 0x7f4f7c12bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:34.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.197+0000 7f4f7b59e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f7c144650 0x7f4f7c156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:34.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.197+0000 7f4f7b59e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f7c0659d0 con 0x7f4f7c066120 2020-04-22T14:13:34.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.197+0000 7f4f7b59e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f7c157490 con 0x7f4f7c0620a0 2020-04-22T14:13:34.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.197+0000 7f4f7b59e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c157730 con 0x7f4f7c144650 2020-04-22T14:13:34.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.197+0000 7f4f79d9b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f4f7c066120 0x7f4f7c143280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45966/0 (socket says 172.21.15.103:45966) 2020-04-22T14:13:34.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.197+0000 7f4f79d9b700 1 -- 172.21.15.103:0/162806512 learned_addr learned my addr 172.21.15.103:0/162806512 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:34.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.197+0000 7f4f7a59c700 1 --2- 172.21.15.103:0/162806512 >> v2:172.21.15.86:3300/0 conn(0x7f4f7c0620a0 0x7f4f7c12bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:34.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.197+0000 7f4f7ad9d700 1 --2- 172.21.15.103:0/162806512 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f7c144650 0x7f4f7c156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:34.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.197+0000 7f4f6b7fe700 1 -- 172.21.15.103:0/162806512 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 800111403 0 0) 0x7f4f7c0659d0 con 0x7f4f7c066120 2020-04-22T14:13:34.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.197+0000 7f4f6b7fe700 1 -- 172.21.15.103:0/162806512 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f58002fe0 con 0x7f4f7c066120 2020-04-22T14:13:34.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.197+0000 7f4f6b7fe700 1 -- 172.21.15.103:0/162806512 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1046018766 0 0) 0x7f4f58002fe0 con 0x7f4f7c066120 2020-04-22T14:13:34.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.197+0000 7f4f7a59c700 1 -- 172.21.15.103:0/162806512 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f7c144650 msgr2=0x7f4f7c156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:34.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.197+0000 7f4f7a59c700 1 --2- 172.21.15.103:0/162806512 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f7c144650 0x7f4f7c156f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:34.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.197+0000 7f4f7a59c700 1 -- 172.21.15.103:0/162806512 >> v1:172.21.15.103:6789/0 conn(0x7f4f7c066120 legacy=0x7f4f7c143280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:34.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.197+0000 7f4f7a59c700 1 -- 172.21.15.103:0/162806512 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f7c1579d0 con 0x7f4f7c0620a0 2020-04-22T14:13:34.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.197+0000 7f4f7ad9d700 1 --2- 172.21.15.103:0/162806512 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f7c144650 0x7f4f7c156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:13:34.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.197+0000 7f4f7a59c700 1 --2- 172.21.15.103:0/162806512 >> v2:172.21.15.86:3300/0 conn(0x7f4f7c0620a0 0x7f4f7c12bfd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4f7c0b6080 tx=0x7f4f74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:34.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.197+0000 7f4f7a59c700 1 --2- 172.21.15.103:0/162806512 >> v2:172.21.15.86:3300/0 conn(0x7f4f7c0620a0 0x7f4f7c12bfd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4f7c0b6080 tx=0x7f4f74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:34.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.197+0000 7f4f7a59c700 1 --2- 172.21.15.103:0/162806512 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f7c0620a0 0x7f4f7c12bfd0 secure :-1 s=READY pgs=682 cs=0 l=1 rx=0x7f4f7c0b6080 tx=0x7f4f74007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:34.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.198+0000 7f4f7a59c700 1 --2- 172.21.15.103:0/162806512 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f7c0620a0 0x7f4f7c12bfd0 secure :-1 s=THROTTLE_DONE pgs=682 cs=0 l=1 rx=0x7f4f7c0b6080 tx=0x7f4f74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:34.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.198+0000 7f4f6b7fe700 1 -- 172.21.15.103:0/162806512 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f70002880 con 0x7f4f7c0620a0 2020-04-22T14:13:34.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.198+0000 7f4f7a59c700 1 --2- 172.21.15.103:0/162806512 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f7c0620a0 0x7f4f7c12bfd0 secure :-1 s=THROTTLE_DONE pgs=682 cs=0 l=1 rx=0x7f4f7c0b6080 tx=0x7f4f74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:34.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.198+0000 7f4f7a59c700 1 --2- 172.21.15.103:0/162806512 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f7c0620a0 0x7f4f7c12bfd0 secure :-1 s=THROTTLE_DONE pgs=682 cs=0 l=1 rx=0x7f4f7c0b6080 tx=0x7f4f74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:34.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.198+0000 7f4f6b7fe700 1 -- 172.21.15.103:0/162806512 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f74011b70 con 0x7f4f7c0620a0 2020-04-22T14:13:34.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.198+0000 7f4f7b59e700 1 -- 172.21.15.103:0/162806512 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f7c143990 con 0x7f4f7c0620a0 2020-04-22T14:13:34.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.198+0000 7f4f6b7fe700 1 -- 172.21.15.103:0/162806512 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f74007170 con 0x7f4f7c0620a0 2020-04-22T14:13:34.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.198+0000 7f4f7b59e700 1 -- 172.21.15.103:0/162806512 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f7c0b4230 con 0x7f4f7c0620a0 2020-04-22T14:13:34.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.198+0000 7f4f7a59c700 1 --2- 172.21.15.103:0/162806512 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f7c0620a0 0x7f4f7c12bfd0 secure :-1 s=THROTTLE_DONE pgs=682 cs=0 l=1 rx=0x7f4f7c0b6080 tx=0x7f4f74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:34.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.199+0000 7f4f7b59e700 1 -- 172.21.15.103:0/162806512 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f7c056c90 con 0x7f4f7c0620a0 2020-04-22T14:13:34.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.199+0000 7f4f6b7fe700 1 -- 172.21.15.103:0/162806512 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f4f74007320 con 0x7f4f7c0620a0 2020-04-22T14:13:34.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.199+0000 7f4f7a59c700 1 --2- 172.21.15.103:0/162806512 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f7c0620a0 0x7f4f7c12bfd0 secure :-1 s=THROTTLE_DONE pgs=682 cs=0 l=1 rx=0x7f4f7c0b6080 tx=0x7f4f74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:34.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.199+0000 7f4f6b7fe700 1 --2- 172.21.15.103:0/162806512 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4f5804dc70 0x7f4f58050130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:34.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.199+0000 7f4f6b7fe700 1 -- 172.21.15.103:0/162806512 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f4f74061550 con 0x7f4f7c0620a0 2020-04-22T14:13:34.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.199+0000 7f4f79d9b700 1 --2- 172.21.15.103:0/162806512 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4f5804dc70 0x7f4f58050130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:34.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.199+0000 7f4f79d9b700 1 --2- 172.21.15.103:0/162806512 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4f5804dc70 0x7f4f58050130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4f70002a60 tx=0x7f4f7000d4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:34.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.200+0000 7f4f79d9b700 1 --2- 172.21.15.103:0/162806512 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4f5804dc70 0x7f4f58050130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4f70002a60 tx=0x7f4f7000d4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:34.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.200+0000 7f4f79d9b700 1 --2- 172.21.15.103:0/162806512 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4f5804dc70 0x7f4f58050130 secure :-1 s=READY pgs=461 cs=0 l=1 rx=0x7f4f70002a60 tx=0x7f4f7000d4e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:34.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.203+0000 7f4f7a59c700 1 --2- 172.21.15.103:0/162806512 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f7c0620a0 0x7f4f7c12bfd0 secure :-1 s=THROTTLE_DONE pgs=682 cs=0 l=1 rx=0x7f4f7c0b6080 tx=0x7f4f74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:34.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.203+0000 7f4f6b7fe700 1 -- 172.21.15.103:0/162806512 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f4f7403c990 con 0x7f4f7c0620a0 2020-04-22T14:13:34.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.397+0000 7f4f7b59e700 1 -- 172.21.15.103:0/162806512 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4f7c0ac7f0 con 0x7f4f7c0620a0 2020-04-22T14:13:34.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.397+0000 7f4f7a59c700 1 --2- 172.21.15.103:0/162806512 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f7c0620a0 0x7f4f7c12bfd0 secure :-1 s=THROTTLE_DONE pgs=682 cs=0 l=1 rx=0x7f4f7c0b6080 tx=0x7f4f74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:34.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.397+0000 7f4f6b7fe700 1 -- 172.21.15.103:0/162806512 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+2145 (secure 0 0 0) 0x7f4f7403ffb0 con 0x7f4f7c0620a0 2020-04-22T14:13:34.400 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:13:34.400 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":55,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:13:33.465555+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:rejoin","state_seq":15,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:13:34.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.399+0000 7f4f7b59e700 1 -- 172.21.15.103:0/162806512 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4f5804dc70 msgr2=0x7f4f58050130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:34.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.399+0000 7f4f7b59e700 1 --2- 172.21.15.103:0/162806512 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4f5804dc70 0x7f4f58050130 secure :-1 s=READY pgs=461 cs=0 l=1 rx=0x7f4f70002a60 tx=0x7f4f7000d4e0).stop 2020-04-22T14:13:34.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.399+0000 7f4f7b59e700 1 -- 172.21.15.103:0/162806512 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f7c0620a0 msgr2=0x7f4f7c12bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:34.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.399+0000 7f4f7b59e700 1 --2- 172.21.15.103:0/162806512 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f7c0620a0 0x7f4f7c12bfd0 secure :-1 s=READY pgs=682 cs=0 l=1 rx=0x7f4f7c0b6080 tx=0x7f4f74007a40).stop 2020-04-22T14:13:34.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.399+0000 7f4f7b59e700 1 -- 172.21.15.103:0/162806512 shutdown_connections 2020-04-22T14:13:34.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.399+0000 7f4f7b59e700 1 --2- 172.21.15.103:0/162806512 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f7c144650 0x7f4f7c156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:34.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.399+0000 7f4f7b59e700 1 --2- 172.21.15.103:0/162806512 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4f5804dc70 0x7f4f58050130 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:34.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.399+0000 7f4f7b59e700 1 --2- 172.21.15.103:0/162806512 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f7c0620a0 0x7f4f7c12bfd0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:34.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.399+0000 7f4f7b59e700 1 -- 172.21.15.103:0/162806512 >> 172.21.15.103:0/162806512 conn(0x7f4f7c05b7c0 msgr2=0x7f4f7c12cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:34.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.399+0000 7f4f7b59e700 1 -- 172.21.15.103:0/162806512 shutdown_connections 2020-04-22T14:13:34.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:34.399+0000 7f4f7b59e700 1 -- 172.21.15.103:0/162806512 wait complete. 2020-04-22T14:13:34.404 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 55 2020-04-22T14:13:34.411 INFO:tasks.cephfs.filesystem:mapped states [u'up:rejoin'] to None 2020-04-22T14:13:35.412 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:35.429 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:13:35.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.585+0000 7f0933f59700 1 Processor -- start 2020-04-22T14:13:35.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.585+0000 7f0933f59700 1 -- start start 2020-04-22T14:13:35.590 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.586+0000 7f0933f59700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f092c12c0d0 0x7f092c1464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:35.590 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.586+0000 7f0933f59700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f092c143300 con 0x7f092c063e30 2020-04-22T14:13:35.591 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.586+0000 7f0933f59700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f092c1435a0 con 0x7f092c065fe0 2020-04-22T14:13:35.591 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.586+0000 7f0933f59700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f092c143840 con 0x7f092c12c0d0 2020-04-22T14:13:35.591 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.586+0000 7f0931cf5700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f092c12c0d0 0x7f092c1464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:35.591 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.586+0000 7f09314f4700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f092c065fe0 0x7f092c05b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45976/0 (socket says 172.21.15.103:45976) 2020-04-22T14:13:35.591 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.586+0000 7f09314f4700 1 -- 172.21.15.103:0/4031177317 learned_addr learned my addr 172.21.15.103:0/4031177317 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:35.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.586+0000 7f0931cf5700 1 -- 172.21.15.103:0/4031177317 >> v1:172.21.15.103:6789/0 conn(0x7f092c065fe0 legacy=0x7f092c05b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:35.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.586+0000 7f0931cf5700 1 -- 172.21.15.103:0/4031177317 >> v1:172.21.15.86:6789/0 conn(0x7f092c063e30 legacy=0x7f092c0642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:35.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.586+0000 7f0931cf5700 1 -- 172.21.15.103:0/4031177317 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f092c05bb50 con 0x7f092c12c0d0 2020-04-22T14:13:35.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.586+0000 7f0931cf5700 1 --2- 172.21.15.103:0/4031177317 >> v2:172.21.15.103:3300/0 conn(0x7f092c12c0d0 0x7f092c1464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f092c0669a0 tx=0x7f0928007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:35.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.586+0000 7f0931cf5700 1 --2- 172.21.15.103:0/4031177317 >> v2:172.21.15.103:3300/0 conn(0x7f092c12c0d0 0x7f092c1464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f092c0669a0 tx=0x7f0928007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:35.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.586+0000 7f0931cf5700 1 --2- 172.21.15.103:0/4031177317 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f092c12c0d0 0x7f092c1464e0 secure :-1 s=READY pgs=1249 cs=0 l=1 rx=0x7f092c0669a0 tx=0x7f0928007a40).ready entity=mon.1 client_cookie=aa05537f5f471cf2 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:35.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.587+0000 7f0931cf5700 1 --2- 172.21.15.103:0/4031177317 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f092c12c0d0 0x7f092c1464e0 secure :-1 s=THROTTLE_DONE pgs=1249 cs=0 l=1 rx=0x7f092c0669a0 tx=0x7f0928007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:35.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.587+0000 7f0930cf3700 1 -- 172.21.15.103:0/4031177317 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0928011430 con 0x7f092c12c0d0 2020-04-22T14:13:35.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.587+0000 7f0931cf5700 1 --2- 172.21.15.103:0/4031177317 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f092c12c0d0 0x7f092c1464e0 secure :-1 s=THROTTLE_DONE pgs=1249 cs=0 l=1 rx=0x7f092c0669a0 tx=0x7f0928007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:35.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.587+0000 7f0931cf5700 1 --2- 172.21.15.103:0/4031177317 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f092c12c0d0 0x7f092c1464e0 secure :-1 s=THROTTLE_DONE pgs=1249 cs=0 l=1 rx=0x7f092c0669a0 tx=0x7f0928007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:35.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.587+0000 7f0930cf3700 1 -- 172.21.15.103:0/4031177317 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0928011590 con 0x7f092c12c0d0 2020-04-22T14:13:35.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.587+0000 7f0930cf3700 1 -- 172.21.15.103:0/4031177317 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09280119b0 con 0x7f092c12c0d0 2020-04-22T14:13:35.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.587+0000 7f0933f59700 1 -- 172.21.15.103:0/4031177317 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f092c12c0d0 msgr2=0x7f092c1464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:35.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.587+0000 7f0933f59700 1 --2- 172.21.15.103:0/4031177317 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f092c12c0d0 0x7f092c1464e0 secure :-1 s=READY pgs=1249 cs=0 l=1 rx=0x7f092c0669a0 tx=0x7f0928007a40).stop 2020-04-22T14:13:35.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.587+0000 7f0933f59700 1 -- 172.21.15.103:0/4031177317 shutdown_connections 2020-04-22T14:13:35.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.587+0000 7f0933f59700 1 --2- 172.21.15.103:0/4031177317 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f092c12c0d0 0x7f092c1464e0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:35.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.587+0000 7f0933f59700 1 -- 172.21.15.103:0/4031177317 >> 172.21.15.103:0/4031177317 conn(0x7f092c0b9160 msgr2=0x7f092c05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:35.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.587+0000 7f0933f59700 1 -- 172.21.15.103:0/4031177317 shutdown_connections 2020-04-22T14:13:35.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.587+0000 7f0933f59700 1 -- 172.21.15.103:0/4031177317 wait complete. 2020-04-22T14:13:35.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.588+0000 7f0933f59700 1 Processor -- start 2020-04-22T14:13:35.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.588+0000 7f0933f59700 1 -- start start 2020-04-22T14:13:35.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.589+0000 7f0933f59700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f092c063e30 0x7f092c12ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:35.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.589+0000 7f0933f59700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f092c0b42a0 con 0x7f092c12c0d0 2020-04-22T14:13:35.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.589+0000 7f0933f59700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f092c0b4540 con 0x7f092c065fe0 2020-04-22T14:13:35.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.589+0000 7f0933f59700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f092c12c910 con 0x7f092c063e30 2020-04-22T14:13:35.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.589+0000 7f0931cf5700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f092c063e30 0x7f092c12ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:35.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.589+0000 7f09314f4700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f092c065fe0 0x7f092c126f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45980/0 (socket says 172.21.15.103:45980) 2020-04-22T14:13:35.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.589+0000 7f09314f4700 1 -- 172.21.15.103:0/2368706171 learned_addr learned my addr 172.21.15.103:0/2368706171 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:35.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.589+0000 7f0931cf5700 1 -- 172.21.15.103:0/2368706171 >> v1:172.21.15.103:6789/0 conn(0x7f092c065fe0 legacy=0x7f092c126f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:35.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.589+0000 7f091effd700 1 -- 172.21.15.103:0/2368706171 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 588668809 0 0) 0x7f092c0b4540 con 0x7f092c065fe0 2020-04-22T14:13:35.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.589+0000 7f0931cf5700 1 -- 172.21.15.103:0/2368706171 >> v1:172.21.15.86:6789/0 conn(0x7f092c12c0d0 legacy=0x7f092c128d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:35.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.589+0000 7f0931cf5700 1 -- 172.21.15.103:0/2368706171 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f092c12ca50 con 0x7f092c063e30 2020-04-22T14:13:35.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.589+0000 7f0931cf5700 1 --2- 172.21.15.103:0/2368706171 >> v2:172.21.15.103:3300/0 conn(0x7f092c063e30 0x7f092c12ab70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f092c0b5f90 tx=0x7f0928007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:35.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.589+0000 7f0931cf5700 1 --2- 172.21.15.103:0/2368706171 >> v2:172.21.15.103:3300/0 conn(0x7f092c063e30 0x7f092c12ab70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f092c0b5f90 tx=0x7f0928007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:35.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.589+0000 7f0931cf5700 1 --2- 172.21.15.103:0/2368706171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f092c063e30 0x7f092c12ab70 secure :-1 s=READY pgs=1251 cs=0 l=1 rx=0x7f092c0b5f90 tx=0x7f0928007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:35.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.590+0000 7f0931cf5700 1 --2- 172.21.15.103:0/2368706171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f092c063e30 0x7f092c12ab70 secure :-1 s=THROTTLE_DONE pgs=1251 cs=0 l=1 rx=0x7f092c0b5f90 tx=0x7f0928007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:35.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.590+0000 7f091effd700 1 -- 172.21.15.103:0/2368706171 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0928007170 con 0x7f092c063e30 2020-04-22T14:13:35.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.590+0000 7f0931cf5700 1 --2- 172.21.15.103:0/2368706171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f092c063e30 0x7f092c12ab70 secure :-1 s=THROTTLE_DONE pgs=1251 cs=0 l=1 rx=0x7f092c0b5f90 tx=0x7f0928007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:35.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.590+0000 7f0931cf5700 1 --2- 172.21.15.103:0/2368706171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f092c063e30 0x7f092c12ab70 secure :-1 s=THROTTLE_DONE pgs=1251 cs=0 l=1 rx=0x7f092c0b5f90 tx=0x7f0928007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:35.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.590+0000 7f091effd700 1 -- 172.21.15.103:0/2368706171 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09280072d0 con 0x7f092c063e30 2020-04-22T14:13:35.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.590+0000 7f0933f59700 1 -- 172.21.15.103:0/2368706171 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f092c153f30 con 0x7f092c063e30 2020-04-22T14:13:35.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.590+0000 7f091effd700 1 -- 172.21.15.103:0/2368706171 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09280056c0 con 0x7f092c063e30 2020-04-22T14:13:35.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.590+0000 7f0933f59700 1 -- 172.21.15.103:0/2368706171 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f092c0b3da0 con 0x7f092c063e30 2020-04-22T14:13:35.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.590+0000 7f0931cf5700 1 --2- 172.21.15.103:0/2368706171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f092c063e30 0x7f092c12ab70 secure :-1 s=THROTTLE_DONE pgs=1251 cs=0 l=1 rx=0x7f092c0b5f90 tx=0x7f0928007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:35.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.591+0000 7f091effd700 1 -- 172.21.15.103:0/2368706171 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f0928005870 con 0x7f092c063e30 2020-04-22T14:13:35.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.591+0000 7f0931cf5700 1 --2- 172.21.15.103:0/2368706171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f092c063e30 0x7f092c12ab70 secure :-1 s=THROTTLE_DONE pgs=1251 cs=0 l=1 rx=0x7f092c0b5f90 tx=0x7f0928007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:35.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.591+0000 7f0933f59700 1 -- 172.21.15.103:0/2368706171 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f092c056c90 con 0x7f092c063e30 2020-04-22T14:13:35.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.591+0000 7f091effd700 1 --2- 172.21.15.103:0/2368706171 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f090c04d900 0x7f090c04fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:35.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.591+0000 7f091effd700 1 -- 172.21.15.103:0/2368706171 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f0928061c70 con 0x7f092c063e30 2020-04-22T14:13:35.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.591+0000 7f09314f4700 1 --2- 172.21.15.103:0/2368706171 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f090c04d900 0x7f090c04fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:35.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.591+0000 7f09314f4700 1 --2- 172.21.15.103:0/2368706171 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f090c04d900 0x7f090c04fdc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0920005500 tx=0x7f0920001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:35.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.592+0000 7f09314f4700 1 --2- 172.21.15.103:0/2368706171 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f090c04d900 0x7f090c04fdc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0920005500 tx=0x7f0920001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:35.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.592+0000 7f09314f4700 1 --2- 172.21.15.103:0/2368706171 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f090c04d900 0x7f090c04fdc0 secure :-1 s=READY pgs=462 cs=0 l=1 rx=0x7f0920005500 tx=0x7f0920001710).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:35.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.595+0000 7f0931cf5700 1 --2- 172.21.15.103:0/2368706171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f092c063e30 0x7f092c12ab70 secure :-1 s=THROTTLE_DONE pgs=1251 cs=0 l=1 rx=0x7f092c0b5f90 tx=0x7f0928007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:35.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.595+0000 7f091effd700 1 -- 172.21.15.103:0/2368706171 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f092803d0b0 con 0x7f092c063e30 2020-04-22T14:13:35.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.782+0000 7f0933f59700 1 -- 172.21.15.103:0/2368706171 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f092c147360 con 0x7f092c063e30 2020-04-22T14:13:35.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.783+0000 7f0931cf5700 1 --2- 172.21.15.103:0/2368706171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f092c063e30 0x7f092c12ab70 secure :-1 s=THROTTLE_DONE pgs=1251 cs=0 l=1 rx=0x7f092c0b5f90 tx=0x7f0928007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:35.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.783+0000 7f091effd700 1 -- 172.21.15.103:0/2368706171 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+2145 (secure 0 0 0) 0x7f09280406d0 con 0x7f092c063e30 2020-04-22T14:13:35.786 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:13:35.786 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":56,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:13:34.470492+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":16,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:13:35.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.784+0000 7f0933f59700 1 -- 172.21.15.103:0/2368706171 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f090c04d900 msgr2=0x7f090c04fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:35.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.784+0000 7f0933f59700 1 --2- 172.21.15.103:0/2368706171 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f090c04d900 0x7f090c04fdc0 secure :-1 s=READY pgs=462 cs=0 l=1 rx=0x7f0920005500 tx=0x7f0920001710).stop 2020-04-22T14:13:35.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.784+0000 7f0933f59700 1 -- 172.21.15.103:0/2368706171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f092c063e30 msgr2=0x7f092c12ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:35.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.784+0000 7f0933f59700 1 --2- 172.21.15.103:0/2368706171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f092c063e30 0x7f092c12ab70 secure :-1 s=READY pgs=1251 cs=0 l=1 rx=0x7f092c0b5f90 tx=0x7f0928007a40).stop 2020-04-22T14:13:35.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.784+0000 7f0933f59700 1 -- 172.21.15.103:0/2368706171 shutdown_connections 2020-04-22T14:13:35.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.784+0000 7f0933f59700 1 --2- 172.21.15.103:0/2368706171 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f090c04d900 0x7f090c04fdc0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:35.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.784+0000 7f0933f59700 1 --2- 172.21.15.103:0/2368706171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f092c063e30 0x7f092c12ab70 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:35.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.784+0000 7f0933f59700 1 -- 172.21.15.103:0/2368706171 >> 172.21.15.103:0/2368706171 conn(0x7f092c0b9160 msgr2=0x7f092c061540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:35.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.784+0000 7f0933f59700 1 -- 172.21.15.103:0/2368706171 shutdown_connections 2020-04-22T14:13:35.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.784+0000 7f0933f59700 1 -- 172.21.15.103:0/2368706171 wait complete. 2020-04-22T14:13:35.789 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 56 2020-04-22T14:13:35.797 INFO:tasks.cephfs.filesystem:mapped states [u'up:active'] to up:active 2020-04-22T14:13:35.797 INFO:tasks.cephfs.filesystem:reached state 'up:active' in 51.7607069016s 2020-04-22T14:13:35.797 INFO:tasks.cephfs.test_client_recovery:Reached active... 2020-04-22T14:13:35.797 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:35.811 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:13:35.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.954+0000 7f730b736700 1 Processor -- start 2020-04-22T14:13:35.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.954+0000 7f730b736700 1 -- start start 2020-04-22T14:13:35.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.955+0000 7f730b736700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f73041464e0 0x7f7304064540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:35.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.955+0000 7f730b736700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7304143300 con 0x7f730412c0d0 2020-04-22T14:13:35.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.955+0000 7f730b736700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73041435a0 con 0x7f7304065fe0 2020-04-22T14:13:35.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.955+0000 7f730b736700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7304143840 con 0x7f73041464e0 2020-04-22T14:13:35.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.955+0000 7f7308cd1700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f7304065fe0 0x7f7304063e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45986/0 (socket says 172.21.15.103:45986) 2020-04-22T14:13:35.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.955+0000 7f7308cd1700 1 -- 172.21.15.103:0/4071807874 learned_addr learned my addr 172.21.15.103:0/4071807874 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:35.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.955+0000 7f7309cd3700 1 --2- 172.21.15.103:0/4071807874 >> v2:172.21.15.86:3300/0 conn(0x7f73041464e0 0x7f7304064540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:35.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.956+0000 7f72f7fff700 1 -- 172.21.15.103:0/4071807874 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 104919959 0 0) 0x7f73041435a0 con 0x7f7304065fe0 2020-04-22T14:13:35.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.956+0000 7f72f7fff700 1 -- 172.21.15.103:0/4071807874 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72ec003230 con 0x7f7304065fe0 2020-04-22T14:13:35.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.956+0000 7f72f7fff700 1 -- 172.21.15.103:0/4071807874 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 539926605 0 0) 0x7f72ec003230 con 0x7f7304065fe0 2020-04-22T14:13:35.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.956+0000 7f72f7fff700 1 -- 172.21.15.103:0/4071807874 >> v2:172.21.15.86:3300/0 conn(0x7f73041464e0 msgr2=0x7f7304064540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:35.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.956+0000 7f72f7fff700 1 --2- 172.21.15.103:0/4071807874 >> v2:172.21.15.86:3300/0 conn(0x7f73041464e0 0x7f7304064540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:35.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.956+0000 7f72f7fff700 1 -- 172.21.15.103:0/4071807874 >> v1:172.21.15.86:6789/0 conn(0x7f730412c0d0 legacy=0x7f730405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:35.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.956+0000 7f72f7fff700 1 -- 172.21.15.103:0/4071807874 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f730405bb50 con 0x7f7304065fe0 2020-04-22T14:13:35.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.956+0000 7f72f7fff700 1 -- 172.21.15.103:0/4071807874 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f73000016d0 con 0x7f7304065fe0 2020-04-22T14:13:35.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.956+0000 7f72f7fff700 1 -- 172.21.15.103:0/4071807874 >> v1:172.21.15.103:6789/0 conn(0x7f7304065fe0 legacy=0x7f7304063e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:35.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.956+0000 7f72f7fff700 1 --2- 172.21.15.103:0/4071807874 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72ec003720 0x7f72ec003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:35.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.956+0000 7f72f7fff700 1 --2- 172.21.15.103:0/4071807874 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f72ec0044d0 0x7f72ec004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:35.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.956+0000 7f72f7fff700 1 --2- 172.21.15.103:0/4071807874 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f72ec004db0 0x7f72ec00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:35.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.956+0000 7f72f7fff700 1 -- 172.21.15.103:0/4071807874 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7304143840 con 0x7f72ec004db0 2020-04-22T14:13:35.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.956+0000 7f72f7fff700 1 -- 172.21.15.103:0/4071807874 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec0041f0 con 0x7f72ec003720 2020-04-22T14:13:35.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.956+0000 7f72f7fff700 1 -- 172.21.15.103:0/4071807874 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec00bb80 con 0x7f72ec0044d0 2020-04-22T14:13:35.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.956+0000 7f73094d2700 1 --2- 172.21.15.103:0/4071807874 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72ec003720 0x7f72ec003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:35.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.956+0000 7f7308cd1700 1 --2- 172.21.15.103:0/4071807874 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f72ec0044d0 0x7f72ec004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:35.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.956+0000 7f7309cd3700 1 --2- 172.21.15.103:0/4071807874 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f72ec004db0 0x7f72ec00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:35.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.956+0000 7f73094d2700 1 -- 172.21.15.103:0/4071807874 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f72ec0044d0 msgr2=0x7f72ec004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:35.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.956+0000 7f73094d2700 1 --2- 172.21.15.103:0/4071807874 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f72ec0044d0 0x7f72ec004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:35.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.956+0000 7f73094d2700 1 -- 172.21.15.103:0/4071807874 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f72ec004db0 msgr2=0x7f72ec00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:35.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.956+0000 7f73094d2700 1 --2- 172.21.15.103:0/4071807874 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f72ec004db0 0x7f72ec00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:35.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.956+0000 7f73094d2700 1 -- 172.21.15.103:0/4071807874 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ec003230 con 0x7f72ec003720 2020-04-22T14:13:35.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.956+0000 7f7309cd3700 1 --2- 172.21.15.103:0/4071807874 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f72ec004db0 0x7f72ec00b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:13:35.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.956+0000 7f7309cd3700 1 -- 172.21.15.103:0/4071807874 reap_dead start 2020-04-22T14:13:35.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.956+0000 7f73094d2700 1 --2- 172.21.15.103:0/4071807874 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72ec003720 0x7f72ec003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f72ec0054a0 tx=0x7f72f800fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:35.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.956+0000 7f73094d2700 1 --2- 172.21.15.103:0/4071807874 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72ec003720 0x7f72ec003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f72ec0054a0 tx=0x7f72f800fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:35.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.956+0000 7f73094d2700 1 --2- 172.21.15.103:0/4071807874 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72ec003720 0x7f72ec003b40 secure :-1 s=READY pgs=1253 cs=0 l=1 rx=0x7f72ec0054a0 tx=0x7f72f800fd20).ready entity=mon.1 client_cookie=241389aaed18b316 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:35.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.956+0000 7f73094d2700 1 --2- 172.21.15.103:0/4071807874 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72ec003720 0x7f72ec003b40 secure :-1 s=THROTTLE_DONE pgs=1253 cs=0 l=1 rx=0x7f72ec0054a0 tx=0x7f72f800fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:35.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.956+0000 7f72f7fff700 1 -- 172.21.15.103:0/4071807874 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72f8003560 con 0x7f72ec003720 2020-04-22T14:13:35.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.957+0000 7f73094d2700 1 --2- 172.21.15.103:0/4071807874 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72ec003720 0x7f72ec003b40 secure :-1 s=THROTTLE_DONE pgs=1253 cs=0 l=1 rx=0x7f72ec0054a0 tx=0x7f72f800fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:35.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.957+0000 7f72f7fff700 1 -- 172.21.15.103:0/4071807874 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f80036c0 con 0x7f72ec003720 2020-04-22T14:13:35.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.957+0000 7f73094d2700 1 --2- 172.21.15.103:0/4071807874 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72ec003720 0x7f72ec003b40 secure :-1 s=THROTTLE_DONE pgs=1253 cs=0 l=1 rx=0x7f72ec0054a0 tx=0x7f72f800fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:35.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.957+0000 7f72f7fff700 1 -- 172.21.15.103:0/4071807874 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72f8003a60 con 0x7f72ec003720 2020-04-22T14:13:35.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.957+0000 7f730b736700 1 -- 172.21.15.103:0/4071807874 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72ec003720 msgr2=0x7f72ec003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:35.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.957+0000 7f730b736700 1 --2- 172.21.15.103:0/4071807874 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72ec003720 0x7f72ec003b40 secure :-1 s=READY pgs=1253 cs=0 l=1 rx=0x7f72ec0054a0 tx=0x7f72f800fd20).stop 2020-04-22T14:13:35.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.957+0000 7f730b736700 1 -- 172.21.15.103:0/4071807874 shutdown_connections 2020-04-22T14:13:35.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.957+0000 7f730b736700 1 --2- 172.21.15.103:0/4071807874 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72ec003720 0x7f72ec003b40 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:35.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.957+0000 7f730b736700 1 -- 172.21.15.103:0/4071807874 >> 172.21.15.103:0/4071807874 conn(0x7f73040b9160 msgr2=0x7f730405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:35.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.957+0000 7f730b736700 1 -- 172.21.15.103:0/4071807874 shutdown_connections 2020-04-22T14:13:35.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.957+0000 7f730b736700 1 -- 172.21.15.103:0/4071807874 wait complete. 2020-04-22T14:13:35.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.958+0000 7f730b736700 1 Processor -- start 2020-04-22T14:13:35.997 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.958+0000 7f730b736700 1 -- start start 2020-04-22T14:13:35.997 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.959+0000 7f730b736700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7304128a90 0x7f73040afea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:35.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.959+0000 7f730b736700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73040b2b40 con 0x7f72ec003720 2020-04-22T14:13:35.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.959+0000 7f730b736700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73040b2de0 con 0x7f73040b03f0 2020-04-22T14:13:35.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.959+0000 7f730b736700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73040b0860 con 0x7f7304128a90 2020-04-22T14:13:35.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.959+0000 7f7309cd3700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f73040b03f0 0x7f73040aea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46000/0 (socket says 172.21.15.103:46000) 2020-04-22T14:13:35.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.959+0000 7f7309cd3700 1 -- 172.21.15.103:0/35243057 learned_addr learned my addr 172.21.15.103:0/35243057 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:36.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.959+0000 7f7308cd1700 1 --2- 172.21.15.103:0/35243057 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7304128a90 0x7f73040afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:36.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.959+0000 7f72f67fc700 1 -- 172.21.15.103:0/35243057 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1822951210 0 0) 0x7f73040b2de0 con 0x7f73040b03f0 2020-04-22T14:13:36.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.959+0000 7f72f67fc700 1 -- 172.21.15.103:0/35243057 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72e4002fe0 con 0x7f73040b03f0 2020-04-22T14:13:36.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.959+0000 7f72f67fc700 1 -- 172.21.15.103:0/35243057 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3031151479 0 0) 0x7f73040b2b40 con 0x7f72ec003720 2020-04-22T14:13:36.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.959+0000 7f72f67fc700 1 -- 172.21.15.103:0/35243057 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73040b2de0 con 0x7f72ec003720 2020-04-22T14:13:36.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.959+0000 7f72f67fc700 1 -- 172.21.15.103:0/35243057 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3932229438 0 0) 0x7f72e4002fe0 con 0x7f73040b03f0 2020-04-22T14:13:36.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.959+0000 7f72f67fc700 1 -- 172.21.15.103:0/35243057 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f73040b2b40 con 0x7f73040b03f0 2020-04-22T14:13:36.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.959+0000 7f72f67fc700 1 -- 172.21.15.103:0/35243057 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f72fc0017d0 con 0x7f73040b03f0 2020-04-22T14:13:36.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.959+0000 7f72f67fc700 1 -- 172.21.15.103:0/35243057 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7304128a90 msgr2=0x7f73040afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:36.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.959+0000 7f72f67fc700 1 --2- 172.21.15.103:0/35243057 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7304128a90 0x7f73040afea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:36.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.959+0000 7f72f67fc700 1 -- 172.21.15.103:0/35243057 >> v1:172.21.15.103:6789/0 conn(0x7f73040b03f0 legacy=0x7f73040aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:36.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.959+0000 7f72f67fc700 1 -- 172.21.15.103:0/35243057 >> v1:172.21.15.86:6789/0 conn(0x7f72ec003720 legacy=0x7f7304128380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:36.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.959+0000 7f72f67fc700 1 --2- 172.21.15.103:0/35243057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72e4004b20 0x7f72e4004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:36.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.959+0000 7f72f67fc700 1 --2- 172.21.15.103:0/35243057 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f72e4003ab0 0x7f72e4003f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:36.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.959+0000 7f72f67fc700 1 --2- 172.21.15.103:0/35243057 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f72e4004370 0x7f72e400d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:36.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.959+0000 7f72f67fc700 1 -- 172.21.15.103:0/35243057 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73040b0860 con 0x7f72e4004370 2020-04-22T14:13:36.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.959+0000 7f72f67fc700 1 -- 172.21.15.103:0/35243057 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e4004910 con 0x7f72e4004b20 2020-04-22T14:13:36.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.959+0000 7f72f67fc700 1 -- 172.21.15.103:0/35243057 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e400ddf0 con 0x7f72e4003ab0 2020-04-22T14:13:36.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.959+0000 7f7308cd1700 1 --2- 172.21.15.103:0/35243057 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7304128a90 0x7f73040afea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:13:36.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.959+0000 7f73094d2700 1 --2- 172.21.15.103:0/35243057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72e4004b20 0x7f72e4004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:36.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.960+0000 7f7309cd3700 1 --2- 172.21.15.103:0/35243057 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f72e4004370 0x7f72e400d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:36.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.960+0000 7f7308cd1700 1 --2- 172.21.15.103:0/35243057 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f72e4003ab0 0x7f72e4003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:36.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.960+0000 7f73094d2700 1 -- 172.21.15.103:0/35243057 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f72e4003ab0 msgr2=0x7f72e4003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:36.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.960+0000 7f73094d2700 1 --2- 172.21.15.103:0/35243057 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f72e4003ab0 0x7f72e4003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:36.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.960+0000 7f73094d2700 1 -- 172.21.15.103:0/35243057 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f72e4004370 msgr2=0x7f72e400d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:36.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.960+0000 7f73094d2700 1 --2- 172.21.15.103:0/35243057 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f72e4004370 0x7f72e400d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:36.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.960+0000 7f73094d2700 1 -- 172.21.15.103:0/35243057 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73040b3080 con 0x7f72e4004b20 2020-04-22T14:13:36.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.960+0000 7f7308cd1700 1 --2- 172.21.15.103:0/35243057 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f72e4003ab0 0x7f72e4003f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:13:36.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.960+0000 7f730b736700 1 -- 172.21.15.103:0/35243057 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73040b32b0 con 0x7f72e4004b20 2020-04-22T14:13:36.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.960+0000 7f73094d2700 1 --2- 172.21.15.103:0/35243057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72e4004b20 0x7f72e4004f40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f72f8001420 tx=0x7f72f800fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.960+0000 7f73094d2700 1 --2- 172.21.15.103:0/35243057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72e4004b20 0x7f72e4004f40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f72f8001420 tx=0x7f72f800fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.960+0000 7f73094d2700 1 --2- 172.21.15.103:0/35243057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72e4004b20 0x7f72e4004f40 secure :-1 s=READY pgs=1255 cs=0 l=1 rx=0x7f72f8001420 tx=0x7f72f800fd20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:36.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.960+0000 7f73094d2700 1 --2- 172.21.15.103:0/35243057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72e4004b20 0x7f72e4004f40 secure :-1 s=THROTTLE_DONE pgs=1255 cs=0 l=1 rx=0x7f72f8001420 tx=0x7f72f800fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.960+0000 7f730b736700 1 -- 172.21.15.103:0/35243057 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73040b00e0 con 0x7f72e4004b20 2020-04-22T14:13:36.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.960+0000 7f73094d2700 1 --2- 172.21.15.103:0/35243057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72e4004b20 0x7f72e4004f40 secure :-1 s=THROTTLE_DONE pgs=1255 cs=0 l=1 rx=0x7f72f8001420 tx=0x7f72f800fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.960+0000 7f73094d2700 1 --2- 172.21.15.103:0/35243057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72e4004b20 0x7f72e4004f40 secure :-1 s=THROTTLE_DONE pgs=1255 cs=0 l=1 rx=0x7f72f8001420 tx=0x7f72f800fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.961+0000 7f73094d2700 1 --2- 172.21.15.103:0/35243057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72e4004b20 0x7f72e4004f40 secure :-1 s=THROTTLE_DONE pgs=1255 cs=0 l=1 rx=0x7f72f8001420 tx=0x7f72f800fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.961+0000 7f73094d2700 1 --2- 172.21.15.103:0/35243057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72e4004b20 0x7f72e4004f40 secure :-1 s=THROTTLE_DONE pgs=1255 cs=0 l=1 rx=0x7f72f8001420 tx=0x7f72f800fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.961+0000 7f72f67fc700 1 -- 172.21.15.103:0/35243057 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72f8008370 con 0x7f72e4004b20 2020-04-22T14:13:36.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.961+0000 7f72f67fc700 1 -- 172.21.15.103:0/35243057 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f8008ac0 con 0x7f72e4004b20 2020-04-22T14:13:36.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.961+0000 7f72f67fc700 1 -- 172.21.15.103:0/35243057 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72f80064e0 con 0x7f72e4004b20 2020-04-22T14:13:36.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.961+0000 7f72f67fc700 1 -- 172.21.15.103:0/35243057 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f72f8006700 con 0x7f72e4004b20 2020-04-22T14:13:36.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.961+0000 7f730b736700 1 -- 172.21.15.103:0/35243057 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7304056c90 con 0x7f72e4004b20 2020-04-22T14:13:36.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.962+0000 7f72f67fc700 1 --2- 172.21.15.103:0/35243057 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f72e4058640 0x7f72e405ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:36.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.962+0000 7f72f67fc700 1 -- 172.21.15.103:0/35243057 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f72f8061ee0 con 0x7f72e4004b20 2020-04-22T14:13:36.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.962+0000 7f7308cd1700 1 --2- 172.21.15.103:0/35243057 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f72e4058640 0x7f72e405ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:36.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.962+0000 7f7308cd1700 1 --2- 172.21.15.103:0/35243057 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f72e4058640 0x7f72e405ab00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f73000013e0 tx=0x7f730405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.962+0000 7f7308cd1700 1 --2- 172.21.15.103:0/35243057 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f72e4058640 0x7f72e405ab00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f73000013e0 tx=0x7f730405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.962+0000 7f7308cd1700 1 --2- 172.21.15.103:0/35243057 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f72e4058640 0x7f72e405ab00 secure :-1 s=READY pgs=463 cs=0 l=1 rx=0x7f73000013e0 tx=0x7f730405bce0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:36.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.966+0000 7f73094d2700 1 --2- 172.21.15.103:0/35243057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72e4004b20 0x7f72e4004f40 secure :-1 s=THROTTLE_DONE pgs=1255 cs=0 l=1 rx=0x7f72f8001420 tx=0x7f72f800fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:35.966+0000 7f72f67fc700 1 -- 172.21.15.103:0/35243057 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f72f803d3f0 con 0x7f72e4004b20 2020-04-22T14:13:36.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.109+0000 7f730b736700 1 -- 172.21.15.103:0/35243057 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7304147360 con 0x7f72e4004b20 2020-04-22T14:13:36.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.110+0000 7f73094d2700 1 --2- 172.21.15.103:0/35243057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72e4004b20 0x7f72e4004f40 secure :-1 s=THROTTLE_DONE pgs=1255 cs=0 l=1 rx=0x7f72f8001420 tx=0x7f72f800fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.110+0000 7f72f67fc700 1 -- 172.21.15.103:0/35243057 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+16282 (secure 0 0 0) 0x7f72f8040a10 con 0x7f72e4004b20 2020-04-22T14:13:36.113 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:13:36.113 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":80,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:13:32.459154+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:12:16.799055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2020-04-22T14:12:17.819603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.103:6833/46849623":"2020-04-23T14:12:39.098447+0000","172.21.15.103:0/3734229525":"2020-04-22T15:13:32.344388+0000","172.21.15.103:6832/46849623":"2020-04-23T14:12:39.098447+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:13:36.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.112+0000 7f730b736700 1 -- 172.21.15.103:0/35243057 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f72e4058640 msgr2=0x7f72e405ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:36.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.112+0000 7f730b736700 1 --2- 172.21.15.103:0/35243057 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f72e4058640 0x7f72e405ab00 secure :-1 s=READY pgs=463 cs=0 l=1 rx=0x7f73000013e0 tx=0x7f730405bce0).stop 2020-04-22T14:13:36.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.112+0000 7f730b736700 1 -- 172.21.15.103:0/35243057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72e4004b20 msgr2=0x7f72e4004f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:36.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.112+0000 7f730b736700 1 --2- 172.21.15.103:0/35243057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72e4004b20 0x7f72e4004f40 secure :-1 s=READY pgs=1255 cs=0 l=1 rx=0x7f72f8001420 tx=0x7f72f800fd20).stop 2020-04-22T14:13:36.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.112+0000 7f7309cd3700 1 -- 172.21.15.103:0/35243057 reap_dead start 2020-04-22T14:13:36.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.112+0000 7f7309cd3700 1 -- 172.21.15.103:0/35243057 reap_dead start 2020-04-22T14:13:36.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.112+0000 7f730b736700 1 -- 172.21.15.103:0/35243057 shutdown_connections 2020-04-22T14:13:36.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.112+0000 7f730b736700 1 -- 172.21.15.103:0/35243057 >> 172.21.15.103:0/35243057 conn(0x7f73040b9160 msgr2=0x7f73040b7350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:36.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.112+0000 7f730b736700 1 -- 172.21.15.103:0/35243057 shutdown_connections 2020-04-22T14:13:36.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.112+0000 7f730b736700 1 -- 172.21.15.103:0/35243057 wait complete. 2020-04-22T14:13:36.125 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:12:16.799055+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 13, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'76', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:12:17.819603+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 14, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'77', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:13:36.125 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:36.139 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:13:36.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.292+0000 7f88e4e2c700 1 Processor -- start 2020-04-22T14:13:36.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.292+0000 7f88e4e2c700 1 -- start start 2020-04-22T14:13:36.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.293+0000 7f88e4e2c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88e00b3bd0 0x7f88e0143650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:36.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.293+0000 7f88e4e2c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f88e0143ab0 0x7f88e0143f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:36.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.293+0000 7f88e4e2c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88e0148310 con 0x7f88e00b9140 2020-04-22T14:13:36.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.293+0000 7f88e4e2c700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88e01485b0 con 0x7f88e0143ab0 2020-04-22T14:13:36.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.293+0000 7f88e4e2c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e00b9520 con 0x7f88e00b3bd0 2020-04-22T14:13:36.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.293+0000 7f88de59c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f88e00b9140 0x7f88e00aed90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46010/0 (socket says 172.21.15.103:46010) 2020-04-22T14:13:36.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.293+0000 7f88de59c700 1 -- 172.21.15.103:0/3873816651 learned_addr learned my addr 172.21.15.103:0/3873816651 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:36.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.293+0000 7f88ded9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f88e0143ab0 0x7f88e0143f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:36.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.293+0000 7f88d7fff700 1 --2- 172.21.15.103:0/3873816651 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88e00b3bd0 0x7f88e0143650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:36.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.293+0000 7f88ded9d700 1 -- 172.21.15.103:0/3873816651 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88e00b3bd0 msgr2=0x7f88e0143650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:36.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.293+0000 7f88ded9d700 1 --2- 172.21.15.103:0/3873816651 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88e00b3bd0 0x7f88e0143650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:36.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.293+0000 7f88ded9d700 1 -- 172.21.15.103:0/3873816651 >> v1:172.21.15.103:6789/0 conn(0x7f88e00b9140 legacy=0x7f88e00aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:36.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.293+0000 7f88ddd9b700 1 -- 172.21.15.103:0/3873816651 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1808884304 0 0) 0x7f88e0148310 con 0x7f88e00b9140 2020-04-22T14:13:36.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.293+0000 7f88ded9d700 1 -- 172.21.15.103:0/3873816651 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e00b3050 con 0x7f88e0143ab0 2020-04-22T14:13:36.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.293+0000 7f88ded9d700 1 --2- 172.21.15.103:0/3873816651 >> v2:172.21.15.103:3300/0 conn(0x7f88e0143ab0 0x7f88e0143f60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f88d80032b0 tx=0x7f88d8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.293+0000 7f88ded9d700 1 --2- 172.21.15.103:0/3873816651 >> v2:172.21.15.103:3300/0 conn(0x7f88e0143ab0 0x7f88e0143f60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f88d80032b0 tx=0x7f88d8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.293+0000 7f88ded9d700 1 --2- 172.21.15.103:0/3873816651 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88e0143ab0 0x7f88e0143f60 secure :-1 s=READY pgs=1257 cs=0 l=1 rx=0x7f88d80032b0 tx=0x7f88d8007dc0).ready entity=mon.1 client_cookie=12653cfb9f78a7b8 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:36.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.293+0000 7f88ded9d700 1 --2- 172.21.15.103:0/3873816651 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88e0143ab0 0x7f88e0143f60 secure :-1 s=THROTTLE_DONE pgs=1257 cs=0 l=1 rx=0x7f88d80032b0 tx=0x7f88d8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.293+0000 7f88ddd9b700 1 -- 172.21.15.103:0/3873816651 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88d800a180 con 0x7f88e0143ab0 2020-04-22T14:13:36.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.293+0000 7f88ded9d700 1 --2- 172.21.15.103:0/3873816651 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88e0143ab0 0x7f88e0143f60 secure :-1 s=THROTTLE_DONE pgs=1257 cs=0 l=1 rx=0x7f88d80032b0 tx=0x7f88d8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.293+0000 7f88ded9d700 1 --2- 172.21.15.103:0/3873816651 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88e0143ab0 0x7f88e0143f60 secure :-1 s=THROTTLE_DONE pgs=1257 cs=0 l=1 rx=0x7f88d80032b0 tx=0x7f88d8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.293+0000 7f88ddd9b700 1 -- 172.21.15.103:0/3873816651 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d800a320 con 0x7f88e0143ab0 2020-04-22T14:13:36.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.293+0000 7f88ddd9b700 1 -- 172.21.15.103:0/3873816651 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88d800a700 con 0x7f88e0143ab0 2020-04-22T14:13:36.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.293+0000 7f88e4e2c700 1 -- 172.21.15.103:0/3873816651 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88e0143ab0 msgr2=0x7f88e0143f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:36.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.293+0000 7f88e4e2c700 1 --2- 172.21.15.103:0/3873816651 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88e0143ab0 0x7f88e0143f60 secure :-1 s=READY pgs=1257 cs=0 l=1 rx=0x7f88d80032b0 tx=0x7f88d8007dc0).stop 2020-04-22T14:13:36.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.294+0000 7f88e4e2c700 1 -- 172.21.15.103:0/3873816651 shutdown_connections 2020-04-22T14:13:36.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.294+0000 7f88e4e2c700 1 --2- 172.21.15.103:0/3873816651 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88e0143ab0 0x7f88e0143f60 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:36.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.294+0000 7f88e4e2c700 1 --2- 172.21.15.103:0/3873816651 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88e00b3bd0 0x7f88e0143650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:36.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.294+0000 7f88e4e2c700 1 -- 172.21.15.103:0/3873816651 >> 172.21.15.103:0/3873816651 conn(0x7f88e005b7b0 msgr2=0x7f88e00b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:36.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.294+0000 7f88e4e2c700 1 -- 172.21.15.103:0/3873816651 shutdown_connections 2020-04-22T14:13:36.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.294+0000 7f88e4e2c700 1 -- 172.21.15.103:0/3873816651 wait complete. 2020-04-22T14:13:36.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.295+0000 7f88e4e2c700 1 Processor -- start 2020-04-22T14:13:36.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.295+0000 7f88e4e2c700 1 -- start start 2020-04-22T14:13:36.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.295+0000 7f88e4e2c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f88e00b9140 0x7f88e0142d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:36.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.295+0000 7f88e4e2c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88e0143ab0 0x7f88e0147230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:36.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.295+0000 7f88e4e2c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88e0142b90 con 0x7f88e00b3bd0 2020-04-22T14:13:36.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.295+0000 7f88e4e2c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88e00b2b40 con 0x7f88e00b9140 2020-04-22T14:13:36.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.295+0000 7f88e4e2c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e0147690 con 0x7f88e0143ab0 2020-04-22T14:13:36.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.295+0000 7f88de59c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f88e00b3bd0 0x7f88e012cfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46016/0 (socket says 172.21.15.103:46016) 2020-04-22T14:13:36.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.295+0000 7f88de59c700 1 -- 172.21.15.103:0/1462260911 learned_addr learned my addr 172.21.15.103:0/1462260911 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:36.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.296+0000 7f88d7fff700 1 --2- 172.21.15.103:0/1462260911 >> v2:172.21.15.86:3300/0 conn(0x7f88e00b9140 0x7f88e0142d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:36.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.296+0000 7f88ded9d700 1 --2- 172.21.15.103:0/1462260911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88e0143ab0 0x7f88e0147230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:36.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.296+0000 7f88d77fe700 1 -- 172.21.15.103:0/1462260911 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3125243373 0 0) 0x7f88e0142b90 con 0x7f88e00b3bd0 2020-04-22T14:13:36.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.296+0000 7f88d77fe700 1 -- 172.21.15.103:0/1462260911 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88c4002fe0 con 0x7f88e00b3bd0 2020-04-22T14:13:36.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.296+0000 7f88d77fe700 1 -- 172.21.15.103:0/1462260911 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 954625292 0 0) 0x7f88c4002fe0 con 0x7f88e00b3bd0 2020-04-22T14:13:36.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.296+0000 7f88d77fe700 1 -- 172.21.15.103:0/1462260911 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f88e0142b90 con 0x7f88e00b3bd0 2020-04-22T14:13:36.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.296+0000 7f88d77fe700 1 -- 172.21.15.103:0/1462260911 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f88d0001860 con 0x7f88e00b3bd0 2020-04-22T14:13:36.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.296+0000 7f88d77fe700 1 -- 172.21.15.103:0/1462260911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88e0143ab0 msgr2=0x7f88e0147230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:36.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.296+0000 7f88d77fe700 1 --2- 172.21.15.103:0/1462260911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88e0143ab0 0x7f88e0147230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:36.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.296+0000 7f88d77fe700 1 -- 172.21.15.103:0/1462260911 >> v2:172.21.15.86:3300/0 conn(0x7f88e00b9140 msgr2=0x7f88e0142d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:36.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.296+0000 7f88d77fe700 1 --2- 172.21.15.103:0/1462260911 >> v2:172.21.15.86:3300/0 conn(0x7f88e00b9140 0x7f88e0142d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:36.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.296+0000 7f88d77fe700 1 -- 172.21.15.103:0/1462260911 >> v1:172.21.15.103:6789/0 conn(0x7f88e00b3bd0 legacy=0x7f88e012cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:36.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.296+0000 7f88d77fe700 1 --2- 172.21.15.103:0/1462260911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88e0143ab0 0x7f88c40049b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:36.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.296+0000 7f88d77fe700 1 --2- 172.21.15.103:0/1462260911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88c4004e10 0x7f88c4003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:36.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.296+0000 7f88d77fe700 1 --2- 172.21.15.103:0/1462260911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88c4003d80 0x7f88c40041c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:36.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.296+0000 7f88d77fe700 1 -- 172.21.15.103:0/1462260911 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e00b2b40 con 0x7f88c4004e10 2020-04-22T14:13:36.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.296+0000 7f88d77fe700 1 -- 172.21.15.103:0/1462260911 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e0147690 con 0x7f88c4003d80 2020-04-22T14:13:36.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.296+0000 7f88d77fe700 1 -- 172.21.15.103:0/1462260911 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c4004620 con 0x7f88e0143ab0 2020-04-22T14:13:36.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.296+0000 7f88ded9d700 1 --2- 172.21.15.103:0/1462260911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88c4003d80 0x7f88c40041c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:36.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.296+0000 7f88d7fff700 1 --2- 172.21.15.103:0/1462260911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88c4004e10 0x7f88c4003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:36.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.296+0000 7f88de59c700 1 --2- 172.21.15.103:0/1462260911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88e0143ab0 0x7f88c40049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:36.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.296+0000 7f88ded9d700 1 -- 172.21.15.103:0/1462260911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88e0143ab0 msgr2=0x7f88c40049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:36.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.296+0000 7f88ded9d700 1 --2- 172.21.15.103:0/1462260911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88e0143ab0 0x7f88c40049b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:36.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.296+0000 7f88ded9d700 1 -- 172.21.15.103:0/1462260911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88c4004e10 msgr2=0x7f88c4003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:36.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.296+0000 7f88ded9d700 1 --2- 172.21.15.103:0/1462260911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88c4004e10 0x7f88c4003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:36.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.296+0000 7f88ded9d700 1 -- 172.21.15.103:0/1462260911 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e00b13f0 con 0x7f88c4003d80 2020-04-22T14:13:36.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.296+0000 7f88e4e2c700 1 -- 172.21.15.103:0/1462260911 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88e00b1690 con 0x7f88c4003d80 2020-04-22T14:13:36.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.296+0000 7f88ded9d700 1 --2- 172.21.15.103:0/1462260911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88c4003d80 0x7f88c40041c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f88d80032b0 tx=0x7f88d8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.297+0000 7f88e4e2c700 1 -- 172.21.15.103:0/1462260911 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88e012d6d0 con 0x7f88c4003d80 2020-04-22T14:13:36.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.297+0000 7f88ded9d700 1 --2- 172.21.15.103:0/1462260911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88c4003d80 0x7f88c40041c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f88d80032b0 tx=0x7f88d8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.297+0000 7f88ded9d700 1 --2- 172.21.15.103:0/1462260911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88c4003d80 0x7f88c40041c0 secure :-1 s=READY pgs=1259 cs=0 l=1 rx=0x7f88d80032b0 tx=0x7f88d8007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:36.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.297+0000 7f88ded9d700 1 --2- 172.21.15.103:0/1462260911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88c4003d80 0x7f88c40041c0 secure :-1 s=THROTTLE_DONE pgs=1259 cs=0 l=1 rx=0x7f88d80032b0 tx=0x7f88d8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.297+0000 7f88ded9d700 1 --2- 172.21.15.103:0/1462260911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88c4003d80 0x7f88c40041c0 secure :-1 s=THROTTLE_DONE pgs=1259 cs=0 l=1 rx=0x7f88d80032b0 tx=0x7f88d8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.297+0000 7f88d77fe700 1 -- 172.21.15.103:0/1462260911 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88d8005c30 con 0x7f88c4003d80 2020-04-22T14:13:36.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.297+0000 7f88ded9d700 1 --2- 172.21.15.103:0/1462260911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88c4003d80 0x7f88c40041c0 secure :-1 s=THROTTLE_DONE pgs=1259 cs=0 l=1 rx=0x7f88d80032b0 tx=0x7f88d8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.297+0000 7f88d77fe700 1 -- 172.21.15.103:0/1462260911 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d8005d90 con 0x7f88c4003d80 2020-04-22T14:13:36.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.297+0000 7f88d77fe700 1 -- 172.21.15.103:0/1462260911 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88d800f7a0 con 0x7f88c4003d80 2020-04-22T14:13:36.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.297+0000 7f88ded9d700 1 --2- 172.21.15.103:0/1462260911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88c4003d80 0x7f88c40041c0 secure :-1 s=THROTTLE_DONE pgs=1259 cs=0 l=1 rx=0x7f88d80032b0 tx=0x7f88d8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.298+0000 7f88e4e2c700 1 -- 172.21.15.103:0/1462260911 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88e0056c90 con 0x7f88c4003d80 2020-04-22T14:13:36.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.298+0000 7f88d77fe700 1 -- 172.21.15.103:0/1462260911 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f88d800f900 con 0x7f88c4003d80 2020-04-22T14:13:36.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.298+0000 7f88ded9d700 1 --2- 172.21.15.103:0/1462260911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88c4003d80 0x7f88c40041c0 secure :-1 s=THROTTLE_DONE pgs=1259 cs=0 l=1 rx=0x7f88d80032b0 tx=0x7f88d8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.298+0000 7f88d77fe700 1 --2- 172.21.15.103:0/1462260911 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f88c4055b60 0x7f88c4058020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:36.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.298+0000 7f88d77fe700 1 -- 172.21.15.103:0/1462260911 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f88d80623c0 con 0x7f88c4003d80 2020-04-22T14:13:36.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.298+0000 7f88de59c700 1 --2- 172.21.15.103:0/1462260911 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f88c4055b60 0x7f88c4058020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:36.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.298+0000 7f88de59c700 1 --2- 172.21.15.103:0/1462260911 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f88c4055b60 0x7f88c4058020 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f88d0005540 tx=0x7f88d0008d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.298+0000 7f88de59c700 1 --2- 172.21.15.103:0/1462260911 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f88c4055b60 0x7f88c4058020 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f88d0005540 tx=0x7f88d0008d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.298+0000 7f88de59c700 1 --2- 172.21.15.103:0/1462260911 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f88c4055b60 0x7f88c4058020 secure :-1 s=READY pgs=464 cs=0 l=1 rx=0x7f88d0005540 tx=0x7f88d0008d30).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:36.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.302+0000 7f88ded9d700 1 --2- 172.21.15.103:0/1462260911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88c4003d80 0x7f88c40041c0 secure :-1 s=THROTTLE_DONE pgs=1259 cs=0 l=1 rx=0x7f88d80032b0 tx=0x7f88d8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.302+0000 7f88d77fe700 1 -- 172.21.15.103:0/1462260911 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f88d803d8c0 con 0x7f88c4003d80 2020-04-22T14:13:36.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.445+0000 7f88e4e2c700 1 -- 172.21.15.103:0/1462260911 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f88e0067be0 con 0x7f88c4003d80 2020-04-22T14:13:36.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.446+0000 7f88ded9d700 1 --2- 172.21.15.103:0/1462260911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88c4003d80 0x7f88c40041c0 secure :-1 s=THROTTLE_DONE pgs=1259 cs=0 l=1 rx=0x7f88d80032b0 tx=0x7f88d8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.446+0000 7f88d77fe700 1 -- 172.21.15.103:0/1462260911 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v80) v1 ==== 110+0+10 (secure 0 0 0) 0x7f88d8040ee0 con 0x7f88c4003d80 2020-04-22T14:13:36.449 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:13:36.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.447+0000 7f88e4e2c700 1 -- 172.21.15.103:0/1462260911 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f88c4055b60 msgr2=0x7f88c4058020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:36.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.447+0000 7f88e4e2c700 1 --2- 172.21.15.103:0/1462260911 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f88c4055b60 0x7f88c4058020 secure :-1 s=READY pgs=464 cs=0 l=1 rx=0x7f88d0005540 tx=0x7f88d0008d30).stop 2020-04-22T14:13:36.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.447+0000 7f88e4e2c700 1 -- 172.21.15.103:0/1462260911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88c4003d80 msgr2=0x7f88c40041c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:36.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.447+0000 7f88e4e2c700 1 --2- 172.21.15.103:0/1462260911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88c4003d80 0x7f88c40041c0 secure :-1 s=READY pgs=1259 cs=0 l=1 rx=0x7f88d80032b0 tx=0x7f88d8007dc0).stop 2020-04-22T14:13:36.451 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.447+0000 7f88ded9d700 1 -- 172.21.15.103:0/1462260911 reap_dead start 2020-04-22T14:13:36.451 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.447+0000 7f88ded9d700 1 -- 172.21.15.103:0/1462260911 reap_dead start 2020-04-22T14:13:36.451 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.447+0000 7f88e4e2c700 1 -- 172.21.15.103:0/1462260911 shutdown_connections 2020-04-22T14:13:36.451 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.447+0000 7f88e4e2c700 1 -- 172.21.15.103:0/1462260911 >> 172.21.15.103:0/1462260911 conn(0x7f88e005b7b0 msgr2=0x7f88e005c650 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:36.451 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.447+0000 7f88e4e2c700 1 -- 172.21.15.103:0/1462260911 shutdown_connections 2020-04-22T14:13:36.451 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.447+0000 7f88e4e2c700 1 -- 172.21.15.103:0/1462260911 wait complete. 2020-04-22T14:13:36.460 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:36.473 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:13:36.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.620+0000 7fc382d6f700 1 Processor -- start 2020-04-22T14:13:36.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.620+0000 7fc382d6f700 1 -- start start 2020-04-22T14:13:36.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.620+0000 7fc382d6f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc37c061a30 0x7fc37c0b4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:36.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.620+0000 7fc382d6f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc37c141f20 0x7fc37c1423b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:36.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.620+0000 7fc382d6f700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc37c0af030 con 0x7fc37c0acb10 2020-04-22T14:13:36.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.620+0000 7fc382d6f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc37c060250 con 0x7fc37c141f20 2020-04-22T14:13:36.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.620+0000 7fc382d6f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c0623c0 con 0x7fc37c061a30 2020-04-22T14:13:36.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.621+0000 7fc38130c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc37c141f20 0x7fc37c1423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:36.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.621+0000 7fc37bfff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc37c0acb10 0x7fc37c0ae920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46034/0 (socket says 172.21.15.103:46034) 2020-04-22T14:13:36.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.621+0000 7fc38130c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc37c141f20 0x7fc37c1423b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53840/0 (socket says 172.21.15.103:53840) 2020-04-22T14:13:36.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.621+0000 7fc37bfff700 1 -- 172.21.15.103:0/2890916863 learned_addr learned my addr 172.21.15.103:0/2890916863 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:36.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.621+0000 7fc380b0b700 1 --2- 172.21.15.103:0/2890916863 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc37c061a30 0x7fc37c0b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:36.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.621+0000 7fc38130c700 1 -- 172.21.15.103:0/2890916863 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc37c061a30 msgr2=0x7fc37c0b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:36.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.621+0000 7fc38130c700 1 --2- 172.21.15.103:0/2890916863 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc37c061a30 0x7fc37c0b4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:36.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.621+0000 7fc38130c700 1 -- 172.21.15.103:0/2890916863 >> v1:172.21.15.103:6789/0 conn(0x7fc37c0acb10 legacy=0x7fc37c0ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:36.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.621+0000 7fc37b7fe700 1 -- 172.21.15.103:0/2890916863 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 302642267 0 0) 0x7fc37c0af030 con 0x7fc37c0acb10 2020-04-22T14:13:36.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.621+0000 7fc38130c700 1 -- 172.21.15.103:0/2890916863 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc37c062660 con 0x7fc37c141f20 2020-04-22T14:13:36.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.621+0000 7fc38130c700 1 --2- 172.21.15.103:0/2890916863 >> v2:172.21.15.103:3300/0 conn(0x7fc37c141f20 0x7fc37c1423b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc3740032b0 tx=0x7fc374007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.621+0000 7fc38130c700 1 --2- 172.21.15.103:0/2890916863 >> v2:172.21.15.103:3300/0 conn(0x7fc37c141f20 0x7fc37c1423b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc3740032b0 tx=0x7fc374007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.621+0000 7fc38130c700 1 --2- 172.21.15.103:0/2890916863 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc37c141f20 0x7fc37c1423b0 secure :-1 s=READY pgs=1261 cs=0 l=1 rx=0x7fc3740032b0 tx=0x7fc374007dc0).ready entity=mon.1 client_cookie=a572ed89a2c8bd25 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:36.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.621+0000 7fc38130c700 1 --2- 172.21.15.103:0/2890916863 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc37c141f20 0x7fc37c1423b0 secure :-1 s=THROTTLE_DONE pgs=1261 cs=0 l=1 rx=0x7fc3740032b0 tx=0x7fc374007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.621+0000 7fc37b7fe700 1 -- 172.21.15.103:0/2890916863 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc374011e20 con 0x7fc37c141f20 2020-04-22T14:13:36.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.621+0000 7fc38130c700 1 --2- 172.21.15.103:0/2890916863 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc37c141f20 0x7fc37c1423b0 secure :-1 s=THROTTLE_DONE pgs=1261 cs=0 l=1 rx=0x7fc3740032b0 tx=0x7fc374007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.632 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.621+0000 7fc38130c700 1 --2- 172.21.15.103:0/2890916863 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc37c141f20 0x7fc37c1423b0 secure :-1 s=THROTTLE_DONE pgs=1261 cs=0 l=1 rx=0x7fc3740032b0 tx=0x7fc374007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.632 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.621+0000 7fc37b7fe700 1 -- 172.21.15.103:0/2890916863 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc37400a180 con 0x7fc37c141f20 2020-04-22T14:13:36.632 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.621+0000 7fc37b7fe700 1 -- 172.21.15.103:0/2890916863 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc37400a520 con 0x7fc37c141f20 2020-04-22T14:13:36.632 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.621+0000 7fc382d6f700 1 -- 172.21.15.103:0/2890916863 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc37c141f20 msgr2=0x7fc37c1423b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:36.632 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.621+0000 7fc382d6f700 1 --2- 172.21.15.103:0/2890916863 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc37c141f20 0x7fc37c1423b0 secure :-1 s=READY pgs=1261 cs=0 l=1 rx=0x7fc3740032b0 tx=0x7fc374007dc0).stop 2020-04-22T14:13:36.632 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.622+0000 7fc382d6f700 1 -- 172.21.15.103:0/2890916863 shutdown_connections 2020-04-22T14:13:36.632 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.622+0000 7fc382d6f700 1 --2- 172.21.15.103:0/2890916863 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc37c141f20 0x7fc37c1423b0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:36.633 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.622+0000 7fc382d6f700 1 --2- 172.21.15.103:0/2890916863 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc37c061a30 0x7fc37c0b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:36.633 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.622+0000 7fc382d6f700 1 -- 172.21.15.103:0/2890916863 >> 172.21.15.103:0/2890916863 conn(0x7fc37c05b7b0 msgr2=0x7fc37c0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:36.633 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.622+0000 7fc382d6f700 1 -- 172.21.15.103:0/2890916863 shutdown_connections 2020-04-22T14:13:36.633 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.622+0000 7fc382d6f700 1 -- 172.21.15.103:0/2890916863 wait complete. 2020-04-22T14:13:36.633 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.623+0000 7fc382d6f700 1 Processor -- start 2020-04-22T14:13:36.633 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.623+0000 7fc382d6f700 1 -- start start 2020-04-22T14:13:36.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.623+0000 7fc382d6f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc37c061a30 0x7fc37c151db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:36.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.623+0000 7fc382d6f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc37c0acb10 0x7fc37c141100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:36.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.623+0000 7fc382d6f700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc37c152330 con 0x7fc37c141f20 2020-04-22T14:13:36.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.623+0000 7fc382d6f700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc37c13bad0 con 0x7fc37c061a30 2020-04-22T14:13:36.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.623+0000 7fc382d6f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc37c141af0 con 0x7fc37c0acb10 2020-04-22T14:13:36.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.624+0000 7fc37bfff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc37c0acb10 0x7fc37c141100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:36.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.624+0000 7fc38130c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc37c141f20 0x7fc37c144540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46040/0 (socket says 172.21.15.103:46040) 2020-04-22T14:13:36.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.624+0000 7fc38130c700 1 -- 172.21.15.103:0/1639143720 learned_addr learned my addr 172.21.15.103:0/1639143720 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:36.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.624+0000 7fc37bfff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc37c0acb10 0x7fc37c141100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53846/0 (socket says 172.21.15.103:53846) 2020-04-22T14:13:36.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.624+0000 7fc37bfff700 1 -- 172.21.15.103:0/1639143720 >> v2:172.21.15.86:3300/0 conn(0x7fc37c061a30 msgr2=0x7fc37c151db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:36.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.624+0000 7fc37bfff700 1 --2- 172.21.15.103:0/1639143720 >> v2:172.21.15.86:3300/0 conn(0x7fc37c061a30 0x7fc37c151db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:36.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.624+0000 7fc379ffb700 1 -- 172.21.15.103:0/1639143720 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2651882721 0 0) 0x7fc37c152330 con 0x7fc37c141f20 2020-04-22T14:13:36.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.624+0000 7fc37bfff700 1 -- 172.21.15.103:0/1639143720 >> v1:172.21.15.103:6789/0 conn(0x7fc37c141f20 legacy=0x7fc37c144540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:36.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.624+0000 7fc37bfff700 1 -- 172.21.15.103:0/1639143720 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc37c13db30 con 0x7fc37c0acb10 2020-04-22T14:13:36.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.624+0000 7fc37bfff700 1 --2- 172.21.15.103:0/1639143720 >> v2:172.21.15.103:3300/0 conn(0x7fc37c0acb10 0x7fc37c141100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc368000b80 tx=0x7fc368010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.624+0000 7fc37bfff700 1 --2- 172.21.15.103:0/1639143720 >> v2:172.21.15.103:3300/0 conn(0x7fc37c0acb10 0x7fc37c141100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc368000b80 tx=0x7fc368010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.624+0000 7fc37bfff700 1 --2- 172.21.15.103:0/1639143720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc37c0acb10 0x7fc37c141100 secure :-1 s=READY pgs=1263 cs=0 l=1 rx=0x7fc368000b80 tx=0x7fc368010970).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:36.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.624+0000 7fc37bfff700 1 --2- 172.21.15.103:0/1639143720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc37c0acb10 0x7fc37c141100 secure :-1 s=THROTTLE_DONE pgs=1263 cs=0 l=1 rx=0x7fc368000b80 tx=0x7fc368010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.624+0000 7fc379ffb700 1 -- 172.21.15.103:0/1639143720 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc368005ca0 con 0x7fc37c0acb10 2020-04-22T14:13:36.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.624+0000 7fc37bfff700 1 --2- 172.21.15.103:0/1639143720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc37c0acb10 0x7fc37c141100 secure :-1 s=THROTTLE_DONE pgs=1263 cs=0 l=1 rx=0x7fc368000b80 tx=0x7fc368010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.624+0000 7fc382d6f700 1 -- 172.21.15.103:0/1639143720 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc37c13ddd0 con 0x7fc37c0acb10 2020-04-22T14:13:36.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.624+0000 7fc379ffb700 1 -- 172.21.15.103:0/1639143720 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc368005e00 con 0x7fc37c0acb10 2020-04-22T14:13:36.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.624+0000 7fc37bfff700 1 --2- 172.21.15.103:0/1639143720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc37c0acb10 0x7fc37c141100 secure :-1 s=THROTTLE_DONE pgs=1263 cs=0 l=1 rx=0x7fc368000b80 tx=0x7fc368010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.624+0000 7fc379ffb700 1 -- 172.21.15.103:0/1639143720 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3680062c0 con 0x7fc37c0acb10 2020-04-22T14:13:36.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.624+0000 7fc382d6f700 1 -- 172.21.15.103:0/1639143720 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc37c063b10 con 0x7fc37c0acb10 2020-04-22T14:13:36.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.625+0000 7fc37bfff700 1 --2- 172.21.15.103:0/1639143720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc37c0acb10 0x7fc37c141100 secure :-1 s=THROTTLE_DONE pgs=1263 cs=0 l=1 rx=0x7fc368000b80 tx=0x7fc368010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.625+0000 7fc382d6f700 1 -- 172.21.15.103:0/1639143720 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc37c063e20 con 0x7fc37c0acb10 2020-04-22T14:13:36.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.625+0000 7fc379ffb700 1 -- 172.21.15.103:0/1639143720 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fc368006500 con 0x7fc37c0acb10 2020-04-22T14:13:36.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.625+0000 7fc37bfff700 1 --2- 172.21.15.103:0/1639143720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc37c0acb10 0x7fc37c141100 secure :-1 s=THROTTLE_DONE pgs=1263 cs=0 l=1 rx=0x7fc368000b80 tx=0x7fc368010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.626+0000 7fc379ffb700 1 --2- 172.21.15.103:0/1639143720 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc36404d830 0x7fc36404fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:36.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.626+0000 7fc379ffb700 1 -- 172.21.15.103:0/1639143720 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6202+0+0 (secure 0 0 0) 0x7fc3680090c0 con 0x7fc37c0acb10 2020-04-22T14:13:36.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.626+0000 7fc380b0b700 1 --2- 172.21.15.103:0/1639143720 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc36404d830 0x7fc36404fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:36.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.626+0000 7fc380b0b700 1 --2- 172.21.15.103:0/1639143720 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc36404d830 0x7fc36404fcf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc370002f30 tx=0x7fc37000c6f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.626+0000 7fc380b0b700 1 --2- 172.21.15.103:0/1639143720 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc36404d830 0x7fc36404fcf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc370002f30 tx=0x7fc37000c6f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.626+0000 7fc380b0b700 1 --2- 172.21.15.103:0/1639143720 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc36404d830 0x7fc36404fcf0 secure :-1 s=READY pgs=465 cs=0 l=1 rx=0x7fc370002f30 tx=0x7fc37000c6f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:36.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.630+0000 7fc37bfff700 1 --2- 172.21.15.103:0/1639143720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc37c0acb10 0x7fc37c141100 secure :-1 s=THROTTLE_DONE pgs=1263 cs=0 l=1 rx=0x7fc368000b80 tx=0x7fc368010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.630+0000 7fc379ffb700 1 -- 172.21.15.103:0/1639143720 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fc36803c990 con 0x7fc37c0acb10 2020-04-22T14:13:36.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.771+0000 7fc382d6f700 1 -- 172.21.15.103:0/1639143720 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc37c056c90 con 0x7fc37c0acb10 2020-04-22T14:13:36.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.772+0000 7fc37bfff700 1 --2- 172.21.15.103:0/1639143720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc37c0acb10 0x7fc37c141100 secure :-1 s=THROTTLE_DONE pgs=1263 cs=0 l=1 rx=0x7fc368000b80 tx=0x7fc368010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.772+0000 7fc379ffb700 1 -- 172.21.15.103:0/1639143720 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v80) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc36803ffb0 con 0x7fc37c0acb10 2020-04-22T14:13:36.774 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:13:36.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.773+0000 7fc382d6f700 1 -- 172.21.15.103:0/1639143720 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc36404d830 msgr2=0x7fc36404fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:36.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.773+0000 7fc382d6f700 1 --2- 172.21.15.103:0/1639143720 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc36404d830 0x7fc36404fcf0 secure :-1 s=READY pgs=465 cs=0 l=1 rx=0x7fc370002f30 tx=0x7fc37000c6f0).stop 2020-04-22T14:13:36.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.773+0000 7fc382d6f700 1 -- 172.21.15.103:0/1639143720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc37c0acb10 msgr2=0x7fc37c141100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:36.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.773+0000 7fc382d6f700 1 --2- 172.21.15.103:0/1639143720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc37c0acb10 0x7fc37c141100 secure :-1 s=READY pgs=1263 cs=0 l=1 rx=0x7fc368000b80 tx=0x7fc368010970).stop 2020-04-22T14:13:36.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.773+0000 7fc382d6f700 1 -- 172.21.15.103:0/1639143720 shutdown_connections 2020-04-22T14:13:36.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.773+0000 7fc382d6f700 1 --2- 172.21.15.103:0/1639143720 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc36404d830 0x7fc36404fcf0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:36.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.773+0000 7fc382d6f700 1 --2- 172.21.15.103:0/1639143720 >> v2:172.21.15.86:3300/0 conn(0x7fc37c061a30 0x7fc37c151db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:36.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.773+0000 7fc382d6f700 1 --2- 172.21.15.103:0/1639143720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc37c0acb10 0x7fc37c141100 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:36.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.773+0000 7fc382d6f700 1 -- 172.21.15.103:0/1639143720 >> 172.21.15.103:0/1639143720 conn(0x7fc37c05b7b0 msgr2=0x7fc37c0ade70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:36.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.773+0000 7fc382d6f700 1 -- 172.21.15.103:0/1639143720 shutdown_connections 2020-04-22T14:13:36.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.773+0000 7fc382d6f700 1 -- 172.21.15.103:0/1639143720 wait complete. 2020-04-22T14:13:36.785 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:36.799 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-22T14:13:36.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.944+0000 7f0663cf3700 1 Processor -- start 2020-04-22T14:13:36.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.944+0000 7f0663cf3700 1 -- start start 2020-04-22T14:13:36.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.945+0000 7f0663cf3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f065c0b9140 0x7f065c12b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:36.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.945+0000 7f0663cf3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f065c0ac950 0x7f065c12b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:36.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.945+0000 7f0663cf3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f065c146c40 0x7f065c1470f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:36.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.945+0000 7f0663cf3700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f065c0602f0 con 0x7f065c0b9140 2020-04-22T14:13:36.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.945+0000 7f0663cf3700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f065c1467e0 con 0x7f065c146c40 2020-04-22T14:13:36.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.945+0000 7f0663cf3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f065c060050 con 0x7f065c0ac950 2020-04-22T14:13:36.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.945+0000 7f0662290700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f065c146c40 0x7f065c1470f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:36.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.945+0000 7f0662290700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f065c146c40 0x7f065c1470f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53854/0 (socket says 172.21.15.103:53854) 2020-04-22T14:13:36.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.945+0000 7f0662290700 1 -- 172.21.15.103:0/1858859270 learned_addr learned my addr 172.21.15.103:0/1858859270 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:36.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.945+0000 7f0661a8f700 1 --2- 172.21.15.103:0/1858859270 >> v2:172.21.15.86:3300/0 conn(0x7f065c0b9140 0x7f065c12b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:36.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.945+0000 7f066128e700 1 --2- 172.21.15.103:0/1858859270 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f065c0ac950 0x7f065c12b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:36.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.945+0000 7f0662290700 1 -- 172.21.15.103:0/1858859270 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f065c0ac950 msgr2=0x7f065c12b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:36.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.945+0000 7f0662290700 1 --2- 172.21.15.103:0/1858859270 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f065c0ac950 0x7f065c12b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:36.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.945+0000 7f0662290700 1 -- 172.21.15.103:0/1858859270 >> v2:172.21.15.86:3300/0 conn(0x7f065c0b9140 msgr2=0x7f065c12b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:36.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.945+0000 7f0662290700 1 --2- 172.21.15.103:0/1858859270 >> v2:172.21.15.86:3300/0 conn(0x7f065c0b9140 0x7f065c12b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:36.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.945+0000 7f0662290700 1 -- 172.21.15.103:0/1858859270 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f065c0b9520 con 0x7f065c146c40 2020-04-22T14:13:36.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.946+0000 7f0662290700 1 --2- 172.21.15.103:0/1858859270 >> v2:172.21.15.103:3300/0 conn(0x7f065c146c40 0x7f065c1470f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f065c062a30 tx=0x7f06500088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.946+0000 7f0662290700 1 --2- 172.21.15.103:0/1858859270 >> v2:172.21.15.103:3300/0 conn(0x7f065c146c40 0x7f065c1470f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f065c062a30 tx=0x7f06500088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.946+0000 7f0662290700 1 --2- 172.21.15.103:0/1858859270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f065c146c40 0x7f065c1470f0 secure :-1 s=READY pgs=1264 cs=0 l=1 rx=0x7f065c062a30 tx=0x7f06500088e0).ready entity=mon.1 client_cookie=4be40cdfa2836b8c server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:36.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.946+0000 7f0662290700 1 --2- 172.21.15.103:0/1858859270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f065c146c40 0x7f065c1470f0 secure :-1 s=THROTTLE_DONE pgs=1264 cs=0 l=1 rx=0x7f065c062a30 tx=0x7f06500088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.946+0000 7f0660a8d700 1 -- 172.21.15.103:0/1858859270 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0650011720 con 0x7f065c146c40 2020-04-22T14:13:36.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.946+0000 7f0662290700 1 --2- 172.21.15.103:0/1858859270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f065c146c40 0x7f065c1470f0 secure :-1 s=THROTTLE_DONE pgs=1264 cs=0 l=1 rx=0x7f065c062a30 tx=0x7f06500088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.946+0000 7f0662290700 1 --2- 172.21.15.103:0/1858859270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f065c146c40 0x7f065c1470f0 secure :-1 s=THROTTLE_DONE pgs=1264 cs=0 l=1 rx=0x7f065c062a30 tx=0x7f06500088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.946+0000 7f0660a8d700 1 -- 172.21.15.103:0/1858859270 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0650011880 con 0x7f065c146c40 2020-04-22T14:13:36.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.946+0000 7f0660a8d700 1 -- 172.21.15.103:0/1858859270 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0650011ca0 con 0x7f065c146c40 2020-04-22T14:13:36.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.946+0000 7f0663cf3700 1 -- 172.21.15.103:0/1858859270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f065c146c40 msgr2=0x7f065c1470f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:36.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.946+0000 7f0663cf3700 1 --2- 172.21.15.103:0/1858859270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f065c146c40 0x7f065c1470f0 secure :-1 s=READY pgs=1264 cs=0 l=1 rx=0x7f065c062a30 tx=0x7f06500088e0).stop 2020-04-22T14:13:36.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.946+0000 7f0663cf3700 1 -- 172.21.15.103:0/1858859270 shutdown_connections 2020-04-22T14:13:36.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.946+0000 7f0663cf3700 1 --2- 172.21.15.103:0/1858859270 >> v2:172.21.15.86:3300/0 conn(0x7f065c0b9140 0x7f065c12b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:36.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.946+0000 7f0663cf3700 1 --2- 172.21.15.103:0/1858859270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f065c146c40 0x7f065c1470f0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:36.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.946+0000 7f0663cf3700 1 --2- 172.21.15.103:0/1858859270 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f065c0ac950 0x7f065c12b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:36.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.946+0000 7f0663cf3700 1 -- 172.21.15.103:0/1858859270 >> 172.21.15.103:0/1858859270 conn(0x7f065c05b7b0 msgr2=0x7f065c0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:36.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.946+0000 7f0663cf3700 1 -- 172.21.15.103:0/1858859270 shutdown_connections 2020-04-22T14:13:36.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.946+0000 7f0663cf3700 1 -- 172.21.15.103:0/1858859270 wait complete. 2020-04-22T14:13:36.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.947+0000 7f0663cf3700 1 Processor -- start 2020-04-22T14:13:36.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.947+0000 7f0663cf3700 1 -- start start 2020-04-22T14:13:36.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.948+0000 7f0663cf3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f065c0ac950 0x7f065c14bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:36.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.948+0000 7f0663cf3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f065c146c40 0x7f065c126e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:36.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.948+0000 7f0663cf3700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f065c14c3b0 con 0x7f065c0b9140 2020-04-22T14:13:36.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.948+0000 7f0663cf3700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f065c13e980 con 0x7f065c146c40 2020-04-22T14:13:36.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.948+0000 7f0663cf3700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f065c13f4c0 con 0x7f065c0ac950 2020-04-22T14:13:36.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.948+0000 7f0661a8f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f065c0ac950 0x7f065c14bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:36.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.948+0000 7f0661a8f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f065c0ac950 0x7f065c14bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53862/0 (socket says 172.21.15.103:53862) 2020-04-22T14:13:36.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.948+0000 7f066128e700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f065c0b9140 0x7f065c13ebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46048/0 (socket says 172.21.15.103:46048) 2020-04-22T14:13:36.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.948+0000 7f0661a8f700 1 -- 172.21.15.103:0/2388782694 learned_addr learned my addr 172.21.15.103:0/2388782694 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:36.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.948+0000 7f0662290700 1 --2- 172.21.15.103:0/2388782694 >> v2:172.21.15.86:3300/0 conn(0x7f065c146c40 0x7f065c126e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:36.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.948+0000 7f0661a8f700 1 -- 172.21.15.103:0/2388782694 >> v2:172.21.15.86:3300/0 conn(0x7f065c146c40 msgr2=0x7f065c126e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:36.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.948+0000 7f0661a8f700 1 --2- 172.21.15.103:0/2388782694 >> v2:172.21.15.86:3300/0 conn(0x7f065c146c40 0x7f065c126e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:36.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.948+0000 7f0661a8f700 1 -- 172.21.15.103:0/2388782694 >> v1:172.21.15.103:6789/0 conn(0x7f065c0b9140 legacy=0x7f065c13ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:36.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.948+0000 7f0661a8f700 1 -- 172.21.15.103:0/2388782694 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f065c13f760 con 0x7f065c0ac950 2020-04-22T14:13:36.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.948+0000 7f064effd700 1 -- 172.21.15.103:0/2388782694 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 185537686 0 0) 0x7f0658001ec0 con 0x7f065c0b9140 2020-04-22T14:13:36.961 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.948+0000 7f0661a8f700 1 --2- 172.21.15.103:0/2388782694 >> v2:172.21.15.103:3300/0 conn(0x7f065c0ac950 0x7f065c14bf50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0654007e80 tx=0x7f0654011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.961 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.948+0000 7f0661a8f700 1 --2- 172.21.15.103:0/2388782694 >> v2:172.21.15.103:3300/0 conn(0x7f065c0ac950 0x7f065c14bf50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0654007e80 tx=0x7f0654011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.961 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.948+0000 7f0661a8f700 1 --2- 172.21.15.103:0/2388782694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f065c0ac950 0x7f065c14bf50 secure :-1 s=READY pgs=1266 cs=0 l=1 rx=0x7f0654007e80 tx=0x7f0654011020).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:36.961 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.949+0000 7f0661a8f700 1 --2- 172.21.15.103:0/2388782694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f065c0ac950 0x7f065c14bf50 secure :-1 s=THROTTLE_DONE pgs=1266 cs=0 l=1 rx=0x7f0654007e80 tx=0x7f0654011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.961 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.949+0000 7f064effd700 1 -- 172.21.15.103:0/2388782694 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0654005e30 con 0x7f065c0ac950 2020-04-22T14:13:36.961 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.949+0000 7f0661a8f700 1 --2- 172.21.15.103:0/2388782694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f065c0ac950 0x7f065c14bf50 secure :-1 s=THROTTLE_DONE pgs=1266 cs=0 l=1 rx=0x7f0654007e80 tx=0x7f0654011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.961 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.949+0000 7f064effd700 1 -- 172.21.15.103:0/2388782694 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0654007560 con 0x7f065c0ac950 2020-04-22T14:13:36.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.949+0000 7f0661a8f700 1 --2- 172.21.15.103:0/2388782694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f065c0ac950 0x7f065c14bf50 secure :-1 s=THROTTLE_DONE pgs=1266 cs=0 l=1 rx=0x7f0654007e80 tx=0x7f0654011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.949+0000 7f064effd700 1 -- 172.21.15.103:0/2388782694 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06540078c0 con 0x7f065c0ac950 2020-04-22T14:13:36.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.949+0000 7f0663cf3700 1 -- 172.21.15.103:0/2388782694 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f065c13fa00 con 0x7f065c0ac950 2020-04-22T14:13:36.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.949+0000 7f0663cf3700 1 -- 172.21.15.103:0/2388782694 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f065c13ca30 con 0x7f065c0ac950 2020-04-22T14:13:36.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.949+0000 7f0661a8f700 1 --2- 172.21.15.103:0/2388782694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f065c0ac950 0x7f065c14bf50 secure :-1 s=THROTTLE_DONE pgs=1266 cs=0 l=1 rx=0x7f0654007e80 tx=0x7f0654011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.950+0000 7f064effd700 1 -- 172.21.15.103:0/2388782694 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f06540101a0 con 0x7f065c0ac950 2020-04-22T14:13:36.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.950+0000 7f0661a8f700 1 --2- 172.21.15.103:0/2388782694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f065c0ac950 0x7f065c14bf50 secure :-1 s=THROTTLE_DONE pgs=1266 cs=0 l=1 rx=0x7f0654007e80 tx=0x7f0654011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.950+0000 7f0663cf3700 1 -- 172.21.15.103:0/2388782694 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f065c05ee00 con 0x7f065c0ac950 2020-04-22T14:13:36.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.950+0000 7f064effd700 1 --2- 172.21.15.103:0/2388782694 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f063c04d7f0 0x7f063c04fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:36.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.950+0000 7f064effd700 1 -- 172.21.15.103:0/2388782694 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f06540615f0 con 0x7f065c0ac950 2020-04-22T14:13:36.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.950+0000 7f066128e700 1 --2- 172.21.15.103:0/2388782694 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f063c04d7f0 0x7f063c04fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:36.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.950+0000 7f066128e700 1 --2- 172.21.15.103:0/2388782694 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f063c04d7f0 0x7f063c04fcb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0658007a40 tx=0x7f06580024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.950+0000 7f066128e700 1 --2- 172.21.15.103:0/2388782694 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f063c04d7f0 0x7f063c04fcb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0658007a40 tx=0x7f06580024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.950+0000 7f066128e700 1 --2- 172.21.15.103:0/2388782694 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f063c04d7f0 0x7f063c04fcb0 secure :-1 s=READY pgs=466 cs=0 l=1 rx=0x7f0658007a40 tx=0x7f06580024d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:36.964 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.954+0000 7f0661a8f700 1 --2- 172.21.15.103:0/2388782694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f065c0ac950 0x7f065c14bf50 secure :-1 s=THROTTLE_DONE pgs=1266 cs=0 l=1 rx=0x7f0654007e80 tx=0x7f0654011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:36.964 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:36.954+0000 7f064effd700 1 -- 172.21.15.103:0/2388782694 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f065c05ee00 con 0x7f065c0ac950 2020-04-22T14:13:37.099 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.096+0000 7f0663cf3700 1 -- 172.21.15.103:0/2388782694 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f065c05ee00 con 0x7f065c0ac950 2020-04-22T14:13:37.099 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.097+0000 7f0661a8f700 1 --2- 172.21.15.103:0/2388782694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f065c0ac950 0x7f065c14bf50 secure :-1 s=THROTTLE_DONE pgs=1266 cs=0 l=1 rx=0x7f0654007e80 tx=0x7f0654011020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:37.099 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.097+0000 7f064effd700 1 -- 172.21.15.103:0/2388782694 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v80) v1 ==== 104+0+10 (secure 0 0 0) 0x7f065c05ee00 con 0x7f065c0ac950 2020-04-22T14:13:37.100 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:13:37.101 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.098+0000 7f0663cf3700 1 -- 172.21.15.103:0/2388782694 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f063c04d7f0 msgr2=0x7f063c04fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:37.101 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.098+0000 7f0663cf3700 1 --2- 172.21.15.103:0/2388782694 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f063c04d7f0 0x7f063c04fcb0 secure :-1 s=READY pgs=466 cs=0 l=1 rx=0x7f0658007a40 tx=0x7f06580024d0).stop 2020-04-22T14:13:37.101 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.098+0000 7f0663cf3700 1 -- 172.21.15.103:0/2388782694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f065c0ac950 msgr2=0x7f065c14bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:37.101 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.098+0000 7f0663cf3700 1 --2- 172.21.15.103:0/2388782694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f065c0ac950 0x7f065c14bf50 secure :-1 s=READY pgs=1266 cs=0 l=1 rx=0x7f0654007e80 tx=0x7f0654011020).stop 2020-04-22T14:13:37.101 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.098+0000 7f0663cf3700 1 -- 172.21.15.103:0/2388782694 shutdown_connections 2020-04-22T14:13:37.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.098+0000 7f0663cf3700 1 --2- 172.21.15.103:0/2388782694 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f063c04d7f0 0x7f063c04fcb0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:37.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.098+0000 7f0663cf3700 1 --2- 172.21.15.103:0/2388782694 >> v2:172.21.15.86:3300/0 conn(0x7f065c146c40 0x7f065c126e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:37.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.098+0000 7f0663cf3700 1 --2- 172.21.15.103:0/2388782694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f065c0ac950 0x7f065c14bf50 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:37.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.098+0000 7f0663cf3700 1 -- 172.21.15.103:0/2388782694 >> 172.21.15.103:0/2388782694 conn(0x7f065c05b7b0 msgr2=0x7f065c062040 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:37.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.098+0000 7f0663cf3700 1 -- 172.21.15.103:0/2388782694 shutdown_connections 2020-04-22T14:13:37.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.098+0000 7f0663cf3700 1 -- 172.21.15.103:0/2388782694 wait complete. 2020-04-22T14:13:37.116 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:37.140 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-22T14:13:37.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.286+0000 7f6121b37700 1 Processor -- start 2020-04-22T14:13:37.289 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.286+0000 7f6121b37700 1 -- start start 2020-04-22T14:13:37.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.287+0000 7f6121b37700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f611c0b4820 0x7f611c0acb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:37.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.287+0000 7f6121b37700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f611c141f20 0x7f611c142380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:37.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.287+0000 7f6121b37700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f611c0af030 con 0x7f611c061a30 2020-04-22T14:13:37.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.287+0000 7f6121b37700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f611c060250 con 0x7f611c0b4820 2020-04-22T14:13:37.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.287+0000 7f6121b37700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f611c0623c0 con 0x7f611c141f20 2020-04-22T14:13:37.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.287+0000 7f611affd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f611c0b4820 0x7f611c0acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:37.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.287+0000 7f611b7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f611c061a30 0x7f611c0ae920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46056/0 (socket says 172.21.15.103:46056) 2020-04-22T14:13:37.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.287+0000 7f611b7fe700 1 -- 172.21.15.103:0/796184566 learned_addr learned my addr 172.21.15.103:0/796184566 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:37.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.288+0000 7f611bfff700 1 --2- 172.21.15.103:0/796184566 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f611c141f20 0x7f611c142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:37.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.288+0000 7f611affd700 1 -- 172.21.15.103:0/796184566 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f611c141f20 msgr2=0x7f611c142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:37.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.288+0000 7f611affd700 1 --2- 172.21.15.103:0/796184566 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f611c141f20 0x7f611c142380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:37.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.288+0000 7f611affd700 1 -- 172.21.15.103:0/796184566 >> v1:172.21.15.103:6789/0 conn(0x7f611c061a30 legacy=0x7f611c0ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:37.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.288+0000 7f611a7fc700 1 -- 172.21.15.103:0/796184566 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2695157245 0 0) 0x7f611c0af030 con 0x7f611c061a30 2020-04-22T14:13:37.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.288+0000 7f611affd700 1 -- 172.21.15.103:0/796184566 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f611c062660 con 0x7f611c0b4820 2020-04-22T14:13:37.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.288+0000 7f611affd700 1 --2- 172.21.15.103:0/796184566 >> v2:172.21.15.103:3300/0 conn(0x7f611c0b4820 0x7f611c0acb10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6110002f30 tx=0x7f6110007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:37.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.288+0000 7f611affd700 1 --2- 172.21.15.103:0/796184566 >> v2:172.21.15.103:3300/0 conn(0x7f611c0b4820 0x7f611c0acb10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6110002f30 tx=0x7f6110007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:37.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.288+0000 7f611affd700 1 --2- 172.21.15.103:0/796184566 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f611c0b4820 0x7f611c0acb10 secure :-1 s=READY pgs=1268 cs=0 l=1 rx=0x7f6110002f30 tx=0x7f6110007a40).ready entity=mon.1 client_cookie=2ab08b18ae366dab server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:37.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.288+0000 7f611affd700 1 --2- 172.21.15.103:0/796184566 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f611c0b4820 0x7f611c0acb10 secure :-1 s=THROTTLE_DONE pgs=1268 cs=0 l=1 rx=0x7f6110002f30 tx=0x7f6110007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:37.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.288+0000 7f611a7fc700 1 -- 172.21.15.103:0/796184566 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6110012580 con 0x7f611c0b4820 2020-04-22T14:13:37.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.288+0000 7f611affd700 1 --2- 172.21.15.103:0/796184566 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f611c0b4820 0x7f611c0acb10 secure :-1 s=THROTTLE_DONE pgs=1268 cs=0 l=1 rx=0x7f6110002f30 tx=0x7f6110007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:37.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.288+0000 7f611a7fc700 1 -- 172.21.15.103:0/796184566 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6110012720 con 0x7f611c0b4820 2020-04-22T14:13:37.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.288+0000 7f611affd700 1 --2- 172.21.15.103:0/796184566 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f611c0b4820 0x7f611c0acb10 secure :-1 s=THROTTLE_DONE pgs=1268 cs=0 l=1 rx=0x7f6110002f30 tx=0x7f6110007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:37.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.288+0000 7f611a7fc700 1 -- 172.21.15.103:0/796184566 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6110012b00 con 0x7f611c0b4820 2020-04-22T14:13:37.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.288+0000 7f6121b37700 1 -- 172.21.15.103:0/796184566 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f611c0b4820 msgr2=0x7f611c0acb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:37.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.288+0000 7f6121b37700 1 --2- 172.21.15.103:0/796184566 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f611c0b4820 0x7f611c0acb10 secure :-1 s=READY pgs=1268 cs=0 l=1 rx=0x7f6110002f30 tx=0x7f6110007a40).stop 2020-04-22T14:13:37.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.288+0000 7f6121b37700 1 -- 172.21.15.103:0/796184566 shutdown_connections 2020-04-22T14:13:37.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.288+0000 7f6121b37700 1 --2- 172.21.15.103:0/796184566 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f611c141f20 0x7f611c142380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:37.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.288+0000 7f6121b37700 1 --2- 172.21.15.103:0/796184566 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f611c0b4820 0x7f611c0acb10 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:37.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.288+0000 7f6121b37700 1 -- 172.21.15.103:0/796184566 >> 172.21.15.103:0/796184566 conn(0x7f611c05b7b0 msgr2=0x7f611c0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:37.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.288+0000 7f6121b37700 1 -- 172.21.15.103:0/796184566 shutdown_connections 2020-04-22T14:13:37.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.288+0000 7f6121b37700 1 -- 172.21.15.103:0/796184566 wait complete. 2020-04-22T14:13:37.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.289+0000 7f6121b37700 1 Processor -- start 2020-04-22T14:13:37.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.290+0000 7f6121b37700 1 -- start start 2020-04-22T14:13:37.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.290+0000 7f6121b37700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f611c061a30 0x7f611c062a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:37.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.290+0000 7f6121b37700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f611c0b4820 0x7f611c0b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:37.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.290+0000 7f6121b37700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f611c0b1fe0 con 0x7f611c141f20 2020-04-22T14:13:37.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.290+0000 7f6121b37700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f611c154a00 con 0x7f611c061a30 2020-04-22T14:13:37.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.290+0000 7f6121b37700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f611c0634c0 con 0x7f611c0b4820 2020-04-22T14:13:37.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.290+0000 7f611bfff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f611c141f20 0x7f611c140360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46064/0 (socket says 172.21.15.103:46064) 2020-04-22T14:13:37.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.290+0000 7f611bfff700 1 -- 172.21.15.103:0/2068218906 learned_addr learned my addr 172.21.15.103:0/2068218906 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:37.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.290+0000 7f611b7fe700 1 --2- 172.21.15.103:0/2068218906 >> v2:172.21.15.86:3300/0 conn(0x7f611c061a30 0x7f611c062a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:37.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.291+0000 7f611affd700 1 --2- 172.21.15.103:0/2068218906 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f611c0b4820 0x7f611c0b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:37.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.291+0000 7f6118ff9700 1 -- 172.21.15.103:0/2068218906 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 129882143 0 0) 0x7f61140013b0 con 0x7f611c141f20 2020-04-22T14:13:37.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.291+0000 7f6118ff9700 1 -- 172.21.15.103:0/2068218906 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60fc002fe0 con 0x7f611c141f20 2020-04-22T14:13:37.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.291+0000 7f6118ff9700 1 -- 172.21.15.103:0/2068218906 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3651422663 0 0) 0x7f60fc002fe0 con 0x7f611c141f20 2020-04-22T14:13:37.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.291+0000 7f6118ff9700 1 -- 172.21.15.103:0/2068218906 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f61140013b0 con 0x7f611c141f20 2020-04-22T14:13:37.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.291+0000 7f6118ff9700 1 -- 172.21.15.103:0/2068218906 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f6114001c80 con 0x7f611c141f20 2020-04-22T14:13:37.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.291+0000 7f6118ff9700 1 -- 172.21.15.103:0/2068218906 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f611c0b4820 msgr2=0x7f611c0b1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:37.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.291+0000 7f6118ff9700 1 --2- 172.21.15.103:0/2068218906 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f611c0b4820 0x7f611c0b1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:37.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.291+0000 7f6118ff9700 1 -- 172.21.15.103:0/2068218906 >> v2:172.21.15.86:3300/0 conn(0x7f611c061a30 msgr2=0x7f611c062a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:37.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.291+0000 7f6118ff9700 1 --2- 172.21.15.103:0/2068218906 >> v2:172.21.15.86:3300/0 conn(0x7f611c061a30 0x7f611c062a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:37.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.291+0000 7f6118ff9700 1 -- 172.21.15.103:0/2068218906 >> v1:172.21.15.103:6789/0 conn(0x7f611c141f20 legacy=0x7f611c140360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:37.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.291+0000 7f6118ff9700 1 --2- 172.21.15.103:0/2068218906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f60fc0049b0 0x7f60fc004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:37.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.291+0000 7f6118ff9700 1 --2- 172.21.15.103:0/2068218906 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60fc003920 0x7f60fc003d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:37.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.291+0000 7f6118ff9700 1 --2- 172.21.15.103:0/2068218906 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f60fc0041c0 0x7f60fc00b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:37.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.291+0000 7f6118ff9700 1 -- 172.21.15.103:0/2068218906 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611c154a00 con 0x7f60fc0049b0 2020-04-22T14:13:37.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.291+0000 7f6118ff9700 1 -- 172.21.15.103:0/2068218906 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611c0634c0 con 0x7f60fc003920 2020-04-22T14:13:37.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.291+0000 7f6118ff9700 1 -- 172.21.15.103:0/2068218906 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc0046f0 con 0x7f60fc0041c0 2020-04-22T14:13:37.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.291+0000 7f611affd700 1 --2- 172.21.15.103:0/2068218906 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f611c0b4820 0x7f611c0b1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:13:37.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.291+0000 7f611b7fe700 1 --2- 172.21.15.103:0/2068218906 >> v2:172.21.15.86:3300/0 conn(0x7f611c061a30 0x7f611c062a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:13:37.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.291+0000 7f611affd700 1 --2- 172.21.15.103:0/2068218906 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60fc003920 0x7f60fc003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:37.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.291+0000 7f611bfff700 1 --2- 172.21.15.103:0/2068218906 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f60fc0041c0 0x7f60fc00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:37.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.291+0000 7f611b7fe700 1 --2- 172.21.15.103:0/2068218906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f60fc0049b0 0x7f60fc004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:37.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.291+0000 7f611affd700 1 -- 172.21.15.103:0/2068218906 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f60fc0041c0 msgr2=0x7f60fc00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:37.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.291+0000 7f611affd700 1 --2- 172.21.15.103:0/2068218906 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f60fc0041c0 0x7f60fc00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:37.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.291+0000 7f611affd700 1 -- 172.21.15.103:0/2068218906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f60fc0049b0 msgr2=0x7f60fc004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:37.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.291+0000 7f611affd700 1 --2- 172.21.15.103:0/2068218906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f60fc0049b0 0x7f60fc004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:37.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.291+0000 7f611affd700 1 -- 172.21.15.103:0/2068218906 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f611c063760 con 0x7f60fc003920 2020-04-22T14:13:37.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.291+0000 7f6121b37700 1 -- 172.21.15.103:0/2068218906 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f611c063a00 con 0x7f60fc003920 2020-04-22T14:13:37.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.291+0000 7f611affd700 1 --2- 172.21.15.103:0/2068218906 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60fc003920 0x7f60fc003d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6110002f30 tx=0x7f6110007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:37.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.291+0000 7f6121b37700 1 -- 172.21.15.103:0/2068218906 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f611c063ea0 con 0x7f60fc003920 2020-04-22T14:13:37.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.291+0000 7f611affd700 1 --2- 172.21.15.103:0/2068218906 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60fc003920 0x7f60fc003d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6110002f30 tx=0x7f6110007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:37.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.291+0000 7f611affd700 1 --2- 172.21.15.103:0/2068218906 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60fc003920 0x7f60fc003d60 secure :-1 s=READY pgs=1270 cs=0 l=1 rx=0x7f6110002f30 tx=0x7f6110007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:37.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.292+0000 7f611affd700 1 --2- 172.21.15.103:0/2068218906 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60fc003920 0x7f60fc003d60 secure :-1 s=THROTTLE_DONE pgs=1270 cs=0 l=1 rx=0x7f6110002f30 tx=0x7f6110007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:37.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.292+0000 7f611affd700 1 --2- 172.21.15.103:0/2068218906 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60fc003920 0x7f60fc003d60 secure :-1 s=THROTTLE_DONE pgs=1270 cs=0 l=1 rx=0x7f6110002f30 tx=0x7f6110007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:37.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.292+0000 7f6118ff9700 1 -- 172.21.15.103:0/2068218906 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6110012ba0 con 0x7f60fc003920 2020-04-22T14:13:37.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.292+0000 7f611affd700 1 --2- 172.21.15.103:0/2068218906 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60fc003920 0x7f60fc003d60 secure :-1 s=THROTTLE_DONE pgs=1270 cs=0 l=1 rx=0x7f6110002f30 tx=0x7f6110007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:37.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.292+0000 7f6118ff9700 1 -- 172.21.15.103:0/2068218906 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6110007360 con 0x7f60fc003920 2020-04-22T14:13:37.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.292+0000 7f6118ff9700 1 -- 172.21.15.103:0/2068218906 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61100058b0 con 0x7f60fc003920 2020-04-22T14:13:37.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.292+0000 7f611affd700 1 --2- 172.21.15.103:0/2068218906 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60fc003920 0x7f60fc003d60 secure :-1 s=THROTTLE_DONE pgs=1270 cs=0 l=1 rx=0x7f6110002f30 tx=0x7f6110007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:37.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.292+0000 7f6121b37700 1 -- 172.21.15.103:0/2068218906 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f8003340 con 0x7f60fc003920 2020-04-22T14:13:37.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.292+0000 7f6118ff9700 1 -- 172.21.15.103:0/2068218906 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f6110005a10 con 0x7f60fc003920 2020-04-22T14:13:37.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.292+0000 7f611affd700 1 --2- 172.21.15.103:0/2068218906 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60fc003920 0x7f60fc003d60 secure :-1 s=THROTTLE_DONE pgs=1270 cs=0 l=1 rx=0x7f6110002f30 tx=0x7f6110007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:37.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.293+0000 7f6118ff9700 1 --2- 172.21.15.103:0/2068218906 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f60fc056040 0x7f60fc058500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:37.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.293+0000 7f6118ff9700 1 -- 172.21.15.103:0/2068218906 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f6110061ec0 con 0x7f60fc003920 2020-04-22T14:13:37.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.293+0000 7f611b7fe700 1 --2- 172.21.15.103:0/2068218906 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f60fc056040 0x7f60fc058500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:37.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.293+0000 7f611b7fe700 1 --2- 172.21.15.103:0/2068218906 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f60fc056040 0x7f60fc058500 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f610c000b80 tx=0x7f610c00f700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:37.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.293+0000 7f611b7fe700 1 --2- 172.21.15.103:0/2068218906 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f60fc056040 0x7f60fc058500 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f610c000b80 tx=0x7f610c00f700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:37.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.293+0000 7f611b7fe700 1 --2- 172.21.15.103:0/2068218906 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f60fc056040 0x7f60fc058500 secure :-1 s=READY pgs=467 cs=0 l=1 rx=0x7f610c000b80 tx=0x7f610c00f700).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:37.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.297+0000 7f611affd700 1 --2- 172.21.15.103:0/2068218906 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60fc003920 0x7f60fc003d60 secure :-1 s=THROTTLE_DONE pgs=1270 cs=0 l=1 rx=0x7f6110002f30 tx=0x7f6110007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:37.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.297+0000 7f6118ff9700 1 -- 172.21.15.103:0/2068218906 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f611003d3c0 con 0x7f60fc003920 2020-04-22T14:13:37.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.440+0000 7f6121b37700 1 -- 172.21.15.103:0/2068218906 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f60f8002200 con 0x7f60fc003920 2020-04-22T14:13:37.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.440+0000 7f611affd700 1 --2- 172.21.15.103:0/2068218906 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60fc003920 0x7f60fc003d60 secure :-1 s=THROTTLE_DONE pgs=1270 cs=0 l=1 rx=0x7f6110002f30 tx=0x7f6110007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:37.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.440+0000 7f6118ff9700 1 -- 172.21.15.103:0/2068218906 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v80) v1 ==== 100+0+10 (secure 0 0 0) 0x7f61100409e0 con 0x7f60fc003920 2020-04-22T14:13:37.443 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:13:37.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.442+0000 7f6121b37700 1 -- 172.21.15.103:0/2068218906 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f60fc056040 msgr2=0x7f60fc058500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:37.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.442+0000 7f6121b37700 1 --2- 172.21.15.103:0/2068218906 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f60fc056040 0x7f60fc058500 secure :-1 s=READY pgs=467 cs=0 l=1 rx=0x7f610c000b80 tx=0x7f610c00f700).stop 2020-04-22T14:13:37.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.442+0000 7f6121b37700 1 -- 172.21.15.103:0/2068218906 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60fc003920 msgr2=0x7f60fc003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:37.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.442+0000 7f6121b37700 1 --2- 172.21.15.103:0/2068218906 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60fc003920 0x7f60fc003d60 secure :-1 s=READY pgs=1270 cs=0 l=1 rx=0x7f6110002f30 tx=0x7f6110007a40).stop 2020-04-22T14:13:37.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.442+0000 7f611bfff700 1 -- 172.21.15.103:0/2068218906 reap_dead start 2020-04-22T14:13:37.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.442+0000 7f611bfff700 1 -- 172.21.15.103:0/2068218906 reap_dead start 2020-04-22T14:13:37.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.442+0000 7f6121b37700 1 -- 172.21.15.103:0/2068218906 shutdown_connections 2020-04-22T14:13:37.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.442+0000 7f6121b37700 1 -- 172.21.15.103:0/2068218906 >> 172.21.15.103:0/2068218906 conn(0x7f611c05b7b0 msgr2=0x7f611c145450 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:37.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.442+0000 7f6121b37700 1 -- 172.21.15.103:0/2068218906 shutdown_connections 2020-04-22T14:13:37.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.442+0000 7f6121b37700 1 -- 172.21.15.103:0/2068218906 wait complete. 2020-04-22T14:13:37.454 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-04-22T14:13:37.454 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:37.467 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:13:37.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.623+0000 7f6d8fd32700 1 Processor -- start 2020-04-22T14:13:37.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.623+0000 7f6d8fd32700 1 -- start start 2020-04-22T14:13:37.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.624+0000 7f6d8fd32700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6d881403f0 0x7f6d8805f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:37.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.624+0000 7f6d8fd32700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6d881464a0 0x7f6d880629c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:37.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.624+0000 7f6d8fd32700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d88061fe0 con 0x7f6d880b56c0 2020-04-22T14:13:37.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.624+0000 7f6d8fd32700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d88062280 con 0x7f6d881464a0 2020-04-22T14:13:37.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.624+0000 7f6d8fd32700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d88062520 con 0x7f6d881403f0 2020-04-22T14:13:37.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.625+0000 7f6d8dace700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6d881403f0 0x7f6d8805f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:37.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.625+0000 7f6d8d2cd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6d881464a0 0x7f6d880629c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:37.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.625+0000 7f6d8d2cd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6d881464a0 0x7f6d880629c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:51116/0 (socket says 172.21.15.103:51116) 2020-04-22T14:13:37.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.625+0000 7f6d8dace700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6d881403f0 0x7f6d8805f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:38662/0 (socket says 172.21.15.103:38662) 2020-04-22T14:13:37.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.625+0000 7f6d8d2cd700 1 -- 172.21.15.103:0/1759868174 learned_addr learned my addr 172.21.15.103:0/1759868174 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:37.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.625+0000 7f6d8d2cd700 1 -- 172.21.15.103:0/1759868174 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6d881403f0 msgr2=0x7f6d8805f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:37.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.625+0000 7f6d8d2cd700 1 --2- 172.21.15.103:0/1759868174 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6d881403f0 0x7f6d8805f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:37.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.625+0000 7f6d8d2cd700 1 -- 172.21.15.103:0/1759868174 >> v1:172.21.15.86:6789/0 conn(0x7f6d880b56c0 legacy=0x7f6d880b3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:37.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.625+0000 7f6d8cacc700 1 -- 172.21.15.103:0/1759868174 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3119092217 0 0) 0x7f6d88061fe0 con 0x7f6d880b56c0 2020-04-22T14:13:37.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.625+0000 7f6d8d2cd700 1 -- 172.21.15.103:0/1759868174 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d880b51c0 con 0x7f6d881464a0 2020-04-22T14:13:37.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.625+0000 7f6d8dace700 1 --2- 172.21.15.103:0/1759868174 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6d881403f0 0x7f6d8805f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:13:37.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.625+0000 7f6d8d2cd700 1 --2- 172.21.15.103:0/1759868174 >> v2:172.21.15.86:3300/0 conn(0x7f6d881464a0 0x7f6d880629c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6d84002f30 tx=0x7f6d84007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:37.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.625+0000 7f6d8d2cd700 1 --2- 172.21.15.103:0/1759868174 >> v2:172.21.15.86:3300/0 conn(0x7f6d881464a0 0x7f6d880629c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6d84002f30 tx=0x7f6d84007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:37.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.625+0000 7f6d8d2cd700 1 --2- 172.21.15.103:0/1759868174 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d881464a0 0x7f6d880629c0 secure :-1 s=READY pgs=688 cs=0 l=1 rx=0x7f6d84002f30 tx=0x7f6d84007a40).ready entity=mon.0 client_cookie=5944e6c09000974f server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:37.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.625+0000 7f6d8d2cd700 1 --2- 172.21.15.103:0/1759868174 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d881464a0 0x7f6d880629c0 secure :-1 s=THROTTLE_DONE pgs=688 cs=0 l=1 rx=0x7f6d84002f30 tx=0x7f6d84007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:37.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.625+0000 7f6d8cacc700 1 -- 172.21.15.103:0/1759868174 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d84011670 con 0x7f6d881464a0 2020-04-22T14:13:37.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.625+0000 7f6d8d2cd700 1 --2- 172.21.15.103:0/1759868174 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d881464a0 0x7f6d880629c0 secure :-1 s=THROTTLE_DONE pgs=688 cs=0 l=1 rx=0x7f6d84002f30 tx=0x7f6d84007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:37.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.625+0000 7f6d8cacc700 1 -- 172.21.15.103:0/1759868174 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d84011810 con 0x7f6d881464a0 2020-04-22T14:13:37.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.625+0000 7f6d8d2cd700 1 --2- 172.21.15.103:0/1759868174 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d881464a0 0x7f6d880629c0 secure :-1 s=THROTTLE_DONE pgs=688 cs=0 l=1 rx=0x7f6d84002f30 tx=0x7f6d84007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:37.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.625+0000 7f6d8cacc700 1 -- 172.21.15.103:0/1759868174 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d84011bf0 con 0x7f6d881464a0 2020-04-22T14:13:37.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.625+0000 7f6d8fd32700 1 -- 172.21.15.103:0/1759868174 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d881464a0 msgr2=0x7f6d880629c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:37.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.625+0000 7f6d8fd32700 1 --2- 172.21.15.103:0/1759868174 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d881464a0 0x7f6d880629c0 secure :-1 s=READY pgs=688 cs=0 l=1 rx=0x7f6d84002f30 tx=0x7f6d84007a40).stop 2020-04-22T14:13:37.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.626+0000 7f6d8fd32700 1 -- 172.21.15.103:0/1759868174 shutdown_connections 2020-04-22T14:13:37.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.626+0000 7f6d8fd32700 1 --2- 172.21.15.103:0/1759868174 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6d881403f0 0x7f6d8805f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:37.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.626+0000 7f6d8fd32700 1 --2- 172.21.15.103:0/1759868174 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d881464a0 0x7f6d880629c0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:37.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.626+0000 7f6d8fd32700 1 -- 172.21.15.103:0/1759868174 >> 172.21.15.103:0/1759868174 conn(0x7f6d8805ad30 msgr2=0x7f6d8805b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:37.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.626+0000 7f6d8fd32700 1 -- 172.21.15.103:0/1759868174 shutdown_connections 2020-04-22T14:13:37.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.626+0000 7f6d8fd32700 1 -- 172.21.15.103:0/1759868174 wait complete. 2020-04-22T14:13:37.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.627+0000 7f6d8fd32700 1 Processor -- start 2020-04-22T14:13:37.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.627+0000 7f6d8fd32700 1 -- start start 2020-04-22T14:13:37.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.627+0000 7f6d8fd32700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6d880b56c0 0x7f6d88141da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:37.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.627+0000 7f6d8fd32700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6d881403f0 0x7f6d881488e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:37.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.627+0000 7f6d8fd32700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d88148d40 con 0x7f6d881464a0 2020-04-22T14:13:37.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.627+0000 7f6d8fd32700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d88142cc0 con 0x7f6d881403f0 2020-04-22T14:13:37.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.627+0000 7f6d8fd32700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d88142f60 con 0x7f6d880b56c0 2020-04-22T14:13:37.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.628+0000 7f6d8e2cf700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f6d881464a0 0x7f6d88157540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46084/0 (socket says 172.21.15.103:46084) 2020-04-22T14:13:37.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.628+0000 7f6d8e2cf700 1 -- 172.21.15.103:0/123652738 learned_addr learned my addr 172.21.15.103:0/123652738 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:37.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.628+0000 7f6d8d2cd700 1 --2- 172.21.15.103:0/123652738 >> v2:172.21.15.86:3300/0 conn(0x7f6d881403f0 0x7f6d881488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:37.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.628+0000 7f6d8dace700 1 --2- 172.21.15.103:0/123652738 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6d880b56c0 0x7f6d88141da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:37.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.628+0000 7f6d7affd700 1 -- 172.21.15.103:0/123652738 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1643429154 0 0) 0x7f6d80001670 con 0x7f6d881464a0 2020-04-22T14:13:37.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.628+0000 7f6d7affd700 1 -- 172.21.15.103:0/123652738 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d68002fe0 con 0x7f6d881464a0 2020-04-22T14:13:37.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.628+0000 7f6d7affd700 1 -- 172.21.15.103:0/123652738 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1758821858 0 0) 0x7f6d68002fe0 con 0x7f6d881464a0 2020-04-22T14:13:37.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.628+0000 7f6d8d2cd700 1 -- 172.21.15.103:0/123652738 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6d880b56c0 msgr2=0x7f6d88141da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:37.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.628+0000 7f6d8d2cd700 1 --2- 172.21.15.103:0/123652738 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6d880b56c0 0x7f6d88141da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:37.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.628+0000 7f6d8d2cd700 1 -- 172.21.15.103:0/123652738 >> v1:172.21.15.103:6789/0 conn(0x7f6d881464a0 legacy=0x7f6d88157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:37.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.628+0000 7f6d8d2cd700 1 -- 172.21.15.103:0/123652738 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d880ad960 con 0x7f6d881403f0 2020-04-22T14:13:37.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.628+0000 7f6d8d2cd700 1 --2- 172.21.15.103:0/123652738 >> v2:172.21.15.86:3300/0 conn(0x7f6d881403f0 0x7f6d881488e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6d80002020 tx=0x7f6d84007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:37.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.628+0000 7f6d8d2cd700 1 --2- 172.21.15.103:0/123652738 >> v2:172.21.15.86:3300/0 conn(0x7f6d881403f0 0x7f6d881488e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6d80002020 tx=0x7f6d84007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:37.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.628+0000 7f6d8d2cd700 1 --2- 172.21.15.103:0/123652738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d881403f0 0x7f6d881488e0 secure :-1 s=READY pgs=689 cs=0 l=1 rx=0x7f6d80002020 tx=0x7f6d84007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:37.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.628+0000 7f6d8d2cd700 1 --2- 172.21.15.103:0/123652738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d881403f0 0x7f6d881488e0 secure :-1 s=THROTTLE_DONE pgs=689 cs=0 l=1 rx=0x7f6d80002020 tx=0x7f6d84007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:37.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.628+0000 7f6d7affd700 1 -- 172.21.15.103:0/123652738 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d80001e80 con 0x7f6d881403f0 2020-04-22T14:13:37.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.628+0000 7f6d8d2cd700 1 --2- 172.21.15.103:0/123652738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d881403f0 0x7f6d881488e0 secure :-1 s=THROTTLE_DONE pgs=689 cs=0 l=1 rx=0x7f6d80002020 tx=0x7f6d84007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:37.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.628+0000 7f6d7affd700 1 -- 172.21.15.103:0/123652738 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d84011ac0 con 0x7f6d881403f0 2020-04-22T14:13:37.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.628+0000 7f6d8d2cd700 1 --2- 172.21.15.103:0/123652738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d881403f0 0x7f6d881488e0 secure :-1 s=THROTTLE_DONE pgs=689 cs=0 l=1 rx=0x7f6d80002020 tx=0x7f6d84007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:37.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.628+0000 7f6d8fd32700 1 -- 172.21.15.103:0/123652738 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d880aee10 con 0x7f6d881403f0 2020-04-22T14:13:37.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.628+0000 7f6d7affd700 1 -- 172.21.15.103:0/123652738 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d84007170 con 0x7f6d881403f0 2020-04-22T14:13:37.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.628+0000 7f6d8fd32700 1 -- 172.21.15.103:0/123652738 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d88157e90 con 0x7f6d881403f0 2020-04-22T14:13:37.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.629+0000 7f6d8d2cd700 1 --2- 172.21.15.103:0/123652738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d881403f0 0x7f6d881488e0 secure :-1 s=THROTTLE_DONE pgs=689 cs=0 l=1 rx=0x7f6d80002020 tx=0x7f6d84007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:37.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.629+0000 7f6d8fd32700 1 -- 172.21.15.103:0/123652738 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d881583b0 con 0x7f6d881403f0 2020-04-22T14:13:37.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.630+0000 7f6d7affd700 1 -- 172.21.15.103:0/123652738 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f6d840080a0 con 0x7f6d881403f0 2020-04-22T14:13:37.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.630+0000 7f6d8d2cd700 1 --2- 172.21.15.103:0/123652738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d881403f0 0x7f6d881488e0 secure :-1 s=THROTTLE_DONE pgs=689 cs=0 l=1 rx=0x7f6d80002020 tx=0x7f6d84007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:37.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.630+0000 7f6d7affd700 1 --2- 172.21.15.103:0/123652738 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6d6804dcb0 0x7f6d68050170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:37.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.630+0000 7f6d7affd700 1 -- 172.21.15.103:0/123652738 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f6d840612f0 con 0x7f6d881403f0 2020-04-22T14:13:37.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.630+0000 7f6d8dace700 1 --2- 172.21.15.103:0/123652738 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6d6804dcb0 0x7f6d68050170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:37.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.630+0000 7f6d8dace700 1 --2- 172.21.15.103:0/123652738 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6d6804dcb0 0x7f6d68050170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6d7c002f30 tx=0x7f6d7c00eba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:37.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.630+0000 7f6d8dace700 1 --2- 172.21.15.103:0/123652738 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6d6804dcb0 0x7f6d68050170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6d7c002f30 tx=0x7f6d7c00eba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:37.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.630+0000 7f6d8dace700 1 --2- 172.21.15.103:0/123652738 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6d6804dcb0 0x7f6d68050170 secure :-1 s=READY pgs=468 cs=0 l=1 rx=0x7f6d7c002f30 tx=0x7f6d7c00eba0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:37.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.633+0000 7f6d8d2cd700 1 --2- 172.21.15.103:0/123652738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d881403f0 0x7f6d881488e0 secure :-1 s=THROTTLE_DONE pgs=689 cs=0 l=1 rx=0x7f6d80002020 tx=0x7f6d84007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:37.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.633+0000 7f6d7affd700 1 -- 172.21.15.103:0/123652738 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f6d881583b0 con 0x7f6d881403f0 2020-04-22T14:13:37.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.820+0000 7f6d8fd32700 1 -- 172.21.15.103:0/123652738 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d881583b0 con 0x7f6d881403f0 2020-04-22T14:13:37.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.820+0000 7f6d8d2cd700 1 --2- 172.21.15.103:0/123652738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d881403f0 0x7f6d881488e0 secure :-1 s=THROTTLE_DONE pgs=689 cs=0 l=1 rx=0x7f6d80002020 tx=0x7f6d84007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:37.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.820+0000 7f6d7affd700 1 -- 172.21.15.103:0/123652738 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+2145 (secure 0 0 0) 0x7f6d881583b0 con 0x7f6d881403f0 2020-04-22T14:13:37.823 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:13:37.823 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":56,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:13:34.470492+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":16,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:13:37.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.822+0000 7f6d8fd32700 1 -- 172.21.15.103:0/123652738 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6d6804dcb0 msgr2=0x7f6d68050170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:37.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.822+0000 7f6d8fd32700 1 --2- 172.21.15.103:0/123652738 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6d6804dcb0 0x7f6d68050170 secure :-1 s=READY pgs=468 cs=0 l=1 rx=0x7f6d7c002f30 tx=0x7f6d7c00eba0).stop 2020-04-22T14:13:37.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.822+0000 7f6d8fd32700 1 -- 172.21.15.103:0/123652738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d881403f0 msgr2=0x7f6d881488e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:37.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.822+0000 7f6d8fd32700 1 --2- 172.21.15.103:0/123652738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d881403f0 0x7f6d881488e0 secure :-1 s=READY pgs=689 cs=0 l=1 rx=0x7f6d80002020 tx=0x7f6d84007a40).stop 2020-04-22T14:13:37.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.822+0000 7f6d8fd32700 1 -- 172.21.15.103:0/123652738 shutdown_connections 2020-04-22T14:13:37.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.822+0000 7f6d8fd32700 1 --2- 172.21.15.103:0/123652738 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6d880b56c0 0x7f6d88141da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:37.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.822+0000 7f6d8fd32700 1 --2- 172.21.15.103:0/123652738 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6d6804dcb0 0x7f6d68050170 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:37.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.822+0000 7f6d8fd32700 1 --2- 172.21.15.103:0/123652738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d881403f0 0x7f6d881488e0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:37.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.822+0000 7f6d8fd32700 1 -- 172.21.15.103:0/123652738 >> 172.21.15.103:0/123652738 conn(0x7f6d8805ad30 msgr2=0x7f6d881499e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:37.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.822+0000 7f6d8fd32700 1 -- 172.21.15.103:0/123652738 shutdown_connections 2020-04-22T14:13:37.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:37.822+0000 7f6d8fd32700 1 -- 172.21.15.103:0/123652738 wait complete. 2020-04-22T14:13:37.828 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 56 2020-04-22T14:13:38.037 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 7291}, u'last_failure_osd_epoch': 78, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 13, u'failed': [], u'epoch': 56, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [14], u'info': {u'gid_7291': {u'export_targets': [], u'name': u'a', u'incarnation': 53, u'state_seq': 16, u'state': u'up:active', u'gid': 7291, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 3831800052, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 3831800052, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/3831800052'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:12:18.873897+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:13:34.470492+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:13:38.037 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:13:38.038 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:38.053 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:13:38.211 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:13:38.211 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:13:38.211 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:13:38.211 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 7291, 2020-04-22T14:13:38.211 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:13:38.212 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:13:38.212 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 55.636326801000003, 2020-04-22T14:13:38.212 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 56, 2020-04-22T14:13:38.212 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 80, 2020-04-22T14:13:38.212 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 80, 2020-04-22T14:13:38.212 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 55.868358639 2020-04-22T14:13:38.212 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:13:38.219 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 7291, "want_state": "up:active", "state": "up:active", "rank_uptime": 55.636326801000003, "mdsmap_epoch": 56, "osdmap_epoch": 80, "osdmap_epoch_barrier": 80, "uptime": 55.868358639 } 2020-04-22T14:13:38.219 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-04-22T14:13:38.220 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-04-22T14:13:38.220 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:38.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:38.234 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:13:38.306 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:13:38.307 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:13:38.307 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:13:38.307 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:13:38.307 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:13:38.307 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:13:38.308 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:13:38.308 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:13:38.308 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:13:38.308 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:13:38.308 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:13:38.309 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:13:38.309 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:13:38.309 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:13:38.309 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:13:38.309 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42022sec preferred_lft 42022sec 2020-04-22T14:13:38.309 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:13:38.309 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:13:38.309 INFO:teuthology.orchestra.run.smithi103.stdout:25: brx.1@if2: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:13:38.310 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether ce:89:5a:9a:cb:19 brd ff:ff:ff:ff:ff:ff link-netnsid 1 2020-04-22T14:13:38.310 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-04-22T14:13:38.310 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:38.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:38.345 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:13:38.421 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:38.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:38.472 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge con-name ceph-brx ifname ceph-brx stp no' 2020-04-22T14:13:38.579 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' (d423371d-7f09-4eaa-9d17-d8ef64d99065) successfully added. 2020-04-22T14:13:38.579 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:38.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:38.594 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection modify ceph-brx ipv4.addresses 192.168.255.254/16 ipv4.method manual' 2020-04-22T14:13:38.705 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:38.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:38.747 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up ceph-brx' 2020-04-22T14:13:38.855 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (master waiting for slaves) (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/32) 2020-04-22T14:13:38.855 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:38.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:38.870 INFO:teuthology.orchestra.run.smithi103:> touch /tmp/python-ceph-brx 2020-04-22T14:13:38.929 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:38.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:38.977 INFO:teuthology.orchestra.run.smithi103:> cat /proc/sys/net/ipv4/ip_forward 2020-04-22T14:13:39.035 INFO:teuthology.orchestra.run.smithi103.stdout:0 2020-04-22T14:13:39.035 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:39.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:39.086 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 0 > /tmp/python-ceph-brx' 2020-04-22T14:13:39.178 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:39.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:39.224 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 1 > /proc/sys/net/ipv4/ip_forward' 2020-04-22T14:13:39.299 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:39.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:39.347 INFO:teuthology.orchestra.run.smithi103:> route 2020-04-22T14:13:39.410 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2020-04-22T14:13:39.410 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-04-22T14:13:39.410 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 102 0 0 enp3s0f1 2020-04-22T14:13:39.410 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 102 0 0 enp3s0f1 2020-04-22T14:13:39.410 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 425 0 0 ceph-brx 2020-04-22T14:13:39.411 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:39.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:39.457 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-04-22T14:13:39.537 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:39.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:39.579 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-04-22T14:13:39.654 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:39.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:39.705 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-04-22T14:13:39.780 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:39.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:39.827 INFO:teuthology.orchestra.run.smithi103:> ip netns list 2020-04-22T14:13:39.886 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:39.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:39.935 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:13:39.988 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 1 2020-04-22T14:13:39.989 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:40.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:40.041 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:13:40.122 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:40.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:40.172 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0' 2020-04-22T14:13:40.247 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2020-04-22T14:13:40.248 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:40.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:40.293 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0' 2020-04-22T14:13:40.369 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:40.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:40.416 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0' 2020-04-22T14:13:40.501 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:40.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:40.554 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up' 2020-04-22T14:13:40.665 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:40.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:40.679 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up' 2020-04-22T14:13:40.789 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:40.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:40.804 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254' 2020-04-22T14:13:40.912 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:40.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:40.929 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:13:41.005 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:41.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:41.056 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge-slave con-name brx.0 ifname brx.0 master ceph-brx' 2020-04-22T14:13:41.172 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.0' (372f62b6-7594-4e62-85ea-18b4d4af9953) successfully added. 2020-04-22T14:13:41.172 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:41.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:41.202 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up brx.0' 2020-04-22T14:13:41.363 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/33) 2020-04-22T14:13:41.414 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2020-04-22T14:13:41.414 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi103.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2020-04-22T14:13:41.414 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:41.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:13:41.440 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:13:41.496 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:41.549 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:13:41.549 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:13:41.617 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:13:41.624 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:13:41.625 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:41.670 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:13:41.670 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:13:41.730 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-04-22T14:13:41.731 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:41.778 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:13:41.821 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:41.835 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:13:41.835 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:13:41.903 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:13:41.910 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:13:41.911 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:41.911 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:2020-04-22T14:13:41.908+0000 7ff37955f1c0 -1 init, newargv = 0x5563fd60c9a0 newargc=9 2020-04-22T14:13:41.912 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[84283]: starting ceph client 2020-04-22T14:13:41.916 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[84283]: starting fuse 2020-04-22T14:13:41.927 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:13:41.927 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:13:41.988 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:13:41.988 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2020-04-22T14:13:41.988 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:42.034 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:13:42.034 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:13:42.035 INFO:teuthology.orchestra.run.smithi103:> import glob 2020-04-22T14:13:42.035 INFO:teuthology.orchestra.run.smithi103:> import re 2020-04-22T14:13:42.035 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:13:42.035 INFO:teuthology.orchestra.run.smithi103:> import subprocess 2020-04-22T14:13:42.035 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:13:42.035 INFO:teuthology.orchestra.run.smithi103:> def find_socket(client_name): 2020-04-22T14:13:42.035 INFO:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2020-04-22T14:13:42.035 INFO:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2020-04-22T14:13:42.036 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:13:42.036 INFO:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2020-04-22T14:13:42.036 INFO:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2020-04-22T14:13:42.036 INFO:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2020-04-22T14:13:42.036 INFO:teuthology.orchestra.run.smithi103:> return files[0] 2020-04-22T14:13:42.036 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:13:42.036 INFO:teuthology.orchestra.run.smithi103:> for f in files: 2020-04-22T14:13:42.036 INFO:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:13:42.037 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:13:42.037 INFO:teuthology.orchestra.run.smithi103:> return f 2020-04-22T14:13:42.037 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:13:42.037 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:13:42.037 INFO:teuthology.orchestra.run.smithi103:> print(find_socket("client.1")) 2020-04-22T14:13:42.037 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:13:42.143 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.1.84283.asok 2020-04-22T14:13:42.143 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.84283.asok 2020-04-22T14:13:42.143 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:42.157 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:13:42.157 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.84283.asok status 2020-04-22T14:13:42.321 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:13:42.322 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2020-04-22T14:13:42.322 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:13:42.322 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:13:42.322 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "1", 2020-04-22T14:13:42.322 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:13:42.322 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2020-04-22T14:13:42.323 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "84283", 2020-04-22T14:13:42.323 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:13:42.323 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:42.323 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2020-04-22T14:13:42.323 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2020-04-22T14:13:42.323 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 7639, 2020-04-22T14:13:42.323 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2020-04-22T14:13:42.324 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:13:42.324 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:13:42.324 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 7639 2020-04-22T14:13:42.324 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:42.324 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:13:42.324 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:13:42.325 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:13:42.325 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 101334585 2020-04-22T14:13:42.325 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:42.325 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:42.325 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:13:42.325 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:13:42.326 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:13:42.326 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 101334585 2020-04-22T14:13:42.326 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:42.326 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.7639 192.168.0.1:0/101334585", 2020-04-22T14:13:42.326 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.1:0/101334585", 2020-04-22T14:13:42.326 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2020-04-22T14:13:42.326 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 56, 2020-04-22T14:13:42.327 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 80, 2020-04-22T14:13:42.327 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2020-04-22T14:13:42.327 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklisted": false 2020-04-22T14:13:42.327 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:13:42.327 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:42.341 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:13:42.341 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-22T14:13:42.341 INFO:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:13:42.403 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2020-04-22T14:13:42.403 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-04-22T14:13:42.404 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:42.452 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:13:42.453 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:13:42.529 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:42.576 INFO:teuthology.orchestra.run.smithi103:> cd /home/ubuntu/cephtest/mnt.1 && sudo ls subdir/childfile 2020-04-22T14:13:42.647 INFO:teuthology.orchestra.run.smithi103.stdout:subdir/childfile 2020-04-22T14:13:42.648 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-04-22T14:13:42.648 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:13:42.665 INFO:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:13:42.769 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:42.783 INFO:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:13:42.870 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-04-22T14:13:42.871 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:13:42.871 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:42.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:42.884 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:13:42.942 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:13:42.942 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:13:42.942 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:13:42.942 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:13:42.942 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:13:42.942 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:13:42.943 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:13:42.943 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:13:42.943 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:13:42.943 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:13:42.943 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:13:42.943 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:13:42.943 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:13:42.944 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:13:42.944 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:13:42.944 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42017sec preferred_lft 42017sec 2020-04-22T14:13:42.944 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:13:42.944 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:13:42.944 INFO:teuthology.orchestra.run.smithi103.stdout:25: brx.1@if2: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:13:42.944 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether ce:89:5a:9a:cb:19 brd ff:ff:ff:ff:ff:ff link-netnsid 1 2020-04-22T14:13:42.945 INFO:teuthology.orchestra.run.smithi103.stdout:27: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:13:42.945 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether ae:4f:25:1d:cb:3b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:13:42.945 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:13:42.945 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:13:42.945 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::b4c4:4caa:5771:7bd9/64 scope link tentative noprefixroute 2020-04-22T14:13:42.945 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:13:42.945 INFO:teuthology.orchestra.run.smithi103.stdout:28: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-04-22T14:13:42.946 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether ae:4f:25:1d:cb:3b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2020-04-22T14:13:42.946 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:42.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:42.992 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:13:43.067 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:43.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:43.119 INFO:teuthology.orchestra.run.smithi103:> nmcli connection show 2020-04-22T14:13:43.195 INFO:teuthology.orchestra.run.smithi103.stdout:NAME UUID TYPE DEVICE 2020-04-22T14:13:43.195 INFO:teuthology.orchestra.run.smithi103.stdout:System enp3s0f1 b0a308d1-bd90-60af-eb7c-0183bb425a1a ethernet enp3s0f1 2020-04-22T14:13:43.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-brx d423371d-7f09-4eaa-9d17-d8ef64d99065 bridge ceph-brx 2020-04-22T14:13:43.196 INFO:teuthology.orchestra.run.smithi103.stdout:brx.0 372f62b6-7594-4e62-85ea-18b4d4af9953 ethernet brx.0 2020-04-22T14:13:43.196 INFO:teuthology.orchestra.run.smithi103.stdout:eno1 206ad60d-195e-4d4b-a9fe-a5dd1f33a67d ethernet -- 2020-04-22T14:13:43.196 INFO:teuthology.orchestra.run.smithi103.stdout:eno2 894a7dd2-d329-4985-9ef9-84a92c6e1c6c ethernet -- 2020-04-22T14:13:43.196 INFO:teuthology.orchestra.run.smithi103.stdout:enp3s0f0 5a3237ce-06ab-4ae0-818b-45bdf036cb08 ethernet -- 2020-04-22T14:13:43.196 INFO:teuthology.orchestra.run.smithi103.stdout:Wired connection 2 d877888d-a653-34c8-92dd-17504823a2f3 ethernet -- 2020-04-22T14:13:43.196 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:43.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:43.244 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:13:43.310 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2020-04-22T14:13:43.310 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:43.359 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-04-22T14:13:43.359 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:13:43.441 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[84283]: fuse finished with error 0 and tester_r 0 2020-04-22T14:13:43.505 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-04-22T14:13:43.505 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:13:43.505 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:43.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:43.518 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:13:43.600 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:43.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:43.644 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down brx.0' 2020-04-22T14:13:43.801 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.0' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/33) 2020-04-22T14:13:43.802 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:43.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:43.816 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete brx.0' 2020-04-22T14:13:43.923 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.0' (372f62b6-7594-4e62-85ea-18b4d4af9953) successfully deleted. 2020-04-22T14:13:43.923 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:43.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:43.953 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:13:44.062 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:44.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:44.089 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:13:44.149 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:13:44.149 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:13:44.149 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:13:44.149 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:13:44.150 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:13:44.150 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:13:44.150 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:13:44.150 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:13:44.150 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:13:44.150 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:13:44.150 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:13:44.151 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:13:44.151 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:13:44.151 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:13:44.151 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:13:44.151 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42016sec preferred_lft 42016sec 2020-04-22T14:13:44.151 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:13:44.151 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:13:44.151 INFO:teuthology.orchestra.run.smithi103.stdout:25: brx.1@if2: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:13:44.152 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether ce:89:5a:9a:cb:19 brd ff:ff:ff:ff:ff:ff link-netnsid 1 2020-04-22T14:13:44.152 INFO:teuthology.orchestra.run.smithi103.stdout:27: ceph-brx: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:13:44.152 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:13:44.152 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:13:44.152 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:13:44.152 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::b4c4:4caa:5771:7bd9/64 scope link noprefixroute 2020-04-22T14:13:44.152 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:13:44.153 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:44.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:44.196 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:13:44.271 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:44.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:44.322 INFO:teuthology.orchestra.run.smithi103:> nmcli connection show 2020-04-22T14:13:44.398 INFO:teuthology.orchestra.run.smithi103.stdout:NAME UUID TYPE DEVICE 2020-04-22T14:13:44.399 INFO:teuthology.orchestra.run.smithi103.stdout:System enp3s0f1 b0a308d1-bd90-60af-eb7c-0183bb425a1a ethernet enp3s0f1 2020-04-22T14:13:44.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-brx d423371d-7f09-4eaa-9d17-d8ef64d99065 bridge ceph-brx 2020-04-22T14:13:44.399 INFO:teuthology.orchestra.run.smithi103.stdout:eno1 206ad60d-195e-4d4b-a9fe-a5dd1f33a67d ethernet -- 2020-04-22T14:13:44.399 INFO:teuthology.orchestra.run.smithi103.stdout:eno2 894a7dd2-d329-4985-9ef9-84a92c6e1c6c ethernet -- 2020-04-22T14:13:44.399 INFO:teuthology.orchestra.run.smithi103.stdout:enp3s0f0 5a3237ce-06ab-4ae0-818b-45bdf036cb08 ethernet -- 2020-04-22T14:13:44.399 INFO:teuthology.orchestra.run.smithi103.stdout:Wired connection 2 d877888d-a653-34c8-92dd-17504823a2f3 ethernet -- 2020-04-22T14:13:44.400 INFO:tasks.cephfs.mount:Removing the 'ceph-brx' 2020-04-22T14:13:44.400 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:44.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:44.445 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down ceph-brx' 2020-04-22T14:13:44.604 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/32) 2020-04-22T14:13:44.604 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:44.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:44.618 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete ceph-brx' 2020-04-22T14:13:44.734 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' (d423371d-7f09-4eaa-9d17-d8ef64d99065) successfully deleted. 2020-04-22T14:13:44.734 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:44.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:44.758 INFO:teuthology.orchestra.run.smithi103:> route 2020-04-22T14:13:44.817 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2020-04-22T14:13:44.817 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-04-22T14:13:44.817 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 102 0 0 enp3s0f1 2020-04-22T14:13:44.818 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 102 0 0 enp3s0f1 2020-04-22T14:13:44.818 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:44.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:44.866 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -D FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-04-22T14:13:44.974 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:44.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:44.997 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -D FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-04-22T14:13:45.106 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:45.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:45.127 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -t nat -D POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-04-22T14:13:45.234 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:45.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:45.257 INFO:teuthology.orchestra.run.smithi103:> cat /tmp/python-ceph-brx 2020-04-22T14:13:45.316 INFO:teuthology.orchestra.run.smithi103.stdout:0 2020-04-22T14:13:45.316 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:45.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:45.365 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 0 > /proc/sys/net/ipv4/ip_forward' 2020-04-22T14:13:45.441 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:45.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:45.487 INFO:teuthology.orchestra.run.smithi103:> rm -f /tmp/python-ceph-brx 2020-04-22T14:13:45.547 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:45.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:45.595 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:13:45.655 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.2' netns for '/home/ubuntu/cephtest/mnt.2' 2020-04-22T14:13:45.655 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:13:45.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:45.672 INFO:teuthology.orchestra.run.smithi086:> ip addr 2020-04-22T14:13:45.730 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:13:45.730 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:13:45.730 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:13:45.730 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:13:45.730 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2020-04-22T14:13:45.731 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:13:45.731 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:13:45.731 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:13:45.731 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:13:45.731 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:13:45.731 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:13:45.731 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:13:45.732 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:13:45.732 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:13:45.732 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:13:45.732 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 41988sec preferred_lft 41988sec 2020-04-22T14:13:45.732 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2020-04-22T14:13:45.732 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:13:45.733 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:13:45.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:45.785 INFO:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.2) 2020-04-22T14:13:45.843 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.3' netns for '/home/ubuntu/cephtest/mnt.3' 2020-04-22T14:13:45.844 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:13:45.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:45.896 INFO:teuthology.orchestra.run.smithi086:> ip addr 2020-04-22T14:13:45.963 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:13:45.963 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:13:45.963 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:13:45.963 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:13:45.963 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2020-04-22T14:13:45.963 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:13:45.964 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:13:45.964 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:13:45.964 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:13:45.964 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:13:45.964 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:13:45.964 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:13:45.965 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:13:45.965 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:13:45.965 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:13:45.965 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 41988sec preferred_lft 41988sec 2020-04-22T14:13:45.965 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2020-04-22T14:13:45.965 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:13:45.965 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:13:46.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:13:46.015 INFO:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.3) 2020-04-22T14:13:46.077 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:46.092 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_dir_fsync' 2020-04-22T14:13:46.244 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.242+0000 7f23895da700 1 Processor -- start 2020-04-22T14:13:46.244 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.242+0000 7f23895da700 1 -- start start 2020-04-22T14:13:46.248 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.243+0000 7f23895da700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2384065fe0 0x7f23841464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:46.248 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.243+0000 7f23895da700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2384063e30 0x7f23840642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:46.248 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.243+0000 7f23895da700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2384143300 con 0x7f238412c0d0 2020-04-22T14:13:46.249 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.243+0000 7f23895da700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23841435a0 con 0x7f2384065fe0 2020-04-22T14:13:46.249 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.243+0000 7f23895da700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2384143840 con 0x7f2384063e30 2020-04-22T14:13:46.249 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.243+0000 7f23827fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2384065fe0 0x7f23841464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:46.249 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.243+0000 7f23827fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2384065fe0 0x7f23841464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53920/0 (socket says 172.21.15.103:53920) 2020-04-22T14:13:46.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.243+0000 7f23827fc700 1 -- 172.21.15.103:0/3887312911 learned_addr learned my addr 172.21.15.103:0/3887312911 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:46.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.243+0000 7f23837fe700 1 --2- 172.21.15.103:0/3887312911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2384063e30 0x7f23840642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:46.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.244+0000 7f23827fc700 1 -- 172.21.15.103:0/3887312911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2384063e30 msgr2=0x7f23840642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:46.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.244+0000 7f23827fc700 1 --2- 172.21.15.103:0/3887312911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2384063e30 0x7f23840642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:46.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.244+0000 7f23827fc700 1 -- 172.21.15.103:0/3887312911 >> v1:172.21.15.86:6789/0 conn(0x7f238412c0d0 legacy=0x7f238405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:46.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.244+0000 7f23827fc700 1 -- 172.21.15.103:0/3887312911 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238405bb50 con 0x7f2384065fe0 2020-04-22T14:13:46.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.244+0000 7f23837fe700 1 --2- 172.21.15.103:0/3887312911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2384063e30 0x7f23840642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:13:46.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.244+0000 7f23827fc700 1 --2- 172.21.15.103:0/3887312911 >> v2:172.21.15.103:3300/0 conn(0x7f2384065fe0 0x7f23841464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f23840b85b0 tx=0x7f2374007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:46.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.244+0000 7f23827fc700 1 --2- 172.21.15.103:0/3887312911 >> v2:172.21.15.103:3300/0 conn(0x7f2384065fe0 0x7f23841464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f23840b85b0 tx=0x7f2374007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:46.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.244+0000 7f23827fc700 1 --2- 172.21.15.103:0/3887312911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2384065fe0 0x7f23841464e0 secure :-1 s=READY pgs=1276 cs=0 l=1 rx=0x7f23840b85b0 tx=0x7f2374007a40).ready entity=mon.1 client_cookie=b09b3598794d49ed server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:46.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.244+0000 7f23827fc700 1 --2- 172.21.15.103:0/3887312911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2384065fe0 0x7f23841464e0 secure :-1 s=THROTTLE_DONE pgs=1276 cs=0 l=1 rx=0x7f23840b85b0 tx=0x7f2374007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:46.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.244+0000 7f2381ffb700 1 -- 172.21.15.103:0/3887312911 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23740116e0 con 0x7f2384065fe0 2020-04-22T14:13:46.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.244+0000 7f23827fc700 1 --2- 172.21.15.103:0/3887312911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2384065fe0 0x7f23841464e0 secure :-1 s=THROTTLE_DONE pgs=1276 cs=0 l=1 rx=0x7f23840b85b0 tx=0x7f2374007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:46.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.244+0000 7f23827fc700 1 --2- 172.21.15.103:0/3887312911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2384065fe0 0x7f23841464e0 secure :-1 s=THROTTLE_DONE pgs=1276 cs=0 l=1 rx=0x7f23840b85b0 tx=0x7f2374007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:46.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.244+0000 7f2381ffb700 1 -- 172.21.15.103:0/3887312911 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2374011840 con 0x7f2384065fe0 2020-04-22T14:13:46.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.244+0000 7f2381ffb700 1 -- 172.21.15.103:0/3887312911 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2374011c60 con 0x7f2384065fe0 2020-04-22T14:13:46.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.244+0000 7f23895da700 1 -- 172.21.15.103:0/3887312911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2384065fe0 msgr2=0x7f23841464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:46.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.244+0000 7f23895da700 1 --2- 172.21.15.103:0/3887312911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2384065fe0 0x7f23841464e0 secure :-1 s=READY pgs=1276 cs=0 l=1 rx=0x7f23840b85b0 tx=0x7f2374007a40).stop 2020-04-22T14:13:46.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.244+0000 7f23895da700 1 -- 172.21.15.103:0/3887312911 shutdown_connections 2020-04-22T14:13:46.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.244+0000 7f23895da700 1 --2- 172.21.15.103:0/3887312911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2384063e30 0x7f23840642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:46.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.244+0000 7f23895da700 1 --2- 172.21.15.103:0/3887312911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2384065fe0 0x7f23841464e0 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:46.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.244+0000 7f23895da700 1 -- 172.21.15.103:0/3887312911 >> 172.21.15.103:0/3887312911 conn(0x7f23840b9160 msgr2=0x7f238405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:46.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.245+0000 7f23895da700 1 -- 172.21.15.103:0/3887312911 shutdown_connections 2020-04-22T14:13:46.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.245+0000 7f23895da700 1 -- 172.21.15.103:0/3887312911 wait complete. 2020-04-22T14:13:46.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.246+0000 7f23895da700 1 Processor -- start 2020-04-22T14:13:46.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.246+0000 7f23895da700 1 -- start start 2020-04-22T14:13:46.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.247+0000 7f23895da700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2384063e30 0x7f23840b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:46.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.247+0000 7f23895da700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2384065fe0 0x7f23840ac740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:46.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.247+0000 7f23895da700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23840b02b0 con 0x7f238412c0d0 2020-04-22T14:13:46.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.247+0000 7f23895da700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23840b1aa0 con 0x7f2384065fe0 2020-04-22T14:13:46.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.247+0000 7f23895da700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23840b1790 con 0x7f2384063e30 2020-04-22T14:13:46.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.247+0000 7f23827fc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2384065fe0 0x7f23840ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:46.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.247+0000 7f2382ffd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2384063e30 0x7f23840b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:46.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.247+0000 7f23827fc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2384065fe0 0x7f23840ac740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:51158/0 (socket says 172.21.15.103:51158) 2020-04-22T14:13:46.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.247+0000 7f23827fc700 1 -- 172.21.15.103:0/2314680030 learned_addr learned my addr 172.21.15.103:0/2314680030 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:46.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.247+0000 7f23837fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f238412c0d0 0x7f23840b1f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:35042/0 (socket says 172.21.15.103:35042) 2020-04-22T14:13:46.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.247+0000 7f2382ffd700 1 -- 172.21.15.103:0/2314680030 >> v2:172.21.15.86:3300/0 conn(0x7f2384065fe0 msgr2=0x7f23840ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:46.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.247+0000 7f2382ffd700 1 --2- 172.21.15.103:0/2314680030 >> v2:172.21.15.86:3300/0 conn(0x7f2384065fe0 0x7f23840ac740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:46.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.247+0000 7f2382ffd700 1 -- 172.21.15.103:0/2314680030 >> v1:172.21.15.86:6789/0 conn(0x7f238412c0d0 legacy=0x7f23840b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:46.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.247+0000 7f2382ffd700 1 -- 172.21.15.103:0/2314680030 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23840add10 con 0x7f2384063e30 2020-04-22T14:13:46.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.247+0000 7f2382ffd700 1 --2- 172.21.15.103:0/2314680030 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2384063e30 0x7f23840b54c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2378001f50 tx=0x7f2378010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:46.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.247+0000 7f2382ffd700 1 --2- 172.21.15.103:0/2314680030 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2384063e30 0x7f23840b54c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2378001f50 tx=0x7f2378010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:46.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.247+0000 7f2382ffd700 1 --2- 172.21.15.103:0/2314680030 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2384063e30 0x7f23840b54c0 secure :-1 s=READY pgs=121 cs=0 l=1 rx=0x7f2378001f50 tx=0x7f2378010850).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:46.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.248+0000 7f2382ffd700 1 --2- 172.21.15.103:0/2314680030 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2384063e30 0x7f23840b54c0 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7f2378001f50 tx=0x7f2378010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:46.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.248+0000 7f2373fff700 1 -- 172.21.15.103:0/2314680030 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2378006bc0 con 0x7f2384063e30 2020-04-22T14:13:46.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.248+0000 7f2382ffd700 1 --2- 172.21.15.103:0/2314680030 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2384063e30 0x7f23840b54c0 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7f2378001f50 tx=0x7f2378010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:46.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.248+0000 7f2373fff700 1 -- 172.21.15.103:0/2314680030 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2378006d60 con 0x7f2384063e30 2020-04-22T14:13:46.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.248+0000 7f2382ffd700 1 --2- 172.21.15.103:0/2314680030 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2384063e30 0x7f23840b54c0 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7f2378001f50 tx=0x7f2378010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:46.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.248+0000 7f23895da700 1 -- 172.21.15.103:0/2314680030 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23840b2650 con 0x7f2384063e30 2020-04-22T14:13:46.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.248+0000 7f2373fff700 1 -- 172.21.15.103:0/2314680030 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2378008370 con 0x7f2384063e30 2020-04-22T14:13:46.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.248+0000 7f23895da700 1 -- 172.21.15.103:0/2314680030 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23840b0000 con 0x7f2384063e30 2020-04-22T14:13:46.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.248+0000 7f2382ffd700 1 --2- 172.21.15.103:0/2314680030 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2384063e30 0x7f23840b54c0 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7f2378001f50 tx=0x7f2378010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:46.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.249+0000 7f23895da700 1 -- 172.21.15.103:0/2314680030 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2384056c90 con 0x7f2384063e30 2020-04-22T14:13:46.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.249+0000 7f2373fff700 1 -- 172.21.15.103:0/2314680030 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f2378008630 con 0x7f2384063e30 2020-04-22T14:13:46.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.249+0000 7f2382ffd700 1 --2- 172.21.15.103:0/2314680030 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2384063e30 0x7f23840b54c0 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7f2378001f50 tx=0x7f2378010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:46.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.249+0000 7f2373fff700 1 --2- 172.21.15.103:0/2314680030 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f236004d870 0x7f236004fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:46.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.249+0000 7f2373fff700 1 -- 172.21.15.103:0/2314680030 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f2378061540 con 0x7f2384063e30 2020-04-22T14:13:46.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.249+0000 7f23827fc700 1 --2- 172.21.15.103:0/2314680030 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f236004d870 0x7f236004fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:46.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.250+0000 7f23827fc700 1 --2- 172.21.15.103:0/2314680030 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f236004d870 0x7f236004fd30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f23840b85b0 tx=0x7f2374007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:46.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.250+0000 7f23827fc700 1 --2- 172.21.15.103:0/2314680030 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f236004d870 0x7f236004fd30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f23840b85b0 tx=0x7f2374007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:46.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.250+0000 7f23827fc700 1 --2- 172.21.15.103:0/2314680030 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f236004d870 0x7f236004fd30 secure :-1 s=READY pgs=469 cs=0 l=1 rx=0x7f23840b85b0 tx=0x7f2374007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:46.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.253+0000 7f2382ffd700 1 --2- 172.21.15.103:0/2314680030 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2384063e30 0x7f23840b54c0 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7f2378001f50 tx=0x7f2378010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:46.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.253+0000 7f2373fff700 1 -- 172.21.15.103:0/2314680030 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f237803c980 con 0x7f2384063e30 2020-04-22T14:13:46.450 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:46.448+0000 7f23895da700 1 -- 172.21.15.103:0/2314680030 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_dir_fsync"]} v 0) v1 -- 0x7f2384064ab0 con 0x7f2384063e30 2020-04-22T14:13:47.249 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.247+0000 7f2382ffd700 1 --2- 172.21.15.103:0/2314680030 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2384063e30 0x7f23840b54c0 secure :-1 s=READY pgs=121 cs=0 l=1 rx=0x7f2378001f50 tx=0x7f2378010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:47.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.397+0000 7f2382ffd700 1 --2- 172.21.15.103:0/2314680030 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2384063e30 0x7f23840b54c0 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7f2378001f50 tx=0x7f2378010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:47.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.397+0000 7f2373fff700 1 -- 172.21.15.103:0/2314680030 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_dir_fsync"]}]=0 v484) v1 ==== 146+0+0 (secure 0 0 0) 0x7f237803ffa0 con 0x7f2384063e30 2020-04-22T14:13:47.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.399+0000 7f23895da700 1 -- 172.21.15.103:0/2314680030 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f236004d870 msgr2=0x7f236004fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:47.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.399+0000 7f23895da700 1 --2- 172.21.15.103:0/2314680030 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f236004d870 0x7f236004fd30 secure :-1 s=READY pgs=469 cs=0 l=1 rx=0x7f23840b85b0 tx=0x7f2374007a40).stop 2020-04-22T14:13:47.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.399+0000 7f23895da700 1 -- 172.21.15.103:0/2314680030 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2384063e30 msgr2=0x7f23840b54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:47.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.399+0000 7f23895da700 1 --2- 172.21.15.103:0/2314680030 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2384063e30 0x7f23840b54c0 secure :-1 s=READY pgs=121 cs=0 l=1 rx=0x7f2378001f50 tx=0x7f2378010850).stop 2020-04-22T14:13:47.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.399+0000 7f23895da700 1 -- 172.21.15.103:0/2314680030 shutdown_connections 2020-04-22T14:13:47.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.399+0000 7f23895da700 1 --2- 172.21.15.103:0/2314680030 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2384063e30 0x7f23840b54c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:47.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.399+0000 7f23895da700 1 --2- 172.21.15.103:0/2314680030 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f236004d870 0x7f236004fd30 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:47.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.399+0000 7f23895da700 1 --2- 172.21.15.103:0/2314680030 >> v2:172.21.15.86:3300/0 conn(0x7f2384065fe0 0x7f23840ac740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:47.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.399+0000 7f23895da700 1 -- 172.21.15.103:0/2314680030 >> 172.21.15.103:0/2314680030 conn(0x7f23840b9160 msgr2=0x7f2384061710 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:47.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.400+0000 7f23895da700 1 -- 172.21.15.103:0/2314680030 shutdown_connections 2020-04-22T14:13:47.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.400+0000 7f23895da700 1 -- 172.21.15.103:0/2314680030 wait complete. 2020-04-22T14:13:47.414 INFO:tasks.cephfs_test_runner:test_dir_fsync (tasks.cephfs.test_client_recovery.TestClientRecovery) ... ok 2020-04-22T14:13:47.414 INFO:tasks.cephfs_test_runner:Starting test: test_dont_mark_unresponsive_client_stale (tasks.cephfs.test_client_recovery.TestClientRecovery) 2020-04-22T14:13:47.414 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:47.429 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_dont_mark_unresponsive_client_stale' 2020-04-22T14:13:47.582 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.580+0000 7f9925d21700 1 Processor -- start 2020-04-22T14:13:47.582 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.580+0000 7f9925d21700 1 -- start start 2020-04-22T14:13:47.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.581+0000 7f9925d21700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f992012c0d0 0x7f99201464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:47.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.581+0000 7f9925d21700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9920065fe0 0x7f992005b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:47.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.581+0000 7f9925d21700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f992005b8a0 0x7f9920062ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:47.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.581+0000 7f9925d21700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f992012c4b0 con 0x7f992012c0d0 2020-04-22T14:13:47.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.581+0000 7f9925d21700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9920143300 con 0x7f992005b8a0 2020-04-22T14:13:47.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.581+0000 7f9925d21700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99201435a0 con 0x7f9920065fe0 2020-04-22T14:13:47.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.581+0000 7f991ffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f992005b8a0 0x7f9920062ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:47.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.581+0000 7f991ffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f992005b8a0 0x7f9920062ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53936/0 (socket says 172.21.15.103:53936) 2020-04-22T14:13:47.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.581+0000 7f991ffff700 1 -- 172.21.15.103:0/1840371992 learned_addr learned my addr 172.21.15.103:0/1840371992 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:47.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.581+0000 7f9917fff700 1 --2- 172.21.15.103:0/1840371992 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9920065fe0 0x7f992005b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:47.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.581+0000 7f991f7fe700 1 --2- 172.21.15.103:0/1840371992 >> v2:172.21.15.86:3300/0 conn(0x7f992012c0d0 0x7f99201464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:47.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.581+0000 7f991ffff700 1 -- 172.21.15.103:0/1840371992 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9920065fe0 msgr2=0x7f992005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:47.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.581+0000 7f991ffff700 1 --2- 172.21.15.103:0/1840371992 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9920065fe0 0x7f992005b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:47.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.581+0000 7f991ffff700 1 -- 172.21.15.103:0/1840371992 >> v2:172.21.15.86:3300/0 conn(0x7f992012c0d0 msgr2=0x7f99201464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:47.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.581+0000 7f991ffff700 1 --2- 172.21.15.103:0/1840371992 >> v2:172.21.15.86:3300/0 conn(0x7f992012c0d0 0x7f99201464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:47.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.581+0000 7f991ffff700 1 -- 172.21.15.103:0/1840371992 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9920143840 con 0x7f992005b8a0 2020-04-22T14:13:47.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.581+0000 7f991f7fe700 1 --2- 172.21.15.103:0/1840371992 >> v2:172.21.15.86:3300/0 conn(0x7f992012c0d0 0x7f99201464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:13:47.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.581+0000 7f991ffff700 1 --2- 172.21.15.103:0/1840371992 >> v2:172.21.15.103:3300/0 conn(0x7f992005b8a0 0x7f9920062ab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f99180032b0 tx=0x7f9918007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:47.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.581+0000 7f991ffff700 1 --2- 172.21.15.103:0/1840371992 >> v2:172.21.15.103:3300/0 conn(0x7f992005b8a0 0x7f9920062ab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f99180032b0 tx=0x7f9918007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:47.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.581+0000 7f991ffff700 1 --2- 172.21.15.103:0/1840371992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f992005b8a0 0x7f9920062ab0 secure :-1 s=READY pgs=1277 cs=0 l=1 rx=0x7f99180032b0 tx=0x7f9918007dc0).ready entity=mon.1 client_cookie=cee1213101130fdc server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:47.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.581+0000 7f991ffff700 1 --2- 172.21.15.103:0/1840371992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f992005b8a0 0x7f9920062ab0 secure :-1 s=THROTTLE_DONE pgs=1277 cs=0 l=1 rx=0x7f99180032b0 tx=0x7f9918007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:47.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.581+0000 7f991effd700 1 -- 172.21.15.103:0/1840371992 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f991800a180 con 0x7f992005b8a0 2020-04-22T14:13:47.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.581+0000 7f991ffff700 1 --2- 172.21.15.103:0/1840371992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f992005b8a0 0x7f9920062ab0 secure :-1 s=THROTTLE_DONE pgs=1277 cs=0 l=1 rx=0x7f99180032b0 tx=0x7f9918007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:47.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.581+0000 7f991ffff700 1 --2- 172.21.15.103:0/1840371992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f992005b8a0 0x7f9920062ab0 secure :-1 s=THROTTLE_DONE pgs=1277 cs=0 l=1 rx=0x7f99180032b0 tx=0x7f9918007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:47.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.581+0000 7f991effd700 1 -- 172.21.15.103:0/1840371992 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991800a2e0 con 0x7f992005b8a0 2020-04-22T14:13:47.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.581+0000 7f991effd700 1 -- 172.21.15.103:0/1840371992 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f991800a700 con 0x7f992005b8a0 2020-04-22T14:13:47.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.581+0000 7f9925d21700 1 -- 172.21.15.103:0/1840371992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f992005b8a0 msgr2=0x7f9920062ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:47.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.581+0000 7f9925d21700 1 --2- 172.21.15.103:0/1840371992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f992005b8a0 0x7f9920062ab0 secure :-1 s=READY pgs=1277 cs=0 l=1 rx=0x7f99180032b0 tx=0x7f9918007dc0).stop 2020-04-22T14:13:47.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.582+0000 7f9925d21700 1 -- 172.21.15.103:0/1840371992 shutdown_connections 2020-04-22T14:13:47.590 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.582+0000 7f9925d21700 1 --2- 172.21.15.103:0/1840371992 >> v2:172.21.15.86:3300/0 conn(0x7f992012c0d0 0x7f99201464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:47.590 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.582+0000 7f9925d21700 1 --2- 172.21.15.103:0/1840371992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f992005b8a0 0x7f9920062ab0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:47.590 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.582+0000 7f9925d21700 1 --2- 172.21.15.103:0/1840371992 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9920065fe0 0x7f992005b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:47.590 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.582+0000 7f9925d21700 1 -- 172.21.15.103:0/1840371992 >> 172.21.15.103:0/1840371992 conn(0x7f99200b9160 msgr2=0x7f992005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:47.590 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.582+0000 7f9925d21700 1 -- 172.21.15.103:0/1840371992 shutdown_connections 2020-04-22T14:13:47.590 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.582+0000 7f9925d21700 1 -- 172.21.15.103:0/1840371992 wait complete. 2020-04-22T14:13:47.591 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.583+0000 7f9925d21700 1 Processor -- start 2020-04-22T14:13:47.591 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.583+0000 7f9925d21700 1 -- start start 2020-04-22T14:13:47.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.584+0000 7f9925d21700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f992012c0d0 0x7f9920153020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:47.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.584+0000 7f9925d21700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99201537a0 con 0x7f9920065fe0 2020-04-22T14:13:47.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.584+0000 7f9925d21700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99200ae3b0 con 0x7f992005b8a0 2020-04-22T14:13:47.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.584+0000 7f9925d21700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9920153480 con 0x7f992012c0d0 2020-04-22T14:13:47.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.584+0000 7f991f7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f992005b8a0 0x7f99200b40c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46128/0 (socket says 172.21.15.103:46128) 2020-04-22T14:13:47.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.584+0000 7f991f7fe700 1 -- 172.21.15.103:0/1422099253 learned_addr learned my addr 172.21.15.103:0/1422099253 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:47.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.584+0000 7f991ffff700 1 --2- 172.21.15.103:0/1422099253 >> v2:172.21.15.103:3300/0 conn(0x7f992012c0d0 0x7f9920153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:47.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.584+0000 7f991ffff700 1 -- 172.21.15.103:0/1422099253 >> v1:172.21.15.103:6789/0 conn(0x7f992005b8a0 legacy=0x7f99200b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:47.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.584+0000 7f991ffff700 1 -- 172.21.15.103:0/1422099253 >> v1:172.21.15.86:6789/0 conn(0x7f9920065fe0 legacy=0x7f9920125240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:47.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.584+0000 7f991d7fa700 1 -- 172.21.15.103:0/1422099253 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 675826184 0 0) 0x7f99200ae3b0 con 0x7f992005b8a0 2020-04-22T14:13:47.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.584+0000 7f991ffff700 1 -- 172.21.15.103:0/1422099253 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99200ae850 con 0x7f992012c0d0 2020-04-22T14:13:47.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.584+0000 7f991ffff700 1 --2- 172.21.15.103:0/1422099253 >> v2:172.21.15.103:3300/0 conn(0x7f992012c0d0 0x7f9920153020 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9920152c60 tx=0x7f9918007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:47.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.584+0000 7f991ffff700 1 --2- 172.21.15.103:0/1422099253 >> v2:172.21.15.103:3300/0 conn(0x7f992012c0d0 0x7f9920153020 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9920152c60 tx=0x7f9918007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:47.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.584+0000 7f991ffff700 1 --2- 172.21.15.103:0/1422099253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f992012c0d0 0x7f9920153020 secure :-1 s=READY pgs=1279 cs=0 l=1 rx=0x7f9920152c60 tx=0x7f9918007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:47.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.584+0000 7f991ffff700 1 --2- 172.21.15.103:0/1422099253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f992012c0d0 0x7f9920153020 secure :-1 s=THROTTLE_DONE pgs=1279 cs=0 l=1 rx=0x7f9920152c60 tx=0x7f9918007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:47.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.584+0000 7f991ffff700 1 --2- 172.21.15.103:0/1422099253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f992012c0d0 0x7f9920153020 secure :-1 s=THROTTLE_DONE pgs=1279 cs=0 l=1 rx=0x7f9920152c60 tx=0x7f9918007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:47.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.584+0000 7f991d7fa700 1 -- 172.21.15.103:0/1422099253 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9918005c30 con 0x7f992012c0d0 2020-04-22T14:13:47.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.584+0000 7f991ffff700 1 --2- 172.21.15.103:0/1422099253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f992012c0d0 0x7f9920153020 secure :-1 s=THROTTLE_DONE pgs=1279 cs=0 l=1 rx=0x7f9920152c60 tx=0x7f9918007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:47.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.584+0000 7f991d7fa700 1 -- 172.21.15.103:0/1422099253 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9918005d90 con 0x7f992012c0d0 2020-04-22T14:13:47.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.584+0000 7f991d7fa700 1 -- 172.21.15.103:0/1422099253 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99180177a0 con 0x7f992012c0d0 2020-04-22T14:13:47.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.584+0000 7f9925d21700 1 -- 172.21.15.103:0/1422099253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9920128770 con 0x7f992012c0d0 2020-04-22T14:13:47.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.584+0000 7f9925d21700 1 -- 172.21.15.103:0/1422099253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99201284e0 con 0x7f992012c0d0 2020-04-22T14:13:47.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.585+0000 7f991ffff700 1 --2- 172.21.15.103:0/1422099253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f992012c0d0 0x7f9920153020 secure :-1 s=THROTTLE_DONE pgs=1279 cs=0 l=1 rx=0x7f9920152c60 tx=0x7f9918007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:47.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.585+0000 7f9925d21700 1 -- 172.21.15.103:0/1422099253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99200ae1f0 con 0x7f992012c0d0 2020-04-22T14:13:47.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.585+0000 7f991d7fa700 1 -- 172.21.15.103:0/1422099253 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f9918017a10 con 0x7f992012c0d0 2020-04-22T14:13:47.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.585+0000 7f991ffff700 1 --2- 172.21.15.103:0/1422099253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f992012c0d0 0x7f9920153020 secure :-1 s=THROTTLE_DONE pgs=1279 cs=0 l=1 rx=0x7f9920152c60 tx=0x7f9918007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:47.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.586+0000 7f991d7fa700 1 --2- 172.21.15.103:0/1422099253 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f990404d8b0 0x7f990404fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:47.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.586+0000 7f991d7fa700 1 -- 172.21.15.103:0/1422099253 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f9918064410 con 0x7f992012c0d0 2020-04-22T14:13:47.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.586+0000 7f991f7fe700 1 --2- 172.21.15.103:0/1422099253 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f990404d8b0 0x7f990404fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:47.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.586+0000 7f991f7fe700 1 --2- 172.21.15.103:0/1422099253 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f990404d8b0 0x7f990404fd70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9910007a40 tx=0x7f9910008000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:47.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.586+0000 7f991f7fe700 1 --2- 172.21.15.103:0/1422099253 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f990404d8b0 0x7f990404fd70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9910007a40 tx=0x7f9910008000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:47.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.586+0000 7f991f7fe700 1 --2- 172.21.15.103:0/1422099253 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f990404d8b0 0x7f990404fd70 secure :-1 s=READY pgs=470 cs=0 l=1 rx=0x7f9910007a40 tx=0x7f9910008000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:47.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.590+0000 7f991ffff700 1 --2- 172.21.15.103:0/1422099253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f992012c0d0 0x7f9920153020 secure :-1 s=THROTTLE_DONE pgs=1279 cs=0 l=1 rx=0x7f9920152c60 tx=0x7f9918007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:47.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.590+0000 7f991d7fa700 1 -- 172.21.15.103:0/1422099253 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f991803f8b0 con 0x7f992012c0d0 2020-04-22T14:13:47.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:47.784+0000 7f9925d21700 1 -- 172.21.15.103:0/1422099253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_dont_mark_unresponsive_client_stale"]} v 0) v1 -- 0x7f99201535c0 con 0x7f992012c0d0 2020-04-22T14:13:48.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.402+0000 7f991ffff700 1 --2- 172.21.15.103:0/1422099253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f992012c0d0 0x7f9920153020 secure :-1 s=THROTTLE_DONE pgs=1279 cs=0 l=1 rx=0x7f9920152c60 tx=0x7f9918007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:48.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.402+0000 7f991d7fa700 1 -- 172.21.15.103:0/1422099253 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_dont_mark_unresponsive_client_stale"]}]=0 v485) v1 ==== 175+0+0 (secure 0 0 0) 0x7f9918042ed0 con 0x7f992012c0d0 2020-04-22T14:13:48.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.404+0000 7f9925d21700 1 -- 172.21.15.103:0/1422099253 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f990404d8b0 msgr2=0x7f990404fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:48.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.404+0000 7f9925d21700 1 --2- 172.21.15.103:0/1422099253 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f990404d8b0 0x7f990404fd70 secure :-1 s=READY pgs=470 cs=0 l=1 rx=0x7f9910007a40 tx=0x7f9910008000).stop 2020-04-22T14:13:48.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.404+0000 7f9925d21700 1 -- 172.21.15.103:0/1422099253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f992012c0d0 msgr2=0x7f9920153020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:48.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.404+0000 7f9925d21700 1 --2- 172.21.15.103:0/1422099253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f992012c0d0 0x7f9920153020 secure :-1 s=READY pgs=1279 cs=0 l=1 rx=0x7f9920152c60 tx=0x7f9918007dc0).stop 2020-04-22T14:13:48.408 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.404+0000 7f9925d21700 1 -- 172.21.15.103:0/1422099253 shutdown_connections 2020-04-22T14:13:48.408 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.404+0000 7f9925d21700 1 --2- 172.21.15.103:0/1422099253 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f990404d8b0 0x7f990404fd70 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:48.408 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.404+0000 7f9925d21700 1 --2- 172.21.15.103:0/1422099253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f992012c0d0 0x7f9920153020 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:48.408 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.404+0000 7f9925d21700 1 -- 172.21.15.103:0/1422099253 >> 172.21.15.103:0/1422099253 conn(0x7f99200b9160 msgr2=0x7f99200620d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:48.408 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.404+0000 7f9925d21700 1 -- 172.21.15.103:0/1422099253 shutdown_connections 2020-04-22T14:13:48.408 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.404+0000 7f9925d21700 1 -- 172.21.15.103:0/1422099253 wait complete. 2020-04-22T14:13:48.419 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-04-22T14:13:48.419 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:13:48.436 INFO:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:13:48.537 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:48.554 INFO:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:13:48.646 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-04-22T14:13:48.646 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:48.661 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2020-04-22T14:13:48.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.814+0000 7f9a22c5d700 1 Processor -- start 2020-04-22T14:13:48.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.815+0000 7f9a22c5d700 1 -- start start 2020-04-22T14:13:48.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.815+0000 7f9a22c5d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a1c065fe0 0x7f9a1c1464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:48.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.815+0000 7f9a22c5d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a1c143300 con 0x7f9a1c12c0d0 2020-04-22T14:13:48.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.815+0000 7f9a22c5d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a1c1435a0 con 0x7f9a1c063e30 2020-04-22T14:13:48.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.815+0000 7f9a22c5d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1c143840 con 0x7f9a1c065fe0 2020-04-22T14:13:48.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.815+0000 7f9a211fa700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f9a1c063e30 0x7f9a1c0642a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46140/0 (socket says 172.21.15.103:46140) 2020-04-22T14:13:48.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.815+0000 7f9a211fa700 1 -- 172.21.15.103:0/1045250268 learned_addr learned my addr 172.21.15.103:0/1045250268 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:48.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.816+0000 7f9a1b7fe700 1 -- 172.21.15.103:0/1045250268 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3483401551 0 0) 0x7f9a1c1435a0 con 0x7f9a1c063e30 2020-04-22T14:13:48.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.816+0000 7f9a1bfff700 1 --2- 172.21.15.103:0/1045250268 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a1c065fe0 0x7f9a1c1464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:48.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.816+0000 7f9a1b7fe700 1 -- 172.21.15.103:0/1045250268 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a08003230 con 0x7f9a1c063e30 2020-04-22T14:13:48.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.816+0000 7f9a1b7fe700 1 -- 172.21.15.103:0/1045250268 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2387991947 0 0) 0x7f9a08003230 con 0x7f9a1c063e30 2020-04-22T14:13:48.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.816+0000 7f9a1b7fe700 1 -- 172.21.15.103:0/1045250268 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a1c065fe0 msgr2=0x7f9a1c1464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:48.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.816+0000 7f9a1b7fe700 1 --2- 172.21.15.103:0/1045250268 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a1c065fe0 0x7f9a1c1464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:48.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.816+0000 7f9a1b7fe700 1 -- 172.21.15.103:0/1045250268 >> v1:172.21.15.86:6789/0 conn(0x7f9a1c12c0d0 legacy=0x7f9a1c05b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:48.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.816+0000 7f9a1b7fe700 1 -- 172.21.15.103:0/1045250268 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a1c05bb50 con 0x7f9a1c063e30 2020-04-22T14:13:48.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.816+0000 7f9a1b7fe700 1 -- 172.21.15.103:0/1045250268 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f9a14001a90 con 0x7f9a1c063e30 2020-04-22T14:13:48.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.816+0000 7f9a1b7fe700 1 -- 172.21.15.103:0/1045250268 >> v1:172.21.15.103:6789/0 conn(0x7f9a1c063e30 legacy=0x7f9a1c0642a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:48.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.816+0000 7f9a1b7fe700 1 --2- 172.21.15.103:0/1045250268 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a08003720 0x7f9a08003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:48.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.816+0000 7f9a1b7fe700 1 --2- 172.21.15.103:0/1045250268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a08004010 0x7f9a080044f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:48.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.816+0000 7f9a1b7fe700 1 --2- 172.21.15.103:0/1045250268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a08004a60 0x7f9a08004f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:48.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.816+0000 7f9a1b7fe700 1 -- 172.21.15.103:0/1045250268 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1c143840 con 0x7f9a08004010 2020-04-22T14:13:48.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.816+0000 7f9a1b7fe700 1 -- 172.21.15.103:0/1045250268 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0800b830 con 0x7f9a08004a60 2020-04-22T14:13:48.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.816+0000 7f9a1b7fe700 1 -- 172.21.15.103:0/1045250268 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0800b9f0 con 0x7f9a08003720 2020-04-22T14:13:48.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.816+0000 7f9a1bfff700 1 --2- 172.21.15.103:0/1045250268 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a1c065fe0 0x7f9a1c1464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:13:48.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.816+0000 7f9a211fa700 1 --2- 172.21.15.103:0/1045250268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a08004a60 0x7f9a08004f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:48.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.816+0000 7f9a209f9700 1 --2- 172.21.15.103:0/1045250268 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a08003720 0x7f9a08003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:48.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.816+0000 7f9a1bfff700 1 --2- 172.21.15.103:0/1045250268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a08004010 0x7f9a080044f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:48.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.816+0000 7f9a211fa700 1 -- 172.21.15.103:0/1045250268 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a08003720 msgr2=0x7f9a08003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:48.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.816+0000 7f9a211fa700 1 --2- 172.21.15.103:0/1045250268 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a08003720 0x7f9a08003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:48.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.816+0000 7f9a211fa700 1 -- 172.21.15.103:0/1045250268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a08004010 msgr2=0x7f9a080044f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:48.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.816+0000 7f9a211fa700 1 --2- 172.21.15.103:0/1045250268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a08004010 0x7f9a080044f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:48.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.816+0000 7f9a211fa700 1 -- 172.21.15.103:0/1045250268 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a08003230 con 0x7f9a08004a60 2020-04-22T14:13:48.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.817+0000 7f9a211fa700 1 --2- 172.21.15.103:0/1045250268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a08004a60 0x7f9a08004f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9a140017a0 tx=0x7f9a1c05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:48.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.817+0000 7f9a211fa700 1 --2- 172.21.15.103:0/1045250268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a08004a60 0x7f9a08004f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9a140017a0 tx=0x7f9a1c05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:48.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.817+0000 7f9a211fa700 1 --2- 172.21.15.103:0/1045250268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a08004a60 0x7f9a08004f10 secure :-1 s=READY pgs=1281 cs=0 l=1 rx=0x7f9a140017a0 tx=0x7f9a1c05bce0).ready entity=mon.1 client_cookie=572103c8147bcfc8 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:48.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.817+0000 7f9a211fa700 1 --2- 172.21.15.103:0/1045250268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a08004a60 0x7f9a08004f10 secure :-1 s=THROTTLE_DONE pgs=1281 cs=0 l=1 rx=0x7f9a140017a0 tx=0x7f9a1c05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:48.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.817+0000 7f9a211fa700 1 --2- 172.21.15.103:0/1045250268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a08004a60 0x7f9a08004f10 secure :-1 s=THROTTLE_DONE pgs=1281 cs=0 l=1 rx=0x7f9a140017a0 tx=0x7f9a1c05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:48.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.817+0000 7f9a1b7fe700 1 -- 172.21.15.103:0/1045250268 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a14005d40 con 0x7f9a08004a60 2020-04-22T14:13:48.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.817+0000 7f9a211fa700 1 --2- 172.21.15.103:0/1045250268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a08004a60 0x7f9a08004f10 secure :-1 s=THROTTLE_DONE pgs=1281 cs=0 l=1 rx=0x7f9a140017a0 tx=0x7f9a1c05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:48.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.817+0000 7f9a1b7fe700 1 -- 172.21.15.103:0/1045250268 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a14004d20 con 0x7f9a08004a60 2020-04-22T14:13:48.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.817+0000 7f9a1b7fe700 1 -- 172.21.15.103:0/1045250268 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a14005140 con 0x7f9a08004a60 2020-04-22T14:13:48.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.817+0000 7f9a22c5d700 1 -- 172.21.15.103:0/1045250268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a08004a60 msgr2=0x7f9a08004f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:48.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.817+0000 7f9a22c5d700 1 --2- 172.21.15.103:0/1045250268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a08004a60 0x7f9a08004f10 secure :-1 s=READY pgs=1281 cs=0 l=1 rx=0x7f9a140017a0 tx=0x7f9a1c05bce0).stop 2020-04-22T14:13:48.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.817+0000 7f9a211fa700 1 -- 172.21.15.103:0/1045250268 reap_dead start 2020-04-22T14:13:48.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.817+0000 7f9a22c5d700 1 -- 172.21.15.103:0/1045250268 shutdown_connections 2020-04-22T14:13:48.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.817+0000 7f9a22c5d700 1 -- 172.21.15.103:0/1045250268 >> 172.21.15.103:0/1045250268 conn(0x7f9a1c0b9160 msgr2=0x7f9a1c05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:48.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.817+0000 7f9a22c5d700 1 -- 172.21.15.103:0/1045250268 shutdown_connections 2020-04-22T14:13:48.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.817+0000 7f9a22c5d700 1 -- 172.21.15.103:0/1045250268 wait complete. 2020-04-22T14:13:48.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.818+0000 7f9a22c5d700 1 Processor -- start 2020-04-22T14:13:48.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.818+0000 7f9a22c5d700 1 -- start start 2020-04-22T14:13:48.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.819+0000 7f9a22c5d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9a1c0b05e0 0x7f9a1c0b4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:48.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.819+0000 7f9a22c5d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a1c126d00 0x7f9a1c127170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:48.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.819+0000 7f9a22c5d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a1c128920 con 0x7f9a1c0b40b0 2020-04-22T14:13:48.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.819+0000 7f9a22c5d700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a1c0b17a0 con 0x7f9a1c0b05e0 2020-04-22T14:13:48.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.819+0000 7f9a22c5d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1c0b48f0 con 0x7f9a1c126d00 2020-04-22T14:13:48.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.819+0000 7f9a1bfff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9a1c0b05e0 0x7f9a1c0b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:48.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.819+0000 7f9a209f9700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f9a1c0b40b0 0x7f9a1c0ac9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46148/0 (socket says 172.21.15.103:46148) 2020-04-22T14:13:48.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.819+0000 7f9a1bfff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9a1c0b05e0 0x7f9a1c0b4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53960/0 (socket says 172.21.15.103:53960) 2020-04-22T14:13:48.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.819+0000 7f9a209f9700 1 -- 172.21.15.103:0/2084200766 learned_addr learned my addr 172.21.15.103:0/2084200766 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:48.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.819+0000 7f9a211fa700 1 --2- 172.21.15.103:0/2084200766 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a1c126d00 0x7f9a1c127170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:48.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.819+0000 7f9a1bfff700 1 -- 172.21.15.103:0/2084200766 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a1c126d00 msgr2=0x7f9a1c127170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:48.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.819+0000 7f9a1bfff700 1 --2- 172.21.15.103:0/2084200766 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a1c126d00 0x7f9a1c127170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:48.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.819+0000 7f9a1bfff700 1 -- 172.21.15.103:0/2084200766 >> v1:172.21.15.103:6789/0 conn(0x7f9a1c0b40b0 legacy=0x7f9a1c0ac9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:48.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.819+0000 7f9a1bfff700 1 -- 172.21.15.103:0/2084200766 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a1c128b50 con 0x7f9a1c0b05e0 2020-04-22T14:13:48.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.819+0000 7f9a19ffb700 1 -- 172.21.15.103:0/2084200766 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 843237869 0 0) 0x7f9a1c128920 con 0x7f9a1c0b40b0 2020-04-22T14:13:48.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.820+0000 7f9a1bfff700 1 --2- 172.21.15.103:0/2084200766 >> v2:172.21.15.103:3300/0 conn(0x7f9a1c0b05e0 0x7f9a1c0b4490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9a10000e50 tx=0x7f9a10012c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:48.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.820+0000 7f9a1bfff700 1 --2- 172.21.15.103:0/2084200766 >> v2:172.21.15.103:3300/0 conn(0x7f9a1c0b05e0 0x7f9a1c0b4490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9a10000e50 tx=0x7f9a10012c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:48.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.820+0000 7f9a1bfff700 1 --2- 172.21.15.103:0/2084200766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a1c0b05e0 0x7f9a1c0b4490 secure :-1 s=READY pgs=1283 cs=0 l=1 rx=0x7f9a10000e50 tx=0x7f9a10012c20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:48.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.820+0000 7f9a1bfff700 1 --2- 172.21.15.103:0/2084200766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a1c0b05e0 0x7f9a1c0b4490 secure :-1 s=THROTTLE_DONE pgs=1283 cs=0 l=1 rx=0x7f9a10000e50 tx=0x7f9a10012c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:48.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.820+0000 7f9a1bfff700 1 --2- 172.21.15.103:0/2084200766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a1c0b05e0 0x7f9a1c0b4490 secure :-1 s=THROTTLE_DONE pgs=1283 cs=0 l=1 rx=0x7f9a10000e50 tx=0x7f9a10012c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:48.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.820+0000 7f9a19ffb700 1 -- 172.21.15.103:0/2084200766 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a10007560 con 0x7f9a1c0b05e0 2020-04-22T14:13:48.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.820+0000 7f9a1bfff700 1 --2- 172.21.15.103:0/2084200766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a1c0b05e0 0x7f9a1c0b4490 secure :-1 s=THROTTLE_DONE pgs=1283 cs=0 l=1 rx=0x7f9a10000e50 tx=0x7f9a10012c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:48.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.820+0000 7f9a19ffb700 1 -- 172.21.15.103:0/2084200766 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a100059c0 con 0x7f9a1c0b05e0 2020-04-22T14:13:48.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.820+0000 7f9a22c5d700 1 -- 172.21.15.103:0/2084200766 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a1c128df0 con 0x7f9a1c0b05e0 2020-04-22T14:13:48.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.820+0000 7f9a19ffb700 1 -- 172.21.15.103:0/2084200766 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a10005d60 con 0x7f9a1c0b05e0 2020-04-22T14:13:48.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.820+0000 7f9a22c5d700 1 -- 172.21.15.103:0/2084200766 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a1c1290f0 con 0x7f9a1c0b05e0 2020-04-22T14:13:48.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.820+0000 7f9a1bfff700 1 --2- 172.21.15.103:0/2084200766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a1c0b05e0 0x7f9a1c0b4490 secure :-1 s=THROTTLE_DONE pgs=1283 cs=0 l=1 rx=0x7f9a10000e50 tx=0x7f9a10012c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:48.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.821+0000 7f9a19ffb700 1 -- 172.21.15.103:0/2084200766 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f9a100102e0 con 0x7f9a1c0b05e0 2020-04-22T14:13:48.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.821+0000 7f9a1bfff700 1 --2- 172.21.15.103:0/2084200766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a1c0b05e0 0x7f9a1c0b4490 secure :-1 s=THROTTLE_DONE pgs=1283 cs=0 l=1 rx=0x7f9a10000e50 tx=0x7f9a10012c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:48.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.821+0000 7f9a22c5d700 1 -- 172.21.15.103:0/2084200766 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a1c056c90 con 0x7f9a1c0b05e0 2020-04-22T14:13:48.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.821+0000 7f9a19ffb700 1 --2- 172.21.15.103:0/2084200766 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f99fc04d8f0 0x7f99fc04fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:48.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.821+0000 7f9a19ffb700 1 -- 172.21.15.103:0/2084200766 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f9a10063630 con 0x7f9a1c0b05e0 2020-04-22T14:13:48.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.821+0000 7f9a209f9700 1 --2- 172.21.15.103:0/2084200766 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f99fc04d8f0 0x7f99fc04fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:48.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.822+0000 7f9a209f9700 1 --2- 172.21.15.103:0/2084200766 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f99fc04d8f0 0x7f99fc04fdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9a0c000fa0 tx=0x7f9a0c003a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:48.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.822+0000 7f9a209f9700 1 --2- 172.21.15.103:0/2084200766 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f99fc04d8f0 0x7f99fc04fdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9a0c000fa0 tx=0x7f9a0c003a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:48.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.822+0000 7f9a209f9700 1 --2- 172.21.15.103:0/2084200766 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f99fc04d8f0 0x7f99fc04fdb0 secure :-1 s=READY pgs=471 cs=0 l=1 rx=0x7f9a0c000fa0 tx=0x7f9a0c003a00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:48.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.825+0000 7f9a1bfff700 1 --2- 172.21.15.103:0/2084200766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a1c0b05e0 0x7f9a1c0b4490 secure :-1 s=THROTTLE_DONE pgs=1283 cs=0 l=1 rx=0x7f9a10000e50 tx=0x7f9a10012c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:48.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.825+0000 7f9a19ffb700 1 -- 172.21.15.103:0/2084200766 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f9a1003e9b0 con 0x7f9a1c0b05e0 2020-04-22T14:13:48.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.968+0000 7f9a22c5d700 1 -- 172.21.15.103:0/2084200766 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f9a1c0b8390 con 0x7f9a1c0b05e0 2020-04-22T14:13:48.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.969+0000 7f9a1bfff700 1 --2- 172.21.15.103:0/2084200766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a1c0b05e0 0x7f9a1c0b4490 secure :-1 s=THROTTLE_DONE pgs=1283 cs=0 l=1 rx=0x7f9a10000e50 tx=0x7f9a10012c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:48.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.969+0000 7f9a19ffb700 1 -- 172.21.15.103:0/2084200766 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v80) v1 ==== 81+0+33924 (secure 0 0 0) 0x7f9a10041fd0 con 0x7f9a1c0b05e0 2020-04-22T14:13:48.973 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:13:48.973 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:13:48.973 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 80, 2020-04-22T14:13:48.973 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:13:48.974 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2020-04-22T14:02:06.484738+0000", 2020-04-22T14:13:48.974 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2020-04-22T14:13:32.459154+0000", 2020-04-22T14:13:48.974 INFO:teuthology.orchestra.run.smithi103.stdout: "last_up_change": "2020-04-22T14:02:18.623774+0000", 2020-04-22T14:13:48.974 INFO:teuthology.orchestra.run.smithi103.stdout: "last_in_change": "2020-04-22T14:02:18.623774+0000", 2020-04-22T14:13:48.974 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-04-22T14:13:48.974 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_num": 5799936, 2020-04-22T14:13:48.974 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_set": [ 2020-04-22T14:13:48.974 INFO:teuthology.orchestra.run.smithi103.stdout: "pglog_hardlimit", 2020-04-22T14:13:48.975 INFO:teuthology.orchestra.run.smithi103.stdout: "purged_snapdirs", 2020-04-22T14:13:48.975 INFO:teuthology.orchestra.run.smithi103.stdout: "recovery_deletes", 2020-04-22T14:13:48.975 INFO:teuthology.orchestra.run.smithi103.stdout: "sortbitwise" 2020-04-22T14:13:48.975 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:13:48.975 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_version": 5, 2020-04-22T14:13:48.975 INFO:teuthology.orchestra.run.smithi103.stdout: "full_ratio": 0.94999998807907104, 2020-04-22T14:13:48.975 INFO:teuthology.orchestra.run.smithi103.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-04-22T14:13:48.976 INFO:teuthology.orchestra.run.smithi103.stdout: "nearfull_ratio": 0.85000002384185791, 2020-04-22T14:13:48.976 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_snapshot": "", 2020-04-22T14:13:48.976 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_max": 14, 2020-04-22T14:13:48.979 INFO:teuthology.orchestra.run.smithi103.stdout: "max_osd": 8, 2020-04-22T14:13:48.979 INFO:teuthology.orchestra.run.smithi103.stdout: "require_min_compat_client": "luminous", 2020-04-22T14:13:48.979 INFO:teuthology.orchestra.run.smithi103.stdout: "min_compat_client": "jewel", 2020-04-22T14:13:48.979 INFO:teuthology.orchestra.run.smithi103.stdout: "require_osd_release": "pacific", 2020-04-22T14:13:48.979 INFO:teuthology.orchestra.run.smithi103.stdout: "pools": [ 2020-04-22T14:13:48.979 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:48.980 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 1, 2020-04-22T14:13:48.980 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "device_health_metrics", 2020-04-22T14:13:48.980 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:02:09.565655+0000", 2020-04-22T14:13:48.980 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:13:48.980 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:13:48.980 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:13:48.980 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:13:48.981 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:13:48.981 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:13:48.981 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:13:48.981 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:13:48.981 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 1, 2020-04-22T14:13:48.981 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 1, 2020-04-22T14:13:48.981 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 1, 2020-04-22T14:13:48.982 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 1, 2020-04-22T14:13:48.982 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 1, 2020-04-22T14:13:48.982 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:13:48.982 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:13:48.982 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:13:48.982 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:13:48.982 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:13:48.983 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:13:48.983 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:13:48.983 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:48.983 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "17", 2020-04-22T14:13:48.983 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:13:48.983 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:13:48.983 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:13:48.984 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:13:48.984 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:13:48.984 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:13:48.984 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:13:48.984 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:13:48.984 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:13:48.985 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:13:48.985 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:13:48.985 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:13:48.985 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:13:48.985 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:13:48.986 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:13:48.986 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:13:48.986 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:13:48.986 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:13:48.986 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:13:48.986 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:13:48.986 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:13:48.987 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:13:48.987 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:13:48.987 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:13:48.987 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:13:48.987 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:13:48.987 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:48.987 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:13:48.988 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:13:48.988 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:13:48.988 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:13:48.988 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:13:48.988 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:13:48.988 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:13:48.988 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:13:48.989 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:13:49.001 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:13:49.001 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:13:49.002 INFO:teuthology.orchestra.run.smithi103.stdout: "options": { 2020-04-22T14:13:49.002 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_min": 1 2020-04-22T14:13:49.002 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.002 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:13:49.002 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_devicehealth": {} 2020-04-22T14:13:49.003 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.003 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.003 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.003 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 2, 2020-04-22T14:13:49.003 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "rbd", 2020-04-22T14:13:49.003 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:02:22.733031+0000", 2020-04-22T14:13:49.004 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:13:49.004 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:13:49.004 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:13:49.004 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:13:49.004 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:13:49.004 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:13:49.004 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:13:49.005 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:13:49.005 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 8, 2020-04-22T14:13:49.005 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 8, 2020-04-22T14:13:49.005 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 8, 2020-04-22T14:13:49.005 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 8, 2020-04-22T14:13:49.005 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 8, 2020-04-22T14:13:49.005 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:13:49.006 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:13:49.006 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:13:49.006 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:13:49.006 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:13:49.006 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:13:49.006 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:13:49.006 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.006 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "20", 2020-04-22T14:13:49.007 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:13:49.013 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:13:49.013 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:13:49.013 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:13:49.014 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:13:49.014 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:13:49.014 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:13:49.014 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:13:49.014 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:13:49.014 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:13:49.015 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:13:49.015 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:13:49.015 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:13:49.015 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:13:49.015 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:13:49.015 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:13:49.015 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:13:49.016 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:13:49.016 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:13:49.016 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:13:49.016 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:13:49.016 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:13:49.016 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:13:49.016 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:13:49.017 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:13:49.017 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:13:49.017 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.017 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:13:49.033 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:13:49.033 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:13:49.033 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:13:49.033 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:13:49.034 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:13:49.034 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:13:49.034 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:13:49.034 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:13:49.034 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:13:49.034 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:13:49.034 INFO:teuthology.orchestra.run.smithi103.stdout: "options": {}, 2020-04-22T14:13:49.035 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:13:49.035 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd": {} 2020-04-22T14:13:49.035 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.035 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.035 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.035 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 13, 2020-04-22T14:13:49.035 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "cephfs_metadata", 2020-04-22T14:13:49.035 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:12:16.799055+0000", 2020-04-22T14:13:49.036 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:13:49.036 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:13:49.036 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:13:49.036 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:13:49.043 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:13:49.043 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:13:49.043 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:13:49.043 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:13:49.044 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 8, 2020-04-22T14:13:49.044 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 8, 2020-04-22T14:13:49.044 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 8, 2020-04-22T14:13:49.044 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 8, 2020-04-22T14:13:49.044 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 8, 2020-04-22T14:13:49.044 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:13:49.044 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:13:49.045 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:13:49.045 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:13:49.045 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:13:49.045 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:13:49.045 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:13:49.045 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.045 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "76", 2020-04-22T14:13:49.045 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:13:49.046 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:13:49.046 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:13:49.046 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:13:49.046 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:13:49.046 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:13:49.046 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:13:49.046 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:13:49.047 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:13:49.047 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:13:49.047 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:13:49.047 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:13:49.047 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:13:49.047 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:13:49.047 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:13:49.047 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:13:49.048 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:13:49.048 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:13:49.048 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:13:49.048 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:13:49.048 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:13:49.048 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:13:49.048 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:13:49.048 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:13:49.049 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:13:49.049 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:13:49.049 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.049 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:13:49.049 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:13:49.049 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:13:49.049 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:13:49.050 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:13:49.050 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:13:49.050 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:13:49.050 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:13:49.050 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:13:49.050 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:13:49.050 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:13:49.051 INFO:teuthology.orchestra.run.smithi103.stdout: "options": { 2020-04-22T14:13:49.051 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_bias": 4, 2020-04-22T14:13:49.051 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_min": 16, 2020-04-22T14:13:49.051 INFO:teuthology.orchestra.run.smithi103.stdout: "recovery_priority": 5 2020-04-22T14:13:49.051 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.051 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:13:49.052 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs": { 2020-04-22T14:13:49.052 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": "cephfs" 2020-04-22T14:13:49.052 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.052 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.052 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.052 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.052 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 14, 2020-04-22T14:13:49.053 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "cephfs_data", 2020-04-22T14:13:49.053 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:12:17.819603+0000", 2020-04-22T14:13:49.053 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:13:49.053 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:13:49.053 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:13:49.053 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:13:49.053 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:13:49.053 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:13:49.054 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:13:49.054 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:13:49.054 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 8, 2020-04-22T14:13:49.054 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 8, 2020-04-22T14:13:49.054 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 8, 2020-04-22T14:13:49.054 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 8, 2020-04-22T14:13:49.054 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 8, 2020-04-22T14:13:49.055 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:13:49.055 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:13:49.055 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:13:49.055 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:13:49.055 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:13:49.055 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:13:49.055 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:13:49.055 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.056 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "77", 2020-04-22T14:13:49.056 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:13:49.056 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:13:49.056 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:13:49.056 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:13:49.056 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:13:49.056 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:13:49.057 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:13:49.057 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:13:49.057 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:13:49.057 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:13:49.058 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:13:49.058 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:13:49.058 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:13:49.058 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:13:49.058 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:13:49.058 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:13:49.058 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:13:49.059 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:13:49.059 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:13:49.059 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:13:49.059 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:13:49.059 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:13:49.059 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:13:49.059 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:13:49.060 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:13:49.060 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:13:49.060 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.061 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:13:49.061 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:13:49.061 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:13:49.061 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:13:49.061 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:13:49.062 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:13:49.062 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:13:49.062 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:13:49.062 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:13:49.063 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:13:49.063 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:13:49.063 INFO:teuthology.orchestra.run.smithi103.stdout: "options": {}, 2020-04-22T14:13:49.063 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:13:49.063 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs": { 2020-04-22T14:13:49.063 INFO:teuthology.orchestra.run.smithi103.stdout: "data": "cephfs" 2020-04-22T14:13:49.063 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.064 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.064 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.064 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:13:49.064 INFO:teuthology.orchestra.run.smithi103.stdout: "osds": [ 2020-04-22T14:13:49.064 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.064 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 0, 2020-04-22T14:13:49.064 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "3546145b-bd93-4a79-b6fe-3158153b8f05", 2020-04-22T14:13:49.064 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:13:49.065 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:13:49.065 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:13:49.065 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:13:49.065 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:13:49.065 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:13:49.065 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:13:49.065 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 75, 2020-04-22T14:13:49.066 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:13:49.066 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:13:49.066 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:13:49.066 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:13:49.066 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.066 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:13:49.066 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6800", 2020-04-22T14:13:49.066 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:13:49.067 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.067 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.067 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:13:49.067 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6801", 2020-04-22T14:13:49.067 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:13:49.067 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.067 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:13:49.068 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.068 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:13:49.068 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:13:49.068 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.068 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:13:49.068 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6802", 2020-04-22T14:13:49.068 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:13:49.068 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.069 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.069 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:13:49.069 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6803", 2020-04-22T14:13:49.069 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:13:49.069 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.069 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:13:49.069 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.070 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:13:49.070 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:13:49.070 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.070 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:13:49.070 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6806", 2020-04-22T14:13:49.070 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:13:49.070 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.070 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.071 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:13:49.071 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6807", 2020-04-22T14:13:49.071 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:13:49.071 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.071 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:13:49.072 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.075 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:13:49.075 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:13:49.075 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.075 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:13:49.076 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6804", 2020-04-22T14:13:49.076 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:13:49.076 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.076 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.076 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:13:49.076 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6805", 2020-04-22T14:13:49.076 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:13:49.077 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.077 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:13:49.077 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.077 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6801/33072", 2020-04-22T14:13:49.077 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6803/33072", 2020-04-22T14:13:49.077 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6807/33072", 2020-04-22T14:13:49.078 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6805/33072", 2020-04-22T14:13:49.078 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:13:49.078 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:13:49.078 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:13:49.078 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:13:49.078 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.079 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.079 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 1, 2020-04-22T14:13:49.079 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "65ca5f7d-2ea6-4de6-a034-08a0a99aa80d", 2020-04-22T14:13:49.079 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:13:49.079 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:13:49.079 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:13:49.080 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:13:49.080 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:13:49.080 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:13:49.080 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:13:49.080 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 62, 2020-04-22T14:13:49.081 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:13:49.081 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:13:49.081 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:13:49.081 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:13:49.081 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.081 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:13:49.081 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6808", 2020-04-22T14:13:49.082 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:13:49.082 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.082 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.082 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:13:49.082 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6809", 2020-04-22T14:13:49.082 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:13:49.083 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.083 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:13:49.083 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.084 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:13:49.084 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:13:49.084 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.084 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:13:49.084 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6810", 2020-04-22T14:13:49.084 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:13:49.084 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.085 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.085 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:13:49.086 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6811", 2020-04-22T14:13:49.086 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:13:49.086 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.086 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:13:49.086 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.086 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:13:49.087 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:13:49.087 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.087 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:13:49.087 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6814", 2020-04-22T14:13:49.087 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:13:49.087 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.088 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.088 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:13:49.088 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6815", 2020-04-22T14:13:49.088 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:13:49.088 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.089 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:13:49.089 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.089 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:13:49.089 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:13:49.090 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.090 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:13:49.090 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6812", 2020-04-22T14:13:49.090 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:13:49.090 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.091 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.091 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:13:49.091 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6813", 2020-04-22T14:13:49.091 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:13:49.091 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.091 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:13:49.091 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.092 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6809/33103", 2020-04-22T14:13:49.092 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6811/33103", 2020-04-22T14:13:49.092 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6815/33103", 2020-04-22T14:13:49.092 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6813/33103", 2020-04-22T14:13:49.092 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:13:49.092 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:13:49.092 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:13:49.093 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:13:49.093 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.093 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.093 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 2, 2020-04-22T14:13:49.093 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "f2e9bf44-c844-48d7-b6c2-f08ea71189b4", 2020-04-22T14:13:49.093 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:13:49.093 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:13:49.094 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:13:49.094 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:13:49.094 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:13:49.094 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:13:49.094 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:13:49.094 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 75, 2020-04-22T14:13:49.094 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:13:49.094 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:13:49.095 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:13:49.095 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:13:49.095 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.095 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:13:49.095 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6816", 2020-04-22T14:13:49.095 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:13:49.095 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.096 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.096 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:13:49.096 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6817", 2020-04-22T14:13:49.096 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:13:49.096 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.097 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:13:49.097 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.097 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:13:49.097 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:13:49.097 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.097 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:13:49.097 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6818", 2020-04-22T14:13:49.097 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:13:49.098 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.098 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.098 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:13:49.099 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6819", 2020-04-22T14:13:49.099 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:13:49.099 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.099 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:13:49.099 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.100 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:13:49.100 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:13:49.100 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.100 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:13:49.100 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6822", 2020-04-22T14:13:49.100 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:13:49.100 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.101 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.101 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:13:49.101 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6823", 2020-04-22T14:13:49.101 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:13:49.101 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.101 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:13:49.101 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.101 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:13:49.102 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:13:49.102 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.102 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:13:49.102 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6820", 2020-04-22T14:13:49.102 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:13:49.102 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.102 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.103 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:13:49.103 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6821", 2020-04-22T14:13:49.103 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:13:49.103 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.103 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:13:49.103 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.103 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6817/33153", 2020-04-22T14:13:49.104 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6819/33153", 2020-04-22T14:13:49.104 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6823/33153", 2020-04-22T14:13:49.104 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6821/33153", 2020-04-22T14:13:49.104 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:13:49.104 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:13:49.104 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:13:49.104 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:13:49.105 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.105 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.105 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 3, 2020-04-22T14:13:49.105 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "0ab87fee-a427-4906-851a-b9bd8c2e5645", 2020-04-22T14:13:49.105 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:13:49.105 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:13:49.105 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:13:49.105 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:13:49.106 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:13:49.106 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:13:49.106 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:13:49.106 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 75, 2020-04-22T14:13:49.106 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:13:49.106 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:13:49.106 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:13:49.107 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:13:49.107 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.107 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:13:49.107 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6824", 2020-04-22T14:13:49.107 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:13:49.107 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.107 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.107 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:13:49.108 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6825", 2020-04-22T14:13:49.108 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:13:49.108 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.108 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:13:49.108 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.108 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:13:49.108 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:13:49.108 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.109 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:13:49.109 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6826", 2020-04-22T14:13:49.109 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:13:49.109 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.109 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.109 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:13:49.109 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6827", 2020-04-22T14:13:49.110 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:13:49.110 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.110 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:13:49.110 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.110 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:13:49.110 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:13:49.110 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.110 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:13:49.111 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6830", 2020-04-22T14:13:49.111 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:13:49.111 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.111 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.111 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:13:49.111 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6831", 2020-04-22T14:13:49.111 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:13:49.111 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.112 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:13:49.112 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.112 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:13:49.112 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:13:49.112 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.112 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:13:49.112 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6828", 2020-04-22T14:13:49.112 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:13:49.113 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.113 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.113 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:13:49.113 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6829", 2020-04-22T14:13:49.113 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:13:49.113 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.113 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:13:49.114 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.114 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6825/33183", 2020-04-22T14:13:49.114 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6827/33183", 2020-04-22T14:13:49.114 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6831/33183", 2020-04-22T14:13:49.114 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6829/33183", 2020-04-22T14:13:49.114 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:13:49.114 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:13:49.114 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:13:49.115 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:13:49.115 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.115 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.115 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 4, 2020-04-22T14:13:49.115 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "2565df7d-2eff-484b-a3cd-ed7715e5d875", 2020-04-22T14:13:49.115 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:13:49.115 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:13:49.115 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:13:49.116 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:13:49.116 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:13:49.116 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:13:49.116 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:13:49.116 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 74, 2020-04-22T14:13:49.116 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:13:49.116 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:13:49.116 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:13:49.117 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:13:49.117 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.117 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:13:49.117 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6802", 2020-04-22T14:13:49.117 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:13:49.117 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.117 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.118 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:13:49.118 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6803", 2020-04-22T14:13:49.118 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:13:49.118 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.118 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:13:49.118 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.118 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:13:49.118 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:13:49.119 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.119 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:13:49.119 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6804", 2020-04-22T14:13:49.119 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:13:49.119 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.119 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.119 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:13:49.119 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6805", 2020-04-22T14:13:49.120 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:13:49.120 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.120 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:13:49.120 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.120 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:13:49.120 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:13:49.120 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.120 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:13:49.121 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6808", 2020-04-22T14:13:49.121 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:13:49.121 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.121 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.121 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:13:49.121 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6809", 2020-04-22T14:13:49.121 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:13:49.121 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.122 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:13:49.122 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.122 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:13:49.122 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:13:49.122 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.122 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:13:49.122 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6806", 2020-04-22T14:13:49.122 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:13:49.123 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.123 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.123 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:13:49.123 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6807", 2020-04-22T14:13:49.123 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:13:49.123 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.123 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:13:49.124 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.124 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6803/33506", 2020-04-22T14:13:49.124 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6805/33506", 2020-04-22T14:13:49.124 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6809/33506", 2020-04-22T14:13:49.124 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6807/33506", 2020-04-22T14:13:49.124 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:13:49.124 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:13:49.124 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:13:49.125 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:13:49.125 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.125 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.125 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 5, 2020-04-22T14:13:49.125 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "bcfd7a16-6914-4152-8647-a481917fe19d", 2020-04-22T14:13:49.125 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:13:49.125 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:13:49.125 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:13:49.126 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:13:49.126 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:13:49.126 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:13:49.126 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:13:49.126 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 75, 2020-04-22T14:13:49.127 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:13:49.127 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:13:49.127 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:13:49.127 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:13:49.127 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.127 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:13:49.128 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6810", 2020-04-22T14:13:49.128 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:13:49.128 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.128 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.128 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:13:49.128 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6811", 2020-04-22T14:13:49.128 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:13:49.128 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.129 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:13:49.129 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.129 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:13:49.129 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:13:49.129 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.129 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:13:49.129 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6812", 2020-04-22T14:13:49.129 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:13:49.130 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.130 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.130 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:13:49.130 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6813", 2020-04-22T14:13:49.130 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:13:49.130 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.130 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:13:49.130 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.131 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:13:49.131 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:13:49.131 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.131 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:13:49.131 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6816", 2020-04-22T14:13:49.131 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:13:49.131 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.132 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.132 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:13:49.132 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6817", 2020-04-22T14:13:49.132 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:13:49.132 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.132 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:13:49.132 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.132 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:13:49.133 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:13:49.133 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.133 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:13:49.133 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6814", 2020-04-22T14:13:49.133 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:13:49.133 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.133 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.133 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:13:49.134 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6815", 2020-04-22T14:13:49.134 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:13:49.134 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.134 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:13:49.134 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.134 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6811/33554", 2020-04-22T14:13:49.134 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6813/33554", 2020-04-22T14:13:49.135 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6817/33554", 2020-04-22T14:13:49.135 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6815/33554", 2020-04-22T14:13:49.135 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:13:49.135 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:13:49.135 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:13:49.135 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:13:49.135 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.135 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.136 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 6, 2020-04-22T14:13:49.136 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050", 2020-04-22T14:13:49.136 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:13:49.136 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:13:49.137 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:13:49.137 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:13:49.137 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:13:49.137 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:13:49.137 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:13:49.137 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 75, 2020-04-22T14:13:49.137 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:13:49.138 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:13:49.138 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:13:49.138 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:13:49.138 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.138 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:13:49.138 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6818", 2020-04-22T14:13:49.138 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:13:49.138 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.139 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.139 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:13:49.139 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6819", 2020-04-22T14:13:49.139 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:13:49.139 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.139 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:13:49.139 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.139 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:13:49.140 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:13:49.140 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.140 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:13:49.140 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6820", 2020-04-22T14:13:49.140 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:13:49.140 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.140 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.141 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:13:49.141 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6821", 2020-04-22T14:13:49.141 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:13:49.141 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.141 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:13:49.141 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.141 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:13:49.141 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:13:49.142 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.142 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:13:49.142 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6824", 2020-04-22T14:13:49.142 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:13:49.142 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.142 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.142 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:13:49.142 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6825", 2020-04-22T14:13:49.143 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:13:49.143 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.143 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:13:49.143 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.143 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:13:49.143 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:13:49.143 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.144 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:13:49.144 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6822", 2020-04-22T14:13:49.144 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:13:49.144 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.144 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.144 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:13:49.144 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6823", 2020-04-22T14:13:49.144 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:13:49.145 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.145 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:13:49.145 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.145 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6819/33601", 2020-04-22T14:13:49.145 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6821/33601", 2020-04-22T14:13:49.145 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6825/33601", 2020-04-22T14:13:49.145 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6823/33601", 2020-04-22T14:13:49.145 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:13:49.146 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:13:49.146 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:13:49.146 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:13:49.146 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.146 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.146 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 7, 2020-04-22T14:13:49.146 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "340eece1-4c39-47cd-b95f-9cfa5dcfe361", 2020-04-22T14:13:49.146 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:13:49.147 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:13:49.147 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:13:49.147 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:13:49.147 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:13:49.147 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:13:49.147 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:13:49.147 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 74, 2020-04-22T14:13:49.148 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:13:49.148 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:13:49.148 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:13:49.148 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:13:49.148 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.148 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:13:49.148 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6826", 2020-04-22T14:13:49.148 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:13:49.149 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.149 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.149 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:13:49.149 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6827", 2020-04-22T14:13:49.149 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:13:49.149 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.149 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:13:49.149 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.150 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:13:49.150 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:13:49.150 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.150 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:13:49.150 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6828", 2020-04-22T14:13:49.150 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:13:49.150 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.150 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.151 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:13:49.151 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6829", 2020-04-22T14:13:49.151 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:13:49.151 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.151 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:13:49.151 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.151 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:13:49.152 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:13:49.152 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.152 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:13:49.152 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6832", 2020-04-22T14:13:49.152 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:13:49.152 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.152 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.152 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:13:49.153 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6833", 2020-04-22T14:13:49.153 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:13:49.153 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.153 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:13:49.153 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.153 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:13:49.153 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:13:49.153 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.154 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:13:49.154 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6830", 2020-04-22T14:13:49.154 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:13:49.154 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.154 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.154 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:13:49.154 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6831", 2020-04-22T14:13:49.155 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:13:49.155 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.155 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:13:49.155 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.155 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6827/33629", 2020-04-22T14:13:49.156 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6829/33629", 2020-04-22T14:13:49.156 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6833/33629", 2020-04-22T14:13:49.156 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6831/33629", 2020-04-22T14:13:49.156 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:13:49.156 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:13:49.156 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:13:49.156 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:13:49.157 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.157 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:13:49.157 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_xinfo": [ 2020-04-22T14:13:49.157 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.157 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 0, 2020-04-22T14:13:49.157 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:13:49.157 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:13:49.157 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:13:49.158 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:13:49.158 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:13:49.158 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.384360+0000", 2020-04-22T14:13:49.158 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:13:49.158 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.158 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.159 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 1, 2020-04-22T14:13:49.159 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:13:49.159 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:13:49.159 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:13:49.159 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:13:49.159 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:13:49.159 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.503590+0000", 2020-04-22T14:13:49.160 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:13:49.160 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.160 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.160 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 2, 2020-04-22T14:13:49.160 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:13:49.160 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:13:49.160 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:13:49.161 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:13:49.161 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:13:49.161 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.525058+0000", 2020-04-22T14:13:49.161 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:13:49.161 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.161 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.161 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 3, 2020-04-22T14:13:49.161 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:13:49.162 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:13:49.162 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:13:49.162 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:13:49.162 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:13:49.162 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.599729+0000", 2020-04-22T14:13:49.162 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:13:49.162 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.162 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.163 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 4, 2020-04-22T14:13:49.163 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:13:49.163 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:13:49.163 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:13:49.163 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:13:49.163 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:13:49.163 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.600919+0000", 2020-04-22T14:13:49.164 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:13:49.164 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.164 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.164 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 5, 2020-04-22T14:13:49.164 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:13:49.164 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:13:49.164 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:13:49.164 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:13:49.165 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:13:49.165 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.654718+0000", 2020-04-22T14:13:49.165 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:13:49.165 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.165 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.165 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 6, 2020-04-22T14:13:49.165 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:13:49.166 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:13:49.166 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:13:49.166 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:13:49.166 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:13:49.166 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.718342+0000", 2020-04-22T14:13:49.166 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:13:49.166 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.166 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:49.167 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 7, 2020-04-22T14:13:49.167 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:13:49.167 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:13:49.167 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:13:49.167 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:13:49.167 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:13:49.167 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.839089+0000", 2020-04-22T14:13:49.167 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:13:49.168 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.168 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:13:49.168 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_upmap": [], 2020-04-22T14:13:49.168 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_upmap_items": [], 2020-04-22T14:13:49.168 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_temp": [], 2020-04-22T14:13:49.168 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_temp": [], 2020-04-22T14:13:49.168 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklist": { 2020-04-22T14:13:49.169 INFO:teuthology.orchestra.run.smithi103.stdout: "172.21.15.103:6833/46849623": "2020-04-23T14:12:39.098447+0000", 2020-04-22T14:13:49.169 INFO:teuthology.orchestra.run.smithi103.stdout: "172.21.15.103:0/3734229525": "2020-04-22T15:13:32.344388+0000", 2020-04-22T14:13:49.169 INFO:teuthology.orchestra.run.smithi103.stdout: "172.21.15.103:6832/46849623": "2020-04-23T14:12:39.098447+0000" 2020-04-22T14:13:49.169 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.169 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profiles": { 2020-04-22T14:13:49.169 INFO:teuthology.orchestra.run.smithi103.stdout: "default": { 2020-04-22T14:13:49.170 INFO:teuthology.orchestra.run.smithi103.stdout: "crush-failure-domain": "osd", 2020-04-22T14:13:49.170 INFO:teuthology.orchestra.run.smithi103.stdout: "k": "2", 2020-04-22T14:13:49.170 INFO:teuthology.orchestra.run.smithi103.stdout: "m": "1", 2020-04-22T14:13:49.170 INFO:teuthology.orchestra.run.smithi103.stdout: "plugin": "jerasure", 2020-04-22T14:13:49.170 INFO:teuthology.orchestra.run.smithi103.stdout: "ruleset-failure-domain": "osd", 2020-04-22T14:13:49.170 INFO:teuthology.orchestra.run.smithi103.stdout: "technique": "reed_sol_van" 2020-04-22T14:13:49.170 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:49.170 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:49.171 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps_queue": [], 2020-04-22T14:13:49.171 INFO:teuthology.orchestra.run.smithi103.stdout: "new_removed_snaps": [], 2020-04-22T14:13:49.171 INFO:teuthology.orchestra.run.smithi103.stdout: "new_purged_snaps": [], 2020-04-22T14:13:49.171 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_node_flags": {}, 2020-04-22T14:13:49.171 INFO:teuthology.orchestra.run.smithi103.stdout: "device_class_flags": {} 2020-04-22T14:13:49.171 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:13:49.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.970+0000 7f9a22c5d700 1 -- 172.21.15.103:0/2084200766 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f99fc04d8f0 msgr2=0x7f99fc04fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:49.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.970+0000 7f9a22c5d700 1 --2- 172.21.15.103:0/2084200766 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f99fc04d8f0 0x7f99fc04fdb0 secure :-1 s=READY pgs=471 cs=0 l=1 rx=0x7f9a0c000fa0 tx=0x7f9a0c003a00).stop 2020-04-22T14:13:49.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.970+0000 7f9a22c5d700 1 -- 172.21.15.103:0/2084200766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a1c0b05e0 msgr2=0x7f9a1c0b4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:49.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.970+0000 7f9a22c5d700 1 --2- 172.21.15.103:0/2084200766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a1c0b05e0 0x7f9a1c0b4490 secure :-1 s=READY pgs=1283 cs=0 l=1 rx=0x7f9a10000e50 tx=0x7f9a10012c20).stop 2020-04-22T14:13:49.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.970+0000 7f9a22c5d700 1 -- 172.21.15.103:0/2084200766 shutdown_connections 2020-04-22T14:13:49.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.970+0000 7f9a22c5d700 1 --2- 172.21.15.103:0/2084200766 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f99fc04d8f0 0x7f99fc04fdb0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:49.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.970+0000 7f9a22c5d700 1 --2- 172.21.15.103:0/2084200766 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a1c126d00 0x7f9a1c127170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:49.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.970+0000 7f9a22c5d700 1 --2- 172.21.15.103:0/2084200766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a1c0b05e0 0x7f9a1c0b4490 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:49.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.970+0000 7f9a22c5d700 1 -- 172.21.15.103:0/2084200766 >> 172.21.15.103:0/2084200766 conn(0x7f9a1c0b9160 msgr2=0x7f9a1c061540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:49.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.971+0000 7f9a22c5d700 1 -- 172.21.15.103:0/2084200766 shutdown_connections 2020-04-22T14:13:49.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:48.971+0000 7f9a22c5d700 1 -- 172.21.15.103:0/2084200766 wait complete. 2020-04-22T14:13:49.175 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:49.189 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:13:49.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.330+0000 7f6322c0c700 1 Processor -- start 2020-04-22T14:13:49.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.331+0000 7f6322c0c700 1 -- start start 2020-04-22T14:13:49.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.331+0000 7f6322c0c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f631c0620a0 0x7f631c142e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:49.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.331+0000 7f6322c0c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f631c0ad900 0x7f631c0addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:49.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.331+0000 7f6322c0c700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f631c143810 con 0x7f631c143280 2020-04-22T14:13:49.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.331+0000 7f6322c0c700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f631c143ab0 con 0x7f631c0620a0 2020-04-22T14:13:49.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.331+0000 7f6322c0c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f631c143d50 con 0x7f631c0ad900 2020-04-22T14:13:49.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.332+0000 7f6321c0a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f631c0620a0 0x7f631c142e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:49.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.332+0000 7f6321c0a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f631c0620a0 0x7f631c142e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53966/0 (socket says 172.21.15.103:53966) 2020-04-22T14:13:49.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.332+0000 7f6321c0a700 1 -- 172.21.15.103:0/3425641723 learned_addr learned my addr 172.21.15.103:0/3425641723 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:49.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.332+0000 7f632240b700 1 --2- 172.21.15.103:0/3425641723 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f631c0ad900 0x7f631c0addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:49.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.332+0000 7f6321c0a700 1 -- 172.21.15.103:0/3425641723 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f631c0ad900 msgr2=0x7f631c0addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:49.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.332+0000 7f6321c0a700 1 --2- 172.21.15.103:0/3425641723 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f631c0ad900 0x7f631c0addb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:49.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.332+0000 7f6321c0a700 1 -- 172.21.15.103:0/3425641723 >> v1:172.21.15.86:6789/0 conn(0x7f631c143280 legacy=0x7f631c146ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:49.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.332+0000 7f6321c0a700 1 -- 172.21.15.103:0/3425641723 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f631c062480 con 0x7f631c0620a0 2020-04-22T14:13:49.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.332+0000 7f6321c0a700 1 --2- 172.21.15.103:0/3425641723 >> v2:172.21.15.103:3300/0 conn(0x7f631c0620a0 0x7f631c142e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6318002f30 tx=0x7f6318007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:49.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.332+0000 7f6321c0a700 1 --2- 172.21.15.103:0/3425641723 >> v2:172.21.15.103:3300/0 conn(0x7f631c0620a0 0x7f631c142e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6318002f30 tx=0x7f6318007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:49.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.332+0000 7f6321c0a700 1 --2- 172.21.15.103:0/3425641723 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f631c0620a0 0x7f631c142e20 secure :-1 s=READY pgs=1284 cs=0 l=1 rx=0x7f6318002f30 tx=0x7f6318007a40).ready entity=mon.1 client_cookie=b7d75f3cda008866 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:49.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.332+0000 7f6321c0a700 1 --2- 172.21.15.103:0/3425641723 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f631c0620a0 0x7f631c142e20 secure :-1 s=THROTTLE_DONE pgs=1284 cs=0 l=1 rx=0x7f6318002f30 tx=0x7f6318007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:49.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.332+0000 7f6320c08700 1 -- 172.21.15.103:0/3425641723 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6318008e10 con 0x7f631c0620a0 2020-04-22T14:13:49.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.332+0000 7f6321c0a700 1 --2- 172.21.15.103:0/3425641723 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f631c0620a0 0x7f631c142e20 secure :-1 s=THROTTLE_DONE pgs=1284 cs=0 l=1 rx=0x7f6318002f30 tx=0x7f6318007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:49.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.332+0000 7f6321c0a700 1 --2- 172.21.15.103:0/3425641723 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f631c0620a0 0x7f631c142e20 secure :-1 s=THROTTLE_DONE pgs=1284 cs=0 l=1 rx=0x7f6318002f30 tx=0x7f6318007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:49.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.332+0000 7f6320c08700 1 -- 172.21.15.103:0/3425641723 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63180107c0 con 0x7f631c0620a0 2020-04-22T14:13:49.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.332+0000 7f6320c08700 1 -- 172.21.15.103:0/3425641723 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6318010be0 con 0x7f631c0620a0 2020-04-22T14:13:49.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.332+0000 7f6322c0c700 1 -- 172.21.15.103:0/3425641723 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f631c0620a0 msgr2=0x7f631c142e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:49.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.332+0000 7f6322c0c700 1 --2- 172.21.15.103:0/3425641723 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f631c0620a0 0x7f631c142e20 secure :-1 s=READY pgs=1284 cs=0 l=1 rx=0x7f6318002f30 tx=0x7f6318007a40).stop 2020-04-22T14:13:49.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.333+0000 7f6322c0c700 1 -- 172.21.15.103:0/3425641723 shutdown_connections 2020-04-22T14:13:49.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.333+0000 7f6322c0c700 1 --2- 172.21.15.103:0/3425641723 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f631c0ad900 0x7f631c0addb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:49.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.333+0000 7f6322c0c700 1 --2- 172.21.15.103:0/3425641723 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f631c0620a0 0x7f631c142e20 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:49.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.333+0000 7f6322c0c700 1 -- 172.21.15.103:0/3425641723 >> 172.21.15.103:0/3425641723 conn(0x7f631c05b7c0 msgr2=0x7f631c061610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:49.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.333+0000 7f6322c0c700 1 -- 172.21.15.103:0/3425641723 shutdown_connections 2020-04-22T14:13:49.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.333+0000 7f6322c0c700 1 -- 172.21.15.103:0/3425641723 wait complete. 2020-04-22T14:13:49.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.334+0000 7f6322c0c700 1 Processor -- start 2020-04-22T14:13:49.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.334+0000 7f6322c0c700 1 -- start start 2020-04-22T14:13:49.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.334+0000 7f6322c0c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f631c0ad900 0x7f631c12a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:49.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.334+0000 7f6322c0c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f631c143280 0x7f631c12ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:49.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.334+0000 7f6322c0c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f631c129740 con 0x7f631c0620a0 2020-04-22T14:13:49.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.334+0000 7f6322c0c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f631c157c10 con 0x7f631c0ad900 2020-04-22T14:13:49.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.334+0000 7f6322c0c700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f631c157eb0 con 0x7f631c143280 2020-04-22T14:13:49.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.334+0000 7f6321c0a700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f631c0620a0 0x7f631c157110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46162/0 (socket says 172.21.15.103:46162) 2020-04-22T14:13:49.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.334+0000 7f6321c0a700 1 -- 172.21.15.103:0/1690759385 learned_addr learned my addr 172.21.15.103:0/1690759385 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:49.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.334+0000 7f632240b700 1 --2- 172.21.15.103:0/1690759385 >> v2:172.21.15.103:3300/0 conn(0x7f631c143280 0x7f631c12ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:49.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.335+0000 7f6321409700 1 --2- 172.21.15.103:0/1690759385 >> v2:172.21.15.86:3300/0 conn(0x7f631c0ad900 0x7f631c12a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:49.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.335+0000 7f632240b700 1 -- 172.21.15.103:0/1690759385 >> v2:172.21.15.86:3300/0 conn(0x7f631c0ad900 msgr2=0x7f631c12a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:49.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.335+0000 7f632240b700 1 --2- 172.21.15.103:0/1690759385 >> v2:172.21.15.86:3300/0 conn(0x7f631c0ad900 0x7f631c12a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:49.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.335+0000 7f632240b700 1 -- 172.21.15.103:0/1690759385 >> v1:172.21.15.103:6789/0 conn(0x7f631c0620a0 legacy=0x7f631c157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:49.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.335+0000 7f632240b700 1 -- 172.21.15.103:0/1690759385 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f631c157820 con 0x7f631c143280 2020-04-22T14:13:49.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.335+0000 7f630effd700 1 -- 172.21.15.103:0/1690759385 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3252339635 0 0) 0x7f631c129740 con 0x7f631c0620a0 2020-04-22T14:13:49.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.335+0000 7f632240b700 1 --2- 172.21.15.103:0/1690759385 >> v2:172.21.15.103:3300/0 conn(0x7f631c143280 0x7f631c12ace0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f63140032b0 tx=0x7f6314010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:49.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.335+0000 7f632240b700 1 --2- 172.21.15.103:0/1690759385 >> v2:172.21.15.103:3300/0 conn(0x7f631c143280 0x7f631c12ace0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f63140032b0 tx=0x7f6314010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:49.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.335+0000 7f632240b700 1 --2- 172.21.15.103:0/1690759385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f631c143280 0x7f631c12ace0 secure :-1 s=READY pgs=1286 cs=0 l=1 rx=0x7f63140032b0 tx=0x7f6314010ea0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:49.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.335+0000 7f632240b700 1 --2- 172.21.15.103:0/1690759385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f631c143280 0x7f631c12ace0 secure :-1 s=THROTTLE_DONE pgs=1286 cs=0 l=1 rx=0x7f63140032b0 tx=0x7f6314010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:49.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.335+0000 7f630effd700 1 -- 172.21.15.103:0/1690759385 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6314007370 con 0x7f631c143280 2020-04-22T14:13:49.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.335+0000 7f632240b700 1 --2- 172.21.15.103:0/1690759385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f631c143280 0x7f631c12ace0 secure :-1 s=THROTTLE_DONE pgs=1286 cs=0 l=1 rx=0x7f63140032b0 tx=0x7f6314010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:49.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.335+0000 7f632240b700 1 --2- 172.21.15.103:0/1690759385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f631c143280 0x7f631c12ace0 secure :-1 s=THROTTLE_DONE pgs=1286 cs=0 l=1 rx=0x7f63140032b0 tx=0x7f6314010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:49.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.335+0000 7f630effd700 1 -- 172.21.15.103:0/1690759385 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63140074d0 con 0x7f631c143280 2020-04-22T14:13:49.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.335+0000 7f6322c0c700 1 -- 172.21.15.103:0/1690759385 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f631c129ba0 con 0x7f631c143280 2020-04-22T14:13:49.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.335+0000 7f630effd700 1 -- 172.21.15.103:0/1690759385 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6314007830 con 0x7f631c143280 2020-04-22T14:13:49.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.335+0000 7f6322c0c700 1 -- 172.21.15.103:0/1690759385 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f631c1429f0 con 0x7f631c143280 2020-04-22T14:13:49.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.336+0000 7f632240b700 1 --2- 172.21.15.103:0/1690759385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f631c143280 0x7f631c12ace0 secure :-1 s=THROTTLE_DONE pgs=1286 cs=0 l=1 rx=0x7f63140032b0 tx=0x7f6314010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:49.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.336+0000 7f630effd700 1 -- 172.21.15.103:0/1690759385 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f6314012540 con 0x7f631c143280 2020-04-22T14:13:49.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.336+0000 7f632240b700 1 --2- 172.21.15.103:0/1690759385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f631c143280 0x7f631c12ace0 secure :-1 s=THROTTLE_DONE pgs=1286 cs=0 l=1 rx=0x7f63140032b0 tx=0x7f6314010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:49.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.336+0000 7f6322c0c700 1 -- 172.21.15.103:0/1690759385 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f631c157a70 con 0x7f631c143280 2020-04-22T14:13:49.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.336+0000 7f630effd700 1 --2- 172.21.15.103:0/1690759385 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f62fc04d900 0x7f62fc04fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:49.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.336+0000 7f630effd700 1 -- 172.21.15.103:0/1690759385 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f6314061740 con 0x7f631c143280 2020-04-22T14:13:49.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.337+0000 7f6321c0a700 1 --2- 172.21.15.103:0/1690759385 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f62fc04d900 0x7f62fc04fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:49.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.337+0000 7f6321c0a700 1 --2- 172.21.15.103:0/1690759385 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f62fc04d900 0x7f62fc04fdc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6318008320 tx=0x7f6318007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:49.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.337+0000 7f6321c0a700 1 --2- 172.21.15.103:0/1690759385 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f62fc04d900 0x7f62fc04fdc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6318008320 tx=0x7f6318007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:49.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.337+0000 7f6321c0a700 1 --2- 172.21.15.103:0/1690759385 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f62fc04d900 0x7f62fc04fdc0 secure :-1 s=READY pgs=472 cs=0 l=1 rx=0x7f6318008320 tx=0x7f6318007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:49.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.340+0000 7f632240b700 1 --2- 172.21.15.103:0/1690759385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f631c143280 0x7f631c12ace0 secure :-1 s=THROTTLE_DONE pgs=1286 cs=0 l=1 rx=0x7f63140032b0 tx=0x7f6314010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:49.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.340+0000 7f630effd700 1 -- 172.21.15.103:0/1690759385 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f631c157a70 con 0x7f631c143280 2020-04-22T14:13:49.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.532+0000 7f6322c0c700 1 -- 172.21.15.103:0/1690759385 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f631c1298d0 con 0x7f631c143280 2020-04-22T14:13:49.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.532+0000 7f632240b700 1 --2- 172.21.15.103:0/1690759385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f631c143280 0x7f631c12ace0 secure :-1 s=THROTTLE_DONE pgs=1286 cs=0 l=1 rx=0x7f63140032b0 tx=0x7f6314010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:49.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.532+0000 7f630effd700 1 -- 172.21.15.103:0/1690759385 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+2145 (secure 0 0 0) 0x7f631403cb20 con 0x7f631c143280 2020-04-22T14:13:49.536 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:13:49.536 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":56,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:13:34.470492+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7291":{"gid":7291,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":16,"addr":"172.21.15.103:6833/3831800052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3831800052},{"type":"v1","addr":"172.21.15.103:6833","nonce":3831800052}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:13:49.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.533+0000 7f6322c0c700 1 -- 172.21.15.103:0/1690759385 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f62fc04d900 msgr2=0x7f62fc04fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:49.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.533+0000 7f6322c0c700 1 --2- 172.21.15.103:0/1690759385 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f62fc04d900 0x7f62fc04fdc0 secure :-1 s=READY pgs=472 cs=0 l=1 rx=0x7f6318008320 tx=0x7f6318007a40).stop 2020-04-22T14:13:49.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.533+0000 7f6322c0c700 1 -- 172.21.15.103:0/1690759385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f631c143280 msgr2=0x7f631c12ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:49.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.533+0000 7f6322c0c700 1 --2- 172.21.15.103:0/1690759385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f631c143280 0x7f631c12ace0 secure :-1 s=READY pgs=1286 cs=0 l=1 rx=0x7f63140032b0 tx=0x7f6314010ea0).stop 2020-04-22T14:13:49.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.533+0000 7f6322c0c700 1 -- 172.21.15.103:0/1690759385 shutdown_connections 2020-04-22T14:13:49.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.533+0000 7f6322c0c700 1 --2- 172.21.15.103:0/1690759385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f631c143280 0x7f631c12ace0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:49.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.533+0000 7f6322c0c700 1 --2- 172.21.15.103:0/1690759385 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f62fc04d900 0x7f62fc04fdc0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:49.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.533+0000 7f6322c0c700 1 --2- 172.21.15.103:0/1690759385 >> v2:172.21.15.86:3300/0 conn(0x7f631c0ad900 0x7f631c12a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:49.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.533+0000 7f6322c0c700 1 -- 172.21.15.103:0/1690759385 >> 172.21.15.103:0/1690759385 conn(0x7f631c05b7c0 msgr2=0x7f631c0b5060 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:49.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.534+0000 7f6322c0c700 1 -- 172.21.15.103:0/1690759385 shutdown_connections 2020-04-22T14:13:49.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.534+0000 7f6322c0c700 1 -- 172.21.15.103:0/1690759385 wait complete. 2020-04-22T14:13:49.539 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 56 2020-04-22T14:13:49.548 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:49.561 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2020-04-22T14:13:49.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.707+0000 7f5e35556700 1 Processor -- start 2020-04-22T14:13:49.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.707+0000 7f5e35556700 1 -- start start 2020-04-22T14:13:49.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.708+0000 7f5e35556700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e300ad360 0x7f5e300af750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:49.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.708+0000 7f5e35556700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e3014a800 con 0x7f5e30147e60 2020-04-22T14:13:49.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.708+0000 7f5e35556700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e3014aaa0 con 0x7f5e3014b480 2020-04-22T14:13:49.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.708+0000 7f5e35556700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3014ad40 con 0x7f5e300ad360 2020-04-22T14:13:49.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.708+0000 7f5e2f7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f5e3014b480 0x7f5e3014b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46174/0 (socket says 172.21.15.103:46174) 2020-04-22T14:13:49.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.708+0000 7f5e2f7fe700 1 -- 172.21.15.103:0/3331588629 learned_addr learned my addr 172.21.15.103:0/3331588629 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:49.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.708+0000 7f5e2e7fc700 1 -- 172.21.15.103:0/3331588629 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1855436014 0 0) 0x7f5e3014aaa0 con 0x7f5e3014b480 2020-04-22T14:13:49.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.708+0000 7f5e27fff700 1 --2- 172.21.15.103:0/3331588629 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e300ad360 0x7f5e300af750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:49.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.708+0000 7f5e2e7fc700 1 -- 172.21.15.103:0/3331588629 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e10003230 con 0x7f5e3014b480 2020-04-22T14:13:49.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.708+0000 7f5e2e7fc700 1 -- 172.21.15.103:0/3331588629 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1592792722 0 0) 0x7f5e10003230 con 0x7f5e3014b480 2020-04-22T14:13:49.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.708+0000 7f5e2e7fc700 1 -- 172.21.15.103:0/3331588629 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e300ad360 msgr2=0x7f5e300af750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:49.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.708+0000 7f5e2e7fc700 1 --2- 172.21.15.103:0/3331588629 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e300ad360 0x7f5e300af750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:49.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.708+0000 7f5e2e7fc700 1 -- 172.21.15.103:0/3331588629 >> v1:172.21.15.86:6789/0 conn(0x7f5e30147e60 legacy=0x7f5e300ae9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:49.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.708+0000 7f5e2e7fc700 1 -- 172.21.15.103:0/3331588629 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e3014afe0 con 0x7f5e3014b480 2020-04-22T14:13:49.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.708+0000 7f5e2e7fc700 1 -- 172.21.15.103:0/3331588629 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f5e28001a90 con 0x7f5e3014b480 2020-04-22T14:13:49.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.708+0000 7f5e2e7fc700 1 -- 172.21.15.103:0/3331588629 >> v1:172.21.15.103:6789/0 conn(0x7f5e3014b480 legacy=0x7f5e3014b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:49.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.709+0000 7f5e2e7fc700 1 --2- 172.21.15.103:0/3331588629 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e300ad360 0x7f5e10003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:49.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.709+0000 7f5e2e7fc700 1 --2- 172.21.15.103:0/3331588629 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e10003b80 0x7f5e10003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:49.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.709+0000 7f5e2e7fc700 1 --2- 172.21.15.103:0/3331588629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e10004570 0x7f5e100049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:49.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.709+0000 7f5e2e7fc700 1 -- 172.21.15.103:0/3331588629 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3014ad40 con 0x7f5e10003b80 2020-04-22T14:13:49.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.709+0000 7f5e2e7fc700 1 -- 172.21.15.103:0/3331588629 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e10004f80 con 0x7f5e10004570 2020-04-22T14:13:49.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.709+0000 7f5e2e7fc700 1 -- 172.21.15.103:0/3331588629 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e10005140 con 0x7f5e300ad360 2020-04-22T14:13:49.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.709+0000 7f5e2f7fe700 1 --2- 172.21.15.103:0/3331588629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e10004570 0x7f5e100049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:49.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.709+0000 7f5e2effd700 1 --2- 172.21.15.103:0/3331588629 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e300ad360 0x7f5e10003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:49.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.709+0000 7f5e27fff700 1 --2- 172.21.15.103:0/3331588629 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e10003b80 0x7f5e10003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:49.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.709+0000 7f5e2f7fe700 1 -- 172.21.15.103:0/3331588629 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e300ad360 msgr2=0x7f5e10003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:49.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.709+0000 7f5e2f7fe700 1 --2- 172.21.15.103:0/3331588629 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e300ad360 0x7f5e10003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:49.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.709+0000 7f5e2f7fe700 1 -- 172.21.15.103:0/3331588629 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e10003b80 msgr2=0x7f5e10003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:49.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.709+0000 7f5e2f7fe700 1 --2- 172.21.15.103:0/3331588629 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e10003b80 0x7f5e10003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:49.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.709+0000 7f5e2f7fe700 1 -- 172.21.15.103:0/3331588629 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e10003230 con 0x7f5e10004570 2020-04-22T14:13:49.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.709+0000 7f5e27fff700 1 --2- 172.21.15.103:0/3331588629 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e10003b80 0x7f5e10003fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:13:49.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.709+0000 7f5e2f7fe700 1 --2- 172.21.15.103:0/3331588629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e10004570 0x7f5e100049d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5e280017a0 tx=0x7f5e3005b100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:49.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.709+0000 7f5e2f7fe700 1 --2- 172.21.15.103:0/3331588629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e10004570 0x7f5e100049d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5e280017a0 tx=0x7f5e3005b100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:49.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.709+0000 7f5e2f7fe700 1 --2- 172.21.15.103:0/3331588629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e10004570 0x7f5e100049d0 secure :-1 s=READY pgs=1288 cs=0 l=1 rx=0x7f5e280017a0 tx=0x7f5e3005b100).ready entity=mon.1 client_cookie=4ee3d83d6585938 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:49.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.709+0000 7f5e2f7fe700 1 --2- 172.21.15.103:0/3331588629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e10004570 0x7f5e100049d0 secure :-1 s=THROTTLE_DONE pgs=1288 cs=0 l=1 rx=0x7f5e280017a0 tx=0x7f5e3005b100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:49.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.709+0000 7f5e2e7fc700 1 -- 172.21.15.103:0/3331588629 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e28012430 con 0x7f5e10004570 2020-04-22T14:13:49.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.709+0000 7f5e2f7fe700 1 --2- 172.21.15.103:0/3331588629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e10004570 0x7f5e100049d0 secure :-1 s=THROTTLE_DONE pgs=1288 cs=0 l=1 rx=0x7f5e280017a0 tx=0x7f5e3005b100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:49.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.709+0000 7f5e2e7fc700 1 -- 172.21.15.103:0/3331588629 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e28012590 con 0x7f5e10004570 2020-04-22T14:13:49.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.709+0000 7f5e2f7fe700 1 --2- 172.21.15.103:0/3331588629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e10004570 0x7f5e100049d0 secure :-1 s=THROTTLE_DONE pgs=1288 cs=0 l=1 rx=0x7f5e280017a0 tx=0x7f5e3005b100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:49.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.709+0000 7f5e2e7fc700 1 -- 172.21.15.103:0/3331588629 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e28012970 con 0x7f5e10004570 2020-04-22T14:13:49.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.709+0000 7f5e35556700 1 -- 172.21.15.103:0/3331588629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e10004570 msgr2=0x7f5e100049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:49.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.709+0000 7f5e35556700 1 --2- 172.21.15.103:0/3331588629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e10004570 0x7f5e100049d0 secure :-1 s=READY pgs=1288 cs=0 l=1 rx=0x7f5e280017a0 tx=0x7f5e3005b100).stop 2020-04-22T14:13:49.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.709+0000 7f5e2f7fe700 1 -- 172.21.15.103:0/3331588629 reap_dead start 2020-04-22T14:13:49.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.710+0000 7f5e35556700 1 -- 172.21.15.103:0/3331588629 shutdown_connections 2020-04-22T14:13:49.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.710+0000 7f5e35556700 1 -- 172.21.15.103:0/3331588629 >> 172.21.15.103:0/3331588629 conn(0x7f5e300b86b0 msgr2=0x7f5e300b8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:49.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.710+0000 7f5e35556700 1 -- 172.21.15.103:0/3331588629 shutdown_connections 2020-04-22T14:13:49.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.710+0000 7f5e35556700 1 -- 172.21.15.103:0/3331588629 wait complete. 2020-04-22T14:13:49.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.711+0000 7f5e35556700 1 Processor -- start 2020-04-22T14:13:49.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.711+0000 7f5e35556700 1 -- start start 2020-04-22T14:13:49.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.711+0000 7f5e35556700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e300b5070 0x7f5e3014dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:49.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.711+0000 7f5e35556700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e300b3c20 con 0x7f5e300b1290 2020-04-22T14:13:49.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.711+0000 7f5e35556700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e3014d380 con 0x7f5e3014ce00 2020-04-22T14:13:49.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.711+0000 7f5e35556700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3014d620 con 0x7f5e300b5070 2020-04-22T14:13:49.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.711+0000 7f5e27fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f5e3014ce00 0x7f5e301438b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46182/0 (socket says 172.21.15.103:46182) 2020-04-22T14:13:49.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.711+0000 7f5e27fff700 1 -- 172.21.15.103:0/2368189543 learned_addr learned my addr 172.21.15.103:0/2368189543 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:49.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.712+0000 7f5e2f7fe700 1 --2- 172.21.15.103:0/2368189543 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e300b5070 0x7f5e3014dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:49.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.712+0000 7f5e2cff9700 1 -- 172.21.15.103:0/2368189543 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2076643536 0 0) 0x7f5e3014d380 con 0x7f5e3014ce00 2020-04-22T14:13:49.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.712+0000 7f5e2cff9700 1 -- 172.21.15.103:0/2368189543 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e14002fe0 con 0x7f5e3014ce00 2020-04-22T14:13:49.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.712+0000 7f5e2cff9700 1 -- 172.21.15.103:0/2368189543 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3587900294 0 0) 0x7f5e300b3c20 con 0x7f5e300b1290 2020-04-22T14:13:49.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.712+0000 7f5e2cff9700 1 -- 172.21.15.103:0/2368189543 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e3014d380 con 0x7f5e300b1290 2020-04-22T14:13:49.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.712+0000 7f5e2cff9700 1 -- 172.21.15.103:0/2368189543 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1108200804 0 0) 0x7f5e14002fe0 con 0x7f5e3014ce00 2020-04-22T14:13:49.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.712+0000 7f5e2cff9700 1 -- 172.21.15.103:0/2368189543 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5e300b3c20 con 0x7f5e3014ce00 2020-04-22T14:13:49.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.712+0000 7f5e2cff9700 1 -- 172.21.15.103:0/2368189543 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f5e18001490 con 0x7f5e3014ce00 2020-04-22T14:13:49.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.712+0000 7f5e2cff9700 1 -- 172.21.15.103:0/2368189543 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e300b5070 msgr2=0x7f5e3014dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:49.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.712+0000 7f5e2cff9700 1 --2- 172.21.15.103:0/2368189543 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e300b5070 0x7f5e3014dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:49.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.712+0000 7f5e2cff9700 1 -- 172.21.15.103:0/2368189543 >> v1:172.21.15.103:6789/0 conn(0x7f5e3014ce00 legacy=0x7f5e301438b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:49.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.712+0000 7f5e2cff9700 1 -- 172.21.15.103:0/2368189543 >> v1:172.21.15.86:6789/0 conn(0x7f5e300b1290 legacy=0x7f5e30061760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:49.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.712+0000 7f5e2cff9700 1 --2- 172.21.15.103:0/2368189543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e14004b20 0x7f5e14004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:49.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.712+0000 7f5e2cff9700 1 --2- 172.21.15.103:0/2368189543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e14003ab0 0x7f5e14003f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:49.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.712+0000 7f5e2cff9700 1 --2- 172.21.15.103:0/2368189543 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e14004390 0x7f5e1400b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:49.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.712+0000 7f5e2cff9700 1 -- 172.21.15.103:0/2368189543 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3014d620 con 0x7f5e14004b20 2020-04-22T14:13:49.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.712+0000 7f5e2cff9700 1 -- 172.21.15.103:0/2368189543 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e14004900 con 0x7f5e14003ab0 2020-04-22T14:13:49.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.712+0000 7f5e2cff9700 1 -- 172.21.15.103:0/2368189543 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1400bbb0 con 0x7f5e14004390 2020-04-22T14:13:49.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.712+0000 7f5e2f7fe700 1 --2- 172.21.15.103:0/2368189543 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e300b5070 0x7f5e3014dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:13:49.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.712+0000 7f5e27fff700 1 --2- 172.21.15.103:0/2368189543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e14003ab0 0x7f5e14003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:49.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.712+0000 7f5e2effd700 1 --2- 172.21.15.103:0/2368189543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e14004b20 0x7f5e14004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:49.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.712+0000 7f5e2f7fe700 1 --2- 172.21.15.103:0/2368189543 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e14004390 0x7f5e1400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:49.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.712+0000 7f5e27fff700 1 -- 172.21.15.103:0/2368189543 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e14004390 msgr2=0x7f5e1400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:49.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.712+0000 7f5e27fff700 1 --2- 172.21.15.103:0/2368189543 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e14004390 0x7f5e1400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:49.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.712+0000 7f5e27fff700 1 -- 172.21.15.103:0/2368189543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e14004b20 msgr2=0x7f5e14004f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:49.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.712+0000 7f5e27fff700 1 --2- 172.21.15.103:0/2368189543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e14004b20 0x7f5e14004f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:49.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.712+0000 7f5e27fff700 1 -- 172.21.15.103:0/2368189543 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e3014d8c0 con 0x7f5e14003ab0 2020-04-22T14:13:49.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.712+0000 7f5e35556700 1 -- 172.21.15.103:0/2368189543 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e300b1670 con 0x7f5e14003ab0 2020-04-22T14:13:49.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.712+0000 7f5e27fff700 1 --2- 172.21.15.103:0/2368189543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e14003ab0 0x7f5e14003f30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5e18007bd0 tx=0x7f5e18001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:49.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.712+0000 7f5e2f7fe700 1 --2- 172.21.15.103:0/2368189543 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e14004390 0x7f5e1400b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:13:49.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.712+0000 7f5e35556700 1 -- 172.21.15.103:0/2368189543 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e3014dd60 con 0x7f5e14003ab0 2020-04-22T14:13:49.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.712+0000 7f5e27fff700 1 --2- 172.21.15.103:0/2368189543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e14003ab0 0x7f5e14003f30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5e18007bd0 tx=0x7f5e18001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:49.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.712+0000 7f5e27fff700 1 --2- 172.21.15.103:0/2368189543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e14003ab0 0x7f5e14003f30 secure :-1 s=READY pgs=1290 cs=0 l=1 rx=0x7f5e18007bd0 tx=0x7f5e18001e30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:49.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.713+0000 7f5e27fff700 1 --2- 172.21.15.103:0/2368189543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e14003ab0 0x7f5e14003f30 secure :-1 s=THROTTLE_DONE pgs=1290 cs=0 l=1 rx=0x7f5e18007bd0 tx=0x7f5e18001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:49.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.713+0000 7f5e2cff9700 1 -- 172.21.15.103:0/2368189543 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e180058b0 con 0x7f5e14003ab0 2020-04-22T14:13:49.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.713+0000 7f5e27fff700 1 --2- 172.21.15.103:0/2368189543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e14003ab0 0x7f5e14003f30 secure :-1 s=THROTTLE_DONE pgs=1290 cs=0 l=1 rx=0x7f5e18007bd0 tx=0x7f5e18001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:49.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.713+0000 7f5e27fff700 1 --2- 172.21.15.103:0/2368189543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e14003ab0 0x7f5e14003f30 secure :-1 s=THROTTLE_DONE pgs=1290 cs=0 l=1 rx=0x7f5e18007bd0 tx=0x7f5e18001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:49.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.713+0000 7f5e2cff9700 1 -- 172.21.15.103:0/2368189543 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e18005a10 con 0x7f5e14003ab0 2020-04-22T14:13:49.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.713+0000 7f5e2cff9700 1 -- 172.21.15.103:0/2368189543 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e18005df0 con 0x7f5e14003ab0 2020-04-22T14:13:49.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.713+0000 7f5e27fff700 1 --2- 172.21.15.103:0/2368189543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e14003ab0 0x7f5e14003f30 secure :-1 s=THROTTLE_DONE pgs=1290 cs=0 l=1 rx=0x7f5e18007bd0 tx=0x7f5e18001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:49.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.713+0000 7f5e35556700 1 -- 172.21.15.103:0/2368189543 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e08003340 con 0x7f5e14003ab0 2020-04-22T14:13:49.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.714+0000 7f5e2cff9700 1 -- 172.21.15.103:0/2368189543 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f5e180120d0 con 0x7f5e14003ab0 2020-04-22T14:13:49.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.714+0000 7f5e27fff700 1 --2- 172.21.15.103:0/2368189543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e14003ab0 0x7f5e14003f30 secure :-1 s=THROTTLE_DONE pgs=1290 cs=0 l=1 rx=0x7f5e18007bd0 tx=0x7f5e18001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:49.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.714+0000 7f5e2cff9700 1 --2- 172.21.15.103:0/2368189543 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5e140562d0 0x7f5e14058790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:49.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.714+0000 7f5e2cff9700 1 -- 172.21.15.103:0/2368189543 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f5e18061550 con 0x7f5e14003ab0 2020-04-22T14:13:49.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.714+0000 7f5e2effd700 1 --2- 172.21.15.103:0/2368189543 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5e140562d0 0x7f5e14058790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:49.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.714+0000 7f5e2effd700 1 --2- 172.21.15.103:0/2368189543 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5e140562d0 0x7f5e14058790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5e20001210 tx=0x7f5e2000cc00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:49.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.714+0000 7f5e2effd700 1 --2- 172.21.15.103:0/2368189543 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5e140562d0 0x7f5e14058790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5e20001210 tx=0x7f5e2000cc00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:49.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.714+0000 7f5e2effd700 1 --2- 172.21.15.103:0/2368189543 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5e140562d0 0x7f5e14058790 secure :-1 s=READY pgs=473 cs=0 l=1 rx=0x7f5e20001210 tx=0x7f5e2000cc00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:49.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.718+0000 7f5e27fff700 1 --2- 172.21.15.103:0/2368189543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e14003ab0 0x7f5e14003f30 secure :-1 s=THROTTLE_DONE pgs=1290 cs=0 l=1 rx=0x7f5e18007bd0 tx=0x7f5e18001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:49.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.718+0000 7f5e2cff9700 1 -- 172.21.15.103:0/2368189543 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f5e1803c930 con 0x7f5e14003ab0 2020-04-22T14:13:49.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:49.909+0000 7f5e35556700 1 -- 172.21.15.103:0/2368189543 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5e080021d0 con 0x7f5e14003ab0 2020-04-22T14:13:50.403 INFO:tasks.ceph.mon.b.smithi086.stderr:2020-04-22T14:13:50.401+0000 7fbdbf880700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-04-22T14:13:50.413 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.410+0000 7f5e27fff700 1 --2- 172.21.15.103:0/2368189543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e14003ab0 0x7f5e14003f30 secure :-1 s=THROTTLE_DONE pgs=1290 cs=0 l=1 rx=0x7f5e18007bd0 tx=0x7f5e18001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:50.413 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.410+0000 7f5e2cff9700 1 -- 172.21.15.103:0/2368189543 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v57) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5e1803ff50 con 0x7f5e14003ab0 2020-04-22T14:13:50.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.411+0000 7f5e35556700 1 -- 172.21.15.103:0/2368189543 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5e140562d0 msgr2=0x7f5e14058790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:50.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.411+0000 7f5e35556700 1 --2- 172.21.15.103:0/2368189543 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5e140562d0 0x7f5e14058790 secure :-1 s=READY pgs=473 cs=0 l=1 rx=0x7f5e20001210 tx=0x7f5e2000cc00).stop 2020-04-22T14:13:50.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.411+0000 7f5e35556700 1 -- 172.21.15.103:0/2368189543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e14003ab0 msgr2=0x7f5e14003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:50.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.411+0000 7f5e35556700 1 --2- 172.21.15.103:0/2368189543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e14003ab0 0x7f5e14003f30 secure :-1 s=READY pgs=1290 cs=0 l=1 rx=0x7f5e18007bd0 tx=0x7f5e18001e30).stop 2020-04-22T14:13:50.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.411+0000 7f5e2f7fe700 1 -- 172.21.15.103:0/2368189543 reap_dead start 2020-04-22T14:13:50.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.412+0000 7f5e2f7fe700 1 -- 172.21.15.103:0/2368189543 reap_dead start 2020-04-22T14:13:50.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.412+0000 7f5e35556700 1 -- 172.21.15.103:0/2368189543 shutdown_connections 2020-04-22T14:13:50.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.412+0000 7f5e35556700 1 -- 172.21.15.103:0/2368189543 >> 172.21.15.103:0/2368189543 conn(0x7f5e300b86b0 msgr2=0x7f5e30146af0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:50.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.412+0000 7f5e35556700 1 -- 172.21.15.103:0/2368189543 shutdown_connections 2020-04-22T14:13:50.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.412+0000 7f5e35556700 1 -- 172.21.15.103:0/2368189543 wait complete. 2020-04-22T14:13:50.418 INFO:teuthology.orchestra.run.smithi103.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2020-04-22T14:13:50.426 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:50.434 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2020-04-22T14:13:50.440 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:13:50.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.583+0000 7fc219272700 1 Processor -- start 2020-04-22T14:13:50.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.583+0000 7fc219272700 1 -- start start 2020-04-22T14:13:50.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.584+0000 7fc219272700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2140b63d0 0x7fc2140b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:50.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.584+0000 7fc219272700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc214140620 0x7fc2140664d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:50.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.584+0000 7fc219272700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2140608e0 con 0x7fc21414a3a0 2020-04-22T14:13:50.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.584+0000 7fc219272700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc214060b80 con 0x7fc214140620 2020-04-22T14:13:50.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.584+0000 7fc219272700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc214060e20 con 0x7fc2140b63d0 2020-04-22T14:13:50.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.584+0000 7fc2137fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc214140620 0x7fc2140664d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:50.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.584+0000 7fc212ffd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2140b63d0 0x7fc2140b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:50.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.584+0000 7fc2137fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc214140620 0x7fc2140664d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:51252/0 (socket says 172.21.15.103:51252) 2020-04-22T14:13:50.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.584+0000 7fc212ffd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2140b63d0 0x7fc2140b41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:38796/0 (socket says 172.21.15.103:38796) 2020-04-22T14:13:50.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.584+0000 7fc2137fe700 1 -- 172.21.15.103:0/3065065239 learned_addr learned my addr 172.21.15.103:0/3065065239 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:50.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.585+0000 7fc2137fe700 1 -- 172.21.15.103:0/3065065239 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2140b63d0 msgr2=0x7fc2140b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:50.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.585+0000 7fc2137fe700 1 --2- 172.21.15.103:0/3065065239 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2140b63d0 0x7fc2140b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:50.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.585+0000 7fc2137fe700 1 -- 172.21.15.103:0/3065065239 >> v1:172.21.15.86:6789/0 conn(0x7fc21414a3a0 legacy=0x7fc21413ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:50.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.585+0000 7fc2137fe700 1 -- 172.21.15.103:0/3065065239 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2140b67b0 con 0x7fc214140620 2020-04-22T14:13:50.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.585+0000 7fc2127fc700 1 -- 172.21.15.103:0/3065065239 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2412686233 0 0) 0x7fc2140608e0 con 0x7fc21414a3a0 2020-04-22T14:13:50.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.585+0000 7fc2137fe700 1 --2- 172.21.15.103:0/3065065239 >> v2:172.21.15.86:3300/0 conn(0x7fc214140620 0x7fc2140664d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc2140b5ef0 tx=0x7fc20c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:50.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.585+0000 7fc2137fe700 1 --2- 172.21.15.103:0/3065065239 >> v2:172.21.15.86:3300/0 conn(0x7fc214140620 0x7fc2140664d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc2140b5ef0 tx=0x7fc20c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:50.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.585+0000 7fc2137fe700 1 --2- 172.21.15.103:0/3065065239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc214140620 0x7fc2140664d0 secure :-1 s=READY pgs=700 cs=0 l=1 rx=0x7fc2140b5ef0 tx=0x7fc20c008c60).ready entity=mon.0 client_cookie=eff1636fe1acd6a2 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:50.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.585+0000 7fc2137fe700 1 --2- 172.21.15.103:0/3065065239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc214140620 0x7fc2140664d0 secure :-1 s=THROTTLE_DONE pgs=700 cs=0 l=1 rx=0x7fc2140b5ef0 tx=0x7fc20c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:50.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.585+0000 7fc2127fc700 1 -- 172.21.15.103:0/3065065239 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc20c00a180 con 0x7fc214140620 2020-04-22T14:13:50.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.585+0000 7fc2137fe700 1 --2- 172.21.15.103:0/3065065239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc214140620 0x7fc2140664d0 secure :-1 s=THROTTLE_DONE pgs=700 cs=0 l=1 rx=0x7fc2140b5ef0 tx=0x7fc20c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:50.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.585+0000 7fc2127fc700 1 -- 172.21.15.103:0/3065065239 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc20c00a320 con 0x7fc214140620 2020-04-22T14:13:50.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.585+0000 7fc2137fe700 1 --2- 172.21.15.103:0/3065065239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc214140620 0x7fc2140664d0 secure :-1 s=THROTTLE_DONE pgs=700 cs=0 l=1 rx=0x7fc2140b5ef0 tx=0x7fc20c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:50.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.585+0000 7fc2127fc700 1 -- 172.21.15.103:0/3065065239 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc20c00a700 con 0x7fc214140620 2020-04-22T14:13:50.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.585+0000 7fc219272700 1 -- 172.21.15.103:0/3065065239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc214140620 msgr2=0x7fc2140664d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:50.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.585+0000 7fc219272700 1 --2- 172.21.15.103:0/3065065239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc214140620 0x7fc2140664d0 secure :-1 s=READY pgs=700 cs=0 l=1 rx=0x7fc2140b5ef0 tx=0x7fc20c008c60).stop 2020-04-22T14:13:50.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.585+0000 7fc219272700 1 -- 172.21.15.103:0/3065065239 shutdown_connections 2020-04-22T14:13:50.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.585+0000 7fc219272700 1 --2- 172.21.15.103:0/3065065239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc214140620 0x7fc2140664d0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:50.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.585+0000 7fc219272700 1 --2- 172.21.15.103:0/3065065239 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2140b63d0 0x7fc2140b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:50.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.585+0000 7fc219272700 1 -- 172.21.15.103:0/3065065239 >> 172.21.15.103:0/3065065239 conn(0x7fc21405f2c0 msgr2=0x7fc214066e20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:50.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.585+0000 7fc219272700 1 -- 172.21.15.103:0/3065065239 shutdown_connections 2020-04-22T14:13:50.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.585+0000 7fc219272700 1 -- 172.21.15.103:0/3065065239 wait complete. 2020-04-22T14:13:50.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.586+0000 7fc219272700 1 Processor -- start 2020-04-22T14:13:50.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.587+0000 7fc219272700 1 -- start start 2020-04-22T14:13:50.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.587+0000 7fc219272700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc21414a3a0 0x7fc2141439d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:50.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.587+0000 7fc219272700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc2140b9190 0x7fc214140a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:50.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.587+0000 7fc219272700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc214140e70 con 0x7fc2140b63d0 2020-04-22T14:13:50.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.587+0000 7fc219272700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2140ba140 con 0x7fc2140b9190 2020-04-22T14:13:50.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.587+0000 7fc219272700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2140ba3e0 con 0x7fc21414a3a0 2020-04-22T14:13:50.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.587+0000 7fc20a7fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc21414a3a0 0x7fc2141439d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:50.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.587+0000 7fc212ffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc2140b63d0 0x7fc21413ca20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46214/0 (socket says 172.21.15.103:46214) 2020-04-22T14:13:50.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.587+0000 7fc20a7fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc21414a3a0 0x7fc2141439d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54026/0 (socket says 172.21.15.103:54026) 2020-04-22T14:13:50.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.587+0000 7fc212ffd700 1 -- 172.21.15.103:0/3094460025 learned_addr learned my addr 172.21.15.103:0/3094460025 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:50.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.588+0000 7fc2137fe700 1 --2- 172.21.15.103:0/3094460025 >> v2:172.21.15.86:3300/0 conn(0x7fc2140b9190 0x7fc214140a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:50.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.588+0000 7fc20a7fc700 1 -- 172.21.15.103:0/3094460025 >> v2:172.21.15.86:3300/0 conn(0x7fc2140b9190 msgr2=0x7fc214140a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:50.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.588+0000 7fc20a7fc700 1 --2- 172.21.15.103:0/3094460025 >> v2:172.21.15.86:3300/0 conn(0x7fc2140b9190 0x7fc214140a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:50.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.588+0000 7fc20a7fc700 1 -- 172.21.15.103:0/3094460025 >> v1:172.21.15.103:6789/0 conn(0x7fc2140b63d0 legacy=0x7fc21413ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:50.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.588+0000 7fc210ff9700 1 -- 172.21.15.103:0/3094460025 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3656201831 0 0) 0x7fc214140e70 con 0x7fc2140b63d0 2020-04-22T14:13:50.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.588+0000 7fc20a7fc700 1 -- 172.21.15.103:0/3094460025 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2140b9e70 con 0x7fc21414a3a0 2020-04-22T14:13:50.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.588+0000 7fc2137fe700 1 --2- 172.21.15.103:0/3094460025 >> v2:172.21.15.86:3300/0 conn(0x7fc2140b9190 0x7fc214140a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:13:50.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.588+0000 7fc20a7fc700 1 --2- 172.21.15.103:0/3094460025 >> v2:172.21.15.103:3300/0 conn(0x7fc21414a3a0 0x7fc2141439d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc1fc000e90 tx=0x7fc1fc00c4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:50.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.588+0000 7fc20a7fc700 1 --2- 172.21.15.103:0/3094460025 >> v2:172.21.15.103:3300/0 conn(0x7fc21414a3a0 0x7fc2141439d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc1fc000e90 tx=0x7fc1fc00c4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:50.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.588+0000 7fc20a7fc700 1 --2- 172.21.15.103:0/3094460025 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc21414a3a0 0x7fc2141439d0 secure :-1 s=READY pgs=1293 cs=0 l=1 rx=0x7fc1fc000e90 tx=0x7fc1fc00c4d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:50.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.588+0000 7fc20a7fc700 1 --2- 172.21.15.103:0/3094460025 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc21414a3a0 0x7fc2141439d0 secure :-1 s=THROTTLE_DONE pgs=1293 cs=0 l=1 rx=0x7fc1fc000e90 tx=0x7fc1fc00c4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:50.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.588+0000 7fc210ff9700 1 -- 172.21.15.103:0/3094460025 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1fc00cc20 con 0x7fc21414a3a0 2020-04-22T14:13:50.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.588+0000 7fc20a7fc700 1 --2- 172.21.15.103:0/3094460025 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc21414a3a0 0x7fc2141439d0 secure :-1 s=THROTTLE_DONE pgs=1293 cs=0 l=1 rx=0x7fc1fc000e90 tx=0x7fc1fc00c4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:50.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.588+0000 7fc210ff9700 1 -- 172.21.15.103:0/3094460025 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1fc00cd80 con 0x7fc21414a3a0 2020-04-22T14:13:50.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.588+0000 7fc219272700 1 -- 172.21.15.103:0/3094460025 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc21413e720 con 0x7fc21414a3a0 2020-04-22T14:13:50.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.588+0000 7fc20a7fc700 1 --2- 172.21.15.103:0/3094460025 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc21414a3a0 0x7fc2141439d0 secure :-1 s=THROTTLE_DONE pgs=1293 cs=0 l=1 rx=0x7fc1fc000e90 tx=0x7fc1fc00c4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:50.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.588+0000 7fc210ff9700 1 -- 172.21.15.103:0/3094460025 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1fc012200 con 0x7fc21414a3a0 2020-04-22T14:13:50.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.588+0000 7fc219272700 1 -- 172.21.15.103:0/3094460025 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc21413ec10 con 0x7fc21414a3a0 2020-04-22T14:13:50.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.589+0000 7fc20a7fc700 1 --2- 172.21.15.103:0/3094460025 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc21414a3a0 0x7fc2141439d0 secure :-1 s=THROTTLE_DONE pgs=1293 cs=0 l=1 rx=0x7fc1fc000e90 tx=0x7fc1fc00c4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:50.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.589+0000 7fc219272700 1 -- 172.21.15.103:0/3094460025 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2140ba5e0 con 0x7fc21414a3a0 2020-04-22T14:13:50.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.589+0000 7fc210ff9700 1 -- 172.21.15.103:0/3094460025 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fc1fc0064e0 con 0x7fc21414a3a0 2020-04-22T14:13:50.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.589+0000 7fc20a7fc700 1 --2- 172.21.15.103:0/3094460025 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc21414a3a0 0x7fc2141439d0 secure :-1 s=THROTTLE_DONE pgs=1293 cs=0 l=1 rx=0x7fc1fc000e90 tx=0x7fc1fc00c4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:50.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.589+0000 7fc210ff9700 1 --2- 172.21.15.103:0/3094460025 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc1f804d790 0x7fc1f804fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:50.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.589+0000 7fc210ff9700 1 -- 172.21.15.103:0/3094460025 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6288+0+0 (secure 0 0 0) 0x7fc1fc060fa0 con 0x7fc21414a3a0 2020-04-22T14:13:50.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.590+0000 7fc212ffd700 1 --2- 172.21.15.103:0/3094460025 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc1f804d790 0x7fc1f804fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:50.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.590+0000 7fc212ffd700 1 --2- 172.21.15.103:0/3094460025 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc1f804d790 0x7fc1f804fc50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc204007fa0 tx=0x7fc2040090b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:50.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.590+0000 7fc212ffd700 1 --2- 172.21.15.103:0/3094460025 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc1f804d790 0x7fc1f804fc50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc204007fa0 tx=0x7fc2040090b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:50.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.590+0000 7fc212ffd700 1 --2- 172.21.15.103:0/3094460025 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc1f804d790 0x7fc1f804fc50 secure :-1 s=READY pgs=474 cs=0 l=1 rx=0x7fc204007fa0 tx=0x7fc2040090b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:50.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.593+0000 7fc20a7fc700 1 --2- 172.21.15.103:0/3094460025 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc21414a3a0 0x7fc2141439d0 secure :-1 s=THROTTLE_DONE pgs=1293 cs=0 l=1 rx=0x7fc1fc000e90 tx=0x7fc1fc00c4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:50.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.593+0000 7fc210ff9700 1 -- 172.21.15.103:0/3094460025 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fc1fc03c380 con 0x7fc21414a3a0 2020-04-22T14:13:50.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.783+0000 7fc219272700 1 -- 172.21.15.103:0/3094460025 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc2140b7730 con 0x7fc21414a3a0 2020-04-22T14:13:50.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.783+0000 7fc20a7fc700 1 --2- 172.21.15.103:0/3094460025 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc21414a3a0 0x7fc2141439d0 secure :-1 s=THROTTLE_DONE pgs=1293 cs=0 l=1 rx=0x7fc1fc000e90 tx=0x7fc1fc00c4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:50.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.783+0000 7fc210ff9700 1 -- 172.21.15.103:0/3094460025 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+1779 (secure 0 0 0) 0x7fc1fc03f9a0 con 0x7fc21414a3a0 2020-04-22T14:13:50.787 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:13:50.787 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":57,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4146844629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4146844629},{"type":"v1","addr":"172.21.15.86:6835","nonce":4146844629}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":52}],"filesystems":[{"mdsmap":{"epoch":57,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:12:18.873897+0000","modified":"2020-04-22T14:13:50.401872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-04-22T14:13:50.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.784+0000 7fc219272700 1 -- 172.21.15.103:0/3094460025 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc1f804d790 msgr2=0x7fc1f804fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:50.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.784+0000 7fc219272700 1 --2- 172.21.15.103:0/3094460025 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc1f804d790 0x7fc1f804fc50 secure :-1 s=READY pgs=474 cs=0 l=1 rx=0x7fc204007fa0 tx=0x7fc2040090b0).stop 2020-04-22T14:13:50.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.784+0000 7fc219272700 1 -- 172.21.15.103:0/3094460025 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc21414a3a0 msgr2=0x7fc2141439d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:50.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.784+0000 7fc219272700 1 --2- 172.21.15.103:0/3094460025 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc21414a3a0 0x7fc2141439d0 secure :-1 s=READY pgs=1293 cs=0 l=1 rx=0x7fc1fc000e90 tx=0x7fc1fc00c4d0).stop 2020-04-22T14:13:50.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.784+0000 7fc219272700 1 -- 172.21.15.103:0/3094460025 shutdown_connections 2020-04-22T14:13:50.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.784+0000 7fc219272700 1 --2- 172.21.15.103:0/3094460025 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc1f804d790 0x7fc1f804fc50 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:50.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.784+0000 7fc219272700 1 --2- 172.21.15.103:0/3094460025 >> v2:172.21.15.86:3300/0 conn(0x7fc2140b9190 0x7fc214140a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:50.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.784+0000 7fc219272700 1 --2- 172.21.15.103:0/3094460025 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc21414a3a0 0x7fc2141439d0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:50.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.784+0000 7fc219272700 1 -- 172.21.15.103:0/3094460025 >> 172.21.15.103:0/3094460025 conn(0x7fc21405f2c0 msgr2=0x7fc214065870 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:50.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.785+0000 7fc219272700 1 -- 172.21.15.103:0/3094460025 shutdown_connections 2020-04-22T14:13:50.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.785+0000 7fc219272700 1 -- 172.21.15.103:0/3094460025 wait complete. 2020-04-22T14:13:50.790 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 57 2020-04-22T14:13:50.799 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:50.819 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-04-22T14:13:50.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.963+0000 7f572e695700 1 Processor -- start 2020-04-22T14:13:50.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.963+0000 7f572e695700 1 -- start start 2020-04-22T14:13:50.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.965+0000 7f572e695700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f57280af390 0x7f57280b4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:50.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.965+0000 7f572e695700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f572814ddb0 0x7f572814e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:50.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.965+0000 7f572e695700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57280b49d0 con 0x7f57280b9140 2020-04-22T14:13:50.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.965+0000 7f572e695700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5728061830 con 0x7f57280af390 2020-04-22T14:13:50.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.965+0000 7f572e695700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5728061ad0 con 0x7f572814ddb0 2020-04-22T14:13:50.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.965+0000 7f572cc32700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f572814ddb0 0x7f572814e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:50.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.965+0000 7f572cc32700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f572814ddb0 0x7f572814e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54034/0 (socket says 172.21.15.103:54034) 2020-04-22T14:13:50.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.965+0000 7f572cc32700 1 -- 172.21.15.103:0/3837411249 learned_addr learned my addr 172.21.15.103:0/3837411249 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:50.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.965+0000 7f5727fff700 1 --1- 172.21.15.103:0/3837411249 >> v1:172.21.15.103:6789/0 conn(0x7f57280b9140 0x7f5728061f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46222/0 (socket says 172.21.15.103:46222) 2020-04-22T14:13:50.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.965+0000 7f571ffff700 1 --2- 172.21.15.103:0/3837411249 >> v2:172.21.15.86:3300/0 conn(0x7f57280af390 0x7f57280b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:50.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.965+0000 7f572cc32700 1 -- 172.21.15.103:0/3837411249 >> v2:172.21.15.86:3300/0 conn(0x7f57280af390 msgr2=0x7f57280b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:50.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.965+0000 7f572cc32700 1 --2- 172.21.15.103:0/3837411249 >> v2:172.21.15.86:3300/0 conn(0x7f57280af390 0x7f57280b4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:50.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.965+0000 7f572cc32700 1 -- 172.21.15.103:0/3837411249 >> v1:172.21.15.103:6789/0 conn(0x7f57280b9140 legacy=0x7f5728061f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:50.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.965+0000 7f57277fe700 1 -- 172.21.15.103:0/3837411249 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1856689603 0 0) 0x7f57280b49d0 con 0x7f57280b9140 2020-04-22T14:13:50.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.965+0000 7f572cc32700 1 -- 172.21.15.103:0/3837411249 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57280b9520 con 0x7f572814ddb0 2020-04-22T14:13:50.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.965+0000 7f572cc32700 1 --2- 172.21.15.103:0/3837411249 >> v2:172.21.15.103:3300/0 conn(0x7f572814ddb0 0x7f572814e210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f57200032b0 tx=0x7f5720007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:50.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.965+0000 7f572cc32700 1 --2- 172.21.15.103:0/3837411249 >> v2:172.21.15.103:3300/0 conn(0x7f572814ddb0 0x7f572814e210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f57200032b0 tx=0x7f5720007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:50.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.965+0000 7f572cc32700 1 --2- 172.21.15.103:0/3837411249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f572814ddb0 0x7f572814e210 secure :-1 s=READY pgs=1295 cs=0 l=1 rx=0x7f57200032b0 tx=0x7f5720007dc0).ready entity=mon.1 client_cookie=86072bd86984cb1b server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:50.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.965+0000 7f572cc32700 1 --2- 172.21.15.103:0/3837411249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f572814ddb0 0x7f572814e210 secure :-1 s=THROTTLE_DONE pgs=1295 cs=0 l=1 rx=0x7f57200032b0 tx=0x7f5720007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:50.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.965+0000 7f57277fe700 1 -- 172.21.15.103:0/3837411249 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f572000a180 con 0x7f572814ddb0 2020-04-22T14:13:50.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.965+0000 7f572cc32700 1 --2- 172.21.15.103:0/3837411249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f572814ddb0 0x7f572814e210 secure :-1 s=THROTTLE_DONE pgs=1295 cs=0 l=1 rx=0x7f57200032b0 tx=0x7f5720007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:50.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.965+0000 7f572cc32700 1 --2- 172.21.15.103:0/3837411249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f572814ddb0 0x7f572814e210 secure :-1 s=THROTTLE_DONE pgs=1295 cs=0 l=1 rx=0x7f57200032b0 tx=0x7f5720007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:50.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.965+0000 7f57277fe700 1 -- 172.21.15.103:0/3837411249 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572000a2e0 con 0x7f572814ddb0 2020-04-22T14:13:50.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.965+0000 7f57277fe700 1 -- 172.21.15.103:0/3837411249 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f572000a6c0 con 0x7f572814ddb0 2020-04-22T14:13:50.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.965+0000 7f572e695700 1 -- 172.21.15.103:0/3837411249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f572814ddb0 msgr2=0x7f572814e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:50.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.965+0000 7f572e695700 1 --2- 172.21.15.103:0/3837411249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f572814ddb0 0x7f572814e210 secure :-1 s=READY pgs=1295 cs=0 l=1 rx=0x7f57200032b0 tx=0x7f5720007dc0).stop 2020-04-22T14:13:50.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.966+0000 7f572e695700 1 -- 172.21.15.103:0/3837411249 shutdown_connections 2020-04-22T14:13:50.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.966+0000 7f572e695700 1 --2- 172.21.15.103:0/3837411249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f572814ddb0 0x7f572814e210 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:50.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.966+0000 7f572e695700 1 --2- 172.21.15.103:0/3837411249 >> v2:172.21.15.86:3300/0 conn(0x7f57280af390 0x7f57280b4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:50.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.966+0000 7f572e695700 1 -- 172.21.15.103:0/3837411249 >> 172.21.15.103:0/3837411249 conn(0x7f572805b7b0 msgr2=0x7f57280b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:50.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.966+0000 7f572e695700 1 -- 172.21.15.103:0/3837411249 shutdown_connections 2020-04-22T14:13:50.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.966+0000 7f572e695700 1 -- 172.21.15.103:0/3837411249 wait complete. 2020-04-22T14:13:50.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.967+0000 7f572e695700 1 Processor -- start 2020-04-22T14:13:50.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.967+0000 7f572e695700 1 -- start start 2020-04-22T14:13:50.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.967+0000 7f572e695700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57280b9140 0x7f5728066100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:50.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.967+0000 7f572e695700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f572814ddb0 0x7f57280b1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:50.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.967+0000 7f572e695700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5728114390 con 0x7f57280af390 2020-04-22T14:13:50.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.967+0000 7f572e695700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5728114630 con 0x7f572814ddb0 2020-04-22T14:13:50.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.968+0000 7f572e695700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57281148d0 con 0x7f57280b9140 2020-04-22T14:13:50.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.968+0000 7f572cc32700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f572814ddb0 0x7f57280b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:50.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.968+0000 7f572cc32700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f572814ddb0 0x7f57280b1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54042/0 (socket says 172.21.15.103:54042) 2020-04-22T14:13:50.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.968+0000 7f572cc32700 1 -- 172.21.15.103:0/3612011490 learned_addr learned my addr 172.21.15.103:0/3612011490 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:50.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.968+0000 7f571ffff700 1 --2- 172.21.15.103:0/3612011490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57280b9140 0x7f5728066100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:50.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.968+0000 7f572cc32700 1 -- 172.21.15.103:0/3612011490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57280b9140 msgr2=0x7f5728066100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:50.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.968+0000 7f572cc32700 1 --2- 172.21.15.103:0/3612011490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57280b9140 0x7f5728066100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:50.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.968+0000 7f572cc32700 1 -- 172.21.15.103:0/3612011490 >> v1:172.21.15.86:6789/0 conn(0x7f57280af390 legacy=0x7f5728114d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:50.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.968+0000 7f572cc32700 1 -- 172.21.15.103:0/3612011490 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5728115480 con 0x7f572814ddb0 2020-04-22T14:13:50.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.968+0000 7f572cc32700 1 --2- 172.21.15.103:0/3612011490 >> v2:172.21.15.103:3300/0 conn(0x7f572814ddb0 0x7f57280b1600 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f57200032b0 tx=0x7f5720007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:50.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.968+0000 7f572cc32700 1 --2- 172.21.15.103:0/3612011490 >> v2:172.21.15.103:3300/0 conn(0x7f572814ddb0 0x7f57280b1600 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f57200032b0 tx=0x7f5720007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:50.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.968+0000 7f572cc32700 1 --2- 172.21.15.103:0/3612011490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f572814ddb0 0x7f57280b1600 secure :-1 s=READY pgs=1296 cs=0 l=1 rx=0x7f57200032b0 tx=0x7f5720007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:50.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.968+0000 7f572cc32700 1 --2- 172.21.15.103:0/3612011490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f572814ddb0 0x7f57280b1600 secure :-1 s=THROTTLE_DONE pgs=1296 cs=0 l=1 rx=0x7f57200032b0 tx=0x7f5720007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:50.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.968+0000 7f5725ffb700 1 -- 172.21.15.103:0/3612011490 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5720008ab0 con 0x7f572814ddb0 2020-04-22T14:13:50.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.968+0000 7f572cc32700 1 --2- 172.21.15.103:0/3612011490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f572814ddb0 0x7f57280b1600 secure :-1 s=THROTTLE_DONE pgs=1296 cs=0 l=1 rx=0x7f57200032b0 tx=0x7f5720007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:50.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.968+0000 7f572cc32700 1 --2- 172.21.15.103:0/3612011490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f572814ddb0 0x7f57280b1600 secure :-1 s=THROTTLE_DONE pgs=1296 cs=0 l=1 rx=0x7f57200032b0 tx=0x7f5720007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:50.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.968+0000 7f5725ffb700 1 -- 172.21.15.103:0/3612011490 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572000a720 con 0x7f572814ddb0 2020-04-22T14:13:50.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.968+0000 7f5725ffb700 1 -- 172.21.15.103:0/3612011490 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5720005e20 con 0x7f572814ddb0 2020-04-22T14:13:50.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.968+0000 7f572e695700 1 -- 172.21.15.103:0/3612011490 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5728113f60 con 0x7f572814ddb0 2020-04-22T14:13:50.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.968+0000 7f572e695700 1 -- 172.21.15.103:0/3612011490 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f572814d1d0 con 0x7f572814ddb0 2020-04-22T14:13:50.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.969+0000 7f572cc32700 1 --2- 172.21.15.103:0/3612011490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f572814ddb0 0x7f57280b1600 secure :-1 s=THROTTLE_DONE pgs=1296 cs=0 l=1 rx=0x7f57200032b0 tx=0x7f5720007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:50.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.969+0000 7f572e695700 1 -- 172.21.15.103:0/3612011490 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5728056c90 con 0x7f572814ddb0 2020-04-22T14:13:50.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.969+0000 7f5725ffb700 1 -- 172.21.15.103:0/3612011490 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f572000f5b0 con 0x7f572814ddb0 2020-04-22T14:13:50.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.969+0000 7f572cc32700 1 --2- 172.21.15.103:0/3612011490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f572814ddb0 0x7f57280b1600 secure :-1 s=THROTTLE_DONE pgs=1296 cs=0 l=1 rx=0x7f57200032b0 tx=0x7f5720007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:50.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.969+0000 7f5725ffb700 1 --2- 172.21.15.103:0/3612011490 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f570c04d940 0x7f570c04fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:50.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.969+0000 7f5725ffb700 1 -- 172.21.15.103:0/3612011490 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6288+0+0 (secure 0 0 0) 0x7f57200623a0 con 0x7f572814ddb0 2020-04-22T14:13:50.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.969+0000 7f5727fff700 1 --2- 172.21.15.103:0/3612011490 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f570c04d940 0x7f570c04fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:50.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.970+0000 7f5727fff700 1 --2- 172.21.15.103:0/3612011490 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f570c04d940 0x7f570c04fe00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f572814d630 tx=0x7f5718001530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:50.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.970+0000 7f5727fff700 1 --2- 172.21.15.103:0/3612011490 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f570c04d940 0x7f570c04fe00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f572814d630 tx=0x7f5718001530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:50.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.970+0000 7f5727fff700 1 --2- 172.21.15.103:0/3612011490 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f570c04d940 0x7f570c04fe00 secure :-1 s=READY pgs=475 cs=0 l=1 rx=0x7f572814d630 tx=0x7f5718001530).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:50.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.973+0000 7f572cc32700 1 --2- 172.21.15.103:0/3612011490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f572814ddb0 0x7f57280b1600 secure :-1 s=THROTTLE_DONE pgs=1296 cs=0 l=1 rx=0x7f57200032b0 tx=0x7f5720007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:50.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:50.973+0000 7f5725ffb700 1 -- 172.21.15.103:0/3612011490 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f572003d840 con 0x7f572814ddb0 2020-04-22T14:13:51.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.162+0000 7f572e695700 1 -- 172.21.15.103:0/3612011490 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f572806a960 con 0x7f572814ddb0 2020-04-22T14:13:51.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.411+0000 7f572cc32700 1 --2- 172.21.15.103:0/3612011490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f572814ddb0 0x7f57280b1600 secure :-1 s=THROTTLE_DONE pgs=1296 cs=0 l=1 rx=0x7f57200032b0 tx=0x7f5720007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:51.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.411+0000 7f5725ffb700 1 -- 172.21.15.103:0/3612011490 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v58) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5720040e60 con 0x7f572814ddb0 2020-04-22T14:13:51.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.413+0000 7f572e695700 1 -- 172.21.15.103:0/3612011490 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f570c04d940 msgr2=0x7f570c04fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:51.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.413+0000 7f572e695700 1 --2- 172.21.15.103:0/3612011490 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f570c04d940 0x7f570c04fe00 secure :-1 s=READY pgs=475 cs=0 l=1 rx=0x7f572814d630 tx=0x7f5718001530).stop 2020-04-22T14:13:51.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.413+0000 7f572e695700 1 -- 172.21.15.103:0/3612011490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f572814ddb0 msgr2=0x7f57280b1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:51.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.413+0000 7f572e695700 1 --2- 172.21.15.103:0/3612011490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f572814ddb0 0x7f57280b1600 secure :-1 s=READY pgs=1296 cs=0 l=1 rx=0x7f57200032b0 tx=0x7f5720007dc0).stop 2020-04-22T14:13:51.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.413+0000 7f572e695700 1 -- 172.21.15.103:0/3612011490 shutdown_connections 2020-04-22T14:13:51.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.413+0000 7f572e695700 1 --2- 172.21.15.103:0/3612011490 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f570c04d940 0x7f570c04fe00 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:51.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.413+0000 7f572e695700 1 --2- 172.21.15.103:0/3612011490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f572814ddb0 0x7f57280b1600 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:51.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.413+0000 7f572e695700 1 --2- 172.21.15.103:0/3612011490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57280b9140 0x7f5728066100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:51.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.413+0000 7f572e695700 1 -- 172.21.15.103:0/3612011490 >> 172.21.15.103:0/3612011490 conn(0x7f572805b7b0 msgr2=0x7f57280b5090 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:51.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.413+0000 7f572e695700 1 -- 172.21.15.103:0/3612011490 shutdown_connections 2020-04-22T14:13:51.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.413+0000 7f572e695700 1 -- 172.21.15.103:0/3612011490 wait complete. 2020-04-22T14:13:51.427 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:51.441 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-04-22T14:13:51.590 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.587+0000 7f0403533700 1 Processor -- start 2020-04-22T14:13:51.591 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.588+0000 7f0403533700 1 -- start start 2020-04-22T14:13:51.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.588+0000 7f0403533700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f03fc0b6180 0x7f03fc1458e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:51.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.588+0000 7f0403533700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f03fc145d40 0x7f03fc1461f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:51.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.588+0000 7f0403533700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03fc0b4420 con 0x7f03fc0b9670 2020-04-22T14:13:51.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.588+0000 7f0403533700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03fc1498e0 con 0x7f03fc145d40 2020-04-22T14:13:51.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.588+0000 7f0403533700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03fc149b80 con 0x7f03fc0b6180 2020-04-22T14:13:51.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.588+0000 7f0400ace700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f03fc0b6180 0x7f03fc1458e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:51.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.588+0000 7f0400ace700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f03fc0b6180 0x7f03fc1458e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54048/0 (socket says 172.21.15.103:54048) 2020-04-22T14:13:51.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.588+0000 7f0400ace700 1 -- 172.21.15.103:0/3255877916 learned_addr learned my addr 172.21.15.103:0/3255877916 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:51.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.589+0000 7f0401ad0700 1 --2- 172.21.15.103:0/3255877916 >> v2:172.21.15.86:3300/0 conn(0x7f03fc145d40 0x7f03fc1461f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:51.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.589+0000 7f0400ace700 1 -- 172.21.15.103:0/3255877916 >> v2:172.21.15.86:3300/0 conn(0x7f03fc145d40 msgr2=0x7f03fc1461f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:51.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.589+0000 7f0400ace700 1 --2- 172.21.15.103:0/3255877916 >> v2:172.21.15.86:3300/0 conn(0x7f03fc145d40 0x7f03fc1461f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:51.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.589+0000 7f0400ace700 1 -- 172.21.15.103:0/3255877916 >> v1:172.21.15.86:6789/0 conn(0x7f03fc0b9670 legacy=0x7f03fc14a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:51.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.589+0000 7f0400ace700 1 -- 172.21.15.103:0/3255877916 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03fc0b9a50 con 0x7f03fc0b6180 2020-04-22T14:13:51.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.589+0000 7f0401ad0700 1 --2- 172.21.15.103:0/3255877916 >> v2:172.21.15.86:3300/0 conn(0x7f03fc145d40 0x7f03fc1461f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:13:51.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.589+0000 7f0400ace700 1 --2- 172.21.15.103:0/3255877916 >> v2:172.21.15.103:3300/0 conn(0x7f03fc0b6180 0x7f03fc1458e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f03fc0b5760 tx=0x7f03f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:51.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.589+0000 7f0400ace700 1 --2- 172.21.15.103:0/3255877916 >> v2:172.21.15.103:3300/0 conn(0x7f03fc0b6180 0x7f03fc1458e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f03fc0b5760 tx=0x7f03f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:51.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.589+0000 7f0400ace700 1 --2- 172.21.15.103:0/3255877916 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03fc0b6180 0x7f03fc1458e0 secure :-1 s=READY pgs=1297 cs=0 l=1 rx=0x7f03fc0b5760 tx=0x7f03f8007a40).ready entity=mon.1 client_cookie=37ca7362b991c025 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:51.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.589+0000 7f0400ace700 1 --2- 172.21.15.103:0/3255877916 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03fc0b6180 0x7f03fc1458e0 secure :-1 s=THROTTLE_DONE pgs=1297 cs=0 l=1 rx=0x7f03fc0b5760 tx=0x7f03f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:51.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.589+0000 7f03effff700 1 -- 172.21.15.103:0/3255877916 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03f80116e0 con 0x7f03fc0b6180 2020-04-22T14:13:51.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.589+0000 7f0400ace700 1 --2- 172.21.15.103:0/3255877916 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03fc0b6180 0x7f03fc1458e0 secure :-1 s=THROTTLE_DONE pgs=1297 cs=0 l=1 rx=0x7f03fc0b5760 tx=0x7f03f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:51.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.589+0000 7f0400ace700 1 --2- 172.21.15.103:0/3255877916 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03fc0b6180 0x7f03fc1458e0 secure :-1 s=THROTTLE_DONE pgs=1297 cs=0 l=1 rx=0x7f03fc0b5760 tx=0x7f03f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:51.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.589+0000 7f03effff700 1 -- 172.21.15.103:0/3255877916 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f8011880 con 0x7f03fc0b6180 2020-04-22T14:13:51.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.589+0000 7f03effff700 1 -- 172.21.15.103:0/3255877916 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03f8011ca0 con 0x7f03fc0b6180 2020-04-22T14:13:51.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.589+0000 7f0403533700 1 -- 172.21.15.103:0/3255877916 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03fc0b6180 msgr2=0x7f03fc1458e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:51.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.589+0000 7f0403533700 1 --2- 172.21.15.103:0/3255877916 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03fc0b6180 0x7f03fc1458e0 secure :-1 s=READY pgs=1297 cs=0 l=1 rx=0x7f03fc0b5760 tx=0x7f03f8007a40).stop 2020-04-22T14:13:51.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.590+0000 7f0403533700 1 -- 172.21.15.103:0/3255877916 shutdown_connections 2020-04-22T14:13:51.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.590+0000 7f0403533700 1 --2- 172.21.15.103:0/3255877916 >> v2:172.21.15.86:3300/0 conn(0x7f03fc145d40 0x7f03fc1461f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:51.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.590+0000 7f0403533700 1 --2- 172.21.15.103:0/3255877916 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03fc0b6180 0x7f03fc1458e0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:51.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.590+0000 7f0403533700 1 -- 172.21.15.103:0/3255877916 >> 172.21.15.103:0/3255877916 conn(0x7f03fc05ad30 msgr2=0x7f03fc05b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:51.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.590+0000 7f0403533700 1 -- 172.21.15.103:0/3255877916 shutdown_connections 2020-04-22T14:13:51.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.590+0000 7f0403533700 1 -- 172.21.15.103:0/3255877916 wait complete. 2020-04-22T14:13:51.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.591+0000 7f0403533700 1 Processor -- start 2020-04-22T14:13:51.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.591+0000 7f0403533700 1 -- start start 2020-04-22T14:13:51.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.591+0000 7f0403533700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f03fc0b6180 0x7f03fc134ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:51.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.591+0000 7f0403533700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f03fc145d40 0x7f03fc135350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:51.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.591+0000 7f0403533700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03fc112530 con 0x7f03fc0b9670 2020-04-22T14:13:51.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.591+0000 7f0403533700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03fc148970 con 0x7f03fc145d40 2020-04-22T14:13:51.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.591+0000 7f0403533700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03fc147220 con 0x7f03fc0b6180 2020-04-22T14:13:51.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.591+0000 7f04012cf700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f03fc0b6180 0x7f03fc134ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:51.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.591+0000 7f04012cf700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f03fc0b6180 0x7f03fc134ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54052/0 (socket says 172.21.15.103:54052) 2020-04-22T14:13:51.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.591+0000 7f04012cf700 1 -- 172.21.15.103:0/3655083213 learned_addr learned my addr 172.21.15.103:0/3655083213 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:51.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.592+0000 7f04012cf700 1 -- 172.21.15.103:0/3655083213 >> v2:172.21.15.86:3300/0 conn(0x7f03fc145d40 msgr2=0x7f03fc135350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:51.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.592+0000 7f0401ad0700 1 --2- 172.21.15.103:0/3655083213 >> v2:172.21.15.86:3300/0 conn(0x7f03fc145d40 0x7f03fc135350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:51.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.592+0000 7f04012cf700 1 --2- 172.21.15.103:0/3655083213 >> v2:172.21.15.86:3300/0 conn(0x7f03fc145d40 0x7f03fc135350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:51.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.592+0000 7f04012cf700 1 -- 172.21.15.103:0/3655083213 >> v1:172.21.15.86:6789/0 conn(0x7f03fc0b9670 legacy=0x7f03fc134030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:51.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.592+0000 7f04012cf700 1 -- 172.21.15.103:0/3655083213 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03fc1474c0 con 0x7f03fc0b6180 2020-04-22T14:13:51.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.592+0000 7f04012cf700 1 --2- 172.21.15.103:0/3655083213 >> v2:172.21.15.103:3300/0 conn(0x7f03fc0b6180 0x7f03fc134ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f03fc0af650 tx=0x7f03f0010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:51.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.592+0000 7f04012cf700 1 --2- 172.21.15.103:0/3655083213 >> v2:172.21.15.103:3300/0 conn(0x7f03fc0b6180 0x7f03fc134ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f03fc0af650 tx=0x7f03f0010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:51.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.592+0000 7f04012cf700 1 --2- 172.21.15.103:0/3655083213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03fc0b6180 0x7f03fc134ef0 secure :-1 s=READY pgs=1298 cs=0 l=1 rx=0x7f03fc0af650 tx=0x7f03f0010a70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:51.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.592+0000 7f04012cf700 1 --2- 172.21.15.103:0/3655083213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03fc0b6180 0x7f03fc134ef0 secure :-1 s=THROTTLE_DONE pgs=1298 cs=0 l=1 rx=0x7f03fc0af650 tx=0x7f03f0010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:51.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.592+0000 7f03ee7fc700 1 -- 172.21.15.103:0/3655083213 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03f0001ea0 con 0x7f03fc0b6180 2020-04-22T14:13:51.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.592+0000 7f04012cf700 1 --2- 172.21.15.103:0/3655083213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03fc0b6180 0x7f03fc134ef0 secure :-1 s=THROTTLE_DONE pgs=1298 cs=0 l=1 rx=0x7f03fc0af650 tx=0x7f03f0010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:51.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.592+0000 7f04012cf700 1 --2- 172.21.15.103:0/3655083213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03fc0b6180 0x7f03fc134ef0 secure :-1 s=THROTTLE_DONE pgs=1298 cs=0 l=1 rx=0x7f03fc0af650 tx=0x7f03f0010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:51.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.592+0000 7f03ee7fc700 1 -- 172.21.15.103:0/3655083213 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f000cbf0 con 0x7f03fc0b6180 2020-04-22T14:13:51.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.592+0000 7f0403533700 1 -- 172.21.15.103:0/3655083213 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03fc0aee20 con 0x7f03fc0b6180 2020-04-22T14:13:51.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.592+0000 7f03ee7fc700 1 -- 172.21.15.103:0/3655083213 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03f000ce20 con 0x7f03fc0b6180 2020-04-22T14:13:51.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.592+0000 7f0403533700 1 -- 172.21.15.103:0/3655083213 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03fc0acbc0 con 0x7f03fc0b6180 2020-04-22T14:13:51.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.593+0000 7f04012cf700 1 --2- 172.21.15.103:0/3655083213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03fc0b6180 0x7f03fc134ef0 secure :-1 s=THROTTLE_DONE pgs=1298 cs=0 l=1 rx=0x7f03fc0af650 tx=0x7f03f0010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:51.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.593+0000 7f03ee7fc700 1 -- 172.21.15.103:0/3655083213 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f03f00064e0 con 0x7f03fc0b6180 2020-04-22T14:13:51.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.593+0000 7f04012cf700 1 --2- 172.21.15.103:0/3655083213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03fc0b6180 0x7f03fc134ef0 secure :-1 s=THROTTLE_DONE pgs=1298 cs=0 l=1 rx=0x7f03fc0af650 tx=0x7f03f0010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:51.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.593+0000 7f0403533700 1 -- 172.21.15.103:0/3655083213 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03fc056c90 con 0x7f03fc0b6180 2020-04-22T14:13:51.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.593+0000 7f03ee7fc700 1 --2- 172.21.15.103:0/3655083213 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f03dc04d9a0 0x7f03dc04fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:51.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.593+0000 7f03ee7fc700 1 -- 172.21.15.103:0/3655083213 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6288+0+0 (secure 0 0 0) 0x7f03f0060f90 con 0x7f03fc0b6180 2020-04-22T14:13:51.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.593+0000 7f0400ace700 1 --2- 172.21.15.103:0/3655083213 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f03dc04d9a0 0x7f03dc04fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:51.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.594+0000 7f0400ace700 1 --2- 172.21.15.103:0/3655083213 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f03dc04d9a0 0x7f03dc04fe60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f03fc0b5760 tx=0x7f03f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:51.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.594+0000 7f0400ace700 1 --2- 172.21.15.103:0/3655083213 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f03dc04d9a0 0x7f03dc04fe60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f03fc0b5760 tx=0x7f03f8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:51.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.594+0000 7f0400ace700 1 --2- 172.21.15.103:0/3655083213 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f03dc04d9a0 0x7f03dc04fe60 secure :-1 s=READY pgs=477 cs=0 l=1 rx=0x7f03fc0b5760 tx=0x7f03f8007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:51.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.597+0000 7f04012cf700 1 --2- 172.21.15.103:0/3655083213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03fc0b6180 0x7f03fc134ef0 secure :-1 s=THROTTLE_DONE pgs=1298 cs=0 l=1 rx=0x7f03fc0af650 tx=0x7f03f0010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:51.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.597+0000 7f03ee7fc700 1 -- 172.21.15.103:0/3655083213 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f03f003c310 con 0x7f03fc0b6180 2020-04-22T14:13:51.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:51.738+0000 7f0403533700 1 -- 172.21.15.103:0/3655083213 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f03fc0b6660 con 0x7f03fc0b6180 2020-04-22T14:13:52.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.419+0000 7f04012cf700 1 --2- 172.21.15.103:0/3655083213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03fc0b6180 0x7f03fc134ef0 secure :-1 s=THROTTLE_DONE pgs=1298 cs=0 l=1 rx=0x7f03fc0af650 tx=0x7f03f0010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:52.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.420+0000 7f03ee7fc700 1 -- 172.21.15.103:0/3655083213 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v82) v1 ==== 185+0+0 (secure 0 0 0) 0x7f03f003f930 con 0x7f03fc0b6180 2020-04-22T14:13:52.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.421+0000 7f0403533700 1 -- 172.21.15.103:0/3655083213 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f03dc04d9a0 msgr2=0x7f03dc04fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:52.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.421+0000 7f0403533700 1 --2- 172.21.15.103:0/3655083213 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f03dc04d9a0 0x7f03dc04fe60 secure :-1 s=READY pgs=477 cs=0 l=1 rx=0x7f03fc0b5760 tx=0x7f03f8007a40).stop 2020-04-22T14:13:52.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.421+0000 7f0403533700 1 -- 172.21.15.103:0/3655083213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03fc0b6180 msgr2=0x7f03fc134ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:52.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.421+0000 7f0403533700 1 --2- 172.21.15.103:0/3655083213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03fc0b6180 0x7f03fc134ef0 secure :-1 s=READY pgs=1298 cs=0 l=1 rx=0x7f03fc0af650 tx=0x7f03f0010a70).stop 2020-04-22T14:13:52.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.421+0000 7f0403533700 1 -- 172.21.15.103:0/3655083213 shutdown_connections 2020-04-22T14:13:52.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.421+0000 7f0403533700 1 --2- 172.21.15.103:0/3655083213 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f03dc04d9a0 0x7f03dc04fe60 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:52.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.421+0000 7f0403533700 1 --2- 172.21.15.103:0/3655083213 >> v2:172.21.15.86:3300/0 conn(0x7f03fc145d40 0x7f03fc135350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:52.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.421+0000 7f0403533700 1 --2- 172.21.15.103:0/3655083213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03fc0b6180 0x7f03fc134ef0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:52.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.421+0000 7f0403533700 1 -- 172.21.15.103:0/3655083213 >> 172.21.15.103:0/3655083213 conn(0x7f03fc05ad30 msgr2=0x7f03fc05c750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:52.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.421+0000 7f0403533700 1 -- 172.21.15.103:0/3655083213 shutdown_connections 2020-04-22T14:13:52.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.421+0000 7f0403533700 1 -- 172.21.15.103:0/3655083213 wait complete. 2020-04-22T14:13:52.426 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' removed 2020-04-22T14:13:52.436 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:52.451 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2020-04-22T14:13:52.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.599+0000 7fdd44d79700 1 Processor -- start 2020-04-22T14:13:52.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.599+0000 7fdd44d79700 1 -- start start 2020-04-22T14:13:52.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.600+0000 7fdd44d79700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdd400b9140 0x7fdd4012b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:52.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.600+0000 7fdd44d79700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdd400ac950 0x7fdd4012b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:52.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.600+0000 7fdd44d79700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd401467e0 con 0x7fdd40146c40 2020-04-22T14:13:52.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.600+0000 7fdd44d79700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd400602f0 con 0x7fdd400ac950 2020-04-22T14:13:52.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.600+0000 7fdd44d79700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd40060050 con 0x7fdd400b9140 2020-04-22T14:13:52.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.600+0000 7fdd3dd9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdd400ac950 0x7fdd4012b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:52.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.600+0000 7fdd3ed9d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fdd40146c40 0x7fdd40143090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46250/0 (socket says 172.21.15.103:46250) 2020-04-22T14:13:52.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.600+0000 7fdd3ed9d700 1 -- 172.21.15.103:0/3317016486 learned_addr learned my addr 172.21.15.103:0/3317016486 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:52.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.600+0000 7fdd3e59c700 1 --2- 172.21.15.103:0/3317016486 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdd400b9140 0x7fdd4012b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:52.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.600+0000 7fdd3dd9b700 1 -- 172.21.15.103:0/3317016486 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdd400b9140 msgr2=0x7fdd4012b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:52.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.600+0000 7fdd3dd9b700 1 --2- 172.21.15.103:0/3317016486 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdd400b9140 0x7fdd4012b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:52.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.600+0000 7fdd3dd9b700 1 -- 172.21.15.103:0/3317016486 >> v1:172.21.15.103:6789/0 conn(0x7fdd40146c40 legacy=0x7fdd40143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:52.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.600+0000 7fdd3dd9b700 1 -- 172.21.15.103:0/3317016486 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd400b9520 con 0x7fdd400ac950 2020-04-22T14:13:52.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.600+0000 7fdd3dd9b700 1 --2- 172.21.15.103:0/3317016486 >> v2:172.21.15.103:3300/0 conn(0x7fdd400ac950 0x7fdd4012b670 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdd30002f30 tx=0x7fdd30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:52.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.600+0000 7fdd3dd9b700 1 --2- 172.21.15.103:0/3317016486 >> v2:172.21.15.103:3300/0 conn(0x7fdd400ac950 0x7fdd4012b670 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdd30002f30 tx=0x7fdd30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:52.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.600+0000 7fdd3dd9b700 1 --2- 172.21.15.103:0/3317016486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd400ac950 0x7fdd4012b670 secure :-1 s=READY pgs=1300 cs=0 l=1 rx=0x7fdd30002f30 tx=0x7fdd30007a40).ready entity=mon.1 client_cookie=c168bbd080669af server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:52.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.600+0000 7fdd3dd9b700 1 --2- 172.21.15.103:0/3317016486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd400ac950 0x7fdd4012b670 secure :-1 s=THROTTLE_DONE pgs=1300 cs=0 l=1 rx=0x7fdd30002f30 tx=0x7fdd30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:52.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.600+0000 7fdd3d59a700 1 -- 172.21.15.103:0/3317016486 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd30011470 con 0x7fdd400ac950 2020-04-22T14:13:52.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.600+0000 7fdd3dd9b700 1 --2- 172.21.15.103:0/3317016486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd400ac950 0x7fdd4012b670 secure :-1 s=THROTTLE_DONE pgs=1300 cs=0 l=1 rx=0x7fdd30002f30 tx=0x7fdd30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:52.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.600+0000 7fdd3dd9b700 1 --2- 172.21.15.103:0/3317016486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd400ac950 0x7fdd4012b670 secure :-1 s=THROTTLE_DONE pgs=1300 cs=0 l=1 rx=0x7fdd30002f30 tx=0x7fdd30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:52.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.600+0000 7fdd3d59a700 1 -- 172.21.15.103:0/3317016486 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd30011610 con 0x7fdd400ac950 2020-04-22T14:13:52.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.600+0000 7fdd3d59a700 1 -- 172.21.15.103:0/3317016486 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd30011a30 con 0x7fdd400ac950 2020-04-22T14:13:52.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.600+0000 7fdd44d79700 1 -- 172.21.15.103:0/3317016486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd400ac950 msgr2=0x7fdd4012b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:52.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.600+0000 7fdd44d79700 1 --2- 172.21.15.103:0/3317016486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd400ac950 0x7fdd4012b670 secure :-1 s=READY pgs=1300 cs=0 l=1 rx=0x7fdd30002f30 tx=0x7fdd30007a40).stop 2020-04-22T14:13:52.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.601+0000 7fdd44d79700 1 -- 172.21.15.103:0/3317016486 shutdown_connections 2020-04-22T14:13:52.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.601+0000 7fdd44d79700 1 --2- 172.21.15.103:0/3317016486 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdd400b9140 0x7fdd4012b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:52.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.601+0000 7fdd44d79700 1 --2- 172.21.15.103:0/3317016486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd400ac950 0x7fdd4012b670 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:52.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.601+0000 7fdd44d79700 1 -- 172.21.15.103:0/3317016486 >> 172.21.15.103:0/3317016486 conn(0x7fdd4005b7b0 msgr2=0x7fdd400b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:52.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.601+0000 7fdd44d79700 1 -- 172.21.15.103:0/3317016486 shutdown_connections 2020-04-22T14:13:52.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.601+0000 7fdd44d79700 1 -- 172.21.15.103:0/3317016486 wait complete. 2020-04-22T14:13:52.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.602+0000 7fdd44d79700 1 Processor -- start 2020-04-22T14:13:52.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.602+0000 7fdd44d79700 1 -- start start 2020-04-22T14:13:52.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.603+0000 7fdd44d79700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdd400ac950 0x7fdd40144500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:52.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.603+0000 7fdd44d79700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdd40146c40 0x7fdd40128570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:52.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.603+0000 7fdd44d79700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd401289d0 con 0x7fdd400b9140 2020-04-22T14:13:52.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.603+0000 7fdd44d79700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd40129900 con 0x7fdd400ac950 2020-04-22T14:13:52.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.603+0000 7fdd44d79700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd40129ba0 con 0x7fdd40146c40 2020-04-22T14:13:52.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.603+0000 7fdd3ed9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdd40146c40 0x7fdd40128570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:52.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.603+0000 7fdd3dd9b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fdd400b9140 0x7fdd40151870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46258/0 (socket says 172.21.15.103:46258) 2020-04-22T14:13:52.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.603+0000 7fdd3ed9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdd40146c40 0x7fdd40128570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54070/0 (socket says 172.21.15.103:54070) 2020-04-22T14:13:52.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.603+0000 7fdd3dd9b700 1 -- 172.21.15.103:0/2783540581 learned_addr learned my addr 172.21.15.103:0/2783540581 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:52.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.603+0000 7fdd3e59c700 1 --2- 172.21.15.103:0/2783540581 >> v2:172.21.15.86:3300/0 conn(0x7fdd400ac950 0x7fdd40144500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:52.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.603+0000 7fdd2f7fe700 1 -- 172.21.15.103:0/2783540581 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1261908995 0 0) 0x7fdd400b9520 con 0x7fdd400b9140 2020-04-22T14:13:52.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.603+0000 7fdd3ed9d700 1 -- 172.21.15.103:0/2783540581 >> v2:172.21.15.86:3300/0 conn(0x7fdd400ac950 msgr2=0x7fdd40144500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:52.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.603+0000 7fdd3ed9d700 1 --2- 172.21.15.103:0/2783540581 >> v2:172.21.15.86:3300/0 conn(0x7fdd400ac950 0x7fdd40144500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:52.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.603+0000 7fdd3ed9d700 1 -- 172.21.15.103:0/2783540581 >> v1:172.21.15.103:6789/0 conn(0x7fdd400b9140 legacy=0x7fdd40151870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:52.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.603+0000 7fdd3ed9d700 1 -- 172.21.15.103:0/2783540581 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd40151f80 con 0x7fdd40146c40 2020-04-22T14:13:52.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.603+0000 7fdd3ed9d700 1 --2- 172.21.15.103:0/2783540581 >> v2:172.21.15.103:3300/0 conn(0x7fdd40146c40 0x7fdd40128570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdd40060f70 tx=0x7fdd38010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:52.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.603+0000 7fdd3ed9d700 1 --2- 172.21.15.103:0/2783540581 >> v2:172.21.15.103:3300/0 conn(0x7fdd40146c40 0x7fdd40128570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdd40060f70 tx=0x7fdd38010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:52.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.603+0000 7fdd3ed9d700 1 --2- 172.21.15.103:0/2783540581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd40146c40 0x7fdd40128570 secure :-1 s=READY pgs=1302 cs=0 l=1 rx=0x7fdd40060f70 tx=0x7fdd38010bb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:52.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.603+0000 7fdd3ed9d700 1 --2- 172.21.15.103:0/2783540581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd40146c40 0x7fdd40128570 secure :-1 s=THROTTLE_DONE pgs=1302 cs=0 l=1 rx=0x7fdd40060f70 tx=0x7fdd38010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:52.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.603+0000 7fdd2f7fe700 1 -- 172.21.15.103:0/2783540581 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd38012250 con 0x7fdd40146c40 2020-04-22T14:13:52.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.603+0000 7fdd3ed9d700 1 --2- 172.21.15.103:0/2783540581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd40146c40 0x7fdd40128570 secure :-1 s=THROTTLE_DONE pgs=1302 cs=0 l=1 rx=0x7fdd40060f70 tx=0x7fdd38010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:52.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.603+0000 7fdd3ed9d700 1 --2- 172.21.15.103:0/2783540581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd40146c40 0x7fdd40128570 secure :-1 s=THROTTLE_DONE pgs=1302 cs=0 l=1 rx=0x7fdd40060f70 tx=0x7fdd38010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:52.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.603+0000 7fdd2f7fe700 1 -- 172.21.15.103:0/2783540581 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd380123f0 con 0x7fdd40146c40 2020-04-22T14:13:52.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.603+0000 7fdd44d79700 1 -- 172.21.15.103:0/2783540581 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd40142fd0 con 0x7fdd40146c40 2020-04-22T14:13:52.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.603+0000 7fdd2f7fe700 1 -- 172.21.15.103:0/2783540581 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd380127d0 con 0x7fdd40146c40 2020-04-22T14:13:52.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.603+0000 7fdd44d79700 1 -- 172.21.15.103:0/2783540581 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd401456d0 con 0x7fdd40146c40 2020-04-22T14:13:52.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.604+0000 7fdd3ed9d700 1 --2- 172.21.15.103:0/2783540581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd40146c40 0x7fdd40128570 secure :-1 s=THROTTLE_DONE pgs=1302 cs=0 l=1 rx=0x7fdd40060f70 tx=0x7fdd38010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:52.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.605+0000 7fdd2f7fe700 1 -- 172.21.15.103:0/2783540581 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fdd38012a40 con 0x7fdd40146c40 2020-04-22T14:13:52.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.605+0000 7fdd3ed9d700 1 --2- 172.21.15.103:0/2783540581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd40146c40 0x7fdd40128570 secure :-1 s=THROTTLE_DONE pgs=1302 cs=0 l=1 rx=0x7fdd40060f70 tx=0x7fdd38010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:52.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.605+0000 7fdd44d79700 1 -- 172.21.15.103:0/2783540581 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd40056c90 con 0x7fdd40146c40 2020-04-22T14:13:52.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.605+0000 7fdd2f7fe700 1 --2- 172.21.15.103:0/2783540581 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdd1c04d8d0 0x7fdd1c04fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:52.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.605+0000 7fdd2f7fe700 1 -- 172.21.15.103:0/2783540581 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5850+0+0 (secure 0 0 0) 0x7fdd380090c0 con 0x7fdd40146c40 2020-04-22T14:13:52.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.605+0000 7fdd3e59c700 1 --2- 172.21.15.103:0/2783540581 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdd1c04d8d0 0x7fdd1c04fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:52.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.605+0000 7fdd3e59c700 1 --2- 172.21.15.103:0/2783540581 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdd1c04d8d0 0x7fdd1c04fd90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdd34002f30 tx=0x7fdd3400d710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:52.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.606+0000 7fdd3e59c700 1 --2- 172.21.15.103:0/2783540581 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdd1c04d8d0 0x7fdd1c04fd90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdd34002f30 tx=0x7fdd3400d710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:52.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.606+0000 7fdd3e59c700 1 --2- 172.21.15.103:0/2783540581 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdd1c04d8d0 0x7fdd1c04fd90 secure :-1 s=READY pgs=478 cs=0 l=1 rx=0x7fdd34002f30 tx=0x7fdd3400d710).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:52.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.609+0000 7fdd3ed9d700 1 --2- 172.21.15.103:0/2783540581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd40146c40 0x7fdd40128570 secure :-1 s=THROTTLE_DONE pgs=1302 cs=0 l=1 rx=0x7fdd40060f70 tx=0x7fdd38010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:52.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.609+0000 7fdd2f7fe700 1 -- 172.21.15.103:0/2783540581 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fdd3803cd50 con 0x7fdd40146c40 2020-04-22T14:13:52.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:52.749+0000 7fdd44d79700 1 -- 172.21.15.103:0/2783540581 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdd4006a960 con 0x7fdd40146c40 2020-04-22T14:13:53.040 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:13:53.057 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:13:53.099 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:53.113 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:13:53.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.422+0000 7fdd3ed9d700 1 --2- 172.21.15.103:0/2783540581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd40146c40 0x7fdd40128570 secure :-1 s=THROTTLE_DONE pgs=1302 cs=0 l=1 rx=0x7fdd40060f70 tx=0x7fdd38010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:53.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.422+0000 7fdd2f7fe700 1 -- 172.21.15.103:0/2783540581 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v83) v1 ==== 173+0+0 (secure 0 0 0) 0x7fdd38040370 con 0x7fdd40146c40 2020-04-22T14:13:53.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.423+0000 7fdd44d79700 1 -- 172.21.15.103:0/2783540581 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdd1c04d8d0 msgr2=0x7fdd1c04fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:53.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.424+0000 7fdd44d79700 1 --2- 172.21.15.103:0/2783540581 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdd1c04d8d0 0x7fdd1c04fd90 secure :-1 s=READY pgs=478 cs=0 l=1 rx=0x7fdd34002f30 tx=0x7fdd3400d710).stop 2020-04-22T14:13:53.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.424+0000 7fdd44d79700 1 -- 172.21.15.103:0/2783540581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd40146c40 msgr2=0x7fdd40128570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:53.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.424+0000 7fdd44d79700 1 --2- 172.21.15.103:0/2783540581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd40146c40 0x7fdd40128570 secure :-1 s=READY pgs=1302 cs=0 l=1 rx=0x7fdd40060f70 tx=0x7fdd38010bb0).stop 2020-04-22T14:13:53.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.424+0000 7fdd44d79700 1 -- 172.21.15.103:0/2783540581 shutdown_connections 2020-04-22T14:13:53.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.424+0000 7fdd44d79700 1 --2- 172.21.15.103:0/2783540581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd40146c40 0x7fdd40128570 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:53.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.424+0000 7fdd44d79700 1 --2- 172.21.15.103:0/2783540581 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdd1c04d8d0 0x7fdd1c04fd90 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:53.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.424+0000 7fdd44d79700 1 --2- 172.21.15.103:0/2783540581 >> v2:172.21.15.86:3300/0 conn(0x7fdd400ac950 0x7fdd40144500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:53.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.424+0000 7fdd44d79700 1 -- 172.21.15.103:0/2783540581 >> 172.21.15.103:0/2783540581 conn(0x7fdd4005b7b0 msgr2=0x7fdd40140960 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:53.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.424+0000 7fdd44d79700 1 -- 172.21.15.103:0/2783540581 shutdown_connections 2020-04-22T14:13:53.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.424+0000 7fdd44d79700 1 -- 172.21.15.103:0/2783540581 wait complete. 2020-04-22T14:13:53.429 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' removed 2020-04-22T14:13:53.438 INFO:tasks.ceph.mds.a:Restarting daemon 2020-04-22T14:13:53.438 INFO:tasks.ceph.mds.a:Stopping old one... 2020-04-22T14:13:53.438 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-04-22T14:13:53.438 INFO:teuthology.orchestra.run:waiting for 300 2020-04-22T14:13:53.439 INFO:tasks.ceph.mds.b:Restarting daemon 2020-04-22T14:13:53.439 INFO:tasks.ceph.mds.b:Stopping old one... 2020-04-22T14:13:53.439 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-04-22T14:13:53.439 INFO:teuthology.orchestra.run:waiting for 300 2020-04-22T14:13:53.446 INFO:tasks.ceph.mds.a:Stopped 2020-04-22T14:13:53.446 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:53.448 INFO:tasks.ceph.mds.b:Stopped 2020-04-22T14:13:53.448 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:13:53.501 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-04-22T14:13:53.503 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-04-22T14:13:53.548 INFO:tasks.ceph.mds.b:Started 2020-04-22T14:13:53.549 DEBUG:teuthology.parallel:result is None 2020-04-22T14:13:53.549 INFO:tasks.ceph.mds.a:Started 2020-04-22T14:13:53.549 DEBUG:teuthology.parallel:result is None 2020-04-22T14:13:53.550 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:53.564 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2020-04-22T14:13:53.624 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2020-04-22T14:13:53.628 INFO:tasks.ceph.mds.b.smithi086.stdout:starting mds.b at 2020-04-22T14:13:53.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.712+0000 7f1490ebb700 1 Processor -- start 2020-04-22T14:13:53.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.712+0000 7f1490ebb700 1 -- start start 2020-04-22T14:13:53.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.713+0000 7f1490ebb700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f148c0b4320 0x7f148c0b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:53.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.713+0000 7f1490ebb700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f148c0b2530 0x7f148c0b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:53.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.713+0000 7f1490ebb700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f148c0b0e90 con 0x7f148c0b4700 2020-04-22T14:13:53.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.713+0000 7f1490ebb700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f148c0b2ac0 con 0x7f148c0b4320 2020-04-22T14:13:53.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.713+0000 7f1490ebb700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148c0b1130 con 0x7f148c0b2530 2020-04-22T14:13:53.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.713+0000 7f1489d9b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f148c0b4700 0x7f148c0afa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46274/0 (socket says 172.21.15.103:46274) 2020-04-22T14:13:53.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.713+0000 7f1489d9b700 1 -- 172.21.15.103:0/2838107311 learned_addr learned my addr 172.21.15.103:0/2838107311 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:53.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.713+0000 7f148a59c700 1 --2- 172.21.15.103:0/2838107311 >> v2:172.21.15.86:3300/0 conn(0x7f148c0b4320 0x7f148c0b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:53.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.713+0000 7f148ad9d700 1 --2- 172.21.15.103:0/2838107311 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f148c0b2530 0x7f148c0b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:53.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.713+0000 7f148959a700 1 -- 172.21.15.103:0/2838107311 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2510378499 0 0) 0x7f148c0b0e90 con 0x7f148c0b4700 2020-04-22T14:13:53.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.713+0000 7f148959a700 1 -- 172.21.15.103:0/2838107311 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1474003230 con 0x7f148c0b4700 2020-04-22T14:13:53.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.713+0000 7f148a59c700 1 -- 172.21.15.103:0/2838107311 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f148c0b2530 msgr2=0x7f148c0b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:53.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.713+0000 7f148a59c700 1 --2- 172.21.15.103:0/2838107311 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f148c0b2530 0x7f148c0b0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:53.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.713+0000 7f148a59c700 1 -- 172.21.15.103:0/2838107311 >> v1:172.21.15.103:6789/0 conn(0x7f148c0b4700 legacy=0x7f148c0afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:53.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.713+0000 7f148a59c700 1 -- 172.21.15.103:0/2838107311 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148c0ae500 con 0x7f148c0b4320 2020-04-22T14:13:53.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.713+0000 7f148ad9d700 1 --2- 172.21.15.103:0/2838107311 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f148c0b2530 0x7f148c0b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:13:53.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.713+0000 7f148a59c700 1 --2- 172.21.15.103:0/2838107311 >> v2:172.21.15.86:3300/0 conn(0x7f148c0b4320 0x7f148c0b15d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f147c002f30 tx=0x7f147c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:53.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.713+0000 7f148a59c700 1 --2- 172.21.15.103:0/2838107311 >> v2:172.21.15.86:3300/0 conn(0x7f148c0b4320 0x7f148c0b15d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f147c002f30 tx=0x7f147c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:53.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.713+0000 7f148a59c700 1 --2- 172.21.15.103:0/2838107311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f148c0b4320 0x7f148c0b15d0 secure :-1 s=READY pgs=706 cs=0 l=1 rx=0x7f147c002f30 tx=0x7f147c007a40).ready entity=mon.0 client_cookie=ea668b543af404da server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:53.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.713+0000 7f148a59c700 1 --2- 172.21.15.103:0/2838107311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f148c0b4320 0x7f148c0b15d0 secure :-1 s=THROTTLE_DONE pgs=706 cs=0 l=1 rx=0x7f147c002f30 tx=0x7f147c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:53.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.713+0000 7f148959a700 1 -- 172.21.15.103:0/2838107311 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f147c011310 con 0x7f148c0b4320 2020-04-22T14:13:53.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.713+0000 7f148a59c700 1 --2- 172.21.15.103:0/2838107311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f148c0b4320 0x7f148c0b15d0 secure :-1 s=THROTTLE_DONE pgs=706 cs=0 l=1 rx=0x7f147c002f30 tx=0x7f147c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:53.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.713+0000 7f148959a700 1 -- 172.21.15.103:0/2838107311 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f147c0114b0 con 0x7f148c0b4320 2020-04-22T14:13:53.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.713+0000 7f148a59c700 1 --2- 172.21.15.103:0/2838107311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f148c0b4320 0x7f148c0b15d0 secure :-1 s=THROTTLE_DONE pgs=706 cs=0 l=1 rx=0x7f147c002f30 tx=0x7f147c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:53.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.713+0000 7f148959a700 1 -- 172.21.15.103:0/2838107311 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f147c011890 con 0x7f148c0b4320 2020-04-22T14:13:53.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.713+0000 7f1490ebb700 1 -- 172.21.15.103:0/2838107311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f148c0b4320 msgr2=0x7f148c0b15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:53.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.713+0000 7f1490ebb700 1 --2- 172.21.15.103:0/2838107311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f148c0b4320 0x7f148c0b15d0 secure :-1 s=READY pgs=706 cs=0 l=1 rx=0x7f147c002f30 tx=0x7f147c007a40).stop 2020-04-22T14:13:53.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.714+0000 7f1490ebb700 1 -- 172.21.15.103:0/2838107311 shutdown_connections 2020-04-22T14:13:53.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.714+0000 7f1490ebb700 1 --2- 172.21.15.103:0/2838107311 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f148c0b2530 0x7f148c0b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:53.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.714+0000 7f1490ebb700 1 --2- 172.21.15.103:0/2838107311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f148c0b4320 0x7f148c0b15d0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:53.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.714+0000 7f1490ebb700 1 -- 172.21.15.103:0/2838107311 >> 172.21.15.103:0/2838107311 conn(0x7f148c0b86b0 msgr2=0x7f148c0b8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:53.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.714+0000 7f1490ebb700 1 -- 172.21.15.103:0/2838107311 shutdown_connections 2020-04-22T14:13:53.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.714+0000 7f1490ebb700 1 -- 172.21.15.103:0/2838107311 wait complete. 2020-04-22T14:13:53.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.715+0000 7f1490ebb700 1 Processor -- start 2020-04-22T14:13:53.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.715+0000 7f1490ebb700 1 -- start start 2020-04-22T14:13:53.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.716+0000 7f1490ebb700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f148c0b2530 0x7f148c066590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:53.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.716+0000 7f1490ebb700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f148c0b4700 0x7f148c1327a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:53.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.716+0000 7f1490ebb700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f148c145830 con 0x7f148c0b4320 2020-04-22T14:13:53.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.716+0000 7f1490ebb700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f148c145650 con 0x7f148c0b2530 2020-04-22T14:13:53.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.716+0000 7f1490ebb700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148c145ad0 con 0x7f148c0b4700 2020-04-22T14:13:53.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.716+0000 7f148a59c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f148c0b2530 0x7f148c066590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:53.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.716+0000 7f148a59c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f148c0b2530 0x7f148c066590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54090/0 (socket says 172.21.15.103:54090) 2020-04-22T14:13:53.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.716+0000 7f148a59c700 1 -- 172.21.15.103:0/3369920732 learned_addr learned my addr 172.21.15.103:0/3369920732 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:53.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.716+0000 7f148ad9d700 1 --2- 172.21.15.103:0/3369920732 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f148c0b4700 0x7f148c1327a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:53.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.716+0000 7f148a59c700 1 -- 172.21.15.103:0/3369920732 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f148c0b4700 msgr2=0x7f148c1327a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:53.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.716+0000 7f148a59c700 1 --2- 172.21.15.103:0/3369920732 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f148c0b4700 0x7f148c1327a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:53.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.716+0000 7f148a59c700 1 -- 172.21.15.103:0/3369920732 >> v1:172.21.15.86:6789/0 conn(0x7f148c0b4320 legacy=0x7f148c132090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:53.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.716+0000 7f148a59c700 1 -- 172.21.15.103:0/3369920732 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148c1451a0 con 0x7f148c0b2530 2020-04-22T14:13:53.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.716+0000 7f148a59c700 1 --2- 172.21.15.103:0/3369920732 >> v2:172.21.15.103:3300/0 conn(0x7f148c0b2530 0x7f148c066590 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f148c065ea0 tx=0x7f147c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:53.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.716+0000 7f148a59c700 1 --2- 172.21.15.103:0/3369920732 >> v2:172.21.15.103:3300/0 conn(0x7f148c0b2530 0x7f148c066590 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f148c065ea0 tx=0x7f147c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:53.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.716+0000 7f148a59c700 1 --2- 172.21.15.103:0/3369920732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f148c0b2530 0x7f148c066590 secure :-1 s=READY pgs=1309 cs=0 l=1 rx=0x7f148c065ea0 tx=0x7f147c007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:53.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.716+0000 7f148a59c700 1 --2- 172.21.15.103:0/3369920732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f148c0b2530 0x7f148c066590 secure :-1 s=THROTTLE_DONE pgs=1309 cs=0 l=1 rx=0x7f148c065ea0 tx=0x7f147c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:53.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.716+0000 7f14837fe700 1 -- 172.21.15.103:0/3369920732 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f147c0118f0 con 0x7f148c0b2530 2020-04-22T14:13:53.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.716+0000 7f148a59c700 1 --2- 172.21.15.103:0/3369920732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f148c0b2530 0x7f148c066590 secure :-1 s=THROTTLE_DONE pgs=1309 cs=0 l=1 rx=0x7f148c065ea0 tx=0x7f147c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:53.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.716+0000 7f148a59c700 1 --2- 172.21.15.103:0/3369920732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f148c0b2530 0x7f148c066590 secure :-1 s=THROTTLE_DONE pgs=1309 cs=0 l=1 rx=0x7f148c065ea0 tx=0x7f147c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:53.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.716+0000 7f14837fe700 1 -- 172.21.15.103:0/3369920732 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f147c007360 con 0x7f148c0b2530 2020-04-22T14:13:53.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.716+0000 7f14837fe700 1 -- 172.21.15.103:0/3369920732 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f147c0056c0 con 0x7f148c0b2530 2020-04-22T14:13:53.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.716+0000 7f1490ebb700 1 -- 172.21.15.103:0/3369920732 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f148c143c20 con 0x7f148c0b2530 2020-04-22T14:13:53.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.716+0000 7f1490ebb700 1 -- 172.21.15.103:0/3369920732 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f148c1461b0 con 0x7f148c0b2530 2020-04-22T14:13:53.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.717+0000 7f148a59c700 1 --2- 172.21.15.103:0/3369920732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f148c0b2530 0x7f148c066590 secure :-1 s=THROTTLE_DONE pgs=1309 cs=0 l=1 rx=0x7f148c065ea0 tx=0x7f147c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:53.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.717+0000 7f14837fe700 1 -- 172.21.15.103:0/3369920732 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f147c005930 con 0x7f148c0b2530 2020-04-22T14:13:53.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.717+0000 7f148a59c700 1 --2- 172.21.15.103:0/3369920732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f148c0b2530 0x7f148c066590 secure :-1 s=THROTTLE_DONE pgs=1309 cs=0 l=1 rx=0x7f148c065ea0 tx=0x7f147c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:53.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.717+0000 7f1490ebb700 1 -- 172.21.15.103:0/3369920732 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f148c1453f0 con 0x7f148c0b2530 2020-04-22T14:13:53.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.718+0000 7f14837fe700 1 --2- 172.21.15.103:0/3369920732 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f146804da60 0x7f146804ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:53.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.718+0000 7f14837fe700 1 -- 172.21.15.103:0/3369920732 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f147c061f00 con 0x7f148c0b2530 2020-04-22T14:13:53.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.718+0000 7f1489d9b700 1 --2- 172.21.15.103:0/3369920732 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f146804da60 0x7f146804ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:53.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.718+0000 7f1489d9b700 1 --2- 172.21.15.103:0/3369920732 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f146804da60 0x7f146804ff20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f148c065820 tx=0x7f1478001510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:53.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.718+0000 7f1489d9b700 1 --2- 172.21.15.103:0/3369920732 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f146804da60 0x7f146804ff20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f148c065820 tx=0x7f1478001510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:53.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.718+0000 7f1489d9b700 1 --2- 172.21.15.103:0/3369920732 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f146804da60 0x7f146804ff20 secure :-1 s=READY pgs=479 cs=0 l=1 rx=0x7f148c065820 tx=0x7f1478001510).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:53.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.722+0000 7f148a59c700 1 --2- 172.21.15.103:0/3369920732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f148c0b2530 0x7f148c066590 secure :-1 s=THROTTLE_DONE pgs=1309 cs=0 l=1 rx=0x7f148c065ea0 tx=0x7f147c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:53.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.722+0000 7f14837fe700 1 -- 172.21.15.103:0/3369920732 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f148c1453f0 con 0x7f148c0b2530 2020-04-22T14:13:53.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:53.884+0000 7f1490ebb700 1 -- 172.21.15.103:0/3369920732 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f148c145390 con 0x7f148c0b2530 2020-04-22T14:13:54.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.654+0000 7f148a59c700 1 --2- 172.21.15.103:0/3369920732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f148c0b2530 0x7f148c066590 secure :-1 s=THROTTLE_DONE pgs=1309 cs=0 l=1 rx=0x7f148c065ea0 tx=0x7f147c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:54.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.654+0000 7f14837fe700 1 -- 172.21.15.103:0/3369920732 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v85) v1 ==== 97+0+0 (secure 0 0 0) 0x7f147c03d400 con 0x7f148c0b2530 2020-04-22T14:13:54.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.656+0000 7f1490ebb700 1 -- 172.21.15.103:0/3369920732 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f146804da60 msgr2=0x7f146804ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:54.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.656+0000 7f1490ebb700 1 --2- 172.21.15.103:0/3369920732 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f146804da60 0x7f146804ff20 secure :-1 s=READY pgs=479 cs=0 l=1 rx=0x7f148c065820 tx=0x7f1478001510).stop 2020-04-22T14:13:54.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.656+0000 7f1490ebb700 1 -- 172.21.15.103:0/3369920732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f148c0b2530 msgr2=0x7f148c066590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:54.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.656+0000 7f1490ebb700 1 --2- 172.21.15.103:0/3369920732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f148c0b2530 0x7f148c066590 secure :-1 s=READY pgs=1309 cs=0 l=1 rx=0x7f148c065ea0 tx=0x7f147c007a40).stop 2020-04-22T14:13:54.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.656+0000 7f1490ebb700 1 -- 172.21.15.103:0/3369920732 shutdown_connections 2020-04-22T14:13:54.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.656+0000 7f1490ebb700 1 --2- 172.21.15.103:0/3369920732 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f146804da60 0x7f146804ff20 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:54.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.656+0000 7f1490ebb700 1 --2- 172.21.15.103:0/3369920732 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f148c0b4700 0x7f148c1327a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:54.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.656+0000 7f1490ebb700 1 --2- 172.21.15.103:0/3369920732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f148c0b2530 0x7f148c066590 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:54.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.656+0000 7f1490ebb700 1 -- 172.21.15.103:0/3369920732 >> 172.21.15.103:0/3369920732 conn(0x7f148c0b86b0 msgr2=0x7f148c140060 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:54.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.656+0000 7f1490ebb700 1 -- 172.21.15.103:0/3369920732 shutdown_connections 2020-04-22T14:13:54.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.656+0000 7f1490ebb700 1 -- 172.21.15.103:0/3369920732 wait complete. 2020-04-22T14:13:54.661 INFO:teuthology.orchestra.run.smithi103.stderr: removed all blacklist entries 2020-04-22T14:13:54.671 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2020-04-22T14:13:54.671 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:54.726 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2020-04-22T14:13:54.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.873+0000 7f5eaf59e700 1 Processor -- start 2020-04-22T14:13:54.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.873+0000 7f5eaf59e700 1 -- start start 2020-04-22T14:13:54.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.874+0000 7f5eaf59e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5eb00654e0 0x7f5eb00664a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:54.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.874+0000 7f5eaf59e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5eb0142320 0x7f5eb0063340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:54.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.874+0000 7f5eaf59e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eb0066a20 con 0x7f5eb00ad150 2020-04-22T14:13:54.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.874+0000 7f5eaf59e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eb00adf30 con 0x7f5eb0142320 2020-04-22T14:13:54.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.874+0000 7f5eaf59e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eb01427a0 con 0x7f5eb00654e0 2020-04-22T14:13:54.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.875+0000 7f5eadd9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5eb00654e0 0x7f5eb00664a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:54.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.875+0000 7f5eae59c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f5eb00ad150 0x7f5eb0141c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46290/0 (socket says 172.21.15.103:46290) 2020-04-22T14:13:54.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.875+0000 7f5eadd9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5eb00654e0 0x7f5eb00664a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54100/0 (socket says 172.21.15.103:54100) 2020-04-22T14:13:54.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.875+0000 7f5eae59c700 1 -- 172.21.15.103:0/1003616633 learned_addr learned my addr 172.21.15.103:0/1003616633 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:54.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.875+0000 7f5eadd9b700 1 -- 172.21.15.103:0/1003616633 >> v2:172.21.15.86:3300/0 conn(0x7f5eb0142320 msgr2=0x7f5eb0063340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:54.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.875+0000 7f5eadd9b700 1 --2- 172.21.15.103:0/1003616633 >> v2:172.21.15.86:3300/0 conn(0x7f5eb0142320 0x7f5eb0063340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:54.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.875+0000 7f5eadd9b700 1 -- 172.21.15.103:0/1003616633 >> v1:172.21.15.103:6789/0 conn(0x7f5eb00ad150 legacy=0x7f5eb0141c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:54.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.875+0000 7f5eadd9b700 1 -- 172.21.15.103:0/1003616633 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb00ad7f0 con 0x7f5eb00654e0 2020-04-22T14:13:54.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.875+0000 7f5ead59a700 1 -- 172.21.15.103:0/1003616633 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3656403970 0 0) 0x7f5eb0066a20 con 0x7f5eb00ad150 2020-04-22T14:13:54.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.875+0000 7f5eadd9b700 1 --2- 172.21.15.103:0/1003616633 >> v2:172.21.15.103:3300/0 conn(0x7f5eb00654e0 0x7f5eb00664a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5e98002f30 tx=0x7f5e98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:54.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.875+0000 7f5eadd9b700 1 --2- 172.21.15.103:0/1003616633 >> v2:172.21.15.103:3300/0 conn(0x7f5eb00654e0 0x7f5eb00664a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5e98002f30 tx=0x7f5e98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:54.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.875+0000 7f5eadd9b700 1 --2- 172.21.15.103:0/1003616633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5eb00654e0 0x7f5eb00664a0 secure :-1 s=READY pgs=1311 cs=0 l=1 rx=0x7f5e98002f30 tx=0x7f5e98007a40).ready entity=mon.1 client_cookie=fa9d6f5e81836005 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:54.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.875+0000 7f5eadd9b700 1 --2- 172.21.15.103:0/1003616633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5eb00654e0 0x7f5eb00664a0 secure :-1 s=THROTTLE_DONE pgs=1311 cs=0 l=1 rx=0x7f5e98002f30 tx=0x7f5e98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:54.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.875+0000 7f5ead59a700 1 -- 172.21.15.103:0/1003616633 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e98011470 con 0x7f5eb00654e0 2020-04-22T14:13:54.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.875+0000 7f5eadd9b700 1 --2- 172.21.15.103:0/1003616633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5eb00654e0 0x7f5eb00664a0 secure :-1 s=THROTTLE_DONE pgs=1311 cs=0 l=1 rx=0x7f5e98002f30 tx=0x7f5e98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:54.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.875+0000 7f5ead59a700 1 -- 172.21.15.103:0/1003616633 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e980115d0 con 0x7f5eb00654e0 2020-04-22T14:13:54.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.875+0000 7f5eadd9b700 1 --2- 172.21.15.103:0/1003616633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5eb00654e0 0x7f5eb00664a0 secure :-1 s=THROTTLE_DONE pgs=1311 cs=0 l=1 rx=0x7f5e98002f30 tx=0x7f5e98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:54.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.875+0000 7f5ead59a700 1 -- 172.21.15.103:0/1003616633 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e980119b0 con 0x7f5eb00654e0 2020-04-22T14:13:54.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.875+0000 7f5eaf59e700 1 -- 172.21.15.103:0/1003616633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5eb00654e0 msgr2=0x7f5eb00664a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:54.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.875+0000 7f5eaf59e700 1 --2- 172.21.15.103:0/1003616633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5eb00654e0 0x7f5eb00664a0 secure :-1 s=READY pgs=1311 cs=0 l=1 rx=0x7f5e98002f30 tx=0x7f5e98007a40).stop 2020-04-22T14:13:54.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.876+0000 7f5eaf59e700 1 -- 172.21.15.103:0/1003616633 shutdown_connections 2020-04-22T14:13:54.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.876+0000 7f5eaf59e700 1 --2- 172.21.15.103:0/1003616633 >> v2:172.21.15.86:3300/0 conn(0x7f5eb0142320 0x7f5eb0063340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:54.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.876+0000 7f5eaf59e700 1 --2- 172.21.15.103:0/1003616633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5eb00654e0 0x7f5eb00664a0 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:54.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.876+0000 7f5eaf59e700 1 -- 172.21.15.103:0/1003616633 >> 172.21.15.103:0/1003616633 conn(0x7f5eb005b7c0 msgr2=0x7f5eb0061610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:54.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.876+0000 7f5eaf59e700 1 -- 172.21.15.103:0/1003616633 shutdown_connections 2020-04-22T14:13:54.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.876+0000 7f5eaf59e700 1 -- 172.21.15.103:0/1003616633 wait complete. 2020-04-22T14:13:54.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.877+0000 7f5eaf59e700 1 Processor -- start 2020-04-22T14:13:54.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.877+0000 7f5eaf59e700 1 -- start start 2020-04-22T14:13:54.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.877+0000 7f5eaf59e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5eb00654e0 0x7f5eb0131dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:54.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.877+0000 7f5eaf59e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5eb0142320 0x7f5eb012c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:54.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.877+0000 7f5eaf59e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eb01325f0 con 0x7f5eb00ad150 2020-04-22T14:13:54.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.877+0000 7f5eaf59e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eb00aedc0 con 0x7f5eb00654e0 2020-04-22T14:13:54.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.877+0000 7f5eaf59e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb00af060 con 0x7f5eb0142320 2020-04-22T14:13:54.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.877+0000 7f5eadd9b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f5eb00ad150 0x7f5eb0134d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46298/0 (socket says 172.21.15.103:46298) 2020-04-22T14:13:54.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.877+0000 7f5eadd9b700 1 -- 172.21.15.103:0/3923557365 learned_addr learned my addr 172.21.15.103:0/3923557365 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:54.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.877+0000 7f5eaed9d700 1 --2- 172.21.15.103:0/3923557365 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5eb0142320 0x7f5eb012c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:54.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.877+0000 7f5eae59c700 1 --2- 172.21.15.103:0/3923557365 >> v2:172.21.15.86:3300/0 conn(0x7f5eb00654e0 0x7f5eb0131dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:54.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.877+0000 7f5ea77fe700 1 -- 172.21.15.103:0/3923557365 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 375808455 0 0) 0x7f5eb01325f0 con 0x7f5eb00ad150 2020-04-22T14:13:54.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.877+0000 7f5ea77fe700 1 -- 172.21.15.103:0/3923557365 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e94002fe0 con 0x7f5eb00ad150 2020-04-22T14:13:54.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.878+0000 7f5ea77fe700 1 -- 172.21.15.103:0/3923557365 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1700380261 0 0) 0x7f5e94002fe0 con 0x7f5eb00ad150 2020-04-22T14:13:54.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.878+0000 7f5ea77fe700 1 -- 172.21.15.103:0/3923557365 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5eb01325f0 con 0x7f5eb00ad150 2020-04-22T14:13:54.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.878+0000 7f5ea77fe700 1 -- 172.21.15.103:0/3923557365 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f5e98008e10 con 0x7f5eb00ad150 2020-04-22T14:13:54.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.878+0000 7f5ea77fe700 1 -- 172.21.15.103:0/3923557365 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5eb0142320 msgr2=0x7f5eb012c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:54.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.878+0000 7f5ea77fe700 1 --2- 172.21.15.103:0/3923557365 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5eb0142320 0x7f5eb012c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:54.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.878+0000 7f5ea77fe700 1 -- 172.21.15.103:0/3923557365 >> v2:172.21.15.86:3300/0 conn(0x7f5eb00654e0 msgr2=0x7f5eb0131dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:54.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.878+0000 7f5ea77fe700 1 --2- 172.21.15.103:0/3923557365 >> v2:172.21.15.86:3300/0 conn(0x7f5eb00654e0 0x7f5eb0131dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:54.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.878+0000 7f5ea77fe700 1 -- 172.21.15.103:0/3923557365 >> v1:172.21.15.103:6789/0 conn(0x7f5eb00ad150 legacy=0x7f5eb0134d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:54.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.878+0000 7f5ea77fe700 1 --2- 172.21.15.103:0/3923557365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e940049b0 0x7f5e94004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:54.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.878+0000 7f5ea77fe700 1 --2- 172.21.15.103:0/3923557365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e940052a0 0x7f5e94003980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:54.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.878+0000 7f5ea77fe700 1 --2- 172.21.15.103:0/3923557365 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5eb0142320 0x7f5e94003f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:54.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.878+0000 7f5ea77fe700 1 -- 172.21.15.103:0/3923557365 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb00aedc0 con 0x7f5e940049b0 2020-04-22T14:13:54.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.878+0000 7f5ea77fe700 1 -- 172.21.15.103:0/3923557365 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb00af060 con 0x7f5e940052a0 2020-04-22T14:13:54.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.878+0000 7f5ea77fe700 1 -- 172.21.15.103:0/3923557365 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e94004470 con 0x7f5eb0142320 2020-04-22T14:13:54.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.878+0000 7f5eae59c700 1 --2- 172.21.15.103:0/3923557365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e940049b0 0x7f5e94004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:54.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.878+0000 7f5eadd9b700 1 --2- 172.21.15.103:0/3923557365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e940052a0 0x7f5e94003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:54.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.878+0000 7f5eaed9d700 1 --2- 172.21.15.103:0/3923557365 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5eb0142320 0x7f5e94003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:54.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.878+0000 7f5eadd9b700 1 -- 172.21.15.103:0/3923557365 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5eb0142320 msgr2=0x7f5e94003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:54.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.878+0000 7f5eadd9b700 1 --2- 172.21.15.103:0/3923557365 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5eb0142320 0x7f5e94003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:54.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.878+0000 7f5eadd9b700 1 -- 172.21.15.103:0/3923557365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e940049b0 msgr2=0x7f5e94004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:54.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.878+0000 7f5eadd9b700 1 --2- 172.21.15.103:0/3923557365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e940049b0 0x7f5e94004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:54.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.878+0000 7f5eadd9b700 1 -- 172.21.15.103:0/3923557365 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb00af300 con 0x7f5e940052a0 2020-04-22T14:13:54.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.878+0000 7f5eaf59e700 1 -- 172.21.15.103:0/3923557365 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eb012c1e0 con 0x7f5e940052a0 2020-04-22T14:13:54.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.878+0000 7f5eae59c700 1 --2- 172.21.15.103:0/3923557365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e940049b0 0x7f5e94004dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:13:54.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.878+0000 7f5eadd9b700 1 --2- 172.21.15.103:0/3923557365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e940052a0 0x7f5e94003980 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5e98010220 tx=0x7f5e98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:54.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.878+0000 7f5eaf59e700 1 -- 172.21.15.103:0/3923557365 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eb0065010 con 0x7f5e940052a0 2020-04-22T14:13:54.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.878+0000 7f5eadd9b700 1 --2- 172.21.15.103:0/3923557365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e940052a0 0x7f5e94003980 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5e98010220 tx=0x7f5e98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:54.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.878+0000 7f5eadd9b700 1 --2- 172.21.15.103:0/3923557365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e940052a0 0x7f5e94003980 secure :-1 s=READY pgs=1313 cs=0 l=1 rx=0x7f5e98010220 tx=0x7f5e98007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:54.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.879+0000 7f5eadd9b700 1 --2- 172.21.15.103:0/3923557365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e940052a0 0x7f5e94003980 secure :-1 s=THROTTLE_DONE pgs=1313 cs=0 l=1 rx=0x7f5e98010220 tx=0x7f5e98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:54.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.879+0000 7f5eadd9b700 1 --2- 172.21.15.103:0/3923557365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e940052a0 0x7f5e94003980 secure :-1 s=THROTTLE_DONE pgs=1313 cs=0 l=1 rx=0x7f5e98010220 tx=0x7f5e98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:54.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.879+0000 7f5eadd9b700 1 --2- 172.21.15.103:0/3923557365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e940052a0 0x7f5e94003980 secure :-1 s=THROTTLE_DONE pgs=1313 cs=0 l=1 rx=0x7f5e98010220 tx=0x7f5e98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:54.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.879+0000 7f5ea77fe700 1 -- 172.21.15.103:0/3923557365 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e98007550 con 0x7f5e940052a0 2020-04-22T14:13:54.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.879+0000 7f5ea77fe700 1 -- 172.21.15.103:0/3923557365 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9800a900 con 0x7f5e940052a0 2020-04-22T14:13:54.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.879+0000 7f5ea77fe700 1 -- 172.21.15.103:0/3923557365 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e9800aca0 con 0x7f5e940052a0 2020-04-22T14:13:54.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.879+0000 7f5eadd9b700 1 --2- 172.21.15.103:0/3923557365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e940052a0 0x7f5e94003980 secure :-1 s=THROTTLE_DONE pgs=1313 cs=0 l=1 rx=0x7f5e98010220 tx=0x7f5e98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:54.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.880+0000 7f5eaf59e700 1 -- 172.21.15.103:0/3923557365 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eb0056c90 con 0x7f5e940052a0 2020-04-22T14:13:54.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.880+0000 7f5ea77fe700 1 -- 172.21.15.103:0/3923557365 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f5e980056c0 con 0x7f5e940052a0 2020-04-22T14:13:54.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.880+0000 7f5eadd9b700 1 --2- 172.21.15.103:0/3923557365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e940052a0 0x7f5e94003980 secure :-1 s=THROTTLE_DONE pgs=1313 cs=0 l=1 rx=0x7f5e98010220 tx=0x7f5e98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:54.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.880+0000 7f5ea77fe700 1 --2- 172.21.15.103:0/3923557365 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5e94055ad0 0x7f5e94057f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:54.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.880+0000 7f5ea77fe700 1 -- 172.21.15.103:0/3923557365 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f5e980625e0 con 0x7f5e940052a0 2020-04-22T14:13:54.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.880+0000 7f5eae59c700 1 --2- 172.21.15.103:0/3923557365 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5e94055ad0 0x7f5e94057f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:54.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.881+0000 7f5eae59c700 1 --2- 172.21.15.103:0/3923557365 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5e94055ad0 0x7f5e94057f90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5ea0000b80 tx=0x7f5ea000d020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:54.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.881+0000 7f5eae59c700 1 --2- 172.21.15.103:0/3923557365 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5e94055ad0 0x7f5e94057f90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5ea0000b80 tx=0x7f5ea000d020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:54.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.881+0000 7f5eae59c700 1 --2- 172.21.15.103:0/3923557365 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5e94055ad0 0x7f5e94057f90 secure :-1 s=READY pgs=481 cs=0 l=1 rx=0x7f5ea0000b80 tx=0x7f5ea000d020).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:54.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.884+0000 7f5eadd9b700 1 --2- 172.21.15.103:0/3923557365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e940052a0 0x7f5e94003980 secure :-1 s=THROTTLE_DONE pgs=1313 cs=0 l=1 rx=0x7f5e98010220 tx=0x7f5e98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:54.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:54.884+0000 7f5ea77fe700 1 -- 172.21.15.103:0/3923557365 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f5e9803da20 con 0x7f5e940052a0 2020-04-22T14:13:55.080 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.077+0000 7f5eaf59e700 1 -- 172.21.15.103:0/3923557365 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f5eb005d360 con 0x7f5e940052a0 2020-04-22T14:13:55.081 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.078+0000 7f5eadd9b700 1 --2- 172.21.15.103:0/3923557365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e940052a0 0x7f5e94003980 secure :-1 s=THROTTLE_DONE pgs=1313 cs=0 l=1 rx=0x7f5e98010220 tx=0x7f5e98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.081 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.078+0000 7f5ea77fe700 1 -- 172.21.15.103:0/3923557365 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v32) v1 ==== 80+0+4513 (secure 0 0 0) 0x7f5e98041040 con 0x7f5e940052a0 2020-04-22T14:13:55.081 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:13:55.082 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:13:55.082 INFO:teuthology.orchestra.run.smithi103.stdout: "auth_dump": [ 2020-04-22T14:13:55.082 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:55.082 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.a", 2020-04-22T14:13:55.082 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBeliD5IBAAjC7UikdEP8FeE2rKs/ympw==", 2020-04-22T14:13:55.082 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:13:55.082 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:13:55.083 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:13:55.083 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:13:55.083 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:13:55.083 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:55.083 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:55.083 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:55.083 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.b", 2020-04-22T14:13:55.083 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBepkqQLBAA4aMKXxROQugglhm4aBd1Iw==", 2020-04-22T14:13:55.084 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:13:55.084 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:13:55.084 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:13:55.084 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:13:55.084 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:13:55.084 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:55.084 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:55.085 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:55.085 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.0", 2020-04-22T14:13:55.085 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA2TqBehMJiBxAARaWo32QGx49PxImGafnOFw==", 2020-04-22T14:13:55.085 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:13:55.085 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:13:55.085 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:13:55.085 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:13:55.085 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:55.086 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:55.086 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:55.086 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.1", 2020-04-22T14:13:55.086 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA4TqBeiAAcKRAAEHuaqbsB+NLUTSgFOCOFZg==", 2020-04-22T14:13:55.086 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:13:55.086 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:13:55.086 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:13:55.086 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:13:55.087 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:55.087 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:55.087 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:55.087 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.2", 2020-04-22T14:13:55.087 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA7TqBebeRzDxAAsjRyvJektq7MQ+334kU+UQ==", 2020-04-22T14:13:55.087 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:13:55.087 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:13:55.087 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:13:55.088 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:13:55.088 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:55.088 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:55.088 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:55.088 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.3", 2020-04-22T14:13:55.088 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA9TqBehxmSMRAATZ0o/ZnxHp2m/tqLmv6JwA==", 2020-04-22T14:13:55.088 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:13:55.089 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:13:55.089 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:13:55.089 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:13:55.089 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:55.089 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:55.089 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:55.089 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.4", 2020-04-22T14:13:55.090 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBETqBePwJSBRAAXgMKuX3EILi3gy8QzR4cig==", 2020-04-22T14:13:55.090 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:13:55.090 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:13:55.090 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:13:55.090 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:13:55.090 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:55.090 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:55.090 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:55.091 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.5", 2020-04-22T14:13:55.091 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBGTqBe5l++KRAAHIWG6bBnru2EVXv/drAL0g==", 2020-04-22T14:13:55.091 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:13:55.091 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:13:55.091 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:13:55.091 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:13:55.091 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:55.091 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:55.092 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:55.092 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.6", 2020-04-22T14:13:55.092 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBJTqBe88rTEBAAO2Z78NZLTYIbBpYovBSHVQ==", 2020-04-22T14:13:55.092 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:13:55.092 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:13:55.092 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:13:55.092 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:13:55.092 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:55.093 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:55.093 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:55.093 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.7", 2020-04-22T14:13:55.093 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBLTqBeGNFIMxAARIXhPNM6xurdnDv8+xZqUw==", 2020-04-22T14:13:55.093 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:13:55.093 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:13:55.093 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:13:55.094 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:13:55.094 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:55.094 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:55.094 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:55.094 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.0", 2020-04-22T14:13:55.094 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBe5ooUNxAA9zBtv6+i3Xl9iYtRl4xKGg==", 2020-04-22T14:13:55.094 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:13:55.094 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:13:55.095 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:13:55.095 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:13:55.095 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:55.095 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:55.095 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:55.095 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.1", 2020-04-22T14:13:55.095 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAyTqBe0bioBBAAVpoQouA/QICwqRoaFbjkiA==", 2020-04-22T14:13:55.095 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:13:55.096 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:13:55.096 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:13:55.096 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:13:55.096 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:55.096 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:55.096 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:55.096 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.2", 2020-04-22T14:13:55.096 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAyTqBemwpXCxAAObNL96zS67nMEe4MLjrEtw==", 2020-04-22T14:13:55.097 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:13:55.097 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:13:55.097 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:13:55.097 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:13:55.097 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:55.097 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:55.097 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:55.098 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.3", 2020-04-22T14:13:55.098 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAyTqBemGxNFBAAlqvB8FeZbMRwvzVjBpH/tA==", 2020-04-22T14:13:55.098 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:13:55.098 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:13:55.098 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:13:55.098 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:13:55.098 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:55.098 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:55.099 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:55.099 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.admin", 2020-04-22T14:13:55.099 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAwTqBeSx5dHxAAH0jPkaiWEwpr66ROWwbU8Q==", 2020-04-22T14:13:55.099 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:13:55.099 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2020-04-22T14:13:55.099 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:13:55.099 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:13:55.099 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:13:55.100 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:55.100 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:55.100 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:55.100 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mgr.x", 2020-04-22T14:13:55.100 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBe3YVhGhAAWAf6f9sV3bzoucBBPS3j2g==", 2020-04-22T14:13:55.100 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:13:55.100 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2020-04-22T14:13:55.101 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile mgr", 2020-04-22T14:13:55.101 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:13:55.101 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:55.101 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:55.101 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:55.101 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mgr.y", 2020-04-22T14:13:55.101 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBeX8AXExAAhh/N+/ogdKlxmkveSM60+g==", 2020-04-22T14:13:55.101 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:13:55.102 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2020-04-22T14:13:55.102 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile mgr", 2020-04-22T14:13:55.102 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:13:55.102 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:55.102 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:55.102 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:13:55.102 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:13:55.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.079+0000 7f5eaf59e700 1 -- 172.21.15.103:0/3923557365 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5e94055ad0 msgr2=0x7f5e94057f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:55.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.079+0000 7f5eaf59e700 1 --2- 172.21.15.103:0/3923557365 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5e94055ad0 0x7f5e94057f90 secure :-1 s=READY pgs=481 cs=0 l=1 rx=0x7f5ea0000b80 tx=0x7f5ea000d020).stop 2020-04-22T14:13:55.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.079+0000 7f5eaf59e700 1 -- 172.21.15.103:0/3923557365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e940052a0 msgr2=0x7f5e94003980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:55.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.079+0000 7f5eaf59e700 1 --2- 172.21.15.103:0/3923557365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e940052a0 0x7f5e94003980 secure :-1 s=READY pgs=1313 cs=0 l=1 rx=0x7f5e98010220 tx=0x7f5e98007a40).stop 2020-04-22T14:13:55.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.079+0000 7f5eaed9d700 1 -- 172.21.15.103:0/3923557365 reap_dead start 2020-04-22T14:13:55.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.079+0000 7f5eaed9d700 1 -- 172.21.15.103:0/3923557365 reap_dead start 2020-04-22T14:13:55.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.079+0000 7f5eaf59e700 1 -- 172.21.15.103:0/3923557365 shutdown_connections 2020-04-22T14:13:55.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.079+0000 7f5eaf59e700 1 -- 172.21.15.103:0/3923557365 >> 172.21.15.103:0/3923557365 conn(0x7f5eb005b7c0 msgr2=0x7f5eb0136e80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:55.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.079+0000 7f5eaf59e700 1 -- 172.21.15.103:0/3923557365 shutdown_connections 2020-04-22T14:13:55.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.079+0000 7f5eaf59e700 1 -- 172.21.15.103:0/3923557365 wait complete. 2020-04-22T14:13:55.106 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:55.119 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:13:55.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.261+0000 7fe337656700 1 Processor -- start 2020-04-22T14:13:55.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.262+0000 7fe337656700 1 -- start start 2020-04-22T14:13:55.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.262+0000 7fe337656700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe3300b6040 0x7fe3300ac740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:55.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.262+0000 7fe337656700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe3301426d0 0x7fe330142b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:55.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.262+0000 7fe337656700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe330064ec0 con 0x7fe330067170 2020-04-22T14:13:55.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.262+0000 7fe337656700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe330065af0 con 0x7fe3300b6040 2020-04-22T14:13:55.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.262+0000 7fe337656700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe330146870 con 0x7fe3301426d0 2020-04-22T14:13:55.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.262+0000 7fe334bf1700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe3300b6040 0x7fe3300ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:55.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.262+0000 7fe334bf1700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe3300b6040 0x7fe3300ac740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54124/0 (socket says 172.21.15.103:54124) 2020-04-22T14:13:55.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.262+0000 7fe334bf1700 1 -- 172.21.15.103:0/1927208481 learned_addr learned my addr 172.21.15.103:0/1927208481 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:55.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.263+0000 7fe335bf3700 1 --2- 172.21.15.103:0/1927208481 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe3301426d0 0x7fe330142b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:55.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.263+0000 7fe334bf1700 1 -- 172.21.15.103:0/1927208481 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe3301426d0 msgr2=0x7fe330142b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:55.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.263+0000 7fe334bf1700 1 --2- 172.21.15.103:0/1927208481 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe3301426d0 0x7fe330142b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:55.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.263+0000 7fe334bf1700 1 -- 172.21.15.103:0/1927208481 >> v1:172.21.15.86:6789/0 conn(0x7fe330067170 legacy=0x7fe33013c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:55.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.263+0000 7fe334bf1700 1 -- 172.21.15.103:0/1927208481 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe330067550 con 0x7fe3300b6040 2020-04-22T14:13:55.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.263+0000 7fe334bf1700 1 --2- 172.21.15.103:0/1927208481 >> v2:172.21.15.103:3300/0 conn(0x7fe3300b6040 0x7fe3300ac740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe32c002f30 tx=0x7fe32c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.263+0000 7fe334bf1700 1 --2- 172.21.15.103:0/1927208481 >> v2:172.21.15.103:3300/0 conn(0x7fe3300b6040 0x7fe3300ac740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe32c002f30 tx=0x7fe32c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.263+0000 7fe334bf1700 1 --2- 172.21.15.103:0/1927208481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3300b6040 0x7fe3300ac740 secure :-1 s=READY pgs=1314 cs=0 l=1 rx=0x7fe32c002f30 tx=0x7fe32c007a40).ready entity=mon.1 client_cookie=de58e0ff40d73ceb server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:55.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.263+0000 7fe334bf1700 1 --2- 172.21.15.103:0/1927208481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3300b6040 0x7fe3300ac740 secure :-1 s=THROTTLE_DONE pgs=1314 cs=0 l=1 rx=0x7fe32c002f30 tx=0x7fe32c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.263+0000 7fe31ffff700 1 -- 172.21.15.103:0/1927208481 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe32c011720 con 0x7fe3300b6040 2020-04-22T14:13:55.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.263+0000 7fe334bf1700 1 --2- 172.21.15.103:0/1927208481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3300b6040 0x7fe3300ac740 secure :-1 s=THROTTLE_DONE pgs=1314 cs=0 l=1 rx=0x7fe32c002f30 tx=0x7fe32c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.263+0000 7fe334bf1700 1 --2- 172.21.15.103:0/1927208481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3300b6040 0x7fe3300ac740 secure :-1 s=THROTTLE_DONE pgs=1314 cs=0 l=1 rx=0x7fe32c002f30 tx=0x7fe32c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.263+0000 7fe31ffff700 1 -- 172.21.15.103:0/1927208481 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe32c0118c0 con 0x7fe3300b6040 2020-04-22T14:13:55.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.263+0000 7fe31ffff700 1 -- 172.21.15.103:0/1927208481 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe32c011ce0 con 0x7fe3300b6040 2020-04-22T14:13:55.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.263+0000 7fe337656700 1 -- 172.21.15.103:0/1927208481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3300b6040 msgr2=0x7fe3300ac740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:55.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.263+0000 7fe337656700 1 --2- 172.21.15.103:0/1927208481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3300b6040 0x7fe3300ac740 secure :-1 s=READY pgs=1314 cs=0 l=1 rx=0x7fe32c002f30 tx=0x7fe32c007a40).stop 2020-04-22T14:13:55.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.264+0000 7fe337656700 1 -- 172.21.15.103:0/1927208481 shutdown_connections 2020-04-22T14:13:55.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.264+0000 7fe337656700 1 --2- 172.21.15.103:0/1927208481 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe3301426d0 0x7fe330142b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:55.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.264+0000 7fe337656700 1 --2- 172.21.15.103:0/1927208481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3300b6040 0x7fe3300ac740 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:55.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.264+0000 7fe337656700 1 -- 172.21.15.103:0/1927208481 >> 172.21.15.103:0/1927208481 conn(0x7fe3300b9160 msgr2=0x7fe33005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:55.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.264+0000 7fe337656700 1 -- 172.21.15.103:0/1927208481 shutdown_connections 2020-04-22T14:13:55.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.264+0000 7fe337656700 1 -- 172.21.15.103:0/1927208481 wait complete. 2020-04-22T14:13:55.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.265+0000 7fe337656700 1 Processor -- start 2020-04-22T14:13:55.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.265+0000 7fe337656700 1 -- start start 2020-04-22T14:13:55.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.265+0000 7fe337656700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe330067170 0x7fe3300b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:55.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.265+0000 7fe337656700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe3301426d0 0x7fe33014ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:55.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.265+0000 7fe337656700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe33013a8a0 con 0x7fe3300b6040 2020-04-22T14:13:55.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.265+0000 7fe337656700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3300b5060 con 0x7fe330067170 2020-04-22T14:13:55.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.265+0000 7fe337656700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe33013a600 con 0x7fe3301426d0 2020-04-22T14:13:55.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.265+0000 7fe3353f2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe330067170 0x7fe3300b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:55.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.265+0000 7fe334bf1700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe3300b6040 0x7fe33013c700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46318/0 (socket says 172.21.15.103:46318) 2020-04-22T14:13:55.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.265+0000 7fe334bf1700 1 -- 172.21.15.103:0/1432269275 learned_addr learned my addr 172.21.15.103:0/1432269275 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:55.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.265+0000 7fe335bf3700 1 --2- 172.21.15.103:0/1432269275 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe3301426d0 0x7fe33014ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:55.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.266+0000 7fe3353f2700 1 -- 172.21.15.103:0/1432269275 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe3301426d0 msgr2=0x7fe33014ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:55.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.266+0000 7fe3353f2700 1 --2- 172.21.15.103:0/1432269275 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe3301426d0 0x7fe33014ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:55.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.266+0000 7fe3353f2700 1 -- 172.21.15.103:0/1432269275 >> v1:172.21.15.103:6789/0 conn(0x7fe3300b6040 legacy=0x7fe33013c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:55.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.266+0000 7fe31e7fc700 1 -- 172.21.15.103:0/1432269275 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1506841358 0 0) 0x7fe33013a8a0 con 0x7fe3300b6040 2020-04-22T14:13:55.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.266+0000 7fe3353f2700 1 -- 172.21.15.103:0/1432269275 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe33014fac0 con 0x7fe330067170 2020-04-22T14:13:55.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.266+0000 7fe3353f2700 1 --2- 172.21.15.103:0/1432269275 >> v2:172.21.15.103:3300/0 conn(0x7fe330067170 0x7fe3300b4c00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe33005bdf0 tx=0x7fe320010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.266+0000 7fe3353f2700 1 --2- 172.21.15.103:0/1432269275 >> v2:172.21.15.103:3300/0 conn(0x7fe330067170 0x7fe3300b4c00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe33005bdf0 tx=0x7fe320010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.266+0000 7fe3353f2700 1 --2- 172.21.15.103:0/1432269275 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe330067170 0x7fe3300b4c00 secure :-1 s=READY pgs=1316 cs=0 l=1 rx=0x7fe33005bdf0 tx=0x7fe320010880).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:55.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.266+0000 7fe3353f2700 1 --2- 172.21.15.103:0/1432269275 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe330067170 0x7fe3300b4c00 secure :-1 s=THROTTLE_DONE pgs=1316 cs=0 l=1 rx=0x7fe33005bdf0 tx=0x7fe320010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.266+0000 7fe31e7fc700 1 -- 172.21.15.103:0/1432269275 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe320006bc0 con 0x7fe330067170 2020-04-22T14:13:55.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.266+0000 7fe3353f2700 1 --2- 172.21.15.103:0/1432269275 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe330067170 0x7fe3300b4c00 secure :-1 s=THROTTLE_DONE pgs=1316 cs=0 l=1 rx=0x7fe33005bdf0 tx=0x7fe320010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.266+0000 7fe3353f2700 1 --2- 172.21.15.103:0/1432269275 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe330067170 0x7fe3300b4c00 secure :-1 s=THROTTLE_DONE pgs=1316 cs=0 l=1 rx=0x7fe33005bdf0 tx=0x7fe320010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.266+0000 7fe31e7fc700 1 -- 172.21.15.103:0/1432269275 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe320006d60 con 0x7fe330067170 2020-04-22T14:13:55.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.266+0000 7fe337656700 1 -- 172.21.15.103:0/1432269275 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe33013ce10 con 0x7fe330067170 2020-04-22T14:13:55.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.266+0000 7fe31e7fc700 1 -- 172.21.15.103:0/1432269275 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3200110a0 con 0x7fe330067170 2020-04-22T14:13:55.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.266+0000 7fe337656700 1 -- 172.21.15.103:0/1432269275 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe330145a20 con 0x7fe330067170 2020-04-22T14:13:55.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.266+0000 7fe3353f2700 1 --2- 172.21.15.103:0/1432269275 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe330067170 0x7fe3300b4c00 secure :-1 s=THROTTLE_DONE pgs=1316 cs=0 l=1 rx=0x7fe33005bdf0 tx=0x7fe320010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.267+0000 7fe31e7fc700 1 -- 172.21.15.103:0/1432269275 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fe320011310 con 0x7fe330067170 2020-04-22T14:13:55.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.267+0000 7fe3353f2700 1 --2- 172.21.15.103:0/1432269275 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe330067170 0x7fe3300b4c00 secure :-1 s=THROTTLE_DONE pgs=1316 cs=0 l=1 rx=0x7fe33005bdf0 tx=0x7fe320010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.267+0000 7fe337656700 1 -- 172.21.15.103:0/1432269275 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe33014fc50 con 0x7fe330067170 2020-04-22T14:13:55.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.267+0000 7fe31e7fc700 1 --2- 172.21.15.103:0/1432269275 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe31004d800 0x7fe31004fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:55.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.268+0000 7fe31e7fc700 1 -- 172.21.15.103:0/1432269275 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fe320061320 con 0x7fe330067170 2020-04-22T14:13:55.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.268+0000 7fe334bf1700 1 --2- 172.21.15.103:0/1432269275 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe31004d800 0x7fe31004fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:55.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.268+0000 7fe334bf1700 1 --2- 172.21.15.103:0/1432269275 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe31004d800 0x7fe31004fcc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe32c008320 tx=0x7fe32c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.268+0000 7fe334bf1700 1 --2- 172.21.15.103:0/1432269275 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe31004d800 0x7fe31004fcc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe32c008320 tx=0x7fe32c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.268+0000 7fe334bf1700 1 --2- 172.21.15.103:0/1432269275 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe31004d800 0x7fe31004fcc0 secure :-1 s=READY pgs=482 cs=0 l=1 rx=0x7fe32c008320 tx=0x7fe32c007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:55.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.272+0000 7fe3353f2700 1 --2- 172.21.15.103:0/1432269275 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe330067170 0x7fe3300b4c00 secure :-1 s=THROTTLE_DONE pgs=1316 cs=0 l=1 rx=0x7fe33005bdf0 tx=0x7fe320010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.272+0000 7fe31e7fc700 1 -- 172.21.15.103:0/1432269275 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fe32003c6a0 con 0x7fe330067170 2020-04-22T14:13:55.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.414+0000 7fe337656700 1 -- 172.21.15.103:0/1432269275 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe330056c90 con 0x7fe330067170 2020-04-22T14:13:55.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.415+0000 7fe3353f2700 1 --2- 172.21.15.103:0/1432269275 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe330067170 0x7fe3300b4c00 secure :-1 s=THROTTLE_DONE pgs=1316 cs=0 l=1 rx=0x7fe33005bdf0 tx=0x7fe320010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.415+0000 7fe31e7fc700 1 -- 172.21.15.103:0/1432269275 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+13233 (secure 0 0 0) 0x7fe32003fcc0 con 0x7fe330067170 2020-04-22T14:13:55.418 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:13:55.419 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":85,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:13:54.650047+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:13:55.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.416+0000 7fe337656700 1 -- 172.21.15.103:0/1432269275 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe31004d800 msgr2=0x7fe31004fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:55.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.416+0000 7fe337656700 1 --2- 172.21.15.103:0/1432269275 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe31004d800 0x7fe31004fcc0 secure :-1 s=READY pgs=482 cs=0 l=1 rx=0x7fe32c008320 tx=0x7fe32c007a40).stop 2020-04-22T14:13:55.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.416+0000 7fe337656700 1 -- 172.21.15.103:0/1432269275 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe330067170 msgr2=0x7fe3300b4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:55.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.416+0000 7fe337656700 1 --2- 172.21.15.103:0/1432269275 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe330067170 0x7fe3300b4c00 secure :-1 s=READY pgs=1316 cs=0 l=1 rx=0x7fe33005bdf0 tx=0x7fe320010880).stop 2020-04-22T14:13:55.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.417+0000 7fe337656700 1 -- 172.21.15.103:0/1432269275 shutdown_connections 2020-04-22T14:13:55.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.417+0000 7fe337656700 1 --2- 172.21.15.103:0/1432269275 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe31004d800 0x7fe31004fcc0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:55.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.417+0000 7fe337656700 1 --2- 172.21.15.103:0/1432269275 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe3301426d0 0x7fe33014ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:55.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.417+0000 7fe337656700 1 --2- 172.21.15.103:0/1432269275 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe330067170 0x7fe3300b4c00 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:55.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.417+0000 7fe337656700 1 -- 172.21.15.103:0/1432269275 >> 172.21.15.103:0/1432269275 conn(0x7fe3300b9160 msgr2=0x7fe330137fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:55.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.417+0000 7fe337656700 1 -- 172.21.15.103:0/1432269275 shutdown_connections 2020-04-22T14:13:55.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.417+0000 7fe337656700 1 -- 172.21.15.103:0/1432269275 wait complete. 2020-04-22T14:13:55.430 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:13:55.431 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:55.446 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:13:55.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.591+0000 7f1b8c31c700 1 Processor -- start 2020-04-22T14:13:55.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.591+0000 7f1b8c31c700 1 -- start start 2020-04-22T14:13:55.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.592+0000 7f1b8c31c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1b840ac950 0x7f1b84146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:55.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.592+0000 7f1b8c31c700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b841467e0 con 0x7f1b840b9140 2020-04-22T14:13:55.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.592+0000 7f1b8c31c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b84060050 con 0x7f1b841470a0 2020-04-22T14:13:55.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.592+0000 7f1b8c31c700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b84147530 con 0x7f1b840ac950 2020-04-22T14:13:55.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.592+0000 7f1b898b7700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1b840ac950 0x7f1b84146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:55.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.592+0000 7f1b8a8b9700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f1b841470a0 0x7f1b84143090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46324/0 (socket says 172.21.15.103:46324) 2020-04-22T14:13:55.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.592+0000 7f1b8a8b9700 1 -- 172.21.15.103:0/1823683802 learned_addr learned my addr 172.21.15.103:0/1823683802 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:55.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.593+0000 7f1b898b7700 1 -- 172.21.15.103:0/1823683802 >> v1:172.21.15.103:6789/0 conn(0x7f1b841470a0 legacy=0x7f1b84143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:55.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.593+0000 7f1b898b7700 1 -- 172.21.15.103:0/1823683802 >> v1:172.21.15.86:6789/0 conn(0x7f1b840b9140 legacy=0x7f1b8412b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:55.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.593+0000 7f1b898b7700 1 -- 172.21.15.103:0/1823683802 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b840b9520 con 0x7f1b840ac950 2020-04-22T14:13:55.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.593+0000 7f1b890b6700 1 -- 172.21.15.103:0/1823683802 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4193027773 0 0) 0x7f1b84060050 con 0x7f1b841470a0 2020-04-22T14:13:55.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.593+0000 7f1b898b7700 1 --2- 172.21.15.103:0/1823683802 >> v2:172.21.15.103:3300/0 conn(0x7f1b840ac950 0x7f1b84146c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1b840b6250 tx=0x7f1b74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.593+0000 7f1b898b7700 1 --2- 172.21.15.103:0/1823683802 >> v2:172.21.15.103:3300/0 conn(0x7f1b840ac950 0x7f1b84146c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1b840b6250 tx=0x7f1b74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.593+0000 7f1b898b7700 1 --2- 172.21.15.103:0/1823683802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b840ac950 0x7f1b84146c40 secure :-1 s=READY pgs=1318 cs=0 l=1 rx=0x7f1b840b6250 tx=0x7f1b74007a40).ready entity=mon.1 client_cookie=c7c61e1720add50e server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:55.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.593+0000 7f1b898b7700 1 --2- 172.21.15.103:0/1823683802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b840ac950 0x7f1b84146c40 secure :-1 s=THROTTLE_DONE pgs=1318 cs=0 l=1 rx=0x7f1b840b6250 tx=0x7f1b74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.593+0000 7f1b890b6700 1 -- 172.21.15.103:0/1823683802 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b74011430 con 0x7f1b840ac950 2020-04-22T14:13:55.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.593+0000 7f1b898b7700 1 --2- 172.21.15.103:0/1823683802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b840ac950 0x7f1b84146c40 secure :-1 s=THROTTLE_DONE pgs=1318 cs=0 l=1 rx=0x7f1b840b6250 tx=0x7f1b74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.593+0000 7f1b890b6700 1 -- 172.21.15.103:0/1823683802 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b74011590 con 0x7f1b840ac950 2020-04-22T14:13:55.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.593+0000 7f1b898b7700 1 --2- 172.21.15.103:0/1823683802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b840ac950 0x7f1b84146c40 secure :-1 s=THROTTLE_DONE pgs=1318 cs=0 l=1 rx=0x7f1b840b6250 tx=0x7f1b74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.593+0000 7f1b890b6700 1 -- 172.21.15.103:0/1823683802 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b74011970 con 0x7f1b840ac950 2020-04-22T14:13:55.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.593+0000 7f1b8c31c700 1 -- 172.21.15.103:0/1823683802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b840ac950 msgr2=0x7f1b84146c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:55.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.593+0000 7f1b8c31c700 1 --2- 172.21.15.103:0/1823683802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b840ac950 0x7f1b84146c40 secure :-1 s=READY pgs=1318 cs=0 l=1 rx=0x7f1b840b6250 tx=0x7f1b74007a40).stop 2020-04-22T14:13:55.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.594+0000 7f1b8c31c700 1 -- 172.21.15.103:0/1823683802 shutdown_connections 2020-04-22T14:13:55.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.594+0000 7f1b8c31c700 1 --2- 172.21.15.103:0/1823683802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b840ac950 0x7f1b84146c40 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:55.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.594+0000 7f1b8c31c700 1 -- 172.21.15.103:0/1823683802 >> 172.21.15.103:0/1823683802 conn(0x7f1b8405b7b0 msgr2=0x7f1b840b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:55.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.594+0000 7f1b8c31c700 1 -- 172.21.15.103:0/1823683802 shutdown_connections 2020-04-22T14:13:55.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.594+0000 7f1b8c31c700 1 -- 172.21.15.103:0/1823683802 wait complete. 2020-04-22T14:13:55.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.595+0000 7f1b8c31c700 1 Processor -- start 2020-04-22T14:13:55.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.595+0000 7f1b8c31c700 1 -- start start 2020-04-22T14:13:55.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.595+0000 7f1b8c31c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1b841470a0 0x7f1b840b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:55.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.595+0000 7f1b8c31c700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b840b0ab0 con 0x7f1b840b9140 2020-04-22T14:13:55.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.595+0000 7f1b8c31c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b840b01a0 con 0x7f1b840ac950 2020-04-22T14:13:55.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.595+0000 7f1b8c31c700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b84066da0 con 0x7f1b841470a0 2020-04-22T14:13:55.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.595+0000 7f1b8a0b8700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f1b840ac950 0x7f1b84127a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46328/0 (socket says 172.21.15.103:46328) 2020-04-22T14:13:55.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.595+0000 7f1b8a0b8700 1 -- 172.21.15.103:0/2654332665 learned_addr learned my addr 172.21.15.103:0/2654332665 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:55.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.595+0000 7f1b8a8b9700 1 --2- 172.21.15.103:0/2654332665 >> v2:172.21.15.103:3300/0 conn(0x7f1b841470a0 0x7f1b840b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:55.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.595+0000 7f1b737fe700 1 -- 172.21.15.103:0/2654332665 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1893560844 0 0) 0x7f1b840b01a0 con 0x7f1b840ac950 2020-04-22T14:13:55.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.596+0000 7f1b737fe700 1 -- 172.21.15.103:0/2654332665 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b64002fe0 con 0x7f1b840ac950 2020-04-22T14:13:55.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.596+0000 7f1b8a8b9700 1 -- 172.21.15.103:0/2654332665 >> v1:172.21.15.103:6789/0 conn(0x7f1b840ac950 legacy=0x7f1b84127a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:55.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.596+0000 7f1b8a8b9700 1 -- 172.21.15.103:0/2654332665 >> v1:172.21.15.86:6789/0 conn(0x7f1b840b9140 legacy=0x7f1b840b5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:55.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.596+0000 7f1b8a8b9700 1 -- 172.21.15.103:0/2654332665 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b84062a70 con 0x7f1b841470a0 2020-04-22T14:13:55.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.596+0000 7f1b8a8b9700 1 --2- 172.21.15.103:0/2654332665 >> v2:172.21.15.103:3300/0 conn(0x7f1b841470a0 0x7f1b840b27e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1b840b1dc0 tx=0x7f1b7c010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.596+0000 7f1b8a8b9700 1 --2- 172.21.15.103:0/2654332665 >> v2:172.21.15.103:3300/0 conn(0x7f1b841470a0 0x7f1b840b27e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1b840b1dc0 tx=0x7f1b7c010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.596+0000 7f1b8a8b9700 1 --2- 172.21.15.103:0/2654332665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b841470a0 0x7f1b840b27e0 secure :-1 s=READY pgs=1320 cs=0 l=1 rx=0x7f1b840b1dc0 tx=0x7f1b7c010bc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:55.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.596+0000 7f1b8a8b9700 1 --2- 172.21.15.103:0/2654332665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b841470a0 0x7f1b840b27e0 secure :-1 s=THROTTLE_DONE pgs=1320 cs=0 l=1 rx=0x7f1b840b1dc0 tx=0x7f1b7c010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.596+0000 7f1b737fe700 1 -- 172.21.15.103:0/2654332665 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b7c005e30 con 0x7f1b841470a0 2020-04-22T14:13:55.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.596+0000 7f1b8a8b9700 1 --2- 172.21.15.103:0/2654332665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b841470a0 0x7f1b840b27e0 secure :-1 s=THROTTLE_DONE pgs=1320 cs=0 l=1 rx=0x7f1b840b1dc0 tx=0x7f1b7c010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.596+0000 7f1b8a8b9700 1 --2- 172.21.15.103:0/2654332665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b841470a0 0x7f1b840b27e0 secure :-1 s=THROTTLE_DONE pgs=1320 cs=0 l=1 rx=0x7f1b840b1dc0 tx=0x7f1b7c010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.596+0000 7f1b737fe700 1 -- 172.21.15.103:0/2654332665 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7c012410 con 0x7f1b841470a0 2020-04-22T14:13:55.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.596+0000 7f1b8c31c700 1 -- 172.21.15.103:0/2654332665 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b84128130 con 0x7f1b841470a0 2020-04-22T14:13:55.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.596+0000 7f1b737fe700 1 -- 172.21.15.103:0/2654332665 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b7c0127f0 con 0x7f1b841470a0 2020-04-22T14:13:55.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.596+0000 7f1b8c31c700 1 -- 172.21.15.103:0/2654332665 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b84150b80 con 0x7f1b841470a0 2020-04-22T14:13:55.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.596+0000 7f1b8a8b9700 1 --2- 172.21.15.103:0/2654332665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b841470a0 0x7f1b840b27e0 secure :-1 s=THROTTLE_DONE pgs=1320 cs=0 l=1 rx=0x7f1b840b1dc0 tx=0x7f1b7c010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.597+0000 7f1b737fe700 1 -- 172.21.15.103:0/2654332665 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f1b7c012a60 con 0x7f1b841470a0 2020-04-22T14:13:55.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.597+0000 7f1b8a8b9700 1 --2- 172.21.15.103:0/2654332665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b841470a0 0x7f1b840b27e0 secure :-1 s=THROTTLE_DONE pgs=1320 cs=0 l=1 rx=0x7f1b840b1dc0 tx=0x7f1b7c010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.597+0000 7f1b8c31c700 1 -- 172.21.15.103:0/2654332665 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b840b4d20 con 0x7f1b841470a0 2020-04-22T14:13:55.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.597+0000 7f1b737fe700 1 --2- 172.21.15.103:0/2654332665 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1b6404dcc0 0x7f1b64050180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:55.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.597+0000 7f1b737fe700 1 -- 172.21.15.103:0/2654332665 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f1b7c0090c0 con 0x7f1b841470a0 2020-04-22T14:13:55.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.597+0000 7f1b8a0b8700 1 --2- 172.21.15.103:0/2654332665 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1b6404dcc0 0x7f1b64050180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:55.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.598+0000 7f1b8a0b8700 1 --2- 172.21.15.103:0/2654332665 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1b6404dcc0 0x7f1b64050180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1b800020d0 tx=0x7f1b800027a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.598+0000 7f1b8a0b8700 1 --2- 172.21.15.103:0/2654332665 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1b6404dcc0 0x7f1b64050180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1b800020d0 tx=0x7f1b800027a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.598+0000 7f1b8a0b8700 1 --2- 172.21.15.103:0/2654332665 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1b6404dcc0 0x7f1b64050180 secure :-1 s=READY pgs=483 cs=0 l=1 rx=0x7f1b800020d0 tx=0x7f1b800027a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:55.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.601+0000 7f1b8a8b9700 1 --2- 172.21.15.103:0/2654332665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b841470a0 0x7f1b840b27e0 secure :-1 s=THROTTLE_DONE pgs=1320 cs=0 l=1 rx=0x7f1b840b1dc0 tx=0x7f1b7c010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.601+0000 7f1b737fe700 1 -- 172.21.15.103:0/2654332665 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f1b7c03cda0 con 0x7f1b841470a0 2020-04-22T14:13:55.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.743+0000 7f1b8c31c700 1 -- 172.21.15.103:0/2654332665 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f1b84056c90 con 0x7f1b841470a0 2020-04-22T14:13:55.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.743+0000 7f1b8a8b9700 1 --2- 172.21.15.103:0/2654332665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b841470a0 0x7f1b840b27e0 secure :-1 s=THROTTLE_DONE pgs=1320 cs=0 l=1 rx=0x7f1b840b1dc0 tx=0x7f1b7c010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.743+0000 7f1b737fe700 1 -- 172.21.15.103:0/2654332665 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v85) v1 ==== 110+0+10 (secure 0 0 0) 0x7f1b7c0403c0 con 0x7f1b841470a0 2020-04-22T14:13:55.747 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:13:55.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.745+0000 7f1b8c31c700 1 -- 172.21.15.103:0/2654332665 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1b6404dcc0 msgr2=0x7f1b64050180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:55.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.745+0000 7f1b8c31c700 1 --2- 172.21.15.103:0/2654332665 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1b6404dcc0 0x7f1b64050180 secure :-1 s=READY pgs=483 cs=0 l=1 rx=0x7f1b800020d0 tx=0x7f1b800027a0).stop 2020-04-22T14:13:55.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.745+0000 7f1b8c31c700 1 -- 172.21.15.103:0/2654332665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b841470a0 msgr2=0x7f1b840b27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:55.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.745+0000 7f1b8c31c700 1 --2- 172.21.15.103:0/2654332665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b841470a0 0x7f1b840b27e0 secure :-1 s=READY pgs=1320 cs=0 l=1 rx=0x7f1b840b1dc0 tx=0x7f1b7c010bc0).stop 2020-04-22T14:13:55.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.745+0000 7f1b8c31c700 1 -- 172.21.15.103:0/2654332665 shutdown_connections 2020-04-22T14:13:55.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.745+0000 7f1b8c31c700 1 --2- 172.21.15.103:0/2654332665 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1b6404dcc0 0x7f1b64050180 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:55.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.745+0000 7f1b8c31c700 1 --2- 172.21.15.103:0/2654332665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b841470a0 0x7f1b840b27e0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:55.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.745+0000 7f1b8c31c700 1 -- 172.21.15.103:0/2654332665 >> 172.21.15.103:0/2654332665 conn(0x7f1b8405b7b0 msgr2=0x7f1b840b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:55.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.745+0000 7f1b8c31c700 1 -- 172.21.15.103:0/2654332665 shutdown_connections 2020-04-22T14:13:55.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.745+0000 7f1b8c31c700 1 -- 172.21.15.103:0/2654332665 wait complete. 2020-04-22T14:13:55.758 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:55.771 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:13:55.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.917+0000 7efd0c287700 1 Processor -- start 2020-04-22T14:13:55.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.917+0000 7efd0c287700 1 -- start start 2020-04-22T14:13:55.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.918+0000 7efd0c287700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd04143bc0 0x7efd04146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:55.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.918+0000 7efd0c287700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd0405fbc0 con 0x7efd040b5ea0 2020-04-22T14:13:55.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.918+0000 7efd0c287700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd0405fe60 con 0x7efd040b9890 2020-04-22T14:13:55.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.918+0000 7efd0c287700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd04060100 con 0x7efd04143bc0 2020-04-22T14:13:55.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.918+0000 7efd0a023700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7efd040b9890 0x7efd041434b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46336/0 (socket says 172.21.15.103:46336) 2020-04-22T14:13:55.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.918+0000 7efd0a023700 1 -- 172.21.15.103:0/2976289118 learned_addr learned my addr 172.21.15.103:0/2976289118 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:55.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.918+0000 7efd09822700 1 --2- 172.21.15.103:0/2976289118 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd04143bc0 0x7efd04146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:55.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.918+0000 7efd09021700 1 -- 172.21.15.103:0/2976289118 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1911265615 0 0) 0x7efd0405fe60 con 0x7efd040b9890 2020-04-22T14:13:55.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.918+0000 7efd09021700 1 -- 172.21.15.103:0/2976289118 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcec003230 con 0x7efd040b9890 2020-04-22T14:13:55.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.919+0000 7efd09021700 1 -- 172.21.15.103:0/2976289118 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1305927254 0 0) 0x7efcec003230 con 0x7efd040b9890 2020-04-22T14:13:55.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.919+0000 7efd09021700 1 -- 172.21.15.103:0/2976289118 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd04143bc0 msgr2=0x7efd04146fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:55.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.919+0000 7efd09021700 1 --2- 172.21.15.103:0/2976289118 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd04143bc0 0x7efd04146fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:55.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.919+0000 7efd09021700 1 -- 172.21.15.103:0/2976289118 >> v1:172.21.15.86:6789/0 conn(0x7efd040b5ea0 legacy=0x7efd040b6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:55.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.919+0000 7efd09021700 1 -- 172.21.15.103:0/2976289118 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd040b9c70 con 0x7efd040b9890 2020-04-22T14:13:55.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.919+0000 7efd09021700 1 -- 172.21.15.103:0/2976289118 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7efcf80016d0 con 0x7efd040b9890 2020-04-22T14:13:55.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.919+0000 7efd09021700 1 -- 172.21.15.103:0/2976289118 >> v1:172.21.15.103:6789/0 conn(0x7efd040b9890 legacy=0x7efd041434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:55.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.919+0000 7efd09021700 1 --2- 172.21.15.103:0/2976289118 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcec003720 0x7efcec003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:55.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.919+0000 7efd09021700 1 --2- 172.21.15.103:0/2976289118 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd04143bc0 0x7efcec0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:55.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.919+0000 7efd09021700 1 --2- 172.21.15.103:0/2976289118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efcec004930 0x7efcec004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:55.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.919+0000 7efd09021700 1 -- 172.21.15.103:0/2976289118 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd04060100 con 0x7efcec004930 2020-04-22T14:13:55.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.919+0000 7efd09021700 1 -- 172.21.15.103:0/2976289118 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcec005300 con 0x7efcec003720 2020-04-22T14:13:55.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.919+0000 7efd09021700 1 -- 172.21.15.103:0/2976289118 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcec0040f0 con 0x7efd04143bc0 2020-04-22T14:13:55.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.919+0000 7efd0a023700 1 --2- 172.21.15.103:0/2976289118 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcec003720 0x7efcec003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:55.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.919+0000 7efd09822700 1 --2- 172.21.15.103:0/2976289118 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd04143bc0 0x7efcec0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:55.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.919+0000 7efd0a824700 1 --2- 172.21.15.103:0/2976289118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efcec004930 0x7efcec004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:55.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.919+0000 7efd0a023700 1 -- 172.21.15.103:0/2976289118 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd04143bc0 msgr2=0x7efcec0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:55.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.919+0000 7efd0a023700 1 --2- 172.21.15.103:0/2976289118 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd04143bc0 0x7efcec0044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:55.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.919+0000 7efd0a023700 1 -- 172.21.15.103:0/2976289118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efcec004930 msgr2=0x7efcec004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:55.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.919+0000 7efd0a023700 1 --2- 172.21.15.103:0/2976289118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efcec004930 0x7efcec004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:55.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.919+0000 7efd0a023700 1 -- 172.21.15.103:0/2976289118 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcec003230 con 0x7efcec003720 2020-04-22T14:13:55.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.919+0000 7efd0a824700 1 --2- 172.21.15.103:0/2976289118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efcec004930 0x7efcec004db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:13:55.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.919+0000 7efd0a023700 1 --2- 172.21.15.103:0/2976289118 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcec003720 0x7efcec003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efcf80013e0 tx=0x7efd040b9e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.919+0000 7efd0a023700 1 --2- 172.21.15.103:0/2976289118 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcec003720 0x7efcec003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efcf80013e0 tx=0x7efd040b9e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.919+0000 7efd0a023700 1 --2- 172.21.15.103:0/2976289118 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcec003720 0x7efcec003b40 secure :-1 s=READY pgs=1322 cs=0 l=1 rx=0x7efcf80013e0 tx=0x7efd040b9e00).ready entity=mon.1 client_cookie=95997ec3ca3f55a7 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:55.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.919+0000 7efd0a023700 1 --2- 172.21.15.103:0/2976289118 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcec003720 0x7efcec003b40 secure :-1 s=THROTTLE_DONE pgs=1322 cs=0 l=1 rx=0x7efcf80013e0 tx=0x7efd040b9e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.919+0000 7efd09021700 1 -- 172.21.15.103:0/2976289118 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efcf800e180 con 0x7efcec003720 2020-04-22T14:13:55.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.919+0000 7efd0a023700 1 --2- 172.21.15.103:0/2976289118 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcec003720 0x7efcec003b40 secure :-1 s=THROTTLE_DONE pgs=1322 cs=0 l=1 rx=0x7efcf80013e0 tx=0x7efd040b9e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.919+0000 7efd09021700 1 -- 172.21.15.103:0/2976289118 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf800e320 con 0x7efcec003720 2020-04-22T14:13:55.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.919+0000 7efd0a023700 1 --2- 172.21.15.103:0/2976289118 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcec003720 0x7efcec003b40 secure :-1 s=THROTTLE_DONE pgs=1322 cs=0 l=1 rx=0x7efcf80013e0 tx=0x7efd040b9e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.919+0000 7efd09021700 1 -- 172.21.15.103:0/2976289118 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efcf800e6c0 con 0x7efcec003720 2020-04-22T14:13:55.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.919+0000 7efd0c287700 1 -- 172.21.15.103:0/2976289118 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcec003720 msgr2=0x7efcec003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:55.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.919+0000 7efd0c287700 1 --2- 172.21.15.103:0/2976289118 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcec003720 0x7efcec003b40 secure :-1 s=READY pgs=1322 cs=0 l=1 rx=0x7efcf80013e0 tx=0x7efd040b9e00).stop 2020-04-22T14:13:55.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.919+0000 7efd0a824700 1 -- 172.21.15.103:0/2976289118 reap_dead start 2020-04-22T14:13:55.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.920+0000 7efd0c287700 1 -- 172.21.15.103:0/2976289118 shutdown_connections 2020-04-22T14:13:55.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.920+0000 7efd0c287700 1 -- 172.21.15.103:0/2976289118 >> 172.21.15.103:0/2976289118 conn(0x7efd0405ad30 msgr2=0x7efd0405b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:55.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.920+0000 7efd0c287700 1 -- 172.21.15.103:0/2976289118 shutdown_connections 2020-04-22T14:13:55.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.920+0000 7efd0c287700 1 -- 172.21.15.103:0/2976289118 wait complete. 2020-04-22T14:13:55.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.921+0000 7efd0c287700 1 Processor -- start 2020-04-22T14:13:55.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.921+0000 7efd0c287700 1 -- start start 2020-04-22T14:13:55.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.922+0000 7efd0c287700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd041491b0 0x7efd040b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:55.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.922+0000 7efd0c287700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd040ace50 con 0x7efd04147ad0 2020-04-22T14:13:55.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.922+0000 7efd0c287700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd040b2170 con 0x7efd041433a0 2020-04-22T14:13:55.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.922+0000 7efd0c287700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd040b1f90 con 0x7efd041491b0 2020-04-22T14:13:55.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.922+0000 7efd09822700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7efd041433a0 0x7efd0412f2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46348/0 (socket says 172.21.15.103:46348) 2020-04-22T14:13:55.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.922+0000 7efd09822700 1 -- 172.21.15.103:0/2300443020 learned_addr learned my addr 172.21.15.103:0/2300443020 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:55.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.922+0000 7efd0a824700 1 --2- 172.21.15.103:0/2300443020 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd041491b0 0x7efd040b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:55.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.922+0000 7efcf77fe700 1 -- 172.21.15.103:0/2300443020 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2684394456 0 0) 0x7efd040b2170 con 0x7efd041433a0 2020-04-22T14:13:55.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.922+0000 7efcf77fe700 1 -- 172.21.15.103:0/2300443020 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efce4002fe0 con 0x7efd041433a0 2020-04-22T14:13:55.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.922+0000 7efcf77fe700 1 -- 172.21.15.103:0/2300443020 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1330804732 0 0) 0x7efd040ace50 con 0x7efd04147ad0 2020-04-22T14:13:55.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.922+0000 7efcf77fe700 1 -- 172.21.15.103:0/2300443020 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd040b2170 con 0x7efd04147ad0 2020-04-22T14:13:55.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.922+0000 7efd0a824700 1 -- 172.21.15.103:0/2300443020 >> v1:172.21.15.103:6789/0 conn(0x7efd041433a0 legacy=0x7efd0412f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:55.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.922+0000 7efd0a824700 1 -- 172.21.15.103:0/2300443020 >> v1:172.21.15.86:6789/0 conn(0x7efd04147ad0 legacy=0x7efd040ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:55.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.922+0000 7efd0a824700 1 -- 172.21.15.103:0/2300443020 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd040b2410 con 0x7efd041491b0 2020-04-22T14:13:55.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.922+0000 7efd0a824700 1 --2- 172.21.15.103:0/2300443020 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd041491b0 0x7efd040b28b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efcf80010d0 tx=0x7efcfc010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.922+0000 7efd0a824700 1 --2- 172.21.15.103:0/2300443020 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd041491b0 0x7efd040b28b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efcf80010d0 tx=0x7efcfc010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.922+0000 7efd0a824700 1 --2- 172.21.15.103:0/2300443020 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd041491b0 0x7efd040b28b0 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7efcf80010d0 tx=0x7efcfc010a20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:55.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.922+0000 7efd0a824700 1 --2- 172.21.15.103:0/2300443020 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd041491b0 0x7efd040b28b0 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7efcf80010d0 tx=0x7efcfc010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.922+0000 7efcf77fe700 1 -- 172.21.15.103:0/2300443020 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efcfc002220 con 0x7efd041491b0 2020-04-22T14:13:55.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.922+0000 7efd0a824700 1 --2- 172.21.15.103:0/2300443020 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd041491b0 0x7efd040b28b0 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7efcf80010d0 tx=0x7efcfc010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.922+0000 7efd0c287700 1 -- 172.21.15.103:0/2300443020 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd04147eb0 con 0x7efd041491b0 2020-04-22T14:13:55.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.922+0000 7efcf77fe700 1 -- 172.21.15.103:0/2300443020 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcfc002380 con 0x7efd041491b0 2020-04-22T14:13:55.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.922+0000 7efd0a824700 1 --2- 172.21.15.103:0/2300443020 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd041491b0 0x7efd040b28b0 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7efcf80010d0 tx=0x7efcfc010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.922+0000 7efcf77fe700 1 -- 172.21.15.103:0/2300443020 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efcfc0026e0 con 0x7efd041491b0 2020-04-22T14:13:55.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.922+0000 7efd0c287700 1 -- 172.21.15.103:0/2300443020 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd040b2d10 con 0x7efd041491b0 2020-04-22T14:13:55.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.923+0000 7efd0a824700 1 --2- 172.21.15.103:0/2300443020 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd041491b0 0x7efd040b28b0 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7efcf80010d0 tx=0x7efcfc010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.923+0000 7efd0c287700 1 -- 172.21.15.103:0/2300443020 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd040b25a0 con 0x7efd041491b0 2020-04-22T14:13:55.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.924+0000 7efcf77fe700 1 -- 172.21.15.103:0/2300443020 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7efcfc002840 con 0x7efd041491b0 2020-04-22T14:13:55.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.924+0000 7efd0a824700 1 --2- 172.21.15.103:0/2300443020 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd041491b0 0x7efd040b28b0 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7efcf80010d0 tx=0x7efcfc010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.924+0000 7efcf77fe700 1 --2- 172.21.15.103:0/2300443020 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efce404de00 0x7efce40502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:55.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.924+0000 7efcf77fe700 1 -- 172.21.15.103:0/2300443020 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5253+0+0 (secure 0 0 0) 0x7efcfc061190 con 0x7efd041491b0 2020-04-22T14:13:55.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.924+0000 7efd0a023700 1 --2- 172.21.15.103:0/2300443020 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efce404de00 0x7efce40502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:55.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.924+0000 7efd0a023700 1 --2- 172.21.15.103:0/2300443020 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efce404de00 0x7efce40502c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efcf800bb60 tx=0x7efd040b9e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.924+0000 7efd0a023700 1 --2- 172.21.15.103:0/2300443020 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efce404de00 0x7efce40502c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efcf800bb60 tx=0x7efd040b9e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.924+0000 7efd0a023700 1 --2- 172.21.15.103:0/2300443020 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efce404de00 0x7efce40502c0 secure :-1 s=READY pgs=484 cs=0 l=1 rx=0x7efcf800bb60 tx=0x7efd040b9e00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:55.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.927+0000 7efd0a824700 1 --2- 172.21.15.103:0/2300443020 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd041491b0 0x7efd040b28b0 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7efcf80010d0 tx=0x7efcfc010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:55.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:55.928+0000 7efcf77fe700 1 -- 172.21.15.103:0/2300443020 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7efcfc03c510 con 0x7efd041491b0 2020-04-22T14:13:56.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.068+0000 7efd0c287700 1 -- 172.21.15.103:0/2300443020 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7efd04056c90 con 0x7efd041491b0 2020-04-22T14:13:56.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.069+0000 7efd0a824700 1 --2- 172.21.15.103:0/2300443020 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd041491b0 0x7efd040b28b0 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7efcf80010d0 tx=0x7efcfc010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:56.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.069+0000 7efcf77fe700 1 -- 172.21.15.103:0/2300443020 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v85) v1 ==== 92+0+10 (secure 0 0 0) 0x7efcfc03fb30 con 0x7efd041491b0 2020-04-22T14:13:56.072 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:13:56.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.070+0000 7efd0c287700 1 -- 172.21.15.103:0/2300443020 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efce404de00 msgr2=0x7efce40502c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:56.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.070+0000 7efd0c287700 1 --2- 172.21.15.103:0/2300443020 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efce404de00 0x7efce40502c0 secure :-1 s=READY pgs=484 cs=0 l=1 rx=0x7efcf800bb60 tx=0x7efd040b9e00).stop 2020-04-22T14:13:56.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.070+0000 7efd0c287700 1 -- 172.21.15.103:0/2300443020 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd041491b0 msgr2=0x7efd040b28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:56.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.070+0000 7efd0c287700 1 --2- 172.21.15.103:0/2300443020 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd041491b0 0x7efd040b28b0 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7efcf80010d0 tx=0x7efcfc010a20).stop 2020-04-22T14:13:56.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.070+0000 7efd0c287700 1 -- 172.21.15.103:0/2300443020 shutdown_connections 2020-04-22T14:13:56.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.070+0000 7efd0c287700 1 --2- 172.21.15.103:0/2300443020 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efce404de00 0x7efce40502c0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:56.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.070+0000 7efd0c287700 1 --2- 172.21.15.103:0/2300443020 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd041491b0 0x7efd040b28b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:56.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.070+0000 7efd0c287700 1 -- 172.21.15.103:0/2300443020 >> 172.21.15.103:0/2300443020 conn(0x7efd0405ad30 msgr2=0x7efd040b7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:56.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.070+0000 7efd0c287700 1 -- 172.21.15.103:0/2300443020 shutdown_connections 2020-04-22T14:13:56.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.070+0000 7efd0c287700 1 -- 172.21.15.103:0/2300443020 wait complete. 2020-04-22T14:13:56.083 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:56.100 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-04-22T14:13:56.246 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.243+0000 7f14926d3700 1 Processor -- start 2020-04-22T14:13:56.247 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.243+0000 7f14926d3700 1 -- start start 2020-04-22T14:13:56.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.244+0000 7f14926d3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f148c0b2940 0x7f148c0b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:56.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.244+0000 7f14926d3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f148c05f3e0 0x7f148c143880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:56.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.244+0000 7f14926d3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f148c143ce0 0x7f148c0b5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:56.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.244+0000 7f14926d3700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f148c062950 con 0x7f148c0b2940 2020-04-22T14:13:56.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.244+0000 7f14926d3700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f148c062bf0 con 0x7f148c05f3e0 2020-04-22T14:13:56.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.244+0000 7f14926d3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148c144430 con 0x7f148c143ce0 2020-04-22T14:13:56.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.244+0000 7f148b7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f148c05f3e0 0x7f148c143880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:56.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.244+0000 7f148b7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f148c05f3e0 0x7f148c143880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54166/0 (socket says 172.21.15.103:54166) 2020-04-22T14:13:56.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.244+0000 7f148b7fe700 1 -- 172.21.15.103:0/1329707841 learned_addr learned my addr 172.21.15.103:0/1329707841 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:56.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.244+0000 7f148bfff700 1 --2- 172.21.15.103:0/1329707841 >> v2:172.21.15.86:3300/0 conn(0x7f148c0b2940 0x7f148c0b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:56.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.244+0000 7f1490c70700 1 --2- 172.21.15.103:0/1329707841 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f148c143ce0 0x7f148c0b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:56.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.244+0000 7f148b7fe700 1 -- 172.21.15.103:0/1329707841 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f148c143ce0 msgr2=0x7f148c0b5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:56.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.244+0000 7f148b7fe700 1 --2- 172.21.15.103:0/1329707841 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f148c143ce0 0x7f148c0b5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:56.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.244+0000 7f148b7fe700 1 -- 172.21.15.103:0/1329707841 >> v2:172.21.15.86:3300/0 conn(0x7f148c0b2940 msgr2=0x7f148c0b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:56.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.244+0000 7f148b7fe700 1 --2- 172.21.15.103:0/1329707841 >> v2:172.21.15.86:3300/0 conn(0x7f148c0b2940 0x7f148c0b40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:56.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.244+0000 7f148b7fe700 1 -- 172.21.15.103:0/1329707841 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148c0b2d20 con 0x7f148c05f3e0 2020-04-22T14:13:56.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.244+0000 7f148b7fe700 1 --2- 172.21.15.103:0/1329707841 >> v2:172.21.15.103:3300/0 conn(0x7f148c05f3e0 0x7f148c143880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1480002f30 tx=0x7f1480007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:56.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.244+0000 7f148b7fe700 1 --2- 172.21.15.103:0/1329707841 >> v2:172.21.15.103:3300/0 conn(0x7f148c05f3e0 0x7f148c143880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1480002f30 tx=0x7f1480007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:56.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.244+0000 7f148b7fe700 1 --2- 172.21.15.103:0/1329707841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f148c05f3e0 0x7f148c143880 secure :-1 s=READY pgs=1324 cs=0 l=1 rx=0x7f1480002f30 tx=0x7f1480007a40).ready entity=mon.1 client_cookie=62ef14d1f0c4e6c8 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:56.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.245+0000 7f148b7fe700 1 --2- 172.21.15.103:0/1329707841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f148c05f3e0 0x7f148c143880 secure :-1 s=THROTTLE_DONE pgs=1324 cs=0 l=1 rx=0x7f1480002f30 tx=0x7f1480007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:56.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.245+0000 7f148affd700 1 -- 172.21.15.103:0/1329707841 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1480011720 con 0x7f148c05f3e0 2020-04-22T14:13:56.263 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.245+0000 7f148b7fe700 1 --2- 172.21.15.103:0/1329707841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f148c05f3e0 0x7f148c143880 secure :-1 s=THROTTLE_DONE pgs=1324 cs=0 l=1 rx=0x7f1480002f30 tx=0x7f1480007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:56.263 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.245+0000 7f148b7fe700 1 --2- 172.21.15.103:0/1329707841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f148c05f3e0 0x7f148c143880 secure :-1 s=THROTTLE_DONE pgs=1324 cs=0 l=1 rx=0x7f1480002f30 tx=0x7f1480007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:56.263 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.245+0000 7f148affd700 1 -- 172.21.15.103:0/1329707841 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1480011880 con 0x7f148c05f3e0 2020-04-22T14:13:56.263 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.245+0000 7f148affd700 1 -- 172.21.15.103:0/1329707841 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1480011ca0 con 0x7f148c05f3e0 2020-04-22T14:13:56.263 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.245+0000 7f14926d3700 1 -- 172.21.15.103:0/1329707841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f148c05f3e0 msgr2=0x7f148c143880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:56.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.245+0000 7f14926d3700 1 --2- 172.21.15.103:0/1329707841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f148c05f3e0 0x7f148c143880 secure :-1 s=READY pgs=1324 cs=0 l=1 rx=0x7f1480002f30 tx=0x7f1480007a40).stop 2020-04-22T14:13:56.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.245+0000 7f14926d3700 1 -- 172.21.15.103:0/1329707841 shutdown_connections 2020-04-22T14:13:56.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.245+0000 7f14926d3700 1 --2- 172.21.15.103:0/1329707841 >> v2:172.21.15.86:3300/0 conn(0x7f148c0b2940 0x7f148c0b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:56.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.245+0000 7f14926d3700 1 --2- 172.21.15.103:0/1329707841 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f148c143ce0 0x7f148c0b5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:56.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.245+0000 7f14926d3700 1 --2- 172.21.15.103:0/1329707841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f148c05f3e0 0x7f148c143880 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:56.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.245+0000 7f14926d3700 1 -- 172.21.15.103:0/1329707841 >> 172.21.15.103:0/1329707841 conn(0x7f148c05ad30 msgr2=0x7f148c05b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:56.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.245+0000 7f14926d3700 1 -- 172.21.15.103:0/1329707841 shutdown_connections 2020-04-22T14:13:56.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.245+0000 7f14926d3700 1 -- 172.21.15.103:0/1329707841 wait complete. 2020-04-22T14:13:56.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.246+0000 7f14926d3700 1 Processor -- start 2020-04-22T14:13:56.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.246+0000 7f14926d3700 1 -- start start 2020-04-22T14:13:56.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.247+0000 7f14926d3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f148c05f3e0 0x7f148c0b9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:56.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.247+0000 7f14926d3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f148c143ce0 0x7f148c063720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:56.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.247+0000 7f14926d3700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f148c154bf0 con 0x7f148c0b2940 2020-04-22T14:13:56.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.247+0000 7f14926d3700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f148c063b80 con 0x7f148c143ce0 2020-04-22T14:13:56.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.247+0000 7f14926d3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148c151d00 con 0x7f148c05f3e0 2020-04-22T14:13:56.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.247+0000 7f148b7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f148c0b2940 0x7f148c1515f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46360/0 (socket says 172.21.15.103:46360) 2020-04-22T14:13:56.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.247+0000 7f148b7fe700 1 -- 172.21.15.103:0/1865007295 learned_addr learned my addr 172.21.15.103:0/1865007295 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:56.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.247+0000 7f1490c70700 1 --2- 172.21.15.103:0/1865007295 >> v2:172.21.15.86:3300/0 conn(0x7f148c143ce0 0x7f148c063720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:56.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.247+0000 7f14897fa700 1 -- 172.21.15.103:0/1865007295 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2998140687 0 0) 0x7f148c154bf0 con 0x7f148c0b2940 2020-04-22T14:13:56.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.247+0000 7f148bfff700 1 --2- 172.21.15.103:0/1865007295 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f148c05f3e0 0x7f148c0b9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:56.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.247+0000 7f14897fa700 1 -- 172.21.15.103:0/1865007295 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f146c002fe0 con 0x7f148c0b2940 2020-04-22T14:13:56.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.247+0000 7f14897fa700 1 -- 172.21.15.103:0/1865007295 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1857254876 0 0) 0x7f146c002fe0 con 0x7f148c0b2940 2020-04-22T14:13:56.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.247+0000 7f14897fa700 1 -- 172.21.15.103:0/1865007295 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f148c154bf0 con 0x7f148c0b2940 2020-04-22T14:13:56.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.247+0000 7f14897fa700 1 -- 172.21.15.103:0/1865007295 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f14800077f0 con 0x7f148c0b2940 2020-04-22T14:13:56.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.248+0000 7f14897fa700 1 -- 172.21.15.103:0/1865007295 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f148c05f3e0 msgr2=0x7f148c0b9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:56.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.248+0000 7f14897fa700 1 --2- 172.21.15.103:0/1865007295 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f148c05f3e0 0x7f148c0b9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:56.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.248+0000 7f14897fa700 1 -- 172.21.15.103:0/1865007295 >> v2:172.21.15.86:3300/0 conn(0x7f148c143ce0 msgr2=0x7f148c063720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:56.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.248+0000 7f14897fa700 1 --2- 172.21.15.103:0/1865007295 >> v2:172.21.15.86:3300/0 conn(0x7f148c143ce0 0x7f148c063720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:56.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.248+0000 7f14897fa700 1 -- 172.21.15.103:0/1865007295 >> v1:172.21.15.103:6789/0 conn(0x7f148c0b2940 legacy=0x7f148c1515f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:56.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.248+0000 7f14897fa700 1 --2- 172.21.15.103:0/1865007295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f146c0049b0 0x7f146c004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:56.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.248+0000 7f14897fa700 1 --2- 172.21.15.103:0/1865007295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f146c003920 0x7f146c003d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:56.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.248+0000 7f14897fa700 1 --2- 172.21.15.103:0/1865007295 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f146c0041c0 0x7f146c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:56.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.248+0000 7f14897fa700 1 -- 172.21.15.103:0/1865007295 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148c063b80 con 0x7f146c0049b0 2020-04-22T14:13:56.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.248+0000 7f14897fa700 1 -- 172.21.15.103:0/1865007295 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148c151d00 con 0x7f146c003920 2020-04-22T14:13:56.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.248+0000 7f14897fa700 1 -- 172.21.15.103:0/1865007295 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f146c0046c0 con 0x7f146c0041c0 2020-04-22T14:13:56.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.248+0000 7f1490c70700 1 --2- 172.21.15.103:0/1865007295 >> v2:172.21.15.86:3300/0 conn(0x7f148c143ce0 0x7f148c063720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:13:56.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.248+0000 7f148bfff700 1 --2- 172.21.15.103:0/1865007295 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f148c05f3e0 0x7f148c0b9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:13:56.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.248+0000 7f148b7fe700 1 --2- 172.21.15.103:0/1865007295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f146c003920 0x7f146c003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:56.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.248+0000 7f1490c70700 1 --2- 172.21.15.103:0/1865007295 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f146c0041c0 0x7f146c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:56.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.248+0000 7f148bfff700 1 --2- 172.21.15.103:0/1865007295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f146c0049b0 0x7f146c004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:56.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.248+0000 7f148b7fe700 1 -- 172.21.15.103:0/1865007295 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f146c0041c0 msgr2=0x7f146c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:56.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.248+0000 7f148b7fe700 1 --2- 172.21.15.103:0/1865007295 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f146c0041c0 0x7f146c00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:56.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.248+0000 7f148b7fe700 1 -- 172.21.15.103:0/1865007295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f146c0049b0 msgr2=0x7f146c004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:56.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.248+0000 7f148b7fe700 1 --2- 172.21.15.103:0/1865007295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f146c0049b0 0x7f146c004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:56.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.248+0000 7f148b7fe700 1 -- 172.21.15.103:0/1865007295 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148c0b9690 con 0x7f146c003920 2020-04-22T14:13:56.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.248+0000 7f1490c70700 1 --2- 172.21.15.103:0/1865007295 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f146c0041c0 0x7f146c00b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:13:56.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.248+0000 7f14926d3700 1 -- 172.21.15.103:0/1865007295 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f148c0b9930 con 0x7f146c003920 2020-04-22T14:13:56.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.248+0000 7f148b7fe700 1 --2- 172.21.15.103:0/1865007295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f146c003920 0x7f146c003d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f146c005650 tx=0x7f1480007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:56.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.248+0000 7f148bfff700 1 --2- 172.21.15.103:0/1865007295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f146c0049b0 0x7f146c004dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:13:56.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.248+0000 7f14926d3700 1 -- 172.21.15.103:0/1865007295 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f148c0b9380 con 0x7f146c003920 2020-04-22T14:13:56.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.248+0000 7f148b7fe700 1 --2- 172.21.15.103:0/1865007295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f146c003920 0x7f146c003d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f146c005650 tx=0x7f1480007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:56.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.248+0000 7f148b7fe700 1 --2- 172.21.15.103:0/1865007295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f146c003920 0x7f146c003d60 secure :-1 s=READY pgs=1326 cs=0 l=1 rx=0x7f146c005650 tx=0x7f1480007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:56.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.248+0000 7f148b7fe700 1 --2- 172.21.15.103:0/1865007295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f146c003920 0x7f146c003d60 secure :-1 s=THROTTLE_DONE pgs=1326 cs=0 l=1 rx=0x7f146c005650 tx=0x7f1480007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:56.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.248+0000 7f148b7fe700 1 --2- 172.21.15.103:0/1865007295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f146c003920 0x7f146c003d60 secure :-1 s=THROTTLE_DONE pgs=1326 cs=0 l=1 rx=0x7f146c005650 tx=0x7f1480007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:56.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.248+0000 7f148b7fe700 1 --2- 172.21.15.103:0/1865007295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f146c003920 0x7f146c003d60 secure :-1 s=THROTTLE_DONE pgs=1326 cs=0 l=1 rx=0x7f146c005650 tx=0x7f1480007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:56.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.248+0000 7f14897fa700 1 -- 172.21.15.103:0/1865007295 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f148000f900 con 0x7f146c003920 2020-04-22T14:13:56.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.248+0000 7f14897fa700 1 -- 172.21.15.103:0/1865007295 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1480007550 con 0x7f146c003920 2020-04-22T14:13:56.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.248+0000 7f14897fa700 1 -- 172.21.15.103:0/1865007295 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f148000abd0 con 0x7f146c003920 2020-04-22T14:13:56.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.249+0000 7f148b7fe700 1 --2- 172.21.15.103:0/1865007295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f146c003920 0x7f146c003d60 secure :-1 s=THROTTLE_DONE pgs=1326 cs=0 l=1 rx=0x7f146c005650 tx=0x7f1480007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:56.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.249+0000 7f14926d3700 1 -- 172.21.15.103:0/1865007295 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1468003340 con 0x7f146c003920 2020-04-22T14:13:56.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.249+0000 7f14897fa700 1 -- 172.21.15.103:0/1865007295 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f148000ad30 con 0x7f146c003920 2020-04-22T14:13:56.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.249+0000 7f148b7fe700 1 --2- 172.21.15.103:0/1865007295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f146c003920 0x7f146c003d60 secure :-1 s=THROTTLE_DONE pgs=1326 cs=0 l=1 rx=0x7f146c005650 tx=0x7f1480007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:56.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.249+0000 7f14897fa700 1 --2- 172.21.15.103:0/1865007295 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f146c0560c0 0x7f146c058580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:56.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.249+0000 7f14897fa700 1 -- 172.21.15.103:0/1865007295 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f14800624b0 con 0x7f146c003920 2020-04-22T14:13:56.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.250+0000 7f148bfff700 1 --2- 172.21.15.103:0/1865007295 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f146c0560c0 0x7f146c058580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:56.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.250+0000 7f148bfff700 1 --2- 172.21.15.103:0/1865007295 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f146c0560c0 0x7f146c058580 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f147c002f30 tx=0x7f147c00b020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:56.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.250+0000 7f148bfff700 1 --2- 172.21.15.103:0/1865007295 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f146c0560c0 0x7f146c058580 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f147c002f30 tx=0x7f147c00b020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:56.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.250+0000 7f148bfff700 1 --2- 172.21.15.103:0/1865007295 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f146c0560c0 0x7f146c058580 secure :-1 s=READY pgs=485 cs=0 l=1 rx=0x7f147c002f30 tx=0x7f147c00b020).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:56.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.254+0000 7f148b7fe700 1 --2- 172.21.15.103:0/1865007295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f146c003920 0x7f146c003d60 secure :-1 s=THROTTLE_DONE pgs=1326 cs=0 l=1 rx=0x7f146c005650 tx=0x7f1480007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:56.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.254+0000 7f14897fa700 1 -- 172.21.15.103:0/1865007295 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f148003d9b0 con 0x7f146c003920 2020-04-22T14:13:56.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.397+0000 7f14926d3700 1 -- 172.21.15.103:0/1865007295 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f14680021d0 con 0x7f146c003920 2020-04-22T14:13:56.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.398+0000 7f148b7fe700 1 --2- 172.21.15.103:0/1865007295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f146c003920 0x7f146c003d60 secure :-1 s=THROTTLE_DONE pgs=1326 cs=0 l=1 rx=0x7f146c005650 tx=0x7f1480007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:56.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.398+0000 7f14897fa700 1 -- 172.21.15.103:0/1865007295 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v85) v1 ==== 84+0+143 (secure 0 0 0) 0x7f1480040fd0 con 0x7f146c003920 2020-04-22T14:13:56.401 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:13:56.401 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2020-04-22T14:13:56.402 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:56.402 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 1, 2020-04-22T14:13:56.402 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": "device_health_metrics" 2020-04-22T14:13:56.402 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:13:56.402 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:13:56.402 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 2, 2020-04-22T14:13:56.402 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": "rbd" 2020-04-22T14:13:56.403 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:13:56.403 INFO:teuthology.orchestra.run.smithi103.stdout:] 2020-04-22T14:13:56.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.399+0000 7f14926d3700 1 -- 172.21.15.103:0/1865007295 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f146c0560c0 msgr2=0x7f146c058580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:56.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.399+0000 7f14926d3700 1 --2- 172.21.15.103:0/1865007295 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f146c0560c0 0x7f146c058580 secure :-1 s=READY pgs=485 cs=0 l=1 rx=0x7f147c002f30 tx=0x7f147c00b020).stop 2020-04-22T14:13:56.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.399+0000 7f14926d3700 1 -- 172.21.15.103:0/1865007295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f146c003920 msgr2=0x7f146c003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:56.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.399+0000 7f14926d3700 1 --2- 172.21.15.103:0/1865007295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f146c003920 0x7f146c003d60 secure :-1 s=READY pgs=1326 cs=0 l=1 rx=0x7f146c005650 tx=0x7f1480007a40).stop 2020-04-22T14:13:56.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.399+0000 7f1490c70700 1 -- 172.21.15.103:0/1865007295 reap_dead start 2020-04-22T14:13:56.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.399+0000 7f1490c70700 1 -- 172.21.15.103:0/1865007295 reap_dead start 2020-04-22T14:13:56.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.399+0000 7f14926d3700 1 -- 172.21.15.103:0/1865007295 shutdown_connections 2020-04-22T14:13:56.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.399+0000 7f14926d3700 1 -- 172.21.15.103:0/1865007295 >> 172.21.15.103:0/1865007295 conn(0x7f148c05ad30 msgr2=0x7f148c141fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:56.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.399+0000 7f14926d3700 1 -- 172.21.15.103:0/1865007295 shutdown_connections 2020-04-22T14:13:56.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.399+0000 7f14926d3700 1 -- 172.21.15.103:0/1865007295 wait complete. 2020-04-22T14:13:56.413 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-04-22T14:13:56.413 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:56.428 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-04-22T14:13:56.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.573+0000 7f7699aff700 1 Processor -- start 2020-04-22T14:13:56.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.573+0000 7f7699aff700 1 -- start start 2020-04-22T14:13:56.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.574+0000 7f7699aff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f76940b9140 0x7f76940aed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:56.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.574+0000 7f7699aff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f76940af1f0 0x7f7694144660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:56.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.574+0000 7f7699aff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7694144ac0 con 0x7f76940b3bd0 2020-04-22T14:13:56.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.574+0000 7f7699aff700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7694148310 con 0x7f76940af1f0 2020-04-22T14:13:56.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.574+0000 7f7699aff700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76941485b0 con 0x7f76940b9140 2020-04-22T14:13:56.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.574+0000 7f7693fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f76940af1f0 0x7f7694144660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:56.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.574+0000 7f7693fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f76940af1f0 0x7f7694144660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54184/0 (socket says 172.21.15.103:54184) 2020-04-22T14:13:56.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.574+0000 7f7693fff700 1 -- 172.21.15.103:0/1917701485 learned_addr learned my addr 172.21.15.103:0/1917701485 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:56.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.574+0000 7f76937fe700 1 --2- 172.21.15.103:0/1917701485 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f76940b9140 0x7f76940aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:56.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.575+0000 7f7693fff700 1 -- 172.21.15.103:0/1917701485 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f76940b9140 msgr2=0x7f76940aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:56.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.575+0000 7f7693fff700 1 --2- 172.21.15.103:0/1917701485 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f76940b9140 0x7f76940aed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:56.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.575+0000 7f7693fff700 1 -- 172.21.15.103:0/1917701485 >> v1:172.21.15.86:6789/0 conn(0x7f76940b3bd0 legacy=0x7f76940616b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:56.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.575+0000 7f7693fff700 1 -- 172.21.15.103:0/1917701485 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76940b9520 con 0x7f76940af1f0 2020-04-22T14:13:56.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.575+0000 7f7693fff700 1 --2- 172.21.15.103:0/1917701485 >> v2:172.21.15.103:3300/0 conn(0x7f76940af1f0 0x7f7694144660 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f768c0032b0 tx=0x7f768c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:56.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.575+0000 7f7693fff700 1 --2- 172.21.15.103:0/1917701485 >> v2:172.21.15.103:3300/0 conn(0x7f76940af1f0 0x7f7694144660 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f768c0032b0 tx=0x7f768c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:56.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.575+0000 7f7693fff700 1 --2- 172.21.15.103:0/1917701485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76940af1f0 0x7f7694144660 secure :-1 s=READY pgs=1327 cs=0 l=1 rx=0x7f768c0032b0 tx=0x7f768c007dc0).ready entity=mon.1 client_cookie=5b3bfd9c921fc8eb server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:56.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.575+0000 7f7693fff700 1 --2- 172.21.15.103:0/1917701485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76940af1f0 0x7f7694144660 secure :-1 s=THROTTLE_DONE pgs=1327 cs=0 l=1 rx=0x7f768c0032b0 tx=0x7f768c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:56.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.575+0000 7f76927fc700 1 -- 172.21.15.103:0/1917701485 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f768c00a180 con 0x7f76940af1f0 2020-04-22T14:13:56.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.575+0000 7f7693fff700 1 --2- 172.21.15.103:0/1917701485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76940af1f0 0x7f7694144660 secure :-1 s=THROTTLE_DONE pgs=1327 cs=0 l=1 rx=0x7f768c0032b0 tx=0x7f768c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:56.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.575+0000 7f7693fff700 1 --2- 172.21.15.103:0/1917701485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76940af1f0 0x7f7694144660 secure :-1 s=THROTTLE_DONE pgs=1327 cs=0 l=1 rx=0x7f768c0032b0 tx=0x7f768c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:56.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.575+0000 7f76927fc700 1 -- 172.21.15.103:0/1917701485 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f768c00a320 con 0x7f76940af1f0 2020-04-22T14:13:56.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.575+0000 7f76927fc700 1 -- 172.21.15.103:0/1917701485 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f768c00a740 con 0x7f76940af1f0 2020-04-22T14:13:56.590 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.575+0000 7f7699aff700 1 -- 172.21.15.103:0/1917701485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76940af1f0 msgr2=0x7f7694144660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:56.590 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.575+0000 7f7699aff700 1 --2- 172.21.15.103:0/1917701485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76940af1f0 0x7f7694144660 secure :-1 s=READY pgs=1327 cs=0 l=1 rx=0x7f768c0032b0 tx=0x7f768c007dc0).stop 2020-04-22T14:13:56.591 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.575+0000 7f7699aff700 1 -- 172.21.15.103:0/1917701485 shutdown_connections 2020-04-22T14:13:56.591 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.575+0000 7f7699aff700 1 --2- 172.21.15.103:0/1917701485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76940af1f0 0x7f7694144660 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:56.591 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.575+0000 7f7699aff700 1 --2- 172.21.15.103:0/1917701485 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f76940b9140 0x7f76940aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:56.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.575+0000 7f7699aff700 1 -- 172.21.15.103:0/1917701485 >> 172.21.15.103:0/1917701485 conn(0x7f769405b7b0 msgr2=0x7f76940b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:56.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.575+0000 7f7699aff700 1 -- 172.21.15.103:0/1917701485 shutdown_connections 2020-04-22T14:13:56.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.575+0000 7f7699aff700 1 -- 172.21.15.103:0/1917701485 wait complete. 2020-04-22T14:13:56.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.576+0000 7f7699aff700 1 Processor -- start 2020-04-22T14:13:56.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.577+0000 7f7699aff700 1 -- start start 2020-04-22T14:13:56.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.577+0000 7f7699aff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f76940af1f0 0x7f76940b1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:56.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.577+0000 7f7699aff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f76940b3bd0 0x7f76940adcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:56.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.577+0000 7f7699aff700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76940ae130 con 0x7f76940b9140 2020-04-22T14:13:56.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.577+0000 7f7699aff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7694141f20 con 0x7f76940af1f0 2020-04-22T14:13:56.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.577+0000 7f7699aff700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7694141c50 con 0x7f76940b3bd0 2020-04-22T14:13:56.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.577+0000 7f7692ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f76940b3bd0 0x7f76940adcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:56.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.577+0000 7f7693fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f76940b9140 0x7f7694142660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46384/0 (socket says 172.21.15.103:46384) 2020-04-22T14:13:56.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.577+0000 7f7693fff700 1 -- 172.21.15.103:0/1602801826 learned_addr learned my addr 172.21.15.103:0/1602801826 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:56.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.577+0000 7f76937fe700 1 --2- 172.21.15.103:0/1602801826 >> v2:172.21.15.86:3300/0 conn(0x7f76940af1f0 0x7f76940b1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:56.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.578+0000 7f7692ffd700 1 -- 172.21.15.103:0/1602801826 >> v2:172.21.15.86:3300/0 conn(0x7f76940af1f0 msgr2=0x7f76940b1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:56.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.578+0000 7f7692ffd700 1 --2- 172.21.15.103:0/1602801826 >> v2:172.21.15.86:3300/0 conn(0x7f76940af1f0 0x7f76940b1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:56.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.578+0000 7f7692ffd700 1 -- 172.21.15.103:0/1602801826 >> v1:172.21.15.103:6789/0 conn(0x7f76940b9140 legacy=0x7f7694142660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:56.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.578+0000 7f7690ff9700 1 -- 172.21.15.103:0/1602801826 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3290778316 0 0) 0x7f76940b9520 con 0x7f76940b9140 2020-04-22T14:13:56.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.578+0000 7f7692ffd700 1 -- 172.21.15.103:0/1602801826 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7694142d70 con 0x7f76940b3bd0 2020-04-22T14:13:56.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.578+0000 7f7692ffd700 1 --2- 172.21.15.103:0/1602801826 >> v2:172.21.15.103:3300/0 conn(0x7f76940b3bd0 0x7f76940adcd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f76940b6250 tx=0x7f7688010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:56.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.578+0000 7f7692ffd700 1 --2- 172.21.15.103:0/1602801826 >> v2:172.21.15.103:3300/0 conn(0x7f76940b3bd0 0x7f76940adcd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f76940b6250 tx=0x7f7688010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:56.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.578+0000 7f7692ffd700 1 --2- 172.21.15.103:0/1602801826 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76940b3bd0 0x7f76940adcd0 secure :-1 s=READY pgs=1329 cs=0 l=1 rx=0x7f76940b6250 tx=0x7f7688010880).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:56.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.578+0000 7f7692ffd700 1 --2- 172.21.15.103:0/1602801826 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76940b3bd0 0x7f76940adcd0 secure :-1 s=THROTTLE_DONE pgs=1329 cs=0 l=1 rx=0x7f76940b6250 tx=0x7f7688010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:56.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.578+0000 7f7690ff9700 1 -- 172.21.15.103:0/1602801826 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7688006bc0 con 0x7f76940b3bd0 2020-04-22T14:13:56.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.578+0000 7f7692ffd700 1 --2- 172.21.15.103:0/1602801826 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76940b3bd0 0x7f76940adcd0 secure :-1 s=THROTTLE_DONE pgs=1329 cs=0 l=1 rx=0x7f76940b6250 tx=0x7f7688010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:56.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.578+0000 7f7692ffd700 1 --2- 172.21.15.103:0/1602801826 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76940b3bd0 0x7f76940adcd0 secure :-1 s=THROTTLE_DONE pgs=1329 cs=0 l=1 rx=0x7f76940b6250 tx=0x7f7688010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:56.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.578+0000 7f7690ff9700 1 -- 172.21.15.103:0/1602801826 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7688006d60 con 0x7f76940b3bd0 2020-04-22T14:13:56.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.578+0000 7f7699aff700 1 -- 172.21.15.103:0/1602801826 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76940ad150 con 0x7f76940b3bd0 2020-04-22T14:13:56.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.578+0000 7f7690ff9700 1 -- 172.21.15.103:0/1602801826 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76880110a0 con 0x7f76940b3bd0 2020-04-22T14:13:56.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.578+0000 7f7699aff700 1 -- 172.21.15.103:0/1602801826 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76940ad620 con 0x7f76940b3bd0 2020-04-22T14:13:56.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.578+0000 7f7692ffd700 1 --2- 172.21.15.103:0/1602801826 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76940b3bd0 0x7f76940adcd0 secure :-1 s=THROTTLE_DONE pgs=1329 cs=0 l=1 rx=0x7f76940b6250 tx=0x7f7688010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:56.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.579+0000 7f7699aff700 1 -- 172.21.15.103:0/1602801826 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7694056c90 con 0x7f76940b3bd0 2020-04-22T14:13:56.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.579+0000 7f7690ff9700 1 -- 172.21.15.103:0/1602801826 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f7688011320 con 0x7f76940b3bd0 2020-04-22T14:13:56.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.579+0000 7f7692ffd700 1 --2- 172.21.15.103:0/1602801826 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76940b3bd0 0x7f76940adcd0 secure :-1 s=THROTTLE_DONE pgs=1329 cs=0 l=1 rx=0x7f76940b6250 tx=0x7f7688010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:56.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.579+0000 7f7690ff9700 1 --2- 172.21.15.103:0/1602801826 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f767404d7e0 0x7f767404fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:56.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.579+0000 7f7690ff9700 1 -- 172.21.15.103:0/1602801826 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f7688061350 con 0x7f76940b3bd0 2020-04-22T14:13:56.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.579+0000 7f76937fe700 1 --2- 172.21.15.103:0/1602801826 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f767404d7e0 0x7f767404fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:56.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.579+0000 7f76937fe700 1 --2- 172.21.15.103:0/1602801826 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f767404d7e0 0x7f767404fca0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7684002f30 tx=0x7f768400d8b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:56.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.580+0000 7f76937fe700 1 --2- 172.21.15.103:0/1602801826 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f767404d7e0 0x7f767404fca0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7684002f30 tx=0x7f768400d8b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:56.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.580+0000 7f76937fe700 1 --2- 172.21.15.103:0/1602801826 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f767404d7e0 0x7f767404fca0 secure :-1 s=READY pgs=486 cs=0 l=1 rx=0x7f7684002f30 tx=0x7f768400d8b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:56.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.583+0000 7f7692ffd700 1 --2- 172.21.15.103:0/1602801826 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76940b3bd0 0x7f76940adcd0 secure :-1 s=THROTTLE_DONE pgs=1329 cs=0 l=1 rx=0x7f76940b6250 tx=0x7f7688010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:56.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.583+0000 7f7690ff9700 1 -- 172.21.15.103:0/1602801826 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f768803c730 con 0x7f76940b3bd0 2020-04-22T14:13:56.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:56.726+0000 7f7699aff700 1 -- 172.21.15.103:0/1602801826 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f7694142360 con 0x7f76940b3bd0 2020-04-22T14:13:57.453 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.449+0000 7f7692ffd700 1 --2- 172.21.15.103:0/1602801826 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76940b3bd0 0x7f76940adcd0 secure :-1 s=THROTTLE_DONE pgs=1329 cs=0 l=1 rx=0x7f76940b6250 tx=0x7f7688010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:57.453 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.449+0000 7f7690ff9700 1 -- 172.21.15.103:0/1602801826 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v86) v1 ==== 133+0+0 (secure 0 0 0) 0x7f768803fd50 con 0x7f76940b3bd0 2020-04-22T14:13:57.455 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.452+0000 7f7699aff700 1 -- 172.21.15.103:0/1602801826 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f767404d7e0 msgr2=0x7f767404fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:57.455 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.452+0000 7f7699aff700 1 --2- 172.21.15.103:0/1602801826 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f767404d7e0 0x7f767404fca0 secure :-1 s=READY pgs=486 cs=0 l=1 rx=0x7f7684002f30 tx=0x7f768400d8b0).stop 2020-04-22T14:13:57.455 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.452+0000 7f7699aff700 1 -- 172.21.15.103:0/1602801826 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76940b3bd0 msgr2=0x7f76940adcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:57.455 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.452+0000 7f7699aff700 1 --2- 172.21.15.103:0/1602801826 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76940b3bd0 0x7f76940adcd0 secure :-1 s=READY pgs=1329 cs=0 l=1 rx=0x7f76940b6250 tx=0x7f7688010880).stop 2020-04-22T14:13:57.456 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.452+0000 7f7699aff700 1 -- 172.21.15.103:0/1602801826 shutdown_connections 2020-04-22T14:13:57.456 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.452+0000 7f7699aff700 1 --2- 172.21.15.103:0/1602801826 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f767404d7e0 0x7f767404fca0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:57.456 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.452+0000 7f7699aff700 1 --2- 172.21.15.103:0/1602801826 >> v2:172.21.15.86:3300/0 conn(0x7f76940af1f0 0x7f76940b1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:57.456 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.452+0000 7f7699aff700 1 --2- 172.21.15.103:0/1602801826 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76940b3bd0 0x7f76940adcd0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:57.456 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.452+0000 7f7699aff700 1 -- 172.21.15.103:0/1602801826 >> 172.21.15.103:0/1602801826 conn(0x7f769405b7b0 msgr2=0x7f7694146c60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:57.456 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.452+0000 7f7699aff700 1 -- 172.21.15.103:0/1602801826 shutdown_connections 2020-04-22T14:13:57.456 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.452+0000 7f7699aff700 1 -- 172.21.15.103:0/1602801826 wait complete. 2020-04-22T14:13:57.457 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' created 2020-04-22T14:13:57.468 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:57.483 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-04-22T14:13:57.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.633+0000 7fd7b687e700 1 Processor -- start 2020-04-22T14:13:57.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.633+0000 7fd7b687e700 1 -- start start 2020-04-22T14:13:57.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.634+0000 7fd7b687e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd7b00af390 0x7fd7b00b4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:57.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.634+0000 7fd7b687e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7b00b49d0 con 0x7fd7b00b9140 2020-04-22T14:13:57.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.634+0000 7fd7b687e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7b0061830 con 0x7fd7b014ddb0 2020-04-22T14:13:57.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.634+0000 7fd7b687e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7b0061ad0 con 0x7fd7b00af390 2020-04-22T14:13:57.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.634+0000 7fd7a7fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd7b00af390 0x7fd7b00b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:57.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.634+0000 7fd7b4e1b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd7b014ddb0 0x7fd7b014e210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46388/0 (socket says 172.21.15.103:46388) 2020-04-22T14:13:57.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.634+0000 7fd7a7fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd7b00af390 0x7fd7b00b4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54202/0 (socket says 172.21.15.103:54202) 2020-04-22T14:13:57.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.634+0000 7fd7b4e1b700 1 -- 172.21.15.103:0/3076942527 learned_addr learned my addr 172.21.15.103:0/3076942527 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:57.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.635+0000 7fd7a7fff700 1 -- 172.21.15.103:0/3076942527 >> v1:172.21.15.103:6789/0 conn(0x7fd7b014ddb0 legacy=0x7fd7b014e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:57.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.635+0000 7fd7a7fff700 1 -- 172.21.15.103:0/3076942527 >> v1:172.21.15.86:6789/0 conn(0x7fd7b00b9140 legacy=0x7fd7b0061f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:57.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.635+0000 7fd7af7fe700 1 -- 172.21.15.103:0/3076942527 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 456546564 0 0) 0x7fd7b0061830 con 0x7fd7b014ddb0 2020-04-22T14:13:57.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.635+0000 7fd7a7fff700 1 -- 172.21.15.103:0/3076942527 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b00b9520 con 0x7fd7b00af390 2020-04-22T14:13:57.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.635+0000 7fd7a7fff700 1 --2- 172.21.15.103:0/3076942527 >> v2:172.21.15.103:3300/0 conn(0x7fd7b00af390 0x7fd7b00b4570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd7b00b6250 tx=0x7fd798007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:57.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.635+0000 7fd7a7fff700 1 --2- 172.21.15.103:0/3076942527 >> v2:172.21.15.103:3300/0 conn(0x7fd7b00af390 0x7fd7b00b4570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd7b00b6250 tx=0x7fd798007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:57.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.635+0000 7fd7a7fff700 1 --2- 172.21.15.103:0/3076942527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7b00af390 0x7fd7b00b4570 secure :-1 s=READY pgs=1331 cs=0 l=1 rx=0x7fd7b00b6250 tx=0x7fd798007a40).ready entity=mon.1 client_cookie=37afc2868959cacc server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:57.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.635+0000 7fd7a7fff700 1 --2- 172.21.15.103:0/3076942527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7b00af390 0x7fd7b00b4570 secure :-1 s=THROTTLE_DONE pgs=1331 cs=0 l=1 rx=0x7fd7b00b6250 tx=0x7fd798007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:57.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.635+0000 7fd7af7fe700 1 -- 172.21.15.103:0/3076942527 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd798011430 con 0x7fd7b00af390 2020-04-22T14:13:57.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.635+0000 7fd7a7fff700 1 --2- 172.21.15.103:0/3076942527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7b00af390 0x7fd7b00b4570 secure :-1 s=THROTTLE_DONE pgs=1331 cs=0 l=1 rx=0x7fd7b00b6250 tx=0x7fd798007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:57.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.635+0000 7fd7af7fe700 1 -- 172.21.15.103:0/3076942527 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd798011590 con 0x7fd7b00af390 2020-04-22T14:13:57.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.635+0000 7fd7a7fff700 1 --2- 172.21.15.103:0/3076942527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7b00af390 0x7fd7b00b4570 secure :-1 s=THROTTLE_DONE pgs=1331 cs=0 l=1 rx=0x7fd7b00b6250 tx=0x7fd798007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:57.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.635+0000 7fd7af7fe700 1 -- 172.21.15.103:0/3076942527 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd798011970 con 0x7fd7b00af390 2020-04-22T14:13:57.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.635+0000 7fd7b687e700 1 -- 172.21.15.103:0/3076942527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7b00af390 msgr2=0x7fd7b00b4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:57.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.635+0000 7fd7b687e700 1 --2- 172.21.15.103:0/3076942527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7b00af390 0x7fd7b00b4570 secure :-1 s=READY pgs=1331 cs=0 l=1 rx=0x7fd7b00b6250 tx=0x7fd798007a40).stop 2020-04-22T14:13:57.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.635+0000 7fd7b687e700 1 -- 172.21.15.103:0/3076942527 shutdown_connections 2020-04-22T14:13:57.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.635+0000 7fd7b687e700 1 --2- 172.21.15.103:0/3076942527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7b00af390 0x7fd7b00b4570 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:57.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.635+0000 7fd7b687e700 1 -- 172.21.15.103:0/3076942527 >> 172.21.15.103:0/3076942527 conn(0x7fd7b005b7b0 msgr2=0x7fd7b00b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:57.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.636+0000 7fd7b687e700 1 -- 172.21.15.103:0/3076942527 shutdown_connections 2020-04-22T14:13:57.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.636+0000 7fd7b687e700 1 -- 172.21.15.103:0/3076942527 wait complete. 2020-04-22T14:13:57.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.636+0000 7fd7b687e700 1 Processor -- start 2020-04-22T14:13:57.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.636+0000 7fd7b687e700 1 -- start start 2020-04-22T14:13:57.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.637+0000 7fd7b687e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd7b00af390 0x7fd7b00b7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:57.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.637+0000 7fd7b687e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd7b014ddb0 0x7fd7b00660e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:57.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.637+0000 7fd7b687e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7b0146ae0 con 0x7fd7b00b9140 2020-04-22T14:13:57.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.637+0000 7fd7b687e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7b00b86e0 con 0x7fd7b014ddb0 2020-04-22T14:13:57.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.637+0000 7fd7b687e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7b014b4f0 con 0x7fd7b00af390 2020-04-22T14:13:57.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.637+0000 7fd7affff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd7b00af390 0x7fd7b00b7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:57.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.637+0000 7fd7affff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd7b00af390 0x7fd7b00b7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54204/0 (socket says 172.21.15.103:54204) 2020-04-22T14:13:57.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.637+0000 7fd7affff700 1 -- 172.21.15.103:0/702372286 learned_addr learned my addr 172.21.15.103:0/702372286 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:57.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.637+0000 7fd7b4e1b700 1 --2- 172.21.15.103:0/702372286 >> v2:172.21.15.86:3300/0 conn(0x7fd7b014ddb0 0x7fd7b00660e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:57.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.638+0000 7fd7affff700 1 -- 172.21.15.103:0/702372286 >> v2:172.21.15.86:3300/0 conn(0x7fd7b014ddb0 msgr2=0x7fd7b00660e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:57.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.638+0000 7fd7affff700 1 --2- 172.21.15.103:0/702372286 >> v2:172.21.15.86:3300/0 conn(0x7fd7b014ddb0 0x7fd7b00660e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:57.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.638+0000 7fd7affff700 1 -- 172.21.15.103:0/702372286 >> v1:172.21.15.86:6789/0 conn(0x7fd7b00b9140 legacy=0x7fd7b0113df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:57.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.638+0000 7fd7affff700 1 -- 172.21.15.103:0/702372286 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b014ba70 con 0x7fd7b00af390 2020-04-22T14:13:57.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.638+0000 7fd7affff700 1 --2- 172.21.15.103:0/702372286 >> v2:172.21.15.103:3300/0 conn(0x7fd7b00af390 0x7fd7b00b7ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd7b00b20d0 tx=0x7fd7a0010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:57.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.638+0000 7fd7affff700 1 --2- 172.21.15.103:0/702372286 >> v2:172.21.15.103:3300/0 conn(0x7fd7b00af390 0x7fd7b00b7ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd7b00b20d0 tx=0x7fd7a0010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:57.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.638+0000 7fd7affff700 1 --2- 172.21.15.103:0/702372286 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7b00af390 0x7fd7b00b7ef0 secure :-1 s=READY pgs=1332 cs=0 l=1 rx=0x7fd7b00b20d0 tx=0x7fd7a0010960).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:57.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.638+0000 7fd7affff700 1 --2- 172.21.15.103:0/702372286 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7b00af390 0x7fd7b00b7ef0 secure :-1 s=THROTTLE_DONE pgs=1332 cs=0 l=1 rx=0x7fd7b00b20d0 tx=0x7fd7a0010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:57.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.638+0000 7fd7affff700 1 --2- 172.21.15.103:0/702372286 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7b00af390 0x7fd7b00b7ef0 secure :-1 s=THROTTLE_DONE pgs=1332 cs=0 l=1 rx=0x7fd7b00b20d0 tx=0x7fd7a0010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:57.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.638+0000 7fd7adffb700 1 -- 172.21.15.103:0/702372286 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7a000cc20 con 0x7fd7b00af390 2020-04-22T14:13:57.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.638+0000 7fd7affff700 1 --2- 172.21.15.103:0/702372286 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7b00af390 0x7fd7b00b7ef0 secure :-1 s=THROTTLE_DONE pgs=1332 cs=0 l=1 rx=0x7fd7b00b20d0 tx=0x7fd7a0010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:57.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.638+0000 7fd7adffb700 1 -- 172.21.15.103:0/702372286 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a000cd80 con 0x7fd7b00af390 2020-04-22T14:13:57.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.638+0000 7fd7b687e700 1 -- 172.21.15.103:0/702372286 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7b014b050 con 0x7fd7b00af390 2020-04-22T14:13:57.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.638+0000 7fd7adffb700 1 -- 172.21.15.103:0/702372286 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7a000e370 con 0x7fd7b00af390 2020-04-22T14:13:57.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.638+0000 7fd7b687e700 1 -- 172.21.15.103:0/702372286 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7b0066700 con 0x7fd7b00af390 2020-04-22T14:13:57.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.639+0000 7fd7affff700 1 --2- 172.21.15.103:0/702372286 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7b00af390 0x7fd7b00b7ef0 secure :-1 s=THROTTLE_DONE pgs=1332 cs=0 l=1 rx=0x7fd7b00b20d0 tx=0x7fd7a0010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:57.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.639+0000 7fd7adffb700 1 -- 172.21.15.103:0/702372286 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fd7a00064e0 con 0x7fd7b00af390 2020-04-22T14:13:57.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.639+0000 7fd7affff700 1 --2- 172.21.15.103:0/702372286 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7b00af390 0x7fd7b00b7ef0 secure :-1 s=THROTTLE_DONE pgs=1332 cs=0 l=1 rx=0x7fd7b00b20d0 tx=0x7fd7a0010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:57.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.639+0000 7fd7b687e700 1 -- 172.21.15.103:0/702372286 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7b014b300 con 0x7fd7b00af390 2020-04-22T14:13:57.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.639+0000 7fd7adffb700 1 --2- 172.21.15.103:0/702372286 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd79404d9e0 0x7fd79404fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:57.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.639+0000 7fd7adffb700 1 -- 172.21.15.103:0/702372286 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fd7a00611a0 con 0x7fd7b00af390 2020-04-22T14:13:57.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.639+0000 7fd7a7fff700 1 --2- 172.21.15.103:0/702372286 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd79404d9e0 0x7fd79404fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:57.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.640+0000 7fd7a7fff700 1 --2- 172.21.15.103:0/702372286 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd79404d9e0 0x7fd79404fea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd7b0146cc0 tx=0x7fd798007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:57.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.640+0000 7fd7a7fff700 1 --2- 172.21.15.103:0/702372286 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd79404d9e0 0x7fd79404fea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd7b0146cc0 tx=0x7fd798007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:57.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.640+0000 7fd7a7fff700 1 --2- 172.21.15.103:0/702372286 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd79404d9e0 0x7fd79404fea0 secure :-1 s=READY pgs=487 cs=0 l=1 rx=0x7fd7b0146cc0 tx=0x7fd798007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:57.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.643+0000 7fd7affff700 1 --2- 172.21.15.103:0/702372286 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7b00af390 0x7fd7b00b7ef0 secure :-1 s=THROTTLE_DONE pgs=1332 cs=0 l=1 rx=0x7fd7b00b20d0 tx=0x7fd7a0010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:57.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.643+0000 7fd7adffb700 1 -- 172.21.15.103:0/702372286 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fd7a003c520 con 0x7fd7b00af390 2020-04-22T14:13:57.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:57.794+0000 7fd7b687e700 1 -- 172.21.15.103:0/702372286 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fd7b0056c90 con 0x7fd7b00af390 2020-04-22T14:13:58.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.638+0000 7fd7affff700 1 --2- 172.21.15.103:0/702372286 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7b00af390 0x7fd7b00b7ef0 secure :-1 s=READY pgs=1332 cs=0 l=1 rx=0x7fd7b00b20d0 tx=0x7fd7a0010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:58.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.670+0000 7fd7affff700 1 --2- 172.21.15.103:0/702372286 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7b00af390 0x7fd7b00b7ef0 secure :-1 s=THROTTLE_DONE pgs=1332 cs=0 l=1 rx=0x7fd7b00b20d0 tx=0x7fd7a0010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:58.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.671+0000 7fd7adffb700 1 -- 172.21.15.103:0/702372286 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v88) v1 ==== 125+0+0 (secure 0 0 0) 0x7fd7a003fb40 con 0x7fd7b00af390 2020-04-22T14:13:58.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.673+0000 7fd7b687e700 1 -- 172.21.15.103:0/702372286 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd79404d9e0 msgr2=0x7fd79404fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:58.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.673+0000 7fd7b687e700 1 --2- 172.21.15.103:0/702372286 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd79404d9e0 0x7fd79404fea0 secure :-1 s=READY pgs=487 cs=0 l=1 rx=0x7fd7b0146cc0 tx=0x7fd798007a40).stop 2020-04-22T14:13:58.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.673+0000 7fd7b687e700 1 -- 172.21.15.103:0/702372286 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7b00af390 msgr2=0x7fd7b00b7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:58.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.673+0000 7fd7b687e700 1 --2- 172.21.15.103:0/702372286 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7b00af390 0x7fd7b00b7ef0 secure :-1 s=READY pgs=1332 cs=0 l=1 rx=0x7fd7b00b20d0 tx=0x7fd7a0010960).stop 2020-04-22T14:13:58.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.673+0000 7fd7b687e700 1 -- 172.21.15.103:0/702372286 shutdown_connections 2020-04-22T14:13:58.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.673+0000 7fd7b687e700 1 --2- 172.21.15.103:0/702372286 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd79404d9e0 0x7fd79404fea0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:58.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.673+0000 7fd7b687e700 1 --2- 172.21.15.103:0/702372286 >> v2:172.21.15.86:3300/0 conn(0x7fd7b014ddb0 0x7fd7b00660e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:58.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.673+0000 7fd7b687e700 1 --2- 172.21.15.103:0/702372286 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7b00af390 0x7fd7b00b7ef0 secure :-1 s=CLOSED pgs=1332 cs=0 l=1 rx=0x7fd7b00b20d0 tx=0x7fd7a0010960).stop 2020-04-22T14:13:58.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.673+0000 7fd7b687e700 1 -- 172.21.15.103:0/702372286 >> 172.21.15.103:0/702372286 conn(0x7fd7b005b7b0 msgr2=0x7fd7b00b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:58.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.674+0000 7fd7b687e700 1 -- 172.21.15.103:0/702372286 shutdown_connections 2020-04-22T14:13:58.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.674+0000 7fd7b687e700 1 -- 172.21.15.103:0/702372286 wait complete. 2020-04-22T14:13:58.678 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' created 2020-04-22T14:13:58.689 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:58.704 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-04-22T14:13:58.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.859+0000 7f15eee07700 1 Processor -- start 2020-04-22T14:13:58.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.859+0000 7f15eee07700 1 -- start start 2020-04-22T14:13:58.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.860+0000 7f15eee07700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f15e80ac950 0x7f15e8146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:58.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.860+0000 7f15eee07700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f15e81470a0 0x7f15e8143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:58.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.860+0000 7f15eee07700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e81467e0 con 0x7f15e80b9140 2020-04-22T14:13:58.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.860+0000 7f15eee07700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15e8147530 con 0x7f15e80ac950 2020-04-22T14:13:58.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.860+0000 7f15eee07700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15e80602f0 con 0x7f15e81470a0 2020-04-22T14:13:58.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.860+0000 7f15ed3a4700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f15e81470a0 0x7f15e8143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:58.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.860+0000 7f15ecba3700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f15e80b9140 0x7f15e812b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46402/0 (socket says 172.21.15.103:46402) 2020-04-22T14:13:58.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.860+0000 7f15ecba3700 1 -- 172.21.15.103:0/3895140711 learned_addr learned my addr 172.21.15.103:0/3895140711 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:58.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.860+0000 7f15e7fff700 1 --2- 172.21.15.103:0/3895140711 >> v2:172.21.15.86:3300/0 conn(0x7f15e80ac950 0x7f15e8146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:58.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.861+0000 7f15ed3a4700 1 -- 172.21.15.103:0/3895140711 >> v2:172.21.15.86:3300/0 conn(0x7f15e80ac950 msgr2=0x7f15e8146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:58.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.861+0000 7f15ed3a4700 1 --2- 172.21.15.103:0/3895140711 >> v2:172.21.15.86:3300/0 conn(0x7f15e80ac950 0x7f15e8146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:58.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.861+0000 7f15ed3a4700 1 -- 172.21.15.103:0/3895140711 >> v1:172.21.15.103:6789/0 conn(0x7f15e80b9140 legacy=0x7f15e812b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:58.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.861+0000 7f15ed3a4700 1 -- 172.21.15.103:0/3895140711 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e8060050 con 0x7f15e81470a0 2020-04-22T14:13:58.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.861+0000 7f15e77fe700 1 -- 172.21.15.103:0/3895140711 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 272822637 0 0) 0x7f15e81467e0 con 0x7f15e80b9140 2020-04-22T14:13:58.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.861+0000 7f15e7fff700 1 --2- 172.21.15.103:0/3895140711 >> v2:172.21.15.86:3300/0 conn(0x7f15e80ac950 0x7f15e8146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:13:58.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.861+0000 7f15ed3a4700 1 --2- 172.21.15.103:0/3895140711 >> v2:172.21.15.103:3300/0 conn(0x7f15e81470a0 0x7f15e8143090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f15e00032b0 tx=0x7f15e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:58.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.861+0000 7f15ed3a4700 1 --2- 172.21.15.103:0/3895140711 >> v2:172.21.15.103:3300/0 conn(0x7f15e81470a0 0x7f15e8143090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f15e00032b0 tx=0x7f15e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:58.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.861+0000 7f15ed3a4700 1 --2- 172.21.15.103:0/3895140711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15e81470a0 0x7f15e8143090 secure :-1 s=READY pgs=1334 cs=0 l=1 rx=0x7f15e00032b0 tx=0x7f15e0007dc0).ready entity=mon.1 client_cookie=c51a00de47f934d6 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:58.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.861+0000 7f15ed3a4700 1 --2- 172.21.15.103:0/3895140711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15e81470a0 0x7f15e8143090 secure :-1 s=THROTTLE_DONE pgs=1334 cs=0 l=1 rx=0x7f15e00032b0 tx=0x7f15e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:58.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.861+0000 7f15ed3a4700 1 --2- 172.21.15.103:0/3895140711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15e81470a0 0x7f15e8143090 secure :-1 s=THROTTLE_DONE pgs=1334 cs=0 l=1 rx=0x7f15e00032b0 tx=0x7f15e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:58.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.861+0000 7f15e77fe700 1 -- 172.21.15.103:0/3895140711 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15e000a180 con 0x7f15e81470a0 2020-04-22T14:13:58.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.861+0000 7f15ed3a4700 1 --2- 172.21.15.103:0/3895140711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15e81470a0 0x7f15e8143090 secure :-1 s=THROTTLE_DONE pgs=1334 cs=0 l=1 rx=0x7f15e00032b0 tx=0x7f15e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:58.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.861+0000 7f15e77fe700 1 -- 172.21.15.103:0/3895140711 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e000a2e0 con 0x7f15e81470a0 2020-04-22T14:13:58.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.861+0000 7f15e77fe700 1 -- 172.21.15.103:0/3895140711 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15e000a6c0 con 0x7f15e81470a0 2020-04-22T14:13:58.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.861+0000 7f15eee07700 1 -- 172.21.15.103:0/3895140711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15e81470a0 msgr2=0x7f15e8143090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:58.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.861+0000 7f15eee07700 1 --2- 172.21.15.103:0/3895140711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15e81470a0 0x7f15e8143090 secure :-1 s=READY pgs=1334 cs=0 l=1 rx=0x7f15e00032b0 tx=0x7f15e0007dc0).stop 2020-04-22T14:13:58.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.861+0000 7f15eee07700 1 -- 172.21.15.103:0/3895140711 shutdown_connections 2020-04-22T14:13:58.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.861+0000 7f15eee07700 1 --2- 172.21.15.103:0/3895140711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15e81470a0 0x7f15e8143090 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:58.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.861+0000 7f15eee07700 1 --2- 172.21.15.103:0/3895140711 >> v2:172.21.15.86:3300/0 conn(0x7f15e80ac950 0x7f15e8146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:58.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.861+0000 7f15eee07700 1 -- 172.21.15.103:0/3895140711 >> 172.21.15.103:0/3895140711 conn(0x7f15e805b7b0 msgr2=0x7f15e80b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:58.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.861+0000 7f15eee07700 1 -- 172.21.15.103:0/3895140711 shutdown_connections 2020-04-22T14:13:58.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.861+0000 7f15eee07700 1 -- 172.21.15.103:0/3895140711 wait complete. 2020-04-22T14:13:58.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.862+0000 7f15eee07700 1 Processor -- start 2020-04-22T14:13:58.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.862+0000 7f15eee07700 1 -- start start 2020-04-22T14:13:58.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.863+0000 7f15eee07700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f15e80ac950 0x7f15e8157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:58.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.863+0000 7f15eee07700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e80b1d20 con 0x7f15e81470a0 2020-04-22T14:13:58.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.863+0000 7f15eee07700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e80b1fc0 con 0x7f15e80b9140 2020-04-22T14:13:58.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.863+0000 7f15eee07700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15e8158190 con 0x7f15e80ac950 2020-04-22T14:13:58.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.863+0000 7f15ecba3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f15e80ac950 0x7f15e8157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:58.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.863+0000 7f15e7fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f15e80b9140 0x7f15e8142250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46408/0 (socket says 172.21.15.103:46408) 2020-04-22T14:13:58.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.863+0000 7f15ecba3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f15e80ac950 0x7f15e8157d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54216/0 (socket says 172.21.15.103:54216) 2020-04-22T14:13:58.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.863+0000 7f15e7fff700 1 -- 172.21.15.103:0/1949323557 learned_addr learned my addr 172.21.15.103:0/1949323557 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:58.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.864+0000 7f15ecba3700 1 -- 172.21.15.103:0/1949323557 >> v1:172.21.15.103:6789/0 conn(0x7f15e80b9140 legacy=0x7f15e8142250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:58.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.864+0000 7f15ecba3700 1 -- 172.21.15.103:0/1949323557 >> v1:172.21.15.86:6789/0 conn(0x7f15e81470a0 legacy=0x7f15e8143b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:58.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.864+0000 7f15e5ffb700 1 -- 172.21.15.103:0/1949323557 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 402930506 0 0) 0x7f15e80b1fc0 con 0x7f15e80b9140 2020-04-22T14:13:58.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.864+0000 7f15ecba3700 1 -- 172.21.15.103:0/1949323557 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e80b2260 con 0x7f15e80ac950 2020-04-22T14:13:58.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.864+0000 7f15ecba3700 1 --2- 172.21.15.103:0/1949323557 >> v2:172.21.15.103:3300/0 conn(0x7f15e80ac950 0x7f15e8157d30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f15e8153e00 tx=0x7f15d80109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:58.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.864+0000 7f15ecba3700 1 --2- 172.21.15.103:0/1949323557 >> v2:172.21.15.103:3300/0 conn(0x7f15e80ac950 0x7f15e8157d30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f15e8153e00 tx=0x7f15d80109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:58.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.864+0000 7f15ecba3700 1 --2- 172.21.15.103:0/1949323557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15e80ac950 0x7f15e8157d30 secure :-1 s=READY pgs=1336 cs=0 l=1 rx=0x7f15e8153e00 tx=0x7f15d80109b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:58.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.864+0000 7f15ecba3700 1 --2- 172.21.15.103:0/1949323557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15e80ac950 0x7f15e8157d30 secure :-1 s=THROTTLE_DONE pgs=1336 cs=0 l=1 rx=0x7f15e8153e00 tx=0x7f15d80109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:58.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.864+0000 7f15ecba3700 1 --2- 172.21.15.103:0/1949323557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15e80ac950 0x7f15e8157d30 secure :-1 s=THROTTLE_DONE pgs=1336 cs=0 l=1 rx=0x7f15e8153e00 tx=0x7f15d80109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:58.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.864+0000 7f15ecba3700 1 --2- 172.21.15.103:0/1949323557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15e80ac950 0x7f15e8157d30 secure :-1 s=THROTTLE_DONE pgs=1336 cs=0 l=1 rx=0x7f15e8153e00 tx=0x7f15d80109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:58.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.864+0000 7f15e5ffb700 1 -- 172.21.15.103:0/1949323557 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15d8005ca0 con 0x7f15e80ac950 2020-04-22T14:13:58.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.864+0000 7f15e5ffb700 1 -- 172.21.15.103:0/1949323557 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d8005e00 con 0x7f15e80ac950 2020-04-22T14:13:58.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.864+0000 7f15eee07700 1 -- 172.21.15.103:0/1949323557 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15e8142960 con 0x7f15e80ac950 2020-04-22T14:13:58.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.864+0000 7f15e5ffb700 1 -- 172.21.15.103:0/1949323557 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15d80062c0 con 0x7f15e80ac950 2020-04-22T14:13:58.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.864+0000 7f15eee07700 1 -- 172.21.15.103:0/1949323557 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15e80b4170 con 0x7f15e80ac950 2020-04-22T14:13:58.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.865+0000 7f15ecba3700 1 --2- 172.21.15.103:0/1949323557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15e80ac950 0x7f15e8157d30 secure :-1 s=THROTTLE_DONE pgs=1336 cs=0 l=1 rx=0x7f15e8153e00 tx=0x7f15d80109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:58.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.865+0000 7f15eee07700 1 -- 172.21.15.103:0/1949323557 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15e80b1b80 con 0x7f15e80ac950 2020-04-22T14:13:58.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.865+0000 7f15e5ffb700 1 -- 172.21.15.103:0/1949323557 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f15d8006420 con 0x7f15e80ac950 2020-04-22T14:13:58.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.865+0000 7f15ecba3700 1 --2- 172.21.15.103:0/1949323557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15e80ac950 0x7f15e8157d30 secure :-1 s=THROTTLE_DONE pgs=1336 cs=0 l=1 rx=0x7f15e8153e00 tx=0x7f15d80109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:58.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.865+0000 7f15e5ffb700 1 --2- 172.21.15.103:0/1949323557 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f15c804d840 0x7f15c804fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:58.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.865+0000 7f15e5ffb700 1 -- 172.21.15.103:0/1949323557 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f15d80090c0 con 0x7f15e80ac950 2020-04-22T14:13:58.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.865+0000 7f15e7fff700 1 --2- 172.21.15.103:0/1949323557 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f15c804d840 0x7f15c804fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:58.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.866+0000 7f15e7fff700 1 --2- 172.21.15.103:0/1949323557 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f15c804d840 0x7f15c804fd00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f15dc007a40 tx=0x7f15dc008ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:58.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.866+0000 7f15e7fff700 1 --2- 172.21.15.103:0/1949323557 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f15c804d840 0x7f15c804fd00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f15dc007a40 tx=0x7f15dc008ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:58.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.866+0000 7f15e7fff700 1 --2- 172.21.15.103:0/1949323557 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f15c804d840 0x7f15c804fd00 secure :-1 s=READY pgs=489 cs=0 l=1 rx=0x7f15dc007a40 tx=0x7f15dc008ea0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:58.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.869+0000 7f15ecba3700 1 --2- 172.21.15.103:0/1949323557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15e80ac950 0x7f15e8157d30 secure :-1 s=THROTTLE_DONE pgs=1336 cs=0 l=1 rx=0x7f15e8153e00 tx=0x7f15d80109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:58.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:58.870+0000 7f15e5ffb700 1 -- 172.21.15.103:0/1949323557 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f15e80b1b80 con 0x7f15e80ac950 2020-04-22T14:13:59.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.059+0000 7f15eee07700 1 -- 172.21.15.103:0/1949323557 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f15e80b1b80 con 0x7f15e80ac950 2020-04-22T14:13:59.070 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.067+0000 7f15ecba3700 1 --2- 172.21.15.103:0/1949323557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15e80ac950 0x7f15e8157d30 secure :-1 s=THROTTLE_DONE pgs=1336 cs=0 l=1 rx=0x7f15e8153e00 tx=0x7f15d80109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.070 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.067+0000 7f15e5ffb700 1 -- 172.21.15.103:0/1949323557 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 15 and data pool 16 v61) v1 ==== 189+0+0 (secure 0 0 0) 0x7f15e80b1b80 con 0x7f15e80ac950 2020-04-22T14:13:59.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.069+0000 7f15eee07700 1 -- 172.21.15.103:0/1949323557 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f15c804d840 msgr2=0x7f15c804fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:59.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.069+0000 7f15eee07700 1 --2- 172.21.15.103:0/1949323557 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f15c804d840 0x7f15c804fd00 secure :-1 s=READY pgs=489 cs=0 l=1 rx=0x7f15dc007a40 tx=0x7f15dc008ea0).stop 2020-04-22T14:13:59.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.069+0000 7f15eee07700 1 -- 172.21.15.103:0/1949323557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15e80ac950 msgr2=0x7f15e8157d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:59.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.069+0000 7f15eee07700 1 --2- 172.21.15.103:0/1949323557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15e80ac950 0x7f15e8157d30 secure :-1 s=READY pgs=1336 cs=0 l=1 rx=0x7f15e8153e00 tx=0x7f15d80109b0).stop 2020-04-22T14:13:59.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.070+0000 7f15eee07700 1 -- 172.21.15.103:0/1949323557 shutdown_connections 2020-04-22T14:13:59.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.070+0000 7f15eee07700 1 --2- 172.21.15.103:0/1949323557 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f15c804d840 0x7f15c804fd00 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:59.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.070+0000 7f15eee07700 1 --2- 172.21.15.103:0/1949323557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15e80ac950 0x7f15e8157d30 secure :-1 s=CLOSED pgs=1336 cs=0 l=1 rx=0x7f15e8153e00 tx=0x7f15d80109b0).stop 2020-04-22T14:13:59.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.070+0000 7f15eee07700 1 -- 172.21.15.103:0/1949323557 >> 172.21.15.103:0/1949323557 conn(0x7f15e805b7b0 msgr2=0x7f15e8129730 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:59.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.070+0000 7f15eee07700 1 -- 172.21.15.103:0/1949323557 shutdown_connections 2020-04-22T14:13:59.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.071+0000 7f15eee07700 1 -- 172.21.15.103:0/1949323557 wait complete. 2020-04-22T14:13:59.077 INFO:teuthology.orchestra.run.smithi103.stderr:new fs with metadata pool 15 and data pool 16 2020-04-22T14:13:59.090 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:59.103 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:13:59.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.247+0000 7f0a0df53700 1 Processor -- start 2020-04-22T14:13:59.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.247+0000 7f0a0df53700 1 -- start start 2020-04-22T14:13:59.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.248+0000 7f0a0df53700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0a0812c0d0 0x7f0a081464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:59.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.248+0000 7f0a0df53700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a08063e30 0x7f0a080642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:59.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.248+0000 7f0a0df53700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a08143300 con 0x7f0a08065fe0 2020-04-22T14:13:59.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.248+0000 7f0a0df53700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a081435a0 con 0x7f0a0812c0d0 2020-04-22T14:13:59.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.248+0000 7f0a0df53700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a08143840 con 0x7f0a08063e30 2020-04-22T14:13:59.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.248+0000 7f0a07fff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a08063e30 0x7f0a080642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:59.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.248+0000 7f0a077fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0a0812c0d0 0x7f0a081464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:59.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.248+0000 7f0a07fff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a08063e30 0x7f0a080642c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:39012/0 (socket says 172.21.15.103:39012) 2020-04-22T14:13:59.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.248+0000 7f0a077fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0a0812c0d0 0x7f0a081464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:51466/0 (socket says 172.21.15.103:51466) 2020-04-22T14:13:59.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.248+0000 7f0a07fff700 1 -- 172.21.15.103:0/2246539776 learned_addr learned my addr 172.21.15.103:0/2246539776 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:59.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.248+0000 7f0a06ffd700 1 --1- 172.21.15.103:0/2246539776 >> v1:172.21.15.86:6789/0 conn(0x7f0a08065fe0 0x7f0a0805b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:35348/0 (socket says 172.21.15.103:35348) 2020-04-22T14:13:59.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.249+0000 7f0a07fff700 1 -- 172.21.15.103:0/2246539776 >> v2:172.21.15.86:3300/0 conn(0x7f0a0812c0d0 msgr2=0x7f0a081464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:59.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.249+0000 7f0a07fff700 1 --2- 172.21.15.103:0/2246539776 >> v2:172.21.15.86:3300/0 conn(0x7f0a0812c0d0 0x7f0a081464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:59.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.249+0000 7f0a07fff700 1 -- 172.21.15.103:0/2246539776 >> v1:172.21.15.86:6789/0 conn(0x7f0a08065fe0 legacy=0x7f0a0805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:59.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.249+0000 7f0a07fff700 1 -- 172.21.15.103:0/2246539776 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0805bb50 con 0x7f0a08063e30 2020-04-22T14:13:59.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.249+0000 7f0a07fff700 1 --2- 172.21.15.103:0/2246539776 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a08063e30 0x7f0a080642c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0a000032b0 tx=0x7f0a00007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.249+0000 7f0a07fff700 1 --2- 172.21.15.103:0/2246539776 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a08063e30 0x7f0a080642c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0a000032b0 tx=0x7f0a00007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.249+0000 7f0a07fff700 1 --2- 172.21.15.103:0/2246539776 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a08063e30 0x7f0a080642c0 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7f0a000032b0 tx=0x7f0a00007dc0).ready entity=mon.2 client_cookie=e77bfe945d21125c server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:59.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.249+0000 7f0a07fff700 1 --2- 172.21.15.103:0/2246539776 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a08063e30 0x7f0a080642c0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f0a000032b0 tx=0x7f0a00007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.249+0000 7f0a067fc700 1 -- 172.21.15.103:0/2246539776 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a0000a180 con 0x7f0a08063e30 2020-04-22T14:13:59.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.249+0000 7f0a07fff700 1 --2- 172.21.15.103:0/2246539776 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a08063e30 0x7f0a080642c0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f0a000032b0 tx=0x7f0a00007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.249+0000 7f0a067fc700 1 -- 172.21.15.103:0/2246539776 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0000a320 con 0x7f0a08063e30 2020-04-22T14:13:59.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.249+0000 7f0a07fff700 1 --2- 172.21.15.103:0/2246539776 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a08063e30 0x7f0a080642c0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f0a000032b0 tx=0x7f0a00007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.249+0000 7f0a067fc700 1 -- 172.21.15.103:0/2246539776 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a0000a740 con 0x7f0a08063e30 2020-04-22T14:13:59.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.249+0000 7f0a0df53700 1 -- 172.21.15.103:0/2246539776 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a08063e30 msgr2=0x7f0a080642c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:59.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.249+0000 7f0a0df53700 1 --2- 172.21.15.103:0/2246539776 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a08063e30 0x7f0a080642c0 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7f0a000032b0 tx=0x7f0a00007dc0).stop 2020-04-22T14:13:59.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.249+0000 7f0a0df53700 1 -- 172.21.15.103:0/2246539776 shutdown_connections 2020-04-22T14:13:59.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.249+0000 7f0a0df53700 1 --2- 172.21.15.103:0/2246539776 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a08063e30 0x7f0a080642c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:59.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.249+0000 7f0a0df53700 1 --2- 172.21.15.103:0/2246539776 >> v2:172.21.15.86:3300/0 conn(0x7f0a0812c0d0 0x7f0a081464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:59.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.249+0000 7f0a0df53700 1 -- 172.21.15.103:0/2246539776 >> 172.21.15.103:0/2246539776 conn(0x7f0a080b9160 msgr2=0x7f0a0805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:59.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.249+0000 7f0a0df53700 1 -- 172.21.15.103:0/2246539776 shutdown_connections 2020-04-22T14:13:59.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.249+0000 7f0a0df53700 1 -- 172.21.15.103:0/2246539776 wait complete. 2020-04-22T14:13:59.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.250+0000 7f0a0df53700 1 Processor -- start 2020-04-22T14:13:59.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.251+0000 7f0a0df53700 1 -- start start 2020-04-22T14:13:59.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.251+0000 7f0a0df53700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0a08063e30 0x7f0a080ae9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:59.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.251+0000 7f0a0df53700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a08065fe0 0x7f0a08153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:59.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.251+0000 7f0a0df53700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a080aeee0 con 0x7f0a0812c0d0 2020-04-22T14:13:59.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.251+0000 7f0a0df53700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a080af180 con 0x7f0a08063e30 2020-04-22T14:13:59.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.251+0000 7f0a0df53700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a080af420 con 0x7f0a08065fe0 2020-04-22T14:13:59.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.251+0000 7f0a07fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f0a0812c0d0 0x7f0a08128a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46434/0 (socket says 172.21.15.103:46434) 2020-04-22T14:13:59.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.251+0000 7f0a07fff700 1 -- 172.21.15.103:0/4154002062 learned_addr learned my addr 172.21.15.103:0/4154002062 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:59.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.251+0000 7f0a06ffd700 1 --2- 172.21.15.103:0/4154002062 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a08065fe0 0x7f0a08153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:59.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.252+0000 7f0a077fe700 1 --2- 172.21.15.103:0/4154002062 >> v2:172.21.15.86:3300/0 conn(0x7f0a08063e30 0x7f0a080ae9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:59.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.252+0000 7f0a04ff9700 1 -- 172.21.15.103:0/4154002062 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3838641447 0 0) 0x7f0a080aeee0 con 0x7f0a0812c0d0 2020-04-22T14:13:59.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.252+0000 7f0a04ff9700 1 -- 172.21.15.103:0/4154002062 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09e8002fe0 con 0x7f0a0812c0d0 2020-04-22T14:13:59.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.252+0000 7f0a04ff9700 1 -- 172.21.15.103:0/4154002062 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3100358639 0 0) 0x7f09e8002fe0 con 0x7f0a0812c0d0 2020-04-22T14:13:59.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.252+0000 7f0a04ff9700 1 -- 172.21.15.103:0/4154002062 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0a080aeee0 con 0x7f0a0812c0d0 2020-04-22T14:13:59.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.252+0000 7f0a04ff9700 1 -- 172.21.15.103:0/4154002062 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f0a0000ae10 con 0x7f0a0812c0d0 2020-04-22T14:13:59.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.252+0000 7f0a04ff9700 1 -- 172.21.15.103:0/4154002062 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a08065fe0 msgr2=0x7f0a08153b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:59.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.252+0000 7f0a04ff9700 1 --2- 172.21.15.103:0/4154002062 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a08065fe0 0x7f0a08153b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:59.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.252+0000 7f0a04ff9700 1 -- 172.21.15.103:0/4154002062 >> v2:172.21.15.86:3300/0 conn(0x7f0a08063e30 msgr2=0x7f0a080ae9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:59.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.252+0000 7f0a04ff9700 1 --2- 172.21.15.103:0/4154002062 >> v2:172.21.15.86:3300/0 conn(0x7f0a08063e30 0x7f0a080ae9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:59.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.252+0000 7f0a04ff9700 1 -- 172.21.15.103:0/4154002062 >> v1:172.21.15.103:6789/0 conn(0x7f0a0812c0d0 legacy=0x7f0a08128a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:59.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.252+0000 7f0a04ff9700 1 --2- 172.21.15.103:0/4154002062 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f09e80049b0 0x7f09e8004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:59.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.252+0000 7f0a04ff9700 1 --2- 172.21.15.103:0/4154002062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09e8005250 0x7f09e8003960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:59.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.252+0000 7f0a04ff9700 1 --2- 172.21.15.103:0/4154002062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09e8003ed0 0x7f09e8004310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:59.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.252+0000 7f0a04ff9700 1 -- 172.21.15.103:0/4154002062 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a080af180 con 0x7f09e8005250 2020-04-22T14:13:59.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.252+0000 7f0a04ff9700 1 -- 172.21.15.103:0/4154002062 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a080af420 con 0x7f09e8003ed0 2020-04-22T14:13:59.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.252+0000 7f0a04ff9700 1 -- 172.21.15.103:0/4154002062 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e800b890 con 0x7f09e80049b0 2020-04-22T14:13:59.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.252+0000 7f0a06ffd700 1 --2- 172.21.15.103:0/4154002062 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0a08065fe0 0x7f0a08153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:13:59.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.252+0000 7f0a07fff700 1 --2- 172.21.15.103:0/4154002062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09e8003ed0 0x7f09e8004310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:59.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.252+0000 7f0a077fe700 1 --2- 172.21.15.103:0/4154002062 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f09e80049b0 0x7f09e8004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:59.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.252+0000 7f0a06ffd700 1 --2- 172.21.15.103:0/4154002062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09e8005250 0x7f09e8003960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:59.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.252+0000 7f0a07fff700 1 -- 172.21.15.103:0/4154002062 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f09e80049b0 msgr2=0x7f09e8004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:59.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.252+0000 7f0a07fff700 1 --2- 172.21.15.103:0/4154002062 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f09e80049b0 0x7f09e8004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:59.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.252+0000 7f0a07fff700 1 -- 172.21.15.103:0/4154002062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09e8005250 msgr2=0x7f09e8003960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:59.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.252+0000 7f0a07fff700 1 --2- 172.21.15.103:0/4154002062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09e8005250 0x7f09e8003960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:59.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.252+0000 7f0a07fff700 1 -- 172.21.15.103:0/4154002062 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a080ace20 con 0x7f09e8003ed0 2020-04-22T14:13:59.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.252+0000 7f0a0df53700 1 -- 172.21.15.103:0/4154002062 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a08129130 con 0x7f09e8003ed0 2020-04-22T14:13:59.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.252+0000 7f0a06ffd700 1 --2- 172.21.15.103:0/4154002062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f09e8005250 0x7f09e8003960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:13:59.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.252+0000 7f0a07fff700 1 --2- 172.21.15.103:0/4154002062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09e8003ed0 0x7f09e8004310 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0a000105d0 tx=0x7f0a00007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.252+0000 7f0a0df53700 1 -- 172.21.15.103:0/4154002062 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a080afb00 con 0x7f09e8003ed0 2020-04-22T14:13:59.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.252+0000 7f0a07fff700 1 --2- 172.21.15.103:0/4154002062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09e8003ed0 0x7f09e8004310 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0a000105d0 tx=0x7f0a00007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.252+0000 7f0a07fff700 1 --2- 172.21.15.103:0/4154002062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09e8003ed0 0x7f09e8004310 secure :-1 s=READY pgs=1338 cs=0 l=1 rx=0x7f0a000105d0 tx=0x7f0a00007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:59.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.253+0000 7f0a07fff700 1 --2- 172.21.15.103:0/4154002062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09e8003ed0 0x7f09e8004310 secure :-1 s=THROTTLE_DONE pgs=1338 cs=0 l=1 rx=0x7f0a000105d0 tx=0x7f0a00007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.253+0000 7f0a04ff9700 1 -- 172.21.15.103:0/4154002062 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a00005c30 con 0x7f09e8003ed0 2020-04-22T14:13:59.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.253+0000 7f0a07fff700 1 --2- 172.21.15.103:0/4154002062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09e8003ed0 0x7f09e8004310 secure :-1 s=THROTTLE_DONE pgs=1338 cs=0 l=1 rx=0x7f0a000105d0 tx=0x7f0a00007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.253+0000 7f0a04ff9700 1 -- 172.21.15.103:0/4154002062 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a00005d90 con 0x7f09e8003ed0 2020-04-22T14:13:59.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.253+0000 7f0a07fff700 1 --2- 172.21.15.103:0/4154002062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09e8003ed0 0x7f09e8004310 secure :-1 s=THROTTLE_DONE pgs=1338 cs=0 l=1 rx=0x7f0a000105d0 tx=0x7f0a00007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.253+0000 7f0a04ff9700 1 -- 172.21.15.103:0/4154002062 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a00007360 con 0x7f09e8003ed0 2020-04-22T14:13:59.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.253+0000 7f0a07fff700 1 --2- 172.21.15.103:0/4154002062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09e8003ed0 0x7f09e8004310 secure :-1 s=THROTTLE_DONE pgs=1338 cs=0 l=1 rx=0x7f0a000105d0 tx=0x7f0a00007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.253+0000 7f0a0df53700 1 -- 172.21.15.103:0/4154002062 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09e4003340 con 0x7f09e8003ed0 2020-04-22T14:13:59.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.254+0000 7f0a04ff9700 1 -- 172.21.15.103:0/4154002062 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f0a000074c0 con 0x7f09e8003ed0 2020-04-22T14:13:59.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.254+0000 7f0a07fff700 1 --2- 172.21.15.103:0/4154002062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09e8003ed0 0x7f09e8004310 secure :-1 s=THROTTLE_DONE pgs=1338 cs=0 l=1 rx=0x7f0a000105d0 tx=0x7f0a00007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.254+0000 7f0a04ff9700 1 --2- 172.21.15.103:0/4154002062 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f09e8055fb0 0x7f09e8058470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:59.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.254+0000 7f0a04ff9700 1 -- 172.21.15.103:0/4154002062 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0a00062960 con 0x7f09e8003ed0 2020-04-22T14:13:59.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.254+0000 7f0a077fe700 1 --2- 172.21.15.103:0/4154002062 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f09e8055fb0 0x7f09e8058470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:59.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.254+0000 7f0a077fe700 1 --2- 172.21.15.103:0/4154002062 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f09e8055fb0 0x7f09e8058470 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f09f8002f30 tx=0x7f09f800efa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.254+0000 7f0a077fe700 1 --2- 172.21.15.103:0/4154002062 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f09e8055fb0 0x7f09e8058470 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f09f8002f30 tx=0x7f09f800efa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.254+0000 7f0a077fe700 1 --2- 172.21.15.103:0/4154002062 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f09e8055fb0 0x7f09e8058470 secure :-1 s=READY pgs=490 cs=0 l=1 rx=0x7f09f8002f30 tx=0x7f09f800efa0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:59.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.258+0000 7f0a07fff700 1 --2- 172.21.15.103:0/4154002062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09e8003ed0 0x7f09e8004310 secure :-1 s=THROTTLE_DONE pgs=1338 cs=0 l=1 rx=0x7f0a000105d0 tx=0x7f0a00007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.258+0000 7f0a04ff9700 1 -- 172.21.15.103:0/4154002062 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f0a0003de60 con 0x7f09e8003ed0 2020-04-22T14:13:59.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.403+0000 7f0a0df53700 1 -- 172.21.15.103:0/4154002062 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09e40021d0 con 0x7f09e8003ed0 2020-04-22T14:13:59.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.404+0000 7f0a07fff700 1 --2- 172.21.15.103:0/4154002062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09e8003ed0 0x7f09e8004310 secure :-1 s=THROTTLE_DONE pgs=1338 cs=0 l=1 rx=0x7f0a000105d0 tx=0x7f0a00007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.404+0000 7f0a04ff9700 1 -- 172.21.15.103:0/4154002062 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+16105 (secure 0 0 0) 0x7f0a00041480 con 0x7f09e8003ed0 2020-04-22T14:13:59.408 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:13:59.408 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":89,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:13:59.062332+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:13:56.741291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2020-04-22T14:13:57.809563+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:13:59.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.406+0000 7f0a0df53700 1 -- 172.21.15.103:0/4154002062 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f09e8055fb0 msgr2=0x7f09e8058470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:59.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.406+0000 7f0a0df53700 1 --2- 172.21.15.103:0/4154002062 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f09e8055fb0 0x7f09e8058470 secure :-1 s=READY pgs=490 cs=0 l=1 rx=0x7f09f8002f30 tx=0x7f09f800efa0).stop 2020-04-22T14:13:59.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.406+0000 7f0a0df53700 1 -- 172.21.15.103:0/4154002062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09e8003ed0 msgr2=0x7f09e8004310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:59.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.406+0000 7f0a0df53700 1 --2- 172.21.15.103:0/4154002062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09e8003ed0 0x7f09e8004310 secure :-1 s=READY pgs=1338 cs=0 l=1 rx=0x7f0a000105d0 tx=0x7f0a00007dc0).stop 2020-04-22T14:13:59.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.406+0000 7f0a07fff700 1 -- 172.21.15.103:0/4154002062 reap_dead start 2020-04-22T14:13:59.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.406+0000 7f0a0df53700 1 -- 172.21.15.103:0/4154002062 shutdown_connections 2020-04-22T14:13:59.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.406+0000 7f0a0df53700 1 --2- 172.21.15.103:0/4154002062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09e8003ed0 0x7f09e8004310 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:59.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.406+0000 7f0a0df53700 1 -- 172.21.15.103:0/4154002062 >> 172.21.15.103:0/4154002062 conn(0x7f0a080b9160 msgr2=0x7f0a080b4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:59.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.406+0000 7f0a0df53700 1 -- 172.21.15.103:0/4154002062 shutdown_connections 2020-04-22T14:13:59.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.406+0000 7f0a0df53700 1 -- 172.21.15.103:0/4154002062 wait complete. 2020-04-22T14:13:59.420 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:59.434 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:13:59.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.578+0000 7ff95923b700 1 Processor -- start 2020-04-22T14:13:59.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.578+0000 7ff95923b700 1 -- start start 2020-04-22T14:13:59.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.579+0000 7ff95923b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff95412c0d0 0x7ff9541464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:59.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.579+0000 7ff95923b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff954065fe0 0x7ff95405b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:59.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.579+0000 7ff95923b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff954143300 con 0x7ff95405b8a0 2020-04-22T14:13:59.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.579+0000 7ff95923b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff95412c4b0 con 0x7ff954065fe0 2020-04-22T14:13:59.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.579+0000 7ff95923b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9541435a0 con 0x7ff95412c0d0 2020-04-22T14:13:59.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.579+0000 7ff95259c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff954065fe0 0x7ff95405b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:59.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.579+0000 7ff952d9d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff95412c0d0 0x7ff9541464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:59.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.579+0000 7ff95359e700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7ff95405b8a0 0x7ff954062ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:35368/0 (socket says 172.21.15.103:35368) 2020-04-22T14:13:59.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.579+0000 7ff95359e700 1 -- 172.21.15.103:0/3526079095 learned_addr learned my addr 172.21.15.103:0/3526079095 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:13:59.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.579+0000 7ff952d9d700 1 --2- 172.21.15.103:0/3526079095 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff95412c0d0 0x7ff9541464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:39032/0 (socket says 172.21.15.103:39032) 2020-04-22T14:13:59.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.580+0000 7ff952d9d700 1 -- 172.21.15.103:0/3526079095 >> v2:172.21.15.86:3300/0 conn(0x7ff954065fe0 msgr2=0x7ff95405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:59.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.580+0000 7ff952d9d700 1 --2- 172.21.15.103:0/3526079095 >> v2:172.21.15.86:3300/0 conn(0x7ff954065fe0 0x7ff95405b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:59.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.580+0000 7ff952d9d700 1 -- 172.21.15.103:0/3526079095 >> v1:172.21.15.86:6789/0 conn(0x7ff95405b8a0 legacy=0x7ff954062ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:59.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.580+0000 7ff952d9d700 1 -- 172.21.15.103:0/3526079095 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff954143840 con 0x7ff95412c0d0 2020-04-22T14:13:59.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.580+0000 7ff952d9d700 1 --2- 172.21.15.103:0/3526079095 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff95412c0d0 0x7ff9541464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff944002f30 tx=0x7ff944007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.580+0000 7ff952d9d700 1 --2- 172.21.15.103:0/3526079095 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff95412c0d0 0x7ff9541464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff944002f30 tx=0x7ff944007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.580+0000 7ff952d9d700 1 --2- 172.21.15.103:0/3526079095 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff95412c0d0 0x7ff9541464e0 secure :-1 s=READY pgs=126 cs=0 l=1 rx=0x7ff944002f30 tx=0x7ff944007a40).ready entity=mon.2 client_cookie=98ffd649a49e37e0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:59.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.580+0000 7ff952d9d700 1 --2- 172.21.15.103:0/3526079095 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff95412c0d0 0x7ff9541464e0 secure :-1 s=THROTTLE_DONE pgs=126 cs=0 l=1 rx=0x7ff944002f30 tx=0x7ff944007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.580+0000 7ff951d9b700 1 -- 172.21.15.103:0/3526079095 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9440113c0 con 0x7ff95412c0d0 2020-04-22T14:13:59.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.580+0000 7ff952d9d700 1 --2- 172.21.15.103:0/3526079095 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff95412c0d0 0x7ff9541464e0 secure :-1 s=THROTTLE_DONE pgs=126 cs=0 l=1 rx=0x7ff944002f30 tx=0x7ff944007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.580+0000 7ff952d9d700 1 --2- 172.21.15.103:0/3526079095 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff95412c0d0 0x7ff9541464e0 secure :-1 s=THROTTLE_DONE pgs=126 cs=0 l=1 rx=0x7ff944002f30 tx=0x7ff944007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.580+0000 7ff951d9b700 1 -- 172.21.15.103:0/3526079095 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff944011560 con 0x7ff95412c0d0 2020-04-22T14:13:59.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.580+0000 7ff951d9b700 1 -- 172.21.15.103:0/3526079095 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff944011980 con 0x7ff95412c0d0 2020-04-22T14:13:59.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.580+0000 7ff95923b700 1 -- 172.21.15.103:0/3526079095 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff95412c0d0 msgr2=0x7ff9541464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:59.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.580+0000 7ff95923b700 1 --2- 172.21.15.103:0/3526079095 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff95412c0d0 0x7ff9541464e0 secure :-1 s=READY pgs=126 cs=0 l=1 rx=0x7ff944002f30 tx=0x7ff944007a40).stop 2020-04-22T14:13:59.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.581+0000 7ff95923b700 1 -- 172.21.15.103:0/3526079095 shutdown_connections 2020-04-22T14:13:59.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.581+0000 7ff95923b700 1 --2- 172.21.15.103:0/3526079095 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff95412c0d0 0x7ff9541464e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:59.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.581+0000 7ff95923b700 1 --2- 172.21.15.103:0/3526079095 >> v2:172.21.15.86:3300/0 conn(0x7ff954065fe0 0x7ff95405b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:59.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.581+0000 7ff95923b700 1 -- 172.21.15.103:0/3526079095 >> 172.21.15.103:0/3526079095 conn(0x7ff9540b9160 msgr2=0x7ff95405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:59.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.581+0000 7ff95923b700 1 -- 172.21.15.103:0/3526079095 shutdown_connections 2020-04-22T14:13:59.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.581+0000 7ff95923b700 1 -- 172.21.15.103:0/3526079095 wait complete. 2020-04-22T14:13:59.591 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.582+0000 7ff95923b700 1 Processor -- start 2020-04-22T14:13:59.591 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.582+0000 7ff95923b700 1 -- start start 2020-04-22T14:13:59.591 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.582+0000 7ff95923b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff95405b8a0 0x7ff954111680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:59.591 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.582+0000 7ff95923b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff95412c0d0 0x7ff95412a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:59.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.582+0000 7ff95923b700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9540adeb0 con 0x7ff954065fe0 2020-04-22T14:13:59.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.582+0000 7ff95923b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9540ae150 con 0x7ff95405b8a0 2020-04-22T14:13:59.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.582+0000 7ff95923b700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9540ae3f0 con 0x7ff95412c0d0 2020-04-22T14:13:59.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.582+0000 7ff95359e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff95412c0d0 0x7ff95412a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:59.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.582+0000 7ff95359e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff95412c0d0 0x7ff95412a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54262/0 (socket says 172.21.15.103:54262) 2020-04-22T14:13:59.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.582+0000 7ff95359e700 1 -- 172.21.15.103:0/3458696636 learned_addr learned my addr 172.21.15.103:0/3458696636 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:59.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.582+0000 7ff95259c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff954065fe0 0x7ff9540b3480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46450/0 (socket says 172.21.15.103:46450) 2020-04-22T14:13:59.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.582+0000 7ff952d9d700 1 --2- 172.21.15.103:0/3458696636 >> v2:172.21.15.86:3300/0 conn(0x7ff95405b8a0 0x7ff954111680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:59.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.583+0000 7ff95359e700 1 -- 172.21.15.103:0/3458696636 >> v2:172.21.15.86:3300/0 conn(0x7ff95405b8a0 msgr2=0x7ff954111680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:59.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.583+0000 7ff95359e700 1 --2- 172.21.15.103:0/3458696636 >> v2:172.21.15.86:3300/0 conn(0x7ff95405b8a0 0x7ff954111680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:59.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.583+0000 7ff95359e700 1 -- 172.21.15.103:0/3458696636 >> v1:172.21.15.103:6789/0 conn(0x7ff954065fe0 legacy=0x7ff9540b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:59.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.583+0000 7ff94bfff700 1 -- 172.21.15.103:0/3458696636 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1123565650 0 0) 0x7ff9540adeb0 con 0x7ff954065fe0 2020-04-22T14:13:59.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.583+0000 7ff95359e700 1 -- 172.21.15.103:0/3458696636 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9540b5b50 con 0x7ff95412c0d0 2020-04-22T14:13:59.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.583+0000 7ff95359e700 1 --2- 172.21.15.103:0/3458696636 >> v2:172.21.15.103:3300/0 conn(0x7ff95412c0d0 0x7ff95412a440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff9540669a0 tx=0x7ff94c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.583+0000 7ff95359e700 1 --2- 172.21.15.103:0/3458696636 >> v2:172.21.15.103:3300/0 conn(0x7ff95412c0d0 0x7ff95412a440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff9540669a0 tx=0x7ff94c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.583+0000 7ff95359e700 1 --2- 172.21.15.103:0/3458696636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff95412c0d0 0x7ff95412a440 secure :-1 s=READY pgs=1340 cs=0 l=1 rx=0x7ff9540669a0 tx=0x7ff94c010c50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:59.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.583+0000 7ff95359e700 1 --2- 172.21.15.103:0/3458696636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff95412c0d0 0x7ff95412a440 secure :-1 s=THROTTLE_DONE pgs=1340 cs=0 l=1 rx=0x7ff9540669a0 tx=0x7ff94c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.583+0000 7ff94bfff700 1 -- 172.21.15.103:0/3458696636 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff94c0122f0 con 0x7ff95412c0d0 2020-04-22T14:13:59.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.583+0000 7ff95359e700 1 --2- 172.21.15.103:0/3458696636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff95412c0d0 0x7ff95412a440 secure :-1 s=THROTTLE_DONE pgs=1340 cs=0 l=1 rx=0x7ff9540669a0 tx=0x7ff94c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.583+0000 7ff95359e700 1 --2- 172.21.15.103:0/3458696636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff95412c0d0 0x7ff95412a440 secure :-1 s=THROTTLE_DONE pgs=1340 cs=0 l=1 rx=0x7ff9540669a0 tx=0x7ff94c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.583+0000 7ff94bfff700 1 -- 172.21.15.103:0/3458696636 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94c012490 con 0x7ff95412c0d0 2020-04-22T14:13:59.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.583+0000 7ff94bfff700 1 -- 172.21.15.103:0/3458696636 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff94c012870 con 0x7ff95412c0d0 2020-04-22T14:13:59.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.583+0000 7ff95923b700 1 -- 172.21.15.103:0/3458696636 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9540adac0 con 0x7ff95412c0d0 2020-04-22T14:13:59.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.583+0000 7ff95923b700 1 -- 172.21.15.103:0/3458696636 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9540b3d50 con 0x7ff95412c0d0 2020-04-22T14:13:59.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.584+0000 7ff95359e700 1 --2- 172.21.15.103:0/3458696636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff95412c0d0 0x7ff95412a440 secure :-1 s=THROTTLE_DONE pgs=1340 cs=0 l=1 rx=0x7ff9540669a0 tx=0x7ff94c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.584+0000 7ff95923b700 1 -- 172.21.15.103:0/3458696636 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff954056c90 con 0x7ff95412c0d0 2020-04-22T14:13:59.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.584+0000 7ff94bfff700 1 -- 172.21.15.103:0/3458696636 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ff94c012a70 con 0x7ff95412c0d0 2020-04-22T14:13:59.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.584+0000 7ff95359e700 1 --2- 172.21.15.103:0/3458696636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff95412c0d0 0x7ff95412a440 secure :-1 s=THROTTLE_DONE pgs=1340 cs=0 l=1 rx=0x7ff9540669a0 tx=0x7ff94c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.584+0000 7ff94bfff700 1 --2- 172.21.15.103:0/3458696636 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff93804d7b0 0x7ff93804fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:59.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.584+0000 7ff94bfff700 1 -- 172.21.15.103:0/3458696636 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff94c0090c0 con 0x7ff95412c0d0 2020-04-22T14:13:59.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.584+0000 7ff952d9d700 1 --2- 172.21.15.103:0/3458696636 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff93804d7b0 0x7ff93804fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:59.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.585+0000 7ff952d9d700 1 --2- 172.21.15.103:0/3458696636 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff93804d7b0 0x7ff93804fc70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff944002f30 tx=0x7ff944007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.585+0000 7ff952d9d700 1 --2- 172.21.15.103:0/3458696636 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff93804d7b0 0x7ff93804fc70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff944002f30 tx=0x7ff944007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.585+0000 7ff952d9d700 1 --2- 172.21.15.103:0/3458696636 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff93804d7b0 0x7ff93804fc70 secure :-1 s=READY pgs=491 cs=0 l=1 rx=0x7ff944002f30 tx=0x7ff944007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:59.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.588+0000 7ff95359e700 1 --2- 172.21.15.103:0/3458696636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff95412c0d0 0x7ff95412a440 secure :-1 s=THROTTLE_DONE pgs=1340 cs=0 l=1 rx=0x7ff9540669a0 tx=0x7ff94c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.588+0000 7ff94bfff700 1 -- 172.21.15.103:0/3458696636 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ff94c03cee0 con 0x7ff95412c0d0 2020-04-22T14:13:59.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.733+0000 7ff95923b700 1 -- 172.21.15.103:0/3458696636 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff954146ff0 con 0x7ff95412c0d0 2020-04-22T14:13:59.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.734+0000 7ff95359e700 1 --2- 172.21.15.103:0/3458696636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff95412c0d0 0x7ff95412a440 secure :-1 s=THROTTLE_DONE pgs=1340 cs=0 l=1 rx=0x7ff9540669a0 tx=0x7ff94c010c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.734+0000 7ff94bfff700 1 -- 172.21.15.103:0/3458696636 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+16105 (secure 0 0 0) 0x7ff94c040500 con 0x7ff95412c0d0 2020-04-22T14:13:59.738 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:13:59.738 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":89,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:13:59.062332+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:13:56.741291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2020-04-22T14:13:57.809563+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:13:59.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.736+0000 7ff95923b700 1 -- 172.21.15.103:0/3458696636 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff93804d7b0 msgr2=0x7ff93804fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:59.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.736+0000 7ff95923b700 1 --2- 172.21.15.103:0/3458696636 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff93804d7b0 0x7ff93804fc70 secure :-1 s=READY pgs=491 cs=0 l=1 rx=0x7ff944002f30 tx=0x7ff944007a40).stop 2020-04-22T14:13:59.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.736+0000 7ff95923b700 1 -- 172.21.15.103:0/3458696636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff95412c0d0 msgr2=0x7ff95412a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:59.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.736+0000 7ff95923b700 1 --2- 172.21.15.103:0/3458696636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff95412c0d0 0x7ff95412a440 secure :-1 s=READY pgs=1340 cs=0 l=1 rx=0x7ff9540669a0 tx=0x7ff94c010c50).stop 2020-04-22T14:13:59.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.736+0000 7ff95923b700 1 -- 172.21.15.103:0/3458696636 shutdown_connections 2020-04-22T14:13:59.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.736+0000 7ff95923b700 1 --2- 172.21.15.103:0/3458696636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff95412c0d0 0x7ff95412a440 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:59.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.736+0000 7ff95923b700 1 --2- 172.21.15.103:0/3458696636 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff93804d7b0 0x7ff93804fc70 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:59.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.736+0000 7ff95923b700 1 --2- 172.21.15.103:0/3458696636 >> v2:172.21.15.86:3300/0 conn(0x7ff95405b8a0 0x7ff954111680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:59.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.736+0000 7ff95923b700 1 -- 172.21.15.103:0/3458696636 >> 172.21.15.103:0/3458696636 conn(0x7ff9540b9160 msgr2=0x7ff954062120 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:59.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.736+0000 7ff95923b700 1 -- 172.21.15.103:0/3458696636 shutdown_connections 2020-04-22T14:13:59.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.736+0000 7ff95923b700 1 -- 172.21.15.103:0/3458696636 wait complete. 2020-04-22T14:13:59.750 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:13:59.763 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-04-22T14:13:59.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.909+0000 7fa43d8b3700 1 Processor -- start 2020-04-22T14:13:59.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.909+0000 7fa43d8b3700 1 -- start start 2020-04-22T14:13:59.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.910+0000 7fa43d8b3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4380b9670 0x7fa4380b6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:59.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.910+0000 7fa43d8b3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa43814a020 0x7fa43814a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:13:59.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.910+0000 7fa43d8b3700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4381498e0 con 0x7fa4380663c0 2020-04-22T14:13:59.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.910+0000 7fa43d8b3700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4380b44b0 con 0x7fa43814a020 2020-04-22T14:13:59.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.910+0000 7fa43d8b3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa438149b80 con 0x7fa4380b9670 2020-04-22T14:13:59.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.910+0000 7fa4367fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa43814a020 0x7fa43814a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:59.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.910+0000 7fa4367fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa43814a020 0x7fa43814a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54266/0 (socket says 172.21.15.103:54266) 2020-04-22T14:13:59.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.910+0000 7fa4367fc700 1 -- 172.21.15.103:0/418261714 learned_addr learned my addr 172.21.15.103:0/418261714 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:59.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.911+0000 7fa436ffd700 1 --2- 172.21.15.103:0/418261714 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4380b9670 0x7fa4380b6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:59.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.911+0000 7fa4367fc700 1 -- 172.21.15.103:0/418261714 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4380b9670 msgr2=0x7fa4380b6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:59.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.911+0000 7fa4367fc700 1 --2- 172.21.15.103:0/418261714 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4380b9670 0x7fa4380b6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:59.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.911+0000 7fa4367fc700 1 -- 172.21.15.103:0/418261714 >> v1:172.21.15.86:6789/0 conn(0x7fa4380663c0 legacy=0x7fa438066870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:13:59.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.911+0000 7fa4367fc700 1 -- 172.21.15.103:0/418261714 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4380b9a50 con 0x7fa43814a020 2020-04-22T14:13:59.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.911+0000 7fa4367fc700 1 --2- 172.21.15.103:0/418261714 >> v2:172.21.15.103:3300/0 conn(0x7fa43814a020 0x7fa43814a480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa438069f30 tx=0x7fa420007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.911+0000 7fa4367fc700 1 --2- 172.21.15.103:0/418261714 >> v2:172.21.15.103:3300/0 conn(0x7fa43814a020 0x7fa43814a480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa438069f30 tx=0x7fa420007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.911+0000 7fa4367fc700 1 --2- 172.21.15.103:0/418261714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa43814a020 0x7fa43814a480 secure :-1 s=READY pgs=1341 cs=0 l=1 rx=0x7fa438069f30 tx=0x7fa420007a40).ready entity=mon.1 client_cookie=dc3570d18031436d server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:59.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.911+0000 7fa4367fc700 1 --2- 172.21.15.103:0/418261714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa43814a020 0x7fa43814a480 secure :-1 s=THROTTLE_DONE pgs=1341 cs=0 l=1 rx=0x7fa438069f30 tx=0x7fa420007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.911+0000 7fa435ffb700 1 -- 172.21.15.103:0/418261714 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4200116e0 con 0x7fa43814a020 2020-04-22T14:13:59.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.911+0000 7fa4367fc700 1 --2- 172.21.15.103:0/418261714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa43814a020 0x7fa43814a480 secure :-1 s=THROTTLE_DONE pgs=1341 cs=0 l=1 rx=0x7fa438069f30 tx=0x7fa420007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.911+0000 7fa4367fc700 1 --2- 172.21.15.103:0/418261714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa43814a020 0x7fa43814a480 secure :-1 s=THROTTLE_DONE pgs=1341 cs=0 l=1 rx=0x7fa438069f30 tx=0x7fa420007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.911+0000 7fa435ffb700 1 -- 172.21.15.103:0/418261714 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa420011840 con 0x7fa43814a020 2020-04-22T14:13:59.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.911+0000 7fa435ffb700 1 -- 172.21.15.103:0/418261714 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa420011c60 con 0x7fa43814a020 2020-04-22T14:13:59.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.911+0000 7fa43d8b3700 1 -- 172.21.15.103:0/418261714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa43814a020 msgr2=0x7fa43814a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:59.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.911+0000 7fa43d8b3700 1 --2- 172.21.15.103:0/418261714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa43814a020 0x7fa43814a480 secure :-1 s=READY pgs=1341 cs=0 l=1 rx=0x7fa438069f30 tx=0x7fa420007a40).stop 2020-04-22T14:13:59.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.912+0000 7fa43d8b3700 1 -- 172.21.15.103:0/418261714 shutdown_connections 2020-04-22T14:13:59.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.912+0000 7fa43d8b3700 1 --2- 172.21.15.103:0/418261714 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4380b9670 0x7fa4380b6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:13:59.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.912+0000 7fa43d8b3700 1 --2- 172.21.15.103:0/418261714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa43814a020 0x7fa43814a480 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:59.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.912+0000 7fa43d8b3700 1 -- 172.21.15.103:0/418261714 >> 172.21.15.103:0/418261714 conn(0x7fa43805ad30 msgr2=0x7fa43805b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:13:59.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.912+0000 7fa43d8b3700 1 -- 172.21.15.103:0/418261714 shutdown_connections 2020-04-22T14:13:59.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.912+0000 7fa43d8b3700 1 -- 172.21.15.103:0/418261714 wait complete. 2020-04-22T14:13:59.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.913+0000 7fa43d8b3700 1 Processor -- start 2020-04-22T14:13:59.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.913+0000 7fa43d8b3700 1 -- start start 2020-04-22T14:13:59.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.913+0000 7fa43d8b3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa4380663c0 0x7fa4381456b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:59.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.913+0000 7fa43d8b3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4380b9670 0x7fa4380af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:59.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.913+0000 7fa43d8b3700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4380af640 con 0x7fa43814a020 2020-04-22T14:13:59.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.913+0000 7fa43d8b3700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa438149450 con 0x7fa4380663c0 2020-04-22T14:13:59.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.913+0000 7fa43d8b3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4381546b0 con 0x7fa4380b9670 2020-04-22T14:13:59.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.913+0000 7fa436ffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa4380663c0 0x7fa4381456b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:59.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.913+0000 7fa4367fc700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4380b9670 0x7fa4380af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:59.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.913+0000 7fa436ffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa4380663c0 0x7fa4381456b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:51504/0 (socket says 172.21.15.103:51504) 2020-04-22T14:13:59.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.913+0000 7fa436ffd700 1 -- 172.21.15.103:0/4084515788 learned_addr learned my addr 172.21.15.103:0/4084515788 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:13:59.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.913+0000 7fa4377fe700 1 --1- 172.21.15.103:0/4084515788 >> v1:172.21.15.86:6789/0 conn(0x7fa43814a020 0x7fa438140690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:35390/0 (socket says 172.21.15.103:35390) 2020-04-22T14:13:59.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.914+0000 7fa4367fc700 1 -- 172.21.15.103:0/4084515788 >> v2:172.21.15.86:3300/0 conn(0x7fa4380663c0 msgr2=0x7fa4381456b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:59.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.914+0000 7fa4367fc700 1 --2- 172.21.15.103:0/4084515788 >> v2:172.21.15.86:3300/0 conn(0x7fa4380663c0 0x7fa4381456b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:13:59.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.914+0000 7fa4367fc700 1 -- 172.21.15.103:0/4084515788 >> v1:172.21.15.86:6789/0 conn(0x7fa43814a020 legacy=0x7fa438140690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:13:59.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.914+0000 7fa4367fc700 1 -- 172.21.15.103:0/4084515788 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa438154950 con 0x7fa4380b9670 2020-04-22T14:13:59.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.914+0000 7fa4367fc700 1 --2- 172.21.15.103:0/4084515788 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4380b9670 0x7fa4380af1e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa438069f30 tx=0x7fa420007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.914+0000 7fa4367fc700 1 --2- 172.21.15.103:0/4084515788 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4380b9670 0x7fa4380af1e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa438069f30 tx=0x7fa420007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.914+0000 7fa4367fc700 1 --2- 172.21.15.103:0/4084515788 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4380b9670 0x7fa4380af1e0 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7fa438069f30 tx=0x7fa420007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:59.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.914+0000 7fa4367fc700 1 --2- 172.21.15.103:0/4084515788 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4380b9670 0x7fa4380af1e0 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fa438069f30 tx=0x7fa420007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.914+0000 7fa42ffff700 1 -- 172.21.15.103:0/4084515788 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa42000c370 con 0x7fa4380b9670 2020-04-22T14:13:59.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.914+0000 7fa4367fc700 1 --2- 172.21.15.103:0/4084515788 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4380b9670 0x7fa4380af1e0 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fa438069f30 tx=0x7fa420007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.914+0000 7fa42ffff700 1 -- 172.21.15.103:0/4084515788 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42000c4d0 con 0x7fa4380b9670 2020-04-22T14:13:59.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.914+0000 7fa43d8b3700 1 -- 172.21.15.103:0/4084515788 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa438155090 con 0x7fa4380b9670 2020-04-22T14:13:59.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.914+0000 7fa4367fc700 1 --2- 172.21.15.103:0/4084515788 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4380b9670 0x7fa4380af1e0 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fa438069f30 tx=0x7fa420007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.914+0000 7fa42ffff700 1 -- 172.21.15.103:0/4084515788 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa42000c870 con 0x7fa4380b9670 2020-04-22T14:13:59.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.914+0000 7fa43d8b3700 1 -- 172.21.15.103:0/4084515788 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4381470c0 con 0x7fa4380b9670 2020-04-22T14:13:59.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.915+0000 7fa4367fc700 1 --2- 172.21.15.103:0/4084515788 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4380b9670 0x7fa4380af1e0 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fa438069f30 tx=0x7fa420007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.915+0000 7fa43d8b3700 1 -- 172.21.15.103:0/4084515788 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa438056c90 con 0x7fa4380b9670 2020-04-22T14:13:59.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.915+0000 7fa42ffff700 1 -- 172.21.15.103:0/4084515788 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fa42000cab0 con 0x7fa4380b9670 2020-04-22T14:13:59.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.915+0000 7fa4367fc700 1 --2- 172.21.15.103:0/4084515788 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4380b9670 0x7fa4380af1e0 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fa438069f30 tx=0x7fa420007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.916+0000 7fa42ffff700 1 --2- 172.21.15.103:0/4084515788 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa41c04d900 0x7fa41c04fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:13:59.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.916+0000 7fa42ffff700 1 -- 172.21.15.103:0/4084515788 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa420061b00 con 0x7fa4380b9670 2020-04-22T14:13:59.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.916+0000 7fa436ffd700 1 --2- 172.21.15.103:0/4084515788 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa41c04d900 0x7fa41c04fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:13:59.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.916+0000 7fa436ffd700 1 --2- 172.21.15.103:0/4084515788 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa41c04d900 0x7fa41c04fdc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa428002f30 tx=0x7fa428007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.916+0000 7fa436ffd700 1 --2- 172.21.15.103:0/4084515788 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa41c04d900 0x7fa41c04fdc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa428002f30 tx=0x7fa428007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.916+0000 7fa436ffd700 1 --2- 172.21.15.103:0/4084515788 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa41c04d900 0x7fa41c04fdc0 secure :-1 s=READY pgs=492 cs=0 l=1 rx=0x7fa428002f30 tx=0x7fa428007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:13:59.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.919+0000 7fa4367fc700 1 --2- 172.21.15.103:0/4084515788 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4380b9670 0x7fa4380af1e0 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fa438069f30 tx=0x7fa420007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:13:59.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:13:59.919+0000 7fa42ffff700 1 -- 172.21.15.103:0/4084515788 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fa42003d000 con 0x7fa4380b9670 2020-04-22T14:14:00.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:00.113+0000 7fa43d8b3700 1 -- 172.21.15.103:0/4084515788 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa4380afe20 con 0x7fa4380b9670 2020-04-22T14:14:00.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:00.914+0000 7fa4367fc700 1 --2- 172.21.15.103:0/4084515788 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4380b9670 0x7fa4380af1e0 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7fa438069f30 tx=0x7fa420007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.071+0000 7fa4367fc700 1 --2- 172.21.15.103:0/4084515788 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4380b9670 0x7fa4380af1e0 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fa438069f30 tx=0x7fa420007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.071+0000 7fa42ffff700 1 -- 172.21.15.103:0/4084515788 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v64) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa420040620 con 0x7fa4380b9670 2020-04-22T14:14:01.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.074+0000 7fa43d8b3700 1 -- 172.21.15.103:0/4084515788 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa41c04d900 msgr2=0x7fa41c04fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:01.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.074+0000 7fa43d8b3700 1 --2- 172.21.15.103:0/4084515788 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa41c04d900 0x7fa41c04fdc0 secure :-1 s=READY pgs=492 cs=0 l=1 rx=0x7fa428002f30 tx=0x7fa428007a40).stop 2020-04-22T14:14:01.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.074+0000 7fa43d8b3700 1 -- 172.21.15.103:0/4084515788 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4380b9670 msgr2=0x7fa4380af1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:01.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.074+0000 7fa43d8b3700 1 --2- 172.21.15.103:0/4084515788 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4380b9670 0x7fa4380af1e0 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7fa438069f30 tx=0x7fa420007a40).stop 2020-04-22T14:14:01.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.074+0000 7fa43d8b3700 1 -- 172.21.15.103:0/4084515788 shutdown_connections 2020-04-22T14:14:01.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.074+0000 7fa43d8b3700 1 --2- 172.21.15.103:0/4084515788 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa41c04d900 0x7fa41c04fdc0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:01.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.074+0000 7fa43d8b3700 1 --2- 172.21.15.103:0/4084515788 >> v2:172.21.15.86:3300/0 conn(0x7fa4380663c0 0x7fa4381456b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:01.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.074+0000 7fa43d8b3700 1 --2- 172.21.15.103:0/4084515788 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4380b9670 0x7fa4380af1e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:01.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.074+0000 7fa43d8b3700 1 -- 172.21.15.103:0/4084515788 >> 172.21.15.103:0/4084515788 conn(0x7fa43805ad30 msgr2=0x7fa43805b110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:01.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.074+0000 7fa43d8b3700 1 -- 172.21.15.103:0/4084515788 shutdown_connections 2020-04-22T14:14:01.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.074+0000 7fa43d8b3700 1 -- 172.21.15.103:0/4084515788 wait complete. 2020-04-22T14:14:01.090 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:01.105 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:14:01.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.255+0000 7fef98bb6700 1 Processor -- start 2020-04-22T14:14:01.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.255+0000 7fef98bb6700 1 -- start start 2020-04-22T14:14:01.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.255+0000 7fef98bb6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fef9412c0d0 0x7fef941464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:01.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.256+0000 7fef98bb6700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fef94063e30 0x7fef940642a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:01.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.256+0000 7fef98bb6700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef94143300 con 0x7fef94065fe0 2020-04-22T14:14:01.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.256+0000 7fef98bb6700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef941435a0 con 0x7fef94063e30 2020-04-22T14:14:01.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.256+0000 7fef98bb6700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef94143840 con 0x7fef9412c0d0 2020-04-22T14:14:01.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.256+0000 7fef92d9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fef94063e30 0x7fef940642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:01.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.256+0000 7fef91d9b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fef94065fe0 0x7fef9405b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46470/0 (socket says 172.21.15.103:46470) 2020-04-22T14:14:01.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.256+0000 7fef91d9b700 1 -- 172.21.15.103:0/3163247736 learned_addr learned my addr 172.21.15.103:0/3163247736 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:14:01.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.256+0000 7fef9259c700 1 --2- 172.21.15.103:0/3163247736 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fef9412c0d0 0x7fef941464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:01.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.256+0000 7fef92d9d700 1 -- 172.21.15.103:0/3163247736 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fef9412c0d0 msgr2=0x7fef941464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:01.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.256+0000 7fef92d9d700 1 --2- 172.21.15.103:0/3163247736 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fef9412c0d0 0x7fef941464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:01.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.256+0000 7fef92d9d700 1 -- 172.21.15.103:0/3163247736 >> v1:172.21.15.103:6789/0 conn(0x7fef94065fe0 legacy=0x7fef9405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:01.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.256+0000 7fef92d9d700 1 -- 172.21.15.103:0/3163247736 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9405bb50 con 0x7fef94063e30 2020-04-22T14:14:01.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.256+0000 7fef9159a700 1 -- 172.21.15.103:0/3163247736 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3033862261 0 0) 0x7fef94143300 con 0x7fef94065fe0 2020-04-22T14:14:01.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.256+0000 7fef92d9d700 1 --2- 172.21.15.103:0/3163247736 >> v2:172.21.15.103:3300/0 conn(0x7fef94063e30 0x7fef940642a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fef8c0032b0 tx=0x7fef8c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.256+0000 7fef92d9d700 1 --2- 172.21.15.103:0/3163247736 >> v2:172.21.15.103:3300/0 conn(0x7fef94063e30 0x7fef940642a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fef8c0032b0 tx=0x7fef8c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.256+0000 7fef92d9d700 1 --2- 172.21.15.103:0/3163247736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef94063e30 0x7fef940642a0 secure :-1 s=READY pgs=1343 cs=0 l=1 rx=0x7fef8c0032b0 tx=0x7fef8c007dc0).ready entity=mon.1 client_cookie=1ebf4dc6c819b1b7 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:01.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.256+0000 7fef92d9d700 1 --2- 172.21.15.103:0/3163247736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef94063e30 0x7fef940642a0 secure :-1 s=THROTTLE_DONE pgs=1343 cs=0 l=1 rx=0x7fef8c0032b0 tx=0x7fef8c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.256+0000 7fef9159a700 1 -- 172.21.15.103:0/3163247736 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef8c00a180 con 0x7fef94063e30 2020-04-22T14:14:01.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.256+0000 7fef92d9d700 1 --2- 172.21.15.103:0/3163247736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef94063e30 0x7fef940642a0 secure :-1 s=THROTTLE_DONE pgs=1343 cs=0 l=1 rx=0x7fef8c0032b0 tx=0x7fef8c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.256+0000 7fef92d9d700 1 --2- 172.21.15.103:0/3163247736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef94063e30 0x7fef940642a0 secure :-1 s=THROTTLE_DONE pgs=1343 cs=0 l=1 rx=0x7fef8c0032b0 tx=0x7fef8c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.256+0000 7fef9159a700 1 -- 172.21.15.103:0/3163247736 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8c00a320 con 0x7fef94063e30 2020-04-22T14:14:01.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.256+0000 7fef9159a700 1 -- 172.21.15.103:0/3163247736 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef8c00a700 con 0x7fef94063e30 2020-04-22T14:14:01.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.256+0000 7fef98bb6700 1 -- 172.21.15.103:0/3163247736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef94063e30 msgr2=0x7fef940642a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:01.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.256+0000 7fef98bb6700 1 --2- 172.21.15.103:0/3163247736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef94063e30 0x7fef940642a0 secure :-1 s=READY pgs=1343 cs=0 l=1 rx=0x7fef8c0032b0 tx=0x7fef8c007dc0).stop 2020-04-22T14:14:01.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.257+0000 7fef98bb6700 1 -- 172.21.15.103:0/3163247736 shutdown_connections 2020-04-22T14:14:01.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.257+0000 7fef98bb6700 1 --2- 172.21.15.103:0/3163247736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef94063e30 0x7fef940642a0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:01.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.257+0000 7fef98bb6700 1 --2- 172.21.15.103:0/3163247736 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fef9412c0d0 0x7fef941464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:01.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.257+0000 7fef98bb6700 1 -- 172.21.15.103:0/3163247736 >> 172.21.15.103:0/3163247736 conn(0x7fef940b9160 msgr2=0x7fef9405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:01.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.257+0000 7fef98bb6700 1 -- 172.21.15.103:0/3163247736 shutdown_connections 2020-04-22T14:14:01.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.257+0000 7fef98bb6700 1 -- 172.21.15.103:0/3163247736 wait complete. 2020-04-22T14:14:01.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.258+0000 7fef98bb6700 1 Processor -- start 2020-04-22T14:14:01.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.258+0000 7fef98bb6700 1 -- start start 2020-04-22T14:14:01.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.258+0000 7fef98bb6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fef94063e30 0x7fef94125e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:01.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.258+0000 7fef98bb6700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fef9412c0d0 0x7fef94155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:01.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.258+0000 7fef98bb6700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef94127d90 con 0x7fef94065fe0 2020-04-22T14:14:01.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.258+0000 7fef98bb6700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef94128180 con 0x7fef9412c0d0 2020-04-22T14:14:01.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.258+0000 7fef98bb6700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef94128420 con 0x7fef94063e30 2020-04-22T14:14:01.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.259+0000 7fef91d9b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fef94065fe0 0x7fef940b5140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46478/0 (socket says 172.21.15.103:46478) 2020-04-22T14:14:01.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.259+0000 7fef91d9b700 1 -- 172.21.15.103:0/3694891907 learned_addr learned my addr 172.21.15.103:0/3694891907 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:14:01.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.259+0000 7fef92d9d700 1 --2- 172.21.15.103:0/3694891907 >> v2:172.21.15.103:3300/0 conn(0x7fef9412c0d0 0x7fef94155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:01.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.259+0000 7fef9259c700 1 --2- 172.21.15.103:0/3694891907 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fef94063e30 0x7fef94125e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:01.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.259+0000 7fef8b7fe700 1 -- 172.21.15.103:0/3694891907 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1777804763 0 0) 0x7fef94127d90 con 0x7fef94065fe0 2020-04-22T14:14:01.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.259+0000 7fef8b7fe700 1 -- 172.21.15.103:0/3694891907 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef78002fe0 con 0x7fef94065fe0 2020-04-22T14:14:01.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.259+0000 7fef92d9d700 1 -- 172.21.15.103:0/3694891907 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fef94063e30 msgr2=0x7fef94125e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:01.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.259+0000 7fef92d9d700 1 --2- 172.21.15.103:0/3694891907 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fef94063e30 0x7fef94125e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:01.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.259+0000 7fef92d9d700 1 -- 172.21.15.103:0/3694891907 >> v1:172.21.15.103:6789/0 conn(0x7fef94065fe0 legacy=0x7fef940b5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:01.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.259+0000 7fef92d9d700 1 -- 172.21.15.103:0/3694891907 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef940b5850 con 0x7fef9412c0d0 2020-04-22T14:14:01.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.259+0000 7fef92d9d700 1 --2- 172.21.15.103:0/3694891907 >> v2:172.21.15.103:3300/0 conn(0x7fef9412c0d0 0x7fef94155990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fef8c0032b0 tx=0x7fef8c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.259+0000 7fef92d9d700 1 --2- 172.21.15.103:0/3694891907 >> v2:172.21.15.103:3300/0 conn(0x7fef9412c0d0 0x7fef94155990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fef8c0032b0 tx=0x7fef8c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.259+0000 7fef92d9d700 1 --2- 172.21.15.103:0/3694891907 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef9412c0d0 0x7fef94155990 secure :-1 s=READY pgs=1345 cs=0 l=1 rx=0x7fef8c0032b0 tx=0x7fef8c007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:01.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.259+0000 7fef92d9d700 1 --2- 172.21.15.103:0/3694891907 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef9412c0d0 0x7fef94155990 secure :-1 s=THROTTLE_DONE pgs=1345 cs=0 l=1 rx=0x7fef8c0032b0 tx=0x7fef8c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.259+0000 7fef8b7fe700 1 -- 172.21.15.103:0/3694891907 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef8c0114d0 con 0x7fef9412c0d0 2020-04-22T14:14:01.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.259+0000 7fef92d9d700 1 --2- 172.21.15.103:0/3694891907 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef9412c0d0 0x7fef94155990 secure :-1 s=THROTTLE_DONE pgs=1345 cs=0 l=1 rx=0x7fef8c0032b0 tx=0x7fef8c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.259+0000 7fef92d9d700 1 --2- 172.21.15.103:0/3694891907 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef9412c0d0 0x7fef94155990 secure :-1 s=THROTTLE_DONE pgs=1345 cs=0 l=1 rx=0x7fef8c0032b0 tx=0x7fef8c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.259+0000 7fef8b7fe700 1 -- 172.21.15.103:0/3694891907 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8c005a40 con 0x7fef9412c0d0 2020-04-22T14:14:01.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.259+0000 7fef98bb6700 1 -- 172.21.15.103:0/3694891907 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef94142500 con 0x7fef9412c0d0 2020-04-22T14:14:01.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.259+0000 7fef8b7fe700 1 -- 172.21.15.103:0/3694891907 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef8c011630 con 0x7fef9412c0d0 2020-04-22T14:14:01.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.259+0000 7fef98bb6700 1 -- 172.21.15.103:0/3694891907 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef941288c0 con 0x7fef9412c0d0 2020-04-22T14:14:01.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.260+0000 7fef92d9d700 1 --2- 172.21.15.103:0/3694891907 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef9412c0d0 0x7fef94155990 secure :-1 s=THROTTLE_DONE pgs=1345 cs=0 l=1 rx=0x7fef8c0032b0 tx=0x7fef8c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.260+0000 7fef98bb6700 1 -- 172.21.15.103:0/3694891907 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef94127fe0 con 0x7fef9412c0d0 2020-04-22T14:14:01.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.260+0000 7fef8b7fe700 1 -- 172.21.15.103:0/3694891907 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fef8c010680 con 0x7fef9412c0d0 2020-04-22T14:14:01.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.260+0000 7fef92d9d700 1 --2- 172.21.15.103:0/3694891907 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef9412c0d0 0x7fef94155990 secure :-1 s=THROTTLE_DONE pgs=1345 cs=0 l=1 rx=0x7fef8c0032b0 tx=0x7fef8c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.261+0000 7fef8b7fe700 1 --2- 172.21.15.103:0/3694891907 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fef7804dce0 0x7fef780501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:01.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.261+0000 7fef8b7fe700 1 -- 172.21.15.103:0/3694891907 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fef8c061e70 con 0x7fef9412c0d0 2020-04-22T14:14:01.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.261+0000 7fef9259c700 1 --2- 172.21.15.103:0/3694891907 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fef7804dce0 0x7fef780501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:01.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.261+0000 7fef9259c700 1 --2- 172.21.15.103:0/3694891907 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fef7804dce0 0x7fef780501a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fef84002f30 tx=0x7fef840076e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.261+0000 7fef9259c700 1 --2- 172.21.15.103:0/3694891907 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fef7804dce0 0x7fef780501a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fef84002f30 tx=0x7fef840076e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.261+0000 7fef9259c700 1 --2- 172.21.15.103:0/3694891907 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fef7804dce0 0x7fef780501a0 secure :-1 s=READY pgs=493 cs=0 l=1 rx=0x7fef84002f30 tx=0x7fef840076e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:01.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.265+0000 7fef92d9d700 1 --2- 172.21.15.103:0/3694891907 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef9412c0d0 0x7fef94155990 secure :-1 s=THROTTLE_DONE pgs=1345 cs=0 l=1 rx=0x7fef8c0032b0 tx=0x7fef8c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.265+0000 7fef8b7fe700 1 -- 172.21.15.103:0/3694891907 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fef94127fe0 con 0x7fef9412c0d0 2020-04-22T14:14:01.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.455+0000 7fef98bb6700 1 -- 172.21.15.103:0/3694891907 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef94127fe0 con 0x7fef9412c0d0 2020-04-22T14:14:01.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.455+0000 7fef92d9d700 1 --2- 172.21.15.103:0/3694891907 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef9412c0d0 0x7fef94155990 secure :-1 s=THROTTLE_DONE pgs=1345 cs=0 l=1 rx=0x7fef8c0032b0 tx=0x7fef8c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.455+0000 7fef8b7fe700 1 -- 172.21.15.103:0/3694891907 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+2143 (secure 0 0 0) 0x7fef94127fe0 con 0x7fef9412c0d0 2020-04-22T14:14:01.459 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:14:01.459 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":64,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5810,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/2664816107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2664816107},{"type":"v1","addr":"172.21.15.86:6835","nonce":2664816107}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":60}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:13:59.062543+0000","modified":"2020-04-22T14:14:01.070314+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7723},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7723":{"gid":7723,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/3220772133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3220772133},{"type":"v1","addr":"172.21.15.103:6833","nonce":3220772133}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-04-22T14:14:01.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.457+0000 7fef98bb6700 1 -- 172.21.15.103:0/3694891907 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fef7804dce0 msgr2=0x7fef780501a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:01.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.457+0000 7fef98bb6700 1 --2- 172.21.15.103:0/3694891907 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fef7804dce0 0x7fef780501a0 secure :-1 s=READY pgs=493 cs=0 l=1 rx=0x7fef84002f30 tx=0x7fef840076e0).stop 2020-04-22T14:14:01.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.457+0000 7fef98bb6700 1 -- 172.21.15.103:0/3694891907 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef9412c0d0 msgr2=0x7fef94155990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:01.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.457+0000 7fef98bb6700 1 --2- 172.21.15.103:0/3694891907 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef9412c0d0 0x7fef94155990 secure :-1 s=READY pgs=1345 cs=0 l=1 rx=0x7fef8c0032b0 tx=0x7fef8c007dc0).stop 2020-04-22T14:14:01.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.457+0000 7fef98bb6700 1 -- 172.21.15.103:0/3694891907 shutdown_connections 2020-04-22T14:14:01.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.457+0000 7fef98bb6700 1 --2- 172.21.15.103:0/3694891907 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fef7804dce0 0x7fef780501a0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:01.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.457+0000 7fef98bb6700 1 --2- 172.21.15.103:0/3694891907 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef9412c0d0 0x7fef94155990 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:01.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.457+0000 7fef98bb6700 1 --2- 172.21.15.103:0/3694891907 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fef94063e30 0x7fef94125e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:01.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.457+0000 7fef98bb6700 1 -- 172.21.15.103:0/3694891907 >> 172.21.15.103:0/3694891907 conn(0x7fef940b9160 msgr2=0x7fef9405ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:01.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.457+0000 7fef98bb6700 1 -- 172.21.15.103:0/3694891907 shutdown_connections 2020-04-22T14:14:01.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.457+0000 7fef98bb6700 1 -- 172.21.15.103:0/3694891907 wait complete. 2020-04-22T14:14:01.462 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 64 2020-04-22T14:14:01.470 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:01.483 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:14:01.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.627+0000 7f4b6f793700 1 Processor -- start 2020-04-22T14:14:01.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.627+0000 7f4b6f793700 1 -- start start 2020-04-22T14:14:01.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.628+0000 7f4b6f793700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4b68067170 0x7f4b680b6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:01.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.628+0000 7f4b6f793700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b68064ec0 con 0x7f4b681426d0 2020-04-22T14:14:01.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.628+0000 7f4b6f793700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b68146870 con 0x7f4b680ac740 2020-04-22T14:14:01.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.628+0000 7f4b6f793700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b68065af0 con 0x7f4b68067170 2020-04-22T14:14:01.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.628+0000 7f4b6cd2e700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f4b680ac740 0x7f4b6813c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46484/0 (socket says 172.21.15.103:46484) 2020-04-22T14:14:01.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.628+0000 7f4b6cd2e700 1 -- 172.21.15.103:0/1617434601 learned_addr learned my addr 172.21.15.103:0/1617434601 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:14:01.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.628+0000 7f4b6d52f700 1 --2- 172.21.15.103:0/1617434601 >> v2:172.21.15.86:3300/0 conn(0x7f4b68067170 0x7f4b680b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:01.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.628+0000 7f4b57fff700 1 -- 172.21.15.103:0/1617434601 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 332388655 0 0) 0x7f4b68146870 con 0x7f4b680ac740 2020-04-22T14:14:01.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.628+0000 7f4b57fff700 1 -- 172.21.15.103:0/1617434601 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b50003230 con 0x7f4b680ac740 2020-04-22T14:14:01.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.629+0000 7f4b57fff700 1 -- 172.21.15.103:0/1617434601 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 291468850 0 0) 0x7f4b50003230 con 0x7f4b680ac740 2020-04-22T14:14:01.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.629+0000 7f4b57fff700 1 -- 172.21.15.103:0/1617434601 >> v2:172.21.15.86:3300/0 conn(0x7f4b68067170 msgr2=0x7f4b680b6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:01.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.629+0000 7f4b57fff700 1 --2- 172.21.15.103:0/1617434601 >> v2:172.21.15.86:3300/0 conn(0x7f4b68067170 0x7f4b680b6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:01.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.629+0000 7f4b57fff700 1 -- 172.21.15.103:0/1617434601 >> v1:172.21.15.86:6789/0 conn(0x7f4b681426d0 legacy=0x7f4b68142b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:01.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.629+0000 7f4b57fff700 1 -- 172.21.15.103:0/1617434601 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b68067550 con 0x7f4b680ac740 2020-04-22T14:14:01.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.629+0000 7f4b57fff700 1 -- 172.21.15.103:0/1617434601 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f4b640016d0 con 0x7f4b680ac740 2020-04-22T14:14:01.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.629+0000 7f4b57fff700 1 -- 172.21.15.103:0/1617434601 >> v1:172.21.15.103:6789/0 conn(0x7f4b680ac740 legacy=0x7f4b6813c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:01.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.629+0000 7f4b57fff700 1 --2- 172.21.15.103:0/1617434601 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b50003720 0x7f4b50003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:01.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.629+0000 7f4b57fff700 1 --2- 172.21.15.103:0/1617434601 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b500044d0 0x7f4b50004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:01.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.629+0000 7f4b57fff700 1 --2- 172.21.15.103:0/1617434601 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b50004db0 0x7f4b5000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:01.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.629+0000 7f4b57fff700 1 -- 172.21.15.103:0/1617434601 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b68065af0 con 0x7f4b500044d0 2020-04-22T14:14:01.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.629+0000 7f4b57fff700 1 -- 172.21.15.103:0/1617434601 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b500041c0 con 0x7f4b50003720 2020-04-22T14:14:01.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.629+0000 7f4b57fff700 1 -- 172.21.15.103:0/1617434601 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5000bb80 con 0x7f4b50004db0 2020-04-22T14:14:01.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.629+0000 7f4b6d52f700 1 --2- 172.21.15.103:0/1617434601 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b50003720 0x7f4b50003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:01.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.629+0000 7f4b6cd2e700 1 --2- 172.21.15.103:0/1617434601 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b500044d0 0x7f4b50004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:01.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.629+0000 7f4b6dd30700 1 --2- 172.21.15.103:0/1617434601 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b50004db0 0x7f4b5000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:01.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.629+0000 7f4b6d52f700 1 -- 172.21.15.103:0/1617434601 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b50004db0 msgr2=0x7f4b5000b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:01.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.629+0000 7f4b6d52f700 1 --2- 172.21.15.103:0/1617434601 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b50004db0 0x7f4b5000b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:01.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.629+0000 7f4b6d52f700 1 -- 172.21.15.103:0/1617434601 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b500044d0 msgr2=0x7f4b50004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:01.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.629+0000 7f4b6d52f700 1 --2- 172.21.15.103:0/1617434601 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b500044d0 0x7f4b50004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:01.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.629+0000 7f4b6d52f700 1 -- 172.21.15.103:0/1617434601 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b50003230 con 0x7f4b50003720 2020-04-22T14:14:01.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.629+0000 7f4b6dd30700 1 -- 172.21.15.103:0/1617434601 reap_dead start 2020-04-22T14:14:01.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.629+0000 7f4b6cd2e700 1 --2- 172.21.15.103:0/1617434601 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b500044d0 0x7f4b50004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:14:01.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.629+0000 7f4b6d52f700 1 --2- 172.21.15.103:0/1617434601 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b50003720 0x7f4b50003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4b500054a0 tx=0x7f4b58010100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.629+0000 7f4b6d52f700 1 --2- 172.21.15.103:0/1617434601 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b50003720 0x7f4b50003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4b500054a0 tx=0x7f4b58010100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.629+0000 7f4b6d52f700 1 --2- 172.21.15.103:0/1617434601 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b50003720 0x7f4b50003b40 secure :-1 s=READY pgs=1347 cs=0 l=1 rx=0x7f4b500054a0 tx=0x7f4b58010100).ready entity=mon.1 client_cookie=84daa437c93e325c server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:01.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.629+0000 7f4b6d52f700 1 --2- 172.21.15.103:0/1617434601 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b50003720 0x7f4b50003b40 secure :-1 s=THROTTLE_DONE pgs=1347 cs=0 l=1 rx=0x7f4b500054a0 tx=0x7f4b58010100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.629+0000 7f4b57fff700 1 -- 172.21.15.103:0/1617434601 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b58010dd0 con 0x7f4b50003720 2020-04-22T14:14:01.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.629+0000 7f4b6d52f700 1 --2- 172.21.15.103:0/1617434601 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b50003720 0x7f4b50003b40 secure :-1 s=THROTTLE_DONE pgs=1347 cs=0 l=1 rx=0x7f4b500054a0 tx=0x7f4b58010100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.629+0000 7f4b6d52f700 1 --2- 172.21.15.103:0/1617434601 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b50003720 0x7f4b50003b40 secure :-1 s=THROTTLE_DONE pgs=1347 cs=0 l=1 rx=0x7f4b500054a0 tx=0x7f4b58010100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.629+0000 7f4b57fff700 1 -- 172.21.15.103:0/1617434601 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b58008920 con 0x7f4b50003720 2020-04-22T14:14:01.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.629+0000 7f4b57fff700 1 -- 172.21.15.103:0/1617434601 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b58008c80 con 0x7f4b50003720 2020-04-22T14:14:01.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.629+0000 7f4b6f793700 1 -- 172.21.15.103:0/1617434601 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b50003720 msgr2=0x7f4b50003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:01.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.629+0000 7f4b6f793700 1 --2- 172.21.15.103:0/1617434601 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b50003720 0x7f4b50003b40 secure :-1 s=READY pgs=1347 cs=0 l=1 rx=0x7f4b500054a0 tx=0x7f4b58010100).stop 2020-04-22T14:14:01.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.630+0000 7f4b6f793700 1 -- 172.21.15.103:0/1617434601 shutdown_connections 2020-04-22T14:14:01.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.630+0000 7f4b6f793700 1 --2- 172.21.15.103:0/1617434601 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b50003720 0x7f4b50003b40 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:01.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.630+0000 7f4b6f793700 1 -- 172.21.15.103:0/1617434601 >> 172.21.15.103:0/1617434601 conn(0x7f4b680b9160 msgr2=0x7f4b6805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:01.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.630+0000 7f4b6f793700 1 -- 172.21.15.103:0/1617434601 shutdown_connections 2020-04-22T14:14:01.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.630+0000 7f4b6f793700 1 -- 172.21.15.103:0/1617434601 wait complete. 2020-04-22T14:14:01.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.631+0000 7f4b6f793700 1 Processor -- start 2020-04-22T14:14:01.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.631+0000 7f4b6f793700 1 -- start start 2020-04-22T14:14:01.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.632+0000 7f4b6f793700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4b50003720 0x7f4b68145290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:01.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.632+0000 7f4b6f793700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b68154460 0x7f4b681456f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:01.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.632+0000 7f4b6f793700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4b68157280 0x7f4b681576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:01.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.632+0000 7f4b6f793700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b68153a80 con 0x7f4b50003720 2020-04-22T14:14:01.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.632+0000 7f4b6f793700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b68153d20 con 0x7f4b68157280 2020-04-22T14:14:01.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.632+0000 7f4b6f793700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b68153fc0 con 0x7f4b68154460 2020-04-22T14:14:01.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.632+0000 7f4b6dd30700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4b68157280 0x7f4b681576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:01.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.632+0000 7f4b6dd30700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4b68157280 0x7f4b681576a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54308/0 (socket says 172.21.15.103:54308) 2020-04-22T14:14:01.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.632+0000 7f4b6dd30700 1 -- 172.21.15.103:0/1183658737 learned_addr learned my addr 172.21.15.103:0/1183658737 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:14:01.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.632+0000 7f4b6d52f700 1 --2- 172.21.15.103:0/1183658737 >> v2:172.21.15.86:3300/0 conn(0x7f4b50003720 0x7f4b68145290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:01.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.632+0000 7f4b6cd2e700 1 --2- 172.21.15.103:0/1183658737 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b68154460 0x7f4b681456f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:01.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.632+0000 7f4b6dd30700 1 -- 172.21.15.103:0/1183658737 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b68154460 msgr2=0x7f4b681456f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:01.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.632+0000 7f4b6dd30700 1 --2- 172.21.15.103:0/1183658737 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b68154460 0x7f4b681456f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:01.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.632+0000 7f4b6dd30700 1 -- 172.21.15.103:0/1183658737 >> v2:172.21.15.86:3300/0 conn(0x7f4b50003720 msgr2=0x7f4b68145290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:01.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.632+0000 7f4b6dd30700 1 --2- 172.21.15.103:0/1183658737 >> v2:172.21.15.86:3300/0 conn(0x7f4b50003720 0x7f4b68145290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:01.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.632+0000 7f4b6dd30700 1 -- 172.21.15.103:0/1183658737 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b68157b00 con 0x7f4b68157280 2020-04-22T14:14:01.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.632+0000 7f4b6dd30700 1 --2- 172.21.15.103:0/1183658737 >> v2:172.21.15.103:3300/0 conn(0x7f4b68157280 0x7f4b681576a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4b640014a0 tx=0x7f4b600109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.632+0000 7f4b6dd30700 1 --2- 172.21.15.103:0/1183658737 >> v2:172.21.15.103:3300/0 conn(0x7f4b68157280 0x7f4b681576a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4b640014a0 tx=0x7f4b600109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.632+0000 7f4b6dd30700 1 --2- 172.21.15.103:0/1183658737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b68157280 0x7f4b681576a0 secure :-1 s=READY pgs=1348 cs=0 l=1 rx=0x7f4b640014a0 tx=0x7f4b600109c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:01.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.632+0000 7f4b6dd30700 1 --2- 172.21.15.103:0/1183658737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b68157280 0x7f4b681576a0 secure :-1 s=THROTTLE_DONE pgs=1348 cs=0 l=1 rx=0x7f4b640014a0 tx=0x7f4b600109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.632+0000 7f4b6dd30700 1 --2- 172.21.15.103:0/1183658737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b68157280 0x7f4b681576a0 secure :-1 s=THROTTLE_DONE pgs=1348 cs=0 l=1 rx=0x7f4b640014a0 tx=0x7f4b600109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.632+0000 7f4b567fc700 1 -- 172.21.15.103:0/1183658737 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b60001930 con 0x7f4b68157280 2020-04-22T14:14:01.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.632+0000 7f4b6dd30700 1 --2- 172.21.15.103:0/1183658737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b68157280 0x7f4b681576a0 secure :-1 s=THROTTLE_DONE pgs=1348 cs=0 l=1 rx=0x7f4b640014a0 tx=0x7f4b600109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.632+0000 7f4b567fc700 1 -- 172.21.15.103:0/1183658737 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b60001a90 con 0x7f4b68157280 2020-04-22T14:14:01.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.632+0000 7f4b567fc700 1 -- 172.21.15.103:0/1183658737 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b60001e30 con 0x7f4b68157280 2020-04-22T14:14:01.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.632+0000 7f4b6f793700 1 -- 172.21.15.103:0/1183658737 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b680b3430 con 0x7f4b68157280 2020-04-22T14:14:01.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.632+0000 7f4b6f793700 1 -- 172.21.15.103:0/1183658737 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b68062870 con 0x7f4b68157280 2020-04-22T14:14:01.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.633+0000 7f4b6dd30700 1 --2- 172.21.15.103:0/1183658737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b68157280 0x7f4b681576a0 secure :-1 s=THROTTLE_DONE pgs=1348 cs=0 l=1 rx=0x7f4b640014a0 tx=0x7f4b600109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.633+0000 7f4b567fc700 1 -- 172.21.15.103:0/1183658737 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f4b6000a2b0 con 0x7f4b68157280 2020-04-22T14:14:01.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.633+0000 7f4b6dd30700 1 --2- 172.21.15.103:0/1183658737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b68157280 0x7f4b681576a0 secure :-1 s=THROTTLE_DONE pgs=1348 cs=0 l=1 rx=0x7f4b640014a0 tx=0x7f4b600109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.633+0000 7f4b6f793700 1 -- 172.21.15.103:0/1183658737 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b68153870 con 0x7f4b68157280 2020-04-22T14:14:01.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.634+0000 7f4b567fc700 1 --2- 172.21.15.103:0/1183658737 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4b4804d9d0 0x7f4b4804fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:01.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.634+0000 7f4b567fc700 1 -- 172.21.15.103:0/1183658737 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4b60061040 con 0x7f4b68157280 2020-04-22T14:14:01.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.634+0000 7f4b6d52f700 1 --2- 172.21.15.103:0/1183658737 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4b4804d9d0 0x7f4b4804fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:01.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.634+0000 7f4b6d52f700 1 --2- 172.21.15.103:0/1183658737 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4b4804d9d0 0x7f4b4804fe90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4b500054a0 tx=0x7f4b58010100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.634+0000 7f4b6d52f700 1 --2- 172.21.15.103:0/1183658737 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4b4804d9d0 0x7f4b4804fe90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4b500054a0 tx=0x7f4b58010100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.634+0000 7f4b6d52f700 1 --2- 172.21.15.103:0/1183658737 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4b4804d9d0 0x7f4b4804fe90 secure :-1 s=READY pgs=494 cs=0 l=1 rx=0x7f4b500054a0 tx=0x7f4b58010100).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:01.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.638+0000 7f4b6dd30700 1 --2- 172.21.15.103:0/1183658737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b68157280 0x7f4b681576a0 secure :-1 s=THROTTLE_DONE pgs=1348 cs=0 l=1 rx=0x7f4b640014a0 tx=0x7f4b600109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.638+0000 7f4b567fc700 1 -- 172.21.15.103:0/1183658737 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f4b6003c420 con 0x7f4b68157280 2020-04-22T14:14:01.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.782+0000 7f4b6f793700 1 -- 172.21.15.103:0/1183658737 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b68056c90 con 0x7f4b68157280 2020-04-22T14:14:01.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.782+0000 7f4b6dd30700 1 --2- 172.21.15.103:0/1183658737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b68157280 0x7f4b681576a0 secure :-1 s=THROTTLE_DONE pgs=1348 cs=0 l=1 rx=0x7f4b640014a0 tx=0x7f4b600109c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.782+0000 7f4b567fc700 1 -- 172.21.15.103:0/1183658737 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+16092 (secure 0 0 0) 0x7f4b6003fa40 con 0x7f4b68157280 2020-04-22T14:14:01.786 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:14:01.786 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":90,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:14:00.064104+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:13:56.741291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2020-04-22T14:13:57.809563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:14:01.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.784+0000 7f4b6f793700 1 -- 172.21.15.103:0/1183658737 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4b4804d9d0 msgr2=0x7f4b4804fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:01.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.784+0000 7f4b6f793700 1 --2- 172.21.15.103:0/1183658737 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4b4804d9d0 0x7f4b4804fe90 secure :-1 s=READY pgs=494 cs=0 l=1 rx=0x7f4b500054a0 tx=0x7f4b58010100).stop 2020-04-22T14:14:01.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.784+0000 7f4b6f793700 1 -- 172.21.15.103:0/1183658737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b68157280 msgr2=0x7f4b681576a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:01.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.784+0000 7f4b6f793700 1 --2- 172.21.15.103:0/1183658737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b68157280 0x7f4b681576a0 secure :-1 s=READY pgs=1348 cs=0 l=1 rx=0x7f4b640014a0 tx=0x7f4b600109c0).stop 2020-04-22T14:14:01.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.784+0000 7f4b6f793700 1 -- 172.21.15.103:0/1183658737 shutdown_connections 2020-04-22T14:14:01.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.784+0000 7f4b6f793700 1 --2- 172.21.15.103:0/1183658737 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4b4804d9d0 0x7f4b4804fe90 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:01.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.784+0000 7f4b6f793700 1 --2- 172.21.15.103:0/1183658737 >> v2:172.21.15.86:3300/0 conn(0x7f4b50003720 0x7f4b68145290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:01.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.784+0000 7f4b6f793700 1 --2- 172.21.15.103:0/1183658737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b68157280 0x7f4b681576a0 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:01.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.784+0000 7f4b6f793700 1 --2- 172.21.15.103:0/1183658737 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b68154460 0x7f4b681456f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:01.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.784+0000 7f4b6f793700 1 -- 172.21.15.103:0/1183658737 >> 172.21.15.103:0/1183658737 conn(0x7f4b680b9160 msgr2=0x7f4b68138110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:01.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.784+0000 7f4b6f793700 1 -- 172.21.15.103:0/1183658737 shutdown_connections 2020-04-22T14:14:01.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.784+0000 7f4b6f793700 1 -- 172.21.15.103:0/1183658737 wait complete. 2020-04-22T14:14:01.798 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:01.812 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:14:01.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.962+0000 7f141c98e700 1 Processor -- start 2020-04-22T14:14:01.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.962+0000 7f141c98e700 1 -- start start 2020-04-22T14:14:01.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.963+0000 7f141c98e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f14180666e0 0x7f14180633c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:01.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.963+0000 7f141c98e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1418025b90 con 0x7f14180b9880 2020-04-22T14:14:01.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.963+0000 7f141c98e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1418066ac0 con 0x7f14180b6f00 2020-04-22T14:14:01.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.963+0000 7f141c98e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1418024ea0 con 0x7f14180666e0 2020-04-22T14:14:01.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.963+0000 7f141d18f700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f14180b6f00 0x7f14181556f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46504/0 (socket says 172.21.15.103:46504) 2020-04-22T14:14:01.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.963+0000 7f141d18f700 1 -- 172.21.15.103:0/3684003605 learned_addr learned my addr 172.21.15.103:0/3684003605 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:14:01.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.963+0000 7f141759e700 1 --2- 172.21.15.103:0/3684003605 >> v2:172.21.15.86:3300/0 conn(0x7f14180666e0 0x7f14180633c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:01.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.963+0000 7f1416d9d700 1 -- 172.21.15.103:0/3684003605 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 472683930 0 0) 0x7f1418066ac0 con 0x7f14180b6f00 2020-04-22T14:14:01.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.963+0000 7f1416d9d700 1 -- 172.21.15.103:0/3684003605 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1404003230 con 0x7f14180b6f00 2020-04-22T14:14:01.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.963+0000 7f1416d9d700 1 -- 172.21.15.103:0/3684003605 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4102988846 0 0) 0x7f1404003230 con 0x7f14180b6f00 2020-04-22T14:14:01.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.963+0000 7f1416d9d700 1 -- 172.21.15.103:0/3684003605 >> v2:172.21.15.86:3300/0 conn(0x7f14180666e0 msgr2=0x7f14180633c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:01.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.963+0000 7f1416d9d700 1 --2- 172.21.15.103:0/3684003605 >> v2:172.21.15.86:3300/0 conn(0x7f14180666e0 0x7f14180633c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:01.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.963+0000 7f1416d9d700 1 -- 172.21.15.103:0/3684003605 >> v1:172.21.15.86:6789/0 conn(0x7f14180b9880 legacy=0x7f1418154fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:01.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.963+0000 7f1416d9d700 1 -- 172.21.15.103:0/3684003605 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1418024c00 con 0x7f14180b6f00 2020-04-22T14:14:01.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.963+0000 7f1416d9d700 1 -- 172.21.15.103:0/3684003605 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f1410001a50 con 0x7f14180b6f00 2020-04-22T14:14:01.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.963+0000 7f1416d9d700 1 -- 172.21.15.103:0/3684003605 >> v1:172.21.15.103:6789/0 conn(0x7f14180b6f00 legacy=0x7f14181556f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:01.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.963+0000 7f1416d9d700 1 --2- 172.21.15.103:0/3684003605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1404003720 0x7f1404003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:01.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.963+0000 7f1416d9d700 1 --2- 172.21.15.103:0/3684003605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14040044d0 0x7f1404004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:01.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.963+0000 7f1416d9d700 1 --2- 172.21.15.103:0/3684003605 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1404004db0 0x7f140400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:01.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.963+0000 7f141759e700 1 --2- 172.21.15.103:0/3684003605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1404003720 0x7f1404003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:01.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.963+0000 7f1416d9d700 1 -- 172.21.15.103:0/3684003605 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1418024ea0 con 0x7f1404004db0 2020-04-22T14:14:01.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.963+0000 7f1416d9d700 1 -- 172.21.15.103:0/3684003605 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14040041c0 con 0x7f1404003720 2020-04-22T14:14:01.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.963+0000 7f1416d9d700 1 -- 172.21.15.103:0/3684003605 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f140404fb90 con 0x7f14040044d0 2020-04-22T14:14:01.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.964+0000 7f141d18f700 1 --2- 172.21.15.103:0/3684003605 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1404004db0 0x7f140400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:01.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.964+0000 7f140ffff700 1 --2- 172.21.15.103:0/3684003605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14040044d0 0x7f1404004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:01.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.964+0000 7f141759e700 1 -- 172.21.15.103:0/3684003605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14040044d0 msgr2=0x7f1404004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:01.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.964+0000 7f141759e700 1 --2- 172.21.15.103:0/3684003605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14040044d0 0x7f1404004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:01.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.964+0000 7f141759e700 1 -- 172.21.15.103:0/3684003605 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1404004db0 msgr2=0x7f140400b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:01.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.964+0000 7f141759e700 1 --2- 172.21.15.103:0/3684003605 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1404004db0 0x7f140400b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:01.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.964+0000 7f141d18f700 1 -- 172.21.15.103:0/3684003605 reap_dead start 2020-04-22T14:14:01.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.964+0000 7f141759e700 1 -- 172.21.15.103:0/3684003605 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1404003230 con 0x7f1404003720 2020-04-22T14:14:01.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.964+0000 7f141759e700 1 --2- 172.21.15.103:0/3684003605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1404003720 0x7f1404003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f14040054a0 tx=0x7f1408007dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.964+0000 7f141759e700 1 --2- 172.21.15.103:0/3684003605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1404003720 0x7f1404003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f14040054a0 tx=0x7f1408007dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.964+0000 7f141759e700 1 --2- 172.21.15.103:0/3684003605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1404003720 0x7f1404003b40 secure :-1 s=READY pgs=1350 cs=0 l=1 rx=0x7f14040054a0 tx=0x7f1408007dd0).ready entity=mon.1 client_cookie=40de54218552bf52 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:01.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.964+0000 7f141759e700 1 --2- 172.21.15.103:0/3684003605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1404003720 0x7f1404003b40 secure :-1 s=THROTTLE_DONE pgs=1350 cs=0 l=1 rx=0x7f14040054a0 tx=0x7f1408007dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.964+0000 7f1416d9d700 1 -- 172.21.15.103:0/3684003605 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1408008d00 con 0x7f1404003720 2020-04-22T14:14:01.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.964+0000 7f141759e700 1 --2- 172.21.15.103:0/3684003605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1404003720 0x7f1404003b40 secure :-1 s=THROTTLE_DONE pgs=1350 cs=0 l=1 rx=0x7f14040054a0 tx=0x7f1408007dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.964+0000 7f141759e700 1 --2- 172.21.15.103:0/3684003605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1404003720 0x7f1404003b40 secure :-1 s=THROTTLE_DONE pgs=1350 cs=0 l=1 rx=0x7f14040054a0 tx=0x7f1408007dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.964+0000 7f1416d9d700 1 -- 172.21.15.103:0/3684003605 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1408008e60 con 0x7f1404003720 2020-04-22T14:14:01.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.964+0000 7f1416d9d700 1 -- 172.21.15.103:0/3684003605 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1408010a20 con 0x7f1404003720 2020-04-22T14:14:01.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.964+0000 7f141c98e700 1 -- 172.21.15.103:0/3684003605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1404003720 msgr2=0x7f1404003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:01.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.964+0000 7f141c98e700 1 --2- 172.21.15.103:0/3684003605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1404003720 0x7f1404003b40 secure :-1 s=READY pgs=1350 cs=0 l=1 rx=0x7f14040054a0 tx=0x7f1408007dd0).stop 2020-04-22T14:14:01.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.964+0000 7f141c98e700 1 -- 172.21.15.103:0/3684003605 shutdown_connections 2020-04-22T14:14:01.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.964+0000 7f141c98e700 1 --2- 172.21.15.103:0/3684003605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1404003720 0x7f1404003b40 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:01.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.964+0000 7f141c98e700 1 -- 172.21.15.103:0/3684003605 >> 172.21.15.103:0/3684003605 conn(0x7f1418060930 msgr2=0x7f1418060d40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:01.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.964+0000 7f141c98e700 1 -- 172.21.15.103:0/3684003605 shutdown_connections 2020-04-22T14:14:01.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.964+0000 7f141c98e700 1 -- 172.21.15.103:0/3684003605 wait complete. 2020-04-22T14:14:01.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.966+0000 7f141c98e700 1 Processor -- start 2020-04-22T14:14:01.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.966+0000 7f141c98e700 1 -- start start 2020-04-22T14:14:01.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.966+0000 7f141c98e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1404003720 0x7f1418070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:01.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.966+0000 7f141c98e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1418071310 0x7f141805add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:01.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.966+0000 7f141c98e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14180b17c0 con 0x7f141805b230 2020-04-22T14:14:01.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.966+0000 7f141c98e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14180b0830 con 0x7f1404003720 2020-04-22T14:14:01.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.966+0000 7f141c98e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14180b0970 con 0x7f1418071310 2020-04-22T14:14:01.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.966+0000 7f141759e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1404003720 0x7f1418070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:01.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.966+0000 7f141759e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1404003720 0x7f1418070eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54326/0 (socket says 172.21.15.103:54326) 2020-04-22T14:14:01.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.966+0000 7f141759e700 1 -- 172.21.15.103:0/3938493109 learned_addr learned my addr 172.21.15.103:0/3938493109 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:14:01.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.967+0000 7f140ffff700 1 --2- 172.21.15.103:0/3938493109 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1418071310 0x7f141805add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:01.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.967+0000 7f141759e700 1 -- 172.21.15.103:0/3938493109 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1418071310 msgr2=0x7f141805add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:01.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.967+0000 7f141759e700 1 --2- 172.21.15.103:0/3938493109 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1418071310 0x7f141805add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:01.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.967+0000 7f141759e700 1 -- 172.21.15.103:0/3938493109 >> v1:172.21.15.86:6789/0 conn(0x7f141805b230 legacy=0x7f141813f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:01.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.967+0000 7f141759e700 1 -- 172.21.15.103:0/3938493109 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1418140210 con 0x7f1404003720 2020-04-22T14:14:01.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.967+0000 7f140ffff700 1 --2- 172.21.15.103:0/3938493109 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1418071310 0x7f141805add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:14:01.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.967+0000 7f141759e700 1 --2- 172.21.15.103:0/3938493109 >> v2:172.21.15.103:3300/0 conn(0x7f1404003720 0x7f1418070eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1418070dc0 tx=0x7f1408007dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.967+0000 7f141759e700 1 --2- 172.21.15.103:0/3938493109 >> v2:172.21.15.103:3300/0 conn(0x7f1404003720 0x7f1418070eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1418070dc0 tx=0x7f1408007dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.967+0000 7f141759e700 1 --2- 172.21.15.103:0/3938493109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1404003720 0x7f1418070eb0 secure :-1 s=READY pgs=1351 cs=0 l=1 rx=0x7f1418070dc0 tx=0x7f1408007dd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:01.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.967+0000 7f141759e700 1 --2- 172.21.15.103:0/3938493109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1404003720 0x7f1418070eb0 secure :-1 s=THROTTLE_DONE pgs=1351 cs=0 l=1 rx=0x7f1418070dc0 tx=0x7f1408007dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.967+0000 7f141759e700 1 --2- 172.21.15.103:0/3938493109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1404003720 0x7f1418070eb0 secure :-1 s=THROTTLE_DONE pgs=1351 cs=0 l=1 rx=0x7f1418070dc0 tx=0x7f1408007dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.967+0000 7f1414d99700 1 -- 172.21.15.103:0/3938493109 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1408010e80 con 0x7f1404003720 2020-04-22T14:14:01.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.967+0000 7f141759e700 1 --2- 172.21.15.103:0/3938493109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1404003720 0x7f1418070eb0 secure :-1 s=THROTTLE_DONE pgs=1351 cs=0 l=1 rx=0x7f1418070dc0 tx=0x7f1408007dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.967+0000 7f1414d99700 1 -- 172.21.15.103:0/3938493109 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1408010330 con 0x7f1404003720 2020-04-22T14:14:01.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.967+0000 7f141c98e700 1 -- 172.21.15.103:0/3938493109 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f141813fb90 con 0x7f1404003720 2020-04-22T14:14:01.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.967+0000 7f1414d99700 1 -- 172.21.15.103:0/3938493109 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1408007880 con 0x7f1404003720 2020-04-22T14:14:01.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.967+0000 7f141c98e700 1 -- 172.21.15.103:0/3938493109 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1418149610 con 0x7f1404003720 2020-04-22T14:14:01.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.968+0000 7f141759e700 1 --2- 172.21.15.103:0/3938493109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1404003720 0x7f1418070eb0 secure :-1 s=THROTTLE_DONE pgs=1351 cs=0 l=1 rx=0x7f1418070dc0 tx=0x7f1408007dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.968+0000 7f1414d99700 1 -- 172.21.15.103:0/3938493109 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f1408005af0 con 0x7f1404003720 2020-04-22T14:14:01.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.968+0000 7f141759e700 1 --2- 172.21.15.103:0/3938493109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1404003720 0x7f1418070eb0 secure :-1 s=THROTTLE_DONE pgs=1351 cs=0 l=1 rx=0x7f1418070dc0 tx=0x7f1408007dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.968+0000 7f141c98e700 1 -- 172.21.15.103:0/3938493109 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1418056c90 con 0x7f1404003720 2020-04-22T14:14:01.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.968+0000 7f1414d99700 1 --2- 172.21.15.103:0/3938493109 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f13fc04da40 0x7f13fc04ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:01.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.968+0000 7f1414d99700 1 -- 172.21.15.103:0/3938493109 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f14080615d0 con 0x7f1404003720 2020-04-22T14:14:01.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.969+0000 7f140ffff700 1 --2- 172.21.15.103:0/3938493109 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f13fc04da40 0x7f13fc04ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:01.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.969+0000 7f140ffff700 1 --2- 172.21.15.103:0/3938493109 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f13fc04da40 0x7f13fc04ff00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f14180ba430 tx=0x7f140000c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.969+0000 7f140ffff700 1 --2- 172.21.15.103:0/3938493109 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f13fc04da40 0x7f13fc04ff00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f14180ba430 tx=0x7f140000c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.969+0000 7f140ffff700 1 --2- 172.21.15.103:0/3938493109 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f13fc04da40 0x7f13fc04ff00 secure :-1 s=READY pgs=495 cs=0 l=1 rx=0x7f14180ba430 tx=0x7f140000c820).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:01.991 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.972+0000 7f141759e700 1 --2- 172.21.15.103:0/3938493109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1404003720 0x7f1418070eb0 secure :-1 s=THROTTLE_DONE pgs=1351 cs=0 l=1 rx=0x7f1418070dc0 tx=0x7f1408007dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:01.991 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:01.972+0000 7f1414d99700 1 -- 172.21.15.103:0/3938493109 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f140803ca70 con 0x7f1404003720 2020-04-22T14:14:02.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.162+0000 7f141c98e700 1 -- 172.21.15.103:0/3938493109 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f1418071f10 con 0x7f1404003720 2020-04-22T14:14:02.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.166+0000 7f141759e700 1 --2- 172.21.15.103:0/3938493109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1404003720 0x7f1418070eb0 secure :-1 s=THROTTLE_DONE pgs=1351 cs=0 l=1 rx=0x7f1418070dc0 tx=0x7f1408007dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:02.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.166+0000 7f1414d99700 1 -- 172.21.15.103:0/3938493109 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v33) v1 ==== 184+0+0 (secure 0 0 0) 0x7f1408040090 con 0x7f1404003720 2020-04-22T14:14:02.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.167+0000 7f141c98e700 1 -- 172.21.15.103:0/3938493109 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f13fc04da40 msgr2=0x7f13fc04ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:02.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.167+0000 7f141c98e700 1 --2- 172.21.15.103:0/3938493109 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f13fc04da40 0x7f13fc04ff00 secure :-1 s=READY pgs=495 cs=0 l=1 rx=0x7f14180ba430 tx=0x7f140000c820).stop 2020-04-22T14:14:02.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.167+0000 7f141c98e700 1 -- 172.21.15.103:0/3938493109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1404003720 msgr2=0x7f1418070eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:02.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.167+0000 7f141c98e700 1 --2- 172.21.15.103:0/3938493109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1404003720 0x7f1418070eb0 secure :-1 s=READY pgs=1351 cs=0 l=1 rx=0x7f1418070dc0 tx=0x7f1408007dd0).stop 2020-04-22T14:14:02.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.168+0000 7f141c98e700 1 -- 172.21.15.103:0/3938493109 shutdown_connections 2020-04-22T14:14:02.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.168+0000 7f141c98e700 1 --2- 172.21.15.103:0/3938493109 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f13fc04da40 0x7f13fc04ff00 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:02.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.168+0000 7f141c98e700 1 --2- 172.21.15.103:0/3938493109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1404003720 0x7f1418070eb0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:02.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.168+0000 7f141c98e700 1 --2- 172.21.15.103:0/3938493109 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1418071310 0x7f141805add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:02.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.168+0000 7f141c98e700 1 -- 172.21.15.103:0/3938493109 >> 172.21.15.103:0/3938493109 conn(0x7f1418060930 msgr2=0x7f14180b7870 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:02.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.168+0000 7f141c98e700 1 -- 172.21.15.103:0/3938493109 shutdown_connections 2020-04-22T14:14:02.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.168+0000 7f141c98e700 1 -- 172.21.15.103:0/3938493109 wait complete. 2020-04-22T14:14:02.186 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.0 2020-04-22T14:14:02.187 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:02.201 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:14:02.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.349+0000 7f7086c27700 1 Processor -- start 2020-04-22T14:14:02.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.349+0000 7f7086c27700 1 -- start start 2020-04-22T14:14:02.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.350+0000 7f7086c27700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70800633c0 0x7f70800b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:02.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.350+0000 7f7086c27700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f70800b6350 0x7f70800b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:02.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.350+0000 7f7086c27700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7080025b90 con 0x7f70800666e0 2020-04-22T14:14:02.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.350+0000 7f7086c27700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7080066ac0 con 0x7f70800b6350 2020-04-22T14:14:02.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.350+0000 7f7086c27700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7080024ea0 con 0x7f70800633c0 2020-04-22T14:14:02.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.350+0000 7f7087e89700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f70800b6350 0x7f70800b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:02.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.350+0000 7f7086426700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f70800666e0 0x7f70800b9880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46520/0 (socket says 172.21.15.103:46520) 2020-04-22T14:14:02.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.350+0000 7f7086426700 1 -- 172.21.15.103:0/311368944 learned_addr learned my addr 172.21.15.103:0/311368944 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:14:02.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.351+0000 7f7085c25700 1 --2- 172.21.15.103:0/311368944 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70800633c0 0x7f70800b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:02.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.351+0000 7f7087e89700 1 -- 172.21.15.103:0/311368944 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70800633c0 msgr2=0x7f70800b5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:02.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.351+0000 7f7087e89700 1 --2- 172.21.15.103:0/311368944 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70800633c0 0x7f70800b5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:02.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.351+0000 7f7087e89700 1 -- 172.21.15.103:0/311368944 >> v1:172.21.15.103:6789/0 conn(0x7f70800666e0 legacy=0x7f70800b9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:02.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.351+0000 7f7087e89700 1 -- 172.21.15.103:0/311368944 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7080155ff0 con 0x7f70800b6350 2020-04-22T14:14:02.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.351+0000 7f7085424700 1 -- 172.21.15.103:0/311368944 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1209920 0 0) 0x7f7080025b90 con 0x7f70800666e0 2020-04-22T14:14:02.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.351+0000 7f7087e89700 1 --2- 172.21.15.103:0/311368944 >> v2:172.21.15.103:3300/0 conn(0x7f70800b6350 0x7f70800b6780 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f70780032b0 tx=0x7f7078007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:02.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.351+0000 7f7087e89700 1 --2- 172.21.15.103:0/311368944 >> v2:172.21.15.103:3300/0 conn(0x7f70800b6350 0x7f70800b6780 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f70780032b0 tx=0x7f7078007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:02.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.351+0000 7f7087e89700 1 --2- 172.21.15.103:0/311368944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70800b6350 0x7f70800b6780 secure :-1 s=READY pgs=1353 cs=0 l=1 rx=0x7f70780032b0 tx=0x7f7078007dc0).ready entity=mon.1 client_cookie=473124ef3a1c49b5 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:02.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.351+0000 7f7087e89700 1 --2- 172.21.15.103:0/311368944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70800b6350 0x7f70800b6780 secure :-1 s=THROTTLE_DONE pgs=1353 cs=0 l=1 rx=0x7f70780032b0 tx=0x7f7078007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:02.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.351+0000 7f7085424700 1 -- 172.21.15.103:0/311368944 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f707800a180 con 0x7f70800b6350 2020-04-22T14:14:02.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.351+0000 7f7087e89700 1 --2- 172.21.15.103:0/311368944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70800b6350 0x7f70800b6780 secure :-1 s=THROTTLE_DONE pgs=1353 cs=0 l=1 rx=0x7f70780032b0 tx=0x7f7078007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:02.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.351+0000 7f7087e89700 1 --2- 172.21.15.103:0/311368944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70800b6350 0x7f70800b6780 secure :-1 s=THROTTLE_DONE pgs=1353 cs=0 l=1 rx=0x7f70780032b0 tx=0x7f7078007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:02.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.351+0000 7f7085424700 1 -- 172.21.15.103:0/311368944 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707800a320 con 0x7f70800b6350 2020-04-22T14:14:02.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.351+0000 7f7085424700 1 -- 172.21.15.103:0/311368944 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f707800a700 con 0x7f70800b6350 2020-04-22T14:14:02.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.351+0000 7f7086c27700 1 -- 172.21.15.103:0/311368944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70800b6350 msgr2=0x7f70800b6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:02.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.351+0000 7f7086c27700 1 --2- 172.21.15.103:0/311368944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70800b6350 0x7f70800b6780 secure :-1 s=READY pgs=1353 cs=0 l=1 rx=0x7f70780032b0 tx=0x7f7078007dc0).stop 2020-04-22T14:14:02.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.351+0000 7f7086c27700 1 -- 172.21.15.103:0/311368944 shutdown_connections 2020-04-22T14:14:02.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.351+0000 7f7086c27700 1 --2- 172.21.15.103:0/311368944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70800b6350 0x7f70800b6780 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:02.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.351+0000 7f7086c27700 1 --2- 172.21.15.103:0/311368944 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70800633c0 0x7f70800b5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:02.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.351+0000 7f7086c27700 1 -- 172.21.15.103:0/311368944 >> 172.21.15.103:0/311368944 conn(0x7f7080060930 msgr2=0x7f7080060d40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:02.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.352+0000 7f7086c27700 1 -- 172.21.15.103:0/311368944 shutdown_connections 2020-04-22T14:14:02.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.352+0000 7f7086c27700 1 -- 172.21.15.103:0/311368944 wait complete. 2020-04-22T14:14:02.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.353+0000 7f7086c27700 1 Processor -- start 2020-04-22T14:14:02.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.353+0000 7f7086c27700 1 -- start start 2020-04-22T14:14:02.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.353+0000 7f7086c27700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70800633c0 0x7f7080134a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:02.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.353+0000 7f7086c27700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f70800666e0 0x7f7080122660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:02.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.353+0000 7f7086c27700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7080134e70 con 0x7f70800b6350 2020-04-22T14:14:02.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.353+0000 7f7086c27700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70800ad460 con 0x7f70800666e0 2020-04-22T14:14:02.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.353+0000 7f7086c27700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70800ad650 con 0x7f70800633c0 2020-04-22T14:14:02.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.353+0000 7f7085c25700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f70800666e0 0x7f7080122660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:02.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.353+0000 7f7086426700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70800633c0 0x7f7080134a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:02.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.353+0000 7f7085c25700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f70800666e0 0x7f7080122660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:51572/0 (socket says 172.21.15.103:51572) 2020-04-22T14:14:02.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.353+0000 7f7085c25700 1 -- 172.21.15.103:0/3739706662 learned_addr learned my addr 172.21.15.103:0/3739706662 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:14:02.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.354+0000 7f7085c25700 1 -- 172.21.15.103:0/3739706662 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70800633c0 msgr2=0x7f7080134a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:02.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.354+0000 7f7085c25700 1 --2- 172.21.15.103:0/3739706662 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70800633c0 0x7f7080134a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:02.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.354+0000 7f7085c25700 1 -- 172.21.15.103:0/3739706662 >> v1:172.21.15.86:6789/0 conn(0x7f70800b6350 legacy=0x7f70800ae030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:02.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.354+0000 7f7076ffd700 1 -- 172.21.15.103:0/3739706662 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2464207843 0 0) 0x7f7080155ff0 con 0x7f70800b6350 2020-04-22T14:14:02.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.354+0000 7f7085c25700 1 -- 172.21.15.103:0/3739706662 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70800ad8f0 con 0x7f70800666e0 2020-04-22T14:14:02.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.354+0000 7f7086426700 1 --2- 172.21.15.103:0/3739706662 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70800633c0 0x7f7080134a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:14:02.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.354+0000 7f7085c25700 1 --2- 172.21.15.103:0/3739706662 >> v2:172.21.15.86:3300/0 conn(0x7f70800666e0 0x7f7080122660 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7070002f30 tx=0x7f7070010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:02.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.354+0000 7f7085c25700 1 --2- 172.21.15.103:0/3739706662 >> v2:172.21.15.86:3300/0 conn(0x7f70800666e0 0x7f7080122660 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7070002f30 tx=0x7f7070010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:02.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.354+0000 7f7085c25700 1 --2- 172.21.15.103:0/3739706662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70800666e0 0x7f7080122660 secure :-1 s=READY pgs=725 cs=0 l=1 rx=0x7f7070002f30 tx=0x7f7070010c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:02.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.354+0000 7f7085c25700 1 --2- 172.21.15.103:0/3739706662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70800666e0 0x7f7080122660 secure :-1 s=THROTTLE_DONE pgs=725 cs=0 l=1 rx=0x7f7070002f30 tx=0x7f7070010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:02.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.354+0000 7f7076ffd700 1 -- 172.21.15.103:0/3739706662 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7070005e90 con 0x7f70800666e0 2020-04-22T14:14:02.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.354+0000 7f7085c25700 1 --2- 172.21.15.103:0/3739706662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70800666e0 0x7f7080122660 secure :-1 s=THROTTLE_DONE pgs=725 cs=0 l=1 rx=0x7f7070002f30 tx=0x7f7070010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:02.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.354+0000 7f7076ffd700 1 -- 172.21.15.103:0/3739706662 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7070007180 con 0x7f70800666e0 2020-04-22T14:14:02.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.354+0000 7f7086c27700 1 -- 172.21.15.103:0/3739706662 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70800adb90 con 0x7f70800666e0 2020-04-22T14:14:02.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.354+0000 7f7085c25700 1 --2- 172.21.15.103:0/3739706662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70800666e0 0x7f7080122660 secure :-1 s=THROTTLE_DONE pgs=725 cs=0 l=1 rx=0x7f7070002f30 tx=0x7f7070010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:02.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.354+0000 7f7076ffd700 1 -- 172.21.15.103:0/3739706662 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7070007520 con 0x7f70800666e0 2020-04-22T14:14:02.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.354+0000 7f7086c27700 1 -- 172.21.15.103:0/3739706662 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f708005adf0 con 0x7f70800666e0 2020-04-22T14:14:02.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.355+0000 7f7085c25700 1 --2- 172.21.15.103:0/3739706662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70800666e0 0x7f7080122660 secure :-1 s=THROTTLE_DONE pgs=725 cs=0 l=1 rx=0x7f7070002f30 tx=0x7f7070010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:02.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.355+0000 7f7086c27700 1 -- 172.21.15.103:0/3739706662 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70800add20 con 0x7f70800666e0 2020-04-22T14:14:02.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.355+0000 7f7076ffd700 1 -- 172.21.15.103:0/3739706662 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f707000e350 con 0x7f70800666e0 2020-04-22T14:14:02.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.355+0000 7f7085c25700 1 --2- 172.21.15.103:0/3739706662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70800666e0 0x7f7080122660 secure :-1 s=THROTTLE_DONE pgs=725 cs=0 l=1 rx=0x7f7070002f30 tx=0x7f7070010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:02.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.356+0000 7f7076ffd700 1 --2- 172.21.15.103:0/3739706662 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f706804d800 0x7f706804fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:02.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.356+0000 7f7076ffd700 1 -- 172.21.15.103:0/3739706662 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7070061940 con 0x7f70800666e0 2020-04-22T14:14:02.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.356+0000 7f7086426700 1 --2- 172.21.15.103:0/3739706662 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f706804d800 0x7f706804fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:02.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.356+0000 7f7086426700 1 --2- 172.21.15.103:0/3739706662 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f706804d800 0x7f706804fcc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f707c000b80 tx=0x7f707c00cca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:02.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.356+0000 7f7086426700 1 --2- 172.21.15.103:0/3739706662 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f706804d800 0x7f706804fcc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f707c000b80 tx=0x7f707c00cca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:02.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.356+0000 7f7086426700 1 --2- 172.21.15.103:0/3739706662 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f706804d800 0x7f706804fcc0 secure :-1 s=READY pgs=496 cs=0 l=1 rx=0x7f707c000b80 tx=0x7f707c00cca0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:02.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.360+0000 7f7085c25700 1 --2- 172.21.15.103:0/3739706662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70800666e0 0x7f7080122660 secure :-1 s=THROTTLE_DONE pgs=725 cs=0 l=1 rx=0x7f7070002f30 tx=0x7f7070010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:02.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.360+0000 7f7076ffd700 1 -- 172.21.15.103:0/3739706662 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f707003ccc0 con 0x7f70800666e0 2020-04-22T14:14:02.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.554+0000 7f7086c27700 1 -- 172.21.15.103:0/3739706662 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f7080056c90 con 0x7f70800666e0 2020-04-22T14:14:02.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.557+0000 7f7085c25700 1 --2- 172.21.15.103:0/3739706662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70800666e0 0x7f7080122660 secure :-1 s=THROTTLE_DONE pgs=725 cs=0 l=1 rx=0x7f7070002f30 tx=0x7f7070010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:02.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.557+0000 7f7076ffd700 1 -- 172.21.15.103:0/3739706662 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v34) v1 ==== 184+0+0 (secure 0 0 0) 0x7f70700402e0 con 0x7f70800666e0 2020-04-22T14:14:02.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.558+0000 7f7086c27700 1 -- 172.21.15.103:0/3739706662 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f706804d800 msgr2=0x7f706804fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:02.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.558+0000 7f7086c27700 1 --2- 172.21.15.103:0/3739706662 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f706804d800 0x7f706804fcc0 secure :-1 s=READY pgs=496 cs=0 l=1 rx=0x7f707c000b80 tx=0x7f707c00cca0).stop 2020-04-22T14:14:02.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.558+0000 7f7086c27700 1 -- 172.21.15.103:0/3739706662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70800666e0 msgr2=0x7f7080122660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:02.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.558+0000 7f7086c27700 1 --2- 172.21.15.103:0/3739706662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70800666e0 0x7f7080122660 secure :-1 s=READY pgs=725 cs=0 l=1 rx=0x7f7070002f30 tx=0x7f7070010c70).stop 2020-04-22T14:14:02.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.558+0000 7f7086c27700 1 -- 172.21.15.103:0/3739706662 shutdown_connections 2020-04-22T14:14:02.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.558+0000 7f7086c27700 1 --2- 172.21.15.103:0/3739706662 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70800633c0 0x7f7080134a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:02.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.558+0000 7f7086c27700 1 --2- 172.21.15.103:0/3739706662 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f706804d800 0x7f706804fcc0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:02.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.558+0000 7f7086c27700 1 --2- 172.21.15.103:0/3739706662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70800666e0 0x7f7080122660 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:02.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.559+0000 7f7086c27700 1 -- 172.21.15.103:0/3739706662 >> 172.21.15.103:0/3739706662 conn(0x7f7080060930 msgr2=0x7f70800b9990 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:02.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.559+0000 7f7086c27700 1 -- 172.21.15.103:0/3739706662 shutdown_connections 2020-04-22T14:14:02.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.559+0000 7f7086c27700 1 -- 172.21.15.103:0/3739706662 wait complete. 2020-04-22T14:14:02.563 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.1 2020-04-22T14:14:02.572 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:02.589 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:14:02.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.736+0000 7ff49c8fb700 1 Processor -- start 2020-04-22T14:14:02.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.736+0000 7ff49c8fb700 1 -- start start 2020-04-22T14:14:02.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.737+0000 7ff49c8fb700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4980666e0 0x7ff4980633c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:02.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.737+0000 7ff49c8fb700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff4980b6f00 0x7ff4980b9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:02.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.737+0000 7ff49c8fb700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff498025b90 con 0x7ff4980b9880 2020-04-22T14:14:02.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.737+0000 7ff49c8fb700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff498066ac0 con 0x7ff4980b6f00 2020-04-22T14:14:02.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.737+0000 7ff49c8fb700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff498024ea0 con 0x7ff4980666e0 2020-04-22T14:14:02.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.737+0000 7ff49d0fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff4980b6f00 0x7ff4980b9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:02.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.737+0000 7ff49d0fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff4980b6f00 0x7ff4980b9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54348/0 (socket says 172.21.15.103:54348) 2020-04-22T14:14:02.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.737+0000 7ff49d0fc700 1 -- 172.21.15.103:0/275332289 learned_addr learned my addr 172.21.15.103:0/275332289 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:14:02.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.738+0000 7ff49759e700 1 --2- 172.21.15.103:0/275332289 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4980666e0 0x7ff4980633c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:02.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.738+0000 7ff49d0fc700 1 -- 172.21.15.103:0/275332289 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4980666e0 msgr2=0x7ff4980633c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:02.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.738+0000 7ff49d0fc700 1 --2- 172.21.15.103:0/275332289 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4980666e0 0x7ff4980633c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:02.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.738+0000 7ff49d0fc700 1 -- 172.21.15.103:0/275332289 >> v1:172.21.15.103:6789/0 conn(0x7ff4980b9880 legacy=0x7ff498154fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:02.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.738+0000 7ff49d0fc700 1 -- 172.21.15.103:0/275332289 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff498024c00 con 0x7ff4980b6f00 2020-04-22T14:14:02.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.738+0000 7ff49659c700 1 -- 172.21.15.103:0/275332289 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3214590059 0 0) 0x7ff498025b90 con 0x7ff4980b9880 2020-04-22T14:14:02.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.738+0000 7ff49d0fc700 1 --2- 172.21.15.103:0/275332289 >> v2:172.21.15.103:3300/0 conn(0x7ff4980b6f00 0x7ff4980b9ce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff490002f30 tx=0x7ff490007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:02.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.738+0000 7ff49d0fc700 1 --2- 172.21.15.103:0/275332289 >> v2:172.21.15.103:3300/0 conn(0x7ff4980b6f00 0x7ff4980b9ce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff490002f30 tx=0x7ff490007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:02.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.738+0000 7ff49d0fc700 1 --2- 172.21.15.103:0/275332289 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4980b6f00 0x7ff4980b9ce0 secure :-1 s=READY pgs=1355 cs=0 l=1 rx=0x7ff490002f30 tx=0x7ff490007a40).ready entity=mon.1 client_cookie=c390b3b693cdaf58 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:02.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.738+0000 7ff49d0fc700 1 --2- 172.21.15.103:0/275332289 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4980b6f00 0x7ff4980b9ce0 secure :-1 s=THROTTLE_DONE pgs=1355 cs=0 l=1 rx=0x7ff490002f30 tx=0x7ff490007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:02.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.738+0000 7ff49659c700 1 -- 172.21.15.103:0/275332289 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff490011720 con 0x7ff4980b6f00 2020-04-22T14:14:02.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.738+0000 7ff49d0fc700 1 --2- 172.21.15.103:0/275332289 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4980b6f00 0x7ff4980b9ce0 secure :-1 s=THROTTLE_DONE pgs=1355 cs=0 l=1 rx=0x7ff490002f30 tx=0x7ff490007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:02.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.738+0000 7ff49659c700 1 -- 172.21.15.103:0/275332289 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff490011880 con 0x7ff4980b6f00 2020-04-22T14:14:02.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.738+0000 7ff49d0fc700 1 --2- 172.21.15.103:0/275332289 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4980b6f00 0x7ff4980b9ce0 secure :-1 s=THROTTLE_DONE pgs=1355 cs=0 l=1 rx=0x7ff490002f30 tx=0x7ff490007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:02.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.738+0000 7ff49659c700 1 -- 172.21.15.103:0/275332289 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff490011be0 con 0x7ff4980b6f00 2020-04-22T14:14:02.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.738+0000 7ff49c8fb700 1 -- 172.21.15.103:0/275332289 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4980b6f00 msgr2=0x7ff4980b9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:02.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.738+0000 7ff49c8fb700 1 --2- 172.21.15.103:0/275332289 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4980b6f00 0x7ff4980b9ce0 secure :-1 s=READY pgs=1355 cs=0 l=1 rx=0x7ff490002f30 tx=0x7ff490007a40).stop 2020-04-22T14:14:02.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.738+0000 7ff49c8fb700 1 -- 172.21.15.103:0/275332289 shutdown_connections 2020-04-22T14:14:02.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.738+0000 7ff49c8fb700 1 --2- 172.21.15.103:0/275332289 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4980b6f00 0x7ff4980b9ce0 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:02.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.738+0000 7ff49c8fb700 1 --2- 172.21.15.103:0/275332289 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4980666e0 0x7ff4980633c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:02.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.738+0000 7ff49c8fb700 1 -- 172.21.15.103:0/275332289 >> 172.21.15.103:0/275332289 conn(0x7ff498060930 msgr2=0x7ff498060d40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:02.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.738+0000 7ff49c8fb700 1 -- 172.21.15.103:0/275332289 shutdown_connections 2020-04-22T14:14:02.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.738+0000 7ff49c8fb700 1 -- 172.21.15.103:0/275332289 wait complete. 2020-04-22T14:14:02.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.740+0000 7ff49c8fb700 1 Processor -- start 2020-04-22T14:14:02.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.740+0000 7ff49c8fb700 1 -- start start 2020-04-22T14:14:02.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.740+0000 7ff49c8fb700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4980b6f00 0x7ff4980af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:02.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.740+0000 7ff49c8fb700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff4980b9880 0x7ff498137830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:02.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.740+0000 7ff49c8fb700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49813b770 con 0x7ff4980666e0 2020-04-22T14:14:02.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.740+0000 7ff49c8fb700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff498155600 con 0x7ff4980b9880 2020-04-22T14:14:02.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.740+0000 7ff49c8fb700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff49813ba10 con 0x7ff4980b6f00 2020-04-22T14:14:02.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.741+0000 7ff496d9d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4980b6f00 0x7ff4980af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:02.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.741+0000 7ff49d0fc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff4980b9880 0x7ff498137830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:02.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.741+0000 7ff49d0fc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff4980b9880 0x7ff498137830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:51586/0 (socket says 172.21.15.103:51586) 2020-04-22T14:14:02.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.741+0000 7ff49d0fc700 1 -- 172.21.15.103:0/397146356 learned_addr learned my addr 172.21.15.103:0/397146356 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:14:02.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.741+0000 7ff49759e700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7ff4980666e0 0x7ff498137120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:35464/0 (socket says 172.21.15.103:35464) 2020-04-22T14:14:02.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.741+0000 7ff496d9d700 1 -- 172.21.15.103:0/397146356 >> v2:172.21.15.86:3300/0 conn(0x7ff4980b9880 msgr2=0x7ff498137830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:02.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.741+0000 7ff496d9d700 1 --2- 172.21.15.103:0/397146356 >> v2:172.21.15.86:3300/0 conn(0x7ff4980b9880 0x7ff498137830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:02.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.741+0000 7ff496d9d700 1 -- 172.21.15.103:0/397146356 >> v1:172.21.15.86:6789/0 conn(0x7ff4980666e0 legacy=0x7ff498137120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:02.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.741+0000 7ff496d9d700 1 -- 172.21.15.103:0/397146356 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49813bcb0 con 0x7ff4980b6f00 2020-04-22T14:14:02.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.741+0000 7ff496d9d700 1 --2- 172.21.15.103:0/397146356 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4980b6f00 0x7ff4980af7d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff48c000b80 tx=0x7ff48c001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:02.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.741+0000 7ff496d9d700 1 --2- 172.21.15.103:0/397146356 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4980b6f00 0x7ff4980af7d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff48c000b80 tx=0x7ff48c001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:02.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.741+0000 7ff496d9d700 1 --2- 172.21.15.103:0/397146356 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4980b6f00 0x7ff4980af7d0 secure :-1 s=READY pgs=128 cs=0 l=1 rx=0x7ff48c000b80 tx=0x7ff48c001e40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:02.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.741+0000 7ff496d9d700 1 --2- 172.21.15.103:0/397146356 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4980b6f00 0x7ff4980af7d0 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7ff48c000b80 tx=0x7ff48c001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:02.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.741+0000 7ff47ffff700 1 -- 172.21.15.103:0/397146356 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff48c00cd10 con 0x7ff4980b6f00 2020-04-22T14:14:02.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.741+0000 7ff496d9d700 1 --2- 172.21.15.103:0/397146356 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4980b6f00 0x7ff4980af7d0 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7ff48c000b80 tx=0x7ff48c001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:02.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.741+0000 7ff496d9d700 1 --2- 172.21.15.103:0/397146356 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4980b6f00 0x7ff4980af7d0 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7ff48c000b80 tx=0x7ff48c001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:02.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.741+0000 7ff47ffff700 1 -- 172.21.15.103:0/397146356 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48c00ce70 con 0x7ff4980b6f00 2020-04-22T14:14:02.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.741+0000 7ff49c8fb700 1 -- 172.21.15.103:0/397146356 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff49813c150 con 0x7ff4980b6f00 2020-04-22T14:14:02.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.741+0000 7ff47ffff700 1 -- 172.21.15.103:0/397146356 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff48c0110a0 con 0x7ff4980b6f00 2020-04-22T14:14:02.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.741+0000 7ff49c8fb700 1 -- 172.21.15.103:0/397146356 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff49813b2d0 con 0x7ff4980b6f00 2020-04-22T14:14:02.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.742+0000 7ff496d9d700 1 --2- 172.21.15.103:0/397146356 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4980b6f00 0x7ff4980af7d0 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7ff48c000b80 tx=0x7ff48c001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:02.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.742+0000 7ff49c8fb700 1 -- 172.21.15.103:0/397146356 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff49813b5e0 con 0x7ff4980b6f00 2020-04-22T14:14:02.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.743+0000 7ff47ffff700 1 -- 172.21.15.103:0/397146356 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ff48c0064e0 con 0x7ff4980b6f00 2020-04-22T14:14:02.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.743+0000 7ff496d9d700 1 --2- 172.21.15.103:0/397146356 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4980b6f00 0x7ff4980af7d0 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7ff48c000b80 tx=0x7ff48c001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:02.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.743+0000 7ff47ffff700 1 --2- 172.21.15.103:0/397146356 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff47804d930 0x7ff47804fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:02.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.743+0000 7ff47ffff700 1 -- 172.21.15.103:0/397146356 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff48c060f80 con 0x7ff4980b6f00 2020-04-22T14:14:02.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.743+0000 7ff49759e700 1 --2- 172.21.15.103:0/397146356 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff47804d930 0x7ff47804fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:02.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.743+0000 7ff49759e700 1 --2- 172.21.15.103:0/397146356 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff47804d930 0x7ff47804fdf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff4980ac9e0 tx=0x7ff488002670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:02.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.743+0000 7ff49759e700 1 --2- 172.21.15.103:0/397146356 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff47804d930 0x7ff47804fdf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff4980ac9e0 tx=0x7ff488002670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:02.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.743+0000 7ff49759e700 1 --2- 172.21.15.103:0/397146356 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff47804d930 0x7ff47804fdf0 secure :-1 s=READY pgs=497 cs=0 l=1 rx=0x7ff4980ac9e0 tx=0x7ff488002670).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:02.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.747+0000 7ff496d9d700 1 --2- 172.21.15.103:0/397146356 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4980b6f00 0x7ff4980af7d0 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7ff48c000b80 tx=0x7ff48c001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:02.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.747+0000 7ff47ffff700 1 -- 172.21.15.103:0/397146356 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ff48c03c300 con 0x7ff4980b6f00 2020-04-22T14:14:02.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.938+0000 7ff49c8fb700 1 -- 172.21.15.103:0/397146356 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7ff498056c90 con 0x7ff4980b6f00 2020-04-22T14:14:02.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.944+0000 7ff496d9d700 1 --2- 172.21.15.103:0/397146356 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4980b6f00 0x7ff4980af7d0 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7ff48c000b80 tx=0x7ff48c001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:02.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.945+0000 7ff47ffff700 1 -- 172.21.15.103:0/397146356 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v35) v1 ==== 184+0+0 (secure 0 0 0) 0x7ff48c03f920 con 0x7ff4980b6f00 2020-04-22T14:14:02.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.946+0000 7ff49c8fb700 1 -- 172.21.15.103:0/397146356 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff47804d930 msgr2=0x7ff47804fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:02.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.946+0000 7ff49c8fb700 1 --2- 172.21.15.103:0/397146356 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff47804d930 0x7ff47804fdf0 secure :-1 s=READY pgs=497 cs=0 l=1 rx=0x7ff4980ac9e0 tx=0x7ff488002670).stop 2020-04-22T14:14:02.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.946+0000 7ff49c8fb700 1 -- 172.21.15.103:0/397146356 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4980b6f00 msgr2=0x7ff4980af7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:02.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.946+0000 7ff49c8fb700 1 --2- 172.21.15.103:0/397146356 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4980b6f00 0x7ff4980af7d0 secure :-1 s=READY pgs=128 cs=0 l=1 rx=0x7ff48c000b80 tx=0x7ff48c001e40).stop 2020-04-22T14:14:02.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.946+0000 7ff49c8fb700 1 -- 172.21.15.103:0/397146356 shutdown_connections 2020-04-22T14:14:02.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.946+0000 7ff49c8fb700 1 --2- 172.21.15.103:0/397146356 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff47804d930 0x7ff47804fdf0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:02.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.946+0000 7ff49c8fb700 1 --2- 172.21.15.103:0/397146356 >> v2:172.21.15.86:3300/0 conn(0x7ff4980b9880 0x7ff498137830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:02.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.946+0000 7ff49c8fb700 1 --2- 172.21.15.103:0/397146356 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4980b6f00 0x7ff4980af7d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:02.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.946+0000 7ff49c8fb700 1 -- 172.21.15.103:0/397146356 >> 172.21.15.103:0/397146356 conn(0x7ff498060930 msgr2=0x7ff49812c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:02.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.946+0000 7ff49c8fb700 1 -- 172.21.15.103:0/397146356 shutdown_connections 2020-04-22T14:14:02.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:02.946+0000 7ff49c8fb700 1 -- 172.21.15.103:0/397146356 wait complete. 2020-04-22T14:14:02.953 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.2 2020-04-22T14:14:02.959 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:02.972 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:14:03.127 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.121+0000 7f68dc0af700 1 Processor -- start 2020-04-22T14:14:03.128 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.121+0000 7f68dc0af700 1 -- start start 2020-04-22T14:14:03.128 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.122+0000 7f68dc0af700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f68d4152a90 0x7f68d40b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:03.128 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.122+0000 7f68dc0af700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f68d4062170 0x7f68d40b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:03.128 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.122+0000 7f68dc0af700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68d4152e70 con 0x7f68d40b5210 2020-04-22T14:14:03.128 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.122+0000 7f68dc0af700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d40614f0 con 0x7f68d4062170 2020-04-22T14:14:03.128 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.122+0000 7f68dc0af700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d4061790 con 0x7f68d4152a90 2020-04-22T14:14:03.128 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.122+0000 7f68d9e4b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f68d4062170 0x7f68d40b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:03.129 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.122+0000 7f68d9e4b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f68d4062170 0x7f68d40b4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54358/0 (socket says 172.21.15.103:54358) 2020-04-22T14:14:03.129 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.122+0000 7f68d9e4b700 1 -- 172.21.15.103:0/3457888253 learned_addr learned my addr 172.21.15.103:0/3457888253 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:14:03.129 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.123+0000 7f68da64c700 1 --2- 172.21.15.103:0/3457888253 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f68d4152a90 0x7f68d40b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:03.129 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.123+0000 7f68d9e4b700 1 -- 172.21.15.103:0/3457888253 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f68d4152a90 msgr2=0x7f68d40b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:03.129 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.123+0000 7f68d9e4b700 1 --2- 172.21.15.103:0/3457888253 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f68d4152a90 0x7f68d40b44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:03.129 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.123+0000 7f68d9e4b700 1 -- 172.21.15.103:0/3457888253 >> v1:172.21.15.86:6789/0 conn(0x7f68d40b5210 legacy=0x7f68d4156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:03.130 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.123+0000 7f68d9e4b700 1 -- 172.21.15.103:0/3457888253 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d40b56a0 con 0x7f68d4062170 2020-04-22T14:14:03.130 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.123+0000 7f68da64c700 1 --2- 172.21.15.103:0/3457888253 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f68d4152a90 0x7f68d40b44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:14:03.130 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.123+0000 7f68d9e4b700 1 --2- 172.21.15.103:0/3457888253 >> v2:172.21.15.103:3300/0 conn(0x7f68d4062170 0x7f68d40b4db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f68d4062550 tx=0x7f68d405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:03.130 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.123+0000 7f68d9e4b700 1 --2- 172.21.15.103:0/3457888253 >> v2:172.21.15.103:3300/0 conn(0x7f68d4062170 0x7f68d40b4db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f68d4062550 tx=0x7f68d405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:03.130 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.123+0000 7f68d9e4b700 1 --2- 172.21.15.103:0/3457888253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68d4062170 0x7f68d40b4db0 secure :-1 s=READY pgs=1356 cs=0 l=1 rx=0x7f68d4062550 tx=0x7f68d405a720).ready entity=mon.1 client_cookie=ef3ec48746b9ed36 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:03.130 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.123+0000 7f68d9e4b700 1 --2- 172.21.15.103:0/3457888253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68d4062170 0x7f68d40b4db0 secure :-1 s=THROTTLE_DONE pgs=1356 cs=0 l=1 rx=0x7f68d4062550 tx=0x7f68d405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:03.130 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.123+0000 7f68d9e4b700 1 --2- 172.21.15.103:0/3457888253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68d4062170 0x7f68d40b4db0 secure :-1 s=THROTTLE_DONE pgs=1356 cs=0 l=1 rx=0x7f68d4062550 tx=0x7f68d405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:03.130 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.123+0000 7f68d9e4b700 1 --2- 172.21.15.103:0/3457888253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68d4062170 0x7f68d40b4db0 secure :-1 s=THROTTLE_DONE pgs=1356 cs=0 l=1 rx=0x7f68d4062550 tx=0x7f68d405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:03.131 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.123+0000 7f68d964a700 1 -- 172.21.15.103:0/3457888253 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68c40116e0 con 0x7f68d4062170 2020-04-22T14:14:03.131 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.123+0000 7f68d964a700 1 -- 172.21.15.103:0/3457888253 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c4011840 con 0x7f68d4062170 2020-04-22T14:14:03.131 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.123+0000 7f68d964a700 1 -- 172.21.15.103:0/3457888253 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68c4011c60 con 0x7f68d4062170 2020-04-22T14:14:03.131 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.123+0000 7f68dc0af700 1 -- 172.21.15.103:0/3457888253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68d4062170 msgr2=0x7f68d40b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:03.131 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.123+0000 7f68dc0af700 1 --2- 172.21.15.103:0/3457888253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68d4062170 0x7f68d40b4db0 secure :-1 s=READY pgs=1356 cs=0 l=1 rx=0x7f68d4062550 tx=0x7f68d405a720).stop 2020-04-22T14:14:03.131 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.124+0000 7f68dc0af700 1 -- 172.21.15.103:0/3457888253 shutdown_connections 2020-04-22T14:14:03.131 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.124+0000 7f68dc0af700 1 --2- 172.21.15.103:0/3457888253 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f68d4152a90 0x7f68d40b44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:03.132 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.124+0000 7f68dc0af700 1 --2- 172.21.15.103:0/3457888253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68d4062170 0x7f68d40b4db0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:03.132 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.124+0000 7f68dc0af700 1 -- 172.21.15.103:0/3457888253 >> 172.21.15.103:0/3457888253 conn(0x7f68d405ad30 msgr2=0x7f68d405b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:03.132 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.124+0000 7f68dc0af700 1 -- 172.21.15.103:0/3457888253 shutdown_connections 2020-04-22T14:14:03.132 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.124+0000 7f68dc0af700 1 -- 172.21.15.103:0/3457888253 wait complete. 2020-04-22T14:14:03.135 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.125+0000 7f68dc0af700 1 Processor -- start 2020-04-22T14:14:03.135 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.125+0000 7f68dc0af700 1 -- start start 2020-04-22T14:14:03.135 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.125+0000 7f68dc0af700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f68d4152a90 0x7f68d4120670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:03.135 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.125+0000 7f68dc0af700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68d40b0790 con 0x7f68d40b5210 2020-04-22T14:14:03.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.125+0000 7f68dc0af700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68d4120c10 con 0x7f68d4062170 2020-04-22T14:14:03.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.125+0000 7f68dc0af700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d41215f0 con 0x7f68d4152a90 2020-04-22T14:14:03.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.125+0000 7f68da64c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f68d4062170 0x7f68d40af970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46554/0 (socket says 172.21.15.103:46554) 2020-04-22T14:14:03.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.125+0000 7f68dae4d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f68d4152a90 0x7f68d4120670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:03.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.125+0000 7f68da64c700 1 -- 172.21.15.103:0/2600231254 learned_addr learned my addr 172.21.15.103:0/2600231254 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:14:03.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.126+0000 7f68dae4d700 1 -- 172.21.15.103:0/2600231254 >> v1:172.21.15.103:6789/0 conn(0x7f68d4062170 legacy=0x7f68d40af970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:03.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.126+0000 7f68dae4d700 1 -- 172.21.15.103:0/2600231254 >> v1:172.21.15.86:6789/0 conn(0x7f68d40b5210 legacy=0x7f68d40b0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:03.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.126+0000 7f68caffd700 1 -- 172.21.15.103:0/2600231254 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1301168275 0 0) 0x7f68d4120c10 con 0x7f68d4062170 2020-04-22T14:14:03.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.126+0000 7f68dae4d700 1 -- 172.21.15.103:0/2600231254 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d4120eb0 con 0x7f68d4152a90 2020-04-22T14:14:03.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.126+0000 7f68dae4d700 1 --2- 172.21.15.103:0/2600231254 >> v2:172.21.15.103:3300/0 conn(0x7f68d4152a90 0x7f68d4120670 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f68cc001f50 tx=0x7f68cc010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:03.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.126+0000 7f68dae4d700 1 --2- 172.21.15.103:0/2600231254 >> v2:172.21.15.103:3300/0 conn(0x7f68d4152a90 0x7f68d4120670 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f68cc001f50 tx=0x7f68cc010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:03.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.126+0000 7f68dae4d700 1 --2- 172.21.15.103:0/2600231254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68d4152a90 0x7f68d4120670 secure :-1 s=READY pgs=1358 cs=0 l=1 rx=0x7f68cc001f50 tx=0x7f68cc010880).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:03.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.126+0000 7f68dae4d700 1 --2- 172.21.15.103:0/2600231254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68d4152a90 0x7f68d4120670 secure :-1 s=THROTTLE_DONE pgs=1358 cs=0 l=1 rx=0x7f68cc001f50 tx=0x7f68cc010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:03.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.126+0000 7f68caffd700 1 -- 172.21.15.103:0/2600231254 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68cc006bc0 con 0x7f68d4152a90 2020-04-22T14:14:03.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.126+0000 7f68dae4d700 1 --2- 172.21.15.103:0/2600231254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68d4152a90 0x7f68d4120670 secure :-1 s=THROTTLE_DONE pgs=1358 cs=0 l=1 rx=0x7f68cc001f50 tx=0x7f68cc010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:03.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.126+0000 7f68dae4d700 1 --2- 172.21.15.103:0/2600231254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68d4152a90 0x7f68d4120670 secure :-1 s=THROTTLE_DONE pgs=1358 cs=0 l=1 rx=0x7f68cc001f50 tx=0x7f68cc010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:03.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.126+0000 7f68caffd700 1 -- 172.21.15.103:0/2600231254 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68cc006d60 con 0x7f68d4152a90 2020-04-22T14:14:03.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.126+0000 7f68caffd700 1 -- 172.21.15.103:0/2600231254 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68cc008370 con 0x7f68d4152a90 2020-04-22T14:14:03.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.126+0000 7f68dc0af700 1 -- 172.21.15.103:0/2600231254 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68d41211b0 con 0x7f68d4152a90 2020-04-22T14:14:03.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.126+0000 7f68dc0af700 1 -- 172.21.15.103:0/2600231254 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d4062fd0 con 0x7f68d4152a90 2020-04-22T14:14:03.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.127+0000 7f68dae4d700 1 --2- 172.21.15.103:0/2600231254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68d4152a90 0x7f68d4120670 secure :-1 s=THROTTLE_DONE pgs=1358 cs=0 l=1 rx=0x7f68cc001f50 tx=0x7f68cc010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:03.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.127+0000 7f68caffd700 1 -- 172.21.15.103:0/2600231254 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f68cc0084d0 con 0x7f68d4152a90 2020-04-22T14:14:03.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.127+0000 7f68dae4d700 1 --2- 172.21.15.103:0/2600231254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68d4152a90 0x7f68d4120670 secure :-1 s=THROTTLE_DONE pgs=1358 cs=0 l=1 rx=0x7f68cc001f50 tx=0x7f68cc010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:03.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.127+0000 7f68dc0af700 1 -- 172.21.15.103:0/2600231254 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d4056c90 con 0x7f68d4152a90 2020-04-22T14:14:03.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.127+0000 7f68caffd700 1 --2- 172.21.15.103:0/2600231254 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f68bc04d810 0x7f68bc04fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:03.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.127+0000 7f68caffd700 1 -- 172.21.15.103:0/2600231254 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f68cc061410 con 0x7f68d4152a90 2020-04-22T14:14:03.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.127+0000 7f68da64c700 1 --2- 172.21.15.103:0/2600231254 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f68bc04d810 0x7f68bc04fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:03.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.128+0000 7f68da64c700 1 --2- 172.21.15.103:0/2600231254 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f68bc04d810 0x7f68bc04fcd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f68d00033f0 tx=0x7f68d0002850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:03.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.128+0000 7f68da64c700 1 --2- 172.21.15.103:0/2600231254 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f68bc04d810 0x7f68bc04fcd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f68d00033f0 tx=0x7f68d0002850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:03.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.128+0000 7f68da64c700 1 --2- 172.21.15.103:0/2600231254 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f68bc04d810 0x7f68bc04fcd0 secure :-1 s=READY pgs=498 cs=0 l=1 rx=0x7f68d00033f0 tx=0x7f68d0002850).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:03.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.131+0000 7f68dae4d700 1 --2- 172.21.15.103:0/2600231254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68d4152a90 0x7f68d4120670 secure :-1 s=THROTTLE_DONE pgs=1358 cs=0 l=1 rx=0x7f68cc001f50 tx=0x7f68cc010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:03.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.131+0000 7f68caffd700 1 -- 172.21.15.103:0/2600231254 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f68cc03c790 con 0x7f68d4152a90 2020-04-22T14:14:03.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.324+0000 7f68dc0af700 1 -- 172.21.15.103:0/2600231254 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f68d40b8220 con 0x7f68d4152a90 2020-04-22T14:14:03.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.328+0000 7f68dae4d700 1 --2- 172.21.15.103:0/2600231254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68d4152a90 0x7f68d4120670 secure :-1 s=THROTTLE_DONE pgs=1358 cs=0 l=1 rx=0x7f68cc001f50 tx=0x7f68cc010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:03.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.328+0000 7f68caffd700 1 -- 172.21.15.103:0/2600231254 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v36) v1 ==== 184+0+0 (secure 0 0 0) 0x7f68cc03fdb0 con 0x7f68d4152a90 2020-04-22T14:14:03.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.329+0000 7f68dc0af700 1 -- 172.21.15.103:0/2600231254 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f68bc04d810 msgr2=0x7f68bc04fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:03.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.329+0000 7f68dc0af700 1 --2- 172.21.15.103:0/2600231254 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f68bc04d810 0x7f68bc04fcd0 secure :-1 s=READY pgs=498 cs=0 l=1 rx=0x7f68d00033f0 tx=0x7f68d0002850).stop 2020-04-22T14:14:03.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.329+0000 7f68dc0af700 1 -- 172.21.15.103:0/2600231254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68d4152a90 msgr2=0x7f68d4120670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:03.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.329+0000 7f68dc0af700 1 --2- 172.21.15.103:0/2600231254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68d4152a90 0x7f68d4120670 secure :-1 s=READY pgs=1358 cs=0 l=1 rx=0x7f68cc001f50 tx=0x7f68cc010880).stop 2020-04-22T14:14:03.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.329+0000 7f68dc0af700 1 -- 172.21.15.103:0/2600231254 shutdown_connections 2020-04-22T14:14:03.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.329+0000 7f68dc0af700 1 --2- 172.21.15.103:0/2600231254 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f68bc04d810 0x7f68bc04fcd0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:03.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.329+0000 7f68dc0af700 1 --2- 172.21.15.103:0/2600231254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68d4152a90 0x7f68d4120670 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:03.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.329+0000 7f68dc0af700 1 -- 172.21.15.103:0/2600231254 >> 172.21.15.103:0/2600231254 conn(0x7f68d405ad30 msgr2=0x7f68d412e040 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:03.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.329+0000 7f68dc0af700 1 -- 172.21.15.103:0/2600231254 shutdown_connections 2020-04-22T14:14:03.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.329+0000 7f68dc0af700 1 -- 172.21.15.103:0/2600231254 wait complete. 2020-04-22T14:14:03.334 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.3 2020-04-22T14:14:03.343 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:03.357 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:14:03.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.501+0000 7fada9838700 1 Processor -- start 2020-04-22T14:14:03.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.501+0000 7fada9838700 1 -- start start 2020-04-22T14:14:03.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.502+0000 7fada9838700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fada4145dc0 0x7fada40656e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:03.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.502+0000 7fada9838700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fada4146250 con 0x7fada40b0ed0 2020-04-22T14:14:03.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.502+0000 7fada9838700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fada40b79f0 con 0x7fada4145960 2020-04-22T14:14:03.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.502+0000 7fada9838700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fada40b77f0 con 0x7fada4145dc0 2020-04-22T14:14:03.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.502+0000 7fada27fc700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fada4145960 0x7fada4064fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46564/0 (socket says 172.21.15.103:46564) 2020-04-22T14:14:03.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.502+0000 7fada27fc700 1 -- 172.21.15.103:0/580971796 learned_addr learned my addr 172.21.15.103:0/580971796 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:14:03.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.502+0000 7fada37fe700 1 --2- 172.21.15.103:0/580971796 >> v2:172.21.15.86:3300/0 conn(0x7fada4145dc0 0x7fada40656e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:03.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.502+0000 7fada1ffb700 1 -- 172.21.15.103:0/580971796 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1345483618 0 0) 0x7fada40b79f0 con 0x7fada4145960 2020-04-22T14:14:03.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.502+0000 7fada1ffb700 1 -- 172.21.15.103:0/580971796 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad88003230 con 0x7fada4145960 2020-04-22T14:14:03.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.502+0000 7fada37fe700 1 -- 172.21.15.103:0/580971796 >> v1:172.21.15.103:6789/0 conn(0x7fada4145960 legacy=0x7fada4064fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:03.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.502+0000 7fada37fe700 1 -- 172.21.15.103:0/580971796 >> v1:172.21.15.86:6789/0 conn(0x7fada40b0ed0 legacy=0x7fada40b70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:03.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.502+0000 7fada37fe700 1 -- 172.21.15.103:0/580971796 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada40b7c90 con 0x7fada4145dc0 2020-04-22T14:14:03.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.502+0000 7fada37fe700 1 --2- 172.21.15.103:0/580971796 >> v2:172.21.15.86:3300/0 conn(0x7fada4145dc0 0x7fada40656e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fad9c0032b0 tx=0x7fad9c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:03.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.503+0000 7fada37fe700 1 --2- 172.21.15.103:0/580971796 >> v2:172.21.15.86:3300/0 conn(0x7fada4145dc0 0x7fada40656e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fad9c0032b0 tx=0x7fad9c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:03.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.503+0000 7fada37fe700 1 --2- 172.21.15.103:0/580971796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fada4145dc0 0x7fada40656e0 secure :-1 s=READY pgs=730 cs=0 l=1 rx=0x7fad9c0032b0 tx=0x7fad9c007dc0).ready entity=mon.0 client_cookie=149b1bdd5418bd51 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:03.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.503+0000 7fada37fe700 1 --2- 172.21.15.103:0/580971796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fada4145dc0 0x7fada40656e0 secure :-1 s=THROTTLE_DONE pgs=730 cs=0 l=1 rx=0x7fad9c0032b0 tx=0x7fad9c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:03.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.503+0000 7fada1ffb700 1 -- 172.21.15.103:0/580971796 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad9c011e20 con 0x7fada4145dc0 2020-04-22T14:14:03.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.503+0000 7fada37fe700 1 --2- 172.21.15.103:0/580971796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fada4145dc0 0x7fada40656e0 secure :-1 s=THROTTLE_DONE pgs=730 cs=0 l=1 rx=0x7fad9c0032b0 tx=0x7fad9c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:03.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.503+0000 7fada37fe700 1 --2- 172.21.15.103:0/580971796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fada4145dc0 0x7fada40656e0 secure :-1 s=THROTTLE_DONE pgs=730 cs=0 l=1 rx=0x7fad9c0032b0 tx=0x7fad9c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:03.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.503+0000 7fada1ffb700 1 -- 172.21.15.103:0/580971796 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad9c00a180 con 0x7fada4145dc0 2020-04-22T14:14:03.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.503+0000 7fada1ffb700 1 -- 172.21.15.103:0/580971796 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad9c00a520 con 0x7fada4145dc0 2020-04-22T14:14:03.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.503+0000 7fada9838700 1 -- 172.21.15.103:0/580971796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fada4145dc0 msgr2=0x7fada40656e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:03.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.503+0000 7fada9838700 1 --2- 172.21.15.103:0/580971796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fada4145dc0 0x7fada40656e0 secure :-1 s=READY pgs=730 cs=0 l=1 rx=0x7fad9c0032b0 tx=0x7fad9c007dc0).stop 2020-04-22T14:14:03.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.503+0000 7fada9838700 1 -- 172.21.15.103:0/580971796 shutdown_connections 2020-04-22T14:14:03.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.503+0000 7fada9838700 1 --2- 172.21.15.103:0/580971796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fada4145dc0 0x7fada40656e0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:03.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.503+0000 7fada9838700 1 -- 172.21.15.103:0/580971796 >> 172.21.15.103:0/580971796 conn(0x7fada405f2c0 msgr2=0x7fada4061fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:03.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.503+0000 7fada9838700 1 -- 172.21.15.103:0/580971796 shutdown_connections 2020-04-22T14:14:03.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.503+0000 7fada9838700 1 -- 172.21.15.103:0/580971796 wait complete. 2020-04-22T14:14:03.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.504+0000 7fada9838700 1 Processor -- start 2020-04-22T14:14:03.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.504+0000 7fada9838700 1 -- start start 2020-04-22T14:14:03.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.505+0000 7fada9838700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fada4145960 0x7fada40af180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:03.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.505+0000 7fada9838700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fada4145dc0 0x7fada40b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:03.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.505+0000 7fada9838700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fada4142a10 con 0x7fada40b0ed0 2020-04-22T14:14:03.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.505+0000 7fada9838700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fada40baf30 con 0x7fada4145dc0 2020-04-22T14:14:03.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.505+0000 7fada9838700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fada40bb1d0 con 0x7fada4145960 2020-04-22T14:14:03.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.505+0000 7fada37fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fada4145dc0 0x7fada40b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:03.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.505+0000 7fada37fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fada4145dc0 0x7fada40b04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54382/0 (socket says 172.21.15.103:54382) 2020-04-22T14:14:03.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.505+0000 7fada37fe700 1 -- 172.21.15.103:0/2844944487 learned_addr learned my addr 172.21.15.103:0/2844944487 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:14:03.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.505+0000 7fada27fc700 1 --2- 172.21.15.103:0/2844944487 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fada4145960 0x7fada40af180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:03.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.505+0000 7fada37fe700 1 -- 172.21.15.103:0/2844944487 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fada4145960 msgr2=0x7fada40af180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:03.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.505+0000 7fada37fe700 1 --2- 172.21.15.103:0/2844944487 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fada4145960 0x7fada40af180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:03.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.506+0000 7fada37fe700 1 -- 172.21.15.103:0/2844944487 >> v1:172.21.15.86:6789/0 conn(0x7fada40b0ed0 legacy=0x7fada4142300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:03.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.506+0000 7fada37fe700 1 -- 172.21.15.103:0/2844944487 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada40bb470 con 0x7fada4145dc0 2020-04-22T14:14:03.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.506+0000 7fada27fc700 1 --2- 172.21.15.103:0/2844944487 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fada4145960 0x7fada40af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:14:03.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.506+0000 7fada37fe700 1 --2- 172.21.15.103:0/2844944487 >> v2:172.21.15.103:3300/0 conn(0x7fada4145dc0 0x7fada40b04f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fad9c0032b0 tx=0x7fad9c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:03.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.506+0000 7fada37fe700 1 --2- 172.21.15.103:0/2844944487 >> v2:172.21.15.103:3300/0 conn(0x7fada4145dc0 0x7fada40b04f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fad9c0032b0 tx=0x7fad9c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:03.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.506+0000 7fada37fe700 1 --2- 172.21.15.103:0/2844944487 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fada4145dc0 0x7fada40b04f0 secure :-1 s=READY pgs=1360 cs=0 l=1 rx=0x7fad9c0032b0 tx=0x7fad9c007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:03.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.506+0000 7fada37fe700 1 --2- 172.21.15.103:0/2844944487 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fada4145dc0 0x7fada40b04f0 secure :-1 s=THROTTLE_DONE pgs=1360 cs=0 l=1 rx=0x7fad9c0032b0 tx=0x7fad9c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:03.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.506+0000 7fad93fff700 1 -- 172.21.15.103:0/2844944487 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad9c005c30 con 0x7fada4145dc0 2020-04-22T14:14:03.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.506+0000 7fada37fe700 1 --2- 172.21.15.103:0/2844944487 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fada4145dc0 0x7fada40b04f0 secure :-1 s=THROTTLE_DONE pgs=1360 cs=0 l=1 rx=0x7fad9c0032b0 tx=0x7fad9c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:03.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.506+0000 7fada37fe700 1 --2- 172.21.15.103:0/2844944487 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fada4145dc0 0x7fada40b04f0 secure :-1 s=THROTTLE_DONE pgs=1360 cs=0 l=1 rx=0x7fad9c0032b0 tx=0x7fad9c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:03.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.506+0000 7fad93fff700 1 -- 172.21.15.103:0/2844944487 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad9c005d90 con 0x7fada4145dc0 2020-04-22T14:14:03.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.506+0000 7fada9838700 1 -- 172.21.15.103:0/2844944487 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fada40babb0 con 0x7fada4145dc0 2020-04-22T14:14:03.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.506+0000 7fad93fff700 1 -- 172.21.15.103:0/2844944487 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad9c00f890 con 0x7fada4145dc0 2020-04-22T14:14:03.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.506+0000 7fada9838700 1 -- 172.21.15.103:0/2844944487 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fada40b39f0 con 0x7fada4145dc0 2020-04-22T14:14:03.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.506+0000 7fada37fe700 1 --2- 172.21.15.103:0/2844944487 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fada4145dc0 0x7fada40b04f0 secure :-1 s=THROTTLE_DONE pgs=1360 cs=0 l=1 rx=0x7fad9c0032b0 tx=0x7fad9c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:03.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.507+0000 7fada9838700 1 -- 172.21.15.103:0/2844944487 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fada40bb670 con 0x7fada4145dc0 2020-04-22T14:14:03.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.507+0000 7fad93fff700 1 -- 172.21.15.103:0/2844944487 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fad9c00fa90 con 0x7fada4145dc0 2020-04-22T14:14:03.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.507+0000 7fada37fe700 1 --2- 172.21.15.103:0/2844944487 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fada4145dc0 0x7fada40b04f0 secure :-1 s=THROTTLE_DONE pgs=1360 cs=0 l=1 rx=0x7fad9c0032b0 tx=0x7fad9c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:03.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.507+0000 7fad93fff700 1 --2- 172.21.15.103:0/2844944487 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fad8004d970 0x7fad8004fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:03.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.507+0000 7fad93fff700 1 -- 172.21.15.103:0/2844944487 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fad9c0626d0 con 0x7fada4145dc0 2020-04-22T14:14:03.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.507+0000 7fada2ffd700 1 --2- 172.21.15.103:0/2844944487 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fad8004d970 0x7fad8004fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:03.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.507+0000 7fada2ffd700 1 --2- 172.21.15.103:0/2844944487 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fad8004d970 0x7fad8004fe30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fada40ae7d0 tx=0x7fad94002560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:03.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.508+0000 7fada2ffd700 1 --2- 172.21.15.103:0/2844944487 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fad8004d970 0x7fad8004fe30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fada40ae7d0 tx=0x7fad94002560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:03.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.508+0000 7fada2ffd700 1 --2- 172.21.15.103:0/2844944487 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fad8004d970 0x7fad8004fe30 secure :-1 s=READY pgs=499 cs=0 l=1 rx=0x7fada40ae7d0 tx=0x7fad94002560).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:03.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.511+0000 7fada37fe700 1 --2- 172.21.15.103:0/2844944487 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fada4145dc0 0x7fada40b04f0 secure :-1 s=THROTTLE_DONE pgs=1360 cs=0 l=1 rx=0x7fad9c0032b0 tx=0x7fad9c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:03.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.511+0000 7fad93fff700 1 -- 172.21.15.103:0/2844944487 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fada40bb670 con 0x7fada4145dc0 2020-04-22T14:14:03.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.702+0000 7fada9838700 1 -- 172.21.15.103:0/2844944487 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fada40bb670 con 0x7fada4145dc0 2020-04-22T14:14:03.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.702+0000 7fada37fe700 1 --2- 172.21.15.103:0/2844944487 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fada4145dc0 0x7fada40b04f0 secure :-1 s=THROTTLE_DONE pgs=1360 cs=0 l=1 rx=0x7fad9c0032b0 tx=0x7fad9c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:03.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.702+0000 7fad93fff700 1 -- 172.21.15.103:0/2844944487 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+2143 (secure 0 0 0) 0x7fada40bb670 con 0x7fada4145dc0 2020-04-22T14:14:03.706 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:14:03.706 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":64,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5810,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/2664816107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2664816107},{"type":"v1","addr":"172.21.15.86:6835","nonce":2664816107}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":60}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:13:59.062543+0000","modified":"2020-04-22T14:14:01.070314+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7723},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7723":{"gid":7723,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/3220772133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3220772133},{"type":"v1","addr":"172.21.15.103:6833","nonce":3220772133}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-04-22T14:14:03.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.704+0000 7fada9838700 1 -- 172.21.15.103:0/2844944487 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fad8004d970 msgr2=0x7fad8004fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:03.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.704+0000 7fada9838700 1 --2- 172.21.15.103:0/2844944487 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fad8004d970 0x7fad8004fe30 secure :-1 s=READY pgs=499 cs=0 l=1 rx=0x7fada40ae7d0 tx=0x7fad94002560).stop 2020-04-22T14:14:03.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.704+0000 7fada9838700 1 -- 172.21.15.103:0/2844944487 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fada4145dc0 msgr2=0x7fada40b04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:03.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.704+0000 7fada9838700 1 --2- 172.21.15.103:0/2844944487 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fada4145dc0 0x7fada40b04f0 secure :-1 s=READY pgs=1360 cs=0 l=1 rx=0x7fad9c0032b0 tx=0x7fad9c007dc0).stop 2020-04-22T14:14:03.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.704+0000 7fada9838700 1 -- 172.21.15.103:0/2844944487 shutdown_connections 2020-04-22T14:14:03.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.704+0000 7fada9838700 1 --2- 172.21.15.103:0/2844944487 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fad8004d970 0x7fad8004fe30 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:03.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.704+0000 7fada9838700 1 --2- 172.21.15.103:0/2844944487 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fada4145dc0 0x7fada40b04f0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:03.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.704+0000 7fada9838700 1 --2- 172.21.15.103:0/2844944487 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fada4145960 0x7fada40af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:03.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.704+0000 7fada9838700 1 -- 172.21.15.103:0/2844944487 >> 172.21.15.103:0/2844944487 conn(0x7fada405f2c0 msgr2=0x7fada4065b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:03.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.704+0000 7fada9838700 1 -- 172.21.15.103:0/2844944487 shutdown_connections 2020-04-22T14:14:03.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:03.704+0000 7fada9838700 1 -- 172.21.15.103:0/2844944487 wait complete. 2020-04-22T14:14:03.710 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 64 2020-04-22T14:14:03.919 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 7723}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 15, u'failed': [], u'epoch': 64, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [16], u'info': {u'gid_7723': {u'export_targets': [], u'name': u'a', u'incarnation': 61, u'state_seq': 3, u'state': u'up:active', u'gid': 7723, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 3220772133, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 3220772133, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/3220772133'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:13:59.062543+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:14:01.070314+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:14:03.919 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:14:03.919 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:03.934 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:14:04.091 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:14:04.092 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:14:04.092 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:14:04.092 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 7723, 2020-04-22T14:14:04.092 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:14:04.092 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:14:04.092 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 5.0258060489999998, 2020-04-22T14:14:04.093 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 64, 2020-04-22T14:14:04.093 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 90, 2020-04-22T14:14:04.093 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 90, 2020-04-22T14:14:04.093 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 10.465832696 2020-04-22T14:14:04.093 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:14:04.100 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 7723, "want_state": "up:active", "state": "up:active", "rank_uptime": 5.0258060489999998, "mdsmap_epoch": 64, "osdmap_epoch": 90, "osdmap_epoch_barrier": 90, "uptime": 10.465832696 } 2020-04-22T14:14:04.100 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:04.115 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:14:04.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.258+0000 7f1192dd6700 1 Processor -- start 2020-04-22T14:14:04.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.258+0000 7f1192dd6700 1 -- start start 2020-04-22T14:14:04.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.258+0000 7f1192dd6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f118c0b0ed0 0x7f118c0b70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:04.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.258+0000 7f1192dd6700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f118c064fd0 0x7f118c065480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:04.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.258+0000 7f1192dd6700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f118c0b79f0 con 0x7f118c0b7540 2020-04-22T14:14:04.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.258+0000 7f1192dd6700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f118c0b7c90 con 0x7f118c064fd0 2020-04-22T14:14:04.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.258+0000 7f1192dd6700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f118c0b7f30 con 0x7f118c0b0ed0 2020-04-22T14:14:04.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.259+0000 7f1191373700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f118c064fd0 0x7f118c065480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:04.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.259+0000 7f1190b72700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f118c0b0ed0 0x7f118c0b70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:04.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.259+0000 7f1191373700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f118c064fd0 0x7f118c065480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:51620/0 (socket says 172.21.15.103:51620) 2020-04-22T14:14:04.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.259+0000 7f118bfff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f118c0b7540 0x7f118c145960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:35500/0 (socket says 172.21.15.103:35500) 2020-04-22T14:14:04.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.259+0000 7f1191373700 1 -- 172.21.15.103:0/2464929619 learned_addr learned my addr 172.21.15.103:0/2464929619 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:14:04.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.259+0000 7f1191373700 1 -- 172.21.15.103:0/2464929619 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f118c0b0ed0 msgr2=0x7f118c0b70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:04.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.259+0000 7f1191373700 1 --2- 172.21.15.103:0/2464929619 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f118c0b0ed0 0x7f118c0b70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:04.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.259+0000 7f1191373700 1 -- 172.21.15.103:0/2464929619 >> v1:172.21.15.86:6789/0 conn(0x7f118c0b7540 legacy=0x7f118c145960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:04.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.259+0000 7f118b7fe700 1 -- 172.21.15.103:0/2464929619 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3288538857 0 0) 0x7f118c0b79f0 con 0x7f118c0b7540 2020-04-22T14:14:04.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.259+0000 7f1191373700 1 -- 172.21.15.103:0/2464929619 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118c0b12b0 con 0x7f118c064fd0 2020-04-22T14:14:04.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.259+0000 7f1191373700 1 --2- 172.21.15.103:0/2464929619 >> v2:172.21.15.86:3300/0 conn(0x7f118c064fd0 0x7f118c065480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f11840032b0 tx=0x7f1184007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.259+0000 7f1191373700 1 --2- 172.21.15.103:0/2464929619 >> v2:172.21.15.86:3300/0 conn(0x7f118c064fd0 0x7f118c065480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f11840032b0 tx=0x7f1184007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.259+0000 7f1191373700 1 --2- 172.21.15.103:0/2464929619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f118c064fd0 0x7f118c065480 secure :-1 s=READY pgs=733 cs=0 l=1 rx=0x7f11840032b0 tx=0x7f1184007dc0).ready entity=mon.0 client_cookie=4d9242164419b286 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:04.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.259+0000 7f1191373700 1 --2- 172.21.15.103:0/2464929619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f118c064fd0 0x7f118c065480 secure :-1 s=THROTTLE_DONE pgs=733 cs=0 l=1 rx=0x7f11840032b0 tx=0x7f1184007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.259+0000 7f118b7fe700 1 -- 172.21.15.103:0/2464929619 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f118400a180 con 0x7f118c064fd0 2020-04-22T14:14:04.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.259+0000 7f1191373700 1 --2- 172.21.15.103:0/2464929619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f118c064fd0 0x7f118c065480 secure :-1 s=THROTTLE_DONE pgs=733 cs=0 l=1 rx=0x7f11840032b0 tx=0x7f1184007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.260+0000 7f118b7fe700 1 -- 172.21.15.103:0/2464929619 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118400a320 con 0x7f118c064fd0 2020-04-22T14:14:04.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.260+0000 7f1191373700 1 --2- 172.21.15.103:0/2464929619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f118c064fd0 0x7f118c065480 secure :-1 s=THROTTLE_DONE pgs=733 cs=0 l=1 rx=0x7f11840032b0 tx=0x7f1184007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.260+0000 7f118b7fe700 1 -- 172.21.15.103:0/2464929619 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f118400a700 con 0x7f118c064fd0 2020-04-22T14:14:04.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.260+0000 7f1192dd6700 1 -- 172.21.15.103:0/2464929619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f118c064fd0 msgr2=0x7f118c065480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:04.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.260+0000 7f1192dd6700 1 --2- 172.21.15.103:0/2464929619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f118c064fd0 0x7f118c065480 secure :-1 s=READY pgs=733 cs=0 l=1 rx=0x7f11840032b0 tx=0x7f1184007dc0).stop 2020-04-22T14:14:04.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.260+0000 7f1192dd6700 1 -- 172.21.15.103:0/2464929619 shutdown_connections 2020-04-22T14:14:04.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.260+0000 7f1192dd6700 1 --2- 172.21.15.103:0/2464929619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f118c064fd0 0x7f118c065480 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:04.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.260+0000 7f1192dd6700 1 --2- 172.21.15.103:0/2464929619 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f118c0b0ed0 0x7f118c0b70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:04.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.260+0000 7f1192dd6700 1 -- 172.21.15.103:0/2464929619 >> 172.21.15.103:0/2464929619 conn(0x7f118c05f2c0 msgr2=0x7f118c061fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:04.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.260+0000 7f1192dd6700 1 -- 172.21.15.103:0/2464929619 shutdown_connections 2020-04-22T14:14:04.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.260+0000 7f1192dd6700 1 -- 172.21.15.103:0/2464929619 wait complete. 2020-04-22T14:14:04.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.261+0000 7f1192dd6700 1 Processor -- start 2020-04-22T14:14:04.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.261+0000 7f1192dd6700 1 -- start start 2020-04-22T14:14:04.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.262+0000 7f1192dd6700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f118c064fd0 0x7f118c0b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:04.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.262+0000 7f1192dd6700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f118c116230 con 0x7f118c0b0ed0 2020-04-22T14:14:04.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.262+0000 7f1192dd6700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f118c1164d0 con 0x7f118c0b7540 2020-04-22T14:14:04.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.262+0000 7f1192dd6700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f118c116770 con 0x7f118c064fd0 2020-04-22T14:14:04.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.262+0000 7f1190b72700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f118c064fd0 0x7f118c0b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:04.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.262+0000 7f1191373700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f118c0b7540 0x7f118c140850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46586/0 (socket says 172.21.15.103:46586) 2020-04-22T14:14:04.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.262+0000 7f1191373700 1 -- 172.21.15.103:0/803375763 learned_addr learned my addr 172.21.15.103:0/803375763 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:14:04.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.262+0000 7f1190b72700 1 -- 172.21.15.103:0/803375763 >> v1:172.21.15.103:6789/0 conn(0x7f118c0b7540 legacy=0x7f118c140850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:04.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.262+0000 7f1190b72700 1 -- 172.21.15.103:0/803375763 >> v1:172.21.15.86:6789/0 conn(0x7f118c0b0ed0 legacy=0x7f118c115920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:04.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.262+0000 7f1189ffb700 1 -- 172.21.15.103:0/803375763 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1158196124 0 0) 0x7f118c116230 con 0x7f118c0b0ed0 2020-04-22T14:14:04.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.262+0000 7f1190b72700 1 -- 172.21.15.103:0/803375763 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118c0b2600 con 0x7f118c064fd0 2020-04-22T14:14:04.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.262+0000 7f1190b72700 1 --2- 172.21.15.103:0/803375763 >> v2:172.21.15.103:3300/0 conn(0x7f118c064fd0 0x7f118c0b61b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1184008660 tx=0x7f1174010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.262+0000 7f1190b72700 1 --2- 172.21.15.103:0/803375763 >> v2:172.21.15.103:3300/0 conn(0x7f118c064fd0 0x7f118c0b61b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1184008660 tx=0x7f1174010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.262+0000 7f1190b72700 1 --2- 172.21.15.103:0/803375763 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f118c064fd0 0x7f118c0b61b0 secure :-1 s=READY pgs=1362 cs=0 l=1 rx=0x7f1184008660 tx=0x7f1174010ba0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:04.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.262+0000 7f1190b72700 1 --2- 172.21.15.103:0/803375763 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f118c064fd0 0x7f118c0b61b0 secure :-1 s=THROTTLE_DONE pgs=1362 cs=0 l=1 rx=0x7f1184008660 tx=0x7f1174010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.262+0000 7f1189ffb700 1 -- 172.21.15.103:0/803375763 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1174007550 con 0x7f118c064fd0 2020-04-22T14:14:04.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.262+0000 7f1190b72700 1 --2- 172.21.15.103:0/803375763 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f118c064fd0 0x7f118c0b61b0 secure :-1 s=THROTTLE_DONE pgs=1362 cs=0 l=1 rx=0x7f1184008660 tx=0x7f1174010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.262+0000 7f1189ffb700 1 -- 172.21.15.103:0/803375763 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11740056c0 con 0x7f118c064fd0 2020-04-22T14:14:04.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.262+0000 7f1192dd6700 1 -- 172.21.15.103:0/803375763 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f118c0b6610 con 0x7f118c064fd0 2020-04-22T14:14:04.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.262+0000 7f1190b72700 1 --2- 172.21.15.103:0/803375763 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f118c064fd0 0x7f118c0b61b0 secure :-1 s=THROTTLE_DONE pgs=1362 cs=0 l=1 rx=0x7f1184008660 tx=0x7f1174010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.263+0000 7f1189ffb700 1 -- 172.21.15.103:0/803375763 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1174005aa0 con 0x7f118c064fd0 2020-04-22T14:14:04.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.263+0000 7f1192dd6700 1 -- 172.21.15.103:0/803375763 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f118c114540 con 0x7f118c064fd0 2020-04-22T14:14:04.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.263+0000 7f1190b72700 1 --2- 172.21.15.103:0/803375763 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f118c064fd0 0x7f118c0b61b0 secure :-1 s=THROTTLE_DONE pgs=1362 cs=0 l=1 rx=0x7f1184008660 tx=0x7f1174010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.264+0000 7f1192dd6700 1 -- 172.21.15.103:0/803375763 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f118c056c90 con 0x7f118c064fd0 2020-04-22T14:14:04.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.264+0000 7f1189ffb700 1 -- 172.21.15.103:0/803375763 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f1174005d20 con 0x7f118c064fd0 2020-04-22T14:14:04.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.264+0000 7f1190b72700 1 --2- 172.21.15.103:0/803375763 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f118c064fd0 0x7f118c0b61b0 secure :-1 s=THROTTLE_DONE pgs=1362 cs=0 l=1 rx=0x7f1184008660 tx=0x7f1174010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.264+0000 7f1189ffb700 1 --2- 172.21.15.103:0/803375763 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f117004d710 0x7f117004fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:04.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.264+0000 7f1189ffb700 1 -- 172.21.15.103:0/803375763 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f117400d0d0 con 0x7f118c064fd0 2020-04-22T14:14:04.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.264+0000 7f118bfff700 1 --2- 172.21.15.103:0/803375763 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f117004d710 0x7f117004fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:04.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.264+0000 7f118bfff700 1 --2- 172.21.15.103:0/803375763 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f117004d710 0x7f117004fbd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f117c000ee0 tx=0x7f117c0017b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.264+0000 7f118bfff700 1 --2- 172.21.15.103:0/803375763 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f117004d710 0x7f117004fbd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f117c000ee0 tx=0x7f117c0017b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.264+0000 7f118bfff700 1 --2- 172.21.15.103:0/803375763 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f117004d710 0x7f117004fbd0 secure :-1 s=READY pgs=500 cs=0 l=1 rx=0x7f117c000ee0 tx=0x7f117c0017b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:04.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.268+0000 7f1190b72700 1 --2- 172.21.15.103:0/803375763 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f118c064fd0 0x7f118c0b61b0 secure :-1 s=THROTTLE_DONE pgs=1362 cs=0 l=1 rx=0x7f1184008660 tx=0x7f1174010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.268+0000 7f1189ffb700 1 -- 172.21.15.103:0/803375763 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f117403c890 con 0x7f118c064fd0 2020-04-22T14:14:04.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.412+0000 7f1192dd6700 1 -- 172.21.15.103:0/803375763 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f118c061d80 con 0x7f118c064fd0 2020-04-22T14:14:04.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.413+0000 7f1190b72700 1 --2- 172.21.15.103:0/803375763 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f118c064fd0 0x7f118c0b61b0 secure :-1 s=THROTTLE_DONE pgs=1362 cs=0 l=1 rx=0x7f1184008660 tx=0x7f1174010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.413+0000 7f1189ffb700 1 -- 172.21.15.103:0/803375763 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+16092 (secure 0 0 0) 0x7f117403feb0 con 0x7f118c064fd0 2020-04-22T14:14:04.417 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:14:04.418 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":90,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:14:00.064104+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:13:56.741291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2020-04-22T14:13:57.809563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:14:04.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.414+0000 7f1192dd6700 1 -- 172.21.15.103:0/803375763 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f117004d710 msgr2=0x7f117004fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:04.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.414+0000 7f1192dd6700 1 --2- 172.21.15.103:0/803375763 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f117004d710 0x7f117004fbd0 secure :-1 s=READY pgs=500 cs=0 l=1 rx=0x7f117c000ee0 tx=0x7f117c0017b0).stop 2020-04-22T14:14:04.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.414+0000 7f1192dd6700 1 -- 172.21.15.103:0/803375763 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f118c064fd0 msgr2=0x7f118c0b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:04.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.414+0000 7f1192dd6700 1 --2- 172.21.15.103:0/803375763 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f118c064fd0 0x7f118c0b61b0 secure :-1 s=READY pgs=1362 cs=0 l=1 rx=0x7f1184008660 tx=0x7f1174010ba0).stop 2020-04-22T14:14:04.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.414+0000 7f1192dd6700 1 -- 172.21.15.103:0/803375763 shutdown_connections 2020-04-22T14:14:04.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.414+0000 7f1192dd6700 1 --2- 172.21.15.103:0/803375763 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f117004d710 0x7f117004fbd0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:04.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.414+0000 7f1192dd6700 1 --2- 172.21.15.103:0/803375763 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f118c064fd0 0x7f118c0b61b0 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:04.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.414+0000 7f1192dd6700 1 -- 172.21.15.103:0/803375763 >> 172.21.15.103:0/803375763 conn(0x7f118c05f2c0 msgr2=0x7f118c143020 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:04.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.414+0000 7f1192dd6700 1 -- 172.21.15.103:0/803375763 shutdown_connections 2020-04-22T14:14:04.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.414+0000 7f1192dd6700 1 -- 172.21.15.103:0/803375763 wait complete. 2020-04-22T14:14:04.429 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:13:56.741291+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 15, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'89', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:13:57.809563+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 16, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'90', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:14:04.429 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:04.454 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:14:04.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.599+0000 7f0283064700 1 Processor -- start 2020-04-22T14:14:04.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.599+0000 7f0283064700 1 -- start start 2020-04-22T14:14:04.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.600+0000 7f0283064700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f027c14e4c0 0x7f027c0b4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:04.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.600+0000 7f0283064700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f027c0b49d0 con 0x7f027c0b9140 2020-04-22T14:14:04.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.600+0000 7f0283064700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f027c061830 con 0x7f027c0af390 2020-04-22T14:14:04.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.600+0000 7f0283064700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f027c061ad0 con 0x7f027c14e4c0 2020-04-22T14:14:04.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.600+0000 7f027bfff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f027c0af390 0x7f027c14ddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46592/0 (socket says 172.21.15.103:46592) 2020-04-22T14:14:04.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.600+0000 7f027bfff700 1 -- 172.21.15.103:0/1461394246 learned_addr learned my addr 172.21.15.103:0/1461394246 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:14:04.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.601+0000 7f0281601700 1 --2- 172.21.15.103:0/1461394246 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f027c14e4c0 0x7f027c0b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:04.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.601+0000 7f027b7fe700 1 -- 172.21.15.103:0/1461394246 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1161590456 0 0) 0x7f027c061830 con 0x7f027c0af390 2020-04-22T14:14:04.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.601+0000 7f027b7fe700 1 -- 172.21.15.103:0/1461394246 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0260003230 con 0x7f027c0af390 2020-04-22T14:14:04.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.601+0000 7f027b7fe700 1 -- 172.21.15.103:0/1461394246 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1835953335 0 0) 0x7f0260003230 con 0x7f027c0af390 2020-04-22T14:14:04.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.601+0000 7f027b7fe700 1 -- 172.21.15.103:0/1461394246 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f027c14e4c0 msgr2=0x7f027c0b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:04.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.601+0000 7f027b7fe700 1 --2- 172.21.15.103:0/1461394246 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f027c14e4c0 0x7f027c0b4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:04.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.601+0000 7f027b7fe700 1 -- 172.21.15.103:0/1461394246 >> v1:172.21.15.86:6789/0 conn(0x7f027c0b9140 legacy=0x7f027c061f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:04.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.601+0000 7f027b7fe700 1 -- 172.21.15.103:0/1461394246 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f027c0b9520 con 0x7f027c0af390 2020-04-22T14:14:04.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.601+0000 7f027b7fe700 1 -- 172.21.15.103:0/1461394246 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f02680016d0 con 0x7f027c0af390 2020-04-22T14:14:04.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.601+0000 7f027b7fe700 1 -- 172.21.15.103:0/1461394246 >> v1:172.21.15.103:6789/0 conn(0x7f027c0af390 legacy=0x7f027c14ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:04.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.601+0000 7f027b7fe700 1 --2- 172.21.15.103:0/1461394246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0260003720 0x7f0260003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:04.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.601+0000 7f027b7fe700 1 --2- 172.21.15.103:0/1461394246 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f027c14e4c0 0x7f0260003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:04.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.601+0000 7f027b7fe700 1 --2- 172.21.15.103:0/1461394246 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0260004520 0x7f02600049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:04.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.601+0000 7f027b7fe700 1 -- 172.21.15.103:0/1461394246 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027c061ad0 con 0x7f0260004520 2020-04-22T14:14:04.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.601+0000 7f027b7fe700 1 -- 172.21.15.103:0/1461394246 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0260004ef0 con 0x7f0260003720 2020-04-22T14:14:04.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.601+0000 7f027b7fe700 1 -- 172.21.15.103:0/1461394246 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02600050b0 con 0x7f027c14e4c0 2020-04-22T14:14:04.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.601+0000 7f0280e00700 1 --2- 172.21.15.103:0/1461394246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0260003720 0x7f0260003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:04.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.601+0000 7f027bfff700 1 --2- 172.21.15.103:0/1461394246 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f027c14e4c0 0x7f0260003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:04.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.601+0000 7f0281601700 1 --2- 172.21.15.103:0/1461394246 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0260004520 0x7f02600049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:04.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.601+0000 7f0280e00700 1 -- 172.21.15.103:0/1461394246 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f027c14e4c0 msgr2=0x7f0260003ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:04.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.601+0000 7f0280e00700 1 --2- 172.21.15.103:0/1461394246 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f027c14e4c0 0x7f0260003ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:04.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.601+0000 7f0280e00700 1 -- 172.21.15.103:0/1461394246 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0260004520 msgr2=0x7f02600049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:04.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.601+0000 7f0280e00700 1 --2- 172.21.15.103:0/1461394246 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0260004520 0x7f02600049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:04.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.601+0000 7f0280e00700 1 -- 172.21.15.103:0/1461394246 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0260003230 con 0x7f0260003720 2020-04-22T14:14:04.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.601+0000 7f0281601700 1 --2- 172.21.15.103:0/1461394246 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0260004520 0x7f02600049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:14:04.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.601+0000 7f0280e00700 1 --2- 172.21.15.103:0/1461394246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0260003720 0x7f0260003b00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0270000fe0 tx=0x7f027000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.601+0000 7f0280e00700 1 --2- 172.21.15.103:0/1461394246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0260003720 0x7f0260003b00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0270000fe0 tx=0x7f027000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.602+0000 7f0280e00700 1 --2- 172.21.15.103:0/1461394246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0260003720 0x7f0260003b00 secure :-1 s=READY pgs=1364 cs=0 l=1 rx=0x7f0270000fe0 tx=0x7f027000fde0).ready entity=mon.1 client_cookie=b7e801f16211ee24 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:04.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.602+0000 7f0280e00700 1 --2- 172.21.15.103:0/1461394246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0260003720 0x7f0260003b00 secure :-1 s=THROTTLE_DONE pgs=1364 cs=0 l=1 rx=0x7f0270000fe0 tx=0x7f027000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.602+0000 7f027b7fe700 1 -- 172.21.15.103:0/1461394246 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0270003560 con 0x7f0260003720 2020-04-22T14:14:04.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.602+0000 7f0280e00700 1 --2- 172.21.15.103:0/1461394246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0260003720 0x7f0260003b00 secure :-1 s=THROTTLE_DONE pgs=1364 cs=0 l=1 rx=0x7f0270000fe0 tx=0x7f027000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.602+0000 7f0280e00700 1 --2- 172.21.15.103:0/1461394246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0260003720 0x7f0260003b00 secure :-1 s=THROTTLE_DONE pgs=1364 cs=0 l=1 rx=0x7f0270000fe0 tx=0x7f027000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.602+0000 7f027b7fe700 1 -- 172.21.15.103:0/1461394246 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02700036c0 con 0x7f0260003720 2020-04-22T14:14:04.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.602+0000 7f027b7fe700 1 -- 172.21.15.103:0/1461394246 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0270003ae0 con 0x7f0260003720 2020-04-22T14:14:04.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.602+0000 7f0283064700 1 -- 172.21.15.103:0/1461394246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0260003720 msgr2=0x7f0260003b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:04.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.602+0000 7f0283064700 1 --2- 172.21.15.103:0/1461394246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0260003720 0x7f0260003b00 secure :-1 s=READY pgs=1364 cs=0 l=1 rx=0x7f0270000fe0 tx=0x7f027000fde0).stop 2020-04-22T14:14:04.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.602+0000 7f0281601700 1 -- 172.21.15.103:0/1461394246 reap_dead start 2020-04-22T14:14:04.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.602+0000 7f0283064700 1 -- 172.21.15.103:0/1461394246 shutdown_connections 2020-04-22T14:14:04.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.602+0000 7f0283064700 1 -- 172.21.15.103:0/1461394246 >> 172.21.15.103:0/1461394246 conn(0x7f027c05b7b0 msgr2=0x7f027c0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:04.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.602+0000 7f0283064700 1 -- 172.21.15.103:0/1461394246 shutdown_connections 2020-04-22T14:14:04.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.602+0000 7f0283064700 1 -- 172.21.15.103:0/1461394246 wait complete. 2020-04-22T14:14:04.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.603+0000 7f0283064700 1 Processor -- start 2020-04-22T14:14:04.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.603+0000 7f0283064700 1 -- start start 2020-04-22T14:14:04.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.604+0000 7f0283064700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f027c1465d0 0x7f027c114940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:04.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.604+0000 7f0283064700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f027c114050 0x7f027c14d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:04.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.604+0000 7f0283064700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f027c147b10 0x7f027c147fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:04.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.604+0000 7f0283064700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f027c1147e0 con 0x7f027c114050 2020-04-22T14:14:04.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.604+0000 7f0283064700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f027c14da00 con 0x7f027c147b10 2020-04-22T14:14:04.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.604+0000 7f0283064700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f027c1469b0 con 0x7f027c1465d0 2020-04-22T14:14:04.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.604+0000 7f0281601700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f027c147b10 0x7f027c147fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:04.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.604+0000 7f0281601700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f027c147b10 0x7f027c147fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54414/0 (socket says 172.21.15.103:54414) 2020-04-22T14:14:04.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.604+0000 7f0281601700 1 -- 172.21.15.103:0/1698958293 learned_addr learned my addr 172.21.15.103:0/1698958293 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:14:04.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.604+0000 7f0281601700 1 -- 172.21.15.103:0/1698958293 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f027c1465d0 msgr2=0x7f027c114940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:04.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.604+0000 7f0280e00700 1 --2- 172.21.15.103:0/1698958293 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f027c1465d0 0x7f027c114940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:04.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.604+0000 7f0281601700 1 --2- 172.21.15.103:0/1698958293 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f027c1465d0 0x7f027c114940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:04.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.604+0000 7f0281601700 1 -- 172.21.15.103:0/1698958293 >> v2:172.21.15.86:3300/0 conn(0x7f027c114050 msgr2=0x7f027c14d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:04.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.604+0000 7f0281601700 1 --2- 172.21.15.103:0/1698958293 >> v2:172.21.15.86:3300/0 conn(0x7f027c114050 0x7f027c14d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:04.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.604+0000 7f0281601700 1 -- 172.21.15.103:0/1698958293 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f027c114540 con 0x7f027c147b10 2020-04-22T14:14:04.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.604+0000 7f0281601700 1 --2- 172.21.15.103:0/1698958293 >> v2:172.21.15.103:3300/0 conn(0x7f027c147b10 0x7f027c147fc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f02680010d0 tx=0x7f0274010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.605+0000 7f0281601700 1 --2- 172.21.15.103:0/1698958293 >> v2:172.21.15.103:3300/0 conn(0x7f027c147b10 0x7f027c147fc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f02680010d0 tx=0x7f0274010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.605+0000 7f0281601700 1 --2- 172.21.15.103:0/1698958293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f027c147b10 0x7f027c147fc0 secure :-1 s=READY pgs=1365 cs=0 l=1 rx=0x7f02680010d0 tx=0x7f0274010bc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:04.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.605+0000 7f0281601700 1 --2- 172.21.15.103:0/1698958293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f027c147b10 0x7f027c147fc0 secure :-1 s=THROTTLE_DONE pgs=1365 cs=0 l=1 rx=0x7f02680010d0 tx=0x7f0274010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.605+0000 7f0281601700 1 --2- 172.21.15.103:0/1698958293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f027c147b10 0x7f027c147fc0 secure :-1 s=THROTTLE_DONE pgs=1365 cs=0 l=1 rx=0x7f02680010d0 tx=0x7f0274010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.605+0000 7f0281601700 1 --2- 172.21.15.103:0/1698958293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f027c147b10 0x7f027c147fc0 secure :-1 s=THROTTLE_DONE pgs=1365 cs=0 l=1 rx=0x7f02680010d0 tx=0x7f0274010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.605+0000 7f0279ffb700 1 -- 172.21.15.103:0/1698958293 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02740120d0 con 0x7f027c147b10 2020-04-22T14:14:04.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.605+0000 7f0279ffb700 1 -- 172.21.15.103:0/1698958293 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0274013070 con 0x7f027c147b10 2020-04-22T14:14:04.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.605+0000 7f0283064700 1 -- 172.21.15.103:0/1698958293 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f027c14d100 con 0x7f027c147b10 2020-04-22T14:14:04.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.605+0000 7f0279ffb700 1 -- 172.21.15.103:0/1698958293 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0274005e20 con 0x7f027c147b10 2020-04-22T14:14:04.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.605+0000 7f0283064700 1 -- 172.21.15.103:0/1698958293 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f027c14a7c0 con 0x7f027c147b10 2020-04-22T14:14:04.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.605+0000 7f0281601700 1 --2- 172.21.15.103:0/1698958293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f027c147b10 0x7f027c147fc0 secure :-1 s=THROTTLE_DONE pgs=1365 cs=0 l=1 rx=0x7f02680010d0 tx=0x7f0274010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.606+0000 7f0281601700 1 --2- 172.21.15.103:0/1698958293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f027c147b10 0x7f027c147fc0 secure :-1 s=THROTTLE_DONE pgs=1365 cs=0 l=1 rx=0x7f02680010d0 tx=0x7f0274010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.606+0000 7f0279ffb700 1 -- 172.21.15.103:0/1698958293 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f0274012810 con 0x7f027c147b10 2020-04-22T14:14:04.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.606+0000 7f0283064700 1 -- 172.21.15.103:0/1698958293 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f027c056c90 con 0x7f027c147b10 2020-04-22T14:14:04.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.606+0000 7f0279ffb700 1 --2- 172.21.15.103:0/1698958293 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f026404d9a0 0x7f026404fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:04.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.606+0000 7f0279ffb700 1 -- 172.21.15.103:0/1698958293 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0274060cc0 con 0x7f027c147b10 2020-04-22T14:14:04.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.606+0000 7f0280e00700 1 --2- 172.21.15.103:0/1698958293 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f026404d9a0 0x7f026404fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:04.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.606+0000 7f0280e00700 1 --2- 172.21.15.103:0/1698958293 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f026404d9a0 0x7f026404fe60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0270000fe0 tx=0x7f027000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.607+0000 7f0280e00700 1 --2- 172.21.15.103:0/1698958293 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f026404d9a0 0x7f026404fe60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0270000fe0 tx=0x7f027000fde0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.607+0000 7f0280e00700 1 --2- 172.21.15.103:0/1698958293 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f026404d9a0 0x7f026404fe60 secure :-1 s=READY pgs=501 cs=0 l=1 rx=0x7f0270000fe0 tx=0x7f027000fde0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:04.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.610+0000 7f0281601700 1 --2- 172.21.15.103:0/1698958293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f027c147b10 0x7f027c147fc0 secure :-1 s=THROTTLE_DONE pgs=1365 cs=0 l=1 rx=0x7f02680010d0 tx=0x7f0274010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.610+0000 7f0279ffb700 1 -- 172.21.15.103:0/1698958293 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f027403c0c0 con 0x7f027c147b10 2020-04-22T14:14:04.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.751+0000 7f0283064700 1 -- 172.21.15.103:0/1698958293 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f027c06a960 con 0x7f027c147b10 2020-04-22T14:14:04.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.751+0000 7f0281601700 1 --2- 172.21.15.103:0/1698958293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f027c147b10 0x7f027c147fc0 secure :-1 s=THROTTLE_DONE pgs=1365 cs=0 l=1 rx=0x7f02680010d0 tx=0x7f0274010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.751+0000 7f0279ffb700 1 -- 172.21.15.103:0/1698958293 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v90) v1 ==== 110+0+10 (secure 0 0 0) 0x7f027403f6e0 con 0x7f027c147b10 2020-04-22T14:14:04.755 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:14:04.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.752+0000 7f0283064700 1 -- 172.21.15.103:0/1698958293 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f026404d9a0 msgr2=0x7f026404fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:04.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.752+0000 7f0283064700 1 --2- 172.21.15.103:0/1698958293 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f026404d9a0 0x7f026404fe60 secure :-1 s=READY pgs=501 cs=0 l=1 rx=0x7f0270000fe0 tx=0x7f027000fde0).stop 2020-04-22T14:14:04.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.752+0000 7f0283064700 1 -- 172.21.15.103:0/1698958293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f027c147b10 msgr2=0x7f027c147fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:04.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.752+0000 7f0283064700 1 --2- 172.21.15.103:0/1698958293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f027c147b10 0x7f027c147fc0 secure :-1 s=READY pgs=1365 cs=0 l=1 rx=0x7f02680010d0 tx=0x7f0274010bc0).stop 2020-04-22T14:14:04.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.752+0000 7f0283064700 1 -- 172.21.15.103:0/1698958293 shutdown_connections 2020-04-22T14:14:04.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.752+0000 7f0283064700 1 --2- 172.21.15.103:0/1698958293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f027c147b10 0x7f027c147fc0 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:04.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.752+0000 7f0283064700 1 --2- 172.21.15.103:0/1698958293 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f027c1465d0 0x7f027c114940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:04.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.752+0000 7f0283064700 1 --2- 172.21.15.103:0/1698958293 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f026404d9a0 0x7f026404fe60 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:04.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.752+0000 7f0283064700 1 --2- 172.21.15.103:0/1698958293 >> v2:172.21.15.86:3300/0 conn(0x7f027c114050 0x7f027c14d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:04.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.752+0000 7f0283064700 1 -- 172.21.15.103:0/1698958293 >> 172.21.15.103:0/1698958293 conn(0x7f027c05b7b0 msgr2=0x7f027c0b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:04.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.752+0000 7f0283064700 1 -- 172.21.15.103:0/1698958293 shutdown_connections 2020-04-22T14:14:04.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.752+0000 7f0283064700 1 -- 172.21.15.103:0/1698958293 wait complete. 2020-04-22T14:14:04.765 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:04.779 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:14:04.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.925+0000 7fa0c2df7700 1 Processor -- start 2020-04-22T14:14:04.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.925+0000 7fa0c2df7700 1 -- start start 2020-04-22T14:14:04.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.926+0000 7fa0c2df7700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa0bc0b9140 0x7fa0bc12b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:04.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.926+0000 7fa0c2df7700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa0bc12b670 0x7fa0bc143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:04.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.926+0000 7fa0c2df7700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0bc1467e0 con 0x7fa0bc0ac950 2020-04-22T14:14:04.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.926+0000 7fa0c2df7700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0bc0602f0 con 0x7fa0bc12b670 2020-04-22T14:14:04.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.926+0000 7fa0c2df7700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0bc060050 con 0x7fa0bc0b9140 2020-04-22T14:14:04.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.926+0000 7fa0bbfff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa0bc0ac950 0x7fa0bc146c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46610/0 (socket says 172.21.15.103:46610) 2020-04-22T14:14:04.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.926+0000 7fa0bbfff700 1 -- 172.21.15.103:0/4084213554 learned_addr learned my addr 172.21.15.103:0/4084213554 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:14:04.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.926+0000 7fa0bb7fe700 1 -- 172.21.15.103:0/4084213554 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2287314053 0 0) 0x7fa0bc1467e0 con 0x7fa0bc0ac950 2020-04-22T14:14:04.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.926+0000 7fa0c1394700 1 --2- 172.21.15.103:0/4084213554 >> v2:172.21.15.86:3300/0 conn(0x7fa0bc12b670 0x7fa0bc143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:04.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.926+0000 7fa0c0b93700 1 --2- 172.21.15.103:0/4084213554 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa0bc0b9140 0x7fa0bc12b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:04.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.926+0000 7fa0bb7fe700 1 -- 172.21.15.103:0/4084213554 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa09c003230 con 0x7fa0bc0ac950 2020-04-22T14:14:04.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.926+0000 7fa0bb7fe700 1 -- 172.21.15.103:0/4084213554 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2989724661 0 0) 0x7fa09c003230 con 0x7fa0bc0ac950 2020-04-22T14:14:04.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.926+0000 7fa0bb7fe700 1 -- 172.21.15.103:0/4084213554 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa0bc0b9140 msgr2=0x7fa0bc12b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:04.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.926+0000 7fa0bb7fe700 1 --2- 172.21.15.103:0/4084213554 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa0bc0b9140 0x7fa0bc12b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:04.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.926+0000 7fa0bb7fe700 1 -- 172.21.15.103:0/4084213554 >> v2:172.21.15.86:3300/0 conn(0x7fa0bc12b670 msgr2=0x7fa0bc143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:04.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.926+0000 7fa0bb7fe700 1 --2- 172.21.15.103:0/4084213554 >> v2:172.21.15.86:3300/0 conn(0x7fa0bc12b670 0x7fa0bc143090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:04.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.926+0000 7fa0bb7fe700 1 -- 172.21.15.103:0/4084213554 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0bc0b9520 con 0x7fa0bc0ac950 2020-04-22T14:14:04.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.926+0000 7fa0bb7fe700 1 -- 172.21.15.103:0/4084213554 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fa0ac0016d0 con 0x7fa0bc0ac950 2020-04-22T14:14:04.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.926+0000 7fa0bb7fe700 1 -- 172.21.15.103:0/4084213554 >> v1:172.21.15.103:6789/0 conn(0x7fa0bc0ac950 legacy=0x7fa0bc146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:04.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.926+0000 7fa0bb7fe700 1 --2- 172.21.15.103:0/4084213554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa09c003720 0x7fa09c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:04.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.926+0000 7fa0bb7fe700 1 --2- 172.21.15.103:0/4084213554 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa09c004060 0x7fa09c004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:04.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.926+0000 7fa0bb7fe700 1 --2- 172.21.15.103:0/4084213554 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa0bc0b9140 0x7fa09c004ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:04.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.926+0000 7fa0bb7fe700 1 -- 172.21.15.103:0/4084213554 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0bc0602f0 con 0x7fa09c004060 2020-04-22T14:14:04.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.926+0000 7fa0bb7fe700 1 -- 172.21.15.103:0/4084213554 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0bc060050 con 0x7fa09c003720 2020-04-22T14:14:04.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.926+0000 7fa0bb7fe700 1 -- 172.21.15.103:0/4084213554 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c004ff0 con 0x7fa0bc0b9140 2020-04-22T14:14:04.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.926+0000 7fa0c0b93700 1 --2- 172.21.15.103:0/4084213554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa09c003720 0x7fa09c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:04.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.926+0000 7fa0bbfff700 1 --2- 172.21.15.103:0/4084213554 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa09c004060 0x7fa09c004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:04.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.926+0000 7fa0c1394700 1 --2- 172.21.15.103:0/4084213554 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa0bc0b9140 0x7fa09c004ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:04.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.927+0000 7fa0c0b93700 1 -- 172.21.15.103:0/4084213554 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa0bc0b9140 msgr2=0x7fa09c004ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:04.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.927+0000 7fa0c0b93700 1 --2- 172.21.15.103:0/4084213554 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa0bc0b9140 0x7fa09c004ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:04.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.927+0000 7fa0c0b93700 1 -- 172.21.15.103:0/4084213554 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa09c004060 msgr2=0x7fa09c004530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:04.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.927+0000 7fa0c0b93700 1 --2- 172.21.15.103:0/4084213554 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa09c004060 0x7fa09c004530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:04.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.927+0000 7fa0c0b93700 1 -- 172.21.15.103:0/4084213554 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa09c003230 con 0x7fa09c003720 2020-04-22T14:14:04.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.927+0000 7fa0bbfff700 1 --2- 172.21.15.103:0/4084213554 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa09c004060 0x7fa09c004530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:14:04.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.927+0000 7fa0c0b93700 1 --2- 172.21.15.103:0/4084213554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa09c003720 0x7fa09c003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa0a4002f30 tx=0x7fa0a4010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.927+0000 7fa0c0b93700 1 --2- 172.21.15.103:0/4084213554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa09c003720 0x7fa09c003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa0a4002f30 tx=0x7fa0a4010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.927+0000 7fa0c0b93700 1 --2- 172.21.15.103:0/4084213554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa09c003720 0x7fa09c003b40 secure :-1 s=READY pgs=1367 cs=0 l=1 rx=0x7fa0a4002f30 tx=0x7fa0a4010020).ready entity=mon.1 client_cookie=ec09b5c2b2d4d5f9 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:04.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.927+0000 7fa0c0b93700 1 --2- 172.21.15.103:0/4084213554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa09c003720 0x7fa09c003b40 secure :-1 s=THROTTLE_DONE pgs=1367 cs=0 l=1 rx=0x7fa0a4002f30 tx=0x7fa0a4010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.927+0000 7fa0bb7fe700 1 -- 172.21.15.103:0/4084213554 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0a4008d30 con 0x7fa09c003720 2020-04-22T14:14:04.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.927+0000 7fa0c0b93700 1 --2- 172.21.15.103:0/4084213554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa09c003720 0x7fa09c003b40 secure :-1 s=THROTTLE_DONE pgs=1367 cs=0 l=1 rx=0x7fa0a4002f30 tx=0x7fa0a4010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.927+0000 7fa0c0b93700 1 --2- 172.21.15.103:0/4084213554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa09c003720 0x7fa09c003b40 secure :-1 s=THROTTLE_DONE pgs=1367 cs=0 l=1 rx=0x7fa0a4002f30 tx=0x7fa0a4010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.927+0000 7fa0bb7fe700 1 -- 172.21.15.103:0/4084213554 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a4008e90 con 0x7fa09c003720 2020-04-22T14:14:04.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.927+0000 7fa0bb7fe700 1 -- 172.21.15.103:0/4084213554 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0a4010b40 con 0x7fa09c003720 2020-04-22T14:14:04.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.927+0000 7fa0c2df7700 1 -- 172.21.15.103:0/4084213554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa09c003720 msgr2=0x7fa09c003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:04.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.927+0000 7fa0c2df7700 1 --2- 172.21.15.103:0/4084213554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa09c003720 0x7fa09c003b40 secure :-1 s=READY pgs=1367 cs=0 l=1 rx=0x7fa0a4002f30 tx=0x7fa0a4010020).stop 2020-04-22T14:14:04.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.927+0000 7fa0c1394700 1 -- 172.21.15.103:0/4084213554 reap_dead start 2020-04-22T14:14:04.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.927+0000 7fa0c2df7700 1 -- 172.21.15.103:0/4084213554 shutdown_connections 2020-04-22T14:14:04.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.927+0000 7fa0c2df7700 1 -- 172.21.15.103:0/4084213554 >> 172.21.15.103:0/4084213554 conn(0x7fa0bc05b7b0 msgr2=0x7fa0bc0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:04.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.927+0000 7fa0c2df7700 1 -- 172.21.15.103:0/4084213554 shutdown_connections 2020-04-22T14:14:04.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.927+0000 7fa0c2df7700 1 -- 172.21.15.103:0/4084213554 wait complete. 2020-04-22T14:14:04.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.928+0000 7fa0c2df7700 1 Processor -- start 2020-04-22T14:14:04.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.928+0000 7fa0c2df7700 1 -- start start 2020-04-22T14:14:04.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.929+0000 7fa0c2df7700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa0bc143d30 0x7fa0bc0b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:04.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.929+0000 7fa0c2df7700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa0bc0b4050 0x7fa0bc126430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:04.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.929+0000 7fa0c2df7700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0bc1279a0 con 0x7fa0bc0b3ba0 2020-04-22T14:14:04.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.929+0000 7fa0c2df7700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0bc0b1c50 con 0x7fa0bc143d30 2020-04-22T14:14:04.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.929+0000 7fa0c2df7700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0bc126f20 con 0x7fa0bc0b4050 2020-04-22T14:14:04.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.929+0000 7fa0c1394700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa0bc0b4050 0x7fa0bc126430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:04.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.929+0000 7fa0c1394700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa0bc0b4050 0x7fa0bc126430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54434/0 (socket says 172.21.15.103:54434) 2020-04-22T14:14:04.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.929+0000 7fa0c1394700 1 -- 172.21.15.103:0/2874727189 learned_addr learned my addr 172.21.15.103:0/2874727189 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:14:04.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.929+0000 7fa0c0b93700 1 --2- 172.21.15.103:0/2874727189 >> v2:172.21.15.86:3300/0 conn(0x7fa0bc143d30 0x7fa0bc0b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:04.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.930+0000 7fa0c1394700 1 -- 172.21.15.103:0/2874727189 >> v2:172.21.15.86:3300/0 conn(0x7fa0bc143d30 msgr2=0x7fa0bc0b4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:04.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.930+0000 7fa0c1394700 1 --2- 172.21.15.103:0/2874727189 >> v2:172.21.15.86:3300/0 conn(0x7fa0bc143d30 0x7fa0bc0b4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:04.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.930+0000 7fa0c1394700 1 -- 172.21.15.103:0/2874727189 >> v1:172.21.15.86:6789/0 conn(0x7fa0bc0b3ba0 legacy=0x7fa0bc125d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:04.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.930+0000 7fa0c1394700 1 -- 172.21.15.103:0/2874727189 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0bc0b3810 con 0x7fa0bc0b4050 2020-04-22T14:14:04.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.930+0000 7fa0c1394700 1 --2- 172.21.15.103:0/2874727189 >> v2:172.21.15.103:3300/0 conn(0x7fa0bc0b4050 0x7fa0bc126430 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa0bc1272a0 tx=0x7fa0b4010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.930+0000 7fa0c1394700 1 --2- 172.21.15.103:0/2874727189 >> v2:172.21.15.103:3300/0 conn(0x7fa0bc0b4050 0x7fa0bc126430 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa0bc1272a0 tx=0x7fa0b4010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.930+0000 7fa0c1394700 1 --2- 172.21.15.103:0/2874727189 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0bc0b4050 0x7fa0bc126430 secure :-1 s=READY pgs=1368 cs=0 l=1 rx=0x7fa0bc1272a0 tx=0x7fa0b4010ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:04.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.930+0000 7fa0c1394700 1 --2- 172.21.15.103:0/2874727189 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0bc0b4050 0x7fa0bc126430 secure :-1 s=THROTTLE_DONE pgs=1368 cs=0 l=1 rx=0x7fa0bc1272a0 tx=0x7fa0b4010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.930+0000 7fa0b9ffb700 1 -- 172.21.15.103:0/2874727189 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0b4005e20 con 0x7fa0bc0b4050 2020-04-22T14:14:04.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.930+0000 7fa0c1394700 1 --2- 172.21.15.103:0/2874727189 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0bc0b4050 0x7fa0bc126430 secure :-1 s=THROTTLE_DONE pgs=1368 cs=0 l=1 rx=0x7fa0bc1272a0 tx=0x7fa0b4010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.930+0000 7fa0c1394700 1 --2- 172.21.15.103:0/2874727189 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0bc0b4050 0x7fa0bc126430 secure :-1 s=THROTTLE_DONE pgs=1368 cs=0 l=1 rx=0x7fa0bc1272a0 tx=0x7fa0b4010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.930+0000 7fa0b9ffb700 1 -- 172.21.15.103:0/2874727189 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b4008720 con 0x7fa0bc0b4050 2020-04-22T14:14:04.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.930+0000 7fa0b9ffb700 1 -- 172.21.15.103:0/2874727189 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0b4008a80 con 0x7fa0bc0b4050 2020-04-22T14:14:04.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.930+0000 7fa0c2df7700 1 -- 172.21.15.103:0/2874727189 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0bc1273c0 con 0x7fa0bc0b4050 2020-04-22T14:14:04.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.930+0000 7fa0c2df7700 1 -- 172.21.15.103:0/2874727189 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0bc0b6010 con 0x7fa0bc0b4050 2020-04-22T14:14:04.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.930+0000 7fa0c1394700 1 --2- 172.21.15.103:0/2874727189 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0bc0b4050 0x7fa0bc126430 secure :-1 s=THROTTLE_DONE pgs=1368 cs=0 l=1 rx=0x7fa0bc1272a0 tx=0x7fa0b4010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.931+0000 7fa0c2df7700 1 -- 172.21.15.103:0/2874727189 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0bc056c90 con 0x7fa0bc0b4050 2020-04-22T14:14:04.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.931+0000 7fa0b9ffb700 1 -- 172.21.15.103:0/2874727189 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fa0b4008be0 con 0x7fa0bc0b4050 2020-04-22T14:14:04.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.931+0000 7fa0c1394700 1 --2- 172.21.15.103:0/2874727189 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0bc0b4050 0x7fa0bc126430 secure :-1 s=THROTTLE_DONE pgs=1368 cs=0 l=1 rx=0x7fa0bc1272a0 tx=0x7fa0b4010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.931+0000 7fa0b9ffb700 1 --2- 172.21.15.103:0/2874727189 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa0a004d910 0x7fa0a004fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:04.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.931+0000 7fa0b9ffb700 1 -- 172.21.15.103:0/2874727189 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa0b4060e70 con 0x7fa0bc0b4050 2020-04-22T14:14:04.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.932+0000 7fa0c0b93700 1 --2- 172.21.15.103:0/2874727189 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa0a004d910 0x7fa0a004fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:04.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.932+0000 7fa0c0b93700 1 --2- 172.21.15.103:0/2874727189 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa0a004d910 0x7fa0a004fdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa0a4002f30 tx=0x7fa0a4010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.932+0000 7fa0c0b93700 1 --2- 172.21.15.103:0/2874727189 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa0a004d910 0x7fa0a004fdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa0a4002f30 tx=0x7fa0a4010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.932+0000 7fa0c0b93700 1 --2- 172.21.15.103:0/2874727189 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa0a004d910 0x7fa0a004fdd0 secure :-1 s=READY pgs=502 cs=0 l=1 rx=0x7fa0a4002f30 tx=0x7fa0a4010020).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:04.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.935+0000 7fa0c1394700 1 --2- 172.21.15.103:0/2874727189 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0bc0b4050 0x7fa0bc126430 secure :-1 s=THROTTLE_DONE pgs=1368 cs=0 l=1 rx=0x7fa0bc1272a0 tx=0x7fa0b4010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:04.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:04.935+0000 7fa0b9ffb700 1 -- 172.21.15.103:0/2874727189 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fa0b403c250 con 0x7fa0bc0b4050 2020-04-22T14:14:05.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.079+0000 7fa0c2df7700 1 -- 172.21.15.103:0/2874727189 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa0bc127060 con 0x7fa0bc0b4050 2020-04-22T14:14:05.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.080+0000 7fa0c1394700 1 --2- 172.21.15.103:0/2874727189 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0bc0b4050 0x7fa0bc126430 secure :-1 s=THROTTLE_DONE pgs=1368 cs=0 l=1 rx=0x7fa0bc1272a0 tx=0x7fa0b4010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.080+0000 7fa0b9ffb700 1 -- 172.21.15.103:0/2874727189 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v90) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa0b403f870 con 0x7fa0bc0b4050 2020-04-22T14:14:05.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.081+0000 7fa0c2df7700 1 -- 172.21.15.103:0/2874727189 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa0a004d910 msgr2=0x7fa0a004fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:05.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.081+0000 7fa0c2df7700 1 --2- 172.21.15.103:0/2874727189 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa0a004d910 0x7fa0a004fdd0 secure :-1 s=READY pgs=502 cs=0 l=1 rx=0x7fa0a4002f30 tx=0x7fa0a4010020).stop 2020-04-22T14:14:05.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.081+0000 7fa0c2df7700 1 -- 172.21.15.103:0/2874727189 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0bc0b4050 msgr2=0x7fa0bc126430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:05.087 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.081+0000 7fa0c2df7700 1 --2- 172.21.15.103:0/2874727189 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0bc0b4050 0x7fa0bc126430 secure :-1 s=READY pgs=1368 cs=0 l=1 rx=0x7fa0bc1272a0 tx=0x7fa0b4010ec0).stop 2020-04-22T14:14:05.087 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.081+0000 7fa0c2df7700 1 -- 172.21.15.103:0/2874727189 shutdown_connections 2020-04-22T14:14:05.087 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.081+0000 7fa0c2df7700 1 --2- 172.21.15.103:0/2874727189 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0bc0b4050 0x7fa0bc126430 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:05.087 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.081+0000 7fa0c2df7700 1 --2- 172.21.15.103:0/2874727189 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa0a004d910 0x7fa0a004fdd0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:05.087 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.081+0000 7fa0c2df7700 1 --2- 172.21.15.103:0/2874727189 >> v2:172.21.15.86:3300/0 conn(0x7fa0bc143d30 0x7fa0bc0b4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:05.087 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.081+0000 7fa0c2df7700 1 -- 172.21.15.103:0/2874727189 >> 172.21.15.103:0/2874727189 conn(0x7fa0bc05b7b0 msgr2=0x7fa0bc0b85c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:05.087 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.081+0000 7fa0c2df7700 1 -- 172.21.15.103:0/2874727189 shutdown_connections 2020-04-22T14:14:05.087 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.081+0000 7fa0c2df7700 1 -- 172.21.15.103:0/2874727189 wait complete. 2020-04-22T14:14:05.088 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:14:05.095 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:05.108 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-22T14:14:05.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.268+0000 7f5c1c878700 1 Processor -- start 2020-04-22T14:14:05.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.268+0000 7f5c1c878700 1 -- start start 2020-04-22T14:14:05.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.269+0000 7f5c1c878700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5c180b9140 0x7f5c1812b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:05.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.269+0000 7f5c1c878700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5c180ac950 0x7f5c1812b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:05.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.269+0000 7f5c1c878700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c181467e0 con 0x7f5c18146c40 2020-04-22T14:14:05.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.269+0000 7f5c1c878700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c180602f0 con 0x7f5c180b9140 2020-04-22T14:14:05.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.269+0000 7f5c1c878700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c18060050 con 0x7f5c180ac950 2020-04-22T14:14:05.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.269+0000 7f5c15d9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5c180ac950 0x7f5c1812b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:05.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.269+0000 7f5c16d9d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f5c18146c40 0x7f5c18143090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46628/0 (socket says 172.21.15.103:46628) 2020-04-22T14:14:05.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.269+0000 7f5c16d9d700 1 -- 172.21.15.103:0/3837314038 learned_addr learned my addr 172.21.15.103:0/3837314038 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:14:05.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.269+0000 7f5c1659c700 1 --2- 172.21.15.103:0/3837314038 >> v2:172.21.15.86:3300/0 conn(0x7f5c180b9140 0x7f5c1812b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:05.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.269+0000 7f5c15d9b700 1 -- 172.21.15.103:0/3837314038 >> v2:172.21.15.86:3300/0 conn(0x7f5c180b9140 msgr2=0x7f5c1812b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:05.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.269+0000 7f5c15d9b700 1 --2- 172.21.15.103:0/3837314038 >> v2:172.21.15.86:3300/0 conn(0x7f5c180b9140 0x7f5c1812b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:05.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.269+0000 7f5c15d9b700 1 -- 172.21.15.103:0/3837314038 >> v1:172.21.15.103:6789/0 conn(0x7f5c18146c40 legacy=0x7f5c18143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:05.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.269+0000 7f5c15d9b700 1 -- 172.21.15.103:0/3837314038 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c180b9520 con 0x7f5c180ac950 2020-04-22T14:14:05.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.269+0000 7f5c1559a700 1 -- 172.21.15.103:0/3837314038 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3530434021 0 0) 0x7f5c181467e0 con 0x7f5c18146c40 2020-04-22T14:14:05.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.269+0000 7f5c1659c700 1 --2- 172.21.15.103:0/3837314038 >> v2:172.21.15.86:3300/0 conn(0x7f5c180b9140 0x7f5c1812b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:14:05.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.269+0000 7f5c15d9b700 1 --2- 172.21.15.103:0/3837314038 >> v2:172.21.15.103:3300/0 conn(0x7f5c180ac950 0x7f5c1812b670 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5c08002f30 tx=0x7f5c08007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.269+0000 7f5c15d9b700 1 --2- 172.21.15.103:0/3837314038 >> v2:172.21.15.103:3300/0 conn(0x7f5c180ac950 0x7f5c1812b670 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5c08002f30 tx=0x7f5c08007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.269+0000 7f5c15d9b700 1 --2- 172.21.15.103:0/3837314038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c180ac950 0x7f5c1812b670 secure :-1 s=READY pgs=1370 cs=0 l=1 rx=0x7f5c08002f30 tx=0x7f5c08007a40).ready entity=mon.1 client_cookie=c197cd6423fee1f9 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:05.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.270+0000 7f5c15d9b700 1 --2- 172.21.15.103:0/3837314038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c180ac950 0x7f5c1812b670 secure :-1 s=THROTTLE_DONE pgs=1370 cs=0 l=1 rx=0x7f5c08002f30 tx=0x7f5c08007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.270+0000 7f5c1559a700 1 -- 172.21.15.103:0/3837314038 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c08011470 con 0x7f5c180ac950 2020-04-22T14:14:05.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.270+0000 7f5c15d9b700 1 --2- 172.21.15.103:0/3837314038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c180ac950 0x7f5c1812b670 secure :-1 s=THROTTLE_DONE pgs=1370 cs=0 l=1 rx=0x7f5c08002f30 tx=0x7f5c08007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.270+0000 7f5c1559a700 1 -- 172.21.15.103:0/3837314038 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c080115d0 con 0x7f5c180ac950 2020-04-22T14:14:05.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.270+0000 7f5c15d9b700 1 --2- 172.21.15.103:0/3837314038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c180ac950 0x7f5c1812b670 secure :-1 s=THROTTLE_DONE pgs=1370 cs=0 l=1 rx=0x7f5c08002f30 tx=0x7f5c08007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.270+0000 7f5c1c878700 1 -- 172.21.15.103:0/3837314038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c180ac950 msgr2=0x7f5c1812b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:05.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.270+0000 7f5c1c878700 1 --2- 172.21.15.103:0/3837314038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c180ac950 0x7f5c1812b670 secure :-1 s=READY pgs=1370 cs=0 l=1 rx=0x7f5c08002f30 tx=0x7f5c08007a40).stop 2020-04-22T14:14:05.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.270+0000 7f5c1559a700 1 -- 172.21.15.103:0/3837314038 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c080119b0 con 0x7f5c180ac950 2020-04-22T14:14:05.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.270+0000 7f5c1c878700 1 -- 172.21.15.103:0/3837314038 shutdown_connections 2020-04-22T14:14:05.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.270+0000 7f5c1c878700 1 --2- 172.21.15.103:0/3837314038 >> v2:172.21.15.86:3300/0 conn(0x7f5c180b9140 0x7f5c1812b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:05.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.270+0000 7f5c1c878700 1 --2- 172.21.15.103:0/3837314038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c180ac950 0x7f5c1812b670 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:05.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.270+0000 7f5c1c878700 1 -- 172.21.15.103:0/3837314038 >> 172.21.15.103:0/3837314038 conn(0x7f5c1805b7b0 msgr2=0x7f5c180b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:05.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.270+0000 7f5c1c878700 1 -- 172.21.15.103:0/3837314038 shutdown_connections 2020-04-22T14:14:05.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.270+0000 7f5c1c878700 1 -- 172.21.15.103:0/3837314038 wait complete. 2020-04-22T14:14:05.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.271+0000 7f5c1c878700 1 Processor -- start 2020-04-22T14:14:05.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.271+0000 7f5c1c878700 1 -- start start 2020-04-22T14:14:05.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.272+0000 7f5c1c878700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5c180b9140 0x7f5c181558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:05.289 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.272+0000 7f5c1c878700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c18146c40 0x7f5c18064780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:05.289 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.272+0000 7f5c1c878700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c180667d0 con 0x7f5c180ac950 2020-04-22T14:14:05.289 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.272+0000 7f5c1c878700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c18140f30 con 0x7f5c180b9140 2020-04-22T14:14:05.289 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.272+0000 7f5c1c878700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c18140550 con 0x7f5c18146c40 2020-04-22T14:14:05.289 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.272+0000 7f5c15d9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5c180b9140 0x7f5c181558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:05.289 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.272+0000 7f5c16d9d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c18146c40 0x7f5c18064780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:05.289 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.272+0000 7f5c15d9b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5c180b9140 0x7f5c181558c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:51676/0 (socket says 172.21.15.103:51676) 2020-04-22T14:14:05.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.272+0000 7f5c15d9b700 1 -- 172.21.15.103:0/4250407261 learned_addr learned my addr 172.21.15.103:0/4250407261 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:14:05.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.272+0000 7f5c1659c700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f5c180ac950 0x7f5c18127be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:35556/0 (socket says 172.21.15.103:35556) 2020-04-22T14:14:05.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.272+0000 7f5c16d9d700 1 -- 172.21.15.103:0/4250407261 >> v2:172.21.15.86:3300/0 conn(0x7f5c180b9140 msgr2=0x7f5c181558c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:05.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.272+0000 7f5c16d9d700 1 --2- 172.21.15.103:0/4250407261 >> v2:172.21.15.86:3300/0 conn(0x7f5c180b9140 0x7f5c181558c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:05.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.272+0000 7f5c16d9d700 1 -- 172.21.15.103:0/4250407261 >> v1:172.21.15.86:6789/0 conn(0x7f5c180ac950 legacy=0x7f5c18127be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:05.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.272+0000 7f5c16d9d700 1 -- 172.21.15.103:0/4250407261 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c181407f0 con 0x7f5c18146c40 2020-04-22T14:14:05.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.272+0000 7f5c15d9b700 1 --2- 172.21.15.103:0/4250407261 >> v2:172.21.15.86:3300/0 conn(0x7f5c180b9140 0x7f5c181558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:14:05.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.272+0000 7f5c16d9d700 1 --2- 172.21.15.103:0/4250407261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c18146c40 0x7f5c18064780 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5c10001210 tx=0x7f5c10010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.273+0000 7f5c16d9d700 1 --2- 172.21.15.103:0/4250407261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c18146c40 0x7f5c18064780 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5c10001210 tx=0x7f5c10010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.273+0000 7f5c16d9d700 1 --2- 172.21.15.103:0/4250407261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c18146c40 0x7f5c18064780 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7f5c10001210 tx=0x7f5c10010be0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:05.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.273+0000 7f5c16d9d700 1 --2- 172.21.15.103:0/4250407261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c18146c40 0x7f5c18064780 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f5c10001210 tx=0x7f5c10010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.273+0000 7f5c077fe700 1 -- 172.21.15.103:0/4250407261 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c10005e30 con 0x7f5c18146c40 2020-04-22T14:14:05.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.273+0000 7f5c16d9d700 1 --2- 172.21.15.103:0/4250407261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c18146c40 0x7f5c18064780 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f5c10001210 tx=0x7f5c10010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.273+0000 7f5c1c878700 1 -- 172.21.15.103:0/4250407261 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c18140a90 con 0x7f5c18146c40 2020-04-22T14:14:05.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.273+0000 7f5c077fe700 1 -- 172.21.15.103:0/4250407261 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c10012470 con 0x7f5c18146c40 2020-04-22T14:14:05.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.273+0000 7f5c16d9d700 1 --2- 172.21.15.103:0/4250407261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c18146c40 0x7f5c18064780 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f5c10001210 tx=0x7f5c10010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.273+0000 7f5c077fe700 1 -- 172.21.15.103:0/4250407261 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c10012890 con 0x7f5c18146c40 2020-04-22T14:14:05.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.273+0000 7f5c1c878700 1 -- 172.21.15.103:0/4250407261 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c181401d0 con 0x7f5c18146c40 2020-04-22T14:14:05.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.274+0000 7f5c16d9d700 1 --2- 172.21.15.103:0/4250407261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c18146c40 0x7f5c18064780 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f5c10001210 tx=0x7f5c10010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.274+0000 7f5c1c878700 1 -- 172.21.15.103:0/4250407261 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c18064f60 con 0x7f5c18146c40 2020-04-22T14:14:05.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.274+0000 7f5c077fe700 1 -- 172.21.15.103:0/4250407261 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f5c10012b50 con 0x7f5c18146c40 2020-04-22T14:14:05.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.274+0000 7f5c16d9d700 1 --2- 172.21.15.103:0/4250407261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c18146c40 0x7f5c18064780 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f5c10001210 tx=0x7f5c10010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.274+0000 7f5c077fe700 1 --2- 172.21.15.103:0/4250407261 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5bf404d9c0 0x7f5bf404fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:05.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.274+0000 7f5c077fe700 1 -- 172.21.15.103:0/4250407261 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5c100090c0 con 0x7f5c18146c40 2020-04-22T14:14:05.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.274+0000 7f5c1659c700 1 --2- 172.21.15.103:0/4250407261 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5bf404d9c0 0x7f5bf404fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:05.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.275+0000 7f5c1659c700 1 --2- 172.21.15.103:0/4250407261 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5bf404d9c0 0x7f5bf404fe80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5c1812a0d0 tx=0x7f5c0c008d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.275+0000 7f5c1659c700 1 --2- 172.21.15.103:0/4250407261 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5bf404d9c0 0x7f5bf404fe80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5c1812a0d0 tx=0x7f5c0c008d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.275+0000 7f5c1659c700 1 --2- 172.21.15.103:0/4250407261 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5bf404d9c0 0x7f5bf404fe80 secure :-1 s=READY pgs=503 cs=0 l=1 rx=0x7f5c1812a0d0 tx=0x7f5c0c008d70).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:05.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.278+0000 7f5c16d9d700 1 --2- 172.21.15.103:0/4250407261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c18146c40 0x7f5c18064780 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f5c10001210 tx=0x7f5c10010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.278+0000 7f5c077fe700 1 -- 172.21.15.103:0/4250407261 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f5c18064f60 con 0x7f5c18146c40 2020-04-22T14:14:05.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.419+0000 7f5c1c878700 1 -- 172.21.15.103:0/4250407261 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5c18064f60 con 0x7f5c18146c40 2020-04-22T14:14:05.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.420+0000 7f5c16d9d700 1 --2- 172.21.15.103:0/4250407261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c18146c40 0x7f5c18064780 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f5c10001210 tx=0x7f5c10010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.420+0000 7f5c077fe700 1 -- 172.21.15.103:0/4250407261 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) v1 ==== 104+0+10 (secure 0 0 0) 0x7f5c18064f60 con 0x7f5c18146c40 2020-04-22T14:14:05.423 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:14:05.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.421+0000 7f5c1c878700 1 -- 172.21.15.103:0/4250407261 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5bf404d9c0 msgr2=0x7f5bf404fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:05.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.421+0000 7f5c1c878700 1 --2- 172.21.15.103:0/4250407261 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5bf404d9c0 0x7f5bf404fe80 secure :-1 s=READY pgs=503 cs=0 l=1 rx=0x7f5c1812a0d0 tx=0x7f5c0c008d70).stop 2020-04-22T14:14:05.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.421+0000 7f5c1c878700 1 -- 172.21.15.103:0/4250407261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c18146c40 msgr2=0x7f5c18064780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:05.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.421+0000 7f5c1c878700 1 --2- 172.21.15.103:0/4250407261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c18146c40 0x7f5c18064780 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7f5c10001210 tx=0x7f5c10010be0).stop 2020-04-22T14:14:05.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.421+0000 7f5c1c878700 1 -- 172.21.15.103:0/4250407261 shutdown_connections 2020-04-22T14:14:05.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.421+0000 7f5c1c878700 1 --2- 172.21.15.103:0/4250407261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c18146c40 0x7f5c18064780 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:05.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.421+0000 7f5c1c878700 1 --2- 172.21.15.103:0/4250407261 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5bf404d9c0 0x7f5bf404fe80 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:05.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.421+0000 7f5c1c878700 1 --2- 172.21.15.103:0/4250407261 >> v2:172.21.15.86:3300/0 conn(0x7f5c180b9140 0x7f5c181558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:05.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.421+0000 7f5c1c878700 1 -- 172.21.15.103:0/4250407261 >> 172.21.15.103:0/4250407261 conn(0x7f5c1805b7b0 msgr2=0x7f5c1805c650 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:05.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.421+0000 7f5c1c878700 1 -- 172.21.15.103:0/4250407261 shutdown_connections 2020-04-22T14:14:05.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.421+0000 7f5c1c878700 1 -- 172.21.15.103:0/4250407261 wait complete. 2020-04-22T14:14:05.434 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:05.448 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-22T14:14:05.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.594+0000 7f8ea73dc700 1 Processor -- start 2020-04-22T14:14:05.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.594+0000 7f8ea73dc700 1 -- start start 2020-04-22T14:14:05.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.595+0000 7f8ea73dc700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ea00b4820 0x7f8ea00acb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:05.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.595+0000 7f8ea73dc700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea00af030 con 0x7f8ea0141f20 2020-04-22T14:14:05.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.595+0000 7f8ea73dc700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea0060250 con 0x7f8ea0061a30 2020-04-22T14:14:05.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.595+0000 7f8ea73dc700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea00623c0 con 0x7f8ea00b4820 2020-04-22T14:14:05.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.595+0000 7f8ea5178700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f8ea0061a30 0x7f8ea00ae920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46640/0 (socket says 172.21.15.103:46640) 2020-04-22T14:14:05.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.595+0000 7f8ea5178700 1 -- 172.21.15.103:0/3371723458 learned_addr learned my addr 172.21.15.103:0/3371723458 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:14:05.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.595+0000 7f8ea4977700 1 --2- 172.21.15.103:0/3371723458 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ea00b4820 0x7f8ea00acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:05.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.595+0000 7f8e8ffff700 1 -- 172.21.15.103:0/3371723458 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2351688965 0 0) 0x7f8ea0060250 con 0x7f8ea0061a30 2020-04-22T14:14:05.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.595+0000 7f8e8ffff700 1 -- 172.21.15.103:0/3371723458 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e88003230 con 0x7f8ea0061a30 2020-04-22T14:14:05.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.595+0000 7f8e8ffff700 1 -- 172.21.15.103:0/3371723458 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2055197742 0 0) 0x7f8ea00af030 con 0x7f8ea0141f20 2020-04-22T14:14:05.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.595+0000 7f8e8ffff700 1 -- 172.21.15.103:0/3371723458 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ea0060250 con 0x7f8ea0141f20 2020-04-22T14:14:05.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.595+0000 7f8e8ffff700 1 -- 172.21.15.103:0/3371723458 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2886907340 0 0) 0x7f8e88003230 con 0x7f8ea0061a30 2020-04-22T14:14:05.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.595+0000 7f8ea4977700 1 -- 172.21.15.103:0/3371723458 >> v1:172.21.15.103:6789/0 conn(0x7f8ea0061a30 legacy=0x7f8ea00ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:05.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.595+0000 7f8ea4977700 1 -- 172.21.15.103:0/3371723458 >> v1:172.21.15.86:6789/0 conn(0x7f8ea0141f20 legacy=0x7f8ea01423d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:05.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.595+0000 7f8ea4977700 1 -- 172.21.15.103:0/3371723458 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea0062660 con 0x7f8ea00b4820 2020-04-22T14:14:05.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.595+0000 7f8ea4977700 1 --2- 172.21.15.103:0/3371723458 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ea00b4820 0x7f8ea00acb10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8e900010d0 tx=0x7f8e9c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.595+0000 7f8ea4977700 1 --2- 172.21.15.103:0/3371723458 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ea00b4820 0x7f8ea00acb10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8e900010d0 tx=0x7f8e9c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.595+0000 7f8ea4977700 1 --2- 172.21.15.103:0/3371723458 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ea00b4820 0x7f8ea00acb10 secure :-1 s=READY pgs=130 cs=0 l=1 rx=0x7f8e900010d0 tx=0x7f8e9c0088e0).ready entity=mon.2 client_cookie=aa041f4a4136a4f9 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:05.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.596+0000 7f8ea4977700 1 --2- 172.21.15.103:0/3371723458 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ea00b4820 0x7f8ea00acb10 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f8e900010d0 tx=0x7f8e9c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.596+0000 7f8e8ffff700 1 -- 172.21.15.103:0/3371723458 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e900016d0 con 0x7f8ea00b4820 2020-04-22T14:14:05.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.596+0000 7f8ea4977700 1 --2- 172.21.15.103:0/3371723458 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ea00b4820 0x7f8ea00acb10 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f8e900010d0 tx=0x7f8e9c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.596+0000 7f8ea4977700 1 --2- 172.21.15.103:0/3371723458 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ea00b4820 0x7f8ea00acb10 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f8e900010d0 tx=0x7f8e9c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.596+0000 7f8e8ffff700 1 -- 172.21.15.103:0/3371723458 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9c011210 con 0x7f8ea00b4820 2020-04-22T14:14:05.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.596+0000 7f8e8ffff700 1 -- 172.21.15.103:0/3371723458 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e9c0115f0 con 0x7f8ea00b4820 2020-04-22T14:14:05.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.596+0000 7f8ea73dc700 1 -- 172.21.15.103:0/3371723458 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ea00b4820 msgr2=0x7f8ea00acb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:05.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.596+0000 7f8ea73dc700 1 --2- 172.21.15.103:0/3371723458 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ea00b4820 0x7f8ea00acb10 secure :-1 s=READY pgs=130 cs=0 l=1 rx=0x7f8e900010d0 tx=0x7f8e9c0088e0).stop 2020-04-22T14:14:05.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.596+0000 7f8ea73dc700 1 -- 172.21.15.103:0/3371723458 shutdown_connections 2020-04-22T14:14:05.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.596+0000 7f8ea73dc700 1 --2- 172.21.15.103:0/3371723458 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ea00b4820 0x7f8ea00acb10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:05.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.596+0000 7f8ea73dc700 1 -- 172.21.15.103:0/3371723458 >> 172.21.15.103:0/3371723458 conn(0x7f8ea005b7b0 msgr2=0x7f8ea00b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:05.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.596+0000 7f8ea73dc700 1 -- 172.21.15.103:0/3371723458 shutdown_connections 2020-04-22T14:14:05.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.596+0000 7f8ea73dc700 1 -- 172.21.15.103:0/3371723458 wait complete. 2020-04-22T14:14:05.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.597+0000 7f8ea73dc700 1 Processor -- start 2020-04-22T14:14:05.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.597+0000 7f8ea73dc700 1 -- start start 2020-04-22T14:14:05.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.598+0000 7f8ea73dc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8ea0061a30 0x7f8ea00b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:05.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.598+0000 7f8ea73dc700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea0144510 con 0x7f8ea00b4820 2020-04-22T14:14:05.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.598+0000 7f8ea73dc700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea00b1680 con 0x7f8ea0141f20 2020-04-22T14:14:05.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.598+0000 7f8ea73dc700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea0136410 con 0x7f8ea0061a30 2020-04-22T14:14:05.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.598+0000 7f8ea5979700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f8ea0141f20 0x7f8ea0063860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46650/0 (socket says 172.21.15.103:46650) 2020-04-22T14:14:05.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.598+0000 7f8ea5979700 1 -- 172.21.15.103:0/550114612 learned_addr learned my addr 172.21.15.103:0/550114612 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:14:05.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.598+0000 7f8e8e7fc700 1 -- 172.21.15.103:0/550114612 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3442588471 0 0) 0x7f8ea00b1680 con 0x7f8ea0141f20 2020-04-22T14:14:05.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.598+0000 7f8e8e7fc700 1 -- 172.21.15.103:0/550114612 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e80002fe0 con 0x7f8ea0141f20 2020-04-22T14:14:05.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.598+0000 7f8ea5178700 1 --2- 172.21.15.103:0/550114612 >> v2:172.21.15.86:3300/0 conn(0x7f8ea0061a30 0x7f8ea00b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:05.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.598+0000 7f8e8e7fc700 1 -- 172.21.15.103:0/550114612 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 545322046 0 0) 0x7f8e80002fe0 con 0x7f8ea0141f20 2020-04-22T14:14:05.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.598+0000 7f8e8e7fc700 1 -- 172.21.15.103:0/550114612 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8ea00b1680 con 0x7f8ea0141f20 2020-04-22T14:14:05.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.598+0000 7f8e8e7fc700 1 -- 172.21.15.103:0/550114612 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f8e98001d50 con 0x7f8ea0141f20 2020-04-22T14:14:05.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.598+0000 7f8e8e7fc700 1 -- 172.21.15.103:0/550114612 >> v2:172.21.15.86:3300/0 conn(0x7f8ea0061a30 msgr2=0x7f8ea00b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:05.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.598+0000 7f8e8e7fc700 1 --2- 172.21.15.103:0/550114612 >> v2:172.21.15.86:3300/0 conn(0x7f8ea0061a30 0x7f8ea00b1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:05.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.598+0000 7f8e8e7fc700 1 -- 172.21.15.103:0/550114612 >> v1:172.21.15.103:6789/0 conn(0x7f8ea0141f20 legacy=0x7f8ea0063860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:05.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.598+0000 7f8e8e7fc700 1 -- 172.21.15.103:0/550114612 >> v1:172.21.15.86:6789/0 conn(0x7f8ea00b4820 legacy=0x7f8ea0144dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:05.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.598+0000 7f8e8e7fc700 1 --2- 172.21.15.103:0/550114612 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8e80004a00 0x7f8e80004de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:05.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.598+0000 7f8e8e7fc700 1 --2- 172.21.15.103:0/550114612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e80003920 0x7f8e80003da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:05.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.598+0000 7f8e8e7fc700 1 --2- 172.21.15.103:0/550114612 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e80004200 0x7f8e8000b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:05.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.598+0000 7f8e8e7fc700 1 -- 172.21.15.103:0/550114612 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea0136410 con 0x7f8e80004200 2020-04-22T14:14:05.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.598+0000 7f8e8e7fc700 1 -- 172.21.15.103:0/550114612 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e800047f0 con 0x7f8e80003920 2020-04-22T14:14:05.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.598+0000 7f8e8e7fc700 1 -- 172.21.15.103:0/550114612 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8000bc00 con 0x7f8e80004a00 2020-04-22T14:14:05.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.598+0000 7f8ea4977700 1 --2- 172.21.15.103:0/550114612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e80003920 0x7f8e80003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:05.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.598+0000 7f8ea5178700 1 --2- 172.21.15.103:0/550114612 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8e80004a00 0x7f8e80004de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:05.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.598+0000 7f8ea5979700 1 --2- 172.21.15.103:0/550114612 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e80004200 0x7f8e8000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:05.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.599+0000 7f8ea4977700 1 -- 172.21.15.103:0/550114612 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8e80004a00 msgr2=0x7f8e80004de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:05.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.599+0000 7f8ea4977700 1 --2- 172.21.15.103:0/550114612 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8e80004a00 0x7f8e80004de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:05.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.599+0000 7f8ea4977700 1 -- 172.21.15.103:0/550114612 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e80004200 msgr2=0x7f8e8000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:05.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.599+0000 7f8ea4977700 1 --2- 172.21.15.103:0/550114612 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e80004200 0x7f8e8000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:05.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.599+0000 7f8ea4977700 1 -- 172.21.15.103:0/550114612 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea01454e0 con 0x7f8e80003920 2020-04-22T14:14:05.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.599+0000 7f8ea5979700 1 -- 172.21.15.103:0/550114612 reap_dead start 2020-04-22T14:14:05.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.599+0000 7f8ea73dc700 1 -- 172.21.15.103:0/550114612 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea0144dd0 con 0x7f8e80003920 2020-04-22T14:14:05.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.599+0000 7f8ea4977700 1 --2- 172.21.15.103:0/550114612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e80003920 0x7f8e80003da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8ea0142890 tx=0x7f8e9c0111b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.599+0000 7f8ea4977700 1 --2- 172.21.15.103:0/550114612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e80003920 0x7f8e80003da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8ea0142890 tx=0x7f8e9c0111b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.599+0000 7f8ea4977700 1 --2- 172.21.15.103:0/550114612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e80003920 0x7f8e80003da0 secure :-1 s=READY pgs=1373 cs=0 l=1 rx=0x7f8ea0142890 tx=0x7f8e9c0111b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:05.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.599+0000 7f8ea4977700 1 --2- 172.21.15.103:0/550114612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e80003920 0x7f8e80003da0 secure :-1 s=THROTTLE_DONE pgs=1373 cs=0 l=1 rx=0x7f8ea0142890 tx=0x7f8e9c0111b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.599+0000 7f8e8e7fc700 1 -- 172.21.15.103:0/550114612 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e9c011a70 con 0x7f8e80003920 2020-04-22T14:14:05.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.599+0000 7f8ea73dc700 1 -- 172.21.15.103:0/550114612 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea01452c0 con 0x7f8e80003920 2020-04-22T14:14:05.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.599+0000 7f8ea4977700 1 --2- 172.21.15.103:0/550114612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e80003920 0x7f8e80003da0 secure :-1 s=THROTTLE_DONE pgs=1373 cs=0 l=1 rx=0x7f8ea0142890 tx=0x7f8e9c0111b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.599+0000 7f8ea4977700 1 --2- 172.21.15.103:0/550114612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e80003920 0x7f8e80003da0 secure :-1 s=THROTTLE_DONE pgs=1373 cs=0 l=1 rx=0x7f8ea0142890 tx=0x7f8e9c0111b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.599+0000 7f8e8e7fc700 1 -- 172.21.15.103:0/550114612 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9c011bd0 con 0x7f8e80003920 2020-04-22T14:14:05.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.599+0000 7f8e8e7fc700 1 -- 172.21.15.103:0/550114612 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e9c0071a0 con 0x7f8e80003920 2020-04-22T14:14:05.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.599+0000 7f8ea4977700 1 --2- 172.21.15.103:0/550114612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e80003920 0x7f8e80003da0 secure :-1 s=THROTTLE_DONE pgs=1373 cs=0 l=1 rx=0x7f8ea0142890 tx=0x7f8e9c0111b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.600+0000 7f8ea73dc700 1 -- 172.21.15.103:0/550114612 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea0056c90 con 0x7f8e80003920 2020-04-22T14:14:05.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.600+0000 7f8e8e7fc700 1 -- 172.21.15.103:0/550114612 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f8e9c007300 con 0x7f8e80003920 2020-04-22T14:14:05.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.600+0000 7f8ea4977700 1 --2- 172.21.15.103:0/550114612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e80003920 0x7f8e80003da0 secure :-1 s=THROTTLE_DONE pgs=1373 cs=0 l=1 rx=0x7f8ea0142890 tx=0x7f8e9c0111b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.600+0000 7f8e8e7fc700 1 --2- 172.21.15.103:0/550114612 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8e80051960 0x7f8e80053e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:05.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.600+0000 7f8e8e7fc700 1 -- 172.21.15.103:0/550114612 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8e9c0637a0 con 0x7f8e80003920 2020-04-22T14:14:05.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.600+0000 7f8ea5178700 1 --2- 172.21.15.103:0/550114612 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8e80051960 0x7f8e80053e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:05.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.601+0000 7f8ea5178700 1 --2- 172.21.15.103:0/550114612 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8e80051960 0x7f8e80053e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8e90000fa0 tx=0x7f8e900017d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.601+0000 7f8ea5178700 1 --2- 172.21.15.103:0/550114612 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8e80051960 0x7f8e80053e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8e90000fa0 tx=0x7f8e900017d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.601+0000 7f8ea5178700 1 --2- 172.21.15.103:0/550114612 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8e80051960 0x7f8e80053e20 secure :-1 s=READY pgs=504 cs=0 l=1 rx=0x7f8e90000fa0 tx=0x7f8e900017d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:05.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.604+0000 7f8ea4977700 1 --2- 172.21.15.103:0/550114612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e80003920 0x7f8e80003da0 secure :-1 s=THROTTLE_DONE pgs=1373 cs=0 l=1 rx=0x7f8ea0142890 tx=0x7f8e9c0111b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.604+0000 7f8e8e7fc700 1 -- 172.21.15.103:0/550114612 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f8e9c03ec40 con 0x7f8e80003920 2020-04-22T14:14:05.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.747+0000 7f8ea73dc700 1 -- 172.21.15.103:0/550114612 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8ea006a960 con 0x7f8e80003920 2020-04-22T14:14:05.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.748+0000 7f8ea4977700 1 --2- 172.21.15.103:0/550114612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e80003920 0x7f8e80003da0 secure :-1 s=THROTTLE_DONE pgs=1373 cs=0 l=1 rx=0x7f8ea0142890 tx=0x7f8e9c0111b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.748+0000 7f8e8e7fc700 1 -- 172.21.15.103:0/550114612 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) v1 ==== 100+0+10 (secure 0 0 0) 0x7f8e9c042260 con 0x7f8e80003920 2020-04-22T14:14:05.751 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:14:05.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.749+0000 7f8ea73dc700 1 -- 172.21.15.103:0/550114612 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8e80051960 msgr2=0x7f8e80053e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:05.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.749+0000 7f8ea73dc700 1 --2- 172.21.15.103:0/550114612 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8e80051960 0x7f8e80053e20 secure :-1 s=READY pgs=504 cs=0 l=1 rx=0x7f8e90000fa0 tx=0x7f8e900017d0).stop 2020-04-22T14:14:05.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.749+0000 7f8ea73dc700 1 -- 172.21.15.103:0/550114612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e80003920 msgr2=0x7f8e80003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:05.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.749+0000 7f8ea73dc700 1 --2- 172.21.15.103:0/550114612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e80003920 0x7f8e80003da0 secure :-1 s=READY pgs=1373 cs=0 l=1 rx=0x7f8ea0142890 tx=0x7f8e9c0111b0).stop 2020-04-22T14:14:05.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.749+0000 7f8ea73dc700 1 -- 172.21.15.103:0/550114612 shutdown_connections 2020-04-22T14:14:05.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.749+0000 7f8ea73dc700 1 --2- 172.21.15.103:0/550114612 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8e80051960 0x7f8e80053e20 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:05.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.749+0000 7f8ea73dc700 1 --2- 172.21.15.103:0/550114612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e80003920 0x7f8e80003da0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:05.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.749+0000 7f8ea73dc700 1 -- 172.21.15.103:0/550114612 >> 172.21.15.103:0/550114612 conn(0x7f8ea005b7b0 msgr2=0x7f8ea00ae9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:05.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.749+0000 7f8ea73dc700 1 -- 172.21.15.103:0/550114612 shutdown_connections 2020-04-22T14:14:05.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.749+0000 7f8ea73dc700 1 -- 172.21.15.103:0/550114612 wait complete. 2020-04-22T14:14:05.762 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-04-22T14:14:05.762 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:05.776 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:14:05.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.918+0000 7f8878504700 1 Processor -- start 2020-04-22T14:14:05.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.918+0000 7f8878504700 1 -- start start 2020-04-22T14:14:05.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.919+0000 7f8878504700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8870148070 0x7f88700666c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:05.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.919+0000 7f8878504700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88701412b0 0x7f8870141740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:05.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.919+0000 7f8878504700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8870064510 con 0x7f88700b7660 2020-04-22T14:14:05.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.919+0000 7f8878504700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8870144090 con 0x7f8870148070 2020-04-22T14:14:05.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.919+0000 7f8878504700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8870144280 con 0x7f88701412b0 2020-04-22T14:14:05.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.919+0000 7f8875a9f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8870148070 0x7f88700666c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:05.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.919+0000 7f8875a9f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8870148070 0x7f88700666c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54474/0 (socket says 172.21.15.103:54474) 2020-04-22T14:14:05.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.919+0000 7f8875a9f700 1 -- 172.21.15.103:0/2610679218 learned_addr learned my addr 172.21.15.103:0/2610679218 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:14:05.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.919+0000 7f88762a0700 1 --1- 172.21.15.103:0/2610679218 >> v1:172.21.15.103:6789/0 conn(0x7f88700b7660 0x7f88701449c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46660/0 (socket says 172.21.15.103:46660) 2020-04-22T14:14:05.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.920+0000 7f8876aa1700 1 --2- 172.21.15.103:0/2610679218 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88701412b0 0x7f8870141740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:05.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.920+0000 7f8875a9f700 1 -- 172.21.15.103:0/2610679218 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88701412b0 msgr2=0x7f8870141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:05.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.920+0000 7f8875a9f700 1 --2- 172.21.15.103:0/2610679218 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88701412b0 0x7f8870141740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:05.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.920+0000 7f8875a9f700 1 -- 172.21.15.103:0/2610679218 >> v1:172.21.15.103:6789/0 conn(0x7f88700b7660 legacy=0x7f88701449c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:05.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.920+0000 7f887529e700 1 -- 172.21.15.103:0/2610679218 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3629328346 0 0) 0x7f8870064510 con 0x7f88700b7660 2020-04-22T14:14:05.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.920+0000 7f8875a9f700 1 -- 172.21.15.103:0/2610679218 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8870144520 con 0x7f8870148070 2020-04-22T14:14:05.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.920+0000 7f8875a9f700 1 --2- 172.21.15.103:0/2610679218 >> v2:172.21.15.103:3300/0 conn(0x7f8870148070 0x7f88700666c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8860002f30 tx=0x7f8860007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.920+0000 7f8875a9f700 1 --2- 172.21.15.103:0/2610679218 >> v2:172.21.15.103:3300/0 conn(0x7f8870148070 0x7f88700666c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8860002f30 tx=0x7f8860007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.920+0000 7f8875a9f700 1 --2- 172.21.15.103:0/2610679218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8870148070 0x7f88700666c0 secure :-1 s=READY pgs=1375 cs=0 l=1 rx=0x7f8860002f30 tx=0x7f8860007a40).ready entity=mon.1 client_cookie=b168cb31e848159f server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:05.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.920+0000 7f8875a9f700 1 --2- 172.21.15.103:0/2610679218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8870148070 0x7f88700666c0 secure :-1 s=THROTTLE_DONE pgs=1375 cs=0 l=1 rx=0x7f8860002f30 tx=0x7f8860007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.920+0000 7f887529e700 1 -- 172.21.15.103:0/2610679218 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8860011670 con 0x7f8870148070 2020-04-22T14:14:05.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.920+0000 7f8875a9f700 1 --2- 172.21.15.103:0/2610679218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8870148070 0x7f88700666c0 secure :-1 s=THROTTLE_DONE pgs=1375 cs=0 l=1 rx=0x7f8860002f30 tx=0x7f8860007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.920+0000 7f8875a9f700 1 --2- 172.21.15.103:0/2610679218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8870148070 0x7f88700666c0 secure :-1 s=THROTTLE_DONE pgs=1375 cs=0 l=1 rx=0x7f8860002f30 tx=0x7f8860007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.920+0000 7f887529e700 1 -- 172.21.15.103:0/2610679218 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8860011810 con 0x7f8870148070 2020-04-22T14:14:05.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.920+0000 7f887529e700 1 -- 172.21.15.103:0/2610679218 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8860011bf0 con 0x7f8870148070 2020-04-22T14:14:05.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.920+0000 7f8878504700 1 -- 172.21.15.103:0/2610679218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8870148070 msgr2=0x7f88700666c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:05.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.920+0000 7f8878504700 1 --2- 172.21.15.103:0/2610679218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8870148070 0x7f88700666c0 secure :-1 s=READY pgs=1375 cs=0 l=1 rx=0x7f8860002f30 tx=0x7f8860007a40).stop 2020-04-22T14:14:05.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.921+0000 7f8878504700 1 -- 172.21.15.103:0/2610679218 shutdown_connections 2020-04-22T14:14:05.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.921+0000 7f8878504700 1 --2- 172.21.15.103:0/2610679218 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88701412b0 0x7f8870141740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:05.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.921+0000 7f8878504700 1 --2- 172.21.15.103:0/2610679218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8870148070 0x7f88700666c0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:05.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.921+0000 7f8878504700 1 -- 172.21.15.103:0/2610679218 >> 172.21.15.103:0/2610679218 conn(0x7f887005f2c0 msgr2=0x7f8870061fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:05.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.921+0000 7f8878504700 1 -- 172.21.15.103:0/2610679218 shutdown_connections 2020-04-22T14:14:05.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.921+0000 7f8878504700 1 -- 172.21.15.103:0/2610679218 wait complete. 2020-04-22T14:14:05.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.922+0000 7f8878504700 1 Processor -- start 2020-04-22T14:14:05.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.922+0000 7f8878504700 1 -- start start 2020-04-22T14:14:05.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.922+0000 7f8878504700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88701412b0 0x7f8870146b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:05.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.922+0000 7f8878504700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8870148070 0x7f88700ae5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:05.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.922+0000 7f8878504700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88700adbd0 con 0x7f88700b7660 2020-04-22T14:14:05.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.922+0000 7f8878504700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88700ade70 con 0x7f8870148070 2020-04-22T14:14:05.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.922+0000 7f8878504700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88700ae110 con 0x7f88701412b0 2020-04-22T14:14:05.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.922+0000 7f88762a0700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f88700b7660 0x7f88701297a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46666/0 (socket says 172.21.15.103:46666) 2020-04-22T14:14:05.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.922+0000 7f88762a0700 1 -- 172.21.15.103:0/1895761369 learned_addr learned my addr 172.21.15.103:0/1895761369 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:14:05.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.922+0000 7f8876aa1700 1 --2- 172.21.15.103:0/1895761369 >> v2:172.21.15.103:3300/0 conn(0x7f8870148070 0x7f88700ae5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:05.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.922+0000 7f8875a9f700 1 --2- 172.21.15.103:0/1895761369 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88701412b0 0x7f8870146b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:05.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.923+0000 7f8876aa1700 1 -- 172.21.15.103:0/1895761369 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88701412b0 msgr2=0x7f8870146b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:05.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.923+0000 7f8876aa1700 1 --2- 172.21.15.103:0/1895761369 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88701412b0 0x7f8870146b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:05.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.923+0000 7f8876aa1700 1 -- 172.21.15.103:0/1895761369 >> v1:172.21.15.103:6789/0 conn(0x7f88700b7660 legacy=0x7f88701297a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:05.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.923+0000 7f885f7fe700 1 -- 172.21.15.103:0/1895761369 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2998552600 0 0) 0x7f88700adbd0 con 0x7f88700b7660 2020-04-22T14:14:05.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.923+0000 7f8876aa1700 1 -- 172.21.15.103:0/1895761369 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8870143cf0 con 0x7f8870148070 2020-04-22T14:14:05.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.923+0000 7f8876aa1700 1 --2- 172.21.15.103:0/1895761369 >> v2:172.21.15.103:3300/0 conn(0x7f8870148070 0x7f88700ae5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f88680032b0 tx=0x7f8868010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.923+0000 7f8876aa1700 1 --2- 172.21.15.103:0/1895761369 >> v2:172.21.15.103:3300/0 conn(0x7f8870148070 0x7f88700ae5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f88680032b0 tx=0x7f8868010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.923+0000 7f8876aa1700 1 --2- 172.21.15.103:0/1895761369 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8870148070 0x7f88700ae5b0 secure :-1 s=READY pgs=1377 cs=0 l=1 rx=0x7f88680032b0 tx=0x7f8868010ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:05.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.923+0000 7f8876aa1700 1 --2- 172.21.15.103:0/1895761369 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8870148070 0x7f88700ae5b0 secure :-1 s=THROTTLE_DONE pgs=1377 cs=0 l=1 rx=0x7f88680032b0 tx=0x7f8868010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.923+0000 7f885f7fe700 1 -- 172.21.15.103:0/1895761369 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f886800e370 con 0x7f8870148070 2020-04-22T14:14:05.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.923+0000 7f8876aa1700 1 --2- 172.21.15.103:0/1895761369 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8870148070 0x7f88700ae5b0 secure :-1 s=THROTTLE_DONE pgs=1377 cs=0 l=1 rx=0x7f88680032b0 tx=0x7f8868010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.923+0000 7f8876aa1700 1 --2- 172.21.15.103:0/1895761369 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8870148070 0x7f88700ae5b0 secure :-1 s=THROTTLE_DONE pgs=1377 cs=0 l=1 rx=0x7f88680032b0 tx=0x7f8868010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.923+0000 7f885f7fe700 1 -- 172.21.15.103:0/1895761369 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8868005c30 con 0x7f8870148070 2020-04-22T14:14:05.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.923+0000 7f8878504700 1 -- 172.21.15.103:0/1895761369 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88700ad7e0 con 0x7f8870148070 2020-04-22T14:14:05.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.923+0000 7f885f7fe700 1 -- 172.21.15.103:0/1895761369 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8868012910 con 0x7f8870148070 2020-04-22T14:14:05.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.923+0000 7f8878504700 1 -- 172.21.15.103:0/1895761369 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f887012a070 con 0x7f8870148070 2020-04-22T14:14:05.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.924+0000 7f8876aa1700 1 --2- 172.21.15.103:0/1895761369 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8870148070 0x7f88700ae5b0 secure :-1 s=THROTTLE_DONE pgs=1377 cs=0 l=1 rx=0x7f88680032b0 tx=0x7f8868010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.924+0000 7f885f7fe700 1 -- 172.21.15.103:0/1895761369 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f8868012b80 con 0x7f8870148070 2020-04-22T14:14:05.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.924+0000 7f8876aa1700 1 --2- 172.21.15.103:0/1895761369 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8870148070 0x7f88700ae5b0 secure :-1 s=THROTTLE_DONE pgs=1377 cs=0 l=1 rx=0x7f88680032b0 tx=0x7f8868010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.924+0000 7f8878504700 1 -- 172.21.15.103:0/1895761369 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8870056c90 con 0x7f8870148070 2020-04-22T14:14:05.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.924+0000 7f885f7fe700 1 --2- 172.21.15.103:0/1895761369 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f885004d960 0x7f885004fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:05.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.924+0000 7f885f7fe700 1 -- 172.21.15.103:0/1895761369 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8868061050 con 0x7f8870148070 2020-04-22T14:14:05.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.924+0000 7f88762a0700 1 --2- 172.21.15.103:0/1895761369 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f885004d960 0x7f885004fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:05.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.925+0000 7f88762a0700 1 --2- 172.21.15.103:0/1895761369 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f885004d960 0x7f885004fe20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f886c001320 tx=0x7f886c0017e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.925+0000 7f88762a0700 1 --2- 172.21.15.103:0/1895761369 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f885004d960 0x7f885004fe20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f886c001320 tx=0x7f886c0017e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.925+0000 7f88762a0700 1 --2- 172.21.15.103:0/1895761369 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f885004d960 0x7f885004fe20 secure :-1 s=READY pgs=505 cs=0 l=1 rx=0x7f886c001320 tx=0x7f886c0017e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:05.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.928+0000 7f8876aa1700 1 --2- 172.21.15.103:0/1895761369 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8870148070 0x7f88700ae5b0 secure :-1 s=THROTTLE_DONE pgs=1377 cs=0 l=1 rx=0x7f88680032b0 tx=0x7f8868010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:05.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:05.928+0000 7f885f7fe700 1 -- 172.21.15.103:0/1895761369 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f886803c4f0 con 0x7f8870148070 2020-04-22T14:14:06.120 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:06.117+0000 7f8878504700 1 -- 172.21.15.103:0/1895761369 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f887012a070 con 0x7f8870148070 2020-04-22T14:14:06.121 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:06.117+0000 7f8876aa1700 1 --2- 172.21.15.103:0/1895761369 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8870148070 0x7f88700ae5b0 secure :-1 s=THROTTLE_DONE pgs=1377 cs=0 l=1 rx=0x7f88680032b0 tx=0x7f8868010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:06.121 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:06.117+0000 7f885f7fe700 1 -- 172.21.15.103:0/1895761369 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+2143 (secure 0 0 0) 0x7f887012a070 con 0x7f8870148070 2020-04-22T14:14:06.121 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:14:06.121 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":64,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5810,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/2664816107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2664816107},{"type":"v1","addr":"172.21.15.86:6835","nonce":2664816107}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":60}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:13:59.062543+0000","modified":"2020-04-22T14:14:01.070314+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7723},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7723":{"gid":7723,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/3220772133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3220772133},{"type":"v1","addr":"172.21.15.103:6833","nonce":3220772133}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-04-22T14:14:06.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:06.119+0000 7f8878504700 1 -- 172.21.15.103:0/1895761369 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f885004d960 msgr2=0x7f885004fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:06.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:06.119+0000 7f8878504700 1 --2- 172.21.15.103:0/1895761369 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f885004d960 0x7f885004fe20 secure :-1 s=READY pgs=505 cs=0 l=1 rx=0x7f886c001320 tx=0x7f886c0017e0).stop 2020-04-22T14:14:06.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:06.119+0000 7f8878504700 1 -- 172.21.15.103:0/1895761369 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8870148070 msgr2=0x7f88700ae5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:06.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:06.119+0000 7f8878504700 1 --2- 172.21.15.103:0/1895761369 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8870148070 0x7f88700ae5b0 secure :-1 s=READY pgs=1377 cs=0 l=1 rx=0x7f88680032b0 tx=0x7f8868010ec0).stop 2020-04-22T14:14:06.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:06.119+0000 7f8878504700 1 -- 172.21.15.103:0/1895761369 shutdown_connections 2020-04-22T14:14:06.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:06.119+0000 7f8878504700 1 --2- 172.21.15.103:0/1895761369 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f885004d960 0x7f885004fe20 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:06.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:06.119+0000 7f8878504700 1 --2- 172.21.15.103:0/1895761369 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8870148070 0x7f88700ae5b0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:06.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:06.119+0000 7f8878504700 1 --2- 172.21.15.103:0/1895761369 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88701412b0 0x7f8870146b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:06.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:06.119+0000 7f8878504700 1 -- 172.21.15.103:0/1895761369 >> 172.21.15.103:0/1895761369 conn(0x7f887005f2c0 msgr2=0x7f887005ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:06.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:06.119+0000 7f8878504700 1 -- 172.21.15.103:0/1895761369 shutdown_connections 2020-04-22T14:14:06.124 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:06.119+0000 7f8878504700 1 -- 172.21.15.103:0/1895761369 wait complete. 2020-04-22T14:14:06.124 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 64 2020-04-22T14:14:06.334 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 7723}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 15, u'failed': [], u'epoch': 64, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [16], u'info': {u'gid_7723': {u'export_targets': [], u'name': u'a', u'incarnation': 61, u'state_seq': 3, u'state': u'up:active', u'gid': 7723, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 3220772133, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 3220772133, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/3220772133'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:13:59.062543+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:14:01.070314+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:14:06.334 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:14:06.334 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:06.348 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:14:06.506 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:14:06.507 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:14:06.507 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:14:06.507 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 7723, 2020-04-22T14:14:06.507 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:14:06.507 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:14:06.507 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 7.4408914279999996, 2020-04-22T14:14:06.508 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 64, 2020-04-22T14:14:06.508 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 90, 2020-04-22T14:14:06.508 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 90, 2020-04-22T14:14:06.508 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 12.880917145 2020-04-22T14:14:06.508 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:14:06.515 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 7723, "want_state": "up:active", "state": "up:active", "rank_uptime": 7.4408914279999996, "mdsmap_epoch": 64, "osdmap_epoch": 90, "osdmap_epoch_barrier": 90, "uptime": 12.880917145 } 2020-04-22T14:14:06.515 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-04-22T14:14:06.516 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:14:06.516 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:06.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:06.530 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:14:06.590 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:14:06.590 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:14:06.590 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:14:06.590 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:14:06.591 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:14:06.591 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:14:06.591 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:14:06.591 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:14:06.591 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:14:06.591 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:14:06.591 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:14:06.592 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:14:06.592 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:14:06.592 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:14:06.592 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:14:06.592 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 41994sec preferred_lft 41994sec 2020-04-22T14:14:06.592 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:14:06.592 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:14:06.593 INFO:teuthology.orchestra.run.smithi103.stdout:25: brx.1@if2: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:14:06.593 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether ce:89:5a:9a:cb:19 brd ff:ff:ff:ff:ff:ff link-netnsid 1 2020-04-22T14:14:06.593 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-04-22T14:14:06.593 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:06.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:06.638 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:14:06.713 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:06.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:06.767 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge con-name ceph-brx ifname ceph-brx stp no' 2020-04-22T14:14:06.878 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' (ee1ed106-4543-4f08-bc3e-eb683cda2564) successfully added. 2020-04-22T14:14:06.879 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:06.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:06.894 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection modify ceph-brx ipv4.addresses 192.168.255.254/16 ipv4.method manual' 2020-04-22T14:14:06.983 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:07.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:07.002 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up ceph-brx' 2020-04-22T14:14:07.109 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (master waiting for slaves) (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/35) 2020-04-22T14:14:07.110 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:07.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:07.124 INFO:teuthology.orchestra.run.smithi103:> touch /tmp/python-ceph-brx 2020-04-22T14:14:07.180 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:07.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:07.237 INFO:teuthology.orchestra.run.smithi103:> cat /proc/sys/net/ipv4/ip_forward 2020-04-22T14:14:07.298 INFO:teuthology.orchestra.run.smithi103.stdout:0 2020-04-22T14:14:07.299 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:07.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:07.349 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 0 > /tmp/python-ceph-brx' 2020-04-22T14:14:07.424 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:07.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:07.472 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 1 > /proc/sys/net/ipv4/ip_forward' 2020-04-22T14:14:07.549 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:07.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:07.592 INFO:teuthology.orchestra.run.smithi103:> route 2020-04-22T14:14:07.655 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2020-04-22T14:14:07.655 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-04-22T14:14:07.656 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 102 0 0 enp3s0f1 2020-04-22T14:14:07.656 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 102 0 0 enp3s0f1 2020-04-22T14:14:07.656 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 425 0 0 ceph-brx 2020-04-22T14:14:07.656 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:07.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:07.701 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-04-22T14:14:07.775 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:07.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:07.823 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-04-22T14:14:07.899 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:07.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:07.946 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-04-22T14:14:08.021 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:08.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:08.069 INFO:teuthology.orchestra.run.smithi103:> ip netns list 2020-04-22T14:14:08.128 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:08.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:08.176 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:14:08.235 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 1 2020-04-22T14:14:08.236 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:08.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:08.283 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:14:08.366 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:08.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:08.405 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0' 2020-04-22T14:14:08.487 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-04-22T14:14:08.487 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:08.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:08.528 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0' 2020-04-22T14:14:08.603 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:08.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:08.648 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0' 2020-04-22T14:14:08.756 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:08.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:08.770 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up' 2020-04-22T14:14:08.883 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:08.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:08.907 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up' 2020-04-22T14:14:09.015 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:09.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:09.042 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254' 2020-04-22T14:14:09.150 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:09.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:09.163 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:14:09.237 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:09.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:09.290 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge-slave con-name brx.0 ifname brx.0 master ceph-brx' 2020-04-22T14:14:09.398 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.0' (c1e46398-fa80-44d5-8bc3-23834ff98a6f) successfully added. 2020-04-22T14:14:09.398 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:09.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:09.427 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up brx.0' 2020-04-22T14:14:09.591 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/36) 2020-04-22T14:14:09.641 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-04-22T14:14:09.641 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi103.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-04-22T14:14:09.641 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:09.655 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:14:09.655 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:14:09.714 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:09.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:14:09.762 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:14:09.830 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:14:09.838 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:14:09.838 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:09.884 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:14:09.884 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:14:09.943 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-04-22T14:14:09.943 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:09.996 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:14:10.038 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:10.052 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:14:10.052 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:14:10.121 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:14:10.127 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:14:10.128 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:10.128 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:2020-04-22T14:14:10.125+0000 7fca02b3a1c0 -1 init, newargv = 0x558deff7c1c0 newargc=9 2020-04-22T14:14:10.129 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[88473]: starting ceph client 2020-04-22T14:14:10.132 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[88473]: starting fuse 2020-04-22T14:14:10.149 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:14:10.150 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:14:10.209 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:14:10.209 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2020-04-22T14:14:10.209 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:10.254 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:14:10.254 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:14:10.254 INFO:teuthology.orchestra.run.smithi103:> import glob 2020-04-22T14:14:10.254 INFO:teuthology.orchestra.run.smithi103:> import re 2020-04-22T14:14:10.254 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:14:10.254 INFO:teuthology.orchestra.run.smithi103:> import subprocess 2020-04-22T14:14:10.255 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:14:10.255 INFO:teuthology.orchestra.run.smithi103:> def find_socket(client_name): 2020-04-22T14:14:10.255 INFO:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-04-22T14:14:10.255 INFO:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2020-04-22T14:14:10.255 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:14:10.255 INFO:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2020-04-22T14:14:10.255 INFO:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2020-04-22T14:14:10.256 INFO:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2020-04-22T14:14:10.256 INFO:teuthology.orchestra.run.smithi103:> return files[0] 2020-04-22T14:14:10.256 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:14:10.256 INFO:teuthology.orchestra.run.smithi103:> for f in files: 2020-04-22T14:14:10.256 INFO:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:14:10.256 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:14:10.257 INFO:teuthology.orchestra.run.smithi103:> return f 2020-04-22T14:14:10.257 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:14:10.257 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:14:10.257 INFO:teuthology.orchestra.run.smithi103:> print(find_socket("client.0")) 2020-04-22T14:14:10.257 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:14:10.363 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.0.88473.asok 2020-04-22T14:14:10.364 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.88473.asok 2020-04-22T14:14:10.364 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:10.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:14:10.378 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.88473.asok status 2020-04-22T14:14:10.549 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:14:10.550 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2020-04-22T14:14:10.550 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:14:10.550 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:14:10.550 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "0", 2020-04-22T14:14:10.550 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:14:10.550 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-04-22T14:14:10.550 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "88473", 2020-04-22T14:14:10.551 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:14:10.551 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:10.551 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2020-04-22T14:14:10.551 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2020-04-22T14:14:10.551 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 7936, 2020-04-22T14:14:10.551 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2020-04-22T14:14:10.551 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:14:10.552 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:14:10.552 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 7936 2020-04-22T14:14:10.552 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:10.552 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:14:10.552 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:14:10.552 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:14:10.552 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 425900083 2020-04-22T14:14:10.552 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:14:10.553 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:10.553 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:14:10.553 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:14:10.553 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:14:10.553 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 425900083 2020-04-22T14:14:10.553 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:10.553 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.7936 192.168.0.1:0/425900083", 2020-04-22T14:14:10.554 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.1:0/425900083", 2020-04-22T14:14:10.554 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2020-04-22T14:14:10.554 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 64, 2020-04-22T14:14:10.554 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 90, 2020-04-22T14:14:10.554 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2020-04-22T14:14:10.554 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklisted": false 2020-04-22T14:14:10.554 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:14:10.555 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:10.573 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:14:10.573 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-22T14:14:10.573 INFO:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:14:10.631 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2020-04-22T14:14:10.632 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-04-22T14:14:10.632 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:10.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:14:10.682 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:14:10.755 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:10.807 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:14:10.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.951+0000 7fdb267c1700 1 Processor -- start 2020-04-22T14:14:10.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.951+0000 7fdb267c1700 1 -- start start 2020-04-22T14:14:10.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.952+0000 7fdb267c1700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdb2012c0d0 0x7fdb201464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:10.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.952+0000 7fdb267c1700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdb20063e30 0x7fdb200642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:10.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.952+0000 7fdb267c1700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb20143300 con 0x7fdb20065fe0 2020-04-22T14:14:10.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.952+0000 7fdb267c1700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb201435a0 con 0x7fdb2012c0d0 2020-04-22T14:14:10.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.952+0000 7fdb267c1700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb20143840 con 0x7fdb20063e30 2020-04-22T14:14:10.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.952+0000 7fdb24d5e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdb20063e30 0x7fdb200642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:10.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.952+0000 7fdb1f7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fdb20065fe0 0x7fdb2005b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46694/0 (socket says 172.21.15.103:46694) 2020-04-22T14:14:10.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.952+0000 7fdb1f7fe700 1 -- 172.21.15.103:0/2863396520 learned_addr learned my addr 172.21.15.103:0/2863396520 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:14:10.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.952+0000 7fdb1ffff700 1 --2- 172.21.15.103:0/2863396520 >> v2:172.21.15.86:3300/0 conn(0x7fdb2012c0d0 0x7fdb201464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:10.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.952+0000 7fdb24d5e700 1 -- 172.21.15.103:0/2863396520 >> v2:172.21.15.86:3300/0 conn(0x7fdb2012c0d0 msgr2=0x7fdb201464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:10.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.952+0000 7fdb24d5e700 1 --2- 172.21.15.103:0/2863396520 >> v2:172.21.15.86:3300/0 conn(0x7fdb2012c0d0 0x7fdb201464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:10.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.952+0000 7fdb24d5e700 1 -- 172.21.15.103:0/2863396520 >> v1:172.21.15.103:6789/0 conn(0x7fdb20065fe0 legacy=0x7fdb2005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:10.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.952+0000 7fdb24d5e700 1 -- 172.21.15.103:0/2863396520 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb2005bb50 con 0x7fdb20063e30 2020-04-22T14:14:10.964 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.952+0000 7fdb1effd700 1 -- 172.21.15.103:0/2863396520 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4293142318 0 0) 0x7fdb20143300 con 0x7fdb20065fe0 2020-04-22T14:14:10.964 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.952+0000 7fdb24d5e700 1 --2- 172.21.15.103:0/2863396520 >> v2:172.21.15.103:3300/0 conn(0x7fdb20063e30 0x7fdb200642c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdb180032b0 tx=0x7fdb18007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:10.964 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.953+0000 7fdb24d5e700 1 --2- 172.21.15.103:0/2863396520 >> v2:172.21.15.103:3300/0 conn(0x7fdb20063e30 0x7fdb200642c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdb180032b0 tx=0x7fdb18007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:10.964 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.953+0000 7fdb24d5e700 1 --2- 172.21.15.103:0/2863396520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb20063e30 0x7fdb200642c0 secure :-1 s=READY pgs=1383 cs=0 l=1 rx=0x7fdb180032b0 tx=0x7fdb18007dc0).ready entity=mon.1 client_cookie=f6a998ce963ba657 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:10.965 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.953+0000 7fdb24d5e700 1 --2- 172.21.15.103:0/2863396520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb20063e30 0x7fdb200642c0 secure :-1 s=THROTTLE_DONE pgs=1383 cs=0 l=1 rx=0x7fdb180032b0 tx=0x7fdb18007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:10.965 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.953+0000 7fdb1effd700 1 -- 172.21.15.103:0/2863396520 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb18011e20 con 0x7fdb20063e30 2020-04-22T14:14:10.965 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.953+0000 7fdb24d5e700 1 --2- 172.21.15.103:0/2863396520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb20063e30 0x7fdb200642c0 secure :-1 s=THROTTLE_DONE pgs=1383 cs=0 l=1 rx=0x7fdb180032b0 tx=0x7fdb18007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:10.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.953+0000 7fdb1effd700 1 -- 172.21.15.103:0/2863396520 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1800a180 con 0x7fdb20063e30 2020-04-22T14:14:10.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.953+0000 7fdb24d5e700 1 --2- 172.21.15.103:0/2863396520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb20063e30 0x7fdb200642c0 secure :-1 s=THROTTLE_DONE pgs=1383 cs=0 l=1 rx=0x7fdb180032b0 tx=0x7fdb18007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:10.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.953+0000 7fdb267c1700 1 -- 172.21.15.103:0/2863396520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb20063e30 msgr2=0x7fdb200642c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:10.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.953+0000 7fdb1effd700 1 -- 172.21.15.103:0/2863396520 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb1800a560 con 0x7fdb20063e30 2020-04-22T14:14:10.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.953+0000 7fdb267c1700 1 --2- 172.21.15.103:0/2863396520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb20063e30 0x7fdb200642c0 secure :-1 s=READY pgs=1383 cs=0 l=1 rx=0x7fdb180032b0 tx=0x7fdb18007dc0).stop 2020-04-22T14:14:10.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.953+0000 7fdb267c1700 1 -- 172.21.15.103:0/2863396520 shutdown_connections 2020-04-22T14:14:10.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.953+0000 7fdb267c1700 1 --2- 172.21.15.103:0/2863396520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb20063e30 0x7fdb200642c0 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:10.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.953+0000 7fdb267c1700 1 --2- 172.21.15.103:0/2863396520 >> v2:172.21.15.86:3300/0 conn(0x7fdb2012c0d0 0x7fdb201464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:10.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.953+0000 7fdb267c1700 1 -- 172.21.15.103:0/2863396520 >> 172.21.15.103:0/2863396520 conn(0x7fdb200b9160 msgr2=0x7fdb2005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:10.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.953+0000 7fdb267c1700 1 -- 172.21.15.103:0/2863396520 shutdown_connections 2020-04-22T14:14:10.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.953+0000 7fdb267c1700 1 -- 172.21.15.103:0/2863396520 wait complete. 2020-04-22T14:14:10.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.954+0000 7fdb267c1700 1 Processor -- start 2020-04-22T14:14:10.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.954+0000 7fdb267c1700 1 -- start start 2020-04-22T14:14:10.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.955+0000 7fdb267c1700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdb20065fe0 0x7fdb200aea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:10.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.955+0000 7fdb267c1700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdb2012c0d0 0x7fdb200b0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:10.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.955+0000 7fdb267c1700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb200b09e0 con 0x7fdb20063e30 2020-04-22T14:14:10.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.955+0000 7fdb267c1700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb200acbe0 con 0x7fdb2012c0d0 2020-04-22T14:14:10.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.955+0000 7fdb267c1700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb200ace80 con 0x7fdb20065fe0 2020-04-22T14:14:10.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.955+0000 7fdb1f7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdb20065fe0 0x7fdb200aea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:10.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.955+0000 7fdb1f7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdb20065fe0 0x7fdb200aea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54510/0 (socket says 172.21.15.103:54510) 2020-04-22T14:14:10.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.955+0000 7fdb1f7fe700 1 -- 172.21.15.103:0/1573369081 learned_addr learned my addr 172.21.15.103:0/1573369081 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:14:10.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.955+0000 7fdb24d5e700 1 --2- 172.21.15.103:0/1573369081 >> v2:172.21.15.86:3300/0 conn(0x7fdb2012c0d0 0x7fdb200b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:10.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.955+0000 7fdb1f7fe700 1 -- 172.21.15.103:0/1573369081 >> v2:172.21.15.86:3300/0 conn(0x7fdb2012c0d0 msgr2=0x7fdb200b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:10.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.955+0000 7fdb1f7fe700 1 --2- 172.21.15.103:0/1573369081 >> v2:172.21.15.86:3300/0 conn(0x7fdb2012c0d0 0x7fdb200b0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:10.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.955+0000 7fdb1f7fe700 1 -- 172.21.15.103:0/1573369081 >> v1:172.21.15.86:6789/0 conn(0x7fdb20063e30 legacy=0x7fdb20135ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:10.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.955+0000 7fdb1f7fe700 1 -- 172.21.15.103:0/1573369081 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb200ad120 con 0x7fdb20065fe0 2020-04-22T14:14:10.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.955+0000 7fdb1f7fe700 1 --2- 172.21.15.103:0/1573369081 >> v2:172.21.15.103:3300/0 conn(0x7fdb20065fe0 0x7fdb200aea50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdb14000b80 tx=0x7fdb140109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:10.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.956+0000 7fdb1f7fe700 1 --2- 172.21.15.103:0/1573369081 >> v2:172.21.15.103:3300/0 conn(0x7fdb20065fe0 0x7fdb200aea50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdb14000b80 tx=0x7fdb140109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:10.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.956+0000 7fdb1f7fe700 1 --2- 172.21.15.103:0/1573369081 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb20065fe0 0x7fdb200aea50 secure :-1 s=READY pgs=1384 cs=0 l=1 rx=0x7fdb14000b80 tx=0x7fdb140109d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:10.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.956+0000 7fdb1f7fe700 1 --2- 172.21.15.103:0/1573369081 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb20065fe0 0x7fdb200aea50 secure :-1 s=THROTTLE_DONE pgs=1384 cs=0 l=1 rx=0x7fdb14000b80 tx=0x7fdb140109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:10.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.956+0000 7fdb1d7fa700 1 -- 172.21.15.103:0/1573369081 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb14005ca0 con 0x7fdb20065fe0 2020-04-22T14:14:10.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.956+0000 7fdb1f7fe700 1 --2- 172.21.15.103:0/1573369081 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb20065fe0 0x7fdb200aea50 secure :-1 s=THROTTLE_DONE pgs=1384 cs=0 l=1 rx=0x7fdb14000b80 tx=0x7fdb140109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:10.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.956+0000 7fdb1f7fe700 1 --2- 172.21.15.103:0/1573369081 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb20065fe0 0x7fdb200aea50 secure :-1 s=THROTTLE_DONE pgs=1384 cs=0 l=1 rx=0x7fdb14000b80 tx=0x7fdb140109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:10.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.956+0000 7fdb1d7fa700 1 -- 172.21.15.103:0/1573369081 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb14005e00 con 0x7fdb20065fe0 2020-04-22T14:14:10.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.956+0000 7fdb267c1700 1 -- 172.21.15.103:0/1573369081 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb200b1290 con 0x7fdb20065fe0 2020-04-22T14:14:10.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.956+0000 7fdb1d7fa700 1 -- 172.21.15.103:0/1573369081 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb140062c0 con 0x7fdb20065fe0 2020-04-22T14:14:10.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.956+0000 7fdb267c1700 1 -- 172.21.15.103:0/1573369081 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb200ac980 con 0x7fdb20065fe0 2020-04-22T14:14:10.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.956+0000 7fdb1f7fe700 1 --2- 172.21.15.103:0/1573369081 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb20065fe0 0x7fdb200aea50 secure :-1 s=THROTTLE_DONE pgs=1384 cs=0 l=1 rx=0x7fdb14000b80 tx=0x7fdb140109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:10.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.957+0000 7fdb267c1700 1 -- 172.21.15.103:0/1573369081 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb20056c90 con 0x7fdb20065fe0 2020-04-22T14:14:10.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.957+0000 7fdb1d7fa700 1 -- 172.21.15.103:0/1573369081 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fdb14006530 con 0x7fdb20065fe0 2020-04-22T14:14:10.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.957+0000 7fdb1f7fe700 1 --2- 172.21.15.103:0/1573369081 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb20065fe0 0x7fdb200aea50 secure :-1 s=THROTTLE_DONE pgs=1384 cs=0 l=1 rx=0x7fdb14000b80 tx=0x7fdb140109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:10.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.957+0000 7fdb1d7fa700 1 --2- 172.21.15.103:0/1573369081 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdb0004d9d0 0x7fdb0004fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:10.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.957+0000 7fdb1d7fa700 1 -- 172.21.15.103:0/1573369081 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdb140090c0 con 0x7fdb20065fe0 2020-04-22T14:14:10.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.958+0000 7fdb1ffff700 1 --2- 172.21.15.103:0/1573369081 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdb0004d9d0 0x7fdb0004fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:10.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.958+0000 7fdb1ffff700 1 --2- 172.21.15.103:0/1573369081 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdb0004d9d0 0x7fdb0004fe90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdb200639a0 tx=0x7fdb10007700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:10.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.958+0000 7fdb1ffff700 1 --2- 172.21.15.103:0/1573369081 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdb0004d9d0 0x7fdb0004fe90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdb200639a0 tx=0x7fdb10007700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:10.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.958+0000 7fdb1ffff700 1 --2- 172.21.15.103:0/1573369081 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdb0004d9d0 0x7fdb0004fe90 secure :-1 s=READY pgs=506 cs=0 l=1 rx=0x7fdb200639a0 tx=0x7fdb10007700).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:10.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.961+0000 7fdb1f7fe700 1 --2- 172.21.15.103:0/1573369081 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb20065fe0 0x7fdb200aea50 secure :-1 s=THROTTLE_DONE pgs=1384 cs=0 l=1 rx=0x7fdb14000b80 tx=0x7fdb140109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:10.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:10.961+0000 7fdb1d7fa700 1 -- 172.21.15.103:0/1573369081 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fdb1403ca60 con 0x7fdb20065fe0 2020-04-22T14:14:11.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.106+0000 7fdb267c1700 1 -- 172.21.15.103:0/1573369081 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb20062750 con 0x7fdb20065fe0 2020-04-22T14:14:11.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.107+0000 7fdb1f7fe700 1 --2- 172.21.15.103:0/1573369081 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb20065fe0 0x7fdb200aea50 secure :-1 s=THROTTLE_DONE pgs=1384 cs=0 l=1 rx=0x7fdb14000b80 tx=0x7fdb140109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.107+0000 7fdb1d7fa700 1 -- 172.21.15.103:0/1573369081 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+16092 (secure 0 0 0) 0x7fdb14040080 con 0x7fdb20065fe0 2020-04-22T14:14:11.111 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:14:11.111 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":90,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:14:00.064104+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:13:56.741291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2020-04-22T14:13:57.809563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:14:11.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.108+0000 7fdb267c1700 1 -- 172.21.15.103:0/1573369081 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdb0004d9d0 msgr2=0x7fdb0004fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:11.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.108+0000 7fdb267c1700 1 --2- 172.21.15.103:0/1573369081 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdb0004d9d0 0x7fdb0004fe90 secure :-1 s=READY pgs=506 cs=0 l=1 rx=0x7fdb200639a0 tx=0x7fdb10007700).stop 2020-04-22T14:14:11.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.108+0000 7fdb267c1700 1 -- 172.21.15.103:0/1573369081 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb20065fe0 msgr2=0x7fdb200aea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:11.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.108+0000 7fdb267c1700 1 --2- 172.21.15.103:0/1573369081 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb20065fe0 0x7fdb200aea50 secure :-1 s=READY pgs=1384 cs=0 l=1 rx=0x7fdb14000b80 tx=0x7fdb140109d0).stop 2020-04-22T14:14:11.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.108+0000 7fdb267c1700 1 -- 172.21.15.103:0/1573369081 shutdown_connections 2020-04-22T14:14:11.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.108+0000 7fdb267c1700 1 --2- 172.21.15.103:0/1573369081 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdb0004d9d0 0x7fdb0004fe90 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:11.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.108+0000 7fdb267c1700 1 --2- 172.21.15.103:0/1573369081 >> v2:172.21.15.86:3300/0 conn(0x7fdb2012c0d0 0x7fdb200b0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:11.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.108+0000 7fdb267c1700 1 --2- 172.21.15.103:0/1573369081 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb20065fe0 0x7fdb200aea50 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:11.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.108+0000 7fdb267c1700 1 -- 172.21.15.103:0/1573369081 >> 172.21.15.103:0/1573369081 conn(0x7fdb200b9160 msgr2=0x7fdb2012b020 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:11.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.109+0000 7fdb267c1700 1 -- 172.21.15.103:0/1573369081 shutdown_connections 2020-04-22T14:14:11.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.109+0000 7fdb267c1700 1 -- 172.21.15.103:0/1573369081 wait complete. 2020-04-22T14:14:11.122 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:13:56.741291+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 15, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'89', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:13:57.809563+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 16, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'90', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:14:11.123 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:11.137 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:14:11.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.282+0000 7f100501c700 1 Processor -- start 2020-04-22T14:14:11.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.282+0000 7f100501c700 1 -- start start 2020-04-22T14:14:11.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.283+0000 7f100501c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10000b9140 0x7f10000aed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:11.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.283+0000 7f100501c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f10000b3bd0 0x7f10000af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:11.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.283+0000 7f100501c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1000148310 con 0x7f10000616b0 2020-04-22T14:14:11.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.283+0000 7f100501c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10000af650 con 0x7f10000b3bd0 2020-04-22T14:14:11.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.283+0000 7f100501c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10001485b0 con 0x7f10000b9140 2020-04-22T14:14:11.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.283+0000 7f0fff59e700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f10000616b0 0x7f1000061b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46706/0 (socket says 172.21.15.103:46706) 2020-04-22T14:14:11.289 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.283+0000 7f0fff59e700 1 -- 172.21.15.103:0/2398851039 learned_addr learned my addr 172.21.15.103:0/2398851039 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:14:11.289 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.283+0000 7f0ffed9d700 1 --2- 172.21.15.103:0/2398851039 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10000b9140 0x7f10000aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:11.289 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.283+0000 7f0ffe59c700 1 --2- 172.21.15.103:0/2398851039 >> v2:172.21.15.86:3300/0 conn(0x7f10000b3bd0 0x7f10000af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:11.289 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.283+0000 7f0ffdd9b700 1 -- 172.21.15.103:0/2398851039 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3946433648 0 0) 0x7f1000148310 con 0x7f10000616b0 2020-04-22T14:14:11.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.283+0000 7f0ffdd9b700 1 -- 172.21.15.103:0/2398851039 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fe4003230 con 0x7f10000616b0 2020-04-22T14:14:11.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.283+0000 7f0ffdd9b700 1 -- 172.21.15.103:0/2398851039 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 103270084 0 0) 0x7f0fe4003230 con 0x7f10000616b0 2020-04-22T14:14:11.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.283+0000 7f0ffed9d700 1 -- 172.21.15.103:0/2398851039 >> v2:172.21.15.86:3300/0 conn(0x7f10000b3bd0 msgr2=0x7f10000af1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:11.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.284+0000 7f0ffed9d700 1 --2- 172.21.15.103:0/2398851039 >> v2:172.21.15.86:3300/0 conn(0x7f10000b3bd0 0x7f10000af1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:11.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.284+0000 7f0ffed9d700 1 -- 172.21.15.103:0/2398851039 >> v1:172.21.15.103:6789/0 conn(0x7f10000616b0 legacy=0x7f1000061b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:11.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.284+0000 7f0ffed9d700 1 -- 172.21.15.103:0/2398851039 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10000b9520 con 0x7f10000b9140 2020-04-22T14:14:11.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.284+0000 7f0ffed9d700 1 --2- 172.21.15.103:0/2398851039 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10000b9140 0x7f10000aed90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0ff8001bf0 tx=0x7f0ff4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.284+0000 7f0ffed9d700 1 --2- 172.21.15.103:0/2398851039 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10000b9140 0x7f10000aed90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0ff8001bf0 tx=0x7f0ff4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.284+0000 7f0ffed9d700 1 --2- 172.21.15.103:0/2398851039 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10000b9140 0x7f10000aed90 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7f0ff8001bf0 tx=0x7f0ff4007a40).ready entity=mon.2 client_cookie=dd3cc4ce8c4a4443 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:11.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.284+0000 7f0ffed9d700 1 --2- 172.21.15.103:0/2398851039 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10000b9140 0x7f10000aed90 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f0ff8001bf0 tx=0x7f0ff4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.284+0000 7f0ffdd9b700 1 -- 172.21.15.103:0/2398851039 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ff8001a50 con 0x7f10000b9140 2020-04-22T14:14:11.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.284+0000 7f0ffed9d700 1 --2- 172.21.15.103:0/2398851039 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10000b9140 0x7f10000aed90 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f0ff8001bf0 tx=0x7f0ff4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.284+0000 7f0ffdd9b700 1 -- 172.21.15.103:0/2398851039 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff4008b40 con 0x7f10000b9140 2020-04-22T14:14:11.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.284+0000 7f0ffed9d700 1 --2- 172.21.15.103:0/2398851039 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10000b9140 0x7f10000aed90 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f0ff8001bf0 tx=0x7f0ff4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.284+0000 7f0ffdd9b700 1 -- 172.21.15.103:0/2398851039 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ff40115a0 con 0x7f10000b9140 2020-04-22T14:14:11.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.284+0000 7f100501c700 1 -- 172.21.15.103:0/2398851039 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10000b9140 msgr2=0x7f10000aed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:11.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.284+0000 7f100501c700 1 --2- 172.21.15.103:0/2398851039 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10000b9140 0x7f10000aed90 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7f0ff8001bf0 tx=0x7f0ff4007a40).stop 2020-04-22T14:14:11.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.284+0000 7f100501c700 1 -- 172.21.15.103:0/2398851039 shutdown_connections 2020-04-22T14:14:11.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.284+0000 7f100501c700 1 --2- 172.21.15.103:0/2398851039 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10000b9140 0x7f10000aed90 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:11.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.284+0000 7f100501c700 1 --2- 172.21.15.103:0/2398851039 >> v2:172.21.15.86:3300/0 conn(0x7f10000b3bd0 0x7f10000af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:11.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.284+0000 7f100501c700 1 -- 172.21.15.103:0/2398851039 >> 172.21.15.103:0/2398851039 conn(0x7f100005b7b0 msgr2=0x7f10000b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:11.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.284+0000 7f100501c700 1 -- 172.21.15.103:0/2398851039 shutdown_connections 2020-04-22T14:14:11.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.284+0000 7f100501c700 1 -- 172.21.15.103:0/2398851039 wait complete. 2020-04-22T14:14:11.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.285+0000 7f100501c700 1 Processor -- start 2020-04-22T14:14:11.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.285+0000 7f100501c700 1 -- start start 2020-04-22T14:14:11.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.286+0000 7f100501c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10000b3bd0 0x7f10001466a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:11.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.286+0000 7f100501c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f10000b9140 0x7f1000147c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:11.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.286+0000 7f100501c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1000063160 con 0x7f10000616b0 2020-04-22T14:14:11.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.286+0000 7f100501c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10000ae410 con 0x7f10000b9140 2020-04-22T14:14:11.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.286+0000 7f100501c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10000ae6b0 con 0x7f10000b3bd0 2020-04-22T14:14:11.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.286+0000 7f0ffed9d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f10000616b0 0x7f10000ac740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46712/0 (socket says 172.21.15.103:46712) 2020-04-22T14:14:11.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.286+0000 7f0ffed9d700 1 -- 172.21.15.103:0/2050136611 learned_addr learned my addr 172.21.15.103:0/2050136611 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:14:11.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.286+0000 7f0feffff700 1 -- 172.21.15.103:0/2050136611 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1323216105 0 0) 0x7f1000063160 con 0x7f10000616b0 2020-04-22T14:14:11.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.286+0000 7f0feffff700 1 -- 172.21.15.103:0/2050136611 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fdc002fe0 con 0x7f10000616b0 2020-04-22T14:14:11.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.286+0000 7f0ffe59c700 1 --2- 172.21.15.103:0/2050136611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10000b3bd0 0x7f10001466a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:11.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.286+0000 7f0fff59e700 1 --2- 172.21.15.103:0/2050136611 >> v2:172.21.15.86:3300/0 conn(0x7f10000b9140 0x7f1000147c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:11.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.287+0000 7f0feffff700 1 -- 172.21.15.103:0/2050136611 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 845888835 0 0) 0x7f0fdc002fe0 con 0x7f10000616b0 2020-04-22T14:14:11.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.287+0000 7f0feffff700 1 -- 172.21.15.103:0/2050136611 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1000063160 con 0x7f10000616b0 2020-04-22T14:14:11.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.287+0000 7f0feffff700 1 -- 172.21.15.103:0/2050136611 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f0ff40115a0 con 0x7f10000616b0 2020-04-22T14:14:11.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.287+0000 7f0feffff700 1 -- 172.21.15.103:0/2050136611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10000b3bd0 msgr2=0x7f10001466a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:11.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.287+0000 7f0feffff700 1 --2- 172.21.15.103:0/2050136611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10000b3bd0 0x7f10001466a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:11.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.287+0000 7f0feffff700 1 -- 172.21.15.103:0/2050136611 >> v2:172.21.15.86:3300/0 conn(0x7f10000b9140 msgr2=0x7f1000147c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:11.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.287+0000 7f0feffff700 1 --2- 172.21.15.103:0/2050136611 >> v2:172.21.15.86:3300/0 conn(0x7f10000b9140 0x7f1000147c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:11.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.287+0000 7f0feffff700 1 -- 172.21.15.103:0/2050136611 >> v1:172.21.15.103:6789/0 conn(0x7f10000616b0 legacy=0x7f10000ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:11.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.287+0000 7f0feffff700 1 --2- 172.21.15.103:0/2050136611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10000b3bd0 0x7f0fdc0049b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:11.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.287+0000 7f0feffff700 1 --2- 172.21.15.103:0/2050136611 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fdc004e10 0x7f0fdc005230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:11.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.287+0000 7f0feffff700 1 --2- 172.21.15.103:0/2050136611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fdc003990 0x7f0fdc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:11.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.287+0000 7f0feffff700 1 -- 172.21.15.103:0/2050136611 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10000ae410 con 0x7f0fdc004e10 2020-04-22T14:14:11.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.287+0000 7f0feffff700 1 -- 172.21.15.103:0/2050136611 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10000ae6b0 con 0x7f0fdc003990 2020-04-22T14:14:11.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.287+0000 7f0feffff700 1 -- 172.21.15.103:0/2050136611 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fdc004440 con 0x7f10000b3bd0 2020-04-22T14:14:11.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.287+0000 7f0fff59e700 1 --2- 172.21.15.103:0/2050136611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fdc003990 0x7f0fdc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:11.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.287+0000 7f0ffed9d700 1 --2- 172.21.15.103:0/2050136611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10000b3bd0 0x7f0fdc0049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:11.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.287+0000 7f0ffe59c700 1 --2- 172.21.15.103:0/2050136611 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fdc004e10 0x7f0fdc005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:11.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.287+0000 7f0fff59e700 1 -- 172.21.15.103:0/2050136611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10000b3bd0 msgr2=0x7f0fdc0049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:11.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.287+0000 7f0fff59e700 1 --2- 172.21.15.103:0/2050136611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10000b3bd0 0x7f0fdc0049b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:11.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.287+0000 7f0fff59e700 1 -- 172.21.15.103:0/2050136611 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fdc004e10 msgr2=0x7f0fdc005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:11.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.287+0000 7f0fff59e700 1 --2- 172.21.15.103:0/2050136611 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fdc004e10 0x7f0fdc005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:11.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.287+0000 7f0fff59e700 1 -- 172.21.15.103:0/2050136611 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1000156ec0 con 0x7f0fdc003990 2020-04-22T14:14:11.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.287+0000 7f100501c700 1 -- 172.21.15.103:0/2050136611 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10000ace50 con 0x7f0fdc003990 2020-04-22T14:14:11.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.287+0000 7f0fff59e700 1 --2- 172.21.15.103:0/2050136611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fdc003990 0x7f0fdc003e10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0ff8001cb0 tx=0x7f0ff8011250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.287+0000 7f100501c700 1 -- 172.21.15.103:0/2050136611 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10001468e0 con 0x7f0fdc003990 2020-04-22T14:14:11.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.287+0000 7f0fff59e700 1 --2- 172.21.15.103:0/2050136611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fdc003990 0x7f0fdc003e10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0ff8001cb0 tx=0x7f0ff8011250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.287+0000 7f0fff59e700 1 --2- 172.21.15.103:0/2050136611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fdc003990 0x7f0fdc003e10 secure :-1 s=READY pgs=1387 cs=0 l=1 rx=0x7f0ff8001cb0 tx=0x7f0ff8011250).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:11.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.287+0000 7f0fff59e700 1 --2- 172.21.15.103:0/2050136611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fdc003990 0x7f0fdc003e10 secure :-1 s=THROTTLE_DONE pgs=1387 cs=0 l=1 rx=0x7f0ff8001cb0 tx=0x7f0ff8011250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.287+0000 7f0fff59e700 1 --2- 172.21.15.103:0/2050136611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fdc003990 0x7f0fdc003e10 secure :-1 s=THROTTLE_DONE pgs=1387 cs=0 l=1 rx=0x7f0ff8001cb0 tx=0x7f0ff8011250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.287+0000 7f0feffff700 1 -- 172.21.15.103:0/2050136611 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ff800cd70 con 0x7f0fdc003990 2020-04-22T14:14:11.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.287+0000 7f0fff59e700 1 --2- 172.21.15.103:0/2050136611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fdc003990 0x7f0fdc003e10 secure :-1 s=THROTTLE_DONE pgs=1387 cs=0 l=1 rx=0x7f0ff8001cb0 tx=0x7f0ff8011250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.288+0000 7f0feffff700 1 -- 172.21.15.103:0/2050136611 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff80117d0 con 0x7f0fdc003990 2020-04-22T14:14:11.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.288+0000 7f0feffff700 1 -- 172.21.15.103:0/2050136611 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ff8011bb0 con 0x7f0fdc003990 2020-04-22T14:14:11.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.288+0000 7f0fff59e700 1 --2- 172.21.15.103:0/2050136611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fdc003990 0x7f0fdc003e10 secure :-1 s=THROTTLE_DONE pgs=1387 cs=0 l=1 rx=0x7f0ff8001cb0 tx=0x7f0ff8011250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.288+0000 7f100501c700 1 -- 172.21.15.103:0/2050136611 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fe0003340 con 0x7f0fdc003990 2020-04-22T14:14:11.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.288+0000 7f0feffff700 1 -- 172.21.15.103:0/2050136611 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f0ff8011d10 con 0x7f0fdc003990 2020-04-22T14:14:11.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.288+0000 7f0fff59e700 1 --2- 172.21.15.103:0/2050136611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fdc003990 0x7f0fdc003e10 secure :-1 s=THROTTLE_DONE pgs=1387 cs=0 l=1 rx=0x7f0ff8001cb0 tx=0x7f0ff8011250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.289+0000 7f0feffff700 1 --2- 172.21.15.103:0/2050136611 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0fdc055a60 0x7f0fdc057f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:11.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.289+0000 7f0feffff700 1 -- 172.21.15.103:0/2050136611 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0ff80615d0 con 0x7f0fdc003990 2020-04-22T14:14:11.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.289+0000 7f0ffed9d700 1 --2- 172.21.15.103:0/2050136611 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0fdc055a60 0x7f0fdc057f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:11.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.289+0000 7f0ffed9d700 1 --2- 172.21.15.103:0/2050136611 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0fdc055a60 0x7f0fdc057f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0ff4007bd0 tx=0x7f0ff4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.289+0000 7f0ffed9d700 1 --2- 172.21.15.103:0/2050136611 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0fdc055a60 0x7f0fdc057f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0ff4007bd0 tx=0x7f0ff4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.289+0000 7f0ffed9d700 1 --2- 172.21.15.103:0/2050136611 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0fdc055a60 0x7f0fdc057f20 secure :-1 s=READY pgs=507 cs=0 l=1 rx=0x7f0ff4007bd0 tx=0x7f0ff4007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:11.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.293+0000 7f0fff59e700 1 --2- 172.21.15.103:0/2050136611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fdc003990 0x7f0fdc003e10 secure :-1 s=THROTTLE_DONE pgs=1387 cs=0 l=1 rx=0x7f0ff8001cb0 tx=0x7f0ff8011250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.293+0000 7f0feffff700 1 -- 172.21.15.103:0/2050136611 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f0ff803ca70 con 0x7f0fdc003990 2020-04-22T14:14:11.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.435+0000 7f100501c700 1 -- 172.21.15.103:0/2050136611 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f0fe0002220 con 0x7f0fdc003990 2020-04-22T14:14:11.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.435+0000 7f0fff59e700 1 --2- 172.21.15.103:0/2050136611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fdc003990 0x7f0fdc003e10 secure :-1 s=THROTTLE_DONE pgs=1387 cs=0 l=1 rx=0x7f0ff8001cb0 tx=0x7f0ff8011250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.435+0000 7f0feffff700 1 -- 172.21.15.103:0/2050136611 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v90) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0ff8040090 con 0x7f0fdc003990 2020-04-22T14:14:11.439 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:14:11.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.436+0000 7f100501c700 1 -- 172.21.15.103:0/2050136611 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0fdc055a60 msgr2=0x7f0fdc057f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:11.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.436+0000 7f100501c700 1 --2- 172.21.15.103:0/2050136611 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0fdc055a60 0x7f0fdc057f20 secure :-1 s=READY pgs=507 cs=0 l=1 rx=0x7f0ff4007bd0 tx=0x7f0ff4007a40).stop 2020-04-22T14:14:11.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.436+0000 7f100501c700 1 -- 172.21.15.103:0/2050136611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fdc003990 msgr2=0x7f0fdc003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:11.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.436+0000 7f100501c700 1 --2- 172.21.15.103:0/2050136611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fdc003990 0x7f0fdc003e10 secure :-1 s=READY pgs=1387 cs=0 l=1 rx=0x7f0ff8001cb0 tx=0x7f0ff8011250).stop 2020-04-22T14:14:11.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.436+0000 7f0fff59e700 1 -- 172.21.15.103:0/2050136611 reap_dead start 2020-04-22T14:14:11.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.437+0000 7f100501c700 1 -- 172.21.15.103:0/2050136611 shutdown_connections 2020-04-22T14:14:11.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.437+0000 7f100501c700 1 --2- 172.21.15.103:0/2050136611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fdc003990 0x7f0fdc003e10 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:11.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.437+0000 7f100501c700 1 -- 172.21.15.103:0/2050136611 >> 172.21.15.103:0/2050136611 conn(0x7f100005b7b0 msgr2=0x7f1000144590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:11.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.437+0000 7f100501c700 1 -- 172.21.15.103:0/2050136611 shutdown_connections 2020-04-22T14:14:11.441 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.437+0000 7f100501c700 1 -- 172.21.15.103:0/2050136611 wait complete. 2020-04-22T14:14:11.451 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:11.465 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:14:11.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.615+0000 7f3e451f6700 1 Processor -- start 2020-04-22T14:14:11.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.615+0000 7f3e451f6700 1 -- start start 2020-04-22T14:14:11.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.616+0000 7f3e451f6700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3e400b9140 0x7f3e4012b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:11.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.616+0000 7f3e451f6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e4012b670 0x7f3e40143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:11.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.616+0000 7f3e451f6700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e401467e0 con 0x7f3e400ac950 2020-04-22T14:14:11.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.616+0000 7f3e451f6700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e400602f0 con 0x7f3e400b9140 2020-04-22T14:14:11.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.616+0000 7f3e451f6700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e40060050 con 0x7f3e4012b670 2020-04-22T14:14:11.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.617+0000 7f3e3ed9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3e400b9140 0x7f3e4012b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:11.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.617+0000 7f3e3f59e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e4012b670 0x7f3e40143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:11.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.617+0000 7f3e3ed9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3e400b9140 0x7f3e4012b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:51768/0 (socket says 172.21.15.103:51768) 2020-04-22T14:14:11.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.617+0000 7f3e3ed9d700 1 -- 172.21.15.103:0/926808143 learned_addr learned my addr 172.21.15.103:0/926808143 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:14:11.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.617+0000 7f3e3e59c700 1 --1- 172.21.15.103:0/926808143 >> v1:172.21.15.86:6789/0 conn(0x7f3e400ac950 0x7f3e40146c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:35650/0 (socket says 172.21.15.103:35650) 2020-04-22T14:14:11.624 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.617+0000 7f3e3f59e700 1 -- 172.21.15.103:0/926808143 >> v2:172.21.15.86:3300/0 conn(0x7f3e400b9140 msgr2=0x7f3e4012b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:11.624 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.617+0000 7f3e3f59e700 1 --2- 172.21.15.103:0/926808143 >> v2:172.21.15.86:3300/0 conn(0x7f3e400b9140 0x7f3e4012b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:11.624 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.617+0000 7f3e3f59e700 1 -- 172.21.15.103:0/926808143 >> v1:172.21.15.86:6789/0 conn(0x7f3e400ac950 legacy=0x7f3e40146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:11.624 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.617+0000 7f3e3dd9b700 1 -- 172.21.15.103:0/926808143 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1494373022 0 0) 0x7f3e401467e0 con 0x7f3e400ac950 2020-04-22T14:14:11.624 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.617+0000 7f3e3f59e700 1 -- 172.21.15.103:0/926808143 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e400b9520 con 0x7f3e4012b670 2020-04-22T14:14:11.625 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.617+0000 7f3e3ed9d700 1 --2- 172.21.15.103:0/926808143 >> v2:172.21.15.86:3300/0 conn(0x7f3e400b9140 0x7f3e4012b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:14:11.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.617+0000 7f3e3f59e700 1 --2- 172.21.15.103:0/926808143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e4012b670 0x7f3e40143090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3e380032b0 tx=0x7f3e38007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.617+0000 7f3e3f59e700 1 --2- 172.21.15.103:0/926808143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e4012b670 0x7f3e40143090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3e380032b0 tx=0x7f3e38007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.617+0000 7f3e3f59e700 1 --2- 172.21.15.103:0/926808143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e4012b670 0x7f3e40143090 secure :-1 s=READY pgs=132 cs=0 l=1 rx=0x7f3e380032b0 tx=0x7f3e38007dc0).ready entity=mon.2 client_cookie=bf4c9859fe1ce96e server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:11.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.617+0000 7f3e3f59e700 1 --2- 172.21.15.103:0/926808143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e4012b670 0x7f3e40143090 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7f3e380032b0 tx=0x7f3e38007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.617+0000 7f3e3dd9b700 1 -- 172.21.15.103:0/926808143 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e38011e20 con 0x7f3e4012b670 2020-04-22T14:14:11.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.617+0000 7f3e3f59e700 1 --2- 172.21.15.103:0/926808143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e4012b670 0x7f3e40143090 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7f3e380032b0 tx=0x7f3e38007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.617+0000 7f3e3dd9b700 1 -- 172.21.15.103:0/926808143 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3800a180 con 0x7f3e4012b670 2020-04-22T14:14:11.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.617+0000 7f3e3f59e700 1 --2- 172.21.15.103:0/926808143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e4012b670 0x7f3e40143090 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7f3e380032b0 tx=0x7f3e38007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.617+0000 7f3e3dd9b700 1 -- 172.21.15.103:0/926808143 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e3800a520 con 0x7f3e4012b670 2020-04-22T14:14:11.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.617+0000 7f3e451f6700 1 -- 172.21.15.103:0/926808143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e4012b670 msgr2=0x7f3e40143090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:11.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.617+0000 7f3e451f6700 1 --2- 172.21.15.103:0/926808143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e4012b670 0x7f3e40143090 secure :-1 s=READY pgs=132 cs=0 l=1 rx=0x7f3e380032b0 tx=0x7f3e38007dc0).stop 2020-04-22T14:14:11.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.618+0000 7f3e451f6700 1 -- 172.21.15.103:0/926808143 shutdown_connections 2020-04-22T14:14:11.632 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.618+0000 7f3e451f6700 1 --2- 172.21.15.103:0/926808143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e4012b670 0x7f3e40143090 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:11.632 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.618+0000 7f3e451f6700 1 --2- 172.21.15.103:0/926808143 >> v2:172.21.15.86:3300/0 conn(0x7f3e400b9140 0x7f3e4012b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:11.632 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.618+0000 7f3e451f6700 1 -- 172.21.15.103:0/926808143 >> 172.21.15.103:0/926808143 conn(0x7f3e4005b7b0 msgr2=0x7f3e400b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:11.632 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.618+0000 7f3e451f6700 1 -- 172.21.15.103:0/926808143 shutdown_connections 2020-04-22T14:14:11.633 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.618+0000 7f3e451f6700 1 -- 172.21.15.103:0/926808143 wait complete. 2020-04-22T14:14:11.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.619+0000 7f3e451f6700 1 Processor -- start 2020-04-22T14:14:11.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.619+0000 7f3e451f6700 1 -- start start 2020-04-22T14:14:11.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.620+0000 7f3e451f6700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3e400b9140 0x7f3e400b41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:11.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.620+0000 7f3e451f6700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3e4012b670 0x7f3e401573e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:11.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.620+0000 7f3e451f6700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e400b4600 con 0x7f3e400ac950 2020-04-22T14:14:11.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.620+0000 7f3e451f6700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e400b4870 con 0x7f3e4012b670 2020-04-22T14:14:11.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.620+0000 7f3e451f6700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e400b4b10 con 0x7f3e400b9140 2020-04-22T14:14:11.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.620+0000 7f3e3e59c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3e400b9140 0x7f3e400b41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:11.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.620+0000 7f3e3ed9d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f3e400ac950 0x7f3e40126e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46732/0 (socket says 172.21.15.103:46732) 2020-04-22T14:14:11.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.620+0000 7f3e3ed9d700 1 -- 172.21.15.103:0/4225698990 learned_addr learned my addr 172.21.15.103:0/4225698990 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:14:11.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.620+0000 7f3e3f59e700 1 --2- 172.21.15.103:0/4225698990 >> v2:172.21.15.86:3300/0 conn(0x7f3e4012b670 0x7f3e401573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:11.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.620+0000 7f3e3e59c700 1 -- 172.21.15.103:0/4225698990 >> v2:172.21.15.86:3300/0 conn(0x7f3e4012b670 msgr2=0x7f3e401573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:11.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.620+0000 7f3e3e59c700 1 --2- 172.21.15.103:0/4225698990 >> v2:172.21.15.86:3300/0 conn(0x7f3e4012b670 0x7f3e401573e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:11.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.620+0000 7f3e3e59c700 1 -- 172.21.15.103:0/4225698990 >> v1:172.21.15.103:6789/0 conn(0x7f3e400ac950 legacy=0x7f3e40126e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:11.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.620+0000 7f3e3e59c700 1 -- 172.21.15.103:0/4225698990 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e400b4db0 con 0x7f3e400b9140 2020-04-22T14:14:11.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.620+0000 7f3e37fff700 1 -- 172.21.15.103:0/4225698990 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1502910100 0 0) 0x7f3e400b4600 con 0x7f3e400ac950 2020-04-22T14:14:11.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.620+0000 7f3e3e59c700 1 --2- 172.21.15.103:0/4225698990 >> v2:172.21.15.103:3300/0 conn(0x7f3e400b9140 0x7f3e400b41a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3e30000b80 tx=0x7f3e30001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.620+0000 7f3e3e59c700 1 --2- 172.21.15.103:0/4225698990 >> v2:172.21.15.103:3300/0 conn(0x7f3e400b9140 0x7f3e400b41a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3e30000b80 tx=0x7f3e30001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.620+0000 7f3e3e59c700 1 --2- 172.21.15.103:0/4225698990 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e400b9140 0x7f3e400b41a0 secure :-1 s=READY pgs=1389 cs=0 l=1 rx=0x7f3e30000b80 tx=0x7f3e30001e40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:11.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.620+0000 7f3e3e59c700 1 --2- 172.21.15.103:0/4225698990 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e400b9140 0x7f3e400b41a0 secure :-1 s=THROTTLE_DONE pgs=1389 cs=0 l=1 rx=0x7f3e30000b80 tx=0x7f3e30001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.620+0000 7f3e37fff700 1 -- 172.21.15.103:0/4225698990 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e300116d0 con 0x7f3e400b9140 2020-04-22T14:14:11.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.620+0000 7f3e3e59c700 1 --2- 172.21.15.103:0/4225698990 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e400b9140 0x7f3e400b41a0 secure :-1 s=THROTTLE_DONE pgs=1389 cs=0 l=1 rx=0x7f3e30000b80 tx=0x7f3e30001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.620+0000 7f3e3e59c700 1 --2- 172.21.15.103:0/4225698990 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e400b9140 0x7f3e400b41a0 secure :-1 s=THROTTLE_DONE pgs=1389 cs=0 l=1 rx=0x7f3e30000b80 tx=0x7f3e30001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.620+0000 7f3e37fff700 1 -- 172.21.15.103:0/4225698990 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e30011830 con 0x7f3e400b9140 2020-04-22T14:14:11.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.620+0000 7f3e451f6700 1 -- 172.21.15.103:0/4225698990 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e40127550 con 0x7f3e400b9140 2020-04-22T14:14:11.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.620+0000 7f3e37fff700 1 -- 172.21.15.103:0/4225698990 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e30011bd0 con 0x7f3e400b9140 2020-04-22T14:14:11.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.620+0000 7f3e451f6700 1 -- 172.21.15.103:0/4225698990 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e40157a80 con 0x7f3e400b9140 2020-04-22T14:14:11.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.621+0000 7f3e3e59c700 1 --2- 172.21.15.103:0/4225698990 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e400b9140 0x7f3e400b41a0 secure :-1 s=THROTTLE_DONE pgs=1389 cs=0 l=1 rx=0x7f3e30000b80 tx=0x7f3e30001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.621+0000 7f3e451f6700 1 -- 172.21.15.103:0/4225698990 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e40056c90 con 0x7f3e400b9140 2020-04-22T14:14:11.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.622+0000 7f3e37fff700 1 -- 172.21.15.103:0/4225698990 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f3e300071a0 con 0x7f3e400b9140 2020-04-22T14:14:11.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.622+0000 7f3e3e59c700 1 --2- 172.21.15.103:0/4225698990 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e400b9140 0x7f3e400b41a0 secure :-1 s=THROTTLE_DONE pgs=1389 cs=0 l=1 rx=0x7f3e30000b80 tx=0x7f3e30001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.622+0000 7f3e37fff700 1 --2- 172.21.15.103:0/4225698990 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3e2404d990 0x7f3e2404fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:11.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.622+0000 7f3e37fff700 1 -- 172.21.15.103:0/4225698990 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3e30060f60 con 0x7f3e400b9140 2020-04-22T14:14:11.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.622+0000 7f3e3ed9d700 1 --2- 172.21.15.103:0/4225698990 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3e2404d990 0x7f3e2404fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:11.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.622+0000 7f3e3ed9d700 1 --2- 172.21.15.103:0/4225698990 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3e2404d990 0x7f3e2404fe50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3e28007a80 tx=0x7f3e28009410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.623+0000 7f3e3ed9d700 1 --2- 172.21.15.103:0/4225698990 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3e2404d990 0x7f3e2404fe50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3e28007a80 tx=0x7f3e28009410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.623+0000 7f3e3ed9d700 1 --2- 172.21.15.103:0/4225698990 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3e2404d990 0x7f3e2404fe50 secure :-1 s=READY pgs=508 cs=0 l=1 rx=0x7f3e28007a80 tx=0x7f3e28009410).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:11.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.626+0000 7f3e3e59c700 1 --2- 172.21.15.103:0/4225698990 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e400b9140 0x7f3e400b41a0 secure :-1 s=THROTTLE_DONE pgs=1389 cs=0 l=1 rx=0x7f3e30000b80 tx=0x7f3e30001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.626+0000 7f3e37fff700 1 -- 172.21.15.103:0/4225698990 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f3e3003c2e0 con 0x7f3e400b9140 2020-04-22T14:14:11.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.768+0000 7f3e451f6700 1 -- 172.21.15.103:0/4225698990 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3e401276e0 con 0x7f3e400b9140 2020-04-22T14:14:11.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.768+0000 7f3e3e59c700 1 --2- 172.21.15.103:0/4225698990 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e400b9140 0x7f3e400b41a0 secure :-1 s=THROTTLE_DONE pgs=1389 cs=0 l=1 rx=0x7f3e30000b80 tx=0x7f3e30001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.768+0000 7f3e37fff700 1 -- 172.21.15.103:0/4225698990 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v90) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3e3003f900 con 0x7f3e400b9140 2020-04-22T14:14:11.772 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:14:11.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.769+0000 7f3e451f6700 1 -- 172.21.15.103:0/4225698990 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3e2404d990 msgr2=0x7f3e2404fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:11.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.769+0000 7f3e451f6700 1 --2- 172.21.15.103:0/4225698990 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3e2404d990 0x7f3e2404fe50 secure :-1 s=READY pgs=508 cs=0 l=1 rx=0x7f3e28007a80 tx=0x7f3e28009410).stop 2020-04-22T14:14:11.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.769+0000 7f3e451f6700 1 -- 172.21.15.103:0/4225698990 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e400b9140 msgr2=0x7f3e400b41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:11.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.769+0000 7f3e451f6700 1 --2- 172.21.15.103:0/4225698990 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e400b9140 0x7f3e400b41a0 secure :-1 s=READY pgs=1389 cs=0 l=1 rx=0x7f3e30000b80 tx=0x7f3e30001e40).stop 2020-04-22T14:14:11.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.769+0000 7f3e451f6700 1 -- 172.21.15.103:0/4225698990 shutdown_connections 2020-04-22T14:14:11.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.769+0000 7f3e451f6700 1 --2- 172.21.15.103:0/4225698990 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3e2404d990 0x7f3e2404fe50 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:11.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.769+0000 7f3e451f6700 1 --2- 172.21.15.103:0/4225698990 >> v2:172.21.15.86:3300/0 conn(0x7f3e4012b670 0x7f3e401573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:11.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.769+0000 7f3e451f6700 1 --2- 172.21.15.103:0/4225698990 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e400b9140 0x7f3e400b41a0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:11.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.769+0000 7f3e451f6700 1 -- 172.21.15.103:0/4225698990 >> 172.21.15.103:0/4225698990 conn(0x7f3e4005b7b0 msgr2=0x7f3e400b85c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:11.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.769+0000 7f3e451f6700 1 -- 172.21.15.103:0/4225698990 shutdown_connections 2020-04-22T14:14:11.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.769+0000 7f3e451f6700 1 -- 172.21.15.103:0/4225698990 wait complete. 2020-04-22T14:14:11.783 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:11.796 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-22T14:14:11.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.943+0000 7fd9dcc78700 1 Processor -- start 2020-04-22T14:14:11.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.943+0000 7fd9dcc78700 1 -- start start 2020-04-22T14:14:11.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.944+0000 7fd9dcc78700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd9d80b9140 0x7fd9d812b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:11.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.944+0000 7fd9dcc78700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd9d812b670 0x7fd9d8143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:11.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.944+0000 7fd9dcc78700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d81467e0 con 0x7fd9d80ac950 2020-04-22T14:14:11.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.944+0000 7fd9dcc78700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d80602f0 con 0x7fd9d812b670 2020-04-22T14:14:11.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.944+0000 7fd9dcc78700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d8060050 con 0x7fd9d80b9140 2020-04-22T14:14:11.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.944+0000 7fd9d659c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd9d80b9140 0x7fd9d812b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:11.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.944+0000 7fd9d659c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd9d80b9140 0x7fd9d812b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54550/0 (socket says 172.21.15.103:54550) 2020-04-22T14:14:11.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.944+0000 7fd9d659c700 1 -- 172.21.15.103:0/3279339240 learned_addr learned my addr 172.21.15.103:0/3279339240 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:14:11.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.944+0000 7fd9d6d9d700 1 --2- 172.21.15.103:0/3279339240 >> v2:172.21.15.86:3300/0 conn(0x7fd9d812b670 0x7fd9d8143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:11.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.944+0000 7fd9d659c700 1 -- 172.21.15.103:0/3279339240 >> v2:172.21.15.86:3300/0 conn(0x7fd9d812b670 msgr2=0x7fd9d8143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:11.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.944+0000 7fd9d659c700 1 --2- 172.21.15.103:0/3279339240 >> v2:172.21.15.86:3300/0 conn(0x7fd9d812b670 0x7fd9d8143090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:11.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.944+0000 7fd9d659c700 1 -- 172.21.15.103:0/3279339240 >> v1:172.21.15.86:6789/0 conn(0x7fd9d80ac950 legacy=0x7fd9d8146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:11.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.944+0000 7fd9d659c700 1 -- 172.21.15.103:0/3279339240 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d80b9520 con 0x7fd9d80b9140 2020-04-22T14:14:11.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.944+0000 7fd9d659c700 1 --2- 172.21.15.103:0/3279339240 >> v2:172.21.15.103:3300/0 conn(0x7fd9d80b9140 0x7fd9d812b210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd9d80b6250 tx=0x7fd9c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.944+0000 7fd9d659c700 1 --2- 172.21.15.103:0/3279339240 >> v2:172.21.15.103:3300/0 conn(0x7fd9d80b9140 0x7fd9d812b210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd9d80b6250 tx=0x7fd9c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.944+0000 7fd9d659c700 1 --2- 172.21.15.103:0/3279339240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9d80b9140 0x7fd9d812b210 secure :-1 s=READY pgs=1390 cs=0 l=1 rx=0x7fd9d80b6250 tx=0x7fd9c8007a40).ready entity=mon.1 client_cookie=71c6191d421f17fa server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:11.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.944+0000 7fd9d659c700 1 --2- 172.21.15.103:0/3279339240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9d80b9140 0x7fd9d812b210 secure :-1 s=THROTTLE_DONE pgs=1390 cs=0 l=1 rx=0x7fd9d80b6250 tx=0x7fd9c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.944+0000 7fd9d5d9b700 1 -- 172.21.15.103:0/3279339240 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9c80116e0 con 0x7fd9d80b9140 2020-04-22T14:14:11.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.944+0000 7fd9d659c700 1 --2- 172.21.15.103:0/3279339240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9d80b9140 0x7fd9d812b210 secure :-1 s=THROTTLE_DONE pgs=1390 cs=0 l=1 rx=0x7fd9d80b6250 tx=0x7fd9c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.944+0000 7fd9d659c700 1 --2- 172.21.15.103:0/3279339240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9d80b9140 0x7fd9d812b210 secure :-1 s=THROTTLE_DONE pgs=1390 cs=0 l=1 rx=0x7fd9d80b6250 tx=0x7fd9c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.944+0000 7fd9d5d9b700 1 -- 172.21.15.103:0/3279339240 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c8011840 con 0x7fd9d80b9140 2020-04-22T14:14:11.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.944+0000 7fd9d5d9b700 1 -- 172.21.15.103:0/3279339240 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9c8011c20 con 0x7fd9d80b9140 2020-04-22T14:14:11.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.944+0000 7fd9dcc78700 1 -- 172.21.15.103:0/3279339240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9d80b9140 msgr2=0x7fd9d812b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:11.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.944+0000 7fd9dcc78700 1 --2- 172.21.15.103:0/3279339240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9d80b9140 0x7fd9d812b210 secure :-1 s=READY pgs=1390 cs=0 l=1 rx=0x7fd9d80b6250 tx=0x7fd9c8007a40).stop 2020-04-22T14:14:11.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.945+0000 7fd9dcc78700 1 -- 172.21.15.103:0/3279339240 shutdown_connections 2020-04-22T14:14:11.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.945+0000 7fd9dcc78700 1 --2- 172.21.15.103:0/3279339240 >> v2:172.21.15.86:3300/0 conn(0x7fd9d812b670 0x7fd9d8143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:11.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.945+0000 7fd9dcc78700 1 --2- 172.21.15.103:0/3279339240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9d80b9140 0x7fd9d812b210 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:11.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.945+0000 7fd9dcc78700 1 -- 172.21.15.103:0/3279339240 >> 172.21.15.103:0/3279339240 conn(0x7fd9d805b7b0 msgr2=0x7fd9d80b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:11.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.945+0000 7fd9dcc78700 1 -- 172.21.15.103:0/3279339240 shutdown_connections 2020-04-22T14:14:11.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.945+0000 7fd9dcc78700 1 -- 172.21.15.103:0/3279339240 wait complete. 2020-04-22T14:14:11.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.946+0000 7fd9dcc78700 1 Processor -- start 2020-04-22T14:14:11.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.946+0000 7fd9dcc78700 1 -- start start 2020-04-22T14:14:11.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.946+0000 7fd9dcc78700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd9d80ac950 0x7fd9d8065df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:11.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.947+0000 7fd9dcc78700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d8065250 con 0x7fd9d80b9140 2020-04-22T14:14:11.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.947+0000 7fd9dcc78700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d80654f0 con 0x7fd9d812b670 2020-04-22T14:14:11.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.947+0000 7fd9dcc78700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d8065990 con 0x7fd9d80ac950 2020-04-22T14:14:11.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.947+0000 7fd9d6d9d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd9d812b670 0x7fd9d80b1090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46750/0 (socket says 172.21.15.103:46750) 2020-04-22T14:14:11.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.947+0000 7fd9d6d9d700 1 -- 172.21.15.103:0/2061050724 learned_addr learned my addr 172.21.15.103:0/2061050724 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:14:11.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.947+0000 7fd9d659c700 1 --2- 172.21.15.103:0/2061050724 >> v2:172.21.15.86:3300/0 conn(0x7fd9d80ac950 0x7fd9d8065df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:11.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.947+0000 7fd9cf7fe700 1 -- 172.21.15.103:0/2061050724 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1200759355 0 0) 0x7fd9d80654f0 con 0x7fd9d812b670 2020-04-22T14:14:11.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.947+0000 7fd9cf7fe700 1 -- 172.21.15.103:0/2061050724 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9bc002fe0 con 0x7fd9d812b670 2020-04-22T14:14:11.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.947+0000 7fd9cf7fe700 1 -- 172.21.15.103:0/2061050724 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 790736310 0 0) 0x7fd9d8065250 con 0x7fd9d80b9140 2020-04-22T14:14:11.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.947+0000 7fd9d659c700 1 -- 172.21.15.103:0/2061050724 >> v1:172.21.15.103:6789/0 conn(0x7fd9d812b670 legacy=0x7fd9d80b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:11.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.947+0000 7fd9d659c700 1 -- 172.21.15.103:0/2061050724 >> v1:172.21.15.86:6789/0 conn(0x7fd9d80b9140 legacy=0x7fd9d8142910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:11.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.947+0000 7fd9d659c700 1 -- 172.21.15.103:0/2061050724 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d8062b90 con 0x7fd9d80ac950 2020-04-22T14:14:11.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.947+0000 7fd9d659c700 1 --2- 172.21.15.103:0/2061050724 >> v2:172.21.15.86:3300/0 conn(0x7fd9d80ac950 0x7fd9d8065df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd9d0002c70 tx=0x7fd9c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.947+0000 7fd9d659c700 1 --2- 172.21.15.103:0/2061050724 >> v2:172.21.15.86:3300/0 conn(0x7fd9d80ac950 0x7fd9d8065df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd9d0002c70 tx=0x7fd9c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.947+0000 7fd9d659c700 1 --2- 172.21.15.103:0/2061050724 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9d80ac950 0x7fd9d8065df0 secure :-1 s=READY pgs=743 cs=0 l=1 rx=0x7fd9d0002c70 tx=0x7fd9c8007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:11.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.947+0000 7fd9d659c700 1 --2- 172.21.15.103:0/2061050724 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9d80ac950 0x7fd9d8065df0 secure :-1 s=THROTTLE_DONE pgs=743 cs=0 l=1 rx=0x7fd9d0002c70 tx=0x7fd9c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.947+0000 7fd9cf7fe700 1 -- 172.21.15.103:0/2061050724 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9d0002ad0 con 0x7fd9d80ac950 2020-04-22T14:14:11.961 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.947+0000 7fd9d659c700 1 --2- 172.21.15.103:0/2061050724 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9d80ac950 0x7fd9d8065df0 secure :-1 s=THROTTLE_DONE pgs=743 cs=0 l=1 rx=0x7fd9d0002c70 tx=0x7fd9c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.961 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.947+0000 7fd9dcc78700 1 -- 172.21.15.103:0/2061050724 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d8143020 con 0x7fd9d80ac950 2020-04-22T14:14:11.961 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.947+0000 7fd9cf7fe700 1 -- 172.21.15.103:0/2061050724 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c8011be0 con 0x7fd9d80ac950 2020-04-22T14:14:11.961 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.947+0000 7fd9d659c700 1 --2- 172.21.15.103:0/2061050724 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9d80ac950 0x7fd9d8065df0 secure :-1 s=THROTTLE_DONE pgs=743 cs=0 l=1 rx=0x7fd9d0002c70 tx=0x7fd9c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.961 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.948+0000 7fd9cf7fe700 1 -- 172.21.15.103:0/2061050724 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9c8007360 con 0x7fd9d80ac950 2020-04-22T14:14:11.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.948+0000 7fd9dcc78700 1 -- 172.21.15.103:0/2061050724 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d8066560 con 0x7fd9d80ac950 2020-04-22T14:14:11.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.948+0000 7fd9d659c700 1 --2- 172.21.15.103:0/2061050724 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9d80ac950 0x7fd9d8065df0 secure :-1 s=THROTTLE_DONE pgs=743 cs=0 l=1 rx=0x7fd9d0002c70 tx=0x7fd9c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.949+0000 7fd9dcc78700 1 -- 172.21.15.103:0/2061050724 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9d8066880 con 0x7fd9d80ac950 2020-04-22T14:14:11.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.949+0000 7fd9cf7fe700 1 -- 172.21.15.103:0/2061050724 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fd9c80056c0 con 0x7fd9d80ac950 2020-04-22T14:14:11.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.949+0000 7fd9d659c700 1 --2- 172.21.15.103:0/2061050724 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9d80ac950 0x7fd9d8065df0 secure :-1 s=THROTTLE_DONE pgs=743 cs=0 l=1 rx=0x7fd9d0002c70 tx=0x7fd9c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.949+0000 7fd9cf7fe700 1 --2- 172.21.15.103:0/2061050724 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd9bc04dc10 0x7fd9bc0500d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:11.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.949+0000 7fd9cf7fe700 1 -- 172.21.15.103:0/2061050724 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd9c80617e0 con 0x7fd9d80ac950 2020-04-22T14:14:11.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.949+0000 7fd9cffff700 1 --2- 172.21.15.103:0/2061050724 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd9bc04dc10 0x7fd9bc0500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:11.964 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.949+0000 7fd9cffff700 1 --2- 172.21.15.103:0/2061050724 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd9bc04dc10 0x7fd9bc0500d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd9c00031f0 tx=0x7fd9c0008bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.964 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.949+0000 7fd9cffff700 1 --2- 172.21.15.103:0/2061050724 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd9bc04dc10 0x7fd9bc0500d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd9c00031f0 tx=0x7fd9c0008bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.964 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.949+0000 7fd9cffff700 1 --2- 172.21.15.103:0/2061050724 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd9bc04dc10 0x7fd9bc0500d0 secure :-1 s=READY pgs=509 cs=0 l=1 rx=0x7fd9c00031f0 tx=0x7fd9c0008bb0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:11.964 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.954+0000 7fd9d659c700 1 --2- 172.21.15.103:0/2061050724 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9d80ac950 0x7fd9d8065df0 secure :-1 s=THROTTLE_DONE pgs=743 cs=0 l=1 rx=0x7fd9d0002c70 tx=0x7fd9c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:11.964 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:11.954+0000 7fd9cf7fe700 1 -- 172.21.15.103:0/2061050724 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fd9c803cc80 con 0x7fd9d80ac950 2020-04-22T14:14:12.097 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.094+0000 7fd9dcc78700 1 -- 172.21.15.103:0/2061050724 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd9d81431b0 con 0x7fd9d80ac950 2020-04-22T14:14:12.098 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.094+0000 7fd9d659c700 1 --2- 172.21.15.103:0/2061050724 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9d80ac950 0x7fd9d8065df0 secure :-1 s=THROTTLE_DONE pgs=743 cs=0 l=1 rx=0x7fd9d0002c70 tx=0x7fd9c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:12.098 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.094+0000 7fd9cf7fe700 1 -- 172.21.15.103:0/2061050724 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) v1 ==== 104+0+10 (secure 0 0 0) 0x7fd9d81431b0 con 0x7fd9d80ac950 2020-04-22T14:14:12.098 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:14:12.099 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.095+0000 7fd9dcc78700 1 -- 172.21.15.103:0/2061050724 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd9bc04dc10 msgr2=0x7fd9bc0500d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:12.099 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.095+0000 7fd9dcc78700 1 --2- 172.21.15.103:0/2061050724 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd9bc04dc10 0x7fd9bc0500d0 secure :-1 s=READY pgs=509 cs=0 l=1 rx=0x7fd9c00031f0 tx=0x7fd9c0008bb0).stop 2020-04-22T14:14:12.099 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.095+0000 7fd9dcc78700 1 -- 172.21.15.103:0/2061050724 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9d80ac950 msgr2=0x7fd9d8065df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:12.099 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.095+0000 7fd9dcc78700 1 --2- 172.21.15.103:0/2061050724 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9d80ac950 0x7fd9d8065df0 secure :-1 s=READY pgs=743 cs=0 l=1 rx=0x7fd9d0002c70 tx=0x7fd9c8007a40).stop 2020-04-22T14:14:12.100 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.096+0000 7fd9dcc78700 1 -- 172.21.15.103:0/2061050724 shutdown_connections 2020-04-22T14:14:12.100 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.096+0000 7fd9dcc78700 1 --2- 172.21.15.103:0/2061050724 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd9bc04dc10 0x7fd9bc0500d0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:12.100 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.096+0000 7fd9dcc78700 1 --2- 172.21.15.103:0/2061050724 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9d80ac950 0x7fd9d8065df0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:12.100 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.096+0000 7fd9dcc78700 1 -- 172.21.15.103:0/2061050724 >> 172.21.15.103:0/2061050724 conn(0x7fd9d805b7b0 msgr2=0x7fd9d8145dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:12.100 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.096+0000 7fd9dcc78700 1 -- 172.21.15.103:0/2061050724 shutdown_connections 2020-04-22T14:14:12.100 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.096+0000 7fd9dcc78700 1 -- 172.21.15.103:0/2061050724 wait complete. 2020-04-22T14:14:12.110 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:12.125 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-22T14:14:12.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.270+0000 7f0577696700 1 Processor -- start 2020-04-22T14:14:12.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.270+0000 7f0577696700 1 -- start start 2020-04-22T14:14:12.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.271+0000 7f0577696700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f05700b9140 0x7f057012b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:12.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.271+0000 7f0577696700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05701467e0 con 0x7f057012b670 2020-04-22T14:14:12.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.271+0000 7f0577696700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0570060050 con 0x7f05700ac950 2020-04-22T14:14:12.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.271+0000 7f0577696700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05700602f0 con 0x7f05700b9140 2020-04-22T14:14:12.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.271+0000 7f0574c31700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f05700ac950 0x7f0570146c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46754/0 (socket says 172.21.15.103:46754) 2020-04-22T14:14:12.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.271+0000 7f0574c31700 1 -- 172.21.15.103:0/3983725538 learned_addr learned my addr 172.21.15.103:0/3983725538 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:14:12.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.271+0000 7f0575432700 1 --2- 172.21.15.103:0/3983725538 >> v2:172.21.15.86:3300/0 conn(0x7f05700b9140 0x7f057012b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:12.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.271+0000 7f055ffff700 1 -- 172.21.15.103:0/3983725538 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1216430364 0 0) 0x7f0570060050 con 0x7f05700ac950 2020-04-22T14:14:12.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.271+0000 7f055ffff700 1 -- 172.21.15.103:0/3983725538 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0558003230 con 0x7f05700ac950 2020-04-22T14:14:12.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.271+0000 7f055ffff700 1 -- 172.21.15.103:0/3983725538 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3412182270 0 0) 0x7f05701467e0 con 0x7f057012b670 2020-04-22T14:14:12.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.271+0000 7f055ffff700 1 -- 172.21.15.103:0/3983725538 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0570060050 con 0x7f057012b670 2020-04-22T14:14:12.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.272+0000 7f0575432700 1 -- 172.21.15.103:0/3983725538 >> v1:172.21.15.103:6789/0 conn(0x7f05700ac950 legacy=0x7f0570146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:12.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.272+0000 7f0575432700 1 -- 172.21.15.103:0/3983725538 >> v1:172.21.15.86:6789/0 conn(0x7f057012b670 legacy=0x7f0570143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:12.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.272+0000 7f0575432700 1 -- 172.21.15.103:0/3983725538 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05700b9520 con 0x7f05700b9140 2020-04-22T14:14:12.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.272+0000 7f0575432700 1 --2- 172.21.15.103:0/3983725538 >> v2:172.21.15.86:3300/0 conn(0x7f05700b9140 0x7f057012b210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0560002f30 tx=0x7f0560007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:12.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.272+0000 7f0575432700 1 --2- 172.21.15.103:0/3983725538 >> v2:172.21.15.86:3300/0 conn(0x7f05700b9140 0x7f057012b210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0560002f30 tx=0x7f0560007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:12.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.272+0000 7f0575432700 1 --2- 172.21.15.103:0/3983725538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05700b9140 0x7f057012b210 secure :-1 s=READY pgs=745 cs=0 l=1 rx=0x7f0560002f30 tx=0x7f0560007a40).ready entity=mon.0 client_cookie=59ed156bd07fd80f server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:12.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.272+0000 7f0575432700 1 --2- 172.21.15.103:0/3983725538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05700b9140 0x7f057012b210 secure :-1 s=THROTTLE_DONE pgs=745 cs=0 l=1 rx=0x7f0560002f30 tx=0x7f0560007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:12.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.272+0000 7f055ffff700 1 -- 172.21.15.103:0/3983725538 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0560011310 con 0x7f05700b9140 2020-04-22T14:14:12.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.272+0000 7f0575432700 1 --2- 172.21.15.103:0/3983725538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05700b9140 0x7f057012b210 secure :-1 s=THROTTLE_DONE pgs=745 cs=0 l=1 rx=0x7f0560002f30 tx=0x7f0560007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:12.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.272+0000 7f0575432700 1 --2- 172.21.15.103:0/3983725538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05700b9140 0x7f057012b210 secure :-1 s=THROTTLE_DONE pgs=745 cs=0 l=1 rx=0x7f0560002f30 tx=0x7f0560007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:12.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.272+0000 7f055ffff700 1 -- 172.21.15.103:0/3983725538 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0560011470 con 0x7f05700b9140 2020-04-22T14:14:12.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.272+0000 7f055ffff700 1 -- 172.21.15.103:0/3983725538 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0560011850 con 0x7f05700b9140 2020-04-22T14:14:12.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.272+0000 7f0577696700 1 -- 172.21.15.103:0/3983725538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05700b9140 msgr2=0x7f057012b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:12.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.272+0000 7f0577696700 1 --2- 172.21.15.103:0/3983725538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05700b9140 0x7f057012b210 secure :-1 s=READY pgs=745 cs=0 l=1 rx=0x7f0560002f30 tx=0x7f0560007a40).stop 2020-04-22T14:14:12.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.272+0000 7f0577696700 1 -- 172.21.15.103:0/3983725538 shutdown_connections 2020-04-22T14:14:12.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.272+0000 7f0577696700 1 --2- 172.21.15.103:0/3983725538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05700b9140 0x7f057012b210 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:12.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.272+0000 7f0577696700 1 -- 172.21.15.103:0/3983725538 >> 172.21.15.103:0/3983725538 conn(0x7f057005b7b0 msgr2=0x7f05700b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:12.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.272+0000 7f0577696700 1 -- 172.21.15.103:0/3983725538 shutdown_connections 2020-04-22T14:14:12.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.272+0000 7f0577696700 1 -- 172.21.15.103:0/3983725538 wait complete. 2020-04-22T14:14:12.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.273+0000 7f0577696700 1 Processor -- start 2020-04-22T14:14:12.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.273+0000 7f0577696700 1 -- start start 2020-04-22T14:14:12.286 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.274+0000 7f0577696700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f05700ac950 0x7f05701120a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:12.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.274+0000 7f0577696700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f05700b9140 0x7f0570126b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:12.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.274+0000 7f0577696700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f057012b670 0x7f05700b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:12.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.274+0000 7f0577696700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05700b5a40 con 0x7f057012b670 2020-04-22T14:14:12.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.274+0000 7f0577696700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05700652f0 con 0x7f05700ac950 2020-04-22T14:14:12.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.274+0000 7f0577696700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0570127680 con 0x7f05700b9140 2020-04-22T14:14:12.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.274+0000 7f0575432700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f05700ac950 0x7f05701120a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:12.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.274+0000 7f0575432700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f05700ac950 0x7f05701120a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54570/0 (socket says 172.21.15.103:54570) 2020-04-22T14:14:12.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.274+0000 7f0575432700 1 -- 172.21.15.103:0/1067426065 learned_addr learned my addr 172.21.15.103:0/1067426065 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:14:12.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.274+0000 7f0575c33700 1 --2- 172.21.15.103:0/1067426065 >> v2:172.21.15.86:3300/0 conn(0x7f057012b670 0x7f05700b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:12.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.274+0000 7f0574c31700 1 --2- 172.21.15.103:0/1067426065 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f05700b9140 0x7f0570126b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:12.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.274+0000 7f0575432700 1 -- 172.21.15.103:0/1067426065 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f05700b9140 msgr2=0x7f0570126b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:12.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.274+0000 7f0575432700 1 --2- 172.21.15.103:0/1067426065 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f05700b9140 0x7f0570126b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:12.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.274+0000 7f0575432700 1 -- 172.21.15.103:0/1067426065 >> v2:172.21.15.86:3300/0 conn(0x7f057012b670 msgr2=0x7f05700b55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:12.289 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.274+0000 7f0575432700 1 --2- 172.21.15.103:0/1067426065 >> v2:172.21.15.86:3300/0 conn(0x7f057012b670 0x7f05700b55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:12.289 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.274+0000 7f0575432700 1 -- 172.21.15.103:0/1067426065 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0570127140 con 0x7f05700ac950 2020-04-22T14:14:12.289 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.274+0000 7f0575c33700 1 --2- 172.21.15.103:0/1067426065 >> v2:172.21.15.86:3300/0 conn(0x7f057012b670 0x7f05700b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:14:12.289 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.275+0000 7f0575432700 1 --2- 172.21.15.103:0/1067426065 >> v2:172.21.15.103:3300/0 conn(0x7f05700ac950 0x7f05701120a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0560002f30 tx=0x7f0560007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:12.289 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.275+0000 7f0575432700 1 --2- 172.21.15.103:0/1067426065 >> v2:172.21.15.103:3300/0 conn(0x7f05700ac950 0x7f05701120a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0560002f30 tx=0x7f0560007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:12.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.275+0000 7f0575432700 1 --2- 172.21.15.103:0/1067426065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05700ac950 0x7f05701120a0 secure :-1 s=READY pgs=1393 cs=0 l=1 rx=0x7f0560002f30 tx=0x7f0560007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:12.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.275+0000 7f0575432700 1 --2- 172.21.15.103:0/1067426065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05700ac950 0x7f05701120a0 secure :-1 s=THROTTLE_DONE pgs=1393 cs=0 l=1 rx=0x7f0560002f30 tx=0x7f0560007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:12.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.275+0000 7f055e7fc700 1 -- 172.21.15.103:0/1067426065 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0560007170 con 0x7f05700ac950 2020-04-22T14:14:12.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.275+0000 7f0575432700 1 --2- 172.21.15.103:0/1067426065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05700ac950 0x7f05701120a0 secure :-1 s=THROTTLE_DONE pgs=1393 cs=0 l=1 rx=0x7f0560002f30 tx=0x7f0560007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:12.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.275+0000 7f0577696700 1 -- 172.21.15.103:0/1067426065 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05701273e0 con 0x7f05700ac950 2020-04-22T14:14:12.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.275+0000 7f055e7fc700 1 -- 172.21.15.103:0/1067426065 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0560007310 con 0x7f05700ac950 2020-04-22T14:14:12.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.275+0000 7f0575432700 1 --2- 172.21.15.103:0/1067426065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05700ac950 0x7f05701120a0 secure :-1 s=THROTTLE_DONE pgs=1393 cs=0 l=1 rx=0x7f0560002f30 tx=0x7f0560007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:12.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.275+0000 7f055e7fc700 1 -- 172.21.15.103:0/1067426065 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05600056c0 con 0x7f05700ac950 2020-04-22T14:14:12.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.275+0000 7f0577696700 1 -- 172.21.15.103:0/1067426065 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0570062d50 con 0x7f05700ac950 2020-04-22T14:14:12.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.275+0000 7f0575432700 1 --2- 172.21.15.103:0/1067426065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05700ac950 0x7f05701120a0 secure :-1 s=THROTTLE_DONE pgs=1393 cs=0 l=1 rx=0x7f0560002f30 tx=0x7f0560007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:12.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.276+0000 7f055e7fc700 1 -- 172.21.15.103:0/1067426065 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f0560005940 con 0x7f05700ac950 2020-04-22T14:14:12.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.276+0000 7f0575432700 1 --2- 172.21.15.103:0/1067426065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05700ac950 0x7f05701120a0 secure :-1 s=THROTTLE_DONE pgs=1393 cs=0 l=1 rx=0x7f0560002f30 tx=0x7f0560007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:12.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.276+0000 7f0577696700 1 -- 172.21.15.103:0/1067426065 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0570056c90 con 0x7f05700ac950 2020-04-22T14:14:12.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.276+0000 7f055e7fc700 1 --2- 172.21.15.103:0/1067426065 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f055004d960 0x7f055004fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:12.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.276+0000 7f055e7fc700 1 -- 172.21.15.103:0/1067426065 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0560062240 con 0x7f05700ac950 2020-04-22T14:14:12.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.277+0000 7f0574c31700 1 --2- 172.21.15.103:0/1067426065 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f055004d960 0x7f055004fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:12.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.277+0000 7f0574c31700 1 --2- 172.21.15.103:0/1067426065 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f055004d960 0x7f055004fe20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f056c001110 tx=0x7f056c001800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:12.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.277+0000 7f0574c31700 1 --2- 172.21.15.103:0/1067426065 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f055004d960 0x7f055004fe20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f056c001110 tx=0x7f056c001800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:12.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.277+0000 7f0574c31700 1 --2- 172.21.15.103:0/1067426065 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f055004d960 0x7f055004fe20 secure :-1 s=READY pgs=510 cs=0 l=1 rx=0x7f056c001110 tx=0x7f056c001800).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:12.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.281+0000 7f0575432700 1 --2- 172.21.15.103:0/1067426065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05700ac950 0x7f05701120a0 secure :-1 s=THROTTLE_DONE pgs=1393 cs=0 l=1 rx=0x7f0560002f30 tx=0x7f0560007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:12.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.281+0000 7f055e7fc700 1 -- 172.21.15.103:0/1067426065 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f056003d740 con 0x7f05700ac950 2020-04-22T14:14:12.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.424+0000 7f0577696700 1 -- 172.21.15.103:0/1067426065 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0570066ce0 con 0x7f05700ac950 2020-04-22T14:14:12.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.424+0000 7f0575432700 1 --2- 172.21.15.103:0/1067426065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05700ac950 0x7f05701120a0 secure :-1 s=THROTTLE_DONE pgs=1393 cs=0 l=1 rx=0x7f0560002f30 tx=0x7f0560007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:12.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.424+0000 7f055e7fc700 1 -- 172.21.15.103:0/1067426065 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) v1 ==== 100+0+10 (secure 0 0 0) 0x7f0560040d60 con 0x7f05700ac950 2020-04-22T14:14:12.428 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:14:12.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.425+0000 7f0577696700 1 -- 172.21.15.103:0/1067426065 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f055004d960 msgr2=0x7f055004fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:12.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.425+0000 7f0577696700 1 --2- 172.21.15.103:0/1067426065 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f055004d960 0x7f055004fe20 secure :-1 s=READY pgs=510 cs=0 l=1 rx=0x7f056c001110 tx=0x7f056c001800).stop 2020-04-22T14:14:12.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.425+0000 7f0577696700 1 -- 172.21.15.103:0/1067426065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05700ac950 msgr2=0x7f05701120a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:12.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.425+0000 7f0577696700 1 --2- 172.21.15.103:0/1067426065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05700ac950 0x7f05701120a0 secure :-1 s=READY pgs=1393 cs=0 l=1 rx=0x7f0560002f30 tx=0x7f0560007a40).stop 2020-04-22T14:14:12.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.425+0000 7f0577696700 1 -- 172.21.15.103:0/1067426065 shutdown_connections 2020-04-22T14:14:12.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.425+0000 7f0577696700 1 --2- 172.21.15.103:0/1067426065 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f055004d960 0x7f055004fe20 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:12.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.425+0000 7f0577696700 1 --2- 172.21.15.103:0/1067426065 >> v2:172.21.15.86:3300/0 conn(0x7f057012b670 0x7f05700b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:12.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.425+0000 7f0577696700 1 --2- 172.21.15.103:0/1067426065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05700ac950 0x7f05701120a0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:12.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.425+0000 7f0577696700 1 --2- 172.21.15.103:0/1067426065 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f05700b9140 0x7f0570126b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:12.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.425+0000 7f0577696700 1 -- 172.21.15.103:0/1067426065 >> 172.21.15.103:0/1067426065 conn(0x7f057005b7b0 msgr2=0x7f05700b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:12.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.425+0000 7f0577696700 1 -- 172.21.15.103:0/1067426065 shutdown_connections 2020-04-22T14:14:12.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.425+0000 7f0577696700 1 -- 172.21.15.103:0/1067426065 wait complete. 2020-04-22T14:14:12.444 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-04-22T14:14:12.445 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:12.458 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:14:12.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.602+0000 7f925bf70700 1 Processor -- start 2020-04-22T14:14:12.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.602+0000 7f925bf70700 1 -- start start 2020-04-22T14:14:12.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.603+0000 7f925bf70700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9254065fe0 0x7f92541464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:12.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.603+0000 7f925bf70700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9254143300 con 0x7f925412c0d0 2020-04-22T14:14:12.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.603+0000 7f925bf70700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92541435a0 con 0x7f9254063e30 2020-04-22T14:14:12.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.603+0000 7f925bf70700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9254143840 con 0x7f9254065fe0 2020-04-22T14:14:12.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.603+0000 7f925a50d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f9254063e30 0x7f92540642c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46768/0 (socket says 172.21.15.103:46768) 2020-04-22T14:14:12.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.603+0000 7f925a50d700 1 -- 172.21.15.103:0/3297765018 learned_addr learned my addr 172.21.15.103:0/3297765018 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:14:12.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.604+0000 7f925950b700 1 --2- 172.21.15.103:0/3297765018 >> v2:172.21.15.86:3300/0 conn(0x7f9254065fe0 0x7f92541464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:12.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.604+0000 7f9258d0a700 1 -- 172.21.15.103:0/3297765018 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 568328979 0 0) 0x7f92541435a0 con 0x7f9254063e30 2020-04-22T14:14:12.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.604+0000 7f9258d0a700 1 -- 172.21.15.103:0/3297765018 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f923c003230 con 0x7f9254063e30 2020-04-22T14:14:12.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.604+0000 7f9258d0a700 1 -- 172.21.15.103:0/3297765018 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 282862070 0 0) 0x7f923c003230 con 0x7f9254063e30 2020-04-22T14:14:12.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.604+0000 7f9258d0a700 1 -- 172.21.15.103:0/3297765018 >> v2:172.21.15.86:3300/0 conn(0x7f9254065fe0 msgr2=0x7f92541464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:12.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.604+0000 7f9258d0a700 1 --2- 172.21.15.103:0/3297765018 >> v2:172.21.15.86:3300/0 conn(0x7f9254065fe0 0x7f92541464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:12.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.604+0000 7f9258d0a700 1 -- 172.21.15.103:0/3297765018 >> v1:172.21.15.86:6789/0 conn(0x7f925412c0d0 legacy=0x7f925405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:12.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.604+0000 7f9258d0a700 1 -- 172.21.15.103:0/3297765018 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f925405bb50 con 0x7f9254063e30 2020-04-22T14:14:12.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.604+0000 7f9258d0a700 1 -- 172.21.15.103:0/3297765018 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f924c001a50 con 0x7f9254063e30 2020-04-22T14:14:12.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.604+0000 7f9258d0a700 1 -- 172.21.15.103:0/3297765018 >> v1:172.21.15.103:6789/0 conn(0x7f9254063e30 legacy=0x7f92540642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:12.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.604+0000 7f9258d0a700 1 --2- 172.21.15.103:0/3297765018 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f923c003720 0x7f923c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:12.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.604+0000 7f9258d0a700 1 --2- 172.21.15.103:0/3297765018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f923c0044d0 0x7f923c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:12.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.604+0000 7f9258d0a700 1 --2- 172.21.15.103:0/3297765018 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f923c004db0 0x7f923c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:12.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.604+0000 7f9258d0a700 1 -- 172.21.15.103:0/3297765018 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9254143840 con 0x7f923c003720 2020-04-22T14:14:12.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.604+0000 7f9258d0a700 1 -- 172.21.15.103:0/3297765018 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f923c0041c0 con 0x7f923c0044d0 2020-04-22T14:14:12.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.604+0000 7f9258d0a700 1 -- 172.21.15.103:0/3297765018 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f923c00bb80 con 0x7f923c004db0 2020-04-22T14:14:12.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.604+0000 7f925950b700 1 --2- 172.21.15.103:0/3297765018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f923c0044d0 0x7f923c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:12.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.604+0000 7f9259d0c700 1 --2- 172.21.15.103:0/3297765018 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f923c003720 0x7f923c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:12.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.604+0000 7f925a50d700 1 --2- 172.21.15.103:0/3297765018 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f923c004db0 0x7f923c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:12.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.604+0000 7f925950b700 1 -- 172.21.15.103:0/3297765018 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f923c004db0 msgr2=0x7f923c00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:12.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.604+0000 7f925950b700 1 --2- 172.21.15.103:0/3297765018 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f923c004db0 0x7f923c00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:12.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.604+0000 7f925950b700 1 -- 172.21.15.103:0/3297765018 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f923c003720 msgr2=0x7f923c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:12.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.604+0000 7f925950b700 1 --2- 172.21.15.103:0/3297765018 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f923c003720 0x7f923c003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:12.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.604+0000 7f925950b700 1 -- 172.21.15.103:0/3297765018 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f923c003230 con 0x7f923c0044d0 2020-04-22T14:14:12.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.604+0000 7f925a50d700 1 --2- 172.21.15.103:0/3297765018 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f923c004db0 0x7f923c00b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:14:12.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.604+0000 7f925a50d700 1 -- 172.21.15.103:0/3297765018 reap_dead start 2020-04-22T14:14:12.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.604+0000 7f925950b700 1 --2- 172.21.15.103:0/3297765018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f923c0044d0 0x7f923c004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f923c0054a0 tx=0x7f9250010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:12.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.604+0000 7f925950b700 1 --2- 172.21.15.103:0/3297765018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f923c0044d0 0x7f923c004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f923c0054a0 tx=0x7f9250010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:12.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.604+0000 7f925950b700 1 --2- 172.21.15.103:0/3297765018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f923c0044d0 0x7f923c004950 secure :-1 s=READY pgs=1395 cs=0 l=1 rx=0x7f923c0054a0 tx=0x7f9250010050).ready entity=mon.1 client_cookie=d435aeb2cfed82e8 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:12.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.605+0000 7f925950b700 1 --2- 172.21.15.103:0/3297765018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f923c0044d0 0x7f923c004950 secure :-1 s=THROTTLE_DONE pgs=1395 cs=0 l=1 rx=0x7f923c0054a0 tx=0x7f9250010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:12.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.605+0000 7f9258d0a700 1 -- 172.21.15.103:0/3297765018 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9250008d30 con 0x7f923c0044d0 2020-04-22T14:14:12.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.605+0000 7f925950b700 1 --2- 172.21.15.103:0/3297765018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f923c0044d0 0x7f923c004950 secure :-1 s=THROTTLE_DONE pgs=1395 cs=0 l=1 rx=0x7f923c0054a0 tx=0x7f9250010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:12.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.605+0000 7f925950b700 1 --2- 172.21.15.103:0/3297765018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f923c0044d0 0x7f923c004950 secure :-1 s=THROTTLE_DONE pgs=1395 cs=0 l=1 rx=0x7f923c0054a0 tx=0x7f9250010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:12.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.605+0000 7f9258d0a700 1 -- 172.21.15.103:0/3297765018 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9250008e90 con 0x7f923c0044d0 2020-04-22T14:14:12.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.605+0000 7f9258d0a700 1 -- 172.21.15.103:0/3297765018 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9250010b30 con 0x7f923c0044d0 2020-04-22T14:14:12.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.605+0000 7f925bf70700 1 -- 172.21.15.103:0/3297765018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f923c0044d0 msgr2=0x7f923c004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:12.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.605+0000 7f925bf70700 1 --2- 172.21.15.103:0/3297765018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f923c0044d0 0x7f923c004950 secure :-1 s=READY pgs=1395 cs=0 l=1 rx=0x7f923c0054a0 tx=0x7f9250010050).stop 2020-04-22T14:14:12.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.605+0000 7f925bf70700 1 -- 172.21.15.103:0/3297765018 shutdown_connections 2020-04-22T14:14:12.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.605+0000 7f925bf70700 1 --2- 172.21.15.103:0/3297765018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f923c0044d0 0x7f923c004950 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:12.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.605+0000 7f925bf70700 1 -- 172.21.15.103:0/3297765018 >> 172.21.15.103:0/3297765018 conn(0x7f92540b9160 msgr2=0x7f925405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:12.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.605+0000 7f925bf70700 1 -- 172.21.15.103:0/3297765018 shutdown_connections 2020-04-22T14:14:12.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.605+0000 7f925bf70700 1 -- 172.21.15.103:0/3297765018 wait complete. 2020-04-22T14:14:12.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.606+0000 7f925bf70700 1 Processor -- start 2020-04-22T14:14:12.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.606+0000 7f925bf70700 1 -- start start 2020-04-22T14:14:12.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.607+0000 7f925bf70700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f923c0044d0 0x7f9254140a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:12.624 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.607+0000 7f925bf70700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9254140ee0 con 0x7f9254152190 2020-04-22T14:14:12.624 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.607+0000 7f925bf70700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9254155b40 con 0x7f9254155660 2020-04-22T14:14:12.624 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.607+0000 7f925bf70700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9254126990 con 0x7f923c0044d0 2020-04-22T14:14:12.625 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.607+0000 7f9259d0c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f923c0044d0 0x7f9254140a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:12.625 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.607+0000 7f925950b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f9254155660 0x7f9254127f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46778/0 (socket says 172.21.15.103:46778) 2020-04-22T14:14:12.625 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.607+0000 7f925950b700 1 -- 172.21.15.103:0/4041855609 learned_addr learned my addr 172.21.15.103:0/4041855609 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:14:12.625 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.607+0000 7f9259d0c700 1 -- 172.21.15.103:0/4041855609 >> v1:172.21.15.103:6789/0 conn(0x7f9254155660 legacy=0x7f9254127f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:12.625 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.607+0000 7f9259d0c700 1 -- 172.21.15.103:0/4041855609 >> v1:172.21.15.86:6789/0 conn(0x7f9254152190 legacy=0x7f92540b1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:12.625 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.607+0000 7f9242ffd700 1 -- 172.21.15.103:0/4041855609 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 944941410 0 0) 0x7f9254155b40 con 0x7f9254155660 2020-04-22T14:14:12.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.607+0000 7f9259d0c700 1 -- 172.21.15.103:0/4041855609 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9254155de0 con 0x7f923c0044d0 2020-04-22T14:14:12.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.607+0000 7f9259d0c700 1 --2- 172.21.15.103:0/4041855609 >> v2:172.21.15.103:3300/0 conn(0x7f923c0044d0 0x7f9254140a80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f92540669a0 tx=0x7f924400c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:12.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.607+0000 7f9259d0c700 1 --2- 172.21.15.103:0/4041855609 >> v2:172.21.15.103:3300/0 conn(0x7f923c0044d0 0x7f9254140a80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f92540669a0 tx=0x7f924400c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:12.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.607+0000 7f9259d0c700 1 --2- 172.21.15.103:0/4041855609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f923c0044d0 0x7f9254140a80 secure :-1 s=READY pgs=1397 cs=0 l=1 rx=0x7f92540669a0 tx=0x7f924400c4e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:12.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.607+0000 7f9259d0c700 1 --2- 172.21.15.103:0/4041855609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f923c0044d0 0x7f9254140a80 secure :-1 s=THROTTLE_DONE pgs=1397 cs=0 l=1 rx=0x7f92540669a0 tx=0x7f924400c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:12.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.607+0000 7f9242ffd700 1 -- 172.21.15.103:0/4041855609 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9244001e60 con 0x7f923c0044d0 2020-04-22T14:14:12.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.607+0000 7f9259d0c700 1 --2- 172.21.15.103:0/4041855609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f923c0044d0 0x7f9254140a80 secure :-1 s=THROTTLE_DONE pgs=1397 cs=0 l=1 rx=0x7f92540669a0 tx=0x7f924400c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:12.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.607+0000 7f9259d0c700 1 --2- 172.21.15.103:0/4041855609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f923c0044d0 0x7f9254140a80 secure :-1 s=THROTTLE_DONE pgs=1397 cs=0 l=1 rx=0x7f92540669a0 tx=0x7f924400c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:12.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.607+0000 7f9242ffd700 1 -- 172.21.15.103:0/4041855609 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924400c890 con 0x7f923c0044d0 2020-04-22T14:14:12.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.607+0000 7f925bf70700 1 -- 172.21.15.103:0/4041855609 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92540b0c70 con 0x7f923c0044d0 2020-04-22T14:14:12.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.608+0000 7f9242ffd700 1 -- 172.21.15.103:0/4041855609 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f924400cc30 con 0x7f923c0044d0 2020-04-22T14:14:12.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.608+0000 7f925bf70700 1 -- 172.21.15.103:0/4041855609 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9254155200 con 0x7f923c0044d0 2020-04-22T14:14:12.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.608+0000 7f9259d0c700 1 --2- 172.21.15.103:0/4041855609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f923c0044d0 0x7f9254140a80 secure :-1 s=THROTTLE_DONE pgs=1397 cs=0 l=1 rx=0x7f92540669a0 tx=0x7f924400c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:12.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.608+0000 7f9242ffd700 1 -- 172.21.15.103:0/4041855609 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f92440064e0 con 0x7f923c0044d0 2020-04-22T14:14:12.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.608+0000 7f9259d0c700 1 --2- 172.21.15.103:0/4041855609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f923c0044d0 0x7f9254140a80 secure :-1 s=THROTTLE_DONE pgs=1397 cs=0 l=1 rx=0x7f92540669a0 tx=0x7f924400c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:12.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.609+0000 7f925bf70700 1 -- 172.21.15.103:0/4041855609 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92540b0e60 con 0x7f923c0044d0 2020-04-22T14:14:12.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.609+0000 7f9242ffd700 1 --2- 172.21.15.103:0/4041855609 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f923404d7a0 0x7f923404fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.609+0000 7f9242ffd700 1 -- 172.21.15.103:0/4041855609 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f92440611a0 con 0x7f923c0044d0 2020-04-22T14:14:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.609+0000 7f925950b700 1 --2- 172.21.15.103:0/4041855609 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f923404d7a0 0x7f923404fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.609+0000 7f925950b700 1 --2- 172.21.15.103:0/4041855609 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f923404d7a0 0x7f923404fc60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9250008690 tx=0x7f9250010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.609+0000 7f925950b700 1 --2- 172.21.15.103:0/4041855609 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f923404d7a0 0x7f923404fc60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9250008690 tx=0x7f9250010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.609+0000 7f925950b700 1 --2- 172.21.15.103:0/4041855609 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f923404d7a0 0x7f923404fc60 secure :-1 s=READY pgs=511 cs=0 l=1 rx=0x7f9250008690 tx=0x7f9250010050).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:12.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.614+0000 7f9259d0c700 1 --2- 172.21.15.103:0/4041855609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f923c0044d0 0x7f9254140a80 secure :-1 s=THROTTLE_DONE pgs=1397 cs=0 l=1 rx=0x7f92540669a0 tx=0x7f924400c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:12.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.614+0000 7f9242ffd700 1 -- 172.21.15.103:0/4041855609 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f924403c520 con 0x7f923c0044d0 2020-04-22T14:14:12.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.803+0000 7f925bf70700 1 -- 172.21.15.103:0/4041855609 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9254056c90 con 0x7f923c0044d0 2020-04-22T14:14:12.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.804+0000 7f9259d0c700 1 --2- 172.21.15.103:0/4041855609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f923c0044d0 0x7f9254140a80 secure :-1 s=THROTTLE_DONE pgs=1397 cs=0 l=1 rx=0x7f92540669a0 tx=0x7f924400c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:12.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.804+0000 7f9242ffd700 1 -- 172.21.15.103:0/4041855609 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+2143 (secure 0 0 0) 0x7f924403fb40 con 0x7f923c0044d0 2020-04-22T14:14:12.808 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:14:12.808 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":64,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5810,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/2664816107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2664816107},{"type":"v1","addr":"172.21.15.86:6835","nonce":2664816107}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":60}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:13:59.062543+0000","modified":"2020-04-22T14:14:01.070314+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7723},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7723":{"gid":7723,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/3220772133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3220772133},{"type":"v1","addr":"172.21.15.103:6833","nonce":3220772133}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-04-22T14:14:12.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.805+0000 7f925bf70700 1 -- 172.21.15.103:0/4041855609 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f923404d7a0 msgr2=0x7f923404fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:12.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.805+0000 7f925bf70700 1 --2- 172.21.15.103:0/4041855609 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f923404d7a0 0x7f923404fc60 secure :-1 s=READY pgs=511 cs=0 l=1 rx=0x7f9250008690 tx=0x7f9250010050).stop 2020-04-22T14:14:12.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.805+0000 7f925bf70700 1 -- 172.21.15.103:0/4041855609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f923c0044d0 msgr2=0x7f9254140a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:12.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.805+0000 7f925bf70700 1 --2- 172.21.15.103:0/4041855609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f923c0044d0 0x7f9254140a80 secure :-1 s=READY pgs=1397 cs=0 l=1 rx=0x7f92540669a0 tx=0x7f924400c4e0).stop 2020-04-22T14:14:12.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.805+0000 7f925bf70700 1 -- 172.21.15.103:0/4041855609 shutdown_connections 2020-04-22T14:14:12.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.805+0000 7f925bf70700 1 --2- 172.21.15.103:0/4041855609 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f923404d7a0 0x7f923404fc60 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:12.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.805+0000 7f925bf70700 1 --2- 172.21.15.103:0/4041855609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f923c0044d0 0x7f9254140a80 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:12.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.805+0000 7f925bf70700 1 -- 172.21.15.103:0/4041855609 >> 172.21.15.103:0/4041855609 conn(0x7f92540b9160 msgr2=0x7f9254064280 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:12.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.805+0000 7f925bf70700 1 -- 172.21.15.103:0/4041855609 shutdown_connections 2020-04-22T14:14:12.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:12.805+0000 7f925bf70700 1 -- 172.21.15.103:0/4041855609 wait complete. 2020-04-22T14:14:12.811 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 64 2020-04-22T14:14:13.020 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 7723}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 15, u'failed': [], u'epoch': 64, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [16], u'info': {u'gid_7723': {u'export_targets': [], u'name': u'a', u'incarnation': 61, u'state_seq': 3, u'state': u'up:active', u'gid': 7723, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 3220772133, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 3220772133, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/3220772133'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:13:59.062543+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:14:01.070314+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:14:13.020 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:14:13.020 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:13.035 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:14:13.193 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:14:13.193 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:14:13.193 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:14:13.193 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 7723, 2020-04-22T14:14:13.194 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:14:13.194 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:14:13.194 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 14.127229479, 2020-04-22T14:14:13.194 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 64, 2020-04-22T14:14:13.194 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 90, 2020-04-22T14:14:13.194 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 90, 2020-04-22T14:14:13.194 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 19.567256284999999 2020-04-22T14:14:13.194 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:14:13.201 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 7723, "want_state": "up:active", "state": "up:active", "rank_uptime": 14.127229479, "mdsmap_epoch": 64, "osdmap_epoch": 90, "osdmap_epoch_barrier": 90, "uptime": 19.567256284999999 } 2020-04-22T14:14:13.201 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-04-22T14:14:13.201 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-04-22T14:14:13.202 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:13.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:13.215 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:14:13.273 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:14:13.274 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:14:13.274 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:14:13.274 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:14:13.274 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:14:13.274 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:14:13.274 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:14:13.274 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:14:13.275 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:14:13.275 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:14:13.275 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:14:13.275 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:14:13.275 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:14:13.275 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:14:13.275 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:14:13.276 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 41987sec preferred_lft 41987sec 2020-04-22T14:14:13.276 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:14:13.276 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:14:13.276 INFO:teuthology.orchestra.run.smithi103.stdout:25: brx.1@if2: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:14:13.276 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether ce:89:5a:9a:cb:19 brd ff:ff:ff:ff:ff:ff link-netnsid 1 2020-04-22T14:14:13.276 INFO:teuthology.orchestra.run.smithi103.stdout:29: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:14:13.276 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether e6:e5:5c:0e:2a:3a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:14:13.277 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:14:13.277 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:14:13.277 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::3ff9:7e94:95df:228f/64 scope link noprefixroute 2020-04-22T14:14:13.277 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:14:13.277 INFO:teuthology.orchestra.run.smithi103.stdout:30: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-04-22T14:14:13.278 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether e6:e5:5c:0e:2a:3a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2020-04-22T14:14:13.278 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:13.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:13.325 INFO:teuthology.orchestra.run.smithi103:> ip netns list 2020-04-22T14:14:13.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2020-04-22T14:14:13.385 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:13.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:13.432 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:14:13.490 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2020-04-22T14:14:13.491 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 1 2020-04-22T14:14:13.491 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:13.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:13.540 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:14:13.602 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2020-04-22T14:14:13.602 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 1 2020-04-22T14:14:13.603 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:13.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:13.652 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:14:13.711 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2020-04-22T14:14:13.711 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 1 2020-04-22T14:14:13.711 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:13.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:13.768 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:14:13.843 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:13.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:13.891 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 2' 2020-04-22T14:14:13.974 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:14.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:14.020 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr' 2020-04-22T14:14:14.107 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:14:14.107 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:14:14.107 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:14:14.108 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:14:14.108 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:14:14.108 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:14:14.108 INFO:teuthology.orchestra.run.smithi103.stdout:2: veth0@if30: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:14:14.108 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 02:1b:d3:e8:76:00 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:14:14.108 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2020-04-22T14:14:14.108 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:14:14.109 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::1b:d3ff:fee8:7600/64 scope link 2020-04-22T14:14:14.109 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:14:14.109 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:14.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:14.162 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr' 2020-04-22T14:14:14.240 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:14:14.240 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:14:14.241 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:14:14.241 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:14:14.241 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:14:14.241 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:14:14.241 INFO:teuthology.orchestra.run.smithi103.stdout:2: veth0@if30: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:14:14.241 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 02:1b:d3:e8:76:00 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:14:14.242 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2020-04-22T14:14:14.242 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:14:14.242 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::1b:d3ff:fee8:7600/64 scope link 2020-04-22T14:14:14.242 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:14:14.273 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.2/16 2020-04-22T14:14:14.273 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:14.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:14.300 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.2' 2020-04-22T14:14:14.375 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:14.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:14.429 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0' 2020-04-22T14:14:14.538 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:14.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:14.552 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up' 2020-04-22T14:14:14.660 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:14.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:14.674 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up' 2020-04-22T14:14:14.782 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:14.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:14.797 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254' 2020-04-22T14:14:14.904 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:14.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:14.931 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:14:15.008 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:15.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:15.056 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge-slave con-name brx.2 ifname brx.2 master ceph-brx' 2020-04-22T14:14:15.164 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.2' (d2f51cd0-b81f-466d-add7-086c746c0447) successfully added. 2020-04-22T14:14:15.164 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:15.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:15.178 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up brx.2' 2020-04-22T14:14:15.339 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/37) 2020-04-22T14:14:15.389 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2020-04-22T14:14:15.389 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi103.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2020-04-22T14:14:15.390 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:15.403 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:14:15.403 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:14:15.462 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:15.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:14:15.518 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:14:15.585 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:14:15.593 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:14:15.593 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:15.642 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:14:15.642 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:14:15.701 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:14:15.701 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [47] 2020-04-22T14:14:15.701 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:15.748 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:14:15.796 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:15.809 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:14:15.809 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:14:15.878 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:14:15.884 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:2020-04-22T14:14:15.882+0000 7fd3ab8c11c0 -1 init, newargv = 0x55c30a96d150 newargc=9 2020-04-22T14:14:15.884 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[89761]: starting ceph client 2020-04-22T14:14:15.885 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:14:15.886 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:15.888 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[89761]: starting fuse 2020-04-22T14:14:15.902 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:14:15.902 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:14:15.956 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:14:15.956 INFO:teuthology.orchestra.run.smithi103.stdout:49 2020-04-22T14:14:15.956 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47, 49] 2020-04-22T14:14:15.957 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:16.008 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:14:16.008 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:14:16.008 INFO:teuthology.orchestra.run.smithi103:> import glob 2020-04-22T14:14:16.008 INFO:teuthology.orchestra.run.smithi103:> import re 2020-04-22T14:14:16.008 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:14:16.008 INFO:teuthology.orchestra.run.smithi103:> import subprocess 2020-04-22T14:14:16.008 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:14:16.009 INFO:teuthology.orchestra.run.smithi103:> def find_socket(client_name): 2020-04-22T14:14:16.009 INFO:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2020-04-22T14:14:16.009 INFO:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2020-04-22T14:14:16.009 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:14:16.009 INFO:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2020-04-22T14:14:16.009 INFO:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2020-04-22T14:14:16.009 INFO:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2020-04-22T14:14:16.009 INFO:teuthology.orchestra.run.smithi103:> return files[0] 2020-04-22T14:14:16.009 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:14:16.010 INFO:teuthology.orchestra.run.smithi103:> for f in files: 2020-04-22T14:14:16.010 INFO:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:14:16.010 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:14:16.010 INFO:teuthology.orchestra.run.smithi103:> return f 2020-04-22T14:14:16.010 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:14:16.010 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:14:16.010 INFO:teuthology.orchestra.run.smithi103:> print(find_socket("client.1")) 2020-04-22T14:14:16.010 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:14:16.116 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.1.89761.asok 2020-04-22T14:14:16.116 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.89761.asok 2020-04-22T14:14:16.116 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:16.130 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:14:16.130 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.89761.asok status 2020-04-22T14:14:16.289 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:14:16.289 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2020-04-22T14:14:16.289 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:14:16.290 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:14:16.290 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "1", 2020-04-22T14:14:16.290 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:14:16.290 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2020-04-22T14:14:16.290 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "89761", 2020-04-22T14:14:16.290 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:14:16.290 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:16.290 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2020-04-22T14:14:16.291 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2020-04-22T14:14:16.291 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 7993, 2020-04-22T14:14:16.291 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2020-04-22T14:14:16.291 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:14:16.291 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:14:16.291 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 7993 2020-04-22T14:14:16.291 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:16.292 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:14:16.292 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:14:16.292 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.2:0", 2020-04-22T14:14:16.292 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 2994531494 2020-04-22T14:14:16.292 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:14:16.292 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:16.292 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:14:16.293 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:14:16.293 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.2:0", 2020-04-22T14:14:16.293 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 2994531494 2020-04-22T14:14:16.294 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:16.294 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.7993 192.168.0.2:0/2994531494", 2020-04-22T14:14:16.294 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.2:0/2994531494", 2020-04-22T14:14:16.294 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2020-04-22T14:14:16.294 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 64, 2020-04-22T14:14:16.294 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 90, 2020-04-22T14:14:16.294 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2020-04-22T14:14:16.295 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklisted": false 2020-04-22T14:14:16.295 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:14:16.295 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:16.310 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:14:16.310 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-22T14:14:16.310 INFO:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:14:16.367 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2020-04-22T14:14:16.368 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-04-22T14:14:16.368 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:16.416 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:14:16.416 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:14:16.498 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:16.541 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok config get mds_reconnect_timeout 2020-04-22T14:14:16.700 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:14:16.700 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_reconnect_timeout": "45.000000" 2020-04-22T14:14:16.700 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:14:16.702 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_reconnect_timeout": "45.000000" } 2020-04-22T14:14:16.703 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:16.717 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok config get ms_max_backoff 2020-04-22T14:14:16.868 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:14:16.869 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_max_backoff": "15.000000" 2020-04-22T14:14:16.869 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:14:16.876 INFO:tasks.cephfs.filesystem:_json_asok output: { "ms_max_backoff": "15.000000" } 2020-04-22T14:14:16.877 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:16.890 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:14:16.891 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:14:16.891 INFO:teuthology.orchestra.run.smithi103:> import glob 2020-04-22T14:14:16.891 INFO:teuthology.orchestra.run.smithi103:> import re 2020-04-22T14:14:16.891 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:14:16.891 INFO:teuthology.orchestra.run.smithi103:> import subprocess 2020-04-22T14:14:16.891 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:14:16.891 INFO:teuthology.orchestra.run.smithi103:> def find_socket(client_name): 2020-04-22T14:14:16.892 INFO:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-04-22T14:14:16.892 INFO:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2020-04-22T14:14:16.892 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:14:16.892 INFO:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2020-04-22T14:14:16.895 INFO:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2020-04-22T14:14:16.896 INFO:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2020-04-22T14:14:16.896 INFO:teuthology.orchestra.run.smithi103:> return files[0] 2020-04-22T14:14:16.896 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:14:16.897 INFO:teuthology.orchestra.run.smithi103:> for f in files: 2020-04-22T14:14:16.897 INFO:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:14:16.897 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:14:16.897 INFO:teuthology.orchestra.run.smithi103:> return f 2020-04-22T14:14:16.897 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:14:16.898 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:14:16.898 INFO:teuthology.orchestra.run.smithi103:> print(find_socket("client.0")) 2020-04-22T14:14:16.898 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:14:16.999 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.0.88473.asok 2020-04-22T14:14:16.999 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.88473.asok 2020-04-22T14:14:16.999 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:17.013 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:14:17.013 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.88473.asok mds_sessions 2020-04-22T14:14:17.171 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:14:17.171 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 7936, 2020-04-22T14:14:17.171 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2020-04-22T14:14:17.171 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:14:17.172 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:14:17.172 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 7936 2020-04-22T14:14:17.172 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:17.172 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:14:17.172 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:14:17.172 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:14:17.172 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 425900083 2020-04-22T14:14:17.173 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:14:17.173 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:17.173 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.7936 v1:192.168.0.1:0/425900083", 2020-04-22T14:14:17.173 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "v1:192.168.0.1:0/425900083", 2020-04-22T14:14:17.173 INFO:teuthology.orchestra.run.smithi103.stdout: "sessions": [ 2020-04-22T14:14:17.173 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:14:17.174 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": 0, 2020-04-22T14:14:17.174 INFO:teuthology.orchestra.run.smithi103.stdout: "addrs": { 2020-04-22T14:14:17.174 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:14:17.174 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:14:17.174 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:14:17.174 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6832", 2020-04-22T14:14:17.174 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 3220772133 2020-04-22T14:14:17.175 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:17.175 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:14:17.175 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:14:17.175 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6833", 2020-04-22T14:14:17.175 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 3220772133 2020-04-22T14:14:17.175 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:14:17.175 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:14:17.175 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:17.176 INFO:teuthology.orchestra.run.smithi103.stdout: "seq": 0, 2020-04-22T14:14:17.176 INFO:teuthology.orchestra.run.smithi103.stdout: "cap_gen": 0, 2020-04-22T14:14:17.176 INFO:teuthology.orchestra.run.smithi103.stdout: "cap_ttl": "2020-04-22T14:15:11.127699+0000", 2020-04-22T14:14:17.176 INFO:teuthology.orchestra.run.smithi103.stdout: "last_cap_renew_request": "2020-04-22T14:14:11.127699+0000", 2020-04-22T14:14:17.176 INFO:teuthology.orchestra.run.smithi103.stdout: "cap_renew_seq": 2, 2020-04-22T14:14:17.176 INFO:teuthology.orchestra.run.smithi103.stdout: "num_caps": 1, 2020-04-22T14:14:17.176 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "open" 2020-04-22T14:14:17.177 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:14:17.177 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:14:17.177 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 64 2020-04-22T14:14:17.177 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:14:17.177 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:17.191 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs session_timeout 30 2020-04-22T14:14:17.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.336+0000 7f9881f4b700 1 Processor -- start 2020-04-22T14:14:17.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.336+0000 7f9881f4b700 1 -- start start 2020-04-22T14:14:17.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.337+0000 7f9881f4b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f987c0ac950 0x7f987c146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:17.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.337+0000 7f9881f4b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f987c1467e0 con 0x7f987c0b9140 2020-04-22T14:14:17.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.337+0000 7f9881f4b700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f987c060050 con 0x7f987c1470a0 2020-04-22T14:14:17.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.337+0000 7f9881f4b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f987c147530 con 0x7f987c0ac950 2020-04-22T14:14:17.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.337+0000 7f987bfff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f987c1470a0 0x7f987c143090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46800/0 (socket says 172.21.15.103:46800) 2020-04-22T14:14:17.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.337+0000 7f987bfff700 1 -- 172.21.15.103:0/1851406732 learned_addr learned my addr 172.21.15.103:0/1851406732 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:14:17.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.338+0000 7f987affd700 1 --2- 172.21.15.103:0/1851406732 >> v2:172.21.15.86:3300/0 conn(0x7f987c0ac950 0x7f987c146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:17.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.338+0000 7f987a7fc700 1 -- 172.21.15.103:0/1851406732 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2912947183 0 0) 0x7f987c060050 con 0x7f987c1470a0 2020-04-22T14:14:17.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.338+0000 7f987a7fc700 1 -- 172.21.15.103:0/1851406732 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9868003230 con 0x7f987c1470a0 2020-04-22T14:14:17.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.338+0000 7f987a7fc700 1 -- 172.21.15.103:0/1851406732 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2891741351 0 0) 0x7f9868003230 con 0x7f987c1470a0 2020-04-22T14:14:17.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.338+0000 7f987a7fc700 1 -- 172.21.15.103:0/1851406732 >> v2:172.21.15.86:3300/0 conn(0x7f987c0ac950 msgr2=0x7f987c146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:17.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.338+0000 7f987a7fc700 1 --2- 172.21.15.103:0/1851406732 >> v2:172.21.15.86:3300/0 conn(0x7f987c0ac950 0x7f987c146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:17.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.338+0000 7f987a7fc700 1 -- 172.21.15.103:0/1851406732 >> v1:172.21.15.86:6789/0 conn(0x7f987c0b9140 legacy=0x7f987c12b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:17.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.338+0000 7f987a7fc700 1 -- 172.21.15.103:0/1851406732 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f987c0b9520 con 0x7f987c1470a0 2020-04-22T14:14:17.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.338+0000 7f987a7fc700 1 -- 172.21.15.103:0/1851406732 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f9874001710 con 0x7f987c1470a0 2020-04-22T14:14:17.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.338+0000 7f987a7fc700 1 -- 172.21.15.103:0/1851406732 >> v1:172.21.15.103:6789/0 conn(0x7f987c1470a0 legacy=0x7f987c143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:17.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.338+0000 7f987a7fc700 1 --2- 172.21.15.103:0/1851406732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9868003720 0x7f9868003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:17.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.338+0000 7f987a7fc700 1 --2- 172.21.15.103:0/1851406732 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f98680044d0 0x7f9868004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:17.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.338+0000 7f987a7fc700 1 --2- 172.21.15.103:0/1851406732 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9868004db0 0x7f986800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:17.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.338+0000 7f987a7fc700 1 -- 172.21.15.103:0/1851406732 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98680041c0 con 0x7f9868004db0 2020-04-22T14:14:17.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.338+0000 7f987a7fc700 1 -- 172.21.15.103:0/1851406732 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9868004330 con 0x7f9868003720 2020-04-22T14:14:17.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.338+0000 7f987a7fc700 1 -- 172.21.15.103:0/1851406732 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f986800bbd0 con 0x7f98680044d0 2020-04-22T14:14:17.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.338+0000 7f987b7fe700 1 --2- 172.21.15.103:0/1851406732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9868003720 0x7f9868003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:17.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.338+0000 7f987bfff700 1 --2- 172.21.15.103:0/1851406732 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9868004db0 0x7f986800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:17.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.338+0000 7f987affd700 1 --2- 172.21.15.103:0/1851406732 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f98680044d0 0x7f9868004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:17.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.338+0000 7f987b7fe700 1 -- 172.21.15.103:0/1851406732 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f98680044d0 msgr2=0x7f9868004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:17.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.338+0000 7f987b7fe700 1 --2- 172.21.15.103:0/1851406732 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f98680044d0 0x7f9868004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:17.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.338+0000 7f987b7fe700 1 -- 172.21.15.103:0/1851406732 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9868004db0 msgr2=0x7f986800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:17.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.338+0000 7f987b7fe700 1 --2- 172.21.15.103:0/1851406732 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9868004db0 0x7f986800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:17.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.338+0000 7f987bfff700 1 -- 172.21.15.103:0/1851406732 reap_dead start 2020-04-22T14:14:17.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.338+0000 7f987b7fe700 1 -- 172.21.15.103:0/1851406732 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9868003230 con 0x7f9868003720 2020-04-22T14:14:17.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.338+0000 7f987b7fe700 1 --2- 172.21.15.103:0/1851406732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9868003720 0x7f9868003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f987c0b6250 tx=0x7f986c010120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:17.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.338+0000 7f987b7fe700 1 --2- 172.21.15.103:0/1851406732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9868003720 0x7f9868003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f987c0b6250 tx=0x7f986c010120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:17.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.338+0000 7f987b7fe700 1 --2- 172.21.15.103:0/1851406732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9868003720 0x7f9868003b40 secure :-1 s=READY pgs=1402 cs=0 l=1 rx=0x7f987c0b6250 tx=0x7f986c010120).ready entity=mon.1 client_cookie=52f8d58d5136c0d server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:17.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.339+0000 7f987b7fe700 1 --2- 172.21.15.103:0/1851406732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9868003720 0x7f9868003b40 secure :-1 s=THROTTLE_DONE pgs=1402 cs=0 l=1 rx=0x7f987c0b6250 tx=0x7f986c010120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:17.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.339+0000 7f987a7fc700 1 -- 172.21.15.103:0/1851406732 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f986c006c40 con 0x7f9868003720 2020-04-22T14:14:17.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.339+0000 7f987b7fe700 1 --2- 172.21.15.103:0/1851406732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9868003720 0x7f9868003b40 secure :-1 s=THROTTLE_DONE pgs=1402 cs=0 l=1 rx=0x7f987c0b6250 tx=0x7f986c010120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:17.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.339+0000 7f987b7fe700 1 --2- 172.21.15.103:0/1851406732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9868003720 0x7f9868003b40 secure :-1 s=THROTTLE_DONE pgs=1402 cs=0 l=1 rx=0x7f987c0b6250 tx=0x7f986c010120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:17.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.339+0000 7f987a7fc700 1 -- 172.21.15.103:0/1851406732 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986c006da0 con 0x7f9868003720 2020-04-22T14:14:17.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.339+0000 7f987a7fc700 1 -- 172.21.15.103:0/1851406732 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f986c002730 con 0x7f9868003720 2020-04-22T14:14:17.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.339+0000 7f9881f4b700 1 -- 172.21.15.103:0/1851406732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9868003720 msgr2=0x7f9868003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:17.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.339+0000 7f9881f4b700 1 --2- 172.21.15.103:0/1851406732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9868003720 0x7f9868003b40 secure :-1 s=READY pgs=1402 cs=0 l=1 rx=0x7f987c0b6250 tx=0x7f986c010120).stop 2020-04-22T14:14:17.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.339+0000 7f9881f4b700 1 -- 172.21.15.103:0/1851406732 shutdown_connections 2020-04-22T14:14:17.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.339+0000 7f9881f4b700 1 --2- 172.21.15.103:0/1851406732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9868003720 0x7f9868003b40 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:17.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.339+0000 7f9881f4b700 1 -- 172.21.15.103:0/1851406732 >> 172.21.15.103:0/1851406732 conn(0x7f987c05b7b0 msgr2=0x7f987c0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:17.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.339+0000 7f9881f4b700 1 -- 172.21.15.103:0/1851406732 shutdown_connections 2020-04-22T14:14:17.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.339+0000 7f9881f4b700 1 -- 172.21.15.103:0/1851406732 wait complete. 2020-04-22T14:14:17.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.340+0000 7f9881f4b700 1 Processor -- start 2020-04-22T14:14:17.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.340+0000 7f9881f4b700 1 -- start start 2020-04-22T14:14:17.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.341+0000 7f9881f4b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9868003720 0x7f987c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:17.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.341+0000 7f9881f4b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f987c062040 0x7f987c1514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:17.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.341+0000 7f9881f4b700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f987c151cb0 con 0x7f987c0b1f20 2020-04-22T14:14:17.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.341+0000 7f9881f4b700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f987c0624c0 con 0x7f9868003720 2020-04-22T14:14:17.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.341+0000 7f9881f4b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f987c151f50 con 0x7f987c062040 2020-04-22T14:14:17.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.341+0000 7f987b7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9868003720 0x7f987c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:17.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.341+0000 7f987b7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9868003720 0x7f987c062d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54622/0 (socket says 172.21.15.103:54622) 2020-04-22T14:14:17.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.341+0000 7f987b7fe700 1 -- 172.21.15.103:0/1006927010 learned_addr learned my addr 172.21.15.103:0/1006927010 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:14:17.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.341+0000 7f987affd700 1 --2- 172.21.15.103:0/1006927010 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f987c062040 0x7f987c1514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:17.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.341+0000 7f987b7fe700 1 -- 172.21.15.103:0/1006927010 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f987c062040 msgr2=0x7f987c1514c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:17.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.341+0000 7f987b7fe700 1 --2- 172.21.15.103:0/1006927010 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f987c062040 0x7f987c1514c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:17.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.341+0000 7f987b7fe700 1 -- 172.21.15.103:0/1006927010 >> v1:172.21.15.103:6789/0 conn(0x7f987c0b1f20 legacy=0x7f987c0646e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:17.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.341+0000 7f987b7fe700 1 -- 172.21.15.103:0/1006927010 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f987c1521f0 con 0x7f9868003720 2020-04-22T14:14:17.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.341+0000 7f9878ff9700 1 -- 172.21.15.103:0/1006927010 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 159262107 0 0) 0x7f987c151cb0 con 0x7f987c0b1f20 2020-04-22T14:14:17.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.341+0000 7f987affd700 1 --2- 172.21.15.103:0/1006927010 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f987c062040 0x7f987c1514c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:14:17.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.341+0000 7f987b7fe700 1 --2- 172.21.15.103:0/1006927010 >> v2:172.21.15.103:3300/0 conn(0x7f9868003720 0x7f987c062d10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f987c0b6250 tx=0x7f986c010120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:17.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.341+0000 7f987b7fe700 1 --2- 172.21.15.103:0/1006927010 >> v2:172.21.15.103:3300/0 conn(0x7f9868003720 0x7f987c062d10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f987c0b6250 tx=0x7f986c010120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:17.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.341+0000 7f987b7fe700 1 --2- 172.21.15.103:0/1006927010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9868003720 0x7f987c062d10 secure :-1 s=READY pgs=1404 cs=0 l=1 rx=0x7f987c0b6250 tx=0x7f986c010120).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:17.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.342+0000 7f987b7fe700 1 --2- 172.21.15.103:0/1006927010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9868003720 0x7f987c062d10 secure :-1 s=THROTTLE_DONE pgs=1404 cs=0 l=1 rx=0x7f987c0b6250 tx=0x7f986c010120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:17.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.342+0000 7f9878ff9700 1 -- 172.21.15.103:0/1006927010 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f986c011e30 con 0x7f9868003720 2020-04-22T14:14:17.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.342+0000 7f987b7fe700 1 --2- 172.21.15.103:0/1006927010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9868003720 0x7f987c062d10 secure :-1 s=THROTTLE_DONE pgs=1404 cs=0 l=1 rx=0x7f987c0b6250 tx=0x7f986c010120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:17.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.342+0000 7f987b7fe700 1 --2- 172.21.15.103:0/1006927010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9868003720 0x7f987c062d10 secure :-1 s=THROTTLE_DONE pgs=1404 cs=0 l=1 rx=0x7f987c0b6250 tx=0x7f986c010120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:17.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.342+0000 7f9878ff9700 1 -- 172.21.15.103:0/1006927010 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986c006c40 con 0x7f9868003720 2020-04-22T14:14:17.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.342+0000 7f9878ff9700 1 -- 172.21.15.103:0/1006927010 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f986c002750 con 0x7f9868003720 2020-04-22T14:14:17.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.342+0000 7f9881f4b700 1 -- 172.21.15.103:0/1006927010 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f987c151920 con 0x7f9868003720 2020-04-22T14:14:17.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.342+0000 7f9881f4b700 1 -- 172.21.15.103:0/1006927010 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f987c0b25f0 con 0x7f9868003720 2020-04-22T14:14:17.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.342+0000 7f987b7fe700 1 --2- 172.21.15.103:0/1006927010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9868003720 0x7f987c062d10 secure :-1 s=THROTTLE_DONE pgs=1404 cs=0 l=1 rx=0x7f987c0b6250 tx=0x7f986c010120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:17.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.343+0000 7f9881f4b700 1 -- 172.21.15.103:0/1006927010 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f987c056c90 con 0x7f9868003720 2020-04-22T14:14:17.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.343+0000 7f9878ff9700 1 -- 172.21.15.103:0/1006927010 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f986c002950 con 0x7f9868003720 2020-04-22T14:14:17.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.343+0000 7f987b7fe700 1 --2- 172.21.15.103:0/1006927010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9868003720 0x7f987c062d10 secure :-1 s=THROTTLE_DONE pgs=1404 cs=0 l=1 rx=0x7f987c0b6250 tx=0x7f986c010120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:17.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.343+0000 7f9878ff9700 1 --2- 172.21.15.103:0/1006927010 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f985c04d8d0 0x7f985c04fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:17.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.343+0000 7f9878ff9700 1 -- 172.21.15.103:0/1006927010 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f986c00b0d0 con 0x7f9868003720 2020-04-22T14:14:17.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.343+0000 7f987affd700 1 --2- 172.21.15.103:0/1006927010 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f985c04d8d0 0x7f985c04fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:17.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.343+0000 7f987affd700 1 --2- 172.21.15.103:0/1006927010 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f985c04d8d0 0x7f985c04fd90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9870002f30 tx=0x7f987000c870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:17.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.343+0000 7f987affd700 1 --2- 172.21.15.103:0/1006927010 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f985c04d8d0 0x7f985c04fd90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9870002f30 tx=0x7f987000c870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:17.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.343+0000 7f987affd700 1 --2- 172.21.15.103:0/1006927010 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f985c04d8d0 0x7f985c04fd90 secure :-1 s=READY pgs=512 cs=0 l=1 rx=0x7f9870002f30 tx=0x7f987000c870).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:17.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.347+0000 7f987b7fe700 1 --2- 172.21.15.103:0/1006927010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9868003720 0x7f987c062d10 secure :-1 s=THROTTLE_DONE pgs=1404 cs=0 l=1 rx=0x7f987c0b6250 tx=0x7f986c010120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:17.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.347+0000 7f9878ff9700 1 -- 172.21.15.103:0/1006927010 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f986c03d7e0 con 0x7f9868003720 2020-04-22T14:14:17.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:17.537+0000 7f9881f4b700 1 -- 172.21.15.103:0/1006927010 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "30"} v 0) v1 -- 0x7f987c151ab0 con 0x7f9868003720 2020-04-22T14:14:18.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.341+0000 7f987b7fe700 1 --2- 172.21.15.103:0/1006927010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9868003720 0x7f987c062d10 secure :-1 s=READY pgs=1404 cs=0 l=1 rx=0x7f987c0b6250 tx=0x7f986c010120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:18.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.522+0000 7f987b7fe700 1 --2- 172.21.15.103:0/1006927010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9868003720 0x7f987c062d10 secure :-1 s=THROTTLE_DONE pgs=1404 cs=0 l=1 rx=0x7f987c0b6250 tx=0x7f986c010120).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:18.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.522+0000 7f9878ff9700 1 -- 172.21.15.103:0/1006927010 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "30"}]=0 v65) v1 ==== 114+0+0 (secure 0 0 0) 0x7f986c040e00 con 0x7f9868003720 2020-04-22T14:14:18.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.524+0000 7f9881f4b700 1 -- 172.21.15.103:0/1006927010 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f985c04d8d0 msgr2=0x7f985c04fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:18.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.524+0000 7f9881f4b700 1 --2- 172.21.15.103:0/1006927010 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f985c04d8d0 0x7f985c04fd90 secure :-1 s=READY pgs=512 cs=0 l=1 rx=0x7f9870002f30 tx=0x7f987000c870).stop 2020-04-22T14:14:18.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.524+0000 7f9881f4b700 1 -- 172.21.15.103:0/1006927010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9868003720 msgr2=0x7f987c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:18.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.524+0000 7f9881f4b700 1 --2- 172.21.15.103:0/1006927010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9868003720 0x7f987c062d10 secure :-1 s=READY pgs=1404 cs=0 l=1 rx=0x7f987c0b6250 tx=0x7f986c010120).stop 2020-04-22T14:14:18.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.524+0000 7f9881f4b700 1 -- 172.21.15.103:0/1006927010 shutdown_connections 2020-04-22T14:14:18.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.524+0000 7f9881f4b700 1 --2- 172.21.15.103:0/1006927010 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f985c04d8d0 0x7f985c04fd90 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:18.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.524+0000 7f9881f4b700 1 --2- 172.21.15.103:0/1006927010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9868003720 0x7f987c062d10 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:18.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.524+0000 7f9881f4b700 1 --2- 172.21.15.103:0/1006927010 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f987c062040 0x7f987c1514c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:18.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.524+0000 7f9881f4b700 1 -- 172.21.15.103:0/1006927010 >> 172.21.15.103:0/1006927010 conn(0x7f987c05b7b0 msgr2=0x7f987c129570 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:18.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.524+0000 7f9881f4b700 1 -- 172.21.15.103:0/1006927010 shutdown_connections 2020-04-22T14:14:18.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.524+0000 7f9881f4b700 1 -- 172.21.15.103:0/1006927010 wait complete. 2020-04-22T14:14:18.538 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:18.554 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs session_autoclose 50 2020-04-22T14:14:18.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.711+0000 7f21b3fff700 1 Processor -- start 2020-04-22T14:14:18.714 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.711+0000 7f21b3fff700 1 -- start start 2020-04-22T14:14:18.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.712+0000 7f21b3fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f21b40b8e00 0x7f21b40af010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:18.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.712+0000 7f21b3fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f21b405fed0 0x7f21b40b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:18.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.712+0000 7f21b3fff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21b40b29b0 con 0x7f21b40b91e0 2020-04-22T14:14:18.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.712+0000 7f21b3fff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21b40b4270 con 0x7f21b40b8e00 2020-04-22T14:14:18.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.712+0000 7f21b3fff700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21b40b4510 con 0x7f21b405fed0 2020-04-22T14:14:18.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.712+0000 7f21b37fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f21b405fed0 0x7f21b40b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:18.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.712+0000 7f21b37fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f21b405fed0 0x7f21b40b1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54630/0 (socket says 172.21.15.103:54630) 2020-04-22T14:14:18.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.712+0000 7f21b37fe700 1 -- 172.21.15.103:0/2900070724 learned_addr learned my addr 172.21.15.103:0/2900070724 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:14:18.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.713+0000 7f21b2ffd700 1 --2- 172.21.15.103:0/2900070724 >> v2:172.21.15.86:3300/0 conn(0x7f21b40b8e00 0x7f21b40af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:18.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.713+0000 7f21b37fe700 1 -- 172.21.15.103:0/2900070724 >> v2:172.21.15.86:3300/0 conn(0x7f21b40b8e00 msgr2=0x7f21b40af010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:18.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.713+0000 7f21b37fe700 1 --2- 172.21.15.103:0/2900070724 >> v2:172.21.15.86:3300/0 conn(0x7f21b40b8e00 0x7f21b40af010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:18.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.713+0000 7f21b37fe700 1 -- 172.21.15.103:0/2900070724 >> v1:172.21.15.86:6789/0 conn(0x7f21b40b91e0 legacy=0x7f21b4142f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:18.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.713+0000 7f21b37fe700 1 -- 172.21.15.103:0/2900070724 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b40b2020 con 0x7f21b405fed0 2020-04-22T14:14:18.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.713+0000 7f21b37fe700 1 --2- 172.21.15.103:0/2900070724 >> v2:172.21.15.103:3300/0 conn(0x7f21b405fed0 0x7f21b40b1bc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f21b4062890 tx=0x7f21ac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:18.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.713+0000 7f21b37fe700 1 --2- 172.21.15.103:0/2900070724 >> v2:172.21.15.103:3300/0 conn(0x7f21b405fed0 0x7f21b40b1bc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f21b4062890 tx=0x7f21ac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:18.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.713+0000 7f21b37fe700 1 --2- 172.21.15.103:0/2900070724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21b405fed0 0x7f21b40b1bc0 secure :-1 s=READY pgs=1405 cs=0 l=1 rx=0x7f21b4062890 tx=0x7f21ac007dc0).ready entity=mon.1 client_cookie=f8701208a9a3a293 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:18.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.713+0000 7f21b37fe700 1 --2- 172.21.15.103:0/2900070724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21b405fed0 0x7f21b40b1bc0 secure :-1 s=THROTTLE_DONE pgs=1405 cs=0 l=1 rx=0x7f21b4062890 tx=0x7f21ac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:18.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.713+0000 7f21b1ffb700 1 -- 172.21.15.103:0/2900070724 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21ac00a180 con 0x7f21b405fed0 2020-04-22T14:14:18.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.713+0000 7f21b37fe700 1 --2- 172.21.15.103:0/2900070724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21b405fed0 0x7f21b40b1bc0 secure :-1 s=THROTTLE_DONE pgs=1405 cs=0 l=1 rx=0x7f21b4062890 tx=0x7f21ac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:18.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.713+0000 7f21b1ffb700 1 -- 172.21.15.103:0/2900070724 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21ac00a2e0 con 0x7f21b405fed0 2020-04-22T14:14:18.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.713+0000 7f21b37fe700 1 --2- 172.21.15.103:0/2900070724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21b405fed0 0x7f21b40b1bc0 secure :-1 s=THROTTLE_DONE pgs=1405 cs=0 l=1 rx=0x7f21b4062890 tx=0x7f21ac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:18.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.713+0000 7f21b1ffb700 1 -- 172.21.15.103:0/2900070724 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21ac00a6c0 con 0x7f21b405fed0 2020-04-22T14:14:18.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.713+0000 7f21b3fff700 1 -- 172.21.15.103:0/2900070724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21b405fed0 msgr2=0x7f21b40b1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:18.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.713+0000 7f21b3fff700 1 --2- 172.21.15.103:0/2900070724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21b405fed0 0x7f21b40b1bc0 secure :-1 s=READY pgs=1405 cs=0 l=1 rx=0x7f21b4062890 tx=0x7f21ac007dc0).stop 2020-04-22T14:14:18.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.714+0000 7f21b3fff700 1 -- 172.21.15.103:0/2900070724 shutdown_connections 2020-04-22T14:14:18.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.714+0000 7f21b3fff700 1 --2- 172.21.15.103:0/2900070724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21b405fed0 0x7f21b40b1bc0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:18.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.714+0000 7f21b3fff700 1 --2- 172.21.15.103:0/2900070724 >> v2:172.21.15.86:3300/0 conn(0x7f21b40b8e00 0x7f21b40af010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:18.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.714+0000 7f21b3fff700 1 -- 172.21.15.103:0/2900070724 >> 172.21.15.103:0/2900070724 conn(0x7f21b405b780 msgr2=0x7f21b40b8530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:18.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.714+0000 7f21b3fff700 1 -- 172.21.15.103:0/2900070724 shutdown_connections 2020-04-22T14:14:18.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.714+0000 7f21b3fff700 1 -- 172.21.15.103:0/2900070724 wait complete. 2020-04-22T14:14:18.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.715+0000 7f21b3fff700 1 Processor -- start 2020-04-22T14:14:18.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.715+0000 7f21b3fff700 1 -- start start 2020-04-22T14:14:18.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.715+0000 7f21b3fff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f21b405fed0 0x7f21b4064db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:18.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.715+0000 7f21b3fff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21b4065d70 con 0x7f21b40b8e00 2020-04-22T14:14:18.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.715+0000 7f21b3fff700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21b4066010 con 0x7f21b40b91e0 2020-04-22T14:14:18.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.715+0000 7f21b3fff700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b40662b0 con 0x7f21b405fed0 2020-04-22T14:14:18.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.715+0000 7f21b37fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f21b40b91e0 0x7f21b40628d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46828/0 (socket says 172.21.15.103:46828) 2020-04-22T14:14:18.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.715+0000 7f21b37fe700 1 -- 172.21.15.103:0/1002119290 learned_addr learned my addr 172.21.15.103:0/1002119290 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:14:18.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.716+0000 7f21abfff700 1 -- 172.21.15.103:0/1002119290 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2660880055 0 0) 0x7f21b4066010 con 0x7f21b40b91e0 2020-04-22T14:14:18.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.716+0000 7f21abfff700 1 -- 172.21.15.103:0/1002119290 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2198002fe0 con 0x7f21b40b91e0 2020-04-22T14:14:18.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.716+0000 7f21b2ffd700 1 --2- 172.21.15.103:0/1002119290 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f21b405fed0 0x7f21b4064db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:18.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.716+0000 7f21abfff700 1 -- 172.21.15.103:0/1002119290 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1510566773 0 0) 0x7f2198002fe0 con 0x7f21b40b91e0 2020-04-22T14:14:18.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.716+0000 7f21abfff700 1 -- 172.21.15.103:0/1002119290 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f21b4066010 con 0x7f21b40b91e0 2020-04-22T14:14:18.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.716+0000 7f21abfff700 1 -- 172.21.15.103:0/1002119290 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f21ac00ad90 con 0x7f21b40b91e0 2020-04-22T14:14:18.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.716+0000 7f21abfff700 1 -- 172.21.15.103:0/1002119290 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f21b405fed0 msgr2=0x7f21b4064db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:18.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.716+0000 7f21abfff700 1 --2- 172.21.15.103:0/1002119290 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f21b405fed0 0x7f21b4064db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:18.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.716+0000 7f21abfff700 1 -- 172.21.15.103:0/1002119290 >> v1:172.21.15.103:6789/0 conn(0x7f21b40b91e0 legacy=0x7f21b40628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:18.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.716+0000 7f21abfff700 1 -- 172.21.15.103:0/1002119290 >> v1:172.21.15.86:6789/0 conn(0x7f21b40b8e00 legacy=0x7f21b4135860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:18.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.716+0000 7f21abfff700 1 --2- 172.21.15.103:0/1002119290 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f21b405fed0 0x7f21980049b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:18.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.716+0000 7f21abfff700 1 --2- 172.21.15.103:0/1002119290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2198004e10 0x7f2198005230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:18.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.716+0000 7f21abfff700 1 --2- 172.21.15.103:0/1002119290 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2198003a30 0x7f2198003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:18.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.716+0000 7f21abfff700 1 -- 172.21.15.103:0/1002119290 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b40662b0 con 0x7f2198003a30 2020-04-22T14:14:18.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.716+0000 7f21abfff700 1 -- 172.21.15.103:0/1002119290 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2198004580 con 0x7f2198004e10 2020-04-22T14:14:18.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.716+0000 7f21abfff700 1 -- 172.21.15.103:0/1002119290 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2198004740 con 0x7f21b405fed0 2020-04-22T14:14:18.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.716+0000 7f21b27fc700 1 --2- 172.21.15.103:0/1002119290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2198004e10 0x7f2198005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:18.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.716+0000 7f21b37fe700 1 --2- 172.21.15.103:0/1002119290 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2198003a30 0x7f2198003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:18.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.716+0000 7f21b2ffd700 1 --2- 172.21.15.103:0/1002119290 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f21b405fed0 0x7f21980049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:18.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.716+0000 7f21b27fc700 1 -- 172.21.15.103:0/1002119290 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f21b405fed0 msgr2=0x7f21980049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:18.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.716+0000 7f21b27fc700 1 --2- 172.21.15.103:0/1002119290 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f21b405fed0 0x7f21980049b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:18.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.716+0000 7f21b27fc700 1 -- 172.21.15.103:0/1002119290 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2198003a30 msgr2=0x7f2198003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:18.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.716+0000 7f21b27fc700 1 --2- 172.21.15.103:0/1002119290 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2198003a30 0x7f2198003eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:18.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.716+0000 7f21b27fc700 1 -- 172.21.15.103:0/1002119290 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b4135f70 con 0x7f2198004e10 2020-04-22T14:14:18.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.716+0000 7f21b3fff700 1 -- 172.21.15.103:0/1002119290 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21b4136250 con 0x7f2198004e10 2020-04-22T14:14:18.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.716+0000 7f21b27fc700 1 --2- 172.21.15.103:0/1002119290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2198004e10 0x7f2198005230 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f21b40acd00 tx=0x7f21a4010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:18.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.716+0000 7f21b3fff700 1 -- 172.21.15.103:0/1002119290 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21b4064db0 con 0x7f2198004e10 2020-04-22T14:14:18.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.716+0000 7f21b27fc700 1 --2- 172.21.15.103:0/1002119290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2198004e10 0x7f2198005230 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f21b40acd00 tx=0x7f21a4010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:18.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.716+0000 7f21b27fc700 1 --2- 172.21.15.103:0/1002119290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2198004e10 0x7f2198005230 secure :-1 s=READY pgs=1407 cs=0 l=1 rx=0x7f21b40acd00 tx=0x7f21a4010900).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:18.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.717+0000 7f21b27fc700 1 --2- 172.21.15.103:0/1002119290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2198004e10 0x7f2198005230 secure :-1 s=THROTTLE_DONE pgs=1407 cs=0 l=1 rx=0x7f21b40acd00 tx=0x7f21a4010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:18.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.717+0000 7f21abfff700 1 -- 172.21.15.103:0/1002119290 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21a4006cc0 con 0x7f2198004e10 2020-04-22T14:14:18.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.717+0000 7f21b27fc700 1 --2- 172.21.15.103:0/1002119290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2198004e10 0x7f2198005230 secure :-1 s=THROTTLE_DONE pgs=1407 cs=0 l=1 rx=0x7f21b40acd00 tx=0x7f21a4010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:18.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.717+0000 7f21abfff700 1 -- 172.21.15.103:0/1002119290 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a4011e90 con 0x7f2198004e10 2020-04-22T14:14:18.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.717+0000 7f21b27fc700 1 --2- 172.21.15.103:0/1002119290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2198004e10 0x7f2198005230 secure :-1 s=THROTTLE_DONE pgs=1407 cs=0 l=1 rx=0x7f21b40acd00 tx=0x7f21a4010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:18.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.717+0000 7f21abfff700 1 -- 172.21.15.103:0/1002119290 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21a4006e20 con 0x7f2198004e10 2020-04-22T14:14:18.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.717+0000 7f21b27fc700 1 --2- 172.21.15.103:0/1002119290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2198004e10 0x7f2198005230 secure :-1 s=THROTTLE_DONE pgs=1407 cs=0 l=1 rx=0x7f21b40acd00 tx=0x7f21a4010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:18.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.718+0000 7f21abfff700 1 -- 172.21.15.103:0/1002119290 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f21a400a4a0 con 0x7f2198004e10 2020-04-22T14:14:18.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.718+0000 7f21b27fc700 1 --2- 172.21.15.103:0/1002119290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2198004e10 0x7f2198005230 secure :-1 s=THROTTLE_DONE pgs=1407 cs=0 l=1 rx=0x7f21b40acd00 tx=0x7f21a4010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:18.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.718+0000 7f21b3fff700 1 -- 172.21.15.103:0/1002119290 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f218c003340 con 0x7f2198004e10 2020-04-22T14:14:18.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.718+0000 7f21abfff700 1 --2- 172.21.15.103:0/1002119290 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2198055d30 0x7f21980581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:18.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.718+0000 7f21abfff700 1 -- 172.21.15.103:0/1002119290 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f21a4060f10 con 0x7f2198004e10 2020-04-22T14:14:18.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.718+0000 7f21b2ffd700 1 --2- 172.21.15.103:0/1002119290 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2198055d30 0x7f21980581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:18.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.718+0000 7f21b2ffd700 1 --2- 172.21.15.103:0/1002119290 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2198055d30 0x7f21980581f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f219c002f30 tx=0x7f219c007100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:18.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.718+0000 7f21b2ffd700 1 --2- 172.21.15.103:0/1002119290 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2198055d30 0x7f21980581f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f219c002f30 tx=0x7f219c007100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:18.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.718+0000 7f21b2ffd700 1 --2- 172.21.15.103:0/1002119290 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2198055d30 0x7f21980581f0 secure :-1 s=READY pgs=513 cs=0 l=1 rx=0x7f219c002f30 tx=0x7f219c007100).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:18.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.722+0000 7f21b27fc700 1 --2- 172.21.15.103:0/1002119290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2198004e10 0x7f2198005230 secure :-1 s=THROTTLE_DONE pgs=1407 cs=0 l=1 rx=0x7f21b40acd00 tx=0x7f21a4010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:18.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.722+0000 7f21abfff700 1 -- 172.21.15.103:0/1002119290 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f21a403c2f0 con 0x7f2198004e10 2020-04-22T14:14:18.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:18.910+0000 7f21b3fff700 1 -- 172.21.15.103:0/1002119290 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_autoclose", "val": "50"} v 0) v1 -- 0x7f218c002220 con 0x7f2198004e10 2020-04-22T14:14:19.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.521+0000 7f21b27fc700 1 --2- 172.21.15.103:0/1002119290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2198004e10 0x7f2198005230 secure :-1 s=THROTTLE_DONE pgs=1407 cs=0 l=1 rx=0x7f21b40acd00 tx=0x7f21a4010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:19.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.521+0000 7f21abfff700 1 -- 172.21.15.103:0/1002119290 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_autoclose", "val": "50"}]=0 v66) v1 ==== 116+0+0 (secure 0 0 0) 0x7f21a403f910 con 0x7f2198004e10 2020-04-22T14:14:19.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.523+0000 7f21b3fff700 1 -- 172.21.15.103:0/1002119290 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2198055d30 msgr2=0x7f21980581f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:19.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.523+0000 7f21b3fff700 1 --2- 172.21.15.103:0/1002119290 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2198055d30 0x7f21980581f0 secure :-1 s=READY pgs=513 cs=0 l=1 rx=0x7f219c002f30 tx=0x7f219c007100).stop 2020-04-22T14:14:19.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.523+0000 7f21b3fff700 1 -- 172.21.15.103:0/1002119290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2198004e10 msgr2=0x7f2198005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:19.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.523+0000 7f21b3fff700 1 --2- 172.21.15.103:0/1002119290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2198004e10 0x7f2198005230 secure :-1 s=READY pgs=1407 cs=0 l=1 rx=0x7f21b40acd00 tx=0x7f21a4010900).stop 2020-04-22T14:14:19.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.523+0000 7f21b37fe700 1 -- 172.21.15.103:0/1002119290 reap_dead start 2020-04-22T14:14:19.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.523+0000 7f21b37fe700 1 -- 172.21.15.103:0/1002119290 reap_dead start 2020-04-22T14:14:19.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.523+0000 7f21b3fff700 1 -- 172.21.15.103:0/1002119290 shutdown_connections 2020-04-22T14:14:19.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.523+0000 7f21b3fff700 1 -- 172.21.15.103:0/1002119290 >> 172.21.15.103:0/1002119290 conn(0x7f21b405b780 msgr2=0x7f21b40b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:19.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.523+0000 7f21b3fff700 1 -- 172.21.15.103:0/1002119290 shutdown_connections 2020-04-22T14:14:19.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.523+0000 7f21b3fff700 1 -- 172.21.15.103:0/1002119290 wait complete. 2020-04-22T14:14:19.535 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:19.549 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:14:19.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.693+0000 7f42cdac7700 1 Processor -- start 2020-04-22T14:14:19.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.693+0000 7f42cdac7700 1 -- start start 2020-04-22T14:14:19.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.693+0000 7f42cdac7700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42c812c0d0 0x7f42c81464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:19.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.693+0000 7f42cdac7700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f42c8063e30 0x7f42c80642a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:19.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.693+0000 7f42cdac7700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c8143300 con 0x7f42c8065fe0 2020-04-22T14:14:19.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.693+0000 7f42cdac7700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42c81435a0 con 0x7f42c8063e30 2020-04-22T14:14:19.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.693+0000 7f42cdac7700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c8143840 con 0x7f42c812c0d0 2020-04-22T14:14:19.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.693+0000 7f42c7fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f42c8063e30 0x7f42c80642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:19.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.694+0000 7f42c7fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f42c8063e30 0x7f42c80642a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54648/0 (socket says 172.21.15.103:54648) 2020-04-22T14:14:19.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.694+0000 7f42c7fff700 1 -- 172.21.15.103:0/2191590587 learned_addr learned my addr 172.21.15.103:0/2191590587 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:14:19.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.694+0000 7f42c77fe700 1 --2- 172.21.15.103:0/2191590587 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42c812c0d0 0x7f42c81464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:19.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.694+0000 7f42c7fff700 1 -- 172.21.15.103:0/2191590587 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42c812c0d0 msgr2=0x7f42c81464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:19.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.694+0000 7f42c7fff700 1 --2- 172.21.15.103:0/2191590587 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42c812c0d0 0x7f42c81464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:19.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.694+0000 7f42c7fff700 1 -- 172.21.15.103:0/2191590587 >> v1:172.21.15.86:6789/0 conn(0x7f42c8065fe0 legacy=0x7f42c805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:19.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.694+0000 7f42c7fff700 1 -- 172.21.15.103:0/2191590587 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c805bb50 con 0x7f42c8063e30 2020-04-22T14:14:19.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.694+0000 7f42c77fe700 1 --2- 172.21.15.103:0/2191590587 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42c812c0d0 0x7f42c81464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:14:19.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.694+0000 7f42c7fff700 1 --2- 172.21.15.103:0/2191590587 >> v2:172.21.15.103:3300/0 conn(0x7f42c8063e30 0x7f42c80642a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f42c80669a0 tx=0x7f42c0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:19.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.694+0000 7f42c7fff700 1 --2- 172.21.15.103:0/2191590587 >> v2:172.21.15.103:3300/0 conn(0x7f42c8063e30 0x7f42c80642a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f42c80669a0 tx=0x7f42c0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:19.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.694+0000 7f42c7fff700 1 --2- 172.21.15.103:0/2191590587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42c8063e30 0x7f42c80642a0 secure :-1 s=READY pgs=1408 cs=0 l=1 rx=0x7f42c80669a0 tx=0x7f42c0007dc0).ready entity=mon.1 client_cookie=bad4d61eeb1a8ecb server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:19.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.694+0000 7f42c7fff700 1 --2- 172.21.15.103:0/2191590587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42c8063e30 0x7f42c80642a0 secure :-1 s=THROTTLE_DONE pgs=1408 cs=0 l=1 rx=0x7f42c80669a0 tx=0x7f42c0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:19.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.694+0000 7f42c67fc700 1 -- 172.21.15.103:0/2191590587 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42c000a180 con 0x7f42c8063e30 2020-04-22T14:14:19.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.694+0000 7f42c7fff700 1 --2- 172.21.15.103:0/2191590587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42c8063e30 0x7f42c80642a0 secure :-1 s=THROTTLE_DONE pgs=1408 cs=0 l=1 rx=0x7f42c80669a0 tx=0x7f42c0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:19.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.694+0000 7f42c7fff700 1 --2- 172.21.15.103:0/2191590587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42c8063e30 0x7f42c80642a0 secure :-1 s=THROTTLE_DONE pgs=1408 cs=0 l=1 rx=0x7f42c80669a0 tx=0x7f42c0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:19.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.694+0000 7f42c67fc700 1 -- 172.21.15.103:0/2191590587 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c000a2e0 con 0x7f42c8063e30 2020-04-22T14:14:19.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.694+0000 7f42c67fc700 1 -- 172.21.15.103:0/2191590587 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42c000a700 con 0x7f42c8063e30 2020-04-22T14:14:19.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.694+0000 7f42cdac7700 1 -- 172.21.15.103:0/2191590587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42c8063e30 msgr2=0x7f42c80642a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:19.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.694+0000 7f42cdac7700 1 --2- 172.21.15.103:0/2191590587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42c8063e30 0x7f42c80642a0 secure :-1 s=READY pgs=1408 cs=0 l=1 rx=0x7f42c80669a0 tx=0x7f42c0007dc0).stop 2020-04-22T14:14:19.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.695+0000 7f42cdac7700 1 -- 172.21.15.103:0/2191590587 shutdown_connections 2020-04-22T14:14:19.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.695+0000 7f42cdac7700 1 --2- 172.21.15.103:0/2191590587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42c8063e30 0x7f42c80642a0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:19.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.695+0000 7f42cdac7700 1 --2- 172.21.15.103:0/2191590587 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42c812c0d0 0x7f42c81464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:19.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.695+0000 7f42cdac7700 1 -- 172.21.15.103:0/2191590587 >> 172.21.15.103:0/2191590587 conn(0x7f42c80b9160 msgr2=0x7f42c805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:19.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.695+0000 7f42cdac7700 1 -- 172.21.15.103:0/2191590587 shutdown_connections 2020-04-22T14:14:19.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.695+0000 7f42cdac7700 1 -- 172.21.15.103:0/2191590587 wait complete. 2020-04-22T14:14:19.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.696+0000 7f42cdac7700 1 Processor -- start 2020-04-22T14:14:19.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.696+0000 7f42cdac7700 1 -- start start 2020-04-22T14:14:19.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.696+0000 7f42cdac7700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f42c8063e30 0x7f42c80b4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:19.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.696+0000 7f42cdac7700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42c8065fe0 0x7f42c80ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:19.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.696+0000 7f42cdac7700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c80ad780 con 0x7f42c812c0d0 2020-04-22T14:14:19.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.696+0000 7f42cdac7700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42c80ad570 con 0x7f42c8063e30 2020-04-22T14:14:19.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.697+0000 7f42cdac7700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c80b1770 con 0x7f42c8065fe0 2020-04-22T14:14:19.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.697+0000 7f42c7fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f42c812c0d0 0x7f42c80b3600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46846/0 (socket says 172.21.15.103:46846) 2020-04-22T14:14:19.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.697+0000 7f42c7fff700 1 -- 172.21.15.103:0/688267965 learned_addr learned my addr 172.21.15.103:0/688267965 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:14:19.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.697+0000 7f42c77fe700 1 --2- 172.21.15.103:0/688267965 >> v2:172.21.15.86:3300/0 conn(0x7f42c8063e30 0x7f42c80b4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:19.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.697+0000 7f42c6ffd700 1 --2- 172.21.15.103:0/688267965 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42c8065fe0 0x7f42c80ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:19.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.697+0000 7f42c4ff9700 1 -- 172.21.15.103:0/688267965 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1679443163 0 0) 0x7f42c80ad780 con 0x7f42c812c0d0 2020-04-22T14:14:19.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.697+0000 7f42c4ff9700 1 -- 172.21.15.103:0/688267965 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42a8002fe0 con 0x7f42c812c0d0 2020-04-22T14:14:19.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.697+0000 7f42c77fe700 1 -- 172.21.15.103:0/688267965 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42c8065fe0 msgr2=0x7f42c80ad110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:19.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.697+0000 7f42c4ff9700 1 -- 172.21.15.103:0/688267965 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1676289916 0 0) 0x7f42a8002fe0 con 0x7f42c812c0d0 2020-04-22T14:14:19.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.697+0000 7f42c77fe700 1 --2- 172.21.15.103:0/688267965 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42c8065fe0 0x7f42c80ad110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:19.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.697+0000 7f42c77fe700 1 -- 172.21.15.103:0/688267965 >> v1:172.21.15.103:6789/0 conn(0x7f42c812c0d0 legacy=0x7f42c80b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:19.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.697+0000 7f42c77fe700 1 -- 172.21.15.103:0/688267965 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c80b1a10 con 0x7f42c8063e30 2020-04-22T14:14:19.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.697+0000 7f42c6ffd700 1 --2- 172.21.15.103:0/688267965 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42c8065fe0 0x7f42c80ad110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:14:19.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.697+0000 7f42c77fe700 1 --2- 172.21.15.103:0/688267965 >> v2:172.21.15.86:3300/0 conn(0x7f42c8063e30 0x7f42c80b4070 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f42c000af20 tx=0x7f42b8010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:19.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.697+0000 7f42c77fe700 1 --2- 172.21.15.103:0/688267965 >> v2:172.21.15.86:3300/0 conn(0x7f42c8063e30 0x7f42c80b4070 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f42c000af20 tx=0x7f42b8010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:19.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.697+0000 7f42c77fe700 1 --2- 172.21.15.103:0/688267965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42c8063e30 0x7f42c80b4070 secure :-1 s=READY pgs=753 cs=0 l=1 rx=0x7f42c000af20 tx=0x7f42b8010a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:19.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.697+0000 7f42c77fe700 1 --2- 172.21.15.103:0/688267965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42c8063e30 0x7f42c80b4070 secure :-1 s=THROTTLE_DONE pgs=753 cs=0 l=1 rx=0x7f42c000af20 tx=0x7f42b8010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:19.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.697+0000 7f42c4ff9700 1 -- 172.21.15.103:0/688267965 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42c000ad80 con 0x7f42c8063e30 2020-04-22T14:14:19.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.697+0000 7f42c77fe700 1 --2- 172.21.15.103:0/688267965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42c8063e30 0x7f42c80b4070 secure :-1 s=THROTTLE_DONE pgs=753 cs=0 l=1 rx=0x7f42c000af20 tx=0x7f42b8010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:19.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.697+0000 7f42cdac7700 1 -- 172.21.15.103:0/688267965 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42c80b3d10 con 0x7f42c8063e30 2020-04-22T14:14:19.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.697+0000 7f42c77fe700 1 --2- 172.21.15.103:0/688267965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42c8063e30 0x7f42c80b4070 secure :-1 s=THROTTLE_DONE pgs=753 cs=0 l=1 rx=0x7f42c000af20 tx=0x7f42b8010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:19.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.697+0000 7f42c4ff9700 1 -- 172.21.15.103:0/688267965 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b8009d40 con 0x7f42c8063e30 2020-04-22T14:14:19.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.697+0000 7f42c4ff9700 1 -- 172.21.15.103:0/688267965 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42b80093b0 con 0x7f42c8063e30 2020-04-22T14:14:19.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.697+0000 7f42cdac7700 1 -- 172.21.15.103:0/688267965 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c80b5680 con 0x7f42c8063e30 2020-04-22T14:14:19.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.698+0000 7f42c77fe700 1 --2- 172.21.15.103:0/688267965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42c8063e30 0x7f42c80b4070 secure :-1 s=THROTTLE_DONE pgs=753 cs=0 l=1 rx=0x7f42c000af20 tx=0x7f42b8010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:19.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.698+0000 7f42cdac7700 1 -- 172.21.15.103:0/688267965 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42c8056c90 con 0x7f42c8063e30 2020-04-22T14:14:19.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.699+0000 7f42c4ff9700 1 -- 172.21.15.103:0/688267965 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f42b80095f0 con 0x7f42c8063e30 2020-04-22T14:14:19.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.699+0000 7f42c77fe700 1 --2- 172.21.15.103:0/688267965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42c8063e30 0x7f42c80b4070 secure :-1 s=THROTTLE_DONE pgs=753 cs=0 l=1 rx=0x7f42c000af20 tx=0x7f42b8010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:19.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.699+0000 7f42c4ff9700 1 --2- 172.21.15.103:0/688267965 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f42a804dca0 0x7f42a8050160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:19.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.699+0000 7f42c4ff9700 1 -- 172.21.15.103:0/688267965 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f42b80609e0 con 0x7f42c8063e30 2020-04-22T14:14:19.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.699+0000 7f42c6ffd700 1 --2- 172.21.15.103:0/688267965 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f42a804dca0 0x7f42a8050160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:19.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.699+0000 7f42c6ffd700 1 --2- 172.21.15.103:0/688267965 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f42a804dca0 0x7f42a8050160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f42bc001f50 tx=0x7f42bc00cbc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:19.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.699+0000 7f42c6ffd700 1 --2- 172.21.15.103:0/688267965 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f42a804dca0 0x7f42a8050160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f42bc001f50 tx=0x7f42bc00cbc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:19.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.699+0000 7f42c6ffd700 1 --2- 172.21.15.103:0/688267965 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f42a804dca0 0x7f42a8050160 secure :-1 s=READY pgs=514 cs=0 l=1 rx=0x7f42bc001f50 tx=0x7f42bc00cbc0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:19.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.703+0000 7f42c77fe700 1 --2- 172.21.15.103:0/688267965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42c8063e30 0x7f42c80b4070 secure :-1 s=THROTTLE_DONE pgs=753 cs=0 l=1 rx=0x7f42c000af20 tx=0x7f42b8010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:19.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.703+0000 7f42c4ff9700 1 -- 172.21.15.103:0/688267965 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f42b803be20 con 0x7f42c8063e30 2020-04-22T14:14:19.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.892+0000 7f42cdac7700 1 -- 172.21.15.103:0/688267965 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42c8147360 con 0x7f42c8063e30 2020-04-22T14:14:19.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.893+0000 7f42c77fe700 1 --2- 172.21.15.103:0/688267965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42c8063e30 0x7f42c80b4070 secure :-1 s=THROTTLE_DONE pgs=753 cs=0 l=1 rx=0x7f42c000af20 tx=0x7f42b8010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:19.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.893+0000 7f42c4ff9700 1 -- 172.21.15.103:0/688267965 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+2142 (secure 0 0 0) 0x7f42b803f440 con 0x7f42c8063e30 2020-04-22T14:14:19.896 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:14:19.896 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":66,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5810,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/2664816107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2664816107},{"type":"v1","addr":"172.21.15.86:6835","nonce":2664816107}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":60}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:13:59.062543+0000","modified":"2020-04-22T14:14:19.519188+0000","tableserver":0,"root":0,"session_timeout":30,"session_autoclose":50,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7723},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7723":{"gid":7723,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/3220772133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3220772133},{"type":"v1","addr":"172.21.15.103:6833","nonce":3220772133}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-04-22T14:14:19.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.895+0000 7f42cdac7700 1 -- 172.21.15.103:0/688267965 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f42a804dca0 msgr2=0x7f42a8050160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:19.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.895+0000 7f42cdac7700 1 --2- 172.21.15.103:0/688267965 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f42a804dca0 0x7f42a8050160 secure :-1 s=READY pgs=514 cs=0 l=1 rx=0x7f42bc001f50 tx=0x7f42bc00cbc0).stop 2020-04-22T14:14:19.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.895+0000 7f42cdac7700 1 -- 172.21.15.103:0/688267965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42c8063e30 msgr2=0x7f42c80b4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:19.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.895+0000 7f42cdac7700 1 --2- 172.21.15.103:0/688267965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42c8063e30 0x7f42c80b4070 secure :-1 s=READY pgs=753 cs=0 l=1 rx=0x7f42c000af20 tx=0x7f42b8010a00).stop 2020-04-22T14:14:19.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.895+0000 7f42cdac7700 1 -- 172.21.15.103:0/688267965 shutdown_connections 2020-04-22T14:14:19.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.895+0000 7f42cdac7700 1 --2- 172.21.15.103:0/688267965 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f42a804dca0 0x7f42a8050160 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:19.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.895+0000 7f42cdac7700 1 --2- 172.21.15.103:0/688267965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42c8063e30 0x7f42c80b4070 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:19.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.895+0000 7f42cdac7700 1 --2- 172.21.15.103:0/688267965 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42c8065fe0 0x7f42c80ad110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:19.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.895+0000 7f42cdac7700 1 -- 172.21.15.103:0/688267965 >> 172.21.15.103:0/688267965 conn(0x7f42c80b9160 msgr2=0x7f42c805ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:19.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.895+0000 7f42cdac7700 1 -- 172.21.15.103:0/688267965 shutdown_connections 2020-04-22T14:14:19.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:19.895+0000 7f42cdac7700 1 -- 172.21.15.103:0/688267965 wait complete. 2020-04-22T14:14:19.899 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 66 2020-04-22T14:14:19.907 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:19.929 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok session ls 2020-04-22T14:14:20.088 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2020-04-22T14:14:20.088 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:14:20.088 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 7993, 2020-04-22T14:14:20.089 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": { 2020-04-22T14:14:20.089 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:14:20.089 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:14:20.089 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 7993 2020-04-22T14:14:20.089 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:20.089 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:14:20.089 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "any", 2020-04-22T14:14:20.090 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.2:0", 2020-04-22T14:14:20.090 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 2994531494 2020-04-22T14:14:20.090 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:14:20.090 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:20.090 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "open", 2020-04-22T14:14:20.090 INFO:teuthology.orchestra.run.smithi103.stdout: "num_leases": 0, 2020-04-22T14:14:20.090 INFO:teuthology.orchestra.run.smithi103.stdout: "num_caps": 1, 2020-04-22T14:14:20.091 INFO:teuthology.orchestra.run.smithi103.stdout: "request_load_avg": 1, 2020-04-22T14:14:20.091 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 4.2029187969999997, 2020-04-22T14:14:20.091 INFO:teuthology.orchestra.run.smithi103.stdout: "requests_in_flight": 0, 2020-04-22T14:14:20.091 INFO:teuthology.orchestra.run.smithi103.stdout: "completed_requests": 1, 2020-04-22T14:14:20.091 INFO:teuthology.orchestra.run.smithi103.stdout: "reconnecting": false, 2020-04-22T14:14:20.091 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps": { 2020-04-22T14:14:20.091 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:14:20.092 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 60 2020-04-22T14:14:20.092 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:20.092 INFO:teuthology.orchestra.run.smithi103.stdout: "release_caps": { 2020-04-22T14:14:20.092 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:14:20.092 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 60 2020-04-22T14:14:20.092 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:20.092 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps_throttle": { 2020-04-22T14:14:20.093 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:14:20.093 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 2.5 2020-04-22T14:14:20.093 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:20.093 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps_throttle2o": { 2020-04-22T14:14:20.093 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:14:20.093 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 0.5 2020-04-22T14:14:20.093 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:20.094 INFO:teuthology.orchestra.run.smithi103.stdout: "session_cache_liveness": { 2020-04-22T14:14:20.094 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0.99034305760723762, 2020-04-22T14:14:20.094 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 300 2020-04-22T14:14:20.094 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:20.094 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": "client.7993 192.168.0.2:0/2994531494", 2020-04-22T14:14:20.094 INFO:teuthology.orchestra.run.smithi103.stdout: "completed_requests": [ 2020-04-22T14:14:20.094 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:14:20.095 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2, 2020-04-22T14:14:20.095 INFO:teuthology.orchestra.run.smithi103.stdout: "created_ino": "0x0" 2020-04-22T14:14:20.095 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:14:20.095 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:14:20.095 INFO:teuthology.orchestra.run.smithi103.stdout: "prealloc_inos": [], 2020-04-22T14:14:20.095 INFO:teuthology.orchestra.run.smithi103.stdout: "used_inos": [], 2020-04-22T14:14:20.095 INFO:teuthology.orchestra.run.smithi103.stdout: "client_metadata": { 2020-04-22T14:14:20.096 INFO:teuthology.orchestra.run.smithi103.stdout: "client_features": { 2020-04-22T14:14:20.096 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_bits": "0x0000000000003fff" 2020-04-22T14:14:20.096 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:20.096 INFO:teuthology.orchestra.run.smithi103.stdout: "metric_spec": { 2020-04-22T14:14:20.096 INFO:teuthology.orchestra.run.smithi103.stdout: "metric_flags": { 2020-04-22T14:14:20.096 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_bits": "0x" 2020-04-22T14:14:20.096 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:14:20.097 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:20.097 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:14:20.097 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:14:20.097 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "1", 2020-04-22T14:14:20.097 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:14:20.097 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2020-04-22T14:14:20.097 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "89761", 2020-04-22T14:14:20.098 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:14:20.098 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:14:20.098 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:20.098 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:14:20.098 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 7936, 2020-04-22T14:14:20.098 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": { 2020-04-22T14:14:20.098 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:14:20.099 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:14:20.099 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 7936 2020-04-22T14:14:20.099 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:20.099 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:14:20.099 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "any", 2020-04-22T14:14:20.099 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:14:20.099 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 425900083 2020-04-22T14:14:20.100 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:14:20.100 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:20.100 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "open", 2020-04-22T14:14:20.100 INFO:teuthology.orchestra.run.smithi103.stdout: "num_leases": 0, 2020-04-22T14:14:20.100 INFO:teuthology.orchestra.run.smithi103.stdout: "num_caps": 1, 2020-04-22T14:14:20.100 INFO:teuthology.orchestra.run.smithi103.stdout: "request_load_avg": 1, 2020-04-22T14:14:20.100 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 9.9598075710000007, 2020-04-22T14:14:20.101 INFO:teuthology.orchestra.run.smithi103.stdout: "requests_in_flight": 0, 2020-04-22T14:14:20.101 INFO:teuthology.orchestra.run.smithi103.stdout: "completed_requests": 1, 2020-04-22T14:14:20.107 INFO:teuthology.orchestra.run.smithi103.stdout: "reconnecting": false, 2020-04-22T14:14:20.108 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps": { 2020-04-22T14:14:20.108 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:14:20.108 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 60 2020-04-22T14:14:20.108 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:20.108 INFO:teuthology.orchestra.run.smithi103.stdout: "release_caps": { 2020-04-22T14:14:20.108 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:14:20.108 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 60 2020-04-22T14:14:20.109 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:20.109 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps_throttle": { 2020-04-22T14:14:20.109 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:14:20.109 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 2.5 2020-04-22T14:14:20.109 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:20.109 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps_throttle2o": { 2020-04-22T14:14:20.109 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:14:20.110 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 0.5 2020-04-22T14:14:20.110 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:20.110 INFO:teuthology.orchestra.run.smithi103.stdout: "session_cache_liveness": { 2020-04-22T14:14:20.110 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0.97725748953587077, 2020-04-22T14:14:20.110 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 300 2020-04-22T14:14:20.110 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:20.110 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": "client.7936 192.168.0.1:0/425900083", 2020-04-22T14:14:20.111 INFO:teuthology.orchestra.run.smithi103.stdout: "completed_requests": [ 2020-04-22T14:14:20.111 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:14:20.111 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2, 2020-04-22T14:14:20.111 INFO:teuthology.orchestra.run.smithi103.stdout: "created_ino": "0x0" 2020-04-22T14:14:20.111 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:14:20.111 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:14:20.111 INFO:teuthology.orchestra.run.smithi103.stdout: "prealloc_inos": [], 2020-04-22T14:14:20.111 INFO:teuthology.orchestra.run.smithi103.stdout: "used_inos": [], 2020-04-22T14:14:20.112 INFO:teuthology.orchestra.run.smithi103.stdout: "client_metadata": { 2020-04-22T14:14:20.112 INFO:teuthology.orchestra.run.smithi103.stdout: "client_features": { 2020-04-22T14:14:20.112 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_bits": "0x0000000000003fff" 2020-04-22T14:14:20.112 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:20.112 INFO:teuthology.orchestra.run.smithi103.stdout: "metric_spec": { 2020-04-22T14:14:20.113 INFO:teuthology.orchestra.run.smithi103.stdout: "metric_flags": { 2020-04-22T14:14:20.113 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_bits": "0x" 2020-04-22T14:14:20.114 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:14:20.114 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:20.114 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:14:20.114 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:14:20.114 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "0", 2020-04-22T14:14:20.115 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:14:20.115 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-04-22T14:14:20.115 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "88473", 2020-04-22T14:14:20.115 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:14:20.115 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:14:20.115 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:14:20.115 INFO:teuthology.orchestra.run.smithi103.stdout:] 2020-04-22T14:14:20.116 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "id": 7993, "entity": { "name": { "type": "client", "num": 7993 }, "addr": { "type": "any", "addr": "192.168.0.2:0", "nonce": 2994531494 } }, "state": "open", "num_leases": 0, "num_caps": 1, "request_load_avg": 1, "uptime": 4.2029187969999997, "requests_in_flight": 0, "completed_requests": 1, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0.99034305760723762, "halflife": 300 }, "inst": "client.7993 192.168.0.2:0/2994531494", "completed_requests": [ { "tid": 2, "created_ino": "0x0" } ], "prealloc_inos": [], "used_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x0000000000003fff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x" } }, "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", "entity_id": "1", "hostname": "smithi103", "mount_point": "/home/ubuntu/cephtest/mnt.1", "pid": "89761", "root": "/" } }, { "id": 7936, "entity": { "name": { "type": "client", "num": 7936 }, "addr": { "type": "any", "addr": "192.168.0.1:0", "nonce": 425900083 } }, "state": "open", "num_leases": 0, "num_caps": 1, "request_load_avg": 1, "uptime": 9.9598075710000007, "requests_in_flight": 0, "completed_requests": 1, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0.97725748953587077, "halflife": 300 }, "inst": "client.7936 192.168.0.1:0/425900083", "completed_requests": [ { "tid": 2, "created_ino": "0x0" } ], "prealloc_inos": [], "used_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x0000000000003fff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x" } }, "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", "entity_id": "0", "hostname": "smithi103", "mount_point": "/home/ubuntu/cephtest/mnt.0", "pid": "88473", "root": "/" } } ] 2020-04-22T14:14:20.117 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:20.130 INFO:teuthology.orchestra.run.smithi103:> cd /home/ubuntu/cephtest/mnt.0 && sudo mkdir dir 2020-04-22T14:14:20.203 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:20.264 INFO:teuthology.orchestra.run.smithi103:> sudo kill -sigstop 88473 2020-04-22T14:14:23.232 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:14:23.249 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:14:23.292 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:23.308 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:14:52.342 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:52.360 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:14:52.517 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.514+0000 7f7e57ddb700 1 Processor -- start 2020-04-22T14:14:52.517 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.514+0000 7f7e57ddb700 1 -- start start 2020-04-22T14:14:52.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.515+0000 7f7e57ddb700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7e501441f0 0x7f7e50144820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:52.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.515+0000 7f7e57ddb700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e50144c80 0x7f7e500ad850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:52.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.515+0000 7f7e57ddb700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e500b5900 con 0x7f7e5005b7c0 2020-04-22T14:14:52.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.515+0000 7f7e57ddb700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e500b5ba0 con 0x7f7e501441f0 2020-04-22T14:14:52.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.515+0000 7f7e57ddb700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e500b5e40 con 0x7f7e50144c80 2020-04-22T14:14:52.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.515+0000 7f7e55b77700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f7e5005b7c0 0x7f7e500b50d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46850/0 (socket says 172.21.15.103:46850) 2020-04-22T14:14:52.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.515+0000 7f7e55b77700 1 -- 172.21.15.103:0/2130710731 learned_addr learned my addr 172.21.15.103:0/2130710731 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:14:52.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.515+0000 7f7e55376700 1 --2- 172.21.15.103:0/2130710731 >> v2:172.21.15.86:3300/0 conn(0x7f7e501441f0 0x7f7e50144820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:52.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.515+0000 7f7e54b75700 1 -- 172.21.15.103:0/2130710731 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 301503170 0 0) 0x7f7e500b5900 con 0x7f7e5005b7c0 2020-04-22T14:14:52.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.515+0000 7f7e56378700 1 --2- 172.21.15.103:0/2130710731 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e50144c80 0x7f7e500ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:52.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.515+0000 7f7e54b75700 1 -- 172.21.15.103:0/2130710731 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e38003230 con 0x7f7e5005b7c0 2020-04-22T14:14:52.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.515+0000 7f7e54b75700 1 -- 172.21.15.103:0/2130710731 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1100771709 0 0) 0x7f7e38003230 con 0x7f7e5005b7c0 2020-04-22T14:14:52.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.515+0000 7f7e54b75700 1 -- 172.21.15.103:0/2130710731 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e50144c80 msgr2=0x7f7e500ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:52.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.515+0000 7f7e54b75700 1 --2- 172.21.15.103:0/2130710731 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e50144c80 0x7f7e500ad850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:52.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.515+0000 7f7e54b75700 1 -- 172.21.15.103:0/2130710731 >> v2:172.21.15.86:3300/0 conn(0x7f7e501441f0 msgr2=0x7f7e50144820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:52.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.515+0000 7f7e54b75700 1 --2- 172.21.15.103:0/2130710731 >> v2:172.21.15.86:3300/0 conn(0x7f7e501441f0 0x7f7e50144820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:52.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.515+0000 7f7e54b75700 1 -- 172.21.15.103:0/2130710731 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e5005bba0 con 0x7f7e5005b7c0 2020-04-22T14:14:52.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.515+0000 7f7e54b75700 1 -- 172.21.15.103:0/2130710731 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f7e400016d0 con 0x7f7e5005b7c0 2020-04-22T14:14:52.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.515+0000 7f7e54b75700 1 -- 172.21.15.103:0/2130710731 >> v1:172.21.15.103:6789/0 conn(0x7f7e5005b7c0 legacy=0x7f7e500b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:52.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.516+0000 7f7e54b75700 1 --2- 172.21.15.103:0/2130710731 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e38003720 0x7f7e38003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:52.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.516+0000 7f7e54b75700 1 --2- 172.21.15.103:0/2130710731 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e50144c80 0x7f7e380044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:52.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.516+0000 7f7e54b75700 1 --2- 172.21.15.103:0/2130710731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e38004930 0x7f7e38004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:52.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.516+0000 7f7e54b75700 1 -- 172.21.15.103:0/2130710731 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e500b5ba0 con 0x7f7e38004930 2020-04-22T14:14:52.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.516+0000 7f7e54b75700 1 -- 172.21.15.103:0/2130710731 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e500b5e40 con 0x7f7e38003720 2020-04-22T14:14:52.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.516+0000 7f7e54b75700 1 -- 172.21.15.103:0/2130710731 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e38005380 con 0x7f7e50144c80 2020-04-22T14:14:52.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.516+0000 7f7e55b77700 1 --2- 172.21.15.103:0/2130710731 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e38003720 0x7f7e38003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:52.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.516+0000 7f7e55376700 1 --2- 172.21.15.103:0/2130710731 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e50144c80 0x7f7e380044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:52.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.516+0000 7f7e56378700 1 --2- 172.21.15.103:0/2130710731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e38004930 0x7f7e38004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:52.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.516+0000 7f7e55b77700 1 -- 172.21.15.103:0/2130710731 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e50144c80 msgr2=0x7f7e380044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:52.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.516+0000 7f7e55b77700 1 --2- 172.21.15.103:0/2130710731 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e50144c80 0x7f7e380044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:52.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.516+0000 7f7e55b77700 1 -- 172.21.15.103:0/2130710731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e38004930 msgr2=0x7f7e38004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:52.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.516+0000 7f7e55b77700 1 --2- 172.21.15.103:0/2130710731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e38004930 0x7f7e38004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:52.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.516+0000 7f7e55b77700 1 -- 172.21.15.103:0/2130710731 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e38003230 con 0x7f7e38003720 2020-04-22T14:14:52.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.516+0000 7f7e56378700 1 --2- 172.21.15.103:0/2130710731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e38004930 0x7f7e38004db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:14:52.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.516+0000 7f7e55b77700 1 --2- 172.21.15.103:0/2130710731 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e38003720 0x7f7e38003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7e400013e0 tx=0x7f7e5005bd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:52.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.516+0000 7f7e55b77700 1 --2- 172.21.15.103:0/2130710731 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e38003720 0x7f7e38003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7e400013e0 tx=0x7f7e5005bd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:52.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.516+0000 7f7e55b77700 1 --2- 172.21.15.103:0/2130710731 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e38003720 0x7f7e38003b40 secure :-1 s=READY pgs=1411 cs=0 l=1 rx=0x7f7e400013e0 tx=0x7f7e5005bd30).ready entity=mon.1 client_cookie=c632fbfae1b161b3 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:52.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.516+0000 7f7e55b77700 1 --2- 172.21.15.103:0/2130710731 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e38003720 0x7f7e38003b40 secure :-1 s=THROTTLE_DONE pgs=1411 cs=0 l=1 rx=0x7f7e400013e0 tx=0x7f7e5005bd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:52.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.516+0000 7f7e55b77700 1 --2- 172.21.15.103:0/2130710731 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e38003720 0x7f7e38003b40 secure :-1 s=THROTTLE_DONE pgs=1411 cs=0 l=1 rx=0x7f7e400013e0 tx=0x7f7e5005bd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:52.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.516+0000 7f7e54b75700 1 -- 172.21.15.103:0/2130710731 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e4000e180 con 0x7f7e38003720 2020-04-22T14:14:52.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.516+0000 7f7e55b77700 1 --2- 172.21.15.103:0/2130710731 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e38003720 0x7f7e38003b40 secure :-1 s=THROTTLE_DONE pgs=1411 cs=0 l=1 rx=0x7f7e400013e0 tx=0x7f7e5005bd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:52.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.516+0000 7f7e54b75700 1 -- 172.21.15.103:0/2130710731 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e4000e320 con 0x7f7e38003720 2020-04-22T14:14:52.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.516+0000 7f7e54b75700 1 -- 172.21.15.103:0/2130710731 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e4000e6c0 con 0x7f7e38003720 2020-04-22T14:14:52.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.516+0000 7f7e57ddb700 1 -- 172.21.15.103:0/2130710731 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e38003720 msgr2=0x7f7e38003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:52.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.516+0000 7f7e57ddb700 1 --2- 172.21.15.103:0/2130710731 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e38003720 0x7f7e38003b40 secure :-1 s=READY pgs=1411 cs=0 l=1 rx=0x7f7e400013e0 tx=0x7f7e5005bd30).stop 2020-04-22T14:14:52.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.516+0000 7f7e56378700 1 -- 172.21.15.103:0/2130710731 reap_dead start 2020-04-22T14:14:52.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.517+0000 7f7e57ddb700 1 -- 172.21.15.103:0/2130710731 shutdown_connections 2020-04-22T14:14:52.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.517+0000 7f7e57ddb700 1 -- 172.21.15.103:0/2130710731 >> 172.21.15.103:0/2130710731 conn(0x7f7e500b9160 msgr2=0x7f7e5005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:52.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.517+0000 7f7e57ddb700 1 -- 172.21.15.103:0/2130710731 shutdown_connections 2020-04-22T14:14:52.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.517+0000 7f7e57ddb700 1 -- 172.21.15.103:0/2130710731 wait complete. 2020-04-22T14:14:52.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.518+0000 7f7e57ddb700 1 Processor -- start 2020-04-22T14:14:52.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.518+0000 7f7e57ddb700 1 -- start start 2020-04-22T14:14:52.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.518+0000 7f7e57ddb700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e50140580 0x7f7e500aef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:52.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.518+0000 7f7e57ddb700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7e50140960 0x7f7e500af370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:52.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.518+0000 7f7e57ddb700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e501471c0 con 0x7f7e5013cb60 2020-04-22T14:14:52.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.518+0000 7f7e57ddb700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e500af890 con 0x7f7e50140960 2020-04-22T14:14:52.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.518+0000 7f7e57ddb700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e500afb30 con 0x7f7e50140580 2020-04-22T14:14:52.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.519+0000 7f7e55376700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7e50140960 0x7f7e500af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:52.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.519+0000 7f7e55376700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7e50140960 0x7f7e500af370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54674/0 (socket says 172.21.15.103:54674) 2020-04-22T14:14:52.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.519+0000 7f7e55376700 1 -- 172.21.15.103:0/40574597 learned_addr learned my addr 172.21.15.103:0/40574597 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:14:52.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.519+0000 7f7e55b77700 1 --2- 172.21.15.103:0/40574597 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e50140580 0x7f7e500aef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:52.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.519+0000 7f7e55376700 1 -- 172.21.15.103:0/40574597 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e50140580 msgr2=0x7f7e500aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:52.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.519+0000 7f7e55376700 1 --2- 172.21.15.103:0/40574597 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e50140580 0x7f7e500aef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:52.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.519+0000 7f7e55376700 1 -- 172.21.15.103:0/40574597 >> v1:172.21.15.86:6789/0 conn(0x7f7e5013cb60 legacy=0x7f7e50151670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:52.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.519+0000 7f7e55376700 1 -- 172.21.15.103:0/40574597 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e50146070 con 0x7f7e50140960 2020-04-22T14:14:52.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.519+0000 7f7e55376700 1 --2- 172.21.15.103:0/40574597 >> v2:172.21.15.103:3300/0 conn(0x7f7e50140960 0x7f7e500af370 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7e4c007ed0 tx=0x7f7e4c010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:52.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.519+0000 7f7e55376700 1 --2- 172.21.15.103:0/40574597 >> v2:172.21.15.103:3300/0 conn(0x7f7e50140960 0x7f7e500af370 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7e4c007ed0 tx=0x7f7e4c010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:52.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.519+0000 7f7e55376700 1 --2- 172.21.15.103:0/40574597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e50140960 0x7f7e500af370 secure :-1 s=READY pgs=1412 cs=0 l=1 rx=0x7f7e4c007ed0 tx=0x7f7e4c010d00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:52.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.519+0000 7f7e55376700 1 --2- 172.21.15.103:0/40574597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e50140960 0x7f7e500af370 secure :-1 s=THROTTLE_DONE pgs=1412 cs=0 l=1 rx=0x7f7e4c007ed0 tx=0x7f7e4c010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:52.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.519+0000 7f7e55376700 1 --2- 172.21.15.103:0/40574597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e50140960 0x7f7e500af370 secure :-1 s=THROTTLE_DONE pgs=1412 cs=0 l=1 rx=0x7f7e4c007ed0 tx=0x7f7e4c010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:52.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.519+0000 7f7e3effd700 1 -- 172.21.15.103:0/40574597 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e4c00ca50 con 0x7f7e50140960 2020-04-22T14:14:52.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.519+0000 7f7e55376700 1 --2- 172.21.15.103:0/40574597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e50140960 0x7f7e500af370 secure :-1 s=THROTTLE_DONE pgs=1412 cs=0 l=1 rx=0x7f7e4c007ed0 tx=0x7f7e4c010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:52.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.519+0000 7f7e3effd700 1 -- 172.21.15.103:0/40574597 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e4c00cbf0 con 0x7f7e50140960 2020-04-22T14:14:52.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.519+0000 7f7e57ddb700 1 -- 172.21.15.103:0/40574597 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e50154e00 con 0x7f7e50140960 2020-04-22T14:14:52.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.519+0000 7f7e3effd700 1 -- 172.21.15.103:0/40574597 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e4c00ce20 con 0x7f7e50140960 2020-04-22T14:14:52.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.519+0000 7f7e57ddb700 1 -- 172.21.15.103:0/40574597 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e5013d190 con 0x7f7e50140960 2020-04-22T14:14:52.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.520+0000 7f7e55376700 1 --2- 172.21.15.103:0/40574597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e50140960 0x7f7e500af370 secure :-1 s=THROTTLE_DONE pgs=1412 cs=0 l=1 rx=0x7f7e4c007ed0 tx=0x7f7e4c010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:52.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.521+0000 7f7e3effd700 1 -- 172.21.15.103:0/40574597 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f7e4c0071a0 con 0x7f7e50140960 2020-04-22T14:14:52.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.521+0000 7f7e55376700 1 --2- 172.21.15.103:0/40574597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e50140960 0x7f7e500af370 secure :-1 s=THROTTLE_DONE pgs=1412 cs=0 l=1 rx=0x7f7e4c007ed0 tx=0x7f7e4c010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:52.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.521+0000 7f7e57ddb700 1 -- 172.21.15.103:0/40574597 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e50056c90 con 0x7f7e50140960 2020-04-22T14:14:52.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.521+0000 7f7e3effd700 1 --2- 172.21.15.103:0/40574597 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7e3004d970 0x7f7e3004fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:52.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.521+0000 7f7e3effd700 1 -- 172.21.15.103:0/40574597 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7e4c0614a0 con 0x7f7e50140960 2020-04-22T14:14:52.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.521+0000 7f7e55b77700 1 --2- 172.21.15.103:0/40574597 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7e3004d970 0x7f7e3004fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:52.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.521+0000 7f7e55b77700 1 --2- 172.21.15.103:0/40574597 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7e3004d970 0x7f7e3004fe30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7e400013e0 tx=0x7f7e5005bd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:52.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.521+0000 7f7e55b77700 1 --2- 172.21.15.103:0/40574597 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7e3004d970 0x7f7e3004fe30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7e400013e0 tx=0x7f7e5005bd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:52.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.521+0000 7f7e55b77700 1 --2- 172.21.15.103:0/40574597 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7e3004d970 0x7f7e3004fe30 secure :-1 s=READY pgs=515 cs=0 l=1 rx=0x7f7e400013e0 tx=0x7f7e5005bd30).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:52.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.525+0000 7f7e55376700 1 --2- 172.21.15.103:0/40574597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e50140960 0x7f7e500af370 secure :-1 s=THROTTLE_DONE pgs=1412 cs=0 l=1 rx=0x7f7e4c007ed0 tx=0x7f7e4c010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:52.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.525+0000 7f7e3effd700 1 -- 172.21.15.103:0/40574597 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f7e4c03c8e0 con 0x7f7e50140960 2020-04-22T14:14:52.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.715+0000 7f7e57ddb700 1 -- 172.21.15.103:0/40574597 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7e50154f90 con 0x7f7e50140960 2020-04-22T14:14:52.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.715+0000 7f7e55376700 1 --2- 172.21.15.103:0/40574597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e50140960 0x7f7e500af370 secure :-1 s=THROTTLE_DONE pgs=1412 cs=0 l=1 rx=0x7f7e4c007ed0 tx=0x7f7e4c010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:52.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.715+0000 7f7e3effd700 1 -- 172.21.15.103:0/40574597 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+2142 (secure 0 0 0) 0x7f7e4c03ff00 con 0x7f7e50140960 2020-04-22T14:14:52.719 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:14:52.719 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":66,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5810,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/2664816107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2664816107},{"type":"v1","addr":"172.21.15.86:6835","nonce":2664816107}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":60}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:13:59.062543+0000","modified":"2020-04-22T14:14:19.519188+0000","tableserver":0,"root":0,"session_timeout":30,"session_autoclose":50,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7723},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7723":{"gid":7723,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/3220772133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3220772133},{"type":"v1","addr":"172.21.15.103:6833","nonce":3220772133}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-04-22T14:14:52.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.717+0000 7f7e57ddb700 1 -- 172.21.15.103:0/40574597 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7e3004d970 msgr2=0x7f7e3004fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:52.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.717+0000 7f7e57ddb700 1 --2- 172.21.15.103:0/40574597 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7e3004d970 0x7f7e3004fe30 secure :-1 s=READY pgs=515 cs=0 l=1 rx=0x7f7e400013e0 tx=0x7f7e5005bd30).stop 2020-04-22T14:14:52.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.717+0000 7f7e57ddb700 1 -- 172.21.15.103:0/40574597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e50140960 msgr2=0x7f7e500af370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:52.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.717+0000 7f7e57ddb700 1 --2- 172.21.15.103:0/40574597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e50140960 0x7f7e500af370 secure :-1 s=READY pgs=1412 cs=0 l=1 rx=0x7f7e4c007ed0 tx=0x7f7e4c010d00).stop 2020-04-22T14:14:52.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.717+0000 7f7e57ddb700 1 -- 172.21.15.103:0/40574597 shutdown_connections 2020-04-22T14:14:52.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.717+0000 7f7e57ddb700 1 --2- 172.21.15.103:0/40574597 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7e3004d970 0x7f7e3004fe30 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:52.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.717+0000 7f7e57ddb700 1 --2- 172.21.15.103:0/40574597 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e50140580 0x7f7e500aef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:52.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.717+0000 7f7e57ddb700 1 --2- 172.21.15.103:0/40574597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e50140960 0x7f7e500af370 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:52.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.717+0000 7f7e57ddb700 1 -- 172.21.15.103:0/40574597 >> 172.21.15.103:0/40574597 conn(0x7f7e500b9160 msgr2=0x7f7e500b65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:52.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.717+0000 7f7e57ddb700 1 -- 172.21.15.103:0/40574597 shutdown_connections 2020-04-22T14:14:52.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:52.717+0000 7f7e57ddb700 1 -- 172.21.15.103:0/40574597 wait complete. 2020-04-22T14:14:52.722 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 66 2020-04-22T14:14:52.730 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:52.753 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok session ls 2020-04-22T14:14:52.904 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2020-04-22T14:14:52.904 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:14:52.905 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 7993, 2020-04-22T14:14:52.905 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": { 2020-04-22T14:14:52.905 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:14:52.905 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:14:52.905 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 7993 2020-04-22T14:14:52.905 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:52.906 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:14:52.906 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "any", 2020-04-22T14:14:52.906 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.2:0", 2020-04-22T14:14:52.906 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 2994531494 2020-04-22T14:14:52.909 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:14:52.909 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:52.909 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "open", 2020-04-22T14:14:52.909 INFO:teuthology.orchestra.run.smithi103.stdout: "num_leases": 0, 2020-04-22T14:14:52.910 INFO:teuthology.orchestra.run.smithi103.stdout: "num_caps": 1, 2020-04-22T14:14:52.910 INFO:teuthology.orchestra.run.smithi103.stdout: "request_load_avg": 1, 2020-04-22T14:14:52.910 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 37.018283472999997, 2020-04-22T14:14:52.910 INFO:teuthology.orchestra.run.smithi103.stdout: "requests_in_flight": 0, 2020-04-22T14:14:52.910 INFO:teuthology.orchestra.run.smithi103.stdout: "completed_requests": 1, 2020-04-22T14:14:52.910 INFO:teuthology.orchestra.run.smithi103.stdout: "reconnecting": false, 2020-04-22T14:14:52.911 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps": { 2020-04-22T14:14:52.911 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:14:52.911 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 60 2020-04-22T14:14:52.911 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:52.911 INFO:teuthology.orchestra.run.smithi103.stdout: "release_caps": { 2020-04-22T14:14:52.911 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:14:52.911 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 60 2020-04-22T14:14:52.912 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:52.912 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps_throttle": { 2020-04-22T14:14:52.912 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:14:52.912 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 2.5 2020-04-22T14:14:52.912 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:52.912 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps_throttle2o": { 2020-04-22T14:14:52.912 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:14:52.913 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 0.5 2020-04-22T14:14:52.913 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:52.913 INFO:teuthology.orchestra.run.smithi103.stdout: "session_cache_liveness": { 2020-04-22T14:14:52.913 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 2.7724675569568795, 2020-04-22T14:14:52.913 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 300 2020-04-22T14:14:52.913 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:52.913 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": "client.7993 192.168.0.2:0/2994531494", 2020-04-22T14:14:52.914 INFO:teuthology.orchestra.run.smithi103.stdout: "completed_requests": [ 2020-04-22T14:14:52.914 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:14:52.914 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2, 2020-04-22T14:14:52.914 INFO:teuthology.orchestra.run.smithi103.stdout: "created_ino": "0x0" 2020-04-22T14:14:52.914 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:14:52.914 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:14:52.914 INFO:teuthology.orchestra.run.smithi103.stdout: "prealloc_inos": [], 2020-04-22T14:14:52.915 INFO:teuthology.orchestra.run.smithi103.stdout: "used_inos": [], 2020-04-22T14:14:52.915 INFO:teuthology.orchestra.run.smithi103.stdout: "client_metadata": { 2020-04-22T14:14:52.915 INFO:teuthology.orchestra.run.smithi103.stdout: "client_features": { 2020-04-22T14:14:52.915 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_bits": "0x0000000000003fff" 2020-04-22T14:14:52.915 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:52.915 INFO:teuthology.orchestra.run.smithi103.stdout: "metric_spec": { 2020-04-22T14:14:52.915 INFO:teuthology.orchestra.run.smithi103.stdout: "metric_flags": { 2020-04-22T14:14:52.915 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_bits": "0x" 2020-04-22T14:14:52.916 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:14:52.916 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:52.916 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:14:52.916 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:14:52.916 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "1", 2020-04-22T14:14:52.916 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:14:52.916 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2020-04-22T14:14:52.917 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "89761", 2020-04-22T14:14:52.917 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:14:52.917 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:14:52.917 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:52.917 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:14:52.918 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 7936, 2020-04-22T14:14:52.918 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": { 2020-04-22T14:14:52.918 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:14:52.918 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:14:52.918 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 7936 2020-04-22T14:14:52.918 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:52.918 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:14:52.919 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "any", 2020-04-22T14:14:52.919 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:14:52.919 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 425900083 2020-04-22T14:14:52.919 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:14:52.919 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:52.919 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "open", 2020-04-22T14:14:52.919 INFO:teuthology.orchestra.run.smithi103.stdout: "num_leases": 0, 2020-04-22T14:14:52.920 INFO:teuthology.orchestra.run.smithi103.stdout: "num_caps": 2, 2020-04-22T14:14:52.920 INFO:teuthology.orchestra.run.smithi103.stdout: "request_load_avg": 2, 2020-04-22T14:14:52.920 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 42.775172247, 2020-04-22T14:14:52.920 INFO:teuthology.orchestra.run.smithi103.stdout: "requests_in_flight": 0, 2020-04-22T14:14:52.920 INFO:teuthology.orchestra.run.smithi103.stdout: "completed_requests": 1, 2020-04-22T14:14:52.920 INFO:teuthology.orchestra.run.smithi103.stdout: "reconnecting": false, 2020-04-22T14:14:52.920 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps": { 2020-04-22T14:14:52.921 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:14:52.921 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 60 2020-04-22T14:14:52.921 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:52.921 INFO:teuthology.orchestra.run.smithi103.stdout: "release_caps": { 2020-04-22T14:14:52.921 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:14:52.921 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 60 2020-04-22T14:14:52.921 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:52.921 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps_throttle": { 2020-04-22T14:14:52.922 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:14:52.922 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 2.5 2020-04-22T14:14:52.922 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:52.922 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps_throttle2o": { 2020-04-22T14:14:52.922 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:14:52.922 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 0.5 2020-04-22T14:14:52.922 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:52.923 INFO:teuthology.orchestra.run.smithi103.stdout: "session_cache_liveness": { 2020-04-22T14:14:52.923 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 3.6875650703008844, 2020-04-22T14:14:52.924 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 300 2020-04-22T14:14:52.924 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:52.925 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": "client.7936 192.168.0.1:0/425900083", 2020-04-22T14:14:52.925 INFO:teuthology.orchestra.run.smithi103.stdout: "completed_requests": [ 2020-04-22T14:14:52.925 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:14:52.925 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 4, 2020-04-22T14:14:52.925 INFO:teuthology.orchestra.run.smithi103.stdout: "created_ino": "0x10000000000" 2020-04-22T14:14:52.925 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:14:52.925 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:14:52.926 INFO:teuthology.orchestra.run.smithi103.stdout: "prealloc_inos": [ 2020-04-22T14:14:52.926 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:14:52.926 INFO:teuthology.orchestra.run.smithi103.stdout: "start": "0x10000000001", 2020-04-22T14:14:52.926 INFO:teuthology.orchestra.run.smithi103.stdout: "length": 1000 2020-04-22T14:14:52.926 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:14:52.926 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:14:52.926 INFO:teuthology.orchestra.run.smithi103.stdout: "used_inos": [], 2020-04-22T14:14:52.927 INFO:teuthology.orchestra.run.smithi103.stdout: "client_metadata": { 2020-04-22T14:14:52.927 INFO:teuthology.orchestra.run.smithi103.stdout: "client_features": { 2020-04-22T14:14:52.927 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_bits": "0x0000000000003fff" 2020-04-22T14:14:52.927 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:52.927 INFO:teuthology.orchestra.run.smithi103.stdout: "metric_spec": { 2020-04-22T14:14:52.927 INFO:teuthology.orchestra.run.smithi103.stdout: "metric_flags": { 2020-04-22T14:14:52.927 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_bits": "0x" 2020-04-22T14:14:52.927 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:14:52.928 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:52.928 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:14:52.928 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:14:52.928 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "0", 2020-04-22T14:14:52.928 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:14:52.928 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-04-22T14:14:52.929 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "88473", 2020-04-22T14:14:52.929 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:14:52.929 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:14:52.929 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:14:52.929 INFO:teuthology.orchestra.run.smithi103.stdout:] 2020-04-22T14:14:52.930 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "id": 7993, "entity": { "name": { "type": "client", "num": 7993 }, "addr": { "type": "any", "addr": "192.168.0.2:0", "nonce": 2994531494 } }, "state": "open", "num_leases": 0, "num_caps": 1, "request_load_avg": 1, "uptime": 37.018283472999997, "requests_in_flight": 0, "completed_requests": 1, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 2.7724675569568795, "halflife": 300 }, "inst": "client.7993 192.168.0.2:0/2994531494", "completed_requests": [ { "tid": 2, "created_ino": "0x0" } ], "prealloc_inos": [], "used_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x0000000000003fff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x" } }, "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", "entity_id": "1", "hostname": "smithi103", "mount_point": "/home/ubuntu/cephtest/mnt.1", "pid": "89761", "root": "/" } }, { "id": 7936, "entity": { "name": { "type": "client", "num": 7936 }, "addr": { "type": "any", "addr": "192.168.0.1:0", "nonce": 425900083 } }, "state": "open", "num_leases": 0, "num_caps": 2, "request_load_avg": 2, "uptime": 42.775172247, "requests_in_flight": 0, "completed_requests": 1, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 3.6875650703008844, "halflife": 300 }, "inst": "client.7936 192.168.0.1:0/425900083", "completed_requests": [ { "tid": 4, "created_ino": "0x10000000000" } ], "prealloc_inos": [ { "start": "0x10000000001", "length": 1000 } ], "used_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x0000000000003fff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x" } }, "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", "entity_id": "0", "hostname": "smithi103", "mount_point": "/home/ubuntu/cephtest/mnt.0", "pid": "88473", "root": "/" } } ] 2020-04-22T14:14:52.930 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:52.944 INFO:teuthology.orchestra.run.smithi103:> cd /home/ubuntu/cephtest/mnt.1 && sudo stat dir 2020-04-22T14:14:53.424 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:14:53.446 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:14:53.490 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:53.507 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:14:54.603 INFO:teuthology.orchestra.run.smithi103.stdout: File: dir 2020-04-22T14:14:54.604 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 0 Blocks: 1 IO Block: 4096 directory 2020-04-22T14:14:54.604 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 31h/49d Inode: 1099511627776 Links: 2 2020-04-22T14:14:54.604 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-22T14:14:54.604 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:fusefs_t:s0 2020-04-22T14:14:54.604 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2020-04-22 14:14:20.196040737 +0000 2020-04-22T14:14:54.604 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2020-04-22 14:14:20.196040737 +0000 2020-04-22T14:14:54.605 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2020-04-22 14:14:20.196040737 +0000 2020-04-22T14:14:54.605 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: - 2020-04-22T14:14:54.606 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:54.621 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:14:54.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.775+0000 7f9bd6626700 1 Processor -- start 2020-04-22T14:14:54.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.775+0000 7f9bd6626700 1 -- start start 2020-04-22T14:14:54.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.776+0000 7f9bd6626700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9bd00665a0 0x7f9bd014a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:54.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.776+0000 7f9bd6626700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9bd00b4ec0 0x7f9bd00b5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:54.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.776+0000 7f9bd6626700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bd00651f0 con 0x7f9bd005b7c0 2020-04-22T14:14:54.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.776+0000 7f9bd6626700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bd0066b90 con 0x7f9bd00665a0 2020-04-22T14:14:54.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.776+0000 7f9bd6626700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd0066e30 con 0x7f9bd00b4ec0 2020-04-22T14:14:54.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.776+0000 7f9bc7fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9bd00665a0 0x7f9bd014a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:54.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.776+0000 7f9bcffff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f9bd005b7c0 0x7f9bd01336b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46870/0 (socket says 172.21.15.103:46870) 2020-04-22T14:14:54.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.776+0000 7f9bcffff700 1 -- 172.21.15.103:0/1989068636 learned_addr learned my addr 172.21.15.103:0/1989068636 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:14:54.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.777+0000 7f9bc7fff700 1 -- 172.21.15.103:0/1989068636 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9bd00b4ec0 msgr2=0x7f9bd00b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:54.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.777+0000 7f9bd4bc3700 1 --2- 172.21.15.103:0/1989068636 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9bd00b4ec0 0x7f9bd00b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:54.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.777+0000 7f9bc7fff700 1 --2- 172.21.15.103:0/1989068636 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9bd00b4ec0 0x7f9bd00b5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:54.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.777+0000 7f9bc7fff700 1 -- 172.21.15.103:0/1989068636 >> v1:172.21.15.103:6789/0 conn(0x7f9bd005b7c0 legacy=0x7f9bd01336b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:54.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.777+0000 7f9bcf7fe700 1 -- 172.21.15.103:0/1989068636 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3153704355 0 0) 0x7f9bd00651f0 con 0x7f9bd005b7c0 2020-04-22T14:14:54.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.777+0000 7f9bc7fff700 1 -- 172.21.15.103:0/1989068636 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd00670d0 con 0x7f9bd00665a0 2020-04-22T14:14:54.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.777+0000 7f9bc7fff700 1 --2- 172.21.15.103:0/1989068636 >> v2:172.21.15.103:3300/0 conn(0x7f9bd00665a0 0x7f9bd014a640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9bb8002f30 tx=0x7f9bb8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:54.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.777+0000 7f9bc7fff700 1 --2- 172.21.15.103:0/1989068636 >> v2:172.21.15.103:3300/0 conn(0x7f9bd00665a0 0x7f9bd014a640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9bb8002f30 tx=0x7f9bb8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:54.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.777+0000 7f9bc7fff700 1 --2- 172.21.15.103:0/1989068636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bd00665a0 0x7f9bd014a640 secure :-1 s=READY pgs=1414 cs=0 l=1 rx=0x7f9bb8002f30 tx=0x7f9bb8007a40).ready entity=mon.1 client_cookie=a22f2658824312a2 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:54.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.777+0000 7f9bc7fff700 1 --2- 172.21.15.103:0/1989068636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bd00665a0 0x7f9bd014a640 secure :-1 s=THROTTLE_DONE pgs=1414 cs=0 l=1 rx=0x7f9bb8002f30 tx=0x7f9bb8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:54.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.777+0000 7f9bcf7fe700 1 -- 172.21.15.103:0/1989068636 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bb8011470 con 0x7f9bd00665a0 2020-04-22T14:14:54.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.777+0000 7f9bc7fff700 1 --2- 172.21.15.103:0/1989068636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bd00665a0 0x7f9bd014a640 secure :-1 s=THROTTLE_DONE pgs=1414 cs=0 l=1 rx=0x7f9bb8002f30 tx=0x7f9bb8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:54.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.777+0000 7f9bcf7fe700 1 -- 172.21.15.103:0/1989068636 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb8011610 con 0x7f9bd00665a0 2020-04-22T14:14:54.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.777+0000 7f9bc7fff700 1 --2- 172.21.15.103:0/1989068636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bd00665a0 0x7f9bd014a640 secure :-1 s=THROTTLE_DONE pgs=1414 cs=0 l=1 rx=0x7f9bb8002f30 tx=0x7f9bb8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:54.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.777+0000 7f9bcf7fe700 1 -- 172.21.15.103:0/1989068636 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bb80119f0 con 0x7f9bd00665a0 2020-04-22T14:14:54.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.777+0000 7f9bd6626700 1 -- 172.21.15.103:0/1989068636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bd00665a0 msgr2=0x7f9bd014a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:54.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.777+0000 7f9bd6626700 1 --2- 172.21.15.103:0/1989068636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bd00665a0 0x7f9bd014a640 secure :-1 s=READY pgs=1414 cs=0 l=1 rx=0x7f9bb8002f30 tx=0x7f9bb8007a40).stop 2020-04-22T14:14:54.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.777+0000 7f9bd6626700 1 -- 172.21.15.103:0/1989068636 shutdown_connections 2020-04-22T14:14:54.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.777+0000 7f9bd6626700 1 --2- 172.21.15.103:0/1989068636 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9bd00b4ec0 0x7f9bd00b5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:54.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.777+0000 7f9bd6626700 1 --2- 172.21.15.103:0/1989068636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bd00665a0 0x7f9bd014a640 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:54.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.777+0000 7f9bd6626700 1 -- 172.21.15.103:0/1989068636 >> 172.21.15.103:0/1989068636 conn(0x7f9bd00b9160 msgr2=0x7f9bd005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:54.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.777+0000 7f9bd6626700 1 -- 172.21.15.103:0/1989068636 shutdown_connections 2020-04-22T14:14:54.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.777+0000 7f9bd6626700 1 -- 172.21.15.103:0/1989068636 wait complete. 2020-04-22T14:14:54.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.778+0000 7f9bd6626700 1 Processor -- start 2020-04-22T14:14:54.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.778+0000 7f9bd6626700 1 -- start start 2020-04-22T14:14:54.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.779+0000 7f9bd6626700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9bd00665a0 0x7f9bd00b1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:54.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.779+0000 7f9bd6626700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bd00aee60 con 0x7f9bd00b4ec0 2020-04-22T14:14:54.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.779+0000 7f9bd6626700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bd00afb00 con 0x7f9bd005b7c0 2020-04-22T14:14:54.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.779+0000 7f9bd6626700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bd00afda0 con 0x7f9bd00665a0 2020-04-22T14:14:54.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.779+0000 7f9bcffff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f9bd005b7c0 0x7f9bd00ae010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46876/0 (socket says 172.21.15.103:46876) 2020-04-22T14:14:54.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.779+0000 7f9bcffff700 1 -- 172.21.15.103:0/2183479875 learned_addr learned my addr 172.21.15.103:0/2183479875 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:14:54.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.779+0000 7f9bcdffb700 1 -- 172.21.15.103:0/2183479875 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 94749130 0 0) 0x7f9bd00afb00 con 0x7f9bd005b7c0 2020-04-22T14:14:54.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.779+0000 7f9bcdffb700 1 -- 172.21.15.103:0/2183479875 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bb4002fe0 con 0x7f9bd005b7c0 2020-04-22T14:14:54.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.779+0000 7f9bc7fff700 1 --2- 172.21.15.103:0/2183479875 >> v2:172.21.15.86:3300/0 conn(0x7f9bd00665a0 0x7f9bd00b1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:54.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.780+0000 7f9bcdffb700 1 -- 172.21.15.103:0/2183479875 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3451911722 0 0) 0x7f9bb4002fe0 con 0x7f9bd005b7c0 2020-04-22T14:14:54.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.780+0000 7f9bcdffb700 1 -- 172.21.15.103:0/2183479875 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9bd00afb00 con 0x7f9bd005b7c0 2020-04-22T14:14:54.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.780+0000 7f9bcdffb700 1 -- 172.21.15.103:0/2183479875 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f9bc0001860 con 0x7f9bd005b7c0 2020-04-22T14:14:54.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.780+0000 7f9bcdffb700 1 -- 172.21.15.103:0/2183479875 >> v2:172.21.15.86:3300/0 conn(0x7f9bd00665a0 msgr2=0x7f9bd00b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:54.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.780+0000 7f9bcdffb700 1 --2- 172.21.15.103:0/2183479875 >> v2:172.21.15.86:3300/0 conn(0x7f9bd00665a0 0x7f9bd00b1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:54.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.780+0000 7f9bcdffb700 1 -- 172.21.15.103:0/2183479875 >> v1:172.21.15.103:6789/0 conn(0x7f9bd005b7c0 legacy=0x7f9bd00ae010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:54.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.780+0000 7f9bcdffb700 1 -- 172.21.15.103:0/2183479875 >> v1:172.21.15.86:6789/0 conn(0x7f9bd00b4ec0 legacy=0x7f9bd00ae720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:54.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.780+0000 7f9bcdffb700 1 --2- 172.21.15.103:0/2183479875 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9bb40049b0 0x7f9bb4004db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:54.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.780+0000 7f9bcdffb700 1 --2- 172.21.15.103:0/2183479875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9bb4003920 0x7f9bb4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:54.792 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.780+0000 7f9bcdffb700 1 --2- 172.21.15.103:0/2183479875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bb4004200 0x7f9bb400b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:54.792 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.780+0000 7f9bcdffb700 1 -- 172.21.15.103:0/2183479875 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd00afda0 con 0x7f9bb4003920 2020-04-22T14:14:54.792 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.780+0000 7f9bcdffb700 1 -- 172.21.15.103:0/2183479875 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb400bbb0 con 0x7f9bb4004200 2020-04-22T14:14:54.792 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.780+0000 7f9bcdffb700 1 -- 172.21.15.103:0/2183479875 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb400bcf0 con 0x7f9bb40049b0 2020-04-22T14:14:54.792 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.780+0000 7f9bd4bc3700 1 --2- 172.21.15.103:0/2183479875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bb4004200 0x7f9bb400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:54.792 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.780+0000 7f9bcffff700 1 --2- 172.21.15.103:0/2183479875 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9bb40049b0 0x7f9bb4004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:54.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.780+0000 7f9bc7fff700 1 --2- 172.21.15.103:0/2183479875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9bb4003920 0x7f9bb4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:54.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.780+0000 7f9bd4bc3700 1 -- 172.21.15.103:0/2183479875 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9bb40049b0 msgr2=0x7f9bb4004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:54.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.780+0000 7f9bd4bc3700 1 --2- 172.21.15.103:0/2183479875 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9bb40049b0 0x7f9bb4004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:54.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.780+0000 7f9bd4bc3700 1 -- 172.21.15.103:0/2183479875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9bb4003920 msgr2=0x7f9bb4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:54.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.780+0000 7f9bd4bc3700 1 --2- 172.21.15.103:0/2183479875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9bb4003920 0x7f9bb4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:54.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.780+0000 7f9bd4bc3700 1 -- 172.21.15.103:0/2183479875 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd00b4530 con 0x7f9bb4004200 2020-04-22T14:14:54.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.780+0000 7f9bd6626700 1 -- 172.21.15.103:0/2183479875 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bd0157e10 con 0x7f9bb4004200 2020-04-22T14:14:54.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.780+0000 7f9bd4bc3700 1 --2- 172.21.15.103:0/2183479875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bb4004200 0x7f9bb400b750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9bd00b2800 tx=0x7f9bc8010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:54.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.780+0000 7f9bd6626700 1 -- 172.21.15.103:0/2183479875 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bd00b3690 con 0x7f9bb4004200 2020-04-22T14:14:54.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.780+0000 7f9bd4bc3700 1 -- 172.21.15.103:0/2183479875 reap_dead start 2020-04-22T14:14:54.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.780+0000 7f9bd4bc3700 1 --2- 172.21.15.103:0/2183479875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bb4004200 0x7f9bb400b750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9bd00b2800 tx=0x7f9bc8010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:54.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.780+0000 7f9bd4bc3700 1 --2- 172.21.15.103:0/2183479875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bb4004200 0x7f9bb400b750 secure :-1 s=READY pgs=1416 cs=0 l=1 rx=0x7f9bd00b2800 tx=0x7f9bc8010c70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:54.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.780+0000 7f9bd4bc3700 1 --2- 172.21.15.103:0/2183479875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bb4004200 0x7f9bb400b750 secure :-1 s=THROTTLE_DONE pgs=1416 cs=0 l=1 rx=0x7f9bd00b2800 tx=0x7f9bc8010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:54.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.781+0000 7f9bcdffb700 1 -- 172.21.15.103:0/2183479875 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bc8005e20 con 0x7f9bb4004200 2020-04-22T14:14:54.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.781+0000 7f9bd4bc3700 1 --2- 172.21.15.103:0/2183479875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bb4004200 0x7f9bb400b750 secure :-1 s=THROTTLE_DONE pgs=1416 cs=0 l=1 rx=0x7f9bd00b2800 tx=0x7f9bc8010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:54.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.781+0000 7f9bd4bc3700 1 --2- 172.21.15.103:0/2183479875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bb4004200 0x7f9bb400b750 secure :-1 s=THROTTLE_DONE pgs=1416 cs=0 l=1 rx=0x7f9bd00b2800 tx=0x7f9bc8010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:54.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.781+0000 7f9bcdffb700 1 -- 172.21.15.103:0/2183479875 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc80125f0 con 0x7f9bb4004200 2020-04-22T14:14:54.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.781+0000 7f9bcdffb700 1 -- 172.21.15.103:0/2183479875 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bc8012950 con 0x7f9bb4004200 2020-04-22T14:14:54.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.781+0000 7f9bd4bc3700 1 --2- 172.21.15.103:0/2183479875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bb4004200 0x7f9bb400b750 secure :-1 s=THROTTLE_DONE pgs=1416 cs=0 l=1 rx=0x7f9bd00b2800 tx=0x7f9bc8010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:54.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.781+0000 7f9bd6626700 1 -- 172.21.15.103:0/2183479875 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ba8003340 con 0x7f9bb4004200 2020-04-22T14:14:54.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.781+0000 7f9bcdffb700 1 -- 172.21.15.103:0/2183479875 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f9bc8012ab0 con 0x7f9bb4004200 2020-04-22T14:14:54.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.781+0000 7f9bd4bc3700 1 --2- 172.21.15.103:0/2183479875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bb4004200 0x7f9bb400b750 secure :-1 s=THROTTLE_DONE pgs=1416 cs=0 l=1 rx=0x7f9bd00b2800 tx=0x7f9bc8010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:54.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.782+0000 7f9bcdffb700 1 --2- 172.21.15.103:0/2183479875 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9bb40519e0 0x7f9bb4053ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:54.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.782+0000 7f9bcdffb700 1 -- 172.21.15.103:0/2183479875 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f9bc8061520 con 0x7f9bb4004200 2020-04-22T14:14:54.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.782+0000 7f9bcffff700 1 --2- 172.21.15.103:0/2183479875 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9bb40519e0 0x7f9bb4053ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:54.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.782+0000 7f9bcffff700 1 --2- 172.21.15.103:0/2183479875 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9bb40519e0 0x7f9bb4053ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9bc0005540 tx=0x7f9bc000c780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:54.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.782+0000 7f9bcffff700 1 --2- 172.21.15.103:0/2183479875 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9bb40519e0 0x7f9bb4053ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9bc0005540 tx=0x7f9bc000c780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:54.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.782+0000 7f9bcffff700 1 --2- 172.21.15.103:0/2183479875 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9bb40519e0 0x7f9bb4053ea0 secure :-1 s=READY pgs=516 cs=0 l=1 rx=0x7f9bc0005540 tx=0x7f9bc000c780).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:54.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.786+0000 7f9bd4bc3700 1 --2- 172.21.15.103:0/2183479875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bb4004200 0x7f9bb400b750 secure :-1 s=THROTTLE_DONE pgs=1416 cs=0 l=1 rx=0x7f9bd00b2800 tx=0x7f9bc8010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:54.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.786+0000 7f9bcdffb700 1 -- 172.21.15.103:0/2183479875 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f9bc803c9c0 con 0x7f9bb4004200 2020-04-22T14:14:54.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.977+0000 7f9bd6626700 1 -- 172.21.15.103:0/2183479875 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ba80036e0 con 0x7f9bb4004200 2020-04-22T14:14:54.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.977+0000 7f9bd4bc3700 1 --2- 172.21.15.103:0/2183479875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bb4004200 0x7f9bb400b750 secure :-1 s=THROTTLE_DONE pgs=1416 cs=0 l=1 rx=0x7f9bd00b2800 tx=0x7f9bc8010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:54.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.977+0000 7f9bcdffb700 1 -- 172.21.15.103:0/2183479875 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+2142 (secure 0 0 0) 0x7f9bc803ffe0 con 0x7f9bb4004200 2020-04-22T14:14:54.981 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:14:54.981 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":66,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5810,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/2664816107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2664816107},{"type":"v1","addr":"172.21.15.86:6835","nonce":2664816107}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":60}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:13:59.062543+0000","modified":"2020-04-22T14:14:19.519188+0000","tableserver":0,"root":0,"session_timeout":30,"session_autoclose":50,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7723},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7723":{"gid":7723,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/3220772133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3220772133},{"type":"v1","addr":"172.21.15.103:6833","nonce":3220772133}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-04-22T14:14:54.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.978+0000 7f9bd6626700 1 -- 172.21.15.103:0/2183479875 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9bb40519e0 msgr2=0x7f9bb4053ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:54.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.978+0000 7f9bd6626700 1 --2- 172.21.15.103:0/2183479875 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9bb40519e0 0x7f9bb4053ea0 secure :-1 s=READY pgs=516 cs=0 l=1 rx=0x7f9bc0005540 tx=0x7f9bc000c780).stop 2020-04-22T14:14:54.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.978+0000 7f9bd6626700 1 -- 172.21.15.103:0/2183479875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bb4004200 msgr2=0x7f9bb400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:54.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.978+0000 7f9bd6626700 1 --2- 172.21.15.103:0/2183479875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bb4004200 0x7f9bb400b750 secure :-1 s=READY pgs=1416 cs=0 l=1 rx=0x7f9bd00b2800 tx=0x7f9bc8010c70).stop 2020-04-22T14:14:54.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.978+0000 7f9bd6626700 1 -- 172.21.15.103:0/2183479875 shutdown_connections 2020-04-22T14:14:54.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.978+0000 7f9bd6626700 1 --2- 172.21.15.103:0/2183479875 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9bb40519e0 0x7f9bb4053ea0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:54.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.978+0000 7f9bd6626700 1 --2- 172.21.15.103:0/2183479875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bb4004200 0x7f9bb400b750 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:54.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.978+0000 7f9bd6626700 1 -- 172.21.15.103:0/2183479875 >> 172.21.15.103:0/2183479875 conn(0x7f9bd00b9160 msgr2=0x7f9bd014e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:54.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.978+0000 7f9bd6626700 1 -- 172.21.15.103:0/2183479875 shutdown_connections 2020-04-22T14:14:54.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:54.978+0000 7f9bd6626700 1 -- 172.21.15.103:0/2183479875 wait complete. 2020-04-22T14:14:54.985 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 66 2020-04-22T14:14:54.992 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:55.005 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok session ls 2020-04-22T14:14:55.167 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2020-04-22T14:14:55.167 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:14:55.168 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 7993, 2020-04-22T14:14:55.168 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": { 2020-04-22T14:14:55.168 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:14:55.169 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:14:55.169 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 7993 2020-04-22T14:14:55.172 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:55.173 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:14:55.173 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "any", 2020-04-22T14:14:55.173 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.2:0", 2020-04-22T14:14:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 2994531494 2020-04-22T14:14:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:14:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "open", 2020-04-22T14:14:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: "num_leases": 0, 2020-04-22T14:14:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: "num_caps": 2, 2020-04-22T14:14:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: "request_load_avg": 3, 2020-04-22T14:14:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 39.278239655, 2020-04-22T14:14:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: "requests_in_flight": 0, 2020-04-22T14:14:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: "completed_requests": 0, 2020-04-22T14:14:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: "reconnecting": false, 2020-04-22T14:14:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps": { 2020-04-22T14:14:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:14:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 60 2020-04-22T14:14:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: "release_caps": { 2020-04-22T14:14:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:14:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 60 2020-04-22T14:14:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps_throttle": { 2020-04-22T14:14:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:14:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 2.5 2020-04-22T14:14:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: "recall_caps_throttle2o": { 2020-04-22T14:14:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 0, 2020-04-22T14:14:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 0.5 2020-04-22T14:14:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: "session_cache_liveness": { 2020-04-22T14:14:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: "value": 3.7567286143951093, 2020-04-22T14:14:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: "halflife": 300 2020-04-22T14:14:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": "client.7993 192.168.0.2:0/2994531494", 2020-04-22T14:14:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: "completed_requests": [], 2020-04-22T14:14:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: "prealloc_inos": [], 2020-04-22T14:14:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: "used_inos": [], 2020-04-22T14:14:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "client_metadata": { 2020-04-22T14:14:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "client_features": { 2020-04-22T14:14:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_bits": "0x0000000000003fff" 2020-04-22T14:14:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "metric_spec": { 2020-04-22T14:14:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "metric_flags": { 2020-04-22T14:14:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_bits": "0x" 2020-04-22T14:14:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:14:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:14:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:14:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:14:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "1", 2020-04-22T14:14:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:14:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2020-04-22T14:14:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "89761", 2020-04-22T14:14:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:14:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:14:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:14:55.181 INFO:teuthology.orchestra.run.smithi103.stdout:] 2020-04-22T14:14:55.182 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "id": 7993, "entity": { "name": { "type": "client", "num": 7993 }, "addr": { "type": "any", "addr": "192.168.0.2:0", "nonce": 2994531494 } }, "state": "open", "num_leases": 0, "num_caps": 2, "request_load_avg": 3, "uptime": 39.278239655, "requests_in_flight": 0, "completed_requests": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 3.7567286143951093, "halflife": 300 }, "inst": "client.7993 192.168.0.2:0/2994531494", "completed_requests": [], "prealloc_inos": [], "used_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x0000000000003fff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x" } }, "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", "entity_id": "1", "hostname": "smithi103", "mount_point": "/home/ubuntu/cephtest/mnt.1", "pid": "89761", "root": "/" } } ] 2020-04-22T14:14:55.183 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:55.205 INFO:teuthology.orchestra.run.smithi103:> sudo kill -sigcont 88473 2020-04-22T14:14:55.273 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-04-22T14:14:55.274 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:14:55.274 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:2020-04-22T14:14:55.269+0000 7fc9daffd700 -1 client.7936 I was blacklisted at osd epoch 91 2020-04-22T14:14:55.291 INFO:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:14:55.381 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:55.395 INFO:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:14:55.483 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-04-22T14:14:55.483 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2020-04-22T14:14:55.484 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:55.496 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-04-22T14:14:55.497 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:14:55.572 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[88473]: fuse finished with error 0 and tester_r 0 2020-04-22T14:14:55.582 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:14:55.582 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:14:55.582 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:55.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:55.638 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:14:55.714 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:55.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:55.766 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down brx.0' 2020-04-22T14:14:55.931 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.0' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/36) 2020-04-22T14:14:55.931 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:55.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:55.951 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete brx.0' 2020-04-22T14:14:56.062 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.0' (c1e46398-fa80-44d5-8bc3-23834ff98a6f) successfully deleted. 2020-04-22T14:14:56.063 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:56.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:56.088 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:14:56.166 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:56.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:56.216 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:14:56.275 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:14:56.276 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:14:56.276 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:14:56.276 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:14:56.276 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:14:56.276 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:14:56.276 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:14:56.276 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:14:56.277 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:14:56.277 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:14:56.277 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:14:56.277 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:14:56.277 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:14:56.277 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:14:56.277 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:14:56.278 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 41944sec preferred_lft 41944sec 2020-04-22T14:14:56.278 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:14:56.278 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:14:56.278 INFO:teuthology.orchestra.run.smithi103.stdout:29: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:14:56.278 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 8e:a1:08:4e:13:31 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:14:56.278 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:14:56.278 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:14:56.279 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::3ff9:7e94:95df:228f/64 scope link noprefixroute 2020-04-22T14:14:56.279 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:14:56.279 INFO:teuthology.orchestra.run.smithi103.stdout:31: brx.2@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-04-22T14:14:56.280 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 8e:a1:08:4e:13:31 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2020-04-22T14:14:56.280 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:56.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:56.338 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:14:56.413 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:56.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:56.469 INFO:teuthology.orchestra.run.smithi103:> nmcli connection show 2020-04-22T14:14:56.546 INFO:teuthology.orchestra.run.smithi103.stdout:NAME UUID TYPE DEVICE 2020-04-22T14:14:56.547 INFO:teuthology.orchestra.run.smithi103.stdout:System enp3s0f1 b0a308d1-bd90-60af-eb7c-0183bb425a1a ethernet enp3s0f1 2020-04-22T14:14:56.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-brx ee1ed106-4543-4f08-bc3e-eb683cda2564 bridge ceph-brx 2020-04-22T14:14:56.547 INFO:teuthology.orchestra.run.smithi103.stdout:brx.2 d2f51cd0-b81f-466d-add7-086c746c0447 ethernet brx.2 2020-04-22T14:14:56.547 INFO:teuthology.orchestra.run.smithi103.stdout:eno1 206ad60d-195e-4d4b-a9fe-a5dd1f33a67d ethernet -- 2020-04-22T14:14:56.547 INFO:teuthology.orchestra.run.smithi103.stdout:eno2 894a7dd2-d329-4985-9ef9-84a92c6e1c6c ethernet -- 2020-04-22T14:14:56.547 INFO:teuthology.orchestra.run.smithi103.stdout:enp3s0f0 5a3237ce-06ab-4ae0-818b-45bdf036cb08 ethernet -- 2020-04-22T14:14:56.548 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:56.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:56.592 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:14:56.651 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2020-04-22T14:14:56.652 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:56.701 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-04-22T14:14:56.701 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:14:56.782 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[89761]: fuse finished with error 0 and tester_r 0 2020-04-22T14:14:56.923 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-04-22T14:14:56.923 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:14:56.923 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:56.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:56.982 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:14:57.059 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:57.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:57.110 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down brx.2' 2020-04-22T14:14:57.277 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.2' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/37) 2020-04-22T14:14:57.277 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:57.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:57.296 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete brx.2' 2020-04-22T14:14:57.410 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.2' (d2f51cd0-b81f-466d-add7-086c746c0447) successfully deleted. 2020-04-22T14:14:57.410 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:57.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:57.424 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:14:57.532 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:57.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:57.556 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:14:57.616 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:14:57.616 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:14:57.616 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:14:57.617 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:14:57.617 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:14:57.617 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:14:57.617 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:14:57.617 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:14:57.617 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:14:57.617 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:14:57.618 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:14:57.618 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:14:57.618 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:14:57.618 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:14:57.618 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:14:57.618 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 41943sec preferred_lft 41943sec 2020-04-22T14:14:57.619 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:14:57.619 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:14:57.619 INFO:teuthology.orchestra.run.smithi103.stdout:29: ceph-brx: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:14:57.619 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:14:57.619 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:14:57.619 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:14:57.619 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::3ff9:7e94:95df:228f/64 scope link noprefixroute 2020-04-22T14:14:57.619 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:14:57.620 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:57.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:57.665 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:14:57.755 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:57.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:57.803 INFO:teuthology.orchestra.run.smithi103:> nmcli connection show 2020-04-22T14:14:57.884 INFO:teuthology.orchestra.run.smithi103.stdout:NAME UUID TYPE DEVICE 2020-04-22T14:14:57.885 INFO:teuthology.orchestra.run.smithi103.stdout:System enp3s0f1 b0a308d1-bd90-60af-eb7c-0183bb425a1a ethernet enp3s0f1 2020-04-22T14:14:57.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-brx ee1ed106-4543-4f08-bc3e-eb683cda2564 bridge ceph-brx 2020-04-22T14:14:57.885 INFO:teuthology.orchestra.run.smithi103.stdout:eno1 206ad60d-195e-4d4b-a9fe-a5dd1f33a67d ethernet -- 2020-04-22T14:14:57.886 INFO:teuthology.orchestra.run.smithi103.stdout:eno2 894a7dd2-d329-4985-9ef9-84a92c6e1c6c ethernet -- 2020-04-22T14:14:57.886 INFO:teuthology.orchestra.run.smithi103.stdout:enp3s0f0 5a3237ce-06ab-4ae0-818b-45bdf036cb08 ethernet -- 2020-04-22T14:14:57.893 INFO:tasks.cephfs.mount:Removing the 'ceph-brx' 2020-04-22T14:14:57.893 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:57.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:57.931 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down ceph-brx' 2020-04-22T14:14:58.098 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/35) 2020-04-22T14:14:58.098 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:58.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:58.113 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete ceph-brx' 2020-04-22T14:14:58.221 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' (ee1ed106-4543-4f08-bc3e-eb683cda2564) successfully deleted. 2020-04-22T14:14:58.222 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:58.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:58.236 INFO:teuthology.orchestra.run.smithi103:> route 2020-04-22T14:14:58.301 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2020-04-22T14:14:58.302 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-04-22T14:14:58.302 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 102 0 0 enp3s0f1 2020-04-22T14:14:58.302 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 102 0 0 enp3s0f1 2020-04-22T14:14:58.302 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:58.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:58.351 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -D FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-04-22T14:14:58.462 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:58.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:58.485 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -D FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-04-22T14:14:58.594 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:58.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:58.621 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -t nat -D POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-04-22T14:14:58.729 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:58.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:58.756 INFO:teuthology.orchestra.run.smithi103:> cat /tmp/python-ceph-brx 2020-04-22T14:14:58.818 INFO:teuthology.orchestra.run.smithi103.stdout:0 2020-04-22T14:14:58.819 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:58.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:58.863 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 0 > /proc/sys/net/ipv4/ip_forward' 2020-04-22T14:14:58.938 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:58.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:58.984 INFO:teuthology.orchestra.run.smithi103:> rm -f /tmp/python-ceph-brx 2020-04-22T14:14:59.044 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:59.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:59.095 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:14:59.154 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.2' netns for '/home/ubuntu/cephtest/mnt.2' 2020-04-22T14:14:59.154 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:14:59.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:59.171 INFO:teuthology.orchestra.run.smithi086:> ip addr 2020-04-22T14:14:59.249 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:14:59.249 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:14:59.249 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:14:59.250 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:14:59.250 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2020-04-22T14:14:59.250 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:14:59.250 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:14:59.250 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:14:59.250 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:14:59.251 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:14:59.251 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:14:59.251 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:14:59.251 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:14:59.251 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:14:59.251 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:14:59.251 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 41915sec preferred_lft 41915sec 2020-04-22T14:14:59.252 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2020-04-22T14:14:59.252 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:14:59.252 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:14:59.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:59.299 INFO:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.2) 2020-04-22T14:14:59.370 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.3' netns for '/home/ubuntu/cephtest/mnt.3' 2020-04-22T14:14:59.370 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:14:59.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:59.418 INFO:teuthology.orchestra.run.smithi086:> ip addr 2020-04-22T14:14:59.477 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:14:59.478 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:14:59.478 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:14:59.478 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:14:59.478 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2020-04-22T14:14:59.478 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:14:59.478 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:14:59.479 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:14:59.479 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:14:59.479 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:14:59.479 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:14:59.479 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:14:59.479 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:14:59.479 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:14:59.480 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:14:59.480 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 41915sec preferred_lft 41915sec 2020-04-22T14:14:59.480 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2020-04-22T14:14:59.480 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:14:59.480 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:14:59.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:14:59.529 INFO:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.3) 2020-04-22T14:14:59.588 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:14:59.603 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_dont_mark_unresponsive_client_stale' 2020-04-22T14:14:59.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.749+0000 7f79ec205700 1 Processor -- start 2020-04-22T14:14:59.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.749+0000 7f79ec205700 1 -- start start 2020-04-22T14:14:59.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.750+0000 7f79ec205700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79e4067170 0x7f79e40b6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:59.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.750+0000 7f79ec205700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f79e40ac740 0x7f79e413c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:14:59.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.750+0000 7f79ec205700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e4064ec0 con 0x7f79e413c7e0 2020-04-22T14:14:59.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.750+0000 7f79ec205700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e4065af0 con 0x7f79e40ac740 2020-04-22T14:14:59.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.750+0000 7f79ec205700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e405bb50 con 0x7f79e4067170 2020-04-22T14:14:59.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.750+0000 7f79e9fa1700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79e4067170 0x7f79e40b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:59.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.750+0000 7f79e97a0700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f79e40ac740 0x7f79e413c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:59.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.750+0000 7f79ea7a2700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f79e413c7e0 0x7f79e405b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:35824/0 (socket says 172.21.15.103:35824) 2020-04-22T14:14:59.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.750+0000 7f79ea7a2700 1 -- 172.21.15.103:0/1387489178 learned_addr learned my addr 172.21.15.103:0/1387489178 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:14:59.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.751+0000 7f79e9fa1700 1 -- 172.21.15.103:0/1387489178 >> v2:172.21.15.86:3300/0 conn(0x7f79e40ac740 msgr2=0x7f79e413c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:14:59.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.751+0000 7f79e9fa1700 1 --2- 172.21.15.103:0/1387489178 >> v2:172.21.15.86:3300/0 conn(0x7f79e40ac740 0x7f79e413c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:59.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.751+0000 7f79e9fa1700 1 -- 172.21.15.103:0/1387489178 >> v1:172.21.15.86:6789/0 conn(0x7f79e413c7e0 legacy=0x7f79e405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:59.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.751+0000 7f79e9fa1700 1 -- 172.21.15.103:0/1387489178 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e4146870 con 0x7f79e4067170 2020-04-22T14:14:59.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.751+0000 7f79e9fa1700 1 --2- 172.21.15.103:0/1387489178 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79e4067170 0x7f79e40b6040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f79d4002f30 tx=0x7f79d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:59.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.751+0000 7f79e9fa1700 1 --2- 172.21.15.103:0/1387489178 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79e4067170 0x7f79e40b6040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f79d4002f30 tx=0x7f79d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:59.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.751+0000 7f79e9fa1700 1 --2- 172.21.15.103:0/1387489178 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79e4067170 0x7f79e40b6040 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7f79d4002f30 tx=0x7f79d4007a40).ready entity=mon.2 client_cookie=1636e9d08585a035 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:59.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.751+0000 7f79e9fa1700 1 --2- 172.21.15.103:0/1387489178 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79e4067170 0x7f79e40b6040 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7f79d4002f30 tx=0x7f79d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:59.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.751+0000 7f79e8f9f700 1 -- 172.21.15.103:0/1387489178 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79d40113c0 con 0x7f79e4067170 2020-04-22T14:14:59.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.751+0000 7f79e9fa1700 1 --2- 172.21.15.103:0/1387489178 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79e4067170 0x7f79e40b6040 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7f79d4002f30 tx=0x7f79d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:59.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.751+0000 7f79e9fa1700 1 --2- 172.21.15.103:0/1387489178 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79e4067170 0x7f79e40b6040 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7f79d4002f30 tx=0x7f79d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:59.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.751+0000 7f79e8f9f700 1 -- 172.21.15.103:0/1387489178 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d4011560 con 0x7f79e4067170 2020-04-22T14:14:59.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.751+0000 7f79e8f9f700 1 -- 172.21.15.103:0/1387489178 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79d4011980 con 0x7f79e4067170 2020-04-22T14:14:59.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.751+0000 7f79ec205700 1 -- 172.21.15.103:0/1387489178 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79e4067170 msgr2=0x7f79e40b6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:59.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.751+0000 7f79ec205700 1 --2- 172.21.15.103:0/1387489178 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79e4067170 0x7f79e40b6040 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7f79d4002f30 tx=0x7f79d4007a40).stop 2020-04-22T14:14:59.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.752+0000 7f79ec205700 1 -- 172.21.15.103:0/1387489178 shutdown_connections 2020-04-22T14:14:59.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.752+0000 7f79ec205700 1 --2- 172.21.15.103:0/1387489178 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79e4067170 0x7f79e40b6040 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:59.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.752+0000 7f79ec205700 1 --2- 172.21.15.103:0/1387489178 >> v2:172.21.15.86:3300/0 conn(0x7f79e40ac740 0x7f79e413c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:14:59.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.752+0000 7f79ec205700 1 -- 172.21.15.103:0/1387489178 >> 172.21.15.103:0/1387489178 conn(0x7f79e40b9160 msgr2=0x7f79e405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:14:59.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.752+0000 7f79ec205700 1 -- 172.21.15.103:0/1387489178 shutdown_connections 2020-04-22T14:14:59.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.752+0000 7f79ec205700 1 -- 172.21.15.103:0/1387489178 wait complete. 2020-04-22T14:14:59.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.753+0000 7f79ec205700 1 Processor -- start 2020-04-22T14:14:59.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.753+0000 7f79ec205700 1 -- start start 2020-04-22T14:14:59.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.753+0000 7f79ec205700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f79e4067170 0x7f79e4144b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:59.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.753+0000 7f79ec205700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f79e413c7e0 0x7f79e4138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:59.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.753+0000 7f79ec205700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e4144f60 con 0x7f79e40ac740 2020-04-22T14:14:59.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.753+0000 7f79ec205700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e4151950 con 0x7f79e4067170 2020-04-22T14:14:59.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.753+0000 7f79ec205700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e4138b70 con 0x7f79e413c7e0 2020-04-22T14:14:59.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.753+0000 7f79ea7a2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f79e413c7e0 0x7f79e4138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:59.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.753+0000 7f79ea7a2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f79e413c7e0 0x7f79e4138fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54716/0 (socket says 172.21.15.103:54716) 2020-04-22T14:14:59.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.754+0000 7f79ea7a2700 1 -- 172.21.15.103:0/1876044216 learned_addr learned my addr 172.21.15.103:0/1876044216 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:14:59.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.754+0000 7f79e9fa1700 1 --2- 172.21.15.103:0/1876044216 >> v2:172.21.15.86:3300/0 conn(0x7f79e4067170 0x7f79e4144b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:59.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.754+0000 7f79ea7a2700 1 -- 172.21.15.103:0/1876044216 >> v2:172.21.15.86:3300/0 conn(0x7f79e4067170 msgr2=0x7f79e4144b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:59.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.754+0000 7f79ea7a2700 1 --2- 172.21.15.103:0/1876044216 >> v2:172.21.15.86:3300/0 conn(0x7f79e4067170 0x7f79e4144b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:14:59.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.754+0000 7f79ea7a2700 1 -- 172.21.15.103:0/1876044216 >> v1:172.21.15.86:6789/0 conn(0x7f79e40ac740 legacy=0x7f79e413e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:14:59.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.754+0000 7f79ea7a2700 1 -- 172.21.15.103:0/1876044216 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e413a180 con 0x7f79e413c7e0 2020-04-22T14:14:59.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.754+0000 7f79ea7a2700 1 --2- 172.21.15.103:0/1876044216 >> v2:172.21.15.103:3300/0 conn(0x7f79e413c7e0 0x7f79e4138fd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f79e41451d0 tx=0x7f79dc010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:59.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.754+0000 7f79ea7a2700 1 --2- 172.21.15.103:0/1876044216 >> v2:172.21.15.103:3300/0 conn(0x7f79e413c7e0 0x7f79e4138fd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f79e41451d0 tx=0x7f79dc010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:59.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.754+0000 7f79ea7a2700 1 --2- 172.21.15.103:0/1876044216 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79e413c7e0 0x7f79e4138fd0 secure :-1 s=READY pgs=1418 cs=0 l=1 rx=0x7f79e41451d0 tx=0x7f79dc010d00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:59.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.754+0000 7f79ea7a2700 1 --2- 172.21.15.103:0/1876044216 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79e413c7e0 0x7f79e4138fd0 secure :-1 s=THROTTLE_DONE pgs=1418 cs=0 l=1 rx=0x7f79e41451d0 tx=0x7f79dc010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:59.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.754+0000 7f79d2ffd700 1 -- 172.21.15.103:0/1876044216 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79dc012360 con 0x7f79e413c7e0 2020-04-22T14:14:59.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.754+0000 7f79ea7a2700 1 --2- 172.21.15.103:0/1876044216 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79e413c7e0 0x7f79e4138fd0 secure :-1 s=THROTTLE_DONE pgs=1418 cs=0 l=1 rx=0x7f79e41451d0 tx=0x7f79dc010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:59.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.754+0000 7f79ec205700 1 -- 172.21.15.103:0/1876044216 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e413ed80 con 0x7f79e413c7e0 2020-04-22T14:14:59.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.754+0000 7f79d2ffd700 1 -- 172.21.15.103:0/1876044216 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79dc012500 con 0x7f79e413c7e0 2020-04-22T14:14:59.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.754+0000 7f79ea7a2700 1 --2- 172.21.15.103:0/1876044216 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79e413c7e0 0x7f79e4138fd0 secure :-1 s=THROTTLE_DONE pgs=1418 cs=0 l=1 rx=0x7f79e41451d0 tx=0x7f79dc010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:59.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.754+0000 7f79d2ffd700 1 -- 172.21.15.103:0/1876044216 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79dc012920 con 0x7f79e413c7e0 2020-04-22T14:14:59.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.754+0000 7f79ec205700 1 -- 172.21.15.103:0/1876044216 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e413d320 con 0x7f79e413c7e0 2020-04-22T14:14:59.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.755+0000 7f79ea7a2700 1 --2- 172.21.15.103:0/1876044216 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79e413c7e0 0x7f79e4138fd0 secure :-1 s=THROTTLE_DONE pgs=1418 cs=0 l=1 rx=0x7f79e41451d0 tx=0x7f79dc010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:59.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.755+0000 7f79d2ffd700 1 -- 172.21.15.103:0/1876044216 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f79dc012ba0 con 0x7f79e413c7e0 2020-04-22T14:14:59.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.755+0000 7f79ea7a2700 1 --2- 172.21.15.103:0/1876044216 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79e413c7e0 0x7f79e4138fd0 secure :-1 s=THROTTLE_DONE pgs=1418 cs=0 l=1 rx=0x7f79e41451d0 tx=0x7f79dc010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:59.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.755+0000 7f79ec205700 1 -- 172.21.15.103:0/1876044216 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79e4056c90 con 0x7f79e413c7e0 2020-04-22T14:14:59.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.755+0000 7f79d2ffd700 1 --2- 172.21.15.103:0/1876044216 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f79c404d9d0 0x7f79c404fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:14:59.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.755+0000 7f79d2ffd700 1 -- 172.21.15.103:0/1876044216 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f79dc0090c0 con 0x7f79e413c7e0 2020-04-22T14:14:59.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.756+0000 7f79e9fa1700 1 --2- 172.21.15.103:0/1876044216 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f79c404d9d0 0x7f79c404fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:14:59.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.756+0000 7f79e9fa1700 1 --2- 172.21.15.103:0/1876044216 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f79c404d9d0 0x7f79c404fe90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f79d4002f30 tx=0x7f79d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:59.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.756+0000 7f79e9fa1700 1 --2- 172.21.15.103:0/1876044216 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f79c404d9d0 0x7f79c404fe90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f79d4002f30 tx=0x7f79d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:59.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.756+0000 7f79e9fa1700 1 --2- 172.21.15.103:0/1876044216 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f79c404d9d0 0x7f79c404fe90 secure :-1 s=READY pgs=517 cs=0 l=1 rx=0x7f79d4002f30 tx=0x7f79d4007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:14:59.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.759+0000 7f79ea7a2700 1 --2- 172.21.15.103:0/1876044216 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79e413c7e0 0x7f79e4138fd0 secure :-1 s=THROTTLE_DONE pgs=1418 cs=0 l=1 rx=0x7f79e41451d0 tx=0x7f79dc010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:14:59.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.759+0000 7f79d2ffd700 1 -- 172.21.15.103:0/1876044216 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f79dc03ce80 con 0x7f79e413c7e0 2020-04-22T14:14:59.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:14:59.951+0000 7f79ec205700 1 -- 172.21.15.103:0/1876044216 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_dont_mark_unresponsive_client_stale"]} v 0) v1 -- 0x7f79e4144f60 con 0x7f79e413c7e0 2020-04-22T14:15:00.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.618+0000 7f79ea7a2700 1 --2- 172.21.15.103:0/1876044216 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79e413c7e0 0x7f79e4138fd0 secure :-1 s=THROTTLE_DONE pgs=1418 cs=0 l=1 rx=0x7f79e41451d0 tx=0x7f79dc010d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:00.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.618+0000 7f79d2ffd700 1 -- 172.21.15.103:0/1876044216 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_dont_mark_unresponsive_client_stale"]}]=0 v535) v1 ==== 172+0+0 (secure 0 0 0) 0x7f79e4144f60 con 0x7f79e413c7e0 2020-04-22T14:15:00.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.620+0000 7f79ec205700 1 -- 172.21.15.103:0/1876044216 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f79c404d9d0 msgr2=0x7f79c404fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:00.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.620+0000 7f79ec205700 1 --2- 172.21.15.103:0/1876044216 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f79c404d9d0 0x7f79c404fe90 secure :-1 s=READY pgs=517 cs=0 l=1 rx=0x7f79d4002f30 tx=0x7f79d4007a40).stop 2020-04-22T14:15:00.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.620+0000 7f79ec205700 1 -- 172.21.15.103:0/1876044216 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79e413c7e0 msgr2=0x7f79e4138fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:00.624 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.620+0000 7f79ec205700 1 --2- 172.21.15.103:0/1876044216 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79e413c7e0 0x7f79e4138fd0 secure :-1 s=READY pgs=1418 cs=0 l=1 rx=0x7f79e41451d0 tx=0x7f79dc010d00).stop 2020-04-22T14:15:00.624 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.620+0000 7f79ec205700 1 -- 172.21.15.103:0/1876044216 shutdown_connections 2020-04-22T14:15:00.624 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.620+0000 7f79ec205700 1 --2- 172.21.15.103:0/1876044216 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79e413c7e0 0x7f79e4138fd0 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:00.624 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.620+0000 7f79ec205700 1 --2- 172.21.15.103:0/1876044216 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f79c404d9d0 0x7f79c404fe90 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:00.624 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.620+0000 7f79ec205700 1 --2- 172.21.15.103:0/1876044216 >> v2:172.21.15.86:3300/0 conn(0x7f79e4067170 0x7f79e4144b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:00.624 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.620+0000 7f79ec205700 1 -- 172.21.15.103:0/1876044216 >> 172.21.15.103:0/1876044216 conn(0x7f79e40b9160 msgr2=0x7f79e40b4890 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:00.624 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.620+0000 7f79ec205700 1 -- 172.21.15.103:0/1876044216 shutdown_connections 2020-04-22T14:15:00.625 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.620+0000 7f79ec205700 1 -- 172.21.15.103:0/1876044216 wait complete. 2020-04-22T14:15:00.634 INFO:tasks.cephfs_test_runner:test_dont_mark_unresponsive_client_stale (tasks.cephfs.test_client_recovery.TestClientRecovery) ... ok 2020-04-22T14:15:00.634 INFO:tasks.cephfs_test_runner:Starting test: test_evicted_caps (tasks.cephfs.test_client_recovery.TestClientRecovery) 2020-04-22T14:15:00.634 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:00.653 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_evicted_caps' 2020-04-22T14:15:00.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.798+0000 7f30ff2b6700 1 Processor -- start 2020-04-22T14:15:00.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.798+0000 7f30ff2b6700 1 -- start start 2020-04-22T14:15:00.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.799+0000 7f30ff2b6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f30f8145dc0 0x7f30f80656e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:00.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.799+0000 7f30ff2b6700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30f80b79f0 con 0x7f30f80b0ed0 2020-04-22T14:15:00.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.799+0000 7f30ff2b6700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30f80b7c90 con 0x7f30f8145960 2020-04-22T14:15:00.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.799+0000 7f30ff2b6700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f80b77f0 con 0x7f30f8145dc0 2020-04-22T14:15:00.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.799+0000 7f30fc851700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f30f8145960 0x7f30f8064fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46910/0 (socket says 172.21.15.103:46910) 2020-04-22T14:15:00.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.799+0000 7f30fc851700 1 -- 172.21.15.103:0/3288795315 learned_addr learned my addr 172.21.15.103:0/3288795315 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:00.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.799+0000 7f30fd853700 1 --2- 172.21.15.103:0/3288795315 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f30f8145dc0 0x7f30f80656e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:00.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.799+0000 7f30e7fff700 1 -- 172.21.15.103:0/3288795315 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1883103881 0 0) 0x7f30f80b7c90 con 0x7f30f8145960 2020-04-22T14:15:00.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.800+0000 7f30e7fff700 1 -- 172.21.15.103:0/3288795315 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30e0003230 con 0x7f30f8145960 2020-04-22T14:15:00.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.800+0000 7f30e7fff700 1 -- 172.21.15.103:0/3288795315 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4013044656 0 0) 0x7f30f80b79f0 con 0x7f30f80b0ed0 2020-04-22T14:15:00.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.800+0000 7f30e7fff700 1 -- 172.21.15.103:0/3288795315 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30f80b7c90 con 0x7f30f80b0ed0 2020-04-22T14:15:00.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.800+0000 7f30fd853700 1 -- 172.21.15.103:0/3288795315 >> v1:172.21.15.103:6789/0 conn(0x7f30f8145960 legacy=0x7f30f8064fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:00.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.800+0000 7f30e7fff700 1 -- 172.21.15.103:0/3288795315 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1409050725 0 0) 0x7f30e0003230 con 0x7f30f8145960 2020-04-22T14:15:00.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.800+0000 7f30fd853700 1 -- 172.21.15.103:0/3288795315 >> v1:172.21.15.86:6789/0 conn(0x7f30f80b0ed0 legacy=0x7f30f80b70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:00.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.800+0000 7f30fd853700 1 -- 172.21.15.103:0/3288795315 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f80b7f30 con 0x7f30f8145dc0 2020-04-22T14:15:00.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.800+0000 7f30fd853700 1 --2- 172.21.15.103:0/3288795315 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f30f8145dc0 0x7f30f80656e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f30f00032b0 tx=0x7f30f0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:00.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.800+0000 7f30fd853700 1 --2- 172.21.15.103:0/3288795315 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f30f8145dc0 0x7f30f80656e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f30f00032b0 tx=0x7f30f0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:00.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.800+0000 7f30fd853700 1 --2- 172.21.15.103:0/3288795315 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f30f8145dc0 0x7f30f80656e0 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7f30f00032b0 tx=0x7f30f0008c60).ready entity=mon.2 client_cookie=b7ab947b6496e7ca server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:00.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.800+0000 7f30fd853700 1 --2- 172.21.15.103:0/3288795315 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f30f8145dc0 0x7f30f80656e0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f30f00032b0 tx=0x7f30f0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:00.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.800+0000 7f30e7fff700 1 -- 172.21.15.103:0/3288795315 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30f0011db0 con 0x7f30f8145dc0 2020-04-22T14:15:00.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.800+0000 7f30fd853700 1 --2- 172.21.15.103:0/3288795315 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f30f8145dc0 0x7f30f80656e0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f30f00032b0 tx=0x7f30f0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:00.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.800+0000 7f30e7fff700 1 -- 172.21.15.103:0/3288795315 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f000a180 con 0x7f30f8145dc0 2020-04-22T14:15:00.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.800+0000 7f30fd853700 1 --2- 172.21.15.103:0/3288795315 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f30f8145dc0 0x7f30f80656e0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f30f00032b0 tx=0x7f30f0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:00.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.800+0000 7f30e7fff700 1 -- 172.21.15.103:0/3288795315 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30f000a520 con 0x7f30f8145dc0 2020-04-22T14:15:00.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.800+0000 7f30ff2b6700 1 -- 172.21.15.103:0/3288795315 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f30f8145dc0 msgr2=0x7f30f80656e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:00.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.800+0000 7f30ff2b6700 1 --2- 172.21.15.103:0/3288795315 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f30f8145dc0 0x7f30f80656e0 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7f30f00032b0 tx=0x7f30f0008c60).stop 2020-04-22T14:15:00.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.801+0000 7f30ff2b6700 1 -- 172.21.15.103:0/3288795315 shutdown_connections 2020-04-22T14:15:00.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.801+0000 7f30ff2b6700 1 --2- 172.21.15.103:0/3288795315 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f30f8145dc0 0x7f30f80656e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:00.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.801+0000 7f30ff2b6700 1 -- 172.21.15.103:0/3288795315 >> 172.21.15.103:0/3288795315 conn(0x7f30f805f2c0 msgr2=0x7f30f8061fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:00.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.801+0000 7f30ff2b6700 1 -- 172.21.15.103:0/3288795315 shutdown_connections 2020-04-22T14:15:00.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.801+0000 7f30ff2b6700 1 -- 172.21.15.103:0/3288795315 wait complete. 2020-04-22T14:15:00.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.802+0000 7f30ff2b6700 1 Processor -- start 2020-04-22T14:15:00.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.802+0000 7f30ff2b6700 1 -- start start 2020-04-22T14:15:00.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.802+0000 7f30ff2b6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f30f80b0ed0 0x7f30f80ba7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:00.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.802+0000 7f30ff2b6700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f30f8145960 0x7f30f80bae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:00.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.802+0000 7f30ff2b6700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f30f8145dc0 0x7f30f80b64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:00.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.802+0000 7f30ff2b6700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f80b6920 con 0x7f30f8145960 2020-04-22T14:15:00.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.802+0000 7f30ff2b6700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f80bb3c0 con 0x7f30f8145dc0 2020-04-22T14:15:00.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.802+0000 7f30ff2b6700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f8157280 con 0x7f30f80b0ed0 2020-04-22T14:15:00.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.802+0000 7f30fd853700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f30f8145dc0 0x7f30f80b64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:00.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.802+0000 7f30fd853700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f30f8145dc0 0x7f30f80b64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54730/0 (socket says 172.21.15.103:54730) 2020-04-22T14:15:00.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.802+0000 7f30fd853700 1 -- 172.21.15.103:0/719092503 learned_addr learned my addr 172.21.15.103:0/719092503 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:15:00.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.802+0000 7f30fc851700 1 --2- 172.21.15.103:0/719092503 >> v2:172.21.15.86:3300/0 conn(0x7f30f8145960 0x7f30f80bae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:00.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.802+0000 7f30fd052700 1 --2- 172.21.15.103:0/719092503 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f30f80b0ed0 0x7f30f80ba7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:00.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.803+0000 7f30fd853700 1 -- 172.21.15.103:0/719092503 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f30f80b0ed0 msgr2=0x7f30f80ba7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:00.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.803+0000 7f30fd853700 1 --2- 172.21.15.103:0/719092503 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f30f80b0ed0 0x7f30f80ba7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:00.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.803+0000 7f30fd853700 1 -- 172.21.15.103:0/719092503 >> v2:172.21.15.86:3300/0 conn(0x7f30f8145960 msgr2=0x7f30f80bae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:00.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.803+0000 7f30fd853700 1 --2- 172.21.15.103:0/719092503 >> v2:172.21.15.86:3300/0 conn(0x7f30f8145960 0x7f30f80bae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:00.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.803+0000 7f30fd853700 1 -- 172.21.15.103:0/719092503 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f8157520 con 0x7f30f8145dc0 2020-04-22T14:15:00.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.803+0000 7f30fd853700 1 --2- 172.21.15.103:0/719092503 >> v2:172.21.15.103:3300/0 conn(0x7f30f8145dc0 0x7f30f80b64c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f30f00032b0 tx=0x7f30f8064c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:00.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.803+0000 7f30fd853700 1 --2- 172.21.15.103:0/719092503 >> v2:172.21.15.103:3300/0 conn(0x7f30f8145dc0 0x7f30f80b64c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f30f00032b0 tx=0x7f30f8064c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:00.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.803+0000 7f30fd853700 1 --2- 172.21.15.103:0/719092503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30f8145dc0 0x7f30f80b64c0 secure :-1 s=READY pgs=1420 cs=0 l=1 rx=0x7f30f00032b0 tx=0x7f30f8064c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:00.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.803+0000 7f30fd853700 1 --2- 172.21.15.103:0/719092503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30f8145dc0 0x7f30f80b64c0 secure :-1 s=THROTTLE_DONE pgs=1420 cs=0 l=1 rx=0x7f30f00032b0 tx=0x7f30f8064c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:00.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.803+0000 7f30e67fc700 1 -- 172.21.15.103:0/719092503 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30f0005c30 con 0x7f30f8145dc0 2020-04-22T14:15:00.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.803+0000 7f30fd853700 1 --2- 172.21.15.103:0/719092503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30f8145dc0 0x7f30f80b64c0 secure :-1 s=THROTTLE_DONE pgs=1420 cs=0 l=1 rx=0x7f30f00032b0 tx=0x7f30f8064c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:00.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.803+0000 7f30fd853700 1 --2- 172.21.15.103:0/719092503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30f8145dc0 0x7f30f80b64c0 secure :-1 s=THROTTLE_DONE pgs=1420 cs=0 l=1 rx=0x7f30f00032b0 tx=0x7f30f8064c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:00.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.803+0000 7f30e67fc700 1 -- 172.21.15.103:0/719092503 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f0005d90 con 0x7f30f8145dc0 2020-04-22T14:15:00.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.803+0000 7f30ff2b6700 1 -- 172.21.15.103:0/719092503 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f8147470 con 0x7f30f8145dc0 2020-04-22T14:15:00.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.803+0000 7f30e67fc700 1 -- 172.21.15.103:0/719092503 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30f000f7a0 con 0x7f30f8145dc0 2020-04-22T14:15:00.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.803+0000 7f30ff2b6700 1 -- 172.21.15.103:0/719092503 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f8157c00 con 0x7f30f8145dc0 2020-04-22T14:15:00.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.804+0000 7f30fd853700 1 --2- 172.21.15.103:0/719092503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30f8145dc0 0x7f30f80b64c0 secure :-1 s=THROTTLE_DONE pgs=1420 cs=0 l=1 rx=0x7f30f00032b0 tx=0x7f30f8064c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:00.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.804+0000 7f30e67fc700 1 -- 172.21.15.103:0/719092503 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f30f000f9d0 con 0x7f30f8145dc0 2020-04-22T14:15:00.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.804+0000 7f30fd853700 1 --2- 172.21.15.103:0/719092503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30f8145dc0 0x7f30f80b64c0 secure :-1 s=THROTTLE_DONE pgs=1420 cs=0 l=1 rx=0x7f30f00032b0 tx=0x7f30f8064c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:00.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.804+0000 7f30ff2b6700 1 -- 172.21.15.103:0/719092503 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f8056c90 con 0x7f30f8145dc0 2020-04-22T14:15:00.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.804+0000 7f30e67fc700 1 --2- 172.21.15.103:0/719092503 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f30d804da30 0x7f30d804fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:00.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.804+0000 7f30e67fc700 1 -- 172.21.15.103:0/719092503 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f30f0062460 con 0x7f30f8145dc0 2020-04-22T14:15:00.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.805+0000 7f30fd052700 1 --2- 172.21.15.103:0/719092503 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f30d804da30 0x7f30d804fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:00.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.805+0000 7f30fd052700 1 --2- 172.21.15.103:0/719092503 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f30d804da30 0x7f30d804fef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f30e80010d0 tx=0x7f30e8003e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:00.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.805+0000 7f30fd052700 1 --2- 172.21.15.103:0/719092503 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f30d804da30 0x7f30d804fef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f30e80010d0 tx=0x7f30e8003e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:00.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.805+0000 7f30fd052700 1 --2- 172.21.15.103:0/719092503 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f30d804da30 0x7f30d804fef0 secure :-1 s=READY pgs=518 cs=0 l=1 rx=0x7f30e80010d0 tx=0x7f30e8003e60).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:00.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.809+0000 7f30fd853700 1 --2- 172.21.15.103:0/719092503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30f8145dc0 0x7f30f80b64c0 secure :-1 s=THROTTLE_DONE pgs=1420 cs=0 l=1 rx=0x7f30f00032b0 tx=0x7f30f8064c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:00.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:00.809+0000 7f30e67fc700 1 -- 172.21.15.103:0/719092503 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f30f003d900 con 0x7f30f8145dc0 2020-04-22T14:15:01.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:01.002+0000 7f30ff2b6700 1 -- 172.21.15.103:0/719092503 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_evicted_caps"]} v 0) v1 -- 0x7f30f80b70b0 con 0x7f30f8145dc0 2020-04-22T14:15:01.625 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:01.622+0000 7f30fd853700 1 --2- 172.21.15.103:0/719092503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30f8145dc0 0x7f30f80b64c0 secure :-1 s=THROTTLE_DONE pgs=1420 cs=0 l=1 rx=0x7f30f00032b0 tx=0x7f30f8064c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:01.625 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:01.622+0000 7f30e67fc700 1 -- 172.21.15.103:0/719092503 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_evicted_caps"]}]=0 v536) v1 ==== 152+0+0 (secure 0 0 0) 0x7f30f0040f20 con 0x7f30f8145dc0 2020-04-22T14:15:01.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:01.623+0000 7f30ff2b6700 1 -- 172.21.15.103:0/719092503 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f30d804da30 msgr2=0x7f30d804fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:01.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:01.623+0000 7f30ff2b6700 1 --2- 172.21.15.103:0/719092503 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f30d804da30 0x7f30d804fef0 secure :-1 s=READY pgs=518 cs=0 l=1 rx=0x7f30e80010d0 tx=0x7f30e8003e60).stop 2020-04-22T14:15:01.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:01.623+0000 7f30ff2b6700 1 -- 172.21.15.103:0/719092503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30f8145dc0 msgr2=0x7f30f80b64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:01.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:01.623+0000 7f30ff2b6700 1 --2- 172.21.15.103:0/719092503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30f8145dc0 0x7f30f80b64c0 secure :-1 s=READY pgs=1420 cs=0 l=1 rx=0x7f30f00032b0 tx=0x7f30f8064c40).stop 2020-04-22T14:15:01.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:01.623+0000 7f30ff2b6700 1 -- 172.21.15.103:0/719092503 shutdown_connections 2020-04-22T14:15:01.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:01.623+0000 7f30ff2b6700 1 --2- 172.21.15.103:0/719092503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30f8145dc0 0x7f30f80b64c0 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:01.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:01.623+0000 7f30ff2b6700 1 --2- 172.21.15.103:0/719092503 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f30f80b0ed0 0x7f30f80ba7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:01.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:01.623+0000 7f30ff2b6700 1 --2- 172.21.15.103:0/719092503 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f30d804da30 0x7f30d804fef0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:01.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:01.623+0000 7f30ff2b6700 1 --2- 172.21.15.103:0/719092503 >> v2:172.21.15.86:3300/0 conn(0x7f30f8145960 0x7f30f80bae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:01.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:01.623+0000 7f30ff2b6700 1 -- 172.21.15.103:0/719092503 >> 172.21.15.103:0/719092503 conn(0x7f30f805f2c0 msgr2=0x7f30f8144d10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:01.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:01.624+0000 7f30ff2b6700 1 -- 172.21.15.103:0/719092503 shutdown_connections 2020-04-22T14:15:01.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:01.624+0000 7f30ff2b6700 1 -- 172.21.15.103:0/719092503 wait complete. 2020-04-22T14:15:01.638 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-04-22T14:15:01.638 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:15:01.654 INFO:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:15:01.745 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:01.762 INFO:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:15:01.853 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-04-22T14:15:01.853 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:01.868 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2020-04-22T14:15:02.015 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.012+0000 7fa06b4ca700 1 Processor -- start 2020-04-22T14:15:02.015 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.012+0000 7fa06b4ca700 1 -- start start 2020-04-22T14:15:02.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.013+0000 7fa06b4ca700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa06412c0d0 0x7fa0641464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:02.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.013+0000 7fa06b4ca700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa064063e30 0x7fa0640642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:02.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.013+0000 7fa06b4ca700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa064143300 con 0x7fa064065fe0 2020-04-22T14:15:02.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.013+0000 7fa06b4ca700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0641435a0 con 0x7fa06412c0d0 2020-04-22T14:15:02.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.013+0000 7fa06b4ca700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa064143840 con 0x7fa064063e30 2020-04-22T14:15:02.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.013+0000 7fa069a67700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa064063e30 0x7fa0640642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:02.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.013+0000 7fa068a65700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa064065fe0 0x7fa06405b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46926/0 (socket says 172.21.15.103:46926) 2020-04-22T14:15:02.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.013+0000 7fa068a65700 1 -- 172.21.15.103:0/1629798860 learned_addr learned my addr 172.21.15.103:0/1629798860 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:02.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.013+0000 7fa069a67700 1 -- 172.21.15.103:0/1629798860 >> v2:172.21.15.86:3300/0 conn(0x7fa06412c0d0 msgr2=0x7fa0641464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:02.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.013+0000 7fa069266700 1 --2- 172.21.15.103:0/1629798860 >> v2:172.21.15.86:3300/0 conn(0x7fa06412c0d0 0x7fa0641464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:02.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.013+0000 7fa053fff700 1 -- 172.21.15.103:0/1629798860 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 999163417 0 0) 0x7fa064143300 con 0x7fa064065fe0 2020-04-22T14:15:02.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.013+0000 7fa069a67700 1 --2- 172.21.15.103:0/1629798860 >> v2:172.21.15.86:3300/0 conn(0x7fa06412c0d0 0x7fa0641464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:02.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.014+0000 7fa069a67700 1 -- 172.21.15.103:0/1629798860 >> v1:172.21.15.103:6789/0 conn(0x7fa064065fe0 legacy=0x7fa06405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:02.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.014+0000 7fa069a67700 1 -- 172.21.15.103:0/1629798860 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa06405bb50 con 0x7fa064063e30 2020-04-22T14:15:02.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.014+0000 7fa069a67700 1 --2- 172.21.15.103:0/1629798860 >> v2:172.21.15.103:3300/0 conn(0x7fa064063e30 0x7fa0640642c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa05c0032b0 tx=0x7fa05c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.014+0000 7fa069a67700 1 --2- 172.21.15.103:0/1629798860 >> v2:172.21.15.103:3300/0 conn(0x7fa064063e30 0x7fa0640642c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa05c0032b0 tx=0x7fa05c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.014+0000 7fa069a67700 1 --2- 172.21.15.103:0/1629798860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa064063e30 0x7fa0640642c0 secure :-1 s=READY pgs=1422 cs=0 l=1 rx=0x7fa05c0032b0 tx=0x7fa05c007dc0).ready entity=mon.1 client_cookie=230ba95f990b7b5a server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:02.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.014+0000 7fa069a67700 1 --2- 172.21.15.103:0/1629798860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa064063e30 0x7fa0640642c0 secure :-1 s=THROTTLE_DONE pgs=1422 cs=0 l=1 rx=0x7fa05c0032b0 tx=0x7fa05c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.014+0000 7fa053fff700 1 -- 172.21.15.103:0/1629798860 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa05c00a180 con 0x7fa064063e30 2020-04-22T14:15:02.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.014+0000 7fa069a67700 1 --2- 172.21.15.103:0/1629798860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa064063e30 0x7fa0640642c0 secure :-1 s=THROTTLE_DONE pgs=1422 cs=0 l=1 rx=0x7fa05c0032b0 tx=0x7fa05c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.014+0000 7fa069a67700 1 --2- 172.21.15.103:0/1629798860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa064063e30 0x7fa0640642c0 secure :-1 s=THROTTLE_DONE pgs=1422 cs=0 l=1 rx=0x7fa05c0032b0 tx=0x7fa05c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.014+0000 7fa053fff700 1 -- 172.21.15.103:0/1629798860 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05c00a2e0 con 0x7fa064063e30 2020-04-22T14:15:02.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.014+0000 7fa053fff700 1 -- 172.21.15.103:0/1629798860 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa05c00a6c0 con 0x7fa064063e30 2020-04-22T14:15:02.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.014+0000 7fa06b4ca700 1 -- 172.21.15.103:0/1629798860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa064063e30 msgr2=0x7fa0640642c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:02.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.014+0000 7fa06b4ca700 1 --2- 172.21.15.103:0/1629798860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa064063e30 0x7fa0640642c0 secure :-1 s=READY pgs=1422 cs=0 l=1 rx=0x7fa05c0032b0 tx=0x7fa05c007dc0).stop 2020-04-22T14:15:02.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.014+0000 7fa06b4ca700 1 -- 172.21.15.103:0/1629798860 shutdown_connections 2020-04-22T14:15:02.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.014+0000 7fa06b4ca700 1 --2- 172.21.15.103:0/1629798860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa064063e30 0x7fa0640642c0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:02.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.014+0000 7fa06b4ca700 1 --2- 172.21.15.103:0/1629798860 >> v2:172.21.15.86:3300/0 conn(0x7fa06412c0d0 0x7fa0641464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:02.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.014+0000 7fa06b4ca700 1 -- 172.21.15.103:0/1629798860 >> 172.21.15.103:0/1629798860 conn(0x7fa0640b9160 msgr2=0x7fa06405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:02.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.014+0000 7fa06b4ca700 1 -- 172.21.15.103:0/1629798860 shutdown_connections 2020-04-22T14:15:02.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.014+0000 7fa06b4ca700 1 -- 172.21.15.103:0/1629798860 wait complete. 2020-04-22T14:15:02.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.015+0000 7fa06b4ca700 1 Processor -- start 2020-04-22T14:15:02.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.015+0000 7fa06b4ca700 1 -- start start 2020-04-22T14:15:02.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.016+0000 7fa06b4ca700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa064063e30 0x7fa0640af820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:02.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.016+0000 7fa06b4ca700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0640af0e0 con 0x7fa064065fe0 2020-04-22T14:15:02.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.016+0000 7fa06b4ca700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0640af380 con 0x7fa06412c0d0 2020-04-22T14:15:02.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.016+0000 7fa06b4ca700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0640aeed0 con 0x7fa064063e30 2020-04-22T14:15:02.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.016+0000 7fa069a67700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa06412c0d0 0x7fa064126180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46934/0 (socket says 172.21.15.103:46934) 2020-04-22T14:15:02.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.016+0000 7fa069a67700 1 -- 172.21.15.103:0/407519215 learned_addr learned my addr 172.21.15.103:0/407519215 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:02.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.016+0000 7fa0527fc700 1 -- 172.21.15.103:0/407519215 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4050747531 0 0) 0x7fa0640af380 con 0x7fa06412c0d0 2020-04-22T14:15:02.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.016+0000 7fa0527fc700 1 -- 172.21.15.103:0/407519215 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa044002fe0 con 0x7fa06412c0d0 2020-04-22T14:15:02.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.016+0000 7fa069266700 1 --2- 172.21.15.103:0/407519215 >> v2:172.21.15.86:3300/0 conn(0x7fa064063e30 0x7fa0640af820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:02.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.017+0000 7fa0527fc700 1 -- 172.21.15.103:0/407519215 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3159425563 0 0) 0x7fa044002fe0 con 0x7fa06412c0d0 2020-04-22T14:15:02.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.017+0000 7fa0527fc700 1 -- 172.21.15.103:0/407519215 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa0640af380 con 0x7fa06412c0d0 2020-04-22T14:15:02.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.017+0000 7fa0527fc700 1 -- 172.21.15.103:0/407519215 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fa05c0089e0 con 0x7fa06412c0d0 2020-04-22T14:15:02.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.017+0000 7fa0527fc700 1 -- 172.21.15.103:0/407519215 >> v2:172.21.15.86:3300/0 conn(0x7fa064063e30 msgr2=0x7fa0640af820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:02.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.017+0000 7fa0527fc700 1 --2- 172.21.15.103:0/407519215 >> v2:172.21.15.86:3300/0 conn(0x7fa064063e30 0x7fa0640af820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:02.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.017+0000 7fa0527fc700 1 -- 172.21.15.103:0/407519215 >> v1:172.21.15.103:6789/0 conn(0x7fa06412c0d0 legacy=0x7fa064126180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:02.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.017+0000 7fa0527fc700 1 -- 172.21.15.103:0/407519215 >> v1:172.21.15.86:6789/0 conn(0x7fa064065fe0 legacy=0x7fa064141fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:02.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.017+0000 7fa0527fc700 1 --2- 172.21.15.103:0/407519215 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa0440049b0 0x7fa044004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:02.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.017+0000 7fa0527fc700 1 --2- 172.21.15.103:0/407519215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0440052b0 0x7fa0440039c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:02.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.017+0000 7fa0527fc700 1 --2- 172.21.15.103:0/407519215 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa044003f30 0x7fa0440043b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:02.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.017+0000 7fa0527fc700 1 -- 172.21.15.103:0/407519215 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0640aeed0 con 0x7fa044003f30 2020-04-22T14:15:02.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.017+0000 7fa0527fc700 1 -- 172.21.15.103:0/407519215 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04400b8b0 con 0x7fa0440052b0 2020-04-22T14:15:02.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.017+0000 7fa0527fc700 1 -- 172.21.15.103:0/407519215 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa04400ba70 con 0x7fa0440049b0 2020-04-22T14:15:02.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.017+0000 7fa068a65700 1 --2- 172.21.15.103:0/407519215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0440052b0 0x7fa0440039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:02.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.017+0000 7fa069a67700 1 --2- 172.21.15.103:0/407519215 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa044003f30 0x7fa0440043b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:02.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.017+0000 7fa069266700 1 --2- 172.21.15.103:0/407519215 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa0440049b0 0x7fa044004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:02.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.017+0000 7fa068a65700 1 -- 172.21.15.103:0/407519215 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa0440049b0 msgr2=0x7fa044004d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:02.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.017+0000 7fa068a65700 1 --2- 172.21.15.103:0/407519215 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa0440049b0 0x7fa044004d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:02.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.017+0000 7fa068a65700 1 -- 172.21.15.103:0/407519215 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa044003f30 msgr2=0x7fa0440043b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:02.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.017+0000 7fa068a65700 1 --2- 172.21.15.103:0/407519215 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa044003f30 0x7fa0440043b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:02.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.017+0000 7fa068a65700 1 -- 172.21.15.103:0/407519215 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa06412ac30 con 0x7fa0440052b0 2020-04-22T14:15:02.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.017+0000 7fa069a67700 1 -- 172.21.15.103:0/407519215 reap_dead start 2020-04-22T14:15:02.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.017+0000 7fa06b4ca700 1 -- 172.21.15.103:0/407519215 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0640ae9a0 con 0x7fa0440052b0 2020-04-22T14:15:02.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.017+0000 7fa068a65700 1 --2- 172.21.15.103:0/407519215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0440052b0 0x7fa0440039c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa064129ec0 tx=0x7fa060001e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.017+0000 7fa068a65700 1 --2- 172.21.15.103:0/407519215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0440052b0 0x7fa0440039c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa064129ec0 tx=0x7fa060001e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.017+0000 7fa068a65700 1 --2- 172.21.15.103:0/407519215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0440052b0 0x7fa0440039c0 secure :-1 s=READY pgs=1424 cs=0 l=1 rx=0x7fa064129ec0 tx=0x7fa060001e60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:02.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.017+0000 7fa06b4ca700 1 -- 172.21.15.103:0/407519215 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0640af820 con 0x7fa0440052b0 2020-04-22T14:15:02.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.017+0000 7fa068a65700 1 --2- 172.21.15.103:0/407519215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0440052b0 0x7fa0440039c0 secure :-1 s=THROTTLE_DONE pgs=1424 cs=0 l=1 rx=0x7fa064129ec0 tx=0x7fa060001e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.017+0000 7fa0527fc700 1 -- 172.21.15.103:0/407519215 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa06000c930 con 0x7fa0440052b0 2020-04-22T14:15:02.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.017+0000 7fa068a65700 1 --2- 172.21.15.103:0/407519215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0440052b0 0x7fa0440039c0 secure :-1 s=THROTTLE_DONE pgs=1424 cs=0 l=1 rx=0x7fa064129ec0 tx=0x7fa060001e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.017+0000 7fa068a65700 1 --2- 172.21.15.103:0/407519215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0440052b0 0x7fa0440039c0 secure :-1 s=THROTTLE_DONE pgs=1424 cs=0 l=1 rx=0x7fa064129ec0 tx=0x7fa060001e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.017+0000 7fa0527fc700 1 -- 172.21.15.103:0/407519215 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06000ca90 con 0x7fa0440052b0 2020-04-22T14:15:02.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.017+0000 7fa0527fc700 1 -- 172.21.15.103:0/407519215 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa06000cdf0 con 0x7fa0440052b0 2020-04-22T14:15:02.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.018+0000 7fa068a65700 1 --2- 172.21.15.103:0/407519215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0440052b0 0x7fa0440039c0 secure :-1 s=THROTTLE_DONE pgs=1424 cs=0 l=1 rx=0x7fa064129ec0 tx=0x7fa060001e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.018+0000 7fa0527fc700 1 -- 172.21.15.103:0/407519215 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fa0600055e0 con 0x7fa0440052b0 2020-04-22T14:15:02.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.018+0000 7fa068a65700 1 --2- 172.21.15.103:0/407519215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0440052b0 0x7fa0440039c0 secure :-1 s=THROTTLE_DONE pgs=1424 cs=0 l=1 rx=0x7fa064129ec0 tx=0x7fa060001e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.018+0000 7fa06b4ca700 1 -- 172.21.15.103:0/407519215 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0640afad0 con 0x7fa0440052b0 2020-04-22T14:15:02.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.018+0000 7fa0527fc700 1 --2- 172.21.15.103:0/407519215 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa0440517b0 0x7fa044053c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:02.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.019+0000 7fa0527fc700 1 -- 172.21.15.103:0/407519215 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fa0600100c0 con 0x7fa0440052b0 2020-04-22T14:15:02.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.019+0000 7fa069266700 1 --2- 172.21.15.103:0/407519215 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa0440517b0 0x7fa044053c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:02.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.019+0000 7fa069266700 1 --2- 172.21.15.103:0/407519215 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa0440517b0 0x7fa044053c70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa054002f30 tx=0x7fa05400c8b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.019+0000 7fa069266700 1 --2- 172.21.15.103:0/407519215 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa0440517b0 0x7fa044053c70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa054002f30 tx=0x7fa05400c8b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.019+0000 7fa069266700 1 --2- 172.21.15.103:0/407519215 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa0440517b0 0x7fa044053c70 secure :-1 s=READY pgs=519 cs=0 l=1 rx=0x7fa054002f30 tx=0x7fa05400c8b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:02.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.023+0000 7fa068a65700 1 --2- 172.21.15.103:0/407519215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0440052b0 0x7fa0440039c0 secure :-1 s=THROTTLE_DONE pgs=1424 cs=0 l=1 rx=0x7fa064129ec0 tx=0x7fa060001e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.023+0000 7fa0527fc700 1 -- 172.21.15.103:0/407519215 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fa06003c240 con 0x7fa0440052b0 2020-04-22T14:15:02.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.172+0000 7fa06b4ca700 1 -- 172.21.15.103:0/407519215 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa064056c90 con 0x7fa0440052b0 2020-04-22T14:15:02.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.174+0000 7fa068a65700 1 --2- 172.21.15.103:0/407519215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0440052b0 0x7fa0440039c0 secure :-1 s=THROTTLE_DONE pgs=1424 cs=0 l=1 rx=0x7fa064129ec0 tx=0x7fa060001e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.174+0000 7fa0527fc700 1 -- 172.21.15.103:0/407519215 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v91) v1 ==== 81+0+33773 (secure 0 0 0) 0x7fa06003f860 con 0x7fa0440052b0 2020-04-22T14:15:02.177 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:15:02.178 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:15:02.178 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 91, 2020-04-22T14:15:02.178 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:15:02.178 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2020-04-22T14:02:06.484738+0000", 2020-04-22T14:15:02.178 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2020-04-22T14:14:54.591428+0000", 2020-04-22T14:15:02.178 INFO:teuthology.orchestra.run.smithi103.stdout: "last_up_change": "2020-04-22T14:02:18.623774+0000", 2020-04-22T14:15:02.178 INFO:teuthology.orchestra.run.smithi103.stdout: "last_in_change": "2020-04-22T14:02:18.623774+0000", 2020-04-22T14:15:02.179 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-04-22T14:15:02.179 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_num": 5799936, 2020-04-22T14:15:02.179 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_set": [ 2020-04-22T14:15:02.179 INFO:teuthology.orchestra.run.smithi103.stdout: "pglog_hardlimit", 2020-04-22T14:15:02.179 INFO:teuthology.orchestra.run.smithi103.stdout: "purged_snapdirs", 2020-04-22T14:15:02.179 INFO:teuthology.orchestra.run.smithi103.stdout: "recovery_deletes", 2020-04-22T14:15:02.179 INFO:teuthology.orchestra.run.smithi103.stdout: "sortbitwise" 2020-04-22T14:15:02.180 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:15:02.180 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_version": 5, 2020-04-22T14:15:02.180 INFO:teuthology.orchestra.run.smithi103.stdout: "full_ratio": 0.94999998807907104, 2020-04-22T14:15:02.180 INFO:teuthology.orchestra.run.smithi103.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-04-22T14:15:02.180 INFO:teuthology.orchestra.run.smithi103.stdout: "nearfull_ratio": 0.85000002384185791, 2020-04-22T14:15:02.180 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_snapshot": "", 2020-04-22T14:15:02.180 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_max": 16, 2020-04-22T14:15:02.181 INFO:teuthology.orchestra.run.smithi103.stdout: "max_osd": 8, 2020-04-22T14:15:02.181 INFO:teuthology.orchestra.run.smithi103.stdout: "require_min_compat_client": "luminous", 2020-04-22T14:15:02.181 INFO:teuthology.orchestra.run.smithi103.stdout: "min_compat_client": "jewel", 2020-04-22T14:15:02.181 INFO:teuthology.orchestra.run.smithi103.stdout: "require_osd_release": "pacific", 2020-04-22T14:15:02.181 INFO:teuthology.orchestra.run.smithi103.stdout: "pools": [ 2020-04-22T14:15:02.181 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.182 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 1, 2020-04-22T14:15:02.182 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "device_health_metrics", 2020-04-22T14:15:02.182 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:02:09.565655+0000", 2020-04-22T14:15:02.182 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:15:02.182 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:15:02.182 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:15:02.182 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:15:02.183 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:15:02.183 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:15:02.183 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:15:02.183 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:15:02.183 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 1, 2020-04-22T14:15:02.183 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 1, 2020-04-22T14:15:02.183 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 1, 2020-04-22T14:15:02.183 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 1, 2020-04-22T14:15:02.184 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 1, 2020-04-22T14:15:02.184 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:15:02.184 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:15:02.184 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:15:02.184 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:15:02.184 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:15:02.184 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:15:02.184 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:15:02.185 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.185 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "17", 2020-04-22T14:15:02.185 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:15:02.185 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:15:02.185 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:15:02.185 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:15:02.185 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:15:02.186 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:15:02.186 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:15:02.186 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:15:02.186 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:15:02.186 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:15:02.186 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:15:02.186 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:15:02.186 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:15:02.187 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:15:02.187 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:15:02.187 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:15:02.187 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:15:02.187 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:15:02.187 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:15:02.187 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:15:02.188 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:15:02.188 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:15:02.188 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:15:02.188 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:15:02.188 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:15:02.188 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:15:02.188 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.189 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:15:02.189 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:15:02.189 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:15:02.189 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:15:02.189 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:15:02.189 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:15:02.189 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:15:02.190 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:15:02.190 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:15:02.190 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:15:02.190 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:15:02.190 INFO:teuthology.orchestra.run.smithi103.stdout: "options": { 2020-04-22T14:15:02.190 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_min": 1 2020-04-22T14:15:02.190 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.190 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:15:02.191 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_devicehealth": {} 2020-04-22T14:15:02.191 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.191 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.191 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.191 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 2, 2020-04-22T14:15:02.191 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "rbd", 2020-04-22T14:15:02.191 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:02:22.733031+0000", 2020-04-22T14:15:02.192 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:15:02.192 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:15:02.192 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:15:02.192 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:15:02.192 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:15:02.192 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:15:02.192 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:15:02.192 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:15:02.193 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 8, 2020-04-22T14:15:02.193 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 8, 2020-04-22T14:15:02.193 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 8, 2020-04-22T14:15:02.193 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 8, 2020-04-22T14:15:02.193 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 8, 2020-04-22T14:15:02.193 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:15:02.193 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:15:02.193 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:15:02.194 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:15:02.194 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:15:02.194 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:15:02.194 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:15:02.194 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.194 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "20", 2020-04-22T14:15:02.194 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:15:02.195 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:15:02.195 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:15:02.195 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:15:02.195 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:15:02.195 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:15:02.195 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:15:02.195 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:15:02.195 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:15:02.198 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:15:02.199 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:15:02.199 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:15:02.199 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:15:02.199 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:15:02.199 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:15:02.199 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:15:02.199 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:15:02.200 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:15:02.200 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:15:02.200 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:15:02.200 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:15:02.200 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:15:02.200 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:15:02.200 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:15:02.200 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:15:02.201 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:15:02.201 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.201 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:15:02.201 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:15:02.201 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:15:02.201 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:15:02.201 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:15:02.202 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:15:02.202 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:15:02.202 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:15:02.202 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:15:02.202 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:15:02.202 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:15:02.202 INFO:teuthology.orchestra.run.smithi103.stdout: "options": {}, 2020-04-22T14:15:02.202 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:15:02.203 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd": {} 2020-04-22T14:15:02.203 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.203 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.203 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.203 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 15, 2020-04-22T14:15:02.203 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "cephfs_metadata", 2020-04-22T14:15:02.203 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:13:56.741291+0000", 2020-04-22T14:15:02.203 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:15:02.204 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:15:02.204 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:15:02.204 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:15:02.204 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:15:02.204 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:15:02.204 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:15:02.204 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:15:02.205 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 8, 2020-04-22T14:15:02.205 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 8, 2020-04-22T14:15:02.205 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 8, 2020-04-22T14:15:02.205 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 8, 2020-04-22T14:15:02.205 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 8, 2020-04-22T14:15:02.205 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:15:02.205 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:15:02.205 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:15:02.206 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:15:02.206 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:15:02.206 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:15:02.206 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:15:02.206 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.206 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "89", 2020-04-22T14:15:02.206 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:15:02.206 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:15:02.207 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:15:02.207 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:15:02.207 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:15:02.207 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:15:02.207 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:15:02.207 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:15:02.207 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:15:02.208 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:15:02.208 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:15:02.208 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:15:02.208 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:15:02.208 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:15:02.208 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:15:02.209 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:15:02.209 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:15:02.209 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:15:02.209 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:15:02.209 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:15:02.209 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:15:02.209 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:15:02.209 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:15:02.210 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:15:02.210 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:15:02.210 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:15:02.210 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.210 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:15:02.210 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:15:02.210 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:15:02.210 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:15:02.211 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:15:02.211 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:15:02.211 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:15:02.211 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:15:02.211 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:15:02.211 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:15:02.211 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:15:02.212 INFO:teuthology.orchestra.run.smithi103.stdout: "options": { 2020-04-22T14:15:02.212 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_bias": 4, 2020-04-22T14:15:02.212 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_min": 16, 2020-04-22T14:15:02.212 INFO:teuthology.orchestra.run.smithi103.stdout: "recovery_priority": 5 2020-04-22T14:15:02.212 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.212 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:15:02.213 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs": { 2020-04-22T14:15:02.213 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": "cephfs" 2020-04-22T14:15:02.213 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.213 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.213 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.213 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.213 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 16, 2020-04-22T14:15:02.213 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "cephfs_data", 2020-04-22T14:15:02.214 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:13:57.809563+0000", 2020-04-22T14:15:02.214 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:15:02.214 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:15:02.214 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:15:02.214 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:15:02.214 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:15:02.215 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:15:02.215 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:15:02.215 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:15:02.215 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 8, 2020-04-22T14:15:02.215 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 8, 2020-04-22T14:15:02.215 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 8, 2020-04-22T14:15:02.216 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 8, 2020-04-22T14:15:02.216 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 8, 2020-04-22T14:15:02.216 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:15:02.216 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:15:02.216 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:15:02.216 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:15:02.216 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:15:02.217 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:15:02.217 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:15:02.217 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.217 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "90", 2020-04-22T14:15:02.217 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:15:02.217 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:15:02.217 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:15:02.218 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:15:02.218 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:15:02.218 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:15:02.218 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:15:02.218 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:15:02.218 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:15:02.218 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:15:02.218 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:15:02.219 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:15:02.219 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:15:02.219 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:15:02.219 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:15:02.219 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:15:02.219 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:15:02.219 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:15:02.219 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:15:02.220 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:15:02.220 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:15:02.220 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:15:02.220 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:15:02.220 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:15:02.220 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:15:02.220 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:15:02.221 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.221 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:15:02.221 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:15:02.221 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:15:02.221 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:15:02.221 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:15:02.221 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:15:02.221 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:15:02.222 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:15:02.222 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:15:02.222 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:15:02.222 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:15:02.222 INFO:teuthology.orchestra.run.smithi103.stdout: "options": {}, 2020-04-22T14:15:02.222 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:15:02.222 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs": { 2020-04-22T14:15:02.222 INFO:teuthology.orchestra.run.smithi103.stdout: "data": "cephfs" 2020-04-22T14:15:02.223 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.223 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.223 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.223 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:15:02.223 INFO:teuthology.orchestra.run.smithi103.stdout: "osds": [ 2020-04-22T14:15:02.223 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.223 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 0, 2020-04-22T14:15:02.223 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "3546145b-bd93-4a79-b6fe-3158153b8f05", 2020-04-22T14:15:02.224 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:15:02.224 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:15:02.224 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:15:02.224 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:15:02.224 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:15:02.224 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:15:02.224 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:15:02.225 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 88, 2020-04-22T14:15:02.225 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:15:02.225 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:15:02.225 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:15:02.225 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:02.225 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.225 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:02.225 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6800", 2020-04-22T14:15:02.226 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:15:02.226 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.226 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.226 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:02.226 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6801", 2020-04-22T14:15:02.226 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:15:02.226 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.226 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:02.227 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.227 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:15:02.227 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:02.227 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.227 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:02.227 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6802", 2020-04-22T14:15:02.227 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:15:02.228 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.228 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.228 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:02.228 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6803", 2020-04-22T14:15:02.228 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:15:02.228 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.228 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:02.228 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.229 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:15:02.229 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:02.229 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.229 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:02.229 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6806", 2020-04-22T14:15:02.229 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:15:02.229 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.229 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.230 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:02.230 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6807", 2020-04-22T14:15:02.230 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:15:02.230 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.230 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:02.230 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.230 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:15:02.231 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:02.231 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.231 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:02.231 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6804", 2020-04-22T14:15:02.231 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:15:02.231 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.232 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.232 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:02.232 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6805", 2020-04-22T14:15:02.232 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:15:02.232 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.232 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:02.232 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.232 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6801/33072", 2020-04-22T14:15:02.233 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6803/33072", 2020-04-22T14:15:02.233 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6807/33072", 2020-04-22T14:15:02.233 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6805/33072", 2020-04-22T14:15:02.233 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:15:02.233 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:15:02.233 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:15:02.233 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:02.233 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.234 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.234 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 1, 2020-04-22T14:15:02.234 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "65ca5f7d-2ea6-4de6-a034-08a0a99aa80d", 2020-04-22T14:15:02.234 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:15:02.234 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:15:02.234 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:15:02.234 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:15:02.235 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:15:02.235 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:15:02.235 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:15:02.235 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 86, 2020-04-22T14:15:02.235 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:15:02.235 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:15:02.235 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:15:02.235 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:02.236 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.236 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:02.236 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6808", 2020-04-22T14:15:02.236 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:15:02.236 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.236 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.236 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:02.236 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6809", 2020-04-22T14:15:02.237 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:15:02.237 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.237 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:02.237 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.237 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:15:02.237 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:02.237 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.238 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:02.238 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6810", 2020-04-22T14:15:02.238 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:15:02.238 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.238 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.238 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:02.238 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6811", 2020-04-22T14:15:02.238 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:15:02.239 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.239 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:02.239 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.239 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:15:02.239 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:02.239 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.239 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:02.239 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6814", 2020-04-22T14:15:02.240 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:15:02.240 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.240 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.240 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:02.240 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6815", 2020-04-22T14:15:02.240 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:15:02.240 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.240 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:02.241 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.241 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:15:02.241 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:02.241 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.241 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:02.241 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6812", 2020-04-22T14:15:02.241 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:15:02.242 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.242 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.242 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:02.242 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6813", 2020-04-22T14:15:02.242 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:15:02.242 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.242 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:02.243 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.243 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6809/33103", 2020-04-22T14:15:02.243 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6811/33103", 2020-04-22T14:15:02.243 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6815/33103", 2020-04-22T14:15:02.243 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6813/33103", 2020-04-22T14:15:02.243 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:15:02.243 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:15:02.243 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:15:02.244 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:02.244 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.244 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.244 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 2, 2020-04-22T14:15:02.244 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "f2e9bf44-c844-48d7-b6c2-f08ea71189b4", 2020-04-22T14:15:02.244 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:15:02.244 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:15:02.245 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:15:02.245 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:15:02.245 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:15:02.245 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:15:02.245 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:15:02.245 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 88, 2020-04-22T14:15:02.245 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:15:02.245 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:15:02.246 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:15:02.246 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:02.246 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.246 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:02.246 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6816", 2020-04-22T14:15:02.246 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:15:02.247 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.247 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.247 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:02.247 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6817", 2020-04-22T14:15:02.247 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:15:02.247 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.247 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:02.248 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.248 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:15:02.248 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:02.248 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.248 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:02.248 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6818", 2020-04-22T14:15:02.248 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:15:02.249 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.249 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.249 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:02.249 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6819", 2020-04-22T14:15:02.249 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:15:02.249 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.249 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:02.249 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.250 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:15:02.250 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:02.250 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.250 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:02.250 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6822", 2020-04-22T14:15:02.250 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:15:02.250 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.250 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.251 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:02.251 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6823", 2020-04-22T14:15:02.251 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:15:02.251 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.251 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:02.251 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.251 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:15:02.251 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:02.252 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.252 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:02.252 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6820", 2020-04-22T14:15:02.252 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:15:02.252 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.252 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.252 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:02.253 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6821", 2020-04-22T14:15:02.253 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:15:02.253 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.253 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:02.253 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.253 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6817/33153", 2020-04-22T14:15:02.253 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6819/33153", 2020-04-22T14:15:02.253 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6823/33153", 2020-04-22T14:15:02.254 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6821/33153", 2020-04-22T14:15:02.254 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:15:02.254 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:15:02.254 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:15:02.254 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:02.254 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.254 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.254 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 3, 2020-04-22T14:15:02.255 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "0ab87fee-a427-4906-851a-b9bd8c2e5645", 2020-04-22T14:15:02.255 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:15:02.255 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:15:02.255 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:15:02.255 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:15:02.255 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:15:02.255 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:15:02.256 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:15:02.256 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 88, 2020-04-22T14:15:02.256 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:15:02.256 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:15:02.256 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:15:02.256 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:02.256 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.256 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:02.257 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6824", 2020-04-22T14:15:02.259 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:15:02.259 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.259 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.259 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:02.259 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6825", 2020-04-22T14:15:02.259 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:15:02.260 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.260 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:02.260 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.260 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:15:02.260 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:02.260 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.260 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:02.261 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6826", 2020-04-22T14:15:02.261 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:15:02.261 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.261 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.261 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:02.261 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6827", 2020-04-22T14:15:02.261 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:15:02.262 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.262 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:02.262 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.262 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:15:02.262 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:02.262 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.262 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:02.263 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6830", 2020-04-22T14:15:02.263 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:15:02.263 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.263 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.263 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:02.263 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6831", 2020-04-22T14:15:02.263 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:15:02.263 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.264 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:02.264 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.264 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:15:02.264 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:02.264 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.264 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:02.264 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6828", 2020-04-22T14:15:02.265 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:15:02.265 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.265 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.265 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:02.265 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6829", 2020-04-22T14:15:02.265 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:15:02.265 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.266 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:02.266 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.266 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6825/33183", 2020-04-22T14:15:02.266 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6827/33183", 2020-04-22T14:15:02.266 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6831/33183", 2020-04-22T14:15:02.266 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6829/33183", 2020-04-22T14:15:02.266 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:15:02.267 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:15:02.267 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:15:02.267 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:02.267 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.267 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.267 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 4, 2020-04-22T14:15:02.267 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "2565df7d-2eff-484b-a3cd-ed7715e5d875", 2020-04-22T14:15:02.267 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:15:02.268 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:15:02.268 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:15:02.268 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:15:02.268 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:15:02.268 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:15:02.268 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:15:02.268 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 88, 2020-04-22T14:15:02.269 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:15:02.269 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:15:02.269 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:15:02.269 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:02.269 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.269 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:02.269 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6802", 2020-04-22T14:15:02.270 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:15:02.270 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.270 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.270 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:02.270 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6803", 2020-04-22T14:15:02.270 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:15:02.270 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.270 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:02.271 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.271 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:15:02.271 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:02.271 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.271 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:02.271 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6804", 2020-04-22T14:15:02.271 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:15:02.272 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.272 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.272 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:02.272 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6805", 2020-04-22T14:15:02.272 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:15:02.272 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.272 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:02.273 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.273 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:15:02.273 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:02.273 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.273 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:02.273 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6808", 2020-04-22T14:15:02.273 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:15:02.274 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.274 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.274 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:02.274 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6809", 2020-04-22T14:15:02.274 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:15:02.274 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.274 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:02.275 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.275 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:15:02.275 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:02.275 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.275 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:02.276 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6806", 2020-04-22T14:15:02.276 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:15:02.276 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.276 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.276 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:02.276 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6807", 2020-04-22T14:15:02.276 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:15:02.276 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.277 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:02.277 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.277 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6803/33506", 2020-04-22T14:15:02.277 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6805/33506", 2020-04-22T14:15:02.277 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6809/33506", 2020-04-22T14:15:02.277 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6807/33506", 2020-04-22T14:15:02.277 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:15:02.278 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:15:02.278 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:15:02.278 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:02.278 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.278 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.278 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 5, 2020-04-22T14:15:02.278 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "bcfd7a16-6914-4152-8647-a481917fe19d", 2020-04-22T14:15:02.279 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:15:02.279 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:15:02.279 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:15:02.279 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:15:02.279 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:15:02.279 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:15:02.279 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:15:02.279 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 88, 2020-04-22T14:15:02.280 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:15:02.280 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:15:02.280 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:15:02.280 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:02.280 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.280 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:02.280 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6810", 2020-04-22T14:15:02.281 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:15:02.281 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.281 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.281 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:02.281 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6811", 2020-04-22T14:15:02.281 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:15:02.281 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.281 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:02.282 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.282 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:15:02.282 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:02.282 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.282 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:02.282 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6812", 2020-04-22T14:15:02.282 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:15:02.283 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.283 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.283 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:02.283 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6813", 2020-04-22T14:15:02.283 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:15:02.283 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.283 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:02.283 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.284 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:15:02.284 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:02.284 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.284 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:02.284 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6816", 2020-04-22T14:15:02.284 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:15:02.284 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.285 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.285 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:02.285 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6817", 2020-04-22T14:15:02.285 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:15:02.285 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.285 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:02.285 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.286 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:15:02.286 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:02.286 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.286 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:02.286 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6814", 2020-04-22T14:15:02.286 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:15:02.286 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.287 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.287 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:02.287 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6815", 2020-04-22T14:15:02.287 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:15:02.287 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.287 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:02.287 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.287 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6811/33554", 2020-04-22T14:15:02.288 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6813/33554", 2020-04-22T14:15:02.288 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6817/33554", 2020-04-22T14:15:02.288 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6815/33554", 2020-04-22T14:15:02.288 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:15:02.288 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:15:02.288 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:15:02.288 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:02.289 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.289 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.289 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 6, 2020-04-22T14:15:02.289 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050", 2020-04-22T14:15:02.289 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:15:02.289 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:15:02.289 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:15:02.290 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:15:02.290 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:15:02.290 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:15:02.290 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:15:02.290 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 88, 2020-04-22T14:15:02.290 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:15:02.291 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:15:02.291 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:15:02.291 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:02.291 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.291 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:02.291 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6818", 2020-04-22T14:15:02.291 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:15:02.292 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.292 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.292 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:02.292 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6819", 2020-04-22T14:15:02.292 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:15:02.292 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.292 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:02.293 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.293 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:15:02.293 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:02.293 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.293 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:02.293 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6820", 2020-04-22T14:15:02.293 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:15:02.293 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.294 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.294 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:02.294 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6821", 2020-04-22T14:15:02.294 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:15:02.294 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.294 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:02.294 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.295 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:15:02.295 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:02.295 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.295 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:02.295 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6824", 2020-04-22T14:15:02.295 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:15:02.295 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.296 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.296 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:02.296 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6825", 2020-04-22T14:15:02.296 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:15:02.296 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.296 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:02.296 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.296 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:15:02.297 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:02.297 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.297 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:02.297 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6822", 2020-04-22T14:15:02.297 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:15:02.297 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.297 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.298 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:02.298 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6823", 2020-04-22T14:15:02.298 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:15:02.298 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.298 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:02.298 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.298 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6819/33601", 2020-04-22T14:15:02.298 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6821/33601", 2020-04-22T14:15:02.299 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6825/33601", 2020-04-22T14:15:02.299 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6823/33601", 2020-04-22T14:15:02.299 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:15:02.299 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:15:02.299 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:15:02.299 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:02.299 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.300 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.300 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 7, 2020-04-22T14:15:02.300 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "340eece1-4c39-47cd-b95f-9cfa5dcfe361", 2020-04-22T14:15:02.300 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:15:02.300 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:15:02.300 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:15:02.300 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:15:02.301 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:15:02.301 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:15:02.301 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:15:02.301 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 74, 2020-04-22T14:15:02.301 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:15:02.301 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:15:02.301 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:15:02.302 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:02.302 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.302 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:02.302 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6826", 2020-04-22T14:15:02.302 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:15:02.302 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.302 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.302 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:02.303 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6827", 2020-04-22T14:15:02.303 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:15:02.303 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.303 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:02.303 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.303 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:15:02.303 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:02.304 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.304 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:02.304 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6828", 2020-04-22T14:15:02.304 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:15:02.304 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.304 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.304 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:02.305 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6829", 2020-04-22T14:15:02.305 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:15:02.305 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.305 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:02.305 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.305 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:15:02.305 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:02.305 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.306 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:02.306 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6832", 2020-04-22T14:15:02.306 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:15:02.306 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.306 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.306 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:02.306 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6833", 2020-04-22T14:15:02.307 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:15:02.307 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.307 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:02.307 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.307 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:15:02.307 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:02.307 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.308 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:02.308 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6830", 2020-04-22T14:15:02.308 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:15:02.308 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.308 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.308 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:02.309 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6831", 2020-04-22T14:15:02.309 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:15:02.309 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.309 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:02.309 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.309 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6827/33629", 2020-04-22T14:15:02.310 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6829/33629", 2020-04-22T14:15:02.310 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6833/33629", 2020-04-22T14:15:02.310 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6831/33629", 2020-04-22T14:15:02.310 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:15:02.310 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:15:02.310 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:15:02.310 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:02.310 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.311 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:15:02.311 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_xinfo": [ 2020-04-22T14:15:02.311 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.311 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 0, 2020-04-22T14:15:02.311 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:15:02.311 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:15:02.312 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:15:02.312 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:15:02.312 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:15:02.312 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.384360+0000", 2020-04-22T14:15:02.312 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:15:02.312 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.313 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.313 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 1, 2020-04-22T14:15:02.313 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:15:02.313 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:15:02.313 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:15:02.313 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:15:02.313 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:15:02.314 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.503590+0000", 2020-04-22T14:15:02.314 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:15:02.314 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.314 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.314 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 2, 2020-04-22T14:15:02.314 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:15:02.314 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:15:02.315 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:15:02.315 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:15:02.315 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:15:02.315 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.525058+0000", 2020-04-22T14:15:02.315 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:15:02.315 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.315 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.315 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 3, 2020-04-22T14:15:02.316 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:15:02.316 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:15:02.316 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:15:02.316 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:15:02.316 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:15:02.316 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.599729+0000", 2020-04-22T14:15:02.316 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:15:02.317 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.317 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.317 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 4, 2020-04-22T14:15:02.317 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:15:02.317 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:15:02.317 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:15:02.317 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:15:02.318 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:15:02.318 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.600919+0000", 2020-04-22T14:15:02.318 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:15:02.318 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.318 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.318 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 5, 2020-04-22T14:15:02.318 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:15:02.318 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:15:02.319 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:15:02.319 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:15:02.319 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:15:02.319 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.654718+0000", 2020-04-22T14:15:02.319 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:15:02.319 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.319 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.320 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 6, 2020-04-22T14:15:02.320 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:15:02.320 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:15:02.320 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:15:02.320 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:15:02.320 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:15:02.320 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.718342+0000", 2020-04-22T14:15:02.321 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:15:02.321 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.321 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:02.321 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 7, 2020-04-22T14:15:02.321 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:15:02.321 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:15:02.321 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:15:02.321 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:15:02.322 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:15:02.322 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.839089+0000", 2020-04-22T14:15:02.322 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:15:02.322 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.322 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:15:02.322 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_upmap": [], 2020-04-22T14:15:02.322 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_upmap_items": [], 2020-04-22T14:15:02.323 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_temp": [], 2020-04-22T14:15:02.323 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_temp": [], 2020-04-22T14:15:02.323 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklist": { 2020-04-22T14:15:02.323 INFO:teuthology.orchestra.run.smithi103.stdout: "192.168.0.1:0/425900083": "2020-04-22T15:14:53.627821+0000" 2020-04-22T14:15:02.323 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.323 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profiles": { 2020-04-22T14:15:02.323 INFO:teuthology.orchestra.run.smithi103.stdout: "default": { 2020-04-22T14:15:02.323 INFO:teuthology.orchestra.run.smithi103.stdout: "crush-failure-domain": "osd", 2020-04-22T14:15:02.324 INFO:teuthology.orchestra.run.smithi103.stdout: "k": "2", 2020-04-22T14:15:02.324 INFO:teuthology.orchestra.run.smithi103.stdout: "m": "1", 2020-04-22T14:15:02.324 INFO:teuthology.orchestra.run.smithi103.stdout: "plugin": "jerasure", 2020-04-22T14:15:02.324 INFO:teuthology.orchestra.run.smithi103.stdout: "ruleset-failure-domain": "osd", 2020-04-22T14:15:02.324 INFO:teuthology.orchestra.run.smithi103.stdout: "technique": "reed_sol_van" 2020-04-22T14:15:02.324 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:02.324 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:02.325 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps_queue": [], 2020-04-22T14:15:02.325 INFO:teuthology.orchestra.run.smithi103.stdout: "new_removed_snaps": [], 2020-04-22T14:15:02.325 INFO:teuthology.orchestra.run.smithi103.stdout: "new_purged_snaps": [], 2020-04-22T14:15:02.325 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_node_flags": {}, 2020-04-22T14:15:02.325 INFO:teuthology.orchestra.run.smithi103.stdout: "device_class_flags": {} 2020-04-22T14:15:02.325 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:15:02.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.175+0000 7fa06b4ca700 1 -- 172.21.15.103:0/407519215 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa0440517b0 msgr2=0x7fa044053c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:02.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.175+0000 7fa06b4ca700 1 --2- 172.21.15.103:0/407519215 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa0440517b0 0x7fa044053c70 secure :-1 s=READY pgs=519 cs=0 l=1 rx=0x7fa054002f30 tx=0x7fa05400c8b0).stop 2020-04-22T14:15:02.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.175+0000 7fa06b4ca700 1 -- 172.21.15.103:0/407519215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0440052b0 msgr2=0x7fa0440039c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:02.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.175+0000 7fa06b4ca700 1 --2- 172.21.15.103:0/407519215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0440052b0 0x7fa0440039c0 secure :-1 s=READY pgs=1424 cs=0 l=1 rx=0x7fa064129ec0 tx=0x7fa060001e60).stop 2020-04-22T14:15:02.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.175+0000 7fa06b4ca700 1 -- 172.21.15.103:0/407519215 shutdown_connections 2020-04-22T14:15:02.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.175+0000 7fa06b4ca700 1 --2- 172.21.15.103:0/407519215 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa0440517b0 0x7fa044053c70 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:02.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.175+0000 7fa06b4ca700 1 --2- 172.21.15.103:0/407519215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0440052b0 0x7fa0440039c0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:02.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.175+0000 7fa06b4ca700 1 -- 172.21.15.103:0/407519215 >> 172.21.15.103:0/407519215 conn(0x7fa0640b9160 msgr2=0x7fa064061df0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:02.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.175+0000 7fa06b4ca700 1 -- 172.21.15.103:0/407519215 shutdown_connections 2020-04-22T14:15:02.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.175+0000 7fa06b4ca700 1 -- 172.21.15.103:0/407519215 wait complete. 2020-04-22T14:15:02.329 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:02.343 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:15:02.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.486+0000 7fe14f52b700 1 Processor -- start 2020-04-22T14:15:02.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.486+0000 7fe14f52b700 1 -- start start 2020-04-22T14:15:02.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.486+0000 7fe14f52b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe148065fe0 0x7fe1481464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:02.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.486+0000 7fe14f52b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe148143300 con 0x7fe148063e30 2020-04-22T14:15:02.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.486+0000 7fe14f52b700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1481435a0 con 0x7fe14812c0d0 2020-04-22T14:15:02.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.486+0000 7fe14f52b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe148143840 con 0x7fe148065fe0 2020-04-22T14:15:02.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.487+0000 7fe14d2c7700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe14812c0d0 0x7fe14805b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46946/0 (socket says 172.21.15.103:46946) 2020-04-22T14:15:02.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.487+0000 7fe14d2c7700 1 -- 172.21.15.103:0/4270661768 learned_addr learned my addr 172.21.15.103:0/4270661768 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:02.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.487+0000 7fe137fff700 1 -- 172.21.15.103:0/4270661768 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1753699011 0 0) 0x7fe1481435a0 con 0x7fe14812c0d0 2020-04-22T14:15:02.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.487+0000 7fe137fff700 1 -- 172.21.15.103:0/4270661768 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe130003230 con 0x7fe14812c0d0 2020-04-22T14:15:02.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.487+0000 7fe14cac6700 1 --2- 172.21.15.103:0/4270661768 >> v2:172.21.15.86:3300/0 conn(0x7fe148065fe0 0x7fe1481464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:02.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.487+0000 7fe137fff700 1 -- 172.21.15.103:0/4270661768 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3354337669 0 0) 0x7fe130003230 con 0x7fe14812c0d0 2020-04-22T14:15:02.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.487+0000 7fe137fff700 1 -- 172.21.15.103:0/4270661768 >> v2:172.21.15.86:3300/0 conn(0x7fe148065fe0 msgr2=0x7fe1481464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:02.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.487+0000 7fe137fff700 1 --2- 172.21.15.103:0/4270661768 >> v2:172.21.15.86:3300/0 conn(0x7fe148065fe0 0x7fe1481464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:02.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.487+0000 7fe137fff700 1 -- 172.21.15.103:0/4270661768 >> v1:172.21.15.86:6789/0 conn(0x7fe148063e30 legacy=0x7fe1480642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:02.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.487+0000 7fe137fff700 1 -- 172.21.15.103:0/4270661768 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14805bb50 con 0x7fe14812c0d0 2020-04-22T14:15:02.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.487+0000 7fe137fff700 1 -- 172.21.15.103:0/4270661768 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fe1380016d0 con 0x7fe14812c0d0 2020-04-22T14:15:02.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.487+0000 7fe137fff700 1 -- 172.21.15.103:0/4270661768 >> v1:172.21.15.103:6789/0 conn(0x7fe14812c0d0 legacy=0x7fe14805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:02.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.487+0000 7fe137fff700 1 --2- 172.21.15.103:0/4270661768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe130003720 0x7fe130003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:02.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.487+0000 7fe137fff700 1 --2- 172.21.15.103:0/4270661768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1300044d0 0x7fe130004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:02.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.487+0000 7fe137fff700 1 --2- 172.21.15.103:0/4270661768 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe130004db0 0x7fe13000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:02.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.487+0000 7fe137fff700 1 -- 172.21.15.103:0/4270661768 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe148143840 con 0x7fe130003720 2020-04-22T14:15:02.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.487+0000 7fe137fff700 1 -- 172.21.15.103:0/4270661768 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1300041c0 con 0x7fe1300044d0 2020-04-22T14:15:02.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.487+0000 7fe137fff700 1 -- 172.21.15.103:0/4270661768 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe13000dd90 con 0x7fe130004db0 2020-04-22T14:15:02.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.487+0000 7fe14cac6700 1 --2- 172.21.15.103:0/4270661768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1300044d0 0x7fe130004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:02.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.487+0000 7fe14d2c7700 1 --2- 172.21.15.103:0/4270661768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe130003720 0x7fe130003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:02.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.487+0000 7fe14dac8700 1 --2- 172.21.15.103:0/4270661768 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe130004db0 0x7fe13000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:02.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.488+0000 7fe14cac6700 1 -- 172.21.15.103:0/4270661768 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe130004db0 msgr2=0x7fe13000b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:02.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.488+0000 7fe14cac6700 1 --2- 172.21.15.103:0/4270661768 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe130004db0 0x7fe13000b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:02.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.488+0000 7fe14cac6700 1 -- 172.21.15.103:0/4270661768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe130003720 msgr2=0x7fe130003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:02.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.488+0000 7fe14cac6700 1 --2- 172.21.15.103:0/4270661768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe130003720 0x7fe130003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:02.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.488+0000 7fe14cac6700 1 -- 172.21.15.103:0/4270661768 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe130003230 con 0x7fe1300044d0 2020-04-22T14:15:02.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.488+0000 7fe14dac8700 1 --2- 172.21.15.103:0/4270661768 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe130004db0 0x7fe13000b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:15:02.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.488+0000 7fe14dac8700 1 -- 172.21.15.103:0/4270661768 reap_dead start 2020-04-22T14:15:02.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.488+0000 7fe14cac6700 1 --2- 172.21.15.103:0/4270661768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1300044d0 0x7fe130004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe1300054a0 tx=0x7fe144010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.488+0000 7fe14cac6700 1 --2- 172.21.15.103:0/4270661768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1300044d0 0x7fe130004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe1300054a0 tx=0x7fe144010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.488+0000 7fe14cac6700 1 --2- 172.21.15.103:0/4270661768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1300044d0 0x7fe130004950 secure :-1 s=READY pgs=1426 cs=0 l=1 rx=0x7fe1300054a0 tx=0x7fe144010050).ready entity=mon.1 client_cookie=38992bbd3da95aa2 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:02.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.488+0000 7fe14cac6700 1 --2- 172.21.15.103:0/4270661768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1300044d0 0x7fe130004950 secure :-1 s=THROTTLE_DONE pgs=1426 cs=0 l=1 rx=0x7fe1300054a0 tx=0x7fe144010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.488+0000 7fe137fff700 1 -- 172.21.15.103:0/4270661768 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe144008d30 con 0x7fe1300044d0 2020-04-22T14:15:02.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.488+0000 7fe14cac6700 1 --2- 172.21.15.103:0/4270661768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1300044d0 0x7fe130004950 secure :-1 s=THROTTLE_DONE pgs=1426 cs=0 l=1 rx=0x7fe1300054a0 tx=0x7fe144010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.488+0000 7fe137fff700 1 -- 172.21.15.103:0/4270661768 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe144008e90 con 0x7fe1300044d0 2020-04-22T14:15:02.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.488+0000 7fe14cac6700 1 --2- 172.21.15.103:0/4270661768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1300044d0 0x7fe130004950 secure :-1 s=THROTTLE_DONE pgs=1426 cs=0 l=1 rx=0x7fe1300054a0 tx=0x7fe144010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.488+0000 7fe137fff700 1 -- 172.21.15.103:0/4270661768 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe144010b30 con 0x7fe1300044d0 2020-04-22T14:15:02.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.488+0000 7fe14f52b700 1 -- 172.21.15.103:0/4270661768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1300044d0 msgr2=0x7fe130004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:02.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.488+0000 7fe14f52b700 1 --2- 172.21.15.103:0/4270661768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1300044d0 0x7fe130004950 secure :-1 s=READY pgs=1426 cs=0 l=1 rx=0x7fe1300054a0 tx=0x7fe144010050).stop 2020-04-22T14:15:02.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.488+0000 7fe14f52b700 1 -- 172.21.15.103:0/4270661768 shutdown_connections 2020-04-22T14:15:02.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.488+0000 7fe14f52b700 1 --2- 172.21.15.103:0/4270661768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1300044d0 0x7fe130004950 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:02.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.488+0000 7fe14f52b700 1 -- 172.21.15.103:0/4270661768 >> 172.21.15.103:0/4270661768 conn(0x7fe1480b9160 msgr2=0x7fe14805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:02.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.488+0000 7fe14f52b700 1 -- 172.21.15.103:0/4270661768 shutdown_connections 2020-04-22T14:15:02.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.488+0000 7fe14f52b700 1 -- 172.21.15.103:0/4270661768 wait complete. 2020-04-22T14:15:02.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.489+0000 7fe14f52b700 1 Processor -- start 2020-04-22T14:15:02.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.489+0000 7fe14f52b700 1 -- start start 2020-04-22T14:15:02.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.490+0000 7fe14f52b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe1300044d0 0x7fe1480af6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:02.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.490+0000 7fe14f52b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe148129e80 0x7fe1480b1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:02.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.490+0000 7fe14f52b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1480b2580 con 0x7fe1481276f0 2020-04-22T14:15:02.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.490+0000 7fe14f52b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1480ad8f0 con 0x7fe1300044d0 2020-04-22T14:15:02.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.490+0000 7fe14f52b700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1480adb90 con 0x7fe148129e80 2020-04-22T14:15:02.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.490+0000 7fe14cac6700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe148129e80 0x7fe1480b1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:02.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.490+0000 7fe14cac6700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe148129e80 0x7fe1480b1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54770/0 (socket says 172.21.15.103:54770) 2020-04-22T14:15:02.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.490+0000 7fe14cac6700 1 -- 172.21.15.103:0/4142140081 learned_addr learned my addr 172.21.15.103:0/4142140081 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:15:02.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.490+0000 7fe14d2c7700 1 --2- 172.21.15.103:0/4142140081 >> v2:172.21.15.86:3300/0 conn(0x7fe1300044d0 0x7fe1480af6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:02.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.490+0000 7fe14cac6700 1 -- 172.21.15.103:0/4142140081 >> v2:172.21.15.86:3300/0 conn(0x7fe1300044d0 msgr2=0x7fe1480af6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:02.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.490+0000 7fe14cac6700 1 --2- 172.21.15.103:0/4142140081 >> v2:172.21.15.86:3300/0 conn(0x7fe1300044d0 0x7fe1480af6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:02.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.490+0000 7fe14cac6700 1 -- 172.21.15.103:0/4142140081 >> v1:172.21.15.86:6789/0 conn(0x7fe1481276f0 legacy=0x7fe1480ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:02.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.490+0000 7fe14cac6700 1 -- 172.21.15.103:0/4142140081 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1480b22d0 con 0x7fe148129e80 2020-04-22T14:15:02.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.491+0000 7fe14cac6700 1 --2- 172.21.15.103:0/4142140081 >> v2:172.21.15.103:3300/0 conn(0x7fe148129e80 0x7fe1480b1e70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe1300054a0 tx=0x7fe144010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.491+0000 7fe14cac6700 1 --2- 172.21.15.103:0/4142140081 >> v2:172.21.15.103:3300/0 conn(0x7fe148129e80 0x7fe1480b1e70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe1300054a0 tx=0x7fe144010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.491+0000 7fe14cac6700 1 --2- 172.21.15.103:0/4142140081 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe148129e80 0x7fe1480b1e70 secure :-1 s=READY pgs=1427 cs=0 l=1 rx=0x7fe1300054a0 tx=0x7fe144010050).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:02.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.491+0000 7fe14cac6700 1 --2- 172.21.15.103:0/4142140081 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe148129e80 0x7fe1480b1e70 secure :-1 s=THROTTLE_DONE pgs=1427 cs=0 l=1 rx=0x7fe1300054a0 tx=0x7fe144010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.491+0000 7fe14cac6700 1 --2- 172.21.15.103:0/4142140081 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe148129e80 0x7fe1480b1e70 secure :-1 s=THROTTLE_DONE pgs=1427 cs=0 l=1 rx=0x7fe1300054a0 tx=0x7fe144010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.491+0000 7fe1367fc700 1 -- 172.21.15.103:0/4142140081 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1440058b0 con 0x7fe148129e80 2020-04-22T14:15:02.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.491+0000 7fe14cac6700 1 --2- 172.21.15.103:0/4142140081 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe148129e80 0x7fe1480b1e70 secure :-1 s=THROTTLE_DONE pgs=1427 cs=0 l=1 rx=0x7fe1300054a0 tx=0x7fe144010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.491+0000 7fe1367fc700 1 -- 172.21.15.103:0/4142140081 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe144005a10 con 0x7fe148129e80 2020-04-22T14:15:02.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.491+0000 7fe14f52b700 1 -- 172.21.15.103:0/4142140081 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe14814f900 con 0x7fe148129e80 2020-04-22T14:15:02.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.491+0000 7fe1367fc700 1 -- 172.21.15.103:0/4142140081 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe144005d70 con 0x7fe148129e80 2020-04-22T14:15:02.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.491+0000 7fe14f52b700 1 -- 172.21.15.103:0/4142140081 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe148127b10 con 0x7fe148129e80 2020-04-22T14:15:02.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.491+0000 7fe14cac6700 1 --2- 172.21.15.103:0/4142140081 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe148129e80 0x7fe1480b1e70 secure :-1 s=THROTTLE_DONE pgs=1427 cs=0 l=1 rx=0x7fe1300054a0 tx=0x7fe144010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.492+0000 7fe1367fc700 1 -- 172.21.15.103:0/4142140081 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fe144014240 con 0x7fe148129e80 2020-04-22T14:15:02.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.492+0000 7fe14cac6700 1 --2- 172.21.15.103:0/4142140081 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe148129e80 0x7fe1480b1e70 secure :-1 s=THROTTLE_DONE pgs=1427 cs=0 l=1 rx=0x7fe1300054a0 tx=0x7fe144010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.492+0000 7fe14f52b700 1 -- 172.21.15.103:0/4142140081 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe148127fe0 con 0x7fe148129e80 2020-04-22T14:15:02.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.492+0000 7fe1367fc700 1 --2- 172.21.15.103:0/4142140081 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe12804d9d0 0x7fe12804fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:02.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.492+0000 7fe1367fc700 1 -- 172.21.15.103:0/4142140081 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fe144061800 con 0x7fe148129e80 2020-04-22T14:15:02.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.492+0000 7fe14d2c7700 1 --2- 172.21.15.103:0/4142140081 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe12804d9d0 0x7fe12804fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:02.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.492+0000 7fe14d2c7700 1 --2- 172.21.15.103:0/4142140081 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe12804d9d0 0x7fe12804fe90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe1380013e0 tx=0x7fe14805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.493+0000 7fe14d2c7700 1 --2- 172.21.15.103:0/4142140081 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe12804d9d0 0x7fe12804fe90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe1380013e0 tx=0x7fe14805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.493+0000 7fe14d2c7700 1 --2- 172.21.15.103:0/4142140081 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe12804d9d0 0x7fe12804fe90 secure :-1 s=READY pgs=520 cs=0 l=1 rx=0x7fe1380013e0 tx=0x7fe14805bce0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:02.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.496+0000 7fe14cac6700 1 --2- 172.21.15.103:0/4142140081 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe148129e80 0x7fe1480b1e70 secure :-1 s=THROTTLE_DONE pgs=1427 cs=0 l=1 rx=0x7fe1300054a0 tx=0x7fe144010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.496+0000 7fe1367fc700 1 -- 172.21.15.103:0/4142140081 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fe14403cc40 con 0x7fe148129e80 2020-04-22T14:15:02.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.688+0000 7fe14f52b700 1 -- 172.21.15.103:0/4142140081 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe148056c90 con 0x7fe148129e80 2020-04-22T14:15:02.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.689+0000 7fe14cac6700 1 --2- 172.21.15.103:0/4142140081 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe148129e80 0x7fe1480b1e70 secure :-1 s=THROTTLE_DONE pgs=1427 cs=0 l=1 rx=0x7fe1300054a0 tx=0x7fe144010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.689+0000 7fe1367fc700 1 -- 172.21.15.103:0/4142140081 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+2142 (secure 0 0 0) 0x7fe144040260 con 0x7fe148129e80 2020-04-22T14:15:02.692 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:15:02.692 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":66,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5810,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/2664816107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2664816107},{"type":"v1","addr":"172.21.15.86:6835","nonce":2664816107}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":60}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:13:59.062543+0000","modified":"2020-04-22T14:14:19.519188+0000","tableserver":0,"root":0,"session_timeout":30,"session_autoclose":50,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7723},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7723":{"gid":7723,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/3220772133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3220772133},{"type":"v1","addr":"172.21.15.103:6833","nonce":3220772133}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-04-22T14:15:02.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.690+0000 7fe14f52b700 1 -- 172.21.15.103:0/4142140081 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe12804d9d0 msgr2=0x7fe12804fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:02.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.690+0000 7fe14f52b700 1 --2- 172.21.15.103:0/4142140081 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe12804d9d0 0x7fe12804fe90 secure :-1 s=READY pgs=520 cs=0 l=1 rx=0x7fe1380013e0 tx=0x7fe14805bce0).stop 2020-04-22T14:15:02.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.690+0000 7fe14f52b700 1 -- 172.21.15.103:0/4142140081 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe148129e80 msgr2=0x7fe1480b1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:02.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.690+0000 7fe14f52b700 1 --2- 172.21.15.103:0/4142140081 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe148129e80 0x7fe1480b1e70 secure :-1 s=READY pgs=1427 cs=0 l=1 rx=0x7fe1300054a0 tx=0x7fe144010050).stop 2020-04-22T14:15:02.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.690+0000 7fe14f52b700 1 -- 172.21.15.103:0/4142140081 shutdown_connections 2020-04-22T14:15:02.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.690+0000 7fe14f52b700 1 --2- 172.21.15.103:0/4142140081 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe12804d9d0 0x7fe12804fe90 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:02.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.690+0000 7fe14f52b700 1 --2- 172.21.15.103:0/4142140081 >> v2:172.21.15.86:3300/0 conn(0x7fe1300044d0 0x7fe1480af6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:02.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.690+0000 7fe14f52b700 1 --2- 172.21.15.103:0/4142140081 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe148129e80 0x7fe1480b1e70 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:02.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.690+0000 7fe14f52b700 1 -- 172.21.15.103:0/4142140081 >> 172.21.15.103:0/4142140081 conn(0x7fe1480b9160 msgr2=0x7fe148062a30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:02.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.690+0000 7fe14f52b700 1 -- 172.21.15.103:0/4142140081 shutdown_connections 2020-04-22T14:15:02.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.690+0000 7fe14f52b700 1 -- 172.21.15.103:0/4142140081 wait complete. 2020-04-22T14:15:02.699 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 66 2020-04-22T14:15:02.704 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:02.717 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2020-04-22T14:15:02.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.862+0000 7ff512833700 1 Processor -- start 2020-04-22T14:15:02.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.862+0000 7ff512833700 1 -- start start 2020-04-22T14:15:02.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.863+0000 7ff512833700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff50c0b4320 0x7ff50c0b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:02.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.863+0000 7ff512833700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff50c0b2530 0x7ff50c0b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:02.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.863+0000 7ff512833700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff50c0b0e90 con 0x7ff50c0b4700 2020-04-22T14:15:02.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.863+0000 7ff512833700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff50c0b1130 con 0x7ff50c0b2530 2020-04-22T14:15:02.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.863+0000 7ff512833700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff50c0ae500 con 0x7ff50c0b4320 2020-04-22T14:15:02.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.863+0000 7ff50bfff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff50c0b4320 0x7ff50c0b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:02.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.863+0000 7ff50b7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff50c0b4700 0x7ff50c0afa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46968/0 (socket says 172.21.15.103:46968) 2020-04-22T14:15:02.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.863+0000 7ff50b7fe700 1 -- 172.21.15.103:0/3099303184 learned_addr learned my addr 172.21.15.103:0/3099303184 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:02.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.863+0000 7ff510dd0700 1 --2- 172.21.15.103:0/3099303184 >> v2:172.21.15.86:3300/0 conn(0x7ff50c0b2530 0x7ff50c0b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:02.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.863+0000 7ff50bfff700 1 -- 172.21.15.103:0/3099303184 >> v2:172.21.15.86:3300/0 conn(0x7ff50c0b2530 msgr2=0x7ff50c0b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:02.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.863+0000 7ff50bfff700 1 --2- 172.21.15.103:0/3099303184 >> v2:172.21.15.86:3300/0 conn(0x7ff50c0b2530 0x7ff50c0b0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:02.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.863+0000 7ff50bfff700 1 -- 172.21.15.103:0/3099303184 >> v1:172.21.15.103:6789/0 conn(0x7ff50c0b4700 legacy=0x7ff50c0afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:02.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.863+0000 7ff50bfff700 1 -- 172.21.15.103:0/3099303184 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff50c0b1a30 con 0x7ff50c0b4320 2020-04-22T14:15:02.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.863+0000 7ff50affd700 1 -- 172.21.15.103:0/3099303184 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3958871112 0 0) 0x7ff50c0b0e90 con 0x7ff50c0b4700 2020-04-22T14:15:02.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.863+0000 7ff510dd0700 1 --2- 172.21.15.103:0/3099303184 >> v2:172.21.15.86:3300/0 conn(0x7ff50c0b2530 0x7ff50c0b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:15:02.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.863+0000 7ff50bfff700 1 --2- 172.21.15.103:0/3099303184 >> v2:172.21.15.103:3300/0 conn(0x7ff50c0b4320 0x7ff50c0b15d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff4fc002f30 tx=0x7ff4fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.863+0000 7ff50bfff700 1 --2- 172.21.15.103:0/3099303184 >> v2:172.21.15.103:3300/0 conn(0x7ff50c0b4320 0x7ff50c0b15d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff4fc002f30 tx=0x7ff4fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.863+0000 7ff50bfff700 1 --2- 172.21.15.103:0/3099303184 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff50c0b4320 0x7ff50c0b15d0 secure :-1 s=READY pgs=1429 cs=0 l=1 rx=0x7ff4fc002f30 tx=0x7ff4fc007a40).ready entity=mon.1 client_cookie=fc9e4223819b1e05 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:02.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.863+0000 7ff50bfff700 1 --2- 172.21.15.103:0/3099303184 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff50c0b4320 0x7ff50c0b15d0 secure :-1 s=THROTTLE_DONE pgs=1429 cs=0 l=1 rx=0x7ff4fc002f30 tx=0x7ff4fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.863+0000 7ff50affd700 1 -- 172.21.15.103:0/3099303184 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4fc011470 con 0x7ff50c0b4320 2020-04-22T14:15:02.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.863+0000 7ff50bfff700 1 --2- 172.21.15.103:0/3099303184 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff50c0b4320 0x7ff50c0b15d0 secure :-1 s=THROTTLE_DONE pgs=1429 cs=0 l=1 rx=0x7ff4fc002f30 tx=0x7ff4fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.863+0000 7ff50affd700 1 -- 172.21.15.103:0/3099303184 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4fc0115d0 con 0x7ff50c0b4320 2020-04-22T14:15:02.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.863+0000 7ff50bfff700 1 --2- 172.21.15.103:0/3099303184 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff50c0b4320 0x7ff50c0b15d0 secure :-1 s=THROTTLE_DONE pgs=1429 cs=0 l=1 rx=0x7ff4fc002f30 tx=0x7ff4fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.863+0000 7ff50affd700 1 -- 172.21.15.103:0/3099303184 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4fc0119b0 con 0x7ff50c0b4320 2020-04-22T14:15:02.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.863+0000 7ff512833700 1 -- 172.21.15.103:0/3099303184 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff50c0b4320 msgr2=0x7ff50c0b15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:02.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.863+0000 7ff512833700 1 --2- 172.21.15.103:0/3099303184 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff50c0b4320 0x7ff50c0b15d0 secure :-1 s=READY pgs=1429 cs=0 l=1 rx=0x7ff4fc002f30 tx=0x7ff4fc007a40).stop 2020-04-22T14:15:02.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.864+0000 7ff512833700 1 -- 172.21.15.103:0/3099303184 shutdown_connections 2020-04-22T14:15:02.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.864+0000 7ff512833700 1 --2- 172.21.15.103:0/3099303184 >> v2:172.21.15.86:3300/0 conn(0x7ff50c0b2530 0x7ff50c0b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:02.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.864+0000 7ff512833700 1 --2- 172.21.15.103:0/3099303184 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff50c0b4320 0x7ff50c0b15d0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:02.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.864+0000 7ff512833700 1 -- 172.21.15.103:0/3099303184 >> 172.21.15.103:0/3099303184 conn(0x7ff50c0b86b0 msgr2=0x7ff50c0b8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:02.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.864+0000 7ff512833700 1 -- 172.21.15.103:0/3099303184 shutdown_connections 2020-04-22T14:15:02.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.864+0000 7ff512833700 1 -- 172.21.15.103:0/3099303184 wait complete. 2020-04-22T14:15:02.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.865+0000 7ff512833700 1 Processor -- start 2020-04-22T14:15:02.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.865+0000 7ff512833700 1 -- start start 2020-04-22T14:15:02.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.866+0000 7ff512833700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff50c0b4320 0x7ff50c145c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:02.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.866+0000 7ff512833700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff50c1448c0 con 0x7ff50c0b4700 2020-04-22T14:15:02.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.866+0000 7ff512833700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff50c133f10 con 0x7ff50c0b2530 2020-04-22T14:15:02.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.866+0000 7ff512833700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c133d00 con 0x7ff50c0b4320 2020-04-22T14:15:02.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.866+0000 7ff50bfff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff50c0b2530 0x7ff50c132ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46972/0 (socket says 172.21.15.103:46972) 2020-04-22T14:15:02.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.866+0000 7ff50bfff700 1 -- 172.21.15.103:0/843489523 learned_addr learned my addr 172.21.15.103:0/843489523 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:02.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.866+0000 7ff5097fa700 1 -- 172.21.15.103:0/843489523 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3521970446 0 0) 0x7ff50c133f10 con 0x7ff50c0b2530 2020-04-22T14:15:02.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.866+0000 7ff5097fa700 1 -- 172.21.15.103:0/843489523 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4ec002fe0 con 0x7ff50c0b2530 2020-04-22T14:15:02.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.866+0000 7ff50b7fe700 1 --2- 172.21.15.103:0/843489523 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff50c0b4320 0x7ff50c145c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:02.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.866+0000 7ff5097fa700 1 -- 172.21.15.103:0/843489523 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1281479027 0 0) 0x7ff4ec002fe0 con 0x7ff50c0b2530 2020-04-22T14:15:02.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.866+0000 7ff5097fa700 1 -- 172.21.15.103:0/843489523 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff50c133f10 con 0x7ff50c0b2530 2020-04-22T14:15:02.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.866+0000 7ff5097fa700 1 -- 172.21.15.103:0/843489523 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7ff4fc008e10 con 0x7ff50c0b2530 2020-04-22T14:15:02.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.866+0000 7ff5097fa700 1 -- 172.21.15.103:0/843489523 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff50c0b4320 msgr2=0x7ff50c145c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:02.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.866+0000 7ff5097fa700 1 --2- 172.21.15.103:0/843489523 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff50c0b4320 0x7ff50c145c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:02.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.866+0000 7ff5097fa700 1 -- 172.21.15.103:0/843489523 >> v1:172.21.15.103:6789/0 conn(0x7ff50c0b2530 legacy=0x7ff50c132ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:02.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.866+0000 7ff5097fa700 1 -- 172.21.15.103:0/843489523 >> v1:172.21.15.86:6789/0 conn(0x7ff50c0b4700 legacy=0x7ff50c1335f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:02.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.866+0000 7ff5097fa700 1 --2- 172.21.15.103:0/843489523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4ec0049b0 0x7ff4ec004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:02.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.866+0000 7ff5097fa700 1 --2- 172.21.15.103:0/843489523 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff50c0b4320 0x7ff4ec003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:02.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.866+0000 7ff5097fa700 1 --2- 172.21.15.103:0/843489523 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4ec003d80 0x7ff4ec004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:02.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.866+0000 7ff5097fa700 1 -- 172.21.15.103:0/843489523 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c133d00 con 0x7ff4ec003d80 2020-04-22T14:15:02.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.866+0000 7ff5097fa700 1 -- 172.21.15.103:0/843489523 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec004780 con 0x7ff4ec0049b0 2020-04-22T14:15:02.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.866+0000 7ff5097fa700 1 -- 172.21.15.103:0/843489523 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec005370 con 0x7ff50c0b4320 2020-04-22T14:15:02.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.866+0000 7ff50bfff700 1 --2- 172.21.15.103:0/843489523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4ec0049b0 0x7ff4ec004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:02.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.866+0000 7ff50b7fe700 1 --2- 172.21.15.103:0/843489523 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff50c0b4320 0x7ff4ec003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:02.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.866+0000 7ff510dd0700 1 --2- 172.21.15.103:0/843489523 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4ec003d80 0x7ff4ec004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:02.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.867+0000 7ff50bfff700 1 -- 172.21.15.103:0/843489523 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff50c0b4320 msgr2=0x7ff4ec003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:02.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.867+0000 7ff50bfff700 1 --2- 172.21.15.103:0/843489523 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff50c0b4320 0x7ff4ec003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:02.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.867+0000 7ff50bfff700 1 -- 172.21.15.103:0/843489523 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4ec003d80 msgr2=0x7ff4ec004200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:02.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.867+0000 7ff50bfff700 1 --2- 172.21.15.103:0/843489523 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4ec003d80 0x7ff4ec004200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:02.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.867+0000 7ff50bfff700 1 -- 172.21.15.103:0/843489523 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff50c1341b0 con 0x7ff4ec0049b0 2020-04-22T14:15:02.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.867+0000 7ff512833700 1 -- 172.21.15.103:0/843489523 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff50c145c10 con 0x7ff4ec0049b0 2020-04-22T14:15:02.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.867+0000 7ff50b7fe700 1 --2- 172.21.15.103:0/843489523 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff50c0b4320 0x7ff4ec003920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:15:02.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.867+0000 7ff510dd0700 1 --2- 172.21.15.103:0/843489523 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4ec003d80 0x7ff4ec004200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:15:02.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.867+0000 7ff50bfff700 1 --2- 172.21.15.103:0/843489523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4ec0049b0 0x7ff4ec004d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff4fc010220 tx=0x7ff4fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.867+0000 7ff512833700 1 -- 172.21.15.103:0/843489523 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff50c143610 con 0x7ff4ec0049b0 2020-04-22T14:15:02.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.867+0000 7ff50bfff700 1 --2- 172.21.15.103:0/843489523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4ec0049b0 0x7ff4ec004d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff4fc010220 tx=0x7ff4fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.867+0000 7ff50bfff700 1 --2- 172.21.15.103:0/843489523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4ec0049b0 0x7ff4ec004d90 secure :-1 s=READY pgs=1431 cs=0 l=1 rx=0x7ff4fc010220 tx=0x7ff4fc007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:02.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.867+0000 7ff50bfff700 1 --2- 172.21.15.103:0/843489523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4ec0049b0 0x7ff4ec004d90 secure :-1 s=THROTTLE_DONE pgs=1431 cs=0 l=1 rx=0x7ff4fc010220 tx=0x7ff4fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.867+0000 7ff5097fa700 1 -- 172.21.15.103:0/843489523 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4fc007550 con 0x7ff4ec0049b0 2020-04-22T14:15:02.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.867+0000 7ff50bfff700 1 --2- 172.21.15.103:0/843489523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4ec0049b0 0x7ff4ec004d90 secure :-1 s=THROTTLE_DONE pgs=1431 cs=0 l=1 rx=0x7ff4fc010220 tx=0x7ff4fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.867+0000 7ff50bfff700 1 --2- 172.21.15.103:0/843489523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4ec0049b0 0x7ff4ec004d90 secure :-1 s=THROTTLE_DONE pgs=1431 cs=0 l=1 rx=0x7ff4fc010220 tx=0x7ff4fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.867+0000 7ff5097fa700 1 -- 172.21.15.103:0/843489523 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4fc00a730 con 0x7ff4ec0049b0 2020-04-22T14:15:02.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.867+0000 7ff5097fa700 1 -- 172.21.15.103:0/843489523 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4fc00ab50 con 0x7ff4ec0049b0 2020-04-22T14:15:02.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.867+0000 7ff50bfff700 1 --2- 172.21.15.103:0/843489523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4ec0049b0 0x7ff4ec004d90 secure :-1 s=THROTTLE_DONE pgs=1431 cs=0 l=1 rx=0x7ff4fc010220 tx=0x7ff4fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.868+0000 7ff512833700 1 -- 172.21.15.103:0/843489523 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4e8003340 con 0x7ff4ec0049b0 2020-04-22T14:15:02.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.868+0000 7ff5097fa700 1 -- 172.21.15.103:0/843489523 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ff4fc00acb0 con 0x7ff4ec0049b0 2020-04-22T14:15:02.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.868+0000 7ff50bfff700 1 --2- 172.21.15.103:0/843489523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4ec0049b0 0x7ff4ec004d90 secure :-1 s=THROTTLE_DONE pgs=1431 cs=0 l=1 rx=0x7ff4fc010220 tx=0x7ff4fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.868+0000 7ff5097fa700 1 --2- 172.21.15.103:0/843489523 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff4ec055b50 0x7ff4ec058010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:02.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.868+0000 7ff5097fa700 1 -- 172.21.15.103:0/843489523 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6116+0+0 (secure 0 0 0) 0x7ff4fc062450 con 0x7ff4ec0049b0 2020-04-22T14:15:02.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.868+0000 7ff50b7fe700 1 --2- 172.21.15.103:0/843489523 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff4ec055b50 0x7ff4ec058010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:02.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.869+0000 7ff50b7fe700 1 --2- 172.21.15.103:0/843489523 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff4ec055b50 0x7ff4ec058010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff500000b80 tx=0x7ff500001130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.869+0000 7ff50b7fe700 1 --2- 172.21.15.103:0/843489523 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff4ec055b50 0x7ff4ec058010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff500000b80 tx=0x7ff500001130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.869+0000 7ff50b7fe700 1 --2- 172.21.15.103:0/843489523 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff4ec055b50 0x7ff4ec058010 secure :-1 s=READY pgs=521 cs=0 l=1 rx=0x7ff500000b80 tx=0x7ff500001130).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:02.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.872+0000 7ff50bfff700 1 --2- 172.21.15.103:0/843489523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4ec0049b0 0x7ff4ec004d90 secure :-1 s=THROTTLE_DONE pgs=1431 cs=0 l=1 rx=0x7ff4fc010220 tx=0x7ff4fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:02.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:02.872+0000 7ff5097fa700 1 -- 172.21.15.103:0/843489523 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ff4fc03d950 con 0x7ff4ec0049b0 2020-04-22T14:15:03.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.064+0000 7ff512833700 1 -- 172.21.15.103:0/843489523 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff4e80021d0 con 0x7ff4ec0049b0 2020-04-22T14:15:03.628 INFO:tasks.ceph.mon.b.smithi086.stderr:2020-04-22T14:15:03.626+0000 7fbdbf880700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-04-22T14:15:03.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.628+0000 7ff50bfff700 1 --2- 172.21.15.103:0/843489523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4ec0049b0 0x7ff4ec004d90 secure :-1 s=THROTTLE_DONE pgs=1431 cs=0 l=1 rx=0x7ff4fc010220 tx=0x7ff4fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:03.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.628+0000 7ff5097fa700 1 -- 172.21.15.103:0/843489523 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v67) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff4fc040f70 con 0x7ff4ec0049b0 2020-04-22T14:15:03.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.630+0000 7ff512833700 1 -- 172.21.15.103:0/843489523 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff4ec055b50 msgr2=0x7ff4ec058010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:03.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.630+0000 7ff512833700 1 --2- 172.21.15.103:0/843489523 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff4ec055b50 0x7ff4ec058010 secure :-1 s=READY pgs=521 cs=0 l=1 rx=0x7ff500000b80 tx=0x7ff500001130).stop 2020-04-22T14:15:03.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.630+0000 7ff512833700 1 -- 172.21.15.103:0/843489523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4ec0049b0 msgr2=0x7ff4ec004d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:03.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.630+0000 7ff512833700 1 --2- 172.21.15.103:0/843489523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4ec0049b0 0x7ff4ec004d90 secure :-1 s=READY pgs=1431 cs=0 l=1 rx=0x7ff4fc010220 tx=0x7ff4fc007a40).stop 2020-04-22T14:15:03.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.630+0000 7ff510dd0700 1 -- 172.21.15.103:0/843489523 reap_dead start 2020-04-22T14:15:03.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.630+0000 7ff512833700 1 -- 172.21.15.103:0/843489523 shutdown_connections 2020-04-22T14:15:03.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.630+0000 7ff512833700 1 -- 172.21.15.103:0/843489523 >> 172.21.15.103:0/843489523 conn(0x7ff50c0b86b0 msgr2=0x7ff50c065ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:03.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.631+0000 7ff512833700 1 -- 172.21.15.103:0/843489523 shutdown_connections 2020-04-22T14:15:03.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.631+0000 7ff512833700 1 -- 172.21.15.103:0/843489523 wait complete. 2020-04-22T14:15:03.635 INFO:teuthology.orchestra.run.smithi103.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2020-04-22T14:15:03.646 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:03.654 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2020-04-22T14:15:03.660 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:15:03.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.803+0000 7fad9d046700 1 Processor -- start 2020-04-22T14:15:03.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.803+0000 7fad9d046700 1 -- start start 2020-04-22T14:15:03.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.804+0000 7fad9d046700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fad980b6040 0x7fad980ac740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:03.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.804+0000 7fad9d046700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad98064ec0 con 0x7fad98067170 2020-04-22T14:15:03.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.804+0000 7fad9d046700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad98146870 con 0x7fad981426d0 2020-04-22T14:15:03.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.804+0000 7fad9d046700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad98065af0 con 0x7fad980b6040 2020-04-22T14:15:03.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.805+0000 7fad9659c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fad980b6040 0x7fad980ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:03.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.805+0000 7fad9759e700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fad981426d0 0x7fad98142b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47000/0 (socket says 172.21.15.103:47000) 2020-04-22T14:15:03.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.805+0000 7fad9759e700 1 -- 172.21.15.103:0/2664933160 learned_addr learned my addr 172.21.15.103:0/2664933160 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:03.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.805+0000 7fad9659c700 1 -- 172.21.15.103:0/2664933160 >> v1:172.21.15.103:6789/0 conn(0x7fad981426d0 legacy=0x7fad98142b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:03.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.805+0000 7fad9659c700 1 -- 172.21.15.103:0/2664933160 >> v1:172.21.15.86:6789/0 conn(0x7fad98067170 legacy=0x7fad9813c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:03.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.805+0000 7fad95d9b700 1 -- 172.21.15.103:0/2664933160 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 869456781 0 0) 0x7fad98146870 con 0x7fad981426d0 2020-04-22T14:15:03.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.805+0000 7fad9659c700 1 -- 172.21.15.103:0/2664933160 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad98067550 con 0x7fad980b6040 2020-04-22T14:15:03.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.805+0000 7fad9659c700 1 --2- 172.21.15.103:0/2664933160 >> v2:172.21.15.103:3300/0 conn(0x7fad980b6040 0x7fad980ac740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fad98066c90 tx=0x7fad800088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:03.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.805+0000 7fad9659c700 1 --2- 172.21.15.103:0/2664933160 >> v2:172.21.15.103:3300/0 conn(0x7fad980b6040 0x7fad980ac740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fad98066c90 tx=0x7fad800088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:03.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.805+0000 7fad9659c700 1 --2- 172.21.15.103:0/2664933160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad980b6040 0x7fad980ac740 secure :-1 s=READY pgs=1437 cs=0 l=1 rx=0x7fad98066c90 tx=0x7fad800088e0).ready entity=mon.1 client_cookie=5790c6a1657f6f9a server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:03.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.805+0000 7fad9659c700 1 --2- 172.21.15.103:0/2664933160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad980b6040 0x7fad980ac740 secure :-1 s=THROTTLE_DONE pgs=1437 cs=0 l=1 rx=0x7fad98066c90 tx=0x7fad800088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:03.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.805+0000 7fad95d9b700 1 -- 172.21.15.103:0/2664933160 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad80008e40 con 0x7fad980b6040 2020-04-22T14:15:03.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.805+0000 7fad9659c700 1 --2- 172.21.15.103:0/2664933160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad980b6040 0x7fad980ac740 secure :-1 s=THROTTLE_DONE pgs=1437 cs=0 l=1 rx=0x7fad98066c90 tx=0x7fad800088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:03.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.805+0000 7fad95d9b700 1 -- 172.21.15.103:0/2664933160 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad80011660 con 0x7fad980b6040 2020-04-22T14:15:03.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.805+0000 7fad9659c700 1 --2- 172.21.15.103:0/2664933160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad980b6040 0x7fad980ac740 secure :-1 s=THROTTLE_DONE pgs=1437 cs=0 l=1 rx=0x7fad98066c90 tx=0x7fad800088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:03.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.805+0000 7fad95d9b700 1 -- 172.21.15.103:0/2664933160 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad80011a80 con 0x7fad980b6040 2020-04-22T14:15:03.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.805+0000 7fad9d046700 1 -- 172.21.15.103:0/2664933160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad980b6040 msgr2=0x7fad980ac740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:03.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.805+0000 7fad9d046700 1 --2- 172.21.15.103:0/2664933160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad980b6040 0x7fad980ac740 secure :-1 s=READY pgs=1437 cs=0 l=1 rx=0x7fad98066c90 tx=0x7fad800088e0).stop 2020-04-22T14:15:03.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.806+0000 7fad9d046700 1 -- 172.21.15.103:0/2664933160 shutdown_connections 2020-04-22T14:15:03.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.806+0000 7fad9d046700 1 --2- 172.21.15.103:0/2664933160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad980b6040 0x7fad980ac740 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:03.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.806+0000 7fad9d046700 1 -- 172.21.15.103:0/2664933160 >> 172.21.15.103:0/2664933160 conn(0x7fad980b9160 msgr2=0x7fad9805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:03.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.806+0000 7fad9d046700 1 -- 172.21.15.103:0/2664933160 shutdown_connections 2020-04-22T14:15:03.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.806+0000 7fad9d046700 1 -- 172.21.15.103:0/2664933160 wait complete. 2020-04-22T14:15:03.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.807+0000 7fad9d046700 1 Processor -- start 2020-04-22T14:15:03.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.807+0000 7fad9d046700 1 -- start start 2020-04-22T14:15:03.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.807+0000 7fad9d046700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fad98067170 0x7fad9813eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:03.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.807+0000 7fad9d046700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fad980b6040 0x7fad9813c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:03.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.807+0000 7fad9d046700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad98141520 con 0x7fad981426d0 2020-04-22T14:15:03.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.807+0000 7fad9d046700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad980adf80 con 0x7fad98067170 2020-04-22T14:15:03.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.807+0000 7fad9d046700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad9813c930 con 0x7fad980b6040 2020-04-22T14:15:03.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.807+0000 7fad9759e700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fad981426d0 0x7fad98132080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47008/0 (socket says 172.21.15.103:47008) 2020-04-22T14:15:03.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.807+0000 7fad9759e700 1 -- 172.21.15.103:0/883804475 learned_addr learned my addr 172.21.15.103:0/883804475 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:03.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.808+0000 7fad9659c700 1 --2- 172.21.15.103:0/883804475 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fad980b6040 0x7fad9813c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:03.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.808+0000 7fad96d9d700 1 --2- 172.21.15.103:0/883804475 >> v2:172.21.15.86:3300/0 conn(0x7fad98067170 0x7fad9813eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:03.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.808+0000 7fad8ffff700 1 -- 172.21.15.103:0/883804475 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2423189860 0 0) 0x7fad98141520 con 0x7fad981426d0 2020-04-22T14:15:03.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.808+0000 7fad8ffff700 1 -- 172.21.15.103:0/883804475 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad7c002fe0 con 0x7fad981426d0 2020-04-22T14:15:03.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.808+0000 7fad8ffff700 1 -- 172.21.15.103:0/883804475 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1767450072 0 0) 0x7fad7c002fe0 con 0x7fad981426d0 2020-04-22T14:15:03.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.808+0000 7fad8ffff700 1 -- 172.21.15.103:0/883804475 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fad98141520 con 0x7fad981426d0 2020-04-22T14:15:03.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.808+0000 7fad8ffff700 1 -- 172.21.15.103:0/883804475 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fad90001be0 con 0x7fad981426d0 2020-04-22T14:15:03.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.808+0000 7fad8ffff700 1 -- 172.21.15.103:0/883804475 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fad980b6040 msgr2=0x7fad9813c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:03.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.808+0000 7fad8ffff700 1 --2- 172.21.15.103:0/883804475 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fad980b6040 0x7fad9813c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:03.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.808+0000 7fad8ffff700 1 -- 172.21.15.103:0/883804475 >> v2:172.21.15.86:3300/0 conn(0x7fad98067170 msgr2=0x7fad9813eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:03.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.808+0000 7fad8ffff700 1 --2- 172.21.15.103:0/883804475 >> v2:172.21.15.86:3300/0 conn(0x7fad98067170 0x7fad9813eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:03.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.808+0000 7fad8ffff700 1 -- 172.21.15.103:0/883804475 >> v1:172.21.15.103:6789/0 conn(0x7fad981426d0 legacy=0x7fad98132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:03.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.808+0000 7fad8ffff700 1 --2- 172.21.15.103:0/883804475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad7c0049b0 0x7fad7c004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:03.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.808+0000 7fad8ffff700 1 --2- 172.21.15.103:0/883804475 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad7c003920 0x7fad7c003d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:03.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.808+0000 7fad8ffff700 1 --2- 172.21.15.103:0/883804475 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fad980b6040 0x7fad7c0041c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:03.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.808+0000 7fad8ffff700 1 -- 172.21.15.103:0/883804475 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad980adf80 con 0x7fad7c003920 2020-04-22T14:15:03.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.808+0000 7fad8ffff700 1 -- 172.21.15.103:0/883804475 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9813c930 con 0x7fad7c0049b0 2020-04-22T14:15:03.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.808+0000 7fad8ffff700 1 -- 172.21.15.103:0/883804475 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c005550 con 0x7fad980b6040 2020-04-22T14:15:03.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.808+0000 7fad96d9d700 1 --2- 172.21.15.103:0/883804475 >> v2:172.21.15.86:3300/0 conn(0x7fad98067170 0x7fad9813eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:15:03.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.808+0000 7fad96d9d700 1 --2- 172.21.15.103:0/883804475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad7c0049b0 0x7fad7c004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:03.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.808+0000 7fad9759e700 1 --2- 172.21.15.103:0/883804475 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fad980b6040 0x7fad7c0041c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:03.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.808+0000 7fad9659c700 1 --2- 172.21.15.103:0/883804475 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad7c003920 0x7fad7c003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:03.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.808+0000 7fad96d9d700 1 -- 172.21.15.103:0/883804475 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fad980b6040 msgr2=0x7fad7c0041c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:03.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.808+0000 7fad96d9d700 1 --2- 172.21.15.103:0/883804475 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fad980b6040 0x7fad7c0041c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:03.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.808+0000 7fad96d9d700 1 -- 172.21.15.103:0/883804475 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad7c003920 msgr2=0x7fad7c003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:03.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.808+0000 7fad96d9d700 1 --2- 172.21.15.103:0/883804475 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad7c003920 0x7fad7c003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:03.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.808+0000 7fad96d9d700 1 -- 172.21.15.103:0/883804475 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad98140cf0 con 0x7fad7c0049b0 2020-04-22T14:15:03.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.808+0000 7fad9d046700 1 -- 172.21.15.103:0/883804475 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad981411a0 con 0x7fad7c0049b0 2020-04-22T14:15:03.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.808+0000 7fad96d9d700 1 --2- 172.21.15.103:0/883804475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad7c0049b0 0x7fad7c004dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fad98066130 tx=0x7fad88010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:03.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.808+0000 7fad9d046700 1 -- 172.21.15.103:0/883804475 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad98132790 con 0x7fad7c0049b0 2020-04-22T14:15:03.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.809+0000 7fad96d9d700 1 --2- 172.21.15.103:0/883804475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad7c0049b0 0x7fad7c004dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fad98066130 tx=0x7fad88010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:03.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.809+0000 7fad96d9d700 1 --2- 172.21.15.103:0/883804475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad7c0049b0 0x7fad7c004dd0 secure :-1 s=READY pgs=1439 cs=0 l=1 rx=0x7fad98066130 tx=0x7fad88010eb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:03.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.809+0000 7fad96d9d700 1 --2- 172.21.15.103:0/883804475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad7c0049b0 0x7fad7c004dd0 secure :-1 s=THROTTLE_DONE pgs=1439 cs=0 l=1 rx=0x7fad98066130 tx=0x7fad88010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:03.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.809+0000 7fad8ffff700 1 -- 172.21.15.103:0/883804475 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad8800ce60 con 0x7fad7c0049b0 2020-04-22T14:15:03.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.809+0000 7fad96d9d700 1 --2- 172.21.15.103:0/883804475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad7c0049b0 0x7fad7c004dd0 secure :-1 s=THROTTLE_DONE pgs=1439 cs=0 l=1 rx=0x7fad98066130 tx=0x7fad88010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:03.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.809+0000 7fad96d9d700 1 --2- 172.21.15.103:0/883804475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad7c0049b0 0x7fad7c004dd0 secure :-1 s=THROTTLE_DONE pgs=1439 cs=0 l=1 rx=0x7fad98066130 tx=0x7fad88010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:03.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.809+0000 7fad8ffff700 1 -- 172.21.15.103:0/883804475 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad880064e0 con 0x7fad7c0049b0 2020-04-22T14:15:03.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.809+0000 7fad8ffff700 1 -- 172.21.15.103:0/883804475 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad88006900 con 0x7fad7c0049b0 2020-04-22T14:15:03.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.809+0000 7fad96d9d700 1 --2- 172.21.15.103:0/883804475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad7c0049b0 0x7fad7c004dd0 secure :-1 s=THROTTLE_DONE pgs=1439 cs=0 l=1 rx=0x7fad98066130 tx=0x7fad88010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:03.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.809+0000 7fad9d046700 1 -- 172.21.15.103:0/883804475 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad70003340 con 0x7fad7c0049b0 2020-04-22T14:15:03.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.810+0000 7fad8ffff700 1 -- 172.21.15.103:0/883804475 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fad88006a60 con 0x7fad7c0049b0 2020-04-22T14:15:03.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.810+0000 7fad96d9d700 1 --2- 172.21.15.103:0/883804475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad7c0049b0 0x7fad7c004dd0 secure :-1 s=THROTTLE_DONE pgs=1439 cs=0 l=1 rx=0x7fad98066130 tx=0x7fad88010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:03.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.810+0000 7fad8ffff700 1 --2- 172.21.15.103:0/883804475 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fad7c055a90 0x7fad7c057f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:03.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.810+0000 7fad8ffff700 1 -- 172.21.15.103:0/883804475 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6202+0+0 (secure 0 0 0) 0x7fad88061340 con 0x7fad7c0049b0 2020-04-22T14:15:03.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.810+0000 7fad9659c700 1 --2- 172.21.15.103:0/883804475 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fad7c055a90 0x7fad7c057f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:03.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.810+0000 7fad9659c700 1 --2- 172.21.15.103:0/883804475 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fad7c055a90 0x7fad7c057f50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fad98066c90 tx=0x7fad980676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:03.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.810+0000 7fad9659c700 1 --2- 172.21.15.103:0/883804475 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fad7c055a90 0x7fad7c057f50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fad98066c90 tx=0x7fad980676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:03.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.810+0000 7fad9659c700 1 --2- 172.21.15.103:0/883804475 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fad7c055a90 0x7fad7c057f50 secure :-1 s=READY pgs=522 cs=0 l=1 rx=0x7fad98066c90 tx=0x7fad980676e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:03.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.815+0000 7fad96d9d700 1 --2- 172.21.15.103:0/883804475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad7c0049b0 0x7fad7c004dd0 secure :-1 s=THROTTLE_DONE pgs=1439 cs=0 l=1 rx=0x7fad98066130 tx=0x7fad88010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:03.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:03.815+0000 7fad8ffff700 1 -- 172.21.15.103:0/883804475 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fad8803c720 con 0x7fad7c0049b0 2020-04-22T14:15:04.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.001+0000 7fad9d046700 1 -- 172.21.15.103:0/883804475 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad700036e0 con 0x7fad7c0049b0 2020-04-22T14:15:04.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.002+0000 7fad96d9d700 1 --2- 172.21.15.103:0/883804475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad7c0049b0 0x7fad7c004dd0 secure :-1 s=THROTTLE_DONE pgs=1439 cs=0 l=1 rx=0x7fad98066130 tx=0x7fad88010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:04.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.002+0000 7fad8ffff700 1 -- 172.21.15.103:0/883804475 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+1778 (secure 0 0 0) 0x7fad8803fd40 con 0x7fad7c0049b0 2020-04-22T14:15:04.005 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:15:04.005 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":67,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5810,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/2664816107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2664816107},{"type":"v1","addr":"172.21.15.86:6835","nonce":2664816107}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":60}],"filesystems":[{"mdsmap":{"epoch":67,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:13:59.062543+0000","modified":"2020-04-22T14:15:03.627137+0000","tableserver":0,"root":0,"session_timeout":30,"session_autoclose":50,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-04-22T14:15:04.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.003+0000 7fad9d046700 1 -- 172.21.15.103:0/883804475 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fad7c055a90 msgr2=0x7fad7c057f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:04.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.003+0000 7fad9d046700 1 --2- 172.21.15.103:0/883804475 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fad7c055a90 0x7fad7c057f50 secure :-1 s=READY pgs=522 cs=0 l=1 rx=0x7fad98066c90 tx=0x7fad980676e0).stop 2020-04-22T14:15:04.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.003+0000 7fad9d046700 1 -- 172.21.15.103:0/883804475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad7c0049b0 msgr2=0x7fad7c004dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:04.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.003+0000 7fad9d046700 1 --2- 172.21.15.103:0/883804475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad7c0049b0 0x7fad7c004dd0 secure :-1 s=READY pgs=1439 cs=0 l=1 rx=0x7fad98066130 tx=0x7fad88010eb0).stop 2020-04-22T14:15:04.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.003+0000 7fad9759e700 1 -- 172.21.15.103:0/883804475 reap_dead start 2020-04-22T14:15:04.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.003+0000 7fad9759e700 1 -- 172.21.15.103:0/883804475 reap_dead start 2020-04-22T14:15:04.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.003+0000 7fad9d046700 1 -- 172.21.15.103:0/883804475 shutdown_connections 2020-04-22T14:15:04.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.003+0000 7fad9d046700 1 -- 172.21.15.103:0/883804475 >> 172.21.15.103:0/883804475 conn(0x7fad980b9160 msgr2=0x7fad980b7450 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:04.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.003+0000 7fad9d046700 1 -- 172.21.15.103:0/883804475 shutdown_connections 2020-04-22T14:15:04.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.003+0000 7fad9d046700 1 -- 172.21.15.103:0/883804475 wait complete. 2020-04-22T14:15:04.008 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 67 2020-04-22T14:15:04.017 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:04.032 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-04-22T14:15:04.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.179+0000 7f1c90a6a700 1 Processor -- start 2020-04-22T14:15:04.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.179+0000 7f1c90a6a700 1 -- start start 2020-04-22T14:15:04.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.179+0000 7f1c90a6a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1c8c0b9140 0x7f1c8c0aed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:04.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.179+0000 7f1c90a6a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1c8c0b3bd0 0x7f1c8c0af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:04.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.179+0000 7f1c90a6a700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c8c148310 con 0x7f1c8c0616b0 2020-04-22T14:15:04.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.179+0000 7f1c90a6a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c8c0af650 con 0x7f1c8c0b3bd0 2020-04-22T14:15:04.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.179+0000 7f1c90a6a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c8c1485b0 con 0x7f1c8c0b9140 2020-04-22T14:15:04.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.179+0000 7f1c8a59c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1c8c0b9140 0x7f1c8c0aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:04.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.179+0000 7f1c8ad9d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f1c8c0616b0 0x7f1c8c061b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47018/0 (socket says 172.21.15.103:47018) 2020-04-22T14:15:04.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.179+0000 7f1c8ad9d700 1 -- 172.21.15.103:0/320833398 learned_addr learned my addr 172.21.15.103:0/320833398 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:04.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.179+0000 7f1c89d9b700 1 --2- 172.21.15.103:0/320833398 >> v2:172.21.15.86:3300/0 conn(0x7f1c8c0b3bd0 0x7f1c8c0af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:04.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.179+0000 7f1c8a59c700 1 -- 172.21.15.103:0/320833398 >> v2:172.21.15.86:3300/0 conn(0x7f1c8c0b3bd0 msgr2=0x7f1c8c0af1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:04.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.179+0000 7f1c8a59c700 1 --2- 172.21.15.103:0/320833398 >> v2:172.21.15.86:3300/0 conn(0x7f1c8c0b3bd0 0x7f1c8c0af1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:04.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.179+0000 7f1c8a59c700 1 -- 172.21.15.103:0/320833398 >> v1:172.21.15.103:6789/0 conn(0x7f1c8c0616b0 legacy=0x7f1c8c061b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:04.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.179+0000 7f1c8a59c700 1 -- 172.21.15.103:0/320833398 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c8c0b9520 con 0x7f1c8c0b9140 2020-04-22T14:15:04.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.179+0000 7f1c8959a700 1 -- 172.21.15.103:0/320833398 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 984096882 0 0) 0x7f1c8c148310 con 0x7f1c8c0616b0 2020-04-22T14:15:04.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.179+0000 7f1c8a59c700 1 --2- 172.21.15.103:0/320833398 >> v2:172.21.15.103:3300/0 conn(0x7f1c8c0b9140 0x7f1c8c0aed90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1c7c002f30 tx=0x7f1c7c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:04.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.179+0000 7f1c8a59c700 1 --2- 172.21.15.103:0/320833398 >> v2:172.21.15.103:3300/0 conn(0x7f1c8c0b9140 0x7f1c8c0aed90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1c7c002f30 tx=0x7f1c7c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:04.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.179+0000 7f1c8a59c700 1 --2- 172.21.15.103:0/320833398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c8c0b9140 0x7f1c8c0aed90 secure :-1 s=READY pgs=1441 cs=0 l=1 rx=0x7f1c7c002f30 tx=0x7f1c7c007a40).ready entity=mon.1 client_cookie=b0c041cd794545e server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:04.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.179+0000 7f1c8a59c700 1 --2- 172.21.15.103:0/320833398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c8c0b9140 0x7f1c8c0aed90 secure :-1 s=THROTTLE_DONE pgs=1441 cs=0 l=1 rx=0x7f1c7c002f30 tx=0x7f1c7c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:04.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.179+0000 7f1c8959a700 1 -- 172.21.15.103:0/320833398 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c7c011470 con 0x7f1c8c0b9140 2020-04-22T14:15:04.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.179+0000 7f1c8a59c700 1 --2- 172.21.15.103:0/320833398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c8c0b9140 0x7f1c8c0aed90 secure :-1 s=THROTTLE_DONE pgs=1441 cs=0 l=1 rx=0x7f1c7c002f30 tx=0x7f1c7c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:04.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.179+0000 7f1c8a59c700 1 --2- 172.21.15.103:0/320833398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c8c0b9140 0x7f1c8c0aed90 secure :-1 s=THROTTLE_DONE pgs=1441 cs=0 l=1 rx=0x7f1c7c002f30 tx=0x7f1c7c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:04.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.179+0000 7f1c8959a700 1 -- 172.21.15.103:0/320833398 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7c0115d0 con 0x7f1c8c0b9140 2020-04-22T14:15:04.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.179+0000 7f1c8959a700 1 -- 172.21.15.103:0/320833398 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c7c0119b0 con 0x7f1c8c0b9140 2020-04-22T14:15:04.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.179+0000 7f1c90a6a700 1 -- 172.21.15.103:0/320833398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c8c0b9140 msgr2=0x7f1c8c0aed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:04.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.179+0000 7f1c90a6a700 1 --2- 172.21.15.103:0/320833398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c8c0b9140 0x7f1c8c0aed90 secure :-1 s=READY pgs=1441 cs=0 l=1 rx=0x7f1c7c002f30 tx=0x7f1c7c007a40).stop 2020-04-22T14:15:04.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.180+0000 7f1c90a6a700 1 -- 172.21.15.103:0/320833398 shutdown_connections 2020-04-22T14:15:04.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.180+0000 7f1c90a6a700 1 --2- 172.21.15.103:0/320833398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c8c0b9140 0x7f1c8c0aed90 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:04.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.180+0000 7f1c90a6a700 1 --2- 172.21.15.103:0/320833398 >> v2:172.21.15.86:3300/0 conn(0x7f1c8c0b3bd0 0x7f1c8c0af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:04.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.180+0000 7f1c90a6a700 1 -- 172.21.15.103:0/320833398 >> 172.21.15.103:0/320833398 conn(0x7f1c8c05b7b0 msgr2=0x7f1c8c0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:04.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.180+0000 7f1c90a6a700 1 -- 172.21.15.103:0/320833398 shutdown_connections 2020-04-22T14:15:04.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.180+0000 7f1c90a6a700 1 -- 172.21.15.103:0/320833398 wait complete. 2020-04-22T14:15:04.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.181+0000 7f1c90a6a700 1 Processor -- start 2020-04-22T14:15:04.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.181+0000 7f1c90a6a700 1 -- start start 2020-04-22T14:15:04.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.182+0000 7f1c90a6a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c8c0b9140 0x7f1c8c147c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:04.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.182+0000 7f1c90a6a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c8c148060 con 0x7f1c8c0b3bd0 2020-04-22T14:15:04.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.182+0000 7f1c90a6a700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c8c0635e0 con 0x7f1c8c0616b0 2020-04-22T14:15:04.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.182+0000 7f1c90a6a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c142500 con 0x7f1c8c0b9140 2020-04-22T14:15:04.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.182+0000 7f1c8a59c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f1c8c0616b0 0x7f1c8c151c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47024/0 (socket says 172.21.15.103:47024) 2020-04-22T14:15:04.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.182+0000 7f1c8a59c700 1 -- 172.21.15.103:0/2815591605 learned_addr learned my addr 172.21.15.103:0/2815591605 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:04.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.182+0000 7f1c8ad9d700 1 --2- 172.21.15.103:0/2815591605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c8c0b9140 0x7f1c8c147c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:04.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.182+0000 7f1c7b7fe700 1 -- 172.21.15.103:0/2815591605 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1724387564 0 0) 0x7f1c8c0635e0 con 0x7f1c8c0616b0 2020-04-22T14:15:04.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.182+0000 7f1c7b7fe700 1 -- 172.21.15.103:0/2815591605 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c68002fe0 con 0x7f1c8c0616b0 2020-04-22T14:15:04.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.182+0000 7f1c7b7fe700 1 -- 172.21.15.103:0/2815591605 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2529343776 0 0) 0x7f1c68002fe0 con 0x7f1c8c0616b0 2020-04-22T14:15:04.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.182+0000 7f1c7b7fe700 1 -- 172.21.15.103:0/2815591605 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1c8c0635e0 con 0x7f1c8c0616b0 2020-04-22T14:15:04.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.182+0000 7f1c7b7fe700 1 -- 172.21.15.103:0/2815591605 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f1c7c008e10 con 0x7f1c8c0616b0 2020-04-22T14:15:04.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.182+0000 7f1c7b7fe700 1 -- 172.21.15.103:0/2815591605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c8c0b9140 msgr2=0x7f1c8c147c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:04.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.182+0000 7f1c7b7fe700 1 --2- 172.21.15.103:0/2815591605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c8c0b9140 0x7f1c8c147c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:04.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.182+0000 7f1c7b7fe700 1 -- 172.21.15.103:0/2815591605 >> v1:172.21.15.103:6789/0 conn(0x7f1c8c0616b0 legacy=0x7f1c8c151c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:04.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.182+0000 7f1c7b7fe700 1 -- 172.21.15.103:0/2815591605 >> v1:172.21.15.86:6789/0 conn(0x7f1c8c0b3bd0 legacy=0x7f1c8c141df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:04.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.182+0000 7f1c7b7fe700 1 --2- 172.21.15.103:0/2815591605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c8c0b9140 0x7f1c680049b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:04.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.182+0000 7f1c7b7fe700 1 --2- 172.21.15.103:0/2815591605 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c68004e10 0x7f1c68005230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:04.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.182+0000 7f1c7b7fe700 1 --2- 172.21.15.103:0/2815591605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c68003990 0x7f1c68003e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:04.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.182+0000 7f1c7b7fe700 1 -- 172.21.15.103:0/2815591605 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c142500 con 0x7f1c68004e10 2020-04-22T14:15:04.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.182+0000 7f1c7b7fe700 1 -- 172.21.15.103:0/2815591605 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c68004480 con 0x7f1c68003990 2020-04-22T14:15:04.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.182+0000 7f1c7b7fe700 1 -- 172.21.15.103:0/2815591605 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c68004640 con 0x7f1c8c0b9140 2020-04-22T14:15:04.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.182+0000 7f1c8ad9d700 1 --2- 172.21.15.103:0/2815591605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c68003990 0x7f1c68003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:04.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.182+0000 7f1c8a59c700 1 --2- 172.21.15.103:0/2815591605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c8c0b9140 0x7f1c680049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:04.214 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.182+0000 7f1c89d9b700 1 --2- 172.21.15.103:0/2815591605 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c68004e10 0x7f1c68005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:04.214 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.183+0000 7f1c8ad9d700 1 -- 172.21.15.103:0/2815591605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c8c0b9140 msgr2=0x7f1c680049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:04.214 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.183+0000 7f1c8ad9d700 1 --2- 172.21.15.103:0/2815591605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c8c0b9140 0x7f1c680049b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:04.214 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.183+0000 7f1c8ad9d700 1 -- 172.21.15.103:0/2815591605 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c68004e10 msgr2=0x7f1c68005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:04.214 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.183+0000 7f1c8ad9d700 1 --2- 172.21.15.103:0/2815591605 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c68004e10 0x7f1c68005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:04.214 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.183+0000 7f1c8ad9d700 1 -- 172.21.15.103:0/2815591605 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c8c063880 con 0x7f1c68003990 2020-04-22T14:15:04.214 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.183+0000 7f1c90a6a700 1 -- 172.21.15.103:0/2815591605 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c8c0651f0 con 0x7f1c68003990 2020-04-22T14:15:04.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.183+0000 7f1c8ad9d700 1 --2- 172.21.15.103:0/2815591605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c68003990 0x7f1c68003e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1c84001210 tx=0x7f1c8400c950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:04.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.183+0000 7f1c90a6a700 1 -- 172.21.15.103:0/2815591605 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c8c147dc0 con 0x7f1c68003990 2020-04-22T14:15:04.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.183+0000 7f1c8ad9d700 1 --2- 172.21.15.103:0/2815591605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c68003990 0x7f1c68003e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1c84001210 tx=0x7f1c8400c950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:04.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.183+0000 7f1c8ad9d700 1 --2- 172.21.15.103:0/2815591605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c68003990 0x7f1c68003e40 secure :-1 s=READY pgs=1443 cs=0 l=1 rx=0x7f1c84001210 tx=0x7f1c8400c950).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:04.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.183+0000 7f1c8ad9d700 1 --2- 172.21.15.103:0/2815591605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c68003990 0x7f1c68003e40 secure :-1 s=THROTTLE_DONE pgs=1443 cs=0 l=1 rx=0x7f1c84001210 tx=0x7f1c8400c950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:04.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.183+0000 7f1c7b7fe700 1 -- 172.21.15.103:0/2815591605 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c8400cd90 con 0x7f1c68003990 2020-04-22T14:15:04.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.183+0000 7f1c8ad9d700 1 --2- 172.21.15.103:0/2815591605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c68003990 0x7f1c68003e40 secure :-1 s=THROTTLE_DONE pgs=1443 cs=0 l=1 rx=0x7f1c84001210 tx=0x7f1c8400c950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:04.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.183+0000 7f1c7b7fe700 1 -- 172.21.15.103:0/2815591605 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c84005940 con 0x7f1c68003990 2020-04-22T14:15:04.216 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.183+0000 7f1c8ad9d700 1 --2- 172.21.15.103:0/2815591605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c68003990 0x7f1c68003e40 secure :-1 s=THROTTLE_DONE pgs=1443 cs=0 l=1 rx=0x7f1c84001210 tx=0x7f1c8400c950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:04.216 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.183+0000 7f1c7b7fe700 1 -- 172.21.15.103:0/2815591605 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c84005ce0 con 0x7f1c68003990 2020-04-22T14:15:04.216 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.183+0000 7f1c8ad9d700 1 --2- 172.21.15.103:0/2815591605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c68003990 0x7f1c68003e40 secure :-1 s=THROTTLE_DONE pgs=1443 cs=0 l=1 rx=0x7f1c84001210 tx=0x7f1c8400c950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:04.216 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.184+0000 7f1c7b7fe700 1 -- 172.21.15.103:0/2815591605 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f1c84011800 con 0x7f1c68003990 2020-04-22T14:15:04.216 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.184+0000 7f1c8ad9d700 1 --2- 172.21.15.103:0/2815591605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c68003990 0x7f1c68003e40 secure :-1 s=THROTTLE_DONE pgs=1443 cs=0 l=1 rx=0x7f1c84001210 tx=0x7f1c8400c950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:04.216 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.184+0000 7f1c90a6a700 1 -- 172.21.15.103:0/2815591605 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c8c063a80 con 0x7f1c68003990 2020-04-22T14:15:04.217 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.184+0000 7f1c7b7fe700 1 --2- 172.21.15.103:0/2815591605 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1c68055c40 0x7f1c68058100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:04.217 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.184+0000 7f1c7b7fe700 1 -- 172.21.15.103:0/2815591605 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f1c84061170 con 0x7f1c68003990 2020-04-22T14:15:04.217 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.184+0000 7f1c8a59c700 1 --2- 172.21.15.103:0/2815591605 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1c68055c40 0x7f1c68058100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:04.217 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.184+0000 7f1c8a59c700 1 --2- 172.21.15.103:0/2815591605 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1c68055c40 0x7f1c68058100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1c7c008300 tx=0x7f1c7c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:04.217 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.185+0000 7f1c8a59c700 1 --2- 172.21.15.103:0/2815591605 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1c68055c40 0x7f1c68058100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1c7c008300 tx=0x7f1c7c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:04.217 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.185+0000 7f1c8a59c700 1 --2- 172.21.15.103:0/2815591605 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1c68055c40 0x7f1c68058100 secure :-1 s=READY pgs=523 cs=0 l=1 rx=0x7f1c7c008300 tx=0x7f1c7c007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:04.217 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.188+0000 7f1c8ad9d700 1 --2- 172.21.15.103:0/2815591605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c68003990 0x7f1c68003e40 secure :-1 s=THROTTLE_DONE pgs=1443 cs=0 l=1 rx=0x7f1c84001210 tx=0x7f1c8400c950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:04.218 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.188+0000 7f1c7b7fe700 1 -- 172.21.15.103:0/2815591605 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f1c8c063a80 con 0x7f1c68003990 2020-04-22T14:15:04.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.378+0000 7f1c90a6a700 1 -- 172.21.15.103:0/2815591605 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1c8c063a80 con 0x7f1c68003990 2020-04-22T14:15:04.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.633+0000 7f1c8ad9d700 1 --2- 172.21.15.103:0/2815591605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c68003990 0x7f1c68003e40 secure :-1 s=THROTTLE_DONE pgs=1443 cs=0 l=1 rx=0x7f1c84001210 tx=0x7f1c8400c950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:04.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.633+0000 7f1c7b7fe700 1 -- 172.21.15.103:0/2815591605 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v68) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1c8c063a80 con 0x7f1c68003990 2020-04-22T14:15:04.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.635+0000 7f1c90a6a700 1 -- 172.21.15.103:0/2815591605 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1c68055c40 msgr2=0x7f1c68058100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:04.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.635+0000 7f1c90a6a700 1 --2- 172.21.15.103:0/2815591605 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1c68055c40 0x7f1c68058100 secure :-1 s=READY pgs=523 cs=0 l=1 rx=0x7f1c7c008300 tx=0x7f1c7c007a40).stop 2020-04-22T14:15:04.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.635+0000 7f1c90a6a700 1 -- 172.21.15.103:0/2815591605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c68003990 msgr2=0x7f1c68003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:04.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.635+0000 7f1c90a6a700 1 --2- 172.21.15.103:0/2815591605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c68003990 0x7f1c68003e40 secure :-1 s=READY pgs=1443 cs=0 l=1 rx=0x7f1c84001210 tx=0x7f1c8400c950).stop 2020-04-22T14:15:04.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.635+0000 7f1c8ad9d700 1 -- 172.21.15.103:0/2815591605 reap_dead start 2020-04-22T14:15:04.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.635+0000 7f1c8ad9d700 1 -- 172.21.15.103:0/2815591605 reap_dead start 2020-04-22T14:15:04.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.635+0000 7f1c90a6a700 1 -- 172.21.15.103:0/2815591605 shutdown_connections 2020-04-22T14:15:04.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.635+0000 7f1c90a6a700 1 -- 172.21.15.103:0/2815591605 >> 172.21.15.103:0/2815591605 conn(0x7f1c8c05b7b0 msgr2=0x7f1c8c0b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:04.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.635+0000 7f1c90a6a700 1 -- 172.21.15.103:0/2815591605 shutdown_connections 2020-04-22T14:15:04.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.635+0000 7f1c90a6a700 1 -- 172.21.15.103:0/2815591605 wait complete. 2020-04-22T14:15:04.656 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:04.670 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-04-22T14:15:04.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.817+0000 7f8758d96700 1 Processor -- start 2020-04-22T14:15:04.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.817+0000 7f8758d96700 1 -- start start 2020-04-22T14:15:04.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.817+0000 7f8758d96700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f87540b9140 0x7f875412b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:04.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.817+0000 7f8758d96700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87540ac950 0x7f875412b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:04.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.817+0000 7f8758d96700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87541467e0 con 0x7f8754146c40 2020-04-22T14:15:04.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.817+0000 7f8758d96700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87540602f0 con 0x7f87540b9140 2020-04-22T14:15:04.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.817+0000 7f8758d96700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8754060050 con 0x7f87540ac950 2020-04-22T14:15:04.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.817+0000 7f875259c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f87540b9140 0x7f875412b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:04.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.817+0000 7f8752d9d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f8754146c40 0x7f8754143090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47044/0 (socket says 172.21.15.103:47044) 2020-04-22T14:15:04.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.817+0000 7f8752d9d700 1 -- 172.21.15.103:0/3391685930 learned_addr learned my addr 172.21.15.103:0/3391685930 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:04.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.818+0000 7f8751d9b700 1 --2- 172.21.15.103:0/3391685930 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87540ac950 0x7f875412b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:04.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.818+0000 7f875259c700 1 -- 172.21.15.103:0/3391685930 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87540ac950 msgr2=0x7f875412b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:04.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.818+0000 7f875259c700 1 --2- 172.21.15.103:0/3391685930 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87540ac950 0x7f875412b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:04.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.818+0000 7f875259c700 1 -- 172.21.15.103:0/3391685930 >> v1:172.21.15.103:6789/0 conn(0x7f8754146c40 legacy=0x7f8754143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:04.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.818+0000 7f875259c700 1 -- 172.21.15.103:0/3391685930 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87540b9520 con 0x7f87540b9140 2020-04-22T14:15:04.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.818+0000 7f8751d9b700 1 --2- 172.21.15.103:0/3391685930 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87540ac950 0x7f875412b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:15:04.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.818+0000 7f875259c700 1 --2- 172.21.15.103:0/3391685930 >> v2:172.21.15.103:3300/0 conn(0x7f87540b9140 0x7f875412b210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8744002f30 tx=0x7f8744007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:04.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.818+0000 7f875259c700 1 --2- 172.21.15.103:0/3391685930 >> v2:172.21.15.103:3300/0 conn(0x7f87540b9140 0x7f875412b210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8744002f30 tx=0x7f8744007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:04.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.818+0000 7f875259c700 1 --2- 172.21.15.103:0/3391685930 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87540b9140 0x7f875412b210 secure :-1 s=READY pgs=1445 cs=0 l=1 rx=0x7f8744002f30 tx=0x7f8744007a40).ready entity=mon.1 client_cookie=e277c87fc23cedca server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:04.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.818+0000 7f875259c700 1 --2- 172.21.15.103:0/3391685930 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87540b9140 0x7f875412b210 secure :-1 s=THROTTLE_DONE pgs=1445 cs=0 l=1 rx=0x7f8744002f30 tx=0x7f8744007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:04.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.818+0000 7f875259c700 1 --2- 172.21.15.103:0/3391685930 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87540b9140 0x7f875412b210 secure :-1 s=THROTTLE_DONE pgs=1445 cs=0 l=1 rx=0x7f8744002f30 tx=0x7f8744007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:04.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.818+0000 7f875159a700 1 -- 172.21.15.103:0/3391685930 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8744011470 con 0x7f87540b9140 2020-04-22T14:15:04.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.818+0000 7f875259c700 1 --2- 172.21.15.103:0/3391685930 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87540b9140 0x7f875412b210 secure :-1 s=THROTTLE_DONE pgs=1445 cs=0 l=1 rx=0x7f8744002f30 tx=0x7f8744007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:04.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.818+0000 7f875159a700 1 -- 172.21.15.103:0/3391685930 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8744011610 con 0x7f87540b9140 2020-04-22T14:15:04.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.818+0000 7f875159a700 1 -- 172.21.15.103:0/3391685930 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8744011a30 con 0x7f87540b9140 2020-04-22T14:15:04.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.818+0000 7f8758d96700 1 -- 172.21.15.103:0/3391685930 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87540b9140 msgr2=0x7f875412b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:04.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.818+0000 7f8758d96700 1 --2- 172.21.15.103:0/3391685930 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87540b9140 0x7f875412b210 secure :-1 s=READY pgs=1445 cs=0 l=1 rx=0x7f8744002f30 tx=0x7f8744007a40).stop 2020-04-22T14:15:04.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.819+0000 7f8758d96700 1 -- 172.21.15.103:0/3391685930 shutdown_connections 2020-04-22T14:15:04.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.819+0000 7f8758d96700 1 --2- 172.21.15.103:0/3391685930 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87540b9140 0x7f875412b210 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:04.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.819+0000 7f8758d96700 1 --2- 172.21.15.103:0/3391685930 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87540ac950 0x7f875412b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:04.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.819+0000 7f8758d96700 1 -- 172.21.15.103:0/3391685930 >> 172.21.15.103:0/3391685930 conn(0x7f875405b7b0 msgr2=0x7f87540b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:04.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.819+0000 7f8758d96700 1 -- 172.21.15.103:0/3391685930 shutdown_connections 2020-04-22T14:15:04.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.819+0000 7f8758d96700 1 -- 172.21.15.103:0/3391685930 wait complete. 2020-04-22T14:15:04.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.819+0000 7f8758d96700 1 Processor -- start 2020-04-22T14:15:04.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.820+0000 7f8758d96700 1 -- start start 2020-04-22T14:15:04.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.820+0000 7f8758d96700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f87540b9140 0x7f8754064a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:04.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.820+0000 7f8758d96700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87540667e0 con 0x7f87540ac950 2020-04-22T14:15:04.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.820+0000 7f8758d96700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8754112220 con 0x7f8754146c40 2020-04-22T14:15:04.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.820+0000 7f8758d96700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87541124c0 con 0x7f87540b9140 2020-04-22T14:15:04.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.820+0000 7f8752d9d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f8754146c40 0x7f8754063490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47050/0 (socket says 172.21.15.103:47050) 2020-04-22T14:15:04.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.820+0000 7f8752d9d700 1 -- 172.21.15.103:0/2885222458 learned_addr learned my addr 172.21.15.103:0/2885222458 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:04.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.820+0000 7f8751d9b700 1 --2- 172.21.15.103:0/2885222458 >> v2:172.21.15.86:3300/0 conn(0x7f87540b9140 0x7f8754064a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:04.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.820+0000 7f874b7fe700 1 -- 172.21.15.103:0/2885222458 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3981868997 0 0) 0x7f8754112220 con 0x7f8754146c40 2020-04-22T14:15:04.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.820+0000 7f874b7fe700 1 -- 172.21.15.103:0/2885222458 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8738002fe0 con 0x7f8754146c40 2020-04-22T14:15:04.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.821+0000 7f874b7fe700 1 -- 172.21.15.103:0/2885222458 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3906397183 0 0) 0x7f8738002fe0 con 0x7f8754146c40 2020-04-22T14:15:04.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.821+0000 7f874b7fe700 1 -- 172.21.15.103:0/2885222458 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8754112220 con 0x7f8754146c40 2020-04-22T14:15:04.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.821+0000 7f874b7fe700 1 -- 172.21.15.103:0/2885222458 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f874c001b50 con 0x7f8754146c40 2020-04-22T14:15:04.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.821+0000 7f874b7fe700 1 -- 172.21.15.103:0/2885222458 >> v2:172.21.15.86:3300/0 conn(0x7f87540b9140 msgr2=0x7f8754064a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:04.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.821+0000 7f874b7fe700 1 --2- 172.21.15.103:0/2885222458 >> v2:172.21.15.86:3300/0 conn(0x7f87540b9140 0x7f8754064a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:04.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.821+0000 7f874b7fe700 1 -- 172.21.15.103:0/2885222458 >> v1:172.21.15.103:6789/0 conn(0x7f8754146c40 legacy=0x7f8754063490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:04.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.821+0000 7f874b7fe700 1 -- 172.21.15.103:0/2885222458 >> v1:172.21.15.86:6789/0 conn(0x7f87540ac950 legacy=0x7f8754144fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:04.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.821+0000 7f874b7fe700 1 --2- 172.21.15.103:0/2885222458 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87380049b0 0x7f8738004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:04.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.821+0000 7f874b7fe700 1 --2- 172.21.15.103:0/2885222458 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8738003920 0x7f8738003d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:04.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.821+0000 7f874b7fe700 1 --2- 172.21.15.103:0/2885222458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87380041e0 0x7f873800b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:04.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.821+0000 7f874b7fe700 1 -- 172.21.15.103:0/2885222458 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87541124c0 con 0x7f87380049b0 2020-04-22T14:15:04.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.821+0000 7f874b7fe700 1 -- 172.21.15.103:0/2885222458 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87380047a0 con 0x7f87380041e0 2020-04-22T14:15:04.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.821+0000 7f874b7fe700 1 -- 172.21.15.103:0/2885222458 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f873800bbe0 con 0x7f8738003920 2020-04-22T14:15:04.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.821+0000 7f8751d9b700 1 --2- 172.21.15.103:0/2885222458 >> v2:172.21.15.86:3300/0 conn(0x7f87540b9140 0x7f8754064a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:15:04.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.821+0000 7f8752d9d700 1 --2- 172.21.15.103:0/2885222458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87380041e0 0x7f873800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:04.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.821+0000 7f875259c700 1 --2- 172.21.15.103:0/2885222458 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87380049b0 0x7f8738004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:04.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.821+0000 7f8751d9b700 1 --2- 172.21.15.103:0/2885222458 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8738003920 0x7f8738003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:04.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.821+0000 7f8752d9d700 1 -- 172.21.15.103:0/2885222458 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8738003920 msgr2=0x7f8738003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:04.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.821+0000 7f8752d9d700 1 --2- 172.21.15.103:0/2885222458 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8738003920 0x7f8738003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:04.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.821+0000 7f8752d9d700 1 -- 172.21.15.103:0/2885222458 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87380049b0 msgr2=0x7f8738004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:04.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.821+0000 7f8752d9d700 1 --2- 172.21.15.103:0/2885222458 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87380049b0 0x7f8738004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:04.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.821+0000 7f8752d9d700 1 -- 172.21.15.103:0/2885222458 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8754062ff0 con 0x7f87380041e0 2020-04-22T14:15:04.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.821+0000 7f8758d96700 1 -- 172.21.15.103:0/2885222458 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87541456d0 con 0x7f87380041e0 2020-04-22T14:15:04.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.821+0000 7f8752d9d700 1 --2- 172.21.15.103:0/2885222458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87380041e0 0x7f873800b750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f874c0058a0 tx=0x7f874c0116b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:04.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.821+0000 7f8758d96700 1 -- 172.21.15.103:0/2885222458 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8754151e20 con 0x7f87380041e0 2020-04-22T14:15:04.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.821+0000 7f8752d9d700 1 -- 172.21.15.103:0/2885222458 reap_dead start 2020-04-22T14:15:04.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.821+0000 7f8752d9d700 1 --2- 172.21.15.103:0/2885222458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87380041e0 0x7f873800b750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f874c0058a0 tx=0x7f874c0116b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:04.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.821+0000 7f8752d9d700 1 --2- 172.21.15.103:0/2885222458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87380041e0 0x7f873800b750 secure :-1 s=READY pgs=1447 cs=0 l=1 rx=0x7f874c0058a0 tx=0x7f874c0116b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:04.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.821+0000 7f8752d9d700 1 --2- 172.21.15.103:0/2885222458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87380041e0 0x7f873800b750 secure :-1 s=THROTTLE_DONE pgs=1447 cs=0 l=1 rx=0x7f874c0058a0 tx=0x7f874c0116b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:04.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.821+0000 7f874b7fe700 1 -- 172.21.15.103:0/2885222458 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f874c005d20 con 0x7f87380041e0 2020-04-22T14:15:04.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.821+0000 7f8752d9d700 1 --2- 172.21.15.103:0/2885222458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87380041e0 0x7f873800b750 secure :-1 s=THROTTLE_DONE pgs=1447 cs=0 l=1 rx=0x7f874c0058a0 tx=0x7f874c0116b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:04.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.821+0000 7f8752d9d700 1 --2- 172.21.15.103:0/2885222458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87380041e0 0x7f873800b750 secure :-1 s=THROTTLE_DONE pgs=1447 cs=0 l=1 rx=0x7f874c0058a0 tx=0x7f874c0116b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:04.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.821+0000 7f874b7fe700 1 -- 172.21.15.103:0/2885222458 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874c005e80 con 0x7f87380041e0 2020-04-22T14:15:04.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.821+0000 7f874b7fe700 1 -- 172.21.15.103:0/2885222458 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f874c00e370 con 0x7f87380041e0 2020-04-22T14:15:04.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.822+0000 7f8752d9d700 1 --2- 172.21.15.103:0/2885222458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87380041e0 0x7f873800b750 secure :-1 s=THROTTLE_DONE pgs=1447 cs=0 l=1 rx=0x7f874c0058a0 tx=0x7f874c0116b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:04.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.822+0000 7f8758d96700 1 -- 172.21.15.103:0/2885222458 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8754056c90 con 0x7f87380041e0 2020-04-22T14:15:04.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.822+0000 7f874b7fe700 1 -- 172.21.15.103:0/2885222458 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f874c00e4d0 con 0x7f87380041e0 2020-04-22T14:15:04.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.823+0000 7f8752d9d700 1 --2- 172.21.15.103:0/2885222458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87380041e0 0x7f873800b750 secure :-1 s=THROTTLE_DONE pgs=1447 cs=0 l=1 rx=0x7f874c0058a0 tx=0x7f874c0116b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:04.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.823+0000 7f874b7fe700 1 --2- 172.21.15.103:0/2885222458 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f87380519b0 0x7f8738053e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:04.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.823+0000 7f874b7fe700 1 -- 172.21.15.103:0/2885222458 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f874c061d30 con 0x7f87380041e0 2020-04-22T14:15:04.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.823+0000 7f875259c700 1 --2- 172.21.15.103:0/2885222458 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f87380519b0 0x7f8738053e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:04.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.823+0000 7f875259c700 1 --2- 172.21.15.103:0/2885222458 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f87380519b0 0x7f8738053e70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f87540b5530 tx=0x7f8744007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:04.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.823+0000 7f875259c700 1 --2- 172.21.15.103:0/2885222458 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f87380519b0 0x7f8738053e70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f87540b5530 tx=0x7f8744007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:04.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.823+0000 7f875259c700 1 --2- 172.21.15.103:0/2885222458 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f87380519b0 0x7f8738053e70 secure :-1 s=READY pgs=525 cs=0 l=1 rx=0x7f87540b5530 tx=0x7f8744007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:04.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.828+0000 7f8752d9d700 1 --2- 172.21.15.103:0/2885222458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87380041e0 0x7f873800b750 secure :-1 s=THROTTLE_DONE pgs=1447 cs=0 l=1 rx=0x7f874c0058a0 tx=0x7f874c0116b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:04.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.828+0000 7f874b7fe700 1 -- 172.21.15.103:0/2885222458 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f874c03d170 con 0x7f87380041e0 2020-04-22T14:15:04.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:04.968+0000 7f8758d96700 1 -- 172.21.15.103:0/2885222458 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f87540adc30 con 0x7f87380041e0 2020-04-22T14:15:05.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.678+0000 7f8752d9d700 1 --2- 172.21.15.103:0/2885222458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87380041e0 0x7f873800b750 secure :-1 s=THROTTLE_DONE pgs=1447 cs=0 l=1 rx=0x7f874c0058a0 tx=0x7f874c0116b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:05.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.678+0000 7f874b7fe700 1 -- 172.21.15.103:0/2885222458 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v93) v1 ==== 185+0+0 (secure 0 0 0) 0x7f874c040790 con 0x7f87380041e0 2020-04-22T14:15:05.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.681+0000 7f8758d96700 1 -- 172.21.15.103:0/2885222458 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f87380519b0 msgr2=0x7f8738053e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:05.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.681+0000 7f8758d96700 1 --2- 172.21.15.103:0/2885222458 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f87380519b0 0x7f8738053e70 secure :-1 s=READY pgs=525 cs=0 l=1 rx=0x7f87540b5530 tx=0x7f8744007a40).stop 2020-04-22T14:15:05.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.681+0000 7f8758d96700 1 -- 172.21.15.103:0/2885222458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87380041e0 msgr2=0x7f873800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:05.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.681+0000 7f8758d96700 1 --2- 172.21.15.103:0/2885222458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87380041e0 0x7f873800b750 secure :-1 s=READY pgs=1447 cs=0 l=1 rx=0x7f874c0058a0 tx=0x7f874c0116b0).stop 2020-04-22T14:15:05.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.681+0000 7f8758d96700 1 -- 172.21.15.103:0/2885222458 shutdown_connections 2020-04-22T14:15:05.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.681+0000 7f8758d96700 1 --2- 172.21.15.103:0/2885222458 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f87380519b0 0x7f8738053e70 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:05.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.681+0000 7f8758d96700 1 --2- 172.21.15.103:0/2885222458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87380041e0 0x7f873800b750 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:05.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.681+0000 7f8758d96700 1 -- 172.21.15.103:0/2885222458 >> 172.21.15.103:0/2885222458 conn(0x7f875405b7b0 msgr2=0x7f87540b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:05.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.681+0000 7f8758d96700 1 -- 172.21.15.103:0/2885222458 shutdown_connections 2020-04-22T14:15:05.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.681+0000 7f8758d96700 1 -- 172.21.15.103:0/2885222458 wait complete. 2020-04-22T14:15:05.694 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' removed 2020-04-22T14:15:05.696 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:05.710 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2020-04-22T14:15:05.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.863+0000 7f3781bfc700 1 Processor -- start 2020-04-22T14:15:05.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.863+0000 7f3781bfc700 1 -- start start 2020-04-22T14:15:05.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.864+0000 7f3781bfc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f377c0b9140 0x7f377c12b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:05.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.864+0000 7f3781bfc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f377c0ac950 0x7f377c12b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:05.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.864+0000 7f3781bfc700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f377c1467e0 con 0x7f377c146c40 2020-04-22T14:15:05.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.864+0000 7f3781bfc700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f377c0602f0 con 0x7f377c0b9140 2020-04-22T14:15:05.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.864+0000 7f3781bfc700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f377c060050 con 0x7f377c0ac950 2020-04-22T14:15:05.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.864+0000 7f377affd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f377c0ac950 0x7f377c12b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:05.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.864+0000 7f377bfff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f377c146c40 0x7f377c143090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47062/0 (socket says 172.21.15.103:47062) 2020-04-22T14:15:05.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.864+0000 7f377bfff700 1 -- 172.21.15.103:0/2335147389 learned_addr learned my addr 172.21.15.103:0/2335147389 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:05.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.865+0000 7f377b7fe700 1 --2- 172.21.15.103:0/2335147389 >> v2:172.21.15.86:3300/0 conn(0x7f377c0b9140 0x7f377c12b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:05.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.865+0000 7f377affd700 1 -- 172.21.15.103:0/2335147389 >> v2:172.21.15.86:3300/0 conn(0x7f377c0b9140 msgr2=0x7f377c12b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:05.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.865+0000 7f377affd700 1 --2- 172.21.15.103:0/2335147389 >> v2:172.21.15.86:3300/0 conn(0x7f377c0b9140 0x7f377c12b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:05.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.865+0000 7f377affd700 1 -- 172.21.15.103:0/2335147389 >> v1:172.21.15.103:6789/0 conn(0x7f377c146c40 legacy=0x7f377c143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:05.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.865+0000 7f377a7fc700 1 -- 172.21.15.103:0/2335147389 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2280192970 0 0) 0x7f377c1467e0 con 0x7f377c146c40 2020-04-22T14:15:05.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.865+0000 7f377affd700 1 -- 172.21.15.103:0/2335147389 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377c0b9520 con 0x7f377c0ac950 2020-04-22T14:15:05.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.865+0000 7f377affd700 1 --2- 172.21.15.103:0/2335147389 >> v2:172.21.15.103:3300/0 conn(0x7f377c0ac950 0x7f377c12b670 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3770002f30 tx=0x7f3770007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:05.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.865+0000 7f377affd700 1 --2- 172.21.15.103:0/2335147389 >> v2:172.21.15.103:3300/0 conn(0x7f377c0ac950 0x7f377c12b670 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3770002f30 tx=0x7f3770007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:05.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.865+0000 7f377affd700 1 --2- 172.21.15.103:0/2335147389 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f377c0ac950 0x7f377c12b670 secure :-1 s=READY pgs=1449 cs=0 l=1 rx=0x7f3770002f30 tx=0x7f3770007a40).ready entity=mon.1 client_cookie=e63ccc8f2a440ca3 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:05.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.865+0000 7f377affd700 1 --2- 172.21.15.103:0/2335147389 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f377c0ac950 0x7f377c12b670 secure :-1 s=THROTTLE_DONE pgs=1449 cs=0 l=1 rx=0x7f3770002f30 tx=0x7f3770007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:05.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.865+0000 7f377a7fc700 1 -- 172.21.15.103:0/2335147389 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3770011470 con 0x7f377c0ac950 2020-04-22T14:15:05.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.865+0000 7f377affd700 1 --2- 172.21.15.103:0/2335147389 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f377c0ac950 0x7f377c12b670 secure :-1 s=THROTTLE_DONE pgs=1449 cs=0 l=1 rx=0x7f3770002f30 tx=0x7f3770007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:05.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.865+0000 7f377affd700 1 --2- 172.21.15.103:0/2335147389 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f377c0ac950 0x7f377c12b670 secure :-1 s=THROTTLE_DONE pgs=1449 cs=0 l=1 rx=0x7f3770002f30 tx=0x7f3770007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:05.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.865+0000 7f377a7fc700 1 -- 172.21.15.103:0/2335147389 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37700115d0 con 0x7f377c0ac950 2020-04-22T14:15:05.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.865+0000 7f377a7fc700 1 -- 172.21.15.103:0/2335147389 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37700119b0 con 0x7f377c0ac950 2020-04-22T14:15:05.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.865+0000 7f3781bfc700 1 -- 172.21.15.103:0/2335147389 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f377c0ac950 msgr2=0x7f377c12b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:05.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.865+0000 7f3781bfc700 1 --2- 172.21.15.103:0/2335147389 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f377c0ac950 0x7f377c12b670 secure :-1 s=READY pgs=1449 cs=0 l=1 rx=0x7f3770002f30 tx=0x7f3770007a40).stop 2020-04-22T14:15:05.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.865+0000 7f3781bfc700 1 -- 172.21.15.103:0/2335147389 shutdown_connections 2020-04-22T14:15:05.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.865+0000 7f3781bfc700 1 --2- 172.21.15.103:0/2335147389 >> v2:172.21.15.86:3300/0 conn(0x7f377c0b9140 0x7f377c12b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:05.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.865+0000 7f3781bfc700 1 --2- 172.21.15.103:0/2335147389 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f377c0ac950 0x7f377c12b670 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:05.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.865+0000 7f3781bfc700 1 -- 172.21.15.103:0/2335147389 >> 172.21.15.103:0/2335147389 conn(0x7f377c05b7b0 msgr2=0x7f377c0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:05.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.866+0000 7f3781bfc700 1 -- 172.21.15.103:0/2335147389 shutdown_connections 2020-04-22T14:15:05.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.866+0000 7f3781bfc700 1 -- 172.21.15.103:0/2335147389 wait complete. 2020-04-22T14:15:05.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.866+0000 7f3781bfc700 1 Processor -- start 2020-04-22T14:15:05.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.867+0000 7f3781bfc700 1 -- start start 2020-04-22T14:15:05.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.867+0000 7f3781bfc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f377c0b9140 0x7f377c0b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:05.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.867+0000 7f3781bfc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f377c146c40 0x7f377c12a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:05.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.867+0000 7f3781bfc700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f377c12a560 con 0x7f377c0ac950 2020-04-22T14:15:05.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.867+0000 7f3781bfc700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f377c13c180 con 0x7f377c146c40 2020-04-22T14:15:05.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.867+0000 7f3781bfc700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f377c0b5610 con 0x7f377c0b9140 2020-04-22T14:15:05.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.867+0000 7f377affd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f377c0b9140 0x7f377c0b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:05.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.867+0000 7f377b7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f377c0ac950 0x7f377c13c5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47064/0 (socket says 172.21.15.103:47064) 2020-04-22T14:15:05.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.867+0000 7f377b7fe700 1 -- 172.21.15.103:0/2086107769 learned_addr learned my addr 172.21.15.103:0/2086107769 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:05.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.868+0000 7f377affd700 1 -- 172.21.15.103:0/2086107769 >> v2:172.21.15.86:3300/0 conn(0x7f377c146c40 msgr2=0x7f377c12a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:05.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.868+0000 7f377affd700 1 --2- 172.21.15.103:0/2086107769 >> v2:172.21.15.86:3300/0 conn(0x7f377c146c40 0x7f377c12a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:05.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.868+0000 7f377affd700 1 -- 172.21.15.103:0/2086107769 >> v1:172.21.15.103:6789/0 conn(0x7f377c0ac950 legacy=0x7f377c13c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:05.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.868+0000 7f377affd700 1 -- 172.21.15.103:0/2086107769 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377c0b5370 con 0x7f377c0b9140 2020-04-22T14:15:05.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.868+0000 7f3778ff9700 1 -- 172.21.15.103:0/2086107769 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 649160588 0 0) 0x7f376c0022c0 con 0x7f377c0ac950 2020-04-22T14:15:05.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.868+0000 7f377affd700 1 --2- 172.21.15.103:0/2086107769 >> v2:172.21.15.103:3300/0 conn(0x7f377c0b9140 0x7f377c0b5a90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3770002f30 tx=0x7f3770007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:05.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.868+0000 7f377affd700 1 --2- 172.21.15.103:0/2086107769 >> v2:172.21.15.103:3300/0 conn(0x7f377c0b9140 0x7f377c0b5a90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3770002f30 tx=0x7f3770007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:05.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.868+0000 7f377affd700 1 --2- 172.21.15.103:0/2086107769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f377c0b9140 0x7f377c0b5a90 secure :-1 s=READY pgs=1451 cs=0 l=1 rx=0x7f3770002f30 tx=0x7f3770007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:05.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.868+0000 7f377affd700 1 --2- 172.21.15.103:0/2086107769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f377c0b9140 0x7f377c0b5a90 secure :-1 s=THROTTLE_DONE pgs=1451 cs=0 l=1 rx=0x7f3770002f30 tx=0x7f3770007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:05.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.868+0000 7f3778ff9700 1 -- 172.21.15.103:0/2086107769 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3770007360 con 0x7f377c0b9140 2020-04-22T14:15:05.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.868+0000 7f377affd700 1 --2- 172.21.15.103:0/2086107769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f377c0b9140 0x7f377c0b5a90 secure :-1 s=THROTTLE_DONE pgs=1451 cs=0 l=1 rx=0x7f3770002f30 tx=0x7f3770007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:05.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.868+0000 7f3778ff9700 1 -- 172.21.15.103:0/2086107769 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37700074c0 con 0x7f377c0b9140 2020-04-22T14:15:05.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.868+0000 7f3781bfc700 1 -- 172.21.15.103:0/2086107769 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f377c13ccf0 con 0x7f377c0b9140 2020-04-22T14:15:05.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.868+0000 7f377affd700 1 --2- 172.21.15.103:0/2086107769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f377c0b9140 0x7f377c0b5a90 secure :-1 s=THROTTLE_DONE pgs=1451 cs=0 l=1 rx=0x7f3770002f30 tx=0x7f3770007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:05.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.868+0000 7f3778ff9700 1 -- 172.21.15.103:0/2086107769 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37700058b0 con 0x7f377c0b9140 2020-04-22T14:15:05.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.868+0000 7f3781bfc700 1 -- 172.21.15.103:0/2086107769 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f377c0b4ed0 con 0x7f377c0b9140 2020-04-22T14:15:05.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.868+0000 7f377affd700 1 --2- 172.21.15.103:0/2086107769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f377c0b9140 0x7f377c0b5a90 secure :-1 s=THROTTLE_DONE pgs=1451 cs=0 l=1 rx=0x7f3770002f30 tx=0x7f3770007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:05.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.869+0000 7f3781bfc700 1 -- 172.21.15.103:0/2086107769 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f377c0b51e0 con 0x7f377c0b9140 2020-04-22T14:15:05.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.869+0000 7f3778ff9700 1 -- 172.21.15.103:0/2086107769 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f3770005ab0 con 0x7f377c0b9140 2020-04-22T14:15:05.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.869+0000 7f377affd700 1 --2- 172.21.15.103:0/2086107769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f377c0b9140 0x7f377c0b5a90 secure :-1 s=THROTTLE_DONE pgs=1451 cs=0 l=1 rx=0x7f3770002f30 tx=0x7f3770007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:05.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.869+0000 7f3778ff9700 1 --2- 172.21.15.103:0/2086107769 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f375c04d870 0x7f375c04fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:05.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.869+0000 7f3778ff9700 1 -- 172.21.15.103:0/2086107769 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5764+0+0 (secure 0 0 0) 0x7f3770061ba0 con 0x7f377c0b9140 2020-04-22T14:15:05.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.869+0000 7f377b7fe700 1 --2- 172.21.15.103:0/2086107769 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f375c04d870 0x7f375c04fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:05.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.870+0000 7f377b7fe700 1 --2- 172.21.15.103:0/2086107769 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f375c04d870 0x7f375c04fd30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f376c007dc0 tx=0x7f376c002870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:05.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.870+0000 7f377b7fe700 1 --2- 172.21.15.103:0/2086107769 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f375c04d870 0x7f375c04fd30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f376c007dc0 tx=0x7f376c002870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:05.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.870+0000 7f377b7fe700 1 --2- 172.21.15.103:0/2086107769 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f375c04d870 0x7f375c04fd30 secure :-1 s=READY pgs=526 cs=0 l=1 rx=0x7f376c007dc0 tx=0x7f376c002870).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:05.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.873+0000 7f377affd700 1 --2- 172.21.15.103:0/2086107769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f377c0b9140 0x7f377c0b5a90 secure :-1 s=THROTTLE_DONE pgs=1451 cs=0 l=1 rx=0x7f3770002f30 tx=0x7f3770007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:05.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:05.873+0000 7f3778ff9700 1 -- 172.21.15.103:0/2086107769 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f377003cfe0 con 0x7f377c0b9140 2020-04-22T14:15:06.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.012+0000 7f3781bfc700 1 -- 172.21.15.103:0/2086107769 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f377c13c2c0 con 0x7f377c0b9140 2020-04-22T14:15:06.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.682+0000 7f377affd700 1 --2- 172.21.15.103:0/2086107769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f377c0b9140 0x7f377c0b5a90 secure :-1 s=THROTTLE_DONE pgs=1451 cs=0 l=1 rx=0x7f3770002f30 tx=0x7f3770007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:06.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.682+0000 7f3778ff9700 1 -- 172.21.15.103:0/2086107769 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v94) v1 ==== 173+0+0 (secure 0 0 0) 0x7f3770040600 con 0x7f377c0b9140 2020-04-22T14:15:06.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.684+0000 7f3781bfc700 1 -- 172.21.15.103:0/2086107769 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f375c04d870 msgr2=0x7f375c04fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:06.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.684+0000 7f3781bfc700 1 --2- 172.21.15.103:0/2086107769 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f375c04d870 0x7f375c04fd30 secure :-1 s=READY pgs=526 cs=0 l=1 rx=0x7f376c007dc0 tx=0x7f376c002870).stop 2020-04-22T14:15:06.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.684+0000 7f3781bfc700 1 -- 172.21.15.103:0/2086107769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f377c0b9140 msgr2=0x7f377c0b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:06.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.684+0000 7f3781bfc700 1 --2- 172.21.15.103:0/2086107769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f377c0b9140 0x7f377c0b5a90 secure :-1 s=READY pgs=1451 cs=0 l=1 rx=0x7f3770002f30 tx=0x7f3770007a40).stop 2020-04-22T14:15:06.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.684+0000 7f3781bfc700 1 -- 172.21.15.103:0/2086107769 shutdown_connections 2020-04-22T14:15:06.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.684+0000 7f3781bfc700 1 --2- 172.21.15.103:0/2086107769 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f375c04d870 0x7f375c04fd30 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:06.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.684+0000 7f3781bfc700 1 --2- 172.21.15.103:0/2086107769 >> v2:172.21.15.86:3300/0 conn(0x7f377c146c40 0x7f377c12a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:06.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.684+0000 7f3781bfc700 1 --2- 172.21.15.103:0/2086107769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f377c0b9140 0x7f377c0b5a90 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:06.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.684+0000 7f3781bfc700 1 -- 172.21.15.103:0/2086107769 >> 172.21.15.103:0/2086107769 conn(0x7f377c05b7b0 msgr2=0x7f377c0b7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:06.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.685+0000 7f3781bfc700 1 -- 172.21.15.103:0/2086107769 shutdown_connections 2020-04-22T14:15:06.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.685+0000 7f3781bfc700 1 -- 172.21.15.103:0/2086107769 wait complete. 2020-04-22T14:15:06.688 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' removed 2020-04-22T14:15:06.699 INFO:tasks.ceph.mds.a:Restarting daemon 2020-04-22T14:15:06.699 INFO:tasks.ceph.mds.a:Stopping old one... 2020-04-22T14:15:06.699 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-04-22T14:15:06.699 INFO:teuthology.orchestra.run:waiting for 300 2020-04-22T14:15:06.700 INFO:tasks.ceph.mds.b:Restarting daemon 2020-04-22T14:15:06.700 INFO:tasks.ceph.mds.b:Stopping old one... 2020-04-22T14:15:06.700 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-04-22T14:15:06.700 INFO:teuthology.orchestra.run:waiting for 300 2020-04-22T14:15:06.707 INFO:tasks.ceph.mds.a:Stopped 2020-04-22T14:15:06.708 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:06.709 INFO:tasks.ceph.mds.b:Stopped 2020-04-22T14:15:06.709 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:15:06.763 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-04-22T14:15:06.764 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-04-22T14:15:06.806 INFO:tasks.ceph.mds.a:Started 2020-04-22T14:15:06.806 DEBUG:teuthology.parallel:result is None 2020-04-22T14:15:06.807 INFO:tasks.ceph.mds.b:Started 2020-04-22T14:15:06.807 DEBUG:teuthology.parallel:result is None 2020-04-22T14:15:06.807 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:06.821 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2020-04-22T14:15:06.890 INFO:tasks.ceph.mds.b.smithi086.stdout:starting mds.b at 2020-04-22T14:15:06.890 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2020-04-22T14:15:06.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.969+0000 7fc9d9c8e700 1 Processor -- start 2020-04-22T14:15:06.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.969+0000 7fc9d9c8e700 1 -- start start 2020-04-22T14:15:07.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.970+0000 7fc9d9c8e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc9d40ade00 0x7fc9d40ae680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:07.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.970+0000 7fc9d9c8e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc9d40aeae0 0x7fc9d4143f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:07.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.970+0000 7fc9d9c8e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d4066c50 con 0x7fc9d40b5280 2020-04-22T14:15:07.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.970+0000 7fc9d9c8e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d4066e80 con 0x7fc9d40ade00 2020-04-22T14:15:07.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.970+0000 7fc9d9c8e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d4067120 con 0x7fc9d40aeae0 2020-04-22T14:15:07.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.970+0000 7fc9d948d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc9d40aeae0 0x7fc9d4143f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:07.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.970+0000 7fc9d948d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc9d40aeae0 0x7fc9d4143f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54898/0 (socket says 172.21.15.103:54898) 2020-04-22T14:15:07.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.970+0000 7fc9d948d700 1 -- 172.21.15.103:0/1866034580 learned_addr learned my addr 172.21.15.103:0/1866034580 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:15:07.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.970+0000 7fc9d3fff700 1 --2- 172.21.15.103:0/1866034580 >> v2:172.21.15.86:3300/0 conn(0x7fc9d40ade00 0x7fc9d40ae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:07.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.970+0000 7fc9d948d700 1 -- 172.21.15.103:0/1866034580 >> v2:172.21.15.86:3300/0 conn(0x7fc9d40ade00 msgr2=0x7fc9d40ae680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:07.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.970+0000 7fc9d948d700 1 --2- 172.21.15.103:0/1866034580 >> v2:172.21.15.86:3300/0 conn(0x7fc9d40ade00 0x7fc9d40ae680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:07.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.970+0000 7fc9d948d700 1 -- 172.21.15.103:0/1866034580 >> v1:172.21.15.86:6789/0 conn(0x7fc9d40b5280 legacy=0x7fc9d414e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:07.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.970+0000 7fc9d948d700 1 -- 172.21.15.103:0/1866034580 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d40673c0 con 0x7fc9d40aeae0 2020-04-22T14:15:07.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.970+0000 7fc9d3fff700 1 --2- 172.21.15.103:0/1866034580 >> v2:172.21.15.86:3300/0 conn(0x7fc9d40ade00 0x7fc9d40ae680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:15:07.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.970+0000 7fc9d948d700 1 --2- 172.21.15.103:0/1866034580 >> v2:172.21.15.103:3300/0 conn(0x7fc9d40aeae0 0x7fc9d4143f80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc9cc0032b0 tx=0x7fc9cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:07.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.970+0000 7fc9d948d700 1 --2- 172.21.15.103:0/1866034580 >> v2:172.21.15.103:3300/0 conn(0x7fc9d40aeae0 0x7fc9d4143f80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc9cc0032b0 tx=0x7fc9cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:07.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.970+0000 7fc9d948d700 1 --2- 172.21.15.103:0/1866034580 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9d40aeae0 0x7fc9d4143f80 secure :-1 s=READY pgs=1455 cs=0 l=1 rx=0x7fc9cc0032b0 tx=0x7fc9cc007dc0).ready entity=mon.1 client_cookie=2cb6f05189dbdd39 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:07.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.970+0000 7fc9d948d700 1 --2- 172.21.15.103:0/1866034580 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9d40aeae0 0x7fc9d4143f80 secure :-1 s=THROTTLE_DONE pgs=1455 cs=0 l=1 rx=0x7fc9cc0032b0 tx=0x7fc9cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:07.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.970+0000 7fc9d948d700 1 --2- 172.21.15.103:0/1866034580 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9d40aeae0 0x7fc9d4143f80 secure :-1 s=THROTTLE_DONE pgs=1455 cs=0 l=1 rx=0x7fc9cc0032b0 tx=0x7fc9cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:07.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.970+0000 7fc9d37fe700 1 -- 172.21.15.103:0/1866034580 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9cc00a180 con 0x7fc9d40aeae0 2020-04-22T14:15:07.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.970+0000 7fc9d948d700 1 --2- 172.21.15.103:0/1866034580 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9d40aeae0 0x7fc9d4143f80 secure :-1 s=THROTTLE_DONE pgs=1455 cs=0 l=1 rx=0x7fc9cc0032b0 tx=0x7fc9cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:07.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.970+0000 7fc9d37fe700 1 -- 172.21.15.103:0/1866034580 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9cc00a2e0 con 0x7fc9d40aeae0 2020-04-22T14:15:07.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.970+0000 7fc9d37fe700 1 -- 172.21.15.103:0/1866034580 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9cc00a700 con 0x7fc9d40aeae0 2020-04-22T14:15:07.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.970+0000 7fc9d9c8e700 1 -- 172.21.15.103:0/1866034580 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9d40aeae0 msgr2=0x7fc9d4143f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:07.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.970+0000 7fc9d9c8e700 1 --2- 172.21.15.103:0/1866034580 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9d40aeae0 0x7fc9d4143f80 secure :-1 s=READY pgs=1455 cs=0 l=1 rx=0x7fc9cc0032b0 tx=0x7fc9cc007dc0).stop 2020-04-22T14:15:07.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.971+0000 7fc9d9c8e700 1 -- 172.21.15.103:0/1866034580 shutdown_connections 2020-04-22T14:15:07.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.971+0000 7fc9d9c8e700 1 --2- 172.21.15.103:0/1866034580 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9d40aeae0 0x7fc9d4143f80 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:07.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.971+0000 7fc9d9c8e700 1 --2- 172.21.15.103:0/1866034580 >> v2:172.21.15.86:3300/0 conn(0x7fc9d40ade00 0x7fc9d40ae680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:07.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.971+0000 7fc9d9c8e700 1 -- 172.21.15.103:0/1866034580 >> 172.21.15.103:0/1866034580 conn(0x7fc9d405ad30 msgr2=0x7fc9d405b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:07.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.971+0000 7fc9d9c8e700 1 -- 172.21.15.103:0/1866034580 shutdown_connections 2020-04-22T14:15:07.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.971+0000 7fc9d9c8e700 1 -- 172.21.15.103:0/1866034580 wait complete. 2020-04-22T14:15:07.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.972+0000 7fc9d9c8e700 1 Processor -- start 2020-04-22T14:15:07.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.972+0000 7fc9d9c8e700 1 -- start start 2020-04-22T14:15:07.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.973+0000 7fc9d9c8e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc9d40aeae0 0x7fc9d4149be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:07.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.973+0000 7fc9d9c8e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9d40b5280 0x7fc9d40b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:07.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.973+0000 7fc9d9c8e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d414a040 con 0x7fc9d40ade00 2020-04-22T14:15:07.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.973+0000 7fc9d9c8e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d4145150 con 0x7fc9d40aeae0 2020-04-22T14:15:07.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.973+0000 7fc9d9c8e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d414bfd0 con 0x7fc9d40b5280 2020-04-22T14:15:07.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.973+0000 7fc9d8c8c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc9d40ade00 0x7fc9d4157de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47090/0 (socket says 172.21.15.103:47090) 2020-04-22T14:15:07.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.973+0000 7fc9d8c8c700 1 -- 172.21.15.103:0/1056390772 learned_addr learned my addr 172.21.15.103:0/1056390772 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:07.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.973+0000 7fc9d3fff700 1 --2- 172.21.15.103:0/1056390772 >> v2:172.21.15.86:3300/0 conn(0x7fc9d40aeae0 0x7fc9d4149be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:07.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.973+0000 7fc9d948d700 1 --2- 172.21.15.103:0/1056390772 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9d40b5280 0x7fc9d40b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:07.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.973+0000 7fc9d1ffb700 1 -- 172.21.15.103:0/1056390772 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1892696797 0 0) 0x7fc9d4066c50 con 0x7fc9d40ade00 2020-04-22T14:15:07.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.973+0000 7fc9d1ffb700 1 -- 172.21.15.103:0/1056390772 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9bc002fe0 con 0x7fc9d40ade00 2020-04-22T14:15:07.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.973+0000 7fc9d1ffb700 1 -- 172.21.15.103:0/1056390772 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3291045632 0 0) 0x7fc9bc002fe0 con 0x7fc9d40ade00 2020-04-22T14:15:07.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.973+0000 7fc9d1ffb700 1 -- 172.21.15.103:0/1056390772 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc9d4066c50 con 0x7fc9d40ade00 2020-04-22T14:15:07.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.973+0000 7fc9d1ffb700 1 -- 172.21.15.103:0/1056390772 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fc9c8001930 con 0x7fc9d40ade00 2020-04-22T14:15:07.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.973+0000 7fc9d1ffb700 1 -- 172.21.15.103:0/1056390772 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9d40b5280 msgr2=0x7fc9d40b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:07.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.973+0000 7fc9d1ffb700 1 --2- 172.21.15.103:0/1056390772 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9d40b5280 0x7fc9d40b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:07.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.973+0000 7fc9d1ffb700 1 -- 172.21.15.103:0/1056390772 >> v2:172.21.15.86:3300/0 conn(0x7fc9d40aeae0 msgr2=0x7fc9d4149be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:07.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.973+0000 7fc9d1ffb700 1 --2- 172.21.15.103:0/1056390772 >> v2:172.21.15.86:3300/0 conn(0x7fc9d40aeae0 0x7fc9d4149be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:07.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.973+0000 7fc9d1ffb700 1 -- 172.21.15.103:0/1056390772 >> v1:172.21.15.103:6789/0 conn(0x7fc9d40ade00 legacy=0x7fc9d4157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:07.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.973+0000 7fc9d1ffb700 1 --2- 172.21.15.103:0/1056390772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9bc0049b0 0x7fc9bc004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:07.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.973+0000 7fc9d1ffb700 1 --2- 172.21.15.103:0/1056390772 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9bc003920 0x7fc9bc003d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:07.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.973+0000 7fc9d1ffb700 1 --2- 172.21.15.103:0/1056390772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9bc0041c0 0x7fc9bc00b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:07.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.973+0000 7fc9d1ffb700 1 -- 172.21.15.103:0/1056390772 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc004700 con 0x7fc9bc0049b0 2020-04-22T14:15:07.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.973+0000 7fc9d1ffb700 1 -- 172.21.15.103:0/1056390772 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc00bbb0 con 0x7fc9bc0041c0 2020-04-22T14:15:07.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.973+0000 7fc9d1ffb700 1 -- 172.21.15.103:0/1056390772 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc00bcf0 con 0x7fc9bc003920 2020-04-22T14:15:07.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.973+0000 7fc9d3fff700 1 --2- 172.21.15.103:0/1056390772 >> v2:172.21.15.86:3300/0 conn(0x7fc9d40aeae0 0x7fc9d4149be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:15:07.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.973+0000 7fc9d948d700 1 --2- 172.21.15.103:0/1056390772 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9d40b5280 0x7fc9d40b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:15:07.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.973+0000 7fc9d8c8c700 1 --2- 172.21.15.103:0/1056390772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9bc0049b0 0x7fc9bc004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:07.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.973+0000 7fc9d948d700 1 --2- 172.21.15.103:0/1056390772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9bc0041c0 0x7fc9bc00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:07.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.973+0000 7fc9d3fff700 1 --2- 172.21.15.103:0/1056390772 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9bc003920 0x7fc9bc003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:07.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.974+0000 7fc9d8c8c700 1 -- 172.21.15.103:0/1056390772 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9bc003920 msgr2=0x7fc9bc003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:07.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.974+0000 7fc9d8c8c700 1 --2- 172.21.15.103:0/1056390772 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9bc003920 0x7fc9bc003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:07.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.974+0000 7fc9d8c8c700 1 -- 172.21.15.103:0/1056390772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9bc0041c0 msgr2=0x7fc9bc00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:07.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.974+0000 7fc9d8c8c700 1 --2- 172.21.15.103:0/1056390772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9bc0041c0 0x7fc9bc00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:07.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.974+0000 7fc9d8c8c700 1 -- 172.21.15.103:0/1056390772 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d41586f0 con 0x7fc9bc0049b0 2020-04-22T14:15:07.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.974+0000 7fc9d9c8e700 1 -- 172.21.15.103:0/1056390772 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d4158990 con 0x7fc9bc0049b0 2020-04-22T14:15:07.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.974+0000 7fc9d8c8c700 1 --2- 172.21.15.103:0/1056390772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9bc0049b0 0x7fc9bc004dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc9bc005650 tx=0x7fc9c8011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:07.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.974+0000 7fc9d948d700 1 --2- 172.21.15.103:0/1056390772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9bc0041c0 0x7fc9bc00b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:15:07.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.974+0000 7fc9d9c8e700 1 -- 172.21.15.103:0/1056390772 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d40b1af0 con 0x7fc9bc0049b0 2020-04-22T14:15:07.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.974+0000 7fc9d8c8c700 1 --2- 172.21.15.103:0/1056390772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9bc0049b0 0x7fc9bc004dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc9bc005650 tx=0x7fc9c8011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:07.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.974+0000 7fc9d8c8c700 1 --2- 172.21.15.103:0/1056390772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9bc0049b0 0x7fc9bc004dd0 secure :-1 s=READY pgs=771 cs=0 l=1 rx=0x7fc9bc005650 tx=0x7fc9c8011450).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:07.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.974+0000 7fc9d8c8c700 1 --2- 172.21.15.103:0/1056390772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9bc0049b0 0x7fc9bc004dd0 secure :-1 s=THROTTLE_DONE pgs=771 cs=0 l=1 rx=0x7fc9bc005650 tx=0x7fc9c8011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:07.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.974+0000 7fc9d1ffb700 1 -- 172.21.15.103:0/1056390772 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9c8012bf0 con 0x7fc9bc0049b0 2020-04-22T14:15:07.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.974+0000 7fc9d8c8c700 1 --2- 172.21.15.103:0/1056390772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9bc0049b0 0x7fc9bc004dd0 secure :-1 s=THROTTLE_DONE pgs=771 cs=0 l=1 rx=0x7fc9bc005650 tx=0x7fc9c8011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:07.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.974+0000 7fc9d1ffb700 1 -- 172.21.15.103:0/1056390772 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c8012d50 con 0x7fc9bc0049b0 2020-04-22T14:15:07.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.974+0000 7fc9d8c8c700 1 --2- 172.21.15.103:0/1056390772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9bc0049b0 0x7fc9bc004dd0 secure :-1 s=THROTTLE_DONE pgs=771 cs=0 l=1 rx=0x7fc9bc005650 tx=0x7fc9c8011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:07.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.974+0000 7fc9d1ffb700 1 -- 172.21.15.103:0/1056390772 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9c8010370 con 0x7fc9bc0049b0 2020-04-22T14:15:07.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.975+0000 7fc9d8c8c700 1 --2- 172.21.15.103:0/1056390772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9bc0049b0 0x7fc9bc004dd0 secure :-1 s=THROTTLE_DONE pgs=771 cs=0 l=1 rx=0x7fc9bc005650 tx=0x7fc9c8011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:07.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.975+0000 7fc9d9c8e700 1 -- 172.21.15.103:0/1056390772 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9b0003340 con 0x7fc9bc0049b0 2020-04-22T14:15:07.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.975+0000 7fc9d1ffb700 1 -- 172.21.15.103:0/1056390772 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fc9c80104d0 con 0x7fc9bc0049b0 2020-04-22T14:15:07.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.975+0000 7fc9d8c8c700 1 --2- 172.21.15.103:0/1056390772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9bc0049b0 0x7fc9bc004dd0 secure :-1 s=THROTTLE_DONE pgs=771 cs=0 l=1 rx=0x7fc9bc005650 tx=0x7fc9c8011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:07.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.975+0000 7fc9d1ffb700 1 --2- 172.21.15.103:0/1056390772 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc9bc056470 0x7fc9bc058930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:07.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.975+0000 7fc9d1ffb700 1 -- 172.21.15.103:0/1056390772 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fc9c80616c0 con 0x7fc9bc0049b0 2020-04-22T14:15:07.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.975+0000 7fc9d3fff700 1 --2- 172.21.15.103:0/1056390772 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc9bc056470 0x7fc9bc058930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:07.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.976+0000 7fc9d3fff700 1 --2- 172.21.15.103:0/1056390772 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc9bc056470 0x7fc9bc058930 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc9c0002f30 tx=0x7fc9c000bd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:07.015 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.976+0000 7fc9d3fff700 1 --2- 172.21.15.103:0/1056390772 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc9bc056470 0x7fc9bc058930 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc9c0002f30 tx=0x7fc9c000bd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:07.015 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.976+0000 7fc9d3fff700 1 --2- 172.21.15.103:0/1056390772 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc9bc056470 0x7fc9bc058930 secure :-1 s=READY pgs=527 cs=0 l=1 rx=0x7fc9c0002f30 tx=0x7fc9c000bd20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:07.015 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.979+0000 7fc9d8c8c700 1 --2- 172.21.15.103:0/1056390772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9bc0049b0 0x7fc9bc004dd0 secure :-1 s=THROTTLE_DONE pgs=771 cs=0 l=1 rx=0x7fc9bc005650 tx=0x7fc9c8011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:07.015 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:06.979+0000 7fc9d1ffb700 1 -- 172.21.15.103:0/1056390772 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fc9c803cb00 con 0x7fc9bc0049b0 2020-04-22T14:15:07.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:07.138+0000 7fc9d9c8e700 1 -- 172.21.15.103:0/1056390772 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fc9b00036e0 con 0x7fc9bc0049b0 2020-04-22T14:15:07.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:07.898+0000 7fc9d8c8c700 1 --2- 172.21.15.103:0/1056390772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9bc0049b0 0x7fc9bc004dd0 secure :-1 s=THROTTLE_DONE pgs=771 cs=0 l=1 rx=0x7fc9bc005650 tx=0x7fc9c8011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:07.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:07.898+0000 7fc9d1ffb700 1 -- 172.21.15.103:0/1056390772 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v96) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc9c8040120 con 0x7fc9bc0049b0 2020-04-22T14:15:07.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:07.900+0000 7fc9d9c8e700 1 -- 172.21.15.103:0/1056390772 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc9bc056470 msgr2=0x7fc9bc058930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:07.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:07.900+0000 7fc9d9c8e700 1 --2- 172.21.15.103:0/1056390772 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc9bc056470 0x7fc9bc058930 secure :-1 s=READY pgs=527 cs=0 l=1 rx=0x7fc9c0002f30 tx=0x7fc9c000bd20).stop 2020-04-22T14:15:07.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:07.900+0000 7fc9d9c8e700 1 -- 172.21.15.103:0/1056390772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9bc0049b0 msgr2=0x7fc9bc004dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:07.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:07.900+0000 7fc9d9c8e700 1 --2- 172.21.15.103:0/1056390772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9bc0049b0 0x7fc9bc004dd0 secure :-1 s=READY pgs=771 cs=0 l=1 rx=0x7fc9bc005650 tx=0x7fc9c8011450).stop 2020-04-22T14:15:07.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:07.900+0000 7fc9d948d700 1 -- 172.21.15.103:0/1056390772 reap_dead start 2020-04-22T14:15:07.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:07.900+0000 7fc9d948d700 1 -- 172.21.15.103:0/1056390772 reap_dead start 2020-04-22T14:15:07.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:07.900+0000 7fc9d9c8e700 1 -- 172.21.15.103:0/1056390772 shutdown_connections 2020-04-22T14:15:07.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:07.900+0000 7fc9d9c8e700 1 -- 172.21.15.103:0/1056390772 >> 172.21.15.103:0/1056390772 conn(0x7fc9d405ad30 msgr2=0x7fc9d40aeec0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:07.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:07.900+0000 7fc9d9c8e700 1 -- 172.21.15.103:0/1056390772 shutdown_connections 2020-04-22T14:15:07.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:07.900+0000 7fc9d9c8e700 1 -- 172.21.15.103:0/1056390772 wait complete. 2020-04-22T14:15:07.904 INFO:teuthology.orchestra.run.smithi103.stderr: removed all blacklist entries 2020-04-22T14:15:07.915 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2020-04-22T14:15:07.915 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:07.971 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2020-04-22T14:15:08.133 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.120+0000 7f58df2da700 1 Processor -- start 2020-04-22T14:15:08.134 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.120+0000 7f58df2da700 1 -- start start 2020-04-22T14:15:08.134 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.121+0000 7f58df2da700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f58d8065fe0 0x7f58d81464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:08.134 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.121+0000 7f58df2da700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58d8063e30 0x7f58d80642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:08.134 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.121+0000 7f58df2da700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d8143300 con 0x7f58d812c0d0 2020-04-22T14:15:08.134 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.121+0000 7f58df2da700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58d81435a0 con 0x7f58d8065fe0 2020-04-22T14:15:08.134 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.121+0000 7f58df2da700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d8143840 con 0x7f58d8063e30 2020-04-22T14:15:08.134 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.121+0000 7f58dc875700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f58d8065fe0 0x7f58d81464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:08.135 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.121+0000 7f58dc875700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f58d8065fe0 0x7f58d81464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54918/0 (socket says 172.21.15.103:54918) 2020-04-22T14:15:08.135 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.121+0000 7f58dc875700 1 -- 172.21.15.103:0/2490307597 learned_addr learned my addr 172.21.15.103:0/2490307597 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:15:08.135 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.121+0000 7f58dd877700 1 --2- 172.21.15.103:0/2490307597 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58d8063e30 0x7f58d80642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:08.135 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.121+0000 7f58dc875700 1 -- 172.21.15.103:0/2490307597 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58d8063e30 msgr2=0x7f58d80642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:08.135 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.121+0000 7f58dc875700 1 --2- 172.21.15.103:0/2490307597 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58d8063e30 0x7f58d80642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:08.135 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.121+0000 7f58dc875700 1 -- 172.21.15.103:0/2490307597 >> v1:172.21.15.86:6789/0 conn(0x7f58d812c0d0 legacy=0x7f58d805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:08.135 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.121+0000 7f58dc875700 1 -- 172.21.15.103:0/2490307597 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d805bb50 con 0x7f58d8065fe0 2020-04-22T14:15:08.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.121+0000 7f58dc875700 1 --2- 172.21.15.103:0/2490307597 >> v2:172.21.15.103:3300/0 conn(0x7f58d8065fe0 0x7f58d81464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f58c8002f30 tx=0x7f58c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.121+0000 7f58dc875700 1 --2- 172.21.15.103:0/2490307597 >> v2:172.21.15.103:3300/0 conn(0x7f58d8065fe0 0x7f58d81464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f58c8002f30 tx=0x7f58c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.121+0000 7f58dc875700 1 --2- 172.21.15.103:0/2490307597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58d8065fe0 0x7f58d81464e0 secure :-1 s=READY pgs=1457 cs=0 l=1 rx=0x7f58c8002f30 tx=0x7f58c8007a40).ready entity=mon.1 client_cookie=addb56dcfedcf268 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:08.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.121+0000 7f58dc875700 1 --2- 172.21.15.103:0/2490307597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58d8065fe0 0x7f58d81464e0 secure :-1 s=THROTTLE_DONE pgs=1457 cs=0 l=1 rx=0x7f58c8002f30 tx=0x7f58c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.121+0000 7f58c7fff700 1 -- 172.21.15.103:0/2490307597 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58c8011720 con 0x7f58d8065fe0 2020-04-22T14:15:08.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.121+0000 7f58dc875700 1 --2- 172.21.15.103:0/2490307597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58d8065fe0 0x7f58d81464e0 secure :-1 s=THROTTLE_DONE pgs=1457 cs=0 l=1 rx=0x7f58c8002f30 tx=0x7f58c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.122+0000 7f58c7fff700 1 -- 172.21.15.103:0/2490307597 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c80118c0 con 0x7f58d8065fe0 2020-04-22T14:15:08.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.122+0000 7f58dc875700 1 --2- 172.21.15.103:0/2490307597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58d8065fe0 0x7f58d81464e0 secure :-1 s=THROTTLE_DONE pgs=1457 cs=0 l=1 rx=0x7f58c8002f30 tx=0x7f58c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.122+0000 7f58c7fff700 1 -- 172.21.15.103:0/2490307597 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58c8011ce0 con 0x7f58d8065fe0 2020-04-22T14:15:08.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.122+0000 7f58df2da700 1 -- 172.21.15.103:0/2490307597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58d8065fe0 msgr2=0x7f58d81464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:08.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.122+0000 7f58df2da700 1 --2- 172.21.15.103:0/2490307597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58d8065fe0 0x7f58d81464e0 secure :-1 s=READY pgs=1457 cs=0 l=1 rx=0x7f58c8002f30 tx=0x7f58c8007a40).stop 2020-04-22T14:15:08.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.122+0000 7f58df2da700 1 -- 172.21.15.103:0/2490307597 shutdown_connections 2020-04-22T14:15:08.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.122+0000 7f58df2da700 1 --2- 172.21.15.103:0/2490307597 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58d8063e30 0x7f58d80642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:08.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.122+0000 7f58df2da700 1 --2- 172.21.15.103:0/2490307597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58d8065fe0 0x7f58d81464e0 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:08.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.122+0000 7f58df2da700 1 -- 172.21.15.103:0/2490307597 >> 172.21.15.103:0/2490307597 conn(0x7f58d80b9160 msgr2=0x7f58d805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:08.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.122+0000 7f58df2da700 1 -- 172.21.15.103:0/2490307597 shutdown_connections 2020-04-22T14:15:08.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.122+0000 7f58df2da700 1 -- 172.21.15.103:0/2490307597 wait complete. 2020-04-22T14:15:08.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.123+0000 7f58df2da700 1 Processor -- start 2020-04-22T14:15:08.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.123+0000 7f58df2da700 1 -- start start 2020-04-22T14:15:08.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.124+0000 7f58df2da700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f58d8065fe0 0x7f58d8141dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:08.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.124+0000 7f58df2da700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58d812c0d0 0x7f58d812a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:08.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.124+0000 7f58df2da700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d81422f0 con 0x7f58d8063e30 2020-04-22T14:15:08.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.124+0000 7f58df2da700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58d8125c10 con 0x7f58d8065fe0 2020-04-22T14:15:08.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.124+0000 7f58df2da700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d8125970 con 0x7f58d812c0d0 2020-04-22T14:15:08.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.124+0000 7f58dc875700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f58d8065fe0 0x7f58d8141dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:08.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.124+0000 7f58dd877700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58d812c0d0 0x7f58d812a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:08.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.124+0000 7f58dd076700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f58d8063e30 0x7f58d8126ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:36036/0 (socket says 172.21.15.103:36036) 2020-04-22T14:15:08.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.124+0000 7f58dc875700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f58d8065fe0 0x7f58d8141dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:52156/0 (socket says 172.21.15.103:52156) 2020-04-22T14:15:08.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.124+0000 7f58dd076700 1 -- 172.21.15.103:0/1898945529 learned_addr learned my addr 172.21.15.103:0/1898945529 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:08.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.124+0000 7f58dd877700 1 -- 172.21.15.103:0/1898945529 >> v2:172.21.15.86:3300/0 conn(0x7f58d8065fe0 msgr2=0x7f58d8141dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:08.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.124+0000 7f58dd877700 1 --2- 172.21.15.103:0/1898945529 >> v2:172.21.15.86:3300/0 conn(0x7f58d8065fe0 0x7f58d8141dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:08.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.124+0000 7f58dd877700 1 -- 172.21.15.103:0/1898945529 >> v1:172.21.15.86:6789/0 conn(0x7f58d8063e30 legacy=0x7f58d8126ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:08.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.124+0000 7f58dd877700 1 -- 172.21.15.103:0/1898945529 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d8142660 con 0x7f58d812c0d0 2020-04-22T14:15:08.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.124+0000 7f58dc875700 1 --2- 172.21.15.103:0/1898945529 >> v2:172.21.15.86:3300/0 conn(0x7f58d8065fe0 0x7f58d8141dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:15:08.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.124+0000 7f58dd877700 1 --2- 172.21.15.103:0/1898945529 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58d812c0d0 0x7f58d812a060 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f58d4002f30 tx=0x7f58d4010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.124+0000 7f58dd877700 1 --2- 172.21.15.103:0/1898945529 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58d812c0d0 0x7f58d812a060 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f58d4002f30 tx=0x7f58d4010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.124+0000 7f58dd877700 1 --2- 172.21.15.103:0/1898945529 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58d812c0d0 0x7f58d812a060 secure :-1 s=READY pgs=136 cs=0 l=1 rx=0x7f58d4002f30 tx=0x7f58d4010ac0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:08.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.125+0000 7f58dd877700 1 --2- 172.21.15.103:0/1898945529 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58d812c0d0 0x7f58d812a060 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f58d4002f30 tx=0x7f58d4010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.125+0000 7f58c67fc700 1 -- 172.21.15.103:0/1898945529 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58d4005aa0 con 0x7f58d812c0d0 2020-04-22T14:15:08.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.125+0000 7f58dd877700 1 --2- 172.21.15.103:0/1898945529 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58d812c0d0 0x7f58d812a060 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f58d4002f30 tx=0x7f58d4010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.125+0000 7f58dd877700 1 --2- 172.21.15.103:0/1898945529 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58d812c0d0 0x7f58d812a060 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f58d4002f30 tx=0x7f58d4010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.125+0000 7f58c67fc700 1 -- 172.21.15.103:0/1898945529 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d4005c00 con 0x7f58d812c0d0 2020-04-22T14:15:08.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.125+0000 7f58c67fc700 1 -- 172.21.15.103:0/1898945529 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58d4012550 con 0x7f58d812c0d0 2020-04-22T14:15:08.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.125+0000 7f58df2da700 1 -- 172.21.15.103:0/1898945529 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58d814ce50 con 0x7f58d812c0d0 2020-04-22T14:15:08.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.125+0000 7f58df2da700 1 -- 172.21.15.103:0/1898945529 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d8127aa0 con 0x7f58d812c0d0 2020-04-22T14:15:08.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.125+0000 7f58dd877700 1 --2- 172.21.15.103:0/1898945529 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58d812c0d0 0x7f58d812a060 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f58d4002f30 tx=0x7f58d4010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.126+0000 7f58df2da700 1 -- 172.21.15.103:0/1898945529 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58d81428b0 con 0x7f58d812c0d0 2020-04-22T14:15:08.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.126+0000 7f58c67fc700 1 -- 172.21.15.103:0/1898945529 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f58d40071a0 con 0x7f58d812c0d0 2020-04-22T14:15:08.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.126+0000 7f58dd877700 1 --2- 172.21.15.103:0/1898945529 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58d812c0d0 0x7f58d812a060 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f58d4002f30 tx=0x7f58d4010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.126+0000 7f58c67fc700 1 --2- 172.21.15.103:0/1898945529 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f58b804da10 0x7f58b804fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:08.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.126+0000 7f58c67fc700 1 -- 172.21.15.103:0/1898945529 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f58d40612e0 con 0x7f58d812c0d0 2020-04-22T14:15:08.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.127+0000 7f58dd076700 1 --2- 172.21.15.103:0/1898945529 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f58b804da10 0x7f58b804fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:08.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.127+0000 7f58dd076700 1 --2- 172.21.15.103:0/1898945529 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f58b804da10 0x7f58b804fed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f58d80b5c80 tx=0x7f58d0001990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.127+0000 7f58dd076700 1 --2- 172.21.15.103:0/1898945529 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f58b804da10 0x7f58b804fed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f58d80b5c80 tx=0x7f58d0001990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.127+0000 7f58dd076700 1 --2- 172.21.15.103:0/1898945529 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f58b804da10 0x7f58b804fed0 secure :-1 s=READY pgs=529 cs=0 l=1 rx=0x7f58d80b5c80 tx=0x7f58d0001990).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:08.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.130+0000 7f58dd877700 1 --2- 172.21.15.103:0/1898945529 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58d812c0d0 0x7f58d812a060 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f58d4002f30 tx=0x7f58d4010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.130+0000 7f58c67fc700 1 -- 172.21.15.103:0/1898945529 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f58d81428b0 con 0x7f58d812c0d0 2020-04-22T14:15:08.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.323+0000 7f58df2da700 1 -- 172.21.15.103:0/1898945529 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f58d8056c90 con 0x7f58d812c0d0 2020-04-22T14:15:08.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.324+0000 7f58dd877700 1 --2- 172.21.15.103:0/1898945529 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58d812c0d0 0x7f58d812a060 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f58d4002f30 tx=0x7f58d4010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.324+0000 7f58c67fc700 1 -- 172.21.15.103:0/1898945529 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v36) v1 ==== 80+0+4513 (secure 0 0 0) 0x7f58d403c6c0 con 0x7f58d812c0d0 2020-04-22T14:15:08.327 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:15:08.327 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:15:08.327 INFO:teuthology.orchestra.run.smithi103.stdout: "auth_dump": [ 2020-04-22T14:15:08.327 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:08.328 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.a", 2020-04-22T14:15:08.328 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBeliD5IBAAjC7UikdEP8FeE2rKs/ympw==", 2020-04-22T14:15:08.328 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:15:08.328 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:15:08.328 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:15:08.328 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:15:08.328 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:15:08.329 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:08.329 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:08.329 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:08.329 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.b", 2020-04-22T14:15:08.329 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBepkqQLBAA4aMKXxROQugglhm4aBd1Iw==", 2020-04-22T14:15:08.329 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:15:08.330 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:15:08.330 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:15:08.330 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:15:08.330 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:15:08.330 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:08.330 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:08.330 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:08.330 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.0", 2020-04-22T14:15:08.331 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA2TqBehMJiBxAARaWo32QGx49PxImGafnOFw==", 2020-04-22T14:15:08.331 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:15:08.331 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:15:08.331 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:15:08.331 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:15:08.331 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:08.331 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:08.332 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:08.332 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.1", 2020-04-22T14:15:08.332 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA4TqBeiAAcKRAAEHuaqbsB+NLUTSgFOCOFZg==", 2020-04-22T14:15:08.332 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:15:08.332 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:15:08.345 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:15:08.345 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:15:08.345 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:08.345 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:08.346 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:08.346 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.2", 2020-04-22T14:15:08.346 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA7TqBebeRzDxAAsjRyvJektq7MQ+334kU+UQ==", 2020-04-22T14:15:08.346 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:15:08.346 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:15:08.346 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:15:08.346 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:15:08.346 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:08.347 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:08.347 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:08.347 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.3", 2020-04-22T14:15:08.347 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA9TqBehxmSMRAATZ0o/ZnxHp2m/tqLmv6JwA==", 2020-04-22T14:15:08.347 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:15:08.347 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:15:08.347 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:15:08.348 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:15:08.348 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:08.348 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:08.348 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:08.348 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.4", 2020-04-22T14:15:08.348 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBETqBePwJSBRAAXgMKuX3EILi3gy8QzR4cig==", 2020-04-22T14:15:08.348 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:15:08.348 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:15:08.349 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:15:08.349 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:15:08.349 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:08.349 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:08.349 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:08.349 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.5", 2020-04-22T14:15:08.349 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBGTqBe5l++KRAAHIWG6bBnru2EVXv/drAL0g==", 2020-04-22T14:15:08.350 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:15:08.350 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:15:08.350 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:15:08.350 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:15:08.350 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:08.350 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:08.350 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:08.350 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.6", 2020-04-22T14:15:08.351 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBJTqBe88rTEBAAO2Z78NZLTYIbBpYovBSHVQ==", 2020-04-22T14:15:08.351 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:15:08.351 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:15:08.351 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:15:08.351 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:15:08.351 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:08.351 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:08.352 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:08.352 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.7", 2020-04-22T14:15:08.352 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBLTqBeGNFIMxAARIXhPNM6xurdnDv8+xZqUw==", 2020-04-22T14:15:08.352 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:15:08.352 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:15:08.352 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:15:08.352 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:15:08.360 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:08.360 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:08.360 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:08.362 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.0", 2020-04-22T14:15:08.362 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBe5ooUNxAA9zBtv6+i3Xl9iYtRl4xKGg==", 2020-04-22T14:15:08.362 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:15:08.362 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:15:08.362 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:15:08.364 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:15:08.364 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:08.364 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:08.364 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:08.364 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.1", 2020-04-22T14:15:08.364 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAyTqBe0bioBBAAVpoQouA/QICwqRoaFbjkiA==", 2020-04-22T14:15:08.364 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:15:08.365 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:15:08.365 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:15:08.365 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:15:08.365 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:08.365 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:08.365 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:08.365 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.2", 2020-04-22T14:15:08.365 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAyTqBemwpXCxAAObNL96zS67nMEe4MLjrEtw==", 2020-04-22T14:15:08.366 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:15:08.366 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:15:08.366 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:15:08.366 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:15:08.366 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:08.366 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:08.366 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:08.367 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.3", 2020-04-22T14:15:08.367 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAyTqBemGxNFBAAlqvB8FeZbMRwvzVjBpH/tA==", 2020-04-22T14:15:08.367 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:15:08.367 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:15:08.367 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:15:08.367 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:15:08.367 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:08.367 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:08.368 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:08.368 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.admin", 2020-04-22T14:15:08.368 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAwTqBeSx5dHxAAH0jPkaiWEwpr66ROWwbU8Q==", 2020-04-22T14:15:08.368 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:15:08.368 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2020-04-22T14:15:08.368 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:15:08.368 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:15:08.368 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:15:08.369 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:08.369 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:08.369 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:08.369 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mgr.x", 2020-04-22T14:15:08.369 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBe3YVhGhAAWAf6f9sV3bzoucBBPS3j2g==", 2020-04-22T14:15:08.369 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:15:08.369 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2020-04-22T14:15:08.369 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile mgr", 2020-04-22T14:15:08.370 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:15:08.370 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:08.370 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:08.370 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:08.370 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mgr.y", 2020-04-22T14:15:08.370 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBeX8AXExAAhh/N+/ogdKlxmkveSM60+g==", 2020-04-22T14:15:08.370 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:15:08.370 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2020-04-22T14:15:08.371 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile mgr", 2020-04-22T14:15:08.371 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:15:08.371 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:08.371 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:08.371 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:08.371 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:15:08.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.326+0000 7f58df2da700 1 -- 172.21.15.103:0/1898945529 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f58b804da10 msgr2=0x7f58b804fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:08.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.326+0000 7f58df2da700 1 --2- 172.21.15.103:0/1898945529 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f58b804da10 0x7f58b804fed0 secure :-1 s=READY pgs=529 cs=0 l=1 rx=0x7f58d80b5c80 tx=0x7f58d0001990).stop 2020-04-22T14:15:08.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.326+0000 7f58df2da700 1 -- 172.21.15.103:0/1898945529 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58d812c0d0 msgr2=0x7f58d812a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:08.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.326+0000 7f58df2da700 1 --2- 172.21.15.103:0/1898945529 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58d812c0d0 0x7f58d812a060 secure :-1 s=READY pgs=136 cs=0 l=1 rx=0x7f58d4002f30 tx=0x7f58d4010ac0).stop 2020-04-22T14:15:08.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.326+0000 7f58df2da700 1 -- 172.21.15.103:0/1898945529 shutdown_connections 2020-04-22T14:15:08.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.326+0000 7f58df2da700 1 --2- 172.21.15.103:0/1898945529 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58d812c0d0 0x7f58d812a060 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:08.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.326+0000 7f58df2da700 1 --2- 172.21.15.103:0/1898945529 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f58b804da10 0x7f58b804fed0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:08.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.326+0000 7f58df2da700 1 --2- 172.21.15.103:0/1898945529 >> v2:172.21.15.86:3300/0 conn(0x7f58d8065fe0 0x7f58d8141dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:08.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.326+0000 7f58df2da700 1 -- 172.21.15.103:0/1898945529 >> 172.21.15.103:0/1898945529 conn(0x7f58d80b9160 msgr2=0x7f58d80615e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:08.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.326+0000 7f58df2da700 1 -- 172.21.15.103:0/1898945529 shutdown_connections 2020-04-22T14:15:08.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.326+0000 7f58df2da700 1 -- 172.21.15.103:0/1898945529 wait complete. 2020-04-22T14:15:08.375 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:08.389 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:15:08.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.533+0000 7fbed7d75700 1 Processor -- start 2020-04-22T14:15:08.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.533+0000 7fbed7d75700 1 -- start start 2020-04-22T14:15:08.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.534+0000 7fbed7d75700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbed0065fe0 0x7fbed01464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:08.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.534+0000 7fbed7d75700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbed0143300 con 0x7fbed0063e30 2020-04-22T14:15:08.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.534+0000 7fbed7d75700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbed01435a0 con 0x7fbed012c0d0 2020-04-22T14:15:08.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.534+0000 7fbed7d75700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed0143840 con 0x7fbed0065fe0 2020-04-22T14:15:08.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.534+0000 7fbed5b11700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fbed012c0d0 0x7fbed005b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47120/0 (socket says 172.21.15.103:47120) 2020-04-22T14:15:08.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.534+0000 7fbed5b11700 1 -- 172.21.15.103:0/4127094221 learned_addr learned my addr 172.21.15.103:0/4127094221 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:08.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.534+0000 7fbed4b0f700 1 -- 172.21.15.103:0/4127094221 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 522576850 0 0) 0x7fbed01435a0 con 0x7fbed012c0d0 2020-04-22T14:15:08.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.534+0000 7fbed4b0f700 1 -- 172.21.15.103:0/4127094221 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbeb8003230 con 0x7fbed012c0d0 2020-04-22T14:15:08.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.534+0000 7fbed5310700 1 --2- 172.21.15.103:0/4127094221 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbed0065fe0 0x7fbed01464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:08.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.535+0000 7fbed4b0f700 1 -- 172.21.15.103:0/4127094221 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3790724964 0 0) 0x7fbeb8003230 con 0x7fbed012c0d0 2020-04-22T14:15:08.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.535+0000 7fbed4b0f700 1 -- 172.21.15.103:0/4127094221 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbed0065fe0 msgr2=0x7fbed01464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:08.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.535+0000 7fbed4b0f700 1 --2- 172.21.15.103:0/4127094221 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbed0065fe0 0x7fbed01464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:08.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.535+0000 7fbed4b0f700 1 -- 172.21.15.103:0/4127094221 >> v1:172.21.15.86:6789/0 conn(0x7fbed0063e30 legacy=0x7fbed00642a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:08.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.535+0000 7fbed4b0f700 1 -- 172.21.15.103:0/4127094221 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed005bb50 con 0x7fbed012c0d0 2020-04-22T14:15:08.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.535+0000 7fbed4b0f700 1 -- 172.21.15.103:0/4127094221 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fbec0001710 con 0x7fbed012c0d0 2020-04-22T14:15:08.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.535+0000 7fbed4b0f700 1 -- 172.21.15.103:0/4127094221 >> v1:172.21.15.103:6789/0 conn(0x7fbed012c0d0 legacy=0x7fbed005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:08.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.535+0000 7fbed4b0f700 1 --2- 172.21.15.103:0/4127094221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbeb8003720 0x7fbeb8003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:08.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.535+0000 7fbed4b0f700 1 --2- 172.21.15.103:0/4127094221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeb8003fd0 0x7fbeb80044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:08.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.535+0000 7fbed4b0f700 1 --2- 172.21.15.103:0/4127094221 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbed0065fe0 0x7fbeb8004a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:08.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.535+0000 7fbed4b0f700 1 -- 172.21.15.103:0/4127094221 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed0143840 con 0x7fbeb8003720 2020-04-22T14:15:08.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.535+0000 7fbed4b0f700 1 -- 172.21.15.103:0/4127094221 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb8004f80 con 0x7fbeb8003fd0 2020-04-22T14:15:08.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.535+0000 7fbed4b0f700 1 -- 172.21.15.103:0/4127094221 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb8005140 con 0x7fbed0065fe0 2020-04-22T14:15:08.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.535+0000 7fbed5310700 1 --2- 172.21.15.103:0/4127094221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeb8003fd0 0x7fbeb80044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:08.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.535+0000 7fbed5b11700 1 --2- 172.21.15.103:0/4127094221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbeb8003720 0x7fbeb8003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:08.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.535+0000 7fbed6312700 1 --2- 172.21.15.103:0/4127094221 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbed0065fe0 0x7fbeb8004a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:08.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.535+0000 7fbed5310700 1 -- 172.21.15.103:0/4127094221 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbed0065fe0 msgr2=0x7fbeb8004a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:08.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.535+0000 7fbed5310700 1 --2- 172.21.15.103:0/4127094221 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbed0065fe0 0x7fbeb8004a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:08.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.535+0000 7fbed5310700 1 -- 172.21.15.103:0/4127094221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbeb8003720 msgr2=0x7fbeb8003b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:08.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.535+0000 7fbed5310700 1 --2- 172.21.15.103:0/4127094221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbeb8003720 0x7fbeb8003b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:08.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.535+0000 7fbed5310700 1 -- 172.21.15.103:0/4127094221 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb8003230 con 0x7fbeb8003fd0 2020-04-22T14:15:08.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.535+0000 7fbed6312700 1 --2- 172.21.15.103:0/4127094221 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbed0065fe0 0x7fbeb8004a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:15:08.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.535+0000 7fbed5310700 1 --2- 172.21.15.103:0/4127094221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeb8003fd0 0x7fbeb80044d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbecc008910 tx=0x7fbecc010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.535+0000 7fbed5310700 1 --2- 172.21.15.103:0/4127094221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeb8003fd0 0x7fbeb80044d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbecc008910 tx=0x7fbecc010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.535+0000 7fbed5310700 1 --2- 172.21.15.103:0/4127094221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeb8003fd0 0x7fbeb80044d0 secure :-1 s=READY pgs=1459 cs=0 l=1 rx=0x7fbecc008910 tx=0x7fbecc010050).ready entity=mon.1 client_cookie=cd50458f6ccfed12 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:08.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.535+0000 7fbed5310700 1 --2- 172.21.15.103:0/4127094221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeb8003fd0 0x7fbeb80044d0 secure :-1 s=THROTTLE_DONE pgs=1459 cs=0 l=1 rx=0x7fbecc008910 tx=0x7fbecc010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.535+0000 7fbed4b0f700 1 -- 172.21.15.103:0/4127094221 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbecc008d30 con 0x7fbeb8003fd0 2020-04-22T14:15:08.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.535+0000 7fbed5310700 1 --2- 172.21.15.103:0/4127094221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeb8003fd0 0x7fbeb80044d0 secure :-1 s=THROTTLE_DONE pgs=1459 cs=0 l=1 rx=0x7fbecc008910 tx=0x7fbecc010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.535+0000 7fbed4b0f700 1 -- 172.21.15.103:0/4127094221 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbecc008e90 con 0x7fbeb8003fd0 2020-04-22T14:15:08.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.535+0000 7fbed5310700 1 --2- 172.21.15.103:0/4127094221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeb8003fd0 0x7fbeb80044d0 secure :-1 s=THROTTLE_DONE pgs=1459 cs=0 l=1 rx=0x7fbecc008910 tx=0x7fbecc010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.535+0000 7fbed4b0f700 1 -- 172.21.15.103:0/4127094221 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbecc010b30 con 0x7fbeb8003fd0 2020-04-22T14:15:08.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.535+0000 7fbed7d75700 1 -- 172.21.15.103:0/4127094221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeb8003fd0 msgr2=0x7fbeb80044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:08.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.535+0000 7fbed7d75700 1 --2- 172.21.15.103:0/4127094221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeb8003fd0 0x7fbeb80044d0 secure :-1 s=READY pgs=1459 cs=0 l=1 rx=0x7fbecc008910 tx=0x7fbecc010050).stop 2020-04-22T14:15:08.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.535+0000 7fbed6312700 1 -- 172.21.15.103:0/4127094221 reap_dead start 2020-04-22T14:15:08.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.536+0000 7fbed7d75700 1 -- 172.21.15.103:0/4127094221 shutdown_connections 2020-04-22T14:15:08.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.536+0000 7fbed7d75700 1 -- 172.21.15.103:0/4127094221 >> 172.21.15.103:0/4127094221 conn(0x7fbed00b9160 msgr2=0x7fbed005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:08.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.536+0000 7fbed7d75700 1 -- 172.21.15.103:0/4127094221 shutdown_connections 2020-04-22T14:15:08.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.536+0000 7fbed7d75700 1 -- 172.21.15.103:0/4127094221 wait complete. 2020-04-22T14:15:08.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.537+0000 7fbed7d75700 1 Processor -- start 2020-04-22T14:15:08.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.537+0000 7fbed7d75700 1 -- start start 2020-04-22T14:15:08.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.538+0000 7fbed7d75700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbed01534e0 0x7fbed00ae750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:08.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.538+0000 7fbed7d75700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbed0153c90 con 0x7fbed012b420 2020-04-22T14:15:08.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.538+0000 7fbed7d75700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbed01539f0 con 0x7fbed00b5e50 2020-04-22T14:15:08.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.538+0000 7fbed7d75700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbed00b1e80 con 0x7fbed01534e0 2020-04-22T14:15:08.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.538+0000 7fbed5310700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fbed00b5e50 0x7fbed0152dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47134/0 (socket says 172.21.15.103:47134) 2020-04-22T14:15:08.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.538+0000 7fbed5310700 1 -- 172.21.15.103:0/1118196468 learned_addr learned my addr 172.21.15.103:0/1118196468 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:08.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.538+0000 7fbed6312700 1 --2- 172.21.15.103:0/1118196468 >> v2:172.21.15.86:3300/0 conn(0x7fbed01534e0 0x7fbed00ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:08.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.538+0000 7fbebeffd700 1 -- 172.21.15.103:0/1118196468 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1713414658 0 0) 0x7fbed01539f0 con 0x7fbed00b5e50 2020-04-22T14:15:08.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.538+0000 7fbebeffd700 1 -- 172.21.15.103:0/1118196468 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbeb0002fe0 con 0x7fbed00b5e50 2020-04-22T14:15:08.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.538+0000 7fbebeffd700 1 -- 172.21.15.103:0/1118196468 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3429913541 0 0) 0x7fbed0153c90 con 0x7fbed012b420 2020-04-22T14:15:08.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.538+0000 7fbebeffd700 1 -- 172.21.15.103:0/1118196468 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbed01539f0 con 0x7fbed012b420 2020-04-22T14:15:08.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.538+0000 7fbebeffd700 1 -- 172.21.15.103:0/1118196468 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 296080811 0 0) 0x7fbeb0002fe0 con 0x7fbed00b5e50 2020-04-22T14:15:08.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.538+0000 7fbebeffd700 1 -- 172.21.15.103:0/1118196468 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbed0153c90 con 0x7fbed00b5e50 2020-04-22T14:15:08.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.538+0000 7fbebeffd700 1 -- 172.21.15.103:0/1118196468 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fbecc0078a0 con 0x7fbed00b5e50 2020-04-22T14:15:08.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.538+0000 7fbebeffd700 1 -- 172.21.15.103:0/1118196468 >> v2:172.21.15.86:3300/0 conn(0x7fbed01534e0 msgr2=0x7fbed00ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:08.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.538+0000 7fbebeffd700 1 --2- 172.21.15.103:0/1118196468 >> v2:172.21.15.86:3300/0 conn(0x7fbed01534e0 0x7fbed00ae750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:08.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.538+0000 7fbebeffd700 1 -- 172.21.15.103:0/1118196468 >> v1:172.21.15.103:6789/0 conn(0x7fbed00b5e50 legacy=0x7fbed0152dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:08.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.538+0000 7fbebeffd700 1 -- 172.21.15.103:0/1118196468 >> v1:172.21.15.86:6789/0 conn(0x7fbed012b420 legacy=0x7fbed00b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:08.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.538+0000 7fbebeffd700 1 --2- 172.21.15.103:0/1118196468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeb0004b20 0x7fbeb0004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:08.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.538+0000 7fbebeffd700 1 --2- 172.21.15.103:0/1118196468 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbeb0003ab0 0x7fbeb0003f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:08.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.538+0000 7fbebeffd700 1 --2- 172.21.15.103:0/1118196468 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbeb0004390 0x7fbeb000b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:08.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.538+0000 7fbebeffd700 1 -- 172.21.15.103:0/1118196468 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed00b1e80 con 0x7fbeb0003ab0 2020-04-22T14:15:08.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.538+0000 7fbebeffd700 1 -- 172.21.15.103:0/1118196468 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb0004920 con 0x7fbeb0004b20 2020-04-22T14:15:08.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.538+0000 7fbebeffd700 1 -- 172.21.15.103:0/1118196468 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb000bbe0 con 0x7fbeb0004390 2020-04-22T14:15:08.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.538+0000 7fbed5b11700 1 --2- 172.21.15.103:0/1118196468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeb0004b20 0x7fbeb0004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:08.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.538+0000 7fbed5310700 1 --2- 172.21.15.103:0/1118196468 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbeb0003ab0 0x7fbeb0003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:08.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.538+0000 7fbed6312700 1 --2- 172.21.15.103:0/1118196468 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbeb0004390 0x7fbeb000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:08.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.539+0000 7fbed5b11700 1 -- 172.21.15.103:0/1118196468 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbeb0004390 msgr2=0x7fbeb000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:08.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.539+0000 7fbed5b11700 1 --2- 172.21.15.103:0/1118196468 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbeb0004390 0x7fbeb000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:08.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.539+0000 7fbed5b11700 1 -- 172.21.15.103:0/1118196468 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbeb0003ab0 msgr2=0x7fbeb0003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:08.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.539+0000 7fbed5b11700 1 --2- 172.21.15.103:0/1118196468 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbeb0003ab0 0x7fbeb0003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:08.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.539+0000 7fbed6312700 1 -- 172.21.15.103:0/1118196468 reap_dead start 2020-04-22T14:15:08.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.539+0000 7fbed5b11700 1 -- 172.21.15.103:0/1118196468 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed00b0f60 con 0x7fbeb0004b20 2020-04-22T14:15:08.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.539+0000 7fbed7d75700 1 -- 172.21.15.103:0/1118196468 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbed0152dd0 con 0x7fbeb0004b20 2020-04-22T14:15:08.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.539+0000 7fbed5b11700 1 --2- 172.21.15.103:0/1118196468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeb0004b20 0x7fbeb0004f00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbec00010d0 tx=0x7fbed005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.539+0000 7fbed7d75700 1 -- 172.21.15.103:0/1118196468 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbed0153240 con 0x7fbeb0004b20 2020-04-22T14:15:08.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.539+0000 7fbed5b11700 1 --2- 172.21.15.103:0/1118196468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeb0004b20 0x7fbeb0004f00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbec00010d0 tx=0x7fbed005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.539+0000 7fbed5b11700 1 --2- 172.21.15.103:0/1118196468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeb0004b20 0x7fbeb0004f00 secure :-1 s=READY pgs=1461 cs=0 l=1 rx=0x7fbec00010d0 tx=0x7fbed005bce0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:08.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.539+0000 7fbed5b11700 1 --2- 172.21.15.103:0/1118196468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeb0004b20 0x7fbeb0004f00 secure :-1 s=THROTTLE_DONE pgs=1461 cs=0 l=1 rx=0x7fbec00010d0 tx=0x7fbed005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.539+0000 7fbebeffd700 1 -- 172.21.15.103:0/1118196468 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbec000fdf0 con 0x7fbeb0004b20 2020-04-22T14:15:08.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.539+0000 7fbed5b11700 1 --2- 172.21.15.103:0/1118196468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeb0004b20 0x7fbeb0004f00 secure :-1 s=THROTTLE_DONE pgs=1461 cs=0 l=1 rx=0x7fbec00010d0 tx=0x7fbed005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.539+0000 7fbebeffd700 1 -- 172.21.15.103:0/1118196468 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec00118b0 con 0x7fbeb0004b20 2020-04-22T14:15:08.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.539+0000 7fbed5b11700 1 --2- 172.21.15.103:0/1118196468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeb0004b20 0x7fbeb0004f00 secure :-1 s=THROTTLE_DONE pgs=1461 cs=0 l=1 rx=0x7fbec00010d0 tx=0x7fbed005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.539+0000 7fbebeffd700 1 -- 172.21.15.103:0/1118196468 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbec0011c10 con 0x7fbeb0004b20 2020-04-22T14:15:08.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.540+0000 7fbed5b11700 1 --2- 172.21.15.103:0/1118196468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeb0004b20 0x7fbeb0004f00 secure :-1 s=THROTTLE_DONE pgs=1461 cs=0 l=1 rx=0x7fbec00010d0 tx=0x7fbed005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.540+0000 7fbed7d75700 1 -- 172.21.15.103:0/1118196468 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbed0056c90 con 0x7fbeb0004b20 2020-04-22T14:15:08.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.540+0000 7fbebeffd700 1 -- 172.21.15.103:0/1118196468 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fbec0011d70 con 0x7fbeb0004b20 2020-04-22T14:15:08.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.540+0000 7fbed5b11700 1 --2- 172.21.15.103:0/1118196468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeb0004b20 0x7fbeb0004f00 secure :-1 s=THROTTLE_DONE pgs=1461 cs=0 l=1 rx=0x7fbec00010d0 tx=0x7fbed005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.540+0000 7fbebeffd700 1 --2- 172.21.15.103:0/1118196468 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbeb0051500 0x7fbeb00539c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:08.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.540+0000 7fbebeffd700 1 -- 172.21.15.103:0/1118196468 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fbec0060e70 con 0x7fbeb0004b20 2020-04-22T14:15:08.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.541+0000 7fbed5310700 1 --2- 172.21.15.103:0/1118196468 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbeb0051500 0x7fbeb00539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:08.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.541+0000 7fbed5310700 1 --2- 172.21.15.103:0/1118196468 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbeb0051500 0x7fbeb00539c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbecc007720 tx=0x7fbecc010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.541+0000 7fbed5310700 1 --2- 172.21.15.103:0/1118196468 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbeb0051500 0x7fbeb00539c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbecc007720 tx=0x7fbecc010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.541+0000 7fbed5310700 1 --2- 172.21.15.103:0/1118196468 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbeb0051500 0x7fbeb00539c0 secure :-1 s=READY pgs=530 cs=0 l=1 rx=0x7fbecc007720 tx=0x7fbecc010050).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:08.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.544+0000 7fbed5b11700 1 --2- 172.21.15.103:0/1118196468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeb0004b20 0x7fbeb0004f00 secure :-1 s=THROTTLE_DONE pgs=1461 cs=0 l=1 rx=0x7fbec00010d0 tx=0x7fbed005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.544+0000 7fbebeffd700 1 -- 172.21.15.103:0/1118196468 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fbec003c370 con 0x7fbeb0004b20 2020-04-22T14:15:08.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.692+0000 7fbed7d75700 1 -- 172.21.15.103:0/1118196468 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbed0147360 con 0x7fbeb0004b20 2020-04-22T14:15:08.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.692+0000 7fbed5b11700 1 --2- 172.21.15.103:0/1118196468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeb0004b20 0x7fbeb0004f00 secure :-1 s=THROTTLE_DONE pgs=1461 cs=0 l=1 rx=0x7fbec00010d0 tx=0x7fbed005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.692+0000 7fbebeffd700 1 -- 172.21.15.103:0/1118196468 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+13233 (secure 0 0 0) 0x7fbec003f990 con 0x7fbeb0004b20 2020-04-22T14:15:08.695 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:15:08.695 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":96,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:15:07.890071+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:15:08.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.694+0000 7fbed7d75700 1 -- 172.21.15.103:0/1118196468 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbeb0051500 msgr2=0x7fbeb00539c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:08.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.694+0000 7fbed7d75700 1 --2- 172.21.15.103:0/1118196468 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbeb0051500 0x7fbeb00539c0 secure :-1 s=READY pgs=530 cs=0 l=1 rx=0x7fbecc007720 tx=0x7fbecc010050).stop 2020-04-22T14:15:08.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.694+0000 7fbed7d75700 1 -- 172.21.15.103:0/1118196468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeb0004b20 msgr2=0x7fbeb0004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:08.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.694+0000 7fbed7d75700 1 --2- 172.21.15.103:0/1118196468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeb0004b20 0x7fbeb0004f00 secure :-1 s=READY pgs=1461 cs=0 l=1 rx=0x7fbec00010d0 tx=0x7fbed005bce0).stop 2020-04-22T14:15:08.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.694+0000 7fbed7d75700 1 -- 172.21.15.103:0/1118196468 shutdown_connections 2020-04-22T14:15:08.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.694+0000 7fbed7d75700 1 --2- 172.21.15.103:0/1118196468 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbeb0051500 0x7fbeb00539c0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:08.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.694+0000 7fbed7d75700 1 --2- 172.21.15.103:0/1118196468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeb0004b20 0x7fbeb0004f00 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:08.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.694+0000 7fbed7d75700 1 -- 172.21.15.103:0/1118196468 >> 172.21.15.103:0/1118196468 conn(0x7fbed00b9160 msgr2=0x7fbed00645e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:08.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.694+0000 7fbed7d75700 1 -- 172.21.15.103:0/1118196468 shutdown_connections 2020-04-22T14:15:08.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.694+0000 7fbed7d75700 1 -- 172.21.15.103:0/1118196468 wait complete. 2020-04-22T14:15:08.707 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:15:08.708 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:08.722 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:15:08.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.868+0000 7fb3fba58700 1 Processor -- start 2020-04-22T14:15:08.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.868+0000 7fb3fba58700 1 -- start start 2020-04-22T14:15:08.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.869+0000 7fb3fba58700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3f40acb10 0x7fb3f4142630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:08.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.869+0000 7fb3fba58700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3f40af030 con 0x7fb3f4061a30 2020-04-22T14:15:08.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.869+0000 7fb3fba58700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3f4060250 con 0x7fb3f40b4820 2020-04-22T14:15:08.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.869+0000 7fb3fba58700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f40623c0 con 0x7fb3f40acb10 2020-04-22T14:15:08.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.869+0000 7fb3f8ff3700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb3f40b4820 0x7fb3f4141f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47146/0 (socket says 172.21.15.103:47146) 2020-04-22T14:15:08.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.869+0000 7fb3f8ff3700 1 -- 172.21.15.103:0/1243150187 learned_addr learned my addr 172.21.15.103:0/1243150187 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:08.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.869+0000 7fb3f9ff5700 1 --2- 172.21.15.103:0/1243150187 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3f40acb10 0x7fb3f4142630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:08.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.869+0000 7fb3e3fff700 1 -- 172.21.15.103:0/1243150187 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1026326615 0 0) 0x7fb3f4060250 con 0x7fb3f40b4820 2020-04-22T14:15:08.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.869+0000 7fb3e3fff700 1 -- 172.21.15.103:0/1243150187 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3dc004340 con 0x7fb3f40b4820 2020-04-22T14:15:08.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.869+0000 7fb3e3fff700 1 -- 172.21.15.103:0/1243150187 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1125009557 0 0) 0x7fb3f40af030 con 0x7fb3f4061a30 2020-04-22T14:15:08.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.869+0000 7fb3e3fff700 1 -- 172.21.15.103:0/1243150187 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3f4060250 con 0x7fb3f4061a30 2020-04-22T14:15:08.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.869+0000 7fb3f9ff5700 1 -- 172.21.15.103:0/1243150187 >> v1:172.21.15.103:6789/0 conn(0x7fb3f40b4820 legacy=0x7fb3f4141f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:08.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.869+0000 7fb3e3fff700 1 -- 172.21.15.103:0/1243150187 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2114734245 0 0) 0x7fb3dc004340 con 0x7fb3f40b4820 2020-04-22T14:15:08.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.869+0000 7fb3f9ff5700 1 -- 172.21.15.103:0/1243150187 >> v1:172.21.15.86:6789/0 conn(0x7fb3f4061a30 legacy=0x7fb3f40ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:08.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.869+0000 7fb3f9ff5700 1 -- 172.21.15.103:0/1243150187 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f4062660 con 0x7fb3f40acb10 2020-04-22T14:15:08.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.869+0000 7fb3f9ff5700 1 --2- 172.21.15.103:0/1243150187 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3f40acb10 0x7fb3f4142630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb3e40010d0 tx=0x7fb3ec008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.869+0000 7fb3f9ff5700 1 --2- 172.21.15.103:0/1243150187 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3f40acb10 0x7fb3f4142630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb3e40010d0 tx=0x7fb3ec008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.869+0000 7fb3f9ff5700 1 --2- 172.21.15.103:0/1243150187 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3f40acb10 0x7fb3f4142630 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7fb3e40010d0 tx=0x7fb3ec008c60).ready entity=mon.2 client_cookie=8b1f08461836907b server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:08.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.869+0000 7fb3f9ff5700 1 --2- 172.21.15.103:0/1243150187 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3f40acb10 0x7fb3f4142630 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7fb3e40010d0 tx=0x7fb3ec008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.870+0000 7fb3e3fff700 1 -- 172.21.15.103:0/1243150187 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3e40016d0 con 0x7fb3f40acb10 2020-04-22T14:15:08.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.870+0000 7fb3f9ff5700 1 --2- 172.21.15.103:0/1243150187 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3f40acb10 0x7fb3f4142630 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7fb3e40010d0 tx=0x7fb3ec008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.870+0000 7fb3f9ff5700 1 --2- 172.21.15.103:0/1243150187 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3f40acb10 0x7fb3f4142630 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7fb3e40010d0 tx=0x7fb3ec008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.870+0000 7fb3e3fff700 1 -- 172.21.15.103:0/1243150187 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3ec011b70 con 0x7fb3f40acb10 2020-04-22T14:15:08.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.870+0000 7fb3e3fff700 1 -- 172.21.15.103:0/1243150187 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3ec00a180 con 0x7fb3f40acb10 2020-04-22T14:15:08.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.870+0000 7fb3fba58700 1 -- 172.21.15.103:0/1243150187 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3f40acb10 msgr2=0x7fb3f4142630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:08.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.870+0000 7fb3fba58700 1 --2- 172.21.15.103:0/1243150187 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3f40acb10 0x7fb3f4142630 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7fb3e40010d0 tx=0x7fb3ec008c60).stop 2020-04-22T14:15:08.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.870+0000 7fb3fba58700 1 -- 172.21.15.103:0/1243150187 shutdown_connections 2020-04-22T14:15:08.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.870+0000 7fb3fba58700 1 --2- 172.21.15.103:0/1243150187 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3f40acb10 0x7fb3f4142630 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:08.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.870+0000 7fb3fba58700 1 -- 172.21.15.103:0/1243150187 >> 172.21.15.103:0/1243150187 conn(0x7fb3f405b7b0 msgr2=0x7fb3f40b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:08.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.870+0000 7fb3fba58700 1 -- 172.21.15.103:0/1243150187 shutdown_connections 2020-04-22T14:15:08.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.870+0000 7fb3fba58700 1 -- 172.21.15.103:0/1243150187 wait complete. 2020-04-22T14:15:08.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.871+0000 7fb3fba58700 1 Processor -- start 2020-04-22T14:15:08.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.871+0000 7fb3fba58700 1 -- start start 2020-04-22T14:15:08.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.872+0000 7fb3fba58700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3f4061a30 0x7fb3f4152b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:08.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.872+0000 7fb3fba58700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb3f40b4820 0x7fb3f4065aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:08.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.872+0000 7fb3fba58700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3f4111820 con 0x7fb3f40acb10 2020-04-22T14:15:08.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.872+0000 7fb3fba58700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3f4153110 con 0x7fb3f40b4820 2020-04-22T14:15:08.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.872+0000 7fb3fba58700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f41533b0 con 0x7fb3f4061a30 2020-04-22T14:15:08.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.872+0000 7fb3f8ff3700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb3f40acb10 0x7fb3f41400e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47152/0 (socket says 172.21.15.103:47152) 2020-04-22T14:15:08.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.872+0000 7fb3f8ff3700 1 -- 172.21.15.103:0/3160992548 learned_addr learned my addr 172.21.15.103:0/3160992548 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:08.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.872+0000 7fb3f97f4700 1 --2- 172.21.15.103:0/3160992548 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3f4061a30 0x7fb3f4152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:08.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.872+0000 7fb3f9ff5700 1 --2- 172.21.15.103:0/3160992548 >> v2:172.21.15.86:3300/0 conn(0x7fb3f40b4820 0x7fb3f4065aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:08.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.872+0000 7fb3e27fc700 1 -- 172.21.15.103:0/3160992548 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 880155088 0 0) 0x7fb3f4111820 con 0x7fb3f40acb10 2020-04-22T14:15:08.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.872+0000 7fb3e27fc700 1 -- 172.21.15.103:0/3160992548 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3d4002fe0 con 0x7fb3f40acb10 2020-04-22T14:15:08.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.872+0000 7fb3f97f4700 1 -- 172.21.15.103:0/3160992548 >> v2:172.21.15.86:3300/0 conn(0x7fb3f40b4820 msgr2=0x7fb3f4065aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:08.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.872+0000 7fb3f97f4700 1 --2- 172.21.15.103:0/3160992548 >> v2:172.21.15.86:3300/0 conn(0x7fb3f40b4820 0x7fb3f4065aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:08.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.872+0000 7fb3f97f4700 1 -- 172.21.15.103:0/3160992548 >> v1:172.21.15.103:6789/0 conn(0x7fb3f40acb10 legacy=0x7fb3f41400e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:08.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.872+0000 7fb3e27fc700 1 -- 172.21.15.103:0/3160992548 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2234222781 0 0) 0x7fb3d4002fe0 con 0x7fb3f40acb10 2020-04-22T14:15:08.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.872+0000 7fb3f97f4700 1 -- 172.21.15.103:0/3160992548 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f4153650 con 0x7fb3f4061a30 2020-04-22T14:15:08.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.872+0000 7fb3f97f4700 1 --2- 172.21.15.103:0/3160992548 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3f4061a30 0x7fb3f4152b90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb3e4001790 tx=0x7fb3f00108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.872+0000 7fb3f97f4700 1 --2- 172.21.15.103:0/3160992548 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3f4061a30 0x7fb3f4152b90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb3e4001790 tx=0x7fb3f00108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.872+0000 7fb3f97f4700 1 --2- 172.21.15.103:0/3160992548 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3f4061a30 0x7fb3f4152b90 secure :-1 s=READY pgs=138 cs=0 l=1 rx=0x7fb3e4001790 tx=0x7fb3f00108a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:08.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.873+0000 7fb3f97f4700 1 --2- 172.21.15.103:0/3160992548 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3f4061a30 0x7fb3f4152b90 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7fb3e4001790 tx=0x7fb3f00108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.873+0000 7fb3e27fc700 1 -- 172.21.15.103:0/3160992548 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3e40044f0 con 0x7fb3f4061a30 2020-04-22T14:15:08.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.873+0000 7fb3f97f4700 1 --2- 172.21.15.103:0/3160992548 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3f4061a30 0x7fb3f4152b90 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7fb3e4001790 tx=0x7fb3f00108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.873+0000 7fb3f97f4700 1 --2- 172.21.15.103:0/3160992548 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3f4061a30 0x7fb3f4152b90 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7fb3e4001790 tx=0x7fb3f00108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.873+0000 7fb3e27fc700 1 -- 172.21.15.103:0/3160992548 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f00069d0 con 0x7fb3f4061a30 2020-04-22T14:15:08.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.873+0000 7fb3fba58700 1 -- 172.21.15.103:0/3160992548 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3f41407f0 con 0x7fb3f4061a30 2020-04-22T14:15:08.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.873+0000 7fb3e27fc700 1 -- 172.21.15.103:0/3160992548 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3f0006d70 con 0x7fb3f4061a30 2020-04-22T14:15:08.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.873+0000 7fb3fba58700 1 -- 172.21.15.103:0/3160992548 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3f4144900 con 0x7fb3f4061a30 2020-04-22T14:15:08.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.873+0000 7fb3f97f4700 1 --2- 172.21.15.103:0/3160992548 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3f4061a30 0x7fb3f4152b90 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7fb3e4001790 tx=0x7fb3f00108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.874+0000 7fb3e27fc700 1 -- 172.21.15.103:0/3160992548 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fb3f000a350 con 0x7fb3f4061a30 2020-04-22T14:15:08.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.874+0000 7fb3fba58700 1 -- 172.21.15.103:0/3160992548 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3f4153a10 con 0x7fb3f4061a30 2020-04-22T14:15:08.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.874+0000 7fb3f97f4700 1 --2- 172.21.15.103:0/3160992548 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3f4061a30 0x7fb3f4152b90 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7fb3e4001790 tx=0x7fb3f00108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.874+0000 7fb3e27fc700 1 --2- 172.21.15.103:0/3160992548 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb3d404dcf0 0x7fb3d40501b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:08.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.874+0000 7fb3e27fc700 1 -- 172.21.15.103:0/3160992548 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fb3f0060fa0 con 0x7fb3f4061a30 2020-04-22T14:15:08.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.874+0000 7fb3f8ff3700 1 --2- 172.21.15.103:0/3160992548 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb3d404dcf0 0x7fb3d40501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:08.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.874+0000 7fb3f8ff3700 1 --2- 172.21.15.103:0/3160992548 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb3d404dcf0 0x7fb3d40501b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb3e4001440 tx=0x7fb3e40017d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.875+0000 7fb3f8ff3700 1 --2- 172.21.15.103:0/3160992548 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb3d404dcf0 0x7fb3d40501b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb3e4001440 tx=0x7fb3e40017d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.875+0000 7fb3f8ff3700 1 --2- 172.21.15.103:0/3160992548 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb3d404dcf0 0x7fb3d40501b0 secure :-1 s=READY pgs=531 cs=0 l=1 rx=0x7fb3e4001440 tx=0x7fb3e40017d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:08.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.878+0000 7fb3f97f4700 1 --2- 172.21.15.103:0/3160992548 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3f4061a30 0x7fb3f4152b90 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7fb3e4001790 tx=0x7fb3f00108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:08.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:08.878+0000 7fb3e27fc700 1 -- 172.21.15.103:0/3160992548 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fb3f003c3e0 con 0x7fb3f4061a30 2020-04-22T14:15:09.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.019+0000 7fb3fba58700 1 -- 172.21.15.103:0/3160992548 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb3f41537e0 con 0x7fb3f4061a30 2020-04-22T14:15:09.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.019+0000 7fb3f97f4700 1 --2- 172.21.15.103:0/3160992548 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3f4061a30 0x7fb3f4152b90 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7fb3e4001790 tx=0x7fb3f00108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.019+0000 7fb3e27fc700 1 -- 172.21.15.103:0/3160992548 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v96) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb3f003fa00 con 0x7fb3f4061a30 2020-04-22T14:15:09.022 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:15:09.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.021+0000 7fb3fba58700 1 -- 172.21.15.103:0/3160992548 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb3d404dcf0 msgr2=0x7fb3d40501b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:09.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.021+0000 7fb3fba58700 1 --2- 172.21.15.103:0/3160992548 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb3d404dcf0 0x7fb3d40501b0 secure :-1 s=READY pgs=531 cs=0 l=1 rx=0x7fb3e4001440 tx=0x7fb3e40017d0).stop 2020-04-22T14:15:09.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.021+0000 7fb3fba58700 1 -- 172.21.15.103:0/3160992548 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3f4061a30 msgr2=0x7fb3f4152b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:09.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.021+0000 7fb3fba58700 1 --2- 172.21.15.103:0/3160992548 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3f4061a30 0x7fb3f4152b90 secure :-1 s=READY pgs=138 cs=0 l=1 rx=0x7fb3e4001790 tx=0x7fb3f00108a0).stop 2020-04-22T14:15:09.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.021+0000 7fb3fba58700 1 -- 172.21.15.103:0/3160992548 shutdown_connections 2020-04-22T14:15:09.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.021+0000 7fb3fba58700 1 --2- 172.21.15.103:0/3160992548 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb3d404dcf0 0x7fb3d40501b0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:09.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.021+0000 7fb3fba58700 1 --2- 172.21.15.103:0/3160992548 >> v2:172.21.15.86:3300/0 conn(0x7fb3f40b4820 0x7fb3f4065aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:09.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.021+0000 7fb3fba58700 1 --2- 172.21.15.103:0/3160992548 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3f4061a30 0x7fb3f4152b90 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:09.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.021+0000 7fb3fba58700 1 -- 172.21.15.103:0/3160992548 >> 172.21.15.103:0/3160992548 conn(0x7fb3f405b7b0 msgr2=0x7fb3f4140d50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:09.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.021+0000 7fb3fba58700 1 -- 172.21.15.103:0/3160992548 shutdown_connections 2020-04-22T14:15:09.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.021+0000 7fb3fba58700 1 -- 172.21.15.103:0/3160992548 wait complete. 2020-04-22T14:15:09.033 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:09.047 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:15:09.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.193+0000 7f2af312e700 1 Processor -- start 2020-04-22T14:15:09.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.193+0000 7f2af312e700 1 -- start start 2020-04-22T14:15:09.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.194+0000 7f2af312e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2aec0b9140 0x7f2aec12b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:09.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.194+0000 7f2af312e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aec1467e0 con 0x7f2aec0ac950 2020-04-22T14:15:09.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.194+0000 7f2af312e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aec060050 con 0x7f2aec12b670 2020-04-22T14:15:09.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.194+0000 7f2af312e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aec0602f0 con 0x7f2aec0b9140 2020-04-22T14:15:09.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.194+0000 7f2af0eca700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2aec0b9140 0x7f2aec12b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:09.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.194+0000 7f2af16cb700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f2aec12b670 0x7f2aec143090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47158/0 (socket says 172.21.15.103:47158) 2020-04-22T14:15:09.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.194+0000 7f2af16cb700 1 -- 172.21.15.103:0/1120466043 learned_addr learned my addr 172.21.15.103:0/1120466043 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:09.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.194+0000 7f2af0eca700 1 -- 172.21.15.103:0/1120466043 >> v1:172.21.15.103:6789/0 conn(0x7f2aec12b670 legacy=0x7f2aec143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:09.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.194+0000 7f2af0eca700 1 -- 172.21.15.103:0/1120466043 >> v1:172.21.15.86:6789/0 conn(0x7f2aec0ac950 legacy=0x7f2aec146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:09.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.194+0000 7f2aeb7fe700 1 -- 172.21.15.103:0/1120466043 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3520863143 0 0) 0x7f2aec060050 con 0x7f2aec12b670 2020-04-22T14:15:09.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.194+0000 7f2af0eca700 1 -- 172.21.15.103:0/1120466043 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aec0b9520 con 0x7f2aec0b9140 2020-04-22T14:15:09.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.194+0000 7f2af0eca700 1 --2- 172.21.15.103:0/1120466043 >> v2:172.21.15.103:3300/0 conn(0x7f2aec0b9140 0x7f2aec12b210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2aec0b6250 tx=0x7f2adc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.195+0000 7f2af0eca700 1 --2- 172.21.15.103:0/1120466043 >> v2:172.21.15.103:3300/0 conn(0x7f2aec0b9140 0x7f2aec12b210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2aec0b6250 tx=0x7f2adc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.195+0000 7f2af0eca700 1 --2- 172.21.15.103:0/1120466043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2aec0b9140 0x7f2aec12b210 secure :-1 s=READY pgs=1465 cs=0 l=1 rx=0x7f2aec0b6250 tx=0x7f2adc007a40).ready entity=mon.1 client_cookie=8d08f676dab87f9c server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:09.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.195+0000 7f2af0eca700 1 --2- 172.21.15.103:0/1120466043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2aec0b9140 0x7f2aec12b210 secure :-1 s=THROTTLE_DONE pgs=1465 cs=0 l=1 rx=0x7f2aec0b6250 tx=0x7f2adc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.195+0000 7f2aeb7fe700 1 -- 172.21.15.103:0/1120466043 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2adc011430 con 0x7f2aec0b9140 2020-04-22T14:15:09.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.195+0000 7f2af0eca700 1 --2- 172.21.15.103:0/1120466043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2aec0b9140 0x7f2aec12b210 secure :-1 s=THROTTLE_DONE pgs=1465 cs=0 l=1 rx=0x7f2aec0b6250 tx=0x7f2adc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.195+0000 7f2af0eca700 1 --2- 172.21.15.103:0/1120466043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2aec0b9140 0x7f2aec12b210 secure :-1 s=THROTTLE_DONE pgs=1465 cs=0 l=1 rx=0x7f2aec0b6250 tx=0x7f2adc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.195+0000 7f2aeb7fe700 1 -- 172.21.15.103:0/1120466043 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2adc011590 con 0x7f2aec0b9140 2020-04-22T14:15:09.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.195+0000 7f2aeb7fe700 1 -- 172.21.15.103:0/1120466043 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2adc011970 con 0x7f2aec0b9140 2020-04-22T14:15:09.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.195+0000 7f2af312e700 1 -- 172.21.15.103:0/1120466043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2aec0b9140 msgr2=0x7f2aec12b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:09.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.195+0000 7f2af312e700 1 --2- 172.21.15.103:0/1120466043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2aec0b9140 0x7f2aec12b210 secure :-1 s=READY pgs=1465 cs=0 l=1 rx=0x7f2aec0b6250 tx=0x7f2adc007a40).stop 2020-04-22T14:15:09.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.195+0000 7f2af312e700 1 -- 172.21.15.103:0/1120466043 shutdown_connections 2020-04-22T14:15:09.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.195+0000 7f2af312e700 1 --2- 172.21.15.103:0/1120466043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2aec0b9140 0x7f2aec12b210 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:09.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.195+0000 7f2af312e700 1 -- 172.21.15.103:0/1120466043 >> 172.21.15.103:0/1120466043 conn(0x7f2aec05b7b0 msgr2=0x7f2aec0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:09.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.195+0000 7f2af312e700 1 -- 172.21.15.103:0/1120466043 shutdown_connections 2020-04-22T14:15:09.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.195+0000 7f2af312e700 1 -- 172.21.15.103:0/1120466043 wait complete. 2020-04-22T14:15:09.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.196+0000 7f2af312e700 1 Processor -- start 2020-04-22T14:15:09.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.196+0000 7f2af312e700 1 -- start start 2020-04-22T14:15:09.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.197+0000 7f2af312e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2aec0ac950 0x7f2aec066580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:09.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.197+0000 7f2af312e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2aec12b670 0x7f2aec0b7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:09.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.197+0000 7f2af312e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aec062c00 con 0x7f2aec0b9140 2020-04-22T14:15:09.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.197+0000 7f2af312e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aec128620 con 0x7f2aec12b670 2020-04-22T14:15:09.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.197+0000 7f2af312e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec0b8230 con 0x7f2aec0ac950 2020-04-22T14:15:09.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.197+0000 7f2af16cb700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2aec12b670 0x7f2aec0b7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:09.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.197+0000 7f2af16cb700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2aec12b670 0x7f2aec0b7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54976/0 (socket says 172.21.15.103:54976) 2020-04-22T14:15:09.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.197+0000 7f2af16cb700 1 -- 172.21.15.103:0/253296587 learned_addr learned my addr 172.21.15.103:0/253296587 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:15:09.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.197+0000 7f2af0eca700 1 --2- 172.21.15.103:0/253296587 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2aec0ac950 0x7f2aec066580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:09.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.197+0000 7f2af16cb700 1 -- 172.21.15.103:0/253296587 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2aec0ac950 msgr2=0x7f2aec066580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:09.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.197+0000 7f2af16cb700 1 --2- 172.21.15.103:0/253296587 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2aec0ac950 0x7f2aec066580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:09.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.197+0000 7f2af16cb700 1 -- 172.21.15.103:0/253296587 >> v1:172.21.15.86:6789/0 conn(0x7f2aec0b9140 legacy=0x7f2aec145710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:09.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.197+0000 7f2af16cb700 1 -- 172.21.15.103:0/253296587 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aec127a10 con 0x7f2aec12b670 2020-04-22T14:15:09.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.197+0000 7f2af0eca700 1 --2- 172.21.15.103:0/253296587 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2aec0ac950 0x7f2aec066580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:15:09.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.197+0000 7f2af16cb700 1 --2- 172.21.15.103:0/253296587 >> v2:172.21.15.103:3300/0 conn(0x7f2aec12b670 0x7f2aec0b7dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2aec14f8f0 tx=0x7f2ae4010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.197+0000 7f2af16cb700 1 --2- 172.21.15.103:0/253296587 >> v2:172.21.15.103:3300/0 conn(0x7f2aec12b670 0x7f2aec0b7dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2aec14f8f0 tx=0x7f2ae4010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.197+0000 7f2af16cb700 1 --2- 172.21.15.103:0/253296587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2aec12b670 0x7f2aec0b7dd0 secure :-1 s=READY pgs=1466 cs=0 l=1 rx=0x7f2aec14f8f0 tx=0x7f2ae4010d20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:09.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.198+0000 7f2af16cb700 1 --2- 172.21.15.103:0/253296587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2aec12b670 0x7f2aec0b7dd0 secure :-1 s=THROTTLE_DONE pgs=1466 cs=0 l=1 rx=0x7f2aec14f8f0 tx=0x7f2ae4010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.198+0000 7f2ae9ffb700 1 -- 172.21.15.103:0/253296587 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ae4005e30 con 0x7f2aec12b670 2020-04-22T14:15:09.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.198+0000 7f2af16cb700 1 --2- 172.21.15.103:0/253296587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2aec12b670 0x7f2aec0b7dd0 secure :-1 s=THROTTLE_DONE pgs=1466 cs=0 l=1 rx=0x7f2aec14f8f0 tx=0x7f2ae4010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.198+0000 7f2af16cb700 1 --2- 172.21.15.103:0/253296587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2aec12b670 0x7f2aec0b7dd0 secure :-1 s=THROTTLE_DONE pgs=1466 cs=0 l=1 rx=0x7f2aec14f8f0 tx=0x7f2ae4010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.198+0000 7f2ae9ffb700 1 -- 172.21.15.103:0/253296587 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae4012570 con 0x7f2aec12b670 2020-04-22T14:15:09.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.198+0000 7f2af312e700 1 -- 172.21.15.103:0/253296587 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aec127ca0 con 0x7f2aec12b670 2020-04-22T14:15:09.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.198+0000 7f2ae9ffb700 1 -- 172.21.15.103:0/253296587 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ae4012990 con 0x7f2aec12b670 2020-04-22T14:15:09.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.198+0000 7f2af312e700 1 -- 172.21.15.103:0/253296587 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aec062de0 con 0x7f2aec12b670 2020-04-22T14:15:09.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.198+0000 7f2af16cb700 1 --2- 172.21.15.103:0/253296587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2aec12b670 0x7f2aec0b7dd0 secure :-1 s=THROTTLE_DONE pgs=1466 cs=0 l=1 rx=0x7f2aec14f8f0 tx=0x7f2ae4010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.199+0000 7f2af312e700 1 -- 172.21.15.103:0/253296587 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aec056c90 con 0x7f2aec12b670 2020-04-22T14:15:09.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.199+0000 7f2ae9ffb700 1 -- 172.21.15.103:0/253296587 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f2ae4012c00 con 0x7f2aec12b670 2020-04-22T14:15:09.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.199+0000 7f2af16cb700 1 --2- 172.21.15.103:0/253296587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2aec12b670 0x7f2aec0b7dd0 secure :-1 s=THROTTLE_DONE pgs=1466 cs=0 l=1 rx=0x7f2aec14f8f0 tx=0x7f2ae4010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.199+0000 7f2ae9ffb700 1 --2- 172.21.15.103:0/253296587 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2acc04d880 0x7f2acc04fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:09.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.199+0000 7f2ae9ffb700 1 -- 172.21.15.103:0/253296587 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f2ae40090c0 con 0x7f2aec12b670 2020-04-22T14:15:09.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.199+0000 7f2af0eca700 1 --2- 172.21.15.103:0/253296587 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2acc04d880 0x7f2acc04fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:09.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.199+0000 7f2af0eca700 1 --2- 172.21.15.103:0/253296587 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2acc04d880 0x7f2acc04fd40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2aec0b6250 tx=0x7f2adc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.199+0000 7f2af0eca700 1 --2- 172.21.15.103:0/253296587 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2acc04d880 0x7f2acc04fd40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2aec0b6250 tx=0x7f2adc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.199+0000 7f2af0eca700 1 --2- 172.21.15.103:0/253296587 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2acc04d880 0x7f2acc04fd40 secure :-1 s=READY pgs=532 cs=0 l=1 rx=0x7f2aec0b6250 tx=0x7f2adc007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:09.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.203+0000 7f2af16cb700 1 --2- 172.21.15.103:0/253296587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2aec12b670 0x7f2aec0b7dd0 secure :-1 s=THROTTLE_DONE pgs=1466 cs=0 l=1 rx=0x7f2aec14f8f0 tx=0x7f2ae4010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.203+0000 7f2ae9ffb700 1 -- 172.21.15.103:0/253296587 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f2ae403ce00 con 0x7f2aec12b670 2020-04-22T14:15:09.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.345+0000 7f2af312e700 1 -- 172.21.15.103:0/253296587 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2aec066ce0 con 0x7f2aec12b670 2020-04-22T14:15:09.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.346+0000 7f2af16cb700 1 --2- 172.21.15.103:0/253296587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2aec12b670 0x7f2aec0b7dd0 secure :-1 s=THROTTLE_DONE pgs=1466 cs=0 l=1 rx=0x7f2aec14f8f0 tx=0x7f2ae4010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.346+0000 7f2ae9ffb700 1 -- 172.21.15.103:0/253296587 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v96) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2ae4040420 con 0x7f2aec12b670 2020-04-22T14:15:09.348 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:15:09.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.347+0000 7f2af312e700 1 -- 172.21.15.103:0/253296587 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2acc04d880 msgr2=0x7f2acc04fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:09.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.347+0000 7f2af312e700 1 --2- 172.21.15.103:0/253296587 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2acc04d880 0x7f2acc04fd40 secure :-1 s=READY pgs=532 cs=0 l=1 rx=0x7f2aec0b6250 tx=0x7f2adc007a40).stop 2020-04-22T14:15:09.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.347+0000 7f2af312e700 1 -- 172.21.15.103:0/253296587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2aec12b670 msgr2=0x7f2aec0b7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:09.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.347+0000 7f2af312e700 1 --2- 172.21.15.103:0/253296587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2aec12b670 0x7f2aec0b7dd0 secure :-1 s=READY pgs=1466 cs=0 l=1 rx=0x7f2aec14f8f0 tx=0x7f2ae4010d20).stop 2020-04-22T14:15:09.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.347+0000 7f2af312e700 1 -- 172.21.15.103:0/253296587 shutdown_connections 2020-04-22T14:15:09.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.347+0000 7f2af312e700 1 --2- 172.21.15.103:0/253296587 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2acc04d880 0x7f2acc04fd40 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:09.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.347+0000 7f2af312e700 1 --2- 172.21.15.103:0/253296587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2aec12b670 0x7f2aec0b7dd0 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:09.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.347+0000 7f2af312e700 1 --2- 172.21.15.103:0/253296587 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2aec0ac950 0x7f2aec066580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:09.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.347+0000 7f2af312e700 1 -- 172.21.15.103:0/253296587 >> 172.21.15.103:0/253296587 conn(0x7f2aec05b7b0 msgr2=0x7f2aec0ae640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:09.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.347+0000 7f2af312e700 1 -- 172.21.15.103:0/253296587 shutdown_connections 2020-04-22T14:15:09.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.347+0000 7f2af312e700 1 -- 172.21.15.103:0/253296587 wait complete. 2020-04-22T14:15:09.365 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:09.378 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-04-22T14:15:09.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.524+0000 7f00cd653700 1 Processor -- start 2020-04-22T14:15:09.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.524+0000 7f00cd653700 1 -- start start 2020-04-22T14:15:09.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.524+0000 7f00cd653700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f00c80620a0 0x7f00c814a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:09.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.524+0000 7f00cd653700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00c8062930 0x7f00c8062da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:09.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.524+0000 7f00cd653700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00c8144a20 con 0x7f00c80ac740 2020-04-22T14:15:09.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.524+0000 7f00cd653700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00c80661d0 con 0x7f00c80620a0 2020-04-22T14:15:09.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.524+0000 7f00cd653700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c80acd70 con 0x7f00c8062930 2020-04-22T14:15:09.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.525+0000 7f00c7fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f00c80620a0 0x7f00c814a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:09.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.525+0000 7f00c7fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f00c80620a0 0x7f00c814a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54982/0 (socket says 172.21.15.103:54982) 2020-04-22T14:15:09.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.525+0000 7f00c7fff700 1 -- 172.21.15.103:0/1018843019 learned_addr learned my addr 172.21.15.103:0/1018843019 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:15:09.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.525+0000 7f00cce52700 1 --2- 172.21.15.103:0/1018843019 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00c8062930 0x7f00c8062da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:09.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.525+0000 7f00c7fff700 1 -- 172.21.15.103:0/1018843019 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00c8062930 msgr2=0x7f00c8062da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:09.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.525+0000 7f00c7fff700 1 --2- 172.21.15.103:0/1018843019 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00c8062930 0x7f00c8062da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:09.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.525+0000 7f00c7fff700 1 -- 172.21.15.103:0/1018843019 >> v1:172.21.15.86:6789/0 conn(0x7f00c80ac740 legacy=0x7f00c814ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:09.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.525+0000 7f00c7fff700 1 -- 172.21.15.103:0/1018843019 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c80ad010 con 0x7f00c80620a0 2020-04-22T14:15:09.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.525+0000 7f00cce52700 1 --2- 172.21.15.103:0/1018843019 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00c8062930 0x7f00c8062da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:15:09.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.525+0000 7f00c7fff700 1 --2- 172.21.15.103:0/1018843019 >> v2:172.21.15.103:3300/0 conn(0x7f00c80620a0 0x7f00c814a4d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f00c8062770 tx=0x7f00b8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.525+0000 7f00c7fff700 1 --2- 172.21.15.103:0/1018843019 >> v2:172.21.15.103:3300/0 conn(0x7f00c80620a0 0x7f00c814a4d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f00c8062770 tx=0x7f00b8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.525+0000 7f00c7fff700 1 --2- 172.21.15.103:0/1018843019 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00c80620a0 0x7f00c814a4d0 secure :-1 s=READY pgs=1467 cs=0 l=1 rx=0x7f00c8062770 tx=0x7f00b8007a40).ready entity=mon.1 client_cookie=ae700e8443d47e46 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:09.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.525+0000 7f00c7fff700 1 --2- 172.21.15.103:0/1018843019 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00c80620a0 0x7f00c814a4d0 secure :-1 s=THROTTLE_DONE pgs=1467 cs=0 l=1 rx=0x7f00c8062770 tx=0x7f00b8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.525+0000 7f00c77fe700 1 -- 172.21.15.103:0/1018843019 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00b80116e0 con 0x7f00c80620a0 2020-04-22T14:15:09.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.525+0000 7f00c7fff700 1 --2- 172.21.15.103:0/1018843019 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00c80620a0 0x7f00c814a4d0 secure :-1 s=THROTTLE_DONE pgs=1467 cs=0 l=1 rx=0x7f00c8062770 tx=0x7f00b8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.525+0000 7f00c7fff700 1 --2- 172.21.15.103:0/1018843019 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00c80620a0 0x7f00c814a4d0 secure :-1 s=THROTTLE_DONE pgs=1467 cs=0 l=1 rx=0x7f00c8062770 tx=0x7f00b8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.525+0000 7f00c77fe700 1 -- 172.21.15.103:0/1018843019 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b8011840 con 0x7f00c80620a0 2020-04-22T14:15:09.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.525+0000 7f00c77fe700 1 -- 172.21.15.103:0/1018843019 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00b8011c60 con 0x7f00c80620a0 2020-04-22T14:15:09.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.525+0000 7f00cd653700 1 -- 172.21.15.103:0/1018843019 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00c80620a0 msgr2=0x7f00c814a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:09.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.525+0000 7f00cd653700 1 --2- 172.21.15.103:0/1018843019 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00c80620a0 0x7f00c814a4d0 secure :-1 s=READY pgs=1467 cs=0 l=1 rx=0x7f00c8062770 tx=0x7f00b8007a40).stop 2020-04-22T14:15:09.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.526+0000 7f00cd653700 1 -- 172.21.15.103:0/1018843019 shutdown_connections 2020-04-22T14:15:09.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.526+0000 7f00cd653700 1 --2- 172.21.15.103:0/1018843019 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00c8062930 0x7f00c8062da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:09.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.526+0000 7f00cd653700 1 --2- 172.21.15.103:0/1018843019 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00c80620a0 0x7f00c814a4d0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:09.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.526+0000 7f00cd653700 1 -- 172.21.15.103:0/1018843019 >> 172.21.15.103:0/1018843019 conn(0x7f00c805b7c0 msgr2=0x7f00c8061610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:09.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.526+0000 7f00cd653700 1 -- 172.21.15.103:0/1018843019 shutdown_connections 2020-04-22T14:15:09.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.526+0000 7f00cd653700 1 -- 172.21.15.103:0/1018843019 wait complete. 2020-04-22T14:15:09.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.527+0000 7f00cd653700 1 Processor -- start 2020-04-22T14:15:09.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.527+0000 7f00cd653700 1 -- start start 2020-04-22T14:15:09.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.527+0000 7f00cd653700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f00c80620a0 0x7f00c814cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:09.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.528+0000 7f00cd653700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00c80ac740 0x7f00c80b6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:09.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.528+0000 7f00cd653700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00c80b7070 con 0x7f00c8062930 2020-04-22T14:15:09.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.528+0000 7f00cd653700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00c8158320 con 0x7f00c80620a0 2020-04-22T14:15:09.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.528+0000 7f00cd653700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c81493a0 con 0x7f00c80ac740 2020-04-22T14:15:09.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.528+0000 7f00c7fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f00c80620a0 0x7f00c814cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:09.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.528+0000 7f00c7fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f00c80620a0 0x7f00c814cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:52220/0 (socket says 172.21.15.103:52220) 2020-04-22T14:15:09.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.528+0000 7f00cce52700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00c80ac740 0x7f00c80b6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:09.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.528+0000 7f00c7fff700 1 -- 172.21.15.103:0/1705959089 learned_addr learned my addr 172.21.15.103:0/1705959089 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:15:09.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.528+0000 7f00bffff700 1 --1- 172.21.15.103:0/1705959089 >> v1:172.21.15.86:6789/0 conn(0x7f00c8062930 0x7f00c8130cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:36102/0 (socket says 172.21.15.103:36102) 2020-04-22T14:15:09.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.528+0000 7f00cce52700 1 -- 172.21.15.103:0/1705959089 >> v2:172.21.15.86:3300/0 conn(0x7f00c80620a0 msgr2=0x7f00c814cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:09.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.528+0000 7f00cce52700 1 --2- 172.21.15.103:0/1705959089 >> v2:172.21.15.86:3300/0 conn(0x7f00c80620a0 0x7f00c814cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:09.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.528+0000 7f00cce52700 1 -- 172.21.15.103:0/1705959089 >> v1:172.21.15.86:6789/0 conn(0x7f00c8062930 legacy=0x7f00c8130cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:09.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.528+0000 7f00cce52700 1 -- 172.21.15.103:0/1705959089 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c8149600 con 0x7f00c80ac740 2020-04-22T14:15:09.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.528+0000 7f00c5ffb700 1 -- 172.21.15.103:0/1705959089 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2149301746 0 0) 0x7f00b00020c0 con 0x7f00c8062930 2020-04-22T14:15:09.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.528+0000 7f00c7fff700 1 --2- 172.21.15.103:0/1705959089 >> v2:172.21.15.86:3300/0 conn(0x7f00c80620a0 0x7f00c814cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:15:09.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.528+0000 7f00cce52700 1 --2- 172.21.15.103:0/1705959089 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00c80ac740 0x7f00c80b6c10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f00c00032b0 tx=0x7f00c0010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.528+0000 7f00cce52700 1 --2- 172.21.15.103:0/1705959089 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00c80ac740 0x7f00c80b6c10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f00c00032b0 tx=0x7f00c0010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.528+0000 7f00cce52700 1 --2- 172.21.15.103:0/1705959089 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00c80ac740 0x7f00c80b6c10 secure :-1 s=READY pgs=139 cs=0 l=1 rx=0x7f00c00032b0 tx=0x7f00c0010d40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:09.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.528+0000 7f00cce52700 1 --2- 172.21.15.103:0/1705959089 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00c80ac740 0x7f00c80b6c10 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f00c00032b0 tx=0x7f00c0010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.528+0000 7f00c5ffb700 1 -- 172.21.15.103:0/1705959089 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00c0012b70 con 0x7f00c80ac740 2020-04-22T14:15:09.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.528+0000 7f00cce52700 1 --2- 172.21.15.103:0/1705959089 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00c80ac740 0x7f00c80b6c10 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f00c00032b0 tx=0x7f00c0010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.528+0000 7f00cce52700 1 --2- 172.21.15.103:0/1705959089 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00c80ac740 0x7f00c80b6c10 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f00c00032b0 tx=0x7f00c0010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.528+0000 7f00c5ffb700 1 -- 172.21.15.103:0/1705959089 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c0012d10 con 0x7f00c80ac740 2020-04-22T14:15:09.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.528+0000 7f00cd653700 1 -- 172.21.15.103:0/1705959089 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00c8148fc0 con 0x7f00c80ac740 2020-04-22T14:15:09.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.529+0000 7f00c5ffb700 1 -- 172.21.15.103:0/1705959089 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00c00093b0 con 0x7f00c80ac740 2020-04-22T14:15:09.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.529+0000 7f00cd653700 1 -- 172.21.15.103:0/1705959089 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00c8131480 con 0x7f00c80ac740 2020-04-22T14:15:09.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.529+0000 7f00cce52700 1 --2- 172.21.15.103:0/1705959089 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00c80ac740 0x7f00c80b6c10 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f00c00032b0 tx=0x7f00c0010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.529+0000 7f00cd653700 1 -- 172.21.15.103:0/1705959089 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00a0003340 con 0x7f00c80ac740 2020-04-22T14:15:09.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.530+0000 7f00c5ffb700 1 -- 172.21.15.103:0/1705959089 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f00c0010190 con 0x7f00c80ac740 2020-04-22T14:15:09.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.530+0000 7f00cce52700 1 --2- 172.21.15.103:0/1705959089 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00c80ac740 0x7f00c80b6c10 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f00c00032b0 tx=0x7f00c0010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.530+0000 7f00c5ffb700 1 --2- 172.21.15.103:0/1705959089 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f00ac04d840 0x7f00ac04fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:09.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.530+0000 7f00c5ffb700 1 -- 172.21.15.103:0/1705959089 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f00c00616d0 con 0x7f00c80ac740 2020-04-22T14:15:09.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.530+0000 7f00c7fff700 1 --2- 172.21.15.103:0/1705959089 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f00ac04d840 0x7f00ac04fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:09.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.530+0000 7f00c7fff700 1 --2- 172.21.15.103:0/1705959089 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f00ac04d840 0x7f00ac04fd00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f00c8062770 tx=0x7f00b8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.530+0000 7f00c7fff700 1 --2- 172.21.15.103:0/1705959089 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f00ac04d840 0x7f00ac04fd00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f00c8062770 tx=0x7f00b8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.530+0000 7f00c7fff700 1 --2- 172.21.15.103:0/1705959089 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f00ac04d840 0x7f00ac04fd00 secure :-1 s=READY pgs=533 cs=0 l=1 rx=0x7f00c8062770 tx=0x7f00b8007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:09.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.534+0000 7f00cce52700 1 --2- 172.21.15.103:0/1705959089 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00c80ac740 0x7f00c80b6c10 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f00c00032b0 tx=0x7f00c0010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.534+0000 7f00c5ffb700 1 -- 172.21.15.103:0/1705959089 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f00c003ca50 con 0x7f00c80ac740 2020-04-22T14:15:09.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.679+0000 7f00cd653700 1 -- 172.21.15.103:0/1705959089 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f00a00021d0 con 0x7f00c80ac740 2020-04-22T14:15:09.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.679+0000 7f00cce52700 1 --2- 172.21.15.103:0/1705959089 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00c80ac740 0x7f00c80b6c10 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f00c00032b0 tx=0x7f00c0010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.679+0000 7f00c5ffb700 1 -- 172.21.15.103:0/1705959089 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v96) v1 ==== 84+0+143 (secure 0 0 0) 0x7f00c0040070 con 0x7f00c80ac740 2020-04-22T14:15:09.682 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:15:09.682 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2020-04-22T14:15:09.682 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:09.682 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 1, 2020-04-22T14:15:09.682 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": "device_health_metrics" 2020-04-22T14:15:09.683 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:09.683 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:09.683 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 2, 2020-04-22T14:15:09.683 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": "rbd" 2020-04-22T14:15:09.683 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:09.683 INFO:teuthology.orchestra.run.smithi103.stdout:] 2020-04-22T14:15:09.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.681+0000 7f00cd653700 1 -- 172.21.15.103:0/1705959089 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f00ac04d840 msgr2=0x7f00ac04fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:09.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.681+0000 7f00cd653700 1 --2- 172.21.15.103:0/1705959089 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f00ac04d840 0x7f00ac04fd00 secure :-1 s=READY pgs=533 cs=0 l=1 rx=0x7f00c8062770 tx=0x7f00b8007a40).stop 2020-04-22T14:15:09.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.681+0000 7f00cd653700 1 -- 172.21.15.103:0/1705959089 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00c80ac740 msgr2=0x7f00c80b6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:09.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.681+0000 7f00cd653700 1 --2- 172.21.15.103:0/1705959089 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00c80ac740 0x7f00c80b6c10 secure :-1 s=READY pgs=139 cs=0 l=1 rx=0x7f00c00032b0 tx=0x7f00c0010d40).stop 2020-04-22T14:15:09.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.681+0000 7f00cd653700 1 -- 172.21.15.103:0/1705959089 shutdown_connections 2020-04-22T14:15:09.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.681+0000 7f00cd653700 1 --2- 172.21.15.103:0/1705959089 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00c80ac740 0x7f00c80b6c10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:09.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.681+0000 7f00cd653700 1 --2- 172.21.15.103:0/1705959089 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f00ac04d840 0x7f00ac04fd00 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:09.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.681+0000 7f00cd653700 1 --2- 172.21.15.103:0/1705959089 >> v2:172.21.15.86:3300/0 conn(0x7f00c80620a0 0x7f00c814cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:09.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.681+0000 7f00cd653700 1 -- 172.21.15.103:0/1705959089 >> 172.21.15.103:0/1705959089 conn(0x7f00c805b7c0 msgr2=0x7f00c81450e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:09.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.681+0000 7f00cd653700 1 -- 172.21.15.103:0/1705959089 shutdown_connections 2020-04-22T14:15:09.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.681+0000 7f00cd653700 1 -- 172.21.15.103:0/1705959089 wait complete. 2020-04-22T14:15:09.693 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-04-22T14:15:09.698 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:09.711 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-04-22T14:15:09.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.858+0000 7f333aff1700 1 Processor -- start 2020-04-22T14:15:09.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.858+0000 7f333aff1700 1 -- start start 2020-04-22T14:15:09.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.859+0000 7f333aff1700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3334061a30 0x7f33340b4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:09.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.859+0000 7f333aff1700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f33340acb10 0x7f33340ae920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:09.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.859+0000 7f333aff1700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3334060250 con 0x7f33340aed80 2020-04-22T14:15:09.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.859+0000 7f333aff1700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33340623c0 con 0x7f3334061a30 2020-04-22T14:15:09.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.859+0000 7f333aff1700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3334062660 con 0x7f33340acb10 2020-04-22T14:15:09.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.859+0000 7f333958e700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f33340aed80 0x7f33340b3050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47186/0 (socket says 172.21.15.103:47186) 2020-04-22T14:15:09.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.859+0000 7f333958e700 1 -- 172.21.15.103:0/205959810 learned_addr learned my addr 172.21.15.103:0/205959810 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:09.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.859+0000 7f3338d8d700 1 --2- 172.21.15.103:0/205959810 >> v2:172.21.15.86:3300/0 conn(0x7f3334061a30 0x7f33340b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:09.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.859+0000 7f3333fff700 1 --2- 172.21.15.103:0/205959810 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f33340acb10 0x7f33340ae920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:09.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.859+0000 7f33337fe700 1 -- 172.21.15.103:0/205959810 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1534350201 0 0) 0x7f3334060250 con 0x7f33340aed80 2020-04-22T14:15:09.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.859+0000 7f33337fe700 1 -- 172.21.15.103:0/205959810 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3320003230 con 0x7f33340aed80 2020-04-22T14:15:09.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.859+0000 7f33337fe700 1 -- 172.21.15.103:0/205959810 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3616407790 0 0) 0x7f3320003230 con 0x7f33340aed80 2020-04-22T14:15:09.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.859+0000 7f33337fe700 1 -- 172.21.15.103:0/205959810 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f33340acb10 msgr2=0x7f33340ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:09.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.859+0000 7f33337fe700 1 --2- 172.21.15.103:0/205959810 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f33340acb10 0x7f33340ae920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:09.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.859+0000 7f33337fe700 1 -- 172.21.15.103:0/205959810 >> v2:172.21.15.86:3300/0 conn(0x7f3334061a30 msgr2=0x7f33340b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:09.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.859+0000 7f33337fe700 1 --2- 172.21.15.103:0/205959810 >> v2:172.21.15.86:3300/0 conn(0x7f3334061a30 0x7f33340b4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:09.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.859+0000 7f33337fe700 1 -- 172.21.15.103:0/205959810 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3334061e10 con 0x7f33340aed80 2020-04-22T14:15:09.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.859+0000 7f33337fe700 1 -- 172.21.15.103:0/205959810 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f332c001a50 con 0x7f33340aed80 2020-04-22T14:15:09.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.859+0000 7f33337fe700 1 -- 172.21.15.103:0/205959810 >> v1:172.21.15.103:6789/0 conn(0x7f33340aed80 legacy=0x7f33340b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:09.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.859+0000 7f33337fe700 1 --2- 172.21.15.103:0/205959810 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3320003720 0x7f3320003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:09.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.859+0000 7f33337fe700 1 --2- 172.21.15.103:0/205959810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3320004060 0x7f3320004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:09.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.859+0000 7f33337fe700 1 --2- 172.21.15.103:0/205959810 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f33340acb10 0x7f3320004ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:09.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.859+0000 7f33337fe700 1 -- 172.21.15.103:0/205959810 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33340623c0 con 0x7f3320003720 2020-04-22T14:15:09.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.859+0000 7f33337fe700 1 -- 172.21.15.103:0/205959810 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3334062660 con 0x7f3320004060 2020-04-22T14:15:09.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.859+0000 7f33337fe700 1 -- 172.21.15.103:0/205959810 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3320004ff0 con 0x7f33340acb10 2020-04-22T14:15:09.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.860+0000 7f3333fff700 1 --2- 172.21.15.103:0/205959810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3320004060 0x7f3320004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:09.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.860+0000 7f333958e700 1 --2- 172.21.15.103:0/205959810 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f33340acb10 0x7f3320004ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:09.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.860+0000 7f3338d8d700 1 --2- 172.21.15.103:0/205959810 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3320003720 0x7f3320003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:09.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.860+0000 7f3333fff700 1 -- 172.21.15.103:0/205959810 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f33340acb10 msgr2=0x7f3320004ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:09.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.860+0000 7f3333fff700 1 --2- 172.21.15.103:0/205959810 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f33340acb10 0x7f3320004ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:09.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.860+0000 7f3333fff700 1 -- 172.21.15.103:0/205959810 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3320003720 msgr2=0x7f3320003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:09.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.860+0000 7f3333fff700 1 --2- 172.21.15.103:0/205959810 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3320003720 0x7f3320003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:09.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.860+0000 7f3333fff700 1 -- 172.21.15.103:0/205959810 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3320003230 con 0x7f3320004060 2020-04-22T14:15:09.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.860+0000 7f3333fff700 1 --2- 172.21.15.103:0/205959810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3320004060 0x7f3320004530 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3328008910 tx=0x7f3328010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.860+0000 7f3333fff700 1 --2- 172.21.15.103:0/205959810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3320004060 0x7f3320004530 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3328008910 tx=0x7f3328010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.860+0000 7f3333fff700 1 --2- 172.21.15.103:0/205959810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3320004060 0x7f3320004530 secure :-1 s=READY pgs=1469 cs=0 l=1 rx=0x7f3328008910 tx=0x7f3328010050).ready entity=mon.1 client_cookie=424be78f017066f0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:09.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.860+0000 7f3333fff700 1 --2- 172.21.15.103:0/205959810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3320004060 0x7f3320004530 secure :-1 s=THROTTLE_DONE pgs=1469 cs=0 l=1 rx=0x7f3328008910 tx=0x7f3328010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.860+0000 7f33337fe700 1 -- 172.21.15.103:0/205959810 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3328008d30 con 0x7f3320004060 2020-04-22T14:15:09.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.860+0000 7f3333fff700 1 --2- 172.21.15.103:0/205959810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3320004060 0x7f3320004530 secure :-1 s=THROTTLE_DONE pgs=1469 cs=0 l=1 rx=0x7f3328008910 tx=0x7f3328010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.860+0000 7f3333fff700 1 --2- 172.21.15.103:0/205959810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3320004060 0x7f3320004530 secure :-1 s=THROTTLE_DONE pgs=1469 cs=0 l=1 rx=0x7f3328008910 tx=0x7f3328010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.860+0000 7f33337fe700 1 -- 172.21.15.103:0/205959810 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3328008e90 con 0x7f3320004060 2020-04-22T14:15:09.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.860+0000 7f33337fe700 1 -- 172.21.15.103:0/205959810 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3328010a80 con 0x7f3320004060 2020-04-22T14:15:09.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.860+0000 7f333aff1700 1 -- 172.21.15.103:0/205959810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3320004060 msgr2=0x7f3320004530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:09.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.860+0000 7f333aff1700 1 --2- 172.21.15.103:0/205959810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3320004060 0x7f3320004530 secure :-1 s=READY pgs=1469 cs=0 l=1 rx=0x7f3328008910 tx=0x7f3328010050).stop 2020-04-22T14:15:09.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.860+0000 7f333958e700 1 -- 172.21.15.103:0/205959810 reap_dead start 2020-04-22T14:15:09.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.860+0000 7f333aff1700 1 -- 172.21.15.103:0/205959810 shutdown_connections 2020-04-22T14:15:09.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.860+0000 7f333aff1700 1 -- 172.21.15.103:0/205959810 >> 172.21.15.103:0/205959810 conn(0x7f333405b7b0 msgr2=0x7f33340b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:09.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.861+0000 7f333aff1700 1 -- 172.21.15.103:0/205959810 shutdown_connections 2020-04-22T14:15:09.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.861+0000 7f333aff1700 1 -- 172.21.15.103:0/205959810 wait complete. 2020-04-22T14:15:09.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.861+0000 7f333aff1700 1 Processor -- start 2020-04-22T14:15:09.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.861+0000 7f333aff1700 1 -- start start 2020-04-22T14:15:09.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.862+0000 7f333aff1700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3334064d40 0x7f3334062860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:09.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.862+0000 7f333aff1700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f33340653b0 0x7f333413b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:09.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.862+0000 7f333aff1700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33340663e0 con 0x7f3334065830 2020-04-22T14:15:09.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.862+0000 7f333aff1700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3334066680 con 0x7f33340653b0 2020-04-22T14:15:09.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.862+0000 7f333aff1700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3334065120 con 0x7f3334064d40 2020-04-22T14:15:09.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.862+0000 7f3338d8d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3334064d40 0x7f3334062860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:09.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.862+0000 7f3338d8d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3334064d40 0x7f3334062860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:39784/0 (socket says 172.21.15.103:39784) 2020-04-22T14:15:09.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.862+0000 7f3333fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f33340653b0 0x7f333413b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:09.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.862+0000 7f3338d8d700 1 -- 172.21.15.103:0/2181421011 learned_addr learned my addr 172.21.15.103:0/2181421011 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:15:09.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.863+0000 7f3338d8d700 1 -- 172.21.15.103:0/2181421011 >> v2:172.21.15.86:3300/0 conn(0x7f33340653b0 msgr2=0x7f333413b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:09.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.863+0000 7f3338d8d700 1 --2- 172.21.15.103:0/2181421011 >> v2:172.21.15.86:3300/0 conn(0x7f33340653b0 0x7f333413b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:09.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.863+0000 7f3338d8d700 1 -- 172.21.15.103:0/2181421011 >> v1:172.21.15.86:6789/0 conn(0x7f3334065830 legacy=0x7f3334141b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:09.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.863+0000 7f3338d8d700 1 -- 172.21.15.103:0/2181421011 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33340b1290 con 0x7f3334064d40 2020-04-22T14:15:09.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.863+0000 7f3338d8d700 1 --2- 172.21.15.103:0/2181421011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3334064d40 0x7f3334062860 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3324002f30 tx=0x7f332400c380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.863+0000 7f3338d8d700 1 --2- 172.21.15.103:0/2181421011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3334064d40 0x7f3334062860 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3324002f30 tx=0x7f332400c380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.863+0000 7f3338d8d700 1 --2- 172.21.15.103:0/2181421011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3334064d40 0x7f3334062860 secure :-1 s=READY pgs=140 cs=0 l=1 rx=0x7f3324002f30 tx=0x7f332400c380).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:09.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.863+0000 7f3338d8d700 1 --2- 172.21.15.103:0/2181421011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3334064d40 0x7f3334062860 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7f3324002f30 tx=0x7f332400c380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.863+0000 7f3331ffb700 1 -- 172.21.15.103:0/2181421011 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3324005e90 con 0x7f3334064d40 2020-04-22T14:15:09.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.863+0000 7f3338d8d700 1 --2- 172.21.15.103:0/2181421011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3334064d40 0x7f3334062860 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7f3324002f30 tx=0x7f332400c380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.863+0000 7f3338d8d700 1 --2- 172.21.15.103:0/2181421011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3334064d40 0x7f3334062860 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7f3324002f30 tx=0x7f332400c380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.863+0000 7f3331ffb700 1 -- 172.21.15.103:0/2181421011 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3324007180 con 0x7f3334064d40 2020-04-22T14:15:09.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.863+0000 7f333aff1700 1 -- 172.21.15.103:0/2181421011 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33340b2630 con 0x7f3334064d40 2020-04-22T14:15:09.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.863+0000 7f3331ffb700 1 -- 172.21.15.103:0/2181421011 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3324007560 con 0x7f3334064d40 2020-04-22T14:15:09.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.863+0000 7f333aff1700 1 -- 172.21.15.103:0/2181421011 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33341424d0 con 0x7f3334064d40 2020-04-22T14:15:09.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.864+0000 7f3338d8d700 1 --2- 172.21.15.103:0/2181421011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3334064d40 0x7f3334062860 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7f3324002f30 tx=0x7f332400c380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.864+0000 7f3331ffb700 1 -- 172.21.15.103:0/2181421011 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f3324009490 con 0x7f3334064d40 2020-04-22T14:15:09.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.864+0000 7f3338d8d700 1 --2- 172.21.15.103:0/2181421011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3334064d40 0x7f3334062860 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7f3324002f30 tx=0x7f332400c380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.864+0000 7f333aff1700 1 -- 172.21.15.103:0/2181421011 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3334066240 con 0x7f3334064d40 2020-04-22T14:15:09.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.864+0000 7f3331ffb700 1 --2- 172.21.15.103:0/2181421011 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f331404d9d0 0x7f331404fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:09.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.864+0000 7f3331ffb700 1 -- 172.21.15.103:0/2181421011 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f3324061510 con 0x7f3334064d40 2020-04-22T14:15:09.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.865+0000 7f3333fff700 1 --2- 172.21.15.103:0/2181421011 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f331404d9d0 0x7f331404fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:09.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.865+0000 7f3333fff700 1 --2- 172.21.15.103:0/2181421011 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f331404d9d0 0x7f331404fe90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3328008910 tx=0x7f3328010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.865+0000 7f3333fff700 1 --2- 172.21.15.103:0/2181421011 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f331404d9d0 0x7f331404fe90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3328008910 tx=0x7f3328010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.865+0000 7f3333fff700 1 --2- 172.21.15.103:0/2181421011 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f331404d9d0 0x7f331404fe90 secure :-1 s=READY pgs=534 cs=0 l=1 rx=0x7f3328008910 tx=0x7f3328010050).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:09.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.868+0000 7f3338d8d700 1 --2- 172.21.15.103:0/2181421011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3334064d40 0x7f3334062860 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7f3324002f30 tx=0x7f332400c380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:09.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:09.868+0000 7f3331ffb700 1 -- 172.21.15.103:0/2181421011 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f3334066240 con 0x7f3334064d40 2020-04-22T14:15:10.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.009+0000 7f333aff1700 1 -- 172.21.15.103:0/2181421011 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f33340b1420 con 0x7f3334064d40 2020-04-22T14:15:10.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.698+0000 7f3338d8d700 1 --2- 172.21.15.103:0/2181421011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3334064d40 0x7f3334062860 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7f3324002f30 tx=0x7f332400c380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:10.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.698+0000 7f3331ffb700 1 -- 172.21.15.103:0/2181421011 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v97) v1 ==== 133+0+0 (secure 0 0 0) 0x7f332403c8f0 con 0x7f3334064d40 2020-04-22T14:15:10.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.701+0000 7f333aff1700 1 -- 172.21.15.103:0/2181421011 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f331404d9d0 msgr2=0x7f331404fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:10.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.701+0000 7f333aff1700 1 --2- 172.21.15.103:0/2181421011 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f331404d9d0 0x7f331404fe90 secure :-1 s=READY pgs=534 cs=0 l=1 rx=0x7f3328008910 tx=0x7f3328010050).stop 2020-04-22T14:15:10.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.701+0000 7f333aff1700 1 -- 172.21.15.103:0/2181421011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3334064d40 msgr2=0x7f3334062860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:10.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.701+0000 7f333aff1700 1 --2- 172.21.15.103:0/2181421011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3334064d40 0x7f3334062860 secure :-1 s=READY pgs=140 cs=0 l=1 rx=0x7f3324002f30 tx=0x7f332400c380).stop 2020-04-22T14:15:10.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.701+0000 7f333aff1700 1 -- 172.21.15.103:0/2181421011 shutdown_connections 2020-04-22T14:15:10.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.701+0000 7f333aff1700 1 --2- 172.21.15.103:0/2181421011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3334064d40 0x7f3334062860 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:10.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.701+0000 7f333aff1700 1 --2- 172.21.15.103:0/2181421011 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f331404d9d0 0x7f331404fe90 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:10.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.701+0000 7f333aff1700 1 --2- 172.21.15.103:0/2181421011 >> v2:172.21.15.86:3300/0 conn(0x7f33340653b0 0x7f333413b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:10.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.701+0000 7f333aff1700 1 -- 172.21.15.103:0/2181421011 >> 172.21.15.103:0/2181421011 conn(0x7f333405b7b0 msgr2=0x7f3334145060 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:10.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.702+0000 7f333aff1700 1 -- 172.21.15.103:0/2181421011 shutdown_connections 2020-04-22T14:15:10.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.702+0000 7f333aff1700 1 -- 172.21.15.103:0/2181421011 wait complete. 2020-04-22T14:15:10.705 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' created 2020-04-22T14:15:10.715 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:10.729 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-04-22T14:15:10.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.879+0000 7f6c86473700 1 Processor -- start 2020-04-22T14:15:10.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.879+0000 7f6c86473700 1 -- start start 2020-04-22T14:15:10.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.879+0000 7f6c86473700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6c800b7c20 0x7f6c800643b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:10.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.879+0000 7f6c86473700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c800b7240 con 0x7f6c80147b60 2020-04-22T14:15:10.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.879+0000 7f6c86473700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c800b74e0 con 0x7f6c80065d30 2020-04-22T14:15:10.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.879+0000 7f6c86473700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c800b7780 con 0x7f6c800b7c20 2020-04-22T14:15:10.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.880+0000 7f6c84a10700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f6c80065d30 0x7f6c80066180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47204/0 (socket says 172.21.15.103:47204) 2020-04-22T14:15:10.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.880+0000 7f6c84a10700 1 -- 172.21.15.103:0/1894367221 learned_addr learned my addr 172.21.15.103:0/1894367221 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:10.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.880+0000 7f6c7f7fe700 1 -- 172.21.15.103:0/1894367221 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3493179482 0 0) 0x7f6c800b74e0 con 0x7f6c80065d30 2020-04-22T14:15:10.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.880+0000 7f6c7f7fe700 1 -- 172.21.15.103:0/1894367221 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c60003230 con 0x7f6c80065d30 2020-04-22T14:15:10.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.880+0000 7f6c77fff700 1 --2- 172.21.15.103:0/1894367221 >> v2:172.21.15.86:3300/0 conn(0x7f6c800b7c20 0x7f6c800643b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:10.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.880+0000 7f6c7f7fe700 1 -- 172.21.15.103:0/1894367221 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1230470963 0 0) 0x7f6c60003230 con 0x7f6c80065d30 2020-04-22T14:15:10.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.880+0000 7f6c7f7fe700 1 -- 172.21.15.103:0/1894367221 >> v2:172.21.15.86:3300/0 conn(0x7f6c800b7c20 msgr2=0x7f6c800643b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:10.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.880+0000 7f6c7f7fe700 1 --2- 172.21.15.103:0/1894367221 >> v2:172.21.15.86:3300/0 conn(0x7f6c800b7c20 0x7f6c800643b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:10.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.880+0000 7f6c7f7fe700 1 -- 172.21.15.103:0/1894367221 >> v1:172.21.15.86:6789/0 conn(0x7f6c80147b60 legacy=0x7f6c80141320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:10.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.880+0000 7f6c7f7fe700 1 -- 172.21.15.103:0/1894367221 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c80064810 con 0x7f6c80065d30 2020-04-22T14:15:10.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.880+0000 7f6c7f7fe700 1 -- 172.21.15.103:0/1894367221 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f6c78001a50 con 0x7f6c80065d30 2020-04-22T14:15:10.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.880+0000 7f6c7f7fe700 1 -- 172.21.15.103:0/1894367221 >> v1:172.21.15.103:6789/0 conn(0x7f6c80065d30 legacy=0x7f6c80066180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:10.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.880+0000 7f6c7f7fe700 1 --2- 172.21.15.103:0/1894367221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c60003770 0x7f6c60003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:10.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.880+0000 7f6c7f7fe700 1 --2- 172.21.15.103:0/1894367221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c600044d0 0x7f6c60004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:10.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.880+0000 7f6c7f7fe700 1 --2- 172.21.15.103:0/1894367221 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6c60004db0 0x7f6c6000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:10.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.880+0000 7f6c7f7fe700 1 -- 172.21.15.103:0/1894367221 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c800b7780 con 0x7f6c60003770 2020-04-22T14:15:10.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.880+0000 7f6c7f7fe700 1 -- 172.21.15.103:0/1894367221 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c60005260 con 0x7f6c600044d0 2020-04-22T14:15:10.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.880+0000 7f6c7f7fe700 1 -- 172.21.15.103:0/1894367221 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6000bb80 con 0x7f6c60004db0 2020-04-22T14:15:10.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.880+0000 7f6c77fff700 1 --2- 172.21.15.103:0/1894367221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c600044d0 0x7f6c60004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:10.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.880+0000 7f6c7ffff700 1 --2- 172.21.15.103:0/1894367221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c60003770 0x7f6c60003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:10.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.880+0000 7f6c84a10700 1 --2- 172.21.15.103:0/1894367221 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6c60004db0 0x7f6c6000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:10.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.881+0000 7f6c77fff700 1 -- 172.21.15.103:0/1894367221 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6c60004db0 msgr2=0x7f6c6000b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:10.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.881+0000 7f6c77fff700 1 --2- 172.21.15.103:0/1894367221 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6c60004db0 0x7f6c6000b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:10.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.881+0000 7f6c77fff700 1 -- 172.21.15.103:0/1894367221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c60003770 msgr2=0x7f6c60003b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:10.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.881+0000 7f6c77fff700 1 --2- 172.21.15.103:0/1894367221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c60003770 0x7f6c60003b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:10.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.881+0000 7f6c77fff700 1 -- 172.21.15.103:0/1894367221 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c60003230 con 0x7f6c600044d0 2020-04-22T14:15:10.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.881+0000 7f6c84a10700 1 --2- 172.21.15.103:0/1894367221 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6c60004db0 0x7f6c6000b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:15:10.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.881+0000 7f6c84a10700 1 -- 172.21.15.103:0/1894367221 reap_dead start 2020-04-22T14:15:10.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.881+0000 7f6c77fff700 1 --2- 172.21.15.103:0/1894367221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c600044d0 0x7f6c60004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6c68008910 tx=0x7f6c68010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:10.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.881+0000 7f6c77fff700 1 --2- 172.21.15.103:0/1894367221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c600044d0 0x7f6c60004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6c68008910 tx=0x7f6c68010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:10.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.881+0000 7f6c77fff700 1 --2- 172.21.15.103:0/1894367221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c600044d0 0x7f6c60004950 secure :-1 s=READY pgs=1471 cs=0 l=1 rx=0x7f6c68008910 tx=0x7f6c68010050).ready entity=mon.1 client_cookie=a0fbcd1062bb28f1 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:10.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.881+0000 7f6c77fff700 1 --2- 172.21.15.103:0/1894367221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c600044d0 0x7f6c60004950 secure :-1 s=THROTTLE_DONE pgs=1471 cs=0 l=1 rx=0x7f6c68008910 tx=0x7f6c68010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:10.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.881+0000 7f6c77fff700 1 --2- 172.21.15.103:0/1894367221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c600044d0 0x7f6c60004950 secure :-1 s=THROTTLE_DONE pgs=1471 cs=0 l=1 rx=0x7f6c68008910 tx=0x7f6c68010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:10.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.881+0000 7f6c7f7fe700 1 -- 172.21.15.103:0/1894367221 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c68008d30 con 0x7f6c600044d0 2020-04-22T14:15:10.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.881+0000 7f6c77fff700 1 --2- 172.21.15.103:0/1894367221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c600044d0 0x7f6c60004950 secure :-1 s=THROTTLE_DONE pgs=1471 cs=0 l=1 rx=0x7f6c68008910 tx=0x7f6c68010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:10.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.881+0000 7f6c7f7fe700 1 -- 172.21.15.103:0/1894367221 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c68008e90 con 0x7f6c600044d0 2020-04-22T14:15:10.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.881+0000 7f6c7f7fe700 1 -- 172.21.15.103:0/1894367221 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c68010b30 con 0x7f6c600044d0 2020-04-22T14:15:10.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.881+0000 7f6c86473700 1 -- 172.21.15.103:0/1894367221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c600044d0 msgr2=0x7f6c60004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:10.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.881+0000 7f6c86473700 1 --2- 172.21.15.103:0/1894367221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c600044d0 0x7f6c60004950 secure :-1 s=READY pgs=1471 cs=0 l=1 rx=0x7f6c68008910 tx=0x7f6c68010050).stop 2020-04-22T14:15:10.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.881+0000 7f6c86473700 1 -- 172.21.15.103:0/1894367221 shutdown_connections 2020-04-22T14:15:10.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.881+0000 7f6c86473700 1 --2- 172.21.15.103:0/1894367221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c600044d0 0x7f6c60004950 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:10.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.881+0000 7f6c86473700 1 -- 172.21.15.103:0/1894367221 >> 172.21.15.103:0/1894367221 conn(0x7f6c8005ad30 msgr2=0x7f6c8005b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:10.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.881+0000 7f6c86473700 1 -- 172.21.15.103:0/1894367221 shutdown_connections 2020-04-22T14:15:10.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.881+0000 7f6c86473700 1 -- 172.21.15.103:0/1894367221 wait complete. 2020-04-22T14:15:10.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.882+0000 7f6c86473700 1 Processor -- start 2020-04-22T14:15:10.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.882+0000 7f6c86473700 1 -- start start 2020-04-22T14:15:10.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.883+0000 7f6c86473700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6c80127680 0x7f6c800b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:10.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.883+0000 7f6c86473700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c801550f0 con 0x7f6c80154c50 2020-04-22T14:15:10.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.883+0000 7f6c86473700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c80155390 con 0x7f6c600044d0 2020-04-22T14:15:10.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.883+0000 7f6c86473700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c80155630 con 0x7f6c80127680 2020-04-22T14:15:10.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.883+0000 7f6c7ffff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f6c600044d0 0x7f6c80126f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47216/0 (socket says 172.21.15.103:47216) 2020-04-22T14:15:10.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.883+0000 7f6c7ffff700 1 -- 172.21.15.103:0/3963788346 learned_addr learned my addr 172.21.15.103:0/3963788346 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:10.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.883+0000 7f6c77fff700 1 --2- 172.21.15.103:0/3963788346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6c80127680 0x7f6c800b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:10.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.883+0000 7f6c7dffb700 1 -- 172.21.15.103:0/3963788346 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2574907875 0 0) 0x7f6c80155390 con 0x7f6c600044d0 2020-04-22T14:15:10.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.883+0000 7f6c7dffb700 1 -- 172.21.15.103:0/3963788346 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c64002fe0 con 0x7f6c600044d0 2020-04-22T14:15:10.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.884+0000 7f6c77fff700 1 -- 172.21.15.103:0/3963788346 >> v1:172.21.15.103:6789/0 conn(0x7f6c600044d0 legacy=0x7f6c80126f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:10.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.884+0000 7f6c77fff700 1 -- 172.21.15.103:0/3963788346 >> v1:172.21.15.86:6789/0 conn(0x7f6c80154c50 legacy=0x7f6c800b1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:10.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.884+0000 7f6c77fff700 1 -- 172.21.15.103:0/3963788346 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c80155ad0 con 0x7f6c80127680 2020-04-22T14:15:10.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.884+0000 7f6c77fff700 1 --2- 172.21.15.103:0/3963788346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6c80127680 0x7f6c800b60a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6c70002220 tx=0x7f6c68010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:10.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.884+0000 7f6c77fff700 1 --2- 172.21.15.103:0/3963788346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6c80127680 0x7f6c800b60a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6c70002220 tx=0x7f6c68010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:10.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.884+0000 7f6c77fff700 1 --2- 172.21.15.103:0/3963788346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6c80127680 0x7f6c800b60a0 secure :-1 s=READY pgs=141 cs=0 l=1 rx=0x7f6c70002220 tx=0x7f6c68010050).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:10.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.884+0000 7f6c77fff700 1 --2- 172.21.15.103:0/3963788346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6c80127680 0x7f6c800b60a0 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7f6c70002220 tx=0x7f6c68010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:10.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.884+0000 7f6c7dffb700 1 -- 172.21.15.103:0/3963788346 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c70002080 con 0x7f6c80127680 2020-04-22T14:15:10.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.884+0000 7f6c77fff700 1 --2- 172.21.15.103:0/3963788346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6c80127680 0x7f6c800b60a0 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7f6c70002220 tx=0x7f6c68010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:10.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.884+0000 7f6c77fff700 1 --2- 172.21.15.103:0/3963788346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6c80127680 0x7f6c800b60a0 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7f6c70002220 tx=0x7f6c68010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:10.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.884+0000 7f6c7dffb700 1 -- 172.21.15.103:0/3963788346 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6800f810 con 0x7f6c80127680 2020-04-22T14:15:10.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.884+0000 7f6c86473700 1 -- 172.21.15.103:0/3963788346 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c800b3880 con 0x7f6c80127680 2020-04-22T14:15:10.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.884+0000 7f6c7dffb700 1 -- 172.21.15.103:0/3963788346 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c680058b0 con 0x7f6c80127680 2020-04-22T14:15:10.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.884+0000 7f6c86473700 1 -- 172.21.15.103:0/3963788346 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c800b5830 con 0x7f6c80127680 2020-04-22T14:15:10.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.885+0000 7f6c86473700 1 -- 172.21.15.103:0/3963788346 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c80056c90 con 0x7f6c80127680 2020-04-22T14:15:10.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.885+0000 7f6c77fff700 1 --2- 172.21.15.103:0/3963788346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6c80127680 0x7f6c800b60a0 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7f6c70002220 tx=0x7f6c68010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:10.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.886+0000 7f6c7dffb700 1 -- 172.21.15.103:0/3963788346 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f6c68005a60 con 0x7f6c80127680 2020-04-22T14:15:10.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.886+0000 7f6c77fff700 1 --2- 172.21.15.103:0/3963788346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6c80127680 0x7f6c800b60a0 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7f6c70002220 tx=0x7f6c68010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:10.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.886+0000 7f6c7dffb700 1 --2- 172.21.15.103:0/3963788346 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6c6404dc70 0x7f6c64050130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:10.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.886+0000 7f6c7dffb700 1 -- 172.21.15.103:0/3963788346 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f6c68061230 con 0x7f6c80127680 2020-04-22T14:15:10.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.886+0000 7f6c7ffff700 1 --2- 172.21.15.103:0/3963788346 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6c6404dc70 0x7f6c64050130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:10.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.886+0000 7f6c7ffff700 1 --2- 172.21.15.103:0/3963788346 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6c6404dc70 0x7f6c64050130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6c700018b0 tx=0x7f6c70003980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:10.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.886+0000 7f6c7ffff700 1 --2- 172.21.15.103:0/3963788346 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6c6404dc70 0x7f6c64050130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6c700018b0 tx=0x7f6c70003980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:10.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.886+0000 7f6c7ffff700 1 --2- 172.21.15.103:0/3963788346 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6c6404dc70 0x7f6c64050130 secure :-1 s=READY pgs=535 cs=0 l=1 rx=0x7f6c700018b0 tx=0x7f6c70003980).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:10.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.889+0000 7f6c77fff700 1 --2- 172.21.15.103:0/3963788346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6c80127680 0x7f6c800b60a0 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7f6c70002220 tx=0x7f6c68010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:10.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:10.889+0000 7f6c7dffb700 1 -- 172.21.15.103:0/3963788346 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f6c6803c730 con 0x7f6c80127680 2020-04-22T14:15:11.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:11.035+0000 7f6c86473700 1 -- 172.21.15.103:0/3963788346 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f6c800b3a10 con 0x7f6c80127680 2020-04-22T14:15:11.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:11.883+0000 7f6c77fff700 1 --2- 172.21.15.103:0/3963788346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6c80127680 0x7f6c800b60a0 secure :-1 s=READY pgs=141 cs=0 l=1 rx=0x7f6c70002220 tx=0x7f6c68010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:11.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:11.902+0000 7f6c77fff700 1 --2- 172.21.15.103:0/3963788346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6c80127680 0x7f6c800b60a0 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7f6c70002220 tx=0x7f6c68010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:11.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:11.902+0000 7f6c7dffb700 1 -- 172.21.15.103:0/3963788346 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v99) v1 ==== 125+0+0 (secure 0 0 0) 0x7f6c6803fd50 con 0x7f6c80127680 2020-04-22T14:15:11.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:11.904+0000 7f6c86473700 1 -- 172.21.15.103:0/3963788346 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6c6404dc70 msgr2=0x7f6c64050130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:11.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:11.904+0000 7f6c86473700 1 --2- 172.21.15.103:0/3963788346 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6c6404dc70 0x7f6c64050130 secure :-1 s=READY pgs=535 cs=0 l=1 rx=0x7f6c700018b0 tx=0x7f6c70003980).stop 2020-04-22T14:15:11.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:11.904+0000 7f6c86473700 1 -- 172.21.15.103:0/3963788346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6c80127680 msgr2=0x7f6c800b60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:11.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:11.904+0000 7f6c86473700 1 --2- 172.21.15.103:0/3963788346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6c80127680 0x7f6c800b60a0 secure :-1 s=READY pgs=141 cs=0 l=1 rx=0x7f6c70002220 tx=0x7f6c68010050).stop 2020-04-22T14:15:11.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:11.904+0000 7f6c86473700 1 -- 172.21.15.103:0/3963788346 shutdown_connections 2020-04-22T14:15:11.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:11.904+0000 7f6c86473700 1 --2- 172.21.15.103:0/3963788346 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6c6404dc70 0x7f6c64050130 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:11.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:11.904+0000 7f6c86473700 1 --2- 172.21.15.103:0/3963788346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6c80127680 0x7f6c800b60a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:11.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:11.904+0000 7f6c86473700 1 -- 172.21.15.103:0/3963788346 >> 172.21.15.103:0/3963788346 conn(0x7f6c8005ad30 msgr2=0x7f6c801464b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:11.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:11.904+0000 7f6c86473700 1 -- 172.21.15.103:0/3963788346 shutdown_connections 2020-04-22T14:15:11.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:11.904+0000 7f6c86473700 1 -- 172.21.15.103:0/3963788346 wait complete. 2020-04-22T14:15:11.908 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' created 2020-04-22T14:15:11.918 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:11.933 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-04-22T14:15:12.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.084+0000 7faebafd4700 1 Processor -- start 2020-04-22T14:15:12.087 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.084+0000 7faebafd4700 1 -- start start 2020-04-22T14:15:12.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.085+0000 7faebafd4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faeb40b9140 0x7faeb412b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:12.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.085+0000 7faebafd4700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7faeb40ac950 0x7faeb412b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:12.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.085+0000 7faebafd4700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeb41467e0 con 0x7faeb4146c40 2020-04-22T14:15:12.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.085+0000 7faebafd4700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb40602f0 con 0x7faeb40ac950 2020-04-22T14:15:12.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.085+0000 7faebafd4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb4060050 con 0x7faeb40b9140 2020-04-22T14:15:12.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.085+0000 7faeb8d70700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faeb40b9140 0x7faeb412b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:12.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.085+0000 7faeb8d70700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faeb40b9140 0x7faeb412b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:39812/0 (socket says 172.21.15.103:39812) 2020-04-22T14:15:12.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.085+0000 7faeb3fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7faeb40ac950 0x7faeb412b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:12.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.085+0000 7faeb8d70700 1 -- 172.21.15.103:0/3594686490 learned_addr learned my addr 172.21.15.103:0/3594686490 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:15:12.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.085+0000 7faeb8d70700 1 -- 172.21.15.103:0/3594686490 >> v2:172.21.15.86:3300/0 conn(0x7faeb40ac950 msgr2=0x7faeb412b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:12.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.085+0000 7faeb8d70700 1 --2- 172.21.15.103:0/3594686490 >> v2:172.21.15.86:3300/0 conn(0x7faeb40ac950 0x7faeb412b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:12.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.085+0000 7faeb8d70700 1 -- 172.21.15.103:0/3594686490 >> v1:172.21.15.86:6789/0 conn(0x7faeb4146c40 legacy=0x7faeb4143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:12.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.085+0000 7faeb8d70700 1 -- 172.21.15.103:0/3594686490 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb40b9520 con 0x7faeb40b9140 2020-04-22T14:15:12.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.085+0000 7faeb8d70700 1 --2- 172.21.15.103:0/3594686490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faeb40b9140 0x7faeb412b210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7faeac0032b0 tx=0x7faeac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.086+0000 7faeb8d70700 1 --2- 172.21.15.103:0/3594686490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faeb40b9140 0x7faeb412b210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7faeac0032b0 tx=0x7faeac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.086+0000 7faeb8d70700 1 --2- 172.21.15.103:0/3594686490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faeb40b9140 0x7faeb412b210 secure :-1 s=READY pgs=142 cs=0 l=1 rx=0x7faeac0032b0 tx=0x7faeac007dc0).ready entity=mon.2 client_cookie=1560a7c823cc2f64 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:12.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.086+0000 7faeb8d70700 1 --2- 172.21.15.103:0/3594686490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faeb40b9140 0x7faeb412b210 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7faeac0032b0 tx=0x7faeac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.086+0000 7faeb8d70700 1 --2- 172.21.15.103:0/3594686490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faeb40b9140 0x7faeb412b210 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7faeac0032b0 tx=0x7faeac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.092 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.086+0000 7faeb37fe700 1 -- 172.21.15.103:0/3594686490 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faeac00a180 con 0x7faeb40b9140 2020-04-22T14:15:12.092 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.086+0000 7faeb8d70700 1 --2- 172.21.15.103:0/3594686490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faeb40b9140 0x7faeb412b210 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7faeac0032b0 tx=0x7faeac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.092 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.086+0000 7faeb37fe700 1 -- 172.21.15.103:0/3594686490 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeac00a320 con 0x7faeb40b9140 2020-04-22T14:15:12.092 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.086+0000 7faeb37fe700 1 -- 172.21.15.103:0/3594686490 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faeac00a740 con 0x7faeb40b9140 2020-04-22T14:15:12.092 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.086+0000 7faebafd4700 1 -- 172.21.15.103:0/3594686490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faeb40b9140 msgr2=0x7faeb412b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:12.092 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.086+0000 7faebafd4700 1 --2- 172.21.15.103:0/3594686490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faeb40b9140 0x7faeb412b210 secure :-1 s=READY pgs=142 cs=0 l=1 rx=0x7faeac0032b0 tx=0x7faeac007dc0).stop 2020-04-22T14:15:12.092 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.086+0000 7faebafd4700 1 -- 172.21.15.103:0/3594686490 shutdown_connections 2020-04-22T14:15:12.093 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.086+0000 7faebafd4700 1 --2- 172.21.15.103:0/3594686490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faeb40b9140 0x7faeb412b210 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:12.093 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.086+0000 7faebafd4700 1 --2- 172.21.15.103:0/3594686490 >> v2:172.21.15.86:3300/0 conn(0x7faeb40ac950 0x7faeb412b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:12.093 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.086+0000 7faebafd4700 1 -- 172.21.15.103:0/3594686490 >> 172.21.15.103:0/3594686490 conn(0x7faeb405b7b0 msgr2=0x7faeb40b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:12.093 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.086+0000 7faebafd4700 1 -- 172.21.15.103:0/3594686490 shutdown_connections 2020-04-22T14:15:12.093 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.086+0000 7faebafd4700 1 -- 172.21.15.103:0/3594686490 wait complete. 2020-04-22T14:15:12.093 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.087+0000 7faebafd4700 1 Processor -- start 2020-04-22T14:15:12.093 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.087+0000 7faebafd4700 1 -- start start 2020-04-22T14:15:12.097 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.088+0000 7faebafd4700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7faeb40ac950 0x7faeb413e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:12.097 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.088+0000 7faebafd4700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7faeb40b9140 0x7faeb40b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:12.097 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.088+0000 7faebafd4700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeb4063140 con 0x7faeb4146c40 2020-04-22T14:15:12.097 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.088+0000 7faebafd4700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb4063420 con 0x7faeb40b9140 2020-04-22T14:15:12.097 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.088+0000 7faebafd4700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb40636c0 con 0x7faeb40ac950 2020-04-22T14:15:12.097 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.088+0000 7faeb8d70700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7faeb40ac950 0x7faeb413e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:12.097 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.088+0000 7faeb8d70700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7faeb40ac950 0x7faeb413e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55040/0 (socket says 172.21.15.103:55040) 2020-04-22T14:15:12.098 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.088+0000 7faeb8d70700 1 -- 172.21.15.103:0/2537049941 learned_addr learned my addr 172.21.15.103:0/2537049941 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:15:12.098 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.088+0000 7faeb3fff700 1 --2- 172.21.15.103:0/2537049941 >> v2:172.21.15.86:3300/0 conn(0x7faeb40b9140 0x7faeb40b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:12.098 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.088+0000 7faeb8d70700 1 -- 172.21.15.103:0/2537049941 >> v2:172.21.15.86:3300/0 conn(0x7faeb40b9140 msgr2=0x7faeb40b5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:12.098 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.088+0000 7faeb8d70700 1 --2- 172.21.15.103:0/2537049941 >> v2:172.21.15.86:3300/0 conn(0x7faeb40b9140 0x7faeb40b5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:12.098 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.088+0000 7faeb8d70700 1 -- 172.21.15.103:0/2537049941 >> v1:172.21.15.86:6789/0 conn(0x7faeb4146c40 legacy=0x7faeb4127ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:12.098 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.088+0000 7faeb8d70700 1 -- 172.21.15.103:0/2537049941 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb4128700 con 0x7faeb40ac950 2020-04-22T14:15:12.099 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.088+0000 7faeb3fff700 1 --2- 172.21.15.103:0/2537049941 >> v2:172.21.15.86:3300/0 conn(0x7faeb40b9140 0x7faeb40b5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:15:12.099 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.089+0000 7faeb8d70700 1 --2- 172.21.15.103:0/2537049941 >> v2:172.21.15.103:3300/0 conn(0x7faeb40ac950 0x7faeb413e360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faeb413e270 tx=0x7faeac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.099 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.089+0000 7faeb8d70700 1 --2- 172.21.15.103:0/2537049941 >> v2:172.21.15.103:3300/0 conn(0x7faeb40ac950 0x7faeb413e360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faeb413e270 tx=0x7faeac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.099 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.089+0000 7faeb8d70700 1 --2- 172.21.15.103:0/2537049941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faeb40ac950 0x7faeb413e360 secure :-1 s=READY pgs=1473 cs=0 l=1 rx=0x7faeb413e270 tx=0x7faeac007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:12.099 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.089+0000 7faeb8d70700 1 --2- 172.21.15.103:0/2537049941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faeb40ac950 0x7faeb413e360 secure :-1 s=THROTTLE_DONE pgs=1473 cs=0 l=1 rx=0x7faeb413e270 tx=0x7faeac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.099 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.089+0000 7faeb8d70700 1 --2- 172.21.15.103:0/2537049941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faeb40ac950 0x7faeb413e360 secure :-1 s=THROTTLE_DONE pgs=1473 cs=0 l=1 rx=0x7faeb413e270 tx=0x7faeac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.100 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.089+0000 7faeb8d70700 1 --2- 172.21.15.103:0/2537049941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faeb40ac950 0x7faeb413e360 secure :-1 s=THROTTLE_DONE pgs=1473 cs=0 l=1 rx=0x7faeb413e270 tx=0x7faeac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.100 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.089+0000 7faeb1ffb700 1 -- 172.21.15.103:0/2537049941 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faeac010590 con 0x7faeb40ac950 2020-04-22T14:15:12.100 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.089+0000 7faeb1ffb700 1 -- 172.21.15.103:0/2537049941 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeac00a7d0 con 0x7faeb40ac950 2020-04-22T14:15:12.100 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.089+0000 7faebafd4700 1 -- 172.21.15.103:0/2537049941 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb4128970 con 0x7faeb40ac950 2020-04-22T14:15:12.100 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.089+0000 7faeb1ffb700 1 -- 172.21.15.103:0/2537049941 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faeac005e20 con 0x7faeb40ac950 2020-04-22T14:15:12.100 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.089+0000 7faebafd4700 1 -- 172.21.15.103:0/2537049941 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb4062c70 con 0x7faeb40ac950 2020-04-22T14:15:12.100 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.089+0000 7faeb8d70700 1 --2- 172.21.15.103:0/2537049941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faeb40ac950 0x7faeb413e360 secure :-1 s=THROTTLE_DONE pgs=1473 cs=0 l=1 rx=0x7faeb413e270 tx=0x7faeac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.101 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.090+0000 7faebafd4700 1 -- 172.21.15.103:0/2537049941 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeb4056c90 con 0x7faeb40ac950 2020-04-22T14:15:12.101 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.090+0000 7faeb1ffb700 1 -- 172.21.15.103:0/2537049941 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7faeac00f5b0 con 0x7faeb40ac950 2020-04-22T14:15:12.101 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.090+0000 7faeb8d70700 1 --2- 172.21.15.103:0/2537049941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faeb40ac950 0x7faeb413e360 secure :-1 s=THROTTLE_DONE pgs=1473 cs=0 l=1 rx=0x7faeb413e270 tx=0x7faeac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.101 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.090+0000 7faeb1ffb700 1 --2- 172.21.15.103:0/2537049941 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fae9404da80 0x7fae9404ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:12.101 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.090+0000 7faeb1ffb700 1 -- 172.21.15.103:0/2537049941 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5957+0+0 (secure 0 0 0) 0x7faeac062330 con 0x7faeb40ac950 2020-04-22T14:15:12.101 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.090+0000 7faeb3fff700 1 --2- 172.21.15.103:0/2537049941 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fae9404da80 0x7fae9404ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:12.101 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.091+0000 7faeb3fff700 1 --2- 172.21.15.103:0/2537049941 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fae9404da80 0x7fae9404ff40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faea8002f30 tx=0x7faea800c880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.091+0000 7faeb3fff700 1 --2- 172.21.15.103:0/2537049941 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fae9404da80 0x7fae9404ff40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faea8002f30 tx=0x7faea800c880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.091+0000 7faeb3fff700 1 --2- 172.21.15.103:0/2537049941 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fae9404da80 0x7fae9404ff40 secure :-1 s=READY pgs=537 cs=0 l=1 rx=0x7faea8002f30 tx=0x7faea800c880).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:12.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.094+0000 7faeb8d70700 1 --2- 172.21.15.103:0/2537049941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faeb40ac950 0x7faeb413e360 secure :-1 s=THROTTLE_DONE pgs=1473 cs=0 l=1 rx=0x7faeb413e270 tx=0x7faeac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.094+0000 7faeb1ffb700 1 -- 172.21.15.103:0/2537049941 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7faeac03d830 con 0x7faeb40ac950 2020-04-22T14:15:12.286 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.284+0000 7faebafd4700 1 -- 172.21.15.103:0/2537049941 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7faeb4062f20 con 0x7faeb40ac950 2020-04-22T14:15:12.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.290+0000 7faeb8d70700 1 --2- 172.21.15.103:0/2537049941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faeb40ac950 0x7faeb413e360 secure :-1 s=THROTTLE_DONE pgs=1473 cs=0 l=1 rx=0x7faeb413e270 tx=0x7faeac007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.290+0000 7faeb1ffb700 1 -- 172.21.15.103:0/2537049941 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 17 and data pool 18 v71) v1 ==== 189+0+0 (secure 0 0 0) 0x7faeac040e50 con 0x7faeb40ac950 2020-04-22T14:15:12.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.293+0000 7faebafd4700 1 -- 172.21.15.103:0/2537049941 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fae9404da80 msgr2=0x7fae9404ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:12.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.293+0000 7faebafd4700 1 --2- 172.21.15.103:0/2537049941 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fae9404da80 0x7fae9404ff40 secure :-1 s=READY pgs=537 cs=0 l=1 rx=0x7faea8002f30 tx=0x7faea800c880).stop 2020-04-22T14:15:12.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.293+0000 7faebafd4700 1 -- 172.21.15.103:0/2537049941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faeb40ac950 msgr2=0x7faeb413e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:12.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.293+0000 7faebafd4700 1 --2- 172.21.15.103:0/2537049941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faeb40ac950 0x7faeb413e360 secure :-1 s=READY pgs=1473 cs=0 l=1 rx=0x7faeb413e270 tx=0x7faeac007dc0).stop 2020-04-22T14:15:12.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.293+0000 7faebafd4700 1 -- 172.21.15.103:0/2537049941 shutdown_connections 2020-04-22T14:15:12.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.293+0000 7faebafd4700 1 --2- 172.21.15.103:0/2537049941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faeb40ac950 0x7faeb413e360 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:12.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.293+0000 7faebafd4700 1 --2- 172.21.15.103:0/2537049941 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fae9404da80 0x7fae9404ff40 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:12.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.293+0000 7faebafd4700 1 --2- 172.21.15.103:0/2537049941 >> v2:172.21.15.86:3300/0 conn(0x7faeb40b9140 0x7faeb40b5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:12.297 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.293+0000 7faebafd4700 1 -- 172.21.15.103:0/2537049941 >> 172.21.15.103:0/2537049941 conn(0x7faeb405b7b0 msgr2=0x7faeb40b85c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:12.298 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.294+0000 7faebafd4700 1 -- 172.21.15.103:0/2537049941 shutdown_connections 2020-04-22T14:15:12.298 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.295+0000 7faebafd4700 1 -- 172.21.15.103:0/2537049941 wait complete. 2020-04-22T14:15:12.302 INFO:teuthology.orchestra.run.smithi103.stderr:new fs with metadata pool 17 and data pool 18 2020-04-22T14:15:12.312 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:12.326 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:15:12.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.470+0000 7fefde860700 1 Processor -- start 2020-04-22T14:15:12.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.470+0000 7fefde860700 1 -- start start 2020-04-22T14:15:12.475 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.471+0000 7fefde860700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fefd80665a0 0x7fefd814a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:12.475 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.471+0000 7fefde860700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fefd80b4ec0 0x7fefd80b5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:12.476 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.471+0000 7fefde860700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefd80651f0 con 0x7fefd805b7c0 2020-04-22T14:15:12.476 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.471+0000 7fefde860700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefd8066b90 con 0x7fefd80b4ec0 2020-04-22T14:15:12.476 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.471+0000 7fefde860700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefd8066e30 con 0x7fefd80665a0 2020-04-22T14:15:12.476 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.471+0000 7fefd77fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fefd80665a0 0x7fefd814a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:12.476 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.471+0000 7fefd77fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fefd80665a0 0x7fefd814a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55056/0 (socket says 172.21.15.103:55056) 2020-04-22T14:15:12.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.471+0000 7fefd77fe700 1 -- 172.21.15.103:0/2389297328 learned_addr learned my addr 172.21.15.103:0/2389297328 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:15:12.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.471+0000 7fefdcdfd700 1 --2- 172.21.15.103:0/2389297328 >> v2:172.21.15.86:3300/0 conn(0x7fefd80b4ec0 0x7fefd80b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:12.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.471+0000 7fefd77fe700 1 -- 172.21.15.103:0/2389297328 >> v2:172.21.15.86:3300/0 conn(0x7fefd80b4ec0 msgr2=0x7fefd80b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:12.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.471+0000 7fefd77fe700 1 --2- 172.21.15.103:0/2389297328 >> v2:172.21.15.86:3300/0 conn(0x7fefd80b4ec0 0x7fefd80b5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:12.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.471+0000 7fefd77fe700 1 -- 172.21.15.103:0/2389297328 >> v1:172.21.15.86:6789/0 conn(0x7fefd805b7c0 legacy=0x7fefd81336b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:12.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.471+0000 7fefd77fe700 1 -- 172.21.15.103:0/2389297328 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd80670d0 con 0x7fefd80665a0 2020-04-22T14:15:12.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.471+0000 7fefd77fe700 1 --2- 172.21.15.103:0/2389297328 >> v2:172.21.15.103:3300/0 conn(0x7fefd80665a0 0x7fefd814a640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fefcc002f30 tx=0x7fefcc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.471+0000 7fefd77fe700 1 --2- 172.21.15.103:0/2389297328 >> v2:172.21.15.103:3300/0 conn(0x7fefd80665a0 0x7fefd814a640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fefcc002f30 tx=0x7fefcc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.471+0000 7fefd77fe700 1 --2- 172.21.15.103:0/2389297328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefd80665a0 0x7fefd814a640 secure :-1 s=READY pgs=1474 cs=0 l=1 rx=0x7fefcc002f30 tx=0x7fefcc007a40).ready entity=mon.1 client_cookie=acec7730fd5b45bb server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:12.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.471+0000 7fefd77fe700 1 --2- 172.21.15.103:0/2389297328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefd80665a0 0x7fefd814a640 secure :-1 s=THROTTLE_DONE pgs=1474 cs=0 l=1 rx=0x7fefcc002f30 tx=0x7fefcc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.471+0000 7fefd6ffd700 1 -- 172.21.15.103:0/2389297328 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefcc011720 con 0x7fefd80665a0 2020-04-22T14:15:12.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.471+0000 7fefd77fe700 1 --2- 172.21.15.103:0/2389297328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefd80665a0 0x7fefd814a640 secure :-1 s=THROTTLE_DONE pgs=1474 cs=0 l=1 rx=0x7fefcc002f30 tx=0x7fefcc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.471+0000 7fefd77fe700 1 --2- 172.21.15.103:0/2389297328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefd80665a0 0x7fefd814a640 secure :-1 s=THROTTLE_DONE pgs=1474 cs=0 l=1 rx=0x7fefcc002f30 tx=0x7fefcc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.471+0000 7fefd6ffd700 1 -- 172.21.15.103:0/2389297328 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefcc011880 con 0x7fefd80665a0 2020-04-22T14:15:12.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.471+0000 7fefd6ffd700 1 -- 172.21.15.103:0/2389297328 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefcc011ca0 con 0x7fefd80665a0 2020-04-22T14:15:12.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.471+0000 7fefde860700 1 -- 172.21.15.103:0/2389297328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefd80665a0 msgr2=0x7fefd814a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:12.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.471+0000 7fefde860700 1 --2- 172.21.15.103:0/2389297328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefd80665a0 0x7fefd814a640 secure :-1 s=READY pgs=1474 cs=0 l=1 rx=0x7fefcc002f30 tx=0x7fefcc007a40).stop 2020-04-22T14:15:12.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.472+0000 7fefde860700 1 -- 172.21.15.103:0/2389297328 shutdown_connections 2020-04-22T14:15:12.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.472+0000 7fefde860700 1 --2- 172.21.15.103:0/2389297328 >> v2:172.21.15.86:3300/0 conn(0x7fefd80b4ec0 0x7fefd80b5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:12.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.472+0000 7fefde860700 1 --2- 172.21.15.103:0/2389297328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefd80665a0 0x7fefd814a640 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:12.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.472+0000 7fefde860700 1 -- 172.21.15.103:0/2389297328 >> 172.21.15.103:0/2389297328 conn(0x7fefd80b9160 msgr2=0x7fefd805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:12.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.472+0000 7fefde860700 1 -- 172.21.15.103:0/2389297328 shutdown_connections 2020-04-22T14:15:12.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.472+0000 7fefde860700 1 -- 172.21.15.103:0/2389297328 wait complete. 2020-04-22T14:15:12.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.473+0000 7fefde860700 1 Processor -- start 2020-04-22T14:15:12.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.473+0000 7fefde860700 1 -- start start 2020-04-22T14:15:12.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.474+0000 7fefde860700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fefd805b7c0 0x7fefd80b4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:12.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.474+0000 7fefde860700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fefd80b4ec0 0x7fefd8131590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:12.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.474+0000 7fefde860700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefd80b4480 con 0x7fefd80665a0 2020-04-22T14:15:12.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.474+0000 7fefde860700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefd80b12a0 con 0x7fefd80b4ec0 2020-04-22T14:15:12.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.474+0000 7fefde860700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd80b1540 con 0x7fefd805b7c0 2020-04-22T14:15:12.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.474+0000 7fefdcdfd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fefd80b4ec0 0x7fefd8131590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:12.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.474+0000 7fefdcdfd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fefd80b4ec0 0x7fefd8131590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:52294/0 (socket says 172.21.15.103:52294) 2020-04-22T14:15:12.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.474+0000 7fefd7fff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fefd805b7c0 0x7fefd80b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:12.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.474+0000 7fefd77fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fefd80665a0 0x7fefd80b0a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:36174/0 (socket says 172.21.15.103:36174) 2020-04-22T14:15:12.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.474+0000 7fefdcdfd700 1 -- 172.21.15.103:0/2288072733 learned_addr learned my addr 172.21.15.103:0/2288072733 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:15:12.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.474+0000 7fefd57fa700 1 -- 172.21.15.103:0/2288072733 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3478910732 0 0) 0x7fefd80670d0 con 0x7fefd80665a0 2020-04-22T14:15:12.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.474+0000 7fefd57fa700 1 -- 172.21.15.103:0/2288072733 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefb8002fe0 con 0x7fefd80665a0 2020-04-22T14:15:12.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.474+0000 7fefd7fff700 1 -- 172.21.15.103:0/2288072733 >> v2:172.21.15.86:3300/0 conn(0x7fefd80b4ec0 msgr2=0x7fefd8131590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:12.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.474+0000 7fefd7fff700 1 --2- 172.21.15.103:0/2288072733 >> v2:172.21.15.86:3300/0 conn(0x7fefd80b4ec0 0x7fefd8131590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:12.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.474+0000 7fefd7fff700 1 -- 172.21.15.103:0/2288072733 >> v1:172.21.15.86:6789/0 conn(0x7fefd80665a0 legacy=0x7fefd80b0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:12.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.474+0000 7fefd7fff700 1 -- 172.21.15.103:0/2288072733 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd80b2430 con 0x7fefd805b7c0 2020-04-22T14:15:12.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.474+0000 7fefd7fff700 1 --2- 172.21.15.103:0/2288072733 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fefd805b7c0 0x7fefd80b4020 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fefd80656b0 tx=0x7fefc8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.474+0000 7fefd7fff700 1 --2- 172.21.15.103:0/2288072733 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fefd805b7c0 0x7fefd80b4020 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fefd80656b0 tx=0x7fefc8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.474+0000 7fefd7fff700 1 --2- 172.21.15.103:0/2288072733 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fefd805b7c0 0x7fefd80b4020 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7fefd80656b0 tx=0x7fefc8010880).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:12.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.475+0000 7fefd7fff700 1 --2- 172.21.15.103:0/2288072733 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fefd805b7c0 0x7fefd80b4020 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7fefd80656b0 tx=0x7fefc8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.475+0000 7fefd57fa700 1 -- 172.21.15.103:0/2288072733 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefc8006bc0 con 0x7fefd805b7c0 2020-04-22T14:15:12.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.475+0000 7fefd7fff700 1 --2- 172.21.15.103:0/2288072733 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fefd805b7c0 0x7fefd80b4020 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7fefd80656b0 tx=0x7fefc8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.475+0000 7fefd57fa700 1 -- 172.21.15.103:0/2288072733 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc8006d60 con 0x7fefd805b7c0 2020-04-22T14:15:12.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.475+0000 7fefd7fff700 1 --2- 172.21.15.103:0/2288072733 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fefd805b7c0 0x7fefd80b4020 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7fefd80656b0 tx=0x7fefc8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.475+0000 7fefde860700 1 -- 172.21.15.103:0/2288072733 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefd80b2680 con 0x7fefd805b7c0 2020-04-22T14:15:12.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.475+0000 7fefd57fa700 1 -- 172.21.15.103:0/2288072733 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefc8010ff0 con 0x7fefd805b7c0 2020-04-22T14:15:12.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.475+0000 7fefde860700 1 -- 172.21.15.103:0/2288072733 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd8131bb0 con 0x7fefd805b7c0 2020-04-22T14:15:12.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.475+0000 7fefd7fff700 1 --2- 172.21.15.103:0/2288072733 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fefd805b7c0 0x7fefd80b4020 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7fefd80656b0 tx=0x7fefc8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.476+0000 7fefde860700 1 -- 172.21.15.103:0/2288072733 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefd80b1740 con 0x7fefd805b7c0 2020-04-22T14:15:12.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.476+0000 7fefd57fa700 1 -- 172.21.15.103:0/2288072733 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fefc80112b0 con 0x7fefd805b7c0 2020-04-22T14:15:12.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.476+0000 7fefd7fff700 1 --2- 172.21.15.103:0/2288072733 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fefd805b7c0 0x7fefd80b4020 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7fefd80656b0 tx=0x7fefc8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.476+0000 7fefd57fa700 1 --2- 172.21.15.103:0/2288072733 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fefb804dcb0 0x7fefb8050170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:12.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.476+0000 7fefd57fa700 1 -- 172.21.15.103:0/2288072733 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fefc8061350 con 0x7fefd805b7c0 2020-04-22T14:15:12.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.476+0000 7fefd77fe700 1 --2- 172.21.15.103:0/2288072733 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fefb804dcb0 0x7fefb8050170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:12.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.477+0000 7fefd77fe700 1 --2- 172.21.15.103:0/2288072733 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fefb804dcb0 0x7fefb8050170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fefcc007ed0 tx=0x7fefcc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.477+0000 7fefd77fe700 1 --2- 172.21.15.103:0/2288072733 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fefb804dcb0 0x7fefb8050170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fefcc007ed0 tx=0x7fefcc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.477+0000 7fefd77fe700 1 --2- 172.21.15.103:0/2288072733 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fefb804dcb0 0x7fefb8050170 secure :-1 s=READY pgs=538 cs=0 l=1 rx=0x7fefcc007ed0 tx=0x7fefcc007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:12.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.480+0000 7fefd7fff700 1 --2- 172.21.15.103:0/2288072733 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fefd805b7c0 0x7fefd80b4020 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7fefd80656b0 tx=0x7fefc8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.480+0000 7fefd57fa700 1 -- 172.21.15.103:0/2288072733 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fefc803c730 con 0x7fefd805b7c0 2020-04-22T14:15:12.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.624+0000 7fefde860700 1 -- 172.21.15.103:0/2288072733 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fefd8056c90 con 0x7fefd805b7c0 2020-04-22T14:15:12.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.625+0000 7fefd7fff700 1 --2- 172.21.15.103:0/2288072733 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fefd805b7c0 0x7fefd80b4020 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7fefd80656b0 tx=0x7fefc8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.625+0000 7fefd57fa700 1 -- 172.21.15.103:0/2288072733 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+16108 (secure 0 0 0) 0x7fefc803fd50 con 0x7fefd805b7c0 2020-04-22T14:15:12.627 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:15:12.628 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":100,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:15:12.286032+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:15:10.023228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2020-04-22T14:15:11.048528+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:15:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.626+0000 7fefde860700 1 -- 172.21.15.103:0/2288072733 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fefb804dcb0 msgr2=0x7fefb8050170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.626+0000 7fefde860700 1 --2- 172.21.15.103:0/2288072733 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fefb804dcb0 0x7fefb8050170 secure :-1 s=READY pgs=538 cs=0 l=1 rx=0x7fefcc007ed0 tx=0x7fefcc007a40).stop 2020-04-22T14:15:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.626+0000 7fefde860700 1 -- 172.21.15.103:0/2288072733 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fefd805b7c0 msgr2=0x7fefd80b4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.626+0000 7fefde860700 1 --2- 172.21.15.103:0/2288072733 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fefd805b7c0 0x7fefd80b4020 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7fefd80656b0 tx=0x7fefc8010880).stop 2020-04-22T14:15:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.626+0000 7fefde860700 1 -- 172.21.15.103:0/2288072733 shutdown_connections 2020-04-22T14:15:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.626+0000 7fefde860700 1 --2- 172.21.15.103:0/2288072733 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fefb804dcb0 0x7fefb8050170 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:12.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.626+0000 7fefde860700 1 --2- 172.21.15.103:0/2288072733 >> v2:172.21.15.86:3300/0 conn(0x7fefd80b4ec0 0x7fefd8131590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:12.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.626+0000 7fefde860700 1 --2- 172.21.15.103:0/2288072733 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fefd805b7c0 0x7fefd80b4020 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:12.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.626+0000 7fefde860700 1 -- 172.21.15.103:0/2288072733 >> 172.21.15.103:0/2288072733 conn(0x7fefd80b9160 msgr2=0x7fefd814e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:12.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.626+0000 7fefde860700 1 -- 172.21.15.103:0/2288072733 shutdown_connections 2020-04-22T14:15:12.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.626+0000 7fefde860700 1 -- 172.21.15.103:0/2288072733 wait complete. 2020-04-22T14:15:12.650 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:12.668 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:15:12.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.812+0000 7f6b60830700 1 Processor -- start 2020-04-22T14:15:12.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.812+0000 7f6b60830700 1 -- start start 2020-04-22T14:15:12.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.813+0000 7f6b60830700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6b5c065fe0 0x7f6b5c1464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:12.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.813+0000 7f6b60830700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b5c063e30 0x7f6b5c0642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:12.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.813+0000 7f6b60830700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b5c143300 con 0x7f6b5c12c0d0 2020-04-22T14:15:12.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.813+0000 7f6b60830700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b5c1435a0 con 0x7f6b5c065fe0 2020-04-22T14:15:12.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.813+0000 7f6b60830700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5c143840 con 0x7f6b5c063e30 2020-04-22T14:15:12.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.813+0000 7f6b5a59c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f6b5c12c0d0 0x7f6b5c05b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47256/0 (socket says 172.21.15.103:47256) 2020-04-22T14:15:12.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.813+0000 7f6b5a59c700 1 -- 172.21.15.103:0/2497492240 learned_addr learned my addr 172.21.15.103:0/2497492240 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:12.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.813+0000 7f6b5ad9d700 1 --2- 172.21.15.103:0/2497492240 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b5c063e30 0x7f6b5c0642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:12.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.813+0000 7f6b59d9b700 1 --2- 172.21.15.103:0/2497492240 >> v2:172.21.15.86:3300/0 conn(0x7f6b5c065fe0 0x7f6b5c1464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:12.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.813+0000 7f6b5959a700 1 -- 172.21.15.103:0/2497492240 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2017928171 0 0) 0x7f6b5c143300 con 0x7f6b5c12c0d0 2020-04-22T14:15:12.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.813+0000 7f6b5959a700 1 -- 172.21.15.103:0/2497492240 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b40003230 con 0x7f6b5c12c0d0 2020-04-22T14:15:12.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.813+0000 7f6b5959a700 1 -- 172.21.15.103:0/2497492240 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 896917573 0 0) 0x7f6b40003230 con 0x7f6b5c12c0d0 2020-04-22T14:15:12.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.813+0000 7f6b5959a700 1 -- 172.21.15.103:0/2497492240 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b5c063e30 msgr2=0x7f6b5c0642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:12.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.813+0000 7f6b5959a700 1 --2- 172.21.15.103:0/2497492240 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b5c063e30 0x7f6b5c0642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:12.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.813+0000 7f6b5959a700 1 -- 172.21.15.103:0/2497492240 >> v2:172.21.15.86:3300/0 conn(0x7f6b5c065fe0 msgr2=0x7f6b5c1464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:12.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.813+0000 7f6b5959a700 1 --2- 172.21.15.103:0/2497492240 >> v2:172.21.15.86:3300/0 conn(0x7f6b5c065fe0 0x7f6b5c1464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:12.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.813+0000 7f6b5959a700 1 -- 172.21.15.103:0/2497492240 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b5c05bb50 con 0x7f6b5c12c0d0 2020-04-22T14:15:12.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.813+0000 7f6b5959a700 1 -- 172.21.15.103:0/2497492240 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f6b54001a50 con 0x7f6b5c12c0d0 2020-04-22T14:15:12.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.813+0000 7f6b5959a700 1 -- 172.21.15.103:0/2497492240 >> v1:172.21.15.103:6789/0 conn(0x7f6b5c12c0d0 legacy=0x7f6b5c05b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:12.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.813+0000 7f6b5959a700 1 --2- 172.21.15.103:0/2497492240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b40003720 0x7f6b40003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:12.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.813+0000 7f6b5959a700 1 --2- 172.21.15.103:0/2497492240 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b40004060 0x7f6b40004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:12.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.813+0000 7f6b5959a700 1 --2- 172.21.15.103:0/2497492240 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b5c063e30 0x7f6b40004ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:12.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.813+0000 7f6b5959a700 1 -- 172.21.15.103:0/2497492240 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5c1435a0 con 0x7f6b40004060 2020-04-22T14:15:12.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.813+0000 7f6b5959a700 1 -- 172.21.15.103:0/2497492240 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5c143840 con 0x7f6b40003720 2020-04-22T14:15:12.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.813+0000 7f6b5959a700 1 -- 172.21.15.103:0/2497492240 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b40005020 con 0x7f6b5c063e30 2020-04-22T14:15:12.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.813+0000 7f6b5a59c700 1 --2- 172.21.15.103:0/2497492240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b40003720 0x7f6b40003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:12.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.813+0000 7f6b59d9b700 1 --2- 172.21.15.103:0/2497492240 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b40004060 0x7f6b40004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:12.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.814+0000 7f6b5ad9d700 1 --2- 172.21.15.103:0/2497492240 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b5c063e30 0x7f6b40004ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:12.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.814+0000 7f6b5a59c700 1 -- 172.21.15.103:0/2497492240 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b5c063e30 msgr2=0x7f6b40004ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:12.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.814+0000 7f6b5a59c700 1 --2- 172.21.15.103:0/2497492240 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b5c063e30 0x7f6b40004ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:12.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.814+0000 7f6b5a59c700 1 -- 172.21.15.103:0/2497492240 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b40004060 msgr2=0x7f6b40004530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:12.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.814+0000 7f6b5a59c700 1 --2- 172.21.15.103:0/2497492240 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b40004060 0x7f6b40004530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:12.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.814+0000 7f6b5a59c700 1 -- 172.21.15.103:0/2497492240 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b40003230 con 0x7f6b40003720 2020-04-22T14:15:12.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.814+0000 7f6b5a59c700 1 --2- 172.21.15.103:0/2497492240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b40003720 0x7f6b40003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6b54001760 tx=0x7f6b5c05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.814+0000 7f6b5a59c700 1 --2- 172.21.15.103:0/2497492240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b40003720 0x7f6b40003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6b54001760 tx=0x7f6b5c05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.814+0000 7f6b5a59c700 1 --2- 172.21.15.103:0/2497492240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b40003720 0x7f6b40003b40 secure :-1 s=READY pgs=1476 cs=0 l=1 rx=0x7f6b54001760 tx=0x7f6b5c05bce0).ready entity=mon.1 client_cookie=c026c1dae06a2e3f server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:12.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.814+0000 7f6b5a59c700 1 --2- 172.21.15.103:0/2497492240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b40003720 0x7f6b40003b40 secure :-1 s=THROTTLE_DONE pgs=1476 cs=0 l=1 rx=0x7f6b54001760 tx=0x7f6b5c05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.814+0000 7f6b5959a700 1 -- 172.21.15.103:0/2497492240 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b5400e560 con 0x7f6b40003720 2020-04-22T14:15:12.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.814+0000 7f6b5a59c700 1 --2- 172.21.15.103:0/2497492240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b40003720 0x7f6b40003b40 secure :-1 s=THROTTLE_DONE pgs=1476 cs=0 l=1 rx=0x7f6b54001760 tx=0x7f6b5c05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.814+0000 7f6b5959a700 1 -- 172.21.15.103:0/2497492240 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b5400e6c0 con 0x7f6b40003720 2020-04-22T14:15:12.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.814+0000 7f6b5a59c700 1 --2- 172.21.15.103:0/2497492240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b40003720 0x7f6b40003b40 secure :-1 s=THROTTLE_DONE pgs=1476 cs=0 l=1 rx=0x7f6b54001760 tx=0x7f6b5c05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.814+0000 7f6b5959a700 1 -- 172.21.15.103:0/2497492240 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b540100c0 con 0x7f6b40003720 2020-04-22T14:15:12.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.814+0000 7f6b60830700 1 -- 172.21.15.103:0/2497492240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b40003720 msgr2=0x7f6b40003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:12.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.814+0000 7f6b60830700 1 --2- 172.21.15.103:0/2497492240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b40003720 0x7f6b40003b40 secure :-1 s=READY pgs=1476 cs=0 l=1 rx=0x7f6b54001760 tx=0x7f6b5c05bce0).stop 2020-04-22T14:15:12.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.814+0000 7f6b5ad9d700 1 -- 172.21.15.103:0/2497492240 reap_dead start 2020-04-22T14:15:12.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.814+0000 7f6b60830700 1 -- 172.21.15.103:0/2497492240 shutdown_connections 2020-04-22T14:15:12.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.814+0000 7f6b60830700 1 -- 172.21.15.103:0/2497492240 >> 172.21.15.103:0/2497492240 conn(0x7f6b5c0b9160 msgr2=0x7f6b5c05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:12.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.815+0000 7f6b60830700 1 -- 172.21.15.103:0/2497492240 shutdown_connections 2020-04-22T14:15:12.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.815+0000 7f6b60830700 1 -- 172.21.15.103:0/2497492240 wait complete. 2020-04-22T14:15:12.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.815+0000 7f6b60830700 1 Processor -- start 2020-04-22T14:15:12.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.815+0000 7f6b60830700 1 -- start start 2020-04-22T14:15:12.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.816+0000 7f6b60830700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6b5c0b5b70 0x7f6b5c12c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:12.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.816+0000 7f6b60830700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b5c127cb0 0x7f6b5c1280f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:12.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.816+0000 7f6b60830700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b5c12cc90 con 0x7f6b5c129ba0 2020-04-22T14:15:12.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.816+0000 7f6b60830700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b5c12ced0 con 0x7f6b5c0b5b70 2020-04-22T14:15:12.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.816+0000 7f6b60830700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5c12d170 con 0x7f6b5c127cb0 2020-04-22T14:15:12.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.816+0000 7f6b5a59c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f6b5c129ba0 0x7f6b5c0b2d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47268/0 (socket says 172.21.15.103:47268) 2020-04-22T14:15:12.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.816+0000 7f6b5a59c700 1 -- 172.21.15.103:0/3425472857 learned_addr learned my addr 172.21.15.103:0/3425472857 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:12.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.816+0000 7f6b59d9b700 1 --2- 172.21.15.103:0/3425472857 >> v2:172.21.15.86:3300/0 conn(0x7f6b5c0b5b70 0x7f6b5c12c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:12.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.816+0000 7f6b5ad9d700 1 --2- 172.21.15.103:0/3425472857 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b5c127cb0 0x7f6b5c1280f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:12.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.816+0000 7f6b4b7fe700 1 -- 172.21.15.103:0/3425472857 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3174648235 0 0) 0x7f6b40003230 con 0x7f6b5c129ba0 2020-04-22T14:15:12.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.816+0000 7f6b4b7fe700 1 -- 172.21.15.103:0/3425472857 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b38002fe0 con 0x7f6b5c129ba0 2020-04-22T14:15:12.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.817+0000 7f6b4b7fe700 1 -- 172.21.15.103:0/3425472857 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 611989056 0 0) 0x7f6b38002fe0 con 0x7f6b5c129ba0 2020-04-22T14:15:12.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.817+0000 7f6b4b7fe700 1 -- 172.21.15.103:0/3425472857 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6b40003230 con 0x7f6b5c129ba0 2020-04-22T14:15:12.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.817+0000 7f6b4b7fe700 1 -- 172.21.15.103:0/3425472857 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f6b54001dd0 con 0x7f6b5c129ba0 2020-04-22T14:15:12.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.817+0000 7f6b4b7fe700 1 -- 172.21.15.103:0/3425472857 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b5c127cb0 msgr2=0x7f6b5c1280f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:12.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.817+0000 7f6b4b7fe700 1 --2- 172.21.15.103:0/3425472857 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b5c127cb0 0x7f6b5c1280f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:12.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.817+0000 7f6b4b7fe700 1 -- 172.21.15.103:0/3425472857 >> v2:172.21.15.86:3300/0 conn(0x7f6b5c0b5b70 msgr2=0x7f6b5c12c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:12.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.817+0000 7f6b4b7fe700 1 --2- 172.21.15.103:0/3425472857 >> v2:172.21.15.86:3300/0 conn(0x7f6b5c0b5b70 0x7f6b5c12c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:12.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.817+0000 7f6b4b7fe700 1 -- 172.21.15.103:0/3425472857 >> v1:172.21.15.103:6789/0 conn(0x7f6b5c129ba0 legacy=0x7f6b5c0b2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:12.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.817+0000 7f6b4b7fe700 1 --2- 172.21.15.103:0/3425472857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b380049b0 0x7f6b38004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:12.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.817+0000 7f6b4b7fe700 1 --2- 172.21.15.103:0/3425472857 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b38005250 0x7f6b38003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:12.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.817+0000 7f6b4b7fe700 1 --2- 172.21.15.103:0/3425472857 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b38003f20 0x7f6b380043a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:12.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.817+0000 7f6b4b7fe700 1 -- 172.21.15.103:0/3425472857 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5c12ced0 con 0x7f6b38005250 2020-04-22T14:15:12.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.817+0000 7f6b4b7fe700 1 -- 172.21.15.103:0/3425472857 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5c12d170 con 0x7f6b380049b0 2020-04-22T14:15:12.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.817+0000 7f6b4b7fe700 1 -- 172.21.15.103:0/3425472857 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3800b8c0 con 0x7f6b38003f20 2020-04-22T14:15:12.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.817+0000 7f6b59d9b700 1 --2- 172.21.15.103:0/3425472857 >> v2:172.21.15.86:3300/0 conn(0x7f6b5c0b5b70 0x7f6b5c12c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:15:12.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.817+0000 7f6b5ad9d700 1 --2- 172.21.15.103:0/3425472857 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b5c127cb0 0x7f6b5c1280f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:15:12.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.817+0000 7f6b5a59c700 1 --2- 172.21.15.103:0/3425472857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b380049b0 0x7f6b38004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:12.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.817+0000 7f6b59d9b700 1 --2- 172.21.15.103:0/3425472857 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b38005250 0x7f6b38003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:12.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.817+0000 7f6b5ad9d700 1 --2- 172.21.15.103:0/3425472857 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b38003f20 0x7f6b380043a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:12.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.817+0000 7f6b5a59c700 1 -- 172.21.15.103:0/3425472857 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b38003f20 msgr2=0x7f6b380043a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:12.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.817+0000 7f6b5a59c700 1 --2- 172.21.15.103:0/3425472857 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b38003f20 0x7f6b380043a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:12.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.817+0000 7f6b5a59c700 1 -- 172.21.15.103:0/3425472857 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b38005250 msgr2=0x7f6b38003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:12.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.817+0000 7f6b5a59c700 1 --2- 172.21.15.103:0/3425472857 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b38005250 0x7f6b38003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:12.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.817+0000 7f6b5a59c700 1 -- 172.21.15.103:0/3425472857 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b5c129f80 con 0x7f6b380049b0 2020-04-22T14:15:12.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.817+0000 7f6b59d9b700 1 --2- 172.21.15.103:0/3425472857 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b38005250 0x7f6b38003920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:15:12.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.817+0000 7f6b60830700 1 -- 172.21.15.103:0/3425472857 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b5c1280f0 con 0x7f6b380049b0 2020-04-22T14:15:12.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.817+0000 7f6b5a59c700 1 --2- 172.21.15.103:0/3425472857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b380049b0 0x7f6b38004dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6b540048c0 tx=0x7f6b5c05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.817+0000 7f6b60830700 1 -- 172.21.15.103:0/3425472857 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b5c128560 con 0x7f6b380049b0 2020-04-22T14:15:12.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.817+0000 7f6b5a59c700 1 --2- 172.21.15.103:0/3425472857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b380049b0 0x7f6b38004dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6b540048c0 tx=0x7f6b5c05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.817+0000 7f6b5a59c700 1 --2- 172.21.15.103:0/3425472857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b380049b0 0x7f6b38004dd0 secure :-1 s=READY pgs=1478 cs=0 l=1 rx=0x7f6b540048c0 tx=0x7f6b5c05bce0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:12.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.817+0000 7f6b5a59c700 1 --2- 172.21.15.103:0/3425472857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b380049b0 0x7f6b38004dd0 secure :-1 s=THROTTLE_DONE pgs=1478 cs=0 l=1 rx=0x7f6b540048c0 tx=0x7f6b5c05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.817+0000 7f6b4b7fe700 1 -- 172.21.15.103:0/3425472857 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b54004d10 con 0x7f6b380049b0 2020-04-22T14:15:12.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.817+0000 7f6b5a59c700 1 --2- 172.21.15.103:0/3425472857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b380049b0 0x7f6b38004dd0 secure :-1 s=THROTTLE_DONE pgs=1478 cs=0 l=1 rx=0x7f6b540048c0 tx=0x7f6b5c05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.817+0000 7f6b4b7fe700 1 -- 172.21.15.103:0/3425472857 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b54004e70 con 0x7f6b380049b0 2020-04-22T14:15:12.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.817+0000 7f6b5a59c700 1 --2- 172.21.15.103:0/3425472857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b380049b0 0x7f6b38004dd0 secure :-1 s=THROTTLE_DONE pgs=1478 cs=0 l=1 rx=0x7f6b540048c0 tx=0x7f6b5c05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.817+0000 7f6b4b7fe700 1 -- 172.21.15.103:0/3425472857 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b54012470 con 0x7f6b380049b0 2020-04-22T14:15:12.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.818+0000 7f6b5a59c700 1 --2- 172.21.15.103:0/3425472857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b380049b0 0x7f6b38004dd0 secure :-1 s=THROTTLE_DONE pgs=1478 cs=0 l=1 rx=0x7f6b540048c0 tx=0x7f6b5c05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.818+0000 7f6b60830700 1 -- 172.21.15.103:0/3425472857 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b34003340 con 0x7f6b380049b0 2020-04-22T14:15:12.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.818+0000 7f6b4b7fe700 1 -- 172.21.15.103:0/3425472857 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f6b540125d0 con 0x7f6b380049b0 2020-04-22T14:15:12.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.818+0000 7f6b5a59c700 1 --2- 172.21.15.103:0/3425472857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b380049b0 0x7f6b38004dd0 secure :-1 s=THROTTLE_DONE pgs=1478 cs=0 l=1 rx=0x7f6b540048c0 tx=0x7f6b5c05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.819+0000 7f6b4b7fe700 1 --2- 172.21.15.103:0/3425472857 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6b38056020 0x7f6b380584e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:12.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.819+0000 7f6b4b7fe700 1 -- 172.21.15.103:0/3425472857 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6b540625f0 con 0x7f6b380049b0 2020-04-22T14:15:12.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.819+0000 7f6b59d9b700 1 --2- 172.21.15.103:0/3425472857 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6b38056020 0x7f6b380584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:12.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.819+0000 7f6b59d9b700 1 --2- 172.21.15.103:0/3425472857 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6b38056020 0x7f6b380584e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6b50002f30 tx=0x7f6b50002f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.819+0000 7f6b59d9b700 1 --2- 172.21.15.103:0/3425472857 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6b38056020 0x7f6b380584e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6b50002f30 tx=0x7f6b50002f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.819+0000 7f6b59d9b700 1 --2- 172.21.15.103:0/3425472857 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6b38056020 0x7f6b380584e0 secure :-1 s=READY pgs=539 cs=0 l=1 rx=0x7f6b50002f30 tx=0x7f6b50002f90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:12.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.823+0000 7f6b5a59c700 1 --2- 172.21.15.103:0/3425472857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b380049b0 0x7f6b38004dd0 secure :-1 s=THROTTLE_DONE pgs=1478 cs=0 l=1 rx=0x7f6b540048c0 tx=0x7f6b5c05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.823+0000 7f6b4b7fe700 1 -- 172.21.15.103:0/3425472857 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f6b5403da90 con 0x7f6b380049b0 2020-04-22T14:15:12.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.965+0000 7f6b60830700 1 -- 172.21.15.103:0/3425472857 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b340021d0 con 0x7f6b380049b0 2020-04-22T14:15:12.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.966+0000 7f6b5a59c700 1 --2- 172.21.15.103:0/3425472857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b380049b0 0x7f6b38004dd0 secure :-1 s=THROTTLE_DONE pgs=1478 cs=0 l=1 rx=0x7f6b540048c0 tx=0x7f6b5c05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:12.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.966+0000 7f6b4b7fe700 1 -- 172.21.15.103:0/3425472857 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+16108 (secure 0 0 0) 0x7f6b540410b0 con 0x7f6b380049b0 2020-04-22T14:15:12.968 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:15:12.969 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":100,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:15:12.286032+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:15:10.023228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2020-04-22T14:15:11.048528+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:15:12.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.967+0000 7f6b60830700 1 -- 172.21.15.103:0/3425472857 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6b38056020 msgr2=0x7f6b380584e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:12.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.967+0000 7f6b60830700 1 --2- 172.21.15.103:0/3425472857 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6b38056020 0x7f6b380584e0 secure :-1 s=READY pgs=539 cs=0 l=1 rx=0x7f6b50002f30 tx=0x7f6b50002f90).stop 2020-04-22T14:15:12.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.967+0000 7f6b60830700 1 -- 172.21.15.103:0/3425472857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b380049b0 msgr2=0x7f6b38004dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:12.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.967+0000 7f6b60830700 1 --2- 172.21.15.103:0/3425472857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b380049b0 0x7f6b38004dd0 secure :-1 s=READY pgs=1478 cs=0 l=1 rx=0x7f6b540048c0 tx=0x7f6b5c05bce0).stop 2020-04-22T14:15:12.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.967+0000 7f6b5ad9d700 1 -- 172.21.15.103:0/3425472857 reap_dead start 2020-04-22T14:15:12.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.967+0000 7f6b60830700 1 -- 172.21.15.103:0/3425472857 shutdown_connections 2020-04-22T14:15:12.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.967+0000 7f6b60830700 1 -- 172.21.15.103:0/3425472857 >> 172.21.15.103:0/3425472857 conn(0x7f6b5c0b9160 msgr2=0x7f6b5c12adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:12.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.967+0000 7f6b60830700 1 -- 172.21.15.103:0/3425472857 shutdown_connections 2020-04-22T14:15:12.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:12.968+0000 7f6b60830700 1 -- 172.21.15.103:0/3425472857 wait complete. 2020-04-22T14:15:12.981 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:12.994 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-04-22T14:15:13.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.141+0000 7f23cff4e700 1 Processor -- start 2020-04-22T14:15:13.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.141+0000 7f23cff4e700 1 -- start start 2020-04-22T14:15:13.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.142+0000 7f23cff4e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23c80b9140 0x7f23c80aed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:13.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.142+0000 7f23cff4e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f23c80b3bd0 0x7f23c80af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:13.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.142+0000 7f23cff4e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f23c80616b0 0x7f23c8061b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:13.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.142+0000 7f23cff4e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23c80af650 con 0x7f23c80b3bd0 2020-04-22T14:15:13.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.142+0000 7f23cff4e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23c8148310 con 0x7f23c80616b0 2020-04-22T14:15:13.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.142+0000 7f23cff4e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c81485b0 con 0x7f23c80b9140 2020-04-22T14:15:13.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.142+0000 7f23ce4eb700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f23c80616b0 0x7f23c8061b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:13.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.142+0000 7f23ce4eb700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f23c80616b0 0x7f23c8061b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55092/0 (socket says 172.21.15.103:55092) 2020-04-22T14:15:13.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.142+0000 7f23ce4eb700 1 -- 172.21.15.103:0/928746606 learned_addr learned my addr 172.21.15.103:0/928746606 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:15:13.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.142+0000 7f23cdcea700 1 --2- 172.21.15.103:0/928746606 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23c80b9140 0x7f23c80aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:13.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.142+0000 7f23cd4e9700 1 --2- 172.21.15.103:0/928746606 >> v2:172.21.15.86:3300/0 conn(0x7f23c80b3bd0 0x7f23c80af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:13.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.142+0000 7f23ce4eb700 1 -- 172.21.15.103:0/928746606 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23c80b9140 msgr2=0x7f23c80aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:13.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.142+0000 7f23ce4eb700 1 --2- 172.21.15.103:0/928746606 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23c80b9140 0x7f23c80aed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:13.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.142+0000 7f23ce4eb700 1 -- 172.21.15.103:0/928746606 >> v2:172.21.15.86:3300/0 conn(0x7f23c80b3bd0 msgr2=0x7f23c80af1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:13.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.142+0000 7f23ce4eb700 1 --2- 172.21.15.103:0/928746606 >> v2:172.21.15.86:3300/0 conn(0x7f23c80b3bd0 0x7f23c80af1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:13.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.142+0000 7f23ce4eb700 1 -- 172.21.15.103:0/928746606 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c80b9520 con 0x7f23c80616b0 2020-04-22T14:15:13.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.143+0000 7f23ce4eb700 1 --2- 172.21.15.103:0/928746606 >> v2:172.21.15.103:3300/0 conn(0x7f23c80616b0 0x7f23c8061b60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f23c00032b0 tx=0x7f23c0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:13.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.143+0000 7f23ce4eb700 1 --2- 172.21.15.103:0/928746606 >> v2:172.21.15.103:3300/0 conn(0x7f23c80616b0 0x7f23c8061b60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f23c00032b0 tx=0x7f23c0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:13.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.143+0000 7f23ce4eb700 1 --2- 172.21.15.103:0/928746606 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23c80616b0 0x7f23c8061b60 secure :-1 s=READY pgs=1479 cs=0 l=1 rx=0x7f23c00032b0 tx=0x7f23c0007dc0).ready entity=mon.1 client_cookie=eb101947af9aa86b server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:13.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.143+0000 7f23ce4eb700 1 --2- 172.21.15.103:0/928746606 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23c80616b0 0x7f23c8061b60 secure :-1 s=THROTTLE_DONE pgs=1479 cs=0 l=1 rx=0x7f23c00032b0 tx=0x7f23c0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:13.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.143+0000 7f23ccce8700 1 -- 172.21.15.103:0/928746606 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23c000a180 con 0x7f23c80616b0 2020-04-22T14:15:13.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.143+0000 7f23ce4eb700 1 --2- 172.21.15.103:0/928746606 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23c80616b0 0x7f23c8061b60 secure :-1 s=THROTTLE_DONE pgs=1479 cs=0 l=1 rx=0x7f23c00032b0 tx=0x7f23c0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:13.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.143+0000 7f23ce4eb700 1 --2- 172.21.15.103:0/928746606 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23c80616b0 0x7f23c8061b60 secure :-1 s=THROTTLE_DONE pgs=1479 cs=0 l=1 rx=0x7f23c00032b0 tx=0x7f23c0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:13.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.143+0000 7f23ccce8700 1 -- 172.21.15.103:0/928746606 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c000a2e0 con 0x7f23c80616b0 2020-04-22T14:15:13.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.143+0000 7f23ccce8700 1 -- 172.21.15.103:0/928746606 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23c000a700 con 0x7f23c80616b0 2020-04-22T14:15:13.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.143+0000 7f23cff4e700 1 -- 172.21.15.103:0/928746606 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23c80616b0 msgr2=0x7f23c8061b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:13.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.143+0000 7f23cff4e700 1 --2- 172.21.15.103:0/928746606 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23c80616b0 0x7f23c8061b60 secure :-1 s=READY pgs=1479 cs=0 l=1 rx=0x7f23c00032b0 tx=0x7f23c0007dc0).stop 2020-04-22T14:15:13.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.143+0000 7f23cff4e700 1 -- 172.21.15.103:0/928746606 shutdown_connections 2020-04-22T14:15:13.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.143+0000 7f23cff4e700 1 --2- 172.21.15.103:0/928746606 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23c80616b0 0x7f23c8061b60 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:13.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.143+0000 7f23cff4e700 1 --2- 172.21.15.103:0/928746606 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23c80b9140 0x7f23c80aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:13.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.143+0000 7f23cff4e700 1 --2- 172.21.15.103:0/928746606 >> v2:172.21.15.86:3300/0 conn(0x7f23c80b3bd0 0x7f23c80af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:13.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.143+0000 7f23cff4e700 1 -- 172.21.15.103:0/928746606 >> 172.21.15.103:0/928746606 conn(0x7f23c805b7b0 msgr2=0x7f23c80b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:13.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.143+0000 7f23cff4e700 1 -- 172.21.15.103:0/928746606 shutdown_connections 2020-04-22T14:15:13.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.143+0000 7f23cff4e700 1 -- 172.21.15.103:0/928746606 wait complete. 2020-04-22T14:15:13.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.144+0000 7f23cff4e700 1 Processor -- start 2020-04-22T14:15:13.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.144+0000 7f23cff4e700 1 -- start start 2020-04-22T14:15:13.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.145+0000 7f23cff4e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f23c80b3bd0 0x7f23c8065eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:13.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.145+0000 7f23cff4e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f23c80b9140 0x7f23c8150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:13.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.145+0000 7f23cff4e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23c80625d0 con 0x7f23c80616b0 2020-04-22T14:15:13.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.145+0000 7f23cff4e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23c8064010 con 0x7f23c80b9140 2020-04-22T14:15:13.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.145+0000 7f23cff4e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23c81512e0 con 0x7f23c80b3bd0 2020-04-22T14:15:13.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.145+0000 7f23cd4e9700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f23c80b3bd0 0x7f23c8065eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:13.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.145+0000 7f23cd4e9700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f23c80b3bd0 0x7f23c8065eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55098/0 (socket says 172.21.15.103:55098) 2020-04-22T14:15:13.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.145+0000 7f23cd4e9700 1 -- 172.21.15.103:0/3620973049 learned_addr learned my addr 172.21.15.103:0/3620973049 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:15:13.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.145+0000 7f23ce4eb700 1 --2- 172.21.15.103:0/3620973049 >> v2:172.21.15.86:3300/0 conn(0x7f23c80b9140 0x7f23c8150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:13.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.145+0000 7f23cd4e9700 1 -- 172.21.15.103:0/3620973049 >> v2:172.21.15.86:3300/0 conn(0x7f23c80b9140 msgr2=0x7f23c8150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:13.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.145+0000 7f23cd4e9700 1 --2- 172.21.15.103:0/3620973049 >> v2:172.21.15.86:3300/0 conn(0x7f23c80b9140 0x7f23c8150e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:13.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.145+0000 7f23cd4e9700 1 -- 172.21.15.103:0/3620973049 >> v1:172.21.15.103:6789/0 conn(0x7f23c80616b0 legacy=0x7f23c80b1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:13.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.145+0000 7f23b6ffd700 1 -- 172.21.15.103:0/3620973049 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2298352949 0 0) 0x7f23c80625d0 con 0x7f23c80616b0 2020-04-22T14:15:13.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.145+0000 7f23cd4e9700 1 -- 172.21.15.103:0/3620973049 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c8062870 con 0x7f23c80b3bd0 2020-04-22T14:15:13.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.145+0000 7f23cd4e9700 1 --2- 172.21.15.103:0/3620973049 >> v2:172.21.15.103:3300/0 conn(0x7f23c80b3bd0 0x7f23c8065eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f23c4002f30 tx=0x7f23c4010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:13.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.145+0000 7f23cd4e9700 1 --2- 172.21.15.103:0/3620973049 >> v2:172.21.15.103:3300/0 conn(0x7f23c80b3bd0 0x7f23c8065eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f23c4002f30 tx=0x7f23c4010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:13.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.145+0000 7f23cd4e9700 1 --2- 172.21.15.103:0/3620973049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23c80b3bd0 0x7f23c8065eb0 secure :-1 s=READY pgs=1481 cs=0 l=1 rx=0x7f23c4002f30 tx=0x7f23c4010ce0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:13.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.146+0000 7f23cd4e9700 1 --2- 172.21.15.103:0/3620973049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23c80b3bd0 0x7f23c8065eb0 secure :-1 s=THROTTLE_DONE pgs=1481 cs=0 l=1 rx=0x7f23c4002f30 tx=0x7f23c4010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:13.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.146+0000 7f23b6ffd700 1 -- 172.21.15.103:0/3620973049 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23c4012b50 con 0x7f23c80b3bd0 2020-04-22T14:15:13.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.146+0000 7f23cd4e9700 1 --2- 172.21.15.103:0/3620973049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23c80b3bd0 0x7f23c8065eb0 secure :-1 s=THROTTLE_DONE pgs=1481 cs=0 l=1 rx=0x7f23c4002f30 tx=0x7f23c4010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:13.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.146+0000 7f23cd4e9700 1 --2- 172.21.15.103:0/3620973049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23c80b3bd0 0x7f23c8065eb0 secure :-1 s=THROTTLE_DONE pgs=1481 cs=0 l=1 rx=0x7f23c4002f30 tx=0x7f23c4010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:13.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.146+0000 7f23b6ffd700 1 -- 172.21.15.103:0/3620973049 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c4012cb0 con 0x7f23c80b3bd0 2020-04-22T14:15:13.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.146+0000 7f23cff4e700 1 -- 172.21.15.103:0/3620973049 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23c8062b10 con 0x7f23c80b3bd0 2020-04-22T14:15:13.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.146+0000 7f23b6ffd700 1 -- 172.21.15.103:0/3620973049 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23c4012e20 con 0x7f23c80b3bd0 2020-04-22T14:15:13.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.146+0000 7f23cff4e700 1 -- 172.21.15.103:0/3620973049 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23c8151e90 con 0x7f23c80b3bd0 2020-04-22T14:15:13.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.146+0000 7f23cd4e9700 1 --2- 172.21.15.103:0/3620973049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23c80b3bd0 0x7f23c8065eb0 secure :-1 s=THROTTLE_DONE pgs=1481 cs=0 l=1 rx=0x7f23c4002f30 tx=0x7f23c4010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:13.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.147+0000 7f23b6ffd700 1 -- 172.21.15.103:0/3620973049 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f23c4007190 con 0x7f23c80b3bd0 2020-04-22T14:15:13.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.147+0000 7f23cd4e9700 1 --2- 172.21.15.103:0/3620973049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23c80b3bd0 0x7f23c8065eb0 secure :-1 s=THROTTLE_DONE pgs=1481 cs=0 l=1 rx=0x7f23c4002f30 tx=0x7f23c4010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:13.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.147+0000 7f23cff4e700 1 -- 172.21.15.103:0/3620973049 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23c8056c90 con 0x7f23c80b3bd0 2020-04-22T14:15:13.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.147+0000 7f23b6ffd700 1 --2- 172.21.15.103:0/3620973049 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f23a804d870 0x7f23a804fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:13.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.147+0000 7f23b6ffd700 1 -- 172.21.15.103:0/3620973049 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f23c4061a70 con 0x7f23c80b3bd0 2020-04-22T14:15:13.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.147+0000 7f23cdcea700 1 --2- 172.21.15.103:0/3620973049 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f23a804d870 0x7f23a804fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:13.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.147+0000 7f23cdcea700 1 --2- 172.21.15.103:0/3620973049 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f23a804d870 0x7f23a804fd30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f23b8003070 tx=0x7f23b8008010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:13.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.148+0000 7f23cdcea700 1 --2- 172.21.15.103:0/3620973049 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f23a804d870 0x7f23a804fd30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f23b8003070 tx=0x7f23b8008010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:13.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.148+0000 7f23cdcea700 1 --2- 172.21.15.103:0/3620973049 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f23a804d870 0x7f23a804fd30 secure :-1 s=READY pgs=540 cs=0 l=1 rx=0x7f23b8003070 tx=0x7f23b8008010).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:13.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.151+0000 7f23cd4e9700 1 --2- 172.21.15.103:0/3620973049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23c80b3bd0 0x7f23c8065eb0 secure :-1 s=THROTTLE_DONE pgs=1481 cs=0 l=1 rx=0x7f23c4002f30 tx=0x7f23c4010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:13.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.151+0000 7f23b6ffd700 1 -- 172.21.15.103:0/3620973049 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f23c403cdf0 con 0x7f23c80b3bd0 2020-04-22T14:15:13.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:13.343+0000 7f23cff4e700 1 -- 172.21.15.103:0/3620973049 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f23c806a960 con 0x7f23c80b3bd0 2020-04-22T14:15:14.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.145+0000 7f23cd4e9700 1 --2- 172.21.15.103:0/3620973049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23c80b3bd0 0x7f23c8065eb0 secure :-1 s=READY pgs=1481 cs=0 l=1 rx=0x7f23c4002f30 tx=0x7f23c4010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:14.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.298+0000 7f23cd4e9700 1 --2- 172.21.15.103:0/3620973049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23c80b3bd0 0x7f23c8065eb0 secure :-1 s=THROTTLE_DONE pgs=1481 cs=0 l=1 rx=0x7f23c4002f30 tx=0x7f23c4010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:14.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.298+0000 7f23b6ffd700 1 -- 172.21.15.103:0/3620973049 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v74) v1 ==== 118+0+0 (secure 0 0 0) 0x7f23c4040410 con 0x7f23c80b3bd0 2020-04-22T14:15:14.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.300+0000 7f23cff4e700 1 -- 172.21.15.103:0/3620973049 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f23a804d870 msgr2=0x7f23a804fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:14.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.300+0000 7f23cff4e700 1 --2- 172.21.15.103:0/3620973049 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f23a804d870 0x7f23a804fd30 secure :-1 s=READY pgs=540 cs=0 l=1 rx=0x7f23b8003070 tx=0x7f23b8008010).stop 2020-04-22T14:15:14.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.300+0000 7f23cff4e700 1 -- 172.21.15.103:0/3620973049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23c80b3bd0 msgr2=0x7f23c8065eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:14.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.300+0000 7f23cff4e700 1 --2- 172.21.15.103:0/3620973049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23c80b3bd0 0x7f23c8065eb0 secure :-1 s=READY pgs=1481 cs=0 l=1 rx=0x7f23c4002f30 tx=0x7f23c4010ce0).stop 2020-04-22T14:15:14.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.300+0000 7f23cff4e700 1 -- 172.21.15.103:0/3620973049 shutdown_connections 2020-04-22T14:15:14.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.300+0000 7f23cff4e700 1 --2- 172.21.15.103:0/3620973049 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f23a804d870 0x7f23a804fd30 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:14.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.300+0000 7f23cff4e700 1 --2- 172.21.15.103:0/3620973049 >> v2:172.21.15.86:3300/0 conn(0x7f23c80b9140 0x7f23c8150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:14.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.300+0000 7f23cff4e700 1 --2- 172.21.15.103:0/3620973049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23c80b3bd0 0x7f23c8065eb0 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:14.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.300+0000 7f23cff4e700 1 -- 172.21.15.103:0/3620973049 >> 172.21.15.103:0/3620973049 conn(0x7f23c805b7b0 msgr2=0x7f23c813ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:14.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.300+0000 7f23cff4e700 1 -- 172.21.15.103:0/3620973049 shutdown_connections 2020-04-22T14:15:14.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.300+0000 7f23cff4e700 1 -- 172.21.15.103:0/3620973049 wait complete. 2020-04-22T14:15:14.315 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:14.330 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:15:14.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.479+0000 7fd52804d700 1 Processor -- start 2020-04-22T14:15:14.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.480+0000 7fd52804d700 1 -- start start 2020-04-22T14:15:14.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.480+0000 7fd52804d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd52012c0d0 0x7fd5201464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:14.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.480+0000 7fd52804d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd520065fe0 0x7fd52005b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:14.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.480+0000 7fd52804d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd520143300 con 0x7fd52005b8a0 2020-04-22T14:15:14.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.480+0000 7fd52804d700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd52012c4b0 con 0x7fd52012c0d0 2020-04-22T14:15:14.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.480+0000 7fd52804d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5201435a0 con 0x7fd520065fe0 2020-04-22T14:15:14.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.481+0000 7fd525de9700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd52012c0d0 0x7fd5201464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:14.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.481+0000 7fd525de9700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd52012c0d0 0x7fd5201464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55104/0 (socket says 172.21.15.103:55104) 2020-04-22T14:15:14.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.481+0000 7fd525de9700 1 -- 172.21.15.103:0/3801321660 learned_addr learned my addr 172.21.15.103:0/3801321660 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:15:14.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.481+0000 7fd5255e8700 1 --2- 172.21.15.103:0/3801321660 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd520065fe0 0x7fd52005b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:14.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.481+0000 7fd525de9700 1 -- 172.21.15.103:0/3801321660 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd520065fe0 msgr2=0x7fd52005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:14.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.481+0000 7fd525de9700 1 --2- 172.21.15.103:0/3801321660 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd520065fe0 0x7fd52005b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:14.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.481+0000 7fd525de9700 1 -- 172.21.15.103:0/3801321660 >> v1:172.21.15.86:6789/0 conn(0x7fd52005b8a0 legacy=0x7fd520062ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:14.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.481+0000 7fd525de9700 1 -- 172.21.15.103:0/3801321660 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd520143840 con 0x7fd52012c0d0 2020-04-22T14:15:14.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.481+0000 7fd525de9700 1 --2- 172.21.15.103:0/3801321660 >> v2:172.21.15.103:3300/0 conn(0x7fd52012c0d0 0x7fd5201464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd51c002f30 tx=0x7fd51c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:14.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.481+0000 7fd525de9700 1 --2- 172.21.15.103:0/3801321660 >> v2:172.21.15.103:3300/0 conn(0x7fd52012c0d0 0x7fd5201464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd51c002f30 tx=0x7fd51c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:14.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.481+0000 7fd525de9700 1 --2- 172.21.15.103:0/3801321660 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd52012c0d0 0x7fd5201464e0 secure :-1 s=READY pgs=1482 cs=0 l=1 rx=0x7fd51c002f30 tx=0x7fd51c007a40).ready entity=mon.1 client_cookie=59f98d84b58fddb server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:14.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.481+0000 7fd525de9700 1 --2- 172.21.15.103:0/3801321660 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd52012c0d0 0x7fd5201464e0 secure :-1 s=THROTTLE_DONE pgs=1482 cs=0 l=1 rx=0x7fd51c002f30 tx=0x7fd51c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:14.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.481+0000 7fd524de7700 1 -- 172.21.15.103:0/3801321660 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd51c011720 con 0x7fd52012c0d0 2020-04-22T14:15:14.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.481+0000 7fd525de9700 1 --2- 172.21.15.103:0/3801321660 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd52012c0d0 0x7fd5201464e0 secure :-1 s=THROTTLE_DONE pgs=1482 cs=0 l=1 rx=0x7fd51c002f30 tx=0x7fd51c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:14.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.481+0000 7fd525de9700 1 --2- 172.21.15.103:0/3801321660 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd52012c0d0 0x7fd5201464e0 secure :-1 s=THROTTLE_DONE pgs=1482 cs=0 l=1 rx=0x7fd51c002f30 tx=0x7fd51c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:14.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.481+0000 7fd524de7700 1 -- 172.21.15.103:0/3801321660 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51c0118c0 con 0x7fd52012c0d0 2020-04-22T14:15:14.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.481+0000 7fd524de7700 1 -- 172.21.15.103:0/3801321660 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd51c011ce0 con 0x7fd52012c0d0 2020-04-22T14:15:14.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.481+0000 7fd52804d700 1 -- 172.21.15.103:0/3801321660 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd52012c0d0 msgr2=0x7fd5201464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:14.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.481+0000 7fd52804d700 1 --2- 172.21.15.103:0/3801321660 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd52012c0d0 0x7fd5201464e0 secure :-1 s=READY pgs=1482 cs=0 l=1 rx=0x7fd51c002f30 tx=0x7fd51c007a40).stop 2020-04-22T14:15:14.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.482+0000 7fd52804d700 1 -- 172.21.15.103:0/3801321660 shutdown_connections 2020-04-22T14:15:14.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.482+0000 7fd52804d700 1 --2- 172.21.15.103:0/3801321660 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd52012c0d0 0x7fd5201464e0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:14.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.482+0000 7fd52804d700 1 --2- 172.21.15.103:0/3801321660 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd520065fe0 0x7fd52005b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:14.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.482+0000 7fd52804d700 1 -- 172.21.15.103:0/3801321660 >> 172.21.15.103:0/3801321660 conn(0x7fd5200b9160 msgr2=0x7fd52005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:14.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.482+0000 7fd52804d700 1 -- 172.21.15.103:0/3801321660 shutdown_connections 2020-04-22T14:15:14.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.482+0000 7fd52804d700 1 -- 172.21.15.103:0/3801321660 wait complete. 2020-04-22T14:15:14.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.483+0000 7fd52804d700 1 Processor -- start 2020-04-22T14:15:14.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.483+0000 7fd52804d700 1 -- start start 2020-04-22T14:15:14.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.483+0000 7fd52804d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd520065fe0 0x7fd520127f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:14.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.483+0000 7fd52804d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd520128540 con 0x7fd52012c0d0 2020-04-22T14:15:14.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.483+0000 7fd52804d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5201287e0 con 0x7fd52005b8a0 2020-04-22T14:15:14.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.483+0000 7fd52804d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5200acb50 con 0x7fd520065fe0 2020-04-22T14:15:14.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.484+0000 7fd525de9700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd52005b8a0 0x7fd520142010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47300/0 (socket says 172.21.15.103:47300) 2020-04-22T14:15:14.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.484+0000 7fd525de9700 1 -- 172.21.15.103:0/3138288516 learned_addr learned my addr 172.21.15.103:0/3138288516 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:14.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.484+0000 7fd5255e8700 1 --2- 172.21.15.103:0/3138288516 >> v2:172.21.15.86:3300/0 conn(0x7fd520065fe0 0x7fd520127f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:14.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.484+0000 7fd50effd700 1 -- 172.21.15.103:0/3138288516 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4193599803 0 0) 0x7fd5201287e0 con 0x7fd52005b8a0 2020-04-22T14:15:14.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.484+0000 7fd50effd700 1 -- 172.21.15.103:0/3138288516 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd500002fe0 con 0x7fd52005b8a0 2020-04-22T14:15:14.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.484+0000 7fd50effd700 1 -- 172.21.15.103:0/3138288516 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 305392044 0 0) 0x7fd500002fe0 con 0x7fd52005b8a0 2020-04-22T14:15:14.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.484+0000 7fd50effd700 1 -- 172.21.15.103:0/3138288516 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd5201287e0 con 0x7fd52005b8a0 2020-04-22T14:15:14.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.484+0000 7fd50effd700 1 -- 172.21.15.103:0/3138288516 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fd51c0085e0 con 0x7fd52005b8a0 2020-04-22T14:15:14.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.484+0000 7fd50effd700 1 -- 172.21.15.103:0/3138288516 >> v2:172.21.15.86:3300/0 conn(0x7fd520065fe0 msgr2=0x7fd520127f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:14.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.484+0000 7fd50effd700 1 --2- 172.21.15.103:0/3138288516 >> v2:172.21.15.86:3300/0 conn(0x7fd520065fe0 0x7fd520127f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:14.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.484+0000 7fd50effd700 1 -- 172.21.15.103:0/3138288516 >> v1:172.21.15.103:6789/0 conn(0x7fd52005b8a0 legacy=0x7fd520142010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:14.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.484+0000 7fd50effd700 1 -- 172.21.15.103:0/3138288516 >> v1:172.21.15.86:6789/0 conn(0x7fd52012c0d0 legacy=0x7fd5201266a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:14.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.484+0000 7fd50effd700 1 --2- 172.21.15.103:0/3138288516 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd5000049b0 0x7fd500004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:14.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.484+0000 7fd50effd700 1 --2- 172.21.15.103:0/3138288516 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd500003920 0x7fd500003d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:14.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.484+0000 7fd50effd700 1 --2- 172.21.15.103:0/3138288516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5000041e0 0x7fd50000b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:14.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.484+0000 7fd50effd700 1 -- 172.21.15.103:0/3138288516 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5200acb50 con 0x7fd5000041e0 2020-04-22T14:15:14.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.484+0000 7fd50effd700 1 -- 172.21.15.103:0/3138288516 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd500004750 con 0x7fd500003920 2020-04-22T14:15:14.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.484+0000 7fd50effd700 1 -- 172.21.15.103:0/3138288516 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd50000bbb0 con 0x7fd5000049b0 2020-04-22T14:15:14.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.484+0000 7fd5255e8700 1 --2- 172.21.15.103:0/3138288516 >> v2:172.21.15.86:3300/0 conn(0x7fd520065fe0 0x7fd520127f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:15:14.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.484+0000 7fd5255e8700 1 --2- 172.21.15.103:0/3138288516 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd500003920 0x7fd500003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:14.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.484+0000 7fd525de9700 1 --2- 172.21.15.103:0/3138288516 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd5000049b0 0x7fd500004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:14.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.484+0000 7fd5265ea700 1 --2- 172.21.15.103:0/3138288516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5000041e0 0x7fd50000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:14.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.484+0000 7fd5255e8700 1 -- 172.21.15.103:0/3138288516 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd5000049b0 msgr2=0x7fd500004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:14.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.485+0000 7fd5255e8700 1 --2- 172.21.15.103:0/3138288516 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd5000049b0 0x7fd500004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:14.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.485+0000 7fd5255e8700 1 -- 172.21.15.103:0/3138288516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5000041e0 msgr2=0x7fd50000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:14.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.485+0000 7fd5255e8700 1 --2- 172.21.15.103:0/3138288516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5000041e0 0x7fd50000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:14.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.485+0000 7fd5265ea700 1 -- 172.21.15.103:0/3138288516 reap_dead start 2020-04-22T14:15:14.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.485+0000 7fd5255e8700 1 -- 172.21.15.103:0/3138288516 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd520153e10 con 0x7fd500003920 2020-04-22T14:15:14.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.485+0000 7fd52804d700 1 -- 172.21.15.103:0/3138288516 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5200ac740 con 0x7fd500003920 2020-04-22T14:15:14.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.485+0000 7fd5255e8700 1 --2- 172.21.15.103:0/3138288516 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd500003920 0x7fd500003d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd510002f30 tx=0x7fd51000b270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:14.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.485+0000 7fd52804d700 1 -- 172.21.15.103:0/3138288516 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd520127f10 con 0x7fd500003920 2020-04-22T14:15:14.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.485+0000 7fd5255e8700 1 --2- 172.21.15.103:0/3138288516 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd500003920 0x7fd500003d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd510002f30 tx=0x7fd51000b270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:14.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.485+0000 7fd5255e8700 1 --2- 172.21.15.103:0/3138288516 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd500003920 0x7fd500003d80 secure :-1 s=READY pgs=1484 cs=0 l=1 rx=0x7fd510002f30 tx=0x7fd51000b270).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:14.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.485+0000 7fd5255e8700 1 --2- 172.21.15.103:0/3138288516 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd500003920 0x7fd500003d80 secure :-1 s=THROTTLE_DONE pgs=1484 cs=0 l=1 rx=0x7fd510002f30 tx=0x7fd51000b270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:14.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.485+0000 7fd50effd700 1 -- 172.21.15.103:0/3138288516 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd510007580 con 0x7fd500003920 2020-04-22T14:15:14.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.485+0000 7fd5255e8700 1 --2- 172.21.15.103:0/3138288516 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd500003920 0x7fd500003d80 secure :-1 s=THROTTLE_DONE pgs=1484 cs=0 l=1 rx=0x7fd510002f30 tx=0x7fd51000b270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:14.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.485+0000 7fd5255e8700 1 --2- 172.21.15.103:0/3138288516 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd500003920 0x7fd500003d80 secure :-1 s=THROTTLE_DONE pgs=1484 cs=0 l=1 rx=0x7fd510002f30 tx=0x7fd51000b270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:14.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.485+0000 7fd50effd700 1 -- 172.21.15.103:0/3138288516 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5100127c0 con 0x7fd500003920 2020-04-22T14:15:14.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.485+0000 7fd50effd700 1 -- 172.21.15.103:0/3138288516 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd510012b20 con 0x7fd500003920 2020-04-22T14:15:14.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.485+0000 7fd5255e8700 1 --2- 172.21.15.103:0/3138288516 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd500003920 0x7fd500003d80 secure :-1 s=THROTTLE_DONE pgs=1484 cs=0 l=1 rx=0x7fd510002f30 tx=0x7fd51000b270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:14.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.486+0000 7fd50effd700 1 -- 172.21.15.103:0/3138288516 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fd510012c80 con 0x7fd500003920 2020-04-22T14:15:14.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.486+0000 7fd5255e8700 1 --2- 172.21.15.103:0/3138288516 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd500003920 0x7fd500003d80 secure :-1 s=THROTTLE_DONE pgs=1484 cs=0 l=1 rx=0x7fd510002f30 tx=0x7fd51000b270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:14.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.486+0000 7fd52804d700 1 -- 172.21.15.103:0/3138288516 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5200ac930 con 0x7fd500003920 2020-04-22T14:15:14.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.486+0000 7fd50effd700 1 --2- 172.21.15.103:0/3138288516 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd5000518a0 0x7fd500053d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:14.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.486+0000 7fd50effd700 1 -- 172.21.15.103:0/3138288516 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd510061c10 con 0x7fd500003920 2020-04-22T14:15:14.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.486+0000 7fd525de9700 1 --2- 172.21.15.103:0/3138288516 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd5000518a0 0x7fd500053d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:14.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.487+0000 7fd525de9700 1 --2- 172.21.15.103:0/3138288516 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd5000518a0 0x7fd500053d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd51c0102c0 tx=0x7fd51c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:14.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.487+0000 7fd525de9700 1 --2- 172.21.15.103:0/3138288516 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd5000518a0 0x7fd500053d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd51c0102c0 tx=0x7fd51c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:14.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.487+0000 7fd525de9700 1 --2- 172.21.15.103:0/3138288516 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd5000518a0 0x7fd500053d60 secure :-1 s=READY pgs=541 cs=0 l=1 rx=0x7fd51c0102c0 tx=0x7fd51c007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:14.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.490+0000 7fd5255e8700 1 --2- 172.21.15.103:0/3138288516 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd500003920 0x7fd500003d80 secure :-1 s=THROTTLE_DONE pgs=1484 cs=0 l=1 rx=0x7fd510002f30 tx=0x7fd51000b270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:14.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.490+0000 7fd50effd700 1 -- 172.21.15.103:0/3138288516 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fd51003cff0 con 0x7fd500003920 2020-04-22T14:15:14.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.679+0000 7fd52804d700 1 -- 172.21.15.103:0/3138288516 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd5201281c0 con 0x7fd500003920 2020-04-22T14:15:14.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.679+0000 7fd5255e8700 1 --2- 172.21.15.103:0/3138288516 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd500003920 0x7fd500003d80 secure :-1 s=THROTTLE_DONE pgs=1484 cs=0 l=1 rx=0x7fd510002f30 tx=0x7fd51000b270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:14.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.680+0000 7fd50effd700 1 -- 172.21.15.103:0/3138288516 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+2143 (secure 0 0 0) 0x7fd510040610 con 0x7fd500003920 2020-04-22T14:15:14.683 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:15:14.683 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":74,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5987,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/3564040484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3564040484},{"type":"v1","addr":"172.21.15.86:6835","nonce":3564040484}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":70}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:15:12.286236+0000","modified":"2020-04-22T14:15:14.292028+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7452},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7452":{"gid":7452,"name":"a","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/1492911872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1492911872},{"type":"v1","addr":"172.21.15.103:6833","nonce":1492911872}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2020-04-22T14:15:14.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.681+0000 7fd52804d700 1 -- 172.21.15.103:0/3138288516 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd5000518a0 msgr2=0x7fd500053d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:14.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.681+0000 7fd52804d700 1 --2- 172.21.15.103:0/3138288516 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd5000518a0 0x7fd500053d60 secure :-1 s=READY pgs=541 cs=0 l=1 rx=0x7fd51c0102c0 tx=0x7fd51c007a40).stop 2020-04-22T14:15:14.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.681+0000 7fd52804d700 1 -- 172.21.15.103:0/3138288516 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd500003920 msgr2=0x7fd500003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:14.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.681+0000 7fd52804d700 1 --2- 172.21.15.103:0/3138288516 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd500003920 0x7fd500003d80 secure :-1 s=READY pgs=1484 cs=0 l=1 rx=0x7fd510002f30 tx=0x7fd51000b270).stop 2020-04-22T14:15:14.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.681+0000 7fd52804d700 1 -- 172.21.15.103:0/3138288516 shutdown_connections 2020-04-22T14:15:14.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.681+0000 7fd52804d700 1 --2- 172.21.15.103:0/3138288516 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd5000518a0 0x7fd500053d60 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:14.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.681+0000 7fd52804d700 1 --2- 172.21.15.103:0/3138288516 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd500003920 0x7fd500003d80 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:14.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.681+0000 7fd52804d700 1 -- 172.21.15.103:0/3138288516 >> 172.21.15.103:0/3138288516 conn(0x7fd5200b9160 msgr2=0x7fd52012b200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:14.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.681+0000 7fd52804d700 1 -- 172.21.15.103:0/3138288516 shutdown_connections 2020-04-22T14:15:14.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.681+0000 7fd52804d700 1 -- 172.21.15.103:0/3138288516 wait complete. 2020-04-22T14:15:14.685 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 74 2020-04-22T14:15:14.693 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:14.707 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:15:14.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.857+0000 7f2dabbac700 1 Processor -- start 2020-04-22T14:15:14.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.857+0000 7f2dabbac700 1 -- start start 2020-04-22T14:15:14.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.858+0000 7f2dabbac700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2da40ae1a0 0x7f2da414a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:14.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.858+0000 7f2dabbac700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2da40bd1b0 0x7f2da40bd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:14.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.858+0000 7f2dabbac700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2da414a710 con 0x7f2da4140320 2020-04-22T14:15:14.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.858+0000 7f2dabbac700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2da41462f0 con 0x7f2da40ae1a0 2020-04-22T14:15:14.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.858+0000 7f2dabbac700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da4146590 con 0x7f2da40bd1b0 2020-04-22T14:15:14.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.858+0000 7f2da9147700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2da40ae1a0 0x7f2da414a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:14.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.858+0000 7f2da9147700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2da40ae1a0 0x7f2da414a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55126/0 (socket says 172.21.15.103:55126) 2020-04-22T14:15:14.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.858+0000 7f2da9147700 1 -- 172.21.15.103:0/1423275772 learned_addr learned my addr 172.21.15.103:0/1423275772 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:15:14.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.858+0000 7f2da9948700 1 --1- 172.21.15.103:0/1423275772 >> v1:172.21.15.103:6789/0 conn(0x7f2da4140320 0x7f2da4146cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47314/0 (socket says 172.21.15.103:47314) 2020-04-22T14:15:14.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.858+0000 7f2daa149700 1 --2- 172.21.15.103:0/1423275772 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2da40bd1b0 0x7f2da40bd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:14.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.858+0000 7f2da9147700 1 -- 172.21.15.103:0/1423275772 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2da40bd1b0 msgr2=0x7f2da40bd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:14.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.858+0000 7f2da9147700 1 --2- 172.21.15.103:0/1423275772 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2da40bd1b0 0x7f2da40bd640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:14.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.858+0000 7f2da9147700 1 -- 172.21.15.103:0/1423275772 >> v1:172.21.15.103:6789/0 conn(0x7f2da4140320 legacy=0x7f2da4146cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:14.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.858+0000 7f2da8946700 1 -- 172.21.15.103:0/1423275772 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2972480108 0 0) 0x7f2da414a710 con 0x7f2da4140320 2020-04-22T14:15:14.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.858+0000 7f2da9147700 1 -- 172.21.15.103:0/1423275772 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da4146830 con 0x7f2da40ae1a0 2020-04-22T14:15:14.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.858+0000 7f2daa149700 1 --2- 172.21.15.103:0/1423275772 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2da40bd1b0 0x7f2da40bd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:15:14.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.858+0000 7f2da9147700 1 --2- 172.21.15.103:0/1423275772 >> v2:172.21.15.103:3300/0 conn(0x7f2da40ae1a0 0x7f2da414a2b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2d98002f30 tx=0x7f2d98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:14.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.859+0000 7f2da9147700 1 --2- 172.21.15.103:0/1423275772 >> v2:172.21.15.103:3300/0 conn(0x7f2da40ae1a0 0x7f2da414a2b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2d98002f30 tx=0x7f2d98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:14.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.859+0000 7f2da9147700 1 --2- 172.21.15.103:0/1423275772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2da40ae1a0 0x7f2da414a2b0 secure :-1 s=READY pgs=1486 cs=0 l=1 rx=0x7f2d98002f30 tx=0x7f2d98007a40).ready entity=mon.1 client_cookie=29abd16277d09c04 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:14.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.859+0000 7f2da9147700 1 --2- 172.21.15.103:0/1423275772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2da40ae1a0 0x7f2da414a2b0 secure :-1 s=THROTTLE_DONE pgs=1486 cs=0 l=1 rx=0x7f2d98002f30 tx=0x7f2d98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:14.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.859+0000 7f2da8946700 1 -- 172.21.15.103:0/1423275772 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d98011720 con 0x7f2da40ae1a0 2020-04-22T14:15:14.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.859+0000 7f2da9147700 1 --2- 172.21.15.103:0/1423275772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2da40ae1a0 0x7f2da414a2b0 secure :-1 s=THROTTLE_DONE pgs=1486 cs=0 l=1 rx=0x7f2d98002f30 tx=0x7f2d98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:14.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.859+0000 7f2da9147700 1 --2- 172.21.15.103:0/1423275772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2da40ae1a0 0x7f2da414a2b0 secure :-1 s=THROTTLE_DONE pgs=1486 cs=0 l=1 rx=0x7f2d98002f30 tx=0x7f2d98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:14.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.859+0000 7f2da8946700 1 -- 172.21.15.103:0/1423275772 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d980118c0 con 0x7f2da40ae1a0 2020-04-22T14:15:14.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.859+0000 7f2da8946700 1 -- 172.21.15.103:0/1423275772 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d98011ca0 con 0x7f2da40ae1a0 2020-04-22T14:15:14.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.859+0000 7f2dabbac700 1 -- 172.21.15.103:0/1423275772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2da40ae1a0 msgr2=0x7f2da414a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:14.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.859+0000 7f2dabbac700 1 --2- 172.21.15.103:0/1423275772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2da40ae1a0 0x7f2da414a2b0 secure :-1 s=READY pgs=1486 cs=0 l=1 rx=0x7f2d98002f30 tx=0x7f2d98007a40).stop 2020-04-22T14:15:14.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.859+0000 7f2dabbac700 1 -- 172.21.15.103:0/1423275772 shutdown_connections 2020-04-22T14:15:14.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.859+0000 7f2dabbac700 1 --2- 172.21.15.103:0/1423275772 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2da40bd1b0 0x7f2da40bd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:14.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.859+0000 7f2dabbac700 1 --2- 172.21.15.103:0/1423275772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2da40ae1a0 0x7f2da414a2b0 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:14.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.859+0000 7f2dabbac700 1 -- 172.21.15.103:0/1423275772 >> 172.21.15.103:0/1423275772 conn(0x7f2da405f2c0 msgr2=0x7f2da40bcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:14.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.859+0000 7f2dabbac700 1 -- 172.21.15.103:0/1423275772 shutdown_connections 2020-04-22T14:15:14.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.859+0000 7f2dabbac700 1 -- 172.21.15.103:0/1423275772 wait complete. 2020-04-22T14:15:14.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.860+0000 7f2dabbac700 1 Processor -- start 2020-04-22T14:15:14.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.860+0000 7f2dabbac700 1 -- start start 2020-04-22T14:15:14.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.861+0000 7f2dabbac700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2da40ae1a0 0x7f2da41549b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:14.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.861+0000 7f2dabbac700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2da40bd1b0 0x7f2da40bb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:14.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.861+0000 7f2dabbac700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2da4140320 0x7f2da4140a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:14.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.861+0000 7f2dabbac700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2da4154e10 con 0x7f2da40bd1b0 2020-04-22T14:15:14.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.861+0000 7f2dabbac700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2da40bbcd0 con 0x7f2da40ae1a0 2020-04-22T14:15:14.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.861+0000 7f2dabbac700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da4140e60 con 0x7f2da4140320 2020-04-22T14:15:14.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.861+0000 7f2da9948700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2da40ae1a0 0x7f2da41549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:14.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.861+0000 7f2da9948700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2da40ae1a0 0x7f2da41549b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55130/0 (socket says 172.21.15.103:55130) 2020-04-22T14:15:14.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.861+0000 7f2da9948700 1 -- 172.21.15.103:0/1428873578 learned_addr learned my addr 172.21.15.103:0/1428873578 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:15:14.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.861+0000 7f2daa149700 1 --2- 172.21.15.103:0/1428873578 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2da4140320 0x7f2da4140a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:14.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.861+0000 7f2da9147700 1 --2- 172.21.15.103:0/1428873578 >> v2:172.21.15.86:3300/0 conn(0x7f2da40bd1b0 0x7f2da40bb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:14.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.861+0000 7f2da9948700 1 -- 172.21.15.103:0/1428873578 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2da4140320 msgr2=0x7f2da4140a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:14.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.861+0000 7f2da9948700 1 --2- 172.21.15.103:0/1428873578 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2da4140320 0x7f2da4140a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:14.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.861+0000 7f2da9948700 1 -- 172.21.15.103:0/1428873578 >> v2:172.21.15.86:3300/0 conn(0x7f2da40bd1b0 msgr2=0x7f2da40bb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:14.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.861+0000 7f2da9948700 1 --2- 172.21.15.103:0/1428873578 >> v2:172.21.15.86:3300/0 conn(0x7f2da40bd1b0 0x7f2da40bb870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:14.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.861+0000 7f2da9948700 1 -- 172.21.15.103:0/1428873578 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da40b0460 con 0x7f2da40ae1a0 2020-04-22T14:15:14.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.861+0000 7f2daa149700 1 --2- 172.21.15.103:0/1428873578 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2da4140320 0x7f2da4140a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:15:14.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.861+0000 7f2da9948700 1 --2- 172.21.15.103:0/1428873578 >> v2:172.21.15.103:3300/0 conn(0x7f2da40ae1a0 0x7f2da41549b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2da0000b80 tx=0x7f2da0010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:14.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.861+0000 7f2da9948700 1 --2- 172.21.15.103:0/1428873578 >> v2:172.21.15.103:3300/0 conn(0x7f2da40ae1a0 0x7f2da41549b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2da0000b80 tx=0x7f2da0010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:14.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.861+0000 7f2da9948700 1 --2- 172.21.15.103:0/1428873578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2da40ae1a0 0x7f2da41549b0 secure :-1 s=READY pgs=1487 cs=0 l=1 rx=0x7f2da0000b80 tx=0x7f2da0010a60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:14.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.861+0000 7f2da9948700 1 --2- 172.21.15.103:0/1428873578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2da40ae1a0 0x7f2da41549b0 secure :-1 s=THROTTLE_DONE pgs=1487 cs=0 l=1 rx=0x7f2da0000b80 tx=0x7f2da0010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:14.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.861+0000 7f2d96ffd700 1 -- 172.21.15.103:0/1428873578 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2da000c970 con 0x7f2da40ae1a0 2020-04-22T14:15:14.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.862+0000 7f2da9948700 1 --2- 172.21.15.103:0/1428873578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2da40ae1a0 0x7f2da41549b0 secure :-1 s=THROTTLE_DONE pgs=1487 cs=0 l=1 rx=0x7f2da0000b80 tx=0x7f2da0010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:14.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.862+0000 7f2da9948700 1 --2- 172.21.15.103:0/1428873578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2da40ae1a0 0x7f2da41549b0 secure :-1 s=THROTTLE_DONE pgs=1487 cs=0 l=1 rx=0x7f2da0000b80 tx=0x7f2da0010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:14.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.862+0000 7f2d96ffd700 1 -- 172.21.15.103:0/1428873578 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da000cad0 con 0x7f2da40ae1a0 2020-04-22T14:15:14.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.862+0000 7f2dabbac700 1 -- 172.21.15.103:0/1428873578 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2da40b0700 con 0x7f2da40ae1a0 2020-04-22T14:15:14.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.862+0000 7f2d96ffd700 1 -- 172.21.15.103:0/1428873578 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2da00044f0 con 0x7f2da40ae1a0 2020-04-22T14:15:14.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.862+0000 7f2dabbac700 1 -- 172.21.15.103:0/1428873578 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2da4142760 con 0x7f2da40ae1a0 2020-04-22T14:15:14.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.862+0000 7f2da9948700 1 --2- 172.21.15.103:0/1428873578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2da40ae1a0 0x7f2da41549b0 secure :-1 s=THROTTLE_DONE pgs=1487 cs=0 l=1 rx=0x7f2da0000b80 tx=0x7f2da0010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:14.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.863+0000 7f2d96ffd700 1 -- 172.21.15.103:0/1428873578 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f2da0004760 con 0x7f2da40ae1a0 2020-04-22T14:15:14.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.863+0000 7f2da9948700 1 --2- 172.21.15.103:0/1428873578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2da40ae1a0 0x7f2da41549b0 secure :-1 s=THROTTLE_DONE pgs=1487 cs=0 l=1 rx=0x7f2da0000b80 tx=0x7f2da0010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:14.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.863+0000 7f2dabbac700 1 -- 172.21.15.103:0/1428873578 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2da40b02d0 con 0x7f2da40ae1a0 2020-04-22T14:15:14.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.863+0000 7f2d96ffd700 1 --2- 172.21.15.103:0/1428873578 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2d8404d9a0 0x7f2d8404fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:14.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.863+0000 7f2d96ffd700 1 -- 172.21.15.103:0/1428873578 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2da0060f70 con 0x7f2da40ae1a0 2020-04-22T14:15:14.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.864+0000 7f2da9147700 1 --2- 172.21.15.103:0/1428873578 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2d8404d9a0 0x7f2d8404fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:14.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.864+0000 7f2da9147700 1 --2- 172.21.15.103:0/1428873578 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2d8404d9a0 0x7f2d8404fe60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2d98002f30 tx=0x7f2d98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:14.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.864+0000 7f2da9147700 1 --2- 172.21.15.103:0/1428873578 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2d8404d9a0 0x7f2d8404fe60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2d98002f30 tx=0x7f2d98007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:14.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.864+0000 7f2da9147700 1 --2- 172.21.15.103:0/1428873578 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2d8404d9a0 0x7f2d8404fe60 secure :-1 s=READY pgs=542 cs=0 l=1 rx=0x7f2d98002f30 tx=0x7f2d98007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:14.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.867+0000 7f2da9948700 1 --2- 172.21.15.103:0/1428873578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2da40ae1a0 0x7f2da41549b0 secure :-1 s=THROTTLE_DONE pgs=1487 cs=0 l=1 rx=0x7f2da0000b80 tx=0x7f2da0010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:14.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:14.867+0000 7f2d96ffd700 1 -- 172.21.15.103:0/1428873578 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f2da003c2f0 con 0x7f2da40ae1a0 2020-04-22T14:15:15.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.010+0000 7f2dabbac700 1 -- 172.21.15.103:0/1428873578 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2da4056c90 con 0x7f2da40ae1a0 2020-04-22T14:15:15.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.010+0000 7f2da9948700 1 --2- 172.21.15.103:0/1428873578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2da40ae1a0 0x7f2da41549b0 secure :-1 s=THROTTLE_DONE pgs=1487 cs=0 l=1 rx=0x7f2da0000b80 tx=0x7f2da0010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.010+0000 7f2d96ffd700 1 -- 172.21.15.103:0/1428873578 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+16096 (secure 0 0 0) 0x7f2da003f910 con 0x7f2da40ae1a0 2020-04-22T14:15:15.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.012+0000 7f2dabbac700 1 -- 172.21.15.103:0/1428873578 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2d8404d9a0 msgr2=0x7f2d8404fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:15.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.012+0000 7f2dabbac700 1 --2- 172.21.15.103:0/1428873578 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2d8404d9a0 0x7f2d8404fe60 secure :-1 s=READY pgs=542 cs=0 l=1 rx=0x7f2d98002f30 tx=0x7f2d98007a40).stop 2020-04-22T14:15:15.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.012+0000 7f2dabbac700 1 -- 172.21.15.103:0/1428873578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2da40ae1a0 msgr2=0x7f2da41549b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:15.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.012+0000 7f2dabbac700 1 --2- 172.21.15.103:0/1428873578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2da40ae1a0 0x7f2da41549b0 secure :-1 s=READY pgs=1487 cs=0 l=1 rx=0x7f2da0000b80 tx=0x7f2da0010a60).stop 2020-04-22T14:15:15.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.012+0000 7f2dabbac700 1 -- 172.21.15.103:0/1428873578 shutdown_connections 2020-04-22T14:15:15.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.012+0000 7f2dabbac700 1 --2- 172.21.15.103:0/1428873578 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2da4140320 0x7f2da4140a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:15.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.012+0000 7f2dabbac700 1 --2- 172.21.15.103:0/1428873578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2da40ae1a0 0x7f2da41549b0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:15.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.012+0000 7f2dabbac700 1 --2- 172.21.15.103:0/1428873578 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2d8404d9a0 0x7f2d8404fe60 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:15.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.012+0000 7f2dabbac700 1 --2- 172.21.15.103:0/1428873578 >> v2:172.21.15.86:3300/0 conn(0x7f2da40bd1b0 0x7f2da40bb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:15.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.012+0000 7f2dabbac700 1 -- 172.21.15.103:0/1428873578 >> 172.21.15.103:0/1428873578 conn(0x7f2da405f2c0 msgr2=0x7f2da405ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:15.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.012+0000 7f2dabbac700 1 -- 172.21.15.103:0/1428873578 shutdown_connections 2020-04-22T14:15:15.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.012+0000 7f2dabbac700 1 -- 172.21.15.103:0/1428873578 wait complete. 2020-04-22T14:15:15.020 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:15:15.020 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":102,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:15:14.291464+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:15:10.023228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2020-04-22T14:15:11.048528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:15:15.025 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:15.039 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:15:15.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.191+0000 7fb7f49fe700 1 Processor -- start 2020-04-22T14:15:15.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.191+0000 7fb7f49fe700 1 -- start start 2020-04-22T14:15:15.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.192+0000 7fb7f49fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb7f0062170 0x7fb7f00b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:15.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.192+0000 7fb7f49fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb7f00b5210 0x7fb7f00adf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:15.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.192+0000 7fb7f49fe700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7f00b5650 con 0x7fb7f0152a90 2020-04-22T14:15:15.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.192+0000 7fb7f49fe700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7f00614f0 con 0x7fb7f0062170 2020-04-22T14:15:15.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.192+0000 7fb7f49fe700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7f0061790 con 0x7fb7f00b5210 2020-04-22T14:15:15.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.192+0000 7fb7ef59e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb7f00b5210 0x7fb7f00adf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:15.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.192+0000 7fb7ef59e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb7f00b5210 0x7fb7f00adf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55138/0 (socket says 172.21.15.103:55138) 2020-04-22T14:15:15.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.192+0000 7fb7ef59e700 1 -- 172.21.15.103:0/3046270903 learned_addr learned my addr 172.21.15.103:0/3046270903 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:15:15.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.192+0000 7fb7ee59c700 1 --2- 172.21.15.103:0/3046270903 >> v2:172.21.15.86:3300/0 conn(0x7fb7f0062170 0x7fb7f00b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:15.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.192+0000 7fb7ef59e700 1 -- 172.21.15.103:0/3046270903 >> v2:172.21.15.86:3300/0 conn(0x7fb7f0062170 msgr2=0x7fb7f00b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:15.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.192+0000 7fb7ef59e700 1 --2- 172.21.15.103:0/3046270903 >> v2:172.21.15.86:3300/0 conn(0x7fb7f0062170 0x7fb7f00b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:15.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.192+0000 7fb7ef59e700 1 -- 172.21.15.103:0/3046270903 >> v1:172.21.15.86:6789/0 conn(0x7fb7f0152a90 legacy=0x7fb7f00b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:15.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.192+0000 7fb7ef59e700 1 -- 172.21.15.103:0/3046270903 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f0061a30 con 0x7fb7f00b5210 2020-04-22T14:15:15.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.192+0000 7fb7ee59c700 1 --2- 172.21.15.103:0/3046270903 >> v2:172.21.15.86:3300/0 conn(0x7fb7f0062170 0x7fb7f00b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:15:15.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.192+0000 7fb7ef59e700 1 --2- 172.21.15.103:0/3046270903 >> v2:172.21.15.103:3300/0 conn(0x7fb7f00b5210 0x7fb7f00adf50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb7f00ad5a0 tx=0x7fb7e8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.192+0000 7fb7ef59e700 1 --2- 172.21.15.103:0/3046270903 >> v2:172.21.15.103:3300/0 conn(0x7fb7f00b5210 0x7fb7f00adf50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb7f00ad5a0 tx=0x7fb7e8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.192+0000 7fb7ef59e700 1 --2- 172.21.15.103:0/3046270903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7f00b5210 0x7fb7f00adf50 secure :-1 s=READY pgs=1488 cs=0 l=1 rx=0x7fb7f00ad5a0 tx=0x7fb7e8007dc0).ready entity=mon.1 client_cookie=f728edb2e37b1e67 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:15.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.192+0000 7fb7ef59e700 1 --2- 172.21.15.103:0/3046270903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7f00b5210 0x7fb7f00adf50 secure :-1 s=THROTTLE_DONE pgs=1488 cs=0 l=1 rx=0x7fb7f00ad5a0 tx=0x7fb7e8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.192+0000 7fb7edd9b700 1 -- 172.21.15.103:0/3046270903 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7e800a180 con 0x7fb7f00b5210 2020-04-22T14:15:15.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.192+0000 7fb7ef59e700 1 --2- 172.21.15.103:0/3046270903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7f00b5210 0x7fb7f00adf50 secure :-1 s=THROTTLE_DONE pgs=1488 cs=0 l=1 rx=0x7fb7f00ad5a0 tx=0x7fb7e8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.192+0000 7fb7ef59e700 1 --2- 172.21.15.103:0/3046270903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7f00b5210 0x7fb7f00adf50 secure :-1 s=THROTTLE_DONE pgs=1488 cs=0 l=1 rx=0x7fb7f00ad5a0 tx=0x7fb7e8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.192+0000 7fb7edd9b700 1 -- 172.21.15.103:0/3046270903 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e800a2e0 con 0x7fb7f00b5210 2020-04-22T14:15:15.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.192+0000 7fb7edd9b700 1 -- 172.21.15.103:0/3046270903 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7e800a6c0 con 0x7fb7f00b5210 2020-04-22T14:15:15.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.192+0000 7fb7f49fe700 1 -- 172.21.15.103:0/3046270903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7f00b5210 msgr2=0x7fb7f00adf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:15.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.192+0000 7fb7f49fe700 1 --2- 172.21.15.103:0/3046270903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7f00b5210 0x7fb7f00adf50 secure :-1 s=READY pgs=1488 cs=0 l=1 rx=0x7fb7f00ad5a0 tx=0x7fb7e8007dc0).stop 2020-04-22T14:15:15.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.193+0000 7fb7f49fe700 1 -- 172.21.15.103:0/3046270903 shutdown_connections 2020-04-22T14:15:15.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.193+0000 7fb7f49fe700 1 --2- 172.21.15.103:0/3046270903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7f00b5210 0x7fb7f00adf50 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:15.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.193+0000 7fb7f49fe700 1 --2- 172.21.15.103:0/3046270903 >> v2:172.21.15.86:3300/0 conn(0x7fb7f0062170 0x7fb7f00b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:15.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.193+0000 7fb7f49fe700 1 -- 172.21.15.103:0/3046270903 >> 172.21.15.103:0/3046270903 conn(0x7fb7f005ad30 msgr2=0x7fb7f005b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:15.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.193+0000 7fb7f49fe700 1 -- 172.21.15.103:0/3046270903 shutdown_connections 2020-04-22T14:15:15.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.193+0000 7fb7f49fe700 1 -- 172.21.15.103:0/3046270903 wait complete. 2020-04-22T14:15:15.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.194+0000 7fb7f49fe700 1 Processor -- start 2020-04-22T14:15:15.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.194+0000 7fb7f49fe700 1 -- start start 2020-04-22T14:15:15.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.195+0000 7fb7f49fe700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb7f0062170 0x7fb7f0154b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:15.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.195+0000 7fb7f49fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb7f0152a90 0x7fb7f0066010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:15.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.195+0000 7fb7f49fe700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7f0152580 con 0x7fb7f00b5210 2020-04-22T14:15:15.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.195+0000 7fb7f49fe700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7f0139280 con 0x7fb7f0152a90 2020-04-22T14:15:15.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.195+0000 7fb7f49fe700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f0139520 con 0x7fb7f0062170 2020-04-22T14:15:15.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.195+0000 7fb7ee59c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb7f00b5210 0x7fb7f00adee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47334/0 (socket says 172.21.15.103:47334) 2020-04-22T14:15:15.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.195+0000 7fb7ee59c700 1 -- 172.21.15.103:0/1381818048 learned_addr learned my addr 172.21.15.103:0/1381818048 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:15.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.195+0000 7fb7ef59e700 1 --2- 172.21.15.103:0/1381818048 >> v2:172.21.15.103:3300/0 conn(0x7fb7f0152a90 0x7fb7f0066010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:15.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.195+0000 7fb7eed9d700 1 --2- 172.21.15.103:0/1381818048 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb7f0062170 0x7fb7f0154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:15.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.195+0000 7fb7ef59e700 1 -- 172.21.15.103:0/1381818048 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb7f0062170 msgr2=0x7fb7f0154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:15.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.195+0000 7fb7ef59e700 1 --2- 172.21.15.103:0/1381818048 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb7f0062170 0x7fb7f0154b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:15.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.195+0000 7fb7ef59e700 1 -- 172.21.15.103:0/1381818048 >> v1:172.21.15.103:6789/0 conn(0x7fb7f00b5210 legacy=0x7fb7f00adee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:15.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.195+0000 7fb7ef59e700 1 -- 172.21.15.103:0/1381818048 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f01397c0 con 0x7fb7f0152a90 2020-04-22T14:15:15.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.195+0000 7fb7e77fe700 1 -- 172.21.15.103:0/1381818048 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 435617901 0 0) 0x7fb7f0152580 con 0x7fb7f00b5210 2020-04-22T14:15:15.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.195+0000 7fb7ef59e700 1 --2- 172.21.15.103:0/1381818048 >> v2:172.21.15.103:3300/0 conn(0x7fb7f0152a90 0x7fb7f0066010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb7f00ad5a0 tx=0x7fb7e8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.195+0000 7fb7ef59e700 1 --2- 172.21.15.103:0/1381818048 >> v2:172.21.15.103:3300/0 conn(0x7fb7f0152a90 0x7fb7f0066010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb7f00ad5a0 tx=0x7fb7e8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.195+0000 7fb7ef59e700 1 --2- 172.21.15.103:0/1381818048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7f0152a90 0x7fb7f0066010 secure :-1 s=READY pgs=1490 cs=0 l=1 rx=0x7fb7f00ad5a0 tx=0x7fb7e8007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:15.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.195+0000 7fb7ef59e700 1 --2- 172.21.15.103:0/1381818048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7f0152a90 0x7fb7f0066010 secure :-1 s=THROTTLE_DONE pgs=1490 cs=0 l=1 rx=0x7fb7f00ad5a0 tx=0x7fb7e8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.195+0000 7fb7ef59e700 1 --2- 172.21.15.103:0/1381818048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7f0152a90 0x7fb7f0066010 secure :-1 s=THROTTLE_DONE pgs=1490 cs=0 l=1 rx=0x7fb7f00ad5a0 tx=0x7fb7e8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.195+0000 7fb7e77fe700 1 -- 172.21.15.103:0/1381818048 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7e800a760 con 0x7fb7f0152a90 2020-04-22T14:15:15.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.195+0000 7fb7ef59e700 1 --2- 172.21.15.103:0/1381818048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7f0152a90 0x7fb7f0066010 secure :-1 s=THROTTLE_DONE pgs=1490 cs=0 l=1 rx=0x7fb7f00ad5a0 tx=0x7fb7e8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.195+0000 7fb7e77fe700 1 -- 172.21.15.103:0/1381818048 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e80114d0 con 0x7fb7f0152a90 2020-04-22T14:15:15.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.195+0000 7fb7f49fe700 1 -- 172.21.15.103:0/1381818048 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7f00ae5f0 con 0x7fb7f0152a90 2020-04-22T14:15:15.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.195+0000 7fb7e77fe700 1 -- 172.21.15.103:0/1381818048 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7e8005c30 con 0x7fb7f0152a90 2020-04-22T14:15:15.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.195+0000 7fb7f49fe700 1 -- 172.21.15.103:0/1381818048 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f0135890 con 0x7fb7f0152a90 2020-04-22T14:15:15.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.196+0000 7fb7ef59e700 1 --2- 172.21.15.103:0/1381818048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7f0152a90 0x7fb7f0066010 secure :-1 s=THROTTLE_DONE pgs=1490 cs=0 l=1 rx=0x7fb7f00ad5a0 tx=0x7fb7e8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.196+0000 7fb7e77fe700 1 -- 172.21.15.103:0/1381818048 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fb7e8010700 con 0x7fb7f0152a90 2020-04-22T14:15:15.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.196+0000 7fb7ef59e700 1 --2- 172.21.15.103:0/1381818048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7f0152a90 0x7fb7f0066010 secure :-1 s=THROTTLE_DONE pgs=1490 cs=0 l=1 rx=0x7fb7f00ad5a0 tx=0x7fb7e8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.197+0000 7fb7f49fe700 1 -- 172.21.15.103:0/1381818048 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7f0139fe0 con 0x7fb7f0152a90 2020-04-22T14:15:15.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.197+0000 7fb7e77fe700 1 --2- 172.21.15.103:0/1381818048 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb7d404d920 0x7fb7d404fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:15.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.197+0000 7fb7e77fe700 1 -- 172.21.15.103:0/1381818048 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb7e8061de0 con 0x7fb7f0152a90 2020-04-22T14:15:15.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.197+0000 7fb7eed9d700 1 --2- 172.21.15.103:0/1381818048 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb7d404d920 0x7fb7d404fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:15.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.197+0000 7fb7eed9d700 1 --2- 172.21.15.103:0/1381818048 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb7d404d920 0x7fb7d404fde0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb7e0001f50 tx=0x7fb7e0003980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.197+0000 7fb7eed9d700 1 --2- 172.21.15.103:0/1381818048 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb7d404d920 0x7fb7d404fde0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb7e0001f50 tx=0x7fb7e0003980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.197+0000 7fb7eed9d700 1 --2- 172.21.15.103:0/1381818048 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb7d404d920 0x7fb7d404fde0 secure :-1 s=READY pgs=543 cs=0 l=1 rx=0x7fb7e0001f50 tx=0x7fb7e0003980).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:15.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.201+0000 7fb7ef59e700 1 --2- 172.21.15.103:0/1381818048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7f0152a90 0x7fb7f0066010 secure :-1 s=THROTTLE_DONE pgs=1490 cs=0 l=1 rx=0x7fb7f00ad5a0 tx=0x7fb7e8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.201+0000 7fb7e77fe700 1 -- 172.21.15.103:0/1381818048 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fb7e803d2e0 con 0x7fb7f0152a90 2020-04-22T14:15:15.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.394+0000 7fb7f49fe700 1 -- 172.21.15.103:0/1381818048 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fb7f0056c90 con 0x7fb7f0152a90 2020-04-22T14:15:15.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.400+0000 7fb7ef59e700 1 --2- 172.21.15.103:0/1381818048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7f0152a90 0x7fb7f0066010 secure :-1 s=THROTTLE_DONE pgs=1490 cs=0 l=1 rx=0x7fb7f00ad5a0 tx=0x7fb7e8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.400+0000 7fb7e77fe700 1 -- 172.21.15.103:0/1381818048 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v37) v1 ==== 184+0+0 (secure 0 0 0) 0x7fb7e8040900 con 0x7fb7f0152a90 2020-04-22T14:15:15.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.402+0000 7fb7f49fe700 1 -- 172.21.15.103:0/1381818048 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb7d404d920 msgr2=0x7fb7d404fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:15.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.402+0000 7fb7f49fe700 1 --2- 172.21.15.103:0/1381818048 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb7d404d920 0x7fb7d404fde0 secure :-1 s=READY pgs=543 cs=0 l=1 rx=0x7fb7e0001f50 tx=0x7fb7e0003980).stop 2020-04-22T14:15:15.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.402+0000 7fb7f49fe700 1 -- 172.21.15.103:0/1381818048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7f0152a90 msgr2=0x7fb7f0066010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:15.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.402+0000 7fb7f49fe700 1 --2- 172.21.15.103:0/1381818048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7f0152a90 0x7fb7f0066010 secure :-1 s=READY pgs=1490 cs=0 l=1 rx=0x7fb7f00ad5a0 tx=0x7fb7e8007dc0).stop 2020-04-22T14:15:15.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.402+0000 7fb7f49fe700 1 -- 172.21.15.103:0/1381818048 shutdown_connections 2020-04-22T14:15:15.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.402+0000 7fb7f49fe700 1 --2- 172.21.15.103:0/1381818048 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb7d404d920 0x7fb7d404fde0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:15.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.402+0000 7fb7f49fe700 1 --2- 172.21.15.103:0/1381818048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7f0152a90 0x7fb7f0066010 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:15.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.402+0000 7fb7f49fe700 1 --2- 172.21.15.103:0/1381818048 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb7f0062170 0x7fb7f0154b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:15.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.402+0000 7fb7f49fe700 1 -- 172.21.15.103:0/1381818048 >> 172.21.15.103:0/1381818048 conn(0x7fb7f005ad30 msgr2=0x7fb7f005b110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:15.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.402+0000 7fb7f49fe700 1 -- 172.21.15.103:0/1381818048 shutdown_connections 2020-04-22T14:15:15.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.402+0000 7fb7f49fe700 1 -- 172.21.15.103:0/1381818048 wait complete. 2020-04-22T14:15:15.406 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.0 2020-04-22T14:15:15.414 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:15.427 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:15:15.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.577+0000 7f04a120e700 1 Processor -- start 2020-04-22T14:15:15.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.577+0000 7f04a120e700 1 -- start start 2020-04-22T14:15:15.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.578+0000 7f04a120e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f049c152a90 0x7f049c0b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:15.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.578+0000 7f04a120e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f049c062170 0x7f049c0b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:15.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.578+0000 7f04a120e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f049c152e70 con 0x7f049c0b5210 2020-04-22T14:15:15.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.578+0000 7f04a120e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f049c0614f0 con 0x7f049c152a90 2020-04-22T14:15:15.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.578+0000 7f04a120e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f049c061790 con 0x7f049c062170 2020-04-22T14:15:15.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.578+0000 7f04a0a0d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f049c0b5210 0x7f049c156500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47340/0 (socket says 172.21.15.103:47340) 2020-04-22T14:15:15.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.578+0000 7f04a0a0d700 1 -- 172.21.15.103:0/3668002834 learned_addr learned my addr 172.21.15.103:0/3668002834 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:15.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.579+0000 7f049ad9d700 1 --2- 172.21.15.103:0/3668002834 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f049c062170 0x7f049c0b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:15.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.579+0000 7f049b59e700 1 --2- 172.21.15.103:0/3668002834 >> v2:172.21.15.86:3300/0 conn(0x7f049c152a90 0x7f049c0b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:15.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.579+0000 7f049a59c700 1 -- 172.21.15.103:0/3668002834 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2553882827 0 0) 0x7f049c152e70 con 0x7f049c0b5210 2020-04-22T14:15:15.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.579+0000 7f049a59c700 1 -- 172.21.15.103:0/3668002834 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0484003230 con 0x7f049c0b5210 2020-04-22T14:15:15.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.579+0000 7f049a59c700 1 -- 172.21.15.103:0/3668002834 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1072847872 0 0) 0x7f0484003230 con 0x7f049c0b5210 2020-04-22T14:15:15.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.579+0000 7f049a59c700 1 -- 172.21.15.103:0/3668002834 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f049c062170 msgr2=0x7f049c0b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:15.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.579+0000 7f049a59c700 1 --2- 172.21.15.103:0/3668002834 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f049c062170 0x7f049c0b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:15.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.579+0000 7f049a59c700 1 -- 172.21.15.103:0/3668002834 >> v2:172.21.15.86:3300/0 conn(0x7f049c152a90 msgr2=0x7f049c0b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:15.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.579+0000 7f049a59c700 1 --2- 172.21.15.103:0/3668002834 >> v2:172.21.15.86:3300/0 conn(0x7f049c152a90 0x7f049c0b44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:15.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.579+0000 7f049a59c700 1 -- 172.21.15.103:0/3668002834 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049c0b56a0 con 0x7f049c0b5210 2020-04-22T14:15:15.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.579+0000 7f049a59c700 1 -- 172.21.15.103:0/3668002834 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f04940016d0 con 0x7f049c0b5210 2020-04-22T14:15:15.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.579+0000 7f049a59c700 1 -- 172.21.15.103:0/3668002834 >> v1:172.21.15.103:6789/0 conn(0x7f049c0b5210 legacy=0x7f049c156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:15.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.579+0000 7f049a59c700 1 --2- 172.21.15.103:0/3668002834 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f049c062170 0x7f0484003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:15.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.579+0000 7f049a59c700 1 --2- 172.21.15.103:0/3668002834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0484003b80 0x7f0484003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:15.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.579+0000 7f049a59c700 1 --2- 172.21.15.103:0/3668002834 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0484004570 0x7f04840049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:15.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.579+0000 7f049a59c700 1 -- 172.21.15.103:0/3668002834 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049c0614f0 con 0x7f0484004570 2020-04-22T14:15:15.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.579+0000 7f049a59c700 1 -- 172.21.15.103:0/3668002834 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049c061790 con 0x7f0484003b80 2020-04-22T14:15:15.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.579+0000 7f049a59c700 1 -- 172.21.15.103:0/3668002834 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0484005000 con 0x7f049c062170 2020-04-22T14:15:15.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.579+0000 7f049ad9d700 1 --2- 172.21.15.103:0/3668002834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0484003b80 0x7f0484003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:15.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.579+0000 7f049b59e700 1 --2- 172.21.15.103:0/3668002834 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f049c062170 0x7f0484003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:15.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.579+0000 7f04a0a0d700 1 --2- 172.21.15.103:0/3668002834 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0484004570 0x7f04840049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:15.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.579+0000 7f049ad9d700 1 -- 172.21.15.103:0/3668002834 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f049c062170 msgr2=0x7f0484003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:15.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.579+0000 7f049ad9d700 1 --2- 172.21.15.103:0/3668002834 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f049c062170 0x7f0484003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:15.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.579+0000 7f049ad9d700 1 -- 172.21.15.103:0/3668002834 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0484004570 msgr2=0x7f04840049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:15.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.579+0000 7f049ad9d700 1 --2- 172.21.15.103:0/3668002834 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0484004570 0x7f04840049d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:15.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.579+0000 7f049ad9d700 1 -- 172.21.15.103:0/3668002834 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0484003230 con 0x7f0484003b80 2020-04-22T14:15:15.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.579+0000 7f049ad9d700 1 --2- 172.21.15.103:0/3668002834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0484003b80 0x7f0484003fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0490002f30 tx=0x7f049c05a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.579+0000 7f049ad9d700 1 --2- 172.21.15.103:0/3668002834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0484003b80 0x7f0484003fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0490002f30 tx=0x7f049c05a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.579+0000 7f049ad9d700 1 --2- 172.21.15.103:0/3668002834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0484003b80 0x7f0484003fe0 secure :-1 s=READY pgs=1492 cs=0 l=1 rx=0x7f0490002f30 tx=0x7f049c05a720).ready entity=mon.1 client_cookie=d285018bea407ee6 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:15.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.579+0000 7f049ad9d700 1 --2- 172.21.15.103:0/3668002834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0484003b80 0x7f0484003fe0 secure :-1 s=THROTTLE_DONE pgs=1492 cs=0 l=1 rx=0x7f0490002f30 tx=0x7f049c05a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.579+0000 7f049a59c700 1 -- 172.21.15.103:0/3668002834 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0490008db0 con 0x7f0484003b80 2020-04-22T14:15:15.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.580+0000 7f049ad9d700 1 --2- 172.21.15.103:0/3668002834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0484003b80 0x7f0484003fe0 secure :-1 s=THROTTLE_DONE pgs=1492 cs=0 l=1 rx=0x7f0490002f30 tx=0x7f049c05a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.580+0000 7f049a59c700 1 -- 172.21.15.103:0/3668002834 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0490010920 con 0x7f0484003b80 2020-04-22T14:15:15.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.580+0000 7f049ad9d700 1 --2- 172.21.15.103:0/3668002834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0484003b80 0x7f0484003fe0 secure :-1 s=THROTTLE_DONE pgs=1492 cs=0 l=1 rx=0x7f0490002f30 tx=0x7f049c05a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.580+0000 7f049a59c700 1 -- 172.21.15.103:0/3668002834 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0490010c80 con 0x7f0484003b80 2020-04-22T14:15:15.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.580+0000 7f04a120e700 1 -- 172.21.15.103:0/3668002834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0484003b80 msgr2=0x7f0484003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:15.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.580+0000 7f04a120e700 1 --2- 172.21.15.103:0/3668002834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0484003b80 0x7f0484003fe0 secure :-1 s=READY pgs=1492 cs=0 l=1 rx=0x7f0490002f30 tx=0x7f049c05a720).stop 2020-04-22T14:15:15.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.580+0000 7f04a0a0d700 1 -- 172.21.15.103:0/3668002834 reap_dead start 2020-04-22T14:15:15.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.580+0000 7f04a120e700 1 -- 172.21.15.103:0/3668002834 shutdown_connections 2020-04-22T14:15:15.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.580+0000 7f04a120e700 1 -- 172.21.15.103:0/3668002834 >> 172.21.15.103:0/3668002834 conn(0x7f049c05ad30 msgr2=0x7f049c05b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:15.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.580+0000 7f04a120e700 1 -- 172.21.15.103:0/3668002834 shutdown_connections 2020-04-22T14:15:15.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.580+0000 7f04a120e700 1 -- 172.21.15.103:0/3668002834 wait complete. 2020-04-22T14:15:15.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.581+0000 7f04a120e700 1 Processor -- start 2020-04-22T14:15:15.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.581+0000 7f04a120e700 1 -- start start 2020-04-22T14:15:15.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.582+0000 7f04a120e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f049c0addc0 0x7f049c062c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:15.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.582+0000 7f04a120e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f049c134850 con 0x7f049c0ae1a0 2020-04-22T14:15:15.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.582+0000 7f04a120e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f049c0b1510 con 0x7f049c0b10a0 2020-04-22T14:15:15.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.582+0000 7f04a120e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f049c063280 con 0x7f049c0addc0 2020-04-22T14:15:15.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.582+0000 7f04a0a0d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f049c0b10a0 0x7f049c0655e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47354/0 (socket says 172.21.15.103:47354) 2020-04-22T14:15:15.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.582+0000 7f04a0a0d700 1 -- 172.21.15.103:0/278316274 learned_addr learned my addr 172.21.15.103:0/278316274 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:15.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.582+0000 7f0483fff700 1 -- 172.21.15.103:0/278316274 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1771328056 0 0) 0x7f049c0b1510 con 0x7f049c0b10a0 2020-04-22T14:15:15.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.582+0000 7f049b59e700 1 --2- 172.21.15.103:0/278316274 >> v2:172.21.15.86:3300/0 conn(0x7f049c0addc0 0x7f049c062c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:15.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.582+0000 7f0483fff700 1 -- 172.21.15.103:0/278316274 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f047c003230 con 0x7f049c0b10a0 2020-04-22T14:15:15.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.583+0000 7f0483fff700 1 -- 172.21.15.103:0/278316274 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 881782246 0 0) 0x7f047c003230 con 0x7f049c0b10a0 2020-04-22T14:15:15.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.583+0000 7f0483fff700 1 -- 172.21.15.103:0/278316274 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f049c0b1510 con 0x7f049c0b10a0 2020-04-22T14:15:15.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.583+0000 7f0483fff700 1 -- 172.21.15.103:0/278316274 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f04940019c0 con 0x7f049c0b10a0 2020-04-22T14:15:15.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.583+0000 7f0483fff700 1 -- 172.21.15.103:0/278316274 >> v2:172.21.15.86:3300/0 conn(0x7f049c0addc0 msgr2=0x7f049c062c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:15.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.583+0000 7f0483fff700 1 --2- 172.21.15.103:0/278316274 >> v2:172.21.15.86:3300/0 conn(0x7f049c0addc0 0x7f049c062c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:15.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.583+0000 7f0483fff700 1 -- 172.21.15.103:0/278316274 >> v1:172.21.15.103:6789/0 conn(0x7f049c0b10a0 legacy=0x7f049c0655e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:15.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.583+0000 7f0483fff700 1 -- 172.21.15.103:0/278316274 >> v1:172.21.15.86:6789/0 conn(0x7f049c0ae1a0 legacy=0x7f049c064ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:15.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.583+0000 7f0483fff700 1 --2- 172.21.15.103:0/278316274 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f047c0037f0 0x7f047c003c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:15.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.583+0000 7f0483fff700 1 --2- 172.21.15.103:0/278316274 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f047c0044d0 0x7f047c004910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:15.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.583+0000 7f0483fff700 1 --2- 172.21.15.103:0/278316274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f047c004d70 0x7f047c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:15.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.583+0000 7f0483fff700 1 -- 172.21.15.103:0/278316274 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049c063280 con 0x7f047c004d70 2020-04-22T14:15:15.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.583+0000 7f0483fff700 1 -- 172.21.15.103:0/278316274 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f047c005310 con 0x7f047c0044d0 2020-04-22T14:15:15.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.583+0000 7f0483fff700 1 -- 172.21.15.103:0/278316274 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f047c00bb80 con 0x7f047c0037f0 2020-04-22T14:15:15.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.583+0000 7f049ad9d700 1 --2- 172.21.15.103:0/278316274 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f047c0044d0 0x7f047c004910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:15.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.583+0000 7f049b59e700 1 --2- 172.21.15.103:0/278316274 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f047c0037f0 0x7f047c003c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:15.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.583+0000 7f04a0a0d700 1 --2- 172.21.15.103:0/278316274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f047c004d70 0x7f047c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:15.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.583+0000 7f049ad9d700 1 -- 172.21.15.103:0/278316274 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f047c0037f0 msgr2=0x7f047c003c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:15.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.583+0000 7f049ad9d700 1 --2- 172.21.15.103:0/278316274 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f047c0037f0 0x7f047c003c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:15.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.583+0000 7f049ad9d700 1 -- 172.21.15.103:0/278316274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f047c004d70 msgr2=0x7f047c00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:15.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.583+0000 7f049ad9d700 1 --2- 172.21.15.103:0/278316274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f047c004d70 0x7f047c00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:15.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.583+0000 7f049ad9d700 1 -- 172.21.15.103:0/278316274 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049c063520 con 0x7f047c0044d0 2020-04-22T14:15:15.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.583+0000 7f04a120e700 1 -- 172.21.15.103:0/278316274 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f049c064a30 con 0x7f047c0044d0 2020-04-22T14:15:15.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.583+0000 7f049ad9d700 1 --2- 172.21.15.103:0/278316274 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f047c0044d0 0x7f047c004910 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f049c063de0 tx=0x7f049c05a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.583+0000 7f04a0a0d700 1 --2- 172.21.15.103:0/278316274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f047c004d70 0x7f047c00b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:15:15.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.583+0000 7f04a0a0d700 1 -- 172.21.15.103:0/278316274 reap_dead start 2020-04-22T14:15:15.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.583+0000 7f04a120e700 1 -- 172.21.15.103:0/278316274 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f049c1265b0 con 0x7f047c0044d0 2020-04-22T14:15:15.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.583+0000 7f049ad9d700 1 --2- 172.21.15.103:0/278316274 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f047c0044d0 0x7f047c004910 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f049c063de0 tx=0x7f049c05a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.583+0000 7f049ad9d700 1 --2- 172.21.15.103:0/278316274 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f047c0044d0 0x7f047c004910 secure :-1 s=READY pgs=1494 cs=0 l=1 rx=0x7f049c063de0 tx=0x7f049c05a720).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:15.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.583+0000 7f049ad9d700 1 --2- 172.21.15.103:0/278316274 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f047c0044d0 0x7f047c004910 secure :-1 s=THROTTLE_DONE pgs=1494 cs=0 l=1 rx=0x7f049c063de0 tx=0x7f049c05a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.583+0000 7f049ad9d700 1 --2- 172.21.15.103:0/278316274 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f047c0044d0 0x7f047c004910 secure :-1 s=THROTTLE_DONE pgs=1494 cs=0 l=1 rx=0x7f049c063de0 tx=0x7f049c05a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.583+0000 7f0483fff700 1 -- 172.21.15.103:0/278316274 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0490008e90 con 0x7f047c0044d0 2020-04-22T14:15:15.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.583+0000 7f049ad9d700 1 --2- 172.21.15.103:0/278316274 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f047c0044d0 0x7f047c004910 secure :-1 s=THROTTLE_DONE pgs=1494 cs=0 l=1 rx=0x7f049c063de0 tx=0x7f049c05a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.583+0000 7f0483fff700 1 -- 172.21.15.103:0/278316274 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04900056c0 con 0x7f047c0044d0 2020-04-22T14:15:15.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.583+0000 7f0483fff700 1 -- 172.21.15.103:0/278316274 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0490005a20 con 0x7f047c0044d0 2020-04-22T14:15:15.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.584+0000 7f049ad9d700 1 --2- 172.21.15.103:0/278316274 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f047c0044d0 0x7f047c004910 secure :-1 s=THROTTLE_DONE pgs=1494 cs=0 l=1 rx=0x7f049c063de0 tx=0x7f049c05a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.584+0000 7f04a120e700 1 -- 172.21.15.103:0/278316274 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0474003340 con 0x7f047c0044d0 2020-04-22T14:15:15.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.584+0000 7f0483fff700 1 -- 172.21.15.103:0/278316274 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f0490005b80 con 0x7f047c0044d0 2020-04-22T14:15:15.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.584+0000 7f049ad9d700 1 --2- 172.21.15.103:0/278316274 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f047c0044d0 0x7f047c004910 secure :-1 s=THROTTLE_DONE pgs=1494 cs=0 l=1 rx=0x7f049c063de0 tx=0x7f049c05a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.585+0000 7f0483fff700 1 --2- 172.21.15.103:0/278316274 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f047c0510d0 0x7f047c053590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:15.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.585+0000 7f0483fff700 1 -- 172.21.15.103:0/278316274 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0490061280 con 0x7f047c0044d0 2020-04-22T14:15:15.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.585+0000 7f049b59e700 1 --2- 172.21.15.103:0/278316274 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f047c0510d0 0x7f047c053590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:15.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.585+0000 7f049b59e700 1 --2- 172.21.15.103:0/278316274 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f047c0510d0 0x7f047c053590 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f048c0032b0 tx=0x7f048c0072e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.585+0000 7f049b59e700 1 --2- 172.21.15.103:0/278316274 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f047c0510d0 0x7f047c053590 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f048c0032b0 tx=0x7f048c0072e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.585+0000 7f049b59e700 1 --2- 172.21.15.103:0/278316274 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f047c0510d0 0x7f047c053590 secure :-1 s=READY pgs=544 cs=0 l=1 rx=0x7f048c0032b0 tx=0x7f048c0072e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:15.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.589+0000 7f049ad9d700 1 --2- 172.21.15.103:0/278316274 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f047c0044d0 0x7f047c004910 secure :-1 s=THROTTLE_DONE pgs=1494 cs=0 l=1 rx=0x7f049c063de0 tx=0x7f049c05a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.589+0000 7f0483fff700 1 -- 172.21.15.103:0/278316274 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f049003c780 con 0x7f047c0044d0 2020-04-22T14:15:15.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.785+0000 7f04a120e700 1 -- 172.21.15.103:0/278316274 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f0474002280 con 0x7f047c0044d0 2020-04-22T14:15:15.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.791+0000 7f049ad9d700 1 --2- 172.21.15.103:0/278316274 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f047c0044d0 0x7f047c004910 secure :-1 s=THROTTLE_DONE pgs=1494 cs=0 l=1 rx=0x7f049c063de0 tx=0x7f049c05a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.791+0000 7f0483fff700 1 -- 172.21.15.103:0/278316274 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v38) v1 ==== 184+0+0 (secure 0 0 0) 0x7f049003fda0 con 0x7f047c0044d0 2020-04-22T14:15:15.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.793+0000 7f04a120e700 1 -- 172.21.15.103:0/278316274 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f047c0510d0 msgr2=0x7f047c053590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:15.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.793+0000 7f04a120e700 1 --2- 172.21.15.103:0/278316274 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f047c0510d0 0x7f047c053590 secure :-1 s=READY pgs=544 cs=0 l=1 rx=0x7f048c0032b0 tx=0x7f048c0072e0).stop 2020-04-22T14:15:15.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.793+0000 7f04a120e700 1 -- 172.21.15.103:0/278316274 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f047c0044d0 msgr2=0x7f047c004910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:15.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.793+0000 7f04a120e700 1 --2- 172.21.15.103:0/278316274 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f047c0044d0 0x7f047c004910 secure :-1 s=READY pgs=1494 cs=0 l=1 rx=0x7f049c063de0 tx=0x7f049c05a720).stop 2020-04-22T14:15:15.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.793+0000 7f04a120e700 1 -- 172.21.15.103:0/278316274 shutdown_connections 2020-04-22T14:15:15.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.793+0000 7f04a120e700 1 --2- 172.21.15.103:0/278316274 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f047c0510d0 0x7f047c053590 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:15.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.793+0000 7f04a120e700 1 --2- 172.21.15.103:0/278316274 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f047c0044d0 0x7f047c004910 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:15.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.793+0000 7f04a120e700 1 -- 172.21.15.103:0/278316274 >> 172.21.15.103:0/278316274 conn(0x7f049c05ad30 msgr2=0x7f049c0669d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:15.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.793+0000 7f04a120e700 1 -- 172.21.15.103:0/278316274 shutdown_connections 2020-04-22T14:15:15.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.793+0000 7f04a120e700 1 -- 172.21.15.103:0/278316274 wait complete. 2020-04-22T14:15:15.797 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.1 2020-04-22T14:15:15.805 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:15.819 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:15:15.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.969+0000 7fecfb1be700 1 Processor -- start 2020-04-22T14:15:15.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.969+0000 7fecfb1be700 1 -- start start 2020-04-22T14:15:15.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.970+0000 7fecfb1be700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fecf4152a90 0x7fecf40b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:15.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.970+0000 7fecfb1be700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fecf40adf50 0x7fecf40ae390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:15.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.970+0000 7fecfb1be700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecf40614f0 con 0x7fecf4062170 2020-04-22T14:15:15.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.970+0000 7fecfb1be700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecf4061790 con 0x7fecf4152a90 2020-04-22T14:15:15.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.970+0000 7fecfb1be700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf4061a30 con 0x7fecf40adf50 2020-04-22T14:15:15.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.970+0000 7fecf975b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fecf4152a90 0x7fecf40b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:15.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.970+0000 7fecf975b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fecf4152a90 0x7fecf40b44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55174/0 (socket says 172.21.15.103:55174) 2020-04-22T14:15:15.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.970+0000 7fecf975b700 1 -- 172.21.15.103:0/3435149167 learned_addr learned my addr 172.21.15.103:0/3435149167 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:15:15.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.970+0000 7fecf9f5c700 1 --2- 172.21.15.103:0/3435149167 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fecf40adf50 0x7fecf40ae390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:15.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.970+0000 7fecf975b700 1 -- 172.21.15.103:0/3435149167 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fecf40adf50 msgr2=0x7fecf40ae390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:15.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.970+0000 7fecf975b700 1 --2- 172.21.15.103:0/3435149167 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fecf40adf50 0x7fecf40ae390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:15.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.970+0000 7fecf975b700 1 -- 172.21.15.103:0/3435149167 >> v1:172.21.15.86:6789/0 conn(0x7fecf4062170 legacy=0x7fecf40b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:15.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.970+0000 7fecf975b700 1 -- 172.21.15.103:0/3435149167 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf4061cd0 con 0x7fecf4152a90 2020-04-22T14:15:15.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.970+0000 7fecf975b700 1 --2- 172.21.15.103:0/3435149167 >> v2:172.21.15.103:3300/0 conn(0x7fecf4152a90 0x7fecf40b44d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fecf0002f30 tx=0x7fecf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.970+0000 7fecf975b700 1 --2- 172.21.15.103:0/3435149167 >> v2:172.21.15.103:3300/0 conn(0x7fecf4152a90 0x7fecf40b44d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fecf0002f30 tx=0x7fecf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.970+0000 7fecf975b700 1 --2- 172.21.15.103:0/3435149167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fecf4152a90 0x7fecf40b44d0 secure :-1 s=READY pgs=1495 cs=0 l=1 rx=0x7fecf0002f30 tx=0x7fecf0007a40).ready entity=mon.1 client_cookie=da93c285cb443d6e server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:15.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.970+0000 7fecf975b700 1 --2- 172.21.15.103:0/3435149167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fecf4152a90 0x7fecf40b44d0 secure :-1 s=THROTTLE_DONE pgs=1495 cs=0 l=1 rx=0x7fecf0002f30 tx=0x7fecf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.970+0000 7fecebfff700 1 -- 172.21.15.103:0/3435149167 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fecf0011720 con 0x7fecf4152a90 2020-04-22T14:15:15.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.971+0000 7fecf975b700 1 --2- 172.21.15.103:0/3435149167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fecf4152a90 0x7fecf40b44d0 secure :-1 s=THROTTLE_DONE pgs=1495 cs=0 l=1 rx=0x7fecf0002f30 tx=0x7fecf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.971+0000 7fecf975b700 1 --2- 172.21.15.103:0/3435149167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fecf4152a90 0x7fecf40b44d0 secure :-1 s=THROTTLE_DONE pgs=1495 cs=0 l=1 rx=0x7fecf0002f30 tx=0x7fecf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.971+0000 7fecebfff700 1 -- 172.21.15.103:0/3435149167 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf00118c0 con 0x7fecf4152a90 2020-04-22T14:15:15.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.971+0000 7fecebfff700 1 -- 172.21.15.103:0/3435149167 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fecf0011ce0 con 0x7fecf4152a90 2020-04-22T14:15:15.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.971+0000 7fecfb1be700 1 -- 172.21.15.103:0/3435149167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fecf4152a90 msgr2=0x7fecf40b44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:15.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.971+0000 7fecfb1be700 1 --2- 172.21.15.103:0/3435149167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fecf4152a90 0x7fecf40b44d0 secure :-1 s=READY pgs=1495 cs=0 l=1 rx=0x7fecf0002f30 tx=0x7fecf0007a40).stop 2020-04-22T14:15:15.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.971+0000 7fecfb1be700 1 -- 172.21.15.103:0/3435149167 shutdown_connections 2020-04-22T14:15:15.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.971+0000 7fecfb1be700 1 --2- 172.21.15.103:0/3435149167 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fecf40adf50 0x7fecf40ae390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:15.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.971+0000 7fecfb1be700 1 --2- 172.21.15.103:0/3435149167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fecf4152a90 0x7fecf40b44d0 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:15.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.971+0000 7fecfb1be700 1 -- 172.21.15.103:0/3435149167 >> 172.21.15.103:0/3435149167 conn(0x7fecf405ad30 msgr2=0x7fecf405b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:15.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.971+0000 7fecfb1be700 1 -- 172.21.15.103:0/3435149167 shutdown_connections 2020-04-22T14:15:15.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.971+0000 7fecfb1be700 1 -- 172.21.15.103:0/3435149167 wait complete. 2020-04-22T14:15:15.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.972+0000 7fecfb1be700 1 Processor -- start 2020-04-22T14:15:15.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.972+0000 7fecfb1be700 1 -- start start 2020-04-22T14:15:15.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.973+0000 7fecfb1be700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fecf4062170 0x7fecf40b2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:15.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.973+0000 7fecfb1be700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fecf40adf50 0x7fecf40b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:15.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.973+0000 7fecfb1be700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fecf4152a90 0x7fecf40b4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:15.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.973+0000 7fecfb1be700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecf4155870 con 0x7fecf40adf50 2020-04-22T14:15:15.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.973+0000 7fecfb1be700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecf413c320 con 0x7fecf4062170 2020-04-22T14:15:15.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.973+0000 7fecfb1be700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf413bde0 con 0x7fecf4152a90 2020-04-22T14:15:15.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.973+0000 7fecf975b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fecf4062170 0x7fecf40b2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:15.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.973+0000 7fecf975b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fecf4062170 0x7fecf40b2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55178/0 (socket says 172.21.15.103:55178) 2020-04-22T14:15:15.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.973+0000 7fecf975b700 1 -- 172.21.15.103:0/3929460742 learned_addr learned my addr 172.21.15.103:0/3929460742 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:15:15.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.974+0000 7fecf9f5c700 1 --2- 172.21.15.103:0/3929460742 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fecf4152a90 0x7fecf40b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:15.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.974+0000 7fecf975b700 1 -- 172.21.15.103:0/3929460742 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fecf4152a90 msgr2=0x7fecf40b4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:15.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.974+0000 7fecf975b700 1 --2- 172.21.15.103:0/3929460742 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fecf4152a90 0x7fecf40b4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:15.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.974+0000 7fecf975b700 1 -- 172.21.15.103:0/3929460742 >> v2:172.21.15.86:3300/0 conn(0x7fecf40adf50 msgr2=0x7fecf40b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:15.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.974+0000 7fecf8f5a700 1 --2- 172.21.15.103:0/3929460742 >> v2:172.21.15.86:3300/0 conn(0x7fecf40adf50 0x7fecf40b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:15.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.974+0000 7fecf975b700 1 --2- 172.21.15.103:0/3929460742 >> v2:172.21.15.86:3300/0 conn(0x7fecf40adf50 0x7fecf40b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:15.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.974+0000 7fecf975b700 1 -- 172.21.15.103:0/3929460742 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf413c080 con 0x7fecf4062170 2020-04-22T14:15:15.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.974+0000 7fecf8f5a700 1 --2- 172.21.15.103:0/3929460742 >> v2:172.21.15.86:3300/0 conn(0x7fecf40adf50 0x7fecf40b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:15:15.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.974+0000 7fecf975b700 1 --2- 172.21.15.103:0/3929460742 >> v2:172.21.15.103:3300/0 conn(0x7fecf4062170 0x7fecf40b2700 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fecf0002f30 tx=0x7fecf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.974+0000 7fecf975b700 1 --2- 172.21.15.103:0/3929460742 >> v2:172.21.15.103:3300/0 conn(0x7fecf4062170 0x7fecf40b2700 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fecf0002f30 tx=0x7fecf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.974+0000 7fecf975b700 1 --2- 172.21.15.103:0/3929460742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fecf4062170 0x7fecf40b2700 secure :-1 s=READY pgs=1496 cs=0 l=1 rx=0x7fecf0002f30 tx=0x7fecf0007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:15.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.974+0000 7fecf975b700 1 --2- 172.21.15.103:0/3929460742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fecf4062170 0x7fecf40b2700 secure :-1 s=THROTTLE_DONE pgs=1496 cs=0 l=1 rx=0x7fecf0002f30 tx=0x7fecf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.974+0000 7fecf975b700 1 --2- 172.21.15.103:0/3929460742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fecf4062170 0x7fecf40b2700 secure :-1 s=THROTTLE_DONE pgs=1496 cs=0 l=1 rx=0x7fecf0002f30 tx=0x7fecf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.974+0000 7fecf975b700 1 --2- 172.21.15.103:0/3929460742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fecf4062170 0x7fecf40b2700 secure :-1 s=THROTTLE_DONE pgs=1496 cs=0 l=1 rx=0x7fecf0002f30 tx=0x7fecf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.974+0000 7fece9ffb700 1 -- 172.21.15.103:0/3929460742 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fecf0007360 con 0x7fecf4062170 2020-04-22T14:15:15.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.974+0000 7fece9ffb700 1 -- 172.21.15.103:0/3929460742 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf00074c0 con 0x7fecf4062170 2020-04-22T14:15:15.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.974+0000 7fecfb1be700 1 -- 172.21.15.103:0/3929460742 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecf4155cd0 con 0x7fecf4062170 2020-04-22T14:15:15.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.974+0000 7fece9ffb700 1 -- 172.21.15.103:0/3929460742 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fecf00058b0 con 0x7fecf4062170 2020-04-22T14:15:15.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.974+0000 7fecfb1be700 1 -- 172.21.15.103:0/3929460742 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf41561a0 con 0x7fecf4062170 2020-04-22T14:15:15.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.975+0000 7fecf975b700 1 --2- 172.21.15.103:0/3929460742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fecf4062170 0x7fecf40b2700 secure :-1 s=THROTTLE_DONE pgs=1496 cs=0 l=1 rx=0x7fecf0002f30 tx=0x7fecf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.975+0000 7fece9ffb700 1 -- 172.21.15.103:0/3929460742 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fecf0005b20 con 0x7fecf4062170 2020-04-22T14:15:15.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.975+0000 7fecf975b700 1 --2- 172.21.15.103:0/3929460742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fecf4062170 0x7fecf40b2700 secure :-1 s=THROTTLE_DONE pgs=1496 cs=0 l=1 rx=0x7fecf0002f30 tx=0x7fecf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.975+0000 7fecfb1be700 1 -- 172.21.15.103:0/3929460742 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecf41559b0 con 0x7fecf4062170 2020-04-22T14:15:15.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.975+0000 7fece9ffb700 1 --2- 172.21.15.103:0/3929460742 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fecd404da60 0x7fecd404ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:15.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.975+0000 7fece9ffb700 1 -- 172.21.15.103:0/3929460742 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fecf0061c90 con 0x7fecf4062170 2020-04-22T14:15:15.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.976+0000 7fecf8f5a700 1 --2- 172.21.15.103:0/3929460742 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fecd404da60 0x7fecd404ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:15.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.976+0000 7fecf8f5a700 1 --2- 172.21.15.103:0/3929460742 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fecd404da60 0x7fecd404ff20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fecf405c3a0 tx=0x7fecf405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.976+0000 7fecf8f5a700 1 --2- 172.21.15.103:0/3929460742 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fecd404da60 0x7fecd404ff20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fecf405c3a0 tx=0x7fecf405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.976+0000 7fecf8f5a700 1 --2- 172.21.15.103:0/3929460742 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fecd404da60 0x7fecd404ff20 secure :-1 s=READY pgs=545 cs=0 l=1 rx=0x7fecf405c3a0 tx=0x7fecf405a720).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:15.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.979+0000 7fecf975b700 1 --2- 172.21.15.103:0/3929460742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fecf4062170 0x7fecf40b2700 secure :-1 s=THROTTLE_DONE pgs=1496 cs=0 l=1 rx=0x7fecf0002f30 tx=0x7fecf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:15.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:15.979+0000 7fece9ffb700 1 -- 172.21.15.103:0/3929460742 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fecf003d190 con 0x7fecf4062170 2020-04-22T14:15:16.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.170+0000 7fecfb1be700 1 -- 172.21.15.103:0/3929460742 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fecf4056c90 con 0x7fecf4062170 2020-04-22T14:15:16.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.177+0000 7fecf975b700 1 --2- 172.21.15.103:0/3929460742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fecf4062170 0x7fecf40b2700 secure :-1 s=THROTTLE_DONE pgs=1496 cs=0 l=1 rx=0x7fecf0002f30 tx=0x7fecf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:16.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.177+0000 7fece9ffb700 1 -- 172.21.15.103:0/3929460742 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v39) v1 ==== 184+0+0 (secure 0 0 0) 0x7fecf00407b0 con 0x7fecf4062170 2020-04-22T14:15:16.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.178+0000 7fecfb1be700 1 -- 172.21.15.103:0/3929460742 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fecd404da60 msgr2=0x7fecd404ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:16.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.178+0000 7fecfb1be700 1 --2- 172.21.15.103:0/3929460742 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fecd404da60 0x7fecd404ff20 secure :-1 s=READY pgs=545 cs=0 l=1 rx=0x7fecf405c3a0 tx=0x7fecf405a720).stop 2020-04-22T14:15:16.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.178+0000 7fecfb1be700 1 -- 172.21.15.103:0/3929460742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fecf4062170 msgr2=0x7fecf40b2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:16.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.178+0000 7fecfb1be700 1 --2- 172.21.15.103:0/3929460742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fecf4062170 0x7fecf40b2700 secure :-1 s=READY pgs=1496 cs=0 l=1 rx=0x7fecf0002f30 tx=0x7fecf0007a40).stop 2020-04-22T14:15:16.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.178+0000 7fecfb1be700 1 -- 172.21.15.103:0/3929460742 shutdown_connections 2020-04-22T14:15:16.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.178+0000 7fecfb1be700 1 --2- 172.21.15.103:0/3929460742 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fecf4152a90 0x7fecf40b4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:16.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.178+0000 7fecfb1be700 1 --2- 172.21.15.103:0/3929460742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fecf4062170 0x7fecf40b2700 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:16.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.178+0000 7fecfb1be700 1 --2- 172.21.15.103:0/3929460742 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fecd404da60 0x7fecd404ff20 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:16.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.178+0000 7fecfb1be700 1 --2- 172.21.15.103:0/3929460742 >> v2:172.21.15.86:3300/0 conn(0x7fecf40adf50 0x7fecf40b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:16.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.178+0000 7fecfb1be700 1 -- 172.21.15.103:0/3929460742 >> 172.21.15.103:0/3929460742 conn(0x7fecf405ad30 msgr2=0x7fecf405c640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:16.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.178+0000 7fecfb1be700 1 -- 172.21.15.103:0/3929460742 shutdown_connections 2020-04-22T14:15:16.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.178+0000 7fecfb1be700 1 -- 172.21.15.103:0/3929460742 wait complete. 2020-04-22T14:15:16.182 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.2 2020-04-22T14:15:16.190 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:16.204 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:15:16.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.355+0000 7fe853f42700 1 Processor -- start 2020-04-22T14:15:16.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.355+0000 7fe853f42700 1 -- start start 2020-04-22T14:15:16.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.356+0000 7fe853f42700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe84c062170 0x7fe84c0b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:16.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.356+0000 7fe853f42700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe84c152e70 con 0x7fe84c152a90 2020-04-22T14:15:16.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.356+0000 7fe853f42700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe84c0b56a0 con 0x7fe84c0b5210 2020-04-22T14:15:16.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.356+0000 7fe853f42700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c0614f0 con 0x7fe84c062170 2020-04-22T14:15:16.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.356+0000 7fe852ce0700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe84c0b5210 0x7fe84c0adf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47376/0 (socket says 172.21.15.103:47376) 2020-04-22T14:15:16.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.356+0000 7fe852ce0700 1 -- 172.21.15.103:0/2820951706 learned_addr learned my addr 172.21.15.103:0/2820951706 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:16.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.356+0000 7fe8514dd700 1 -- 172.21.15.103:0/2820951706 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4177239964 0 0) 0x7fe84c0b56a0 con 0x7fe84c0b5210 2020-04-22T14:15:16.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.356+0000 7fe851cde700 1 --2- 172.21.15.103:0/2820951706 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe84c062170 0x7fe84c0b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:16.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.356+0000 7fe8514dd700 1 -- 172.21.15.103:0/2820951706 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe838003230 con 0x7fe84c0b5210 2020-04-22T14:15:16.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.356+0000 7fe8514dd700 1 -- 172.21.15.103:0/2820951706 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 481967671 0 0) 0x7fe84c152e70 con 0x7fe84c152a90 2020-04-22T14:15:16.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.356+0000 7fe8514dd700 1 -- 172.21.15.103:0/2820951706 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe84c0b56a0 con 0x7fe84c152a90 2020-04-22T14:15:16.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.356+0000 7fe8514dd700 1 -- 172.21.15.103:0/2820951706 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 831642649 0 0) 0x7fe838003230 con 0x7fe84c0b5210 2020-04-22T14:15:16.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.356+0000 7fe8514dd700 1 -- 172.21.15.103:0/2820951706 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe84c062170 msgr2=0x7fe84c0b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:16.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.356+0000 7fe8514dd700 1 --2- 172.21.15.103:0/2820951706 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe84c062170 0x7fe84c0b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:16.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.356+0000 7fe8514dd700 1 -- 172.21.15.103:0/2820951706 >> v1:172.21.15.86:6789/0 conn(0x7fe84c152a90 legacy=0x7fe84c0b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:16.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.356+0000 7fe8514dd700 1 -- 172.21.15.103:0/2820951706 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe84c061790 con 0x7fe84c0b5210 2020-04-22T14:15:16.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.356+0000 7fe8514dd700 1 -- 172.21.15.103:0/2820951706 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fe844001a50 con 0x7fe84c0b5210 2020-04-22T14:15:16.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.356+0000 7fe8514dd700 1 -- 172.21.15.103:0/2820951706 >> v1:172.21.15.103:6789/0 conn(0x7fe84c0b5210 legacy=0x7fe84c0adf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:16.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.356+0000 7fe8514dd700 1 --2- 172.21.15.103:0/2820951706 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe84c062170 0x7fe8380038b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:16.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.356+0000 7fe8514dd700 1 --2- 172.21.15.103:0/2820951706 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe838003d60 0x7fe8380044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:16.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.356+0000 7fe8514dd700 1 --2- 172.21.15.103:0/2820951706 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe838004930 0x7fe838004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:16.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.356+0000 7fe8514dd700 1 -- 172.21.15.103:0/2820951706 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c0614f0 con 0x7fe838004930 2020-04-22T14:15:16.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.356+0000 7fe8514dd700 1 -- 172.21.15.103:0/2820951706 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe838005210 con 0x7fe838003d60 2020-04-22T14:15:16.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.356+0000 7fe8514dd700 1 -- 172.21.15.103:0/2820951706 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe83804f730 con 0x7fe84c062170 2020-04-22T14:15:16.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.357+0000 7fe851cde700 1 --2- 172.21.15.103:0/2820951706 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe838003d60 0x7fe8380044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:16.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.357+0000 7fe8524df700 1 --2- 172.21.15.103:0/2820951706 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe84c062170 0x7fe8380038b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:16.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.357+0000 7fe852ce0700 1 --2- 172.21.15.103:0/2820951706 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe838004930 0x7fe838004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:16.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.357+0000 7fe851cde700 1 -- 172.21.15.103:0/2820951706 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe84c062170 msgr2=0x7fe8380038b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:16.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.357+0000 7fe851cde700 1 --2- 172.21.15.103:0/2820951706 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe84c062170 0x7fe8380038b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:16.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.357+0000 7fe851cde700 1 -- 172.21.15.103:0/2820951706 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe838004930 msgr2=0x7fe838004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:16.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.357+0000 7fe851cde700 1 --2- 172.21.15.103:0/2820951706 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe838004930 0x7fe838004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:16.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.357+0000 7fe851cde700 1 -- 172.21.15.103:0/2820951706 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe838003230 con 0x7fe838003d60 2020-04-22T14:15:16.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.357+0000 7fe852ce0700 1 --2- 172.21.15.103:0/2820951706 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe838004930 0x7fe838004db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:15:16.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.357+0000 7fe851cde700 1 --2- 172.21.15.103:0/2820951706 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe838003d60 0x7fe8380044d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe83c002f30 tx=0x7fe838004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:16.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.357+0000 7fe851cde700 1 --2- 172.21.15.103:0/2820951706 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe838003d60 0x7fe8380044d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe83c002f30 tx=0x7fe838004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:16.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.357+0000 7fe851cde700 1 --2- 172.21.15.103:0/2820951706 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe838003d60 0x7fe8380044d0 secure :-1 s=READY pgs=1498 cs=0 l=1 rx=0x7fe83c002f30 tx=0x7fe838004420).ready entity=mon.1 client_cookie=95f54251d9d78711 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:16.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.357+0000 7fe851cde700 1 --2- 172.21.15.103:0/2820951706 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe838003d60 0x7fe8380044d0 secure :-1 s=THROTTLE_DONE pgs=1498 cs=0 l=1 rx=0x7fe83c002f30 tx=0x7fe838004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:16.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.357+0000 7fe8514dd700 1 -- 172.21.15.103:0/2820951706 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe83c008d30 con 0x7fe838003d60 2020-04-22T14:15:16.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.357+0000 7fe851cde700 1 --2- 172.21.15.103:0/2820951706 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe838003d60 0x7fe8380044d0 secure :-1 s=THROTTLE_DONE pgs=1498 cs=0 l=1 rx=0x7fe83c002f30 tx=0x7fe838004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:16.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.357+0000 7fe851cde700 1 --2- 172.21.15.103:0/2820951706 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe838003d60 0x7fe8380044d0 secure :-1 s=THROTTLE_DONE pgs=1498 cs=0 l=1 rx=0x7fe83c002f30 tx=0x7fe838004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:16.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.357+0000 7fe8514dd700 1 -- 172.21.15.103:0/2820951706 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83c008e90 con 0x7fe838003d60 2020-04-22T14:15:16.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.357+0000 7fe8514dd700 1 -- 172.21.15.103:0/2820951706 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe83c010b10 con 0x7fe838003d60 2020-04-22T14:15:16.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.357+0000 7fe853f42700 1 -- 172.21.15.103:0/2820951706 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe838003d60 msgr2=0x7fe8380044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:16.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.357+0000 7fe853f42700 1 --2- 172.21.15.103:0/2820951706 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe838003d60 0x7fe8380044d0 secure :-1 s=READY pgs=1498 cs=0 l=1 rx=0x7fe83c002f30 tx=0x7fe838004420).stop 2020-04-22T14:15:16.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.357+0000 7fe852ce0700 1 -- 172.21.15.103:0/2820951706 reap_dead start 2020-04-22T14:15:16.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.358+0000 7fe853f42700 1 -- 172.21.15.103:0/2820951706 shutdown_connections 2020-04-22T14:15:16.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.358+0000 7fe853f42700 1 -- 172.21.15.103:0/2820951706 >> 172.21.15.103:0/2820951706 conn(0x7fe84c05ad30 msgr2=0x7fe84c05b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:16.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.358+0000 7fe853f42700 1 -- 172.21.15.103:0/2820951706 shutdown_connections 2020-04-22T14:15:16.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.358+0000 7fe853f42700 1 -- 172.21.15.103:0/2820951706 wait complete. 2020-04-22T14:15:16.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.359+0000 7fe853f42700 1 Processor -- start 2020-04-22T14:15:16.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.359+0000 7fe853f42700 1 -- start start 2020-04-22T14:15:16.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.359+0000 7fe853f42700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe84c116120 0x7fe84c0653c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:16.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.359+0000 7fe853f42700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe84c0b1da0 0x7fe84c063650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:16.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.359+0000 7fe853f42700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe84c063f60 con 0x7fe84c063ab0 2020-04-22T14:15:16.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.359+0000 7fe853f42700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe84c062d80 con 0x7fe84c116120 2020-04-22T14:15:16.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.359+0000 7fe853f42700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c142840 con 0x7fe84c0b1da0 2020-04-22T14:15:16.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.360+0000 7fe852ce0700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe84c063ab0 0x7fe84c142c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47390/0 (socket says 172.21.15.103:47390) 2020-04-22T14:15:16.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.360+0000 7fe852ce0700 1 -- 172.21.15.103:0/3048398987 learned_addr learned my addr 172.21.15.103:0/3048398987 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:16.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.360+0000 7fe851cde700 1 --2- 172.21.15.103:0/3048398987 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe84c0b1da0 0x7fe84c063650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:16.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.360+0000 7fe8524df700 1 --2- 172.21.15.103:0/3048398987 >> v2:172.21.15.86:3300/0 conn(0x7fe84c116120 0x7fe84c0653c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:16.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.360+0000 7fe842ffd700 1 -- 172.21.15.103:0/3048398987 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3993374437 0 0) 0x7fe84c063f60 con 0x7fe84c063ab0 2020-04-22T14:15:16.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.360+0000 7fe842ffd700 1 -- 172.21.15.103:0/3048398987 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe834003230 con 0x7fe84c063ab0 2020-04-22T14:15:16.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.360+0000 7fe842ffd700 1 -- 172.21.15.103:0/3048398987 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2895505663 0 0) 0x7fe834003230 con 0x7fe84c063ab0 2020-04-22T14:15:16.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.360+0000 7fe842ffd700 1 -- 172.21.15.103:0/3048398987 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe84c063f60 con 0x7fe84c063ab0 2020-04-22T14:15:16.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.360+0000 7fe842ffd700 1 -- 172.21.15.103:0/3048398987 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fe844001a50 con 0x7fe84c063ab0 2020-04-22T14:15:16.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.360+0000 7fe851cde700 1 -- 172.21.15.103:0/3048398987 >> v2:172.21.15.86:3300/0 conn(0x7fe84c116120 msgr2=0x7fe84c0653c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:16.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.360+0000 7fe851cde700 1 --2- 172.21.15.103:0/3048398987 >> v2:172.21.15.86:3300/0 conn(0x7fe84c116120 0x7fe84c0653c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:16.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.360+0000 7fe851cde700 1 -- 172.21.15.103:0/3048398987 >> v1:172.21.15.103:6789/0 conn(0x7fe84c063ab0 legacy=0x7fe84c142c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:16.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.360+0000 7fe851cde700 1 -- 172.21.15.103:0/3048398987 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe84c062f60 con 0x7fe84c0b1da0 2020-04-22T14:15:16.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.360+0000 7fe851cde700 1 --2- 172.21.15.103:0/3048398987 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe84c0b1da0 0x7fe84c063650 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe83c002f30 tx=0x7fe838004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:16.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.360+0000 7fe851cde700 1 --2- 172.21.15.103:0/3048398987 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe84c0b1da0 0x7fe84c063650 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe83c002f30 tx=0x7fe838004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:16.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.360+0000 7fe851cde700 1 --2- 172.21.15.103:0/3048398987 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe84c0b1da0 0x7fe84c063650 secure :-1 s=READY pgs=144 cs=0 l=1 rx=0x7fe83c002f30 tx=0x7fe838004420).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:16.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.360+0000 7fe851cde700 1 --2- 172.21.15.103:0/3048398987 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe84c0b1da0 0x7fe84c063650 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7fe83c002f30 tx=0x7fe838004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:16.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.360+0000 7fe842ffd700 1 -- 172.21.15.103:0/3048398987 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe83c00f5c0 con 0x7fe84c0b1da0 2020-04-22T14:15:16.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.360+0000 7fe851cde700 1 --2- 172.21.15.103:0/3048398987 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe84c0b1da0 0x7fe84c063650 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7fe83c002f30 tx=0x7fe838004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:16.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.360+0000 7fe851cde700 1 --2- 172.21.15.103:0/3048398987 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe84c0b1da0 0x7fe84c063650 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7fe83c002f30 tx=0x7fe838004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:16.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.360+0000 7fe842ffd700 1 -- 172.21.15.103:0/3048398987 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83c00f720 con 0x7fe84c0b1da0 2020-04-22T14:15:16.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.360+0000 7fe853f42700 1 -- 172.21.15.103:0/3048398987 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe84c116500 con 0x7fe84c0b1da0 2020-04-22T14:15:16.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.360+0000 7fe842ffd700 1 -- 172.21.15.103:0/3048398987 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe83c0058b0 con 0x7fe84c0b1da0 2020-04-22T14:15:16.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.360+0000 7fe853f42700 1 -- 172.21.15.103:0/3048398987 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe84c0b18f0 con 0x7fe84c0b1da0 2020-04-22T14:15:16.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.361+0000 7fe851cde700 1 --2- 172.21.15.103:0/3048398987 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe84c0b1da0 0x7fe84c063650 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7fe83c002f30 tx=0x7fe838004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:16.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.361+0000 7fe851cde700 1 --2- 172.21.15.103:0/3048398987 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe84c0b1da0 0x7fe84c063650 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7fe83c002f30 tx=0x7fe838004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:16.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.361+0000 7fe842ffd700 1 -- 172.21.15.103:0/3048398987 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fe83c005a60 con 0x7fe84c0b1da0 2020-04-22T14:15:16.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.362+0000 7fe853f42700 1 -- 172.21.15.103:0/3048398987 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe84c056c90 con 0x7fe84c0b1da0 2020-04-22T14:15:16.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.362+0000 7fe842ffd700 1 --2- 172.21.15.103:0/3048398987 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe83404e000 0x7fe8340504c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:16.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.362+0000 7fe842ffd700 1 -- 172.21.15.103:0/3048398987 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe83c0610d0 con 0x7fe84c0b1da0 2020-04-22T14:15:16.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.362+0000 7fe8524df700 1 --2- 172.21.15.103:0/3048398987 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe83404e000 0x7fe8340504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:16.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.362+0000 7fe8524df700 1 --2- 172.21.15.103:0/3048398987 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe83404e000 0x7fe8340504c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe8480010d0 tx=0x7fe84800c9b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:16.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.362+0000 7fe8524df700 1 --2- 172.21.15.103:0/3048398987 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe83404e000 0x7fe8340504c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe8480010d0 tx=0x7fe84800c9b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:16.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.362+0000 7fe8524df700 1 --2- 172.21.15.103:0/3048398987 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe83404e000 0x7fe8340504c0 secure :-1 s=READY pgs=546 cs=0 l=1 rx=0x7fe8480010d0 tx=0x7fe84800c9b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:16.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.366+0000 7fe851cde700 1 --2- 172.21.15.103:0/3048398987 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe84c0b1da0 0x7fe84c063650 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7fe83c002f30 tx=0x7fe838004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:16.378 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.366+0000 7fe842ffd700 1 -- 172.21.15.103:0/3048398987 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fe83c03c590 con 0x7fe84c0b1da0 2020-04-22T14:15:16.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.558+0000 7fe853f42700 1 -- 172.21.15.103:0/3048398987 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fe84c0b8220 con 0x7fe84c0b1da0 2020-04-22T14:15:16.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.562+0000 7fe851cde700 1 --2- 172.21.15.103:0/3048398987 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe84c0b1da0 0x7fe84c063650 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7fe83c002f30 tx=0x7fe838004420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:16.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.562+0000 7fe842ffd700 1 -- 172.21.15.103:0/3048398987 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v40) v1 ==== 184+0+0 (secure 0 0 0) 0x7fe83c03fbb0 con 0x7fe84c0b1da0 2020-04-22T14:15:16.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.563+0000 7fe853f42700 1 -- 172.21.15.103:0/3048398987 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe83404e000 msgr2=0x7fe8340504c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:16.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.563+0000 7fe853f42700 1 --2- 172.21.15.103:0/3048398987 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe83404e000 0x7fe8340504c0 secure :-1 s=READY pgs=546 cs=0 l=1 rx=0x7fe8480010d0 tx=0x7fe84800c9b0).stop 2020-04-22T14:15:16.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.563+0000 7fe853f42700 1 -- 172.21.15.103:0/3048398987 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe84c0b1da0 msgr2=0x7fe84c063650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:16.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.563+0000 7fe853f42700 1 --2- 172.21.15.103:0/3048398987 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe84c0b1da0 0x7fe84c063650 secure :-1 s=READY pgs=144 cs=0 l=1 rx=0x7fe83c002f30 tx=0x7fe838004420).stop 2020-04-22T14:15:16.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.563+0000 7fe853f42700 1 -- 172.21.15.103:0/3048398987 shutdown_connections 2020-04-22T14:15:16.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.563+0000 7fe853f42700 1 --2- 172.21.15.103:0/3048398987 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe83404e000 0x7fe8340504c0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:16.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.563+0000 7fe853f42700 1 --2- 172.21.15.103:0/3048398987 >> v2:172.21.15.86:3300/0 conn(0x7fe84c116120 0x7fe84c0653c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:16.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.563+0000 7fe853f42700 1 --2- 172.21.15.103:0/3048398987 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe84c0b1da0 0x7fe84c063650 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:16.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.563+0000 7fe853f42700 1 -- 172.21.15.103:0/3048398987 >> 172.21.15.103:0/3048398987 conn(0x7fe84c05ad30 msgr2=0x7fe84c0b8510 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:16.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.563+0000 7fe853f42700 1 -- 172.21.15.103:0/3048398987 shutdown_connections 2020-04-22T14:15:16.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.563+0000 7fe853f42700 1 -- 172.21.15.103:0/3048398987 wait complete. 2020-04-22T14:15:16.568 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.3 2020-04-22T14:15:16.580 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:16.594 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:15:16.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.738+0000 7f015d2db700 1 Processor -- start 2020-04-22T14:15:16.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.738+0000 7f015d2db700 1 -- start start 2020-04-22T14:15:16.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.738+0000 7f015d2db700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f015812c0d0 0x7f01581464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:16.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.739+0000 7f015d2db700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0158063e30 0x7f01580642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:16.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.739+0000 7f015d2db700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0158143300 con 0x7f0158065fe0 2020-04-22T14:15:16.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.739+0000 7f015d2db700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01581435a0 con 0x7f015812c0d0 2020-04-22T14:15:16.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.739+0000 7f015d2db700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0158143840 con 0x7f0158063e30 2020-04-22T14:15:16.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.739+0000 7f01577fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0158063e30 0x7f01580642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:16.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.739+0000 7f01567fc700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f0158065fe0 0x7f015805b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47394/0 (socket says 172.21.15.103:47394) 2020-04-22T14:15:16.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.739+0000 7f01567fc700 1 -- 172.21.15.103:0/1316808086 learned_addr learned my addr 172.21.15.103:0/1316808086 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:16.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.739+0000 7f0156ffd700 1 --2- 172.21.15.103:0/1316808086 >> v2:172.21.15.86:3300/0 conn(0x7f015812c0d0 0x7f01581464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:16.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.739+0000 7f01577fe700 1 -- 172.21.15.103:0/1316808086 >> v2:172.21.15.86:3300/0 conn(0x7f015812c0d0 msgr2=0x7f01581464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:16.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.739+0000 7f01577fe700 1 --2- 172.21.15.103:0/1316808086 >> v2:172.21.15.86:3300/0 conn(0x7f015812c0d0 0x7f01581464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:16.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.739+0000 7f01577fe700 1 -- 172.21.15.103:0/1316808086 >> v1:172.21.15.103:6789/0 conn(0x7f0158065fe0 legacy=0x7f015805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:16.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.739+0000 7f0155ffb700 1 -- 172.21.15.103:0/1316808086 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3098471882 0 0) 0x7f0158143300 con 0x7f0158065fe0 2020-04-22T14:15:16.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.739+0000 7f01577fe700 1 -- 172.21.15.103:0/1316808086 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f015805bb50 con 0x7f0158063e30 2020-04-22T14:15:16.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.739+0000 7f0156ffd700 1 --2- 172.21.15.103:0/1316808086 >> v2:172.21.15.86:3300/0 conn(0x7f015812c0d0 0x7f01581464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:15:16.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.739+0000 7f01577fe700 1 --2- 172.21.15.103:0/1316808086 >> v2:172.21.15.103:3300/0 conn(0x7f0158063e30 0x7f01580642c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f01500032b0 tx=0x7f0150007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:16.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.739+0000 7f01577fe700 1 --2- 172.21.15.103:0/1316808086 >> v2:172.21.15.103:3300/0 conn(0x7f0158063e30 0x7f01580642c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f01500032b0 tx=0x7f0150007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:16.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.739+0000 7f01577fe700 1 --2- 172.21.15.103:0/1316808086 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0158063e30 0x7f01580642c0 secure :-1 s=READY pgs=1501 cs=0 l=1 rx=0x7f01500032b0 tx=0x7f0150007dc0).ready entity=mon.1 client_cookie=2ee5b7049b0ee834 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:16.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.739+0000 7f01577fe700 1 --2- 172.21.15.103:0/1316808086 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0158063e30 0x7f01580642c0 secure :-1 s=THROTTLE_DONE pgs=1501 cs=0 l=1 rx=0x7f01500032b0 tx=0x7f0150007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:16.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.739+0000 7f0155ffb700 1 -- 172.21.15.103:0/1316808086 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f015000a180 con 0x7f0158063e30 2020-04-22T14:15:16.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.739+0000 7f01577fe700 1 --2- 172.21.15.103:0/1316808086 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0158063e30 0x7f01580642c0 secure :-1 s=THROTTLE_DONE pgs=1501 cs=0 l=1 rx=0x7f01500032b0 tx=0x7f0150007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:16.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.739+0000 7f01577fe700 1 --2- 172.21.15.103:0/1316808086 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0158063e30 0x7f01580642c0 secure :-1 s=THROTTLE_DONE pgs=1501 cs=0 l=1 rx=0x7f01500032b0 tx=0x7f0150007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:16.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.739+0000 7f0155ffb700 1 -- 172.21.15.103:0/1316808086 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f015000a2e0 con 0x7f0158063e30 2020-04-22T14:15:16.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.739+0000 7f0155ffb700 1 -- 172.21.15.103:0/1316808086 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f015000a6c0 con 0x7f0158063e30 2020-04-22T14:15:16.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.739+0000 7f015d2db700 1 -- 172.21.15.103:0/1316808086 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0158063e30 msgr2=0x7f01580642c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:16.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.739+0000 7f015d2db700 1 --2- 172.21.15.103:0/1316808086 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0158063e30 0x7f01580642c0 secure :-1 s=READY pgs=1501 cs=0 l=1 rx=0x7f01500032b0 tx=0x7f0150007dc0).stop 2020-04-22T14:15:16.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.740+0000 7f015d2db700 1 -- 172.21.15.103:0/1316808086 shutdown_connections 2020-04-22T14:15:16.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.740+0000 7f015d2db700 1 --2- 172.21.15.103:0/1316808086 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0158063e30 0x7f01580642c0 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:16.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.740+0000 7f015d2db700 1 --2- 172.21.15.103:0/1316808086 >> v2:172.21.15.86:3300/0 conn(0x7f015812c0d0 0x7f01581464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:16.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.740+0000 7f015d2db700 1 -- 172.21.15.103:0/1316808086 >> 172.21.15.103:0/1316808086 conn(0x7f01580b9160 msgr2=0x7f015805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:16.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.740+0000 7f015d2db700 1 -- 172.21.15.103:0/1316808086 shutdown_connections 2020-04-22T14:15:16.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.740+0000 7f015d2db700 1 -- 172.21.15.103:0/1316808086 wait complete. 2020-04-22T14:15:16.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.741+0000 7f015d2db700 1 Processor -- start 2020-04-22T14:15:16.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.741+0000 7f015d2db700 1 -- start start 2020-04-22T14:15:16.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.741+0000 7f015d2db700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0158063e30 0x7f01580b0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:16.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.741+0000 7f015d2db700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f015812c0d0 0x7f0158127760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:16.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.741+0000 7f015d2db700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0158127bc0 con 0x7f0158065fe0 2020-04-22T14:15:16.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.741+0000 7f015d2db700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01580ac7e0 con 0x7f015812c0d0 2020-04-22T14:15:16.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.741+0000 7f015d2db700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01580aca80 con 0x7f0158063e30 2020-04-22T14:15:16.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.741+0000 7f01567fc700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f0158065fe0 0x7f01580b13e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47400/0 (socket says 172.21.15.103:47400) 2020-04-22T14:15:16.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.741+0000 7f01567fc700 1 -- 172.21.15.103:0/3761820869 learned_addr learned my addr 172.21.15.103:0/3761820869 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:16.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.742+0000 7f01577fe700 1 --2- 172.21.15.103:0/3761820869 >> v2:172.21.15.86:3300/0 conn(0x7f015812c0d0 0x7f0158127760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:16.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.742+0000 7f0156ffd700 1 --2- 172.21.15.103:0/3761820869 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0158063e30 0x7f01580b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:16.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.742+0000 7f014ffff700 1 -- 172.21.15.103:0/3761820869 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 82861868 0 0) 0x7f0140000fa0 con 0x7f0158065fe0 2020-04-22T14:15:16.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.742+0000 7f014ffff700 1 -- 172.21.15.103:0/3761820869 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f013c002fe0 con 0x7f0158065fe0 2020-04-22T14:15:16.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.742+0000 7f014ffff700 1 -- 172.21.15.103:0/3761820869 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1806893970 0 0) 0x7f013c002fe0 con 0x7f0158065fe0 2020-04-22T14:15:16.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.742+0000 7f01577fe700 1 -- 172.21.15.103:0/3761820869 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0158063e30 msgr2=0x7f01580b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:16.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.742+0000 7f01577fe700 1 --2- 172.21.15.103:0/3761820869 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0158063e30 0x7f01580b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:16.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.742+0000 7f01577fe700 1 -- 172.21.15.103:0/3761820869 >> v1:172.21.15.103:6789/0 conn(0x7f0158065fe0 legacy=0x7f01580b13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:16.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.742+0000 7f01577fe700 1 -- 172.21.15.103:0/3761820869 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01580acd20 con 0x7f015812c0d0 2020-04-22T14:15:16.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.742+0000 7f01577fe700 1 --2- 172.21.15.103:0/3761820869 >> v2:172.21.15.86:3300/0 conn(0x7f015812c0d0 0x7f0158127760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0140001bc0 tx=0x7f0150007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:16.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.742+0000 7f01577fe700 1 --2- 172.21.15.103:0/3761820869 >> v2:172.21.15.86:3300/0 conn(0x7f015812c0d0 0x7f0158127760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0140001bc0 tx=0x7f0150007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:16.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.742+0000 7f01577fe700 1 --2- 172.21.15.103:0/3761820869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f015812c0d0 0x7f0158127760 secure :-1 s=READY pgs=794 cs=0 l=1 rx=0x7f0140001bc0 tx=0x7f0150007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:16.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.742+0000 7f01577fe700 1 --2- 172.21.15.103:0/3761820869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f015812c0d0 0x7f0158127760 secure :-1 s=THROTTLE_DONE pgs=794 cs=0 l=1 rx=0x7f0140001bc0 tx=0x7f0150007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:16.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.742+0000 7f014ffff700 1 -- 172.21.15.103:0/3761820869 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0140001a20 con 0x7f015812c0d0 2020-04-22T14:15:16.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.742+0000 7f01577fe700 1 --2- 172.21.15.103:0/3761820869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f015812c0d0 0x7f0158127760 secure :-1 s=THROTTLE_DONE pgs=794 cs=0 l=1 rx=0x7f0140001bc0 tx=0x7f0150007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:16.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.742+0000 7f01577fe700 1 --2- 172.21.15.103:0/3761820869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f015812c0d0 0x7f0158127760 secure :-1 s=THROTTLE_DONE pgs=794 cs=0 l=1 rx=0x7f0140001bc0 tx=0x7f0150007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:16.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.742+0000 7f014ffff700 1 -- 172.21.15.103:0/3761820869 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0150005a40 con 0x7f015812c0d0 2020-04-22T14:15:16.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.742+0000 7f015d2db700 1 -- 172.21.15.103:0/3761820869 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01580aeb10 con 0x7f015812c0d0 2020-04-22T14:15:16.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.742+0000 7f014ffff700 1 -- 172.21.15.103:0/3761820869 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0150005da0 con 0x7f015812c0d0 2020-04-22T14:15:16.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.742+0000 7f015d2db700 1 -- 172.21.15.103:0/3761820869 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01580b3ec0 con 0x7f015812c0d0 2020-04-22T14:15:16.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.743+0000 7f01577fe700 1 --2- 172.21.15.103:0/3761820869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f015812c0d0 0x7f0158127760 secure :-1 s=THROTTLE_DONE pgs=794 cs=0 l=1 rx=0x7f0140001bc0 tx=0x7f0150007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:16.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.743+0000 7f015d2db700 1 -- 172.21.15.103:0/3761820869 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0158056c90 con 0x7f015812c0d0 2020-04-22T14:15:16.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.743+0000 7f014ffff700 1 -- 172.21.15.103:0/3761820869 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f0150007170 con 0x7f015812c0d0 2020-04-22T14:15:16.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.743+0000 7f01577fe700 1 --2- 172.21.15.103:0/3761820869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f015812c0d0 0x7f0158127760 secure :-1 s=THROTTLE_DONE pgs=794 cs=0 l=1 rx=0x7f0140001bc0 tx=0x7f0150007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:16.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.744+0000 7f014ffff700 1 --2- 172.21.15.103:0/3761820869 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f013c04dd70 0x7f013c050230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:16.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.744+0000 7f014ffff700 1 -- 172.21.15.103:0/3761820869 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0150061f80 con 0x7f015812c0d0 2020-04-22T14:15:16.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.744+0000 7f0156ffd700 1 --2- 172.21.15.103:0/3761820869 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f013c04dd70 0x7f013c050230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:16.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.744+0000 7f0156ffd700 1 --2- 172.21.15.103:0/3761820869 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f013c04dd70 0x7f013c050230 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0148002f30 tx=0x7f014800e190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:16.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.744+0000 7f0156ffd700 1 --2- 172.21.15.103:0/3761820869 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f013c04dd70 0x7f013c050230 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0148002f30 tx=0x7f014800e190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:16.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.744+0000 7f0156ffd700 1 --2- 172.21.15.103:0/3761820869 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f013c04dd70 0x7f013c050230 secure :-1 s=READY pgs=547 cs=0 l=1 rx=0x7f0148002f30 tx=0x7f014800e190).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:16.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.748+0000 7f01577fe700 1 --2- 172.21.15.103:0/3761820869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f015812c0d0 0x7f0158127760 secure :-1 s=THROTTLE_DONE pgs=794 cs=0 l=1 rx=0x7f0140001bc0 tx=0x7f0150007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:16.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.748+0000 7f014ffff700 1 -- 172.21.15.103:0/3761820869 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f015003d3c0 con 0x7f015812c0d0 2020-04-22T14:15:16.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.938+0000 7f015d2db700 1 -- 172.21.15.103:0/3761820869 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0158146e90 con 0x7f015812c0d0 2020-04-22T14:15:16.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.938+0000 7f01577fe700 1 --2- 172.21.15.103:0/3761820869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f015812c0d0 0x7f0158127760 secure :-1 s=THROTTLE_DONE pgs=794 cs=0 l=1 rx=0x7f0140001bc0 tx=0x7f0150007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:16.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.939+0000 7f014ffff700 1 -- 172.21.15.103:0/3761820869 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+2143 (secure 0 0 0) 0x7f01500409e0 con 0x7f015812c0d0 2020-04-22T14:15:16.941 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:15:16.941 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":74,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5987,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/3564040484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3564040484},{"type":"v1","addr":"172.21.15.86:6835","nonce":3564040484}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":70}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:15:12.286236+0000","modified":"2020-04-22T14:15:14.292028+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7452},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7452":{"gid":7452,"name":"a","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/1492911872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1492911872},{"type":"v1","addr":"172.21.15.103:6833","nonce":1492911872}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2020-04-22T14:15:16.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.940+0000 7f015d2db700 1 -- 172.21.15.103:0/3761820869 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f013c04dd70 msgr2=0x7f013c050230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:16.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.940+0000 7f015d2db700 1 --2- 172.21.15.103:0/3761820869 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f013c04dd70 0x7f013c050230 secure :-1 s=READY pgs=547 cs=0 l=1 rx=0x7f0148002f30 tx=0x7f014800e190).stop 2020-04-22T14:15:16.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.940+0000 7f015d2db700 1 -- 172.21.15.103:0/3761820869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f015812c0d0 msgr2=0x7f0158127760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:16.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.940+0000 7f015d2db700 1 --2- 172.21.15.103:0/3761820869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f015812c0d0 0x7f0158127760 secure :-1 s=READY pgs=794 cs=0 l=1 rx=0x7f0140001bc0 tx=0x7f0150007dc0).stop 2020-04-22T14:15:16.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.940+0000 7f015d2db700 1 -- 172.21.15.103:0/3761820869 shutdown_connections 2020-04-22T14:15:16.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.940+0000 7f015d2db700 1 --2- 172.21.15.103:0/3761820869 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f013c04dd70 0x7f013c050230 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:16.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.940+0000 7f015d2db700 1 --2- 172.21.15.103:0/3761820869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f015812c0d0 0x7f0158127760 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:16.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.940+0000 7f015d2db700 1 --2- 172.21.15.103:0/3761820869 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0158063e30 0x7f01580b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:16.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.940+0000 7f015d2db700 1 -- 172.21.15.103:0/3761820869 >> 172.21.15.103:0/3761820869 conn(0x7f01580b9160 msgr2=0x7f015812b020 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:16.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.940+0000 7f015d2db700 1 -- 172.21.15.103:0/3761820869 shutdown_connections 2020-04-22T14:15:16.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:16.940+0000 7f015d2db700 1 -- 172.21.15.103:0/3761820869 wait complete. 2020-04-22T14:15:16.944 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 74 2020-04-22T14:15:17.154 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 7452}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 17, u'failed': [], u'epoch': 74, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [18], u'info': {u'gid_7452': {u'export_targets': [], u'name': u'a', u'incarnation': 71, u'state_seq': 3, u'state': u'up:active', u'gid': 7452, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 1492911872, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 1492911872, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/1492911872'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:15:12.286236+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:15:14.292028+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:15:17.154 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:15:17.154 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:17.174 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:15:17.333 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:15:17.333 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:15:17.334 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:15:17.334 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 7452, 2020-04-22T14:15:17.334 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:15:17.334 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:15:17.334 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 5.0442144229999997, 2020-04-22T14:15:17.334 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 74, 2020-04-22T14:15:17.334 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 102, 2020-04-22T14:15:17.335 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 102, 2020-04-22T14:15:17.335 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 10.448877181 2020-04-22T14:15:17.335 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:15:17.342 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 7452, "want_state": "up:active", "state": "up:active", "rank_uptime": 5.0442144229999997, "mdsmap_epoch": 74, "osdmap_epoch": 102, "osdmap_epoch_barrier": 102, "uptime": 10.448877181 } 2020-04-22T14:15:17.342 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:17.357 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:15:17.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.501+0000 7f81f7a3f700 1 Processor -- start 2020-04-22T14:15:17.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.501+0000 7f81f7a3f700 1 -- start start 2020-04-22T14:15:17.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.502+0000 7f81f7a3f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f81f012c0d0 0x7f81f01464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:17.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.502+0000 7f81f7a3f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f81f0063e30 0x7f81f00642a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:17.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.502+0000 7f81f7a3f700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81f0143300 con 0x7f81f0065fe0 2020-04-22T14:15:17.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.502+0000 7f81f7a3f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81f01435a0 con 0x7f81f0063e30 2020-04-22T14:15:17.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.502+0000 7f81f7a3f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f0143840 con 0x7f81f012c0d0 2020-04-22T14:15:17.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.502+0000 7f81f5fdc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f81f0063e30 0x7f81f00642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:17.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.502+0000 7f81f4fda700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f81f0065fe0 0x7f81f005b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47406/0 (socket says 172.21.15.103:47406) 2020-04-22T14:15:17.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.502+0000 7f81f4fda700 1 -- 172.21.15.103:0/1703789946 learned_addr learned my addr 172.21.15.103:0/1703789946 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:17.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.502+0000 7f81f57db700 1 --2- 172.21.15.103:0/1703789946 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f81f012c0d0 0x7f81f01464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:17.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.502+0000 7f81f5fdc700 1 -- 172.21.15.103:0/1703789946 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f81f012c0d0 msgr2=0x7f81f01464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:17.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.502+0000 7f81f5fdc700 1 --2- 172.21.15.103:0/1703789946 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f81f012c0d0 0x7f81f01464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:17.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.502+0000 7f81f5fdc700 1 -- 172.21.15.103:0/1703789946 >> v1:172.21.15.103:6789/0 conn(0x7f81f0065fe0 legacy=0x7f81f005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:17.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.502+0000 7f81e3fff700 1 -- 172.21.15.103:0/1703789946 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2478960892 0 0) 0x7f81f0143300 con 0x7f81f0065fe0 2020-04-22T14:15:17.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.502+0000 7f81f5fdc700 1 -- 172.21.15.103:0/1703789946 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f005bb50 con 0x7f81f0063e30 2020-04-22T14:15:17.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.502+0000 7f81f57db700 1 --2- 172.21.15.103:0/1703789946 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f81f012c0d0 0x7f81f01464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:15:17.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.502+0000 7f81f5fdc700 1 --2- 172.21.15.103:0/1703789946 >> v2:172.21.15.103:3300/0 conn(0x7f81f0063e30 0x7f81f00642a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f81e4002f30 tx=0x7f81e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:17.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.502+0000 7f81f5fdc700 1 --2- 172.21.15.103:0/1703789946 >> v2:172.21.15.103:3300/0 conn(0x7f81f0063e30 0x7f81f00642a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f81e4002f30 tx=0x7f81e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:17.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.502+0000 7f81f5fdc700 1 --2- 172.21.15.103:0/1703789946 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81f0063e30 0x7f81f00642a0 secure :-1 s=READY pgs=1504 cs=0 l=1 rx=0x7f81e4002f30 tx=0x7f81e4007a40).ready entity=mon.1 client_cookie=b6b5d21cdb165bfd server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:17.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.503+0000 7f81f5fdc700 1 --2- 172.21.15.103:0/1703789946 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81f0063e30 0x7f81f00642a0 secure :-1 s=THROTTLE_DONE pgs=1504 cs=0 l=1 rx=0x7f81e4002f30 tx=0x7f81e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:17.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.503+0000 7f81e3fff700 1 -- 172.21.15.103:0/1703789946 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81e4011470 con 0x7f81f0063e30 2020-04-22T14:15:17.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.503+0000 7f81f5fdc700 1 --2- 172.21.15.103:0/1703789946 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81f0063e30 0x7f81f00642a0 secure :-1 s=THROTTLE_DONE pgs=1504 cs=0 l=1 rx=0x7f81e4002f30 tx=0x7f81e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:17.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.503+0000 7f81f5fdc700 1 --2- 172.21.15.103:0/1703789946 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81f0063e30 0x7f81f00642a0 secure :-1 s=THROTTLE_DONE pgs=1504 cs=0 l=1 rx=0x7f81e4002f30 tx=0x7f81e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:17.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.503+0000 7f81e3fff700 1 -- 172.21.15.103:0/1703789946 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e4011610 con 0x7f81f0063e30 2020-04-22T14:15:17.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.503+0000 7f81e3fff700 1 -- 172.21.15.103:0/1703789946 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81e40119f0 con 0x7f81f0063e30 2020-04-22T14:15:17.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.503+0000 7f81f7a3f700 1 -- 172.21.15.103:0/1703789946 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81f0063e30 msgr2=0x7f81f00642a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:17.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.503+0000 7f81f7a3f700 1 --2- 172.21.15.103:0/1703789946 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81f0063e30 0x7f81f00642a0 secure :-1 s=READY pgs=1504 cs=0 l=1 rx=0x7f81e4002f30 tx=0x7f81e4007a40).stop 2020-04-22T14:15:17.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.503+0000 7f81f7a3f700 1 -- 172.21.15.103:0/1703789946 shutdown_connections 2020-04-22T14:15:17.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.503+0000 7f81f7a3f700 1 --2- 172.21.15.103:0/1703789946 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81f0063e30 0x7f81f00642a0 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:17.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.503+0000 7f81f7a3f700 1 --2- 172.21.15.103:0/1703789946 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f81f012c0d0 0x7f81f01464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:17.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.503+0000 7f81f7a3f700 1 -- 172.21.15.103:0/1703789946 >> 172.21.15.103:0/1703789946 conn(0x7f81f00b9160 msgr2=0x7f81f005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:17.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.503+0000 7f81f7a3f700 1 -- 172.21.15.103:0/1703789946 shutdown_connections 2020-04-22T14:15:17.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.503+0000 7f81f7a3f700 1 -- 172.21.15.103:0/1703789946 wait complete. 2020-04-22T14:15:17.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.504+0000 7f81f7a3f700 1 Processor -- start 2020-04-22T14:15:17.517 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.504+0000 7f81f7a3f700 1 -- start start 2020-04-22T14:15:17.517 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.505+0000 7f81f7a3f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f81f0063e30 0x7f81f0064590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:17.517 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.505+0000 7f81f7a3f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f81f0065fe0 0x7f81f014d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:17.517 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.505+0000 7f81f7a3f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f81f012c0d0 0x7f81f0123fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:17.517 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.505+0000 7f81f7a3f700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81f00649f0 con 0x7f81f012c0d0 2020-04-22T14:15:17.517 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.505+0000 7f81f7a3f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81f014d480 con 0x7f81f0063e30 2020-04-22T14:15:17.517 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.505+0000 7f81f7a3f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f00618f0 con 0x7f81f0065fe0 2020-04-22T14:15:17.518 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.505+0000 7f81f57db700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f81f0063e30 0x7f81f0064590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:17.518 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.505+0000 7f81f57db700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f81f0063e30 0x7f81f0064590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55222/0 (socket says 172.21.15.103:55222) 2020-04-22T14:15:17.518 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.505+0000 7f81f57db700 1 -- 172.21.15.103:0/1264390320 learned_addr learned my addr 172.21.15.103:0/1264390320 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:15:17.518 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.505+0000 7f81f5fdc700 1 --2- 172.21.15.103:0/1264390320 >> v2:172.21.15.86:3300/0 conn(0x7f81f012c0d0 0x7f81f0123fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:17.518 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.505+0000 7f81f4fda700 1 --2- 172.21.15.103:0/1264390320 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f81f0065fe0 0x7f81f014d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:17.518 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.505+0000 7f81f57db700 1 -- 172.21.15.103:0/1264390320 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f81f0065fe0 msgr2=0x7f81f014d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:17.518 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.505+0000 7f81f57db700 1 --2- 172.21.15.103:0/1264390320 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f81f0065fe0 0x7f81f014d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:17.519 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.505+0000 7f81f57db700 1 -- 172.21.15.103:0/1264390320 >> v2:172.21.15.86:3300/0 conn(0x7f81f012c0d0 msgr2=0x7f81f0123fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:17.519 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.505+0000 7f81f57db700 1 --2- 172.21.15.103:0/1264390320 >> v2:172.21.15.86:3300/0 conn(0x7f81f012c0d0 0x7f81f0123fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:17.519 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.505+0000 7f81f57db700 1 -- 172.21.15.103:0/1264390320 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f0157240 con 0x7f81f0063e30 2020-04-22T14:15:17.519 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.505+0000 7f81f5fdc700 1 --2- 172.21.15.103:0/1264390320 >> v2:172.21.15.86:3300/0 conn(0x7f81f012c0d0 0x7f81f0123fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:15:17.519 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.506+0000 7f81f57db700 1 --2- 172.21.15.103:0/1264390320 >> v2:172.21.15.103:3300/0 conn(0x7f81f0063e30 0x7f81f0064590 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f81e80032b0 tx=0x7f81e8010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:17.519 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.506+0000 7f81f57db700 1 --2- 172.21.15.103:0/1264390320 >> v2:172.21.15.103:3300/0 conn(0x7f81f0063e30 0x7f81f0064590 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f81e80032b0 tx=0x7f81e8010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:17.519 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.506+0000 7f81f57db700 1 --2- 172.21.15.103:0/1264390320 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81f0063e30 0x7f81f0064590 secure :-1 s=READY pgs=1505 cs=0 l=1 rx=0x7f81e80032b0 tx=0x7f81e8010ef0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:17.519 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.506+0000 7f81f57db700 1 --2- 172.21.15.103:0/1264390320 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81f0063e30 0x7f81f0064590 secure :-1 s=THROTTLE_DONE pgs=1505 cs=0 l=1 rx=0x7f81e80032b0 tx=0x7f81e8010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:17.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.506+0000 7f81f57db700 1 --2- 172.21.15.103:0/1264390320 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81f0063e30 0x7f81f0064590 secure :-1 s=THROTTLE_DONE pgs=1505 cs=0 l=1 rx=0x7f81e80032b0 tx=0x7f81e8010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:17.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.506+0000 7f81e27fc700 1 -- 172.21.15.103:0/1264390320 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81e8007370 con 0x7f81f0063e30 2020-04-22T14:15:17.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.506+0000 7f81f57db700 1 --2- 172.21.15.103:0/1264390320 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81f0063e30 0x7f81f0064590 secure :-1 s=THROTTLE_DONE pgs=1505 cs=0 l=1 rx=0x7f81e80032b0 tx=0x7f81e8010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:17.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.506+0000 7f81e27fc700 1 -- 172.21.15.103:0/1264390320 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e80074d0 con 0x7f81f0063e30 2020-04-22T14:15:17.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.506+0000 7f81f7a3f700 1 -- 172.21.15.103:0/1264390320 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81f00615e0 con 0x7f81f0063e30 2020-04-22T14:15:17.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.506+0000 7f81e27fc700 1 -- 172.21.15.103:0/1264390320 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81e80078b0 con 0x7f81f0063e30 2020-04-22T14:15:17.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.506+0000 7f81f7a3f700 1 -- 172.21.15.103:0/1264390320 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f0124410 con 0x7f81f0063e30 2020-04-22T14:15:17.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.506+0000 7f81f57db700 1 --2- 172.21.15.103:0/1264390320 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81f0063e30 0x7f81f0064590 secure :-1 s=THROTTLE_DONE pgs=1505 cs=0 l=1 rx=0x7f81e80032b0 tx=0x7f81e8010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:17.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.507+0000 7f81e27fc700 1 -- 172.21.15.103:0/1264390320 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f81e8012590 con 0x7f81f0063e30 2020-04-22T14:15:17.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.507+0000 7f81f57db700 1 --2- 172.21.15.103:0/1264390320 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81f0063e30 0x7f81f0064590 secure :-1 s=THROTTLE_DONE pgs=1505 cs=0 l=1 rx=0x7f81e80032b0 tx=0x7f81e8010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:17.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.507+0000 7f81f7a3f700 1 -- 172.21.15.103:0/1264390320 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81f0061af0 con 0x7f81f0063e30 2020-04-22T14:15:17.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.507+0000 7f81e27fc700 1 --2- 172.21.15.103:0/1264390320 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f81d004da30 0x7f81d004fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:17.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.507+0000 7f81e27fc700 1 -- 172.21.15.103:0/1264390320 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f81e80616c0 con 0x7f81f0063e30 2020-04-22T14:15:17.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.507+0000 7f81f4fda700 1 --2- 172.21.15.103:0/1264390320 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f81d004da30 0x7f81d004fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:17.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.508+0000 7f81f4fda700 1 --2- 172.21.15.103:0/1264390320 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f81d004da30 0x7f81d004fef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f81ec000b80 tx=0x7f81ec0017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:17.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.508+0000 7f81f4fda700 1 --2- 172.21.15.103:0/1264390320 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f81d004da30 0x7f81d004fef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f81ec000b80 tx=0x7f81ec0017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:17.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.508+0000 7f81f4fda700 1 --2- 172.21.15.103:0/1264390320 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f81d004da30 0x7f81d004fef0 secure :-1 s=READY pgs=548 cs=0 l=1 rx=0x7f81ec000b80 tx=0x7f81ec0017a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:17.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.511+0000 7f81f57db700 1 --2- 172.21.15.103:0/1264390320 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81f0063e30 0x7f81f0064590 secure :-1 s=THROTTLE_DONE pgs=1505 cs=0 l=1 rx=0x7f81e80032b0 tx=0x7f81e8010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:17.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.511+0000 7f81e27fc700 1 -- 172.21.15.103:0/1264390320 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f81e803caa0 con 0x7f81f0063e30 2020-04-22T14:15:17.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.655+0000 7f81f7a3f700 1 -- 172.21.15.103:0/1264390320 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81f0056c90 con 0x7f81f0063e30 2020-04-22T14:15:17.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.655+0000 7f81f57db700 1 --2- 172.21.15.103:0/1264390320 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81f0063e30 0x7f81f0064590 secure :-1 s=THROTTLE_DONE pgs=1505 cs=0 l=1 rx=0x7f81e80032b0 tx=0x7f81e8010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:17.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.655+0000 7f81e27fc700 1 -- 172.21.15.103:0/1264390320 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+16096 (secure 0 0 0) 0x7f81e80400c0 con 0x7f81f0063e30 2020-04-22T14:15:17.659 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:15:17.659 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":102,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:15:14.291464+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:15:10.023228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2020-04-22T14:15:11.048528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:15:17.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.657+0000 7f81f7a3f700 1 -- 172.21.15.103:0/1264390320 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f81d004da30 msgr2=0x7f81d004fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:17.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.657+0000 7f81f7a3f700 1 --2- 172.21.15.103:0/1264390320 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f81d004da30 0x7f81d004fef0 secure :-1 s=READY pgs=548 cs=0 l=1 rx=0x7f81ec000b80 tx=0x7f81ec0017a0).stop 2020-04-22T14:15:17.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.657+0000 7f81f7a3f700 1 -- 172.21.15.103:0/1264390320 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81f0063e30 msgr2=0x7f81f0064590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:17.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.657+0000 7f81f7a3f700 1 --2- 172.21.15.103:0/1264390320 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81f0063e30 0x7f81f0064590 secure :-1 s=READY pgs=1505 cs=0 l=1 rx=0x7f81e80032b0 tx=0x7f81e8010ef0).stop 2020-04-22T14:15:17.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.657+0000 7f81f7a3f700 1 -- 172.21.15.103:0/1264390320 shutdown_connections 2020-04-22T14:15:17.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.657+0000 7f81f7a3f700 1 --2- 172.21.15.103:0/1264390320 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f81d004da30 0x7f81d004fef0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:17.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.657+0000 7f81f7a3f700 1 --2- 172.21.15.103:0/1264390320 >> v2:172.21.15.86:3300/0 conn(0x7f81f012c0d0 0x7f81f0123fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:17.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.657+0000 7f81f7a3f700 1 --2- 172.21.15.103:0/1264390320 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81f0063e30 0x7f81f0064590 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:17.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.657+0000 7f81f7a3f700 1 --2- 172.21.15.103:0/1264390320 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f81f0065fe0 0x7f81f014d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:17.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.657+0000 7f81f7a3f700 1 -- 172.21.15.103:0/1264390320 >> 172.21.15.103:0/1264390320 conn(0x7f81f00b9160 msgr2=0x7f81f00b4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:17.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.657+0000 7f81f7a3f700 1 -- 172.21.15.103:0/1264390320 shutdown_connections 2020-04-22T14:15:17.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.657+0000 7f81f7a3f700 1 -- 172.21.15.103:0/1264390320 wait complete. 2020-04-22T14:15:17.670 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:15:10.023228+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 17, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'100', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:15:11.048528+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 18, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'102', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:15:17.670 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:17.684 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:15:17.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.830+0000 7f04b1e1a700 1 Processor -- start 2020-04-22T14:15:17.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.830+0000 7f04b1e1a700 1 -- start start 2020-04-22T14:15:17.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.831+0000 7f04b1e1a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f04ac0b9140 0x7f04ac12b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:17.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.831+0000 7f04b1e1a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04ac1467e0 con 0x7f04ac0ac950 2020-04-22T14:15:17.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.831+0000 7f04b1e1a700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04ac060050 con 0x7f04ac12b670 2020-04-22T14:15:17.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.831+0000 7f04b1e1a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04ac0602f0 con 0x7f04ac0b9140 2020-04-22T14:15:17.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.831+0000 7f04abfff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f04ac12b670 0x7f04ac143090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47420/0 (socket says 172.21.15.103:47420) 2020-04-22T14:15:17.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.831+0000 7f04abfff700 1 -- 172.21.15.103:0/3406297149 learned_addr learned my addr 172.21.15.103:0/3406297149 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:17.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.831+0000 7f04ab7fe700 1 --2- 172.21.15.103:0/3406297149 >> v2:172.21.15.86:3300/0 conn(0x7f04ac0b9140 0x7f04ac12b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:17.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.831+0000 7f04aa7fc700 1 -- 172.21.15.103:0/3406297149 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 572555393 0 0) 0x7f04ac060050 con 0x7f04ac12b670 2020-04-22T14:15:17.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.831+0000 7f04aa7fc700 1 -- 172.21.15.103:0/3406297149 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0498003230 con 0x7f04ac12b670 2020-04-22T14:15:17.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.832+0000 7f04aa7fc700 1 -- 172.21.15.103:0/3406297149 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3039757911 0 0) 0x7f0498003230 con 0x7f04ac12b670 2020-04-22T14:15:17.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.832+0000 7f04aa7fc700 1 -- 172.21.15.103:0/3406297149 >> v2:172.21.15.86:3300/0 conn(0x7f04ac0b9140 msgr2=0x7f04ac12b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:17.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.832+0000 7f04aa7fc700 1 --2- 172.21.15.103:0/3406297149 >> v2:172.21.15.86:3300/0 conn(0x7f04ac0b9140 0x7f04ac12b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:17.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.832+0000 7f04aa7fc700 1 -- 172.21.15.103:0/3406297149 >> v1:172.21.15.86:6789/0 conn(0x7f04ac0ac950 legacy=0x7f04ac146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:17.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.832+0000 7f04aa7fc700 1 -- 172.21.15.103:0/3406297149 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ac0b9520 con 0x7f04ac12b670 2020-04-22T14:15:17.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.832+0000 7f04aa7fc700 1 -- 172.21.15.103:0/3406297149 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f04a4001710 con 0x7f04ac12b670 2020-04-22T14:15:17.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.832+0000 7f04ab7fe700 1 --2- 172.21.15.103:0/3406297149 >> v2:172.21.15.86:3300/0 conn(0x7f04ac0b9140 0x7f04ac12b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:15:17.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.832+0000 7f04aa7fc700 1 -- 172.21.15.103:0/3406297149 >> v1:172.21.15.103:6789/0 conn(0x7f04ac12b670 legacy=0x7f04ac143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:17.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.832+0000 7f04aa7fc700 1 --2- 172.21.15.103:0/3406297149 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0498003720 0x7f0498003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:17.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.832+0000 7f04aa7fc700 1 --2- 172.21.15.103:0/3406297149 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04980044d0 0x7f0498004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:17.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.832+0000 7f04aa7fc700 1 --2- 172.21.15.103:0/3406297149 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0498004db0 0x7f049800d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:17.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.832+0000 7f04aa7fc700 1 -- 172.21.15.103:0/3406297149 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac0602f0 con 0x7f04980044d0 2020-04-22T14:15:17.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.832+0000 7f04aa7fc700 1 -- 172.21.15.103:0/3406297149 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04980041c0 con 0x7f0498003720 2020-04-22T14:15:17.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.832+0000 7f04aa7fc700 1 -- 172.21.15.103:0/3406297149 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f049800dd90 con 0x7f0498004db0 2020-04-22T14:15:17.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.832+0000 7f04ab7fe700 1 --2- 172.21.15.103:0/3406297149 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0498003720 0x7f0498003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:17.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.832+0000 7f04aaffd700 1 --2- 172.21.15.103:0/3406297149 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04980044d0 0x7f0498004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:17.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.832+0000 7f04abfff700 1 --2- 172.21.15.103:0/3406297149 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0498004db0 0x7f049800d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:17.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.832+0000 7f04ab7fe700 1 -- 172.21.15.103:0/3406297149 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0498004db0 msgr2=0x7f049800d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:17.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.832+0000 7f04ab7fe700 1 --2- 172.21.15.103:0/3406297149 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0498004db0 0x7f049800d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:17.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.832+0000 7f04ab7fe700 1 -- 172.21.15.103:0/3406297149 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04980044d0 msgr2=0x7f0498004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:17.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.832+0000 7f04ab7fe700 1 --2- 172.21.15.103:0/3406297149 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04980044d0 0x7f0498004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:17.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.832+0000 7f04ab7fe700 1 -- 172.21.15.103:0/3406297149 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0498003230 con 0x7f0498003720 2020-04-22T14:15:17.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.832+0000 7f04aaffd700 1 --2- 172.21.15.103:0/3406297149 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04980044d0 0x7f0498004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:15:17.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.832+0000 7f04abfff700 1 --2- 172.21.15.103:0/3406297149 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0498004db0 0x7f049800d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:15:17.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.832+0000 7f04abfff700 1 -- 172.21.15.103:0/3406297149 reap_dead start 2020-04-22T14:15:17.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.832+0000 7f04ab7fe700 1 --2- 172.21.15.103:0/3406297149 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0498003720 0x7f0498003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f04980054a0 tx=0x7f049c00c3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:17.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.832+0000 7f04ab7fe700 1 --2- 172.21.15.103:0/3406297149 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0498003720 0x7f0498003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f04980054a0 tx=0x7f049c00c3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:17.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.832+0000 7f04ab7fe700 1 --2- 172.21.15.103:0/3406297149 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0498003720 0x7f0498003b40 secure :-1 s=READY pgs=1507 cs=0 l=1 rx=0x7f04980054a0 tx=0x7f049c00c3a0).ready entity=mon.1 client_cookie=bc90182cbe08d29e server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:17.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.832+0000 7f04ab7fe700 1 --2- 172.21.15.103:0/3406297149 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0498003720 0x7f0498003b40 secure :-1 s=THROTTLE_DONE pgs=1507 cs=0 l=1 rx=0x7f04980054a0 tx=0x7f049c00c3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:17.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.832+0000 7f04aa7fc700 1 -- 172.21.15.103:0/3406297149 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f049c00c9e0 con 0x7f0498003720 2020-04-22T14:15:17.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.832+0000 7f04ab7fe700 1 --2- 172.21.15.103:0/3406297149 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0498003720 0x7f0498003b40 secure :-1 s=THROTTLE_DONE pgs=1507 cs=0 l=1 rx=0x7f04980054a0 tx=0x7f049c00c3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:17.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.832+0000 7f04ab7fe700 1 --2- 172.21.15.103:0/3406297149 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0498003720 0x7f0498003b40 secure :-1 s=THROTTLE_DONE pgs=1507 cs=0 l=1 rx=0x7f04980054a0 tx=0x7f049c00c3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:17.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.832+0000 7f04aa7fc700 1 -- 172.21.15.103:0/3406297149 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f049c00cb40 con 0x7f0498003720 2020-04-22T14:15:17.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.832+0000 7f04aa7fc700 1 -- 172.21.15.103:0/3406297149 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f049c00e180 con 0x7f0498003720 2020-04-22T14:15:17.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.832+0000 7f04b1e1a700 1 -- 172.21.15.103:0/3406297149 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0498003720 msgr2=0x7f0498003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:17.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.832+0000 7f04b1e1a700 1 --2- 172.21.15.103:0/3406297149 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0498003720 0x7f0498003b40 secure :-1 s=READY pgs=1507 cs=0 l=1 rx=0x7f04980054a0 tx=0x7f049c00c3a0).stop 2020-04-22T14:15:17.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.833+0000 7f04b1e1a700 1 -- 172.21.15.103:0/3406297149 shutdown_connections 2020-04-22T14:15:17.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.833+0000 7f04b1e1a700 1 --2- 172.21.15.103:0/3406297149 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0498003720 0x7f0498003b40 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:17.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.833+0000 7f04b1e1a700 1 -- 172.21.15.103:0/3406297149 >> 172.21.15.103:0/3406297149 conn(0x7f04ac05b7b0 msgr2=0x7f04ac0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:17.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.833+0000 7f04b1e1a700 1 -- 172.21.15.103:0/3406297149 shutdown_connections 2020-04-22T14:15:17.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.833+0000 7f04b1e1a700 1 -- 172.21.15.103:0/3406297149 wait complete. 2020-04-22T14:15:17.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.834+0000 7f04b1e1a700 1 Processor -- start 2020-04-22T14:15:17.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.834+0000 7f04b1e1a700 1 -- start start 2020-04-22T14:15:17.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.835+0000 7f04b1e1a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f04ac1441b0 0x7f04ac0b2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:17.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.835+0000 7f04b1e1a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04ac126540 con 0x7f04ac0b0280 2020-04-22T14:15:17.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.835+0000 7f04b1e1a700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04ac1267e0 con 0x7f0498003720 2020-04-22T14:15:17.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.835+0000 7f04b1e1a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04ac127a90 con 0x7f04ac1441b0 2020-04-22T14:15:17.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.835+0000 7f04ab7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f0498003720 0x7f04ac125c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47430/0 (socket says 172.21.15.103:47430) 2020-04-22T14:15:17.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.835+0000 7f04ab7fe700 1 -- 172.21.15.103:0/3114945575 learned_addr learned my addr 172.21.15.103:0/3114945575 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:17.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.835+0000 7f04aaffd700 1 --2- 172.21.15.103:0/3114945575 >> v2:172.21.15.103:3300/0 conn(0x7f04ac1441b0 0x7f04ac0b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:17.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.835+0000 7f04a8ff9700 1 -- 172.21.15.103:0/3114945575 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1505089990 0 0) 0x7f04ac1267e0 con 0x7f0498003720 2020-04-22T14:15:17.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.835+0000 7f04a8ff9700 1 -- 172.21.15.103:0/3114945575 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f048c002fe0 con 0x7f0498003720 2020-04-22T14:15:17.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.835+0000 7f04aaffd700 1 -- 172.21.15.103:0/3114945575 >> v1:172.21.15.103:6789/0 conn(0x7f0498003720 legacy=0x7f04ac125c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:17.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.835+0000 7f04aaffd700 1 -- 172.21.15.103:0/3114945575 >> v1:172.21.15.86:6789/0 conn(0x7f04ac0b0280 legacy=0x7f04ac123dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:17.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.835+0000 7f04aaffd700 1 -- 172.21.15.103:0/3114945575 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ac0b06d0 con 0x7f04ac1441b0 2020-04-22T14:15:17.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.835+0000 7f04aaffd700 1 --2- 172.21.15.103:0/3114945575 >> v2:172.21.15.103:3300/0 conn(0x7f04ac1441b0 0x7f04ac0b2420 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f04ac0b6250 tx=0x7f04a00108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:17.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.835+0000 7f04aaffd700 1 --2- 172.21.15.103:0/3114945575 >> v2:172.21.15.103:3300/0 conn(0x7f04ac1441b0 0x7f04ac0b2420 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f04ac0b6250 tx=0x7f04a00108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:17.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.835+0000 7f04aaffd700 1 --2- 172.21.15.103:0/3114945575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04ac1441b0 0x7f04ac0b2420 secure :-1 s=READY pgs=1509 cs=0 l=1 rx=0x7f04ac0b6250 tx=0x7f04a00108e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:17.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.835+0000 7f04aaffd700 1 --2- 172.21.15.103:0/3114945575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04ac1441b0 0x7f04ac0b2420 secure :-1 s=THROTTLE_DONE pgs=1509 cs=0 l=1 rx=0x7f04ac0b6250 tx=0x7f04a00108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:17.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.835+0000 7f04aaffd700 1 --2- 172.21.15.103:0/3114945575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04ac1441b0 0x7f04ac0b2420 secure :-1 s=THROTTLE_DONE pgs=1509 cs=0 l=1 rx=0x7f04ac0b6250 tx=0x7f04a00108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:17.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.835+0000 7f04a8ff9700 1 -- 172.21.15.103:0/3114945575 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04a000cc00 con 0x7f04ac1441b0 2020-04-22T14:15:17.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.835+0000 7f04aaffd700 1 --2- 172.21.15.103:0/3114945575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04ac1441b0 0x7f04ac0b2420 secure :-1 s=THROTTLE_DONE pgs=1509 cs=0 l=1 rx=0x7f04ac0b6250 tx=0x7f04a00108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:17.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.835+0000 7f04a8ff9700 1 -- 172.21.15.103:0/3114945575 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a000cd60 con 0x7f04ac1441b0 2020-04-22T14:15:17.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.835+0000 7f04b1e1a700 1 -- 172.21.15.103:0/3114945575 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04ac0b0980 con 0x7f04ac1441b0 2020-04-22T14:15:17.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.835+0000 7f04a8ff9700 1 -- 172.21.15.103:0/3114945575 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04a00110c0 con 0x7f04ac1441b0 2020-04-22T14:15:17.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.835+0000 7f04b1e1a700 1 -- 172.21.15.103:0/3114945575 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04ac124690 con 0x7f04ac1441b0 2020-04-22T14:15:17.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.836+0000 7f04aaffd700 1 --2- 172.21.15.103:0/3114945575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04ac1441b0 0x7f04ac0b2420 secure :-1 s=THROTTLE_DONE pgs=1509 cs=0 l=1 rx=0x7f04ac0b6250 tx=0x7f04a00108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:17.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.836+0000 7f04b1e1a700 1 -- 172.21.15.103:0/3114945575 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04ac126340 con 0x7f04ac1441b0 2020-04-22T14:15:17.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.837+0000 7f04a8ff9700 1 -- 172.21.15.103:0/3114945575 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f04a00064e0 con 0x7f04ac1441b0 2020-04-22T14:15:17.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.837+0000 7f04aaffd700 1 --2- 172.21.15.103:0/3114945575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04ac1441b0 0x7f04ac0b2420 secure :-1 s=THROTTLE_DONE pgs=1509 cs=0 l=1 rx=0x7f04ac0b6250 tx=0x7f04a00108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:17.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.837+0000 7f04a8ff9700 1 --2- 172.21.15.103:0/3114945575 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f048c052100 0x7f048c0545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:17.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.837+0000 7f04a8ff9700 1 -- 172.21.15.103:0/3114945575 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f04a0060f50 con 0x7f04ac1441b0 2020-04-22T14:15:17.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.837+0000 7f04ab7fe700 1 --2- 172.21.15.103:0/3114945575 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f048c052100 0x7f048c0545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:17.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.837+0000 7f04ab7fe700 1 --2- 172.21.15.103:0/3114945575 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f048c052100 0x7f048c0545c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f049c008250 tx=0x7f049c00c3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:17.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.837+0000 7f04ab7fe700 1 --2- 172.21.15.103:0/3114945575 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f048c052100 0x7f048c0545c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f049c008250 tx=0x7f049c00c3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:17.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.837+0000 7f04ab7fe700 1 --2- 172.21.15.103:0/3114945575 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f048c052100 0x7f048c0545c0 secure :-1 s=READY pgs=549 cs=0 l=1 rx=0x7f049c008250 tx=0x7f049c00c3a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:17.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.841+0000 7f04aaffd700 1 --2- 172.21.15.103:0/3114945575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04ac1441b0 0x7f04ac0b2420 secure :-1 s=THROTTLE_DONE pgs=1509 cs=0 l=1 rx=0x7f04ac0b6250 tx=0x7f04a00108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:17.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.841+0000 7f04a8ff9700 1 -- 172.21.15.103:0/3114945575 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f04a003c2d0 con 0x7f04ac1441b0 2020-04-22T14:15:17.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.982+0000 7f04b1e1a700 1 -- 172.21.15.103:0/3114945575 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f04ac056c90 con 0x7f04ac1441b0 2020-04-22T14:15:17.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.982+0000 7f04aaffd700 1 --2- 172.21.15.103:0/3114945575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04ac1441b0 0x7f04ac0b2420 secure :-1 s=THROTTLE_DONE pgs=1509 cs=0 l=1 rx=0x7f04ac0b6250 tx=0x7f04a00108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:17.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.982+0000 7f04a8ff9700 1 -- 172.21.15.103:0/3114945575 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v102) v1 ==== 110+0+10 (secure 0 0 0) 0x7f04a003f8f0 con 0x7f04ac1441b0 2020-04-22T14:15:17.985 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:15:17.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.984+0000 7f04b1e1a700 1 -- 172.21.15.103:0/3114945575 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f048c052100 msgr2=0x7f048c0545c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:17.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.984+0000 7f04b1e1a700 1 --2- 172.21.15.103:0/3114945575 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f048c052100 0x7f048c0545c0 secure :-1 s=READY pgs=549 cs=0 l=1 rx=0x7f049c008250 tx=0x7f049c00c3a0).stop 2020-04-22T14:15:17.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.984+0000 7f04b1e1a700 1 -- 172.21.15.103:0/3114945575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04ac1441b0 msgr2=0x7f04ac0b2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:17.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.984+0000 7f04b1e1a700 1 --2- 172.21.15.103:0/3114945575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04ac1441b0 0x7f04ac0b2420 secure :-1 s=READY pgs=1509 cs=0 l=1 rx=0x7f04ac0b6250 tx=0x7f04a00108e0).stop 2020-04-22T14:15:17.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.984+0000 7f04b1e1a700 1 -- 172.21.15.103:0/3114945575 shutdown_connections 2020-04-22T14:15:17.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.984+0000 7f04b1e1a700 1 --2- 172.21.15.103:0/3114945575 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f048c052100 0x7f048c0545c0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:17.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.984+0000 7f04b1e1a700 1 --2- 172.21.15.103:0/3114945575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04ac1441b0 0x7f04ac0b2420 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:17.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.984+0000 7f04b1e1a700 1 -- 172.21.15.103:0/3114945575 >> 172.21.15.103:0/3114945575 conn(0x7f04ac05b7b0 msgr2=0x7f04ac146060 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:17.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.984+0000 7f04b1e1a700 1 -- 172.21.15.103:0/3114945575 shutdown_connections 2020-04-22T14:15:17.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:17.984+0000 7f04b1e1a700 1 -- 172.21.15.103:0/3114945575 wait complete. 2020-04-22T14:15:17.996 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:18.010 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:15:18.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.156+0000 7fd2fae50700 1 Processor -- start 2020-04-22T14:15:18.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.156+0000 7fd2fae50700 1 -- start start 2020-04-22T14:15:18.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.157+0000 7fd2fae50700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd2f40b9140 0x7fd2f40aed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:18.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.157+0000 7fd2fae50700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd2f40b3bd0 0x7fd2f40af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:18.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.157+0000 7fd2fae50700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2f40616b0 0x7fd2f4061b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:18.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.157+0000 7fd2fae50700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2f40af650 con 0x7fd2f40b3bd0 2020-04-22T14:15:18.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.157+0000 7fd2fae50700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2f4148310 con 0x7fd2f40b9140 2020-04-22T14:15:18.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.157+0000 7fd2fae50700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f41485b0 con 0x7fd2f40616b0 2020-04-22T14:15:18.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.157+0000 7fd2f8bec700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd2f40b9140 0x7fd2f40aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:18.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.157+0000 7fd2f8bec700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd2f40b9140 0x7fd2f40aed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55248/0 (socket says 172.21.15.103:55248) 2020-04-22T14:15:18.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.157+0000 7fd2f8bec700 1 -- 172.21.15.103:0/2096664307 learned_addr learned my addr 172.21.15.103:0/2096664307 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:15:18.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.158+0000 7fd2f3fff700 1 --2- 172.21.15.103:0/2096664307 >> v2:172.21.15.86:3300/0 conn(0x7fd2f40b3bd0 0x7fd2f40af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:18.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.158+0000 7fd2f93ed700 1 --2- 172.21.15.103:0/2096664307 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2f40616b0 0x7fd2f4061b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:18.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.158+0000 7fd2f8bec700 1 -- 172.21.15.103:0/2096664307 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2f40616b0 msgr2=0x7fd2f4061b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:18.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.158+0000 7fd2f8bec700 1 --2- 172.21.15.103:0/2096664307 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2f40616b0 0x7fd2f4061b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:18.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.158+0000 7fd2f8bec700 1 -- 172.21.15.103:0/2096664307 >> v2:172.21.15.86:3300/0 conn(0x7fd2f40b3bd0 msgr2=0x7fd2f40af1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:18.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.158+0000 7fd2f8bec700 1 --2- 172.21.15.103:0/2096664307 >> v2:172.21.15.86:3300/0 conn(0x7fd2f40b3bd0 0x7fd2f40af1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:18.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.158+0000 7fd2f8bec700 1 -- 172.21.15.103:0/2096664307 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f40b9520 con 0x7fd2f40b9140 2020-04-22T14:15:18.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.158+0000 7fd2f93ed700 1 --2- 172.21.15.103:0/2096664307 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2f40616b0 0x7fd2f4061b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:15:18.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.158+0000 7fd2f3fff700 1 --2- 172.21.15.103:0/2096664307 >> v2:172.21.15.86:3300/0 conn(0x7fd2f40b3bd0 0x7fd2f40af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:15:18.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.158+0000 7fd2f8bec700 1 --2- 172.21.15.103:0/2096664307 >> v2:172.21.15.103:3300/0 conn(0x7fd2f40b9140 0x7fd2f40aed90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd2e4002f30 tx=0x7fd2e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.158+0000 7fd2f8bec700 1 --2- 172.21.15.103:0/2096664307 >> v2:172.21.15.103:3300/0 conn(0x7fd2f40b9140 0x7fd2f40aed90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd2e4002f30 tx=0x7fd2e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.158+0000 7fd2f8bec700 1 --2- 172.21.15.103:0/2096664307 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2f40b9140 0x7fd2f40aed90 secure :-1 s=READY pgs=1510 cs=0 l=1 rx=0x7fd2e4002f30 tx=0x7fd2e4007a40).ready entity=mon.1 client_cookie=94fd0d7e0f0fc4ca server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:18.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.158+0000 7fd2f8bec700 1 --2- 172.21.15.103:0/2096664307 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2f40b9140 0x7fd2f40aed90 secure :-1 s=THROTTLE_DONE pgs=1510 cs=0 l=1 rx=0x7fd2e4002f30 tx=0x7fd2e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.158+0000 7fd2f8bec700 1 --2- 172.21.15.103:0/2096664307 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2f40b9140 0x7fd2f40aed90 secure :-1 s=THROTTLE_DONE pgs=1510 cs=0 l=1 rx=0x7fd2e4002f30 tx=0x7fd2e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.158+0000 7fd2f37fe700 1 -- 172.21.15.103:0/2096664307 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2e4011720 con 0x7fd2f40b9140 2020-04-22T14:15:18.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.158+0000 7fd2f8bec700 1 --2- 172.21.15.103:0/2096664307 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2f40b9140 0x7fd2f40aed90 secure :-1 s=THROTTLE_DONE pgs=1510 cs=0 l=1 rx=0x7fd2e4002f30 tx=0x7fd2e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.158+0000 7fd2f37fe700 1 -- 172.21.15.103:0/2096664307 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e4011880 con 0x7fd2f40b9140 2020-04-22T14:15:18.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.158+0000 7fd2f37fe700 1 -- 172.21.15.103:0/2096664307 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2e4011ca0 con 0x7fd2f40b9140 2020-04-22T14:15:18.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.158+0000 7fd2fae50700 1 -- 172.21.15.103:0/2096664307 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2f40b9140 msgr2=0x7fd2f40aed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:18.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.158+0000 7fd2fae50700 1 --2- 172.21.15.103:0/2096664307 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2f40b9140 0x7fd2f40aed90 secure :-1 s=READY pgs=1510 cs=0 l=1 rx=0x7fd2e4002f30 tx=0x7fd2e4007a40).stop 2020-04-22T14:15:18.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.159+0000 7fd2fae50700 1 -- 172.21.15.103:0/2096664307 shutdown_connections 2020-04-22T14:15:18.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.159+0000 7fd2fae50700 1 --2- 172.21.15.103:0/2096664307 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2f40616b0 0x7fd2f4061b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:18.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.159+0000 7fd2fae50700 1 --2- 172.21.15.103:0/2096664307 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2f40b9140 0x7fd2f40aed90 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:18.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.159+0000 7fd2fae50700 1 --2- 172.21.15.103:0/2096664307 >> v2:172.21.15.86:3300/0 conn(0x7fd2f40b3bd0 0x7fd2f40af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:18.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.159+0000 7fd2fae50700 1 -- 172.21.15.103:0/2096664307 >> 172.21.15.103:0/2096664307 conn(0x7fd2f405b7b0 msgr2=0x7fd2f40b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:18.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.159+0000 7fd2fae50700 1 -- 172.21.15.103:0/2096664307 shutdown_connections 2020-04-22T14:15:18.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.159+0000 7fd2fae50700 1 -- 172.21.15.103:0/2096664307 wait complete. 2020-04-22T14:15:18.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.159+0000 7fd2fae50700 1 Processor -- start 2020-04-22T14:15:18.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.160+0000 7fd2fae50700 1 -- start start 2020-04-22T14:15:18.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.160+0000 7fd2fae50700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2f40616b0 0x7fd2f4143e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:18.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.160+0000 7fd2fae50700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd2f40b3bd0 0x7fd2f4145970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:18.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.160+0000 7fd2fae50700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2f4146410 con 0x7fd2f40b9140 2020-04-22T14:15:18.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.160+0000 7fd2fae50700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2f41476c0 con 0x7fd2f40b3bd0 2020-04-22T14:15:18.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.160+0000 7fd2fae50700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f4147b20 con 0x7fd2f40616b0 2020-04-22T14:15:18.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.160+0000 7fd2f3fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd2f40b3bd0 0x7fd2f4145970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:18.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.161+0000 7fd2f3fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd2f40b3bd0 0x7fd2f4145970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55258/0 (socket says 172.21.15.103:55258) 2020-04-22T14:15:18.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.161+0000 7fd2f3fff700 1 -- 172.21.15.103:0/1633484814 learned_addr learned my addr 172.21.15.103:0/1633484814 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:15:18.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.161+0000 7fd2f8bec700 1 --2- 172.21.15.103:0/1633484814 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2f40616b0 0x7fd2f4143e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:18.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.161+0000 7fd2f3fff700 1 -- 172.21.15.103:0/1633484814 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2f40616b0 msgr2=0x7fd2f4143e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:18.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.161+0000 7fd2f3fff700 1 --2- 172.21.15.103:0/1633484814 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2f40616b0 0x7fd2f4143e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:18.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.161+0000 7fd2f3fff700 1 -- 172.21.15.103:0/1633484814 >> v1:172.21.15.86:6789/0 conn(0x7fd2f40b9140 legacy=0x7fd2f4064d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:18.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.161+0000 7fd2f3fff700 1 -- 172.21.15.103:0/1633484814 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f4065450 con 0x7fd2f40b3bd0 2020-04-22T14:15:18.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.161+0000 7fd2f3fff700 1 --2- 172.21.15.103:0/1633484814 >> v2:172.21.15.103:3300/0 conn(0x7fd2f40b3bd0 0x7fd2f4145970 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd2e8007920 tx=0x7fd2e8010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.161+0000 7fd2f3fff700 1 --2- 172.21.15.103:0/1633484814 >> v2:172.21.15.103:3300/0 conn(0x7fd2f40b3bd0 0x7fd2f4145970 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd2e8007920 tx=0x7fd2e8010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.161+0000 7fd2f3fff700 1 --2- 172.21.15.103:0/1633484814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2f40b3bd0 0x7fd2f4145970 secure :-1 s=READY pgs=1511 cs=0 l=1 rx=0x7fd2e8007920 tx=0x7fd2e8010b50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:18.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.161+0000 7fd2f3fff700 1 --2- 172.21.15.103:0/1633484814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2f40b3bd0 0x7fd2f4145970 secure :-1 s=THROTTLE_DONE pgs=1511 cs=0 l=1 rx=0x7fd2e8007920 tx=0x7fd2e8010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.161+0000 7fd2f1ffb700 1 -- 172.21.15.103:0/1633484814 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2e8005e90 con 0x7fd2f40b3bd0 2020-04-22T14:15:18.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.161+0000 7fd2f3fff700 1 --2- 172.21.15.103:0/1633484814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2f40b3bd0 0x7fd2f4145970 secure :-1 s=THROTTLE_DONE pgs=1511 cs=0 l=1 rx=0x7fd2e8007920 tx=0x7fd2e8010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.161+0000 7fd2f3fff700 1 --2- 172.21.15.103:0/1633484814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2f40b3bd0 0x7fd2f4145970 secure :-1 s=THROTTLE_DONE pgs=1511 cs=0 l=1 rx=0x7fd2e8007920 tx=0x7fd2e8010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.161+0000 7fd2f1ffb700 1 -- 172.21.15.103:0/1633484814 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e8007180 con 0x7fd2f40b3bd0 2020-04-22T14:15:18.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.161+0000 7fd2fae50700 1 -- 172.21.15.103:0/1633484814 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2f4145dd0 con 0x7fd2f40b3bd0 2020-04-22T14:15:18.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.161+0000 7fd2f1ffb700 1 -- 172.21.15.103:0/1633484814 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2e8007560 con 0x7fd2f40b3bd0 2020-04-22T14:15:18.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.161+0000 7fd2fae50700 1 -- 172.21.15.103:0/1633484814 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2f40635d0 con 0x7fd2f40b3bd0 2020-04-22T14:15:18.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.162+0000 7fd2f3fff700 1 --2- 172.21.15.103:0/1633484814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2f40b3bd0 0x7fd2f4145970 secure :-1 s=THROTTLE_DONE pgs=1511 cs=0 l=1 rx=0x7fd2e8007920 tx=0x7fd2e8010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.162+0000 7fd2f1ffb700 1 -- 172.21.15.103:0/1633484814 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fd2e800e2b0 con 0x7fd2f40b3bd0 2020-04-22T14:15:18.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.162+0000 7fd2f3fff700 1 --2- 172.21.15.103:0/1633484814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2f40b3bd0 0x7fd2f4145970 secure :-1 s=THROTTLE_DONE pgs=1511 cs=0 l=1 rx=0x7fd2e8007920 tx=0x7fd2e8010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.162+0000 7fd2fae50700 1 -- 172.21.15.103:0/1633484814 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2f4056c90 con 0x7fd2f40b3bd0 2020-04-22T14:15:18.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.162+0000 7fd2f1ffb700 1 --2- 172.21.15.103:0/1633484814 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2d404d990 0x7fd2d404fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:18.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.162+0000 7fd2f1ffb700 1 -- 172.21.15.103:0/1633484814 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd2e8007e40 con 0x7fd2f40b3bd0 2020-04-22T14:15:18.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.162+0000 7fd2f8bec700 1 --2- 172.21.15.103:0/1633484814 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2d404d990 0x7fd2d404fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:18.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.163+0000 7fd2f8bec700 1 --2- 172.21.15.103:0/1633484814 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2d404d990 0x7fd2d404fe50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd2e4002f30 tx=0x7fd2e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.163+0000 7fd2f8bec700 1 --2- 172.21.15.103:0/1633484814 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2d404d990 0x7fd2d404fe50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd2e4002f30 tx=0x7fd2e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.163+0000 7fd2f8bec700 1 --2- 172.21.15.103:0/1633484814 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2d404d990 0x7fd2d404fe50 secure :-1 s=READY pgs=550 cs=0 l=1 rx=0x7fd2e4002f30 tx=0x7fd2e4007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:18.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.166+0000 7fd2f3fff700 1 --2- 172.21.15.103:0/1633484814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2f40b3bd0 0x7fd2f4145970 secure :-1 s=THROTTLE_DONE pgs=1511 cs=0 l=1 rx=0x7fd2e8007920 tx=0x7fd2e8010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.166+0000 7fd2f1ffb700 1 -- 172.21.15.103:0/1633484814 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fd2e803c8e0 con 0x7fd2f40b3bd0 2020-04-22T14:15:18.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.310+0000 7fd2fae50700 1 -- 172.21.15.103:0/1633484814 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd2f40008d0 con 0x7fd2f40b3bd0 2020-04-22T14:15:18.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.311+0000 7fd2f3fff700 1 --2- 172.21.15.103:0/1633484814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2f40b3bd0 0x7fd2f4145970 secure :-1 s=THROTTLE_DONE pgs=1511 cs=0 l=1 rx=0x7fd2e8007920 tx=0x7fd2e8010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.311+0000 7fd2f1ffb700 1 -- 172.21.15.103:0/1633484814 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v102) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd2e803ff00 con 0x7fd2f40b3bd0 2020-04-22T14:15:18.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.312+0000 7fd2fae50700 1 -- 172.21.15.103:0/1633484814 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2d404d990 msgr2=0x7fd2d404fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:18.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.312+0000 7fd2fae50700 1 --2- 172.21.15.103:0/1633484814 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2d404d990 0x7fd2d404fe50 secure :-1 s=READY pgs=550 cs=0 l=1 rx=0x7fd2e4002f30 tx=0x7fd2e4007a40).stop 2020-04-22T14:15:18.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.312+0000 7fd2fae50700 1 -- 172.21.15.103:0/1633484814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2f40b3bd0 msgr2=0x7fd2f4145970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:18.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.312+0000 7fd2fae50700 1 --2- 172.21.15.103:0/1633484814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2f40b3bd0 0x7fd2f4145970 secure :-1 s=READY pgs=1511 cs=0 l=1 rx=0x7fd2e8007920 tx=0x7fd2e8010b50).stop 2020-04-22T14:15:18.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.312+0000 7fd2fae50700 1 -- 172.21.15.103:0/1633484814 shutdown_connections 2020-04-22T14:15:18.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.312+0000 7fd2fae50700 1 --2- 172.21.15.103:0/1633484814 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2d404d990 0x7fd2d404fe50 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:18.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.312+0000 7fd2fae50700 1 --2- 172.21.15.103:0/1633484814 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2f40616b0 0x7fd2f4143e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:18.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.312+0000 7fd2fae50700 1 --2- 172.21.15.103:0/1633484814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2f40b3bd0 0x7fd2f4145970 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:18.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.312+0000 7fd2fae50700 1 -- 172.21.15.103:0/1633484814 >> 172.21.15.103:0/1633484814 conn(0x7fd2f405b7b0 msgr2=0x7fd2f4142a00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:18.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.312+0000 7fd2fae50700 1 -- 172.21.15.103:0/1633484814 shutdown_connections 2020-04-22T14:15:18.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.312+0000 7fd2fae50700 1 -- 172.21.15.103:0/1633484814 wait complete. 2020-04-22T14:15:18.322 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:15:18.325 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:18.338 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-22T14:15:18.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.485+0000 7f8ce9479700 1 Processor -- start 2020-04-22T14:15:18.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.485+0000 7f8ce9479700 1 -- start start 2020-04-22T14:15:18.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.486+0000 7f8ce9479700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ce4061a30 0x7f8ce40b4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:18.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.486+0000 7f8ce9479700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8ce4141f20 0x7f8ce41423b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:18.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.486+0000 7f8ce9479700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce40af030 con 0x7f8ce40acb10 2020-04-22T14:15:18.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.486+0000 7f8ce9479700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce4060250 con 0x7f8ce4141f20 2020-04-22T14:15:18.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.486+0000 7f8ce9479700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce40623c0 con 0x7f8ce4061a30 2020-04-22T14:15:18.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.486+0000 7f8ce27fc700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f8ce40acb10 0x7f8ce40ae920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47452/0 (socket says 172.21.15.103:47452) 2020-04-22T14:15:18.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.486+0000 7f8ce27fc700 1 -- 172.21.15.103:0/4108205130 learned_addr learned my addr 172.21.15.103:0/4108205130 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:18.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.486+0000 7f8ce1ffb700 1 -- 172.21.15.103:0/4108205130 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 28873262 0 0) 0x7f8ce40af030 con 0x7f8ce40acb10 2020-04-22T14:15:18.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.486+0000 7f8ce2ffd700 1 --2- 172.21.15.103:0/4108205130 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ce4061a30 0x7f8ce40b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:18.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.486+0000 7f8ce1ffb700 1 -- 172.21.15.103:0/4108205130 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cc8003230 con 0x7f8ce40acb10 2020-04-22T14:15:18.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.486+0000 7f8ce37fe700 1 --2- 172.21.15.103:0/4108205130 >> v2:172.21.15.86:3300/0 conn(0x7f8ce4141f20 0x7f8ce41423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:18.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.486+0000 7f8ce1ffb700 1 -- 172.21.15.103:0/4108205130 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2706555806 0 0) 0x7f8cc8003230 con 0x7f8ce40acb10 2020-04-22T14:15:18.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.486+0000 7f8ce1ffb700 1 -- 172.21.15.103:0/4108205130 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ce4061a30 msgr2=0x7f8ce40b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:18.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.486+0000 7f8ce1ffb700 1 --2- 172.21.15.103:0/4108205130 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ce4061a30 0x7f8ce40b4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:18.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.487+0000 7f8ce1ffb700 1 -- 172.21.15.103:0/4108205130 >> v2:172.21.15.86:3300/0 conn(0x7f8ce4141f20 msgr2=0x7f8ce41423b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:18.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.487+0000 7f8ce1ffb700 1 --2- 172.21.15.103:0/4108205130 >> v2:172.21.15.86:3300/0 conn(0x7f8ce4141f20 0x7f8ce41423b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:18.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.487+0000 7f8ce1ffb700 1 -- 172.21.15.103:0/4108205130 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce4062660 con 0x7f8ce40acb10 2020-04-22T14:15:18.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.487+0000 7f8ce1ffb700 1 -- 172.21.15.103:0/4108205130 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f8cd40016d0 con 0x7f8ce40acb10 2020-04-22T14:15:18.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.487+0000 7f8ce1ffb700 1 -- 172.21.15.103:0/4108205130 >> v1:172.21.15.103:6789/0 conn(0x7f8ce40acb10 legacy=0x7f8ce40ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:18.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.487+0000 7f8ce1ffb700 1 --2- 172.21.15.103:0/4108205130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cc8003720 0x7f8cc8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:18.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.487+0000 7f8ce1ffb700 1 --2- 172.21.15.103:0/4108205130 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ce4061a30 0x7f8cc80044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:18.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.487+0000 7f8ce1ffb700 1 --2- 172.21.15.103:0/4108205130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8cc8004930 0x7f8cc8004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:18.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.487+0000 7f8ce1ffb700 1 -- 172.21.15.103:0/4108205130 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce4060250 con 0x7f8cc8004930 2020-04-22T14:15:18.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.487+0000 7f8ce1ffb700 1 -- 172.21.15.103:0/4108205130 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce40623c0 con 0x7f8cc8003720 2020-04-22T14:15:18.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.487+0000 7f8ce1ffb700 1 -- 172.21.15.103:0/4108205130 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc8005380 con 0x7f8ce4061a30 2020-04-22T14:15:18.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.487+0000 7f8ce2ffd700 1 --2- 172.21.15.103:0/4108205130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cc8003720 0x7f8cc8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:18.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.487+0000 7f8ce27fc700 1 --2- 172.21.15.103:0/4108205130 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ce4061a30 0x7f8cc80044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:18.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.487+0000 7f8ce37fe700 1 --2- 172.21.15.103:0/4108205130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8cc8004930 0x7f8cc8004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:18.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.487+0000 7f8ce2ffd700 1 -- 172.21.15.103:0/4108205130 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ce4061a30 msgr2=0x7f8cc80044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:18.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.487+0000 7f8ce2ffd700 1 --2- 172.21.15.103:0/4108205130 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ce4061a30 0x7f8cc80044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:18.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.487+0000 7f8ce2ffd700 1 -- 172.21.15.103:0/4108205130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8cc8004930 msgr2=0x7f8cc8004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:18.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.487+0000 7f8ce2ffd700 1 --2- 172.21.15.103:0/4108205130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8cc8004930 0x7f8cc8004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:18.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.487+0000 7f8ce2ffd700 1 -- 172.21.15.103:0/4108205130 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc8003230 con 0x7f8cc8003720 2020-04-22T14:15:18.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.487+0000 7f8ce37fe700 1 --2- 172.21.15.103:0/4108205130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8cc8004930 0x7f8cc8004db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:15:18.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.487+0000 7f8ce2ffd700 1 --2- 172.21.15.103:0/4108205130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cc8003720 0x7f8cc8003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8cd8002f30 tx=0x7f8cd8010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.487+0000 7f8ce2ffd700 1 --2- 172.21.15.103:0/4108205130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cc8003720 0x7f8cc8003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8cd8002f30 tx=0x7f8cd8010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.487+0000 7f8ce2ffd700 1 --2- 172.21.15.103:0/4108205130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cc8003720 0x7f8cc8003b40 secure :-1 s=READY pgs=1513 cs=0 l=1 rx=0x7f8cd8002f30 tx=0x7f8cd8010020).ready entity=mon.1 client_cookie=2dfcbdcb202e7026 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:18.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.487+0000 7f8ce2ffd700 1 --2- 172.21.15.103:0/4108205130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cc8003720 0x7f8cc8003b40 secure :-1 s=THROTTLE_DONE pgs=1513 cs=0 l=1 rx=0x7f8cd8002f30 tx=0x7f8cd8010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.487+0000 7f8ce1ffb700 1 -- 172.21.15.103:0/4108205130 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cd8008d30 con 0x7f8cc8003720 2020-04-22T14:15:18.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.487+0000 7f8ce2ffd700 1 --2- 172.21.15.103:0/4108205130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cc8003720 0x7f8cc8003b40 secure :-1 s=THROTTLE_DONE pgs=1513 cs=0 l=1 rx=0x7f8cd8002f30 tx=0x7f8cd8010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.487+0000 7f8ce1ffb700 1 -- 172.21.15.103:0/4108205130 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd8008e90 con 0x7f8cc8003720 2020-04-22T14:15:18.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.487+0000 7f8ce2ffd700 1 --2- 172.21.15.103:0/4108205130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cc8003720 0x7f8cc8003b40 secure :-1 s=THROTTLE_DONE pgs=1513 cs=0 l=1 rx=0x7f8cd8002f30 tx=0x7f8cd8010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.487+0000 7f8ce1ffb700 1 -- 172.21.15.103:0/4108205130 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cd8010b40 con 0x7f8cc8003720 2020-04-22T14:15:18.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.487+0000 7f8ce9479700 1 -- 172.21.15.103:0/4108205130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cc8003720 msgr2=0x7f8cc8003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:18.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.487+0000 7f8ce9479700 1 --2- 172.21.15.103:0/4108205130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cc8003720 0x7f8cc8003b40 secure :-1 s=READY pgs=1513 cs=0 l=1 rx=0x7f8cd8002f30 tx=0x7f8cd8010020).stop 2020-04-22T14:15:18.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.487+0000 7f8ce37fe700 1 -- 172.21.15.103:0/4108205130 reap_dead start 2020-04-22T14:15:18.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.488+0000 7f8ce9479700 1 -- 172.21.15.103:0/4108205130 shutdown_connections 2020-04-22T14:15:18.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.488+0000 7f8ce9479700 1 -- 172.21.15.103:0/4108205130 >> 172.21.15.103:0/4108205130 conn(0x7f8ce405b7b0 msgr2=0x7f8ce40b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:18.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.488+0000 7f8ce9479700 1 -- 172.21.15.103:0/4108205130 shutdown_connections 2020-04-22T14:15:18.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.488+0000 7f8ce9479700 1 -- 172.21.15.103:0/4108205130 wait complete. 2020-04-22T14:15:18.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.489+0000 7f8ce9479700 1 Processor -- start 2020-04-22T14:15:18.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.489+0000 7f8ce9479700 1 -- start start 2020-04-22T14:15:18.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.489+0000 7f8ce9479700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ce4153190 0x7f8ce41441c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:18.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.489+0000 7f8ce9479700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8ce41413b0 0x7f8ce4141840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:18.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.489+0000 7f8ce9479700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce40666f0 con 0x7f8ce4157600 2020-04-22T14:15:18.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.489+0000 7f8ce9479700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce4154660 con 0x7f8ce41413b0 2020-04-22T14:15:18.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.489+0000 7f8ce9479700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce4153570 con 0x7f8ce4153190 2020-04-22T14:15:18.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.490+0000 7f8ce37fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8ce41413b0 0x7f8ce4141840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:18.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.490+0000 7f8ce2ffd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ce4153190 0x7f8ce41441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:18.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.490+0000 7f8ce2ffd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ce4153190 0x7f8ce41441c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:40052/0 (socket says 172.21.15.103:40052) 2020-04-22T14:15:18.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.490+0000 7f8ce2ffd700 1 -- 172.21.15.103:0/3091076513 learned_addr learned my addr 172.21.15.103:0/3091076513 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:15:18.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.490+0000 7f8ce2ffd700 1 -- 172.21.15.103:0/3091076513 >> v2:172.21.15.86:3300/0 conn(0x7f8ce41413b0 msgr2=0x7f8ce4141840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:18.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.490+0000 7f8ce2ffd700 1 --2- 172.21.15.103:0/3091076513 >> v2:172.21.15.86:3300/0 conn(0x7f8ce41413b0 0x7f8ce4141840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:18.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.490+0000 7f8ce2ffd700 1 -- 172.21.15.103:0/3091076513 >> v1:172.21.15.86:6789/0 conn(0x7f8ce4157600 legacy=0x7f8ce4153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:18.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.490+0000 7f8ce2ffd700 1 -- 172.21.15.103:0/3091076513 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce4153810 con 0x7f8ce4153190 2020-04-22T14:15:18.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.490+0000 7f8ce37fe700 1 --2- 172.21.15.103:0/3091076513 >> v2:172.21.15.86:3300/0 conn(0x7f8ce41413b0 0x7f8ce4141840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:15:18.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.490+0000 7f8ce2ffd700 1 --2- 172.21.15.103:0/3091076513 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ce4153190 0x7f8ce41441c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8cd8002f30 tx=0x7f8cd8010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.490+0000 7f8ce2ffd700 1 --2- 172.21.15.103:0/3091076513 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ce4153190 0x7f8ce41441c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8cd8002f30 tx=0x7f8cd8010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.490+0000 7f8ce2ffd700 1 --2- 172.21.15.103:0/3091076513 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ce4153190 0x7f8ce41441c0 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7f8cd8002f30 tx=0x7f8cd8010020).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:18.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.490+0000 7f8ce2ffd700 1 --2- 172.21.15.103:0/3091076513 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ce4153190 0x7f8ce41441c0 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f8cd8002f30 tx=0x7f8cd8010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.490+0000 7f8cd3fff700 1 -- 172.21.15.103:0/3091076513 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cd800f720 con 0x7f8ce4153190 2020-04-22T14:15:18.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.491+0000 7f8ce2ffd700 1 --2- 172.21.15.103:0/3091076513 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ce4153190 0x7f8ce41441c0 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f8cd8002f30 tx=0x7f8cd8010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.491+0000 7f8ce2ffd700 1 --2- 172.21.15.103:0/3091076513 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ce4153190 0x7f8ce41441c0 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f8cd8002f30 tx=0x7f8cd8010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.491+0000 7f8cd3fff700 1 -- 172.21.15.103:0/3091076513 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd80056c0 con 0x7f8ce4153190 2020-04-22T14:15:18.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.491+0000 7f8cd3fff700 1 -- 172.21.15.103:0/3091076513 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cd800f880 con 0x7f8ce4153190 2020-04-22T14:15:18.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.491+0000 7f8ce9479700 1 -- 172.21.15.103:0/3091076513 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce4153ab0 con 0x7f8ce4153190 2020-04-22T14:15:18.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.491+0000 7f8ce9479700 1 -- 172.21.15.103:0/3091076513 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce40652f0 con 0x7f8ce4153190 2020-04-22T14:15:18.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.491+0000 7f8ce2ffd700 1 --2- 172.21.15.103:0/3091076513 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ce4153190 0x7f8ce41441c0 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f8cd8002f30 tx=0x7f8cd8010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.491+0000 7f8ce9479700 1 -- 172.21.15.103:0/3091076513 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ce4157a90 con 0x7f8ce4153190 2020-04-22T14:15:18.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.492+0000 7f8cd3fff700 1 -- 172.21.15.103:0/3091076513 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f8cd8005a60 con 0x7f8ce4153190 2020-04-22T14:15:18.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.492+0000 7f8ce2ffd700 1 --2- 172.21.15.103:0/3091076513 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ce4153190 0x7f8ce41441c0 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f8cd8002f30 tx=0x7f8cd8010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.492+0000 7f8cd3fff700 1 --2- 172.21.15.103:0/3091076513 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8cc004d8a0 0x7f8cc004fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:18.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.492+0000 7f8cd3fff700 1 -- 172.21.15.103:0/3091076513 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8cd80614c0 con 0x7f8ce4153190 2020-04-22T14:15:18.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.492+0000 7f8ce27fc700 1 --2- 172.21.15.103:0/3091076513 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8cc004d8a0 0x7f8cc004fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:18.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.492+0000 7f8ce27fc700 1 --2- 172.21.15.103:0/3091076513 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8cc004d8a0 0x7f8cc004fd60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8ce4143f80 tx=0x7f8ce4067710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.492+0000 7f8ce27fc700 1 --2- 172.21.15.103:0/3091076513 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8cc004d8a0 0x7f8cc004fd60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8ce4143f80 tx=0x7f8ce4067710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.493+0000 7f8ce27fc700 1 --2- 172.21.15.103:0/3091076513 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8cc004d8a0 0x7f8cc004fd60 secure :-1 s=READY pgs=551 cs=0 l=1 rx=0x7f8ce4143f80 tx=0x7f8ce4067710).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:18.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.496+0000 7f8ce2ffd700 1 --2- 172.21.15.103:0/3091076513 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ce4153190 0x7f8ce41441c0 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f8cd8002f30 tx=0x7f8cd8010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.496+0000 7f8cd3fff700 1 -- 172.21.15.103:0/3091076513 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f8cd803c900 con 0x7f8ce4153190 2020-04-22T14:15:18.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.639+0000 7f8ce9479700 1 -- 172.21.15.103:0/3091076513 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8ce4056c90 con 0x7f8ce4153190 2020-04-22T14:15:18.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.639+0000 7f8ce2ffd700 1 --2- 172.21.15.103:0/3091076513 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ce4153190 0x7f8ce41441c0 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f8cd8002f30 tx=0x7f8cd8010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.639+0000 7f8cd3fff700 1 -- 172.21.15.103:0/3091076513 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v102) v1 ==== 104+0+10 (secure 0 0 0) 0x7f8cd803ff20 con 0x7f8ce4153190 2020-04-22T14:15:18.642 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:15:18.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.641+0000 7f8ce9479700 1 -- 172.21.15.103:0/3091076513 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8cc004d8a0 msgr2=0x7f8cc004fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:18.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.641+0000 7f8ce9479700 1 --2- 172.21.15.103:0/3091076513 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8cc004d8a0 0x7f8cc004fd60 secure :-1 s=READY pgs=551 cs=0 l=1 rx=0x7f8ce4143f80 tx=0x7f8ce4067710).stop 2020-04-22T14:15:18.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.641+0000 7f8ce9479700 1 -- 172.21.15.103:0/3091076513 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ce4153190 msgr2=0x7f8ce41441c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:18.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.641+0000 7f8ce9479700 1 --2- 172.21.15.103:0/3091076513 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ce4153190 0x7f8ce41441c0 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7f8cd8002f30 tx=0x7f8cd8010020).stop 2020-04-22T14:15:18.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.641+0000 7f8ce9479700 1 -- 172.21.15.103:0/3091076513 shutdown_connections 2020-04-22T14:15:18.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.641+0000 7f8ce9479700 1 --2- 172.21.15.103:0/3091076513 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8cc004d8a0 0x7f8cc004fd60 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:18.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.641+0000 7f8ce9479700 1 --2- 172.21.15.103:0/3091076513 >> v2:172.21.15.86:3300/0 conn(0x7f8ce41413b0 0x7f8ce4141840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:18.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.641+0000 7f8ce9479700 1 --2- 172.21.15.103:0/3091076513 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ce4153190 0x7f8ce41441c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:18.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.641+0000 7f8ce9479700 1 -- 172.21.15.103:0/3091076513 >> 172.21.15.103:0/3091076513 conn(0x7f8ce405b7b0 msgr2=0x7f8ce40b77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:18.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.641+0000 7f8ce9479700 1 -- 172.21.15.103:0/3091076513 shutdown_connections 2020-04-22T14:15:18.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.641+0000 7f8ce9479700 1 -- 172.21.15.103:0/3091076513 wait complete. 2020-04-22T14:15:18.653 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:18.667 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-22T14:15:18.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.813+0000 7f57497ee700 1 Processor -- start 2020-04-22T14:15:18.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.814+0000 7f57497ee700 1 -- start start 2020-04-22T14:15:18.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.814+0000 7f57497ee700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f574412c5d0 0x7f5744146f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:18.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.814+0000 7f57497ee700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5744146560 con 0x7f57440bcc50 2020-04-22T14:15:18.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.814+0000 7f57497ee700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5744146800 con 0x7f574405fc70 2020-04-22T14:15:18.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.814+0000 7f57497ee700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5744146370 con 0x7f574412c5d0 2020-04-22T14:15:18.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.814+0000 7f57437fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f574405fc70 0x7f57440b5b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47474/0 (socket says 172.21.15.103:47474) 2020-04-22T14:15:18.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.814+0000 7f57437fe700 1 -- 172.21.15.103:0/3531203413 learned_addr learned my addr 172.21.15.103:0/3531203413 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:18.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.815+0000 7f5748fed700 1 --2- 172.21.15.103:0/3531203413 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f574412c5d0 0x7f5744146f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:18.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.815+0000 7f5742ffd700 1 -- 172.21.15.103:0/3531203413 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 225777647 0 0) 0x7f5744146800 con 0x7f574405fc70 2020-04-22T14:15:18.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.815+0000 7f5742ffd700 1 -- 172.21.15.103:0/3531203413 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5730003230 con 0x7f574405fc70 2020-04-22T14:15:18.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.815+0000 7f5742ffd700 1 -- 172.21.15.103:0/3531203413 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1182416178 0 0) 0x7f5744146560 con 0x7f57440bcc50 2020-04-22T14:15:18.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.815+0000 7f5742ffd700 1 -- 172.21.15.103:0/3531203413 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5744146800 con 0x7f57440bcc50 2020-04-22T14:15:18.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.815+0000 7f5742ffd700 1 -- 172.21.15.103:0/3531203413 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2606920689 0 0) 0x7f5730003230 con 0x7f574405fc70 2020-04-22T14:15:18.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.815+0000 7f5742ffd700 1 -- 172.21.15.103:0/3531203413 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f574412c5d0 msgr2=0x7f5744146f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:18.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.815+0000 7f5742ffd700 1 --2- 172.21.15.103:0/3531203413 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f574412c5d0 0x7f5744146f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:18.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.815+0000 7f5742ffd700 1 -- 172.21.15.103:0/3531203413 >> v1:172.21.15.86:6789/0 conn(0x7f57440bcc50 legacy=0x7f574412bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:18.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.815+0000 7f5742ffd700 1 -- 172.21.15.103:0/3531203413 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5744146aa0 con 0x7f574405fc70 2020-04-22T14:15:18.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.815+0000 7f5742ffd700 1 -- 172.21.15.103:0/3531203413 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f57380016d0 con 0x7f574405fc70 2020-04-22T14:15:18.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.815+0000 7f5748fed700 1 --2- 172.21.15.103:0/3531203413 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f574412c5d0 0x7f5744146f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:15:18.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.815+0000 7f5742ffd700 1 -- 172.21.15.103:0/3531203413 >> v1:172.21.15.103:6789/0 conn(0x7f574405fc70 legacy=0x7f57440b5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:18.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.815+0000 7f5742ffd700 1 --2- 172.21.15.103:0/3531203413 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57300038b0 0x7f5730003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:18.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.815+0000 7f5742ffd700 1 --2- 172.21.15.103:0/3531203413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57300044d0 0x7f5730004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:18.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.815+0000 7f5742ffd700 1 --2- 172.21.15.103:0/3531203413 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f574412c5d0 0x7f5730004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:18.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.815+0000 7f5742ffd700 1 -- 172.21.15.103:0/3531203413 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5730005210 con 0x7f57300038b0 2020-04-22T14:15:18.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.815+0000 7f5742ffd700 1 -- 172.21.15.103:0/3531203413 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5730005380 con 0x7f57300044d0 2020-04-22T14:15:18.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.815+0000 7f5742ffd700 1 -- 172.21.15.103:0/3531203413 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f573000b720 con 0x7f574412c5d0 2020-04-22T14:15:18.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.815+0000 7f57437fe700 1 --2- 172.21.15.103:0/3531203413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57300044d0 0x7f5730004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:18.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.815+0000 7f5743fff700 1 --2- 172.21.15.103:0/3531203413 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57300038b0 0x7f5730003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:18.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.815+0000 7f5748fed700 1 --2- 172.21.15.103:0/3531203413 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f574412c5d0 0x7f5730004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:18.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.815+0000 7f57437fe700 1 -- 172.21.15.103:0/3531203413 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f574412c5d0 msgr2=0x7f5730004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:18.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.815+0000 7f57437fe700 1 --2- 172.21.15.103:0/3531203413 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f574412c5d0 0x7f5730004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:18.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.815+0000 7f57437fe700 1 -- 172.21.15.103:0/3531203413 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57300038b0 msgr2=0x7f5730003cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:18.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.815+0000 7f57437fe700 1 --2- 172.21.15.103:0/3531203413 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57300038b0 0x7f5730003cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:18.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.815+0000 7f57437fe700 1 -- 172.21.15.103:0/3531203413 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5730003230 con 0x7f57300044d0 2020-04-22T14:15:18.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.815+0000 7f57437fe700 1 --2- 172.21.15.103:0/3531203413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57300044d0 0x7f5730004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f57380014a0 tx=0x7f573800c280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.816+0000 7f57437fe700 1 --2- 172.21.15.103:0/3531203413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57300044d0 0x7f5730004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f57380014a0 tx=0x7f573800c280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.816+0000 7f57437fe700 1 --2- 172.21.15.103:0/3531203413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57300044d0 0x7f5730004950 secure :-1 s=READY pgs=1515 cs=0 l=1 rx=0x7f57380014a0 tx=0x7f573800c280).ready entity=mon.1 client_cookie=9c2769704e5b77bd server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:18.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.816+0000 7f57437fe700 1 --2- 172.21.15.103:0/3531203413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57300044d0 0x7f5730004950 secure :-1 s=THROTTLE_DONE pgs=1515 cs=0 l=1 rx=0x7f57380014a0 tx=0x7f573800c280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.816+0000 7f5742ffd700 1 -- 172.21.15.103:0/3531203413 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5738010d40 con 0x7f57300044d0 2020-04-22T14:15:18.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.816+0000 7f57437fe700 1 --2- 172.21.15.103:0/3531203413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57300044d0 0x7f5730004950 secure :-1 s=THROTTLE_DONE pgs=1515 cs=0 l=1 rx=0x7f57380014a0 tx=0x7f573800c280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.816+0000 7f57437fe700 1 --2- 172.21.15.103:0/3531203413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57300044d0 0x7f5730004950 secure :-1 s=THROTTLE_DONE pgs=1515 cs=0 l=1 rx=0x7f57380014a0 tx=0x7f573800c280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.816+0000 7f5742ffd700 1 -- 172.21.15.103:0/3531203413 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57380101c0 con 0x7f57300044d0 2020-04-22T14:15:18.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.816+0000 7f5742ffd700 1 -- 172.21.15.103:0/3531203413 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5738010ea0 con 0x7f57300044d0 2020-04-22T14:15:18.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.816+0000 7f57497ee700 1 -- 172.21.15.103:0/3531203413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57300044d0 msgr2=0x7f5730004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:18.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.816+0000 7f57497ee700 1 --2- 172.21.15.103:0/3531203413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57300044d0 0x7f5730004950 secure :-1 s=READY pgs=1515 cs=0 l=1 rx=0x7f57380014a0 tx=0x7f573800c280).stop 2020-04-22T14:15:18.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.816+0000 7f5748fed700 1 -- 172.21.15.103:0/3531203413 reap_dead start 2020-04-22T14:15:18.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.816+0000 7f57497ee700 1 -- 172.21.15.103:0/3531203413 shutdown_connections 2020-04-22T14:15:18.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.816+0000 7f57497ee700 1 -- 172.21.15.103:0/3531203413 >> 172.21.15.103:0/3531203413 conn(0x7f5744065af0 msgr2=0x7f5744065f00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:18.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.816+0000 7f57497ee700 1 -- 172.21.15.103:0/3531203413 shutdown_connections 2020-04-22T14:15:18.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.816+0000 7f57497ee700 1 -- 172.21.15.103:0/3531203413 wait complete. 2020-04-22T14:15:18.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.817+0000 7f57497ee700 1 Processor -- start 2020-04-22T14:15:18.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.817+0000 7f57497ee700 1 -- start start 2020-04-22T14:15:18.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.818+0000 7f57497ee700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57440bbda0 0x7f574411e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:18.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.818+0000 7f57497ee700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5744144d70 con 0x7f574412f610 2020-04-22T14:15:18.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.818+0000 7f57497ee700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5744149590 con 0x7f574412f1b0 2020-04-22T14:15:18.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.818+0000 7f57497ee700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f574412fa30 con 0x7f57440bbda0 2020-04-22T14:15:18.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.818+0000 7f57437fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f574412f1b0 0x7f5744143f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47486/0 (socket says 172.21.15.103:47486) 2020-04-22T14:15:18.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.818+0000 7f57437fe700 1 -- 172.21.15.103:0/701859362 learned_addr learned my addr 172.21.15.103:0/701859362 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:18.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.818+0000 7f5743fff700 1 --2- 172.21.15.103:0/701859362 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57440bbda0 0x7f574411e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:18.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.818+0000 7f57417fa700 1 -- 172.21.15.103:0/701859362 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2769255737 0 0) 0x7f5744149590 con 0x7f574412f1b0 2020-04-22T14:15:18.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.818+0000 7f57417fa700 1 -- 172.21.15.103:0/701859362 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5724002fe0 con 0x7f574412f1b0 2020-04-22T14:15:18.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.819+0000 7f57417fa700 1 -- 172.21.15.103:0/701859362 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2371669677 0 0) 0x7f5744144d70 con 0x7f574412f610 2020-04-22T14:15:18.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.819+0000 7f57417fa700 1 -- 172.21.15.103:0/701859362 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5744149590 con 0x7f574412f610 2020-04-22T14:15:18.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.819+0000 7f57417fa700 1 -- 172.21.15.103:0/701859362 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3743501384 0 0) 0x7f5724002fe0 con 0x7f574412f1b0 2020-04-22T14:15:18.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.819+0000 7f57417fa700 1 -- 172.21.15.103:0/701859362 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5744144d70 con 0x7f574412f1b0 2020-04-22T14:15:18.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.819+0000 7f57417fa700 1 -- 172.21.15.103:0/701859362 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f5738000e90 con 0x7f574412f1b0 2020-04-22T14:15:18.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.819+0000 7f5743fff700 1 -- 172.21.15.103:0/701859362 >> v1:172.21.15.103:6789/0 conn(0x7f574412f1b0 legacy=0x7f5744143f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:18.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.819+0000 7f5743fff700 1 -- 172.21.15.103:0/701859362 >> v1:172.21.15.86:6789/0 conn(0x7f574412f610 legacy=0x7f5744144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:18.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.819+0000 7f5743fff700 1 -- 172.21.15.103:0/701859362 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5744149830 con 0x7f57440bbda0 2020-04-22T14:15:18.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.819+0000 7f5743fff700 1 --2- 172.21.15.103:0/701859362 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57440bbda0 0x7f574411e490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f57340010d0 tx=0x7f5734010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.819+0000 7f5743fff700 1 --2- 172.21.15.103:0/701859362 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57440bbda0 0x7f574411e490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f57340010d0 tx=0x7f5734010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.819+0000 7f5743fff700 1 --2- 172.21.15.103:0/701859362 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57440bbda0 0x7f574411e490 secure :-1 s=READY pgs=146 cs=0 l=1 rx=0x7f57340010d0 tx=0x7f5734010a70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:18.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.819+0000 7f5743fff700 1 --2- 172.21.15.103:0/701859362 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57440bbda0 0x7f574411e490 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7f57340010d0 tx=0x7f5734010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.819+0000 7f57417fa700 1 -- 172.21.15.103:0/701859362 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5734003690 con 0x7f57440bbda0 2020-04-22T14:15:18.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.819+0000 7f5743fff700 1 --2- 172.21.15.103:0/701859362 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57440bbda0 0x7f574411e490 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7f57340010d0 tx=0x7f5734010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.819+0000 7f57497ee700 1 -- 172.21.15.103:0/701859362 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5744149ad0 con 0x7f57440bbda0 2020-04-22T14:15:18.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.819+0000 7f57417fa700 1 -- 172.21.15.103:0/701859362 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57340037f0 con 0x7f57440bbda0 2020-04-22T14:15:18.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.819+0000 7f5743fff700 1 --2- 172.21.15.103:0/701859362 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57440bbda0 0x7f574411e490 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7f57340010d0 tx=0x7f5734010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.819+0000 7f57417fa700 1 -- 172.21.15.103:0/701859362 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f573400c510 con 0x7f57440bbda0 2020-04-22T14:15:18.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.819+0000 7f57497ee700 1 -- 172.21.15.103:0/701859362 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f574411e8f0 con 0x7f57440bbda0 2020-04-22T14:15:18.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.820+0000 7f5743fff700 1 --2- 172.21.15.103:0/701859362 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57440bbda0 0x7f574411e490 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7f57340010d0 tx=0x7f5734010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.820+0000 7f57497ee700 1 -- 172.21.15.103:0/701859362 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5744056c90 con 0x7f57440bbda0 2020-04-22T14:15:18.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.820+0000 7f57417fa700 1 -- 172.21.15.103:0/701859362 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f573400c7d0 con 0x7f57440bbda0 2020-04-22T14:15:18.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.820+0000 7f5743fff700 1 --2- 172.21.15.103:0/701859362 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57440bbda0 0x7f574411e490 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7f57340010d0 tx=0x7f5734010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.820+0000 7f57417fa700 1 --2- 172.21.15.103:0/701859362 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f572404e040 0x7f5724050500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:18.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.820+0000 7f57417fa700 1 -- 172.21.15.103:0/701859362 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5734060fc0 con 0x7f57440bbda0 2020-04-22T14:15:18.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.821+0000 7f57437fe700 1 --2- 172.21.15.103:0/701859362 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f572404e040 0x7f5724050500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:18.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.821+0000 7f57437fe700 1 --2- 172.21.15.103:0/701859362 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f572404e040 0x7f5724050500 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5738004520 tx=0x7f573800c280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.821+0000 7f57437fe700 1 --2- 172.21.15.103:0/701859362 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f572404e040 0x7f5724050500 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5738004520 tx=0x7f573800c280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.821+0000 7f57437fe700 1 --2- 172.21.15.103:0/701859362 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f572404e040 0x7f5724050500 secure :-1 s=READY pgs=552 cs=0 l=1 rx=0x7f5738004520 tx=0x7f573800c280).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:18.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.824+0000 7f5743fff700 1 --2- 172.21.15.103:0/701859362 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57440bbda0 0x7f574411e490 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7f57340010d0 tx=0x7f5734010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.824+0000 7f57417fa700 1 -- 172.21.15.103:0/701859362 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f573403c340 con 0x7f57440bbda0 2020-04-22T14:15:18.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.966+0000 7f57497ee700 1 -- 172.21.15.103:0/701859362 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f57440b6890 con 0x7f57440bbda0 2020-04-22T14:15:18.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.967+0000 7f5743fff700 1 --2- 172.21.15.103:0/701859362 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57440bbda0 0x7f574411e490 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7f57340010d0 tx=0x7f5734010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:18.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.967+0000 7f57417fa700 1 -- 172.21.15.103:0/701859362 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v102) v1 ==== 100+0+10 (secure 0 0 0) 0x7f573403f960 con 0x7f57440bbda0 2020-04-22T14:15:18.969 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:15:18.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.968+0000 7f57497ee700 1 -- 172.21.15.103:0/701859362 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f572404e040 msgr2=0x7f5724050500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:18.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.968+0000 7f57497ee700 1 --2- 172.21.15.103:0/701859362 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f572404e040 0x7f5724050500 secure :-1 s=READY pgs=552 cs=0 l=1 rx=0x7f5738004520 tx=0x7f573800c280).stop 2020-04-22T14:15:18.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.968+0000 7f57497ee700 1 -- 172.21.15.103:0/701859362 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57440bbda0 msgr2=0x7f574411e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:18.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.968+0000 7f57497ee700 1 --2- 172.21.15.103:0/701859362 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57440bbda0 0x7f574411e490 secure :-1 s=READY pgs=146 cs=0 l=1 rx=0x7f57340010d0 tx=0x7f5734010a70).stop 2020-04-22T14:15:18.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.968+0000 7f57497ee700 1 -- 172.21.15.103:0/701859362 shutdown_connections 2020-04-22T14:15:18.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.968+0000 7f57497ee700 1 --2- 172.21.15.103:0/701859362 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f572404e040 0x7f5724050500 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:18.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.968+0000 7f57497ee700 1 --2- 172.21.15.103:0/701859362 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57440bbda0 0x7f574411e490 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:18.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.968+0000 7f57497ee700 1 -- 172.21.15.103:0/701859362 >> 172.21.15.103:0/701859362 conn(0x7f5744065af0 msgr2=0x7f57440b72e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:18.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.968+0000 7f57497ee700 1 -- 172.21.15.103:0/701859362 shutdown_connections 2020-04-22T14:15:18.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:18.968+0000 7f57497ee700 1 -- 172.21.15.103:0/701859362 wait complete. 2020-04-22T14:15:18.983 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-04-22T14:15:18.983 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:18.997 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:15:19.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.143+0000 7f325bce3700 1 Processor -- start 2020-04-22T14:15:19.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.143+0000 7f325bce3700 1 -- start start 2020-04-22T14:15:19.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.144+0000 7f325bce3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3254067170 0x7f32540b6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:19.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.144+0000 7f325bce3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f32541426d0 0x7f3254142b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:19.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.144+0000 7f325bce3700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3254064ec0 con 0x7f32540ac740 2020-04-22T14:15:19.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.144+0000 7f325bce3700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3254065af0 con 0x7f32541426d0 2020-04-22T14:15:19.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.144+0000 7f325bce3700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3254146870 con 0x7f3254067170 2020-04-22T14:15:19.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.144+0000 7f3259a7f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3254067170 0x7f32540b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:19.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.144+0000 7f3259a7f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3254067170 0x7f32540b6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55302/0 (socket says 172.21.15.103:55302) 2020-04-22T14:15:19.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.144+0000 7f3259a7f700 1 -- 172.21.15.103:0/3973448977 learned_addr learned my addr 172.21.15.103:0/3973448977 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:15:19.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.144+0000 7f325a280700 1 --2- 172.21.15.103:0/3973448977 >> v2:172.21.15.86:3300/0 conn(0x7f32541426d0 0x7f3254142b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:19.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.144+0000 7f3259a7f700 1 -- 172.21.15.103:0/3973448977 >> v2:172.21.15.86:3300/0 conn(0x7f32541426d0 msgr2=0x7f3254142b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:19.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.144+0000 7f3259a7f700 1 --2- 172.21.15.103:0/3973448977 >> v2:172.21.15.86:3300/0 conn(0x7f32541426d0 0x7f3254142b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:19.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.144+0000 7f3259a7f700 1 -- 172.21.15.103:0/3973448977 >> v1:172.21.15.86:6789/0 conn(0x7f32540ac740 legacy=0x7f325413c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:19.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.144+0000 7f3259a7f700 1 -- 172.21.15.103:0/3973448977 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3254067550 con 0x7f3254067170 2020-04-22T14:15:19.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.144+0000 7f3259a7f700 1 --2- 172.21.15.103:0/3973448977 >> v2:172.21.15.103:3300/0 conn(0x7f3254067170 0x7f32540b6040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3254066130 tx=0x7f3244007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:19.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.144+0000 7f3259a7f700 1 --2- 172.21.15.103:0/3973448977 >> v2:172.21.15.103:3300/0 conn(0x7f3254067170 0x7f32540b6040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3254066130 tx=0x7f3244007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:19.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.144+0000 7f3259a7f700 1 --2- 172.21.15.103:0/3973448977 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3254067170 0x7f32540b6040 secure :-1 s=READY pgs=1517 cs=0 l=1 rx=0x7f3254066130 tx=0x7f3244007a40).ready entity=mon.1 client_cookie=81df14c8b220ec37 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:19.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.144+0000 7f3259a7f700 1 --2- 172.21.15.103:0/3973448977 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3254067170 0x7f32540b6040 secure :-1 s=THROTTLE_DONE pgs=1517 cs=0 l=1 rx=0x7f3254066130 tx=0x7f3244007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:19.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.144+0000 7f3258a7d700 1 -- 172.21.15.103:0/3973448977 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32440116e0 con 0x7f3254067170 2020-04-22T14:15:19.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.144+0000 7f3259a7f700 1 --2- 172.21.15.103:0/3973448977 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3254067170 0x7f32540b6040 secure :-1 s=THROTTLE_DONE pgs=1517 cs=0 l=1 rx=0x7f3254066130 tx=0x7f3244007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:19.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.144+0000 7f3258a7d700 1 -- 172.21.15.103:0/3973448977 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3244011840 con 0x7f3254067170 2020-04-22T14:15:19.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.144+0000 7f3259a7f700 1 --2- 172.21.15.103:0/3973448977 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3254067170 0x7f32540b6040 secure :-1 s=THROTTLE_DONE pgs=1517 cs=0 l=1 rx=0x7f3254066130 tx=0x7f3244007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:19.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.144+0000 7f3258a7d700 1 -- 172.21.15.103:0/3973448977 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3244011c20 con 0x7f3254067170 2020-04-22T14:15:19.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.144+0000 7f325bce3700 1 -- 172.21.15.103:0/3973448977 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3254067170 msgr2=0x7f32540b6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:19.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.144+0000 7f325bce3700 1 --2- 172.21.15.103:0/3973448977 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3254067170 0x7f32540b6040 secure :-1 s=READY pgs=1517 cs=0 l=1 rx=0x7f3254066130 tx=0x7f3244007a40).stop 2020-04-22T14:15:19.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.145+0000 7f325bce3700 1 -- 172.21.15.103:0/3973448977 shutdown_connections 2020-04-22T14:15:19.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.145+0000 7f325bce3700 1 --2- 172.21.15.103:0/3973448977 >> v2:172.21.15.86:3300/0 conn(0x7f32541426d0 0x7f3254142b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:19.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.145+0000 7f325bce3700 1 --2- 172.21.15.103:0/3973448977 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3254067170 0x7f32540b6040 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:19.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.145+0000 7f325bce3700 1 -- 172.21.15.103:0/3973448977 >> 172.21.15.103:0/3973448977 conn(0x7f32540b9160 msgr2=0x7f325405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:19.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.145+0000 7f325bce3700 1 -- 172.21.15.103:0/3973448977 shutdown_connections 2020-04-22T14:15:19.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.145+0000 7f325bce3700 1 -- 172.21.15.103:0/3973448977 wait complete. 2020-04-22T14:15:19.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.146+0000 7f325bce3700 1 Processor -- start 2020-04-22T14:15:19.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.146+0000 7f325bce3700 1 -- start start 2020-04-22T14:15:19.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.146+0000 7f325bce3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f32540ac740 0x7f325413ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:19.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.147+0000 7f325bce3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f32541426d0 0x7f3254157a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:19.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.147+0000 7f325bce3700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32540b3f00 con 0x7f3254067170 2020-04-22T14:15:19.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.147+0000 7f325bce3700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f325413b180 con 0x7f32540ac740 2020-04-22T14:15:19.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.147+0000 7f325bce3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3254157e70 con 0x7f32541426d0 2020-04-22T14:15:19.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.147+0000 7f3259a7f700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f3254067170 0x7f3254061340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47498/0 (socket says 172.21.15.103:47498) 2020-04-22T14:15:19.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.147+0000 7f3259a7f700 1 -- 172.21.15.103:0/1007575458 learned_addr learned my addr 172.21.15.103:0/1007575458 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:19.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.147+0000 7f325a280700 1 --2- 172.21.15.103:0/1007575458 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f32541426d0 0x7f3254157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:19.162 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.147+0000 7f3242ffd700 1 -- 172.21.15.103:0/1007575458 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2348346188 0 0) 0x7f32540b3f00 con 0x7f3254067170 2020-04-22T14:15:19.162 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.147+0000 7f325927e700 1 --2- 172.21.15.103:0/1007575458 >> v2:172.21.15.86:3300/0 conn(0x7f32540ac740 0x7f325413ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:19.162 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.147+0000 7f3242ffd700 1 -- 172.21.15.103:0/1007575458 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3234002fe0 con 0x7f3254067170 2020-04-22T14:15:19.162 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.147+0000 7f3242ffd700 1 -- 172.21.15.103:0/1007575458 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2921823538 0 0) 0x7f3234002fe0 con 0x7f3254067170 2020-04-22T14:15:19.162 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.147+0000 7f3242ffd700 1 -- 172.21.15.103:0/1007575458 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f32540b3f00 con 0x7f3254067170 2020-04-22T14:15:19.162 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.147+0000 7f3242ffd700 1 -- 172.21.15.103:0/1007575458 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f3244002f30 con 0x7f3254067170 2020-04-22T14:15:19.162 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.147+0000 7f3242ffd700 1 -- 172.21.15.103:0/1007575458 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f32541426d0 msgr2=0x7f3254157a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:19.162 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.147+0000 7f3242ffd700 1 --2- 172.21.15.103:0/1007575458 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f32541426d0 0x7f3254157a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:19.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.147+0000 7f3242ffd700 1 -- 172.21.15.103:0/1007575458 >> v2:172.21.15.86:3300/0 conn(0x7f32540ac740 msgr2=0x7f325413ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:19.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.147+0000 7f3242ffd700 1 --2- 172.21.15.103:0/1007575458 >> v2:172.21.15.86:3300/0 conn(0x7f32540ac740 0x7f325413ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:19.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.147+0000 7f3242ffd700 1 -- 172.21.15.103:0/1007575458 >> v1:172.21.15.103:6789/0 conn(0x7f3254067170 legacy=0x7f3254061340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:19.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.147+0000 7f3242ffd700 1 --2- 172.21.15.103:0/1007575458 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32340049b0 0x7f3234004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:19.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.147+0000 7f3242ffd700 1 --2- 172.21.15.103:0/1007575458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3234003920 0x7f3234003d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:19.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.147+0000 7f3242ffd700 1 --2- 172.21.15.103:0/1007575458 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f32541426d0 0x7f32340041c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:19.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.147+0000 7f3242ffd700 1 -- 172.21.15.103:0/1007575458 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325413b180 con 0x7f32340049b0 2020-04-22T14:15:19.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.147+0000 7f3242ffd700 1 -- 172.21.15.103:0/1007575458 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3254157e70 con 0x7f3234003920 2020-04-22T14:15:19.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.147+0000 7f3242ffd700 1 -- 172.21.15.103:0/1007575458 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3234004620 con 0x7f32541426d0 2020-04-22T14:15:19.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.147+0000 7f325927e700 1 --2- 172.21.15.103:0/1007575458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3234003920 0x7f3234003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:19.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.147+0000 7f3259a7f700 1 --2- 172.21.15.103:0/1007575458 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32340049b0 0x7f3234004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:19.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.147+0000 7f325a280700 1 --2- 172.21.15.103:0/1007575458 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f32541426d0 0x7f32340041c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:19.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.147+0000 7f325927e700 1 -- 172.21.15.103:0/1007575458 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f32541426d0 msgr2=0x7f32340041c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:19.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.147+0000 7f325927e700 1 --2- 172.21.15.103:0/1007575458 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f32541426d0 0x7f32340041c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:19.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.147+0000 7f325927e700 1 -- 172.21.15.103:0/1007575458 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32340049b0 msgr2=0x7f3234004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:19.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.148+0000 7f325927e700 1 --2- 172.21.15.103:0/1007575458 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32340049b0 0x7f3234004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:19.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.148+0000 7f325927e700 1 -- 172.21.15.103:0/1007575458 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32540b3c60 con 0x7f3234003920 2020-04-22T14:15:19.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.148+0000 7f325bce3700 1 -- 172.21.15.103:0/1007575458 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3254153b80 con 0x7f3234003920 2020-04-22T14:15:19.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.148+0000 7f325927e700 1 --2- 172.21.15.103:0/1007575458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3234003920 0x7f3234003d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3250001f50 tx=0x7f3250010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:19.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.148+0000 7f325bce3700 1 -- 172.21.15.103:0/1007575458 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3254144690 con 0x7f3234003920 2020-04-22T14:15:19.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.148+0000 7f325927e700 1 --2- 172.21.15.103:0/1007575458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3234003920 0x7f3234003d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3250001f50 tx=0x7f3250010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:19.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.148+0000 7f325927e700 1 --2- 172.21.15.103:0/1007575458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3234003920 0x7f3234003d60 secure :-1 s=READY pgs=1519 cs=0 l=1 rx=0x7f3250001f50 tx=0x7f3250010c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:19.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.148+0000 7f325927e700 1 --2- 172.21.15.103:0/1007575458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3234003920 0x7f3234003d60 secure :-1 s=THROTTLE_DONE pgs=1519 cs=0 l=1 rx=0x7f3250001f50 tx=0x7f3250010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:19.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.148+0000 7f325927e700 1 --2- 172.21.15.103:0/1007575458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3234003920 0x7f3234003d60 secure :-1 s=THROTTLE_DONE pgs=1519 cs=0 l=1 rx=0x7f3250001f50 tx=0x7f3250010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:19.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.148+0000 7f3242ffd700 1 -- 172.21.15.103:0/1007575458 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f325000c700 con 0x7f3234003920 2020-04-22T14:15:19.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.148+0000 7f325927e700 1 --2- 172.21.15.103:0/1007575458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3234003920 0x7f3234003d60 secure :-1 s=THROTTLE_DONE pgs=1519 cs=0 l=1 rx=0x7f3250001f50 tx=0x7f3250010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:19.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.148+0000 7f3242ffd700 1 -- 172.21.15.103:0/1007575458 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f325000c860 con 0x7f3234003920 2020-04-22T14:15:19.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.148+0000 7f3242ffd700 1 -- 172.21.15.103:0/1007575458 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f325000cc00 con 0x7f3234003920 2020-04-22T14:15:19.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.148+0000 7f325927e700 1 --2- 172.21.15.103:0/1007575458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3234003920 0x7f3234003d60 secure :-1 s=THROTTLE_DONE pgs=1519 cs=0 l=1 rx=0x7f3250001f50 tx=0x7f3250010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:19.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.149+0000 7f325bce3700 1 -- 172.21.15.103:0/1007575458 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32540b3a70 con 0x7f3234003920 2020-04-22T14:15:19.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.149+0000 7f3242ffd700 1 -- 172.21.15.103:0/1007575458 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f325000cd60 con 0x7f3234003920 2020-04-22T14:15:19.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.149+0000 7f325927e700 1 --2- 172.21.15.103:0/1007575458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3234003920 0x7f3234003d60 secure :-1 s=THROTTLE_DONE pgs=1519 cs=0 l=1 rx=0x7f3250001f50 tx=0x7f3250010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:19.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.149+0000 7f3242ffd700 1 --2- 172.21.15.103:0/1007575458 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3234055ba0 0x7f3234058060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:19.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.149+0000 7f3242ffd700 1 -- 172.21.15.103:0/1007575458 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3250060fc0 con 0x7f3234003920 2020-04-22T14:15:19.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.149+0000 7f3259a7f700 1 --2- 172.21.15.103:0/1007575458 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3234055ba0 0x7f3234058060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:19.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.149+0000 7f3259a7f700 1 --2- 172.21.15.103:0/1007575458 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3234055ba0 0x7f3234058060 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3244007aa0 tx=0x7f3244007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:19.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.149+0000 7f3259a7f700 1 --2- 172.21.15.103:0/1007575458 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3234055ba0 0x7f3234058060 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3244007aa0 tx=0x7f3244007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:19.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.149+0000 7f3259a7f700 1 --2- 172.21.15.103:0/1007575458 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3234055ba0 0x7f3234058060 secure :-1 s=READY pgs=553 cs=0 l=1 rx=0x7f3244007aa0 tx=0x7f3244007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:19.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.153+0000 7f325927e700 1 --2- 172.21.15.103:0/1007575458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3234003920 0x7f3234003d60 secure :-1 s=THROTTLE_DONE pgs=1519 cs=0 l=1 rx=0x7f3250001f50 tx=0x7f3250010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:19.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.153+0000 7f3242ffd700 1 -- 172.21.15.103:0/1007575458 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f325003c340 con 0x7f3234003920 2020-04-22T14:15:19.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.342+0000 7f325bce3700 1 -- 172.21.15.103:0/1007575458 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3254056c90 con 0x7f3234003920 2020-04-22T14:15:19.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.343+0000 7f325927e700 1 --2- 172.21.15.103:0/1007575458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3234003920 0x7f3234003d60 secure :-1 s=THROTTLE_DONE pgs=1519 cs=0 l=1 rx=0x7f3250001f50 tx=0x7f3250010c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:19.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.343+0000 7f3242ffd700 1 -- 172.21.15.103:0/1007575458 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+2143 (secure 0 0 0) 0x7f325003f960 con 0x7f3234003920 2020-04-22T14:15:19.345 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:15:19.346 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":74,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5987,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/3564040484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3564040484},{"type":"v1","addr":"172.21.15.86:6835","nonce":3564040484}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":70}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:15:12.286236+0000","modified":"2020-04-22T14:15:14.292028+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7452},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7452":{"gid":7452,"name":"a","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/1492911872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1492911872},{"type":"v1","addr":"172.21.15.103:6833","nonce":1492911872}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2020-04-22T14:15:19.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.344+0000 7f325bce3700 1 -- 172.21.15.103:0/1007575458 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3234055ba0 msgr2=0x7f3234058060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:19.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.344+0000 7f325bce3700 1 --2- 172.21.15.103:0/1007575458 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3234055ba0 0x7f3234058060 secure :-1 s=READY pgs=553 cs=0 l=1 rx=0x7f3244007aa0 tx=0x7f3244007a40).stop 2020-04-22T14:15:19.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.344+0000 7f325bce3700 1 -- 172.21.15.103:0/1007575458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3234003920 msgr2=0x7f3234003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:19.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.344+0000 7f325bce3700 1 --2- 172.21.15.103:0/1007575458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3234003920 0x7f3234003d60 secure :-1 s=READY pgs=1519 cs=0 l=1 rx=0x7f3250001f50 tx=0x7f3250010c40).stop 2020-04-22T14:15:19.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.344+0000 7f325a280700 1 -- 172.21.15.103:0/1007575458 reap_dead start 2020-04-22T14:15:19.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.344+0000 7f325a280700 1 -- 172.21.15.103:0/1007575458 reap_dead start 2020-04-22T14:15:19.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.344+0000 7f325bce3700 1 -- 172.21.15.103:0/1007575458 shutdown_connections 2020-04-22T14:15:19.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.344+0000 7f325bce3700 1 -- 172.21.15.103:0/1007575458 >> 172.21.15.103:0/1007575458 conn(0x7f32540b9160 msgr2=0x7f32540b6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:19.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.344+0000 7f325bce3700 1 -- 172.21.15.103:0/1007575458 shutdown_connections 2020-04-22T14:15:19.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:19.344+0000 7f325bce3700 1 -- 172.21.15.103:0/1007575458 wait complete. 2020-04-22T14:15:19.348 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 74 2020-04-22T14:15:19.558 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 7452}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 17, u'failed': [], u'epoch': 74, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [18], u'info': {u'gid_7452': {u'export_targets': [], u'name': u'a', u'incarnation': 71, u'state_seq': 3, u'state': u'up:active', u'gid': 7452, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 1492911872, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 1492911872, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/1492911872'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:15:12.286236+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:15:14.292028+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:15:19.558 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:15:19.558 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:19.573 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:15:19.731 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:15:19.731 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:15:19.731 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:15:19.731 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 7452, 2020-04-22T14:15:19.731 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:15:19.731 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:15:19.732 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 7.4416448639999997, 2020-04-22T14:15:19.732 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 74, 2020-04-22T14:15:19.732 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 102, 2020-04-22T14:15:19.732 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 102, 2020-04-22T14:15:19.732 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 12.846308742 2020-04-22T14:15:19.732 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:15:19.739 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 7452, "want_state": "up:active", "state": "up:active", "rank_uptime": 7.4416448639999997, "mdsmap_epoch": 74, "osdmap_epoch": 102, "osdmap_epoch_barrier": 102, "uptime": 12.846308742 } 2020-04-22T14:15:19.739 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-04-22T14:15:19.739 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:15:19.740 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:19.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:19.753 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:15:19.813 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:15:19.813 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:15:19.813 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:15:19.813 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:15:19.814 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:15:19.814 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:15:19.814 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:15:19.814 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:15:19.814 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:15:19.815 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:15:19.815 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:15:19.815 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:15:19.815 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:15:19.815 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:15:19.815 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:15:19.815 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 41920sec preferred_lft 41920sec 2020-04-22T14:15:19.816 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:15:19.816 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:15:19.816 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-04-22T14:15:19.816 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:19.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:19.860 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:15:19.936 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:19.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:19.985 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge con-name ceph-brx ifname ceph-brx stp no' 2020-04-22T14:15:20.093 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' (bd4b7b29-8dae-4ac8-b9ec-536f049f57e9) successfully added. 2020-04-22T14:15:20.094 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:20.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:20.108 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection modify ceph-brx ipv4.addresses 192.168.255.254/16 ipv4.method manual' 2020-04-22T14:15:20.221 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:20.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:20.251 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up ceph-brx' 2020-04-22T14:15:20.359 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (master waiting for slaves) (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/39) 2020-04-22T14:15:20.359 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:20.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:20.373 INFO:teuthology.orchestra.run.smithi103:> touch /tmp/python-ceph-brx 2020-04-22T14:15:20.432 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:20.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:20.481 INFO:teuthology.orchestra.run.smithi103:> cat /proc/sys/net/ipv4/ip_forward 2020-04-22T14:15:20.541 INFO:teuthology.orchestra.run.smithi103.stdout:0 2020-04-22T14:15:20.541 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:20.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:20.589 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 0 > /tmp/python-ceph-brx' 2020-04-22T14:15:20.664 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:20.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:20.710 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 1 > /proc/sys/net/ipv4/ip_forward' 2020-04-22T14:15:20.786 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:20.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:20.833 INFO:teuthology.orchestra.run.smithi103:> route 2020-04-22T14:15:20.897 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2020-04-22T14:15:20.897 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-04-22T14:15:20.897 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 102 0 0 enp3s0f1 2020-04-22T14:15:20.897 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 102 0 0 enp3s0f1 2020-04-22T14:15:20.897 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 425 0 0 ceph-brx 2020-04-22T14:15:20.898 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:20.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:20.941 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-04-22T14:15:21.016 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:21.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:21.062 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-04-22T14:15:21.137 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:21.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:21.187 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-04-22T14:15:21.269 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:21.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:21.309 INFO:teuthology.orchestra.run.smithi103:> ip netns list 2020-04-22T14:15:21.373 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:21.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:21.419 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:15:21.479 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:21.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:21.526 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:15:21.610 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:21.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:21.651 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0' 2020-04-22T14:15:21.728 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-04-22T14:15:21.728 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:21.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:21.773 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0' 2020-04-22T14:15:21.849 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:21.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:21.898 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0' 2020-04-22T14:15:22.006 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:22.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:22.021 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up' 2020-04-22T14:15:22.131 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:22.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:22.150 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up' 2020-04-22T14:15:22.259 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:22.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:22.274 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254' 2020-04-22T14:15:22.383 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:22.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:22.397 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:15:22.472 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:22.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:22.526 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge-slave con-name brx.0 ifname brx.0 master ceph-brx' 2020-04-22T14:15:22.633 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.0' (93d59d19-5747-4294-8744-ad68e1ecbbcd) successfully added. 2020-04-22T14:15:22.634 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:22.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:22.663 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up brx.0' 2020-04-22T14:15:22.821 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/40) 2020-04-22T14:15:22.872 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-04-22T14:15:22.872 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi103.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-04-22T14:15:22.872 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:22.891 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:15:22.891 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:15:22.969 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:23.005 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:15:23.006 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:15:23.074 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:15:23.080 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:15:23.081 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:23.128 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:15:23.128 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:15:23.191 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-04-22T14:15:23.192 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:23.236 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:15:23.279 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:23.294 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:15:23.294 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:15:23.364 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:15:23.368 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:2020-04-22T14:15:23.366+0000 7fd64a7441c0 -1 init, newargv = 0x5604da9f6c50 newargc=9 2020-04-22T14:15:23.369 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[94821]: starting ceph client 2020-04-22T14:15:23.372 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[94821]: starting fuse 2020-04-22T14:15:23.377 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:15:23.382 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:23.396 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:15:23.396 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:15:23.453 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:15:23.453 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2020-04-22T14:15:23.453 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:23.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:15:23.503 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:15:23.503 INFO:teuthology.orchestra.run.smithi103:> import glob 2020-04-22T14:15:23.504 INFO:teuthology.orchestra.run.smithi103:> import re 2020-04-22T14:15:23.504 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:15:23.504 INFO:teuthology.orchestra.run.smithi103:> import subprocess 2020-04-22T14:15:23.504 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:15:23.504 INFO:teuthology.orchestra.run.smithi103:> def find_socket(client_name): 2020-04-22T14:15:23.505 INFO:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-04-22T14:15:23.505 INFO:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2020-04-22T14:15:23.505 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:15:23.505 INFO:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2020-04-22T14:15:23.505 INFO:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2020-04-22T14:15:23.505 INFO:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2020-04-22T14:15:23.505 INFO:teuthology.orchestra.run.smithi103:> return files[0] 2020-04-22T14:15:23.506 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:15:23.506 INFO:teuthology.orchestra.run.smithi103:> for f in files: 2020-04-22T14:15:23.506 INFO:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:15:23.506 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:15:23.506 INFO:teuthology.orchestra.run.smithi103:> return f 2020-04-22T14:15:23.506 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:15:23.506 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:15:23.506 INFO:teuthology.orchestra.run.smithi103:> print(find_socket("client.0")) 2020-04-22T14:15:23.507 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:15:23.605 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:15:23.612 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.0.94821.asok 2020-04-22T14:15:23.613 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.94821.asok 2020-04-22T14:15:23.613 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:23.624 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:15:23.629 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:15:23.630 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.94821.asok status 2020-04-22T14:15:23.669 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:23.697 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:15:23.807 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:15:23.807 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2020-04-22T14:15:23.807 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:15:23.807 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:15:23.807 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "0", 2020-04-22T14:15:23.808 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:15:23.808 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-04-22T14:15:23.808 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "94821", 2020-04-22T14:15:23.808 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:15:23.808 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:23.808 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2020-04-22T14:15:23.809 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2020-04-22T14:15:23.809 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 8323, 2020-04-22T14:15:23.809 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2020-04-22T14:15:23.809 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:15:23.809 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:15:23.809 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 8323 2020-04-22T14:15:23.809 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:23.810 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:15:23.810 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:23.810 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:15:23.810 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1618592206 2020-04-22T14:15:23.810 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:23.810 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:23.810 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:15:23.810 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:23.811 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:15:23.811 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1618592206 2020-04-22T14:15:23.811 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:23.811 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.8323 192.168.0.1:0/1618592206", 2020-04-22T14:15:23.811 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.1:0/1618592206", 2020-04-22T14:15:23.811 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2020-04-22T14:15:23.811 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 74, 2020-04-22T14:15:23.812 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 102, 2020-04-22T14:15:23.812 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2020-04-22T14:15:23.812 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklisted": false 2020-04-22T14:15:23.812 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:15:23.812 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:23.893 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:15:23.894 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-22T14:15:23.894 INFO:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:15:23.955 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2020-04-22T14:15:23.955 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-04-22T14:15:23.955 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:24.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:15:24.003 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:15:24.085 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:24.125 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:15:24.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.270+0000 7f1b0ab3e700 1 Processor -- start 2020-04-22T14:15:24.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.270+0000 7f1b0ab3e700 1 -- start start 2020-04-22T14:15:24.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.271+0000 7f1b0ab3e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1b041464e0 0x7f1b04064540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:24.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.271+0000 7f1b0ab3e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b04143300 con 0x7f1b04065fe0 2020-04-22T14:15:24.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.271+0000 7f1b0ab3e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b041435a0 con 0x7f1b0412c0d0 2020-04-22T14:15:24.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.271+0000 7f1b0ab3e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b04143840 con 0x7f1b041464e0 2020-04-22T14:15:24.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.271+0000 7f1b088da700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f1b0412c0d0 0x7f1b0405b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47526/0 (socket says 172.21.15.103:47526) 2020-04-22T14:15:24.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.271+0000 7f1b088da700 1 -- 172.21.15.103:0/3908615269 learned_addr learned my addr 172.21.15.103:0/3908615269 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:24.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.271+0000 7f1b090db700 1 --2- 172.21.15.103:0/3908615269 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1b041464e0 0x7f1b04064540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:24.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.271+0000 7f1b037fe700 1 -- 172.21.15.103:0/3908615269 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1372676334 0 0) 0x7f1b041435a0 con 0x7f1b0412c0d0 2020-04-22T14:15:24.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.271+0000 7f1b037fe700 1 -- 172.21.15.103:0/3908615269 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1af0003230 con 0x7f1b0412c0d0 2020-04-22T14:15:24.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.272+0000 7f1b037fe700 1 -- 172.21.15.103:0/3908615269 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2138138561 0 0) 0x7f1af0003230 con 0x7f1b0412c0d0 2020-04-22T14:15:24.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.272+0000 7f1b037fe700 1 -- 172.21.15.103:0/3908615269 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1b041464e0 msgr2=0x7f1b04064540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:24.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.272+0000 7f1b037fe700 1 --2- 172.21.15.103:0/3908615269 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1b041464e0 0x7f1b04064540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:24.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.272+0000 7f1b037fe700 1 -- 172.21.15.103:0/3908615269 >> v1:172.21.15.86:6789/0 conn(0x7f1b04065fe0 legacy=0x7f1b04063e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:24.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.272+0000 7f1b037fe700 1 -- 172.21.15.103:0/3908615269 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b0405bb50 con 0x7f1b0412c0d0 2020-04-22T14:15:24.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.272+0000 7f1b037fe700 1 -- 172.21.15.103:0/3908615269 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f1af40016d0 con 0x7f1b0412c0d0 2020-04-22T14:15:24.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.272+0000 7f1b037fe700 1 -- 172.21.15.103:0/3908615269 >> v1:172.21.15.103:6789/0 conn(0x7f1b0412c0d0 legacy=0x7f1b0405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:24.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.272+0000 7f1b037fe700 1 --2- 172.21.15.103:0/3908615269 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1b041464e0 0x7f1af0003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:24.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.272+0000 7f1b037fe700 1 --2- 172.21.15.103:0/3908615269 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1af0003bb0 0x7f1af0004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:24.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.272+0000 7f1b037fe700 1 --2- 172.21.15.103:0/3908615269 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1af0004590 0x7f1af0004a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:24.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.272+0000 7f1b037fe700 1 -- 172.21.15.103:0/3908615269 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b04143840 con 0x7f1af0003bb0 2020-04-22T14:15:24.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.272+0000 7f1b037fe700 1 -- 172.21.15.103:0/3908615269 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af0004fc0 con 0x7f1af0004590 2020-04-22T14:15:24.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.272+0000 7f1b037fe700 1 -- 172.21.15.103:0/3908615269 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af0005180 con 0x7f1b041464e0 2020-04-22T14:15:24.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.272+0000 7f1b090db700 1 --2- 172.21.15.103:0/3908615269 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1af0004590 0x7f1af0004a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:24.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.272+0000 7f1b088da700 1 --2- 172.21.15.103:0/3908615269 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1b041464e0 0x7f1af0003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:24.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.272+0000 7f1b03fff700 1 --2- 172.21.15.103:0/3908615269 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1af0003bb0 0x7f1af0004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:24.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.272+0000 7f1b090db700 1 -- 172.21.15.103:0/3908615269 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1b041464e0 msgr2=0x7f1af0003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:24.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.272+0000 7f1b090db700 1 --2- 172.21.15.103:0/3908615269 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1b041464e0 0x7f1af0003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:24.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.272+0000 7f1b090db700 1 -- 172.21.15.103:0/3908615269 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1af0003bb0 msgr2=0x7f1af0004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:24.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.272+0000 7f1b090db700 1 --2- 172.21.15.103:0/3908615269 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1af0003bb0 0x7f1af0004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:24.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.272+0000 7f1b090db700 1 -- 172.21.15.103:0/3908615269 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af0003230 con 0x7f1af0004590 2020-04-22T14:15:24.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.272+0000 7f1b03fff700 1 --2- 172.21.15.103:0/3908615269 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1af0003bb0 0x7f1af0004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:15:24.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.272+0000 7f1b090db700 1 --2- 172.21.15.103:0/3908615269 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1af0004590 0x7f1af0004a10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1afc0032b0 tx=0x7f1afc010380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.272+0000 7f1b090db700 1 --2- 172.21.15.103:0/3908615269 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1af0004590 0x7f1af0004a10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1afc0032b0 tx=0x7f1afc010380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.272+0000 7f1b090db700 1 --2- 172.21.15.103:0/3908615269 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1af0004590 0x7f1af0004a10 secure :-1 s=READY pgs=1523 cs=0 l=1 rx=0x7f1afc0032b0 tx=0x7f1afc010380).ready entity=mon.1 client_cookie=e70ba65e3f83f04d server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:24.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.272+0000 7f1b090db700 1 --2- 172.21.15.103:0/3908615269 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1af0004590 0x7f1af0004a10 secure :-1 s=THROTTLE_DONE pgs=1523 cs=0 l=1 rx=0x7f1afc0032b0 tx=0x7f1afc010380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.272+0000 7f1b090db700 1 --2- 172.21.15.103:0/3908615269 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1af0004590 0x7f1af0004a10 secure :-1 s=THROTTLE_DONE pgs=1523 cs=0 l=1 rx=0x7f1afc0032b0 tx=0x7f1afc010380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.272+0000 7f1b037fe700 1 -- 172.21.15.103:0/3908615269 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1afc005c30 con 0x7f1af0004590 2020-04-22T14:15:24.297 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.272+0000 7f1b090db700 1 --2- 172.21.15.103:0/3908615269 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1af0004590 0x7f1af0004a10 secure :-1 s=THROTTLE_DONE pgs=1523 cs=0 l=1 rx=0x7f1afc0032b0 tx=0x7f1afc010380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.298 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.272+0000 7f1b037fe700 1 -- 172.21.15.103:0/3908615269 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1afc005d90 con 0x7f1af0004590 2020-04-22T14:15:24.298 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.272+0000 7f1b037fe700 1 -- 172.21.15.103:0/3908615269 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1afc0112c0 con 0x7f1af0004590 2020-04-22T14:15:24.298 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.272+0000 7f1b0ab3e700 1 -- 172.21.15.103:0/3908615269 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1af0004590 msgr2=0x7f1af0004a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:24.298 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.272+0000 7f1b0ab3e700 1 --2- 172.21.15.103:0/3908615269 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1af0004590 0x7f1af0004a10 secure :-1 s=READY pgs=1523 cs=0 l=1 rx=0x7f1afc0032b0 tx=0x7f1afc010380).stop 2020-04-22T14:15:24.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.272+0000 7f1b090db700 1 -- 172.21.15.103:0/3908615269 reap_dead start 2020-04-22T14:15:24.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.273+0000 7f1b0ab3e700 1 -- 172.21.15.103:0/3908615269 shutdown_connections 2020-04-22T14:15:24.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.273+0000 7f1b0ab3e700 1 -- 172.21.15.103:0/3908615269 >> 172.21.15.103:0/3908615269 conn(0x7f1b040b9160 msgr2=0x7f1b0405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:24.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.273+0000 7f1b0ab3e700 1 -- 172.21.15.103:0/3908615269 shutdown_connections 2020-04-22T14:15:24.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.273+0000 7f1b0ab3e700 1 -- 172.21.15.103:0/3908615269 wait complete. 2020-04-22T14:15:24.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.274+0000 7f1b0ab3e700 1 Processor -- start 2020-04-22T14:15:24.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.274+0000 7f1b0ab3e700 1 -- start start 2020-04-22T14:15:24.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.275+0000 7f1b0ab3e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1b041535d0 0x7f1b04150a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:24.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.275+0000 7f1b0ab3e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1b041539b0 0x7f1b04153e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:24.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.275+0000 7f1b0ab3e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1b040ad5f0 0x7f1b040ada80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:24.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.275+0000 7f1b0ab3e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b04150eb0 con 0x7f1b041535d0 2020-04-22T14:15:24.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.275+0000 7f1b0ab3e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b040b4680 con 0x7f1b040ad5f0 2020-04-22T14:15:24.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.275+0000 7f1b0ab3e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b040b4140 con 0x7f1b041539b0 2020-04-22T14:15:24.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.275+0000 7f1b090db700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1b040ad5f0 0x7f1b040ada80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:24.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.275+0000 7f1b090db700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1b040ad5f0 0x7f1b040ada80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55350/0 (socket says 172.21.15.103:55350) 2020-04-22T14:15:24.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.275+0000 7f1b090db700 1 -- 172.21.15.103:0/2963386170 learned_addr learned my addr 172.21.15.103:0/2963386170 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:15:24.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.275+0000 7f1b088da700 1 --2- 172.21.15.103:0/2963386170 >> v2:172.21.15.86:3300/0 conn(0x7f1b041535d0 0x7f1b04150a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:24.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.275+0000 7f1b03fff700 1 --2- 172.21.15.103:0/2963386170 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1b041539b0 0x7f1b04153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:24.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.275+0000 7f1b090db700 1 -- 172.21.15.103:0/2963386170 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1b041539b0 msgr2=0x7f1b04153e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:24.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.275+0000 7f1b090db700 1 --2- 172.21.15.103:0/2963386170 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1b041539b0 0x7f1b04153e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:24.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.275+0000 7f1b090db700 1 -- 172.21.15.103:0/2963386170 >> v2:172.21.15.86:3300/0 conn(0x7f1b041535d0 msgr2=0x7f1b04150a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:24.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.275+0000 7f1b090db700 1 --2- 172.21.15.103:0/2963386170 >> v2:172.21.15.86:3300/0 conn(0x7f1b041535d0 0x7f1b04150a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:24.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.275+0000 7f1b090db700 1 -- 172.21.15.103:0/2963386170 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b040b43e0 con 0x7f1b040ad5f0 2020-04-22T14:15:24.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.275+0000 7f1b090db700 1 --2- 172.21.15.103:0/2963386170 >> v2:172.21.15.103:3300/0 conn(0x7f1b040ad5f0 0x7f1b040ada80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1b0405be50 tx=0x7f1afc010380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.275+0000 7f1b090db700 1 --2- 172.21.15.103:0/2963386170 >> v2:172.21.15.103:3300/0 conn(0x7f1b040ad5f0 0x7f1b040ada80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1b0405be50 tx=0x7f1afc010380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.275+0000 7f1b090db700 1 --2- 172.21.15.103:0/2963386170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b040ad5f0 0x7f1b040ada80 secure :-1 s=READY pgs=1524 cs=0 l=1 rx=0x7f1b0405be50 tx=0x7f1afc010380).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:24.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.275+0000 7f1b090db700 1 --2- 172.21.15.103:0/2963386170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b040ad5f0 0x7f1b040ada80 secure :-1 s=THROTTLE_DONE pgs=1524 cs=0 l=1 rx=0x7f1b0405be50 tx=0x7f1afc010380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.275+0000 7f1b01ffb700 1 -- 172.21.15.103:0/2963386170 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1afc007c00 con 0x7f1b040ad5f0 2020-04-22T14:15:24.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.275+0000 7f1b090db700 1 --2- 172.21.15.103:0/2963386170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b040ad5f0 0x7f1b040ada80 secure :-1 s=THROTTLE_DONE pgs=1524 cs=0 l=1 rx=0x7f1b0405be50 tx=0x7f1afc010380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.275+0000 7f1b090db700 1 --2- 172.21.15.103:0/2963386170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b040ad5f0 0x7f1b040ada80 secure :-1 s=THROTTLE_DONE pgs=1524 cs=0 l=1 rx=0x7f1b0405be50 tx=0x7f1afc010380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.275+0000 7f1b01ffb700 1 -- 172.21.15.103:0/2963386170 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1afc005c30 con 0x7f1b040ad5f0 2020-04-22T14:15:24.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.275+0000 7f1b0ab3e700 1 -- 172.21.15.103:0/2963386170 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b04129a80 con 0x7f1b040ad5f0 2020-04-22T14:15:24.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.275+0000 7f1b01ffb700 1 -- 172.21.15.103:0/2963386170 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1afc00e410 con 0x7f1b040ad5f0 2020-04-22T14:15:24.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.275+0000 7f1b0ab3e700 1 -- 172.21.15.103:0/2963386170 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b040ae0a0 con 0x7f1b040ad5f0 2020-04-22T14:15:24.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.276+0000 7f1b090db700 1 --2- 172.21.15.103:0/2963386170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b040ad5f0 0x7f1b040ada80 secure :-1 s=THROTTLE_DONE pgs=1524 cs=0 l=1 rx=0x7f1b0405be50 tx=0x7f1afc010380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.276+0000 7f1b0ab3e700 1 -- 172.21.15.103:0/2963386170 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b04056c90 con 0x7f1b040ad5f0 2020-04-22T14:15:24.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.276+0000 7f1b01ffb700 1 -- 172.21.15.103:0/2963386170 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f1afc00e570 con 0x7f1b040ad5f0 2020-04-22T14:15:24.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.276+0000 7f1b090db700 1 --2- 172.21.15.103:0/2963386170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b040ad5f0 0x7f1b040ada80 secure :-1 s=THROTTLE_DONE pgs=1524 cs=0 l=1 rx=0x7f1b0405be50 tx=0x7f1afc010380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.277+0000 7f1b01ffb700 1 --2- 172.21.15.103:0/2963386170 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1ae404da30 0x7f1ae404fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:24.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.277+0000 7f1b01ffb700 1 -- 172.21.15.103:0/2963386170 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1afc061810 con 0x7f1b040ad5f0 2020-04-22T14:15:24.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.277+0000 7f1b088da700 1 --2- 172.21.15.103:0/2963386170 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1ae404da30 0x7f1ae404fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:24.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.277+0000 7f1b088da700 1 --2- 172.21.15.103:0/2963386170 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1ae404da30 0x7f1ae404fef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1af40013e0 tx=0x7f1b0405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.277+0000 7f1b088da700 1 --2- 172.21.15.103:0/2963386170 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1ae404da30 0x7f1ae404fef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1af40013e0 tx=0x7f1b0405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.277+0000 7f1b088da700 1 --2- 172.21.15.103:0/2963386170 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1ae404da30 0x7f1ae404fef0 secure :-1 s=READY pgs=554 cs=0 l=1 rx=0x7f1af40013e0 tx=0x7f1b0405bce0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:24.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.281+0000 7f1b090db700 1 --2- 172.21.15.103:0/2963386170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b040ad5f0 0x7f1b040ada80 secure :-1 s=THROTTLE_DONE pgs=1524 cs=0 l=1 rx=0x7f1b0405be50 tx=0x7f1afc010380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.281+0000 7f1b01ffb700 1 -- 172.21.15.103:0/2963386170 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f1afc03cbf0 con 0x7f1b040ad5f0 2020-04-22T14:15:24.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.424+0000 7f1b0ab3e700 1 -- 172.21.15.103:0/2963386170 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b040b55b0 con 0x7f1b040ad5f0 2020-04-22T14:15:24.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.425+0000 7f1b090db700 1 --2- 172.21.15.103:0/2963386170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b040ad5f0 0x7f1b040ada80 secure :-1 s=THROTTLE_DONE pgs=1524 cs=0 l=1 rx=0x7f1b0405be50 tx=0x7f1afc010380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.425+0000 7f1b01ffb700 1 -- 172.21.15.103:0/2963386170 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+16096 (secure 0 0 0) 0x7f1afc040210 con 0x7f1b040ad5f0 2020-04-22T14:15:24.427 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:15:24.428 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":102,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:15:14.291464+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:15:10.023228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2020-04-22T14:15:11.048528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:15:24.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.426+0000 7f1b0ab3e700 1 -- 172.21.15.103:0/2963386170 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1ae404da30 msgr2=0x7f1ae404fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:24.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.426+0000 7f1b0ab3e700 1 --2- 172.21.15.103:0/2963386170 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1ae404da30 0x7f1ae404fef0 secure :-1 s=READY pgs=554 cs=0 l=1 rx=0x7f1af40013e0 tx=0x7f1b0405bce0).stop 2020-04-22T14:15:24.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.426+0000 7f1b0ab3e700 1 -- 172.21.15.103:0/2963386170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b040ad5f0 msgr2=0x7f1b040ada80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:24.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.426+0000 7f1b0ab3e700 1 --2- 172.21.15.103:0/2963386170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b040ad5f0 0x7f1b040ada80 secure :-1 s=READY pgs=1524 cs=0 l=1 rx=0x7f1b0405be50 tx=0x7f1afc010380).stop 2020-04-22T14:15:24.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.427+0000 7f1b0ab3e700 1 -- 172.21.15.103:0/2963386170 shutdown_connections 2020-04-22T14:15:24.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.427+0000 7f1b0ab3e700 1 --2- 172.21.15.103:0/2963386170 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1ae404da30 0x7f1ae404fef0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:24.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.427+0000 7f1b0ab3e700 1 --2- 172.21.15.103:0/2963386170 >> v2:172.21.15.86:3300/0 conn(0x7f1b041535d0 0x7f1b04150a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:24.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.427+0000 7f1b0ab3e700 1 --2- 172.21.15.103:0/2963386170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b040ad5f0 0x7f1b040ada80 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:24.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.427+0000 7f1b0ab3e700 1 --2- 172.21.15.103:0/2963386170 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1b041539b0 0x7f1b04153e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:24.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.427+0000 7f1b0ab3e700 1 -- 172.21.15.103:0/2963386170 >> 172.21.15.103:0/2963386170 conn(0x7f1b040b9160 msgr2=0x7f1b0412ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:24.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.427+0000 7f1b0ab3e700 1 -- 172.21.15.103:0/2963386170 shutdown_connections 2020-04-22T14:15:24.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.427+0000 7f1b0ab3e700 1 -- 172.21.15.103:0/2963386170 wait complete. 2020-04-22T14:15:24.440 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:15:10.023228+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 17, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'100', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:15:11.048528+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 18, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'102', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:15:24.440 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:24.453 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:15:24.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.600+0000 7f6b70ddb700 1 Processor -- start 2020-04-22T14:15:24.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.600+0000 7f6b70ddb700 1 -- start start 2020-04-22T14:15:24.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.601+0000 7f6b70ddb700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b6c0af390 0x7f6b6c0b4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:24.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.601+0000 7f6b70ddb700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b6c0b49d0 con 0x7f6b6c14ddb0 2020-04-22T14:15:24.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.601+0000 7f6b70ddb700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b6c061830 con 0x7f6b6c0b9140 2020-04-22T14:15:24.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.601+0000 7f6b70ddb700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c061ad0 con 0x7f6b6c0af390 2020-04-22T14:15:24.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.601+0000 7f6b6a59c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f6b6c0b9140 0x7f6b6c061f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47544/0 (socket says 172.21.15.103:47544) 2020-04-22T14:15:24.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.601+0000 7f6b6a59c700 1 -- 172.21.15.103:0/1886823778 learned_addr learned my addr 172.21.15.103:0/1886823778 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:24.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.601+0000 7f6b69d9b700 1 -- 172.21.15.103:0/1886823778 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1367180668 0 0) 0x7f6b6c061830 con 0x7f6b6c0b9140 2020-04-22T14:15:24.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.601+0000 7f6b69d9b700 1 -- 172.21.15.103:0/1886823778 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b4c003230 con 0x7f6b6c0b9140 2020-04-22T14:15:24.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.601+0000 7f6b63fff700 1 --2- 172.21.15.103:0/1886823778 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b6c0af390 0x7f6b6c0b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:24.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.601+0000 7f6b69d9b700 1 -- 172.21.15.103:0/1886823778 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 118420014 0 0) 0x7f6b4c003230 con 0x7f6b6c0b9140 2020-04-22T14:15:24.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.601+0000 7f6b69d9b700 1 -- 172.21.15.103:0/1886823778 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b6c0af390 msgr2=0x7f6b6c0b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:24.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.601+0000 7f6b69d9b700 1 --2- 172.21.15.103:0/1886823778 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b6c0af390 0x7f6b6c0b4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:24.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.601+0000 7f6b69d9b700 1 -- 172.21.15.103:0/1886823778 >> v1:172.21.15.86:6789/0 conn(0x7f6b6c14ddb0 legacy=0x7f6b6c14e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:24.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.601+0000 7f6b69d9b700 1 -- 172.21.15.103:0/1886823778 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b6c0b9520 con 0x7f6b6c0b9140 2020-04-22T14:15:24.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.601+0000 7f6b69d9b700 1 -- 172.21.15.103:0/1886823778 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f6b5c0016d0 con 0x7f6b6c0b9140 2020-04-22T14:15:24.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.601+0000 7f6b63fff700 1 --2- 172.21.15.103:0/1886823778 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b6c0af390 0x7f6b6c0b4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:15:24.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.601+0000 7f6b69d9b700 1 -- 172.21.15.103:0/1886823778 >> v1:172.21.15.103:6789/0 conn(0x7f6b6c0b9140 legacy=0x7f6b6c061f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:24.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.601+0000 7f6b69d9b700 1 --2- 172.21.15.103:0/1886823778 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b4c003720 0x7f6b4c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:24.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.601+0000 7f6b69d9b700 1 --2- 172.21.15.103:0/1886823778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b4c004060 0x7f6b4c004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:24.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.601+0000 7f6b69d9b700 1 --2- 172.21.15.103:0/1886823778 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b6c0af390 0x7f6b4c004ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:24.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.601+0000 7f6b69d9b700 1 -- 172.21.15.103:0/1886823778 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c061ad0 con 0x7f6b4c003720 2020-04-22T14:15:24.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.602+0000 7f6b69d9b700 1 -- 172.21.15.103:0/1886823778 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c005020 con 0x7f6b4c004060 2020-04-22T14:15:24.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.602+0000 7f6b69d9b700 1 -- 172.21.15.103:0/1886823778 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c0051e0 con 0x7f6b6c0af390 2020-04-22T14:15:24.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.602+0000 7f6b63fff700 1 --2- 172.21.15.103:0/1886823778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b4c004060 0x7f6b4c004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:24.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.602+0000 7f6b6a59c700 1 --2- 172.21.15.103:0/1886823778 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b4c003720 0x7f6b4c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:24.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.602+0000 7f6b6ad9d700 1 --2- 172.21.15.103:0/1886823778 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b6c0af390 0x7f6b4c004ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:24.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.602+0000 7f6b63fff700 1 -- 172.21.15.103:0/1886823778 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b6c0af390 msgr2=0x7f6b4c004ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:24.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.602+0000 7f6b63fff700 1 --2- 172.21.15.103:0/1886823778 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b6c0af390 0x7f6b4c004ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:24.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.602+0000 7f6b63fff700 1 -- 172.21.15.103:0/1886823778 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b4c003720 msgr2=0x7f6b4c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:24.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.602+0000 7f6b63fff700 1 --2- 172.21.15.103:0/1886823778 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b4c003720 0x7f6b4c003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:24.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.602+0000 7f6b63fff700 1 -- 172.21.15.103:0/1886823778 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b4c003230 con 0x7f6b4c004060 2020-04-22T14:15:24.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.602+0000 7f6b6ad9d700 1 --2- 172.21.15.103:0/1886823778 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b6c0af390 0x7f6b4c004ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:15:24.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.602+0000 7f6b63fff700 1 --2- 172.21.15.103:0/1886823778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b4c004060 0x7f6b4c004530 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6b54002f30 tx=0x7f6b5400fed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.602+0000 7f6b63fff700 1 --2- 172.21.15.103:0/1886823778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b4c004060 0x7f6b4c004530 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6b54002f30 tx=0x7f6b5400fed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.602+0000 7f6b63fff700 1 --2- 172.21.15.103:0/1886823778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b4c004060 0x7f6b4c004530 secure :-1 s=READY pgs=1526 cs=0 l=1 rx=0x7f6b54002f30 tx=0x7f6b5400fed0).ready entity=mon.1 client_cookie=fc7916ce71b0184d server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:24.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.602+0000 7f6b63fff700 1 --2- 172.21.15.103:0/1886823778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b4c004060 0x7f6b4c004530 secure :-1 s=THROTTLE_DONE pgs=1526 cs=0 l=1 rx=0x7f6b54002f30 tx=0x7f6b5400fed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.602+0000 7f6b69d9b700 1 -- 172.21.15.103:0/1886823778 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b54008d30 con 0x7f6b4c004060 2020-04-22T14:15:24.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.602+0000 7f6b63fff700 1 --2- 172.21.15.103:0/1886823778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b4c004060 0x7f6b4c004530 secure :-1 s=THROTTLE_DONE pgs=1526 cs=0 l=1 rx=0x7f6b54002f30 tx=0x7f6b5400fed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.602+0000 7f6b63fff700 1 --2- 172.21.15.103:0/1886823778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b4c004060 0x7f6b4c004530 secure :-1 s=THROTTLE_DONE pgs=1526 cs=0 l=1 rx=0x7f6b54002f30 tx=0x7f6b5400fed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.602+0000 7f6b69d9b700 1 -- 172.21.15.103:0/1886823778 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b54008e90 con 0x7f6b4c004060 2020-04-22T14:15:24.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.602+0000 7f6b69d9b700 1 -- 172.21.15.103:0/1886823778 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b540109f0 con 0x7f6b4c004060 2020-04-22T14:15:24.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.602+0000 7f6b70ddb700 1 -- 172.21.15.103:0/1886823778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b4c004060 msgr2=0x7f6b4c004530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:24.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.602+0000 7f6b70ddb700 1 --2- 172.21.15.103:0/1886823778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b4c004060 0x7f6b4c004530 secure :-1 s=READY pgs=1526 cs=0 l=1 rx=0x7f6b54002f30 tx=0x7f6b5400fed0).stop 2020-04-22T14:15:24.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.602+0000 7f6b6ad9d700 1 -- 172.21.15.103:0/1886823778 reap_dead start 2020-04-22T14:15:24.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.603+0000 7f6b70ddb700 1 -- 172.21.15.103:0/1886823778 shutdown_connections 2020-04-22T14:15:24.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.603+0000 7f6b70ddb700 1 -- 172.21.15.103:0/1886823778 >> 172.21.15.103:0/1886823778 conn(0x7f6b6c05b7b0 msgr2=0x7f6b6c0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:24.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.603+0000 7f6b70ddb700 1 -- 172.21.15.103:0/1886823778 shutdown_connections 2020-04-22T14:15:24.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.603+0000 7f6b70ddb700 1 -- 172.21.15.103:0/1886823778 wait complete. 2020-04-22T14:15:24.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.604+0000 7f6b70ddb700 1 Processor -- start 2020-04-22T14:15:24.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.604+0000 7f6b70ddb700 1 -- start start 2020-04-22T14:15:24.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.604+0000 7f6b70ddb700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6b6c147d70 0x7f6b6c14d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:24.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.604+0000 7f6b70ddb700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6b6c0b0c70 0x7f6b6c0b10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:24.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.604+0000 7f6b70ddb700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b6c0b02a0 con 0x7f6b6c14d500 2020-04-22T14:15:24.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.604+0000 7f6b70ddb700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b6c0b0540 con 0x7f6b6c147d70 2020-04-22T14:15:24.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.604+0000 7f6b70ddb700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b6c148150 con 0x7f6b6c0b0c70 2020-04-22T14:15:24.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.604+0000 7f6b6ad9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6b6c0b0c70 0x7f6b6c0b10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:24.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.604+0000 7f6b6ad9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6b6c0b0c70 0x7f6b6c0b10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55368/0 (socket says 172.21.15.103:55368) 2020-04-22T14:15:24.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.604+0000 7f6b6ad9d700 1 -- 172.21.15.103:0/3031608237 learned_addr learned my addr 172.21.15.103:0/3031608237 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:15:24.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.604+0000 7f6b6a59c700 1 --2- 172.21.15.103:0/3031608237 >> v2:172.21.15.86:3300/0 conn(0x7f6b6c147d70 0x7f6b6c14d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:24.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.605+0000 7f6b6ad9d700 1 -- 172.21.15.103:0/3031608237 >> v2:172.21.15.86:3300/0 conn(0x7f6b6c147d70 msgr2=0x7f6b6c14d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:24.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.605+0000 7f6b6ad9d700 1 --2- 172.21.15.103:0/3031608237 >> v2:172.21.15.86:3300/0 conn(0x7f6b6c147d70 0x7f6b6c14d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:24.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.605+0000 7f6b6ad9d700 1 -- 172.21.15.103:0/3031608237 >> v1:172.21.15.86:6789/0 conn(0x7f6b6c14d500 legacy=0x7f6b6c143b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:24.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.605+0000 7f6b6ad9d700 1 -- 172.21.15.103:0/3031608237 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b6c14cbc0 con 0x7f6b6c0b0c70 2020-04-22T14:15:24.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.605+0000 7f6b6ad9d700 1 --2- 172.21.15.103:0/3031608237 >> v2:172.21.15.103:3300/0 conn(0x7f6b6c0b0c70 0x7f6b6c0b10e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6b5c0010d0 tx=0x7f6b6400c800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.605+0000 7f6b6ad9d700 1 --2- 172.21.15.103:0/3031608237 >> v2:172.21.15.103:3300/0 conn(0x7f6b6c0b0c70 0x7f6b6c0b10e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6b5c0010d0 tx=0x7f6b6400c800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.605+0000 7f6b6ad9d700 1 --2- 172.21.15.103:0/3031608237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b6c0b0c70 0x7f6b6c0b10e0 secure :-1 s=READY pgs=1527 cs=0 l=1 rx=0x7f6b5c0010d0 tx=0x7f6b6400c800).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:24.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.605+0000 7f6b6ad9d700 1 --2- 172.21.15.103:0/3031608237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b6c0b0c70 0x7f6b6c0b10e0 secure :-1 s=THROTTLE_DONE pgs=1527 cs=0 l=1 rx=0x7f6b5c0010d0 tx=0x7f6b6400c800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.605+0000 7f6b637fe700 1 -- 172.21.15.103:0/3031608237 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b6400cca0 con 0x7f6b6c0b0c70 2020-04-22T14:15:24.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.605+0000 7f6b6ad9d700 1 --2- 172.21.15.103:0/3031608237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b6c0b0c70 0x7f6b6c0b10e0 secure :-1 s=THROTTLE_DONE pgs=1527 cs=0 l=1 rx=0x7f6b5c0010d0 tx=0x7f6b6400c800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.605+0000 7f6b6ad9d700 1 --2- 172.21.15.103:0/3031608237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b6c0b0c70 0x7f6b6c0b10e0 secure :-1 s=THROTTLE_DONE pgs=1527 cs=0 l=1 rx=0x7f6b5c0010d0 tx=0x7f6b6400c800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.605+0000 7f6b637fe700 1 -- 172.21.15.103:0/3031608237 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6400ce00 con 0x7f6b6c0b0c70 2020-04-22T14:15:24.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.605+0000 7f6b70ddb700 1 -- 172.21.15.103:0/3031608237 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b6c1442a0 con 0x7f6b6c0b0c70 2020-04-22T14:15:24.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.605+0000 7f6b637fe700 1 -- 172.21.15.103:0/3031608237 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b64010380 con 0x7f6b6c0b0c70 2020-04-22T14:15:24.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.605+0000 7f6b70ddb700 1 -- 172.21.15.103:0/3031608237 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b6c0b1700 con 0x7f6b6c0b0c70 2020-04-22T14:15:24.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.605+0000 7f6b6ad9d700 1 --2- 172.21.15.103:0/3031608237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b6c0b0c70 0x7f6b6c0b10e0 secure :-1 s=THROTTLE_DONE pgs=1527 cs=0 l=1 rx=0x7f6b5c0010d0 tx=0x7f6b6400c800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.606+0000 7f6b637fe700 1 -- 172.21.15.103:0/3031608237 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f6b640104e0 con 0x7f6b6c0b0c70 2020-04-22T14:15:24.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.606+0000 7f6b6ad9d700 1 --2- 172.21.15.103:0/3031608237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b6c0b0c70 0x7f6b6c0b10e0 secure :-1 s=THROTTLE_DONE pgs=1527 cs=0 l=1 rx=0x7f6b5c0010d0 tx=0x7f6b6400c800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.606+0000 7f6b70ddb700 1 -- 172.21.15.103:0/3031608237 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b6c056c90 con 0x7f6b6c0b0c70 2020-04-22T14:15:24.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.606+0000 7f6b637fe700 1 --2- 172.21.15.103:0/3031608237 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6b5004d8a0 0x7f6b5004fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:24.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.606+0000 7f6b637fe700 1 -- 172.21.15.103:0/3031608237 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6b640610a0 con 0x7f6b6c0b0c70 2020-04-22T14:15:24.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.606+0000 7f6b6a59c700 1 --2- 172.21.15.103:0/3031608237 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6b5004d8a0 0x7f6b5004fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:24.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.607+0000 7f6b6a59c700 1 --2- 172.21.15.103:0/3031608237 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6b5004d8a0 0x7f6b5004fd60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6b5c0013e0 tx=0x7f6b6c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.607+0000 7f6b6a59c700 1 --2- 172.21.15.103:0/3031608237 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6b5004d8a0 0x7f6b5004fd60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6b5c0013e0 tx=0x7f6b6c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.607+0000 7f6b6a59c700 1 --2- 172.21.15.103:0/3031608237 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6b5004d8a0 0x7f6b5004fd60 secure :-1 s=READY pgs=555 cs=0 l=1 rx=0x7f6b5c0013e0 tx=0x7f6b6c0b96b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:24.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.610+0000 7f6b6ad9d700 1 --2- 172.21.15.103:0/3031608237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b6c0b0c70 0x7f6b6c0b10e0 secure :-1 s=THROTTLE_DONE pgs=1527 cs=0 l=1 rx=0x7f6b5c0010d0 tx=0x7f6b6400c800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.610+0000 7f6b637fe700 1 -- 172.21.15.103:0/3031608237 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f6b6403c4e0 con 0x7f6b6c0b0c70 2020-04-22T14:15:24.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.753+0000 7f6b70ddb700 1 -- 172.21.15.103:0/3031608237 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f6b6c06a960 con 0x7f6b6c0b0c70 2020-04-22T14:15:24.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.753+0000 7f6b6ad9d700 1 --2- 172.21.15.103:0/3031608237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b6c0b0c70 0x7f6b6c0b10e0 secure :-1 s=THROTTLE_DONE pgs=1527 cs=0 l=1 rx=0x7f6b5c0010d0 tx=0x7f6b6400c800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.753+0000 7f6b637fe700 1 -- 172.21.15.103:0/3031608237 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v102) v1 ==== 110+0+10 (secure 0 0 0) 0x7f6b6403fb00 con 0x7f6b6c0b0c70 2020-04-22T14:15:24.756 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:15:24.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.755+0000 7f6b70ddb700 1 -- 172.21.15.103:0/3031608237 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6b5004d8a0 msgr2=0x7f6b5004fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:24.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.755+0000 7f6b70ddb700 1 --2- 172.21.15.103:0/3031608237 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6b5004d8a0 0x7f6b5004fd60 secure :-1 s=READY pgs=555 cs=0 l=1 rx=0x7f6b5c0013e0 tx=0x7f6b6c0b96b0).stop 2020-04-22T14:15:24.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.755+0000 7f6b70ddb700 1 -- 172.21.15.103:0/3031608237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b6c0b0c70 msgr2=0x7f6b6c0b10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:24.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.755+0000 7f6b70ddb700 1 --2- 172.21.15.103:0/3031608237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b6c0b0c70 0x7f6b6c0b10e0 secure :-1 s=READY pgs=1527 cs=0 l=1 rx=0x7f6b5c0010d0 tx=0x7f6b6400c800).stop 2020-04-22T14:15:24.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.755+0000 7f6b70ddb700 1 -- 172.21.15.103:0/3031608237 shutdown_connections 2020-04-22T14:15:24.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.755+0000 7f6b70ddb700 1 --2- 172.21.15.103:0/3031608237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b6c0b0c70 0x7f6b6c0b10e0 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:24.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.755+0000 7f6b70ddb700 1 --2- 172.21.15.103:0/3031608237 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6b5004d8a0 0x7f6b5004fd60 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:24.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.755+0000 7f6b70ddb700 1 --2- 172.21.15.103:0/3031608237 >> v2:172.21.15.86:3300/0 conn(0x7f6b6c147d70 0x7f6b6c14d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:24.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.755+0000 7f6b70ddb700 1 -- 172.21.15.103:0/3031608237 >> 172.21.15.103:0/3031608237 conn(0x7f6b6c05b7b0 msgr2=0x7f6b6c1490e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:24.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.755+0000 7f6b70ddb700 1 -- 172.21.15.103:0/3031608237 shutdown_connections 2020-04-22T14:15:24.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.755+0000 7f6b70ddb700 1 -- 172.21.15.103:0/3031608237 wait complete. 2020-04-22T14:15:24.767 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:24.780 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:15:24.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.928+0000 7f3b543e2700 1 Processor -- start 2020-04-22T14:15:24.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.928+0000 7f3b543e2700 1 -- start start 2020-04-22T14:15:24.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.929+0000 7f3b543e2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3b4c0b9140 0x7f3b4c0aed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:24.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.929+0000 7f3b543e2700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3b4c0af1f0 0x7f3b4c144660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:24.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.929+0000 7f3b543e2700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b4c144ac0 con 0x7f3b4c0b3bd0 2020-04-22T14:15:24.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.929+0000 7f3b543e2700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b4c148310 con 0x7f3b4c0b9140 2020-04-22T14:15:24.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.929+0000 7f3b543e2700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4c1485b0 con 0x7f3b4c0af1f0 2020-04-22T14:15:24.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.929+0000 7f3b5217e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3b4c0b9140 0x7f3b4c0aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:24.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.929+0000 7f3b5217e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3b4c0b9140 0x7f3b4c0aed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55374/0 (socket says 172.21.15.103:55374) 2020-04-22T14:15:24.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.929+0000 7f3b5217e700 1 -- 172.21.15.103:0/1736200220 learned_addr learned my addr 172.21.15.103:0/1736200220 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:15:24.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.929+0000 7f3b5217e700 1 -- 172.21.15.103:0/1736200220 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3b4c0af1f0 msgr2=0x7f3b4c144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:24.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.929+0000 7f3b5297f700 1 --2- 172.21.15.103:0/1736200220 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3b4c0af1f0 0x7f3b4c144660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:24.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.929+0000 7f3b5217e700 1 --2- 172.21.15.103:0/1736200220 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3b4c0af1f0 0x7f3b4c144660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:24.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.929+0000 7f3b5217e700 1 -- 172.21.15.103:0/1736200220 >> v1:172.21.15.86:6789/0 conn(0x7f3b4c0b3bd0 legacy=0x7f3b4c0616b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:24.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.929+0000 7f3b5217e700 1 -- 172.21.15.103:0/1736200220 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b4c0b9520 con 0x7f3b4c0b9140 2020-04-22T14:15:24.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.929+0000 7f3b5217e700 1 --2- 172.21.15.103:0/1736200220 >> v2:172.21.15.103:3300/0 conn(0x7f3b4c0b9140 0x7f3b4c0aed90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3b4c0b6250 tx=0x7f3b3c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.930+0000 7f3b5217e700 1 --2- 172.21.15.103:0/1736200220 >> v2:172.21.15.103:3300/0 conn(0x7f3b4c0b9140 0x7f3b4c0aed90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3b4c0b6250 tx=0x7f3b3c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.930+0000 7f3b5217e700 1 --2- 172.21.15.103:0/1736200220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b4c0b9140 0x7f3b4c0aed90 secure :-1 s=READY pgs=1528 cs=0 l=1 rx=0x7f3b4c0b6250 tx=0x7f3b3c007a40).ready entity=mon.1 client_cookie=31509c040123db0a server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:24.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.930+0000 7f3b5217e700 1 --2- 172.21.15.103:0/1736200220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b4c0b9140 0x7f3b4c0aed90 secure :-1 s=THROTTLE_DONE pgs=1528 cs=0 l=1 rx=0x7f3b4c0b6250 tx=0x7f3b3c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.930+0000 7f3b5117c700 1 -- 172.21.15.103:0/1736200220 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b3c0116e0 con 0x7f3b4c0b9140 2020-04-22T14:15:24.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.930+0000 7f3b5217e700 1 --2- 172.21.15.103:0/1736200220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b4c0b9140 0x7f3b4c0aed90 secure :-1 s=THROTTLE_DONE pgs=1528 cs=0 l=1 rx=0x7f3b4c0b6250 tx=0x7f3b3c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.930+0000 7f3b5217e700 1 --2- 172.21.15.103:0/1736200220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b4c0b9140 0x7f3b4c0aed90 secure :-1 s=THROTTLE_DONE pgs=1528 cs=0 l=1 rx=0x7f3b4c0b6250 tx=0x7f3b3c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.930+0000 7f3b5117c700 1 -- 172.21.15.103:0/1736200220 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b3c011840 con 0x7f3b4c0b9140 2020-04-22T14:15:24.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.930+0000 7f3b5117c700 1 -- 172.21.15.103:0/1736200220 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b3c011c60 con 0x7f3b4c0b9140 2020-04-22T14:15:24.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.930+0000 7f3b543e2700 1 -- 172.21.15.103:0/1736200220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b4c0b9140 msgr2=0x7f3b4c0aed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:24.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.930+0000 7f3b543e2700 1 --2- 172.21.15.103:0/1736200220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b4c0b9140 0x7f3b4c0aed90 secure :-1 s=READY pgs=1528 cs=0 l=1 rx=0x7f3b4c0b6250 tx=0x7f3b3c007a40).stop 2020-04-22T14:15:24.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.930+0000 7f3b543e2700 1 -- 172.21.15.103:0/1736200220 shutdown_connections 2020-04-22T14:15:24.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.930+0000 7f3b543e2700 1 --2- 172.21.15.103:0/1736200220 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3b4c0af1f0 0x7f3b4c144660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:24.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.930+0000 7f3b543e2700 1 --2- 172.21.15.103:0/1736200220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b4c0b9140 0x7f3b4c0aed90 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:24.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.930+0000 7f3b543e2700 1 -- 172.21.15.103:0/1736200220 >> 172.21.15.103:0/1736200220 conn(0x7f3b4c05b7b0 msgr2=0x7f3b4c0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:24.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.930+0000 7f3b543e2700 1 -- 172.21.15.103:0/1736200220 shutdown_connections 2020-04-22T14:15:24.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.930+0000 7f3b543e2700 1 -- 172.21.15.103:0/1736200220 wait complete. 2020-04-22T14:15:24.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.931+0000 7f3b543e2700 1 Processor -- start 2020-04-22T14:15:24.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.931+0000 7f3b543e2700 1 -- start start 2020-04-22T14:15:24.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.932+0000 7f3b543e2700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3b4c0af1f0 0x7f3b4c13bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:24.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.932+0000 7f3b543e2700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b4c131850 con 0x7f3b4c0b3bd0 2020-04-22T14:15:24.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.932+0000 7f3b543e2700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b4c13e4f0 con 0x7f3b4c0b9140 2020-04-22T14:15:24.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.932+0000 7f3b543e2700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b4c146a10 con 0x7f3b4c0af1f0 2020-04-22T14:15:24.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.932+0000 7f3b5297f700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f3b4c0b9140 0x7f3b4c146bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47572/0 (socket says 172.21.15.103:47572) 2020-04-22T14:15:24.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.932+0000 7f3b5297f700 1 -- 172.21.15.103:0/631591573 learned_addr learned my addr 172.21.15.103:0/631591573 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:24.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.932+0000 7f3b5217e700 1 --2- 172.21.15.103:0/631591573 >> v2:172.21.15.86:3300/0 conn(0x7f3b4c0af1f0 0x7f3b4c13bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:24.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.932+0000 7f3b3b7fe700 1 -- 172.21.15.103:0/631591573 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 81743344 0 0) 0x7f3b4c13e4f0 con 0x7f3b4c0b9140 2020-04-22T14:15:24.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.932+0000 7f3b3b7fe700 1 -- 172.21.15.103:0/631591573 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b2c002fe0 con 0x7f3b4c0b9140 2020-04-22T14:15:24.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.932+0000 7f3b5217e700 1 -- 172.21.15.103:0/631591573 >> v1:172.21.15.103:6789/0 conn(0x7f3b4c0b9140 legacy=0x7f3b4c146bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:24.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.932+0000 7f3b3b7fe700 1 -- 172.21.15.103:0/631591573 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2525672771 0 0) 0x7f3b4c131850 con 0x7f3b4c0b3bd0 2020-04-22T14:15:24.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.932+0000 7f3b5217e700 1 -- 172.21.15.103:0/631591573 >> v1:172.21.15.86:6789/0 conn(0x7f3b4c0b3bd0 legacy=0x7f3b4c1413c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:24.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.932+0000 7f3b5217e700 1 -- 172.21.15.103:0/631591573 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b4c146570 con 0x7f3b4c0af1f0 2020-04-22T14:15:24.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.932+0000 7f3b5217e700 1 --2- 172.21.15.103:0/631591573 >> v2:172.21.15.86:3300/0 conn(0x7f3b4c0af1f0 0x7f3b4c13bda0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3b44002c30 tx=0x7f3b3c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.932+0000 7f3b5217e700 1 --2- 172.21.15.103:0/631591573 >> v2:172.21.15.86:3300/0 conn(0x7f3b4c0af1f0 0x7f3b4c13bda0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3b44002c30 tx=0x7f3b3c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.933+0000 7f3b5217e700 1 --2- 172.21.15.103:0/631591573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b4c0af1f0 0x7f3b4c13bda0 secure :-1 s=READY pgs=808 cs=0 l=1 rx=0x7f3b44002c30 tx=0x7f3b3c007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:24.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.933+0000 7f3b5217e700 1 --2- 172.21.15.103:0/631591573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b4c0af1f0 0x7f3b4c13bda0 secure :-1 s=THROTTLE_DONE pgs=808 cs=0 l=1 rx=0x7f3b44002c30 tx=0x7f3b3c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.933+0000 7f3b3b7fe700 1 -- 172.21.15.103:0/631591573 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b44002a90 con 0x7f3b4c0af1f0 2020-04-22T14:15:24.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.933+0000 7f3b543e2700 1 -- 172.21.15.103:0/631591573 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b4c146290 con 0x7f3b4c0af1f0 2020-04-22T14:15:24.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.933+0000 7f3b5217e700 1 --2- 172.21.15.103:0/631591573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b4c0af1f0 0x7f3b4c13bda0 secure :-1 s=THROTTLE_DONE pgs=808 cs=0 l=1 rx=0x7f3b44002c30 tx=0x7f3b3c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.933+0000 7f3b3b7fe700 1 -- 172.21.15.103:0/631591573 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b3c011cd0 con 0x7f3b4c0af1f0 2020-04-22T14:15:24.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.933+0000 7f3b5217e700 1 --2- 172.21.15.103:0/631591573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b4c0af1f0 0x7f3b4c13bda0 secure :-1 s=THROTTLE_DONE pgs=808 cs=0 l=1 rx=0x7f3b44002c30 tx=0x7f3b3c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.933+0000 7f3b3b7fe700 1 -- 172.21.15.103:0/631591573 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b3c007360 con 0x7f3b4c0af1f0 2020-04-22T14:15:24.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.933+0000 7f3b543e2700 1 -- 172.21.15.103:0/631591573 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b4c13df70 con 0x7f3b4c0af1f0 2020-04-22T14:15:24.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.934+0000 7f3b5217e700 1 --2- 172.21.15.103:0/631591573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b4c0af1f0 0x7f3b4c13bda0 secure :-1 s=THROTTLE_DONE pgs=808 cs=0 l=1 rx=0x7f3b44002c30 tx=0x7f3b3c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.934+0000 7f3b543e2700 1 -- 172.21.15.103:0/631591573 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b4c056c90 con 0x7f3b4c0af1f0 2020-04-22T14:15:24.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.934+0000 7f3b5217e700 1 --2- 172.21.15.103:0/631591573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b4c0af1f0 0x7f3b4c13bda0 secure :-1 s=THROTTLE_DONE pgs=808 cs=0 l=1 rx=0x7f3b44002c30 tx=0x7f3b3c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.934+0000 7f3b3b7fe700 1 -- 172.21.15.103:0/631591573 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f3b3c0056c0 con 0x7f3b4c0af1f0 2020-04-22T14:15:24.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.934+0000 7f3b3b7fe700 1 --2- 172.21.15.103:0/631591573 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3b2c04dc90 0x7f3b2c050150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:24.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.934+0000 7f3b3b7fe700 1 -- 172.21.15.103:0/631591573 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3b3c061860 con 0x7f3b4c0af1f0 2020-04-22T14:15:24.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.935+0000 7f3b5197d700 1 --2- 172.21.15.103:0/631591573 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3b2c04dc90 0x7f3b2c050150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:24.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.935+0000 7f3b5197d700 1 --2- 172.21.15.103:0/631591573 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3b2c04dc90 0x7f3b2c050150 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3b48001020 tx=0x7f3b480015e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.935+0000 7f3b5197d700 1 --2- 172.21.15.103:0/631591573 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3b2c04dc90 0x7f3b2c050150 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3b48001020 tx=0x7f3b480015e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.935+0000 7f3b5197d700 1 --2- 172.21.15.103:0/631591573 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3b2c04dc90 0x7f3b2c050150 secure :-1 s=READY pgs=556 cs=0 l=1 rx=0x7f3b48001020 tx=0x7f3b480015e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:24.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.938+0000 7f3b5217e700 1 --2- 172.21.15.103:0/631591573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b4c0af1f0 0x7f3b4c13bda0 secure :-1 s=THROTTLE_DONE pgs=808 cs=0 l=1 rx=0x7f3b44002c30 tx=0x7f3b3c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:24.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:24.938+0000 7f3b3b7fe700 1 -- 172.21.15.103:0/631591573 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f3b3c03ccc0 con 0x7f3b4c0af1f0 2020-04-22T14:15:25.082 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.080+0000 7f3b543e2700 1 -- 172.21.15.103:0/631591573 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3b4c06a960 con 0x7f3b4c0af1f0 2020-04-22T14:15:25.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.080+0000 7f3b5217e700 1 --2- 172.21.15.103:0/631591573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b4c0af1f0 0x7f3b4c13bda0 secure :-1 s=THROTTLE_DONE pgs=808 cs=0 l=1 rx=0x7f3b44002c30 tx=0x7f3b3c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.080+0000 7f3b3b7fe700 1 -- 172.21.15.103:0/631591573 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v102) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3b3c0402e0 con 0x7f3b4c0af1f0 2020-04-22T14:15:25.083 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:15:25.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.082+0000 7f3b543e2700 1 -- 172.21.15.103:0/631591573 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3b2c04dc90 msgr2=0x7f3b2c050150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:25.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.082+0000 7f3b543e2700 1 --2- 172.21.15.103:0/631591573 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3b2c04dc90 0x7f3b2c050150 secure :-1 s=READY pgs=556 cs=0 l=1 rx=0x7f3b48001020 tx=0x7f3b480015e0).stop 2020-04-22T14:15:25.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.082+0000 7f3b543e2700 1 -- 172.21.15.103:0/631591573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b4c0af1f0 msgr2=0x7f3b4c13bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:25.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.082+0000 7f3b543e2700 1 --2- 172.21.15.103:0/631591573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b4c0af1f0 0x7f3b4c13bda0 secure :-1 s=READY pgs=808 cs=0 l=1 rx=0x7f3b44002c30 tx=0x7f3b3c007a40).stop 2020-04-22T14:15:25.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.082+0000 7f3b543e2700 1 -- 172.21.15.103:0/631591573 shutdown_connections 2020-04-22T14:15:25.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.082+0000 7f3b543e2700 1 --2- 172.21.15.103:0/631591573 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3b2c04dc90 0x7f3b2c050150 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:25.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.082+0000 7f3b543e2700 1 --2- 172.21.15.103:0/631591573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b4c0af1f0 0x7f3b4c13bda0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:25.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.082+0000 7f3b543e2700 1 -- 172.21.15.103:0/631591573 >> 172.21.15.103:0/631591573 conn(0x7f3b4c05b7b0 msgr2=0x7f3b4c1441b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:25.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.082+0000 7f3b543e2700 1 -- 172.21.15.103:0/631591573 shutdown_connections 2020-04-22T14:15:25.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.082+0000 7f3b543e2700 1 -- 172.21.15.103:0/631591573 wait complete. 2020-04-22T14:15:25.100 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:25.114 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-22T14:15:25.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.266+0000 7fa4db74b700 1 Processor -- start 2020-04-22T14:15:25.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.266+0000 7fa4db74b700 1 -- start start 2020-04-22T14:15:25.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.267+0000 7fa4db74b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4d40ac950 0x7fa4d4146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:25.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.267+0000 7fa4db74b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa4d41470a0 0x7fa4d4143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:25.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.267+0000 7fa4db74b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d41467e0 con 0x7fa4d40b9140 2020-04-22T14:15:25.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.267+0000 7fa4db74b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d40602f0 con 0x7fa4d41470a0 2020-04-22T14:15:25.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.267+0000 7fa4db74b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d4060050 con 0x7fa4d40ac950 2020-04-22T14:15:25.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.267+0000 7fa4d8ce6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4d40ac950 0x7fa4d4146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:25.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.267+0000 7fa4d9ce8700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa4d41470a0 0x7fa4d4143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:25.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.267+0000 7fa4d94e7700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fa4d40b9140 0x7fa4d412b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:36502/0 (socket says 172.21.15.103:36502) 2020-04-22T14:15:25.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.267+0000 7fa4d8ce6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4d40ac950 0x7fa4d4146c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:40168/0 (socket says 172.21.15.103:40168) 2020-04-22T14:15:25.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.267+0000 7fa4d94e7700 1 -- 172.21.15.103:0/1681275871 learned_addr learned my addr 172.21.15.103:0/1681275871 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:25.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.268+0000 7fa4d8ce6700 1 -- 172.21.15.103:0/1681275871 >> v2:172.21.15.86:3300/0 conn(0x7fa4d41470a0 msgr2=0x7fa4d4143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:25.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.268+0000 7fa4d8ce6700 1 --2- 172.21.15.103:0/1681275871 >> v2:172.21.15.86:3300/0 conn(0x7fa4d41470a0 0x7fa4d4143090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:25.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.268+0000 7fa4d8ce6700 1 -- 172.21.15.103:0/1681275871 >> v1:172.21.15.86:6789/0 conn(0x7fa4d40b9140 legacy=0x7fa4d412b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:25.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.268+0000 7fa4d8ce6700 1 -- 172.21.15.103:0/1681275871 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d40b9520 con 0x7fa4d40ac950 2020-04-22T14:15:25.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.268+0000 7fa4d8ce6700 1 --2- 172.21.15.103:0/1681275871 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4d40ac950 0x7fa4d4146c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa4d0002f30 tx=0x7fa4d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.268+0000 7fa4d8ce6700 1 --2- 172.21.15.103:0/1681275871 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4d40ac950 0x7fa4d4146c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa4d0002f30 tx=0x7fa4d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.268+0000 7fa4d8ce6700 1 --2- 172.21.15.103:0/1681275871 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4d40ac950 0x7fa4d4146c40 secure :-1 s=READY pgs=148 cs=0 l=1 rx=0x7fa4d0002f30 tx=0x7fa4d0007a40).ready entity=mon.2 client_cookie=d5e0d8bae1e9c2ee server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:25.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.268+0000 7fa4d8ce6700 1 --2- 172.21.15.103:0/1681275871 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4d40ac950 0x7fa4d4146c40 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7fa4d0002f30 tx=0x7fa4d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.268+0000 7fa4c3fff700 1 -- 172.21.15.103:0/1681275871 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4d00113c0 con 0x7fa4d40ac950 2020-04-22T14:15:25.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.268+0000 7fa4d8ce6700 1 --2- 172.21.15.103:0/1681275871 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4d40ac950 0x7fa4d4146c40 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7fa4d0002f30 tx=0x7fa4d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.268+0000 7fa4c3fff700 1 -- 172.21.15.103:0/1681275871 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d0011560 con 0x7fa4d40ac950 2020-04-22T14:15:25.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.268+0000 7fa4d8ce6700 1 --2- 172.21.15.103:0/1681275871 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4d40ac950 0x7fa4d4146c40 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7fa4d0002f30 tx=0x7fa4d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.268+0000 7fa4c3fff700 1 -- 172.21.15.103:0/1681275871 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4d0011980 con 0x7fa4d40ac950 2020-04-22T14:15:25.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.268+0000 7fa4db74b700 1 -- 172.21.15.103:0/1681275871 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4d40ac950 msgr2=0x7fa4d4146c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:25.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.268+0000 7fa4db74b700 1 --2- 172.21.15.103:0/1681275871 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4d40ac950 0x7fa4d4146c40 secure :-1 s=READY pgs=148 cs=0 l=1 rx=0x7fa4d0002f30 tx=0x7fa4d0007a40).stop 2020-04-22T14:15:25.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.268+0000 7fa4db74b700 1 -- 172.21.15.103:0/1681275871 shutdown_connections 2020-04-22T14:15:25.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.268+0000 7fa4db74b700 1 --2- 172.21.15.103:0/1681275871 >> v2:172.21.15.86:3300/0 conn(0x7fa4d41470a0 0x7fa4d4143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:25.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.268+0000 7fa4db74b700 1 --2- 172.21.15.103:0/1681275871 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4d40ac950 0x7fa4d4146c40 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:25.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.268+0000 7fa4db74b700 1 -- 172.21.15.103:0/1681275871 >> 172.21.15.103:0/1681275871 conn(0x7fa4d405b7b0 msgr2=0x7fa4d40b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:25.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.268+0000 7fa4db74b700 1 -- 172.21.15.103:0/1681275871 shutdown_connections 2020-04-22T14:15:25.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.269+0000 7fa4db74b700 1 -- 172.21.15.103:0/1681275871 wait complete. 2020-04-22T14:15:25.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.269+0000 7fa4db74b700 1 Processor -- start 2020-04-22T14:15:25.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.269+0000 7fa4db74b700 1 -- start start 2020-04-22T14:15:25.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.270+0000 7fa4db74b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa4d40ac950 0x7fa4d40646a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:25.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.270+0000 7fa4db74b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4d40b9140 0x7fa4d40b5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:25.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.270+0000 7fa4db74b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d40b56c0 con 0x7fa4d41470a0 2020-04-22T14:15:25.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.270+0000 7fa4db74b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d4065d40 con 0x7fa4d40ac950 2020-04-22T14:15:25.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.270+0000 7fa4db74b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d4065fe0 con 0x7fa4d40b9140 2020-04-22T14:15:25.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.270+0000 7fa4d94e7700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa4d40ac950 0x7fa4d40646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:25.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.270+0000 7fa4d8ce6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4d40b9140 0x7fa4d40b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:25.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.270+0000 7fa4d9ce8700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fa4d41470a0 0x7fa4d4066720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:36512/0 (socket says 172.21.15.103:36512) 2020-04-22T14:15:25.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.270+0000 7fa4d9ce8700 1 -- 172.21.15.103:0/1443233971 learned_addr learned my addr 172.21.15.103:0/1443233971 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:25.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.271+0000 7fa4d8ce6700 1 -- 172.21.15.103:0/1443233971 >> v2:172.21.15.86:3300/0 conn(0x7fa4d40ac950 msgr2=0x7fa4d40646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:25.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.271+0000 7fa4d8ce6700 1 --2- 172.21.15.103:0/1443233971 >> v2:172.21.15.86:3300/0 conn(0x7fa4d40ac950 0x7fa4d40646a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:25.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.271+0000 7fa4d8ce6700 1 -- 172.21.15.103:0/1443233971 >> v1:172.21.15.86:6789/0 conn(0x7fa4d41470a0 legacy=0x7fa4d4066720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:25.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.271+0000 7fa4d8ce6700 1 -- 172.21.15.103:0/1443233971 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d4066280 con 0x7fa4d40b9140 2020-04-22T14:15:25.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.271+0000 7fa4d8ce6700 1 --2- 172.21.15.103:0/1443233971 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4d40b9140 0x7fa4d40b5260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa4d0002f30 tx=0x7fa4d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.271+0000 7fa4d8ce6700 1 --2- 172.21.15.103:0/1443233971 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4d40b9140 0x7fa4d40b5260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa4d0002f30 tx=0x7fa4d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.271+0000 7fa4d8ce6700 1 --2- 172.21.15.103:0/1443233971 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4d40b9140 0x7fa4d40b5260 secure :-1 s=READY pgs=149 cs=0 l=1 rx=0x7fa4d0002f30 tx=0x7fa4d0007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:25.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.271+0000 7fa4d8ce6700 1 --2- 172.21.15.103:0/1443233971 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4d40b9140 0x7fa4d40b5260 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7fa4d0002f30 tx=0x7fa4d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.271+0000 7fa4c27fc700 1 -- 172.21.15.103:0/1443233971 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4d0011940 con 0x7fa4d40b9140 2020-04-22T14:15:25.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.271+0000 7fa4d8ce6700 1 --2- 172.21.15.103:0/1443233971 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4d40b9140 0x7fa4d40b5260 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7fa4d0002f30 tx=0x7fa4d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.271+0000 7fa4d8ce6700 1 --2- 172.21.15.103:0/1443233971 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4d40b9140 0x7fa4d40b5260 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7fa4d0002f30 tx=0x7fa4d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.271+0000 7fa4c27fc700 1 -- 172.21.15.103:0/1443233971 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d0007170 con 0x7fa4d40b9140 2020-04-22T14:15:25.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.271+0000 7fa4db74b700 1 -- 172.21.15.103:0/1443233971 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d4065a10 con 0x7fa4d40b9140 2020-04-22T14:15:25.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.271+0000 7fa4c27fc700 1 -- 172.21.15.103:0/1443233971 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4d0007510 con 0x7fa4d40b9140 2020-04-22T14:15:25.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.271+0000 7fa4db74b700 1 -- 172.21.15.103:0/1443233971 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d40657c0 con 0x7fa4d40b9140 2020-04-22T14:15:25.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.272+0000 7fa4d8ce6700 1 --2- 172.21.15.103:0/1443233971 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4d40b9140 0x7fa4d40b5260 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7fa4d0002f30 tx=0x7fa4d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.272+0000 7fa4db74b700 1 -- 172.21.15.103:0/1443233971 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d4056c90 con 0x7fa4d40b9140 2020-04-22T14:15:25.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.272+0000 7fa4c27fc700 1 -- 172.21.15.103:0/1443233971 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fa4d00056c0 con 0x7fa4d40b9140 2020-04-22T14:15:25.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.272+0000 7fa4d8ce6700 1 --2- 172.21.15.103:0/1443233971 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4d40b9140 0x7fa4d40b5260 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7fa4d0002f30 tx=0x7fa4d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.272+0000 7fa4c27fc700 1 --2- 172.21.15.103:0/1443233971 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa4b404d9c0 0x7fa4b404fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:25.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.272+0000 7fa4c27fc700 1 -- 172.21.15.103:0/1443233971 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa4d0061db0 con 0x7fa4d40b9140 2020-04-22T14:15:25.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.273+0000 7fa4d94e7700 1 --2- 172.21.15.103:0/1443233971 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa4b404d9c0 0x7fa4b404fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:25.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.273+0000 7fa4d94e7700 1 --2- 172.21.15.103:0/1443233971 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa4b404d9c0 0x7fa4b404fe80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa4d4060f70 tx=0x7fa4c4001cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.273+0000 7fa4d94e7700 1 --2- 172.21.15.103:0/1443233971 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa4b404d9c0 0x7fa4b404fe80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa4d4060f70 tx=0x7fa4c4001cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.273+0000 7fa4d94e7700 1 --2- 172.21.15.103:0/1443233971 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa4b404d9c0 0x7fa4b404fe80 secure :-1 s=READY pgs=557 cs=0 l=1 rx=0x7fa4d4060f70 tx=0x7fa4c4001cf0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:25.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.276+0000 7fa4d8ce6700 1 --2- 172.21.15.103:0/1443233971 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4d40b9140 0x7fa4d40b5260 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7fa4d0002f30 tx=0x7fa4d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.276+0000 7fa4c27fc700 1 -- 172.21.15.103:0/1443233971 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fa4d003d190 con 0x7fa4d40b9140 2020-04-22T14:15:25.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.419+0000 7fa4db74b700 1 -- 172.21.15.103:0/1443233971 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa4d40b67c0 con 0x7fa4d40b9140 2020-04-22T14:15:25.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.419+0000 7fa4d8ce6700 1 --2- 172.21.15.103:0/1443233971 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4d40b9140 0x7fa4d40b5260 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7fa4d0002f30 tx=0x7fa4d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.419+0000 7fa4c27fc700 1 -- 172.21.15.103:0/1443233971 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v102) v1 ==== 104+0+10 (secure 0 0 0) 0x7fa4d00407b0 con 0x7fa4d40b9140 2020-04-22T14:15:25.422 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:15:25.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.421+0000 7fa4db74b700 1 -- 172.21.15.103:0/1443233971 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa4b404d9c0 msgr2=0x7fa4b404fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:25.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.421+0000 7fa4db74b700 1 --2- 172.21.15.103:0/1443233971 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa4b404d9c0 0x7fa4b404fe80 secure :-1 s=READY pgs=557 cs=0 l=1 rx=0x7fa4d4060f70 tx=0x7fa4c4001cf0).stop 2020-04-22T14:15:25.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.421+0000 7fa4db74b700 1 -- 172.21.15.103:0/1443233971 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4d40b9140 msgr2=0x7fa4d40b5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:25.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.421+0000 7fa4db74b700 1 --2- 172.21.15.103:0/1443233971 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4d40b9140 0x7fa4d40b5260 secure :-1 s=READY pgs=149 cs=0 l=1 rx=0x7fa4d0002f30 tx=0x7fa4d0007a40).stop 2020-04-22T14:15:25.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.421+0000 7fa4db74b700 1 -- 172.21.15.103:0/1443233971 shutdown_connections 2020-04-22T14:15:25.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.421+0000 7fa4db74b700 1 --2- 172.21.15.103:0/1443233971 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa4b404d9c0 0x7fa4b404fe80 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:25.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.421+0000 7fa4db74b700 1 --2- 172.21.15.103:0/1443233971 >> v2:172.21.15.86:3300/0 conn(0x7fa4d40ac950 0x7fa4d40646a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:25.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.421+0000 7fa4db74b700 1 --2- 172.21.15.103:0/1443233971 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4d40b9140 0x7fa4d40b5260 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:25.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.421+0000 7fa4db74b700 1 -- 172.21.15.103:0/1443233971 >> 172.21.15.103:0/1443233971 conn(0x7fa4d405b7b0 msgr2=0x7fa4d40b7970 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:25.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.421+0000 7fa4db74b700 1 -- 172.21.15.103:0/1443233971 shutdown_connections 2020-04-22T14:15:25.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.421+0000 7fa4db74b700 1 -- 172.21.15.103:0/1443233971 wait complete. 2020-04-22T14:15:25.434 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:25.447 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-22T14:15:25.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.593+0000 7f9115c70700 1 Processor -- start 2020-04-22T14:15:25.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.593+0000 7f9115c70700 1 -- start start 2020-04-22T14:15:25.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.594+0000 7f9115c70700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f91100b49a0 0x7f911014a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:25.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.594+0000 7f9115c70700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91100aec20 con 0x7f9110145dc0 2020-04-22T14:15:25.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.594+0000 7f9115c70700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91100aeec0 con 0x7f91100af360 2020-04-22T14:15:25.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.594+0000 7f9115c70700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91100aea10 con 0x7f91100b49a0 2020-04-22T14:15:25.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.594+0000 7f910effd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f91100af360 0x7f91100616b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47594/0 (socket says 172.21.15.103:47594) 2020-04-22T14:15:25.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.594+0000 7f910effd700 1 -- 172.21.15.103:0/4100706010 learned_addr learned my addr 172.21.15.103:0/4100706010 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:25.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.594+0000 7f910e7fc700 1 -- 172.21.15.103:0/4100706010 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3862263386 0 0) 0x7f91100aeec0 con 0x7f91100af360 2020-04-22T14:15:25.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.594+0000 7f910e7fc700 1 -- 172.21.15.103:0/4100706010 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90fc003230 con 0x7f91100af360 2020-04-22T14:15:25.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.594+0000 7f910ffff700 1 --2- 172.21.15.103:0/4100706010 >> v2:172.21.15.86:3300/0 conn(0x7f91100b49a0 0x7f911014a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:25.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.594+0000 7f910e7fc700 1 -- 172.21.15.103:0/4100706010 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 853571078 0 0) 0x7f90fc003230 con 0x7f91100af360 2020-04-22T14:15:25.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.594+0000 7f910e7fc700 1 -- 172.21.15.103:0/4100706010 >> v2:172.21.15.86:3300/0 conn(0x7f91100b49a0 msgr2=0x7f911014a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:25.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.594+0000 7f910e7fc700 1 --2- 172.21.15.103:0/4100706010 >> v2:172.21.15.86:3300/0 conn(0x7f91100b49a0 0x7f911014a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:25.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.594+0000 7f910e7fc700 1 -- 172.21.15.103:0/4100706010 >> v1:172.21.15.86:6789/0 conn(0x7f9110145dc0 legacy=0x7f91100b8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:25.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.594+0000 7f910e7fc700 1 -- 172.21.15.103:0/4100706010 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9110060240 con 0x7f91100af360 2020-04-22T14:15:25.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.594+0000 7f910e7fc700 1 -- 172.21.15.103:0/4100706010 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f91040016d0 con 0x7f91100af360 2020-04-22T14:15:25.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.594+0000 7f910e7fc700 1 -- 172.21.15.103:0/4100706010 >> v1:172.21.15.103:6789/0 conn(0x7f91100af360 legacy=0x7f91100616b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:25.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.594+0000 7f910e7fc700 1 --2- 172.21.15.103:0/4100706010 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90fc003720 0x7f90fc003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:25.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.594+0000 7f910e7fc700 1 --2- 172.21.15.103:0/4100706010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90fc0044d0 0x7f90fc004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:25.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.594+0000 7f910e7fc700 1 --2- 172.21.15.103:0/4100706010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90fc004db0 0x7f90fc00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:25.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.594+0000 7f910e7fc700 1 -- 172.21.15.103:0/4100706010 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91100aea10 con 0x7f90fc004db0 2020-04-22T14:15:25.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.594+0000 7f910e7fc700 1 -- 172.21.15.103:0/4100706010 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90fc0041c0 con 0x7f90fc0044d0 2020-04-22T14:15:25.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.594+0000 7f910e7fc700 1 -- 172.21.15.103:0/4100706010 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90fc00bb80 con 0x7f90fc003720 2020-04-22T14:15:25.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.594+0000 7f910effd700 1 --2- 172.21.15.103:0/4100706010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90fc0044d0 0x7f90fc004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:25.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.595+0000 7f910ffff700 1 --2- 172.21.15.103:0/4100706010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90fc004db0 0x7f90fc00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:25.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.595+0000 7f910f7fe700 1 --2- 172.21.15.103:0/4100706010 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90fc003720 0x7f90fc003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:25.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.595+0000 7f910effd700 1 -- 172.21.15.103:0/4100706010 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90fc003720 msgr2=0x7f90fc003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:25.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.595+0000 7f910effd700 1 --2- 172.21.15.103:0/4100706010 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90fc003720 0x7f90fc003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:25.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.595+0000 7f910effd700 1 -- 172.21.15.103:0/4100706010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90fc004db0 msgr2=0x7f90fc00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:25.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.595+0000 7f910effd700 1 --2- 172.21.15.103:0/4100706010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90fc004db0 0x7f90fc00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:25.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.595+0000 7f910effd700 1 -- 172.21.15.103:0/4100706010 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90fc003230 con 0x7f90fc0044d0 2020-04-22T14:15:25.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.595+0000 7f910ffff700 1 -- 172.21.15.103:0/4100706010 reap_dead start 2020-04-22T14:15:25.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.595+0000 7f910effd700 1 --2- 172.21.15.103:0/4100706010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90fc0044d0 0x7f90fc004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f90fc0054a0 tx=0x7f91100677a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.595+0000 7f910effd700 1 --2- 172.21.15.103:0/4100706010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90fc0044d0 0x7f90fc004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f90fc0054a0 tx=0x7f91100677a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.595+0000 7f910effd700 1 --2- 172.21.15.103:0/4100706010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90fc0044d0 0x7f90fc004950 secure :-1 s=READY pgs=1531 cs=0 l=1 rx=0x7f90fc0054a0 tx=0x7f91100677a0).ready entity=mon.1 client_cookie=32612cbfc9fde67a server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:25.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.595+0000 7f910effd700 1 --2- 172.21.15.103:0/4100706010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90fc0044d0 0x7f90fc004950 secure :-1 s=THROTTLE_DONE pgs=1531 cs=0 l=1 rx=0x7f90fc0054a0 tx=0x7f91100677a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.595+0000 7f910e7fc700 1 -- 172.21.15.103:0/4100706010 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f910400ca80 con 0x7f90fc0044d0 2020-04-22T14:15:25.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.595+0000 7f910effd700 1 --2- 172.21.15.103:0/4100706010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90fc0044d0 0x7f90fc004950 secure :-1 s=THROTTLE_DONE pgs=1531 cs=0 l=1 rx=0x7f90fc0054a0 tx=0x7f91100677a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.595+0000 7f910effd700 1 --2- 172.21.15.103:0/4100706010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90fc0044d0 0x7f90fc004950 secure :-1 s=THROTTLE_DONE pgs=1531 cs=0 l=1 rx=0x7f90fc0054a0 tx=0x7f91100677a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.595+0000 7f910e7fc700 1 -- 172.21.15.103:0/4100706010 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f910400cc20 con 0x7f90fc0044d0 2020-04-22T14:15:25.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.595+0000 7f910e7fc700 1 -- 172.21.15.103:0/4100706010 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91040111d0 con 0x7f90fc0044d0 2020-04-22T14:15:25.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.595+0000 7f9115c70700 1 -- 172.21.15.103:0/4100706010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90fc0044d0 msgr2=0x7f90fc004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:25.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.595+0000 7f9115c70700 1 --2- 172.21.15.103:0/4100706010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90fc0044d0 0x7f90fc004950 secure :-1 s=READY pgs=1531 cs=0 l=1 rx=0x7f90fc0054a0 tx=0x7f91100677a0).stop 2020-04-22T14:15:25.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.596+0000 7f9115c70700 1 -- 172.21.15.103:0/4100706010 shutdown_connections 2020-04-22T14:15:25.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.596+0000 7f9115c70700 1 --2- 172.21.15.103:0/4100706010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90fc0044d0 0x7f90fc004950 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:25.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.596+0000 7f9115c70700 1 -- 172.21.15.103:0/4100706010 >> 172.21.15.103:0/4100706010 conn(0x7f911005b7b0 msgr2=0x7f91100b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:25.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.596+0000 7f9115c70700 1 -- 172.21.15.103:0/4100706010 shutdown_connections 2020-04-22T14:15:25.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.596+0000 7f9115c70700 1 -- 172.21.15.103:0/4100706010 wait complete. 2020-04-22T14:15:25.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.596+0000 7f9115c70700 1 Processor -- start 2020-04-22T14:15:25.609 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.597+0000 7f9115c70700 1 -- start start 2020-04-22T14:15:25.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.597+0000 7f9115c70700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9110144530 0x7f91100b8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:25.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.597+0000 7f9115c70700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9110141f70 0x7f91100b1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:25.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.597+0000 7f9115c70700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91100b9220 con 0x7f90fc0044d0 2020-04-22T14:15:25.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.597+0000 7f9115c70700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9110142400 con 0x7f9110144530 2020-04-22T14:15:25.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.597+0000 7f9115c70700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9110143b50 con 0x7f9110141f70 2020-04-22T14:15:25.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.598+0000 7f910effd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9110144530 0x7f91100b8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:25.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.598+0000 7f910ffff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9110141f70 0x7f91100b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:25.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.598+0000 7f910effd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9110144530 0x7f91100b8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:52648/0 (socket says 172.21.15.103:52648) 2020-04-22T14:15:25.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.598+0000 7f910f7fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f90fc0044d0 0x7f911013b450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:36528/0 (socket says 172.21.15.103:36528) 2020-04-22T14:15:25.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.598+0000 7f910effd700 1 -- 172.21.15.103:0/4012179296 learned_addr learned my addr 172.21.15.103:0/4012179296 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:15:25.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.598+0000 7f910effd700 1 -- 172.21.15.103:0/4012179296 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9110141f70 msgr2=0x7f91100b1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:25.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.598+0000 7f910effd700 1 --2- 172.21.15.103:0/4012179296 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9110141f70 0x7f91100b1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:25.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.598+0000 7f910effd700 1 -- 172.21.15.103:0/4012179296 >> v1:172.21.15.86:6789/0 conn(0x7f90fc0044d0 legacy=0x7f911013b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:25.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.598+0000 7f910cff9700 1 -- 172.21.15.103:0/4012179296 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1604690807 0 0) 0x7f91100aec20 con 0x7f90fc0044d0 2020-04-22T14:15:25.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.598+0000 7f910effd700 1 -- 172.21.15.103:0/4012179296 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9110143df0 con 0x7f9110144530 2020-04-22T14:15:25.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.598+0000 7f910ffff700 1 --2- 172.21.15.103:0/4012179296 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9110141f70 0x7f91100b1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:15:25.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.598+0000 7f910effd700 1 --2- 172.21.15.103:0/4012179296 >> v2:172.21.15.86:3300/0 conn(0x7f9110144530 0x7f91100b8dc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f90fc0054a0 tx=0x7f91100677a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.598+0000 7f910effd700 1 --2- 172.21.15.103:0/4012179296 >> v2:172.21.15.86:3300/0 conn(0x7f9110144530 0x7f91100b8dc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f90fc0054a0 tx=0x7f91100677a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.598+0000 7f910effd700 1 --2- 172.21.15.103:0/4012179296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9110144530 0x7f91100b8dc0 secure :-1 s=READY pgs=813 cs=0 l=1 rx=0x7f90fc0054a0 tx=0x7f91100677a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:25.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.598+0000 7f910effd700 1 --2- 172.21.15.103:0/4012179296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9110144530 0x7f91100b8dc0 secure :-1 s=THROTTLE_DONE pgs=813 cs=0 l=1 rx=0x7f90fc0054a0 tx=0x7f91100677a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.598+0000 7f910cff9700 1 -- 172.21.15.103:0/4012179296 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f910400cc90 con 0x7f9110144530 2020-04-22T14:15:25.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.598+0000 7f910effd700 1 --2- 172.21.15.103:0/4012179296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9110144530 0x7f91100b8dc0 secure :-1 s=THROTTLE_DONE pgs=813 cs=0 l=1 rx=0x7f90fc0054a0 tx=0x7f91100677a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.598+0000 7f910cff9700 1 -- 172.21.15.103:0/4012179296 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f910400cdf0 con 0x7f9110144530 2020-04-22T14:15:25.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.598+0000 7f910effd700 1 --2- 172.21.15.103:0/4012179296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9110144530 0x7f91100b8dc0 secure :-1 s=THROTTLE_DONE pgs=813 cs=0 l=1 rx=0x7f90fc0054a0 tx=0x7f91100677a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.598+0000 7f9115c70700 1 -- 172.21.15.103:0/4012179296 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9110144090 con 0x7f9110144530 2020-04-22T14:15:25.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.598+0000 7f910cff9700 1 -- 172.21.15.103:0/4012179296 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91040047a0 con 0x7f9110144530 2020-04-22T14:15:25.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.598+0000 7f9115c70700 1 -- 172.21.15.103:0/4012179296 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f911013bb60 con 0x7f9110144530 2020-04-22T14:15:25.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.599+0000 7f910effd700 1 --2- 172.21.15.103:0/4012179296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9110144530 0x7f91100b8dc0 secure :-1 s=THROTTLE_DONE pgs=813 cs=0 l=1 rx=0x7f90fc0054a0 tx=0x7f91100677a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.599+0000 7f9115c70700 1 -- 172.21.15.103:0/4012179296 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9110056c90 con 0x7f9110144530 2020-04-22T14:15:25.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.600+0000 7f910cff9700 1 -- 172.21.15.103:0/4012179296 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f91040011f0 con 0x7f9110144530 2020-04-22T14:15:25.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.600+0000 7f910effd700 1 --2- 172.21.15.103:0/4012179296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9110144530 0x7f91100b8dc0 secure :-1 s=THROTTLE_DONE pgs=813 cs=0 l=1 rx=0x7f90fc0054a0 tx=0x7f91100677a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.600+0000 7f910cff9700 1 --2- 172.21.15.103:0/4012179296 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f90f004d8a0 0x7f90f004fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:25.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.600+0000 7f910cff9700 1 -- 172.21.15.103:0/4012179296 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f91040615f0 con 0x7f9110144530 2020-04-22T14:15:25.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.600+0000 7f910f7fe700 1 --2- 172.21.15.103:0/4012179296 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f90f004d8a0 0x7f90f004fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:25.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.600+0000 7f910f7fe700 1 --2- 172.21.15.103:0/4012179296 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f90f004d8a0 0x7f90f004fd60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9108001320 tx=0x7f9108001c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.601+0000 7f910f7fe700 1 --2- 172.21.15.103:0/4012179296 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f90f004d8a0 0x7f90f004fd60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9108001320 tx=0x7f9108001c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.601+0000 7f910f7fe700 1 --2- 172.21.15.103:0/4012179296 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f90f004d8a0 0x7f90f004fd60 secure :-1 s=READY pgs=558 cs=0 l=1 rx=0x7f9108001320 tx=0x7f9108001c50).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:25.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.604+0000 7f910effd700 1 --2- 172.21.15.103:0/4012179296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9110144530 0x7f91100b8dc0 secure :-1 s=THROTTLE_DONE pgs=813 cs=0 l=1 rx=0x7f90fc0054a0 tx=0x7f91100677a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.604+0000 7f910cff9700 1 -- 172.21.15.103:0/4012179296 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f910403ca90 con 0x7f9110144530 2020-04-22T14:15:25.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.745+0000 7f9115c70700 1 -- 172.21.15.103:0/4012179296 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f911013bec0 con 0x7f9110144530 2020-04-22T14:15:25.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.746+0000 7f910effd700 1 --2- 172.21.15.103:0/4012179296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9110144530 0x7f91100b8dc0 secure :-1 s=THROTTLE_DONE pgs=813 cs=0 l=1 rx=0x7f90fc0054a0 tx=0x7f91100677a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.746+0000 7f910cff9700 1 -- 172.21.15.103:0/4012179296 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v102) v1 ==== 100+0+10 (secure 0 0 0) 0x7f91040400b0 con 0x7f9110144530 2020-04-22T14:15:25.749 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:15:25.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.747+0000 7f9115c70700 1 -- 172.21.15.103:0/4012179296 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f90f004d8a0 msgr2=0x7f90f004fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:25.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.747+0000 7f9115c70700 1 --2- 172.21.15.103:0/4012179296 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f90f004d8a0 0x7f90f004fd60 secure :-1 s=READY pgs=558 cs=0 l=1 rx=0x7f9108001320 tx=0x7f9108001c50).stop 2020-04-22T14:15:25.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.747+0000 7f9115c70700 1 -- 172.21.15.103:0/4012179296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9110144530 msgr2=0x7f91100b8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:25.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.747+0000 7f9115c70700 1 --2- 172.21.15.103:0/4012179296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9110144530 0x7f91100b8dc0 secure :-1 s=READY pgs=813 cs=0 l=1 rx=0x7f90fc0054a0 tx=0x7f91100677a0).stop 2020-04-22T14:15:25.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.747+0000 7f9115c70700 1 -- 172.21.15.103:0/4012179296 shutdown_connections 2020-04-22T14:15:25.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.747+0000 7f9115c70700 1 --2- 172.21.15.103:0/4012179296 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9110141f70 0x7f91100b1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:25.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.747+0000 7f9115c70700 1 --2- 172.21.15.103:0/4012179296 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f90f004d8a0 0x7f90f004fd60 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:25.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.747+0000 7f9115c70700 1 --2- 172.21.15.103:0/4012179296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9110144530 0x7f91100b8dc0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:25.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.747+0000 7f9115c70700 1 -- 172.21.15.103:0/4012179296 >> 172.21.15.103:0/4012179296 conn(0x7f911005b7b0 msgr2=0x7f91100b7490 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:25.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.747+0000 7f9115c70700 1 -- 172.21.15.103:0/4012179296 shutdown_connections 2020-04-22T14:15:25.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.747+0000 7f9115c70700 1 -- 172.21.15.103:0/4012179296 wait complete. 2020-04-22T14:15:25.759 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-04-22T14:15:25.759 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:25.773 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:15:25.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.918+0000 7efd5d5cc700 1 Processor -- start 2020-04-22T14:15:25.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.918+0000 7efd5d5cc700 1 -- start start 2020-04-22T14:15:25.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.919+0000 7efd5d5cc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7efd5812c0d0 0x7efd581464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:25.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.919+0000 7efd5d5cc700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd58143300 con 0x7efd58063e30 2020-04-22T14:15:25.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.919+0000 7efd5d5cc700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd581435a0 con 0x7efd58065fe0 2020-04-22T14:15:25.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.919+0000 7efd5d5cc700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd58143840 con 0x7efd5812c0d0 2020-04-22T14:15:25.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.919+0000 7efd567fc700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7efd58065fe0 0x7efd5805b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47612/0 (socket says 172.21.15.103:47612) 2020-04-22T14:15:25.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.919+0000 7efd567fc700 1 -- 172.21.15.103:0/2655710921 learned_addr learned my addr 172.21.15.103:0/2655710921 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:25.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.920+0000 7efd56ffd700 1 --2- 172.21.15.103:0/2655710921 >> v2:172.21.15.86:3300/0 conn(0x7efd5812c0d0 0x7efd581464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:25.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.920+0000 7efd55ffb700 1 -- 172.21.15.103:0/2655710921 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2251647523 0 0) 0x7efd581435a0 con 0x7efd58065fe0 2020-04-22T14:15:25.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.920+0000 7efd55ffb700 1 -- 172.21.15.103:0/2655710921 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd3c003230 con 0x7efd58065fe0 2020-04-22T14:15:25.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.920+0000 7efd55ffb700 1 -- 172.21.15.103:0/2655710921 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4267414485 0 0) 0x7efd3c003230 con 0x7efd58065fe0 2020-04-22T14:15:25.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.920+0000 7efd55ffb700 1 -- 172.21.15.103:0/2655710921 >> v2:172.21.15.86:3300/0 conn(0x7efd5812c0d0 msgr2=0x7efd581464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:25.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.920+0000 7efd55ffb700 1 --2- 172.21.15.103:0/2655710921 >> v2:172.21.15.86:3300/0 conn(0x7efd5812c0d0 0x7efd581464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:25.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.920+0000 7efd55ffb700 1 -- 172.21.15.103:0/2655710921 >> v1:172.21.15.86:6789/0 conn(0x7efd58063e30 legacy=0x7efd580642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:25.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.920+0000 7efd55ffb700 1 -- 172.21.15.103:0/2655710921 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5805bb50 con 0x7efd58065fe0 2020-04-22T14:15:25.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.920+0000 7efd55ffb700 1 -- 172.21.15.103:0/2655710921 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7efd480016d0 con 0x7efd58065fe0 2020-04-22T14:15:25.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.920+0000 7efd55ffb700 1 -- 172.21.15.103:0/2655710921 >> v1:172.21.15.103:6789/0 conn(0x7efd58065fe0 legacy=0x7efd5805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:25.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.920+0000 7efd55ffb700 1 --2- 172.21.15.103:0/2655710921 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd3c003720 0x7efd3c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:25.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.920+0000 7efd55ffb700 1 --2- 172.21.15.103:0/2655710921 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd3c0044d0 0x7efd3c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:25.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.920+0000 7efd55ffb700 1 --2- 172.21.15.103:0/2655710921 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd3c004db0 0x7efd3c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:25.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.920+0000 7efd55ffb700 1 -- 172.21.15.103:0/2655710921 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd58143840 con 0x7efd3c003720 2020-04-22T14:15:25.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.920+0000 7efd55ffb700 1 -- 172.21.15.103:0/2655710921 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd3c0041c0 con 0x7efd3c004db0 2020-04-22T14:15:25.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.920+0000 7efd55ffb700 1 -- 172.21.15.103:0/2655710921 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd3c00bb80 con 0x7efd3c0044d0 2020-04-22T14:15:25.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.920+0000 7efd577fe700 1 --2- 172.21.15.103:0/2655710921 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd3c004db0 0x7efd3c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:25.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.920+0000 7efd56ffd700 1 --2- 172.21.15.103:0/2655710921 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd3c003720 0x7efd3c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:25.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.920+0000 7efd567fc700 1 --2- 172.21.15.103:0/2655710921 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd3c0044d0 0x7efd3c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:25.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.920+0000 7efd577fe700 1 -- 172.21.15.103:0/2655710921 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd3c0044d0 msgr2=0x7efd3c004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:25.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.920+0000 7efd577fe700 1 --2- 172.21.15.103:0/2655710921 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd3c0044d0 0x7efd3c004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:25.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.920+0000 7efd577fe700 1 -- 172.21.15.103:0/2655710921 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd3c003720 msgr2=0x7efd3c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:25.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.920+0000 7efd577fe700 1 --2- 172.21.15.103:0/2655710921 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd3c003720 0x7efd3c003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:25.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.920+0000 7efd577fe700 1 -- 172.21.15.103:0/2655710921 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd3c003230 con 0x7efd3c004db0 2020-04-22T14:15:25.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.921+0000 7efd577fe700 1 --2- 172.21.15.103:0/2655710921 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd3c004db0 0x7efd3c00b720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efd3c0054a0 tx=0x7efd500122b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.921+0000 7efd577fe700 1 -- 172.21.15.103:0/2655710921 reap_dead start 2020-04-22T14:15:25.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.921+0000 7efd577fe700 1 --2- 172.21.15.103:0/2655710921 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd3c004db0 0x7efd3c00b720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efd3c0054a0 tx=0x7efd500122b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.921+0000 7efd577fe700 1 --2- 172.21.15.103:0/2655710921 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd3c004db0 0x7efd3c00b720 secure :-1 s=READY pgs=1533 cs=0 l=1 rx=0x7efd3c0054a0 tx=0x7efd500122b0).ready entity=mon.1 client_cookie=3de5e07a865255b3 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:25.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.921+0000 7efd577fe700 1 --2- 172.21.15.103:0/2655710921 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd3c004db0 0x7efd3c00b720 secure :-1 s=THROTTLE_DONE pgs=1533 cs=0 l=1 rx=0x7efd3c0054a0 tx=0x7efd500122b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.921+0000 7efd577fe700 1 --2- 172.21.15.103:0/2655710921 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd3c004db0 0x7efd3c00b720 secure :-1 s=THROTTLE_DONE pgs=1533 cs=0 l=1 rx=0x7efd3c0054a0 tx=0x7efd500122b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.921+0000 7efd55ffb700 1 -- 172.21.15.103:0/2655710921 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd50006c40 con 0x7efd3c004db0 2020-04-22T14:15:25.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.921+0000 7efd577fe700 1 --2- 172.21.15.103:0/2655710921 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd3c004db0 0x7efd3c00b720 secure :-1 s=THROTTLE_DONE pgs=1533 cs=0 l=1 rx=0x7efd3c0054a0 tx=0x7efd500122b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.921+0000 7efd55ffb700 1 -- 172.21.15.103:0/2655710921 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd50006da0 con 0x7efd3c004db0 2020-04-22T14:15:25.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.921+0000 7efd55ffb700 1 -- 172.21.15.103:0/2655710921 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd50002640 con 0x7efd3c004db0 2020-04-22T14:15:25.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.921+0000 7efd5d5cc700 1 -- 172.21.15.103:0/2655710921 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd3c004db0 msgr2=0x7efd3c00b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:25.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.921+0000 7efd5d5cc700 1 --2- 172.21.15.103:0/2655710921 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd3c004db0 0x7efd3c00b720 secure :-1 s=READY pgs=1533 cs=0 l=1 rx=0x7efd3c0054a0 tx=0x7efd500122b0).stop 2020-04-22T14:15:25.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.921+0000 7efd5d5cc700 1 -- 172.21.15.103:0/2655710921 shutdown_connections 2020-04-22T14:15:25.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.921+0000 7efd5d5cc700 1 --2- 172.21.15.103:0/2655710921 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd3c004db0 0x7efd3c00b720 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:25.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.921+0000 7efd5d5cc700 1 -- 172.21.15.103:0/2655710921 >> 172.21.15.103:0/2655710921 conn(0x7efd580b9160 msgr2=0x7efd5805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:25.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.921+0000 7efd5d5cc700 1 -- 172.21.15.103:0/2655710921 shutdown_connections 2020-04-22T14:15:25.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.921+0000 7efd5d5cc700 1 -- 172.21.15.103:0/2655710921 wait complete. 2020-04-22T14:15:25.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.922+0000 7efd5d5cc700 1 Processor -- start 2020-04-22T14:15:25.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.922+0000 7efd5d5cc700 1 -- start start 2020-04-22T14:15:25.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.923+0000 7efd5d5cc700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd581293c0 0x7efd580b1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:25.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.923+0000 7efd5d5cc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7efd581576b0 0x7efd580b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:25.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.923+0000 7efd5d5cc700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd58142970 con 0x7efd3c004db0 2020-04-22T14:15:25.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.923+0000 7efd5d5cc700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd580b5ac0 con 0x7efd581576b0 2020-04-22T14:15:25.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.923+0000 7efd5d5cc700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd580b1ae0 con 0x7efd581293c0 2020-04-22T14:15:25.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.923+0000 7efd56ffd700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7efd3c004db0 0x7efd58156fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:36546/0 (socket says 172.21.15.103:36546) 2020-04-22T14:15:25.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.923+0000 7efd56ffd700 1 -- 172.21.15.103:0/3881393921 learned_addr learned my addr 172.21.15.103:0/3881393921 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:25.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.923+0000 7efd577fe700 1 --2- 172.21.15.103:0/3881393921 >> v2:172.21.15.86:3300/0 conn(0x7efd581576b0 0x7efd580b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:25.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.923+0000 7efd567fc700 1 --2- 172.21.15.103:0/3881393921 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd581293c0 0x7efd580b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:25.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.923+0000 7efd47fff700 1 -- 172.21.15.103:0/3881393921 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2762751057 0 0) 0x7efd4c007bd0 con 0x7efd3c004db0 2020-04-22T14:15:25.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.923+0000 7efd47fff700 1 -- 172.21.15.103:0/3881393921 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd34002fe0 con 0x7efd3c004db0 2020-04-22T14:15:25.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.924+0000 7efd567fc700 1 -- 172.21.15.103:0/3881393921 >> v2:172.21.15.86:3300/0 conn(0x7efd581576b0 msgr2=0x7efd580b32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:25.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.924+0000 7efd567fc700 1 --2- 172.21.15.103:0/3881393921 >> v2:172.21.15.86:3300/0 conn(0x7efd581576b0 0x7efd580b32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:25.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.924+0000 7efd567fc700 1 -- 172.21.15.103:0/3881393921 >> v1:172.21.15.86:6789/0 conn(0x7efd3c004db0 legacy=0x7efd58156fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:25.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.924+0000 7efd567fc700 1 -- 172.21.15.103:0/3881393921 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd580b1d80 con 0x7efd581293c0 2020-04-22T14:15:25.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.924+0000 7efd567fc700 1 --2- 172.21.15.103:0/3881393921 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd581293c0 0x7efd580b1510 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efd480013e0 tx=0x7efd5805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.924+0000 7efd567fc700 1 --2- 172.21.15.103:0/3881393921 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd581293c0 0x7efd580b1510 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efd480013e0 tx=0x7efd5805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.924+0000 7efd567fc700 1 --2- 172.21.15.103:0/3881393921 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd581293c0 0x7efd580b1510 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7efd480013e0 tx=0x7efd5805bce0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:25.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.924+0000 7efd567fc700 1 --2- 172.21.15.103:0/3881393921 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd581293c0 0x7efd580b1510 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7efd480013e0 tx=0x7efd5805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.924+0000 7efd47fff700 1 -- 172.21.15.103:0/3881393921 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd4800e550 con 0x7efd581293c0 2020-04-22T14:15:25.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.924+0000 7efd567fc700 1 --2- 172.21.15.103:0/3881393921 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd581293c0 0x7efd580b1510 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7efd480013e0 tx=0x7efd5805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.924+0000 7efd47fff700 1 -- 172.21.15.103:0/3881393921 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd4800e6b0 con 0x7efd581293c0 2020-04-22T14:15:25.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.924+0000 7efd567fc700 1 --2- 172.21.15.103:0/3881393921 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd581293c0 0x7efd580b1510 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7efd480013e0 tx=0x7efd5805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.924+0000 7efd5d5cc700 1 -- 172.21.15.103:0/3881393921 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd580b2020 con 0x7efd581293c0 2020-04-22T14:15:25.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.924+0000 7efd47fff700 1 -- 172.21.15.103:0/3881393921 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd4800ca80 con 0x7efd581293c0 2020-04-22T14:15:25.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.924+0000 7efd5d5cc700 1 -- 172.21.15.103:0/3881393921 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd580b3710 con 0x7efd581293c0 2020-04-22T14:15:25.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.925+0000 7efd567fc700 1 --2- 172.21.15.103:0/3881393921 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd581293c0 0x7efd580b1510 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7efd480013e0 tx=0x7efd5805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.925+0000 7efd5d5cc700 1 -- 172.21.15.103:0/3881393921 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd58056c90 con 0x7efd581293c0 2020-04-22T14:15:25.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.925+0000 7efd47fff700 1 -- 172.21.15.103:0/3881393921 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7efd4800cc80 con 0x7efd581293c0 2020-04-22T14:15:25.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.925+0000 7efd567fc700 1 --2- 172.21.15.103:0/3881393921 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd581293c0 0x7efd580b1510 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7efd480013e0 tx=0x7efd5805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.925+0000 7efd47fff700 1 --2- 172.21.15.103:0/3881393921 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efd3404dcb0 0x7efd34050170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:25.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.925+0000 7efd47fff700 1 -- 172.21.15.103:0/3881393921 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efd48061480 con 0x7efd581293c0 2020-04-22T14:15:25.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.926+0000 7efd56ffd700 1 --2- 172.21.15.103:0/3881393921 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efd3404dcb0 0x7efd34050170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:25.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.926+0000 7efd56ffd700 1 --2- 172.21.15.103:0/3881393921 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efd3404dcb0 0x7efd34050170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efd4c002f30 tx=0x7efd4c00c990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.926+0000 7efd56ffd700 1 --2- 172.21.15.103:0/3881393921 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efd3404dcb0 0x7efd34050170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efd4c002f30 tx=0x7efd4c00c990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.926+0000 7efd56ffd700 1 --2- 172.21.15.103:0/3881393921 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efd3404dcb0 0x7efd34050170 secure :-1 s=READY pgs=559 cs=0 l=1 rx=0x7efd4c002f30 tx=0x7efd4c00c990).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:25.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.929+0000 7efd567fc700 1 --2- 172.21.15.103:0/3881393921 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd581293c0 0x7efd580b1510 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7efd480013e0 tx=0x7efd5805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:25.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:25.929+0000 7efd47fff700 1 -- 172.21.15.103:0/3881393921 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7efd4803c800 con 0x7efd581293c0 2020-04-22T14:15:26.121 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:26.119+0000 7efd5d5cc700 1 -- 172.21.15.103:0/3881393921 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd58145ee0 con 0x7efd581293c0 2020-04-22T14:15:26.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:26.120+0000 7efd567fc700 1 --2- 172.21.15.103:0/3881393921 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd581293c0 0x7efd580b1510 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7efd480013e0 tx=0x7efd5805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:26.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:26.120+0000 7efd47fff700 1 -- 172.21.15.103:0/3881393921 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+2143 (secure 0 0 0) 0x7efd4803fe20 con 0x7efd581293c0 2020-04-22T14:15:26.122 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:15:26.122 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":74,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5987,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/3564040484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3564040484},{"type":"v1","addr":"172.21.15.86:6835","nonce":3564040484}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":70}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:15:12.286236+0000","modified":"2020-04-22T14:15:14.292028+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7452},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7452":{"gid":7452,"name":"a","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/1492911872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1492911872},{"type":"v1","addr":"172.21.15.103:6833","nonce":1492911872}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2020-04-22T14:15:26.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:26.121+0000 7efd5d5cc700 1 -- 172.21.15.103:0/3881393921 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efd3404dcb0 msgr2=0x7efd34050170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:26.124 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:26.121+0000 7efd5d5cc700 1 --2- 172.21.15.103:0/3881393921 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efd3404dcb0 0x7efd34050170 secure :-1 s=READY pgs=559 cs=0 l=1 rx=0x7efd4c002f30 tx=0x7efd4c00c990).stop 2020-04-22T14:15:26.124 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:26.121+0000 7efd5d5cc700 1 -- 172.21.15.103:0/3881393921 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd581293c0 msgr2=0x7efd580b1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:26.124 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:26.121+0000 7efd5d5cc700 1 --2- 172.21.15.103:0/3881393921 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd581293c0 0x7efd580b1510 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7efd480013e0 tx=0x7efd5805bce0).stop 2020-04-22T14:15:26.124 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:26.121+0000 7efd5d5cc700 1 -- 172.21.15.103:0/3881393921 shutdown_connections 2020-04-22T14:15:26.124 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:26.121+0000 7efd5d5cc700 1 --2- 172.21.15.103:0/3881393921 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efd3404dcb0 0x7efd34050170 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:26.124 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:26.121+0000 7efd5d5cc700 1 --2- 172.21.15.103:0/3881393921 >> v2:172.21.15.86:3300/0 conn(0x7efd581576b0 0x7efd580b32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:26.125 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:26.121+0000 7efd5d5cc700 1 --2- 172.21.15.103:0/3881393921 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd581293c0 0x7efd580b1510 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:26.125 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:26.121+0000 7efd5d5cc700 1 -- 172.21.15.103:0/3881393921 >> 172.21.15.103:0/3881393921 conn(0x7efd580b9160 msgr2=0x7efd58064c30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:26.125 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:26.121+0000 7efd5d5cc700 1 -- 172.21.15.103:0/3881393921 shutdown_connections 2020-04-22T14:15:26.125 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:26.121+0000 7efd5d5cc700 1 -- 172.21.15.103:0/3881393921 wait complete. 2020-04-22T14:15:26.125 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 74 2020-04-22T14:15:26.335 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 7452}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 17, u'failed': [], u'epoch': 74, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [18], u'info': {u'gid_7452': {u'export_targets': [], u'name': u'a', u'incarnation': 71, u'state_seq': 3, u'state': u'up:active', u'gid': 7452, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 1492911872, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 1492911872, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/1492911872'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:15:12.286236+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:15:14.292028+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:15:26.335 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:15:26.336 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:26.351 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:15:26.514 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:15:26.515 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:15:26.515 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:15:26.515 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 7452, 2020-04-22T14:15:26.515 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:15:26.515 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:15:26.515 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 14.222170342, 2020-04-22T14:15:26.523 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 74, 2020-04-22T14:15:26.524 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 102, 2020-04-22T14:15:26.524 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 102, 2020-04-22T14:15:26.524 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 19.626833010999999 2020-04-22T14:15:26.524 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:15:26.525 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 7452, "want_state": "up:active", "state": "up:active", "rank_uptime": 14.222170342, "mdsmap_epoch": 74, "osdmap_epoch": 102, "osdmap_epoch_barrier": 102, "uptime": 19.626833010999999 } 2020-04-22T14:15:26.525 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-04-22T14:15:26.525 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-04-22T14:15:26.526 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:26.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:26.540 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:15:26.610 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:15:26.611 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:15:26.611 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:15:26.611 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:15:26.611 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:15:26.611 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:15:26.611 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:15:26.612 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:15:26.612 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:15:26.612 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:15:26.612 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:15:26.612 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:15:26.612 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:15:26.612 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:15:26.613 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:15:26.613 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 41914sec preferred_lft 41914sec 2020-04-22T14:15:26.613 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:15:26.613 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:15:26.613 INFO:teuthology.orchestra.run.smithi103.stdout:32: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:15:26.613 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 16:f4:f7:e4:d3:c7 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:15:26.613 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:15:26.614 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:15:26.614 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::2644:9931:adeb:4e5e/64 scope link noprefixroute 2020-04-22T14:15:26.614 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:15:26.614 INFO:teuthology.orchestra.run.smithi103.stdout:33: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-04-22T14:15:26.614 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 16:f4:f7:e4:d3:c7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2020-04-22T14:15:26.615 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:26.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:26.658 INFO:teuthology.orchestra.run.smithi103:> ip netns list 2020-04-22T14:15:26.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2020-04-22T14:15:26.717 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:26.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:26.766 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:15:26.826 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2020-04-22T14:15:26.826 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:26.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:26.873 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:15:26.932 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2020-04-22T14:15:26.933 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:26.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:26.982 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:15:27.064 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:27.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:27.105 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 1' 2020-04-22T14:15:27.180 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:27.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:27.226 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr' 2020-04-22T14:15:27.309 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:15:27.309 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:15:27.309 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:15:27.309 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:15:27.310 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:15:27.310 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:15:27.310 INFO:teuthology.orchestra.run.smithi103.stdout:2: veth0@if33: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:15:27.310 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether e2:a7:61:34:cf:29 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:15:27.311 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2020-04-22T14:15:27.311 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:15:27.311 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::e0a7:61ff:fe34:cf29/64 scope link 2020-04-22T14:15:27.311 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:15:27.341 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:27.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:27.367 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr' 2020-04-22T14:15:27.481 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:15:27.500 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:15:27.500 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:15:27.500 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:15:27.500 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:15:27.500 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:15:27.500 INFO:teuthology.orchestra.run.smithi103.stdout:2: veth0@if33: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:15:27.501 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether e2:a7:61:34:cf:29 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:15:27.501 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2020-04-22T14:15:27.501 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:15:27.501 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::e0a7:61ff:fe34:cf29/64 scope link 2020-04-22T14:15:27.501 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:15:27.502 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.2/16 2020-04-22T14:15:27.502 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:27.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:27.519 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.1' 2020-04-22T14:15:27.595 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:27.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:27.650 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0' 2020-04-22T14:15:27.761 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:27.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:27.794 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up' 2020-04-22T14:15:27.901 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:27.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:27.943 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up' 2020-04-22T14:15:28.067 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:28.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:28.082 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254' 2020-04-22T14:15:28.201 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:28.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:28.220 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:15:28.300 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:28.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:28.345 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge-slave con-name brx.1 ifname brx.1 master ceph-brx' 2020-04-22T14:15:28.453 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.1' (282701c3-1e3b-4a63-bf11-0a15994f4e94) successfully added. 2020-04-22T14:15:28.453 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:28.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:28.485 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up brx.1' 2020-04-22T14:15:28.642 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/41) 2020-04-22T14:15:28.643 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2020-04-22T14:15:28.643 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi103.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2020-04-22T14:15:28.643 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:28.656 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:15:28.657 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:15:28.716 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:28.776 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:15:28.776 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:15:28.844 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:15:28.851 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:15:28.852 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:28.897 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:15:28.897 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:15:28.970 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:15:28.970 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [47] 2020-04-22T14:15:28.971 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:29.010 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:15:29.053 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:29.066 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:15:29.067 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:15:29.136 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:15:29.140 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:2020-04-22T14:15:29.138+0000 7f355e9d61c0 -1 init, newargv = 0x55bb311d02b0 newargc=9 2020-04-22T14:15:29.141 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[96111]: starting ceph client 2020-04-22T14:15:29.143 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:15:29.143 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:29.146 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[96111]: starting fuse 2020-04-22T14:15:29.158 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:15:29.158 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:15:29.218 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:15:29.218 INFO:teuthology.orchestra.run.smithi103.stdout:49 2020-04-22T14:15:29.218 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47, 49] 2020-04-22T14:15:29.219 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:29.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:15:29.267 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:15:29.267 INFO:teuthology.orchestra.run.smithi103:> import glob 2020-04-22T14:15:29.267 INFO:teuthology.orchestra.run.smithi103:> import re 2020-04-22T14:15:29.267 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:15:29.267 INFO:teuthology.orchestra.run.smithi103:> import subprocess 2020-04-22T14:15:29.267 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:15:29.268 INFO:teuthology.orchestra.run.smithi103:> def find_socket(client_name): 2020-04-22T14:15:29.268 INFO:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2020-04-22T14:15:29.268 INFO:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2020-04-22T14:15:29.268 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:15:29.268 INFO:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2020-04-22T14:15:29.268 INFO:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2020-04-22T14:15:29.269 INFO:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2020-04-22T14:15:29.269 INFO:teuthology.orchestra.run.smithi103:> return files[0] 2020-04-22T14:15:29.269 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:15:29.269 INFO:teuthology.orchestra.run.smithi103:> for f in files: 2020-04-22T14:15:29.269 INFO:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:15:29.270 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:15:29.270 INFO:teuthology.orchestra.run.smithi103:> return f 2020-04-22T14:15:29.270 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:15:29.270 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:15:29.270 INFO:teuthology.orchestra.run.smithi103:> print(find_socket("client.1")) 2020-04-22T14:15:29.271 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:15:29.386 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.1.96111.asok 2020-04-22T14:15:29.387 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.96111.asok 2020-04-22T14:15:29.387 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:29.401 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:15:29.401 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.96111.asok status 2020-04-22T14:15:29.560 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:15:29.560 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2020-04-22T14:15:29.560 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:15:29.560 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:15:29.561 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "1", 2020-04-22T14:15:29.561 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:15:29.563 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2020-04-22T14:15:29.564 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "96111", 2020-04-22T14:15:29.564 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:15:29.565 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:29.565 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2020-04-22T14:15:29.565 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2020-04-22T14:15:29.565 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 8362, 2020-04-22T14:15:29.565 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2020-04-22T14:15:29.565 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:15:29.565 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:15:29.566 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 8362 2020-04-22T14:15:29.566 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:29.566 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:15:29.566 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:29.566 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.2:0", 2020-04-22T14:15:29.566 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 135981073 2020-04-22T14:15:29.566 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:29.567 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:29.567 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:15:29.571 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:29.571 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.2:0", 2020-04-22T14:15:29.571 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 135981073 2020-04-22T14:15:29.571 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:29.571 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.8362 192.168.0.2:0/135981073", 2020-04-22T14:15:29.572 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.2:0/135981073", 2020-04-22T14:15:29.572 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2020-04-22T14:15:29.572 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 74, 2020-04-22T14:15:29.572 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 102, 2020-04-22T14:15:29.572 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2020-04-22T14:15:29.572 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklisted": false 2020-04-22T14:15:29.572 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:15:29.573 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:29.588 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:15:29.588 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-22T14:15:29.588 INFO:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:15:29.647 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2020-04-22T14:15:29.647 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-04-22T14:15:29.649 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:29.696 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:15:29.696 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:15:29.772 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:29.825 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok config get mds_reconnect_timeout 2020-04-22T14:15:29.977 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:15:29.977 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_reconnect_timeout": "45.000000" 2020-04-22T14:15:29.978 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:15:29.993 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_reconnect_timeout": "45.000000" } 2020-04-22T14:15:29.994 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:30.009 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok config get ms_max_backoff 2020-04-22T14:15:30.161 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:15:30.162 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_max_backoff": "15.000000" 2020-04-22T14:15:30.163 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:15:30.171 INFO:tasks.cephfs.filesystem:_json_asok output: { "ms_max_backoff": "15.000000" } 2020-04-22T14:15:30.171 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:30.184 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:15:30.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.330+0000 7fb4e232b700 1 Processor -- start 2020-04-22T14:15:30.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.330+0000 7fb4e232b700 1 -- start start 2020-04-22T14:15:30.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.330+0000 7fb4e232b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4dc12c0d0 0x7fb4dc1464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:30.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.330+0000 7fb4e232b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb4dc065fe0 0x7fb4dc05b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:30.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.330+0000 7fb4e232b700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4dc143300 con 0x7fb4dc05b8a0 2020-04-22T14:15:30.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.330+0000 7fb4e232b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4dc12c4b0 con 0x7fb4dc065fe0 2020-04-22T14:15:30.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.330+0000 7fb4e232b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4dc1435a0 con 0x7fb4dc12c0d0 2020-04-22T14:15:30.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.330+0000 7fb4e08c8700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb4dc05b8a0 0x7fb4dc062ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47654/0 (socket says 172.21.15.103:47654) 2020-04-22T14:15:30.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.330+0000 7fb4e08c8700 1 -- 172.21.15.103:0/2418285695 learned_addr learned my addr 172.21.15.103:0/2418285695 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:30.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.331+0000 7fb4db7fe700 1 --2- 172.21.15.103:0/2418285695 >> v2:172.21.15.86:3300/0 conn(0x7fb4dc065fe0 0x7fb4dc05b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:30.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.331+0000 7fb4dbfff700 1 --2- 172.21.15.103:0/2418285695 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4dc12c0d0 0x7fb4dc1464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:30.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.331+0000 7fb4daffd700 1 -- 172.21.15.103:0/2418285695 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3094244624 0 0) 0x7fb4dc143300 con 0x7fb4dc05b8a0 2020-04-22T14:15:30.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.331+0000 7fb4daffd700 1 -- 172.21.15.103:0/2418285695 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4c8003230 con 0x7fb4dc05b8a0 2020-04-22T14:15:30.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.331+0000 7fb4db7fe700 1 -- 172.21.15.103:0/2418285695 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4dc12c0d0 msgr2=0x7fb4dc1464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:30.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.331+0000 7fb4db7fe700 1 --2- 172.21.15.103:0/2418285695 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4dc12c0d0 0x7fb4dc1464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:30.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.331+0000 7fb4db7fe700 1 -- 172.21.15.103:0/2418285695 >> v1:172.21.15.103:6789/0 conn(0x7fb4dc05b8a0 legacy=0x7fb4dc062ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:30.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.331+0000 7fb4db7fe700 1 -- 172.21.15.103:0/2418285695 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4dc143840 con 0x7fb4dc065fe0 2020-04-22T14:15:30.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.331+0000 7fb4db7fe700 1 --2- 172.21.15.103:0/2418285695 >> v2:172.21.15.86:3300/0 conn(0x7fb4dc065fe0 0x7fb4dc05b440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb4d0002f30 tx=0x7fb4d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:30.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.331+0000 7fb4dbfff700 1 --2- 172.21.15.103:0/2418285695 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4dc12c0d0 0x7fb4dc1464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:15:30.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.331+0000 7fb4db7fe700 1 --2- 172.21.15.103:0/2418285695 >> v2:172.21.15.86:3300/0 conn(0x7fb4dc065fe0 0x7fb4dc05b440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb4d0002f30 tx=0x7fb4d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:30.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.331+0000 7fb4db7fe700 1 --2- 172.21.15.103:0/2418285695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4dc065fe0 0x7fb4dc05b440 secure :-1 s=READY pgs=816 cs=0 l=1 rx=0x7fb4d0002f30 tx=0x7fb4d0007a40).ready entity=mon.0 client_cookie=44559c068f97ba12 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:30.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.331+0000 7fb4db7fe700 1 --2- 172.21.15.103:0/2418285695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4dc065fe0 0x7fb4dc05b440 secure :-1 s=THROTTLE_DONE pgs=816 cs=0 l=1 rx=0x7fb4d0002f30 tx=0x7fb4d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:30.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.331+0000 7fb4daffd700 1 -- 172.21.15.103:0/2418285695 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4d0011500 con 0x7fb4dc065fe0 2020-04-22T14:15:30.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.331+0000 7fb4db7fe700 1 --2- 172.21.15.103:0/2418285695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4dc065fe0 0x7fb4dc05b440 secure :-1 s=THROTTLE_DONE pgs=816 cs=0 l=1 rx=0x7fb4d0002f30 tx=0x7fb4d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:30.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.331+0000 7fb4daffd700 1 -- 172.21.15.103:0/2418285695 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d00116a0 con 0x7fb4dc065fe0 2020-04-22T14:15:30.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.331+0000 7fb4db7fe700 1 --2- 172.21.15.103:0/2418285695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4dc065fe0 0x7fb4dc05b440 secure :-1 s=THROTTLE_DONE pgs=816 cs=0 l=1 rx=0x7fb4d0002f30 tx=0x7fb4d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:30.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.331+0000 7fb4e232b700 1 -- 172.21.15.103:0/2418285695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4dc065fe0 msgr2=0x7fb4dc05b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:30.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.331+0000 7fb4daffd700 1 -- 172.21.15.103:0/2418285695 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4d0011a80 con 0x7fb4dc065fe0 2020-04-22T14:15:30.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.331+0000 7fb4e232b700 1 --2- 172.21.15.103:0/2418285695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4dc065fe0 0x7fb4dc05b440 secure :-1 s=READY pgs=816 cs=0 l=1 rx=0x7fb4d0002f30 tx=0x7fb4d0007a40).stop 2020-04-22T14:15:30.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.332+0000 7fb4e232b700 1 -- 172.21.15.103:0/2418285695 shutdown_connections 2020-04-22T14:15:30.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.332+0000 7fb4e232b700 1 --2- 172.21.15.103:0/2418285695 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4dc12c0d0 0x7fb4dc1464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:30.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.332+0000 7fb4e232b700 1 --2- 172.21.15.103:0/2418285695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4dc065fe0 0x7fb4dc05b440 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:30.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.332+0000 7fb4e232b700 1 -- 172.21.15.103:0/2418285695 >> 172.21.15.103:0/2418285695 conn(0x7fb4dc0b9160 msgr2=0x7fb4dc05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:30.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.332+0000 7fb4e232b700 1 -- 172.21.15.103:0/2418285695 shutdown_connections 2020-04-22T14:15:30.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.332+0000 7fb4e232b700 1 -- 172.21.15.103:0/2418285695 wait complete. 2020-04-22T14:15:30.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.333+0000 7fb4e232b700 1 Processor -- start 2020-04-22T14:15:30.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.333+0000 7fb4e232b700 1 -- start start 2020-04-22T14:15:30.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.334+0000 7fb4e232b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb4dc05b8a0 0x7fb4dc0b4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:30.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.334+0000 7fb4e232b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4dc065fe0 0x7fb4dc0b2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:30.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.334+0000 7fb4e232b700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4dc0b3b60 con 0x7fb4dc12c0d0 2020-04-22T14:15:30.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.334+0000 7fb4e232b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4dc0b3e00 con 0x7fb4dc05b8a0 2020-04-22T14:15:30.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.334+0000 7fb4e232b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4dc0b40a0 con 0x7fb4dc065fe0 2020-04-22T14:15:30.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.334+0000 7fb4e08c8700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb4dc12c0d0 0x7fb4dc141fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47660/0 (socket says 172.21.15.103:47660) 2020-04-22T14:15:30.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.334+0000 7fb4e08c8700 1 -- 172.21.15.103:0/3014290979 learned_addr learned my addr 172.21.15.103:0/3014290979 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:30.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.334+0000 7fb4dbfff700 1 --2- 172.21.15.103:0/3014290979 >> v2:172.21.15.86:3300/0 conn(0x7fb4dc05b8a0 0x7fb4dc0b4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:30.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.334+0000 7fb4db7fe700 1 --2- 172.21.15.103:0/3014290979 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4dc065fe0 0x7fb4dc0b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:30.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.334+0000 7fb4d97fa700 1 -- 172.21.15.103:0/3014290979 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1753425267 0 0) 0x7fb4dc0b3b60 con 0x7fb4dc12c0d0 2020-04-22T14:15:30.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.334+0000 7fb4d97fa700 1 -- 172.21.15.103:0/3014290979 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4bc002fe0 con 0x7fb4dc12c0d0 2020-04-22T14:15:30.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.334+0000 7fb4dbfff700 1 -- 172.21.15.103:0/3014290979 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4dc065fe0 msgr2=0x7fb4dc0b2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:30.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.334+0000 7fb4dbfff700 1 --2- 172.21.15.103:0/3014290979 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4dc065fe0 0x7fb4dc0b2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:30.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.334+0000 7fb4dbfff700 1 -- 172.21.15.103:0/3014290979 >> v1:172.21.15.103:6789/0 conn(0x7fb4dc12c0d0 legacy=0x7fb4dc141fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:30.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.334+0000 7fb4d97fa700 1 -- 172.21.15.103:0/3014290979 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1656442827 0 0) 0x7fb4bc002fe0 con 0x7fb4dc12c0d0 2020-04-22T14:15:30.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.334+0000 7fb4dbfff700 1 -- 172.21.15.103:0/3014290979 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4dc1426b0 con 0x7fb4dc05b8a0 2020-04-22T14:15:30.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.334+0000 7fb4dbfff700 1 --2- 172.21.15.103:0/3014290979 >> v2:172.21.15.86:3300/0 conn(0x7fb4dc05b8a0 0x7fb4dc0b4540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb4d4001da0 tx=0x7fb4cc010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:30.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.334+0000 7fb4dbfff700 1 --2- 172.21.15.103:0/3014290979 >> v2:172.21.15.86:3300/0 conn(0x7fb4dc05b8a0 0x7fb4dc0b4540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb4d4001da0 tx=0x7fb4cc010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:30.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.334+0000 7fb4dbfff700 1 --2- 172.21.15.103:0/3014290979 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4dc05b8a0 0x7fb4dc0b4540 secure :-1 s=READY pgs=817 cs=0 l=1 rx=0x7fb4d4001da0 tx=0x7fb4cc010d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:30.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.335+0000 7fb4dbfff700 1 --2- 172.21.15.103:0/3014290979 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4dc05b8a0 0x7fb4dc0b4540 secure :-1 s=THROTTLE_DONE pgs=817 cs=0 l=1 rx=0x7fb4d4001da0 tx=0x7fb4cc010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:30.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.335+0000 7fb4d97fa700 1 -- 172.21.15.103:0/3014290979 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4d4001c00 con 0x7fb4dc05b8a0 2020-04-22T14:15:30.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.335+0000 7fb4dbfff700 1 --2- 172.21.15.103:0/3014290979 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4dc05b8a0 0x7fb4dc0b4540 secure :-1 s=THROTTLE_DONE pgs=817 cs=0 l=1 rx=0x7fb4d4001da0 tx=0x7fb4cc010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:30.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.335+0000 7fb4dbfff700 1 --2- 172.21.15.103:0/3014290979 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4dc05b8a0 0x7fb4dc0b4540 secure :-1 s=THROTTLE_DONE pgs=817 cs=0 l=1 rx=0x7fb4d4001da0 tx=0x7fb4cc010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:30.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.335+0000 7fb4d97fa700 1 -- 172.21.15.103:0/3014290979 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4cc007370 con 0x7fb4dc05b8a0 2020-04-22T14:15:30.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.335+0000 7fb4d97fa700 1 -- 172.21.15.103:0/3014290979 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4cc0059c0 con 0x7fb4dc05b8a0 2020-04-22T14:15:30.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.335+0000 7fb4e232b700 1 -- 172.21.15.103:0/3014290979 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4dc0b54c0 con 0x7fb4dc05b8a0 2020-04-22T14:15:30.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.335+0000 7fb4e232b700 1 -- 172.21.15.103:0/3014290979 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4dc0b3470 con 0x7fb4dc05b8a0 2020-04-22T14:15:30.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.335+0000 7fb4dbfff700 1 --2- 172.21.15.103:0/3014290979 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4dc05b8a0 0x7fb4dc0b4540 secure :-1 s=THROTTLE_DONE pgs=817 cs=0 l=1 rx=0x7fb4d4001da0 tx=0x7fb4cc010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:30.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.336+0000 7fb4e232b700 1 -- 172.21.15.103:0/3014290979 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4dc0b3990 con 0x7fb4dc05b8a0 2020-04-22T14:15:30.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.336+0000 7fb4d97fa700 1 -- 172.21.15.103:0/3014290979 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fb4cc005c30 con 0x7fb4dc05b8a0 2020-04-22T14:15:30.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.336+0000 7fb4dbfff700 1 --2- 172.21.15.103:0/3014290979 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4dc05b8a0 0x7fb4dc0b4540 secure :-1 s=THROTTLE_DONE pgs=817 cs=0 l=1 rx=0x7fb4d4001da0 tx=0x7fb4cc010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:30.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.336+0000 7fb4d97fa700 1 --2- 172.21.15.103:0/3014290979 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb4bc04dc70 0x7fb4bc050130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:30.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.336+0000 7fb4d97fa700 1 -- 172.21.15.103:0/3014290979 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb4cc061120 con 0x7fb4dc05b8a0 2020-04-22T14:15:30.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.336+0000 7fb4db7fe700 1 --2- 172.21.15.103:0/3014290979 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb4bc04dc70 0x7fb4bc050130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:30.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.337+0000 7fb4db7fe700 1 --2- 172.21.15.103:0/3014290979 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb4bc04dc70 0x7fb4bc050130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb4d0002f30 tx=0x7fb4d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:30.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.337+0000 7fb4db7fe700 1 --2- 172.21.15.103:0/3014290979 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb4bc04dc70 0x7fb4bc050130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb4d0002f30 tx=0x7fb4d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:30.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.337+0000 7fb4db7fe700 1 --2- 172.21.15.103:0/3014290979 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb4bc04dc70 0x7fb4bc050130 secure :-1 s=READY pgs=560 cs=0 l=1 rx=0x7fb4d0002f30 tx=0x7fb4d0007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:30.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.340+0000 7fb4dbfff700 1 --2- 172.21.15.103:0/3014290979 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4dc05b8a0 0x7fb4dc0b4540 secure :-1 s=THROTTLE_DONE pgs=817 cs=0 l=1 rx=0x7fb4d4001da0 tx=0x7fb4cc010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:30.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.340+0000 7fb4d97fa700 1 -- 172.21.15.103:0/3014290979 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fb4cc03c560 con 0x7fb4dc05b8a0 2020-04-22T14:15:30.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.527+0000 7fb4e232b700 1 -- 172.21.15.103:0/3014290979 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4dc056c90 con 0x7fb4dc05b8a0 2020-04-22T14:15:30.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.528+0000 7fb4dbfff700 1 --2- 172.21.15.103:0/3014290979 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4dc05b8a0 0x7fb4dc0b4540 secure :-1 s=THROTTLE_DONE pgs=817 cs=0 l=1 rx=0x7fb4d4001da0 tx=0x7fb4cc010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:30.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.528+0000 7fb4d97fa700 1 -- 172.21.15.103:0/3014290979 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+2143 (secure 0 0 0) 0x7fb4cc03fb80 con 0x7fb4dc05b8a0 2020-04-22T14:15:30.530 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:15:30.530 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":74,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5987,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/3564040484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3564040484},{"type":"v1","addr":"172.21.15.86:6835","nonce":3564040484}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":70}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:15:12.286236+0000","modified":"2020-04-22T14:15:14.292028+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7452},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7452":{"gid":7452,"name":"a","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/1492911872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1492911872},{"type":"v1","addr":"172.21.15.103:6833","nonce":1492911872}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2020-04-22T14:15:30.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.529+0000 7fb4e232b700 1 -- 172.21.15.103:0/3014290979 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb4bc04dc70 msgr2=0x7fb4bc050130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:30.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.529+0000 7fb4e232b700 1 --2- 172.21.15.103:0/3014290979 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb4bc04dc70 0x7fb4bc050130 secure :-1 s=READY pgs=560 cs=0 l=1 rx=0x7fb4d0002f30 tx=0x7fb4d0007a40).stop 2020-04-22T14:15:30.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.529+0000 7fb4e232b700 1 -- 172.21.15.103:0/3014290979 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4dc05b8a0 msgr2=0x7fb4dc0b4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:30.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.529+0000 7fb4e232b700 1 --2- 172.21.15.103:0/3014290979 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4dc05b8a0 0x7fb4dc0b4540 secure :-1 s=READY pgs=817 cs=0 l=1 rx=0x7fb4d4001da0 tx=0x7fb4cc010d70).stop 2020-04-22T14:15:30.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.529+0000 7fb4e232b700 1 -- 172.21.15.103:0/3014290979 shutdown_connections 2020-04-22T14:15:30.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.529+0000 7fb4e232b700 1 --2- 172.21.15.103:0/3014290979 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb4bc04dc70 0x7fb4bc050130 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:30.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.529+0000 7fb4e232b700 1 --2- 172.21.15.103:0/3014290979 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4dc05b8a0 0x7fb4dc0b4540 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:30.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.529+0000 7fb4e232b700 1 --2- 172.21.15.103:0/3014290979 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4dc065fe0 0x7fb4dc0b2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:30.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.529+0000 7fb4e232b700 1 -- 172.21.15.103:0/3014290979 >> 172.21.15.103:0/3014290979 conn(0x7fb4dc0b9160 msgr2=0x7fb4dc0b65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:30.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.529+0000 7fb4e232b700 1 -- 172.21.15.103:0/3014290979 shutdown_connections 2020-04-22T14:15:30.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:30.529+0000 7fb4e232b700 1 -- 172.21.15.103:0/3014290979 wait complete. 2020-04-22T14:15:30.533 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 74 2020-04-22T14:15:30.541 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:30.555 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-04-22T14:15:30.555 INFO:teuthology.orchestra.run.smithi103:> import time 2020-04-22T14:15:30.555 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:15:30.555 INFO:teuthology.orchestra.run.smithi103:> with open("/home/ubuntu/cephtest/mnt.0/background_file", '"'"'w'"'"') as f: 2020-04-22T14:15:30.556 INFO:teuthology.orchestra.run.smithi103:> f.write('"'"'content'"'"') 2020-04-22T14:15:30.556 INFO:teuthology.orchestra.run.smithi103:> f.flush() 2020-04-22T14:15:30.556 INFO:teuthology.orchestra.run.smithi103:> f.write('"'"'content2'"'"') 2020-04-22T14:15:30.556 INFO:teuthology.orchestra.run.smithi103:> while True: 2020-04-22T14:15:30.556 INFO:teuthology.orchestra.run.smithi103:> time.sleep(1) 2020-04-22T14:15:30.556 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:15:30.597 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:30.610 INFO:teuthology.orchestra.run.smithi103:> sudo ls /home/ubuntu/cephtest/mnt.0/background_file 2020-04-22T14:15:30.679 INFO:teuthology.orchestra.run.smithi103.stdout:/home/ubuntu/cephtest/mnt.0/background_file 2020-04-22T14:15:30.680 DEBUG:tasks.cephfs.mount:File background_file became visible from 0 after 0s 2020-04-22T14:15:30.680 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:30.733 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:15:30.734 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:15:30.734 INFO:teuthology.orchestra.run.smithi103:> import glob 2020-04-22T14:15:30.734 INFO:teuthology.orchestra.run.smithi103:> import re 2020-04-22T14:15:30.734 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:15:30.734 INFO:teuthology.orchestra.run.smithi103:> import subprocess 2020-04-22T14:15:30.734 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:15:30.735 INFO:teuthology.orchestra.run.smithi103:> def find_socket(client_name): 2020-04-22T14:15:30.735 INFO:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-04-22T14:15:30.735 INFO:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2020-04-22T14:15:30.735 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:15:30.735 INFO:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2020-04-22T14:15:30.735 INFO:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2020-04-22T14:15:30.735 INFO:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2020-04-22T14:15:30.735 INFO:teuthology.orchestra.run.smithi103:> return files[0] 2020-04-22T14:15:30.736 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:15:30.736 INFO:teuthology.orchestra.run.smithi103:> for f in files: 2020-04-22T14:15:30.736 INFO:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:15:30.736 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:15:30.736 INFO:teuthology.orchestra.run.smithi103:> return f 2020-04-22T14:15:30.736 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:15:30.736 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:15:30.736 INFO:teuthology.orchestra.run.smithi103:> print(find_socket("client.0")) 2020-04-22T14:15:30.737 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:15:30.842 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.0.94821.asok 2020-04-22T14:15:30.842 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.94821.asok 2020-04-22T14:15:30.843 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:30.856 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:15:30.856 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.94821.asok mds_sessions 2020-04-22T14:15:31.016 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:15:31.016 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 8323, 2020-04-22T14:15:31.016 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2020-04-22T14:15:31.017 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:15:31.017 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:15:31.017 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 8323 2020-04-22T14:15:31.018 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:31.019 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:15:31.019 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:31.019 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:15:31.022 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1618592206 2020-04-22T14:15:31.022 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:31.022 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:31.022 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.8323 v1:192.168.0.1:0/1618592206", 2020-04-22T14:15:31.022 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "v1:192.168.0.1:0/1618592206", 2020-04-22T14:15:31.023 INFO:teuthology.orchestra.run.smithi103.stdout: "sessions": [ 2020-04-22T14:15:31.023 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:31.023 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": 0, 2020-04-22T14:15:31.023 INFO:teuthology.orchestra.run.smithi103.stdout: "addrs": { 2020-04-22T14:15:31.023 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:31.023 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:31.027 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:31.027 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6832", 2020-04-22T14:15:31.028 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1492911872 2020-04-22T14:15:31.028 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:31.028 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:31.028 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:31.028 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6833", 2020-04-22T14:15:31.028 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1492911872 2020-04-22T14:15:31.029 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:31.029 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:31.029 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:31.029 INFO:teuthology.orchestra.run.smithi103.stdout: "seq": 0, 2020-04-22T14:15:31.029 INFO:teuthology.orchestra.run.smithi103.stdout: "cap_gen": 0, 2020-04-22T14:15:31.029 INFO:teuthology.orchestra.run.smithi103.stdout: "cap_ttl": "2020-04-22T14:16:24.368561+0000", 2020-04-22T14:15:31.030 INFO:teuthology.orchestra.run.smithi103.stdout: "last_cap_renew_request": "2020-04-22T14:15:24.368561+0000", 2020-04-22T14:15:31.030 INFO:teuthology.orchestra.run.smithi103.stdout: "cap_renew_seq": 2, 2020-04-22T14:15:31.030 INFO:teuthology.orchestra.run.smithi103.stdout: "num_caps": 2, 2020-04-22T14:15:31.030 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "open" 2020-04-22T14:15:31.030 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:31.030 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:15:31.030 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 74 2020-04-22T14:15:31.031 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:15:31.031 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:31.045 INFO:teuthology.orchestra.run.smithi103:> sudo ls /home/ubuntu/cephtest/mnt.1/background_file 2020-04-22T14:15:31.120 INFO:teuthology.orchestra.run.smithi103.stdout:/home/ubuntu/cephtest/mnt.1/background_file 2020-04-22T14:15:31.121 DEBUG:tasks.cephfs.mount:File background_file became visible from 1 after 0s 2020-04-22T14:15:31.121 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:15:31.121 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:31.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:31.174 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip link set brx.0 down' 2020-04-22T14:15:36.251 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:36.268 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-04-22T14:15:36.268 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:15:36.268 INFO:teuthology.orchestra.run.smithi103:> import time 2020-04-22T14:15:36.269 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:15:36.269 INFO:teuthology.orchestra.run.smithi103:> fd = os.open("/home/ubuntu/cephtest/mnt.1/background_file", os.O_RDWR | os.O_CREAT, 0o644) 2020-04-22T14:15:36.269 INFO:teuthology.orchestra.run.smithi103:> try: 2020-04-22T14:15:36.269 INFO:teuthology.orchestra.run.smithi103:> while True: 2020-04-22T14:15:36.269 INFO:teuthology.orchestra.run.smithi103:> os.write(fd, b'"'"'content'"'"') 2020-04-22T14:15:36.269 INFO:teuthology.orchestra.run.smithi103:> time.sleep(1) 2020-04-22T14:15:36.269 INFO:teuthology.orchestra.run.smithi103:> if not False: 2020-04-22T14:15:36.269 INFO:teuthology.orchestra.run.smithi103:> break 2020-04-22T14:15:36.270 INFO:teuthology.orchestra.run.smithi103:> except IOError as e: 2020-04-22T14:15:36.270 INFO:teuthology.orchestra.run.smithi103:> pass 2020-04-22T14:15:36.270 INFO:teuthology.orchestra.run.smithi103:> os.close(fd) 2020-04-22T14:15:36.270 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:15:41.411 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:41.428 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:15:41.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.582+0000 7fc08e75d700 1 Processor -- start 2020-04-22T14:15:41.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.582+0000 7fc08e75d700 1 -- start start 2020-04-22T14:15:41.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.583+0000 7fc08e75d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc08812c0d0 0x7fc0881464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:41.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.583+0000 7fc08e75d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc088065fe0 0x7fc08805b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:41.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.583+0000 7fc08e75d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc088143300 con 0x7fc08805b8a0 2020-04-22T14:15:41.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.583+0000 7fc08e75d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc08812c4b0 con 0x7fc088065fe0 2020-04-22T14:15:41.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.583+0000 7fc08e75d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0881435a0 con 0x7fc08812c0d0 2020-04-22T14:15:41.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.583+0000 7fc0877fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc088065fe0 0x7fc08805b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:41.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.583+0000 7fc087fff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc08812c0d0 0x7fc0881464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:41.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.583+0000 7fc0877fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc088065fe0 0x7fc08805b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:52710/0 (socket says 172.21.15.103:52710) 2020-04-22T14:15:41.589 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.583+0000 7fc0877fe700 1 -- 172.21.15.103:0/492270019 learned_addr learned my addr 172.21.15.103:0/492270019 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:15:41.590 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.583+0000 7fc08ccfa700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fc08805b8a0 0x7fc088062ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:36590/0 (socket says 172.21.15.103:36590) 2020-04-22T14:15:41.590 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.584+0000 7fc086ffd700 1 -- 172.21.15.103:0/492270019 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2062455457 0 0) 0x7fc088143300 con 0x7fc08805b8a0 2020-04-22T14:15:41.590 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.584+0000 7fc086ffd700 1 -- 172.21.15.103:0/492270019 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc074003230 con 0x7fc08805b8a0 2020-04-22T14:15:41.591 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.584+0000 7fc0877fe700 1 -- 172.21.15.103:0/492270019 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc08812c0d0 msgr2=0x7fc0881464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:41.591 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.584+0000 7fc0877fe700 1 --2- 172.21.15.103:0/492270019 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc08812c0d0 0x7fc0881464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:41.591 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.584+0000 7fc0877fe700 1 -- 172.21.15.103:0/492270019 >> v1:172.21.15.86:6789/0 conn(0x7fc08805b8a0 legacy=0x7fc088062ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:41.591 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.584+0000 7fc0877fe700 1 -- 172.21.15.103:0/492270019 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc088143840 con 0x7fc088065fe0 2020-04-22T14:15:41.591 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.584+0000 7fc087fff700 1 --2- 172.21.15.103:0/492270019 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc08812c0d0 0x7fc0881464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:15:41.591 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.584+0000 7fc0877fe700 1 --2- 172.21.15.103:0/492270019 >> v2:172.21.15.86:3300/0 conn(0x7fc088065fe0 0x7fc08805b440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc07c002f30 tx=0x7fc07c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:41.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.584+0000 7fc0877fe700 1 --2- 172.21.15.103:0/492270019 >> v2:172.21.15.86:3300/0 conn(0x7fc088065fe0 0x7fc08805b440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc07c002f30 tx=0x7fc07c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:41.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.584+0000 7fc0877fe700 1 --2- 172.21.15.103:0/492270019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc088065fe0 0x7fc08805b440 secure :-1 s=READY pgs=819 cs=0 l=1 rx=0x7fc07c002f30 tx=0x7fc07c007a40).ready entity=mon.0 client_cookie=1718c7645b3269e5 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:41.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.584+0000 7fc0877fe700 1 --2- 172.21.15.103:0/492270019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc088065fe0 0x7fc08805b440 secure :-1 s=THROTTLE_DONE pgs=819 cs=0 l=1 rx=0x7fc07c002f30 tx=0x7fc07c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:41.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.584+0000 7fc086ffd700 1 -- 172.21.15.103:0/492270019 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc07c0115c0 con 0x7fc088065fe0 2020-04-22T14:15:41.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.584+0000 7fc0877fe700 1 --2- 172.21.15.103:0/492270019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc088065fe0 0x7fc08805b440 secure :-1 s=THROTTLE_DONE pgs=819 cs=0 l=1 rx=0x7fc07c002f30 tx=0x7fc07c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:41.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.584+0000 7fc086ffd700 1 -- 172.21.15.103:0/492270019 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07c011760 con 0x7fc088065fe0 2020-04-22T14:15:41.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.584+0000 7fc0877fe700 1 --2- 172.21.15.103:0/492270019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc088065fe0 0x7fc08805b440 secure :-1 s=THROTTLE_DONE pgs=819 cs=0 l=1 rx=0x7fc07c002f30 tx=0x7fc07c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:41.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.584+0000 7fc08e75d700 1 -- 172.21.15.103:0/492270019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc088065fe0 msgr2=0x7fc08805b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:41.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.584+0000 7fc086ffd700 1 -- 172.21.15.103:0/492270019 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc07c011b80 con 0x7fc088065fe0 2020-04-22T14:15:41.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.584+0000 7fc08e75d700 1 --2- 172.21.15.103:0/492270019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc088065fe0 0x7fc08805b440 secure :-1 s=READY pgs=819 cs=0 l=1 rx=0x7fc07c002f30 tx=0x7fc07c007a40).stop 2020-04-22T14:15:41.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.585+0000 7fc08e75d700 1 -- 172.21.15.103:0/492270019 shutdown_connections 2020-04-22T14:15:41.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.585+0000 7fc08e75d700 1 --2- 172.21.15.103:0/492270019 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc08812c0d0 0x7fc0881464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:41.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.585+0000 7fc08e75d700 1 --2- 172.21.15.103:0/492270019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc088065fe0 0x7fc08805b440 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:41.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.585+0000 7fc08e75d700 1 -- 172.21.15.103:0/492270019 >> 172.21.15.103:0/492270019 conn(0x7fc0880b9160 msgr2=0x7fc08805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:41.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.585+0000 7fc08e75d700 1 -- 172.21.15.103:0/492270019 shutdown_connections 2020-04-22T14:15:41.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.585+0000 7fc08e75d700 1 -- 172.21.15.103:0/492270019 wait complete. 2020-04-22T14:15:41.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.586+0000 7fc08e75d700 1 Processor -- start 2020-04-22T14:15:41.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.586+0000 7fc08e75d700 1 -- start start 2020-04-22T14:15:41.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.587+0000 7fc08e75d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc08805b8a0 0x7fc088152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:41.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.587+0000 7fc08e75d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc088065fe0 0x7fc088127220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:41.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.587+0000 7fc08e75d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc088129510 con 0x7fc08812c0d0 2020-04-22T14:15:41.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.587+0000 7fc08e75d700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0881297b0 con 0x7fc08805b8a0 2020-04-22T14:15:41.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.587+0000 7fc08e75d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc088129a50 con 0x7fc088065fe0 2020-04-22T14:15:41.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.587+0000 7fc087fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc08805b8a0 0x7fc088152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:41.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.587+0000 7fc087fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc08805b8a0 0x7fc088152d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55482/0 (socket says 172.21.15.103:55482) 2020-04-22T14:15:41.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.587+0000 7fc087fff700 1 -- 172.21.15.103:0/197477219 learned_addr learned my addr 172.21.15.103:0/197477219 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:15:41.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.587+0000 7fc0877fe700 1 --2- 172.21.15.103:0/197477219 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc088065fe0 0x7fc088127220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:41.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.587+0000 7fc087fff700 1 -- 172.21.15.103:0/197477219 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc088065fe0 msgr2=0x7fc088127220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:41.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.587+0000 7fc087fff700 1 --2- 172.21.15.103:0/197477219 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc088065fe0 0x7fc088127220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:41.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.587+0000 7fc087fff700 1 -- 172.21.15.103:0/197477219 >> v1:172.21.15.86:6789/0 conn(0x7fc08812c0d0 legacy=0x7fc088129ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:41.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.587+0000 7fc087fff700 1 -- 172.21.15.103:0/197477219 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc088128c30 con 0x7fc08805b8a0 2020-04-22T14:15:41.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.587+0000 7fc087fff700 1 --2- 172.21.15.103:0/197477219 >> v2:172.21.15.103:3300/0 conn(0x7fc08805b8a0 0x7fc088152d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc078002ef0 tx=0x7fc07800eb60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:41.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.587+0000 7fc087fff700 1 --2- 172.21.15.103:0/197477219 >> v2:172.21.15.103:3300/0 conn(0x7fc08805b8a0 0x7fc088152d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc078002ef0 tx=0x7fc07800eb60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:41.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.587+0000 7fc087fff700 1 --2- 172.21.15.103:0/197477219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc08805b8a0 0x7fc088152d80 secure :-1 s=READY pgs=1540 cs=0 l=1 rx=0x7fc078002ef0 tx=0x7fc07800eb60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:41.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.587+0000 7fc087fff700 1 --2- 172.21.15.103:0/197477219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc08805b8a0 0x7fc088152d80 secure :-1 s=THROTTLE_DONE pgs=1540 cs=0 l=1 rx=0x7fc078002ef0 tx=0x7fc07800eb60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:41.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.587+0000 7fc0857fa700 1 -- 172.21.15.103:0/197477219 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc078007180 con 0x7fc08805b8a0 2020-04-22T14:15:41.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.587+0000 7fc087fff700 1 --2- 172.21.15.103:0/197477219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc08805b8a0 0x7fc088152d80 secure :-1 s=THROTTLE_DONE pgs=1540 cs=0 l=1 rx=0x7fc078002ef0 tx=0x7fc07800eb60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:41.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.587+0000 7fc087fff700 1 --2- 172.21.15.103:0/197477219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc08805b8a0 0x7fc088152d80 secure :-1 s=THROTTLE_DONE pgs=1540 cs=0 l=1 rx=0x7fc078002ef0 tx=0x7fc07800eb60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:41.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.587+0000 7fc0857fa700 1 -- 172.21.15.103:0/197477219 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0780072e0 con 0x7fc08805b8a0 2020-04-22T14:15:41.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.587+0000 7fc08e75d700 1 -- 172.21.15.103:0/197477219 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc08812a600 con 0x7fc08805b8a0 2020-04-22T14:15:41.625 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.587+0000 7fc0857fa700 1 -- 172.21.15.103:0/197477219 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc078014900 con 0x7fc08805b8a0 2020-04-22T14:15:41.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.588+0000 7fc08e75d700 1 -- 172.21.15.103:0/197477219 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc088129230 con 0x7fc08805b8a0 2020-04-22T14:15:41.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.588+0000 7fc087fff700 1 --2- 172.21.15.103:0/197477219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc08805b8a0 0x7fc088152d80 secure :-1 s=THROTTLE_DONE pgs=1540 cs=0 l=1 rx=0x7fc078002ef0 tx=0x7fc07800eb60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:41.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.588+0000 7fc08e75d700 1 -- 172.21.15.103:0/197477219 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc088056c90 con 0x7fc08805b8a0 2020-04-22T14:15:41.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.589+0000 7fc0857fa700 1 -- 172.21.15.103:0/197477219 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fc078014a60 con 0x7fc08805b8a0 2020-04-22T14:15:41.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.589+0000 7fc087fff700 1 --2- 172.21.15.103:0/197477219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc08805b8a0 0x7fc088152d80 secure :-1 s=THROTTLE_DONE pgs=1540 cs=0 l=1 rx=0x7fc078002ef0 tx=0x7fc07800eb60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:41.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.589+0000 7fc0857fa700 1 --2- 172.21.15.103:0/197477219 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc06804da50 0x7fc06804ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:41.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.589+0000 7fc0857fa700 1 -- 172.21.15.103:0/197477219 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc078063680 con 0x7fc08805b8a0 2020-04-22T14:15:41.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.589+0000 7fc0877fe700 1 --2- 172.21.15.103:0/197477219 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc06804da50 0x7fc06804ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:41.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.589+0000 7fc0877fe700 1 --2- 172.21.15.103:0/197477219 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc06804da50 0x7fc06804ff10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc07c002f30 tx=0x7fc07c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:41.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.589+0000 7fc0877fe700 1 --2- 172.21.15.103:0/197477219 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc06804da50 0x7fc06804ff10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc07c002f30 tx=0x7fc07c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:41.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.589+0000 7fc0877fe700 1 --2- 172.21.15.103:0/197477219 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc06804da50 0x7fc06804ff10 secure :-1 s=READY pgs=561 cs=0 l=1 rx=0x7fc07c002f30 tx=0x7fc07c007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:41.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.593+0000 7fc087fff700 1 --2- 172.21.15.103:0/197477219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc08805b8a0 0x7fc088152d80 secure :-1 s=THROTTLE_DONE pgs=1540 cs=0 l=1 rx=0x7fc078002ef0 tx=0x7fc07800eb60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:41.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.593+0000 7fc0857fa700 1 -- 172.21.15.103:0/197477219 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fc07803ea00 con 0x7fc08805b8a0 2020-04-22T14:15:41.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.783+0000 7fc08e75d700 1 -- 172.21.15.103:0/197477219 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc088129bc0 con 0x7fc08805b8a0 2020-04-22T14:15:41.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.784+0000 7fc087fff700 1 --2- 172.21.15.103:0/197477219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc08805b8a0 0x7fc088152d80 secure :-1 s=THROTTLE_DONE pgs=1540 cs=0 l=1 rx=0x7fc078002ef0 tx=0x7fc07800eb60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:41.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.784+0000 7fc0857fa700 1 -- 172.21.15.103:0/197477219 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+2143 (secure 0 0 0) 0x7fc078042020 con 0x7fc08805b8a0 2020-04-22T14:15:41.788 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:15:41.788 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":74,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5987,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/3564040484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3564040484},{"type":"v1","addr":"172.21.15.86:6835","nonce":3564040484}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":70}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:15:12.286236+0000","modified":"2020-04-22T14:15:14.292028+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7452},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7452":{"gid":7452,"name":"a","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/1492911872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1492911872},{"type":"v1","addr":"172.21.15.103:6833","nonce":1492911872}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2020-04-22T14:15:41.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.785+0000 7fc08e75d700 1 -- 172.21.15.103:0/197477219 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc06804da50 msgr2=0x7fc06804ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:41.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.785+0000 7fc08e75d700 1 --2- 172.21.15.103:0/197477219 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc06804da50 0x7fc06804ff10 secure :-1 s=READY pgs=561 cs=0 l=1 rx=0x7fc07c002f30 tx=0x7fc07c007a40).stop 2020-04-22T14:15:41.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.785+0000 7fc08e75d700 1 -- 172.21.15.103:0/197477219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc08805b8a0 msgr2=0x7fc088152d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:41.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.785+0000 7fc08e75d700 1 --2- 172.21.15.103:0/197477219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc08805b8a0 0x7fc088152d80 secure :-1 s=READY pgs=1540 cs=0 l=1 rx=0x7fc078002ef0 tx=0x7fc07800eb60).stop 2020-04-22T14:15:41.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.785+0000 7fc08e75d700 1 -- 172.21.15.103:0/197477219 shutdown_connections 2020-04-22T14:15:41.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.785+0000 7fc08e75d700 1 --2- 172.21.15.103:0/197477219 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc06804da50 0x7fc06804ff10 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:41.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.785+0000 7fc08e75d700 1 --2- 172.21.15.103:0/197477219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc08805b8a0 0x7fc088152d80 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:41.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.785+0000 7fc08e75d700 1 --2- 172.21.15.103:0/197477219 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc088065fe0 0x7fc088127220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:41.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.785+0000 7fc08e75d700 1 -- 172.21.15.103:0/197477219 >> 172.21.15.103:0/197477219 conn(0x7fc0880b9160 msgr2=0x7fc0880b4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:41.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.785+0000 7fc08e75d700 1 -- 172.21.15.103:0/197477219 shutdown_connections 2020-04-22T14:15:41.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:41.785+0000 7fc08e75d700 1 -- 172.21.15.103:0/197477219 wait complete. 2020-04-22T14:15:41.790 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 74 2020-04-22T14:15:41.799 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:41.812 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok session evict 8323 2020-04-22T14:15:42.492 INFO:tasks.cephfs.filesystem:_json_asok output: 2020-04-22T14:15:48.002 INFO:tasks.cephfs.test_client_recovery:cap_waiter waited 5.50958609581s 2020-04-22T14:15:48.011 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:15:48.011 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:48.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:48.067 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip link set brx.0 up' 2020-04-22T14:15:48.181 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-04-22T14:15:48.181 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:15:48.198 INFO:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:15:48.289 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:48.306 INFO:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:15:48.400 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-04-22T14:15:48.401 INFO:tasks.cephfs.mount:Terminating background process 2020-04-22T14:15:48.401 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2020-04-22T14:15:48.401 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:48.415 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-04-22T14:15:48.415 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:15:48.492 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[94821]: fuse finished with error 0 and tester_r 0 2020-04-22T14:15:48.608 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:15:48.608 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:15:48.608 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:48.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:48.662 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:15:48.737 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:48.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:48.795 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down brx.0' 2020-04-22T14:15:49.007 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.0' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/40) 2020-04-22T14:15:49.008 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:49.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:49.022 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete brx.0' 2020-04-22T14:15:49.129 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.0' (93d59d19-5747-4294-8744-ad68e1ecbbcd) successfully deleted. 2020-04-22T14:15:49.130 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:49.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:49.159 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:15:49.267 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:49.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:49.289 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:15:49.349 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:15:49.349 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:15:49.349 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:15:49.349 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:15:49.349 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:15:49.349 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:15:49.350 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:15:49.350 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:15:49.350 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:15:49.350 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:15:49.350 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:15:49.350 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:15:49.350 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:15:49.351 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:15:49.351 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:15:49.351 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 41891sec preferred_lft 41891sec 2020-04-22T14:15:49.351 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:15:49.351 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:15:49.351 INFO:teuthology.orchestra.run.smithi103.stdout:32: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:15:49.351 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether d2:98:d4:1b:2c:0d brd ff:ff:ff:ff:ff:ff 2020-04-22T14:15:49.352 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:15:49.352 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:15:49.352 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::2644:9931:adeb:4e5e/64 scope link noprefixroute 2020-04-22T14:15:49.352 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:15:49.352 INFO:teuthology.orchestra.run.smithi103.stdout:34: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-04-22T14:15:49.352 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether d2:98:d4:1b:2c:0d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2020-04-22T14:15:49.353 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:49.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:49.422 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:15:49.498 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:49.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:49.548 INFO:teuthology.orchestra.run.smithi103:> nmcli connection show 2020-04-22T14:15:49.622 INFO:teuthology.orchestra.run.smithi103.stdout:NAME UUID TYPE DEVICE 2020-04-22T14:15:49.623 INFO:teuthology.orchestra.run.smithi103.stdout:System enp3s0f1 b0a308d1-bd90-60af-eb7c-0183bb425a1a ethernet enp3s0f1 2020-04-22T14:15:49.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-brx bd4b7b29-8dae-4ac8-b9ec-536f049f57e9 bridge ceph-brx 2020-04-22T14:15:49.624 INFO:teuthology.orchestra.run.smithi103.stdout:brx.1 282701c3-1e3b-4a63-bf11-0a15994f4e94 ethernet brx.1 2020-04-22T14:15:49.624 INFO:teuthology.orchestra.run.smithi103.stdout:eno1 206ad60d-195e-4d4b-a9fe-a5dd1f33a67d ethernet -- 2020-04-22T14:15:49.625 INFO:teuthology.orchestra.run.smithi103.stdout:eno2 894a7dd2-d329-4985-9ef9-84a92c6e1c6c ethernet -- 2020-04-22T14:15:49.625 INFO:teuthology.orchestra.run.smithi103.stdout:enp3s0f0 5a3237ce-06ab-4ae0-818b-45bdf036cb08 ethernet -- 2020-04-22T14:15:49.625 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:49.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:49.673 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:15:49.732 INFO:tasks.cephfs.mount:Terminating background process 2020-04-22T14:15:49.732 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2020-04-22T14:15:49.732 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:49.780 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-04-22T14:15:49.780 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:15:49.854 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[96111]: fuse finished with error 0 and tester_r 0 2020-04-22T14:15:49.996 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-04-22T14:15:49.996 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:15:49.997 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:50.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:50.051 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:15:50.126 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:50.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:50.178 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down brx.1' 2020-04-22T14:15:50.339 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.1' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/41) 2020-04-22T14:15:50.340 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:50.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:50.353 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete brx.1' 2020-04-22T14:15:50.464 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.1' (282701c3-1e3b-4a63-bf11-0a15994f4e94) successfully deleted. 2020-04-22T14:15:50.464 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:50.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:50.492 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:15:50.600 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:50.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:50.629 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:15:50.688 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:15:50.688 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:15:50.689 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:15:50.689 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:15:50.689 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:15:50.689 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:15:50.689 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:15:50.689 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:15:50.690 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:15:50.690 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:15:50.690 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:15:50.690 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:15:50.691 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:15:50.691 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:15:50.691 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:15:50.691 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 41890sec preferred_lft 41890sec 2020-04-22T14:15:50.691 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:15:50.691 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:15:50.691 INFO:teuthology.orchestra.run.smithi103.stdout:32: ceph-brx: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:15:50.692 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:15:50.692 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:15:50.692 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:15:50.692 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::2644:9931:adeb:4e5e/64 scope link noprefixroute 2020-04-22T14:15:50.692 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:15:50.692 INFO:teuthology.orchestra.run.smithi103.stdout:34: brx.1@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:15:50.692 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether d2:98:d4:1b:2c:0d brd ff:ff:ff:ff:ff:ff link-netnsid 1 2020-04-22T14:15:50.693 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:50.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:50.736 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:15:50.812 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:50.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:50.863 INFO:teuthology.orchestra.run.smithi103:> nmcli connection show 2020-04-22T14:15:50.942 INFO:teuthology.orchestra.run.smithi103.stdout:NAME UUID TYPE DEVICE 2020-04-22T14:15:50.942 INFO:teuthology.orchestra.run.smithi103.stdout:System enp3s0f1 b0a308d1-bd90-60af-eb7c-0183bb425a1a ethernet enp3s0f1 2020-04-22T14:15:50.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-brx bd4b7b29-8dae-4ac8-b9ec-536f049f57e9 bridge ceph-brx 2020-04-22T14:15:50.942 INFO:teuthology.orchestra.run.smithi103.stdout:eno1 206ad60d-195e-4d4b-a9fe-a5dd1f33a67d ethernet -- 2020-04-22T14:15:50.944 INFO:teuthology.orchestra.run.smithi103.stdout:eno2 894a7dd2-d329-4985-9ef9-84a92c6e1c6c ethernet -- 2020-04-22T14:15:50.944 INFO:teuthology.orchestra.run.smithi103.stdout:enp3s0f0 5a3237ce-06ab-4ae0-818b-45bdf036cb08 ethernet -- 2020-04-22T14:15:50.944 INFO:tasks.cephfs.mount:Removing the 'ceph-brx' 2020-04-22T14:15:50.944 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:50.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:50.984 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down ceph-brx' 2020-04-22T14:15:51.195 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/39) 2020-04-22T14:15:51.195 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:51.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:51.210 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete ceph-brx' 2020-04-22T14:15:51.318 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' (bd4b7b29-8dae-4ac8-b9ec-536f049f57e9) successfully deleted. 2020-04-22T14:15:51.318 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:51.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:51.346 INFO:teuthology.orchestra.run.smithi103:> route 2020-04-22T14:15:51.405 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2020-04-22T14:15:51.406 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-04-22T14:15:51.406 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 102 0 0 enp3s0f1 2020-04-22T14:15:51.406 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 102 0 0 enp3s0f1 2020-04-22T14:15:51.406 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:51.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:51.455 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -D FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-04-22T14:15:51.563 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:51.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:51.588 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -D FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-04-22T14:15:51.697 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:51.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:51.781 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -t nat -D POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-04-22T14:15:51.891 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:51.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:51.913 INFO:teuthology.orchestra.run.smithi103:> cat /tmp/python-ceph-brx 2020-04-22T14:15:51.972 INFO:teuthology.orchestra.run.smithi103.stdout:0 2020-04-22T14:15:51.973 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:52.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:52.020 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 0 > /proc/sys/net/ipv4/ip_forward' 2020-04-22T14:15:52.096 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:52.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:52.140 INFO:teuthology.orchestra.run.smithi103:> rm -f /tmp/python-ceph-brx 2020-04-22T14:15:52.198 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:52.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:52.246 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:15:52.304 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.2' netns for '/home/ubuntu/cephtest/mnt.2' 2020-04-22T14:15:52.304 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:15:52.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:52.321 INFO:teuthology.orchestra.run.smithi086:> ip addr 2020-04-22T14:15:52.387 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:15:52.387 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:15:52.388 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:15:52.388 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:15:52.388 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2020-04-22T14:15:52.388 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:15:52.388 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:15:52.388 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:15:52.389 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:15:52.389 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:15:52.389 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:15:52.389 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:15:52.389 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:15:52.389 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:15:52.389 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:15:52.390 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 41862sec preferred_lft 41862sec 2020-04-22T14:15:52.390 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2020-04-22T14:15:52.390 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:15:52.390 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:15:52.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:52.439 INFO:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.2) 2020-04-22T14:15:52.498 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.3' netns for '/home/ubuntu/cephtest/mnt.3' 2020-04-22T14:15:52.498 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:15:52.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:52.551 INFO:teuthology.orchestra.run.smithi086:> ip addr 2020-04-22T14:15:52.610 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:15:52.610 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:15:52.610 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:15:52.611 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:15:52.611 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2020-04-22T14:15:52.611 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:15:52.611 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:15:52.611 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:15:52.611 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:15:52.612 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:15:52.612 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:15:52.612 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:15:52.612 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:15:52.612 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:15:52.612 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:15:52.612 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 41861sec preferred_lft 41861sec 2020-04-22T14:15:52.613 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2020-04-22T14:15:52.613 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:15:52.613 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:15:52.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:15:52.660 INFO:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.3) 2020-04-22T14:15:52.723 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:52.737 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_evicted_caps' 2020-04-22T14:15:52.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.880+0000 7fe38d9c1700 1 Processor -- start 2020-04-22T14:15:52.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.880+0000 7fe38d9c1700 1 -- start start 2020-04-22T14:15:52.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.881+0000 7fe38d9c1700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe388146ad0 0x7fe388146f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:52.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.881+0000 7fe38d9c1700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe388143810 con 0x7fe3880620a0 2020-04-22T14:15:52.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.881+0000 7fe38d9c1700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe388143ab0 con 0x7fe3880ad900 2020-04-22T14:15:52.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.881+0000 7fe38d9c1700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3881473b0 con 0x7fe388146ad0 2020-04-22T14:15:52.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.881+0000 7fe38d1c0700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe3880ad900 0x7fe3880add90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47686/0 (socket says 172.21.15.103:47686) 2020-04-22T14:15:52.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.881+0000 7fe38d1c0700 1 -- 172.21.15.103:0/72433109 learned_addr learned my addr 172.21.15.103:0/72433109 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:52.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.881+0000 7fe387fff700 1 --2- 172.21.15.103:0/72433109 >> v2:172.21.15.86:3300/0 conn(0x7fe388146ad0 0x7fe388146f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:52.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.881+0000 7fe3877fe700 1 -- 172.21.15.103:0/72433109 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2839944260 0 0) 0x7fe388143ab0 con 0x7fe3880ad900 2020-04-22T14:15:52.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.881+0000 7fe3877fe700 1 -- 172.21.15.103:0/72433109 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe374003230 con 0x7fe3880ad900 2020-04-22T14:15:52.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.881+0000 7fe3877fe700 1 -- 172.21.15.103:0/72433109 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4068246744 0 0) 0x7fe388143810 con 0x7fe3880620a0 2020-04-22T14:15:52.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.881+0000 7fe3877fe700 1 -- 172.21.15.103:0/72433109 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe388143ab0 con 0x7fe3880620a0 2020-04-22T14:15:52.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.881+0000 7fe3877fe700 1 -- 172.21.15.103:0/72433109 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3526872173 0 0) 0x7fe374003230 con 0x7fe3880ad900 2020-04-22T14:15:52.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.881+0000 7fe3877fe700 1 -- 172.21.15.103:0/72433109 >> v2:172.21.15.86:3300/0 conn(0x7fe388146ad0 msgr2=0x7fe388146f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:52.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.881+0000 7fe3877fe700 1 --2- 172.21.15.103:0/72433109 >> v2:172.21.15.86:3300/0 conn(0x7fe388146ad0 0x7fe388146f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:52.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.881+0000 7fe3877fe700 1 -- 172.21.15.103:0/72433109 >> v1:172.21.15.86:6789/0 conn(0x7fe3880620a0 legacy=0x7fe388142e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:52.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.881+0000 7fe3877fe700 1 -- 172.21.15.103:0/72433109 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe388143d50 con 0x7fe3880ad900 2020-04-22T14:15:52.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.881+0000 7fe3877fe700 1 -- 172.21.15.103:0/72433109 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fe3780016d0 con 0x7fe3880ad900 2020-04-22T14:15:52.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.881+0000 7fe3877fe700 1 -- 172.21.15.103:0/72433109 >> v1:172.21.15.103:6789/0 conn(0x7fe3880ad900 legacy=0x7fe3880add90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:52.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.881+0000 7fe3877fe700 1 --2- 172.21.15.103:0/72433109 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe3740038b0 0x7fe374003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:52.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.881+0000 7fe3877fe700 1 --2- 172.21.15.103:0/72433109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3740044d0 0x7fe374004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:52.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.881+0000 7fe3877fe700 1 --2- 172.21.15.103:0/72433109 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe374004db0 0x7fe37400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:52.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.881+0000 7fe3877fe700 1 -- 172.21.15.103:0/72433109 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3881473b0 con 0x7fe374004db0 2020-04-22T14:15:52.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.881+0000 7fe3877fe700 1 -- 172.21.15.103:0/72433109 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3740053a0 con 0x7fe3740044d0 2020-04-22T14:15:52.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.881+0000 7fe3877fe700 1 -- 172.21.15.103:0/72433109 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe37400de10 con 0x7fe3740038b0 2020-04-22T14:15:52.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.882+0000 7fe387fff700 1 --2- 172.21.15.103:0/72433109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3740044d0 0x7fe374004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:52.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.882+0000 7fe38c9bf700 1 --2- 172.21.15.103:0/72433109 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe3740038b0 0x7fe374003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:52.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.882+0000 7fe38d1c0700 1 --2- 172.21.15.103:0/72433109 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe374004db0 0x7fe37400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:52.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.882+0000 7fe387fff700 1 -- 172.21.15.103:0/72433109 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe3740038b0 msgr2=0x7fe374003cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:52.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.882+0000 7fe387fff700 1 --2- 172.21.15.103:0/72433109 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe3740038b0 0x7fe374003cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:52.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.882+0000 7fe387fff700 1 -- 172.21.15.103:0/72433109 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe374004db0 msgr2=0x7fe37400b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:52.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.882+0000 7fe387fff700 1 --2- 172.21.15.103:0/72433109 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe374004db0 0x7fe37400b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:52.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.882+0000 7fe38d1c0700 1 -- 172.21.15.103:0/72433109 reap_dead start 2020-04-22T14:15:52.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.882+0000 7fe387fff700 1 -- 172.21.15.103:0/72433109 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe374003230 con 0x7fe3740044d0 2020-04-22T14:15:52.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.882+0000 7fe387fff700 1 --2- 172.21.15.103:0/72433109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3740044d0 0x7fe374004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe37c002f30 tx=0x7fe37c010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:52.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.882+0000 7fe387fff700 1 --2- 172.21.15.103:0/72433109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3740044d0 0x7fe374004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe37c002f30 tx=0x7fe37c010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:52.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.882+0000 7fe387fff700 1 --2- 172.21.15.103:0/72433109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3740044d0 0x7fe374004950 secure :-1 s=READY pgs=1542 cs=0 l=1 rx=0x7fe37c002f30 tx=0x7fe37c010020).ready entity=mon.1 client_cookie=d806256216eb6267 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:52.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.882+0000 7fe387fff700 1 --2- 172.21.15.103:0/72433109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3740044d0 0x7fe374004950 secure :-1 s=THROTTLE_DONE pgs=1542 cs=0 l=1 rx=0x7fe37c002f30 tx=0x7fe37c010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:52.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.882+0000 7fe3877fe700 1 -- 172.21.15.103:0/72433109 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe37c008d30 con 0x7fe3740044d0 2020-04-22T14:15:52.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.882+0000 7fe387fff700 1 --2- 172.21.15.103:0/72433109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3740044d0 0x7fe374004950 secure :-1 s=THROTTLE_DONE pgs=1542 cs=0 l=1 rx=0x7fe37c002f30 tx=0x7fe37c010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:52.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.882+0000 7fe387fff700 1 --2- 172.21.15.103:0/72433109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3740044d0 0x7fe374004950 secure :-1 s=THROTTLE_DONE pgs=1542 cs=0 l=1 rx=0x7fe37c002f30 tx=0x7fe37c010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:52.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.882+0000 7fe3877fe700 1 -- 172.21.15.103:0/72433109 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37c008e90 con 0x7fe3740044d0 2020-04-22T14:15:52.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.882+0000 7fe3877fe700 1 -- 172.21.15.103:0/72433109 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe37c010a90 con 0x7fe3740044d0 2020-04-22T14:15:52.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.882+0000 7fe38d9c1700 1 -- 172.21.15.103:0/72433109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3740044d0 msgr2=0x7fe374004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:52.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.882+0000 7fe38d9c1700 1 --2- 172.21.15.103:0/72433109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3740044d0 0x7fe374004950 secure :-1 s=READY pgs=1542 cs=0 l=1 rx=0x7fe37c002f30 tx=0x7fe37c010020).stop 2020-04-22T14:15:52.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.883+0000 7fe38d9c1700 1 -- 172.21.15.103:0/72433109 shutdown_connections 2020-04-22T14:15:52.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.883+0000 7fe38d9c1700 1 --2- 172.21.15.103:0/72433109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3740044d0 0x7fe374004950 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:52.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.883+0000 7fe38d9c1700 1 -- 172.21.15.103:0/72433109 >> 172.21.15.103:0/72433109 conn(0x7fe38805b7c0 msgr2=0x7fe388061610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:52.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.883+0000 7fe38d9c1700 1 -- 172.21.15.103:0/72433109 shutdown_connections 2020-04-22T14:15:52.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.883+0000 7fe38d9c1700 1 -- 172.21.15.103:0/72433109 wait complete. 2020-04-22T14:15:52.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.884+0000 7fe38d9c1700 1 Processor -- start 2020-04-22T14:15:52.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.884+0000 7fe38d9c1700 1 -- start start 2020-04-22T14:15:52.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.884+0000 7fe38d9c1700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe3740044d0 0x7fe3880b2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:52.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.884+0000 7fe38d9c1700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe38813ca00 0x7fe38813ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:52.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.884+0000 7fe38d9c1700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe38813d290 con 0x7fe388062ca0 2020-04-22T14:15:52.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.884+0000 7fe38d9c1700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3880b26d0 con 0x7fe38813ca00 2020-04-22T14:15:52.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.884+0000 7fe38d9c1700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe388063150 con 0x7fe3740044d0 2020-04-22T14:15:52.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.885+0000 7fe38c9bf700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe3740044d0 0x7fe3880b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:52.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.885+0000 7fe387fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe388062ca0 0x7fe388064670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47696/0 (socket says 172.21.15.103:47696) 2020-04-22T14:15:52.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.885+0000 7fe387fff700 1 -- 172.21.15.103:0/182661641 learned_addr learned my addr 172.21.15.103:0/182661641 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:52.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.885+0000 7fe38d1c0700 1 --2- 172.21.15.103:0/182661641 >> v2:172.21.15.86:3300/0 conn(0x7fe38813ca00 0x7fe38813ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:52.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.885+0000 7fe38c9bf700 1 -- 172.21.15.103:0/182661641 >> v2:172.21.15.86:3300/0 conn(0x7fe38813ca00 msgr2=0x7fe38813ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:52.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.885+0000 7fe38c9bf700 1 --2- 172.21.15.103:0/182661641 >> v2:172.21.15.86:3300/0 conn(0x7fe38813ca00 0x7fe38813ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:52.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.885+0000 7fe385ffb700 1 -- 172.21.15.103:0/182661641 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2681019377 0 0) 0x7fe38813d290 con 0x7fe388062ca0 2020-04-22T14:15:52.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.885+0000 7fe38c9bf700 1 -- 172.21.15.103:0/182661641 >> v1:172.21.15.103:6789/0 conn(0x7fe388062ca0 legacy=0x7fe388064670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:52.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.885+0000 7fe38c9bf700 1 -- 172.21.15.103:0/182661641 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3880b1890 con 0x7fe3740044d0 2020-04-22T14:15:52.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.885+0000 7fe38c9bf700 1 --2- 172.21.15.103:0/182661641 >> v2:172.21.15.103:3300/0 conn(0x7fe3740044d0 0x7fe3880b2270 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe380001450 tx=0x7fe380001270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:52.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.885+0000 7fe38c9bf700 1 --2- 172.21.15.103:0/182661641 >> v2:172.21.15.103:3300/0 conn(0x7fe3740044d0 0x7fe3880b2270 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe380001450 tx=0x7fe380001270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:52.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.885+0000 7fe38c9bf700 1 --2- 172.21.15.103:0/182661641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3740044d0 0x7fe3880b2270 secure :-1 s=READY pgs=1544 cs=0 l=1 rx=0x7fe380001450 tx=0x7fe380001270).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:52.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.885+0000 7fe38c9bf700 1 --2- 172.21.15.103:0/182661641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3740044d0 0x7fe3880b2270 secure :-1 s=THROTTLE_DONE pgs=1544 cs=0 l=1 rx=0x7fe380001450 tx=0x7fe380001270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:52.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.885+0000 7fe385ffb700 1 -- 172.21.15.103:0/182661641 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe38000cea0 con 0x7fe3740044d0 2020-04-22T14:15:52.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.885+0000 7fe38c9bf700 1 --2- 172.21.15.103:0/182661641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3740044d0 0x7fe3880b2270 secure :-1 s=THROTTLE_DONE pgs=1544 cs=0 l=1 rx=0x7fe380001450 tx=0x7fe380001270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:52.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.885+0000 7fe38c9bf700 1 --2- 172.21.15.103:0/182661641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3740044d0 0x7fe3880b2270 secure :-1 s=THROTTLE_DONE pgs=1544 cs=0 l=1 rx=0x7fe380001450 tx=0x7fe380001270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:52.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.885+0000 7fe385ffb700 1 -- 172.21.15.103:0/182661641 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe380012660 con 0x7fe3740044d0 2020-04-22T14:15:52.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.885+0000 7fe38d9c1700 1 -- 172.21.15.103:0/182661641 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3880b1b30 con 0x7fe3740044d0 2020-04-22T14:15:52.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.885+0000 7fe385ffb700 1 -- 172.21.15.103:0/182661641 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe380012a80 con 0x7fe3740044d0 2020-04-22T14:15:52.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.885+0000 7fe38d9c1700 1 -- 172.21.15.103:0/182661641 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3880b1510 con 0x7fe3740044d0 2020-04-22T14:15:52.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.886+0000 7fe38c9bf700 1 --2- 172.21.15.103:0/182661641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3740044d0 0x7fe3880b2270 secure :-1 s=THROTTLE_DONE pgs=1544 cs=0 l=1 rx=0x7fe380001450 tx=0x7fe380001270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:52.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.886+0000 7fe38d9c1700 1 -- 172.21.15.103:0/182661641 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe388056c90 con 0x7fe3740044d0 2020-04-22T14:15:52.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.886+0000 7fe385ffb700 1 -- 172.21.15.103:0/182661641 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fe380012d40 con 0x7fe3740044d0 2020-04-22T14:15:52.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.886+0000 7fe38c9bf700 1 --2- 172.21.15.103:0/182661641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3740044d0 0x7fe3880b2270 secure :-1 s=THROTTLE_DONE pgs=1544 cs=0 l=1 rx=0x7fe380001450 tx=0x7fe380001270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:52.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.886+0000 7fe385ffb700 1 --2- 172.21.15.103:0/182661641 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe36804d820 0x7fe36804fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:52.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.886+0000 7fe385ffb700 1 -- 172.21.15.103:0/182661641 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fe380061310 con 0x7fe3740044d0 2020-04-22T14:15:52.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.887+0000 7fe387fff700 1 --2- 172.21.15.103:0/182661641 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe36804d820 0x7fe36804fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:52.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.887+0000 7fe387fff700 1 --2- 172.21.15.103:0/182661641 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe36804d820 0x7fe36804fce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe37c008620 tx=0x7fe37c010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:52.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.887+0000 7fe387fff700 1 --2- 172.21.15.103:0/182661641 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe36804d820 0x7fe36804fce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe37c008620 tx=0x7fe37c010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:52.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.887+0000 7fe387fff700 1 --2- 172.21.15.103:0/182661641 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe36804d820 0x7fe36804fce0 secure :-1 s=READY pgs=562 cs=0 l=1 rx=0x7fe37c008620 tx=0x7fe37c010020).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:52.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.890+0000 7fe38c9bf700 1 --2- 172.21.15.103:0/182661641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3740044d0 0x7fe3880b2270 secure :-1 s=THROTTLE_DONE pgs=1544 cs=0 l=1 rx=0x7fe380001450 tx=0x7fe380001270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:52.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:52.890+0000 7fe385ffb700 1 -- 172.21.15.103:0/182661641 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fe38003c690 con 0x7fe3740044d0 2020-04-22T14:15:53.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.082+0000 7fe38d9c1700 1 -- 172.21.15.103:0/182661641 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_evicted_caps"]} v 0) v1 -- 0x7fe388069f30 con 0x7fe3740044d0 2020-04-22T14:15:53.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.494+0000 7fe38c9bf700 1 --2- 172.21.15.103:0/182661641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3740044d0 0x7fe3880b2270 secure :-1 s=THROTTLE_DONE pgs=1544 cs=0 l=1 rx=0x7fe380001450 tx=0x7fe380001270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:53.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.494+0000 7fe385ffb700 1 -- 172.21.15.103:0/182661641 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_evicted_caps"]}]=0 v573) v1 ==== 149+0+0 (secure 0 0 0) 0x7fe38003fcb0 con 0x7fe3740044d0 2020-04-22T14:15:53.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.496+0000 7fe38d9c1700 1 -- 172.21.15.103:0/182661641 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe36804d820 msgr2=0x7fe36804fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:53.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.496+0000 7fe38d9c1700 1 --2- 172.21.15.103:0/182661641 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe36804d820 0x7fe36804fce0 secure :-1 s=READY pgs=562 cs=0 l=1 rx=0x7fe37c008620 tx=0x7fe37c010020).stop 2020-04-22T14:15:53.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.496+0000 7fe38d9c1700 1 -- 172.21.15.103:0/182661641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3740044d0 msgr2=0x7fe3880b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:53.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.496+0000 7fe38d9c1700 1 --2- 172.21.15.103:0/182661641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3740044d0 0x7fe3880b2270 secure :-1 s=READY pgs=1544 cs=0 l=1 rx=0x7fe380001450 tx=0x7fe380001270).stop 2020-04-22T14:15:53.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.496+0000 7fe38d9c1700 1 -- 172.21.15.103:0/182661641 shutdown_connections 2020-04-22T14:15:53.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.496+0000 7fe38d9c1700 1 --2- 172.21.15.103:0/182661641 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe36804d820 0x7fe36804fce0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:53.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.496+0000 7fe38d9c1700 1 --2- 172.21.15.103:0/182661641 >> v2:172.21.15.86:3300/0 conn(0x7fe38813ca00 0x7fe38813ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:53.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.496+0000 7fe38d9c1700 1 --2- 172.21.15.103:0/182661641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3740044d0 0x7fe3880b2270 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:53.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.496+0000 7fe38d9c1700 1 -- 172.21.15.103:0/182661641 >> 172.21.15.103:0/182661641 conn(0x7fe38805b7c0 msgr2=0x7fe3880b3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:53.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.496+0000 7fe38d9c1700 1 -- 172.21.15.103:0/182661641 shutdown_connections 2020-04-22T14:15:53.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.496+0000 7fe38d9c1700 1 -- 172.21.15.103:0/182661641 wait complete. 2020-04-22T14:15:53.510 INFO:tasks.cephfs_test_runner:test_evicted_caps (tasks.cephfs.test_client_recovery.TestClientRecovery) ... ok 2020-04-22T14:15:53.510 INFO:tasks.cephfs_test_runner:Starting test: test_filelock (tasks.cephfs.test_client_recovery.TestClientRecovery) 2020-04-22T14:15:53.511 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:53.525 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_filelock' 2020-04-22T14:15:53.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.670+0000 7f12100bd700 1 Processor -- start 2020-04-22T14:15:53.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.670+0000 7f12100bd700 1 -- start start 2020-04-22T14:15:53.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.671+0000 7f12100bd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1208065fe0 0x7f12081464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:53.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.671+0000 7f12100bd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1208063e30 0x7f12080642a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:53.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.671+0000 7f12100bd700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1208143300 con 0x7f120812c0d0 2020-04-22T14:15:53.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.671+0000 7f12100bd700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12081435a0 con 0x7f1208063e30 2020-04-22T14:15:53.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.671+0000 7f12100bd700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1208143840 con 0x7f1208065fe0 2020-04-22T14:15:53.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.671+0000 7f120de59700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f120812c0d0 0x7f120805b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47702/0 (socket says 172.21.15.103:47702) 2020-04-22T14:15:53.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.671+0000 7f120de59700 1 -- 172.21.15.103:0/2058832664 learned_addr learned my addr 172.21.15.103:0/2058832664 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:53.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.671+0000 7f120e65a700 1 --2- 172.21.15.103:0/2058832664 >> v2:172.21.15.86:3300/0 conn(0x7f1208063e30 0x7f12080642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:53.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.671+0000 7f120d658700 1 --2- 172.21.15.103:0/2058832664 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1208065fe0 0x7f12081464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:53.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.671+0000 7f120ce57700 1 -- 172.21.15.103:0/2058832664 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1547035889 0 0) 0x7f1208143300 con 0x7f120812c0d0 2020-04-22T14:15:53.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.671+0000 7f120ce57700 1 -- 172.21.15.103:0/2058832664 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11f0003230 con 0x7f120812c0d0 2020-04-22T14:15:53.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.671+0000 7f120ce57700 1 -- 172.21.15.103:0/2058832664 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1664838409 0 0) 0x7f11f0003230 con 0x7f120812c0d0 2020-04-22T14:15:53.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.672+0000 7f120ce57700 1 -- 172.21.15.103:0/2058832664 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1208065fe0 msgr2=0x7f12081464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:53.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.672+0000 7f120ce57700 1 --2- 172.21.15.103:0/2058832664 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1208065fe0 0x7f12081464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:53.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.672+0000 7f120ce57700 1 -- 172.21.15.103:0/2058832664 >> v2:172.21.15.86:3300/0 conn(0x7f1208063e30 msgr2=0x7f12080642a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:53.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.672+0000 7f120ce57700 1 --2- 172.21.15.103:0/2058832664 >> v2:172.21.15.86:3300/0 conn(0x7f1208063e30 0x7f12080642a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:53.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.672+0000 7f120ce57700 1 -- 172.21.15.103:0/2058832664 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f120805bb50 con 0x7f120812c0d0 2020-04-22T14:15:53.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.672+0000 7f120ce57700 1 -- 172.21.15.103:0/2058832664 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f11f80016d0 con 0x7f120812c0d0 2020-04-22T14:15:53.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.672+0000 7f120ce57700 1 -- 172.21.15.103:0/2058832664 >> v1:172.21.15.103:6789/0 conn(0x7f120812c0d0 legacy=0x7f120805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:53.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.672+0000 7f120ce57700 1 --2- 172.21.15.103:0/2058832664 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11f0003720 0x7f11f0003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:53.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.672+0000 7f120ce57700 1 --2- 172.21.15.103:0/2058832664 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1208065fe0 0x7f11f00044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:53.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.672+0000 7f120ce57700 1 --2- 172.21.15.103:0/2058832664 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11f0004930 0x7f11f0004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:53.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.672+0000 7f120ce57700 1 -- 172.21.15.103:0/2058832664 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12081435a0 con 0x7f11f0003720 2020-04-22T14:15:53.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.672+0000 7f120ce57700 1 -- 172.21.15.103:0/2058832664 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1208143840 con 0x7f11f0004930 2020-04-22T14:15:53.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.672+0000 7f120ce57700 1 -- 172.21.15.103:0/2058832664 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11f00040f0 con 0x7f1208065fe0 2020-04-22T14:15:53.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.672+0000 7f120e65a700 1 --2- 172.21.15.103:0/2058832664 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11f0004930 0x7f11f0004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:53.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.672+0000 7f120d658700 1 --2- 172.21.15.103:0/2058832664 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1208065fe0 0x7f11f00044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:53.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.672+0000 7f120de59700 1 --2- 172.21.15.103:0/2058832664 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11f0003720 0x7f11f0003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:53.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.672+0000 7f120e65a700 1 -- 172.21.15.103:0/2058832664 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1208065fe0 msgr2=0x7f11f00044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:53.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.672+0000 7f120e65a700 1 --2- 172.21.15.103:0/2058832664 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1208065fe0 0x7f11f00044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:53.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.672+0000 7f120e65a700 1 -- 172.21.15.103:0/2058832664 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11f0003720 msgr2=0x7f11f0003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:53.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.672+0000 7f120e65a700 1 --2- 172.21.15.103:0/2058832664 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11f0003720 0x7f11f0003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:53.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.672+0000 7f120e65a700 1 -- 172.21.15.103:0/2058832664 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f0003230 con 0x7f11f0004930 2020-04-22T14:15:53.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.672+0000 7f120e65a700 1 --2- 172.21.15.103:0/2058832664 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11f0004930 0x7f11f0004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f12000032b0 tx=0x7f12000103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:53.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.672+0000 7f120e65a700 1 --2- 172.21.15.103:0/2058832664 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11f0004930 0x7f11f0004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f12000032b0 tx=0x7f12000103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:53.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.672+0000 7f120e65a700 1 --2- 172.21.15.103:0/2058832664 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11f0004930 0x7f11f0004db0 secure :-1 s=READY pgs=1546 cs=0 l=1 rx=0x7f12000032b0 tx=0x7f12000103a0).ready entity=mon.1 client_cookie=cc3af149b285bdb9 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:53.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.672+0000 7f120e65a700 1 --2- 172.21.15.103:0/2058832664 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11f0004930 0x7f11f0004db0 secure :-1 s=THROTTLE_DONE pgs=1546 cs=0 l=1 rx=0x7f12000032b0 tx=0x7f12000103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:53.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.672+0000 7f120ce57700 1 -- 172.21.15.103:0/2058832664 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12000112c0 con 0x7f11f0004930 2020-04-22T14:15:53.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.672+0000 7f120e65a700 1 --2- 172.21.15.103:0/2058832664 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11f0004930 0x7f11f0004db0 secure :-1 s=THROTTLE_DONE pgs=1546 cs=0 l=1 rx=0x7f12000032b0 tx=0x7f12000103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:53.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.672+0000 7f120e65a700 1 --2- 172.21.15.103:0/2058832664 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11f0004930 0x7f11f0004db0 secure :-1 s=THROTTLE_DONE pgs=1546 cs=0 l=1 rx=0x7f12000032b0 tx=0x7f12000103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:53.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.672+0000 7f120ce57700 1 -- 172.21.15.103:0/2058832664 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1200011420 con 0x7f11f0004930 2020-04-22T14:15:53.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.672+0000 7f120ce57700 1 -- 172.21.15.103:0/2058832664 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1200011800 con 0x7f11f0004930 2020-04-22T14:15:53.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.672+0000 7f12100bd700 1 -- 172.21.15.103:0/2058832664 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11f0004930 msgr2=0x7f11f0004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:53.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.672+0000 7f12100bd700 1 --2- 172.21.15.103:0/2058832664 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11f0004930 0x7f11f0004db0 secure :-1 s=READY pgs=1546 cs=0 l=1 rx=0x7f12000032b0 tx=0x7f12000103a0).stop 2020-04-22T14:15:53.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.672+0000 7f120e65a700 1 -- 172.21.15.103:0/2058832664 reap_dead start 2020-04-22T14:15:53.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.673+0000 7f12100bd700 1 -- 172.21.15.103:0/2058832664 shutdown_connections 2020-04-22T14:15:53.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.673+0000 7f12100bd700 1 -- 172.21.15.103:0/2058832664 >> 172.21.15.103:0/2058832664 conn(0x7f12080b9160 msgr2=0x7f120805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:53.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.673+0000 7f12100bd700 1 -- 172.21.15.103:0/2058832664 shutdown_connections 2020-04-22T14:15:53.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.673+0000 7f12100bd700 1 -- 172.21.15.103:0/2058832664 wait complete. 2020-04-22T14:15:53.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.674+0000 7f12100bd700 1 Processor -- start 2020-04-22T14:15:53.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.674+0000 7f12100bd700 1 -- start start 2020-04-22T14:15:53.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.674+0000 7f12100bd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1208149590 0x7f120812b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:53.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.674+0000 7f12100bd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f120812aae0 0x7f1208149970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:53.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.674+0000 7f12100bd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f120814a8b0 0x7f120814ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:53.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.674+0000 7f12100bd700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1208149dd0 con 0x7f1208149590 2020-04-22T14:15:53.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.674+0000 7f12100bd700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12080aeb20 con 0x7f120814a8b0 2020-04-22T14:15:53.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.674+0000 7f12100bd700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12080aedc0 con 0x7f120812aae0 2020-04-22T14:15:53.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.675+0000 7f120e65a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f120814a8b0 0x7f120814ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:53.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.675+0000 7f120e65a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f120814a8b0 0x7f120814ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55526/0 (socket says 172.21.15.103:55526) 2020-04-22T14:15:53.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.675+0000 7f120e65a700 1 -- 172.21.15.103:0/2395990561 learned_addr learned my addr 172.21.15.103:0/2395990561 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:15:53.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.675+0000 7f120de59700 1 --2- 172.21.15.103:0/2395990561 >> v2:172.21.15.86:3300/0 conn(0x7f1208149590 0x7f120812b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:53.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.675+0000 7f120d658700 1 --2- 172.21.15.103:0/2395990561 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f120812aae0 0x7f1208149970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:53.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.675+0000 7f120e65a700 1 -- 172.21.15.103:0/2395990561 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f120812aae0 msgr2=0x7f1208149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:53.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.675+0000 7f120e65a700 1 --2- 172.21.15.103:0/2395990561 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f120812aae0 0x7f1208149970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:53.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.675+0000 7f120e65a700 1 -- 172.21.15.103:0/2395990561 >> v2:172.21.15.86:3300/0 conn(0x7f1208149590 msgr2=0x7f120812b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:53.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.675+0000 7f120e65a700 1 --2- 172.21.15.103:0/2395990561 >> v2:172.21.15.86:3300/0 conn(0x7f1208149590 0x7f120812b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:53.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.675+0000 7f120e65a700 1 -- 172.21.15.103:0/2395990561 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12080ae830 con 0x7f120814a8b0 2020-04-22T14:15:53.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.675+0000 7f120e65a700 1 --2- 172.21.15.103:0/2395990561 >> v2:172.21.15.103:3300/0 conn(0x7f120814a8b0 0x7f120814ad10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f12080603e0 tx=0x7f12000103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:53.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.675+0000 7f120e65a700 1 --2- 172.21.15.103:0/2395990561 >> v2:172.21.15.103:3300/0 conn(0x7f120814a8b0 0x7f120814ad10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f12080603e0 tx=0x7f12000103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:53.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.675+0000 7f120e65a700 1 --2- 172.21.15.103:0/2395990561 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f120814a8b0 0x7f120814ad10 secure :-1 s=READY pgs=1547 cs=0 l=1 rx=0x7f12080603e0 tx=0x7f12000103a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:53.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.675+0000 7f120e65a700 1 --2- 172.21.15.103:0/2395990561 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f120814a8b0 0x7f120814ad10 secure :-1 s=THROTTLE_DONE pgs=1547 cs=0 l=1 rx=0x7f12080603e0 tx=0x7f12000103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:53.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.675+0000 7f11f6ffd700 1 -- 172.21.15.103:0/2395990561 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1200007c20 con 0x7f120814a8b0 2020-04-22T14:15:53.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.675+0000 7f120e65a700 1 --2- 172.21.15.103:0/2395990561 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f120814a8b0 0x7f120814ad10 secure :-1 s=THROTTLE_DONE pgs=1547 cs=0 l=1 rx=0x7f12080603e0 tx=0x7f12000103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:53.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.675+0000 7f120e65a700 1 --2- 172.21.15.103:0/2395990561 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f120814a8b0 0x7f120814ad10 secure :-1 s=THROTTLE_DONE pgs=1547 cs=0 l=1 rx=0x7f12080603e0 tx=0x7f12000103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:53.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.675+0000 7f11f6ffd700 1 -- 172.21.15.103:0/2395990561 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1200005c30 con 0x7f120814a8b0 2020-04-22T14:15:53.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.675+0000 7f11f6ffd700 1 -- 172.21.15.103:0/2395990561 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1200007180 con 0x7f120814a8b0 2020-04-22T14:15:53.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.675+0000 7f12100bd700 1 -- 172.21.15.103:0/2395990561 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f120814b170 con 0x7f120814a8b0 2020-04-22T14:15:53.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.675+0000 7f12100bd700 1 -- 172.21.15.103:0/2395990561 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f120814b5e0 con 0x7f120814a8b0 2020-04-22T14:15:53.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.676+0000 7f120e65a700 1 --2- 172.21.15.103:0/2395990561 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f120814a8b0 0x7f120814ad10 secure :-1 s=THROTTLE_DONE pgs=1547 cs=0 l=1 rx=0x7f12080603e0 tx=0x7f12000103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:53.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.676+0000 7f11f6ffd700 1 -- 172.21.15.103:0/2395990561 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f12000072e0 con 0x7f120814a8b0 2020-04-22T14:15:53.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.676+0000 7f120e65a700 1 --2- 172.21.15.103:0/2395990561 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f120814a8b0 0x7f120814ad10 secure :-1 s=THROTTLE_DONE pgs=1547 cs=0 l=1 rx=0x7f12080603e0 tx=0x7f12000103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:53.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.676+0000 7f12100bd700 1 -- 172.21.15.103:0/2395990561 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12080aef30 con 0x7f120814a8b0 2020-04-22T14:15:53.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.676+0000 7f11f6ffd700 1 --2- 172.21.15.103:0/2395990561 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f11e804da00 0x7f11e804fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:53.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.676+0000 7f11f6ffd700 1 -- 172.21.15.103:0/2395990561 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f1200061360 con 0x7f120814a8b0 2020-04-22T14:15:53.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.677+0000 7f120de59700 1 --2- 172.21.15.103:0/2395990561 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f11e804da00 0x7f11e804fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:53.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.677+0000 7f120de59700 1 --2- 172.21.15.103:0/2395990561 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f11e804da00 0x7f11e804fec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f11f80013e0 tx=0x7f120805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:53.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.677+0000 7f120de59700 1 --2- 172.21.15.103:0/2395990561 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f11e804da00 0x7f11e804fec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f11f80013e0 tx=0x7f120805bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:53.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.677+0000 7f120de59700 1 --2- 172.21.15.103:0/2395990561 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f11e804da00 0x7f11e804fec0 secure :-1 s=READY pgs=563 cs=0 l=1 rx=0x7f11f80013e0 tx=0x7f120805bce0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:53.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.680+0000 7f120e65a700 1 --2- 172.21.15.103:0/2395990561 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f120814a8b0 0x7f120814ad10 secure :-1 s=THROTTLE_DONE pgs=1547 cs=0 l=1 rx=0x7f12080603e0 tx=0x7f12000103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:53.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.680+0000 7f11f6ffd700 1 -- 172.21.15.103:0/2395990561 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f120003c800 con 0x7f120814a8b0 2020-04-22T14:15:53.838 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:15:53.855 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:15:53.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:53.874+0000 7f12100bd700 1 -- 172.21.15.103:0/2395990561 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_filelock"]} v 0) v1 -- 0x7f1208056c90 con 0x7f120814a8b0 2020-04-22T14:15:53.909 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:53.923 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:15:54.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.500+0000 7f120e65a700 1 --2- 172.21.15.103:0/2395990561 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f120814a8b0 0x7f120814ad10 secure :-1 s=THROTTLE_DONE pgs=1547 cs=0 l=1 rx=0x7f12080603e0 tx=0x7f12000103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:54.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.500+0000 7f11f6ffd700 1 -- 172.21.15.103:0/2395990561 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_filelock"]}]=0 v574) v1 ==== 148+0+0 (secure 0 0 0) 0x7f1200015120 con 0x7f120814a8b0 2020-04-22T14:15:54.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.502+0000 7f12100bd700 1 -- 172.21.15.103:0/2395990561 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f11e804da00 msgr2=0x7f11e804fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:54.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.502+0000 7f12100bd700 1 --2- 172.21.15.103:0/2395990561 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f11e804da00 0x7f11e804fec0 secure :-1 s=READY pgs=563 cs=0 l=1 rx=0x7f11f80013e0 tx=0x7f120805bce0).stop 2020-04-22T14:15:54.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.502+0000 7f12100bd700 1 -- 172.21.15.103:0/2395990561 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f120814a8b0 msgr2=0x7f120814ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:54.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.502+0000 7f12100bd700 1 --2- 172.21.15.103:0/2395990561 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f120814a8b0 0x7f120814ad10 secure :-1 s=READY pgs=1547 cs=0 l=1 rx=0x7f12080603e0 tx=0x7f12000103a0).stop 2020-04-22T14:15:54.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.502+0000 7f12100bd700 1 -- 172.21.15.103:0/2395990561 shutdown_connections 2020-04-22T14:15:54.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.502+0000 7f12100bd700 1 --2- 172.21.15.103:0/2395990561 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f11e804da00 0x7f11e804fec0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:54.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.502+0000 7f12100bd700 1 --2- 172.21.15.103:0/2395990561 >> v2:172.21.15.86:3300/0 conn(0x7f1208149590 0x7f120812b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:54.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.502+0000 7f12100bd700 1 --2- 172.21.15.103:0/2395990561 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f120814a8b0 0x7f120814ad10 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:54.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.502+0000 7f12100bd700 1 --2- 172.21.15.103:0/2395990561 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f120812aae0 0x7f1208149970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:54.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.502+0000 7f12100bd700 1 -- 172.21.15.103:0/2395990561 >> 172.21.15.103:0/2395990561 conn(0x7f12080b9160 msgr2=0x7f12080615e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:54.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.502+0000 7f12100bd700 1 -- 172.21.15.103:0/2395990561 shutdown_connections 2020-04-22T14:15:54.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.502+0000 7f12100bd700 1 -- 172.21.15.103:0/2395990561 wait complete. 2020-04-22T14:15:54.516 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-04-22T14:15:54.516 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:15:54.547 INFO:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:15:54.648 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:54.671 INFO:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:15:54.763 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-04-22T14:15:54.763 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:54.778 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2020-04-22T14:15:54.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.925+0000 7f56f2e54700 1 Processor -- start 2020-04-22T14:15:54.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.925+0000 7f56f2e54700 1 -- start start 2020-04-22T14:15:54.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.925+0000 7f56f2e54700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f56ec0b7660 0x7f56ec148070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:54.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.925+0000 7f56f2e54700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f56ec1412b0 0x7f56ec141740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:54.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.925+0000 7f56f2e54700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56ec064510 con 0x7f56ec0666c0 2020-04-22T14:15:54.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.925+0000 7f56f2e54700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56ec144090 con 0x7f56ec1412b0 2020-04-22T14:15:54.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.925+0000 7f56f2e54700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56ec144280 con 0x7f56ec0b7660 2020-04-22T14:15:54.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.925+0000 7f56f13f1700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f56ec1412b0 0x7f56ec141740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:54.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.925+0000 7f56ebfff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f56ec0666c0 0x7f56ec1449c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47722/0 (socket says 172.21.15.103:47722) 2020-04-22T14:15:54.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.925+0000 7f56ebfff700 1 -- 172.21.15.103:0/2347912673 learned_addr learned my addr 172.21.15.103:0/2347912673 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:54.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.926+0000 7f56f0bf0700 1 --2- 172.21.15.103:0/2347912673 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f56ec0b7660 0x7f56ec148070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:54.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.926+0000 7f56f13f1700 1 -- 172.21.15.103:0/2347912673 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f56ec0b7660 msgr2=0x7f56ec148070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:54.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.926+0000 7f56f13f1700 1 --2- 172.21.15.103:0/2347912673 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f56ec0b7660 0x7f56ec148070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:54.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.926+0000 7f56eb7fe700 1 -- 172.21.15.103:0/2347912673 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2138392387 0 0) 0x7f56ec064510 con 0x7f56ec0666c0 2020-04-22T14:15:54.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.926+0000 7f56f13f1700 1 -- 172.21.15.103:0/2347912673 >> v1:172.21.15.103:6789/0 conn(0x7f56ec0666c0 legacy=0x7f56ec1449c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:54.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.926+0000 7f56f13f1700 1 -- 172.21.15.103:0/2347912673 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56ec144520 con 0x7f56ec1412b0 2020-04-22T14:15:54.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.926+0000 7f56f13f1700 1 --2- 172.21.15.103:0/2347912673 >> v2:172.21.15.103:3300/0 conn(0x7f56ec1412b0 0x7f56ec141740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f56e40032b0 tx=0x7f56e4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:54.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.926+0000 7f56f13f1700 1 --2- 172.21.15.103:0/2347912673 >> v2:172.21.15.103:3300/0 conn(0x7f56ec1412b0 0x7f56ec141740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f56e40032b0 tx=0x7f56e4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:54.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.926+0000 7f56f13f1700 1 --2- 172.21.15.103:0/2347912673 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56ec1412b0 0x7f56ec141740 secure :-1 s=READY pgs=1549 cs=0 l=1 rx=0x7f56e40032b0 tx=0x7f56e4007dc0).ready entity=mon.1 client_cookie=27c6b448adb1e28e server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:54.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.926+0000 7f56f13f1700 1 --2- 172.21.15.103:0/2347912673 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56ec1412b0 0x7f56ec141740 secure :-1 s=THROTTLE_DONE pgs=1549 cs=0 l=1 rx=0x7f56e40032b0 tx=0x7f56e4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:54.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.926+0000 7f56eb7fe700 1 -- 172.21.15.103:0/2347912673 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56e400a180 con 0x7f56ec1412b0 2020-04-22T14:15:54.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.926+0000 7f56f13f1700 1 --2- 172.21.15.103:0/2347912673 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56ec1412b0 0x7f56ec141740 secure :-1 s=THROTTLE_DONE pgs=1549 cs=0 l=1 rx=0x7f56e40032b0 tx=0x7f56e4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:54.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.926+0000 7f56f13f1700 1 --2- 172.21.15.103:0/2347912673 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56ec1412b0 0x7f56ec141740 secure :-1 s=THROTTLE_DONE pgs=1549 cs=0 l=1 rx=0x7f56e40032b0 tx=0x7f56e4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:54.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.926+0000 7f56eb7fe700 1 -- 172.21.15.103:0/2347912673 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e400a320 con 0x7f56ec1412b0 2020-04-22T14:15:54.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.926+0000 7f56eb7fe700 1 -- 172.21.15.103:0/2347912673 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56e400a700 con 0x7f56ec1412b0 2020-04-22T14:15:54.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.926+0000 7f56f2e54700 1 -- 172.21.15.103:0/2347912673 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56ec1412b0 msgr2=0x7f56ec141740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:54.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.926+0000 7f56f2e54700 1 --2- 172.21.15.103:0/2347912673 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56ec1412b0 0x7f56ec141740 secure :-1 s=READY pgs=1549 cs=0 l=1 rx=0x7f56e40032b0 tx=0x7f56e4007dc0).stop 2020-04-22T14:15:54.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.927+0000 7f56f2e54700 1 -- 172.21.15.103:0/2347912673 shutdown_connections 2020-04-22T14:15:54.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.927+0000 7f56f2e54700 1 --2- 172.21.15.103:0/2347912673 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56ec1412b0 0x7f56ec141740 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:54.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.927+0000 7f56f2e54700 1 --2- 172.21.15.103:0/2347912673 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f56ec0b7660 0x7f56ec148070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:54.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.927+0000 7f56f2e54700 1 -- 172.21.15.103:0/2347912673 >> 172.21.15.103:0/2347912673 conn(0x7f56ec05f2c0 msgr2=0x7f56ec061fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:54.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.927+0000 7f56f2e54700 1 -- 172.21.15.103:0/2347912673 shutdown_connections 2020-04-22T14:15:54.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.927+0000 7f56f2e54700 1 -- 172.21.15.103:0/2347912673 wait complete. 2020-04-22T14:15:54.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.928+0000 7f56f2e54700 1 Processor -- start 2020-04-22T14:15:54.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.928+0000 7f56f2e54700 1 -- start start 2020-04-22T14:15:54.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.928+0000 7f56f2e54700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f56ec1412b0 0x7f56ec1436c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:54.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.928+0000 7f56f2e54700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56ec0b2740 con 0x7f56ec0666c0 2020-04-22T14:15:54.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.928+0000 7f56f2e54700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56ec0b29e0 con 0x7f56ec0b7660 2020-04-22T14:15:54.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.928+0000 7f56f2e54700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56ec12c650 con 0x7f56ec1412b0 2020-04-22T14:15:54.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.929+0000 7f56ebfff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f56ec0b7660 0x7f56ec0ad070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47728/0 (socket says 172.21.15.103:47728) 2020-04-22T14:15:54.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.929+0000 7f56ebfff700 1 -- 172.21.15.103:0/325471471 learned_addr learned my addr 172.21.15.103:0/325471471 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:54.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.929+0000 7f56f13f1700 1 --2- 172.21.15.103:0/325471471 >> v2:172.21.15.86:3300/0 conn(0x7f56ec1412b0 0x7f56ec1436c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:54.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.929+0000 7f56e9ffb700 1 -- 172.21.15.103:0/325471471 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3866261015 0 0) 0x7f56ec0b29e0 con 0x7f56ec0b7660 2020-04-22T14:15:54.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.929+0000 7f56e9ffb700 1 -- 172.21.15.103:0/325471471 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56cc002fe0 con 0x7f56ec0b7660 2020-04-22T14:15:54.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.929+0000 7f56e9ffb700 1 -- 172.21.15.103:0/325471471 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1908869324 0 0) 0x7f56cc002fe0 con 0x7f56ec0b7660 2020-04-22T14:15:54.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.929+0000 7f56e9ffb700 1 -- 172.21.15.103:0/325471471 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f56ec0b29e0 con 0x7f56ec0b7660 2020-04-22T14:15:54.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.929+0000 7f56e9ffb700 1 -- 172.21.15.103:0/325471471 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f56e00018a0 con 0x7f56ec0b7660 2020-04-22T14:15:54.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.929+0000 7f56e9ffb700 1 -- 172.21.15.103:0/325471471 >> v2:172.21.15.86:3300/0 conn(0x7f56ec1412b0 msgr2=0x7f56ec1436c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:54.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.929+0000 7f56e9ffb700 1 --2- 172.21.15.103:0/325471471 >> v2:172.21.15.86:3300/0 conn(0x7f56ec1412b0 0x7f56ec1436c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:54.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.929+0000 7f56e9ffb700 1 -- 172.21.15.103:0/325471471 >> v1:172.21.15.103:6789/0 conn(0x7f56ec0b7660 legacy=0x7f56ec0ad070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:54.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.929+0000 7f56e9ffb700 1 -- 172.21.15.103:0/325471471 >> v1:172.21.15.86:6789/0 conn(0x7f56ec0666c0 legacy=0x7f56ec12bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:54.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.929+0000 7f56e9ffb700 1 --2- 172.21.15.103:0/325471471 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56cc004910 0x7f56cc004d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:54.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.929+0000 7f56e9ffb700 1 --2- 172.21.15.103:0/325471471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56cc0052a0 0x7f56cc003900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:54.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.929+0000 7f56e9ffb700 1 --2- 172.21.15.103:0/325471471 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f56cc003f00 0x7f56cc004380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:54.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.929+0000 7f56e9ffb700 1 -- 172.21.15.103:0/325471471 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ec12c650 con 0x7f56cc0052a0 2020-04-22T14:15:54.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.929+0000 7f56e9ffb700 1 -- 172.21.15.103:0/325471471 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc00b910 con 0x7f56cc004910 2020-04-22T14:15:54.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.929+0000 7f56e9ffb700 1 -- 172.21.15.103:0/325471471 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc00bad0 con 0x7f56cc003f00 2020-04-22T14:15:54.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.929+0000 7f56ebfff700 1 --2- 172.21.15.103:0/325471471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56cc0052a0 0x7f56cc003900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:54.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.929+0000 7f56f0bf0700 1 --2- 172.21.15.103:0/325471471 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56cc004910 0x7f56cc004d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:54.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.929+0000 7f56f13f1700 1 --2- 172.21.15.103:0/325471471 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f56cc003f00 0x7f56cc004380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:54.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.930+0000 7f56ebfff700 1 -- 172.21.15.103:0/325471471 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f56cc003f00 msgr2=0x7f56cc004380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:54.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.930+0000 7f56ebfff700 1 --2- 172.21.15.103:0/325471471 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f56cc003f00 0x7f56cc004380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:54.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.930+0000 7f56ebfff700 1 -- 172.21.15.103:0/325471471 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56cc004910 msgr2=0x7f56cc004d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:54.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.930+0000 7f56ebfff700 1 --2- 172.21.15.103:0/325471471 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56cc004910 0x7f56cc004d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:54.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.930+0000 7f56f13f1700 1 -- 172.21.15.103:0/325471471 reap_dead start 2020-04-22T14:15:54.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.930+0000 7f56ebfff700 1 -- 172.21.15.103:0/325471471 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56ec12c790 con 0x7f56cc0052a0 2020-04-22T14:15:54.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.930+0000 7f56f2e54700 1 -- 172.21.15.103:0/325471471 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56ec0b3a00 con 0x7f56cc0052a0 2020-04-22T14:15:54.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.930+0000 7f56f0bf0700 1 --2- 172.21.15.103:0/325471471 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56cc004910 0x7f56cc004d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:15:54.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.930+0000 7f56ebfff700 1 --2- 172.21.15.103:0/325471471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56cc0052a0 0x7f56cc003900 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f56e0001100 tx=0x7f56e0011470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:54.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.930+0000 7f56f2e54700 1 -- 172.21.15.103:0/325471471 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56ec0b24b0 con 0x7f56cc0052a0 2020-04-22T14:15:54.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.930+0000 7f56ebfff700 1 --2- 172.21.15.103:0/325471471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56cc0052a0 0x7f56cc003900 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f56e0001100 tx=0x7f56e0011470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:54.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.930+0000 7f56ebfff700 1 --2- 172.21.15.103:0/325471471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56cc0052a0 0x7f56cc003900 secure :-1 s=READY pgs=823 cs=0 l=1 rx=0x7f56e0001100 tx=0x7f56e0011470).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:54.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.930+0000 7f56ebfff700 1 --2- 172.21.15.103:0/325471471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56cc0052a0 0x7f56cc003900 secure :-1 s=THROTTLE_DONE pgs=823 cs=0 l=1 rx=0x7f56e0001100 tx=0x7f56e0011470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:54.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.930+0000 7f56e9ffb700 1 -- 172.21.15.103:0/325471471 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56e0011dd0 con 0x7f56cc0052a0 2020-04-22T14:15:54.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.930+0000 7f56ebfff700 1 --2- 172.21.15.103:0/325471471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56cc0052a0 0x7f56cc003900 secure :-1 s=THROTTLE_DONE pgs=823 cs=0 l=1 rx=0x7f56e0001100 tx=0x7f56e0011470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:54.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.930+0000 7f56e9ffb700 1 -- 172.21.15.103:0/325471471 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e000b080 con 0x7f56cc0052a0 2020-04-22T14:15:54.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.930+0000 7f56ebfff700 1 --2- 172.21.15.103:0/325471471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56cc0052a0 0x7f56cc003900 secure :-1 s=THROTTLE_DONE pgs=823 cs=0 l=1 rx=0x7f56e0001100 tx=0x7f56e0011470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:54.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.930+0000 7f56e9ffb700 1 -- 172.21.15.103:0/325471471 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56e000b460 con 0x7f56cc0052a0 2020-04-22T14:15:54.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.930+0000 7f56f2e54700 1 -- 172.21.15.103:0/325471471 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56c8003340 con 0x7f56cc0052a0 2020-04-22T14:15:54.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.931+0000 7f56ebfff700 1 --2- 172.21.15.103:0/325471471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56cc0052a0 0x7f56cc003900 secure :-1 s=THROTTLE_DONE pgs=823 cs=0 l=1 rx=0x7f56e0001100 tx=0x7f56e0011470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:54.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.931+0000 7f56e9ffb700 1 -- 172.21.15.103:0/325471471 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f56e000a690 con 0x7f56cc0052a0 2020-04-22T14:15:54.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.931+0000 7f56ebfff700 1 --2- 172.21.15.103:0/325471471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56cc0052a0 0x7f56cc003900 secure :-1 s=THROTTLE_DONE pgs=823 cs=0 l=1 rx=0x7f56e0001100 tx=0x7f56e0011470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:54.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.931+0000 7f56e9ffb700 1 --2- 172.21.15.103:0/325471471 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f56cc0518b0 0x7f56cc053d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:54.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.931+0000 7f56e9ffb700 1 -- 172.21.15.103:0/325471471 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f56e0061690 con 0x7f56cc0052a0 2020-04-22T14:15:54.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.931+0000 7f56f0bf0700 1 --2- 172.21.15.103:0/325471471 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f56cc0518b0 0x7f56cc053d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:54.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.932+0000 7f56f0bf0700 1 --2- 172.21.15.103:0/325471471 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f56cc0518b0 0x7f56cc053d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f56ec143480 tx=0x7f56dc002c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:54.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.932+0000 7f56f0bf0700 1 --2- 172.21.15.103:0/325471471 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f56cc0518b0 0x7f56cc053d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f56ec143480 tx=0x7f56dc002c40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:54.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.932+0000 7f56f0bf0700 1 --2- 172.21.15.103:0/325471471 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f56cc0518b0 0x7f56cc053d70 secure :-1 s=READY pgs=564 cs=0 l=1 rx=0x7f56ec143480 tx=0x7f56dc002c40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:54.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.934+0000 7f56ebfff700 1 --2- 172.21.15.103:0/325471471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56cc0052a0 0x7f56cc003900 secure :-1 s=THROTTLE_DONE pgs=823 cs=0 l=1 rx=0x7f56e0001100 tx=0x7f56e0011470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:54.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:54.934+0000 7f56e9ffb700 1 -- 172.21.15.103:0/325471471 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f56e003ca90 con 0x7f56cc0052a0 2020-04-22T14:15:55.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.075+0000 7f56f2e54700 1 -- 172.21.15.103:0/325471471 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f56c80021d0 con 0x7f56cc0052a0 2020-04-22T14:15:55.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.077+0000 7f56ebfff700 1 --2- 172.21.15.103:0/325471471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56cc0052a0 0x7f56cc003900 secure :-1 s=THROTTLE_DONE pgs=823 cs=0 l=1 rx=0x7f56e0001100 tx=0x7f56e0011470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:55.080 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.077+0000 7f56e9ffb700 1 -- 172.21.15.103:0/325471471 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v103) v1 ==== 81+0+33778 (secure 0 0 0) 0x7f56e00400b0 con 0x7f56cc0052a0 2020-04-22T14:15:55.081 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:15:55.081 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:15:55.081 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 103, 2020-04-22T14:15:55.081 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:15:55.081 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2020-04-22T14:02:06.484738+0000", 2020-04-22T14:15:55.081 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2020-04-22T14:15:42.467272+0000", 2020-04-22T14:15:55.081 INFO:teuthology.orchestra.run.smithi103.stdout: "last_up_change": "2020-04-22T14:02:18.623774+0000", 2020-04-22T14:15:55.082 INFO:teuthology.orchestra.run.smithi103.stdout: "last_in_change": "2020-04-22T14:02:18.623774+0000", 2020-04-22T14:15:55.082 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-04-22T14:15:55.082 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_num": 5799936, 2020-04-22T14:15:55.082 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_set": [ 2020-04-22T14:15:55.082 INFO:teuthology.orchestra.run.smithi103.stdout: "pglog_hardlimit", 2020-04-22T14:15:55.082 INFO:teuthology.orchestra.run.smithi103.stdout: "purged_snapdirs", 2020-04-22T14:15:55.082 INFO:teuthology.orchestra.run.smithi103.stdout: "recovery_deletes", 2020-04-22T14:15:55.083 INFO:teuthology.orchestra.run.smithi103.stdout: "sortbitwise" 2020-04-22T14:15:55.083 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:15:55.083 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_version": 5, 2020-04-22T14:15:55.083 INFO:teuthology.orchestra.run.smithi103.stdout: "full_ratio": 0.94999998807907104, 2020-04-22T14:15:55.083 INFO:teuthology.orchestra.run.smithi103.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-04-22T14:15:55.083 INFO:teuthology.orchestra.run.smithi103.stdout: "nearfull_ratio": 0.85000002384185791, 2020-04-22T14:15:55.083 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_snapshot": "", 2020-04-22T14:15:55.084 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_max": 18, 2020-04-22T14:15:55.084 INFO:teuthology.orchestra.run.smithi103.stdout: "max_osd": 8, 2020-04-22T14:15:55.084 INFO:teuthology.orchestra.run.smithi103.stdout: "require_min_compat_client": "luminous", 2020-04-22T14:15:55.084 INFO:teuthology.orchestra.run.smithi103.stdout: "min_compat_client": "jewel", 2020-04-22T14:15:55.090 INFO:teuthology.orchestra.run.smithi103.stdout: "require_osd_release": "pacific", 2020-04-22T14:15:55.090 INFO:teuthology.orchestra.run.smithi103.stdout: "pools": [ 2020-04-22T14:15:55.090 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.090 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 1, 2020-04-22T14:15:55.091 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "device_health_metrics", 2020-04-22T14:15:55.091 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:02:09.565655+0000", 2020-04-22T14:15:55.091 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:15:55.091 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:15:55.091 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:15:55.091 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:15:55.091 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:15:55.092 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:15:55.092 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:15:55.092 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:15:55.092 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 1, 2020-04-22T14:15:55.092 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 1, 2020-04-22T14:15:55.092 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 1, 2020-04-22T14:15:55.092 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 1, 2020-04-22T14:15:55.093 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 1, 2020-04-22T14:15:55.093 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:15:55.093 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:15:55.093 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:15:55.093 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:15:55.093 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:15:55.093 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:15:55.094 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:15:55.094 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.094 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "17", 2020-04-22T14:15:55.094 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:15:55.094 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:15:55.094 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:15:55.094 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:15:55.094 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:15:55.095 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:15:55.095 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:15:55.098 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:15:55.098 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:15:55.098 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:15:55.098 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:15:55.098 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:15:55.098 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:15:55.099 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:15:55.099 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:15:55.099 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:15:55.099 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:15:55.099 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:15:55.099 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:15:55.099 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:15:55.100 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:15:55.100 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:15:55.100 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:15:55.100 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:15:55.100 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:15:55.100 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:15:55.100 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.100 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:15:55.101 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:15:55.101 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:15:55.101 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:15:55.101 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:15:55.101 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:15:55.101 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:15:55.101 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:15:55.102 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:15:55.102 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:15:55.102 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:15:55.102 INFO:teuthology.orchestra.run.smithi103.stdout: "options": { 2020-04-22T14:15:55.102 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_min": 1 2020-04-22T14:15:55.102 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.102 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:15:55.103 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_devicehealth": {} 2020-04-22T14:15:55.103 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.103 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.103 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.103 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 2, 2020-04-22T14:15:55.103 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "rbd", 2020-04-22T14:15:55.103 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:02:22.733031+0000", 2020-04-22T14:15:55.103 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:15:55.104 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:15:55.104 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:15:55.104 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:15:55.104 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:15:55.104 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:15:55.104 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:15:55.104 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:15:55.105 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 8, 2020-04-22T14:15:55.105 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 8, 2020-04-22T14:15:55.105 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 8, 2020-04-22T14:15:55.105 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 8, 2020-04-22T14:15:55.105 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 8, 2020-04-22T14:15:55.105 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:15:55.105 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:15:55.106 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:15:55.106 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:15:55.106 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:15:55.107 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:15:55.107 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:15:55.107 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.107 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "20", 2020-04-22T14:15:55.108 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:15:55.108 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:15:55.108 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:15:55.108 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:15:55.108 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:15:55.108 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:15:55.109 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:15:55.109 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:15:55.109 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:15:55.109 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:15:55.109 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:15:55.109 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:15:55.109 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:15:55.109 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:15:55.110 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:15:55.110 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:15:55.110 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:15:55.110 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:15:55.110 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:15:55.110 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:15:55.110 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:15:55.111 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:15:55.111 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:15:55.111 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:15:55.111 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:15:55.111 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:15:55.111 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.111 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:15:55.111 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:15:55.112 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:15:55.112 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:15:55.112 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:15:55.112 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:15:55.112 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:15:55.112 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:15:55.112 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:15:55.113 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:15:55.113 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:15:55.113 INFO:teuthology.orchestra.run.smithi103.stdout: "options": {}, 2020-04-22T14:15:55.113 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:15:55.113 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd": {} 2020-04-22T14:15:55.114 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.114 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.114 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.114 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 17, 2020-04-22T14:15:55.114 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "cephfs_metadata", 2020-04-22T14:15:55.114 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:15:10.023228+0000", 2020-04-22T14:15:55.114 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:15:55.114 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:15:55.115 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:15:55.115 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:15:55.115 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:15:55.115 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:15:55.115 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:15:55.115 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:15:55.115 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 8, 2020-04-22T14:15:55.116 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 8, 2020-04-22T14:15:55.116 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 8, 2020-04-22T14:15:55.116 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 8, 2020-04-22T14:15:55.116 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 8, 2020-04-22T14:15:55.116 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:15:55.116 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:15:55.116 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:15:55.117 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:15:55.117 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:15:55.117 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:15:55.117 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:15:55.117 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.117 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "100", 2020-04-22T14:15:55.117 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:15:55.118 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:15:55.118 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:15:55.118 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:15:55.119 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:15:55.119 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:15:55.119 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:15:55.119 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:15:55.119 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:15:55.119 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:15:55.120 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:15:55.120 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:15:55.120 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:15:55.120 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:15:55.120 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:15:55.121 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:15:55.121 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:15:55.121 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:15:55.121 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:15:55.121 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:15:55.121 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:15:55.121 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:15:55.122 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:15:55.122 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:15:55.122 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:15:55.122 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:15:55.122 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.122 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:15:55.122 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:15:55.122 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:15:55.123 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:15:55.123 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:15:55.123 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:15:55.123 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:15:55.123 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:15:55.123 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:15:55.123 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:15:55.124 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:15:55.124 INFO:teuthology.orchestra.run.smithi103.stdout: "options": { 2020-04-22T14:15:55.124 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_bias": 4, 2020-04-22T14:15:55.124 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_min": 16, 2020-04-22T14:15:55.124 INFO:teuthology.orchestra.run.smithi103.stdout: "recovery_priority": 5 2020-04-22T14:15:55.124 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.124 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:15:55.124 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs": { 2020-04-22T14:15:55.125 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": "cephfs" 2020-04-22T14:15:55.125 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.125 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.125 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.125 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.125 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 18, 2020-04-22T14:15:55.125 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "cephfs_data", 2020-04-22T14:15:55.126 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:15:11.048528+0000", 2020-04-22T14:15:55.126 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:15:55.126 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:15:55.126 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:15:55.126 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:15:55.126 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:15:55.126 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:15:55.126 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:15:55.127 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:15:55.127 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 8, 2020-04-22T14:15:55.127 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 8, 2020-04-22T14:15:55.127 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 8, 2020-04-22T14:15:55.127 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 8, 2020-04-22T14:15:55.127 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 8, 2020-04-22T14:15:55.127 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:15:55.127 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:15:55.128 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:15:55.128 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:15:55.128 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:15:55.128 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:15:55.129 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:15:55.130 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.130 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "102", 2020-04-22T14:15:55.130 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:15:55.130 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:15:55.130 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:15:55.131 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:15:55.131 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:15:55.131 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:15:55.131 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:15:55.131 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:15:55.131 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:15:55.132 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:15:55.132 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:15:55.136 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:15:55.136 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:15:55.137 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:15:55.137 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:15:55.137 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:15:55.137 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:15:55.137 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:15:55.137 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:15:55.137 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:15:55.138 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:15:55.138 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:15:55.138 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:15:55.138 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:15:55.138 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:15:55.138 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:15:55.138 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.139 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:15:55.139 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:15:55.139 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:15:55.139 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:15:55.139 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:15:55.139 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:15:55.139 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:15:55.139 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:15:55.140 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:15:55.140 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:15:55.140 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:15:55.140 INFO:teuthology.orchestra.run.smithi103.stdout: "options": {}, 2020-04-22T14:15:55.140 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:15:55.140 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs": { 2020-04-22T14:15:55.140 INFO:teuthology.orchestra.run.smithi103.stdout: "data": "cephfs" 2020-04-22T14:15:55.141 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.141 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.141 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.141 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:15:55.141 INFO:teuthology.orchestra.run.smithi103.stdout: "osds": [ 2020-04-22T14:15:55.141 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.141 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 0, 2020-04-22T14:15:55.142 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "3546145b-bd93-4a79-b6fe-3158153b8f05", 2020-04-22T14:15:55.142 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:15:55.142 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:15:55.142 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:15:55.142 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:15:55.142 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:15:55.142 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:15:55.142 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:15:55.143 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 99, 2020-04-22T14:15:55.143 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:15:55.143 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:15:55.143 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:15:55.143 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:55.143 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.143 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:55.144 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6800", 2020-04-22T14:15:55.144 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:15:55.144 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.144 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.144 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:55.144 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6801", 2020-04-22T14:15:55.144 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:15:55.144 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.145 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:55.145 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.145 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:15:55.145 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:55.145 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.145 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:55.145 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6802", 2020-04-22T14:15:55.146 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:15:55.146 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.146 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.146 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:55.146 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6803", 2020-04-22T14:15:55.146 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:15:55.146 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.146 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:55.147 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.147 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:15:55.147 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:55.147 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.147 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:55.147 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6806", 2020-04-22T14:15:55.147 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:15:55.148 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.148 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.148 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:55.148 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6807", 2020-04-22T14:15:55.148 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:15:55.148 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.148 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:55.148 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.149 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:15:55.149 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:55.149 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.149 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:55.149 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6804", 2020-04-22T14:15:55.149 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:15:55.149 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.150 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.150 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:55.150 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6805", 2020-04-22T14:15:55.150 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:15:55.150 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.150 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:55.150 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.150 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6801/33072", 2020-04-22T14:15:55.151 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6803/33072", 2020-04-22T14:15:55.151 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6807/33072", 2020-04-22T14:15:55.151 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6805/33072", 2020-04-22T14:15:55.151 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:15:55.151 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:15:55.151 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:15:55.151 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:55.152 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.152 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.152 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 1, 2020-04-22T14:15:55.152 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "65ca5f7d-2ea6-4de6-a034-08a0a99aa80d", 2020-04-22T14:15:55.152 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:15:55.152 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:15:55.152 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:15:55.152 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:15:55.153 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:15:55.153 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:15:55.153 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:15:55.153 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 99, 2020-04-22T14:15:55.153 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:15:55.153 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:15:55.153 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:15:55.154 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:55.154 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.154 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:55.154 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6808", 2020-04-22T14:15:55.154 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:15:55.154 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.154 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.154 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:55.155 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6809", 2020-04-22T14:15:55.155 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:15:55.155 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.155 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:55.155 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.155 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:15:55.155 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:55.156 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.156 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:55.156 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6810", 2020-04-22T14:15:55.156 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:15:55.156 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.156 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.156 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:55.156 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6811", 2020-04-22T14:15:55.157 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:15:55.157 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.157 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:55.157 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.157 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:15:55.157 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:55.157 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.158 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:55.158 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6814", 2020-04-22T14:15:55.158 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:15:55.158 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.158 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.158 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:55.158 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6815", 2020-04-22T14:15:55.158 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:15:55.159 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.159 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:55.159 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.159 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:15:55.159 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:55.159 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.159 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:55.160 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6812", 2020-04-22T14:15:55.160 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:15:55.160 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.160 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.160 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:55.160 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6813", 2020-04-22T14:15:55.160 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:15:55.160 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.161 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:55.161 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.161 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6809/33103", 2020-04-22T14:15:55.161 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6811/33103", 2020-04-22T14:15:55.161 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6815/33103", 2020-04-22T14:15:55.161 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6813/33103", 2020-04-22T14:15:55.161 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:15:55.162 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:15:55.162 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:15:55.162 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:55.162 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.162 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.162 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 2, 2020-04-22T14:15:55.162 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "f2e9bf44-c844-48d7-b6c2-f08ea71189b4", 2020-04-22T14:15:55.162 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:15:55.163 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:15:55.163 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:15:55.163 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:15:55.163 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:15:55.163 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:15:55.163 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:15:55.163 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 100, 2020-04-22T14:15:55.164 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:15:55.164 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:15:55.164 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:15:55.164 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:55.164 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.164 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:55.164 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6816", 2020-04-22T14:15:55.164 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:15:55.165 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.165 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.165 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:55.165 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6817", 2020-04-22T14:15:55.165 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:15:55.165 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.165 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:55.166 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.166 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:15:55.166 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:55.166 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.166 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:55.166 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6818", 2020-04-22T14:15:55.166 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:15:55.166 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.167 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.167 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:55.167 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6819", 2020-04-22T14:15:55.167 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:15:55.167 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.167 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:55.167 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.168 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:15:55.168 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:55.168 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.168 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:55.168 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6822", 2020-04-22T14:15:55.168 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:15:55.168 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.169 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.169 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:55.169 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6823", 2020-04-22T14:15:55.169 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:15:55.169 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.169 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:55.169 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.169 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:15:55.170 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:55.170 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.170 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:55.170 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6820", 2020-04-22T14:15:55.170 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:15:55.170 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.170 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.171 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:55.171 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6821", 2020-04-22T14:15:55.171 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:15:55.171 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.171 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:55.171 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.171 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6817/33153", 2020-04-22T14:15:55.171 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6819/33153", 2020-04-22T14:15:55.172 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6823/33153", 2020-04-22T14:15:55.172 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6821/33153", 2020-04-22T14:15:55.172 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:15:55.172 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:15:55.172 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:15:55.172 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:55.172 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.173 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.173 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 3, 2020-04-22T14:15:55.173 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "0ab87fee-a427-4906-851a-b9bd8c2e5645", 2020-04-22T14:15:55.173 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:15:55.173 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:15:55.173 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:15:55.173 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:15:55.173 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:15:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:15:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:15:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 99, 2020-04-22T14:15:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:15:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:15:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:15:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6824", 2020-04-22T14:15:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:15:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6825", 2020-04-22T14:15:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:15:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:15:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6826", 2020-04-22T14:15:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:15:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6827", 2020-04-22T14:15:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:15:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:15:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6830", 2020-04-22T14:15:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:15:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6831", 2020-04-22T14:15:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:15:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:15:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6828", 2020-04-22T14:15:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:15:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6829", 2020-04-22T14:15:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:15:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6825/33183", 2020-04-22T14:15:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6827/33183", 2020-04-22T14:15:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6831/33183", 2020-04-22T14:15:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6829/33183", 2020-04-22T14:15:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:15:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:15:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:15:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 4, 2020-04-22T14:15:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "2565df7d-2eff-484b-a3cd-ed7715e5d875", 2020-04-22T14:15:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:15:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:15:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:15:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:15:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:15:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:15:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:15:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 97, 2020-04-22T14:15:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:15:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:15:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:15:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6802", 2020-04-22T14:15:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:15:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6803", 2020-04-22T14:15:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:15:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:15:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6804", 2020-04-22T14:15:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:15:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6805", 2020-04-22T14:15:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:15:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:15:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6808", 2020-04-22T14:15:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:15:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6809", 2020-04-22T14:15:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:15:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:15:55.191 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:55.191 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.191 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:55.191 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6806", 2020-04-22T14:15:55.191 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:15:55.191 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.191 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.191 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:55.192 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6807", 2020-04-22T14:15:55.192 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:15:55.192 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.192 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:55.192 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.192 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6803/33506", 2020-04-22T14:15:55.192 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6805/33506", 2020-04-22T14:15:55.193 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6809/33506", 2020-04-22T14:15:55.193 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6807/33506", 2020-04-22T14:15:55.193 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:15:55.193 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:15:55.193 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:15:55.193 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:55.193 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.193 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.194 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 5, 2020-04-22T14:15:55.194 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "bcfd7a16-6914-4152-8647-a481917fe19d", 2020-04-22T14:15:55.194 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:15:55.194 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:15:55.194 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:15:55.194 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:15:55.194 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:15:55.195 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:15:55.195 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:15:55.195 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 88, 2020-04-22T14:15:55.195 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:15:55.195 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:15:55.195 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:15:55.195 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:55.195 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.196 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:55.196 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6810", 2020-04-22T14:15:55.196 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:15:55.196 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.196 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.196 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:55.196 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6811", 2020-04-22T14:15:55.197 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:15:55.197 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.197 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:55.197 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.197 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:15:55.197 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:55.197 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.197 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:55.198 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6812", 2020-04-22T14:15:55.198 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:15:55.198 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.198 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.198 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:55.198 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6813", 2020-04-22T14:15:55.198 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:15:55.199 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.199 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:55.199 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.199 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:15:55.199 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:55.199 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.199 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:55.199 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6816", 2020-04-22T14:15:55.200 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:15:55.200 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.200 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.200 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:55.200 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6817", 2020-04-22T14:15:55.200 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:15:55.200 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.201 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:55.201 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.201 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:15:55.201 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:55.201 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.201 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:55.201 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6814", 2020-04-22T14:15:55.202 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:15:55.202 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.202 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.202 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:55.202 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6815", 2020-04-22T14:15:55.202 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:15:55.202 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.202 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:55.203 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.203 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6811/33554", 2020-04-22T14:15:55.203 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6813/33554", 2020-04-22T14:15:55.203 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6817/33554", 2020-04-22T14:15:55.203 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6815/33554", 2020-04-22T14:15:55.203 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:15:55.203 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:15:55.204 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:15:55.204 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:55.204 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.204 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.204 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 6, 2020-04-22T14:15:55.204 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050", 2020-04-22T14:15:55.204 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:15:55.205 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:15:55.205 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:15:55.205 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:15:55.205 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:15:55.205 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:15:55.205 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:15:55.205 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 97, 2020-04-22T14:15:55.205 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:15:55.206 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:15:55.206 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:15:55.206 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:55.206 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.206 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:55.206 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6818", 2020-04-22T14:15:55.206 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:15:55.207 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.207 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.207 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:55.207 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6819", 2020-04-22T14:15:55.207 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:15:55.207 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.207 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:55.207 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.208 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:15:55.208 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:55.208 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.208 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:55.208 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6820", 2020-04-22T14:15:55.208 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:15:55.208 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.209 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.209 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:55.209 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6821", 2020-04-22T14:15:55.209 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:15:55.209 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.209 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:55.209 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.209 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:15:55.210 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:55.210 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.210 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:55.210 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6824", 2020-04-22T14:15:55.210 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:15:55.210 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.210 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.211 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:55.211 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6825", 2020-04-22T14:15:55.211 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:15:55.211 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.211 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:55.211 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.211 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:15:55.211 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6822", 2020-04-22T14:15:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:15:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:55.213 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6823", 2020-04-22T14:15:55.213 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:15:55.213 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.213 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:55.213 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.213 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6819/33601", 2020-04-22T14:15:55.213 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6821/33601", 2020-04-22T14:15:55.214 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6825/33601", 2020-04-22T14:15:55.214 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6823/33601", 2020-04-22T14:15:55.214 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:15:55.214 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:15:55.214 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:15:55.214 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:55.214 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.214 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.215 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 7, 2020-04-22T14:15:55.215 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "340eece1-4c39-47cd-b95f-9cfa5dcfe361", 2020-04-22T14:15:55.215 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:15:55.215 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:15:55.215 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:15:55.215 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:15:55.215 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:15:55.216 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:15:55.216 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:15:55.216 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 99, 2020-04-22T14:15:55.216 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:15:55.216 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:15:55.216 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:15:55.216 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:55.217 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.217 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:55.217 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6826", 2020-04-22T14:15:55.217 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:15:55.217 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.217 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.217 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:55.218 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6827", 2020-04-22T14:15:55.218 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:15:55.218 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.218 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:55.218 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.218 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:15:55.218 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:55.218 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.219 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:55.219 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6828", 2020-04-22T14:15:55.219 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:15:55.219 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.219 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.219 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:55.219 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6829", 2020-04-22T14:15:55.219 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:15:55.220 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.220 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:55.220 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.220 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:15:55.220 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:55.220 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.220 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:55.221 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6832", 2020-04-22T14:15:55.221 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:15:55.221 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.221 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.221 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:55.221 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6833", 2020-04-22T14:15:55.221 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:15:55.222 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.222 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:55.222 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.222 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:15:55.222 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:15:55.222 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.222 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:15:55.222 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6830", 2020-04-22T14:15:55.223 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:15:55.223 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.223 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.223 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:15:55.223 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6831", 2020-04-22T14:15:55.223 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:15:55.223 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.224 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:55.224 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.224 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6827/33629", 2020-04-22T14:15:55.224 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6829/33629", 2020-04-22T14:15:55.224 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6833/33629", 2020-04-22T14:15:55.224 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6831/33629", 2020-04-22T14:15:55.224 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:15:55.224 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:15:55.225 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:15:55.225 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:15:55.225 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.225 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:15:55.225 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_xinfo": [ 2020-04-22T14:15:55.225 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.225 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 0, 2020-04-22T14:15:55.226 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:15:55.226 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:15:55.226 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:15:55.226 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:15:55.226 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:15:55.226 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.384360+0000", 2020-04-22T14:15:55.226 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:15:55.226 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.227 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.227 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 1, 2020-04-22T14:15:55.227 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:15:55.227 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:15:55.227 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:15:55.227 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:15:55.227 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:15:55.228 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.503590+0000", 2020-04-22T14:15:55.228 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:15:55.228 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.228 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.228 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 2, 2020-04-22T14:15:55.228 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:15:55.228 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:15:55.228 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:15:55.229 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:15:55.229 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:15:55.229 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.525058+0000", 2020-04-22T14:15:55.229 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:15:55.229 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.229 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.229 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 3, 2020-04-22T14:15:55.230 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:15:55.230 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:15:55.230 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:15:55.230 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:15:55.230 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:15:55.230 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.599729+0000", 2020-04-22T14:15:55.230 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:15:55.230 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.231 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.231 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 4, 2020-04-22T14:15:55.231 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:15:55.231 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:15:55.231 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:15:55.231 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:15:55.231 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:15:55.232 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.600919+0000", 2020-04-22T14:15:55.232 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:15:55.232 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.232 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.232 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 5, 2020-04-22T14:15:55.232 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:15:55.232 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:15:55.232 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:15:55.233 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:15:55.233 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:15:55.233 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.654718+0000", 2020-04-22T14:15:55.233 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:15:55.233 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.233 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.233 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 6, 2020-04-22T14:15:55.234 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:15:55.234 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:15:55.234 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:15:55.234 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:15:55.234 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:15:55.234 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.718342+0000", 2020-04-22T14:15:55.234 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:15:55.234 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.235 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:15:55.235 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 7, 2020-04-22T14:15:55.235 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:15:55.235 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:15:55.235 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:15:55.235 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:15:55.235 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:15:55.236 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.839089+0000", 2020-04-22T14:15:55.236 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:15:55.236 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.236 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:15:55.236 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_upmap": [], 2020-04-22T14:15:55.236 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_upmap_items": [], 2020-04-22T14:15:55.236 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_temp": [], 2020-04-22T14:15:55.236 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_temp": [], 2020-04-22T14:15:55.237 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklist": { 2020-04-22T14:15:55.237 INFO:teuthology.orchestra.run.smithi103.stdout: "192.168.0.1:0/1618592206": "2020-04-22T15:15:41.970566+0000" 2020-04-22T14:15:55.237 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.237 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profiles": { 2020-04-22T14:15:55.237 INFO:teuthology.orchestra.run.smithi103.stdout: "default": { 2020-04-22T14:15:55.237 INFO:teuthology.orchestra.run.smithi103.stdout: "crush-failure-domain": "osd", 2020-04-22T14:15:55.237 INFO:teuthology.orchestra.run.smithi103.stdout: "k": "2", 2020-04-22T14:15:55.238 INFO:teuthology.orchestra.run.smithi103.stdout: "m": "1", 2020-04-22T14:15:55.238 INFO:teuthology.orchestra.run.smithi103.stdout: "plugin": "jerasure", 2020-04-22T14:15:55.238 INFO:teuthology.orchestra.run.smithi103.stdout: "ruleset-failure-domain": "osd", 2020-04-22T14:15:55.238 INFO:teuthology.orchestra.run.smithi103.stdout: "technique": "reed_sol_van" 2020-04-22T14:15:55.238 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:15:55.238 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:15:55.238 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps_queue": [], 2020-04-22T14:15:55.238 INFO:teuthology.orchestra.run.smithi103.stdout: "new_removed_snaps": [], 2020-04-22T14:15:55.239 INFO:teuthology.orchestra.run.smithi103.stdout: "new_purged_snaps": [], 2020-04-22T14:15:55.239 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_node_flags": {}, 2020-04-22T14:15:55.239 INFO:teuthology.orchestra.run.smithi103.stdout: "device_class_flags": {} 2020-04-22T14:15:55.239 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:15:55.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.078+0000 7f56f2e54700 1 -- 172.21.15.103:0/325471471 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f56cc0518b0 msgr2=0x7f56cc053d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:55.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.078+0000 7f56f2e54700 1 --2- 172.21.15.103:0/325471471 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f56cc0518b0 0x7f56cc053d70 secure :-1 s=READY pgs=564 cs=0 l=1 rx=0x7f56ec143480 tx=0x7f56dc002c40).stop 2020-04-22T14:15:55.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.078+0000 7f56f2e54700 1 -- 172.21.15.103:0/325471471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56cc0052a0 msgr2=0x7f56cc003900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:55.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.078+0000 7f56f2e54700 1 --2- 172.21.15.103:0/325471471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56cc0052a0 0x7f56cc003900 secure :-1 s=READY pgs=823 cs=0 l=1 rx=0x7f56e0001100 tx=0x7f56e0011470).stop 2020-04-22T14:15:55.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.078+0000 7f56f2e54700 1 -- 172.21.15.103:0/325471471 shutdown_connections 2020-04-22T14:15:55.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.078+0000 7f56f2e54700 1 --2- 172.21.15.103:0/325471471 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f56cc0518b0 0x7f56cc053d70 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:55.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.078+0000 7f56f2e54700 1 --2- 172.21.15.103:0/325471471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56cc0052a0 0x7f56cc003900 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:55.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.078+0000 7f56f2e54700 1 -- 172.21.15.103:0/325471471 >> 172.21.15.103:0/325471471 conn(0x7f56ec05f2c0 msgr2=0x7f56ec064ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:55.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.078+0000 7f56f2e54700 1 -- 172.21.15.103:0/325471471 shutdown_connections 2020-04-22T14:15:55.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.078+0000 7f56f2e54700 1 -- 172.21.15.103:0/325471471 wait complete. 2020-04-22T14:15:55.243 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:55.256 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:15:55.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.398+0000 7ff71f5d4700 1 Processor -- start 2020-04-22T14:15:55.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.399+0000 7ff71f5d4700 1 -- start start 2020-04-22T14:15:55.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.399+0000 7ff71f5d4700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff71812c0d0 0x7ff7181464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:55.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.399+0000 7ff71f5d4700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff718065fe0 0x7ff71805b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:55.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.399+0000 7ff71f5d4700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff718143300 con 0x7ff71805b8a0 2020-04-22T14:15:55.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.399+0000 7ff71f5d4700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff71812c4b0 con 0x7ff718065fe0 2020-04-22T14:15:55.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.399+0000 7ff71f5d4700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7181435a0 con 0x7ff71812c0d0 2020-04-22T14:15:55.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.399+0000 7ff71d370700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff71812c0d0 0x7ff7181464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:55.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.399+0000 7ff71d370700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff71812c0d0 0x7ff7181464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55550/0 (socket says 172.21.15.103:55550) 2020-04-22T14:15:55.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.400+0000 7ff71d370700 1 -- 172.21.15.103:0/1014545406 learned_addr learned my addr 172.21.15.103:0/1014545406 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:15:55.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.400+0000 7ff71cb6f700 1 --2- 172.21.15.103:0/1014545406 >> v2:172.21.15.86:3300/0 conn(0x7ff718065fe0 0x7ff71805b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:55.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.400+0000 7ff71d370700 1 -- 172.21.15.103:0/1014545406 >> v2:172.21.15.86:3300/0 conn(0x7ff718065fe0 msgr2=0x7ff71805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:55.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.400+0000 7ff71d370700 1 --2- 172.21.15.103:0/1014545406 >> v2:172.21.15.86:3300/0 conn(0x7ff718065fe0 0x7ff71805b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:55.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.400+0000 7ff71d370700 1 -- 172.21.15.103:0/1014545406 >> v1:172.21.15.86:6789/0 conn(0x7ff71805b8a0 legacy=0x7ff718062ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:55.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.400+0000 7ff71d370700 1 -- 172.21.15.103:0/1014545406 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff718143840 con 0x7ff71812c0d0 2020-04-22T14:15:55.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.400+0000 7ff71d370700 1 --2- 172.21.15.103:0/1014545406 >> v2:172.21.15.103:3300/0 conn(0x7ff71812c0d0 0x7ff7181464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff7180669a0 tx=0x7ff708007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:55.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.400+0000 7ff71d370700 1 --2- 172.21.15.103:0/1014545406 >> v2:172.21.15.103:3300/0 conn(0x7ff71812c0d0 0x7ff7181464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff7180669a0 tx=0x7ff708007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:55.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.400+0000 7ff71d370700 1 --2- 172.21.15.103:0/1014545406 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff71812c0d0 0x7ff7181464e0 secure :-1 s=READY pgs=1551 cs=0 l=1 rx=0x7ff7180669a0 tx=0x7ff708007a40).ready entity=mon.1 client_cookie=78dfe10300dd5819 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:55.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.400+0000 7ff71d370700 1 --2- 172.21.15.103:0/1014545406 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff71812c0d0 0x7ff7181464e0 secure :-1 s=THROTTLE_DONE pgs=1551 cs=0 l=1 rx=0x7ff7180669a0 tx=0x7ff708007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:55.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.400+0000 7ff707fff700 1 -- 172.21.15.103:0/1014545406 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7080116e0 con 0x7ff71812c0d0 2020-04-22T14:15:55.408 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.400+0000 7ff71d370700 1 --2- 172.21.15.103:0/1014545406 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff71812c0d0 0x7ff7181464e0 secure :-1 s=THROTTLE_DONE pgs=1551 cs=0 l=1 rx=0x7ff7180669a0 tx=0x7ff708007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:55.408 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.400+0000 7ff71d370700 1 --2- 172.21.15.103:0/1014545406 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff71812c0d0 0x7ff7181464e0 secure :-1 s=THROTTLE_DONE pgs=1551 cs=0 l=1 rx=0x7ff7180669a0 tx=0x7ff708007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:55.408 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.400+0000 7ff707fff700 1 -- 172.21.15.103:0/1014545406 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff708011840 con 0x7ff71812c0d0 2020-04-22T14:15:55.408 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.400+0000 7ff707fff700 1 -- 172.21.15.103:0/1014545406 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff708011c20 con 0x7ff71812c0d0 2020-04-22T14:15:55.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.400+0000 7ff71f5d4700 1 -- 172.21.15.103:0/1014545406 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff71812c0d0 msgr2=0x7ff7181464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:55.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.400+0000 7ff71f5d4700 1 --2- 172.21.15.103:0/1014545406 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff71812c0d0 0x7ff7181464e0 secure :-1 s=READY pgs=1551 cs=0 l=1 rx=0x7ff7180669a0 tx=0x7ff708007a40).stop 2020-04-22T14:15:55.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.401+0000 7ff71f5d4700 1 -- 172.21.15.103:0/1014545406 shutdown_connections 2020-04-22T14:15:55.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.401+0000 7ff71f5d4700 1 --2- 172.21.15.103:0/1014545406 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff71812c0d0 0x7ff7181464e0 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:55.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.401+0000 7ff71f5d4700 1 --2- 172.21.15.103:0/1014545406 >> v2:172.21.15.86:3300/0 conn(0x7ff718065fe0 0x7ff71805b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:55.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.401+0000 7ff71f5d4700 1 -- 172.21.15.103:0/1014545406 >> 172.21.15.103:0/1014545406 conn(0x7ff7180b9160 msgr2=0x7ff71805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:55.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.401+0000 7ff71f5d4700 1 -- 172.21.15.103:0/1014545406 shutdown_connections 2020-04-22T14:15:55.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.401+0000 7ff71f5d4700 1 -- 172.21.15.103:0/1014545406 wait complete. 2020-04-22T14:15:55.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.402+0000 7ff71f5d4700 1 Processor -- start 2020-04-22T14:15:55.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.402+0000 7ff71f5d4700 1 -- start start 2020-04-22T14:15:55.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.402+0000 7ff71f5d4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff718065fe0 0x7ff718154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:55.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.402+0000 7ff71f5d4700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff71812c0d0 0x7ff7180b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:55.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.402+0000 7ff71f5d4700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff718153be0 con 0x7ff71805b8a0 2020-04-22T14:15:55.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.402+0000 7ff71f5d4700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff718153e80 con 0x7ff71812c0d0 2020-04-22T14:15:55.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.402+0000 7ff71f5d4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff718154120 con 0x7ff718065fe0 2020-04-22T14:15:55.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.402+0000 7ff71db71700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff71812c0d0 0x7ff7180b0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:55.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.402+0000 7ff71db71700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff71812c0d0 0x7ff7180b0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55560/0 (socket says 172.21.15.103:55560) 2020-04-22T14:15:55.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.402+0000 7ff71db71700 1 -- 172.21.15.103:0/3969599614 learned_addr learned my addr 172.21.15.103:0/3969599614 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:15:55.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.402+0000 7ff71cb6f700 1 --2- 172.21.15.103:0/3969599614 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff718065fe0 0x7ff718154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:55.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.403+0000 7ff71db71700 1 -- 172.21.15.103:0/3969599614 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff718065fe0 msgr2=0x7ff718154860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:55.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.403+0000 7ff71db71700 1 --2- 172.21.15.103:0/3969599614 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff718065fe0 0x7ff718154860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:55.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.403+0000 7ff71db71700 1 -- 172.21.15.103:0/3969599614 >> v1:172.21.15.86:6789/0 conn(0x7ff71805b8a0 legacy=0x7ff7180b5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:55.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.403+0000 7ff71db71700 1 -- 172.21.15.103:0/3969599614 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7181543c0 con 0x7ff71812c0d0 2020-04-22T14:15:55.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.403+0000 7ff71db71700 1 --2- 172.21.15.103:0/3969599614 >> v2:172.21.15.103:3300/0 conn(0x7ff71812c0d0 0x7ff7180b0b50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff7100022d0 tx=0x7ff710010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:55.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.403+0000 7ff71db71700 1 --2- 172.21.15.103:0/3969599614 >> v2:172.21.15.103:3300/0 conn(0x7ff71812c0d0 0x7ff7180b0b50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff7100022d0 tx=0x7ff710010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:55.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.403+0000 7ff71db71700 1 --2- 172.21.15.103:0/3969599614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff71812c0d0 0x7ff7180b0b50 secure :-1 s=READY pgs=1552 cs=0 l=1 rx=0x7ff7100022d0 tx=0x7ff710010c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:55.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.403+0000 7ff71db71700 1 --2- 172.21.15.103:0/3969599614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff71812c0d0 0x7ff7180b0b50 secure :-1 s=THROTTLE_DONE pgs=1552 cs=0 l=1 rx=0x7ff7100022d0 tx=0x7ff710010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:55.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.403+0000 7ff71db71700 1 --2- 172.21.15.103:0/3969599614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff71812c0d0 0x7ff7180b0b50 secure :-1 s=THROTTLE_DONE pgs=1552 cs=0 l=1 rx=0x7ff7100022d0 tx=0x7ff710010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:55.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.403+0000 7ff7067fc700 1 -- 172.21.15.103:0/3969599614 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7100122b0 con 0x7ff71812c0d0 2020-04-22T14:15:55.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.403+0000 7ff71db71700 1 --2- 172.21.15.103:0/3969599614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff71812c0d0 0x7ff7180b0b50 secure :-1 s=THROTTLE_DONE pgs=1552 cs=0 l=1 rx=0x7ff7100022d0 tx=0x7ff710010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:55.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.403+0000 7ff7067fc700 1 -- 172.21.15.103:0/3969599614 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff710012410 con 0x7ff71812c0d0 2020-04-22T14:15:55.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.403+0000 7ff71f5d4700 1 -- 172.21.15.103:0/3969599614 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7180b5850 con 0x7ff71812c0d0 2020-04-22T14:15:55.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.403+0000 7ff7067fc700 1 -- 172.21.15.103:0/3969599614 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff710012830 con 0x7ff71812c0d0 2020-04-22T14:15:55.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.403+0000 7ff71f5d4700 1 -- 172.21.15.103:0/3969599614 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7180b1ff0 con 0x7ff71812c0d0 2020-04-22T14:15:55.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.403+0000 7ff71db71700 1 --2- 172.21.15.103:0/3969599614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff71812c0d0 0x7ff7180b0b50 secure :-1 s=THROTTLE_DONE pgs=1552 cs=0 l=1 rx=0x7ff7100022d0 tx=0x7ff710010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:55.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.404+0000 7ff7067fc700 1 -- 172.21.15.103:0/3969599614 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ff710012aa0 con 0x7ff71812c0d0 2020-04-22T14:15:55.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.404+0000 7ff71db71700 1 --2- 172.21.15.103:0/3969599614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff71812c0d0 0x7ff7180b0b50 secure :-1 s=THROTTLE_DONE pgs=1552 cs=0 l=1 rx=0x7ff7100022d0 tx=0x7ff710010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:55.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.404+0000 7ff71f5d4700 1 -- 172.21.15.103:0/3969599614 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff718056c90 con 0x7ff71812c0d0 2020-04-22T14:15:55.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.404+0000 7ff7067fc700 1 --2- 172.21.15.103:0/3969599614 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff6f804da20 0x7ff6f804fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:55.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.404+0000 7ff7067fc700 1 -- 172.21.15.103:0/3969599614 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6116+0+0 (secure 0 0 0) 0x7ff710061aa0 con 0x7ff71812c0d0 2020-04-22T14:15:55.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.404+0000 7ff71d370700 1 --2- 172.21.15.103:0/3969599614 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff6f804da20 0x7ff6f804fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:55.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.404+0000 7ff71d370700 1 --2- 172.21.15.103:0/3969599614 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff6f804da20 0x7ff6f804fee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff7180b5d60 tx=0x7ff708007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:55.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.405+0000 7ff71d370700 1 --2- 172.21.15.103:0/3969599614 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff6f804da20 0x7ff6f804fee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff7180b5d60 tx=0x7ff708007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:55.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.405+0000 7ff71d370700 1 --2- 172.21.15.103:0/3969599614 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff6f804da20 0x7ff6f804fee0 secure :-1 s=READY pgs=565 cs=0 l=1 rx=0x7ff7180b5d60 tx=0x7ff708007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:55.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.409+0000 7ff71db71700 1 --2- 172.21.15.103:0/3969599614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff71812c0d0 0x7ff7180b0b50 secure :-1 s=THROTTLE_DONE pgs=1552 cs=0 l=1 rx=0x7ff7100022d0 tx=0x7ff710010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:55.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.409+0000 7ff7067fc700 1 -- 172.21.15.103:0/3969599614 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ff71003ce20 con 0x7ff71812c0d0 2020-04-22T14:15:55.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.596+0000 7ff71f5d4700 1 -- 172.21.15.103:0/3969599614 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff71812aac0 con 0x7ff71812c0d0 2020-04-22T14:15:55.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.596+0000 7ff71db71700 1 --2- 172.21.15.103:0/3969599614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff71812c0d0 0x7ff7180b0b50 secure :-1 s=THROTTLE_DONE pgs=1552 cs=0 l=1 rx=0x7ff7100022d0 tx=0x7ff710010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:55.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.596+0000 7ff7067fc700 1 -- 172.21.15.103:0/3969599614 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+2143 (secure 0 0 0) 0x7ff710040440 con 0x7ff71812c0d0 2020-04-22T14:15:55.600 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:15:55.600 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":74,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5987,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/3564040484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3564040484},{"type":"v1","addr":"172.21.15.86:6835","nonce":3564040484}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":70}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:15:12.286236+0000","modified":"2020-04-22T14:15:14.292028+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7452},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7452":{"gid":7452,"name":"a","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/1492911872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1492911872},{"type":"v1","addr":"172.21.15.103:6833","nonce":1492911872}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2020-04-22T14:15:55.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.598+0000 7ff71f5d4700 1 -- 172.21.15.103:0/3969599614 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff6f804da20 msgr2=0x7ff6f804fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:55.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.598+0000 7ff71f5d4700 1 --2- 172.21.15.103:0/3969599614 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff6f804da20 0x7ff6f804fee0 secure :-1 s=READY pgs=565 cs=0 l=1 rx=0x7ff7180b5d60 tx=0x7ff708007a40).stop 2020-04-22T14:15:55.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.598+0000 7ff71f5d4700 1 -- 172.21.15.103:0/3969599614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff71812c0d0 msgr2=0x7ff7180b0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:55.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.598+0000 7ff71f5d4700 1 --2- 172.21.15.103:0/3969599614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff71812c0d0 0x7ff7180b0b50 secure :-1 s=READY pgs=1552 cs=0 l=1 rx=0x7ff7100022d0 tx=0x7ff710010c10).stop 2020-04-22T14:15:55.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.598+0000 7ff71f5d4700 1 -- 172.21.15.103:0/3969599614 shutdown_connections 2020-04-22T14:15:55.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.598+0000 7ff71f5d4700 1 --2- 172.21.15.103:0/3969599614 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff6f804da20 0x7ff6f804fee0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:55.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.598+0000 7ff71f5d4700 1 --2- 172.21.15.103:0/3969599614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff71812c0d0 0x7ff7180b0b50 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:55.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.598+0000 7ff71f5d4700 1 --2- 172.21.15.103:0/3969599614 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff718065fe0 0x7ff718154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:55.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.598+0000 7ff71f5d4700 1 -- 172.21.15.103:0/3969599614 >> 172.21.15.103:0/3969599614 conn(0x7ff7180b9160 msgr2=0x7ff7180620f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:55.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.598+0000 7ff71f5d4700 1 -- 172.21.15.103:0/3969599614 shutdown_connections 2020-04-22T14:15:55.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.598+0000 7ff71f5d4700 1 -- 172.21.15.103:0/3969599614 wait complete. 2020-04-22T14:15:55.603 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 74 2020-04-22T14:15:55.611 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:55.625 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2020-04-22T14:15:55.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.768+0000 7fbec4d19700 1 Processor -- start 2020-04-22T14:15:55.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.768+0000 7fbec4d19700 1 -- start start 2020-04-22T14:15:55.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.769+0000 7fbec4d19700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbec00b6860 0x7fbec0148540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:55.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.769+0000 7fbec4d19700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbec0062c00 0x7fbec0144c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:55.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.769+0000 7fbec4d19700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbec0063060 con 0x7fbec01450c0 2020-04-22T14:15:55.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.769+0000 7fbec4d19700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbec00632a0 con 0x7fbec0062c00 2020-04-22T14:15:55.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.769+0000 7fbec4d19700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec0144520 con 0x7fbec00b6860 2020-04-22T14:15:55.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.769+0000 7fbebed9d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fbec01450c0 0x7fbec00b2e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47754/0 (socket says 172.21.15.103:47754) 2020-04-22T14:15:55.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.769+0000 7fbebed9d700 1 -- 172.21.15.103:0/3221274687 learned_addr learned my addr 172.21.15.103:0/3221274687 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:55.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.769+0000 7fbebdd9b700 1 --2- 172.21.15.103:0/3221274687 >> v2:172.21.15.86:3300/0 conn(0x7fbec0062c00 0x7fbec0144c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:55.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.770+0000 7fbebe59c700 1 --2- 172.21.15.103:0/3221274687 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbec00b6860 0x7fbec0148540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:55.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.770+0000 7fbebd59a700 1 -- 172.21.15.103:0/3221274687 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3493988761 0 0) 0x7fbeb8001450 con 0x7fbec01450c0 2020-04-22T14:15:55.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.770+0000 7fbebd59a700 1 -- 172.21.15.103:0/3221274687 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbea4003230 con 0x7fbec01450c0 2020-04-22T14:15:55.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.770+0000 7fbebdd9b700 1 -- 172.21.15.103:0/3221274687 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbec00b6860 msgr2=0x7fbec0148540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:55.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.770+0000 7fbebdd9b700 1 --2- 172.21.15.103:0/3221274687 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbec00b6860 0x7fbec0148540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:55.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.770+0000 7fbebdd9b700 1 -- 172.21.15.103:0/3221274687 >> v1:172.21.15.103:6789/0 conn(0x7fbec01450c0 legacy=0x7fbec00b2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:55.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.770+0000 7fbebdd9b700 1 -- 172.21.15.103:0/3221274687 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec01447c0 con 0x7fbec0062c00 2020-04-22T14:15:55.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.770+0000 7fbebdd9b700 1 --2- 172.21.15.103:0/3221274687 >> v2:172.21.15.86:3300/0 conn(0x7fbec0062c00 0x7fbec0144c60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbeb0002f30 tx=0x7fbeb0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:55.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.770+0000 7fbebdd9b700 1 --2- 172.21.15.103:0/3221274687 >> v2:172.21.15.86:3300/0 conn(0x7fbec0062c00 0x7fbec0144c60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbeb0002f30 tx=0x7fbeb0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:55.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.770+0000 7fbebdd9b700 1 --2- 172.21.15.103:0/3221274687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbec0062c00 0x7fbec0144c60 secure :-1 s=READY pgs=826 cs=0 l=1 rx=0x7fbeb0002f30 tx=0x7fbeb0007a40).ready entity=mon.0 client_cookie=1eb6d8a671b834c9 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:55.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.770+0000 7fbebdd9b700 1 --2- 172.21.15.103:0/3221274687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbec0062c00 0x7fbec0144c60 secure :-1 s=THROTTLE_DONE pgs=826 cs=0 l=1 rx=0x7fbeb0002f30 tx=0x7fbeb0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:55.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.770+0000 7fbebd59a700 1 -- 172.21.15.103:0/3221274687 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbeb0011310 con 0x7fbec0062c00 2020-04-22T14:15:55.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.770+0000 7fbebdd9b700 1 --2- 172.21.15.103:0/3221274687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbec0062c00 0x7fbec0144c60 secure :-1 s=THROTTLE_DONE pgs=826 cs=0 l=1 rx=0x7fbeb0002f30 tx=0x7fbeb0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:55.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.770+0000 7fbebdd9b700 1 --2- 172.21.15.103:0/3221274687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbec0062c00 0x7fbec0144c60 secure :-1 s=THROTTLE_DONE pgs=826 cs=0 l=1 rx=0x7fbeb0002f30 tx=0x7fbeb0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:55.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.770+0000 7fbebd59a700 1 -- 172.21.15.103:0/3221274687 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeb00114b0 con 0x7fbec0062c00 2020-04-22T14:15:55.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.770+0000 7fbebd59a700 1 -- 172.21.15.103:0/3221274687 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbeb0011890 con 0x7fbec0062c00 2020-04-22T14:15:55.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.770+0000 7fbec4d19700 1 -- 172.21.15.103:0/3221274687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbec0062c00 msgr2=0x7fbec0144c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:55.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.770+0000 7fbec4d19700 1 --2- 172.21.15.103:0/3221274687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbec0062c00 0x7fbec0144c60 secure :-1 s=READY pgs=826 cs=0 l=1 rx=0x7fbeb0002f30 tx=0x7fbeb0007a40).stop 2020-04-22T14:15:55.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.771+0000 7fbec4d19700 1 -- 172.21.15.103:0/3221274687 shutdown_connections 2020-04-22T14:15:55.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.771+0000 7fbec4d19700 1 --2- 172.21.15.103:0/3221274687 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbec00b6860 0x7fbec0148540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:55.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.771+0000 7fbec4d19700 1 --2- 172.21.15.103:0/3221274687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbec0062c00 0x7fbec0144c60 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:55.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.771+0000 7fbec4d19700 1 -- 172.21.15.103:0/3221274687 >> 172.21.15.103:0/3221274687 conn(0x7fbec005fd90 msgr2=0x7fbec0060580 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:55.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.771+0000 7fbec4d19700 1 -- 172.21.15.103:0/3221274687 shutdown_connections 2020-04-22T14:15:55.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.771+0000 7fbec4d19700 1 -- 172.21.15.103:0/3221274687 wait complete. 2020-04-22T14:15:55.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.773+0000 7fbec4d19700 1 Processor -- start 2020-04-22T14:15:55.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.773+0000 7fbec4d19700 1 -- start start 2020-04-22T14:15:55.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.773+0000 7fbec4d19700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbec0062c00 0x7fbec00b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:55.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.773+0000 7fbec4d19700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbec01410d0 con 0x7fbec01450c0 2020-04-22T14:15:55.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.773+0000 7fbec4d19700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbec0141370 con 0x7fbec00b6860 2020-04-22T14:15:55.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.773+0000 7fbec4d19700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbec0141610 con 0x7fbec0062c00 2020-04-22T14:15:55.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.773+0000 7fbebdd9b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fbec00b6860 0x7fbec013df70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47762/0 (socket says 172.21.15.103:47762) 2020-04-22T14:15:55.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.773+0000 7fbebdd9b700 1 -- 172.21.15.103:0/415079792 learned_addr learned my addr 172.21.15.103:0/415079792 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:55.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.773+0000 7fbebe59c700 1 --2- 172.21.15.103:0/415079792 >> v2:172.21.15.86:3300/0 conn(0x7fbec0062c00 0x7fbec00b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:55.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.773+0000 7fbeaf7fe700 1 -- 172.21.15.103:0/415079792 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1901510267 0 0) 0x7fbec0141370 con 0x7fbec00b6860 2020-04-22T14:15:55.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.773+0000 7fbeaf7fe700 1 -- 172.21.15.103:0/415079792 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe9c002fe0 con 0x7fbec00b6860 2020-04-22T14:15:55.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.773+0000 7fbeaf7fe700 1 -- 172.21.15.103:0/415079792 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3553188468 0 0) 0x7fbe9c002fe0 con 0x7fbec00b6860 2020-04-22T14:15:55.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.773+0000 7fbeaf7fe700 1 -- 172.21.15.103:0/415079792 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbec0141370 con 0x7fbec00b6860 2020-04-22T14:15:55.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.773+0000 7fbeaf7fe700 1 -- 172.21.15.103:0/415079792 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fbeb0008e10 con 0x7fbec00b6860 2020-04-22T14:15:55.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.773+0000 7fbeaf7fe700 1 -- 172.21.15.103:0/415079792 >> v2:172.21.15.86:3300/0 conn(0x7fbec0062c00 msgr2=0x7fbec00b0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:55.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.773+0000 7fbeaf7fe700 1 --2- 172.21.15.103:0/415079792 >> v2:172.21.15.86:3300/0 conn(0x7fbec0062c00 0x7fbec00b0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:55.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.773+0000 7fbeaf7fe700 1 -- 172.21.15.103:0/415079792 >> v1:172.21.15.103:6789/0 conn(0x7fbec00b6860 legacy=0x7fbec013df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:55.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.773+0000 7fbeaf7fe700 1 -- 172.21.15.103:0/415079792 >> v1:172.21.15.86:6789/0 conn(0x7fbec01450c0 legacy=0x7fbec00659d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:55.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.773+0000 7fbeaf7fe700 1 --2- 172.21.15.103:0/415079792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe9c0049b0 0x7fbe9c004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:55.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.773+0000 7fbeaf7fe700 1 --2- 172.21.15.103:0/415079792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe9c005240 0x7fbe9c003960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:55.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.773+0000 7fbeaf7fe700 1 --2- 172.21.15.103:0/415079792 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbe9c003f60 0x7fbe9c0043e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:55.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.773+0000 7fbeaf7fe700 1 -- 172.21.15.103:0/415079792 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec0141610 con 0x7fbe9c0049b0 2020-04-22T14:15:55.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.773+0000 7fbeaf7fe700 1 -- 172.21.15.103:0/415079792 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c00b8e0 con 0x7fbe9c005240 2020-04-22T14:15:55.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.773+0000 7fbeaf7fe700 1 -- 172.21.15.103:0/415079792 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c00baa0 con 0x7fbe9c003f60 2020-04-22T14:15:55.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.773+0000 7fbebe59c700 1 --2- 172.21.15.103:0/415079792 >> v2:172.21.15.86:3300/0 conn(0x7fbec0062c00 0x7fbec00b0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:15:55.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.773+0000 7fbebdd9b700 1 --2- 172.21.15.103:0/415079792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe9c005240 0x7fbe9c003960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:55.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.773+0000 7fbebed9d700 1 --2- 172.21.15.103:0/415079792 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbe9c003f60 0x7fbe9c0043e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:55.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.773+0000 7fbebe59c700 1 --2- 172.21.15.103:0/415079792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe9c0049b0 0x7fbe9c004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:55.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.773+0000 7fbebdd9b700 1 -- 172.21.15.103:0/415079792 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbe9c003f60 msgr2=0x7fbe9c0043e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:55.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.773+0000 7fbebdd9b700 1 --2- 172.21.15.103:0/415079792 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbe9c003f60 0x7fbe9c0043e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:55.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.773+0000 7fbebdd9b700 1 -- 172.21.15.103:0/415079792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe9c0049b0 msgr2=0x7fbe9c004d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:55.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.773+0000 7fbebdd9b700 1 --2- 172.21.15.103:0/415079792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe9c0049b0 0x7fbe9c004d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:55.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.773+0000 7fbebdd9b700 1 -- 172.21.15.103:0/415079792 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec00b1470 con 0x7fbe9c005240 2020-04-22T14:15:55.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.773+0000 7fbebed9d700 1 -- 172.21.15.103:0/415079792 reap_dead start 2020-04-22T14:15:55.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.773+0000 7fbebe59c700 1 --2- 172.21.15.103:0/415079792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe9c0049b0 0x7fbe9c004d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:15:55.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.773+0000 7fbec4d19700 1 -- 172.21.15.103:0/415079792 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbec00645d0 con 0x7fbe9c005240 2020-04-22T14:15:55.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.773+0000 7fbebdd9b700 1 --2- 172.21.15.103:0/415079792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe9c005240 0x7fbe9c003960 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbeb0008300 tx=0x7fbeb0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:55.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.773+0000 7fbec4d19700 1 -- 172.21.15.103:0/415079792 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbec00b0c10 con 0x7fbe9c005240 2020-04-22T14:15:55.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.774+0000 7fbebdd9b700 1 --2- 172.21.15.103:0/415079792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe9c005240 0x7fbe9c003960 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbeb0008300 tx=0x7fbeb0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:55.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.774+0000 7fbebdd9b700 1 --2- 172.21.15.103:0/415079792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe9c005240 0x7fbe9c003960 secure :-1 s=READY pgs=1555 cs=0 l=1 rx=0x7fbeb0008300 tx=0x7fbeb0007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:55.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.774+0000 7fbebdd9b700 1 --2- 172.21.15.103:0/415079792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe9c005240 0x7fbe9c003960 secure :-1 s=THROTTLE_DONE pgs=1555 cs=0 l=1 rx=0x7fbeb0008300 tx=0x7fbeb0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:55.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.774+0000 7fbeaf7fe700 1 -- 172.21.15.103:0/415079792 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbeb0007550 con 0x7fbe9c005240 2020-04-22T14:15:55.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.774+0000 7fbebdd9b700 1 --2- 172.21.15.103:0/415079792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe9c005240 0x7fbe9c003960 secure :-1 s=THROTTLE_DONE pgs=1555 cs=0 l=1 rx=0x7fbeb0008300 tx=0x7fbeb0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:55.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.774+0000 7fbebdd9b700 1 --2- 172.21.15.103:0/415079792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe9c005240 0x7fbe9c003960 secure :-1 s=THROTTLE_DONE pgs=1555 cs=0 l=1 rx=0x7fbeb0008300 tx=0x7fbeb0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:55.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.774+0000 7fbeaf7fe700 1 -- 172.21.15.103:0/415079792 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeb00056c0 con 0x7fbe9c005240 2020-04-22T14:15:55.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.774+0000 7fbeaf7fe700 1 -- 172.21.15.103:0/415079792 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbeb0005a60 con 0x7fbe9c005240 2020-04-22T14:15:55.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.774+0000 7fbebdd9b700 1 --2- 172.21.15.103:0/415079792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe9c005240 0x7fbe9c003960 secure :-1 s=THROTTLE_DONE pgs=1555 cs=0 l=1 rx=0x7fbeb0008300 tx=0x7fbeb0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:55.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.775+0000 7fbec4d19700 1 -- 172.21.15.103:0/415079792 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbec00b0ec0 con 0x7fbe9c005240 2020-04-22T14:15:55.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.775+0000 7fbeaf7fe700 1 -- 172.21.15.103:0/415079792 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fbeb0005bc0 con 0x7fbe9c005240 2020-04-22T14:15:55.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.775+0000 7fbebdd9b700 1 --2- 172.21.15.103:0/415079792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe9c005240 0x7fbe9c003960 secure :-1 s=THROTTLE_DONE pgs=1555 cs=0 l=1 rx=0x7fbeb0008300 tx=0x7fbeb0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:55.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.775+0000 7fbeaf7fe700 1 --2- 172.21.15.103:0/415079792 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbe9c051820 0x7fbe9c053ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:55.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.775+0000 7fbeaf7fe700 1 -- 172.21.15.103:0/415079792 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fbeb0062960 con 0x7fbe9c005240 2020-04-22T14:15:55.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.775+0000 7fbebe59c700 1 --2- 172.21.15.103:0/415079792 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbe9c051820 0x7fbe9c053ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:55.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.775+0000 7fbebe59c700 1 --2- 172.21.15.103:0/415079792 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbe9c051820 0x7fbe9c053ce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbeb4002f30 tx=0x7fbeb400bdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:55.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.775+0000 7fbebe59c700 1 --2- 172.21.15.103:0/415079792 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbe9c051820 0x7fbe9c053ce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbeb4002f30 tx=0x7fbeb400bdd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:55.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.775+0000 7fbebe59c700 1 --2- 172.21.15.103:0/415079792 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbe9c051820 0x7fbe9c053ce0 secure :-1 s=READY pgs=566 cs=0 l=1 rx=0x7fbeb4002f30 tx=0x7fbeb400bdd0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:55.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.779+0000 7fbebdd9b700 1 --2- 172.21.15.103:0/415079792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe9c005240 0x7fbe9c003960 secure :-1 s=THROTTLE_DONE pgs=1555 cs=0 l=1 rx=0x7fbeb0008300 tx=0x7fbeb0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:55.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.779+0000 7fbeaf7fe700 1 -- 172.21.15.103:0/415079792 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fbeb003de60 con 0x7fbe9c005240 2020-04-22T14:15:55.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:55.967+0000 7fbec4d19700 1 -- 172.21.15.103:0/415079792 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fbec0064760 con 0x7fbe9c005240 2020-04-22T14:15:56.503 INFO:tasks.ceph.mon.b.smithi086.stderr:2020-04-22T14:15:56.501+0000 7fbdbf880700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-04-22T14:15:56.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.507+0000 7fbebdd9b700 1 --2- 172.21.15.103:0/415079792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe9c005240 0x7fbe9c003960 secure :-1 s=THROTTLE_DONE pgs=1555 cs=0 l=1 rx=0x7fbeb0008300 tx=0x7fbeb0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:56.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.507+0000 7fbeaf7fe700 1 -- 172.21.15.103:0/415079792 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v75) v1 ==== 161+0+0 (secure 0 0 0) 0x7fbeb0041480 con 0x7fbe9c005240 2020-04-22T14:15:56.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.509+0000 7fbec4d19700 1 -- 172.21.15.103:0/415079792 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbe9c051820 msgr2=0x7fbe9c053ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:56.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.509+0000 7fbec4d19700 1 --2- 172.21.15.103:0/415079792 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbe9c051820 0x7fbe9c053ce0 secure :-1 s=READY pgs=566 cs=0 l=1 rx=0x7fbeb4002f30 tx=0x7fbeb400bdd0).stop 2020-04-22T14:15:56.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.509+0000 7fbec4d19700 1 -- 172.21.15.103:0/415079792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe9c005240 msgr2=0x7fbe9c003960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:56.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.509+0000 7fbec4d19700 1 --2- 172.21.15.103:0/415079792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe9c005240 0x7fbe9c003960 secure :-1 s=READY pgs=1555 cs=0 l=1 rx=0x7fbeb0008300 tx=0x7fbeb0007a40).stop 2020-04-22T14:15:56.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.509+0000 7fbec4d19700 1 -- 172.21.15.103:0/415079792 shutdown_connections 2020-04-22T14:15:56.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.509+0000 7fbec4d19700 1 --2- 172.21.15.103:0/415079792 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbe9c051820 0x7fbe9c053ce0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:56.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.509+0000 7fbec4d19700 1 --2- 172.21.15.103:0/415079792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe9c005240 0x7fbe9c003960 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:56.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.509+0000 7fbec4d19700 1 -- 172.21.15.103:0/415079792 >> 172.21.15.103:0/415079792 conn(0x7fbec005fd90 msgr2=0x7fbec01436e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:56.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.509+0000 7fbec4d19700 1 -- 172.21.15.103:0/415079792 shutdown_connections 2020-04-22T14:15:56.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.509+0000 7fbec4d19700 1 -- 172.21.15.103:0/415079792 wait complete. 2020-04-22T14:15:56.513 INFO:teuthology.orchestra.run.smithi103.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2020-04-22T14:15:56.523 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:56.534 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2020-04-22T14:15:56.538 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:15:56.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.686+0000 7f656a911700 1 Processor -- start 2020-04-22T14:15:56.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.686+0000 7f656a911700 1 -- start start 2020-04-22T14:15:56.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.687+0000 7f656a911700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f656412c0d0 0x7f65641464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:56.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.687+0000 7f656a911700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6564063e30 0x7f65640642a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:56.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.687+0000 7f656a911700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6564143300 con 0x7f6564065fe0 2020-04-22T14:15:56.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.687+0000 7f656a911700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65641435a0 con 0x7f6564063e30 2020-04-22T14:15:56.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.687+0000 7f656a911700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6564143840 con 0x7f656412c0d0 2020-04-22T14:15:56.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.687+0000 7f6568eae700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6564063e30 0x7f65640642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:56.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.687+0000 7f655bfff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f6564065fe0 0x7f656405b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47786/0 (socket says 172.21.15.103:47786) 2020-04-22T14:15:56.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.687+0000 7f655bfff700 1 -- 172.21.15.103:0/1354531605 learned_addr learned my addr 172.21.15.103:0/1354531605 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:56.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.687+0000 7f6563fff700 1 --2- 172.21.15.103:0/1354531605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f656412c0d0 0x7f65641464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:56.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.687+0000 7f6568eae700 1 -- 172.21.15.103:0/1354531605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f656412c0d0 msgr2=0x7f65641464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:56.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.687+0000 7f6568eae700 1 --2- 172.21.15.103:0/1354531605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f656412c0d0 0x7f65641464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:56.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.687+0000 7f6568eae700 1 -- 172.21.15.103:0/1354531605 >> v1:172.21.15.103:6789/0 conn(0x7f6564065fe0 legacy=0x7f656405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:56.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.687+0000 7f65637fe700 1 -- 172.21.15.103:0/1354531605 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4203842094 0 0) 0x7f6564143300 con 0x7f6564065fe0 2020-04-22T14:15:56.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.687+0000 7f6568eae700 1 -- 172.21.15.103:0/1354531605 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f656405bb50 con 0x7f6564063e30 2020-04-22T14:15:56.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.687+0000 7f6568eae700 1 --2- 172.21.15.103:0/1354531605 >> v2:172.21.15.103:3300/0 conn(0x7f6564063e30 0x7f65640642a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f655c0032b0 tx=0x7f655c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:56.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.688+0000 7f6568eae700 1 --2- 172.21.15.103:0/1354531605 >> v2:172.21.15.103:3300/0 conn(0x7f6564063e30 0x7f65640642a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f655c0032b0 tx=0x7f655c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:56.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.688+0000 7f6568eae700 1 --2- 172.21.15.103:0/1354531605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6564063e30 0x7f65640642a0 secure :-1 s=READY pgs=1558 cs=0 l=1 rx=0x7f655c0032b0 tx=0x7f655c007dc0).ready entity=mon.1 client_cookie=f68842de7d9efed5 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:56.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.688+0000 7f6568eae700 1 --2- 172.21.15.103:0/1354531605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6564063e30 0x7f65640642a0 secure :-1 s=THROTTLE_DONE pgs=1558 cs=0 l=1 rx=0x7f655c0032b0 tx=0x7f655c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:56.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.688+0000 7f65637fe700 1 -- 172.21.15.103:0/1354531605 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f655c011e20 con 0x7f6564063e30 2020-04-22T14:15:56.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.688+0000 7f6568eae700 1 --2- 172.21.15.103:0/1354531605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6564063e30 0x7f65640642a0 secure :-1 s=THROTTLE_DONE pgs=1558 cs=0 l=1 rx=0x7f655c0032b0 tx=0x7f655c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:56.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.688+0000 7f6568eae700 1 --2- 172.21.15.103:0/1354531605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6564063e30 0x7f65640642a0 secure :-1 s=THROTTLE_DONE pgs=1558 cs=0 l=1 rx=0x7f655c0032b0 tx=0x7f655c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:56.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.688+0000 7f65637fe700 1 -- 172.21.15.103:0/1354531605 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f655c00a180 con 0x7f6564063e30 2020-04-22T14:15:56.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.688+0000 7f65637fe700 1 -- 172.21.15.103:0/1354531605 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f655c00a520 con 0x7f6564063e30 2020-04-22T14:15:56.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.688+0000 7f656a911700 1 -- 172.21.15.103:0/1354531605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6564063e30 msgr2=0x7f65640642a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:56.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.688+0000 7f656a911700 1 --2- 172.21.15.103:0/1354531605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6564063e30 0x7f65640642a0 secure :-1 s=READY pgs=1558 cs=0 l=1 rx=0x7f655c0032b0 tx=0x7f655c007dc0).stop 2020-04-22T14:15:56.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.688+0000 7f656a911700 1 -- 172.21.15.103:0/1354531605 shutdown_connections 2020-04-22T14:15:56.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.688+0000 7f656a911700 1 --2- 172.21.15.103:0/1354531605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6564063e30 0x7f65640642a0 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:56.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.688+0000 7f656a911700 1 --2- 172.21.15.103:0/1354531605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f656412c0d0 0x7f65641464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:56.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.688+0000 7f656a911700 1 -- 172.21.15.103:0/1354531605 >> 172.21.15.103:0/1354531605 conn(0x7f65640b9160 msgr2=0x7f656405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:56.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.688+0000 7f656a911700 1 -- 172.21.15.103:0/1354531605 shutdown_connections 2020-04-22T14:15:56.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.688+0000 7f656a911700 1 -- 172.21.15.103:0/1354531605 wait complete. 2020-04-22T14:15:56.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.689+0000 7f656a911700 1 Processor -- start 2020-04-22T14:15:56.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.689+0000 7f656a911700 1 -- start start 2020-04-22T14:15:56.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.690+0000 7f656a911700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f656412c0d0 0x7f6564129f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:56.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.690+0000 7f656a911700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65640af290 con 0x7f6564063e30 2020-04-22T14:15:56.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.690+0000 7f656a911700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65640af530 con 0x7f6564065fe0 2020-04-22T14:15:56.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.690+0000 7f656a911700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65640aefb0 con 0x7f656412c0d0 2020-04-22T14:15:56.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.690+0000 7f6568eae700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f656412c0d0 0x7f6564129f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:56.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.690+0000 7f655bfff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f6564065fe0 0x7f6564141fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47790/0 (socket says 172.21.15.103:47790) 2020-04-22T14:15:56.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.690+0000 7f655bfff700 1 -- 172.21.15.103:0/3334106911 learned_addr learned my addr 172.21.15.103:0/3334106911 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:56.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.690+0000 7f6568eae700 1 -- 172.21.15.103:0/3334106911 >> v1:172.21.15.103:6789/0 conn(0x7f6564065fe0 legacy=0x7f6564141fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:56.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.690+0000 7f6568eae700 1 -- 172.21.15.103:0/3334106911 >> v1:172.21.15.86:6789/0 conn(0x7f6564063e30 legacy=0x7f65640ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:56.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.690+0000 7f6561ffb700 1 -- 172.21.15.103:0/3334106911 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 546702348 0 0) 0x7f65640af530 con 0x7f6564065fe0 2020-04-22T14:15:56.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.690+0000 7f6568eae700 1 -- 172.21.15.103:0/3334106911 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65640ac940 con 0x7f656412c0d0 2020-04-22T14:15:56.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.690+0000 7f6568eae700 1 --2- 172.21.15.103:0/3334106911 >> v2:172.21.15.103:3300/0 conn(0x7f656412c0d0 0x7f6564129f40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f65640b5b20 tx=0x7f655c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:56.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.690+0000 7f6568eae700 1 --2- 172.21.15.103:0/3334106911 >> v2:172.21.15.103:3300/0 conn(0x7f656412c0d0 0x7f6564129f40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f65640b5b20 tx=0x7f655c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:56.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.690+0000 7f6568eae700 1 --2- 172.21.15.103:0/3334106911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f656412c0d0 0x7f6564129f40 secure :-1 s=READY pgs=1560 cs=0 l=1 rx=0x7f65640b5b20 tx=0x7f655c007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:56.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.690+0000 7f6568eae700 1 --2- 172.21.15.103:0/3334106911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f656412c0d0 0x7f6564129f40 secure :-1 s=THROTTLE_DONE pgs=1560 cs=0 l=1 rx=0x7f65640b5b20 tx=0x7f655c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:56.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.690+0000 7f6561ffb700 1 -- 172.21.15.103:0/3334106911 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f655c005c30 con 0x7f656412c0d0 2020-04-22T14:15:56.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.690+0000 7f6568eae700 1 --2- 172.21.15.103:0/3334106911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f656412c0d0 0x7f6564129f40 secure :-1 s=THROTTLE_DONE pgs=1560 cs=0 l=1 rx=0x7f65640b5b20 tx=0x7f655c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:56.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.690+0000 7f6568eae700 1 --2- 172.21.15.103:0/3334106911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f656412c0d0 0x7f6564129f40 secure :-1 s=THROTTLE_DONE pgs=1560 cs=0 l=1 rx=0x7f65640b5b20 tx=0x7f655c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:56.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.690+0000 7f6561ffb700 1 -- 172.21.15.103:0/3334106911 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f655c005d90 con 0x7f656412c0d0 2020-04-22T14:15:56.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.690+0000 7f656a911700 1 -- 172.21.15.103:0/3334106911 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65641426b0 con 0x7f656412c0d0 2020-04-22T14:15:56.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.691+0000 7f6561ffb700 1 -- 172.21.15.103:0/3334106911 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f655c007360 con 0x7f656412c0d0 2020-04-22T14:15:56.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.691+0000 7f656a911700 1 -- 172.21.15.103:0/3334106911 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65640b5680 con 0x7f656412c0d0 2020-04-22T14:15:56.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.691+0000 7f6568eae700 1 --2- 172.21.15.103:0/3334106911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f656412c0d0 0x7f6564129f40 secure :-1 s=THROTTLE_DONE pgs=1560 cs=0 l=1 rx=0x7f65640b5b20 tx=0x7f655c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:56.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.692+0000 7f656a911700 1 -- 172.21.15.103:0/3334106911 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65640af0f0 con 0x7f656412c0d0 2020-04-22T14:15:56.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.692+0000 7f6561ffb700 1 -- 172.21.15.103:0/3334106911 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f655c0075d0 con 0x7f656412c0d0 2020-04-22T14:15:56.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.692+0000 7f6568eae700 1 --2- 172.21.15.103:0/3334106911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f656412c0d0 0x7f6564129f40 secure :-1 s=THROTTLE_DONE pgs=1560 cs=0 l=1 rx=0x7f65640b5b20 tx=0x7f655c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:56.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.692+0000 7f6561ffb700 1 --2- 172.21.15.103:0/3334106911 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f654804d800 0x7f654804fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:56.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.692+0000 7f6561ffb700 1 -- 172.21.15.103:0/3334106911 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f655c062320 con 0x7f656412c0d0 2020-04-22T14:15:56.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.692+0000 7f6563fff700 1 --2- 172.21.15.103:0/3334106911 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f654804d800 0x7f654804fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:56.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.692+0000 7f6563fff700 1 --2- 172.21.15.103:0/3334106911 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f654804d800 0x7f654804fcc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6554002f30 tx=0x7f655400c6f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:56.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.692+0000 7f6563fff700 1 --2- 172.21.15.103:0/3334106911 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f654804d800 0x7f654804fcc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6554002f30 tx=0x7f655400c6f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:56.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.692+0000 7f6563fff700 1 --2- 172.21.15.103:0/3334106911 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f654804d800 0x7f654804fcc0 secure :-1 s=READY pgs=567 cs=0 l=1 rx=0x7f6554002f30 tx=0x7f655400c6f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:56.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.696+0000 7f6568eae700 1 --2- 172.21.15.103:0/3334106911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f656412c0d0 0x7f6564129f40 secure :-1 s=THROTTLE_DONE pgs=1560 cs=0 l=1 rx=0x7f65640b5b20 tx=0x7f655c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:56.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.696+0000 7f6561ffb700 1 -- 172.21.15.103:0/3334106911 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f65640af0f0 con 0x7f656412c0d0 2020-04-22T14:15:56.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.886+0000 7f656a911700 1 -- 172.21.15.103:0/3334106911 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65640af0f0 con 0x7f656412c0d0 2020-04-22T14:15:56.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.886+0000 7f6568eae700 1 --2- 172.21.15.103:0/3334106911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f656412c0d0 0x7f6564129f40 secure :-1 s=THROTTLE_DONE pgs=1560 cs=0 l=1 rx=0x7f65640b5b20 tx=0x7f655c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:56.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.886+0000 7f6561ffb700 1 -- 172.21.15.103:0/3334106911 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+1780 (secure 0 0 0) 0x7f65640af0f0 con 0x7f656412c0d0 2020-04-22T14:15:56.889 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:15:56.889 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":75,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5987,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/3564040484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3564040484},{"type":"v1","addr":"172.21.15.86:6835","nonce":3564040484}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":70}],"filesystems":[{"mdsmap":{"epoch":75,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:15:12.286236+0000","modified":"2020-04-22T14:15:56.501928+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":104,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2020-04-22T14:15:56.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.887+0000 7f656a911700 1 -- 172.21.15.103:0/3334106911 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f654804d800 msgr2=0x7f654804fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:56.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.887+0000 7f656a911700 1 --2- 172.21.15.103:0/3334106911 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f654804d800 0x7f654804fcc0 secure :-1 s=READY pgs=567 cs=0 l=1 rx=0x7f6554002f30 tx=0x7f655400c6f0).stop 2020-04-22T14:15:56.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.887+0000 7f656a911700 1 -- 172.21.15.103:0/3334106911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f656412c0d0 msgr2=0x7f6564129f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:56.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.887+0000 7f656a911700 1 --2- 172.21.15.103:0/3334106911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f656412c0d0 0x7f6564129f40 secure :-1 s=READY pgs=1560 cs=0 l=1 rx=0x7f65640b5b20 tx=0x7f655c007dc0).stop 2020-04-22T14:15:56.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.887+0000 7f656a911700 1 -- 172.21.15.103:0/3334106911 shutdown_connections 2020-04-22T14:15:56.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.887+0000 7f656a911700 1 --2- 172.21.15.103:0/3334106911 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f654804d800 0x7f654804fcc0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:56.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.887+0000 7f656a911700 1 --2- 172.21.15.103:0/3334106911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f656412c0d0 0x7f6564129f40 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:56.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.887+0000 7f656a911700 1 -- 172.21.15.103:0/3334106911 >> 172.21.15.103:0/3334106911 conn(0x7f65640b9160 msgr2=0x7f65640b7220 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:56.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.888+0000 7f656a911700 1 -- 172.21.15.103:0/3334106911 shutdown_connections 2020-04-22T14:15:56.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:56.888+0000 7f656a911700 1 -- 172.21.15.103:0/3334106911 wait complete. 2020-04-22T14:15:56.893 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 75 2020-04-22T14:15:56.900 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:56.914 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-04-22T14:15:57.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.060+0000 7f45c2907700 1 Processor -- start 2020-04-22T14:15:57.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.060+0000 7f45c2907700 1 -- start start 2020-04-22T14:15:57.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.061+0000 7f45c2907700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f45bc0ac950 0x7f45bc146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:57.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.061+0000 7f45c2907700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45bc1470a0 0x7f45bc143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:57.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.061+0000 7f45c2907700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45bc1467e0 con 0x7f45bc0b9140 2020-04-22T14:15:57.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.061+0000 7f45c2907700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45bc0602f0 con 0x7f45bc0ac950 2020-04-22T14:15:57.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.061+0000 7f45c2907700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc060050 con 0x7f45bc1470a0 2020-04-22T14:15:57.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.061+0000 7f45bb7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f45bc0ac950 0x7f45bc146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:57.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.061+0000 7f45bb7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f45bc0ac950 0x7f45bc146c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55606/0 (socket says 172.21.15.103:55606) 2020-04-22T14:15:57.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.061+0000 7f45bb7fe700 1 -- 172.21.15.103:0/1498124556 learned_addr learned my addr 172.21.15.103:0/1498124556 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:15:57.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.061+0000 7f45c0ea4700 1 --2- 172.21.15.103:0/1498124556 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45bc1470a0 0x7f45bc143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:57.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.061+0000 7f45bb7fe700 1 -- 172.21.15.103:0/1498124556 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45bc1470a0 msgr2=0x7f45bc143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:57.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.061+0000 7f45bb7fe700 1 --2- 172.21.15.103:0/1498124556 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45bc1470a0 0x7f45bc143090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:57.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.061+0000 7f45bb7fe700 1 -- 172.21.15.103:0/1498124556 >> v1:172.21.15.86:6789/0 conn(0x7f45bc0b9140 legacy=0x7f45bc12b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:57.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.061+0000 7f45bb7fe700 1 -- 172.21.15.103:0/1498124556 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45bc0b9520 con 0x7f45bc0ac950 2020-04-22T14:15:57.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.061+0000 7f45c0ea4700 1 --2- 172.21.15.103:0/1498124556 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45bc1470a0 0x7f45bc143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:15:57.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.061+0000 7f45bb7fe700 1 --2- 172.21.15.103:0/1498124556 >> v2:172.21.15.103:3300/0 conn(0x7f45bc0ac950 0x7f45bc146c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f45b0002f30 tx=0x7f45b0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:57.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.061+0000 7f45bb7fe700 1 --2- 172.21.15.103:0/1498124556 >> v2:172.21.15.103:3300/0 conn(0x7f45bc0ac950 0x7f45bc146c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f45b0002f30 tx=0x7f45b0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:57.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.061+0000 7f45bb7fe700 1 --2- 172.21.15.103:0/1498124556 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45bc0ac950 0x7f45bc146c40 secure :-1 s=READY pgs=1561 cs=0 l=1 rx=0x7f45b0002f30 tx=0x7f45b0007a40).ready entity=mon.1 client_cookie=5e88a091bdaa87c5 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:57.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.061+0000 7f45bb7fe700 1 --2- 172.21.15.103:0/1498124556 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45bc0ac950 0x7f45bc146c40 secure :-1 s=THROTTLE_DONE pgs=1561 cs=0 l=1 rx=0x7f45b0002f30 tx=0x7f45b0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:57.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.061+0000 7f45baffd700 1 -- 172.21.15.103:0/1498124556 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45b0011720 con 0x7f45bc0ac950 2020-04-22T14:15:57.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.061+0000 7f45bb7fe700 1 --2- 172.21.15.103:0/1498124556 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45bc0ac950 0x7f45bc146c40 secure :-1 s=THROTTLE_DONE pgs=1561 cs=0 l=1 rx=0x7f45b0002f30 tx=0x7f45b0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:57.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.061+0000 7f45bb7fe700 1 --2- 172.21.15.103:0/1498124556 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45bc0ac950 0x7f45bc146c40 secure :-1 s=THROTTLE_DONE pgs=1561 cs=0 l=1 rx=0x7f45b0002f30 tx=0x7f45b0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:57.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.061+0000 7f45baffd700 1 -- 172.21.15.103:0/1498124556 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b00118c0 con 0x7f45bc0ac950 2020-04-22T14:15:57.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.062+0000 7f45baffd700 1 -- 172.21.15.103:0/1498124556 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45b0011ce0 con 0x7f45bc0ac950 2020-04-22T14:15:57.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.062+0000 7f45c2907700 1 -- 172.21.15.103:0/1498124556 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45bc0ac950 msgr2=0x7f45bc146c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:57.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.062+0000 7f45c2907700 1 --2- 172.21.15.103:0/1498124556 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45bc0ac950 0x7f45bc146c40 secure :-1 s=READY pgs=1561 cs=0 l=1 rx=0x7f45b0002f30 tx=0x7f45b0007a40).stop 2020-04-22T14:15:57.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.062+0000 7f45c2907700 1 -- 172.21.15.103:0/1498124556 shutdown_connections 2020-04-22T14:15:57.080 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.062+0000 7f45c2907700 1 --2- 172.21.15.103:0/1498124556 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45bc1470a0 0x7f45bc143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:57.080 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.062+0000 7f45c2907700 1 --2- 172.21.15.103:0/1498124556 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45bc0ac950 0x7f45bc146c40 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:57.080 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.062+0000 7f45c2907700 1 -- 172.21.15.103:0/1498124556 >> 172.21.15.103:0/1498124556 conn(0x7f45bc05b7b0 msgr2=0x7f45bc0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:57.080 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.062+0000 7f45c2907700 1 -- 172.21.15.103:0/1498124556 shutdown_connections 2020-04-22T14:15:57.080 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.062+0000 7f45c2907700 1 -- 172.21.15.103:0/1498124556 wait complete. 2020-04-22T14:15:57.081 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.063+0000 7f45c2907700 1 Processor -- start 2020-04-22T14:15:57.081 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.063+0000 7f45c2907700 1 -- start start 2020-04-22T14:15:57.081 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.064+0000 7f45c2907700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45bc0b9140 0x7f45bc153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:57.081 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.064+0000 7f45c2907700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f45bc1470a0 0x7f45bc1282d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:57.082 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.064+0000 7f45c2907700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45bc1439c0 con 0x7f45bc0ac950 2020-04-22T14:15:57.082 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.064+0000 7f45c2907700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45bc066750 con 0x7f45bc1470a0 2020-04-22T14:15:57.082 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.064+0000 7f45c2907700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc0649c0 con 0x7f45bc0b9140 2020-04-22T14:15:57.082 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.064+0000 7f45bbfff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f45bc0ac950 0x7f45bc127bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47802/0 (socket says 172.21.15.103:47802) 2020-04-22T14:15:57.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.064+0000 7f45bbfff700 1 -- 172.21.15.103:0/148317640 learned_addr learned my addr 172.21.15.103:0/148317640 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:57.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.064+0000 7f45c0ea4700 1 --2- 172.21.15.103:0/148317640 >> v2:172.21.15.103:3300/0 conn(0x7f45bc1470a0 0x7f45bc1282d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:57.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.064+0000 7f45bb7fe700 1 --2- 172.21.15.103:0/148317640 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45bc0b9140 0x7f45bc153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:57.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.064+0000 7f45b97fa700 1 -- 172.21.15.103:0/148317640 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4059982616 0 0) 0x7f45bc1439c0 con 0x7f45bc0ac950 2020-04-22T14:15:57.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.064+0000 7f45b97fa700 1 -- 172.21.15.103:0/148317640 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f459c002fe0 con 0x7f45bc0ac950 2020-04-22T14:15:57.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.064+0000 7f45c0ea4700 1 -- 172.21.15.103:0/148317640 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45bc0b9140 msgr2=0x7f45bc153e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:57.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.064+0000 7f45c0ea4700 1 --2- 172.21.15.103:0/148317640 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45bc0b9140 0x7f45bc153e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:57.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.064+0000 7f45c0ea4700 1 -- 172.21.15.103:0/148317640 >> v1:172.21.15.103:6789/0 conn(0x7f45bc0ac950 legacy=0x7f45bc127bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:57.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.064+0000 7f45c0ea4700 1 -- 172.21.15.103:0/148317640 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45bc064c60 con 0x7f45bc1470a0 2020-04-22T14:15:57.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.064+0000 7f45c0ea4700 1 --2- 172.21.15.103:0/148317640 >> v2:172.21.15.103:3300/0 conn(0x7f45bc1470a0 0x7f45bc1282d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f45b40032b0 tx=0x7f45b4010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:57.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.064+0000 7f45c0ea4700 1 --2- 172.21.15.103:0/148317640 >> v2:172.21.15.103:3300/0 conn(0x7f45bc1470a0 0x7f45bc1282d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f45b40032b0 tx=0x7f45b4010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:57.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.064+0000 7f45c0ea4700 1 --2- 172.21.15.103:0/148317640 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45bc1470a0 0x7f45bc1282d0 secure :-1 s=READY pgs=1563 cs=0 l=1 rx=0x7f45b40032b0 tx=0x7f45b4010da0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:57.086 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.064+0000 7f45c0ea4700 1 --2- 172.21.15.103:0/148317640 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45bc1470a0 0x7f45bc1282d0 secure :-1 s=THROTTLE_DONE pgs=1563 cs=0 l=1 rx=0x7f45b40032b0 tx=0x7f45b4010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:57.087 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.064+0000 7f45b97fa700 1 -- 172.21.15.103:0/148317640 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45b4005e30 con 0x7f45bc1470a0 2020-04-22T14:15:57.087 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.064+0000 7f45c0ea4700 1 --2- 172.21.15.103:0/148317640 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45bc1470a0 0x7f45bc1282d0 secure :-1 s=THROTTLE_DONE pgs=1563 cs=0 l=1 rx=0x7f45b40032b0 tx=0x7f45b4010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:57.087 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.064+0000 7f45c0ea4700 1 --2- 172.21.15.103:0/148317640 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45bc1470a0 0x7f45bc1282d0 secure :-1 s=THROTTLE_DONE pgs=1563 cs=0 l=1 rx=0x7f45b40032b0 tx=0x7f45b4010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:57.087 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.064+0000 7f45b97fa700 1 -- 172.21.15.103:0/148317640 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b4007560 con 0x7f45bc1470a0 2020-04-22T14:15:57.087 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.065+0000 7f45c2907700 1 -- 172.21.15.103:0/148317640 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45bc064f00 con 0x7f45bc1470a0 2020-04-22T14:15:57.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.065+0000 7f45b97fa700 1 -- 172.21.15.103:0/148317640 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45b4012390 con 0x7f45bc1470a0 2020-04-22T14:15:57.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.065+0000 7f45c2907700 1 -- 172.21.15.103:0/148317640 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45bc0643d0 con 0x7f45bc1470a0 2020-04-22T14:15:57.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.065+0000 7f45c0ea4700 1 --2- 172.21.15.103:0/148317640 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45bc1470a0 0x7f45bc1282d0 secure :-1 s=THROTTLE_DONE pgs=1563 cs=0 l=1 rx=0x7f45b40032b0 tx=0x7f45b4010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:57.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.065+0000 7f45c2907700 1 -- 172.21.15.103:0/148317640 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45bc065100 con 0x7f45bc1470a0 2020-04-22T14:15:57.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.065+0000 7f45b97fa700 1 -- 172.21.15.103:0/148317640 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f45b4010190 con 0x7f45bc1470a0 2020-04-22T14:15:57.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.065+0000 7f45c0ea4700 1 --2- 172.21.15.103:0/148317640 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45bc1470a0 0x7f45bc1282d0 secure :-1 s=THROTTLE_DONE pgs=1563 cs=0 l=1 rx=0x7f45b40032b0 tx=0x7f45b4010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:57.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.066+0000 7f45b97fa700 1 --2- 172.21.15.103:0/148317640 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f459c04dda0 0x7f459c050260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:57.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.066+0000 7f45b97fa700 1 -- 172.21.15.103:0/148317640 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f45b4061850 con 0x7f45bc1470a0 2020-04-22T14:15:57.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.066+0000 7f45bbfff700 1 --2- 172.21.15.103:0/148317640 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f459c04dda0 0x7f459c050260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:57.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.066+0000 7f45bbfff700 1 --2- 172.21.15.103:0/148317640 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f459c04dda0 0x7f459c050260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f45ac0010d0 tx=0x7f45ac0017c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:57.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.066+0000 7f45bbfff700 1 --2- 172.21.15.103:0/148317640 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f459c04dda0 0x7f459c050260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f45ac0010d0 tx=0x7f45ac0017c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:57.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.066+0000 7f45bbfff700 1 --2- 172.21.15.103:0/148317640 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f459c04dda0 0x7f459c050260 secure :-1 s=READY pgs=568 cs=0 l=1 rx=0x7f45ac0010d0 tx=0x7f45ac0017c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:57.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.070+0000 7f45c0ea4700 1 --2- 172.21.15.103:0/148317640 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45bc1470a0 0x7f45bc1282d0 secure :-1 s=THROTTLE_DONE pgs=1563 cs=0 l=1 rx=0x7f45b40032b0 tx=0x7f45b4010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:57.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.070+0000 7f45b97fa700 1 -- 172.21.15.103:0/148317640 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f45bc065100 con 0x7f45bc1470a0 2020-04-22T14:15:57.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.259+0000 7f45c2907700 1 -- 172.21.15.103:0/148317640 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f45bc065100 con 0x7f45bc1470a0 2020-04-22T14:15:57.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.509+0000 7f45c0ea4700 1 --2- 172.21.15.103:0/148317640 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45bc1470a0 0x7f45bc1282d0 secure :-1 s=THROTTLE_DONE pgs=1563 cs=0 l=1 rx=0x7f45b40032b0 tx=0x7f45b4010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:57.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.509+0000 7f45b97fa700 1 -- 172.21.15.103:0/148317640 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v76) v1 ==== 104+0+0 (secure 0 0 0) 0x7f45bc065100 con 0x7f45bc1470a0 2020-04-22T14:15:57.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.511+0000 7f45c2907700 1 -- 172.21.15.103:0/148317640 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f459c04dda0 msgr2=0x7f459c050260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:57.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.511+0000 7f45c2907700 1 --2- 172.21.15.103:0/148317640 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f459c04dda0 0x7f459c050260 secure :-1 s=READY pgs=568 cs=0 l=1 rx=0x7f45ac0010d0 tx=0x7f45ac0017c0).stop 2020-04-22T14:15:57.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.511+0000 7f45c2907700 1 -- 172.21.15.103:0/148317640 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45bc1470a0 msgr2=0x7f45bc1282d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:57.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.511+0000 7f45c2907700 1 --2- 172.21.15.103:0/148317640 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45bc1470a0 0x7f45bc1282d0 secure :-1 s=READY pgs=1563 cs=0 l=1 rx=0x7f45b40032b0 tx=0x7f45b4010da0).stop 2020-04-22T14:15:57.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.511+0000 7f45c2907700 1 -- 172.21.15.103:0/148317640 shutdown_connections 2020-04-22T14:15:57.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.511+0000 7f45c2907700 1 --2- 172.21.15.103:0/148317640 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f459c04dda0 0x7f459c050260 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:57.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.511+0000 7f45c2907700 1 --2- 172.21.15.103:0/148317640 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45bc1470a0 0x7f45bc1282d0 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:57.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.511+0000 7f45c2907700 1 --2- 172.21.15.103:0/148317640 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45bc0b9140 0x7f45bc153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:57.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.511+0000 7f45c2907700 1 -- 172.21.15.103:0/148317640 >> 172.21.15.103:0/148317640 conn(0x7f45bc05b7b0 msgr2=0x7f45bc0b68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:57.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.511+0000 7f45c2907700 1 -- 172.21.15.103:0/148317640 shutdown_connections 2020-04-22T14:15:57.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.511+0000 7f45c2907700 1 -- 172.21.15.103:0/148317640 wait complete. 2020-04-22T14:15:57.524 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:57.538 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-04-22T14:15:57.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.686+0000 7f3633ac7700 1 Processor -- start 2020-04-22T14:15:57.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.686+0000 7f3633ac7700 1 -- start start 2020-04-22T14:15:57.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.687+0000 7f3633ac7700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f362c0b4820 0x7f362c0acb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:57.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.687+0000 7f3633ac7700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f362c0af030 con 0x7f362c141f20 2020-04-22T14:15:57.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.687+0000 7f3633ac7700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f362c060250 con 0x7f362c061a30 2020-04-22T14:15:57.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.687+0000 7f3633ac7700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f362c0623c0 con 0x7f362c0b4820 2020-04-22T14:15:57.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.687+0000 7f3631062700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f362c0b4820 0x7f362c0acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:57.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.687+0000 7f3631863700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f362c061a30 0x7f362c0ae920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47812/0 (socket says 172.21.15.103:47812) 2020-04-22T14:15:57.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.687+0000 7f3631863700 1 -- 172.21.15.103:0/1891638800 learned_addr learned my addr 172.21.15.103:0/1891638800 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:57.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.687+0000 7f3631062700 1 -- 172.21.15.103:0/1891638800 >> v1:172.21.15.103:6789/0 conn(0x7f362c061a30 legacy=0x7f362c0ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:57.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.687+0000 7f3631062700 1 -- 172.21.15.103:0/1891638800 >> v1:172.21.15.86:6789/0 conn(0x7f362c141f20 legacy=0x7f362c142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:57.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.687+0000 7f3630861700 1 -- 172.21.15.103:0/1891638800 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4235646536 0 0) 0x7f362c060250 con 0x7f362c061a30 2020-04-22T14:15:57.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.687+0000 7f3631062700 1 -- 172.21.15.103:0/1891638800 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f362c062660 con 0x7f362c0b4820 2020-04-22T14:15:57.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.687+0000 7f3631062700 1 --2- 172.21.15.103:0/1891638800 >> v2:172.21.15.103:3300/0 conn(0x7f362c0b4820 0x7f362c0acb10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f361c002f30 tx=0x7f361c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:57.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.687+0000 7f3631062700 1 --2- 172.21.15.103:0/1891638800 >> v2:172.21.15.103:3300/0 conn(0x7f362c0b4820 0x7f362c0acb10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f361c002f30 tx=0x7f361c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:57.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.687+0000 7f3631062700 1 --2- 172.21.15.103:0/1891638800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f362c0b4820 0x7f362c0acb10 secure :-1 s=READY pgs=1565 cs=0 l=1 rx=0x7f361c002f30 tx=0x7f361c007a40).ready entity=mon.1 client_cookie=433e5337d49ac01d server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:57.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.687+0000 7f3631062700 1 --2- 172.21.15.103:0/1891638800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f362c0b4820 0x7f362c0acb10 secure :-1 s=THROTTLE_DONE pgs=1565 cs=0 l=1 rx=0x7f361c002f30 tx=0x7f361c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:57.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.687+0000 7f3630861700 1 -- 172.21.15.103:0/1891638800 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f361c011470 con 0x7f362c0b4820 2020-04-22T14:15:57.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.687+0000 7f3631062700 1 --2- 172.21.15.103:0/1891638800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f362c0b4820 0x7f362c0acb10 secure :-1 s=THROTTLE_DONE pgs=1565 cs=0 l=1 rx=0x7f361c002f30 tx=0x7f361c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:57.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.688+0000 7f3630861700 1 -- 172.21.15.103:0/1891638800 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f361c0115d0 con 0x7f362c0b4820 2020-04-22T14:15:57.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.688+0000 7f3631062700 1 --2- 172.21.15.103:0/1891638800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f362c0b4820 0x7f362c0acb10 secure :-1 s=THROTTLE_DONE pgs=1565 cs=0 l=1 rx=0x7f361c002f30 tx=0x7f361c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:57.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.688+0000 7f3630861700 1 -- 172.21.15.103:0/1891638800 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f361c0119f0 con 0x7f362c0b4820 2020-04-22T14:15:57.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.688+0000 7f3633ac7700 1 -- 172.21.15.103:0/1891638800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f362c0b4820 msgr2=0x7f362c0acb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:57.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.688+0000 7f3633ac7700 1 --2- 172.21.15.103:0/1891638800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f362c0b4820 0x7f362c0acb10 secure :-1 s=READY pgs=1565 cs=0 l=1 rx=0x7f361c002f30 tx=0x7f361c007a40).stop 2020-04-22T14:15:57.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.688+0000 7f3633ac7700 1 -- 172.21.15.103:0/1891638800 shutdown_connections 2020-04-22T14:15:57.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.688+0000 7f3633ac7700 1 --2- 172.21.15.103:0/1891638800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f362c0b4820 0x7f362c0acb10 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:57.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.688+0000 7f3633ac7700 1 -- 172.21.15.103:0/1891638800 >> 172.21.15.103:0/1891638800 conn(0x7f362c05b7b0 msgr2=0x7f362c0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:57.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.688+0000 7f3633ac7700 1 -- 172.21.15.103:0/1891638800 shutdown_connections 2020-04-22T14:15:57.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.688+0000 7f3633ac7700 1 -- 172.21.15.103:0/1891638800 wait complete. 2020-04-22T14:15:57.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.689+0000 7f3633ac7700 1 Processor -- start 2020-04-22T14:15:57.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.689+0000 7f3633ac7700 1 -- start start 2020-04-22T14:15:57.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.690+0000 7f3633ac7700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f362c061a30 0x7f362c144810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:57.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.690+0000 7f3633ac7700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f362c144c70 con 0x7f362c141f20 2020-04-22T14:15:57.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.690+0000 7f3633ac7700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f362c136200 con 0x7f362c0b4820 2020-04-22T14:15:57.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.690+0000 7f3633ac7700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f362c1364a0 con 0x7f362c061a30 2020-04-22T14:15:57.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.690+0000 7f3631863700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f362c061a30 0x7f362c144810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:57.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.690+0000 7f3631062700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f362c0b4820 0x7f362c113f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47820/0 (socket says 172.21.15.103:47820) 2020-04-22T14:15:57.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.690+0000 7f3631062700 1 -- 172.21.15.103:0/3091120983 learned_addr learned my addr 172.21.15.103:0/3091120983 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:57.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.690+0000 7f3631863700 1 -- 172.21.15.103:0/3091120983 >> v1:172.21.15.103:6789/0 conn(0x7f362c0b4820 legacy=0x7f362c113f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:57.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.690+0000 7f3631863700 1 -- 172.21.15.103:0/3091120983 >> v1:172.21.15.86:6789/0 conn(0x7f362c141f20 legacy=0x7f362c135480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:57.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.690+0000 7f3631863700 1 -- 172.21.15.103:0/3091120983 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f362c136740 con 0x7f362c061a30 2020-04-22T14:15:57.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.690+0000 7f361affd700 1 -- 172.21.15.103:0/3091120983 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2181277811 0 0) 0x7f362c136200 con 0x7f362c0b4820 2020-04-22T14:15:57.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.690+0000 7f3631863700 1 --2- 172.21.15.103:0/3091120983 >> v2:172.21.15.103:3300/0 conn(0x7f362c061a30 0x7f362c144810 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3628000b80 tx=0x7f36280109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:57.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.690+0000 7f3631863700 1 --2- 172.21.15.103:0/3091120983 >> v2:172.21.15.103:3300/0 conn(0x7f362c061a30 0x7f362c144810 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3628000b80 tx=0x7f36280109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:57.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.690+0000 7f3631863700 1 --2- 172.21.15.103:0/3091120983 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f362c061a30 0x7f362c144810 secure :-1 s=READY pgs=1567 cs=0 l=1 rx=0x7f3628000b80 tx=0x7f36280109b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:57.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.690+0000 7f3631863700 1 --2- 172.21.15.103:0/3091120983 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f362c061a30 0x7f362c144810 secure :-1 s=THROTTLE_DONE pgs=1567 cs=0 l=1 rx=0x7f3628000b80 tx=0x7f36280109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:57.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.690+0000 7f361affd700 1 -- 172.21.15.103:0/3091120983 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3628005ca0 con 0x7f362c061a30 2020-04-22T14:15:57.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.690+0000 7f3631863700 1 --2- 172.21.15.103:0/3091120983 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f362c061a30 0x7f362c144810 secure :-1 s=THROTTLE_DONE pgs=1567 cs=0 l=1 rx=0x7f3628000b80 tx=0x7f36280109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:57.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.690+0000 7f3631863700 1 --2- 172.21.15.103:0/3091120983 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f362c061a30 0x7f362c144810 secure :-1 s=THROTTLE_DONE pgs=1567 cs=0 l=1 rx=0x7f3628000b80 tx=0x7f36280109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:57.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.690+0000 7f361affd700 1 -- 172.21.15.103:0/3091120983 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3628005e00 con 0x7f362c061a30 2020-04-22T14:15:57.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.690+0000 7f3633ac7700 1 -- 172.21.15.103:0/3091120983 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f362c135ef0 con 0x7f362c061a30 2020-04-22T14:15:57.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.690+0000 7f361affd700 1 -- 172.21.15.103:0/3091120983 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36280062c0 con 0x7f362c061a30 2020-04-22T14:15:57.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.690+0000 7f3633ac7700 1 -- 172.21.15.103:0/3091120983 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f362c065fd0 con 0x7f362c061a30 2020-04-22T14:15:57.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.691+0000 7f3631863700 1 --2- 172.21.15.103:0/3091120983 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f362c061a30 0x7f362c144810 secure :-1 s=THROTTLE_DONE pgs=1567 cs=0 l=1 rx=0x7f3628000b80 tx=0x7f36280109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:57.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.692+0000 7f361affd700 1 -- 172.21.15.103:0/3091120983 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f3628006540 con 0x7f362c061a30 2020-04-22T14:15:57.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.692+0000 7f3631863700 1 --2- 172.21.15.103:0/3091120983 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f362c061a30 0x7f362c144810 secure :-1 s=THROTTLE_DONE pgs=1567 cs=0 l=1 rx=0x7f3628000b80 tx=0x7f36280109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:57.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.692+0000 7f3633ac7700 1 -- 172.21.15.103:0/3091120983 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f362c056c90 con 0x7f362c061a30 2020-04-22T14:15:57.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.692+0000 7f361affd700 1 --2- 172.21.15.103:0/3091120983 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f360c04d7d0 0x7f360c04fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:57.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.692+0000 7f361affd700 1 -- 172.21.15.103:0/3091120983 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f36280090c0 con 0x7f362c061a30 2020-04-22T14:15:57.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.692+0000 7f3631062700 1 --2- 172.21.15.103:0/3091120983 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f360c04d7d0 0x7f360c04fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:57.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.693+0000 7f3631062700 1 --2- 172.21.15.103:0/3091120983 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f360c04d7d0 0x7f360c04fc90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f361c000b80 tx=0x7f361c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:57.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.693+0000 7f3631062700 1 --2- 172.21.15.103:0/3091120983 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f360c04d7d0 0x7f360c04fc90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f361c000b80 tx=0x7f361c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:57.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.693+0000 7f3631062700 1 --2- 172.21.15.103:0/3091120983 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f360c04d7d0 0x7f360c04fc90 secure :-1 s=READY pgs=570 cs=0 l=1 rx=0x7f361c000b80 tx=0x7f361c007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:57.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.696+0000 7f3631863700 1 --2- 172.21.15.103:0/3091120983 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f362c061a30 0x7f362c144810 secure :-1 s=THROTTLE_DONE pgs=1567 cs=0 l=1 rx=0x7f3628000b80 tx=0x7f36280109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:57.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.696+0000 7f361affd700 1 -- 172.21.15.103:0/3091120983 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f362803c9e0 con 0x7f362c061a30 2020-04-22T14:15:57.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:57.838+0000 7f3633ac7700 1 -- 172.21.15.103:0/3091120983 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f362c0b8430 con 0x7f362c061a30 2020-04-22T14:15:58.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.522+0000 7f3631863700 1 --2- 172.21.15.103:0/3091120983 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f362c061a30 0x7f362c144810 secure :-1 s=THROTTLE_DONE pgs=1567 cs=0 l=1 rx=0x7f3628000b80 tx=0x7f36280109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:58.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.522+0000 7f361affd700 1 -- 172.21.15.103:0/3091120983 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v105) v1 ==== 185+0+0 (secure 0 0 0) 0x7f3628040000 con 0x7f362c061a30 2020-04-22T14:15:58.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.524+0000 7f3633ac7700 1 -- 172.21.15.103:0/3091120983 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f360c04d7d0 msgr2=0x7f360c04fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:58.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.524+0000 7f3633ac7700 1 --2- 172.21.15.103:0/3091120983 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f360c04d7d0 0x7f360c04fc90 secure :-1 s=READY pgs=570 cs=0 l=1 rx=0x7f361c000b80 tx=0x7f361c007a40).stop 2020-04-22T14:15:58.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.524+0000 7f3633ac7700 1 -- 172.21.15.103:0/3091120983 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f362c061a30 msgr2=0x7f362c144810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:58.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.524+0000 7f3633ac7700 1 --2- 172.21.15.103:0/3091120983 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f362c061a30 0x7f362c144810 secure :-1 s=READY pgs=1567 cs=0 l=1 rx=0x7f3628000b80 tx=0x7f36280109b0).stop 2020-04-22T14:15:58.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.524+0000 7f3633ac7700 1 -- 172.21.15.103:0/3091120983 shutdown_connections 2020-04-22T14:15:58.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.524+0000 7f3633ac7700 1 --2- 172.21.15.103:0/3091120983 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f360c04d7d0 0x7f360c04fc90 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:58.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.524+0000 7f3633ac7700 1 --2- 172.21.15.103:0/3091120983 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f362c061a30 0x7f362c144810 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:58.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.524+0000 7f3633ac7700 1 -- 172.21.15.103:0/3091120983 >> 172.21.15.103:0/3091120983 conn(0x7f362c05b7b0 msgr2=0x7f362c0b8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:58.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.524+0000 7f3633ac7700 1 -- 172.21.15.103:0/3091120983 shutdown_connections 2020-04-22T14:15:58.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.524+0000 7f3633ac7700 1 -- 172.21.15.103:0/3091120983 wait complete. 2020-04-22T14:15:58.530 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' removed 2020-04-22T14:15:58.539 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:58.554 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2020-04-22T14:15:58.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.710+0000 7ffaff0dd700 1 Processor -- start 2020-04-22T14:15:58.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.710+0000 7ffaff0dd700 1 -- start start 2020-04-22T14:15:58.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.711+0000 7ffaff0dd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffaf80b3bd0 0x7ffaf8143650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:58.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.711+0000 7ffaff0dd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffaf8143ab0 0x7ffaf8143f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:58.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.711+0000 7ffaff0dd700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaf8148310 con 0x7ffaf80b9140 2020-04-22T14:15:58.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.711+0000 7ffaff0dd700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaf81485b0 con 0x7ffaf80b3bd0 2020-04-22T14:15:58.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.711+0000 7ffaff0dd700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf80b9520 con 0x7ffaf8143ab0 2020-04-22T14:15:58.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.711+0000 7ffaf7fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffaf80b3bd0 0x7ffaf8143650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:58.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.711+0000 7ffafce79700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ffaf80b9140 0x7ffaf80aed90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47826/0 (socket says 172.21.15.103:47826) 2020-04-22T14:15:58.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.711+0000 7ffafce79700 1 -- 172.21.15.103:0/4124398590 learned_addr learned my addr 172.21.15.103:0/4124398590 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:58.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.711+0000 7ffaf7fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffaf80b3bd0 0x7ffaf8143650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55636/0 (socket says 172.21.15.103:55636) 2020-04-22T14:15:58.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.711+0000 7ffafd67a700 1 --2- 172.21.15.103:0/4124398590 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffaf8143ab0 0x7ffaf8143f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:58.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.711+0000 7ffaf7fff700 1 -- 172.21.15.103:0/4124398590 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffaf8143ab0 msgr2=0x7ffaf8143f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:58.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.711+0000 7ffaf7fff700 1 --2- 172.21.15.103:0/4124398590 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffaf8143ab0 0x7ffaf8143f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:58.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.711+0000 7ffaf7fff700 1 -- 172.21.15.103:0/4124398590 >> v1:172.21.15.103:6789/0 conn(0x7ffaf80b9140 legacy=0x7ffaf80aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:58.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.711+0000 7ffaf77fe700 1 -- 172.21.15.103:0/4124398590 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3875562830 0 0) 0x7ffaf8148310 con 0x7ffaf80b9140 2020-04-22T14:15:58.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.711+0000 7ffaf7fff700 1 -- 172.21.15.103:0/4124398590 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf80b3050 con 0x7ffaf80b3bd0 2020-04-22T14:15:58.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.711+0000 7ffaf7fff700 1 --2- 172.21.15.103:0/4124398590 >> v2:172.21.15.103:3300/0 conn(0x7ffaf80b3bd0 0x7ffaf8143650 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ffaec002f30 tx=0x7ffaec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:58.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.711+0000 7ffaf7fff700 1 --2- 172.21.15.103:0/4124398590 >> v2:172.21.15.103:3300/0 conn(0x7ffaf80b3bd0 0x7ffaf8143650 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ffaec002f30 tx=0x7ffaec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:58.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.711+0000 7ffaf7fff700 1 --2- 172.21.15.103:0/4124398590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffaf80b3bd0 0x7ffaf8143650 secure :-1 s=READY pgs=1569 cs=0 l=1 rx=0x7ffaec002f30 tx=0x7ffaec007a40).ready entity=mon.1 client_cookie=d0367d3391d4f173 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:58.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.712+0000 7ffaf7fff700 1 --2- 172.21.15.103:0/4124398590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffaf80b3bd0 0x7ffaf8143650 secure :-1 s=THROTTLE_DONE pgs=1569 cs=0 l=1 rx=0x7ffaec002f30 tx=0x7ffaec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:58.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.712+0000 7ffaf77fe700 1 -- 172.21.15.103:0/4124398590 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffaec011470 con 0x7ffaf80b3bd0 2020-04-22T14:15:58.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.712+0000 7ffaf7fff700 1 --2- 172.21.15.103:0/4124398590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffaf80b3bd0 0x7ffaf8143650 secure :-1 s=THROTTLE_DONE pgs=1569 cs=0 l=1 rx=0x7ffaec002f30 tx=0x7ffaec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:58.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.712+0000 7ffaf77fe700 1 -- 172.21.15.103:0/4124398590 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaec011610 con 0x7ffaf80b3bd0 2020-04-22T14:15:58.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.712+0000 7ffaf7fff700 1 --2- 172.21.15.103:0/4124398590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffaf80b3bd0 0x7ffaf8143650 secure :-1 s=THROTTLE_DONE pgs=1569 cs=0 l=1 rx=0x7ffaec002f30 tx=0x7ffaec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:58.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.712+0000 7ffaf77fe700 1 -- 172.21.15.103:0/4124398590 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffaec0119f0 con 0x7ffaf80b3bd0 2020-04-22T14:15:58.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.712+0000 7ffaff0dd700 1 -- 172.21.15.103:0/4124398590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffaf80b3bd0 msgr2=0x7ffaf8143650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:58.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.712+0000 7ffaff0dd700 1 --2- 172.21.15.103:0/4124398590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffaf80b3bd0 0x7ffaf8143650 secure :-1 s=READY pgs=1569 cs=0 l=1 rx=0x7ffaec002f30 tx=0x7ffaec007a40).stop 2020-04-22T14:15:58.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.712+0000 7ffaff0dd700 1 -- 172.21.15.103:0/4124398590 shutdown_connections 2020-04-22T14:15:58.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.712+0000 7ffaff0dd700 1 --2- 172.21.15.103:0/4124398590 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffaf8143ab0 0x7ffaf8143f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:58.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.712+0000 7ffaff0dd700 1 --2- 172.21.15.103:0/4124398590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffaf80b3bd0 0x7ffaf8143650 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:58.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.712+0000 7ffaff0dd700 1 -- 172.21.15.103:0/4124398590 >> 172.21.15.103:0/4124398590 conn(0x7ffaf805b7b0 msgr2=0x7ffaf80b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:58.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.712+0000 7ffaff0dd700 1 -- 172.21.15.103:0/4124398590 shutdown_connections 2020-04-22T14:15:58.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.712+0000 7ffaff0dd700 1 -- 172.21.15.103:0/4124398590 wait complete. 2020-04-22T14:15:58.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.713+0000 7ffaff0dd700 1 Processor -- start 2020-04-22T14:15:58.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.713+0000 7ffaff0dd700 1 -- start start 2020-04-22T14:15:58.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.714+0000 7ffaff0dd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ffaf80b3bd0 0x7ffaf80654d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:58.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.714+0000 7ffaff0dd700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaf8064800 con 0x7ffaf8143ab0 2020-04-22T14:15:58.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.714+0000 7ffaff0dd700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaf8064aa0 con 0x7ffaf80b9140 2020-04-22T14:15:58.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.714+0000 7ffaff0dd700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaf8064d40 con 0x7ffaf80b3bd0 2020-04-22T14:15:58.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.714+0000 7ffaf7fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ffaf80b9140 0x7ffaf813b010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47836/0 (socket says 172.21.15.103:47836) 2020-04-22T14:15:58.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.714+0000 7ffaf7fff700 1 -- 172.21.15.103:0/265452418 learned_addr learned my addr 172.21.15.103:0/265452418 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:58.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.714+0000 7ffafce79700 1 --2- 172.21.15.103:0/265452418 >> v2:172.21.15.86:3300/0 conn(0x7ffaf80b3bd0 0x7ffaf80654d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:58.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.714+0000 7ffaf5ffb700 1 -- 172.21.15.103:0/265452418 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 470444066 0 0) 0x7ffaf8064aa0 con 0x7ffaf80b9140 2020-04-22T14:15:58.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.714+0000 7ffaf5ffb700 1 -- 172.21.15.103:0/265452418 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffad8002fe0 con 0x7ffaf80b9140 2020-04-22T14:15:58.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.714+0000 7ffaf5ffb700 1 -- 172.21.15.103:0/265452418 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4147129409 0 0) 0x7ffad8002fe0 con 0x7ffaf80b9140 2020-04-22T14:15:58.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.714+0000 7ffaf5ffb700 1 -- 172.21.15.103:0/265452418 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ffaf8064aa0 con 0x7ffaf80b9140 2020-04-22T14:15:58.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.714+0000 7ffaf5ffb700 1 -- 172.21.15.103:0/265452418 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7ffaec008e10 con 0x7ffaf80b9140 2020-04-22T14:15:58.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.715+0000 7ffafce79700 1 -- 172.21.15.103:0/265452418 >> v1:172.21.15.103:6789/0 conn(0x7ffaf80b9140 legacy=0x7ffaf813b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:58.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.715+0000 7ffafce79700 1 -- 172.21.15.103:0/265452418 >> v1:172.21.15.86:6789/0 conn(0x7ffaf8143ab0 legacy=0x7ffaf8146380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:58.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.715+0000 7ffafce79700 1 -- 172.21.15.103:0/265452418 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf80651e0 con 0x7ffaf80b3bd0 2020-04-22T14:15:58.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.715+0000 7ffafce79700 1 --2- 172.21.15.103:0/265452418 >> v2:172.21.15.86:3300/0 conn(0x7ffaf80b3bd0 0x7ffaf80654d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffaf0007ca0 tx=0x7ffae8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:58.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.715+0000 7ffafce79700 1 --2- 172.21.15.103:0/265452418 >> v2:172.21.15.86:3300/0 conn(0x7ffaf80b3bd0 0x7ffaf80654d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffaf0007ca0 tx=0x7ffae8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:58.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.715+0000 7ffafce79700 1 --2- 172.21.15.103:0/265452418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffaf80b3bd0 0x7ffaf80654d0 secure :-1 s=READY pgs=836 cs=0 l=1 rx=0x7ffaf0007ca0 tx=0x7ffae8010880).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:58.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.715+0000 7ffafce79700 1 --2- 172.21.15.103:0/265452418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffaf80b3bd0 0x7ffaf80654d0 secure :-1 s=THROTTLE_DONE pgs=836 cs=0 l=1 rx=0x7ffaf0007ca0 tx=0x7ffae8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:58.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.715+0000 7ffaf5ffb700 1 -- 172.21.15.103:0/265452418 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffae8005a90 con 0x7ffaf80b3bd0 2020-04-22T14:15:58.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.715+0000 7ffafce79700 1 --2- 172.21.15.103:0/265452418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffaf80b3bd0 0x7ffaf80654d0 secure :-1 s=THROTTLE_DONE pgs=836 cs=0 l=1 rx=0x7ffaf0007ca0 tx=0x7ffae8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:58.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.715+0000 7ffaff0dd700 1 -- 172.21.15.103:0/265452418 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaf813b720 con 0x7ffaf80b3bd0 2020-04-22T14:15:58.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.715+0000 7ffaf5ffb700 1 -- 172.21.15.103:0/265452418 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae8005bf0 con 0x7ffaf80b3bd0 2020-04-22T14:15:58.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.715+0000 7ffafce79700 1 --2- 172.21.15.103:0/265452418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffaf80b3bd0 0x7ffaf80654d0 secure :-1 s=THROTTLE_DONE pgs=836 cs=0 l=1 rx=0x7ffaf0007ca0 tx=0x7ffae8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:58.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.715+0000 7ffaf5ffb700 1 -- 172.21.15.103:0/265452418 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffae80060d0 con 0x7ffaf80b3bd0 2020-04-22T14:15:58.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.715+0000 7ffaff0dd700 1 -- 172.21.15.103:0/265452418 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaf80b1ea0 con 0x7ffaf80b3bd0 2020-04-22T14:15:58.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.716+0000 7ffafce79700 1 --2- 172.21.15.103:0/265452418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffaf80b3bd0 0x7ffaf80654d0 secure :-1 s=THROTTLE_DONE pgs=836 cs=0 l=1 rx=0x7ffaf0007ca0 tx=0x7ffae8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:58.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.716+0000 7ffaff0dd700 1 -- 172.21.15.103:0/265452418 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaf813ba00 con 0x7ffaf80b3bd0 2020-04-22T14:15:58.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.716+0000 7ffaf5ffb700 1 -- 172.21.15.103:0/265452418 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ffae800a360 con 0x7ffaf80b3bd0 2020-04-22T14:15:58.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.716+0000 7ffafce79700 1 --2- 172.21.15.103:0/265452418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffaf80b3bd0 0x7ffaf80654d0 secure :-1 s=THROTTLE_DONE pgs=836 cs=0 l=1 rx=0x7ffaf0007ca0 tx=0x7ffae8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:58.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.716+0000 7ffaf5ffb700 1 --2- 172.21.15.103:0/265452418 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffad804df80 0x7ffad8050440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:58.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.716+0000 7ffaf5ffb700 1 -- 172.21.15.103:0/265452418 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5764+0+0 (secure 0 0 0) 0x7ffae80090c0 con 0x7ffaf80b3bd0 2020-04-22T14:15:58.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.717+0000 7ffaf7fff700 1 --2- 172.21.15.103:0/265452418 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffad804df80 0x7ffad8050440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:58.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.717+0000 7ffaf7fff700 1 --2- 172.21.15.103:0/265452418 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffad804df80 0x7ffad8050440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffaec008320 tx=0x7ffaec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:58.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.717+0000 7ffaf7fff700 1 --2- 172.21.15.103:0/265452418 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffad804df80 0x7ffad8050440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffaec008320 tx=0x7ffaec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:58.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.717+0000 7ffaf7fff700 1 --2- 172.21.15.103:0/265452418 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffad804df80 0x7ffad8050440 secure :-1 s=READY pgs=571 cs=0 l=1 rx=0x7ffaec008320 tx=0x7ffaec007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:58.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.720+0000 7ffafce79700 1 --2- 172.21.15.103:0/265452418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffaf80b3bd0 0x7ffaf80654d0 secure :-1 s=THROTTLE_DONE pgs=836 cs=0 l=1 rx=0x7ffaf0007ca0 tx=0x7ffae8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:58.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.720+0000 7ffaf5ffb700 1 -- 172.21.15.103:0/265452418 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ffae803c610 con 0x7ffaf80b3bd0 2020-04-22T14:15:58.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:58.860+0000 7ffaff0dd700 1 -- 172.21.15.103:0/265452418 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ffaf8056c90 con 0x7ffaf80b3bd0 2020-04-22T14:15:59.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.522+0000 7ffafce79700 1 --2- 172.21.15.103:0/265452418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffaf80b3bd0 0x7ffaf80654d0 secure :-1 s=THROTTLE_DONE pgs=836 cs=0 l=1 rx=0x7ffaf0007ca0 tx=0x7ffae8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:59.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.522+0000 7ffaf5ffb700 1 -- 172.21.15.103:0/265452418 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v106) v1 ==== 173+0+0 (secure 0 0 0) 0x7ffae803fc30 con 0x7ffaf80b3bd0 2020-04-22T14:15:59.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.524+0000 7ffaff0dd700 1 -- 172.21.15.103:0/265452418 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffad804df80 msgr2=0x7ffad8050440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:59.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.524+0000 7ffaff0dd700 1 --2- 172.21.15.103:0/265452418 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffad804df80 0x7ffad8050440 secure :-1 s=READY pgs=571 cs=0 l=1 rx=0x7ffaec008320 tx=0x7ffaec007a40).stop 2020-04-22T14:15:59.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.524+0000 7ffaff0dd700 1 -- 172.21.15.103:0/265452418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffaf80b3bd0 msgr2=0x7ffaf80654d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:59.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.524+0000 7ffaff0dd700 1 --2- 172.21.15.103:0/265452418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffaf80b3bd0 0x7ffaf80654d0 secure :-1 s=READY pgs=836 cs=0 l=1 rx=0x7ffaf0007ca0 tx=0x7ffae8010880).stop 2020-04-22T14:15:59.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.525+0000 7ffaff0dd700 1 -- 172.21.15.103:0/265452418 shutdown_connections 2020-04-22T14:15:59.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.525+0000 7ffaff0dd700 1 --2- 172.21.15.103:0/265452418 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffad804df80 0x7ffad8050440 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:59.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.525+0000 7ffaff0dd700 1 --2- 172.21.15.103:0/265452418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffaf80b3bd0 0x7ffaf80654d0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:59.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.525+0000 7ffaff0dd700 1 -- 172.21.15.103:0/265452418 >> 172.21.15.103:0/265452418 conn(0x7ffaf805b7b0 msgr2=0x7ffaf80b6940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:59.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.525+0000 7ffaff0dd700 1 -- 172.21.15.103:0/265452418 shutdown_connections 2020-04-22T14:15:59.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.525+0000 7ffaff0dd700 1 -- 172.21.15.103:0/265452418 wait complete. 2020-04-22T14:15:59.528 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' removed 2020-04-22T14:15:59.539 INFO:tasks.ceph.mds.a:Restarting daemon 2020-04-22T14:15:59.539 INFO:tasks.ceph.mds.a:Stopping old one... 2020-04-22T14:15:59.539 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-04-22T14:15:59.540 INFO:teuthology.orchestra.run:waiting for 300 2020-04-22T14:15:59.540 INFO:tasks.ceph.mds.b:Restarting daemon 2020-04-22T14:15:59.540 INFO:tasks.ceph.mds.b:Stopping old one... 2020-04-22T14:15:59.540 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-04-22T14:15:59.540 INFO:teuthology.orchestra.run:waiting for 300 2020-04-22T14:15:59.548 INFO:tasks.ceph.mds.a:Stopped 2020-04-22T14:15:59.548 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:59.550 INFO:tasks.ceph.mds.b:Stopped 2020-04-22T14:15:59.550 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:15:59.602 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-04-22T14:15:59.605 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-04-22T14:15:59.645 INFO:tasks.ceph.mds.a:Started 2020-04-22T14:15:59.645 DEBUG:teuthology.parallel:result is None 2020-04-22T14:15:59.647 INFO:tasks.ceph.mds.b:Started 2020-04-22T14:15:59.647 DEBUG:teuthology.parallel:result is None 2020-04-22T14:15:59.648 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:15:59.662 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2020-04-22T14:15:59.726 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2020-04-22T14:15:59.729 INFO:tasks.ceph.mds.b.smithi086.stdout:starting mds.b at 2020-04-22T14:15:59.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.815+0000 7f581cec1700 1 Processor -- start 2020-04-22T14:15:59.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.815+0000 7f581cec1700 1 -- start start 2020-04-22T14:15:59.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.816+0000 7f581cec1700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f58180b86a0 0x7f581805b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:59.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.816+0000 7f581cec1700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5818143a50 0x7f5818143f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:15:59.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.816+0000 7f581cec1700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f581814ab90 con 0x7f581805b0b0 2020-04-22T14:15:59.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.816+0000 7f581cec1700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5818146830 con 0x7f58180b86a0 2020-04-22T14:15:59.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.816+0000 7f581cec1700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5818146a20 con 0x7f5818143a50 2020-04-22T14:15:59.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.816+0000 7f5815d9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f58180b86a0 0x7f581805b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:59.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.816+0000 7f5815d9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f58180b86a0 0x7f581805b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55664/0 (socket says 172.21.15.103:55664) 2020-04-22T14:15:59.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.816+0000 7f581659c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f581805b0b0 0x7f581805f800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47852/0 (socket says 172.21.15.103:47852) 2020-04-22T14:15:59.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.816+0000 7f5815d9b700 1 -- 172.21.15.103:0/3931887440 learned_addr learned my addr 172.21.15.103:0/3931887440 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:15:59.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.817+0000 7f5816d9d700 1 --2- 172.21.15.103:0/3931887440 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5818143a50 0x7f5818143f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:59.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.817+0000 7f5815d9b700 1 -- 172.21.15.103:0/3931887440 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5818143a50 msgr2=0x7f5818143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:15:59.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.817+0000 7f5815d9b700 1 --2- 172.21.15.103:0/3931887440 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5818143a50 0x7f5818143f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:59.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.817+0000 7f581559a700 1 -- 172.21.15.103:0/3931887440 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2142906357 0 0) 0x7f581814ab90 con 0x7f581805b0b0 2020-04-22T14:15:59.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.817+0000 7f5815d9b700 1 -- 172.21.15.103:0/3931887440 >> v1:172.21.15.103:6789/0 conn(0x7f581805b0b0 legacy=0x7f581805f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:59.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.817+0000 7f5815d9b700 1 -- 172.21.15.103:0/3931887440 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f581805ff10 con 0x7f58180b86a0 2020-04-22T14:15:59.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.817+0000 7f5815d9b700 1 --2- 172.21.15.103:0/3931887440 >> v2:172.21.15.103:3300/0 conn(0x7f58180b86a0 0x7f581805b490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5818060ab0 tx=0x7f58080088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:59.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.817+0000 7f5815d9b700 1 --2- 172.21.15.103:0/3931887440 >> v2:172.21.15.103:3300/0 conn(0x7f58180b86a0 0x7f581805b490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5818060ab0 tx=0x7f58080088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:59.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.817+0000 7f5815d9b700 1 --2- 172.21.15.103:0/3931887440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58180b86a0 0x7f581805b490 secure :-1 s=READY pgs=1577 cs=0 l=1 rx=0x7f5818060ab0 tx=0x7f58080088e0).ready entity=mon.1 client_cookie=7eafde301d8ad5b7 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:59.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.817+0000 7f5815d9b700 1 --2- 172.21.15.103:0/3931887440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58180b86a0 0x7f581805b490 secure :-1 s=THROTTLE_DONE pgs=1577 cs=0 l=1 rx=0x7f5818060ab0 tx=0x7f58080088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:59.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.817+0000 7f581559a700 1 -- 172.21.15.103:0/3931887440 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5808011670 con 0x7f58180b86a0 2020-04-22T14:15:59.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.817+0000 7f5815d9b700 1 --2- 172.21.15.103:0/3931887440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58180b86a0 0x7f581805b490 secure :-1 s=THROTTLE_DONE pgs=1577 cs=0 l=1 rx=0x7f5818060ab0 tx=0x7f58080088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:59.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.817+0000 7f5815d9b700 1 --2- 172.21.15.103:0/3931887440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58180b86a0 0x7f581805b490 secure :-1 s=THROTTLE_DONE pgs=1577 cs=0 l=1 rx=0x7f5818060ab0 tx=0x7f58080088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:59.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.817+0000 7f581559a700 1 -- 172.21.15.103:0/3931887440 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5808011810 con 0x7f58180b86a0 2020-04-22T14:15:59.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.817+0000 7f581559a700 1 -- 172.21.15.103:0/3931887440 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5808011bf0 con 0x7f58180b86a0 2020-04-22T14:15:59.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.817+0000 7f581cec1700 1 -- 172.21.15.103:0/3931887440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58180b86a0 msgr2=0x7f581805b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:59.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.817+0000 7f581cec1700 1 --2- 172.21.15.103:0/3931887440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58180b86a0 0x7f581805b490 secure :-1 s=READY pgs=1577 cs=0 l=1 rx=0x7f5818060ab0 tx=0x7f58080088e0).stop 2020-04-22T14:15:59.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.818+0000 7f581cec1700 1 -- 172.21.15.103:0/3931887440 shutdown_connections 2020-04-22T14:15:59.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.818+0000 7f581cec1700 1 --2- 172.21.15.103:0/3931887440 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5818143a50 0x7f5818143f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:15:59.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.818+0000 7f581cec1700 1 --2- 172.21.15.103:0/3931887440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58180b86a0 0x7f581805b490 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:59.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.818+0000 7f581cec1700 1 -- 172.21.15.103:0/3931887440 >> 172.21.15.103:0/3931887440 conn(0x7f58180bcae0 msgr2=0x7f58180bcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:15:59.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.818+0000 7f581cec1700 1 -- 172.21.15.103:0/3931887440 shutdown_connections 2020-04-22T14:15:59.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.818+0000 7f581cec1700 1 -- 172.21.15.103:0/3931887440 wait complete. 2020-04-22T14:15:59.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.819+0000 7f581cec1700 1 Processor -- start 2020-04-22T14:15:59.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.819+0000 7f581cec1700 1 -- start start 2020-04-22T14:15:59.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.819+0000 7f581cec1700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f58180b86a0 0x7f5818148500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:59.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.819+0000 7f581cec1700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5818143a50 0x7f5818154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:59.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.819+0000 7f581cec1700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5818153c60 con 0x7f581805b0b0 2020-04-22T14:15:59.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.819+0000 7f581cec1700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5818153f00 con 0x7f58180b86a0 2020-04-22T14:15:59.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.819+0000 7f581cec1700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58181541a0 con 0x7f5818143a50 2020-04-22T14:15:59.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.819+0000 7f581659c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f581805b0b0 0x7f5818147df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47858/0 (socket says 172.21.15.103:47858) 2020-04-22T14:15:59.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.819+0000 7f581659c700 1 -- 172.21.15.103:0/2656440314 learned_addr learned my addr 172.21.15.103:0/2656440314 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:15:59.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.819+0000 7f5816d9d700 1 --2- 172.21.15.103:0/2656440314 >> v2:172.21.15.103:3300/0 conn(0x7f5818143a50 0x7f5818154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:59.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.820+0000 7f5815d9b700 1 --2- 172.21.15.103:0/2656440314 >> v2:172.21.15.86:3300/0 conn(0x7f58180b86a0 0x7f5818148500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:59.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.820+0000 7f5816d9d700 1 -- 172.21.15.103:0/2656440314 >> v2:172.21.15.86:3300/0 conn(0x7f58180b86a0 msgr2=0x7f5818148500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:59.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.820+0000 7f5816d9d700 1 --2- 172.21.15.103:0/2656440314 >> v2:172.21.15.86:3300/0 conn(0x7f58180b86a0 0x7f5818148500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:15:59.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.820+0000 7f5816d9d700 1 -- 172.21.15.103:0/2656440314 >> v1:172.21.15.103:6789/0 conn(0x7f581805b0b0 legacy=0x7f5818147df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:15:59.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.820+0000 7f5816d9d700 1 -- 172.21.15.103:0/2656440314 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5818149170 con 0x7f5818143a50 2020-04-22T14:15:59.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.820+0000 7f580f7fe700 1 -- 172.21.15.103:0/2656440314 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3572538729 0 0) 0x7f5818153c60 con 0x7f581805b0b0 2020-04-22T14:15:59.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.820+0000 7f5815d9b700 1 --2- 172.21.15.103:0/2656440314 >> v2:172.21.15.86:3300/0 conn(0x7f58180b86a0 0x7f5818148500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:15:59.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.820+0000 7f5816d9d700 1 --2- 172.21.15.103:0/2656440314 >> v2:172.21.15.103:3300/0 conn(0x7f5818143a50 0x7f5818154640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f58100032b0 tx=0x7f5810010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:59.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.820+0000 7f5816d9d700 1 --2- 172.21.15.103:0/2656440314 >> v2:172.21.15.103:3300/0 conn(0x7f5818143a50 0x7f5818154640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f58100032b0 tx=0x7f5810010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:59.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.820+0000 7f5816d9d700 1 --2- 172.21.15.103:0/2656440314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5818143a50 0x7f5818154640 secure :-1 s=READY pgs=1579 cs=0 l=1 rx=0x7f58100032b0 tx=0x7f5810010f70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:59.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.820+0000 7f5816d9d700 1 --2- 172.21.15.103:0/2656440314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5818143a50 0x7f5818154640 secure :-1 s=THROTTLE_DONE pgs=1579 cs=0 l=1 rx=0x7f58100032b0 tx=0x7f5810010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:59.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.820+0000 7f580f7fe700 1 -- 172.21.15.103:0/2656440314 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f581000e370 con 0x7f5818143a50 2020-04-22T14:15:59.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.820+0000 7f5816d9d700 1 --2- 172.21.15.103:0/2656440314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5818143a50 0x7f5818154640 secure :-1 s=THROTTLE_DONE pgs=1579 cs=0 l=1 rx=0x7f58100032b0 tx=0x7f5810010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:59.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.820+0000 7f5816d9d700 1 --2- 172.21.15.103:0/2656440314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5818143a50 0x7f5818154640 secure :-1 s=THROTTLE_DONE pgs=1579 cs=0 l=1 rx=0x7f58100032b0 tx=0x7f5810010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:59.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.820+0000 7f580f7fe700 1 -- 172.21.15.103:0/2656440314 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5810005c30 con 0x7f5818143a50 2020-04-22T14:15:59.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.820+0000 7f581cec1700 1 -- 172.21.15.103:0/2656440314 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58180ae0b0 con 0x7f5818143a50 2020-04-22T14:15:59.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.820+0000 7f580f7fe700 1 -- 172.21.15.103:0/2656440314 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58100129c0 con 0x7f5818143a50 2020-04-22T14:15:59.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.820+0000 7f581cec1700 1 -- 172.21.15.103:0/2656440314 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5818157ac0 con 0x7f5818143a50 2020-04-22T14:15:59.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.821+0000 7f5816d9d700 1 --2- 172.21.15.103:0/2656440314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5818143a50 0x7f5818154640 secure :-1 s=THROTTLE_DONE pgs=1579 cs=0 l=1 rx=0x7f58100032b0 tx=0x7f5810010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:59.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.821+0000 7f5816d9d700 1 --2- 172.21.15.103:0/2656440314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5818143a50 0x7f5818154640 secure :-1 s=THROTTLE_DONE pgs=1579 cs=0 l=1 rx=0x7f58100032b0 tx=0x7f5810010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:59.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.821+0000 7f580f7fe700 1 -- 172.21.15.103:0/2656440314 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f5810012c30 con 0x7f5818143a50 2020-04-22T14:15:59.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.821+0000 7f581cec1700 1 -- 172.21.15.103:0/2656440314 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5818157f90 con 0x7f5818143a50 2020-04-22T14:15:59.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.821+0000 7f580f7fe700 1 --2- 172.21.15.103:0/2656440314 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f57fc04d870 0x7f57fc04fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:15:59.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.821+0000 7f580f7fe700 1 -- 172.21.15.103:0/2656440314 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f5810061330 con 0x7f5818143a50 2020-04-22T14:15:59.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.822+0000 7f581659c700 1 --2- 172.21.15.103:0/2656440314 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f57fc04d870 0x7f57fc04fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:15:59.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.822+0000 7f581659c700 1 --2- 172.21.15.103:0/2656440314 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f57fc04d870 0x7f57fc04fd30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5800001320 tx=0x7f58000017e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:59.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.822+0000 7f581659c700 1 --2- 172.21.15.103:0/2656440314 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f57fc04d870 0x7f57fc04fd30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5800001320 tx=0x7f58000017e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:59.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.822+0000 7f581659c700 1 --2- 172.21.15.103:0/2656440314 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f57fc04d870 0x7f57fc04fd30 secure :-1 s=READY pgs=572 cs=0 l=1 rx=0x7f5800001320 tx=0x7f58000017e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:15:59.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.825+0000 7f5816d9d700 1 --2- 172.21.15.103:0/2656440314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5818143a50 0x7f5818154640 secure :-1 s=THROTTLE_DONE pgs=1579 cs=0 l=1 rx=0x7f58100032b0 tx=0x7f5810010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:15:59.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.825+0000 7f580f7fe700 1 -- 172.21.15.103:0/2656440314 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f5818157f90 con 0x7f5818143a50 2020-04-22T14:15:59.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:15:59.985+0000 7f581cec1700 1 -- 172.21.15.103:0/2656440314 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f5818157f90 con 0x7f5818143a50 2020-04-22T14:16:00.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.758+0000 7f5816d9d700 1 --2- 172.21.15.103:0/2656440314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5818143a50 0x7f5818154640 secure :-1 s=THROTTLE_DONE pgs=1579 cs=0 l=1 rx=0x7f58100032b0 tx=0x7f5810010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:00.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.758+0000 7f580f7fe700 1 -- 172.21.15.103:0/2656440314 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v108) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5818157f90 con 0x7f5818143a50 2020-04-22T14:16:00.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.760+0000 7f581cec1700 1 -- 172.21.15.103:0/2656440314 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f57fc04d870 msgr2=0x7f57fc04fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:00.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.760+0000 7f581cec1700 1 --2- 172.21.15.103:0/2656440314 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f57fc04d870 0x7f57fc04fd30 secure :-1 s=READY pgs=572 cs=0 l=1 rx=0x7f5800001320 tx=0x7f58000017e0).stop 2020-04-22T14:16:00.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.760+0000 7f581cec1700 1 -- 172.21.15.103:0/2656440314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5818143a50 msgr2=0x7f5818154640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:00.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.760+0000 7f581cec1700 1 --2- 172.21.15.103:0/2656440314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5818143a50 0x7f5818154640 secure :-1 s=READY pgs=1579 cs=0 l=1 rx=0x7f58100032b0 tx=0x7f5810010f70).stop 2020-04-22T14:16:00.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.760+0000 7f581cec1700 1 -- 172.21.15.103:0/2656440314 shutdown_connections 2020-04-22T14:16:00.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.760+0000 7f581cec1700 1 --2- 172.21.15.103:0/2656440314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5818143a50 0x7f5818154640 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:00.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.760+0000 7f581cec1700 1 --2- 172.21.15.103:0/2656440314 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f57fc04d870 0x7f57fc04fd30 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:00.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.760+0000 7f581cec1700 1 --2- 172.21.15.103:0/2656440314 >> v2:172.21.15.86:3300/0 conn(0x7f58180b86a0 0x7f5818148500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:00.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.760+0000 7f581cec1700 1 -- 172.21.15.103:0/2656440314 >> 172.21.15.103:0/2656440314 conn(0x7f58180bcae0 msgr2=0x7f581805f800 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:00.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.760+0000 7f581cec1700 1 -- 172.21.15.103:0/2656440314 shutdown_connections 2020-04-22T14:16:00.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.760+0000 7f581cec1700 1 -- 172.21.15.103:0/2656440314 wait complete. 2020-04-22T14:16:00.764 INFO:teuthology.orchestra.run.smithi103.stderr: removed all blacklist entries 2020-04-22T14:16:00.774 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2020-04-22T14:16:00.774 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:00.829 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2020-04-22T14:16:00.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.977+0000 7f06c2088700 1 Processor -- start 2020-04-22T14:16:00.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.978+0000 7f06c2088700 1 -- start start 2020-04-22T14:16:00.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.978+0000 7f06c2088700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f06bc1441f0 0x7f06bc144820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:00.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.978+0000 7f06c2088700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06bc0b5900 con 0x7f06bc05b7c0 2020-04-22T14:16:00.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.978+0000 7f06c2088700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06bc0b5ba0 con 0x7f06bc144c80 2020-04-22T14:16:00.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.978+0000 7f06c2088700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06bc0b5e40 con 0x7f06bc1441f0 2020-04-22T14:16:00.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.978+0000 7f06bbfff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f06bc144c80 0x7f06bc0ad850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47872/0 (socket says 172.21.15.103:47872) 2020-04-22T14:16:00.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.978+0000 7f06bbfff700 1 -- 172.21.15.103:0/3834700281 learned_addr learned my addr 172.21.15.103:0/3834700281 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:00.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.979+0000 7f06baffd700 1 --2- 172.21.15.103:0/3834700281 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f06bc1441f0 0x7f06bc144820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:00.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.979+0000 7f06ba7fc700 1 -- 172.21.15.103:0/3834700281 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 166663098 0 0) 0x7f06bc0b5ba0 con 0x7f06bc144c80 2020-04-22T14:16:00.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.979+0000 7f06ba7fc700 1 -- 172.21.15.103:0/3834700281 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06a8003230 con 0x7f06bc144c80 2020-04-22T14:16:00.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.979+0000 7f06ba7fc700 1 -- 172.21.15.103:0/3834700281 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1874241945 0 0) 0x7f06a8003230 con 0x7f06bc144c80 2020-04-22T14:16:00.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.979+0000 7f06ba7fc700 1 -- 172.21.15.103:0/3834700281 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f06bc1441f0 msgr2=0x7f06bc144820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:00.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.979+0000 7f06ba7fc700 1 --2- 172.21.15.103:0/3834700281 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f06bc1441f0 0x7f06bc144820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:00.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.979+0000 7f06ba7fc700 1 -- 172.21.15.103:0/3834700281 >> v1:172.21.15.86:6789/0 conn(0x7f06bc05b7c0 legacy=0x7f06bc0b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:00.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.979+0000 7f06ba7fc700 1 -- 172.21.15.103:0/3834700281 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06bc05bba0 con 0x7f06bc144c80 2020-04-22T14:16:00.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.979+0000 7f06ba7fc700 1 -- 172.21.15.103:0/3834700281 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f06b4001a50 con 0x7f06bc144c80 2020-04-22T14:16:00.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.979+0000 7f06ba7fc700 1 -- 172.21.15.103:0/3834700281 >> v1:172.21.15.103:6789/0 conn(0x7f06bc144c80 legacy=0x7f06bc0ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:00.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.979+0000 7f06ba7fc700 1 --2- 172.21.15.103:0/3834700281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06a8003720 0x7f06a8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:00.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.979+0000 7f06ba7fc700 1 --2- 172.21.15.103:0/3834700281 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06a8004060 0x7f06a8004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:00.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.979+0000 7f06ba7fc700 1 --2- 172.21.15.103:0/3834700281 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f06bc1441f0 0x7f06a8004ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:00.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.979+0000 7f06ba7fc700 1 -- 172.21.15.103:0/3834700281 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06bc0b5e40 con 0x7f06a8004060 2020-04-22T14:16:00.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.979+0000 7f06ba7fc700 1 -- 172.21.15.103:0/3834700281 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a8004f70 con 0x7f06a8003720 2020-04-22T14:16:00.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.979+0000 7f06ba7fc700 1 -- 172.21.15.103:0/3834700281 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06a8005130 con 0x7f06bc1441f0 2020-04-22T14:16:00.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.979+0000 7f06bb7fe700 1 --2- 172.21.15.103:0/3834700281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06a8003720 0x7f06a8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:00.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.979+0000 7f06baffd700 1 --2- 172.21.15.103:0/3834700281 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06a8004060 0x7f06a8004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:00.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.979+0000 7f06bbfff700 1 --2- 172.21.15.103:0/3834700281 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f06bc1441f0 0x7f06a8004ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:00.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.979+0000 7f06bb7fe700 1 -- 172.21.15.103:0/3834700281 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f06bc1441f0 msgr2=0x7f06a8004ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:00.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.979+0000 7f06bb7fe700 1 --2- 172.21.15.103:0/3834700281 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f06bc1441f0 0x7f06a8004ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:00.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.979+0000 7f06bb7fe700 1 -- 172.21.15.103:0/3834700281 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06a8004060 msgr2=0x7f06a8004530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:00.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.979+0000 7f06bb7fe700 1 --2- 172.21.15.103:0/3834700281 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06a8004060 0x7f06a8004530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:00.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.979+0000 7f06bb7fe700 1 -- 172.21.15.103:0/3834700281 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a8003230 con 0x7f06a8003720 2020-04-22T14:16:00.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.979+0000 7f06bbfff700 1 --2- 172.21.15.103:0/3834700281 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f06bc1441f0 0x7f06a8004ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:16:00.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.979+0000 7f06bb7fe700 1 --2- 172.21.15.103:0/3834700281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06a8003720 0x7f06a8003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f06bc0613e0 tx=0x7f06ac00fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:00.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.979+0000 7f06bb7fe700 1 --2- 172.21.15.103:0/3834700281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06a8003720 0x7f06a8003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f06bc0613e0 tx=0x7f06ac00fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:00.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.979+0000 7f06bb7fe700 1 --2- 172.21.15.103:0/3834700281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06a8003720 0x7f06a8003b40 secure :-1 s=READY pgs=1581 cs=0 l=1 rx=0x7f06bc0613e0 tx=0x7f06ac00fcf0).ready entity=mon.1 client_cookie=76f8a30f1f51919d server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:00.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.980+0000 7f06bb7fe700 1 --2- 172.21.15.103:0/3834700281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06a8003720 0x7f06a8003b40 secure :-1 s=THROTTLE_DONE pgs=1581 cs=0 l=1 rx=0x7f06bc0613e0 tx=0x7f06ac00fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:00.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.980+0000 7f06bb7fe700 1 --2- 172.21.15.103:0/3834700281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06a8003720 0x7f06a8003b40 secure :-1 s=THROTTLE_DONE pgs=1581 cs=0 l=1 rx=0x7f06bc0613e0 tx=0x7f06ac00fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:00.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.980+0000 7f06ba7fc700 1 -- 172.21.15.103:0/3834700281 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06ac003560 con 0x7f06a8003720 2020-04-22T14:16:01.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.980+0000 7f06bb7fe700 1 --2- 172.21.15.103:0/3834700281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06a8003720 0x7f06a8003b40 secure :-1 s=THROTTLE_DONE pgs=1581 cs=0 l=1 rx=0x7f06bc0613e0 tx=0x7f06ac00fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.980+0000 7f06ba7fc700 1 -- 172.21.15.103:0/3834700281 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ac003700 con 0x7f06a8003720 2020-04-22T14:16:01.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.980+0000 7f06ba7fc700 1 -- 172.21.15.103:0/3834700281 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06ac003b20 con 0x7f06a8003720 2020-04-22T14:16:01.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.980+0000 7f06c2088700 1 -- 172.21.15.103:0/3834700281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06a8003720 msgr2=0x7f06a8003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:01.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.980+0000 7f06c2088700 1 --2- 172.21.15.103:0/3834700281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06a8003720 0x7f06a8003b40 secure :-1 s=READY pgs=1581 cs=0 l=1 rx=0x7f06bc0613e0 tx=0x7f06ac00fcf0).stop 2020-04-22T14:16:01.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.980+0000 7f06bbfff700 1 -- 172.21.15.103:0/3834700281 reap_dead start 2020-04-22T14:16:01.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.980+0000 7f06c2088700 1 -- 172.21.15.103:0/3834700281 shutdown_connections 2020-04-22T14:16:01.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.980+0000 7f06c2088700 1 -- 172.21.15.103:0/3834700281 >> 172.21.15.103:0/3834700281 conn(0x7f06bc0b9160 msgr2=0x7f06bc05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:01.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.980+0000 7f06c2088700 1 -- 172.21.15.103:0/3834700281 shutdown_connections 2020-04-22T14:16:01.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.980+0000 7f06c2088700 1 -- 172.21.15.103:0/3834700281 wait complete. 2020-04-22T14:16:01.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.981+0000 7f06c2088700 1 Processor -- start 2020-04-22T14:16:01.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.981+0000 7f06c2088700 1 -- start start 2020-04-22T14:16:01.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.982+0000 7f06c2088700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f06bc154dc0 0x7f06bc0b3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:01.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.982+0000 7f06c2088700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f06bc0af5c0 0x7f06bc0afa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:01.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.982+0000 7f06c2088700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06bc0b1d40 con 0x7f06bc0662d0 2020-04-22T14:16:01.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.982+0000 7f06c2088700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06bc0b3780 con 0x7f06bc0af5c0 2020-04-22T14:16:01.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.982+0000 7f06c2088700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06bc0b3a20 con 0x7f06bc154dc0 2020-04-22T14:16:01.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.982+0000 7f06baffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f06bc154dc0 0x7f06bc0b3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:01.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.982+0000 7f06baffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f06bc154dc0 0x7f06bc0b3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55692/0 (socket says 172.21.15.103:55692) 2020-04-22T14:16:01.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.982+0000 7f06baffd700 1 -- 172.21.15.103:0/2173918358 learned_addr learned my addr 172.21.15.103:0/2173918358 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:01.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.982+0000 7f06bbfff700 1 --2- 172.21.15.103:0/2173918358 >> v2:172.21.15.86:3300/0 conn(0x7f06bc0af5c0 0x7f06bc0afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:01.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.982+0000 7f06baffd700 1 -- 172.21.15.103:0/2173918358 >> v2:172.21.15.86:3300/0 conn(0x7f06bc0af5c0 msgr2=0x7f06bc0afa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:01.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.982+0000 7f06baffd700 1 --2- 172.21.15.103:0/2173918358 >> v2:172.21.15.86:3300/0 conn(0x7f06bc0af5c0 0x7f06bc0afa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:01.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.982+0000 7f06baffd700 1 -- 172.21.15.103:0/2173918358 >> v1:172.21.15.86:6789/0 conn(0x7f06bc0662d0 legacy=0x7f06bc0b0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:01.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.982+0000 7f06baffd700 1 -- 172.21.15.103:0/2173918358 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06bc0b3cc0 con 0x7f06bc154dc0 2020-04-22T14:16:01.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.982+0000 7f06baffd700 1 --2- 172.21.15.103:0/2173918358 >> v2:172.21.15.103:3300/0 conn(0x7f06bc154dc0 0x7f06bc0b3190 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f06b0007ed0 tx=0x7f06b000c400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.982+0000 7f06baffd700 1 --2- 172.21.15.103:0/2173918358 >> v2:172.21.15.103:3300/0 conn(0x7f06bc154dc0 0x7f06bc0b3190 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f06b0007ed0 tx=0x7f06b000c400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.982+0000 7f06baffd700 1 --2- 172.21.15.103:0/2173918358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06bc154dc0 0x7f06bc0b3190 secure :-1 s=READY pgs=1582 cs=0 l=1 rx=0x7f06b0007ed0 tx=0x7f06b000c400).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:01.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.983+0000 7f06baffd700 1 --2- 172.21.15.103:0/2173918358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06bc154dc0 0x7f06bc0b3190 secure :-1 s=THROTTLE_DONE pgs=1582 cs=0 l=1 rx=0x7f06b0007ed0 tx=0x7f06b000c400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.983+0000 7f06baffd700 1 --2- 172.21.15.103:0/2173918358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06bc154dc0 0x7f06bc0b3190 secure :-1 s=THROTTLE_DONE pgs=1582 cs=0 l=1 rx=0x7f06b0007ed0 tx=0x7f06b000c400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.983+0000 7f06b8ff9700 1 -- 172.21.15.103:0/2173918358 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06b0005e90 con 0x7f06bc154dc0 2020-04-22T14:16:01.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.983+0000 7f06baffd700 1 --2- 172.21.15.103:0/2173918358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06bc154dc0 0x7f06bc0b3190 secure :-1 s=THROTTLE_DONE pgs=1582 cs=0 l=1 rx=0x7f06b0007ed0 tx=0x7f06b000c400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.983+0000 7f06b8ff9700 1 -- 172.21.15.103:0/2173918358 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b0007180 con 0x7f06bc154dc0 2020-04-22T14:16:01.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.983+0000 7f06c2088700 1 -- 172.21.15.103:0/2173918358 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06bc0666b0 con 0x7f06bc154dc0 2020-04-22T14:16:01.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.983+0000 7f06b8ff9700 1 -- 172.21.15.103:0/2173918358 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06b00075a0 con 0x7f06bc154dc0 2020-04-22T14:16:01.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.983+0000 7f06c2088700 1 -- 172.21.15.103:0/2173918358 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06bc0b1080 con 0x7f06bc154dc0 2020-04-22T14:16:01.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.983+0000 7f06baffd700 1 --2- 172.21.15.103:0/2173918358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06bc154dc0 0x7f06bc0b3190 secure :-1 s=THROTTLE_DONE pgs=1582 cs=0 l=1 rx=0x7f06b0007ed0 tx=0x7f06b000c400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.984+0000 7f06c2088700 1 -- 172.21.15.103:0/2173918358 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06bc0b3e70 con 0x7f06bc154dc0 2020-04-22T14:16:01.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.984+0000 7f06b8ff9700 1 -- 172.21.15.103:0/2173918358 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f06b0008410 con 0x7f06bc154dc0 2020-04-22T14:16:01.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.984+0000 7f06baffd700 1 --2- 172.21.15.103:0/2173918358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06bc154dc0 0x7f06bc0b3190 secure :-1 s=THROTTLE_DONE pgs=1582 cs=0 l=1 rx=0x7f06b0007ed0 tx=0x7f06b000c400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.984+0000 7f06b8ff9700 1 --2- 172.21.15.103:0/2173918358 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f069c04da20 0x7f069c04fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:01.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.984+0000 7f06b8ff9700 1 -- 172.21.15.103:0/2173918358 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f06b00615f0 con 0x7f06bc154dc0 2020-04-22T14:16:01.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.984+0000 7f06bb7fe700 1 --2- 172.21.15.103:0/2173918358 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f069c04da20 0x7f069c04fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:01.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.984+0000 7f06bb7fe700 1 --2- 172.21.15.103:0/2173918358 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f069c04da20 0x7f069c04fee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f06bc1415b0 tx=0x7f06ac00fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.984+0000 7f06bb7fe700 1 --2- 172.21.15.103:0/2173918358 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f069c04da20 0x7f069c04fee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f06bc1415b0 tx=0x7f06ac00fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.984+0000 7f06bb7fe700 1 --2- 172.21.15.103:0/2173918358 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f069c04da20 0x7f069c04fee0 secure :-1 s=READY pgs=574 cs=0 l=1 rx=0x7f06bc1415b0 tx=0x7f06ac00fcf0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:01.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.988+0000 7f06baffd700 1 --2- 172.21.15.103:0/2173918358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06bc154dc0 0x7f06bc0b3190 secure :-1 s=THROTTLE_DONE pgs=1582 cs=0 l=1 rx=0x7f06b0007ed0 tx=0x7f06b000c400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:00.988+0000 7f06b8ff9700 1 -- 172.21.15.103:0/2173918358 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f06b003ca30 con 0x7f06bc154dc0 2020-04-22T14:16:01.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.180+0000 7f06c2088700 1 -- 172.21.15.103:0/2173918358 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f06bc056c90 con 0x7f06bc154dc0 2020-04-22T14:16:01.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.181+0000 7f06baffd700 1 --2- 172.21.15.103:0/2173918358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06bc154dc0 0x7f06bc0b3190 secure :-1 s=THROTTLE_DONE pgs=1582 cs=0 l=1 rx=0x7f06b0007ed0 tx=0x7f06b000c400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.181+0000 7f06b8ff9700 1 -- 172.21.15.103:0/2173918358 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v40) v1 ==== 80+0+4513 (secure 0 0 0) 0x7f06b0040050 con 0x7f06bc154dc0 2020-04-22T14:16:01.183 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:16:01.184 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:16:01.184 INFO:teuthology.orchestra.run.smithi103.stdout: "auth_dump": [ 2020-04-22T14:16:01.184 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:01.184 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.a", 2020-04-22T14:16:01.184 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBeliD5IBAAjC7UikdEP8FeE2rKs/ympw==", 2020-04-22T14:16:01.184 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:16:01.184 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:16:01.185 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:16:01.185 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:16:01.185 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:16:01.185 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:01.185 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:01.185 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:01.185 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.b", 2020-04-22T14:16:01.186 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBepkqQLBAA4aMKXxROQugglhm4aBd1Iw==", 2020-04-22T14:16:01.186 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:16:01.186 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:16:01.186 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:16:01.186 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:16:01.187 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:16:01.187 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:01.187 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:01.187 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:01.187 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.0", 2020-04-22T14:16:01.187 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA2TqBehMJiBxAARaWo32QGx49PxImGafnOFw==", 2020-04-22T14:16:01.187 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:16:01.188 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:16:01.188 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:16:01.188 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:16:01.188 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:01.188 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:01.188 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:01.188 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.1", 2020-04-22T14:16:01.189 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA4TqBeiAAcKRAAEHuaqbsB+NLUTSgFOCOFZg==", 2020-04-22T14:16:01.189 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:16:01.189 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:16:01.189 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:16:01.189 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:16:01.189 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:01.189 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:01.190 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:01.190 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.2", 2020-04-22T14:16:01.190 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA7TqBebeRzDxAAsjRyvJektq7MQ+334kU+UQ==", 2020-04-22T14:16:01.190 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:16:01.190 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:16:01.190 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:16:01.190 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:16:01.190 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:01.191 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:01.191 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:01.191 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.3", 2020-04-22T14:16:01.191 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA9TqBehxmSMRAATZ0o/ZnxHp2m/tqLmv6JwA==", 2020-04-22T14:16:01.191 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:16:01.191 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:16:01.191 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:16:01.192 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:16:01.192 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:01.192 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:01.192 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:01.192 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.4", 2020-04-22T14:16:01.192 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBETqBePwJSBRAAXgMKuX3EILi3gy8QzR4cig==", 2020-04-22T14:16:01.192 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:16:01.192 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:16:01.193 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:16:01.193 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:16:01.193 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:01.193 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:01.193 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:01.193 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.5", 2020-04-22T14:16:01.193 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBGTqBe5l++KRAAHIWG6bBnru2EVXv/drAL0g==", 2020-04-22T14:16:01.193 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:16:01.194 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:16:01.194 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:16:01.194 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:16:01.194 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:01.194 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:01.194 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:01.194 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.6", 2020-04-22T14:16:01.195 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBJTqBe88rTEBAAO2Z78NZLTYIbBpYovBSHVQ==", 2020-04-22T14:16:01.195 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:16:01.195 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:16:01.195 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:16:01.195 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:16:01.195 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:01.195 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:01.195 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:01.196 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.7", 2020-04-22T14:16:01.196 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBLTqBeGNFIMxAARIXhPNM6xurdnDv8+xZqUw==", 2020-04-22T14:16:01.196 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:16:01.196 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:16:01.196 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:16:01.197 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:16:01.197 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:01.197 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:01.197 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:01.198 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.0", 2020-04-22T14:16:01.198 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBe5ooUNxAA9zBtv6+i3Xl9iYtRl4xKGg==", 2020-04-22T14:16:01.198 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:16:01.198 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:16:01.198 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:16:01.198 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:16:01.198 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:01.199 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:01.199 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:01.199 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.1", 2020-04-22T14:16:01.199 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAyTqBe0bioBBAAVpoQouA/QICwqRoaFbjkiA==", 2020-04-22T14:16:01.199 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:16:01.199 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:16:01.199 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:16:01.200 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:16:01.200 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:01.200 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:01.200 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:01.200 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.2", 2020-04-22T14:16:01.200 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAyTqBemwpXCxAAObNL96zS67nMEe4MLjrEtw==", 2020-04-22T14:16:01.200 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:16:01.201 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:16:01.201 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:16:01.201 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:16:01.201 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:01.201 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:01.201 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:01.201 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.3", 2020-04-22T14:16:01.202 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAyTqBemGxNFBAAlqvB8FeZbMRwvzVjBpH/tA==", 2020-04-22T14:16:01.202 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:16:01.202 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:16:01.202 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:16:01.202 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:16:01.202 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:01.202 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:01.202 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:01.203 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.admin", 2020-04-22T14:16:01.203 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAwTqBeSx5dHxAAH0jPkaiWEwpr66ROWwbU8Q==", 2020-04-22T14:16:01.203 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:16:01.203 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2020-04-22T14:16:01.203 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:16:01.203 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:16:01.203 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:16:01.203 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:01.204 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:01.204 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:01.204 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mgr.x", 2020-04-22T14:16:01.204 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBe3YVhGhAAWAf6f9sV3bzoucBBPS3j2g==", 2020-04-22T14:16:01.204 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:16:01.204 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2020-04-22T14:16:01.204 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile mgr", 2020-04-22T14:16:01.205 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:16:01.205 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:01.205 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:01.205 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:01.205 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mgr.y", 2020-04-22T14:16:01.205 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBeX8AXExAAhh/N+/ogdKlxmkveSM60+g==", 2020-04-22T14:16:01.205 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:16:01.206 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2020-04-22T14:16:01.206 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile mgr", 2020-04-22T14:16:01.206 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:16:01.206 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:01.206 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:01.206 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:01.206 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:16:01.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.182+0000 7f06c2088700 1 -- 172.21.15.103:0/2173918358 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f069c04da20 msgr2=0x7f069c04fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:01.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.182+0000 7f06c2088700 1 --2- 172.21.15.103:0/2173918358 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f069c04da20 0x7f069c04fee0 secure :-1 s=READY pgs=574 cs=0 l=1 rx=0x7f06bc1415b0 tx=0x7f06ac00fcf0).stop 2020-04-22T14:16:01.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.182+0000 7f06c2088700 1 -- 172.21.15.103:0/2173918358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06bc154dc0 msgr2=0x7f06bc0b3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:01.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.182+0000 7f06c2088700 1 --2- 172.21.15.103:0/2173918358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06bc154dc0 0x7f06bc0b3190 secure :-1 s=READY pgs=1582 cs=0 l=1 rx=0x7f06b0007ed0 tx=0x7f06b000c400).stop 2020-04-22T14:16:01.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.182+0000 7f06c2088700 1 -- 172.21.15.103:0/2173918358 shutdown_connections 2020-04-22T14:16:01.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.182+0000 7f06c2088700 1 --2- 172.21.15.103:0/2173918358 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f069c04da20 0x7f069c04fee0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:01.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.182+0000 7f06c2088700 1 --2- 172.21.15.103:0/2173918358 >> v2:172.21.15.86:3300/0 conn(0x7f06bc0af5c0 0x7f06bc0afa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:01.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.182+0000 7f06c2088700 1 --2- 172.21.15.103:0/2173918358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06bc154dc0 0x7f06bc0b3190 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:01.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.182+0000 7f06c2088700 1 -- 172.21.15.103:0/2173918358 >> 172.21.15.103:0/2173918358 conn(0x7f06bc0b9160 msgr2=0x7f06bc066dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:01.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.182+0000 7f06c2088700 1 -- 172.21.15.103:0/2173918358 shutdown_connections 2020-04-22T14:16:01.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.182+0000 7f06c2088700 1 -- 172.21.15.103:0/2173918358 wait complete. 2020-04-22T14:16:01.210 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:01.224 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:16:01.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.367+0000 7f0638f5f700 1 Processor -- start 2020-04-22T14:16:01.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.367+0000 7f0638f5f700 1 -- start start 2020-04-22T14:16:01.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.368+0000 7f0638f5f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0634065fe0 0x7f063405fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:01.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.368+0000 7f0638f5f700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06341443a0 con 0x7f063413de20 2020-04-22T14:16:01.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.368+0000 7f0638f5f700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0634144640 con 0x7f0634062650 2020-04-22T14:16:01.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.368+0000 7f0638f5f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06341451f0 con 0x7f0634065fe0 2020-04-22T14:16:01.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.368+0000 7f063259c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0634065fe0 0x7f063405fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:01.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.368+0000 7f0631d9b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f0634062650 0x7f0634144ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47888/0 (socket says 172.21.15.103:47888) 2020-04-22T14:16:01.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.368+0000 7f0631d9b700 1 -- 172.21.15.103:0/1996890742 learned_addr learned my addr 172.21.15.103:0/1996890742 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:01.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.368+0000 7f063259c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0634065fe0 0x7f063405fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55698/0 (socket says 172.21.15.103:55698) 2020-04-22T14:16:01.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.369+0000 7f063259c700 1 -- 172.21.15.103:0/1996890742 >> v1:172.21.15.103:6789/0 conn(0x7f0634062650 legacy=0x7f0634144ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:01.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.369+0000 7f063259c700 1 -- 172.21.15.103:0/1996890742 >> v1:172.21.15.86:6789/0 conn(0x7f063413de20 legacy=0x7f06340b5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:01.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.369+0000 7f063259c700 1 -- 172.21.15.103:0/1996890742 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06340663c0 con 0x7f0634065fe0 2020-04-22T14:16:01.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.369+0000 7f063259c700 1 --2- 172.21.15.103:0/1996890742 >> v2:172.21.15.103:3300/0 conn(0x7f0634065fe0 0x7f063405fdc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0634066710 tx=0x7f0624007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.369+0000 7f063259c700 1 --2- 172.21.15.103:0/1996890742 >> v2:172.21.15.103:3300/0 conn(0x7f0634065fe0 0x7f063405fdc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0634066710 tx=0x7f0624007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.369+0000 7f063259c700 1 --2- 172.21.15.103:0/1996890742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0634065fe0 0x7f063405fdc0 secure :-1 s=READY pgs=1584 cs=0 l=1 rx=0x7f0634066710 tx=0x7f0624007a40).ready entity=mon.1 client_cookie=ae0822aa781a047d server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:01.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.369+0000 7f063259c700 1 --2- 172.21.15.103:0/1996890742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0634065fe0 0x7f063405fdc0 secure :-1 s=THROTTLE_DONE pgs=1584 cs=0 l=1 rx=0x7f0634066710 tx=0x7f0624007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.369+0000 7f063259c700 1 --2- 172.21.15.103:0/1996890742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0634065fe0 0x7f063405fdc0 secure :-1 s=THROTTLE_DONE pgs=1584 cs=0 l=1 rx=0x7f0634066710 tx=0x7f0624007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.369+0000 7f063159a700 1 -- 172.21.15.103:0/1996890742 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0624011430 con 0x7f0634065fe0 2020-04-22T14:16:01.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.369+0000 7f063259c700 1 --2- 172.21.15.103:0/1996890742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0634065fe0 0x7f063405fdc0 secure :-1 s=THROTTLE_DONE pgs=1584 cs=0 l=1 rx=0x7f0634066710 tx=0x7f0624007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.369+0000 7f063159a700 1 -- 172.21.15.103:0/1996890742 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0624011590 con 0x7f0634065fe0 2020-04-22T14:16:01.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.369+0000 7f063159a700 1 -- 172.21.15.103:0/1996890742 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06240119b0 con 0x7f0634065fe0 2020-04-22T14:16:01.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.369+0000 7f0638f5f700 1 -- 172.21.15.103:0/1996890742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0634065fe0 msgr2=0x7f063405fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:01.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.369+0000 7f0638f5f700 1 --2- 172.21.15.103:0/1996890742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0634065fe0 0x7f063405fdc0 secure :-1 s=READY pgs=1584 cs=0 l=1 rx=0x7f0634066710 tx=0x7f0624007a40).stop 2020-04-22T14:16:01.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.369+0000 7f0638f5f700 1 -- 172.21.15.103:0/1996890742 shutdown_connections 2020-04-22T14:16:01.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.369+0000 7f0638f5f700 1 --2- 172.21.15.103:0/1996890742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0634065fe0 0x7f063405fdc0 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:01.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.369+0000 7f0638f5f700 1 -- 172.21.15.103:0/1996890742 >> 172.21.15.103:0/1996890742 conn(0x7f063405f2c0 msgr2=0x7f0634066e20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:01.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.369+0000 7f0638f5f700 1 -- 172.21.15.103:0/1996890742 shutdown_connections 2020-04-22T14:16:01.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.369+0000 7f0638f5f700 1 -- 172.21.15.103:0/1996890742 wait complete. 2020-04-22T14:16:01.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.370+0000 7f0638f5f700 1 Processor -- start 2020-04-22T14:16:01.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.370+0000 7f0638f5f700 1 -- start start 2020-04-22T14:16:01.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.371+0000 7f0638f5f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0634062650 0x7f063413afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:01.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.371+0000 7f0638f5f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0634065fe0 0x7f06340ba190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:01.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.371+0000 7f0638f5f700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06340b3ca0 con 0x7f063413de20 2020-04-22T14:16:01.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.371+0000 7f0638f5f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0634155fb0 con 0x7f0634062650 2020-04-22T14:16:01.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.371+0000 7f0638f5f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06341408a0 con 0x7f0634065fe0 2020-04-22T14:16:01.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.371+0000 7f063259c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0634062650 0x7f063413afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:01.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.371+0000 7f063259c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0634062650 0x7f063413afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55702/0 (socket says 172.21.15.103:55702) 2020-04-22T14:16:01.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.371+0000 7f063259c700 1 -- 172.21.15.103:0/2510058661 learned_addr learned my addr 172.21.15.103:0/2510058661 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:01.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.371+0000 7f0631d9b700 1 --2- 172.21.15.103:0/2510058661 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0634065fe0 0x7f06340ba190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:01.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.371+0000 7f063259c700 1 -- 172.21.15.103:0/2510058661 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0634065fe0 msgr2=0x7f06340ba190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:01.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.371+0000 7f063259c700 1 --2- 172.21.15.103:0/2510058661 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0634065fe0 0x7f06340ba190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:01.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.371+0000 7f063259c700 1 -- 172.21.15.103:0/2510058661 >> v1:172.21.15.86:6789/0 conn(0x7f063413de20 legacy=0x7f0634143670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:01.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.371+0000 7f063259c700 1 -- 172.21.15.103:0/2510058661 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0634143d80 con 0x7f0634062650 2020-04-22T14:16:01.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.371+0000 7f063259c700 1 --2- 172.21.15.103:0/2510058661 >> v2:172.21.15.103:3300/0 conn(0x7f0634062650 0x7f063413afb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0634066710 tx=0x7f0624007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.372+0000 7f063259c700 1 --2- 172.21.15.103:0/2510058661 >> v2:172.21.15.103:3300/0 conn(0x7f0634062650 0x7f063413afb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0634066710 tx=0x7f0624007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.372+0000 7f063259c700 1 --2- 172.21.15.103:0/2510058661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0634062650 0x7f063413afb0 secure :-1 s=READY pgs=1585 cs=0 l=1 rx=0x7f0634066710 tx=0x7f0624007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:01.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.372+0000 7f063259c700 1 --2- 172.21.15.103:0/2510058661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0634062650 0x7f063413afb0 secure :-1 s=THROTTLE_DONE pgs=1585 cs=0 l=1 rx=0x7f0634066710 tx=0x7f0624007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.372+0000 7f063259c700 1 --2- 172.21.15.103:0/2510058661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0634062650 0x7f063413afb0 secure :-1 s=THROTTLE_DONE pgs=1585 cs=0 l=1 rx=0x7f0634066710 tx=0x7f0624007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.372+0000 7f062b7fe700 1 -- 172.21.15.103:0/2510058661 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f062400f860 con 0x7f0634062650 2020-04-22T14:16:01.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.372+0000 7f063259c700 1 --2- 172.21.15.103:0/2510058661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0634062650 0x7f063413afb0 secure :-1 s=THROTTLE_DONE pgs=1585 cs=0 l=1 rx=0x7f0634066710 tx=0x7f0624007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.372+0000 7f062b7fe700 1 -- 172.21.15.103:0/2510058661 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0624011a10 con 0x7f0634062650 2020-04-22T14:16:01.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.372+0000 7f0638f5f700 1 -- 172.21.15.103:0/2510058661 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0634155080 con 0x7f0634062650 2020-04-22T14:16:01.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.372+0000 7f062b7fe700 1 -- 172.21.15.103:0/2510058661 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0624007550 con 0x7f0634062650 2020-04-22T14:16:01.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.372+0000 7f0638f5f700 1 -- 172.21.15.103:0/2510058661 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06340b3900 con 0x7f0634062650 2020-04-22T14:16:01.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.372+0000 7f063259c700 1 --2- 172.21.15.103:0/2510058661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0634062650 0x7f063413afb0 secure :-1 s=THROTTLE_DONE pgs=1585 cs=0 l=1 rx=0x7f0634066710 tx=0x7f0624007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.373+0000 7f062b7fe700 1 -- 172.21.15.103:0/2510058661 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f06240056c0 con 0x7f0634062650 2020-04-22T14:16:01.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.373+0000 7f063259c700 1 --2- 172.21.15.103:0/2510058661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0634062650 0x7f063413afb0 secure :-1 s=THROTTLE_DONE pgs=1585 cs=0 l=1 rx=0x7f0634066710 tx=0x7f0624007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.373+0000 7f0638f5f700 1 -- 172.21.15.103:0/2510058661 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06340b3ea0 con 0x7f0634062650 2020-04-22T14:16:01.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.373+0000 7f062b7fe700 1 --2- 172.21.15.103:0/2510058661 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f061804d980 0x7f061804fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:01.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.373+0000 7f062b7fe700 1 -- 172.21.15.103:0/2510058661 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f0624061d00 con 0x7f0634062650 2020-04-22T14:16:01.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.373+0000 7f0631d9b700 1 --2- 172.21.15.103:0/2510058661 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f061804d980 0x7f061804fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:01.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.373+0000 7f0631d9b700 1 --2- 172.21.15.103:0/2510058661 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f061804d980 0x7f061804fe40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f06340637a0 tx=0x7f061c001dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.374+0000 7f0631d9b700 1 --2- 172.21.15.103:0/2510058661 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f061804d980 0x7f061804fe40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f06340637a0 tx=0x7f061c001dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.374+0000 7f0631d9b700 1 --2- 172.21.15.103:0/2510058661 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f061804d980 0x7f061804fe40 secure :-1 s=READY pgs=575 cs=0 l=1 rx=0x7f06340637a0 tx=0x7f061c001dc0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:01.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.377+0000 7f063259c700 1 --2- 172.21.15.103:0/2510058661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0634062650 0x7f063413afb0 secure :-1 s=THROTTLE_DONE pgs=1585 cs=0 l=1 rx=0x7f0634066710 tx=0x7f0624007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.377+0000 7f062b7fe700 1 -- 172.21.15.103:0/2510058661 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f062403d1a0 con 0x7f0634062650 2020-04-22T14:16:01.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.522+0000 7f0638f5f700 1 -- 172.21.15.103:0/2510058661 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0634140a70 con 0x7f0634062650 2020-04-22T14:16:01.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.523+0000 7f063259c700 1 --2- 172.21.15.103:0/2510058661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0634062650 0x7f063413afb0 secure :-1 s=THROTTLE_DONE pgs=1585 cs=0 l=1 rx=0x7f0634066710 tx=0x7f0624007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.523+0000 7f062b7fe700 1 -- 172.21.15.103:0/2510058661 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+13235 (secure 0 0 0) 0x7f06240407c0 con 0x7f0634062650 2020-04-22T14:16:01.526 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:16:01.526 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":108,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:16:00.747240+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:16:01.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.524+0000 7f0638f5f700 1 -- 172.21.15.103:0/2510058661 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f061804d980 msgr2=0x7f061804fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:01.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.524+0000 7f0638f5f700 1 --2- 172.21.15.103:0/2510058661 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f061804d980 0x7f061804fe40 secure :-1 s=READY pgs=575 cs=0 l=1 rx=0x7f06340637a0 tx=0x7f061c001dc0).stop 2020-04-22T14:16:01.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.524+0000 7f0638f5f700 1 -- 172.21.15.103:0/2510058661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0634062650 msgr2=0x7f063413afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:01.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.524+0000 7f0638f5f700 1 --2- 172.21.15.103:0/2510058661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0634062650 0x7f063413afb0 secure :-1 s=READY pgs=1585 cs=0 l=1 rx=0x7f0634066710 tx=0x7f0624007a40).stop 2020-04-22T14:16:01.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.525+0000 7f0638f5f700 1 -- 172.21.15.103:0/2510058661 shutdown_connections 2020-04-22T14:16:01.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.525+0000 7f0638f5f700 1 --2- 172.21.15.103:0/2510058661 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f061804d980 0x7f061804fe40 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:01.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.525+0000 7f0638f5f700 1 --2- 172.21.15.103:0/2510058661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0634062650 0x7f063413afb0 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:01.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.525+0000 7f0638f5f700 1 --2- 172.21.15.103:0/2510058661 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0634065fe0 0x7f06340ba190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:01.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.525+0000 7f0638f5f700 1 -- 172.21.15.103:0/2510058661 >> 172.21.15.103:0/2510058661 conn(0x7f063405f2c0 msgr2=0x7f063413c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:01.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.525+0000 7f0638f5f700 1 -- 172.21.15.103:0/2510058661 shutdown_connections 2020-04-22T14:16:01.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.525+0000 7f0638f5f700 1 -- 172.21.15.103:0/2510058661 wait complete. 2020-04-22T14:16:01.538 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:16:01.539 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:01.577 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:16:01.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.724+0000 7fa2a15bf700 1 Processor -- start 2020-04-22T14:16:01.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.724+0000 7fa2a15bf700 1 -- start start 2020-04-22T14:16:01.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.725+0000 7fa2a15bf700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa29c0b9140 0x7fa29c12b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:01.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.725+0000 7fa2a15bf700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa29c0ac950 0x7fa29c12b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:01.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.725+0000 7fa2a15bf700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa29c1467e0 con 0x7fa29c146c40 2020-04-22T14:16:01.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.725+0000 7fa2a15bf700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa29c0602f0 con 0x7fa29c0b9140 2020-04-22T14:16:01.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.725+0000 7fa2a15bf700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c060050 con 0x7fa29c0ac950 2020-04-22T14:16:01.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.725+0000 7fa29b7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa29c146c40 0x7fa29c143090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47900/0 (socket says 172.21.15.103:47900) 2020-04-22T14:16:01.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.725+0000 7fa29b7fe700 1 -- 172.21.15.103:0/2486245301 learned_addr learned my addr 172.21.15.103:0/2486245301 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:01.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.725+0000 7fa29affd700 1 --2- 172.21.15.103:0/2486245301 >> v2:172.21.15.86:3300/0 conn(0x7fa29c0b9140 0x7fa29c12b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:01.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.725+0000 7fa299ffb700 1 -- 172.21.15.103:0/2486245301 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3960577160 0 0) 0x7fa29c1467e0 con 0x7fa29c146c40 2020-04-22T14:16:01.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.725+0000 7fa299ffb700 1 -- 172.21.15.103:0/2486245301 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa280003230 con 0x7fa29c146c40 2020-04-22T14:16:01.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.725+0000 7fa29a7fc700 1 --2- 172.21.15.103:0/2486245301 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa29c0ac950 0x7fa29c12b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:01.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.725+0000 7fa299ffb700 1 -- 172.21.15.103:0/2486245301 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2346012086 0 0) 0x7fa280003230 con 0x7fa29c146c40 2020-04-22T14:16:01.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.725+0000 7fa299ffb700 1 -- 172.21.15.103:0/2486245301 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa29c0ac950 msgr2=0x7fa29c12b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:01.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.725+0000 7fa299ffb700 1 --2- 172.21.15.103:0/2486245301 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa29c0ac950 0x7fa29c12b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:01.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.726+0000 7fa299ffb700 1 -- 172.21.15.103:0/2486245301 >> v2:172.21.15.86:3300/0 conn(0x7fa29c0b9140 msgr2=0x7fa29c12b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:01.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.726+0000 7fa299ffb700 1 --2- 172.21.15.103:0/2486245301 >> v2:172.21.15.86:3300/0 conn(0x7fa29c0b9140 0x7fa29c12b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:01.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.726+0000 7fa299ffb700 1 -- 172.21.15.103:0/2486245301 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa29c0b9520 con 0x7fa29c146c40 2020-04-22T14:16:01.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.726+0000 7fa299ffb700 1 -- 172.21.15.103:0/2486245301 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fa294001a50 con 0x7fa29c146c40 2020-04-22T14:16:01.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.726+0000 7fa299ffb700 1 -- 172.21.15.103:0/2486245301 >> v1:172.21.15.103:6789/0 conn(0x7fa29c146c40 legacy=0x7fa29c143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:01.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.726+0000 7fa299ffb700 1 --2- 172.21.15.103:0/2486245301 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa29c0ac950 0x7fa280003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:01.766 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.726+0000 7fa299ffb700 1 --2- 172.21.15.103:0/2486245301 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa280003b80 0x7fa280003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:01.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.726+0000 7fa299ffb700 1 --2- 172.21.15.103:0/2486245301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2800045c0 0x7fa280004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:01.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.726+0000 7fa299ffb700 1 -- 172.21.15.103:0/2486245301 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c0602f0 con 0x7fa280003b80 2020-04-22T14:16:01.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.726+0000 7fa299ffb700 1 -- 172.21.15.103:0/2486245301 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c060050 con 0x7fa2800045c0 2020-04-22T14:16:01.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.726+0000 7fa299ffb700 1 -- 172.21.15.103:0/2486245301 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa280005050 con 0x7fa29c0ac950 2020-04-22T14:16:01.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.726+0000 7fa29b7fe700 1 --2- 172.21.15.103:0/2486245301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2800045c0 0x7fa280004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:01.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.726+0000 7fa29affd700 1 --2- 172.21.15.103:0/2486245301 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa29c0ac950 0x7fa280003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:01.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.726+0000 7fa29a7fc700 1 --2- 172.21.15.103:0/2486245301 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa280003b80 0x7fa280003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:01.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.726+0000 7fa29b7fe700 1 -- 172.21.15.103:0/2486245301 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa29c0ac950 msgr2=0x7fa280003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:01.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.726+0000 7fa29b7fe700 1 --2- 172.21.15.103:0/2486245301 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa29c0ac950 0x7fa280003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:01.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.726+0000 7fa29b7fe700 1 -- 172.21.15.103:0/2486245301 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa280003b80 msgr2=0x7fa280003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:01.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.726+0000 7fa29b7fe700 1 --2- 172.21.15.103:0/2486245301 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa280003b80 0x7fa280003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:01.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.726+0000 7fa29b7fe700 1 -- 172.21.15.103:0/2486245301 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa280003230 con 0x7fa2800045c0 2020-04-22T14:16:01.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.726+0000 7fa29b7fe700 1 --2- 172.21.15.103:0/2486245301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2800045c0 0x7fa280004a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa294001760 tx=0x7fa29c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.726+0000 7fa29b7fe700 1 --2- 172.21.15.103:0/2486245301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2800045c0 0x7fa280004a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa294001760 tx=0x7fa29c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.726+0000 7fa29b7fe700 1 --2- 172.21.15.103:0/2486245301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2800045c0 0x7fa280004a20 secure :-1 s=READY pgs=1587 cs=0 l=1 rx=0x7fa294001760 tx=0x7fa29c0b96b0).ready entity=mon.1 client_cookie=a4724cc00653255f server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:01.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.726+0000 7fa29b7fe700 1 --2- 172.21.15.103:0/2486245301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2800045c0 0x7fa280004a20 secure :-1 s=THROTTLE_DONE pgs=1587 cs=0 l=1 rx=0x7fa294001760 tx=0x7fa29c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.726+0000 7fa299ffb700 1 -- 172.21.15.103:0/2486245301 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa29400e560 con 0x7fa2800045c0 2020-04-22T14:16:01.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.726+0000 7fa29b7fe700 1 --2- 172.21.15.103:0/2486245301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2800045c0 0x7fa280004a20 secure :-1 s=THROTTLE_DONE pgs=1587 cs=0 l=1 rx=0x7fa294001760 tx=0x7fa29c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.726+0000 7fa29b7fe700 1 --2- 172.21.15.103:0/2486245301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2800045c0 0x7fa280004a20 secure :-1 s=THROTTLE_DONE pgs=1587 cs=0 l=1 rx=0x7fa294001760 tx=0x7fa29c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.726+0000 7fa299ffb700 1 -- 172.21.15.103:0/2486245301 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29400e6c0 con 0x7fa2800045c0 2020-04-22T14:16:01.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.726+0000 7fa299ffb700 1 -- 172.21.15.103:0/2486245301 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2940100c0 con 0x7fa2800045c0 2020-04-22T14:16:01.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.726+0000 7fa2a15bf700 1 -- 172.21.15.103:0/2486245301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2800045c0 msgr2=0x7fa280004a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:01.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.726+0000 7fa2a15bf700 1 --2- 172.21.15.103:0/2486245301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2800045c0 0x7fa280004a20 secure :-1 s=READY pgs=1587 cs=0 l=1 rx=0x7fa294001760 tx=0x7fa29c0b96b0).stop 2020-04-22T14:16:01.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.726+0000 7fa29b7fe700 1 -- 172.21.15.103:0/2486245301 reap_dead start 2020-04-22T14:16:01.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.727+0000 7fa2a15bf700 1 -- 172.21.15.103:0/2486245301 shutdown_connections 2020-04-22T14:16:01.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.727+0000 7fa2a15bf700 1 -- 172.21.15.103:0/2486245301 >> 172.21.15.103:0/2486245301 conn(0x7fa29c05b7b0 msgr2=0x7fa29c0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:01.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.727+0000 7fa2a15bf700 1 -- 172.21.15.103:0/2486245301 shutdown_connections 2020-04-22T14:16:01.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.727+0000 7fa2a15bf700 1 -- 172.21.15.103:0/2486245301 wait complete. 2020-04-22T14:16:01.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.728+0000 7fa2a15bf700 1 Processor -- start 2020-04-22T14:16:01.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.728+0000 7fa2a15bf700 1 -- start start 2020-04-22T14:16:01.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.729+0000 7fa2a15bf700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa29c0b5300 0x7fa29c157810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:01.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.729+0000 7fa2a15bf700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa29c153b80 con 0x7fa29c153630 2020-04-22T14:16:01.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.729+0000 7fa2a15bf700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa29c153e20 con 0x7fa29c065f20 2020-04-22T14:16:01.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.729+0000 7fa2a15bf700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa29c1540c0 con 0x7fa29c0b5300 2020-04-22T14:16:01.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.729+0000 7fa29affd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa29c065f20 0x7fa29c157100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47912/0 (socket says 172.21.15.103:47912) 2020-04-22T14:16:01.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.729+0000 7fa29affd700 1 -- 172.21.15.103:0/872595241 learned_addr learned my addr 172.21.15.103:0/872595241 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:01.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.729+0000 7fa29b7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa29c0b5300 0x7fa29c157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:01.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.729+0000 7fa29b7fe700 1 -- 172.21.15.103:0/872595241 >> v1:172.21.15.103:6789/0 conn(0x7fa29c065f20 legacy=0x7fa29c157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:01.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.729+0000 7fa29b7fe700 1 -- 172.21.15.103:0/872595241 >> v1:172.21.15.86:6789/0 conn(0x7fa29c153630 legacy=0x7fa29c1267e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:01.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.729+0000 7fa28bfff700 1 -- 172.21.15.103:0/872595241 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3985205892 0 0) 0x7fa29c153e20 con 0x7fa29c065f20 2020-04-22T14:16:01.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.729+0000 7fa29b7fe700 1 -- 172.21.15.103:0/872595241 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa29c066300 con 0x7fa29c0b5300 2020-04-22T14:16:01.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.729+0000 7fa29b7fe700 1 --2- 172.21.15.103:0/872595241 >> v2:172.21.15.103:3300/0 conn(0x7fa29c0b5300 0x7fa29c157810 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa29c153aa0 tx=0x7fa29c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.729+0000 7fa29b7fe700 1 --2- 172.21.15.103:0/872595241 >> v2:172.21.15.103:3300/0 conn(0x7fa29c0b5300 0x7fa29c157810 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa29c153aa0 tx=0x7fa29c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.729+0000 7fa29b7fe700 1 --2- 172.21.15.103:0/872595241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa29c0b5300 0x7fa29c157810 secure :-1 s=READY pgs=1589 cs=0 l=1 rx=0x7fa29c153aa0 tx=0x7fa29c0b96b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:01.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.729+0000 7fa29b7fe700 1 --2- 172.21.15.103:0/872595241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa29c0b5300 0x7fa29c157810 secure :-1 s=THROTTLE_DONE pgs=1589 cs=0 l=1 rx=0x7fa29c153aa0 tx=0x7fa29c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.729+0000 7fa28bfff700 1 -- 172.21.15.103:0/872595241 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa294010a50 con 0x7fa29c0b5300 2020-04-22T14:16:01.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.729+0000 7fa29b7fe700 1 --2- 172.21.15.103:0/872595241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa29c0b5300 0x7fa29c157810 secure :-1 s=THROTTLE_DONE pgs=1589 cs=0 l=1 rx=0x7fa29c153aa0 tx=0x7fa29c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.729+0000 7fa29b7fe700 1 --2- 172.21.15.103:0/872595241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa29c0b5300 0x7fa29c157810 secure :-1 s=THROTTLE_DONE pgs=1589 cs=0 l=1 rx=0x7fa29c153aa0 tx=0x7fa29c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.729+0000 7fa28bfff700 1 -- 172.21.15.103:0/872595241 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa294001a70 con 0x7fa29c0b5300 2020-04-22T14:16:01.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.729+0000 7fa2a15bf700 1 -- 172.21.15.103:0/872595241 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa29c0b15c0 con 0x7fa29c0b5300 2020-04-22T14:16:01.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.729+0000 7fa28bfff700 1 -- 172.21.15.103:0/872595241 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa294004930 con 0x7fa29c0b5300 2020-04-22T14:16:01.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.729+0000 7fa2a15bf700 1 -- 172.21.15.103:0/872595241 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa29c126ef0 con 0x7fa29c0b5300 2020-04-22T14:16:01.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.730+0000 7fa29b7fe700 1 --2- 172.21.15.103:0/872595241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa29c0b5300 0x7fa29c157810 secure :-1 s=THROTTLE_DONE pgs=1589 cs=0 l=1 rx=0x7fa29c153aa0 tx=0x7fa29c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.730+0000 7fa2a15bf700 1 -- 172.21.15.103:0/872595241 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa29c056c90 con 0x7fa29c0b5300 2020-04-22T14:16:01.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.730+0000 7fa28bfff700 1 -- 172.21.15.103:0/872595241 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fa294001510 con 0x7fa29c0b5300 2020-04-22T14:16:01.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.730+0000 7fa29b7fe700 1 --2- 172.21.15.103:0/872595241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa29c0b5300 0x7fa29c157810 secure :-1 s=THROTTLE_DONE pgs=1589 cs=0 l=1 rx=0x7fa29c153aa0 tx=0x7fa29c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.731+0000 7fa28bfff700 1 --2- 172.21.15.103:0/872595241 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa27804d7f0 0x7fa27804fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:01.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.731+0000 7fa28bfff700 1 -- 172.21.15.103:0/872595241 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fa2940618d0 con 0x7fa29c0b5300 2020-04-22T14:16:01.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.731+0000 7fa29affd700 1 --2- 172.21.15.103:0/872595241 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa27804d7f0 0x7fa27804fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:01.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.731+0000 7fa29affd700 1 --2- 172.21.15.103:0/872595241 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa27804d7f0 0x7fa27804fcb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa290002ed0 tx=0x7fa29000c910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.731+0000 7fa29affd700 1 --2- 172.21.15.103:0/872595241 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa27804d7f0 0x7fa27804fcb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa290002ed0 tx=0x7fa29000c910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.731+0000 7fa29affd700 1 --2- 172.21.15.103:0/872595241 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa27804d7f0 0x7fa27804fcb0 secure :-1 s=READY pgs=576 cs=0 l=1 rx=0x7fa290002ed0 tx=0x7fa29000c910).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:01.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.735+0000 7fa29b7fe700 1 --2- 172.21.15.103:0/872595241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa29c0b5300 0x7fa29c157810 secure :-1 s=THROTTLE_DONE pgs=1589 cs=0 l=1 rx=0x7fa29c153aa0 tx=0x7fa29c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.735+0000 7fa28bfff700 1 -- 172.21.15.103:0/872595241 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fa29403cdd0 con 0x7fa29c0b5300 2020-04-22T14:16:01.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.877+0000 7fa2a15bf700 1 -- 172.21.15.103:0/872595241 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fa29c154200 con 0x7fa29c0b5300 2020-04-22T14:16:01.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.877+0000 7fa29b7fe700 1 --2- 172.21.15.103:0/872595241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa29c0b5300 0x7fa29c157810 secure :-1 s=THROTTLE_DONE pgs=1589 cs=0 l=1 rx=0x7fa29c153aa0 tx=0x7fa29c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:01.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.878+0000 7fa28bfff700 1 -- 172.21.15.103:0/872595241 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v108) v1 ==== 110+0+10 (secure 0 0 0) 0x7fa2940403f0 con 0x7fa29c0b5300 2020-04-22T14:16:01.881 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:16:01.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.879+0000 7fa2a15bf700 1 -- 172.21.15.103:0/872595241 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa27804d7f0 msgr2=0x7fa27804fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:01.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.879+0000 7fa2a15bf700 1 --2- 172.21.15.103:0/872595241 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa27804d7f0 0x7fa27804fcb0 secure :-1 s=READY pgs=576 cs=0 l=1 rx=0x7fa290002ed0 tx=0x7fa29000c910).stop 2020-04-22T14:16:01.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.879+0000 7fa2a15bf700 1 -- 172.21.15.103:0/872595241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa29c0b5300 msgr2=0x7fa29c157810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:01.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.879+0000 7fa2a15bf700 1 --2- 172.21.15.103:0/872595241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa29c0b5300 0x7fa29c157810 secure :-1 s=READY pgs=1589 cs=0 l=1 rx=0x7fa29c153aa0 tx=0x7fa29c0b96b0).stop 2020-04-22T14:16:01.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.879+0000 7fa2a15bf700 1 -- 172.21.15.103:0/872595241 shutdown_connections 2020-04-22T14:16:01.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.879+0000 7fa2a15bf700 1 --2- 172.21.15.103:0/872595241 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa27804d7f0 0x7fa27804fcb0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:01.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.879+0000 7fa2a15bf700 1 --2- 172.21.15.103:0/872595241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa29c0b5300 0x7fa29c157810 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:01.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.879+0000 7fa2a15bf700 1 -- 172.21.15.103:0/872595241 >> 172.21.15.103:0/872595241 conn(0x7fa29c05b7b0 msgr2=0x7fa29c128d90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:01.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.879+0000 7fa2a15bf700 1 -- 172.21.15.103:0/872595241 shutdown_connections 2020-04-22T14:16:01.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:01.879+0000 7fa2a15bf700 1 -- 172.21.15.103:0/872595241 wait complete. 2020-04-22T14:16:01.891 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:01.911 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:16:02.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.058+0000 7f4e8737d700 1 Processor -- start 2020-04-22T14:16:02.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.058+0000 7f4e8737d700 1 -- start start 2020-04-22T14:16:02.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.059+0000 7f4e8737d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e800b8e00 0x7f4e800af010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:02.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.059+0000 7f4e8737d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4e8005fed0 0x7f4e800b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:02.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.059+0000 7f4e8737d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e800b29b0 con 0x7f4e800b91e0 2020-04-22T14:16:02.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.059+0000 7f4e8737d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e800b4270 con 0x7f4e8005fed0 2020-04-22T14:16:02.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.059+0000 7f4e8737d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e800b4510 con 0x7f4e800b8e00 2020-04-22T14:16:02.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.059+0000 7f4e85b7a700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f4e800b91e0 0x7f4e80142f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47920/0 (socket says 172.21.15.103:47920) 2020-04-22T14:16:02.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.059+0000 7f4e85b7a700 1 -- 172.21.15.103:0/1188986786 learned_addr learned my addr 172.21.15.103:0/1188986786 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:02.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.059+0000 7f4e86b7c700 1 --2- 172.21.15.103:0/1188986786 >> v2:172.21.15.86:3300/0 conn(0x7f4e8005fed0 0x7f4e800b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:02.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.059+0000 7f4e8637b700 1 --2- 172.21.15.103:0/1188986786 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e800b8e00 0x7f4e800af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:02.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.059+0000 7f4e85379700 1 -- 172.21.15.103:0/1188986786 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1299786427 0 0) 0x7f4e800b29b0 con 0x7f4e800b91e0 2020-04-22T14:16:02.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.060+0000 7f4e85379700 1 -- 172.21.15.103:0/1188986786 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e68003230 con 0x7f4e800b91e0 2020-04-22T14:16:02.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.060+0000 7f4e85379700 1 -- 172.21.15.103:0/1188986786 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 72212269 0 0) 0x7f4e68003230 con 0x7f4e800b91e0 2020-04-22T14:16:02.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.060+0000 7f4e85379700 1 -- 172.21.15.103:0/1188986786 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e800b8e00 msgr2=0x7f4e800af010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:02.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.060+0000 7f4e85379700 1 --2- 172.21.15.103:0/1188986786 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e800b8e00 0x7f4e800af010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:02.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.060+0000 7f4e85379700 1 -- 172.21.15.103:0/1188986786 >> v2:172.21.15.86:3300/0 conn(0x7f4e8005fed0 msgr2=0x7f4e800b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:02.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.060+0000 7f4e85379700 1 --2- 172.21.15.103:0/1188986786 >> v2:172.21.15.86:3300/0 conn(0x7f4e8005fed0 0x7f4e800b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:02.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.060+0000 7f4e85379700 1 -- 172.21.15.103:0/1188986786 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e800b2020 con 0x7f4e800b91e0 2020-04-22T14:16:02.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.060+0000 7f4e85379700 1 -- 172.21.15.103:0/1188986786 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f4e7c0016d0 con 0x7f4e800b91e0 2020-04-22T14:16:02.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.060+0000 7f4e85379700 1 -- 172.21.15.103:0/1188986786 >> v1:172.21.15.103:6789/0 conn(0x7f4e800b91e0 legacy=0x7f4e80142f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:02.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.060+0000 7f4e85379700 1 --2- 172.21.15.103:0/1188986786 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e800b8e00 0x7f4e68003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:02.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.060+0000 7f4e85379700 1 --2- 172.21.15.103:0/1188986786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e68003b80 0x7f4e68003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:02.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.060+0000 7f4e85379700 1 --2- 172.21.15.103:0/1188986786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e680045c0 0x7f4e68004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:02.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.060+0000 7f4e85379700 1 -- 172.21.15.103:0/1188986786 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e800b4270 con 0x7f4e680045c0 2020-04-22T14:16:02.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.060+0000 7f4e85379700 1 -- 172.21.15.103:0/1188986786 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e800b4510 con 0x7f4e68003b80 2020-04-22T14:16:02.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.060+0000 7f4e85379700 1 -- 172.21.15.103:0/1188986786 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e68005050 con 0x7f4e800b8e00 2020-04-22T14:16:02.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.060+0000 7f4e85b7a700 1 --2- 172.21.15.103:0/1188986786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e68003b80 0x7f4e68003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:02.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.060+0000 7f4e8637b700 1 --2- 172.21.15.103:0/1188986786 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e800b8e00 0x7f4e68003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:02.070 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.060+0000 7f4e86b7c700 1 --2- 172.21.15.103:0/1188986786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e680045c0 0x7f4e68004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:02.070 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.060+0000 7f4e85b7a700 1 -- 172.21.15.103:0/1188986786 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e800b8e00 msgr2=0x7f4e68003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:02.070 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.060+0000 7f4e85b7a700 1 --2- 172.21.15.103:0/1188986786 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e800b8e00 0x7f4e68003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:02.070 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.060+0000 7f4e85b7a700 1 -- 172.21.15.103:0/1188986786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e680045c0 msgr2=0x7f4e68004a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:02.070 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.060+0000 7f4e85b7a700 1 --2- 172.21.15.103:0/1188986786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e680045c0 0x7f4e68004a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:02.070 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.060+0000 7f4e85b7a700 1 -- 172.21.15.103:0/1188986786 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e68003230 con 0x7f4e68003b80 2020-04-22T14:16:02.070 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.060+0000 7f4e85b7a700 1 --2- 172.21.15.103:0/1188986786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e68003b80 0x7f4e68003fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4e7c0013e0 tx=0x7f4e800b2210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.070 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.060+0000 7f4e85b7a700 1 --2- 172.21.15.103:0/1188986786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e68003b80 0x7f4e68003fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4e7c0013e0 tx=0x7f4e800b2210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.060+0000 7f4e85b7a700 1 --2- 172.21.15.103:0/1188986786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e68003b80 0x7f4e68003fe0 secure :-1 s=READY pgs=1591 cs=0 l=1 rx=0x7f4e7c0013e0 tx=0x7f4e800b2210).ready entity=mon.1 client_cookie=a0efda994235b77 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:02.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.060+0000 7f4e85b7a700 1 --2- 172.21.15.103:0/1188986786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e68003b80 0x7f4e68003fe0 secure :-1 s=THROTTLE_DONE pgs=1591 cs=0 l=1 rx=0x7f4e7c0013e0 tx=0x7f4e800b2210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.060+0000 7f4e85379700 1 -- 172.21.15.103:0/1188986786 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e7c00ce70 con 0x7f4e68003b80 2020-04-22T14:16:02.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.060+0000 7f4e85b7a700 1 --2- 172.21.15.103:0/1188986786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e68003b80 0x7f4e68003fe0 secure :-1 s=THROTTLE_DONE pgs=1591 cs=0 l=1 rx=0x7f4e7c0013e0 tx=0x7f4e800b2210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.060+0000 7f4e85b7a700 1 --2- 172.21.15.103:0/1188986786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e68003b80 0x7f4e68003fe0 secure :-1 s=THROTTLE_DONE pgs=1591 cs=0 l=1 rx=0x7f4e7c0013e0 tx=0x7f4e800b2210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.060+0000 7f4e85379700 1 -- 172.21.15.103:0/1188986786 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e7c00e370 con 0x7f4e68003b80 2020-04-22T14:16:02.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.060+0000 7f4e85379700 1 -- 172.21.15.103:0/1188986786 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e7c00e750 con 0x7f4e68003b80 2020-04-22T14:16:02.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.060+0000 7f4e8737d700 1 -- 172.21.15.103:0/1188986786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e68003b80 msgr2=0x7f4e68003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:02.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.060+0000 7f4e8737d700 1 --2- 172.21.15.103:0/1188986786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e68003b80 0x7f4e68003fe0 secure :-1 s=READY pgs=1591 cs=0 l=1 rx=0x7f4e7c0013e0 tx=0x7f4e800b2210).stop 2020-04-22T14:16:02.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.060+0000 7f4e86b7c700 1 -- 172.21.15.103:0/1188986786 reap_dead start 2020-04-22T14:16:02.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.061+0000 7f4e8737d700 1 -- 172.21.15.103:0/1188986786 shutdown_connections 2020-04-22T14:16:02.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.061+0000 7f4e8737d700 1 -- 172.21.15.103:0/1188986786 >> 172.21.15.103:0/1188986786 conn(0x7f4e8005b780 msgr2=0x7f4e800b8530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:02.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.061+0000 7f4e8737d700 1 -- 172.21.15.103:0/1188986786 shutdown_connections 2020-04-22T14:16:02.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.061+0000 7f4e8737d700 1 -- 172.21.15.103:0/1188986786 wait complete. 2020-04-22T14:16:02.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.062+0000 7f4e8737d700 1 Processor -- start 2020-04-22T14:16:02.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.062+0000 7f4e8737d700 1 -- start start 2020-04-22T14:16:02.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.063+0000 7f4e8737d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4e80143860 0x7f4e801541a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:02.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.063+0000 7f4e8737d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e80154850 con 0x7f4e80153dc0 2020-04-22T14:16:02.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.063+0000 7f4e8737d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e80154600 con 0x7f4e800628d0 2020-04-22T14:16:02.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.063+0000 7f4e8737d700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e80140160 con 0x7f4e80143860 2020-04-22T14:16:02.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.063+0000 7f4e85b7a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4e80143860 0x7f4e801541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:02.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.063+0000 7f4e85b7a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4e80143860 0x7f4e801541a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55742/0 (socket says 172.21.15.103:55742) 2020-04-22T14:16:02.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.063+0000 7f4e85b7a700 1 -- 172.21.15.103:0/1595881885 learned_addr learned my addr 172.21.15.103:0/1595881885 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:02.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.063+0000 7f4e86b7c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f4e800628d0 0x7f4e80150340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47934/0 (socket says 172.21.15.103:47934) 2020-04-22T14:16:02.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.063+0000 7f4e85b7a700 1 -- 172.21.15.103:0/1595881885 >> v1:172.21.15.103:6789/0 conn(0x7f4e800628d0 legacy=0x7f4e80150340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:02.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.063+0000 7f4e85b7a700 1 -- 172.21.15.103:0/1595881885 >> v1:172.21.15.86:6789/0 conn(0x7f4e80153dc0 legacy=0x7f4e800b4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:02.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.063+0000 7f4e85b7a700 1 -- 172.21.15.103:0/1595881885 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e80140400 con 0x7f4e80143860 2020-04-22T14:16:02.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.063+0000 7f4e6f7fe700 1 -- 172.21.15.103:0/1595881885 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1504188059 0 0) 0x7f4e80154600 con 0x7f4e800628d0 2020-04-22T14:16:02.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.063+0000 7f4e85b7a700 1 --2- 172.21.15.103:0/1595881885 >> v2:172.21.15.103:3300/0 conn(0x7f4e80143860 0x7f4e801541a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4e7c0013e0 tx=0x7f4e800b2210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.063+0000 7f4e85b7a700 1 --2- 172.21.15.103:0/1595881885 >> v2:172.21.15.103:3300/0 conn(0x7f4e80143860 0x7f4e801541a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4e7c0013e0 tx=0x7f4e800b2210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.063+0000 7f4e85b7a700 1 --2- 172.21.15.103:0/1595881885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e80143860 0x7f4e801541a0 secure :-1 s=READY pgs=1593 cs=0 l=1 rx=0x7f4e7c0013e0 tx=0x7f4e800b2210).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:02.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.063+0000 7f4e85b7a700 1 --2- 172.21.15.103:0/1595881885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e80143860 0x7f4e801541a0 secure :-1 s=THROTTLE_DONE pgs=1593 cs=0 l=1 rx=0x7f4e7c0013e0 tx=0x7f4e800b2210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.063+0000 7f4e6f7fe700 1 -- 172.21.15.103:0/1595881885 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e7c00fe40 con 0x7f4e80143860 2020-04-22T14:16:02.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.063+0000 7f4e85b7a700 1 --2- 172.21.15.103:0/1595881885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e80143860 0x7f4e801541a0 secure :-1 s=THROTTLE_DONE pgs=1593 cs=0 l=1 rx=0x7f4e7c0013e0 tx=0x7f4e800b2210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.063+0000 7f4e85b7a700 1 --2- 172.21.15.103:0/1595881885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e80143860 0x7f4e801541a0 secure :-1 s=THROTTLE_DONE pgs=1593 cs=0 l=1 rx=0x7f4e7c0013e0 tx=0x7f4e800b2210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.063+0000 7f4e6f7fe700 1 -- 172.21.15.103:0/1595881885 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e7c006370 con 0x7f4e80143860 2020-04-22T14:16:02.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.063+0000 7f4e6f7fe700 1 -- 172.21.15.103:0/1595881885 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e7c0049b0 con 0x7f4e80143860 2020-04-22T14:16:02.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.063+0000 7f4e8737d700 1 -- 172.21.15.103:0/1595881885 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e800b56e0 con 0x7f4e80143860 2020-04-22T14:16:02.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.063+0000 7f4e8737d700 1 -- 172.21.15.103:0/1595881885 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e80150a50 con 0x7f4e80143860 2020-04-22T14:16:02.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.064+0000 7f4e85b7a700 1 --2- 172.21.15.103:0/1595881885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e80143860 0x7f4e801541a0 secure :-1 s=THROTTLE_DONE pgs=1593 cs=0 l=1 rx=0x7f4e7c0013e0 tx=0x7f4e800b2210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.064+0000 7f4e6f7fe700 1 -- 172.21.15.103:0/1595881885 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f4e7c004be0 con 0x7f4e80143860 2020-04-22T14:16:02.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.064+0000 7f4e85b7a700 1 --2- 172.21.15.103:0/1595881885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e80143860 0x7f4e801541a0 secure :-1 s=THROTTLE_DONE pgs=1593 cs=0 l=1 rx=0x7f4e7c0013e0 tx=0x7f4e800b2210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.064+0000 7f4e8737d700 1 -- 172.21.15.103:0/1595881885 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e801407c0 con 0x7f4e80143860 2020-04-22T14:16:02.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.064+0000 7f4e6f7fe700 1 --2- 172.21.15.103:0/1595881885 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4e6004d880 0x7f4e6004fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:02.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.065+0000 7f4e6f7fe700 1 -- 172.21.15.103:0/1595881885 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f4e7c063a30 con 0x7f4e80143860 2020-04-22T14:16:02.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.065+0000 7f4e8637b700 1 --2- 172.21.15.103:0/1595881885 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4e6004d880 0x7f4e6004fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:02.080 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.065+0000 7f4e8637b700 1 --2- 172.21.15.103:0/1595881885 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4e6004d880 0x7f4e6004fd40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4e80141ef0 tx=0x7f4e70007d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.080 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.065+0000 7f4e8637b700 1 --2- 172.21.15.103:0/1595881885 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4e6004d880 0x7f4e6004fd40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4e80141ef0 tx=0x7f4e70007d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.080 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.065+0000 7f4e8637b700 1 --2- 172.21.15.103:0/1595881885 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4e6004d880 0x7f4e6004fd40 secure :-1 s=READY pgs=577 cs=0 l=1 rx=0x7f4e80141ef0 tx=0x7f4e70007d10).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:02.080 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.068+0000 7f4e85b7a700 1 --2- 172.21.15.103:0/1595881885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e80143860 0x7f4e801541a0 secure :-1 s=THROTTLE_DONE pgs=1593 cs=0 l=1 rx=0x7f4e7c0013e0 tx=0x7f4e800b2210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.080 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.068+0000 7f4e6f7fe700 1 -- 172.21.15.103:0/1595881885 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f4e7c03ef30 con 0x7f4e80143860 2020-04-22T14:16:02.214 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.211+0000 7f4e8737d700 1 -- 172.21.15.103:0/1595881885 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4e80063060 con 0x7f4e80143860 2020-04-22T14:16:02.214 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.212+0000 7f4e85b7a700 1 --2- 172.21.15.103:0/1595881885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e80143860 0x7f4e801541a0 secure :-1 s=THROTTLE_DONE pgs=1593 cs=0 l=1 rx=0x7f4e7c0013e0 tx=0x7f4e800b2210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.214 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.212+0000 7f4e6f7fe700 1 -- 172.21.15.103:0/1595881885 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v108) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4e7c042550 con 0x7f4e80143860 2020-04-22T14:16:02.214 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:16:02.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.213+0000 7f4e8737d700 1 -- 172.21.15.103:0/1595881885 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4e6004d880 msgr2=0x7f4e6004fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:02.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.213+0000 7f4e8737d700 1 --2- 172.21.15.103:0/1595881885 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4e6004d880 0x7f4e6004fd40 secure :-1 s=READY pgs=577 cs=0 l=1 rx=0x7f4e80141ef0 tx=0x7f4e70007d10).stop 2020-04-22T14:16:02.216 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.213+0000 7f4e8737d700 1 -- 172.21.15.103:0/1595881885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e80143860 msgr2=0x7f4e801541a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:02.216 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.213+0000 7f4e8737d700 1 --2- 172.21.15.103:0/1595881885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e80143860 0x7f4e801541a0 secure :-1 s=READY pgs=1593 cs=0 l=1 rx=0x7f4e7c0013e0 tx=0x7f4e800b2210).stop 2020-04-22T14:16:02.216 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.213+0000 7f4e8737d700 1 -- 172.21.15.103:0/1595881885 shutdown_connections 2020-04-22T14:16:02.216 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.213+0000 7f4e8737d700 1 --2- 172.21.15.103:0/1595881885 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4e6004d880 0x7f4e6004fd40 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:02.216 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.213+0000 7f4e8737d700 1 --2- 172.21.15.103:0/1595881885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e80143860 0x7f4e801541a0 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:02.217 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.213+0000 7f4e8737d700 1 -- 172.21.15.103:0/1595881885 >> 172.21.15.103:0/1595881885 conn(0x7f4e8005b780 msgr2=0x7f4e800b7150 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:02.217 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.213+0000 7f4e8737d700 1 -- 172.21.15.103:0/1595881885 shutdown_connections 2020-04-22T14:16:02.217 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.213+0000 7f4e8737d700 1 -- 172.21.15.103:0/1595881885 wait complete. 2020-04-22T14:16:02.225 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:02.240 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-04-22T14:16:02.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.384+0000 7f24b16db700 1 Processor -- start 2020-04-22T14:16:02.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.384+0000 7f24b16db700 1 -- start start 2020-04-22T14:16:02.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.385+0000 7f24b16db700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f24ac065fe0 0x7f24ac1464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:02.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.385+0000 7f24b16db700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24ac063e30 0x7f24ac0642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:02.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.385+0000 7f24b16db700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24ac143300 con 0x7f24ac12c0d0 2020-04-22T14:16:02.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.385+0000 7f24b16db700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24ac1435a0 con 0x7f24ac065fe0 2020-04-22T14:16:02.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.385+0000 7f24b16db700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac143840 con 0x7f24ac063e30 2020-04-22T14:16:02.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.385+0000 7f24aa7fc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f24ac065fe0 0x7f24ac1464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:02.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.385+0000 7f24ab7fe700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24ac063e30 0x7f24ac0642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:02.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.385+0000 7f24aa7fc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f24ac065fe0 0x7f24ac1464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:52982/0 (socket says 172.21.15.103:52982) 2020-04-22T14:16:02.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.385+0000 7f24aa7fc700 1 -- 172.21.15.103:0/319419218 learned_addr learned my addr 172.21.15.103:0/319419218 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:02.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.385+0000 7f24aaffd700 1 --1- 172.21.15.103:0/319419218 >> v1:172.21.15.86:6789/0 conn(0x7f24ac12c0d0 0x7f24ac05b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:36862/0 (socket says 172.21.15.103:36862) 2020-04-22T14:16:02.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.386+0000 7f24aa7fc700 1 -- 172.21.15.103:0/319419218 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24ac063e30 msgr2=0x7f24ac0642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:02.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.386+0000 7f24aa7fc700 1 --2- 172.21.15.103:0/319419218 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24ac063e30 0x7f24ac0642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:02.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.386+0000 7f24aa7fc700 1 -- 172.21.15.103:0/319419218 >> v1:172.21.15.86:6789/0 conn(0x7f24ac12c0d0 legacy=0x7f24ac05b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:02.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.386+0000 7f24a9ffb700 1 -- 172.21.15.103:0/319419218 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 194445938 0 0) 0x7f24ac143300 con 0x7f24ac12c0d0 2020-04-22T14:16:02.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.386+0000 7f24aa7fc700 1 -- 172.21.15.103:0/319419218 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ac05bb50 con 0x7f24ac065fe0 2020-04-22T14:16:02.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.386+0000 7f24aa7fc700 1 --2- 172.21.15.103:0/319419218 >> v2:172.21.15.86:3300/0 conn(0x7f24ac065fe0 0x7f24ac1464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f249c002f30 tx=0x7f249c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.386+0000 7f24aa7fc700 1 --2- 172.21.15.103:0/319419218 >> v2:172.21.15.86:3300/0 conn(0x7f24ac065fe0 0x7f24ac1464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f249c002f30 tx=0x7f249c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.386+0000 7f24aa7fc700 1 --2- 172.21.15.103:0/319419218 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24ac065fe0 0x7f24ac1464e0 secure :-1 s=READY pgs=848 cs=0 l=1 rx=0x7f249c002f30 tx=0x7f249c007a40).ready entity=mon.0 client_cookie=acfe787db939cb6a server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:02.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.386+0000 7f24aa7fc700 1 --2- 172.21.15.103:0/319419218 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24ac065fe0 0x7f24ac1464e0 secure :-1 s=THROTTLE_DONE pgs=848 cs=0 l=1 rx=0x7f249c002f30 tx=0x7f249c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.386+0000 7f24a9ffb700 1 -- 172.21.15.103:0/319419218 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f249c011670 con 0x7f24ac065fe0 2020-04-22T14:16:02.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.386+0000 7f24aa7fc700 1 --2- 172.21.15.103:0/319419218 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24ac065fe0 0x7f24ac1464e0 secure :-1 s=THROTTLE_DONE pgs=848 cs=0 l=1 rx=0x7f249c002f30 tx=0x7f249c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.386+0000 7f24a9ffb700 1 -- 172.21.15.103:0/319419218 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249c011810 con 0x7f24ac065fe0 2020-04-22T14:16:02.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.386+0000 7f24aa7fc700 1 --2- 172.21.15.103:0/319419218 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24ac065fe0 0x7f24ac1464e0 secure :-1 s=THROTTLE_DONE pgs=848 cs=0 l=1 rx=0x7f249c002f30 tx=0x7f249c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.386+0000 7f24a9ffb700 1 -- 172.21.15.103:0/319419218 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f249c011bf0 con 0x7f24ac065fe0 2020-04-22T14:16:02.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.386+0000 7f24b16db700 1 -- 172.21.15.103:0/319419218 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24ac065fe0 msgr2=0x7f24ac1464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:02.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.386+0000 7f24b16db700 1 --2- 172.21.15.103:0/319419218 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24ac065fe0 0x7f24ac1464e0 secure :-1 s=READY pgs=848 cs=0 l=1 rx=0x7f249c002f30 tx=0x7f249c007a40).stop 2020-04-22T14:16:02.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.387+0000 7f24b16db700 1 -- 172.21.15.103:0/319419218 shutdown_connections 2020-04-22T14:16:02.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.387+0000 7f24b16db700 1 --2- 172.21.15.103:0/319419218 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24ac063e30 0x7f24ac0642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:02.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.387+0000 7f24b16db700 1 --2- 172.21.15.103:0/319419218 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24ac065fe0 0x7f24ac1464e0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:02.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.387+0000 7f24b16db700 1 -- 172.21.15.103:0/319419218 >> 172.21.15.103:0/319419218 conn(0x7f24ac0b9160 msgr2=0x7f24ac05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:02.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.387+0000 7f24b16db700 1 -- 172.21.15.103:0/319419218 shutdown_connections 2020-04-22T14:16:02.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.387+0000 7f24b16db700 1 -- 172.21.15.103:0/319419218 wait complete. 2020-04-22T14:16:02.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.388+0000 7f24b16db700 1 Processor -- start 2020-04-22T14:16:02.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.388+0000 7f24b16db700 1 -- start start 2020-04-22T14:16:02.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.388+0000 7f24b16db700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f24ac12c0d0 0x7f24ac142450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:02.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.388+0000 7f24b16db700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24ac1239a0 con 0x7f24ac065fe0 2020-04-22T14:16:02.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.388+0000 7f24b16db700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24ac123c40 con 0x7f24ac063e30 2020-04-22T14:16:02.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.388+0000 7f24b16db700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24ac123ee0 con 0x7f24ac12c0d0 2020-04-22T14:16:02.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.388+0000 7f24aaffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f24ac063e30 0x7f24ac1452a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47944/0 (socket says 172.21.15.103:47944) 2020-04-22T14:16:02.412 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.388+0000 7f24aaffd700 1 -- 172.21.15.103:0/1333511996 learned_addr learned my addr 172.21.15.103:0/1333511996 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:02.412 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.389+0000 7f249bfff700 1 -- 172.21.15.103:0/1333511996 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1145186590 0 0) 0x7f24ac123c40 con 0x7f24ac063e30 2020-04-22T14:16:02.413 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.389+0000 7f24ab7fe700 1 --2- 172.21.15.103:0/1333511996 >> v2:172.21.15.86:3300/0 conn(0x7f24ac12c0d0 0x7f24ac142450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:02.413 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.389+0000 7f249bfff700 1 -- 172.21.15.103:0/1333511996 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2488002fe0 con 0x7f24ac063e30 2020-04-22T14:16:02.413 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.389+0000 7f249bfff700 1 -- 172.21.15.103:0/1333511996 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4093550868 0 0) 0x7f2488002fe0 con 0x7f24ac063e30 2020-04-22T14:16:02.413 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.389+0000 7f249bfff700 1 -- 172.21.15.103:0/1333511996 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f24ac123c40 con 0x7f24ac063e30 2020-04-22T14:16:02.413 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.389+0000 7f249bfff700 1 -- 172.21.15.103:0/1333511996 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f24a0001920 con 0x7f24ac063e30 2020-04-22T14:16:02.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.389+0000 7f249bfff700 1 -- 172.21.15.103:0/1333511996 >> v2:172.21.15.86:3300/0 conn(0x7f24ac12c0d0 msgr2=0x7f24ac142450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:02.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.389+0000 7f249bfff700 1 --2- 172.21.15.103:0/1333511996 >> v2:172.21.15.86:3300/0 conn(0x7f24ac12c0d0 0x7f24ac142450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:02.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.389+0000 7f249bfff700 1 -- 172.21.15.103:0/1333511996 >> v1:172.21.15.103:6789/0 conn(0x7f24ac063e30 legacy=0x7f24ac1452a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:02.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.389+0000 7f249bfff700 1 -- 172.21.15.103:0/1333511996 >> v1:172.21.15.86:6789/0 conn(0x7f24ac065fe0 legacy=0x7f24ac11efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:02.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.389+0000 7f249bfff700 1 --2- 172.21.15.103:0/1333511996 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24880049b0 0x7f2488004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:02.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.389+0000 7f249bfff700 1 --2- 172.21.15.103:0/1333511996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2488005290 0x7f24880039a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:02.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.389+0000 7f249bfff700 1 --2- 172.21.15.103:0/1333511996 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2488003f10 0x7f2488004390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:02.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.389+0000 7f249bfff700 1 -- 172.21.15.103:0/1333511996 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac123ee0 con 0x7f2488003f10 2020-04-22T14:16:02.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.389+0000 7f249bfff700 1 -- 172.21.15.103:0/1333511996 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248800b810 con 0x7f2488005290 2020-04-22T14:16:02.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.389+0000 7f249bfff700 1 -- 172.21.15.103:0/1333511996 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f248800b9d0 con 0x7f24880049b0 2020-04-22T14:16:02.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.389+0000 7f24ab7fe700 1 --2- 172.21.15.103:0/1333511996 >> v2:172.21.15.86:3300/0 conn(0x7f24ac12c0d0 0x7f24ac142450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:16:02.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.389+0000 7f24aa7fc700 1 --2- 172.21.15.103:0/1333511996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2488005290 0x7f24880039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:02.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.389+0000 7f24aaffd700 1 --2- 172.21.15.103:0/1333511996 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24880049b0 0x7f2488004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:02.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.389+0000 7f24ab7fe700 1 --2- 172.21.15.103:0/1333511996 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2488003f10 0x7f2488004390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:02.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.389+0000 7f24aa7fc700 1 -- 172.21.15.103:0/1333511996 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24880049b0 msgr2=0x7f2488004d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:02.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.389+0000 7f24aa7fc700 1 --2- 172.21.15.103:0/1333511996 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24880049b0 0x7f2488004d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:02.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.389+0000 7f24aa7fc700 1 -- 172.21.15.103:0/1333511996 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2488003f10 msgr2=0x7f2488004390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:02.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.389+0000 7f24aa7fc700 1 --2- 172.21.15.103:0/1333511996 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2488003f10 0x7f2488004390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:02.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.389+0000 7f24aa7fc700 1 -- 172.21.15.103:0/1333511996 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ac123690 con 0x7f2488005290 2020-04-22T14:16:02.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.389+0000 7f24b16db700 1 -- 172.21.15.103:0/1333511996 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24ac1459b0 con 0x7f2488005290 2020-04-22T14:16:02.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.389+0000 7f24ab7fe700 1 --2- 172.21.15.103:0/1333511996 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2488003f10 0x7f2488004390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:16:02.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.389+0000 7f24ab7fe700 1 -- 172.21.15.103:0/1333511996 reap_dead start 2020-04-22T14:16:02.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.389+0000 7f24aa7fc700 1 --2- 172.21.15.103:0/1333511996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2488005290 0x7f24880039a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f249c0084c0 tx=0x7f249c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.389+0000 7f24b16db700 1 -- 172.21.15.103:0/1333511996 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24ac142610 con 0x7f2488005290 2020-04-22T14:16:02.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.389+0000 7f24aa7fc700 1 --2- 172.21.15.103:0/1333511996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2488005290 0x7f24880039a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f249c0084c0 tx=0x7f249c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.389+0000 7f24aa7fc700 1 --2- 172.21.15.103:0/1333511996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2488005290 0x7f24880039a0 secure :-1 s=READY pgs=1595 cs=0 l=1 rx=0x7f249c0084c0 tx=0x7f249c007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:02.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.390+0000 7f24aa7fc700 1 --2- 172.21.15.103:0/1333511996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2488005290 0x7f24880039a0 secure :-1 s=THROTTLE_DONE pgs=1595 cs=0 l=1 rx=0x7f249c0084c0 tx=0x7f249c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.390+0000 7f249bfff700 1 -- 172.21.15.103:0/1333511996 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f249c007360 con 0x7f2488005290 2020-04-22T14:16:02.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.390+0000 7f24aa7fc700 1 --2- 172.21.15.103:0/1333511996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2488005290 0x7f24880039a0 secure :-1 s=THROTTLE_DONE pgs=1595 cs=0 l=1 rx=0x7f249c0084c0 tx=0x7f249c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.390+0000 7f24aa7fc700 1 --2- 172.21.15.103:0/1333511996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2488005290 0x7f24880039a0 secure :-1 s=THROTTLE_DONE pgs=1595 cs=0 l=1 rx=0x7f249c0084c0 tx=0x7f249c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.390+0000 7f249bfff700 1 -- 172.21.15.103:0/1333511996 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249c0074c0 con 0x7f2488005290 2020-04-22T14:16:02.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.390+0000 7f249bfff700 1 -- 172.21.15.103:0/1333511996 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f249c0058b0 con 0x7f2488005290 2020-04-22T14:16:02.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.390+0000 7f24aa7fc700 1 --2- 172.21.15.103:0/1333511996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2488005290 0x7f24880039a0 secure :-1 s=THROTTLE_DONE pgs=1595 cs=0 l=1 rx=0x7f249c0084c0 tx=0x7f249c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.390+0000 7f24b16db700 1 -- 172.21.15.103:0/1333511996 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f248c003340 con 0x7f2488005290 2020-04-22T14:16:02.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.391+0000 7f249bfff700 1 -- 172.21.15.103:0/1333511996 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f249c005a10 con 0x7f2488005290 2020-04-22T14:16:02.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.391+0000 7f24aa7fc700 1 --2- 172.21.15.103:0/1333511996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2488005290 0x7f24880039a0 secure :-1 s=THROTTLE_DONE pgs=1595 cs=0 l=1 rx=0x7f249c0084c0 tx=0x7f249c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.391+0000 7f249bfff700 1 --2- 172.21.15.103:0/1333511996 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2488051790 0x7f2488053c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:02.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.391+0000 7f249bfff700 1 -- 172.21.15.103:0/1333511996 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f249c061a60 con 0x7f2488005290 2020-04-22T14:16:02.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.391+0000 7f24aaffd700 1 --2- 172.21.15.103:0/1333511996 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2488051790 0x7f2488053c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:02.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.391+0000 7f24aaffd700 1 --2- 172.21.15.103:0/1333511996 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2488051790 0x7f2488053c50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f24a0001130 tx=0x7f24a0008b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.391+0000 7f24aaffd700 1 --2- 172.21.15.103:0/1333511996 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2488051790 0x7f2488053c50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f24a0001130 tx=0x7f24a0008b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.391+0000 7f24aaffd700 1 --2- 172.21.15.103:0/1333511996 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2488051790 0x7f2488053c50 secure :-1 s=READY pgs=578 cs=0 l=1 rx=0x7f24a0001130 tx=0x7f24a0008b50).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:02.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.395+0000 7f24aa7fc700 1 --2- 172.21.15.103:0/1333511996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2488005290 0x7f24880039a0 secure :-1 s=THROTTLE_DONE pgs=1595 cs=0 l=1 rx=0x7f249c0084c0 tx=0x7f249c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.395+0000 7f249bfff700 1 -- 172.21.15.103:0/1333511996 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f249c03cf60 con 0x7f2488005290 2020-04-22T14:16:02.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.540+0000 7f24b16db700 1 -- 172.21.15.103:0/1333511996 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f248c0021d0 con 0x7f2488005290 2020-04-22T14:16:02.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.540+0000 7f24aa7fc700 1 --2- 172.21.15.103:0/1333511996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2488005290 0x7f24880039a0 secure :-1 s=THROTTLE_DONE pgs=1595 cs=0 l=1 rx=0x7f249c0084c0 tx=0x7f249c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.540+0000 7f249bfff700 1 -- 172.21.15.103:0/1333511996 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v108) v1 ==== 84+0+143 (secure 0 0 0) 0x7f249c040580 con 0x7f2488005290 2020-04-22T14:16:02.543 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:16:02.543 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2020-04-22T14:16:02.543 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:02.543 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 1, 2020-04-22T14:16:02.543 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": "device_health_metrics" 2020-04-22T14:16:02.543 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:02.543 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:02.544 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 2, 2020-04-22T14:16:02.544 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": "rbd" 2020-04-22T14:16:02.544 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:02.544 INFO:teuthology.orchestra.run.smithi103.stdout:] 2020-04-22T14:16:02.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.541+0000 7f24b16db700 1 -- 172.21.15.103:0/1333511996 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2488051790 msgr2=0x7f2488053c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:02.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.541+0000 7f24b16db700 1 --2- 172.21.15.103:0/1333511996 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2488051790 0x7f2488053c50 secure :-1 s=READY pgs=578 cs=0 l=1 rx=0x7f24a0001130 tx=0x7f24a0008b50).stop 2020-04-22T14:16:02.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.541+0000 7f24b16db700 1 -- 172.21.15.103:0/1333511996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2488005290 msgr2=0x7f24880039a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:02.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.541+0000 7f24b16db700 1 --2- 172.21.15.103:0/1333511996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2488005290 0x7f24880039a0 secure :-1 s=READY pgs=1595 cs=0 l=1 rx=0x7f249c0084c0 tx=0x7f249c007a40).stop 2020-04-22T14:16:02.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.541+0000 7f24b16db700 1 -- 172.21.15.103:0/1333511996 shutdown_connections 2020-04-22T14:16:02.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.541+0000 7f24b16db700 1 --2- 172.21.15.103:0/1333511996 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2488051790 0x7f2488053c50 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:02.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.541+0000 7f24b16db700 1 --2- 172.21.15.103:0/1333511996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2488005290 0x7f24880039a0 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:02.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.541+0000 7f24b16db700 1 -- 172.21.15.103:0/1333511996 >> 172.21.15.103:0/1333511996 conn(0x7f24ac0b9160 msgr2=0x7f24ac0b4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:02.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.541+0000 7f24b16db700 1 -- 172.21.15.103:0/1333511996 shutdown_connections 2020-04-22T14:16:02.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.542+0000 7f24b16db700 1 -- 172.21.15.103:0/1333511996 wait complete. 2020-04-22T14:16:02.556 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-04-22T14:16:02.556 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:02.572 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-04-22T14:16:02.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.723+0000 7f4173bbc700 1 Processor -- start 2020-04-22T14:16:02.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.724+0000 7f4173bbc700 1 -- start start 2020-04-22T14:16:02.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.724+0000 7f4173bbc700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f416c061a30 0x7f416c0b4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:02.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.724+0000 7f4173bbc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f416c0acb10 0x7f416c0ae920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:02.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.724+0000 7f4173bbc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f416c0aed80 0x7f416c0b3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:02.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.724+0000 7f4173bbc700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f416c060250 con 0x7f416c0aed80 2020-04-22T14:16:02.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.724+0000 7f4173bbc700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f416c0623c0 con 0x7f416c0acb10 2020-04-22T14:16:02.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.724+0000 7f4173bbc700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f416c062660 con 0x7f416c061a30 2020-04-22T14:16:02.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.724+0000 7f4171157700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f416c0acb10 0x7f416c0ae920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:02.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.725+0000 7f4171157700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f416c0acb10 0x7f416c0ae920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55768/0 (socket says 172.21.15.103:55768) 2020-04-22T14:16:02.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.725+0000 7f4171157700 1 -- 172.21.15.103:0/919205613 learned_addr learned my addr 172.21.15.103:0/919205613 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:02.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.725+0000 7f4171958700 1 --2- 172.21.15.103:0/919205613 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f416c061a30 0x7f416c0b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:02.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.725+0000 7f4171157700 1 -- 172.21.15.103:0/919205613 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f416c061a30 msgr2=0x7f416c0b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:02.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.725+0000 7f4171157700 1 --2- 172.21.15.103:0/919205613 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f416c061a30 0x7f416c0b4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:02.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.725+0000 7f4171157700 1 -- 172.21.15.103:0/919205613 >> v2:172.21.15.86:3300/0 conn(0x7f416c0aed80 msgr2=0x7f416c0b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:02.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.725+0000 7f4172159700 1 --2- 172.21.15.103:0/919205613 >> v2:172.21.15.86:3300/0 conn(0x7f416c0aed80 0x7f416c0b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:02.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.725+0000 7f4171157700 1 --2- 172.21.15.103:0/919205613 >> v2:172.21.15.86:3300/0 conn(0x7f416c0aed80 0x7f416c0b3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:02.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.725+0000 7f4171157700 1 -- 172.21.15.103:0/919205613 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f416c061e10 con 0x7f416c0acb10 2020-04-22T14:16:02.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.725+0000 7f4171157700 1 --2- 172.21.15.103:0/919205613 >> v2:172.21.15.103:3300/0 conn(0x7f416c0acb10 0x7f416c0ae920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4168002f30 tx=0x7f4168007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.725+0000 7f4171157700 1 --2- 172.21.15.103:0/919205613 >> v2:172.21.15.103:3300/0 conn(0x7f416c0acb10 0x7f416c0ae920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4168002f30 tx=0x7f4168007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.725+0000 7f4171157700 1 --2- 172.21.15.103:0/919205613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f416c0acb10 0x7f416c0ae920 secure :-1 s=READY pgs=1596 cs=0 l=1 rx=0x7f4168002f30 tx=0x7f4168007a40).ready entity=mon.1 client_cookie=fe0bde49824ad7 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:02.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.725+0000 7f4171157700 1 --2- 172.21.15.103:0/919205613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f416c0acb10 0x7f416c0ae920 secure :-1 s=THROTTLE_DONE pgs=1596 cs=0 l=1 rx=0x7f4168002f30 tx=0x7f4168007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.725+0000 7f4171157700 1 --2- 172.21.15.103:0/919205613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f416c0acb10 0x7f416c0ae920 secure :-1 s=THROTTLE_DONE pgs=1596 cs=0 l=1 rx=0x7f4168002f30 tx=0x7f4168007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.725+0000 7f4170956700 1 -- 172.21.15.103:0/919205613 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4168011720 con 0x7f416c0acb10 2020-04-22T14:16:02.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.725+0000 7f4171157700 1 --2- 172.21.15.103:0/919205613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f416c0acb10 0x7f416c0ae920 secure :-1 s=THROTTLE_DONE pgs=1596 cs=0 l=1 rx=0x7f4168002f30 tx=0x7f4168007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.725+0000 7f4170956700 1 -- 172.21.15.103:0/919205613 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4168011880 con 0x7f416c0acb10 2020-04-22T14:16:02.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.725+0000 7f4170956700 1 -- 172.21.15.103:0/919205613 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4168011ca0 con 0x7f416c0acb10 2020-04-22T14:16:02.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.725+0000 7f4173bbc700 1 -- 172.21.15.103:0/919205613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f416c0acb10 msgr2=0x7f416c0ae920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:02.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.725+0000 7f4173bbc700 1 --2- 172.21.15.103:0/919205613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f416c0acb10 0x7f416c0ae920 secure :-1 s=READY pgs=1596 cs=0 l=1 rx=0x7f4168002f30 tx=0x7f4168007a40).stop 2020-04-22T14:16:02.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.726+0000 7f4173bbc700 1 -- 172.21.15.103:0/919205613 shutdown_connections 2020-04-22T14:16:02.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.726+0000 7f4173bbc700 1 --2- 172.21.15.103:0/919205613 >> v2:172.21.15.86:3300/0 conn(0x7f416c0aed80 0x7f416c0b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:02.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.726+0000 7f4173bbc700 1 --2- 172.21.15.103:0/919205613 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f416c061a30 0x7f416c0b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:02.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.726+0000 7f4173bbc700 1 --2- 172.21.15.103:0/919205613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f416c0acb10 0x7f416c0ae920 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:02.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.726+0000 7f4173bbc700 1 -- 172.21.15.103:0/919205613 >> 172.21.15.103:0/919205613 conn(0x7f416c05b7b0 msgr2=0x7f416c0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:02.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.726+0000 7f4173bbc700 1 -- 172.21.15.103:0/919205613 shutdown_connections 2020-04-22T14:16:02.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.726+0000 7f4173bbc700 1 -- 172.21.15.103:0/919205613 wait complete. 2020-04-22T14:16:02.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.727+0000 7f4173bbc700 1 Processor -- start 2020-04-22T14:16:02.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.727+0000 7f4173bbc700 1 -- start start 2020-04-22T14:16:02.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.727+0000 7f4173bbc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f416c061a30 0x7f416c136400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:02.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.727+0000 7f4173bbc700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f416c0aed80 0x7f416c1444e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:02.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.727+0000 7f4173bbc700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f416c144940 con 0x7f416c0acb10 2020-04-22T14:16:02.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.727+0000 7f4173bbc700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f416c139d90 con 0x7f416c0aed80 2020-04-22T14:16:02.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.727+0000 7f4173bbc700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f416c13a1f0 con 0x7f416c061a30 2020-04-22T14:16:02.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.727+0000 7f4171958700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f416c061a30 0x7f416c136400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:02.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.727+0000 7f4171958700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f416c061a30 0x7f416c136400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55774/0 (socket says 172.21.15.103:55774) 2020-04-22T14:16:02.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.727+0000 7f4171958700 1 -- 172.21.15.103:0/2276893132 learned_addr learned my addr 172.21.15.103:0/2276893132 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:02.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.728+0000 7f4172159700 1 --2- 172.21.15.103:0/2276893132 >> v2:172.21.15.86:3300/0 conn(0x7f416c0aed80 0x7f416c1444e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:02.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.728+0000 7f4171958700 1 -- 172.21.15.103:0/2276893132 >> v2:172.21.15.86:3300/0 conn(0x7f416c0aed80 msgr2=0x7f416c1444e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:02.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.728+0000 7f4171958700 1 --2- 172.21.15.103:0/2276893132 >> v2:172.21.15.86:3300/0 conn(0x7f416c0aed80 0x7f416c1444e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:02.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.728+0000 7f4171958700 1 -- 172.21.15.103:0/2276893132 >> v1:172.21.15.86:6789/0 conn(0x7f416c0acb10 legacy=0x7f416c136ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:02.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.728+0000 7f4171958700 1 -- 172.21.15.103:0/2276893132 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f416c138180 con 0x7f416c061a30 2020-04-22T14:16:02.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.728+0000 7f4172159700 1 --2- 172.21.15.103:0/2276893132 >> v2:172.21.15.86:3300/0 conn(0x7f416c0aed80 0x7f416c1444e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:16:02.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.728+0000 7f4171958700 1 --2- 172.21.15.103:0/2276893132 >> v2:172.21.15.103:3300/0 conn(0x7f416c061a30 0x7f416c136400 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f415c002f30 tx=0x7f415c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.728+0000 7f4171958700 1 --2- 172.21.15.103:0/2276893132 >> v2:172.21.15.103:3300/0 conn(0x7f416c061a30 0x7f416c136400 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f415c002f30 tx=0x7f415c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.728+0000 7f4171958700 1 --2- 172.21.15.103:0/2276893132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f416c061a30 0x7f416c136400 secure :-1 s=READY pgs=1597 cs=0 l=1 rx=0x7f415c002f30 tx=0x7f415c010af0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:02.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.728+0000 7f4171958700 1 --2- 172.21.15.103:0/2276893132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f416c061a30 0x7f416c136400 secure :-1 s=THROTTLE_DONE pgs=1597 cs=0 l=1 rx=0x7f415c002f30 tx=0x7f415c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.728+0000 7f415affd700 1 -- 172.21.15.103:0/2276893132 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f415c012380 con 0x7f416c061a30 2020-04-22T14:16:02.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.728+0000 7f4171958700 1 --2- 172.21.15.103:0/2276893132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f416c061a30 0x7f416c136400 secure :-1 s=THROTTLE_DONE pgs=1597 cs=0 l=1 rx=0x7f415c002f30 tx=0x7f415c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.728+0000 7f4171958700 1 --2- 172.21.15.103:0/2276893132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f416c061a30 0x7f416c136400 secure :-1 s=THROTTLE_DONE pgs=1597 cs=0 l=1 rx=0x7f415c002f30 tx=0x7f415c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.728+0000 7f415affd700 1 -- 172.21.15.103:0/2276893132 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f415c0124e0 con 0x7f416c061a30 2020-04-22T14:16:02.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.728+0000 7f4173bbc700 1 -- 172.21.15.103:0/2276893132 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f416c142d00 con 0x7f416c061a30 2020-04-22T14:16:02.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.728+0000 7f415affd700 1 -- 172.21.15.103:0/2276893132 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f415c012900 con 0x7f416c061a30 2020-04-22T14:16:02.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.728+0000 7f4173bbc700 1 -- 172.21.15.103:0/2276893132 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f416c136af0 con 0x7f416c061a30 2020-04-22T14:16:02.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.729+0000 7f4171958700 1 --2- 172.21.15.103:0/2276893132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f416c061a30 0x7f416c136400 secure :-1 s=THROTTLE_DONE pgs=1597 cs=0 l=1 rx=0x7f415c002f30 tx=0x7f415c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.729+0000 7f415affd700 1 -- 172.21.15.103:0/2276893132 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f415c012b70 con 0x7f416c061a30 2020-04-22T14:16:02.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.729+0000 7f4171958700 1 --2- 172.21.15.103:0/2276893132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f416c061a30 0x7f416c136400 secure :-1 s=THROTTLE_DONE pgs=1597 cs=0 l=1 rx=0x7f415c002f30 tx=0x7f415c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.729+0000 7f4173bbc700 1 -- 172.21.15.103:0/2276893132 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f416c139f30 con 0x7f416c061a30 2020-04-22T14:16:02.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.729+0000 7f415affd700 1 --2- 172.21.15.103:0/2276893132 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f414c04d9c0 0x7f414c04fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:02.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.729+0000 7f415affd700 1 -- 172.21.15.103:0/2276893132 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f415c013070 con 0x7f416c061a30 2020-04-22T14:16:02.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.729+0000 7f4171157700 1 --2- 172.21.15.103:0/2276893132 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f414c04d9c0 0x7f414c04fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:02.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.730+0000 7f4171157700 1 --2- 172.21.15.103:0/2276893132 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f414c04d9c0 0x7f414c04fe80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f416c139af0 tx=0x7f4168007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.730+0000 7f4171157700 1 --2- 172.21.15.103:0/2276893132 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f414c04d9c0 0x7f414c04fe80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f416c139af0 tx=0x7f4168007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.730+0000 7f4171157700 1 --2- 172.21.15.103:0/2276893132 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f414c04d9c0 0x7f414c04fe80 secure :-1 s=READY pgs=579 cs=0 l=1 rx=0x7f416c139af0 tx=0x7f4168007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:02.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.733+0000 7f4171958700 1 --2- 172.21.15.103:0/2276893132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f416c061a30 0x7f416c136400 secure :-1 s=THROTTLE_DONE pgs=1597 cs=0 l=1 rx=0x7f415c002f30 tx=0x7f415c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:02.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.733+0000 7f415affd700 1 -- 172.21.15.103:0/2276893132 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f416c139f30 con 0x7f416c061a30 2020-04-22T14:16:02.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:02.876+0000 7f4173bbc700 1 -- 172.21.15.103:0/2276893132 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f416c139ed0 con 0x7f416c061a30 2020-04-22T14:16:03.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.545+0000 7f4171958700 1 --2- 172.21.15.103:0/2276893132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f416c061a30 0x7f416c136400 secure :-1 s=THROTTLE_DONE pgs=1597 cs=0 l=1 rx=0x7f415c002f30 tx=0x7f415c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:03.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.546+0000 7f415affd700 1 -- 172.21.15.103:0/2276893132 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v109) v1 ==== 133+0+0 (secure 0 0 0) 0x7f415c03cbc0 con 0x7f416c061a30 2020-04-22T14:16:03.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.547+0000 7f4173bbc700 1 -- 172.21.15.103:0/2276893132 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f414c04d9c0 msgr2=0x7f414c04fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:03.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.547+0000 7f4173bbc700 1 --2- 172.21.15.103:0/2276893132 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f414c04d9c0 0x7f414c04fe80 secure :-1 s=READY pgs=579 cs=0 l=1 rx=0x7f416c139af0 tx=0x7f4168007a40).stop 2020-04-22T14:16:03.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.547+0000 7f4173bbc700 1 -- 172.21.15.103:0/2276893132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f416c061a30 msgr2=0x7f416c136400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:03.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.547+0000 7f4173bbc700 1 --2- 172.21.15.103:0/2276893132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f416c061a30 0x7f416c136400 secure :-1 s=READY pgs=1597 cs=0 l=1 rx=0x7f415c002f30 tx=0x7f415c010af0).stop 2020-04-22T14:16:03.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.547+0000 7f4173bbc700 1 -- 172.21.15.103:0/2276893132 shutdown_connections 2020-04-22T14:16:03.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.547+0000 7f4173bbc700 1 --2- 172.21.15.103:0/2276893132 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f414c04d9c0 0x7f414c04fe80 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:03.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.547+0000 7f4173bbc700 1 --2- 172.21.15.103:0/2276893132 >> v2:172.21.15.86:3300/0 conn(0x7f416c0aed80 0x7f416c1444e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:03.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.547+0000 7f4173bbc700 1 --2- 172.21.15.103:0/2276893132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f416c061a30 0x7f416c136400 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:03.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.547+0000 7f4173bbc700 1 -- 172.21.15.103:0/2276893132 >> 172.21.15.103:0/2276893132 conn(0x7f416c05b7b0 msgr2=0x7f416c145290 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:03.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.547+0000 7f4173bbc700 1 -- 172.21.15.103:0/2276893132 shutdown_connections 2020-04-22T14:16:03.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.547+0000 7f4173bbc700 1 -- 172.21.15.103:0/2276893132 wait complete. 2020-04-22T14:16:03.551 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' created 2020-04-22T14:16:03.561 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:03.576 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-04-22T14:16:03.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.723+0000 7f59e0a37700 1 Processor -- start 2020-04-22T14:16:03.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.723+0000 7f59e0a37700 1 -- start start 2020-04-22T14:16:03.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.724+0000 7f59e0a37700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59dc0b8e00 0x7f59dc0af010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:03.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.724+0000 7f59e0a37700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f59dc0b91e0 0x7f59dc142f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:03.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.724+0000 7f59e0a37700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f59dc05fed0 0x7f59dc0b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:03.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.724+0000 7f59e0a37700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59dc0b29b0 con 0x7f59dc05fed0 2020-04-22T14:16:03.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.724+0000 7f59e0a37700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59dc0b4270 con 0x7f59dc0b91e0 2020-04-22T14:16:03.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.724+0000 7f59e0a37700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc0b4510 con 0x7f59dc0b8e00 2020-04-22T14:16:03.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.724+0000 7f59daffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f59dc0b91e0 0x7f59dc142f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:03.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.724+0000 7f59daffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f59dc0b91e0 0x7f59dc142f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55784/0 (socket says 172.21.15.103:55784) 2020-04-22T14:16:03.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.724+0000 7f59daffd700 1 -- 172.21.15.103:0/3013519554 learned_addr learned my addr 172.21.15.103:0/3013519554 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:03.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.724+0000 7f59db7fe700 1 --2- 172.21.15.103:0/3013519554 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59dc0b8e00 0x7f59dc0af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:03.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.724+0000 7f59dbfff700 1 --2- 172.21.15.103:0/3013519554 >> v2:172.21.15.86:3300/0 conn(0x7f59dc05fed0 0x7f59dc0b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:03.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.724+0000 7f59daffd700 1 -- 172.21.15.103:0/3013519554 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59dc0b8e00 msgr2=0x7f59dc0af010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:03.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.724+0000 7f59daffd700 1 --2- 172.21.15.103:0/3013519554 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59dc0b8e00 0x7f59dc0af010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:03.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.725+0000 7f59daffd700 1 -- 172.21.15.103:0/3013519554 >> v2:172.21.15.86:3300/0 conn(0x7f59dc05fed0 msgr2=0x7f59dc0b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:03.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.725+0000 7f59daffd700 1 --2- 172.21.15.103:0/3013519554 >> v2:172.21.15.86:3300/0 conn(0x7f59dc05fed0 0x7f59dc0b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:03.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.725+0000 7f59daffd700 1 -- 172.21.15.103:0/3013519554 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59dc1433c0 con 0x7f59dc0b91e0 2020-04-22T14:16:03.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.725+0000 7f59dbfff700 1 --2- 172.21.15.103:0/3013519554 >> v2:172.21.15.86:3300/0 conn(0x7f59dc05fed0 0x7f59dc0b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:16:03.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.725+0000 7f59daffd700 1 --2- 172.21.15.103:0/3013519554 >> v2:172.21.15.103:3300/0 conn(0x7f59dc0b91e0 0x7f59dc142f60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f59d0002f30 tx=0x7f59d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:03.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.725+0000 7f59daffd700 1 --2- 172.21.15.103:0/3013519554 >> v2:172.21.15.103:3300/0 conn(0x7f59dc0b91e0 0x7f59dc142f60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f59d0002f30 tx=0x7f59d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:03.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.725+0000 7f59daffd700 1 --2- 172.21.15.103:0/3013519554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59dc0b91e0 0x7f59dc142f60 secure :-1 s=READY pgs=1598 cs=0 l=1 rx=0x7f59d0002f30 tx=0x7f59d0007a40).ready entity=mon.1 client_cookie=faa22ad16ecdeba server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:03.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.725+0000 7f59daffd700 1 --2- 172.21.15.103:0/3013519554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59dc0b91e0 0x7f59dc142f60 secure :-1 s=THROTTLE_DONE pgs=1598 cs=0 l=1 rx=0x7f59d0002f30 tx=0x7f59d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:03.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.725+0000 7f59da7fc700 1 -- 172.21.15.103:0/3013519554 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59d0011720 con 0x7f59dc0b91e0 2020-04-22T14:16:03.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.725+0000 7f59daffd700 1 --2- 172.21.15.103:0/3013519554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59dc0b91e0 0x7f59dc142f60 secure :-1 s=THROTTLE_DONE pgs=1598 cs=0 l=1 rx=0x7f59d0002f30 tx=0x7f59d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:03.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.725+0000 7f59daffd700 1 --2- 172.21.15.103:0/3013519554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59dc0b91e0 0x7f59dc142f60 secure :-1 s=THROTTLE_DONE pgs=1598 cs=0 l=1 rx=0x7f59d0002f30 tx=0x7f59d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:03.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.725+0000 7f59da7fc700 1 -- 172.21.15.103:0/3013519554 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d0011880 con 0x7f59dc0b91e0 2020-04-22T14:16:03.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.725+0000 7f59da7fc700 1 -- 172.21.15.103:0/3013519554 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59d0011ca0 con 0x7f59dc0b91e0 2020-04-22T14:16:03.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.725+0000 7f59e0a37700 1 -- 172.21.15.103:0/3013519554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59dc0b91e0 msgr2=0x7f59dc142f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:03.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.725+0000 7f59e0a37700 1 --2- 172.21.15.103:0/3013519554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59dc0b91e0 0x7f59dc142f60 secure :-1 s=READY pgs=1598 cs=0 l=1 rx=0x7f59d0002f30 tx=0x7f59d0007a40).stop 2020-04-22T14:16:03.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.725+0000 7f59e0a37700 1 -- 172.21.15.103:0/3013519554 shutdown_connections 2020-04-22T14:16:03.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.725+0000 7f59e0a37700 1 --2- 172.21.15.103:0/3013519554 >> v2:172.21.15.86:3300/0 conn(0x7f59dc05fed0 0x7f59dc0b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:03.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.725+0000 7f59e0a37700 1 --2- 172.21.15.103:0/3013519554 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59dc0b8e00 0x7f59dc0af010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:03.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.725+0000 7f59e0a37700 1 --2- 172.21.15.103:0/3013519554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59dc0b91e0 0x7f59dc142f60 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:03.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.725+0000 7f59e0a37700 1 -- 172.21.15.103:0/3013519554 >> 172.21.15.103:0/3013519554 conn(0x7f59dc05b780 msgr2=0x7f59dc0b8530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:03.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.725+0000 7f59e0a37700 1 -- 172.21.15.103:0/3013519554 shutdown_connections 2020-04-22T14:16:03.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.725+0000 7f59e0a37700 1 -- 172.21.15.103:0/3013519554 wait complete. 2020-04-22T14:16:03.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.726+0000 7f59e0a37700 1 Processor -- start 2020-04-22T14:16:03.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.726+0000 7f59e0a37700 1 -- start start 2020-04-22T14:16:03.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.727+0000 7f59e0a37700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59dc05fed0 0x7f59dc0b0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:03.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.727+0000 7f59e0a37700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f59dc0b8e00 0x7f59dc0650a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:03.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.727+0000 7f59e0a37700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59dc0b0bc0 con 0x7f59dc0b91e0 2020-04-22T14:16:03.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.727+0000 7f59e0a37700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59dc0b0e60 con 0x7f59dc0b8e00 2020-04-22T14:16:03.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.727+0000 7f59e0a37700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc0b1100 con 0x7f59dc05fed0 2020-04-22T14:16:03.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.727+0000 7f59dbfff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f59dc0b91e0 0x7f59dc1336b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:47982/0 (socket says 172.21.15.103:47982) 2020-04-22T14:16:03.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.727+0000 7f59dbfff700 1 -- 172.21.15.103:0/2640426253 learned_addr learned my addr 172.21.15.103:0/2640426253 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:03.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.727+0000 7f59d8ff9700 1 -- 172.21.15.103:0/2640426253 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1831599391 0 0) 0x7f59dc0b0bc0 con 0x7f59dc0b91e0 2020-04-22T14:16:03.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.727+0000 7f59d8ff9700 1 -- 172.21.15.103:0/2640426253 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59bc002fe0 con 0x7f59dc0b91e0 2020-04-22T14:16:03.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.727+0000 7f59db7fe700 1 --2- 172.21.15.103:0/2640426253 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59dc05fed0 0x7f59dc0b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:03.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.727+0000 7f59daffd700 1 --2- 172.21.15.103:0/2640426253 >> v2:172.21.15.86:3300/0 conn(0x7f59dc0b8e00 0x7f59dc0650a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:03.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.728+0000 7f59d8ff9700 1 -- 172.21.15.103:0/2640426253 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 994849430 0 0) 0x7f59bc002fe0 con 0x7f59dc0b91e0 2020-04-22T14:16:03.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.728+0000 7f59d8ff9700 1 -- 172.21.15.103:0/2640426253 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f59dc0b0bc0 con 0x7f59dc0b91e0 2020-04-22T14:16:03.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.728+0000 7f59d8ff9700 1 -- 172.21.15.103:0/2640426253 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f59d4002900 con 0x7f59dc0b91e0 2020-04-22T14:16:03.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.728+0000 7f59d8ff9700 1 -- 172.21.15.103:0/2640426253 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59dc05fed0 msgr2=0x7f59dc0b0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:03.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.728+0000 7f59d8ff9700 1 --2- 172.21.15.103:0/2640426253 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59dc05fed0 0x7f59dc0b0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:03.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.728+0000 7f59d8ff9700 1 -- 172.21.15.103:0/2640426253 >> v2:172.21.15.86:3300/0 conn(0x7f59dc0b8e00 msgr2=0x7f59dc0650a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:03.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.728+0000 7f59d8ff9700 1 --2- 172.21.15.103:0/2640426253 >> v2:172.21.15.86:3300/0 conn(0x7f59dc0b8e00 0x7f59dc0650a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:03.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.728+0000 7f59d8ff9700 1 -- 172.21.15.103:0/2640426253 >> v1:172.21.15.103:6789/0 conn(0x7f59dc0b91e0 legacy=0x7f59dc1336b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:03.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.728+0000 7f59d8ff9700 1 --2- 172.21.15.103:0/2640426253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59bc0049b0 0x7f59bc004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:03.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.728+0000 7f59d8ff9700 1 --2- 172.21.15.103:0/2640426253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59bc003920 0x7f59bc003d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:03.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.728+0000 7f59d8ff9700 1 --2- 172.21.15.103:0/2640426253 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59dc05fed0 0x7f59bc0041c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:03.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.728+0000 7f59d8ff9700 1 -- 172.21.15.103:0/2640426253 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc0b0e60 con 0x7f59bc003920 2020-04-22T14:16:03.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.728+0000 7f59d8ff9700 1 -- 172.21.15.103:0/2640426253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc0b1100 con 0x7f59bc0049b0 2020-04-22T14:16:03.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.728+0000 7f59d8ff9700 1 -- 172.21.15.103:0/2640426253 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc004620 con 0x7f59dc05fed0 2020-04-22T14:16:03.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.728+0000 7f59db7fe700 1 --2- 172.21.15.103:0/2640426253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59bc0049b0 0x7f59bc004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:03.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.728+0000 7f59daffd700 1 --2- 172.21.15.103:0/2640426253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59bc003920 0x7f59bc003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:03.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.728+0000 7f59dbfff700 1 --2- 172.21.15.103:0/2640426253 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59dc05fed0 0x7f59bc0041c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:03.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.728+0000 7f59db7fe700 1 -- 172.21.15.103:0/2640426253 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59dc05fed0 msgr2=0x7f59bc0041c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:03.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.728+0000 7f59db7fe700 1 --2- 172.21.15.103:0/2640426253 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59dc05fed0 0x7f59bc0041c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:03.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.728+0000 7f59db7fe700 1 -- 172.21.15.103:0/2640426253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59bc003920 msgr2=0x7f59bc003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:03.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.728+0000 7f59db7fe700 1 --2- 172.21.15.103:0/2640426253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59bc003920 0x7f59bc003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:03.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.728+0000 7f59db7fe700 1 -- 172.21.15.103:0/2640426253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59dc066ec0 con 0x7f59bc0049b0 2020-04-22T14:16:03.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.728+0000 7f59e0a37700 1 -- 172.21.15.103:0/2640426253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59dc0b0640 con 0x7f59bc0049b0 2020-04-22T14:16:03.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.728+0000 7f59db7fe700 1 --2- 172.21.15.103:0/2640426253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59bc0049b0 0x7f59bc004dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f59cc002f30 tx=0x7f59cc010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:03.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.728+0000 7f59daffd700 1 --2- 172.21.15.103:0/2640426253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59bc003920 0x7f59bc003d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:16:03.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.728+0000 7f59e0a37700 1 -- 172.21.15.103:0/2640426253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59dc133f80 con 0x7f59bc0049b0 2020-04-22T14:16:03.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.728+0000 7f59db7fe700 1 --2- 172.21.15.103:0/2640426253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59bc0049b0 0x7f59bc004dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f59cc002f30 tx=0x7f59cc010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:03.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.728+0000 7f59db7fe700 1 --2- 172.21.15.103:0/2640426253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59bc0049b0 0x7f59bc004dd0 secure :-1 s=READY pgs=1600 cs=0 l=1 rx=0x7f59cc002f30 tx=0x7f59cc010eb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:03.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.728+0000 7f59db7fe700 1 --2- 172.21.15.103:0/2640426253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59bc0049b0 0x7f59bc004dd0 secure :-1 s=THROTTLE_DONE pgs=1600 cs=0 l=1 rx=0x7f59cc002f30 tx=0x7f59cc010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:03.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.728+0000 7f59db7fe700 1 --2- 172.21.15.103:0/2640426253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59bc0049b0 0x7f59bc004dd0 secure :-1 s=THROTTLE_DONE pgs=1600 cs=0 l=1 rx=0x7f59cc002f30 tx=0x7f59cc010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:03.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.728+0000 7f59db7fe700 1 --2- 172.21.15.103:0/2640426253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59bc0049b0 0x7f59bc004dd0 secure :-1 s=THROTTLE_DONE pgs=1600 cs=0 l=1 rx=0x7f59cc002f30 tx=0x7f59cc010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:03.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.728+0000 7f59d8ff9700 1 -- 172.21.15.103:0/2640426253 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59cc007550 con 0x7f59bc0049b0 2020-04-22T14:16:03.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.728+0000 7f59d8ff9700 1 -- 172.21.15.103:0/2640426253 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59cc0117e0 con 0x7f59bc0049b0 2020-04-22T14:16:03.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.728+0000 7f59d8ff9700 1 -- 172.21.15.103:0/2640426253 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59cc011bc0 con 0x7f59bc0049b0 2020-04-22T14:16:03.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.729+0000 7f59db7fe700 1 --2- 172.21.15.103:0/2640426253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59bc0049b0 0x7f59bc004dd0 secure :-1 s=THROTTLE_DONE pgs=1600 cs=0 l=1 rx=0x7f59cc002f30 tx=0x7f59cc010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:03.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.729+0000 7f59e0a37700 1 -- 172.21.15.103:0/2640426253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59b8003340 con 0x7f59bc0049b0 2020-04-22T14:16:03.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.729+0000 7f59d8ff9700 1 -- 172.21.15.103:0/2640426253 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f59cc011d20 con 0x7f59bc0049b0 2020-04-22T14:16:03.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.729+0000 7f59db7fe700 1 --2- 172.21.15.103:0/2640426253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59bc0049b0 0x7f59bc004dd0 secure :-1 s=THROTTLE_DONE pgs=1600 cs=0 l=1 rx=0x7f59cc002f30 tx=0x7f59cc010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:03.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.729+0000 7f59d8ff9700 1 --2- 172.21.15.103:0/2640426253 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f59bc057d80 0x7f59bc05a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:03.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.730+0000 7f59d8ff9700 1 -- 172.21.15.103:0/2640426253 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f59cc061490 con 0x7f59bc0049b0 2020-04-22T14:16:03.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.730+0000 7f59daffd700 1 --2- 172.21.15.103:0/2640426253 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f59bc057d80 0x7f59bc05a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:03.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.730+0000 7f59daffd700 1 --2- 172.21.15.103:0/2640426253 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f59bc057d80 0x7f59bc05a240 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f59d0002f30 tx=0x7f59d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:03.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.730+0000 7f59daffd700 1 --2- 172.21.15.103:0/2640426253 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f59bc057d80 0x7f59bc05a240 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f59d0002f30 tx=0x7f59d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:03.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.730+0000 7f59daffd700 1 --2- 172.21.15.103:0/2640426253 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f59bc057d80 0x7f59bc05a240 secure :-1 s=READY pgs=580 cs=0 l=1 rx=0x7f59d0002f30 tx=0x7f59d0007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:03.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.733+0000 7f59db7fe700 1 --2- 172.21.15.103:0/2640426253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59bc0049b0 0x7f59bc004dd0 secure :-1 s=THROTTLE_DONE pgs=1600 cs=0 l=1 rx=0x7f59cc002f30 tx=0x7f59cc010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:03.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.733+0000 7f59d8ff9700 1 -- 172.21.15.103:0/2640426253 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f59cc03c930 con 0x7f59bc0049b0 2020-04-22T14:16:03.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:03.879+0000 7f59e0a37700 1 -- 172.21.15.103:0/2640426253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f59b8002200 con 0x7f59bc0049b0 2020-04-22T14:16:04.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.728+0000 7f59db7fe700 1 --2- 172.21.15.103:0/2640426253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59bc0049b0 0x7f59bc004dd0 secure :-1 s=READY pgs=1600 cs=0 l=1 rx=0x7f59cc002f30 tx=0x7f59cc010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:04.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.765+0000 7f59db7fe700 1 --2- 172.21.15.103:0/2640426253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59bc0049b0 0x7f59bc004dd0 secure :-1 s=THROTTLE_DONE pgs=1600 cs=0 l=1 rx=0x7f59cc002f30 tx=0x7f59cc010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:04.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.765+0000 7f59d8ff9700 1 -- 172.21.15.103:0/2640426253 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v111) v1 ==== 125+0+0 (secure 0 0 0) 0x7f59cc03ff50 con 0x7f59bc0049b0 2020-04-22T14:16:04.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.769+0000 7f59e0a37700 1 -- 172.21.15.103:0/2640426253 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f59bc057d80 msgr2=0x7f59bc05a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:04.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.769+0000 7f59e0a37700 1 --2- 172.21.15.103:0/2640426253 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f59bc057d80 0x7f59bc05a240 secure :-1 s=READY pgs=580 cs=0 l=1 rx=0x7f59d0002f30 tx=0x7f59d0007a40).stop 2020-04-22T14:16:04.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.769+0000 7f59e0a37700 1 -- 172.21.15.103:0/2640426253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59bc0049b0 msgr2=0x7f59bc004dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:04.771 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.769+0000 7f59e0a37700 1 --2- 172.21.15.103:0/2640426253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59bc0049b0 0x7f59bc004dd0 secure :-1 s=READY pgs=1600 cs=0 l=1 rx=0x7f59cc002f30 tx=0x7f59cc010eb0).stop 2020-04-22T14:16:04.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.769+0000 7f59dbfff700 1 -- 172.21.15.103:0/2640426253 reap_dead start 2020-04-22T14:16:04.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.769+0000 7f59dbfff700 1 -- 172.21.15.103:0/2640426253 reap_dead start 2020-04-22T14:16:04.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.769+0000 7f59e0a37700 1 -- 172.21.15.103:0/2640426253 shutdown_connections 2020-04-22T14:16:04.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.769+0000 7f59e0a37700 1 -- 172.21.15.103:0/2640426253 >> 172.21.15.103:0/2640426253 conn(0x7f59dc05b780 msgr2=0x7f59dc0b4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:04.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.769+0000 7f59e0a37700 1 -- 172.21.15.103:0/2640426253 shutdown_connections 2020-04-22T14:16:04.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.770+0000 7f59e0a37700 1 -- 172.21.15.103:0/2640426253 wait complete. 2020-04-22T14:16:04.774 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' created 2020-04-22T14:16:04.785 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:04.800 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-04-22T14:16:04.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.949+0000 7f5212345700 1 Processor -- start 2020-04-22T14:16:04.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.949+0000 7f5212345700 1 -- start start 2020-04-22T14:16:04.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.950+0000 7f5212345700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f520c0b9140 0x7f520c0b4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:04.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.950+0000 7f5212345700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f520c0af390 0x7f520c061f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:04.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.950+0000 7f5212345700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f520c0b49d0 con 0x7f520c14ddb0 2020-04-22T14:16:04.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.950+0000 7f5212345700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f520c061830 con 0x7f520c0af390 2020-04-22T14:16:04.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.950+0000 7f5212345700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f520c061ad0 con 0x7f520c0b9140 2020-04-22T14:16:04.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.950+0000 7f520bfff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f520c0b9140 0x7f520c0b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:04.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.950+0000 7f520bfff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f520c0b9140 0x7f520c0b4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55802/0 (socket says 172.21.15.103:55802) 2020-04-22T14:16:04.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.950+0000 7f520bfff700 1 -- 172.21.15.103:0/1620869481 learned_addr learned my addr 172.21.15.103:0/1620869481 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:04.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.951+0000 7f520bfff700 1 -- 172.21.15.103:0/1620869481 >> v2:172.21.15.86:3300/0 conn(0x7f520c0af390 msgr2=0x7f520c061f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:04.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.951+0000 7f520b7fe700 1 --2- 172.21.15.103:0/1620869481 >> v2:172.21.15.86:3300/0 conn(0x7f520c0af390 0x7f520c061f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:04.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.951+0000 7f520bfff700 1 --2- 172.21.15.103:0/1620869481 >> v2:172.21.15.86:3300/0 conn(0x7f520c0af390 0x7f520c061f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:04.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.951+0000 7f520bfff700 1 -- 172.21.15.103:0/1620869481 >> v1:172.21.15.86:6789/0 conn(0x7f520c14ddb0 legacy=0x7f520c14e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:04.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.951+0000 7f520bfff700 1 -- 172.21.15.103:0/1620869481 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520c0b9520 con 0x7f520c0b9140 2020-04-22T14:16:04.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.951+0000 7f520b7fe700 1 --2- 172.21.15.103:0/1620869481 >> v2:172.21.15.86:3300/0 conn(0x7f520c0af390 0x7f520c061f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:16:04.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.951+0000 7f520bfff700 1 --2- 172.21.15.103:0/1620869481 >> v2:172.21.15.103:3300/0 conn(0x7f520c0b9140 0x7f520c0b4570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f520c0b6250 tx=0x7f51fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:04.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.951+0000 7f520bfff700 1 --2- 172.21.15.103:0/1620869481 >> v2:172.21.15.103:3300/0 conn(0x7f520c0b9140 0x7f520c0b4570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f520c0b6250 tx=0x7f51fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:04.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.951+0000 7f520bfff700 1 --2- 172.21.15.103:0/1620869481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f520c0b9140 0x7f520c0b4570 secure :-1 s=READY pgs=1601 cs=0 l=1 rx=0x7f520c0b6250 tx=0x7f51fc007a40).ready entity=mon.1 client_cookie=caea7d1ea5d226f2 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:04.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.951+0000 7f520bfff700 1 --2- 172.21.15.103:0/1620869481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f520c0b9140 0x7f520c0b4570 secure :-1 s=THROTTLE_DONE pgs=1601 cs=0 l=1 rx=0x7f520c0b6250 tx=0x7f51fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:04.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.951+0000 7f520affd700 1 -- 172.21.15.103:0/1620869481 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51fc0116e0 con 0x7f520c0b9140 2020-04-22T14:16:04.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.951+0000 7f520bfff700 1 --2- 172.21.15.103:0/1620869481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f520c0b9140 0x7f520c0b4570 secure :-1 s=THROTTLE_DONE pgs=1601 cs=0 l=1 rx=0x7f520c0b6250 tx=0x7f51fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:04.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.951+0000 7f520affd700 1 -- 172.21.15.103:0/1620869481 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51fc011840 con 0x7f520c0b9140 2020-04-22T14:16:04.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.951+0000 7f520bfff700 1 --2- 172.21.15.103:0/1620869481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f520c0b9140 0x7f520c0b4570 secure :-1 s=THROTTLE_DONE pgs=1601 cs=0 l=1 rx=0x7f520c0b6250 tx=0x7f51fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:04.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.951+0000 7f520affd700 1 -- 172.21.15.103:0/1620869481 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51fc011c20 con 0x7f520c0b9140 2020-04-22T14:16:04.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.951+0000 7f5212345700 1 -- 172.21.15.103:0/1620869481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f520c0b9140 msgr2=0x7f520c0b4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:04.961 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.951+0000 7f5212345700 1 --2- 172.21.15.103:0/1620869481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f520c0b9140 0x7f520c0b4570 secure :-1 s=READY pgs=1601 cs=0 l=1 rx=0x7f520c0b6250 tx=0x7f51fc007a40).stop 2020-04-22T14:16:04.961 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.951+0000 7f5212345700 1 -- 172.21.15.103:0/1620869481 shutdown_connections 2020-04-22T14:16:04.961 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.951+0000 7f5212345700 1 --2- 172.21.15.103:0/1620869481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f520c0b9140 0x7f520c0b4570 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:04.961 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.951+0000 7f5212345700 1 --2- 172.21.15.103:0/1620869481 >> v2:172.21.15.86:3300/0 conn(0x7f520c0af390 0x7f520c061f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:04.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.951+0000 7f5212345700 1 -- 172.21.15.103:0/1620869481 >> 172.21.15.103:0/1620869481 conn(0x7f520c05b7b0 msgr2=0x7f520c0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:04.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.951+0000 7f5212345700 1 -- 172.21.15.103:0/1620869481 shutdown_connections 2020-04-22T14:16:04.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.951+0000 7f5212345700 1 -- 172.21.15.103:0/1620869481 wait complete. 2020-04-22T14:16:04.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.952+0000 7f5212345700 1 Processor -- start 2020-04-22T14:16:04.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.952+0000 7f5212345700 1 -- start start 2020-04-22T14:16:04.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.953+0000 7f5212345700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f520c0b9140 0x7f520c0b2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:04.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.953+0000 7f5212345700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f520c0b0720 con 0x7f520c0af390 2020-04-22T14:16:04.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.953+0000 7f5212345700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f520c0b01e0 con 0x7f520c14ddb0 2020-04-22T14:16:04.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.953+0000 7f5212345700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f520c0affe0 con 0x7f520c0b9140 2020-04-22T14:16:04.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.953+0000 7f52108e2700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f520c14ddb0 0x7f520c147d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48002/0 (socket says 172.21.15.103:48002) 2020-04-22T14:16:04.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.953+0000 7f52108e2700 1 -- 172.21.15.103:0/296060768 learned_addr learned my addr 172.21.15.103:0/296060768 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:04.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.953+0000 7f52097fa700 1 -- 172.21.15.103:0/296060768 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2977901292 0 0) 0x7f520c0b01e0 con 0x7f520c14ddb0 2020-04-22T14:16:04.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.953+0000 7f52097fa700 1 -- 172.21.15.103:0/296060768 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51ec002fe0 con 0x7f520c14ddb0 2020-04-22T14:16:04.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.953+0000 7f520b7fe700 1 --2- 172.21.15.103:0/296060768 >> v2:172.21.15.86:3300/0 conn(0x7f520c0b9140 0x7f520c0b2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:04.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.954+0000 7f52097fa700 1 -- 172.21.15.103:0/296060768 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1004252983 0 0) 0x7f51ec002fe0 con 0x7f520c14ddb0 2020-04-22T14:16:04.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.954+0000 7f52097fa700 1 -- 172.21.15.103:0/296060768 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f520c0b01e0 con 0x7f520c14ddb0 2020-04-22T14:16:04.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.954+0000 7f52097fa700 1 -- 172.21.15.103:0/296060768 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f5204002ca0 con 0x7f520c14ddb0 2020-04-22T14:16:04.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.954+0000 7f52097fa700 1 -- 172.21.15.103:0/296060768 >> v2:172.21.15.86:3300/0 conn(0x7f520c0b9140 msgr2=0x7f520c0b2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:04.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.954+0000 7f52097fa700 1 --2- 172.21.15.103:0/296060768 >> v2:172.21.15.86:3300/0 conn(0x7f520c0b9140 0x7f520c0b2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:04.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.954+0000 7f52097fa700 1 -- 172.21.15.103:0/296060768 >> v1:172.21.15.103:6789/0 conn(0x7f520c14ddb0 legacy=0x7f520c147d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:04.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.954+0000 7f52097fa700 1 -- 172.21.15.103:0/296060768 >> v1:172.21.15.86:6789/0 conn(0x7f520c0af390 legacy=0x7f520c0af8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:04.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.954+0000 7f52097fa700 1 --2- 172.21.15.103:0/296060768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51ec0049b0 0x7f51ec004db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:04.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.954+0000 7f52097fa700 1 --2- 172.21.15.103:0/296060768 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f51ec003920 0x7f51ec003d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:04.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.954+0000 7f52097fa700 1 --2- 172.21.15.103:0/296060768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51ec0041e0 0x7f51ec00b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:04.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.954+0000 7f52097fa700 1 -- 172.21.15.103:0/296060768 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c0affe0 con 0x7f51ec0049b0 2020-04-22T14:16:04.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.954+0000 7f52097fa700 1 -- 172.21.15.103:0/296060768 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec0047a0 con 0x7f51ec0041e0 2020-04-22T14:16:04.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.954+0000 7f52097fa700 1 -- 172.21.15.103:0/296060768 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec00bbe0 con 0x7f51ec003920 2020-04-22T14:16:04.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.954+0000 7f52108e2700 1 --2- 172.21.15.103:0/296060768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51ec0041e0 0x7f51ec00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:04.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.954+0000 7f520bfff700 1 --2- 172.21.15.103:0/296060768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51ec0049b0 0x7f51ec004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:04.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.954+0000 7f520b7fe700 1 --2- 172.21.15.103:0/296060768 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f51ec003920 0x7f51ec003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:04.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.954+0000 7f52108e2700 1 -- 172.21.15.103:0/296060768 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f51ec003920 msgr2=0x7f51ec003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:04.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.954+0000 7f52108e2700 1 --2- 172.21.15.103:0/296060768 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f51ec003920 0x7f51ec003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:04.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.954+0000 7f52108e2700 1 -- 172.21.15.103:0/296060768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51ec0049b0 msgr2=0x7f51ec004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:04.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.954+0000 7f52108e2700 1 --2- 172.21.15.103:0/296060768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51ec0049b0 0x7f51ec004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:04.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.954+0000 7f52108e2700 1 -- 172.21.15.103:0/296060768 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520c0b0480 con 0x7f51ec0041e0 2020-04-22T14:16:04.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.954+0000 7f5212345700 1 -- 172.21.15.103:0/296060768 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f520c148430 con 0x7f51ec0041e0 2020-04-22T14:16:04.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.954+0000 7f52108e2700 1 --2- 172.21.15.103:0/296060768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51ec0041e0 0x7f51ec00b750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f52040029b0 tx=0x7f5204011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:04.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.954+0000 7f5212345700 1 -- 172.21.15.103:0/296060768 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f520c0b1560 con 0x7f51ec0041e0 2020-04-22T14:16:04.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.954+0000 7f52108e2700 1 -- 172.21.15.103:0/296060768 reap_dead start 2020-04-22T14:16:04.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.954+0000 7f52108e2700 1 --2- 172.21.15.103:0/296060768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51ec0041e0 0x7f51ec00b750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f52040029b0 tx=0x7f5204011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:04.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.954+0000 7f52108e2700 1 --2- 172.21.15.103:0/296060768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51ec0041e0 0x7f51ec00b750 secure :-1 s=READY pgs=1603 cs=0 l=1 rx=0x7f52040029b0 tx=0x7f5204011780).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:04.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.954+0000 7f52108e2700 1 --2- 172.21.15.103:0/296060768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51ec0041e0 0x7f51ec00b750 secure :-1 s=THROTTLE_DONE pgs=1603 cs=0 l=1 rx=0x7f52040029b0 tx=0x7f5204011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:04.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.954+0000 7f52108e2700 1 --2- 172.21.15.103:0/296060768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51ec0041e0 0x7f51ec00b750 secure :-1 s=THROTTLE_DONE pgs=1603 cs=0 l=1 rx=0x7f52040029b0 tx=0x7f5204011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:04.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.954+0000 7f52097fa700 1 -- 172.21.15.103:0/296060768 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5204008660 con 0x7f51ec0041e0 2020-04-22T14:16:04.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.954+0000 7f52108e2700 1 --2- 172.21.15.103:0/296060768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51ec0041e0 0x7f51ec00b750 secure :-1 s=THROTTLE_DONE pgs=1603 cs=0 l=1 rx=0x7f52040029b0 tx=0x7f5204011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:04.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.954+0000 7f52097fa700 1 -- 172.21.15.103:0/296060768 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f520400ee90 con 0x7f51ec0041e0 2020-04-22T14:16:04.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.955+0000 7f52097fa700 1 -- 172.21.15.103:0/296060768 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5204005a40 con 0x7f51ec0041e0 2020-04-22T14:16:04.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.955+0000 7f52108e2700 1 --2- 172.21.15.103:0/296060768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51ec0041e0 0x7f51ec00b750 secure :-1 s=THROTTLE_DONE pgs=1603 cs=0 l=1 rx=0x7f52040029b0 tx=0x7f5204011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:04.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.955+0000 7f5212345700 1 -- 172.21.15.103:0/296060768 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51e8003340 con 0x7f51ec0041e0 2020-04-22T14:16:04.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.955+0000 7f52097fa700 1 -- 172.21.15.103:0/296060768 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f5204005ba0 con 0x7f51ec0041e0 2020-04-22T14:16:04.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.955+0000 7f52108e2700 1 --2- 172.21.15.103:0/296060768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51ec0041e0 0x7f51ec00b750 secure :-1 s=THROTTLE_DONE pgs=1603 cs=0 l=1 rx=0x7f52040029b0 tx=0x7f5204011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:04.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.956+0000 7f52097fa700 1 --2- 172.21.15.103:0/296060768 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f51ec051980 0x7f51ec053e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:04.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.956+0000 7f52097fa700 1 -- 172.21.15.103:0/296060768 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f5204061b20 con 0x7f51ec0041e0 2020-04-22T14:16:04.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.956+0000 7f520bfff700 1 --2- 172.21.15.103:0/296060768 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f51ec051980 0x7f51ec053e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:04.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.956+0000 7f520bfff700 1 --2- 172.21.15.103:0/296060768 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f51ec051980 0x7f51ec053e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f520c148c20 tx=0x7f51fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:04.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.956+0000 7f520bfff700 1 --2- 172.21.15.103:0/296060768 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f51ec051980 0x7f51ec053e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f520c148c20 tx=0x7f51fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:04.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.956+0000 7f520bfff700 1 --2- 172.21.15.103:0/296060768 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f51ec051980 0x7f51ec053e40 secure :-1 s=READY pgs=582 cs=0 l=1 rx=0x7f520c148c20 tx=0x7f51fc007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:04.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.960+0000 7f52108e2700 1 --2- 172.21.15.103:0/296060768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51ec0041e0 0x7f51ec00b750 secure :-1 s=THROTTLE_DONE pgs=1603 cs=0 l=1 rx=0x7f52040029b0 tx=0x7f5204011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:04.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:04.960+0000 7f52097fa700 1 -- 172.21.15.103:0/296060768 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f520403cf60 con 0x7f51ec0041e0 2020-04-22T14:16:05.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.148+0000 7f5212345700 1 -- 172.21.15.103:0/296060768 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f51e8002260 con 0x7f51ec0041e0 2020-04-22T14:16:05.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.155+0000 7f52108e2700 1 --2- 172.21.15.103:0/296060768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51ec0041e0 0x7f51ec00b750 secure :-1 s=THROTTLE_DONE pgs=1603 cs=0 l=1 rx=0x7f52040029b0 tx=0x7f5204011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:05.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.155+0000 7f52097fa700 1 -- 172.21.15.103:0/296060768 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 19 and data pool 20 v79) v1 ==== 189+0+0 (secure 0 0 0) 0x7f5204040580 con 0x7f51ec0041e0 2020-04-22T14:16:05.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.159+0000 7f5212345700 1 -- 172.21.15.103:0/296060768 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f51ec051980 msgr2=0x7f51ec053e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:05.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.159+0000 7f5212345700 1 --2- 172.21.15.103:0/296060768 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f51ec051980 0x7f51ec053e40 secure :-1 s=READY pgs=582 cs=0 l=1 rx=0x7f520c148c20 tx=0x7f51fc007a40).stop 2020-04-22T14:16:05.162 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.159+0000 7f5212345700 1 -- 172.21.15.103:0/296060768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51ec0041e0 msgr2=0x7f51ec00b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:05.162 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.159+0000 7f5212345700 1 --2- 172.21.15.103:0/296060768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51ec0041e0 0x7f51ec00b750 secure :-1 s=READY pgs=1603 cs=0 l=1 rx=0x7f52040029b0 tx=0x7f5204011780).stop 2020-04-22T14:16:05.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.161+0000 7f5212345700 1 -- 172.21.15.103:0/296060768 shutdown_connections 2020-04-22T14:16:05.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.162+0000 7f5212345700 1 --2- 172.21.15.103:0/296060768 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f51ec051980 0x7f51ec053e40 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:05.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.162+0000 7f5212345700 1 --2- 172.21.15.103:0/296060768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51ec0041e0 0x7f51ec00b750 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:05.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.162+0000 7f5212345700 1 -- 172.21.15.103:0/296060768 >> 172.21.15.103:0/296060768 conn(0x7f520c05b7b0 msgr2=0x7f520c0b5150 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:05.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.163+0000 7f5212345700 1 -- 172.21.15.103:0/296060768 shutdown_connections 2020-04-22T14:16:05.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.163+0000 7f5212345700 1 -- 172.21.15.103:0/296060768 wait complete. 2020-04-22T14:16:05.166 INFO:teuthology.orchestra.run.smithi103.stderr:new fs with metadata pool 19 and data pool 20 2020-04-22T14:16:05.179 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:05.194 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:16:05.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.338+0000 7fc7b305a700 1 Processor -- start 2020-04-22T14:16:05.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.338+0000 7fc7b305a700 1 -- start start 2020-04-22T14:16:05.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.338+0000 7fc7b305a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc7ac146050 0x7fc7ac062ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:05.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.338+0000 7fc7b305a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7ac061840 0x7fc7ac061cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:05.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.338+0000 7fc7b305a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7ac065710 con 0x7fc7ac063350 2020-04-22T14:16:05.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.338+0000 7fc7b305a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7ac0659b0 con 0x7fc7ac146050 2020-04-22T14:16:05.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.338+0000 7fc7b305a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ac146430 con 0x7fc7ac061840 2020-04-22T14:16:05.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.338+0000 7fc7b0df6700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc7ac146050 0x7fc7ac062ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:05.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.338+0000 7fc7b0df6700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc7ac146050 0x7fc7ac062ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55834/0 (socket says 172.21.15.103:55834) 2020-04-22T14:16:05.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.339+0000 7fc7b0df6700 1 -- 172.21.15.103:0/3586595328 learned_addr learned my addr 172.21.15.103:0/3586595328 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:05.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.339+0000 7fc7b15f7700 1 --2- 172.21.15.103:0/3586595328 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7ac061840 0x7fc7ac061cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:05.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.339+0000 7fc7b0df6700 1 -- 172.21.15.103:0/3586595328 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7ac061840 msgr2=0x7fc7ac061cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:05.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.339+0000 7fc7b0df6700 1 --2- 172.21.15.103:0/3586595328 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7ac061840 0x7fc7ac061cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:05.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.339+0000 7fc7b0df6700 1 -- 172.21.15.103:0/3586595328 >> v1:172.21.15.86:6789/0 conn(0x7fc7ac063350 legacy=0x7fc7ac13c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:05.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.339+0000 7fc7b0df6700 1 -- 172.21.15.103:0/3586595328 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7ac065cc0 con 0x7fc7ac146050 2020-04-22T14:16:05.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.339+0000 7fc7b0df6700 1 --2- 172.21.15.103:0/3586595328 >> v2:172.21.15.103:3300/0 conn(0x7fc7ac146050 0x7fc7ac062ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc7ac06a700 tx=0x7fc79c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:05.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.339+0000 7fc7b0df6700 1 --2- 172.21.15.103:0/3586595328 >> v2:172.21.15.103:3300/0 conn(0x7fc7ac146050 0x7fc7ac062ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc7ac06a700 tx=0x7fc79c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:05.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.339+0000 7fc7b0df6700 1 --2- 172.21.15.103:0/3586595328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7ac146050 0x7fc7ac062ef0 secure :-1 s=READY pgs=1604 cs=0 l=1 rx=0x7fc7ac06a700 tx=0x7fc79c007a40).ready entity=mon.1 client_cookie=7d7a975c80e5df31 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:05.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.339+0000 7fc7b0df6700 1 --2- 172.21.15.103:0/3586595328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7ac146050 0x7fc7ac062ef0 secure :-1 s=THROTTLE_DONE pgs=1604 cs=0 l=1 rx=0x7fc7ac06a700 tx=0x7fc79c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:05.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.339+0000 7fc7ab7fe700 1 -- 172.21.15.103:0/3586595328 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc79c009e40 con 0x7fc7ac146050 2020-04-22T14:16:05.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.339+0000 7fc7b0df6700 1 --2- 172.21.15.103:0/3586595328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7ac146050 0x7fc7ac062ef0 secure :-1 s=THROTTLE_DONE pgs=1604 cs=0 l=1 rx=0x7fc7ac06a700 tx=0x7fc79c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:05.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.339+0000 7fc7b0df6700 1 --2- 172.21.15.103:0/3586595328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7ac146050 0x7fc7ac062ef0 secure :-1 s=THROTTLE_DONE pgs=1604 cs=0 l=1 rx=0x7fc7ac06a700 tx=0x7fc79c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:05.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.339+0000 7fc7ab7fe700 1 -- 172.21.15.103:0/3586595328 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc79c0129e0 con 0x7fc7ac146050 2020-04-22T14:16:05.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.339+0000 7fc7ab7fe700 1 -- 172.21.15.103:0/3586595328 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc79c012e00 con 0x7fc7ac146050 2020-04-22T14:16:05.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.339+0000 7fc7b305a700 1 -- 172.21.15.103:0/3586595328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7ac146050 msgr2=0x7fc7ac062ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:05.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.339+0000 7fc7b305a700 1 --2- 172.21.15.103:0/3586595328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7ac146050 0x7fc7ac062ef0 secure :-1 s=READY pgs=1604 cs=0 l=1 rx=0x7fc7ac06a700 tx=0x7fc79c007a40).stop 2020-04-22T14:16:05.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.340+0000 7fc7b305a700 1 -- 172.21.15.103:0/3586595328 shutdown_connections 2020-04-22T14:16:05.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.340+0000 7fc7b305a700 1 --2- 172.21.15.103:0/3586595328 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7ac061840 0x7fc7ac061cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:05.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.340+0000 7fc7b305a700 1 --2- 172.21.15.103:0/3586595328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7ac146050 0x7fc7ac062ef0 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:05.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.340+0000 7fc7b305a700 1 -- 172.21.15.103:0/3586595328 >> 172.21.15.103:0/3586595328 conn(0x7fc7ac05ad30 msgr2=0x7fc7ac05b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:05.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.340+0000 7fc7b305a700 1 -- 172.21.15.103:0/3586595328 shutdown_connections 2020-04-22T14:16:05.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.340+0000 7fc7b305a700 1 -- 172.21.15.103:0/3586595328 wait complete. 2020-04-22T14:16:05.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.341+0000 7fc7b305a700 1 Processor -- start 2020-04-22T14:16:05.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.341+0000 7fc7b305a700 1 -- start start 2020-04-22T14:16:05.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.341+0000 7fc7b305a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc7ac061840 0x7fc7ac135ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:05.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.341+0000 7fc7b305a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7ac136330 con 0x7fc7ac063350 2020-04-22T14:16:05.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.341+0000 7fc7b305a700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7ac0b5490 con 0x7fc7ac146050 2020-04-22T14:16:05.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.341+0000 7fc7b305a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7ac152c40 con 0x7fc7ac061840 2020-04-22T14:16:05.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.342+0000 7fc7b15f7700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc7ac146050 0x7fc7ac153380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48034/0 (socket says 172.21.15.103:48034) 2020-04-22T14:16:05.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.342+0000 7fc7b15f7700 1 -- 172.21.15.103:0/755481110 learned_addr learned my addr 172.21.15.103:0/755481110 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:05.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.342+0000 7fc7b0df6700 1 --2- 172.21.15.103:0/755481110 >> v2:172.21.15.86:3300/0 conn(0x7fc7ac061840 0x7fc7ac135ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:05.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.342+0000 7fc7a9ffb700 1 -- 172.21.15.103:0/755481110 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2177604590 0 0) 0x7fc7ac0b5490 con 0x7fc7ac146050 2020-04-22T14:16:05.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.342+0000 7fc7a9ffb700 1 -- 172.21.15.103:0/755481110 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc78c002fe0 con 0x7fc7ac146050 2020-04-22T14:16:05.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.342+0000 7fc7a9ffb700 1 -- 172.21.15.103:0/755481110 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3001403169 0 0) 0x7fc78c002fe0 con 0x7fc7ac146050 2020-04-22T14:16:05.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.342+0000 7fc7b0df6700 1 -- 172.21.15.103:0/755481110 >> v1:172.21.15.103:6789/0 conn(0x7fc7ac146050 legacy=0x7fc7ac153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:05.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.342+0000 7fc7b0df6700 1 -- 172.21.15.103:0/755481110 >> v1:172.21.15.86:6789/0 conn(0x7fc7ac063350 legacy=0x7fc7ac0b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:05.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.342+0000 7fc7b0df6700 1 -- 172.21.15.103:0/755481110 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7ac152ee0 con 0x7fc7ac061840 2020-04-22T14:16:05.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.342+0000 7fc7b0df6700 1 --2- 172.21.15.103:0/755481110 >> v2:172.21.15.86:3300/0 conn(0x7fc7ac061840 0x7fc7ac135ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc7a00010b0 tx=0x7fc79c012fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:05.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.342+0000 7fc7b0df6700 1 --2- 172.21.15.103:0/755481110 >> v2:172.21.15.86:3300/0 conn(0x7fc7ac061840 0x7fc7ac135ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc7a00010b0 tx=0x7fc79c012fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:05.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.342+0000 7fc7b0df6700 1 --2- 172.21.15.103:0/755481110 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7ac061840 0x7fc7ac135ed0 secure :-1 s=READY pgs=855 cs=0 l=1 rx=0x7fc7a00010b0 tx=0x7fc79c012fa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:05.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.342+0000 7fc7b0df6700 1 --2- 172.21.15.103:0/755481110 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7ac061840 0x7fc7ac135ed0 secure :-1 s=THROTTLE_DONE pgs=855 cs=0 l=1 rx=0x7fc7a00010b0 tx=0x7fc79c012fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:05.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.342+0000 7fc7a9ffb700 1 -- 172.21.15.103:0/755481110 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7a40018e0 con 0x7fc7ac061840 2020-04-22T14:16:05.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.342+0000 7fc7b0df6700 1 --2- 172.21.15.103:0/755481110 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7ac061840 0x7fc7ac135ed0 secure :-1 s=THROTTLE_DONE pgs=855 cs=0 l=1 rx=0x7fc7a00010b0 tx=0x7fc79c012fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:05.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.342+0000 7fc7b0df6700 1 --2- 172.21.15.103:0/755481110 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7ac061840 0x7fc7ac135ed0 secure :-1 s=THROTTLE_DONE pgs=855 cs=0 l=1 rx=0x7fc7a00010b0 tx=0x7fc79c012fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:05.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.342+0000 7fc7a9ffb700 1 -- 172.21.15.103:0/755481110 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc79c009e40 con 0x7fc7ac061840 2020-04-22T14:16:05.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.342+0000 7fc7b305a700 1 -- 172.21.15.103:0/755481110 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7ac153a90 con 0x7fc7ac061840 2020-04-22T14:16:05.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.342+0000 7fc7a9ffb700 1 -- 172.21.15.103:0/755481110 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc79c007170 con 0x7fc7ac061840 2020-04-22T14:16:05.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.342+0000 7fc7b305a700 1 -- 172.21.15.103:0/755481110 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7ac150550 con 0x7fc7ac061840 2020-04-22T14:16:05.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.343+0000 7fc7b0df6700 1 --2- 172.21.15.103:0/755481110 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7ac061840 0x7fc7ac135ed0 secure :-1 s=THROTTLE_DONE pgs=855 cs=0 l=1 rx=0x7fc7a00010b0 tx=0x7fc79c012fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:05.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.343+0000 7fc7b305a700 1 -- 172.21.15.103:0/755481110 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7ac056c90 con 0x7fc7ac061840 2020-04-22T14:16:05.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.343+0000 7fc7a9ffb700 1 -- 172.21.15.103:0/755481110 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fc79c0073a0 con 0x7fc7ac061840 2020-04-22T14:16:05.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.343+0000 7fc7b0df6700 1 --2- 172.21.15.103:0/755481110 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7ac061840 0x7fc7ac135ed0 secure :-1 s=THROTTLE_DONE pgs=855 cs=0 l=1 rx=0x7fc7a00010b0 tx=0x7fc79c012fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:05.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.344+0000 7fc7a9ffb700 1 --2- 172.21.15.103:0/755481110 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc78c04dc50 0x7fc78c050110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:05.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.344+0000 7fc7a9ffb700 1 -- 172.21.15.103:0/755481110 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc79c062620 con 0x7fc7ac061840 2020-04-22T14:16:05.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.344+0000 7fc7abfff700 1 --2- 172.21.15.103:0/755481110 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc78c04dc50 0x7fc78c050110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:05.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.344+0000 7fc7abfff700 1 --2- 172.21.15.103:0/755481110 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc78c04dc50 0x7fc78c050110 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc7a00010f0 tx=0x7fc7a0001740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:05.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.344+0000 7fc7abfff700 1 --2- 172.21.15.103:0/755481110 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc78c04dc50 0x7fc78c050110 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc7a00010f0 tx=0x7fc7a0001740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:05.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.344+0000 7fc7abfff700 1 --2- 172.21.15.103:0/755481110 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc78c04dc50 0x7fc78c050110 secure :-1 s=READY pgs=583 cs=0 l=1 rx=0x7fc7a00010f0 tx=0x7fc7a0001740).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:05.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.348+0000 7fc7b0df6700 1 --2- 172.21.15.103:0/755481110 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7ac061840 0x7fc7ac135ed0 secure :-1 s=THROTTLE_DONE pgs=855 cs=0 l=1 rx=0x7fc7a00010b0 tx=0x7fc79c012fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:05.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.348+0000 7fc7a9ffb700 1 -- 172.21.15.103:0/755481110 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fc79c03db20 con 0x7fc7ac061840 2020-04-22T14:16:05.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.490+0000 7fc7b305a700 1 -- 172.21.15.103:0/755481110 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7ac0b5d50 con 0x7fc7ac061840 2020-04-22T14:16:05.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.491+0000 7fc7b0df6700 1 --2- 172.21.15.103:0/755481110 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7ac061840 0x7fc7ac135ed0 secure :-1 s=THROTTLE_DONE pgs=855 cs=0 l=1 rx=0x7fc7a00010b0 tx=0x7fc79c012fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:05.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.492+0000 7fc7a9ffb700 1 -- 172.21.15.103:0/755481110 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+16116 (secure 0 0 0) 0x7fc79c041140 con 0x7fc7ac061840 2020-04-22T14:16:05.494 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:16:05.494 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":112,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:16:05.150304+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:16:02.890350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2020-04-22T14:16:03.893169+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:16:05.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.493+0000 7fc7b305a700 1 -- 172.21.15.103:0/755481110 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc78c04dc50 msgr2=0x7fc78c050110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:05.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.493+0000 7fc7b305a700 1 --2- 172.21.15.103:0/755481110 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc78c04dc50 0x7fc78c050110 secure :-1 s=READY pgs=583 cs=0 l=1 rx=0x7fc7a00010f0 tx=0x7fc7a0001740).stop 2020-04-22T14:16:05.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.493+0000 7fc7b305a700 1 -- 172.21.15.103:0/755481110 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7ac061840 msgr2=0x7fc7ac135ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:05.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.493+0000 7fc7b305a700 1 --2- 172.21.15.103:0/755481110 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7ac061840 0x7fc7ac135ed0 secure :-1 s=READY pgs=855 cs=0 l=1 rx=0x7fc7a00010b0 tx=0x7fc79c012fa0).stop 2020-04-22T14:16:05.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.493+0000 7fc7b305a700 1 -- 172.21.15.103:0/755481110 shutdown_connections 2020-04-22T14:16:05.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.493+0000 7fc7b305a700 1 --2- 172.21.15.103:0/755481110 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc78c04dc50 0x7fc78c050110 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:05.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.493+0000 7fc7b305a700 1 --2- 172.21.15.103:0/755481110 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7ac061840 0x7fc7ac135ed0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:05.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.493+0000 7fc7b305a700 1 -- 172.21.15.103:0/755481110 >> 172.21.15.103:0/755481110 conn(0x7fc7ac05ad30 msgr2=0x7fc7ac061cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:05.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.493+0000 7fc7b305a700 1 -- 172.21.15.103:0/755481110 shutdown_connections 2020-04-22T14:16:05.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.493+0000 7fc7b305a700 1 -- 172.21.15.103:0/755481110 wait complete. 2020-04-22T14:16:05.506 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:05.520 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:16:05.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.664+0000 7f326c1e1700 1 Processor -- start 2020-04-22T14:16:05.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.665+0000 7f326c1e1700 1 -- start start 2020-04-22T14:16:05.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.665+0000 7f326c1e1700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f32640ae1a0 0x7f326414a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:05.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.665+0000 7f326c1e1700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f32640bd1b0 0x7f32640bd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:05.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.665+0000 7f326c1e1700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f326414a710 con 0x7f3264140320 2020-04-22T14:16:05.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.665+0000 7f326c1e1700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32641462f0 con 0x7f32640bd1b0 2020-04-22T14:16:05.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.665+0000 7f326c1e1700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3264146590 con 0x7f32640ae1a0 2020-04-22T14:16:05.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.665+0000 7f3269f7d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f3264140320 0x7f3264146cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48038/0 (socket says 172.21.15.103:48038) 2020-04-22T14:16:05.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.665+0000 7f3269f7d700 1 -- 172.21.15.103:0/1194194418 learned_addr learned my addr 172.21.15.103:0/1194194418 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:05.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.666+0000 7f3268f7b700 1 -- 172.21.15.103:0/1194194418 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1072924081 0 0) 0x7f326414a710 con 0x7f3264140320 2020-04-22T14:16:05.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.666+0000 7f326a77e700 1 --2- 172.21.15.103:0/1194194418 >> v2:172.21.15.86:3300/0 conn(0x7f32640bd1b0 0x7f32640bd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:05.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.666+0000 7f326977c700 1 --2- 172.21.15.103:0/1194194418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f32640ae1a0 0x7f326414a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:05.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.666+0000 7f3268f7b700 1 -- 172.21.15.103:0/1194194418 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f324c003230 con 0x7f3264140320 2020-04-22T14:16:05.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.666+0000 7f3268f7b700 1 -- 172.21.15.103:0/1194194418 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2628372925 0 0) 0x7f324c003230 con 0x7f3264140320 2020-04-22T14:16:05.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.666+0000 7f3268f7b700 1 -- 172.21.15.103:0/1194194418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f32640ae1a0 msgr2=0x7f326414a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:05.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.666+0000 7f3268f7b700 1 --2- 172.21.15.103:0/1194194418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f32640ae1a0 0x7f326414a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:05.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.666+0000 7f3268f7b700 1 -- 172.21.15.103:0/1194194418 >> v2:172.21.15.86:3300/0 conn(0x7f32640bd1b0 msgr2=0x7f32640bd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:05.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.666+0000 7f3268f7b700 1 --2- 172.21.15.103:0/1194194418 >> v2:172.21.15.86:3300/0 conn(0x7f32640bd1b0 0x7f32640bd640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:05.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.666+0000 7f3268f7b700 1 -- 172.21.15.103:0/1194194418 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3264146830 con 0x7f3264140320 2020-04-22T14:16:05.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.666+0000 7f3268f7b700 1 -- 172.21.15.103:0/1194194418 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f32580016d0 con 0x7f3264140320 2020-04-22T14:16:05.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.666+0000 7f3268f7b700 1 -- 172.21.15.103:0/1194194418 >> v1:172.21.15.103:6789/0 conn(0x7f3264140320 legacy=0x7f3264146cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:05.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.666+0000 7f3268f7b700 1 --2- 172.21.15.103:0/1194194418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f32640ae1a0 0x7f324c003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:05.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.666+0000 7f3268f7b700 1 --2- 172.21.15.103:0/1194194418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f324c003b80 0x7f324c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:05.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.666+0000 7f3268f7b700 1 --2- 172.21.15.103:0/1194194418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f324c0045c0 0x7f324c004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:05.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.666+0000 7f3268f7b700 1 -- 172.21.15.103:0/1194194418 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32641462f0 con 0x7f324c0045c0 2020-04-22T14:16:05.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.666+0000 7f3268f7b700 1 -- 172.21.15.103:0/1194194418 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3264146590 con 0x7f324c003b80 2020-04-22T14:16:05.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.666+0000 7f3268f7b700 1 -- 172.21.15.103:0/1194194418 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f324c005050 con 0x7f32640ae1a0 2020-04-22T14:16:05.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.666+0000 7f326977c700 1 --2- 172.21.15.103:0/1194194418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f324c003b80 0x7f324c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:05.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.666+0000 7f3269f7d700 1 --2- 172.21.15.103:0/1194194418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f32640ae1a0 0x7f324c003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:05.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.666+0000 7f326a77e700 1 --2- 172.21.15.103:0/1194194418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f324c0045c0 0x7f324c004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:05.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.666+0000 7f326977c700 1 -- 172.21.15.103:0/1194194418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f32640ae1a0 msgr2=0x7f324c003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:05.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.666+0000 7f326977c700 1 --2- 172.21.15.103:0/1194194418 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f32640ae1a0 0x7f324c003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:05.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.666+0000 7f326977c700 1 -- 172.21.15.103:0/1194194418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f324c0045c0 msgr2=0x7f324c004a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:05.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.666+0000 7f326977c700 1 --2- 172.21.15.103:0/1194194418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f324c0045c0 0x7f324c004a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:05.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.666+0000 7f326977c700 1 -- 172.21.15.103:0/1194194418 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f324c003230 con 0x7f324c003b80 2020-04-22T14:16:05.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.666+0000 7f326977c700 1 --2- 172.21.15.103:0/1194194418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f324c003b80 0x7f324c003fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3260008910 tx=0x7f3260010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:05.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.667+0000 7f326977c700 1 --2- 172.21.15.103:0/1194194418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f324c003b80 0x7f324c003fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3260008910 tx=0x7f3260010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:05.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.667+0000 7f326977c700 1 --2- 172.21.15.103:0/1194194418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f324c003b80 0x7f324c003fe0 secure :-1 s=READY pgs=1607 cs=0 l=1 rx=0x7f3260008910 tx=0x7f3260010050).ready entity=mon.1 client_cookie=4add3e5e5adfb635 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:05.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.667+0000 7f326977c700 1 --2- 172.21.15.103:0/1194194418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f324c003b80 0x7f324c003fe0 secure :-1 s=THROTTLE_DONE pgs=1607 cs=0 l=1 rx=0x7f3260008910 tx=0x7f3260010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:05.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.667+0000 7f326977c700 1 --2- 172.21.15.103:0/1194194418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f324c003b80 0x7f324c003fe0 secure :-1 s=THROTTLE_DONE pgs=1607 cs=0 l=1 rx=0x7f3260008910 tx=0x7f3260010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:05.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.667+0000 7f3268f7b700 1 -- 172.21.15.103:0/1194194418 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3260008d30 con 0x7f324c003b80 2020-04-22T14:16:05.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.667+0000 7f326977c700 1 --2- 172.21.15.103:0/1194194418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f324c003b80 0x7f324c003fe0 secure :-1 s=THROTTLE_DONE pgs=1607 cs=0 l=1 rx=0x7f3260008910 tx=0x7f3260010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:05.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.667+0000 7f3268f7b700 1 -- 172.21.15.103:0/1194194418 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3260008e90 con 0x7f324c003b80 2020-04-22T14:16:05.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.667+0000 7f3268f7b700 1 -- 172.21.15.103:0/1194194418 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3260010a80 con 0x7f324c003b80 2020-04-22T14:16:05.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.667+0000 7f326c1e1700 1 -- 172.21.15.103:0/1194194418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f324c003b80 msgr2=0x7f324c003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:05.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.667+0000 7f326c1e1700 1 --2- 172.21.15.103:0/1194194418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f324c003b80 0x7f324c003fe0 secure :-1 s=READY pgs=1607 cs=0 l=1 rx=0x7f3260008910 tx=0x7f3260010050).stop 2020-04-22T14:16:05.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.667+0000 7f326a77e700 1 -- 172.21.15.103:0/1194194418 reap_dead start 2020-04-22T14:16:05.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.667+0000 7f326c1e1700 1 -- 172.21.15.103:0/1194194418 shutdown_connections 2020-04-22T14:16:05.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.667+0000 7f326c1e1700 1 -- 172.21.15.103:0/1194194418 >> 172.21.15.103:0/1194194418 conn(0x7f326405f2c0 msgr2=0x7f32640bcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:05.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.667+0000 7f326c1e1700 1 -- 172.21.15.103:0/1194194418 shutdown_connections 2020-04-22T14:16:05.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.667+0000 7f326c1e1700 1 -- 172.21.15.103:0/1194194418 wait complete. 2020-04-22T14:16:05.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.668+0000 7f326c1e1700 1 Processor -- start 2020-04-22T14:16:05.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.668+0000 7f326c1e1700 1 -- start start 2020-04-22T14:16:05.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.669+0000 7f326c1e1700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f326414abf0 0x7f32640b7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:05.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.669+0000 7f326c1e1700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3264143430 0x7f32641438c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:05.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.669+0000 7f326c1e1700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32641548b0 con 0x7f3264154410 2020-04-22T14:16:05.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.669+0000 7f326c1e1700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3264143d20 con 0x7f3264143430 2020-04-22T14:16:05.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.669+0000 7f326c1e1700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3264140810 con 0x7f326414abf0 2020-04-22T14:16:05.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.669+0000 7f3269f7d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f326414abf0 0x7f32640b7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:05.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.669+0000 7f3269f7d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f326414abf0 0x7f32640b7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:40638/0 (socket says 172.21.15.103:40638) 2020-04-22T14:16:05.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.669+0000 7f3269f7d700 1 -- 172.21.15.103:0/377854669 learned_addr learned my addr 172.21.15.103:0/377854669 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:05.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.669+0000 7f326a77e700 1 --2- 172.21.15.103:0/377854669 >> v2:172.21.15.86:3300/0 conn(0x7f3264143430 0x7f32641438c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:05.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.669+0000 7f3269f7d700 1 -- 172.21.15.103:0/377854669 >> v2:172.21.15.86:3300/0 conn(0x7f3264143430 msgr2=0x7f32641438c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:05.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.669+0000 7f3269f7d700 1 --2- 172.21.15.103:0/377854669 >> v2:172.21.15.86:3300/0 conn(0x7f3264143430 0x7f32641438c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:05.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.669+0000 7f3269f7d700 1 -- 172.21.15.103:0/377854669 >> v1:172.21.15.86:6789/0 conn(0x7f3264154410 legacy=0x7f3264140f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:05.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.669+0000 7f3269f7d700 1 -- 172.21.15.103:0/377854669 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3264140ab0 con 0x7f326414abf0 2020-04-22T14:16:05.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.669+0000 7f3269f7d700 1 --2- 172.21.15.103:0/377854669 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f326414abf0 0x7f32640b7d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f32640b1510 tx=0x7f3264143ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:05.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.669+0000 7f3269f7d700 1 --2- 172.21.15.103:0/377854669 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f326414abf0 0x7f32640b7d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f32640b1510 tx=0x7f3264143ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:05.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.669+0000 7f3269f7d700 1 --2- 172.21.15.103:0/377854669 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f326414abf0 0x7f32640b7d80 secure :-1 s=READY pgs=152 cs=0 l=1 rx=0x7f32640b1510 tx=0x7f3264143ee0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:05.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.670+0000 7f3269f7d700 1 --2- 172.21.15.103:0/377854669 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f326414abf0 0x7f32640b7d80 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f32640b1510 tx=0x7f3264143ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:05.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.670+0000 7f3256ffd700 1 -- 172.21.15.103:0/377854669 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3258011d30 con 0x7f326414abf0 2020-04-22T14:16:05.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.670+0000 7f3269f7d700 1 --2- 172.21.15.103:0/377854669 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f326414abf0 0x7f32640b7d80 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f32640b1510 tx=0x7f3264143ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:05.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.670+0000 7f326c1e1700 1 -- 172.21.15.103:0/377854669 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f326414afd0 con 0x7f326414abf0 2020-04-22T14:16:05.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.670+0000 7f3256ffd700 1 -- 172.21.15.103:0/377854669 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3258011e90 con 0x7f326414abf0 2020-04-22T14:16:05.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.670+0000 7f3269f7d700 1 --2- 172.21.15.103:0/377854669 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f326414abf0 0x7f32640b7d80 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f32640b1510 tx=0x7f3264143ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:05.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.670+0000 7f3256ffd700 1 -- 172.21.15.103:0/377854669 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f325800e360 con 0x7f326414abf0 2020-04-22T14:16:05.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.670+0000 7f326c1e1700 1 -- 172.21.15.103:0/377854669 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32640b8510 con 0x7f326414abf0 2020-04-22T14:16:05.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.670+0000 7f3269f7d700 1 --2- 172.21.15.103:0/377854669 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f326414abf0 0x7f32640b7d80 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f32640b1510 tx=0x7f3264143ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:05.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.671+0000 7f3256ffd700 1 -- 172.21.15.103:0/377854669 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f325800e560 con 0x7f326414abf0 2020-04-22T14:16:05.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.671+0000 7f3269f7d700 1 --2- 172.21.15.103:0/377854669 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f326414abf0 0x7f32640b7d80 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f32640b1510 tx=0x7f3264143ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:05.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.671+0000 7f326c1e1700 1 -- 172.21.15.103:0/377854669 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3264056c90 con 0x7f326414abf0 2020-04-22T14:16:05.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.671+0000 7f3256ffd700 1 --2- 172.21.15.103:0/377854669 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f324404d8a0 0x7f324404fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:05.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.671+0000 7f3256ffd700 1 -- 172.21.15.103:0/377854669 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3258061160 con 0x7f326414abf0 2020-04-22T14:16:05.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.671+0000 7f326977c700 1 --2- 172.21.15.103:0/377854669 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f324404d8a0 0x7f324404fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:05.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.671+0000 7f326977c700 1 --2- 172.21.15.103:0/377854669 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f324404d8a0 0x7f324404fd60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f32640b0c50 tx=0x7f3260010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:05.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.671+0000 7f326977c700 1 --2- 172.21.15.103:0/377854669 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f324404d8a0 0x7f324404fd60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f32640b0c50 tx=0x7f3260010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:05.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.671+0000 7f326977c700 1 --2- 172.21.15.103:0/377854669 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f324404d8a0 0x7f324404fd60 secure :-1 s=READY pgs=584 cs=0 l=1 rx=0x7f32640b0c50 tx=0x7f3260010050).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:05.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.675+0000 7f3269f7d700 1 --2- 172.21.15.103:0/377854669 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f326414abf0 0x7f32640b7d80 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f32640b1510 tx=0x7f3264143ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:05.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.675+0000 7f3256ffd700 1 -- 172.21.15.103:0/377854669 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f325803c4e0 con 0x7f326414abf0 2020-04-22T14:16:05.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.818+0000 7f326c1e1700 1 -- 172.21.15.103:0/377854669 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3264061690 con 0x7f326414abf0 2020-04-22T14:16:05.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.819+0000 7f3269f7d700 1 --2- 172.21.15.103:0/377854669 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f326414abf0 0x7f32640b7d80 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f32640b1510 tx=0x7f3264143ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:05.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.819+0000 7f3256ffd700 1 -- 172.21.15.103:0/377854669 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+16116 (secure 0 0 0) 0x7f325803fb00 con 0x7f326414abf0 2020-04-22T14:16:05.821 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:16:05.821 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":112,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:16:05.150304+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:16:02.890350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2020-04-22T14:16:03.893169+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:16:05.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.820+0000 7f326c1e1700 1 -- 172.21.15.103:0/377854669 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f324404d8a0 msgr2=0x7f324404fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:05.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.820+0000 7f326c1e1700 1 --2- 172.21.15.103:0/377854669 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f324404d8a0 0x7f324404fd60 secure :-1 s=READY pgs=584 cs=0 l=1 rx=0x7f32640b0c50 tx=0x7f3260010050).stop 2020-04-22T14:16:05.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.820+0000 7f326c1e1700 1 -- 172.21.15.103:0/377854669 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f326414abf0 msgr2=0x7f32640b7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:05.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.820+0000 7f326c1e1700 1 --2- 172.21.15.103:0/377854669 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f326414abf0 0x7f32640b7d80 secure :-1 s=READY pgs=152 cs=0 l=1 rx=0x7f32640b1510 tx=0x7f3264143ee0).stop 2020-04-22T14:16:05.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.820+0000 7f326c1e1700 1 -- 172.21.15.103:0/377854669 shutdown_connections 2020-04-22T14:16:05.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.820+0000 7f326c1e1700 1 --2- 172.21.15.103:0/377854669 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f324404d8a0 0x7f324404fd60 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:05.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.820+0000 7f326c1e1700 1 --2- 172.21.15.103:0/377854669 >> v2:172.21.15.86:3300/0 conn(0x7f3264143430 0x7f32641438c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:05.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.820+0000 7f326c1e1700 1 --2- 172.21.15.103:0/377854669 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f326414abf0 0x7f32640b7d80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:05.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.820+0000 7f326c1e1700 1 -- 172.21.15.103:0/377854669 >> 172.21.15.103:0/377854669 conn(0x7f326405f2c0 msgr2=0x7f3264147a20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:05.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.820+0000 7f326c1e1700 1 -- 172.21.15.103:0/377854669 shutdown_connections 2020-04-22T14:16:05.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.820+0000 7f326c1e1700 1 -- 172.21.15.103:0/377854669 wait complete. 2020-04-22T14:16:05.833 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:05.847 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-04-22T14:16:05.996 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.994+0000 7fbcdfc82700 1 Processor -- start 2020-04-22T14:16:05.997 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.994+0000 7fbcdfc82700 1 -- start start 2020-04-22T14:16:06.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.995+0000 7fbcdfc82700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbcd8143bc0 0x7fbcd8146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:06.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.995+0000 7fbcdfc82700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbcd80b5ea0 0x7fbcd80b6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:06.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.995+0000 7fbcdfc82700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcd805fbc0 con 0x7fbcd80b9890 2020-04-22T14:16:06.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.995+0000 7fbcdfc82700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcd805fe60 con 0x7fbcd8143bc0 2020-04-22T14:16:06.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.995+0000 7fbcdfc82700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcd8060100 con 0x7fbcd80b5ea0 2020-04-22T14:16:06.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.995+0000 7fbcde21f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbcd80b5ea0 0x7fbcd80b6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:06.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.995+0000 7fbcde21f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbcd80b5ea0 0x7fbcd80b6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55872/0 (socket says 172.21.15.103:55872) 2020-04-22T14:16:06.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.995+0000 7fbcde21f700 1 -- 172.21.15.103:0/715387128 learned_addr learned my addr 172.21.15.103:0/715387128 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:06.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.995+0000 7fbcdda1e700 1 --1- 172.21.15.103:0/715387128 >> v1:172.21.15.103:6789/0 conn(0x7fbcd80b9890 0x7fbcd81434b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48058/0 (socket says 172.21.15.103:48058) 2020-04-22T14:16:06.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.995+0000 7fbcdd21d700 1 --2- 172.21.15.103:0/715387128 >> v2:172.21.15.86:3300/0 conn(0x7fbcd8143bc0 0x7fbcd8146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:06.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.996+0000 7fbcde21f700 1 -- 172.21.15.103:0/715387128 >> v2:172.21.15.86:3300/0 conn(0x7fbcd8143bc0 msgr2=0x7fbcd8146fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:06.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.996+0000 7fbcde21f700 1 --2- 172.21.15.103:0/715387128 >> v2:172.21.15.86:3300/0 conn(0x7fbcd8143bc0 0x7fbcd8146fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:06.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.996+0000 7fbcde21f700 1 -- 172.21.15.103:0/715387128 >> v1:172.21.15.103:6789/0 conn(0x7fbcd80b9890 legacy=0x7fbcd81434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:06.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.996+0000 7fbcdca1c700 1 -- 172.21.15.103:0/715387128 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1040389884 0 0) 0x7fbcd805fbc0 con 0x7fbcd80b9890 2020-04-22T14:16:06.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.996+0000 7fbcde21f700 1 -- 172.21.15.103:0/715387128 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd80b9c70 con 0x7fbcd80b5ea0 2020-04-22T14:16:06.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.996+0000 7fbcdd21d700 1 --2- 172.21.15.103:0/715387128 >> v2:172.21.15.86:3300/0 conn(0x7fbcd8143bc0 0x7fbcd8146fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:16:06.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.996+0000 7fbcde21f700 1 --2- 172.21.15.103:0/715387128 >> v2:172.21.15.103:3300/0 conn(0x7fbcd80b5ea0 0x7fbcd80b6330 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbcd00032b0 tx=0x7fbcd0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:06.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.996+0000 7fbcde21f700 1 --2- 172.21.15.103:0/715387128 >> v2:172.21.15.103:3300/0 conn(0x7fbcd80b5ea0 0x7fbcd80b6330 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbcd00032b0 tx=0x7fbcd0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:06.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.996+0000 7fbcde21f700 1 --2- 172.21.15.103:0/715387128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcd80b5ea0 0x7fbcd80b6330 secure :-1 s=READY pgs=1609 cs=0 l=1 rx=0x7fbcd00032b0 tx=0x7fbcd0007dc0).ready entity=mon.1 client_cookie=6df3eba79a1a8df2 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:06.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.996+0000 7fbcde21f700 1 --2- 172.21.15.103:0/715387128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcd80b5ea0 0x7fbcd80b6330 secure :-1 s=THROTTLE_DONE pgs=1609 cs=0 l=1 rx=0x7fbcd00032b0 tx=0x7fbcd0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:06.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.996+0000 7fbcdca1c700 1 -- 172.21.15.103:0/715387128 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcd000a180 con 0x7fbcd80b5ea0 2020-04-22T14:16:06.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.996+0000 7fbcde21f700 1 --2- 172.21.15.103:0/715387128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcd80b5ea0 0x7fbcd80b6330 secure :-1 s=THROTTLE_DONE pgs=1609 cs=0 l=1 rx=0x7fbcd00032b0 tx=0x7fbcd0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:06.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.996+0000 7fbcdca1c700 1 -- 172.21.15.103:0/715387128 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd000a2e0 con 0x7fbcd80b5ea0 2020-04-22T14:16:06.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.996+0000 7fbcde21f700 1 --2- 172.21.15.103:0/715387128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcd80b5ea0 0x7fbcd80b6330 secure :-1 s=THROTTLE_DONE pgs=1609 cs=0 l=1 rx=0x7fbcd00032b0 tx=0x7fbcd0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:06.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.996+0000 7fbcdca1c700 1 -- 172.21.15.103:0/715387128 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcd000a6c0 con 0x7fbcd80b5ea0 2020-04-22T14:16:06.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.996+0000 7fbcdfc82700 1 -- 172.21.15.103:0/715387128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcd80b5ea0 msgr2=0x7fbcd80b6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:06.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.996+0000 7fbcdfc82700 1 --2- 172.21.15.103:0/715387128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcd80b5ea0 0x7fbcd80b6330 secure :-1 s=READY pgs=1609 cs=0 l=1 rx=0x7fbcd00032b0 tx=0x7fbcd0007dc0).stop 2020-04-22T14:16:06.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.996+0000 7fbcdfc82700 1 -- 172.21.15.103:0/715387128 shutdown_connections 2020-04-22T14:16:06.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.996+0000 7fbcdfc82700 1 --2- 172.21.15.103:0/715387128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcd80b5ea0 0x7fbcd80b6330 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:06.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.996+0000 7fbcdfc82700 1 --2- 172.21.15.103:0/715387128 >> v2:172.21.15.86:3300/0 conn(0x7fbcd8143bc0 0x7fbcd8146fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:06.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.996+0000 7fbcdfc82700 1 -- 172.21.15.103:0/715387128 >> 172.21.15.103:0/715387128 conn(0x7fbcd805ad30 msgr2=0x7fbcd805b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:06.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.996+0000 7fbcdfc82700 1 -- 172.21.15.103:0/715387128 shutdown_connections 2020-04-22T14:16:06.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.996+0000 7fbcdfc82700 1 -- 172.21.15.103:0/715387128 wait complete. 2020-04-22T14:16:06.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.997+0000 7fbcdfc82700 1 Processor -- start 2020-04-22T14:16:06.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.997+0000 7fbcdfc82700 1 -- start start 2020-04-22T14:16:06.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.998+0000 7fbcdfc82700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbcd80b5ea0 0x7fbcd80bbc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:06.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.998+0000 7fbcdfc82700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbcd80b9890 0x7fbcd8146bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:06.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.998+0000 7fbcdfc82700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcd8147030 con 0x7fbcd8143bc0 2020-04-22T14:16:06.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.998+0000 7fbcdfc82700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcd8157d00 con 0x7fbcd80b5ea0 2020-04-22T14:16:06.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.998+0000 7fbcdfc82700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcd80bc360 con 0x7fbcd80b9890 2020-04-22T14:16:06.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.998+0000 7fbcdd21d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbcd80b9890 0x7fbcd8146bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:06.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.998+0000 7fbcdd21d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbcd80b9890 0x7fbcd8146bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55876/0 (socket says 172.21.15.103:55876) 2020-04-22T14:16:06.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.998+0000 7fbcdd21d700 1 -- 172.21.15.103:0/3368527538 learned_addr learned my addr 172.21.15.103:0/3368527538 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:06.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.998+0000 7fbcdd21d700 1 -- 172.21.15.103:0/3368527538 >> v2:172.21.15.86:3300/0 conn(0x7fbcd80b5ea0 msgr2=0x7fbcd80bbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:06.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.998+0000 7fbcdda1e700 1 --2- 172.21.15.103:0/3368527538 >> v2:172.21.15.86:3300/0 conn(0x7fbcd80b5ea0 0x7fbcd80bbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:06.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.998+0000 7fbcdd21d700 1 --2- 172.21.15.103:0/3368527538 >> v2:172.21.15.86:3300/0 conn(0x7fbcd80b5ea0 0x7fbcd80bbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:06.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.998+0000 7fbcdd21d700 1 -- 172.21.15.103:0/3368527538 >> v1:172.21.15.86:6789/0 conn(0x7fbcd8143bc0 legacy=0x7fbcd81575f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:06.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.998+0000 7fbcdd21d700 1 -- 172.21.15.103:0/3368527538 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd80bc600 con 0x7fbcd80b9890 2020-04-22T14:16:06.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.998+0000 7fbcdd21d700 1 --2- 172.21.15.103:0/3368527538 >> v2:172.21.15.103:3300/0 conn(0x7fbcd80b9890 0x7fbcd8146bd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbcd81455d0 tx=0x7fbcd4010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:06.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.999+0000 7fbcdd21d700 1 --2- 172.21.15.103:0/3368527538 >> v2:172.21.15.103:3300/0 conn(0x7fbcd80b9890 0x7fbcd8146bd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbcd81455d0 tx=0x7fbcd4010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:06.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.999+0000 7fbcdd21d700 1 --2- 172.21.15.103:0/3368527538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcd80b9890 0x7fbcd8146bd0 secure :-1 s=READY pgs=1610 cs=0 l=1 rx=0x7fbcd81455d0 tx=0x7fbcd4010be0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:06.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.999+0000 7fbcdd21d700 1 --2- 172.21.15.103:0/3368527538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcd80b9890 0x7fbcd8146bd0 secure :-1 s=THROTTLE_DONE pgs=1610 cs=0 l=1 rx=0x7fbcd81455d0 tx=0x7fbcd4010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:06.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.999+0000 7fbcdd21d700 1 --2- 172.21.15.103:0/3368527538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcd80b9890 0x7fbcd8146bd0 secure :-1 s=THROTTLE_DONE pgs=1610 cs=0 l=1 rx=0x7fbcd81455d0 tx=0x7fbcd4010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:06.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.999+0000 7fbccaffd700 1 -- 172.21.15.103:0/3368527538 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcd4005e90 con 0x7fbcd80b9890 2020-04-22T14:16:06.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.999+0000 7fbcdd21d700 1 --2- 172.21.15.103:0/3368527538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcd80b9890 0x7fbcd8146bd0 secure :-1 s=THROTTLE_DONE pgs=1610 cs=0 l=1 rx=0x7fbcd81455d0 tx=0x7fbcd4010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:06.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.999+0000 7fbccaffd700 1 -- 172.21.15.103:0/3368527538 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd4007180 con 0x7fbcd80b9890 2020-04-22T14:16:06.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.999+0000 7fbccaffd700 1 -- 172.21.15.103:0/3368527538 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcd4007560 con 0x7fbcd80b9890 2020-04-22T14:16:06.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.999+0000 7fbcdfc82700 1 -- 172.21.15.103:0/3368527538 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcd8154000 con 0x7fbcd80b9890 2020-04-22T14:16:06.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.999+0000 7fbcdfc82700 1 -- 172.21.15.103:0/3368527538 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcd80ad360 con 0x7fbcd80b9890 2020-04-22T14:16:06.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:05.999+0000 7fbcdd21d700 1 --2- 172.21.15.103:0/3368527538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcd80b9890 0x7fbcd8146bd0 secure :-1 s=THROTTLE_DONE pgs=1610 cs=0 l=1 rx=0x7fbcd81455d0 tx=0x7fbcd4010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:06.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:06.000+0000 7fbccaffd700 1 -- 172.21.15.103:0/3368527538 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fbcd400e210 con 0x7fbcd80b9890 2020-04-22T14:16:06.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:06.000+0000 7fbcdd21d700 1 --2- 172.21.15.103:0/3368527538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcd80b9890 0x7fbcd8146bd0 secure :-1 s=THROTTLE_DONE pgs=1610 cs=0 l=1 rx=0x7fbcd81455d0 tx=0x7fbcd4010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:06.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:06.000+0000 7fbcdfc82700 1 -- 172.21.15.103:0/3368527538 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcd8056c90 con 0x7fbcd80b9890 2020-04-22T14:16:06.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:06.000+0000 7fbccaffd700 1 --2- 172.21.15.103:0/3368527538 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbcb804dac0 0x7fbcb804ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:06.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:06.000+0000 7fbccaffd700 1 -- 172.21.15.103:0/3368527538 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbcd4007e40 con 0x7fbcd80b9890 2020-04-22T14:16:06.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:06.000+0000 7fbcdda1e700 1 --2- 172.21.15.103:0/3368527538 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbcb804dac0 0x7fbcb804ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:06.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:06.001+0000 7fbcdda1e700 1 --2- 172.21.15.103:0/3368527538 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbcb804dac0 0x7fbcb804ff80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbccc000b80 tx=0x7fbccc001530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:06.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:06.001+0000 7fbcdda1e700 1 --2- 172.21.15.103:0/3368527538 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbcb804dac0 0x7fbcb804ff80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbccc000b80 tx=0x7fbccc001530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:06.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:06.001+0000 7fbcdda1e700 1 --2- 172.21.15.103:0/3368527538 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbcb804dac0 0x7fbcb804ff80 secure :-1 s=READY pgs=585 cs=0 l=1 rx=0x7fbccc000b80 tx=0x7fbccc001530).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:06.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:06.004+0000 7fbcdd21d700 1 --2- 172.21.15.103:0/3368527538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcd80b9890 0x7fbcd8146bd0 secure :-1 s=THROTTLE_DONE pgs=1610 cs=0 l=1 rx=0x7fbcd81455d0 tx=0x7fbcd4010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:06.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:06.004+0000 7fbccaffd700 1 -- 172.21.15.103:0/3368527538 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fbcd403c850 con 0x7fbcd80b9890 2020-04-22T14:16:06.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:06.197+0000 7fbcdfc82700 1 -- 172.21.15.103:0/3368527538 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fbcd8147030 con 0x7fbcd80b9890 2020-04-22T14:16:07.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:06.998+0000 7fbcdd21d700 1 --2- 172.21.15.103:0/3368527538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcd80b9890 0x7fbcd8146bd0 secure :-1 s=READY pgs=1610 cs=0 l=1 rx=0x7fbcd81455d0 tx=0x7fbcd4010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:07.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.158+0000 7fbcdd21d700 1 --2- 172.21.15.103:0/3368527538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcd80b9890 0x7fbcd8146bd0 secure :-1 s=THROTTLE_DONE pgs=1610 cs=0 l=1 rx=0x7fbcd81455d0 tx=0x7fbcd4010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:07.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.158+0000 7fbccaffd700 1 -- 172.21.15.103:0/3368527538 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v82) v1 ==== 118+0+0 (secure 0 0 0) 0x7fbcd8147030 con 0x7fbcd80b9890 2020-04-22T14:16:07.162 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.159+0000 7fbcdfc82700 1 -- 172.21.15.103:0/3368527538 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbcb804dac0 msgr2=0x7fbcb804ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:07.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.159+0000 7fbcdfc82700 1 --2- 172.21.15.103:0/3368527538 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbcb804dac0 0x7fbcb804ff80 secure :-1 s=READY pgs=585 cs=0 l=1 rx=0x7fbccc000b80 tx=0x7fbccc001530).stop 2020-04-22T14:16:07.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.159+0000 7fbcdfc82700 1 -- 172.21.15.103:0/3368527538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcd80b9890 msgr2=0x7fbcd8146bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:07.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.159+0000 7fbcdfc82700 1 --2- 172.21.15.103:0/3368527538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcd80b9890 0x7fbcd8146bd0 secure :-1 s=READY pgs=1610 cs=0 l=1 rx=0x7fbcd81455d0 tx=0x7fbcd4010be0).stop 2020-04-22T14:16:07.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.160+0000 7fbcdfc82700 1 -- 172.21.15.103:0/3368527538 shutdown_connections 2020-04-22T14:16:07.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.160+0000 7fbcdfc82700 1 --2- 172.21.15.103:0/3368527538 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbcb804dac0 0x7fbcb804ff80 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:07.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.160+0000 7fbcdfc82700 1 --2- 172.21.15.103:0/3368527538 >> v2:172.21.15.86:3300/0 conn(0x7fbcd80b5ea0 0x7fbcd80bbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:07.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.160+0000 7fbcdfc82700 1 --2- 172.21.15.103:0/3368527538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcd80b9890 0x7fbcd8146bd0 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:07.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.160+0000 7fbcdfc82700 1 -- 172.21.15.103:0/3368527538 >> 172.21.15.103:0/3368527538 conn(0x7fbcd805ad30 msgr2=0x7fbcd812f410 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:07.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.160+0000 7fbcdfc82700 1 -- 172.21.15.103:0/3368527538 shutdown_connections 2020-04-22T14:16:07.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.160+0000 7fbcdfc82700 1 -- 172.21.15.103:0/3368527538 wait complete. 2020-04-22T14:16:07.173 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:07.189 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:16:07.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.334+0000 7fa21f3d8700 1 Processor -- start 2020-04-22T14:16:07.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.334+0000 7fa21f3d8700 1 -- start start 2020-04-22T14:16:07.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.335+0000 7fa21f3d8700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa21805b7c0 0x7fa2180665a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:07.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.335+0000 7fa21f3d8700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa21814a640 0x7fa2181336b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:07.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.335+0000 7fa21f3d8700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa218133b10 0x7fa21814dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:07.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.335+0000 7fa21f3d8700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2180651f0 con 0x7fa21805b7c0 2020-04-22T14:16:07.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.335+0000 7fa21f3d8700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa218066b90 con 0x7fa218133b10 2020-04-22T14:16:07.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.335+0000 7fa21f3d8700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa218066e30 con 0x7fa21814a640 2020-04-22T14:16:07.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.335+0000 7fa21d975700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa218133b10 0x7fa21814dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:07.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.335+0000 7fa21d975700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa218133b10 0x7fa21814dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55882/0 (socket says 172.21.15.103:55882) 2020-04-22T14:16:07.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.335+0000 7fa21d975700 1 -- 172.21.15.103:0/2335430029 learned_addr learned my addr 172.21.15.103:0/2335430029 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:07.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.336+0000 7fa21c973700 1 --2- 172.21.15.103:0/2335430029 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa21814a640 0x7fa2181336b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:07.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.336+0000 7fa21d174700 1 --2- 172.21.15.103:0/2335430029 >> v2:172.21.15.86:3300/0 conn(0x7fa21805b7c0 0x7fa2180665a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:07.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.336+0000 7fa21d975700 1 -- 172.21.15.103:0/2335430029 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa21814a640 msgr2=0x7fa2181336b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:07.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.336+0000 7fa21d975700 1 --2- 172.21.15.103:0/2335430029 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa21814a640 0x7fa2181336b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:07.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.336+0000 7fa21d975700 1 -- 172.21.15.103:0/2335430029 >> v2:172.21.15.86:3300/0 conn(0x7fa21805b7c0 msgr2=0x7fa2180665a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:07.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.336+0000 7fa21d975700 1 --2- 172.21.15.103:0/2335430029 >> v2:172.21.15.86:3300/0 conn(0x7fa21805b7c0 0x7fa2180665a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:07.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.336+0000 7fa21d975700 1 -- 172.21.15.103:0/2335430029 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2180670d0 con 0x7fa218133b10 2020-04-22T14:16:07.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.336+0000 7fa21d975700 1 --2- 172.21.15.103:0/2335430029 >> v2:172.21.15.103:3300/0 conn(0x7fa218133b10 0x7fa21814dc40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa20c002f30 tx=0x7fa20c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:07.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.336+0000 7fa21d975700 1 --2- 172.21.15.103:0/2335430029 >> v2:172.21.15.103:3300/0 conn(0x7fa218133b10 0x7fa21814dc40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa20c002f30 tx=0x7fa20c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:07.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.336+0000 7fa21d975700 1 --2- 172.21.15.103:0/2335430029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa218133b10 0x7fa21814dc40 secure :-1 s=READY pgs=1611 cs=0 l=1 rx=0x7fa20c002f30 tx=0x7fa20c007a40).ready entity=mon.1 client_cookie=84e45c34453396e3 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:07.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.336+0000 7fa21d975700 1 --2- 172.21.15.103:0/2335430029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa218133b10 0x7fa21814dc40 secure :-1 s=THROTTLE_DONE pgs=1611 cs=0 l=1 rx=0x7fa20c002f30 tx=0x7fa20c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:07.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.336+0000 7fa203fff700 1 -- 172.21.15.103:0/2335430029 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa20c011720 con 0x7fa218133b10 2020-04-22T14:16:07.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.336+0000 7fa21d975700 1 --2- 172.21.15.103:0/2335430029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa218133b10 0x7fa21814dc40 secure :-1 s=THROTTLE_DONE pgs=1611 cs=0 l=1 rx=0x7fa20c002f30 tx=0x7fa20c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:07.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.336+0000 7fa203fff700 1 -- 172.21.15.103:0/2335430029 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa20c011880 con 0x7fa218133b10 2020-04-22T14:16:07.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.336+0000 7fa21d975700 1 --2- 172.21.15.103:0/2335430029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa218133b10 0x7fa21814dc40 secure :-1 s=THROTTLE_DONE pgs=1611 cs=0 l=1 rx=0x7fa20c002f30 tx=0x7fa20c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:07.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.336+0000 7fa203fff700 1 -- 172.21.15.103:0/2335430029 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa20c011ca0 con 0x7fa218133b10 2020-04-22T14:16:07.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.336+0000 7fa21f3d8700 1 -- 172.21.15.103:0/2335430029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa218133b10 msgr2=0x7fa21814dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:07.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.336+0000 7fa21f3d8700 1 --2- 172.21.15.103:0/2335430029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa218133b10 0x7fa21814dc40 secure :-1 s=READY pgs=1611 cs=0 l=1 rx=0x7fa20c002f30 tx=0x7fa20c007a40).stop 2020-04-22T14:16:07.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.337+0000 7fa21f3d8700 1 -- 172.21.15.103:0/2335430029 shutdown_connections 2020-04-22T14:16:07.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.337+0000 7fa21f3d8700 1 --2- 172.21.15.103:0/2335430029 >> v2:172.21.15.86:3300/0 conn(0x7fa21805b7c0 0x7fa2180665a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:07.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.337+0000 7fa21f3d8700 1 --2- 172.21.15.103:0/2335430029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa218133b10 0x7fa21814dc40 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:07.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.337+0000 7fa21f3d8700 1 --2- 172.21.15.103:0/2335430029 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa21814a640 0x7fa2181336b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:07.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.337+0000 7fa21f3d8700 1 -- 172.21.15.103:0/2335430029 >> 172.21.15.103:0/2335430029 conn(0x7fa2180b9160 msgr2=0x7fa21805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:07.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.337+0000 7fa21f3d8700 1 -- 172.21.15.103:0/2335430029 shutdown_connections 2020-04-22T14:16:07.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.337+0000 7fa21f3d8700 1 -- 172.21.15.103:0/2335430029 wait complete. 2020-04-22T14:16:07.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.338+0000 7fa21f3d8700 1 Processor -- start 2020-04-22T14:16:07.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.338+0000 7fa21f3d8700 1 -- start start 2020-04-22T14:16:07.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.338+0000 7fa21f3d8700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa21805b7c0 0x7fa2180b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:07.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.338+0000 7fa21f3d8700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa218133b10 0x7fa2180b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:07.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.338+0000 7fa21f3d8700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2180b7d10 con 0x7fa21814a640 2020-04-22T14:16:07.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.338+0000 7fa21f3d8700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2180b2810 con 0x7fa21805b7c0 2020-04-22T14:16:07.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.338+0000 7fa21f3d8700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2180b2ab0 con 0x7fa218133b10 2020-04-22T14:16:07.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.338+0000 7fa21d975700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa21814a640 0x7fa218149870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48082/0 (socket says 172.21.15.103:48082) 2020-04-22T14:16:07.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.338+0000 7fa21d975700 1 -- 172.21.15.103:0/2608853875 learned_addr learned my addr 172.21.15.103:0/2608853875 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:07.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.338+0000 7fa21d174700 1 --2- 172.21.15.103:0/2608853875 >> v2:172.21.15.86:3300/0 conn(0x7fa21805b7c0 0x7fa2180b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:07.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.338+0000 7fa21c973700 1 --2- 172.21.15.103:0/2608853875 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa218133b10 0x7fa2180b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:07.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.339+0000 7fa20affd700 1 -- 172.21.15.103:0/2608853875 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1573177457 0 0) 0x7fa2180670d0 con 0x7fa21814a640 2020-04-22T14:16:07.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.339+0000 7fa20affd700 1 -- 172.21.15.103:0/2608853875 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1f4002fe0 con 0x7fa21814a640 2020-04-22T14:16:07.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.339+0000 7fa21d174700 1 -- 172.21.15.103:0/2608853875 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa218133b10 msgr2=0x7fa2180b1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:07.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.339+0000 7fa20affd700 1 -- 172.21.15.103:0/2608853875 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1642652014 0 0) 0x7fa1f4002fe0 con 0x7fa21814a640 2020-04-22T14:16:07.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.339+0000 7fa21d174700 1 --2- 172.21.15.103:0/2608853875 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa218133b10 0x7fa2180b1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:07.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.339+0000 7fa21d174700 1 -- 172.21.15.103:0/2608853875 >> v1:172.21.15.103:6789/0 conn(0x7fa21814a640 legacy=0x7fa218149870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:07.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.339+0000 7fa21d174700 1 -- 172.21.15.103:0/2608853875 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2180b2d50 con 0x7fa21805b7c0 2020-04-22T14:16:07.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.339+0000 7fa21d174700 1 --2- 172.21.15.103:0/2608853875 >> v2:172.21.15.86:3300/0 conn(0x7fa21805b7c0 0x7fa2180b78b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa20c008780 tx=0x7fa210010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:07.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.339+0000 7fa21d174700 1 --2- 172.21.15.103:0/2608853875 >> v2:172.21.15.86:3300/0 conn(0x7fa21805b7c0 0x7fa2180b78b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa20c008780 tx=0x7fa210010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:07.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.339+0000 7fa21d174700 1 --2- 172.21.15.103:0/2608853875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa21805b7c0 0x7fa2180b78b0 secure :-1 s=READY pgs=857 cs=0 l=1 rx=0x7fa20c008780 tx=0x7fa210010e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:07.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.339+0000 7fa21d174700 1 --2- 172.21.15.103:0/2608853875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa21805b7c0 0x7fa2180b78b0 secure :-1 s=THROTTLE_DONE pgs=857 cs=0 l=1 rx=0x7fa20c008780 tx=0x7fa210010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:07.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.339+0000 7fa20affd700 1 -- 172.21.15.103:0/2608853875 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa20c0085e0 con 0x7fa21805b7c0 2020-04-22T14:16:07.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.339+0000 7fa21d174700 1 --2- 172.21.15.103:0/2608853875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa21805b7c0 0x7fa2180b78b0 secure :-1 s=THROTTLE_DONE pgs=857 cs=0 l=1 rx=0x7fa20c008780 tx=0x7fa210010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:07.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.339+0000 7fa21f3d8700 1 -- 172.21.15.103:0/2608853875 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2180b23d0 con 0x7fa21805b7c0 2020-04-22T14:16:07.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.339+0000 7fa20affd700 1 -- 172.21.15.103:0/2608853875 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa210005e30 con 0x7fa21805b7c0 2020-04-22T14:16:07.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.339+0000 7fa21d174700 1 --2- 172.21.15.103:0/2608853875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa21805b7c0 0x7fa2180b78b0 secure :-1 s=THROTTLE_DONE pgs=857 cs=0 l=1 rx=0x7fa20c008780 tx=0x7fa210010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:07.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.339+0000 7fa20affd700 1 -- 172.21.15.103:0/2608853875 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa210007560 con 0x7fa21805b7c0 2020-04-22T14:16:07.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.339+0000 7fa21f3d8700 1 -- 172.21.15.103:0/2608853875 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2180acb70 con 0x7fa21805b7c0 2020-04-22T14:16:07.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.340+0000 7fa21d174700 1 --2- 172.21.15.103:0/2608853875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa21805b7c0 0x7fa2180b78b0 secure :-1 s=THROTTLE_DONE pgs=857 cs=0 l=1 rx=0x7fa20c008780 tx=0x7fa210010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:07.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.340+0000 7fa21f3d8700 1 -- 172.21.15.103:0/2608853875 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa218056c90 con 0x7fa21805b7c0 2020-04-22T14:16:07.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.340+0000 7fa20affd700 1 -- 172.21.15.103:0/2608853875 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fa210007760 con 0x7fa21805b7c0 2020-04-22T14:16:07.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.340+0000 7fa21d174700 1 --2- 172.21.15.103:0/2608853875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa21805b7c0 0x7fa2180b78b0 secure :-1 s=THROTTLE_DONE pgs=857 cs=0 l=1 rx=0x7fa20c008780 tx=0x7fa210010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:07.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.341+0000 7fa20affd700 1 --2- 172.21.15.103:0/2608853875 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa1f404dc50 0x7fa1f4050110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:07.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.341+0000 7fa20affd700 1 -- 172.21.15.103:0/2608853875 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa210061040 con 0x7fa21805b7c0 2020-04-22T14:16:07.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.341+0000 7fa21c973700 1 --2- 172.21.15.103:0/2608853875 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa1f404dc50 0x7fa1f4050110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:07.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.341+0000 7fa21c973700 1 --2- 172.21.15.103:0/2608853875 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa1f404dc50 0x7fa1f4050110 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa214002f30 tx=0x7fa214006ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:07.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.341+0000 7fa21c973700 1 --2- 172.21.15.103:0/2608853875 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa1f404dc50 0x7fa1f4050110 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa214002f30 tx=0x7fa214006ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:07.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.341+0000 7fa21c973700 1 --2- 172.21.15.103:0/2608853875 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa1f404dc50 0x7fa1f4050110 secure :-1 s=READY pgs=586 cs=0 l=1 rx=0x7fa214002f30 tx=0x7fa214006ed0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:07.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.344+0000 7fa21d174700 1 --2- 172.21.15.103:0/2608853875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa21805b7c0 0x7fa2180b78b0 secure :-1 s=THROTTLE_DONE pgs=857 cs=0 l=1 rx=0x7fa20c008780 tx=0x7fa210010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:07.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.344+0000 7fa20affd700 1 -- 172.21.15.103:0/2608853875 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fa21003c480 con 0x7fa21805b7c0 2020-04-22T14:16:07.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.533+0000 7fa21f3d8700 1 -- 172.21.15.103:0/2608853875 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa21805bba0 con 0x7fa21805b7c0 2020-04-22T14:16:07.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.533+0000 7fa21d174700 1 --2- 172.21.15.103:0/2608853875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa21805b7c0 0x7fa2180b78b0 secure :-1 s=THROTTLE_DONE pgs=857 cs=0 l=1 rx=0x7fa20c008780 tx=0x7fa210010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:07.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.533+0000 7fa20affd700 1 -- 172.21.15.103:0/2608853875 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+2143 (secure 0 0 0) 0x7fa21003faa0 con 0x7fa21805b7c0 2020-04-22T14:16:07.536 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:16:07.536 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":82,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7776,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/3450302561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3450302561},{"type":"v1","addr":"172.21.15.86:6835","nonce":3450302561}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":78}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:16:05.150517+0000","modified":"2020-04-22T14:16:07.155780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8470":{"gid":8470,"name":"a","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/3949453152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3949453152},{"type":"v1","addr":"172.21.15.103:6833","nonce":3949453152}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2020-04-22T14:16:07.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.535+0000 7fa21f3d8700 1 -- 172.21.15.103:0/2608853875 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa1f404dc50 msgr2=0x7fa1f4050110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:07.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.535+0000 7fa21f3d8700 1 --2- 172.21.15.103:0/2608853875 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa1f404dc50 0x7fa1f4050110 secure :-1 s=READY pgs=586 cs=0 l=1 rx=0x7fa214002f30 tx=0x7fa214006ed0).stop 2020-04-22T14:16:07.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.535+0000 7fa21f3d8700 1 -- 172.21.15.103:0/2608853875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa21805b7c0 msgr2=0x7fa2180b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:07.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.535+0000 7fa21f3d8700 1 --2- 172.21.15.103:0/2608853875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa21805b7c0 0x7fa2180b78b0 secure :-1 s=READY pgs=857 cs=0 l=1 rx=0x7fa20c008780 tx=0x7fa210010e60).stop 2020-04-22T14:16:07.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.535+0000 7fa21f3d8700 1 -- 172.21.15.103:0/2608853875 shutdown_connections 2020-04-22T14:16:07.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.535+0000 7fa21f3d8700 1 --2- 172.21.15.103:0/2608853875 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa1f404dc50 0x7fa1f4050110 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:07.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.535+0000 7fa21f3d8700 1 --2- 172.21.15.103:0/2608853875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa21805b7c0 0x7fa2180b78b0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:07.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.535+0000 7fa21f3d8700 1 --2- 172.21.15.103:0/2608853875 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa218133b10 0x7fa2180b1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:07.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.535+0000 7fa21f3d8700 1 -- 172.21.15.103:0/2608853875 >> 172.21.15.103:0/2608853875 conn(0x7fa2180b9160 msgr2=0x7fa2181323f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:07.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.535+0000 7fa21f3d8700 1 -- 172.21.15.103:0/2608853875 shutdown_connections 2020-04-22T14:16:07.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.535+0000 7fa21f3d8700 1 -- 172.21.15.103:0/2608853875 wait complete. 2020-04-22T14:16:07.542 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 82 2020-04-22T14:16:07.548 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:07.561 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:16:07.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.706+0000 7f28c4c98700 1 Processor -- start 2020-04-22T14:16:07.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.706+0000 7f28c4c98700 1 -- start start 2020-04-22T14:16:07.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.707+0000 7f28c4c98700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f28c0062650 0x7f28c005fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:07.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.707+0000 7f28c4c98700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f28c013de20 0x7f28c013e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:07.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.707+0000 7f28c4c98700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28c013e6f0 con 0x7f28c0065fe0 2020-04-22T14:16:07.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.707+0000 7f28c4c98700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28c01451f0 con 0x7f28c013de20 2020-04-22T14:16:07.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.707+0000 7f28c4c98700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c01441b0 con 0x7f28c0062650 2020-04-22T14:16:07.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.708+0000 7f28bed9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f28c013de20 0x7f28c013e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:07.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.708+0000 7f28bdd9b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f28c0062650 0x7f28c005fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:07.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.708+0000 7f28bed9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f28c013de20 0x7f28c013e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:53128/0 (socket says 172.21.15.103:53128) 2020-04-22T14:16:07.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.708+0000 7f28bdd9b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f28c0062650 0x7f28c005fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:40674/0 (socket says 172.21.15.103:40674) 2020-04-22T14:16:07.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.708+0000 7f28bed9d700 1 -- 172.21.15.103:0/3295983656 learned_addr learned my addr 172.21.15.103:0/3295983656 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:07.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.708+0000 7f28bed9d700 1 -- 172.21.15.103:0/3295983656 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f28c0062650 msgr2=0x7f28c005fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:07.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.708+0000 7f28bed9d700 1 --2- 172.21.15.103:0/3295983656 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f28c0062650 0x7f28c005fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:07.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.708+0000 7f28bed9d700 1 -- 172.21.15.103:0/3295983656 >> v1:172.21.15.86:6789/0 conn(0x7f28c0065fe0 legacy=0x7f28c0144ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:07.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.708+0000 7f28bed9d700 1 -- 172.21.15.103:0/3295983656 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c01443a0 con 0x7f28c013de20 2020-04-22T14:16:07.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.708+0000 7f28bd59a700 1 -- 172.21.15.103:0/3295983656 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1792099308 0 0) 0x7f28c013e6f0 con 0x7f28c0065fe0 2020-04-22T14:16:07.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.708+0000 7f28bed9d700 1 --2- 172.21.15.103:0/3295983656 >> v2:172.21.15.86:3300/0 conn(0x7f28c013de20 0x7f28c013e290 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f28b80032b0 tx=0x7f28b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:07.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.708+0000 7f28bed9d700 1 --2- 172.21.15.103:0/3295983656 >> v2:172.21.15.86:3300/0 conn(0x7f28c013de20 0x7f28c013e290 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f28b80032b0 tx=0x7f28b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:07.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.708+0000 7f28bed9d700 1 --2- 172.21.15.103:0/3295983656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28c013de20 0x7f28c013e290 secure :-1 s=READY pgs=859 cs=0 l=1 rx=0x7f28b80032b0 tx=0x7f28b8007dc0).ready entity=mon.0 client_cookie=c71d41ed8734f3e2 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:07.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.708+0000 7f28bed9d700 1 --2- 172.21.15.103:0/3295983656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28c013de20 0x7f28c013e290 secure :-1 s=THROTTLE_DONE pgs=859 cs=0 l=1 rx=0x7f28b80032b0 tx=0x7f28b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:07.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.708+0000 7f28bd59a700 1 -- 172.21.15.103:0/3295983656 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28b800a180 con 0x7f28c013de20 2020-04-22T14:16:07.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.709+0000 7f28bed9d700 1 --2- 172.21.15.103:0/3295983656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28c013de20 0x7f28c013e290 secure :-1 s=THROTTLE_DONE pgs=859 cs=0 l=1 rx=0x7f28b80032b0 tx=0x7f28b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:07.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.709+0000 7f28bd59a700 1 -- 172.21.15.103:0/3295983656 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b800a320 con 0x7f28c013de20 2020-04-22T14:16:07.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.709+0000 7f28bed9d700 1 --2- 172.21.15.103:0/3295983656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28c013de20 0x7f28c013e290 secure :-1 s=THROTTLE_DONE pgs=859 cs=0 l=1 rx=0x7f28b80032b0 tx=0x7f28b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:07.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.709+0000 7f28bd59a700 1 -- 172.21.15.103:0/3295983656 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28b800a700 con 0x7f28c013de20 2020-04-22T14:16:07.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.709+0000 7f28c4c98700 1 -- 172.21.15.103:0/3295983656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28c013de20 msgr2=0x7f28c013e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:07.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.709+0000 7f28c4c98700 1 --2- 172.21.15.103:0/3295983656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28c013de20 0x7f28c013e290 secure :-1 s=READY pgs=859 cs=0 l=1 rx=0x7f28b80032b0 tx=0x7f28b8007dc0).stop 2020-04-22T14:16:07.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.709+0000 7f28c4c98700 1 -- 172.21.15.103:0/3295983656 shutdown_connections 2020-04-22T14:16:07.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.709+0000 7f28c4c98700 1 --2- 172.21.15.103:0/3295983656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28c013de20 0x7f28c013e290 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:07.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.709+0000 7f28c4c98700 1 --2- 172.21.15.103:0/3295983656 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f28c0062650 0x7f28c005fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:07.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.709+0000 7f28c4c98700 1 -- 172.21.15.103:0/3295983656 >> 172.21.15.103:0/3295983656 conn(0x7f28c005f2c0 msgr2=0x7f28c0066e20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:07.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.709+0000 7f28c4c98700 1 -- 172.21.15.103:0/3295983656 shutdown_connections 2020-04-22T14:16:07.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.709+0000 7f28c4c98700 1 -- 172.21.15.103:0/3295983656 wait complete. 2020-04-22T14:16:07.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.710+0000 7f28c4c98700 1 Processor -- start 2020-04-22T14:16:07.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.710+0000 7f28c4c98700 1 -- start start 2020-04-22T14:16:07.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.711+0000 7f28c4c98700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f28c0065fe0 0x7f28c0143560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:07.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.711+0000 7f28c4c98700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f28c013de20 0x7f28c013c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:07.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.711+0000 7f28c4c98700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28c01423e0 con 0x7f28c0062650 2020-04-22T14:16:07.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.711+0000 7f28c4c98700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28c01400f0 con 0x7f28c0065fe0 2020-04-22T14:16:07.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.711+0000 7f28c4c98700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28c0141450 con 0x7f28c013de20 2020-04-22T14:16:07.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.711+0000 7f28bed9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f28c013de20 0x7f28c013c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:07.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.711+0000 7f28bed9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f28c013de20 0x7f28c013c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55906/0 (socket says 172.21.15.103:55906) 2020-04-22T14:16:07.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.711+0000 7f28bed9d700 1 -- 172.21.15.103:0/588796420 learned_addr learned my addr 172.21.15.103:0/588796420 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:07.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.711+0000 7f28bdd9b700 1 --2- 172.21.15.103:0/588796420 >> v2:172.21.15.86:3300/0 conn(0x7f28c0065fe0 0x7f28c0143560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:07.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.711+0000 7f28bed9d700 1 -- 172.21.15.103:0/588796420 >> v2:172.21.15.86:3300/0 conn(0x7f28c0065fe0 msgr2=0x7f28c0143560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:07.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.711+0000 7f28bed9d700 1 --2- 172.21.15.103:0/588796420 >> v2:172.21.15.86:3300/0 conn(0x7f28c0065fe0 0x7f28c0143560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:07.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.711+0000 7f28bed9d700 1 -- 172.21.15.103:0/588796420 >> v1:172.21.15.86:6789/0 conn(0x7f28c0062650 legacy=0x7f28c013be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:07.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.711+0000 7f28bed9d700 1 -- 172.21.15.103:0/588796420 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c013fe50 con 0x7f28c013de20 2020-04-22T14:16:07.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.711+0000 7f28bed9d700 1 --2- 172.21.15.103:0/588796420 >> v2:172.21.15.103:3300/0 conn(0x7f28c013de20 0x7f28c013c550 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f28c00ad490 tx=0x7f28b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:07.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.711+0000 7f28bed9d700 1 --2- 172.21.15.103:0/588796420 >> v2:172.21.15.103:3300/0 conn(0x7f28c013de20 0x7f28c013c550 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f28c00ad490 tx=0x7f28b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:07.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.711+0000 7f28bed9d700 1 --2- 172.21.15.103:0/588796420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28c013de20 0x7f28c013c550 secure :-1 s=READY pgs=1613 cs=0 l=1 rx=0x7f28c00ad490 tx=0x7f28b8007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:07.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.711+0000 7f28bed9d700 1 --2- 172.21.15.103:0/588796420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28c013de20 0x7f28c013c550 secure :-1 s=THROTTLE_DONE pgs=1613 cs=0 l=1 rx=0x7f28c00ad490 tx=0x7f28b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:07.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.711+0000 7f28af7fe700 1 -- 172.21.15.103:0/588796420 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28b800a790 con 0x7f28c013de20 2020-04-22T14:16:07.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.711+0000 7f28bed9d700 1 --2- 172.21.15.103:0/588796420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28c013de20 0x7f28c013c550 secure :-1 s=THROTTLE_DONE pgs=1613 cs=0 l=1 rx=0x7f28c00ad490 tx=0x7f28b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:07.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.711+0000 7f28c4c98700 1 -- 172.21.15.103:0/588796420 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28c0142840 con 0x7f28c013de20 2020-04-22T14:16:07.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.711+0000 7f28bed9d700 1 --2- 172.21.15.103:0/588796420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28c013de20 0x7f28c013c550 secure :-1 s=THROTTLE_DONE pgs=1613 cs=0 l=1 rx=0x7f28c00ad490 tx=0x7f28b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:07.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.711+0000 7f28af7fe700 1 -- 172.21.15.103:0/588796420 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b8008a30 con 0x7f28c013de20 2020-04-22T14:16:07.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.711+0000 7f28af7fe700 1 -- 172.21.15.103:0/588796420 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28b8005e20 con 0x7f28c013de20 2020-04-22T14:16:07.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.711+0000 7f28c4c98700 1 -- 172.21.15.103:0/588796420 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28c0141ea0 con 0x7f28c013de20 2020-04-22T14:16:07.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.712+0000 7f28bed9d700 1 --2- 172.21.15.103:0/588796420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28c013de20 0x7f28c013c550 secure :-1 s=THROTTLE_DONE pgs=1613 cs=0 l=1 rx=0x7f28c00ad490 tx=0x7f28b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:07.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.712+0000 7f28af7fe700 1 -- 172.21.15.103:0/588796420 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f28b800f5b0 con 0x7f28c013de20 2020-04-22T14:16:07.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.712+0000 7f28bed9d700 1 --2- 172.21.15.103:0/588796420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28c013de20 0x7f28c013c550 secure :-1 s=THROTTLE_DONE pgs=1613 cs=0 l=1 rx=0x7f28c00ad490 tx=0x7f28b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:07.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.712+0000 7f28c4c98700 1 -- 172.21.15.103:0/588796420 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28c0056c90 con 0x7f28c013de20 2020-04-22T14:16:07.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.713+0000 7f28af7fe700 1 --2- 172.21.15.103:0/588796420 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f289c04d9d0 0x7f289c04fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:07.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.713+0000 7f28af7fe700 1 -- 172.21.15.103:0/588796420 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f28b8062420 con 0x7f28c013de20 2020-04-22T14:16:07.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.713+0000 7f28be59c700 1 --2- 172.21.15.103:0/588796420 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f289c04d9d0 0x7f289c04fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:07.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.713+0000 7f28be59c700 1 --2- 172.21.15.103:0/588796420 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f289c04d9d0 0x7f289c04fe90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f28b4000b80 tx=0x7f28b4001470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:07.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.713+0000 7f28be59c700 1 --2- 172.21.15.103:0/588796420 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f289c04d9d0 0x7f289c04fe90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f28b4000b80 tx=0x7f28b4001470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:07.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.713+0000 7f28be59c700 1 --2- 172.21.15.103:0/588796420 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f289c04d9d0 0x7f289c04fe90 secure :-1 s=READY pgs=587 cs=0 l=1 rx=0x7f28b4000b80 tx=0x7f28b4001470).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:07.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.717+0000 7f28bed9d700 1 --2- 172.21.15.103:0/588796420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28c013de20 0x7f28c013c550 secure :-1 s=THROTTLE_DONE pgs=1613 cs=0 l=1 rx=0x7f28c00ad490 tx=0x7f28b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:07.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.717+0000 7f28af7fe700 1 -- 172.21.15.103:0/588796420 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f28b803d860 con 0x7f28c013de20 2020-04-22T14:16:07.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.859+0000 7f28c4c98700 1 -- 172.21.15.103:0/588796420 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28c00669c0 con 0x7f28c013de20 2020-04-22T14:16:07.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.860+0000 7f28bed9d700 1 --2- 172.21.15.103:0/588796420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28c013de20 0x7f28c013c550 secure :-1 s=THROTTLE_DONE pgs=1613 cs=0 l=1 rx=0x7f28c00ad490 tx=0x7f28b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:07.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.860+0000 7f28af7fe700 1 -- 172.21.15.103:0/588796420 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+16103 (secure 0 0 0) 0x7f28b8040e80 con 0x7f28c013de20 2020-04-22T14:16:07.862 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:16:07.863 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":113,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:16:06.152090+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:16:02.890350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2020-04-22T14:16:03.893169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:16:07.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.861+0000 7f28c4c98700 1 -- 172.21.15.103:0/588796420 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f289c04d9d0 msgr2=0x7f289c04fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:07.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.861+0000 7f28c4c98700 1 --2- 172.21.15.103:0/588796420 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f289c04d9d0 0x7f289c04fe90 secure :-1 s=READY pgs=587 cs=0 l=1 rx=0x7f28b4000b80 tx=0x7f28b4001470).stop 2020-04-22T14:16:07.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.861+0000 7f28c4c98700 1 -- 172.21.15.103:0/588796420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28c013de20 msgr2=0x7f28c013c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:07.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.861+0000 7f28c4c98700 1 --2- 172.21.15.103:0/588796420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28c013de20 0x7f28c013c550 secure :-1 s=READY pgs=1613 cs=0 l=1 rx=0x7f28c00ad490 tx=0x7f28b8007dc0).stop 2020-04-22T14:16:07.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.861+0000 7f28c4c98700 1 -- 172.21.15.103:0/588796420 shutdown_connections 2020-04-22T14:16:07.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.861+0000 7f28c4c98700 1 --2- 172.21.15.103:0/588796420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28c013de20 0x7f28c013c550 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:07.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.861+0000 7f28c4c98700 1 --2- 172.21.15.103:0/588796420 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f289c04d9d0 0x7f289c04fe90 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:07.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.861+0000 7f28c4c98700 1 --2- 172.21.15.103:0/588796420 >> v2:172.21.15.86:3300/0 conn(0x7f28c0065fe0 0x7f28c0143560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:07.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.861+0000 7f28c4c98700 1 -- 172.21.15.103:0/588796420 >> 172.21.15.103:0/588796420 conn(0x7f28c005f2c0 msgr2=0x7f28c0144a00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:07.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.861+0000 7f28c4c98700 1 -- 172.21.15.103:0/588796420 shutdown_connections 2020-04-22T14:16:07.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:07.861+0000 7f28c4c98700 1 -- 172.21.15.103:0/588796420 wait complete. 2020-04-22T14:16:07.875 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:07.889 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:16:08.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.038+0000 7f081359e700 1 Processor -- start 2020-04-22T14:16:08.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.038+0000 7f081359e700 1 -- start start 2020-04-22T14:16:08.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.039+0000 7f081359e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f08140666e0 0x7f08140633c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:08.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.039+0000 7f081359e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f08140b9880 0x7f08140b9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:08.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.039+0000 7f081359e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0814154fe0 0x7f0814155410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:08.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.039+0000 7f081359e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0814025b90 con 0x7f08140b9880 2020-04-22T14:16:08.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.039+0000 7f081359e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0814066ac0 con 0x7f0814154fe0 2020-04-22T14:16:08.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.039+0000 7f081359e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0814024ea0 con 0x7f08140666e0 2020-04-22T14:16:08.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.039+0000 7f0818835700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0814154fe0 0x7f0814155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:08.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.039+0000 7f0818835700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0814154fe0 0x7f0814155410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55910/0 (socket says 172.21.15.103:55910) 2020-04-22T14:16:08.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.039+0000 7f0818835700 1 -- 172.21.15.103:0/2239073257 learned_addr learned my addr 172.21.15.103:0/2239073257 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:08.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.039+0000 7f0812d9d700 1 --2- 172.21.15.103:0/2239073257 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f08140666e0 0x7f08140633c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:08.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.039+0000 7f081259c700 1 --2- 172.21.15.103:0/2239073257 >> v2:172.21.15.86:3300/0 conn(0x7f08140b9880 0x7f08140b9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:08.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.040+0000 7f0818835700 1 -- 172.21.15.103:0/2239073257 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f08140666e0 msgr2=0x7f08140633c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:08.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.040+0000 7f0818835700 1 --2- 172.21.15.103:0/2239073257 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f08140666e0 0x7f08140633c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:08.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.040+0000 7f0818835700 1 -- 172.21.15.103:0/2239073257 >> v2:172.21.15.86:3300/0 conn(0x7f08140b9880 msgr2=0x7f08140b9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:08.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.040+0000 7f0818835700 1 --2- 172.21.15.103:0/2239073257 >> v2:172.21.15.86:3300/0 conn(0x7f08140b9880 0x7f08140b9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:08.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.040+0000 7f0818835700 1 -- 172.21.15.103:0/2239073257 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0814024c00 con 0x7f0814154fe0 2020-04-22T14:16:08.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.040+0000 7f081259c700 1 --2- 172.21.15.103:0/2239073257 >> v2:172.21.15.86:3300/0 conn(0x7f08140b9880 0x7f08140b9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:16:08.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.040+0000 7f0818835700 1 --2- 172.21.15.103:0/2239073257 >> v2:172.21.15.103:3300/0 conn(0x7f0814154fe0 0x7f0814155410 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f080c0032b0 tx=0x7f080c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.040+0000 7f0818835700 1 --2- 172.21.15.103:0/2239073257 >> v2:172.21.15.103:3300/0 conn(0x7f0814154fe0 0x7f0814155410 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f080c0032b0 tx=0x7f080c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.040+0000 7f0818835700 1 --2- 172.21.15.103:0/2239073257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0814154fe0 0x7f0814155410 secure :-1 s=READY pgs=1614 cs=0 l=1 rx=0x7f080c0032b0 tx=0x7f080c007dc0).ready entity=mon.1 client_cookie=a8c86210541d42f1 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:08.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.040+0000 7f0818835700 1 --2- 172.21.15.103:0/2239073257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0814154fe0 0x7f0814155410 secure :-1 s=THROTTLE_DONE pgs=1614 cs=0 l=1 rx=0x7f080c0032b0 tx=0x7f080c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.040+0000 7f0811d9b700 1 -- 172.21.15.103:0/2239073257 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f080c00a180 con 0x7f0814154fe0 2020-04-22T14:16:08.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.040+0000 7f0818835700 1 --2- 172.21.15.103:0/2239073257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0814154fe0 0x7f0814155410 secure :-1 s=THROTTLE_DONE pgs=1614 cs=0 l=1 rx=0x7f080c0032b0 tx=0x7f080c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.040+0000 7f0818835700 1 --2- 172.21.15.103:0/2239073257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0814154fe0 0x7f0814155410 secure :-1 s=THROTTLE_DONE pgs=1614 cs=0 l=1 rx=0x7f080c0032b0 tx=0x7f080c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.040+0000 7f0811d9b700 1 -- 172.21.15.103:0/2239073257 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080c00a2e0 con 0x7f0814154fe0 2020-04-22T14:16:08.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.040+0000 7f0811d9b700 1 -- 172.21.15.103:0/2239073257 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f080c00a700 con 0x7f0814154fe0 2020-04-22T14:16:08.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.040+0000 7f081359e700 1 -- 172.21.15.103:0/2239073257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0814154fe0 msgr2=0x7f0814155410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:08.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.040+0000 7f081359e700 1 --2- 172.21.15.103:0/2239073257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0814154fe0 0x7f0814155410 secure :-1 s=READY pgs=1614 cs=0 l=1 rx=0x7f080c0032b0 tx=0x7f080c007dc0).stop 2020-04-22T14:16:08.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.040+0000 7f081359e700 1 -- 172.21.15.103:0/2239073257 shutdown_connections 2020-04-22T14:16:08.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.040+0000 7f081359e700 1 --2- 172.21.15.103:0/2239073257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0814154fe0 0x7f0814155410 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:08.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.040+0000 7f081359e700 1 --2- 172.21.15.103:0/2239073257 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f08140666e0 0x7f08140633c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:08.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.040+0000 7f081359e700 1 --2- 172.21.15.103:0/2239073257 >> v2:172.21.15.86:3300/0 conn(0x7f08140b9880 0x7f08140b9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:08.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.040+0000 7f081359e700 1 -- 172.21.15.103:0/2239073257 >> 172.21.15.103:0/2239073257 conn(0x7f0814060930 msgr2=0x7f0814060d40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:08.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.040+0000 7f081359e700 1 -- 172.21.15.103:0/2239073257 shutdown_connections 2020-04-22T14:16:08.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.040+0000 7f081359e700 1 -- 172.21.15.103:0/2239073257 wait complete. 2020-04-22T14:16:08.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.042+0000 7f081359e700 1 Processor -- start 2020-04-22T14:16:08.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.042+0000 7f081359e700 1 -- start start 2020-04-22T14:16:08.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.042+0000 7f081359e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0814154fe0 0x7f081406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:08.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.042+0000 7f081359e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0814072210 con 0x7f08140666e0 2020-04-22T14:16:08.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.042+0000 7f081359e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0814143380 con 0x7f08140b9880 2020-04-22T14:16:08.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.042+0000 7f081359e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0814071830 con 0x7f0814154fe0 2020-04-22T14:16:08.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.042+0000 7f081259c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f08140b9880 0x7f0814142c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48106/0 (socket says 172.21.15.103:48106) 2020-04-22T14:16:08.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.042+0000 7f081259c700 1 -- 172.21.15.103:0/3139854953 learned_addr learned my addr 172.21.15.103:0/3139854953 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:08.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.042+0000 7f0818835700 1 --2- 172.21.15.103:0/3139854953 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0814154fe0 0x7f081406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:08.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.043+0000 7f08037fe700 1 -- 172.21.15.103:0/3139854953 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1593980613 0 0) 0x7f0814143380 con 0x7f08140b9880 2020-04-22T14:16:08.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.043+0000 7f08037fe700 1 -- 172.21.15.103:0/3139854953 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07f8003230 con 0x7f08140b9880 2020-04-22T14:16:08.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.043+0000 7f08037fe700 1 -- 172.21.15.103:0/3139854953 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 269521871 0 0) 0x7f0814072210 con 0x7f08140666e0 2020-04-22T14:16:08.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.043+0000 7f08037fe700 1 -- 172.21.15.103:0/3139854953 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0814143380 con 0x7f08140666e0 2020-04-22T14:16:08.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.043+0000 7f0818835700 1 -- 172.21.15.103:0/3139854953 >> v1:172.21.15.103:6789/0 conn(0x7f08140b9880 legacy=0x7f0814142c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:08.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.043+0000 7f0818835700 1 -- 172.21.15.103:0/3139854953 >> v1:172.21.15.86:6789/0 conn(0x7f08140666e0 legacy=0x7f0814142560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:08.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.043+0000 7f0818835700 1 -- 172.21.15.103:0/3139854953 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0814071ad0 con 0x7f0814154fe0 2020-04-22T14:16:08.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.043+0000 7f0818835700 1 --2- 172.21.15.103:0/3139854953 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0814154fe0 0x7f081406fc90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f080c0032b0 tx=0x7f080c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.043+0000 7f0818835700 1 --2- 172.21.15.103:0/3139854953 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0814154fe0 0x7f081406fc90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f080c0032b0 tx=0x7f080c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.043+0000 7f0818835700 1 --2- 172.21.15.103:0/3139854953 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0814154fe0 0x7f081406fc90 secure :-1 s=READY pgs=153 cs=0 l=1 rx=0x7f080c0032b0 tx=0x7f080c007dc0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:08.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.043+0000 7f0818835700 1 --2- 172.21.15.103:0/3139854953 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0814154fe0 0x7f081406fc90 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7f080c0032b0 tx=0x7f080c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.043+0000 7f08037fe700 1 -- 172.21.15.103:0/3139854953 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f080c010640 con 0x7f0814154fe0 2020-04-22T14:16:08.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.043+0000 7f0818835700 1 --2- 172.21.15.103:0/3139854953 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0814154fe0 0x7f081406fc90 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7f080c0032b0 tx=0x7f080c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.043+0000 7f0818835700 1 --2- 172.21.15.103:0/3139854953 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0814154fe0 0x7f081406fc90 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7f080c0032b0 tx=0x7f080c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.043+0000 7f08037fe700 1 -- 172.21.15.103:0/3139854953 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080c005c30 con 0x7f0814154fe0 2020-04-22T14:16:08.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.043+0000 7f08037fe700 1 -- 172.21.15.103:0/3139854953 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f080c007170 con 0x7f0814154fe0 2020-04-22T14:16:08.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.043+0000 7f081359e700 1 -- 172.21.15.103:0/3139854953 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0814071d70 con 0x7f0814154fe0 2020-04-22T14:16:08.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.043+0000 7f081359e700 1 -- 172.21.15.103:0/3139854953 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08140656c0 con 0x7f0814154fe0 2020-04-22T14:16:08.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.044+0000 7f0818835700 1 --2- 172.21.15.103:0/3139854953 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0814154fe0 0x7f081406fc90 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7f080c0032b0 tx=0x7f080c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.044+0000 7f08037fe700 1 -- 172.21.15.103:0/3139854953 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f080c007370 con 0x7f0814154fe0 2020-04-22T14:16:08.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.044+0000 7f0818835700 1 --2- 172.21.15.103:0/3139854953 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0814154fe0 0x7f081406fc90 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7f080c0032b0 tx=0x7f080c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.044+0000 7f081359e700 1 -- 172.21.15.103:0/3139854953 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0814071f00 con 0x7f0814154fe0 2020-04-22T14:16:08.059 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.045+0000 7f08037fe700 1 --2- 172.21.15.103:0/3139854953 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f07f804ddf0 0x7f07f80502b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:08.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.045+0000 7f08037fe700 1 -- 172.21.15.103:0/3139854953 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f080c062160 con 0x7f0814154fe0 2020-04-22T14:16:08.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.045+0000 7f0812d9d700 1 --2- 172.21.15.103:0/3139854953 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f07f804ddf0 0x7f07f80502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:08.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.045+0000 7f0812d9d700 1 --2- 172.21.15.103:0/3139854953 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f07f804ddf0 0x7f07f80502b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0804002ef0 tx=0x7f0804008020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.045+0000 7f0812d9d700 1 --2- 172.21.15.103:0/3139854953 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f07f804ddf0 0x7f07f80502b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0804002ef0 tx=0x7f0804008020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.045+0000 7f0812d9d700 1 --2- 172.21.15.103:0/3139854953 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f07f804ddf0 0x7f07f80502b0 secure :-1 s=READY pgs=588 cs=0 l=1 rx=0x7f0804002ef0 tx=0x7f0804008020).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:08.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.048+0000 7f0818835700 1 --2- 172.21.15.103:0/3139854953 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0814154fe0 0x7f081406fc90 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7f080c0032b0 tx=0x7f080c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.048+0000 7f08037fe700 1 -- 172.21.15.103:0/3139854953 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f080c03d660 con 0x7f0814154fe0 2020-04-22T14:16:08.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.238+0000 7f081359e700 1 -- 172.21.15.103:0/3139854953 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f0814056c90 con 0x7f0814154fe0 2020-04-22T14:16:08.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.243+0000 7f0818835700 1 --2- 172.21.15.103:0/3139854953 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0814154fe0 0x7f081406fc90 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7f080c0032b0 tx=0x7f080c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.243+0000 7f08037fe700 1 -- 172.21.15.103:0/3139854953 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v41) v1 ==== 184+0+0 (secure 0 0 0) 0x7f080c040c80 con 0x7f0814154fe0 2020-04-22T14:16:08.247 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.245+0000 7f081359e700 1 -- 172.21.15.103:0/3139854953 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f07f804ddf0 msgr2=0x7f07f80502b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:08.247 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.245+0000 7f081359e700 1 --2- 172.21.15.103:0/3139854953 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f07f804ddf0 0x7f07f80502b0 secure :-1 s=READY pgs=588 cs=0 l=1 rx=0x7f0804002ef0 tx=0x7f0804008020).stop 2020-04-22T14:16:08.247 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.245+0000 7f081359e700 1 -- 172.21.15.103:0/3139854953 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0814154fe0 msgr2=0x7f081406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:08.248 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.245+0000 7f081359e700 1 --2- 172.21.15.103:0/3139854953 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0814154fe0 0x7f081406fc90 secure :-1 s=READY pgs=153 cs=0 l=1 rx=0x7f080c0032b0 tx=0x7f080c007dc0).stop 2020-04-22T14:16:08.248 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.245+0000 7f081359e700 1 -- 172.21.15.103:0/3139854953 shutdown_connections 2020-04-22T14:16:08.248 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.245+0000 7f081359e700 1 --2- 172.21.15.103:0/3139854953 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f07f804ddf0 0x7f07f80502b0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:08.248 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.245+0000 7f081359e700 1 --2- 172.21.15.103:0/3139854953 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0814154fe0 0x7f081406fc90 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:08.248 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.245+0000 7f081359e700 1 -- 172.21.15.103:0/3139854953 >> 172.21.15.103:0/3139854953 conn(0x7f0814060930 msgr2=0x7f081407ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:08.249 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.245+0000 7f081359e700 1 -- 172.21.15.103:0/3139854953 shutdown_connections 2020-04-22T14:16:08.249 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.245+0000 7f081359e700 1 -- 172.21.15.103:0/3139854953 wait complete. 2020-04-22T14:16:08.249 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.0 2020-04-22T14:16:08.257 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:08.271 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:16:08.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.421+0000 7f0cf8d11700 1 Processor -- start 2020-04-22T14:16:08.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.421+0000 7f0cf8d11700 1 -- start start 2020-04-22T14:16:08.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.421+0000 7f0cf8d11700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0cf40666e0 0x7f0cf40633c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:08.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.421+0000 7f0cf8d11700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0cf40b6f00 0x7f0cf40b9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:08.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.421+0000 7f0cf8d11700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cf4025b90 con 0x7f0cf40b9880 2020-04-22T14:16:08.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.421+0000 7f0cf8d11700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf4066ac0 con 0x7f0cf40666e0 2020-04-22T14:16:08.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.421+0000 7f0cf8d11700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf4024ea0 con 0x7f0cf40b6f00 2020-04-22T14:16:08.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.422+0000 7f0cf9f73700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0cf40b6f00 0x7f0cf40b9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:08.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.422+0000 7f0cf3fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0cf40666e0 0x7f0cf40633c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:08.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.422+0000 7f0cf9f73700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0cf40b6f00 0x7f0cf40b9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:40702/0 (socket says 172.21.15.103:40702) 2020-04-22T14:16:08.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.422+0000 7f0cf3fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0cf40666e0 0x7f0cf40633c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:53154/0 (socket says 172.21.15.103:53154) 2020-04-22T14:16:08.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.422+0000 7f0cf9f73700 1 -- 172.21.15.103:0/1034316968 learned_addr learned my addr 172.21.15.103:0/1034316968 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:08.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.422+0000 7f0cebfff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f0cf40b9880 0x7f0cf4154fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:37036/0 (socket says 172.21.15.103:37036) 2020-04-22T14:16:08.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.422+0000 7f0cf37fe700 1 -- 172.21.15.103:0/1034316968 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4274687519 0 0) 0x7f0cf4025b90 con 0x7f0cf40b9880 2020-04-22T14:16:08.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.422+0000 7f0cf37fe700 1 -- 172.21.15.103:0/1034316968 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ce0003230 con 0x7f0cf40b9880 2020-04-22T14:16:08.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.422+0000 7f0cf3fff700 1 -- 172.21.15.103:0/1034316968 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0cf40b6f00 msgr2=0x7f0cf40b9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:08.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.422+0000 7f0cf3fff700 1 --2- 172.21.15.103:0/1034316968 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0cf40b6f00 0x7f0cf40b9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:08.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.422+0000 7f0cf3fff700 1 -- 172.21.15.103:0/1034316968 >> v1:172.21.15.86:6789/0 conn(0x7f0cf40b9880 legacy=0x7f0cf4154fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:08.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.422+0000 7f0cf3fff700 1 -- 172.21.15.103:0/1034316968 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf4024c00 con 0x7f0cf40666e0 2020-04-22T14:16:08.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.422+0000 7f0cf9f73700 1 --2- 172.21.15.103:0/1034316968 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0cf40b6f00 0x7f0cf40b9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:16:08.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.422+0000 7f0cf3fff700 1 --2- 172.21.15.103:0/1034316968 >> v2:172.21.15.86:3300/0 conn(0x7f0cf40666e0 0x7f0cf40633c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0ce4002f30 tx=0x7f0ce4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.422+0000 7f0cf3fff700 1 --2- 172.21.15.103:0/1034316968 >> v2:172.21.15.86:3300/0 conn(0x7f0cf40666e0 0x7f0cf40633c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0ce4002f30 tx=0x7f0ce4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.422+0000 7f0cf3fff700 1 --2- 172.21.15.103:0/1034316968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0cf40666e0 0x7f0cf40633c0 secure :-1 s=READY pgs=863 cs=0 l=1 rx=0x7f0ce4002f30 tx=0x7f0ce4007a40).ready entity=mon.0 client_cookie=2372b2fbf0bf16db server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:08.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.423+0000 7f0cf3fff700 1 --2- 172.21.15.103:0/1034316968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0cf40666e0 0x7f0cf40633c0 secure :-1 s=THROTTLE_DONE pgs=863 cs=0 l=1 rx=0x7f0ce4002f30 tx=0x7f0ce4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.423+0000 7f0cf37fe700 1 -- 172.21.15.103:0/1034316968 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ce4011310 con 0x7f0cf40666e0 2020-04-22T14:16:08.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.423+0000 7f0cf3fff700 1 --2- 172.21.15.103:0/1034316968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0cf40666e0 0x7f0cf40633c0 secure :-1 s=THROTTLE_DONE pgs=863 cs=0 l=1 rx=0x7f0ce4002f30 tx=0x7f0ce4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.423+0000 7f0cf3fff700 1 --2- 172.21.15.103:0/1034316968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0cf40666e0 0x7f0cf40633c0 secure :-1 s=THROTTLE_DONE pgs=863 cs=0 l=1 rx=0x7f0ce4002f30 tx=0x7f0ce4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.423+0000 7f0cf37fe700 1 -- 172.21.15.103:0/1034316968 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce40114b0 con 0x7f0cf40666e0 2020-04-22T14:16:08.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.423+0000 7f0cf37fe700 1 -- 172.21.15.103:0/1034316968 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ce40118d0 con 0x7f0cf40666e0 2020-04-22T14:16:08.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.423+0000 7f0cf8d11700 1 -- 172.21.15.103:0/1034316968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0cf40666e0 msgr2=0x7f0cf40633c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:08.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.423+0000 7f0cf8d11700 1 --2- 172.21.15.103:0/1034316968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0cf40666e0 0x7f0cf40633c0 secure :-1 s=READY pgs=863 cs=0 l=1 rx=0x7f0ce4002f30 tx=0x7f0ce4007a40).stop 2020-04-22T14:16:08.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.423+0000 7f0cf8d11700 1 -- 172.21.15.103:0/1034316968 shutdown_connections 2020-04-22T14:16:08.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.423+0000 7f0cf8d11700 1 --2- 172.21.15.103:0/1034316968 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0cf40b6f00 0x7f0cf40b9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:08.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.423+0000 7f0cf8d11700 1 --2- 172.21.15.103:0/1034316968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0cf40666e0 0x7f0cf40633c0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:08.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.423+0000 7f0cf8d11700 1 -- 172.21.15.103:0/1034316968 >> 172.21.15.103:0/1034316968 conn(0x7f0cf4060930 msgr2=0x7f0cf4060d40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:08.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.423+0000 7f0cf8d11700 1 -- 172.21.15.103:0/1034316968 shutdown_connections 2020-04-22T14:16:08.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.423+0000 7f0cf8d11700 1 -- 172.21.15.103:0/1034316968 wait complete. 2020-04-22T14:16:08.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.424+0000 7f0cf8d11700 1 Processor -- start 2020-04-22T14:16:08.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.424+0000 7f0cf8d11700 1 -- start start 2020-04-22T14:16:08.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.425+0000 7f0cf8d11700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0cf40666e0 0x7f0cf4134120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:08.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.425+0000 7f0cf8d11700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0cf40b6f00 0x7f0cf40ad050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:08.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.425+0000 7f0cf8d11700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0cf40b9880 0x7f0cf41346e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:08.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.425+0000 7f0cf8d11700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf411fa10 con 0x7f0cf40b6f00 2020-04-22T14:16:08.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.425+0000 7f0cf8d11700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf4120150 con 0x7f0cf40b9880 2020-04-22T14:16:08.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.425+0000 7f0cf8d11700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf4120290 con 0x7f0cf40666e0 2020-04-22T14:16:08.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.425+0000 7f0cf9f73700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0cf40b9880 0x7f0cf41346e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:08.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.425+0000 7f0cf9f73700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0cf40b9880 0x7f0cf41346e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55930/0 (socket says 172.21.15.103:55930) 2020-04-22T14:16:08.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.425+0000 7f0cf9f73700 1 -- 172.21.15.103:0/599052079 learned_addr learned my addr 172.21.15.103:0/599052079 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:08.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.425+0000 7f0cf3fff700 1 --2- 172.21.15.103:0/599052079 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0cf40666e0 0x7f0cf4134120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:08.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.425+0000 7f0cebfff700 1 --2- 172.21.15.103:0/599052079 >> v2:172.21.15.86:3300/0 conn(0x7f0cf40b6f00 0x7f0cf40ad050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:08.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.426+0000 7f0cf9f73700 1 -- 172.21.15.103:0/599052079 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0cf40666e0 msgr2=0x7f0cf4134120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:08.436 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.426+0000 7f0cf9f73700 1 --2- 172.21.15.103:0/599052079 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0cf40666e0 0x7f0cf4134120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:08.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.426+0000 7f0cf9f73700 1 -- 172.21.15.103:0/599052079 >> v2:172.21.15.86:3300/0 conn(0x7f0cf40b6f00 msgr2=0x7f0cf40ad050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:08.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.426+0000 7f0cf9f73700 1 --2- 172.21.15.103:0/599052079 >> v2:172.21.15.86:3300/0 conn(0x7f0cf40b6f00 0x7f0cf40ad050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:08.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.426+0000 7f0cf9f73700 1 -- 172.21.15.103:0/599052079 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf4120400 con 0x7f0cf40b9880 2020-04-22T14:16:08.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.426+0000 7f0cf9f73700 1 --2- 172.21.15.103:0/599052079 >> v2:172.21.15.103:3300/0 conn(0x7f0cf40b9880 0x7f0cf41346e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0cec0033f0 tx=0x7f0cec011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.426+0000 7f0cf9f73700 1 --2- 172.21.15.103:0/599052079 >> v2:172.21.15.103:3300/0 conn(0x7f0cf40b9880 0x7f0cf41346e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0cec0033f0 tx=0x7f0cec011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.426+0000 7f0cf9f73700 1 --2- 172.21.15.103:0/599052079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0cf40b9880 0x7f0cf41346e0 secure :-1 s=READY pgs=1616 cs=0 l=1 rx=0x7f0cec0033f0 tx=0x7f0cec011130).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:08.437 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.426+0000 7f0cf9f73700 1 --2- 172.21.15.103:0/599052079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0cf40b9880 0x7f0cf41346e0 secure :-1 s=THROTTLE_DONE pgs=1616 cs=0 l=1 rx=0x7f0cec0033f0 tx=0x7f0cec011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.426+0000 7f0cf17fa700 1 -- 172.21.15.103:0/599052079 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cec005e30 con 0x7f0cf40b9880 2020-04-22T14:16:08.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.426+0000 7f0cf9f73700 1 --2- 172.21.15.103:0/599052079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0cf40b9880 0x7f0cf41346e0 secure :-1 s=THROTTLE_DONE pgs=1616 cs=0 l=1 rx=0x7f0cec0033f0 tx=0x7f0cec011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.426+0000 7f0cf17fa700 1 -- 172.21.15.103:0/599052079 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cec00cbf0 con 0x7f0cf40b9880 2020-04-22T14:16:08.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.426+0000 7f0cf9f73700 1 --2- 172.21.15.103:0/599052079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0cf40b9880 0x7f0cf41346e0 secure :-1 s=THROTTLE_DONE pgs=1616 cs=0 l=1 rx=0x7f0cec0033f0 tx=0x7f0cec011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.426+0000 7f0cf8d11700 1 -- 172.21.15.103:0/599052079 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf4120650 con 0x7f0cf40b9880 2020-04-22T14:16:08.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.426+0000 7f0cf17fa700 1 -- 172.21.15.103:0/599052079 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cec00ce20 con 0x7f0cf40b9880 2020-04-22T14:16:08.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.426+0000 7f0cf8d11700 1 -- 172.21.15.103:0/599052079 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf40ad960 con 0x7f0cf40b9880 2020-04-22T14:16:08.438 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.426+0000 7f0cf9f73700 1 --2- 172.21.15.103:0/599052079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0cf40b9880 0x7f0cf41346e0 secure :-1 s=THROTTLE_DONE pgs=1616 cs=0 l=1 rx=0x7f0cec0033f0 tx=0x7f0cec011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.427+0000 7f0cf8d11700 1 -- 172.21.15.103:0/599052079 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf4056c90 con 0x7f0cf40b9880 2020-04-22T14:16:08.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.427+0000 7f0cf17fa700 1 -- 172.21.15.103:0/599052079 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f0cec00e1a0 con 0x7f0cf40b9880 2020-04-22T14:16:08.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.427+0000 7f0cf9f73700 1 --2- 172.21.15.103:0/599052079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0cf40b9880 0x7f0cf41346e0 secure :-1 s=THROTTLE_DONE pgs=1616 cs=0 l=1 rx=0x7f0cec0033f0 tx=0x7f0cec011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.427+0000 7f0cf17fa700 1 --2- 172.21.15.103:0/599052079 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0cd804d9d0 0x7f0cd804fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:08.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.427+0000 7f0cf17fa700 1 -- 172.21.15.103:0/599052079 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0cec061530 con 0x7f0cf40b9880 2020-04-22T14:16:08.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.427+0000 7f0cf3fff700 1 --2- 172.21.15.103:0/599052079 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0cd804d9d0 0x7f0cd804fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:08.439 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.427+0000 7f0cf3fff700 1 --2- 172.21.15.103:0/599052079 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0cd804d9d0 0x7f0cd804fe90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0ce4002f30 tx=0x7f0ce4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.428+0000 7f0cf3fff700 1 --2- 172.21.15.103:0/599052079 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0cd804d9d0 0x7f0cd804fe90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0ce4002f30 tx=0x7f0ce4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.428+0000 7f0cf3fff700 1 --2- 172.21.15.103:0/599052079 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0cd804d9d0 0x7f0cd804fe90 secure :-1 s=READY pgs=589 cs=0 l=1 rx=0x7f0ce4002f30 tx=0x7f0ce4007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:08.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.431+0000 7f0cf9f73700 1 --2- 172.21.15.103:0/599052079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0cf40b9880 0x7f0cf41346e0 secure :-1 s=THROTTLE_DONE pgs=1616 cs=0 l=1 rx=0x7f0cec0033f0 tx=0x7f0cec011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.440 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.431+0000 7f0cf17fa700 1 -- 172.21.15.103:0/599052079 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f0cec03c970 con 0x7f0cf40b9880 2020-04-22T14:16:08.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.629+0000 7f0cf8d11700 1 -- 172.21.15.103:0/599052079 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f0cf406a8b0 con 0x7f0cf40b9880 2020-04-22T14:16:08.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.634+0000 7f0cf9f73700 1 --2- 172.21.15.103:0/599052079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0cf40b9880 0x7f0cf41346e0 secure :-1 s=THROTTLE_DONE pgs=1616 cs=0 l=1 rx=0x7f0cec0033f0 tx=0x7f0cec011130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.634+0000 7f0cf17fa700 1 -- 172.21.15.103:0/599052079 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v42) v1 ==== 184+0+0 (secure 0 0 0) 0x7f0cec03ff90 con 0x7f0cf40b9880 2020-04-22T14:16:08.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.636+0000 7f0cf8d11700 1 -- 172.21.15.103:0/599052079 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0cd804d9d0 msgr2=0x7f0cd804fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:08.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.636+0000 7f0cf8d11700 1 --2- 172.21.15.103:0/599052079 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0cd804d9d0 0x7f0cd804fe90 secure :-1 s=READY pgs=589 cs=0 l=1 rx=0x7f0ce4002f30 tx=0x7f0ce4007a40).stop 2020-04-22T14:16:08.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.636+0000 7f0cf8d11700 1 -- 172.21.15.103:0/599052079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0cf40b9880 msgr2=0x7f0cf41346e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:08.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.636+0000 7f0cf8d11700 1 --2- 172.21.15.103:0/599052079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0cf40b9880 0x7f0cf41346e0 secure :-1 s=READY pgs=1616 cs=0 l=1 rx=0x7f0cec0033f0 tx=0x7f0cec011130).stop 2020-04-22T14:16:08.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.636+0000 7f0cf8d11700 1 -- 172.21.15.103:0/599052079 shutdown_connections 2020-04-22T14:16:08.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.636+0000 7f0cf8d11700 1 --2- 172.21.15.103:0/599052079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0cf40b9880 0x7f0cf41346e0 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:08.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.636+0000 7f0cf8d11700 1 --2- 172.21.15.103:0/599052079 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0cf40666e0 0x7f0cf4134120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:08.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.636+0000 7f0cf8d11700 1 --2- 172.21.15.103:0/599052079 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0cd804d9d0 0x7f0cd804fe90 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:08.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.636+0000 7f0cf8d11700 1 --2- 172.21.15.103:0/599052079 >> v2:172.21.15.86:3300/0 conn(0x7f0cf40b6f00 0x7f0cf40ad050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:08.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.636+0000 7f0cf8d11700 1 -- 172.21.15.103:0/599052079 >> 172.21.15.103:0/599052079 conn(0x7f0cf4060930 msgr2=0x7f0cf4060d10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:08.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.636+0000 7f0cf8d11700 1 -- 172.21.15.103:0/599052079 shutdown_connections 2020-04-22T14:16:08.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.636+0000 7f0cf8d11700 1 -- 172.21.15.103:0/599052079 wait complete. 2020-04-22T14:16:08.640 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.1 2020-04-22T14:16:08.648 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:08.662 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:16:08.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.811+0000 7f18d3e24700 1 Processor -- start 2020-04-22T14:16:08.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.812+0000 7f18d3e24700 1 -- start start 2020-04-22T14:16:08.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.812+0000 7f18d3e24700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18cc152a90 0x7f18cc0b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:08.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.812+0000 7f18d3e24700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18cc152e70 con 0x7f18cc062170 2020-04-22T14:16:08.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.812+0000 7f18d3e24700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18cc0614f0 con 0x7f18cc0adf50 2020-04-22T14:16:08.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.812+0000 7f18d3e24700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc061790 con 0x7f18cc152a90 2020-04-22T14:16:08.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.813+0000 7f18d2bc2700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f18cc0adf50 0x7f18cc0ae3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48128/0 (socket says 172.21.15.103:48128) 2020-04-22T14:16:08.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.813+0000 7f18d2bc2700 1 -- 172.21.15.103:0/2600109605 learned_addr learned my addr 172.21.15.103:0/2600109605 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:08.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.813+0000 7f18d23c1700 1 --2- 172.21.15.103:0/2600109605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18cc152a90 0x7f18cc0b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:08.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.813+0000 7f18d13bf700 1 -- 172.21.15.103:0/2600109605 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2890005943 0 0) 0x7f18cc0614f0 con 0x7f18cc0adf50 2020-04-22T14:16:08.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.813+0000 7f18d13bf700 1 -- 172.21.15.103:0/2600109605 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18b8003230 con 0x7f18cc0adf50 2020-04-22T14:16:08.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.813+0000 7f18d13bf700 1 -- 172.21.15.103:0/2600109605 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2599774982 0 0) 0x7f18cc152e70 con 0x7f18cc062170 2020-04-22T14:16:08.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.813+0000 7f18d13bf700 1 -- 172.21.15.103:0/2600109605 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18cc0614f0 con 0x7f18cc062170 2020-04-22T14:16:08.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.813+0000 7f18d13bf700 1 -- 172.21.15.103:0/2600109605 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2531713108 0 0) 0x7f18b8003230 con 0x7f18cc0adf50 2020-04-22T14:16:08.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.813+0000 7f18d13bf700 1 -- 172.21.15.103:0/2600109605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18cc152a90 msgr2=0x7f18cc0b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:08.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.813+0000 7f18d13bf700 1 --2- 172.21.15.103:0/2600109605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18cc152a90 0x7f18cc0b44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:08.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.813+0000 7f18d13bf700 1 -- 172.21.15.103:0/2600109605 >> v1:172.21.15.86:6789/0 conn(0x7f18cc062170 legacy=0x7f18cc0b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:08.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.813+0000 7f18d13bf700 1 -- 172.21.15.103:0/2600109605 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18cc061a30 con 0x7f18cc0adf50 2020-04-22T14:16:08.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.813+0000 7f18d13bf700 1 -- 172.21.15.103:0/2600109605 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f18c4001a50 con 0x7f18cc0adf50 2020-04-22T14:16:08.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.813+0000 7f18d23c1700 1 --2- 172.21.15.103:0/2600109605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18cc152a90 0x7f18cc0b44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:16:08.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.813+0000 7f18d13bf700 1 -- 172.21.15.103:0/2600109605 >> v1:172.21.15.103:6789/0 conn(0x7f18cc0adf50 legacy=0x7f18cc0ae3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:08.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.813+0000 7f18d13bf700 1 --2- 172.21.15.103:0/2600109605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18b80038b0 0x7f18b8003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:08.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.813+0000 7f18d13bf700 1 --2- 172.21.15.103:0/2600109605 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18b80044d0 0x7f18b8004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:08.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.813+0000 7f18d13bf700 1 --2- 172.21.15.103:0/2600109605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18cc152a90 0x7f18b8004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:08.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.813+0000 7f18d13bf700 1 -- 172.21.15.103:0/2600109605 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc061790 con 0x7f18b80044d0 2020-04-22T14:16:08.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.813+0000 7f18d13bf700 1 -- 172.21.15.103:0/2600109605 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b8005210 con 0x7f18b80038b0 2020-04-22T14:16:08.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.813+0000 7f18d13bf700 1 -- 172.21.15.103:0/2600109605 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b80053a0 con 0x7f18cc152a90 2020-04-22T14:16:08.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.813+0000 7f18d23c1700 1 --2- 172.21.15.103:0/2600109605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18b80038b0 0x7f18b8003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:08.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.813+0000 7f18d2bc2700 1 --2- 172.21.15.103:0/2600109605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18cc152a90 0x7f18b8004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:08.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.813+0000 7f18d1bc0700 1 --2- 172.21.15.103:0/2600109605 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18b80044d0 0x7f18b8004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:08.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.813+0000 7f18d23c1700 1 -- 172.21.15.103:0/2600109605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18cc152a90 msgr2=0x7f18b8004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:08.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.813+0000 7f18d23c1700 1 --2- 172.21.15.103:0/2600109605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18cc152a90 0x7f18b8004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:08.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.813+0000 7f18d23c1700 1 -- 172.21.15.103:0/2600109605 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18b80044d0 msgr2=0x7f18b8004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:08.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.813+0000 7f18d23c1700 1 --2- 172.21.15.103:0/2600109605 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18b80044d0 0x7f18b8004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:08.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.813+0000 7f18d23c1700 1 -- 172.21.15.103:0/2600109605 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b8003230 con 0x7f18b80038b0 2020-04-22T14:16:08.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.813+0000 7f18d2bc2700 1 --2- 172.21.15.103:0/2600109605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18cc152a90 0x7f18b8004db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:16:08.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.813+0000 7f18d1bc0700 1 --2- 172.21.15.103:0/2600109605 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18b80044d0 0x7f18b8004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:16:08.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.813+0000 7f18d23c1700 1 --2- 172.21.15.103:0/2600109605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18b80038b0 0x7f18b8003cb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f18c8002f30 tx=0x7f18c800bff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.814+0000 7f18d23c1700 1 --2- 172.21.15.103:0/2600109605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18b80038b0 0x7f18b8003cb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f18c8002f30 tx=0x7f18c800bff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.814+0000 7f18d23c1700 1 --2- 172.21.15.103:0/2600109605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18b80038b0 0x7f18b8003cb0 secure :-1 s=READY pgs=1618 cs=0 l=1 rx=0x7f18c8002f30 tx=0x7f18c800bff0).ready entity=mon.1 client_cookie=47a58a77ebb6bec7 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:08.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.814+0000 7f18d23c1700 1 --2- 172.21.15.103:0/2600109605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18b80038b0 0x7f18b8003cb0 secure :-1 s=THROTTLE_DONE pgs=1618 cs=0 l=1 rx=0x7f18c8002f30 tx=0x7f18c800bff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.814+0000 7f18d13bf700 1 -- 172.21.15.103:0/2600109605 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18c80056c0 con 0x7f18b80038b0 2020-04-22T14:16:08.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.814+0000 7f18d23c1700 1 --2- 172.21.15.103:0/2600109605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18b80038b0 0x7f18b8003cb0 secure :-1 s=THROTTLE_DONE pgs=1618 cs=0 l=1 rx=0x7f18c8002f30 tx=0x7f18c800bff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.814+0000 7f18d23c1700 1 --2- 172.21.15.103:0/2600109605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18b80038b0 0x7f18b8003cb0 secure :-1 s=THROTTLE_DONE pgs=1618 cs=0 l=1 rx=0x7f18c8002f30 tx=0x7f18c800bff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.814+0000 7f18d13bf700 1 -- 172.21.15.103:0/2600109605 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c8005820 con 0x7f18b80038b0 2020-04-22T14:16:08.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.814+0000 7f18d13bf700 1 -- 172.21.15.103:0/2600109605 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18c8005c00 con 0x7f18b80038b0 2020-04-22T14:16:08.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.814+0000 7f18d3e24700 1 -- 172.21.15.103:0/2600109605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18b80038b0 msgr2=0x7f18b8003cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:08.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.814+0000 7f18d3e24700 1 --2- 172.21.15.103:0/2600109605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18b80038b0 0x7f18b8003cb0 secure :-1 s=READY pgs=1618 cs=0 l=1 rx=0x7f18c8002f30 tx=0x7f18c800bff0).stop 2020-04-22T14:16:08.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.814+0000 7f18d2bc2700 1 -- 172.21.15.103:0/2600109605 reap_dead start 2020-04-22T14:16:08.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.814+0000 7f18d3e24700 1 -- 172.21.15.103:0/2600109605 shutdown_connections 2020-04-22T14:16:08.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.814+0000 7f18d3e24700 1 -- 172.21.15.103:0/2600109605 >> 172.21.15.103:0/2600109605 conn(0x7f18cc05ad30 msgr2=0x7f18cc05b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:08.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.814+0000 7f18d3e24700 1 -- 172.21.15.103:0/2600109605 shutdown_connections 2020-04-22T14:16:08.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.814+0000 7f18d3e24700 1 -- 172.21.15.103:0/2600109605 wait complete. 2020-04-22T14:16:08.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.815+0000 7f18d3e24700 1 Processor -- start 2020-04-22T14:16:08.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.816+0000 7f18d3e24700 1 -- start start 2020-04-22T14:16:08.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.816+0000 7f18d3e24700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f18cc065c20 0x7f18cc117ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:08.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.816+0000 7f18d3e24700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18cc146440 0x7f18cc07ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:08.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.816+0000 7f18d3e24700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18cc065240 con 0x7f18cc0b4f30 2020-04-22T14:16:08.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.816+0000 7f18d3e24700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18cc118320 con 0x7f18cc065c20 2020-04-22T14:16:08.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.816+0000 7f18d3e24700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc0654e0 con 0x7f18cc146440 2020-04-22T14:16:08.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.816+0000 7f18d1bc0700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f18cc065c20 0x7f18cc117ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:08.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.816+0000 7f18d1bc0700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f18cc065c20 0x7f18cc117ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55948/0 (socket says 172.21.15.103:55948) 2020-04-22T14:16:08.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.816+0000 7f18d1bc0700 1 -- 172.21.15.103:0/341797935 learned_addr learned my addr 172.21.15.103:0/341797935 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:08.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.816+0000 7f18d2bc2700 1 --2- 172.21.15.103:0/341797935 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18cc146440 0x7f18cc07ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:08.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.816+0000 7f18d1bc0700 1 -- 172.21.15.103:0/341797935 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18cc146440 msgr2=0x7f18cc07ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:08.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.816+0000 7f18d1bc0700 1 --2- 172.21.15.103:0/341797935 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18cc146440 0x7f18cc07ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:08.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.816+0000 7f18d1bc0700 1 -- 172.21.15.103:0/341797935 >> v1:172.21.15.86:6789/0 conn(0x7f18cc0b4f30 legacy=0x7f18cc1177b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:08.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.817+0000 7f18d1bc0700 1 -- 172.21.15.103:0/341797935 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18cc065780 con 0x7f18cc065c20 2020-04-22T14:16:08.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.817+0000 7f18d1bc0700 1 --2- 172.21.15.103:0/341797935 >> v2:172.21.15.103:3300/0 conn(0x7f18cc065c20 0x7f18cc117ec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f18cc0b8380 tx=0x7f18cc05a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.817+0000 7f18d1bc0700 1 --2- 172.21.15.103:0/341797935 >> v2:172.21.15.103:3300/0 conn(0x7f18cc065c20 0x7f18cc117ec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f18cc0b8380 tx=0x7f18cc05a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.817+0000 7f18d1bc0700 1 --2- 172.21.15.103:0/341797935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18cc065c20 0x7f18cc117ec0 secure :-1 s=READY pgs=1619 cs=0 l=1 rx=0x7f18cc0b8380 tx=0x7f18cc05a720).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:08.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.817+0000 7f18d1bc0700 1 --2- 172.21.15.103:0/341797935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18cc065c20 0x7f18cc117ec0 secure :-1 s=THROTTLE_DONE pgs=1619 cs=0 l=1 rx=0x7f18cc0b8380 tx=0x7f18cc05a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.817+0000 7f18d1bc0700 1 --2- 172.21.15.103:0/341797935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18cc065c20 0x7f18cc117ec0 secure :-1 s=THROTTLE_DONE pgs=1619 cs=0 l=1 rx=0x7f18cc0b8380 tx=0x7f18cc05a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.817+0000 7f18c2ffd700 1 -- 172.21.15.103:0/341797935 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18bc00cc40 con 0x7f18cc065c20 2020-04-22T14:16:08.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.817+0000 7f18d1bc0700 1 --2- 172.21.15.103:0/341797935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18cc065c20 0x7f18cc117ec0 secure :-1 s=THROTTLE_DONE pgs=1619 cs=0 l=1 rx=0x7f18cc0b8380 tx=0x7f18cc05a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.817+0000 7f18c2ffd700 1 -- 172.21.15.103:0/341797935 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18bc00cda0 con 0x7f18cc065c20 2020-04-22T14:16:08.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.817+0000 7f18d3e24700 1 -- 172.21.15.103:0/341797935 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18cc1468f0 con 0x7f18cc065c20 2020-04-22T14:16:08.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.817+0000 7f18c2ffd700 1 -- 172.21.15.103:0/341797935 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18bc00e370 con 0x7f18cc065c20 2020-04-22T14:16:08.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.817+0000 7f18d3e24700 1 -- 172.21.15.103:0/341797935 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18cc1189a0 con 0x7f18cc065c20 2020-04-22T14:16:08.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.817+0000 7f18d1bc0700 1 --2- 172.21.15.103:0/341797935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18cc065c20 0x7f18cc117ec0 secure :-1 s=THROTTLE_DONE pgs=1619 cs=0 l=1 rx=0x7f18cc0b8380 tx=0x7f18cc05a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.818+0000 7f18d1bc0700 1 --2- 172.21.15.103:0/341797935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18cc065c20 0x7f18cc117ec0 secure :-1 s=THROTTLE_DONE pgs=1619 cs=0 l=1 rx=0x7f18cc0b8380 tx=0x7f18cc05a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.818+0000 7f18c2ffd700 1 -- 172.21.15.103:0/341797935 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f18bc00e5e0 con 0x7f18cc065c20 2020-04-22T14:16:08.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.818+0000 7f18d3e24700 1 -- 172.21.15.103:0/341797935 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18cc056c90 con 0x7f18cc065c20 2020-04-22T14:16:08.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.818+0000 7f18c2ffd700 1 --2- 172.21.15.103:0/341797935 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f18b404d9d0 0x7f18b404fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:08.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.818+0000 7f18c2ffd700 1 -- 172.21.15.103:0/341797935 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f18bc061340 con 0x7f18cc065c20 2020-04-22T14:16:08.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.818+0000 7f18d23c1700 1 --2- 172.21.15.103:0/341797935 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f18b404d9d0 0x7f18b404fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:08.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.818+0000 7f18d23c1700 1 --2- 172.21.15.103:0/341797935 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f18b404d9d0 0x7f18b404fe90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f18c8002f30 tx=0x7f18c800bff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.819+0000 7f18d23c1700 1 --2- 172.21.15.103:0/341797935 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f18b404d9d0 0x7f18b404fe90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f18c8002f30 tx=0x7f18c800bff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.819+0000 7f18d23c1700 1 --2- 172.21.15.103:0/341797935 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f18b404d9d0 0x7f18b404fe90 secure :-1 s=READY pgs=590 cs=0 l=1 rx=0x7f18c8002f30 tx=0x7f18c800bff0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:08.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.822+0000 7f18d1bc0700 1 --2- 172.21.15.103:0/341797935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18cc065c20 0x7f18cc117ec0 secure :-1 s=THROTTLE_DONE pgs=1619 cs=0 l=1 rx=0x7f18cc0b8380 tx=0x7f18cc05a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:08.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:08.822+0000 7f18c2ffd700 1 -- 172.21.15.103:0/341797935 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f18bc03c680 con 0x7f18cc065c20 2020-04-22T14:16:09.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.016+0000 7f18d3e24700 1 -- 172.21.15.103:0/341797935 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f18cc06a8b0 con 0x7f18cc065c20 2020-04-22T14:16:09.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.020+0000 7f18d1bc0700 1 --2- 172.21.15.103:0/341797935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18cc065c20 0x7f18cc117ec0 secure :-1 s=THROTTLE_DONE pgs=1619 cs=0 l=1 rx=0x7f18cc0b8380 tx=0x7f18cc05a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:09.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.020+0000 7f18c2ffd700 1 -- 172.21.15.103:0/341797935 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v43) v1 ==== 184+0+0 (secure 0 0 0) 0x7f18bc03fca0 con 0x7f18cc065c20 2020-04-22T14:16:09.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.021+0000 7f18d3e24700 1 -- 172.21.15.103:0/341797935 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f18b404d9d0 msgr2=0x7f18b404fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:09.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.021+0000 7f18d3e24700 1 --2- 172.21.15.103:0/341797935 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f18b404d9d0 0x7f18b404fe90 secure :-1 s=READY pgs=590 cs=0 l=1 rx=0x7f18c8002f30 tx=0x7f18c800bff0).stop 2020-04-22T14:16:09.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.021+0000 7f18d3e24700 1 -- 172.21.15.103:0/341797935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18cc065c20 msgr2=0x7f18cc117ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:09.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.021+0000 7f18d3e24700 1 --2- 172.21.15.103:0/341797935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18cc065c20 0x7f18cc117ec0 secure :-1 s=READY pgs=1619 cs=0 l=1 rx=0x7f18cc0b8380 tx=0x7f18cc05a720).stop 2020-04-22T14:16:09.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.022+0000 7f18d3e24700 1 -- 172.21.15.103:0/341797935 shutdown_connections 2020-04-22T14:16:09.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.022+0000 7f18d3e24700 1 --2- 172.21.15.103:0/341797935 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f18b404d9d0 0x7f18b404fe90 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:09.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.022+0000 7f18d3e24700 1 --2- 172.21.15.103:0/341797935 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18cc146440 0x7f18cc07ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:09.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.022+0000 7f18d3e24700 1 --2- 172.21.15.103:0/341797935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18cc065c20 0x7f18cc117ec0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:09.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.022+0000 7f18d3e24700 1 -- 172.21.15.103:0/341797935 >> 172.21.15.103:0/341797935 conn(0x7f18cc05ad30 msgr2=0x7f18cc135550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:09.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.022+0000 7f18d3e24700 1 -- 172.21.15.103:0/341797935 shutdown_connections 2020-04-22T14:16:09.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.022+0000 7f18d3e24700 1 -- 172.21.15.103:0/341797935 wait complete. 2020-04-22T14:16:09.027 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.2 2020-04-22T14:16:09.034 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:09.047 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:16:09.219 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.214+0000 7fd4137bf700 1 Processor -- start 2020-04-22T14:16:09.219 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.214+0000 7fd4137bf700 1 -- start start 2020-04-22T14:16:09.219 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.215+0000 7fd4137bf700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd40c152a90 0x7fd40c0b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:09.220 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.215+0000 7fd4137bf700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd40c062170 0x7fd40c0b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:09.220 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.215+0000 7fd4137bf700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40c152e70 con 0x7fd40c0b5210 2020-04-22T14:16:09.220 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.215+0000 7fd4137bf700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40c0614f0 con 0x7fd40c062170 2020-04-22T14:16:09.220 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.215+0000 7fd4137bf700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd40c061790 con 0x7fd40c152a90 2020-04-22T14:16:09.220 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.215+0000 7fd41155b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd40c062170 0x7fd40c0b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:09.220 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.215+0000 7fd41155b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd40c062170 0x7fd40c0b4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55954/0 (socket says 172.21.15.103:55954) 2020-04-22T14:16:09.220 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.215+0000 7fd41155b700 1 -- 172.21.15.103:0/2633655081 learned_addr learned my addr 172.21.15.103:0/2633655081 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:09.221 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.215+0000 7fd411d5c700 1 --2- 172.21.15.103:0/2633655081 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd40c152a90 0x7fd40c0b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:09.221 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.215+0000 7fd41155b700 1 -- 172.21.15.103:0/2633655081 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd40c152a90 msgr2=0x7fd40c0b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:09.221 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.215+0000 7fd41155b700 1 --2- 172.21.15.103:0/2633655081 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd40c152a90 0x7fd40c0b44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:09.221 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.215+0000 7fd41155b700 1 -- 172.21.15.103:0/2633655081 >> v1:172.21.15.86:6789/0 conn(0x7fd40c0b5210 legacy=0x7fd40c156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:09.221 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.215+0000 7fd41155b700 1 -- 172.21.15.103:0/2633655081 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd40c0b56a0 con 0x7fd40c062170 2020-04-22T14:16:09.221 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.215+0000 7fd411d5c700 1 --2- 172.21.15.103:0/2633655081 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd40c152a90 0x7fd40c0b44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:16:09.221 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.216+0000 7fd41155b700 1 --2- 172.21.15.103:0/2633655081 >> v2:172.21.15.103:3300/0 conn(0x7fd40c062170 0x7fd40c0b4db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd400002f30 tx=0x7fd40c05a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:09.222 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.216+0000 7fd41155b700 1 --2- 172.21.15.103:0/2633655081 >> v2:172.21.15.103:3300/0 conn(0x7fd40c062170 0x7fd40c0b4db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd400002f30 tx=0x7fd40c05a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:09.222 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.216+0000 7fd41155b700 1 --2- 172.21.15.103:0/2633655081 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd40c062170 0x7fd40c0b4db0 secure :-1 s=READY pgs=1620 cs=0 l=1 rx=0x7fd400002f30 tx=0x7fd40c05a720).ready entity=mon.1 client_cookie=bc013d5efac6287f server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:09.222 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.216+0000 7fd41155b700 1 --2- 172.21.15.103:0/2633655081 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd40c062170 0x7fd40c0b4db0 secure :-1 s=THROTTLE_DONE pgs=1620 cs=0 l=1 rx=0x7fd400002f30 tx=0x7fd40c05a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:09.222 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.216+0000 7fd410d5a700 1 -- 172.21.15.103:0/2633655081 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd400011720 con 0x7fd40c062170 2020-04-22T14:16:09.222 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.216+0000 7fd41155b700 1 --2- 172.21.15.103:0/2633655081 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd40c062170 0x7fd40c0b4db0 secure :-1 s=THROTTLE_DONE pgs=1620 cs=0 l=1 rx=0x7fd400002f30 tx=0x7fd40c05a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:09.222 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.216+0000 7fd41155b700 1 --2- 172.21.15.103:0/2633655081 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd40c062170 0x7fd40c0b4db0 secure :-1 s=THROTTLE_DONE pgs=1620 cs=0 l=1 rx=0x7fd400002f30 tx=0x7fd40c05a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:09.222 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.216+0000 7fd410d5a700 1 -- 172.21.15.103:0/2633655081 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4000118c0 con 0x7fd40c062170 2020-04-22T14:16:09.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.216+0000 7fd410d5a700 1 -- 172.21.15.103:0/2633655081 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd400011ce0 con 0x7fd40c062170 2020-04-22T14:16:09.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.216+0000 7fd4137bf700 1 -- 172.21.15.103:0/2633655081 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd40c062170 msgr2=0x7fd40c0b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:09.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.216+0000 7fd4137bf700 1 --2- 172.21.15.103:0/2633655081 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd40c062170 0x7fd40c0b4db0 secure :-1 s=READY pgs=1620 cs=0 l=1 rx=0x7fd400002f30 tx=0x7fd40c05a720).stop 2020-04-22T14:16:09.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.216+0000 7fd4137bf700 1 -- 172.21.15.103:0/2633655081 shutdown_connections 2020-04-22T14:16:09.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.216+0000 7fd4137bf700 1 --2- 172.21.15.103:0/2633655081 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd40c152a90 0x7fd40c0b44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:09.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.216+0000 7fd4137bf700 1 --2- 172.21.15.103:0/2633655081 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd40c062170 0x7fd40c0b4db0 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:09.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.216+0000 7fd4137bf700 1 -- 172.21.15.103:0/2633655081 >> 172.21.15.103:0/2633655081 conn(0x7fd40c05ad30 msgr2=0x7fd40c05b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:09.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.216+0000 7fd4137bf700 1 -- 172.21.15.103:0/2633655081 shutdown_connections 2020-04-22T14:16:09.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.216+0000 7fd4137bf700 1 -- 172.21.15.103:0/2633655081 wait complete. 2020-04-22T14:16:09.227 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.217+0000 7fd4137bf700 1 Processor -- start 2020-04-22T14:16:09.228 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.217+0000 7fd4137bf700 1 -- start start 2020-04-22T14:16:09.228 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.218+0000 7fd4137bf700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd40c0b5210 0x7fd40c066460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:09.228 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.218+0000 7fd4137bf700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd40c152a90 0x7fd40c0ae260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:09.228 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.218+0000 7fd4137bf700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40c0ae6c0 con 0x7fd40c062170 2020-04-22T14:16:09.228 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.218+0000 7fd4137bf700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40c1542d0 con 0x7fd40c0b5210 2020-04-22T14:16:09.228 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.218+0000 7fd4137bf700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40c140190 con 0x7fd40c152a90 2020-04-22T14:16:09.228 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.218+0000 7fd411d5c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd40c062170 0x7fd40c064140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48148/0 (socket says 172.21.15.103:48148) 2020-04-22T14:16:09.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.218+0000 7fd411d5c700 1 -- 172.21.15.103:0/1589898282 learned_addr learned my addr 172.21.15.103:0/1589898282 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:09.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.218+0000 7fd41255d700 1 --2- 172.21.15.103:0/1589898282 >> v2:172.21.15.103:3300/0 conn(0x7fd40c152a90 0x7fd40c0ae260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:09.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.218+0000 7fd41155b700 1 --2- 172.21.15.103:0/1589898282 >> v2:172.21.15.86:3300/0 conn(0x7fd40c0b5210 0x7fd40c066460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:09.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.218+0000 7fd40a7fc700 1 -- 172.21.15.103:0/1589898282 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 845641948 0 0) 0x7fd3fc001ec0 con 0x7fd40c062170 2020-04-22T14:16:09.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.218+0000 7fd40a7fc700 1 -- 172.21.15.103:0/1589898282 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3ec003230 con 0x7fd40c062170 2020-04-22T14:16:09.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.218+0000 7fd41255d700 1 -- 172.21.15.103:0/1589898282 >> v2:172.21.15.86:3300/0 conn(0x7fd40c0b5210 msgr2=0x7fd40c066460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:09.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.218+0000 7fd41255d700 1 --2- 172.21.15.103:0/1589898282 >> v2:172.21.15.86:3300/0 conn(0x7fd40c0b5210 0x7fd40c066460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:09.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.218+0000 7fd41255d700 1 -- 172.21.15.103:0/1589898282 >> v1:172.21.15.103:6789/0 conn(0x7fd40c062170 legacy=0x7fd40c064140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:09.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.218+0000 7fd41255d700 1 -- 172.21.15.103:0/1589898282 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd40c1544c0 con 0x7fd40c152a90 2020-04-22T14:16:09.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.219+0000 7fd41255d700 1 --2- 172.21.15.103:0/1589898282 >> v2:172.21.15.103:3300/0 conn(0x7fd40c152a90 0x7fd40c0ae260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd40c062550 tx=0x7fd404010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:09.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.219+0000 7fd41255d700 1 --2- 172.21.15.103:0/1589898282 >> v2:172.21.15.103:3300/0 conn(0x7fd40c152a90 0x7fd40c0ae260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd40c062550 tx=0x7fd404010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:09.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.219+0000 7fd41255d700 1 --2- 172.21.15.103:0/1589898282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd40c152a90 0x7fd40c0ae260 secure :-1 s=READY pgs=1622 cs=0 l=1 rx=0x7fd40c062550 tx=0x7fd404010ba0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:09.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.219+0000 7fd41255d700 1 --2- 172.21.15.103:0/1589898282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd40c152a90 0x7fd40c0ae260 secure :-1 s=THROTTLE_DONE pgs=1622 cs=0 l=1 rx=0x7fd40c062550 tx=0x7fd404010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:09.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.219+0000 7fd40a7fc700 1 -- 172.21.15.103:0/1589898282 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd404002240 con 0x7fd40c152a90 2020-04-22T14:16:09.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.219+0000 7fd41255d700 1 --2- 172.21.15.103:0/1589898282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd40c152a90 0x7fd40c0ae260 secure :-1 s=THROTTLE_DONE pgs=1622 cs=0 l=1 rx=0x7fd40c062550 tx=0x7fd404010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:09.231 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.219+0000 7fd41255d700 1 --2- 172.21.15.103:0/1589898282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd40c152a90 0x7fd40c0ae260 secure :-1 s=THROTTLE_DONE pgs=1622 cs=0 l=1 rx=0x7fd40c062550 tx=0x7fd404010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:09.231 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.219+0000 7fd40a7fc700 1 -- 172.21.15.103:0/1589898282 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4040023a0 con 0x7fd40c152a90 2020-04-22T14:16:09.231 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.219+0000 7fd40a7fc700 1 -- 172.21.15.103:0/1589898282 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4040027c0 con 0x7fd40c152a90 2020-04-22T14:16:09.231 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.219+0000 7fd4137bf700 1 -- 172.21.15.103:0/1589898282 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd40c13fe10 con 0x7fd40c152a90 2020-04-22T14:16:09.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.219+0000 7fd4137bf700 1 -- 172.21.15.103:0/1589898282 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd40c065ed0 con 0x7fd40c152a90 2020-04-22T14:16:09.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.219+0000 7fd41255d700 1 --2- 172.21.15.103:0/1589898282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd40c152a90 0x7fd40c0ae260 secure :-1 s=THROTTLE_DONE pgs=1622 cs=0 l=1 rx=0x7fd40c062550 tx=0x7fd404010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:09.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.220+0000 7fd40a7fc700 1 -- 172.21.15.103:0/1589898282 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fd404002a30 con 0x7fd40c152a90 2020-04-22T14:16:09.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.220+0000 7fd41255d700 1 --2- 172.21.15.103:0/1589898282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd40c152a90 0x7fd40c0ae260 secure :-1 s=THROTTLE_DONE pgs=1622 cs=0 l=1 rx=0x7fd40c062550 tx=0x7fd404010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:09.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.220+0000 7fd4137bf700 1 -- 172.21.15.103:0/1589898282 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd40c056c90 con 0x7fd40c152a90 2020-04-22T14:16:09.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.220+0000 7fd40a7fc700 1 --2- 172.21.15.103:0/1589898282 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd3ec04dd40 0x7fd3ec050200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:09.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.220+0000 7fd40a7fc700 1 -- 172.21.15.103:0/1589898282 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd404013070 con 0x7fd40c152a90 2020-04-22T14:16:09.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.220+0000 7fd411d5c700 1 --2- 172.21.15.103:0/1589898282 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd3ec04dd40 0x7fd3ec050200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:09.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.221+0000 7fd411d5c700 1 --2- 172.21.15.103:0/1589898282 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd3ec04dd40 0x7fd3ec050200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd3fc002f30 tx=0x7fd3fc0022f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:09.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.221+0000 7fd411d5c700 1 --2- 172.21.15.103:0/1589898282 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd3ec04dd40 0x7fd3ec050200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd3fc002f30 tx=0x7fd3fc0022f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:09.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.221+0000 7fd411d5c700 1 --2- 172.21.15.103:0/1589898282 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd3ec04dd40 0x7fd3ec050200 secure :-1 s=READY pgs=591 cs=0 l=1 rx=0x7fd3fc002f30 tx=0x7fd3fc0022f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:09.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.224+0000 7fd41255d700 1 --2- 172.21.15.103:0/1589898282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd40c152a90 0x7fd40c0ae260 secure :-1 s=THROTTLE_DONE pgs=1622 cs=0 l=1 rx=0x7fd40c062550 tx=0x7fd404010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:09.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.224+0000 7fd40a7fc700 1 -- 172.21.15.103:0/1589898282 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fd40403cb20 con 0x7fd40c152a90 2020-04-22T14:16:09.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.415+0000 7fd4137bf700 1 -- 172.21.15.103:0/1589898282 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fd40c0b93d0 con 0x7fd40c152a90 2020-04-22T14:16:09.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.421+0000 7fd41255d700 1 --2- 172.21.15.103:0/1589898282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd40c152a90 0x7fd40c0ae260 secure :-1 s=THROTTLE_DONE pgs=1622 cs=0 l=1 rx=0x7fd40c062550 tx=0x7fd404010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:09.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.421+0000 7fd40a7fc700 1 -- 172.21.15.103:0/1589898282 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v44) v1 ==== 184+0+0 (secure 0 0 0) 0x7fd404040140 con 0x7fd40c152a90 2020-04-22T14:16:09.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.423+0000 7fd4137bf700 1 -- 172.21.15.103:0/1589898282 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd3ec04dd40 msgr2=0x7fd3ec050200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:09.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.423+0000 7fd4137bf700 1 --2- 172.21.15.103:0/1589898282 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd3ec04dd40 0x7fd3ec050200 secure :-1 s=READY pgs=591 cs=0 l=1 rx=0x7fd3fc002f30 tx=0x7fd3fc0022f0).stop 2020-04-22T14:16:09.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.423+0000 7fd4137bf700 1 -- 172.21.15.103:0/1589898282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd40c152a90 msgr2=0x7fd40c0ae260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:09.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.423+0000 7fd4137bf700 1 --2- 172.21.15.103:0/1589898282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd40c152a90 0x7fd40c0ae260 secure :-1 s=READY pgs=1622 cs=0 l=1 rx=0x7fd40c062550 tx=0x7fd404010ba0).stop 2020-04-22T14:16:09.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.423+0000 7fd4137bf700 1 -- 172.21.15.103:0/1589898282 shutdown_connections 2020-04-22T14:16:09.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.423+0000 7fd4137bf700 1 --2- 172.21.15.103:0/1589898282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd40c152a90 0x7fd40c0ae260 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:09.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.423+0000 7fd4137bf700 1 --2- 172.21.15.103:0/1589898282 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd3ec04dd40 0x7fd3ec050200 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:09.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.423+0000 7fd4137bf700 1 --2- 172.21.15.103:0/1589898282 >> v2:172.21.15.86:3300/0 conn(0x7fd40c0b5210 0x7fd40c066460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:09.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.423+0000 7fd4137bf700 1 -- 172.21.15.103:0/1589898282 >> 172.21.15.103:0/1589898282 conn(0x7fd40c05ad30 msgr2=0x7fd40c05c640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:09.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.423+0000 7fd4137bf700 1 -- 172.21.15.103:0/1589898282 shutdown_connections 2020-04-22T14:16:09.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.423+0000 7fd4137bf700 1 -- 172.21.15.103:0/1589898282 wait complete. 2020-04-22T14:16:09.429 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.3 2020-04-22T14:16:09.435 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:09.449 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:16:09.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.595+0000 7f9279738700 1 Processor -- start 2020-04-22T14:16:09.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.595+0000 7f9279738700 1 -- start start 2020-04-22T14:16:09.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.596+0000 7f9279738700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f927412c0d0 0x7f92741464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:09.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.596+0000 7f9279738700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9274063e30 0x7f92740642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:09.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.596+0000 7f9279738700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9274143300 con 0x7f9274065fe0 2020-04-22T14:16:09.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.596+0000 7f9279738700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92741435a0 con 0x7f927412c0d0 2020-04-22T14:16:09.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.596+0000 7f9279738700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9274143840 con 0x7f9274063e30 2020-04-22T14:16:09.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.596+0000 7f92737fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9274063e30 0x7f92740642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:09.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.596+0000 7f92727fc700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f9274065fe0 0x7f927405b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48158/0 (socket says 172.21.15.103:48158) 2020-04-22T14:16:09.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.596+0000 7f92737fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9274063e30 0x7f92740642c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55970/0 (socket says 172.21.15.103:55970) 2020-04-22T14:16:09.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.596+0000 7f92727fc700 1 -- 172.21.15.103:0/906677187 learned_addr learned my addr 172.21.15.103:0/906677187 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:09.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.596+0000 7f9272ffd700 1 --2- 172.21.15.103:0/906677187 >> v2:172.21.15.86:3300/0 conn(0x7f927412c0d0 0x7f92741464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:09.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.596+0000 7f92737fe700 1 -- 172.21.15.103:0/906677187 >> v2:172.21.15.86:3300/0 conn(0x7f927412c0d0 msgr2=0x7f92741464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:09.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.596+0000 7f92737fe700 1 --2- 172.21.15.103:0/906677187 >> v2:172.21.15.86:3300/0 conn(0x7f927412c0d0 0x7f92741464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:09.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.596+0000 7f92737fe700 1 -- 172.21.15.103:0/906677187 >> v1:172.21.15.103:6789/0 conn(0x7f9274065fe0 legacy=0x7f927405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:09.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.596+0000 7f92737fe700 1 -- 172.21.15.103:0/906677187 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927405bb50 con 0x7f9274063e30 2020-04-22T14:16:09.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.596+0000 7f92737fe700 1 --2- 172.21.15.103:0/906677187 >> v2:172.21.15.103:3300/0 conn(0x7f9274063e30 0x7f92740642c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f926c0032b0 tx=0x7f926c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:09.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.597+0000 7f92737fe700 1 --2- 172.21.15.103:0/906677187 >> v2:172.21.15.103:3300/0 conn(0x7f9274063e30 0x7f92740642c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f926c0032b0 tx=0x7f926c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:09.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.597+0000 7f92737fe700 1 --2- 172.21.15.103:0/906677187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9274063e30 0x7f92740642c0 secure :-1 s=READY pgs=1624 cs=0 l=1 rx=0x7f926c0032b0 tx=0x7f926c007dc0).ready entity=mon.1 client_cookie=2a46bd75eb66d4c6 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:09.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.597+0000 7f92737fe700 1 --2- 172.21.15.103:0/906677187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9274063e30 0x7f92740642c0 secure :-1 s=THROTTLE_DONE pgs=1624 cs=0 l=1 rx=0x7f926c0032b0 tx=0x7f926c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:09.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.597+0000 7f9271ffb700 1 -- 172.21.15.103:0/906677187 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f926c00a180 con 0x7f9274063e30 2020-04-22T14:16:09.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.597+0000 7f92737fe700 1 --2- 172.21.15.103:0/906677187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9274063e30 0x7f92740642c0 secure :-1 s=THROTTLE_DONE pgs=1624 cs=0 l=1 rx=0x7f926c0032b0 tx=0x7f926c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:09.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.597+0000 7f92737fe700 1 --2- 172.21.15.103:0/906677187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9274063e30 0x7f92740642c0 secure :-1 s=THROTTLE_DONE pgs=1624 cs=0 l=1 rx=0x7f926c0032b0 tx=0x7f926c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:09.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.597+0000 7f9271ffb700 1 -- 172.21.15.103:0/906677187 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f926c00a2e0 con 0x7f9274063e30 2020-04-22T14:16:09.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.597+0000 7f9271ffb700 1 -- 172.21.15.103:0/906677187 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f926c00a700 con 0x7f9274063e30 2020-04-22T14:16:09.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.597+0000 7f9279738700 1 -- 172.21.15.103:0/906677187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9274063e30 msgr2=0x7f92740642c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:09.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.597+0000 7f9279738700 1 --2- 172.21.15.103:0/906677187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9274063e30 0x7f92740642c0 secure :-1 s=READY pgs=1624 cs=0 l=1 rx=0x7f926c0032b0 tx=0x7f926c007dc0).stop 2020-04-22T14:16:09.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.597+0000 7f9279738700 1 -- 172.21.15.103:0/906677187 shutdown_connections 2020-04-22T14:16:09.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.597+0000 7f9279738700 1 --2- 172.21.15.103:0/906677187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9274063e30 0x7f92740642c0 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:09.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.597+0000 7f9279738700 1 --2- 172.21.15.103:0/906677187 >> v2:172.21.15.86:3300/0 conn(0x7f927412c0d0 0x7f92741464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:09.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.597+0000 7f9279738700 1 -- 172.21.15.103:0/906677187 >> 172.21.15.103:0/906677187 conn(0x7f92740b9160 msgr2=0x7f927405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:09.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.597+0000 7f9279738700 1 -- 172.21.15.103:0/906677187 shutdown_connections 2020-04-22T14:16:09.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.597+0000 7f9279738700 1 -- 172.21.15.103:0/906677187 wait complete. 2020-04-22T14:16:09.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.598+0000 7f9279738700 1 Processor -- start 2020-04-22T14:16:09.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.598+0000 7f9279738700 1 -- start start 2020-04-22T14:16:09.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.599+0000 7f9279738700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f927412c0d0 0x7f92740adea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:09.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.599+0000 7f9279738700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f927412ab10 con 0x7f9274065fe0 2020-04-22T14:16:09.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.599+0000 7f9279738700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f927412adb0 con 0x7f9274063e30 2020-04-22T14:16:09.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.599+0000 7f9279738700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92740ada00 con 0x7f927412c0d0 2020-04-22T14:16:09.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.599+0000 7f9272ffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f9274063e30 0x7f92741295d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48162/0 (socket says 172.21.15.103:48162) 2020-04-22T14:16:09.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.599+0000 7f9272ffd700 1 -- 172.21.15.103:0/2549389955 learned_addr learned my addr 172.21.15.103:0/2549389955 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:09.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.599+0000 7f92737fe700 1 --2- 172.21.15.103:0/2549389955 >> v2:172.21.15.86:3300/0 conn(0x7f927412c0d0 0x7f92740adea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:09.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.599+0000 7f926bfff700 1 -- 172.21.15.103:0/2549389955 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2725240241 0 0) 0x7f927412adb0 con 0x7f9274063e30 2020-04-22T14:16:09.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.599+0000 7f926bfff700 1 -- 172.21.15.103:0/2549389955 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9258002fe0 con 0x7f9274063e30 2020-04-22T14:16:09.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.600+0000 7f926bfff700 1 -- 172.21.15.103:0/2549389955 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1096360662 0 0) 0x7f9258002fe0 con 0x7f9274063e30 2020-04-22T14:16:09.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.600+0000 7f926bfff700 1 -- 172.21.15.103:0/2549389955 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f927412adb0 con 0x7f9274063e30 2020-04-22T14:16:09.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.600+0000 7f926bfff700 1 -- 172.21.15.103:0/2549389955 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f9264002710 con 0x7f9274063e30 2020-04-22T14:16:09.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.600+0000 7f926bfff700 1 -- 172.21.15.103:0/2549389955 >> v2:172.21.15.86:3300/0 conn(0x7f927412c0d0 msgr2=0x7f92740adea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:09.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.600+0000 7f926bfff700 1 --2- 172.21.15.103:0/2549389955 >> v2:172.21.15.86:3300/0 conn(0x7f927412c0d0 0x7f92740adea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:09.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.600+0000 7f926bfff700 1 -- 172.21.15.103:0/2549389955 >> v1:172.21.15.103:6789/0 conn(0x7f9274063e30 legacy=0x7f92741295d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:09.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.600+0000 7f926bfff700 1 -- 172.21.15.103:0/2549389955 >> v1:172.21.15.86:6789/0 conn(0x7f9274065fe0 legacy=0x7f92740b5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:09.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.600+0000 7f926bfff700 1 --2- 172.21.15.103:0/2549389955 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f92580049b0 0x7f9258004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:09.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.600+0000 7f926bfff700 1 --2- 172.21.15.103:0/2549389955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9258005290 0x7f92580039a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:09.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.600+0000 7f926bfff700 1 --2- 172.21.15.103:0/2549389955 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9258003fa0 0x7f9258004450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:09.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.600+0000 7f926bfff700 1 -- 172.21.15.103:0/2549389955 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92740ada00 con 0x7f9258003fa0 2020-04-22T14:16:09.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.600+0000 7f926bfff700 1 -- 172.21.15.103:0/2549389955 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925800b940 con 0x7f9258005290 2020-04-22T14:16:09.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.600+0000 7f926bfff700 1 -- 172.21.15.103:0/2549389955 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f925800bb00 con 0x7f92580049b0 2020-04-22T14:16:09.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.600+0000 7f92737fe700 1 --2- 172.21.15.103:0/2549389955 >> v2:172.21.15.86:3300/0 conn(0x7f927412c0d0 0x7f92740adea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:16:09.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.600+0000 7f92727fc700 1 --2- 172.21.15.103:0/2549389955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9258005290 0x7f92580039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:09.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.600+0000 7f9272ffd700 1 --2- 172.21.15.103:0/2549389955 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f92580049b0 0x7f9258004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:09.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.600+0000 7f92737fe700 1 --2- 172.21.15.103:0/2549389955 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9258003fa0 0x7f9258004450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:09.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.600+0000 7f92727fc700 1 -- 172.21.15.103:0/2549389955 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f92580049b0 msgr2=0x7f9258004d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:09.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.600+0000 7f92727fc700 1 --2- 172.21.15.103:0/2549389955 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f92580049b0 0x7f9258004d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:09.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.600+0000 7f92727fc700 1 -- 172.21.15.103:0/2549389955 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9258003fa0 msgr2=0x7f9258004450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:09.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.600+0000 7f92727fc700 1 --2- 172.21.15.103:0/2549389955 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9258003fa0 0x7f9258004450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:09.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.600+0000 7f92727fc700 1 -- 172.21.15.103:0/2549389955 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92740b6010 con 0x7f9258005290 2020-04-22T14:16:09.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.600+0000 7f9279738700 1 -- 172.21.15.103:0/2549389955 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f927412a470 con 0x7f9258005290 2020-04-22T14:16:09.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.600+0000 7f92737fe700 1 --2- 172.21.15.103:0/2549389955 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9258003fa0 0x7f9258004450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:16:09.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.600+0000 7f92737fe700 1 -- 172.21.15.103:0/2549389955 reap_dead start 2020-04-22T14:16:09.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.600+0000 7f92727fc700 1 --2- 172.21.15.103:0/2549389955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9258005290 0x7f92580039a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f925c001150 tx=0x7f925c00c570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:09.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.600+0000 7f9279738700 1 -- 172.21.15.103:0/2549389955 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92740adea0 con 0x7f9258005290 2020-04-22T14:16:09.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.600+0000 7f92727fc700 1 --2- 172.21.15.103:0/2549389955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9258005290 0x7f92580039a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f925c001150 tx=0x7f925c00c570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:09.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.600+0000 7f92727fc700 1 --2- 172.21.15.103:0/2549389955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9258005290 0x7f92580039a0 secure :-1 s=READY pgs=1626 cs=0 l=1 rx=0x7f925c001150 tx=0x7f925c00c570).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:09.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.600+0000 7f92727fc700 1 --2- 172.21.15.103:0/2549389955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9258005290 0x7f92580039a0 secure :-1 s=THROTTLE_DONE pgs=1626 cs=0 l=1 rx=0x7f925c001150 tx=0x7f925c00c570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:09.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.600+0000 7f926bfff700 1 -- 172.21.15.103:0/2549389955 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f925c00c650 con 0x7f9258005290 2020-04-22T14:16:09.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.600+0000 7f92727fc700 1 --2- 172.21.15.103:0/2549389955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9258005290 0x7f92580039a0 secure :-1 s=THROTTLE_DONE pgs=1626 cs=0 l=1 rx=0x7f925c001150 tx=0x7f925c00c570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:09.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.600+0000 7f92727fc700 1 --2- 172.21.15.103:0/2549389955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9258005290 0x7f92580039a0 secure :-1 s=THROTTLE_DONE pgs=1626 cs=0 l=1 rx=0x7f925c001150 tx=0x7f925c00c570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:09.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.600+0000 7f926bfff700 1 -- 172.21.15.103:0/2549389955 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925c00c7b0 con 0x7f9258005290 2020-04-22T14:16:09.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.600+0000 7f926bfff700 1 -- 172.21.15.103:0/2549389955 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f925c00cb50 con 0x7f9258005290 2020-04-22T14:16:09.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.601+0000 7f92727fc700 1 --2- 172.21.15.103:0/2549389955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9258005290 0x7f92580039a0 secure :-1 s=THROTTLE_DONE pgs=1626 cs=0 l=1 rx=0x7f925c001150 tx=0x7f925c00c570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:09.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.601+0000 7f9279738700 1 -- 172.21.15.103:0/2549389955 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f924c003340 con 0x7f9258005290 2020-04-22T14:16:09.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.601+0000 7f926bfff700 1 -- 172.21.15.103:0/2549389955 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f925c00ccb0 con 0x7f9258005290 2020-04-22T14:16:09.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.601+0000 7f92727fc700 1 --2- 172.21.15.103:0/2549389955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9258005290 0x7f92580039a0 secure :-1 s=THROTTLE_DONE pgs=1626 cs=0 l=1 rx=0x7f925c001150 tx=0x7f925c00c570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:09.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.602+0000 7f926bfff700 1 --2- 172.21.15.103:0/2549389955 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9258051860 0x7f9258053d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:09.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.602+0000 7f926bfff700 1 -- 172.21.15.103:0/2549389955 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f925c060e50 con 0x7f9258005290 2020-04-22T14:16:09.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.602+0000 7f9272ffd700 1 --2- 172.21.15.103:0/2549389955 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9258051860 0x7f9258053d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:09.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.602+0000 7f9272ffd700 1 --2- 172.21.15.103:0/2549389955 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9258051860 0x7f9258053d20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f92640024a0 tx=0x7f9264009de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:09.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.602+0000 7f9272ffd700 1 --2- 172.21.15.103:0/2549389955 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9258051860 0x7f9258053d20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f92640024a0 tx=0x7f9264009de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:09.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.602+0000 7f9272ffd700 1 --2- 172.21.15.103:0/2549389955 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9258051860 0x7f9258053d20 secure :-1 s=READY pgs=592 cs=0 l=1 rx=0x7f92640024a0 tx=0x7f9264009de0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:09.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.606+0000 7f92727fc700 1 --2- 172.21.15.103:0/2549389955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9258005290 0x7f92580039a0 secure :-1 s=THROTTLE_DONE pgs=1626 cs=0 l=1 rx=0x7f925c001150 tx=0x7f925c00c570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:09.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.606+0000 7f926bfff700 1 -- 172.21.15.103:0/2549389955 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f925c03c230 con 0x7f9258005290 2020-04-22T14:16:09.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.795+0000 7f9279738700 1 -- 172.21.15.103:0/2549389955 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f924c0036e0 con 0x7f9258005290 2020-04-22T14:16:09.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.795+0000 7f92727fc700 1 --2- 172.21.15.103:0/2549389955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9258005290 0x7f92580039a0 secure :-1 s=THROTTLE_DONE pgs=1626 cs=0 l=1 rx=0x7f925c001150 tx=0x7f925c00c570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:09.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.795+0000 7f926bfff700 1 -- 172.21.15.103:0/2549389955 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+2143 (secure 0 0 0) 0x7f925c03f850 con 0x7f9258005290 2020-04-22T14:16:09.798 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:16:09.799 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":82,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7776,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/3450302561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3450302561},{"type":"v1","addr":"172.21.15.86:6835","nonce":3450302561}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":78}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:16:05.150517+0000","modified":"2020-04-22T14:16:07.155780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8470":{"gid":8470,"name":"a","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/3949453152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3949453152},{"type":"v1","addr":"172.21.15.103:6833","nonce":3949453152}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2020-04-22T14:16:09.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.796+0000 7f9279738700 1 -- 172.21.15.103:0/2549389955 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9258051860 msgr2=0x7f9258053d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:09.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.796+0000 7f9279738700 1 --2- 172.21.15.103:0/2549389955 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9258051860 0x7f9258053d20 secure :-1 s=READY pgs=592 cs=0 l=1 rx=0x7f92640024a0 tx=0x7f9264009de0).stop 2020-04-22T14:16:09.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.796+0000 7f9279738700 1 -- 172.21.15.103:0/2549389955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9258005290 msgr2=0x7f92580039a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:09.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.796+0000 7f9279738700 1 --2- 172.21.15.103:0/2549389955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9258005290 0x7f92580039a0 secure :-1 s=READY pgs=1626 cs=0 l=1 rx=0x7f925c001150 tx=0x7f925c00c570).stop 2020-04-22T14:16:09.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.797+0000 7f9279738700 1 -- 172.21.15.103:0/2549389955 shutdown_connections 2020-04-22T14:16:09.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.797+0000 7f9279738700 1 --2- 172.21.15.103:0/2549389955 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9258051860 0x7f9258053d20 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:09.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.797+0000 7f9279738700 1 --2- 172.21.15.103:0/2549389955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9258005290 0x7f92580039a0 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:09.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.797+0000 7f9279738700 1 -- 172.21.15.103:0/2549389955 >> 172.21.15.103:0/2549389955 conn(0x7f92740b9160 msgr2=0x7f92740b7dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:09.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.797+0000 7f9279738700 1 -- 172.21.15.103:0/2549389955 shutdown_connections 2020-04-22T14:16:09.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:09.797+0000 7f9279738700 1 -- 172.21.15.103:0/2549389955 wait complete. 2020-04-22T14:16:09.802 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 82 2020-04-22T14:16:10.011 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 8470}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 19, u'failed': [], u'epoch': 82, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [20], u'info': {u'gid_8470': {u'export_targets': [], u'name': u'a', u'incarnation': 79, u'state_seq': 3, u'state': u'up:active', u'gid': 8470, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 3949453152, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 3949453152, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/3949453152'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:16:05.150517+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:16:07.155780+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:16:10.011 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:16:10.012 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:10.026 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:16:10.186 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:16:10.186 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:16:10.186 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:16:10.186 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 8470, 2020-04-22T14:16:10.187 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:16:10.187 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:16:10.187 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 5.0320306869999998, 2020-04-22T14:16:10.187 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 82, 2020-04-22T14:16:10.188 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 113, 2020-04-22T14:16:10.189 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 113, 2020-04-22T14:16:10.193 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 10.457478532 2020-04-22T14:16:10.194 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:16:10.195 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 8470, "want_state": "up:active", "state": "up:active", "rank_uptime": 5.0320306869999998, "mdsmap_epoch": 82, "osdmap_epoch": 113, "osdmap_epoch_barrier": 113, "uptime": 10.457478532 } 2020-04-22T14:16:10.196 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:10.210 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:16:10.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.357+0000 7ff195064700 1 Processor -- start 2020-04-22T14:16:10.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.357+0000 7ff195064700 1 -- start start 2020-04-22T14:16:10.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.357+0000 7ff195064700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff19014a4d0 0x7ff1900ac740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:10.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.357+0000 7ff195064700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff190144a20 con 0x7ff1900620a0 2020-04-22T14:16:10.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.358+0000 7ff195064700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1900acd70 con 0x7ff190062930 2020-04-22T14:16:10.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.358+0000 7ff195064700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1900661d0 con 0x7ff19014a4d0 2020-04-22T14:16:10.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.358+0000 7ff194863700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff190062930 0x7ff190062da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48176/0 (socket says 172.21.15.103:48176) 2020-04-22T14:16:10.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.358+0000 7ff194863700 1 -- 172.21.15.103:0/1229236371 learned_addr learned my addr 172.21.15.103:0/1229236371 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:10.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.358+0000 7ff18effd700 1 -- 172.21.15.103:0/1229236371 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2369839598 0 0) 0x7ff1900acd70 con 0x7ff190062930 2020-04-22T14:16:10.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.358+0000 7ff18effd700 1 -- 172.21.15.103:0/1229236371 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff17c003230 con 0x7ff190062930 2020-04-22T14:16:10.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.358+0000 7ff18f7fe700 1 --2- 172.21.15.103:0/1229236371 >> v2:172.21.15.86:3300/0 conn(0x7ff19014a4d0 0x7ff1900ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:10.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.358+0000 7ff18effd700 1 -- 172.21.15.103:0/1229236371 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4279417058 0 0) 0x7ff17c003230 con 0x7ff190062930 2020-04-22T14:16:10.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.358+0000 7ff18effd700 1 -- 172.21.15.103:0/1229236371 >> v2:172.21.15.86:3300/0 conn(0x7ff19014a4d0 msgr2=0x7ff1900ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:10.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.358+0000 7ff18effd700 1 --2- 172.21.15.103:0/1229236371 >> v2:172.21.15.86:3300/0 conn(0x7ff19014a4d0 0x7ff1900ac740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:10.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.358+0000 7ff18effd700 1 -- 172.21.15.103:0/1229236371 >> v1:172.21.15.86:6789/0 conn(0x7ff1900620a0 legacy=0x7ff19014ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:10.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.358+0000 7ff18effd700 1 -- 172.21.15.103:0/1229236371 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1900ad010 con 0x7ff190062930 2020-04-22T14:16:10.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.358+0000 7ff18effd700 1 -- 172.21.15.103:0/1229236371 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7ff188001a50 con 0x7ff190062930 2020-04-22T14:16:10.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.358+0000 7ff18effd700 1 -- 172.21.15.103:0/1229236371 >> v1:172.21.15.103:6789/0 conn(0x7ff190062930 legacy=0x7ff190062da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:10.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.358+0000 7ff18effd700 1 --2- 172.21.15.103:0/1229236371 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff17c003720 0x7ff17c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:10.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.358+0000 7ff18effd700 1 --2- 172.21.15.103:0/1229236371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff17c0044d0 0x7ff17c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:10.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.358+0000 7ff18effd700 1 --2- 172.21.15.103:0/1229236371 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff17c004db0 0x7ff17c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:10.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.358+0000 7ff18effd700 1 -- 172.21.15.103:0/1229236371 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1900661d0 con 0x7ff17c0044d0 2020-04-22T14:16:10.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.358+0000 7ff18effd700 1 -- 172.21.15.103:0/1229236371 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c0041c0 con 0x7ff17c004db0 2020-04-22T14:16:10.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.358+0000 7ff18effd700 1 -- 172.21.15.103:0/1229236371 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c00bb80 con 0x7ff17c003720 2020-04-22T14:16:10.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.358+0000 7ff194863700 1 --2- 172.21.15.103:0/1229236371 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff17c004db0 0x7ff17c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:10.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.358+0000 7ff18f7fe700 1 --2- 172.21.15.103:0/1229236371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff17c0044d0 0x7ff17c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:10.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.358+0000 7ff18ffff700 1 --2- 172.21.15.103:0/1229236371 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff17c003720 0x7ff17c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:10.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.359+0000 7ff194863700 1 -- 172.21.15.103:0/1229236371 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff17c003720 msgr2=0x7ff17c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:10.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.359+0000 7ff194863700 1 --2- 172.21.15.103:0/1229236371 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff17c003720 0x7ff17c003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:10.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.359+0000 7ff194863700 1 -- 172.21.15.103:0/1229236371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff17c0044d0 msgr2=0x7ff17c004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:10.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.359+0000 7ff194863700 1 --2- 172.21.15.103:0/1229236371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff17c0044d0 0x7ff17c004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:10.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.359+0000 7ff194863700 1 -- 172.21.15.103:0/1229236371 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17c003230 con 0x7ff17c004db0 2020-04-22T14:16:10.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.359+0000 7ff194863700 1 --2- 172.21.15.103:0/1229236371 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff17c004db0 0x7ff17c00b720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff17c0054a0 tx=0x7ff18800c6c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:10.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.359+0000 7ff194863700 1 -- 172.21.15.103:0/1229236371 reap_dead start 2020-04-22T14:16:10.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.359+0000 7ff194863700 1 --2- 172.21.15.103:0/1229236371 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff17c004db0 0x7ff17c00b720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff17c0054a0 tx=0x7ff18800c6c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:10.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.359+0000 7ff194863700 1 --2- 172.21.15.103:0/1229236371 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff17c004db0 0x7ff17c00b720 secure :-1 s=READY pgs=1628 cs=0 l=1 rx=0x7ff17c0054a0 tx=0x7ff18800c6c0).ready entity=mon.1 client_cookie=f40827f936d40713 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:10.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.359+0000 7ff194863700 1 --2- 172.21.15.103:0/1229236371 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff17c004db0 0x7ff17c00b720 secure :-1 s=THROTTLE_DONE pgs=1628 cs=0 l=1 rx=0x7ff17c0054a0 tx=0x7ff18800c6c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:10.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.359+0000 7ff18effd700 1 -- 172.21.15.103:0/1229236371 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff188005d40 con 0x7ff17c004db0 2020-04-22T14:16:10.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.359+0000 7ff194863700 1 --2- 172.21.15.103:0/1229236371 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff17c004db0 0x7ff17c00b720 secure :-1 s=THROTTLE_DONE pgs=1628 cs=0 l=1 rx=0x7ff17c0054a0 tx=0x7ff18800c6c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:10.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.359+0000 7ff18effd700 1 -- 172.21.15.103:0/1229236371 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff18800e180 con 0x7ff17c004db0 2020-04-22T14:16:10.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.359+0000 7ff194863700 1 --2- 172.21.15.103:0/1229236371 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff17c004db0 0x7ff17c00b720 secure :-1 s=THROTTLE_DONE pgs=1628 cs=0 l=1 rx=0x7ff17c0054a0 tx=0x7ff18800c6c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:10.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.359+0000 7ff18effd700 1 -- 172.21.15.103:0/1229236371 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff188005ea0 con 0x7ff17c004db0 2020-04-22T14:16:10.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.359+0000 7ff195064700 1 -- 172.21.15.103:0/1229236371 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff17c004db0 msgr2=0x7ff17c00b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:10.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.359+0000 7ff195064700 1 --2- 172.21.15.103:0/1229236371 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff17c004db0 0x7ff17c00b720 secure :-1 s=READY pgs=1628 cs=0 l=1 rx=0x7ff17c0054a0 tx=0x7ff18800c6c0).stop 2020-04-22T14:16:10.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.359+0000 7ff195064700 1 -- 172.21.15.103:0/1229236371 shutdown_connections 2020-04-22T14:16:10.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.359+0000 7ff195064700 1 --2- 172.21.15.103:0/1229236371 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff17c004db0 0x7ff17c00b720 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:10.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.359+0000 7ff195064700 1 -- 172.21.15.103:0/1229236371 >> 172.21.15.103:0/1229236371 conn(0x7ff19005b7c0 msgr2=0x7ff190061610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:10.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.359+0000 7ff195064700 1 -- 172.21.15.103:0/1229236371 shutdown_connections 2020-04-22T14:16:10.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.359+0000 7ff195064700 1 -- 172.21.15.103:0/1229236371 wait complete. 2020-04-22T14:16:10.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.360+0000 7ff195064700 1 Processor -- start 2020-04-22T14:16:10.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.360+0000 7ff195064700 1 -- start start 2020-04-22T14:16:10.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.361+0000 7ff195064700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff17c004db0 0x7ff190147690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:10.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.361+0000 7ff195064700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1900adb70 con 0x7ff190133440 2020-04-22T14:16:10.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.361+0000 7ff195064700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1900b7510 con 0x7ff1900b7c50 2020-04-22T14:16:10.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.361+0000 7ff195064700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1901338d0 con 0x7ff17c004db0 2020-04-22T14:16:10.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.361+0000 7ff18f7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff1900b7c50 0x7ff190130cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48190/0 (socket says 172.21.15.103:48190) 2020-04-22T14:16:10.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.361+0000 7ff18f7fe700 1 -- 172.21.15.103:0/1304070575 learned_addr learned my addr 172.21.15.103:0/1304070575 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:10.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.361+0000 7ff18d7fa700 1 -- 172.21.15.103:0/1304070575 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1778439807 0 0) 0x7ff1900b7510 con 0x7ff1900b7c50 2020-04-22T14:16:10.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.361+0000 7ff18d7fa700 1 -- 172.21.15.103:0/1304070575 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff170002fe0 con 0x7ff1900b7c50 2020-04-22T14:16:10.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.361+0000 7ff18ffff700 1 --2- 172.21.15.103:0/1304070575 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff17c004db0 0x7ff190147690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:10.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.362+0000 7ff18d7fa700 1 -- 172.21.15.103:0/1304070575 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4257499099 0 0) 0x7ff170002fe0 con 0x7ff1900b7c50 2020-04-22T14:16:10.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.362+0000 7ff18d7fa700 1 -- 172.21.15.103:0/1304070575 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff1900b7510 con 0x7ff1900b7c50 2020-04-22T14:16:10.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.362+0000 7ff18d7fa700 1 -- 172.21.15.103:0/1304070575 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7ff184001490 con 0x7ff1900b7c50 2020-04-22T14:16:10.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.362+0000 7ff18d7fa700 1 -- 172.21.15.103:0/1304070575 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff17c004db0 msgr2=0x7ff190147690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:10.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.362+0000 7ff18d7fa700 1 --2- 172.21.15.103:0/1304070575 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff17c004db0 0x7ff190147690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:10.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.362+0000 7ff18d7fa700 1 -- 172.21.15.103:0/1304070575 >> v1:172.21.15.103:6789/0 conn(0x7ff1900b7c50 legacy=0x7ff190130cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:10.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.362+0000 7ff18d7fa700 1 -- 172.21.15.103:0/1304070575 >> v1:172.21.15.86:6789/0 conn(0x7ff190133440 legacy=0x7ff190146960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:10.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.362+0000 7ff18d7fa700 1 --2- 172.21.15.103:0/1304070575 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff1700049b0 0x7ff170004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:10.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.362+0000 7ff18d7fa700 1 --2- 172.21.15.103:0/1304070575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff170003920 0x7ff170003d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:10.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.362+0000 7ff18d7fa700 1 --2- 172.21.15.103:0/1304070575 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1700041e0 0x7ff17000b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:10.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.362+0000 7ff18d7fa700 1 -- 172.21.15.103:0/1304070575 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1901338d0 con 0x7ff1700041e0 2020-04-22T14:16:10.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.362+0000 7ff18d7fa700 1 -- 172.21.15.103:0/1304070575 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1700047a0 con 0x7ff170003920 2020-04-22T14:16:10.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.362+0000 7ff18d7fa700 1 -- 172.21.15.103:0/1304070575 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff17000bbe0 con 0x7ff1700049b0 2020-04-22T14:16:10.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.362+0000 7ff18f7fe700 1 --2- 172.21.15.103:0/1304070575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff170003920 0x7ff170003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:10.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.362+0000 7ff18ffff700 1 --2- 172.21.15.103:0/1304070575 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff1700049b0 0x7ff170004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:10.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.362+0000 7ff194863700 1 --2- 172.21.15.103:0/1304070575 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1700041e0 0x7ff17000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:10.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.362+0000 7ff18f7fe700 1 -- 172.21.15.103:0/1304070575 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff1700049b0 msgr2=0x7ff170004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:10.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.362+0000 7ff18f7fe700 1 --2- 172.21.15.103:0/1304070575 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff1700049b0 0x7ff170004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:10.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.362+0000 7ff18f7fe700 1 -- 172.21.15.103:0/1304070575 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1700041e0 msgr2=0x7ff17000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:10.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.362+0000 7ff18f7fe700 1 --2- 172.21.15.103:0/1304070575 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1700041e0 0x7ff17000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:10.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.362+0000 7ff18f7fe700 1 -- 172.21.15.103:0/1304070575 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1900b77b0 con 0x7ff170003920 2020-04-22T14:16:10.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.362+0000 7ff195064700 1 -- 172.21.15.103:0/1304070575 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff190157f20 con 0x7ff170003920 2020-04-22T14:16:10.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.362+0000 7ff18f7fe700 1 --2- 172.21.15.103:0/1304070575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff170003920 0x7ff170003d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff184002ef0 tx=0x7ff184011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:10.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.362+0000 7ff195064700 1 -- 172.21.15.103:0/1304070575 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff190131400 con 0x7ff170003920 2020-04-22T14:16:10.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.362+0000 7ff18f7fe700 1 --2- 172.21.15.103:0/1304070575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff170003920 0x7ff170003d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff184002ef0 tx=0x7ff184011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:10.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.362+0000 7ff18f7fe700 1 --2- 172.21.15.103:0/1304070575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff170003920 0x7ff170003d80 secure :-1 s=READY pgs=1630 cs=0 l=1 rx=0x7ff184002ef0 tx=0x7ff184011510).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:10.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.362+0000 7ff18f7fe700 1 --2- 172.21.15.103:0/1304070575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff170003920 0x7ff170003d80 secure :-1 s=THROTTLE_DONE pgs=1630 cs=0 l=1 rx=0x7ff184002ef0 tx=0x7ff184011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:10.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.362+0000 7ff18f7fe700 1 --2- 172.21.15.103:0/1304070575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff170003920 0x7ff170003d80 secure :-1 s=THROTTLE_DONE pgs=1630 cs=0 l=1 rx=0x7ff184002ef0 tx=0x7ff184011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:10.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.362+0000 7ff18d7fa700 1 -- 172.21.15.103:0/1304070575 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff184011e80 con 0x7ff170003920 2020-04-22T14:16:10.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.362+0000 7ff18f7fe700 1 --2- 172.21.15.103:0/1304070575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff170003920 0x7ff170003d80 secure :-1 s=THROTTLE_DONE pgs=1630 cs=0 l=1 rx=0x7ff184002ef0 tx=0x7ff184011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:10.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.362+0000 7ff18d7fa700 1 -- 172.21.15.103:0/1304070575 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff184005aa0 con 0x7ff170003920 2020-04-22T14:16:10.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.363+0000 7ff18d7fa700 1 -- 172.21.15.103:0/1304070575 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff184005e80 con 0x7ff170003920 2020-04-22T14:16:10.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.363+0000 7ff18f7fe700 1 --2- 172.21.15.103:0/1304070575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff170003920 0x7ff170003d80 secure :-1 s=THROTTLE_DONE pgs=1630 cs=0 l=1 rx=0x7ff184002ef0 tx=0x7ff184011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:10.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.363+0000 7ff195064700 1 -- 172.21.15.103:0/1304070575 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff16c003340 con 0x7ff170003920 2020-04-22T14:16:10.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.363+0000 7ff18d7fa700 1 -- 172.21.15.103:0/1304070575 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ff18400b4c0 con 0x7ff170003920 2020-04-22T14:16:10.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.363+0000 7ff18f7fe700 1 --2- 172.21.15.103:0/1304070575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff170003920 0x7ff170003d80 secure :-1 s=THROTTLE_DONE pgs=1630 cs=0 l=1 rx=0x7ff184002ef0 tx=0x7ff184011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:10.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.364+0000 7ff18d7fa700 1 --2- 172.21.15.103:0/1304070575 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff170056330 0x7ff1700587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:10.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.364+0000 7ff18d7fa700 1 -- 172.21.15.103:0/1304070575 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff184061c80 con 0x7ff170003920 2020-04-22T14:16:10.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.364+0000 7ff18ffff700 1 --2- 172.21.15.103:0/1304070575 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff170056330 0x7ff1700587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:10.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.364+0000 7ff18ffff700 1 --2- 172.21.15.103:0/1304070575 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff170056330 0x7ff1700587f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff190067580 tx=0x7ff18000c9a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:10.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.364+0000 7ff18ffff700 1 --2- 172.21.15.103:0/1304070575 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff170056330 0x7ff1700587f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff190067580 tx=0x7ff18000c9a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:10.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.364+0000 7ff18ffff700 1 --2- 172.21.15.103:0/1304070575 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff170056330 0x7ff1700587f0 secure :-1 s=READY pgs=593 cs=0 l=1 rx=0x7ff190067580 tx=0x7ff18000c9a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:10.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.368+0000 7ff18f7fe700 1 --2- 172.21.15.103:0/1304070575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff170003920 0x7ff170003d80 secure :-1 s=THROTTLE_DONE pgs=1630 cs=0 l=1 rx=0x7ff184002ef0 tx=0x7ff184011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:10.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.368+0000 7ff18d7fa700 1 -- 172.21.15.103:0/1304070575 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ff18403d060 con 0x7ff170003920 2020-04-22T14:16:10.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.510+0000 7ff195064700 1 -- 172.21.15.103:0/1304070575 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff16c0021d0 con 0x7ff170003920 2020-04-22T14:16:10.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.511+0000 7ff18f7fe700 1 --2- 172.21.15.103:0/1304070575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff170003920 0x7ff170003d80 secure :-1 s=THROTTLE_DONE pgs=1630 cs=0 l=1 rx=0x7ff184002ef0 tx=0x7ff184011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:10.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.511+0000 7ff18d7fa700 1 -- 172.21.15.103:0/1304070575 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+16103 (secure 0 0 0) 0x7ff184040680 con 0x7ff170003920 2020-04-22T14:16:10.513 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:16:10.514 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":113,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:16:06.152090+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:16:02.890350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2020-04-22T14:16:03.893169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:16:10.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.512+0000 7ff195064700 1 -- 172.21.15.103:0/1304070575 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff170056330 msgr2=0x7ff1700587f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:10.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.512+0000 7ff195064700 1 --2- 172.21.15.103:0/1304070575 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff170056330 0x7ff1700587f0 secure :-1 s=READY pgs=593 cs=0 l=1 rx=0x7ff190067580 tx=0x7ff18000c9a0).stop 2020-04-22T14:16:10.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.512+0000 7ff195064700 1 -- 172.21.15.103:0/1304070575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff170003920 msgr2=0x7ff170003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:10.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.512+0000 7ff195064700 1 --2- 172.21.15.103:0/1304070575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff170003920 0x7ff170003d80 secure :-1 s=READY pgs=1630 cs=0 l=1 rx=0x7ff184002ef0 tx=0x7ff184011510).stop 2020-04-22T14:16:10.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.512+0000 7ff194863700 1 -- 172.21.15.103:0/1304070575 reap_dead start 2020-04-22T14:16:10.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.512+0000 7ff194863700 1 -- 172.21.15.103:0/1304070575 reap_dead start 2020-04-22T14:16:10.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.513+0000 7ff195064700 1 -- 172.21.15.103:0/1304070575 shutdown_connections 2020-04-22T14:16:10.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.513+0000 7ff195064700 1 -- 172.21.15.103:0/1304070575 >> 172.21.15.103:0/1304070575 conn(0x7ff19005b7c0 msgr2=0x7ff190063a20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:10.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.513+0000 7ff195064700 1 -- 172.21.15.103:0/1304070575 shutdown_connections 2020-04-22T14:16:10.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.513+0000 7ff195064700 1 -- 172.21.15.103:0/1304070575 wait complete. 2020-04-22T14:16:10.534 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:16:02.890350+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 19, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'112', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:16:03.893169+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 20, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'113', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:16:10.535 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:10.551 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:16:10.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.697+0000 7f2afba45700 1 Processor -- start 2020-04-22T14:16:10.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.697+0000 7f2afba45700 1 -- start start 2020-04-22T14:16:10.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.698+0000 7f2afba45700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2af40b9140 0x7f2af412b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:10.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.698+0000 7f2afba45700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2af40ac950 0x7f2af412b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:10.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.698+0000 7f2afba45700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2af41467e0 con 0x7f2af4146c40 2020-04-22T14:16:10.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.698+0000 7f2afba45700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2af40602f0 con 0x7f2af40ac950 2020-04-22T14:16:10.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.698+0000 7f2afba45700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af4060050 con 0x7f2af40b9140 2020-04-22T14:16:10.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.698+0000 7f2af9fe2700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f2af4146c40 0x7f2af4143090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48202/0 (socket says 172.21.15.103:48202) 2020-04-22T14:16:10.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.698+0000 7f2af9fe2700 1 -- 172.21.15.103:0/149199835 learned_addr learned my addr 172.21.15.103:0/149199835 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:10.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.698+0000 7f2af97e1700 1 --2- 172.21.15.103:0/149199835 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2af40b9140 0x7f2af412b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:10.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.698+0000 7f2af8fe0700 1 --2- 172.21.15.103:0/149199835 >> v2:172.21.15.86:3300/0 conn(0x7f2af40ac950 0x7f2af412b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:10.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.698+0000 7f2ae7fff700 1 -- 172.21.15.103:0/149199835 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2969294692 0 0) 0x7f2af41467e0 con 0x7f2af4146c40 2020-04-22T14:16:10.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.698+0000 7f2ae7fff700 1 -- 172.21.15.103:0/149199835 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2adc003230 con 0x7f2af4146c40 2020-04-22T14:16:10.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.698+0000 7f2ae7fff700 1 -- 172.21.15.103:0/149199835 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3688378266 0 0) 0x7f2adc003230 con 0x7f2af4146c40 2020-04-22T14:16:10.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.698+0000 7f2ae7fff700 1 -- 172.21.15.103:0/149199835 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2af40b9140 msgr2=0x7f2af412b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:10.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.698+0000 7f2ae7fff700 1 --2- 172.21.15.103:0/149199835 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2af40b9140 0x7f2af412b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:10.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.698+0000 7f2ae7fff700 1 -- 172.21.15.103:0/149199835 >> v2:172.21.15.86:3300/0 conn(0x7f2af40ac950 msgr2=0x7f2af412b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:10.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.698+0000 7f2ae7fff700 1 --2- 172.21.15.103:0/149199835 >> v2:172.21.15.86:3300/0 conn(0x7f2af40ac950 0x7f2af412b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:10.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.699+0000 7f2ae7fff700 1 -- 172.21.15.103:0/149199835 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af40b9520 con 0x7f2af4146c40 2020-04-22T14:16:10.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.699+0000 7f2ae7fff700 1 -- 172.21.15.103:0/149199835 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f2aec001a50 con 0x7f2af4146c40 2020-04-22T14:16:10.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.699+0000 7f2af8fe0700 1 --2- 172.21.15.103:0/149199835 >> v2:172.21.15.86:3300/0 conn(0x7f2af40ac950 0x7f2af412b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:16:10.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.699+0000 7f2ae7fff700 1 -- 172.21.15.103:0/149199835 >> v1:172.21.15.103:6789/0 conn(0x7f2af4146c40 legacy=0x7f2af4143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:10.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.699+0000 7f2ae7fff700 1 --2- 172.21.15.103:0/149199835 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2af40b9140 0x7f2adc003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:10.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.699+0000 7f2ae7fff700 1 --2- 172.21.15.103:0/149199835 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2adc003b80 0x7f2adc003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:10.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.699+0000 7f2ae7fff700 1 --2- 172.21.15.103:0/149199835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2adc0045c0 0x7f2adc004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:10.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.699+0000 7f2ae7fff700 1 -- 172.21.15.103:0/149199835 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af40602f0 con 0x7f2adc003b80 2020-04-22T14:16:10.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.699+0000 7f2ae7fff700 1 -- 172.21.15.103:0/149199835 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af4060050 con 0x7f2adc0045c0 2020-04-22T14:16:10.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.699+0000 7f2ae7fff700 1 -- 172.21.15.103:0/149199835 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc005050 con 0x7f2af40b9140 2020-04-22T14:16:10.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.699+0000 7f2af9fe2700 1 --2- 172.21.15.103:0/149199835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2adc0045c0 0x7f2adc004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:10.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.699+0000 7f2af97e1700 1 --2- 172.21.15.103:0/149199835 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2af40b9140 0x7f2adc003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:10.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.699+0000 7f2af8fe0700 1 --2- 172.21.15.103:0/149199835 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2adc003b80 0x7f2adc003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:10.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.699+0000 7f2af9fe2700 1 -- 172.21.15.103:0/149199835 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2af40b9140 msgr2=0x7f2adc003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:10.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.699+0000 7f2af9fe2700 1 --2- 172.21.15.103:0/149199835 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2af40b9140 0x7f2adc003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:10.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.699+0000 7f2af9fe2700 1 -- 172.21.15.103:0/149199835 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2adc003b80 msgr2=0x7f2adc003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:10.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.699+0000 7f2af9fe2700 1 --2- 172.21.15.103:0/149199835 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2adc003b80 0x7f2adc003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:10.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.699+0000 7f2af9fe2700 1 -- 172.21.15.103:0/149199835 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2adc003230 con 0x7f2adc0045c0 2020-04-22T14:16:10.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.699+0000 7f2af9fe2700 1 --2- 172.21.15.103:0/149199835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2adc0045c0 0x7f2adc004a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2aec001760 tx=0x7f2af40b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:10.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.699+0000 7f2af9fe2700 1 --2- 172.21.15.103:0/149199835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2adc0045c0 0x7f2adc004a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2aec001760 tx=0x7f2af40b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:10.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.699+0000 7f2af9fe2700 1 --2- 172.21.15.103:0/149199835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2adc0045c0 0x7f2adc004a20 secure :-1 s=READY pgs=1632 cs=0 l=1 rx=0x7f2aec001760 tx=0x7f2af40b96b0).ready entity=mon.1 client_cookie=3408add87b78c2c1 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:10.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.699+0000 7f2af9fe2700 1 --2- 172.21.15.103:0/149199835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2adc0045c0 0x7f2adc004a20 secure :-1 s=THROTTLE_DONE pgs=1632 cs=0 l=1 rx=0x7f2aec001760 tx=0x7f2af40b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:10.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.699+0000 7f2af9fe2700 1 --2- 172.21.15.103:0/149199835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2adc0045c0 0x7f2adc004a20 secure :-1 s=THROTTLE_DONE pgs=1632 cs=0 l=1 rx=0x7f2aec001760 tx=0x7f2af40b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:10.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.699+0000 7f2ae7fff700 1 -- 172.21.15.103:0/149199835 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2aec00e560 con 0x7f2adc0045c0 2020-04-22T14:16:10.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.699+0000 7f2af9fe2700 1 --2- 172.21.15.103:0/149199835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2adc0045c0 0x7f2adc004a20 secure :-1 s=THROTTLE_DONE pgs=1632 cs=0 l=1 rx=0x7f2aec001760 tx=0x7f2af40b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:10.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.699+0000 7f2ae7fff700 1 -- 172.21.15.103:0/149199835 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aec00e6c0 con 0x7f2adc0045c0 2020-04-22T14:16:10.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.699+0000 7f2ae7fff700 1 -- 172.21.15.103:0/149199835 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2aec0100c0 con 0x7f2adc0045c0 2020-04-22T14:16:10.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.699+0000 7f2afba45700 1 -- 172.21.15.103:0/149199835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2adc0045c0 msgr2=0x7f2adc004a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:10.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.699+0000 7f2afba45700 1 --2- 172.21.15.103:0/149199835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2adc0045c0 0x7f2adc004a20 secure :-1 s=READY pgs=1632 cs=0 l=1 rx=0x7f2aec001760 tx=0x7f2af40b96b0).stop 2020-04-22T14:16:10.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.699+0000 7f2af9fe2700 1 -- 172.21.15.103:0/149199835 reap_dead start 2020-04-22T14:16:10.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.700+0000 7f2afba45700 1 -- 172.21.15.103:0/149199835 shutdown_connections 2020-04-22T14:16:10.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.700+0000 7f2afba45700 1 -- 172.21.15.103:0/149199835 >> 172.21.15.103:0/149199835 conn(0x7f2af405b7b0 msgr2=0x7f2af40b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:10.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.700+0000 7f2afba45700 1 -- 172.21.15.103:0/149199835 shutdown_connections 2020-04-22T14:16:10.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.700+0000 7f2afba45700 1 -- 172.21.15.103:0/149199835 wait complete. 2020-04-22T14:16:10.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.701+0000 7f2afba45700 1 Processor -- start 2020-04-22T14:16:10.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.701+0000 7f2afba45700 1 -- start start 2020-04-22T14:16:10.714 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.701+0000 7f2afba45700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2af41193b0 0x7f2af41435c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:10.714 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.701+0000 7f2afba45700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2af4142250 0x7f2af40afac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:10.714 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.702+0000 7f2afba45700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2af4118c90 con 0x7f2af40aff20 2020-04-22T14:16:10.714 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.702+0000 7f2afba45700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2af40b2070 con 0x7f2af4142250 2020-04-22T14:16:10.714 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.702+0000 7f2afba45700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af4142840 con 0x7f2af41193b0 2020-04-22T14:16:10.714 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.702+0000 7f2af8fe0700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2af4142250 0x7f2af40afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:10.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.702+0000 7f2af8fe0700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2af4142250 0x7f2af40afac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56026/0 (socket says 172.21.15.103:56026) 2020-04-22T14:16:10.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.702+0000 7f2af9fe2700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f2af40aff20 0x7f2af4152aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48218/0 (socket says 172.21.15.103:48218) 2020-04-22T14:16:10.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.702+0000 7f2af8fe0700 1 -- 172.21.15.103:0/1901403830 learned_addr learned my addr 172.21.15.103:0/1901403830 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:10.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.702+0000 7f2af97e1700 1 --2- 172.21.15.103:0/1901403830 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2af41193b0 0x7f2af41435c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:10.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.702+0000 7f2af8fe0700 1 -- 172.21.15.103:0/1901403830 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2af41193b0 msgr2=0x7f2af41435c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:10.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.702+0000 7f2af8fe0700 1 --2- 172.21.15.103:0/1901403830 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2af41193b0 0x7f2af41435c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:10.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.702+0000 7f2ae67fc700 1 -- 172.21.15.103:0/1901403830 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 385237514 0 0) 0x7f2af4118c90 con 0x7f2af40aff20 2020-04-22T14:16:10.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.702+0000 7f2af8fe0700 1 -- 172.21.15.103:0/1901403830 >> v1:172.21.15.103:6789/0 conn(0x7f2af40aff20 legacy=0x7f2af4152aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:10.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.702+0000 7f2af8fe0700 1 -- 172.21.15.103:0/1901403830 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af4142ae0 con 0x7f2af4142250 2020-04-22T14:16:10.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.702+0000 7f2af97e1700 1 --2- 172.21.15.103:0/1901403830 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2af41193b0 0x7f2af41435c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:16:10.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.702+0000 7f2af8fe0700 1 --2- 172.21.15.103:0/1901403830 >> v2:172.21.15.103:3300/0 conn(0x7f2af4142250 0x7f2af40afac0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2af4128470 tx=0x7f2af000c2b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:10.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.702+0000 7f2af8fe0700 1 --2- 172.21.15.103:0/1901403830 >> v2:172.21.15.103:3300/0 conn(0x7f2af4142250 0x7f2af40afac0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2af4128470 tx=0x7f2af000c2b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:10.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.702+0000 7f2af8fe0700 1 --2- 172.21.15.103:0/1901403830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2af4142250 0x7f2af40afac0 secure :-1 s=READY pgs=1634 cs=0 l=1 rx=0x7f2af4128470 tx=0x7f2af000c2b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:10.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.702+0000 7f2af8fe0700 1 --2- 172.21.15.103:0/1901403830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2af4142250 0x7f2af40afac0 secure :-1 s=THROTTLE_DONE pgs=1634 cs=0 l=1 rx=0x7f2af4128470 tx=0x7f2af000c2b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:10.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.702+0000 7f2af8fe0700 1 --2- 172.21.15.103:0/1901403830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2af4142250 0x7f2af40afac0 secure :-1 s=THROTTLE_DONE pgs=1634 cs=0 l=1 rx=0x7f2af4128470 tx=0x7f2af000c2b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:10.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.702+0000 7f2ae67fc700 1 -- 172.21.15.103:0/1901403830 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2af0005e90 con 0x7f2af4142250 2020-04-22T14:16:10.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.702+0000 7f2af8fe0700 1 --2- 172.21.15.103:0/1901403830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2af4142250 0x7f2af40afac0 secure :-1 s=THROTTLE_DONE pgs=1634 cs=0 l=1 rx=0x7f2af4128470 tx=0x7f2af000c2b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:10.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.702+0000 7f2ae67fc700 1 -- 172.21.15.103:0/1901403830 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af0007180 con 0x7f2af4142250 2020-04-22T14:16:10.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.702+0000 7f2afba45700 1 -- 172.21.15.103:0/1901403830 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2af4142d80 con 0x7f2af4142250 2020-04-22T14:16:10.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.702+0000 7f2ae67fc700 1 -- 172.21.15.103:0/1901403830 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2af0007560 con 0x7f2af4142250 2020-04-22T14:16:10.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.702+0000 7f2afba45700 1 -- 172.21.15.103:0/1901403830 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2af41432a0 con 0x7f2af4142250 2020-04-22T14:16:10.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.703+0000 7f2af8fe0700 1 --2- 172.21.15.103:0/1901403830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2af4142250 0x7f2af40afac0 secure :-1 s=THROTTLE_DONE pgs=1634 cs=0 l=1 rx=0x7f2af4128470 tx=0x7f2af000c2b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:10.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.703+0000 7f2ae67fc700 1 -- 172.21.15.103:0/1901403830 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f2af000ebc0 con 0x7f2af4142250 2020-04-22T14:16:10.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.703+0000 7f2af8fe0700 1 --2- 172.21.15.103:0/1901403830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2af4142250 0x7f2af40afac0 secure :-1 s=THROTTLE_DONE pgs=1634 cs=0 l=1 rx=0x7f2af4128470 tx=0x7f2af000c2b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:10.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.703+0000 7f2afba45700 1 -- 172.21.15.103:0/1901403830 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2af4142f10 con 0x7f2af4142250 2020-04-22T14:16:10.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.703+0000 7f2ae67fc700 1 --2- 172.21.15.103:0/1901403830 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2ad404d890 0x7f2ad404fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:10.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.703+0000 7f2ae67fc700 1 -- 172.21.15.103:0/1901403830 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2af00638f0 con 0x7f2af4142250 2020-04-22T14:16:10.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.704+0000 7f2af97e1700 1 --2- 172.21.15.103:0/1901403830 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2ad404d890 0x7f2ad404fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:10.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.704+0000 7f2af97e1700 1 --2- 172.21.15.103:0/1901403830 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2ad404d890 0x7f2ad404fd50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2ae8002f30 tx=0x7f2ae800c870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:10.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.704+0000 7f2af97e1700 1 --2- 172.21.15.103:0/1901403830 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2ad404d890 0x7f2ad404fd50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2ae8002f30 tx=0x7f2ae800c870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:10.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.704+0000 7f2af97e1700 1 --2- 172.21.15.103:0/1901403830 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2ad404d890 0x7f2ad404fd50 secure :-1 s=READY pgs=594 cs=0 l=1 rx=0x7f2ae8002f30 tx=0x7f2ae800c870).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:10.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.708+0000 7f2af8fe0700 1 --2- 172.21.15.103:0/1901403830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2af4142250 0x7f2af40afac0 secure :-1 s=THROTTLE_DONE pgs=1634 cs=0 l=1 rx=0x7f2af4128470 tx=0x7f2af000c2b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:10.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.708+0000 7f2ae67fc700 1 -- 172.21.15.103:0/1901403830 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f2af003ecd0 con 0x7f2af4142250 2020-04-22T14:16:10.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.849+0000 7f2afba45700 1 -- 172.21.15.103:0/1901403830 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f2af4056c90 con 0x7f2af4142250 2020-04-22T14:16:10.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.849+0000 7f2af8fe0700 1 --2- 172.21.15.103:0/1901403830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2af4142250 0x7f2af40afac0 secure :-1 s=THROTTLE_DONE pgs=1634 cs=0 l=1 rx=0x7f2af4128470 tx=0x7f2af000c2b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:10.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.849+0000 7f2ae67fc700 1 -- 172.21.15.103:0/1901403830 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v113) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2af00422f0 con 0x7f2af4142250 2020-04-22T14:16:10.852 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:16:10.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.851+0000 7f2afba45700 1 -- 172.21.15.103:0/1901403830 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2ad404d890 msgr2=0x7f2ad404fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:10.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.851+0000 7f2afba45700 1 --2- 172.21.15.103:0/1901403830 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2ad404d890 0x7f2ad404fd50 secure :-1 s=READY pgs=594 cs=0 l=1 rx=0x7f2ae8002f30 tx=0x7f2ae800c870).stop 2020-04-22T14:16:10.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.851+0000 7f2afba45700 1 -- 172.21.15.103:0/1901403830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2af4142250 msgr2=0x7f2af40afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:10.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.851+0000 7f2afba45700 1 --2- 172.21.15.103:0/1901403830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2af4142250 0x7f2af40afac0 secure :-1 s=READY pgs=1634 cs=0 l=1 rx=0x7f2af4128470 tx=0x7f2af000c2b0).stop 2020-04-22T14:16:10.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.851+0000 7f2afba45700 1 -- 172.21.15.103:0/1901403830 shutdown_connections 2020-04-22T14:16:10.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.851+0000 7f2afba45700 1 --2- 172.21.15.103:0/1901403830 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2ad404d890 0x7f2ad404fd50 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:10.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.851+0000 7f2afba45700 1 --2- 172.21.15.103:0/1901403830 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2af41193b0 0x7f2af41435c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:10.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.851+0000 7f2afba45700 1 --2- 172.21.15.103:0/1901403830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2af4142250 0x7f2af40afac0 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:10.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.851+0000 7f2afba45700 1 -- 172.21.15.103:0/1901403830 >> 172.21.15.103:0/1901403830 conn(0x7f2af405b7b0 msgr2=0x7f2af40b85c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:10.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.851+0000 7f2afba45700 1 -- 172.21.15.103:0/1901403830 shutdown_connections 2020-04-22T14:16:10.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:10.851+0000 7f2afba45700 1 -- 172.21.15.103:0/1901403830 wait complete. 2020-04-22T14:16:10.863 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:10.877 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:16:11.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.023+0000 7f3ed43df700 1 Processor -- start 2020-04-22T14:16:11.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.023+0000 7f3ed43df700 1 -- start start 2020-04-22T14:16:11.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.023+0000 7f3ed43df700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3ecc0b9140 0x7f3ecc12b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:11.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.023+0000 7f3ed43df700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3ecc12b670 0x7f3ecc143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:11.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.023+0000 7f3ed43df700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ecc1467e0 con 0x7f3ecc0ac950 2020-04-22T14:16:11.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.023+0000 7f3ed43df700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ecc0602f0 con 0x7f3ecc12b670 2020-04-22T14:16:11.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.023+0000 7f3ed43df700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc060050 con 0x7f3ecc0b9140 2020-04-22T14:16:11.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.024+0000 7f3ed217b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3ecc0b9140 0x7f3ecc12b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:11.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.024+0000 7f3ed297c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3ecc12b670 0x7f3ecc143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:11.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.024+0000 7f3ed297c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3ecc12b670 0x7f3ecc143090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:53266/0 (socket says 172.21.15.103:53266) 2020-04-22T14:16:11.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.024+0000 7f3ed217b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3ecc0b9140 0x7f3ecc12b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:40812/0 (socket says 172.21.15.103:40812) 2020-04-22T14:16:11.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.024+0000 7f3ed297c700 1 -- 172.21.15.103:0/1076932191 learned_addr learned my addr 172.21.15.103:0/1076932191 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:11.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.024+0000 7f3ed197a700 1 --1- 172.21.15.103:0/1076932191 >> v1:172.21.15.86:6789/0 conn(0x7f3ecc0ac950 0x7f3ecc146c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:37146/0 (socket says 172.21.15.103:37146) 2020-04-22T14:16:11.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.024+0000 7f3ed297c700 1 -- 172.21.15.103:0/1076932191 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3ecc0b9140 msgr2=0x7f3ecc12b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:11.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.024+0000 7f3ed297c700 1 --2- 172.21.15.103:0/1076932191 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3ecc0b9140 0x7f3ecc12b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:11.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.024+0000 7f3ed297c700 1 -- 172.21.15.103:0/1076932191 >> v1:172.21.15.86:6789/0 conn(0x7f3ecc0ac950 legacy=0x7f3ecc146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:11.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.024+0000 7f3ed297c700 1 -- 172.21.15.103:0/1076932191 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ecc0b9520 con 0x7f3ecc12b670 2020-04-22T14:16:11.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.024+0000 7f3ed1179700 1 -- 172.21.15.103:0/1076932191 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 207176041 0 0) 0x7f3ecc1467e0 con 0x7f3ecc0ac950 2020-04-22T14:16:11.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.024+0000 7f3ed297c700 1 --2- 172.21.15.103:0/1076932191 >> v2:172.21.15.86:3300/0 conn(0x7f3ecc12b670 0x7f3ecc143090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3ec40032b0 tx=0x7f3ec4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.024+0000 7f3ed297c700 1 --2- 172.21.15.103:0/1076932191 >> v2:172.21.15.86:3300/0 conn(0x7f3ecc12b670 0x7f3ecc143090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3ec40032b0 tx=0x7f3ec4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.024+0000 7f3ed297c700 1 --2- 172.21.15.103:0/1076932191 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ecc12b670 0x7f3ecc143090 secure :-1 s=READY pgs=871 cs=0 l=1 rx=0x7f3ec40032b0 tx=0x7f3ec4007dc0).ready entity=mon.0 client_cookie=dc876fa40d4aa41a server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:11.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.024+0000 7f3ed297c700 1 --2- 172.21.15.103:0/1076932191 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ecc12b670 0x7f3ecc143090 secure :-1 s=THROTTLE_DONE pgs=871 cs=0 l=1 rx=0x7f3ec40032b0 tx=0x7f3ec4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.024+0000 7f3ed1179700 1 -- 172.21.15.103:0/1076932191 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ec400a180 con 0x7f3ecc12b670 2020-04-22T14:16:11.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.024+0000 7f3ed297c700 1 --2- 172.21.15.103:0/1076932191 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ecc12b670 0x7f3ecc143090 secure :-1 s=THROTTLE_DONE pgs=871 cs=0 l=1 rx=0x7f3ec40032b0 tx=0x7f3ec4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.024+0000 7f3ed297c700 1 --2- 172.21.15.103:0/1076932191 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ecc12b670 0x7f3ecc143090 secure :-1 s=THROTTLE_DONE pgs=871 cs=0 l=1 rx=0x7f3ec40032b0 tx=0x7f3ec4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.024+0000 7f3ed1179700 1 -- 172.21.15.103:0/1076932191 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec400a320 con 0x7f3ecc12b670 2020-04-22T14:16:11.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.025+0000 7f3ed1179700 1 -- 172.21.15.103:0/1076932191 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ec400a700 con 0x7f3ecc12b670 2020-04-22T14:16:11.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.025+0000 7f3ed43df700 1 -- 172.21.15.103:0/1076932191 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ecc12b670 msgr2=0x7f3ecc143090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:11.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.025+0000 7f3ed43df700 1 --2- 172.21.15.103:0/1076932191 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ecc12b670 0x7f3ecc143090 secure :-1 s=READY pgs=871 cs=0 l=1 rx=0x7f3ec40032b0 tx=0x7f3ec4007dc0).stop 2020-04-22T14:16:11.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.025+0000 7f3ed43df700 1 -- 172.21.15.103:0/1076932191 shutdown_connections 2020-04-22T14:16:11.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.025+0000 7f3ed43df700 1 --2- 172.21.15.103:0/1076932191 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ecc12b670 0x7f3ecc143090 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:11.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.025+0000 7f3ed43df700 1 --2- 172.21.15.103:0/1076932191 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3ecc0b9140 0x7f3ecc12b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:11.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.025+0000 7f3ed43df700 1 -- 172.21.15.103:0/1076932191 >> 172.21.15.103:0/1076932191 conn(0x7f3ecc05b7b0 msgr2=0x7f3ecc0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:11.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.025+0000 7f3ed43df700 1 -- 172.21.15.103:0/1076932191 shutdown_connections 2020-04-22T14:16:11.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.025+0000 7f3ed43df700 1 -- 172.21.15.103:0/1076932191 wait complete. 2020-04-22T14:16:11.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.026+0000 7f3ed43df700 1 Processor -- start 2020-04-22T14:16:11.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.026+0000 7f3ed43df700 1 -- start start 2020-04-22T14:16:11.035 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.027+0000 7f3ed43df700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3ecc0ac950 0x7f3ecc0b03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:11.035 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.027+0000 7f3ed43df700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ecc0b2a40 con 0x7f3ecc12b670 2020-04-22T14:16:11.035 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.027+0000 7f3ed43df700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ecc153ae0 con 0x7f3ecc0b9140 2020-04-22T14:16:11.035 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.027+0000 7f3ed43df700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ecc153d80 con 0x7f3ecc0ac950 2020-04-22T14:16:11.035 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.027+0000 7f3ed217b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3ecc0ac950 0x7f3ecc0b03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:11.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.027+0000 7f3ed217b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3ecc0ac950 0x7f3ecc0b03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56038/0 (socket says 172.21.15.103:56038) 2020-04-22T14:16:11.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.027+0000 7f3ed197a700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f3ecc0b9140 0x7f3ecc154220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48230/0 (socket says 172.21.15.103:48230) 2020-04-22T14:16:11.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.027+0000 7f3ed217b700 1 -- 172.21.15.103:0/3402223026 learned_addr learned my addr 172.21.15.103:0/3402223026 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:11.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.027+0000 7f3ed217b700 1 -- 172.21.15.103:0/3402223026 >> v1:172.21.15.103:6789/0 conn(0x7f3ecc0b9140 legacy=0x7f3ecc154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:11.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.027+0000 7f3ebf7fe700 1 -- 172.21.15.103:0/3402223026 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1447364141 0 0) 0x7f3ecc153ae0 con 0x7f3ecc0b9140 2020-04-22T14:16:11.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.027+0000 7f3ed217b700 1 -- 172.21.15.103:0/3402223026 >> v1:172.21.15.86:6789/0 conn(0x7f3ecc12b670 legacy=0x7f3ecc150420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:11.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.027+0000 7f3ed217b700 1 -- 172.21.15.103:0/3402223026 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ecc154930 con 0x7f3ecc0ac950 2020-04-22T14:16:11.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.027+0000 7f3ed217b700 1 --2- 172.21.15.103:0/3402223026 >> v2:172.21.15.103:3300/0 conn(0x7f3ecc0ac950 0x7f3ecc0b03a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3ec4008250 tx=0x7f3ec8010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.027+0000 7f3ed217b700 1 --2- 172.21.15.103:0/3402223026 >> v2:172.21.15.103:3300/0 conn(0x7f3ecc0ac950 0x7f3ecc0b03a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3ec4008250 tx=0x7f3ec8010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.027+0000 7f3ed217b700 1 --2- 172.21.15.103:0/3402223026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ecc0ac950 0x7f3ecc0b03a0 secure :-1 s=READY pgs=1636 cs=0 l=1 rx=0x7f3ec4008250 tx=0x7f3ec8010e10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:11.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.027+0000 7f3ed217b700 1 --2- 172.21.15.103:0/3402223026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ecc0ac950 0x7f3ecc0b03a0 secure :-1 s=THROTTLE_DONE pgs=1636 cs=0 l=1 rx=0x7f3ec4008250 tx=0x7f3ec8010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.027+0000 7f3ebf7fe700 1 -- 172.21.15.103:0/3402223026 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ec8008d50 con 0x7f3ecc0ac950 2020-04-22T14:16:11.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.027+0000 7f3ed217b700 1 --2- 172.21.15.103:0/3402223026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ecc0ac950 0x7f3ecc0b03a0 secure :-1 s=THROTTLE_DONE pgs=1636 cs=0 l=1 rx=0x7f3ec4008250 tx=0x7f3ec8010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.027+0000 7f3ed217b700 1 --2- 172.21.15.103:0/3402223026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ecc0ac950 0x7f3ecc0b03a0 secure :-1 s=THROTTLE_DONE pgs=1636 cs=0 l=1 rx=0x7f3ec4008250 tx=0x7f3ec8010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.027+0000 7f3ebf7fe700 1 -- 172.21.15.103:0/3402223026 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec80056c0 con 0x7f3ecc0ac950 2020-04-22T14:16:11.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.027+0000 7f3ed43df700 1 -- 172.21.15.103:0/3402223026 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ecc0b47b0 con 0x7f3ecc0ac950 2020-04-22T14:16:11.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.027+0000 7f3ebf7fe700 1 -- 172.21.15.103:0/3402223026 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ec8005a20 con 0x7f3ecc0ac950 2020-04-22T14:16:11.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.027+0000 7f3ed43df700 1 -- 172.21.15.103:0/3402223026 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ecc150b30 con 0x7f3ecc0ac950 2020-04-22T14:16:11.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.028+0000 7f3ed217b700 1 --2- 172.21.15.103:0/3402223026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ecc0ac950 0x7f3ecc0b03a0 secure :-1 s=THROTTLE_DONE pgs=1636 cs=0 l=1 rx=0x7f3ec4008250 tx=0x7f3ec8010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.029+0000 7f3ebf7fe700 1 -- 172.21.15.103:0/3402223026 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f3ec8005c20 con 0x7f3ecc0ac950 2020-04-22T14:16:11.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.029+0000 7f3ed217b700 1 --2- 172.21.15.103:0/3402223026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ecc0ac950 0x7f3ecc0b03a0 secure :-1 s=THROTTLE_DONE pgs=1636 cs=0 l=1 rx=0x7f3ec4008250 tx=0x7f3ec8010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.029+0000 7f3ed43df700 1 -- 172.21.15.103:0/3402223026 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ecc056c90 con 0x7f3ecc0ac950 2020-04-22T14:16:11.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.029+0000 7f3ebf7fe700 1 --2- 172.21.15.103:0/3402223026 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3eac04d830 0x7f3eac04fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:11.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.029+0000 7f3ebf7fe700 1 -- 172.21.15.103:0/3402223026 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3ec80617a0 con 0x7f3ecc0ac950 2020-04-22T14:16:11.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.029+0000 7f3ed197a700 1 --2- 172.21.15.103:0/3402223026 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3eac04d830 0x7f3eac04fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:11.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.029+0000 7f3ed197a700 1 --2- 172.21.15.103:0/3402223026 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3eac04d830 0x7f3eac04fcf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3ec0000ee0 tx=0x7f3ec0001720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.029+0000 7f3ed197a700 1 --2- 172.21.15.103:0/3402223026 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3eac04d830 0x7f3eac04fcf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3ec0000ee0 tx=0x7f3ec0001720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.029+0000 7f3ed197a700 1 --2- 172.21.15.103:0/3402223026 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3eac04d830 0x7f3eac04fcf0 secure :-1 s=READY pgs=595 cs=0 l=1 rx=0x7f3ec0000ee0 tx=0x7f3ec0001720).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:11.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.033+0000 7f3ed217b700 1 --2- 172.21.15.103:0/3402223026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ecc0ac950 0x7f3ecc0b03a0 secure :-1 s=THROTTLE_DONE pgs=1636 cs=0 l=1 rx=0x7f3ec4008250 tx=0x7f3ec8010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.033+0000 7f3ebf7fe700 1 -- 172.21.15.103:0/3402223026 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f3ec803cbe0 con 0x7f3ecc0ac950 2020-04-22T14:16:11.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.175+0000 7f3ed43df700 1 -- 172.21.15.103:0/3402223026 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3ecc066ce0 con 0x7f3ecc0ac950 2020-04-22T14:16:11.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.175+0000 7f3ed217b700 1 --2- 172.21.15.103:0/3402223026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ecc0ac950 0x7f3ecc0b03a0 secure :-1 s=THROTTLE_DONE pgs=1636 cs=0 l=1 rx=0x7f3ec4008250 tx=0x7f3ec8010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.175+0000 7f3ebf7fe700 1 -- 172.21.15.103:0/3402223026 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v113) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3ec8040200 con 0x7f3ecc0ac950 2020-04-22T14:16:11.178 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:16:11.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.177+0000 7f3ed43df700 1 -- 172.21.15.103:0/3402223026 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3eac04d830 msgr2=0x7f3eac04fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:11.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.177+0000 7f3ed43df700 1 --2- 172.21.15.103:0/3402223026 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3eac04d830 0x7f3eac04fcf0 secure :-1 s=READY pgs=595 cs=0 l=1 rx=0x7f3ec0000ee0 tx=0x7f3ec0001720).stop 2020-04-22T14:16:11.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.177+0000 7f3ed43df700 1 -- 172.21.15.103:0/3402223026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ecc0ac950 msgr2=0x7f3ecc0b03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:11.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.177+0000 7f3ed43df700 1 --2- 172.21.15.103:0/3402223026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ecc0ac950 0x7f3ecc0b03a0 secure :-1 s=READY pgs=1636 cs=0 l=1 rx=0x7f3ec4008250 tx=0x7f3ec8010e10).stop 2020-04-22T14:16:11.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.177+0000 7f3ed43df700 1 -- 172.21.15.103:0/3402223026 shutdown_connections 2020-04-22T14:16:11.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.177+0000 7f3ed43df700 1 --2- 172.21.15.103:0/3402223026 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3eac04d830 0x7f3eac04fcf0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:11.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.177+0000 7f3ed43df700 1 --2- 172.21.15.103:0/3402223026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ecc0ac950 0x7f3ecc0b03a0 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:11.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.177+0000 7f3ed43df700 1 -- 172.21.15.103:0/3402223026 >> 172.21.15.103:0/3402223026 conn(0x7f3ecc05b7b0 msgr2=0x7f3ecc0b6690 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:11.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.177+0000 7f3ed43df700 1 -- 172.21.15.103:0/3402223026 shutdown_connections 2020-04-22T14:16:11.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.177+0000 7f3ed43df700 1 -- 172.21.15.103:0/3402223026 wait complete. 2020-04-22T14:16:11.189 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:11.202 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-22T14:16:11.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.350+0000 7f363325b700 1 Processor -- start 2020-04-22T14:16:11.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.350+0000 7f363325b700 1 -- start start 2020-04-22T14:16:11.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.351+0000 7f363325b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f362c143090 0x7f362c143520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:11.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.351+0000 7f363325b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f362c1467e0 con 0x7f362c0b9140 2020-04-22T14:16:11.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.351+0000 7f363325b700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f362c060050 con 0x7f362c0ac950 2020-04-22T14:16:11.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.351+0000 7f363325b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f362c0602f0 con 0x7f362c143090 2020-04-22T14:16:11.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.351+0000 7f362bfff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f362c0ac950 0x7f362c146c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48238/0 (socket says 172.21.15.103:48238) 2020-04-22T14:16:11.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.351+0000 7f362bfff700 1 -- 172.21.15.103:0/2380649426 learned_addr learned my addr 172.21.15.103:0/2380649426 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:11.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.351+0000 7f36317f8700 1 --2- 172.21.15.103:0/2380649426 >> v2:172.21.15.86:3300/0 conn(0x7f362c143090 0x7f362c143520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:11.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.351+0000 7f362b7fe700 1 -- 172.21.15.103:0/2380649426 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 114273169 0 0) 0x7f362c060050 con 0x7f362c0ac950 2020-04-22T14:16:11.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.351+0000 7f362b7fe700 1 -- 172.21.15.103:0/2380649426 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3618003230 con 0x7f362c0ac950 2020-04-22T14:16:11.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.351+0000 7f362b7fe700 1 -- 172.21.15.103:0/2380649426 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4224475681 0 0) 0x7f3618003230 con 0x7f362c0ac950 2020-04-22T14:16:11.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.351+0000 7f362b7fe700 1 -- 172.21.15.103:0/2380649426 >> v2:172.21.15.86:3300/0 conn(0x7f362c143090 msgr2=0x7f362c143520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:11.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.351+0000 7f362b7fe700 1 --2- 172.21.15.103:0/2380649426 >> v2:172.21.15.86:3300/0 conn(0x7f362c143090 0x7f362c143520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:11.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.351+0000 7f362b7fe700 1 -- 172.21.15.103:0/2380649426 >> v1:172.21.15.86:6789/0 conn(0x7f362c0b9140 legacy=0x7f362c12b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:11.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.351+0000 7f362b7fe700 1 -- 172.21.15.103:0/2380649426 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f362c0b9520 con 0x7f362c0ac950 2020-04-22T14:16:11.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.351+0000 7f362b7fe700 1 -- 172.21.15.103:0/2380649426 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f3620001710 con 0x7f362c0ac950 2020-04-22T14:16:11.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.351+0000 7f362b7fe700 1 -- 172.21.15.103:0/2380649426 >> v1:172.21.15.103:6789/0 conn(0x7f362c0ac950 legacy=0x7f362c146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:11.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.351+0000 7f362b7fe700 1 --2- 172.21.15.103:0/2380649426 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3618003770 0x7f3618003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:11.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.351+0000 7f362b7fe700 1 --2- 172.21.15.103:0/2380649426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36180044d0 0x7f3618004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:11.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.351+0000 7f362b7fe700 1 --2- 172.21.15.103:0/2380649426 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3618004db0 0x7f361800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:11.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.351+0000 7f362b7fe700 1 -- 172.21.15.103:0/2380649426 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362c0602f0 con 0x7f3618004db0 2020-04-22T14:16:11.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.351+0000 7f362b7fe700 1 -- 172.21.15.103:0/2380649426 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3618005260 con 0x7f36180044d0 2020-04-22T14:16:11.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.351+0000 7f362b7fe700 1 -- 172.21.15.103:0/2380649426 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f361800bb80 con 0x7f3618003770 2020-04-22T14:16:11.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.351+0000 7f362bfff700 1 --2- 172.21.15.103:0/2380649426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36180044d0 0x7f3618004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:11.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.352+0000 7f36317f8700 1 --2- 172.21.15.103:0/2380649426 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3618004db0 0x7f361800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:11.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.352+0000 7f3630ff7700 1 --2- 172.21.15.103:0/2380649426 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3618003770 0x7f3618003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:11.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.352+0000 7f362bfff700 1 -- 172.21.15.103:0/2380649426 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3618003770 msgr2=0x7f3618003b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:11.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.352+0000 7f362bfff700 1 --2- 172.21.15.103:0/2380649426 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3618003770 0x7f3618003b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:11.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.352+0000 7f362bfff700 1 -- 172.21.15.103:0/2380649426 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3618004db0 msgr2=0x7f361800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:11.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.352+0000 7f362bfff700 1 --2- 172.21.15.103:0/2380649426 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3618004db0 0x7f361800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:11.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.352+0000 7f36317f8700 1 -- 172.21.15.103:0/2380649426 reap_dead start 2020-04-22T14:16:11.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.352+0000 7f362bfff700 1 -- 172.21.15.103:0/2380649426 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3618003230 con 0x7f36180044d0 2020-04-22T14:16:11.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.352+0000 7f3630ff7700 1 --2- 172.21.15.103:0/2380649426 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3618003770 0x7f3618003b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:16:11.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.352+0000 7f362bfff700 1 --2- 172.21.15.103:0/2380649426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36180044d0 0x7f3618004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3620001420 tx=0x7f362c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.352+0000 7f362bfff700 1 --2- 172.21.15.103:0/2380649426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36180044d0 0x7f3618004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3620001420 tx=0x7f362c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.352+0000 7f362bfff700 1 --2- 172.21.15.103:0/2380649426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36180044d0 0x7f3618004950 secure :-1 s=READY pgs=1638 cs=0 l=1 rx=0x7f3620001420 tx=0x7f362c0b96b0).ready entity=mon.1 client_cookie=f89cded823660be server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:11.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.352+0000 7f362bfff700 1 --2- 172.21.15.103:0/2380649426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36180044d0 0x7f3618004950 secure :-1 s=THROTTLE_DONE pgs=1638 cs=0 l=1 rx=0x7f3620001420 tx=0x7f362c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.352+0000 7f362b7fe700 1 -- 172.21.15.103:0/2380649426 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f362000ee90 con 0x7f36180044d0 2020-04-22T14:16:11.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.352+0000 7f362bfff700 1 --2- 172.21.15.103:0/2380649426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36180044d0 0x7f3618004950 secure :-1 s=THROTTLE_DONE pgs=1638 cs=0 l=1 rx=0x7f3620001420 tx=0x7f362c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.352+0000 7f362b7fe700 1 -- 172.21.15.103:0/2380649426 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3620010cf0 con 0x7f36180044d0 2020-04-22T14:16:11.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.352+0000 7f362bfff700 1 --2- 172.21.15.103:0/2380649426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36180044d0 0x7f3618004950 secure :-1 s=THROTTLE_DONE pgs=1638 cs=0 l=1 rx=0x7f3620001420 tx=0x7f362c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.352+0000 7f362b7fe700 1 -- 172.21.15.103:0/2380649426 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3620010e60 con 0x7f36180044d0 2020-04-22T14:16:11.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.352+0000 7f363325b700 1 -- 172.21.15.103:0/2380649426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36180044d0 msgr2=0x7f3618004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:11.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.352+0000 7f363325b700 1 --2- 172.21.15.103:0/2380649426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36180044d0 0x7f3618004950 secure :-1 s=READY pgs=1638 cs=0 l=1 rx=0x7f3620001420 tx=0x7f362c0b96b0).stop 2020-04-22T14:16:11.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.352+0000 7f363325b700 1 -- 172.21.15.103:0/2380649426 shutdown_connections 2020-04-22T14:16:11.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.352+0000 7f363325b700 1 --2- 172.21.15.103:0/2380649426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36180044d0 0x7f3618004950 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:11.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.352+0000 7f363325b700 1 -- 172.21.15.103:0/2380649426 >> 172.21.15.103:0/2380649426 conn(0x7f362c05b7b0 msgr2=0x7f362c0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:11.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.353+0000 7f363325b700 1 -- 172.21.15.103:0/2380649426 shutdown_connections 2020-04-22T14:16:11.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.353+0000 7f363325b700 1 -- 172.21.15.103:0/2380649426 wait complete. 2020-04-22T14:16:11.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.353+0000 7f363325b700 1 Processor -- start 2020-04-22T14:16:11.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.354+0000 7f363325b700 1 -- start start 2020-04-22T14:16:11.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.354+0000 7f363325b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f362c0b5c40 0x7f362c0b5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:11.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.354+0000 7f363325b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f362c0629f0 con 0x7f36180044d0 2020-04-22T14:16:11.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.354+0000 7f363325b700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f362c1434a0 con 0x7f362c1282c0 2020-04-22T14:16:11.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.354+0000 7f363325b700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f362c0627e0 con 0x7f362c0b5c40 2020-04-22T14:16:11.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.355+0000 7f362bfff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f362c0b5c40 0x7f362c0b5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:11.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.355+0000 7f36317f8700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f362c1282c0 0x7f362c143940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48252/0 (socket says 172.21.15.103:48252) 2020-04-22T14:16:11.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.355+0000 7f362bfff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f362c0b5c40 0x7f362c0b5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56060/0 (socket says 172.21.15.103:56060) 2020-04-22T14:16:11.378 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.355+0000 7f36317f8700 1 -- 172.21.15.103:0/594667560 learned_addr learned my addr 172.21.15.103:0/594667560 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:11.378 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.355+0000 7f362bfff700 1 -- 172.21.15.103:0/594667560 >> v1:172.21.15.103:6789/0 conn(0x7f362c1282c0 legacy=0x7f362c143940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:11.378 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.355+0000 7f3629ffb700 1 -- 172.21.15.103:0/594667560 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 958693670 0 0) 0x7f362c1434a0 con 0x7f362c1282c0 2020-04-22T14:16:11.378 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.355+0000 7f362bfff700 1 -- 172.21.15.103:0/594667560 >> v1:172.21.15.86:6789/0 conn(0x7f36180044d0 legacy=0x7f362c0b67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:11.378 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.355+0000 7f362bfff700 1 -- 172.21.15.103:0/594667560 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f362c0b6ec0 con 0x7f362c0b5c40 2020-04-22T14:16:11.378 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.355+0000 7f362bfff700 1 --2- 172.21.15.103:0/594667560 >> v2:172.21.15.103:3300/0 conn(0x7f362c0b5c40 0x7f362c0b5160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3620001420 tx=0x7f362c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.379 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.355+0000 7f362bfff700 1 --2- 172.21.15.103:0/594667560 >> v2:172.21.15.103:3300/0 conn(0x7f362c0b5c40 0x7f362c0b5160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3620001420 tx=0x7f362c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.379 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.355+0000 7f362bfff700 1 --2- 172.21.15.103:0/594667560 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f362c0b5c40 0x7f362c0b5160 secure :-1 s=READY pgs=1640 cs=0 l=1 rx=0x7f3620001420 tx=0x7f362c0b96b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:11.379 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.355+0000 7f362bfff700 1 --2- 172.21.15.103:0/594667560 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f362c0b5c40 0x7f362c0b5160 secure :-1 s=THROTTLE_DONE pgs=1640 cs=0 l=1 rx=0x7f3620001420 tx=0x7f362c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.379 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.355+0000 7f3629ffb700 1 -- 172.21.15.103:0/594667560 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3620010750 con 0x7f362c0b5c40 2020-04-22T14:16:11.379 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.355+0000 7f362bfff700 1 --2- 172.21.15.103:0/594667560 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f362c0b5c40 0x7f362c0b5160 secure :-1 s=THROTTLE_DONE pgs=1640 cs=0 l=1 rx=0x7f3620001420 tx=0x7f362c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.379 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.355+0000 7f362bfff700 1 --2- 172.21.15.103:0/594667560 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f362c0b5c40 0x7f362c0b5160 secure :-1 s=THROTTLE_DONE pgs=1640 cs=0 l=1 rx=0x7f3620001420 tx=0x7f362c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.355+0000 7f3629ffb700 1 -- 172.21.15.103:0/594667560 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36200108b0 con 0x7f362c0b5c40 2020-04-22T14:16:11.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.355+0000 7f363325b700 1 -- 172.21.15.103:0/594667560 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f362c062370 con 0x7f362c0b5c40 2020-04-22T14:16:11.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.355+0000 7f3629ffb700 1 -- 172.21.15.103:0/594667560 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f362000c9f0 con 0x7f362c0b5c40 2020-04-22T14:16:11.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.355+0000 7f363325b700 1 -- 172.21.15.103:0/594667560 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f362c144210 con 0x7f362c0b5c40 2020-04-22T14:16:11.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.356+0000 7f362bfff700 1 --2- 172.21.15.103:0/594667560 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f362c0b5c40 0x7f362c0b5160 secure :-1 s=THROTTLE_DONE pgs=1640 cs=0 l=1 rx=0x7f3620001420 tx=0x7f362c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.356+0000 7f3629ffb700 1 -- 172.21.15.103:0/594667560 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f362000cc20 con 0x7f362c0b5c40 2020-04-22T14:16:11.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.356+0000 7f362bfff700 1 --2- 172.21.15.103:0/594667560 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f362c0b5c40 0x7f362c0b5160 secure :-1 s=THROTTLE_DONE pgs=1640 cs=0 l=1 rx=0x7f3620001420 tx=0x7f362c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.356+0000 7f363325b700 1 -- 172.21.15.103:0/594667560 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f362c062560 con 0x7f362c0b5c40 2020-04-22T14:16:11.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.357+0000 7f3629ffb700 1 --2- 172.21.15.103:0/594667560 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f360c04d870 0x7f360c04fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:11.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.357+0000 7f3629ffb700 1 -- 172.21.15.103:0/594667560 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f36200614b0 con 0x7f362c0b5c40 2020-04-22T14:16:11.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.357+0000 7f3630ff7700 1 --2- 172.21.15.103:0/594667560 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f360c04d870 0x7f360c04fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:11.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.357+0000 7f3630ff7700 1 --2- 172.21.15.103:0/594667560 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f360c04d870 0x7f360c04fd30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f362c0b8120 tx=0x7f361c001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.357+0000 7f3630ff7700 1 --2- 172.21.15.103:0/594667560 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f360c04d870 0x7f360c04fd30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f362c0b8120 tx=0x7f361c001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.357+0000 7f3630ff7700 1 --2- 172.21.15.103:0/594667560 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f360c04d870 0x7f360c04fd30 secure :-1 s=READY pgs=596 cs=0 l=1 rx=0x7f362c0b8120 tx=0x7f361c001e40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:11.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.361+0000 7f362bfff700 1 --2- 172.21.15.103:0/594667560 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f362c0b5c40 0x7f362c0b5160 secure :-1 s=THROTTLE_DONE pgs=1640 cs=0 l=1 rx=0x7f3620001420 tx=0x7f362c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.382 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.361+0000 7f3629ffb700 1 -- 172.21.15.103:0/594667560 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f362003c9b0 con 0x7f362c0b5c40 2020-04-22T14:16:11.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.503+0000 7f363325b700 1 -- 172.21.15.103:0/594667560 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f362c143630 con 0x7f362c0b5c40 2020-04-22T14:16:11.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.504+0000 7f362bfff700 1 --2- 172.21.15.103:0/594667560 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f362c0b5c40 0x7f362c0b5160 secure :-1 s=THROTTLE_DONE pgs=1640 cs=0 l=1 rx=0x7f3620001420 tx=0x7f362c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.504+0000 7f3629ffb700 1 -- 172.21.15.103:0/594667560 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v113) v1 ==== 104+0+10 (secure 0 0 0) 0x7f362003ffd0 con 0x7f362c0b5c40 2020-04-22T14:16:11.506 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:16:11.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.505+0000 7f363325b700 1 -- 172.21.15.103:0/594667560 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f360c04d870 msgr2=0x7f360c04fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:11.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.505+0000 7f363325b700 1 --2- 172.21.15.103:0/594667560 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f360c04d870 0x7f360c04fd30 secure :-1 s=READY pgs=596 cs=0 l=1 rx=0x7f362c0b8120 tx=0x7f361c001e40).stop 2020-04-22T14:16:11.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.505+0000 7f363325b700 1 -- 172.21.15.103:0/594667560 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f362c0b5c40 msgr2=0x7f362c0b5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:11.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.505+0000 7f363325b700 1 --2- 172.21.15.103:0/594667560 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f362c0b5c40 0x7f362c0b5160 secure :-1 s=READY pgs=1640 cs=0 l=1 rx=0x7f3620001420 tx=0x7f362c0b96b0).stop 2020-04-22T14:16:11.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.505+0000 7f363325b700 1 -- 172.21.15.103:0/594667560 shutdown_connections 2020-04-22T14:16:11.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.505+0000 7f363325b700 1 --2- 172.21.15.103:0/594667560 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f360c04d870 0x7f360c04fd30 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:11.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.505+0000 7f363325b700 1 --2- 172.21.15.103:0/594667560 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f362c0b5c40 0x7f362c0b5160 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:11.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.505+0000 7f363325b700 1 -- 172.21.15.103:0/594667560 >> 172.21.15.103:0/594667560 conn(0x7f362c05b7b0 msgr2=0x7f362c14f980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:11.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.505+0000 7f363325b700 1 -- 172.21.15.103:0/594667560 shutdown_connections 2020-04-22T14:16:11.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.505+0000 7f363325b700 1 -- 172.21.15.103:0/594667560 wait complete. 2020-04-22T14:16:11.518 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:11.532 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-22T14:16:11.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.679+0000 7f75bd783700 1 Processor -- start 2020-04-22T14:16:11.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.679+0000 7f75bd783700 1 -- start start 2020-04-22T14:16:11.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.680+0000 7f75bd783700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f75b80b9140 0x7f75b812b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:11.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.680+0000 7f75bd783700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75b812b670 0x7f75b8143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:11.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.680+0000 7f75bd783700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75b81467e0 con 0x7f75b80ac950 2020-04-22T14:16:11.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.680+0000 7f75bd783700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75b80602f0 con 0x7f75b80b9140 2020-04-22T14:16:11.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.680+0000 7f75bd783700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b8060050 con 0x7f75b812b670 2020-04-22T14:16:11.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.680+0000 7f75b77fe700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75b812b670 0x7f75b8143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:11.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.680+0000 7f75b6ffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f75b80b9140 0x7f75b812b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:11.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.680+0000 7f75b77fe700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75b812b670 0x7f75b8143090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:40848/0 (socket says 172.21.15.103:40848) 2020-04-22T14:16:11.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.680+0000 7f75b77fe700 1 -- 172.21.15.103:0/1558827660 learned_addr learned my addr 172.21.15.103:0/1558827660 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:11.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.680+0000 7f75b77fe700 1 -- 172.21.15.103:0/1558827660 >> v2:172.21.15.86:3300/0 conn(0x7f75b80b9140 msgr2=0x7f75b812b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:11.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.680+0000 7f75b77fe700 1 --2- 172.21.15.103:0/1558827660 >> v2:172.21.15.86:3300/0 conn(0x7f75b80b9140 0x7f75b812b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:11.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.680+0000 7f75b77fe700 1 -- 172.21.15.103:0/1558827660 >> v1:172.21.15.86:6789/0 conn(0x7f75b80ac950 legacy=0x7f75b8146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:11.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.680+0000 7f75b77fe700 1 -- 172.21.15.103:0/1558827660 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b80b9520 con 0x7f75b812b670 2020-04-22T14:16:11.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.680+0000 7f75b77fe700 1 --2- 172.21.15.103:0/1558827660 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75b812b670 0x7f75b8143090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f75b00032b0 tx=0x7f75b0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.680+0000 7f75b77fe700 1 --2- 172.21.15.103:0/1558827660 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75b812b670 0x7f75b8143090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f75b00032b0 tx=0x7f75b0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.680+0000 7f75b77fe700 1 --2- 172.21.15.103:0/1558827660 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75b812b670 0x7f75b8143090 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7f75b00032b0 tx=0x7f75b0007dc0).ready entity=mon.2 client_cookie=71021a353e06b021 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:11.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.681+0000 7f75b77fe700 1 --2- 172.21.15.103:0/1558827660 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75b812b670 0x7f75b8143090 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f75b00032b0 tx=0x7f75b0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.681+0000 7f75b5ffb700 1 -- 172.21.15.103:0/1558827660 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75b000a180 con 0x7f75b812b670 2020-04-22T14:16:11.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.681+0000 7f75b77fe700 1 --2- 172.21.15.103:0/1558827660 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75b812b670 0x7f75b8143090 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f75b00032b0 tx=0x7f75b0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.681+0000 7f75b77fe700 1 --2- 172.21.15.103:0/1558827660 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75b812b670 0x7f75b8143090 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f75b00032b0 tx=0x7f75b0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.681+0000 7f75b5ffb700 1 -- 172.21.15.103:0/1558827660 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b000a320 con 0x7f75b812b670 2020-04-22T14:16:11.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.681+0000 7f75b5ffb700 1 -- 172.21.15.103:0/1558827660 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75b000a740 con 0x7f75b812b670 2020-04-22T14:16:11.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.681+0000 7f75bd783700 1 -- 172.21.15.103:0/1558827660 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75b812b670 msgr2=0x7f75b8143090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:11.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.681+0000 7f75bd783700 1 --2- 172.21.15.103:0/1558827660 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75b812b670 0x7f75b8143090 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7f75b00032b0 tx=0x7f75b0007dc0).stop 2020-04-22T14:16:11.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.681+0000 7f75bd783700 1 -- 172.21.15.103:0/1558827660 shutdown_connections 2020-04-22T14:16:11.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.681+0000 7f75bd783700 1 --2- 172.21.15.103:0/1558827660 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75b812b670 0x7f75b8143090 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:11.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.681+0000 7f75bd783700 1 --2- 172.21.15.103:0/1558827660 >> v2:172.21.15.86:3300/0 conn(0x7f75b80b9140 0x7f75b812b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:11.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.681+0000 7f75bd783700 1 -- 172.21.15.103:0/1558827660 >> 172.21.15.103:0/1558827660 conn(0x7f75b805b7b0 msgr2=0x7f75b80b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:11.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.681+0000 7f75bd783700 1 -- 172.21.15.103:0/1558827660 shutdown_connections 2020-04-22T14:16:11.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.681+0000 7f75bd783700 1 -- 172.21.15.103:0/1558827660 wait complete. 2020-04-22T14:16:11.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.682+0000 7f75bd783700 1 Processor -- start 2020-04-22T14:16:11.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.682+0000 7f75bd783700 1 -- start start 2020-04-22T14:16:11.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.683+0000 7f75bd783700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f75b80ac950 0x7f75b8064950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:11.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.683+0000 7f75bd783700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f75b80b9140 0x7f75b81546f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:11.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.683+0000 7f75bd783700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75b812b670 0x7f75b80b5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:11.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.683+0000 7f75bd783700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75b8063f70 con 0x7f75b80b9140 2020-04-22T14:16:11.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.683+0000 7f75bd783700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75b8064210 con 0x7f75b80ac950 2020-04-22T14:16:11.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.683+0000 7f75bd783700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b80644b0 con 0x7f75b812b670 2020-04-22T14:16:11.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.683+0000 7f75b6ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f75b80ac950 0x7f75b8064950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:11.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.683+0000 7f75b6ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f75b80ac950 0x7f75b8064950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56072/0 (socket says 172.21.15.103:56072) 2020-04-22T14:16:11.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.683+0000 7f75b6ffd700 1 -- 172.21.15.103:0/30094284 learned_addr learned my addr 172.21.15.103:0/30094284 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:11.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.683+0000 7f75b77fe700 1 --2- 172.21.15.103:0/30094284 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75b812b670 0x7f75b80b5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:11.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.683+0000 7f75b67fc700 1 --2- 172.21.15.103:0/30094284 >> v2:172.21.15.86:3300/0 conn(0x7f75b80b9140 0x7f75b81546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:11.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.683+0000 7f75b6ffd700 1 -- 172.21.15.103:0/30094284 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75b812b670 msgr2=0x7f75b80b5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:11.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.683+0000 7f75b6ffd700 1 --2- 172.21.15.103:0/30094284 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75b812b670 0x7f75b80b5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:11.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.683+0000 7f75b6ffd700 1 -- 172.21.15.103:0/30094284 >> v2:172.21.15.86:3300/0 conn(0x7f75b80b9140 msgr2=0x7f75b81546f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:11.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.683+0000 7f75b6ffd700 1 --2- 172.21.15.103:0/30094284 >> v2:172.21.15.86:3300/0 conn(0x7f75b80b9140 0x7f75b81546f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:11.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.683+0000 7f75b6ffd700 1 -- 172.21.15.103:0/30094284 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b8063bf0 con 0x7f75b80ac950 2020-04-22T14:16:11.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.683+0000 7f75b77fe700 1 --2- 172.21.15.103:0/30094284 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75b812b670 0x7f75b80b5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:16:11.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.683+0000 7f75b6ffd700 1 --2- 172.21.15.103:0/30094284 >> v2:172.21.15.103:3300/0 conn(0x7f75b80ac950 0x7f75b8064950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f75ac003070 tx=0x7f75ac012f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.683+0000 7f75b6ffd700 1 --2- 172.21.15.103:0/30094284 >> v2:172.21.15.103:3300/0 conn(0x7f75b80ac950 0x7f75b8064950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f75ac003070 tx=0x7f75ac012f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.683+0000 7f75b6ffd700 1 --2- 172.21.15.103:0/30094284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75b80ac950 0x7f75b8064950 secure :-1 s=READY pgs=1641 cs=0 l=1 rx=0x7f75ac003070 tx=0x7f75ac012f70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:11.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.683+0000 7f75b6ffd700 1 --2- 172.21.15.103:0/30094284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75b80ac950 0x7f75b8064950 secure :-1 s=THROTTLE_DONE pgs=1641 cs=0 l=1 rx=0x7f75ac003070 tx=0x7f75ac012f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.684+0000 7f75a7fff700 1 -- 172.21.15.103:0/30094284 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75ac007560 con 0x7f75b80ac950 2020-04-22T14:16:11.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.684+0000 7f75b6ffd700 1 --2- 172.21.15.103:0/30094284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75b80ac950 0x7f75b8064950 secure :-1 s=THROTTLE_DONE pgs=1641 cs=0 l=1 rx=0x7f75ac003070 tx=0x7f75ac012f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.684+0000 7f75b6ffd700 1 --2- 172.21.15.103:0/30094284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75b80ac950 0x7f75b8064950 secure :-1 s=THROTTLE_DONE pgs=1641 cs=0 l=1 rx=0x7f75ac003070 tx=0x7f75ac012f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.684+0000 7f75a7fff700 1 -- 172.21.15.103:0/30094284 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ac008970 con 0x7f75b80ac950 2020-04-22T14:16:11.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.684+0000 7f75bd783700 1 -- 172.21.15.103:0/30094284 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b81293b0 con 0x7f75b80ac950 2020-04-22T14:16:11.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.684+0000 7f75a7fff700 1 -- 172.21.15.103:0/30094284 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75ac008d10 con 0x7f75b80ac950 2020-04-22T14:16:11.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.684+0000 7f75bd783700 1 -- 172.21.15.103:0/30094284 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75b8142f50 con 0x7f75b80ac950 2020-04-22T14:16:11.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.684+0000 7f75b6ffd700 1 --2- 172.21.15.103:0/30094284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75b80ac950 0x7f75b8064950 secure :-1 s=THROTTLE_DONE pgs=1641 cs=0 l=1 rx=0x7f75ac003070 tx=0x7f75ac012f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.684+0000 7f75bd783700 1 -- 172.21.15.103:0/30094284 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75b8063de0 con 0x7f75b80ac950 2020-04-22T14:16:11.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.685+0000 7f75a7fff700 1 -- 172.21.15.103:0/30094284 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f75ac0058d0 con 0x7f75b80ac950 2020-04-22T14:16:11.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.685+0000 7f75b6ffd700 1 --2- 172.21.15.103:0/30094284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75b80ac950 0x7f75b8064950 secure :-1 s=THROTTLE_DONE pgs=1641 cs=0 l=1 rx=0x7f75ac003070 tx=0x7f75ac012f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.685+0000 7f75a7fff700 1 --2- 172.21.15.103:0/30094284 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f759404d990 0x7f759404fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:11.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.685+0000 7f75a7fff700 1 -- 172.21.15.103:0/30094284 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f75ac063430 con 0x7f75b80ac950 2020-04-22T14:16:11.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.685+0000 7f75b67fc700 1 --2- 172.21.15.103:0/30094284 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f759404d990 0x7f759404fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:11.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.685+0000 7f75b67fc700 1 --2- 172.21.15.103:0/30094284 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f759404d990 0x7f759404fe50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f75b80b6250 tx=0x7f75a800c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.685+0000 7f75b67fc700 1 --2- 172.21.15.103:0/30094284 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f759404d990 0x7f759404fe50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f75b80b6250 tx=0x7f75a800c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.685+0000 7f75b67fc700 1 --2- 172.21.15.103:0/30094284 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f759404d990 0x7f759404fe50 secure :-1 s=READY pgs=597 cs=0 l=1 rx=0x7f75b80b6250 tx=0x7f75a800c820).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:11.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.689+0000 7f75b6ffd700 1 --2- 172.21.15.103:0/30094284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75b80ac950 0x7f75b8064950 secure :-1 s=THROTTLE_DONE pgs=1641 cs=0 l=1 rx=0x7f75ac003070 tx=0x7f75ac012f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.689+0000 7f75a7fff700 1 -- 172.21.15.103:0/30094284 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f75ac03e870 con 0x7f75b80ac950 2020-04-22T14:16:11.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.833+0000 7f75bd783700 1 -- 172.21.15.103:0/30094284 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f75b8056c90 con 0x7f75b80ac950 2020-04-22T14:16:11.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.833+0000 7f75b6ffd700 1 --2- 172.21.15.103:0/30094284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75b80ac950 0x7f75b8064950 secure :-1 s=THROTTLE_DONE pgs=1641 cs=0 l=1 rx=0x7f75ac003070 tx=0x7f75ac012f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:11.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.833+0000 7f75a7fff700 1 -- 172.21.15.103:0/30094284 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v113) v1 ==== 100+0+10 (secure 0 0 0) 0x7f75ac041e90 con 0x7f75b80ac950 2020-04-22T14:16:11.910 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:16:11.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.835+0000 7f75bd783700 1 -- 172.21.15.103:0/30094284 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f759404d990 msgr2=0x7f759404fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:11.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.835+0000 7f75bd783700 1 --2- 172.21.15.103:0/30094284 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f759404d990 0x7f759404fe50 secure :-1 s=READY pgs=597 cs=0 l=1 rx=0x7f75b80b6250 tx=0x7f75a800c820).stop 2020-04-22T14:16:11.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.835+0000 7f75bd783700 1 -- 172.21.15.103:0/30094284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75b80ac950 msgr2=0x7f75b8064950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:11.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.835+0000 7f75bd783700 1 --2- 172.21.15.103:0/30094284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75b80ac950 0x7f75b8064950 secure :-1 s=READY pgs=1641 cs=0 l=1 rx=0x7f75ac003070 tx=0x7f75ac012f70).stop 2020-04-22T14:16:11.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.835+0000 7f75bd783700 1 -- 172.21.15.103:0/30094284 shutdown_connections 2020-04-22T14:16:11.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.835+0000 7f75bd783700 1 --2- 172.21.15.103:0/30094284 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75b812b670 0x7f75b80b5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:11.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.835+0000 7f75bd783700 1 --2- 172.21.15.103:0/30094284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75b80ac950 0x7f75b8064950 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:11.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.835+0000 7f75bd783700 1 --2- 172.21.15.103:0/30094284 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f759404d990 0x7f759404fe50 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:11.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.835+0000 7f75bd783700 1 --2- 172.21.15.103:0/30094284 >> v2:172.21.15.86:3300/0 conn(0x7f75b80b9140 0x7f75b81546f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:11.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.835+0000 7f75bd783700 1 -- 172.21.15.103:0/30094284 >> 172.21.15.103:0/30094284 conn(0x7f75b805b7b0 msgr2=0x7f75b81460c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:11.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.835+0000 7f75bd783700 1 -- 172.21.15.103:0/30094284 shutdown_connections 2020-04-22T14:16:11.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:11.835+0000 7f75bd783700 1 -- 172.21.15.103:0/30094284 wait complete. 2020-04-22T14:16:11.913 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-04-22T14:16:11.914 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:11.946 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:16:12.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.089+0000 7fec898fa700 1 Processor -- start 2020-04-22T14:16:12.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.089+0000 7fec898fa700 1 -- start start 2020-04-22T14:16:12.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.090+0000 7fec898fa700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fec8413c420 0x7fec8413c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:12.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.090+0000 7fec898fa700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec84065710 con 0x7fec84061840 2020-04-22T14:16:12.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.090+0000 7fec898fa700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec840659b0 con 0x7fec84146050 2020-04-22T14:16:12.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.090+0000 7fec898fa700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec84065530 con 0x7fec8413c420 2020-04-22T14:16:12.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.090+0000 7fec82ffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fec84146050 0x7fec84062ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48270/0 (socket says 172.21.15.103:48270) 2020-04-22T14:16:12.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.090+0000 7fec82ffd700 1 -- 172.21.15.103:0/954924169 learned_addr learned my addr 172.21.15.103:0/954924169 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:12.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.090+0000 7fec827fc700 1 --2- 172.21.15.103:0/954924169 >> v2:172.21.15.86:3300/0 conn(0x7fec8413c420 0x7fec8413c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:12.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.090+0000 7fec81ffb700 1 -- 172.21.15.103:0/954924169 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3866588989 0 0) 0x7fec840659b0 con 0x7fec84146050 2020-04-22T14:16:12.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.090+0000 7fec81ffb700 1 -- 172.21.15.103:0/954924169 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec68003230 con 0x7fec84146050 2020-04-22T14:16:12.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.091+0000 7fec81ffb700 1 -- 172.21.15.103:0/954924169 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2137648763 0 0) 0x7fec68003230 con 0x7fec84146050 2020-04-22T14:16:12.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.091+0000 7fec81ffb700 1 -- 172.21.15.103:0/954924169 >> v2:172.21.15.86:3300/0 conn(0x7fec8413c420 msgr2=0x7fec8413c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:12.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.091+0000 7fec81ffb700 1 --2- 172.21.15.103:0/954924169 >> v2:172.21.15.86:3300/0 conn(0x7fec8413c420 0x7fec8413c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:12.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.091+0000 7fec81ffb700 1 -- 172.21.15.103:0/954924169 >> v1:172.21.15.86:6789/0 conn(0x7fec84061840 legacy=0x7fec84061cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:12.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.091+0000 7fec81ffb700 1 -- 172.21.15.103:0/954924169 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec84063600 con 0x7fec84146050 2020-04-22T14:16:12.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.091+0000 7fec81ffb700 1 -- 172.21.15.103:0/954924169 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fec780016d0 con 0x7fec84146050 2020-04-22T14:16:12.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.091+0000 7fec81ffb700 1 -- 172.21.15.103:0/954924169 >> v1:172.21.15.103:6789/0 conn(0x7fec84146050 legacy=0x7fec84062ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:12.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.091+0000 7fec81ffb700 1 --2- 172.21.15.103:0/954924169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec68003720 0x7fec68003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:12.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.091+0000 7fec81ffb700 1 --2- 172.21.15.103:0/954924169 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fec680044d0 0x7fec68004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:12.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.091+0000 7fec81ffb700 1 --2- 172.21.15.103:0/954924169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec68004db0 0x7fec6800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:12.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.091+0000 7fec81ffb700 1 -- 172.21.15.103:0/954924169 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec84065530 con 0x7fec68003720 2020-04-22T14:16:12.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.091+0000 7fec81ffb700 1 -- 172.21.15.103:0/954924169 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec680041c0 con 0x7fec68004db0 2020-04-22T14:16:12.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.091+0000 7fec81ffb700 1 -- 172.21.15.103:0/954924169 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec6800bb80 con 0x7fec680044d0 2020-04-22T14:16:12.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.091+0000 7fec827fc700 1 --2- 172.21.15.103:0/954924169 >> v2:172.21.15.86:3300/0 conn(0x7fec8413c420 0x7fec8413c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:16:12.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.091+0000 7fec837fe700 1 --2- 172.21.15.103:0/954924169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec68004db0 0x7fec6800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:12.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.091+0000 7fec82ffd700 1 --2- 172.21.15.103:0/954924169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec68003720 0x7fec68003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:12.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.091+0000 7fec827fc700 1 --2- 172.21.15.103:0/954924169 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fec680044d0 0x7fec68004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:12.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.091+0000 7fec837fe700 1 -- 172.21.15.103:0/954924169 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fec680044d0 msgr2=0x7fec68004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:12.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.091+0000 7fec837fe700 1 --2- 172.21.15.103:0/954924169 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fec680044d0 0x7fec68004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:12.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.091+0000 7fec837fe700 1 -- 172.21.15.103:0/954924169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec68003720 msgr2=0x7fec68003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:12.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.091+0000 7fec837fe700 1 --2- 172.21.15.103:0/954924169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec68003720 0x7fec68003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:12.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.091+0000 7fec837fe700 1 -- 172.21.15.103:0/954924169 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec68003230 con 0x7fec68004db0 2020-04-22T14:16:12.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.091+0000 7fec827fc700 1 --2- 172.21.15.103:0/954924169 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fec680044d0 0x7fec68004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:16:12.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.091+0000 7fec837fe700 1 --2- 172.21.15.103:0/954924169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec68004db0 0x7fec6800b720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fec680054a0 tx=0x7fec7c0100a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:12.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.091+0000 7fec837fe700 1 -- 172.21.15.103:0/954924169 reap_dead start 2020-04-22T14:16:12.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.091+0000 7fec837fe700 1 --2- 172.21.15.103:0/954924169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec68004db0 0x7fec6800b720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fec680054a0 tx=0x7fec7c0100a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:12.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.091+0000 7fec837fe700 1 --2- 172.21.15.103:0/954924169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec68004db0 0x7fec6800b720 secure :-1 s=READY pgs=1643 cs=0 l=1 rx=0x7fec680054a0 tx=0x7fec7c0100a0).ready entity=mon.1 client_cookie=d200fcfc35c17cbe server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:12.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.091+0000 7fec837fe700 1 --2- 172.21.15.103:0/954924169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec68004db0 0x7fec6800b720 secure :-1 s=THROTTLE_DONE pgs=1643 cs=0 l=1 rx=0x7fec680054a0 tx=0x7fec7c0100a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:12.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.091+0000 7fec81ffb700 1 -- 172.21.15.103:0/954924169 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec7c006c40 con 0x7fec68004db0 2020-04-22T14:16:12.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.091+0000 7fec837fe700 1 --2- 172.21.15.103:0/954924169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec68004db0 0x7fec6800b720 secure :-1 s=THROTTLE_DONE pgs=1643 cs=0 l=1 rx=0x7fec680054a0 tx=0x7fec7c0100a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:12.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.091+0000 7fec837fe700 1 --2- 172.21.15.103:0/954924169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec68004db0 0x7fec6800b720 secure :-1 s=THROTTLE_DONE pgs=1643 cs=0 l=1 rx=0x7fec680054a0 tx=0x7fec7c0100a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:12.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.091+0000 7fec81ffb700 1 -- 172.21.15.103:0/954924169 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7c006da0 con 0x7fec68004db0 2020-04-22T14:16:12.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.091+0000 7fec81ffb700 1 -- 172.21.15.103:0/954924169 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec7c002640 con 0x7fec68004db0 2020-04-22T14:16:12.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.091+0000 7fec898fa700 1 -- 172.21.15.103:0/954924169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec68004db0 msgr2=0x7fec6800b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:12.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.091+0000 7fec898fa700 1 --2- 172.21.15.103:0/954924169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec68004db0 0x7fec6800b720 secure :-1 s=READY pgs=1643 cs=0 l=1 rx=0x7fec680054a0 tx=0x7fec7c0100a0).stop 2020-04-22T14:16:12.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.092+0000 7fec898fa700 1 -- 172.21.15.103:0/954924169 shutdown_connections 2020-04-22T14:16:12.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.092+0000 7fec898fa700 1 --2- 172.21.15.103:0/954924169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec68004db0 0x7fec6800b720 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:12.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.092+0000 7fec898fa700 1 -- 172.21.15.103:0/954924169 >> 172.21.15.103:0/954924169 conn(0x7fec8405ad30 msgr2=0x7fec8405b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:12.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.092+0000 7fec898fa700 1 -- 172.21.15.103:0/954924169 shutdown_connections 2020-04-22T14:16:12.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.092+0000 7fec898fa700 1 -- 172.21.15.103:0/954924169 wait complete. 2020-04-22T14:16:12.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.093+0000 7fec898fa700 1 Processor -- start 2020-04-22T14:16:12.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.093+0000 7fec898fa700 1 -- start start 2020-04-22T14:16:12.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.094+0000 7fec898fa700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fec68004db0 0x7fec8413bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:12.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.094+0000 7fec898fa700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec8414dd50 con 0x7fec840b0fd0 2020-04-22T14:16:12.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.094+0000 7fec898fa700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec8413bf60 con 0x7fec840b0b50 2020-04-22T14:16:12.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.094+0000 7fec898fa700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec84143110 con 0x7fec68004db0 2020-04-22T14:16:12.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.094+0000 7fec827fc700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fec840b0b50 0x7fec84156e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48284/0 (socket says 172.21.15.103:48284) 2020-04-22T14:16:12.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.094+0000 7fec827fc700 1 -- 172.21.15.103:0/3077262639 learned_addr learned my addr 172.21.15.103:0/3077262639 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:12.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.094+0000 7fec82ffd700 1 --2- 172.21.15.103:0/3077262639 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fec68004db0 0x7fec8413bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:12.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.094+0000 7fec73fff700 1 -- 172.21.15.103:0/3077262639 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4009194662 0 0) 0x7fec8413bf60 con 0x7fec840b0b50 2020-04-22T14:16:12.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.094+0000 7fec73fff700 1 -- 172.21.15.103:0/3077262639 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec60002fe0 con 0x7fec840b0b50 2020-04-22T14:16:12.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.094+0000 7fec73fff700 1 -- 172.21.15.103:0/3077262639 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2435282681 0 0) 0x7fec8414dd50 con 0x7fec840b0fd0 2020-04-22T14:16:12.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.094+0000 7fec73fff700 1 -- 172.21.15.103:0/3077262639 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec8413bf60 con 0x7fec840b0fd0 2020-04-22T14:16:12.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.094+0000 7fec82ffd700 1 -- 172.21.15.103:0/3077262639 >> v1:172.21.15.103:6789/0 conn(0x7fec840b0b50 legacy=0x7fec84156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:12.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.094+0000 7fec82ffd700 1 -- 172.21.15.103:0/3077262639 >> v1:172.21.15.86:6789/0 conn(0x7fec840b0fd0 legacy=0x7fec84142a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:12.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.094+0000 7fec82ffd700 1 -- 172.21.15.103:0/3077262639 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec841546d0 con 0x7fec68004db0 2020-04-22T14:16:12.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.094+0000 7fec82ffd700 1 --2- 172.21.15.103:0/3077262639 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fec68004db0 0x7fec8413bb00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fec780013e0 tx=0x7fec780093e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:12.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.094+0000 7fec82ffd700 1 --2- 172.21.15.103:0/3077262639 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fec68004db0 0x7fec8413bb00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fec780013e0 tx=0x7fec780093e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:12.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.094+0000 7fec82ffd700 1 --2- 172.21.15.103:0/3077262639 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fec68004db0 0x7fec8413bb00 secure :-1 s=READY pgs=155 cs=0 l=1 rx=0x7fec780013e0 tx=0x7fec780093e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:12.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.094+0000 7fec82ffd700 1 --2- 172.21.15.103:0/3077262639 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fec68004db0 0x7fec8413bb00 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7fec780013e0 tx=0x7fec780093e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:12.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.094+0000 7fec73fff700 1 -- 172.21.15.103:0/3077262639 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec7800cbe0 con 0x7fec68004db0 2020-04-22T14:16:12.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.094+0000 7fec82ffd700 1 --2- 172.21.15.103:0/3077262639 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fec68004db0 0x7fec8413bb00 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7fec780013e0 tx=0x7fec780093e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:12.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.094+0000 7fec898fa700 1 -- 172.21.15.103:0/3077262639 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec8413f9d0 con 0x7fec68004db0 2020-04-22T14:16:12.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.095+0000 7fec73fff700 1 -- 172.21.15.103:0/3077262639 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7800cd40 con 0x7fec68004db0 2020-04-22T14:16:12.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.095+0000 7fec82ffd700 1 --2- 172.21.15.103:0/3077262639 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fec68004db0 0x7fec8413bb00 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7fec780013e0 tx=0x7fec780093e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:12.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.095+0000 7fec73fff700 1 -- 172.21.15.103:0/3077262639 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec78012840 con 0x7fec68004db0 2020-04-22T14:16:12.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.095+0000 7fec898fa700 1 -- 172.21.15.103:0/3077262639 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec84154310 con 0x7fec68004db0 2020-04-22T14:16:12.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.095+0000 7fec82ffd700 1 --2- 172.21.15.103:0/3077262639 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fec68004db0 0x7fec8413bb00 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7fec780013e0 tx=0x7fec780093e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:12.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.095+0000 7fec898fa700 1 -- 172.21.15.103:0/3077262639 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec84140030 con 0x7fec68004db0 2020-04-22T14:16:12.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.096+0000 7fec73fff700 1 -- 172.21.15.103:0/3077262639 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fec78013070 con 0x7fec68004db0 2020-04-22T14:16:12.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.096+0000 7fec82ffd700 1 --2- 172.21.15.103:0/3077262639 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fec68004db0 0x7fec8413bb00 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7fec780013e0 tx=0x7fec780093e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:12.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.096+0000 7fec73fff700 1 --2- 172.21.15.103:0/3077262639 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fec6004de20 0x7fec600502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:12.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.096+0000 7fec73fff700 1 -- 172.21.15.103:0/3077262639 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fec78060f70 con 0x7fec68004db0 2020-04-22T14:16:12.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.096+0000 7fec827fc700 1 --2- 172.21.15.103:0/3077262639 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fec6004de20 0x7fec600502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:12.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.096+0000 7fec827fc700 1 --2- 172.21.15.103:0/3077262639 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fec6004de20 0x7fec600502e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fec74002f30 tx=0x7fec7400c940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:12.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.096+0000 7fec827fc700 1 --2- 172.21.15.103:0/3077262639 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fec6004de20 0x7fec600502e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fec74002f30 tx=0x7fec7400c940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:12.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.096+0000 7fec827fc700 1 --2- 172.21.15.103:0/3077262639 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fec6004de20 0x7fec600502e0 secure :-1 s=READY pgs=598 cs=0 l=1 rx=0x7fec74002f30 tx=0x7fec7400c940).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:12.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.099+0000 7fec82ffd700 1 --2- 172.21.15.103:0/3077262639 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fec68004db0 0x7fec8413bb00 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7fec780013e0 tx=0x7fec780093e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:12.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.100+0000 7fec73fff700 1 -- 172.21.15.103:0/3077262639 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fec7803c350 con 0x7fec68004db0 2020-04-22T14:16:12.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.289+0000 7fec898fa700 1 -- 172.21.15.103:0/3077262639 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec8413fe30 con 0x7fec68004db0 2020-04-22T14:16:12.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.290+0000 7fec82ffd700 1 --2- 172.21.15.103:0/3077262639 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fec68004db0 0x7fec8413bb00 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7fec780013e0 tx=0x7fec780093e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:12.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.290+0000 7fec73fff700 1 -- 172.21.15.103:0/3077262639 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+2143 (secure 0 0 0) 0x7fec7803f970 con 0x7fec68004db0 2020-04-22T14:16:12.293 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:16:12.293 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":82,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7776,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/3450302561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3450302561},{"type":"v1","addr":"172.21.15.86:6835","nonce":3450302561}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":78}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:16:05.150517+0000","modified":"2020-04-22T14:16:07.155780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8470":{"gid":8470,"name":"a","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/3949453152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3949453152},{"type":"v1","addr":"172.21.15.103:6833","nonce":3949453152}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2020-04-22T14:16:12.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.291+0000 7fec898fa700 1 -- 172.21.15.103:0/3077262639 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fec6004de20 msgr2=0x7fec600502e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:12.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.291+0000 7fec898fa700 1 --2- 172.21.15.103:0/3077262639 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fec6004de20 0x7fec600502e0 secure :-1 s=READY pgs=598 cs=0 l=1 rx=0x7fec74002f30 tx=0x7fec7400c940).stop 2020-04-22T14:16:12.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.291+0000 7fec898fa700 1 -- 172.21.15.103:0/3077262639 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fec68004db0 msgr2=0x7fec8413bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:12.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.291+0000 7fec898fa700 1 --2- 172.21.15.103:0/3077262639 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fec68004db0 0x7fec8413bb00 secure :-1 s=READY pgs=155 cs=0 l=1 rx=0x7fec780013e0 tx=0x7fec780093e0).stop 2020-04-22T14:16:12.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.291+0000 7fec898fa700 1 -- 172.21.15.103:0/3077262639 shutdown_connections 2020-04-22T14:16:12.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.291+0000 7fec898fa700 1 --2- 172.21.15.103:0/3077262639 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fec6004de20 0x7fec600502e0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:12.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.291+0000 7fec898fa700 1 --2- 172.21.15.103:0/3077262639 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fec68004db0 0x7fec8413bb00 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:12.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.291+0000 7fec898fa700 1 -- 172.21.15.103:0/3077262639 >> 172.21.15.103:0/3077262639 conn(0x7fec8405ad30 msgr2=0x7fec84061e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:12.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.291+0000 7fec898fa700 1 -- 172.21.15.103:0/3077262639 shutdown_connections 2020-04-22T14:16:12.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:12.291+0000 7fec898fa700 1 -- 172.21.15.103:0/3077262639 wait complete. 2020-04-22T14:16:12.296 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 82 2020-04-22T14:16:12.506 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 8470}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 19, u'failed': [], u'epoch': 82, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [20], u'info': {u'gid_8470': {u'export_targets': [], u'name': u'a', u'incarnation': 79, u'state_seq': 3, u'state': u'up:active', u'gid': 8470, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 3949453152, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 3949453152, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/3949453152'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:16:05.150517+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:16:07.155780+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:16:12.506 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:16:12.507 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:12.529 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:16:12.680 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:16:12.681 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:16:12.681 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:16:12.681 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 8470, 2020-04-22T14:16:12.681 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:16:12.681 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:16:12.681 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 7.5268809369999996, 2020-04-22T14:16:12.682 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 82, 2020-04-22T14:16:12.682 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 113, 2020-04-22T14:16:12.682 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 113, 2020-04-22T14:16:12.682 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 12.952328199 2020-04-22T14:16:12.682 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:16:12.689 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 8470, "want_state": "up:active", "state": "up:active", "rank_uptime": 7.5268809369999996, "mdsmap_epoch": 82, "osdmap_epoch": 113, "osdmap_epoch_barrier": 113, "uptime": 12.952328199 } 2020-04-22T14:16:12.689 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-04-22T14:16:12.689 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:16:12.690 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:12.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:12.703 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:16:12.765 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:16:12.765 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:16:12.765 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:16:12.765 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:16:12.766 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:16:12.766 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:16:12.766 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:16:12.766 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:16:12.766 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:16:12.766 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:16:12.766 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:16:12.767 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:16:12.767 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:16:12.767 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:16:12.767 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:16:12.767 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 41867sec preferred_lft 41867sec 2020-04-22T14:16:12.767 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:16:12.767 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:16:12.767 INFO:teuthology.orchestra.run.smithi103.stdout:34: brx.1@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:16:12.768 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether d2:98:d4:1b:2c:0d brd ff:ff:ff:ff:ff:ff link-netnsid 1 2020-04-22T14:16:12.768 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-04-22T14:16:12.768 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:12.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:12.811 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:16:12.887 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:12.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:12.940 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge con-name ceph-brx ifname ceph-brx stp no' 2020-04-22T14:16:13.048 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' (383228ff-5b5c-4b7b-a300-7e4b97f1129b) successfully added. 2020-04-22T14:16:13.049 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:13.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:13.078 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection modify ceph-brx ipv4.addresses 192.168.255.254/16 ipv4.method manual' 2020-04-22T14:16:13.186 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:13.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:13.200 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up ceph-brx' 2020-04-22T14:16:13.313 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (master waiting for slaves) (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/43) 2020-04-22T14:16:13.314 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:13.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:13.328 INFO:teuthology.orchestra.run.smithi103:> touch /tmp/python-ceph-brx 2020-04-22T14:16:13.387 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:13.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:13.436 INFO:teuthology.orchestra.run.smithi103:> cat /proc/sys/net/ipv4/ip_forward 2020-04-22T14:16:13.498 INFO:teuthology.orchestra.run.smithi103.stdout:0 2020-04-22T14:16:13.499 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:13.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:13.554 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 0 > /tmp/python-ceph-brx' 2020-04-22T14:16:13.633 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:13.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:13.682 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 1 > /proc/sys/net/ipv4/ip_forward' 2020-04-22T14:16:13.757 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:13.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:13.804 INFO:teuthology.orchestra.run.smithi103:> route 2020-04-22T14:16:13.863 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2020-04-22T14:16:13.864 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-04-22T14:16:13.864 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 102 0 0 enp3s0f1 2020-04-22T14:16:13.864 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 102 0 0 enp3s0f1 2020-04-22T14:16:13.864 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 425 0 0 ceph-brx 2020-04-22T14:16:13.865 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:13.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:13.912 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-04-22T14:16:13.989 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:14.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:14.033 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-04-22T14:16:14.108 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:14.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:14.155 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-04-22T14:16:14.237 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:14.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:14.299 INFO:teuthology.orchestra.run.smithi103:> ip netns list 2020-04-22T14:16:14.357 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:14.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:14.408 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:16:14.468 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 1 2020-04-22T14:16:14.469 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:14.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:14.515 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:16:14.593 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:14.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:14.637 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0' 2020-04-22T14:16:14.717 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-04-22T14:16:14.717 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:14.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:14.759 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0' 2020-04-22T14:16:14.835 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:14.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:14.882 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0' 2020-04-22T14:16:14.990 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:15.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:15.004 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up' 2020-04-22T14:16:15.114 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:15.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:15.129 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up' 2020-04-22T14:16:15.238 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:15.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:15.253 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254' 2020-04-22T14:16:15.360 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:15.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:15.374 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:16:15.449 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:15.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:15.500 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge-slave con-name brx.0 ifname brx.0 master ceph-brx' 2020-04-22T14:16:15.608 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.0' (64b8aecc-2558-4ca0-b85c-ec51c316d7af) successfully added. 2020-04-22T14:16:15.608 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:15.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:15.638 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up brx.0' 2020-04-22T14:16:15.797 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/44) 2020-04-22T14:16:15.848 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-04-22T14:16:15.848 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi103.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-04-22T14:16:15.848 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:15.862 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:16:15.862 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:16:15.922 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:15.976 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:16:15.977 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:16:16.054 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:16:16.057 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:16:16.057 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:16.170 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:16:16.173 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:16:16.230 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-04-22T14:16:16.231 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:16.289 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:16:16.336 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:16.352 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:16:16.352 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:16:16.424 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:2020-04-22T14:16:16.421+0000 7f57d29c81c0 -1 init, newargv = 0x55bb2c63a4c0 newargc=9 2020-04-22T14:16:16.425 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[100936]: starting ceph client 2020-04-22T14:16:16.428 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:16:16.428 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[100936]: starting fuse 2020-04-22T14:16:16.439 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:16:16.439 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:16.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:16:16.485 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:16:16.558 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:16:16.563 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2020-04-22T14:16:16.563 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:16.614 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:16:16.614 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:16:16.614 INFO:teuthology.orchestra.run.smithi103:> import glob 2020-04-22T14:16:16.614 INFO:teuthology.orchestra.run.smithi103:> import re 2020-04-22T14:16:16.615 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:16:16.615 INFO:teuthology.orchestra.run.smithi103:> import subprocess 2020-04-22T14:16:16.615 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:16:16.615 INFO:teuthology.orchestra.run.smithi103:> def find_socket(client_name): 2020-04-22T14:16:16.615 INFO:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-04-22T14:16:16.615 INFO:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2020-04-22T14:16:16.615 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:16:16.615 INFO:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2020-04-22T14:16:16.615 INFO:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2020-04-22T14:16:16.616 INFO:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2020-04-22T14:16:16.616 INFO:teuthology.orchestra.run.smithi103:> return files[0] 2020-04-22T14:16:16.616 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:16:16.616 INFO:teuthology.orchestra.run.smithi103:> for f in files: 2020-04-22T14:16:16.616 INFO:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:16:16.616 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:16:16.616 INFO:teuthology.orchestra.run.smithi103:> return f 2020-04-22T14:16:16.616 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:16:16.617 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:16:16.617 INFO:teuthology.orchestra.run.smithi103:> print(find_socket("client.0")) 2020-04-22T14:16:16.617 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:16:16.723 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.0.100936.asok 2020-04-22T14:16:16.724 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.100936.asok 2020-04-22T14:16:16.724 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:16.738 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:16:16.739 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.100936.asok status 2020-04-22T14:16:16.897 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:16:16.897 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2020-04-22T14:16:16.898 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:16:16.898 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:16:16.898 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "0", 2020-04-22T14:16:16.898 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:16:16.898 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-04-22T14:16:16.898 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "100936", 2020-04-22T14:16:16.898 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:16:16.899 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:16.899 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2020-04-22T14:16:16.899 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2020-04-22T14:16:16.899 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 8662, 2020-04-22T14:16:16.899 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2020-04-22T14:16:16.899 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:16:16.899 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:16:16.900 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 8662 2020-04-22T14:16:16.900 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:16.900 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:16:16.900 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:16:16.900 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:16:16.900 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1115483089 2020-04-22T14:16:16.900 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:16.901 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:16.901 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:16:16.901 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:16:16.901 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:16:16.901 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1115483089 2020-04-22T14:16:16.901 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:16.901 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.8662 192.168.0.1:0/1115483089", 2020-04-22T14:16:16.901 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.1:0/1115483089", 2020-04-22T14:16:16.902 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2020-04-22T14:16:16.902 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 82, 2020-04-22T14:16:16.902 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 113, 2020-04-22T14:16:16.902 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2020-04-22T14:16:16.902 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklisted": false 2020-04-22T14:16:16.902 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:16:16.903 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:16.927 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:16:16.928 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-22T14:16:16.928 INFO:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:16:16.988 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2020-04-22T14:16:16.989 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-04-22T14:16:16.989 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:17.039 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:16:17.039 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:16:17.115 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:17.161 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:16:17.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.305+0000 7f8c719b8700 1 Processor -- start 2020-04-22T14:16:17.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.305+0000 7f8c719b8700 1 -- start start 2020-04-22T14:16:17.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.306+0000 7f8c719b8700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8c6c065fe0 0x7f8c6c1464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:17.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.306+0000 7f8c719b8700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8c6c063e30 0x7f8c6c0642a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:17.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.306+0000 7f8c719b8700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c6c143300 con 0x7f8c6c12c0d0 2020-04-22T14:16:17.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.306+0000 7f8c719b8700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c6c1435a0 con 0x7f8c6c063e30 2020-04-22T14:16:17.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.306+0000 7f8c719b8700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c143840 con 0x7f8c6c065fe0 2020-04-22T14:16:17.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.306+0000 7f8c6a7fc700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8c6c065fe0 0x7f8c6c1464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:17.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.306+0000 7f8c6b7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8c6c063e30 0x7f8c6c0642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:17.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.306+0000 7f8c6a7fc700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8c6c065fe0 0x7f8c6c1464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:40892/0 (socket says 172.21.15.103:40892) 2020-04-22T14:16:17.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.306+0000 7f8c6b7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8c6c063e30 0x7f8c6c0642a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:53346/0 (socket says 172.21.15.103:53346) 2020-04-22T14:16:17.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.306+0000 7f8c6a7fc700 1 -- 172.21.15.103:0/61515548 learned_addr learned my addr 172.21.15.103:0/61515548 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:17.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.306+0000 7f8c6affd700 1 --1- 172.21.15.103:0/61515548 >> v1:172.21.15.86:6789/0 conn(0x7f8c6c12c0d0 0x7f8c6c05b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:37228/0 (socket says 172.21.15.103:37228) 2020-04-22T14:16:17.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.306+0000 7f8c6b7fe700 1 -- 172.21.15.103:0/61515548 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8c6c065fe0 msgr2=0x7f8c6c1464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:17.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.306+0000 7f8c6b7fe700 1 --2- 172.21.15.103:0/61515548 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8c6c065fe0 0x7f8c6c1464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:17.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.306+0000 7f8c6b7fe700 1 -- 172.21.15.103:0/61515548 >> v1:172.21.15.86:6789/0 conn(0x7f8c6c12c0d0 legacy=0x7f8c6c05b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:17.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.306+0000 7f8c69ffb700 1 -- 172.21.15.103:0/61515548 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 712459255 0 0) 0x7f8c6c143300 con 0x7f8c6c12c0d0 2020-04-22T14:16:17.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.306+0000 7f8c6b7fe700 1 -- 172.21.15.103:0/61515548 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c6c05bb50 con 0x7f8c6c063e30 2020-04-22T14:16:17.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.306+0000 7f8c6b7fe700 1 --2- 172.21.15.103:0/61515548 >> v2:172.21.15.86:3300/0 conn(0x7f8c6c063e30 0x7f8c6c0642a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8c640032b0 tx=0x7f8c64007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.307+0000 7f8c6b7fe700 1 --2- 172.21.15.103:0/61515548 >> v2:172.21.15.86:3300/0 conn(0x7f8c6c063e30 0x7f8c6c0642a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8c640032b0 tx=0x7f8c64007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.307+0000 7f8c6b7fe700 1 --2- 172.21.15.103:0/61515548 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c6c063e30 0x7f8c6c0642a0 secure :-1 s=READY pgs=880 cs=0 l=1 rx=0x7f8c640032b0 tx=0x7f8c64007dc0).ready entity=mon.0 client_cookie=e8d2bb1f22b0808 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:17.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.307+0000 7f8c6b7fe700 1 --2- 172.21.15.103:0/61515548 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c6c063e30 0x7f8c6c0642a0 secure :-1 s=THROTTLE_DONE pgs=880 cs=0 l=1 rx=0x7f8c640032b0 tx=0x7f8c64007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.307+0000 7f8c69ffb700 1 -- 172.21.15.103:0/61515548 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c64011e20 con 0x7f8c6c063e30 2020-04-22T14:16:17.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.307+0000 7f8c6b7fe700 1 --2- 172.21.15.103:0/61515548 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c6c063e30 0x7f8c6c0642a0 secure :-1 s=THROTTLE_DONE pgs=880 cs=0 l=1 rx=0x7f8c640032b0 tx=0x7f8c64007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.307+0000 7f8c69ffb700 1 -- 172.21.15.103:0/61515548 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6400a180 con 0x7f8c6c063e30 2020-04-22T14:16:17.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.307+0000 7f8c6b7fe700 1 --2- 172.21.15.103:0/61515548 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c6c063e30 0x7f8c6c0642a0 secure :-1 s=THROTTLE_DONE pgs=880 cs=0 l=1 rx=0x7f8c640032b0 tx=0x7f8c64007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.307+0000 7f8c69ffb700 1 -- 172.21.15.103:0/61515548 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c6400a520 con 0x7f8c6c063e30 2020-04-22T14:16:17.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.307+0000 7f8c719b8700 1 -- 172.21.15.103:0/61515548 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c6c063e30 msgr2=0x7f8c6c0642a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:17.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.307+0000 7f8c719b8700 1 --2- 172.21.15.103:0/61515548 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c6c063e30 0x7f8c6c0642a0 secure :-1 s=READY pgs=880 cs=0 l=1 rx=0x7f8c640032b0 tx=0x7f8c64007dc0).stop 2020-04-22T14:16:17.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.307+0000 7f8c719b8700 1 -- 172.21.15.103:0/61515548 shutdown_connections 2020-04-22T14:16:17.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.307+0000 7f8c719b8700 1 --2- 172.21.15.103:0/61515548 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c6c063e30 0x7f8c6c0642a0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:17.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.307+0000 7f8c719b8700 1 --2- 172.21.15.103:0/61515548 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8c6c065fe0 0x7f8c6c1464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:17.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.307+0000 7f8c719b8700 1 -- 172.21.15.103:0/61515548 >> 172.21.15.103:0/61515548 conn(0x7f8c6c0b9160 msgr2=0x7f8c6c05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:17.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.307+0000 7f8c719b8700 1 -- 172.21.15.103:0/61515548 shutdown_connections 2020-04-22T14:16:17.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.307+0000 7f8c719b8700 1 -- 172.21.15.103:0/61515548 wait complete. 2020-04-22T14:16:17.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.308+0000 7f8c719b8700 1 Processor -- start 2020-04-22T14:16:17.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.308+0000 7f8c719b8700 1 -- start start 2020-04-22T14:16:17.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.309+0000 7f8c719b8700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8c6c063e30 0x7f8c6c0afcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:17.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.309+0000 7f8c719b8700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8c6c065fe0 0x7f8c6c0b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:17.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.309+0000 7f8c719b8700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c6c0b0230 con 0x7f8c6c12c0d0 2020-04-22T14:16:17.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.309+0000 7f8c719b8700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c6c0b04d0 con 0x7f8c6c065fe0 2020-04-22T14:16:17.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.309+0000 7f8c719b8700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c6c151c70 con 0x7f8c6c063e30 2020-04-22T14:16:17.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.309+0000 7f8c6affd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8c6c063e30 0x7f8c6c0afcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:17.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.309+0000 7f8c6affd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8c6c063e30 0x7f8c6c0afcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56118/0 (socket says 172.21.15.103:56118) 2020-04-22T14:16:17.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.309+0000 7f8c6affd700 1 -- 172.21.15.103:0/3674212912 learned_addr learned my addr 172.21.15.103:0/3674212912 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:17.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.309+0000 7f8c6a7fc700 1 --2- 172.21.15.103:0/3674212912 >> v2:172.21.15.86:3300/0 conn(0x7f8c6c065fe0 0x7f8c6c0b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:17.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.309+0000 7f8c6affd700 1 -- 172.21.15.103:0/3674212912 >> v2:172.21.15.86:3300/0 conn(0x7f8c6c065fe0 msgr2=0x7f8c6c0b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:17.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.309+0000 7f8c6affd700 1 --2- 172.21.15.103:0/3674212912 >> v2:172.21.15.86:3300/0 conn(0x7f8c6c065fe0 0x7f8c6c0b18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:17.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.309+0000 7f8c6affd700 1 -- 172.21.15.103:0/3674212912 >> v1:172.21.15.103:6789/0 conn(0x7f8c6c12c0d0 legacy=0x7f8c6c0b5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:17.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.309+0000 7f8c5bfff700 1 -- 172.21.15.103:0/3674212912 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1874877469 0 0) 0x7f8c6c0b0230 con 0x7f8c6c12c0d0 2020-04-22T14:16:17.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.309+0000 7f8c6affd700 1 -- 172.21.15.103:0/3674212912 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c6c0b5850 con 0x7f8c6c063e30 2020-04-22T14:16:17.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.309+0000 7f8c6affd700 1 --2- 172.21.15.103:0/3674212912 >> v2:172.21.15.103:3300/0 conn(0x7f8c6c063e30 0x7f8c6c0afcb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8c60000b80 tx=0x7f8c60010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.310+0000 7f8c6affd700 1 --2- 172.21.15.103:0/3674212912 >> v2:172.21.15.103:3300/0 conn(0x7f8c6c063e30 0x7f8c6c0afcb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8c60000b80 tx=0x7f8c60010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.310+0000 7f8c6affd700 1 --2- 172.21.15.103:0/3674212912 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c6c063e30 0x7f8c6c0afcb0 secure :-1 s=READY pgs=1649 cs=0 l=1 rx=0x7f8c60000b80 tx=0x7f8c60010940).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:17.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.310+0000 7f8c6affd700 1 --2- 172.21.15.103:0/3674212912 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c6c063e30 0x7f8c6c0afcb0 secure :-1 s=THROTTLE_DONE pgs=1649 cs=0 l=1 rx=0x7f8c60000b80 tx=0x7f8c60010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.310+0000 7f8c5bfff700 1 -- 172.21.15.103:0/3674212912 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c60011650 con 0x7f8c6c063e30 2020-04-22T14:16:17.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.310+0000 7f8c6affd700 1 --2- 172.21.15.103:0/3674212912 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c6c063e30 0x7f8c6c0afcb0 secure :-1 s=THROTTLE_DONE pgs=1649 cs=0 l=1 rx=0x7f8c60000b80 tx=0x7f8c60010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.310+0000 7f8c719b8700 1 -- 172.21.15.103:0/3674212912 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c6c0b1d50 con 0x7f8c6c063e30 2020-04-22T14:16:17.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.310+0000 7f8c5bfff700 1 -- 172.21.15.103:0/3674212912 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c600117b0 con 0x7f8c6c063e30 2020-04-22T14:16:17.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.310+0000 7f8c6affd700 1 --2- 172.21.15.103:0/3674212912 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c6c063e30 0x7f8c6c0afcb0 secure :-1 s=THROTTLE_DONE pgs=1649 cs=0 l=1 rx=0x7f8c60000b80 tx=0x7f8c60010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.310+0000 7f8c5bfff700 1 -- 172.21.15.103:0/3674212912 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c60011b50 con 0x7f8c6c063e30 2020-04-22T14:16:17.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.310+0000 7f8c719b8700 1 -- 172.21.15.103:0/3674212912 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c6c152110 con 0x7f8c6c063e30 2020-04-22T14:16:17.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.310+0000 7f8c6affd700 1 --2- 172.21.15.103:0/3674212912 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c6c063e30 0x7f8c6c0afcb0 secure :-1 s=THROTTLE_DONE pgs=1649 cs=0 l=1 rx=0x7f8c60000b80 tx=0x7f8c60010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.311+0000 7f8c719b8700 1 -- 172.21.15.103:0/3674212912 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c6c056c90 con 0x7f8c6c063e30 2020-04-22T14:16:17.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.311+0000 7f8c5bfff700 1 -- 172.21.15.103:0/3674212912 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f8c6000b370 con 0x7f8c6c063e30 2020-04-22T14:16:17.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.311+0000 7f8c6affd700 1 --2- 172.21.15.103:0/3674212912 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c6c063e30 0x7f8c6c0afcb0 secure :-1 s=THROTTLE_DONE pgs=1649 cs=0 l=1 rx=0x7f8c60000b80 tx=0x7f8c60010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.311+0000 7f8c5bfff700 1 --2- 172.21.15.103:0/3674212912 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8c4804d7f0 0x7f8c4804fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:17.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.311+0000 7f8c5bfff700 1 -- 172.21.15.103:0/3674212912 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8c60061520 con 0x7f8c6c063e30 2020-04-22T14:16:17.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.311+0000 7f8c6a7fc700 1 --2- 172.21.15.103:0/3674212912 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8c4804d7f0 0x7f8c4804fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:17.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.312+0000 7f8c6a7fc700 1 --2- 172.21.15.103:0/3674212912 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8c4804d7f0 0x7f8c4804fcb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8c5c002f30 tx=0x7f8c5c002ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.312+0000 7f8c6a7fc700 1 --2- 172.21.15.103:0/3674212912 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8c4804d7f0 0x7f8c4804fcb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8c5c002f30 tx=0x7f8c5c002ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.312+0000 7f8c6a7fc700 1 --2- 172.21.15.103:0/3674212912 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8c4804d7f0 0x7f8c4804fcb0 secure :-1 s=READY pgs=599 cs=0 l=1 rx=0x7f8c5c002f30 tx=0x7f8c5c002ed0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:17.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.315+0000 7f8c6affd700 1 --2- 172.21.15.103:0/3674212912 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c6c063e30 0x7f8c6c0afcb0 secure :-1 s=THROTTLE_DONE pgs=1649 cs=0 l=1 rx=0x7f8c60000b80 tx=0x7f8c60010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.315+0000 7f8c5bfff700 1 -- 172.21.15.103:0/3674212912 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f8c6003c900 con 0x7f8c6c063e30 2020-04-22T14:16:17.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.459+0000 7f8c719b8700 1 -- 172.21.15.103:0/3674212912 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c6c0b83d0 con 0x7f8c6c063e30 2020-04-22T14:16:17.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.460+0000 7f8c6affd700 1 --2- 172.21.15.103:0/3674212912 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c6c063e30 0x7f8c6c0afcb0 secure :-1 s=THROTTLE_DONE pgs=1649 cs=0 l=1 rx=0x7f8c60000b80 tx=0x7f8c60010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.460+0000 7f8c5bfff700 1 -- 172.21.15.103:0/3674212912 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+16103 (secure 0 0 0) 0x7f8c6003ff20 con 0x7f8c6c063e30 2020-04-22T14:16:17.463 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:16:17.463 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":113,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:16:06.152090+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:16:02.890350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2020-04-22T14:16:03.893169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:16:17.466 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.461+0000 7f8c719b8700 1 -- 172.21.15.103:0/3674212912 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8c4804d7f0 msgr2=0x7f8c4804fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:17.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.461+0000 7f8c719b8700 1 --2- 172.21.15.103:0/3674212912 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8c4804d7f0 0x7f8c4804fcb0 secure :-1 s=READY pgs=599 cs=0 l=1 rx=0x7f8c5c002f30 tx=0x7f8c5c002ed0).stop 2020-04-22T14:16:17.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.461+0000 7f8c719b8700 1 -- 172.21.15.103:0/3674212912 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c6c063e30 msgr2=0x7f8c6c0afcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:17.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.461+0000 7f8c719b8700 1 --2- 172.21.15.103:0/3674212912 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c6c063e30 0x7f8c6c0afcb0 secure :-1 s=READY pgs=1649 cs=0 l=1 rx=0x7f8c60000b80 tx=0x7f8c60010940).stop 2020-04-22T14:16:17.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.461+0000 7f8c719b8700 1 -- 172.21.15.103:0/3674212912 shutdown_connections 2020-04-22T14:16:17.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.461+0000 7f8c719b8700 1 --2- 172.21.15.103:0/3674212912 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c6c063e30 0x7f8c6c0afcb0 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:17.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.461+0000 7f8c719b8700 1 --2- 172.21.15.103:0/3674212912 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8c4804d7f0 0x7f8c4804fcb0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:17.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.461+0000 7f8c719b8700 1 --2- 172.21.15.103:0/3674212912 >> v2:172.21.15.86:3300/0 conn(0x7f8c6c065fe0 0x7f8c6c0b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:17.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.461+0000 7f8c719b8700 1 -- 172.21.15.103:0/3674212912 >> 172.21.15.103:0/3674212912 conn(0x7f8c6c0b9160 msgr2=0x7f8c6c062a90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:17.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.461+0000 7f8c719b8700 1 -- 172.21.15.103:0/3674212912 shutdown_connections 2020-04-22T14:16:17.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.461+0000 7f8c719b8700 1 -- 172.21.15.103:0/3674212912 wait complete. 2020-04-22T14:16:17.474 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:16:02.890350+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 19, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'112', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:16:03.893169+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 20, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'113', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:16:17.477 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:17.491 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:16:17.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.639+0000 7fd2eb3b6700 1 Processor -- start 2020-04-22T14:16:17.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.639+0000 7fd2eb3b6700 1 -- start start 2020-04-22T14:16:17.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.640+0000 7fd2eb3b6700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd2e40b8e00 0x7fd2e40af010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:17.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.640+0000 7fd2eb3b6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2e40b91e0 0x7fd2e4142f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:17.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.640+0000 7fd2eb3b6700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e40b29b0 con 0x7fd2e405fed0 2020-04-22T14:16:17.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.640+0000 7fd2eb3b6700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2e40b4270 con 0x7fd2e40b8e00 2020-04-22T14:16:17.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.640+0000 7fd2eb3b6700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e40b4510 con 0x7fd2e40b91e0 2020-04-22T14:16:17.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.641+0000 7fd2e9bb3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2e40b91e0 0x7fd2e4142f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:17.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.641+0000 7fd2ea3b4700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd2e40b8e00 0x7fd2e40af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:17.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.641+0000 7fd2ea3b4700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd2e40b8e00 0x7fd2e40af010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:53358/0 (socket says 172.21.15.103:53358) 2020-04-22T14:16:17.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.641+0000 7fd2e9bb3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2e40b91e0 0x7fd2e4142f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:40904/0 (socket says 172.21.15.103:40904) 2020-04-22T14:16:17.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.641+0000 7fd2ea3b4700 1 -- 172.21.15.103:0/3679507997 learned_addr learned my addr 172.21.15.103:0/3679507997 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:17.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.641+0000 7fd2ea3b4700 1 -- 172.21.15.103:0/3679507997 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2e40b91e0 msgr2=0x7fd2e4142f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:17.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.641+0000 7fd2ea3b4700 1 --2- 172.21.15.103:0/3679507997 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2e40b91e0 0x7fd2e4142f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:17.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.641+0000 7fd2ea3b4700 1 -- 172.21.15.103:0/3679507997 >> v1:172.21.15.86:6789/0 conn(0x7fd2e405fed0 legacy=0x7fd2e40b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:17.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.641+0000 7fd2e93b2700 1 -- 172.21.15.103:0/3679507997 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2851313889 0 0) 0x7fd2e40b29b0 con 0x7fd2e405fed0 2020-04-22T14:16:17.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.641+0000 7fd2ea3b4700 1 -- 172.21.15.103:0/3679507997 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e40b22d0 con 0x7fd2e40b8e00 2020-04-22T14:16:17.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.641+0000 7fd2ea3b4700 1 --2- 172.21.15.103:0/3679507997 >> v2:172.21.15.86:3300/0 conn(0x7fd2e40b8e00 0x7fd2e40af010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd2d4002f30 tx=0x7fd2d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.641+0000 7fd2ea3b4700 1 --2- 172.21.15.103:0/3679507997 >> v2:172.21.15.86:3300/0 conn(0x7fd2e40b8e00 0x7fd2e40af010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd2d4002f30 tx=0x7fd2d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.641+0000 7fd2ea3b4700 1 --2- 172.21.15.103:0/3679507997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2e40b8e00 0x7fd2e40af010 secure :-1 s=READY pgs=882 cs=0 l=1 rx=0x7fd2d4002f30 tx=0x7fd2d4007a40).ready entity=mon.0 client_cookie=f557e481e55a6160 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:17.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.641+0000 7fd2ea3b4700 1 --2- 172.21.15.103:0/3679507997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2e40b8e00 0x7fd2e40af010 secure :-1 s=THROTTLE_DONE pgs=882 cs=0 l=1 rx=0x7fd2d4002f30 tx=0x7fd2d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.641+0000 7fd2e93b2700 1 -- 172.21.15.103:0/3679507997 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2d4013d70 con 0x7fd2e40b8e00 2020-04-22T14:16:17.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.641+0000 7fd2ea3b4700 1 --2- 172.21.15.103:0/3679507997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2e40b8e00 0x7fd2e40af010 secure :-1 s=THROTTLE_DONE pgs=882 cs=0 l=1 rx=0x7fd2d4002f30 tx=0x7fd2d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.641+0000 7fd2ea3b4700 1 --2- 172.21.15.103:0/3679507997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2e40b8e00 0x7fd2e40af010 secure :-1 s=THROTTLE_DONE pgs=882 cs=0 l=1 rx=0x7fd2d4002f30 tx=0x7fd2d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.641+0000 7fd2e93b2700 1 -- 172.21.15.103:0/3679507997 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d400c180 con 0x7fd2e40b8e00 2020-04-22T14:16:17.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.641+0000 7fd2e93b2700 1 -- 172.21.15.103:0/3679507997 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2d400c560 con 0x7fd2e40b8e00 2020-04-22T14:16:17.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.641+0000 7fd2eb3b6700 1 -- 172.21.15.103:0/3679507997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2e40b8e00 msgr2=0x7fd2e40af010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:17.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.641+0000 7fd2eb3b6700 1 --2- 172.21.15.103:0/3679507997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2e40b8e00 0x7fd2e40af010 secure :-1 s=READY pgs=882 cs=0 l=1 rx=0x7fd2d4002f30 tx=0x7fd2d4007a40).stop 2020-04-22T14:16:17.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.642+0000 7fd2eb3b6700 1 -- 172.21.15.103:0/3679507997 shutdown_connections 2020-04-22T14:16:17.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.642+0000 7fd2eb3b6700 1 --2- 172.21.15.103:0/3679507997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2e40b8e00 0x7fd2e40af010 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:17.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.642+0000 7fd2eb3b6700 1 --2- 172.21.15.103:0/3679507997 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2e40b91e0 0x7fd2e4142f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:17.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.642+0000 7fd2eb3b6700 1 -- 172.21.15.103:0/3679507997 >> 172.21.15.103:0/3679507997 conn(0x7fd2e405b780 msgr2=0x7fd2e40b8530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:17.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.642+0000 7fd2eb3b6700 1 -- 172.21.15.103:0/3679507997 shutdown_connections 2020-04-22T14:16:17.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.642+0000 7fd2eb3b6700 1 -- 172.21.15.103:0/3679507997 wait complete. 2020-04-22T14:16:17.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.643+0000 7fd2eb3b6700 1 Processor -- start 2020-04-22T14:16:17.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.643+0000 7fd2eb3b6700 1 -- start start 2020-04-22T14:16:17.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.644+0000 7fd2eb3b6700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd2e405fed0 0x7fd2e4140be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:17.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.644+0000 7fd2eb3b6700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd2e40b91e0 0x7fd2e413ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:17.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.644+0000 7fd2eb3b6700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e413f0f0 con 0x7fd2e40b8e00 2020-04-22T14:16:17.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.644+0000 7fd2eb3b6700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2e4062a10 con 0x7fd2e40b91e0 2020-04-22T14:16:17.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.644+0000 7fd2eb3b6700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2e4062cb0 con 0x7fd2e405fed0 2020-04-22T14:16:17.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.644+0000 7fd2ea3b4700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd2e405fed0 0x7fd2e4140be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:17.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.644+0000 7fd2e9bb3700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd2e40b8e00 0x7fd2e41415d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48322/0 (socket says 172.21.15.103:48322) 2020-04-22T14:16:17.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.644+0000 7fd2ea3b4700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd2e405fed0 0x7fd2e4140be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56130/0 (socket says 172.21.15.103:56130) 2020-04-22T14:16:17.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.644+0000 7fd2e9bb3700 1 -- 172.21.15.103:0/2750342038 learned_addr learned my addr 172.21.15.103:0/2750342038 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:17.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.644+0000 7fd2eabb5700 1 --2- 172.21.15.103:0/2750342038 >> v2:172.21.15.86:3300/0 conn(0x7fd2e40b91e0 0x7fd2e413ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:17.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.644+0000 7fd2ea3b4700 1 -- 172.21.15.103:0/2750342038 >> v2:172.21.15.86:3300/0 conn(0x7fd2e40b91e0 msgr2=0x7fd2e413ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:17.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.644+0000 7fd2ea3b4700 1 --2- 172.21.15.103:0/2750342038 >> v2:172.21.15.86:3300/0 conn(0x7fd2e40b91e0 0x7fd2e413ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:17.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.644+0000 7fd2ea3b4700 1 -- 172.21.15.103:0/2750342038 >> v1:172.21.15.103:6789/0 conn(0x7fd2e40b8e00 legacy=0x7fd2e41415d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:17.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.644+0000 7fd2d37fe700 1 -- 172.21.15.103:0/2750342038 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2213680594 0 0) 0x7fd2e0001ec0 con 0x7fd2e40b8e00 2020-04-22T14:16:17.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.644+0000 7fd2ea3b4700 1 -- 172.21.15.103:0/2750342038 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e4062f50 con 0x7fd2e405fed0 2020-04-22T14:16:17.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.644+0000 7fd2ea3b4700 1 --2- 172.21.15.103:0/2750342038 >> v2:172.21.15.103:3300/0 conn(0x7fd2e405fed0 0x7fd2e4140be0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd2d4002f30 tx=0x7fd2d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.644+0000 7fd2ea3b4700 1 --2- 172.21.15.103:0/2750342038 >> v2:172.21.15.103:3300/0 conn(0x7fd2e405fed0 0x7fd2e4140be0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd2d4002f30 tx=0x7fd2d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.644+0000 7fd2ea3b4700 1 --2- 172.21.15.103:0/2750342038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2e405fed0 0x7fd2e4140be0 secure :-1 s=READY pgs=1651 cs=0 l=1 rx=0x7fd2d4002f30 tx=0x7fd2d4007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:17.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.644+0000 7fd2ea3b4700 1 --2- 172.21.15.103:0/2750342038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2e405fed0 0x7fd2e4140be0 secure :-1 s=THROTTLE_DONE pgs=1651 cs=0 l=1 rx=0x7fd2d4002f30 tx=0x7fd2d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.644+0000 7fd2d37fe700 1 -- 172.21.15.103:0/2750342038 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2d4007170 con 0x7fd2e405fed0 2020-04-22T14:16:17.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.644+0000 7fd2ea3b4700 1 --2- 172.21.15.103:0/2750342038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2e405fed0 0x7fd2e4140be0 secure :-1 s=THROTTLE_DONE pgs=1651 cs=0 l=1 rx=0x7fd2d4002f30 tx=0x7fd2d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.644+0000 7fd2eb3b6700 1 -- 172.21.15.103:0/2750342038 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e4141ce0 con 0x7fd2e405fed0 2020-04-22T14:16:17.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.644+0000 7fd2d37fe700 1 -- 172.21.15.103:0/2750342038 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d40072d0 con 0x7fd2e405fed0 2020-04-22T14:16:17.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.644+0000 7fd2ea3b4700 1 --2- 172.21.15.103:0/2750342038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2e405fed0 0x7fd2e4140be0 secure :-1 s=THROTTLE_DONE pgs=1651 cs=0 l=1 rx=0x7fd2d4002f30 tx=0x7fd2d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.644+0000 7fd2d37fe700 1 -- 172.21.15.103:0/2750342038 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2d40113a0 con 0x7fd2e405fed0 2020-04-22T14:16:17.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.644+0000 7fd2eb3b6700 1 -- 172.21.15.103:0/2750342038 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e414f530 con 0x7fd2e405fed0 2020-04-22T14:16:17.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.645+0000 7fd2ea3b4700 1 --2- 172.21.15.103:0/2750342038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2e405fed0 0x7fd2e4140be0 secure :-1 s=THROTTLE_DONE pgs=1651 cs=0 l=1 rx=0x7fd2d4002f30 tx=0x7fd2d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.645+0000 7fd2d37fe700 1 -- 172.21.15.103:0/2750342038 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fd2d4011620 con 0x7fd2e405fed0 2020-04-22T14:16:17.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.646+0000 7fd2ea3b4700 1 --2- 172.21.15.103:0/2750342038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2e405fed0 0x7fd2e4140be0 secure :-1 s=THROTTLE_DONE pgs=1651 cs=0 l=1 rx=0x7fd2d4002f30 tx=0x7fd2d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.646+0000 7fd2d37fe700 1 --2- 172.21.15.103:0/2750342038 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2c404d7f0 0x7fd2c404fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:17.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.646+0000 7fd2eb3b6700 1 -- 172.21.15.103:0/2750342038 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2e4056c90 con 0x7fd2e405fed0 2020-04-22T14:16:17.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.646+0000 7fd2d37fe700 1 -- 172.21.15.103:0/2750342038 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd2d40642a0 con 0x7fd2e405fed0 2020-04-22T14:16:17.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.646+0000 7fd2e9bb3700 1 --2- 172.21.15.103:0/2750342038 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2c404d7f0 0x7fd2c404fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:17.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.646+0000 7fd2e9bb3700 1 --2- 172.21.15.103:0/2750342038 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2c404d7f0 0x7fd2c404fcb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd2e0007fa0 tx=0x7fd2e0002990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.646+0000 7fd2e9bb3700 1 --2- 172.21.15.103:0/2750342038 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2c404d7f0 0x7fd2c404fcb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd2e0007fa0 tx=0x7fd2e0002990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.646+0000 7fd2e9bb3700 1 --2- 172.21.15.103:0/2750342038 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2c404d7f0 0x7fd2c404fcb0 secure :-1 s=READY pgs=600 cs=0 l=1 rx=0x7fd2e0007fa0 tx=0x7fd2e0002990).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:17.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.650+0000 7fd2ea3b4700 1 --2- 172.21.15.103:0/2750342038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2e405fed0 0x7fd2e4140be0 secure :-1 s=THROTTLE_DONE pgs=1651 cs=0 l=1 rx=0x7fd2d4002f30 tx=0x7fd2d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.650+0000 7fd2d37fe700 1 -- 172.21.15.103:0/2750342038 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fd2d403f740 con 0x7fd2e405fed0 2020-04-22T14:16:17.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.793+0000 7fd2eb3b6700 1 -- 172.21.15.103:0/2750342038 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd2e406a8b0 con 0x7fd2e405fed0 2020-04-22T14:16:17.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.793+0000 7fd2ea3b4700 1 --2- 172.21.15.103:0/2750342038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2e405fed0 0x7fd2e4140be0 secure :-1 s=THROTTLE_DONE pgs=1651 cs=0 l=1 rx=0x7fd2d4002f30 tx=0x7fd2d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.793+0000 7fd2d37fe700 1 -- 172.21.15.103:0/2750342038 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v113) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd2d4042d60 con 0x7fd2e405fed0 2020-04-22T14:16:17.801 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:16:17.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.794+0000 7fd2eb3b6700 1 -- 172.21.15.103:0/2750342038 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2c404d7f0 msgr2=0x7fd2c404fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:17.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.794+0000 7fd2eb3b6700 1 --2- 172.21.15.103:0/2750342038 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2c404d7f0 0x7fd2c404fcb0 secure :-1 s=READY pgs=600 cs=0 l=1 rx=0x7fd2e0007fa0 tx=0x7fd2e0002990).stop 2020-04-22T14:16:17.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.794+0000 7fd2eb3b6700 1 -- 172.21.15.103:0/2750342038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2e405fed0 msgr2=0x7fd2e4140be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:17.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.794+0000 7fd2eb3b6700 1 --2- 172.21.15.103:0/2750342038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2e405fed0 0x7fd2e4140be0 secure :-1 s=READY pgs=1651 cs=0 l=1 rx=0x7fd2d4002f30 tx=0x7fd2d4007a40).stop 2020-04-22T14:16:17.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.795+0000 7fd2eb3b6700 1 -- 172.21.15.103:0/2750342038 shutdown_connections 2020-04-22T14:16:17.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.795+0000 7fd2eb3b6700 1 --2- 172.21.15.103:0/2750342038 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2c404d7f0 0x7fd2c404fcb0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:17.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.795+0000 7fd2eb3b6700 1 --2- 172.21.15.103:0/2750342038 >> v2:172.21.15.86:3300/0 conn(0x7fd2e40b91e0 0x7fd2e413ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:17.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.795+0000 7fd2eb3b6700 1 --2- 172.21.15.103:0/2750342038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2e405fed0 0x7fd2e4140be0 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:17.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.795+0000 7fd2eb3b6700 1 -- 172.21.15.103:0/2750342038 >> 172.21.15.103:0/2750342038 conn(0x7fd2e405b780 msgr2=0x7fd2e40b4890 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:17.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.795+0000 7fd2eb3b6700 1 -- 172.21.15.103:0/2750342038 shutdown_connections 2020-04-22T14:16:17.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.795+0000 7fd2eb3b6700 1 -- 172.21.15.103:0/2750342038 wait complete. 2020-04-22T14:16:17.807 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:17.820 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:16:17.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.967+0000 7fac35f58700 1 Processor -- start 2020-04-22T14:16:17.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.967+0000 7fac35f58700 1 -- start start 2020-04-22T14:16:17.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.968+0000 7fac35f58700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac300ac950 0x7fac30146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:17.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.968+0000 7fac35f58700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac301467e0 con 0x7fac300b9140 2020-04-22T14:16:17.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.968+0000 7fac35f58700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac30060050 con 0x7fac301470a0 2020-04-22T14:16:17.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.968+0000 7fac35f58700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac300602f0 con 0x7fac300ac950 2020-04-22T14:16:17.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.968+0000 7fac2ffff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fac301470a0 0x7fac30143090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48328/0 (socket says 172.21.15.103:48328) 2020-04-22T14:16:17.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.968+0000 7fac2ffff700 1 -- 172.21.15.103:0/4155455570 learned_addr learned my addr 172.21.15.103:0/4155455570 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:17.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.968+0000 7fac2effd700 1 --2- 172.21.15.103:0/4155455570 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac300ac950 0x7fac30146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:17.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.968+0000 7fac2e7fc700 1 -- 172.21.15.103:0/4155455570 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1798746913 0 0) 0x7fac30060050 con 0x7fac301470a0 2020-04-22T14:16:17.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.968+0000 7fac2e7fc700 1 -- 172.21.15.103:0/4155455570 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac1c003230 con 0x7fac301470a0 2020-04-22T14:16:17.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.968+0000 7fac2e7fc700 1 -- 172.21.15.103:0/4155455570 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3844164146 0 0) 0x7fac301467e0 con 0x7fac300b9140 2020-04-22T14:16:17.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.968+0000 7fac2e7fc700 1 -- 172.21.15.103:0/4155455570 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac30060050 con 0x7fac300b9140 2020-04-22T14:16:17.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.968+0000 7fac2effd700 1 -- 172.21.15.103:0/4155455570 >> v1:172.21.15.103:6789/0 conn(0x7fac301470a0 legacy=0x7fac30143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:17.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.968+0000 7fac2effd700 1 -- 172.21.15.103:0/4155455570 >> v1:172.21.15.86:6789/0 conn(0x7fac300b9140 legacy=0x7fac3012b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:17.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.968+0000 7fac2effd700 1 -- 172.21.15.103:0/4155455570 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac300b9520 con 0x7fac300ac950 2020-04-22T14:16:17.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.969+0000 7fac2effd700 1 --2- 172.21.15.103:0/4155455570 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac300ac950 0x7fac30146c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fac24002f30 tx=0x7fac240088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.969+0000 7fac2effd700 1 --2- 172.21.15.103:0/4155455570 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac300ac950 0x7fac30146c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fac24002f30 tx=0x7fac240088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.969+0000 7fac2effd700 1 --2- 172.21.15.103:0/4155455570 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac300ac950 0x7fac30146c40 secure :-1 s=READY pgs=156 cs=0 l=1 rx=0x7fac24002f30 tx=0x7fac240088e0).ready entity=mon.2 client_cookie=ada343083c81379c server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:17.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.969+0000 7fac2effd700 1 --2- 172.21.15.103:0/4155455570 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac300ac950 0x7fac30146c40 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7fac24002f30 tx=0x7fac240088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.969+0000 7fac2e7fc700 1 -- 172.21.15.103:0/4155455570 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac24008e40 con 0x7fac300ac950 2020-04-22T14:16:17.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.969+0000 7fac2effd700 1 --2- 172.21.15.103:0/4155455570 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac300ac950 0x7fac30146c40 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7fac24002f30 tx=0x7fac240088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.969+0000 7fac2e7fc700 1 -- 172.21.15.103:0/4155455570 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac24011540 con 0x7fac300ac950 2020-04-22T14:16:17.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.969+0000 7fac2effd700 1 --2- 172.21.15.103:0/4155455570 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac300ac950 0x7fac30146c40 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7fac24002f30 tx=0x7fac240088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.969+0000 7fac2e7fc700 1 -- 172.21.15.103:0/4155455570 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac240118e0 con 0x7fac300ac950 2020-04-22T14:16:17.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.969+0000 7fac35f58700 1 -- 172.21.15.103:0/4155455570 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac300ac950 msgr2=0x7fac30146c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:17.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.969+0000 7fac35f58700 1 --2- 172.21.15.103:0/4155455570 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac300ac950 0x7fac30146c40 secure :-1 s=READY pgs=156 cs=0 l=1 rx=0x7fac24002f30 tx=0x7fac240088e0).stop 2020-04-22T14:16:17.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.969+0000 7fac35f58700 1 -- 172.21.15.103:0/4155455570 shutdown_connections 2020-04-22T14:16:17.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.969+0000 7fac35f58700 1 --2- 172.21.15.103:0/4155455570 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac300ac950 0x7fac30146c40 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:17.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.969+0000 7fac35f58700 1 -- 172.21.15.103:0/4155455570 >> 172.21.15.103:0/4155455570 conn(0x7fac3005b7b0 msgr2=0x7fac300b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:17.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.969+0000 7fac35f58700 1 -- 172.21.15.103:0/4155455570 shutdown_connections 2020-04-22T14:16:17.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.969+0000 7fac35f58700 1 -- 172.21.15.103:0/4155455570 wait complete. 2020-04-22T14:16:17.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.970+0000 7fac35f58700 1 Processor -- start 2020-04-22T14:16:17.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.970+0000 7fac35f58700 1 -- start start 2020-04-22T14:16:17.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.971+0000 7fac35f58700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fac301470a0 0x7fac30141bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:17.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.971+0000 7fac35f58700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac30063460 con 0x7fac300b9140 2020-04-22T14:16:17.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.971+0000 7fac35f58700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac30061a70 con 0x7fac300ac950 2020-04-22T14:16:17.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.971+0000 7fac35f58700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac30061d10 con 0x7fac301470a0 2020-04-22T14:16:17.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.971+0000 7fac2f7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fac300ac950 0x7fac30065f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48332/0 (socket says 172.21.15.103:48332) 2020-04-22T14:16:17.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.971+0000 7fac2f7fe700 1 -- 172.21.15.103:0/3848619003 learned_addr learned my addr 172.21.15.103:0/3848619003 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:17.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.971+0000 7fac2ffff700 1 --2- 172.21.15.103:0/3848619003 >> v2:172.21.15.86:3300/0 conn(0x7fac301470a0 0x7fac30141bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:17.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.971+0000 7fac2cff9700 1 -- 172.21.15.103:0/3848619003 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4161004267 0 0) 0x7fac30061a70 con 0x7fac300ac950 2020-04-22T14:16:17.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.971+0000 7fac2cff9700 1 -- 172.21.15.103:0/3848619003 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac10002fe0 con 0x7fac300ac950 2020-04-22T14:16:17.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.972+0000 7fac2cff9700 1 -- 172.21.15.103:0/3848619003 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 548476749 0 0) 0x7fac10002fe0 con 0x7fac300ac950 2020-04-22T14:16:17.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.972+0000 7fac2cff9700 1 -- 172.21.15.103:0/3848619003 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fac30061a70 con 0x7fac300ac950 2020-04-22T14:16:17.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.972+0000 7fac2cff9700 1 -- 172.21.15.103:0/3848619003 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fac20001d00 con 0x7fac300ac950 2020-04-22T14:16:17.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.972+0000 7fac2cff9700 1 -- 172.21.15.103:0/3848619003 >> v2:172.21.15.86:3300/0 conn(0x7fac301470a0 msgr2=0x7fac30141bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:17.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.972+0000 7fac2cff9700 1 --2- 172.21.15.103:0/3848619003 >> v2:172.21.15.86:3300/0 conn(0x7fac301470a0 0x7fac30141bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:17.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.972+0000 7fac2cff9700 1 -- 172.21.15.103:0/3848619003 >> v1:172.21.15.103:6789/0 conn(0x7fac300ac950 legacy=0x7fac30065f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:17.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.972+0000 7fac2cff9700 1 -- 172.21.15.103:0/3848619003 >> v1:172.21.15.86:6789/0 conn(0x7fac300b9140 legacy=0x7fac300b5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:17.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.972+0000 7fac2cff9700 1 --2- 172.21.15.103:0/3848619003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac100049b0 0x7fac10004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:17.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.972+0000 7fac2cff9700 1 --2- 172.21.15.103:0/3848619003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac10003920 0x7fac10003da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:17.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.972+0000 7fac2cff9700 1 --2- 172.21.15.103:0/3848619003 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac10004200 0x7fac1000b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:17.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.972+0000 7fac2cff9700 1 -- 172.21.15.103:0/3848619003 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac30061d10 con 0x7fac100049b0 2020-04-22T14:16:17.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.972+0000 7fac2cff9700 1 -- 172.21.15.103:0/3848619003 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac10004680 con 0x7fac10003920 2020-04-22T14:16:17.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.972+0000 7fac2cff9700 1 -- 172.21.15.103:0/3848619003 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac1000bbb0 con 0x7fac10004200 2020-04-22T14:16:17.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.972+0000 7fac2ffff700 1 --2- 172.21.15.103:0/3848619003 >> v2:172.21.15.86:3300/0 conn(0x7fac301470a0 0x7fac30141bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:16:17.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.972+0000 7fac2effd700 1 --2- 172.21.15.103:0/3848619003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac10003920 0x7fac10003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:17.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.972+0000 7fac2f7fe700 1 --2- 172.21.15.103:0/3848619003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac100049b0 0x7fac10004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:17.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.972+0000 7fac2ffff700 1 --2- 172.21.15.103:0/3848619003 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac10004200 0x7fac1000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:17.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.972+0000 7fac2effd700 1 -- 172.21.15.103:0/3848619003 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac10004200 msgr2=0x7fac1000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:17.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.972+0000 7fac2effd700 1 --2- 172.21.15.103:0/3848619003 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac10004200 0x7fac1000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:17.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.972+0000 7fac2effd700 1 -- 172.21.15.103:0/3848619003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac100049b0 msgr2=0x7fac10004d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:17.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.972+0000 7fac2effd700 1 --2- 172.21.15.103:0/3848619003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac100049b0 0x7fac10004d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:17.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.972+0000 7fac2effd700 1 -- 172.21.15.103:0/3848619003 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac30061fb0 con 0x7fac10003920 2020-04-22T14:16:17.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.972+0000 7fac2ffff700 1 -- 172.21.15.103:0/3848619003 reap_dead start 2020-04-22T14:16:17.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.972+0000 7fac35f58700 1 -- 172.21.15.103:0/3848619003 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac301519d0 con 0x7fac10003920 2020-04-22T14:16:17.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.972+0000 7fac2effd700 1 --2- 172.21.15.103:0/3848619003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac10003920 0x7fac10003da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fac24007ed0 tx=0x7fac300b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.972+0000 7fac35f58700 1 -- 172.21.15.103:0/3848619003 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac30141bb0 con 0x7fac10003920 2020-04-22T14:16:17.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.972+0000 7fac2effd700 1 --2- 172.21.15.103:0/3848619003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac10003920 0x7fac10003da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fac24007ed0 tx=0x7fac300b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.972+0000 7fac2effd700 1 --2- 172.21.15.103:0/3848619003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac10003920 0x7fac10003da0 secure :-1 s=READY pgs=1654 cs=0 l=1 rx=0x7fac24007ed0 tx=0x7fac300b96b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:17.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.972+0000 7fac2effd700 1 --2- 172.21.15.103:0/3848619003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac10003920 0x7fac10003da0 secure :-1 s=THROTTLE_DONE pgs=1654 cs=0 l=1 rx=0x7fac24007ed0 tx=0x7fac300b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.972+0000 7fac2cff9700 1 -- 172.21.15.103:0/3848619003 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac24007880 con 0x7fac10003920 2020-04-22T14:16:17.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.973+0000 7fac2effd700 1 --2- 172.21.15.103:0/3848619003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac10003920 0x7fac10003da0 secure :-1 s=THROTTLE_DONE pgs=1654 cs=0 l=1 rx=0x7fac24007ed0 tx=0x7fac300b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.973+0000 7fac2cff9700 1 -- 172.21.15.103:0/3848619003 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac24007170 con 0x7fac10003920 2020-04-22T14:16:17.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.973+0000 7fac2effd700 1 --2- 172.21.15.103:0/3848619003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac10003920 0x7fac10003da0 secure :-1 s=THROTTLE_DONE pgs=1654 cs=0 l=1 rx=0x7fac24007ed0 tx=0x7fac300b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.973+0000 7fac2cff9700 1 -- 172.21.15.103:0/3848619003 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac24007550 con 0x7fac10003920 2020-04-22T14:16:17.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.973+0000 7fac2effd700 1 --2- 172.21.15.103:0/3848619003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac10003920 0x7fac10003da0 secure :-1 s=THROTTLE_DONE pgs=1654 cs=0 l=1 rx=0x7fac24007ed0 tx=0x7fac300b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.973+0000 7fac35f58700 1 -- 172.21.15.103:0/3848619003 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac0c003340 con 0x7fac10003920 2020-04-22T14:16:17.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.974+0000 7fac2cff9700 1 -- 172.21.15.103:0/3848619003 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fac240056c0 con 0x7fac10003920 2020-04-22T14:16:17.989 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.974+0000 7fac2effd700 1 --2- 172.21.15.103:0/3848619003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac10003920 0x7fac10003da0 secure :-1 s=THROTTLE_DONE pgs=1654 cs=0 l=1 rx=0x7fac24007ed0 tx=0x7fac300b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.974+0000 7fac2cff9700 1 --2- 172.21.15.103:0/3848619003 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fac10051820 0x7fac10053ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:17.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.974+0000 7fac2cff9700 1 -- 172.21.15.103:0/3848619003 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fac24061be0 con 0x7fac10003920 2020-04-22T14:16:17.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.974+0000 7fac2f7fe700 1 --2- 172.21.15.103:0/3848619003 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fac10051820 0x7fac10053ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:17.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.974+0000 7fac2f7fe700 1 --2- 172.21.15.103:0/3848619003 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fac10051820 0x7fac10053ce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fac20001a10 tx=0x7fac20008ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.974+0000 7fac2f7fe700 1 --2- 172.21.15.103:0/3848619003 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fac10051820 0x7fac10053ce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fac20001a10 tx=0x7fac20008ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.974+0000 7fac2f7fe700 1 --2- 172.21.15.103:0/3848619003 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fac10051820 0x7fac10053ce0 secure :-1 s=READY pgs=601 cs=0 l=1 rx=0x7fac20001a10 tx=0x7fac20008ec0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:17.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.978+0000 7fac2effd700 1 --2- 172.21.15.103:0/3848619003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac10003920 0x7fac10003da0 secure :-1 s=THROTTLE_DONE pgs=1654 cs=0 l=1 rx=0x7fac24007ed0 tx=0x7fac300b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:17.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:17.978+0000 7fac2cff9700 1 -- 172.21.15.103:0/3848619003 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fac2403d020 con 0x7fac10003920 2020-04-22T14:16:18.120 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.118+0000 7fac35f58700 1 -- 172.21.15.103:0/3848619003 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fac0c002200 con 0x7fac10003920 2020-04-22T14:16:18.120 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.118+0000 7fac2effd700 1 --2- 172.21.15.103:0/3848619003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac10003920 0x7fac10003da0 secure :-1 s=THROTTLE_DONE pgs=1654 cs=0 l=1 rx=0x7fac24007ed0 tx=0x7fac300b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.120 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.118+0000 7fac2cff9700 1 -- 172.21.15.103:0/3848619003 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v113) v1 ==== 92+0+10 (secure 0 0 0) 0x7fac24040640 con 0x7fac10003920 2020-04-22T14:16:18.121 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:16:18.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.119+0000 7fac35f58700 1 -- 172.21.15.103:0/3848619003 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fac10051820 msgr2=0x7fac10053ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:18.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.119+0000 7fac35f58700 1 --2- 172.21.15.103:0/3848619003 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fac10051820 0x7fac10053ce0 secure :-1 s=READY pgs=601 cs=0 l=1 rx=0x7fac20001a10 tx=0x7fac20008ec0).stop 2020-04-22T14:16:18.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.119+0000 7fac35f58700 1 -- 172.21.15.103:0/3848619003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac10003920 msgr2=0x7fac10003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:18.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.119+0000 7fac35f58700 1 --2- 172.21.15.103:0/3848619003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac10003920 0x7fac10003da0 secure :-1 s=READY pgs=1654 cs=0 l=1 rx=0x7fac24007ed0 tx=0x7fac300b96b0).stop 2020-04-22T14:16:18.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.119+0000 7fac35f58700 1 -- 172.21.15.103:0/3848619003 shutdown_connections 2020-04-22T14:16:18.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.119+0000 7fac35f58700 1 --2- 172.21.15.103:0/3848619003 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fac10051820 0x7fac10053ce0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:18.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.119+0000 7fac35f58700 1 --2- 172.21.15.103:0/3848619003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac10003920 0x7fac10003da0 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:18.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.119+0000 7fac35f58700 1 -- 172.21.15.103:0/3848619003 >> 172.21.15.103:0/3848619003 conn(0x7fac3005b7b0 msgr2=0x7fac300b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:18.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.119+0000 7fac35f58700 1 -- 172.21.15.103:0/3848619003 shutdown_connections 2020-04-22T14:16:18.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.119+0000 7fac35f58700 1 -- 172.21.15.103:0/3848619003 wait complete. 2020-04-22T14:16:18.131 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:18.145 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-22T14:16:18.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.291+0000 7fb9e9a2a700 1 Processor -- start 2020-04-22T14:16:18.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.291+0000 7fb9e9a2a700 1 -- start start 2020-04-22T14:16:18.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.292+0000 7fb9e9a2a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9e40ac950 0x7fb9e4146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:18.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.292+0000 7fb9e9a2a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e41467e0 con 0x7fb9e40b9140 2020-04-22T14:16:18.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.292+0000 7fb9e9a2a700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e4060050 con 0x7fb9e41470a0 2020-04-22T14:16:18.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.292+0000 7fb9e9a2a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e40602f0 con 0x7fb9e40ac950 2020-04-22T14:16:18.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.292+0000 7fb9e37fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb9e41470a0 0x7fb9e4143090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48346/0 (socket says 172.21.15.103:48346) 2020-04-22T14:16:18.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.292+0000 7fb9e37fe700 1 -- 172.21.15.103:0/659896520 learned_addr learned my addr 172.21.15.103:0/659896520 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:18.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.292+0000 7fb9e27fc700 1 --2- 172.21.15.103:0/659896520 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9e40ac950 0x7fb9e4146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:18.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.292+0000 7fb9e1ffb700 1 -- 172.21.15.103:0/659896520 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 316731766 0 0) 0x7fb9e4060050 con 0x7fb9e41470a0 2020-04-22T14:16:18.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.292+0000 7fb9e1ffb700 1 -- 172.21.15.103:0/659896520 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9c8003230 con 0x7fb9e41470a0 2020-04-22T14:16:18.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.293+0000 7fb9e1ffb700 1 -- 172.21.15.103:0/659896520 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1146384601 0 0) 0x7fb9c8003230 con 0x7fb9e41470a0 2020-04-22T14:16:18.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.293+0000 7fb9e1ffb700 1 -- 172.21.15.103:0/659896520 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9e40ac950 msgr2=0x7fb9e4146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:18.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.293+0000 7fb9e1ffb700 1 --2- 172.21.15.103:0/659896520 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9e40ac950 0x7fb9e4146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:18.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.293+0000 7fb9e1ffb700 1 -- 172.21.15.103:0/659896520 >> v1:172.21.15.86:6789/0 conn(0x7fb9e40b9140 legacy=0x7fb9e412b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:18.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.293+0000 7fb9e1ffb700 1 -- 172.21.15.103:0/659896520 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e40b9520 con 0x7fb9e41470a0 2020-04-22T14:16:18.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.293+0000 7fb9e1ffb700 1 -- 172.21.15.103:0/659896520 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fb9dc001a50 con 0x7fb9e41470a0 2020-04-22T14:16:18.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.293+0000 7fb9e1ffb700 1 -- 172.21.15.103:0/659896520 >> v1:172.21.15.103:6789/0 conn(0x7fb9e41470a0 legacy=0x7fb9e4143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:18.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.293+0000 7fb9e1ffb700 1 --2- 172.21.15.103:0/659896520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9c8003720 0x7fb9c8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:18.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.293+0000 7fb9e1ffb700 1 --2- 172.21.15.103:0/659896520 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9e40ac950 0x7fb9c80044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:18.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.293+0000 7fb9e1ffb700 1 --2- 172.21.15.103:0/659896520 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9c8004930 0x7fb9c8004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:18.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.293+0000 7fb9e1ffb700 1 -- 172.21.15.103:0/659896520 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e40602f0 con 0x7fb9c8004930 2020-04-22T14:16:18.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.293+0000 7fb9e1ffb700 1 -- 172.21.15.103:0/659896520 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c8005300 con 0x7fb9c8003720 2020-04-22T14:16:18.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.293+0000 7fb9e1ffb700 1 -- 172.21.15.103:0/659896520 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c80040f0 con 0x7fb9e40ac950 2020-04-22T14:16:18.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.293+0000 7fb9e2ffd700 1 --2- 172.21.15.103:0/659896520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9c8003720 0x7fb9c8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:18.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.293+0000 7fb9e27fc700 1 --2- 172.21.15.103:0/659896520 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9e40ac950 0x7fb9c80044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:18.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.293+0000 7fb9e37fe700 1 --2- 172.21.15.103:0/659896520 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9c8004930 0x7fb9c8004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:18.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.293+0000 7fb9e2ffd700 1 -- 172.21.15.103:0/659896520 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9e40ac950 msgr2=0x7fb9c80044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:18.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.293+0000 7fb9e2ffd700 1 --2- 172.21.15.103:0/659896520 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9e40ac950 0x7fb9c80044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:18.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.293+0000 7fb9e2ffd700 1 -- 172.21.15.103:0/659896520 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9c8004930 msgr2=0x7fb9c8004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:18.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.293+0000 7fb9e2ffd700 1 --2- 172.21.15.103:0/659896520 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9c8004930 0x7fb9c8004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:18.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.293+0000 7fb9e2ffd700 1 -- 172.21.15.103:0/659896520 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c8003230 con 0x7fb9c8003720 2020-04-22T14:16:18.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.293+0000 7fb9e2ffd700 1 --2- 172.21.15.103:0/659896520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9c8003720 0x7fb9c8003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb9e4060f70 tx=0x7fb9d800fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.293+0000 7fb9e2ffd700 1 --2- 172.21.15.103:0/659896520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9c8003720 0x7fb9c8003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb9e4060f70 tx=0x7fb9d800fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.293+0000 7fb9e2ffd700 1 --2- 172.21.15.103:0/659896520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9c8003720 0x7fb9c8003b40 secure :-1 s=READY pgs=1656 cs=0 l=1 rx=0x7fb9e4060f70 tx=0x7fb9d800fcf0).ready entity=mon.1 client_cookie=72f89275eece7649 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:18.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.293+0000 7fb9e2ffd700 1 --2- 172.21.15.103:0/659896520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9c8003720 0x7fb9c8003b40 secure :-1 s=THROTTLE_DONE pgs=1656 cs=0 l=1 rx=0x7fb9e4060f70 tx=0x7fb9d800fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.293+0000 7fb9e2ffd700 1 --2- 172.21.15.103:0/659896520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9c8003720 0x7fb9c8003b40 secure :-1 s=THROTTLE_DONE pgs=1656 cs=0 l=1 rx=0x7fb9e4060f70 tx=0x7fb9d800fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.293+0000 7fb9e1ffb700 1 -- 172.21.15.103:0/659896520 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9d8003560 con 0x7fb9c8003720 2020-04-22T14:16:18.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.293+0000 7fb9e2ffd700 1 --2- 172.21.15.103:0/659896520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9c8003720 0x7fb9c8003b40 secure :-1 s=THROTTLE_DONE pgs=1656 cs=0 l=1 rx=0x7fb9e4060f70 tx=0x7fb9d800fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.293+0000 7fb9e1ffb700 1 -- 172.21.15.103:0/659896520 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d8003700 con 0x7fb9c8003720 2020-04-22T14:16:18.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.293+0000 7fb9e1ffb700 1 -- 172.21.15.103:0/659896520 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9d8003b20 con 0x7fb9c8003720 2020-04-22T14:16:18.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.293+0000 7fb9e9a2a700 1 -- 172.21.15.103:0/659896520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9c8003720 msgr2=0x7fb9c8003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:18.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.293+0000 7fb9e9a2a700 1 --2- 172.21.15.103:0/659896520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9c8003720 0x7fb9c8003b40 secure :-1 s=READY pgs=1656 cs=0 l=1 rx=0x7fb9e4060f70 tx=0x7fb9d800fcf0).stop 2020-04-22T14:16:18.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.293+0000 7fb9e37fe700 1 -- 172.21.15.103:0/659896520 reap_dead start 2020-04-22T14:16:18.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.294+0000 7fb9e9a2a700 1 -- 172.21.15.103:0/659896520 shutdown_connections 2020-04-22T14:16:18.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.294+0000 7fb9e9a2a700 1 -- 172.21.15.103:0/659896520 >> 172.21.15.103:0/659896520 conn(0x7fb9e405b7b0 msgr2=0x7fb9e40b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:18.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.294+0000 7fb9e9a2a700 1 -- 172.21.15.103:0/659896520 shutdown_connections 2020-04-22T14:16:18.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.294+0000 7fb9e9a2a700 1 -- 172.21.15.103:0/659896520 wait complete. 2020-04-22T14:16:18.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.295+0000 7fb9e9a2a700 1 Processor -- start 2020-04-22T14:16:18.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.295+0000 7fb9e9a2a700 1 -- start start 2020-04-22T14:16:18.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.296+0000 7fb9e9a2a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb9e40b21e0 0x7fb9e41281e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:18.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.296+0000 7fb9e9a2a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e4141470 con 0x7fb9e4065d30 2020-04-22T14:16:18.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.296+0000 7fb9e9a2a700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e41416a0 con 0x7fb9e41421f0 2020-04-22T14:16:18.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.296+0000 7fb9e9a2a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e4141940 con 0x7fb9e40b21e0 2020-04-22T14:16:18.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.296+0000 7fb9e2ffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb9e41421f0 0x7fb9e4140b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48358/0 (socket says 172.21.15.103:48358) 2020-04-22T14:16:18.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.296+0000 7fb9e2ffd700 1 -- 172.21.15.103:0/2215143732 learned_addr learned my addr 172.21.15.103:0/2215143732 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:18.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.296+0000 7fb9e37fe700 1 --2- 172.21.15.103:0/2215143732 >> v2:172.21.15.103:3300/0 conn(0x7fb9e40b21e0 0x7fb9e41281e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:18.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.296+0000 7fb9e37fe700 1 -- 172.21.15.103:0/2215143732 >> v1:172.21.15.103:6789/0 conn(0x7fb9e41421f0 legacy=0x7fb9e4140b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:18.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.296+0000 7fb9d3fff700 1 -- 172.21.15.103:0/2215143732 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 681796533 0 0) 0x7fb9e41416a0 con 0x7fb9e41421f0 2020-04-22T14:16:18.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.296+0000 7fb9e37fe700 1 -- 172.21.15.103:0/2215143732 >> v1:172.21.15.86:6789/0 conn(0x7fb9e4065d30 legacy=0x7fb9e40b0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:18.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.296+0000 7fb9e37fe700 1 -- 172.21.15.103:0/2215143732 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e41425d0 con 0x7fb9e40b21e0 2020-04-22T14:16:18.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.296+0000 7fb9e37fe700 1 --2- 172.21.15.103:0/2215143732 >> v2:172.21.15.103:3300/0 conn(0x7fb9e40b21e0 0x7fb9e41281e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb9dc001450 tx=0x7fb9e40b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.296+0000 7fb9e37fe700 1 --2- 172.21.15.103:0/2215143732 >> v2:172.21.15.103:3300/0 conn(0x7fb9e40b21e0 0x7fb9e41281e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb9dc001450 tx=0x7fb9e40b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.296+0000 7fb9e37fe700 1 --2- 172.21.15.103:0/2215143732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9e40b21e0 0x7fb9e41281e0 secure :-1 s=READY pgs=1658 cs=0 l=1 rx=0x7fb9dc001450 tx=0x7fb9e40b96b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:18.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.296+0000 7fb9e37fe700 1 --2- 172.21.15.103:0/2215143732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9e40b21e0 0x7fb9e41281e0 secure :-1 s=THROTTLE_DONE pgs=1658 cs=0 l=1 rx=0x7fb9dc001450 tx=0x7fb9e40b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.296+0000 7fb9d3fff700 1 -- 172.21.15.103:0/2215143732 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9dc011870 con 0x7fb9e40b21e0 2020-04-22T14:16:18.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.296+0000 7fb9e37fe700 1 --2- 172.21.15.103:0/2215143732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9e40b21e0 0x7fb9e41281e0 secure :-1 s=THROTTLE_DONE pgs=1658 cs=0 l=1 rx=0x7fb9dc001450 tx=0x7fb9e40b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.296+0000 7fb9e37fe700 1 --2- 172.21.15.103:0/2215143732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9e40b21e0 0x7fb9e41281e0 secure :-1 s=THROTTLE_DONE pgs=1658 cs=0 l=1 rx=0x7fb9dc001450 tx=0x7fb9e40b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.296+0000 7fb9d3fff700 1 -- 172.21.15.103:0/2215143732 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9dc0119d0 con 0x7fb9e40b21e0 2020-04-22T14:16:18.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.296+0000 7fb9e9a2a700 1 -- 172.21.15.103:0/2215143732 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e40b0f10 con 0x7fb9e40b21e0 2020-04-22T14:16:18.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.296+0000 7fb9d3fff700 1 -- 172.21.15.103:0/2215143732 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9dc011d30 con 0x7fb9e40b21e0 2020-04-22T14:16:18.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.296+0000 7fb9e9a2a700 1 -- 172.21.15.103:0/2215143732 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e4061de0 con 0x7fb9e40b21e0 2020-04-22T14:16:18.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.297+0000 7fb9e37fe700 1 --2- 172.21.15.103:0/2215143732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9e40b21e0 0x7fb9e41281e0 secure :-1 s=THROTTLE_DONE pgs=1658 cs=0 l=1 rx=0x7fb9dc001450 tx=0x7fb9e40b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.297+0000 7fb9e9a2a700 1 -- 172.21.15.103:0/2215143732 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e4141b40 con 0x7fb9e40b21e0 2020-04-22T14:16:18.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.297+0000 7fb9d3fff700 1 -- 172.21.15.103:0/2215143732 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fb9dc004930 con 0x7fb9e40b21e0 2020-04-22T14:16:18.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.297+0000 7fb9e37fe700 1 --2- 172.21.15.103:0/2215143732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9e40b21e0 0x7fb9e41281e0 secure :-1 s=THROTTLE_DONE pgs=1658 cs=0 l=1 rx=0x7fb9dc001450 tx=0x7fb9e40b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.298+0000 7fb9d3fff700 1 --2- 172.21.15.103:0/2215143732 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb9c004d990 0x7fb9c004fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:18.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.298+0000 7fb9d3fff700 1 -- 172.21.15.103:0/2215143732 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb9dc060e20 con 0x7fb9e40b21e0 2020-04-22T14:16:18.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.298+0000 7fb9e2ffd700 1 --2- 172.21.15.103:0/2215143732 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb9c004d990 0x7fb9c004fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:18.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.298+0000 7fb9e2ffd700 1 --2- 172.21.15.103:0/2215143732 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb9c004d990 0x7fb9c004fe50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb9d800f630 tx=0x7fb9d800fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.298+0000 7fb9e2ffd700 1 --2- 172.21.15.103:0/2215143732 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb9c004d990 0x7fb9c004fe50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb9d800f630 tx=0x7fb9d800fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.298+0000 7fb9e2ffd700 1 --2- 172.21.15.103:0/2215143732 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb9c004d990 0x7fb9c004fe50 secure :-1 s=READY pgs=602 cs=0 l=1 rx=0x7fb9d800f630 tx=0x7fb9d800fcf0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:18.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.302+0000 7fb9e37fe700 1 --2- 172.21.15.103:0/2215143732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9e40b21e0 0x7fb9e41281e0 secure :-1 s=THROTTLE_DONE pgs=1658 cs=0 l=1 rx=0x7fb9dc001450 tx=0x7fb9e40b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.302+0000 7fb9d3fff700 1 -- 172.21.15.103:0/2215143732 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fb9dc03c260 con 0x7fb9e40b21e0 2020-04-22T14:16:18.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.442+0000 7fb9e9a2a700 1 -- 172.21.15.103:0/2215143732 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb9e4056c90 con 0x7fb9e40b21e0 2020-04-22T14:16:18.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.443+0000 7fb9e37fe700 1 --2- 172.21.15.103:0/2215143732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9e40b21e0 0x7fb9e41281e0 secure :-1 s=THROTTLE_DONE pgs=1658 cs=0 l=1 rx=0x7fb9dc001450 tx=0x7fb9e40b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.443+0000 7fb9d3fff700 1 -- 172.21.15.103:0/2215143732 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v113) v1 ==== 104+0+10 (secure 0 0 0) 0x7fb9dc03f880 con 0x7fb9e40b21e0 2020-04-22T14:16:18.446 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:16:18.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.444+0000 7fb9e9a2a700 1 -- 172.21.15.103:0/2215143732 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb9c004d990 msgr2=0x7fb9c004fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:18.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.444+0000 7fb9e9a2a700 1 --2- 172.21.15.103:0/2215143732 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb9c004d990 0x7fb9c004fe50 secure :-1 s=READY pgs=602 cs=0 l=1 rx=0x7fb9d800f630 tx=0x7fb9d800fcf0).stop 2020-04-22T14:16:18.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.444+0000 7fb9e9a2a700 1 -- 172.21.15.103:0/2215143732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9e40b21e0 msgr2=0x7fb9e41281e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:18.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.444+0000 7fb9e9a2a700 1 --2- 172.21.15.103:0/2215143732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9e40b21e0 0x7fb9e41281e0 secure :-1 s=READY pgs=1658 cs=0 l=1 rx=0x7fb9dc001450 tx=0x7fb9e40b96b0).stop 2020-04-22T14:16:18.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.444+0000 7fb9e9a2a700 1 -- 172.21.15.103:0/2215143732 shutdown_connections 2020-04-22T14:16:18.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.444+0000 7fb9e9a2a700 1 --2- 172.21.15.103:0/2215143732 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb9c004d990 0x7fb9c004fe50 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:18.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.444+0000 7fb9e9a2a700 1 --2- 172.21.15.103:0/2215143732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9e40b21e0 0x7fb9e41281e0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:18.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.444+0000 7fb9e9a2a700 1 -- 172.21.15.103:0/2215143732 >> 172.21.15.103:0/2215143732 conn(0x7fb9e405b7b0 msgr2=0x7fb9e40b7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:18.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.444+0000 7fb9e9a2a700 1 -- 172.21.15.103:0/2215143732 shutdown_connections 2020-04-22T14:16:18.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.444+0000 7fb9e9a2a700 1 -- 172.21.15.103:0/2215143732 wait complete. 2020-04-22T14:16:18.456 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:18.470 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-22T14:16:18.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.618+0000 7ff9080b9700 1 Processor -- start 2020-04-22T14:16:18.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.618+0000 7ff9080b9700 1 -- start start 2020-04-22T14:16:18.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.619+0000 7ff9080b9700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff900061a30 0x7ff9000b4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:18.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.619+0000 7ff9080b9700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff900141f20 0x7ff9001423b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:18.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.619+0000 7ff9080b9700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9000af030 con 0x7ff9000acb10 2020-04-22T14:16:18.624 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.619+0000 7ff9080b9700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff900060250 con 0x7ff900061a30 2020-04-22T14:16:18.624 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.619+0000 7ff9080b9700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9000623c0 con 0x7ff900141f20 2020-04-22T14:16:18.624 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.619+0000 7ff905e55700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff900061a30 0x7ff9000b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:18.624 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.619+0000 7ff905e55700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff900061a30 0x7ff9000b4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56176/0 (socket says 172.21.15.103:56176) 2020-04-22T14:16:18.624 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.619+0000 7ff905e55700 1 -- 172.21.15.103:0/5783534 learned_addr learned my addr 172.21.15.103:0/5783534 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:18.624 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.619+0000 7ff906656700 1 --2- 172.21.15.103:0/5783534 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff900141f20 0x7ff9001423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:18.625 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.619+0000 7ff905e55700 1 -- 172.21.15.103:0/5783534 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff900141f20 msgr2=0x7ff9001423b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:18.625 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.619+0000 7ff905e55700 1 --2- 172.21.15.103:0/5783534 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff900141f20 0x7ff9001423b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:18.625 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.619+0000 7ff905e55700 1 -- 172.21.15.103:0/5783534 >> v1:172.21.15.86:6789/0 conn(0x7ff9000acb10 legacy=0x7ff9000ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:18.625 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.619+0000 7ff905e55700 1 -- 172.21.15.103:0/5783534 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff900062660 con 0x7ff900061a30 2020-04-22T14:16:18.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.619+0000 7ff905e55700 1 --2- 172.21.15.103:0/5783534 >> v2:172.21.15.103:3300/0 conn(0x7ff900061a30 0x7ff9000b4820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff90005bc40 tx=0x7ff8fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.619+0000 7ff905e55700 1 --2- 172.21.15.103:0/5783534 >> v2:172.21.15.103:3300/0 conn(0x7ff900061a30 0x7ff9000b4820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff90005bc40 tx=0x7ff8fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.619+0000 7ff905e55700 1 --2- 172.21.15.103:0/5783534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff900061a30 0x7ff9000b4820 secure :-1 s=READY pgs=1659 cs=0 l=1 rx=0x7ff90005bc40 tx=0x7ff8fc007a40).ready entity=mon.1 client_cookie=8e0500261c87da34 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:18.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.619+0000 7ff905e55700 1 --2- 172.21.15.103:0/5783534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff900061a30 0x7ff9000b4820 secure :-1 s=THROTTLE_DONE pgs=1659 cs=0 l=1 rx=0x7ff90005bc40 tx=0x7ff8fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.632 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.619+0000 7ff904e53700 1 -- 172.21.15.103:0/5783534 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8fc0116e0 con 0x7ff900061a30 2020-04-22T14:16:18.633 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.619+0000 7ff905e55700 1 --2- 172.21.15.103:0/5783534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff900061a30 0x7ff9000b4820 secure :-1 s=THROTTLE_DONE pgs=1659 cs=0 l=1 rx=0x7ff90005bc40 tx=0x7ff8fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.633 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.619+0000 7ff905e55700 1 --2- 172.21.15.103:0/5783534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff900061a30 0x7ff9000b4820 secure :-1 s=THROTTLE_DONE pgs=1659 cs=0 l=1 rx=0x7ff90005bc40 tx=0x7ff8fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.633 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.619+0000 7ff904e53700 1 -- 172.21.15.103:0/5783534 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8fc011840 con 0x7ff900061a30 2020-04-22T14:16:18.633 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.619+0000 7ff904e53700 1 -- 172.21.15.103:0/5783534 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8fc011c60 con 0x7ff900061a30 2020-04-22T14:16:18.633 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.619+0000 7ff9080b9700 1 -- 172.21.15.103:0/5783534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff900061a30 msgr2=0x7ff9000b4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:18.633 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.619+0000 7ff9080b9700 1 --2- 172.21.15.103:0/5783534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff900061a30 0x7ff9000b4820 secure :-1 s=READY pgs=1659 cs=0 l=1 rx=0x7ff90005bc40 tx=0x7ff8fc007a40).stop 2020-04-22T14:16:18.633 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.620+0000 7ff9080b9700 1 -- 172.21.15.103:0/5783534 shutdown_connections 2020-04-22T14:16:18.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.620+0000 7ff9080b9700 1 --2- 172.21.15.103:0/5783534 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff900141f20 0x7ff9001423b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:18.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.620+0000 7ff9080b9700 1 --2- 172.21.15.103:0/5783534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff900061a30 0x7ff9000b4820 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:18.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.620+0000 7ff9080b9700 1 -- 172.21.15.103:0/5783534 >> 172.21.15.103:0/5783534 conn(0x7ff90005b7b0 msgr2=0x7ff9000b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:18.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.620+0000 7ff9080b9700 1 -- 172.21.15.103:0/5783534 shutdown_connections 2020-04-22T14:16:18.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.620+0000 7ff9080b9700 1 -- 172.21.15.103:0/5783534 wait complete. 2020-04-22T14:16:18.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.621+0000 7ff9080b9700 1 Processor -- start 2020-04-22T14:16:18.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.621+0000 7ff9080b9700 1 -- start start 2020-04-22T14:16:18.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.621+0000 7ff9080b9700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff900061a30 0x7ff90013a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:18.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.622+0000 7ff9080b9700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff900141f20 0x7ff90013a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:18.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.622+0000 7ff9080b9700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff900064c60 con 0x7ff9000acb10 2020-04-22T14:16:18.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.622+0000 7ff9080b9700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff900064f00 con 0x7ff900061a30 2020-04-22T14:16:18.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.622+0000 7ff9080b9700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9000649c0 con 0x7ff900141f20 2020-04-22T14:16:18.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.622+0000 7ff906656700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff900141f20 0x7ff90013a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:18.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.622+0000 7ff906656700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff900141f20 0x7ff90013a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56186/0 (socket says 172.21.15.103:56186) 2020-04-22T14:16:18.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.622+0000 7ff906656700 1 -- 172.21.15.103:0/1106904791 learned_addr learned my addr 172.21.15.103:0/1106904791 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:18.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.622+0000 7ff905e55700 1 --2- 172.21.15.103:0/1106904791 >> v2:172.21.15.86:3300/0 conn(0x7ff900061a30 0x7ff90013a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:18.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.622+0000 7ff906656700 1 -- 172.21.15.103:0/1106904791 >> v2:172.21.15.86:3300/0 conn(0x7ff900061a30 msgr2=0x7ff90013a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:18.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.622+0000 7ff906656700 1 --2- 172.21.15.103:0/1106904791 >> v2:172.21.15.86:3300/0 conn(0x7ff900061a30 0x7ff90013a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:18.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.622+0000 7ff906656700 1 -- 172.21.15.103:0/1106904791 >> v1:172.21.15.86:6789/0 conn(0x7ff9000acb10 legacy=0x7ff90013e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:18.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.622+0000 7ff906656700 1 -- 172.21.15.103:0/1106904791 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff90013ee50 con 0x7ff900141f20 2020-04-22T14:16:18.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.622+0000 7ff906656700 1 --2- 172.21.15.103:0/1106904791 >> v2:172.21.15.103:3300/0 conn(0x7ff900141f20 0x7ff90013a000 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff900065d50 tx=0x7ff8f8010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.622+0000 7ff906656700 1 --2- 172.21.15.103:0/1106904791 >> v2:172.21.15.103:3300/0 conn(0x7ff900141f20 0x7ff90013a000 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff900065d50 tx=0x7ff8f8010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.622+0000 7ff906656700 1 --2- 172.21.15.103:0/1106904791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff900141f20 0x7ff90013a000 secure :-1 s=READY pgs=1660 cs=0 l=1 rx=0x7ff900065d50 tx=0x7ff8f8010f40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:18.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.622+0000 7ff906656700 1 --2- 172.21.15.103:0/1106904791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff900141f20 0x7ff90013a000 secure :-1 s=THROTTLE_DONE pgs=1660 cs=0 l=1 rx=0x7ff900065d50 tx=0x7ff8f8010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.622+0000 7ff8eeffd700 1 -- 172.21.15.103:0/1106904791 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8f8012c80 con 0x7ff900141f20 2020-04-22T14:16:18.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.622+0000 7ff906656700 1 --2- 172.21.15.103:0/1106904791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff900141f20 0x7ff90013a000 secure :-1 s=THROTTLE_DONE pgs=1660 cs=0 l=1 rx=0x7ff900065d50 tx=0x7ff8f8010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.622+0000 7ff906656700 1 --2- 172.21.15.103:0/1106904791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff900141f20 0x7ff90013a000 secure :-1 s=THROTTLE_DONE pgs=1660 cs=0 l=1 rx=0x7ff900065d50 tx=0x7ff8f8010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.622+0000 7ff8eeffd700 1 -- 172.21.15.103:0/1106904791 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8f8012de0 con 0x7ff900141f20 2020-04-22T14:16:18.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.622+0000 7ff9080b9700 1 -- 172.21.15.103:0/1106904791 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff90013f100 con 0x7ff900141f20 2020-04-22T14:16:18.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.622+0000 7ff8eeffd700 1 -- 172.21.15.103:0/1106904791 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8f800a370 con 0x7ff900141f20 2020-04-22T14:16:18.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.622+0000 7ff9080b9700 1 -- 172.21.15.103:0/1106904791 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff90013b810 con 0x7ff900141f20 2020-04-22T14:16:18.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.623+0000 7ff906656700 1 --2- 172.21.15.103:0/1106904791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff900141f20 0x7ff90013a000 secure :-1 s=THROTTLE_DONE pgs=1660 cs=0 l=1 rx=0x7ff900065d50 tx=0x7ff8f8010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.623+0000 7ff8eeffd700 1 -- 172.21.15.103:0/1106904791 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ff8f800a5e0 con 0x7ff900141f20 2020-04-22T14:16:18.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.623+0000 7ff906656700 1 --2- 172.21.15.103:0/1106904791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff900141f20 0x7ff90013a000 secure :-1 s=THROTTLE_DONE pgs=1660 cs=0 l=1 rx=0x7ff900065d50 tx=0x7ff8f8010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.623+0000 7ff9080b9700 1 -- 172.21.15.103:0/1106904791 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff900056c90 con 0x7ff900141f20 2020-04-22T14:16:18.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.623+0000 7ff8eeffd700 1 --2- 172.21.15.103:0/1106904791 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff8e004d9e0 0x7ff8e004fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:18.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.624+0000 7ff8eeffd700 1 -- 172.21.15.103:0/1106904791 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff8f8061da0 con 0x7ff900141f20 2020-04-22T14:16:18.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.624+0000 7ff905e55700 1 --2- 172.21.15.103:0/1106904791 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff8e004d9e0 0x7ff8e004fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:18.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.624+0000 7ff905e55700 1 --2- 172.21.15.103:0/1106904791 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff8e004d9e0 0x7ff8e004fea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff90005bc40 tx=0x7ff8fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.624+0000 7ff905e55700 1 --2- 172.21.15.103:0/1106904791 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff8e004d9e0 0x7ff8e004fea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff90005bc40 tx=0x7ff8fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.624+0000 7ff905e55700 1 --2- 172.21.15.103:0/1106904791 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff8e004d9e0 0x7ff8e004fea0 secure :-1 s=READY pgs=603 cs=0 l=1 rx=0x7ff90005bc40 tx=0x7ff8fc007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:18.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.628+0000 7ff906656700 1 --2- 172.21.15.103:0/1106904791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff900141f20 0x7ff90013a000 secure :-1 s=THROTTLE_DONE pgs=1660 cs=0 l=1 rx=0x7ff900065d50 tx=0x7ff8f8010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.628+0000 7ff8eeffd700 1 -- 172.21.15.103:0/1106904791 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ff8f803d1e0 con 0x7ff900141f20 2020-04-22T14:16:18.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.770+0000 7ff9080b9700 1 -- 172.21.15.103:0/1106904791 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff90006a960 con 0x7ff900141f20 2020-04-22T14:16:18.772 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.770+0000 7ff906656700 1 --2- 172.21.15.103:0/1106904791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff900141f20 0x7ff90013a000 secure :-1 s=THROTTLE_DONE pgs=1660 cs=0 l=1 rx=0x7ff900065d50 tx=0x7ff8f8010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.773 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.770+0000 7ff8eeffd700 1 -- 172.21.15.103:0/1106904791 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v113) v1 ==== 100+0+10 (secure 0 0 0) 0x7ff8f8040800 con 0x7ff900141f20 2020-04-22T14:16:18.773 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:16:18.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.771+0000 7ff9080b9700 1 -- 172.21.15.103:0/1106904791 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff8e004d9e0 msgr2=0x7ff8e004fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:18.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.771+0000 7ff9080b9700 1 --2- 172.21.15.103:0/1106904791 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff8e004d9e0 0x7ff8e004fea0 secure :-1 s=READY pgs=603 cs=0 l=1 rx=0x7ff90005bc40 tx=0x7ff8fc007a40).stop 2020-04-22T14:16:18.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.771+0000 7ff9080b9700 1 -- 172.21.15.103:0/1106904791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff900141f20 msgr2=0x7ff90013a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:18.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.771+0000 7ff9080b9700 1 --2- 172.21.15.103:0/1106904791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff900141f20 0x7ff90013a000 secure :-1 s=READY pgs=1660 cs=0 l=1 rx=0x7ff900065d50 tx=0x7ff8f8010f40).stop 2020-04-22T14:16:18.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.771+0000 7ff9080b9700 1 -- 172.21.15.103:0/1106904791 shutdown_connections 2020-04-22T14:16:18.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.771+0000 7ff9080b9700 1 --2- 172.21.15.103:0/1106904791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff900141f20 0x7ff90013a000 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:18.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.771+0000 7ff9080b9700 1 --2- 172.21.15.103:0/1106904791 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff8e004d9e0 0x7ff8e004fea0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:18.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.771+0000 7ff9080b9700 1 --2- 172.21.15.103:0/1106904791 >> v2:172.21.15.86:3300/0 conn(0x7ff900061a30 0x7ff90013a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:18.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.771+0000 7ff9080b9700 1 -- 172.21.15.103:0/1106904791 >> 172.21.15.103:0/1106904791 conn(0x7ff90005b7b0 msgr2=0x7ff9000b7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:18.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.772+0000 7ff9080b9700 1 -- 172.21.15.103:0/1106904791 shutdown_connections 2020-04-22T14:16:18.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.772+0000 7ff9080b9700 1 -- 172.21.15.103:0/1106904791 wait complete. 2020-04-22T14:16:18.784 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-04-22T14:16:18.785 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:18.799 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:16:18.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.942+0000 7f95c23e1700 1 Processor -- start 2020-04-22T14:16:18.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.943+0000 7f95c23e1700 1 -- start start 2020-04-22T14:16:18.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.943+0000 7f95c23e1700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f95bc0b6040 0x7f95bc0ac740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:18.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.943+0000 7f95c23e1700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f95bc1426d0 0x7f95bc142b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:18.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.943+0000 7f95c23e1700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95bc064ec0 con 0x7f95bc067170 2020-04-22T14:16:18.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.943+0000 7f95c23e1700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95bc065af0 con 0x7f95bc1426d0 2020-04-22T14:16:18.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.943+0000 7f95c23e1700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc146870 con 0x7f95bc0b6040 2020-04-22T14:16:18.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.943+0000 7f95c097e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f95bc1426d0 0x7f95bc142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:18.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.943+0000 7f95c097e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f95bc1426d0 0x7f95bc142b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56190/0 (socket says 172.21.15.103:56190) 2020-04-22T14:16:18.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.943+0000 7f95c097e700 1 -- 172.21.15.103:0/7150280 learned_addr learned my addr 172.21.15.103:0/7150280 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:18.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.944+0000 7f95bb7fe700 1 --2- 172.21.15.103:0/7150280 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f95bc0b6040 0x7f95bc0ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:18.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.944+0000 7f95c097e700 1 -- 172.21.15.103:0/7150280 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f95bc0b6040 msgr2=0x7f95bc0ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:18.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.944+0000 7f95c097e700 1 --2- 172.21.15.103:0/7150280 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f95bc0b6040 0x7f95bc0ac740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:18.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.944+0000 7f95c097e700 1 -- 172.21.15.103:0/7150280 >> v1:172.21.15.86:6789/0 conn(0x7f95bc067170 legacy=0x7f95bc13c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:18.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.944+0000 7f95c097e700 1 -- 172.21.15.103:0/7150280 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95bc067550 con 0x7f95bc1426d0 2020-04-22T14:16:18.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.944+0000 7f95c097e700 1 --2- 172.21.15.103:0/7150280 >> v2:172.21.15.103:3300/0 conn(0x7f95bc1426d0 0x7f95bc142b80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f95bc0663d0 tx=0x7f95b4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.944+0000 7f95c097e700 1 --2- 172.21.15.103:0/7150280 >> v2:172.21.15.103:3300/0 conn(0x7f95bc1426d0 0x7f95bc142b80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f95bc0663d0 tx=0x7f95b4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.944+0000 7f95c097e700 1 --2- 172.21.15.103:0/7150280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95bc1426d0 0x7f95bc142b80 secure :-1 s=READY pgs=1661 cs=0 l=1 rx=0x7f95bc0663d0 tx=0x7f95b4007dc0).ready entity=mon.1 client_cookie=c977313cbaa99021 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:18.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.944+0000 7f95c097e700 1 --2- 172.21.15.103:0/7150280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95bc1426d0 0x7f95bc142b80 secure :-1 s=THROTTLE_DONE pgs=1661 cs=0 l=1 rx=0x7f95bc0663d0 tx=0x7f95b4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.944+0000 7f95baffd700 1 -- 172.21.15.103:0/7150280 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95b400a180 con 0x7f95bc1426d0 2020-04-22T14:16:18.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.944+0000 7f95c097e700 1 --2- 172.21.15.103:0/7150280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95bc1426d0 0x7f95bc142b80 secure :-1 s=THROTTLE_DONE pgs=1661 cs=0 l=1 rx=0x7f95bc0663d0 tx=0x7f95b4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.944+0000 7f95c097e700 1 --2- 172.21.15.103:0/7150280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95bc1426d0 0x7f95bc142b80 secure :-1 s=THROTTLE_DONE pgs=1661 cs=0 l=1 rx=0x7f95bc0663d0 tx=0x7f95b4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.944+0000 7f95baffd700 1 -- 172.21.15.103:0/7150280 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b400a2e0 con 0x7f95bc1426d0 2020-04-22T14:16:18.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.944+0000 7f95baffd700 1 -- 172.21.15.103:0/7150280 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95b400a700 con 0x7f95bc1426d0 2020-04-22T14:16:18.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.944+0000 7f95c23e1700 1 -- 172.21.15.103:0/7150280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95bc1426d0 msgr2=0x7f95bc142b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:18.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.944+0000 7f95c23e1700 1 --2- 172.21.15.103:0/7150280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95bc1426d0 0x7f95bc142b80 secure :-1 s=READY pgs=1661 cs=0 l=1 rx=0x7f95bc0663d0 tx=0x7f95b4007dc0).stop 2020-04-22T14:16:18.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.945+0000 7f95c23e1700 1 -- 172.21.15.103:0/7150280 shutdown_connections 2020-04-22T14:16:18.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.945+0000 7f95c23e1700 1 --2- 172.21.15.103:0/7150280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95bc1426d0 0x7f95bc142b80 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:18.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.945+0000 7f95c23e1700 1 --2- 172.21.15.103:0/7150280 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f95bc0b6040 0x7f95bc0ac740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:18.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.945+0000 7f95c23e1700 1 -- 172.21.15.103:0/7150280 >> 172.21.15.103:0/7150280 conn(0x7f95bc0b9160 msgr2=0x7f95bc05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:18.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.945+0000 7f95c23e1700 1 -- 172.21.15.103:0/7150280 shutdown_connections 2020-04-22T14:16:18.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.945+0000 7f95c23e1700 1 -- 172.21.15.103:0/7150280 wait complete. 2020-04-22T14:16:18.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.946+0000 7f95c23e1700 1 Processor -- start 2020-04-22T14:16:18.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.946+0000 7f95c23e1700 1 -- start start 2020-04-22T14:16:18.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.946+0000 7f95c23e1700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f95bc0b6040 0x7f95bc138440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:18.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.946+0000 7f95c23e1700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95bc0ad5f0 con 0x7f95bc067170 2020-04-22T14:16:18.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.946+0000 7f95c23e1700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95bc0ad890 con 0x7f95bc1426d0 2020-04-22T14:16:18.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.946+0000 7f95c23e1700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95bc0adb30 con 0x7f95bc0b6040 2020-04-22T14:16:18.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.947+0000 7f95c097e700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f95bc1426d0 0x7f95bc153200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48388/0 (socket says 172.21.15.103:48388) 2020-04-22T14:16:18.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.947+0000 7f95c097e700 1 -- 172.21.15.103:0/1863112538 learned_addr learned my addr 172.21.15.103:0/1863112538 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:18.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.947+0000 7f95b97fa700 1 -- 172.21.15.103:0/1863112538 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 623243219 0 0) 0x7f95bc0ad890 con 0x7f95bc1426d0 2020-04-22T14:16:18.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.947+0000 7f95b97fa700 1 -- 172.21.15.103:0/1863112538 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f959c002fe0 con 0x7f95bc1426d0 2020-04-22T14:16:18.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.947+0000 7f95bb7fe700 1 --2- 172.21.15.103:0/1863112538 >> v2:172.21.15.86:3300/0 conn(0x7f95bc0b6040 0x7f95bc138440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:18.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.947+0000 7f95b97fa700 1 -- 172.21.15.103:0/1863112538 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1417154313 0 0) 0x7f959c002fe0 con 0x7f95bc1426d0 2020-04-22T14:16:18.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.947+0000 7f95b97fa700 1 -- 172.21.15.103:0/1863112538 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f95bc0ad890 con 0x7f95bc1426d0 2020-04-22T14:16:18.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.947+0000 7f95b97fa700 1 -- 172.21.15.103:0/1863112538 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f95b4008960 con 0x7f95bc1426d0 2020-04-22T14:16:18.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.947+0000 7f95b97fa700 1 -- 172.21.15.103:0/1863112538 >> v2:172.21.15.86:3300/0 conn(0x7f95bc0b6040 msgr2=0x7f95bc138440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:18.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.947+0000 7f95b97fa700 1 --2- 172.21.15.103:0/1863112538 >> v2:172.21.15.86:3300/0 conn(0x7f95bc0b6040 0x7f95bc138440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:18.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.947+0000 7f95b97fa700 1 -- 172.21.15.103:0/1863112538 >> v1:172.21.15.103:6789/0 conn(0x7f95bc1426d0 legacy=0x7f95bc153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:18.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.947+0000 7f95b97fa700 1 -- 172.21.15.103:0/1863112538 >> v1:172.21.15.86:6789/0 conn(0x7f95bc067170 legacy=0x7f95bc0adfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:18.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.947+0000 7f95b97fa700 1 --2- 172.21.15.103:0/1863112538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f959c0049b0 0x7f959c004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:18.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.947+0000 7f95b97fa700 1 --2- 172.21.15.103:0/1863112538 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f959c005290 0x7f959c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:18.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.947+0000 7f95b97fa700 1 --2- 172.21.15.103:0/1863112538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f959c003f10 0x7f959c004390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:18.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.947+0000 7f95b97fa700 1 -- 172.21.15.103:0/1863112538 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc0adb30 con 0x7f959c003f10 2020-04-22T14:16:18.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.947+0000 7f95b97fa700 1 -- 172.21.15.103:0/1863112538 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959c00b780 con 0x7f959c0049b0 2020-04-22T14:16:18.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.947+0000 7f95b97fa700 1 -- 172.21.15.103:0/1863112538 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f959c00b940 con 0x7f959c005290 2020-04-22T14:16:18.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.947+0000 7f95bbfff700 1 --2- 172.21.15.103:0/1863112538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f959c0049b0 0x7f959c004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:18.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.947+0000 7f95bb7fe700 1 --2- 172.21.15.103:0/1863112538 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f959c005290 0x7f959c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:18.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.947+0000 7f95c097e700 1 --2- 172.21.15.103:0/1863112538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f959c003f10 0x7f959c004390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:18.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.948+0000 7f95bbfff700 1 -- 172.21.15.103:0/1863112538 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f959c005290 msgr2=0x7f959c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:18.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.948+0000 7f95bbfff700 1 --2- 172.21.15.103:0/1863112538 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f959c005290 0x7f959c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:18.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.948+0000 7f95bbfff700 1 -- 172.21.15.103:0/1863112538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f959c003f10 msgr2=0x7f959c004390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:18.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.948+0000 7f95bbfff700 1 --2- 172.21.15.103:0/1863112538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f959c003f10 0x7f959c004390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:18.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.948+0000 7f95c097e700 1 -- 172.21.15.103:0/1863112538 reap_dead start 2020-04-22T14:16:18.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.948+0000 7f95bbfff700 1 -- 172.21.15.103:0/1863112538 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95bc153910 con 0x7f959c0049b0 2020-04-22T14:16:18.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.948+0000 7f95c23e1700 1 -- 172.21.15.103:0/1863112538 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95bc138440 con 0x7f959c0049b0 2020-04-22T14:16:18.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.948+0000 7f95bbfff700 1 --2- 172.21.15.103:0/1863112538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f959c0049b0 0x7f959c004d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f95ac0013a0 tx=0x7f95ac000f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.948+0000 7f95c23e1700 1 -- 172.21.15.103:0/1863112538 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95bc0619f0 con 0x7f959c0049b0 2020-04-22T14:16:18.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.948+0000 7f95bbfff700 1 --2- 172.21.15.103:0/1863112538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f959c0049b0 0x7f959c004d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f95ac0013a0 tx=0x7f95ac000f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.948+0000 7f95bbfff700 1 --2- 172.21.15.103:0/1863112538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f959c0049b0 0x7f959c004d90 secure :-1 s=READY pgs=1663 cs=0 l=1 rx=0x7f95ac0013a0 tx=0x7f95ac000f90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:18.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.948+0000 7f95bbfff700 1 --2- 172.21.15.103:0/1863112538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f959c0049b0 0x7f959c004d90 secure :-1 s=THROTTLE_DONE pgs=1663 cs=0 l=1 rx=0x7f95ac0013a0 tx=0x7f95ac000f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.948+0000 7f95b97fa700 1 -- 172.21.15.103:0/1863112538 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95ac00cd20 con 0x7f959c0049b0 2020-04-22T14:16:18.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.948+0000 7f95bbfff700 1 --2- 172.21.15.103:0/1863112538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f959c0049b0 0x7f959c004d90 secure :-1 s=THROTTLE_DONE pgs=1663 cs=0 l=1 rx=0x7f95ac0013a0 tx=0x7f95ac000f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.948+0000 7f95b97fa700 1 -- 172.21.15.103:0/1863112538 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ac00ce80 con 0x7f959c0049b0 2020-04-22T14:16:18.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.948+0000 7f95bbfff700 1 --2- 172.21.15.103:0/1863112538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f959c0049b0 0x7f959c004d90 secure :-1 s=THROTTLE_DONE pgs=1663 cs=0 l=1 rx=0x7f95ac0013a0 tx=0x7f95ac000f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.948+0000 7f95b97fa700 1 -- 172.21.15.103:0/1863112538 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95ac0067d0 con 0x7f959c0049b0 2020-04-22T14:16:18.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.948+0000 7f95bbfff700 1 --2- 172.21.15.103:0/1863112538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f959c0049b0 0x7f959c004d90 secure :-1 s=THROTTLE_DONE pgs=1663 cs=0 l=1 rx=0x7f95ac0013a0 tx=0x7f95ac000f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.949+0000 7f95c23e1700 1 -- 172.21.15.103:0/1863112538 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9598003340 con 0x7f959c0049b0 2020-04-22T14:16:18.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.949+0000 7f95b97fa700 1 -- 172.21.15.103:0/1863112538 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f95ac006930 con 0x7f959c0049b0 2020-04-22T14:16:18.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.949+0000 7f95bbfff700 1 --2- 172.21.15.103:0/1863112538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f959c0049b0 0x7f959c004d90 secure :-1 s=THROTTLE_DONE pgs=1663 cs=0 l=1 rx=0x7f95ac0013a0 tx=0x7f95ac000f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.949+0000 7f95b97fa700 1 --2- 172.21.15.103:0/1863112538 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f959c051680 0x7f959c053b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:18.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.949+0000 7f95b97fa700 1 -- 172.21.15.103:0/1863112538 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f95ac060d10 con 0x7f959c0049b0 2020-04-22T14:16:18.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.949+0000 7f95bb7fe700 1 --2- 172.21.15.103:0/1863112538 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f959c051680 0x7f959c053b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:18.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.950+0000 7f95bb7fe700 1 --2- 172.21.15.103:0/1863112538 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f959c051680 0x7f959c053b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f95b0002f30 tx=0x7f95b0006f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.950+0000 7f95bb7fe700 1 --2- 172.21.15.103:0/1863112538 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f959c051680 0x7f959c053b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f95b0002f30 tx=0x7f95b0006f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.950+0000 7f95bb7fe700 1 --2- 172.21.15.103:0/1863112538 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f959c051680 0x7f959c053b40 secure :-1 s=READY pgs=604 cs=0 l=1 rx=0x7f95b0002f30 tx=0x7f95b0006f00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:18.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.953+0000 7f95bbfff700 1 --2- 172.21.15.103:0/1863112538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f959c0049b0 0x7f959c004d90 secure :-1 s=THROTTLE_DONE pgs=1663 cs=0 l=1 rx=0x7f95ac0013a0 tx=0x7f95ac000f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:18.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:18.953+0000 7f95b97fa700 1 -- 172.21.15.103:0/1863112538 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f95ac03c0f0 con 0x7f959c0049b0 2020-04-22T14:16:19.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:19.140+0000 7f95c23e1700 1 -- 172.21.15.103:0/1863112538 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95980036e0 con 0x7f959c0049b0 2020-04-22T14:16:19.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:19.140+0000 7f95bbfff700 1 --2- 172.21.15.103:0/1863112538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f959c0049b0 0x7f959c004d90 secure :-1 s=THROTTLE_DONE pgs=1663 cs=0 l=1 rx=0x7f95ac0013a0 tx=0x7f95ac000f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:19.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:19.140+0000 7f95b97fa700 1 -- 172.21.15.103:0/1863112538 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+2143 (secure 0 0 0) 0x7f95ac03f710 con 0x7f959c0049b0 2020-04-22T14:16:19.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:19.142+0000 7f95c23e1700 1 -- 172.21.15.103:0/1863112538 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f959c051680 msgr2=0x7f959c053b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:19.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:19.142+0000 7f95c23e1700 1 --2- 172.21.15.103:0/1863112538 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f959c051680 0x7f959c053b40 secure :-1 s=READY pgs=604 cs=0 l=1 rx=0x7f95b0002f30 tx=0x7f95b0006f00).stop 2020-04-22T14:16:19.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:19.142+0000 7f95c23e1700 1 -- 172.21.15.103:0/1863112538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f959c0049b0 msgr2=0x7f959c004d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:19.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:19.142+0000 7f95c23e1700 1 --2- 172.21.15.103:0/1863112538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f959c0049b0 0x7f959c004d90 secure :-1 s=READY pgs=1663 cs=0 l=1 rx=0x7f95ac0013a0 tx=0x7f95ac000f90).stop 2020-04-22T14:16:19.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:19.142+0000 7f95c23e1700 1 -- 172.21.15.103:0/1863112538 shutdown_connections 2020-04-22T14:16:19.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:19.142+0000 7f95c23e1700 1 --2- 172.21.15.103:0/1863112538 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f959c051680 0x7f959c053b40 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:19.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:19.142+0000 7f95c23e1700 1 --2- 172.21.15.103:0/1863112538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f959c0049b0 0x7f959c004d90 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:19.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:19.142+0000 7f95c23e1700 1 -- 172.21.15.103:0/1863112538 >> 172.21.15.103:0/1863112538 conn(0x7f95bc0b9160 msgr2=0x7f95bc0b7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:19.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:19.142+0000 7f95c23e1700 1 -- 172.21.15.103:0/1863112538 shutdown_connections 2020-04-22T14:16:19.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:19.142+0000 7f95c23e1700 1 -- 172.21.15.103:0/1863112538 wait complete. 2020-04-22T14:16:19.147 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 82 2020-04-22T14:16:19.147 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:16:19.148 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":82,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7776,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.86:6835/3450302561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3450302561},{"type":"v1","addr":"172.21.15.86:6835","nonce":3450302561}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":78}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:16:05.150517+0000","modified":"2020-04-22T14:16:07.155780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8470":{"gid":8470,"name":"a","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/3949453152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3949453152},{"type":"v1","addr":"172.21.15.103:6833","nonce":3949453152}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2020-04-22T14:16:19.356 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 8470}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 19, u'failed': [], u'epoch': 82, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [20], u'info': {u'gid_8470': {u'export_targets': [], u'name': u'a', u'incarnation': 79, u'state_seq': 3, u'state': u'up:active', u'gid': 8470, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 3949453152, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 3949453152, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/3949453152'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:16:05.150517+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:16:07.155780+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:16:19.356 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:16:19.356 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:19.370 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:16:19.530 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:16:19.531 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:16:19.531 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:16:19.531 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 8470, 2020-04-22T14:16:19.532 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:16:19.532 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:16:19.532 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 14.376896119, 2020-04-22T14:16:19.532 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 82, 2020-04-22T14:16:19.533 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 113, 2020-04-22T14:16:19.533 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 113, 2020-04-22T14:16:19.533 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 19.802346092000001 2020-04-22T14:16:19.533 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:16:19.540 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 8470, "want_state": "up:active", "state": "up:active", "rank_uptime": 14.376896119, "mdsmap_epoch": 82, "osdmap_epoch": 113, "osdmap_epoch_barrier": 113, "uptime": 19.802346092000001 } 2020-04-22T14:16:19.540 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-04-22T14:16:19.541 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-04-22T14:16:19.541 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:19.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:19.556 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:16:19.614 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:16:19.615 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:16:19.615 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:16:19.615 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:16:19.615 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:16:19.615 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:16:19.615 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:16:19.616 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:16:19.616 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:16:19.616 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:16:19.616 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:16:19.616 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:16:19.616 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:16:19.616 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:16:19.617 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:16:19.617 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 41861sec preferred_lft 41861sec 2020-04-22T14:16:19.617 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:16:19.617 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:16:19.617 INFO:teuthology.orchestra.run.smithi103.stdout:34: brx.1@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:16:19.617 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether d2:98:d4:1b:2c:0d brd ff:ff:ff:ff:ff:ff link-netnsid 1 2020-04-22T14:16:19.617 INFO:teuthology.orchestra.run.smithi103.stdout:35: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:16:19.618 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 06:0f:bc:de:b3:68 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:16:19.618 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:16:19.618 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:16:19.618 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::94b4:9f79:eb94:ae6a/64 scope link noprefixroute 2020-04-22T14:16:19.618 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:16:19.618 INFO:teuthology.orchestra.run.smithi103.stdout:36: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-04-22T14:16:19.618 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 06:0f:bc:de:b3:68 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2020-04-22T14:16:19.619 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:19.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:19.670 INFO:teuthology.orchestra.run.smithi103:> ip netns list 2020-04-22T14:16:19.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2020-04-22T14:16:19.726 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:19.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:19.778 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:16:19.837 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2020-04-22T14:16:19.837 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 1 2020-04-22T14:16:19.838 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:19.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:19.885 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:16:19.943 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2020-04-22T14:16:19.944 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 1 2020-04-22T14:16:19.944 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:19.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:19.992 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:16:20.051 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2020-04-22T14:16:20.051 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 1 2020-04-22T14:16:20.051 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:20.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:20.100 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:16:20.177 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:20.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:20.223 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 2' 2020-04-22T14:16:20.298 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:20.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:20.344 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr' 2020-04-22T14:16:20.424 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:16:20.424 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:16:20.424 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:16:20.425 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:16:20.425 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:16:20.425 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:16:20.425 INFO:teuthology.orchestra.run.smithi103.stdout:2: veth0@if36: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:16:20.425 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 6e:a0:8f:38:8c:fc brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:16:20.425 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2020-04-22T14:16:20.426 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:16:20.426 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::6ca0:8fff:fe38:8cfc/64 scope link 2020-04-22T14:16:20.426 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:16:20.457 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:20.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:20.481 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr' 2020-04-22T14:16:20.592 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:16:20.592 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:16:20.593 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:16:20.593 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:16:20.593 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:16:20.593 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:16:20.593 INFO:teuthology.orchestra.run.smithi103.stdout:2: veth0@if36: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:16:20.593 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 6e:a0:8f:38:8c:fc brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:16:20.594 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2020-04-22T14:16:20.594 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:16:20.594 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::6ca0:8fff:fe38:8cfc/64 scope link 2020-04-22T14:16:20.594 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:16:20.594 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.2/16 2020-04-22T14:16:20.594 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:20.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:20.621 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.2' 2020-04-22T14:16:20.697 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:20.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:20.745 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0' 2020-04-22T14:16:20.852 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:20.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:20.866 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up' 2020-04-22T14:16:20.974 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:20.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:20.989 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up' 2020-04-22T14:16:21.098 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:21.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:21.112 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254' 2020-04-22T14:16:21.219 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:21.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:21.233 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:16:21.318 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:21.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:21.360 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge-slave con-name brx.2 ifname brx.2 master ceph-brx' 2020-04-22T14:16:21.470 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.2' (083685d5-d95c-425c-9287-8e11ffa4d170) successfully added. 2020-04-22T14:16:21.470 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:21.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:21.484 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up brx.2' 2020-04-22T14:16:21.643 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/45) 2020-04-22T14:16:21.694 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2020-04-22T14:16:21.694 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi103.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2020-04-22T14:16:21.694 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:21.709 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:16:21.710 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:16:21.768 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:21.817 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:16:21.818 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:16:21.885 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:16:21.893 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:16:21.893 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:21.946 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:16:21.947 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:16:22.006 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:16:22.006 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [47] 2020-04-22T14:16:22.006 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:22.054 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:16:22.096 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:22.109 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:16:22.110 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:16:22.179 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:16:22.185 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:2020-04-22T14:16:22.183+0000 7f8c96f251c0 -1 init, newargv = 0x55ca90926b80 newargc=9 2020-04-22T14:16:22.185 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[102228]: starting ceph client 2020-04-22T14:16:22.186 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:16:22.187 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:22.189 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[102228]: starting fuse 2020-04-22T14:16:22.201 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:16:22.201 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:16:22.260 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:16:22.260 INFO:teuthology.orchestra.run.smithi103.stdout:49 2020-04-22T14:16:22.260 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47, 49] 2020-04-22T14:16:22.261 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:22.309 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:16:22.310 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:16:22.310 INFO:teuthology.orchestra.run.smithi103:> import glob 2020-04-22T14:16:22.310 INFO:teuthology.orchestra.run.smithi103:> import re 2020-04-22T14:16:22.310 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:16:22.310 INFO:teuthology.orchestra.run.smithi103:> import subprocess 2020-04-22T14:16:22.310 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:16:22.310 INFO:teuthology.orchestra.run.smithi103:> def find_socket(client_name): 2020-04-22T14:16:22.310 INFO:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2020-04-22T14:16:22.311 INFO:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2020-04-22T14:16:22.311 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:16:22.311 INFO:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2020-04-22T14:16:22.311 INFO:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2020-04-22T14:16:22.311 INFO:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2020-04-22T14:16:22.311 INFO:teuthology.orchestra.run.smithi103:> return files[0] 2020-04-22T14:16:22.311 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:16:22.311 INFO:teuthology.orchestra.run.smithi103:> for f in files: 2020-04-22T14:16:22.312 INFO:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:16:22.312 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:16:22.312 INFO:teuthology.orchestra.run.smithi103:> return f 2020-04-22T14:16:22.312 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:16:22.312 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:16:22.312 INFO:teuthology.orchestra.run.smithi103:> print(find_socket("client.1")) 2020-04-22T14:16:22.312 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:16:22.417 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.1.102228.asok 2020-04-22T14:16:22.417 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.102228.asok 2020-04-22T14:16:22.417 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:22.431 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:16:22.431 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.102228.asok status 2020-04-22T14:16:22.589 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:16:22.589 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2020-04-22T14:16:22.589 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:16:22.589 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:16:22.590 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "1", 2020-04-22T14:16:22.590 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:16:22.590 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2020-04-22T14:16:22.590 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "102228", 2020-04-22T14:16:22.590 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:16:22.590 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:22.590 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2020-04-22T14:16:22.590 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2020-04-22T14:16:22.591 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 6314, 2020-04-22T14:16:22.591 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2020-04-22T14:16:22.591 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:16:22.591 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:16:22.591 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 6314 2020-04-22T14:16:22.591 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:22.591 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:16:22.592 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:16:22.592 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.2:0", 2020-04-22T14:16:22.592 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1554253538 2020-04-22T14:16:22.592 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:22.592 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:22.592 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:16:22.592 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:16:22.592 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.2:0", 2020-04-22T14:16:22.593 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1554253538 2020-04-22T14:16:22.593 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:22.593 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.6314 192.168.0.2:0/1554253538", 2020-04-22T14:16:22.593 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.2:0/1554253538", 2020-04-22T14:16:22.593 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2020-04-22T14:16:22.593 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 82, 2020-04-22T14:16:22.593 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 113, 2020-04-22T14:16:22.594 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2020-04-22T14:16:22.594 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklisted": false 2020-04-22T14:16:22.594 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:16:22.594 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:22.609 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:16:22.609 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-22T14:16:22.609 INFO:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:16:22.668 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2020-04-22T14:16:22.668 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-04-22T14:16:22.668 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:22.717 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:16:22.717 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:16:22.792 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:22.838 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok config get mds_reconnect_timeout 2020-04-22T14:16:22.989 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:16:22.990 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_reconnect_timeout": "45.000000" 2020-04-22T14:16:22.990 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:16:22.998 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_reconnect_timeout": "45.000000" } 2020-04-22T14:16:22.998 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:23.011 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok config get ms_max_backoff 2020-04-22T14:16:23.169 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:16:23.170 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_max_backoff": "15.000000" 2020-04-22T14:16:23.170 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:16:23.177 INFO:tasks.cephfs.filesystem:_json_asok output: { "ms_max_backoff": "15.000000" } 2020-04-22T14:16:23.178 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:23.191 INFO:teuthology.orchestra.run.smithi103:> rpm -q fuse --qf '%{VERSION}-%{RELEASE}' 2020-04-22T14:16:23.249 INFO:teuthology.orchestra.run.smithi103.stdout:2.9.7-12.el8 2020-04-22T14:16:23.250 INFO:teuthology.packaging:The installed version of fuse is 2.9.7-12.el8 2020-04-22T14:16:23.250 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:23.303 INFO:teuthology.orchestra.run.smithi103:> rpm -q fuse --qf '%{VERSION}-%{RELEASE}' 2020-04-22T14:16:23.362 INFO:teuthology.orchestra.run.smithi103.stdout:2.9.7-12.el8 2020-04-22T14:16:23.363 INFO:teuthology.packaging:The installed version of fuse is 2.9.7-12.el8 2020-04-22T14:16:23.363 INFO:tasks.cephfs.test_client_recovery:flock locks are available 2020-04-22T14:16:23.363 INFO:tasks.cephfs.mount:lock_background file background_file 2020-04-22T14:16:23.363 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:23.416 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-04-22T14:16:23.416 INFO:teuthology.orchestra.run.smithi103:> import time 2020-04-22T14:16:23.416 INFO:teuthology.orchestra.run.smithi103:> import fcntl 2020-04-22T14:16:23.417 INFO:teuthology.orchestra.run.smithi103:> import struct 2020-04-22T14:16:23.417 INFO:teuthology.orchestra.run.smithi103:> f1 = open("/home/ubuntu/cephtest/mnt.0/background_file-1", '"'"'w'"'"') 2020-04-22T14:16:23.417 INFO:teuthology.orchestra.run.smithi103:> fcntl.flock(f1, fcntl.LOCK_EX | fcntl.LOCK_NB) 2020-04-22T14:16:23.417 INFO:teuthology.orchestra.run.smithi103:> f2 = open("/home/ubuntu/cephtest/mnt.0/background_file-2", '"'"'w'"'"') 2020-04-22T14:16:23.417 INFO:teuthology.orchestra.run.smithi103:> lockdata = struct.pack('"'"'hhllhh'"'"', fcntl.F_WRLCK, 0, 0, 0, 0, 0) 2020-04-22T14:16:23.417 INFO:teuthology.orchestra.run.smithi103:> fcntl.fcntl(f2, fcntl.F_SETLK, lockdata) 2020-04-22T14:16:23.417 INFO:teuthology.orchestra.run.smithi103:> while True: 2020-04-22T14:16:23.417 INFO:teuthology.orchestra.run.smithi103:> time.sleep(1) 2020-04-22T14:16:23.418 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:16:23.465 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:23.478 INFO:teuthology.orchestra.run.smithi103:> sudo ls /home/ubuntu/cephtest/mnt.1/background_file-2 2020-04-22T14:16:23.553 INFO:teuthology.orchestra.run.smithi103.stdout:/home/ubuntu/cephtest/mnt.1/background_file-2 2020-04-22T14:16:23.554 DEBUG:tasks.cephfs.mount:File background_file-2 became visible from 1 after 0s 2020-04-22T14:16:23.555 INFO:tasks.cephfs.mount:check lock on file background_file 2020-04-22T14:16:23.555 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:23.608 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:16:23.609 INFO:teuthology.orchestra.run.smithi103:> import fcntl 2020-04-22T14:16:23.609 INFO:teuthology.orchestra.run.smithi103:> import errno 2020-04-22T14:16:23.609 INFO:teuthology.orchestra.run.smithi103:> import struct 2020-04-22T14:16:23.609 INFO:teuthology.orchestra.run.smithi103:> f1 = open("/home/ubuntu/cephtest/mnt.1/background_file-1", '"'"'r'"'"') 2020-04-22T14:16:23.609 INFO:teuthology.orchestra.run.smithi103:> try: 2020-04-22T14:16:23.609 INFO:teuthology.orchestra.run.smithi103:> fcntl.flock(f1, fcntl.LOCK_EX | fcntl.LOCK_NB) 2020-04-22T14:16:23.609 INFO:teuthology.orchestra.run.smithi103:> except IOError as e: 2020-04-22T14:16:23.609 INFO:teuthology.orchestra.run.smithi103:> if e.errno == errno.EAGAIN: 2020-04-22T14:16:23.610 INFO:teuthology.orchestra.run.smithi103:> pass 2020-04-22T14:16:23.610 INFO:teuthology.orchestra.run.smithi103:> else: 2020-04-22T14:16:23.610 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("flock on file /home/ubuntu/cephtest/mnt.1/background_file-1 not found") 2020-04-22T14:16:23.610 INFO:teuthology.orchestra.run.smithi103:> f2 = open("/home/ubuntu/cephtest/mnt.1/background_file-2", '"'"'r'"'"') 2020-04-22T14:16:23.610 INFO:teuthology.orchestra.run.smithi103:> try: 2020-04-22T14:16:23.610 INFO:teuthology.orchestra.run.smithi103:> lockdata = struct.pack('"'"'hhllhh'"'"', fcntl.F_WRLCK, 0, 0, 0, 0, 0) 2020-04-22T14:16:23.610 INFO:teuthology.orchestra.run.smithi103:> fcntl.fcntl(f2, fcntl.F_SETLK, lockdata) 2020-04-22T14:16:23.610 INFO:teuthology.orchestra.run.smithi103:> except IOError as e: 2020-04-22T14:16:23.611 INFO:teuthology.orchestra.run.smithi103:> if e.errno == errno.EAGAIN: 2020-04-22T14:16:23.611 INFO:teuthology.orchestra.run.smithi103:> pass 2020-04-22T14:16:23.611 INFO:teuthology.orchestra.run.smithi103:> else: 2020-04-22T14:16:23.611 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("posix lock on file /home/ubuntu/cephtest/mnt.1/background_file-2 not found") 2020-04-22T14:16:23.611 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:16:23.713 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-04-22T14:16:23.713 INFO:teuthology.orchestra.run:waiting for 300 2020-04-22T14:16:23.713 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-04-22T14:16:23.714 INFO:teuthology.orchestra.run:waiting for 300 2020-04-22T14:16:23.721 INFO:tasks.ceph.mds.a:Stopped 2020-04-22T14:16:23.721 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:23.723 INFO:tasks.ceph.mds.b:Stopped 2020-04-22T14:16:23.723 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:23.775 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mds fail a 2020-04-22T14:16:23.776 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mds fail b 2020-04-22T14:16:23.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.922+0000 7f87a637c700 1 Processor -- start 2020-04-22T14:16:23.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.922+0000 7f87a637c700 1 -- start start 2020-04-22T14:16:23.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.922+0000 7f95373d2700 1 Processor -- start 2020-04-22T14:16:23.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.923+0000 7f95373d2700 1 -- start start 2020-04-22T14:16:23.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.924+0000 7f95373d2700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f95301468c0 0x7f9530146d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:23.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.924+0000 7f95373d2700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f953014a880 con 0x7f953014a400 2020-04-22T14:16:23.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.924+0000 7f95373d2700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95300b3300 con 0x7f95301405c0 2020-04-22T14:16:23.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.924+0000 7f95373d2700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95300b35a0 con 0x7f95301468c0 2020-04-22T14:16:23.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.924+0000 7f953516e700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f95301405c0 0x7f95300b1cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48426/0 (socket says 172.21.15.103:48426) 2020-04-22T14:16:23.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.924+0000 7f953516e700 1 -- 172.21.15.103:0/3026561115 learned_addr learned my addr 172.21.15.103:0/3026561115 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:23.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.924+0000 7f953596f700 1 --2- 172.21.15.103:0/3026561115 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f95301468c0 0x7f9530146d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:23.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.924+0000 7f951ffff700 1 -- 172.21.15.103:0/3026561115 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1403760871 0 0) 0x7f95300b3300 con 0x7f95301405c0 2020-04-22T14:16:23.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.924+0000 7f951ffff700 1 -- 172.21.15.103:0/3026561115 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9518003230 con 0x7f95301405c0 2020-04-22T14:16:23.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.924+0000 7f951ffff700 1 -- 172.21.15.103:0/3026561115 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 61986262 0 0) 0x7f953014a880 con 0x7f953014a400 2020-04-22T14:16:23.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.924+0000 7f951ffff700 1 -- 172.21.15.103:0/3026561115 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95300b3300 con 0x7f953014a400 2020-04-22T14:16:23.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.924+0000 7f953596f700 1 -- 172.21.15.103:0/3026561115 >> v1:172.21.15.103:6789/0 conn(0x7f95301405c0 legacy=0x7f95300b1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:23.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.924+0000 7f953596f700 1 -- 172.21.15.103:0/3026561115 >> v1:172.21.15.86:6789/0 conn(0x7f953014a400 legacy=0x7f9530061f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:23.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.924+0000 7f953596f700 1 -- 172.21.15.103:0/3026561115 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95301463b0 con 0x7f95301468c0 2020-04-22T14:16:23.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.924+0000 7f953596f700 1 --2- 172.21.15.103:0/3026561115 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f95301468c0 0x7f9530146d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f952c0032b0 tx=0x7f952c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:23.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.924+0000 7f953596f700 1 --2- 172.21.15.103:0/3026561115 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f95301468c0 0x7f9530146d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f952c0032b0 tx=0x7f952c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:23.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.924+0000 7f953596f700 1 --2- 172.21.15.103:0/3026561115 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f95301468c0 0x7f9530146d70 secure :-1 s=READY pgs=158 cs=0 l=1 rx=0x7f952c0032b0 tx=0x7f952c008c60).ready entity=mon.2 client_cookie=781e51b03c92b1fa server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:23.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.924+0000 7f953596f700 1 --2- 172.21.15.103:0/3026561115 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f95301468c0 0x7f9530146d70 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7f952c0032b0 tx=0x7f952c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:23.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.924+0000 7f951ffff700 1 -- 172.21.15.103:0/3026561115 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f952c011db0 con 0x7f95301468c0 2020-04-22T14:16:23.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.924+0000 7f953596f700 1 --2- 172.21.15.103:0/3026561115 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f95301468c0 0x7f9530146d70 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7f952c0032b0 tx=0x7f952c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:23.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.925+0000 7f953596f700 1 --2- 172.21.15.103:0/3026561115 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f95301468c0 0x7f9530146d70 secure :-1 s=THROTTLE_DONE pgs=158 cs=0 l=1 rx=0x7f952c0032b0 tx=0x7f952c008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:23.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.925+0000 7f951ffff700 1 -- 172.21.15.103:0/3026561115 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952c00a180 con 0x7f95301468c0 2020-04-22T14:16:23.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.925+0000 7f951ffff700 1 -- 172.21.15.103:0/3026561115 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f952c00a5a0 con 0x7f95301468c0 2020-04-22T14:16:23.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.925+0000 7f95373d2700 1 -- 172.21.15.103:0/3026561115 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f95301468c0 msgr2=0x7f9530146d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:23.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.925+0000 7f95373d2700 1 --2- 172.21.15.103:0/3026561115 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f95301468c0 0x7f9530146d70 secure :-1 s=READY pgs=158 cs=0 l=1 rx=0x7f952c0032b0 tx=0x7f952c008c60).stop 2020-04-22T14:16:23.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.925+0000 7f95373d2700 1 -- 172.21.15.103:0/3026561115 shutdown_connections 2020-04-22T14:16:23.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.925+0000 7f95373d2700 1 --2- 172.21.15.103:0/3026561115 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f95301468c0 0x7f9530146d70 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:23.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.925+0000 7f95373d2700 1 -- 172.21.15.103:0/3026561115 >> 172.21.15.103:0/3026561115 conn(0x7f953005ad30 msgr2=0x7f953005f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:23.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.925+0000 7f95373d2700 1 -- 172.21.15.103:0/3026561115 shutdown_connections 2020-04-22T14:16:23.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.925+0000 7f95373d2700 1 -- 172.21.15.103:0/3026561115 wait complete. 2020-04-22T14:16:23.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.926+0000 7f95373d2700 1 Processor -- start 2020-04-22T14:16:23.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.926+0000 7f95373d2700 1 -- start start 2020-04-22T14:16:23.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.927+0000 7f95373d2700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f95301405c0 0x7f95300b6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:23.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.927+0000 7f95373d2700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f953014a400 0x7f9530142d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:23.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.927+0000 7f95373d2700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95300b7e20 con 0x7f95301468c0 2020-04-22T14:16:23.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.927+0000 7f95373d2700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9530142990 con 0x7f95301405c0 2020-04-22T14:16:23.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.927+0000 7f95373d2700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9530062cc0 con 0x7f953014a400 2020-04-22T14:16:23.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.927+0000 7f953516e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f95301405c0 0x7f95300b6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:23.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.927+0000 7f953516e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f95301405c0 0x7f95300b6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:53480/0 (socket says 172.21.15.103:53480) 2020-04-22T14:16:23.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.927+0000 7f953516e700 1 -- 172.21.15.103:0/4051186654 learned_addr learned my addr 172.21.15.103:0/4051186654 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:23.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.927+0000 7f953596f700 1 --2- 172.21.15.103:0/4051186654 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f953014a400 0x7f9530142d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:23.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.927+0000 7f951e7fc700 1 -- 172.21.15.103:0/4051186654 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3237411622 0 0) 0x7f95300b7e20 con 0x7f95301468c0 2020-04-22T14:16:23.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.927+0000 7f953596f700 1 -- 172.21.15.103:0/4051186654 >> v2:172.21.15.86:3300/0 conn(0x7f95301405c0 msgr2=0x7f95300b6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:23.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.927+0000 7f953596f700 1 --2- 172.21.15.103:0/4051186654 >> v2:172.21.15.86:3300/0 conn(0x7f95301405c0 0x7f95300b6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:23.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.927+0000 7f953596f700 1 -- 172.21.15.103:0/4051186654 >> v1:172.21.15.103:6789/0 conn(0x7f95301468c0 legacy=0x7f9530142280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:23.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.927+0000 7f953596f700 1 -- 172.21.15.103:0/4051186654 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9530062f60 con 0x7f953014a400 2020-04-22T14:16:23.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.927+0000 7f953596f700 1 --2- 172.21.15.103:0/4051186654 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f953014a400 0x7f9530142d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f952c0032b0 tx=0x7f9530061ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:23.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.928+0000 7f953596f700 1 --2- 172.21.15.103:0/4051186654 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f953014a400 0x7f9530142d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f952c0032b0 tx=0x7f9530061ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:23.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.928+0000 7f953596f700 1 --2- 172.21.15.103:0/4051186654 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f953014a400 0x7f9530142d40 secure :-1 s=READY pgs=159 cs=0 l=1 rx=0x7f952c0032b0 tx=0x7f9530061ea0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:23.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.928+0000 7f953596f700 1 --2- 172.21.15.103:0/4051186654 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f953014a400 0x7f9530142d40 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f952c0032b0 tx=0x7f9530061ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:23.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.928+0000 7f953596f700 1 --2- 172.21.15.103:0/4051186654 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f953014a400 0x7f9530142d40 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f952c0032b0 tx=0x7f9530061ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:23.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.928+0000 7f953596f700 1 --2- 172.21.15.103:0/4051186654 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f953014a400 0x7f9530142d40 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f952c0032b0 tx=0x7f9530061ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:23.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.928+0000 7f951e7fc700 1 -- 172.21.15.103:0/4051186654 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f952c010440 con 0x7f953014a400 2020-04-22T14:16:23.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.928+0000 7f951e7fc700 1 -- 172.21.15.103:0/4051186654 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952c005c30 con 0x7f953014a400 2020-04-22T14:16:23.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.928+0000 7f95373d2700 1 -- 172.21.15.103:0/4051186654 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9530143720 con 0x7f953014a400 2020-04-22T14:16:23.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.928+0000 7f951e7fc700 1 -- 172.21.15.103:0/4051186654 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f952c007170 con 0x7f953014a400 2020-04-22T14:16:23.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.928+0000 7f95373d2700 1 -- 172.21.15.103:0/4051186654 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95301487e0 con 0x7f953014a400 2020-04-22T14:16:23.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.929+0000 7f953596f700 1 --2- 172.21.15.103:0/4051186654 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f953014a400 0x7f9530142d40 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f952c0032b0 tx=0x7f9530061ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:23.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.930+0000 7f95373d2700 1 -- 172.21.15.103:0/4051186654 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f950c003340 con 0x7f953014a400 2020-04-22T14:16:23.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.930+0000 7f951e7fc700 1 -- 172.21.15.103:0/4051186654 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f952c0072d0 con 0x7f953014a400 2020-04-22T14:16:23.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.930+0000 7f953596f700 1 --2- 172.21.15.103:0/4051186654 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f953014a400 0x7f9530142d40 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f952c0032b0 tx=0x7f9530061ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:23.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.930+0000 7f951e7fc700 1 --2- 172.21.15.103:0/4051186654 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f951004d900 0x7f951004fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:23.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.930+0000 7f951e7fc700 1 -- 172.21.15.103:0/4051186654 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f952c062300 con 0x7f953014a400 2020-04-22T14:16:23.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.930+0000 7f953516e700 1 --2- 172.21.15.103:0/4051186654 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f951004d900 0x7f951004fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:23.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.930+0000 7f953516e700 1 --2- 172.21.15.103:0/4051186654 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f951004d900 0x7f951004fdc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f95280010d0 tx=0x7f9528001e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:23.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.931+0000 7f953516e700 1 --2- 172.21.15.103:0/4051186654 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f951004d900 0x7f951004fdc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f95280010d0 tx=0x7f9528001e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:23.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.931+0000 7f953516e700 1 --2- 172.21.15.103:0/4051186654 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f951004d900 0x7f951004fdc0 secure :-1 s=READY pgs=606 cs=0 l=1 rx=0x7f95280010d0 tx=0x7f9528001e00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:23.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.923+0000 7f87a637c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f87a00b4320 0x7f87a00b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:23.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.923+0000 7f87a637c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87a00b2530 0x7f87a00b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:23.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.923+0000 7f87a637c700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a00b0e90 con 0x7f87a00b4700 2020-04-22T14:16:23.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.923+0000 7f87a637c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87a00b2ac0 con 0x7f87a00b4320 2020-04-22T14:16:23.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.923+0000 7f87a637c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87a00b1130 con 0x7f87a00b2530 2020-04-22T14:16:23.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.923+0000 7f87a4919700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87a00b2530 0x7f87a00b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:23.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.923+0000 7f879ffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f87a00b4320 0x7f87a00b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:23.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.923+0000 7f879f7fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f87a00b4700 0x7f87a00afa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:37344/0 (socket says 172.21.15.103:37344) 2020-04-22T14:16:23.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.923+0000 7f879f7fe700 1 -- 172.21.15.103:0/162247977 learned_addr learned my addr 172.21.15.103:0/162247977 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:23.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.924+0000 7f879ffff700 1 -- 172.21.15.103:0/162247977 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87a00b2530 msgr2=0x7f87a00b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:23.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.924+0000 7f879ffff700 1 --2- 172.21.15.103:0/162247977 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87a00b2530 0x7f87a00b0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:23.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.924+0000 7f879ffff700 1 -- 172.21.15.103:0/162247977 >> v1:172.21.15.86:6789/0 conn(0x7f87a00b4700 legacy=0x7f87a00afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:23.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.924+0000 7f879ffff700 1 -- 172.21.15.103:0/162247977 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a00ae500 con 0x7f87a00b4320 2020-04-22T14:16:23.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.924+0000 7f879ffff700 1 --2- 172.21.15.103:0/162247977 >> v2:172.21.15.86:3300/0 conn(0x7f87a00b4320 0x7f87a00b15d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8790002f30 tx=0x7f8790007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:23.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.924+0000 7f879ffff700 1 --2- 172.21.15.103:0/162247977 >> v2:172.21.15.86:3300/0 conn(0x7f87a00b4320 0x7f87a00b15d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8790002f30 tx=0x7f8790007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:23.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.924+0000 7f879ffff700 1 --2- 172.21.15.103:0/162247977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87a00b4320 0x7f87a00b15d0 secure :-1 s=READY pgs=894 cs=0 l=1 rx=0x7f8790002f30 tx=0x7f8790007a40).ready entity=mon.0 client_cookie=87dedaca5062f34d server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:23.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.924+0000 7f879ffff700 1 --2- 172.21.15.103:0/162247977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87a00b4320 0x7f87a00b15d0 secure :-1 s=THROTTLE_DONE pgs=894 cs=0 l=1 rx=0x7f8790002f30 tx=0x7f8790007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:23.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.924+0000 7f879effd700 1 -- 172.21.15.103:0/162247977 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87900113c0 con 0x7f87a00b4320 2020-04-22T14:16:23.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.924+0000 7f879ffff700 1 --2- 172.21.15.103:0/162247977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87a00b4320 0x7f87a00b15d0 secure :-1 s=THROTTLE_DONE pgs=894 cs=0 l=1 rx=0x7f8790002f30 tx=0x7f8790007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:23.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.924+0000 7f879effd700 1 -- 172.21.15.103:0/162247977 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8790011560 con 0x7f87a00b4320 2020-04-22T14:16:23.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.924+0000 7f879ffff700 1 --2- 172.21.15.103:0/162247977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87a00b4320 0x7f87a00b15d0 secure :-1 s=THROTTLE_DONE pgs=894 cs=0 l=1 rx=0x7f8790002f30 tx=0x7f8790007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:23.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.924+0000 7f879effd700 1 -- 172.21.15.103:0/162247977 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8790011980 con 0x7f87a00b4320 2020-04-22T14:16:23.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.924+0000 7f87a637c700 1 -- 172.21.15.103:0/162247977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87a00b4320 msgr2=0x7f87a00b15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:23.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.924+0000 7f87a637c700 1 --2- 172.21.15.103:0/162247977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87a00b4320 0x7f87a00b15d0 secure :-1 s=READY pgs=894 cs=0 l=1 rx=0x7f8790002f30 tx=0x7f8790007a40).stop 2020-04-22T14:16:23.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.925+0000 7f87a637c700 1 -- 172.21.15.103:0/162247977 shutdown_connections 2020-04-22T14:16:23.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.925+0000 7f87a637c700 1 --2- 172.21.15.103:0/162247977 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87a00b2530 0x7f87a00b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:23.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.925+0000 7f87a637c700 1 --2- 172.21.15.103:0/162247977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87a00b4320 0x7f87a00b15d0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:23.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.925+0000 7f87a637c700 1 -- 172.21.15.103:0/162247977 >> 172.21.15.103:0/162247977 conn(0x7f87a00b86b0 msgr2=0x7f87a00b8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:23.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.925+0000 7f87a637c700 1 -- 172.21.15.103:0/162247977 shutdown_connections 2020-04-22T14:16:23.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.925+0000 7f87a637c700 1 -- 172.21.15.103:0/162247977 wait complete. 2020-04-22T14:16:23.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.926+0000 7f87a637c700 1 Processor -- start 2020-04-22T14:16:23.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.926+0000 7f87a637c700 1 -- start start 2020-04-22T14:16:23.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.927+0000 7f87a637c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f87a00b4320 0x7f87a00b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:23.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.927+0000 7f87a637c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f87a00b4700 0x7f87a0143d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:23.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.927+0000 7f87a637c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a0141c60 con 0x7f87a00b2530 2020-04-22T14:16:23.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.927+0000 7f87a637c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87a0141a50 con 0x7f87a00b4320 2020-04-22T14:16:23.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.927+0000 7f87a637c700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87a0145160 con 0x7f87a00b4700 2020-04-22T14:16:23.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.927+0000 7f879ffff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f87a00b2530 0x7f87a013ce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48432/0 (socket says 172.21.15.103:48432) 2020-04-22T14:16:23.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.927+0000 7f879ffff700 1 -- 172.21.15.103:0/340485113 learned_addr learned my addr 172.21.15.103:0/340485113 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:23.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.927+0000 7f87a4919700 1 --2- 172.21.15.103:0/340485113 >> v2:172.21.15.103:3300/0 conn(0x7f87a00b4700 0x7f87a0143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:23.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.927+0000 7f879f7fe700 1 --2- 172.21.15.103:0/340485113 >> v2:172.21.15.86:3300/0 conn(0x7f87a00b4320 0x7f87a00b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:23.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.927+0000 7f87a4919700 1 -- 172.21.15.103:0/340485113 >> v2:172.21.15.86:3300/0 conn(0x7f87a00b4320 msgr2=0x7f87a00b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:23.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.927+0000 7f87a4919700 1 --2- 172.21.15.103:0/340485113 >> v2:172.21.15.86:3300/0 conn(0x7f87a00b4320 0x7f87a00b33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:23.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.927+0000 7f879d7fa700 1 -- 172.21.15.103:0/340485113 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1147065340 0 0) 0x7f87a0141c60 con 0x7f87a00b2530 2020-04-22T14:16:23.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.927+0000 7f87a4919700 1 -- 172.21.15.103:0/340485113 >> v1:172.21.15.103:6789/0 conn(0x7f87a00b2530 legacy=0x7f87a013ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:23.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.927+0000 7f87a4919700 1 -- 172.21.15.103:0/340485113 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a0144190 con 0x7f87a00b4700 2020-04-22T14:16:23.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.927+0000 7f87a4919700 1 --2- 172.21.15.103:0/340485113 >> v2:172.21.15.103:3300/0 conn(0x7f87a00b4700 0x7f87a0143d30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f87980032b0 tx=0x7f8798010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:23.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.927+0000 7f87a4919700 1 --2- 172.21.15.103:0/340485113 >> v2:172.21.15.103:3300/0 conn(0x7f87a00b4700 0x7f87a0143d30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f87980032b0 tx=0x7f8798010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:23.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.927+0000 7f87a4919700 1 --2- 172.21.15.103:0/340485113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87a00b4700 0x7f87a0143d30 secure :-1 s=READY pgs=1669 cs=0 l=1 rx=0x7f87980032b0 tx=0x7f8798010ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:23.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.927+0000 7f87a4919700 1 --2- 172.21.15.103:0/340485113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87a00b4700 0x7f87a0143d30 secure :-1 s=THROTTLE_DONE pgs=1669 cs=0 l=1 rx=0x7f87980032b0 tx=0x7f8798010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:23.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.927+0000 7f879d7fa700 1 -- 172.21.15.103:0/340485113 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f879800e370 con 0x7f87a00b4700 2020-04-22T14:16:23.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.928+0000 7f87a4919700 1 --2- 172.21.15.103:0/340485113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87a00b4700 0x7f87a0143d30 secure :-1 s=THROTTLE_DONE pgs=1669 cs=0 l=1 rx=0x7f87980032b0 tx=0x7f8798010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:23.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.928+0000 7f879d7fa700 1 -- 172.21.15.103:0/340485113 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8798005c30 con 0x7f87a00b4700 2020-04-22T14:16:23.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.928+0000 7f87a4919700 1 --2- 172.21.15.103:0/340485113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87a00b4700 0x7f87a0143d30 secure :-1 s=THROTTLE_DONE pgs=1669 cs=0 l=1 rx=0x7f87980032b0 tx=0x7f8798010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:23.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.928+0000 7f87a637c700 1 -- 172.21.15.103:0/340485113 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87a0065cc0 con 0x7f87a00b4700 2020-04-22T14:16:23.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.928+0000 7f879d7fa700 1 -- 172.21.15.103:0/340485113 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8798012910 con 0x7f87a00b4700 2020-04-22T14:16:23.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.928+0000 7f87a637c700 1 -- 172.21.15.103:0/340485113 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87a013d510 con 0x7f87a00b4700 2020-04-22T14:16:23.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.928+0000 7f87a4919700 1 --2- 172.21.15.103:0/340485113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87a00b4700 0x7f87a0143d30 secure :-1 s=THROTTLE_DONE pgs=1669 cs=0 l=1 rx=0x7f87980032b0 tx=0x7f8798010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:23.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.929+0000 7f87a637c700 1 -- 172.21.15.103:0/340485113 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87a0141830 con 0x7f87a00b4700 2020-04-22T14:16:23.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.929+0000 7f879d7fa700 1 -- 172.21.15.103:0/340485113 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f8798012b10 con 0x7f87a00b4700 2020-04-22T14:16:23.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.929+0000 7f87a4919700 1 --2- 172.21.15.103:0/340485113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87a00b4700 0x7f87a0143d30 secure :-1 s=THROTTLE_DONE pgs=1669 cs=0 l=1 rx=0x7f87980032b0 tx=0x7f8798010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:23.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.929+0000 7f879d7fa700 1 --2- 172.21.15.103:0/340485113 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f878004d820 0x7f878004fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:23.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.929+0000 7f879d7fa700 1 -- 172.21.15.103:0/340485113 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8798061260 con 0x7f87a00b4700 2020-04-22T14:16:23.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.929+0000 7f879ffff700 1 --2- 172.21.15.103:0/340485113 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f878004d820 0x7f878004fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:23.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.930+0000 7f879ffff700 1 --2- 172.21.15.103:0/340485113 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f878004d820 0x7f878004fce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f87900082e0 tx=0x7f8790007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:23.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.930+0000 7f879ffff700 1 --2- 172.21.15.103:0/340485113 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f878004d820 0x7f878004fce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f87900082e0 tx=0x7f8790007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:23.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.930+0000 7f879ffff700 1 --2- 172.21.15.103:0/340485113 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f878004d820 0x7f878004fce0 secure :-1 s=READY pgs=605 cs=0 l=1 rx=0x7f87900082e0 tx=0x7f8790007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:23.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.933+0000 7f953596f700 1 --2- 172.21.15.103:0/4051186654 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f953014a400 0x7f9530142d40 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f952c0032b0 tx=0x7f9530061ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:23.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.934+0000 7f951e7fc700 1 -- 172.21.15.103:0/4051186654 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f952c03d680 con 0x7f953014a400 2020-04-22T14:16:23.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.934+0000 7f87a4919700 1 --2- 172.21.15.103:0/340485113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87a00b4700 0x7f87a0143d30 secure :-1 s=THROTTLE_DONE pgs=1669 cs=0 l=1 rx=0x7f87980032b0 tx=0x7f8798010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:23.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:23.934+0000 7f879d7fa700 1 -- 172.21.15.103:0/340485113 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f879803c6a0 con 0x7f87a00b4700 2020-04-22T14:16:24.032 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:16:24.049 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:16:24.091 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:24.105 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:16:24.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.134+0000 7f87a637c700 1 -- 172.21.15.103:0/340485113 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7f87a0056c90 con 0x7f87a00b4700 2020-04-22T14:16:24.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.136+0000 7f95373d2700 1 -- 172.21.15.103:0/4051186654 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7f950c0021d0 con 0x7f953014a400 2020-04-22T14:16:24.629 INFO:tasks.ceph.mon.b.smithi086.stderr:2020-04-22T14:16:24.626+0000 7fbdbf880700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-04-22T14:16:24.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.633+0000 7f953596f700 1 --2- 172.21.15.103:0/4051186654 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f953014a400 0x7f9530142d40 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f952c0032b0 tx=0x7f9530061ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:24.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.633+0000 7f951e7fc700 1 -- 172.21.15.103:0/4051186654 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 8470 v83) v1 ==== 95+0+0 (secure 0 0 0) 0x7f952c040ca0 con 0x7f953014a400 2020-04-22T14:16:24.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.634+0000 7f87a4919700 1 --2- 172.21.15.103:0/340485113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87a00b4700 0x7f87a0143d30 secure :-1 s=THROTTLE_DONE pgs=1669 cs=0 l=1 rx=0x7f87980032b0 tx=0x7f8798010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:24.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.634+0000 7f879d7fa700 1 -- 172.21.15.103:0/340485113 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 7776 v83) v1 ==== 95+0+0 (secure 0 0 0) 0x7f879803fcc0 con 0x7f87a00b4700 2020-04-22T14:16:24.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.635+0000 7f95373d2700 1 -- 172.21.15.103:0/4051186654 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f951004d900 msgr2=0x7f951004fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:24.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.635+0000 7f95373d2700 1 --2- 172.21.15.103:0/4051186654 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f951004d900 0x7f951004fdc0 secure :-1 s=READY pgs=606 cs=0 l=1 rx=0x7f95280010d0 tx=0x7f9528001e00).stop 2020-04-22T14:16:24.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.635+0000 7f95373d2700 1 -- 172.21.15.103:0/4051186654 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f953014a400 msgr2=0x7f9530142d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:24.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.635+0000 7f95373d2700 1 --2- 172.21.15.103:0/4051186654 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f953014a400 0x7f9530142d40 secure :-1 s=READY pgs=159 cs=0 l=1 rx=0x7f952c0032b0 tx=0x7f9530061ea0).stop 2020-04-22T14:16:24.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.635+0000 7f95373d2700 1 -- 172.21.15.103:0/4051186654 shutdown_connections 2020-04-22T14:16:24.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.635+0000 7f95373d2700 1 --2- 172.21.15.103:0/4051186654 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f953014a400 0x7f9530142d40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:24.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.635+0000 7f95373d2700 1 --2- 172.21.15.103:0/4051186654 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f951004d900 0x7f951004fdc0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:24.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.635+0000 7f95373d2700 1 --2- 172.21.15.103:0/4051186654 >> v2:172.21.15.86:3300/0 conn(0x7f95301405c0 0x7f95300b6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:24.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.635+0000 7f95373d2700 1 -- 172.21.15.103:0/4051186654 >> 172.21.15.103:0/4051186654 conn(0x7f953005ad30 msgr2=0x7f95300b5900 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:24.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.635+0000 7f95373d2700 1 -- 172.21.15.103:0/4051186654 shutdown_connections 2020-04-22T14:16:24.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.635+0000 7f95373d2700 1 -- 172.21.15.103:0/4051186654 wait complete. 2020-04-22T14:16:24.641 INFO:teuthology.orchestra.run.smithi103.stderr:failed mds gid 8470 2020-04-22T14:16:24.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.636+0000 7f87a637c700 1 -- 172.21.15.103:0/340485113 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f878004d820 msgr2=0x7f878004fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:24.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.636+0000 7f87a637c700 1 --2- 172.21.15.103:0/340485113 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f878004d820 0x7f878004fce0 secure :-1 s=READY pgs=605 cs=0 l=1 rx=0x7f87900082e0 tx=0x7f8790007a40).stop 2020-04-22T14:16:24.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.636+0000 7f87a637c700 1 -- 172.21.15.103:0/340485113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87a00b4700 msgr2=0x7f87a0143d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:24.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.636+0000 7f87a637c700 1 --2- 172.21.15.103:0/340485113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87a00b4700 0x7f87a0143d30 secure :-1 s=READY pgs=1669 cs=0 l=1 rx=0x7f87980032b0 tx=0x7f8798010ec0).stop 2020-04-22T14:16:24.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.636+0000 7f87a637c700 1 -- 172.21.15.103:0/340485113 shutdown_connections 2020-04-22T14:16:24.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.636+0000 7f87a637c700 1 --2- 172.21.15.103:0/340485113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87a00b4700 0x7f87a0143d30 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:24.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.636+0000 7f87a637c700 1 --2- 172.21.15.103:0/340485113 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f878004d820 0x7f878004fce0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:24.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.636+0000 7f87a637c700 1 --2- 172.21.15.103:0/340485113 >> v2:172.21.15.86:3300/0 conn(0x7f87a00b4320 0x7f87a00b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:24.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.636+0000 7f87a637c700 1 -- 172.21.15.103:0/340485113 >> 172.21.15.103:0/340485113 conn(0x7f87a00b86b0 msgr2=0x7f87a0140060 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:24.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.636+0000 7f87a637c700 1 -- 172.21.15.103:0/340485113 shutdown_connections 2020-04-22T14:16:24.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.636+0000 7f87a637c700 1 -- 172.21.15.103:0/340485113 wait complete. 2020-04-22T14:16:24.646 INFO:teuthology.orchestra.run.smithi103.stderr:failed mds gid 7776 2020-04-22T14:16:24.656 INFO:tasks.ceph.mds.a:Restarting daemon 2020-04-22T14:16:24.656 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:24.657 INFO:tasks.ceph.mds.b:Restarting daemon 2020-04-22T14:16:24.657 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:16:24.671 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-04-22T14:16:24.673 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-04-22T14:16:24.713 INFO:tasks.ceph.mds.a:Started 2020-04-22T14:16:24.713 DEBUG:teuthology.parallel:result is None 2020-04-22T14:16:24.715 INFO:tasks.ceph.mds.b:Started 2020-04-22T14:16:24.715 DEBUG:teuthology.parallel:result is None 2020-04-22T14:16:24.716 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:24.730 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:16:24.790 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2020-04-22T14:16:24.796 INFO:tasks.ceph.mds.b.smithi086.stdout:starting mds.b at 2020-04-22T14:16:24.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.875+0000 7faf6359e700 1 Processor -- start 2020-04-22T14:16:24.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.875+0000 7faf6359e700 1 -- start start 2020-04-22T14:16:24.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.875+0000 7faf6359e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7faf640ad150 0x7faf640664a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:24.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.875+0000 7faf6359e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faf64141c10 0x7faf64142070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:24.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.875+0000 7faf6359e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf64066a20 con 0x7faf641424d0 2020-04-22T14:16:24.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.875+0000 7faf6359e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf640adf30 con 0x7faf640ad150 2020-04-22T14:16:24.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.875+0000 7faf6359e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf640ad7f0 con 0x7faf64141c10 2020-04-22T14:16:24.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.876+0000 7faf62d9d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7faf641424d0 0x7faf64063340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48464/0 (socket says 172.21.15.103:48464) 2020-04-22T14:16:24.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.876+0000 7faf62d9d700 1 -- 172.21.15.103:0/3361459615 learned_addr learned my addr 172.21.15.103:0/3361459615 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:24.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.876+0000 7faf61d9b700 1 --2- 172.21.15.103:0/3361459615 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faf64141c10 0x7faf64142070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:24.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.876+0000 7faf6259c700 1 --2- 172.21.15.103:0/3361459615 >> v2:172.21.15.86:3300/0 conn(0x7faf640ad150 0x7faf640664a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:24.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.876+0000 7faf6159a700 1 -- 172.21.15.103:0/3361459615 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3847138705 0 0) 0x7faf64066a20 con 0x7faf641424d0 2020-04-22T14:16:24.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.876+0000 7faf6159a700 1 -- 172.21.15.103:0/3361459615 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf44003230 con 0x7faf641424d0 2020-04-22T14:16:24.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.876+0000 7faf6159a700 1 -- 172.21.15.103:0/3361459615 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 537825216 0 0) 0x7faf44003230 con 0x7faf641424d0 2020-04-22T14:16:24.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.876+0000 7faf61d9b700 1 -- 172.21.15.103:0/3361459615 >> v2:172.21.15.86:3300/0 conn(0x7faf640ad150 msgr2=0x7faf640664a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:24.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.876+0000 7faf61d9b700 1 --2- 172.21.15.103:0/3361459615 >> v2:172.21.15.86:3300/0 conn(0x7faf640ad150 0x7faf640664a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:24.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.876+0000 7faf61d9b700 1 -- 172.21.15.103:0/3361459615 >> v1:172.21.15.103:6789/0 conn(0x7faf641424d0 legacy=0x7faf64063340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:24.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.876+0000 7faf61d9b700 1 -- 172.21.15.103:0/3361459615 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf640ada90 con 0x7faf64141c10 2020-04-22T14:16:24.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.876+0000 7faf6259c700 1 --2- 172.21.15.103:0/3361459615 >> v2:172.21.15.86:3300/0 conn(0x7faf640ad150 0x7faf640664a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:16:24.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.876+0000 7faf61d9b700 1 --2- 172.21.15.103:0/3361459615 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faf64141c10 0x7faf64142070 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7faf5c001bf0 tx=0x7faf4c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:24.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.876+0000 7faf61d9b700 1 --2- 172.21.15.103:0/3361459615 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faf64141c10 0x7faf64142070 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7faf5c001bf0 tx=0x7faf4c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:24.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.876+0000 7faf61d9b700 1 --2- 172.21.15.103:0/3361459615 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faf64141c10 0x7faf64142070 secure :-1 s=READY pgs=162 cs=0 l=1 rx=0x7faf5c001bf0 tx=0x7faf4c007a40).ready entity=mon.2 client_cookie=e882a2470ed0fe28 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:24.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.876+0000 7faf61d9b700 1 --2- 172.21.15.103:0/3361459615 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faf64141c10 0x7faf64142070 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7faf5c001bf0 tx=0x7faf4c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:24.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.876+0000 7faf6159a700 1 -- 172.21.15.103:0/3361459615 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf5c001a50 con 0x7faf64141c10 2020-04-22T14:16:24.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.876+0000 7faf61d9b700 1 --2- 172.21.15.103:0/3361459615 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faf64141c10 0x7faf64142070 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7faf5c001bf0 tx=0x7faf4c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:24.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.876+0000 7faf6159a700 1 -- 172.21.15.103:0/3361459615 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4c008b40 con 0x7faf64141c10 2020-04-22T14:16:24.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.876+0000 7faf61d9b700 1 --2- 172.21.15.103:0/3361459615 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faf64141c10 0x7faf64142070 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7faf5c001bf0 tx=0x7faf4c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:24.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.876+0000 7faf6159a700 1 -- 172.21.15.103:0/3361459615 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf4c0115a0 con 0x7faf64141c10 2020-04-22T14:16:24.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.876+0000 7faf6359e700 1 -- 172.21.15.103:0/3361459615 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faf64141c10 msgr2=0x7faf64142070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:24.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.876+0000 7faf6359e700 1 --2- 172.21.15.103:0/3361459615 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faf64141c10 0x7faf64142070 secure :-1 s=READY pgs=162 cs=0 l=1 rx=0x7faf5c001bf0 tx=0x7faf4c007a40).stop 2020-04-22T14:16:24.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.877+0000 7faf6359e700 1 -- 172.21.15.103:0/3361459615 shutdown_connections 2020-04-22T14:16:24.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.877+0000 7faf6359e700 1 --2- 172.21.15.103:0/3361459615 >> v2:172.21.15.86:3300/0 conn(0x7faf640ad150 0x7faf640664a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:24.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.877+0000 7faf6359e700 1 --2- 172.21.15.103:0/3361459615 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faf64141c10 0x7faf64142070 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:24.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.877+0000 7faf6359e700 1 -- 172.21.15.103:0/3361459615 >> 172.21.15.103:0/3361459615 conn(0x7faf6405b7c0 msgr2=0x7faf64061610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:24.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.877+0000 7faf6359e700 1 -- 172.21.15.103:0/3361459615 shutdown_connections 2020-04-22T14:16:24.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.877+0000 7faf6359e700 1 -- 172.21.15.103:0/3361459615 wait complete. 2020-04-22T14:16:24.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.878+0000 7faf6359e700 1 Processor -- start 2020-04-22T14:16:24.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.878+0000 7faf6359e700 1 -- start start 2020-04-22T14:16:24.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.879+0000 7faf6359e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7faf640ad150 0x7faf6413a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:24.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.879+0000 7faf6359e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7faf641424d0 0x7faf6413c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:24.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.879+0000 7faf6359e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf64138030 con 0x7faf64141c10 2020-04-22T14:16:24.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.879+0000 7faf6359e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf641368a0 con 0x7faf641424d0 2020-04-22T14:16:24.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.879+0000 7faf6359e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf6413cbb0 con 0x7faf640ad150 2020-04-22T14:16:24.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.879+0000 7faf6259c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7faf640ad150 0x7faf6413a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:24.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.879+0000 7faf6259c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7faf640ad150 0x7faf6413a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56280/0 (socket says 172.21.15.103:56280) 2020-04-22T14:16:24.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.879+0000 7faf6259c700 1 -- 172.21.15.103:0/2466234847 learned_addr learned my addr 172.21.15.103:0/2466234847 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:24.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.879+0000 7faf62d9d700 1 --2- 172.21.15.103:0/2466234847 >> v2:172.21.15.86:3300/0 conn(0x7faf641424d0 0x7faf6413c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:24.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.879+0000 7faf6259c700 1 -- 172.21.15.103:0/2466234847 >> v2:172.21.15.86:3300/0 conn(0x7faf641424d0 msgr2=0x7faf6413c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:24.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.879+0000 7faf6259c700 1 --2- 172.21.15.103:0/2466234847 >> v2:172.21.15.86:3300/0 conn(0x7faf641424d0 0x7faf6413c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:24.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.879+0000 7faf6259c700 1 -- 172.21.15.103:0/2466234847 >> v1:172.21.15.86:6789/0 conn(0x7faf64141c10 legacy=0x7faf640b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:24.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.879+0000 7faf6259c700 1 -- 172.21.15.103:0/2466234847 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf64138260 con 0x7faf640ad150 2020-04-22T14:16:24.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.879+0000 7faf6259c700 1 --2- 172.21.15.103:0/2466234847 >> v2:172.21.15.103:3300/0 conn(0x7faf640ad150 0x7faf6413a1a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faf54002ef0 tx=0x7faf54010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:24.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.879+0000 7faf6259c700 1 --2- 172.21.15.103:0/2466234847 >> v2:172.21.15.103:3300/0 conn(0x7faf640ad150 0x7faf6413a1a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faf54002ef0 tx=0x7faf54010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:24.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.879+0000 7faf6259c700 1 --2- 172.21.15.103:0/2466234847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf640ad150 0x7faf6413a1a0 secure :-1 s=READY pgs=1676 cs=0 l=1 rx=0x7faf54002ef0 tx=0x7faf54010eb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:24.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.879+0000 7faf6259c700 1 --2- 172.21.15.103:0/2466234847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf640ad150 0x7faf6413a1a0 secure :-1 s=THROTTLE_DONE pgs=1676 cs=0 l=1 rx=0x7faf54002ef0 tx=0x7faf54010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:24.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.879+0000 7faf5b7fe700 1 -- 172.21.15.103:0/2466234847 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf54007560 con 0x7faf640ad150 2020-04-22T14:16:24.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.879+0000 7faf6259c700 1 --2- 172.21.15.103:0/2466234847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf640ad150 0x7faf6413a1a0 secure :-1 s=THROTTLE_DONE pgs=1676 cs=0 l=1 rx=0x7faf54002ef0 tx=0x7faf54010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:24.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.879+0000 7faf6259c700 1 --2- 172.21.15.103:0/2466234847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf640ad150 0x7faf6413a1a0 secure :-1 s=THROTTLE_DONE pgs=1676 cs=0 l=1 rx=0x7faf54002ef0 tx=0x7faf54010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:24.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.879+0000 7faf5b7fe700 1 -- 172.21.15.103:0/2466234847 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf54005a60 con 0x7faf640ad150 2020-04-22T14:16:24.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.879+0000 7faf6359e700 1 -- 172.21.15.103:0/2466234847 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf6413cf40 con 0x7faf640ad150 2020-04-22T14:16:24.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.879+0000 7faf5b7fe700 1 -- 172.21.15.103:0/2466234847 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf54005e40 con 0x7faf640ad150 2020-04-22T14:16:24.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.879+0000 7faf6359e700 1 -- 172.21.15.103:0/2466234847 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf64065510 con 0x7faf640ad150 2020-04-22T14:16:24.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.880+0000 7faf6259c700 1 --2- 172.21.15.103:0/2466234847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf640ad150 0x7faf6413a1a0 secure :-1 s=THROTTLE_DONE pgs=1676 cs=0 l=1 rx=0x7faf54002ef0 tx=0x7faf54010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:24.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.880+0000 7faf5b7fe700 1 -- 172.21.15.103:0/2466234847 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7faf540101a0 con 0x7faf640ad150 2020-04-22T14:16:24.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.880+0000 7faf6259c700 1 --2- 172.21.15.103:0/2466234847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf640ad150 0x7faf6413a1a0 secure :-1 s=THROTTLE_DONE pgs=1676 cs=0 l=1 rx=0x7faf54002ef0 tx=0x7faf54010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:24.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.880+0000 7faf6359e700 1 -- 172.21.15.103:0/2466234847 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf64056c90 con 0x7faf640ad150 2020-04-22T14:16:24.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.881+0000 7faf5b7fe700 1 --2- 172.21.15.103:0/2466234847 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faf4804d9e0 0x7faf4804fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:24.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.881+0000 7faf5b7fe700 1 -- 172.21.15.103:0/2466234847 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6159+0+0 (secure 0 0 0) 0x7faf54061650 con 0x7faf640ad150 2020-04-22T14:16:24.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.881+0000 7faf61d9b700 1 --2- 172.21.15.103:0/2466234847 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faf4804d9e0 0x7faf4804fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:24.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.881+0000 7faf61d9b700 1 --2- 172.21.15.103:0/2466234847 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faf4804d9e0 0x7faf4804fea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faf640b2630 tx=0x7faf4c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:24.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.881+0000 7faf61d9b700 1 --2- 172.21.15.103:0/2466234847 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faf4804d9e0 0x7faf4804fea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faf640b2630 tx=0x7faf4c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:24.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.881+0000 7faf61d9b700 1 --2- 172.21.15.103:0/2466234847 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faf4804d9e0 0x7faf4804fea0 secure :-1 s=READY pgs=607 cs=0 l=1 rx=0x7faf640b2630 tx=0x7faf4c007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:24.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.885+0000 7faf6259c700 1 --2- 172.21.15.103:0/2466234847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf640ad150 0x7faf6413a1a0 secure :-1 s=THROTTLE_DONE pgs=1676 cs=0 l=1 rx=0x7faf54002ef0 tx=0x7faf54010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:24.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:24.885+0000 7faf5b7fe700 1 -- 172.21.15.103:0/2466234847 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7faf5403ca30 con 0x7faf640ad150 2020-04-22T14:16:25.081 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:25.078+0000 7faf6359e700 1 -- 172.21.15.103:0/2466234847 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf6405d340 con 0x7faf640ad150 2020-04-22T14:16:25.081 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:25.078+0000 7faf6259c700 1 --2- 172.21.15.103:0/2466234847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf640ad150 0x7faf6413a1a0 secure :-1 s=THROTTLE_DONE pgs=1676 cs=0 l=1 rx=0x7faf54002ef0 tx=0x7faf54010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:25.082 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:25.078+0000 7faf5b7fe700 1 -- 172.21.15.103:0/2466234847 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+1428 (secure 0 0 0) 0x7faf54040050 con 0x7faf640ad150 2020-04-22T14:16:25.082 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:16:25.082 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":83,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:16:05.150517+0000","modified":"2020-04-22T14:16:24.627123+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2020-04-22T14:16:25.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:25.080+0000 7faf6359e700 1 -- 172.21.15.103:0/2466234847 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faf4804d9e0 msgr2=0x7faf4804fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:25.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:25.080+0000 7faf6359e700 1 --2- 172.21.15.103:0/2466234847 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faf4804d9e0 0x7faf4804fea0 secure :-1 s=READY pgs=607 cs=0 l=1 rx=0x7faf640b2630 tx=0x7faf4c007a40).stop 2020-04-22T14:16:25.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:25.080+0000 7faf6359e700 1 -- 172.21.15.103:0/2466234847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf640ad150 msgr2=0x7faf6413a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:25.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:25.080+0000 7faf6359e700 1 --2- 172.21.15.103:0/2466234847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf640ad150 0x7faf6413a1a0 secure :-1 s=READY pgs=1676 cs=0 l=1 rx=0x7faf54002ef0 tx=0x7faf54010eb0).stop 2020-04-22T14:16:25.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:25.080+0000 7faf6359e700 1 -- 172.21.15.103:0/2466234847 shutdown_connections 2020-04-22T14:16:25.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:25.080+0000 7faf6359e700 1 --2- 172.21.15.103:0/2466234847 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faf4804d9e0 0x7faf4804fea0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:25.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:25.080+0000 7faf6359e700 1 --2- 172.21.15.103:0/2466234847 >> v2:172.21.15.86:3300/0 conn(0x7faf641424d0 0x7faf6413c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:25.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:25.080+0000 7faf6359e700 1 --2- 172.21.15.103:0/2466234847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf640ad150 0x7faf6413a1a0 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:25.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:25.080+0000 7faf6359e700 1 -- 172.21.15.103:0/2466234847 >> 172.21.15.103:0/2466234847 conn(0x7faf6405b7c0 msgr2=0x7faf640b4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:25.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:25.080+0000 7faf6359e700 1 -- 172.21.15.103:0/2466234847 shutdown_connections 2020-04-22T14:16:25.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:25.080+0000 7faf6359e700 1 -- 172.21.15.103:0/2466234847 wait complete. 2020-04-22T14:16:25.085 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 83 2020-04-22T14:16:25.093 INFO:tasks.cephfs.filesystem:mapped states [] to None 2020-04-22T14:16:26.094 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:26.110 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:16:26.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.263+0000 7f895189d700 1 Processor -- start 2020-04-22T14:16:26.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.263+0000 7f895189d700 1 -- start start 2020-04-22T14:16:26.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.263+0000 7f895189d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f894c146ad0 0x7f894c146f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:26.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.263+0000 7f895189d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f894c0ad900 0x7f894c0addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:26.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.263+0000 7f895189d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f894c143810 con 0x7f894c0620a0 2020-04-22T14:16:26.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.263+0000 7f895189d700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f894c1473b0 con 0x7f894c0ad900 2020-04-22T14:16:26.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.263+0000 7f895189d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f894c143ab0 con 0x7f894c146ad0 2020-04-22T14:16:26.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.264+0000 7f895109c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f894c0ad900 0x7f894c0addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:26.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.264+0000 7f895109c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f894c0ad900 0x7f894c0addb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56304/0 (socket says 172.21.15.103:56304) 2020-04-22T14:16:26.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.264+0000 7f895089b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f894c0620a0 0x7f894c142e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48490/0 (socket says 172.21.15.103:48490) 2020-04-22T14:16:26.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.264+0000 7f895109c700 1 -- 172.21.15.103:0/976101728 learned_addr learned my addr 172.21.15.103:0/976101728 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:26.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.264+0000 7f894bfff700 1 --2- 172.21.15.103:0/976101728 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f894c146ad0 0x7f894c146f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:26.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.264+0000 7f895109c700 1 -- 172.21.15.103:0/976101728 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f894c146ad0 msgr2=0x7f894c146f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:26.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.264+0000 7f895109c700 1 --2- 172.21.15.103:0/976101728 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f894c146ad0 0x7f894c146f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:26.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.264+0000 7f895109c700 1 -- 172.21.15.103:0/976101728 >> v1:172.21.15.103:6789/0 conn(0x7f894c0620a0 legacy=0x7f894c142e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:26.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.264+0000 7f894b7fe700 1 -- 172.21.15.103:0/976101728 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1181549690 0 0) 0x7f894c143810 con 0x7f894c0620a0 2020-04-22T14:16:26.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.264+0000 7f895109c700 1 -- 172.21.15.103:0/976101728 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f894c143d50 con 0x7f894c0ad900 2020-04-22T14:16:26.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.264+0000 7f895109c700 1 --2- 172.21.15.103:0/976101728 >> v2:172.21.15.103:3300/0 conn(0x7f894c0ad900 0x7f894c0addb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f894c1474f0 tx=0x7f8944008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:26.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.264+0000 7f895109c700 1 --2- 172.21.15.103:0/976101728 >> v2:172.21.15.103:3300/0 conn(0x7f894c0ad900 0x7f894c0addb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f894c1474f0 tx=0x7f8944008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:26.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.264+0000 7f895109c700 1 --2- 172.21.15.103:0/976101728 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f894c0ad900 0x7f894c0addb0 secure :-1 s=READY pgs=1678 cs=0 l=1 rx=0x7f894c1474f0 tx=0x7f8944008c60).ready entity=mon.1 client_cookie=fa3e69e4c63e9e05 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:26.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.264+0000 7f895109c700 1 --2- 172.21.15.103:0/976101728 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f894c0ad900 0x7f894c0addb0 secure :-1 s=THROTTLE_DONE pgs=1678 cs=0 l=1 rx=0x7f894c1474f0 tx=0x7f8944008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:26.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.264+0000 7f894b7fe700 1 -- 172.21.15.103:0/976101728 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89440110d0 con 0x7f894c0ad900 2020-04-22T14:16:26.271 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.264+0000 7f895109c700 1 --2- 172.21.15.103:0/976101728 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f894c0ad900 0x7f894c0addb0 secure :-1 s=THROTTLE_DONE pgs=1678 cs=0 l=1 rx=0x7f894c1474f0 tx=0x7f8944008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:26.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.264+0000 7f895109c700 1 --2- 172.21.15.103:0/976101728 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f894c0ad900 0x7f894c0addb0 secure :-1 s=THROTTLE_DONE pgs=1678 cs=0 l=1 rx=0x7f894c1474f0 tx=0x7f8944008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:26.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.264+0000 7f894b7fe700 1 -- 172.21.15.103:0/976101728 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8944011270 con 0x7f894c0ad900 2020-04-22T14:16:26.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.264+0000 7f894b7fe700 1 -- 172.21.15.103:0/976101728 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8944011650 con 0x7f894c0ad900 2020-04-22T14:16:26.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.264+0000 7f895189d700 1 -- 172.21.15.103:0/976101728 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f894c0ad900 msgr2=0x7f894c0addb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:26.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.264+0000 7f895189d700 1 --2- 172.21.15.103:0/976101728 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f894c0ad900 0x7f894c0addb0 secure :-1 s=READY pgs=1678 cs=0 l=1 rx=0x7f894c1474f0 tx=0x7f8944008c60).stop 2020-04-22T14:16:26.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.265+0000 7f895189d700 1 -- 172.21.15.103:0/976101728 shutdown_connections 2020-04-22T14:16:26.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.265+0000 7f895189d700 1 --2- 172.21.15.103:0/976101728 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f894c0ad900 0x7f894c0addb0 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:26.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.265+0000 7f895189d700 1 --2- 172.21.15.103:0/976101728 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f894c146ad0 0x7f894c146f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:26.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.265+0000 7f895189d700 1 -- 172.21.15.103:0/976101728 >> 172.21.15.103:0/976101728 conn(0x7f894c05b7c0 msgr2=0x7f894c061610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:26.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.265+0000 7f895189d700 1 -- 172.21.15.103:0/976101728 shutdown_connections 2020-04-22T14:16:26.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.265+0000 7f895189d700 1 -- 172.21.15.103:0/976101728 wait complete. 2020-04-22T14:16:26.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.266+0000 7f895189d700 1 Processor -- start 2020-04-22T14:16:26.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.266+0000 7f895189d700 1 -- start start 2020-04-22T14:16:26.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.267+0000 7f895189d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f894c0620a0 0x7f894c13d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:26.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.267+0000 7f895189d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f894c146ad0 0x7f894c1342f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:26.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.267+0000 7f895189d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f894c13e140 con 0x7f894c0ad900 2020-04-22T14:16:26.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.267+0000 7f895189d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f894c13e3e0 con 0x7f894c146ad0 2020-04-22T14:16:26.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.267+0000 7f895189d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f894c13e680 con 0x7f894c0620a0 2020-04-22T14:16:26.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.267+0000 7f895089b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f894c0620a0 0x7f894c13d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:26.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.267+0000 7f895089b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f894c0620a0 0x7f894c13d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:41084/0 (socket says 172.21.15.103:41084) 2020-04-22T14:16:26.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.267+0000 7f895089b700 1 -- 172.21.15.103:0/219245574 learned_addr learned my addr 172.21.15.103:0/219245574 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:26.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.267+0000 7f895109c700 1 --2- 172.21.15.103:0/219245574 >> v2:172.21.15.86:3300/0 conn(0x7f894c146ad0 0x7f894c1342f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:26.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.267+0000 7f895089b700 1 -- 172.21.15.103:0/219245574 >> v2:172.21.15.86:3300/0 conn(0x7f894c146ad0 msgr2=0x7f894c1342f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:26.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.267+0000 7f895089b700 1 --2- 172.21.15.103:0/219245574 >> v2:172.21.15.86:3300/0 conn(0x7f894c146ad0 0x7f894c1342f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:26.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.267+0000 7f895089b700 1 -- 172.21.15.103:0/219245574 >> v1:172.21.15.86:6789/0 conn(0x7f894c0ad900 legacy=0x7f894c130200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:26.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.267+0000 7f895089b700 1 -- 172.21.15.103:0/219245574 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f894c130910 con 0x7f894c0620a0 2020-04-22T14:16:26.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.267+0000 7f895109c700 1 --2- 172.21.15.103:0/219245574 >> v2:172.21.15.86:3300/0 conn(0x7f894c146ad0 0x7f894c1342f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:16:26.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.267+0000 7f895089b700 1 --2- 172.21.15.103:0/219245574 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f894c0620a0 0x7f894c13d530 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f893c000e90 tx=0x7f893c0109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:26.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.267+0000 7f895089b700 1 --2- 172.21.15.103:0/219245574 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f894c0620a0 0x7f894c13d530 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f893c000e90 tx=0x7f893c0109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:26.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.267+0000 7f895089b700 1 --2- 172.21.15.103:0/219245574 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f894c0620a0 0x7f894c13d530 secure :-1 s=READY pgs=163 cs=0 l=1 rx=0x7f893c000e90 tx=0x7f893c0109b0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:26.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.267+0000 7f895089b700 1 --2- 172.21.15.103:0/219245574 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f894c0620a0 0x7f894c13d530 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f893c000e90 tx=0x7f893c0109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:26.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.267+0000 7f8949ffb700 1 -- 172.21.15.103:0/219245574 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f893c00c970 con 0x7f894c0620a0 2020-04-22T14:16:26.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.268+0000 7f895089b700 1 --2- 172.21.15.103:0/219245574 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f894c0620a0 0x7f894c13d530 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f893c000e90 tx=0x7f893c0109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:26.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.268+0000 7f895089b700 1 --2- 172.21.15.103:0/219245574 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f894c0620a0 0x7f894c13d530 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f893c000e90 tx=0x7f893c0109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:26.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.268+0000 7f8949ffb700 1 -- 172.21.15.103:0/219245574 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893c00cad0 con 0x7f894c0620a0 2020-04-22T14:16:26.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.268+0000 7f8949ffb700 1 -- 172.21.15.103:0/219245574 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f893c0044f0 con 0x7f894c0620a0 2020-04-22T14:16:26.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.268+0000 7f895189d700 1 -- 172.21.15.103:0/219245574 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f894c130b00 con 0x7f894c0620a0 2020-04-22T14:16:26.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.268+0000 7f895189d700 1 -- 172.21.15.103:0/219245574 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f894c13dbf0 con 0x7f894c0620a0 2020-04-22T14:16:26.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.268+0000 7f895089b700 1 --2- 172.21.15.103:0/219245574 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f894c0620a0 0x7f894c13d530 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f893c000e90 tx=0x7f893c0109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:26.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.269+0000 7f895189d700 1 -- 172.21.15.103:0/219245574 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f894c13df50 con 0x7f894c0620a0 2020-04-22T14:16:26.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.269+0000 7f8949ffb700 1 -- 172.21.15.103:0/219245574 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f893c004760 con 0x7f894c0620a0 2020-04-22T14:16:26.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.269+0000 7f895089b700 1 --2- 172.21.15.103:0/219245574 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f894c0620a0 0x7f894c13d530 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f893c000e90 tx=0x7f893c0109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:26.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.269+0000 7f8949ffb700 1 --2- 172.21.15.103:0/219245574 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f892c04d840 0x7f892c04fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:26.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.269+0000 7f8949ffb700 1 -- 172.21.15.103:0/219245574 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f893c060ec0 con 0x7f894c0620a0 2020-04-22T14:16:26.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.269+0000 7f894bfff700 1 --2- 172.21.15.103:0/219245574 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f892c04d840 0x7f892c04fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:26.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.269+0000 7f894bfff700 1 --2- 172.21.15.103:0/219245574 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f892c04d840 0x7f892c04fd00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f894c13c700 tx=0x7f8940007f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:26.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.269+0000 7f894bfff700 1 --2- 172.21.15.103:0/219245574 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f892c04d840 0x7f892c04fd00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f894c13c700 tx=0x7f8940007f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:26.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.269+0000 7f894bfff700 1 --2- 172.21.15.103:0/219245574 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f892c04d840 0x7f892c04fd00 secure :-1 s=READY pgs=610 cs=0 l=1 rx=0x7f894c13c700 tx=0x7f8940007f00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:26.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.273+0000 7f895089b700 1 --2- 172.21.15.103:0/219245574 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f894c0620a0 0x7f894c13d530 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f893c000e90 tx=0x7f893c0109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:26.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.273+0000 7f8949ffb700 1 -- 172.21.15.103:0/219245574 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f893c03c2a0 con 0x7f894c0620a0 2020-04-22T14:16:26.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.462+0000 7f895189d700 1 -- 172.21.15.103:0/219245574 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f894c056c90 con 0x7f894c0620a0 2020-04-22T14:16:26.466 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.463+0000 7f895089b700 1 --2- 172.21.15.103:0/219245574 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f894c0620a0 0x7f894c13d530 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f893c000e90 tx=0x7f893c0109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:26.466 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.463+0000 7f8949ffb700 1 -- 172.21.15.103:0/219245574 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+2142 (secure 0 0 0) 0x7f893c03f8c0 con 0x7f894c0620a0 2020-04-22T14:16:26.467 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:16:26.467 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":85,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6332,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/419161869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":419161869},{"type":"v1","addr":"172.21.15.86:6835","nonce":419161869}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":84}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:16:05.150517+0000","modified":"2020-04-22T14:16:25.635536+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8737},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8737":{"gid":8737,"name":"a","rank":0,"incarnation":85,"state":"up:replay","state_seq":1,"addr":"172.21.15.103:6833/4047146716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":4047146716},{"type":"v1","addr":"172.21.15.103:6833","nonce":4047146716}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2020-04-22T14:16:26.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.464+0000 7f895189d700 1 -- 172.21.15.103:0/219245574 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f892c04d840 msgr2=0x7f892c04fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:26.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.464+0000 7f895189d700 1 --2- 172.21.15.103:0/219245574 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f892c04d840 0x7f892c04fd00 secure :-1 s=READY pgs=610 cs=0 l=1 rx=0x7f894c13c700 tx=0x7f8940007f00).stop 2020-04-22T14:16:26.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.464+0000 7f895189d700 1 -- 172.21.15.103:0/219245574 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f894c0620a0 msgr2=0x7f894c13d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:26.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.464+0000 7f895189d700 1 --2- 172.21.15.103:0/219245574 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f894c0620a0 0x7f894c13d530 secure :-1 s=READY pgs=163 cs=0 l=1 rx=0x7f893c000e90 tx=0x7f893c0109b0).stop 2020-04-22T14:16:26.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.465+0000 7f895189d700 1 -- 172.21.15.103:0/219245574 shutdown_connections 2020-04-22T14:16:26.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.465+0000 7f895189d700 1 --2- 172.21.15.103:0/219245574 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f892c04d840 0x7f892c04fd00 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:26.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.465+0000 7f895189d700 1 --2- 172.21.15.103:0/219245574 >> v2:172.21.15.86:3300/0 conn(0x7f894c146ad0 0x7f894c1342f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:26.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.465+0000 7f895189d700 1 --2- 172.21.15.103:0/219245574 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f894c0620a0 0x7f894c13d530 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:26.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.465+0000 7f895189d700 1 -- 172.21.15.103:0/219245574 >> 172.21.15.103:0/219245574 conn(0x7f894c05b7c0 msgr2=0x7f894c1461d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:26.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.465+0000 7f895189d700 1 -- 172.21.15.103:0/219245574 shutdown_connections 2020-04-22T14:16:26.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:26.465+0000 7f895189d700 1 -- 172.21.15.103:0/219245574 wait complete. 2020-04-22T14:16:26.470 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 85 2020-04-22T14:16:26.478 INFO:tasks.cephfs.filesystem:mapped states [u'up:replay'] to None 2020-04-22T14:16:27.479 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:27.496 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:16:27.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.651+0000 7f45c6076700 1 Processor -- start 2020-04-22T14:16:27.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.651+0000 7f45c6076700 1 -- start start 2020-04-22T14:16:27.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.652+0000 7f45c6076700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45c0140320 0x7f45c00ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:27.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.652+0000 7f45c6076700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f45c00bd1b0 0x7f45c00bd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:27.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.652+0000 7f45c6076700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45c014a710 con 0x7f45c014a2b0 2020-04-22T14:16:27.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.652+0000 7f45c6076700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c01462f0 con 0x7f45c00bd1b0 2020-04-22T14:16:27.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.652+0000 7f45c6076700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c0146590 con 0x7f45c0140320 2020-04-22T14:16:27.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.652+0000 7f45beffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f45c014a2b0 0x7f45c0146cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48510/0 (socket says 172.21.15.103:48510) 2020-04-22T14:16:27.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.652+0000 7f45beffd700 1 -- 172.21.15.103:0/2492029340 learned_addr learned my addr 172.21.15.103:0/2492029340 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:27.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.652+0000 7f45bffff700 1 --2- 172.21.15.103:0/2492029340 >> v2:172.21.15.86:3300/0 conn(0x7f45c00bd1b0 0x7f45c00bd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:27.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.652+0000 7f45bf7fe700 1 --2- 172.21.15.103:0/2492029340 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45c0140320 0x7f45c00ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:27.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.652+0000 7f45be7fc700 1 -- 172.21.15.103:0/2492029340 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2122074507 0 0) 0x7f45c014a710 con 0x7f45c014a2b0 2020-04-22T14:16:27.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.652+0000 7f45be7fc700 1 -- 172.21.15.103:0/2492029340 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45ac003230 con 0x7f45c014a2b0 2020-04-22T14:16:27.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.653+0000 7f45be7fc700 1 -- 172.21.15.103:0/2492029340 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2932048940 0 0) 0x7f45ac003230 con 0x7f45c014a2b0 2020-04-22T14:16:27.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.653+0000 7f45bf7fe700 1 -- 172.21.15.103:0/2492029340 >> v2:172.21.15.86:3300/0 conn(0x7f45c00bd1b0 msgr2=0x7f45c00bd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:27.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.653+0000 7f45bf7fe700 1 --2- 172.21.15.103:0/2492029340 >> v2:172.21.15.86:3300/0 conn(0x7f45c00bd1b0 0x7f45c00bd640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:27.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.653+0000 7f45bf7fe700 1 -- 172.21.15.103:0/2492029340 >> v1:172.21.15.103:6789/0 conn(0x7f45c014a2b0 legacy=0x7f45c0146cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:27.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.653+0000 7f45bf7fe700 1 -- 172.21.15.103:0/2492029340 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c0146830 con 0x7f45c0140320 2020-04-22T14:16:27.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.653+0000 7f45bffff700 1 --2- 172.21.15.103:0/2492029340 >> v2:172.21.15.86:3300/0 conn(0x7f45c00bd1b0 0x7f45c00bd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:16:27.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.653+0000 7f45bf7fe700 1 --2- 172.21.15.103:0/2492029340 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45c0140320 0x7f45c00ae1a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f45b4001870 tx=0x7f45b0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:27.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.653+0000 7f45bf7fe700 1 --2- 172.21.15.103:0/2492029340 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45c0140320 0x7f45c00ae1a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f45b4001870 tx=0x7f45b0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:27.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.653+0000 7f45bf7fe700 1 --2- 172.21.15.103:0/2492029340 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45c0140320 0x7f45c00ae1a0 secure :-1 s=READY pgs=164 cs=0 l=1 rx=0x7f45b4001870 tx=0x7f45b0007a40).ready entity=mon.2 client_cookie=ee41b0bcfc719429 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:27.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.653+0000 7f45bf7fe700 1 --2- 172.21.15.103:0/2492029340 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45c0140320 0x7f45c00ae1a0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f45b4001870 tx=0x7f45b0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:27.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.653+0000 7f45be7fc700 1 -- 172.21.15.103:0/2492029340 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45b40016d0 con 0x7f45c0140320 2020-04-22T14:16:27.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.653+0000 7f45bf7fe700 1 --2- 172.21.15.103:0/2492029340 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45c0140320 0x7f45c00ae1a0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f45b4001870 tx=0x7f45b0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:27.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.653+0000 7f45bf7fe700 1 --2- 172.21.15.103:0/2492029340 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45c0140320 0x7f45c00ae1a0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f45b4001870 tx=0x7f45b0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:27.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.653+0000 7f45be7fc700 1 -- 172.21.15.103:0/2492029340 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b0008b40 con 0x7f45c0140320 2020-04-22T14:16:27.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.653+0000 7f45be7fc700 1 -- 172.21.15.103:0/2492029340 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45b00115a0 con 0x7f45c0140320 2020-04-22T14:16:27.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.653+0000 7f45c6076700 1 -- 172.21.15.103:0/2492029340 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45c0140320 msgr2=0x7f45c00ae1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:27.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.653+0000 7f45c6076700 1 --2- 172.21.15.103:0/2492029340 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45c0140320 0x7f45c00ae1a0 secure :-1 s=READY pgs=164 cs=0 l=1 rx=0x7f45b4001870 tx=0x7f45b0007a40).stop 2020-04-22T14:16:27.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.654+0000 7f45c6076700 1 -- 172.21.15.103:0/2492029340 shutdown_connections 2020-04-22T14:16:27.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.654+0000 7f45c6076700 1 --2- 172.21.15.103:0/2492029340 >> v2:172.21.15.86:3300/0 conn(0x7f45c00bd1b0 0x7f45c00bd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:27.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.654+0000 7f45c6076700 1 --2- 172.21.15.103:0/2492029340 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45c0140320 0x7f45c00ae1a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:27.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.654+0000 7f45c6076700 1 -- 172.21.15.103:0/2492029340 >> 172.21.15.103:0/2492029340 conn(0x7f45c005f2c0 msgr2=0x7f45c00bcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:27.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.654+0000 7f45c6076700 1 -- 172.21.15.103:0/2492029340 shutdown_connections 2020-04-22T14:16:27.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.654+0000 7f45c6076700 1 -- 172.21.15.103:0/2492029340 wait complete. 2020-04-22T14:16:27.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.655+0000 7f45c6076700 1 Processor -- start 2020-04-22T14:16:27.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.655+0000 7f45c6076700 1 -- start start 2020-04-22T14:16:27.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.655+0000 7f45c6076700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f45c014a2b0 0x7f45c01435e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:27.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.655+0000 7f45c6076700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45c00af560 con 0x7f45c0140320 2020-04-22T14:16:27.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.655+0000 7f45c6076700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45c00af800 con 0x7f45c00bd1b0 2020-04-22T14:16:27.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.655+0000 7f45c6076700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c0158060 con 0x7f45c014a2b0 2020-04-22T14:16:27.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.656+0000 7f45bf7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f45c00bd1b0 0x7f45c00afca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48514/0 (socket says 172.21.15.103:48514) 2020-04-22T14:16:27.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.656+0000 7f45bf7fe700 1 -- 172.21.15.103:0/3943948367 learned_addr learned my addr 172.21.15.103:0/3943948367 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:27.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.656+0000 7f45bffff700 1 --2- 172.21.15.103:0/3943948367 >> v2:172.21.15.103:3300/0 conn(0x7f45c014a2b0 0x7f45c01435e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:27.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.656+0000 7f45bcff9700 1 -- 172.21.15.103:0/3943948367 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2545606075 0 0) 0x7f45c00af800 con 0x7f45c00bd1b0 2020-04-22T14:16:27.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.656+0000 7f45bcff9700 1 -- 172.21.15.103:0/3943948367 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45a0002fe0 con 0x7f45c00bd1b0 2020-04-22T14:16:27.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.656+0000 7f45bffff700 1 -- 172.21.15.103:0/3943948367 >> v1:172.21.15.103:6789/0 conn(0x7f45c00bd1b0 legacy=0x7f45c00afca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:27.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.656+0000 7f45bffff700 1 -- 172.21.15.103:0/3943948367 >> v1:172.21.15.86:6789/0 conn(0x7f45c0140320 legacy=0x7f45c013f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:27.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.656+0000 7f45bffff700 1 -- 172.21.15.103:0/3943948367 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c00b1040 con 0x7f45c014a2b0 2020-04-22T14:16:27.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.656+0000 7f45bffff700 1 --2- 172.21.15.103:0/3943948367 >> v2:172.21.15.103:3300/0 conn(0x7f45c014a2b0 0x7f45c01435e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f45b80032b0 tx=0x7f45b8011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:27.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.656+0000 7f45bffff700 1 --2- 172.21.15.103:0/3943948367 >> v2:172.21.15.103:3300/0 conn(0x7f45c014a2b0 0x7f45c01435e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f45b80032b0 tx=0x7f45b8011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:27.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.656+0000 7f45bffff700 1 --2- 172.21.15.103:0/3943948367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45c014a2b0 0x7f45c01435e0 secure :-1 s=READY pgs=1681 cs=0 l=1 rx=0x7f45b80032b0 tx=0x7f45b8011040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:27.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.656+0000 7f45bffff700 1 --2- 172.21.15.103:0/3943948367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45c014a2b0 0x7f45c01435e0 secure :-1 s=THROTTLE_DONE pgs=1681 cs=0 l=1 rx=0x7f45b80032b0 tx=0x7f45b8011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:27.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.656+0000 7f45bcff9700 1 -- 172.21.15.103:0/3943948367 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45b8005e30 con 0x7f45c014a2b0 2020-04-22T14:16:27.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.656+0000 7f45bffff700 1 --2- 172.21.15.103:0/3943948367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45c014a2b0 0x7f45c01435e0 secure :-1 s=THROTTLE_DONE pgs=1681 cs=0 l=1 rx=0x7f45b80032b0 tx=0x7f45b8011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:27.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.656+0000 7f45bffff700 1 --2- 172.21.15.103:0/3943948367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45c014a2b0 0x7f45c01435e0 secure :-1 s=THROTTLE_DONE pgs=1681 cs=0 l=1 rx=0x7f45b80032b0 tx=0x7f45b8011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:27.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.656+0000 7f45bcff9700 1 -- 172.21.15.103:0/3943948367 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b8007560 con 0x7f45c014a2b0 2020-04-22T14:16:27.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.656+0000 7f45c6076700 1 -- 172.21.15.103:0/3943948367 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45c00b03b0 con 0x7f45c014a2b0 2020-04-22T14:16:27.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.656+0000 7f45bcff9700 1 -- 172.21.15.103:0/3943948367 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45b8007900 con 0x7f45c014a2b0 2020-04-22T14:16:27.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.657+0000 7f45c6076700 1 -- 172.21.15.103:0/3943948367 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c013fbf0 con 0x7f45c014a2b0 2020-04-22T14:16:27.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.657+0000 7f45bffff700 1 --2- 172.21.15.103:0/3943948367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45c014a2b0 0x7f45c01435e0 secure :-1 s=THROTTLE_DONE pgs=1681 cs=0 l=1 rx=0x7f45b80032b0 tx=0x7f45b8011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:27.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.657+0000 7f45bcff9700 1 -- 172.21.15.103:0/3943948367 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f45b800e1a0 con 0x7f45c014a2b0 2020-04-22T14:16:27.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.657+0000 7f45bffff700 1 --2- 172.21.15.103:0/3943948367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45c014a2b0 0x7f45c01435e0 secure :-1 s=THROTTLE_DONE pgs=1681 cs=0 l=1 rx=0x7f45b80032b0 tx=0x7f45b8011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:27.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.658+0000 7f45bcff9700 1 --2- 172.21.15.103:0/3943948367 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f45a004dcc0 0x7f45a0050180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:27.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.658+0000 7f45c6076700 1 -- 172.21.15.103:0/3943948367 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45c0056c90 con 0x7f45c014a2b0 2020-04-22T14:16:27.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.658+0000 7f45bcff9700 1 -- 172.21.15.103:0/3943948367 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f45b80612e0 con 0x7f45c014a2b0 2020-04-22T14:16:27.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.658+0000 7f45bf7fe700 1 --2- 172.21.15.103:0/3943948367 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f45a004dcc0 0x7f45a0050180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:27.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.658+0000 7f45bf7fe700 1 --2- 172.21.15.103:0/3943948367 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f45a004dcc0 0x7f45a0050180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f45b0008320 tx=0x7f45b0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:27.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.658+0000 7f45bf7fe700 1 --2- 172.21.15.103:0/3943948367 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f45a004dcc0 0x7f45a0050180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f45b0008320 tx=0x7f45b0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:27.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.658+0000 7f45bf7fe700 1 --2- 172.21.15.103:0/3943948367 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f45a004dcc0 0x7f45a0050180 secure :-1 s=READY pgs=611 cs=0 l=1 rx=0x7f45b0008320 tx=0x7f45b0007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:27.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.662+0000 7f45bffff700 1 --2- 172.21.15.103:0/3943948367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45c014a2b0 0x7f45c01435e0 secure :-1 s=THROTTLE_DONE pgs=1681 cs=0 l=1 rx=0x7f45b80032b0 tx=0x7f45b8011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:27.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.662+0000 7f45bcff9700 1 -- 172.21.15.103:0/3943948367 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f45b803c780 con 0x7f45c014a2b0 2020-04-22T14:16:27.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.850+0000 7f45c6076700 1 -- 172.21.15.103:0/3943948367 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f45c013fbf0 con 0x7f45c014a2b0 2020-04-22T14:16:27.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.851+0000 7f45bffff700 1 --2- 172.21.15.103:0/3943948367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45c014a2b0 0x7f45c01435e0 secure :-1 s=THROTTLE_DONE pgs=1681 cs=0 l=1 rx=0x7f45b80032b0 tx=0x7f45b8011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:27.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.851+0000 7f45bcff9700 1 -- 172.21.15.103:0/3943948367 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) v1 ==== 94+0+2142 (secure 0 0 0) 0x7f45c013fbf0 con 0x7f45c014a2b0 2020-04-22T14:16:27.854 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:16:27.855 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":87,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6332,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/419161869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":419161869},{"type":"v1","addr":"172.21.15.86:6835","nonce":419161869}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":84}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:16:05.150517+0000","modified":"2020-04-22T14:16:27.644411+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8737},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8737":{"gid":8737,"name":"a","rank":0,"incarnation":85,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.103:6833/4047146716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":4047146716},{"type":"v1","addr":"172.21.15.103:6833","nonce":4047146716}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2020-04-22T14:16:27.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.852+0000 7f45c6076700 1 -- 172.21.15.103:0/3943948367 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f45a004dcc0 msgr2=0x7f45a0050180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:27.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.852+0000 7f45c6076700 1 --2- 172.21.15.103:0/3943948367 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f45a004dcc0 0x7f45a0050180 secure :-1 s=READY pgs=611 cs=0 l=1 rx=0x7f45b0008320 tx=0x7f45b0007a40).stop 2020-04-22T14:16:27.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.852+0000 7f45c6076700 1 -- 172.21.15.103:0/3943948367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45c014a2b0 msgr2=0x7f45c01435e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:27.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.852+0000 7f45c6076700 1 --2- 172.21.15.103:0/3943948367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45c014a2b0 0x7f45c01435e0 secure :-1 s=READY pgs=1681 cs=0 l=1 rx=0x7f45b80032b0 tx=0x7f45b8011040).stop 2020-04-22T14:16:27.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.852+0000 7f45c6076700 1 -- 172.21.15.103:0/3943948367 shutdown_connections 2020-04-22T14:16:27.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.852+0000 7f45c6076700 1 --2- 172.21.15.103:0/3943948367 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f45a004dcc0 0x7f45a0050180 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:27.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.852+0000 7f45c6076700 1 --2- 172.21.15.103:0/3943948367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45c014a2b0 0x7f45c01435e0 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:27.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.852+0000 7f45c6076700 1 -- 172.21.15.103:0/3943948367 >> 172.21.15.103:0/3943948367 conn(0x7f45c005f2c0 msgr2=0x7f45c00adc40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:27.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.852+0000 7f45c6076700 1 -- 172.21.15.103:0/3943948367 shutdown_connections 2020-04-22T14:16:27.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:27.852+0000 7f45c6076700 1 -- 172.21.15.103:0/3943948367 wait complete. 2020-04-22T14:16:27.858 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 87 2020-04-22T14:16:27.865 INFO:tasks.cephfs.filesystem:mapped states [u'up:rejoin'] to None 2020-04-22T14:16:28.866 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:28.882 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:16:29.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.035+0000 7f0709928700 1 Processor -- start 2020-04-22T14:16:29.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.036+0000 7f0709928700 1 -- start start 2020-04-22T14:16:29.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.036+0000 7f0709928700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0704065fe0 0x7f07041464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:29.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.036+0000 7f0709928700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0704063e30 0x7f07040642a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:29.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.036+0000 7f0709928700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0704143300 con 0x7f070412c0d0 2020-04-22T14:16:29.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.036+0000 7f0709928700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07041435a0 con 0x7f0704063e30 2020-04-22T14:16:29.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.036+0000 7f0709928700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0704143840 con 0x7f0704065fe0 2020-04-22T14:16:29.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.037+0000 7f0702ffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f070412c0d0 0x7f070405b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48524/0 (socket says 172.21.15.103:48524) 2020-04-22T14:16:29.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.037+0000 7f0702ffd700 1 -- 172.21.15.103:0/300346429 learned_addr learned my addr 172.21.15.103:0/300346429 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:29.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.037+0000 7f07027fc700 1 --2- 172.21.15.103:0/300346429 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0704065fe0 0x7f07041464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:29.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.037+0000 7f07037fe700 1 --2- 172.21.15.103:0/300346429 >> v2:172.21.15.86:3300/0 conn(0x7f0704063e30 0x7f07040642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:29.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.037+0000 7f0701ffb700 1 -- 172.21.15.103:0/300346429 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 901816627 0 0) 0x7f0704143300 con 0x7f070412c0d0 2020-04-22T14:16:29.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.037+0000 7f0701ffb700 1 -- 172.21.15.103:0/300346429 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06e4003230 con 0x7f070412c0d0 2020-04-22T14:16:29.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.037+0000 7f0701ffb700 1 -- 172.21.15.103:0/300346429 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1469597296 0 0) 0x7f06e4003230 con 0x7f070412c0d0 2020-04-22T14:16:29.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.037+0000 7f0701ffb700 1 -- 172.21.15.103:0/300346429 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0704065fe0 msgr2=0x7f07041464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:29.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.037+0000 7f0701ffb700 1 --2- 172.21.15.103:0/300346429 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0704065fe0 0x7f07041464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:29.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.037+0000 7f0701ffb700 1 -- 172.21.15.103:0/300346429 >> v2:172.21.15.86:3300/0 conn(0x7f0704063e30 msgr2=0x7f07040642a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:29.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.037+0000 7f0701ffb700 1 --2- 172.21.15.103:0/300346429 >> v2:172.21.15.86:3300/0 conn(0x7f0704063e30 0x7f07040642a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:29.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.037+0000 7f0701ffb700 1 -- 172.21.15.103:0/300346429 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f070405bb50 con 0x7f070412c0d0 2020-04-22T14:16:29.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.037+0000 7f0701ffb700 1 -- 172.21.15.103:0/300346429 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f06ec0016d0 con 0x7f070412c0d0 2020-04-22T14:16:29.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.037+0000 7f0701ffb700 1 -- 172.21.15.103:0/300346429 >> v1:172.21.15.103:6789/0 conn(0x7f070412c0d0 legacy=0x7f070405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:29.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.037+0000 7f0701ffb700 1 --2- 172.21.15.103:0/300346429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06e4003720 0x7f06e4003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:29.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.037+0000 7f0701ffb700 1 --2- 172.21.15.103:0/300346429 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0704065fe0 0x7f06e40044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:29.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.037+0000 7f0701ffb700 1 --2- 172.21.15.103:0/300346429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06e4004930 0x7f06e4004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:29.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.037+0000 7f0701ffb700 1 -- 172.21.15.103:0/300346429 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07041435a0 con 0x7f06e4004930 2020-04-22T14:16:29.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.037+0000 7f0701ffb700 1 -- 172.21.15.103:0/300346429 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0704143840 con 0x7f06e4003720 2020-04-22T14:16:29.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.037+0000 7f0701ffb700 1 -- 172.21.15.103:0/300346429 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e40040f0 con 0x7f0704065fe0 2020-04-22T14:16:29.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.037+0000 7f0702ffd700 1 --2- 172.21.15.103:0/300346429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06e4003720 0x7f06e4003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:29.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.037+0000 7f07027fc700 1 --2- 172.21.15.103:0/300346429 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0704065fe0 0x7f06e40044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:29.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.037+0000 7f07037fe700 1 --2- 172.21.15.103:0/300346429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06e4004930 0x7f06e4004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:29.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.038+0000 7f0702ffd700 1 -- 172.21.15.103:0/300346429 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0704065fe0 msgr2=0x7f06e40044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:29.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.038+0000 7f0702ffd700 1 --2- 172.21.15.103:0/300346429 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0704065fe0 0x7f06e40044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:29.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.038+0000 7f0702ffd700 1 -- 172.21.15.103:0/300346429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06e4004930 msgr2=0x7f06e4004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:29.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.038+0000 7f0702ffd700 1 --2- 172.21.15.103:0/300346429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06e4004930 0x7f06e4004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:29.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.038+0000 7f0702ffd700 1 -- 172.21.15.103:0/300346429 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e4003230 con 0x7f06e4003720 2020-04-22T14:16:29.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.038+0000 7f0702ffd700 1 --2- 172.21.15.103:0/300346429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06e4003720 0x7f06e4003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f06ec0013e0 tx=0x7f070405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:29.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.038+0000 7f0702ffd700 1 --2- 172.21.15.103:0/300346429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06e4003720 0x7f06e4003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f06ec0013e0 tx=0x7f070405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:29.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.038+0000 7f0702ffd700 1 --2- 172.21.15.103:0/300346429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06e4003720 0x7f06e4003b40 secure :-1 s=READY pgs=1683 cs=0 l=1 rx=0x7f06ec0013e0 tx=0x7f070405bce0).ready entity=mon.1 client_cookie=ccb0a89d115c76d5 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:29.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.038+0000 7f0702ffd700 1 --2- 172.21.15.103:0/300346429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06e4003720 0x7f06e4003b40 secure :-1 s=THROTTLE_DONE pgs=1683 cs=0 l=1 rx=0x7f06ec0013e0 tx=0x7f070405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:29.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.038+0000 7f0701ffb700 1 -- 172.21.15.103:0/300346429 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06ec00e180 con 0x7f06e4003720 2020-04-22T14:16:29.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.038+0000 7f0702ffd700 1 --2- 172.21.15.103:0/300346429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06e4003720 0x7f06e4003b40 secure :-1 s=THROTTLE_DONE pgs=1683 cs=0 l=1 rx=0x7f06ec0013e0 tx=0x7f070405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:29.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.038+0000 7f0702ffd700 1 --2- 172.21.15.103:0/300346429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06e4003720 0x7f06e4003b40 secure :-1 s=THROTTLE_DONE pgs=1683 cs=0 l=1 rx=0x7f06ec0013e0 tx=0x7f070405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:29.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.038+0000 7f0701ffb700 1 -- 172.21.15.103:0/300346429 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ec00e2e0 con 0x7f06e4003720 2020-04-22T14:16:29.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.038+0000 7f0701ffb700 1 -- 172.21.15.103:0/300346429 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06ec0100c0 con 0x7f06e4003720 2020-04-22T14:16:29.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.038+0000 7f0709928700 1 -- 172.21.15.103:0/300346429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06e4003720 msgr2=0x7f06e4003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:29.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.038+0000 7f0709928700 1 --2- 172.21.15.103:0/300346429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06e4003720 0x7f06e4003b40 secure :-1 s=READY pgs=1683 cs=0 l=1 rx=0x7f06ec0013e0 tx=0x7f070405bce0).stop 2020-04-22T14:16:29.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.038+0000 7f07037fe700 1 -- 172.21.15.103:0/300346429 reap_dead start 2020-04-22T14:16:29.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.039+0000 7f0709928700 1 -- 172.21.15.103:0/300346429 shutdown_connections 2020-04-22T14:16:29.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.039+0000 7f0709928700 1 -- 172.21.15.103:0/300346429 >> 172.21.15.103:0/300346429 conn(0x7f07040b9160 msgr2=0x7f070405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:29.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.039+0000 7f0709928700 1 -- 172.21.15.103:0/300346429 shutdown_connections 2020-04-22T14:16:29.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.039+0000 7f0709928700 1 -- 172.21.15.103:0/300346429 wait complete. 2020-04-22T14:16:29.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.039+0000 7f0709928700 1 Processor -- start 2020-04-22T14:16:29.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.040+0000 7f0709928700 1 -- start start 2020-04-22T14:16:29.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.040+0000 7f0709928700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f070414cca0 0x7f0704154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:29.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.040+0000 7f0709928700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07040ac740 con 0x7f07040b18d0 2020-04-22T14:16:29.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.040+0000 7f0709928700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07040b57a0 con 0x7f07040b5020 2020-04-22T14:16:29.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.040+0000 7f0709928700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07040ac970 con 0x7f070414cca0 2020-04-22T14:16:29.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.040+0000 7f0702ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f070414cca0 0x7f0704154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:29.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.040+0000 7f07027fc700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f07040b5020 0x7f07040ace10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48536/0 (socket says 172.21.15.103:48536) 2020-04-22T14:16:29.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.040+0000 7f07027fc700 1 -- 172.21.15.103:0/3744056207 learned_addr learned my addr 172.21.15.103:0/3744056207 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:29.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.040+0000 7f0702ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f070414cca0 0x7f0704154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56344/0 (socket says 172.21.15.103:56344) 2020-04-22T14:16:29.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.041+0000 7f0702ffd700 1 -- 172.21.15.103:0/3744056207 >> v1:172.21.15.103:6789/0 conn(0x7f07040b5020 legacy=0x7f07040ace10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:29.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.041+0000 7f0702ffd700 1 -- 172.21.15.103:0/3744056207 >> v1:172.21.15.86:6789/0 conn(0x7f07040b18d0 legacy=0x7f07040aef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:29.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.041+0000 7f0702ffd700 1 -- 172.21.15.103:0/3744056207 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f070414d080 con 0x7f070414cca0 2020-04-22T14:16:29.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.041+0000 7f06fbfff700 1 -- 172.21.15.103:0/3744056207 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2078373127 0 0) 0x7f07040b57a0 con 0x7f07040b5020 2020-04-22T14:16:29.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.041+0000 7f0702ffd700 1 --2- 172.21.15.103:0/3744056207 >> v2:172.21.15.103:3300/0 conn(0x7f070414cca0 0x7f0704154830 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f070414d830 tx=0x7f070405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:29.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.041+0000 7f0702ffd700 1 --2- 172.21.15.103:0/3744056207 >> v2:172.21.15.103:3300/0 conn(0x7f070414cca0 0x7f0704154830 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f070414d830 tx=0x7f070405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:29.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.041+0000 7f0702ffd700 1 --2- 172.21.15.103:0/3744056207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f070414cca0 0x7f0704154830 secure :-1 s=READY pgs=1685 cs=0 l=1 rx=0x7f070414d830 tx=0x7f070405bce0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:29.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.041+0000 7f0702ffd700 1 --2- 172.21.15.103:0/3744056207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f070414cca0 0x7f0704154830 secure :-1 s=THROTTLE_DONE pgs=1685 cs=0 l=1 rx=0x7f070414d830 tx=0x7f070405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:29.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.041+0000 7f06fbfff700 1 -- 172.21.15.103:0/3744056207 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06ec00e660 con 0x7f070414cca0 2020-04-22T14:16:29.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.041+0000 7f0702ffd700 1 --2- 172.21.15.103:0/3744056207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f070414cca0 0x7f0704154830 secure :-1 s=THROTTLE_DONE pgs=1685 cs=0 l=1 rx=0x7f070414d830 tx=0x7f070405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:29.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.041+0000 7f0702ffd700 1 --2- 172.21.15.103:0/3744056207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f070414cca0 0x7f0704154830 secure :-1 s=THROTTLE_DONE pgs=1685 cs=0 l=1 rx=0x7f070414d830 tx=0x7f070405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:29.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.041+0000 7f06fbfff700 1 -- 172.21.15.103:0/3744056207 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ec0104c0 con 0x7f070414cca0 2020-04-22T14:16:29.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.041+0000 7f0709928700 1 -- 172.21.15.103:0/3744056207 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07040b54d0 con 0x7f070414cca0 2020-04-22T14:16:29.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.041+0000 7f06fbfff700 1 -- 172.21.15.103:0/3744056207 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06ec010860 con 0x7f070414cca0 2020-04-22T14:16:29.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.041+0000 7f0709928700 1 -- 172.21.15.103:0/3744056207 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07040af630 con 0x7f070414cca0 2020-04-22T14:16:29.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.041+0000 7f0702ffd700 1 --2- 172.21.15.103:0/3744056207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f070414cca0 0x7f0704154830 secure :-1 s=THROTTLE_DONE pgs=1685 cs=0 l=1 rx=0x7f070414d830 tx=0x7f070405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:29.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.042+0000 7f0709928700 1 -- 172.21.15.103:0/3744056207 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0704056c90 con 0x7f070414cca0 2020-04-22T14:16:29.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.042+0000 7f06fbfff700 1 -- 172.21.15.103:0/3744056207 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f06ec0045b0 con 0x7f070414cca0 2020-04-22T14:16:29.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.042+0000 7f0702ffd700 1 --2- 172.21.15.103:0/3744056207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f070414cca0 0x7f0704154830 secure :-1 s=THROTTLE_DONE pgs=1685 cs=0 l=1 rx=0x7f070414d830 tx=0x7f070405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:29.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.042+0000 7f06fbfff700 1 --2- 172.21.15.103:0/3744056207 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f06e804d750 0x7f06e804fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:29.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.042+0000 7f06fbfff700 1 -- 172.21.15.103:0/3744056207 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f06ec0618f0 con 0x7f070414cca0 2020-04-22T14:16:29.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.042+0000 7f07027fc700 1 --2- 172.21.15.103:0/3744056207 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f06e804d750 0x7f06e804fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:29.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.043+0000 7f07027fc700 1 --2- 172.21.15.103:0/3744056207 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f06e804d750 0x7f06e804fc10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f06f4008330 tx=0x7f06f400caa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:29.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.043+0000 7f07027fc700 1 --2- 172.21.15.103:0/3744056207 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f06e804d750 0x7f06e804fc10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f06f4008330 tx=0x7f06f400caa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:29.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.043+0000 7f07027fc700 1 --2- 172.21.15.103:0/3744056207 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f06e804d750 0x7f06e804fc10 secure :-1 s=READY pgs=612 cs=0 l=1 rx=0x7f06f4008330 tx=0x7f06f400caa0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:29.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.046+0000 7f0702ffd700 1 --2- 172.21.15.103:0/3744056207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f070414cca0 0x7f0704154830 secure :-1 s=THROTTLE_DONE pgs=1685 cs=0 l=1 rx=0x7f070414d830 tx=0x7f070405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:29.058 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.046+0000 7f06fbfff700 1 -- 172.21.15.103:0/3744056207 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f06ec03cd90 con 0x7f070414cca0 2020-04-22T14:16:29.237 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.234+0000 7f0709928700 1 -- 172.21.15.103:0/3744056207 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0704062720 con 0x7f070414cca0 2020-04-22T14:16:29.238 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.235+0000 7f0702ffd700 1 --2- 172.21.15.103:0/3744056207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f070414cca0 0x7f0704154830 secure :-1 s=THROTTLE_DONE pgs=1685 cs=0 l=1 rx=0x7f070414d830 tx=0x7f070405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:29.238 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.235+0000 7f06fbfff700 1 -- 172.21.15.103:0/3744056207 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+2142 (secure 0 0 0) 0x7f06ec0403b0 con 0x7f070414cca0 2020-04-22T14:16:29.238 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:16:29.238 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":88,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6332,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/419161869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":419161869},{"type":"v1","addr":"172.21.15.86:6835","nonce":419161869}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":84}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:16:05.150517+0000","modified":"2020-04-22T14:16:28.649443+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8737},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8737":{"gid":8737,"name":"a","rank":0,"incarnation":85,"state":"up:active","state_seq":4,"addr":"172.21.15.103:6833/4047146716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":4047146716},{"type":"v1","addr":"172.21.15.103:6833","nonce":4047146716}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2020-04-22T14:16:29.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.236+0000 7f0709928700 1 -- 172.21.15.103:0/3744056207 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f06e804d750 msgr2=0x7f06e804fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:29.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.236+0000 7f0709928700 1 --2- 172.21.15.103:0/3744056207 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f06e804d750 0x7f06e804fc10 secure :-1 s=READY pgs=612 cs=0 l=1 rx=0x7f06f4008330 tx=0x7f06f400caa0).stop 2020-04-22T14:16:29.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.236+0000 7f0709928700 1 -- 172.21.15.103:0/3744056207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f070414cca0 msgr2=0x7f0704154830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:29.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.236+0000 7f0709928700 1 --2- 172.21.15.103:0/3744056207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f070414cca0 0x7f0704154830 secure :-1 s=READY pgs=1685 cs=0 l=1 rx=0x7f070414d830 tx=0x7f070405bce0).stop 2020-04-22T14:16:29.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.236+0000 7f0709928700 1 -- 172.21.15.103:0/3744056207 shutdown_connections 2020-04-22T14:16:29.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.236+0000 7f0709928700 1 --2- 172.21.15.103:0/3744056207 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f06e804d750 0x7f06e804fc10 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:29.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.236+0000 7f0709928700 1 --2- 172.21.15.103:0/3744056207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f070414cca0 0x7f0704154830 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:29.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.236+0000 7f0709928700 1 -- 172.21.15.103:0/3744056207 >> 172.21.15.103:0/3744056207 conn(0x7f07040b9160 msgr2=0x7f07040615e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:29.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.236+0000 7f0709928700 1 -- 172.21.15.103:0/3744056207 shutdown_connections 2020-04-22T14:16:29.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:29.236+0000 7f0709928700 1 -- 172.21.15.103:0/3744056207 wait complete. 2020-04-22T14:16:29.241 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 88 2020-04-22T14:16:29.249 INFO:tasks.cephfs.filesystem:mapped states [u'up:active'] to up:active 2020-04-22T14:16:29.249 INFO:tasks.cephfs.filesystem:reached state 'up:active' in 4.53372001648s 2020-04-22T14:16:29.249 INFO:tasks.cephfs.mount:check lock on file background_file 2020-04-22T14:16:29.250 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:29.263 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:16:29.263 INFO:teuthology.orchestra.run.smithi103:> import fcntl 2020-04-22T14:16:29.263 INFO:teuthology.orchestra.run.smithi103:> import errno 2020-04-22T14:16:29.263 INFO:teuthology.orchestra.run.smithi103:> import struct 2020-04-22T14:16:29.263 INFO:teuthology.orchestra.run.smithi103:> f1 = open("/home/ubuntu/cephtest/mnt.1/background_file-1", '"'"'r'"'"') 2020-04-22T14:16:29.264 INFO:teuthology.orchestra.run.smithi103:> try: 2020-04-22T14:16:29.264 INFO:teuthology.orchestra.run.smithi103:> fcntl.flock(f1, fcntl.LOCK_EX | fcntl.LOCK_NB) 2020-04-22T14:16:29.264 INFO:teuthology.orchestra.run.smithi103:> except IOError as e: 2020-04-22T14:16:29.264 INFO:teuthology.orchestra.run.smithi103:> if e.errno == errno.EAGAIN: 2020-04-22T14:16:29.264 INFO:teuthology.orchestra.run.smithi103:> pass 2020-04-22T14:16:29.264 INFO:teuthology.orchestra.run.smithi103:> else: 2020-04-22T14:16:29.264 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("flock on file /home/ubuntu/cephtest/mnt.1/background_file-1 not found") 2020-04-22T14:16:29.265 INFO:teuthology.orchestra.run.smithi103:> f2 = open("/home/ubuntu/cephtest/mnt.1/background_file-2", '"'"'r'"'"') 2020-04-22T14:16:29.265 INFO:teuthology.orchestra.run.smithi103:> try: 2020-04-22T14:16:29.265 INFO:teuthology.orchestra.run.smithi103:> lockdata = struct.pack('"'"'hhllhh'"'"', fcntl.F_WRLCK, 0, 0, 0, 0, 0) 2020-04-22T14:16:29.265 INFO:teuthology.orchestra.run.smithi103:> fcntl.fcntl(f2, fcntl.F_SETLK, lockdata) 2020-04-22T14:16:29.265 INFO:teuthology.orchestra.run.smithi103:> except IOError as e: 2020-04-22T14:16:29.265 INFO:teuthology.orchestra.run.smithi103:> if e.errno == errno.EAGAIN: 2020-04-22T14:16:29.265 INFO:teuthology.orchestra.run.smithi103:> pass 2020-04-22T14:16:29.265 INFO:teuthology.orchestra.run.smithi103:> else: 2020-04-22T14:16:29.265 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("posix lock on file /home/ubuntu/cephtest/mnt.1/background_file-2 not found") 2020-04-22T14:16:29.266 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:16:29.365 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-04-22T14:16:29.365 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:16:29.382 INFO:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:16:29.474 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:29.488 INFO:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:16:29.577 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-04-22T14:16:29.578 INFO:tasks.cephfs.mount:Terminating background process 2020-04-22T14:16:29.578 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2020-04-22T14:16:29.578 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:29.592 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-04-22T14:16:29.592 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:16:29.669 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[100936]: fuse finished with error 0 and tester_r 0 2020-04-22T14:16:29.780 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:16:29.781 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:16:29.781 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:29.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:29.836 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:16:29.912 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:29.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:29.963 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down brx.0' 2020-04-22T14:16:30.123 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.0' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/44) 2020-04-22T14:16:30.123 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:30.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:30.138 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete brx.0' 2020-04-22T14:16:30.246 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.0' (64b8aecc-2558-4ca0-b85c-ec51c316d7af) successfully deleted. 2020-04-22T14:16:30.246 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:30.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:30.275 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:16:30.383 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:30.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:30.417 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:16:30.476 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:16:30.476 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:16:30.476 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:16:30.477 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:16:30.477 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:16:30.477 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:16:30.477 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:16:30.477 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:16:30.477 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:16:30.477 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:16:30.478 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:16:30.478 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:16:30.478 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:16:30.478 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:16:30.478 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:16:30.478 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 41850sec preferred_lft 41850sec 2020-04-22T14:16:30.478 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:16:30.478 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:16:30.479 INFO:teuthology.orchestra.run.smithi103.stdout:34: brx.1@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:16:30.479 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether d2:98:d4:1b:2c:0d brd ff:ff:ff:ff:ff:ff link-netnsid 1 2020-04-22T14:16:30.479 INFO:teuthology.orchestra.run.smithi103.stdout:35: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:16:30.479 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether a6:ff:ab:51:83:b6 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:16:30.479 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:16:30.479 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:16:30.480 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::94b4:9f79:eb94:ae6a/64 scope link noprefixroute 2020-04-22T14:16:30.480 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:16:30.480 INFO:teuthology.orchestra.run.smithi103.stdout:37: brx.2@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-04-22T14:16:30.480 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether a6:ff:ab:51:83:b6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2020-04-22T14:16:30.480 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:30.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:30.526 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:16:30.600 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:30.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:30.653 INFO:teuthology.orchestra.run.smithi103:> nmcli connection show 2020-04-22T14:16:30.728 INFO:teuthology.orchestra.run.smithi103.stdout:NAME UUID TYPE DEVICE 2020-04-22T14:16:30.728 INFO:teuthology.orchestra.run.smithi103.stdout:System enp3s0f1 b0a308d1-bd90-60af-eb7c-0183bb425a1a ethernet enp3s0f1 2020-04-22T14:16:30.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-brx 383228ff-5b5c-4b7b-a300-7e4b97f1129b bridge ceph-brx 2020-04-22T14:16:30.729 INFO:teuthology.orchestra.run.smithi103.stdout:brx.2 083685d5-d95c-425c-9287-8e11ffa4d170 ethernet brx.2 2020-04-22T14:16:30.729 INFO:teuthology.orchestra.run.smithi103.stdout:eno1 206ad60d-195e-4d4b-a9fe-a5dd1f33a67d ethernet -- 2020-04-22T14:16:30.729 INFO:teuthology.orchestra.run.smithi103.stdout:eno2 894a7dd2-d329-4985-9ef9-84a92c6e1c6c ethernet -- 2020-04-22T14:16:30.729 INFO:teuthology.orchestra.run.smithi103.stdout:enp3s0f0 5a3237ce-06ab-4ae0-818b-45bdf036cb08 ethernet -- 2020-04-22T14:16:30.729 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:30.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:30.776 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:16:30.835 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2020-04-22T14:16:30.835 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:30.884 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-04-22T14:16:30.884 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:16:30.962 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[102228]: fuse finished with error 0 and tester_r 0 2020-04-22T14:16:31.113 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-04-22T14:16:31.113 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:16:31.114 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:31.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:31.167 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:16:31.242 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:31.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:31.295 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down brx.2' 2020-04-22T14:16:31.404 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.2' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/45) 2020-04-22T14:16:31.405 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:31.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:31.422 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete brx.2' 2020-04-22T14:16:31.530 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.2' (083685d5-d95c-425c-9287-8e11ffa4d170) successfully deleted. 2020-04-22T14:16:31.530 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:31.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:31.558 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:16:31.667 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:31.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:31.691 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:16:31.758 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:16:31.758 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:16:31.758 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:16:31.759 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:16:31.759 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:16:31.759 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:16:31.759 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:16:31.759 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:16:31.759 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:16:31.759 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:16:31.760 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:16:31.760 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:16:31.760 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:16:31.760 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:16:31.760 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:16:31.760 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 41848sec preferred_lft 41848sec 2020-04-22T14:16:31.761 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:16:31.761 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:16:31.761 INFO:teuthology.orchestra.run.smithi103.stdout:34: brx.1@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:16:31.761 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether d2:98:d4:1b:2c:0d brd ff:ff:ff:ff:ff:ff link-netnsid 1 2020-04-22T14:16:31.761 INFO:teuthology.orchestra.run.smithi103.stdout:35: ceph-brx: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:16:31.761 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:16:31.761 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:16:31.762 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:16:31.762 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::94b4:9f79:eb94:ae6a/64 scope link noprefixroute 2020-04-22T14:16:31.762 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:16:31.762 INFO:teuthology.orchestra.run.smithi103.stdout:37: brx.2@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:16:31.762 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether a6:ff:ab:51:83:b6 brd ff:ff:ff:ff:ff:ff link-netnsid 2 2020-04-22T14:16:31.762 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:31.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:31.809 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:16:31.884 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:31.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:31.934 INFO:teuthology.orchestra.run.smithi103:> nmcli connection show 2020-04-22T14:16:32.017 INFO:teuthology.orchestra.run.smithi103.stdout:NAME UUID TYPE DEVICE 2020-04-22T14:16:32.018 INFO:teuthology.orchestra.run.smithi103.stdout:System enp3s0f1 b0a308d1-bd90-60af-eb7c-0183bb425a1a ethernet enp3s0f1 2020-04-22T14:16:32.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-brx 383228ff-5b5c-4b7b-a300-7e4b97f1129b bridge ceph-brx 2020-04-22T14:16:32.018 INFO:teuthology.orchestra.run.smithi103.stdout:eno1 206ad60d-195e-4d4b-a9fe-a5dd1f33a67d ethernet -- 2020-04-22T14:16:32.018 INFO:teuthology.orchestra.run.smithi103.stdout:eno2 894a7dd2-d329-4985-9ef9-84a92c6e1c6c ethernet -- 2020-04-22T14:16:32.018 INFO:teuthology.orchestra.run.smithi103.stdout:enp3s0f0 5a3237ce-06ab-4ae0-818b-45bdf036cb08 ethernet -- 2020-04-22T14:16:32.019 INFO:tasks.cephfs.mount:Removing the 'ceph-brx' 2020-04-22T14:16:32.019 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:32.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:32.056 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down ceph-brx' 2020-04-22T14:16:32.215 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/43) 2020-04-22T14:16:32.215 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:32.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:32.234 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete ceph-brx' 2020-04-22T14:16:32.342 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' (383228ff-5b5c-4b7b-a300-7e4b97f1129b) successfully deleted. 2020-04-22T14:16:32.343 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:32.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:32.374 INFO:teuthology.orchestra.run.smithi103:> route 2020-04-22T14:16:32.440 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2020-04-22T14:16:32.440 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-04-22T14:16:32.440 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 102 0 0 enp3s0f1 2020-04-22T14:16:32.440 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 102 0 0 enp3s0f1 2020-04-22T14:16:32.441 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:32.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:32.494 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -D FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-04-22T14:16:32.568 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:32.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:32.626 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -D FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-04-22T14:16:32.734 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:32.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:32.758 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -t nat -D POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-04-22T14:16:32.870 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:32.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:32.892 INFO:teuthology.orchestra.run.smithi103:> cat /tmp/python-ceph-brx 2020-04-22T14:16:32.953 INFO:teuthology.orchestra.run.smithi103.stdout:0 2020-04-22T14:16:32.953 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:32.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:32.999 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 0 > /proc/sys/net/ipv4/ip_forward' 2020-04-22T14:16:33.077 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:33.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:33.122 INFO:teuthology.orchestra.run.smithi103:> rm -f /tmp/python-ceph-brx 2020-04-22T14:16:33.181 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:33.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:33.235 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:16:33.295 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.2' netns for '/home/ubuntu/cephtest/mnt.2' 2020-04-22T14:16:33.295 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:16:33.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:33.319 INFO:teuthology.orchestra.run.smithi086:> ip addr 2020-04-22T14:16:33.375 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:16:33.375 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:16:33.375 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:16:33.375 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:16:33.376 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2020-04-22T14:16:33.376 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:16:33.376 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:16:33.376 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:16:33.376 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:16:33.376 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:16:33.376 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:16:33.377 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:16:33.377 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:16:33.377 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:16:33.377 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:16:33.377 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 41821sec preferred_lft 41821sec 2020-04-22T14:16:33.377 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2020-04-22T14:16:33.377 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:16:33.378 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:16:33.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:33.430 INFO:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.2) 2020-04-22T14:16:33.490 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.3' netns for '/home/ubuntu/cephtest/mnt.3' 2020-04-22T14:16:33.491 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:16:33.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:33.543 INFO:teuthology.orchestra.run.smithi086:> ip addr 2020-04-22T14:16:33.611 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:16:33.611 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:16:33.611 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:16:33.611 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:16:33.611 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2020-04-22T14:16:33.612 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:16:33.612 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:16:33.612 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:16:33.612 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:16:33.612 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:16:33.612 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:16:33.613 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:16:33.613 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:16:33.613 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:16:33.613 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:16:33.613 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 41820sec preferred_lft 41820sec 2020-04-22T14:16:33.613 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2020-04-22T14:16:33.614 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:16:33.614 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:16:33.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:33.661 INFO:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.3) 2020-04-22T14:16:33.731 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:33.746 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_filelock' 2020-04-22T14:16:33.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.890+0000 7f6132295700 1 Processor -- start 2020-04-22T14:16:33.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.891+0000 7f6132295700 1 -- start start 2020-04-22T14:16:33.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.891+0000 7f6132295700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f612c0ae1a0 0x7f612c14a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:33.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.891+0000 7f6132295700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f612c14a710 con 0x7f612c140320 2020-04-22T14:16:33.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.891+0000 7f6132295700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f612c1462f0 con 0x7f612c0bd1b0 2020-04-22T14:16:33.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.891+0000 7f6132295700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f612c146590 con 0x7f612c0ae1a0 2020-04-22T14:16:33.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.891+0000 7f612b7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f612c0ae1a0 0x7f612c14a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:33.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.891+0000 7f6130832700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f612c0bd1b0 0x7f612c0ac740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48544/0 (socket says 172.21.15.103:48544) 2020-04-22T14:16:33.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.891+0000 7f6130832700 1 -- 172.21.15.103:0/3847617722 learned_addr learned my addr 172.21.15.103:0/3847617722 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:33.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.892+0000 7f612b7fe700 1 -- 172.21.15.103:0/3847617722 >> v1:172.21.15.103:6789/0 conn(0x7f612c0bd1b0 legacy=0x7f612c0ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:33.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.892+0000 7f612b7fe700 1 -- 172.21.15.103:0/3847617722 >> v1:172.21.15.86:6789/0 conn(0x7f612c140320 legacy=0x7f612c146cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:33.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.892+0000 7f612affd700 1 -- 172.21.15.103:0/3847617722 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 319844127 0 0) 0x7f612c1462f0 con 0x7f612c0bd1b0 2020-04-22T14:16:33.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.892+0000 7f612b7fe700 1 -- 172.21.15.103:0/3847617722 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612c146830 con 0x7f612c0ae1a0 2020-04-22T14:16:33.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.892+0000 7f612b7fe700 1 --2- 172.21.15.103:0/3847617722 >> v2:172.21.15.103:3300/0 conn(0x7f612c0ae1a0 0x7f612c14a2b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f612c146bb0 tx=0x7f6120007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:33.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.892+0000 7f612b7fe700 1 --2- 172.21.15.103:0/3847617722 >> v2:172.21.15.103:3300/0 conn(0x7f612c0ae1a0 0x7f612c14a2b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f612c146bb0 tx=0x7f6120007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:33.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.892+0000 7f612b7fe700 1 --2- 172.21.15.103:0/3847617722 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f612c0ae1a0 0x7f612c14a2b0 secure :-1 s=READY pgs=1687 cs=0 l=1 rx=0x7f612c146bb0 tx=0x7f6120007a40).ready entity=mon.1 client_cookie=3c1d01d638540c77 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:33.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.892+0000 7f612b7fe700 1 --2- 172.21.15.103:0/3847617722 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f612c0ae1a0 0x7f612c14a2b0 secure :-1 s=THROTTLE_DONE pgs=1687 cs=0 l=1 rx=0x7f612c146bb0 tx=0x7f6120007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:33.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.892+0000 7f612b7fe700 1 --2- 172.21.15.103:0/3847617722 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f612c0ae1a0 0x7f612c14a2b0 secure :-1 s=THROTTLE_DONE pgs=1687 cs=0 l=1 rx=0x7f612c146bb0 tx=0x7f6120007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:33.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.892+0000 7f612affd700 1 -- 172.21.15.103:0/3847617722 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6120011430 con 0x7f612c0ae1a0 2020-04-22T14:16:33.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.892+0000 7f612b7fe700 1 --2- 172.21.15.103:0/3847617722 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f612c0ae1a0 0x7f612c14a2b0 secure :-1 s=THROTTLE_DONE pgs=1687 cs=0 l=1 rx=0x7f612c146bb0 tx=0x7f6120007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:33.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.892+0000 7f612affd700 1 -- 172.21.15.103:0/3847617722 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6120011590 con 0x7f612c0ae1a0 2020-04-22T14:16:33.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.892+0000 7f612affd700 1 -- 172.21.15.103:0/3847617722 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6120011970 con 0x7f612c0ae1a0 2020-04-22T14:16:33.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.892+0000 7f6132295700 1 -- 172.21.15.103:0/3847617722 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f612c0ae1a0 msgr2=0x7f612c14a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:33.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.892+0000 7f6132295700 1 --2- 172.21.15.103:0/3847617722 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f612c0ae1a0 0x7f612c14a2b0 secure :-1 s=READY pgs=1687 cs=0 l=1 rx=0x7f612c146bb0 tx=0x7f6120007a40).stop 2020-04-22T14:16:33.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.893+0000 7f6132295700 1 -- 172.21.15.103:0/3847617722 shutdown_connections 2020-04-22T14:16:33.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.893+0000 7f6132295700 1 --2- 172.21.15.103:0/3847617722 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f612c0ae1a0 0x7f612c14a2b0 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:33.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.893+0000 7f6132295700 1 -- 172.21.15.103:0/3847617722 >> 172.21.15.103:0/3847617722 conn(0x7f612c05f2c0 msgr2=0x7f612c0bcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:33.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.893+0000 7f6132295700 1 -- 172.21.15.103:0/3847617722 shutdown_connections 2020-04-22T14:16:33.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.893+0000 7f6132295700 1 -- 172.21.15.103:0/3847617722 wait complete. 2020-04-22T14:16:33.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.894+0000 7f6132295700 1 Processor -- start 2020-04-22T14:16:33.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.894+0000 7f6132295700 1 -- start start 2020-04-22T14:16:33.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.895+0000 7f6132295700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f612c140320 0x7f612c143690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:33.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.895+0000 7f6132295700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f612c158160 con 0x7f612c0bd1b0 2020-04-22T14:16:33.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.895+0000 7f6132295700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f612c0b2ac0 con 0x7f612c0ae1a0 2020-04-22T14:16:33.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.895+0000 7f6132295700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f612c0aff90 con 0x7f612c140320 2020-04-22T14:16:33.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.895+0000 7f612bfff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f612c0ae1a0 0x7f612c0af880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48548/0 (socket says 172.21.15.103:48548) 2020-04-22T14:16:33.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.895+0000 7f612bfff700 1 -- 172.21.15.103:0/1009934098 learned_addr learned my addr 172.21.15.103:0/1009934098 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:33.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.895+0000 7f6130832700 1 --2- 172.21.15.103:0/1009934098 >> v2:172.21.15.86:3300/0 conn(0x7f612c140320 0x7f612c143690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:33.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.895+0000 7f61297fa700 1 -- 172.21.15.103:0/1009934098 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1725338534 0 0) 0x7f612c0b2ac0 con 0x7f612c0ae1a0 2020-04-22T14:16:33.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.895+0000 7f61297fa700 1 -- 172.21.15.103:0/1009934098 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f610c002fe0 con 0x7f612c0ae1a0 2020-04-22T14:16:33.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.895+0000 7f61297fa700 1 -- 172.21.15.103:0/1009934098 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1149586264 0 0) 0x7f610c002fe0 con 0x7f612c0ae1a0 2020-04-22T14:16:33.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.895+0000 7f61297fa700 1 -- 172.21.15.103:0/1009934098 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f612c0b2ac0 con 0x7f612c0ae1a0 2020-04-22T14:16:33.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.895+0000 7f61297fa700 1 -- 172.21.15.103:0/1009934098 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f611c002910 con 0x7f612c0ae1a0 2020-04-22T14:16:33.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.895+0000 7f61297fa700 1 -- 172.21.15.103:0/1009934098 >> v2:172.21.15.86:3300/0 conn(0x7f612c140320 msgr2=0x7f612c143690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:33.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.895+0000 7f61297fa700 1 --2- 172.21.15.103:0/1009934098 >> v2:172.21.15.86:3300/0 conn(0x7f612c140320 0x7f612c143690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:33.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.895+0000 7f61297fa700 1 -- 172.21.15.103:0/1009934098 >> v1:172.21.15.103:6789/0 conn(0x7f612c0ae1a0 legacy=0x7f612c0af880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:33.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.895+0000 7f61297fa700 1 -- 172.21.15.103:0/1009934098 >> v1:172.21.15.86:6789/0 conn(0x7f612c0bd1b0 legacy=0x7f612c13f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:33.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.895+0000 7f61297fa700 1 --2- 172.21.15.103:0/1009934098 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f610c0049b0 0x7f610c004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:33.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.895+0000 7f61297fa700 1 --2- 172.21.15.103:0/1009934098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f610c003920 0x7f610c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:33.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.895+0000 7f61297fa700 1 --2- 172.21.15.103:0/1009934098 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f610c0041e0 0x7f610c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:33.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.895+0000 7f61297fa700 1 -- 172.21.15.103:0/1009934098 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612c0aff90 con 0x7f610c0049b0 2020-04-22T14:16:33.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.895+0000 7f61297fa700 1 -- 172.21.15.103:0/1009934098 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610c004690 con 0x7f610c003920 2020-04-22T14:16:33.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.895+0000 7f61297fa700 1 -- 172.21.15.103:0/1009934098 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610c00bbb0 con 0x7f610c0041e0 2020-04-22T14:16:33.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.895+0000 7f612b7fe700 1 --2- 172.21.15.103:0/1009934098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f610c003920 0x7f610c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:33.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.895+0000 7f612bfff700 1 --2- 172.21.15.103:0/1009934098 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f610c0049b0 0x7f610c004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:33.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.895+0000 7f6130832700 1 --2- 172.21.15.103:0/1009934098 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f610c0041e0 0x7f610c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:33.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.895+0000 7f612b7fe700 1 -- 172.21.15.103:0/1009934098 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f610c0041e0 msgr2=0x7f610c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:33.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.895+0000 7f612b7fe700 1 --2- 172.21.15.103:0/1009934098 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f610c0041e0 0x7f610c00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:33.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.895+0000 7f612b7fe700 1 -- 172.21.15.103:0/1009934098 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f610c0049b0 msgr2=0x7f610c004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:33.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.895+0000 7f612b7fe700 1 --2- 172.21.15.103:0/1009934098 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f610c0049b0 0x7f610c004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:33.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.896+0000 7f612b7fe700 1 -- 172.21.15.103:0/1009934098 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612c0b27b0 con 0x7f610c003920 2020-04-22T14:16:33.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.896+0000 7f6130832700 1 -- 172.21.15.103:0/1009934098 reap_dead start 2020-04-22T14:16:33.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.896+0000 7f6132295700 1 -- 172.21.15.103:0/1009934098 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f612c157da0 con 0x7f610c003920 2020-04-22T14:16:33.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.896+0000 7f612b7fe700 1 --2- 172.21.15.103:0/1009934098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f610c003920 0x7f610c003d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f612c142b60 tx=0x7f6120007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:33.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.896+0000 7f6132295700 1 -- 172.21.15.103:0/1009934098 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f612c143690 con 0x7f610c003920 2020-04-22T14:16:33.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.896+0000 7f612b7fe700 1 --2- 172.21.15.103:0/1009934098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f610c003920 0x7f610c003d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f612c142b60 tx=0x7f6120007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:33.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.896+0000 7f612b7fe700 1 --2- 172.21.15.103:0/1009934098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f610c003920 0x7f610c003d80 secure :-1 s=READY pgs=1689 cs=0 l=1 rx=0x7f612c142b60 tx=0x7f6120007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:33.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.896+0000 7f612b7fe700 1 --2- 172.21.15.103:0/1009934098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f610c003920 0x7f610c003d80 secure :-1 s=THROTTLE_DONE pgs=1689 cs=0 l=1 rx=0x7f612c142b60 tx=0x7f6120007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:33.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.896+0000 7f61297fa700 1 -- 172.21.15.103:0/1009934098 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6120011a10 con 0x7f610c003920 2020-04-22T14:16:33.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.896+0000 7f612b7fe700 1 --2- 172.21.15.103:0/1009934098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f610c003920 0x7f610c003d80 secure :-1 s=THROTTLE_DONE pgs=1689 cs=0 l=1 rx=0x7f612c142b60 tx=0x7f6120007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:33.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.896+0000 7f612b7fe700 1 --2- 172.21.15.103:0/1009934098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f610c003920 0x7f610c003d80 secure :-1 s=THROTTLE_DONE pgs=1689 cs=0 l=1 rx=0x7f612c142b60 tx=0x7f6120007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:33.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.896+0000 7f61297fa700 1 -- 172.21.15.103:0/1009934098 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61200058b0 con 0x7f610c003920 2020-04-22T14:16:33.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.896+0000 7f61297fa700 1 -- 172.21.15.103:0/1009934098 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6120005c90 con 0x7f610c003920 2020-04-22T14:16:33.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.896+0000 7f612b7fe700 1 --2- 172.21.15.103:0/1009934098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f610c003920 0x7f610c003d80 secure :-1 s=THROTTLE_DONE pgs=1689 cs=0 l=1 rx=0x7f612c142b60 tx=0x7f6120007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:33.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.897+0000 7f6132295700 1 -- 172.21.15.103:0/1009934098 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6108003340 con 0x7f610c003920 2020-04-22T14:16:33.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.897+0000 7f61297fa700 1 -- 172.21.15.103:0/1009934098 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f612000d460 con 0x7f610c003920 2020-04-22T14:16:33.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.897+0000 7f612b7fe700 1 --2- 172.21.15.103:0/1009934098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f610c003920 0x7f610c003d80 secure :-1 s=THROTTLE_DONE pgs=1689 cs=0 l=1 rx=0x7f612c142b60 tx=0x7f6120007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:33.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.897+0000 7f61297fa700 1 --2- 172.21.15.103:0/1009934098 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f610c051870 0x7f610c053d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:33.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.897+0000 7f61297fa700 1 -- 172.21.15.103:0/1009934098 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f61200619a0 con 0x7f610c003920 2020-04-22T14:16:33.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.897+0000 7f612bfff700 1 --2- 172.21.15.103:0/1009934098 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f610c051870 0x7f610c053d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:33.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.897+0000 7f612bfff700 1 --2- 172.21.15.103:0/1009934098 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f610c051870 0x7f610c053d30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f611c002620 tx=0x7f611c00b6a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:33.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.897+0000 7f612bfff700 1 --2- 172.21.15.103:0/1009934098 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f610c051870 0x7f610c053d30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f611c002620 tx=0x7f611c00b6a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:33.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.898+0000 7f612bfff700 1 --2- 172.21.15.103:0/1009934098 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f610c051870 0x7f610c053d30 secure :-1 s=READY pgs=613 cs=0 l=1 rx=0x7f611c002620 tx=0x7f611c00b6a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:33.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.901+0000 7f612b7fe700 1 --2- 172.21.15.103:0/1009934098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f610c003920 0x7f610c003d80 secure :-1 s=THROTTLE_DONE pgs=1689 cs=0 l=1 rx=0x7f612c142b60 tx=0x7f6120007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:33.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:33.901+0000 7f61297fa700 1 -- 172.21.15.103:0/1009934098 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f612003ce40 con 0x7f610c003920 2020-04-22T14:16:34.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.093+0000 7f6132295700 1 -- 172.21.15.103:0/1009934098 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_filelock"]} v 0) v1 -- 0x7f6108002260 con 0x7f610c003920 2020-04-22T14:16:34.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.665+0000 7f612b7fe700 1 --2- 172.21.15.103:0/1009934098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f610c003920 0x7f610c003d80 secure :-1 s=THROTTLE_DONE pgs=1689 cs=0 l=1 rx=0x7f612c142b60 tx=0x7f6120007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:34.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.665+0000 7f61297fa700 1 -- 172.21.15.103:0/1009934098 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_filelock"]}]=0 v608) v1 ==== 145+0+0 (secure 0 0 0) 0x7f6120040460 con 0x7f610c003920 2020-04-22T14:16:34.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.667+0000 7f6132295700 1 -- 172.21.15.103:0/1009934098 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f610c051870 msgr2=0x7f610c053d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:34.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.667+0000 7f6132295700 1 --2- 172.21.15.103:0/1009934098 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f610c051870 0x7f610c053d30 secure :-1 s=READY pgs=613 cs=0 l=1 rx=0x7f611c002620 tx=0x7f611c00b6a0).stop 2020-04-22T14:16:34.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.667+0000 7f6132295700 1 -- 172.21.15.103:0/1009934098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f610c003920 msgr2=0x7f610c003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:34.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.667+0000 7f6132295700 1 --2- 172.21.15.103:0/1009934098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f610c003920 0x7f610c003d80 secure :-1 s=READY pgs=1689 cs=0 l=1 rx=0x7f612c142b60 tx=0x7f6120007a40).stop 2020-04-22T14:16:34.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.667+0000 7f6132295700 1 -- 172.21.15.103:0/1009934098 shutdown_connections 2020-04-22T14:16:34.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.667+0000 7f6132295700 1 --2- 172.21.15.103:0/1009934098 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f610c051870 0x7f610c053d30 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:34.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.667+0000 7f6132295700 1 --2- 172.21.15.103:0/1009934098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f610c003920 0x7f610c003d80 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:34.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.667+0000 7f6132295700 1 -- 172.21.15.103:0/1009934098 >> 172.21.15.103:0/1009934098 conn(0x7f612c05f2c0 msgr2=0x7f612c148b30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:34.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.667+0000 7f6132295700 1 -- 172.21.15.103:0/1009934098 shutdown_connections 2020-04-22T14:16:34.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.667+0000 7f6132295700 1 -- 172.21.15.103:0/1009934098 wait complete. 2020-04-22T14:16:34.681 INFO:tasks.cephfs_test_runner:test_filelock (tasks.cephfs.test_client_recovery.TestClientRecovery) ... ok 2020-04-22T14:16:34.681 INFO:tasks.cephfs_test_runner:Starting test: test_filelock_eviction (tasks.cephfs.test_client_recovery.TestClientRecovery) 2020-04-22T14:16:34.681 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:34.696 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_filelock_eviction' 2020-04-22T14:16:34.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.840+0000 7ff0ac9e9700 1 Processor -- start 2020-04-22T14:16:34.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.840+0000 7ff0ac9e9700 1 -- start start 2020-04-22T14:16:34.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.841+0000 7ff0ac9e9700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff0a8067170 0x7ff0a80b6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:34.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.841+0000 7ff0ac9e9700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0a80ac740 0x7ff0a813c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:34.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.841+0000 7ff0ac9e9700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0a8064ec0 con 0x7ff0a813c7e0 2020-04-22T14:16:34.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.841+0000 7ff0ac9e9700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a8065af0 con 0x7ff0a8067170 2020-04-22T14:16:34.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.841+0000 7ff0ac9e9700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a8146870 con 0x7ff0a80ac740 2020-04-22T14:16:34.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.842+0000 7ff0a659c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff0a8067170 0x7ff0a80b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:34.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.842+0000 7ff0a5d9b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0a80ac740 0x7ff0a813c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:34.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.842+0000 7ff0a659c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff0a8067170 0x7ff0a80b6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:53604/0 (socket says 172.21.15.103:53604) 2020-04-22T14:16:34.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.842+0000 7ff0a659c700 1 -- 172.21.15.103:0/799162269 learned_addr learned my addr 172.21.15.103:0/799162269 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:34.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.842+0000 7ff0a5d9b700 1 -- 172.21.15.103:0/799162269 >> v2:172.21.15.86:3300/0 conn(0x7ff0a8067170 msgr2=0x7ff0a80b6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:34.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.842+0000 7ff0a5d9b700 1 --2- 172.21.15.103:0/799162269 >> v2:172.21.15.86:3300/0 conn(0x7ff0a8067170 0x7ff0a80b6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:34.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.842+0000 7ff0a5d9b700 1 -- 172.21.15.103:0/799162269 >> v1:172.21.15.86:6789/0 conn(0x7ff0a813c7e0 legacy=0x7ff0a80b4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:34.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.842+0000 7ff0a5d9b700 1 -- 172.21.15.103:0/799162269 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a8067550 con 0x7ff0a80ac740 2020-04-22T14:16:34.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.842+0000 7ff0a5d9b700 1 --2- 172.21.15.103:0/799162269 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0a80ac740 0x7ff0a813c380 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff098002f30 tx=0x7ff098007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:34.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.842+0000 7ff0a5d9b700 1 --2- 172.21.15.103:0/799162269 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0a80ac740 0x7ff0a813c380 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff098002f30 tx=0x7ff098007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:34.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.842+0000 7ff0a5d9b700 1 --2- 172.21.15.103:0/799162269 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0a80ac740 0x7ff0a813c380 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7ff098002f30 tx=0x7ff098007a40).ready entity=mon.2 client_cookie=d926585be4500dd3 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:34.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.842+0000 7ff0a5d9b700 1 --2- 172.21.15.103:0/799162269 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0a80ac740 0x7ff0a813c380 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7ff098002f30 tx=0x7ff098007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:34.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.842+0000 7ff0a559a700 1 -- 172.21.15.103:0/799162269 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0980113c0 con 0x7ff0a80ac740 2020-04-22T14:16:34.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.842+0000 7ff0a5d9b700 1 --2- 172.21.15.103:0/799162269 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0a80ac740 0x7ff0a813c380 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7ff098002f30 tx=0x7ff098007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:34.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.842+0000 7ff0a5d9b700 1 --2- 172.21.15.103:0/799162269 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0a80ac740 0x7ff0a813c380 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7ff098002f30 tx=0x7ff098007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:34.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.842+0000 7ff0a559a700 1 -- 172.21.15.103:0/799162269 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff098011560 con 0x7ff0a80ac740 2020-04-22T14:16:34.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.842+0000 7ff0a559a700 1 -- 172.21.15.103:0/799162269 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff098011980 con 0x7ff0a80ac740 2020-04-22T14:16:34.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.843+0000 7ff0ac9e9700 1 -- 172.21.15.103:0/799162269 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0a80ac740 msgr2=0x7ff0a813c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:34.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.843+0000 7ff0ac9e9700 1 --2- 172.21.15.103:0/799162269 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0a80ac740 0x7ff0a813c380 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7ff098002f30 tx=0x7ff098007a40).stop 2020-04-22T14:16:34.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.843+0000 7ff0ac9e9700 1 -- 172.21.15.103:0/799162269 shutdown_connections 2020-04-22T14:16:34.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.843+0000 7ff0ac9e9700 1 --2- 172.21.15.103:0/799162269 >> v2:172.21.15.86:3300/0 conn(0x7ff0a8067170 0x7ff0a80b6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:34.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.843+0000 7ff0ac9e9700 1 --2- 172.21.15.103:0/799162269 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0a80ac740 0x7ff0a813c380 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:34.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.843+0000 7ff0ac9e9700 1 -- 172.21.15.103:0/799162269 >> 172.21.15.103:0/799162269 conn(0x7ff0a80b9160 msgr2=0x7ff0a805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:34.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.843+0000 7ff0ac9e9700 1 -- 172.21.15.103:0/799162269 shutdown_connections 2020-04-22T14:16:34.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.843+0000 7ff0ac9e9700 1 -- 172.21.15.103:0/799162269 wait complete. 2020-04-22T14:16:34.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.844+0000 7ff0ac9e9700 1 Processor -- start 2020-04-22T14:16:34.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.844+0000 7ff0ac9e9700 1 -- start start 2020-04-22T14:16:34.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.845+0000 7ff0ac9e9700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff0a80ac740 0x7ff0a8151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:34.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.845+0000 7ff0ac9e9700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff0a813c7e0 0x7ff0a8145d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:34.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.845+0000 7ff0ac9e9700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0a8146160 con 0x7ff0a8067170 2020-04-22T14:16:34.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.845+0000 7ff0ac9e9700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a813b8e0 con 0x7ff0a80ac740 2020-04-22T14:16:34.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.845+0000 7ff0ac9e9700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a8140640 con 0x7ff0a813c7e0 2020-04-22T14:16:34.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.845+0000 7ff0a6d9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff0a813c7e0 0x7ff0a8145d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:34.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.845+0000 7ff0a6d9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff0a813c7e0 0x7ff0a8145d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56382/0 (socket says 172.21.15.103:56382) 2020-04-22T14:16:34.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.845+0000 7ff0a6d9d700 1 -- 172.21.15.103:0/2620417279 learned_addr learned my addr 172.21.15.103:0/2620417279 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:34.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.845+0000 7ff0a5d9b700 1 --2- 172.21.15.103:0/2620417279 >> v2:172.21.15.86:3300/0 conn(0x7ff0a80ac740 0x7ff0a8151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:34.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.845+0000 7ff0a6d9d700 1 -- 172.21.15.103:0/2620417279 >> v2:172.21.15.86:3300/0 conn(0x7ff0a80ac740 msgr2=0x7ff0a8151880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:34.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.845+0000 7ff0a6d9d700 1 --2- 172.21.15.103:0/2620417279 >> v2:172.21.15.86:3300/0 conn(0x7ff0a80ac740 0x7ff0a8151880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:34.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.845+0000 7ff0a6d9d700 1 -- 172.21.15.103:0/2620417279 >> v1:172.21.15.86:6789/0 conn(0x7ff0a8067170 legacy=0x7ff0a8142aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:34.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.845+0000 7ff0a6d9d700 1 -- 172.21.15.103:0/2620417279 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a81408e0 con 0x7ff0a813c7e0 2020-04-22T14:16:34.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.845+0000 7ff0a6d9d700 1 --2- 172.21.15.103:0/2620417279 >> v2:172.21.15.103:3300/0 conn(0x7ff0a813c7e0 0x7ff0a8145d00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff0a0001290 tx=0x7ff0a0010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:34.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.845+0000 7ff0a6d9d700 1 --2- 172.21.15.103:0/2620417279 >> v2:172.21.15.103:3300/0 conn(0x7ff0a813c7e0 0x7ff0a8145d00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff0a0001290 tx=0x7ff0a0010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:34.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.845+0000 7ff0a6d9d700 1 --2- 172.21.15.103:0/2620417279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0a813c7e0 0x7ff0a8145d00 secure :-1 s=READY pgs=1690 cs=0 l=1 rx=0x7ff0a0001290 tx=0x7ff0a0010ce0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:34.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.846+0000 7ff0a6d9d700 1 --2- 172.21.15.103:0/2620417279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0a813c7e0 0x7ff0a8145d00 secure :-1 s=THROTTLE_DONE pgs=1690 cs=0 l=1 rx=0x7ff0a0001290 tx=0x7ff0a0010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:34.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.846+0000 7ff09f7fe700 1 -- 172.21.15.103:0/2620417279 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0a00101e0 con 0x7ff0a813c7e0 2020-04-22T14:16:34.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.846+0000 7ff0a6d9d700 1 --2- 172.21.15.103:0/2620417279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0a813c7e0 0x7ff0a8145d00 secure :-1 s=THROTTLE_DONE pgs=1690 cs=0 l=1 rx=0x7ff0a0001290 tx=0x7ff0a0010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:34.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.846+0000 7ff0a6d9d700 1 --2- 172.21.15.103:0/2620417279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0a813c7e0 0x7ff0a8145d00 secure :-1 s=THROTTLE_DONE pgs=1690 cs=0 l=1 rx=0x7ff0a0001290 tx=0x7ff0a0010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:34.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.846+0000 7ff09f7fe700 1 -- 172.21.15.103:0/2620417279 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a0010380 con 0x7ff0a813c7e0 2020-04-22T14:16:34.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.846+0000 7ff0ac9e9700 1 -- 172.21.15.103:0/2620417279 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0a8140be0 con 0x7ff0a813c7e0 2020-04-22T14:16:34.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.846+0000 7ff09f7fe700 1 -- 172.21.15.103:0/2620417279 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0a00107a0 con 0x7ff0a813c7e0 2020-04-22T14:16:34.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.846+0000 7ff0ac9e9700 1 -- 172.21.15.103:0/2620417279 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0a8140410 con 0x7ff0a813c7e0 2020-04-22T14:16:34.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.846+0000 7ff0a6d9d700 1 --2- 172.21.15.103:0/2620417279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0a813c7e0 0x7ff0a8145d00 secure :-1 s=THROTTLE_DONE pgs=1690 cs=0 l=1 rx=0x7ff0a0001290 tx=0x7ff0a0010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:34.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.847+0000 7ff09f7fe700 1 -- 172.21.15.103:0/2620417279 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ff0a0006860 con 0x7ff0a813c7e0 2020-04-22T14:16:34.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.847+0000 7ff0a6d9d700 1 --2- 172.21.15.103:0/2620417279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0a813c7e0 0x7ff0a8145d00 secure :-1 s=THROTTLE_DONE pgs=1690 cs=0 l=1 rx=0x7ff0a0001290 tx=0x7ff0a0010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:34.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.847+0000 7ff0ac9e9700 1 -- 172.21.15.103:0/2620417279 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0a8056c90 con 0x7ff0a813c7e0 2020-04-22T14:16:34.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.847+0000 7ff09f7fe700 1 --2- 172.21.15.103:0/2620417279 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff08c04d900 0x7ff08c04fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:34.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.847+0000 7ff09f7fe700 1 -- 172.21.15.103:0/2620417279 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6159+0+0 (secure 0 0 0) 0x7ff0a0061540 con 0x7ff0a813c7e0 2020-04-22T14:16:34.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.847+0000 7ff0a659c700 1 --2- 172.21.15.103:0/2620417279 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff08c04d900 0x7ff08c04fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:34.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.847+0000 7ff0a659c700 1 --2- 172.21.15.103:0/2620417279 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff08c04d900 0x7ff08c04fdc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff0a813a7e0 tx=0x7ff090007700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:34.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.847+0000 7ff0a659c700 1 --2- 172.21.15.103:0/2620417279 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff08c04d900 0x7ff08c04fdc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff0a813a7e0 tx=0x7ff090007700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:34.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.847+0000 7ff0a659c700 1 --2- 172.21.15.103:0/2620417279 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff08c04d900 0x7ff08c04fdc0 secure :-1 s=READY pgs=614 cs=0 l=1 rx=0x7ff0a813a7e0 tx=0x7ff090007700).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:34.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.851+0000 7ff0a6d9d700 1 --2- 172.21.15.103:0/2620417279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0a813c7e0 0x7ff0a8145d00 secure :-1 s=THROTTLE_DONE pgs=1690 cs=0 l=1 rx=0x7ff0a0001290 tx=0x7ff0a0010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:34.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:34.851+0000 7ff09f7fe700 1 -- 172.21.15.103:0/2620417279 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ff0a003c980 con 0x7ff0a813c7e0 2020-04-22T14:16:35.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:35.045+0000 7ff0ac9e9700 1 -- 172.21.15.103:0/2620417279 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_filelock_eviction"]} v 0) v1 -- 0x7ff0a80b40c0 con 0x7ff0a813c7e0 2020-04-22T14:16:35.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:35.668+0000 7ff0a6d9d700 1 --2- 172.21.15.103:0/2620417279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0a813c7e0 0x7ff0a8145d00 secure :-1 s=THROTTLE_DONE pgs=1690 cs=0 l=1 rx=0x7ff0a0001290 tx=0x7ff0a0010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:35.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:35.668+0000 7ff09f7fe700 1 -- 172.21.15.103:0/2620417279 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_filelock_eviction"]}]=0 v609) v1 ==== 157+0+0 (secure 0 0 0) 0x7ff0a003ffa0 con 0x7ff0a813c7e0 2020-04-22T14:16:35.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:35.670+0000 7ff0ac9e9700 1 -- 172.21.15.103:0/2620417279 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff08c04d900 msgr2=0x7ff08c04fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:35.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:35.670+0000 7ff0ac9e9700 1 --2- 172.21.15.103:0/2620417279 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff08c04d900 0x7ff08c04fdc0 secure :-1 s=READY pgs=614 cs=0 l=1 rx=0x7ff0a813a7e0 tx=0x7ff090007700).stop 2020-04-22T14:16:35.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:35.670+0000 7ff0ac9e9700 1 -- 172.21.15.103:0/2620417279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0a813c7e0 msgr2=0x7ff0a8145d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:35.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:35.670+0000 7ff0ac9e9700 1 --2- 172.21.15.103:0/2620417279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0a813c7e0 0x7ff0a8145d00 secure :-1 s=READY pgs=1690 cs=0 l=1 rx=0x7ff0a0001290 tx=0x7ff0a0010ce0).stop 2020-04-22T14:16:35.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:35.670+0000 7ff0ac9e9700 1 -- 172.21.15.103:0/2620417279 shutdown_connections 2020-04-22T14:16:35.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:35.670+0000 7ff0ac9e9700 1 --2- 172.21.15.103:0/2620417279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0a813c7e0 0x7ff0a8145d00 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:35.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:35.670+0000 7ff0ac9e9700 1 --2- 172.21.15.103:0/2620417279 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff08c04d900 0x7ff08c04fdc0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:35.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:35.670+0000 7ff0ac9e9700 1 --2- 172.21.15.103:0/2620417279 >> v2:172.21.15.86:3300/0 conn(0x7ff0a80ac740 0x7ff0a8151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:35.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:35.670+0000 7ff0ac9e9700 1 -- 172.21.15.103:0/2620417279 >> 172.21.15.103:0/2620417279 conn(0x7ff0a80b9160 msgr2=0x7ff0a8137100 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:35.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:35.670+0000 7ff0ac9e9700 1 -- 172.21.15.103:0/2620417279 shutdown_connections 2020-04-22T14:16:35.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:35.670+0000 7ff0ac9e9700 1 -- 172.21.15.103:0/2620417279 wait complete. 2020-04-22T14:16:35.687 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-04-22T14:16:35.687 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:16:35.707 INFO:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:16:35.805 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:35.824 INFO:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:16:35.918 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-04-22T14:16:35.918 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:35.933 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2020-04-22T14:16:36.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.081+0000 7fa4c758d700 1 Processor -- start 2020-04-22T14:16:36.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.081+0000 7fa4c758d700 1 -- start start 2020-04-22T14:16:36.087 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.082+0000 7fa4c758d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa4c00b2940 0x7fa4c00b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:36.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.082+0000 7fa4c758d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa4c005f3e0 0x7fa4c0143880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:36.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.082+0000 7fa4c758d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4c0062950 con 0x7fa4c0143ce0 2020-04-22T14:16:36.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.082+0000 7fa4c758d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4c0062bf0 con 0x7fa4c00b2940 2020-04-22T14:16:36.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.082+0000 7fa4c758d700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4c0144430 con 0x7fa4c005f3e0 2020-04-22T14:16:36.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.082+0000 7fa4c4b28700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa4c005f3e0 0x7fa4c0143880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:36.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.082+0000 7fa4c4b28700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa4c005f3e0 0x7fa4c0143880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56388/0 (socket says 172.21.15.103:56388) 2020-04-22T14:16:36.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.082+0000 7fa4c4b28700 1 -- 172.21.15.103:0/2326772460 learned_addr learned my addr 172.21.15.103:0/2326772460 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:36.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.083+0000 7fa4c5329700 1 --2- 172.21.15.103:0/2326772460 >> v2:172.21.15.86:3300/0 conn(0x7fa4c00b2940 0x7fa4c00b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:36.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.083+0000 7fa4c4b28700 1 -- 172.21.15.103:0/2326772460 >> v2:172.21.15.86:3300/0 conn(0x7fa4c00b2940 msgr2=0x7fa4c00b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:36.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.083+0000 7fa4c4b28700 1 --2- 172.21.15.103:0/2326772460 >> v2:172.21.15.86:3300/0 conn(0x7fa4c00b2940 0x7fa4c00b40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:36.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.083+0000 7fa4c4b28700 1 -- 172.21.15.103:0/2326772460 >> v1:172.21.15.86:6789/0 conn(0x7fa4c0143ce0 legacy=0x7fa4c00b5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:36.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.083+0000 7fa4c4b28700 1 -- 172.21.15.103:0/2326772460 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c00b2d20 con 0x7fa4c005f3e0 2020-04-22T14:16:36.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.083+0000 7fa4c5329700 1 --2- 172.21.15.103:0/2326772460 >> v2:172.21.15.86:3300/0 conn(0x7fa4c00b2940 0x7fa4c00b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:16:36.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.083+0000 7fa4c4b28700 1 --2- 172.21.15.103:0/2326772460 >> v2:172.21.15.103:3300/0 conn(0x7fa4c005f3e0 0x7fa4c0143880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa4c0061b80 tx=0x7fa4b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.083+0000 7fa4c4b28700 1 --2- 172.21.15.103:0/2326772460 >> v2:172.21.15.103:3300/0 conn(0x7fa4c005f3e0 0x7fa4c0143880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa4c0061b80 tx=0x7fa4b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.083+0000 7fa4c4b28700 1 --2- 172.21.15.103:0/2326772460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4c005f3e0 0x7fa4c0143880 secure :-1 s=READY pgs=1691 cs=0 l=1 rx=0x7fa4c0061b80 tx=0x7fa4b4007a40).ready entity=mon.1 client_cookie=5e8cc01d5b00089c server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:36.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.083+0000 7fa4c4b28700 1 --2- 172.21.15.103:0/2326772460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4c005f3e0 0x7fa4c0143880 secure :-1 s=THROTTLE_DONE pgs=1691 cs=0 l=1 rx=0x7fa4c0061b80 tx=0x7fa4b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.083+0000 7fa4b3fff700 1 -- 172.21.15.103:0/2326772460 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4b40116e0 con 0x7fa4c005f3e0 2020-04-22T14:16:36.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.083+0000 7fa4c4b28700 1 --2- 172.21.15.103:0/2326772460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4c005f3e0 0x7fa4c0143880 secure :-1 s=THROTTLE_DONE pgs=1691 cs=0 l=1 rx=0x7fa4c0061b80 tx=0x7fa4b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.083+0000 7fa4b3fff700 1 -- 172.21.15.103:0/2326772460 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b4011840 con 0x7fa4c005f3e0 2020-04-22T14:16:36.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.083+0000 7fa4c4b28700 1 --2- 172.21.15.103:0/2326772460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4c005f3e0 0x7fa4c0143880 secure :-1 s=THROTTLE_DONE pgs=1691 cs=0 l=1 rx=0x7fa4c0061b80 tx=0x7fa4b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.083+0000 7fa4b3fff700 1 -- 172.21.15.103:0/2326772460 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4b4011c20 con 0x7fa4c005f3e0 2020-04-22T14:16:36.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.083+0000 7fa4c758d700 1 -- 172.21.15.103:0/2326772460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4c005f3e0 msgr2=0x7fa4c0143880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:36.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.083+0000 7fa4c758d700 1 --2- 172.21.15.103:0/2326772460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4c005f3e0 0x7fa4c0143880 secure :-1 s=READY pgs=1691 cs=0 l=1 rx=0x7fa4c0061b80 tx=0x7fa4b4007a40).stop 2020-04-22T14:16:36.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.084+0000 7fa4c758d700 1 -- 172.21.15.103:0/2326772460 shutdown_connections 2020-04-22T14:16:36.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.084+0000 7fa4c758d700 1 --2- 172.21.15.103:0/2326772460 >> v2:172.21.15.86:3300/0 conn(0x7fa4c00b2940 0x7fa4c00b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:36.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.084+0000 7fa4c758d700 1 --2- 172.21.15.103:0/2326772460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4c005f3e0 0x7fa4c0143880 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:36.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.084+0000 7fa4c758d700 1 -- 172.21.15.103:0/2326772460 >> 172.21.15.103:0/2326772460 conn(0x7fa4c005ad30 msgr2=0x7fa4c005b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:36.092 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.084+0000 7fa4c758d700 1 -- 172.21.15.103:0/2326772460 shutdown_connections 2020-04-22T14:16:36.092 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.084+0000 7fa4c758d700 1 -- 172.21.15.103:0/2326772460 wait complete. 2020-04-22T14:16:36.092 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.085+0000 7fa4c758d700 1 Processor -- start 2020-04-22T14:16:36.092 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.085+0000 7fa4c758d700 1 -- start start 2020-04-22T14:16:36.095 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.085+0000 7fa4c758d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4c005f3e0 0x7fa4c0066710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:36.095 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.085+0000 7fa4c758d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa4c00b2940 0x7fa4c0146440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:36.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.085+0000 7fa4c758d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4c01468a0 con 0x7fa4c0143ce0 2020-04-22T14:16:36.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.085+0000 7fa4c758d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4c0064fe0 con 0x7fa4c00b2940 2020-04-22T14:16:36.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.085+0000 7fa4c758d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c0066c90 con 0x7fa4c005f3e0 2020-04-22T14:16:36.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.085+0000 7fa4c4b28700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa4c00b2940 0x7fa4c0146440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:36.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.085+0000 7fa4c4b28700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa4c00b2940 0x7fa4c0146440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:53626/0 (socket says 172.21.15.103:53626) 2020-04-22T14:16:36.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.085+0000 7fa4c4b28700 1 -- 172.21.15.103:0/2198148823 learned_addr learned my addr 172.21.15.103:0/2198148823 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:36.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.085+0000 7fa4c5329700 1 --2- 172.21.15.103:0/2198148823 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4c005f3e0 0x7fa4c0066710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:36.097 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.086+0000 7fa4c4b28700 1 -- 172.21.15.103:0/2198148823 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4c005f3e0 msgr2=0x7fa4c0066710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:36.097 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.086+0000 7fa4c4b28700 1 --2- 172.21.15.103:0/2198148823 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4c005f3e0 0x7fa4c0066710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:36.097 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.086+0000 7fa4b27fc700 1 -- 172.21.15.103:0/2198148823 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2210495898 0 0) 0x7fa4bc000fb0 con 0x7fa4c0143ce0 2020-04-22T14:16:36.097 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.086+0000 7fa4c4b28700 1 -- 172.21.15.103:0/2198148823 >> v1:172.21.15.86:6789/0 conn(0x7fa4c0143ce0 legacy=0x7fa4c00b83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:36.097 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.086+0000 7fa4c4b28700 1 -- 172.21.15.103:0/2198148823 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c00651d0 con 0x7fa4c00b2940 2020-04-22T14:16:36.097 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.086+0000 7fa4c5329700 1 --2- 172.21.15.103:0/2198148823 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4c005f3e0 0x7fa4c0066710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:16:36.097 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.086+0000 7fa4c4b28700 1 --2- 172.21.15.103:0/2198148823 >> v2:172.21.15.86:3300/0 conn(0x7fa4c00b2940 0x7fa4c0146440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa4c0061b80 tx=0x7fa4b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.097 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.086+0000 7fa4c4b28700 1 --2- 172.21.15.103:0/2198148823 >> v2:172.21.15.86:3300/0 conn(0x7fa4c00b2940 0x7fa4c0146440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa4c0061b80 tx=0x7fa4b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.098 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.086+0000 7fa4c4b28700 1 --2- 172.21.15.103:0/2198148823 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4c00b2940 0x7fa4c0146440 secure :-1 s=READY pgs=905 cs=0 l=1 rx=0x7fa4c0061b80 tx=0x7fa4b4007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:36.098 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.086+0000 7fa4c4b28700 1 --2- 172.21.15.103:0/2198148823 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4c00b2940 0x7fa4c0146440 secure :-1 s=THROTTLE_DONE pgs=905 cs=0 l=1 rx=0x7fa4c0061b80 tx=0x7fa4b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.098 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.086+0000 7fa4b27fc700 1 -- 172.21.15.103:0/2198148823 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4b4007360 con 0x7fa4c00b2940 2020-04-22T14:16:36.098 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.086+0000 7fa4c4b28700 1 --2- 172.21.15.103:0/2198148823 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4c00b2940 0x7fa4c0146440 secure :-1 s=THROTTLE_DONE pgs=905 cs=0 l=1 rx=0x7fa4c0061b80 tx=0x7fa4b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.098 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.086+0000 7fa4c758d700 1 -- 172.21.15.103:0/2198148823 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4c01558d0 con 0x7fa4c00b2940 2020-04-22T14:16:36.098 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.086+0000 7fa4b27fc700 1 -- 172.21.15.103:0/2198148823 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b40074c0 con 0x7fa4c00b2940 2020-04-22T14:16:36.098 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.086+0000 7fa4c4b28700 1 --2- 172.21.15.103:0/2198148823 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4c00b2940 0x7fa4c0146440 secure :-1 s=THROTTLE_DONE pgs=905 cs=0 l=1 rx=0x7fa4c0061b80 tx=0x7fa4b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.099 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.086+0000 7fa4b27fc700 1 -- 172.21.15.103:0/2198148823 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4b40058b0 con 0x7fa4c00b2940 2020-04-22T14:16:36.099 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.086+0000 7fa4c758d700 1 -- 172.21.15.103:0/2198148823 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c0155dc0 con 0x7fa4c00b2940 2020-04-22T14:16:36.099 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.087+0000 7fa4c4b28700 1 --2- 172.21.15.103:0/2198148823 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4c00b2940 0x7fa4c0146440 secure :-1 s=THROTTLE_DONE pgs=905 cs=0 l=1 rx=0x7fa4c0061b80 tx=0x7fa4b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.099 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.087+0000 7fa4c758d700 1 -- 172.21.15.103:0/2198148823 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4c0056c90 con 0x7fa4c00b2940 2020-04-22T14:16:36.099 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.087+0000 7fa4b27fc700 1 -- 172.21.15.103:0/2198148823 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fa4b4005b30 con 0x7fa4c00b2940 2020-04-22T14:16:36.099 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.087+0000 7fa4c4b28700 1 --2- 172.21.15.103:0/2198148823 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4c00b2940 0x7fa4c0146440 secure :-1 s=THROTTLE_DONE pgs=905 cs=0 l=1 rx=0x7fa4c0061b80 tx=0x7fa4b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.099 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.088+0000 7fa4b27fc700 1 --2- 172.21.15.103:0/2198148823 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa4a004d8a0 0x7fa4a004fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:36.100 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.088+0000 7fa4b27fc700 1 -- 172.21.15.103:0/2198148823 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fa4b4061ca0 con 0x7fa4c00b2940 2020-04-22T14:16:36.100 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.088+0000 7fa4c5329700 1 --2- 172.21.15.103:0/2198148823 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa4a004d8a0 0x7fa4a004fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:36.100 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.088+0000 7fa4c5329700 1 --2- 172.21.15.103:0/2198148823 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa4a004d8a0 0x7fa4a004fd60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa4b80032b0 tx=0x7fa4b800b770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.100 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.088+0000 7fa4c5329700 1 --2- 172.21.15.103:0/2198148823 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa4a004d8a0 0x7fa4a004fd60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa4b80032b0 tx=0x7fa4b800b770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.100 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.088+0000 7fa4c5329700 1 --2- 172.21.15.103:0/2198148823 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa4a004d8a0 0x7fa4a004fd60 secure :-1 s=READY pgs=615 cs=0 l=1 rx=0x7fa4b80032b0 tx=0x7fa4b800b770).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:36.100 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.091+0000 7fa4c4b28700 1 --2- 172.21.15.103:0/2198148823 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4c00b2940 0x7fa4c0146440 secure :-1 s=THROTTLE_DONE pgs=905 cs=0 l=1 rx=0x7fa4c0061b80 tx=0x7fa4b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.100 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.091+0000 7fa4b27fc700 1 -- 172.21.15.103:0/2198148823 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fa4b403d1a0 con 0x7fa4c00b2940 2020-04-22T14:16:36.238 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.235+0000 7fa4c758d700 1 -- 172.21.15.103:0/2198148823 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa4c006a8b0 con 0x7fa4c00b2940 2020-04-22T14:16:36.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.236+0000 7fa4c4b28700 1 --2- 172.21.15.103:0/2198148823 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4c00b2940 0x7fa4c0146440 secure :-1 s=THROTTLE_DONE pgs=905 cs=0 l=1 rx=0x7fa4c0061b80 tx=0x7fa4b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.236+0000 7fa4b27fc700 1 -- 172.21.15.103:0/2198148823 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v115) v1 ==== 81+0+33866 (secure 0 0 0) 0x7fa4b40407c0 con 0x7fa4c00b2940 2020-04-22T14:16:36.240 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:16:36.240 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:16:36.240 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 115, 2020-04-22T14:16:36.240 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:16:36.240 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2020-04-22T14:02:06.484738+0000", 2020-04-22T14:16:36.241 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2020-04-22T14:16:24.141639+0000", 2020-04-22T14:16:36.241 INFO:teuthology.orchestra.run.smithi103.stdout: "last_up_change": "2020-04-22T14:02:18.623774+0000", 2020-04-22T14:16:36.241 INFO:teuthology.orchestra.run.smithi103.stdout: "last_in_change": "2020-04-22T14:02:18.623774+0000", 2020-04-22T14:16:36.241 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-04-22T14:16:36.241 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_num": 5799936, 2020-04-22T14:16:36.241 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_set": [ 2020-04-22T14:16:36.241 INFO:teuthology.orchestra.run.smithi103.stdout: "pglog_hardlimit", 2020-04-22T14:16:36.241 INFO:teuthology.orchestra.run.smithi103.stdout: "purged_snapdirs", 2020-04-22T14:16:36.242 INFO:teuthology.orchestra.run.smithi103.stdout: "recovery_deletes", 2020-04-22T14:16:36.242 INFO:teuthology.orchestra.run.smithi103.stdout: "sortbitwise" 2020-04-22T14:16:36.242 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:16:36.242 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_version": 5, 2020-04-22T14:16:36.242 INFO:teuthology.orchestra.run.smithi103.stdout: "full_ratio": 0.94999998807907104, 2020-04-22T14:16:36.242 INFO:teuthology.orchestra.run.smithi103.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-04-22T14:16:36.242 INFO:teuthology.orchestra.run.smithi103.stdout: "nearfull_ratio": 0.85000002384185791, 2020-04-22T14:16:36.243 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_snapshot": "", 2020-04-22T14:16:36.243 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_max": 20, 2020-04-22T14:16:36.243 INFO:teuthology.orchestra.run.smithi103.stdout: "max_osd": 8, 2020-04-22T14:16:36.243 INFO:teuthology.orchestra.run.smithi103.stdout: "require_min_compat_client": "luminous", 2020-04-22T14:16:36.243 INFO:teuthology.orchestra.run.smithi103.stdout: "min_compat_client": "jewel", 2020-04-22T14:16:36.243 INFO:teuthology.orchestra.run.smithi103.stdout: "require_osd_release": "pacific", 2020-04-22T14:16:36.243 INFO:teuthology.orchestra.run.smithi103.stdout: "pools": [ 2020-04-22T14:16:36.243 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.244 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 1, 2020-04-22T14:16:36.244 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "device_health_metrics", 2020-04-22T14:16:36.244 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:02:09.565655+0000", 2020-04-22T14:16:36.244 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:16:36.245 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:16:36.245 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:16:36.245 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:16:36.245 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:16:36.245 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:16:36.246 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:16:36.246 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:16:36.246 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 1, 2020-04-22T14:16:36.246 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 1, 2020-04-22T14:16:36.246 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 1, 2020-04-22T14:16:36.246 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 1, 2020-04-22T14:16:36.246 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 1, 2020-04-22T14:16:36.246 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:16:36.247 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:16:36.247 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:16:36.248 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:16:36.248 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:16:36.248 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:16:36.248 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:16:36.248 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.248 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "17", 2020-04-22T14:16:36.248 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:16:36.249 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:16:36.249 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:16:36.249 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:16:36.249 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:16:36.249 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:16:36.249 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:16:36.250 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:16:36.250 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:16:36.250 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:16:36.250 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:16:36.250 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:16:36.250 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:16:36.251 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:16:36.251 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:16:36.251 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:16:36.251 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:16:36.251 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:16:36.251 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:16:36.251 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:16:36.252 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:16:36.252 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:16:36.252 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:16:36.252 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:16:36.252 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:16:36.252 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:16:36.253 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.253 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:16:36.253 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:16:36.253 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:16:36.253 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:16:36.253 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:16:36.253 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:16:36.253 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:16:36.254 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:16:36.254 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:16:36.254 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:16:36.254 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:16:36.254 INFO:teuthology.orchestra.run.smithi103.stdout: "options": { 2020-04-22T14:16:36.254 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_min": 1 2020-04-22T14:16:36.255 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.255 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:16:36.255 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_devicehealth": {} 2020-04-22T14:16:36.255 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.255 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.255 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.255 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 2, 2020-04-22T14:16:36.256 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "rbd", 2020-04-22T14:16:36.256 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:02:22.733031+0000", 2020-04-22T14:16:36.256 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:16:36.256 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:16:36.256 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:16:36.256 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:16:36.256 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:16:36.257 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:16:36.257 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:16:36.257 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:16:36.257 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 8, 2020-04-22T14:16:36.257 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 8, 2020-04-22T14:16:36.257 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 8, 2020-04-22T14:16:36.257 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 8, 2020-04-22T14:16:36.257 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 8, 2020-04-22T14:16:36.258 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:16:36.258 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:16:36.258 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:16:36.258 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:16:36.258 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:16:36.264 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:16:36.265 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:16:36.265 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.265 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "20", 2020-04-22T14:16:36.265 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:16:36.265 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:16:36.270 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:16:36.270 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:16:36.271 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:16:36.271 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:16:36.271 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:16:36.271 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:16:36.271 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:16:36.271 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:16:36.271 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:16:36.272 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:16:36.272 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:16:36.272 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:16:36.272 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:16:36.272 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:16:36.272 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:16:36.272 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:16:36.273 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:16:36.273 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:16:36.273 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:16:36.273 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:16:36.273 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:16:36.273 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:16:36.273 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:16:36.273 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:16:36.274 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.274 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:16:36.274 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:16:36.274 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:16:36.274 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:16:36.274 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:16:36.275 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:16:36.275 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:16:36.275 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:16:36.275 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:16:36.276 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:16:36.276 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:16:36.276 INFO:teuthology.orchestra.run.smithi103.stdout: "options": {}, 2020-04-22T14:16:36.276 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:16:36.276 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd": {} 2020-04-22T14:16:36.276 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.277 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.277 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.277 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 19, 2020-04-22T14:16:36.277 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "cephfs_metadata", 2020-04-22T14:16:36.277 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:16:02.890350+0000", 2020-04-22T14:16:36.277 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:16:36.277 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:16:36.277 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:16:36.278 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:16:36.278 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:16:36.278 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:16:36.278 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:16:36.278 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:16:36.278 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 8, 2020-04-22T14:16:36.278 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 8, 2020-04-22T14:16:36.279 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 8, 2020-04-22T14:16:36.279 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 8, 2020-04-22T14:16:36.279 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 8, 2020-04-22T14:16:36.279 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:16:36.279 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:16:36.279 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:16:36.279 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:16:36.279 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:16:36.280 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:16:36.280 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:16:36.280 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.280 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "112", 2020-04-22T14:16:36.280 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:16:36.280 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:16:36.280 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:16:36.281 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:16:36.281 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:16:36.281 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:16:36.281 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:16:36.281 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:16:36.281 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:16:36.281 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:16:36.281 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:16:36.282 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:16:36.282 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:16:36.282 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:16:36.282 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:16:36.282 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:16:36.282 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:16:36.282 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:16:36.282 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:16:36.283 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:16:36.283 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:16:36.283 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:16:36.283 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:16:36.283 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:16:36.283 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:16:36.283 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:16:36.284 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.284 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:16:36.284 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:16:36.284 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:16:36.284 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:16:36.284 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:16:36.284 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:16:36.284 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:16:36.285 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:16:36.285 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:16:36.285 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:16:36.285 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:16:36.285 INFO:teuthology.orchestra.run.smithi103.stdout: "options": { 2020-04-22T14:16:36.285 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_bias": 4, 2020-04-22T14:16:36.285 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_min": 16, 2020-04-22T14:16:36.285 INFO:teuthology.orchestra.run.smithi103.stdout: "recovery_priority": 5 2020-04-22T14:16:36.286 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.286 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:16:36.286 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs": { 2020-04-22T14:16:36.286 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": "cephfs" 2020-04-22T14:16:36.286 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.286 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.286 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.287 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.287 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 20, 2020-04-22T14:16:36.287 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "cephfs_data", 2020-04-22T14:16:36.287 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:16:03.893169+0000", 2020-04-22T14:16:36.287 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:16:36.287 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:16:36.287 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:16:36.288 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:16:36.288 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:16:36.288 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:16:36.288 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:16:36.288 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:16:36.288 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 8, 2020-04-22T14:16:36.288 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 8, 2020-04-22T14:16:36.288 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 8, 2020-04-22T14:16:36.289 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 8, 2020-04-22T14:16:36.289 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 8, 2020-04-22T14:16:36.289 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:16:36.289 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:16:36.289 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:16:36.289 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:16:36.289 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:16:36.290 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:16:36.290 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:16:36.290 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.290 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "113", 2020-04-22T14:16:36.290 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:16:36.290 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:16:36.290 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:16:36.290 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:16:36.291 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:16:36.291 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:16:36.291 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:16:36.291 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:16:36.291 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:16:36.291 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:16:36.291 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:16:36.292 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:16:36.292 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:16:36.292 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:16:36.292 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:16:36.292 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:16:36.292 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:16:36.292 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:16:36.293 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:16:36.293 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:16:36.293 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:16:36.293 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:16:36.293 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:16:36.293 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:16:36.294 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:16:36.294 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:16:36.294 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.294 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:16:36.294 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:16:36.294 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:16:36.294 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:16:36.294 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:16:36.295 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:16:36.295 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:16:36.295 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:16:36.295 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:16:36.295 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:16:36.295 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:16:36.295 INFO:teuthology.orchestra.run.smithi103.stdout: "options": {}, 2020-04-22T14:16:36.295 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:16:36.296 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs": { 2020-04-22T14:16:36.296 INFO:teuthology.orchestra.run.smithi103.stdout: "data": "cephfs" 2020-04-22T14:16:36.296 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.296 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.296 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.296 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:16:36.296 INFO:teuthology.orchestra.run.smithi103.stdout: "osds": [ 2020-04-22T14:16:36.297 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.297 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 0, 2020-04-22T14:16:36.297 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "3546145b-bd93-4a79-b6fe-3158153b8f05", 2020-04-22T14:16:36.297 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:16:36.297 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:16:36.297 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:16:36.297 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:16:36.297 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:16:36.298 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:16:36.298 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:16:36.298 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 111, 2020-04-22T14:16:36.298 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:16:36.298 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:16:36.298 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:16:36.298 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:16:36.299 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.299 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:16:36.299 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6800", 2020-04-22T14:16:36.299 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:16:36.299 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.299 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.299 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:16:36.299 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6801", 2020-04-22T14:16:36.300 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:16:36.300 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.300 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:36.300 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.300 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:16:36.300 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:16:36.300 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.300 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:16:36.301 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6802", 2020-04-22T14:16:36.301 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:16:36.301 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.301 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.301 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:16:36.301 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6803", 2020-04-22T14:16:36.301 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:16:36.302 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.302 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:36.302 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.302 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:16:36.302 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:16:36.302 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.302 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:16:36.302 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6806", 2020-04-22T14:16:36.303 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:16:36.303 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.303 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.303 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:16:36.303 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6807", 2020-04-22T14:16:36.303 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:16:36.303 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.303 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:36.304 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.304 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:16:36.304 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:16:36.304 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.304 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:16:36.304 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6804", 2020-04-22T14:16:36.304 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:16:36.305 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.305 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.305 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:16:36.305 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6805", 2020-04-22T14:16:36.305 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:16:36.305 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.305 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:36.305 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.306 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6801/33072", 2020-04-22T14:16:36.306 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6803/33072", 2020-04-22T14:16:36.306 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6807/33072", 2020-04-22T14:16:36.306 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6805/33072", 2020-04-22T14:16:36.306 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:16:36.306 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:16:36.306 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:16:36.306 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:36.307 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.307 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.307 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 1, 2020-04-22T14:16:36.307 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "65ca5f7d-2ea6-4de6-a034-08a0a99aa80d", 2020-04-22T14:16:36.307 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:16:36.307 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:16:36.307 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:16:36.307 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:16:36.308 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:16:36.308 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:16:36.308 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:16:36.308 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 111, 2020-04-22T14:16:36.308 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:16:36.308 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:16:36.308 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:16:36.309 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:16:36.309 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.309 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:16:36.309 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6808", 2020-04-22T14:16:36.309 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:16:36.309 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.309 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.310 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:16:36.310 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6809", 2020-04-22T14:16:36.310 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:16:36.310 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.310 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:36.310 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.310 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:16:36.310 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:16:36.311 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.311 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:16:36.311 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6810", 2020-04-22T14:16:36.311 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:16:36.311 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.311 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.311 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:16:36.311 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6811", 2020-04-22T14:16:36.312 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:16:36.312 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.312 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:36.312 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.312 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:16:36.312 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:16:36.312 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.312 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:16:36.313 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6814", 2020-04-22T14:16:36.313 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:16:36.313 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.313 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.313 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:16:36.313 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6815", 2020-04-22T14:16:36.313 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:16:36.314 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.314 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:36.314 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.314 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:16:36.314 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:16:36.314 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.314 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:16:36.314 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6812", 2020-04-22T14:16:36.315 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:16:36.315 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.315 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.315 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:16:36.315 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6813", 2020-04-22T14:16:36.315 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:16:36.315 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.315 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:36.316 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.316 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6809/33103", 2020-04-22T14:16:36.316 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6811/33103", 2020-04-22T14:16:36.316 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6815/33103", 2020-04-22T14:16:36.316 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6813/33103", 2020-04-22T14:16:36.316 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:16:36.316 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:16:36.317 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:16:36.317 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:36.317 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.317 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.317 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 2, 2020-04-22T14:16:36.317 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "f2e9bf44-c844-48d7-b6c2-f08ea71189b4", 2020-04-22T14:16:36.318 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:16:36.318 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:16:36.318 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:16:36.318 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:16:36.318 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:16:36.318 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:16:36.318 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:16:36.319 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 109, 2020-04-22T14:16:36.319 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:16:36.323 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:16:36.323 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:16:36.323 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:16:36.323 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.323 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:16:36.323 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6816", 2020-04-22T14:16:36.323 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:16:36.324 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.324 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.324 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:16:36.324 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6817", 2020-04-22T14:16:36.324 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:16:36.324 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.325 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:36.325 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.325 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:16:36.325 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:16:36.325 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.325 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:16:36.325 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6818", 2020-04-22T14:16:36.326 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:16:36.326 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.326 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.326 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:16:36.326 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6819", 2020-04-22T14:16:36.326 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:16:36.326 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.326 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:36.327 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.327 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:16:36.327 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:16:36.327 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.327 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:16:36.327 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6822", 2020-04-22T14:16:36.327 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:16:36.328 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.328 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.328 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:16:36.328 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6823", 2020-04-22T14:16:36.328 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:16:36.328 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.328 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:36.329 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.329 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:16:36.329 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:16:36.329 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.329 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:16:36.329 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6820", 2020-04-22T14:16:36.330 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:16:36.330 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.330 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.330 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:16:36.330 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6821", 2020-04-22T14:16:36.330 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:16:36.330 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.331 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:36.331 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.331 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6817/33153", 2020-04-22T14:16:36.331 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6819/33153", 2020-04-22T14:16:36.331 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6823/33153", 2020-04-22T14:16:36.331 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6821/33153", 2020-04-22T14:16:36.331 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:16:36.331 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:16:36.332 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:16:36.332 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:36.332 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.332 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.332 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 3, 2020-04-22T14:16:36.332 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "0ab87fee-a427-4906-851a-b9bd8c2e5645", 2020-04-22T14:16:36.332 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:16:36.333 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:16:36.333 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:16:36.333 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:16:36.333 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:16:36.333 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:16:36.333 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:16:36.333 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 111, 2020-04-22T14:16:36.333 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:16:36.334 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:16:36.334 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:16:36.334 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:16:36.334 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.334 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:16:36.334 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6824", 2020-04-22T14:16:36.334 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:16:36.335 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.335 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.335 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:16:36.335 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6825", 2020-04-22T14:16:36.335 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:16:36.335 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.335 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:36.335 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.336 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:16:36.336 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:16:36.336 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.336 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:16:36.336 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6826", 2020-04-22T14:16:36.336 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:16:36.336 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.337 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.337 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:16:36.337 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6827", 2020-04-22T14:16:36.337 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:16:36.337 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.337 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:36.337 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.337 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:16:36.338 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:16:36.338 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.338 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:16:36.338 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6830", 2020-04-22T14:16:36.338 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:16:36.338 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.338 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.339 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:16:36.339 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6831", 2020-04-22T14:16:36.339 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:16:36.339 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.339 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:36.339 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.339 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:16:36.339 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:16:36.340 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.340 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:16:36.340 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6828", 2020-04-22T14:16:36.340 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:16:36.340 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.340 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.340 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:16:36.341 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6829", 2020-04-22T14:16:36.341 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:16:36.341 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.341 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:36.341 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.341 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6825/33183", 2020-04-22T14:16:36.341 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6827/33183", 2020-04-22T14:16:36.341 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6831/33183", 2020-04-22T14:16:36.342 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6829/33183", 2020-04-22T14:16:36.342 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:16:36.342 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:16:36.342 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:16:36.342 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:36.342 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.342 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.343 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 4, 2020-04-22T14:16:36.343 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "2565df7d-2eff-484b-a3cd-ed7715e5d875", 2020-04-22T14:16:36.343 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:16:36.343 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:16:36.343 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:16:36.343 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:16:36.343 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:16:36.343 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:16:36.344 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:16:36.344 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 109, 2020-04-22T14:16:36.344 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:16:36.344 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:16:36.344 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:16:36.344 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:16:36.344 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.345 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:16:36.345 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6802", 2020-04-22T14:16:36.345 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:16:36.345 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.345 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.345 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:16:36.345 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6803", 2020-04-22T14:16:36.345 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:16:36.346 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.346 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:36.346 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.346 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:16:36.346 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:16:36.346 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.346 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:16:36.347 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6804", 2020-04-22T14:16:36.347 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:16:36.347 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.347 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.347 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:16:36.347 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6805", 2020-04-22T14:16:36.347 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:16:36.347 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.348 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:36.348 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.348 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:16:36.348 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:16:36.348 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.348 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:16:36.348 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6808", 2020-04-22T14:16:36.349 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:16:36.349 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.349 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.349 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:16:36.349 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6809", 2020-04-22T14:16:36.349 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:16:36.349 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.350 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:36.350 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.350 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:16:36.350 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:16:36.350 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.350 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:16:36.350 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6806", 2020-04-22T14:16:36.350 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:16:36.351 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.351 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.351 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:16:36.351 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6807", 2020-04-22T14:16:36.351 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:16:36.351 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.351 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:36.351 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.352 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6803/33506", 2020-04-22T14:16:36.352 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6805/33506", 2020-04-22T14:16:36.352 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6809/33506", 2020-04-22T14:16:36.352 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6807/33506", 2020-04-22T14:16:36.352 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:16:36.352 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:16:36.352 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:16:36.353 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:36.353 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.353 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.353 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 5, 2020-04-22T14:16:36.353 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "bcfd7a16-6914-4152-8647-a481917fe19d", 2020-04-22T14:16:36.353 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:16:36.353 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:16:36.353 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:16:36.354 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:16:36.354 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:16:36.354 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:16:36.354 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:16:36.354 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 109, 2020-04-22T14:16:36.354 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:16:36.354 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:16:36.355 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:16:36.355 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:16:36.355 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.355 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:16:36.355 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6810", 2020-04-22T14:16:36.355 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:16:36.355 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.356 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.356 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:16:36.356 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6811", 2020-04-22T14:16:36.356 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:16:36.356 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.356 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:36.357 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.357 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:16:36.357 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:16:36.357 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.357 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:16:36.357 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6812", 2020-04-22T14:16:36.357 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:16:36.358 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.358 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.358 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:16:36.358 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6813", 2020-04-22T14:16:36.358 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:16:36.358 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.359 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:36.359 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.359 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:16:36.359 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:16:36.359 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.359 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:16:36.359 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6816", 2020-04-22T14:16:36.359 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:16:36.360 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.360 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.360 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:16:36.360 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6817", 2020-04-22T14:16:36.360 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:16:36.360 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.360 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:36.361 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.361 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:16:36.361 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:16:36.361 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.361 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:16:36.361 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6814", 2020-04-22T14:16:36.361 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:16:36.362 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.362 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.362 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:16:36.362 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6815", 2020-04-22T14:16:36.362 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:16:36.362 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.362 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:36.362 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.363 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6811/33554", 2020-04-22T14:16:36.363 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6813/33554", 2020-04-22T14:16:36.363 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6817/33554", 2020-04-22T14:16:36.363 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6815/33554", 2020-04-22T14:16:36.363 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:16:36.363 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:16:36.363 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:16:36.364 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:36.364 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.364 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.364 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 6, 2020-04-22T14:16:36.364 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050", 2020-04-22T14:16:36.364 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:16:36.364 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:16:36.364 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:16:36.365 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:16:36.365 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:16:36.365 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:16:36.365 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:16:36.365 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 111, 2020-04-22T14:16:36.365 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:16:36.365 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:16:36.366 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:16:36.366 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:16:36.366 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.366 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:16:36.366 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6818", 2020-04-22T14:16:36.366 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:16:36.366 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.367 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.367 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:16:36.367 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6819", 2020-04-22T14:16:36.367 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:16:36.367 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.367 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:36.367 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.367 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:16:36.368 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:16:36.368 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.368 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:16:36.368 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6820", 2020-04-22T14:16:36.368 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:16:36.368 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.368 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.369 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:16:36.369 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6821", 2020-04-22T14:16:36.369 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:16:36.369 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.369 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:36.369 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.369 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:16:36.370 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:16:36.370 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.370 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:16:36.370 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6824", 2020-04-22T14:16:36.370 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:16:36.370 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.370 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.370 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:16:36.371 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6825", 2020-04-22T14:16:36.371 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:16:36.371 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.371 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:36.371 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.371 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:16:36.371 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:16:36.372 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.372 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:16:36.372 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6822", 2020-04-22T14:16:36.372 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:16:36.372 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.372 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.372 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:16:36.372 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6823", 2020-04-22T14:16:36.373 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:16:36.373 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.373 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:36.373 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.373 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6819/33601", 2020-04-22T14:16:36.373 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6821/33601", 2020-04-22T14:16:36.373 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6825/33601", 2020-04-22T14:16:36.374 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6823/33601", 2020-04-22T14:16:36.374 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:16:36.374 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:16:36.374 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:16:36.374 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:36.374 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.374 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.375 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 7, 2020-04-22T14:16:36.375 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "340eece1-4c39-47cd-b95f-9cfa5dcfe361", 2020-04-22T14:16:36.375 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:16:36.375 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:16:36.375 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:16:36.375 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:16:36.375 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:16:36.376 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:16:36.376 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:16:36.376 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 111, 2020-04-22T14:16:36.376 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:16:36.376 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:16:36.376 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:16:36.376 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:16:36.377 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.377 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:16:36.377 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6826", 2020-04-22T14:16:36.377 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:16:36.377 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.377 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.377 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:16:36.378 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6827", 2020-04-22T14:16:36.378 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:16:36.378 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.378 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:36.378 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.378 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:16:36.378 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:16:36.379 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.379 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:16:36.379 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6828", 2020-04-22T14:16:36.379 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:16:36.379 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.379 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.380 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:16:36.380 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6829", 2020-04-22T14:16:36.380 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:16:36.380 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.381 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:36.381 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.381 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:16:36.381 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:16:36.381 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.381 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:16:36.381 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6832", 2020-04-22T14:16:36.382 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:16:36.382 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.382 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.382 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:16:36.382 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6833", 2020-04-22T14:16:36.382 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:16:36.383 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.383 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:36.383 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.383 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:16:36.383 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:16:36.383 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.383 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:16:36.384 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6830", 2020-04-22T14:16:36.384 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:16:36.384 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.384 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.384 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:16:36.384 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6831", 2020-04-22T14:16:36.384 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:16:36.384 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.385 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:36.385 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.385 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6827/33629", 2020-04-22T14:16:36.385 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6829/33629", 2020-04-22T14:16:36.385 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6833/33629", 2020-04-22T14:16:36.385 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6831/33629", 2020-04-22T14:16:36.385 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:16:36.386 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:16:36.386 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:16:36.386 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:36.386 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.386 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:16:36.386 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_xinfo": [ 2020-04-22T14:16:36.386 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.386 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 0, 2020-04-22T14:16:36.387 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:16:36.387 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:16:36.387 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:16:36.387 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:16:36.387 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:16:36.387 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.384360+0000", 2020-04-22T14:16:36.387 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:16:36.388 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.388 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.388 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 1, 2020-04-22T14:16:36.388 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:16:36.388 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:16:36.388 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:16:36.388 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:16:36.388 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:16:36.389 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.503590+0000", 2020-04-22T14:16:36.389 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:16:36.389 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.389 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.389 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 2, 2020-04-22T14:16:36.389 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:16:36.389 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:16:36.390 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:16:36.392 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:16:36.392 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:16:36.392 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.525058+0000", 2020-04-22T14:16:36.392 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:16:36.392 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.392 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.393 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 3, 2020-04-22T14:16:36.393 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:16:36.393 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:16:36.393 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:16:36.393 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:16:36.393 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:16:36.393 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.599729+0000", 2020-04-22T14:16:36.394 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:16:36.394 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.394 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.394 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 4, 2020-04-22T14:16:36.394 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:16:36.394 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:16:36.394 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:16:36.394 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:16:36.395 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:16:36.395 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.600919+0000", 2020-04-22T14:16:36.395 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:16:36.395 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.395 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.395 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 5, 2020-04-22T14:16:36.395 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:16:36.396 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:16:36.396 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:16:36.396 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:16:36.396 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:16:36.396 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.654718+0000", 2020-04-22T14:16:36.396 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:16:36.396 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.397 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.397 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 6, 2020-04-22T14:16:36.397 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:16:36.397 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:16:36.397 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:16:36.397 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:16:36.397 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:16:36.397 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.718342+0000", 2020-04-22T14:16:36.398 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:16:36.398 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.398 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:36.398 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 7, 2020-04-22T14:16:36.398 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:16:36.398 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:16:36.398 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:16:36.399 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:16:36.399 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:16:36.399 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.839089+0000", 2020-04-22T14:16:36.399 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:16:36.399 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.399 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:16:36.399 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_upmap": [], 2020-04-22T14:16:36.399 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_upmap_items": [], 2020-04-22T14:16:36.400 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_temp": [], 2020-04-22T14:16:36.400 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_temp": [], 2020-04-22T14:16:36.400 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklist": { 2020-04-22T14:16:36.400 INFO:teuthology.orchestra.run.smithi103.stdout: "172.21.15.103:6833/3949453152": "2020-04-23T14:16:24.141612+0000", 2020-04-22T14:16:36.400 INFO:teuthology.orchestra.run.smithi103.stdout: "172.21.15.103:6832/3949453152": "2020-04-23T14:16:24.141612+0000" 2020-04-22T14:16:36.400 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.400 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profiles": { 2020-04-22T14:16:36.401 INFO:teuthology.orchestra.run.smithi103.stdout: "default": { 2020-04-22T14:16:36.401 INFO:teuthology.orchestra.run.smithi103.stdout: "crush-failure-domain": "osd", 2020-04-22T14:16:36.401 INFO:teuthology.orchestra.run.smithi103.stdout: "k": "2", 2020-04-22T14:16:36.401 INFO:teuthology.orchestra.run.smithi103.stdout: "m": "1", 2020-04-22T14:16:36.401 INFO:teuthology.orchestra.run.smithi103.stdout: "plugin": "jerasure", 2020-04-22T14:16:36.401 INFO:teuthology.orchestra.run.smithi103.stdout: "ruleset-failure-domain": "osd", 2020-04-22T14:16:36.401 INFO:teuthology.orchestra.run.smithi103.stdout: "technique": "reed_sol_van" 2020-04-22T14:16:36.401 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:36.402 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:36.402 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps_queue": [], 2020-04-22T14:16:36.402 INFO:teuthology.orchestra.run.smithi103.stdout: "new_removed_snaps": [], 2020-04-22T14:16:36.402 INFO:teuthology.orchestra.run.smithi103.stdout: "new_purged_snaps": [], 2020-04-22T14:16:36.402 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_node_flags": {}, 2020-04-22T14:16:36.402 INFO:teuthology.orchestra.run.smithi103.stdout: "device_class_flags": {} 2020-04-22T14:16:36.402 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:16:36.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.237+0000 7fa4c758d700 1 -- 172.21.15.103:0/2198148823 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa4a004d8a0 msgr2=0x7fa4a004fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:36.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.237+0000 7fa4c758d700 1 --2- 172.21.15.103:0/2198148823 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa4a004d8a0 0x7fa4a004fd60 secure :-1 s=READY pgs=615 cs=0 l=1 rx=0x7fa4b80032b0 tx=0x7fa4b800b770).stop 2020-04-22T14:16:36.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.237+0000 7fa4c758d700 1 -- 172.21.15.103:0/2198148823 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4c00b2940 msgr2=0x7fa4c0146440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:36.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.237+0000 7fa4c758d700 1 --2- 172.21.15.103:0/2198148823 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4c00b2940 0x7fa4c0146440 secure :-1 s=READY pgs=905 cs=0 l=1 rx=0x7fa4c0061b80 tx=0x7fa4b4007a40).stop 2020-04-22T14:16:36.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.237+0000 7fa4c758d700 1 -- 172.21.15.103:0/2198148823 shutdown_connections 2020-04-22T14:16:36.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.237+0000 7fa4c758d700 1 --2- 172.21.15.103:0/2198148823 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4c005f3e0 0x7fa4c0066710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:36.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.237+0000 7fa4c758d700 1 --2- 172.21.15.103:0/2198148823 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa4a004d8a0 0x7fa4a004fd60 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:36.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.237+0000 7fa4c758d700 1 --2- 172.21.15.103:0/2198148823 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4c00b2940 0x7fa4c0146440 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:36.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.237+0000 7fa4c758d700 1 -- 172.21.15.103:0/2198148823 >> 172.21.15.103:0/2198148823 conn(0x7fa4c005ad30 msgr2=0x7fa4c0142b00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:36.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.237+0000 7fa4c758d700 1 -- 172.21.15.103:0/2198148823 shutdown_connections 2020-04-22T14:16:36.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.237+0000 7fa4c758d700 1 -- 172.21.15.103:0/2198148823 wait complete. 2020-04-22T14:16:36.406 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:36.421 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:16:36.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.566+0000 7fb3d0e8b700 1 Processor -- start 2020-04-22T14:16:36.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.566+0000 7fb3d0e8b700 1 -- start start 2020-04-22T14:16:36.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.567+0000 7fb3d0e8b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3cc0bcc00 0x7fb3cc0bbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:36.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.567+0000 7fb3d0e8b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb3cc0ae130 0x7fb3cc0ac740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:36.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.567+0000 7fb3d0e8b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb3cc0acba0 0x7fb3cc060730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:36.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.567+0000 7fb3d0e8b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3cc14a480 con 0x7fb3cc0acba0 2020-04-22T14:16:36.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.567+0000 7fb3d0e8b700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3cc060290 con 0x7fb3cc0ae130 2020-04-22T14:16:36.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.567+0000 7fb3d0e8b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3cc0bcfe0 con 0x7fb3cc0bcc00 2020-04-22T14:16:36.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.567+0000 7fb3caffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb3cc0ae130 0x7fb3cc0ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:36.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.567+0000 7fb3caffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb3cc0ae130 0x7fb3cc0ac740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56400/0 (socket says 172.21.15.103:56400) 2020-04-22T14:16:36.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.567+0000 7fb3caffd700 1 -- 172.21.15.103:0/1434512488 learned_addr learned my addr 172.21.15.103:0/1434512488 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:36.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.567+0000 7fb3cbfff700 1 --2- 172.21.15.103:0/1434512488 >> v2:172.21.15.86:3300/0 conn(0x7fb3cc0acba0 0x7fb3cc060730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:36.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.567+0000 7fb3cb7fe700 1 --2- 172.21.15.103:0/1434512488 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3cc0bcc00 0x7fb3cc0bbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:36.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.567+0000 7fb3caffd700 1 -- 172.21.15.103:0/1434512488 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3cc0bcc00 msgr2=0x7fb3cc0bbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:36.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.567+0000 7fb3caffd700 1 --2- 172.21.15.103:0/1434512488 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3cc0bcc00 0x7fb3cc0bbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:36.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.567+0000 7fb3caffd700 1 -- 172.21.15.103:0/1434512488 >> v2:172.21.15.86:3300/0 conn(0x7fb3cc0acba0 msgr2=0x7fb3cc060730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:36.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.567+0000 7fb3caffd700 1 --2- 172.21.15.103:0/1434512488 >> v2:172.21.15.86:3300/0 conn(0x7fb3cc0acba0 0x7fb3cc060730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:36.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.567+0000 7fb3caffd700 1 -- 172.21.15.103:0/1434512488 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3cc14a100 con 0x7fb3cc0ae130 2020-04-22T14:16:36.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.567+0000 7fb3cb7fe700 1 --2- 172.21.15.103:0/1434512488 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3cc0bcc00 0x7fb3cc0bbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:16:36.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.567+0000 7fb3caffd700 1 --2- 172.21.15.103:0/1434512488 >> v2:172.21.15.103:3300/0 conn(0x7fb3cc0ae130 0x7fb3cc0ac740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb3c0002f30 tx=0x7fb3c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.567+0000 7fb3caffd700 1 --2- 172.21.15.103:0/1434512488 >> v2:172.21.15.103:3300/0 conn(0x7fb3cc0ae130 0x7fb3cc0ac740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb3c0002f30 tx=0x7fb3c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.567+0000 7fb3caffd700 1 --2- 172.21.15.103:0/1434512488 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3cc0ae130 0x7fb3cc0ac740 secure :-1 s=READY pgs=1692 cs=0 l=1 rx=0x7fb3c0002f30 tx=0x7fb3c0007a40).ready entity=mon.1 client_cookie=be1c0f64cffff264 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:36.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.567+0000 7fb3caffd700 1 --2- 172.21.15.103:0/1434512488 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3cc0ae130 0x7fb3cc0ac740 secure :-1 s=THROTTLE_DONE pgs=1692 cs=0 l=1 rx=0x7fb3c0002f30 tx=0x7fb3c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.567+0000 7fb3ca7fc700 1 -- 172.21.15.103:0/1434512488 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3c0011720 con 0x7fb3cc0ae130 2020-04-22T14:16:36.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.567+0000 7fb3caffd700 1 --2- 172.21.15.103:0/1434512488 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3cc0ae130 0x7fb3cc0ac740 secure :-1 s=THROTTLE_DONE pgs=1692 cs=0 l=1 rx=0x7fb3c0002f30 tx=0x7fb3c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.567+0000 7fb3ca7fc700 1 -- 172.21.15.103:0/1434512488 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c0011880 con 0x7fb3cc0ae130 2020-04-22T14:16:36.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.567+0000 7fb3caffd700 1 --2- 172.21.15.103:0/1434512488 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3cc0ae130 0x7fb3cc0ac740 secure :-1 s=THROTTLE_DONE pgs=1692 cs=0 l=1 rx=0x7fb3c0002f30 tx=0x7fb3c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.567+0000 7fb3ca7fc700 1 -- 172.21.15.103:0/1434512488 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3c0011ca0 con 0x7fb3cc0ae130 2020-04-22T14:16:36.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.567+0000 7fb3d0e8b700 1 -- 172.21.15.103:0/1434512488 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3cc0ae130 msgr2=0x7fb3cc0ac740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:36.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.567+0000 7fb3d0e8b700 1 --2- 172.21.15.103:0/1434512488 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3cc0ae130 0x7fb3cc0ac740 secure :-1 s=READY pgs=1692 cs=0 l=1 rx=0x7fb3c0002f30 tx=0x7fb3c0007a40).stop 2020-04-22T14:16:36.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.568+0000 7fb3d0e8b700 1 -- 172.21.15.103:0/1434512488 shutdown_connections 2020-04-22T14:16:36.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.568+0000 7fb3d0e8b700 1 --2- 172.21.15.103:0/1434512488 >> v2:172.21.15.86:3300/0 conn(0x7fb3cc0acba0 0x7fb3cc060730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:36.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.568+0000 7fb3d0e8b700 1 --2- 172.21.15.103:0/1434512488 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb3cc0bcc00 0x7fb3cc0bbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:36.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.568+0000 7fb3d0e8b700 1 --2- 172.21.15.103:0/1434512488 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3cc0ae130 0x7fb3cc0ac740 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:36.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.568+0000 7fb3d0e8b700 1 -- 172.21.15.103:0/1434512488 >> 172.21.15.103:0/1434512488 conn(0x7fb3cc069f30 msgr2=0x7fb3cc06a340 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:36.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.568+0000 7fb3d0e8b700 1 -- 172.21.15.103:0/1434512488 shutdown_connections 2020-04-22T14:16:36.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.568+0000 7fb3d0e8b700 1 -- 172.21.15.103:0/1434512488 wait complete. 2020-04-22T14:16:36.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.569+0000 7fb3d0e8b700 1 Processor -- start 2020-04-22T14:16:36.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.569+0000 7fb3d0e8b700 1 -- start start 2020-04-22T14:16:36.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.570+0000 7fb3d0e8b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb3cc0ae130 0x7fb3cc0ba330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:36.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.570+0000 7fb3d0e8b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3cc0ba790 con 0x7fb3cc0acba0 2020-04-22T14:16:36.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.570+0000 7fb3d0e8b700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3cc0b4f00 con 0x7fb3cc0bcc00 2020-04-22T14:16:36.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.570+0000 7fb3d0e8b700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3cc0b51a0 con 0x7fb3cc0ae130 2020-04-22T14:16:36.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.570+0000 7fb3caffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb3cc0ae130 0x7fb3cc0ba330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:36.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.570+0000 7fb3cbfff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb3cc0bcc00 0x7fb3cc0b7ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48598/0 (socket says 172.21.15.103:48598) 2020-04-22T14:16:36.582 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.570+0000 7fb3cbfff700 1 -- 172.21.15.103:0/2479069738 learned_addr learned my addr 172.21.15.103:0/2479069738 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:36.582 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.570+0000 7fb3caffd700 1 -- 172.21.15.103:0/2479069738 >> v1:172.21.15.103:6789/0 conn(0x7fb3cc0bcc00 legacy=0x7fb3cc0b7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:36.582 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.570+0000 7fb3caffd700 1 -- 172.21.15.103:0/2479069738 >> v1:172.21.15.86:6789/0 conn(0x7fb3cc0acba0 legacy=0x7fb3cc0b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:36.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.570+0000 7fb3c8ff9700 1 -- 172.21.15.103:0/2479069738 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 946838045 0 0) 0x7fb3cc0b4f00 con 0x7fb3cc0bcc00 2020-04-22T14:16:36.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.570+0000 7fb3caffd700 1 -- 172.21.15.103:0/2479069738 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3cc0b5440 con 0x7fb3cc0ae130 2020-04-22T14:16:36.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.570+0000 7fb3caffd700 1 --2- 172.21.15.103:0/2479069738 >> v2:172.21.15.103:3300/0 conn(0x7fb3cc0ae130 0x7fb3cc0ba330 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb3c0002f30 tx=0x7fb3c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.570+0000 7fb3caffd700 1 --2- 172.21.15.103:0/2479069738 >> v2:172.21.15.103:3300/0 conn(0x7fb3cc0ae130 0x7fb3cc0ba330 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb3c0002f30 tx=0x7fb3c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.570+0000 7fb3caffd700 1 --2- 172.21.15.103:0/2479069738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3cc0ae130 0x7fb3cc0ba330 secure :-1 s=READY pgs=1694 cs=0 l=1 rx=0x7fb3c0002f30 tx=0x7fb3c0007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:36.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.570+0000 7fb3caffd700 1 --2- 172.21.15.103:0/2479069738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3cc0ae130 0x7fb3cc0ba330 secure :-1 s=THROTTLE_DONE pgs=1694 cs=0 l=1 rx=0x7fb3c0002f30 tx=0x7fb3c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.570+0000 7fb3c8ff9700 1 -- 172.21.15.103:0/2479069738 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3c0011d10 con 0x7fb3cc0ae130 2020-04-22T14:16:36.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.570+0000 7fb3caffd700 1 --2- 172.21.15.103:0/2479069738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3cc0ae130 0x7fb3cc0ba330 secure :-1 s=THROTTLE_DONE pgs=1694 cs=0 l=1 rx=0x7fb3c0002f30 tx=0x7fb3c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.570+0000 7fb3caffd700 1 --2- 172.21.15.103:0/2479069738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3cc0ae130 0x7fb3cc0ba330 secure :-1 s=THROTTLE_DONE pgs=1694 cs=0 l=1 rx=0x7fb3c0002f30 tx=0x7fb3c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.570+0000 7fb3c8ff9700 1 -- 172.21.15.103:0/2479069738 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c0007360 con 0x7fb3cc0ae130 2020-04-22T14:16:36.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.570+0000 7fb3d0e8b700 1 -- 172.21.15.103:0/2479069738 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3cc0b85e0 con 0x7fb3cc0ae130 2020-04-22T14:16:36.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.570+0000 7fb3c8ff9700 1 -- 172.21.15.103:0/2479069738 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3c00056c0 con 0x7fb3cc0ae130 2020-04-22T14:16:36.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.570+0000 7fb3d0e8b700 1 -- 172.21.15.103:0/2479069738 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3cc0b1c10 con 0x7fb3cc0ae130 2020-04-22T14:16:36.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.571+0000 7fb3caffd700 1 --2- 172.21.15.103:0/2479069738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3cc0ae130 0x7fb3cc0ba330 secure :-1 s=THROTTLE_DONE pgs=1694 cs=0 l=1 rx=0x7fb3c0002f30 tx=0x7fb3c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.571+0000 7fb3d0e8b700 1 -- 172.21.15.103:0/2479069738 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3cc0b55d0 con 0x7fb3cc0ae130 2020-04-22T14:16:36.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.571+0000 7fb3c8ff9700 1 -- 172.21.15.103:0/2479069738 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fb3c0005820 con 0x7fb3cc0ae130 2020-04-22T14:16:36.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.571+0000 7fb3caffd700 1 --2- 172.21.15.103:0/2479069738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3cc0ae130 0x7fb3cc0ba330 secure :-1 s=THROTTLE_DONE pgs=1694 cs=0 l=1 rx=0x7fb3c0002f30 tx=0x7fb3c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.572+0000 7fb3c8ff9700 1 --2- 172.21.15.103:0/2479069738 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb3ac04d880 0x7fb3ac04fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:36.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.572+0000 7fb3c8ff9700 1 -- 172.21.15.103:0/2479069738 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fb3c0061960 con 0x7fb3cc0ae130 2020-04-22T14:16:36.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.572+0000 7fb3cb7fe700 1 --2- 172.21.15.103:0/2479069738 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb3ac04d880 0x7fb3ac04fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:36.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.572+0000 7fb3cb7fe700 1 --2- 172.21.15.103:0/2479069738 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb3ac04d880 0x7fb3ac04fd40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb3cc0b4570 tx=0x7fb3c4008e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.572+0000 7fb3cb7fe700 1 --2- 172.21.15.103:0/2479069738 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb3ac04d880 0x7fb3ac04fd40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb3cc0b4570 tx=0x7fb3c4008e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.572+0000 7fb3cb7fe700 1 --2- 172.21.15.103:0/2479069738 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb3ac04d880 0x7fb3ac04fd40 secure :-1 s=READY pgs=616 cs=0 l=1 rx=0x7fb3cc0b4570 tx=0x7fb3c4008e20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:36.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.576+0000 7fb3caffd700 1 --2- 172.21.15.103:0/2479069738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3cc0ae130 0x7fb3cc0ba330 secure :-1 s=THROTTLE_DONE pgs=1694 cs=0 l=1 rx=0x7fb3c0002f30 tx=0x7fb3c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.576+0000 7fb3c8ff9700 1 -- 172.21.15.103:0/2479069738 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fb3c003cda0 con 0x7fb3cc0ae130 2020-04-22T14:16:36.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.767+0000 7fb3d0e8b700 1 -- 172.21.15.103:0/2479069738 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3cc0b1c10 con 0x7fb3cc0ae130 2020-04-22T14:16:36.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.767+0000 7fb3caffd700 1 --2- 172.21.15.103:0/2479069738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3cc0ae130 0x7fb3cc0ba330 secure :-1 s=THROTTLE_DONE pgs=1694 cs=0 l=1 rx=0x7fb3c0002f30 tx=0x7fb3c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.770 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.767+0000 7fb3c8ff9700 1 -- 172.21.15.103:0/2479069738 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+2142 (secure 0 0 0) 0x7fb3cc0b1c10 con 0x7fb3cc0ae130 2020-04-22T14:16:36.771 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:16:36.771 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":88,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6332,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/419161869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":419161869},{"type":"v1","addr":"172.21.15.86:6835","nonce":419161869}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":84}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:16:05.150517+0000","modified":"2020-04-22T14:16:28.649443+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8737},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8737":{"gid":8737,"name":"a","rank":0,"incarnation":85,"state":"up:active","state_seq":4,"addr":"172.21.15.103:6833/4047146716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":4047146716},{"type":"v1","addr":"172.21.15.103:6833","nonce":4047146716}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2020-04-22T14:16:36.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.768+0000 7fb3d0e8b700 1 -- 172.21.15.103:0/2479069738 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb3ac04d880 msgr2=0x7fb3ac04fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:36.774 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.768+0000 7fb3d0e8b700 1 --2- 172.21.15.103:0/2479069738 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb3ac04d880 0x7fb3ac04fd40 secure :-1 s=READY pgs=616 cs=0 l=1 rx=0x7fb3cc0b4570 tx=0x7fb3c4008e20).stop 2020-04-22T14:16:36.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.768+0000 7fb3d0e8b700 1 -- 172.21.15.103:0/2479069738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3cc0ae130 msgr2=0x7fb3cc0ba330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:36.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.768+0000 7fb3d0e8b700 1 --2- 172.21.15.103:0/2479069738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3cc0ae130 0x7fb3cc0ba330 secure :-1 s=READY pgs=1694 cs=0 l=1 rx=0x7fb3c0002f30 tx=0x7fb3c0007a40).stop 2020-04-22T14:16:36.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.768+0000 7fb3d0e8b700 1 -- 172.21.15.103:0/2479069738 shutdown_connections 2020-04-22T14:16:36.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.768+0000 7fb3d0e8b700 1 --2- 172.21.15.103:0/2479069738 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb3ac04d880 0x7fb3ac04fd40 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:36.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.768+0000 7fb3d0e8b700 1 --2- 172.21.15.103:0/2479069738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3cc0ae130 0x7fb3cc0ba330 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:36.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.768+0000 7fb3d0e8b700 1 -- 172.21.15.103:0/2479069738 >> 172.21.15.103:0/2479069738 conn(0x7fb3cc069f30 msgr2=0x7fb3cc12dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:36.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.769+0000 7fb3d0e8b700 1 -- 172.21.15.103:0/2479069738 shutdown_connections 2020-04-22T14:16:36.776 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.769+0000 7fb3d0e8b700 1 -- 172.21.15.103:0/2479069738 wait complete. 2020-04-22T14:16:36.776 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 88 2020-04-22T14:16:36.783 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:36.797 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2020-04-22T14:16:36.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.942+0000 7f10ef371700 1 Processor -- start 2020-04-22T14:16:36.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.943+0000 7f10ef371700 1 -- start start 2020-04-22T14:16:36.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.943+0000 7f10ef371700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f10e80b4700 0x7f10e80afa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:36.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.943+0000 7f10ef371700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f10e80b2530 0x7f10e80afec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:36.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.943+0000 7f10ef371700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10e80b0e90 con 0x7f10e80b4320 2020-04-22T14:16:36.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.943+0000 7f10ef371700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10e80b1130 con 0x7f10e80b2530 2020-04-22T14:16:36.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.943+0000 7f10ef371700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10e80b1ce0 con 0x7f10e80b4700 2020-04-22T14:16:36.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.943+0000 7f10ec90c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f10e80b4700 0x7f10e80afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:36.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.943+0000 7f10ed10d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f10e80b4320 0x7f10e80b15d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48602/0 (socket says 172.21.15.103:48602) 2020-04-22T14:16:36.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.943+0000 7f10ed10d700 1 -- 172.21.15.103:0/1151613468 learned_addr learned my addr 172.21.15.103:0/1151613468 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:36.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.944+0000 7f10ed90e700 1 --2- 172.21.15.103:0/1151613468 >> v2:172.21.15.86:3300/0 conn(0x7f10e80b2530 0x7f10e80afec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:36.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.944+0000 7f10ec90c700 1 -- 172.21.15.103:0/1151613468 >> v2:172.21.15.86:3300/0 conn(0x7f10e80b2530 msgr2=0x7f10e80afec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:36.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.944+0000 7f10ec90c700 1 --2- 172.21.15.103:0/1151613468 >> v2:172.21.15.86:3300/0 conn(0x7f10e80b2530 0x7f10e80afec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:36.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.944+0000 7f10ec90c700 1 -- 172.21.15.103:0/1151613468 >> v1:172.21.15.103:6789/0 conn(0x7f10e80b4320 legacy=0x7f10e80b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:36.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.944+0000 7f10ec90c700 1 -- 172.21.15.103:0/1151613468 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e80ae500 con 0x7f10e80b4700 2020-04-22T14:16:36.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.944+0000 7f10ed90e700 1 --2- 172.21.15.103:0/1151613468 >> v2:172.21.15.86:3300/0 conn(0x7f10e80b2530 0x7f10e80afec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:16:36.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.944+0000 7f10ec90c700 1 --2- 172.21.15.103:0/1151613468 >> v2:172.21.15.103:3300/0 conn(0x7f10e80b4700 0x7f10e80afa60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f10d8002f30 tx=0x7f10d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.944+0000 7f10d7fff700 1 -- 172.21.15.103:0/1151613468 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2154380309 0 0) 0x7f10e80b0e90 con 0x7f10e80b4320 2020-04-22T14:16:36.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.944+0000 7f10ec90c700 1 --2- 172.21.15.103:0/1151613468 >> v2:172.21.15.103:3300/0 conn(0x7f10e80b4700 0x7f10e80afa60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f10d8002f30 tx=0x7f10d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.944+0000 7f10ec90c700 1 --2- 172.21.15.103:0/1151613468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10e80b4700 0x7f10e80afa60 secure :-1 s=READY pgs=1696 cs=0 l=1 rx=0x7f10d8002f30 tx=0x7f10d8007a40).ready entity=mon.1 client_cookie=863235e6fc1b1ef8 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:36.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.944+0000 7f10ec90c700 1 --2- 172.21.15.103:0/1151613468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10e80b4700 0x7f10e80afa60 secure :-1 s=THROTTLE_DONE pgs=1696 cs=0 l=1 rx=0x7f10d8002f30 tx=0x7f10d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.944+0000 7f10d7fff700 1 -- 172.21.15.103:0/1151613468 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10d8011470 con 0x7f10e80b4700 2020-04-22T14:16:36.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.944+0000 7f10ec90c700 1 --2- 172.21.15.103:0/1151613468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10e80b4700 0x7f10e80afa60 secure :-1 s=THROTTLE_DONE pgs=1696 cs=0 l=1 rx=0x7f10d8002f30 tx=0x7f10d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.944+0000 7f10d7fff700 1 -- 172.21.15.103:0/1151613468 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d80115d0 con 0x7f10e80b4700 2020-04-22T14:16:36.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.944+0000 7f10ec90c700 1 --2- 172.21.15.103:0/1151613468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10e80b4700 0x7f10e80afa60 secure :-1 s=THROTTLE_DONE pgs=1696 cs=0 l=1 rx=0x7f10d8002f30 tx=0x7f10d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.944+0000 7f10d7fff700 1 -- 172.21.15.103:0/1151613468 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10d80119b0 con 0x7f10e80b4700 2020-04-22T14:16:36.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.944+0000 7f10ef371700 1 -- 172.21.15.103:0/1151613468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10e80b4700 msgr2=0x7f10e80afa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:36.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.944+0000 7f10ef371700 1 --2- 172.21.15.103:0/1151613468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10e80b4700 0x7f10e80afa60 secure :-1 s=READY pgs=1696 cs=0 l=1 rx=0x7f10d8002f30 tx=0x7f10d8007a40).stop 2020-04-22T14:16:36.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.944+0000 7f10ef371700 1 -- 172.21.15.103:0/1151613468 shutdown_connections 2020-04-22T14:16:36.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.944+0000 7f10ef371700 1 --2- 172.21.15.103:0/1151613468 >> v2:172.21.15.86:3300/0 conn(0x7f10e80b2530 0x7f10e80afec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:36.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.944+0000 7f10ef371700 1 --2- 172.21.15.103:0/1151613468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10e80b4700 0x7f10e80afa60 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:36.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.945+0000 7f10ef371700 1 -- 172.21.15.103:0/1151613468 >> 172.21.15.103:0/1151613468 conn(0x7f10e80b86b0 msgr2=0x7f10e80b8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:36.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.945+0000 7f10ef371700 1 -- 172.21.15.103:0/1151613468 shutdown_connections 2020-04-22T14:16:36.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.945+0000 7f10ef371700 1 -- 172.21.15.103:0/1151613468 wait complete. 2020-04-22T14:16:36.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.946+0000 7f10ef371700 1 Processor -- start 2020-04-22T14:16:36.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.946+0000 7f10ef371700 1 -- start start 2020-04-22T14:16:36.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.946+0000 7f10ef371700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f10e80b2530 0x7f10e813f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:36.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.946+0000 7f10ef371700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f10e80b4320 0x7f10e80648b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:36.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.946+0000 7f10ef371700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10e813fc20 con 0x7f10e80b4700 2020-04-22T14:16:36.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.946+0000 7f10ef371700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10e8151630 con 0x7f10e80b2530 2020-04-22T14:16:36.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.946+0000 7f10ef371700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10e813bbc0 con 0x7f10e80b4320 2020-04-22T14:16:36.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.946+0000 7f10ec90c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f10e80b4320 0x7f10e80648b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:36.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.946+0000 7f10ec90c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f10e80b4320 0x7f10e80648b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56420/0 (socket says 172.21.15.103:56420) 2020-04-22T14:16:36.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.946+0000 7f10ec90c700 1 -- 172.21.15.103:0/3542613482 learned_addr learned my addr 172.21.15.103:0/3542613482 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:36.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.947+0000 7f10ed10d700 1 --2- 172.21.15.103:0/3542613482 >> v2:172.21.15.86:3300/0 conn(0x7f10e80b2530 0x7f10e813f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:36.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.947+0000 7f10ec90c700 1 -- 172.21.15.103:0/3542613482 >> v2:172.21.15.86:3300/0 conn(0x7f10e80b2530 msgr2=0x7f10e813f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:36.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.947+0000 7f10ec90c700 1 --2- 172.21.15.103:0/3542613482 >> v2:172.21.15.86:3300/0 conn(0x7f10e80b2530 0x7f10e813f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:36.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.947+0000 7f10ec90c700 1 -- 172.21.15.103:0/3542613482 >> v1:172.21.15.86:6789/0 conn(0x7f10e80b4700 legacy=0x7f10e8151cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:36.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.947+0000 7f10ec90c700 1 -- 172.21.15.103:0/3542613482 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e8151820 con 0x7f10e80b4320 2020-04-22T14:16:36.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.947+0000 7f10ed10d700 1 --2- 172.21.15.103:0/3542613482 >> v2:172.21.15.86:3300/0 conn(0x7f10e80b2530 0x7f10e813f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:16:36.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.947+0000 7f10ec90c700 1 --2- 172.21.15.103:0/3542613482 >> v2:172.21.15.103:3300/0 conn(0x7f10e80b4320 0x7f10e80648b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f10e80647c0 tx=0x7f10d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.947+0000 7f10ec90c700 1 --2- 172.21.15.103:0/3542613482 >> v2:172.21.15.103:3300/0 conn(0x7f10e80b4320 0x7f10e80648b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f10e80647c0 tx=0x7f10d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.947+0000 7f10ec90c700 1 --2- 172.21.15.103:0/3542613482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10e80b4320 0x7f10e80648b0 secure :-1 s=READY pgs=1697 cs=0 l=1 rx=0x7f10e80647c0 tx=0x7f10d8007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:36.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.947+0000 7f10ec90c700 1 --2- 172.21.15.103:0/3542613482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10e80b4320 0x7f10e80648b0 secure :-1 s=THROTTLE_DONE pgs=1697 cs=0 l=1 rx=0x7f10e80647c0 tx=0x7f10d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.947+0000 7f10d67fc700 1 -- 172.21.15.103:0/3542613482 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10d8007170 con 0x7f10e80b4320 2020-04-22T14:16:36.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.947+0000 7f10ec90c700 1 --2- 172.21.15.103:0/3542613482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10e80b4320 0x7f10e80648b0 secure :-1 s=THROTTLE_DONE pgs=1697 cs=0 l=1 rx=0x7f10e80647c0 tx=0x7f10d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.964 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.947+0000 7f10ec90c700 1 --2- 172.21.15.103:0/3542613482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10e80b4320 0x7f10e80648b0 secure :-1 s=THROTTLE_DONE pgs=1697 cs=0 l=1 rx=0x7f10e80647c0 tx=0x7f10d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.965 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.947+0000 7f10d67fc700 1 -- 172.21.15.103:0/3542613482 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d80072d0 con 0x7f10e80b4320 2020-04-22T14:16:36.965 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.947+0000 7f10ef371700 1 -- 172.21.15.103:0/3542613482 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10e8066470 con 0x7f10e80b4320 2020-04-22T14:16:36.965 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.947+0000 7f10d67fc700 1 -- 172.21.15.103:0/3542613482 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10d80056c0 con 0x7f10e80b4320 2020-04-22T14:16:36.965 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.947+0000 7f10ef371700 1 -- 172.21.15.103:0/3542613482 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10e813b750 con 0x7f10e80b4320 2020-04-22T14:16:36.965 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.948+0000 7f10ec90c700 1 --2- 172.21.15.103:0/3542613482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10e80b4320 0x7f10e80648b0 secure :-1 s=THROTTLE_DONE pgs=1697 cs=0 l=1 rx=0x7f10e80647c0 tx=0x7f10d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.965 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.948+0000 7f10d67fc700 1 -- 172.21.15.103:0/3542613482 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f10d8005930 con 0x7f10e80b4320 2020-04-22T14:16:36.965 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.948+0000 7f10ec90c700 1 --2- 172.21.15.103:0/3542613482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10e80b4320 0x7f10e80648b0 secure :-1 s=THROTTLE_DONE pgs=1697 cs=0 l=1 rx=0x7f10e80647c0 tx=0x7f10d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.948+0000 7f10ef371700 1 -- 172.21.15.103:0/3542613482 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10e8056c90 con 0x7f10e80b4320 2020-04-22T14:16:36.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.948+0000 7f10d67fc700 1 --2- 172.21.15.103:0/3542613482 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f10c804d9a0 0x7f10c804fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:36.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.948+0000 7f10d67fc700 1 -- 172.21.15.103:0/3542613482 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f10d8061ac0 con 0x7f10e80b4320 2020-04-22T14:16:36.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.948+0000 7f10ed10d700 1 --2- 172.21.15.103:0/3542613482 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f10c804d9a0 0x7f10c804fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:36.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.949+0000 7f10ed10d700 1 --2- 172.21.15.103:0/3542613482 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f10c804d9a0 0x7f10c804fe60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f10e4000b80 tx=0x7f10e4001530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.949+0000 7f10ed10d700 1 --2- 172.21.15.103:0/3542613482 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f10c804d9a0 0x7f10c804fe60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f10e4000b80 tx=0x7f10e4001530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.949+0000 7f10ed10d700 1 --2- 172.21.15.103:0/3542613482 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f10c804d9a0 0x7f10c804fe60 secure :-1 s=READY pgs=617 cs=0 l=1 rx=0x7f10e4000b80 tx=0x7f10e4001530).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:36.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.952+0000 7f10ec90c700 1 --2- 172.21.15.103:0/3542613482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10e80b4320 0x7f10e80648b0 secure :-1 s=THROTTLE_DONE pgs=1697 cs=0 l=1 rx=0x7f10e80647c0 tx=0x7f10d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:36.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:36.952+0000 7f10d67fc700 1 -- 172.21.15.103:0/3542613482 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f10d803cfc0 con 0x7f10e80b4320 2020-04-22T14:16:37.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.145+0000 7f10ef371700 1 -- 172.21.15.103:0/3542613482 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f10e813fc20 con 0x7f10e80b4320 2020-04-22T14:16:37.675 INFO:tasks.ceph.mon.b.smithi086.stderr:2020-04-22T14:16:37.673+0000 7fbdbf880700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-04-22T14:16:37.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.675+0000 7f10ec90c700 1 --2- 172.21.15.103:0/3542613482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10e80b4320 0x7f10e80648b0 secure :-1 s=THROTTLE_DONE pgs=1697 cs=0 l=1 rx=0x7f10e80647c0 tx=0x7f10d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:37.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.675+0000 7f10d67fc700 1 -- 172.21.15.103:0/3542613482 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v89) v1 ==== 161+0+0 (secure 0 0 0) 0x7f10e813fc20 con 0x7f10e80b4320 2020-04-22T14:16:37.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.677+0000 7f10ef371700 1 -- 172.21.15.103:0/3542613482 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f10c804d9a0 msgr2=0x7f10c804fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:37.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.677+0000 7f10ef371700 1 --2- 172.21.15.103:0/3542613482 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f10c804d9a0 0x7f10c804fe60 secure :-1 s=READY pgs=617 cs=0 l=1 rx=0x7f10e4000b80 tx=0x7f10e4001530).stop 2020-04-22T14:16:37.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.677+0000 7f10ef371700 1 -- 172.21.15.103:0/3542613482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10e80b4320 msgr2=0x7f10e80648b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:37.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.677+0000 7f10ef371700 1 --2- 172.21.15.103:0/3542613482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10e80b4320 0x7f10e80648b0 secure :-1 s=READY pgs=1697 cs=0 l=1 rx=0x7f10e80647c0 tx=0x7f10d8007a40).stop 2020-04-22T14:16:37.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.677+0000 7f10ef371700 1 -- 172.21.15.103:0/3542613482 shutdown_connections 2020-04-22T14:16:37.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.677+0000 7f10ef371700 1 --2- 172.21.15.103:0/3542613482 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f10c804d9a0 0x7f10c804fe60 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:37.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.677+0000 7f10ef371700 1 --2- 172.21.15.103:0/3542613482 >> v2:172.21.15.86:3300/0 conn(0x7f10e80b2530 0x7f10e813f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:37.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.677+0000 7f10ef371700 1 --2- 172.21.15.103:0/3542613482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10e80b4320 0x7f10e80648b0 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:37.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.677+0000 7f10ef371700 1 -- 172.21.15.103:0/3542613482 >> 172.21.15.103:0/3542613482 conn(0x7f10e80b86b0 msgr2=0x7f10e80b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:37.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.678+0000 7f10ef371700 1 -- 172.21.15.103:0/3542613482 shutdown_connections 2020-04-22T14:16:37.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.678+0000 7f10ef371700 1 -- 172.21.15.103:0/3542613482 wait complete. 2020-04-22T14:16:37.682 INFO:teuthology.orchestra.run.smithi103.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2020-04-22T14:16:37.693 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:37.703 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2020-04-22T14:16:37.708 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:16:37.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.853+0000 7fd2d9876700 1 Processor -- start 2020-04-22T14:16:37.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.853+0000 7fd2d9876700 1 -- start start 2020-04-22T14:16:37.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.854+0000 7fd2d9876700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd2d412c0d0 0x7fd2d41464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:37.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.854+0000 7fd2d9876700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2d4065fe0 0x7fd2d405b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:37.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.854+0000 7fd2d9876700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2d4143300 con 0x7fd2d405b8a0 2020-04-22T14:16:37.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.854+0000 7fd2d9876700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2d412c4b0 con 0x7fd2d412c0d0 2020-04-22T14:16:37.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.854+0000 7fd2d9876700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d41435a0 con 0x7fd2d4065fe0 2020-04-22T14:16:37.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.854+0000 7fd2d27fc700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2d4065fe0 0x7fd2d405b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:37.860 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.854+0000 7fd2d2ffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd2d412c0d0 0x7fd2d41464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:37.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.855+0000 7fd2d27fc700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2d4065fe0 0x7fd2d405b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:41216/0 (socket says 172.21.15.103:41216) 2020-04-22T14:16:37.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.855+0000 7fd2d2ffd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd2d412c0d0 0x7fd2d41464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:53670/0 (socket says 172.21.15.103:53670) 2020-04-22T14:16:37.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.855+0000 7fd2d27fc700 1 -- 172.21.15.103:0/2547653694 learned_addr learned my addr 172.21.15.103:0/2547653694 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:37.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.855+0000 7fd2d1ffb700 1 -- 172.21.15.103:0/2547653694 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 301881266 0 0) 0x7fd2d4143300 con 0x7fd2d405b8a0 2020-04-22T14:16:37.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.855+0000 7fd2d1ffb700 1 -- 172.21.15.103:0/2547653694 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2b8003230 con 0x7fd2d405b8a0 2020-04-22T14:16:37.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.855+0000 7fd2d2ffd700 1 -- 172.21.15.103:0/2547653694 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2d4065fe0 msgr2=0x7fd2d405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:37.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.855+0000 7fd2d2ffd700 1 --2- 172.21.15.103:0/2547653694 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2d4065fe0 0x7fd2d405b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:37.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.855+0000 7fd2d2ffd700 1 -- 172.21.15.103:0/2547653694 >> v1:172.21.15.86:6789/0 conn(0x7fd2d405b8a0 legacy=0x7fd2d4062ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:37.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.855+0000 7fd2d2ffd700 1 -- 172.21.15.103:0/2547653694 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d4143840 con 0x7fd2d412c0d0 2020-04-22T14:16:37.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.855+0000 7fd2d27fc700 1 --2- 172.21.15.103:0/2547653694 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2d4065fe0 0x7fd2d405b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:16:37.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.855+0000 7fd2d2ffd700 1 --2- 172.21.15.103:0/2547653694 >> v2:172.21.15.86:3300/0 conn(0x7fd2d412c0d0 0x7fd2d41464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd2c8002f30 tx=0x7fd2c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:37.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.855+0000 7fd2d2ffd700 1 --2- 172.21.15.103:0/2547653694 >> v2:172.21.15.86:3300/0 conn(0x7fd2d412c0d0 0x7fd2d41464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd2c8002f30 tx=0x7fd2c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:37.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.855+0000 7fd2d2ffd700 1 --2- 172.21.15.103:0/2547653694 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2d412c0d0 0x7fd2d41464e0 secure :-1 s=READY pgs=910 cs=0 l=1 rx=0x7fd2c8002f30 tx=0x7fd2c8007a40).ready entity=mon.0 client_cookie=2b780de17fcf1792 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:37.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.855+0000 7fd2d2ffd700 1 --2- 172.21.15.103:0/2547653694 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2d412c0d0 0x7fd2d41464e0 secure :-1 s=THROTTLE_DONE pgs=910 cs=0 l=1 rx=0x7fd2c8002f30 tx=0x7fd2c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:37.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.855+0000 7fd2d1ffb700 1 -- 172.21.15.103:0/2547653694 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2c8011310 con 0x7fd2d412c0d0 2020-04-22T14:16:37.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.855+0000 7fd2d2ffd700 1 --2- 172.21.15.103:0/2547653694 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2d412c0d0 0x7fd2d41464e0 secure :-1 s=THROTTLE_DONE pgs=910 cs=0 l=1 rx=0x7fd2c8002f30 tx=0x7fd2c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:37.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.855+0000 7fd2d1ffb700 1 -- 172.21.15.103:0/2547653694 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c80114b0 con 0x7fd2d412c0d0 2020-04-22T14:16:37.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.855+0000 7fd2d2ffd700 1 --2- 172.21.15.103:0/2547653694 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2d412c0d0 0x7fd2d41464e0 secure :-1 s=THROTTLE_DONE pgs=910 cs=0 l=1 rx=0x7fd2c8002f30 tx=0x7fd2c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:37.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.855+0000 7fd2d1ffb700 1 -- 172.21.15.103:0/2547653694 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2c80118d0 con 0x7fd2d412c0d0 2020-04-22T14:16:37.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.855+0000 7fd2d9876700 1 -- 172.21.15.103:0/2547653694 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2d412c0d0 msgr2=0x7fd2d41464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:37.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.855+0000 7fd2d9876700 1 --2- 172.21.15.103:0/2547653694 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2d412c0d0 0x7fd2d41464e0 secure :-1 s=READY pgs=910 cs=0 l=1 rx=0x7fd2c8002f30 tx=0x7fd2c8007a40).stop 2020-04-22T14:16:37.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.856+0000 7fd2d9876700 1 -- 172.21.15.103:0/2547653694 shutdown_connections 2020-04-22T14:16:37.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.856+0000 7fd2d9876700 1 --2- 172.21.15.103:0/2547653694 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2d412c0d0 0x7fd2d41464e0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:37.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.856+0000 7fd2d9876700 1 --2- 172.21.15.103:0/2547653694 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2d4065fe0 0x7fd2d405b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:37.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.856+0000 7fd2d9876700 1 -- 172.21.15.103:0/2547653694 >> 172.21.15.103:0/2547653694 conn(0x7fd2d40b9160 msgr2=0x7fd2d405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:37.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.856+0000 7fd2d9876700 1 -- 172.21.15.103:0/2547653694 shutdown_connections 2020-04-22T14:16:37.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.856+0000 7fd2d9876700 1 -- 172.21.15.103:0/2547653694 wait complete. 2020-04-22T14:16:37.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.857+0000 7fd2d9876700 1 Processor -- start 2020-04-22T14:16:37.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.857+0000 7fd2d9876700 1 -- start start 2020-04-22T14:16:37.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.857+0000 7fd2d9876700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd2d4065fe0 0x7fd2d414b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:37.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.857+0000 7fd2d9876700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2d414dc40 con 0x7fd2d405b8a0 2020-04-22T14:16:37.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.857+0000 7fd2d9876700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2d40aca80 con 0x7fd2d412c0d0 2020-04-22T14:16:37.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.857+0000 7fd2d9876700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2d40ac7e0 con 0x7fd2d4065fe0 2020-04-22T14:16:37.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.858+0000 7fd2d27fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd2d4065fe0 0x7fd2d414b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:37.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.858+0000 7fd2d27fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd2d4065fe0 0x7fd2d414b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56444/0 (socket says 172.21.15.103:56444) 2020-04-22T14:16:37.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.858+0000 7fd2d37fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd2d412c0d0 0x7fd2d414a650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48636/0 (socket says 172.21.15.103:48636) 2020-04-22T14:16:37.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.858+0000 7fd2d27fc700 1 -- 172.21.15.103:0/4261848915 learned_addr learned my addr 172.21.15.103:0/4261848915 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:37.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.858+0000 7fd2d27fc700 1 -- 172.21.15.103:0/4261848915 >> v1:172.21.15.103:6789/0 conn(0x7fd2d412c0d0 legacy=0x7fd2d414a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:37.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.858+0000 7fd2d27fc700 1 -- 172.21.15.103:0/4261848915 >> v1:172.21.15.86:6789/0 conn(0x7fd2d405b8a0 legacy=0x7fd2d4149f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:37.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.858+0000 7fd2c3fff700 1 -- 172.21.15.103:0/4261848915 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 895083687 0 0) 0x7fd2d40aca80 con 0x7fd2d412c0d0 2020-04-22T14:16:37.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.858+0000 7fd2d27fc700 1 -- 172.21.15.103:0/4261848915 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d41428e0 con 0x7fd2d4065fe0 2020-04-22T14:16:37.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.858+0000 7fd2d27fc700 1 --2- 172.21.15.103:0/4261848915 >> v2:172.21.15.103:3300/0 conn(0x7fd2d4065fe0 0x7fd2d414b8f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd2c4002ef0 tx=0x7fd2c4010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:37.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.858+0000 7fd2d27fc700 1 --2- 172.21.15.103:0/4261848915 >> v2:172.21.15.103:3300/0 conn(0x7fd2d4065fe0 0x7fd2d414b8f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd2c4002ef0 tx=0x7fd2c4010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:37.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.858+0000 7fd2d27fc700 1 --2- 172.21.15.103:0/4261848915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2d4065fe0 0x7fd2d414b8f0 secure :-1 s=READY pgs=1701 cs=0 l=1 rx=0x7fd2c4002ef0 tx=0x7fd2c4010f70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:37.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.858+0000 7fd2d27fc700 1 --2- 172.21.15.103:0/4261848915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2d4065fe0 0x7fd2d414b8f0 secure :-1 s=THROTTLE_DONE pgs=1701 cs=0 l=1 rx=0x7fd2c4002ef0 tx=0x7fd2c4010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:37.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.858+0000 7fd2c3fff700 1 -- 172.21.15.103:0/4261848915 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2c4007560 con 0x7fd2d4065fe0 2020-04-22T14:16:37.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.858+0000 7fd2d27fc700 1 --2- 172.21.15.103:0/4261848915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2d4065fe0 0x7fd2d414b8f0 secure :-1 s=THROTTLE_DONE pgs=1701 cs=0 l=1 rx=0x7fd2c4002ef0 tx=0x7fd2c4010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:37.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.858+0000 7fd2c3fff700 1 -- 172.21.15.103:0/4261848915 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c4005a60 con 0x7fd2d4065fe0 2020-04-22T14:16:37.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.858+0000 7fd2d9876700 1 -- 172.21.15.103:0/4261848915 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2d4142020 con 0x7fd2d4065fe0 2020-04-22T14:16:37.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.858+0000 7fd2d27fc700 1 --2- 172.21.15.103:0/4261848915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2d4065fe0 0x7fd2d414b8f0 secure :-1 s=THROTTLE_DONE pgs=1701 cs=0 l=1 rx=0x7fd2c4002ef0 tx=0x7fd2c4010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:37.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.858+0000 7fd2c3fff700 1 -- 172.21.15.103:0/4261848915 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2c4005e00 con 0x7fd2d4065fe0 2020-04-22T14:16:37.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.858+0000 7fd2d9876700 1 -- 172.21.15.103:0/4261848915 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d414e0a0 con 0x7fd2d4065fe0 2020-04-22T14:16:37.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.859+0000 7fd2d27fc700 1 --2- 172.21.15.103:0/4261848915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2d4065fe0 0x7fd2d414b8f0 secure :-1 s=THROTTLE_DONE pgs=1701 cs=0 l=1 rx=0x7fd2c4002ef0 tx=0x7fd2c4010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:37.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.859+0000 7fd2d9876700 1 -- 172.21.15.103:0/4261848915 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2d4056c90 con 0x7fd2d4065fe0 2020-04-22T14:16:37.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.859+0000 7fd2c3fff700 1 -- 172.21.15.103:0/4261848915 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fd2c40101a0 con 0x7fd2d4065fe0 2020-04-22T14:16:37.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.859+0000 7fd2d27fc700 1 --2- 172.21.15.103:0/4261848915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2d4065fe0 0x7fd2d414b8f0 secure :-1 s=THROTTLE_DONE pgs=1701 cs=0 l=1 rx=0x7fd2c4002ef0 tx=0x7fd2c4010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:37.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.860+0000 7fd2c3fff700 1 --2- 172.21.15.103:0/4261848915 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2b004d880 0x7fd2b004fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:37.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.860+0000 7fd2c3fff700 1 -- 172.21.15.103:0/4261848915 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6245+0+0 (secure 0 0 0) 0x7fd2c40616d0 con 0x7fd2d4065fe0 2020-04-22T14:16:37.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.860+0000 7fd2d2ffd700 1 --2- 172.21.15.103:0/4261848915 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2b004d880 0x7fd2b004fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:37.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.860+0000 7fd2d2ffd700 1 --2- 172.21.15.103:0/4261848915 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2b004d880 0x7fd2b004fd40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd2d4064e00 tx=0x7fd2c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:37.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.860+0000 7fd2d2ffd700 1 --2- 172.21.15.103:0/4261848915 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2b004d880 0x7fd2b004fd40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd2d4064e00 tx=0x7fd2c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:37.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.860+0000 7fd2d2ffd700 1 --2- 172.21.15.103:0/4261848915 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2b004d880 0x7fd2b004fd40 secure :-1 s=READY pgs=618 cs=0 l=1 rx=0x7fd2d4064e00 tx=0x7fd2c8007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:37.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.864+0000 7fd2d27fc700 1 --2- 172.21.15.103:0/4261848915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2d4065fe0 0x7fd2d414b8f0 secure :-1 s=THROTTLE_DONE pgs=1701 cs=0 l=1 rx=0x7fd2c4002ef0 tx=0x7fd2c4010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:37.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:37.864+0000 7fd2c3fff700 1 -- 172.21.15.103:0/4261848915 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fd2c403cab0 con 0x7fd2d4065fe0 2020-04-22T14:16:38.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.056+0000 7fd2d9876700 1 -- 172.21.15.103:0/4261848915 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd2d414ddd0 con 0x7fd2d4065fe0 2020-04-22T14:16:38.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.056+0000 7fd2d27fc700 1 --2- 172.21.15.103:0/4261848915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2d4065fe0 0x7fd2d414b8f0 secure :-1 s=THROTTLE_DONE pgs=1701 cs=0 l=1 rx=0x7fd2c4002ef0 tx=0x7fd2c4010f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:38.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.056+0000 7fd2c3fff700 1 -- 172.21.15.103:0/4261848915 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+1777 (secure 0 0 0) 0x7fd2c40400d0 con 0x7fd2d4065fe0 2020-04-22T14:16:38.060 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:16:38.060 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":89,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6332,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/419161869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":419161869},{"type":"v1","addr":"172.21.15.86:6835","nonce":419161869}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":84}],"filesystems":[{"mdsmap":{"epoch":89,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:16:05.150517+0000","modified":"2020-04-22T14:16:37.674191+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":116,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2020-04-22T14:16:38.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.058+0000 7fd2d9876700 1 -- 172.21.15.103:0/4261848915 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2b004d880 msgr2=0x7fd2b004fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:38.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.058+0000 7fd2d9876700 1 --2- 172.21.15.103:0/4261848915 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2b004d880 0x7fd2b004fd40 secure :-1 s=READY pgs=618 cs=0 l=1 rx=0x7fd2d4064e00 tx=0x7fd2c8007a40).stop 2020-04-22T14:16:38.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.058+0000 7fd2d9876700 1 -- 172.21.15.103:0/4261848915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2d4065fe0 msgr2=0x7fd2d414b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:38.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.058+0000 7fd2d9876700 1 --2- 172.21.15.103:0/4261848915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2d4065fe0 0x7fd2d414b8f0 secure :-1 s=READY pgs=1701 cs=0 l=1 rx=0x7fd2c4002ef0 tx=0x7fd2c4010f70).stop 2020-04-22T14:16:38.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.058+0000 7fd2d9876700 1 -- 172.21.15.103:0/4261848915 shutdown_connections 2020-04-22T14:16:38.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.058+0000 7fd2d9876700 1 --2- 172.21.15.103:0/4261848915 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2b004d880 0x7fd2b004fd40 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:38.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.058+0000 7fd2d9876700 1 --2- 172.21.15.103:0/4261848915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2d4065fe0 0x7fd2d414b8f0 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:38.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.058+0000 7fd2d9876700 1 -- 172.21.15.103:0/4261848915 >> 172.21.15.103:0/4261848915 conn(0x7fd2d40b9160 msgr2=0x7fd2d4064ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:38.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.058+0000 7fd2d9876700 1 -- 172.21.15.103:0/4261848915 shutdown_connections 2020-04-22T14:16:38.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.058+0000 7fd2d9876700 1 -- 172.21.15.103:0/4261848915 wait complete. 2020-04-22T14:16:38.063 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 89 2020-04-22T14:16:38.072 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:38.098 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-04-22T14:16:38.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.242+0000 7fc7a94cd700 1 Processor -- start 2020-04-22T14:16:38.246 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.242+0000 7fc7a94cd700 1 -- start start 2020-04-22T14:16:38.248 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.243+0000 7fc7a94cd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc7a40b9670 0x7fc7a40b6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:38.249 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.243+0000 7fc7a94cd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc7a414a480 0x7fc7a41468f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:38.249 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.243+0000 7fc7a94cd700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7a40b4420 con 0x7fc7a414a020 2020-04-22T14:16:38.249 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.243+0000 7fc7a94cd700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7a41498e0 con 0x7fc7a40b9670 2020-04-22T14:16:38.249 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.243+0000 7fc7a94cd700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7a4149b80 con 0x7fc7a414a480 2020-04-22T14:16:38.249 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.243+0000 7fc7a27fc700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc7a414a020 0x7fc7a40663c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48640/0 (socket says 172.21.15.103:48640) 2020-04-22T14:16:38.249 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.243+0000 7fc7a27fc700 1 -- 172.21.15.103:0/3826498827 learned_addr learned my addr 172.21.15.103:0/3826498827 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:38.249 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.243+0000 7fc7a37fe700 1 --2- 172.21.15.103:0/3826498827 >> v2:172.21.15.103:3300/0 conn(0x7fc7a414a480 0x7fc7a41468f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:38.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.244+0000 7fc7a37fe700 1 -- 172.21.15.103:0/3826498827 >> v2:172.21.15.86:3300/0 conn(0x7fc7a40b9670 msgr2=0x7fc7a40b6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:38.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.244+0000 7fc7a2ffd700 1 --2- 172.21.15.103:0/3826498827 >> v2:172.21.15.86:3300/0 conn(0x7fc7a40b9670 0x7fc7a40b6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:38.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.244+0000 7fc7a37fe700 1 --2- 172.21.15.103:0/3826498827 >> v2:172.21.15.86:3300/0 conn(0x7fc7a40b9670 0x7fc7a40b6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:38.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.244+0000 7fc7a37fe700 1 -- 172.21.15.103:0/3826498827 >> v1:172.21.15.103:6789/0 conn(0x7fc7a414a020 legacy=0x7fc7a40663c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:38.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.244+0000 7fc7a1ffb700 1 -- 172.21.15.103:0/3826498827 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1414747425 0 0) 0x7fc7a40b4420 con 0x7fc7a414a020 2020-04-22T14:16:38.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.244+0000 7fc7a37fe700 1 -- 172.21.15.103:0/3826498827 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a40b9a50 con 0x7fc7a414a480 2020-04-22T14:16:38.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.244+0000 7fc7a37fe700 1 --2- 172.21.15.103:0/3826498827 >> v2:172.21.15.103:3300/0 conn(0x7fc7a414a480 0x7fc7a41468f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc7a40b03b0 tx=0x7fc79c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:38.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.244+0000 7fc7a37fe700 1 --2- 172.21.15.103:0/3826498827 >> v2:172.21.15.103:3300/0 conn(0x7fc7a414a480 0x7fc7a41468f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc7a40b03b0 tx=0x7fc79c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:38.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.244+0000 7fc7a37fe700 1 --2- 172.21.15.103:0/3826498827 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7a414a480 0x7fc7a41468f0 secure :-1 s=READY pgs=1703 cs=0 l=1 rx=0x7fc7a40b03b0 tx=0x7fc79c007dc0).ready entity=mon.1 client_cookie=5de2b1e724924a52 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:38.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.244+0000 7fc7a37fe700 1 --2- 172.21.15.103:0/3826498827 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7a414a480 0x7fc7a41468f0 secure :-1 s=THROTTLE_DONE pgs=1703 cs=0 l=1 rx=0x7fc7a40b03b0 tx=0x7fc79c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:38.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.244+0000 7fc7a1ffb700 1 -- 172.21.15.103:0/3826498827 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc79c011e90 con 0x7fc7a414a480 2020-04-22T14:16:38.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.244+0000 7fc7a37fe700 1 --2- 172.21.15.103:0/3826498827 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7a414a480 0x7fc7a41468f0 secure :-1 s=THROTTLE_DONE pgs=1703 cs=0 l=1 rx=0x7fc7a40b03b0 tx=0x7fc79c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:38.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.244+0000 7fc7a37fe700 1 --2- 172.21.15.103:0/3826498827 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7a414a480 0x7fc7a41468f0 secure :-1 s=THROTTLE_DONE pgs=1703 cs=0 l=1 rx=0x7fc7a40b03b0 tx=0x7fc79c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:38.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.244+0000 7fc7a1ffb700 1 -- 172.21.15.103:0/3826498827 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc79c00a180 con 0x7fc7a414a480 2020-04-22T14:16:38.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.244+0000 7fc7a1ffb700 1 -- 172.21.15.103:0/3826498827 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc79c00a560 con 0x7fc7a414a480 2020-04-22T14:16:38.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.244+0000 7fc7a94cd700 1 -- 172.21.15.103:0/3826498827 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7a414a480 msgr2=0x7fc7a41468f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:38.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.244+0000 7fc7a94cd700 1 --2- 172.21.15.103:0/3826498827 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7a414a480 0x7fc7a41468f0 secure :-1 s=READY pgs=1703 cs=0 l=1 rx=0x7fc7a40b03b0 tx=0x7fc79c007dc0).stop 2020-04-22T14:16:38.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.244+0000 7fc7a94cd700 1 -- 172.21.15.103:0/3826498827 shutdown_connections 2020-04-22T14:16:38.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.244+0000 7fc7a94cd700 1 --2- 172.21.15.103:0/3826498827 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7a414a480 0x7fc7a41468f0 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:38.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.245+0000 7fc7a94cd700 1 --2- 172.21.15.103:0/3826498827 >> v2:172.21.15.86:3300/0 conn(0x7fc7a40b9670 0x7fc7a40b6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:38.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.245+0000 7fc7a94cd700 1 -- 172.21.15.103:0/3826498827 >> 172.21.15.103:0/3826498827 conn(0x7fc7a405ad30 msgr2=0x7fc7a405b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:38.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.245+0000 7fc7a94cd700 1 -- 172.21.15.103:0/3826498827 shutdown_connections 2020-04-22T14:16:38.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.245+0000 7fc7a94cd700 1 -- 172.21.15.103:0/3826498827 wait complete. 2020-04-22T14:16:38.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.245+0000 7fc7a94cd700 1 Processor -- start 2020-04-22T14:16:38.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.246+0000 7fc7a94cd700 1 -- start start 2020-04-22T14:16:38.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.246+0000 7fc7a94cd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc7a40b9670 0x7fc7a41148e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:38.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.246+0000 7fc7a94cd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7a414a480 0x7fc7a40afa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:38.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.246+0000 7fc7a94cd700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7a40ad110 con 0x7fc7a414a020 2020-04-22T14:16:38.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.246+0000 7fc7a94cd700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7a4115670 con 0x7fc7a40b9670 2020-04-22T14:16:38.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.246+0000 7fc7a94cd700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a4154190 con 0x7fc7a414a480 2020-04-22T14:16:38.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.246+0000 7fc7a2ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc7a40b9670 0x7fc7a41148e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:38.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.246+0000 7fc7a27fc700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc7a414a020 0x7fc7a4153a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48646/0 (socket says 172.21.15.103:48646) 2020-04-22T14:16:38.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.246+0000 7fc7a2ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc7a40b9670 0x7fc7a41148e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56456/0 (socket says 172.21.15.103:56456) 2020-04-22T14:16:38.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.246+0000 7fc7a27fc700 1 -- 172.21.15.103:0/1118022464 learned_addr learned my addr 172.21.15.103:0/1118022464 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:38.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.246+0000 7fc7a37fe700 1 --2- 172.21.15.103:0/1118022464 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7a414a480 0x7fc7a40afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:38.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.247+0000 7fc7a2ffd700 1 -- 172.21.15.103:0/1118022464 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7a414a480 msgr2=0x7fc7a40afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:38.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.247+0000 7fc7a2ffd700 1 --2- 172.21.15.103:0/1118022464 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7a414a480 0x7fc7a40afa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:38.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.247+0000 7fc7a2ffd700 1 -- 172.21.15.103:0/1118022464 >> v1:172.21.15.103:6789/0 conn(0x7fc7a414a020 legacy=0x7fc7a4153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:38.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.247+0000 7fc793fff700 1 -- 172.21.15.103:0/1118022464 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2716550643 0 0) 0x7fc7a40ad110 con 0x7fc7a414a020 2020-04-22T14:16:38.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.247+0000 7fc7a2ffd700 1 -- 172.21.15.103:0/1118022464 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a4112fb0 con 0x7fc7a40b9670 2020-04-22T14:16:38.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.247+0000 7fc7a2ffd700 1 --2- 172.21.15.103:0/1118022464 >> v2:172.21.15.103:3300/0 conn(0x7fc7a40b9670 0x7fc7a41148e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc798002f30 tx=0x7fc798010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:38.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.247+0000 7fc7a2ffd700 1 --2- 172.21.15.103:0/1118022464 >> v2:172.21.15.103:3300/0 conn(0x7fc7a40b9670 0x7fc7a41148e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc798002f30 tx=0x7fc798010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:38.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.247+0000 7fc7a2ffd700 1 --2- 172.21.15.103:0/1118022464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7a40b9670 0x7fc7a41148e0 secure :-1 s=READY pgs=1705 cs=0 l=1 rx=0x7fc798002f30 tx=0x7fc798010a30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:38.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.247+0000 7fc7a2ffd700 1 --2- 172.21.15.103:0/1118022464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7a40b9670 0x7fc7a41148e0 secure :-1 s=THROTTLE_DONE pgs=1705 cs=0 l=1 rx=0x7fc798002f30 tx=0x7fc798010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:38.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.247+0000 7fc793fff700 1 -- 172.21.15.103:0/1118022464 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc798008e30 con 0x7fc7a40b9670 2020-04-22T14:16:38.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.247+0000 7fc7a2ffd700 1 --2- 172.21.15.103:0/1118022464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7a40b9670 0x7fc7a41148e0 secure :-1 s=THROTTLE_DONE pgs=1705 cs=0 l=1 rx=0x7fc798002f30 tx=0x7fc798010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:38.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.247+0000 7fc793fff700 1 -- 172.21.15.103:0/1118022464 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc79800a370 con 0x7fc7a40b9670 2020-04-22T14:16:38.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.247+0000 7fc7a2ffd700 1 --2- 172.21.15.103:0/1118022464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7a40b9670 0x7fc7a41148e0 secure :-1 s=THROTTLE_DONE pgs=1705 cs=0 l=1 rx=0x7fc798002f30 tx=0x7fc798010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:38.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.247+0000 7fc793fff700 1 -- 172.21.15.103:0/1118022464 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc79800a750 con 0x7fc7a40b9670 2020-04-22T14:16:38.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.247+0000 7fc7a94cd700 1 -- 172.21.15.103:0/1118022464 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7a4113140 con 0x7fc7a40b9670 2020-04-22T14:16:38.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.247+0000 7fc7a94cd700 1 -- 172.21.15.103:0/1118022464 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7a4114f80 con 0x7fc7a40b9670 2020-04-22T14:16:38.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.247+0000 7fc7a2ffd700 1 --2- 172.21.15.103:0/1118022464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7a40b9670 0x7fc7a41148e0 secure :-1 s=THROTTLE_DONE pgs=1705 cs=0 l=1 rx=0x7fc798002f30 tx=0x7fc798010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:38.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.248+0000 7fc7a94cd700 1 -- 172.21.15.103:0/1118022464 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7a4056c90 con 0x7fc7a40b9670 2020-04-22T14:16:38.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.248+0000 7fc793fff700 1 -- 172.21.15.103:0/1118022464 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fc79800a9d0 con 0x7fc7a40b9670 2020-04-22T14:16:38.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.248+0000 7fc7a2ffd700 1 --2- 172.21.15.103:0/1118022464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7a40b9670 0x7fc7a41148e0 secure :-1 s=THROTTLE_DONE pgs=1705 cs=0 l=1 rx=0x7fc798002f30 tx=0x7fc798010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:38.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.248+0000 7fc793fff700 1 --2- 172.21.15.103:0/1118022464 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc78004d840 0x7fc78004fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:38.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.248+0000 7fc793fff700 1 -- 172.21.15.103:0/1118022464 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6245+0+0 (secure 0 0 0) 0x7fc798061680 con 0x7fc7a40b9670 2020-04-22T14:16:38.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.248+0000 7fc7a27fc700 1 --2- 172.21.15.103:0/1118022464 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc78004d840 0x7fc78004fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:38.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.248+0000 7fc7a27fc700 1 --2- 172.21.15.103:0/1118022464 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc78004d840 0x7fc78004fd00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc794001260 tx=0x7fc794001720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:38.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.249+0000 7fc7a27fc700 1 --2- 172.21.15.103:0/1118022464 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc78004d840 0x7fc78004fd00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc794001260 tx=0x7fc794001720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:38.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.249+0000 7fc7a27fc700 1 --2- 172.21.15.103:0/1118022464 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc78004d840 0x7fc78004fd00 secure :-1 s=READY pgs=619 cs=0 l=1 rx=0x7fc794001260 tx=0x7fc794001720).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:38.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.252+0000 7fc7a2ffd700 1 --2- 172.21.15.103:0/1118022464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7a40b9670 0x7fc7a41148e0 secure :-1 s=THROTTLE_DONE pgs=1705 cs=0 l=1 rx=0x7fc798002f30 tx=0x7fc798010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:38.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.252+0000 7fc793fff700 1 -- 172.21.15.103:0/1118022464 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fc798033440 con 0x7fc7a40b9670 2020-04-22T14:16:38.443 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.440+0000 7fc7a94cd700 1 -- 172.21.15.103:0/1118022464 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc7a40b6660 con 0x7fc7a40b9670 2020-04-22T14:16:38.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.688+0000 7fc7a2ffd700 1 --2- 172.21.15.103:0/1118022464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7a40b9670 0x7fc7a41148e0 secure :-1 s=THROTTLE_DONE pgs=1705 cs=0 l=1 rx=0x7fc798002f30 tx=0x7fc798010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:38.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.688+0000 7fc793fff700 1 -- 172.21.15.103:0/1118022464 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v90) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc79803ca60 con 0x7fc7a40b9670 2020-04-22T14:16:38.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.690+0000 7fc7a94cd700 1 -- 172.21.15.103:0/1118022464 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc78004d840 msgr2=0x7fc78004fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:38.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.690+0000 7fc7a94cd700 1 --2- 172.21.15.103:0/1118022464 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc78004d840 0x7fc78004fd00 secure :-1 s=READY pgs=619 cs=0 l=1 rx=0x7fc794001260 tx=0x7fc794001720).stop 2020-04-22T14:16:38.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.690+0000 7fc7a94cd700 1 -- 172.21.15.103:0/1118022464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7a40b9670 msgr2=0x7fc7a41148e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:38.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.690+0000 7fc7a94cd700 1 --2- 172.21.15.103:0/1118022464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7a40b9670 0x7fc7a41148e0 secure :-1 s=READY pgs=1705 cs=0 l=1 rx=0x7fc798002f30 tx=0x7fc798010a30).stop 2020-04-22T14:16:38.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.690+0000 7fc7a94cd700 1 -- 172.21.15.103:0/1118022464 shutdown_connections 2020-04-22T14:16:38.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.690+0000 7fc7a94cd700 1 --2- 172.21.15.103:0/1118022464 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc78004d840 0x7fc78004fd00 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:38.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.690+0000 7fc7a94cd700 1 --2- 172.21.15.103:0/1118022464 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7a414a480 0x7fc7a40afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:38.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.690+0000 7fc7a94cd700 1 --2- 172.21.15.103:0/1118022464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7a40b9670 0x7fc7a41148e0 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:38.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.690+0000 7fc7a94cd700 1 -- 172.21.15.103:0/1118022464 >> 172.21.15.103:0/1118022464 conn(0x7fc7a405ad30 msgr2=0x7fc7a405f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:38.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.690+0000 7fc7a94cd700 1 -- 172.21.15.103:0/1118022464 shutdown_connections 2020-04-22T14:16:38.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.690+0000 7fc7a94cd700 1 -- 172.21.15.103:0/1118022464 wait complete. 2020-04-22T14:16:38.704 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:38.718 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-04-22T14:16:38.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.864+0000 7fe0c898f700 1 Processor -- start 2020-04-22T14:16:38.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.864+0000 7fe0c898f700 1 -- start start 2020-04-22T14:16:38.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.865+0000 7fe0c898f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe0c40b9140 0x7fe0c412b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:38.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.865+0000 7fe0c898f700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c41467e0 con 0x7fe0c412b670 2020-04-22T14:16:38.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.865+0000 7fe0c898f700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c4060050 con 0x7fe0c40ac950 2020-04-22T14:16:38.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.865+0000 7fe0c898f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c40602f0 con 0x7fe0c40b9140 2020-04-22T14:16:38.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.865+0000 7fe0c259c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe0c40b9140 0x7fe0c412b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:38.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.865+0000 7fe0c259c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe0c40b9140 0x7fe0c412b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56464/0 (socket says 172.21.15.103:56464) 2020-04-22T14:16:38.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.865+0000 7fe0c259c700 1 -- 172.21.15.103:0/2234645917 learned_addr learned my addr 172.21.15.103:0/2234645917 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:38.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.865+0000 7fe0c1d9b700 1 --1- 172.21.15.103:0/2234645917 >> v1:172.21.15.103:6789/0 conn(0x7fe0c40ac950 0x7fe0c4146c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48654/0 (socket says 172.21.15.103:48654) 2020-04-22T14:16:38.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.865+0000 7fe0c259c700 1 -- 172.21.15.103:0/2234645917 >> v1:172.21.15.103:6789/0 conn(0x7fe0c40ac950 legacy=0x7fe0c4146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:38.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.865+0000 7fe0c259c700 1 -- 172.21.15.103:0/2234645917 >> v1:172.21.15.86:6789/0 conn(0x7fe0c412b670 legacy=0x7fe0c4143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:38.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.865+0000 7fe0c259c700 1 -- 172.21.15.103:0/2234645917 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c40b9520 con 0x7fe0c40b9140 2020-04-22T14:16:38.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.865+0000 7fe0c259c700 1 --2- 172.21.15.103:0/2234645917 >> v2:172.21.15.103:3300/0 conn(0x7fe0c40b9140 0x7fe0c412b210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe0c40b6250 tx=0x7fe0b8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:38.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.866+0000 7fe0c259c700 1 --2- 172.21.15.103:0/2234645917 >> v2:172.21.15.103:3300/0 conn(0x7fe0c40b9140 0x7fe0c412b210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe0c40b6250 tx=0x7fe0b8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:38.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.866+0000 7fe0c259c700 1 --2- 172.21.15.103:0/2234645917 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0c40b9140 0x7fe0c412b210 secure :-1 s=READY pgs=1707 cs=0 l=1 rx=0x7fe0c40b6250 tx=0x7fe0b8007a40).ready entity=mon.1 client_cookie=7c9dfcd8de0fe9cc server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:38.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.866+0000 7fe0c259c700 1 --2- 172.21.15.103:0/2234645917 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0c40b9140 0x7fe0c412b210 secure :-1 s=THROTTLE_DONE pgs=1707 cs=0 l=1 rx=0x7fe0c40b6250 tx=0x7fe0b8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:38.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.866+0000 7fe0c259c700 1 --2- 172.21.15.103:0/2234645917 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0c40b9140 0x7fe0c412b210 secure :-1 s=THROTTLE_DONE pgs=1707 cs=0 l=1 rx=0x7fe0c40b6250 tx=0x7fe0b8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:38.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.866+0000 7fe0c159a700 1 -- 172.21.15.103:0/2234645917 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0b80116e0 con 0x7fe0c40b9140 2020-04-22T14:16:38.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.866+0000 7fe0c259c700 1 --2- 172.21.15.103:0/2234645917 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0c40b9140 0x7fe0c412b210 secure :-1 s=THROTTLE_DONE pgs=1707 cs=0 l=1 rx=0x7fe0c40b6250 tx=0x7fe0b8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:38.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.866+0000 7fe0c159a700 1 -- 172.21.15.103:0/2234645917 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b8011840 con 0x7fe0c40b9140 2020-04-22T14:16:38.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.866+0000 7fe0c159a700 1 -- 172.21.15.103:0/2234645917 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0b8011c60 con 0x7fe0c40b9140 2020-04-22T14:16:38.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.866+0000 7fe0c898f700 1 -- 172.21.15.103:0/2234645917 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0c40b9140 msgr2=0x7fe0c412b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:38.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.866+0000 7fe0c898f700 1 --2- 172.21.15.103:0/2234645917 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0c40b9140 0x7fe0c412b210 secure :-1 s=READY pgs=1707 cs=0 l=1 rx=0x7fe0c40b6250 tx=0x7fe0b8007a40).stop 2020-04-22T14:16:38.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.866+0000 7fe0c898f700 1 -- 172.21.15.103:0/2234645917 shutdown_connections 2020-04-22T14:16:38.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.866+0000 7fe0c898f700 1 --2- 172.21.15.103:0/2234645917 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0c40b9140 0x7fe0c412b210 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:38.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.866+0000 7fe0c898f700 1 -- 172.21.15.103:0/2234645917 >> 172.21.15.103:0/2234645917 conn(0x7fe0c405b7b0 msgr2=0x7fe0c40b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:38.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.866+0000 7fe0c898f700 1 -- 172.21.15.103:0/2234645917 shutdown_connections 2020-04-22T14:16:38.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.866+0000 7fe0c898f700 1 -- 172.21.15.103:0/2234645917 wait complete. 2020-04-22T14:16:38.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.867+0000 7fe0c898f700 1 Processor -- start 2020-04-22T14:16:38.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.867+0000 7fe0c898f700 1 -- start start 2020-04-22T14:16:38.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.868+0000 7fe0c898f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe0c40ac950 0x7fe0c4065790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:38.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.868+0000 7fe0c898f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe0c412b670 0x7fe0c41281a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:38.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.868+0000 7fe0c898f700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c4063030 con 0x7fe0c40b9140 2020-04-22T14:16:38.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.868+0000 7fe0c898f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c4064500 con 0x7fe0c412b670 2020-04-22T14:16:38.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.868+0000 7fe0c898f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c40b5eb0 con 0x7fe0c40ac950 2020-04-22T14:16:38.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.868+0000 7fe0c2d9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe0c412b670 0x7fe0c41281a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:38.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.868+0000 7fe0c1d9b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe0c40b9140 0x7fe0c40663f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48658/0 (socket says 172.21.15.103:48658) 2020-04-22T14:16:38.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.868+0000 7fe0c2d9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe0c412b670 0x7fe0c41281a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56470/0 (socket says 172.21.15.103:56470) 2020-04-22T14:16:38.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.868+0000 7fe0c1d9b700 1 -- 172.21.15.103:0/554621413 learned_addr learned my addr 172.21.15.103:0/554621413 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:38.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.868+0000 7fe0c259c700 1 --2- 172.21.15.103:0/554621413 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe0c40ac950 0x7fe0c4065790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:38.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.868+0000 7fe0c2d9d700 1 -- 172.21.15.103:0/554621413 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe0c40ac950 msgr2=0x7fe0c4065790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:38.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.868+0000 7fe0c2d9d700 1 --2- 172.21.15.103:0/554621413 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe0c40ac950 0x7fe0c4065790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:38.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.868+0000 7fe0c2d9d700 1 -- 172.21.15.103:0/554621413 >> v1:172.21.15.103:6789/0 conn(0x7fe0c40b9140 legacy=0x7fe0c40663f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:38.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.868+0000 7fe0c2d9d700 1 -- 172.21.15.103:0/554621413 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c40632d0 con 0x7fe0c412b670 2020-04-22T14:16:38.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.868+0000 7fe0c2d9d700 1 --2- 172.21.15.103:0/554621413 >> v2:172.21.15.103:3300/0 conn(0x7fe0c412b670 0x7fe0c41281a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe0b4001160 tx=0x7fe0bc010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:38.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.868+0000 7fe0c2d9d700 1 --2- 172.21.15.103:0/554621413 >> v2:172.21.15.103:3300/0 conn(0x7fe0c412b670 0x7fe0c41281a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe0b4001160 tx=0x7fe0bc010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:38.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.868+0000 7fe0c2d9d700 1 --2- 172.21.15.103:0/554621413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0c412b670 0x7fe0c41281a0 secure :-1 s=READY pgs=1709 cs=0 l=1 rx=0x7fe0b4001160 tx=0x7fe0bc010c30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:38.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.869+0000 7fe0c2d9d700 1 --2- 172.21.15.103:0/554621413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0c412b670 0x7fe0c41281a0 secure :-1 s=THROTTLE_DONE pgs=1709 cs=0 l=1 rx=0x7fe0b4001160 tx=0x7fe0bc010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:38.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.869+0000 7fe0c2d9d700 1 --2- 172.21.15.103:0/554621413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0c412b670 0x7fe0c41281a0 secure :-1 s=THROTTLE_DONE pgs=1709 cs=0 l=1 rx=0x7fe0b4001160 tx=0x7fe0bc010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:38.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.869+0000 7fe0b37fe700 1 -- 172.21.15.103:0/554621413 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0bc013070 con 0x7fe0c412b670 2020-04-22T14:16:38.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.869+0000 7fe0c2d9d700 1 --2- 172.21.15.103:0/554621413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0c412b670 0x7fe0c41281a0 secure :-1 s=THROTTLE_DONE pgs=1709 cs=0 l=1 rx=0x7fe0b4001160 tx=0x7fe0bc010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:38.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.869+0000 7fe0b37fe700 1 -- 172.21.15.103:0/554621413 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0bc006c40 con 0x7fe0c412b670 2020-04-22T14:16:38.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.869+0000 7fe0c898f700 1 -- 172.21.15.103:0/554621413 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0c4063570 con 0x7fe0c412b670 2020-04-22T14:16:38.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.869+0000 7fe0b37fe700 1 -- 172.21.15.103:0/554621413 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0bc006e30 con 0x7fe0c412b670 2020-04-22T14:16:38.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.869+0000 7fe0c898f700 1 -- 172.21.15.103:0/554621413 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0c4062dd0 con 0x7fe0c412b670 2020-04-22T14:16:38.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.869+0000 7fe0c2d9d700 1 --2- 172.21.15.103:0/554621413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0c412b670 0x7fe0c41281a0 secure :-1 s=THROTTLE_DONE pgs=1709 cs=0 l=1 rx=0x7fe0b4001160 tx=0x7fe0bc010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:38.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.870+0000 7fe0b37fe700 1 -- 172.21.15.103:0/554621413 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fe0bc00b0b0 con 0x7fe0c412b670 2020-04-22T14:16:38.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.870+0000 7fe0c2d9d700 1 --2- 172.21.15.103:0/554621413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0c412b670 0x7fe0c41281a0 secure :-1 s=THROTTLE_DONE pgs=1709 cs=0 l=1 rx=0x7fe0b4001160 tx=0x7fe0bc010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:38.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.870+0000 7fe0c898f700 1 -- 172.21.15.103:0/554621413 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0c4056c90 con 0x7fe0c412b670 2020-04-22T14:16:38.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.870+0000 7fe0b37fe700 1 --2- 172.21.15.103:0/554621413 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe0a004d960 0x7fe0a004fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:38.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.870+0000 7fe0b37fe700 1 -- 172.21.15.103:0/554621413 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6245+0+0 (secure 0 0 0) 0x7fe0bc061170 con 0x7fe0c412b670 2020-04-22T14:16:38.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.870+0000 7fe0c259c700 1 --2- 172.21.15.103:0/554621413 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe0a004d960 0x7fe0a004fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:38.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.870+0000 7fe0c259c700 1 --2- 172.21.15.103:0/554621413 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe0a004d960 0x7fe0a004fe20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe0c40b6250 tx=0x7fe0b8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:38.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.870+0000 7fe0c259c700 1 --2- 172.21.15.103:0/554621413 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe0a004d960 0x7fe0a004fe20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe0c40b6250 tx=0x7fe0b8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:38.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.870+0000 7fe0c259c700 1 --2- 172.21.15.103:0/554621413 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe0a004d960 0x7fe0a004fe20 secure :-1 s=READY pgs=620 cs=0 l=1 rx=0x7fe0c40b6250 tx=0x7fe0b8007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:38.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.874+0000 7fe0c2d9d700 1 --2- 172.21.15.103:0/554621413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0c412b670 0x7fe0c41281a0 secure :-1 s=THROTTLE_DONE pgs=1709 cs=0 l=1 rx=0x7fe0b4001160 tx=0x7fe0bc010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:38.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:38.874+0000 7fe0b37fe700 1 -- 172.21.15.103:0/554621413 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fe0bc03c4f0 con 0x7fe0c412b670 2020-04-22T14:16:39.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.016+0000 7fe0c898f700 1 -- 172.21.15.103:0/554621413 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe0c406a960 con 0x7fe0c412b670 2020-04-22T14:16:39.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.702+0000 7fe0c2d9d700 1 --2- 172.21.15.103:0/554621413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0c412b670 0x7fe0c41281a0 secure :-1 s=THROTTLE_DONE pgs=1709 cs=0 l=1 rx=0x7fe0b4001160 tx=0x7fe0bc010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:39.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.702+0000 7fe0b37fe700 1 -- 172.21.15.103:0/554621413 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v117) v1 ==== 185+0+0 (secure 0 0 0) 0x7fe0bc03fb10 con 0x7fe0c412b670 2020-04-22T14:16:39.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.704+0000 7fe0c898f700 1 -- 172.21.15.103:0/554621413 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe0a004d960 msgr2=0x7fe0a004fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:39.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.704+0000 7fe0c898f700 1 --2- 172.21.15.103:0/554621413 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe0a004d960 0x7fe0a004fe20 secure :-1 s=READY pgs=620 cs=0 l=1 rx=0x7fe0c40b6250 tx=0x7fe0b8007a40).stop 2020-04-22T14:16:39.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.704+0000 7fe0c898f700 1 -- 172.21.15.103:0/554621413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0c412b670 msgr2=0x7fe0c41281a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:39.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.704+0000 7fe0c898f700 1 --2- 172.21.15.103:0/554621413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0c412b670 0x7fe0c41281a0 secure :-1 s=READY pgs=1709 cs=0 l=1 rx=0x7fe0b4001160 tx=0x7fe0bc010c30).stop 2020-04-22T14:16:39.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.704+0000 7fe0c898f700 1 -- 172.21.15.103:0/554621413 shutdown_connections 2020-04-22T14:16:39.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.704+0000 7fe0c898f700 1 --2- 172.21.15.103:0/554621413 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe0a004d960 0x7fe0a004fe20 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:39.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.704+0000 7fe0c898f700 1 --2- 172.21.15.103:0/554621413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0c412b670 0x7fe0c41281a0 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:39.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.704+0000 7fe0c898f700 1 --2- 172.21.15.103:0/554621413 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe0c40ac950 0x7fe0c4065790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:39.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.704+0000 7fe0c898f700 1 -- 172.21.15.103:0/554621413 >> 172.21.15.103:0/554621413 conn(0x7fe0c405b7b0 msgr2=0x7fe0c40b7850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:39.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.704+0000 7fe0c898f700 1 -- 172.21.15.103:0/554621413 shutdown_connections 2020-04-22T14:16:39.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.704+0000 7fe0c898f700 1 -- 172.21.15.103:0/554621413 wait complete. 2020-04-22T14:16:39.711 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' removed 2020-04-22T14:16:39.720 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:39.735 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2020-04-22T14:16:39.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.888+0000 7f43aa4eb700 1 Processor -- start 2020-04-22T14:16:39.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.888+0000 7f43aa4eb700 1 -- start start 2020-04-22T14:16:39.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.888+0000 7f43aa4eb700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f43a40b9140 0x7f43a40aed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:39.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.888+0000 7f43aa4eb700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f43a40b3bd0 0x7f43a40af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:39.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.888+0000 7f43aa4eb700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43a40616b0 0x7f43a4061b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:39.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.888+0000 7f43aa4eb700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43a40af650 con 0x7f43a40b3bd0 2020-04-22T14:16:39.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.888+0000 7f43aa4eb700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43a4148310 con 0x7f43a40b9140 2020-04-22T14:16:39.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.888+0000 7f43aa4eb700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a41485b0 con 0x7f43a40616b0 2020-04-22T14:16:39.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.889+0000 7f43a3fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f43a40b9140 0x7f43a40aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:39.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.889+0000 7f43a3fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f43a40b9140 0x7f43a40aed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56480/0 (socket says 172.21.15.103:56480) 2020-04-22T14:16:39.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.889+0000 7f43a3fff700 1 -- 172.21.15.103:0/1347073862 learned_addr learned my addr 172.21.15.103:0/1347073862 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:39.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.889+0000 7f43a8a88700 1 --2- 172.21.15.103:0/1347073862 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43a40616b0 0x7f43a4061b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:39.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.889+0000 7f43a37fe700 1 --2- 172.21.15.103:0/1347073862 >> v2:172.21.15.86:3300/0 conn(0x7f43a40b3bd0 0x7f43a40af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:39.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.889+0000 7f43a3fff700 1 -- 172.21.15.103:0/1347073862 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43a40616b0 msgr2=0x7f43a4061b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:39.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.889+0000 7f43a3fff700 1 --2- 172.21.15.103:0/1347073862 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43a40616b0 0x7f43a4061b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:39.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.889+0000 7f43a3fff700 1 -- 172.21.15.103:0/1347073862 >> v2:172.21.15.86:3300/0 conn(0x7f43a40b3bd0 msgr2=0x7f43a40af1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:39.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.889+0000 7f43a3fff700 1 --2- 172.21.15.103:0/1347073862 >> v2:172.21.15.86:3300/0 conn(0x7f43a40b3bd0 0x7f43a40af1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:39.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.889+0000 7f43a3fff700 1 -- 172.21.15.103:0/1347073862 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a40b9520 con 0x7f43a40b9140 2020-04-22T14:16:39.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.889+0000 7f43a3fff700 1 --2- 172.21.15.103:0/1347073862 >> v2:172.21.15.103:3300/0 conn(0x7f43a40b9140 0x7f43a40aed90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4394002f30 tx=0x7f4394007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:39.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.889+0000 7f43a3fff700 1 --2- 172.21.15.103:0/1347073862 >> v2:172.21.15.103:3300/0 conn(0x7f43a40b9140 0x7f43a40aed90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4394002f30 tx=0x7f4394007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:39.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.889+0000 7f43a3fff700 1 --2- 172.21.15.103:0/1347073862 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43a40b9140 0x7f43a40aed90 secure :-1 s=READY pgs=1710 cs=0 l=1 rx=0x7f4394002f30 tx=0x7f4394007a40).ready entity=mon.1 client_cookie=27fd483b2b2dbe5f server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:39.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.889+0000 7f43a3fff700 1 --2- 172.21.15.103:0/1347073862 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43a40b9140 0x7f43a40aed90 secure :-1 s=THROTTLE_DONE pgs=1710 cs=0 l=1 rx=0x7f4394002f30 tx=0x7f4394007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:39.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.889+0000 7f43a3fff700 1 --2- 172.21.15.103:0/1347073862 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43a40b9140 0x7f43a40aed90 secure :-1 s=THROTTLE_DONE pgs=1710 cs=0 l=1 rx=0x7f4394002f30 tx=0x7f4394007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:39.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.889+0000 7f43a3fff700 1 --2- 172.21.15.103:0/1347073862 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43a40b9140 0x7f43a40aed90 secure :-1 s=THROTTLE_DONE pgs=1710 cs=0 l=1 rx=0x7f4394002f30 tx=0x7f4394007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:39.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.889+0000 7f43a2ffd700 1 -- 172.21.15.103:0/1347073862 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4394011720 con 0x7f43a40b9140 2020-04-22T14:16:39.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.889+0000 7f43a2ffd700 1 -- 172.21.15.103:0/1347073862 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4394011880 con 0x7f43a40b9140 2020-04-22T14:16:39.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.889+0000 7f43a2ffd700 1 -- 172.21.15.103:0/1347073862 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4394011ca0 con 0x7f43a40b9140 2020-04-22T14:16:39.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.889+0000 7f43aa4eb700 1 -- 172.21.15.103:0/1347073862 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43a40b9140 msgr2=0x7f43a40aed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:39.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.889+0000 7f43aa4eb700 1 --2- 172.21.15.103:0/1347073862 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43a40b9140 0x7f43a40aed90 secure :-1 s=READY pgs=1710 cs=0 l=1 rx=0x7f4394002f30 tx=0x7f4394007a40).stop 2020-04-22T14:16:39.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.890+0000 7f43aa4eb700 1 -- 172.21.15.103:0/1347073862 shutdown_connections 2020-04-22T14:16:39.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.890+0000 7f43aa4eb700 1 --2- 172.21.15.103:0/1347073862 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43a40616b0 0x7f43a4061b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:39.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.890+0000 7f43aa4eb700 1 --2- 172.21.15.103:0/1347073862 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43a40b9140 0x7f43a40aed90 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:39.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.890+0000 7f43aa4eb700 1 --2- 172.21.15.103:0/1347073862 >> v2:172.21.15.86:3300/0 conn(0x7f43a40b3bd0 0x7f43a40af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:39.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.890+0000 7f43aa4eb700 1 -- 172.21.15.103:0/1347073862 >> 172.21.15.103:0/1347073862 conn(0x7f43a405b7b0 msgr2=0x7f43a40b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:39.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.890+0000 7f43aa4eb700 1 -- 172.21.15.103:0/1347073862 shutdown_connections 2020-04-22T14:16:39.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.890+0000 7f43aa4eb700 1 -- 172.21.15.103:0/1347073862 wait complete. 2020-04-22T14:16:39.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.891+0000 7f43aa4eb700 1 Processor -- start 2020-04-22T14:16:39.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.891+0000 7f43aa4eb700 1 -- start start 2020-04-22T14:16:39.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.892+0000 7f43aa4eb700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43a40616b0 0x7f43a4154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:39.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.892+0000 7f43aa4eb700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f43a40b9140 0x7f43a40b2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:39.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.892+0000 7f43aa4eb700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43a40b2870 con 0x7f43a40b3bd0 2020-04-22T14:16:39.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.892+0000 7f43aa4eb700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43a40652a0 con 0x7f43a40b9140 2020-04-22T14:16:39.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.892+0000 7f43aa4eb700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a4065540 con 0x7f43a40616b0 2020-04-22T14:16:39.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.892+0000 7f43a3fff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43a40616b0 0x7f43a4154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:39.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.892+0000 7f43a8a88700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f43a40b9140 0x7f43a40b2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:39.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.892+0000 7f43a3fff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43a40616b0 0x7f43a4154fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:41260/0 (socket says 172.21.15.103:41260) 2020-04-22T14:16:39.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.892+0000 7f43a3fff700 1 -- 172.21.15.103:0/392856145 learned_addr learned my addr 172.21.15.103:0/392856145 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:39.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.892+0000 7f43a8a88700 1 -- 172.21.15.103:0/392856145 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43a40616b0 msgr2=0x7f43a4154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:39.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.892+0000 7f43a8a88700 1 --2- 172.21.15.103:0/392856145 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43a40616b0 0x7f43a4154fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:39.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.892+0000 7f43a8a88700 1 -- 172.21.15.103:0/392856145 >> v1:172.21.15.86:6789/0 conn(0x7f43a40b3bd0 legacy=0x7f43a4144ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:39.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.892+0000 7f43a8a88700 1 -- 172.21.15.103:0/392856145 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a40657e0 con 0x7f43a40b9140 2020-04-22T14:16:39.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.892+0000 7f43a17fa700 1 -- 172.21.15.103:0/392856145 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3772934555 0 0) 0x7f4398001ec0 con 0x7f43a40b3bd0 2020-04-22T14:16:39.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.892+0000 7f43a8a88700 1 --2- 172.21.15.103:0/392856145 >> v2:172.21.15.86:3300/0 conn(0x7f43a40b9140 0x7f43a40b2410 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f439c0032b0 tx=0x7f439c010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:39.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.892+0000 7f43a8a88700 1 --2- 172.21.15.103:0/392856145 >> v2:172.21.15.86:3300/0 conn(0x7f43a40b9140 0x7f43a40b2410 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f439c0032b0 tx=0x7f439c010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:39.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.892+0000 7f43a8a88700 1 --2- 172.21.15.103:0/392856145 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43a40b9140 0x7f43a40b2410 secure :-1 s=READY pgs=914 cs=0 l=1 rx=0x7f439c0032b0 tx=0x7f439c010d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:39.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.892+0000 7f43a8a88700 1 --2- 172.21.15.103:0/392856145 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43a40b9140 0x7f43a40b2410 secure :-1 s=THROTTLE_DONE pgs=914 cs=0 l=1 rx=0x7f439c0032b0 tx=0x7f439c010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:39.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.892+0000 7f43a17fa700 1 -- 172.21.15.103:0/392856145 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f439c005e30 con 0x7f43a40b9140 2020-04-22T14:16:39.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.892+0000 7f43a8a88700 1 --2- 172.21.15.103:0/392856145 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43a40b9140 0x7f43a40b2410 secure :-1 s=THROTTLE_DONE pgs=914 cs=0 l=1 rx=0x7f439c0032b0 tx=0x7f439c010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:39.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.892+0000 7f43aa4eb700 1 -- 172.21.15.103:0/392856145 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43a41455b0 con 0x7f43a40b9140 2020-04-22T14:16:39.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.892+0000 7f43a17fa700 1 -- 172.21.15.103:0/392856145 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439c007560 con 0x7f43a40b9140 2020-04-22T14:16:39.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.892+0000 7f43a8a88700 1 --2- 172.21.15.103:0/392856145 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43a40b9140 0x7f43a40b2410 secure :-1 s=THROTTLE_DONE pgs=914 cs=0 l=1 rx=0x7f439c0032b0 tx=0x7f439c010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:39.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.892+0000 7f43a17fa700 1 -- 172.21.15.103:0/392856145 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f439c0078c0 con 0x7f43a40b9140 2020-04-22T14:16:39.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.893+0000 7f43aa4eb700 1 -- 172.21.15.103:0/392856145 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a4064a30 con 0x7f43a40b9140 2020-04-22T14:16:39.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.893+0000 7f43a8a88700 1 --2- 172.21.15.103:0/392856145 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43a40b9140 0x7f43a40b2410 secure :-1 s=THROTTLE_DONE pgs=914 cs=0 l=1 rx=0x7f439c0032b0 tx=0x7f439c010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:39.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.893+0000 7f43aa4eb700 1 -- 172.21.15.103:0/392856145 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43a4056c90 con 0x7f43a40b9140 2020-04-22T14:16:39.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.894+0000 7f43a17fa700 1 -- 172.21.15.103:0/392856145 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f439c0123e0 con 0x7f43a40b9140 2020-04-22T14:16:39.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.894+0000 7f43a8a88700 1 --2- 172.21.15.103:0/392856145 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43a40b9140 0x7f43a40b2410 secure :-1 s=THROTTLE_DONE pgs=914 cs=0 l=1 rx=0x7f439c0032b0 tx=0x7f439c010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:39.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.894+0000 7f43a17fa700 1 --2- 172.21.15.103:0/392856145 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f438404d820 0x7f438404fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:39.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.894+0000 7f43a17fa700 1 -- 172.21.15.103:0/392856145 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5807+0+0 (secure 0 0 0) 0x7f439c061ab0 con 0x7f43a40b9140 2020-04-22T14:16:39.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.894+0000 7f43a3fff700 1 --2- 172.21.15.103:0/392856145 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f438404d820 0x7f438404fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:39.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.894+0000 7f43a3fff700 1 --2- 172.21.15.103:0/392856145 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f438404d820 0x7f438404fce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4394002f30 tx=0x7f4394007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:39.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.894+0000 7f43a3fff700 1 --2- 172.21.15.103:0/392856145 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f438404d820 0x7f438404fce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4394002f30 tx=0x7f4394007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:39.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.894+0000 7f43a3fff700 1 --2- 172.21.15.103:0/392856145 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f438404d820 0x7f438404fce0 secure :-1 s=READY pgs=621 cs=0 l=1 rx=0x7f4394002f30 tx=0x7f4394007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:39.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.898+0000 7f43a8a88700 1 --2- 172.21.15.103:0/392856145 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43a40b9140 0x7f43a40b2410 secure :-1 s=THROTTLE_DONE pgs=914 cs=0 l=1 rx=0x7f439c0032b0 tx=0x7f439c010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:39.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:39.898+0000 7f43a17fa700 1 -- 172.21.15.103:0/392856145 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f439c03ce30 con 0x7f43a40b9140 2020-04-22T14:16:40.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.038+0000 7f43aa4eb700 1 -- 172.21.15.103:0/392856145 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f43a40b4220 con 0x7f43a40b9140 2020-04-22T14:16:40.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.700+0000 7f43a8a88700 1 --2- 172.21.15.103:0/392856145 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43a40b9140 0x7f43a40b2410 secure :-1 s=THROTTLE_DONE pgs=914 cs=0 l=1 rx=0x7f439c0032b0 tx=0x7f439c010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:40.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.700+0000 7f43a17fa700 1 -- 172.21.15.103:0/392856145 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v118) v1 ==== 173+0+0 (secure 0 0 0) 0x7f439c040450 con 0x7f43a40b9140 2020-04-22T14:16:40.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.702+0000 7f43aa4eb700 1 -- 172.21.15.103:0/392856145 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f438404d820 msgr2=0x7f438404fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:40.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.702+0000 7f43aa4eb700 1 --2- 172.21.15.103:0/392856145 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f438404d820 0x7f438404fce0 secure :-1 s=READY pgs=621 cs=0 l=1 rx=0x7f4394002f30 tx=0x7f4394007a40).stop 2020-04-22T14:16:40.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.702+0000 7f43aa4eb700 1 -- 172.21.15.103:0/392856145 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43a40b9140 msgr2=0x7f43a40b2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:40.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.702+0000 7f43aa4eb700 1 --2- 172.21.15.103:0/392856145 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43a40b9140 0x7f43a40b2410 secure :-1 s=READY pgs=914 cs=0 l=1 rx=0x7f439c0032b0 tx=0x7f439c010d40).stop 2020-04-22T14:16:40.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.702+0000 7f43aa4eb700 1 -- 172.21.15.103:0/392856145 shutdown_connections 2020-04-22T14:16:40.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.702+0000 7f43aa4eb700 1 --2- 172.21.15.103:0/392856145 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f438404d820 0x7f438404fce0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:40.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.702+0000 7f43aa4eb700 1 --2- 172.21.15.103:0/392856145 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43a40b9140 0x7f43a40b2410 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:40.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.702+0000 7f43aa4eb700 1 --2- 172.21.15.103:0/392856145 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43a40616b0 0x7f43a4154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:40.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.702+0000 7f43aa4eb700 1 -- 172.21.15.103:0/392856145 >> 172.21.15.103:0/392856145 conn(0x7f43a405b7b0 msgr2=0x7f43a4142250 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:40.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.702+0000 7f43aa4eb700 1 -- 172.21.15.103:0/392856145 shutdown_connections 2020-04-22T14:16:40.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.702+0000 7f43aa4eb700 1 -- 172.21.15.103:0/392856145 wait complete. 2020-04-22T14:16:40.707 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' removed 2020-04-22T14:16:40.718 INFO:tasks.ceph.mds.a:Restarting daemon 2020-04-22T14:16:40.718 INFO:tasks.ceph.mds.a:Stopping old one... 2020-04-22T14:16:40.718 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-04-22T14:16:40.718 INFO:teuthology.orchestra.run:waiting for 300 2020-04-22T14:16:40.719 INFO:tasks.ceph.mds.b:Restarting daemon 2020-04-22T14:16:40.719 INFO:tasks.ceph.mds.b:Stopping old one... 2020-04-22T14:16:40.719 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-04-22T14:16:40.719 INFO:teuthology.orchestra.run:waiting for 300 2020-04-22T14:16:40.727 INFO:tasks.ceph.mds.a:Stopped 2020-04-22T14:16:40.727 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:40.731 INFO:tasks.ceph.mds.b:Stopped 2020-04-22T14:16:40.731 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:16:40.783 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-04-22T14:16:40.789 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-04-22T14:16:40.826 INFO:tasks.ceph.mds.a:Started 2020-04-22T14:16:40.827 DEBUG:teuthology.parallel:result is None 2020-04-22T14:16:40.832 INFO:tasks.ceph.mds.b:Started 2020-04-22T14:16:40.832 DEBUG:teuthology.parallel:result is None 2020-04-22T14:16:40.833 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:40.847 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2020-04-22T14:16:40.902 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2020-04-22T14:16:40.914 INFO:tasks.ceph.mds.b.smithi086.stdout:starting mds.b at 2020-04-22T14:16:40.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.995+0000 7f8cfffff700 1 Processor -- start 2020-04-22T14:16:40.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.995+0000 7f8cfffff700 1 -- start start 2020-04-22T14:16:41.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.996+0000 7f8cfffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8d00067110 0x7f8d000aee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:41.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.996+0000 7f8cfffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8d00142690 0x7f8d00142af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:41.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.996+0000 7f8cfffff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d00142f50 con 0x7f8d000ac740 2020-04-22T14:16:41.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.996+0000 7f8cfffff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d000afb20 con 0x7f8d00142690 2020-04-22T14:16:41.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.996+0000 7f8cfffff700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d000afdc0 con 0x7f8d00067110 2020-04-22T14:16:41.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.996+0000 7f8cfeffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8d00067110 0x7f8d000aee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:41.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.996+0000 7f8cfeffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8d00067110 0x7f8d000aee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56502/0 (socket says 172.21.15.103:56502) 2020-04-22T14:16:41.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.996+0000 7f8cfeffd700 1 -- 172.21.15.103:0/3271522421 learned_addr learned my addr 172.21.15.103:0/3271522421 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:41.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.996+0000 7f8cfe7fc700 1 --2- 172.21.15.103:0/3271522421 >> v2:172.21.15.86:3300/0 conn(0x7f8d00142690 0x7f8d00142af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:41.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.996+0000 7f8cfeffd700 1 -- 172.21.15.103:0/3271522421 >> v2:172.21.15.86:3300/0 conn(0x7f8d00142690 msgr2=0x7f8d00142af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:41.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.996+0000 7f8cfeffd700 1 --2- 172.21.15.103:0/3271522421 >> v2:172.21.15.86:3300/0 conn(0x7f8d00142690 0x7f8d00142af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:41.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.996+0000 7f8cfeffd700 1 -- 172.21.15.103:0/3271522421 >> v1:172.21.15.86:6789/0 conn(0x7f8d000ac740 legacy=0x7f8d000acb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:41.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.996+0000 7f8cfeffd700 1 -- 172.21.15.103:0/3271522421 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d000b0060 con 0x7f8d00067110 2020-04-22T14:16:41.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.996+0000 7f8cfe7fc700 1 --2- 172.21.15.103:0/3271522421 >> v2:172.21.15.86:3300/0 conn(0x7f8d00142690 0x7f8d00142af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:16:41.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.996+0000 7f8cfeffd700 1 --2- 172.21.15.103:0/3271522421 >> v2:172.21.15.103:3300/0 conn(0x7f8d00067110 0x7f8d000aee80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8cf0002f30 tx=0x7f8cf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:41.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.996+0000 7f8cfeffd700 1 --2- 172.21.15.103:0/3271522421 >> v2:172.21.15.103:3300/0 conn(0x7f8d00067110 0x7f8d000aee80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8cf0002f30 tx=0x7f8cf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:41.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.996+0000 7f8cfeffd700 1 --2- 172.21.15.103:0/3271522421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d00067110 0x7f8d000aee80 secure :-1 s=READY pgs=1714 cs=0 l=1 rx=0x7f8cf0002f30 tx=0x7f8cf0007a40).ready entity=mon.1 client_cookie=96d04214aa063f50 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:41.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.996+0000 7f8cfeffd700 1 --2- 172.21.15.103:0/3271522421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d00067110 0x7f8d000aee80 secure :-1 s=THROTTLE_DONE pgs=1714 cs=0 l=1 rx=0x7f8cf0002f30 tx=0x7f8cf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:41.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.996+0000 7f8cfdffb700 1 -- 172.21.15.103:0/3271522421 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cf0011720 con 0x7f8d00067110 2020-04-22T14:16:41.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.996+0000 7f8cfeffd700 1 --2- 172.21.15.103:0/3271522421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d00067110 0x7f8d000aee80 secure :-1 s=THROTTLE_DONE pgs=1714 cs=0 l=1 rx=0x7f8cf0002f30 tx=0x7f8cf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:41.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.996+0000 7f8cfeffd700 1 --2- 172.21.15.103:0/3271522421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d00067110 0x7f8d000aee80 secure :-1 s=THROTTLE_DONE pgs=1714 cs=0 l=1 rx=0x7f8cf0002f30 tx=0x7f8cf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:41.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.997+0000 7f8cfdffb700 1 -- 172.21.15.103:0/3271522421 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf0011880 con 0x7f8d00067110 2020-04-22T14:16:41.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.997+0000 7f8cfdffb700 1 -- 172.21.15.103:0/3271522421 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cf0011ca0 con 0x7f8d00067110 2020-04-22T14:16:41.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.997+0000 7f8cfffff700 1 -- 172.21.15.103:0/3271522421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d00067110 msgr2=0x7f8d000aee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:41.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.997+0000 7f8cfffff700 1 --2- 172.21.15.103:0/3271522421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d00067110 0x7f8d000aee80 secure :-1 s=READY pgs=1714 cs=0 l=1 rx=0x7f8cf0002f30 tx=0x7f8cf0007a40).stop 2020-04-22T14:16:41.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.997+0000 7f8cfffff700 1 -- 172.21.15.103:0/3271522421 shutdown_connections 2020-04-22T14:16:41.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.997+0000 7f8cfffff700 1 --2- 172.21.15.103:0/3271522421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d00067110 0x7f8d000aee80 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:41.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.997+0000 7f8cfffff700 1 --2- 172.21.15.103:0/3271522421 >> v2:172.21.15.86:3300/0 conn(0x7f8d00142690 0x7f8d00142af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:41.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.997+0000 7f8cfffff700 1 -- 172.21.15.103:0/3271522421 >> 172.21.15.103:0/3271522421 conn(0x7f8d0005ad30 msgr2=0x7f8d0005b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:41.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.997+0000 7f8cfffff700 1 -- 172.21.15.103:0/3271522421 shutdown_connections 2020-04-22T14:16:41.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.997+0000 7f8cfffff700 1 -- 172.21.15.103:0/3271522421 wait complete. 2020-04-22T14:16:41.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.998+0000 7f8cfffff700 1 Processor -- start 2020-04-22T14:16:41.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.998+0000 7f8cfffff700 1 -- start start 2020-04-22T14:16:41.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.999+0000 7f8cfffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8d00067110 0x7f8d00147d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:41.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.999+0000 7f8cfffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8d00142690 0x7f8d001556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:41.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.999+0000 7f8cfffff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d00148190 con 0x7f8d000ac740 2020-04-22T14:16:41.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.999+0000 7f8cfffff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d00156030 con 0x7f8d00142690 2020-04-22T14:16:41.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.999+0000 7f8cfffff700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d001562d0 con 0x7f8d00067110 2020-04-22T14:16:41.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.999+0000 7f8cfeffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8d00067110 0x7f8d00147d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:41.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.999+0000 7f8cfeffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8d00067110 0x7f8d00147d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56508/0 (socket says 172.21.15.103:56508) 2020-04-22T14:16:41.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.999+0000 7f8cfeffd700 1 -- 172.21.15.103:0/4172856137 learned_addr learned my addr 172.21.15.103:0/4172856137 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:41.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.999+0000 7f8cff7fe700 1 --2- 172.21.15.103:0/4172856137 >> v2:172.21.15.86:3300/0 conn(0x7f8d00142690 0x7f8d001556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:41.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.999+0000 7f8cfeffd700 1 -- 172.21.15.103:0/4172856137 >> v2:172.21.15.86:3300/0 conn(0x7f8d00142690 msgr2=0x7f8d001556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:41.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.999+0000 7f8cfeffd700 1 --2- 172.21.15.103:0/4172856137 >> v2:172.21.15.86:3300/0 conn(0x7f8d00142690 0x7f8d001556b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:41.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.999+0000 7f8cfeffd700 1 -- 172.21.15.103:0/4172856137 >> v1:172.21.15.86:6789/0 conn(0x7f8d000ac740 legacy=0x7f8d00062890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:41.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.999+0000 7f8cfeffd700 1 -- 172.21.15.103:0/4172856137 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d00151f70 con 0x7f8d00067110 2020-04-22T14:16:41.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:40.999+0000 7f8cfeffd700 1 --2- 172.21.15.103:0/4172856137 >> v2:172.21.15.103:3300/0 conn(0x7f8d00067110 0x7f8d00147d30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8d001485a0 tx=0x7f8cf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:41.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:41.000+0000 7f8cfeffd700 1 --2- 172.21.15.103:0/4172856137 >> v2:172.21.15.103:3300/0 conn(0x7f8d00067110 0x7f8d00147d30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8d001485a0 tx=0x7f8cf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:41.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:41.000+0000 7f8cfeffd700 1 --2- 172.21.15.103:0/4172856137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d00067110 0x7f8d00147d30 secure :-1 s=READY pgs=1715 cs=0 l=1 rx=0x7f8d001485a0 tx=0x7f8cf0007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:41.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:41.000+0000 7f8cfeffd700 1 --2- 172.21.15.103:0/4172856137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d00067110 0x7f8d00147d30 secure :-1 s=THROTTLE_DONE pgs=1715 cs=0 l=1 rx=0x7f8d001485a0 tx=0x7f8cf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:41.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:41.000+0000 7f8cfeffd700 1 --2- 172.21.15.103:0/4172856137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d00067110 0x7f8d00147d30 secure :-1 s=THROTTLE_DONE pgs=1715 cs=0 l=1 rx=0x7f8d001485a0 tx=0x7f8cf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:41.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:41.000+0000 7f8ceffff700 1 -- 172.21.15.103:0/4172856137 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cf0007360 con 0x7f8d00067110 2020-04-22T14:16:41.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:41.000+0000 7f8cfeffd700 1 --2- 172.21.15.103:0/4172856137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d00067110 0x7f8d00147d30 secure :-1 s=THROTTLE_DONE pgs=1715 cs=0 l=1 rx=0x7f8d001485a0 tx=0x7f8cf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:41.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:41.000+0000 7f8ceffff700 1 -- 172.21.15.103:0/4172856137 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf00074c0 con 0x7f8d00067110 2020-04-22T14:16:41.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:41.000+0000 7f8cfffff700 1 -- 172.21.15.103:0/4172856137 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d00143d10 con 0x7f8d00067110 2020-04-22T14:16:41.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:41.000+0000 7f8ceffff700 1 -- 172.21.15.103:0/4172856137 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cf00058b0 con 0x7f8d00067110 2020-04-22T14:16:41.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:41.000+0000 7f8cfffff700 1 -- 172.21.15.103:0/4172856137 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d00155d50 con 0x7f8d00067110 2020-04-22T14:16:41.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:41.001+0000 7f8cfeffd700 1 --2- 172.21.15.103:0/4172856137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d00067110 0x7f8d00147d30 secure :-1 s=THROTTLE_DONE pgs=1715 cs=0 l=1 rx=0x7f8d001485a0 tx=0x7f8cf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:41.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:41.001+0000 7f8cfffff700 1 -- 172.21.15.103:0/4172856137 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ce0003340 con 0x7f8d00067110 2020-04-22T14:16:41.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:41.001+0000 7f8ceffff700 1 -- 172.21.15.103:0/4172856137 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f8cf0005b20 con 0x7f8d00067110 2020-04-22T14:16:41.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:41.001+0000 7f8cfeffd700 1 --2- 172.21.15.103:0/4172856137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d00067110 0x7f8d00147d30 secure :-1 s=THROTTLE_DONE pgs=1715 cs=0 l=1 rx=0x7f8d001485a0 tx=0x7f8cf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:41.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:41.001+0000 7f8ceffff700 1 --2- 172.21.15.103:0/4172856137 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8cdc04da20 0x7f8cdc04fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:41.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:41.001+0000 7f8ceffff700 1 -- 172.21.15.103:0/4172856137 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5425+0+0 (secure 0 0 0) 0x7f8cf0065dd0 con 0x7f8d00067110 2020-04-22T14:16:41.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:41.002+0000 7f8cfe7fc700 1 --2- 172.21.15.103:0/4172856137 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8cdc04da20 0x7f8cdc04fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:41.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:41.002+0000 7f8cfe7fc700 1 --2- 172.21.15.103:0/4172856137 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8cdc04da20 0x7f8cdc04fee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8cf4002f30 tx=0x7f8cf400c530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:41.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:41.002+0000 7f8cfe7fc700 1 --2- 172.21.15.103:0/4172856137 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8cdc04da20 0x7f8cdc04fee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8cf4002f30 tx=0x7f8cf400c530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:41.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:41.002+0000 7f8cfe7fc700 1 --2- 172.21.15.103:0/4172856137 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8cdc04da20 0x7f8cdc04fee0 secure :-1 s=READY pgs=622 cs=0 l=1 rx=0x7f8cf4002f30 tx=0x7f8cf400c530).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:41.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:41.005+0000 7f8cfeffd700 1 --2- 172.21.15.103:0/4172856137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d00067110 0x7f8d00147d30 secure :-1 s=THROTTLE_DONE pgs=1715 cs=0 l=1 rx=0x7f8d001485a0 tx=0x7f8cf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:41.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:41.005+0000 7f8ceffff700 1 -- 172.21.15.103:0/4172856137 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f8cf00412d0 con 0x7f8d00067110 2020-04-22T14:16:41.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:41.164+0000 7f8cfffff700 1 -- 172.21.15.103:0/4172856137 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f8ce00036e0 con 0x7f8d00067110 2020-04-22T14:16:41.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:41.931+0000 7f8cfeffd700 1 --2- 172.21.15.103:0/4172856137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d00067110 0x7f8d00147d30 secure :-1 s=THROTTLE_DONE pgs=1715 cs=0 l=1 rx=0x7f8d001485a0 tx=0x7f8cf0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:41.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:41.931+0000 7f8ceffff700 1 -- 172.21.15.103:0/4172856137 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v120) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8cf00448f0 con 0x7f8d00067110 2020-04-22T14:16:41.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:41.933+0000 7f8cfffff700 1 -- 172.21.15.103:0/4172856137 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8cdc04da20 msgr2=0x7f8cdc04fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:41.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:41.933+0000 7f8cfffff700 1 --2- 172.21.15.103:0/4172856137 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8cdc04da20 0x7f8cdc04fee0 secure :-1 s=READY pgs=622 cs=0 l=1 rx=0x7f8cf4002f30 tx=0x7f8cf400c530).stop 2020-04-22T14:16:41.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:41.933+0000 7f8cfffff700 1 -- 172.21.15.103:0/4172856137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d00067110 msgr2=0x7f8d00147d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:41.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:41.933+0000 7f8cfffff700 1 --2- 172.21.15.103:0/4172856137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d00067110 0x7f8d00147d30 secure :-1 s=READY pgs=1715 cs=0 l=1 rx=0x7f8d001485a0 tx=0x7f8cf0007a40).stop 2020-04-22T14:16:41.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:41.933+0000 7f8cfffff700 1 -- 172.21.15.103:0/4172856137 shutdown_connections 2020-04-22T14:16:41.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:41.933+0000 7f8cfffff700 1 --2- 172.21.15.103:0/4172856137 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8cdc04da20 0x7f8cdc04fee0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:41.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:41.933+0000 7f8cfffff700 1 --2- 172.21.15.103:0/4172856137 >> v2:172.21.15.86:3300/0 conn(0x7f8d00142690 0x7f8d001556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:41.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:41.933+0000 7f8cfffff700 1 --2- 172.21.15.103:0/4172856137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d00067110 0x7f8d00147d30 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:41.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:41.933+0000 7f8cfffff700 1 -- 172.21.15.103:0/4172856137 >> 172.21.15.103:0/4172856137 conn(0x7f8d0005ad30 msgr2=0x7f8d000acb60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:41.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:41.933+0000 7f8cfffff700 1 -- 172.21.15.103:0/4172856137 shutdown_connections 2020-04-22T14:16:41.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:41.933+0000 7f8cfffff700 1 -- 172.21.15.103:0/4172856137 wait complete. 2020-04-22T14:16:41.938 INFO:teuthology.orchestra.run.smithi103.stderr: removed all blacklist entries 2020-04-22T14:16:41.948 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2020-04-22T14:16:41.949 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:42.004 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2020-04-22T14:16:42.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.153+0000 7f25b640d700 1 Processor -- start 2020-04-22T14:16:42.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.153+0000 7f25b640d700 1 -- start start 2020-04-22T14:16:42.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.154+0000 7f25b640d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f25b01441f0 0x7f25b0144820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:42.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.154+0000 7f25b640d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25b0144c80 0x7f25b00ad850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:42.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.154+0000 7f25b640d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b00b5900 con 0x7f25b005b7c0 2020-04-22T14:16:42.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.154+0000 7f25b640d700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b00b5ba0 con 0x7f25b01441f0 2020-04-22T14:16:42.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.154+0000 7f25b640d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b00b5e40 con 0x7f25b0144c80 2020-04-22T14:16:42.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.154+0000 7f25a7fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f25b01441f0 0x7f25b0144820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:42.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.154+0000 7f25affff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f25b005b7c0 0x7f25b00b50d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48708/0 (socket says 172.21.15.103:48708) 2020-04-22T14:16:42.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.154+0000 7f25affff700 1 -- 172.21.15.103:0/1017454819 learned_addr learned my addr 172.21.15.103:0/1017454819 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:42.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.154+0000 7f25a7fff700 1 -- 172.21.15.103:0/1017454819 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25b0144c80 msgr2=0x7f25b00ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:42.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.154+0000 7f25b49aa700 1 --2- 172.21.15.103:0/1017454819 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25b0144c80 0x7f25b00ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:42.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.155+0000 7f25af7fe700 1 -- 172.21.15.103:0/1017454819 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 533892901 0 0) 0x7f25b00b5900 con 0x7f25b005b7c0 2020-04-22T14:16:42.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.155+0000 7f25a7fff700 1 --2- 172.21.15.103:0/1017454819 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25b0144c80 0x7f25b00ad850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:42.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.155+0000 7f25a7fff700 1 -- 172.21.15.103:0/1017454819 >> v1:172.21.15.103:6789/0 conn(0x7f25b005b7c0 legacy=0x7f25b00b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:42.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.155+0000 7f25a7fff700 1 -- 172.21.15.103:0/1017454819 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b005bba0 con 0x7f25b01441f0 2020-04-22T14:16:42.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.155+0000 7f25b49aa700 1 --2- 172.21.15.103:0/1017454819 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25b0144c80 0x7f25b00ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:16:42.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.155+0000 7f25a7fff700 1 --2- 172.21.15.103:0/1017454819 >> v2:172.21.15.103:3300/0 conn(0x7f25b01441f0 0x7f25b0144820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2598002f30 tx=0x7f2598007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.155+0000 7f25a7fff700 1 --2- 172.21.15.103:0/1017454819 >> v2:172.21.15.103:3300/0 conn(0x7f25b01441f0 0x7f25b0144820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2598002f30 tx=0x7f2598007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.162 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.155+0000 7f25a7fff700 1 --2- 172.21.15.103:0/1017454819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25b01441f0 0x7f25b0144820 secure :-1 s=READY pgs=1717 cs=0 l=1 rx=0x7f2598002f30 tx=0x7f2598007a40).ready entity=mon.1 client_cookie=4ed03cf9d766e5b5 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:42.162 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.155+0000 7f25a7fff700 1 --2- 172.21.15.103:0/1017454819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25b01441f0 0x7f25b0144820 secure :-1 s=THROTTLE_DONE pgs=1717 cs=0 l=1 rx=0x7f2598002f30 tx=0x7f2598007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.162 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.155+0000 7f25af7fe700 1 -- 172.21.15.103:0/1017454819 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2598008d00 con 0x7f25b01441f0 2020-04-22T14:16:42.162 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.155+0000 7f25a7fff700 1 --2- 172.21.15.103:0/1017454819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25b01441f0 0x7f25b0144820 secure :-1 s=THROTTLE_DONE pgs=1717 cs=0 l=1 rx=0x7f2598002f30 tx=0x7f2598007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.162 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.155+0000 7f25a7fff700 1 --2- 172.21.15.103:0/1017454819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25b01441f0 0x7f25b0144820 secure :-1 s=THROTTLE_DONE pgs=1717 cs=0 l=1 rx=0x7f2598002f30 tx=0x7f2598007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.162 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.155+0000 7f25af7fe700 1 -- 172.21.15.103:0/1017454819 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2598010700 con 0x7f25b01441f0 2020-04-22T14:16:42.162 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.155+0000 7f25af7fe700 1 -- 172.21.15.103:0/1017454819 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2598008ea0 con 0x7f25b01441f0 2020-04-22T14:16:42.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.155+0000 7f25b640d700 1 -- 172.21.15.103:0/1017454819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25b01441f0 msgr2=0x7f25b0144820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:42.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.155+0000 7f25b640d700 1 --2- 172.21.15.103:0/1017454819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25b01441f0 0x7f25b0144820 secure :-1 s=READY pgs=1717 cs=0 l=1 rx=0x7f2598002f30 tx=0x7f2598007a40).stop 2020-04-22T14:16:42.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.155+0000 7f25b640d700 1 -- 172.21.15.103:0/1017454819 shutdown_connections 2020-04-22T14:16:42.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.155+0000 7f25b640d700 1 --2- 172.21.15.103:0/1017454819 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25b0144c80 0x7f25b00ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:42.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.155+0000 7f25b640d700 1 --2- 172.21.15.103:0/1017454819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25b01441f0 0x7f25b0144820 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:42.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.155+0000 7f25b640d700 1 -- 172.21.15.103:0/1017454819 >> 172.21.15.103:0/1017454819 conn(0x7f25b00b9160 msgr2=0x7f25b005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:42.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.155+0000 7f25b640d700 1 -- 172.21.15.103:0/1017454819 shutdown_connections 2020-04-22T14:16:42.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.155+0000 7f25b640d700 1 -- 172.21.15.103:0/1017454819 wait complete. 2020-04-22T14:16:42.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.156+0000 7f25b640d700 1 Processor -- start 2020-04-22T14:16:42.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.156+0000 7f25b640d700 1 -- start start 2020-04-22T14:16:42.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.157+0000 7f25b640d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f25b01441f0 0x7f25b013a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:42.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.157+0000 7f25b640d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f25b0144c80 0x7f25b01410e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:42.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.157+0000 7f25b640d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b01464d0 con 0x7f25b005b7c0 2020-04-22T14:16:42.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.157+0000 7f25b640d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b0146770 con 0x7f25b01441f0 2020-04-22T14:16:42.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.157+0000 7f25b640d700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b0146a10 con 0x7f25b0144c80 2020-04-22T14:16:42.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.157+0000 7f25affff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f25b005b7c0 0x7f25b013a220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48712/0 (socket says 172.21.15.103:48712) 2020-04-22T14:16:42.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.157+0000 7f25affff700 1 -- 172.21.15.103:0/86214953 learned_addr learned my addr 172.21.15.103:0/86214953 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:42.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.157+0000 7f25b49aa700 1 --2- 172.21.15.103:0/86214953 >> v2:172.21.15.103:3300/0 conn(0x7f25b0144c80 0x7f25b01410e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:42.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.157+0000 7f25a7fff700 1 --2- 172.21.15.103:0/86214953 >> v2:172.21.15.86:3300/0 conn(0x7f25b01441f0 0x7f25b013a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:42.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.157+0000 7f25adffb700 1 -- 172.21.15.103:0/86214953 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2923632859 0 0) 0x7f25b01464d0 con 0x7f25b005b7c0 2020-04-22T14:16:42.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.157+0000 7f25adffb700 1 -- 172.21.15.103:0/86214953 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2594002fe0 con 0x7f25b005b7c0 2020-04-22T14:16:42.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.157+0000 7f25b49aa700 1 -- 172.21.15.103:0/86214953 >> v2:172.21.15.86:3300/0 conn(0x7f25b01441f0 msgr2=0x7f25b013a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:42.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.157+0000 7f25b49aa700 1 --2- 172.21.15.103:0/86214953 >> v2:172.21.15.86:3300/0 conn(0x7f25b01441f0 0x7f25b013a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:42.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.157+0000 7f25b49aa700 1 -- 172.21.15.103:0/86214953 >> v1:172.21.15.103:6789/0 conn(0x7f25b005b7c0 legacy=0x7f25b013a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:42.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.157+0000 7f25b49aa700 1 -- 172.21.15.103:0/86214953 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b00ae2a0 con 0x7f25b0144c80 2020-04-22T14:16:42.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.158+0000 7f25b49aa700 1 --2- 172.21.15.103:0/86214953 >> v2:172.21.15.103:3300/0 conn(0x7f25b0144c80 0x7f25b01410e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f25a80032b0 tx=0x7f25a8010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.158+0000 7f25b49aa700 1 --2- 172.21.15.103:0/86214953 >> v2:172.21.15.103:3300/0 conn(0x7f25b0144c80 0x7f25b01410e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f25a80032b0 tx=0x7f25a8010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.158+0000 7f25b49aa700 1 --2- 172.21.15.103:0/86214953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25b0144c80 0x7f25b01410e0 secure :-1 s=READY pgs=1719 cs=0 l=1 rx=0x7f25a80032b0 tx=0x7f25a8010cc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:42.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.158+0000 7f25b49aa700 1 --2- 172.21.15.103:0/86214953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25b0144c80 0x7f25b01410e0 secure :-1 s=THROTTLE_DONE pgs=1719 cs=0 l=1 rx=0x7f25a80032b0 tx=0x7f25a8010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.158+0000 7f25adffb700 1 -- 172.21.15.103:0/86214953 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25a8012b30 con 0x7f25b0144c80 2020-04-22T14:16:42.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.158+0000 7f25b49aa700 1 --2- 172.21.15.103:0/86214953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25b0144c80 0x7f25b01410e0 secure :-1 s=THROTTLE_DONE pgs=1719 cs=0 l=1 rx=0x7f25a80032b0 tx=0x7f25a8010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.158+0000 7f25b49aa700 1 --2- 172.21.15.103:0/86214953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25b0144c80 0x7f25b01410e0 secure :-1 s=THROTTLE_DONE pgs=1719 cs=0 l=1 rx=0x7f25a80032b0 tx=0x7f25a8010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.158+0000 7f25adffb700 1 -- 172.21.15.103:0/86214953 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a8009e90 con 0x7f25b0144c80 2020-04-22T14:16:42.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.158+0000 7f25b640d700 1 -- 172.21.15.103:0/86214953 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25b0146030 con 0x7f25b0144c80 2020-04-22T14:16:42.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.158+0000 7f25adffb700 1 -- 172.21.15.103:0/86214953 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25a80091c0 con 0x7f25b0144c80 2020-04-22T14:16:42.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.158+0000 7f25b640d700 1 -- 172.21.15.103:0/86214953 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b00670f0 con 0x7f25b0144c80 2020-04-22T14:16:42.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.158+0000 7f25b49aa700 1 --2- 172.21.15.103:0/86214953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25b0144c80 0x7f25b01410e0 secure :-1 s=THROTTLE_DONE pgs=1719 cs=0 l=1 rx=0x7f25a80032b0 tx=0x7f25a8010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.159+0000 7f25b640d700 1 -- 172.21.15.103:0/86214953 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25b0146340 con 0x7f25b0144c80 2020-04-22T14:16:42.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.159+0000 7f25adffb700 1 -- 172.21.15.103:0/86214953 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f25a8005a40 con 0x7f25b0144c80 2020-04-22T14:16:42.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.159+0000 7f25b49aa700 1 --2- 172.21.15.103:0/86214953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25b0144c80 0x7f25b01410e0 secure :-1 s=THROTTLE_DONE pgs=1719 cs=0 l=1 rx=0x7f25a80032b0 tx=0x7f25a8010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.159+0000 7f25adffb700 1 --2- 172.21.15.103:0/86214953 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f259404dd10 0x7f25940501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:42.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.159+0000 7f25adffb700 1 -- 172.21.15.103:0/86214953 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f25a8061650 con 0x7f25b0144c80 2020-04-22T14:16:42.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.159+0000 7f25affff700 1 --2- 172.21.15.103:0/86214953 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f259404dd10 0x7f25940501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:42.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.160+0000 7f25affff700 1 --2- 172.21.15.103:0/86214953 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f259404dd10 0x7f25940501d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f25a0001030 tx=0x7f25a00016f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.160+0000 7f25affff700 1 --2- 172.21.15.103:0/86214953 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f259404dd10 0x7f25940501d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f25a0001030 tx=0x7f25a00016f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.160+0000 7f25affff700 1 --2- 172.21.15.103:0/86214953 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f259404dd10 0x7f25940501d0 secure :-1 s=READY pgs=625 cs=0 l=1 rx=0x7f25a0001030 tx=0x7f25a00016f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:42.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.163+0000 7f25b49aa700 1 --2- 172.21.15.103:0/86214953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25b0144c80 0x7f25b01410e0 secure :-1 s=THROTTLE_DONE pgs=1719 cs=0 l=1 rx=0x7f25a80032b0 tx=0x7f25a8010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.163+0000 7f25adffb700 1 -- 172.21.15.103:0/86214953 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f25a803caf0 con 0x7f25b0144c80 2020-04-22T14:16:42.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.359+0000 7f25b640d700 1 -- 172.21.15.103:0/86214953 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f25b0056c90 con 0x7f25b0144c80 2020-04-22T14:16:42.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.359+0000 7f25b49aa700 1 --2- 172.21.15.103:0/86214953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25b0144c80 0x7f25b01410e0 secure :-1 s=THROTTLE_DONE pgs=1719 cs=0 l=1 rx=0x7f25a80032b0 tx=0x7f25a8010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.359+0000 7f25adffb700 1 -- 172.21.15.103:0/86214953 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v44) v1 ==== 80+0+4513 (secure 0 0 0) 0x7f25a8040110 con 0x7f25b0144c80 2020-04-22T14:16:42.363 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:16:42.363 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:16:42.363 INFO:teuthology.orchestra.run.smithi103.stdout: "auth_dump": [ 2020-04-22T14:16:42.364 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:42.364 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.a", 2020-04-22T14:16:42.364 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBeliD5IBAAjC7UikdEP8FeE2rKs/ympw==", 2020-04-22T14:16:42.364 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:16:42.364 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:16:42.364 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:16:42.364 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:16:42.365 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:16:42.365 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:42.365 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:42.365 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:42.365 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.b", 2020-04-22T14:16:42.365 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBepkqQLBAA4aMKXxROQugglhm4aBd1Iw==", 2020-04-22T14:16:42.365 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:16:42.365 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:16:42.366 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:16:42.366 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:16:42.366 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:16:42.366 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:42.366 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:42.366 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:42.366 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.0", 2020-04-22T14:16:42.367 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA2TqBehMJiBxAARaWo32QGx49PxImGafnOFw==", 2020-04-22T14:16:42.367 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:16:42.367 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:16:42.367 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:16:42.367 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:16:42.367 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:42.367 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:42.367 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:42.368 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.1", 2020-04-22T14:16:42.368 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA4TqBeiAAcKRAAEHuaqbsB+NLUTSgFOCOFZg==", 2020-04-22T14:16:42.368 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:16:42.368 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:16:42.368 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:16:42.368 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:16:42.368 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:42.369 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:42.369 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:42.369 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.2", 2020-04-22T14:16:42.369 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA7TqBebeRzDxAAsjRyvJektq7MQ+334kU+UQ==", 2020-04-22T14:16:42.369 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:16:42.369 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:16:42.369 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:16:42.369 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:16:42.370 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:42.370 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:42.370 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:42.370 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.3", 2020-04-22T14:16:42.370 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA9TqBehxmSMRAATZ0o/ZnxHp2m/tqLmv6JwA==", 2020-04-22T14:16:42.370 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:16:42.370 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:16:42.371 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:16:42.371 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:16:42.371 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:42.371 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:42.371 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:42.371 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.4", 2020-04-22T14:16:42.371 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBETqBePwJSBRAAXgMKuX3EILi3gy8QzR4cig==", 2020-04-22T14:16:42.372 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:16:42.372 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:16:42.372 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:16:42.372 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:16:42.372 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:42.372 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:42.373 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:42.373 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.5", 2020-04-22T14:16:42.373 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBGTqBe5l++KRAAHIWG6bBnru2EVXv/drAL0g==", 2020-04-22T14:16:42.373 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:16:42.373 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:16:42.373 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:16:42.373 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:16:42.373 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:42.374 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:42.374 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:42.374 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.6", 2020-04-22T14:16:42.374 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBJTqBe88rTEBAAO2Z78NZLTYIbBpYovBSHVQ==", 2020-04-22T14:16:42.374 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:16:42.374 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:16:42.374 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:16:42.375 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:16:42.375 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:42.375 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:42.375 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:42.375 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.7", 2020-04-22T14:16:42.375 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBLTqBeGNFIMxAARIXhPNM6xurdnDv8+xZqUw==", 2020-04-22T14:16:42.375 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:16:42.375 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:16:42.376 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:16:42.376 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:16:42.376 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:42.376 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:42.376 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:42.376 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.0", 2020-04-22T14:16:42.376 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBe5ooUNxAA9zBtv6+i3Xl9iYtRl4xKGg==", 2020-04-22T14:16:42.377 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:16:42.377 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:16:42.377 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:16:42.377 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:16:42.377 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:42.377 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:42.377 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:42.377 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.1", 2020-04-22T14:16:42.378 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAyTqBe0bioBBAAVpoQouA/QICwqRoaFbjkiA==", 2020-04-22T14:16:42.378 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:16:42.378 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:16:42.378 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:16:42.378 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:16:42.378 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:42.378 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:42.378 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:42.379 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.2", 2020-04-22T14:16:42.379 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAyTqBemwpXCxAAObNL96zS67nMEe4MLjrEtw==", 2020-04-22T14:16:42.379 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:16:42.379 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:16:42.379 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:16:42.379 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:16:42.379 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:42.380 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:42.380 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:42.380 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.3", 2020-04-22T14:16:42.380 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAyTqBemGxNFBAAlqvB8FeZbMRwvzVjBpH/tA==", 2020-04-22T14:16:42.380 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:16:42.380 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:16:42.380 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:16:42.380 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:16:42.381 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:42.381 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:42.381 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:42.381 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.admin", 2020-04-22T14:16:42.381 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAwTqBeSx5dHxAAH0jPkaiWEwpr66ROWwbU8Q==", 2020-04-22T14:16:42.381 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:16:42.381 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2020-04-22T14:16:42.381 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:16:42.382 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:16:42.382 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:16:42.382 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:42.382 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:42.382 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:42.382 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mgr.x", 2020-04-22T14:16:42.382 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBe3YVhGhAAWAf6f9sV3bzoucBBPS3j2g==", 2020-04-22T14:16:42.383 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:16:42.383 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2020-04-22T14:16:42.383 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile mgr", 2020-04-22T14:16:42.383 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:16:42.383 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:42.383 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:42.383 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:42.383 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mgr.y", 2020-04-22T14:16:42.384 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBeX8AXExAAhh/N+/ogdKlxmkveSM60+g==", 2020-04-22T14:16:42.384 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:16:42.384 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2020-04-22T14:16:42.384 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile mgr", 2020-04-22T14:16:42.384 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:16:42.384 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:42.384 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:42.385 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:16:42.385 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:16:42.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.360+0000 7f25b640d700 1 -- 172.21.15.103:0/86214953 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f259404dd10 msgr2=0x7f25940501d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:42.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.360+0000 7f25b640d700 1 --2- 172.21.15.103:0/86214953 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f259404dd10 0x7f25940501d0 secure :-1 s=READY pgs=625 cs=0 l=1 rx=0x7f25a0001030 tx=0x7f25a00016f0).stop 2020-04-22T14:16:42.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.360+0000 7f25b640d700 1 -- 172.21.15.103:0/86214953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25b0144c80 msgr2=0x7f25b01410e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:42.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.360+0000 7f25b640d700 1 --2- 172.21.15.103:0/86214953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25b0144c80 0x7f25b01410e0 secure :-1 s=READY pgs=1719 cs=0 l=1 rx=0x7f25a80032b0 tx=0x7f25a8010cc0).stop 2020-04-22T14:16:42.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.360+0000 7f25b640d700 1 -- 172.21.15.103:0/86214953 shutdown_connections 2020-04-22T14:16:42.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.361+0000 7f25b640d700 1 --2- 172.21.15.103:0/86214953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25b0144c80 0x7f25b01410e0 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:42.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.361+0000 7f25b640d700 1 --2- 172.21.15.103:0/86214953 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f259404dd10 0x7f25940501d0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:42.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.361+0000 7f25b640d700 1 --2- 172.21.15.103:0/86214953 >> v2:172.21.15.86:3300/0 conn(0x7f25b01441f0 0x7f25b013a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:42.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.361+0000 7f25b640d700 1 -- 172.21.15.103:0/86214953 >> 172.21.15.103:0/86214953 conn(0x7f25b00b9160 msgr2=0x7f25b005ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:42.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.361+0000 7f25b640d700 1 -- 172.21.15.103:0/86214953 shutdown_connections 2020-04-22T14:16:42.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.361+0000 7f25b640d700 1 -- 172.21.15.103:0/86214953 wait complete. 2020-04-22T14:16:42.389 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:42.403 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:16:42.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.547+0000 7fd30bf67700 1 Processor -- start 2020-04-22T14:16:42.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.547+0000 7fd30bf67700 1 -- start start 2020-04-22T14:16:42.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.548+0000 7fd30bf67700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd304140320 0x7fd3040ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:42.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.548+0000 7fd30bf67700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd30414a2b0 0x7fd304146cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:42.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.548+0000 7fd30bf67700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3041462f0 con 0x7fd3040bd1b0 2020-04-22T14:16:42.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.548+0000 7fd30bf67700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd304146590 con 0x7fd304140320 2020-04-22T14:16:42.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.548+0000 7fd30bf67700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd304146830 con 0x7fd30414a2b0 2020-04-22T14:16:42.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.548+0000 7fd309502700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd30414a2b0 0x7fd304146cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:42.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.548+0000 7fd309502700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd30414a2b0 0x7fd304146cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56532/0 (socket says 172.21.15.103:56532) 2020-04-22T14:16:42.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.548+0000 7fd309502700 1 -- 172.21.15.103:0/36138623 learned_addr learned my addr 172.21.15.103:0/36138623 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:42.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.548+0000 7fd309d03700 1 --2- 172.21.15.103:0/36138623 >> v2:172.21.15.86:3300/0 conn(0x7fd304140320 0x7fd3040ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:42.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.548+0000 7fd309502700 1 -- 172.21.15.103:0/36138623 >> v2:172.21.15.86:3300/0 conn(0x7fd304140320 msgr2=0x7fd3040ae1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:42.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.548+0000 7fd309502700 1 --2- 172.21.15.103:0/36138623 >> v2:172.21.15.86:3300/0 conn(0x7fd304140320 0x7fd3040ae1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:42.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.548+0000 7fd309502700 1 -- 172.21.15.103:0/36138623 >> v1:172.21.15.86:6789/0 conn(0x7fd3040bd1b0 legacy=0x7fd3040ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:42.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.548+0000 7fd309502700 1 -- 172.21.15.103:0/36138623 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd304140700 con 0x7fd30414a2b0 2020-04-22T14:16:42.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.548+0000 7fd309d03700 1 --2- 172.21.15.103:0/36138623 >> v2:172.21.15.86:3300/0 conn(0x7fd304140320 0x7fd3040ae1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:16:42.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.548+0000 7fd309502700 1 --2- 172.21.15.103:0/36138623 >> v2:172.21.15.103:3300/0 conn(0x7fd30414a2b0 0x7fd304146cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd300002f30 tx=0x7fd300007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.549+0000 7fd309502700 1 --2- 172.21.15.103:0/36138623 >> v2:172.21.15.103:3300/0 conn(0x7fd30414a2b0 0x7fd304146cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd300002f30 tx=0x7fd300007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.549+0000 7fd309502700 1 --2- 172.21.15.103:0/36138623 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd30414a2b0 0x7fd304146cd0 secure :-1 s=READY pgs=1720 cs=0 l=1 rx=0x7fd300002f30 tx=0x7fd300007a40).ready entity=mon.1 client_cookie=1e5b9cfb27d073fe server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:42.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.549+0000 7fd309502700 1 --2- 172.21.15.103:0/36138623 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd30414a2b0 0x7fd304146cd0 secure :-1 s=THROTTLE_DONE pgs=1720 cs=0 l=1 rx=0x7fd300002f30 tx=0x7fd300007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.549+0000 7fd308d01700 1 -- 172.21.15.103:0/36138623 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd300011720 con 0x7fd30414a2b0 2020-04-22T14:16:42.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.549+0000 7fd309502700 1 --2- 172.21.15.103:0/36138623 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd30414a2b0 0x7fd304146cd0 secure :-1 s=THROTTLE_DONE pgs=1720 cs=0 l=1 rx=0x7fd300002f30 tx=0x7fd300007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.549+0000 7fd309502700 1 --2- 172.21.15.103:0/36138623 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd30414a2b0 0x7fd304146cd0 secure :-1 s=THROTTLE_DONE pgs=1720 cs=0 l=1 rx=0x7fd300002f30 tx=0x7fd300007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.549+0000 7fd308d01700 1 -- 172.21.15.103:0/36138623 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd300011880 con 0x7fd30414a2b0 2020-04-22T14:16:42.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.549+0000 7fd308d01700 1 -- 172.21.15.103:0/36138623 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd300011ca0 con 0x7fd30414a2b0 2020-04-22T14:16:42.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.549+0000 7fd30bf67700 1 -- 172.21.15.103:0/36138623 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd30414a2b0 msgr2=0x7fd304146cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:42.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.549+0000 7fd30bf67700 1 --2- 172.21.15.103:0/36138623 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd30414a2b0 0x7fd304146cd0 secure :-1 s=READY pgs=1720 cs=0 l=1 rx=0x7fd300002f30 tx=0x7fd300007a40).stop 2020-04-22T14:16:42.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.549+0000 7fd30bf67700 1 -- 172.21.15.103:0/36138623 shutdown_connections 2020-04-22T14:16:42.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.549+0000 7fd30bf67700 1 --2- 172.21.15.103:0/36138623 >> v2:172.21.15.86:3300/0 conn(0x7fd304140320 0x7fd3040ae1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:42.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.549+0000 7fd30bf67700 1 --2- 172.21.15.103:0/36138623 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd30414a2b0 0x7fd304146cd0 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:42.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.549+0000 7fd30bf67700 1 -- 172.21.15.103:0/36138623 >> 172.21.15.103:0/36138623 conn(0x7fd30405f2c0 msgr2=0x7fd3040bcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:42.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.549+0000 7fd30bf67700 1 -- 172.21.15.103:0/36138623 shutdown_connections 2020-04-22T14:16:42.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.549+0000 7fd30bf67700 1 -- 172.21.15.103:0/36138623 wait complete. 2020-04-22T14:16:42.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.550+0000 7fd30bf67700 1 Processor -- start 2020-04-22T14:16:42.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.550+0000 7fd30bf67700 1 -- start start 2020-04-22T14:16:42.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.551+0000 7fd30bf67700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd3040bd1b0 0x7fd3040b1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:42.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.551+0000 7fd30bf67700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd304140320 0x7fd304143790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:42.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.551+0000 7fd30bf67700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd30413fbf0 con 0x7fd30414a2b0 2020-04-22T14:16:42.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.551+0000 7fd30bf67700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd304157f10 con 0x7fd3040bd1b0 2020-04-22T14:16:42.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.551+0000 7fd30bf67700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd304143bf0 con 0x7fd304140320 2020-04-22T14:16:42.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.551+0000 7fd309d03700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd3040bd1b0 0x7fd3040b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:42.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.551+0000 7fd309d03700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd3040bd1b0 0x7fd3040b1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56536/0 (socket says 172.21.15.103:56536) 2020-04-22T14:16:42.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.551+0000 7fd309d03700 1 -- 172.21.15.103:0/113238219 learned_addr learned my addr 172.21.15.103:0/113238219 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:42.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.551+0000 7fd309502700 1 --2- 172.21.15.103:0/113238219 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd304140320 0x7fd304143790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:42.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.551+0000 7fd309d03700 1 -- 172.21.15.103:0/113238219 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd304140320 msgr2=0x7fd304143790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:42.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.551+0000 7fd309d03700 1 --2- 172.21.15.103:0/113238219 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd304140320 0x7fd304143790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:42.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.551+0000 7fd309d03700 1 -- 172.21.15.103:0/113238219 >> v1:172.21.15.86:6789/0 conn(0x7fd30414a2b0 legacy=0x7fd304157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:42.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.551+0000 7fd309d03700 1 -- 172.21.15.103:0/113238219 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3041581b0 con 0x7fd3040bd1b0 2020-04-22T14:16:42.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.551+0000 7fd309502700 1 --2- 172.21.15.103:0/113238219 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd304140320 0x7fd304143790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:16:42.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.551+0000 7fd309d03700 1 --2- 172.21.15.103:0/113238219 >> v2:172.21.15.103:3300/0 conn(0x7fd3040bd1b0 0x7fd3040b1090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd3041425a0 tx=0x7fd2f4010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.551+0000 7fd309d03700 1 --2- 172.21.15.103:0/113238219 >> v2:172.21.15.103:3300/0 conn(0x7fd3040bd1b0 0x7fd3040b1090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd3041425a0 tx=0x7fd2f4010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.551+0000 7fd309d03700 1 --2- 172.21.15.103:0/113238219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3040bd1b0 0x7fd3040b1090 secure :-1 s=READY pgs=1721 cs=0 l=1 rx=0x7fd3041425a0 tx=0x7fd2f4010c00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:42.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.552+0000 7fd309d03700 1 --2- 172.21.15.103:0/113238219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3040bd1b0 0x7fd3040b1090 secure :-1 s=THROTTLE_DONE pgs=1721 cs=0 l=1 rx=0x7fd3041425a0 tx=0x7fd2f4010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.552+0000 7fd309d03700 1 --2- 172.21.15.103:0/113238219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3040bd1b0 0x7fd3040b1090 secure :-1 s=THROTTLE_DONE pgs=1721 cs=0 l=1 rx=0x7fd3041425a0 tx=0x7fd2f4010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.552+0000 7fd2f2ffd700 1 -- 172.21.15.103:0/113238219 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2f4005e90 con 0x7fd3040bd1b0 2020-04-22T14:16:42.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.552+0000 7fd309d03700 1 --2- 172.21.15.103:0/113238219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3040bd1b0 0x7fd3040b1090 secure :-1 s=THROTTLE_DONE pgs=1721 cs=0 l=1 rx=0x7fd3041425a0 tx=0x7fd2f4010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.552+0000 7fd2f2ffd700 1 -- 172.21.15.103:0/113238219 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f4007180 con 0x7fd3040bd1b0 2020-04-22T14:16:42.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.552+0000 7fd30bf67700 1 -- 172.21.15.103:0/113238219 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3040b0490 con 0x7fd3040bd1b0 2020-04-22T14:16:42.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.552+0000 7fd2f2ffd700 1 -- 172.21.15.103:0/113238219 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2f4007560 con 0x7fd3040bd1b0 2020-04-22T14:16:42.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.552+0000 7fd30bf67700 1 -- 172.21.15.103:0/113238219 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3040b0960 con 0x7fd3040bd1b0 2020-04-22T14:16:42.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.552+0000 7fd309d03700 1 --2- 172.21.15.103:0/113238219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3040bd1b0 0x7fd3040b1090 secure :-1 s=THROTTLE_DONE pgs=1721 cs=0 l=1 rx=0x7fd3041425a0 tx=0x7fd2f4010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.553+0000 7fd2f2ffd700 1 -- 172.21.15.103:0/113238219 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fd2f4012290 con 0x7fd3040bd1b0 2020-04-22T14:16:42.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.553+0000 7fd309d03700 1 --2- 172.21.15.103:0/113238219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3040bd1b0 0x7fd3040b1090 secure :-1 s=THROTTLE_DONE pgs=1721 cs=0 l=1 rx=0x7fd3041425a0 tx=0x7fd2f4010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.553+0000 7fd30bf67700 1 -- 172.21.15.103:0/113238219 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd304056c90 con 0x7fd3040bd1b0 2020-04-22T14:16:42.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.553+0000 7fd2f2ffd700 1 --2- 172.21.15.103:0/113238219 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2e404d8e0 0x7fd2e404fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:42.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.553+0000 7fd2f2ffd700 1 -- 172.21.15.103:0/113238219 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fd2f4007e40 con 0x7fd3040bd1b0 2020-04-22T14:16:42.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.553+0000 7fd309502700 1 --2- 172.21.15.103:0/113238219 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2e404d8e0 0x7fd2e404fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:42.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.553+0000 7fd309502700 1 --2- 172.21.15.103:0/113238219 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2e404d8e0 0x7fd2e404fda0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd300002f30 tx=0x7fd300007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.553+0000 7fd309502700 1 --2- 172.21.15.103:0/113238219 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2e404d8e0 0x7fd2e404fda0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd300002f30 tx=0x7fd300007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.553+0000 7fd309502700 1 --2- 172.21.15.103:0/113238219 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2e404d8e0 0x7fd2e404fda0 secure :-1 s=READY pgs=626 cs=0 l=1 rx=0x7fd300002f30 tx=0x7fd300007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:42.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.557+0000 7fd309d03700 1 --2- 172.21.15.103:0/113238219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3040bd1b0 0x7fd3040b1090 secure :-1 s=THROTTLE_DONE pgs=1721 cs=0 l=1 rx=0x7fd3041425a0 tx=0x7fd2f4010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.557+0000 7fd2f2ffd700 1 -- 172.21.15.103:0/113238219 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fd2f403c870 con 0x7fd3040bd1b0 2020-04-22T14:16:42.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.705+0000 7fd30bf67700 1 -- 172.21.15.103:0/113238219 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd30413fbf0 con 0x7fd3040bd1b0 2020-04-22T14:16:42.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.706+0000 7fd309d03700 1 --2- 172.21.15.103:0/113238219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3040bd1b0 0x7fd3040b1090 secure :-1 s=THROTTLE_DONE pgs=1721 cs=0 l=1 rx=0x7fd3041425a0 tx=0x7fd2f4010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.706+0000 7fd2f2ffd700 1 -- 172.21.15.103:0/113238219 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) v1 ==== 74+0+13242 (secure 0 0 0) 0x7fd30413fbf0 con 0x7fd3040bd1b0 2020-04-22T14:16:42.709 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:16:42.709 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":120,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:16:41.926631+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:16:42.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.707+0000 7fd30bf67700 1 -- 172.21.15.103:0/113238219 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2e404d8e0 msgr2=0x7fd2e404fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:42.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.707+0000 7fd30bf67700 1 --2- 172.21.15.103:0/113238219 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2e404d8e0 0x7fd2e404fda0 secure :-1 s=READY pgs=626 cs=0 l=1 rx=0x7fd300002f30 tx=0x7fd300007a40).stop 2020-04-22T14:16:42.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.707+0000 7fd30bf67700 1 -- 172.21.15.103:0/113238219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3040bd1b0 msgr2=0x7fd3040b1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:42.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.707+0000 7fd30bf67700 1 --2- 172.21.15.103:0/113238219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3040bd1b0 0x7fd3040b1090 secure :-1 s=READY pgs=1721 cs=0 l=1 rx=0x7fd3041425a0 tx=0x7fd2f4010c00).stop 2020-04-22T14:16:42.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.707+0000 7fd30bf67700 1 -- 172.21.15.103:0/113238219 shutdown_connections 2020-04-22T14:16:42.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.707+0000 7fd30bf67700 1 --2- 172.21.15.103:0/113238219 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd2e404d8e0 0x7fd2e404fda0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:42.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.707+0000 7fd30bf67700 1 --2- 172.21.15.103:0/113238219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3040bd1b0 0x7fd3040b1090 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:42.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.707+0000 7fd30bf67700 1 --2- 172.21.15.103:0/113238219 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd304140320 0x7fd304143790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:42.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.707+0000 7fd30bf67700 1 -- 172.21.15.103:0/113238219 >> 172.21.15.103:0/113238219 conn(0x7fd30405f2c0 msgr2=0x7fd3040ac740 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:42.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.707+0000 7fd30bf67700 1 -- 172.21.15.103:0/113238219 shutdown_connections 2020-04-22T14:16:42.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.707+0000 7fd30bf67700 1 -- 172.21.15.103:0/113238219 wait complete. 2020-04-22T14:16:42.723 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:16:42.724 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:42.738 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:16:42.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.884+0000 7f7fdb770700 1 Processor -- start 2020-04-22T14:16:42.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.884+0000 7f7fdb770700 1 -- start start 2020-04-22T14:16:42.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.885+0000 7f7fdb770700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7fd40b9140 0x7f7fd40b4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:42.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.885+0000 7f7fdb770700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd40b49d0 con 0x7f7fd40af390 2020-04-22T14:16:42.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.885+0000 7f7fdb770700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd4061830 con 0x7f7fd414ddb0 2020-04-22T14:16:42.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.885+0000 7f7fdb770700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd4061ad0 con 0x7f7fd40b9140 2020-04-22T14:16:42.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.885+0000 7f7fd9d0d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f7fd414ddb0 0x7f7fd414e210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48738/0 (socket says 172.21.15.103:48738) 2020-04-22T14:16:42.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.885+0000 7f7fd9d0d700 1 -- 172.21.15.103:0/3699490527 learned_addr learned my addr 172.21.15.103:0/3699490527 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:42.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.885+0000 7f7fbffff700 1 -- 172.21.15.103:0/3699490527 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1861847156 0 0) 0x7f7fd4061830 con 0x7f7fd414ddb0 2020-04-22T14:16:42.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.885+0000 7f7fd950c700 1 --2- 172.21.15.103:0/3699490527 >> v2:172.21.15.86:3300/0 conn(0x7f7fd40b9140 0x7f7fd40b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:42.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.885+0000 7f7fbffff700 1 -- 172.21.15.103:0/3699490527 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fb8003230 con 0x7f7fd414ddb0 2020-04-22T14:16:42.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.886+0000 7f7fbffff700 1 -- 172.21.15.103:0/3699490527 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 828193125 0 0) 0x7f7fb8003230 con 0x7f7fd414ddb0 2020-04-22T14:16:42.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.886+0000 7f7fbffff700 1 -- 172.21.15.103:0/3699490527 >> v2:172.21.15.86:3300/0 conn(0x7f7fd40b9140 msgr2=0x7f7fd40b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:42.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.886+0000 7f7fbffff700 1 --2- 172.21.15.103:0/3699490527 >> v2:172.21.15.86:3300/0 conn(0x7f7fd40b9140 0x7f7fd40b4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:42.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.886+0000 7f7fbffff700 1 -- 172.21.15.103:0/3699490527 >> v1:172.21.15.86:6789/0 conn(0x7f7fd40af390 legacy=0x7f7fd4061f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:42.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.886+0000 7f7fbffff700 1 -- 172.21.15.103:0/3699490527 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd40b9520 con 0x7f7fd414ddb0 2020-04-22T14:16:42.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.886+0000 7f7fd950c700 1 --2- 172.21.15.103:0/3699490527 >> v2:172.21.15.86:3300/0 conn(0x7f7fd40b9140 0x7f7fd40b4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:16:42.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.886+0000 7f7fbffff700 1 -- 172.21.15.103:0/3699490527 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f7fc80016d0 con 0x7f7fd414ddb0 2020-04-22T14:16:42.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.886+0000 7f7fbffff700 1 -- 172.21.15.103:0/3699490527 >> v1:172.21.15.103:6789/0 conn(0x7f7fd414ddb0 legacy=0x7f7fd414e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:42.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.886+0000 7f7fbffff700 1 --2- 172.21.15.103:0/3699490527 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7fb8003720 0x7f7fb8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:42.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.886+0000 7f7fbffff700 1 --2- 172.21.15.103:0/3699490527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fb80044d0 0x7f7fb8004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:42.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.886+0000 7f7fbffff700 1 --2- 172.21.15.103:0/3699490527 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fb8004db0 0x7f7fb800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:42.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.886+0000 7f7fbffff700 1 -- 172.21.15.103:0/3699490527 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd4061ad0 con 0x7f7fb8004db0 2020-04-22T14:16:42.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.886+0000 7f7fbffff700 1 -- 172.21.15.103:0/3699490527 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb80041c0 con 0x7f7fb80044d0 2020-04-22T14:16:42.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.886+0000 7f7fbffff700 1 -- 172.21.15.103:0/3699490527 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb800bb80 con 0x7f7fb8003720 2020-04-22T14:16:42.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.886+0000 7f7fd8d0b700 1 --2- 172.21.15.103:0/3699490527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fb80044d0 0x7f7fb8004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:42.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.886+0000 7f7fd950c700 1 --2- 172.21.15.103:0/3699490527 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7fb8003720 0x7f7fb8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:42.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.886+0000 7f7fd9d0d700 1 --2- 172.21.15.103:0/3699490527 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fb8004db0 0x7f7fb800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:42.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.886+0000 7f7fd8d0b700 1 -- 172.21.15.103:0/3699490527 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7fb8003720 msgr2=0x7f7fb8003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:42.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.886+0000 7f7fd8d0b700 1 --2- 172.21.15.103:0/3699490527 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7fb8003720 0x7f7fb8003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:42.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.886+0000 7f7fd8d0b700 1 -- 172.21.15.103:0/3699490527 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fb8004db0 msgr2=0x7f7fb800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:42.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.886+0000 7f7fd8d0b700 1 --2- 172.21.15.103:0/3699490527 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fb8004db0 0x7f7fb800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:42.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.886+0000 7f7fd9d0d700 1 -- 172.21.15.103:0/3699490527 reap_dead start 2020-04-22T14:16:42.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.886+0000 7f7fd8d0b700 1 -- 172.21.15.103:0/3699490527 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb8003230 con 0x7f7fb80044d0 2020-04-22T14:16:42.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.886+0000 7f7fd8d0b700 1 --2- 172.21.15.103:0/3699490527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fb80044d0 0x7f7fb8004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7fb80054a0 tx=0x7f7fd000fd10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.886+0000 7f7fd8d0b700 1 --2- 172.21.15.103:0/3699490527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fb80044d0 0x7f7fb8004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7fb80054a0 tx=0x7f7fd000fd10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.886+0000 7f7fd8d0b700 1 --2- 172.21.15.103:0/3699490527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fb80044d0 0x7f7fb8004950 secure :-1 s=READY pgs=1723 cs=0 l=1 rx=0x7f7fb80054a0 tx=0x7f7fd000fd10).ready entity=mon.1 client_cookie=54e97e1087023ff7 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:42.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.886+0000 7f7fd8d0b700 1 --2- 172.21.15.103:0/3699490527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fb80044d0 0x7f7fb8004950 secure :-1 s=THROTTLE_DONE pgs=1723 cs=0 l=1 rx=0x7f7fb80054a0 tx=0x7f7fd000fd10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.886+0000 7f7fbffff700 1 -- 172.21.15.103:0/3699490527 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fd0003560 con 0x7f7fb80044d0 2020-04-22T14:16:42.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.886+0000 7f7fd8d0b700 1 --2- 172.21.15.103:0/3699490527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fb80044d0 0x7f7fb8004950 secure :-1 s=THROTTLE_DONE pgs=1723 cs=0 l=1 rx=0x7f7fb80054a0 tx=0x7f7fd000fd10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.886+0000 7f7fbffff700 1 -- 172.21.15.103:0/3699490527 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd00036c0 con 0x7f7fb80044d0 2020-04-22T14:16:42.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.886+0000 7f7fd8d0b700 1 --2- 172.21.15.103:0/3699490527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fb80044d0 0x7f7fb8004950 secure :-1 s=THROTTLE_DONE pgs=1723 cs=0 l=1 rx=0x7f7fb80054a0 tx=0x7f7fd000fd10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.886+0000 7f7fbffff700 1 -- 172.21.15.103:0/3699490527 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fd0003aa0 con 0x7f7fb80044d0 2020-04-22T14:16:42.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.886+0000 7f7fdb770700 1 -- 172.21.15.103:0/3699490527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fb80044d0 msgr2=0x7f7fb8004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:42.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.886+0000 7f7fdb770700 1 --2- 172.21.15.103:0/3699490527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fb80044d0 0x7f7fb8004950 secure :-1 s=READY pgs=1723 cs=0 l=1 rx=0x7f7fb80054a0 tx=0x7f7fd000fd10).stop 2020-04-22T14:16:42.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.887+0000 7f7fdb770700 1 -- 172.21.15.103:0/3699490527 shutdown_connections 2020-04-22T14:16:42.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.887+0000 7f7fdb770700 1 --2- 172.21.15.103:0/3699490527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fb80044d0 0x7f7fb8004950 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:42.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.887+0000 7f7fdb770700 1 -- 172.21.15.103:0/3699490527 >> 172.21.15.103:0/3699490527 conn(0x7f7fd405b7b0 msgr2=0x7f7fd40b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:42.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.887+0000 7f7fdb770700 1 -- 172.21.15.103:0/3699490527 shutdown_connections 2020-04-22T14:16:42.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.887+0000 7f7fdb770700 1 -- 172.21.15.103:0/3699490527 wait complete. 2020-04-22T14:16:42.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.888+0000 7f7fdb770700 1 Processor -- start 2020-04-22T14:16:42.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.888+0000 7f7fdb770700 1 -- start start 2020-04-22T14:16:42.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.889+0000 7f7fdb770700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7fb80044d0 0x7f7fd4114fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:42.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.889+0000 7f7fdb770700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7fd4149d40 0x7f7fd41571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:42.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.889+0000 7f7fdb770700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd414a1a0 con 0x7f7fd4157630 2020-04-22T14:16:42.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.889+0000 7f7fdb770700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd41458f0 con 0x7f7fd4149d40 2020-04-22T14:16:42.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.889+0000 7f7fdb770700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd40b12a0 con 0x7f7fb80044d0 2020-04-22T14:16:42.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.889+0000 7f7fd8d0b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7fd4149d40 0x7f7fd41571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:42.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.889+0000 7f7fd8d0b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7fd4149d40 0x7f7fd41571d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56558/0 (socket says 172.21.15.103:56558) 2020-04-22T14:16:42.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.889+0000 7f7fd8d0b700 1 -- 172.21.15.103:0/595343550 learned_addr learned my addr 172.21.15.103:0/595343550 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:42.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.889+0000 7f7fd950c700 1 --2- 172.21.15.103:0/595343550 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7fb80044d0 0x7f7fd4114fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:42.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.889+0000 7f7fd8d0b700 1 -- 172.21.15.103:0/595343550 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7fb80044d0 msgr2=0x7f7fd4114fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:42.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.889+0000 7f7fd8d0b700 1 --2- 172.21.15.103:0/595343550 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7fb80044d0 0x7f7fd4114fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:42.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.889+0000 7f7fd8d0b700 1 -- 172.21.15.103:0/595343550 >> v1:172.21.15.86:6789/0 conn(0x7f7fd4157630 legacy=0x7f7fd415b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:42.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.889+0000 7f7fd8d0b700 1 -- 172.21.15.103:0/595343550 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd40b08c0 con 0x7f7fd4149d40 2020-04-22T14:16:42.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.889+0000 7f7fd8d0b700 1 --2- 172.21.15.103:0/595343550 >> v2:172.21.15.103:3300/0 conn(0x7f7fd4149d40 0x7f7fd41571d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7fb80054a0 tx=0x7f7fd000fd10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.889+0000 7f7fd8d0b700 1 --2- 172.21.15.103:0/595343550 >> v2:172.21.15.103:3300/0 conn(0x7f7fd4149d40 0x7f7fd41571d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7fb80054a0 tx=0x7f7fd000fd10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.889+0000 7f7fd8d0b700 1 --2- 172.21.15.103:0/595343550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fd4149d40 0x7f7fd41571d0 secure :-1 s=READY pgs=1724 cs=0 l=1 rx=0x7f7fb80054a0 tx=0x7f7fd000fd10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:42.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.889+0000 7f7fd8d0b700 1 --2- 172.21.15.103:0/595343550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fd4149d40 0x7f7fd41571d0 secure :-1 s=THROTTLE_DONE pgs=1724 cs=0 l=1 rx=0x7f7fb80054a0 tx=0x7f7fd000fd10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.889+0000 7f7fc6ffd700 1 -- 172.21.15.103:0/595343550 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fd0008370 con 0x7f7fd4149d40 2020-04-22T14:16:42.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.889+0000 7f7fd8d0b700 1 --2- 172.21.15.103:0/595343550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fd4149d40 0x7f7fd41571d0 secure :-1 s=THROTTLE_DONE pgs=1724 cs=0 l=1 rx=0x7f7fb80054a0 tx=0x7f7fd000fd10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.889+0000 7f7fd8d0b700 1 --2- 172.21.15.103:0/595343550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fd4149d40 0x7f7fd41571d0 secure :-1 s=THROTTLE_DONE pgs=1724 cs=0 l=1 rx=0x7f7fb80054a0 tx=0x7f7fd000fd10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.889+0000 7f7fc6ffd700 1 -- 172.21.15.103:0/595343550 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd0008a40 con 0x7f7fd4149d40 2020-04-22T14:16:42.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.889+0000 7f7fc6ffd700 1 -- 172.21.15.103:0/595343550 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fd0008e20 con 0x7f7fd4149d40 2020-04-22T14:16:42.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.889+0000 7f7fdb770700 1 -- 172.21.15.103:0/595343550 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fd40b0b60 con 0x7f7fd4149d40 2020-04-22T14:16:42.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.889+0000 7f7fdb770700 1 -- 172.21.15.103:0/595343550 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fd41126a0 con 0x7f7fd4149d40 2020-04-22T14:16:42.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.890+0000 7f7fd8d0b700 1 --2- 172.21.15.103:0/595343550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fd4149d40 0x7f7fd41571d0 secure :-1 s=THROTTLE_DONE pgs=1724 cs=0 l=1 rx=0x7f7fb80054a0 tx=0x7f7fd000fd10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.890+0000 7f7fdb770700 1 -- 172.21.15.103:0/595343550 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fd4113c00 con 0x7f7fd4149d40 2020-04-22T14:16:42.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.890+0000 7f7fc6ffd700 1 -- 172.21.15.103:0/595343550 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f7fd0012070 con 0x7f7fd4149d40 2020-04-22T14:16:42.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.890+0000 7f7fd8d0b700 1 --2- 172.21.15.103:0/595343550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fd4149d40 0x7f7fd41571d0 secure :-1 s=THROTTLE_DONE pgs=1724 cs=0 l=1 rx=0x7f7fb80054a0 tx=0x7f7fd000fd10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.890+0000 7f7fc6ffd700 1 --2- 172.21.15.103:0/595343550 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7fb004da90 0x7f7fb004ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:42.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.891+0000 7f7fc6ffd700 1 -- 172.21.15.103:0/595343550 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f7fd0061d40 con 0x7f7fd4149d40 2020-04-22T14:16:42.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.891+0000 7f7fd950c700 1 --2- 172.21.15.103:0/595343550 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7fb004da90 0x7f7fb004ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:42.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.891+0000 7f7fd950c700 1 --2- 172.21.15.103:0/595343550 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7fb004da90 0x7f7fb004ff50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7fcc0032b0 tx=0x7f7fcc00bc80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.891+0000 7f7fd950c700 1 --2- 172.21.15.103:0/595343550 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7fb004da90 0x7f7fb004ff50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7fcc0032b0 tx=0x7f7fcc00bc80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.891+0000 7f7fd950c700 1 --2- 172.21.15.103:0/595343550 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7fb004da90 0x7f7fb004ff50 secure :-1 s=READY pgs=627 cs=0 l=1 rx=0x7f7fcc0032b0 tx=0x7f7fcc00bc80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:42.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.894+0000 7f7fd8d0b700 1 --2- 172.21.15.103:0/595343550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fd4149d40 0x7f7fd41571d0 secure :-1 s=THROTTLE_DONE pgs=1724 cs=0 l=1 rx=0x7f7fb80054a0 tx=0x7f7fd000fd10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:42.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:42.894+0000 7f7fc6ffd700 1 -- 172.21.15.103:0/595343550 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f7fd003d120 con 0x7f7fd4149d40 2020-04-22T14:16:43.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.036+0000 7f7fdb770700 1 -- 172.21.15.103:0/595343550 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f7fd40b0700 con 0x7f7fd4149d40 2020-04-22T14:16:43.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.036+0000 7f7fd8d0b700 1 --2- 172.21.15.103:0/595343550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fd4149d40 0x7f7fd41571d0 secure :-1 s=THROTTLE_DONE pgs=1724 cs=0 l=1 rx=0x7f7fb80054a0 tx=0x7f7fd000fd10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.036+0000 7f7fc6ffd700 1 -- 172.21.15.103:0/595343550 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v120) v1 ==== 110+0+10 (secure 0 0 0) 0x7f7fd0040740 con 0x7f7fd4149d40 2020-04-22T14:16:43.040 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:16:43.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.037+0000 7f7fdb770700 1 -- 172.21.15.103:0/595343550 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7fb004da90 msgr2=0x7f7fb004ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:43.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.037+0000 7f7fdb770700 1 --2- 172.21.15.103:0/595343550 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7fb004da90 0x7f7fb004ff50 secure :-1 s=READY pgs=627 cs=0 l=1 rx=0x7f7fcc0032b0 tx=0x7f7fcc00bc80).stop 2020-04-22T14:16:43.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.037+0000 7f7fdb770700 1 -- 172.21.15.103:0/595343550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fd4149d40 msgr2=0x7f7fd41571d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:43.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.037+0000 7f7fdb770700 1 --2- 172.21.15.103:0/595343550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fd4149d40 0x7f7fd41571d0 secure :-1 s=READY pgs=1724 cs=0 l=1 rx=0x7f7fb80054a0 tx=0x7f7fd000fd10).stop 2020-04-22T14:16:43.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.037+0000 7f7fdb770700 1 -- 172.21.15.103:0/595343550 shutdown_connections 2020-04-22T14:16:43.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.037+0000 7f7fdb770700 1 --2- 172.21.15.103:0/595343550 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7fb004da90 0x7f7fb004ff50 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:43.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.037+0000 7f7fdb770700 1 --2- 172.21.15.103:0/595343550 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7fb80044d0 0x7f7fd4114fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:43.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.037+0000 7f7fdb770700 1 --2- 172.21.15.103:0/595343550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fd4149d40 0x7f7fd41571d0 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:43.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.037+0000 7f7fdb770700 1 -- 172.21.15.103:0/595343550 >> 172.21.15.103:0/595343550 conn(0x7f7fd405b7b0 msgr2=0x7f7fd4148140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:43.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.038+0000 7f7fdb770700 1 -- 172.21.15.103:0/595343550 shutdown_connections 2020-04-22T14:16:43.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.038+0000 7f7fdb770700 1 -- 172.21.15.103:0/595343550 wait complete. 2020-04-22T14:16:43.051 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:43.064 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:16:43.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.210+0000 7f7d20ddf700 1 Processor -- start 2020-04-22T14:16:43.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.210+0000 7f7d20ddf700 1 -- start start 2020-04-22T14:16:43.219 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.211+0000 7f7d20ddf700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7d1c0b9140 0x7f7d1c12b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:43.219 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.211+0000 7f7d20ddf700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7d1c12b670 0x7f7d1c143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:43.219 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.211+0000 7f7d20ddf700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d1c1467e0 con 0x7f7d1c0ac950 2020-04-22T14:16:43.219 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.211+0000 7f7d20ddf700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d1c0602f0 con 0x7f7d1c12b670 2020-04-22T14:16:43.220 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.211+0000 7f7d20ddf700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d1c060050 con 0x7f7d1c0b9140 2020-04-22T14:16:43.220 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.211+0000 7f7d1a59c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7d1c0b9140 0x7f7d1c12b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:43.220 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.211+0000 7f7d19d9b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f7d1c0ac950 0x7f7d1c146c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48756/0 (socket says 172.21.15.103:48756) 2020-04-22T14:16:43.220 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.211+0000 7f7d1a59c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7d1c0b9140 0x7f7d1c12b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56564/0 (socket says 172.21.15.103:56564) 2020-04-22T14:16:43.220 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.211+0000 7f7d19d9b700 1 -- 172.21.15.103:0/831952330 learned_addr learned my addr 172.21.15.103:0/831952330 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:43.220 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.211+0000 7f7d1ad9d700 1 --2- 172.21.15.103:0/831952330 >> v2:172.21.15.86:3300/0 conn(0x7f7d1c12b670 0x7f7d1c143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:43.220 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.211+0000 7f7d1a59c700 1 -- 172.21.15.103:0/831952330 >> v2:172.21.15.86:3300/0 conn(0x7f7d1c12b670 msgr2=0x7f7d1c143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:43.221 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.211+0000 7f7d1a59c700 1 --2- 172.21.15.103:0/831952330 >> v2:172.21.15.86:3300/0 conn(0x7f7d1c12b670 0x7f7d1c143090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:43.221 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.211+0000 7f7d1a59c700 1 -- 172.21.15.103:0/831952330 >> v1:172.21.15.103:6789/0 conn(0x7f7d1c0ac950 legacy=0x7f7d1c146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:43.222 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.211+0000 7f7d1959a700 1 -- 172.21.15.103:0/831952330 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3705448776 0 0) 0x7f7d1c1467e0 con 0x7f7d1c0ac950 2020-04-22T14:16:43.222 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.211+0000 7f7d1a59c700 1 -- 172.21.15.103:0/831952330 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d1c0b9520 con 0x7f7d1c0b9140 2020-04-22T14:16:43.222 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.211+0000 7f7d1ad9d700 1 --2- 172.21.15.103:0/831952330 >> v2:172.21.15.86:3300/0 conn(0x7f7d1c12b670 0x7f7d1c143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:16:43.222 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.211+0000 7f7d1a59c700 1 --2- 172.21.15.103:0/831952330 >> v2:172.21.15.103:3300/0 conn(0x7f7d1c0b9140 0x7f7d1c12b210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7d10002f30 tx=0x7f7d10007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.222 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.211+0000 7f7d1a59c700 1 --2- 172.21.15.103:0/831952330 >> v2:172.21.15.103:3300/0 conn(0x7f7d1c0b9140 0x7f7d1c12b210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7d10002f30 tx=0x7f7d10007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.211+0000 7f7d1a59c700 1 --2- 172.21.15.103:0/831952330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d1c0b9140 0x7f7d1c12b210 secure :-1 s=READY pgs=1726 cs=0 l=1 rx=0x7f7d10002f30 tx=0x7f7d10007a40).ready entity=mon.1 client_cookie=b803aaf3918cced4 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:43.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.211+0000 7f7d1a59c700 1 --2- 172.21.15.103:0/831952330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d1c0b9140 0x7f7d1c12b210 secure :-1 s=THROTTLE_DONE pgs=1726 cs=0 l=1 rx=0x7f7d10002f30 tx=0x7f7d10007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.212+0000 7f7d1959a700 1 -- 172.21.15.103:0/831952330 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d10011470 con 0x7f7d1c0b9140 2020-04-22T14:16:43.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.212+0000 7f7d1a59c700 1 --2- 172.21.15.103:0/831952330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d1c0b9140 0x7f7d1c12b210 secure :-1 s=THROTTLE_DONE pgs=1726 cs=0 l=1 rx=0x7f7d10002f30 tx=0x7f7d10007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.212+0000 7f7d1a59c700 1 --2- 172.21.15.103:0/831952330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d1c0b9140 0x7f7d1c12b210 secure :-1 s=THROTTLE_DONE pgs=1726 cs=0 l=1 rx=0x7f7d10002f30 tx=0x7f7d10007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.212+0000 7f7d1959a700 1 -- 172.21.15.103:0/831952330 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d100115d0 con 0x7f7d1c0b9140 2020-04-22T14:16:43.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.212+0000 7f7d1959a700 1 -- 172.21.15.103:0/831952330 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d100119b0 con 0x7f7d1c0b9140 2020-04-22T14:16:43.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.212+0000 7f7d20ddf700 1 -- 172.21.15.103:0/831952330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d1c0b9140 msgr2=0x7f7d1c12b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:43.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.212+0000 7f7d20ddf700 1 --2- 172.21.15.103:0/831952330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d1c0b9140 0x7f7d1c12b210 secure :-1 s=READY pgs=1726 cs=0 l=1 rx=0x7f7d10002f30 tx=0x7f7d10007a40).stop 2020-04-22T14:16:43.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.212+0000 7f7d20ddf700 1 -- 172.21.15.103:0/831952330 shutdown_connections 2020-04-22T14:16:43.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.212+0000 7f7d20ddf700 1 --2- 172.21.15.103:0/831952330 >> v2:172.21.15.86:3300/0 conn(0x7f7d1c12b670 0x7f7d1c143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:43.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.212+0000 7f7d20ddf700 1 --2- 172.21.15.103:0/831952330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d1c0b9140 0x7f7d1c12b210 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:43.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.212+0000 7f7d20ddf700 1 -- 172.21.15.103:0/831952330 >> 172.21.15.103:0/831952330 conn(0x7f7d1c05b7b0 msgr2=0x7f7d1c0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:43.225 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.212+0000 7f7d20ddf700 1 -- 172.21.15.103:0/831952330 shutdown_connections 2020-04-22T14:16:43.225 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.212+0000 7f7d20ddf700 1 -- 172.21.15.103:0/831952330 wait complete. 2020-04-22T14:16:43.225 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.213+0000 7f7d20ddf700 1 Processor -- start 2020-04-22T14:16:43.225 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.213+0000 7f7d20ddf700 1 -- start start 2020-04-22T14:16:43.225 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.214+0000 7f7d20ddf700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7d1c0b9140 0x7f7d1c0b2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:43.225 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.214+0000 7f7d20ddf700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d1c147e10 con 0x7f7d1c12b670 2020-04-22T14:16:43.226 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.214+0000 7f7d20ddf700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d1c064ae0 con 0x7f7d1c0ac950 2020-04-22T14:16:43.226 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.214+0000 7f7d20ddf700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d1c063680 con 0x7f7d1c0b9140 2020-04-22T14:16:43.226 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.214+0000 7f7d19d9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7d1c0b9140 0x7f7d1c0b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:43.226 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.214+0000 7f7d19d9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7d1c0b9140 0x7f7d1c0b2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56572/0 (socket says 172.21.15.103:56572) 2020-04-22T14:16:43.226 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.214+0000 7f7d1a59c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f7d1c0ac950 0x7f7d1c147700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48760/0 (socket says 172.21.15.103:48760) 2020-04-22T14:16:43.226 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.214+0000 7f7d19d9b700 1 -- 172.21.15.103:0/1299127290 learned_addr learned my addr 172.21.15.103:0/1299127290 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:43.226 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.214+0000 7f7d19d9b700 1 -- 172.21.15.103:0/1299127290 >> v1:172.21.15.103:6789/0 conn(0x7f7d1c0ac950 legacy=0x7f7d1c147700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:43.227 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.214+0000 7f7d19d9b700 1 -- 172.21.15.103:0/1299127290 >> v1:172.21.15.86:6789/0 conn(0x7f7d1c12b670 legacy=0x7f7d1c065fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:43.227 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.214+0000 7f7d0b7fe700 1 -- 172.21.15.103:0/1299127290 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3192136766 0 0) 0x7f7d1c064ae0 con 0x7f7d1c0ac950 2020-04-22T14:16:43.227 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.214+0000 7f7d19d9b700 1 -- 172.21.15.103:0/1299127290 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d1c063920 con 0x7f7d1c0b9140 2020-04-22T14:16:43.227 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.214+0000 7f7d19d9b700 1 --2- 172.21.15.103:0/1299127290 >> v2:172.21.15.103:3300/0 conn(0x7f7d1c0b9140 0x7f7d1c0b2630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7d1c065ee0 tx=0x7f7d0c001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.227 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.214+0000 7f7d19d9b700 1 --2- 172.21.15.103:0/1299127290 >> v2:172.21.15.103:3300/0 conn(0x7f7d1c0b9140 0x7f7d1c0b2630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7d1c065ee0 tx=0x7f7d0c001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.227 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.214+0000 7f7d19d9b700 1 --2- 172.21.15.103:0/1299127290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d1c0b9140 0x7f7d1c0b2630 secure :-1 s=READY pgs=1728 cs=0 l=1 rx=0x7f7d1c065ee0 tx=0x7f7d0c001e40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:43.228 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.214+0000 7f7d19d9b700 1 --2- 172.21.15.103:0/1299127290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d1c0b9140 0x7f7d1c0b2630 secure :-1 s=THROTTLE_DONE pgs=1728 cs=0 l=1 rx=0x7f7d1c065ee0 tx=0x7f7d0c001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.228 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.214+0000 7f7d0b7fe700 1 -- 172.21.15.103:0/1299127290 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d0c00ca40 con 0x7f7d1c0b9140 2020-04-22T14:16:43.228 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.214+0000 7f7d19d9b700 1 --2- 172.21.15.103:0/1299127290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d1c0b9140 0x7f7d1c0b2630 secure :-1 s=THROTTLE_DONE pgs=1728 cs=0 l=1 rx=0x7f7d1c065ee0 tx=0x7f7d0c001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.214+0000 7f7d19d9b700 1 --2- 172.21.15.103:0/1299127290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d1c0b9140 0x7f7d1c0b2630 secure :-1 s=THROTTLE_DONE pgs=1728 cs=0 l=1 rx=0x7f7d1c065ee0 tx=0x7f7d0c001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.214+0000 7f7d0b7fe700 1 -- 172.21.15.103:0/1299127290 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0c00cba0 con 0x7f7d1c0b9140 2020-04-22T14:16:43.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.214+0000 7f7d20ddf700 1 -- 172.21.15.103:0/1299127290 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d1c064380 con 0x7f7d1c0b9140 2020-04-22T14:16:43.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.215+0000 7f7d0b7fe700 1 -- 172.21.15.103:0/1299127290 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d0c00d0d0 con 0x7f7d1c0b9140 2020-04-22T14:16:43.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.215+0000 7f7d20ddf700 1 -- 172.21.15.103:0/1299127290 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d1c064640 con 0x7f7d1c0b9140 2020-04-22T14:16:43.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.215+0000 7f7d19d9b700 1 --2- 172.21.15.103:0/1299127290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d1c0b9140 0x7f7d1c0b2630 secure :-1 s=THROTTLE_DONE pgs=1728 cs=0 l=1 rx=0x7f7d1c065ee0 tx=0x7f7d0c001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.216+0000 7f7d0b7fe700 1 -- 172.21.15.103:0/1299127290 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f7d0c0055c0 con 0x7f7d1c0b9140 2020-04-22T14:16:43.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.216+0000 7f7d19d9b700 1 --2- 172.21.15.103:0/1299127290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d1c0b9140 0x7f7d1c0b2630 secure :-1 s=THROTTLE_DONE pgs=1728 cs=0 l=1 rx=0x7f7d1c065ee0 tx=0x7f7d0c001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.216+0000 7f7d20ddf700 1 -- 172.21.15.103:0/1299127290 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d1c064950 con 0x7f7d1c0b9140 2020-04-22T14:16:43.231 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.216+0000 7f7d0b7fe700 1 --2- 172.21.15.103:0/1299127290 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7cf804d760 0x7f7cf804fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:43.231 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.216+0000 7f7d0b7fe700 1 -- 172.21.15.103:0/1299127290 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f7d0c0100c0 con 0x7f7d1c0b9140 2020-04-22T14:16:43.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.216+0000 7f7d1a59c700 1 --2- 172.21.15.103:0/1299127290 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7cf804d760 0x7f7cf804fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:43.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.216+0000 7f7d1a59c700 1 --2- 172.21.15.103:0/1299127290 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7cf804d760 0x7f7cf804fc20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7d100084c0 tx=0x7f7d10007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.217+0000 7f7d1a59c700 1 --2- 172.21.15.103:0/1299127290 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7cf804d760 0x7f7cf804fc20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7d100084c0 tx=0x7f7d10007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.217+0000 7f7d1a59c700 1 --2- 172.21.15.103:0/1299127290 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7cf804d760 0x7f7cf804fc20 secure :-1 s=READY pgs=628 cs=0 l=1 rx=0x7f7d100084c0 tx=0x7f7d10007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:43.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.220+0000 7f7d19d9b700 1 --2- 172.21.15.103:0/1299127290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d1c0b9140 0x7f7d1c0b2630 secure :-1 s=THROTTLE_DONE pgs=1728 cs=0 l=1 rx=0x7f7d1c065ee0 tx=0x7f7d0c001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.220+0000 7f7d0b7fe700 1 -- 172.21.15.103:0/1299127290 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f7d0c03c490 con 0x7f7d1c0b9140 2020-04-22T14:16:43.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.361+0000 7f7d20ddf700 1 -- 172.21.15.103:0/1299127290 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7d1c146660 con 0x7f7d1c0b9140 2020-04-22T14:16:43.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.361+0000 7f7d19d9b700 1 --2- 172.21.15.103:0/1299127290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d1c0b9140 0x7f7d1c0b2630 secure :-1 s=THROTTLE_DONE pgs=1728 cs=0 l=1 rx=0x7f7d1c065ee0 tx=0x7f7d0c001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.361+0000 7f7d0b7fe700 1 -- 172.21.15.103:0/1299127290 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v120) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7d0c03fab0 con 0x7f7d1c0b9140 2020-04-22T14:16:43.365 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:16:43.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.363+0000 7f7d20ddf700 1 -- 172.21.15.103:0/1299127290 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7cf804d760 msgr2=0x7f7cf804fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:43.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.363+0000 7f7d20ddf700 1 --2- 172.21.15.103:0/1299127290 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7cf804d760 0x7f7cf804fc20 secure :-1 s=READY pgs=628 cs=0 l=1 rx=0x7f7d100084c0 tx=0x7f7d10007a40).stop 2020-04-22T14:16:43.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.363+0000 7f7d20ddf700 1 -- 172.21.15.103:0/1299127290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d1c0b9140 msgr2=0x7f7d1c0b2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:43.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.363+0000 7f7d20ddf700 1 --2- 172.21.15.103:0/1299127290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d1c0b9140 0x7f7d1c0b2630 secure :-1 s=READY pgs=1728 cs=0 l=1 rx=0x7f7d1c065ee0 tx=0x7f7d0c001e40).stop 2020-04-22T14:16:43.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.363+0000 7f7d20ddf700 1 -- 172.21.15.103:0/1299127290 shutdown_connections 2020-04-22T14:16:43.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.363+0000 7f7d20ddf700 1 --2- 172.21.15.103:0/1299127290 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7cf804d760 0x7f7cf804fc20 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:43.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.363+0000 7f7d20ddf700 1 --2- 172.21.15.103:0/1299127290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d1c0b9140 0x7f7d1c0b2630 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:43.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.363+0000 7f7d20ddf700 1 -- 172.21.15.103:0/1299127290 >> 172.21.15.103:0/1299127290 conn(0x7f7d1c05b7b0 msgr2=0x7f7d1c14dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:43.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.363+0000 7f7d20ddf700 1 -- 172.21.15.103:0/1299127290 shutdown_connections 2020-04-22T14:16:43.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.363+0000 7f7d20ddf700 1 -- 172.21.15.103:0/1299127290 wait complete. 2020-04-22T14:16:43.376 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:43.391 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-04-22T14:16:43.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.535+0000 7ffb42363700 1 Processor -- start 2020-04-22T14:16:43.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.535+0000 7ffb42363700 1 -- start start 2020-04-22T14:16:43.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.536+0000 7ffb42363700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ffb3c12c0d0 0x7ffb3c1464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:43.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.536+0000 7ffb42363700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffb3c065fe0 0x7ffb3c05b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:43.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.536+0000 7ffb42363700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb3c143300 con 0x7ffb3c05b8a0 2020-04-22T14:16:43.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.536+0000 7ffb42363700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb3c12c4b0 con 0x7ffb3c12c0d0 2020-04-22T14:16:43.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.536+0000 7ffb42363700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb3c1435a0 con 0x7ffb3c065fe0 2020-04-22T14:16:43.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.536+0000 7ffb3b7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffb3c065fe0 0x7ffb3c05b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:43.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.536+0000 7ffb3b7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffb3c065fe0 0x7ffb3c05b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56578/0 (socket says 172.21.15.103:56578) 2020-04-22T14:16:43.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.536+0000 7ffb3b7fe700 1 -- 172.21.15.103:0/2202241185 learned_addr learned my addr 172.21.15.103:0/2202241185 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:43.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.536+0000 7ffb3bfff700 1 --2- 172.21.15.103:0/2202241185 >> v2:172.21.15.86:3300/0 conn(0x7ffb3c12c0d0 0x7ffb3c1464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:43.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.536+0000 7ffb3b7fe700 1 -- 172.21.15.103:0/2202241185 >> v2:172.21.15.86:3300/0 conn(0x7ffb3c12c0d0 msgr2=0x7ffb3c1464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:43.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.536+0000 7ffb3b7fe700 1 --2- 172.21.15.103:0/2202241185 >> v2:172.21.15.86:3300/0 conn(0x7ffb3c12c0d0 0x7ffb3c1464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:43.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.536+0000 7ffb3b7fe700 1 -- 172.21.15.103:0/2202241185 >> v1:172.21.15.86:6789/0 conn(0x7ffb3c05b8a0 legacy=0x7ffb3c062ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:43.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.536+0000 7ffb3b7fe700 1 -- 172.21.15.103:0/2202241185 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb3c143840 con 0x7ffb3c065fe0 2020-04-22T14:16:43.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.536+0000 7ffb3bfff700 1 --2- 172.21.15.103:0/2202241185 >> v2:172.21.15.86:3300/0 conn(0x7ffb3c12c0d0 0x7ffb3c1464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:16:43.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.536+0000 7ffb3b7fe700 1 --2- 172.21.15.103:0/2202241185 >> v2:172.21.15.103:3300/0 conn(0x7ffb3c065fe0 0x7ffb3c05b440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ffb30002f30 tx=0x7ffb30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.537+0000 7ffb3b7fe700 1 --2- 172.21.15.103:0/2202241185 >> v2:172.21.15.103:3300/0 conn(0x7ffb3c065fe0 0x7ffb3c05b440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ffb30002f30 tx=0x7ffb30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.537+0000 7ffb3b7fe700 1 --2- 172.21.15.103:0/2202241185 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb3c065fe0 0x7ffb3c05b440 secure :-1 s=READY pgs=1729 cs=0 l=1 rx=0x7ffb30002f30 tx=0x7ffb30007a40).ready entity=mon.1 client_cookie=cbe326332c38855e server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:43.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.537+0000 7ffb3b7fe700 1 --2- 172.21.15.103:0/2202241185 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb3c065fe0 0x7ffb3c05b440 secure :-1 s=THROTTLE_DONE pgs=1729 cs=0 l=1 rx=0x7ffb30002f30 tx=0x7ffb30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.537+0000 7ffb3affd700 1 -- 172.21.15.103:0/2202241185 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb30011720 con 0x7ffb3c065fe0 2020-04-22T14:16:43.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.537+0000 7ffb3b7fe700 1 --2- 172.21.15.103:0/2202241185 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb3c065fe0 0x7ffb3c05b440 secure :-1 s=THROTTLE_DONE pgs=1729 cs=0 l=1 rx=0x7ffb30002f30 tx=0x7ffb30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.537+0000 7ffb3b7fe700 1 --2- 172.21.15.103:0/2202241185 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb3c065fe0 0x7ffb3c05b440 secure :-1 s=THROTTLE_DONE pgs=1729 cs=0 l=1 rx=0x7ffb30002f30 tx=0x7ffb30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.537+0000 7ffb3affd700 1 -- 172.21.15.103:0/2202241185 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb30011880 con 0x7ffb3c065fe0 2020-04-22T14:16:43.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.537+0000 7ffb3affd700 1 -- 172.21.15.103:0/2202241185 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb30011ca0 con 0x7ffb3c065fe0 2020-04-22T14:16:43.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.537+0000 7ffb42363700 1 -- 172.21.15.103:0/2202241185 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb3c065fe0 msgr2=0x7ffb3c05b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:43.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.537+0000 7ffb42363700 1 --2- 172.21.15.103:0/2202241185 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb3c065fe0 0x7ffb3c05b440 secure :-1 s=READY pgs=1729 cs=0 l=1 rx=0x7ffb30002f30 tx=0x7ffb30007a40).stop 2020-04-22T14:16:43.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.537+0000 7ffb42363700 1 -- 172.21.15.103:0/2202241185 shutdown_connections 2020-04-22T14:16:43.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.537+0000 7ffb42363700 1 --2- 172.21.15.103:0/2202241185 >> v2:172.21.15.86:3300/0 conn(0x7ffb3c12c0d0 0x7ffb3c1464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:43.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.537+0000 7ffb42363700 1 --2- 172.21.15.103:0/2202241185 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb3c065fe0 0x7ffb3c05b440 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:43.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.537+0000 7ffb42363700 1 -- 172.21.15.103:0/2202241185 >> 172.21.15.103:0/2202241185 conn(0x7ffb3c0b9160 msgr2=0x7ffb3c05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:43.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.537+0000 7ffb42363700 1 -- 172.21.15.103:0/2202241185 shutdown_connections 2020-04-22T14:16:43.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.537+0000 7ffb42363700 1 -- 172.21.15.103:0/2202241185 wait complete. 2020-04-22T14:16:43.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.538+0000 7ffb42363700 1 Processor -- start 2020-04-22T14:16:43.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.538+0000 7ffb42363700 1 -- start start 2020-04-22T14:16:43.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.539+0000 7ffb42363700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb3c05b8a0 0x7ffb3c0b4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:43.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.539+0000 7ffb42363700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffb3c065fe0 0x7ffb3c0b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:43.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.539+0000 7ffb42363700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb3c0b5920 con 0x7ffb3c12c0d0 2020-04-22T14:16:43.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.539+0000 7ffb42363700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb3c0acfe0 con 0x7ffb3c065fe0 2020-04-22T14:16:43.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.539+0000 7ffb42363700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3c155e30 con 0x7ffb3c05b8a0 2020-04-22T14:16:43.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.539+0000 7ffb3b7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffb3c065fe0 0x7ffb3c0b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:43.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.539+0000 7ffb3b7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffb3c065fe0 0x7ffb3c0b54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56586/0 (socket says 172.21.15.103:56586) 2020-04-22T14:16:43.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.539+0000 7ffb3b7fe700 1 -- 172.21.15.103:0/1113215185 learned_addr learned my addr 172.21.15.103:0/1113215185 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:43.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.539+0000 7ffb40900700 1 --1- 172.21.15.103:0/1113215185 >> v1:172.21.15.103:6789/0 conn(0x7ffb3c12c0d0 0x7ffb3c0ac8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48778/0 (socket says 172.21.15.103:48778) 2020-04-22T14:16:43.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.539+0000 7ffb3bfff700 1 --2- 172.21.15.103:0/1113215185 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb3c05b8a0 0x7ffb3c0b4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:43.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.539+0000 7ffb3b7fe700 1 -- 172.21.15.103:0/1113215185 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb3c05b8a0 msgr2=0x7ffb3c0b4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:43.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.539+0000 7ffb3b7fe700 1 --2- 172.21.15.103:0/1113215185 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb3c05b8a0 0x7ffb3c0b4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:43.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.539+0000 7ffb3b7fe700 1 -- 172.21.15.103:0/1113215185 >> v1:172.21.15.103:6789/0 conn(0x7ffb3c12c0d0 legacy=0x7ffb3c0ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:43.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.539+0000 7ffb397fa700 1 -- 172.21.15.103:0/1113215185 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3717650246 0 0) 0x7ffb3c143300 con 0x7ffb3c12c0d0 2020-04-22T14:16:43.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.539+0000 7ffb3b7fe700 1 -- 172.21.15.103:0/1113215185 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb3c0b04a0 con 0x7ffb3c065fe0 2020-04-22T14:16:43.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.539+0000 7ffb3b7fe700 1 --2- 172.21.15.103:0/1113215185 >> v2:172.21.15.103:3300/0 conn(0x7ffb3c065fe0 0x7ffb3c0b54c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffb30002f30 tx=0x7ffb30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.540+0000 7ffb3b7fe700 1 --2- 172.21.15.103:0/1113215185 >> v2:172.21.15.103:3300/0 conn(0x7ffb3c065fe0 0x7ffb3c0b54c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffb30002f30 tx=0x7ffb30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.540+0000 7ffb3b7fe700 1 --2- 172.21.15.103:0/1113215185 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb3c065fe0 0x7ffb3c0b54c0 secure :-1 s=READY pgs=1731 cs=0 l=1 rx=0x7ffb30002f30 tx=0x7ffb30007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:43.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.540+0000 7ffb3b7fe700 1 --2- 172.21.15.103:0/1113215185 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb3c065fe0 0x7ffb3c0b54c0 secure :-1 s=THROTTLE_DONE pgs=1731 cs=0 l=1 rx=0x7ffb30002f30 tx=0x7ffb30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.540+0000 7ffb397fa700 1 -- 172.21.15.103:0/1113215185 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb30007360 con 0x7ffb3c065fe0 2020-04-22T14:16:43.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.540+0000 7ffb3b7fe700 1 --2- 172.21.15.103:0/1113215185 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb3c065fe0 0x7ffb3c0b54c0 secure :-1 s=THROTTLE_DONE pgs=1731 cs=0 l=1 rx=0x7ffb30002f30 tx=0x7ffb30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.540+0000 7ffb3b7fe700 1 --2- 172.21.15.103:0/1113215185 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb3c065fe0 0x7ffb3c0b54c0 secure :-1 s=THROTTLE_DONE pgs=1731 cs=0 l=1 rx=0x7ffb30002f30 tx=0x7ffb30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.540+0000 7ffb397fa700 1 -- 172.21.15.103:0/1113215185 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb300074c0 con 0x7ffb3c065fe0 2020-04-22T14:16:43.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.540+0000 7ffb42363700 1 -- 172.21.15.103:0/1113215185 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb3c0b0740 con 0x7ffb3c065fe0 2020-04-22T14:16:43.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.540+0000 7ffb397fa700 1 -- 172.21.15.103:0/1113215185 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb300058b0 con 0x7ffb3c065fe0 2020-04-22T14:16:43.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.540+0000 7ffb42363700 1 -- 172.21.15.103:0/1113215185 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb3c0aef60 con 0x7ffb3c065fe0 2020-04-22T14:16:43.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.540+0000 7ffb3b7fe700 1 --2- 172.21.15.103:0/1113215185 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb3c065fe0 0x7ffb3c0b54c0 secure :-1 s=THROTTLE_DONE pgs=1731 cs=0 l=1 rx=0x7ffb30002f30 tx=0x7ffb30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.541+0000 7ffb42363700 1 -- 172.21.15.103:0/1113215185 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb3c056c90 con 0x7ffb3c065fe0 2020-04-22T14:16:43.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.541+0000 7ffb397fa700 1 -- 172.21.15.103:0/1113215185 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ffb30005b20 con 0x7ffb3c065fe0 2020-04-22T14:16:43.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.541+0000 7ffb3b7fe700 1 --2- 172.21.15.103:0/1113215185 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb3c065fe0 0x7ffb3c0b54c0 secure :-1 s=THROTTLE_DONE pgs=1731 cs=0 l=1 rx=0x7ffb30002f30 tx=0x7ffb30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.541+0000 7ffb397fa700 1 --2- 172.21.15.103:0/1113215185 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffb1c04d830 0x7ffb1c04fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:43.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.541+0000 7ffb397fa700 1 -- 172.21.15.103:0/1113215185 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5253+0+0 (secure 0 0 0) 0x7ffb30061d00 con 0x7ffb3c065fe0 2020-04-22T14:16:43.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.541+0000 7ffb3bfff700 1 --2- 172.21.15.103:0/1113215185 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffb1c04d830 0x7ffb1c04fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:43.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.541+0000 7ffb3bfff700 1 --2- 172.21.15.103:0/1113215185 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffb1c04d830 0x7ffb1c04fcf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffb2c002f30 tx=0x7ffb2c008d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.542+0000 7ffb3bfff700 1 --2- 172.21.15.103:0/1113215185 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffb1c04d830 0x7ffb1c04fcf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffb2c002f30 tx=0x7ffb2c008d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.542+0000 7ffb3bfff700 1 --2- 172.21.15.103:0/1113215185 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffb1c04d830 0x7ffb1c04fcf0 secure :-1 s=READY pgs=629 cs=0 l=1 rx=0x7ffb2c002f30 tx=0x7ffb2c008d70).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:43.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.545+0000 7ffb3b7fe700 1 --2- 172.21.15.103:0/1113215185 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb3c065fe0 0x7ffb3c0b54c0 secure :-1 s=THROTTLE_DONE pgs=1731 cs=0 l=1 rx=0x7ffb30002f30 tx=0x7ffb30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.545+0000 7ffb397fa700 1 -- 172.21.15.103:0/1113215185 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ffb3003d080 con 0x7ffb3c065fe0 2020-04-22T14:16:43.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.689+0000 7ffb42363700 1 -- 172.21.15.103:0/1113215185 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ffb3c147360 con 0x7ffb3c065fe0 2020-04-22T14:16:43.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.689+0000 7ffb3b7fe700 1 --2- 172.21.15.103:0/1113215185 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb3c065fe0 0x7ffb3c0b54c0 secure :-1 s=THROTTLE_DONE pgs=1731 cs=0 l=1 rx=0x7ffb30002f30 tx=0x7ffb30007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.689+0000 7ffb397fa700 1 -- 172.21.15.103:0/1113215185 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v120) v1 ==== 84+0+143 (secure 0 0 0) 0x7ffb300406a0 con 0x7ffb3c065fe0 2020-04-22T14:16:43.693 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:16:43.693 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2020-04-22T14:16:43.694 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:43.694 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 1, 2020-04-22T14:16:43.694 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": "device_health_metrics" 2020-04-22T14:16:43.694 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:43.694 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:16:43.694 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 2, 2020-04-22T14:16:43.694 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": "rbd" 2020-04-22T14:16:43.695 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:43.695 INFO:teuthology.orchestra.run.smithi103.stdout:] 2020-04-22T14:16:43.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.691+0000 7ffb42363700 1 -- 172.21.15.103:0/1113215185 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffb1c04d830 msgr2=0x7ffb1c04fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:43.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.691+0000 7ffb42363700 1 --2- 172.21.15.103:0/1113215185 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffb1c04d830 0x7ffb1c04fcf0 secure :-1 s=READY pgs=629 cs=0 l=1 rx=0x7ffb2c002f30 tx=0x7ffb2c008d70).stop 2020-04-22T14:16:43.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.691+0000 7ffb42363700 1 -- 172.21.15.103:0/1113215185 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb3c065fe0 msgr2=0x7ffb3c0b54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:43.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.691+0000 7ffb42363700 1 --2- 172.21.15.103:0/1113215185 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb3c065fe0 0x7ffb3c0b54c0 secure :-1 s=READY pgs=1731 cs=0 l=1 rx=0x7ffb30002f30 tx=0x7ffb30007a40).stop 2020-04-22T14:16:43.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.691+0000 7ffb42363700 1 -- 172.21.15.103:0/1113215185 shutdown_connections 2020-04-22T14:16:43.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.691+0000 7ffb42363700 1 --2- 172.21.15.103:0/1113215185 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffb1c04d830 0x7ffb1c04fcf0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:43.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.691+0000 7ffb42363700 1 --2- 172.21.15.103:0/1113215185 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb3c05b8a0 0x7ffb3c0b4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:43.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.691+0000 7ffb42363700 1 --2- 172.21.15.103:0/1113215185 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb3c065fe0 0x7ffb3c0b54c0 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:43.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.691+0000 7ffb42363700 1 -- 172.21.15.103:0/1113215185 >> 172.21.15.103:0/1113215185 conn(0x7ffb3c0b9160 msgr2=0x7ffb3c062bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:43.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.691+0000 7ffb42363700 1 -- 172.21.15.103:0/1113215185 shutdown_connections 2020-04-22T14:16:43.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.691+0000 7ffb42363700 1 -- 172.21.15.103:0/1113215185 wait complete. 2020-04-22T14:16:43.704 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-04-22T14:16:43.705 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:43.719 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-04-22T14:16:43.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.865+0000 7f18206c4700 1 Processor -- start 2020-04-22T14:16:43.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.865+0000 7f18206c4700 1 -- start start 2020-04-22T14:16:43.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.866+0000 7f18206c4700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f181814a320 0x7f181805fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:43.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.866+0000 7f18206c4700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18181465d0 con 0x7f1818146fb0 2020-04-22T14:16:43.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.866+0000 7f18206c4700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1818146870 con 0x7f1818149890 2020-04-22T14:16:43.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.866+0000 7f18206c4700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18181407a0 con 0x7f181814a320 2020-04-22T14:16:43.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.866+0000 7f181e460700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f181814a320 0x7f181805fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:43.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.866+0000 7f181ec61700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f1818149890 0x7f18180b3db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48786/0 (socket says 172.21.15.103:48786) 2020-04-22T14:16:43.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.866+0000 7f181ec61700 1 -- 172.21.15.103:0/698911749 learned_addr learned my addr 172.21.15.103:0/698911749 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:43.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.866+0000 7f181e460700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f181814a320 0x7f181805fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56592/0 (socket says 172.21.15.103:56592) 2020-04-22T14:16:43.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.867+0000 7f181e460700 1 -- 172.21.15.103:0/698911749 >> v1:172.21.15.103:6789/0 conn(0x7f1818149890 legacy=0x7f18180b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:43.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.867+0000 7f181e460700 1 -- 172.21.15.103:0/698911749 >> v1:172.21.15.86:6789/0 conn(0x7f1818146fb0 legacy=0x7f18180b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:43.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.867+0000 7f181d45e700 1 -- 172.21.15.103:0/698911749 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 731258952 0 0) 0x7f1818146870 con 0x7f1818149890 2020-04-22T14:16:43.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.867+0000 7f181e460700 1 -- 172.21.15.103:0/698911749 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1818146b10 con 0x7f181814a320 2020-04-22T14:16:43.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.867+0000 7f181e460700 1 --2- 172.21.15.103:0/698911749 >> v2:172.21.15.103:3300/0 conn(0x7f181814a320 0x7f181805fbe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1808002f30 tx=0x7f1808007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.867+0000 7f181e460700 1 --2- 172.21.15.103:0/698911749 >> v2:172.21.15.103:3300/0 conn(0x7f181814a320 0x7f181805fbe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1808002f30 tx=0x7f1808007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.867+0000 7f181e460700 1 --2- 172.21.15.103:0/698911749 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f181814a320 0x7f181805fbe0 secure :-1 s=READY pgs=1733 cs=0 l=1 rx=0x7f1808002f30 tx=0x7f1808007a40).ready entity=mon.1 client_cookie=232adfe61af811db server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:43.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.867+0000 7f181e460700 1 --2- 172.21.15.103:0/698911749 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f181814a320 0x7f181805fbe0 secure :-1 s=THROTTLE_DONE pgs=1733 cs=0 l=1 rx=0x7f1808002f30 tx=0x7f1808007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.867+0000 7f181e460700 1 --2- 172.21.15.103:0/698911749 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f181814a320 0x7f181805fbe0 secure :-1 s=THROTTLE_DONE pgs=1733 cs=0 l=1 rx=0x7f1808002f30 tx=0x7f1808007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.867+0000 7f181e460700 1 --2- 172.21.15.103:0/698911749 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f181814a320 0x7f181805fbe0 secure :-1 s=THROTTLE_DONE pgs=1733 cs=0 l=1 rx=0x7f1808002f30 tx=0x7f1808007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.867+0000 7f181d45e700 1 -- 172.21.15.103:0/698911749 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1808011470 con 0x7f181814a320 2020-04-22T14:16:43.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.867+0000 7f181d45e700 1 -- 172.21.15.103:0/698911749 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18080115d0 con 0x7f181814a320 2020-04-22T14:16:43.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.867+0000 7f181d45e700 1 -- 172.21.15.103:0/698911749 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18080119f0 con 0x7f181814a320 2020-04-22T14:16:43.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.867+0000 7f18206c4700 1 -- 172.21.15.103:0/698911749 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f181814a320 msgr2=0x7f181805fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:43.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.867+0000 7f18206c4700 1 --2- 172.21.15.103:0/698911749 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f181814a320 0x7f181805fbe0 secure :-1 s=READY pgs=1733 cs=0 l=1 rx=0x7f1808002f30 tx=0x7f1808007a40).stop 2020-04-22T14:16:43.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.867+0000 7f18206c4700 1 -- 172.21.15.103:0/698911749 shutdown_connections 2020-04-22T14:16:43.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.867+0000 7f18206c4700 1 --2- 172.21.15.103:0/698911749 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f181814a320 0x7f181805fbe0 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:43.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.867+0000 7f18206c4700 1 -- 172.21.15.103:0/698911749 >> 172.21.15.103:0/698911749 conn(0x7f18180610c0 msgr2=0x7f181805f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:43.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.868+0000 7f18206c4700 1 -- 172.21.15.103:0/698911749 shutdown_connections 2020-04-22T14:16:43.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.868+0000 7f18206c4700 1 -- 172.21.15.103:0/698911749 wait complete. 2020-04-22T14:16:43.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.868+0000 7f18206c4700 1 Processor -- start 2020-04-22T14:16:43.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.868+0000 7f18206c4700 1 -- start start 2020-04-22T14:16:43.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.869+0000 7f18206c4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1818146fb0 0x7f18180b4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:43.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.869+0000 7f18206c4700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f181814a320 0x7f18181438d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:43.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.869+0000 7f18206c4700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18180b4b30 con 0x7f1818149890 2020-04-22T14:16:43.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.869+0000 7f18206c4700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1818157990 con 0x7f181814a320 2020-04-22T14:16:43.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.869+0000 7f18206c4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18180b3190 con 0x7f1818146fb0 2020-04-22T14:16:43.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.869+0000 7f181dc5f700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f1818149890 0x7f18181570f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48790/0 (socket says 172.21.15.103:48790) 2020-04-22T14:16:43.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.869+0000 7f181dc5f700 1 -- 172.21.15.103:0/239091625 learned_addr learned my addr 172.21.15.103:0/239091625 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:43.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.869+0000 7f181e460700 1 --2- 172.21.15.103:0/239091625 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1818146fb0 0x7f18180b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:43.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.869+0000 7f181ec61700 1 --2- 172.21.15.103:0/239091625 >> v2:172.21.15.86:3300/0 conn(0x7f181814a320 0x7f18181438d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:43.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.869+0000 7f18077fe700 1 -- 172.21.15.103:0/239091625 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1449289707 0 0) 0x7f18180b4b30 con 0x7f1818149890 2020-04-22T14:16:43.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.869+0000 7f18077fe700 1 -- 172.21.15.103:0/239091625 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17f8002fe0 con 0x7f1818149890 2020-04-22T14:16:43.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.870+0000 7f18077fe700 1 -- 172.21.15.103:0/239091625 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 149360666 0 0) 0x7f17f8002fe0 con 0x7f1818149890 2020-04-22T14:16:43.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.870+0000 7f18077fe700 1 -- 172.21.15.103:0/239091625 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f18180b4b30 con 0x7f1818149890 2020-04-22T14:16:43.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.870+0000 7f18077fe700 1 -- 172.21.15.103:0/239091625 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f18140019c0 con 0x7f1818149890 2020-04-22T14:16:43.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.870+0000 7f18077fe700 1 -- 172.21.15.103:0/239091625 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1818146fb0 msgr2=0x7f18180b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:43.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.870+0000 7f18077fe700 1 --2- 172.21.15.103:0/239091625 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1818146fb0 0x7f18180b4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:43.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.870+0000 7f18077fe700 1 -- 172.21.15.103:0/239091625 >> v2:172.21.15.86:3300/0 conn(0x7f181814a320 msgr2=0x7f18181438d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:43.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.870+0000 7f18077fe700 1 --2- 172.21.15.103:0/239091625 >> v2:172.21.15.86:3300/0 conn(0x7f181814a320 0x7f18181438d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:43.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.870+0000 7f18077fe700 1 -- 172.21.15.103:0/239091625 >> v1:172.21.15.103:6789/0 conn(0x7f1818149890 legacy=0x7f18181570f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:43.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.870+0000 7f18077fe700 1 --2- 172.21.15.103:0/239091625 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f17f80049b0 0x7f17f8004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:43.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.870+0000 7f18077fe700 1 --2- 172.21.15.103:0/239091625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17f8003920 0x7f17f8003d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:43.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.870+0000 7f18077fe700 1 --2- 172.21.15.103:0/239091625 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1818146fb0 0x7f17f80041e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:43.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.870+0000 7f18077fe700 1 -- 172.21.15.103:0/239091625 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1818157990 con 0x7f17f80049b0 2020-04-22T14:16:43.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.870+0000 7f18077fe700 1 -- 172.21.15.103:0/239091625 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18180b3190 con 0x7f17f8003920 2020-04-22T14:16:43.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.870+0000 7f18077fe700 1 -- 172.21.15.103:0/239091625 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f8004640 con 0x7f1818146fb0 2020-04-22T14:16:43.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.870+0000 7f181dc5f700 1 --2- 172.21.15.103:0/239091625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17f8003920 0x7f17f8003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:43.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.870+0000 7f181e460700 1 --2- 172.21.15.103:0/239091625 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f17f80049b0 0x7f17f8004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:43.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.870+0000 7f181ec61700 1 --2- 172.21.15.103:0/239091625 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1818146fb0 0x7f17f80041e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:43.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.870+0000 7f181dc5f700 1 -- 172.21.15.103:0/239091625 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1818146fb0 msgr2=0x7f17f80041e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:43.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.870+0000 7f181dc5f700 1 --2- 172.21.15.103:0/239091625 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1818146fb0 0x7f17f80041e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:43.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.870+0000 7f181dc5f700 1 -- 172.21.15.103:0/239091625 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f17f80049b0 msgr2=0x7f17f8004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:43.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.870+0000 7f181dc5f700 1 --2- 172.21.15.103:0/239091625 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f17f80049b0 0x7f17f8004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:43.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.870+0000 7f181dc5f700 1 -- 172.21.15.103:0/239091625 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18180b2020 con 0x7f17f8003920 2020-04-22T14:16:43.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.870+0000 7f18206c4700 1 -- 172.21.15.103:0/239091625 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18180b4620 con 0x7f17f8003920 2020-04-22T14:16:43.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.870+0000 7f181dc5f700 1 --2- 172.21.15.103:0/239091625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17f8003920 0x7f17f8003d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f18140016d0 tx=0x7f18140114c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.870+0000 7f18206c4700 1 -- 172.21.15.103:0/239091625 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18180b2430 con 0x7f17f8003920 2020-04-22T14:16:43.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.870+0000 7f181dc5f700 1 --2- 172.21.15.103:0/239091625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17f8003920 0x7f17f8003d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f18140016d0 tx=0x7f18140114c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.870+0000 7f181dc5f700 1 --2- 172.21.15.103:0/239091625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17f8003920 0x7f17f8003d80 secure :-1 s=READY pgs=1735 cs=0 l=1 rx=0x7f18140016d0 tx=0x7f18140114c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:43.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.870+0000 7f181dc5f700 1 --2- 172.21.15.103:0/239091625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17f8003920 0x7f17f8003d80 secure :-1 s=THROTTLE_DONE pgs=1735 cs=0 l=1 rx=0x7f18140016d0 tx=0x7f18140114c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.870+0000 7f18077fe700 1 -- 172.21.15.103:0/239091625 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1814011e20 con 0x7f17f8003920 2020-04-22T14:16:43.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.870+0000 7f181dc5f700 1 --2- 172.21.15.103:0/239091625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17f8003920 0x7f17f8003d80 secure :-1 s=THROTTLE_DONE pgs=1735 cs=0 l=1 rx=0x7f18140016d0 tx=0x7f18140114c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.871+0000 7f181dc5f700 1 --2- 172.21.15.103:0/239091625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17f8003920 0x7f17f8003d80 secure :-1 s=THROTTLE_DONE pgs=1735 cs=0 l=1 rx=0x7f18140016d0 tx=0x7f18140114c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.871+0000 7f18077fe700 1 -- 172.21.15.103:0/239091625 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181400b080 con 0x7f17f8003920 2020-04-22T14:16:43.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.871+0000 7f18077fe700 1 -- 172.21.15.103:0/239091625 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f181400b4a0 con 0x7f17f8003920 2020-04-22T14:16:43.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.871+0000 7f181dc5f700 1 --2- 172.21.15.103:0/239091625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17f8003920 0x7f17f8003d80 secure :-1 s=THROTTLE_DONE pgs=1735 cs=0 l=1 rx=0x7f18140016d0 tx=0x7f18140114c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.871+0000 7f18077fe700 1 -- 172.21.15.103:0/239091625 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f181400a6e0 con 0x7f17f8003920 2020-04-22T14:16:43.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.871+0000 7f181dc5f700 1 --2- 172.21.15.103:0/239091625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17f8003920 0x7f17f8003d80 secure :-1 s=THROTTLE_DONE pgs=1735 cs=0 l=1 rx=0x7f18140016d0 tx=0x7f18140114c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.872+0000 7f18206c4700 1 -- 172.21.15.103:0/239091625 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1818157800 con 0x7f17f8003920 2020-04-22T14:16:43.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.872+0000 7f18077fe700 1 --2- 172.21.15.103:0/239091625 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f17f8055ba0 0x7f17f8058060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:43.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.872+0000 7f18077fe700 1 -- 172.21.15.103:0/239091625 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f1814061560 con 0x7f17f8003920 2020-04-22T14:16:43.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.872+0000 7f181e460700 1 --2- 172.21.15.103:0/239091625 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f17f8055ba0 0x7f17f8058060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:43.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.872+0000 7f181e460700 1 --2- 172.21.15.103:0/239091625 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f17f8055ba0 0x7f17f8058060 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1808002f30 tx=0x7f1808007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.872+0000 7f181e460700 1 --2- 172.21.15.103:0/239091625 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f17f8055ba0 0x7f17f8058060 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1808002f30 tx=0x7f1808007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.872+0000 7f181e460700 1 --2- 172.21.15.103:0/239091625 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f17f8055ba0 0x7f17f8058060 secure :-1 s=READY pgs=630 cs=0 l=1 rx=0x7f1808002f30 tx=0x7f1808007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:43.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.876+0000 7f181dc5f700 1 --2- 172.21.15.103:0/239091625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17f8003920 0x7f17f8003d80 secure :-1 s=THROTTLE_DONE pgs=1735 cs=0 l=1 rx=0x7f18140016d0 tx=0x7f18140114c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:43.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:43.876+0000 7f18077fe700 1 -- 172.21.15.103:0/239091625 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f181403c9a0 con 0x7f17f8003920 2020-04-22T14:16:44.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.016+0000 7f18206c4700 1 -- 172.21.15.103:0/239091625 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f18180b4930 con 0x7f17f8003920 2020-04-22T14:16:44.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.723+0000 7f181dc5f700 1 --2- 172.21.15.103:0/239091625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17f8003920 0x7f17f8003d80 secure :-1 s=THROTTLE_DONE pgs=1735 cs=0 l=1 rx=0x7f18140016d0 tx=0x7f18140114c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:44.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.723+0000 7f18077fe700 1 -- 172.21.15.103:0/239091625 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v121) v1 ==== 133+0+0 (secure 0 0 0) 0x7f181403ffc0 con 0x7f17f8003920 2020-04-22T14:16:44.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.725+0000 7f18206c4700 1 -- 172.21.15.103:0/239091625 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f17f8055ba0 msgr2=0x7f17f8058060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:44.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.725+0000 7f18206c4700 1 --2- 172.21.15.103:0/239091625 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f17f8055ba0 0x7f17f8058060 secure :-1 s=READY pgs=630 cs=0 l=1 rx=0x7f1808002f30 tx=0x7f1808007a40).stop 2020-04-22T14:16:44.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.725+0000 7f18206c4700 1 -- 172.21.15.103:0/239091625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17f8003920 msgr2=0x7f17f8003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:44.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.725+0000 7f18206c4700 1 --2- 172.21.15.103:0/239091625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17f8003920 0x7f17f8003d80 secure :-1 s=READY pgs=1735 cs=0 l=1 rx=0x7f18140016d0 tx=0x7f18140114c0).stop 2020-04-22T14:16:44.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.725+0000 7f181ec61700 1 -- 172.21.15.103:0/239091625 reap_dead start 2020-04-22T14:16:44.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.725+0000 7f181ec61700 1 -- 172.21.15.103:0/239091625 reap_dead start 2020-04-22T14:16:44.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.725+0000 7f18206c4700 1 -- 172.21.15.103:0/239091625 shutdown_connections 2020-04-22T14:16:44.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.725+0000 7f18206c4700 1 -- 172.21.15.103:0/239091625 >> 172.21.15.103:0/239091625 conn(0x7f18180610c0 msgr2=0x7f181812efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:44.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.725+0000 7f18206c4700 1 -- 172.21.15.103:0/239091625 shutdown_connections 2020-04-22T14:16:44.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.725+0000 7f18206c4700 1 -- 172.21.15.103:0/239091625 wait complete. 2020-04-22T14:16:44.731 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' created 2020-04-22T14:16:44.742 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:44.757 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-04-22T14:16:44.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.908+0000 7fa1e890e700 1 Processor -- start 2020-04-22T14:16:44.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.908+0000 7fa1e890e700 1 -- start start 2020-04-22T14:16:44.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.909+0000 7fa1e890e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa1e40ac950 0x7fa1e4146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:44.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.909+0000 7fa1e890e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1e41467e0 con 0x7fa1e40b9140 2020-04-22T14:16:44.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.909+0000 7fa1e890e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1e4060050 con 0x7fa1e41470a0 2020-04-22T14:16:44.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.909+0000 7fa1e890e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1e4147530 con 0x7fa1e40ac950 2020-04-22T14:16:44.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.909+0000 7fa1e1d9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa1e40ac950 0x7fa1e4146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:44.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.910+0000 7fa1e1d9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa1e40ac950 0x7fa1e4146c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56614/0 (socket says 172.21.15.103:56614) 2020-04-22T14:16:44.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.910+0000 7fa1e1d9b700 1 -- 172.21.15.103:0/2822907771 learned_addr learned my addr 172.21.15.103:0/2822907771 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:44.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.910+0000 7fa1e2d9d700 1 --1- 172.21.15.103:0/2822907771 >> v1:172.21.15.103:6789/0 conn(0x7fa1e41470a0 0x7fa1e4143090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48806/0 (socket says 172.21.15.103:48806) 2020-04-22T14:16:44.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.910+0000 7fa1e1d9b700 1 -- 172.21.15.103:0/2822907771 >> v1:172.21.15.103:6789/0 conn(0x7fa1e41470a0 legacy=0x7fa1e4143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:44.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.910+0000 7fa1e1d9b700 1 -- 172.21.15.103:0/2822907771 >> v1:172.21.15.86:6789/0 conn(0x7fa1e40b9140 legacy=0x7fa1e412b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:44.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.910+0000 7fa1e159a700 1 -- 172.21.15.103:0/2822907771 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3637667199 0 0) 0x7fa1e4060050 con 0x7fa1e41470a0 2020-04-22T14:16:44.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.910+0000 7fa1e1d9b700 1 -- 172.21.15.103:0/2822907771 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e40b9520 con 0x7fa1e40ac950 2020-04-22T14:16:44.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.910+0000 7fa1e1d9b700 1 --2- 172.21.15.103:0/2822907771 >> v2:172.21.15.103:3300/0 conn(0x7fa1e40ac950 0x7fa1e4146c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa1e40b6250 tx=0x7fa1d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:44.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.910+0000 7fa1e1d9b700 1 --2- 172.21.15.103:0/2822907771 >> v2:172.21.15.103:3300/0 conn(0x7fa1e40ac950 0x7fa1e4146c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa1e40b6250 tx=0x7fa1d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:44.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.910+0000 7fa1e1d9b700 1 --2- 172.21.15.103:0/2822907771 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1e40ac950 0x7fa1e4146c40 secure :-1 s=READY pgs=1737 cs=0 l=1 rx=0x7fa1e40b6250 tx=0x7fa1d4007a40).ready entity=mon.1 client_cookie=86d7060b8241f7ae server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:44.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.910+0000 7fa1e1d9b700 1 --2- 172.21.15.103:0/2822907771 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1e40ac950 0x7fa1e4146c40 secure :-1 s=THROTTLE_DONE pgs=1737 cs=0 l=1 rx=0x7fa1e40b6250 tx=0x7fa1d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:44.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.910+0000 7fa1e159a700 1 -- 172.21.15.103:0/2822907771 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1d40116e0 con 0x7fa1e40ac950 2020-04-22T14:16:44.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.910+0000 7fa1e1d9b700 1 --2- 172.21.15.103:0/2822907771 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1e40ac950 0x7fa1e4146c40 secure :-1 s=THROTTLE_DONE pgs=1737 cs=0 l=1 rx=0x7fa1e40b6250 tx=0x7fa1d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:44.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.910+0000 7fa1e1d9b700 1 --2- 172.21.15.103:0/2822907771 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1e40ac950 0x7fa1e4146c40 secure :-1 s=THROTTLE_DONE pgs=1737 cs=0 l=1 rx=0x7fa1e40b6250 tx=0x7fa1d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:44.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.910+0000 7fa1e159a700 1 -- 172.21.15.103:0/2822907771 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d4011840 con 0x7fa1e40ac950 2020-04-22T14:16:44.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.910+0000 7fa1e159a700 1 -- 172.21.15.103:0/2822907771 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1d4011c20 con 0x7fa1e40ac950 2020-04-22T14:16:44.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.910+0000 7fa1e890e700 1 -- 172.21.15.103:0/2822907771 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1e40ac950 msgr2=0x7fa1e4146c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:44.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.910+0000 7fa1e890e700 1 --2- 172.21.15.103:0/2822907771 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1e40ac950 0x7fa1e4146c40 secure :-1 s=READY pgs=1737 cs=0 l=1 rx=0x7fa1e40b6250 tx=0x7fa1d4007a40).stop 2020-04-22T14:16:44.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.911+0000 7fa1e890e700 1 -- 172.21.15.103:0/2822907771 shutdown_connections 2020-04-22T14:16:44.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.911+0000 7fa1e890e700 1 --2- 172.21.15.103:0/2822907771 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1e40ac950 0x7fa1e4146c40 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:44.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.911+0000 7fa1e890e700 1 -- 172.21.15.103:0/2822907771 >> 172.21.15.103:0/2822907771 conn(0x7fa1e405b7b0 msgr2=0x7fa1e40b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:44.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.911+0000 7fa1e890e700 1 -- 172.21.15.103:0/2822907771 shutdown_connections 2020-04-22T14:16:44.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.911+0000 7fa1e890e700 1 -- 172.21.15.103:0/2822907771 wait complete. 2020-04-22T14:16:44.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.911+0000 7fa1e890e700 1 Processor -- start 2020-04-22T14:16:44.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.912+0000 7fa1e890e700 1 -- start start 2020-04-22T14:16:44.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.912+0000 7fa1e890e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa1e40ac950 0x7fa1e4144a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:44.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.912+0000 7fa1e890e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa1e41470a0 0x7fa1e40b1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:44.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.912+0000 7fa1e890e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1e4144ec0 con 0x7fa1e40b9140 2020-04-22T14:16:44.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.912+0000 7fa1e890e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1e40b0de0 con 0x7fa1e40ac950 2020-04-22T14:16:44.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.912+0000 7fa1e890e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e40b1040 con 0x7fa1e41470a0 2020-04-22T14:16:44.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.912+0000 7fa1e259c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa1e40ac950 0x7fa1e4144a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:44.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.912+0000 7fa1e1d9b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa1e40b9140 0x7fa1e40b20d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48810/0 (socket says 172.21.15.103:48810) 2020-04-22T14:16:44.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.912+0000 7fa1e1d9b700 1 -- 172.21.15.103:0/3315888312 learned_addr learned my addr 172.21.15.103:0/3315888312 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:44.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.912+0000 7fa1e259c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa1e40ac950 0x7fa1e4144a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56618/0 (socket says 172.21.15.103:56618) 2020-04-22T14:16:44.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.912+0000 7fa1d37fe700 1 -- 172.21.15.103:0/3315888312 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2577607291 0 0) 0x7fa1e40b9520 con 0x7fa1e40b9140 2020-04-22T14:16:44.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.912+0000 7fa1d37fe700 1 -- 172.21.15.103:0/3315888312 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1c0002fe0 con 0x7fa1e40b9140 2020-04-22T14:16:44.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.913+0000 7fa1e2d9d700 1 --2- 172.21.15.103:0/3315888312 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa1e41470a0 0x7fa1e40b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:44.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.913+0000 7fa1e259c700 1 -- 172.21.15.103:0/3315888312 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa1e41470a0 msgr2=0x7fa1e40b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:44.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.913+0000 7fa1e259c700 1 --2- 172.21.15.103:0/3315888312 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa1e41470a0 0x7fa1e40b1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:44.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.913+0000 7fa1e259c700 1 -- 172.21.15.103:0/3315888312 >> v1:172.21.15.103:6789/0 conn(0x7fa1e40b9140 legacy=0x7fa1e40b20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:44.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.913+0000 7fa1e259c700 1 -- 172.21.15.103:0/3315888312 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e40b12e0 con 0x7fa1e40ac950 2020-04-22T14:16:44.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.913+0000 7fa1e259c700 1 --2- 172.21.15.103:0/3315888312 >> v2:172.21.15.103:3300/0 conn(0x7fa1e40ac950 0x7fa1e4144a60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa1d8001f50 tx=0x7fa1d8010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:44.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.913+0000 7fa1e259c700 1 --2- 172.21.15.103:0/3315888312 >> v2:172.21.15.103:3300/0 conn(0x7fa1e40ac950 0x7fa1e4144a60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa1d8001f50 tx=0x7fa1d8010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:44.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.913+0000 7fa1e259c700 1 --2- 172.21.15.103:0/3315888312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1e40ac950 0x7fa1e4144a60 secure :-1 s=READY pgs=1739 cs=0 l=1 rx=0x7fa1d8001f50 tx=0x7fa1d8010850).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:44.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.913+0000 7fa1e259c700 1 --2- 172.21.15.103:0/3315888312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1e40ac950 0x7fa1e4144a60 secure :-1 s=THROTTLE_DONE pgs=1739 cs=0 l=1 rx=0x7fa1d8001f50 tx=0x7fa1d8010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:44.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.913+0000 7fa1d37fe700 1 -- 172.21.15.103:0/3315888312 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1d8006bc0 con 0x7fa1e40ac950 2020-04-22T14:16:44.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.913+0000 7fa1e259c700 1 --2- 172.21.15.103:0/3315888312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1e40ac950 0x7fa1e4144a60 secure :-1 s=THROTTLE_DONE pgs=1739 cs=0 l=1 rx=0x7fa1d8001f50 tx=0x7fa1d8010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:44.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.913+0000 7fa1e259c700 1 --2- 172.21.15.103:0/3315888312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1e40ac950 0x7fa1e4144a60 secure :-1 s=THROTTLE_DONE pgs=1739 cs=0 l=1 rx=0x7fa1d8001f50 tx=0x7fa1d8010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:44.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.913+0000 7fa1d37fe700 1 -- 172.21.15.103:0/3315888312 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d8006d60 con 0x7fa1e40ac950 2020-04-22T14:16:44.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.913+0000 7fa1e890e700 1 -- 172.21.15.103:0/3315888312 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1e413f8c0 con 0x7fa1e40ac950 2020-04-22T14:16:44.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.913+0000 7fa1d37fe700 1 -- 172.21.15.103:0/3315888312 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1d8008370 con 0x7fa1e40ac950 2020-04-22T14:16:44.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.913+0000 7fa1e890e700 1 -- 172.21.15.103:0/3315888312 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1e40b1da0 con 0x7fa1e40ac950 2020-04-22T14:16:44.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.913+0000 7fa1e259c700 1 --2- 172.21.15.103:0/3315888312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1e40ac950 0x7fa1e4144a60 secure :-1 s=THROTTLE_DONE pgs=1739 cs=0 l=1 rx=0x7fa1d8001f50 tx=0x7fa1d8010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:44.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.914+0000 7fa1d37fe700 1 -- 172.21.15.103:0/3315888312 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fa1d80085e0 con 0x7fa1e40ac950 2020-04-22T14:16:44.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.914+0000 7fa1e259c700 1 --2- 172.21.15.103:0/3315888312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1e40ac950 0x7fa1e4144a60 secure :-1 s=THROTTLE_DONE pgs=1739 cs=0 l=1 rx=0x7fa1d8001f50 tx=0x7fa1d8010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:44.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.914+0000 7fa1e890e700 1 -- 172.21.15.103:0/3315888312 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1e4056c90 con 0x7fa1e40ac950 2020-04-22T14:16:44.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.914+0000 7fa1d37fe700 1 --2- 172.21.15.103:0/3315888312 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa1c004dd00 0x7fa1c00501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:44.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.914+0000 7fa1d37fe700 1 -- 172.21.15.103:0/3315888312 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fa1d8061510 con 0x7fa1e40ac950 2020-04-22T14:16:44.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.914+0000 7fa1e1d9b700 1 --2- 172.21.15.103:0/3315888312 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa1c004dd00 0x7fa1c00501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:44.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.915+0000 7fa1e1d9b700 1 --2- 172.21.15.103:0/3315888312 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa1c004dd00 0x7fa1c00501c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa1d40102c0 tx=0x7fa1d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:44.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.915+0000 7fa1e1d9b700 1 --2- 172.21.15.103:0/3315888312 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa1c004dd00 0x7fa1c00501c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa1d40102c0 tx=0x7fa1d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:44.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.915+0000 7fa1e1d9b700 1 --2- 172.21.15.103:0/3315888312 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa1c004dd00 0x7fa1c00501c0 secure :-1 s=READY pgs=631 cs=0 l=1 rx=0x7fa1d40102c0 tx=0x7fa1d4007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:44.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.918+0000 7fa1e259c700 1 --2- 172.21.15.103:0/3315888312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1e40ac950 0x7fa1e4144a60 secure :-1 s=THROTTLE_DONE pgs=1739 cs=0 l=1 rx=0x7fa1d8001f50 tx=0x7fa1d8010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:44.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:44.918+0000 7fa1d37fe700 1 -- 172.21.15.103:0/3315888312 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fa1d803c8f0 con 0x7fa1e40ac950 2020-04-22T14:16:45.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.059+0000 7fa1e890e700 1 -- 172.21.15.103:0/3315888312 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fa1e40b5c60 con 0x7fa1e40ac950 2020-04-22T14:16:45.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.724+0000 7fa1e259c700 1 --2- 172.21.15.103:0/3315888312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1e40ac950 0x7fa1e4144a60 secure :-1 s=THROTTLE_DONE pgs=1739 cs=0 l=1 rx=0x7fa1d8001f50 tx=0x7fa1d8010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:45.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.724+0000 7fa1d37fe700 1 -- 172.21.15.103:0/3315888312 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v122) v1 ==== 125+0+0 (secure 0 0 0) 0x7fa1d803ff10 con 0x7fa1e40ac950 2020-04-22T14:16:45.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.727+0000 7fa1e890e700 1 -- 172.21.15.103:0/3315888312 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa1c004dd00 msgr2=0x7fa1c00501c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:45.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.727+0000 7fa1e890e700 1 --2- 172.21.15.103:0/3315888312 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa1c004dd00 0x7fa1c00501c0 secure :-1 s=READY pgs=631 cs=0 l=1 rx=0x7fa1d40102c0 tx=0x7fa1d4007a40).stop 2020-04-22T14:16:45.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.727+0000 7fa1e890e700 1 -- 172.21.15.103:0/3315888312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1e40ac950 msgr2=0x7fa1e4144a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:45.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.727+0000 7fa1e890e700 1 --2- 172.21.15.103:0/3315888312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1e40ac950 0x7fa1e4144a60 secure :-1 s=READY pgs=1739 cs=0 l=1 rx=0x7fa1d8001f50 tx=0x7fa1d8010850).stop 2020-04-22T14:16:45.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.728+0000 7fa1e890e700 1 -- 172.21.15.103:0/3315888312 shutdown_connections 2020-04-22T14:16:45.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.728+0000 7fa1e890e700 1 --2- 172.21.15.103:0/3315888312 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa1c004dd00 0x7fa1c00501c0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:45.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.728+0000 7fa1e890e700 1 --2- 172.21.15.103:0/3315888312 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa1e41470a0 0x7fa1e40b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:45.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.728+0000 7fa1e890e700 1 --2- 172.21.15.103:0/3315888312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1e40ac950 0x7fa1e4144a60 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:45.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.728+0000 7fa1e890e700 1 -- 172.21.15.103:0/3315888312 >> 172.21.15.103:0/3315888312 conn(0x7fa1e405b7b0 msgr2=0x7fa1e40b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:45.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.728+0000 7fa1e890e700 1 -- 172.21.15.103:0/3315888312 shutdown_connections 2020-04-22T14:16:45.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.728+0000 7fa1e890e700 1 -- 172.21.15.103:0/3315888312 wait complete. 2020-04-22T14:16:45.733 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' created 2020-04-22T14:16:45.745 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:45.759 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-04-22T14:16:45.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.910+0000 7fd08a260700 1 Processor -- start 2020-04-22T14:16:45.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.910+0000 7fd08a260700 1 -- start start 2020-04-22T14:16:45.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.910+0000 7fd08a260700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd0840b9140 0x7fd08412b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:45.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.910+0000 7fd08a260700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd0840ac950 0x7fd08412b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:45.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.910+0000 7fd08a260700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd084146c40 0x7fd0841470d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:45.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.910+0000 7fd08a260700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd084147530 con 0x7fd084146c40 2020-04-22T14:16:45.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.910+0000 7fd08a260700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0840602f0 con 0x7fd0840ac950 2020-04-22T14:16:45.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.910+0000 7fd08a260700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0841467e0 con 0x7fd0840b9140 2020-04-22T14:16:45.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.911+0000 7fd082ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd0840ac950 0x7fd08412b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:45.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.911+0000 7fd082ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd0840ac950 0x7fd08412b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56626/0 (socket says 172.21.15.103:56626) 2020-04-22T14:16:45.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.911+0000 7fd082ffd700 1 -- 172.21.15.103:0/320064911 learned_addr learned my addr 172.21.15.103:0/320064911 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:45.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.911+0000 7fd0837fe700 1 --2- 172.21.15.103:0/320064911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd0840b9140 0x7fd08412b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:45.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.911+0000 7fd083fff700 1 --2- 172.21.15.103:0/320064911 >> v2:172.21.15.86:3300/0 conn(0x7fd084146c40 0x7fd0841470d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:45.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.911+0000 7fd082ffd700 1 -- 172.21.15.103:0/320064911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd0840b9140 msgr2=0x7fd08412b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:45.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.911+0000 7fd082ffd700 1 --2- 172.21.15.103:0/320064911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd0840b9140 0x7fd08412b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:45.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.911+0000 7fd082ffd700 1 -- 172.21.15.103:0/320064911 >> v2:172.21.15.86:3300/0 conn(0x7fd084146c40 msgr2=0x7fd0841470d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:45.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.911+0000 7fd082ffd700 1 --2- 172.21.15.103:0/320064911 >> v2:172.21.15.86:3300/0 conn(0x7fd084146c40 0x7fd0841470d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:45.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.911+0000 7fd082ffd700 1 -- 172.21.15.103:0/320064911 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd084060050 con 0x7fd0840ac950 2020-04-22T14:16:45.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.911+0000 7fd083fff700 1 --2- 172.21.15.103:0/320064911 >> v2:172.21.15.86:3300/0 conn(0x7fd084146c40 0x7fd0841470d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:16:45.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.911+0000 7fd0837fe700 1 --2- 172.21.15.103:0/320064911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd0840b9140 0x7fd08412b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:16:45.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.911+0000 7fd082ffd700 1 --2- 172.21.15.103:0/320064911 >> v2:172.21.15.103:3300/0 conn(0x7fd0840ac950 0x7fd08412b670 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd0780032b0 tx=0x7fd078007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:45.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.911+0000 7fd082ffd700 1 --2- 172.21.15.103:0/320064911 >> v2:172.21.15.103:3300/0 conn(0x7fd0840ac950 0x7fd08412b670 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd0780032b0 tx=0x7fd078007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:45.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.911+0000 7fd082ffd700 1 --2- 172.21.15.103:0/320064911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0840ac950 0x7fd08412b670 secure :-1 s=READY pgs=1740 cs=0 l=1 rx=0x7fd0780032b0 tx=0x7fd078007dc0).ready entity=mon.1 client_cookie=4da1e2dac7e2b8e3 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:45.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.911+0000 7fd082ffd700 1 --2- 172.21.15.103:0/320064911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0840ac950 0x7fd08412b670 secure :-1 s=THROTTLE_DONE pgs=1740 cs=0 l=1 rx=0x7fd0780032b0 tx=0x7fd078007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:45.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.911+0000 7fd0827fc700 1 -- 172.21.15.103:0/320064911 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd07800a180 con 0x7fd0840ac950 2020-04-22T14:16:45.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.911+0000 7fd082ffd700 1 --2- 172.21.15.103:0/320064911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0840ac950 0x7fd08412b670 secure :-1 s=THROTTLE_DONE pgs=1740 cs=0 l=1 rx=0x7fd0780032b0 tx=0x7fd078007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:45.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.911+0000 7fd082ffd700 1 --2- 172.21.15.103:0/320064911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0840ac950 0x7fd08412b670 secure :-1 s=THROTTLE_DONE pgs=1740 cs=0 l=1 rx=0x7fd0780032b0 tx=0x7fd078007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:45.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.911+0000 7fd0827fc700 1 -- 172.21.15.103:0/320064911 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07800a2e0 con 0x7fd0840ac950 2020-04-22T14:16:45.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.911+0000 7fd0827fc700 1 -- 172.21.15.103:0/320064911 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd07800a700 con 0x7fd0840ac950 2020-04-22T14:16:45.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.911+0000 7fd08a260700 1 -- 172.21.15.103:0/320064911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0840ac950 msgr2=0x7fd08412b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:45.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.911+0000 7fd08a260700 1 --2- 172.21.15.103:0/320064911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0840ac950 0x7fd08412b670 secure :-1 s=READY pgs=1740 cs=0 l=1 rx=0x7fd0780032b0 tx=0x7fd078007dc0).stop 2020-04-22T14:16:45.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.912+0000 7fd08a260700 1 -- 172.21.15.103:0/320064911 shutdown_connections 2020-04-22T14:16:45.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.912+0000 7fd08a260700 1 --2- 172.21.15.103:0/320064911 >> v2:172.21.15.86:3300/0 conn(0x7fd084146c40 0x7fd0841470d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:45.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.912+0000 7fd08a260700 1 --2- 172.21.15.103:0/320064911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd0840b9140 0x7fd08412b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:45.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.912+0000 7fd08a260700 1 --2- 172.21.15.103:0/320064911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0840ac950 0x7fd08412b670 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:45.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.912+0000 7fd08a260700 1 -- 172.21.15.103:0/320064911 >> 172.21.15.103:0/320064911 conn(0x7fd08405b7b0 msgr2=0x7fd0840b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:45.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.912+0000 7fd08a260700 1 -- 172.21.15.103:0/320064911 shutdown_connections 2020-04-22T14:16:45.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.912+0000 7fd08a260700 1 -- 172.21.15.103:0/320064911 wait complete. 2020-04-22T14:16:45.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.913+0000 7fd08a260700 1 Processor -- start 2020-04-22T14:16:45.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.913+0000 7fd08a260700 1 -- start start 2020-04-22T14:16:45.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.913+0000 7fd08a260700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd0840ac950 0x7fd0840b2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:45.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.913+0000 7fd08a260700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd0840b9140 0x7fd084128360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:45.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.913+0000 7fd08a260700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd084146c40 0x7fd0840b4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:45.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.913+0000 7fd08a260700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0840b40f0 con 0x7fd0840ac950 2020-04-22T14:16:45.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.914+0000 7fd08a260700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0841287c0 con 0x7fd084146c40 2020-04-22T14:16:45.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.914+0000 7fd08a260700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0840b3160 con 0x7fd0840b9140 2020-04-22T14:16:45.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.914+0000 7fd083fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd084146c40 0x7fd0840b4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:45.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.914+0000 7fd083fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd084146c40 0x7fd0840b4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56636/0 (socket says 172.21.15.103:56636) 2020-04-22T14:16:45.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.914+0000 7fd083fff700 1 -- 172.21.15.103:0/3481082001 learned_addr learned my addr 172.21.15.103:0/3481082001 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:45.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.914+0000 7fd0837fe700 1 --2- 172.21.15.103:0/3481082001 >> v2:172.21.15.86:3300/0 conn(0x7fd0840ac950 0x7fd0840b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:45.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.914+0000 7fd082ffd700 1 --2- 172.21.15.103:0/3481082001 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd0840b9140 0x7fd084128360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:45.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.914+0000 7fd083fff700 1 -- 172.21.15.103:0/3481082001 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd0840b9140 msgr2=0x7fd084128360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:45.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.914+0000 7fd083fff700 1 --2- 172.21.15.103:0/3481082001 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd0840b9140 0x7fd084128360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:45.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.914+0000 7fd083fff700 1 -- 172.21.15.103:0/3481082001 >> v2:172.21.15.86:3300/0 conn(0x7fd0840ac950 msgr2=0x7fd0840b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:45.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.914+0000 7fd083fff700 1 --2- 172.21.15.103:0/3481082001 >> v2:172.21.15.86:3300/0 conn(0x7fd0840ac950 0x7fd0840b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:45.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.914+0000 7fd083fff700 1 -- 172.21.15.103:0/3481082001 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0840b5fa0 con 0x7fd084146c40 2020-04-22T14:16:45.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.914+0000 7fd083fff700 1 --2- 172.21.15.103:0/3481082001 >> v2:172.21.15.103:3300/0 conn(0x7fd084146c40 0x7fd0840b4550 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd0840b3080 tx=0x7fd07c0109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:45.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.914+0000 7fd083fff700 1 --2- 172.21.15.103:0/3481082001 >> v2:172.21.15.103:3300/0 conn(0x7fd084146c40 0x7fd0840b4550 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd0840b3080 tx=0x7fd07c0109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:45.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.914+0000 7fd083fff700 1 --2- 172.21.15.103:0/3481082001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd084146c40 0x7fd0840b4550 secure :-1 s=READY pgs=1741 cs=0 l=1 rx=0x7fd0840b3080 tx=0x7fd07c0109d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:45.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.914+0000 7fd083fff700 1 --2- 172.21.15.103:0/3481082001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd084146c40 0x7fd0840b4550 secure :-1 s=THROTTLE_DONE pgs=1741 cs=0 l=1 rx=0x7fd0840b3080 tx=0x7fd07c0109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:45.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.914+0000 7fd080ff9700 1 -- 172.21.15.103:0/3481082001 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd07c00a370 con 0x7fd084146c40 2020-04-22T14:16:45.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.914+0000 7fd083fff700 1 --2- 172.21.15.103:0/3481082001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd084146c40 0x7fd0840b4550 secure :-1 s=THROTTLE_DONE pgs=1741 cs=0 l=1 rx=0x7fd0840b3080 tx=0x7fd07c0109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:45.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.914+0000 7fd083fff700 1 --2- 172.21.15.103:0/3481082001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd084146c40 0x7fd0840b4550 secure :-1 s=THROTTLE_DONE pgs=1741 cs=0 l=1 rx=0x7fd0840b3080 tx=0x7fd07c0109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:45.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.914+0000 7fd080ff9700 1 -- 172.21.15.103:0/3481082001 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07c00a4d0 con 0x7fd084146c40 2020-04-22T14:16:45.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.914+0000 7fd08a260700 1 -- 172.21.15.103:0/3481082001 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0840b49b0 con 0x7fd084146c40 2020-04-22T14:16:45.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.914+0000 7fd080ff9700 1 -- 172.21.15.103:0/3481082001 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd07c00a8f0 con 0x7fd084146c40 2020-04-22T14:16:45.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.914+0000 7fd08a260700 1 -- 172.21.15.103:0/3481082001 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd08413c6b0 con 0x7fd084146c40 2020-04-22T14:16:45.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.915+0000 7fd083fff700 1 --2- 172.21.15.103:0/3481082001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd084146c40 0x7fd0840b4550 secure :-1 s=THROTTLE_DONE pgs=1741 cs=0 l=1 rx=0x7fd0840b3080 tx=0x7fd07c0109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:45.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.915+0000 7fd08a260700 1 -- 172.21.15.103:0/3481082001 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0840b4290 con 0x7fd084146c40 2020-04-22T14:16:45.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.915+0000 7fd080ff9700 1 -- 172.21.15.103:0/3481082001 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fd07c00ab60 con 0x7fd084146c40 2020-04-22T14:16:45.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.915+0000 7fd083fff700 1 --2- 172.21.15.103:0/3481082001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd084146c40 0x7fd0840b4550 secure :-1 s=THROTTLE_DONE pgs=1741 cs=0 l=1 rx=0x7fd0840b3080 tx=0x7fd07c0109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:45.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.915+0000 7fd080ff9700 1 --2- 172.21.15.103:0/3481082001 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd06404d9a0 0x7fd06404fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:45.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.915+0000 7fd080ff9700 1 -- 172.21.15.103:0/3481082001 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5957+0+0 (secure 0 0 0) 0x7fd07c0613d0 con 0x7fd084146c40 2020-04-22T14:16:45.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.916+0000 7fd0837fe700 1 --2- 172.21.15.103:0/3481082001 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd06404d9a0 0x7fd06404fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:45.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.916+0000 7fd0837fe700 1 --2- 172.21.15.103:0/3481082001 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd06404d9a0 0x7fd06404fe60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd074002f30 tx=0x7fd07400e190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:45.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.916+0000 7fd0837fe700 1 --2- 172.21.15.103:0/3481082001 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd06404d9a0 0x7fd06404fe60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd074002f30 tx=0x7fd07400e190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:45.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.916+0000 7fd0837fe700 1 --2- 172.21.15.103:0/3481082001 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd06404d9a0 0x7fd06404fe60 secure :-1 s=READY pgs=632 cs=0 l=1 rx=0x7fd074002f30 tx=0x7fd07400e190).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:45.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.919+0000 7fd083fff700 1 --2- 172.21.15.103:0/3481082001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd084146c40 0x7fd0840b4550 secure :-1 s=THROTTLE_DONE pgs=1741 cs=0 l=1 rx=0x7fd0840b3080 tx=0x7fd07c0109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:45.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:45.919+0000 7fd080ff9700 1 -- 172.21.15.103:0/3481082001 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fd0840b4290 con 0x7fd084146c40 2020-04-22T14:16:46.111 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.108+0000 7fd08a260700 1 -- 172.21.15.103:0/3481082001 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fd0840b4230 con 0x7fd084146c40 2020-04-22T14:16:46.118 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.115+0000 7fd083fff700 1 --2- 172.21.15.103:0/3481082001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd084146c40 0x7fd0840b4550 secure :-1 s=THROTTLE_DONE pgs=1741 cs=0 l=1 rx=0x7fd0840b3080 tx=0x7fd07c0109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.118 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.115+0000 7fd080ff9700 1 -- 172.21.15.103:0/3481082001 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 21 and data pool 22 v92) v1 ==== 189+0+0 (secure 0 0 0) 0x7fd07c040010 con 0x7fd084146c40 2020-04-22T14:16:46.121 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.117+0000 7fd08a260700 1 -- 172.21.15.103:0/3481082001 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd06404d9a0 msgr2=0x7fd06404fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:46.121 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.117+0000 7fd08a260700 1 --2- 172.21.15.103:0/3481082001 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd06404d9a0 0x7fd06404fe60 secure :-1 s=READY pgs=632 cs=0 l=1 rx=0x7fd074002f30 tx=0x7fd07400e190).stop 2020-04-22T14:16:46.121 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.117+0000 7fd08a260700 1 -- 172.21.15.103:0/3481082001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd084146c40 msgr2=0x7fd0840b4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:46.121 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.117+0000 7fd08a260700 1 --2- 172.21.15.103:0/3481082001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd084146c40 0x7fd0840b4550 secure :-1 s=READY pgs=1741 cs=0 l=1 rx=0x7fd0840b3080 tx=0x7fd07c0109d0).stop 2020-04-22T14:16:46.121 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.118+0000 7fd08a260700 1 -- 172.21.15.103:0/3481082001 shutdown_connections 2020-04-22T14:16:46.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.118+0000 7fd08a260700 1 --2- 172.21.15.103:0/3481082001 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd06404d9a0 0x7fd06404fe60 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:46.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.118+0000 7fd08a260700 1 --2- 172.21.15.103:0/3481082001 >> v2:172.21.15.86:3300/0 conn(0x7fd0840ac950 0x7fd0840b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:46.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.118+0000 7fd08a260700 1 --2- 172.21.15.103:0/3481082001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd084146c40 0x7fd0840b4550 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:46.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.118+0000 7fd08a260700 1 --2- 172.21.15.103:0/3481082001 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd0840b9140 0x7fd084128360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:46.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.118+0000 7fd08a260700 1 -- 172.21.15.103:0/3481082001 >> 172.21.15.103:0/3481082001 conn(0x7fd08405b7b0 msgr2=0x7fd08413fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:46.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.118+0000 7fd08a260700 1 -- 172.21.15.103:0/3481082001 shutdown_connections 2020-04-22T14:16:46.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.119+0000 7fd08a260700 1 -- 172.21.15.103:0/3481082001 wait complete. 2020-04-22T14:16:46.129 INFO:teuthology.orchestra.run.smithi103.stderr:new fs with metadata pool 21 and data pool 22 2020-04-22T14:16:46.136 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:46.149 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:16:46.297 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.293+0000 7f8d6ab90700 1 Processor -- start 2020-04-22T14:16:46.297 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.293+0000 7f8d6ab90700 1 -- start start 2020-04-22T14:16:46.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.294+0000 7f8d6ab90700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8d6412c0d0 0x7f8d641464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:46.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.294+0000 7f8d6ab90700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d64143300 con 0x7f8d64065fe0 2020-04-22T14:16:46.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.294+0000 7f8d6ab90700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d641435a0 con 0x7f8d64063e30 2020-04-22T14:16:46.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.294+0000 7f8d6ab90700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d64143840 con 0x7f8d6412c0d0 2020-04-22T14:16:46.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.294+0000 7f8d6892c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8d6412c0d0 0x7f8d641464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:46.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.294+0000 7f8d6892c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8d6412c0d0 0x7f8d641464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56640/0 (socket says 172.21.15.103:56640) 2020-04-22T14:16:46.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.294+0000 7f8d6912d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f8d64063e30 0x7f8d640642c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48834/0 (socket says 172.21.15.103:48834) 2020-04-22T14:16:46.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.294+0000 7f8d6892c700 1 -- 172.21.15.103:0/1977724450 learned_addr learned my addr 172.21.15.103:0/1977724450 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:46.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.295+0000 7f8d6892c700 1 -- 172.21.15.103:0/1977724450 >> v1:172.21.15.103:6789/0 conn(0x7f8d64063e30 legacy=0x7f8d640642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:46.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.295+0000 7f8d6892c700 1 -- 172.21.15.103:0/1977724450 >> v1:172.21.15.86:6789/0 conn(0x7f8d64065fe0 legacy=0x7f8d6405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:46.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.295+0000 7f8d6892c700 1 -- 172.21.15.103:0/1977724450 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d6405bb50 con 0x7f8d6412c0d0 2020-04-22T14:16:46.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.295+0000 7f8d6892c700 1 --2- 172.21.15.103:0/1977724450 >> v2:172.21.15.103:3300/0 conn(0x7f8d6412c0d0 0x7f8d641464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8d640669a0 tx=0x7f8d54007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.295+0000 7f8d6892c700 1 --2- 172.21.15.103:0/1977724450 >> v2:172.21.15.103:3300/0 conn(0x7f8d6412c0d0 0x7f8d641464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8d640669a0 tx=0x7f8d54007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.295+0000 7f8d6892c700 1 --2- 172.21.15.103:0/1977724450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d6412c0d0 0x7f8d641464e0 secure :-1 s=READY pgs=1743 cs=0 l=1 rx=0x7f8d640669a0 tx=0x7f8d54007a40).ready entity=mon.1 client_cookie=49c819f539213219 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:46.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.295+0000 7f8d6892c700 1 --2- 172.21.15.103:0/1977724450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d6412c0d0 0x7f8d641464e0 secure :-1 s=THROTTLE_DONE pgs=1743 cs=0 l=1 rx=0x7f8d640669a0 tx=0x7f8d54007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.295+0000 7f8d637fe700 1 -- 172.21.15.103:0/1977724450 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d540116e0 con 0x7f8d6412c0d0 2020-04-22T14:16:46.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.295+0000 7f8d6892c700 1 --2- 172.21.15.103:0/1977724450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d6412c0d0 0x7f8d641464e0 secure :-1 s=THROTTLE_DONE pgs=1743 cs=0 l=1 rx=0x7f8d640669a0 tx=0x7f8d54007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.295+0000 7f8d637fe700 1 -- 172.21.15.103:0/1977724450 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d54011840 con 0x7f8d6412c0d0 2020-04-22T14:16:46.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.295+0000 7f8d6892c700 1 --2- 172.21.15.103:0/1977724450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d6412c0d0 0x7f8d641464e0 secure :-1 s=THROTTLE_DONE pgs=1743 cs=0 l=1 rx=0x7f8d640669a0 tx=0x7f8d54007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.295+0000 7f8d637fe700 1 -- 172.21.15.103:0/1977724450 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d54011c60 con 0x7f8d6412c0d0 2020-04-22T14:16:46.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.295+0000 7f8d6ab90700 1 -- 172.21.15.103:0/1977724450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d6412c0d0 msgr2=0x7f8d641464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:46.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.295+0000 7f8d6ab90700 1 --2- 172.21.15.103:0/1977724450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d6412c0d0 0x7f8d641464e0 secure :-1 s=READY pgs=1743 cs=0 l=1 rx=0x7f8d640669a0 tx=0x7f8d54007a40).stop 2020-04-22T14:16:46.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.295+0000 7f8d6ab90700 1 -- 172.21.15.103:0/1977724450 shutdown_connections 2020-04-22T14:16:46.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.295+0000 7f8d6ab90700 1 --2- 172.21.15.103:0/1977724450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d6412c0d0 0x7f8d641464e0 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:46.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.295+0000 7f8d6ab90700 1 -- 172.21.15.103:0/1977724450 >> 172.21.15.103:0/1977724450 conn(0x7f8d640b9160 msgr2=0x7f8d6405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:46.302 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.295+0000 7f8d6ab90700 1 -- 172.21.15.103:0/1977724450 shutdown_connections 2020-04-22T14:16:46.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.295+0000 7f8d6ab90700 1 -- 172.21.15.103:0/1977724450 wait complete. 2020-04-22T14:16:46.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.296+0000 7f8d6ab90700 1 Processor -- start 2020-04-22T14:16:46.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.296+0000 7f8d6ab90700 1 -- start start 2020-04-22T14:16:46.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.297+0000 7f8d6ab90700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8d64065fe0 0x7f8d6414ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:46.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.297+0000 7f8d6ab90700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8d6412c0d0 0x7f8d64142590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:46.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.297+0000 7f8d6ab90700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d641429f0 con 0x7f8d64063e30 2020-04-22T14:16:46.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.297+0000 7f8d6ab90700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d6414d350 con 0x7f8d64065fe0 2020-04-22T14:16:46.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.297+0000 7f8d6ab90700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6414d5f0 con 0x7f8d6412c0d0 2020-04-22T14:16:46.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.297+0000 7f8d6892c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f8d64063e30 0x7f8d6412a1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48836/0 (socket says 172.21.15.103:48836) 2020-04-22T14:16:46.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.297+0000 7f8d6892c700 1 -- 172.21.15.103:0/4125670540 learned_addr learned my addr 172.21.15.103:0/4125670540 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:46.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.297+0000 7f8d63fff700 1 --2- 172.21.15.103:0/4125670540 >> v2:172.21.15.103:3300/0 conn(0x7f8d64065fe0 0x7f8d6414ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:46.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.298+0000 7f8d6912d700 1 --2- 172.21.15.103:0/4125670540 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8d6412c0d0 0x7f8d64142590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:46.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.298+0000 7f8d63fff700 1 -- 172.21.15.103:0/4125670540 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8d6412c0d0 msgr2=0x7f8d64142590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:46.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.298+0000 7f8d63fff700 1 --2- 172.21.15.103:0/4125670540 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8d6412c0d0 0x7f8d64142590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:46.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.298+0000 7f8d63fff700 1 -- 172.21.15.103:0/4125670540 >> v1:172.21.15.103:6789/0 conn(0x7f8d64063e30 legacy=0x7f8d6412a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:46.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.298+0000 7f8d61ffb700 1 -- 172.21.15.103:0/4125670540 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2666658015 0 0) 0x7f8d641429f0 con 0x7f8d64063e30 2020-04-22T14:16:46.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.298+0000 7f8d63fff700 1 -- 172.21.15.103:0/4125670540 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d641488b0 con 0x7f8d64065fe0 2020-04-22T14:16:46.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.298+0000 7f8d63fff700 1 --2- 172.21.15.103:0/4125670540 >> v2:172.21.15.103:3300/0 conn(0x7f8d64065fe0 0x7f8d6414ada0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8d58001f50 tx=0x7f8d58002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.298+0000 7f8d63fff700 1 --2- 172.21.15.103:0/4125670540 >> v2:172.21.15.103:3300/0 conn(0x7f8d64065fe0 0x7f8d6414ada0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8d58001f50 tx=0x7f8d58002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.298+0000 7f8d63fff700 1 --2- 172.21.15.103:0/4125670540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d64065fe0 0x7f8d6414ada0 secure :-1 s=READY pgs=1745 cs=0 l=1 rx=0x7f8d58001f50 tx=0x7f8d58002e60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:46.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.298+0000 7f8d63fff700 1 --2- 172.21.15.103:0/4125670540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d64065fe0 0x7f8d6414ada0 secure :-1 s=THROTTLE_DONE pgs=1745 cs=0 l=1 rx=0x7f8d58001f50 tx=0x7f8d58002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.298+0000 7f8d61ffb700 1 -- 172.21.15.103:0/4125670540 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d5800cd10 con 0x7f8d64065fe0 2020-04-22T14:16:46.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.298+0000 7f8d63fff700 1 --2- 172.21.15.103:0/4125670540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d64065fe0 0x7f8d6414ada0 secure :-1 s=THROTTLE_DONE pgs=1745 cs=0 l=1 rx=0x7f8d58001f50 tx=0x7f8d58002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.298+0000 7f8d61ffb700 1 -- 172.21.15.103:0/4125670540 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d5800e180 con 0x7f8d64065fe0 2020-04-22T14:16:46.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.298+0000 7f8d63fff700 1 --2- 172.21.15.103:0/4125670540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d64065fe0 0x7f8d6414ada0 secure :-1 s=THROTTLE_DONE pgs=1745 cs=0 l=1 rx=0x7f8d58001f50 tx=0x7f8d58002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.298+0000 7f8d6ab90700 1 -- 172.21.15.103:0/4125670540 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d6412a8d0 con 0x7f8d64065fe0 2020-04-22T14:16:46.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.298+0000 7f8d61ffb700 1 -- 172.21.15.103:0/4125670540 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d5800e560 con 0x7f8d64065fe0 2020-04-22T14:16:46.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.298+0000 7f8d6ab90700 1 -- 172.21.15.103:0/4125670540 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d6414cf90 con 0x7f8d64065fe0 2020-04-22T14:16:46.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.299+0000 7f8d63fff700 1 --2- 172.21.15.103:0/4125670540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d64065fe0 0x7f8d6414ada0 secure :-1 s=THROTTLE_DONE pgs=1745 cs=0 l=1 rx=0x7f8d58001f50 tx=0x7f8d58002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.299+0000 7f8d6ab90700 1 -- 172.21.15.103:0/4125670540 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d64056c90 con 0x7f8d64065fe0 2020-04-22T14:16:46.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.299+0000 7f8d61ffb700 1 -- 172.21.15.103:0/4125670540 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f8d5800e7e0 con 0x7f8d64065fe0 2020-04-22T14:16:46.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.299+0000 7f8d63fff700 1 --2- 172.21.15.103:0/4125670540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d64065fe0 0x7f8d6414ada0 secure :-1 s=THROTTLE_DONE pgs=1745 cs=0 l=1 rx=0x7f8d58001f50 tx=0x7f8d58002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.299+0000 7f8d61ffb700 1 --2- 172.21.15.103:0/4125670540 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8d4404d880 0x7f8d4404fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:46.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.299+0000 7f8d61ffb700 1 -- 172.21.15.103:0/4125670540 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8d58061110 con 0x7f8d64065fe0 2020-04-22T14:16:46.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.299+0000 7f8d6892c700 1 --2- 172.21.15.103:0/4125670540 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8d4404d880 0x7f8d4404fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:46.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.300+0000 7f8d6892c700 1 --2- 172.21.15.103:0/4125670540 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8d4404d880 0x7f8d4404fd40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8d54008320 tx=0x7f8d54007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.300+0000 7f8d6892c700 1 --2- 172.21.15.103:0/4125670540 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8d4404d880 0x7f8d4404fd40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8d54008320 tx=0x7f8d54007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.300+0000 7f8d6892c700 1 --2- 172.21.15.103:0/4125670540 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8d4404d880 0x7f8d4404fd40 secure :-1 s=READY pgs=633 cs=0 l=1 rx=0x7f8d54008320 tx=0x7f8d54007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:46.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.303+0000 7f8d63fff700 1 --2- 172.21.15.103:0/4125670540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d64065fe0 0x7f8d6414ada0 secure :-1 s=THROTTLE_DONE pgs=1745 cs=0 l=1 rx=0x7f8d58001f50 tx=0x7f8d58002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.303+0000 7f8d61ffb700 1 -- 172.21.15.103:0/4125670540 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f8d5803c550 con 0x7f8d64065fe0 2020-04-22T14:16:46.452 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.449+0000 7f8d6ab90700 1 -- 172.21.15.103:0/4125670540 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d64147360 con 0x7f8d64065fe0 2020-04-22T14:16:46.453 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.450+0000 7f8d63fff700 1 --2- 172.21.15.103:0/4125670540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d64065fe0 0x7f8d6414ada0 secure :-1 s=THROTTLE_DONE pgs=1745 cs=0 l=1 rx=0x7f8d58001f50 tx=0x7f8d58002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.453 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.450+0000 7f8d61ffb700 1 -- 172.21.15.103:0/4125670540 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+16116 (secure 0 0 0) 0x7f8d5803fb70 con 0x7f8d64065fe0 2020-04-22T14:16:46.453 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:16:46.453 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":123,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:16:46.111345+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:16:44.031424+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2020-04-22T14:16:45.073910+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:16:46.455 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.451+0000 7f8d6ab90700 1 -- 172.21.15.103:0/4125670540 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8d4404d880 msgr2=0x7f8d4404fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:46.455 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.451+0000 7f8d6ab90700 1 --2- 172.21.15.103:0/4125670540 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8d4404d880 0x7f8d4404fd40 secure :-1 s=READY pgs=633 cs=0 l=1 rx=0x7f8d54008320 tx=0x7f8d54007a40).stop 2020-04-22T14:16:46.455 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.451+0000 7f8d6ab90700 1 -- 172.21.15.103:0/4125670540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d64065fe0 msgr2=0x7f8d6414ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:46.455 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.451+0000 7f8d6ab90700 1 --2- 172.21.15.103:0/4125670540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d64065fe0 0x7f8d6414ada0 secure :-1 s=READY pgs=1745 cs=0 l=1 rx=0x7f8d58001f50 tx=0x7f8d58002e60).stop 2020-04-22T14:16:46.457 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.451+0000 7f8d6ab90700 1 -- 172.21.15.103:0/4125670540 shutdown_connections 2020-04-22T14:16:46.457 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.451+0000 7f8d6ab90700 1 --2- 172.21.15.103:0/4125670540 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8d4404d880 0x7f8d4404fd40 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:46.457 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.451+0000 7f8d6ab90700 1 --2- 172.21.15.103:0/4125670540 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8d6412c0d0 0x7f8d64142590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:46.457 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.451+0000 7f8d6ab90700 1 --2- 172.21.15.103:0/4125670540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d64065fe0 0x7f8d6414ada0 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:46.457 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.451+0000 7f8d6ab90700 1 -- 172.21.15.103:0/4125670540 >> 172.21.15.103:0/4125670540 conn(0x7f8d640b9160 msgr2=0x7f8d64061540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:46.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.451+0000 7f8d6ab90700 1 -- 172.21.15.103:0/4125670540 shutdown_connections 2020-04-22T14:16:46.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.451+0000 7f8d6ab90700 1 -- 172.21.15.103:0/4125670540 wait complete. 2020-04-22T14:16:46.466 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:46.479 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:16:46.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.623+0000 7fa1769ce700 1 Processor -- start 2020-04-22T14:16:46.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.624+0000 7fa1769ce700 1 -- start start 2020-04-22T14:16:46.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.624+0000 7fa1769ce700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa1700620a0 0x7fa170142e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:46.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.624+0000 7fa1769ce700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa1700ad900 0x7fa1700add90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:46.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.624+0000 7fa1769ce700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa170143810 con 0x7fa170143280 2020-04-22T14:16:46.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.624+0000 7fa1769ce700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa170143ab0 con 0x7fa1700ad900 2020-04-22T14:16:46.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.624+0000 7fa1769ce700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa170143d50 con 0x7fa1700620a0 2020-04-22T14:16:46.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.625+0000 7fa1759cc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa1700620a0 0x7fa170142e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:46.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.625+0000 7fa1759cc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa1700620a0 0x7fa170142e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56654/0 (socket says 172.21.15.103:56654) 2020-04-22T14:16:46.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.625+0000 7fa1759cc700 1 -- 172.21.15.103:0/4188127313 learned_addr learned my addr 172.21.15.103:0/4188127313 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:46.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.625+0000 7fa1759cc700 1 -- 172.21.15.103:0/4188127313 >> v2:172.21.15.86:3300/0 conn(0x7fa1700ad900 msgr2=0x7fa1700add90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:46.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.625+0000 7fa1761cd700 1 --2- 172.21.15.103:0/4188127313 >> v2:172.21.15.86:3300/0 conn(0x7fa1700ad900 0x7fa1700add90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:46.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.625+0000 7fa1759cc700 1 --2- 172.21.15.103:0/4188127313 >> v2:172.21.15.86:3300/0 conn(0x7fa1700ad900 0x7fa1700add90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:46.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.625+0000 7fa1759cc700 1 -- 172.21.15.103:0/4188127313 >> v1:172.21.15.86:6789/0 conn(0x7fa170143280 legacy=0x7fa170146ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:46.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.625+0000 7fa1759cc700 1 -- 172.21.15.103:0/4188127313 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa170062480 con 0x7fa1700620a0 2020-04-22T14:16:46.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.625+0000 7fa1759cc700 1 --2- 172.21.15.103:0/4188127313 >> v2:172.21.15.103:3300/0 conn(0x7fa1700620a0 0x7fa170142e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa1700ad7e0 tx=0x7fa16c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.625+0000 7fa1759cc700 1 --2- 172.21.15.103:0/4188127313 >> v2:172.21.15.103:3300/0 conn(0x7fa1700620a0 0x7fa170142e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa1700ad7e0 tx=0x7fa16c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.625+0000 7fa1759cc700 1 --2- 172.21.15.103:0/4188127313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1700620a0 0x7fa170142e20 secure :-1 s=READY pgs=1746 cs=0 l=1 rx=0x7fa1700ad7e0 tx=0x7fa16c007a40).ready entity=mon.1 client_cookie=cd7cb822384a0318 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:46.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.625+0000 7fa1759cc700 1 --2- 172.21.15.103:0/4188127313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1700620a0 0x7fa170142e20 secure :-1 s=THROTTLE_DONE pgs=1746 cs=0 l=1 rx=0x7fa1700ad7e0 tx=0x7fa16c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.625+0000 7fa1749ca700 1 -- 172.21.15.103:0/4188127313 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa16c008e10 con 0x7fa1700620a0 2020-04-22T14:16:46.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.625+0000 7fa1759cc700 1 --2- 172.21.15.103:0/4188127313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1700620a0 0x7fa170142e20 secure :-1 s=THROTTLE_DONE pgs=1746 cs=0 l=1 rx=0x7fa1700ad7e0 tx=0x7fa16c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.625+0000 7fa1749ca700 1 -- 172.21.15.103:0/4188127313 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa16c010780 con 0x7fa1700620a0 2020-04-22T14:16:46.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.625+0000 7fa1759cc700 1 --2- 172.21.15.103:0/4188127313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1700620a0 0x7fa170142e20 secure :-1 s=THROTTLE_DONE pgs=1746 cs=0 l=1 rx=0x7fa1700ad7e0 tx=0x7fa16c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.625+0000 7fa1749ca700 1 -- 172.21.15.103:0/4188127313 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa16c010b20 con 0x7fa1700620a0 2020-04-22T14:16:46.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.625+0000 7fa1769ce700 1 -- 172.21.15.103:0/4188127313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1700620a0 msgr2=0x7fa170142e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:46.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.625+0000 7fa1769ce700 1 --2- 172.21.15.103:0/4188127313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1700620a0 0x7fa170142e20 secure :-1 s=READY pgs=1746 cs=0 l=1 rx=0x7fa1700ad7e0 tx=0x7fa16c007a40).stop 2020-04-22T14:16:46.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.626+0000 7fa1769ce700 1 -- 172.21.15.103:0/4188127313 shutdown_connections 2020-04-22T14:16:46.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.626+0000 7fa1769ce700 1 --2- 172.21.15.103:0/4188127313 >> v2:172.21.15.86:3300/0 conn(0x7fa1700ad900 0x7fa1700add90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:46.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.626+0000 7fa1769ce700 1 --2- 172.21.15.103:0/4188127313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1700620a0 0x7fa170142e20 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:46.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.626+0000 7fa1769ce700 1 -- 172.21.15.103:0/4188127313 >> 172.21.15.103:0/4188127313 conn(0x7fa17005b7c0 msgr2=0x7fa170061610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:46.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.626+0000 7fa1769ce700 1 -- 172.21.15.103:0/4188127313 shutdown_connections 2020-04-22T14:16:46.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.626+0000 7fa1769ce700 1 -- 172.21.15.103:0/4188127313 wait complete. 2020-04-22T14:16:46.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.627+0000 7fa1769ce700 1 Processor -- start 2020-04-22T14:16:46.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.627+0000 7fa1769ce700 1 -- start start 2020-04-22T14:16:46.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.627+0000 7fa1769ce700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa1700620a0 0x7fa170062d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:46.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.627+0000 7fa1769ce700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa170142850 con 0x7fa170143280 2020-04-22T14:16:46.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.627+0000 7fa1769ce700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa170142ab0 con 0x7fa1700ad900 2020-04-22T14:16:46.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.627+0000 7fa1769ce700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa170142d50 con 0x7fa1700620a0 2020-04-22T14:16:46.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.627+0000 7fa1751cb700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa1700ad900 0x7fa17012d1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48850/0 (socket says 172.21.15.103:48850) 2020-04-22T14:16:46.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.627+0000 7fa1751cb700 1 -- 172.21.15.103:0/2891355676 learned_addr learned my addr 172.21.15.103:0/2891355676 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:46.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.628+0000 7fa1759cc700 1 --2- 172.21.15.103:0/2891355676 >> v2:172.21.15.86:3300/0 conn(0x7fa1700620a0 0x7fa170062d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:46.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.628+0000 7fa15effd700 1 -- 172.21.15.103:0/2891355676 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3127345026 0 0) 0x7fa170142ab0 con 0x7fa1700ad900 2020-04-22T14:16:46.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.628+0000 7fa15effd700 1 -- 172.21.15.103:0/2891355676 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa150002fe0 con 0x7fa1700ad900 2020-04-22T14:16:46.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.628+0000 7fa1759cc700 1 -- 172.21.15.103:0/2891355676 >> v1:172.21.15.103:6789/0 conn(0x7fa1700ad900 legacy=0x7fa17012d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:46.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.628+0000 7fa15effd700 1 -- 172.21.15.103:0/2891355676 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1365176877 0 0) 0x7fa150002fe0 con 0x7fa1700ad900 2020-04-22T14:16:46.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.628+0000 7fa1759cc700 1 -- 172.21.15.103:0/2891355676 >> v1:172.21.15.86:6789/0 conn(0x7fa170143280 legacy=0x7fa1701575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:46.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.628+0000 7fa1759cc700 1 -- 172.21.15.103:0/2891355676 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa170142ff0 con 0x7fa1700620a0 2020-04-22T14:16:46.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.628+0000 7fa1759cc700 1 --2- 172.21.15.103:0/2891355676 >> v2:172.21.15.86:3300/0 conn(0x7fa1700620a0 0x7fa170062d30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa168007aa0 tx=0x7fa16c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.628+0000 7fa1759cc700 1 --2- 172.21.15.103:0/2891355676 >> v2:172.21.15.86:3300/0 conn(0x7fa1700620a0 0x7fa170062d30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa168007aa0 tx=0x7fa16c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.628+0000 7fa1759cc700 1 --2- 172.21.15.103:0/2891355676 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1700620a0 0x7fa170062d30 secure :-1 s=READY pgs=931 cs=0 l=1 rx=0x7fa168007aa0 tx=0x7fa16c007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:46.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.628+0000 7fa1759cc700 1 --2- 172.21.15.103:0/2891355676 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1700620a0 0x7fa170062d30 secure :-1 s=THROTTLE_DONE pgs=931 cs=0 l=1 rx=0x7fa168007aa0 tx=0x7fa16c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.628+0000 7fa15effd700 1 -- 172.21.15.103:0/2891355676 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa160001900 con 0x7fa1700620a0 2020-04-22T14:16:46.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.628+0000 7fa1759cc700 1 --2- 172.21.15.103:0/2891355676 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1700620a0 0x7fa170062d30 secure :-1 s=THROTTLE_DONE pgs=931 cs=0 l=1 rx=0x7fa168007aa0 tx=0x7fa16c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.628+0000 7fa15effd700 1 -- 172.21.15.103:0/2891355676 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa16c00f580 con 0x7fa1700620a0 2020-04-22T14:16:46.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.628+0000 7fa1759cc700 1 --2- 172.21.15.103:0/2891355676 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1700620a0 0x7fa170062d30 secure :-1 s=THROTTLE_DONE pgs=931 cs=0 l=1 rx=0x7fa168007aa0 tx=0x7fa16c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.628+0000 7fa1769ce700 1 -- 172.21.15.103:0/2891355676 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa170130590 con 0x7fa1700620a0 2020-04-22T14:16:46.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.628+0000 7fa15effd700 1 -- 172.21.15.103:0/2891355676 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa16c00f8e0 con 0x7fa1700620a0 2020-04-22T14:16:46.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.628+0000 7fa1769ce700 1 -- 172.21.15.103:0/2891355676 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa170157e90 con 0x7fa1700620a0 2020-04-22T14:16:46.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.629+0000 7fa1759cc700 1 --2- 172.21.15.103:0/2891355676 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1700620a0 0x7fa170062d30 secure :-1 s=THROTTLE_DONE pgs=931 cs=0 l=1 rx=0x7fa168007aa0 tx=0x7fa16c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.629+0000 7fa1769ce700 1 -- 172.21.15.103:0/2891355676 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa170158360 con 0x7fa1700620a0 2020-04-22T14:16:46.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.629+0000 7fa15effd700 1 -- 172.21.15.103:0/2891355676 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fa16c007170 con 0x7fa1700620a0 2020-04-22T14:16:46.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.629+0000 7fa1759cc700 1 --2- 172.21.15.103:0/2891355676 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1700620a0 0x7fa170062d30 secure :-1 s=THROTTLE_DONE pgs=931 cs=0 l=1 rx=0x7fa168007aa0 tx=0x7fa16c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.630+0000 7fa15effd700 1 --2- 172.21.15.103:0/2891355676 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa15004dc00 0x7fa1500500c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:46.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.630+0000 7fa15effd700 1 -- 172.21.15.103:0/2891355676 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa16c060ed0 con 0x7fa1700620a0 2020-04-22T14:16:46.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.630+0000 7fa1751cb700 1 --2- 172.21.15.103:0/2891355676 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa15004dc00 0x7fa1500500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:46.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.630+0000 7fa1751cb700 1 --2- 172.21.15.103:0/2891355676 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa15004dc00 0x7fa1500500c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa160001a60 tx=0x7fa1600094f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.630+0000 7fa1751cb700 1 --2- 172.21.15.103:0/2891355676 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa15004dc00 0x7fa1500500c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa160001a60 tx=0x7fa1600094f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.630+0000 7fa1751cb700 1 --2- 172.21.15.103:0/2891355676 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa15004dc00 0x7fa1500500c0 secure :-1 s=READY pgs=634 cs=0 l=1 rx=0x7fa160001a60 tx=0x7fa1600094f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:46.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.634+0000 7fa1759cc700 1 --2- 172.21.15.103:0/2891355676 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1700620a0 0x7fa170062d30 secure :-1 s=THROTTLE_DONE pgs=931 cs=0 l=1 rx=0x7fa168007aa0 tx=0x7fa16c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.634+0000 7fa15effd700 1 -- 172.21.15.103:0/2891355676 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fa16c03c370 con 0x7fa1700620a0 2020-04-22T14:16:46.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.780+0000 7fa1769ce700 1 -- 172.21.15.103:0/2891355676 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1700675c0 con 0x7fa1700620a0 2020-04-22T14:16:46.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.782+0000 7fa1759cc700 1 --2- 172.21.15.103:0/2891355676 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1700620a0 0x7fa170062d30 secure :-1 s=THROTTLE_DONE pgs=931 cs=0 l=1 rx=0x7fa168007aa0 tx=0x7fa16c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.782+0000 7fa15effd700 1 -- 172.21.15.103:0/2891355676 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+16116 (secure 0 0 0) 0x7fa1700675c0 con 0x7fa1700620a0 2020-04-22T14:16:46.785 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:16:46.785 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":123,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:16:46.111345+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:16:44.031424+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2020-04-22T14:16:45.073910+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:16:46.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.783+0000 7fa1769ce700 1 -- 172.21.15.103:0/2891355676 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa15004dc00 msgr2=0x7fa1500500c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:46.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.783+0000 7fa1769ce700 1 --2- 172.21.15.103:0/2891355676 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa15004dc00 0x7fa1500500c0 secure :-1 s=READY pgs=634 cs=0 l=1 rx=0x7fa160001a60 tx=0x7fa1600094f0).stop 2020-04-22T14:16:46.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.783+0000 7fa1769ce700 1 -- 172.21.15.103:0/2891355676 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1700620a0 msgr2=0x7fa170062d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:46.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.783+0000 7fa1769ce700 1 --2- 172.21.15.103:0/2891355676 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1700620a0 0x7fa170062d30 secure :-1 s=READY pgs=931 cs=0 l=1 rx=0x7fa168007aa0 tx=0x7fa16c007a40).stop 2020-04-22T14:16:46.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.783+0000 7fa1769ce700 1 -- 172.21.15.103:0/2891355676 shutdown_connections 2020-04-22T14:16:46.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.783+0000 7fa1769ce700 1 --2- 172.21.15.103:0/2891355676 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa15004dc00 0x7fa1500500c0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:46.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.783+0000 7fa1769ce700 1 --2- 172.21.15.103:0/2891355676 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1700620a0 0x7fa170062d30 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:46.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.783+0000 7fa1769ce700 1 -- 172.21.15.103:0/2891355676 >> 172.21.15.103:0/2891355676 conn(0x7fa17005b7c0 msgr2=0x7fa1700b4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:46.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.783+0000 7fa1769ce700 1 -- 172.21.15.103:0/2891355676 shutdown_connections 2020-04-22T14:16:46.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.783+0000 7fa1769ce700 1 -- 172.21.15.103:0/2891355676 wait complete. 2020-04-22T14:16:46.798 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:46.812 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-04-22T14:16:46.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.959+0000 7fb9dfd79700 1 Processor -- start 2020-04-22T14:16:46.962 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.959+0000 7fb9dfd79700 1 -- start start 2020-04-22T14:16:46.965 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.959+0000 7fb9dfd79700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb9d80b9140 0x7fb9d812b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:46.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.959+0000 7fb9dfd79700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9d812b670 0x7fb9d8143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:46.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.959+0000 7fb9dfd79700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9d81467e0 con 0x7fb9d80ac950 2020-04-22T14:16:46.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.959+0000 7fb9dfd79700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9d80602f0 con 0x7fb9d80b9140 2020-04-22T14:16:46.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.959+0000 7fb9dfd79700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d8060050 con 0x7fb9d812b670 2020-04-22T14:16:46.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.960+0000 7fb9de316700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9d812b670 0x7fb9d8143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:46.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.960+0000 7fb9ddb15700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb9d80b9140 0x7fb9d812b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:46.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.960+0000 7fb9ddb15700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb9d80b9140 0x7fb9d812b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:53900/0 (socket says 172.21.15.103:53900) 2020-04-22T14:16:46.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.960+0000 7fb9de316700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9d812b670 0x7fb9d8143090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:41446/0 (socket says 172.21.15.103:41446) 2020-04-22T14:16:46.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.960+0000 7fb9ddb15700 1 -- 172.21.15.103:0/605863972 learned_addr learned my addr 172.21.15.103:0/605863972 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:46.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.960+0000 7fb9dd314700 1 --1- 172.21.15.103:0/605863972 >> v1:172.21.15.86:6789/0 conn(0x7fb9d80ac950 0x7fb9d8146c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:37782/0 (socket says 172.21.15.103:37782) 2020-04-22T14:16:46.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.960+0000 7fb9ddb15700 1 -- 172.21.15.103:0/605863972 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9d812b670 msgr2=0x7fb9d8143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:46.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.960+0000 7fb9ddb15700 1 --2- 172.21.15.103:0/605863972 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9d812b670 0x7fb9d8143090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:46.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.960+0000 7fb9ddb15700 1 -- 172.21.15.103:0/605863972 >> v1:172.21.15.86:6789/0 conn(0x7fb9d80ac950 legacy=0x7fb9d8146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:46.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.960+0000 7fb9ddb15700 1 -- 172.21.15.103:0/605863972 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d80b9520 con 0x7fb9d80b9140 2020-04-22T14:16:46.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.960+0000 7fb9dcb13700 1 -- 172.21.15.103:0/605863972 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1524413842 0 0) 0x7fb9d81467e0 con 0x7fb9d80ac950 2020-04-22T14:16:46.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.960+0000 7fb9de316700 1 --2- 172.21.15.103:0/605863972 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9d812b670 0x7fb9d8143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:16:46.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.960+0000 7fb9ddb15700 1 --2- 172.21.15.103:0/605863972 >> v2:172.21.15.86:3300/0 conn(0x7fb9d80b9140 0x7fb9d812b210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb9c8002f30 tx=0x7fb9c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.960+0000 7fb9ddb15700 1 --2- 172.21.15.103:0/605863972 >> v2:172.21.15.86:3300/0 conn(0x7fb9d80b9140 0x7fb9d812b210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb9c8002f30 tx=0x7fb9c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.960+0000 7fb9ddb15700 1 --2- 172.21.15.103:0/605863972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9d80b9140 0x7fb9d812b210 secure :-1 s=READY pgs=933 cs=0 l=1 rx=0x7fb9c8002f30 tx=0x7fb9c8007a40).ready entity=mon.0 client_cookie=9b09e3b560641d8a server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:46.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.960+0000 7fb9ddb15700 1 --2- 172.21.15.103:0/605863972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9d80b9140 0x7fb9d812b210 secure :-1 s=THROTTLE_DONE pgs=933 cs=0 l=1 rx=0x7fb9c8002f30 tx=0x7fb9c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.960+0000 7fb9dcb13700 1 -- 172.21.15.103:0/605863972 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9c8011670 con 0x7fb9d80b9140 2020-04-22T14:16:46.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.960+0000 7fb9ddb15700 1 --2- 172.21.15.103:0/605863972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9d80b9140 0x7fb9d812b210 secure :-1 s=THROTTLE_DONE pgs=933 cs=0 l=1 rx=0x7fb9c8002f30 tx=0x7fb9c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.960+0000 7fb9dcb13700 1 -- 172.21.15.103:0/605863972 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c8011810 con 0x7fb9d80b9140 2020-04-22T14:16:46.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.960+0000 7fb9ddb15700 1 --2- 172.21.15.103:0/605863972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9d80b9140 0x7fb9d812b210 secure :-1 s=THROTTLE_DONE pgs=933 cs=0 l=1 rx=0x7fb9c8002f30 tx=0x7fb9c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.960+0000 7fb9dcb13700 1 -- 172.21.15.103:0/605863972 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9c8011bf0 con 0x7fb9d80b9140 2020-04-22T14:16:46.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.960+0000 7fb9dfd79700 1 -- 172.21.15.103:0/605863972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9d80b9140 msgr2=0x7fb9d812b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:46.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.960+0000 7fb9dfd79700 1 --2- 172.21.15.103:0/605863972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9d80b9140 0x7fb9d812b210 secure :-1 s=READY pgs=933 cs=0 l=1 rx=0x7fb9c8002f30 tx=0x7fb9c8007a40).stop 2020-04-22T14:16:46.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.961+0000 7fb9dfd79700 1 -- 172.21.15.103:0/605863972 shutdown_connections 2020-04-22T14:16:46.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.961+0000 7fb9dfd79700 1 --2- 172.21.15.103:0/605863972 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9d812b670 0x7fb9d8143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:46.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.961+0000 7fb9dfd79700 1 --2- 172.21.15.103:0/605863972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9d80b9140 0x7fb9d812b210 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:46.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.961+0000 7fb9dfd79700 1 -- 172.21.15.103:0/605863972 >> 172.21.15.103:0/605863972 conn(0x7fb9d805b7b0 msgr2=0x7fb9d80b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:46.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.961+0000 7fb9dfd79700 1 -- 172.21.15.103:0/605863972 shutdown_connections 2020-04-22T14:16:46.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.961+0000 7fb9dfd79700 1 -- 172.21.15.103:0/605863972 wait complete. 2020-04-22T14:16:46.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.962+0000 7fb9dfd79700 1 Processor -- start 2020-04-22T14:16:46.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.962+0000 7fb9dfd79700 1 -- start start 2020-04-22T14:16:46.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.963+0000 7fb9dfd79700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9d80b9140 0x7fb9d81556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:46.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.963+0000 7fb9dfd79700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9d81518f0 con 0x7fb9d812b670 2020-04-22T14:16:46.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.963+0000 7fb9dfd79700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9d8151b90 con 0x7fb9d80ac950 2020-04-22T14:16:46.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.963+0000 7fb9dfd79700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d8152740 con 0x7fb9d80b9140 2020-04-22T14:16:46.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.963+0000 7fb9ddb15700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb9d80ac950 0x7fb9d8152030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48860/0 (socket says 172.21.15.103:48860) 2020-04-22T14:16:46.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.963+0000 7fb9ddb15700 1 -- 172.21.15.103:0/3616426372 learned_addr learned my addr 172.21.15.103:0/3616426372 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:46.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.963+0000 7fb9dd314700 1 --2- 172.21.15.103:0/3616426372 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9d80b9140 0x7fb9d81556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:46.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.963+0000 7fb9c6ffd700 1 -- 172.21.15.103:0/3616426372 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1263105964 0 0) 0x7fb9d8151b90 con 0x7fb9d80ac950 2020-04-22T14:16:46.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.963+0000 7fb9c6ffd700 1 -- 172.21.15.103:0/3616426372 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9b8002fe0 con 0x7fb9d80ac950 2020-04-22T14:16:46.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.963+0000 7fb9c6ffd700 1 -- 172.21.15.103:0/3616426372 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1591567133 0 0) 0x7fb9d81518f0 con 0x7fb9d812b670 2020-04-22T14:16:46.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.963+0000 7fb9c6ffd700 1 -- 172.21.15.103:0/3616426372 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9d8151b90 con 0x7fb9d812b670 2020-04-22T14:16:46.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.963+0000 7fb9c6ffd700 1 -- 172.21.15.103:0/3616426372 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3680122711 0 0) 0x7fb9b8002fe0 con 0x7fb9d80ac950 2020-04-22T14:16:46.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.963+0000 7fb9dd314700 1 -- 172.21.15.103:0/3616426372 >> v1:172.21.15.103:6789/0 conn(0x7fb9d80ac950 legacy=0x7fb9d8152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:46.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.963+0000 7fb9dd314700 1 -- 172.21.15.103:0/3616426372 >> v1:172.21.15.86:6789/0 conn(0x7fb9d812b670 legacy=0x7fb9d8150bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:46.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.963+0000 7fb9dd314700 1 -- 172.21.15.103:0/3616426372 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d8143df0 con 0x7fb9d80b9140 2020-04-22T14:16:46.976 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.963+0000 7fb9dd314700 1 --2- 172.21.15.103:0/3616426372 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9d80b9140 0x7fb9d81556e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb9c8000b80 tx=0x7fb9d4001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.963+0000 7fb9dd314700 1 --2- 172.21.15.103:0/3616426372 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9d80b9140 0x7fb9d81556e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb9c8000b80 tx=0x7fb9d4001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.963+0000 7fb9dd314700 1 --2- 172.21.15.103:0/3616426372 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9d80b9140 0x7fb9d81556e0 secure :-1 s=READY pgs=169 cs=0 l=1 rx=0x7fb9c8000b80 tx=0x7fb9d4001e40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:46.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.963+0000 7fb9dd314700 1 --2- 172.21.15.103:0/3616426372 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9d80b9140 0x7fb9d81556e0 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7fb9c8000b80 tx=0x7fb9d4001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.963+0000 7fb9c6ffd700 1 -- 172.21.15.103:0/3616426372 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9c8011e70 con 0x7fb9d80b9140 2020-04-22T14:16:46.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.963+0000 7fb9dd314700 1 --2- 172.21.15.103:0/3616426372 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9d80b9140 0x7fb9d81556e0 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7fb9c8000b80 tx=0x7fb9d4001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.963+0000 7fb9dd314700 1 --2- 172.21.15.103:0/3616426372 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9d80b9140 0x7fb9d81556e0 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7fb9c8000b80 tx=0x7fb9d4001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.963+0000 7fb9c6ffd700 1 -- 172.21.15.103:0/3616426372 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d4011370 con 0x7fb9d80b9140 2020-04-22T14:16:46.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.963+0000 7fb9c6ffd700 1 -- 172.21.15.103:0/3616426372 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9d40116d0 con 0x7fb9d80b9140 2020-04-22T14:16:46.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.963+0000 7fb9dfd79700 1 -- 172.21.15.103:0/3616426372 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9d8063070 con 0x7fb9d80b9140 2020-04-22T14:16:46.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.964+0000 7fb9dfd79700 1 -- 172.21.15.103:0/3616426372 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9d81512d0 con 0x7fb9d80b9140 2020-04-22T14:16:46.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.964+0000 7fb9dd314700 1 --2- 172.21.15.103:0/3616426372 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9d80b9140 0x7fb9d81556e0 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7fb9c8000b80 tx=0x7fb9d4001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.965+0000 7fb9c6ffd700 1 -- 172.21.15.103:0/3616426372 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fb9d40118d0 con 0x7fb9d80b9140 2020-04-22T14:16:46.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.965+0000 7fb9dfd79700 1 -- 172.21.15.103:0/3616426372 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9d8151d20 con 0x7fb9d80b9140 2020-04-22T14:16:46.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.965+0000 7fb9dd314700 1 --2- 172.21.15.103:0/3616426372 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9d80b9140 0x7fb9d81556e0 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7fb9c8000b80 tx=0x7fb9d4001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.965+0000 7fb9c6ffd700 1 --2- 172.21.15.103:0/3616426372 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb9b804ddb0 0x7fb9b8050270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:46.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.965+0000 7fb9c6ffd700 1 -- 172.21.15.103:0/3616426372 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb9d4060aa0 con 0x7fb9d80b9140 2020-04-22T14:16:46.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.965+0000 7fb9ddb15700 1 --2- 172.21.15.103:0/3616426372 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb9b804ddb0 0x7fb9b8050270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:46.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.965+0000 7fb9ddb15700 1 --2- 172.21.15.103:0/3616426372 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb9b804ddb0 0x7fb9b8050270 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb9c8007aa0 tx=0x7fb9c8008f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.965+0000 7fb9ddb15700 1 --2- 172.21.15.103:0/3616426372 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb9b804ddb0 0x7fb9b8050270 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb9c8007aa0 tx=0x7fb9c8008f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.965+0000 7fb9ddb15700 1 --2- 172.21.15.103:0/3616426372 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb9b804ddb0 0x7fb9b8050270 secure :-1 s=READY pgs=635 cs=0 l=1 rx=0x7fb9c8007aa0 tx=0x7fb9c8008f80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:46.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.969+0000 7fb9dd314700 1 --2- 172.21.15.103:0/3616426372 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9d80b9140 0x7fb9d81556e0 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7fb9c8000b80 tx=0x7fb9d4001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:46.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:46.969+0000 7fb9c6ffd700 1 -- 172.21.15.103:0/3616426372 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fb9d403bee0 con 0x7fb9d80b9140 2020-04-22T14:16:47.162 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:47.158+0000 7fb9dfd79700 1 -- 172.21.15.103:0/3616426372 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb9d8056c90 con 0x7fb9d80b9140 2020-04-22T14:16:47.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:47.964+0000 7fb9dd314700 1 --2- 172.21.15.103:0/3616426372 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9d80b9140 0x7fb9d81556e0 secure :-1 s=READY pgs=169 cs=0 l=1 rx=0x7fb9c8000b80 tx=0x7fb9d4001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:48.120 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.118+0000 7fb9dd314700 1 --2- 172.21.15.103:0/3616426372 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9d80b9140 0x7fb9d81556e0 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7fb9c8000b80 tx=0x7fb9d4001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:48.120 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.118+0000 7fb9c6ffd700 1 -- 172.21.15.103:0/3616426372 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v94) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb9d403f500 con 0x7fb9d80b9140 2020-04-22T14:16:48.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.120+0000 7fb9dfd79700 1 -- 172.21.15.103:0/3616426372 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb9b804ddb0 msgr2=0x7fb9b8050270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:48.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.120+0000 7fb9dfd79700 1 --2- 172.21.15.103:0/3616426372 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb9b804ddb0 0x7fb9b8050270 secure :-1 s=READY pgs=635 cs=0 l=1 rx=0x7fb9c8007aa0 tx=0x7fb9c8008f80).stop 2020-04-22T14:16:48.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.120+0000 7fb9dfd79700 1 -- 172.21.15.103:0/3616426372 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9d80b9140 msgr2=0x7fb9d81556e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:48.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.120+0000 7fb9dfd79700 1 --2- 172.21.15.103:0/3616426372 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9d80b9140 0x7fb9d81556e0 secure :-1 s=READY pgs=169 cs=0 l=1 rx=0x7fb9c8000b80 tx=0x7fb9d4001e40).stop 2020-04-22T14:16:48.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.120+0000 7fb9dfd79700 1 -- 172.21.15.103:0/3616426372 shutdown_connections 2020-04-22T14:16:48.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.120+0000 7fb9dfd79700 1 --2- 172.21.15.103:0/3616426372 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb9b804ddb0 0x7fb9b8050270 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:48.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.120+0000 7fb9dfd79700 1 --2- 172.21.15.103:0/3616426372 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9d80b9140 0x7fb9d81556e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:48.124 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.120+0000 7fb9dfd79700 1 -- 172.21.15.103:0/3616426372 >> 172.21.15.103:0/3616426372 conn(0x7fb9d805b7b0 msgr2=0x7fb9d80b56f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:48.124 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.120+0000 7fb9dfd79700 1 -- 172.21.15.103:0/3616426372 shutdown_connections 2020-04-22T14:16:48.124 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.120+0000 7fb9dfd79700 1 -- 172.21.15.103:0/3616426372 wait complete. 2020-04-22T14:16:48.135 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:48.150 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:16:48.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.299+0000 7f72e6f25700 1 Processor -- start 2020-04-22T14:16:48.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.299+0000 7f72e6f25700 1 -- start start 2020-04-22T14:16:48.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.300+0000 7f72e6f25700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f72e0065fe0 0x7f72e01464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:48.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.300+0000 7f72e6f25700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e0143300 con 0x7f72e012c0d0 2020-04-22T14:16:48.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.300+0000 7f72e6f25700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e01435a0 con 0x7f72e0063e30 2020-04-22T14:16:48.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.300+0000 7f72e6f25700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e0143840 con 0x7f72e0065fe0 2020-04-22T14:16:48.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.300+0000 7f72e54c2700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f72e0063e30 0x7f72e00642a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48872/0 (socket says 172.21.15.103:48872) 2020-04-22T14:16:48.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.300+0000 7f72e54c2700 1 -- 172.21.15.103:0/327493223 learned_addr learned my addr 172.21.15.103:0/327493223 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:48.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.300+0000 7f72df7fe700 1 -- 172.21.15.103:0/327493223 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3645482579 0 0) 0x7f72e01435a0 con 0x7f72e0063e30 2020-04-22T14:16:48.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.300+0000 7f72dffff700 1 --2- 172.21.15.103:0/327493223 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f72e0065fe0 0x7f72e01464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:48.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.300+0000 7f72df7fe700 1 -- 172.21.15.103:0/327493223 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72cc003230 con 0x7f72e0063e30 2020-04-22T14:16:48.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.300+0000 7f72df7fe700 1 -- 172.21.15.103:0/327493223 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2090182677 0 0) 0x7f72cc003230 con 0x7f72e0063e30 2020-04-22T14:16:48.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.300+0000 7f72df7fe700 1 -- 172.21.15.103:0/327493223 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f72e0065fe0 msgr2=0x7f72e01464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:48.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.300+0000 7f72df7fe700 1 --2- 172.21.15.103:0/327493223 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f72e0065fe0 0x7f72e01464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:48.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.300+0000 7f72df7fe700 1 -- 172.21.15.103:0/327493223 >> v1:172.21.15.86:6789/0 conn(0x7f72e012c0d0 legacy=0x7f72e005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:48.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.300+0000 7f72df7fe700 1 -- 172.21.15.103:0/327493223 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e005bb50 con 0x7f72e0063e30 2020-04-22T14:16:48.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.300+0000 7f72df7fe700 1 -- 172.21.15.103:0/327493223 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f72d0001710 con 0x7f72e0063e30 2020-04-22T14:16:48.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.300+0000 7f72df7fe700 1 -- 172.21.15.103:0/327493223 >> v1:172.21.15.103:6789/0 conn(0x7f72e0063e30 legacy=0x7f72e00642a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:48.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.300+0000 7f72df7fe700 1 --2- 172.21.15.103:0/327493223 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72cc003720 0x7f72cc003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:48.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.300+0000 7f72df7fe700 1 --2- 172.21.15.103:0/327493223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f72cc004060 0x7f72cc004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:48.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.300+0000 7f72df7fe700 1 --2- 172.21.15.103:0/327493223 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f72e0065fe0 0x7f72cc004af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:48.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.301+0000 7f72df7fe700 1 -- 172.21.15.103:0/327493223 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e0143840 con 0x7f72cc004060 2020-04-22T14:16:48.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.301+0000 7f72df7fe700 1 -- 172.21.15.103:0/327493223 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc005000 con 0x7f72cc003720 2020-04-22T14:16:48.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.301+0000 7f72df7fe700 1 -- 172.21.15.103:0/327493223 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc0051c0 con 0x7f72e0065fe0 2020-04-22T14:16:48.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.301+0000 7f72e4cc1700 1 --2- 172.21.15.103:0/327493223 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72cc003720 0x7f72cc003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:48.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.301+0000 7f72e54c2700 1 --2- 172.21.15.103:0/327493223 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f72e0065fe0 0x7f72cc004af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:48.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.301+0000 7f72dffff700 1 --2- 172.21.15.103:0/327493223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f72cc004060 0x7f72cc004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:48.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.301+0000 7f72e4cc1700 1 -- 172.21.15.103:0/327493223 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f72e0065fe0 msgr2=0x7f72cc004af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:48.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.301+0000 7f72e4cc1700 1 --2- 172.21.15.103:0/327493223 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f72e0065fe0 0x7f72cc004af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:48.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.301+0000 7f72e4cc1700 1 -- 172.21.15.103:0/327493223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f72cc004060 msgr2=0x7f72cc004530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:48.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.301+0000 7f72e4cc1700 1 --2- 172.21.15.103:0/327493223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f72cc004060 0x7f72cc004530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:48.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.301+0000 7f72e4cc1700 1 -- 172.21.15.103:0/327493223 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72cc003230 con 0x7f72cc003720 2020-04-22T14:16:48.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.301+0000 7f72e4cc1700 1 --2- 172.21.15.103:0/327493223 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72cc003720 0x7f72cc003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f72e00613e0 tx=0x7f72d8010070).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:48.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.301+0000 7f72e4cc1700 1 --2- 172.21.15.103:0/327493223 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72cc003720 0x7f72cc003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f72e00613e0 tx=0x7f72d8010070).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:48.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.301+0000 7f72e4cc1700 1 --2- 172.21.15.103:0/327493223 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72cc003720 0x7f72cc003b40 secure :-1 s=READY pgs=1750 cs=0 l=1 rx=0x7f72e00613e0 tx=0x7f72d8010070).ready entity=mon.1 client_cookie=3eb7a9579cbfbf12 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:48.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.301+0000 7f72e4cc1700 1 --2- 172.21.15.103:0/327493223 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72cc003720 0x7f72cc003b40 secure :-1 s=THROTTLE_DONE pgs=1750 cs=0 l=1 rx=0x7f72e00613e0 tx=0x7f72d8010070).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:48.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.301+0000 7f72e4cc1700 1 --2- 172.21.15.103:0/327493223 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72cc003720 0x7f72cc003b40 secure :-1 s=THROTTLE_DONE pgs=1750 cs=0 l=1 rx=0x7f72e00613e0 tx=0x7f72d8010070).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:48.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.301+0000 7f72df7fe700 1 -- 172.21.15.103:0/327493223 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72d8006c40 con 0x7f72cc003720 2020-04-22T14:16:48.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.301+0000 7f72e4cc1700 1 --2- 172.21.15.103:0/327493223 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72cc003720 0x7f72cc003b40 secure :-1 s=THROTTLE_DONE pgs=1750 cs=0 l=1 rx=0x7f72e00613e0 tx=0x7f72d8010070).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:48.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.301+0000 7f72df7fe700 1 -- 172.21.15.103:0/327493223 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d8006da0 con 0x7f72cc003720 2020-04-22T14:16:48.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.301+0000 7f72df7fe700 1 -- 172.21.15.103:0/327493223 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72d8002730 con 0x7f72cc003720 2020-04-22T14:16:48.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.301+0000 7f72e6f25700 1 -- 172.21.15.103:0/327493223 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72cc003720 msgr2=0x7f72cc003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:48.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.301+0000 7f72e6f25700 1 --2- 172.21.15.103:0/327493223 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72cc003720 0x7f72cc003b40 secure :-1 s=READY pgs=1750 cs=0 l=1 rx=0x7f72e00613e0 tx=0x7f72d8010070).stop 2020-04-22T14:16:48.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.301+0000 7f72e54c2700 1 -- 172.21.15.103:0/327493223 reap_dead start 2020-04-22T14:16:48.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.302+0000 7f72e6f25700 1 -- 172.21.15.103:0/327493223 shutdown_connections 2020-04-22T14:16:48.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.302+0000 7f72e6f25700 1 -- 172.21.15.103:0/327493223 >> 172.21.15.103:0/327493223 conn(0x7f72e00b9160 msgr2=0x7f72e005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:48.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.302+0000 7f72e6f25700 1 -- 172.21.15.103:0/327493223 shutdown_connections 2020-04-22T14:16:48.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.302+0000 7f72e6f25700 1 -- 172.21.15.103:0/327493223 wait complete. 2020-04-22T14:16:48.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.303+0000 7f72e6f25700 1 Processor -- start 2020-04-22T14:16:48.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.303+0000 7f72e6f25700 1 -- start start 2020-04-22T14:16:48.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.303+0000 7f72e6f25700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f72e00ae680 0x7f72e01287f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:48.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.303+0000 7f72e6f25700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f72e00aeb10 0x7f72e0128c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:48.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.303+0000 7f72e6f25700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e00b33d0 con 0x7f72e00632b0 2020-04-22T14:16:48.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.303+0000 7f72e6f25700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72e00b36a0 con 0x7f72e00ae680 2020-04-22T14:16:48.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.303+0000 7f72e6f25700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72e00b3940 con 0x7f72e00aeb10 2020-04-22T14:16:48.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.304+0000 7f72e4cc1700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f72e00632b0 0x7f72e00b2cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48880/0 (socket says 172.21.15.103:48880) 2020-04-22T14:16:48.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.304+0000 7f72e4cc1700 1 -- 172.21.15.103:0/53861671 learned_addr learned my addr 172.21.15.103:0/53861671 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:48.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.304+0000 7f72e54c2700 1 --2- 172.21.15.103:0/53861671 >> v2:172.21.15.103:3300/0 conn(0x7f72e00aeb10 0x7f72e0128c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:48.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.304+0000 7f72dffff700 1 --2- 172.21.15.103:0/53861671 >> v2:172.21.15.86:3300/0 conn(0x7f72e00ae680 0x7f72e01287f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:48.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.304+0000 7f72e54c2700 1 -- 172.21.15.103:0/53861671 >> v2:172.21.15.86:3300/0 conn(0x7f72e00ae680 msgr2=0x7f72e01287f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:48.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.304+0000 7f72e54c2700 1 --2- 172.21.15.103:0/53861671 >> v2:172.21.15.86:3300/0 conn(0x7f72e00ae680 0x7f72e01287f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:48.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.304+0000 7f72e54c2700 1 -- 172.21.15.103:0/53861671 >> v1:172.21.15.103:6789/0 conn(0x7f72e00632b0 legacy=0x7f72e00b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:48.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.304+0000 7f72ddffb700 1 -- 172.21.15.103:0/53861671 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2364271818 0 0) 0x7f72e00b33d0 con 0x7f72e00632b0 2020-04-22T14:16:48.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.304+0000 7f72e54c2700 1 -- 172.21.15.103:0/53861671 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e00b3be0 con 0x7f72e00aeb10 2020-04-22T14:16:48.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.304+0000 7f72e54c2700 1 --2- 172.21.15.103:0/53861671 >> v2:172.21.15.103:3300/0 conn(0x7f72e00aeb10 0x7f72e0128c50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f72d0001110 tx=0x7f72e005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:48.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.304+0000 7f72e54c2700 1 --2- 172.21.15.103:0/53861671 >> v2:172.21.15.103:3300/0 conn(0x7f72e00aeb10 0x7f72e0128c50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f72d0001110 tx=0x7f72e005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:48.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.304+0000 7f72e54c2700 1 --2- 172.21.15.103:0/53861671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72e00aeb10 0x7f72e0128c50 secure :-1 s=READY pgs=1752 cs=0 l=1 rx=0x7f72d0001110 tx=0x7f72e005bce0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:48.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.304+0000 7f72e54c2700 1 --2- 172.21.15.103:0/53861671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72e00aeb10 0x7f72e0128c50 secure :-1 s=THROTTLE_DONE pgs=1752 cs=0 l=1 rx=0x7f72d0001110 tx=0x7f72e005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:48.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.304+0000 7f72ddffb700 1 -- 172.21.15.103:0/53861671 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72d0001a40 con 0x7f72e00aeb10 2020-04-22T14:16:48.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.304+0000 7f72e54c2700 1 --2- 172.21.15.103:0/53861671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72e00aeb10 0x7f72e0128c50 secure :-1 s=THROTTLE_DONE pgs=1752 cs=0 l=1 rx=0x7f72d0001110 tx=0x7f72e005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:48.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.304+0000 7f72e54c2700 1 --2- 172.21.15.103:0/53861671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72e00aeb10 0x7f72e0128c50 secure :-1 s=THROTTLE_DONE pgs=1752 cs=0 l=1 rx=0x7f72d0001110 tx=0x7f72e005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:48.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.304+0000 7f72ddffb700 1 -- 172.21.15.103:0/53861671 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d000eca0 con 0x7f72e00aeb10 2020-04-22T14:16:48.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.304+0000 7f72ddffb700 1 -- 172.21.15.103:0/53861671 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72d000ee50 con 0x7f72e00aeb10 2020-04-22T14:16:48.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.304+0000 7f72e6f25700 1 -- 172.21.15.103:0/53861671 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72e0063690 con 0x7f72e00aeb10 2020-04-22T14:16:48.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.304+0000 7f72e6f25700 1 -- 172.21.15.103:0/53861671 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e00b09b0 con 0x7f72e00aeb10 2020-04-22T14:16:48.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.305+0000 7f72e54c2700 1 --2- 172.21.15.103:0/53861671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72e00aeb10 0x7f72e0128c50 secure :-1 s=THROTTLE_DONE pgs=1752 cs=0 l=1 rx=0x7f72d0001110 tx=0x7f72e005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:48.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.305+0000 7f72e6f25700 1 -- 172.21.15.103:0/53861671 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72e00b3d70 con 0x7f72e00aeb10 2020-04-22T14:16:48.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.305+0000 7f72ddffb700 1 -- 172.21.15.103:0/53861671 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f72d0007280 con 0x7f72e00aeb10 2020-04-22T14:16:48.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.305+0000 7f72e54c2700 1 --2- 172.21.15.103:0/53861671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72e00aeb10 0x7f72e0128c50 secure :-1 s=THROTTLE_DONE pgs=1752 cs=0 l=1 rx=0x7f72d0001110 tx=0x7f72e005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:48.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.305+0000 7f72ddffb700 1 --2- 172.21.15.103:0/53861671 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f72c004d820 0x7f72c004fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:48.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.305+0000 7f72ddffb700 1 -- 172.21.15.103:0/53861671 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f72d00611e0 con 0x7f72e00aeb10 2020-04-22T14:16:48.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.306+0000 7f72e4cc1700 1 --2- 172.21.15.103:0/53861671 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f72c004d820 0x7f72c004fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:48.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.306+0000 7f72e4cc1700 1 --2- 172.21.15.103:0/53861671 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f72c004d820 0x7f72c004fce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f72d8002080 tx=0x7f72d8010070).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:48.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.306+0000 7f72e4cc1700 1 --2- 172.21.15.103:0/53861671 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f72c004d820 0x7f72c004fce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f72d8002080 tx=0x7f72d8010070).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:48.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.306+0000 7f72e4cc1700 1 --2- 172.21.15.103:0/53861671 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f72c004d820 0x7f72c004fce0 secure :-1 s=READY pgs=636 cs=0 l=1 rx=0x7f72d8002080 tx=0x7f72d8010070).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:48.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.309+0000 7f72e54c2700 1 --2- 172.21.15.103:0/53861671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72e00aeb10 0x7f72e0128c50 secure :-1 s=THROTTLE_DONE pgs=1752 cs=0 l=1 rx=0x7f72d0001110 tx=0x7f72e005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:48.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.309+0000 7f72ddffb700 1 -- 172.21.15.103:0/53861671 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f72d003c560 con 0x7f72e00aeb10 2020-04-22T14:16:48.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.500+0000 7f72e6f25700 1 -- 172.21.15.103:0/53861671 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f72e0056c90 con 0x7f72e00aeb10 2020-04-22T14:16:48.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.501+0000 7f72e54c2700 1 --2- 172.21.15.103:0/53861671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72e00aeb10 0x7f72e0128c50 secure :-1 s=THROTTLE_DONE pgs=1752 cs=0 l=1 rx=0x7f72d0001110 tx=0x7f72e005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:48.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.501+0000 7f72ddffb700 1 -- 172.21.15.103:0/53861671 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+2145 (secure 0 0 0) 0x7f72d003fb80 con 0x7f72e00aeb10 2020-04-22T14:16:48.504 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:16:48.504 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":94,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6380,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/1697822737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1697822737},{"type":"v1","addr":"172.21.15.103:6833","nonce":1697822737}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":91}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:16:46.111567+0000","modified":"2020-04-22T14:16:48.114069+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8142},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8142":{"gid":8142,"name":"b","rank":0,"incarnation":92,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/3334539524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3334539524},{"type":"v1","addr":"172.21.15.86:6835","nonce":3334539524}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2020-04-22T14:16:48.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.502+0000 7f72e6f25700 1 -- 172.21.15.103:0/53861671 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f72c004d820 msgr2=0x7f72c004fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:48.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.502+0000 7f72e6f25700 1 --2- 172.21.15.103:0/53861671 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f72c004d820 0x7f72c004fce0 secure :-1 s=READY pgs=636 cs=0 l=1 rx=0x7f72d8002080 tx=0x7f72d8010070).stop 2020-04-22T14:16:48.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.502+0000 7f72e6f25700 1 -- 172.21.15.103:0/53861671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72e00aeb10 msgr2=0x7f72e0128c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:48.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.502+0000 7f72e6f25700 1 --2- 172.21.15.103:0/53861671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72e00aeb10 0x7f72e0128c50 secure :-1 s=READY pgs=1752 cs=0 l=1 rx=0x7f72d0001110 tx=0x7f72e005bce0).stop 2020-04-22T14:16:48.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.502+0000 7f72e6f25700 1 -- 172.21.15.103:0/53861671 shutdown_connections 2020-04-22T14:16:48.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.502+0000 7f72e6f25700 1 --2- 172.21.15.103:0/53861671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72e00aeb10 0x7f72e0128c50 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:48.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.502+0000 7f72e6f25700 1 --2- 172.21.15.103:0/53861671 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f72c004d820 0x7f72c004fce0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:48.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.502+0000 7f72e6f25700 1 --2- 172.21.15.103:0/53861671 >> v2:172.21.15.86:3300/0 conn(0x7f72e00ae680 0x7f72e01287f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:48.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.502+0000 7f72e6f25700 1 -- 172.21.15.103:0/53861671 >> 172.21.15.103:0/53861671 conn(0x7f72e00b9160 msgr2=0x7f72e00642a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:48.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.502+0000 7f72e6f25700 1 -- 172.21.15.103:0/53861671 shutdown_connections 2020-04-22T14:16:48.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.502+0000 7f72e6f25700 1 -- 172.21.15.103:0/53861671 wait complete. 2020-04-22T14:16:48.507 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 94 2020-04-22T14:16:48.515 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:48.528 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:16:48.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.672+0000 7f1d8e0db700 1 Processor -- start 2020-04-22T14:16:48.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.672+0000 7f1d8e0db700 1 -- start start 2020-04-22T14:16:48.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.673+0000 7f1d8e0db700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d8814ca00 0x7f1d8814edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:48.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.673+0000 7f1d8e0db700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d880ae860 con 0x7f1d881441f0 2020-04-22T14:16:48.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.673+0000 7f1d8e0db700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d880b5900 con 0x7f1d8805b7c0 2020-04-22T14:16:48.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.673+0000 7f1d8e0db700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d880b5ba0 con 0x7f1d8814ca00 2020-04-22T14:16:48.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.673+0000 7f1d877fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f1d8805b7c0 0x7f1d880b50d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48888/0 (socket says 172.21.15.103:48888) 2020-04-22T14:16:48.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.673+0000 7f1d877fe700 1 -- 172.21.15.103:0/2213341000 learned_addr learned my addr 172.21.15.103:0/2213341000 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:48.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.673+0000 7f1d87fff700 1 --2- 172.21.15.103:0/2213341000 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d8814ca00 0x7f1d8814edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:48.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.673+0000 7f1d867fc700 1 -- 172.21.15.103:0/2213341000 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2297830806 0 0) 0x7f1d880b5900 con 0x7f1d8805b7c0 2020-04-22T14:16:48.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.673+0000 7f1d867fc700 1 -- 172.21.15.103:0/2213341000 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d74003230 con 0x7f1d8805b7c0 2020-04-22T14:16:48.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.673+0000 7f1d867fc700 1 -- 172.21.15.103:0/2213341000 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2371970713 0 0) 0x7f1d880ae860 con 0x7f1d881441f0 2020-04-22T14:16:48.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.673+0000 7f1d867fc700 1 -- 172.21.15.103:0/2213341000 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d880b5900 con 0x7f1d881441f0 2020-04-22T14:16:48.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.674+0000 7f1d87fff700 1 -- 172.21.15.103:0/2213341000 >> v1:172.21.15.103:6789/0 conn(0x7f1d8805b7c0 legacy=0x7f1d880b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:48.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.674+0000 7f1d87fff700 1 -- 172.21.15.103:0/2213341000 >> v1:172.21.15.86:6789/0 conn(0x7f1d881441f0 legacy=0x7f1d88144820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:48.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.674+0000 7f1d87fff700 1 -- 172.21.15.103:0/2213341000 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d880b5e40 con 0x7f1d8814ca00 2020-04-22T14:16:48.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.674+0000 7f1d87fff700 1 --2- 172.21.15.103:0/2213341000 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d8814ca00 0x7f1d8814edf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1d800032b0 tx=0x7f1d80008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:48.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.674+0000 7f1d87fff700 1 --2- 172.21.15.103:0/2213341000 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d8814ca00 0x7f1d8814edf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1d800032b0 tx=0x7f1d80008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:48.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.674+0000 7f1d87fff700 1 --2- 172.21.15.103:0/2213341000 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d8814ca00 0x7f1d8814edf0 secure :-1 s=READY pgs=170 cs=0 l=1 rx=0x7f1d800032b0 tx=0x7f1d80008c60).ready entity=mon.2 client_cookie=1b8a977961935386 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:48.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.674+0000 7f1d87fff700 1 --2- 172.21.15.103:0/2213341000 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d8814ca00 0x7f1d8814edf0 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f1d800032b0 tx=0x7f1d80008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:48.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.674+0000 7f1d867fc700 1 -- 172.21.15.103:0/2213341000 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d80010d40 con 0x7f1d8814ca00 2020-04-22T14:16:48.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.674+0000 7f1d87fff700 1 --2- 172.21.15.103:0/2213341000 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d8814ca00 0x7f1d8814edf0 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f1d800032b0 tx=0x7f1d80008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:48.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.674+0000 7f1d867fc700 1 -- 172.21.15.103:0/2213341000 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d800110d0 con 0x7f1d8814ca00 2020-04-22T14:16:48.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.674+0000 7f1d87fff700 1 --2- 172.21.15.103:0/2213341000 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d8814ca00 0x7f1d8814edf0 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f1d800032b0 tx=0x7f1d80008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:48.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.674+0000 7f1d867fc700 1 -- 172.21.15.103:0/2213341000 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d80010ea0 con 0x7f1d8814ca00 2020-04-22T14:16:48.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.674+0000 7f1d8e0db700 1 -- 172.21.15.103:0/2213341000 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d8814ca00 msgr2=0x7f1d8814edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:48.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.674+0000 7f1d8e0db700 1 --2- 172.21.15.103:0/2213341000 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d8814ca00 0x7f1d8814edf0 secure :-1 s=READY pgs=170 cs=0 l=1 rx=0x7f1d800032b0 tx=0x7f1d80008c60).stop 2020-04-22T14:16:48.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.674+0000 7f1d8e0db700 1 -- 172.21.15.103:0/2213341000 shutdown_connections 2020-04-22T14:16:48.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.674+0000 7f1d8e0db700 1 --2- 172.21.15.103:0/2213341000 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d8814ca00 0x7f1d8814edf0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:48.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.674+0000 7f1d8e0db700 1 -- 172.21.15.103:0/2213341000 >> 172.21.15.103:0/2213341000 conn(0x7f1d880b9160 msgr2=0x7f1d8805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:48.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.674+0000 7f1d8e0db700 1 -- 172.21.15.103:0/2213341000 shutdown_connections 2020-04-22T14:16:48.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.674+0000 7f1d8e0db700 1 -- 172.21.15.103:0/2213341000 wait complete. 2020-04-22T14:16:48.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.675+0000 7f1d8e0db700 1 Processor -- start 2020-04-22T14:16:48.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.676+0000 7f1d8e0db700 1 -- start start 2020-04-22T14:16:48.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.676+0000 7f1d8e0db700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1d8814ca00 0x7f1d881360b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:48.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.676+0000 7f1d8e0db700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d88139530 con 0x7f1d881441f0 2020-04-22T14:16:48.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.676+0000 7f1d8e0db700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d881392b0 con 0x7f1d8805b7c0 2020-04-22T14:16:48.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.676+0000 7f1d8e0db700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d881369c0 con 0x7f1d8814ca00 2020-04-22T14:16:48.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.676+0000 7f1d877fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f1d8805b7c0 0x7f1d881359a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48894/0 (socket says 172.21.15.103:48894) 2020-04-22T14:16:48.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.676+0000 7f1d877fe700 1 -- 172.21.15.103:0/211306391 learned_addr learned my addr 172.21.15.103:0/211306391 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:48.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.676+0000 7f1d84ff9700 1 -- 172.21.15.103:0/211306391 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 437210779 0 0) 0x7f1d881392b0 con 0x7f1d8805b7c0 2020-04-22T14:16:48.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.676+0000 7f1d84ff9700 1 -- 172.21.15.103:0/211306391 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d68002fe0 con 0x7f1d8805b7c0 2020-04-22T14:16:48.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.677+0000 7f1d87fff700 1 --2- 172.21.15.103:0/211306391 >> v2:172.21.15.86:3300/0 conn(0x7f1d8814ca00 0x7f1d881360b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:48.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.677+0000 7f1d84ff9700 1 -- 172.21.15.103:0/211306391 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2518534857 0 0) 0x7f1d68002fe0 con 0x7f1d8805b7c0 2020-04-22T14:16:48.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.677+0000 7f1d84ff9700 1 -- 172.21.15.103:0/211306391 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1d881392b0 con 0x7f1d8805b7c0 2020-04-22T14:16:48.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.677+0000 7f1d84ff9700 1 -- 172.21.15.103:0/211306391 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f1d78001880 con 0x7f1d8805b7c0 2020-04-22T14:16:48.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.677+0000 7f1d84ff9700 1 -- 172.21.15.103:0/211306391 >> v2:172.21.15.86:3300/0 conn(0x7f1d8814ca00 msgr2=0x7f1d881360b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:48.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.677+0000 7f1d84ff9700 1 --2- 172.21.15.103:0/211306391 >> v2:172.21.15.86:3300/0 conn(0x7f1d8814ca00 0x7f1d881360b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:48.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.677+0000 7f1d84ff9700 1 -- 172.21.15.103:0/211306391 >> v1:172.21.15.103:6789/0 conn(0x7f1d8805b7c0 legacy=0x7f1d881359a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:48.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.677+0000 7f1d84ff9700 1 -- 172.21.15.103:0/211306391 >> v1:172.21.15.86:6789/0 conn(0x7f1d881441f0 legacy=0x7f1d88137f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:48.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.677+0000 7f1d84ff9700 1 --2- 172.21.15.103:0/211306391 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d680049b0 0x7f1d68004db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:48.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.677+0000 7f1d84ff9700 1 --2- 172.21.15.103:0/211306391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d68003920 0x7f1d68003da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:48.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.677+0000 7f1d84ff9700 1 --2- 172.21.15.103:0/211306391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d68004200 0x7f1d6800b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:48.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.677+0000 7f1d84ff9700 1 -- 172.21.15.103:0/211306391 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d881369c0 con 0x7f1d68004200 2020-04-22T14:16:48.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.677+0000 7f1d84ff9700 1 -- 172.21.15.103:0/211306391 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d680047a0 con 0x7f1d68003920 2020-04-22T14:16:48.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.677+0000 7f1d84ff9700 1 -- 172.21.15.103:0/211306391 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6800bbe0 con 0x7f1d680049b0 2020-04-22T14:16:48.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.677+0000 7f1d86ffd700 1 --2- 172.21.15.103:0/211306391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d68003920 0x7f1d68003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:48.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.677+0000 7f1d877fe700 1 --2- 172.21.15.103:0/211306391 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d680049b0 0x7f1d68004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:48.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.677+0000 7f1d87fff700 1 --2- 172.21.15.103:0/211306391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d68004200 0x7f1d6800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:48.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.677+0000 7f1d86ffd700 1 -- 172.21.15.103:0/211306391 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d680049b0 msgr2=0x7f1d68004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:48.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.677+0000 7f1d86ffd700 1 --2- 172.21.15.103:0/211306391 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d680049b0 0x7f1d68004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:48.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.677+0000 7f1d86ffd700 1 -- 172.21.15.103:0/211306391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d68004200 msgr2=0x7f1d6800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:48.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.677+0000 7f1d86ffd700 1 --2- 172.21.15.103:0/211306391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d68004200 0x7f1d6800b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:48.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.677+0000 7f1d87fff700 1 -- 172.21.15.103:0/211306391 reap_dead start 2020-04-22T14:16:48.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.677+0000 7f1d86ffd700 1 -- 172.21.15.103:0/211306391 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d88136700 con 0x7f1d68003920 2020-04-22T14:16:48.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.677+0000 7f1d8e0db700 1 -- 172.21.15.103:0/211306391 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d88143760 con 0x7f1d68003920 2020-04-22T14:16:48.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.677+0000 7f1d86ffd700 1 --2- 172.21.15.103:0/211306391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d68003920 0x7f1d68003da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1d88143af0 tx=0x7f1d7c002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:48.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.677+0000 7f1d8e0db700 1 -- 172.21.15.103:0/211306391 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d88155cf0 con 0x7f1d68003920 2020-04-22T14:16:48.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.678+0000 7f1d86ffd700 1 --2- 172.21.15.103:0/211306391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d68003920 0x7f1d68003da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1d88143af0 tx=0x7f1d7c002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:48.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.678+0000 7f1d86ffd700 1 --2- 172.21.15.103:0/211306391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d68003920 0x7f1d68003da0 secure :-1 s=READY pgs=1755 cs=0 l=1 rx=0x7f1d88143af0 tx=0x7f1d7c002e60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:48.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.678+0000 7f1d86ffd700 1 --2- 172.21.15.103:0/211306391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d68003920 0x7f1d68003da0 secure :-1 s=THROTTLE_DONE pgs=1755 cs=0 l=1 rx=0x7f1d88143af0 tx=0x7f1d7c002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:48.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.678+0000 7f1d84ff9700 1 -- 172.21.15.103:0/211306391 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d7c00ca10 con 0x7f1d68003920 2020-04-22T14:16:48.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.678+0000 7f1d86ffd700 1 --2- 172.21.15.103:0/211306391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d68003920 0x7f1d68003da0 secure :-1 s=THROTTLE_DONE pgs=1755 cs=0 l=1 rx=0x7f1d88143af0 tx=0x7f1d7c002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:48.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.678+0000 7f1d86ffd700 1 --2- 172.21.15.103:0/211306391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d68003920 0x7f1d68003da0 secure :-1 s=THROTTLE_DONE pgs=1755 cs=0 l=1 rx=0x7f1d88143af0 tx=0x7f1d7c002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:48.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.678+0000 7f1d84ff9700 1 -- 172.21.15.103:0/211306391 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7c00cb70 con 0x7f1d68003920 2020-04-22T14:16:48.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.678+0000 7f1d84ff9700 1 -- 172.21.15.103:0/211306391 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d7c0064e0 con 0x7f1d68003920 2020-04-22T14:16:48.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.678+0000 7f1d86ffd700 1 --2- 172.21.15.103:0/211306391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d68003920 0x7f1d68003da0 secure :-1 s=THROTTLE_DONE pgs=1755 cs=0 l=1 rx=0x7f1d88143af0 tx=0x7f1d7c002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:48.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.678+0000 7f1d8e0db700 1 -- 172.21.15.103:0/211306391 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d64003340 con 0x7f1d68003920 2020-04-22T14:16:48.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.679+0000 7f1d84ff9700 1 -- 172.21.15.103:0/211306391 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f1d7c006640 con 0x7f1d68003920 2020-04-22T14:16:48.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.679+0000 7f1d86ffd700 1 --2- 172.21.15.103:0/211306391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d68003920 0x7f1d68003da0 secure :-1 s=THROTTLE_DONE pgs=1755 cs=0 l=1 rx=0x7f1d88143af0 tx=0x7f1d7c002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:48.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.679+0000 7f1d84ff9700 1 --2- 172.21.15.103:0/211306391 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1d68051980 0x7f1d68053e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:48.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.679+0000 7f1d84ff9700 1 -- 172.21.15.103:0/211306391 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1d7c060f90 con 0x7f1d68003920 2020-04-22T14:16:48.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.679+0000 7f1d877fe700 1 --2- 172.21.15.103:0/211306391 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1d68051980 0x7f1d68053e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:48.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.679+0000 7f1d877fe700 1 --2- 172.21.15.103:0/211306391 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1d68051980 0x7f1d68053e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1d78005520 tx=0x7f1d78008b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:48.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.679+0000 7f1d877fe700 1 --2- 172.21.15.103:0/211306391 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1d68051980 0x7f1d68053e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1d78005520 tx=0x7f1d78008b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:48.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.679+0000 7f1d877fe700 1 --2- 172.21.15.103:0/211306391 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1d68051980 0x7f1d68053e40 secure :-1 s=READY pgs=637 cs=0 l=1 rx=0x7f1d78005520 tx=0x7f1d78008b50).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:48.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.683+0000 7f1d86ffd700 1 --2- 172.21.15.103:0/211306391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d68003920 0x7f1d68003da0 secure :-1 s=THROTTLE_DONE pgs=1755 cs=0 l=1 rx=0x7f1d88143af0 tx=0x7f1d7c002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:48.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.683+0000 7f1d84ff9700 1 -- 172.21.15.103:0/211306391 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f1d7c03c370 con 0x7f1d68003920 2020-04-22T14:16:48.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.827+0000 7f1d8e0db700 1 -- 172.21.15.103:0/211306391 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d640021d0 con 0x7f1d68003920 2020-04-22T14:16:48.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.828+0000 7f1d86ffd700 1 --2- 172.21.15.103:0/211306391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d68003920 0x7f1d68003da0 secure :-1 s=THROTTLE_DONE pgs=1755 cs=0 l=1 rx=0x7f1d88143af0 tx=0x7f1d7c002e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:48.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.828+0000 7f1d84ff9700 1 -- 172.21.15.103:0/211306391 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) v1 ==== 74+0+16103 (secure 0 0 0) 0x7f1d7c03f990 con 0x7f1d68003920 2020-04-22T14:16:48.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.829+0000 7f1d8e0db700 1 -- 172.21.15.103:0/211306391 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1d68051980 msgr2=0x7f1d68053e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:48.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.829+0000 7f1d8e0db700 1 --2- 172.21.15.103:0/211306391 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1d68051980 0x7f1d68053e40 secure :-1 s=READY pgs=637 cs=0 l=1 rx=0x7f1d78005520 tx=0x7f1d78008b50).stop 2020-04-22T14:16:48.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.829+0000 7f1d8e0db700 1 -- 172.21.15.103:0/211306391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d68003920 msgr2=0x7f1d68003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:48.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.829+0000 7f1d8e0db700 1 --2- 172.21.15.103:0/211306391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d68003920 0x7f1d68003da0 secure :-1 s=READY pgs=1755 cs=0 l=1 rx=0x7f1d88143af0 tx=0x7f1d7c002e60).stop 2020-04-22T14:16:48.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.830+0000 7f1d8e0db700 1 -- 172.21.15.103:0/211306391 shutdown_connections 2020-04-22T14:16:48.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.830+0000 7f1d8e0db700 1 --2- 172.21.15.103:0/211306391 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1d68051980 0x7f1d68053e40 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:48.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.830+0000 7f1d8e0db700 1 --2- 172.21.15.103:0/211306391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d68003920 0x7f1d68003da0 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:48.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.830+0000 7f1d8e0db700 1 -- 172.21.15.103:0/211306391 >> 172.21.15.103:0/211306391 conn(0x7f1d880b9160 msgr2=0x7f1d88066cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:48.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.830+0000 7f1d8e0db700 1 -- 172.21.15.103:0/211306391 shutdown_connections 2020-04-22T14:16:48.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:48.830+0000 7f1d8e0db700 1 -- 172.21.15.103:0/211306391 wait complete. 2020-04-22T14:16:48.834 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:16:48.834 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":124,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:16:47.112746+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:16:44.031424+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2020-04-22T14:16:45.073910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:16:48.843 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:48.856 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:16:49.016 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.007+0000 7f0df7fbf700 1 Processor -- start 2020-04-22T14:16:49.016 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.007+0000 7f0df7fbf700 1 -- start start 2020-04-22T14:16:49.016 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.007+0000 7f0df7fbf700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0df0062170 0x7f0df00b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:49.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.007+0000 7f0df7fbf700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df0152e70 con 0x7f0df0152a90 2020-04-22T14:16:49.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.007+0000 7f0df7fbf700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df00b5650 con 0x7f0df00b5210 2020-04-22T14:16:49.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.007+0000 7f0df7fbf700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df00614f0 con 0x7f0df0062170 2020-04-22T14:16:49.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.008+0000 7f0df6d5d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f0df00b5210 0x7f0df00adf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48912/0 (socket says 172.21.15.103:48912) 2020-04-22T14:16:49.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.008+0000 7f0df6d5d700 1 -- 172.21.15.103:0/1435890852 learned_addr learned my addr 172.21.15.103:0/1435890852 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:49.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.008+0000 7f0df5d5b700 1 --2- 172.21.15.103:0/1435890852 >> v2:172.21.15.86:3300/0 conn(0x7f0df0062170 0x7f0df00b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:49.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.008+0000 7f0df555a700 1 -- 172.21.15.103:0/1435890852 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3587717472 0 0) 0x7f0df00b5650 con 0x7f0df00b5210 2020-04-22T14:16:49.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.008+0000 7f0df555a700 1 -- 172.21.15.103:0/1435890852 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ddc003230 con 0x7f0df00b5210 2020-04-22T14:16:49.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.008+0000 7f0df555a700 1 -- 172.21.15.103:0/1435890852 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 654391862 0 0) 0x7f0ddc003230 con 0x7f0df00b5210 2020-04-22T14:16:49.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.008+0000 7f0df555a700 1 -- 172.21.15.103:0/1435890852 >> v2:172.21.15.86:3300/0 conn(0x7f0df0062170 msgr2=0x7f0df00b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:49.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.008+0000 7f0df555a700 1 --2- 172.21.15.103:0/1435890852 >> v2:172.21.15.86:3300/0 conn(0x7f0df0062170 0x7f0df00b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:49.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.008+0000 7f0df555a700 1 -- 172.21.15.103:0/1435890852 >> v1:172.21.15.86:6789/0 conn(0x7f0df0152a90 legacy=0x7f0df00b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:49.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.008+0000 7f0df555a700 1 -- 172.21.15.103:0/1435890852 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df0061790 con 0x7f0df00b5210 2020-04-22T14:16:49.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.008+0000 7f0df555a700 1 -- 172.21.15.103:0/1435890852 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f0de8001a50 con 0x7f0df00b5210 2020-04-22T14:16:49.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.008+0000 7f0df555a700 1 -- 172.21.15.103:0/1435890852 >> v1:172.21.15.103:6789/0 conn(0x7f0df00b5210 legacy=0x7f0df00adf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:49.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.008+0000 7f0df555a700 1 --2- 172.21.15.103:0/1435890852 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ddc003720 0x7f0ddc003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:49.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.008+0000 7f0df555a700 1 --2- 172.21.15.103:0/1435890852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ddc0044d0 0x7f0ddc004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:49.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.008+0000 7f0df555a700 1 --2- 172.21.15.103:0/1435890852 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0ddc004db0 0x7f0ddc00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:49.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.008+0000 7f0df555a700 1 -- 172.21.15.103:0/1435890852 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df00614f0 con 0x7f0ddc003720 2020-04-22T14:16:49.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.008+0000 7f0df555a700 1 -- 172.21.15.103:0/1435890852 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc0041c0 con 0x7f0ddc0044d0 2020-04-22T14:16:49.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.008+0000 7f0df555a700 1 -- 172.21.15.103:0/1435890852 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc04fb90 con 0x7f0ddc004db0 2020-04-22T14:16:49.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.008+0000 7f0df5d5b700 1 --2- 172.21.15.103:0/1435890852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ddc0044d0 0x7f0ddc004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:49.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.008+0000 7f0df655c700 1 --2- 172.21.15.103:0/1435890852 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ddc003720 0x7f0ddc003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:49.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.008+0000 7f0df6d5d700 1 --2- 172.21.15.103:0/1435890852 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0ddc004db0 0x7f0ddc00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:49.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.008+0000 7f0df5d5b700 1 -- 172.21.15.103:0/1435890852 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0ddc004db0 msgr2=0x7f0ddc00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:49.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.008+0000 7f0df5d5b700 1 --2- 172.21.15.103:0/1435890852 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0ddc004db0 0x7f0ddc00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:49.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.008+0000 7f0df5d5b700 1 -- 172.21.15.103:0/1435890852 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ddc003720 msgr2=0x7f0ddc003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:49.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.008+0000 7f0df5d5b700 1 --2- 172.21.15.103:0/1435890852 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ddc003720 0x7f0ddc003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:49.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.009+0000 7f0df5d5b700 1 -- 172.21.15.103:0/1435890852 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ddc003230 con 0x7f0ddc0044d0 2020-04-22T14:16:49.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.009+0000 7f0df6d5d700 1 -- 172.21.15.103:0/1435890852 reap_dead start 2020-04-22T14:16:49.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.009+0000 7f0df655c700 1 --2- 172.21.15.103:0/1435890852 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ddc003720 0x7f0ddc003b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:16:49.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.009+0000 7f0df5d5b700 1 --2- 172.21.15.103:0/1435890852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ddc0044d0 0x7f0ddc004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0ddc0054a0 tx=0x7f0df005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.009+0000 7f0df5d5b700 1 --2- 172.21.15.103:0/1435890852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ddc0044d0 0x7f0ddc004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0ddc0054a0 tx=0x7f0df005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.009+0000 7f0df5d5b700 1 --2- 172.21.15.103:0/1435890852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ddc0044d0 0x7f0ddc004950 secure :-1 s=READY pgs=1757 cs=0 l=1 rx=0x7f0ddc0054a0 tx=0x7f0df005a720).ready entity=mon.1 client_cookie=6c9c9c2f0932ea3d server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:49.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.009+0000 7f0df5d5b700 1 --2- 172.21.15.103:0/1435890852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ddc0044d0 0x7f0ddc004950 secure :-1 s=THROTTLE_DONE pgs=1757 cs=0 l=1 rx=0x7f0ddc0054a0 tx=0x7f0df005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.009+0000 7f0df555a700 1 -- 172.21.15.103:0/1435890852 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0de0010dc0 con 0x7f0ddc0044d0 2020-04-22T14:16:49.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.009+0000 7f0df5d5b700 1 --2- 172.21.15.103:0/1435890852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ddc0044d0 0x7f0ddc004950 secure :-1 s=THROTTLE_DONE pgs=1757 cs=0 l=1 rx=0x7f0ddc0054a0 tx=0x7f0df005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.009+0000 7f0df5d5b700 1 --2- 172.21.15.103:0/1435890852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ddc0044d0 0x7f0ddc004950 secure :-1 s=THROTTLE_DONE pgs=1757 cs=0 l=1 rx=0x7f0ddc0054a0 tx=0x7f0df005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.009+0000 7f0df555a700 1 -- 172.21.15.103:0/1435890852 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de0008950 con 0x7f0ddc0044d0 2020-04-22T14:16:49.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.009+0000 7f0df555a700 1 -- 172.21.15.103:0/1435890852 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0de0008cb0 con 0x7f0ddc0044d0 2020-04-22T14:16:49.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.009+0000 7f0df7fbf700 1 -- 172.21.15.103:0/1435890852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ddc0044d0 msgr2=0x7f0ddc004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:49.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.009+0000 7f0df7fbf700 1 --2- 172.21.15.103:0/1435890852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ddc0044d0 0x7f0ddc004950 secure :-1 s=READY pgs=1757 cs=0 l=1 rx=0x7f0ddc0054a0 tx=0x7f0df005a720).stop 2020-04-22T14:16:49.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.009+0000 7f0df7fbf700 1 -- 172.21.15.103:0/1435890852 shutdown_connections 2020-04-22T14:16:49.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.009+0000 7f0df7fbf700 1 --2- 172.21.15.103:0/1435890852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ddc0044d0 0x7f0ddc004950 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:49.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.009+0000 7f0df7fbf700 1 -- 172.21.15.103:0/1435890852 >> 172.21.15.103:0/1435890852 conn(0x7f0df005ad30 msgr2=0x7f0df005b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:49.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.009+0000 7f0df7fbf700 1 -- 172.21.15.103:0/1435890852 shutdown_connections 2020-04-22T14:16:49.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.009+0000 7f0df7fbf700 1 -- 172.21.15.103:0/1435890852 wait complete. 2020-04-22T14:16:49.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.010+0000 7f0df7fbf700 1 Processor -- start 2020-04-22T14:16:49.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.010+0000 7f0df7fbf700 1 -- start start 2020-04-22T14:16:49.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.011+0000 7f0df7fbf700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0ddc0044d0 0x7f0df0062d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:49.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.011+0000 7f0df7fbf700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0df0066420 0x7f0df0153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:49.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.011+0000 7f0df7fbf700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df0153710 con 0x7f0df00b6ca0 2020-04-22T14:16:49.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.011+0000 7f0df7fbf700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df01539b0 con 0x7f0df0066420 2020-04-22T14:16:49.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.011+0000 7f0df7fbf700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df0153c50 con 0x7f0ddc0044d0 2020-04-22T14:16:49.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.011+0000 7f0df655c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0ddc0044d0 0x7f0df0062d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:49.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.011+0000 7f0df655c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0ddc0044d0 0x7f0df0062d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56732/0 (socket says 172.21.15.103:56732) 2020-04-22T14:16:49.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.011+0000 7f0df655c700 1 -- 172.21.15.103:0/2757124759 learned_addr learned my addr 172.21.15.103:0/2757124759 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:49.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.011+0000 7f0df6d5d700 1 --1- 172.21.15.103:0/2757124759 >> v1:172.21.15.103:6789/0 conn(0x7f0df00b6ca0 0x7f0df011e8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48922/0 (socket says 172.21.15.103:48922) 2020-04-22T14:16:49.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.011+0000 7f0df5d5b700 1 --2- 172.21.15.103:0/2757124759 >> v2:172.21.15.86:3300/0 conn(0x7f0df0066420 0x7f0df0153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:49.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.011+0000 7f0df655c700 1 -- 172.21.15.103:0/2757124759 >> v2:172.21.15.86:3300/0 conn(0x7f0df0066420 msgr2=0x7f0df0153000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:49.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.011+0000 7f0df655c700 1 --2- 172.21.15.103:0/2757124759 >> v2:172.21.15.86:3300/0 conn(0x7f0df0066420 0x7f0df0153000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:49.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.011+0000 7f0df655c700 1 -- 172.21.15.103:0/2757124759 >> v1:172.21.15.103:6789/0 conn(0x7f0df00b6ca0 legacy=0x7f0df011e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:49.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.011+0000 7f0df655c700 1 -- 172.21.15.103:0/2757124759 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df0153460 con 0x7f0ddc0044d0 2020-04-22T14:16:49.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.011+0000 7f0de6ffd700 1 -- 172.21.15.103:0/2757124759 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2514942540 0 0) 0x7f0df0153710 con 0x7f0df00b6ca0 2020-04-22T14:16:49.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.012+0000 7f0df655c700 1 --2- 172.21.15.103:0/2757124759 >> v2:172.21.15.103:3300/0 conn(0x7f0ddc0044d0 0x7f0df0062d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0df00ad5a0 tx=0x7f0dec001480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.012+0000 7f0df655c700 1 --2- 172.21.15.103:0/2757124759 >> v2:172.21.15.103:3300/0 conn(0x7f0ddc0044d0 0x7f0df0062d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0df00ad5a0 tx=0x7f0dec001480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.012+0000 7f0df655c700 1 --2- 172.21.15.103:0/2757124759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ddc0044d0 0x7f0df0062d90 secure :-1 s=READY pgs=1759 cs=0 l=1 rx=0x7f0df00ad5a0 tx=0x7f0dec001480).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:49.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.012+0000 7f0df655c700 1 --2- 172.21.15.103:0/2757124759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ddc0044d0 0x7f0df0062d90 secure :-1 s=THROTTLE_DONE pgs=1759 cs=0 l=1 rx=0x7f0df00ad5a0 tx=0x7f0dec001480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.012+0000 7f0de6ffd700 1 -- 172.21.15.103:0/2757124759 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dec00aaf0 con 0x7f0ddc0044d0 2020-04-22T14:16:49.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.012+0000 7f0df655c700 1 --2- 172.21.15.103:0/2757124759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ddc0044d0 0x7f0df0062d90 secure :-1 s=THROTTLE_DONE pgs=1759 cs=0 l=1 rx=0x7f0df00ad5a0 tx=0x7f0dec001480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.012+0000 7f0df655c700 1 --2- 172.21.15.103:0/2757124759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ddc0044d0 0x7f0df0062d90 secure :-1 s=THROTTLE_DONE pgs=1759 cs=0 l=1 rx=0x7f0df00ad5a0 tx=0x7f0dec001480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.012+0000 7f0de6ffd700 1 -- 172.21.15.103:0/2757124759 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dec00ac50 con 0x7f0ddc0044d0 2020-04-22T14:16:49.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.012+0000 7f0df7fbf700 1 -- 172.21.15.103:0/2757124759 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df0065650 con 0x7f0ddc0044d0 2020-04-22T14:16:49.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.012+0000 7f0de6ffd700 1 -- 172.21.15.103:0/2757124759 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dec0146b0 con 0x7f0ddc0044d0 2020-04-22T14:16:49.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.012+0000 7f0df7fbf700 1 -- 172.21.15.103:0/2757124759 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0df00b72a0 con 0x7f0ddc0044d0 2020-04-22T14:16:49.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.013+0000 7f0df655c700 1 --2- 172.21.15.103:0/2757124759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ddc0044d0 0x7f0df0062d90 secure :-1 s=THROTTLE_DONE pgs=1759 cs=0 l=1 rx=0x7f0df00ad5a0 tx=0x7f0dec001480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.013+0000 7f0de6ffd700 1 -- 172.21.15.103:0/2757124759 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f0dec014810 con 0x7f0ddc0044d0 2020-04-22T14:16:49.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.013+0000 7f0df655c700 1 --2- 172.21.15.103:0/2757124759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ddc0044d0 0x7f0df0062d90 secure :-1 s=THROTTLE_DONE pgs=1759 cs=0 l=1 rx=0x7f0df00ad5a0 tx=0x7f0dec001480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.013+0000 7f0df7fbf700 1 -- 172.21.15.103:0/2757124759 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0df0066800 con 0x7f0ddc0044d0 2020-04-22T14:16:49.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.013+0000 7f0de6ffd700 1 --2- 172.21.15.103:0/2757124759 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0dd804d8e0 0x7f0dd804fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:49.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.013+0000 7f0de6ffd700 1 -- 172.21.15.103:0/2757124759 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0dec063440 con 0x7f0ddc0044d0 2020-04-22T14:16:49.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.013+0000 7f0df5d5b700 1 --2- 172.21.15.103:0/2757124759 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0dd804d8e0 0x7f0dd804fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:49.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.014+0000 7f0df5d5b700 1 --2- 172.21.15.103:0/2757124759 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0dd804d8e0 0x7f0dd804fda0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0ddc0054a0 tx=0x7f0df005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.014+0000 7f0df5d5b700 1 --2- 172.21.15.103:0/2757124759 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0dd804d8e0 0x7f0dd804fda0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0ddc0054a0 tx=0x7f0df005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.014+0000 7f0df5d5b700 1 --2- 172.21.15.103:0/2757124759 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0dd804d8e0 0x7f0dd804fda0 secure :-1 s=READY pgs=638 cs=0 l=1 rx=0x7f0ddc0054a0 tx=0x7f0df005a720).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:49.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.017+0000 7f0df655c700 1 --2- 172.21.15.103:0/2757124759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ddc0044d0 0x7f0df0062d90 secure :-1 s=THROTTLE_DONE pgs=1759 cs=0 l=1 rx=0x7f0df00ad5a0 tx=0x7f0dec001480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.017+0000 7f0de6ffd700 1 -- 172.21.15.103:0/2757124759 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f0dec03e880 con 0x7f0ddc0044d0 2020-04-22T14:16:49.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.208+0000 7f0df7fbf700 1 -- 172.21.15.103:0/2757124759 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f0df0154010 con 0x7f0ddc0044d0 2020-04-22T14:16:49.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.213+0000 7f0df655c700 1 --2- 172.21.15.103:0/2757124759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ddc0044d0 0x7f0df0062d90 secure :-1 s=THROTTLE_DONE pgs=1759 cs=0 l=1 rx=0x7f0df00ad5a0 tx=0x7f0dec001480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.216 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.213+0000 7f0de6ffd700 1 -- 172.21.15.103:0/2757124759 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v45) v1 ==== 184+0+0 (secure 0 0 0) 0x7f0dec041ea0 con 0x7f0ddc0044d0 2020-04-22T14:16:49.217 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.215+0000 7f0df7fbf700 1 -- 172.21.15.103:0/2757124759 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0dd804d8e0 msgr2=0x7f0dd804fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:49.217 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.215+0000 7f0df7fbf700 1 --2- 172.21.15.103:0/2757124759 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0dd804d8e0 0x7f0dd804fda0 secure :-1 s=READY pgs=638 cs=0 l=1 rx=0x7f0ddc0054a0 tx=0x7f0df005a720).stop 2020-04-22T14:16:49.226 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.215+0000 7f0df7fbf700 1 -- 172.21.15.103:0/2757124759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ddc0044d0 msgr2=0x7f0df0062d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:49.226 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.215+0000 7f0df7fbf700 1 --2- 172.21.15.103:0/2757124759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ddc0044d0 0x7f0df0062d90 secure :-1 s=READY pgs=1759 cs=0 l=1 rx=0x7f0df00ad5a0 tx=0x7f0dec001480).stop 2020-04-22T14:16:49.226 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.215+0000 7f0df7fbf700 1 -- 172.21.15.103:0/2757124759 shutdown_connections 2020-04-22T14:16:49.226 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.215+0000 7f0df7fbf700 1 --2- 172.21.15.103:0/2757124759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ddc0044d0 0x7f0df0062d90 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:49.227 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.215+0000 7f0df7fbf700 1 --2- 172.21.15.103:0/2757124759 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0dd804d8e0 0x7f0dd804fda0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:49.227 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.215+0000 7f0df7fbf700 1 --2- 172.21.15.103:0/2757124759 >> v2:172.21.15.86:3300/0 conn(0x7f0df0066420 0x7f0df0153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:49.227 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.215+0000 7f0df7fbf700 1 -- 172.21.15.103:0/2757124759 >> 172.21.15.103:0/2757124759 conn(0x7f0df005ad30 msgr2=0x7f0df00aca10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:49.227 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.215+0000 7f0df7fbf700 1 -- 172.21.15.103:0/2757124759 shutdown_connections 2020-04-22T14:16:49.227 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.215+0000 7f0df7fbf700 1 -- 172.21.15.103:0/2757124759 wait complete. 2020-04-22T14:16:49.228 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.0 2020-04-22T14:16:49.229 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:49.245 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:16:49.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.395+0000 7f089710f700 1 Processor -- start 2020-04-22T14:16:49.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.395+0000 7f089710f700 1 -- start start 2020-04-22T14:16:49.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.396+0000 7f089710f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0890152a90 0x7f08900b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:49.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.396+0000 7f089710f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f08900adf50 0x7f08900ae3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:49.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.396+0000 7f089710f700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08900614f0 con 0x7f0890062170 2020-04-22T14:16:49.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.396+0000 7f089710f700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0890061790 con 0x7f08900adf50 2020-04-22T14:16:49.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.396+0000 7f089710f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0890061a30 con 0x7f0890152a90 2020-04-22T14:16:49.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.396+0000 7f08956ac700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0890152a90 0x7f08900b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:49.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.396+0000 7f0894eab700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f0890062170 0x7f08900b4db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48928/0 (socket says 172.21.15.103:48928) 2020-04-22T14:16:49.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.396+0000 7f08956ac700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0890152a90 0x7f08900b44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56738/0 (socket says 172.21.15.103:56738) 2020-04-22T14:16:49.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.396+0000 7f0894eab700 1 -- 172.21.15.103:0/3019551222 learned_addr learned my addr 172.21.15.103:0/3019551222 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:49.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.396+0000 7f0895ead700 1 --2- 172.21.15.103:0/3019551222 >> v2:172.21.15.86:3300/0 conn(0x7f08900adf50 0x7f08900ae3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:49.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.396+0000 7f08956ac700 1 -- 172.21.15.103:0/3019551222 >> v2:172.21.15.86:3300/0 conn(0x7f08900adf50 msgr2=0x7f08900ae3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:49.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.396+0000 7f08956ac700 1 --2- 172.21.15.103:0/3019551222 >> v2:172.21.15.86:3300/0 conn(0x7f08900adf50 0x7f08900ae3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:49.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.396+0000 7f08956ac700 1 -- 172.21.15.103:0/3019551222 >> v1:172.21.15.103:6789/0 conn(0x7f0890062170 legacy=0x7f08900b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:49.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.396+0000 7f08956ac700 1 -- 172.21.15.103:0/3019551222 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0890061cd0 con 0x7f0890152a90 2020-04-22T14:16:49.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.396+0000 7f0887fff700 1 -- 172.21.15.103:0/3019551222 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1692003714 0 0) 0x7f08900614f0 con 0x7f0890062170 2020-04-22T14:16:49.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.397+0000 7f08956ac700 1 --2- 172.21.15.103:0/3019551222 >> v2:172.21.15.103:3300/0 conn(0x7f0890152a90 0x7f08900b44d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f088c0032b0 tx=0x7f088c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.397+0000 7f08956ac700 1 --2- 172.21.15.103:0/3019551222 >> v2:172.21.15.103:3300/0 conn(0x7f0890152a90 0x7f08900b44d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f088c0032b0 tx=0x7f088c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.397+0000 7f08956ac700 1 --2- 172.21.15.103:0/3019551222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0890152a90 0x7f08900b44d0 secure :-1 s=READY pgs=1761 cs=0 l=1 rx=0x7f088c0032b0 tx=0x7f088c007dc0).ready entity=mon.1 client_cookie=dec72316cc885ea7 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:49.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.397+0000 7f08956ac700 1 --2- 172.21.15.103:0/3019551222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0890152a90 0x7f08900b44d0 secure :-1 s=THROTTLE_DONE pgs=1761 cs=0 l=1 rx=0x7f088c0032b0 tx=0x7f088c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.397+0000 7f0887fff700 1 -- 172.21.15.103:0/3019551222 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f088c00a180 con 0x7f0890152a90 2020-04-22T14:16:49.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.397+0000 7f08956ac700 1 --2- 172.21.15.103:0/3019551222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0890152a90 0x7f08900b44d0 secure :-1 s=THROTTLE_DONE pgs=1761 cs=0 l=1 rx=0x7f088c0032b0 tx=0x7f088c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.397+0000 7f0887fff700 1 -- 172.21.15.103:0/3019551222 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088c00a2e0 con 0x7f0890152a90 2020-04-22T14:16:49.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.397+0000 7f08956ac700 1 --2- 172.21.15.103:0/3019551222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0890152a90 0x7f08900b44d0 secure :-1 s=THROTTLE_DONE pgs=1761 cs=0 l=1 rx=0x7f088c0032b0 tx=0x7f088c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.397+0000 7f0887fff700 1 -- 172.21.15.103:0/3019551222 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f088c00a6c0 con 0x7f0890152a90 2020-04-22T14:16:49.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.397+0000 7f089710f700 1 -- 172.21.15.103:0/3019551222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0890152a90 msgr2=0x7f08900b44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:49.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.397+0000 7f089710f700 1 --2- 172.21.15.103:0/3019551222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0890152a90 0x7f08900b44d0 secure :-1 s=READY pgs=1761 cs=0 l=1 rx=0x7f088c0032b0 tx=0x7f088c007dc0).stop 2020-04-22T14:16:49.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.397+0000 7f089710f700 1 -- 172.21.15.103:0/3019551222 shutdown_connections 2020-04-22T14:16:49.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.397+0000 7f089710f700 1 --2- 172.21.15.103:0/3019551222 >> v2:172.21.15.86:3300/0 conn(0x7f08900adf50 0x7f08900ae3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:49.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.397+0000 7f089710f700 1 --2- 172.21.15.103:0/3019551222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0890152a90 0x7f08900b44d0 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:49.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.397+0000 7f089710f700 1 -- 172.21.15.103:0/3019551222 >> 172.21.15.103:0/3019551222 conn(0x7f089005ad30 msgr2=0x7f089005b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:49.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.397+0000 7f089710f700 1 -- 172.21.15.103:0/3019551222 shutdown_connections 2020-04-22T14:16:49.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.397+0000 7f089710f700 1 -- 172.21.15.103:0/3019551222 wait complete. 2020-04-22T14:16:49.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.398+0000 7f089710f700 1 Processor -- start 2020-04-22T14:16:49.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.398+0000 7f089710f700 1 -- start start 2020-04-22T14:16:49.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.399+0000 7f089710f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0890062170 0x7f0890155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:49.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.399+0000 7f089710f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0890152a90 0x7f08900b2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:49.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.399+0000 7f089710f700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0890154400 con 0x7f08900adf50 2020-04-22T14:16:49.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.399+0000 7f089710f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08900b29a0 con 0x7f0890062170 2020-04-22T14:16:49.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.399+0000 7f089710f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0890122580 con 0x7f0890152a90 2020-04-22T14:16:49.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.399+0000 7f08956ac700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0890062170 0x7f0890155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:49.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.399+0000 7f08956ac700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0890062170 0x7f0890155a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56742/0 (socket says 172.21.15.103:56742) 2020-04-22T14:16:49.417 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.399+0000 7f08956ac700 1 -- 172.21.15.103:0/3542567359 learned_addr learned my addr 172.21.15.103:0/3542567359 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:49.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.400+0000 7f0895ead700 1 --2- 172.21.15.103:0/3542567359 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0890152a90 0x7f08900b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:49.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.400+0000 7f08956ac700 1 -- 172.21.15.103:0/3542567359 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0890152a90 msgr2=0x7f08900b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:49.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.400+0000 7f08956ac700 1 --2- 172.21.15.103:0/3542567359 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0890152a90 0x7f08900b2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:49.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.400+0000 7f08956ac700 1 -- 172.21.15.103:0/3542567359 >> v1:172.21.15.86:6789/0 conn(0x7f08900adf50 legacy=0x7f08901514d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:49.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.400+0000 7f08956ac700 1 -- 172.21.15.103:0/3542567359 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0890122040 con 0x7f0890062170 2020-04-22T14:16:49.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.400+0000 7f0895ead700 1 --2- 172.21.15.103:0/3542567359 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0890152a90 0x7f08900b2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:16:49.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.400+0000 7f08956ac700 1 --2- 172.21.15.103:0/3542567359 >> v2:172.21.15.103:3300/0 conn(0x7f0890062170 0x7f0890155a50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0890152260 tx=0x7f088c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.400+0000 7f08956ac700 1 --2- 172.21.15.103:0/3542567359 >> v2:172.21.15.103:3300/0 conn(0x7f0890062170 0x7f0890155a50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0890152260 tx=0x7f088c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.400+0000 7f08956ac700 1 --2- 172.21.15.103:0/3542567359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0890062170 0x7f0890155a50 secure :-1 s=READY pgs=1762 cs=0 l=1 rx=0x7f0890152260 tx=0x7f088c007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:49.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.400+0000 7f08956ac700 1 --2- 172.21.15.103:0/3542567359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0890062170 0x7f0890155a50 secure :-1 s=THROTTLE_DONE pgs=1762 cs=0 l=1 rx=0x7f0890152260 tx=0x7f088c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.400+0000 7f08956ac700 1 --2- 172.21.15.103:0/3542567359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0890062170 0x7f0890155a50 secure :-1 s=THROTTLE_DONE pgs=1762 cs=0 l=1 rx=0x7f0890152260 tx=0x7f088c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.400+0000 7f0885ffb700 1 -- 172.21.15.103:0/3542567359 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f088c005c30 con 0x7f0890062170 2020-04-22T14:16:49.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.400+0000 7f08956ac700 1 --2- 172.21.15.103:0/3542567359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0890062170 0x7f0890155a50 secure :-1 s=THROTTLE_DONE pgs=1762 cs=0 l=1 rx=0x7f0890152260 tx=0x7f088c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.400+0000 7f0885ffb700 1 -- 172.21.15.103:0/3542567359 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088c005d90 con 0x7f0890062170 2020-04-22T14:16:49.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.400+0000 7f089710f700 1 -- 172.21.15.103:0/3542567359 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08901222e0 con 0x7f0890062170 2020-04-22T14:16:49.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.400+0000 7f0885ffb700 1 -- 172.21.15.103:0/3542567359 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f088c00f890 con 0x7f0890062170 2020-04-22T14:16:49.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.400+0000 7f089710f700 1 -- 172.21.15.103:0/3542567359 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08900b01e0 con 0x7f0890062170 2020-04-22T14:16:49.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.401+0000 7f08956ac700 1 --2- 172.21.15.103:0/3542567359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0890062170 0x7f0890155a50 secure :-1 s=THROTTLE_DONE pgs=1762 cs=0 l=1 rx=0x7f0890152260 tx=0x7f088c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.401+0000 7f089710f700 1 -- 172.21.15.103:0/3542567359 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08901545c0 con 0x7f0890062170 2020-04-22T14:16:49.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.401+0000 7f0885ffb700 1 -- 172.21.15.103:0/3542567359 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f088c00f9f0 con 0x7f0890062170 2020-04-22T14:16:49.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.401+0000 7f08956ac700 1 --2- 172.21.15.103:0/3542567359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0890062170 0x7f0890155a50 secure :-1 s=THROTTLE_DONE pgs=1762 cs=0 l=1 rx=0x7f0890152260 tx=0x7f088c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.401+0000 7f0885ffb700 1 --2- 172.21.15.103:0/3542567359 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f087004da60 0x7f087004ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:49.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.401+0000 7f0885ffb700 1 -- 172.21.15.103:0/3542567359 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f088c0625c0 con 0x7f0890062170 2020-04-22T14:16:49.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.402+0000 7f0894eab700 1 --2- 172.21.15.103:0/3542567359 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f087004da60 0x7f087004ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:49.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.402+0000 7f0894eab700 1 --2- 172.21.15.103:0/3542567359 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f087004da60 0x7f087004ff20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0880000b80 tx=0x7f089005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.402+0000 7f0894eab700 1 --2- 172.21.15.103:0/3542567359 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f087004da60 0x7f087004ff20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0880000b80 tx=0x7f089005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.402+0000 7f0894eab700 1 --2- 172.21.15.103:0/3542567359 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f087004da60 0x7f087004ff20 secure :-1 s=READY pgs=639 cs=0 l=1 rx=0x7f0880000b80 tx=0x7f089005a720).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:49.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.405+0000 7f08956ac700 1 --2- 172.21.15.103:0/3542567359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0890062170 0x7f0890155a50 secure :-1 s=THROTTLE_DONE pgs=1762 cs=0 l=1 rx=0x7f0890152260 tx=0x7f088c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.405+0000 7f0885ffb700 1 -- 172.21.15.103:0/3542567359 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f08901545c0 con 0x7f0890062170 2020-04-22T14:16:49.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.597+0000 7f089710f700 1 -- 172.21.15.103:0/3542567359 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f08901545c0 con 0x7f0890062170 2020-04-22T14:16:49.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.603+0000 7f08956ac700 1 --2- 172.21.15.103:0/3542567359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0890062170 0x7f0890155a50 secure :-1 s=THROTTLE_DONE pgs=1762 cs=0 l=1 rx=0x7f0890152260 tx=0x7f088c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.603+0000 7f0885ffb700 1 -- 172.21.15.103:0/3542567359 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v46) v1 ==== 184+0+0 (secure 0 0 0) 0x7f08901545c0 con 0x7f0890062170 2020-04-22T14:16:49.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.604+0000 7f089710f700 1 -- 172.21.15.103:0/3542567359 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f087004da60 msgr2=0x7f087004ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:49.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.604+0000 7f089710f700 1 --2- 172.21.15.103:0/3542567359 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f087004da60 0x7f087004ff20 secure :-1 s=READY pgs=639 cs=0 l=1 rx=0x7f0880000b80 tx=0x7f089005a720).stop 2020-04-22T14:16:49.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.604+0000 7f089710f700 1 -- 172.21.15.103:0/3542567359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0890062170 msgr2=0x7f0890155a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:49.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.604+0000 7f089710f700 1 --2- 172.21.15.103:0/3542567359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0890062170 0x7f0890155a50 secure :-1 s=READY pgs=1762 cs=0 l=1 rx=0x7f0890152260 tx=0x7f088c007dc0).stop 2020-04-22T14:16:49.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.604+0000 7f089710f700 1 -- 172.21.15.103:0/3542567359 shutdown_connections 2020-04-22T14:16:49.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.604+0000 7f089710f700 1 --2- 172.21.15.103:0/3542567359 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f087004da60 0x7f087004ff20 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:49.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.604+0000 7f089710f700 1 --2- 172.21.15.103:0/3542567359 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0890152a90 0x7f08900b2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:49.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.604+0000 7f089710f700 1 --2- 172.21.15.103:0/3542567359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0890062170 0x7f0890155a50 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:49.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.604+0000 7f089710f700 1 -- 172.21.15.103:0/3542567359 >> 172.21.15.103:0/3542567359 conn(0x7f089005ad30 msgr2=0x7f089005c640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:49.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.604+0000 7f089710f700 1 -- 172.21.15.103:0/3542567359 shutdown_connections 2020-04-22T14:16:49.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.604+0000 7f089710f700 1 -- 172.21.15.103:0/3542567359 wait complete. 2020-04-22T14:16:49.609 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.1 2020-04-22T14:16:49.617 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:49.630 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:16:49.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.780+0000 7ffa6ac6a700 1 Processor -- start 2020-04-22T14:16:49.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.780+0000 7ffa6ac6a700 1 -- start start 2020-04-22T14:16:49.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.780+0000 7ffa6ac6a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffa64152a90 0x7ffa640b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:49.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.780+0000 7ffa6ac6a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ffa64062170 0x7ffa640b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:49.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.781+0000 7ffa6ac6a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa64152e70 con 0x7ffa640b5210 2020-04-22T14:16:49.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.781+0000 7ffa6ac6a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa640b5680 con 0x7ffa64062170 2020-04-22T14:16:49.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.781+0000 7ffa6ac6a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa640614f0 con 0x7ffa64152a90 2020-04-22T14:16:49.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.781+0000 7ffa69207700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffa64152a90 0x7ffa640b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:49.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.781+0000 7ffa69207700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffa64152a90 0x7ffa640b44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56750/0 (socket says 172.21.15.103:56750) 2020-04-22T14:16:49.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.781+0000 7ffa69207700 1 -- 172.21.15.103:0/615427794 learned_addr learned my addr 172.21.15.103:0/615427794 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:49.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.781+0000 7ffa69207700 1 -- 172.21.15.103:0/615427794 >> v2:172.21.15.86:3300/0 conn(0x7ffa64062170 msgr2=0x7ffa640b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:49.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.781+0000 7ffa68a06700 1 --2- 172.21.15.103:0/615427794 >> v2:172.21.15.86:3300/0 conn(0x7ffa64062170 0x7ffa640b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:49.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.781+0000 7ffa69207700 1 --2- 172.21.15.103:0/615427794 >> v2:172.21.15.86:3300/0 conn(0x7ffa64062170 0x7ffa640b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:49.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.781+0000 7ffa69207700 1 -- 172.21.15.103:0/615427794 >> v1:172.21.15.86:6789/0 conn(0x7ffa640b5210 legacy=0x7ffa64156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:49.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.781+0000 7ffa69207700 1 -- 172.21.15.103:0/615427794 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa64061790 con 0x7ffa64152a90 2020-04-22T14:16:49.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.781+0000 7ffa68a06700 1 --2- 172.21.15.103:0/615427794 >> v2:172.21.15.86:3300/0 conn(0x7ffa64062170 0x7ffa640b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:16:49.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.781+0000 7ffa69207700 1 --2- 172.21.15.103:0/615427794 >> v2:172.21.15.103:3300/0 conn(0x7ffa64152a90 0x7ffa640b44d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ffa640ad5a0 tx=0x7ffa60007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.781+0000 7ffa69207700 1 --2- 172.21.15.103:0/615427794 >> v2:172.21.15.103:3300/0 conn(0x7ffa64152a90 0x7ffa640b44d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ffa640ad5a0 tx=0x7ffa60007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.781+0000 7ffa69207700 1 --2- 172.21.15.103:0/615427794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa64152a90 0x7ffa640b44d0 secure :-1 s=READY pgs=1763 cs=0 l=1 rx=0x7ffa640ad5a0 tx=0x7ffa60007a40).ready entity=mon.1 client_cookie=3d4fa32b79852f43 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:49.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.781+0000 7ffa69207700 1 --2- 172.21.15.103:0/615427794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa64152a90 0x7ffa640b44d0 secure :-1 s=THROTTLE_DONE pgs=1763 cs=0 l=1 rx=0x7ffa640ad5a0 tx=0x7ffa60007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.781+0000 7ffa69207700 1 --2- 172.21.15.103:0/615427794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa64152a90 0x7ffa640b44d0 secure :-1 s=THROTTLE_DONE pgs=1763 cs=0 l=1 rx=0x7ffa640ad5a0 tx=0x7ffa60007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.781+0000 7ffa5bfff700 1 -- 172.21.15.103:0/615427794 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa600116e0 con 0x7ffa64152a90 2020-04-22T14:16:49.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.781+0000 7ffa69207700 1 --2- 172.21.15.103:0/615427794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa64152a90 0x7ffa640b44d0 secure :-1 s=THROTTLE_DONE pgs=1763 cs=0 l=1 rx=0x7ffa640ad5a0 tx=0x7ffa60007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.781+0000 7ffa5bfff700 1 -- 172.21.15.103:0/615427794 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa60011840 con 0x7ffa64152a90 2020-04-22T14:16:49.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.781+0000 7ffa5bfff700 1 -- 172.21.15.103:0/615427794 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa60011c20 con 0x7ffa64152a90 2020-04-22T14:16:49.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.781+0000 7ffa6ac6a700 1 -- 172.21.15.103:0/615427794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa64152a90 msgr2=0x7ffa640b44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:49.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.781+0000 7ffa6ac6a700 1 --2- 172.21.15.103:0/615427794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa64152a90 0x7ffa640b44d0 secure :-1 s=READY pgs=1763 cs=0 l=1 rx=0x7ffa640ad5a0 tx=0x7ffa60007a40).stop 2020-04-22T14:16:49.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.782+0000 7ffa6ac6a700 1 -- 172.21.15.103:0/615427794 shutdown_connections 2020-04-22T14:16:49.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.782+0000 7ffa6ac6a700 1 --2- 172.21.15.103:0/615427794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa64152a90 0x7ffa640b44d0 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:49.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.782+0000 7ffa6ac6a700 1 --2- 172.21.15.103:0/615427794 >> v2:172.21.15.86:3300/0 conn(0x7ffa64062170 0x7ffa640b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:49.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.782+0000 7ffa6ac6a700 1 -- 172.21.15.103:0/615427794 >> 172.21.15.103:0/615427794 conn(0x7ffa6405ad30 msgr2=0x7ffa6405b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:49.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.782+0000 7ffa6ac6a700 1 -- 172.21.15.103:0/615427794 shutdown_connections 2020-04-22T14:16:49.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.782+0000 7ffa6ac6a700 1 -- 172.21.15.103:0/615427794 wait complete. 2020-04-22T14:16:49.792 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.783+0000 7ffa6ac6a700 1 Processor -- start 2020-04-22T14:16:49.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.783+0000 7ffa6ac6a700 1 -- start start 2020-04-22T14:16:49.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.784+0000 7ffa6ac6a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ffa64062170 0x7ffa64153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:49.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.784+0000 7ffa6ac6a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffa640b5210 0x7ffa6415ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:49.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.784+0000 7ffa6ac6a700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa640b2340 con 0x7ffa64152a90 2020-04-22T14:16:49.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.784+0000 7ffa6ac6a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa640b0900 con 0x7ffa64062170 2020-04-22T14:16:49.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.784+0000 7ffa6ac6a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa640b25e0 con 0x7ffa640b5210 2020-04-22T14:16:49.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.784+0000 7ffa68a06700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffa640b5210 0x7ffa6415ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:49.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.784+0000 7ffa68a06700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffa640b5210 0x7ffa6415ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56756/0 (socket says 172.21.15.103:56756) 2020-04-22T14:16:49.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.784+0000 7ffa68a06700 1 -- 172.21.15.103:0/2528241632 learned_addr learned my addr 172.21.15.103:0/2528241632 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:49.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.784+0000 7ffa69207700 1 --2- 172.21.15.103:0/2528241632 >> v2:172.21.15.86:3300/0 conn(0x7ffa64062170 0x7ffa64153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:49.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.784+0000 7ffa68a06700 1 -- 172.21.15.103:0/2528241632 >> v2:172.21.15.86:3300/0 conn(0x7ffa64062170 msgr2=0x7ffa64153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:49.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.784+0000 7ffa68a06700 1 --2- 172.21.15.103:0/2528241632 >> v2:172.21.15.86:3300/0 conn(0x7ffa64062170 0x7ffa64153070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:49.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.784+0000 7ffa68a06700 1 -- 172.21.15.103:0/2528241632 >> v1:172.21.15.103:6789/0 conn(0x7ffa64152a90 legacy=0x7ffa64126b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:49.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.784+0000 7ffa68a06700 1 -- 172.21.15.103:0/2528241632 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa640b2880 con 0x7ffa640b5210 2020-04-22T14:16:49.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.784+0000 7ffa59ffb700 1 -- 172.21.15.103:0/2528241632 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1609427339 0 0) 0x7ffa640b2340 con 0x7ffa64152a90 2020-04-22T14:16:49.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.784+0000 7ffa68a06700 1 --2- 172.21.15.103:0/2528241632 >> v2:172.21.15.103:3300/0 conn(0x7ffa640b5210 0x7ffa6415ce10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffa54002f30 tx=0x7ffa6405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.784+0000 7ffa68a06700 1 --2- 172.21.15.103:0/2528241632 >> v2:172.21.15.103:3300/0 conn(0x7ffa640b5210 0x7ffa6415ce10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffa54002f30 tx=0x7ffa6405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.784+0000 7ffa68a06700 1 --2- 172.21.15.103:0/2528241632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa640b5210 0x7ffa6415ce10 secure :-1 s=READY pgs=1765 cs=0 l=1 rx=0x7ffa54002f30 tx=0x7ffa6405a720).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:49.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.784+0000 7ffa68a06700 1 --2- 172.21.15.103:0/2528241632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa640b5210 0x7ffa6415ce10 secure :-1 s=THROTTLE_DONE pgs=1765 cs=0 l=1 rx=0x7ffa54002f30 tx=0x7ffa6405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.784+0000 7ffa59ffb700 1 -- 172.21.15.103:0/2528241632 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa54007180 con 0x7ffa640b5210 2020-04-22T14:16:49.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.784+0000 7ffa68a06700 1 --2- 172.21.15.103:0/2528241632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa640b5210 0x7ffa6415ce10 secure :-1 s=THROTTLE_DONE pgs=1765 cs=0 l=1 rx=0x7ffa54002f30 tx=0x7ffa6405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.784+0000 7ffa68a06700 1 --2- 172.21.15.103:0/2528241632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa640b5210 0x7ffa6415ce10 secure :-1 s=THROTTLE_DONE pgs=1765 cs=0 l=1 rx=0x7ffa54002f30 tx=0x7ffa6405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.784+0000 7ffa59ffb700 1 -- 172.21.15.103:0/2528241632 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa540072e0 con 0x7ffa640b5210 2020-04-22T14:16:49.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.784+0000 7ffa59ffb700 1 -- 172.21.15.103:0/2528241632 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa540059c0 con 0x7ffa640b5210 2020-04-22T14:16:49.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.784+0000 7ffa6ac6a700 1 -- 172.21.15.103:0/2528241632 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa64062880 con 0x7ffa640b5210 2020-04-22T14:16:49.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.785+0000 7ffa6ac6a700 1 -- 172.21.15.103:0/2528241632 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa64127230 con 0x7ffa640b5210 2020-04-22T14:16:49.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.785+0000 7ffa68a06700 1 --2- 172.21.15.103:0/2528241632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa640b5210 0x7ffa6415ce10 secure :-1 s=THROTTLE_DONE pgs=1765 cs=0 l=1 rx=0x7ffa54002f30 tx=0x7ffa6405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.785+0000 7ffa59ffb700 1 -- 172.21.15.103:0/2528241632 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ffa54005c30 con 0x7ffa640b5210 2020-04-22T14:16:49.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.785+0000 7ffa68a06700 1 --2- 172.21.15.103:0/2528241632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa640b5210 0x7ffa6415ce10 secure :-1 s=THROTTLE_DONE pgs=1765 cs=0 l=1 rx=0x7ffa54002f30 tx=0x7ffa6405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.786+0000 7ffa6ac6a700 1 -- 172.21.15.103:0/2528241632 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa64056c90 con 0x7ffa640b5210 2020-04-22T14:16:49.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.786+0000 7ffa59ffb700 1 --2- 172.21.15.103:0/2528241632 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffa4404d7a0 0x7ffa4404fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:49.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.786+0000 7ffa59ffb700 1 -- 172.21.15.103:0/2528241632 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ffa540612b0 con 0x7ffa640b5210 2020-04-22T14:16:49.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.786+0000 7ffa69207700 1 --2- 172.21.15.103:0/2528241632 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffa4404d7a0 0x7ffa4404fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:49.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.786+0000 7ffa69207700 1 --2- 172.21.15.103:0/2528241632 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffa4404d7a0 0x7ffa4404fc60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffa640ad5a0 tx=0x7ffa60007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.786+0000 7ffa69207700 1 --2- 172.21.15.103:0/2528241632 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffa4404d7a0 0x7ffa4404fc60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffa640ad5a0 tx=0x7ffa60007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.786+0000 7ffa69207700 1 --2- 172.21.15.103:0/2528241632 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffa4404d7a0 0x7ffa4404fc60 secure :-1 s=READY pgs=640 cs=0 l=1 rx=0x7ffa640ad5a0 tx=0x7ffa60007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:49.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.790+0000 7ffa68a06700 1 --2- 172.21.15.103:0/2528241632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa640b5210 0x7ffa6415ce10 secure :-1 s=THROTTLE_DONE pgs=1765 cs=0 l=1 rx=0x7ffa54002f30 tx=0x7ffa6405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.790+0000 7ffa59ffb700 1 -- 172.21.15.103:0/2528241632 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ffa5403c630 con 0x7ffa640b5210 2020-04-22T14:16:49.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.985+0000 7ffa6ac6a700 1 -- 172.21.15.103:0/2528241632 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7ffa6406a8b0 con 0x7ffa640b5210 2020-04-22T14:16:49.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.991+0000 7ffa68a06700 1 --2- 172.21.15.103:0/2528241632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa640b5210 0x7ffa6415ce10 secure :-1 s=THROTTLE_DONE pgs=1765 cs=0 l=1 rx=0x7ffa54002f30 tx=0x7ffa6405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:49.994 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.991+0000 7ffa59ffb700 1 -- 172.21.15.103:0/2528241632 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v47) v1 ==== 184+0+0 (secure 0 0 0) 0x7ffa5403fc50 con 0x7ffa640b5210 2020-04-22T14:16:49.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.992+0000 7ffa6ac6a700 1 -- 172.21.15.103:0/2528241632 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffa4404d7a0 msgr2=0x7ffa4404fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:49.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.992+0000 7ffa6ac6a700 1 --2- 172.21.15.103:0/2528241632 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffa4404d7a0 0x7ffa4404fc60 secure :-1 s=READY pgs=640 cs=0 l=1 rx=0x7ffa640ad5a0 tx=0x7ffa60007a40).stop 2020-04-22T14:16:49.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.992+0000 7ffa6ac6a700 1 -- 172.21.15.103:0/2528241632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa640b5210 msgr2=0x7ffa6415ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:49.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.992+0000 7ffa6ac6a700 1 --2- 172.21.15.103:0/2528241632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa640b5210 0x7ffa6415ce10 secure :-1 s=READY pgs=1765 cs=0 l=1 rx=0x7ffa54002f30 tx=0x7ffa6405a720).stop 2020-04-22T14:16:49.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.993+0000 7ffa6ac6a700 1 -- 172.21.15.103:0/2528241632 shutdown_connections 2020-04-22T14:16:49.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.993+0000 7ffa6ac6a700 1 --2- 172.21.15.103:0/2528241632 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffa4404d7a0 0x7ffa4404fc60 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:49.996 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.993+0000 7ffa6ac6a700 1 --2- 172.21.15.103:0/2528241632 >> v2:172.21.15.86:3300/0 conn(0x7ffa64062170 0x7ffa64153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:49.996 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.993+0000 7ffa6ac6a700 1 --2- 172.21.15.103:0/2528241632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa640b5210 0x7ffa6415ce10 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:49.996 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.993+0000 7ffa6ac6a700 1 -- 172.21.15.103:0/2528241632 >> 172.21.15.103:0/2528241632 conn(0x7ffa6405ad30 msgr2=0x7ffa64129ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:49.996 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.993+0000 7ffa6ac6a700 1 -- 172.21.15.103:0/2528241632 shutdown_connections 2020-04-22T14:16:49.996 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:49.993+0000 7ffa6ac6a700 1 -- 172.21.15.103:0/2528241632 wait complete. 2020-04-22T14:16:49.996 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.2 2020-04-22T14:16:50.005 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:50.018 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:16:50.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.168+0000 7f630f08c700 1 Processor -- start 2020-04-22T14:16:50.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.168+0000 7f630f08c700 1 -- start start 2020-04-22T14:16:50.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.169+0000 7f630f08c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f63080666e0 0x7f63080633c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:50.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.169+0000 7f630f08c700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6308025b90 con 0x7f63080b9880 2020-04-22T14:16:50.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.169+0000 7f630f08c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6308066ac0 con 0x7f63080b6f00 2020-04-22T14:16:50.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.169+0000 7f630f08c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6308024ea0 con 0x7f63080666e0 2020-04-22T14:16:50.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.170+0000 7f63102ee700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f63080b6f00 0x7f63081556f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48956/0 (socket says 172.21.15.103:48956) 2020-04-22T14:16:50.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.170+0000 7f63102ee700 1 -- 172.21.15.103:0/2324226485 learned_addr learned my addr 172.21.15.103:0/2324226485 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:50.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.170+0000 7f630e88b700 1 --2- 172.21.15.103:0/2324226485 >> v2:172.21.15.86:3300/0 conn(0x7f63080666e0 0x7f63080633c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:50.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.170+0000 7f630d889700 1 -- 172.21.15.103:0/2324226485 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2232187172 0 0) 0x7f6308066ac0 con 0x7f63080b6f00 2020-04-22T14:16:50.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.170+0000 7f630d889700 1 -- 172.21.15.103:0/2324226485 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62f0003230 con 0x7f63080b6f00 2020-04-22T14:16:50.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.170+0000 7f630d889700 1 -- 172.21.15.103:0/2324226485 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2866730042 0 0) 0x7f62f0003230 con 0x7f63080b6f00 2020-04-22T14:16:50.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.170+0000 7f630d889700 1 -- 172.21.15.103:0/2324226485 >> v2:172.21.15.86:3300/0 conn(0x7f63080666e0 msgr2=0x7f63080633c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:50.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.170+0000 7f630d889700 1 --2- 172.21.15.103:0/2324226485 >> v2:172.21.15.86:3300/0 conn(0x7f63080666e0 0x7f63080633c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:50.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.170+0000 7f630d889700 1 -- 172.21.15.103:0/2324226485 >> v1:172.21.15.86:6789/0 conn(0x7f63080b9880 legacy=0x7f6308154fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:50.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.170+0000 7f630d889700 1 -- 172.21.15.103:0/2324226485 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6308024c00 con 0x7f63080b6f00 2020-04-22T14:16:50.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.170+0000 7f630d889700 1 -- 172.21.15.103:0/2324226485 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f62f80016d0 con 0x7f63080b6f00 2020-04-22T14:16:50.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.170+0000 7f630d889700 1 -- 172.21.15.103:0/2324226485 >> v1:172.21.15.103:6789/0 conn(0x7f63080b6f00 legacy=0x7f63081556f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:50.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.170+0000 7f630d889700 1 --2- 172.21.15.103:0/2324226485 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f62f0003720 0x7f62f0003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:50.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.170+0000 7f630d889700 1 --2- 172.21.15.103:0/2324226485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62f00044d0 0x7f62f0004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:50.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.170+0000 7f630d889700 1 --2- 172.21.15.103:0/2324226485 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62f0004db0 0x7f62f000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:50.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.170+0000 7f630d889700 1 -- 172.21.15.103:0/2324226485 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6308024ea0 con 0x7f62f0004db0 2020-04-22T14:16:50.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.170+0000 7f630d889700 1 -- 172.21.15.103:0/2324226485 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f00041c0 con 0x7f62f00044d0 2020-04-22T14:16:50.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.170+0000 7f630d889700 1 -- 172.21.15.103:0/2324226485 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f004fb90 con 0x7f62f0003720 2020-04-22T14:16:50.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.170+0000 7f630e08a700 1 --2- 172.21.15.103:0/2324226485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62f00044d0 0x7f62f0004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:50.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.170+0000 7f63102ee700 1 --2- 172.21.15.103:0/2324226485 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62f0004db0 0x7f62f000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:50.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.170+0000 7f630e88b700 1 --2- 172.21.15.103:0/2324226485 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f62f0003720 0x7f62f0003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:50.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.170+0000 7f630e08a700 1 -- 172.21.15.103:0/2324226485 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f62f0003720 msgr2=0x7f62f0003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:50.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.170+0000 7f630e08a700 1 --2- 172.21.15.103:0/2324226485 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f62f0003720 0x7f62f0003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:50.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.170+0000 7f630e08a700 1 -- 172.21.15.103:0/2324226485 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62f0004db0 msgr2=0x7f62f000b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:50.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.170+0000 7f630e08a700 1 --2- 172.21.15.103:0/2324226485 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62f0004db0 0x7f62f000b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:50.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.170+0000 7f630e08a700 1 -- 172.21.15.103:0/2324226485 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f0003230 con 0x7f62f00044d0 2020-04-22T14:16:50.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.170+0000 7f63102ee700 1 -- 172.21.15.103:0/2324226485 reap_dead start 2020-04-22T14:16:50.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.170+0000 7f630e08a700 1 --2- 172.21.15.103:0/2324226485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62f00044d0 0x7f62f0004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f62f00054a0 tx=0x7f62fc00fd10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:50.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.171+0000 7f630e08a700 1 --2- 172.21.15.103:0/2324226485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62f00044d0 0x7f62f0004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f62f00054a0 tx=0x7f62fc00fd10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:50.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.171+0000 7f630e08a700 1 --2- 172.21.15.103:0/2324226485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62f00044d0 0x7f62f0004950 secure :-1 s=READY pgs=1767 cs=0 l=1 rx=0x7f62f00054a0 tx=0x7f62fc00fd10).ready entity=mon.1 client_cookie=8e39cd7c30de3746 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:50.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.171+0000 7f630e08a700 1 --2- 172.21.15.103:0/2324226485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62f00044d0 0x7f62f0004950 secure :-1 s=THROTTLE_DONE pgs=1767 cs=0 l=1 rx=0x7f62f00054a0 tx=0x7f62fc00fd10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:50.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.171+0000 7f630d889700 1 -- 172.21.15.103:0/2324226485 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62fc003560 con 0x7f62f00044d0 2020-04-22T14:16:50.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.171+0000 7f630e08a700 1 --2- 172.21.15.103:0/2324226485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62f00044d0 0x7f62f0004950 secure :-1 s=THROTTLE_DONE pgs=1767 cs=0 l=1 rx=0x7f62f00054a0 tx=0x7f62fc00fd10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:50.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.171+0000 7f630e08a700 1 --2- 172.21.15.103:0/2324226485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62f00044d0 0x7f62f0004950 secure :-1 s=THROTTLE_DONE pgs=1767 cs=0 l=1 rx=0x7f62f00054a0 tx=0x7f62fc00fd10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:50.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.171+0000 7f630d889700 1 -- 172.21.15.103:0/2324226485 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62fc0036c0 con 0x7f62f00044d0 2020-04-22T14:16:50.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.171+0000 7f630d889700 1 -- 172.21.15.103:0/2324226485 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62fc003aa0 con 0x7f62f00044d0 2020-04-22T14:16:50.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.171+0000 7f630f08c700 1 -- 172.21.15.103:0/2324226485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62f00044d0 msgr2=0x7f62f0004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:50.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.171+0000 7f630f08c700 1 --2- 172.21.15.103:0/2324226485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62f00044d0 0x7f62f0004950 secure :-1 s=READY pgs=1767 cs=0 l=1 rx=0x7f62f00054a0 tx=0x7f62fc00fd10).stop 2020-04-22T14:16:50.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.171+0000 7f630f08c700 1 -- 172.21.15.103:0/2324226485 shutdown_connections 2020-04-22T14:16:50.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.171+0000 7f630f08c700 1 --2- 172.21.15.103:0/2324226485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62f00044d0 0x7f62f0004950 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:50.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.171+0000 7f630f08c700 1 -- 172.21.15.103:0/2324226485 >> 172.21.15.103:0/2324226485 conn(0x7f6308060930 msgr2=0x7f6308060d40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:50.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.171+0000 7f630f08c700 1 -- 172.21.15.103:0/2324226485 shutdown_connections 2020-04-22T14:16:50.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.171+0000 7f630f08c700 1 -- 172.21.15.103:0/2324226485 wait complete. 2020-04-22T14:16:50.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.172+0000 7f630f08c700 1 Processor -- start 2020-04-22T14:16:50.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.172+0000 7f630f08c700 1 -- start start 2020-04-22T14:16:50.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.173+0000 7f630f08c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f62f00044d0 0x7f63080adc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:50.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.173+0000 7f630f08c700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63080afc90 con 0x7f63081164d0 2020-04-22T14:16:50.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.173+0000 7f630f08c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63080aff30 con 0x7f6308142dd0 2020-04-22T14:16:50.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.173+0000 7f630f08c700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6308116980 con 0x7f62f00044d0 2020-04-22T14:16:50.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.173+0000 7f630e88b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f62f00044d0 0x7f63080adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:50.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.173+0000 7f630e88b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f62f00044d0 0x7f63080adc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56774/0 (socket says 172.21.15.103:56774) 2020-04-22T14:16:50.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.173+0000 7f630e88b700 1 -- 172.21.15.103:0/3310225618 learned_addr learned my addr 172.21.15.103:0/3310225618 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:50.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.173+0000 7f63102ee700 1 --1- 172.21.15.103:0/3310225618 >> v1:172.21.15.103:6789/0 conn(0x7f6308142dd0 0x7f6308113ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48966/0 (socket says 172.21.15.103:48966) 2020-04-22T14:16:50.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.173+0000 7f630e88b700 1 -- 172.21.15.103:0/3310225618 >> v1:172.21.15.103:6789/0 conn(0x7f6308142dd0 legacy=0x7f6308113ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:50.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.173+0000 7f630e88b700 1 -- 172.21.15.103:0/3310225618 >> v1:172.21.15.86:6789/0 conn(0x7f63081164d0 legacy=0x7f63080b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:50.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.173+0000 7f630e88b700 1 -- 172.21.15.103:0/3310225618 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6308143260 con 0x7f62f00044d0 2020-04-22T14:16:50.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.173+0000 7f63077fe700 1 -- 172.21.15.103:0/3310225618 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3689136950 0 0) 0x7f63080aff30 con 0x7f6308142dd0 2020-04-22T14:16:50.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.173+0000 7f630e88b700 1 --2- 172.21.15.103:0/3310225618 >> v2:172.21.15.103:3300/0 conn(0x7f62f00044d0 0x7f63080adc60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6308115530 tx=0x7f63000132f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:50.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.174+0000 7f630e88b700 1 --2- 172.21.15.103:0/3310225618 >> v2:172.21.15.103:3300/0 conn(0x7f62f00044d0 0x7f63080adc60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6308115530 tx=0x7f63000132f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:50.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.174+0000 7f630e88b700 1 --2- 172.21.15.103:0/3310225618 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62f00044d0 0x7f63080adc60 secure :-1 s=READY pgs=1769 cs=0 l=1 rx=0x7f6308115530 tx=0x7f63000132f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:50.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.174+0000 7f630e88b700 1 --2- 172.21.15.103:0/3310225618 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62f00044d0 0x7f63080adc60 secure :-1 s=THROTTLE_DONE pgs=1769 cs=0 l=1 rx=0x7f6308115530 tx=0x7f63000132f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:50.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.174+0000 7f63077fe700 1 -- 172.21.15.103:0/3310225618 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6300005c30 con 0x7f62f00044d0 2020-04-22T14:16:50.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.174+0000 7f630e88b700 1 --2- 172.21.15.103:0/3310225618 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62f00044d0 0x7f63080adc60 secure :-1 s=THROTTLE_DONE pgs=1769 cs=0 l=1 rx=0x7f6308115530 tx=0x7f63000132f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:50.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.174+0000 7f630e88b700 1 --2- 172.21.15.103:0/3310225618 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62f00044d0 0x7f63080adc60 secure :-1 s=THROTTLE_DONE pgs=1769 cs=0 l=1 rx=0x7f6308115530 tx=0x7f63000132f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:50.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.174+0000 7f63077fe700 1 -- 172.21.15.103:0/3310225618 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6300005d90 con 0x7f62f00044d0 2020-04-22T14:16:50.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.174+0000 7f630f08c700 1 -- 172.21.15.103:0/3310225618 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63080b0ae0 con 0x7f62f00044d0 2020-04-22T14:16:50.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.174+0000 7f63077fe700 1 -- 172.21.15.103:0/3310225618 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f630000e370 con 0x7f62f00044d0 2020-04-22T14:16:50.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.174+0000 7f630f08c700 1 -- 172.21.15.103:0/3310225618 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63081151f0 con 0x7f62f00044d0 2020-04-22T14:16:50.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.174+0000 7f630e88b700 1 --2- 172.21.15.103:0/3310225618 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62f00044d0 0x7f63080adc60 secure :-1 s=THROTTLE_DONE pgs=1769 cs=0 l=1 rx=0x7f6308115530 tx=0x7f63000132f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:50.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.175+0000 7f63077fe700 1 -- 172.21.15.103:0/3310225618 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f630000e4d0 con 0x7f62f00044d0 2020-04-22T14:16:50.188 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.175+0000 7f630e88b700 1 --2- 172.21.15.103:0/3310225618 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62f00044d0 0x7f63080adc60 secure :-1 s=THROTTLE_DONE pgs=1769 cs=0 l=1 rx=0x7f6308115530 tx=0x7f63000132f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:50.188 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.175+0000 7f630f08c700 1 -- 172.21.15.103:0/3310225618 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6308056c90 con 0x7f62f00044d0 2020-04-22T14:16:50.188 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.175+0000 7f63077fe700 1 --2- 172.21.15.103:0/3310225618 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f62e804d8c0 0x7f62e804fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:50.188 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.175+0000 7f63077fe700 1 -- 172.21.15.103:0/3310225618 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f63000636e0 con 0x7f62f00044d0 2020-04-22T14:16:50.188 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.175+0000 7f630e08a700 1 --2- 172.21.15.103:0/3310225618 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f62e804d8c0 0x7f62e804fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:50.188 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.175+0000 7f630e08a700 1 --2- 172.21.15.103:0/3310225618 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f62e804d8c0 0x7f62e804fd80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f62f00054a0 tx=0x7f62fc00fd10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:50.188 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.176+0000 7f630e08a700 1 --2- 172.21.15.103:0/3310225618 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f62e804d8c0 0x7f62e804fd80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f62f00054a0 tx=0x7f62fc00fd10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:50.189 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.176+0000 7f630e08a700 1 --2- 172.21.15.103:0/3310225618 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f62e804d8c0 0x7f62e804fd80 secure :-1 s=READY pgs=641 cs=0 l=1 rx=0x7f62f00054a0 tx=0x7f62fc00fd10).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:50.189 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.179+0000 7f630e88b700 1 --2- 172.21.15.103:0/3310225618 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62f00044d0 0x7f63080adc60 secure :-1 s=THROTTLE_DONE pgs=1769 cs=0 l=1 rx=0x7f6308115530 tx=0x7f63000132f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:50.189 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.179+0000 7f63077fe700 1 -- 172.21.15.103:0/3310225618 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f630003eac0 con 0x7f62f00044d0 2020-04-22T14:16:50.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.370+0000 7f630f08c700 1 -- 172.21.15.103:0/3310225618 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f630806a8b0 con 0x7f62f00044d0 2020-04-22T14:16:50.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.375+0000 7f630e88b700 1 --2- 172.21.15.103:0/3310225618 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62f00044d0 0x7f63080adc60 secure :-1 s=THROTTLE_DONE pgs=1769 cs=0 l=1 rx=0x7f6308115530 tx=0x7f63000132f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:50.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.375+0000 7f63077fe700 1 -- 172.21.15.103:0/3310225618 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v48) v1 ==== 184+0+0 (secure 0 0 0) 0x7f63000420e0 con 0x7f62f00044d0 2020-04-22T14:16:50.378 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.376+0000 7f630f08c700 1 -- 172.21.15.103:0/3310225618 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f62e804d8c0 msgr2=0x7f62e804fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:50.379 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.376+0000 7f630f08c700 1 --2- 172.21.15.103:0/3310225618 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f62e804d8c0 0x7f62e804fd80 secure :-1 s=READY pgs=641 cs=0 l=1 rx=0x7f62f00054a0 tx=0x7f62fc00fd10).stop 2020-04-22T14:16:50.379 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.376+0000 7f630f08c700 1 -- 172.21.15.103:0/3310225618 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62f00044d0 msgr2=0x7f63080adc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:50.379 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.376+0000 7f630f08c700 1 --2- 172.21.15.103:0/3310225618 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62f00044d0 0x7f63080adc60 secure :-1 s=READY pgs=1769 cs=0 l=1 rx=0x7f6308115530 tx=0x7f63000132f0).stop 2020-04-22T14:16:50.379 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.376+0000 7f630f08c700 1 -- 172.21.15.103:0/3310225618 shutdown_connections 2020-04-22T14:16:50.379 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.376+0000 7f630f08c700 1 --2- 172.21.15.103:0/3310225618 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f62e804d8c0 0x7f62e804fd80 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:50.379 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.376+0000 7f630f08c700 1 --2- 172.21.15.103:0/3310225618 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62f00044d0 0x7f63080adc60 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:50.379 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.376+0000 7f630f08c700 1 -- 172.21.15.103:0/3310225618 >> 172.21.15.103:0/3310225618 conn(0x7f6308060930 msgr2=0x7f6308060d40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:50.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.376+0000 7f630f08c700 1 -- 172.21.15.103:0/3310225618 shutdown_connections 2020-04-22T14:16:50.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.376+0000 7f630f08c700 1 -- 172.21.15.103:0/3310225618 wait complete. 2020-04-22T14:16:50.380 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.3 2020-04-22T14:16:50.388 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:50.403 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:16:50.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.547+0000 7f7b58e2c700 1 Processor -- start 2020-04-22T14:16:50.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.547+0000 7f7b58e2c700 1 -- start start 2020-04-22T14:16:50.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.548+0000 7f7b58e2c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7b541464e0 0x7f7b54064540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:50.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.548+0000 7f7b58e2c700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b54143300 con 0x7f7b5412c0d0 2020-04-22T14:16:50.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.548+0000 7f7b58e2c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b541435a0 con 0x7f7b54065fe0 2020-04-22T14:16:50.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.548+0000 7f7b58e2c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b54143840 con 0x7f7b541464e0 2020-04-22T14:16:50.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.548+0000 7f7b51d9b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f7b54065fe0 0x7f7b54063e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48974/0 (socket says 172.21.15.103:48974) 2020-04-22T14:16:50.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.548+0000 7f7b51d9b700 1 -- 172.21.15.103:0/3384779026 learned_addr learned my addr 172.21.15.103:0/3384779026 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:50.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.548+0000 7f7b52d9d700 1 --2- 172.21.15.103:0/3384779026 >> v2:172.21.15.86:3300/0 conn(0x7f7b541464e0 0x7f7b54064540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:50.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.548+0000 7f7b5159a700 1 -- 172.21.15.103:0/3384779026 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3330028864 0 0) 0x7f7b541435a0 con 0x7f7b54065fe0 2020-04-22T14:16:50.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.548+0000 7f7b5159a700 1 -- 172.21.15.103:0/3384779026 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b34003230 con 0x7f7b54065fe0 2020-04-22T14:16:50.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.548+0000 7f7b5159a700 1 -- 172.21.15.103:0/3384779026 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1906576250 0 0) 0x7f7b34003230 con 0x7f7b54065fe0 2020-04-22T14:16:50.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.548+0000 7f7b5159a700 1 -- 172.21.15.103:0/3384779026 >> v2:172.21.15.86:3300/0 conn(0x7f7b541464e0 msgr2=0x7f7b54064540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:50.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.548+0000 7f7b5159a700 1 --2- 172.21.15.103:0/3384779026 >> v2:172.21.15.86:3300/0 conn(0x7f7b541464e0 0x7f7b54064540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:50.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.548+0000 7f7b5159a700 1 -- 172.21.15.103:0/3384779026 >> v1:172.21.15.86:6789/0 conn(0x7f7b5412c0d0 legacy=0x7f7b5405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:50.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.548+0000 7f7b5159a700 1 -- 172.21.15.103:0/3384779026 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b5405bb50 con 0x7f7b54065fe0 2020-04-22T14:16:50.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.548+0000 7f7b5159a700 1 -- 172.21.15.103:0/3384779026 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f7b440016d0 con 0x7f7b54065fe0 2020-04-22T14:16:50.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.548+0000 7f7b5159a700 1 -- 172.21.15.103:0/3384779026 >> v1:172.21.15.103:6789/0 conn(0x7f7b54065fe0 legacy=0x7f7b54063e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:50.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.548+0000 7f7b5159a700 1 --2- 172.21.15.103:0/3384779026 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b34003720 0x7f7b34003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:50.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.548+0000 7f7b5159a700 1 --2- 172.21.15.103:0/3384779026 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b340044d0 0x7f7b34004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:50.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.548+0000 7f7b5159a700 1 --2- 172.21.15.103:0/3384779026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b34004db0 0x7f7b3400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:50.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.548+0000 7f7b5159a700 1 -- 172.21.15.103:0/3384779026 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b54143840 con 0x7f7b340044d0 2020-04-22T14:16:50.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.548+0000 7f7b5159a700 1 -- 172.21.15.103:0/3384779026 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b340041f0 con 0x7f7b34004db0 2020-04-22T14:16:50.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.548+0000 7f7b5159a700 1 -- 172.21.15.103:0/3384779026 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3400bb80 con 0x7f7b34003720 2020-04-22T14:16:50.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.548+0000 7f7b52d9d700 1 --2- 172.21.15.103:0/3384779026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b34004db0 0x7f7b3400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:50.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.548+0000 7f7b51d9b700 1 --2- 172.21.15.103:0/3384779026 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b340044d0 0x7f7b34004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:50.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.548+0000 7f7b5259c700 1 --2- 172.21.15.103:0/3384779026 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b34003720 0x7f7b34003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:50.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.549+0000 7f7b52d9d700 1 -- 172.21.15.103:0/3384779026 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b34003720 msgr2=0x7f7b34003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:50.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.549+0000 7f7b52d9d700 1 --2- 172.21.15.103:0/3384779026 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b34003720 0x7f7b34003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:50.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.549+0000 7f7b52d9d700 1 -- 172.21.15.103:0/3384779026 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b340044d0 msgr2=0x7f7b34004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:50.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.549+0000 7f7b52d9d700 1 --2- 172.21.15.103:0/3384779026 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b340044d0 0x7f7b34004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:50.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.549+0000 7f7b52d9d700 1 -- 172.21.15.103:0/3384779026 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b34003230 con 0x7f7b34004db0 2020-04-22T14:16:50.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.549+0000 7f7b52d9d700 1 --2- 172.21.15.103:0/3384779026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b34004db0 0x7f7b3400b720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7b340054a0 tx=0x7f7b4c0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:50.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.549+0000 7f7b52d9d700 1 -- 172.21.15.103:0/3384779026 reap_dead start 2020-04-22T14:16:50.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.549+0000 7f7b52d9d700 1 --2- 172.21.15.103:0/3384779026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b34004db0 0x7f7b3400b720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7b340054a0 tx=0x7f7b4c0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:50.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.549+0000 7f7b52d9d700 1 --2- 172.21.15.103:0/3384779026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b34004db0 0x7f7b3400b720 secure :-1 s=READY pgs=1771 cs=0 l=1 rx=0x7f7b340054a0 tx=0x7f7b4c0103d0).ready entity=mon.1 client_cookie=8afd8e956d4411d4 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:50.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.549+0000 7f7b52d9d700 1 --2- 172.21.15.103:0/3384779026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b34004db0 0x7f7b3400b720 secure :-1 s=THROTTLE_DONE pgs=1771 cs=0 l=1 rx=0x7f7b340054a0 tx=0x7f7b4c0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:50.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.549+0000 7f7b52d9d700 1 --2- 172.21.15.103:0/3384779026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b34004db0 0x7f7b3400b720 secure :-1 s=THROTTLE_DONE pgs=1771 cs=0 l=1 rx=0x7f7b340054a0 tx=0x7f7b4c0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:50.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.549+0000 7f7b5159a700 1 -- 172.21.15.103:0/3384779026 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b4c005c30 con 0x7f7b34004db0 2020-04-22T14:16:50.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.549+0000 7f7b52d9d700 1 --2- 172.21.15.103:0/3384779026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b34004db0 0x7f7b3400b720 secure :-1 s=THROTTLE_DONE pgs=1771 cs=0 l=1 rx=0x7f7b340054a0 tx=0x7f7b4c0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:50.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.549+0000 7f7b5159a700 1 -- 172.21.15.103:0/3384779026 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4c005d90 con 0x7f7b34004db0 2020-04-22T14:16:50.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.549+0000 7f7b5159a700 1 -- 172.21.15.103:0/3384779026 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b4c0112c0 con 0x7f7b34004db0 2020-04-22T14:16:50.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.549+0000 7f7b58e2c700 1 -- 172.21.15.103:0/3384779026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b34004db0 msgr2=0x7f7b3400b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:50.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.549+0000 7f7b58e2c700 1 --2- 172.21.15.103:0/3384779026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b34004db0 0x7f7b3400b720 secure :-1 s=READY pgs=1771 cs=0 l=1 rx=0x7f7b340054a0 tx=0x7f7b4c0103d0).stop 2020-04-22T14:16:50.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.549+0000 7f7b58e2c700 1 -- 172.21.15.103:0/3384779026 shutdown_connections 2020-04-22T14:16:50.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.549+0000 7f7b58e2c700 1 --2- 172.21.15.103:0/3384779026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b34004db0 0x7f7b3400b720 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:50.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.549+0000 7f7b58e2c700 1 -- 172.21.15.103:0/3384779026 >> 172.21.15.103:0/3384779026 conn(0x7f7b540b9160 msgr2=0x7f7b5405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:50.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.549+0000 7f7b58e2c700 1 -- 172.21.15.103:0/3384779026 shutdown_connections 2020-04-22T14:16:50.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.550+0000 7f7b58e2c700 1 -- 172.21.15.103:0/3384779026 wait complete. 2020-04-22T14:16:50.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.550+0000 7f7b58e2c700 1 Processor -- start 2020-04-22T14:16:50.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.550+0000 7f7b58e2c700 1 -- start start 2020-04-22T14:16:50.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.551+0000 7f7b58e2c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b34004db0 0x7f7b540b04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:50.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.551+0000 7f7b58e2c700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b540b3d10 con 0x7f7b5412af30 2020-04-22T14:16:50.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.551+0000 7f7b58e2c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b540b37d0 con 0x7f7b540b2fa0 2020-04-22T14:16:50.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.551+0000 7f7b58e2c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b540b3a70 con 0x7f7b34004db0 2020-04-22T14:16:50.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.551+0000 7f7b51d9b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f7b540b2fa0 0x7f7b540b3f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48988/0 (socket says 172.21.15.103:48988) 2020-04-22T14:16:50.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.551+0000 7f7b51d9b700 1 -- 172.21.15.103:0/2074659939 learned_addr learned my addr 172.21.15.103:0/2074659939 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:50.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.551+0000 7f7b5259c700 1 --2- 172.21.15.103:0/2074659939 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b34004db0 0x7f7b540b04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:50.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.551+0000 7f7b4b7fe700 1 -- 172.21.15.103:0/2074659939 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3354142047 0 0) 0x7f7b540b37d0 con 0x7f7b540b2fa0 2020-04-22T14:16:50.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.551+0000 7f7b4b7fe700 1 -- 172.21.15.103:0/2074659939 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b38002fe0 con 0x7f7b540b2fa0 2020-04-22T14:16:50.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.552+0000 7f7b4b7fe700 1 -- 172.21.15.103:0/2074659939 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3838234228 0 0) 0x7f7b540b3d10 con 0x7f7b5412af30 2020-04-22T14:16:50.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.552+0000 7f7b4b7fe700 1 -- 172.21.15.103:0/2074659939 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b540b37d0 con 0x7f7b5412af30 2020-04-22T14:16:50.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.552+0000 7f7b5259c700 1 -- 172.21.15.103:0/2074659939 >> v1:172.21.15.103:6789/0 conn(0x7f7b540b2fa0 legacy=0x7f7b540b3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:50.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.552+0000 7f7b4b7fe700 1 -- 172.21.15.103:0/2074659939 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 116769982 0 0) 0x7f7b38002fe0 con 0x7f7b540b2fa0 2020-04-22T14:16:50.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.552+0000 7f7b5259c700 1 -- 172.21.15.103:0/2074659939 >> v1:172.21.15.86:6789/0 conn(0x7f7b5412af30 legacy=0x7f7b540ad3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:50.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.552+0000 7f7b5259c700 1 -- 172.21.15.103:0/2074659939 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b540b0930 con 0x7f7b34004db0 2020-04-22T14:16:50.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.552+0000 7f7b5259c700 1 --2- 172.21.15.103:0/2074659939 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b34004db0 0x7f7b540b04d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7b54067500 tx=0x7f7b3c0108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:50.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.552+0000 7f7b5259c700 1 --2- 172.21.15.103:0/2074659939 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b34004db0 0x7f7b540b04d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7b54067500 tx=0x7f7b3c0108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:50.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.552+0000 7f7b5259c700 1 --2- 172.21.15.103:0/2074659939 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b34004db0 0x7f7b540b04d0 secure :-1 s=READY pgs=171 cs=0 l=1 rx=0x7f7b54067500 tx=0x7f7b3c0108a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:50.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.552+0000 7f7b5259c700 1 --2- 172.21.15.103:0/2074659939 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b34004db0 0x7f7b540b04d0 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7f7b54067500 tx=0x7f7b3c0108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:50.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.552+0000 7f7b4b7fe700 1 -- 172.21.15.103:0/2074659939 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b3c006bc0 con 0x7f7b34004db0 2020-04-22T14:16:50.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.552+0000 7f7b5259c700 1 --2- 172.21.15.103:0/2074659939 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b34004db0 0x7f7b540b04d0 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7f7b54067500 tx=0x7f7b3c0108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:50.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.552+0000 7f7b4b7fe700 1 -- 172.21.15.103:0/2074659939 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3c011e90 con 0x7f7b34004db0 2020-04-22T14:16:50.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.552+0000 7f7b5259c700 1 --2- 172.21.15.103:0/2074659939 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b34004db0 0x7f7b540b04d0 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7f7b54067500 tx=0x7f7b3c0108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:50.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.552+0000 7f7b58e2c700 1 -- 172.21.15.103:0/2074659939 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b540b3420 con 0x7f7b34004db0 2020-04-22T14:16:50.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.552+0000 7f7b4b7fe700 1 -- 172.21.15.103:0/2074659939 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b3c010e20 con 0x7f7b34004db0 2020-04-22T14:16:50.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.552+0000 7f7b58e2c700 1 -- 172.21.15.103:0/2074659939 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b540b16e0 con 0x7f7b34004db0 2020-04-22T14:16:50.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.553+0000 7f7b5259c700 1 --2- 172.21.15.103:0/2074659939 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b34004db0 0x7f7b540b04d0 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7f7b54067500 tx=0x7f7b3c0108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:50.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.553+0000 7f7b4b7fe700 1 -- 172.21.15.103:0/2074659939 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f7b3c00b2c0 con 0x7f7b34004db0 2020-04-22T14:16:50.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.553+0000 7f7b5259c700 1 --2- 172.21.15.103:0/2074659939 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b34004db0 0x7f7b540b04d0 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7f7b54067500 tx=0x7f7b3c0108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:50.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.553+0000 7f7b58e2c700 1 -- 172.21.15.103:0/2074659939 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b54056c90 con 0x7f7b34004db0 2020-04-22T14:16:50.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.553+0000 7f7b4b7fe700 1 --2- 172.21.15.103:0/2074659939 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7b3804dde0 0x7f7b380502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:50.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.553+0000 7f7b4b7fe700 1 -- 172.21.15.103:0/2074659939 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7b3c061090 con 0x7f7b34004db0 2020-04-22T14:16:50.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.554+0000 7f7b51d9b700 1 --2- 172.21.15.103:0/2074659939 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7b3804dde0 0x7f7b380502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:50.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.554+0000 7f7b51d9b700 1 --2- 172.21.15.103:0/2074659939 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7b3804dde0 0x7f7b380502a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7b44001e80 tx=0x7f7b5405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:50.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.554+0000 7f7b51d9b700 1 --2- 172.21.15.103:0/2074659939 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7b3804dde0 0x7f7b380502a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7b44001e80 tx=0x7f7b5405bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:50.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.554+0000 7f7b51d9b700 1 --2- 172.21.15.103:0/2074659939 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7b3804dde0 0x7f7b380502a0 secure :-1 s=READY pgs=642 cs=0 l=1 rx=0x7f7b44001e80 tx=0x7f7b5405bce0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:50.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.557+0000 7f7b5259c700 1 --2- 172.21.15.103:0/2074659939 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b34004db0 0x7f7b540b04d0 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7f7b54067500 tx=0x7f7b3c0108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:50.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.557+0000 7f7b4b7fe700 1 -- 172.21.15.103:0/2074659939 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f7b3c03c4d0 con 0x7f7b34004db0 2020-04-22T14:16:50.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.747+0000 7f7b58e2c700 1 -- 172.21.15.103:0/2074659939 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b54147360 con 0x7f7b34004db0 2020-04-22T14:16:50.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.747+0000 7f7b5259c700 1 --2- 172.21.15.103:0/2074659939 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b34004db0 0x7f7b540b04d0 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7f7b54067500 tx=0x7f7b3c0108a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:50.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.747+0000 7f7b4b7fe700 1 -- 172.21.15.103:0/2074659939 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+2145 (secure 0 0 0) 0x7f7b3c03faf0 con 0x7f7b34004db0 2020-04-22T14:16:50.750 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:16:50.751 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":94,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6380,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/1697822737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1697822737},{"type":"v1","addr":"172.21.15.103:6833","nonce":1697822737}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":91}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:16:46.111567+0000","modified":"2020-04-22T14:16:48.114069+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8142},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8142":{"gid":8142,"name":"b","rank":0,"incarnation":92,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/3334539524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3334539524},{"type":"v1","addr":"172.21.15.86:6835","nonce":3334539524}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2020-04-22T14:16:50.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.749+0000 7f7b58e2c700 1 -- 172.21.15.103:0/2074659939 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7b3804dde0 msgr2=0x7f7b380502a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:50.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.749+0000 7f7b58e2c700 1 --2- 172.21.15.103:0/2074659939 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7b3804dde0 0x7f7b380502a0 secure :-1 s=READY pgs=642 cs=0 l=1 rx=0x7f7b44001e80 tx=0x7f7b5405bce0).stop 2020-04-22T14:16:50.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.749+0000 7f7b58e2c700 1 -- 172.21.15.103:0/2074659939 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b34004db0 msgr2=0x7f7b540b04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:50.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.749+0000 7f7b58e2c700 1 --2- 172.21.15.103:0/2074659939 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b34004db0 0x7f7b540b04d0 secure :-1 s=READY pgs=171 cs=0 l=1 rx=0x7f7b54067500 tx=0x7f7b3c0108a0).stop 2020-04-22T14:16:50.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.749+0000 7f7b58e2c700 1 -- 172.21.15.103:0/2074659939 shutdown_connections 2020-04-22T14:16:50.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.749+0000 7f7b58e2c700 1 --2- 172.21.15.103:0/2074659939 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7b3804dde0 0x7f7b380502a0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:50.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.749+0000 7f7b58e2c700 1 --2- 172.21.15.103:0/2074659939 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b34004db0 0x7f7b540b04d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:50.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.749+0000 7f7b58e2c700 1 -- 172.21.15.103:0/2074659939 >> 172.21.15.103:0/2074659939 conn(0x7f7b540b9160 msgr2=0x7f7b540615c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:50.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.749+0000 7f7b58e2c700 1 -- 172.21.15.103:0/2074659939 shutdown_connections 2020-04-22T14:16:50.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:50.749+0000 7f7b58e2c700 1 -- 172.21.15.103:0/2074659939 wait complete. 2020-04-22T14:16:50.765 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 94 2020-04-22T14:16:50.968 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 8142}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 21, u'failed': [], u'epoch': 94, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [22], u'info': {u'gid_8142': {u'export_targets': [], u'name': u'b', u'incarnation': 92, u'state_seq': 3, u'state': u'up:active', u'gid': 8142, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 3334539524, u'type': u'v2', u'addr': u'172.21.15.86:6834'}, {u'nonce': 3334539524, u'type': u'v1', u'addr': u'172.21.15.86:6835'}]}, u'addr': u'172.21.15.86:6835/3334539524'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:16:46.111567+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:16:48.114069+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:16:50.968 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:16:50.969 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:16:50.985 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2020-04-22T14:16:51.153 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2020-04-22T14:16:51.153 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:16:51.153 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 0, 2020-04-22T14:16:51.153 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 8142, 2020-04-22T14:16:51.154 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2020-04-22T14:16:51.154 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2020-04-22T14:16:51.154 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 5.038458586, 2020-04-22T14:16:51.154 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 94, 2020-04-22T14:16:51.154 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 124, 2020-04-22T14:16:51.154 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 124, 2020-04-22T14:16:51.154 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 10.236933107 2020-04-22T14:16:51.155 INFO:teuthology.orchestra.run.smithi086.stdout:} 2020-04-22T14:16:51.162 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 8142, "want_state": "up:active", "state": "up:active", "rank_uptime": 5.038458586, "mdsmap_epoch": 94, "osdmap_epoch": 124, "osdmap_epoch_barrier": 124, "uptime": 10.236933107 } 2020-04-22T14:16:51.163 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:51.178 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:16:51.324 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.322+0000 7fc75c11e700 1 Processor -- start 2020-04-22T14:16:51.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.322+0000 7fc75c11e700 1 -- start start 2020-04-22T14:16:51.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.323+0000 7fc75c11e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc7540b0ed0 0x7fc7540b70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:51.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.323+0000 7fc75c11e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc754064fd0 0x7fc754065450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:51.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.323+0000 7fc75c11e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7540b79f0 con 0x7fc7540b7540 2020-04-22T14:16:51.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.323+0000 7fc75c11e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7540b7c90 con 0x7fc754064fd0 2020-04-22T14:16:51.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.323+0000 7fc75c11e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7540b7f30 con 0x7fc7540b0ed0 2020-04-22T14:16:51.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.323+0000 7fc759eba700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc7540b0ed0 0x7fc7540b70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:51.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.323+0000 7fc759eba700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc7540b0ed0 0x7fc7540b70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56802/0 (socket says 172.21.15.103:56802) 2020-04-22T14:16:51.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.323+0000 7fc759eba700 1 -- 172.21.15.103:0/1520246129 learned_addr learned my addr 172.21.15.103:0/1520246129 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:51.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.323+0000 7fc75a6bb700 1 --2- 172.21.15.103:0/1520246129 >> v2:172.21.15.86:3300/0 conn(0x7fc754064fd0 0x7fc754065450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:51.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.324+0000 7fc759eba700 1 -- 172.21.15.103:0/1520246129 >> v2:172.21.15.86:3300/0 conn(0x7fc754064fd0 msgr2=0x7fc754065450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:51.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.324+0000 7fc759eba700 1 --2- 172.21.15.103:0/1520246129 >> v2:172.21.15.86:3300/0 conn(0x7fc754064fd0 0x7fc754065450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:51.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.324+0000 7fc759eba700 1 -- 172.21.15.103:0/1520246129 >> v1:172.21.15.86:6789/0 conn(0x7fc7540b7540 legacy=0x7fc754145960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:51.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.324+0000 7fc759eba700 1 -- 172.21.15.103:0/1520246129 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7540b12b0 con 0x7fc7540b0ed0 2020-04-22T14:16:51.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.324+0000 7fc75a6bb700 1 --2- 172.21.15.103:0/1520246129 >> v2:172.21.15.86:3300/0 conn(0x7fc754064fd0 0x7fc754065450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:16:51.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.324+0000 7fc759eba700 1 --2- 172.21.15.103:0/1520246129 >> v2:172.21.15.103:3300/0 conn(0x7fc7540b0ed0 0x7fc7540b70e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc750002f30 tx=0x7fc750007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:51.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.324+0000 7fc759eba700 1 --2- 172.21.15.103:0/1520246129 >> v2:172.21.15.103:3300/0 conn(0x7fc7540b0ed0 0x7fc7540b70e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc750002f30 tx=0x7fc750007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:51.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.324+0000 7fc759eba700 1 --2- 172.21.15.103:0/1520246129 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7540b0ed0 0x7fc7540b70e0 secure :-1 s=READY pgs=1773 cs=0 l=1 rx=0x7fc750002f30 tx=0x7fc750007a40).ready entity=mon.1 client_cookie=ae906d195d96561f server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:51.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.324+0000 7fc759eba700 1 --2- 172.21.15.103:0/1520246129 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7540b0ed0 0x7fc7540b70e0 secure :-1 s=THROTTLE_DONE pgs=1773 cs=0 l=1 rx=0x7fc750002f30 tx=0x7fc750007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:51.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.324+0000 7fc758eb8700 1 -- 172.21.15.103:0/1520246129 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc750011720 con 0x7fc7540b0ed0 2020-04-22T14:16:51.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.324+0000 7fc759eba700 1 --2- 172.21.15.103:0/1520246129 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7540b0ed0 0x7fc7540b70e0 secure :-1 s=THROTTLE_DONE pgs=1773 cs=0 l=1 rx=0x7fc750002f30 tx=0x7fc750007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:51.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.324+0000 7fc759eba700 1 --2- 172.21.15.103:0/1520246129 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7540b0ed0 0x7fc7540b70e0 secure :-1 s=THROTTLE_DONE pgs=1773 cs=0 l=1 rx=0x7fc750002f30 tx=0x7fc750007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:51.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.324+0000 7fc758eb8700 1 -- 172.21.15.103:0/1520246129 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc750011880 con 0x7fc7540b0ed0 2020-04-22T14:16:51.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.324+0000 7fc758eb8700 1 -- 172.21.15.103:0/1520246129 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc750011ca0 con 0x7fc7540b0ed0 2020-04-22T14:16:51.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.324+0000 7fc75c11e700 1 -- 172.21.15.103:0/1520246129 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7540b0ed0 msgr2=0x7fc7540b70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:51.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.324+0000 7fc75c11e700 1 --2- 172.21.15.103:0/1520246129 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7540b0ed0 0x7fc7540b70e0 secure :-1 s=READY pgs=1773 cs=0 l=1 rx=0x7fc750002f30 tx=0x7fc750007a40).stop 2020-04-22T14:16:51.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.324+0000 7fc75c11e700 1 -- 172.21.15.103:0/1520246129 shutdown_connections 2020-04-22T14:16:51.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.324+0000 7fc75c11e700 1 --2- 172.21.15.103:0/1520246129 >> v2:172.21.15.86:3300/0 conn(0x7fc754064fd0 0x7fc754065450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:51.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.324+0000 7fc75c11e700 1 --2- 172.21.15.103:0/1520246129 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7540b0ed0 0x7fc7540b70e0 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:51.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.324+0000 7fc75c11e700 1 -- 172.21.15.103:0/1520246129 >> 172.21.15.103:0/1520246129 conn(0x7fc75405f2c0 msgr2=0x7fc754061fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:51.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.324+0000 7fc75c11e700 1 -- 172.21.15.103:0/1520246129 shutdown_connections 2020-04-22T14:16:51.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.324+0000 7fc75c11e700 1 -- 172.21.15.103:0/1520246129 wait complete. 2020-04-22T14:16:51.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.325+0000 7fc75c11e700 1 Processor -- start 2020-04-22T14:16:51.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.325+0000 7fc75c11e700 1 -- start start 2020-04-22T14:16:51.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.326+0000 7fc75c11e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc754064fd0 0x7fc754113890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:51.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.326+0000 7fc75c11e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7540b7540 0x7fc754154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:51.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.326+0000 7fc75c11e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc754114c00 con 0x7fc7540b0ed0 2020-04-22T14:16:51.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.326+0000 7fc75c11e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc754154ad0 con 0x7fc754064fd0 2020-04-22T14:16:51.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.326+0000 7fc75c11e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc754153c90 con 0x7fc7540b7540 2020-04-22T14:16:51.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.326+0000 7fc759eba700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc754064fd0 0x7fc754113890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:51.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.326+0000 7fc759eba700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc754064fd0 0x7fc754113890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56808/0 (socket says 172.21.15.103:56808) 2020-04-22T14:16:51.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.326+0000 7fc759eba700 1 -- 172.21.15.103:0/1720364187 learned_addr learned my addr 172.21.15.103:0/1720364187 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:51.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.326+0000 7fc75a6bb700 1 --2- 172.21.15.103:0/1720364187 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7540b7540 0x7fc754154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:51.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.326+0000 7fc759eba700 1 -- 172.21.15.103:0/1720364187 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7540b7540 msgr2=0x7fc754154670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:51.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.326+0000 7fc759eba700 1 --2- 172.21.15.103:0/1720364187 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7540b7540 0x7fc754154670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:51.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.326+0000 7fc759eba700 1 -- 172.21.15.103:0/1720364187 >> v1:172.21.15.86:6789/0 conn(0x7fc7540b0ed0 legacy=0x7fc754115f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:51.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.326+0000 7fc759eba700 1 -- 172.21.15.103:0/1720364187 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc754153f30 con 0x7fc754064fd0 2020-04-22T14:16:51.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.326+0000 7fc75a6bb700 1 --2- 172.21.15.103:0/1720364187 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7540b7540 0x7fc754154670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:16:51.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.326+0000 7fc759eba700 1 --2- 172.21.15.103:0/1720364187 >> v2:172.21.15.103:3300/0 conn(0x7fc754064fd0 0x7fc754113890 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc750002f30 tx=0x7fc750007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:51.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.326+0000 7fc759eba700 1 --2- 172.21.15.103:0/1720364187 >> v2:172.21.15.103:3300/0 conn(0x7fc754064fd0 0x7fc754113890 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc750002f30 tx=0x7fc750007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:51.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.326+0000 7fc759eba700 1 --2- 172.21.15.103:0/1720364187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc754064fd0 0x7fc754113890 secure :-1 s=READY pgs=1774 cs=0 l=1 rx=0x7fc750002f30 tx=0x7fc750007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:51.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.327+0000 7fc759eba700 1 --2- 172.21.15.103:0/1720364187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc754064fd0 0x7fc754113890 secure :-1 s=THROTTLE_DONE pgs=1774 cs=0 l=1 rx=0x7fc750002f30 tx=0x7fc750007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:51.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.327+0000 7fc759eba700 1 --2- 172.21.15.103:0/1720364187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc754064fd0 0x7fc754113890 secure :-1 s=THROTTLE_DONE pgs=1774 cs=0 l=1 rx=0x7fc750002f30 tx=0x7fc750007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:51.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.327+0000 7fc746ffd700 1 -- 172.21.15.103:0/1720364187 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc750007360 con 0x7fc754064fd0 2020-04-22T14:16:51.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.327+0000 7fc759eba700 1 --2- 172.21.15.103:0/1720364187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc754064fd0 0x7fc754113890 secure :-1 s=THROTTLE_DONE pgs=1774 cs=0 l=1 rx=0x7fc750002f30 tx=0x7fc750007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:51.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.327+0000 7fc746ffd700 1 -- 172.21.15.103:0/1720364187 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7500074c0 con 0x7fc754064fd0 2020-04-22T14:16:51.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.327+0000 7fc75c11e700 1 -- 172.21.15.103:0/1720364187 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7541541d0 con 0x7fc754064fd0 2020-04-22T14:16:51.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.327+0000 7fc746ffd700 1 -- 172.21.15.103:0/1720364187 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7500058b0 con 0x7fc754064fd0 2020-04-22T14:16:51.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.327+0000 7fc75c11e700 1 -- 172.21.15.103:0/1720364187 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7540b3df0 con 0x7fc754064fd0 2020-04-22T14:16:51.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.327+0000 7fc759eba700 1 --2- 172.21.15.103:0/1720364187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc754064fd0 0x7fc754113890 secure :-1 s=THROTTLE_DONE pgs=1774 cs=0 l=1 rx=0x7fc750002f30 tx=0x7fc750007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:51.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.328+0000 7fc746ffd700 1 -- 172.21.15.103:0/1720364187 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fc750005b20 con 0x7fc754064fd0 2020-04-22T14:16:51.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.328+0000 7fc759eba700 1 --2- 172.21.15.103:0/1720364187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc754064fd0 0x7fc754113890 secure :-1 s=THROTTLE_DONE pgs=1774 cs=0 l=1 rx=0x7fc750002f30 tx=0x7fc750007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:51.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.328+0000 7fc75c11e700 1 -- 172.21.15.103:0/1720364187 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc754154390 con 0x7fc754064fd0 2020-04-22T14:16:51.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.328+0000 7fc746ffd700 1 --2- 172.21.15.103:0/1720364187 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc73404d9a0 0x7fc73404fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:51.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.328+0000 7fc746ffd700 1 -- 172.21.15.103:0/1720364187 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc750061c80 con 0x7fc754064fd0 2020-04-22T14:16:51.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.328+0000 7fc7596b9700 1 --2- 172.21.15.103:0/1720364187 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc73404d9a0 0x7fc73404fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:51.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.328+0000 7fc7596b9700 1 --2- 172.21.15.103:0/1720364187 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc73404d9a0 0x7fc73404fe60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc7540b4700 tx=0x7fc7480025d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:51.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.328+0000 7fc7596b9700 1 --2- 172.21.15.103:0/1720364187 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc73404d9a0 0x7fc73404fe60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc7540b4700 tx=0x7fc7480025d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:51.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.328+0000 7fc7596b9700 1 --2- 172.21.15.103:0/1720364187 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc73404d9a0 0x7fc73404fe60 secure :-1 s=READY pgs=643 cs=0 l=1 rx=0x7fc7540b4700 tx=0x7fc7480025d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:51.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.332+0000 7fc759eba700 1 --2- 172.21.15.103:0/1720364187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc754064fd0 0x7fc754113890 secure :-1 s=THROTTLE_DONE pgs=1774 cs=0 l=1 rx=0x7fc750002f30 tx=0x7fc750007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:51.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.332+0000 7fc746ffd700 1 -- 172.21.15.103:0/1720364187 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fc75003d120 con 0x7fc754064fd0 2020-04-22T14:16:51.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.477+0000 7fc75c11e700 1 -- 172.21.15.103:0/1720364187 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc754056c90 con 0x7fc754064fd0 2020-04-22T14:16:51.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.478+0000 7fc759eba700 1 --2- 172.21.15.103:0/1720364187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc754064fd0 0x7fc754113890 secure :-1 s=THROTTLE_DONE pgs=1774 cs=0 l=1 rx=0x7fc750002f30 tx=0x7fc750007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:51.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.478+0000 7fc746ffd700 1 -- 172.21.15.103:0/1720364187 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) v1 ==== 74+0+16103 (secure 0 0 0) 0x7fc750040740 con 0x7fc754064fd0 2020-04-22T14:16:51.481 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:16:51.481 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":124,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:16:47.112746+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:16:44.031424+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2020-04-22T14:16:45.073910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:16:51.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.480+0000 7fc75c11e700 1 -- 172.21.15.103:0/1720364187 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc73404d9a0 msgr2=0x7fc73404fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:51.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.480+0000 7fc75c11e700 1 --2- 172.21.15.103:0/1720364187 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc73404d9a0 0x7fc73404fe60 secure :-1 s=READY pgs=643 cs=0 l=1 rx=0x7fc7540b4700 tx=0x7fc7480025d0).stop 2020-04-22T14:16:51.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.480+0000 7fc75c11e700 1 -- 172.21.15.103:0/1720364187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc754064fd0 msgr2=0x7fc754113890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:51.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.480+0000 7fc75c11e700 1 --2- 172.21.15.103:0/1720364187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc754064fd0 0x7fc754113890 secure :-1 s=READY pgs=1774 cs=0 l=1 rx=0x7fc750002f30 tx=0x7fc750007a40).stop 2020-04-22T14:16:51.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.480+0000 7fc75c11e700 1 -- 172.21.15.103:0/1720364187 shutdown_connections 2020-04-22T14:16:51.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.480+0000 7fc75c11e700 1 --2- 172.21.15.103:0/1720364187 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc73404d9a0 0x7fc73404fe60 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:51.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.480+0000 7fc75c11e700 1 --2- 172.21.15.103:0/1720364187 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7540b7540 0x7fc754154670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:51.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.480+0000 7fc75c11e700 1 --2- 172.21.15.103:0/1720364187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc754064fd0 0x7fc754113890 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:51.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.480+0000 7fc75c11e700 1 -- 172.21.15.103:0/1720364187 >> 172.21.15.103:0/1720364187 conn(0x7fc75405f2c0 msgr2=0x7fc75405faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:51.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.480+0000 7fc75c11e700 1 -- 172.21.15.103:0/1720364187 shutdown_connections 2020-04-22T14:16:51.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.480+0000 7fc75c11e700 1 -- 172.21.15.103:0/1720364187 wait complete. 2020-04-22T14:16:51.493 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:16:44.031424+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 21, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'123', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:16:45.073910+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 22, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'124', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:16:51.494 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:51.507 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:16:51.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.654+0000 7fdee0f91700 1 Processor -- start 2020-04-22T14:16:51.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.654+0000 7fdee0f91700 1 -- start start 2020-04-22T14:16:51.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.654+0000 7fdee0f91700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdedc0b9140 0x7fdedc12b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:51.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.655+0000 7fdee0f91700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdedc0ac950 0x7fdedc12b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:51.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.655+0000 7fdee0f91700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdedc1467e0 con 0x7fdedc146c40 2020-04-22T14:16:51.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.655+0000 7fdee0f91700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdedc0602f0 con 0x7fdedc0ac950 2020-04-22T14:16:51.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.655+0000 7fdee0f91700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc060050 con 0x7fdedc0b9140 2020-04-22T14:16:51.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.655+0000 7fded9d9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdedc0ac950 0x7fdedc12b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:51.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.655+0000 7fded9d9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdedc0ac950 0x7fdedc12b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56816/0 (socket says 172.21.15.103:56816) 2020-04-22T14:16:51.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.655+0000 7fded9d9b700 1 -- 172.21.15.103:0/106853841 learned_addr learned my addr 172.21.15.103:0/106853841 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:51.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.655+0000 7fdeda59c700 1 --2- 172.21.15.103:0/106853841 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdedc0b9140 0x7fdedc12b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:51.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.655+0000 7fded9d9b700 1 -- 172.21.15.103:0/106853841 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdedc0b9140 msgr2=0x7fdedc12b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:51.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.655+0000 7fded9d9b700 1 --2- 172.21.15.103:0/106853841 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdedc0b9140 0x7fdedc12b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:51.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.655+0000 7fded9d9b700 1 -- 172.21.15.103:0/106853841 >> v1:172.21.15.86:6789/0 conn(0x7fdedc146c40 legacy=0x7fdedc143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:51.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.655+0000 7fded9d9b700 1 -- 172.21.15.103:0/106853841 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdedc0b9520 con 0x7fdedc0ac950 2020-04-22T14:16:51.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.655+0000 7fded9d9b700 1 --2- 172.21.15.103:0/106853841 >> v2:172.21.15.103:3300/0 conn(0x7fdedc0ac950 0x7fdedc12b670 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdecc002f30 tx=0x7fdecc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:51.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.655+0000 7fded9d9b700 1 --2- 172.21.15.103:0/106853841 >> v2:172.21.15.103:3300/0 conn(0x7fdedc0ac950 0x7fdedc12b670 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdecc002f30 tx=0x7fdecc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:51.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.655+0000 7fded9d9b700 1 --2- 172.21.15.103:0/106853841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdedc0ac950 0x7fdedc12b670 secure :-1 s=READY pgs=1775 cs=0 l=1 rx=0x7fdecc002f30 tx=0x7fdecc007a40).ready entity=mon.1 client_cookie=c3f3091c81ed9139 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:51.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.655+0000 7fded9d9b700 1 --2- 172.21.15.103:0/106853841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdedc0ac950 0x7fdedc12b670 secure :-1 s=THROTTLE_DONE pgs=1775 cs=0 l=1 rx=0x7fdecc002f30 tx=0x7fdecc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:51.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.655+0000 7fded959a700 1 -- 172.21.15.103:0/106853841 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdecc011720 con 0x7fdedc0ac950 2020-04-22T14:16:51.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.655+0000 7fded9d9b700 1 --2- 172.21.15.103:0/106853841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdedc0ac950 0x7fdedc12b670 secure :-1 s=THROTTLE_DONE pgs=1775 cs=0 l=1 rx=0x7fdecc002f30 tx=0x7fdecc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:51.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.655+0000 7fded9d9b700 1 --2- 172.21.15.103:0/106853841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdedc0ac950 0x7fdedc12b670 secure :-1 s=THROTTLE_DONE pgs=1775 cs=0 l=1 rx=0x7fdecc002f30 tx=0x7fdecc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:51.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.655+0000 7fded959a700 1 -- 172.21.15.103:0/106853841 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdecc0118c0 con 0x7fdedc0ac950 2020-04-22T14:16:51.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.655+0000 7fded959a700 1 -- 172.21.15.103:0/106853841 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdecc011ce0 con 0x7fdedc0ac950 2020-04-22T14:16:51.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.655+0000 7fdee0f91700 1 -- 172.21.15.103:0/106853841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdedc0ac950 msgr2=0x7fdedc12b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:51.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.655+0000 7fdee0f91700 1 --2- 172.21.15.103:0/106853841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdedc0ac950 0x7fdedc12b670 secure :-1 s=READY pgs=1775 cs=0 l=1 rx=0x7fdecc002f30 tx=0x7fdecc007a40).stop 2020-04-22T14:16:51.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.656+0000 7fdee0f91700 1 -- 172.21.15.103:0/106853841 shutdown_connections 2020-04-22T14:16:51.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.656+0000 7fdee0f91700 1 --2- 172.21.15.103:0/106853841 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdedc0b9140 0x7fdedc12b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:51.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.656+0000 7fdee0f91700 1 --2- 172.21.15.103:0/106853841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdedc0ac950 0x7fdedc12b670 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:51.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.656+0000 7fdee0f91700 1 -- 172.21.15.103:0/106853841 >> 172.21.15.103:0/106853841 conn(0x7fdedc05b7b0 msgr2=0x7fdedc0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:51.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.656+0000 7fdee0f91700 1 -- 172.21.15.103:0/106853841 shutdown_connections 2020-04-22T14:16:51.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.656+0000 7fdee0f91700 1 -- 172.21.15.103:0/106853841 wait complete. 2020-04-22T14:16:51.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.657+0000 7fdee0f91700 1 Processor -- start 2020-04-22T14:16:51.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.657+0000 7fdee0f91700 1 -- start start 2020-04-22T14:16:51.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.657+0000 7fdee0f91700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdedc0ac950 0x7fdedc128570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:51.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.657+0000 7fdee0f91700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdedc0b9140 0x7fdedc145090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:51.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.657+0000 7fdee0f91700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdedc1289d0 con 0x7fdedc146c40 2020-04-22T14:16:51.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.657+0000 7fdee0f91700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdedc144500 con 0x7fdedc0ac950 2020-04-22T14:16:51.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.657+0000 7fdee0f91700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdedc1446f0 con 0x7fdedc0b9140 2020-04-22T14:16:51.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.658+0000 7fded9d9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdedc0b9140 0x7fdedc145090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:51.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.658+0000 7fded9d9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdedc0b9140 0x7fdedc145090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56822/0 (socket says 172.21.15.103:56822) 2020-04-22T14:16:51.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.658+0000 7fded9d9b700 1 -- 172.21.15.103:0/2456038278 learned_addr learned my addr 172.21.15.103:0/2456038278 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:51.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.658+0000 7fdeda59c700 1 --2- 172.21.15.103:0/2456038278 >> v2:172.21.15.86:3300/0 conn(0x7fdedc0ac950 0x7fdedc128570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:51.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.658+0000 7fded9d9b700 1 -- 172.21.15.103:0/2456038278 >> v2:172.21.15.86:3300/0 conn(0x7fdedc0ac950 msgr2=0x7fdedc128570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:51.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.658+0000 7fded9d9b700 1 --2- 172.21.15.103:0/2456038278 >> v2:172.21.15.86:3300/0 conn(0x7fdedc0ac950 0x7fdedc128570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:51.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.658+0000 7fded37fe700 1 -- 172.21.15.103:0/2456038278 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2735534968 0 0) 0x7fdedc1467e0 con 0x7fdedc146c40 2020-04-22T14:16:51.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.658+0000 7fded9d9b700 1 -- 172.21.15.103:0/2456038278 >> v1:172.21.15.103:6789/0 conn(0x7fdedc146c40 legacy=0x7fdedc126da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:51.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.658+0000 7fded9d9b700 1 -- 172.21.15.103:0/2456038278 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdedc144950 con 0x7fdedc0b9140 2020-04-22T14:16:51.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.658+0000 7fded9d9b700 1 --2- 172.21.15.103:0/2456038278 >> v2:172.21.15.103:3300/0 conn(0x7fdedc0b9140 0x7fdedc145090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdecc002f30 tx=0x7fdecc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:51.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.658+0000 7fded9d9b700 1 --2- 172.21.15.103:0/2456038278 >> v2:172.21.15.103:3300/0 conn(0x7fdedc0b9140 0x7fdedc145090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdecc002f30 tx=0x7fdecc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:51.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.658+0000 7fded9d9b700 1 --2- 172.21.15.103:0/2456038278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdedc0b9140 0x7fdedc145090 secure :-1 s=READY pgs=1777 cs=0 l=1 rx=0x7fdecc002f30 tx=0x7fdecc007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:51.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.658+0000 7fded9d9b700 1 --2- 172.21.15.103:0/2456038278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdedc0b9140 0x7fdedc145090 secure :-1 s=THROTTLE_DONE pgs=1777 cs=0 l=1 rx=0x7fdecc002f30 tx=0x7fdecc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:51.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.658+0000 7fded37fe700 1 -- 172.21.15.103:0/2456038278 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdecc0102c0 con 0x7fdedc0b9140 2020-04-22T14:16:51.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.658+0000 7fded9d9b700 1 --2- 172.21.15.103:0/2456038278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdedc0b9140 0x7fdedc145090 secure :-1 s=THROTTLE_DONE pgs=1777 cs=0 l=1 rx=0x7fdecc002f30 tx=0x7fdecc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:51.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.658+0000 7fded9d9b700 1 --2- 172.21.15.103:0/2456038278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdedc0b9140 0x7fdedc145090 secure :-1 s=THROTTLE_DONE pgs=1777 cs=0 l=1 rx=0x7fdecc002f30 tx=0x7fdecc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:51.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.658+0000 7fded37fe700 1 -- 172.21.15.103:0/2456038278 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdecc007170 con 0x7fdedc0b9140 2020-04-22T14:16:51.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.658+0000 7fdee0f91700 1 -- 172.21.15.103:0/2456038278 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdedc1454f0 con 0x7fdedc0b9140 2020-04-22T14:16:51.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.658+0000 7fded37fe700 1 -- 172.21.15.103:0/2456038278 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdecc0074d0 con 0x7fdedc0b9140 2020-04-22T14:16:51.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.658+0000 7fdee0f91700 1 -- 172.21.15.103:0/2456038278 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdedc142c80 con 0x7fdedc0b9140 2020-04-22T14:16:51.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.659+0000 7fded9d9b700 1 --2- 172.21.15.103:0/2456038278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdedc0b9140 0x7fdedc145090 secure :-1 s=THROTTLE_DONE pgs=1777 cs=0 l=1 rx=0x7fdecc002f30 tx=0x7fdecc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:51.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.659+0000 7fded37fe700 1 -- 172.21.15.103:0/2456038278 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fdecc0056c0 con 0x7fdedc0b9140 2020-04-22T14:16:51.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.659+0000 7fded9d9b700 1 --2- 172.21.15.103:0/2456038278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdedc0b9140 0x7fdedc145090 secure :-1 s=THROTTLE_DONE pgs=1777 cs=0 l=1 rx=0x7fdecc002f30 tx=0x7fdecc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:51.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.659+0000 7fdee0f91700 1 -- 172.21.15.103:0/2456038278 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdedc056c90 con 0x7fdedc0b9140 2020-04-22T14:16:51.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.659+0000 7fded37fe700 1 --2- 172.21.15.103:0/2456038278 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdec004d870 0x7fdec004fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:51.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.659+0000 7fded37fe700 1 -- 172.21.15.103:0/2456038278 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdecc061bb0 con 0x7fdedc0b9140 2020-04-22T14:16:51.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.660+0000 7fdeda59c700 1 --2- 172.21.15.103:0/2456038278 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdec004d870 0x7fdec004fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:51.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.660+0000 7fdeda59c700 1 --2- 172.21.15.103:0/2456038278 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdec004d870 0x7fdec004fd30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdec4002f30 tx=0x7fdec400d710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:51.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.660+0000 7fdeda59c700 1 --2- 172.21.15.103:0/2456038278 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdec004d870 0x7fdec004fd30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdec4002f30 tx=0x7fdec400d710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:51.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.660+0000 7fdeda59c700 1 --2- 172.21.15.103:0/2456038278 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdec004d870 0x7fdec004fd30 secure :-1 s=READY pgs=644 cs=0 l=1 rx=0x7fdec4002f30 tx=0x7fdec400d710).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:51.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.663+0000 7fded9d9b700 1 --2- 172.21.15.103:0/2456038278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdedc0b9140 0x7fdedc145090 secure :-1 s=THROTTLE_DONE pgs=1777 cs=0 l=1 rx=0x7fdecc002f30 tx=0x7fdecc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:51.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.663+0000 7fded37fe700 1 -- 172.21.15.103:0/2456038278 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fdecc03cf90 con 0x7fdedc0b9140 2020-04-22T14:16:51.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.806+0000 7fdee0f91700 1 -- 172.21.15.103:0/2456038278 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fdedc06a960 con 0x7fdedc0b9140 2020-04-22T14:16:51.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.806+0000 7fded9d9b700 1 --2- 172.21.15.103:0/2456038278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdedc0b9140 0x7fdedc145090 secure :-1 s=THROTTLE_DONE pgs=1777 cs=0 l=1 rx=0x7fdecc002f30 tx=0x7fdecc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:51.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.806+0000 7fded37fe700 1 -- 172.21.15.103:0/2456038278 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v124) v1 ==== 110+0+10 (secure 0 0 0) 0x7fdecc0405b0 con 0x7fdedc0b9140 2020-04-22T14:16:51.810 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:16:51.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.807+0000 7fdee0f91700 1 -- 172.21.15.103:0/2456038278 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdec004d870 msgr2=0x7fdec004fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:51.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.807+0000 7fdee0f91700 1 --2- 172.21.15.103:0/2456038278 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdec004d870 0x7fdec004fd30 secure :-1 s=READY pgs=644 cs=0 l=1 rx=0x7fdec4002f30 tx=0x7fdec400d710).stop 2020-04-22T14:16:51.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.807+0000 7fdee0f91700 1 -- 172.21.15.103:0/2456038278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdedc0b9140 msgr2=0x7fdedc145090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:51.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.807+0000 7fdee0f91700 1 --2- 172.21.15.103:0/2456038278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdedc0b9140 0x7fdedc145090 secure :-1 s=READY pgs=1777 cs=0 l=1 rx=0x7fdecc002f30 tx=0x7fdecc007a40).stop 2020-04-22T14:16:51.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.807+0000 7fdee0f91700 1 -- 172.21.15.103:0/2456038278 shutdown_connections 2020-04-22T14:16:51.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.807+0000 7fdee0f91700 1 --2- 172.21.15.103:0/2456038278 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdec004d870 0x7fdec004fd30 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:51.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.807+0000 7fdee0f91700 1 --2- 172.21.15.103:0/2456038278 >> v2:172.21.15.86:3300/0 conn(0x7fdedc0ac950 0x7fdedc128570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:51.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.807+0000 7fdee0f91700 1 --2- 172.21.15.103:0/2456038278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdedc0b9140 0x7fdedc145090 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:51.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.807+0000 7fdee0f91700 1 -- 172.21.15.103:0/2456038278 >> 172.21.15.103:0/2456038278 conn(0x7fdedc05b7b0 msgr2=0x7fdedc140960 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:51.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.807+0000 7fdee0f91700 1 -- 172.21.15.103:0/2456038278 shutdown_connections 2020-04-22T14:16:51.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.807+0000 7fdee0f91700 1 -- 172.21.15.103:0/2456038278 wait complete. 2020-04-22T14:16:51.820 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:51.834 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:16:51.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.980+0000 7f637cf17700 1 Processor -- start 2020-04-22T14:16:51.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.981+0000 7f637cf17700 1 -- start start 2020-04-22T14:16:51.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.981+0000 7f637cf17700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f63780b9140 0x7f63780aed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:51.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.981+0000 7f637cf17700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f63780af1f0 0x7f6378144660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:51.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.981+0000 7f637cf17700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6378144ac0 con 0x7f63780b3bd0 2020-04-22T14:16:51.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.981+0000 7f637cf17700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6378148310 con 0x7f63780b9140 2020-04-22T14:16:51.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.981+0000 7f637cf17700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63781485b0 con 0x7f63780af1f0 2020-04-22T14:16:51.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.982+0000 7f6375d9b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f63780b3bd0 0x7f63780616b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49018/0 (socket says 172.21.15.103:49018) 2020-04-22T14:16:51.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.982+0000 7f6375d9b700 1 -- 172.21.15.103:0/1444609925 learned_addr learned my addr 172.21.15.103:0/1444609925 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:51.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.982+0000 7f637659c700 1 --2- 172.21.15.103:0/1444609925 >> v2:172.21.15.86:3300/0 conn(0x7f63780b9140 0x7f63780aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:51.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.982+0000 7f6376d9d700 1 --2- 172.21.15.103:0/1444609925 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f63780af1f0 0x7f6378144660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:51.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.982+0000 7f637559a700 1 -- 172.21.15.103:0/1444609925 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 901461503 0 0) 0x7f6378144ac0 con 0x7f63780b3bd0 2020-04-22T14:16:51.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.982+0000 7f637559a700 1 -- 172.21.15.103:0/1444609925 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6358003230 con 0x7f63780b3bd0 2020-04-22T14:16:51.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.982+0000 7f6376d9d700 1 -- 172.21.15.103:0/1444609925 >> v2:172.21.15.86:3300/0 conn(0x7f63780b9140 msgr2=0x7f63780aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:51.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.982+0000 7f6376d9d700 1 --2- 172.21.15.103:0/1444609925 >> v2:172.21.15.86:3300/0 conn(0x7f63780b9140 0x7f63780aed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:51.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.982+0000 7f637559a700 1 -- 172.21.15.103:0/1444609925 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2231612304 0 0) 0x7f6358003230 con 0x7f63780b3bd0 2020-04-22T14:16:51.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.982+0000 7f6376d9d700 1 -- 172.21.15.103:0/1444609925 >> v1:172.21.15.103:6789/0 conn(0x7f63780b3bd0 legacy=0x7f63780616b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:51.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.982+0000 7f6376d9d700 1 -- 172.21.15.103:0/1444609925 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63780b9520 con 0x7f63780af1f0 2020-04-22T14:16:51.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.982+0000 7f637659c700 1 --2- 172.21.15.103:0/1444609925 >> v2:172.21.15.86:3300/0 conn(0x7f63780b9140 0x7f63780aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:16:51.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.982+0000 7f6376d9d700 1 --2- 172.21.15.103:0/1444609925 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f63780af1f0 0x7f6378144660 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6368001870 tx=0x7f6370007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:51.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.982+0000 7f6376d9d700 1 --2- 172.21.15.103:0/1444609925 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f63780af1f0 0x7f6378144660 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6368001870 tx=0x7f6370007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:51.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.982+0000 7f6376d9d700 1 --2- 172.21.15.103:0/1444609925 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f63780af1f0 0x7f6378144660 secure :-1 s=READY pgs=172 cs=0 l=1 rx=0x7f6368001870 tx=0x7f6370007dc0).ready entity=mon.2 client_cookie=4391fc1cbc36c1a5 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:51.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.982+0000 7f6376d9d700 1 --2- 172.21.15.103:0/1444609925 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f63780af1f0 0x7f6378144660 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f6368001870 tx=0x7f6370007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:51.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.982+0000 7f637559a700 1 -- 172.21.15.103:0/1444609925 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63680016d0 con 0x7f63780af1f0 2020-04-22T14:16:51.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.982+0000 7f6376d9d700 1 --2- 172.21.15.103:0/1444609925 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f63780af1f0 0x7f6378144660 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f6368001870 tx=0x7f6370007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:51.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.982+0000 7f6376d9d700 1 --2- 172.21.15.103:0/1444609925 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f63780af1f0 0x7f6378144660 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f6368001870 tx=0x7f6370007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.982+0000 7f637559a700 1 -- 172.21.15.103:0/1444609925 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6370010a10 con 0x7f63780af1f0 2020-04-22T14:16:52.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.982+0000 7f637559a700 1 -- 172.21.15.103:0/1444609925 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6370010df0 con 0x7f63780af1f0 2020-04-22T14:16:52.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.982+0000 7f637cf17700 1 -- 172.21.15.103:0/1444609925 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f63780af1f0 msgr2=0x7f6378144660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:52.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.982+0000 7f637cf17700 1 --2- 172.21.15.103:0/1444609925 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f63780af1f0 0x7f6378144660 secure :-1 s=READY pgs=172 cs=0 l=1 rx=0x7f6368001870 tx=0x7f6370007dc0).stop 2020-04-22T14:16:52.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.983+0000 7f637cf17700 1 -- 172.21.15.103:0/1444609925 shutdown_connections 2020-04-22T14:16:52.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.983+0000 7f637cf17700 1 --2- 172.21.15.103:0/1444609925 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f63780af1f0 0x7f6378144660 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:52.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.983+0000 7f637cf17700 1 --2- 172.21.15.103:0/1444609925 >> v2:172.21.15.86:3300/0 conn(0x7f63780b9140 0x7f63780aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:52.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.983+0000 7f637cf17700 1 -- 172.21.15.103:0/1444609925 >> 172.21.15.103:0/1444609925 conn(0x7f637805b7b0 msgr2=0x7f63780b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:52.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.983+0000 7f637cf17700 1 -- 172.21.15.103:0/1444609925 shutdown_connections 2020-04-22T14:16:52.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.983+0000 7f637cf17700 1 -- 172.21.15.103:0/1444609925 wait complete. 2020-04-22T14:16:52.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.984+0000 7f637cf17700 1 Processor -- start 2020-04-22T14:16:52.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.984+0000 7f637cf17700 1 -- start start 2020-04-22T14:16:52.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.985+0000 7f637cf17700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f63780b9140 0x7f6378147230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:52.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.985+0000 7f637cf17700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63780b1eb0 con 0x7f63780af1f0 2020-04-22T14:16:52.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.985+0000 7f637cf17700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63780b2150 con 0x7f63780b3bd0 2020-04-22T14:16:52.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.985+0000 7f637cf17700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63780b25f0 con 0x7f63780b9140 2020-04-22T14:16:52.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.985+0000 7f6375d9b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f63780b3bd0 0x7f637813b1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49026/0 (socket says 172.21.15.103:49026) 2020-04-22T14:16:52.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.985+0000 7f6375d9b700 1 -- 172.21.15.103:0/66445252 learned_addr learned my addr 172.21.15.103:0/66445252 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:52.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.985+0000 7f6376d9d700 1 --2- 172.21.15.103:0/66445252 >> v2:172.21.15.86:3300/0 conn(0x7f63780b9140 0x7f6378147230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:52.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.985+0000 7f636f7fe700 1 -- 172.21.15.103:0/66445252 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3274454748 0 0) 0x7f63780b2150 con 0x7f63780b3bd0 2020-04-22T14:16:52.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.985+0000 7f636f7fe700 1 -- 172.21.15.103:0/66445252 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f635c002fe0 con 0x7f63780b3bd0 2020-04-22T14:16:52.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.985+0000 7f6376d9d700 1 -- 172.21.15.103:0/66445252 >> v1:172.21.15.103:6789/0 conn(0x7f63780b3bd0 legacy=0x7f637813b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:52.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.985+0000 7f636f7fe700 1 -- 172.21.15.103:0/66445252 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2986150667 0 0) 0x7f63780b1eb0 con 0x7f63780af1f0 2020-04-22T14:16:52.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.985+0000 7f6376d9d700 1 -- 172.21.15.103:0/66445252 >> v1:172.21.15.86:6789/0 conn(0x7f63780af1f0 legacy=0x7f6378065ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:52.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.985+0000 7f6376d9d700 1 -- 172.21.15.103:0/66445252 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63780b2ad0 con 0x7f63780b9140 2020-04-22T14:16:52.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.985+0000 7f6376d9d700 1 --2- 172.21.15.103:0/66445252 >> v2:172.21.15.86:3300/0 conn(0x7f63780b9140 0x7f6378147230 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f63680013f0 tx=0x7f6370007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.985+0000 7f6376d9d700 1 --2- 172.21.15.103:0/66445252 >> v2:172.21.15.86:3300/0 conn(0x7f63780b9140 0x7f6378147230 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f63680013f0 tx=0x7f6370007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.985+0000 7f6376d9d700 1 --2- 172.21.15.103:0/66445252 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63780b9140 0x7f6378147230 secure :-1 s=READY pgs=949 cs=0 l=1 rx=0x7f63680013f0 tx=0x7f6370007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:52.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.985+0000 7f6376d9d700 1 --2- 172.21.15.103:0/66445252 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63780b9140 0x7f6378147230 secure :-1 s=THROTTLE_DONE pgs=949 cs=0 l=1 rx=0x7f63680013f0 tx=0x7f6370007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.985+0000 7f636f7fe700 1 -- 172.21.15.103:0/66445252 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6368001250 con 0x7f63780b9140 2020-04-22T14:16:52.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.985+0000 7f6376d9d700 1 --2- 172.21.15.103:0/66445252 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63780b9140 0x7f6378147230 secure :-1 s=THROTTLE_DONE pgs=949 cs=0 l=1 rx=0x7f63680013f0 tx=0x7f6370007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.985+0000 7f636f7fe700 1 -- 172.21.15.103:0/66445252 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6370005d40 con 0x7f63780b9140 2020-04-22T14:16:52.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.985+0000 7f6376d9d700 1 --2- 172.21.15.103:0/66445252 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63780b9140 0x7f6378147230 secure :-1 s=THROTTLE_DONE pgs=949 cs=0 l=1 rx=0x7f63680013f0 tx=0x7f6370007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.985+0000 7f637cf17700 1 -- 172.21.15.103:0/66445252 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6378065340 con 0x7f63780b9140 2020-04-22T14:16:52.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.985+0000 7f636f7fe700 1 -- 172.21.15.103:0/66445252 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f637000f910 con 0x7f63780b9140 2020-04-22T14:16:52.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.986+0000 7f637cf17700 1 -- 172.21.15.103:0/66445252 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f637813b8e0 con 0x7f63780b9140 2020-04-22T14:16:52.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.986+0000 7f6376d9d700 1 --2- 172.21.15.103:0/66445252 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63780b9140 0x7f6378147230 secure :-1 s=THROTTLE_DONE pgs=949 cs=0 l=1 rx=0x7f63680013f0 tx=0x7f6370007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.987+0000 7f636f7fe700 1 -- 172.21.15.103:0/66445252 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f637000fac0 con 0x7f63780b9140 2020-04-22T14:16:52.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.987+0000 7f6376d9d700 1 --2- 172.21.15.103:0/66445252 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63780b9140 0x7f6378147230 secure :-1 s=THROTTLE_DONE pgs=949 cs=0 l=1 rx=0x7f63680013f0 tx=0x7f6370007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.987+0000 7f637cf17700 1 -- 172.21.15.103:0/66445252 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63780b22e0 con 0x7f63780b9140 2020-04-22T14:16:52.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.987+0000 7f636f7fe700 1 --2- 172.21.15.103:0/66445252 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f635c04dc20 0x7f635c0500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:52.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.987+0000 7f636f7fe700 1 -- 172.21.15.103:0/66445252 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6370060f50 con 0x7f63780b9140 2020-04-22T14:16:52.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.987+0000 7f637659c700 1 --2- 172.21.15.103:0/66445252 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f635c04dc20 0x7f635c0500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:52.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.987+0000 7f637659c700 1 --2- 172.21.15.103:0/66445252 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f635c04dc20 0x7f635c0500e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6360002ef0 tx=0x7f636000ca00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.987+0000 7f637659c700 1 --2- 172.21.15.103:0/66445252 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f635c04dc20 0x7f635c0500e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6360002ef0 tx=0x7f636000ca00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.987+0000 7f637659c700 1 --2- 172.21.15.103:0/66445252 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f635c04dc20 0x7f635c0500e0 secure :-1 s=READY pgs=645 cs=0 l=1 rx=0x7f6360002ef0 tx=0x7f636000ca00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:52.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.990+0000 7f6376d9d700 1 --2- 172.21.15.103:0/66445252 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63780b9140 0x7f6378147230 secure :-1 s=THROTTLE_DONE pgs=949 cs=0 l=1 rx=0x7f63680013f0 tx=0x7f6370007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:51.990+0000 7f636f7fe700 1 -- 172.21.15.103:0/66445252 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f637003c450 con 0x7f63780b9140 2020-04-22T14:16:52.133 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.131+0000 7f637cf17700 1 -- 172.21.15.103:0/66445252 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6378056c90 con 0x7f63780b9140 2020-04-22T14:16:52.134 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.131+0000 7f6376d9d700 1 --2- 172.21.15.103:0/66445252 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63780b9140 0x7f6378147230 secure :-1 s=THROTTLE_DONE pgs=949 cs=0 l=1 rx=0x7f63680013f0 tx=0x7f6370007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.134 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.131+0000 7f636f7fe700 1 -- 172.21.15.103:0/66445252 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v124) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6370015020 con 0x7f63780b9140 2020-04-22T14:16:52.134 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:16:52.135 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.133+0000 7f637cf17700 1 -- 172.21.15.103:0/66445252 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f635c04dc20 msgr2=0x7f635c0500e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:52.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.133+0000 7f637cf17700 1 --2- 172.21.15.103:0/66445252 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f635c04dc20 0x7f635c0500e0 secure :-1 s=READY pgs=645 cs=0 l=1 rx=0x7f6360002ef0 tx=0x7f636000ca00).stop 2020-04-22T14:16:52.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.133+0000 7f637cf17700 1 -- 172.21.15.103:0/66445252 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63780b9140 msgr2=0x7f6378147230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:52.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.133+0000 7f637cf17700 1 --2- 172.21.15.103:0/66445252 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63780b9140 0x7f6378147230 secure :-1 s=READY pgs=949 cs=0 l=1 rx=0x7f63680013f0 tx=0x7f6370007dc0).stop 2020-04-22T14:16:52.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.133+0000 7f637cf17700 1 -- 172.21.15.103:0/66445252 shutdown_connections 2020-04-22T14:16:52.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.133+0000 7f637cf17700 1 --2- 172.21.15.103:0/66445252 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f635c04dc20 0x7f635c0500e0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:52.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.133+0000 7f637cf17700 1 --2- 172.21.15.103:0/66445252 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63780b9140 0x7f6378147230 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:52.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.133+0000 7f637cf17700 1 -- 172.21.15.103:0/66445252 >> 172.21.15.103:0/66445252 conn(0x7f637805b7b0 msgr2=0x7f6378144450 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:52.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.133+0000 7f637cf17700 1 -- 172.21.15.103:0/66445252 shutdown_connections 2020-04-22T14:16:52.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.133+0000 7f637cf17700 1 -- 172.21.15.103:0/66445252 wait complete. 2020-04-22T14:16:52.145 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:52.164 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-22T14:16:52.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.311+0000 7f775141c700 1 Processor -- start 2020-04-22T14:16:52.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.311+0000 7f775141c700 1 -- start start 2020-04-22T14:16:52.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.312+0000 7f775141c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f774c143090 0x7f774c143520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:52.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.312+0000 7f775141c700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f774c1467e0 con 0x7f774c0ac950 2020-04-22T14:16:52.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.312+0000 7f775141c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f774c060050 con 0x7f774c0b9140 2020-04-22T14:16:52.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.312+0000 7f775141c700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f774c0602f0 con 0x7f774c143090 2020-04-22T14:16:52.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.312+0000 7f774b7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f774c143090 0x7f774c143520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:52.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.312+0000 7f774b7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f774c143090 0x7f774c143520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56842/0 (socket says 172.21.15.103:56842) 2020-04-22T14:16:52.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.312+0000 7f774affd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f774c0b9140 0x7f774c12b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49032/0 (socket says 172.21.15.103:49032) 2020-04-22T14:16:52.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.312+0000 7f774b7fe700 1 -- 172.21.15.103:0/1460246649 learned_addr learned my addr 172.21.15.103:0/1460246649 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:52.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.313+0000 7f774b7fe700 1 -- 172.21.15.103:0/1460246649 >> v1:172.21.15.103:6789/0 conn(0x7f774c0b9140 legacy=0x7f774c12b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:52.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.313+0000 7f774b7fe700 1 -- 172.21.15.103:0/1460246649 >> v1:172.21.15.86:6789/0 conn(0x7f774c0ac950 legacy=0x7f774c146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:52.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.313+0000 7f7749ffb700 1 -- 172.21.15.103:0/1460246649 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3034591644 0 0) 0x7f774c060050 con 0x7f774c0b9140 2020-04-22T14:16:52.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.313+0000 7f774b7fe700 1 -- 172.21.15.103:0/1460246649 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f774c0b9520 con 0x7f774c143090 2020-04-22T14:16:52.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.313+0000 7f774b7fe700 1 --2- 172.21.15.103:0/1460246649 >> v2:172.21.15.103:3300/0 conn(0x7f774c143090 0x7f774c143520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f77440032b0 tx=0x7f7744007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.313+0000 7f774b7fe700 1 --2- 172.21.15.103:0/1460246649 >> v2:172.21.15.103:3300/0 conn(0x7f774c143090 0x7f774c143520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f77440032b0 tx=0x7f7744007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.313+0000 7f774b7fe700 1 --2- 172.21.15.103:0/1460246649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f774c143090 0x7f774c143520 secure :-1 s=READY pgs=1781 cs=0 l=1 rx=0x7f77440032b0 tx=0x7f7744007dc0).ready entity=mon.1 client_cookie=b5c7503989aead1 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:52.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.313+0000 7f774b7fe700 1 --2- 172.21.15.103:0/1460246649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f774c143090 0x7f774c143520 secure :-1 s=THROTTLE_DONE pgs=1781 cs=0 l=1 rx=0x7f77440032b0 tx=0x7f7744007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.313+0000 7f7749ffb700 1 -- 172.21.15.103:0/1460246649 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f774400a180 con 0x7f774c143090 2020-04-22T14:16:52.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.313+0000 7f774b7fe700 1 --2- 172.21.15.103:0/1460246649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f774c143090 0x7f774c143520 secure :-1 s=THROTTLE_DONE pgs=1781 cs=0 l=1 rx=0x7f77440032b0 tx=0x7f7744007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.313+0000 7f774b7fe700 1 --2- 172.21.15.103:0/1460246649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f774c143090 0x7f774c143520 secure :-1 s=THROTTLE_DONE pgs=1781 cs=0 l=1 rx=0x7f77440032b0 tx=0x7f7744007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.313+0000 7f7749ffb700 1 -- 172.21.15.103:0/1460246649 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f774400a320 con 0x7f774c143090 2020-04-22T14:16:52.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.313+0000 7f7749ffb700 1 -- 172.21.15.103:0/1460246649 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f774400a740 con 0x7f774c143090 2020-04-22T14:16:52.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.313+0000 7f775141c700 1 -- 172.21.15.103:0/1460246649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f774c143090 msgr2=0x7f774c143520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:52.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.313+0000 7f775141c700 1 --2- 172.21.15.103:0/1460246649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f774c143090 0x7f774c143520 secure :-1 s=READY pgs=1781 cs=0 l=1 rx=0x7f77440032b0 tx=0x7f7744007dc0).stop 2020-04-22T14:16:52.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.314+0000 7f775141c700 1 -- 172.21.15.103:0/1460246649 shutdown_connections 2020-04-22T14:16:52.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.314+0000 7f775141c700 1 --2- 172.21.15.103:0/1460246649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f774c143090 0x7f774c143520 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:52.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.314+0000 7f775141c700 1 -- 172.21.15.103:0/1460246649 >> 172.21.15.103:0/1460246649 conn(0x7f774c05b7b0 msgr2=0x7f774c0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:52.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.314+0000 7f775141c700 1 -- 172.21.15.103:0/1460246649 shutdown_connections 2020-04-22T14:16:52.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.314+0000 7f775141c700 1 -- 172.21.15.103:0/1460246649 wait complete. 2020-04-22T14:16:52.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.315+0000 7f775141c700 1 Processor -- start 2020-04-22T14:16:52.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.315+0000 7f775141c700 1 -- start start 2020-04-22T14:16:52.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.315+0000 7f775141c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f774c0b9140 0x7f774c0b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:52.324 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.315+0000 7f775141c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f774c143090 0x7f774c1447b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:52.324 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.315+0000 7f775141c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f774c0b1810 con 0x7f774c0ac950 2020-04-22T14:16:52.324 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.315+0000 7f775141c700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f774c0b1ab0 con 0x7f774c143090 2020-04-22T14:16:52.324 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.315+0000 7f775141c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f774c0b1d50 con 0x7f774c0b9140 2020-04-22T14:16:52.324 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.315+0000 7f774affd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f774c0ac950 0x7f774c0b5a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49034/0 (socket says 172.21.15.103:49034) 2020-04-22T14:16:52.324 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.315+0000 7f774affd700 1 -- 172.21.15.103:0/2556905595 learned_addr learned my addr 172.21.15.103:0/2556905595 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:52.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.315+0000 7f774b7fe700 1 --2- 172.21.15.103:0/2556905595 >> v2:172.21.15.103:3300/0 conn(0x7f774c143090 0x7f774c1447b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:52.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.316+0000 7f774a7fc700 1 --2- 172.21.15.103:0/2556905595 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f774c0b9140 0x7f774c0b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:52.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.316+0000 7f774b7fe700 1 -- 172.21.15.103:0/2556905595 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f774c0b9140 msgr2=0x7f774c0b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:52.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.316+0000 7f774b7fe700 1 --2- 172.21.15.103:0/2556905595 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f774c0b9140 0x7f774c0b24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:52.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.316+0000 7f774b7fe700 1 -- 172.21.15.103:0/2556905595 >> v1:172.21.15.103:6789/0 conn(0x7f774c0ac950 legacy=0x7f774c0b5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:52.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.316+0000 7f7743fff700 1 -- 172.21.15.103:0/2556905595 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 542156731 0 0) 0x7f774c0b1810 con 0x7f774c0ac950 2020-04-22T14:16:52.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.316+0000 7f774b7fe700 1 -- 172.21.15.103:0/2556905595 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f774c1453e0 con 0x7f774c143090 2020-04-22T14:16:52.326 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.316+0000 7f774b7fe700 1 --2- 172.21.15.103:0/2556905595 >> v2:172.21.15.103:3300/0 conn(0x7f774c143090 0x7f774c1447b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f77440032b0 tx=0x7f7744007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.326 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.316+0000 7f774b7fe700 1 --2- 172.21.15.103:0/2556905595 >> v2:172.21.15.103:3300/0 conn(0x7f774c143090 0x7f774c1447b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f77440032b0 tx=0x7f7744007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.326 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.316+0000 7f774b7fe700 1 --2- 172.21.15.103:0/2556905595 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f774c143090 0x7f774c1447b0 secure :-1 s=READY pgs=1783 cs=0 l=1 rx=0x7f77440032b0 tx=0x7f7744007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:52.326 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.316+0000 7f774b7fe700 1 --2- 172.21.15.103:0/2556905595 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f774c143090 0x7f774c1447b0 secure :-1 s=THROTTLE_DONE pgs=1783 cs=0 l=1 rx=0x7f77440032b0 tx=0x7f7744007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.326 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.316+0000 7f7743fff700 1 -- 172.21.15.103:0/2556905595 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7744005c30 con 0x7f774c143090 2020-04-22T14:16:52.326 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.316+0000 7f774b7fe700 1 --2- 172.21.15.103:0/2556905595 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f774c143090 0x7f774c1447b0 secure :-1 s=THROTTLE_DONE pgs=1783 cs=0 l=1 rx=0x7f77440032b0 tx=0x7f7744007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.326 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.316+0000 7f774b7fe700 1 --2- 172.21.15.103:0/2556905595 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f774c143090 0x7f774c1447b0 secure :-1 s=THROTTLE_DONE pgs=1783 cs=0 l=1 rx=0x7f77440032b0 tx=0x7f7744007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.316+0000 7f7743fff700 1 -- 172.21.15.103:0/2556905595 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7744005d90 con 0x7f774c143090 2020-04-22T14:16:52.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.316+0000 7f775141c700 1 -- 172.21.15.103:0/2556905595 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f774c145fe0 con 0x7f774c143090 2020-04-22T14:16:52.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.316+0000 7f7743fff700 1 -- 172.21.15.103:0/2556905595 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f774400f7a0 con 0x7f774c143090 2020-04-22T14:16:52.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.316+0000 7f775141c700 1 -- 172.21.15.103:0/2556905595 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f774c127df0 con 0x7f774c143090 2020-04-22T14:16:52.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.317+0000 7f774b7fe700 1 --2- 172.21.15.103:0/2556905595 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f774c143090 0x7f774c1447b0 secure :-1 s=THROTTLE_DONE pgs=1783 cs=0 l=1 rx=0x7f77440032b0 tx=0x7f7744007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.317+0000 7f7743fff700 1 -- 172.21.15.103:0/2556905595 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f774400fa10 con 0x7f774c143090 2020-04-22T14:16:52.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.317+0000 7f774b7fe700 1 --2- 172.21.15.103:0/2556905595 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f774c143090 0x7f774c1447b0 secure :-1 s=THROTTLE_DONE pgs=1783 cs=0 l=1 rx=0x7f77440032b0 tx=0x7f7744007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.317+0000 7f775141c700 1 -- 172.21.15.103:0/2556905595 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f774c0b1ec0 con 0x7f774c143090 2020-04-22T14:16:52.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.317+0000 7f7743fff700 1 --2- 172.21.15.103:0/2556905595 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f773004f9b0 0x7f7730051e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:52.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.317+0000 7f7743fff700 1 -- 172.21.15.103:0/2556905595 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7744062500 con 0x7f774c143090 2020-04-22T14:16:52.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.318+0000 7f774affd700 1 --2- 172.21.15.103:0/2556905595 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f773004f9b0 0x7f7730051e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:52.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.318+0000 7f774affd700 1 --2- 172.21.15.103:0/2556905595 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f773004f9b0 0x7f7730051e70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7734001130 tx=0x7f7734001740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.318+0000 7f774affd700 1 --2- 172.21.15.103:0/2556905595 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f773004f9b0 0x7f7730051e70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7734001130 tx=0x7f7734001740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.318+0000 7f774affd700 1 --2- 172.21.15.103:0/2556905595 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f773004f9b0 0x7f7730051e70 secure :-1 s=READY pgs=646 cs=0 l=1 rx=0x7f7734001130 tx=0x7f7734001740).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:52.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.321+0000 7f774b7fe700 1 --2- 172.21.15.103:0/2556905595 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f774c143090 0x7f774c1447b0 secure :-1 s=THROTTLE_DONE pgs=1783 cs=0 l=1 rx=0x7f77440032b0 tx=0x7f7744007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.321+0000 7f7743fff700 1 -- 172.21.15.103:0/2556905595 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f774c0b1ec0 con 0x7f774c143090 2020-04-22T14:16:52.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.467+0000 7f775141c700 1 -- 172.21.15.103:0/2556905595 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f774c0b1ec0 con 0x7f774c143090 2020-04-22T14:16:52.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.467+0000 7f774b7fe700 1 --2- 172.21.15.103:0/2556905595 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f774c143090 0x7f774c1447b0 secure :-1 s=THROTTLE_DONE pgs=1783 cs=0 l=1 rx=0x7f77440032b0 tx=0x7f7744007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.467+0000 7f7743fff700 1 -- 172.21.15.103:0/2556905595 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v124) v1 ==== 104+0+10 (secure 0 0 0) 0x7f774c0b1ec0 con 0x7f774c143090 2020-04-22T14:16:52.470 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:16:52.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.469+0000 7f775141c700 1 -- 172.21.15.103:0/2556905595 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f773004f9b0 msgr2=0x7f7730051e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:52.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.469+0000 7f775141c700 1 --2- 172.21.15.103:0/2556905595 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f773004f9b0 0x7f7730051e70 secure :-1 s=READY pgs=646 cs=0 l=1 rx=0x7f7734001130 tx=0x7f7734001740).stop 2020-04-22T14:16:52.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.469+0000 7f775141c700 1 -- 172.21.15.103:0/2556905595 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f774c143090 msgr2=0x7f774c1447b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:52.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.469+0000 7f775141c700 1 --2- 172.21.15.103:0/2556905595 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f774c143090 0x7f774c1447b0 secure :-1 s=READY pgs=1783 cs=0 l=1 rx=0x7f77440032b0 tx=0x7f7744007dc0).stop 2020-04-22T14:16:52.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.469+0000 7f775141c700 1 -- 172.21.15.103:0/2556905595 shutdown_connections 2020-04-22T14:16:52.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.469+0000 7f775141c700 1 --2- 172.21.15.103:0/2556905595 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f773004f9b0 0x7f7730051e70 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:52.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.469+0000 7f775141c700 1 --2- 172.21.15.103:0/2556905595 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f774c143090 0x7f774c1447b0 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:52.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.469+0000 7f775141c700 1 --2- 172.21.15.103:0/2556905595 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f774c0b9140 0x7f774c0b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:52.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.469+0000 7f775141c700 1 -- 172.21.15.103:0/2556905595 >> 172.21.15.103:0/2556905595 conn(0x7f774c05b7b0 msgr2=0x7f774c13e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:52.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.469+0000 7f775141c700 1 -- 172.21.15.103:0/2556905595 shutdown_connections 2020-04-22T14:16:52.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.469+0000 7f775141c700 1 -- 172.21.15.103:0/2556905595 wait complete. 2020-04-22T14:16:52.481 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:52.495 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-22T14:16:52.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.641+0000 7f02c4cd2700 1 Processor -- start 2020-04-22T14:16:52.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.641+0000 7f02c4cd2700 1 -- start start 2020-04-22T14:16:52.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.642+0000 7f02c4cd2700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f02c0061a30 0x7f02c00b4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:52.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.642+0000 7f02c4cd2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f02c0141f20 0x7f02c01423b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:52.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.642+0000 7f02c4cd2700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02c00af030 con 0x7f02c00acb10 2020-04-22T14:16:52.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.642+0000 7f02c4cd2700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02c0060250 con 0x7f02c0061a30 2020-04-22T14:16:52.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.642+0000 7f02c4cd2700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02c00623c0 con 0x7f02c0141f20 2020-04-22T14:16:52.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.643+0000 7f02bed9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f02c0141f20 0x7f02c01423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:52.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.643+0000 7f02bed9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f02c0141f20 0x7f02c01423b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56856/0 (socket says 172.21.15.103:56856) 2020-04-22T14:16:52.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.643+0000 7f02bed9d700 1 -- 172.21.15.103:0/4075103379 learned_addr learned my addr 172.21.15.103:0/4075103379 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:52.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.643+0000 7f02be59c700 1 --2- 172.21.15.103:0/4075103379 >> v2:172.21.15.86:3300/0 conn(0x7f02c0061a30 0x7f02c00b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:52.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.643+0000 7f02bed9d700 1 -- 172.21.15.103:0/4075103379 >> v2:172.21.15.86:3300/0 conn(0x7f02c0061a30 msgr2=0x7f02c00b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:52.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.643+0000 7f02bed9d700 1 --2- 172.21.15.103:0/4075103379 >> v2:172.21.15.86:3300/0 conn(0x7f02c0061a30 0x7f02c00b4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:52.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.643+0000 7f02bed9d700 1 -- 172.21.15.103:0/4075103379 >> v1:172.21.15.86:6789/0 conn(0x7f02c00acb10 legacy=0x7f02c00ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:52.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.643+0000 7f02bed9d700 1 -- 172.21.15.103:0/4075103379 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c0062660 con 0x7f02c0141f20 2020-04-22T14:16:52.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.643+0000 7f02be59c700 1 --2- 172.21.15.103:0/4075103379 >> v2:172.21.15.86:3300/0 conn(0x7f02c0061a30 0x7f02c00b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:16:52.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.643+0000 7f02bed9d700 1 --2- 172.21.15.103:0/4075103379 >> v2:172.21.15.103:3300/0 conn(0x7f02c0141f20 0x7f02c01423b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f02b80032b0 tx=0x7f02b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.643+0000 7f02bed9d700 1 --2- 172.21.15.103:0/4075103379 >> v2:172.21.15.103:3300/0 conn(0x7f02c0141f20 0x7f02c01423b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f02b80032b0 tx=0x7f02b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.643+0000 7f02bed9d700 1 --2- 172.21.15.103:0/4075103379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02c0141f20 0x7f02c01423b0 secure :-1 s=READY pgs=1784 cs=0 l=1 rx=0x7f02b80032b0 tx=0x7f02b8007dc0).ready entity=mon.1 client_cookie=3cbb2d1fd6332cd8 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:52.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.643+0000 7f02bed9d700 1 --2- 172.21.15.103:0/4075103379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02c0141f20 0x7f02c01423b0 secure :-1 s=THROTTLE_DONE pgs=1784 cs=0 l=1 rx=0x7f02b80032b0 tx=0x7f02b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.643+0000 7f02bd59a700 1 -- 172.21.15.103:0/4075103379 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02b800a180 con 0x7f02c0141f20 2020-04-22T14:16:52.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.643+0000 7f02bed9d700 1 --2- 172.21.15.103:0/4075103379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02c0141f20 0x7f02c01423b0 secure :-1 s=THROTTLE_DONE pgs=1784 cs=0 l=1 rx=0x7f02b80032b0 tx=0x7f02b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.643+0000 7f02bd59a700 1 -- 172.21.15.103:0/4075103379 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b800a2e0 con 0x7f02c0141f20 2020-04-22T14:16:52.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.643+0000 7f02bed9d700 1 --2- 172.21.15.103:0/4075103379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02c0141f20 0x7f02c01423b0 secure :-1 s=THROTTLE_DONE pgs=1784 cs=0 l=1 rx=0x7f02b80032b0 tx=0x7f02b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.643+0000 7f02c4cd2700 1 -- 172.21.15.103:0/4075103379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02c0141f20 msgr2=0x7f02c01423b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:52.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.643+0000 7f02bd59a700 1 -- 172.21.15.103:0/4075103379 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02b800a700 con 0x7f02c0141f20 2020-04-22T14:16:52.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.643+0000 7f02c4cd2700 1 --2- 172.21.15.103:0/4075103379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02c0141f20 0x7f02c01423b0 secure :-1 s=READY pgs=1784 cs=0 l=1 rx=0x7f02b80032b0 tx=0x7f02b8007dc0).stop 2020-04-22T14:16:52.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.644+0000 7f02c4cd2700 1 -- 172.21.15.103:0/4075103379 shutdown_connections 2020-04-22T14:16:52.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.644+0000 7f02c4cd2700 1 --2- 172.21.15.103:0/4075103379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02c0141f20 0x7f02c01423b0 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:52.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.644+0000 7f02c4cd2700 1 --2- 172.21.15.103:0/4075103379 >> v2:172.21.15.86:3300/0 conn(0x7f02c0061a30 0x7f02c00b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:52.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.644+0000 7f02c4cd2700 1 -- 172.21.15.103:0/4075103379 >> 172.21.15.103:0/4075103379 conn(0x7f02c005b7b0 msgr2=0x7f02c00b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:52.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.644+0000 7f02c4cd2700 1 -- 172.21.15.103:0/4075103379 shutdown_connections 2020-04-22T14:16:52.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.644+0000 7f02c4cd2700 1 -- 172.21.15.103:0/4075103379 wait complete. 2020-04-22T14:16:52.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.645+0000 7f02c4cd2700 1 Processor -- start 2020-04-22T14:16:52.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.645+0000 7f02c4cd2700 1 -- start start 2020-04-22T14:16:52.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.645+0000 7f02c4cd2700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f02c0061a30 0x7f02c0145550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:52.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.645+0000 7f02c4cd2700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f02c00acb10 0x7f02c0064190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:52.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.645+0000 7f02c4cd2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f02c0141f20 0x7f02c0143380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:52.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.645+0000 7f02c4cd2700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02c00649d0 con 0x7f02c00acb10 2020-04-22T14:16:52.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.645+0000 7f02c4cd2700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02c0064bb0 con 0x7f02c0141f20 2020-04-22T14:16:52.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.645+0000 7f02c4cd2700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c0064e50 con 0x7f02c0061a30 2020-04-22T14:16:52.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.646+0000 7f02bed9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f02c0141f20 0x7f02c0143380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:52.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.646+0000 7f02bed9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f02c0141f20 0x7f02c0143380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56862/0 (socket says 172.21.15.103:56862) 2020-04-22T14:16:52.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.646+0000 7f02bed9d700 1 -- 172.21.15.103:0/812020153 learned_addr learned my addr 172.21.15.103:0/812020153 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:52.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.646+0000 7f02be59c700 1 --2- 172.21.15.103:0/812020153 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f02c0061a30 0x7f02c0145550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:52.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.646+0000 7f02bdd9b700 1 --2- 172.21.15.103:0/812020153 >> v2:172.21.15.86:3300/0 conn(0x7f02c00acb10 0x7f02c0064190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:52.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.646+0000 7f02bed9d700 1 -- 172.21.15.103:0/812020153 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f02c0061a30 msgr2=0x7f02c0145550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:52.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.646+0000 7f02bed9d700 1 --2- 172.21.15.103:0/812020153 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f02c0061a30 0x7f02c0145550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:52.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.646+0000 7f02bed9d700 1 -- 172.21.15.103:0/812020153 >> v2:172.21.15.86:3300/0 conn(0x7f02c00acb10 msgr2=0x7f02c0064190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:52.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.646+0000 7f02bed9d700 1 --2- 172.21.15.103:0/812020153 >> v2:172.21.15.86:3300/0 conn(0x7f02c00acb10 0x7f02c0064190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:52.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.646+0000 7f02bed9d700 1 -- 172.21.15.103:0/812020153 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c01459b0 con 0x7f02c0141f20 2020-04-22T14:16:52.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.646+0000 7f02bed9d700 1 --2- 172.21.15.103:0/812020153 >> v2:172.21.15.103:3300/0 conn(0x7f02c0141f20 0x7f02c0143380 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f02b80032b0 tx=0x7f02b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.646+0000 7f02bed9d700 1 --2- 172.21.15.103:0/812020153 >> v2:172.21.15.103:3300/0 conn(0x7f02c0141f20 0x7f02c0143380 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f02b80032b0 tx=0x7f02b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.646+0000 7f02bed9d700 1 --2- 172.21.15.103:0/812020153 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02c0141f20 0x7f02c0143380 secure :-1 s=READY pgs=1785 cs=0 l=1 rx=0x7f02b80032b0 tx=0x7f02b8007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:52.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.646+0000 7f02bed9d700 1 --2- 172.21.15.103:0/812020153 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02c0141f20 0x7f02c0143380 secure :-1 s=THROTTLE_DONE pgs=1785 cs=0 l=1 rx=0x7f02b80032b0 tx=0x7f02b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.646+0000 7f02bed9d700 1 --2- 172.21.15.103:0/812020153 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02c0141f20 0x7f02c0143380 secure :-1 s=THROTTLE_DONE pgs=1785 cs=0 l=1 rx=0x7f02b80032b0 tx=0x7f02b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.646+0000 7f02b77fe700 1 -- 172.21.15.103:0/812020153 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02b8005a40 con 0x7f02c0141f20 2020-04-22T14:16:52.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.646+0000 7f02bed9d700 1 --2- 172.21.15.103:0/812020153 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02c0141f20 0x7f02c0143380 secure :-1 s=THROTTLE_DONE pgs=1785 cs=0 l=1 rx=0x7f02b80032b0 tx=0x7f02b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.646+0000 7f02b77fe700 1 -- 172.21.15.103:0/812020153 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b8005ba0 con 0x7f02c0141f20 2020-04-22T14:16:52.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.646+0000 7f02c4cd2700 1 -- 172.21.15.103:0/812020153 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02c00645f0 con 0x7f02c0141f20 2020-04-22T14:16:52.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.646+0000 7f02b77fe700 1 -- 172.21.15.103:0/812020153 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02b800f5b0 con 0x7f02c0141f20 2020-04-22T14:16:52.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.646+0000 7f02c4cd2700 1 -- 172.21.15.103:0/812020153 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02c0066290 con 0x7f02c0141f20 2020-04-22T14:16:52.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.647+0000 7f02bed9d700 1 --2- 172.21.15.103:0/812020153 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02c0141f20 0x7f02c0143380 secure :-1 s=THROTTLE_DONE pgs=1785 cs=0 l=1 rx=0x7f02b80032b0 tx=0x7f02b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.647+0000 7f02bed9d700 1 --2- 172.21.15.103:0/812020153 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02c0141f20 0x7f02c0143380 secure :-1 s=THROTTLE_DONE pgs=1785 cs=0 l=1 rx=0x7f02b80032b0 tx=0x7f02b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.647+0000 7f02b77fe700 1 -- 172.21.15.103:0/812020153 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f02b800f710 con 0x7f02c0141f20 2020-04-22T14:16:52.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.647+0000 7f02c4cd2700 1 -- 172.21.15.103:0/812020153 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02c0056c90 con 0x7f02c0141f20 2020-04-22T14:16:52.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.647+0000 7f02b77fe700 1 --2- 172.21.15.103:0/812020153 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f02a404d9d0 0x7f02a404fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:52.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.648+0000 7f02b77fe700 1 -- 172.21.15.103:0/812020153 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f02b80623a0 con 0x7f02c0141f20 2020-04-22T14:16:52.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.648+0000 7f02be59c700 1 --2- 172.21.15.103:0/812020153 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f02a404d9d0 0x7f02a404fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:52.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.648+0000 7f02be59c700 1 --2- 172.21.15.103:0/812020153 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f02a404d9d0 0x7f02a404fe90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f02a8002f30 tx=0x7f02a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.648+0000 7f02be59c700 1 --2- 172.21.15.103:0/812020153 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f02a404d9d0 0x7f02a404fe90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f02a8002f30 tx=0x7f02a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.648+0000 7f02be59c700 1 --2- 172.21.15.103:0/812020153 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f02a404d9d0 0x7f02a404fe90 secure :-1 s=READY pgs=647 cs=0 l=1 rx=0x7f02a8002f30 tx=0x7f02a8007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:52.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.652+0000 7f02bed9d700 1 --2- 172.21.15.103:0/812020153 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02c0141f20 0x7f02c0143380 secure :-1 s=THROTTLE_DONE pgs=1785 cs=0 l=1 rx=0x7f02b80032b0 tx=0x7f02b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.652+0000 7f02b77fe700 1 -- 172.21.15.103:0/812020153 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f02b803d860 con 0x7f02c0141f20 2020-04-22T14:16:52.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.794+0000 7f02c4cd2700 1 -- 172.21.15.103:0/812020153 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f02c014dd30 con 0x7f02c0141f20 2020-04-22T14:16:52.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.795+0000 7f02bed9d700 1 --2- 172.21.15.103:0/812020153 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02c0141f20 0x7f02c0143380 secure :-1 s=THROTTLE_DONE pgs=1785 cs=0 l=1 rx=0x7f02b80032b0 tx=0x7f02b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.795+0000 7f02b77fe700 1 -- 172.21.15.103:0/812020153 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v124) v1 ==== 100+0+10 (secure 0 0 0) 0x7f02b8040e80 con 0x7f02c0141f20 2020-04-22T14:16:52.797 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:16:52.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.796+0000 7f02c4cd2700 1 -- 172.21.15.103:0/812020153 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f02a404d9d0 msgr2=0x7f02a404fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:52.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.796+0000 7f02c4cd2700 1 --2- 172.21.15.103:0/812020153 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f02a404d9d0 0x7f02a404fe90 secure :-1 s=READY pgs=647 cs=0 l=1 rx=0x7f02a8002f30 tx=0x7f02a8007a40).stop 2020-04-22T14:16:52.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.796+0000 7f02c4cd2700 1 -- 172.21.15.103:0/812020153 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02c0141f20 msgr2=0x7f02c0143380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:52.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.796+0000 7f02c4cd2700 1 --2- 172.21.15.103:0/812020153 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02c0141f20 0x7f02c0143380 secure :-1 s=READY pgs=1785 cs=0 l=1 rx=0x7f02b80032b0 tx=0x7f02b8007dc0).stop 2020-04-22T14:16:52.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.796+0000 7f02c4cd2700 1 -- 172.21.15.103:0/812020153 shutdown_connections 2020-04-22T14:16:52.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.796+0000 7f02c4cd2700 1 --2- 172.21.15.103:0/812020153 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02c0141f20 0x7f02c0143380 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:52.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.796+0000 7f02c4cd2700 1 --2- 172.21.15.103:0/812020153 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f02c0061a30 0x7f02c0145550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:52.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.796+0000 7f02c4cd2700 1 --2- 172.21.15.103:0/812020153 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f02a404d9d0 0x7f02a404fe90 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:52.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.796+0000 7f02c4cd2700 1 --2- 172.21.15.103:0/812020153 >> v2:172.21.15.86:3300/0 conn(0x7f02c00acb10 0x7f02c0064190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:52.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.796+0000 7f02c4cd2700 1 -- 172.21.15.103:0/812020153 >> 172.21.15.103:0/812020153 conn(0x7f02c005b7b0 msgr2=0x7f02c00b57f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:52.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.796+0000 7f02c4cd2700 1 -- 172.21.15.103:0/812020153 shutdown_connections 2020-04-22T14:16:52.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.796+0000 7f02c4cd2700 1 -- 172.21.15.103:0/812020153 wait complete. 2020-04-22T14:16:52.809 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-04-22T14:16:52.809 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:52.822 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:16:52.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.965+0000 7fd920789700 1 Processor -- start 2020-04-22T14:16:52.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.965+0000 7fd920789700 1 -- start start 2020-04-22T14:16:52.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.966+0000 7fd920789700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd9181464e0 0x7fd918064540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:52.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.966+0000 7fd920789700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd918143300 con 0x7fd918065fe0 2020-04-22T14:16:52.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.966+0000 7fd920789700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9181435a0 con 0x7fd91812c0d0 2020-04-22T14:16:52.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.966+0000 7fd920789700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd918143840 con 0x7fd9181464e0 2020-04-22T14:16:52.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.966+0000 7fd91e525700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd91812c0d0 0x7fd91805b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49056/0 (socket says 172.21.15.103:49056) 2020-04-22T14:16:52.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.966+0000 7fd91e525700 1 -- 172.21.15.103:0/2418831091 learned_addr learned my addr 172.21.15.103:0/2418831091 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:52.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.966+0000 7fd91ed26700 1 --2- 172.21.15.103:0/2418831091 >> v2:172.21.15.103:3300/0 conn(0x7fd9181464e0 0x7fd918064540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:52.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.967+0000 7fd91d523700 1 -- 172.21.15.103:0/2418831091 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1173061846 0 0) 0x7fd9181435a0 con 0x7fd91812c0d0 2020-04-22T14:16:52.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.967+0000 7fd91d523700 1 -- 172.21.15.103:0/2418831091 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd900003230 con 0x7fd91812c0d0 2020-04-22T14:16:52.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.967+0000 7fd91ed26700 1 -- 172.21.15.103:0/2418831091 >> v1:172.21.15.103:6789/0 conn(0x7fd91812c0d0 legacy=0x7fd91805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:52.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.967+0000 7fd91ed26700 1 -- 172.21.15.103:0/2418831091 >> v1:172.21.15.86:6789/0 conn(0x7fd918065fe0 legacy=0x7fd918063e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:52.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.967+0000 7fd91ed26700 1 -- 172.21.15.103:0/2418831091 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd91805bb50 con 0x7fd9181464e0 2020-04-22T14:16:52.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.967+0000 7fd91ed26700 1 --2- 172.21.15.103:0/2418831091 >> v2:172.21.15.103:3300/0 conn(0x7fd9181464e0 0x7fd918064540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd918067620 tx=0x7fd910008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.967+0000 7fd91ed26700 1 --2- 172.21.15.103:0/2418831091 >> v2:172.21.15.103:3300/0 conn(0x7fd9181464e0 0x7fd918064540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd918067620 tx=0x7fd910008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.967+0000 7fd91ed26700 1 --2- 172.21.15.103:0/2418831091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9181464e0 0x7fd918064540 secure :-1 s=READY pgs=1787 cs=0 l=1 rx=0x7fd918067620 tx=0x7fd910008c60).ready entity=mon.1 client_cookie=c27f7143efcfa001 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:52.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.967+0000 7fd91ed26700 1 --2- 172.21.15.103:0/2418831091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9181464e0 0x7fd918064540 secure :-1 s=THROTTLE_DONE pgs=1787 cs=0 l=1 rx=0x7fd918067620 tx=0x7fd910008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.967+0000 7fd91d523700 1 -- 172.21.15.103:0/2418831091 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd910011e20 con 0x7fd9181464e0 2020-04-22T14:16:52.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.967+0000 7fd91ed26700 1 --2- 172.21.15.103:0/2418831091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9181464e0 0x7fd918064540 secure :-1 s=THROTTLE_DONE pgs=1787 cs=0 l=1 rx=0x7fd918067620 tx=0x7fd910008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.967+0000 7fd91d523700 1 -- 172.21.15.103:0/2418831091 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd91000a180 con 0x7fd9181464e0 2020-04-22T14:16:52.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.967+0000 7fd91ed26700 1 --2- 172.21.15.103:0/2418831091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9181464e0 0x7fd918064540 secure :-1 s=THROTTLE_DONE pgs=1787 cs=0 l=1 rx=0x7fd918067620 tx=0x7fd910008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.967+0000 7fd91d523700 1 -- 172.21.15.103:0/2418831091 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd91000a560 con 0x7fd9181464e0 2020-04-22T14:16:52.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.967+0000 7fd920789700 1 -- 172.21.15.103:0/2418831091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9181464e0 msgr2=0x7fd918064540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:52.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.967+0000 7fd920789700 1 --2- 172.21.15.103:0/2418831091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9181464e0 0x7fd918064540 secure :-1 s=READY pgs=1787 cs=0 l=1 rx=0x7fd918067620 tx=0x7fd910008c60).stop 2020-04-22T14:16:52.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.968+0000 7fd920789700 1 -- 172.21.15.103:0/2418831091 shutdown_connections 2020-04-22T14:16:52.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.968+0000 7fd920789700 1 --2- 172.21.15.103:0/2418831091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9181464e0 0x7fd918064540 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:52.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.968+0000 7fd920789700 1 -- 172.21.15.103:0/2418831091 >> 172.21.15.103:0/2418831091 conn(0x7fd9180b9160 msgr2=0x7fd91805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:52.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.968+0000 7fd920789700 1 -- 172.21.15.103:0/2418831091 shutdown_connections 2020-04-22T14:16:52.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.968+0000 7fd920789700 1 -- 172.21.15.103:0/2418831091 wait complete. 2020-04-22T14:16:52.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.969+0000 7fd920789700 1 Processor -- start 2020-04-22T14:16:52.975 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.969+0000 7fd920789700 1 -- start start 2020-04-22T14:16:52.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.969+0000 7fd920789700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd91812c0d0 0x7fd918144280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:52.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.969+0000 7fd920789700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9180b1260 con 0x7fd9181464e0 2020-04-22T14:16:52.977 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.969+0000 7fd920789700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd918063c60 con 0x7fd918065fe0 2020-04-22T14:16:52.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.969+0000 7fd920789700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd918144710 con 0x7fd91812c0d0 2020-04-22T14:16:52.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.969+0000 7fd91dd24700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd91812c0d0 0x7fd918144280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:52.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.969+0000 7fd91e525700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd918065fe0 0x7fd9180b0b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49062/0 (socket says 172.21.15.103:49062) 2020-04-22T14:16:52.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.969+0000 7fd91e525700 1 -- 172.21.15.103:0/728443838 learned_addr learned my addr 172.21.15.103:0/728443838 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:52.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.970+0000 7fd91dd24700 1 -- 172.21.15.103:0/728443838 >> v1:172.21.15.103:6789/0 conn(0x7fd918065fe0 legacy=0x7fd9180b0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:52.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.970+0000 7fd91dd24700 1 -- 172.21.15.103:0/728443838 >> v1:172.21.15.86:6789/0 conn(0x7fd9181464e0 legacy=0x7fd918141eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:52.978 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.970+0000 7fd9077fe700 1 -- 172.21.15.103:0/728443838 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4072616636 0 0) 0x7fd918063c60 con 0x7fd918065fe0 2020-04-22T14:16:52.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.970+0000 7fd91dd24700 1 -- 172.21.15.103:0/728443838 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd918063f00 con 0x7fd91812c0d0 2020-04-22T14:16:52.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.970+0000 7fd91dd24700 1 --2- 172.21.15.103:0/728443838 >> v2:172.21.15.103:3300/0 conn(0x7fd91812c0d0 0x7fd918144280 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd918129500 tx=0x7fd914010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.970+0000 7fd91dd24700 1 --2- 172.21.15.103:0/728443838 >> v2:172.21.15.103:3300/0 conn(0x7fd91812c0d0 0x7fd918144280 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd918129500 tx=0x7fd914010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.970+0000 7fd91dd24700 1 --2- 172.21.15.103:0/728443838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd91812c0d0 0x7fd918144280 secure :-1 s=READY pgs=1789 cs=0 l=1 rx=0x7fd918129500 tx=0x7fd914010990).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:52.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.970+0000 7fd91dd24700 1 --2- 172.21.15.103:0/728443838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd91812c0d0 0x7fd918144280 secure :-1 s=THROTTLE_DONE pgs=1789 cs=0 l=1 rx=0x7fd918129500 tx=0x7fd914010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.970+0000 7fd9077fe700 1 -- 172.21.15.103:0/728443838 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd91400cc00 con 0x7fd91812c0d0 2020-04-22T14:16:52.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.970+0000 7fd91dd24700 1 --2- 172.21.15.103:0/728443838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd91812c0d0 0x7fd918144280 secure :-1 s=THROTTLE_DONE pgs=1789 cs=0 l=1 rx=0x7fd918129500 tx=0x7fd914010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.970+0000 7fd91dd24700 1 --2- 172.21.15.103:0/728443838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd91812c0d0 0x7fd918144280 secure :-1 s=THROTTLE_DONE pgs=1789 cs=0 l=1 rx=0x7fd918129500 tx=0x7fd914010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.970+0000 7fd9077fe700 1 -- 172.21.15.103:0/728443838 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd91400cda0 con 0x7fd91812c0d0 2020-04-22T14:16:52.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.970+0000 7fd920789700 1 -- 172.21.15.103:0/728443838 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd918064200 con 0x7fd91812c0d0 2020-04-22T14:16:52.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.970+0000 7fd9077fe700 1 -- 172.21.15.103:0/728443838 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd914011130 con 0x7fd91812c0d0 2020-04-22T14:16:52.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.970+0000 7fd920789700 1 -- 172.21.15.103:0/728443838 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9181298c0 con 0x7fd91812c0d0 2020-04-22T14:16:52.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.971+0000 7fd91dd24700 1 --2- 172.21.15.103:0/728443838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd91812c0d0 0x7fd918144280 secure :-1 s=THROTTLE_DONE pgs=1789 cs=0 l=1 rx=0x7fd918129500 tx=0x7fd914010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.971+0000 7fd9077fe700 1 -- 172.21.15.103:0/728443838 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fd9140064e0 con 0x7fd91812c0d0 2020-04-22T14:16:52.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.971+0000 7fd920789700 1 -- 172.21.15.103:0/728443838 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd918056c90 con 0x7fd91812c0d0 2020-04-22T14:16:52.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.971+0000 7fd91dd24700 1 --2- 172.21.15.103:0/728443838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd91812c0d0 0x7fd918144280 secure :-1 s=THROTTLE_DONE pgs=1789 cs=0 l=1 rx=0x7fd918129500 tx=0x7fd914010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.971+0000 7fd9077fe700 1 --2- 172.21.15.103:0/728443838 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd8f804d820 0x7fd8f804fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:52.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.971+0000 7fd9077fe700 1 -- 172.21.15.103:0/728443838 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd914060dc0 con 0x7fd91812c0d0 2020-04-22T14:16:52.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.971+0000 7fd91e525700 1 --2- 172.21.15.103:0/728443838 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd8f804d820 0x7fd8f804fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:52.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.972+0000 7fd91e525700 1 --2- 172.21.15.103:0/728443838 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd8f804d820 0x7fd8f804fce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd908001050 tx=0x7fd9080016a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.972+0000 7fd91e525700 1 --2- 172.21.15.103:0/728443838 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd8f804d820 0x7fd8f804fce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd908001050 tx=0x7fd9080016a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.972+0000 7fd91e525700 1 --2- 172.21.15.103:0/728443838 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd8f804d820 0x7fd8f804fce0 secure :-1 s=READY pgs=648 cs=0 l=1 rx=0x7fd908001050 tx=0x7fd9080016a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:52.983 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.975+0000 7fd91dd24700 1 --2- 172.21.15.103:0/728443838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd91812c0d0 0x7fd918144280 secure :-1 s=THROTTLE_DONE pgs=1789 cs=0 l=1 rx=0x7fd918129500 tx=0x7fd914010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:52.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:52.975+0000 7fd9077fe700 1 -- 172.21.15.103:0/728443838 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fd91403c140 con 0x7fd91812c0d0 2020-04-22T14:16:53.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:53.163+0000 7fd920789700 1 -- 172.21.15.103:0/728443838 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd918147360 con 0x7fd91812c0d0 2020-04-22T14:16:53.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:53.163+0000 7fd91dd24700 1 --2- 172.21.15.103:0/728443838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd91812c0d0 0x7fd918144280 secure :-1 s=THROTTLE_DONE pgs=1789 cs=0 l=1 rx=0x7fd918129500 tx=0x7fd914010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:53.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:53.163+0000 7fd9077fe700 1 -- 172.21.15.103:0/728443838 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+2145 (secure 0 0 0) 0x7fd91403f760 con 0x7fd91812c0d0 2020-04-22T14:16:53.166 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:16:53.166 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":94,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6380,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/1697822737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1697822737},{"type":"v1","addr":"172.21.15.103:6833","nonce":1697822737}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":91}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:16:46.111567+0000","modified":"2020-04-22T14:16:48.114069+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8142},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8142":{"gid":8142,"name":"b","rank":0,"incarnation":92,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/3334539524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3334539524},{"type":"v1","addr":"172.21.15.86:6835","nonce":3334539524}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2020-04-22T14:16:53.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:53.165+0000 7fd920789700 1 -- 172.21.15.103:0/728443838 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd8f804d820 msgr2=0x7fd8f804fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:53.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:53.165+0000 7fd920789700 1 --2- 172.21.15.103:0/728443838 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd8f804d820 0x7fd8f804fce0 secure :-1 s=READY pgs=648 cs=0 l=1 rx=0x7fd908001050 tx=0x7fd9080016a0).stop 2020-04-22T14:16:53.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:53.165+0000 7fd920789700 1 -- 172.21.15.103:0/728443838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd91812c0d0 msgr2=0x7fd918144280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:53.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:53.165+0000 7fd920789700 1 --2- 172.21.15.103:0/728443838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd91812c0d0 0x7fd918144280 secure :-1 s=READY pgs=1789 cs=0 l=1 rx=0x7fd918129500 tx=0x7fd914010990).stop 2020-04-22T14:16:53.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:53.165+0000 7fd920789700 1 -- 172.21.15.103:0/728443838 shutdown_connections 2020-04-22T14:16:53.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:53.165+0000 7fd920789700 1 --2- 172.21.15.103:0/728443838 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd8f804d820 0x7fd8f804fce0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:53.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:53.165+0000 7fd920789700 1 --2- 172.21.15.103:0/728443838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd91812c0d0 0x7fd918144280 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:53.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:53.165+0000 7fd920789700 1 -- 172.21.15.103:0/728443838 >> 172.21.15.103:0/728443838 conn(0x7fd9180b9160 msgr2=0x7fd918062d90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:53.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:53.165+0000 7fd920789700 1 -- 172.21.15.103:0/728443838 shutdown_connections 2020-04-22T14:16:53.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:53.165+0000 7fd920789700 1 -- 172.21.15.103:0/728443838 wait complete. 2020-04-22T14:16:53.169 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 94 2020-04-22T14:16:53.379 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 8142}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 21, u'failed': [], u'epoch': 94, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [22], u'info': {u'gid_8142': {u'export_targets': [], u'name': u'b', u'incarnation': 92, u'state_seq': 3, u'state': u'up:active', u'gid': 8142, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 3334539524, u'type': u'v2', u'addr': u'172.21.15.86:6834'}, {u'nonce': 3334539524, u'type': u'v1', u'addr': u'172.21.15.86:6835'}]}, u'addr': u'172.21.15.86:6835/3334539524'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:16:46.111567+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:16:48.114069+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:16:53.379 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:16:53.379 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:16:53.397 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2020-04-22T14:16:53.565 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2020-04-22T14:16:53.565 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:16:53.565 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 0, 2020-04-22T14:16:53.565 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 8142, 2020-04-22T14:16:53.565 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2020-04-22T14:16:53.565 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2020-04-22T14:16:53.566 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 7.4498705569999997, 2020-04-22T14:16:53.566 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 94, 2020-04-22T14:16:53.566 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 124, 2020-04-22T14:16:53.566 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 124, 2020-04-22T14:16:53.566 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 12.648346756 2020-04-22T14:16:53.566 INFO:teuthology.orchestra.run.smithi086.stdout:} 2020-04-22T14:16:53.573 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 8142, "want_state": "up:active", "state": "up:active", "rank_uptime": 7.4498705569999997, "mdsmap_epoch": 94, "osdmap_epoch": 124, "osdmap_epoch_barrier": 124, "uptime": 12.648346756 } 2020-04-22T14:16:53.573 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-04-22T14:16:53.574 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:16:53.574 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:53.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:53.589 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:16:53.650 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:16:53.650 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:16:53.650 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:16:53.650 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:16:53.651 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:16:53.651 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:16:53.651 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:16:53.651 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:16:53.651 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:16:53.651 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:16:53.652 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:16:53.652 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:16:53.652 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:16:53.652 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:16:53.652 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:16:53.652 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 41827sec preferred_lft 41827sec 2020-04-22T14:16:53.652 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:16:53.653 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:16:53.653 INFO:teuthology.orchestra.run.smithi103.stdout:34: brx.1@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:16:53.653 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether d2:98:d4:1b:2c:0d brd ff:ff:ff:ff:ff:ff link-netnsid 1 2020-04-22T14:16:53.653 INFO:teuthology.orchestra.run.smithi103.stdout:37: brx.2@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:16:53.653 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether a6:ff:ab:51:83:b6 brd ff:ff:ff:ff:ff:ff link-netnsid 2 2020-04-22T14:16:53.653 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-04-22T14:16:53.654 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:53.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:53.698 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:16:53.775 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:53.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:53.826 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge con-name ceph-brx ifname ceph-brx stp no' 2020-04-22T14:16:53.935 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' (6b3d6d40-16fd-49ac-9259-f712ca031e42) successfully added. 2020-04-22T14:16:53.935 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:53.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:53.960 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection modify ceph-brx ipv4.addresses 192.168.255.254/16 ipv4.method manual' 2020-04-22T14:16:54.072 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:54.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:54.086 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up ceph-brx' 2020-04-22T14:16:54.194 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (master waiting for slaves) (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/47) 2020-04-22T14:16:54.195 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:54.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:54.210 INFO:teuthology.orchestra.run.smithi103:> touch /tmp/python-ceph-brx 2020-04-22T14:16:54.232 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:16:54.247 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:16:54.272 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:54.290 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:54.321 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:16:54.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:54.322 INFO:teuthology.orchestra.run.smithi103:> cat /proc/sys/net/ipv4/ip_forward 2020-04-22T14:16:54.383 INFO:teuthology.orchestra.run.smithi103.stdout:0 2020-04-22T14:16:54.383 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:54.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:54.430 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 0 > /tmp/python-ceph-brx' 2020-04-22T14:16:54.506 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:54.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:54.552 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 1 > /proc/sys/net/ipv4/ip_forward' 2020-04-22T14:16:54.627 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:54.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:54.674 INFO:teuthology.orchestra.run.smithi103:> route 2020-04-22T14:16:54.732 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2020-04-22T14:16:54.732 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-04-22T14:16:54.733 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 102 0 0 enp3s0f1 2020-04-22T14:16:54.733 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 102 0 0 enp3s0f1 2020-04-22T14:16:54.733 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 425 0 0 ceph-brx 2020-04-22T14:16:54.733 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:54.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:54.784 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-04-22T14:16:54.858 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:54.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:54.904 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-04-22T14:16:54.980 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:55.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:55.026 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-04-22T14:16:55.101 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:55.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:55.150 INFO:teuthology.orchestra.run.smithi103:> ip netns list 2020-04-22T14:16:55.212 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:55.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:55.260 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:16:55.318 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 1 2020-04-22T14:16:55.318 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 2 2020-04-22T14:16:55.318 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:55.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:55.373 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:16:55.448 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:55.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:55.496 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0' 2020-04-22T14:16:55.572 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-04-22T14:16:55.572 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:55.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:55.624 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0' 2020-04-22T14:16:55.700 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:55.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:55.746 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0' 2020-04-22T14:16:55.854 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:55.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:55.883 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up' 2020-04-22T14:16:55.991 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:56.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:56.005 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up' 2020-04-22T14:16:56.113 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:56.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:56.136 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254' 2020-04-22T14:16:56.244 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:56.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:56.258 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:16:56.333 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:56.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:56.385 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge-slave con-name brx.0 ifname brx.0 master ceph-brx' 2020-04-22T14:16:56.492 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.0' (f5d72895-9193-44bf-a626-dbcf79496abe) successfully added. 2020-04-22T14:16:56.493 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:56.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:16:56.524 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up brx.0' 2020-04-22T14:16:56.682 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/48) 2020-04-22T14:16:56.732 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-04-22T14:16:56.733 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi103.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-04-22T14:16:56.733 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:56.754 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:16:56.754 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:16:56.812 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:56.861 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:16:56.862 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:16:56.930 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:16:56.936 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:16:56.939 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:56.983 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:16:56.984 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:16:57.045 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-04-22T14:16:57.045 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:57.091 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:16:57.134 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:57.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:16:57.148 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:16:57.216 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:16:57.223 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:16:57.224 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:57.224 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:2020-04-22T14:16:57.220+0000 7ffa42ffe1c0 -1 init, newargv = 0x56114f6e0660 newargc=9 2020-04-22T14:16:57.225 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[107198]: starting ceph client 2020-04-22T14:16:57.227 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[107198]: starting fuse 2020-04-22T14:16:57.239 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:16:57.240 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:16:57.299 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:16:57.300 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2020-04-22T14:16:57.300 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:57.347 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:16:57.348 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:16:57.348 INFO:teuthology.orchestra.run.smithi103:> import glob 2020-04-22T14:16:57.348 INFO:teuthology.orchestra.run.smithi103:> import re 2020-04-22T14:16:57.348 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:16:57.348 INFO:teuthology.orchestra.run.smithi103:> import subprocess 2020-04-22T14:16:57.348 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:16:57.349 INFO:teuthology.orchestra.run.smithi103:> def find_socket(client_name): 2020-04-22T14:16:57.349 INFO:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-04-22T14:16:57.349 INFO:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2020-04-22T14:16:57.349 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:16:57.349 INFO:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2020-04-22T14:16:57.349 INFO:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2020-04-22T14:16:57.349 INFO:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2020-04-22T14:16:57.349 INFO:teuthology.orchestra.run.smithi103:> return files[0] 2020-04-22T14:16:57.350 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:16:57.350 INFO:teuthology.orchestra.run.smithi103:> for f in files: 2020-04-22T14:16:57.350 INFO:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:16:57.350 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:16:57.350 INFO:teuthology.orchestra.run.smithi103:> return f 2020-04-22T14:16:57.350 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:16:57.350 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:16:57.350 INFO:teuthology.orchestra.run.smithi103:> print(find_socket("client.0")) 2020-04-22T14:16:57.350 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:16:57.455 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.0.107198.asok 2020-04-22T14:16:57.455 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.107198.asok 2020-04-22T14:16:57.455 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:57.469 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:16:57.469 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.107198.asok status 2020-04-22T14:16:57.626 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:16:57.626 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2020-04-22T14:16:57.627 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:16:57.627 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:16:57.627 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "0", 2020-04-22T14:16:57.627 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:16:57.627 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-04-22T14:16:57.627 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "107198", 2020-04-22T14:16:57.628 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:16:57.628 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:57.628 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2020-04-22T14:16:57.628 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2020-04-22T14:16:57.628 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 9079, 2020-04-22T14:16:57.628 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2020-04-22T14:16:57.629 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:16:57.629 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:16:57.629 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 9079 2020-04-22T14:16:57.629 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:57.629 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:16:57.629 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:16:57.630 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:16:57.630 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 546260275 2020-04-22T14:16:57.630 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:16:57.630 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:57.630 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:16:57.631 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:16:57.631 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:16:57.631 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 546260275 2020-04-22T14:16:57.631 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:16:57.631 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.9079 192.168.0.1:0/546260275", 2020-04-22T14:16:57.631 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.1:0/546260275", 2020-04-22T14:16:57.631 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2020-04-22T14:16:57.632 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 94, 2020-04-22T14:16:57.632 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 124, 2020-04-22T14:16:57.632 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2020-04-22T14:16:57.632 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklisted": false 2020-04-22T14:16:57.633 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:16:57.633 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:57.647 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:16:57.647 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-22T14:16:57.647 INFO:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:16:57.705 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2020-04-22T14:16:57.705 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-04-22T14:16:57.705 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:57.755 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:16:57.756 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:16:57.831 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:57.879 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:16:58.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.023+0000 7f88db02d700 1 Processor -- start 2020-04-22T14:16:58.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.024+0000 7f88db02d700 1 -- start start 2020-04-22T14:16:58.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.024+0000 7f88db02d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f88d412c0d0 0x7f88d41464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:58.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.024+0000 7f88db02d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88d4065fe0 0x7f88d405b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:58.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.024+0000 7f88db02d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88d4143300 con 0x7f88d405b8a0 2020-04-22T14:16:58.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.024+0000 7f88db02d700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88d412c4b0 con 0x7f88d412c0d0 2020-04-22T14:16:58.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.024+0000 7f88db02d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d41435a0 con 0x7f88d4065fe0 2020-04-22T14:16:58.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.024+0000 7f88d8dc9700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f88d412c0d0 0x7f88d41464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:58.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.024+0000 7f88d8dc9700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f88d412c0d0 0x7f88d41464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56898/0 (socket says 172.21.15.103:56898) 2020-04-22T14:16:58.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.024+0000 7f88d8dc9700 1 -- 172.21.15.103:0/1589305628 learned_addr learned my addr 172.21.15.103:0/1589305628 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:58.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.024+0000 7f88d95ca700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f88d405b8a0 0x7f88d4062ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49084/0 (socket says 172.21.15.103:49084) 2020-04-22T14:16:58.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.025+0000 7f88d3fff700 1 --2- 172.21.15.103:0/1589305628 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88d4065fe0 0x7f88d405b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:58.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.025+0000 7f88d8dc9700 1 -- 172.21.15.103:0/1589305628 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88d4065fe0 msgr2=0x7f88d405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:58.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.025+0000 7f88d8dc9700 1 --2- 172.21.15.103:0/1589305628 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88d4065fe0 0x7f88d405b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:58.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.025+0000 7f88d8dc9700 1 -- 172.21.15.103:0/1589305628 >> v1:172.21.15.103:6789/0 conn(0x7f88d405b8a0 legacy=0x7f88d4062ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:58.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.025+0000 7f88d8dc9700 1 -- 172.21.15.103:0/1589305628 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d4143840 con 0x7f88d412c0d0 2020-04-22T14:16:58.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.025+0000 7f88d37fe700 1 -- 172.21.15.103:0/1589305628 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3306637086 0 0) 0x7f88d4143300 con 0x7f88d405b8a0 2020-04-22T14:16:58.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.025+0000 7f88d8dc9700 1 --2- 172.21.15.103:0/1589305628 >> v2:172.21.15.103:3300/0 conn(0x7f88d412c0d0 0x7f88d41464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f88cc0032b0 tx=0x7f88cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.025+0000 7f88d8dc9700 1 --2- 172.21.15.103:0/1589305628 >> v2:172.21.15.103:3300/0 conn(0x7f88d412c0d0 0x7f88d41464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f88cc0032b0 tx=0x7f88cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.025+0000 7f88d8dc9700 1 --2- 172.21.15.103:0/1589305628 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88d412c0d0 0x7f88d41464e0 secure :-1 s=READY pgs=1794 cs=0 l=1 rx=0x7f88cc0032b0 tx=0x7f88cc007dc0).ready entity=mon.1 client_cookie=9c5ed08fb8246591 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:58.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.025+0000 7f88d8dc9700 1 --2- 172.21.15.103:0/1589305628 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88d412c0d0 0x7f88d41464e0 secure :-1 s=THROTTLE_DONE pgs=1794 cs=0 l=1 rx=0x7f88cc0032b0 tx=0x7f88cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.025+0000 7f88d37fe700 1 -- 172.21.15.103:0/1589305628 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88cc00a180 con 0x7f88d412c0d0 2020-04-22T14:16:58.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.025+0000 7f88d8dc9700 1 --2- 172.21.15.103:0/1589305628 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88d412c0d0 0x7f88d41464e0 secure :-1 s=THROTTLE_DONE pgs=1794 cs=0 l=1 rx=0x7f88cc0032b0 tx=0x7f88cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.025+0000 7f88d8dc9700 1 --2- 172.21.15.103:0/1589305628 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88d412c0d0 0x7f88d41464e0 secure :-1 s=THROTTLE_DONE pgs=1794 cs=0 l=1 rx=0x7f88cc0032b0 tx=0x7f88cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.025+0000 7f88d37fe700 1 -- 172.21.15.103:0/1589305628 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88cc00a320 con 0x7f88d412c0d0 2020-04-22T14:16:58.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.025+0000 7f88d37fe700 1 -- 172.21.15.103:0/1589305628 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88cc00a700 con 0x7f88d412c0d0 2020-04-22T14:16:58.035 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.025+0000 7f88db02d700 1 -- 172.21.15.103:0/1589305628 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88d412c0d0 msgr2=0x7f88d41464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:58.035 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.025+0000 7f88db02d700 1 --2- 172.21.15.103:0/1589305628 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88d412c0d0 0x7f88d41464e0 secure :-1 s=READY pgs=1794 cs=0 l=1 rx=0x7f88cc0032b0 tx=0x7f88cc007dc0).stop 2020-04-22T14:16:58.035 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.026+0000 7f88db02d700 1 -- 172.21.15.103:0/1589305628 shutdown_connections 2020-04-22T14:16:58.035 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.026+0000 7f88db02d700 1 --2- 172.21.15.103:0/1589305628 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88d412c0d0 0x7f88d41464e0 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:58.035 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.026+0000 7f88db02d700 1 --2- 172.21.15.103:0/1589305628 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88d4065fe0 0x7f88d405b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:58.035 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.026+0000 7f88db02d700 1 -- 172.21.15.103:0/1589305628 >> 172.21.15.103:0/1589305628 conn(0x7f88d40b9160 msgr2=0x7f88d405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:58.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.026+0000 7f88db02d700 1 -- 172.21.15.103:0/1589305628 shutdown_connections 2020-04-22T14:16:58.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.026+0000 7f88db02d700 1 -- 172.21.15.103:0/1589305628 wait complete. 2020-04-22T14:16:58.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.026+0000 7f88db02d700 1 Processor -- start 2020-04-22T14:16:58.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.027+0000 7f88db02d700 1 -- start start 2020-04-22T14:16:58.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.027+0000 7f88db02d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f88d4065fe0 0x7f88d40b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:58.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.027+0000 7f88db02d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88d412c0d0 0x7f88d40b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:58.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.027+0000 7f88db02d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88d4129c90 con 0x7f88d405b8a0 2020-04-22T14:16:58.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.027+0000 7f88db02d700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88d40b5920 con 0x7f88d4065fe0 2020-04-22T14:16:58.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.027+0000 7f88db02d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d40b1ce0 con 0x7f88d412c0d0 2020-04-22T14:16:58.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.027+0000 7f88d8dc9700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f88d405b8a0 0x7f88d40b15d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49090/0 (socket says 172.21.15.103:49090) 2020-04-22T14:16:58.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.027+0000 7f88d3fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f88d4065fe0 0x7f88d40b0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:58.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.027+0000 7f88d8dc9700 1 -- 172.21.15.103:0/1807459984 learned_addr learned my addr 172.21.15.103:0/1807459984 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:58.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.028+0000 7f88d95ca700 1 --2- 172.21.15.103:0/1807459984 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88d412c0d0 0x7f88d40b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:58.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.028+0000 7f88d3fff700 1 -- 172.21.15.103:0/1807459984 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88d412c0d0 msgr2=0x7f88d40b54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:58.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.028+0000 7f88d3fff700 1 --2- 172.21.15.103:0/1807459984 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88d412c0d0 0x7f88d40b54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:58.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.028+0000 7f88d3fff700 1 -- 172.21.15.103:0/1807459984 >> v1:172.21.15.103:6789/0 conn(0x7f88d405b8a0 legacy=0x7f88d40b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:58.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.028+0000 7f88d1ffb700 1 -- 172.21.15.103:0/1807459984 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 307592601 0 0) 0x7f88d4129c90 con 0x7f88d405b8a0 2020-04-22T14:16:58.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.028+0000 7f88d3fff700 1 -- 172.21.15.103:0/1807459984 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d4157bd0 con 0x7f88d4065fe0 2020-04-22T14:16:58.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.028+0000 7f88d3fff700 1 --2- 172.21.15.103:0/1807459984 >> v2:172.21.15.103:3300/0 conn(0x7f88d4065fe0 0x7f88d40b0b50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f88c8002f30 tx=0x7f88c8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.028+0000 7f88d3fff700 1 --2- 172.21.15.103:0/1807459984 >> v2:172.21.15.103:3300/0 conn(0x7f88d4065fe0 0x7f88d40b0b50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f88c8002f30 tx=0x7f88c8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.028+0000 7f88d3fff700 1 --2- 172.21.15.103:0/1807459984 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88d4065fe0 0x7f88d40b0b50 secure :-1 s=READY pgs=1796 cs=0 l=1 rx=0x7f88c8002f30 tx=0x7f88c8010bb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:58.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.028+0000 7f88d3fff700 1 --2- 172.21.15.103:0/1807459984 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88d4065fe0 0x7f88d40b0b50 secure :-1 s=THROTTLE_DONE pgs=1796 cs=0 l=1 rx=0x7f88c8002f30 tx=0x7f88c8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.028+0000 7f88d3fff700 1 --2- 172.21.15.103:0/1807459984 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88d4065fe0 0x7f88d40b0b50 secure :-1 s=THROTTLE_DONE pgs=1796 cs=0 l=1 rx=0x7f88c8002f30 tx=0x7f88c8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.028+0000 7f88d3fff700 1 --2- 172.21.15.103:0/1807459984 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88d4065fe0 0x7f88d40b0b50 secure :-1 s=THROTTLE_DONE pgs=1796 cs=0 l=1 rx=0x7f88c8002f30 tx=0x7f88c8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.028+0000 7f88d1ffb700 1 -- 172.21.15.103:0/1807459984 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88c8005e90 con 0x7f88d4065fe0 2020-04-22T14:16:58.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.028+0000 7f88d1ffb700 1 -- 172.21.15.103:0/1807459984 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c8007180 con 0x7f88d4065fe0 2020-04-22T14:16:58.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.028+0000 7f88db02d700 1 -- 172.21.15.103:0/1807459984 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88d4157e70 con 0x7f88d4065fe0 2020-04-22T14:16:58.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.028+0000 7f88d1ffb700 1 -- 172.21.15.103:0/1807459984 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88c80075a0 con 0x7f88d4065fe0 2020-04-22T14:16:58.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.028+0000 7f88db02d700 1 -- 172.21.15.103:0/1807459984 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88d412a0c0 con 0x7f88d4065fe0 2020-04-22T14:16:58.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.029+0000 7f88d3fff700 1 --2- 172.21.15.103:0/1807459984 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88d4065fe0 0x7f88d40b0b50 secure :-1 s=THROTTLE_DONE pgs=1796 cs=0 l=1 rx=0x7f88c8002f30 tx=0x7f88c8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.029+0000 7f88db02d700 1 -- 172.21.15.103:0/1807459984 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88d4157a30 con 0x7f88d4065fe0 2020-04-22T14:16:58.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.029+0000 7f88d1ffb700 1 -- 172.21.15.103:0/1807459984 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f88c800e290 con 0x7f88d4065fe0 2020-04-22T14:16:58.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.029+0000 7f88d3fff700 1 --2- 172.21.15.103:0/1807459984 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88d4065fe0 0x7f88d40b0b50 secure :-1 s=THROTTLE_DONE pgs=1796 cs=0 l=1 rx=0x7f88c8002f30 tx=0x7f88c8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.030+0000 7f88d1ffb700 1 --2- 172.21.15.103:0/1807459984 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f88b404d920 0x7f88b404fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:58.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.030+0000 7f88d1ffb700 1 -- 172.21.15.103:0/1807459984 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f88c8061730 con 0x7f88d4065fe0 2020-04-22T14:16:58.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.030+0000 7f88d8dc9700 1 --2- 172.21.15.103:0/1807459984 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f88b404d920 0x7f88b404fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:58.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.030+0000 7f88d8dc9700 1 --2- 172.21.15.103:0/1807459984 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f88b404d920 0x7f88b404fde0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f88cc0086a0 tx=0x7f88cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.030+0000 7f88d8dc9700 1 --2- 172.21.15.103:0/1807459984 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f88b404d920 0x7f88b404fde0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f88cc0086a0 tx=0x7f88cc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.030+0000 7f88d8dc9700 1 --2- 172.21.15.103:0/1807459984 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f88b404d920 0x7f88b404fde0 secure :-1 s=READY pgs=649 cs=0 l=1 rx=0x7f88cc0086a0 tx=0x7f88cc007dc0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:58.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.034+0000 7f88d3fff700 1 --2- 172.21.15.103:0/1807459984 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88d4065fe0 0x7f88d40b0b50 secure :-1 s=THROTTLE_DONE pgs=1796 cs=0 l=1 rx=0x7f88c8002f30 tx=0x7f88c8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.034+0000 7f88d1ffb700 1 -- 172.21.15.103:0/1807459984 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f88d4157a30 con 0x7f88d4065fe0 2020-04-22T14:16:58.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.176+0000 7f88db02d700 1 -- 172.21.15.103:0/1807459984 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88d4157a30 con 0x7f88d4065fe0 2020-04-22T14:16:58.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.177+0000 7f88d3fff700 1 --2- 172.21.15.103:0/1807459984 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88d4065fe0 0x7f88d40b0b50 secure :-1 s=THROTTLE_DONE pgs=1796 cs=0 l=1 rx=0x7f88c8002f30 tx=0x7f88c8010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.177+0000 7f88d1ffb700 1 -- 172.21.15.103:0/1807459984 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) v1 ==== 74+0+16103 (secure 0 0 0) 0x7f88d4157a30 con 0x7f88d4065fe0 2020-04-22T14:16:58.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.178+0000 7f88db02d700 1 -- 172.21.15.103:0/1807459984 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f88b404d920 msgr2=0x7f88b404fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:58.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.178+0000 7f88db02d700 1 --2- 172.21.15.103:0/1807459984 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f88b404d920 0x7f88b404fde0 secure :-1 s=READY pgs=649 cs=0 l=1 rx=0x7f88cc0086a0 tx=0x7f88cc007dc0).stop 2020-04-22T14:16:58.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.178+0000 7f88db02d700 1 -- 172.21.15.103:0/1807459984 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88d4065fe0 msgr2=0x7f88d40b0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:58.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.178+0000 7f88db02d700 1 --2- 172.21.15.103:0/1807459984 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88d4065fe0 0x7f88d40b0b50 secure :-1 s=READY pgs=1796 cs=0 l=1 rx=0x7f88c8002f30 tx=0x7f88c8010bb0).stop 2020-04-22T14:16:58.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.178+0000 7f88db02d700 1 -- 172.21.15.103:0/1807459984 shutdown_connections 2020-04-22T14:16:58.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.178+0000 7f88db02d700 1 --2- 172.21.15.103:0/1807459984 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f88b404d920 0x7f88b404fde0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:58.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.178+0000 7f88db02d700 1 --2- 172.21.15.103:0/1807459984 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88d412c0d0 0x7f88d40b54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:58.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.178+0000 7f88db02d700 1 --2- 172.21.15.103:0/1807459984 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88d4065fe0 0x7f88d40b0b50 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:58.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.178+0000 7f88db02d700 1 -- 172.21.15.103:0/1807459984 >> 172.21.15.103:0/1807459984 conn(0x7f88d40b9160 msgr2=0x7f88d40b7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:58.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.178+0000 7f88db02d700 1 -- 172.21.15.103:0/1807459984 shutdown_connections 2020-04-22T14:16:58.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.178+0000 7f88db02d700 1 -- 172.21.15.103:0/1807459984 wait complete. 2020-04-22T14:16:58.182 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:16:58.183 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":124,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:16:47.112746+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:16:44.031424+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2020-04-22T14:16:45.073910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:16:58.191 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:16:44.031424+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 21, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'123', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:16:45.073910+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 22, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'124', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:16:58.191 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:58.205 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:16:58.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.351+0000 7f5f4a4b4700 1 Processor -- start 2020-04-22T14:16:58.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.351+0000 7f5f4a4b4700 1 -- start start 2020-04-22T14:16:58.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.352+0000 7f5f4a4b4700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5f440ac950 0x7f5f44146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:58.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.352+0000 7f5f4a4b4700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5f441470a0 0x7f5f44143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:58.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.352+0000 7f5f4a4b4700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f441467e0 con 0x7f5f440b9140 2020-04-22T14:16:58.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.352+0000 7f5f4a4b4700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f44147530 con 0x7f5f441470a0 2020-04-22T14:16:58.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.352+0000 7f5f4a4b4700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f440602f0 con 0x7f5f440ac950 2020-04-22T14:16:58.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.352+0000 7f5f437fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5f440ac950 0x7f5f44146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:58.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.352+0000 7f5f43fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f5f440b9140 0x7f5f4412b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49098/0 (socket says 172.21.15.103:49098) 2020-04-22T14:16:58.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.352+0000 7f5f43fff700 1 -- 172.21.15.103:0/1799976222 learned_addr learned my addr 172.21.15.103:0/1799976222 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:58.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.352+0000 7f5f48a51700 1 --2- 172.21.15.103:0/1799976222 >> v2:172.21.15.86:3300/0 conn(0x7f5f441470a0 0x7f5f44143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:58.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.352+0000 7f5f437fe700 1 -- 172.21.15.103:0/1799976222 >> v2:172.21.15.86:3300/0 conn(0x7f5f441470a0 msgr2=0x7f5f44143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:58.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.352+0000 7f5f437fe700 1 --2- 172.21.15.103:0/1799976222 >> v2:172.21.15.86:3300/0 conn(0x7f5f441470a0 0x7f5f44143090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:58.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.352+0000 7f5f437fe700 1 -- 172.21.15.103:0/1799976222 >> v1:172.21.15.103:6789/0 conn(0x7f5f440b9140 legacy=0x7f5f4412b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:58.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.352+0000 7f5f42ffd700 1 -- 172.21.15.103:0/1799976222 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1650401726 0 0) 0x7f5f441467e0 con 0x7f5f440b9140 2020-04-22T14:16:58.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.352+0000 7f5f437fe700 1 -- 172.21.15.103:0/1799976222 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f44060050 con 0x7f5f440ac950 2020-04-22T14:16:58.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.352+0000 7f5f437fe700 1 --2- 172.21.15.103:0/1799976222 >> v2:172.21.15.103:3300/0 conn(0x7f5f440ac950 0x7f5f44146c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5f38002f30 tx=0x7f5f38007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.352+0000 7f5f437fe700 1 --2- 172.21.15.103:0/1799976222 >> v2:172.21.15.103:3300/0 conn(0x7f5f440ac950 0x7f5f44146c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5f38002f30 tx=0x7f5f38007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.352+0000 7f5f437fe700 1 --2- 172.21.15.103:0/1799976222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f440ac950 0x7f5f44146c40 secure :-1 s=READY pgs=1798 cs=0 l=1 rx=0x7f5f38002f30 tx=0x7f5f38007a40).ready entity=mon.1 client_cookie=d836d4ab8eb0aa58 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:58.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.352+0000 7f5f437fe700 1 --2- 172.21.15.103:0/1799976222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f440ac950 0x7f5f44146c40 secure :-1 s=THROTTLE_DONE pgs=1798 cs=0 l=1 rx=0x7f5f38002f30 tx=0x7f5f38007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.352+0000 7f5f42ffd700 1 -- 172.21.15.103:0/1799976222 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f38011470 con 0x7f5f440ac950 2020-04-22T14:16:58.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.352+0000 7f5f437fe700 1 --2- 172.21.15.103:0/1799976222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f440ac950 0x7f5f44146c40 secure :-1 s=THROTTLE_DONE pgs=1798 cs=0 l=1 rx=0x7f5f38002f30 tx=0x7f5f38007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.352+0000 7f5f42ffd700 1 -- 172.21.15.103:0/1799976222 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f380115d0 con 0x7f5f440ac950 2020-04-22T14:16:58.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.352+0000 7f5f437fe700 1 --2- 172.21.15.103:0/1799976222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f440ac950 0x7f5f44146c40 secure :-1 s=THROTTLE_DONE pgs=1798 cs=0 l=1 rx=0x7f5f38002f30 tx=0x7f5f38007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.352+0000 7f5f42ffd700 1 -- 172.21.15.103:0/1799976222 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f380119b0 con 0x7f5f440ac950 2020-04-22T14:16:58.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.352+0000 7f5f4a4b4700 1 -- 172.21.15.103:0/1799976222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f440ac950 msgr2=0x7f5f44146c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:58.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.352+0000 7f5f4a4b4700 1 --2- 172.21.15.103:0/1799976222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f440ac950 0x7f5f44146c40 secure :-1 s=READY pgs=1798 cs=0 l=1 rx=0x7f5f38002f30 tx=0x7f5f38007a40).stop 2020-04-22T14:16:58.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.353+0000 7f5f4a4b4700 1 -- 172.21.15.103:0/1799976222 shutdown_connections 2020-04-22T14:16:58.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.353+0000 7f5f4a4b4700 1 --2- 172.21.15.103:0/1799976222 >> v2:172.21.15.86:3300/0 conn(0x7f5f441470a0 0x7f5f44143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:58.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.353+0000 7f5f4a4b4700 1 --2- 172.21.15.103:0/1799976222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f440ac950 0x7f5f44146c40 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:58.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.353+0000 7f5f4a4b4700 1 -- 172.21.15.103:0/1799976222 >> 172.21.15.103:0/1799976222 conn(0x7f5f4405b7b0 msgr2=0x7f5f440b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:58.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.353+0000 7f5f4a4b4700 1 -- 172.21.15.103:0/1799976222 shutdown_connections 2020-04-22T14:16:58.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.353+0000 7f5f4a4b4700 1 -- 172.21.15.103:0/1799976222 wait complete. 2020-04-22T14:16:58.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.354+0000 7f5f4a4b4700 1 Processor -- start 2020-04-22T14:16:58.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.354+0000 7f5f4a4b4700 1 -- start start 2020-04-22T14:16:58.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.355+0000 7f5f4a4b4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5f440ac950 0x7f5f44152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:58.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.355+0000 7f5f4a4b4700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5f440b9140 0x7f5f44062900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:58.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.355+0000 7f5f4a4b4700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f44062300 con 0x7f5f441470a0 2020-04-22T14:16:58.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.355+0000 7f5f4a4b4700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f441532e0 con 0x7f5f440b9140 2020-04-22T14:16:58.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.355+0000 7f5f4a4b4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f44153580 con 0x7f5f440ac950 2020-04-22T14:16:58.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.355+0000 7f5f437fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5f440b9140 0x7f5f44062900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:58.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.355+0000 7f5f437fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5f440b9140 0x7f5f44062900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56916/0 (socket says 172.21.15.103:56916) 2020-04-22T14:16:58.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.355+0000 7f5f437fe700 1 -- 172.21.15.103:0/3557302401 learned_addr learned my addr 172.21.15.103:0/3557302401 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:58.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.355+0000 7f5f43fff700 1 --2- 172.21.15.103:0/3557302401 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5f440ac950 0x7f5f44152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:58.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.355+0000 7f5f437fe700 1 -- 172.21.15.103:0/3557302401 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5f440ac950 msgr2=0x7f5f44152d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:58.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.355+0000 7f5f437fe700 1 --2- 172.21.15.103:0/3557302401 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5f440ac950 0x7f5f44152d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:58.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.355+0000 7f5f437fe700 1 -- 172.21.15.103:0/3557302401 >> v1:172.21.15.86:6789/0 conn(0x7f5f441470a0 legacy=0x7f5f440b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:58.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.355+0000 7f5f437fe700 1 -- 172.21.15.103:0/3557302401 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f44153820 con 0x7f5f440b9140 2020-04-22T14:16:58.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.355+0000 7f5f437fe700 1 --2- 172.21.15.103:0/3557302401 >> v2:172.21.15.103:3300/0 conn(0x7f5f440b9140 0x7f5f44062900 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5f38002f30 tx=0x7f5f38007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.355+0000 7f5f437fe700 1 --2- 172.21.15.103:0/3557302401 >> v2:172.21.15.103:3300/0 conn(0x7f5f440b9140 0x7f5f44062900 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5f38002f30 tx=0x7f5f38007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.355+0000 7f5f437fe700 1 --2- 172.21.15.103:0/3557302401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f440b9140 0x7f5f44062900 secure :-1 s=READY pgs=1799 cs=0 l=1 rx=0x7f5f38002f30 tx=0x7f5f38007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:58.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.355+0000 7f5f437fe700 1 --2- 172.21.15.103:0/3557302401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f440b9140 0x7f5f44062900 secure :-1 s=THROTTLE_DONE pgs=1799 cs=0 l=1 rx=0x7f5f38002f30 tx=0x7f5f38007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.355+0000 7f5f417fa700 1 -- 172.21.15.103:0/3557302401 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f38007170 con 0x7f5f440b9140 2020-04-22T14:16:58.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.355+0000 7f5f437fe700 1 --2- 172.21.15.103:0/3557302401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f440b9140 0x7f5f44062900 secure :-1 s=THROTTLE_DONE pgs=1799 cs=0 l=1 rx=0x7f5f38002f30 tx=0x7f5f38007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.355+0000 7f5f437fe700 1 --2- 172.21.15.103:0/3557302401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f440b9140 0x7f5f44062900 secure :-1 s=THROTTLE_DONE pgs=1799 cs=0 l=1 rx=0x7f5f38002f30 tx=0x7f5f38007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.355+0000 7f5f417fa700 1 -- 172.21.15.103:0/3557302401 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f380072d0 con 0x7f5f440b9140 2020-04-22T14:16:58.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.355+0000 7f5f4a4b4700 1 -- 172.21.15.103:0/3557302401 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f440b2520 con 0x7f5f440b9140 2020-04-22T14:16:58.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.355+0000 7f5f417fa700 1 -- 172.21.15.103:0/3557302401 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f380056c0 con 0x7f5f440b9140 2020-04-22T14:16:58.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.356+0000 7f5f4a4b4700 1 -- 172.21.15.103:0/3557302401 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f44150b30 con 0x7f5f440b9140 2020-04-22T14:16:58.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.356+0000 7f5f437fe700 1 --2- 172.21.15.103:0/3557302401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f440b9140 0x7f5f44062900 secure :-1 s=THROTTLE_DONE pgs=1799 cs=0 l=1 rx=0x7f5f38002f30 tx=0x7f5f38007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.357+0000 7f5f4a4b4700 1 -- 172.21.15.103:0/3557302401 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f441539b0 con 0x7f5f440b9140 2020-04-22T14:16:58.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.357+0000 7f5f417fa700 1 -- 172.21.15.103:0/3557302401 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f5f38005930 con 0x7f5f440b9140 2020-04-22T14:16:58.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.357+0000 7f5f437fe700 1 --2- 172.21.15.103:0/3557302401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f440b9140 0x7f5f44062900 secure :-1 s=THROTTLE_DONE pgs=1799 cs=0 l=1 rx=0x7f5f38002f30 tx=0x7f5f38007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.357+0000 7f5f417fa700 1 --2- 172.21.15.103:0/3557302401 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5f2404d9a0 0x7f5f2404fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:58.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.357+0000 7f5f417fa700 1 -- 172.21.15.103:0/3557302401 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5f38061c70 con 0x7f5f440b9140 2020-04-22T14:16:58.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.357+0000 7f5f43fff700 1 --2- 172.21.15.103:0/3557302401 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5f2404d9a0 0x7f5f2404fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:58.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.357+0000 7f5f43fff700 1 --2- 172.21.15.103:0/3557302401 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5f2404d9a0 0x7f5f2404fe60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5f34000b80 tx=0x7f5f34001800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.357+0000 7f5f43fff700 1 --2- 172.21.15.103:0/3557302401 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5f2404d9a0 0x7f5f2404fe60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5f34000b80 tx=0x7f5f34001800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.379 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.357+0000 7f5f43fff700 1 --2- 172.21.15.103:0/3557302401 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5f2404d9a0 0x7f5f2404fe60 secure :-1 s=READY pgs=650 cs=0 l=1 rx=0x7f5f34000b80 tx=0x7f5f34001800).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:58.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.361+0000 7f5f437fe700 1 --2- 172.21.15.103:0/3557302401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f440b9140 0x7f5f44062900 secure :-1 s=THROTTLE_DONE pgs=1799 cs=0 l=1 rx=0x7f5f38002f30 tx=0x7f5f38007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.361+0000 7f5f417fa700 1 -- 172.21.15.103:0/3557302401 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f5f3803d050 con 0x7f5f440b9140 2020-04-22T14:16:58.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.503+0000 7f5f4a4b4700 1 -- 172.21.15.103:0/3557302401 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f5f44056c90 con 0x7f5f440b9140 2020-04-22T14:16:58.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.503+0000 7f5f437fe700 1 --2- 172.21.15.103:0/3557302401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f440b9140 0x7f5f44062900 secure :-1 s=THROTTLE_DONE pgs=1799 cs=0 l=1 rx=0x7f5f38002f30 tx=0x7f5f38007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.503+0000 7f5f417fa700 1 -- 172.21.15.103:0/3557302401 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v124) v1 ==== 110+0+10 (secure 0 0 0) 0x7f5f38040670 con 0x7f5f440b9140 2020-04-22T14:16:58.506 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:16:58.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.505+0000 7f5f4a4b4700 1 -- 172.21.15.103:0/3557302401 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5f2404d9a0 msgr2=0x7f5f2404fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:58.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.505+0000 7f5f4a4b4700 1 --2- 172.21.15.103:0/3557302401 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5f2404d9a0 0x7f5f2404fe60 secure :-1 s=READY pgs=650 cs=0 l=1 rx=0x7f5f34000b80 tx=0x7f5f34001800).stop 2020-04-22T14:16:58.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.505+0000 7f5f4a4b4700 1 -- 172.21.15.103:0/3557302401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f440b9140 msgr2=0x7f5f44062900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:58.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.505+0000 7f5f4a4b4700 1 --2- 172.21.15.103:0/3557302401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f440b9140 0x7f5f44062900 secure :-1 s=READY pgs=1799 cs=0 l=1 rx=0x7f5f38002f30 tx=0x7f5f38007a40).stop 2020-04-22T14:16:58.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.505+0000 7f5f4a4b4700 1 -- 172.21.15.103:0/3557302401 shutdown_connections 2020-04-22T14:16:58.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.505+0000 7f5f4a4b4700 1 --2- 172.21.15.103:0/3557302401 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5f2404d9a0 0x7f5f2404fe60 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:58.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.505+0000 7f5f4a4b4700 1 --2- 172.21.15.103:0/3557302401 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5f440ac950 0x7f5f44152d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:58.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.505+0000 7f5f4a4b4700 1 --2- 172.21.15.103:0/3557302401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f440b9140 0x7f5f44062900 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:58.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.505+0000 7f5f4a4b4700 1 -- 172.21.15.103:0/3557302401 >> 172.21.15.103:0/3557302401 conn(0x7f5f4405b7b0 msgr2=0x7f5f440b5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:58.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.505+0000 7f5f4a4b4700 1 -- 172.21.15.103:0/3557302401 shutdown_connections 2020-04-22T14:16:58.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.505+0000 7f5f4a4b4700 1 -- 172.21.15.103:0/3557302401 wait complete. 2020-04-22T14:16:58.517 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:58.531 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:16:58.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.677+0000 7fe9ae2e2700 1 Processor -- start 2020-04-22T14:16:58.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.677+0000 7fe9ae2e2700 1 -- start start 2020-04-22T14:16:58.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.678+0000 7fe9ae2e2700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9a80b3bd0 0x7fe9a8143650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:58.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.678+0000 7fe9ae2e2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe9a8143ab0 0x7fe9a8143f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:58.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.678+0000 7fe9ae2e2700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9a8148310 con 0x7fe9a80b9140 2020-04-22T14:16:58.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.678+0000 7fe9ae2e2700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9a81485b0 con 0x7fe9a8143ab0 2020-04-22T14:16:58.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.678+0000 7fe9ae2e2700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a80b9520 con 0x7fe9a80b3bd0 2020-04-22T14:16:58.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.678+0000 7fe9ac87f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe9a8143ab0 0x7fe9a8143f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:58.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.678+0000 7fe9ac87f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe9a8143ab0 0x7fe9a8143f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56926/0 (socket says 172.21.15.103:56926) 2020-04-22T14:16:58.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.678+0000 7fe9ac87f700 1 -- 172.21.15.103:0/3478045953 learned_addr learned my addr 172.21.15.103:0/3478045953 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:58.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.678+0000 7fe9a77fe700 1 --2- 172.21.15.103:0/3478045953 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9a80b3bd0 0x7fe9a8143650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:58.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.678+0000 7fe9ac87f700 1 -- 172.21.15.103:0/3478045953 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9a80b3bd0 msgr2=0x7fe9a8143650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:58.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.678+0000 7fe9ac87f700 1 --2- 172.21.15.103:0/3478045953 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9a80b3bd0 0x7fe9a8143650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:58.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.678+0000 7fe9ac87f700 1 -- 172.21.15.103:0/3478045953 >> v1:172.21.15.86:6789/0 conn(0x7fe9a80b9140 legacy=0x7fe9a80aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:58.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.678+0000 7fe9ac87f700 1 -- 172.21.15.103:0/3478045953 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a80b3050 con 0x7fe9a8143ab0 2020-04-22T14:16:58.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.678+0000 7fe9ac87f700 1 --2- 172.21.15.103:0/3478045953 >> v2:172.21.15.103:3300/0 conn(0x7fe9a8143ab0 0x7fe9a8143f60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe9a00032b0 tx=0x7fe9a0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.678+0000 7fe9ac87f700 1 --2- 172.21.15.103:0/3478045953 >> v2:172.21.15.103:3300/0 conn(0x7fe9a8143ab0 0x7fe9a8143f60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe9a00032b0 tx=0x7fe9a0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.678+0000 7fe9ac87f700 1 --2- 172.21.15.103:0/3478045953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9a8143ab0 0x7fe9a8143f60 secure :-1 s=READY pgs=1800 cs=0 l=1 rx=0x7fe9a00032b0 tx=0x7fe9a0007dc0).ready entity=mon.1 client_cookie=c29eeca9950e7d9e server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:58.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.678+0000 7fe9ac87f700 1 --2- 172.21.15.103:0/3478045953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9a8143ab0 0x7fe9a8143f60 secure :-1 s=THROTTLE_DONE pgs=1800 cs=0 l=1 rx=0x7fe9a00032b0 tx=0x7fe9a0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.678+0000 7fe9a6ffd700 1 -- 172.21.15.103:0/3478045953 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9a000a180 con 0x7fe9a8143ab0 2020-04-22T14:16:58.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.678+0000 7fe9ac87f700 1 --2- 172.21.15.103:0/3478045953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9a8143ab0 0x7fe9a8143f60 secure :-1 s=THROTTLE_DONE pgs=1800 cs=0 l=1 rx=0x7fe9a00032b0 tx=0x7fe9a0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.678+0000 7fe9a6ffd700 1 -- 172.21.15.103:0/3478045953 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9a000a320 con 0x7fe9a8143ab0 2020-04-22T14:16:58.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.678+0000 7fe9ac87f700 1 --2- 172.21.15.103:0/3478045953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9a8143ab0 0x7fe9a8143f60 secure :-1 s=THROTTLE_DONE pgs=1800 cs=0 l=1 rx=0x7fe9a00032b0 tx=0x7fe9a0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.678+0000 7fe9a6ffd700 1 -- 172.21.15.103:0/3478045953 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9a000a740 con 0x7fe9a8143ab0 2020-04-22T14:16:58.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.678+0000 7fe9ae2e2700 1 -- 172.21.15.103:0/3478045953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9a8143ab0 msgr2=0x7fe9a8143f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:58.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.678+0000 7fe9ae2e2700 1 --2- 172.21.15.103:0/3478045953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9a8143ab0 0x7fe9a8143f60 secure :-1 s=READY pgs=1800 cs=0 l=1 rx=0x7fe9a00032b0 tx=0x7fe9a0007dc0).stop 2020-04-22T14:16:58.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.679+0000 7fe9ae2e2700 1 -- 172.21.15.103:0/3478045953 shutdown_connections 2020-04-22T14:16:58.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.679+0000 7fe9ae2e2700 1 --2- 172.21.15.103:0/3478045953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9a8143ab0 0x7fe9a8143f60 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:58.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.679+0000 7fe9ae2e2700 1 --2- 172.21.15.103:0/3478045953 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9a80b3bd0 0x7fe9a8143650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:58.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.679+0000 7fe9ae2e2700 1 -- 172.21.15.103:0/3478045953 >> 172.21.15.103:0/3478045953 conn(0x7fe9a805b7b0 msgr2=0x7fe9a80b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:58.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.679+0000 7fe9ae2e2700 1 -- 172.21.15.103:0/3478045953 shutdown_connections 2020-04-22T14:16:58.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.679+0000 7fe9ae2e2700 1 -- 172.21.15.103:0/3478045953 wait complete. 2020-04-22T14:16:58.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.680+0000 7fe9ae2e2700 1 Processor -- start 2020-04-22T14:16:58.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.680+0000 7fe9ae2e2700 1 -- start start 2020-04-22T14:16:58.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.681+0000 7fe9ae2e2700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9a80b3bd0 0x7fe9a80b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:58.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.681+0000 7fe9ae2e2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe9a80b9140 0x7fe9a80b2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:58.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.681+0000 7fe9ae2e2700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9a80b1050 con 0x7fe9a8143ab0 2020-04-22T14:16:58.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.681+0000 7fe9ae2e2700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9a813e630 con 0x7fe9a80b9140 2020-04-22T14:16:58.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.681+0000 7fe9ae2e2700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a80b0390 con 0x7fe9a80b3bd0 2020-04-22T14:16:58.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.681+0000 7fe9a77fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe9a80b9140 0x7fe9a80b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:58.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.681+0000 7fe9a77fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe9a80b9140 0x7fe9a80b2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56930/0 (socket says 172.21.15.103:56930) 2020-04-22T14:16:58.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.681+0000 7fe9a77fe700 1 -- 172.21.15.103:0/3942804112 learned_addr learned my addr 172.21.15.103:0/3942804112 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:58.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.681+0000 7fe9a7fff700 1 --2- 172.21.15.103:0/3942804112 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9a80b3bd0 0x7fe9a80b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:58.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.681+0000 7fe9a77fe700 1 -- 172.21.15.103:0/3942804112 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9a80b3bd0 msgr2=0x7fe9a80b0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:58.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.681+0000 7fe9a77fe700 1 --2- 172.21.15.103:0/3942804112 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9a80b3bd0 0x7fe9a80b0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:58.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.681+0000 7fe9a77fe700 1 -- 172.21.15.103:0/3942804112 >> v1:172.21.15.86:6789/0 conn(0x7fe9a8143ab0 legacy=0x7fe9a8154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:58.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.681+0000 7fe9a77fe700 1 -- 172.21.15.103:0/3942804112 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a813ead0 con 0x7fe9a80b9140 2020-04-22T14:16:58.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.681+0000 7fe9a77fe700 1 --2- 172.21.15.103:0/3942804112 >> v2:172.21.15.103:3300/0 conn(0x7fe9a80b9140 0x7fe9a80b2630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe99c002f30 tx=0x7fe99c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.681+0000 7fe9a77fe700 1 --2- 172.21.15.103:0/3942804112 >> v2:172.21.15.103:3300/0 conn(0x7fe9a80b9140 0x7fe9a80b2630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe99c002f30 tx=0x7fe99c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.681+0000 7fe9a77fe700 1 --2- 172.21.15.103:0/3942804112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9a80b9140 0x7fe9a80b2630 secure :-1 s=READY pgs=1801 cs=0 l=1 rx=0x7fe99c002f30 tx=0x7fe99c010c30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:58.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.681+0000 7fe9a77fe700 1 --2- 172.21.15.103:0/3942804112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9a80b9140 0x7fe9a80b2630 secure :-1 s=THROTTLE_DONE pgs=1801 cs=0 l=1 rx=0x7fe99c002f30 tx=0x7fe99c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.681+0000 7fe9a77fe700 1 --2- 172.21.15.103:0/3942804112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9a80b9140 0x7fe9a80b2630 secure :-1 s=THROTTLE_DONE pgs=1801 cs=0 l=1 rx=0x7fe99c002f30 tx=0x7fe99c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.681+0000 7fe9a57fa700 1 -- 172.21.15.103:0/3942804112 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe99c012aa0 con 0x7fe9a80b9140 2020-04-22T14:16:58.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.681+0000 7fe9a77fe700 1 --2- 172.21.15.103:0/3942804112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9a80b9140 0x7fe9a80b2630 secure :-1 s=THROTTLE_DONE pgs=1801 cs=0 l=1 rx=0x7fe99c002f30 tx=0x7fe99c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.681+0000 7fe9a57fa700 1 -- 172.21.15.103:0/3942804112 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe99c012c00 con 0x7fe9a80b9140 2020-04-22T14:16:58.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.681+0000 7fe9ae2e2700 1 -- 172.21.15.103:0/3942804112 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9a8062800 con 0x7fe9a80b9140 2020-04-22T14:16:58.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.681+0000 7fe9a57fa700 1 -- 172.21.15.103:0/3942804112 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe99c0091c0 con 0x7fe9a80b9140 2020-04-22T14:16:58.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.682+0000 7fe9ae2e2700 1 -- 172.21.15.103:0/3942804112 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a8155230 con 0x7fe9a80b9140 2020-04-22T14:16:58.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.682+0000 7fe9a77fe700 1 --2- 172.21.15.103:0/3942804112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9a80b9140 0x7fe9a80b2630 secure :-1 s=THROTTLE_DONE pgs=1801 cs=0 l=1 rx=0x7fe99c002f30 tx=0x7fe99c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.682+0000 7fe9a57fa700 1 -- 172.21.15.103:0/3942804112 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fe99c007190 con 0x7fe9a80b9140 2020-04-22T14:16:58.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.682+0000 7fe9a77fe700 1 --2- 172.21.15.103:0/3942804112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9a80b9140 0x7fe9a80b2630 secure :-1 s=THROTTLE_DONE pgs=1801 cs=0 l=1 rx=0x7fe99c002f30 tx=0x7fe99c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.683+0000 7fe9ae2e2700 1 -- 172.21.15.103:0/3942804112 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9a8056c90 con 0x7fe9a80b9140 2020-04-22T14:16:58.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.683+0000 7fe9a57fa700 1 --2- 172.21.15.103:0/3942804112 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe98804da70 0x7fe98804ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:58.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.683+0000 7fe9a57fa700 1 -- 172.21.15.103:0/3942804112 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe99c0618c0 con 0x7fe9a80b9140 2020-04-22T14:16:58.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.683+0000 7fe9a7fff700 1 --2- 172.21.15.103:0/3942804112 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe98804da70 0x7fe98804ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:58.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.683+0000 7fe9a7fff700 1 --2- 172.21.15.103:0/3942804112 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe98804da70 0x7fe98804ff30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe9a80b6250 tx=0x7fe998003e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.683+0000 7fe9a7fff700 1 --2- 172.21.15.103:0/3942804112 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe98804da70 0x7fe98804ff30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe9a80b6250 tx=0x7fe998003e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.683+0000 7fe9a7fff700 1 --2- 172.21.15.103:0/3942804112 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe98804da70 0x7fe98804ff30 secure :-1 s=READY pgs=651 cs=0 l=1 rx=0x7fe9a80b6250 tx=0x7fe998003e20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:58.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.687+0000 7fe9a77fe700 1 --2- 172.21.15.103:0/3942804112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9a80b9140 0x7fe9a80b2630 secure :-1 s=THROTTLE_DONE pgs=1801 cs=0 l=1 rx=0x7fe99c002f30 tx=0x7fe99c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.687+0000 7fe9a57fa700 1 -- 172.21.15.103:0/3942804112 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fe99c03cca0 con 0x7fe9a80b9140 2020-04-22T14:16:58.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.828+0000 7fe9ae2e2700 1 -- 172.21.15.103:0/3942804112 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe9a80b11e0 con 0x7fe9a80b9140 2020-04-22T14:16:58.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.829+0000 7fe9a77fe700 1 --2- 172.21.15.103:0/3942804112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9a80b9140 0x7fe9a80b2630 secure :-1 s=THROTTLE_DONE pgs=1801 cs=0 l=1 rx=0x7fe99c002f30 tx=0x7fe99c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:58.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.829+0000 7fe9a57fa700 1 -- 172.21.15.103:0/3942804112 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v124) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe99c0402c0 con 0x7fe9a80b9140 2020-04-22T14:16:58.831 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:16:58.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.830+0000 7fe9ae2e2700 1 -- 172.21.15.103:0/3942804112 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe98804da70 msgr2=0x7fe98804ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:58.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.830+0000 7fe9ae2e2700 1 --2- 172.21.15.103:0/3942804112 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe98804da70 0x7fe98804ff30 secure :-1 s=READY pgs=651 cs=0 l=1 rx=0x7fe9a80b6250 tx=0x7fe998003e20).stop 2020-04-22T14:16:58.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.830+0000 7fe9ae2e2700 1 -- 172.21.15.103:0/3942804112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9a80b9140 msgr2=0x7fe9a80b2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:58.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.830+0000 7fe9ae2e2700 1 --2- 172.21.15.103:0/3942804112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9a80b9140 0x7fe9a80b2630 secure :-1 s=READY pgs=1801 cs=0 l=1 rx=0x7fe99c002f30 tx=0x7fe99c010c30).stop 2020-04-22T14:16:58.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.830+0000 7fe9ae2e2700 1 -- 172.21.15.103:0/3942804112 shutdown_connections 2020-04-22T14:16:58.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.830+0000 7fe9ae2e2700 1 --2- 172.21.15.103:0/3942804112 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe98804da70 0x7fe98804ff30 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:58.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.830+0000 7fe9ae2e2700 1 --2- 172.21.15.103:0/3942804112 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9a80b3bd0 0x7fe9a80b0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:58.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.830+0000 7fe9ae2e2700 1 --2- 172.21.15.103:0/3942804112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9a80b9140 0x7fe9a80b2630 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:58.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.830+0000 7fe9ae2e2700 1 -- 172.21.15.103:0/3942804112 >> 172.21.15.103:0/3942804112 conn(0x7fe9a805b7b0 msgr2=0x7fe9a8061670 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:58.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.830+0000 7fe9ae2e2700 1 -- 172.21.15.103:0/3942804112 shutdown_connections 2020-04-22T14:16:58.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:58.830+0000 7fe9ae2e2700 1 -- 172.21.15.103:0/3942804112 wait complete. 2020-04-22T14:16:58.842 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:58.859 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-22T14:16:59.015 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.013+0000 7f13928a0700 1 Processor -- start 2020-04-22T14:16:59.016 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.013+0000 7f13928a0700 1 -- start start 2020-04-22T14:16:59.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.014+0000 7f13928a0700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f138c05b780 0x7f138c146410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:59.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.014+0000 7f13928a0700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f138c146870 0x7f138c146d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:59.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.014+0000 7f13928a0700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f138c05f2c0 con 0x7f138c0b0ed0 2020-04-22T14:16:59.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.014+0000 7f13928a0700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138c149e40 con 0x7f138c146870 2020-04-22T14:16:59.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.014+0000 7f13928a0700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f138c14a0e0 con 0x7f138c05b780 2020-04-22T14:16:59.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.014+0000 7f139209f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f138c146870 0x7f138c146d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:59.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.014+0000 7f139209f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f138c146870 0x7f138c146d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56940/0 (socket says 172.21.15.103:56940) 2020-04-22T14:16:59.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.014+0000 7f139209f700 1 -- 172.21.15.103:0/2219530998 learned_addr learned my addr 172.21.15.103:0/2219530998 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:59.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.014+0000 7f139109d700 1 --2- 172.21.15.103:0/2219530998 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f138c05b780 0x7f138c146410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:59.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.015+0000 7f139209f700 1 -- 172.21.15.103:0/2219530998 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f138c05b780 msgr2=0x7f138c146410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:59.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.015+0000 7f139209f700 1 --2- 172.21.15.103:0/2219530998 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f138c05b780 0x7f138c146410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:59.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.015+0000 7f139209f700 1 -- 172.21.15.103:0/2219530998 >> v1:172.21.15.86:6789/0 conn(0x7f138c0b0ed0 legacy=0x7f138c1435f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:59.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.015+0000 7f139209f700 1 -- 172.21.15.103:0/2219530998 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f138c14a380 con 0x7f138c146870 2020-04-22T14:16:59.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.015+0000 7f139209f700 1 --2- 172.21.15.103:0/2219530998 >> v2:172.21.15.103:3300/0 conn(0x7f138c146870 0x7f138c146d00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f13840032b0 tx=0x7f1384007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.015+0000 7f139209f700 1 --2- 172.21.15.103:0/2219530998 >> v2:172.21.15.103:3300/0 conn(0x7f138c146870 0x7f138c146d00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f13840032b0 tx=0x7f1384007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.015+0000 7f139209f700 1 --2- 172.21.15.103:0/2219530998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f138c146870 0x7f138c146d00 secure :-1 s=READY pgs=1802 cs=0 l=1 rx=0x7f13840032b0 tx=0x7f1384007dc0).ready entity=mon.1 client_cookie=20a45f1d0c2ffa2a server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:59.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.015+0000 7f139209f700 1 --2- 172.21.15.103:0/2219530998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f138c146870 0x7f138c146d00 secure :-1 s=THROTTLE_DONE pgs=1802 cs=0 l=1 rx=0x7f13840032b0 tx=0x7f1384007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.015+0000 7f139089c700 1 -- 172.21.15.103:0/2219530998 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f138400a180 con 0x7f138c146870 2020-04-22T14:16:59.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.015+0000 7f139209f700 1 --2- 172.21.15.103:0/2219530998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f138c146870 0x7f138c146d00 secure :-1 s=THROTTLE_DONE pgs=1802 cs=0 l=1 rx=0x7f13840032b0 tx=0x7f1384007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.015+0000 7f139089c700 1 -- 172.21.15.103:0/2219530998 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f138400a320 con 0x7f138c146870 2020-04-22T14:16:59.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.015+0000 7f139209f700 1 --2- 172.21.15.103:0/2219530998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f138c146870 0x7f138c146d00 secure :-1 s=THROTTLE_DONE pgs=1802 cs=0 l=1 rx=0x7f13840032b0 tx=0x7f1384007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.015+0000 7f139089c700 1 -- 172.21.15.103:0/2219530998 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f138400a740 con 0x7f138c146870 2020-04-22T14:16:59.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.015+0000 7f13928a0700 1 -- 172.21.15.103:0/2219530998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f138c146870 msgr2=0x7f138c146d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:59.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.015+0000 7f13928a0700 1 --2- 172.21.15.103:0/2219530998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f138c146870 0x7f138c146d00 secure :-1 s=READY pgs=1802 cs=0 l=1 rx=0x7f13840032b0 tx=0x7f1384007dc0).stop 2020-04-22T14:16:59.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.015+0000 7f13928a0700 1 -- 172.21.15.103:0/2219530998 shutdown_connections 2020-04-22T14:16:59.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.015+0000 7f13928a0700 1 --2- 172.21.15.103:0/2219530998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f138c146870 0x7f138c146d00 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:59.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.015+0000 7f13928a0700 1 --2- 172.21.15.103:0/2219530998 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f138c05b780 0x7f138c146410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:59.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.015+0000 7f13928a0700 1 -- 172.21.15.103:0/2219530998 >> 172.21.15.103:0/2219530998 conn(0x7f138c0614d0 msgr2=0x7f138c0618e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:59.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.015+0000 7f13928a0700 1 -- 172.21.15.103:0/2219530998 shutdown_connections 2020-04-22T14:16:59.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.016+0000 7f13928a0700 1 -- 172.21.15.103:0/2219530998 wait complete. 2020-04-22T14:16:59.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.016+0000 7f13928a0700 1 Processor -- start 2020-04-22T14:16:59.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.016+0000 7f13928a0700 1 -- start start 2020-04-22T14:16:59.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.017+0000 7f13928a0700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f138c05b780 0x7f138c0b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:59.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.017+0000 7f13928a0700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f138c146870 0x7f138c147930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:59.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.017+0000 7f13928a0700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f138c147d90 con 0x7f138c0b0ed0 2020-04-22T14:16:59.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.017+0000 7f13928a0700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138c148220 con 0x7f138c146870 2020-04-22T14:16:59.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.017+0000 7f13928a0700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f138c144680 con 0x7f138c05b780 2020-04-22T14:16:59.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.017+0000 7f139209f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f138c146870 0x7f138c147930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:59.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.017+0000 7f139209f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f138c146870 0x7f138c147930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56946/0 (socket says 172.21.15.103:56946) 2020-04-22T14:16:59.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.017+0000 7f139209f700 1 -- 172.21.15.103:0/616712506 learned_addr learned my addr 172.21.15.103:0/616712506 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:59.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.017+0000 7f139189e700 1 --2- 172.21.15.103:0/616712506 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f138c05b780 0x7f138c0b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:59.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.017+0000 7f139209f700 1 -- 172.21.15.103:0/616712506 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f138c05b780 msgr2=0x7f138c0b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:59.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.017+0000 7f139209f700 1 --2- 172.21.15.103:0/616712506 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f138c05b780 0x7f138c0b3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:59.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.017+0000 7f139209f700 1 -- 172.21.15.103:0/616712506 >> v1:172.21.15.86:6789/0 conn(0x7f138c0b0ed0 legacy=0x7f138c13ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:59.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.017+0000 7f139209f700 1 -- 172.21.15.103:0/616712506 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f138c144920 con 0x7f138c146870 2020-04-22T14:16:59.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.017+0000 7f139209f700 1 --2- 172.21.15.103:0/616712506 >> v2:172.21.15.103:3300/0 conn(0x7f138c146870 0x7f138c147930 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f13840032b0 tx=0x7f1384007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.018+0000 7f139209f700 1 --2- 172.21.15.103:0/616712506 >> v2:172.21.15.103:3300/0 conn(0x7f138c146870 0x7f138c147930 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f13840032b0 tx=0x7f1384007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.018+0000 7f139209f700 1 --2- 172.21.15.103:0/616712506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f138c146870 0x7f138c147930 secure :-1 s=READY pgs=1803 cs=0 l=1 rx=0x7f13840032b0 tx=0x7f1384007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:59.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.018+0000 7f139209f700 1 --2- 172.21.15.103:0/616712506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f138c146870 0x7f138c147930 secure :-1 s=THROTTLE_DONE pgs=1803 cs=0 l=1 rx=0x7f13840032b0 tx=0x7f1384007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.018+0000 7f137effd700 1 -- 172.21.15.103:0/616712506 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f138400ae20 con 0x7f138c146870 2020-04-22T14:16:59.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.018+0000 7f139209f700 1 --2- 172.21.15.103:0/616712506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f138c146870 0x7f138c147930 secure :-1 s=THROTTLE_DONE pgs=1803 cs=0 l=1 rx=0x7f13840032b0 tx=0x7f1384007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.018+0000 7f139209f700 1 --2- 172.21.15.103:0/616712506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f138c146870 0x7f138c147930 secure :-1 s=THROTTLE_DONE pgs=1803 cs=0 l=1 rx=0x7f13840032b0 tx=0x7f1384007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.018+0000 7f137effd700 1 -- 172.21.15.103:0/616712506 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1384005c30 con 0x7f138c146870 2020-04-22T14:16:59.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.018+0000 7f137effd700 1 -- 172.21.15.103:0/616712506 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1384005e20 con 0x7f138c146870 2020-04-22T14:16:59.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.018+0000 7f13928a0700 1 -- 172.21.15.103:0/616712506 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f138c144bc0 con 0x7f138c146870 2020-04-22T14:16:59.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.018+0000 7f13928a0700 1 -- 172.21.15.103:0/616712506 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f138c0b2730 con 0x7f138c146870 2020-04-22T14:16:59.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.018+0000 7f139209f700 1 --2- 172.21.15.103:0/616712506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f138c146870 0x7f138c147930 secure :-1 s=THROTTLE_DONE pgs=1803 cs=0 l=1 rx=0x7f13840032b0 tx=0x7f1384007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.019+0000 7f137effd700 1 -- 172.21.15.103:0/616712506 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f1384007360 con 0x7f138c146870 2020-04-22T14:16:59.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.019+0000 7f139209f700 1 --2- 172.21.15.103:0/616712506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f138c146870 0x7f138c147930 secure :-1 s=THROTTLE_DONE pgs=1803 cs=0 l=1 rx=0x7f13840032b0 tx=0x7f1384007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.019+0000 7f13928a0700 1 -- 172.21.15.103:0/616712506 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f138c145060 con 0x7f138c146870 2020-04-22T14:16:59.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.019+0000 7f137effd700 1 --2- 172.21.15.103:0/616712506 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f136c04d9d0 0x7f136c04fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:59.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.019+0000 7f137effd700 1 -- 172.21.15.103:0/616712506 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1384062320 con 0x7f138c146870 2020-04-22T14:16:59.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.019+0000 7f139189e700 1 --2- 172.21.15.103:0/616712506 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f136c04d9d0 0x7f136c04fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:59.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.019+0000 7f139189e700 1 --2- 172.21.15.103:0/616712506 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f136c04d9d0 0x7f136c04fe90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f138c05b330 tx=0x7f1380003e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.020+0000 7f139189e700 1 --2- 172.21.15.103:0/616712506 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f136c04d9d0 0x7f136c04fe90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f138c05b330 tx=0x7f1380003e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.020+0000 7f139189e700 1 --2- 172.21.15.103:0/616712506 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f136c04d9d0 0x7f136c04fe90 secure :-1 s=READY pgs=652 cs=0 l=1 rx=0x7f138c05b330 tx=0x7f1380003e20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:59.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.023+0000 7f139209f700 1 --2- 172.21.15.103:0/616712506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f138c146870 0x7f138c147930 secure :-1 s=THROTTLE_DONE pgs=1803 cs=0 l=1 rx=0x7f13840032b0 tx=0x7f1384007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.023+0000 7f137effd700 1 -- 172.21.15.103:0/616712506 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f138c145060 con 0x7f138c146870 2020-04-22T14:16:59.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.163+0000 7f13928a0700 1 -- 172.21.15.103:0/616712506 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f138c145060 con 0x7f138c146870 2020-04-22T14:16:59.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.163+0000 7f139209f700 1 --2- 172.21.15.103:0/616712506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f138c146870 0x7f138c147930 secure :-1 s=THROTTLE_DONE pgs=1803 cs=0 l=1 rx=0x7f13840032b0 tx=0x7f1384007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.163+0000 7f137effd700 1 -- 172.21.15.103:0/616712506 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v124) v1 ==== 104+0+10 (secure 0 0 0) 0x7f138c145060 con 0x7f138c146870 2020-04-22T14:16:59.166 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:16:59.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.165+0000 7f13928a0700 1 -- 172.21.15.103:0/616712506 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f136c04d9d0 msgr2=0x7f136c04fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:59.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.165+0000 7f13928a0700 1 --2- 172.21.15.103:0/616712506 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f136c04d9d0 0x7f136c04fe90 secure :-1 s=READY pgs=652 cs=0 l=1 rx=0x7f138c05b330 tx=0x7f1380003e20).stop 2020-04-22T14:16:59.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.165+0000 7f13928a0700 1 -- 172.21.15.103:0/616712506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f138c146870 msgr2=0x7f138c147930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:59.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.165+0000 7f13928a0700 1 --2- 172.21.15.103:0/616712506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f138c146870 0x7f138c147930 secure :-1 s=READY pgs=1803 cs=0 l=1 rx=0x7f13840032b0 tx=0x7f1384007dc0).stop 2020-04-22T14:16:59.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.165+0000 7f13928a0700 1 -- 172.21.15.103:0/616712506 shutdown_connections 2020-04-22T14:16:59.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.165+0000 7f13928a0700 1 --2- 172.21.15.103:0/616712506 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f136c04d9d0 0x7f136c04fe90 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:59.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.165+0000 7f13928a0700 1 --2- 172.21.15.103:0/616712506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f138c146870 0x7f138c147930 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:59.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.165+0000 7f13928a0700 1 --2- 172.21.15.103:0/616712506 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f138c05b780 0x7f138c0b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:59.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.165+0000 7f13928a0700 1 -- 172.21.15.103:0/616712506 >> 172.21.15.103:0/616712506 conn(0x7f138c0614d0 msgr2=0x7f138c0605e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:59.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.165+0000 7f13928a0700 1 -- 172.21.15.103:0/616712506 shutdown_connections 2020-04-22T14:16:59.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.165+0000 7f13928a0700 1 -- 172.21.15.103:0/616712506 wait complete. 2020-04-22T14:16:59.177 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:59.194 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-22T14:16:59.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.347+0000 7fcbf8ec2700 1 Processor -- start 2020-04-22T14:16:59.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.347+0000 7fcbf8ec2700 1 -- start start 2020-04-22T14:16:59.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.348+0000 7fcbf8ec2700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcbf4143bc0 0x7fcbf4146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:59.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.348+0000 7fcbf8ec2700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbf405fbc0 con 0x7fcbf40b5ea0 2020-04-22T14:16:59.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.348+0000 7fcbf8ec2700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbf405fe60 con 0x7fcbf40b9890 2020-04-22T14:16:59.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.348+0000 7fcbf8ec2700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbf4060100 con 0x7fcbf4143bc0 2020-04-22T14:16:59.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.348+0000 7fcbf259c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fcbf40b9890 0x7fcbf41434b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49140/0 (socket says 172.21.15.103:49140) 2020-04-22T14:16:59.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.348+0000 7fcbf259c700 1 -- 172.21.15.103:0/1584332382 learned_addr learned my addr 172.21.15.103:0/1584332382 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:59.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.348+0000 7fcbf1d9b700 1 --2- 172.21.15.103:0/1584332382 >> v2:172.21.15.86:3300/0 conn(0x7fcbf4143bc0 0x7fcbf4146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:59.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.348+0000 7fcbf159a700 1 -- 172.21.15.103:0/1584332382 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 421933898 0 0) 0x7fcbf405fe60 con 0x7fcbf40b9890 2020-04-22T14:16:59.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.349+0000 7fcbf159a700 1 -- 172.21.15.103:0/1584332382 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbd8003230 con 0x7fcbf40b9890 2020-04-22T14:16:59.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.349+0000 7fcbf159a700 1 -- 172.21.15.103:0/1584332382 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3067654798 0 0) 0x7fcbd8003230 con 0x7fcbf40b9890 2020-04-22T14:16:59.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.349+0000 7fcbf159a700 1 -- 172.21.15.103:0/1584332382 >> v2:172.21.15.86:3300/0 conn(0x7fcbf4143bc0 msgr2=0x7fcbf4146fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:59.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.349+0000 7fcbf159a700 1 --2- 172.21.15.103:0/1584332382 >> v2:172.21.15.86:3300/0 conn(0x7fcbf4143bc0 0x7fcbf4146fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:59.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.349+0000 7fcbf159a700 1 -- 172.21.15.103:0/1584332382 >> v1:172.21.15.86:6789/0 conn(0x7fcbf40b5ea0 legacy=0x7fcbf40b6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:59.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.349+0000 7fcbf159a700 1 -- 172.21.15.103:0/1584332382 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf40b9c70 con 0x7fcbf40b9890 2020-04-22T14:16:59.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.349+0000 7fcbf159a700 1 -- 172.21.15.103:0/1584332382 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fcbe80016d0 con 0x7fcbf40b9890 2020-04-22T14:16:59.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.349+0000 7fcbf159a700 1 -- 172.21.15.103:0/1584332382 >> v1:172.21.15.103:6789/0 conn(0x7fcbf40b9890 legacy=0x7fcbf41434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:59.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.349+0000 7fcbf159a700 1 --2- 172.21.15.103:0/1584332382 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbd8003720 0x7fcbd8003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:59.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.349+0000 7fcbf159a700 1 --2- 172.21.15.103:0/1584332382 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcbd8004020 0x7fcbd80044f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:59.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.349+0000 7fcbf159a700 1 --2- 172.21.15.103:0/1584332382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbd8004a60 0x7fcbd8004f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:59.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.349+0000 7fcbf159a700 1 -- 172.21.15.103:0/1584332382 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf4060100 con 0x7fcbd8003720 2020-04-22T14:16:59.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.349+0000 7fcbf159a700 1 -- 172.21.15.103:0/1584332382 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd800b830 con 0x7fcbd8004a60 2020-04-22T14:16:59.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.349+0000 7fcbf159a700 1 -- 172.21.15.103:0/1584332382 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd800b9f0 con 0x7fcbd8004020 2020-04-22T14:16:59.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.349+0000 7fcbf2d9d700 1 --2- 172.21.15.103:0/1584332382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbd8004a60 0x7fcbd8004f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:59.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.349+0000 7fcbf259c700 1 --2- 172.21.15.103:0/1584332382 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbd8003720 0x7fcbd8003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:59.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.349+0000 7fcbf1d9b700 1 --2- 172.21.15.103:0/1584332382 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcbd8004020 0x7fcbd80044f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:59.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.349+0000 7fcbf2d9d700 1 -- 172.21.15.103:0/1584332382 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcbd8004020 msgr2=0x7fcbd80044f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:59.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.349+0000 7fcbf2d9d700 1 --2- 172.21.15.103:0/1584332382 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcbd8004020 0x7fcbd80044f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:59.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.349+0000 7fcbf2d9d700 1 -- 172.21.15.103:0/1584332382 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbd8003720 msgr2=0x7fcbd8003b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:59.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.349+0000 7fcbf2d9d700 1 --2- 172.21.15.103:0/1584332382 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbd8003720 0x7fcbd8003b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:59.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.349+0000 7fcbf2d9d700 1 -- 172.21.15.103:0/1584332382 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd8003230 con 0x7fcbd8004a60 2020-04-22T14:16:59.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.349+0000 7fcbf2d9d700 1 --2- 172.21.15.103:0/1584332382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbd8004a60 0x7fcbd8004f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcbec001360 tx=0x7fcbec010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.349+0000 7fcbf2d9d700 1 -- 172.21.15.103:0/1584332382 reap_dead start 2020-04-22T14:16:59.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.349+0000 7fcbf2d9d700 1 --2- 172.21.15.103:0/1584332382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbd8004a60 0x7fcbd8004f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcbec001360 tx=0x7fcbec010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.349+0000 7fcbf2d9d700 1 --2- 172.21.15.103:0/1584332382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbd8004a60 0x7fcbd8004f10 secure :-1 s=READY pgs=1805 cs=0 l=1 rx=0x7fcbec001360 tx=0x7fcbec010160).ready entity=mon.1 client_cookie=7040eb47ab2b548e server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:59.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.349+0000 7fcbf2d9d700 1 --2- 172.21.15.103:0/1584332382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbd8004a60 0x7fcbd8004f10 secure :-1 s=THROTTLE_DONE pgs=1805 cs=0 l=1 rx=0x7fcbec001360 tx=0x7fcbec010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.349+0000 7fcbf159a700 1 -- 172.21.15.103:0/1584332382 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbec006c40 con 0x7fcbd8004a60 2020-04-22T14:16:59.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.349+0000 7fcbf2d9d700 1 --2- 172.21.15.103:0/1584332382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbd8004a60 0x7fcbd8004f10 secure :-1 s=THROTTLE_DONE pgs=1805 cs=0 l=1 rx=0x7fcbec001360 tx=0x7fcbec010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.350+0000 7fcbf159a700 1 -- 172.21.15.103:0/1584332382 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbec006da0 con 0x7fcbd8004a60 2020-04-22T14:16:59.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.350+0000 7fcbf2d9d700 1 --2- 172.21.15.103:0/1584332382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbd8004a60 0x7fcbd8004f10 secure :-1 s=THROTTLE_DONE pgs=1805 cs=0 l=1 rx=0x7fcbec001360 tx=0x7fcbec010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.350+0000 7fcbf8ec2700 1 -- 172.21.15.103:0/1584332382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbd8004a60 msgr2=0x7fcbd8004f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:59.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.350+0000 7fcbf159a700 1 -- 172.21.15.103:0/1584332382 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbec002640 con 0x7fcbd8004a60 2020-04-22T14:16:59.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.350+0000 7fcbf8ec2700 1 --2- 172.21.15.103:0/1584332382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbd8004a60 0x7fcbd8004f10 secure :-1 s=READY pgs=1805 cs=0 l=1 rx=0x7fcbec001360 tx=0x7fcbec010160).stop 2020-04-22T14:16:59.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.350+0000 7fcbf8ec2700 1 -- 172.21.15.103:0/1584332382 shutdown_connections 2020-04-22T14:16:59.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.350+0000 7fcbf8ec2700 1 --2- 172.21.15.103:0/1584332382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbd8004a60 0x7fcbd8004f10 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:59.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.350+0000 7fcbf8ec2700 1 -- 172.21.15.103:0/1584332382 >> 172.21.15.103:0/1584332382 conn(0x7fcbf405ad30 msgr2=0x7fcbf405b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:59.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.350+0000 7fcbf8ec2700 1 -- 172.21.15.103:0/1584332382 shutdown_connections 2020-04-22T14:16:59.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.350+0000 7fcbf8ec2700 1 -- 172.21.15.103:0/1584332382 wait complete. 2020-04-22T14:16:59.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.351+0000 7fcbf8ec2700 1 Processor -- start 2020-04-22T14:16:59.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.351+0000 7fcbf8ec2700 1 -- start start 2020-04-22T14:16:59.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.352+0000 7fcbf8ec2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcbf40bc4f0 0x7fcbf412baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:59.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.352+0000 7fcbf8ec2700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbf40addc0 con 0x7fcbf412c950 2020-04-22T14:16:59.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.352+0000 7fcbf8ec2700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbf40ae030 con 0x7fcbd8004a60 2020-04-22T14:16:59.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.352+0000 7fcbf8ec2700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbf40ae2d0 con 0x7fcbf40bc4f0 2020-04-22T14:16:59.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.352+0000 7fcbf259c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fcbd8004a60 0x7fcbf412b390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49152/0 (socket says 172.21.15.103:49152) 2020-04-22T14:16:59.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.352+0000 7fcbf259c700 1 -- 172.21.15.103:0/2977829578 learned_addr learned my addr 172.21.15.103:0/2977829578 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:16:59.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.352+0000 7fcbf2d9d700 1 --2- 172.21.15.103:0/2977829578 >> v2:172.21.15.103:3300/0 conn(0x7fcbf40bc4f0 0x7fcbf412baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:59.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.352+0000 7fcbe37fe700 1 -- 172.21.15.103:0/2977829578 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3108978542 0 0) 0x7fcbf40ae030 con 0x7fcbd8004a60 2020-04-22T14:16:59.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.352+0000 7fcbe37fe700 1 -- 172.21.15.103:0/2977829578 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbd0002fe0 con 0x7fcbd8004a60 2020-04-22T14:16:59.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.352+0000 7fcbe37fe700 1 -- 172.21.15.103:0/2977829578 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 14891720 0 0) 0x7fcbf40addc0 con 0x7fcbf412c950 2020-04-22T14:16:59.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.352+0000 7fcbf2d9d700 1 -- 172.21.15.103:0/2977829578 >> v1:172.21.15.103:6789/0 conn(0x7fcbd8004a60 legacy=0x7fcbf412b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:59.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.352+0000 7fcbf2d9d700 1 -- 172.21.15.103:0/2977829578 >> v1:172.21.15.86:6789/0 conn(0x7fcbf412c950 legacy=0x7fcbf412cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:59.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.352+0000 7fcbf2d9d700 1 -- 172.21.15.103:0/2977829578 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf40ad9a0 con 0x7fcbf40bc4f0 2020-04-22T14:16:59.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.352+0000 7fcbf2d9d700 1 --2- 172.21.15.103:0/2977829578 >> v2:172.21.15.103:3300/0 conn(0x7fcbf40bc4f0 0x7fcbf412baa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcbec001360 tx=0x7fcbec010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.352+0000 7fcbf2d9d700 1 --2- 172.21.15.103:0/2977829578 >> v2:172.21.15.103:3300/0 conn(0x7fcbf40bc4f0 0x7fcbf412baa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcbec001360 tx=0x7fcbec010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.352+0000 7fcbf2d9d700 1 --2- 172.21.15.103:0/2977829578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbf40bc4f0 0x7fcbf412baa0 secure :-1 s=READY pgs=1807 cs=0 l=1 rx=0x7fcbec001360 tx=0x7fcbec010160).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:59.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.352+0000 7fcbf2d9d700 1 --2- 172.21.15.103:0/2977829578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbf40bc4f0 0x7fcbf412baa0 secure :-1 s=THROTTLE_DONE pgs=1807 cs=0 l=1 rx=0x7fcbec001360 tx=0x7fcbec010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.352+0000 7fcbe37fe700 1 -- 172.21.15.103:0/2977829578 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbec006c40 con 0x7fcbf40bc4f0 2020-04-22T14:16:59.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.352+0000 7fcbf2d9d700 1 --2- 172.21.15.103:0/2977829578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbf40bc4f0 0x7fcbf412baa0 secure :-1 s=THROTTLE_DONE pgs=1807 cs=0 l=1 rx=0x7fcbec001360 tx=0x7fcbec010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.352+0000 7fcbf2d9d700 1 --2- 172.21.15.103:0/2977829578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbf40bc4f0 0x7fcbf412baa0 secure :-1 s=THROTTLE_DONE pgs=1807 cs=0 l=1 rx=0x7fcbec001360 tx=0x7fcbec010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.353+0000 7fcbe37fe700 1 -- 172.21.15.103:0/2977829578 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbec006da0 con 0x7fcbf40bc4f0 2020-04-22T14:16:59.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.353+0000 7fcbf8ec2700 1 -- 172.21.15.103:0/2977829578 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbf40ae770 con 0x7fcbf40bc4f0 2020-04-22T14:16:59.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.353+0000 7fcbe37fe700 1 -- 172.21.15.103:0/2977829578 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbec002640 con 0x7fcbf40bc4f0 2020-04-22T14:16:59.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.353+0000 7fcbf8ec2700 1 -- 172.21.15.103:0/2977829578 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbf40b7800 con 0x7fcbf40bc4f0 2020-04-22T14:16:59.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.353+0000 7fcbf2d9d700 1 --2- 172.21.15.103:0/2977829578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbf40bc4f0 0x7fcbf412baa0 secure :-1 s=THROTTLE_DONE pgs=1807 cs=0 l=1 rx=0x7fcbec001360 tx=0x7fcbec010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.354+0000 7fcbe37fe700 1 -- 172.21.15.103:0/2977829578 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fcbec0028b0 con 0x7fcbf40bc4f0 2020-04-22T14:16:59.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.354+0000 7fcbf2d9d700 1 --2- 172.21.15.103:0/2977829578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbf40bc4f0 0x7fcbf412baa0 secure :-1 s=THROTTLE_DONE pgs=1807 cs=0 l=1 rx=0x7fcbec001360 tx=0x7fcbec010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.354+0000 7fcbf8ec2700 1 -- 172.21.15.103:0/2977829578 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbf40adbf0 con 0x7fcbf40bc4f0 2020-04-22T14:16:59.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.354+0000 7fcbe37fe700 1 --2- 172.21.15.103:0/2977829578 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcbd004dc60 0x7fcbd0050120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:59.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.354+0000 7fcbe37fe700 1 -- 172.21.15.103:0/2977829578 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcbec00b0d0 con 0x7fcbf40bc4f0 2020-04-22T14:16:59.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.354+0000 7fcbf259c700 1 --2- 172.21.15.103:0/2977829578 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcbd004dc60 0x7fcbd0050120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:59.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.354+0000 7fcbf259c700 1 --2- 172.21.15.103:0/2977829578 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcbd004dc60 0x7fcbd0050120 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcbe80013e0 tx=0x7fcbf40b9e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.354+0000 7fcbf259c700 1 --2- 172.21.15.103:0/2977829578 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcbd004dc60 0x7fcbd0050120 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcbe80013e0 tx=0x7fcbf40b9e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.354+0000 7fcbf259c700 1 --2- 172.21.15.103:0/2977829578 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcbd004dc60 0x7fcbd0050120 secure :-1 s=READY pgs=653 cs=0 l=1 rx=0x7fcbe80013e0 tx=0x7fcbf40b9e00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:59.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.358+0000 7fcbf2d9d700 1 --2- 172.21.15.103:0/2977829578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbf40bc4f0 0x7fcbf412baa0 secure :-1 s=THROTTLE_DONE pgs=1807 cs=0 l=1 rx=0x7fcbec001360 tx=0x7fcbec010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.358+0000 7fcbe37fe700 1 -- 172.21.15.103:0/2977829578 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fcbf40adbf0 con 0x7fcbf40bc4f0 2020-04-22T14:16:59.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.502+0000 7fcbf8ec2700 1 -- 172.21.15.103:0/2977829578 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcbf40b7ca0 con 0x7fcbf40bc4f0 2020-04-22T14:16:59.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.503+0000 7fcbf2d9d700 1 --2- 172.21.15.103:0/2977829578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbf40bc4f0 0x7fcbf412baa0 secure :-1 s=THROTTLE_DONE pgs=1807 cs=0 l=1 rx=0x7fcbec001360 tx=0x7fcbec010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.503+0000 7fcbe37fe700 1 -- 172.21.15.103:0/2977829578 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v124) v1 ==== 100+0+10 (secure 0 0 0) 0x7fcbec03d360 con 0x7fcbf40bc4f0 2020-04-22T14:16:59.505 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:16:59.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.504+0000 7fcbf8ec2700 1 -- 172.21.15.103:0/2977829578 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcbd004dc60 msgr2=0x7fcbd0050120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:59.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.504+0000 7fcbf8ec2700 1 --2- 172.21.15.103:0/2977829578 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcbd004dc60 0x7fcbd0050120 secure :-1 s=READY pgs=653 cs=0 l=1 rx=0x7fcbe80013e0 tx=0x7fcbf40b9e00).stop 2020-04-22T14:16:59.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.504+0000 7fcbf8ec2700 1 -- 172.21.15.103:0/2977829578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbf40bc4f0 msgr2=0x7fcbf412baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:59.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.504+0000 7fcbf8ec2700 1 --2- 172.21.15.103:0/2977829578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbf40bc4f0 0x7fcbf412baa0 secure :-1 s=READY pgs=1807 cs=0 l=1 rx=0x7fcbec001360 tx=0x7fcbec010160).stop 2020-04-22T14:16:59.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.504+0000 7fcbf8ec2700 1 -- 172.21.15.103:0/2977829578 shutdown_connections 2020-04-22T14:16:59.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.504+0000 7fcbf8ec2700 1 --2- 172.21.15.103:0/2977829578 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcbd004dc60 0x7fcbd0050120 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:59.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.504+0000 7fcbf8ec2700 1 --2- 172.21.15.103:0/2977829578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbf40bc4f0 0x7fcbf412baa0 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:59.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.504+0000 7fcbf8ec2700 1 -- 172.21.15.103:0/2977829578 >> 172.21.15.103:0/2977829578 conn(0x7fcbf405ad30 msgr2=0x7fcbf412f550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:59.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.504+0000 7fcbf8ec2700 1 -- 172.21.15.103:0/2977829578 shutdown_connections 2020-04-22T14:16:59.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.504+0000 7fcbf8ec2700 1 -- 172.21.15.103:0/2977829578 wait complete. 2020-04-22T14:16:59.517 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-04-22T14:16:59.517 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:16:59.534 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:16:59.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.681+0000 7f7cc5fd9700 1 Processor -- start 2020-04-22T14:16:59.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.681+0000 7f7cc5fd9700 1 -- start start 2020-04-22T14:16:59.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.681+0000 7f7cc5fd9700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7cc012c0d0 0x7f7cc01464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:59.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.681+0000 7f7cc5fd9700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7cc0065fe0 0x7f7cc005b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:59.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.681+0000 7f7cc5fd9700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7cc005b8a0 0x7f7cc0062ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:16:59.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.681+0000 7f7cc5fd9700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc012c4b0 con 0x7f7cc012c0d0 2020-04-22T14:16:59.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.681+0000 7f7cc5fd9700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc0143300 con 0x7f7cc0065fe0 2020-04-22T14:16:59.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.681+0000 7f7cc5fd9700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc01435a0 con 0x7f7cc005b8a0 2020-04-22T14:16:59.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.682+0000 7f7cbeffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7cc0065fe0 0x7f7cc005b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:59.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.682+0000 7f7cbeffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7cc0065fe0 0x7f7cc005b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56970/0 (socket says 172.21.15.103:56970) 2020-04-22T14:16:59.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.682+0000 7f7cbeffd700 1 -- 172.21.15.103:0/1270277600 learned_addr learned my addr 172.21.15.103:0/1270277600 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:59.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.682+0000 7f7cbeffd700 1 -- 172.21.15.103:0/1270277600 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7cc005b8a0 msgr2=0x7f7cc0062ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:59.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.682+0000 7f7cbf7fe700 1 --2- 172.21.15.103:0/1270277600 >> v2:172.21.15.86:3300/0 conn(0x7f7cc012c0d0 0x7f7cc01464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:59.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.682+0000 7f7cbffff700 1 --2- 172.21.15.103:0/1270277600 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7cc005b8a0 0x7f7cc0062ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:59.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.682+0000 7f7cbeffd700 1 --2- 172.21.15.103:0/1270277600 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7cc005b8a0 0x7f7cc0062ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:59.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.682+0000 7f7cbeffd700 1 -- 172.21.15.103:0/1270277600 >> v2:172.21.15.86:3300/0 conn(0x7f7cc012c0d0 msgr2=0x7f7cc01464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:16:59.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.682+0000 7f7cbeffd700 1 --2- 172.21.15.103:0/1270277600 >> v2:172.21.15.86:3300/0 conn(0x7f7cc012c0d0 0x7f7cc01464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:59.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.682+0000 7f7cbeffd700 1 -- 172.21.15.103:0/1270277600 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc0143840 con 0x7f7cc0065fe0 2020-04-22T14:16:59.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.682+0000 7f7cbeffd700 1 --2- 172.21.15.103:0/1270277600 >> v2:172.21.15.103:3300/0 conn(0x7f7cc0065fe0 0x7f7cc005b440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7ca80032b0 tx=0x7f7ca8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.682+0000 7f7cbeffd700 1 --2- 172.21.15.103:0/1270277600 >> v2:172.21.15.103:3300/0 conn(0x7f7cc0065fe0 0x7f7cc005b440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7ca80032b0 tx=0x7f7ca8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.682+0000 7f7cbeffd700 1 --2- 172.21.15.103:0/1270277600 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cc0065fe0 0x7f7cc005b440 secure :-1 s=READY pgs=1808 cs=0 l=1 rx=0x7f7ca80032b0 tx=0x7f7ca8007dc0).ready entity=mon.1 client_cookie=27c866b78c7e43a6 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:59.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.682+0000 7f7cbeffd700 1 --2- 172.21.15.103:0/1270277600 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cc0065fe0 0x7f7cc005b440 secure :-1 s=THROTTLE_DONE pgs=1808 cs=0 l=1 rx=0x7f7ca80032b0 tx=0x7f7ca8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.682+0000 7f7cbe7fc700 1 -- 172.21.15.103:0/1270277600 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ca800a180 con 0x7f7cc0065fe0 2020-04-22T14:16:59.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.682+0000 7f7cbeffd700 1 --2- 172.21.15.103:0/1270277600 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cc0065fe0 0x7f7cc005b440 secure :-1 s=THROTTLE_DONE pgs=1808 cs=0 l=1 rx=0x7f7ca80032b0 tx=0x7f7ca8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.682+0000 7f7cbeffd700 1 --2- 172.21.15.103:0/1270277600 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cc0065fe0 0x7f7cc005b440 secure :-1 s=THROTTLE_DONE pgs=1808 cs=0 l=1 rx=0x7f7ca80032b0 tx=0x7f7ca8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.682+0000 7f7cbe7fc700 1 -- 172.21.15.103:0/1270277600 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca800a2e0 con 0x7f7cc0065fe0 2020-04-22T14:16:59.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.682+0000 7f7cbe7fc700 1 -- 172.21.15.103:0/1270277600 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ca800a700 con 0x7f7cc0065fe0 2020-04-22T14:16:59.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.682+0000 7f7cc5fd9700 1 -- 172.21.15.103:0/1270277600 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cc0065fe0 msgr2=0x7f7cc005b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:59.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.682+0000 7f7cc5fd9700 1 --2- 172.21.15.103:0/1270277600 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cc0065fe0 0x7f7cc005b440 secure :-1 s=READY pgs=1808 cs=0 l=1 rx=0x7f7ca80032b0 tx=0x7f7ca8007dc0).stop 2020-04-22T14:16:59.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.683+0000 7f7cc5fd9700 1 -- 172.21.15.103:0/1270277600 shutdown_connections 2020-04-22T14:16:59.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.683+0000 7f7cc5fd9700 1 --2- 172.21.15.103:0/1270277600 >> v2:172.21.15.86:3300/0 conn(0x7f7cc012c0d0 0x7f7cc01464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:59.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.683+0000 7f7cc5fd9700 1 --2- 172.21.15.103:0/1270277600 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7cc005b8a0 0x7f7cc0062ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:16:59.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.683+0000 7f7cc5fd9700 1 --2- 172.21.15.103:0/1270277600 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cc0065fe0 0x7f7cc005b440 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:59.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.683+0000 7f7cc5fd9700 1 -- 172.21.15.103:0/1270277600 >> 172.21.15.103:0/1270277600 conn(0x7f7cc00b9160 msgr2=0x7f7cc005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:59.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.683+0000 7f7cc5fd9700 1 -- 172.21.15.103:0/1270277600 shutdown_connections 2020-04-22T14:16:59.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.683+0000 7f7cc5fd9700 1 -- 172.21.15.103:0/1270277600 wait complete. 2020-04-22T14:16:59.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.684+0000 7f7cc5fd9700 1 Processor -- start 2020-04-22T14:16:59.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.684+0000 7f7cc5fd9700 1 -- start start 2020-04-22T14:16:59.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.685+0000 7f7cc5fd9700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7cc005b8a0 0x7f7cc00b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:59.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.685+0000 7f7cc5fd9700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7cc0065fe0 0x7f7cc011a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:59.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.685+0000 7f7cc5fd9700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7cc012c0d0 0x7f7cc0126e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:59.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.685+0000 7f7cc5fd9700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc00b5920 con 0x7f7cc005b8a0 2020-04-22T14:16:59.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.685+0000 7f7cc5fd9700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc011b200 con 0x7f7cc012c0d0 2020-04-22T14:16:59.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.685+0000 7f7cc5fd9700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc011b4a0 con 0x7f7cc0065fe0 2020-04-22T14:16:59.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.685+0000 7f7cbffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7cc012c0d0 0x7f7cc0126e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:59.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.685+0000 7f7cbffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7cc012c0d0 0x7f7cc0126e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56980/0 (socket says 172.21.15.103:56980) 2020-04-22T14:16:59.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.685+0000 7f7cbffff700 1 -- 172.21.15.103:0/3584322702 learned_addr learned my addr 172.21.15.103:0/3584322702 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:16:59.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.685+0000 7f7cbeffd700 1 --2- 172.21.15.103:0/3584322702 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7cc0065fe0 0x7f7cc011a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:59.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.685+0000 7f7cbf7fe700 1 --2- 172.21.15.103:0/3584322702 >> v2:172.21.15.86:3300/0 conn(0x7f7cc005b8a0 0x7f7cc00b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:59.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.685+0000 7f7cbffff700 1 -- 172.21.15.103:0/3584322702 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7cc0065fe0 msgr2=0x7f7cc011a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:59.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.685+0000 7f7cbffff700 1 --2- 172.21.15.103:0/3584322702 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7cc0065fe0 0x7f7cc011a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:59.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.685+0000 7f7cbffff700 1 -- 172.21.15.103:0/3584322702 >> v2:172.21.15.86:3300/0 conn(0x7f7cc005b8a0 msgr2=0x7f7cc00b54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:59.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.685+0000 7f7cbffff700 1 --2- 172.21.15.103:0/3584322702 >> v2:172.21.15.86:3300/0 conn(0x7f7cc005b8a0 0x7f7cc00b54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:59.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.685+0000 7f7cbffff700 1 -- 172.21.15.103:0/3584322702 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc011ae30 con 0x7f7cc012c0d0 2020-04-22T14:16:59.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.685+0000 7f7cbeffd700 1 --2- 172.21.15.103:0/3584322702 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7cc0065fe0 0x7f7cc011a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:16:59.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.685+0000 7f7cbf7fe700 1 --2- 172.21.15.103:0/3584322702 >> v2:172.21.15.86:3300/0 conn(0x7f7cc005b8a0 0x7f7cc00b54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:16:59.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.685+0000 7f7cbffff700 1 --2- 172.21.15.103:0/3584322702 >> v2:172.21.15.103:3300/0 conn(0x7f7cc012c0d0 0x7f7cc0126e10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7cb0002f30 tx=0x7f7cb0010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.685+0000 7f7cbffff700 1 --2- 172.21.15.103:0/3584322702 >> v2:172.21.15.103:3300/0 conn(0x7f7cc012c0d0 0x7f7cc0126e10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7cb0002f30 tx=0x7f7cb0010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.685+0000 7f7cbffff700 1 --2- 172.21.15.103:0/3584322702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cc012c0d0 0x7f7cc0126e10 secure :-1 s=READY pgs=1809 cs=0 l=1 rx=0x7f7cb0002f30 tx=0x7f7cb0010a30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:59.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.685+0000 7f7cbffff700 1 --2- 172.21.15.103:0/3584322702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cc012c0d0 0x7f7cc0126e10 secure :-1 s=THROTTLE_DONE pgs=1809 cs=0 l=1 rx=0x7f7cb0002f30 tx=0x7f7cb0010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.685+0000 7f7cbffff700 1 --2- 172.21.15.103:0/3584322702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cc012c0d0 0x7f7cc0126e10 secure :-1 s=THROTTLE_DONE pgs=1809 cs=0 l=1 rx=0x7f7cb0002f30 tx=0x7f7cb0010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.685+0000 7f7cbcff9700 1 -- 172.21.15.103:0/3584322702 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cb000a370 con 0x7f7cc012c0d0 2020-04-22T14:16:59.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.685+0000 7f7cbffff700 1 --2- 172.21.15.103:0/3584322702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cc012c0d0 0x7f7cc0126e10 secure :-1 s=THROTTLE_DONE pgs=1809 cs=0 l=1 rx=0x7f7cb0002f30 tx=0x7f7cb0010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.685+0000 7f7cbcff9700 1 -- 172.21.15.103:0/3584322702 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb000a510 con 0x7f7cc012c0d0 2020-04-22T14:16:59.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.685+0000 7f7cc5fd9700 1 -- 172.21.15.103:0/3584322702 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cc00afc10 con 0x7f7cc012c0d0 2020-04-22T14:16:59.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.685+0000 7f7cbcff9700 1 -- 172.21.15.103:0/3584322702 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cb000a930 con 0x7f7cc012c0d0 2020-04-22T14:16:59.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.685+0000 7f7cc5fd9700 1 -- 172.21.15.103:0/3584322702 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc0127430 con 0x7f7cc012c0d0 2020-04-22T14:16:59.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.686+0000 7f7cbffff700 1 --2- 172.21.15.103:0/3584322702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cc012c0d0 0x7f7cc0126e10 secure :-1 s=THROTTLE_DONE pgs=1809 cs=0 l=1 rx=0x7f7cb0002f30 tx=0x7f7cb0010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.686+0000 7f7cc5fd9700 1 -- 172.21.15.103:0/3584322702 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cc0056c90 con 0x7f7cc012c0d0 2020-04-22T14:16:59.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.686+0000 7f7cbcff9700 1 -- 172.21.15.103:0/3584322702 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f7cb000aba0 con 0x7f7cc012c0d0 2020-04-22T14:16:59.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.686+0000 7f7cbffff700 1 --2- 172.21.15.103:0/3584322702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cc012c0d0 0x7f7cc0126e10 secure :-1 s=THROTTLE_DONE pgs=1809 cs=0 l=1 rx=0x7f7cb0002f30 tx=0x7f7cb0010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.687+0000 7f7cbcff9700 1 --2- 172.21.15.103:0/3584322702 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7ca404d9a0 0x7f7ca404fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:16:59.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.687+0000 7f7cbcff9700 1 -- 172.21.15.103:0/3584322702 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7cb0061690 con 0x7f7cc012c0d0 2020-04-22T14:16:59.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.687+0000 7f7cbf7fe700 1 --2- 172.21.15.103:0/3584322702 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7ca404d9a0 0x7f7ca404fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:16:59.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.687+0000 7f7cbf7fe700 1 --2- 172.21.15.103:0/3584322702 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7ca404d9a0 0x7f7ca404fe60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7cb8002f30 tx=0x7f7cb8007e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.687+0000 7f7cbf7fe700 1 --2- 172.21.15.103:0/3584322702 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7ca404d9a0 0x7f7ca404fe60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7cb8002f30 tx=0x7f7cb8007e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.687+0000 7f7cbf7fe700 1 --2- 172.21.15.103:0/3584322702 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7ca404d9a0 0x7f7ca404fe60 secure :-1 s=READY pgs=654 cs=0 l=1 rx=0x7f7cb8002f30 tx=0x7f7cb8007e80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:16:59.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.691+0000 7f7cbffff700 1 --2- 172.21.15.103:0/3584322702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cc012c0d0 0x7f7cc0126e10 secure :-1 s=THROTTLE_DONE pgs=1809 cs=0 l=1 rx=0x7f7cb0002f30 tx=0x7f7cb0010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.691+0000 7f7cbcff9700 1 -- 172.21.15.103:0/3584322702 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f7cb0033440 con 0x7f7cc012c0d0 2020-04-22T14:16:59.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.878+0000 7f7cc5fd9700 1 -- 172.21.15.103:0/3584322702 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7cc0147360 con 0x7f7cc012c0d0 2020-04-22T14:16:59.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.878+0000 7f7cbffff700 1 --2- 172.21.15.103:0/3584322702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cc012c0d0 0x7f7cc0126e10 secure :-1 s=THROTTLE_DONE pgs=1809 cs=0 l=1 rx=0x7f7cb0002f30 tx=0x7f7cb0010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:16:59.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.878+0000 7f7cbcff9700 1 -- 172.21.15.103:0/3584322702 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+2145 (secure 0 0 0) 0x7f7cb003ca70 con 0x7f7cc012c0d0 2020-04-22T14:16:59.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.879+0000 7f7cc5fd9700 1 -- 172.21.15.103:0/3584322702 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7ca404d9a0 msgr2=0x7f7ca404fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:59.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.879+0000 7f7cc5fd9700 1 --2- 172.21.15.103:0/3584322702 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7ca404d9a0 0x7f7ca404fe60 secure :-1 s=READY pgs=654 cs=0 l=1 rx=0x7f7cb8002f30 tx=0x7f7cb8007e80).stop 2020-04-22T14:16:59.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.879+0000 7f7cc5fd9700 1 -- 172.21.15.103:0/3584322702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cc012c0d0 msgr2=0x7f7cc0126e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:16:59.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.879+0000 7f7cc5fd9700 1 --2- 172.21.15.103:0/3584322702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cc012c0d0 0x7f7cc0126e10 secure :-1 s=READY pgs=1809 cs=0 l=1 rx=0x7f7cb0002f30 tx=0x7f7cb0010a30).stop 2020-04-22T14:16:59.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.880+0000 7f7cc5fd9700 1 -- 172.21.15.103:0/3584322702 shutdown_connections 2020-04-22T14:16:59.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.880+0000 7f7cc5fd9700 1 --2- 172.21.15.103:0/3584322702 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7ca404d9a0 0x7f7ca404fe60 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:59.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.880+0000 7f7cc5fd9700 1 --2- 172.21.15.103:0/3584322702 >> v2:172.21.15.86:3300/0 conn(0x7f7cc005b8a0 0x7f7cc00b54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:59.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.880+0000 7f7cc5fd9700 1 --2- 172.21.15.103:0/3584322702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cc012c0d0 0x7f7cc0126e10 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:59.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.880+0000 7f7cc5fd9700 1 --2- 172.21.15.103:0/3584322702 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7cc0065fe0 0x7f7cc011a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:16:59.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.880+0000 7f7cc5fd9700 1 -- 172.21.15.103:0/3584322702 >> 172.21.15.103:0/3584322702 conn(0x7f7cc00b9160 msgr2=0x7f7cc00615e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:16:59.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.880+0000 7f7cc5fd9700 1 -- 172.21.15.103:0/3584322702 shutdown_connections 2020-04-22T14:16:59.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:16:59.880+0000 7f7cc5fd9700 1 -- 172.21.15.103:0/3584322702 wait complete. 2020-04-22T14:16:59.888 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 94 2020-04-22T14:16:59.888 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:16:59.889 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":94,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6380,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/1697822737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1697822737},{"type":"v1","addr":"172.21.15.103:6833","nonce":1697822737}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":91}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:16:46.111567+0000","modified":"2020-04-22T14:16:48.114069+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8142},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8142":{"gid":8142,"name":"b","rank":0,"incarnation":92,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/3334539524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3334539524},{"type":"v1","addr":"172.21.15.86:6835","nonce":3334539524}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2020-04-22T14:17:00.093 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 8142}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 21, u'failed': [], u'epoch': 94, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [22], u'info': {u'gid_8142': {u'export_targets': [], u'name': u'b', u'incarnation': 92, u'state_seq': 3, u'state': u'up:active', u'gid': 8142, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 3334539524, u'type': u'v2', u'addr': u'172.21.15.86:6834'}, {u'nonce': 3334539524, u'type': u'v1', u'addr': u'172.21.15.86:6835'}]}, u'addr': u'172.21.15.86:6835/3334539524'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:16:46.111567+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:16:48.114069+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:17:00.093 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:17:00.094 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:17:00.110 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2020-04-22T14:17:00.278 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2020-04-22T14:17:00.278 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:17:00.278 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 0, 2020-04-22T14:17:00.279 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 8142, 2020-04-22T14:17:00.279 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2020-04-22T14:17:00.279 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2020-04-22T14:17:00.279 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 14.163623594000001, 2020-04-22T14:17:00.279 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 94, 2020-04-22T14:17:00.279 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 124, 2020-04-22T14:17:00.279 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 124, 2020-04-22T14:17:00.280 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 19.362101260999999 2020-04-22T14:17:00.280 INFO:teuthology.orchestra.run.smithi086.stdout:} 2020-04-22T14:17:00.287 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 8142, "want_state": "up:active", "state": "up:active", "rank_uptime": 14.163623594000001, "mdsmap_epoch": 94, "osdmap_epoch": 124, "osdmap_epoch_barrier": 124, "uptime": 19.362101260999999 } 2020-04-22T14:17:00.287 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-04-22T14:17:00.287 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-04-22T14:17:00.287 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:00.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:00.303 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:17:00.369 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:17:00.369 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:17:00.370 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:17:00.370 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:00.370 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:17:00.370 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:00.370 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:17:00.370 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:17:00.371 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:17:00.371 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:17:00.371 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:17:00.371 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:17:00.371 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:17:00.371 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:17:00.371 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:17:00.371 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 41820sec preferred_lft 41820sec 2020-04-22T14:17:00.372 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:17:00.372 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:00.372 INFO:teuthology.orchestra.run.smithi103.stdout:34: brx.1@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:17:00.373 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether d2:98:d4:1b:2c:0d brd ff:ff:ff:ff:ff:ff link-netnsid 1 2020-04-22T14:17:00.373 INFO:teuthology.orchestra.run.smithi103.stdout:37: brx.2@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:17:00.373 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether a6:ff:ab:51:83:b6 brd ff:ff:ff:ff:ff:ff link-netnsid 2 2020-04-22T14:17:00.373 INFO:teuthology.orchestra.run.smithi103.stdout:38: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:17:00.373 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 12:89:28:89:ea:00 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:17:00.374 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:17:00.374 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:00.374 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::1004:4d67:a829:aff9/64 scope link noprefixroute 2020-04-22T14:17:00.374 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:00.374 INFO:teuthology.orchestra.run.smithi103.stdout:39: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-04-22T14:17:00.374 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 12:89:28:89:ea:00 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2020-04-22T14:17:00.375 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:00.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:00.417 INFO:teuthology.orchestra.run.smithi103:> ip netns list 2020-04-22T14:17:00.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2020-04-22T14:17:00.476 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:00.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:00.525 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:17:00.585 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2020-04-22T14:17:00.585 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 1 2020-04-22T14:17:00.585 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 2 2020-04-22T14:17:00.586 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:00.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:00.638 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:17:00.697 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2020-04-22T14:17:00.697 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 1 2020-04-22T14:17:00.697 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 2 2020-04-22T14:17:00.697 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:00.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:00.745 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:17:00.803 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2020-04-22T14:17:00.804 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 1 2020-04-22T14:17:00.804 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 2 2020-04-22T14:17:00.804 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:00.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:00.852 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:17:00.907 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2020-04-22T14:17:00.907 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 1 2020-04-22T14:17:00.907 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 2 2020-04-22T14:17:00.908 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:00.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:00.960 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:17:01.042 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:01.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:01.087 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 3' 2020-04-22T14:17:01.164 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:01.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:01.211 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr' 2020-04-22T14:17:01.327 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:17:01.327 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:17:01.327 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:17:01.327 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:01.328 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:17:01.328 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:01.328 INFO:teuthology.orchestra.run.smithi103.stdout:2: veth0@if39: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:17:01.328 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 1e:17:df:af:ce:a3 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:17:01.328 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2020-04-22T14:17:01.328 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:01.328 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::1c17:dfff:feaf:cea3/64 scope link 2020-04-22T14:17:01.329 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:01.329 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:01.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:01.364 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr' 2020-04-22T14:17:01.441 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:17:01.441 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:17:01.441 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:17:01.441 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:01.441 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:17:01.441 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:01.442 INFO:teuthology.orchestra.run.smithi103.stdout:2: veth0@if39: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:17:01.442 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 1e:17:df:af:ce:a3 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:17:01.442 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2020-04-22T14:17:01.442 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:01.442 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::1c17:dfff:feaf:cea3/64 scope link 2020-04-22T14:17:01.442 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:01.477 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.2/16 2020-04-22T14:17:01.477 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:01.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:01.510 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.3' 2020-04-22T14:17:01.588 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:01.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:01.635 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0' 2020-04-22T14:17:01.743 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:01.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:01.758 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up' 2020-04-22T14:17:01.865 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:01.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:01.878 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up' 2020-04-22T14:17:01.989 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:02.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:02.005 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254' 2020-04-22T14:17:02.113 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:02.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:02.167 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:17:02.266 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:02.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:02.345 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge-slave con-name brx.3 ifname brx.3 master ceph-brx' 2020-04-22T14:17:02.482 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.3' (fd906f59-a0ad-45fa-a791-2515cf159a7a) successfully added. 2020-04-22T14:17:02.482 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:02.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:02.523 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up brx.3' 2020-04-22T14:17:02.700 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/49) 2020-04-22T14:17:02.750 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2020-04-22T14:17:02.750 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi103.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2020-04-22T14:17:02.751 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:02.779 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:17:02.779 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:17:02.849 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:02.905 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:17:02.905 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:17:02.978 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:17:02.986 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:17:02.986 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:03.034 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:17:03.035 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:17:03.095 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:17:03.095 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [47] 2020-04-22T14:17:03.095 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:03.143 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:17:03.185 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:03.198 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:17:03.199 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:17:03.268 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:17:03.274 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:2020-04-22T14:17:03.272+0000 7fb28a4b31c0 -1 init, newargv = 0x55ef2eb3ab70 newargc=9 2020-04-22T14:17:03.274 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[108481]: starting ceph client 2020-04-22T14:17:03.275 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:17:03.276 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:03.278 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[108481]: starting fuse 2020-04-22T14:17:03.290 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:17:03.291 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:17:03.353 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:17:03.353 INFO:teuthology.orchestra.run.smithi103.stdout:49 2020-04-22T14:17:03.353 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47, 49] 2020-04-22T14:17:03.353 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:03.398 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:17:03.398 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:17:03.398 INFO:teuthology.orchestra.run.smithi103:> import glob 2020-04-22T14:17:03.398 INFO:teuthology.orchestra.run.smithi103:> import re 2020-04-22T14:17:03.398 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:17:03.399 INFO:teuthology.orchestra.run.smithi103:> import subprocess 2020-04-22T14:17:03.399 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:17:03.399 INFO:teuthology.orchestra.run.smithi103:> def find_socket(client_name): 2020-04-22T14:17:03.399 INFO:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2020-04-22T14:17:03.400 INFO:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2020-04-22T14:17:03.400 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:17:03.400 INFO:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2020-04-22T14:17:03.400 INFO:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2020-04-22T14:17:03.400 INFO:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2020-04-22T14:17:03.400 INFO:teuthology.orchestra.run.smithi103:> return files[0] 2020-04-22T14:17:03.400 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:17:03.401 INFO:teuthology.orchestra.run.smithi103:> for f in files: 2020-04-22T14:17:03.401 INFO:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:17:03.401 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:17:03.401 INFO:teuthology.orchestra.run.smithi103:> return f 2020-04-22T14:17:03.401 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:17:03.401 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:17:03.401 INFO:teuthology.orchestra.run.smithi103:> print(find_socket("client.1")) 2020-04-22T14:17:03.402 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:17:03.506 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.1.108481.asok 2020-04-22T14:17:03.506 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.108481.asok 2020-04-22T14:17:03.507 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:03.520 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:17:03.521 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.108481.asok status 2020-04-22T14:17:03.681 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:17:03.682 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2020-04-22T14:17:03.682 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:17:03.682 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:17:03.682 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "1", 2020-04-22T14:17:03.682 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:17:03.682 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2020-04-22T14:17:03.683 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "108481", 2020-04-22T14:17:03.683 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:17:03.683 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:03.683 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2020-04-22T14:17:03.683 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2020-04-22T14:17:03.683 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 9133, 2020-04-22T14:17:03.684 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2020-04-22T14:17:03.684 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:17:03.684 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:17:03.684 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 9133 2020-04-22T14:17:03.685 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:03.685 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:17:03.685 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:17:03.685 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.2:0", 2020-04-22T14:17:03.685 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 3546373905 2020-04-22T14:17:03.686 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:03.686 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:03.686 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:17:03.686 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:17:03.686 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.2:0", 2020-04-22T14:17:03.687 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 3546373905 2020-04-22T14:17:03.687 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:03.687 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.9133 192.168.0.2:0/3546373905", 2020-04-22T14:17:03.687 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.2:0/3546373905", 2020-04-22T14:17:03.687 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2020-04-22T14:17:03.687 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 94, 2020-04-22T14:17:03.687 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 124, 2020-04-22T14:17:03.688 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2020-04-22T14:17:03.688 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklisted": false 2020-04-22T14:17:03.688 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:17:03.688 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:03.702 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:17:03.703 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-22T14:17:03.703 INFO:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:17:03.761 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2020-04-22T14:17:03.762 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-04-22T14:17:03.762 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:03.810 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:17:03.811 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:17:03.887 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:03.938 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok config get mds_reconnect_timeout 2020-04-22T14:17:04.092 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:17:04.092 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_reconnect_timeout": "45.000000" 2020-04-22T14:17:04.092 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:17:04.100 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_reconnect_timeout": "45.000000" } 2020-04-22T14:17:04.101 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:04.115 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok config get ms_max_backoff 2020-04-22T14:17:04.267 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:17:04.267 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_max_backoff": "15.000000" 2020-04-22T14:17:04.268 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:17:04.275 INFO:tasks.cephfs.filesystem:_json_asok output: { "ms_max_backoff": "15.000000" } 2020-04-22T14:17:04.276 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:04.289 INFO:teuthology.orchestra.run.smithi103:> rpm -q fuse --qf '%{VERSION}-%{RELEASE}' 2020-04-22T14:17:04.348 INFO:teuthology.orchestra.run.smithi103.stdout:2.9.7-12.el8 2020-04-22T14:17:04.349 INFO:teuthology.packaging:The installed version of fuse is 2.9.7-12.el8 2020-04-22T14:17:04.349 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:04.403 INFO:teuthology.orchestra.run.smithi103:> rpm -q fuse --qf '%{VERSION}-%{RELEASE}' 2020-04-22T14:17:04.462 INFO:teuthology.orchestra.run.smithi103.stdout:2.9.7-12.el8 2020-04-22T14:17:04.462 INFO:teuthology.packaging:The installed version of fuse is 2.9.7-12.el8 2020-04-22T14:17:04.463 INFO:tasks.cephfs.test_client_recovery:flock locks are available 2020-04-22T14:17:04.463 INFO:tasks.cephfs.mount:lock_background file background_file 2020-04-22T14:17:04.463 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:04.516 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-04-22T14:17:04.516 INFO:teuthology.orchestra.run.smithi103:> import time 2020-04-22T14:17:04.516 INFO:teuthology.orchestra.run.smithi103:> import fcntl 2020-04-22T14:17:04.516 INFO:teuthology.orchestra.run.smithi103:> import struct 2020-04-22T14:17:04.516 INFO:teuthology.orchestra.run.smithi103:> f1 = open("/home/ubuntu/cephtest/mnt.0/background_file-1", '"'"'w'"'"') 2020-04-22T14:17:04.517 INFO:teuthology.orchestra.run.smithi103:> fcntl.flock(f1, fcntl.LOCK_EX | fcntl.LOCK_NB) 2020-04-22T14:17:04.517 INFO:teuthology.orchestra.run.smithi103:> f2 = open("/home/ubuntu/cephtest/mnt.0/background_file-2", '"'"'w'"'"') 2020-04-22T14:17:04.517 INFO:teuthology.orchestra.run.smithi103:> lockdata = struct.pack('"'"'hhllhh'"'"', fcntl.F_WRLCK, 0, 0, 0, 0, 0) 2020-04-22T14:17:04.517 INFO:teuthology.orchestra.run.smithi103:> fcntl.fcntl(f2, fcntl.F_SETLK, lockdata) 2020-04-22T14:17:04.517 INFO:teuthology.orchestra.run.smithi103:> while True: 2020-04-22T14:17:04.517 INFO:teuthology.orchestra.run.smithi103:> time.sleep(1) 2020-04-22T14:17:04.517 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:17:04.558 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:04.572 INFO:teuthology.orchestra.run.smithi103:> sudo ls /home/ubuntu/cephtest/mnt.1/background_file-2 2020-04-22T14:17:04.641 INFO:teuthology.orchestra.run.smithi103.stderr:ls: cannot access '/home/ubuntu/cephtest/mnt.1/background_file-2': No such file or directory 2020-04-22T14:17:04.643 DEBUG:teuthology.orchestra.run:got remote process result: 2 2020-04-22T14:17:05.644 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:05.662 INFO:teuthology.orchestra.run.smithi103:> sudo ls /home/ubuntu/cephtest/mnt.1/background_file-2 2020-04-22T14:17:05.741 INFO:teuthology.orchestra.run.smithi103.stdout:/home/ubuntu/cephtest/mnt.1/background_file-2 2020-04-22T14:17:05.745 DEBUG:tasks.cephfs.mount:File background_file-2 became visible from 1 after 1s 2020-04-22T14:17:05.745 INFO:tasks.cephfs.mount:check lock on file background_file 2020-04-22T14:17:05.745 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:05.800 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:17:05.800 INFO:teuthology.orchestra.run.smithi103:> import fcntl 2020-04-22T14:17:05.800 INFO:teuthology.orchestra.run.smithi103:> import errno 2020-04-22T14:17:05.801 INFO:teuthology.orchestra.run.smithi103:> import struct 2020-04-22T14:17:05.801 INFO:teuthology.orchestra.run.smithi103:> f1 = open("/home/ubuntu/cephtest/mnt.1/background_file-1", '"'"'r'"'"') 2020-04-22T14:17:05.801 INFO:teuthology.orchestra.run.smithi103:> try: 2020-04-22T14:17:05.801 INFO:teuthology.orchestra.run.smithi103:> fcntl.flock(f1, fcntl.LOCK_EX | fcntl.LOCK_NB) 2020-04-22T14:17:05.801 INFO:teuthology.orchestra.run.smithi103:> except IOError as e: 2020-04-22T14:17:05.801 INFO:teuthology.orchestra.run.smithi103:> if e.errno == errno.EAGAIN: 2020-04-22T14:17:05.802 INFO:teuthology.orchestra.run.smithi103:> pass 2020-04-22T14:17:05.802 INFO:teuthology.orchestra.run.smithi103:> else: 2020-04-22T14:17:05.802 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("flock on file /home/ubuntu/cephtest/mnt.1/background_file-1 not found") 2020-04-22T14:17:05.802 INFO:teuthology.orchestra.run.smithi103:> f2 = open("/home/ubuntu/cephtest/mnt.1/background_file-2", '"'"'r'"'"') 2020-04-22T14:17:05.802 INFO:teuthology.orchestra.run.smithi103:> try: 2020-04-22T14:17:05.802 INFO:teuthology.orchestra.run.smithi103:> lockdata = struct.pack('"'"'hhllhh'"'"', fcntl.F_WRLCK, 0, 0, 0, 0, 0) 2020-04-22T14:17:05.803 INFO:teuthology.orchestra.run.smithi103:> fcntl.fcntl(f2, fcntl.F_SETLK, lockdata) 2020-04-22T14:17:05.803 INFO:teuthology.orchestra.run.smithi103:> except IOError as e: 2020-04-22T14:17:05.803 INFO:teuthology.orchestra.run.smithi103:> if e.errno == errno.EAGAIN: 2020-04-22T14:17:05.803 INFO:teuthology.orchestra.run.smithi103:> pass 2020-04-22T14:17:05.803 INFO:teuthology.orchestra.run.smithi103:> else: 2020-04-22T14:17:05.804 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("posix lock on file /home/ubuntu/cephtest/mnt.1/background_file-2 not found") 2020-04-22T14:17:05.804 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:17:05.899 INFO:tasks.cephfs.mount:lock_and_release file background_file 2020-04-22T14:17:05.900 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:05.913 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-04-22T14:17:05.914 INFO:teuthology.orchestra.run.smithi103:> import time 2020-04-22T14:17:05.914 INFO:teuthology.orchestra.run.smithi103:> import fcntl 2020-04-22T14:17:05.914 INFO:teuthology.orchestra.run.smithi103:> import struct 2020-04-22T14:17:05.914 INFO:teuthology.orchestra.run.smithi103:> f1 = open("/home/ubuntu/cephtest/mnt.1/background_file-1", '"'"'w'"'"') 2020-04-22T14:17:05.914 INFO:teuthology.orchestra.run.smithi103:> fcntl.flock(f1, fcntl.LOCK_EX) 2020-04-22T14:17:05.914 INFO:teuthology.orchestra.run.smithi103:> f2 = open("/home/ubuntu/cephtest/mnt.1/background_file-2", '"'"'w'"'"') 2020-04-22T14:17:05.914 INFO:teuthology.orchestra.run.smithi103:> lockdata = struct.pack('"'"'hhllhh'"'"', fcntl.F_WRLCK, 0, 0, 0, 0, 0) 2020-04-22T14:17:05.915 INFO:teuthology.orchestra.run.smithi103:> fcntl.fcntl(f2, fcntl.F_SETLK, lockdata) 2020-04-22T14:17:05.915 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:17:08.159 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:08.176 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:17:08.177 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:17:08.177 INFO:teuthology.orchestra.run.smithi103:> import glob 2020-04-22T14:17:08.177 INFO:teuthology.orchestra.run.smithi103:> import re 2020-04-22T14:17:08.177 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:17:08.177 INFO:teuthology.orchestra.run.smithi103:> import subprocess 2020-04-22T14:17:08.177 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:17:08.178 INFO:teuthology.orchestra.run.smithi103:> def find_socket(client_name): 2020-04-22T14:17:08.178 INFO:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-04-22T14:17:08.178 INFO:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2020-04-22T14:17:08.178 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:17:08.178 INFO:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2020-04-22T14:17:08.178 INFO:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2020-04-22T14:17:08.178 INFO:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2020-04-22T14:17:08.178 INFO:teuthology.orchestra.run.smithi103:> return files[0] 2020-04-22T14:17:08.178 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:17:08.179 INFO:teuthology.orchestra.run.smithi103:> for f in files: 2020-04-22T14:17:08.179 INFO:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:17:08.179 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:17:08.179 INFO:teuthology.orchestra.run.smithi103:> return f 2020-04-22T14:17:08.179 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:17:08.179 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:17:08.179 INFO:teuthology.orchestra.run.smithi103:> print(find_socket("client.0")) 2020-04-22T14:17:08.179 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:17:08.286 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.0.107198.asok 2020-04-22T14:17:08.286 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.107198.asok 2020-04-22T14:17:08.286 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:08.301 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:17:08.301 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.107198.asok mds_sessions 2020-04-22T14:17:08.460 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:17:08.461 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 9079, 2020-04-22T14:17:08.461 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2020-04-22T14:17:08.461 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:17:08.461 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:17:08.461 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 9079 2020-04-22T14:17:08.461 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:08.462 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:17:08.462 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:17:08.462 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:17:08.462 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 546260275 2020-04-22T14:17:08.462 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:08.463 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:08.463 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.9079 v1:192.168.0.1:0/546260275", 2020-04-22T14:17:08.463 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "v1:192.168.0.1:0/546260275", 2020-04-22T14:17:08.463 INFO:teuthology.orchestra.run.smithi103.stdout: "sessions": [ 2020-04-22T14:17:08.463 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:08.463 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": 0, 2020-04-22T14:17:08.463 INFO:teuthology.orchestra.run.smithi103.stdout: "addrs": { 2020-04-22T14:17:08.463 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:17:08.464 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:08.464 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:17:08.464 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6834", 2020-04-22T14:17:08.464 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 3334539524 2020-04-22T14:17:08.464 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:08.464 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:08.464 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:17:08.465 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6835", 2020-04-22T14:17:08.465 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 3334539524 2020-04-22T14:17:08.465 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:08.465 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:08.465 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:08.465 INFO:teuthology.orchestra.run.smithi103.stdout: "seq": 45, 2020-04-22T14:17:08.465 INFO:teuthology.orchestra.run.smithi103.stdout: "cap_gen": 0, 2020-04-22T14:17:08.465 INFO:teuthology.orchestra.run.smithi103.stdout: "cap_ttl": "2020-04-22T14:17:58.222651+0000", 2020-04-22T14:17:08.466 INFO:teuthology.orchestra.run.smithi103.stdout: "last_cap_renew_request": "2020-04-22T14:16:58.222651+0000", 2020-04-22T14:17:08.466 INFO:teuthology.orchestra.run.smithi103.stdout: "cap_renew_seq": 2, 2020-04-22T14:17:08.466 INFO:teuthology.orchestra.run.smithi103.stdout: "num_caps": 3, 2020-04-22T14:17:08.466 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "open" 2020-04-22T14:17:08.466 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:08.466 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:17:08.467 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 94 2020-04-22T14:17:08.467 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:17:08.467 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:08.480 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:17:08.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.624+0000 7f04ecd49700 1 Processor -- start 2020-04-22T14:17:08.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.624+0000 7f04ecd49700 1 -- start start 2020-04-22T14:17:08.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.625+0000 7f04ecd49700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f04e805b7c0 0x7f04e80b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:08.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.625+0000 7f04ecd49700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f04e80ad850 0x7f04e80adc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:08.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.625+0000 7f04ecd49700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e80b5900 con 0x7f04e81441f0 2020-04-22T14:17:08.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.625+0000 7f04ecd49700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04e80b5ba0 con 0x7f04e805b7c0 2020-04-22T14:17:08.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.625+0000 7f04ecd49700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e80b5e40 con 0x7f04e80ad850 2020-04-22T14:17:08.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.625+0000 7f04e659c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f04e805b7c0 0x7f04e80b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:08.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.625+0000 7f04e6d9d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f04e80ad850 0x7f04e80adc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:08.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.625+0000 7f04e659c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f04e805b7c0 0x7f04e80b50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56998/0 (socket says 172.21.15.103:56998) 2020-04-22T14:17:08.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.625+0000 7f04e659c700 1 -- 172.21.15.103:0/3907655450 learned_addr learned my addr 172.21.15.103:0/3907655450 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:08.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.626+0000 7f04e659c700 1 -- 172.21.15.103:0/3907655450 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f04e80ad850 msgr2=0x7f04e80adc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:08.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.626+0000 7f04e659c700 1 --2- 172.21.15.103:0/3907655450 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f04e80ad850 0x7f04e80adc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:08.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.626+0000 7f04e659c700 1 -- 172.21.15.103:0/3907655450 >> v1:172.21.15.103:6789/0 conn(0x7f04e81441f0 legacy=0x7f04e8144820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:08.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.626+0000 7f04e659c700 1 -- 172.21.15.103:0/3907655450 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e805bba0 con 0x7f04e805b7c0 2020-04-22T14:17:08.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.626+0000 7f04e659c700 1 --2- 172.21.15.103:0/3907655450 >> v2:172.21.15.103:3300/0 conn(0x7f04e805b7c0 0x7f04e80b50d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f04e00032b0 tx=0x7f04e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:08.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.626+0000 7f04e659c700 1 --2- 172.21.15.103:0/3907655450 >> v2:172.21.15.103:3300/0 conn(0x7f04e805b7c0 0x7f04e80b50d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f04e00032b0 tx=0x7f04e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:08.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.626+0000 7f04e659c700 1 --2- 172.21.15.103:0/3907655450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04e805b7c0 0x7f04e80b50d0 secure :-1 s=READY pgs=1813 cs=0 l=1 rx=0x7f04e00032b0 tx=0x7f04e0007dc0).ready entity=mon.1 client_cookie=7890f8a189244719 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:08.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.626+0000 7f04e659c700 1 --2- 172.21.15.103:0/3907655450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04e805b7c0 0x7f04e80b50d0 secure :-1 s=THROTTLE_DONE pgs=1813 cs=0 l=1 rx=0x7f04e00032b0 tx=0x7f04e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:08.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.626+0000 7f04e559a700 1 -- 172.21.15.103:0/3907655450 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04e0010e70 con 0x7f04e805b7c0 2020-04-22T14:17:08.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.626+0000 7f04e659c700 1 --2- 172.21.15.103:0/3907655450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04e805b7c0 0x7f04e80b50d0 secure :-1 s=THROTTLE_DONE pgs=1813 cs=0 l=1 rx=0x7f04e00032b0 tx=0x7f04e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:08.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.626+0000 7f04e659c700 1 --2- 172.21.15.103:0/3907655450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04e805b7c0 0x7f04e80b50d0 secure :-1 s=THROTTLE_DONE pgs=1813 cs=0 l=1 rx=0x7f04e00032b0 tx=0x7f04e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:08.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.626+0000 7f04e559a700 1 -- 172.21.15.103:0/3907655450 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e00110d0 con 0x7f04e805b7c0 2020-04-22T14:17:08.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.626+0000 7f04e559a700 1 -- 172.21.15.103:0/3907655450 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04e00114f0 con 0x7f04e805b7c0 2020-04-22T14:17:08.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.626+0000 7f04ecd49700 1 -- 172.21.15.103:0/3907655450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04e805b7c0 msgr2=0x7f04e80b50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:08.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.626+0000 7f04ecd49700 1 --2- 172.21.15.103:0/3907655450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04e805b7c0 0x7f04e80b50d0 secure :-1 s=READY pgs=1813 cs=0 l=1 rx=0x7f04e00032b0 tx=0x7f04e0007dc0).stop 2020-04-22T14:17:08.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.627+0000 7f04ecd49700 1 -- 172.21.15.103:0/3907655450 shutdown_connections 2020-04-22T14:17:08.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.627+0000 7f04ecd49700 1 --2- 172.21.15.103:0/3907655450 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f04e80ad850 0x7f04e80adc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:08.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.627+0000 7f04ecd49700 1 --2- 172.21.15.103:0/3907655450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04e805b7c0 0x7f04e80b50d0 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:08.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.627+0000 7f04ecd49700 1 -- 172.21.15.103:0/3907655450 >> 172.21.15.103:0/3907655450 conn(0x7f04e80b9160 msgr2=0x7f04e805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:08.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.627+0000 7f04ecd49700 1 -- 172.21.15.103:0/3907655450 shutdown_connections 2020-04-22T14:17:08.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.627+0000 7f04ecd49700 1 -- 172.21.15.103:0/3907655450 wait complete. 2020-04-22T14:17:08.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.628+0000 7f04ecd49700 1 Processor -- start 2020-04-22T14:17:08.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.628+0000 7f04ecd49700 1 -- start start 2020-04-22T14:17:08.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.628+0000 7f04ecd49700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f04e805b7c0 0x7f04e80afba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:08.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.628+0000 7f04ecd49700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f04e80ad850 0x7f04e80b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:08.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.628+0000 7f04ecd49700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e80b2410 con 0x7f04e81441f0 2020-04-22T14:17:08.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.628+0000 7f04ecd49700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04e80b2200 con 0x7f04e80ad850 2020-04-22T14:17:08.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.628+0000 7f04ecd49700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04e80b26f0 con 0x7f04e805b7c0 2020-04-22T14:17:08.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.628+0000 7f04e659c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f04e805b7c0 0x7f04e80afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:08.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.628+0000 7f04e659c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f04e805b7c0 0x7f04e80afba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57006/0 (socket says 172.21.15.103:57006) 2020-04-22T14:17:08.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.628+0000 7f04e659c700 1 -- 172.21.15.103:0/2271203597 learned_addr learned my addr 172.21.15.103:0/2271203597 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:08.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.629+0000 7f04e5d9b700 1 --2- 172.21.15.103:0/2271203597 >> v2:172.21.15.86:3300/0 conn(0x7f04e80ad850 0x7f04e80b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:08.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.629+0000 7f04e659c700 1 -- 172.21.15.103:0/2271203597 >> v2:172.21.15.86:3300/0 conn(0x7f04e80ad850 msgr2=0x7f04e80b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:08.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.629+0000 7f04e659c700 1 --2- 172.21.15.103:0/2271203597 >> v2:172.21.15.86:3300/0 conn(0x7f04e80ad850 0x7f04e80b1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:08.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.629+0000 7f04e659c700 1 -- 172.21.15.103:0/2271203597 >> v1:172.21.15.86:6789/0 conn(0x7f04e81441f0 legacy=0x7f04e813cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:08.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.629+0000 7f04e659c700 1 -- 172.21.15.103:0/2271203597 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e80b2990 con 0x7f04e805b7c0 2020-04-22T14:17:08.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.629+0000 7f04e5d9b700 1 --2- 172.21.15.103:0/2271203597 >> v2:172.21.15.86:3300/0 conn(0x7f04e80ad850 0x7f04e80b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:17:08.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.629+0000 7f04e659c700 1 --2- 172.21.15.103:0/2271203597 >> v2:172.21.15.103:3300/0 conn(0x7f04e805b7c0 0x7f04e80afba0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f04e80b1270 tx=0x7f04e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:08.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.629+0000 7f04e659c700 1 --2- 172.21.15.103:0/2271203597 >> v2:172.21.15.103:3300/0 conn(0x7f04e805b7c0 0x7f04e80afba0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f04e80b1270 tx=0x7f04e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:08.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.629+0000 7f04e659c700 1 --2- 172.21.15.103:0/2271203597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04e805b7c0 0x7f04e80afba0 secure :-1 s=READY pgs=1814 cs=0 l=1 rx=0x7f04e80b1270 tx=0x7f04e0007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:08.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.629+0000 7f04e659c700 1 --2- 172.21.15.103:0/2271203597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04e805b7c0 0x7f04e80afba0 secure :-1 s=THROTTLE_DONE pgs=1814 cs=0 l=1 rx=0x7f04e80b1270 tx=0x7f04e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:08.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.629+0000 7f04df7fe700 1 -- 172.21.15.103:0/2271203597 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04e0005c30 con 0x7f04e805b7c0 2020-04-22T14:17:08.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.629+0000 7f04e659c700 1 --2- 172.21.15.103:0/2271203597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04e805b7c0 0x7f04e80afba0 secure :-1 s=THROTTLE_DONE pgs=1814 cs=0 l=1 rx=0x7f04e80b1270 tx=0x7f04e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:08.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.629+0000 7f04df7fe700 1 -- 172.21.15.103:0/2271203597 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e0005d90 con 0x7f04e805b7c0 2020-04-22T14:17:08.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.629+0000 7f04ecd49700 1 -- 172.21.15.103:0/2271203597 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04e813d680 con 0x7f04e805b7c0 2020-04-22T14:17:08.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.629+0000 7f04e659c700 1 --2- 172.21.15.103:0/2271203597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04e805b7c0 0x7f04e80afba0 secure :-1 s=THROTTLE_DONE pgs=1814 cs=0 l=1 rx=0x7f04e80b1270 tx=0x7f04e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:08.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.629+0000 7f04df7fe700 1 -- 172.21.15.103:0/2271203597 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04e000f4a0 con 0x7f04e805b7c0 2020-04-22T14:17:08.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.629+0000 7f04ecd49700 1 -- 172.21.15.103:0/2271203597 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04e80b7c40 con 0x7f04e805b7c0 2020-04-22T14:17:08.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.630+0000 7f04e659c700 1 --2- 172.21.15.103:0/2271203597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04e805b7c0 0x7f04e80afba0 secure :-1 s=THROTTLE_DONE pgs=1814 cs=0 l=1 rx=0x7f04e80b1270 tx=0x7f04e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:08.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.630+0000 7f04df7fe700 1 -- 172.21.15.103:0/2271203597 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f04e000f760 con 0x7f04e805b7c0 2020-04-22T14:17:08.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.630+0000 7f04e659c700 1 --2- 172.21.15.103:0/2271203597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04e805b7c0 0x7f04e80afba0 secure :-1 s=THROTTLE_DONE pgs=1814 cs=0 l=1 rx=0x7f04e80b1270 tx=0x7f04e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:08.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.630+0000 7f04ecd49700 1 -- 172.21.15.103:0/2271203597 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04e8056c90 con 0x7f04e805b7c0 2020-04-22T14:17:08.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.630+0000 7f04df7fe700 1 --2- 172.21.15.103:0/2271203597 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f04cc04d910 0x7f04cc04fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:08.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.630+0000 7f04df7fe700 1 -- 172.21.15.103:0/2271203597 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f04e0061eb0 con 0x7f04e805b7c0 2020-04-22T14:17:08.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.630+0000 7f04e5d9b700 1 --2- 172.21.15.103:0/2271203597 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f04cc04d910 0x7f04cc04fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:08.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.631+0000 7f04e5d9b700 1 --2- 172.21.15.103:0/2271203597 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f04cc04d910 0x7f04cc04fdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f04e80613e0 tx=0x7f04d00016c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:08.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.631+0000 7f04e5d9b700 1 --2- 172.21.15.103:0/2271203597 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f04cc04d910 0x7f04cc04fdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f04e80613e0 tx=0x7f04d00016c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:08.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.631+0000 7f04e5d9b700 1 --2- 172.21.15.103:0/2271203597 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f04cc04d910 0x7f04cc04fdd0 secure :-1 s=READY pgs=655 cs=0 l=1 rx=0x7f04e80613e0 tx=0x7f04d00016c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:08.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.634+0000 7f04e659c700 1 --2- 172.21.15.103:0/2271203597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04e805b7c0 0x7f04e80afba0 secure :-1 s=THROTTLE_DONE pgs=1814 cs=0 l=1 rx=0x7f04e80b1270 tx=0x7f04e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:08.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.634+0000 7f04df7fe700 1 -- 172.21.15.103:0/2271203597 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f04e003d290 con 0x7f04e805b7c0 2020-04-22T14:17:08.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.823+0000 7f04ecd49700 1 -- 172.21.15.103:0/2271203597 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04e80b4eb0 con 0x7f04e805b7c0 2020-04-22T14:17:08.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.823+0000 7f04e659c700 1 --2- 172.21.15.103:0/2271203597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04e805b7c0 0x7f04e80afba0 secure :-1 s=THROTTLE_DONE pgs=1814 cs=0 l=1 rx=0x7f04e80b1270 tx=0x7f04e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:08.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.823+0000 7f04df7fe700 1 -- 172.21.15.103:0/2271203597 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+2145 (secure 0 0 0) 0x7f04e00408b0 con 0x7f04e805b7c0 2020-04-22T14:17:08.826 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:17:08.826 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":94,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6380,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/1697822737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1697822737},{"type":"v1","addr":"172.21.15.103:6833","nonce":1697822737}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":91}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:16:46.111567+0000","modified":"2020-04-22T14:16:48.114069+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8142},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8142":{"gid":8142,"name":"b","rank":0,"incarnation":92,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/3334539524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3334539524},{"type":"v1","addr":"172.21.15.86:6835","nonce":3334539524}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2020-04-22T14:17:08.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.825+0000 7f04ecd49700 1 -- 172.21.15.103:0/2271203597 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f04cc04d910 msgr2=0x7f04cc04fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:08.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.825+0000 7f04ecd49700 1 --2- 172.21.15.103:0/2271203597 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f04cc04d910 0x7f04cc04fdd0 secure :-1 s=READY pgs=655 cs=0 l=1 rx=0x7f04e80613e0 tx=0x7f04d00016c0).stop 2020-04-22T14:17:08.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.825+0000 7f04ecd49700 1 -- 172.21.15.103:0/2271203597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04e805b7c0 msgr2=0x7f04e80afba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:08.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.825+0000 7f04ecd49700 1 --2- 172.21.15.103:0/2271203597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04e805b7c0 0x7f04e80afba0 secure :-1 s=READY pgs=1814 cs=0 l=1 rx=0x7f04e80b1270 tx=0x7f04e0007dc0).stop 2020-04-22T14:17:08.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.825+0000 7f04ecd49700 1 -- 172.21.15.103:0/2271203597 shutdown_connections 2020-04-22T14:17:08.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.825+0000 7f04ecd49700 1 --2- 172.21.15.103:0/2271203597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04e805b7c0 0x7f04e80afba0 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:08.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.825+0000 7f04ecd49700 1 --2- 172.21.15.103:0/2271203597 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f04cc04d910 0x7f04cc04fdd0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:08.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.825+0000 7f04ecd49700 1 --2- 172.21.15.103:0/2271203597 >> v2:172.21.15.86:3300/0 conn(0x7f04e80ad850 0x7f04e80b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:08.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.825+0000 7f04ecd49700 1 -- 172.21.15.103:0/2271203597 >> 172.21.15.103:0/2271203597 conn(0x7f04e80b9160 msgr2=0x7f04e8140bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:08.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.825+0000 7f04ecd49700 1 -- 172.21.15.103:0/2271203597 shutdown_connections 2020-04-22T14:17:08.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:08.825+0000 7f04ecd49700 1 -- 172.21.15.103:0/2271203597 wait complete. 2020-04-22T14:17:08.829 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 94 2020-04-22T14:17:08.837 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:17:08.856 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok session evict 9079 2020-04-22T14:17:09.485 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:2020-04-22T14:17:09.482+0000 7ffa2b7fe700 -1 client.9079 I was blacklisted at osd epoch 125 2020-04-22T14:17:09.495 INFO:tasks.cephfs.filesystem:_json_asok output: 2020-04-22T14:17:09.596 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=10)... 2020-04-22T14:17:14.597 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s 2020-04-22T14:17:14.597 INFO:tasks.cephfs.mount:Killing connection on ubuntu@smithi103.front.sepia.ceph.com... 2020-04-22T14:17:14.597 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:17:14.598 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:14.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:14.615 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip link set brx.0 down' 2020-04-22T14:17:14.722 INFO:tasks.cephfs.mount:Cleaning up killed connection on ubuntu@smithi103.front.sepia.ceph.com 2020-04-22T14:17:14.722 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2020-04-22T14:17:14.723 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:14.752 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-04-22T14:17:14.752 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:17:14.823 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-04-22T14:17:14.829 INFO:teuthology.orchestra.run.smithi103.stderr:fusermount: failed to unmount /home/ubuntu/cephtest/mnt.0: Device or resource busy 2020-04-22T14:17:14.829 INFO:tasks.cephfs.fuse_mount:Failed to unmount ceph-fuse on ubuntu@smithi103.front.sepia.ceph.com, aborting... 2020-04-22T14:17:14.829 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:14.878 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:17:14.879 INFO:teuthology.orchestra.run.smithi103:> sudo PATH=/usr/sbin:$PATH lsof ; ps auxf 2020-04-22T14:17:15.037 INFO:teuthology.orchestra.run.smithi103.stderr:lsof: WARNING: can't stat() fuse.ceph-fuse file system /home/ubuntu/cephtest/mnt.0 2020-04-22T14:17:15.038 INFO:teuthology.orchestra.run.smithi103.stderr: Output information may be incomplete. 2020-04-22T14:17:15.617 INFO:teuthology.orchestra.run.smithi103.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2020-04-22T14:17:15.618 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.618 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.618 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root txt REG 8,1 2523648 6380 /usr/lib/systemd/systemd 2020-04-22T14:17:15.618 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:15.618 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:15.618 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root mem REG 8,1 766120 3335 /usr/lib64/libsepol.so.1 2020-04-22T14:17:15.619 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root mem REG 8,1 1760264 3670 /usr/lib64/libunistring.so.2.1.0 2020-04-22T14:17:15.619 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root mem REG 8,1 356920 3798 /usr/lib64/libpcap.so.1.9.0 2020-04-22T14:17:15.619 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root mem REG 8,1 144392 3449 /usr/lib64/libgpg-error.so.0.24.2 2020-04-22T14:17:15.619 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root mem REG 8,1 70432 3726 /usr/lib64/libjson-c.so.4.0.0 2020-04-22T14:17:15.619 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root mem REG 8,1 443488 5581 /usr/lib64/libdevmapper.so.1.02 2020-04-22T14:17:15.619 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root mem REG 8,1 26192 3541 /usr/lib64/libattr.so.1.1.2448 2020-04-22T14:17:15.619 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:15.620 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:15.620 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:15.620 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root mem REG 8,1 25192 3584 /usr/lib64/libcap-ng.so.0.0.0 2020-04-22T14:17:15.620 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:15.620 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:15.620 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:15.620 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:15.621 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:15.621 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:15.621 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root mem REG 8,1 162224 3672 /usr/lib64/libidn2.so.0.3.6 2020-04-22T14:17:15.621 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root mem REG 8,1 37824 3807 /usr/lib64/libip4tc.so.0.1.0 2020-04-22T14:17:15.621 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root mem REG 8,1 1385560 3654 /usr/lib64/libgcrypt.so.20.2.3 2020-04-22T14:17:15.621 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root mem REG 8,1 645024 5716 /usr/lib64/libcryptsetup.so.12.5.0 2020-04-22T14:17:15.621 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root mem REG 8,1 54816 3543 /usr/lib64/libacl.so.1.1.2253 2020-04-22T14:17:15.622 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:15.622 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:15.622 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:15.622 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:15.622 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root mem REG 8,1 228128 5610 /usr/lib64/libkmod.so.2.3.3 2020-04-22T14:17:15.622 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root mem REG 8,1 141392 3586 /usr/lib64/libaudit.so.1.0.0 2020-04-22T14:17:15.623 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root mem REG 8,1 74600 5752 /usr/lib64/libpam.so.0.84.2 2020-04-22T14:17:15.623 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:15.623 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:15.623 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root mem REG 8,1 357336 4307 /usr/lib64/libseccomp.so.2.4.1 2020-04-22T14:17:15.623 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:15.623 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root mem REG 8,1 5215944 6376 /usr/lib/systemd/libsystemd-shared-239.so 2020-04-22T14:17:15.623 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:15.624 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root DEL REG 8,1 64856 /etc/selinux/targeted/contexts/files/file_contexts.bin 2020-04-22T14:17:15.624 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root DEL REG 8,1 64857 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2020-04-22T14:17:15.625 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 0u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.625 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 1u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.625 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 2u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.625 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 3w CHR 1,11 0t0 1034 /dev/kmsg 2020-04-22T14:17:15.625 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 4u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:15.626 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 5u a_inode 0,14 0 2063 [signalfd] 2020-04-22T14:17:15.626 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 6r DIR 0,26 0 1 /sys/fs/cgroup/systemd 2020-04-22T14:17:15.627 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 7u a_inode 0,14 0 2063 [timerfd] 2020-04-22T14:17:15.627 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 8u netlink 0t0 18252 KOBJECT_UEVENT 2020-04-22T14:17:15.627 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 9u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:15.627 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 10r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:15.627 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 11u netlink 0t0 18258 AUDIT 2020-04-22T14:17:15.627 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 12r REG 0,4 0 12557 /proc/1/mountinfo 2020-04-22T14:17:15.628 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 13r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:15.628 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 14r REG 0,4 0 4026532079 /proc/swaps 2020-04-22T14:17:15.628 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 15u unix 0x00000000e8c3ce52 0t0 18253 /run/systemd/private type=STREAM 2020-04-22T14:17:15.628 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 16u a_inode 0,14 0 2063 [timerfd] 2020-04-22T14:17:15.628 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 17r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:15.628 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 18r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:15.629 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 29u unix 0x0000000067c31f04 0t0 12559 /run/systemd/notify type=DGRAM 2020-04-22T14:17:15.629 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 30u unix 0x000000003212813f 0t0 12561 /run/systemd/cgroups-agent type=DGRAM 2020-04-22T14:17:15.629 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 31u unix 0x000000009b629a3d 0t0 12563 type=DGRAM 2020-04-22T14:17:15.629 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 33u unix 0x00000000785a3900 0t0 12564 type=DGRAM 2020-04-22T14:17:15.629 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 34u unix 0x00000000f6fb48ec 0t0 22100 /run/dbus/system_bus_socket type=STREAM 2020-04-22T14:17:15.629 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 35u unix 0x000000007d47dc8f 0t0 12581 /run/systemd/journal/stdout type=STREAM 2020-04-22T14:17:15.629 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 36u unix 0x00000000c481d764 0t0 12584 /run/systemd/journal/socket type=DGRAM 2020-04-22T14:17:15.630 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 37u unix 0x000000000a3c9cfd 0t0 18270 /run/systemd/coredump type=SEQPACKET 2020-04-22T14:17:15.630 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 38u FIFO 0,24 0t0 18279 /run/dmeventd-server 2020-04-22T14:17:15.630 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 39u FIFO 0,24 0t0 18280 /run/dmeventd-client 2020-04-22T14:17:15.630 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 41u unix 0x000000009bb9827c 0t0 18268 /run/udev/control type=SEQPACKET 2020-04-22T14:17:15.630 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 42r CHR 10,235 0t0 1194 /dev/autofs 2020-04-22T14:17:15.630 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 45u unix 0x0000000039b76c02 0t0 22543 type=DGRAM 2020-04-22T14:17:15.630 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 46u unix 0x000000003094e2c3 0t0 112004 /run/systemd/journal/stdout type=STREAM 2020-04-22T14:17:15.631 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 47u a_inode 0,14 0 2063 [timerfd] 2020-04-22T14:17:15.631 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 48u unix 0x00000000a850cb83 0t0 22692 /run/systemd/journal/stdout type=STREAM 2020-04-22T14:17:15.631 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 49u unix 0x0000000047223826 0t0 25962 /run/systemd/journal/stdout type=STREAM 2020-04-22T14:17:15.631 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 50u unix 0x0000000075518791 0t0 21188 /run/systemd/journal/stdout type=STREAM 2020-04-22T14:17:15.631 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 51u unix 0x0000000013edd189 0t0 22121 type=STREAM 2020-04-22T14:17:15.631 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 52u unix 0x00000000cf66c9f1 0t0 21190 /run/systemd/journal/stdout type=STREAM 2020-04-22T14:17:15.631 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 53u unix 0x000000006e1d0885 0t0 21192 /run/systemd/journal/stdout type=STREAM 2020-04-22T14:17:15.632 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 54u netlink 0t0 2500 SELINUX 2020-04-22T14:17:15.632 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 55u unix 0x000000003c347321 0t0 21196 /run/systemd/journal/stdout type=STREAM 2020-04-22T14:17:15.632 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 56u unix 0x00000000a19d1c44 0t0 21198 /run/systemd/journal/stdout type=STREAM 2020-04-22T14:17:15.632 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 57u unix 0x000000001503a0fb 0t0 26886 /run/systemd/journal/stdout type=STREAM 2020-04-22T14:17:15.632 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 58u unix 0x00000000c4ef0b99 0t0 26888 /run/systemd/journal/stdout type=STREAM 2020-04-22T14:17:15.632 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 59u unix 0x000000001a4ae2ac 0t0 21270 /run/systemd/journal/stdout type=STREAM 2020-04-22T14:17:15.633 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 62u unix 0x00000000955d739e 0t0 26953 /run/systemd/journal/stdout type=STREAM 2020-04-22T14:17:15.633 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 63u unix 0x00000000f061df62 0t0 27013 /run/systemd/journal/stdout type=STREAM 2020-04-22T14:17:15.633 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 64u unix 0x0000000096da5832 0t0 27937 /run/systemd/journal/stdout type=STREAM 2020-04-22T14:17:15.633 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 65u unix 0x0000000048a2aef6 0t0 28819 /run/systemd/journal/stdout type=STREAM 2020-04-22T14:17:15.633 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 66u unix 0x0000000048c2c25c 0t0 25483 /run/systemd/journal/stdout type=STREAM 2020-04-22T14:17:15.633 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 68u unix 0x000000000b836367 0t0 24456 /run/systemd/journal/stdout type=STREAM 2020-04-22T14:17:15.633 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 69u unix 0x00000000c999b29c 0t0 35350 /run/systemd/journal/stdout type=STREAM 2020-04-22T14:17:15.633 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 71u netlink 0t0 18384 KOBJECT_UEVENT 2020-04-22T14:17:15.634 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 72u unix 0x0000000084d98421 0t0 22104 /var/run/.heim_org.h5l.kcm-socket type=STREAM 2020-04-22T14:17:15.634 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 78u unix 0x00000000c565bff1 0t0 12576 /run/systemd/journal/dev-log type=DGRAM 2020-04-22T14:17:15.634 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 79u unix 0x00000000858b49da 0t0 18372 /run/rpcbind.sock type=STREAM 2020-04-22T14:17:15.634 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 82u IPv4 18375 0t0 TCP *:sunrpc (LISTEN) 2020-04-22T14:17:15.634 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 106u IPv4 18376 0t0 UDP *:sunrpc 2020-04-22T14:17:15.634 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 107u IPv6 18377 0t0 TCP *:sunrpc (LISTEN) 2020-04-22T14:17:15.634 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 108u IPv6 18378 0t0 UDP *:sunrpc 2020-04-22T14:17:15.635 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 109u unix 0x0000000025ef50b1 0t0 22539 /run/lvm/lvmpolld.socket type=STREAM 2020-04-22T14:17:15.635 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 113u FIFO 0,24 0t0 18281 /run/initctl 2020-04-22T14:17:15.635 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 1 root 114r FIFO 0,13 0t0 22537 pipe 2020-04-22T14:17:15.635 INFO:teuthology.orchestra.run.smithi103.stdout:kthreadd 2 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.635 INFO:teuthology.orchestra.run.smithi103.stdout:kthreadd 2 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.635 INFO:teuthology.orchestra.run.smithi103.stdout:kthreadd 2 root txt unknown /proc/2/exe 2020-04-22T14:17:15.635 INFO:teuthology.orchestra.run.smithi103.stdout:rcu_gp 3 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.636 INFO:teuthology.orchestra.run.smithi103.stdout:rcu_gp 3 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.636 INFO:teuthology.orchestra.run.smithi103.stdout:rcu_gp 3 root txt unknown /proc/3/exe 2020-04-22T14:17:15.636 INFO:teuthology.orchestra.run.smithi103.stdout:rcu_par_g 4 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.636 INFO:teuthology.orchestra.run.smithi103.stdout:rcu_par_g 4 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.636 INFO:teuthology.orchestra.run.smithi103.stdout:rcu_par_g 4 root txt unknown /proc/4/exe 2020-04-22T14:17:15.636 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/0 6 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.636 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/0 6 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.637 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/0 6 root txt unknown /proc/6/exe 2020-04-22T14:17:15.637 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/u 7 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.637 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/u 7 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.637 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/u 7 root txt unknown /proc/7/exe 2020-04-22T14:17:15.637 INFO:teuthology.orchestra.run.smithi103.stdout:mm_percpu 8 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.637 INFO:teuthology.orchestra.run.smithi103.stdout:mm_percpu 8 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.638 INFO:teuthology.orchestra.run.smithi103.stdout:mm_percpu 8 root txt unknown /proc/8/exe 2020-04-22T14:17:15.638 INFO:teuthology.orchestra.run.smithi103.stdout:ksoftirqd 9 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.638 INFO:teuthology.orchestra.run.smithi103.stdout:ksoftirqd 9 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.638 INFO:teuthology.orchestra.run.smithi103.stdout:ksoftirqd 9 root txt unknown /proc/9/exe 2020-04-22T14:17:15.638 INFO:teuthology.orchestra.run.smithi103.stdout:rcu_sched 10 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.639 INFO:teuthology.orchestra.run.smithi103.stdout:rcu_sched 10 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.639 INFO:teuthology.orchestra.run.smithi103.stdout:rcu_sched 10 root txt unknown /proc/10/exe 2020-04-22T14:17:15.639 INFO:teuthology.orchestra.run.smithi103.stdout:migration 11 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.639 INFO:teuthology.orchestra.run.smithi103.stdout:migration 11 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.639 INFO:teuthology.orchestra.run.smithi103.stdout:migration 11 root txt unknown /proc/11/exe 2020-04-22T14:17:15.639 INFO:teuthology.orchestra.run.smithi103.stdout:watchdog/ 12 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.639 INFO:teuthology.orchestra.run.smithi103.stdout:watchdog/ 12 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.640 INFO:teuthology.orchestra.run.smithi103.stdout:watchdog/ 12 root txt unknown /proc/12/exe 2020-04-22T14:17:15.640 INFO:teuthology.orchestra.run.smithi103.stdout:cpuhp/0 13 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.640 INFO:teuthology.orchestra.run.smithi103.stdout:cpuhp/0 13 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.640 INFO:teuthology.orchestra.run.smithi103.stdout:cpuhp/0 13 root txt unknown /proc/13/exe 2020-04-22T14:17:15.640 INFO:teuthology.orchestra.run.smithi103.stdout:cpuhp/1 14 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.640 INFO:teuthology.orchestra.run.smithi103.stdout:cpuhp/1 14 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.640 INFO:teuthology.orchestra.run.smithi103.stdout:cpuhp/1 14 root txt unknown /proc/14/exe 2020-04-22T14:17:15.641 INFO:teuthology.orchestra.run.smithi103.stdout:watchdog/ 15 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.641 INFO:teuthology.orchestra.run.smithi103.stdout:watchdog/ 15 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.641 INFO:teuthology.orchestra.run.smithi103.stdout:watchdog/ 15 root txt unknown /proc/15/exe 2020-04-22T14:17:15.641 INFO:teuthology.orchestra.run.smithi103.stdout:migration 16 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.641 INFO:teuthology.orchestra.run.smithi103.stdout:migration 16 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.641 INFO:teuthology.orchestra.run.smithi103.stdout:migration 16 root txt unknown /proc/16/exe 2020-04-22T14:17:15.641 INFO:teuthology.orchestra.run.smithi103.stdout:ksoftirqd 17 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.641 INFO:teuthology.orchestra.run.smithi103.stdout:ksoftirqd 17 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.642 INFO:teuthology.orchestra.run.smithi103.stdout:ksoftirqd 17 root txt unknown /proc/17/exe 2020-04-22T14:17:15.642 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/1 19 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.642 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/1 19 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.642 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/1 19 root txt unknown /proc/19/exe 2020-04-22T14:17:15.642 INFO:teuthology.orchestra.run.smithi103.stdout:cpuhp/2 20 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.642 INFO:teuthology.orchestra.run.smithi103.stdout:cpuhp/2 20 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.642 INFO:teuthology.orchestra.run.smithi103.stdout:cpuhp/2 20 root txt unknown /proc/20/exe 2020-04-22T14:17:15.643 INFO:teuthology.orchestra.run.smithi103.stdout:watchdog/ 21 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.643 INFO:teuthology.orchestra.run.smithi103.stdout:watchdog/ 21 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.643 INFO:teuthology.orchestra.run.smithi103.stdout:watchdog/ 21 root txt unknown /proc/21/exe 2020-04-22T14:17:15.643 INFO:teuthology.orchestra.run.smithi103.stdout:migration 22 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.643 INFO:teuthology.orchestra.run.smithi103.stdout:migration 22 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.643 INFO:teuthology.orchestra.run.smithi103.stdout:migration 22 root txt unknown /proc/22/exe 2020-04-22T14:17:15.643 INFO:teuthology.orchestra.run.smithi103.stdout:ksoftirqd 23 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.644 INFO:teuthology.orchestra.run.smithi103.stdout:ksoftirqd 23 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.644 INFO:teuthology.orchestra.run.smithi103.stdout:ksoftirqd 23 root txt unknown /proc/23/exe 2020-04-22T14:17:15.644 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/2 25 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.644 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/2 25 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.644 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/2 25 root txt unknown /proc/25/exe 2020-04-22T14:17:15.644 INFO:teuthology.orchestra.run.smithi103.stdout:cpuhp/3 26 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.644 INFO:teuthology.orchestra.run.smithi103.stdout:cpuhp/3 26 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.645 INFO:teuthology.orchestra.run.smithi103.stdout:cpuhp/3 26 root txt unknown /proc/26/exe 2020-04-22T14:17:15.645 INFO:teuthology.orchestra.run.smithi103.stdout:watchdog/ 27 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.645 INFO:teuthology.orchestra.run.smithi103.stdout:watchdog/ 27 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.645 INFO:teuthology.orchestra.run.smithi103.stdout:watchdog/ 27 root txt unknown /proc/27/exe 2020-04-22T14:17:15.645 INFO:teuthology.orchestra.run.smithi103.stdout:migration 28 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.645 INFO:teuthology.orchestra.run.smithi103.stdout:migration 28 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.645 INFO:teuthology.orchestra.run.smithi103.stdout:migration 28 root txt unknown /proc/28/exe 2020-04-22T14:17:15.646 INFO:teuthology.orchestra.run.smithi103.stdout:ksoftirqd 29 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.646 INFO:teuthology.orchestra.run.smithi103.stdout:ksoftirqd 29 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.646 INFO:teuthology.orchestra.run.smithi103.stdout:ksoftirqd 29 root txt unknown /proc/29/exe 2020-04-22T14:17:15.646 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/3 31 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.646 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/3 31 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.646 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/3 31 root txt unknown /proc/31/exe 2020-04-22T14:17:15.646 INFO:teuthology.orchestra.run.smithi103.stdout:cpuhp/4 32 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.646 INFO:teuthology.orchestra.run.smithi103.stdout:cpuhp/4 32 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.647 INFO:teuthology.orchestra.run.smithi103.stdout:cpuhp/4 32 root txt unknown /proc/32/exe 2020-04-22T14:17:15.647 INFO:teuthology.orchestra.run.smithi103.stdout:watchdog/ 33 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.647 INFO:teuthology.orchestra.run.smithi103.stdout:watchdog/ 33 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.647 INFO:teuthology.orchestra.run.smithi103.stdout:watchdog/ 33 root txt unknown /proc/33/exe 2020-04-22T14:17:15.647 INFO:teuthology.orchestra.run.smithi103.stdout:migration 34 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.647 INFO:teuthology.orchestra.run.smithi103.stdout:migration 34 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.647 INFO:teuthology.orchestra.run.smithi103.stdout:migration 34 root txt unknown /proc/34/exe 2020-04-22T14:17:15.648 INFO:teuthology.orchestra.run.smithi103.stdout:ksoftirqd 35 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.648 INFO:teuthology.orchestra.run.smithi103.stdout:ksoftirqd 35 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.648 INFO:teuthology.orchestra.run.smithi103.stdout:ksoftirqd 35 root txt unknown /proc/35/exe 2020-04-22T14:17:15.648 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/4 37 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.648 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/4 37 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.649 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/4 37 root txt unknown /proc/37/exe 2020-04-22T14:17:15.649 INFO:teuthology.orchestra.run.smithi103.stdout:cpuhp/5 38 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.649 INFO:teuthology.orchestra.run.smithi103.stdout:cpuhp/5 38 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.649 INFO:teuthology.orchestra.run.smithi103.stdout:cpuhp/5 38 root txt unknown /proc/38/exe 2020-04-22T14:17:15.649 INFO:teuthology.orchestra.run.smithi103.stdout:watchdog/ 39 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.649 INFO:teuthology.orchestra.run.smithi103.stdout:watchdog/ 39 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.649 INFO:teuthology.orchestra.run.smithi103.stdout:watchdog/ 39 root txt unknown /proc/39/exe 2020-04-22T14:17:15.650 INFO:teuthology.orchestra.run.smithi103.stdout:migration 40 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.650 INFO:teuthology.orchestra.run.smithi103.stdout:migration 40 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.650 INFO:teuthology.orchestra.run.smithi103.stdout:migration 40 root txt unknown /proc/40/exe 2020-04-22T14:17:15.650 INFO:teuthology.orchestra.run.smithi103.stdout:ksoftirqd 41 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.650 INFO:teuthology.orchestra.run.smithi103.stdout:ksoftirqd 41 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.650 INFO:teuthology.orchestra.run.smithi103.stdout:ksoftirqd 41 root txt unknown /proc/41/exe 2020-04-22T14:17:15.650 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/5 43 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.651 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/5 43 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.651 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/5 43 root txt unknown /proc/43/exe 2020-04-22T14:17:15.651 INFO:teuthology.orchestra.run.smithi103.stdout:cpuhp/6 44 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.651 INFO:teuthology.orchestra.run.smithi103.stdout:cpuhp/6 44 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.651 INFO:teuthology.orchestra.run.smithi103.stdout:cpuhp/6 44 root txt unknown /proc/44/exe 2020-04-22T14:17:15.651 INFO:teuthology.orchestra.run.smithi103.stdout:watchdog/ 45 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.651 INFO:teuthology.orchestra.run.smithi103.stdout:watchdog/ 45 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.651 INFO:teuthology.orchestra.run.smithi103.stdout:watchdog/ 45 root txt unknown /proc/45/exe 2020-04-22T14:17:15.652 INFO:teuthology.orchestra.run.smithi103.stdout:migration 46 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.652 INFO:teuthology.orchestra.run.smithi103.stdout:migration 46 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.652 INFO:teuthology.orchestra.run.smithi103.stdout:migration 46 root txt unknown /proc/46/exe 2020-04-22T14:17:15.652 INFO:teuthology.orchestra.run.smithi103.stdout:ksoftirqd 47 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.652 INFO:teuthology.orchestra.run.smithi103.stdout:ksoftirqd 47 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.652 INFO:teuthology.orchestra.run.smithi103.stdout:ksoftirqd 47 root txt unknown /proc/47/exe 2020-04-22T14:17:15.652 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/6 49 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.653 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/6 49 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.653 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/6 49 root txt unknown /proc/49/exe 2020-04-22T14:17:15.653 INFO:teuthology.orchestra.run.smithi103.stdout:cpuhp/7 50 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.653 INFO:teuthology.orchestra.run.smithi103.stdout:cpuhp/7 50 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.653 INFO:teuthology.orchestra.run.smithi103.stdout:cpuhp/7 50 root txt unknown /proc/50/exe 2020-04-22T14:17:15.653 INFO:teuthology.orchestra.run.smithi103.stdout:watchdog/ 51 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.653 INFO:teuthology.orchestra.run.smithi103.stdout:watchdog/ 51 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.653 INFO:teuthology.orchestra.run.smithi103.stdout:watchdog/ 51 root txt unknown /proc/51/exe 2020-04-22T14:17:15.654 INFO:teuthology.orchestra.run.smithi103.stdout:migration 52 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.654 INFO:teuthology.orchestra.run.smithi103.stdout:migration 52 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.654 INFO:teuthology.orchestra.run.smithi103.stdout:migration 52 root txt unknown /proc/52/exe 2020-04-22T14:17:15.654 INFO:teuthology.orchestra.run.smithi103.stdout:ksoftirqd 53 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.654 INFO:teuthology.orchestra.run.smithi103.stdout:ksoftirqd 53 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.654 INFO:teuthology.orchestra.run.smithi103.stdout:ksoftirqd 53 root txt unknown /proc/53/exe 2020-04-22T14:17:15.654 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/7 55 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.655 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/7 55 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.655 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/7 55 root txt unknown /proc/55/exe 2020-04-22T14:17:15.655 INFO:teuthology.orchestra.run.smithi103.stdout:kdevtmpfs 57 root cwd DIR 0,6 3320 1025 / 2020-04-22T14:17:15.655 INFO:teuthology.orchestra.run.smithi103.stdout:kdevtmpfs 57 root rtd DIR 0,6 3320 1025 / 2020-04-22T14:17:15.655 INFO:teuthology.orchestra.run.smithi103.stdout:kdevtmpfs 57 root txt unknown /proc/57/exe 2020-04-22T14:17:15.655 INFO:teuthology.orchestra.run.smithi103.stdout:netns 58 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.655 INFO:teuthology.orchestra.run.smithi103.stdout:netns 58 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.656 INFO:teuthology.orchestra.run.smithi103.stdout:netns 58 root txt unknown /proc/58/exe 2020-04-22T14:17:15.656 INFO:teuthology.orchestra.run.smithi103.stdout:kauditd 59 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.656 INFO:teuthology.orchestra.run.smithi103.stdout:kauditd 59 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.656 INFO:teuthology.orchestra.run.smithi103.stdout:kauditd 59 root txt unknown /proc/59/exe 2020-04-22T14:17:15.656 INFO:teuthology.orchestra.run.smithi103.stdout:khungtask 61 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.656 INFO:teuthology.orchestra.run.smithi103.stdout:khungtask 61 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.656 INFO:teuthology.orchestra.run.smithi103.stdout:khungtask 61 root txt unknown /proc/61/exe 2020-04-22T14:17:15.656 INFO:teuthology.orchestra.run.smithi103.stdout:oom_reape 62 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.657 INFO:teuthology.orchestra.run.smithi103.stdout:oom_reape 62 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.657 INFO:teuthology.orchestra.run.smithi103.stdout:oom_reape 62 root txt unknown /proc/62/exe 2020-04-22T14:17:15.657 INFO:teuthology.orchestra.run.smithi103.stdout:writeback 63 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.657 INFO:teuthology.orchestra.run.smithi103.stdout:writeback 63 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.657 INFO:teuthology.orchestra.run.smithi103.stdout:writeback 63 root txt unknown /proc/63/exe 2020-04-22T14:17:15.657 INFO:teuthology.orchestra.run.smithi103.stdout:kcompactd 64 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.657 INFO:teuthology.orchestra.run.smithi103.stdout:kcompactd 64 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.658 INFO:teuthology.orchestra.run.smithi103.stdout:kcompactd 64 root txt unknown /proc/64/exe 2020-04-22T14:17:15.658 INFO:teuthology.orchestra.run.smithi103.stdout:ksmd 65 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.658 INFO:teuthology.orchestra.run.smithi103.stdout:ksmd 65 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.658 INFO:teuthology.orchestra.run.smithi103.stdout:ksmd 65 root txt unknown /proc/65/exe 2020-04-22T14:17:15.658 INFO:teuthology.orchestra.run.smithi103.stdout:khugepage 66 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.658 INFO:teuthology.orchestra.run.smithi103.stdout:khugepage 66 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.659 INFO:teuthology.orchestra.run.smithi103.stdout:khugepage 66 root txt unknown /proc/66/exe 2020-04-22T14:17:15.659 INFO:teuthology.orchestra.run.smithi103.stdout:crypto 67 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.659 INFO:teuthology.orchestra.run.smithi103.stdout:crypto 67 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.659 INFO:teuthology.orchestra.run.smithi103.stdout:crypto 67 root txt unknown /proc/67/exe 2020-04-22T14:17:15.659 INFO:teuthology.orchestra.run.smithi103.stdout:kintegrit 68 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.659 INFO:teuthology.orchestra.run.smithi103.stdout:kintegrit 68 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.659 INFO:teuthology.orchestra.run.smithi103.stdout:kintegrit 68 root txt unknown /proc/68/exe 2020-04-22T14:17:15.660 INFO:teuthology.orchestra.run.smithi103.stdout:kblockd 69 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.660 INFO:teuthology.orchestra.run.smithi103.stdout:kblockd 69 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.660 INFO:teuthology.orchestra.run.smithi103.stdout:kblockd 69 root txt unknown /proc/69/exe 2020-04-22T14:17:15.660 INFO:teuthology.orchestra.run.smithi103.stdout:tpm_dev_w 72 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.660 INFO:teuthology.orchestra.run.smithi103.stdout:tpm_dev_w 72 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.660 INFO:teuthology.orchestra.run.smithi103.stdout:tpm_dev_w 72 root txt unknown /proc/72/exe 2020-04-22T14:17:15.660 INFO:teuthology.orchestra.run.smithi103.stdout:md 73 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.661 INFO:teuthology.orchestra.run.smithi103.stdout:md 73 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.661 INFO:teuthology.orchestra.run.smithi103.stdout:md 73 root txt unknown /proc/73/exe 2020-04-22T14:17:15.661 INFO:teuthology.orchestra.run.smithi103.stdout:edac-poll 74 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.661 INFO:teuthology.orchestra.run.smithi103.stdout:edac-poll 74 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.661 INFO:teuthology.orchestra.run.smithi103.stdout:edac-poll 74 root txt unknown /proc/74/exe 2020-04-22T14:17:15.661 INFO:teuthology.orchestra.run.smithi103.stdout:watchdogd 75 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.662 INFO:teuthology.orchestra.run.smithi103.stdout:watchdogd 75 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.662 INFO:teuthology.orchestra.run.smithi103.stdout:watchdogd 75 root txt unknown /proc/75/exe 2020-04-22T14:17:15.662 INFO:teuthology.orchestra.run.smithi103.stdout:kswapd0 102 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.662 INFO:teuthology.orchestra.run.smithi103.stdout:kswapd0 102 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.663 INFO:teuthology.orchestra.run.smithi103.stdout:kswapd0 102 root txt unknown /proc/102/exe 2020-04-22T14:17:15.663 INFO:teuthology.orchestra.run.smithi103.stdout:kthrotld 196 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.663 INFO:teuthology.orchestra.run.smithi103.stdout:kthrotld 196 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.663 INFO:teuthology.orchestra.run.smithi103.stdout:kthrotld 196 root txt unknown /proc/196/exe 2020-04-22T14:17:15.663 INFO:teuthology.orchestra.run.smithi103.stdout:acpi_ther 197 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.663 INFO:teuthology.orchestra.run.smithi103.stdout:acpi_ther 197 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.663 INFO:teuthology.orchestra.run.smithi103.stdout:acpi_ther 197 root txt unknown /proc/197/exe 2020-04-22T14:17:15.663 INFO:teuthology.orchestra.run.smithi103.stdout:kmpath_rd 198 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.664 INFO:teuthology.orchestra.run.smithi103.stdout:kmpath_rd 198 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.664 INFO:teuthology.orchestra.run.smithi103.stdout:kmpath_rd 198 root txt unknown /proc/198/exe 2020-04-22T14:17:15.664 INFO:teuthology.orchestra.run.smithi103.stdout:kaluad 199 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.664 INFO:teuthology.orchestra.run.smithi103.stdout:kaluad 199 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.664 INFO:teuthology.orchestra.run.smithi103.stdout:kaluad 199 root txt unknown /proc/199/exe 2020-04-22T14:17:15.664 INFO:teuthology.orchestra.run.smithi103.stdout:ipv6_addr 200 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.664 INFO:teuthology.orchestra.run.smithi103.stdout:ipv6_addr 200 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.665 INFO:teuthology.orchestra.run.smithi103.stdout:ipv6_addr 200 root txt unknown /proc/200/exe 2020-04-22T14:17:15.665 INFO:teuthology.orchestra.run.smithi103.stdout:kstrp 201 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.665 INFO:teuthology.orchestra.run.smithi103.stdout:kstrp 201 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.665 INFO:teuthology.orchestra.run.smithi103.stdout:kstrp 201 root txt unknown /proc/201/exe 2020-04-22T14:17:15.665 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/0 202 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.665 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/0 202 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.665 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/0 202 root txt unknown /proc/202/exe 2020-04-22T14:17:15.666 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/6 331 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.666 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/6 331 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.666 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/6 331 root txt unknown /proc/331/exe 2020-04-22T14:17:15.666 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/7 480 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.666 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/7 480 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.666 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/7 480 root txt unknown /proc/480/exe 2020-04-22T14:17:15.666 INFO:teuthology.orchestra.run.smithi103.stdout:nvme-wq 488 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.667 INFO:teuthology.orchestra.run.smithi103.stdout:nvme-wq 488 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.667 INFO:teuthology.orchestra.run.smithi103.stdout:nvme-wq 488 root txt unknown /proc/488/exe 2020-04-22T14:17:15.667 INFO:teuthology.orchestra.run.smithi103.stdout:ata_sff 489 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.667 INFO:teuthology.orchestra.run.smithi103.stdout:ata_sff 489 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.667 INFO:teuthology.orchestra.run.smithi103.stdout:ata_sff 489 root txt unknown /proc/489/exe 2020-04-22T14:17:15.667 INFO:teuthology.orchestra.run.smithi103.stdout:nvme-rese 490 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.667 INFO:teuthology.orchestra.run.smithi103.stdout:nvme-rese 490 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.668 INFO:teuthology.orchestra.run.smithi103.stdout:nvme-rese 490 root txt unknown /proc/490/exe 2020-04-22T14:17:15.668 INFO:teuthology.orchestra.run.smithi103.stdout:nvme-dele 491 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.668 INFO:teuthology.orchestra.run.smithi103.stdout:nvme-dele 491 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.668 INFO:teuthology.orchestra.run.smithi103.stdout:nvme-dele 491 root txt unknown /proc/491/exe 2020-04-22T14:17:15.668 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_eh_0 493 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.669 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_eh_0 493 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.669 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_eh_0 493 root txt unknown /proc/493/exe 2020-04-22T14:17:15.669 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_tmf_ 494 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.669 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_tmf_ 494 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.669 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_tmf_ 494 root txt unknown /proc/494/exe 2020-04-22T14:17:15.669 INFO:teuthology.orchestra.run.smithi103.stdout:ixgbe 495 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.669 INFO:teuthology.orchestra.run.smithi103.stdout:ixgbe 495 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.670 INFO:teuthology.orchestra.run.smithi103.stdout:ixgbe 495 root txt unknown /proc/495/exe 2020-04-22T14:17:15.670 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_eh_1 516 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.670 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_eh_1 516 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.670 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_eh_1 516 root txt unknown /proc/516/exe 2020-04-22T14:17:15.670 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_tmf_ 527 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.671 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_tmf_ 527 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.671 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_tmf_ 527 root txt unknown /proc/527/exe 2020-04-22T14:17:15.671 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_eh_2 529 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.671 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_eh_2 529 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.671 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_eh_2 529 root txt unknown /proc/529/exe 2020-04-22T14:17:15.671 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_tmf_ 543 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.671 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_tmf_ 543 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.672 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_tmf_ 543 root txt unknown /proc/543/exe 2020-04-22T14:17:15.672 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_eh_3 577 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.672 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_eh_3 577 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.672 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_eh_3 577 root txt unknown /proc/577/exe 2020-04-22T14:17:15.672 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_tmf_ 632 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.672 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_tmf_ 632 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.673 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_tmf_ 632 root txt unknown /proc/632/exe 2020-04-22T14:17:15.673 INFO:teuthology.orchestra.run.smithi103.stdout:ttm_swap 684 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.673 INFO:teuthology.orchestra.run.smithi103.stdout:ttm_swap 684 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.673 INFO:teuthology.orchestra.run.smithi103.stdout:ttm_swap 684 root txt unknown /proc/684/exe 2020-04-22T14:17:15.673 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_eh_4 1036 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.673 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_eh_4 1036 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.674 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_eh_4 1036 root txt unknown /proc/1036/exe 2020-04-22T14:17:15.674 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_tmf_ 1037 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.674 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_tmf_ 1037 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.674 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_tmf_ 1037 root txt unknown /proc/1037/exe 2020-04-22T14:17:15.674 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_eh_5 1044 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.674 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_eh_5 1044 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.674 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_eh_5 1044 root txt unknown /proc/1044/exe 2020-04-22T14:17:15.675 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_tmf_ 1046 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.675 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_tmf_ 1046 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.675 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_tmf_ 1046 root txt unknown /proc/1046/exe 2020-04-22T14:17:15.675 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_eh_6 1051 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.675 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_eh_6 1051 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.675 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_eh_6 1051 root txt unknown /proc/1051/exe 2020-04-22T14:17:15.676 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_tmf_ 1068 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.676 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_tmf_ 1068 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.676 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_tmf_ 1068 root txt unknown /proc/1068/exe 2020-04-22T14:17:15.676 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_eh_7 1072 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.676 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_eh_7 1072 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.677 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_eh_7 1072 root txt unknown /proc/1072/exe 2020-04-22T14:17:15.677 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_tmf_ 1130 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.677 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_tmf_ 1130 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.677 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_tmf_ 1130 root txt unknown /proc/1130/exe 2020-04-22T14:17:15.677 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_eh_8 1156 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.677 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_eh_8 1156 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.677 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_eh_8 1156 root txt unknown /proc/1156/exe 2020-04-22T14:17:15.677 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_tmf_ 1188 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.678 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_tmf_ 1188 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.678 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_tmf_ 1188 root txt unknown /proc/1188/exe 2020-04-22T14:17:15.678 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_eh_9 1193 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.678 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_eh_9 1193 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.678 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_eh_9 1193 root txt unknown /proc/1193/exe 2020-04-22T14:17:15.678 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_tmf_ 1211 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.678 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_tmf_ 1211 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.679 INFO:teuthology.orchestra.run.smithi103.stdout:scsi_tmf_ 1211 root txt unknown /proc/1211/exe 2020-04-22T14:17:15.679 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/u 1287 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.679 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/u 1287 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.679 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/u 1287 root txt unknown /proc/1287/exe 2020-04-22T14:17:15.679 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/1 1308 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.679 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/1 1308 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.679 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/1 1308 root txt unknown /proc/1308/exe 2020-04-22T14:17:15.679 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/2 1318 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.680 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/2 1318 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.680 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/2 1318 root txt unknown /proc/1318/exe 2020-04-22T14:17:15.680 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/7 1319 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.680 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/7 1319 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.680 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/7 1319 root txt unknown /proc/1319/exe 2020-04-22T14:17:15.680 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/0 1331 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.680 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/0 1331 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.681 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/0 1331 root txt unknown /proc/1331/exe 2020-04-22T14:17:15.681 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/6 1334 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.681 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/6 1334 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.681 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/6 1334 root txt unknown /proc/1334/exe 2020-04-22T14:17:15.681 INFO:teuthology.orchestra.run.smithi103.stdout:jbd2/sda1 1335 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.681 INFO:teuthology.orchestra.run.smithi103.stdout:jbd2/sda1 1335 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.682 INFO:teuthology.orchestra.run.smithi103.stdout:jbd2/sda1 1335 root txt unknown /proc/1335/exe 2020-04-22T14:17:15.682 INFO:teuthology.orchestra.run.smithi103.stdout:ext4-rsv- 1336 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.682 INFO:teuthology.orchestra.run.smithi103.stdout:ext4-rsv- 1336 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.682 INFO:teuthology.orchestra.run.smithi103.stdout:ext4-rsv- 1336 root txt unknown /proc/1336/exe 2020-04-22T14:17:15.682 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/3 1414 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.682 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/3 1414 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.682 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/3 1414 root txt unknown /proc/1414/exe 2020-04-22T14:17:15.682 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/4 1432 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.683 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/4 1432 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.683 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/4 1432 root txt unknown /proc/1432/exe 2020-04-22T14:17:15.683 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/5 1434 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.683 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/5 1434 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.683 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/5 1434 root txt unknown /proc/1434/exe 2020-04-22T14:17:15.683 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.683 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.684 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root txt REG 8,1 237384 6389 /usr/lib/systemd/systemd-journald 2020-04-22T14:17:15.684 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root mem REG 0,24 16777216 16469 /run/log/journal/6183c63c7b5745e8bb22efdfc11a90bd/system.journal 2020-04-22T14:17:15.684 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:15.684 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:15.684 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:15.684 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root mem REG 8,1 766120 3335 /usr/lib64/libsepol.so.1 2020-04-22T14:17:15.684 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root mem REG 8,1 1760264 3670 /usr/lib64/libunistring.so.2.1.0 2020-04-22T14:17:15.685 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root mem REG 8,1 356920 3798 /usr/lib64/libpcap.so.1.9.0 2020-04-22T14:17:15.685 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root mem REG 8,1 144392 3449 /usr/lib64/libgpg-error.so.0.24.2 2020-04-22T14:17:15.685 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root mem REG 8,1 70432 3726 /usr/lib64/libjson-c.so.4.0.0 2020-04-22T14:17:15.685 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:15.685 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:15.685 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root mem REG 8,1 443488 5581 /usr/lib64/libdevmapper.so.1.02 2020-04-22T14:17:15.685 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:15.685 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root mem REG 8,1 26192 3541 /usr/lib64/libattr.so.1.1.2448 2020-04-22T14:17:15.686 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:15.686 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:15.686 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:15.686 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:15.686 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:15.686 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:15.686 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root mem REG 8,1 162224 3672 /usr/lib64/libidn2.so.0.3.6 2020-04-22T14:17:15.687 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root mem REG 8,1 357336 4307 /usr/lib64/libseccomp.so.2.4.1 2020-04-22T14:17:15.687 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root mem REG 8,1 37824 3807 /usr/lib64/libip4tc.so.0.1.0 2020-04-22T14:17:15.687 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root mem REG 8,1 1385560 3654 /usr/lib64/libgcrypt.so.20.2.3 2020-04-22T14:17:15.687 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root mem REG 8,1 645024 5716 /usr/lib64/libcryptsetup.so.12.5.0 2020-04-22T14:17:15.687 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root mem REG 8,1 54816 3543 /usr/lib64/libacl.so.1.1.2253 2020-04-22T14:17:15.687 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:15.687 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:15.687 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:15.688 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:15.688 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:15.688 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:15.688 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root mem REG 8,1 5215944 6376 /usr/lib/systemd/libsystemd-shared-239.so 2020-04-22T14:17:15.688 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:15.688 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root mem REG 0,24 8 16449 /run/systemd/journal/kernel-seqnum 2020-04-22T14:17:15.688 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.689 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root 1w CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.689 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root 2w CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.689 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root 3u unix 0x000000007d47dc8f 0t0 12581 /run/systemd/journal/stdout type=STREAM 2020-04-22T14:17:15.689 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root 4u unix 0x00000000c481d764 0t0 12584 /run/systemd/journal/socket type=DGRAM 2020-04-22T14:17:15.689 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root 5u unix 0x00000000c565bff1 0t0 12576 /run/systemd/journal/dev-log type=DGRAM 2020-04-22T14:17:15.689 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root 6w CHR 1,11 0t0 1034 /dev/kmsg 2020-04-22T14:17:15.689 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root 7u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:15.690 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root 8u CHR 1,11 0t0 1034 /dev/kmsg 2020-04-22T14:17:15.690 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root 9r REG 0,4 0 16450 /proc/sys/kernel/hostname 2020-04-22T14:17:15.690 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root 10u a_inode 0,14 0 2063 [signalfd] 2020-04-22T14:17:15.690 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root 11u a_inode 0,14 0 2063 [signalfd] 2020-04-22T14:17:15.690 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root 12u a_inode 0,14 0 2063 [signalfd] 2020-04-22T14:17:15.690 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root 13u unix 0x00000000a51f0594 0t0 20347 type=DGRAM 2020-04-22T14:17:15.690 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root 14u a_inode 0,14 0 2063 [timerfd] 2020-04-22T14:17:15.691 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root 15u REG 0,24 16777216 16469 /run/log/journal/6183c63c7b5745e8bb22efdfc11a90bd/system.journal 2020-04-22T14:17:15.691 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root 16u unix 0x000000003094e2c3 0t0 112004 /run/systemd/journal/stdout type=STREAM 2020-04-22T14:17:15.691 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root 17u unix 0x00000000a850cb83 0t0 22692 /run/systemd/journal/stdout type=STREAM 2020-04-22T14:17:15.691 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root 18u unix 0x0000000075518791 0t0 21188 /run/systemd/journal/stdout type=STREAM 2020-04-22T14:17:15.691 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root 19u unix 0x0000000047223826 0t0 25962 /run/systemd/journal/stdout type=STREAM 2020-04-22T14:17:15.691 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root 20u unix 0x00000000cf66c9f1 0t0 21190 /run/systemd/journal/stdout type=STREAM 2020-04-22T14:17:15.692 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root 21u unix 0x000000006e1d0885 0t0 21192 /run/systemd/journal/stdout type=STREAM 2020-04-22T14:17:15.692 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root 22u unix 0x00000000c999b29c 0t0 35350 /run/systemd/journal/stdout type=STREAM 2020-04-22T14:17:15.692 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root 23u unix 0x000000003c347321 0t0 21196 /run/systemd/journal/stdout type=STREAM 2020-04-22T14:17:15.692 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root 24u unix 0x00000000a19d1c44 0t0 21198 /run/systemd/journal/stdout type=STREAM 2020-04-22T14:17:15.692 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root 27u unix 0x000000001503a0fb 0t0 26886 /run/systemd/journal/stdout type=STREAM 2020-04-22T14:17:15.693 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root 28u unix 0x00000000c4ef0b99 0t0 26888 /run/systemd/journal/stdout type=STREAM 2020-04-22T14:17:15.693 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root 29u unix 0x0000000096da5832 0t0 27937 /run/systemd/journal/stdout type=STREAM 2020-04-22T14:17:15.693 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root 30u unix 0x000000001a4ae2ac 0t0 21270 /run/systemd/journal/stdout type=STREAM 2020-04-22T14:17:15.693 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root 31u unix 0x0000000048a2aef6 0t0 28819 /run/systemd/journal/stdout type=STREAM 2020-04-22T14:17:15.693 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root 32u unix 0x0000000048c2c25c 0t0 25483 /run/systemd/journal/stdout type=STREAM 2020-04-22T14:17:15.693 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root 33u unix 0x00000000955d739e 0t0 26953 /run/systemd/journal/stdout type=STREAM 2020-04-22T14:17:15.693 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root 34u unix 0x000000000b836367 0t0 24456 /run/systemd/journal/stdout type=STREAM 2020-04-22T14:17:15.693 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-j 1438 root 36u unix 0x00000000f061df62 0t0 27013 /run/systemd/journal/stdout type=STREAM 2020-04-22T14:17:15.694 INFO:teuthology.orchestra.run.smithi103.stdout:ext4lazyi 1453 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.694 INFO:teuthology.orchestra.run.smithi103.stdout:ext4lazyi 1453 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.694 INFO:teuthology.orchestra.run.smithi103.stdout:ext4lazyi 1453 root txt unknown /proc/1453/exe 2020-04-22T14:17:15.694 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.694 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.694 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root txt REG 8,1 569392 6578 /usr/lib/systemd/systemd-udevd 2020-04-22T14:17:15.694 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:15.695 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:15.695 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:15.695 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 494618 55724 /usr/lib/modules/4.18.0-147.8.1.el8_1.x86_64/modules.symbols.bin 2020-04-22T14:17:15.695 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 813918 55731 /usr/lib/modules/4.18.0-147.8.1.el8_1.x86_64/modules.alias.bin 2020-04-22T14:17:15.695 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 9143418 67731 /etc/udev/hwdb.bin 2020-04-22T14:17:15.695 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:15.695 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:15.695 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 766120 3335 /usr/lib64/libsepol.so.1 2020-04-22T14:17:15.696 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 1760264 3670 /usr/lib64/libunistring.so.2.1.0 2020-04-22T14:17:15.696 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:15.696 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 356920 3798 /usr/lib64/libpcap.so.1.9.0 2020-04-22T14:17:15.696 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:15.696 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 144392 3449 /usr/lib64/libgpg-error.so.0.24.2 2020-04-22T14:17:15.696 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 70432 3726 /usr/lib64/libjson-c.so.4.0.0 2020-04-22T14:17:15.696 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 443488 5581 /usr/lib64/libdevmapper.so.1.02 2020-04-22T14:17:15.697 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:15.697 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 26192 3541 /usr/lib64/libattr.so.1.1.2448 2020-04-22T14:17:15.697 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:15.697 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:15.697 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:15.697 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:15.697 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:15.698 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:15.698 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 162224 3672 /usr/lib64/libidn2.so.0.3.6 2020-04-22T14:17:15.698 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:15.698 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 357336 4307 /usr/lib64/libseccomp.so.2.4.1 2020-04-22T14:17:15.698 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 37824 3807 /usr/lib64/libip4tc.so.0.1.0 2020-04-22T14:17:15.699 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 1385560 3654 /usr/lib64/libgcrypt.so.20.2.3 2020-04-22T14:17:15.699 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 645024 5716 /usr/lib64/libcryptsetup.so.12.5.0 2020-04-22T14:17:15.699 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:15.699 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:15.699 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:15.699 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:15.699 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:15.700 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:15.700 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 54816 3543 /usr/lib64/libacl.so.1.1.2253 2020-04-22T14:17:15.700 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 228128 5610 /usr/lib64/libkmod.so.2.3.3 2020-04-22T14:17:15.700 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 5215944 6376 /usr/lib/systemd/libsystemd-shared-239.so 2020-04-22T14:17:15.700 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:15.700 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 386173 52976 /usr/lib/modules/4.18.0-147.8.1.el8_1.x86_64/modules.dep.bin 2020-04-22T14:17:15.700 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root DEL REG 8,1 64856 /etc/selinux/targeted/contexts/files/file_contexts.bin 2020-04-22T14:17:15.701 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root mem REG 8,1 9748 55725 /usr/lib/modules/4.18.0-147.8.1.el8_1.x86_64/modules.builtin.bin 2020-04-22T14:17:15.701 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root DEL REG 8,1 64857 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2020-04-22T14:17:15.701 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.701 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root 1u unix 0x0000000065578e5c 0t0 21784 type=STREAM 2020-04-22T14:17:15.701 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root 2u unix 0x0000000065578e5c 0t0 21784 type=STREAM 2020-04-22T14:17:15.701 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root 3u netlink 0t0 18384 KOBJECT_UEVENT 2020-04-22T14:17:15.702 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root 4u unix 0x000000009bb9827c 0t0 18268 /run/udev/control type=SEQPACKET 2020-04-22T14:17:15.702 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root 5u unix 0x00000000a43bfe43 0t0 21790 type=DGRAM 2020-04-22T14:17:15.702 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root 6r REG 8,1 9143418 67731 /etc/udev/hwdb.bin 2020-04-22T14:17:15.702 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root 7u unix 0x00000000b7309618 0t0 21806 type=DGRAM 2020-04-22T14:17:15.702 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root 8u unix 0x00000000724832a8 0t0 122377 type=STREAM 2020-04-22T14:17:15.702 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root 9u unix 0x000000006e683202 0t0 21807 type=DGRAM 2020-04-22T14:17:15.702 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root 10r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:15.702 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:15.703 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root 12u a_inode 0,14 0 2063 [signalfd] 2020-04-22T14:17:15.703 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root 13u a_inode 0,14 0 2063 [timerfd] 2020-04-22T14:17:15.703 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root 14u a_inode 0,14 0 2063 [timerfd] 2020-04-22T14:17:15.703 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-u 1476 root 16r REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:15.703 INFO:teuthology.orchestra.run.smithi103.stdout:kipmi0 1507 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.703 INFO:teuthology.orchestra.run.smithi103.stdout:kipmi0 1507 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.703 INFO:teuthology.orchestra.run.smithi103.stdout:kipmi0 1507 root txt unknown /proc/1507/exe 2020-04-22T14:17:15.704 INFO:teuthology.orchestra.run.smithi103.stdout:rpcbind 2373 rpc cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.704 INFO:teuthology.orchestra.run.smithi103.stdout:rpcbind 2373 rpc rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.704 INFO:teuthology.orchestra.run.smithi103.stdout:rpcbind 2373 rpc txt REG 8,1 91936 2987 /usr/bin/rpcbind 2020-04-22T14:17:15.704 INFO:teuthology.orchestra.run.smithi103.stdout:rpcbind 2373 rpc mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:15.704 INFO:teuthology.orchestra.run.smithi103.stdout:rpcbind 2373 rpc mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:15.704 INFO:teuthology.orchestra.run.smithi103.stdout:rpcbind 2373 rpc mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:15.704 INFO:teuthology.orchestra.run.smithi103.stdout:rpcbind 2373 rpc mem REG 8,1 144392 3449 /usr/lib64/libgpg-error.so.0.24.2 2020-04-22T14:17:15.704 INFO:teuthology.orchestra.run.smithi103.stdout:rpcbind 2373 rpc mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:15.705 INFO:teuthology.orchestra.run.smithi103.stdout:rpcbind 2373 rpc mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:15.705 INFO:teuthology.orchestra.run.smithi103.stdout:rpcbind 2373 rpc mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:15.705 INFO:teuthology.orchestra.run.smithi103.stdout:rpcbind 2373 rpc mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:15.705 INFO:teuthology.orchestra.run.smithi103.stdout:rpcbind 2373 rpc mem REG 8,1 16240 3641 /usr/lib64/libkeyutils.so.1.6 2020-04-22T14:17:15.705 INFO:teuthology.orchestra.run.smithi103.stdout:rpcbind 2373 rpc mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:15.705 INFO:teuthology.orchestra.run.smithi103.stdout:rpcbind 2373 rpc mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:15.705 INFO:teuthology.orchestra.run.smithi103.stdout:rpcbind 2373 rpc mem REG 8,1 118728 5304 /usr/lib64/libkrb5support.so.0.1 2020-04-22T14:17:15.706 INFO:teuthology.orchestra.run.smithi103.stdout:rpcbind 2373 rpc mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:15.706 INFO:teuthology.orchestra.run.smithi103.stdout:rpcbind 2373 rpc mem REG 8,1 1385560 3654 /usr/lib64/libgcrypt.so.20.2.3 2020-04-22T14:17:15.706 INFO:teuthology.orchestra.run.smithi103.stdout:rpcbind 2373 rpc mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:15.706 INFO:teuthology.orchestra.run.smithi103.stdout:rpcbind 2373 rpc mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:15.706 INFO:teuthology.orchestra.run.smithi103.stdout:rpcbind 2373 rpc mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:15.706 INFO:teuthology.orchestra.run.smithi103.stdout:rpcbind 2373 rpc mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:15.706 INFO:teuthology.orchestra.run.smithi103.stdout:rpcbind 2373 rpc mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:15.706 INFO:teuthology.orchestra.run.smithi103.stdout:rpcbind 2373 rpc mem REG 8,1 25992 3339 /usr/lib64/libcom_err.so.2.1 2020-04-22T14:17:15.707 INFO:teuthology.orchestra.run.smithi103.stdout:rpcbind 2373 rpc mem REG 8,1 273488 5296 /usr/lib64/libk5crypto.so.3.1 2020-04-22T14:17:15.707 INFO:teuthology.orchestra.run.smithi103.stdout:rpcbind 2373 rpc mem REG 8,1 1507952 5302 /usr/lib64/libkrb5.so.3.3 2020-04-22T14:17:15.707 INFO:teuthology.orchestra.run.smithi103.stdout:rpcbind 2373 rpc mem REG 8,1 603768 5292 /usr/lib64/libgssapi_krb5.so.2.2 2020-04-22T14:17:15.707 INFO:teuthology.orchestra.run.smithi103.stdout:rpcbind 2373 rpc mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:15.707 INFO:teuthology.orchestra.run.smithi103.stdout:rpcbind 2373 rpc mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:15.707 INFO:teuthology.orchestra.run.smithi103.stdout:rpcbind 2373 rpc mem REG 8,1 1637336 5512 /usr/lib64/libsystemd.so.0.23.0 2020-04-22T14:17:15.708 INFO:teuthology.orchestra.run.smithi103.stdout:rpcbind 2373 rpc mem REG 8,1 371032 5313 /usr/lib64/libtirpc.so.3.0.0 2020-04-22T14:17:15.708 INFO:teuthology.orchestra.run.smithi103.stdout:rpcbind 2373 rpc mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:15.708 INFO:teuthology.orchestra.run.smithi103.stdout:rpcbind 2373 rpc 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.708 INFO:teuthology.orchestra.run.smithi103.stdout:rpcbind 2373 rpc 1u unix 0x00000000b69dbd47 0t0 24991 type=STREAM 2020-04-22T14:17:15.708 INFO:teuthology.orchestra.run.smithi103.stdout:rpcbind 2373 rpc 2u unix 0x00000000b69dbd47 0t0 24991 type=STREAM 2020-04-22T14:17:15.708 INFO:teuthology.orchestra.run.smithi103.stdout:rpcbind 2373 rpc 3u unix 0x00000000858b49da 0t0 18372 /run/rpcbind.sock type=STREAM 2020-04-22T14:17:15.708 INFO:teuthology.orchestra.run.smithi103.stdout:rpcbind 2373 rpc 4u IPv4 18375 0t0 TCP *:sunrpc (LISTEN) 2020-04-22T14:17:15.708 INFO:teuthology.orchestra.run.smithi103.stdout:rpcbind 2373 rpc 5u IPv4 18376 0t0 UDP *:sunrpc 2020-04-22T14:17:15.709 INFO:teuthology.orchestra.run.smithi103.stdout:rpcbind 2373 rpc 6u IPv6 18377 0t0 TCP *:sunrpc (LISTEN) 2020-04-22T14:17:15.709 INFO:teuthology.orchestra.run.smithi103.stdout:rpcbind 2373 rpc 7u IPv6 18378 0t0 UDP *:sunrpc 2020-04-22T14:17:15.709 INFO:teuthology.orchestra.run.smithi103.stdout:rpcbind 2373 rpc 8rW REG 0,24 0 24992 /run/rpcbind/rpcbind.lock 2020-04-22T14:17:15.709 INFO:teuthology.orchestra.run.smithi103.stdout:rpcbind 2373 rpc 9u sock 0,9 0t0 24999 protocol: UDPv6 2020-04-22T14:17:15.709 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.709 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.709 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 root txt REG 8,1 200760 7420 /usr/sbin/auditd 2020-04-22T14:17:15.709 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 root DEL REG 8,1 67774 /var/lib/sss/mc/passwd 2020-04-22T14:17:15.710 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 root mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:15.710 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 root DEL REG 8,1 66229 /var/lib/sss/mc/group 2020-04-22T14:17:15.710 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 root mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:15.710 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:15.710 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:15.710 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:15.710 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:15.710 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 root mem REG 8,1 16240 3641 /usr/lib64/libkeyutils.so.1.6 2020-04-22T14:17:15.711 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:15.711 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:15.711 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 root mem REG 8,1 118728 5304 /usr/lib64/libkrb5support.so.0.1 2020-04-22T14:17:15.711 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 root mem REG 8,1 25992 3339 /usr/lib64/libcom_err.so.2.1 2020-04-22T14:17:15.711 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 root mem REG 8,1 273488 5296 /usr/lib64/libk5crypto.so.3.1 2020-04-22T14:17:15.711 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:15.711 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:15.712 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 root mem REG 8,1 1507952 5302 /usr/lib64/libkrb5.so.3.3 2020-04-22T14:17:15.712 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 root mem REG 8,1 603768 5292 /usr/lib64/libgssapi_krb5.so.2.2 2020-04-22T14:17:15.712 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:15.712 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:15.712 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 root mem REG 8,1 25192 3584 /usr/lib64/libcap-ng.so.0.0.0 2020-04-22T14:17:15.712 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 root mem REG 8,1 141392 3586 /usr/lib64/libaudit.so.1.0.0 2020-04-22T14:17:15.712 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 root mem REG 8,1 168280 3588 /usr/lib64/libauparse.so.0.0.0 2020-04-22T14:17:15.712 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:15.713 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 root 0u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.713 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 root 1u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.713 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 root 2u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.713 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 root 3u netlink 0t0 25966 AUDIT 2020-04-22T14:17:15.713 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 root 4u unix 0x00000000055ae6e1 0t0 106056 type=STREAM 2020-04-22T14:17:15.713 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 root 5r REG 8,1 8406312 67774 /var/lib/sss/mc/passwd (deleted) 2020-04-22T14:17:15.713 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 root 6w REG 8,1 6809889 67754 /var/log/audit/audit.log 2020-04-22T14:17:15.714 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 root 7u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:15.714 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 root 8u unix 0x000000006ca451a8 0t0 25970 type=DGRAM 2020-04-22T14:17:15.714 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 root 9u unix 0x000000004d067474 0t0 25969 type=STREAM 2020-04-22T14:17:15.714 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 root 10u unix 0x00000000f0f96a28 0t0 25971 type=STREAM 2020-04-22T14:17:15.714 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 root 11u unix 0x000000008df47ad3 0t0 25972 type=STREAM 2020-04-22T14:17:15.714 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 root 12u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.714 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 root 13r REG 8,1 6406312 66229 /var/lib/sss/mc/group (deleted) 2020-04-22T14:17:15.714 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2377 auditd root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.715 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2377 auditd root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.715 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2377 auditd root txt REG 8,1 200760 7420 /usr/sbin/auditd 2020-04-22T14:17:15.715 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2377 auditd root DEL REG 8,1 67774 /var/lib/sss/mc/passwd 2020-04-22T14:17:15.715 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2377 auditd root mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:15.715 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2377 auditd root DEL REG 8,1 66229 /var/lib/sss/mc/group 2020-04-22T14:17:15.715 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2377 auditd root mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:15.716 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2377 auditd root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:15.716 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2377 auditd root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:15.716 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2377 auditd root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:15.716 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2377 auditd root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:15.716 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2377 auditd root mem REG 8,1 16240 3641 /usr/lib64/libkeyutils.so.1.6 2020-04-22T14:17:15.716 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2377 auditd root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:15.717 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2377 auditd root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:15.717 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2377 auditd root mem REG 8,1 118728 5304 /usr/lib64/libkrb5support.so.0.1 2020-04-22T14:17:15.717 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2377 auditd root mem REG 8,1 25992 3339 /usr/lib64/libcom_err.so.2.1 2020-04-22T14:17:15.717 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2377 auditd root mem REG 8,1 273488 5296 /usr/lib64/libk5crypto.so.3.1 2020-04-22T14:17:15.717 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2377 auditd root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:15.717 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2377 auditd root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:15.718 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2377 auditd root mem REG 8,1 1507952 5302 /usr/lib64/libkrb5.so.3.3 2020-04-22T14:17:15.718 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2377 auditd root mem REG 8,1 603768 5292 /usr/lib64/libgssapi_krb5.so.2.2 2020-04-22T14:17:15.718 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2377 auditd root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:15.718 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2377 auditd root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:15.718 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2377 auditd root mem REG 8,1 25192 3584 /usr/lib64/libcap-ng.so.0.0.0 2020-04-22T14:17:15.718 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2377 auditd root mem REG 8,1 141392 3586 /usr/lib64/libaudit.so.1.0.0 2020-04-22T14:17:15.718 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2377 auditd root mem REG 8,1 168280 3588 /usr/lib64/libauparse.so.0.0.0 2020-04-22T14:17:15.719 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2377 auditd root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:15.719 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2377 auditd root 0u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.719 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2377 auditd root 1u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.719 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2377 auditd root 2u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.719 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2377 auditd root 3u netlink 0t0 25966 AUDIT 2020-04-22T14:17:15.719 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2377 auditd root 4u unix 0x00000000055ae6e1 0t0 106056 type=STREAM 2020-04-22T14:17:15.719 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2377 auditd root 5r REG 8,1 8406312 67774 /var/lib/sss/mc/passwd (deleted) 2020-04-22T14:17:15.719 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2377 auditd root 6w REG 8,1 6809889 67754 /var/log/audit/audit.log 2020-04-22T14:17:15.720 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2377 auditd root 7u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:15.720 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2377 auditd root 8u unix 0x000000006ca451a8 0t0 25970 type=DGRAM 2020-04-22T14:17:15.720 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2377 auditd root 9u unix 0x000000004d067474 0t0 25969 type=STREAM 2020-04-22T14:17:15.720 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2377 auditd root 10u unix 0x00000000f0f96a28 0t0 25971 type=STREAM 2020-04-22T14:17:15.720 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2377 auditd root 11u unix 0x000000008df47ad3 0t0 25972 type=STREAM 2020-04-22T14:17:15.720 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2377 auditd root 12u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.720 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2377 auditd root 13r REG 8,1 6406312 66229 /var/lib/sss/mc/group (deleted) 2020-04-22T14:17:15.721 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2379 auditd root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.721 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2379 auditd root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.721 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2379 auditd root txt REG 8,1 200760 7420 /usr/sbin/auditd 2020-04-22T14:17:15.721 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2379 auditd root DEL REG 8,1 67774 /var/lib/sss/mc/passwd 2020-04-22T14:17:15.721 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2379 auditd root mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:15.721 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2379 auditd root DEL REG 8,1 66229 /var/lib/sss/mc/group 2020-04-22T14:17:15.721 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2379 auditd root mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:15.721 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2379 auditd root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:15.722 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2379 auditd root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:15.722 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2379 auditd root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:15.722 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2379 auditd root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:15.722 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2379 auditd root mem REG 8,1 16240 3641 /usr/lib64/libkeyutils.so.1.6 2020-04-22T14:17:15.722 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2379 auditd root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:15.722 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2379 auditd root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:15.723 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2379 auditd root mem REG 8,1 118728 5304 /usr/lib64/libkrb5support.so.0.1 2020-04-22T14:17:15.723 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2379 auditd root mem REG 8,1 25992 3339 /usr/lib64/libcom_err.so.2.1 2020-04-22T14:17:15.723 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2379 auditd root mem REG 8,1 273488 5296 /usr/lib64/libk5crypto.so.3.1 2020-04-22T14:17:15.723 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2379 auditd root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:15.723 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2379 auditd root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:15.723 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2379 auditd root mem REG 8,1 1507952 5302 /usr/lib64/libkrb5.so.3.3 2020-04-22T14:17:15.724 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2379 auditd root mem REG 8,1 603768 5292 /usr/lib64/libgssapi_krb5.so.2.2 2020-04-22T14:17:15.724 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2379 auditd root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:15.724 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2379 auditd root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:15.724 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2379 auditd root mem REG 8,1 25192 3584 /usr/lib64/libcap-ng.so.0.0.0 2020-04-22T14:17:15.724 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2379 auditd root mem REG 8,1 141392 3586 /usr/lib64/libaudit.so.1.0.0 2020-04-22T14:17:15.724 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2379 auditd root mem REG 8,1 168280 3588 /usr/lib64/libauparse.so.0.0.0 2020-04-22T14:17:15.724 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2379 auditd root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:15.725 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2379 auditd root 0u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.725 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2379 auditd root 1u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.725 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2379 auditd root 2u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.725 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2379 auditd root 3u netlink 0t0 25966 AUDIT 2020-04-22T14:17:15.725 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2379 auditd root 4u unix 0x00000000055ae6e1 0t0 106056 type=STREAM 2020-04-22T14:17:15.725 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2379 auditd root 5r REG 8,1 8406312 67774 /var/lib/sss/mc/passwd (deleted) 2020-04-22T14:17:15.726 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2379 auditd root 6w REG 8,1 6809889 67754 /var/log/audit/audit.log 2020-04-22T14:17:15.726 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2379 auditd root 7u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:15.726 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2379 auditd root 8u unix 0x000000006ca451a8 0t0 25970 type=DGRAM 2020-04-22T14:17:15.726 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2379 auditd root 9u unix 0x000000004d067474 0t0 25969 type=STREAM 2020-04-22T14:17:15.726 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2379 auditd root 10u unix 0x00000000f0f96a28 0t0 25971 type=STREAM 2020-04-22T14:17:15.726 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2379 auditd root 11u unix 0x000000008df47ad3 0t0 25972 type=STREAM 2020-04-22T14:17:15.726 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2379 auditd root 12u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.727 INFO:teuthology.orchestra.run.smithi103.stdout:auditd 2376 2379 auditd root 13r REG 8,1 6406312 66229 /var/lib/sss/mc/group (deleted) 2020-04-22T14:17:15.727 INFO:teuthology.orchestra.run.smithi103.stdout:sedispatc 2378 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.727 INFO:teuthology.orchestra.run.smithi103.stdout:sedispatc 2378 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.727 INFO:teuthology.orchestra.run.smithi103.stdout:sedispatc 2378 root txt REG 8,1 28544 8254 /usr/sbin/sedispatch 2020-04-22T14:17:15.727 INFO:teuthology.orchestra.run.smithi103.stdout:sedispatc 2378 root mem REG 8,1 144392 3449 /usr/lib64/libgpg-error.so.0.24.2 2020-04-22T14:17:15.727 INFO:teuthology.orchestra.run.smithi103.stdout:sedispatc 2378 root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:15.728 INFO:teuthology.orchestra.run.smithi103.stdout:sedispatc 2378 root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:15.728 INFO:teuthology.orchestra.run.smithi103.stdout:sedispatc 2378 root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:15.728 INFO:teuthology.orchestra.run.smithi103.stdout:sedispatc 2378 root mem REG 8,1 1385560 3654 /usr/lib64/libgcrypt.so.20.2.3 2020-04-22T14:17:15.728 INFO:teuthology.orchestra.run.smithi103.stdout:sedispatc 2378 root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:15.728 INFO:teuthology.orchestra.run.smithi103.stdout:sedispatc 2378 root mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:15.729 INFO:teuthology.orchestra.run.smithi103.stdout:sedispatc 2378 root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:15.729 INFO:teuthology.orchestra.run.smithi103.stdout:sedispatc 2378 root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:15.729 INFO:teuthology.orchestra.run.smithi103.stdout:sedispatc 2378 root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:15.729 INFO:teuthology.orchestra.run.smithi103.stdout:sedispatc 2378 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:15.729 INFO:teuthology.orchestra.run.smithi103.stdout:sedispatc 2378 root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:15.729 INFO:teuthology.orchestra.run.smithi103.stdout:sedispatc 2378 root mem REG 8,1 141392 3586 /usr/lib64/libaudit.so.1.0.0 2020-04-22T14:17:15.729 INFO:teuthology.orchestra.run.smithi103.stdout:sedispatc 2378 root mem REG 8,1 1637336 5512 /usr/lib64/libsystemd.so.0.23.0 2020-04-22T14:17:15.729 INFO:teuthology.orchestra.run.smithi103.stdout:sedispatc 2378 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:15.730 INFO:teuthology.orchestra.run.smithi103.stdout:sedispatc 2378 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:15.730 INFO:teuthology.orchestra.run.smithi103.stdout:sedispatc 2378 root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:15.730 INFO:teuthology.orchestra.run.smithi103.stdout:sedispatc 2378 root mem REG 8,1 168280 3588 /usr/lib64/libauparse.so.0.0.0 2020-04-22T14:17:15.730 INFO:teuthology.orchestra.run.smithi103.stdout:sedispatc 2378 root mem REG 8,1 505672 5398 /usr/lib64/libdbus-1.so.3.19.7 2020-04-22T14:17:15.730 INFO:teuthology.orchestra.run.smithi103.stdout:sedispatc 2378 root mem REG 8,1 25192 3584 /usr/lib64/libcap-ng.so.0.0.0 2020-04-22T14:17:15.730 INFO:teuthology.orchestra.run.smithi103.stdout:sedispatc 2378 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:15.730 INFO:teuthology.orchestra.run.smithi103.stdout:sedispatc 2378 root 0u unix 0x00000000eff88777 0t0 25968 type=STREAM 2020-04-22T14:17:15.731 INFO:teuthology.orchestra.run.smithi103.stdout:sedispatc 2378 root 1u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.731 INFO:teuthology.orchestra.run.smithi103.stdout:sedispatc 2378 root 2u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.731 INFO:teuthology.orchestra.run.smithi103.stdout:sedispatc 2378 root 3u unix 0x00000000d81a51eb 0t0 35722 type=STREAM 2020-04-22T14:17:15.731 INFO:teuthology.orchestra.run.smithi103.stdout:sedispatc 2378 root 4u unix 0x00000000ed47e58e 0t0 33571 type=DGRAM 2020-04-22T14:17:15.731 INFO:teuthology.orchestra.run.smithi103.stdout:rpciod 2380 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.731 INFO:teuthology.orchestra.run.smithi103.stdout:rpciod 2380 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.731 INFO:teuthology.orchestra.run.smithi103.stdout:rpciod 2380 root txt unknown /proc/2380/exe 2020-04-22T14:17:15.732 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/u 2381 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.732 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/u 2381 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.732 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/u 2381 root txt unknown /proc/2381/exe 2020-04-22T14:17:15.732 INFO:teuthology.orchestra.run.smithi103.stdout:xprtiod 2382 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.732 INFO:teuthology.orchestra.run.smithi103.stdout:xprtiod 2382 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.732 INFO:teuthology.orchestra.run.smithi103.stdout:xprtiod 2382 root txt unknown /proc/2382/exe 2020-04-22T14:17:15.732 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.733 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.733 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd txt REG 8,1 166792 41929 /usr/lib/polkit-1/polkitd 2020-04-22T14:17:15.733 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:15.733 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 860880 5511 /usr/lib64/libnss_systemd.so.2 2020-04-22T14:17:15.733 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:15.733 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:15.734 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:15.734 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:15.734 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 144392 3449 /usr/lib64/libgpg-error.so.0.24.2 2020-04-22T14:17:15.734 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:15.734 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:15.734 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:15.734 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 1503456 3656 /usr/lib64/libgmp.so.10.3.2 2020-04-22T14:17:15.735 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 248080 3819 /usr/lib64/libhogweed.so.4.5 2020-04-22T14:17:15.735 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 299920 3821 /usr/lib64/libnettle.so.6.5 2020-04-22T14:17:15.735 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 81408 3851 /usr/lib64/libtasn1.so.6.5.5 2020-04-22T14:17:15.735 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 1760264 3670 /usr/lib64/libunistring.so.2.1.0 2020-04-22T14:17:15.735 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 162224 3672 /usr/lib64/libidn2.so.0.3.6 2020-04-22T14:17:15.735 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 1295528 3648 /usr/lib64/libp11-kit.so.0.3.0 2020-04-22T14:17:15.735 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:15.736 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 1385560 3654 /usr/lib64/libgcrypt.so.20.2.3 2020-04-22T14:17:15.736 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:15.736 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:15.736 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:15.736 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:15.736 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:15.736 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:15.736 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:15.737 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:15.737 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 471224 3494 /usr/lib64/libpcre.so.1.2.10 2020-04-22T14:17:15.737 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 2521184 6329 /usr/lib64/libgnutls.so.30.24.0 2020-04-22T14:17:15.737 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:15.737 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:15.737 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 18224 6263 /usr/lib64/libgmodule-2.0.so.0.5600.4 2020-04-22T14:17:15.737 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:15.738 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:15.738 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:15.738 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:15.738 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 36978800 4577 /usr/lib64/libmozjs-60.so.0.0.0 2020-04-22T14:17:15.738 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 244736 3491 /usr/lib64/libexpat.so.1.6.7 2020-04-22T14:17:15.738 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 1637336 5512 /usr/lib64/libsystemd.so.0.23.0 2020-04-22T14:17:15.739 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 1471440 6261 /usr/lib64/libglib-2.0.so.0.5600.4 2020-04-22T14:17:15.739 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 435432 6265 /usr/lib64/libgobject-2.0.so.0.5600.4 2020-04-22T14:17:15.739 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 2508264 6259 /usr/lib64/libgio-2.0.so.0.5600.4 2020-04-22T14:17:15.739 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 180576 6656 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2020-04-22T14:17:15.739 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:15.739 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:15.740 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd 0u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.740 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd 1u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.740 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd 2u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.740 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd 3u unix 0x00000000ca06bdb4 0t0 295708 type=STREAM 2020-04-22T14:17:15.740 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd 4r REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:15.740 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd 5r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:15.740 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd 6u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.741 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd 7u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.741 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd 8u unix 0x000000007644287f 0t0 26376 type=STREAM 2020-04-22T14:17:15.741 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd 9u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.741 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd 10r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:15.741 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd 11u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.741 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd 12u unix 0x00000000689b70f8 0t0 28723 type=DGRAM 2020-04-22T14:17:15.741 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd 13r REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:15.741 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 polkitd 14r REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:15.742 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.742 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.742 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd txt REG 8,1 166792 41929 /usr/lib/polkit-1/polkitd 2020-04-22T14:17:15.742 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:15.742 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 860880 5511 /usr/lib64/libnss_systemd.so.2 2020-04-22T14:17:15.742 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:15.742 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:15.743 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:15.743 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:15.743 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 144392 3449 /usr/lib64/libgpg-error.so.0.24.2 2020-04-22T14:17:15.743 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:15.743 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:15.743 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:15.743 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 1503456 3656 /usr/lib64/libgmp.so.10.3.2 2020-04-22T14:17:15.744 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 248080 3819 /usr/lib64/libhogweed.so.4.5 2020-04-22T14:17:15.744 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 299920 3821 /usr/lib64/libnettle.so.6.5 2020-04-22T14:17:15.744 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 81408 3851 /usr/lib64/libtasn1.so.6.5.5 2020-04-22T14:17:15.744 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 1760264 3670 /usr/lib64/libunistring.so.2.1.0 2020-04-22T14:17:15.744 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 162224 3672 /usr/lib64/libidn2.so.0.3.6 2020-04-22T14:17:15.744 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 1295528 3648 /usr/lib64/libp11-kit.so.0.3.0 2020-04-22T14:17:15.744 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:15.745 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 1385560 3654 /usr/lib64/libgcrypt.so.20.2.3 2020-04-22T14:17:15.745 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:15.745 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:15.745 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:15.745 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:15.745 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:15.745 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:15.746 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:15.746 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:15.746 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 471224 3494 /usr/lib64/libpcre.so.1.2.10 2020-04-22T14:17:15.746 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 2521184 6329 /usr/lib64/libgnutls.so.30.24.0 2020-04-22T14:17:15.746 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:15.746 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:15.746 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 18224 6263 /usr/lib64/libgmodule-2.0.so.0.5600.4 2020-04-22T14:17:15.746 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:15.747 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:15.747 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:15.747 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:15.747 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 36978800 4577 /usr/lib64/libmozjs-60.so.0.0.0 2020-04-22T14:17:15.747 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 244736 3491 /usr/lib64/libexpat.so.1.6.7 2020-04-22T14:17:15.747 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 1637336 5512 /usr/lib64/libsystemd.so.0.23.0 2020-04-22T14:17:15.747 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 1471440 6261 /usr/lib64/libglib-2.0.so.0.5600.4 2020-04-22T14:17:15.748 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 435432 6265 /usr/lib64/libgobject-2.0.so.0.5600.4 2020-04-22T14:17:15.748 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 2508264 6259 /usr/lib64/libgio-2.0.so.0.5600.4 2020-04-22T14:17:15.748 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 180576 6656 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2020-04-22T14:17:15.748 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:15.748 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:15.748 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd 0u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.748 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd 1u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.748 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd 2u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.749 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd 3u unix 0x00000000ca06bdb4 0t0 295708 type=STREAM 2020-04-22T14:17:15.749 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd 4r REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:15.749 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd 5r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:15.749 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd 6u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.749 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd 7u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.749 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd 8u unix 0x000000007644287f 0t0 26376 type=STREAM 2020-04-22T14:17:15.750 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd 9u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.750 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd 10r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:15.750 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd 11u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.750 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd 12u unix 0x00000000689b70f8 0t0 28723 type=DGRAM 2020-04-22T14:17:15.750 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd 13r REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:15.750 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2519 gmain polkitd 14r REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:15.750 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.750 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.751 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd txt REG 8,1 166792 41929 /usr/lib/polkit-1/polkitd 2020-04-22T14:17:15.751 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:15.751 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 860880 5511 /usr/lib64/libnss_systemd.so.2 2020-04-22T14:17:15.751 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:15.751 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:15.751 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:15.751 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:15.752 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 144392 3449 /usr/lib64/libgpg-error.so.0.24.2 2020-04-22T14:17:15.752 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:15.752 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:15.752 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:15.752 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 1503456 3656 /usr/lib64/libgmp.so.10.3.2 2020-04-22T14:17:15.752 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 248080 3819 /usr/lib64/libhogweed.so.4.5 2020-04-22T14:17:15.753 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 299920 3821 /usr/lib64/libnettle.so.6.5 2020-04-22T14:17:15.753 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 81408 3851 /usr/lib64/libtasn1.so.6.5.5 2020-04-22T14:17:15.753 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 1760264 3670 /usr/lib64/libunistring.so.2.1.0 2020-04-22T14:17:15.753 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 162224 3672 /usr/lib64/libidn2.so.0.3.6 2020-04-22T14:17:15.753 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 1295528 3648 /usr/lib64/libp11-kit.so.0.3.0 2020-04-22T14:17:15.753 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:15.753 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 1385560 3654 /usr/lib64/libgcrypt.so.20.2.3 2020-04-22T14:17:15.754 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:15.754 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:15.754 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:15.754 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:15.754 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:15.754 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:15.754 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:15.755 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:15.755 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 471224 3494 /usr/lib64/libpcre.so.1.2.10 2020-04-22T14:17:15.755 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 2521184 6329 /usr/lib64/libgnutls.so.30.24.0 2020-04-22T14:17:15.755 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:15.755 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:15.755 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 18224 6263 /usr/lib64/libgmodule-2.0.so.0.5600.4 2020-04-22T14:17:15.755 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:15.755 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:15.756 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:15.756 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:15.756 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 36978800 4577 /usr/lib64/libmozjs-60.so.0.0.0 2020-04-22T14:17:15.756 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 244736 3491 /usr/lib64/libexpat.so.1.6.7 2020-04-22T14:17:15.756 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 1637336 5512 /usr/lib64/libsystemd.so.0.23.0 2020-04-22T14:17:15.756 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 1471440 6261 /usr/lib64/libglib-2.0.so.0.5600.4 2020-04-22T14:17:15.756 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 435432 6265 /usr/lib64/libgobject-2.0.so.0.5600.4 2020-04-22T14:17:15.757 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 2508264 6259 /usr/lib64/libgio-2.0.so.0.5600.4 2020-04-22T14:17:15.757 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 180576 6656 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2020-04-22T14:17:15.757 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:15.757 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:15.757 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd 0u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.757 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd 1u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.757 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd 2u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.758 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd 3u unix 0x00000000ca06bdb4 0t0 295708 type=STREAM 2020-04-22T14:17:15.758 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd 4r REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:15.758 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd 5r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:15.758 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd 6u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.758 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd 7u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.758 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd 8u unix 0x000000007644287f 0t0 26376 type=STREAM 2020-04-22T14:17:15.758 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd 9u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.758 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd 10r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:15.759 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd 11u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.759 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd 12u unix 0x00000000689b70f8 0t0 28723 type=DGRAM 2020-04-22T14:17:15.759 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd 13r REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:15.759 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2521 gdbus polkitd 14r REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:15.759 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.759 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.759 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd txt REG 8,1 166792 41929 /usr/lib/polkit-1/polkitd 2020-04-22T14:17:15.760 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:15.760 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 860880 5511 /usr/lib64/libnss_systemd.so.2 2020-04-22T14:17:15.760 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:15.760 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:15.760 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:15.760 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:15.761 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 144392 3449 /usr/lib64/libgpg-error.so.0.24.2 2020-04-22T14:17:15.761 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:15.761 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:15.761 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:15.761 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 1503456 3656 /usr/lib64/libgmp.so.10.3.2 2020-04-22T14:17:15.761 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 248080 3819 /usr/lib64/libhogweed.so.4.5 2020-04-22T14:17:15.761 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 299920 3821 /usr/lib64/libnettle.so.6.5 2020-04-22T14:17:15.762 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 81408 3851 /usr/lib64/libtasn1.so.6.5.5 2020-04-22T14:17:15.762 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 1760264 3670 /usr/lib64/libunistring.so.2.1.0 2020-04-22T14:17:15.762 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 162224 3672 /usr/lib64/libidn2.so.0.3.6 2020-04-22T14:17:15.762 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 1295528 3648 /usr/lib64/libp11-kit.so.0.3.0 2020-04-22T14:17:15.762 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:15.762 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 1385560 3654 /usr/lib64/libgcrypt.so.20.2.3 2020-04-22T14:17:15.762 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:15.762 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:15.763 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:15.763 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:15.763 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:15.763 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:15.763 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:15.763 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:15.763 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 471224 3494 /usr/lib64/libpcre.so.1.2.10 2020-04-22T14:17:15.763 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 2521184 6329 /usr/lib64/libgnutls.so.30.24.0 2020-04-22T14:17:15.764 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:15.764 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:15.764 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 18224 6263 /usr/lib64/libgmodule-2.0.so.0.5600.4 2020-04-22T14:17:15.764 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:15.764 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:15.764 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:15.764 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:15.765 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 36978800 4577 /usr/lib64/libmozjs-60.so.0.0.0 2020-04-22T14:17:15.765 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 244736 3491 /usr/lib64/libexpat.so.1.6.7 2020-04-22T14:17:15.765 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 1637336 5512 /usr/lib64/libsystemd.so.0.23.0 2020-04-22T14:17:15.765 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 1471440 6261 /usr/lib64/libglib-2.0.so.0.5600.4 2020-04-22T14:17:15.765 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 435432 6265 /usr/lib64/libgobject-2.0.so.0.5600.4 2020-04-22T14:17:15.765 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 2508264 6259 /usr/lib64/libgio-2.0.so.0.5600.4 2020-04-22T14:17:15.765 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 180576 6656 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2020-04-22T14:17:15.765 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:15.766 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:15.766 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd 0u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.766 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd 1u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.766 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd 2u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.766 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd 3u unix 0x00000000ca06bdb4 0t0 295708 type=STREAM 2020-04-22T14:17:15.766 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd 4r REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:15.766 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd 5r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:15.767 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd 6u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.767 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd 7u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.767 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd 8u unix 0x000000007644287f 0t0 26376 type=STREAM 2020-04-22T14:17:15.767 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd 9u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.767 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd 10r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:15.767 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd 11u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.767 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd 12u unix 0x00000000689b70f8 0t0 28723 type=DGRAM 2020-04-22T14:17:15.768 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd 13r REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:15.768 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2527 JS\x20Hel polkitd 14r REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:15.768 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.768 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.768 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd txt REG 8,1 166792 41929 /usr/lib/polkit-1/polkitd 2020-04-22T14:17:15.769 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:15.769 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 860880 5511 /usr/lib64/libnss_systemd.so.2 2020-04-22T14:17:15.769 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:15.769 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:15.769 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:15.769 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:15.769 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 144392 3449 /usr/lib64/libgpg-error.so.0.24.2 2020-04-22T14:17:15.770 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:15.770 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:15.770 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:15.770 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 1503456 3656 /usr/lib64/libgmp.so.10.3.2 2020-04-22T14:17:15.770 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 248080 3819 /usr/lib64/libhogweed.so.4.5 2020-04-22T14:17:15.770 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 299920 3821 /usr/lib64/libnettle.so.6.5 2020-04-22T14:17:15.770 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 81408 3851 /usr/lib64/libtasn1.so.6.5.5 2020-04-22T14:17:15.771 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 1760264 3670 /usr/lib64/libunistring.so.2.1.0 2020-04-22T14:17:15.771 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 162224 3672 /usr/lib64/libidn2.so.0.3.6 2020-04-22T14:17:15.771 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 1295528 3648 /usr/lib64/libp11-kit.so.0.3.0 2020-04-22T14:17:15.771 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:15.771 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 1385560 3654 /usr/lib64/libgcrypt.so.20.2.3 2020-04-22T14:17:15.771 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:15.771 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:15.772 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:15.772 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:15.772 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:15.772 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:15.772 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:15.772 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:15.773 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 471224 3494 /usr/lib64/libpcre.so.1.2.10 2020-04-22T14:17:15.773 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 2521184 6329 /usr/lib64/libgnutls.so.30.24.0 2020-04-22T14:17:15.773 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:15.773 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:15.773 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 18224 6263 /usr/lib64/libgmodule-2.0.so.0.5600.4 2020-04-22T14:17:15.773 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:15.773 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:15.773 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:15.774 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:15.774 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 36978800 4577 /usr/lib64/libmozjs-60.so.0.0.0 2020-04-22T14:17:15.774 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 244736 3491 /usr/lib64/libexpat.so.1.6.7 2020-04-22T14:17:15.774 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 1637336 5512 /usr/lib64/libsystemd.so.0.23.0 2020-04-22T14:17:15.774 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 1471440 6261 /usr/lib64/libglib-2.0.so.0.5600.4 2020-04-22T14:17:15.774 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 435432 6265 /usr/lib64/libgobject-2.0.so.0.5600.4 2020-04-22T14:17:15.775 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 2508264 6259 /usr/lib64/libgio-2.0.so.0.5600.4 2020-04-22T14:17:15.775 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 180576 6656 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2020-04-22T14:17:15.775 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:15.775 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:15.775 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd 0u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.775 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd 1u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.775 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd 2u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.775 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd 3u unix 0x00000000ca06bdb4 0t0 295708 type=STREAM 2020-04-22T14:17:15.776 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd 4r REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:15.776 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd 5r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:15.776 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd 6u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.776 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd 7u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.776 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd 8u unix 0x000000007644287f 0t0 26376 type=STREAM 2020-04-22T14:17:15.776 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd 9u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.777 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd 10r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:15.777 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd 11u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.777 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd 12u unix 0x00000000689b70f8 0t0 28723 type=DGRAM 2020-04-22T14:17:15.777 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd 13r REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:15.777 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2528 JS\x20Hel polkitd 14r REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:15.777 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.778 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.778 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd txt REG 8,1 166792 41929 /usr/lib/polkit-1/polkitd 2020-04-22T14:17:15.778 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:15.778 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 860880 5511 /usr/lib64/libnss_systemd.so.2 2020-04-22T14:17:15.778 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:15.778 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:15.778 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:15.779 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:15.779 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 144392 3449 /usr/lib64/libgpg-error.so.0.24.2 2020-04-22T14:17:15.779 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:15.779 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:15.779 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:15.779 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 1503456 3656 /usr/lib64/libgmp.so.10.3.2 2020-04-22T14:17:15.779 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 248080 3819 /usr/lib64/libhogweed.so.4.5 2020-04-22T14:17:15.780 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 299920 3821 /usr/lib64/libnettle.so.6.5 2020-04-22T14:17:15.780 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 81408 3851 /usr/lib64/libtasn1.so.6.5.5 2020-04-22T14:17:15.780 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 1760264 3670 /usr/lib64/libunistring.so.2.1.0 2020-04-22T14:17:15.780 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 162224 3672 /usr/lib64/libidn2.so.0.3.6 2020-04-22T14:17:15.780 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 1295528 3648 /usr/lib64/libp11-kit.so.0.3.0 2020-04-22T14:17:15.780 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:15.780 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 1385560 3654 /usr/lib64/libgcrypt.so.20.2.3 2020-04-22T14:17:15.781 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:15.781 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:15.781 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:15.781 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:15.781 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:15.781 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:15.781 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:15.781 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:15.782 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 471224 3494 /usr/lib64/libpcre.so.1.2.10 2020-04-22T14:17:15.782 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 2521184 6329 /usr/lib64/libgnutls.so.30.24.0 2020-04-22T14:17:15.782 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:15.782 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:15.782 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 18224 6263 /usr/lib64/libgmodule-2.0.so.0.5600.4 2020-04-22T14:17:15.782 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:15.782 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:15.783 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:15.783 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:15.783 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 36978800 4577 /usr/lib64/libmozjs-60.so.0.0.0 2020-04-22T14:17:15.783 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 244736 3491 /usr/lib64/libexpat.so.1.6.7 2020-04-22T14:17:15.783 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 1637336 5512 /usr/lib64/libsystemd.so.0.23.0 2020-04-22T14:17:15.783 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 1471440 6261 /usr/lib64/libglib-2.0.so.0.5600.4 2020-04-22T14:17:15.783 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 435432 6265 /usr/lib64/libgobject-2.0.so.0.5600.4 2020-04-22T14:17:15.783 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 2508264 6259 /usr/lib64/libgio-2.0.so.0.5600.4 2020-04-22T14:17:15.784 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 180576 6656 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2020-04-22T14:17:15.784 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:15.784 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:15.784 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd 0u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.784 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd 1u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.784 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd 2u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.784 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd 3u unix 0x00000000ca06bdb4 0t0 295708 type=STREAM 2020-04-22T14:17:15.785 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd 4r REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:15.785 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd 5r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:15.785 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd 6u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.785 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd 7u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.785 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd 8u unix 0x000000007644287f 0t0 26376 type=STREAM 2020-04-22T14:17:15.785 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd 9u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.785 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd 10r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:15.786 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd 11u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.786 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd 12u unix 0x00000000689b70f8 0t0 28723 type=DGRAM 2020-04-22T14:17:15.786 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd 13r REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:15.786 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2529 JS\x20Hel polkitd 14r REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:15.786 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.786 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.786 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd txt REG 8,1 166792 41929 /usr/lib/polkit-1/polkitd 2020-04-22T14:17:15.787 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:15.787 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 860880 5511 /usr/lib64/libnss_systemd.so.2 2020-04-22T14:17:15.787 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:15.787 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:15.787 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:15.787 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:15.787 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 144392 3449 /usr/lib64/libgpg-error.so.0.24.2 2020-04-22T14:17:15.788 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:15.788 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:15.788 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:15.788 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 1503456 3656 /usr/lib64/libgmp.so.10.3.2 2020-04-22T14:17:15.788 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 248080 3819 /usr/lib64/libhogweed.so.4.5 2020-04-22T14:17:15.788 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 299920 3821 /usr/lib64/libnettle.so.6.5 2020-04-22T14:17:15.789 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 81408 3851 /usr/lib64/libtasn1.so.6.5.5 2020-04-22T14:17:15.789 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 1760264 3670 /usr/lib64/libunistring.so.2.1.0 2020-04-22T14:17:15.789 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 162224 3672 /usr/lib64/libidn2.so.0.3.6 2020-04-22T14:17:15.789 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 1295528 3648 /usr/lib64/libp11-kit.so.0.3.0 2020-04-22T14:17:15.789 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:15.789 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 1385560 3654 /usr/lib64/libgcrypt.so.20.2.3 2020-04-22T14:17:15.789 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:15.790 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:15.790 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:15.790 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:15.790 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:15.790 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:15.790 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:15.790 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:15.791 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 471224 3494 /usr/lib64/libpcre.so.1.2.10 2020-04-22T14:17:15.791 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 2521184 6329 /usr/lib64/libgnutls.so.30.24.0 2020-04-22T14:17:15.791 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:15.791 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:15.791 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 18224 6263 /usr/lib64/libgmodule-2.0.so.0.5600.4 2020-04-22T14:17:15.791 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:15.791 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:15.792 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:15.792 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:15.792 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 36978800 4577 /usr/lib64/libmozjs-60.so.0.0.0 2020-04-22T14:17:15.792 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 244736 3491 /usr/lib64/libexpat.so.1.6.7 2020-04-22T14:17:15.792 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 1637336 5512 /usr/lib64/libsystemd.so.0.23.0 2020-04-22T14:17:15.792 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 1471440 6261 /usr/lib64/libglib-2.0.so.0.5600.4 2020-04-22T14:17:15.793 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 435432 6265 /usr/lib64/libgobject-2.0.so.0.5600.4 2020-04-22T14:17:15.793 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 2508264 6259 /usr/lib64/libgio-2.0.so.0.5600.4 2020-04-22T14:17:15.793 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 180576 6656 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2020-04-22T14:17:15.793 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:15.793 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:15.793 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd 0u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.794 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd 1u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.794 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd 2u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.794 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd 3u unix 0x00000000ca06bdb4 0t0 295708 type=STREAM 2020-04-22T14:17:15.794 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd 4r REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:15.794 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd 5r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:15.794 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd 6u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.794 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd 7u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.795 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd 8u unix 0x000000007644287f 0t0 26376 type=STREAM 2020-04-22T14:17:15.795 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd 9u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.795 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd 10r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:15.795 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd 11u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.795 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd 12u unix 0x00000000689b70f8 0t0 28723 type=DGRAM 2020-04-22T14:17:15.795 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd 13r REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:15.795 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2530 JS\x20Hel polkitd 14r REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:15.795 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.796 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.796 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd txt REG 8,1 166792 41929 /usr/lib/polkit-1/polkitd 2020-04-22T14:17:15.796 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:15.796 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 860880 5511 /usr/lib64/libnss_systemd.so.2 2020-04-22T14:17:15.796 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:15.796 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:15.796 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:15.796 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:15.797 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 144392 3449 /usr/lib64/libgpg-error.so.0.24.2 2020-04-22T14:17:15.797 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:15.797 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:15.797 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:15.797 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 1503456 3656 /usr/lib64/libgmp.so.10.3.2 2020-04-22T14:17:15.797 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 248080 3819 /usr/lib64/libhogweed.so.4.5 2020-04-22T14:17:15.798 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 299920 3821 /usr/lib64/libnettle.so.6.5 2020-04-22T14:17:15.798 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 81408 3851 /usr/lib64/libtasn1.so.6.5.5 2020-04-22T14:17:15.798 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 1760264 3670 /usr/lib64/libunistring.so.2.1.0 2020-04-22T14:17:15.798 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 162224 3672 /usr/lib64/libidn2.so.0.3.6 2020-04-22T14:17:15.798 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 1295528 3648 /usr/lib64/libp11-kit.so.0.3.0 2020-04-22T14:17:15.798 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:15.798 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 1385560 3654 /usr/lib64/libgcrypt.so.20.2.3 2020-04-22T14:17:15.799 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:15.799 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:15.799 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:15.799 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:15.799 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:15.799 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:15.799 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:15.800 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:15.800 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 471224 3494 /usr/lib64/libpcre.so.1.2.10 2020-04-22T14:17:15.800 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 2521184 6329 /usr/lib64/libgnutls.so.30.24.0 2020-04-22T14:17:15.800 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:15.800 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:15.800 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 18224 6263 /usr/lib64/libgmodule-2.0.so.0.5600.4 2020-04-22T14:17:15.800 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:15.801 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:15.801 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:15.801 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:15.801 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 36978800 4577 /usr/lib64/libmozjs-60.so.0.0.0 2020-04-22T14:17:15.801 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 244736 3491 /usr/lib64/libexpat.so.1.6.7 2020-04-22T14:17:15.801 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 1637336 5512 /usr/lib64/libsystemd.so.0.23.0 2020-04-22T14:17:15.801 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 1471440 6261 /usr/lib64/libglib-2.0.so.0.5600.4 2020-04-22T14:17:15.802 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 435432 6265 /usr/lib64/libgobject-2.0.so.0.5600.4 2020-04-22T14:17:15.802 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 2508264 6259 /usr/lib64/libgio-2.0.so.0.5600.4 2020-04-22T14:17:15.802 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 180576 6656 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2020-04-22T14:17:15.802 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:15.802 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:15.802 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd 0u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.803 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd 1u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.803 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd 2u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.803 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd 3u unix 0x00000000ca06bdb4 0t0 295708 type=STREAM 2020-04-22T14:17:15.803 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd 4r REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:15.803 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd 5r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:15.803 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd 6u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.803 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd 7u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.804 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd 8u unix 0x000000007644287f 0t0 26376 type=STREAM 2020-04-22T14:17:15.804 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd 9u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.804 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd 10r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:15.804 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd 11u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.804 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd 12u unix 0x00000000689b70f8 0t0 28723 type=DGRAM 2020-04-22T14:17:15.804 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd 13r REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:15.804 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2531 JS\x20Hel polkitd 14r REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:15.804 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.805 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.805 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd txt REG 8,1 166792 41929 /usr/lib/polkit-1/polkitd 2020-04-22T14:17:15.805 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:15.805 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 860880 5511 /usr/lib64/libnss_systemd.so.2 2020-04-22T14:17:15.805 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:15.805 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:15.805 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:15.806 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:15.806 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 144392 3449 /usr/lib64/libgpg-error.so.0.24.2 2020-04-22T14:17:15.806 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:15.806 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:15.806 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:15.806 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 1503456 3656 /usr/lib64/libgmp.so.10.3.2 2020-04-22T14:17:15.806 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 248080 3819 /usr/lib64/libhogweed.so.4.5 2020-04-22T14:17:15.807 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 299920 3821 /usr/lib64/libnettle.so.6.5 2020-04-22T14:17:15.807 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 81408 3851 /usr/lib64/libtasn1.so.6.5.5 2020-04-22T14:17:15.807 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 1760264 3670 /usr/lib64/libunistring.so.2.1.0 2020-04-22T14:17:15.807 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 162224 3672 /usr/lib64/libidn2.so.0.3.6 2020-04-22T14:17:15.807 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 1295528 3648 /usr/lib64/libp11-kit.so.0.3.0 2020-04-22T14:17:15.807 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:15.807 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 1385560 3654 /usr/lib64/libgcrypt.so.20.2.3 2020-04-22T14:17:15.808 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:15.808 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:15.808 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:15.808 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:15.808 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:15.808 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:15.808 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:15.809 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:15.809 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 471224 3494 /usr/lib64/libpcre.so.1.2.10 2020-04-22T14:17:15.809 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 2521184 6329 /usr/lib64/libgnutls.so.30.24.0 2020-04-22T14:17:15.809 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:15.809 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:15.809 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 18224 6263 /usr/lib64/libgmodule-2.0.so.0.5600.4 2020-04-22T14:17:15.809 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:15.809 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:15.810 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:15.810 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:15.810 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 36978800 4577 /usr/lib64/libmozjs-60.so.0.0.0 2020-04-22T14:17:15.810 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 244736 3491 /usr/lib64/libexpat.so.1.6.7 2020-04-22T14:17:15.810 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 1637336 5512 /usr/lib64/libsystemd.so.0.23.0 2020-04-22T14:17:15.810 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 1471440 6261 /usr/lib64/libglib-2.0.so.0.5600.4 2020-04-22T14:17:15.810 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 435432 6265 /usr/lib64/libgobject-2.0.so.0.5600.4 2020-04-22T14:17:15.810 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 2508264 6259 /usr/lib64/libgio-2.0.so.0.5600.4 2020-04-22T14:17:15.811 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 180576 6656 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2020-04-22T14:17:15.811 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:15.811 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:15.811 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd 0u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.811 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd 1u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.811 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd 2u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.811 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd 3u unix 0x00000000ca06bdb4 0t0 295708 type=STREAM 2020-04-22T14:17:15.812 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd 4r REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:15.812 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd 5r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:15.812 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd 6u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.812 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd 7u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.812 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd 8u unix 0x000000007644287f 0t0 26376 type=STREAM 2020-04-22T14:17:15.812 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd 9u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.812 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd 10r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:15.813 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd 11u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.813 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd 12u unix 0x00000000689b70f8 0t0 28723 type=DGRAM 2020-04-22T14:17:15.813 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd 13r REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:15.813 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2532 JS\x20Hel polkitd 14r REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:15.813 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.813 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.813 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd txt REG 8,1 166792 41929 /usr/lib/polkit-1/polkitd 2020-04-22T14:17:15.814 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:15.814 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 860880 5511 /usr/lib64/libnss_systemd.so.2 2020-04-22T14:17:15.814 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:15.814 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:15.814 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:15.814 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:15.815 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 144392 3449 /usr/lib64/libgpg-error.so.0.24.2 2020-04-22T14:17:15.815 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:15.815 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:15.815 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:15.815 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 1503456 3656 /usr/lib64/libgmp.so.10.3.2 2020-04-22T14:17:15.815 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 248080 3819 /usr/lib64/libhogweed.so.4.5 2020-04-22T14:17:15.815 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 299920 3821 /usr/lib64/libnettle.so.6.5 2020-04-22T14:17:15.815 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 81408 3851 /usr/lib64/libtasn1.so.6.5.5 2020-04-22T14:17:15.816 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 1760264 3670 /usr/lib64/libunistring.so.2.1.0 2020-04-22T14:17:15.816 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 162224 3672 /usr/lib64/libidn2.so.0.3.6 2020-04-22T14:17:15.816 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 1295528 3648 /usr/lib64/libp11-kit.so.0.3.0 2020-04-22T14:17:15.816 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:15.816 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 1385560 3654 /usr/lib64/libgcrypt.so.20.2.3 2020-04-22T14:17:15.816 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:15.817 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:15.817 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:15.817 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:15.817 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:15.817 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:15.817 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:15.817 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:15.818 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 471224 3494 /usr/lib64/libpcre.so.1.2.10 2020-04-22T14:17:15.818 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 2521184 6329 /usr/lib64/libgnutls.so.30.24.0 2020-04-22T14:17:15.818 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:15.818 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:15.818 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 18224 6263 /usr/lib64/libgmodule-2.0.so.0.5600.4 2020-04-22T14:17:15.818 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:15.818 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:15.819 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:15.819 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:15.819 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 36978800 4577 /usr/lib64/libmozjs-60.so.0.0.0 2020-04-22T14:17:15.819 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 244736 3491 /usr/lib64/libexpat.so.1.6.7 2020-04-22T14:17:15.819 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 1637336 5512 /usr/lib64/libsystemd.so.0.23.0 2020-04-22T14:17:15.819 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 1471440 6261 /usr/lib64/libglib-2.0.so.0.5600.4 2020-04-22T14:17:15.819 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 435432 6265 /usr/lib64/libgobject-2.0.so.0.5600.4 2020-04-22T14:17:15.819 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 2508264 6259 /usr/lib64/libgio-2.0.so.0.5600.4 2020-04-22T14:17:15.820 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 180576 6656 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2020-04-22T14:17:15.820 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:15.820 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:15.820 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd 0u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.820 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd 1u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.820 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd 2u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.820 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd 3u unix 0x00000000ca06bdb4 0t0 295708 type=STREAM 2020-04-22T14:17:15.821 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd 4r REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:15.821 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd 5r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:15.821 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd 6u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.821 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd 7u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.821 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd 8u unix 0x000000007644287f 0t0 26376 type=STREAM 2020-04-22T14:17:15.821 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd 9u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.821 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd 10r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:15.821 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd 11u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.822 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd 12u unix 0x00000000689b70f8 0t0 28723 type=DGRAM 2020-04-22T14:17:15.822 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd 13r REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:15.822 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2533 JS\x20Hel polkitd 14r REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:15.822 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.822 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.822 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd txt REG 8,1 166792 41929 /usr/lib/polkit-1/polkitd 2020-04-22T14:17:15.822 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:15.822 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 860880 5511 /usr/lib64/libnss_systemd.so.2 2020-04-22T14:17:15.823 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:15.823 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:15.823 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:15.823 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:15.823 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 144392 3449 /usr/lib64/libgpg-error.so.0.24.2 2020-04-22T14:17:15.823 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:15.824 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:15.824 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:15.824 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 1503456 3656 /usr/lib64/libgmp.so.10.3.2 2020-04-22T14:17:15.824 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 248080 3819 /usr/lib64/libhogweed.so.4.5 2020-04-22T14:17:15.824 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 299920 3821 /usr/lib64/libnettle.so.6.5 2020-04-22T14:17:15.824 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 81408 3851 /usr/lib64/libtasn1.so.6.5.5 2020-04-22T14:17:15.825 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 1760264 3670 /usr/lib64/libunistring.so.2.1.0 2020-04-22T14:17:15.825 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 162224 3672 /usr/lib64/libidn2.so.0.3.6 2020-04-22T14:17:15.825 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 1295528 3648 /usr/lib64/libp11-kit.so.0.3.0 2020-04-22T14:17:15.825 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:15.825 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 1385560 3654 /usr/lib64/libgcrypt.so.20.2.3 2020-04-22T14:17:15.825 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:15.825 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:15.826 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:15.826 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:15.826 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:15.826 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:15.826 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:15.826 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:15.826 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 471224 3494 /usr/lib64/libpcre.so.1.2.10 2020-04-22T14:17:15.827 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 2521184 6329 /usr/lib64/libgnutls.so.30.24.0 2020-04-22T14:17:15.827 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:15.827 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:15.827 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 18224 6263 /usr/lib64/libgmodule-2.0.so.0.5600.4 2020-04-22T14:17:15.827 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:15.827 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:15.828 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:15.828 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:15.828 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 36978800 4577 /usr/lib64/libmozjs-60.so.0.0.0 2020-04-22T14:17:15.828 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 244736 3491 /usr/lib64/libexpat.so.1.6.7 2020-04-22T14:17:15.828 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 1637336 5512 /usr/lib64/libsystemd.so.0.23.0 2020-04-22T14:17:15.828 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 1471440 6261 /usr/lib64/libglib-2.0.so.0.5600.4 2020-04-22T14:17:15.828 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 435432 6265 /usr/lib64/libgobject-2.0.so.0.5600.4 2020-04-22T14:17:15.829 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 2508264 6259 /usr/lib64/libgio-2.0.so.0.5600.4 2020-04-22T14:17:15.829 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 180576 6656 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2020-04-22T14:17:15.829 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:15.829 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:15.829 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd 0u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.829 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd 1u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.829 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd 2u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.830 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd 3u unix 0x00000000ca06bdb4 0t0 295708 type=STREAM 2020-04-22T14:17:15.830 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd 4r REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:15.830 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd 5r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:15.830 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd 6u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.830 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd 7u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.830 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd 8u unix 0x000000007644287f 0t0 26376 type=STREAM 2020-04-22T14:17:15.830 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd 9u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.830 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd 10r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:15.831 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd 11u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.831 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd 12u unix 0x00000000689b70f8 0t0 28723 type=DGRAM 2020-04-22T14:17:15.831 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd 13r REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:15.831 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2534 JS\x20Hel polkitd 14r REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:15.831 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.831 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.831 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd txt REG 8,1 166792 41929 /usr/lib/polkit-1/polkitd 2020-04-22T14:17:15.832 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:15.832 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 860880 5511 /usr/lib64/libnss_systemd.so.2 2020-04-22T14:17:15.832 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:15.832 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:15.832 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:15.832 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:15.832 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 144392 3449 /usr/lib64/libgpg-error.so.0.24.2 2020-04-22T14:17:15.833 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:15.833 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:15.833 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:15.833 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 1503456 3656 /usr/lib64/libgmp.so.10.3.2 2020-04-22T14:17:15.833 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 248080 3819 /usr/lib64/libhogweed.so.4.5 2020-04-22T14:17:15.833 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 299920 3821 /usr/lib64/libnettle.so.6.5 2020-04-22T14:17:15.833 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 81408 3851 /usr/lib64/libtasn1.so.6.5.5 2020-04-22T14:17:15.834 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 1760264 3670 /usr/lib64/libunistring.so.2.1.0 2020-04-22T14:17:15.834 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 162224 3672 /usr/lib64/libidn2.so.0.3.6 2020-04-22T14:17:15.834 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 1295528 3648 /usr/lib64/libp11-kit.so.0.3.0 2020-04-22T14:17:15.834 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:15.834 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 1385560 3654 /usr/lib64/libgcrypt.so.20.2.3 2020-04-22T14:17:15.834 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:15.834 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:15.835 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:15.835 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:15.835 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:15.835 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:15.835 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:15.835 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:15.835 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 471224 3494 /usr/lib64/libpcre.so.1.2.10 2020-04-22T14:17:15.836 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 2521184 6329 /usr/lib64/libgnutls.so.30.24.0 2020-04-22T14:17:15.836 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:15.836 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:15.836 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 18224 6263 /usr/lib64/libgmodule-2.0.so.0.5600.4 2020-04-22T14:17:15.836 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:15.836 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:15.836 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:15.837 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:15.837 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 36978800 4577 /usr/lib64/libmozjs-60.so.0.0.0 2020-04-22T14:17:15.837 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 244736 3491 /usr/lib64/libexpat.so.1.6.7 2020-04-22T14:17:15.837 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 1637336 5512 /usr/lib64/libsystemd.so.0.23.0 2020-04-22T14:17:15.837 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 1471440 6261 /usr/lib64/libglib-2.0.so.0.5600.4 2020-04-22T14:17:15.837 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 435432 6265 /usr/lib64/libgobject-2.0.so.0.5600.4 2020-04-22T14:17:15.837 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 2508264 6259 /usr/lib64/libgio-2.0.so.0.5600.4 2020-04-22T14:17:15.838 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 180576 6656 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2020-04-22T14:17:15.838 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:15.838 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:15.838 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd 0u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.838 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd 1u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.838 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd 2u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.838 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd 3u unix 0x00000000ca06bdb4 0t0 295708 type=STREAM 2020-04-22T14:17:15.838 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd 4r REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:15.839 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd 5r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:15.839 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd 6u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.839 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd 7u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.839 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd 8u unix 0x000000007644287f 0t0 26376 type=STREAM 2020-04-22T14:17:15.839 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd 9u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.839 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd 10r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:15.840 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd 11u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.840 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd 12u unix 0x00000000689b70f8 0t0 28723 type=DGRAM 2020-04-22T14:17:15.840 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd 13r REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:15.840 INFO:teuthology.orchestra.run.smithi103.stdout:polkitd 2409 2535 polkitd polkitd 14r REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:15.840 INFO:teuthology.orchestra.run.smithi103.stdout:mcelog 2410 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.840 INFO:teuthology.orchestra.run.smithi103.stdout:mcelog 2410 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.841 INFO:teuthology.orchestra.run.smithi103.stdout:mcelog 2410 root txt REG 8,1 177728 9094 /usr/sbin/mcelog 2020-04-22T14:17:15.841 INFO:teuthology.orchestra.run.smithi103.stdout:mcelog 2410 root mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:15.841 INFO:teuthology.orchestra.run.smithi103.stdout:mcelog 2410 root DEL REG 8,1 65728 /var/lib/sss/mc/passwd 2020-04-22T14:17:15.841 INFO:teuthology.orchestra.run.smithi103.stdout:mcelog 2410 root mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:15.841 INFO:teuthology.orchestra.run.smithi103.stdout:mcelog 2410 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:15.842 INFO:teuthology.orchestra.run.smithi103.stdout:mcelog 2410 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:15.842 INFO:teuthology.orchestra.run.smithi103.stdout:mcelog 2410 root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.842 INFO:teuthology.orchestra.run.smithi103.stdout:mcelog 2410 root 1u unix 0x00000000caf58c8e 0t0 26823 type=STREAM 2020-04-22T14:17:15.842 INFO:teuthology.orchestra.run.smithi103.stdout:mcelog 2410 root 2u unix 0x00000000caf58c8e 0t0 26823 type=STREAM 2020-04-22T14:17:15.843 INFO:teuthology.orchestra.run.smithi103.stdout:mcelog 2410 root 3r CHR 10,227 0t0 16393 /dev/mcelog 2020-04-22T14:17:15.843 INFO:teuthology.orchestra.run.smithi103.stdout:mcelog 2410 root 4r REG 8,1 8406312 65728 /var/lib/sss/mc/passwd (deleted) 2020-04-22T14:17:15.843 INFO:teuthology.orchestra.run.smithi103.stdout:mcelog 2410 root 5u unix 0x00000000faeaa3af 0t0 26827 /var/run/mcelog-client type=STREAM 2020-04-22T14:17:15.843 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.843 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.843 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root txt REG 8,1 68912 8952 /usr/sbin/rngd 2020-04-22T14:17:15.843 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:15.844 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root mem REG 8,1 142712 3373 /usr/lib64/libcrypt.so.1.1.0 2020-04-22T14:17:15.844 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:15.844 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root mem REG 8,1 131400 4834 /usr/lib64/libbrotlicommon.so.1.0.6 2020-04-22T14:17:15.844 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root mem REG 8,1 149160 4994 /usr/lib64/libsasl2.so.3.0.0 2020-04-22T14:17:15.844 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:15.844 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root mem REG 8,1 16240 3641 /usr/lib64/libkeyutils.so.1.6 2020-04-22T14:17:15.844 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root mem REG 8,1 118728 5304 /usr/lib64/libkrb5support.so.0.1 2020-04-22T14:17:15.845 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:15.845 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root mem REG 8,1 1760264 3670 /usr/lib64/libunistring.so.2.1.0 2020-04-22T14:17:15.845 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:15.845 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:15.845 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:15.845 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root mem REG 8,1 50456 4836 /usr/lib64/libbrotlidec.so.1.0.6 2020-04-22T14:17:15.845 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root mem REG 8,1 97056 5009 /usr/lib64/liblber-2.4.so.2.10.9 2020-04-22T14:17:15.845 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root mem REG 8,1 477472 5011 /usr/lib64/libldap-2.4.so.2.10.9 2020-04-22T14:17:15.846 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root mem REG 8,1 25992 3339 /usr/lib64/libcom_err.so.2.1 2020-04-22T14:17:15.846 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root mem REG 8,1 273488 5296 /usr/lib64/libk5crypto.so.3.1 2020-04-22T14:17:15.846 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root mem REG 8,1 1507952 5302 /usr/lib64/libkrb5.so.3.3 2020-04-22T14:17:15.846 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root mem REG 8,1 603768 5292 /usr/lib64/libgssapi_krb5.so.2.2 2020-04-22T14:17:15.846 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root mem REG 8,1 69720 4984 /usr/lib64/libpsl.so.5.3.1 2020-04-22T14:17:15.846 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root mem REG 8,1 772872 5005 /usr/lib64/libssh.so.4.8.1 2020-04-22T14:17:15.846 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root mem REG 8,1 162224 3672 /usr/lib64/libidn2.so.0.3.6 2020-04-22T14:17:15.847 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root mem REG 8,1 171424 4862 /usr/lib64/libnghttp2.so.14.17.0 2020-04-22T14:17:15.847 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:15.847 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root mem REG 8,1 144392 3449 /usr/lib64/libgpg-error.so.0.24.2 2020-04-22T14:17:15.847 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:15.847 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:15.847 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:15.847 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:15.848 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root mem REG 8,1 1517464 3390 /usr/lib64/libxml2.so.2.9.7 2020-04-22T14:17:15.848 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root mem REG 8,1 845392 5019 /usr/lib64/libcurl.so.4.5.0 2020-04-22T14:17:15.848 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root mem REG 8,1 1385560 3654 /usr/lib64/libgcrypt.so.20.2.3 2020-04-22T14:17:15.848 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root mem REG 8,1 52400 4902 /usr/lib64/libsysfs.so.2.0.1 2020-04-22T14:17:15.848 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:15.848 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.848 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root 1u unix 0x00000000adbee975 0t0 25114 type=STREAM 2020-04-22T14:17:15.848 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root 2u unix 0x00000000adbee975 0t0 25114 type=STREAM 2020-04-22T14:17:15.849 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root 3r CHR 10,183 0t0 1204 /dev/hwrng 2020-04-22T14:17:15.849 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 root 4u CHR 1,8 0t0 1032 /dev/random 2020-04-22T14:17:15.849 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.849 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.849 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root txt REG 8,1 68912 8952 /usr/sbin/rngd 2020-04-22T14:17:15.849 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:15.849 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root mem REG 8,1 142712 3373 /usr/lib64/libcrypt.so.1.1.0 2020-04-22T14:17:15.850 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:15.850 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root mem REG 8,1 131400 4834 /usr/lib64/libbrotlicommon.so.1.0.6 2020-04-22T14:17:15.851 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root mem REG 8,1 149160 4994 /usr/lib64/libsasl2.so.3.0.0 2020-04-22T14:17:15.852 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:15.852 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root mem REG 8,1 16240 3641 /usr/lib64/libkeyutils.so.1.6 2020-04-22T14:17:15.852 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root mem REG 8,1 118728 5304 /usr/lib64/libkrb5support.so.0.1 2020-04-22T14:17:15.852 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:15.853 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root mem REG 8,1 1760264 3670 /usr/lib64/libunistring.so.2.1.0 2020-04-22T14:17:15.853 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:15.853 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:15.853 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:15.854 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root mem REG 8,1 50456 4836 /usr/lib64/libbrotlidec.so.1.0.6 2020-04-22T14:17:15.854 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root mem REG 8,1 97056 5009 /usr/lib64/liblber-2.4.so.2.10.9 2020-04-22T14:17:15.854 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root mem REG 8,1 477472 5011 /usr/lib64/libldap-2.4.so.2.10.9 2020-04-22T14:17:15.855 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root mem REG 8,1 25992 3339 /usr/lib64/libcom_err.so.2.1 2020-04-22T14:17:15.855 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root mem REG 8,1 273488 5296 /usr/lib64/libk5crypto.so.3.1 2020-04-22T14:17:15.855 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root mem REG 8,1 1507952 5302 /usr/lib64/libkrb5.so.3.3 2020-04-22T14:17:15.855 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root mem REG 8,1 603768 5292 /usr/lib64/libgssapi_krb5.so.2.2 2020-04-22T14:17:15.855 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root mem REG 8,1 69720 4984 /usr/lib64/libpsl.so.5.3.1 2020-04-22T14:17:15.855 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root mem REG 8,1 772872 5005 /usr/lib64/libssh.so.4.8.1 2020-04-22T14:17:15.855 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root mem REG 8,1 162224 3672 /usr/lib64/libidn2.so.0.3.6 2020-04-22T14:17:15.856 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root mem REG 8,1 171424 4862 /usr/lib64/libnghttp2.so.14.17.0 2020-04-22T14:17:15.856 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:15.856 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root mem REG 8,1 144392 3449 /usr/lib64/libgpg-error.so.0.24.2 2020-04-22T14:17:15.856 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:15.856 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:15.856 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:15.856 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:15.856 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root mem REG 8,1 1517464 3390 /usr/lib64/libxml2.so.2.9.7 2020-04-22T14:17:15.857 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root mem REG 8,1 845392 5019 /usr/lib64/libcurl.so.4.5.0 2020-04-22T14:17:15.857 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root mem REG 8,1 1385560 3654 /usr/lib64/libgcrypt.so.20.2.3 2020-04-22T14:17:15.857 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root mem REG 8,1 52400 4902 /usr/lib64/libsysfs.so.2.0.1 2020-04-22T14:17:15.857 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:15.857 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.857 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root 1u unix 0x00000000adbee975 0t0 25114 type=STREAM 2020-04-22T14:17:15.857 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root 2u unix 0x00000000adbee975 0t0 25114 type=STREAM 2020-04-22T14:17:15.858 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root 3r CHR 10,183 0t0 1204 /dev/hwrng 2020-04-22T14:17:15.858 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2453 rngd root 4u CHR 1,8 0t0 1032 /dev/random 2020-04-22T14:17:15.858 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.858 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.858 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root txt REG 8,1 68912 8952 /usr/sbin/rngd 2020-04-22T14:17:15.858 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:15.859 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root mem REG 8,1 142712 3373 /usr/lib64/libcrypt.so.1.1.0 2020-04-22T14:17:15.859 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:15.859 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root mem REG 8,1 131400 4834 /usr/lib64/libbrotlicommon.so.1.0.6 2020-04-22T14:17:15.859 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root mem REG 8,1 149160 4994 /usr/lib64/libsasl2.so.3.0.0 2020-04-22T14:17:15.859 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:15.859 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root mem REG 8,1 16240 3641 /usr/lib64/libkeyutils.so.1.6 2020-04-22T14:17:15.859 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root mem REG 8,1 118728 5304 /usr/lib64/libkrb5support.so.0.1 2020-04-22T14:17:15.859 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:15.860 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root mem REG 8,1 1760264 3670 /usr/lib64/libunistring.so.2.1.0 2020-04-22T14:17:15.860 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:15.860 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:15.860 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:15.860 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root mem REG 8,1 50456 4836 /usr/lib64/libbrotlidec.so.1.0.6 2020-04-22T14:17:15.861 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root mem REG 8,1 97056 5009 /usr/lib64/liblber-2.4.so.2.10.9 2020-04-22T14:17:15.861 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root mem REG 8,1 477472 5011 /usr/lib64/libldap-2.4.so.2.10.9 2020-04-22T14:17:15.861 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root mem REG 8,1 25992 3339 /usr/lib64/libcom_err.so.2.1 2020-04-22T14:17:15.861 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root mem REG 8,1 273488 5296 /usr/lib64/libk5crypto.so.3.1 2020-04-22T14:17:15.861 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root mem REG 8,1 1507952 5302 /usr/lib64/libkrb5.so.3.3 2020-04-22T14:17:15.862 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root mem REG 8,1 603768 5292 /usr/lib64/libgssapi_krb5.so.2.2 2020-04-22T14:17:15.862 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root mem REG 8,1 69720 4984 /usr/lib64/libpsl.so.5.3.1 2020-04-22T14:17:15.862 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root mem REG 8,1 772872 5005 /usr/lib64/libssh.so.4.8.1 2020-04-22T14:17:15.862 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root mem REG 8,1 162224 3672 /usr/lib64/libidn2.so.0.3.6 2020-04-22T14:17:15.862 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root mem REG 8,1 171424 4862 /usr/lib64/libnghttp2.so.14.17.0 2020-04-22T14:17:15.862 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:15.862 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root mem REG 8,1 144392 3449 /usr/lib64/libgpg-error.so.0.24.2 2020-04-22T14:17:15.862 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:15.863 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:15.863 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:15.863 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:15.863 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root mem REG 8,1 1517464 3390 /usr/lib64/libxml2.so.2.9.7 2020-04-22T14:17:15.863 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root mem REG 8,1 845392 5019 /usr/lib64/libcurl.so.4.5.0 2020-04-22T14:17:15.863 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root mem REG 8,1 1385560 3654 /usr/lib64/libgcrypt.so.20.2.3 2020-04-22T14:17:15.864 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root mem REG 8,1 52400 4902 /usr/lib64/libsysfs.so.2.0.1 2020-04-22T14:17:15.864 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:15.864 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.864 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root 1u unix 0x00000000adbee975 0t0 25114 type=STREAM 2020-04-22T14:17:15.864 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root 2u unix 0x00000000adbee975 0t0 25114 type=STREAM 2020-04-22T14:17:15.864 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root 3r CHR 10,183 0t0 1204 /dev/hwrng 2020-04-22T14:17:15.864 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2454 rngd root 4u CHR 1,8 0t0 1032 /dev/random 2020-04-22T14:17:15.864 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.865 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.865 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root txt REG 8,1 68912 8952 /usr/sbin/rngd 2020-04-22T14:17:15.865 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:15.865 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root mem REG 8,1 142712 3373 /usr/lib64/libcrypt.so.1.1.0 2020-04-22T14:17:15.865 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:15.865 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root mem REG 8,1 131400 4834 /usr/lib64/libbrotlicommon.so.1.0.6 2020-04-22T14:17:15.865 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root mem REG 8,1 149160 4994 /usr/lib64/libsasl2.so.3.0.0 2020-04-22T14:17:15.865 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:15.866 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root mem REG 8,1 16240 3641 /usr/lib64/libkeyutils.so.1.6 2020-04-22T14:17:15.866 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root mem REG 8,1 118728 5304 /usr/lib64/libkrb5support.so.0.1 2020-04-22T14:17:15.866 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:15.866 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root mem REG 8,1 1760264 3670 /usr/lib64/libunistring.so.2.1.0 2020-04-22T14:17:15.867 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:15.868 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:15.868 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:15.869 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root mem REG 8,1 50456 4836 /usr/lib64/libbrotlidec.so.1.0.6 2020-04-22T14:17:15.869 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root mem REG 8,1 97056 5009 /usr/lib64/liblber-2.4.so.2.10.9 2020-04-22T14:17:15.869 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root mem REG 8,1 477472 5011 /usr/lib64/libldap-2.4.so.2.10.9 2020-04-22T14:17:15.870 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root mem REG 8,1 25992 3339 /usr/lib64/libcom_err.so.2.1 2020-04-22T14:17:15.870 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root mem REG 8,1 273488 5296 /usr/lib64/libk5crypto.so.3.1 2020-04-22T14:17:15.870 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root mem REG 8,1 1507952 5302 /usr/lib64/libkrb5.so.3.3 2020-04-22T14:17:15.870 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root mem REG 8,1 603768 5292 /usr/lib64/libgssapi_krb5.so.2.2 2020-04-22T14:17:15.870 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root mem REG 8,1 69720 4984 /usr/lib64/libpsl.so.5.3.1 2020-04-22T14:17:15.870 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root mem REG 8,1 772872 5005 /usr/lib64/libssh.so.4.8.1 2020-04-22T14:17:15.871 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root mem REG 8,1 162224 3672 /usr/lib64/libidn2.so.0.3.6 2020-04-22T14:17:15.871 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root mem REG 8,1 171424 4862 /usr/lib64/libnghttp2.so.14.17.0 2020-04-22T14:17:15.871 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:15.871 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root mem REG 8,1 144392 3449 /usr/lib64/libgpg-error.so.0.24.2 2020-04-22T14:17:15.871 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:15.871 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:15.871 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:15.871 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:15.872 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root mem REG 8,1 1517464 3390 /usr/lib64/libxml2.so.2.9.7 2020-04-22T14:17:15.872 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root mem REG 8,1 845392 5019 /usr/lib64/libcurl.so.4.5.0 2020-04-22T14:17:15.872 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root mem REG 8,1 1385560 3654 /usr/lib64/libgcrypt.so.20.2.3 2020-04-22T14:17:15.872 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root mem REG 8,1 52400 4902 /usr/lib64/libsysfs.so.2.0.1 2020-04-22T14:17:15.872 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:15.872 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.872 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root 1u unix 0x00000000adbee975 0t0 25114 type=STREAM 2020-04-22T14:17:15.873 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root 2u unix 0x00000000adbee975 0t0 25114 type=STREAM 2020-04-22T14:17:15.873 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root 3r CHR 10,183 0t0 1204 /dev/hwrng 2020-04-22T14:17:15.874 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2455 rngd root 4u CHR 1,8 0t0 1032 /dev/random 2020-04-22T14:17:15.874 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.874 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.874 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root txt REG 8,1 68912 8952 /usr/sbin/rngd 2020-04-22T14:17:15.874 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:15.875 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root mem REG 8,1 142712 3373 /usr/lib64/libcrypt.so.1.1.0 2020-04-22T14:17:15.876 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:15.876 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root mem REG 8,1 131400 4834 /usr/lib64/libbrotlicommon.so.1.0.6 2020-04-22T14:17:15.876 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root mem REG 8,1 149160 4994 /usr/lib64/libsasl2.so.3.0.0 2020-04-22T14:17:15.876 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:15.876 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root mem REG 8,1 16240 3641 /usr/lib64/libkeyutils.so.1.6 2020-04-22T14:17:15.877 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root mem REG 8,1 118728 5304 /usr/lib64/libkrb5support.so.0.1 2020-04-22T14:17:15.877 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:15.877 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root mem REG 8,1 1760264 3670 /usr/lib64/libunistring.so.2.1.0 2020-04-22T14:17:15.877 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:15.877 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:15.877 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:15.877 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root mem REG 8,1 50456 4836 /usr/lib64/libbrotlidec.so.1.0.6 2020-04-22T14:17:15.878 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root mem REG 8,1 97056 5009 /usr/lib64/liblber-2.4.so.2.10.9 2020-04-22T14:17:15.878 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root mem REG 8,1 477472 5011 /usr/lib64/libldap-2.4.so.2.10.9 2020-04-22T14:17:15.878 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root mem REG 8,1 25992 3339 /usr/lib64/libcom_err.so.2.1 2020-04-22T14:17:15.878 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root mem REG 8,1 273488 5296 /usr/lib64/libk5crypto.so.3.1 2020-04-22T14:17:15.878 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root mem REG 8,1 1507952 5302 /usr/lib64/libkrb5.so.3.3 2020-04-22T14:17:15.878 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root mem REG 8,1 603768 5292 /usr/lib64/libgssapi_krb5.so.2.2 2020-04-22T14:17:15.878 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root mem REG 8,1 69720 4984 /usr/lib64/libpsl.so.5.3.1 2020-04-22T14:17:15.878 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root mem REG 8,1 772872 5005 /usr/lib64/libssh.so.4.8.1 2020-04-22T14:17:15.879 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root mem REG 8,1 162224 3672 /usr/lib64/libidn2.so.0.3.6 2020-04-22T14:17:15.879 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root mem REG 8,1 171424 4862 /usr/lib64/libnghttp2.so.14.17.0 2020-04-22T14:17:15.879 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:15.879 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root mem REG 8,1 144392 3449 /usr/lib64/libgpg-error.so.0.24.2 2020-04-22T14:17:15.879 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:15.879 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:15.879 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:15.880 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:15.880 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root mem REG 8,1 1517464 3390 /usr/lib64/libxml2.so.2.9.7 2020-04-22T14:17:15.880 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root mem REG 8,1 845392 5019 /usr/lib64/libcurl.so.4.5.0 2020-04-22T14:17:15.880 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root mem REG 8,1 1385560 3654 /usr/lib64/libgcrypt.so.20.2.3 2020-04-22T14:17:15.880 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root mem REG 8,1 52400 4902 /usr/lib64/libsysfs.so.2.0.1 2020-04-22T14:17:15.880 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:15.881 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.881 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root 1u unix 0x00000000adbee975 0t0 25114 type=STREAM 2020-04-22T14:17:15.881 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root 2u unix 0x00000000adbee975 0t0 25114 type=STREAM 2020-04-22T14:17:15.881 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root 3r CHR 10,183 0t0 1204 /dev/hwrng 2020-04-22T14:17:15.882 INFO:teuthology.orchestra.run.smithi103.stdout:rngd 2411 2456 rngd root 4u CHR 1,8 0t0 1032 /dev/random 2020-04-22T14:17:15.882 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.882 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.882 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus txt REG 8,1 345256 5585 /usr/bin/dbus-daemon 2020-04-22T14:17:15.882 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus mem REG 8,1 860880 5511 /usr/lib64/libnss_systemd.so.2 2020-04-22T14:17:15.882 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:15.882 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:15.883 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus mem REG 8,1 144392 3449 /usr/lib64/libgpg-error.so.0.24.2 2020-04-22T14:17:15.883 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:15.883 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:15.883 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:15.883 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:15.883 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:15.883 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus mem REG 8,1 1385560 3654 /usr/lib64/libgcrypt.so.20.2.3 2020-04-22T14:17:15.883 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:15.884 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:15.884 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:15.884 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:15.884 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:15.884 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:15.884 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:15.884 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus mem REG 8,1 25192 3584 /usr/lib64/libcap-ng.so.0.0.0 2020-04-22T14:17:15.885 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus mem REG 8,1 141392 3586 /usr/lib64/libaudit.so.1.0.0 2020-04-22T14:17:15.885 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:15.885 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus mem REG 8,1 244736 3491 /usr/lib64/libexpat.so.1.6.7 2020-04-22T14:17:15.885 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus mem REG 8,1 1637336 5512 /usr/lib64/libsystemd.so.0.23.0 2020-04-22T14:17:15.885 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus mem REG 8,1 505672 5398 /usr/lib64/libdbus-1.so.3.19.7 2020-04-22T14:17:15.885 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:15.886 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus 0u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.886 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus 1u unix 0x000000007e5077cf 0t0 26031 type=STREAM 2020-04-22T14:17:15.886 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus 2u unix 0x000000007e5077cf 0t0 26031 type=STREAM 2020-04-22T14:17:15.886 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus 3u unix 0x00000000f6fb48ec 0t0 22100 /run/dbus/system_bus_socket type=STREAM 2020-04-22T14:17:15.886 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus 4u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:15.886 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus 5u unix 0x000000001a685395 0t0 157203 type=STREAM 2020-04-22T14:17:15.886 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus 6u unix 0x00000000438af625 0t0 40674 /run/dbus/system_bus_socket type=STREAM 2020-04-22T14:17:15.887 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus 7u netlink 0t0 25322 AUDIT 2020-04-22T14:17:15.887 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus 8u netlink 0t0 25323 SELINUX 2020-04-22T14:17:15.887 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus 9r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:15.887 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus 10u unix 0x000000005c9e28fb 0t0 25328 type=STREAM 2020-04-22T14:17:15.887 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus 11u unix 0x0000000093e2a339 0t0 25329 type=STREAM 2020-04-22T14:17:15.887 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus 12u unix 0x000000003b5a67a0 0t0 25330 /run/dbus/system_bus_socket type=STREAM 2020-04-22T14:17:15.887 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus 13u unix 0x00000000a38c20d3 0t0 24272 /run/dbus/system_bus_socket type=STREAM 2020-04-22T14:17:15.887 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus 14u unix 0x0000000076207bb8 0t0 27028 /run/dbus/system_bus_socket type=STREAM 2020-04-22T14:17:15.888 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus 15u unix 0x000000004383a4e2 0t0 24364 type=DGRAM 2020-04-22T14:17:15.888 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus 16u unix 0x000000005c017da4 0t0 38033 /run/dbus/system_bus_socket type=STREAM 2020-04-22T14:17:15.888 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus 19u unix 0x00000000e9d99b91 0t0 26389 /run/dbus/system_bus_socket type=STREAM 2020-04-22T14:17:15.888 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus 21u unix 0x00000000d662efc2 0t0 28924 /run/dbus/system_bus_socket type=STREAM 2020-04-22T14:17:15.888 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 dbus 22u unix 0x00000000fc766516 0t0 28152 /run/dbus/system_bus_socket type=STREAM 2020-04-22T14:17:15.888 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.888 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.889 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus txt REG 8,1 345256 5585 /usr/bin/dbus-daemon 2020-04-22T14:17:15.889 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus mem REG 8,1 860880 5511 /usr/lib64/libnss_systemd.so.2 2020-04-22T14:17:15.889 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:15.889 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:15.889 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus mem REG 8,1 144392 3449 /usr/lib64/libgpg-error.so.0.24.2 2020-04-22T14:17:15.889 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:15.889 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:15.890 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:15.890 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:15.890 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:15.890 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus mem REG 8,1 1385560 3654 /usr/lib64/libgcrypt.so.20.2.3 2020-04-22T14:17:15.890 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:15.890 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:15.890 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:15.890 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:15.891 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:15.891 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:15.891 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:15.891 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus mem REG 8,1 25192 3584 /usr/lib64/libcap-ng.so.0.0.0 2020-04-22T14:17:15.891 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus mem REG 8,1 141392 3586 /usr/lib64/libaudit.so.1.0.0 2020-04-22T14:17:15.891 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:15.891 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus mem REG 8,1 244736 3491 /usr/lib64/libexpat.so.1.6.7 2020-04-22T14:17:15.892 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus mem REG 8,1 1637336 5512 /usr/lib64/libsystemd.so.0.23.0 2020-04-22T14:17:15.892 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus mem REG 8,1 505672 5398 /usr/lib64/libdbus-1.so.3.19.7 2020-04-22T14:17:15.892 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:15.892 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus 0u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.892 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus 1u unix 0x000000007e5077cf 0t0 26031 type=STREAM 2020-04-22T14:17:15.892 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus 2u unix 0x000000007e5077cf 0t0 26031 type=STREAM 2020-04-22T14:17:15.892 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus 3u unix 0x00000000f6fb48ec 0t0 22100 /run/dbus/system_bus_socket type=STREAM 2020-04-22T14:17:15.892 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus 4u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:15.893 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus 5u unix 0x000000001a685395 0t0 157203 type=STREAM 2020-04-22T14:17:15.893 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus 6u unix 0x00000000438af625 0t0 40674 /run/dbus/system_bus_socket type=STREAM 2020-04-22T14:17:15.893 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus 7u netlink 0t0 25322 AUDIT 2020-04-22T14:17:15.893 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus 8u netlink 0t0 25323 SELINUX 2020-04-22T14:17:15.893 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus 9r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:15.893 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus 10u unix 0x000000005c9e28fb 0t0 25328 type=STREAM 2020-04-22T14:17:15.893 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus 11u unix 0x0000000093e2a339 0t0 25329 type=STREAM 2020-04-22T14:17:15.894 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus 12u unix 0x000000003b5a67a0 0t0 25330 /run/dbus/system_bus_socket type=STREAM 2020-04-22T14:17:15.894 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus 13u unix 0x00000000a38c20d3 0t0 24272 /run/dbus/system_bus_socket type=STREAM 2020-04-22T14:17:15.894 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus 14u unix 0x0000000076207bb8 0t0 27028 /run/dbus/system_bus_socket type=STREAM 2020-04-22T14:17:15.894 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus 15u unix 0x000000004383a4e2 0t0 24364 type=DGRAM 2020-04-22T14:17:15.894 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus 16u unix 0x000000005c017da4 0t0 38033 /run/dbus/system_bus_socket type=STREAM 2020-04-22T14:17:15.894 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus 19u unix 0x00000000e9d99b91 0t0 26389 /run/dbus/system_bus_socket type=STREAM 2020-04-22T14:17:15.895 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus 21u unix 0x00000000d662efc2 0t0 28924 /run/dbus/system_bus_socket type=STREAM 2020-04-22T14:17:15.895 INFO:teuthology.orchestra.run.smithi103.stdout:dbus-daem 2412 2500 dbus-daem dbus 22u unix 0x00000000fc766516 0t0 28152 /run/dbus/system_bus_socket type=STREAM 2020-04-22T14:17:15.895 INFO:teuthology.orchestra.run.smithi103.stdout:lsmd 2414 libstoragemgmt cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.895 INFO:teuthology.orchestra.run.smithi103.stdout:lsmd 2414 libstoragemgmt rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.895 INFO:teuthology.orchestra.run.smithi103.stdout:lsmd 2414 libstoragemgmt txt REG 8,1 30600 7680 /usr/bin/lsmd 2020-04-22T14:17:15.895 INFO:teuthology.orchestra.run.smithi103.stdout:lsmd 2414 libstoragemgmt mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:15.895 INFO:teuthology.orchestra.run.smithi103.stdout:lsmd 2414 libstoragemgmt DEL REG 8,1 65728 /var/lib/sss/mc/passwd 2020-04-22T14:17:15.896 INFO:teuthology.orchestra.run.smithi103.stdout:lsmd 2414 libstoragemgmt mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:15.896 INFO:teuthology.orchestra.run.smithi103.stdout:lsmd 2414 libstoragemgmt mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:15.896 INFO:teuthology.orchestra.run.smithi103.stdout:lsmd 2414 libstoragemgmt mem REG 8,1 54680 4558 /usr/lib64/libconfig.so.9.2.0 2020-04-22T14:17:15.896 INFO:teuthology.orchestra.run.smithi103.stdout:lsmd 2414 libstoragemgmt mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:15.896 INFO:teuthology.orchestra.run.smithi103.stdout:lsmd 2414 libstoragemgmt 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.896 INFO:teuthology.orchestra.run.smithi103.stdout:lsmd 2414 libstoragemgmt 1u unix 0x0000000080446a39 0t0 22240 type=STREAM 2020-04-22T14:17:15.896 INFO:teuthology.orchestra.run.smithi103.stdout:lsmd 2414 libstoragemgmt 2u unix 0x00000000b11b12c5 0t0 22241 type=STREAM 2020-04-22T14:17:15.896 INFO:teuthology.orchestra.run.smithi103.stdout:lsmd 2414 libstoragemgmt 3r REG 8,1 8406312 65728 /var/lib/sss/mc/passwd (deleted) 2020-04-22T14:17:15.897 INFO:teuthology.orchestra.run.smithi103.stdout:lsmd 2414 libstoragemgmt 4u unix 0x00000000321061fc 0t0 22244 /var/run/lsm/ipc/simc type=STREAM 2020-04-22T14:17:15.897 INFO:teuthology.orchestra.run.smithi103.stdout:lsmd 2414 libstoragemgmt 5u unix 0x0000000050e535d1 0t0 22246 /var/run/lsm/ipc/sim type=STREAM 2020-04-22T14:17:15.897 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.897 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.897 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root txt REG 8,1 107992 8787 /usr/sbin/sssd 2020-04-22T14:17:15.897 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 860880 5511 /usr/lib64/libnss_systemd.so.2 2020-04-22T14:17:15.897 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root DEL REG 8,1 65679 /var/lib/sss/mc/initgroups 2020-04-22T14:17:15.898 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 1609728 65559 /var/lib/sss/db/timestamps_implicit_files.ldb 2020-04-22T14:17:15.898 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 3080192 65556 /var/lib/sss/db/cache_implicit_files.ldb 2020-04-22T14:17:15.898 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:15.898 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:15.898 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root DEL REG 8,1 65728 /var/lib/sss/mc/passwd 2020-04-22T14:17:15.898 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:15.898 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 9216 41912 /usr/lib64/ldb/modules/ldb/tdb.so 2020-04-22T14:17:15.898 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 13408 41911 /usr/lib64/ldb/modules/ldb/skel.so 2020-04-22T14:17:15.899 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 17496 41910 /usr/lib64/ldb/modules/ldb/server_sort.so 2020-04-22T14:17:15.899 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 13584 41909 /usr/lib64/ldb/modules/ldb/sample.so 2020-04-22T14:17:15.899 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 17536 41908 /usr/lib64/ldb/modules/ldb/rdn_name.so 2020-04-22T14:17:15.899 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 17600 41907 /usr/lib64/ldb/modules/ldb/paged_searches.so 2020-04-22T14:17:15.899 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 81312 43861 /usr/lib64/ldb/modules/ldb/memberof.so 2020-04-22T14:17:15.899 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 19200 41900 /usr/lib64/ldb/libldb-tdb-err-map.so 2020-04-22T14:17:15.899 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 33600 41901 /usr/lib64/ldb/libldb-tdb-int.so 2020-04-22T14:17:15.900 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 99352 41899 /usr/lib64/ldb/libldb-key-value.so 2020-04-22T14:17:15.900 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 9232 41906 /usr/lib64/ldb/modules/ldb/ldb.so 2020-04-22T14:17:15.900 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 118728 5304 /usr/lib64/libkrb5support.so.0.1 2020-04-22T14:17:15.900 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 25992 3339 /usr/lib64/libcom_err.so.2.1 2020-04-22T14:17:15.900 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 273488 5296 /usr/lib64/libk5crypto.so.3.1 2020-04-22T14:17:15.900 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 1507952 5302 /usr/lib64/libkrb5.so.3.3 2020-04-22T14:17:15.900 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 603768 5292 /usr/lib64/libgssapi_krb5.so.2.2 2020-04-22T14:17:15.900 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:15.901 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 149160 4994 /usr/lib64/libsasl2.so.3.0.0 2020-04-22T14:17:15.901 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:15.901 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 97056 5009 /usr/lib64/liblber-2.4.so.2.10.9 2020-04-22T14:17:15.901 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 477472 5011 /usr/lib64/libldap-2.4.so.2.10.9 2020-04-22T14:17:15.901 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 35648 41905 /usr/lib64/ldb/modules/ldb/ldap.so 2020-04-22T14:17:15.901 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 17488 41904 /usr/lib64/ldb/modules/ldb/asq.so 2020-04-22T14:17:15.901 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:15.902 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 1503456 3656 /usr/lib64/libgmp.so.10.3.2 2020-04-22T14:17:15.902 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 248080 3819 /usr/lib64/libhogweed.so.4.5 2020-04-22T14:17:15.902 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 299920 3821 /usr/lib64/libnettle.so.6.5 2020-04-22T14:17:15.902 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 81408 3851 /usr/lib64/libtasn1.so.6.5.5 2020-04-22T14:17:15.902 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 1760264 3670 /usr/lib64/libunistring.so.2.1.0 2020-04-22T14:17:15.902 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 162224 3672 /usr/lib64/libidn2.so.0.3.6 2020-04-22T14:17:15.903 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 1295528 3648 /usr/lib64/libp11-kit.so.0.3.0 2020-04-22T14:17:15.903 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 144392 3449 /usr/lib64/libgpg-error.so.0.24.2 2020-04-22T14:17:15.903 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:15.903 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:15.903 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 2521184 6329 /usr/lib64/libgnutls.so.30.24.0 2020-04-22T14:17:15.903 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:15.903 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 1385560 3654 /usr/lib64/libgcrypt.so.20.2.3 2020-04-22T14:17:15.904 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:15.904 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:15.904 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:15.904 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:15.904 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:15.904 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 16160 4303 /usr/lib64/libpath_utils.so.1.0.1 2020-04-22T14:17:15.904 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:15.905 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 142712 3373 /usr/lib64/libcrypt.so.1.1.0 2020-04-22T14:17:15.905 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:15.905 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:15.905 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:15.905 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 1471440 6261 /usr/lib64/libglib-2.0.so.0.5600.4 2020-04-22T14:17:15.905 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 505672 5398 /usr/lib64/libdbus-1.so.3.19.7 2020-04-22T14:17:15.905 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 94816 3405 /usr/lib64/libtalloc.so.2.1.16 2020-04-22T14:17:15.905 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 117040 3472 /usr/lib64/libtevent.so.0.9.39 2020-04-22T14:17:15.906 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 16216 3593 /usr/lib64/libdhash.so.1.1.0 2020-04-22T14:17:15.906 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 375248 34713 /usr/lib64/sssd/libsss_sbus.so 2020-04-22T14:17:15.906 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 166344 34849 /usr/lib64/sssd/libsss_iface.so 2020-04-22T14:17:15.906 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 1637336 5512 /usr/lib64/libsystemd.so.0.23.0 2020-04-22T14:17:15.906 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 26800 34847 /usr/lib64/sssd/libsss_debug.so 2020-04-22T14:17:15.906 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:15.906 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 89680 6613 /usr/lib64/libsss_certmap.so.0.1.0 2020-04-22T14:17:15.907 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 27064 34845 /usr/lib64/sssd/libsss_child.so 2020-04-22T14:17:15.907 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 42104 34846 /usr/lib64/sssd/libsss_crypt.so 2020-04-22T14:17:15.907 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 34408 34704 /usr/lib64/sssd/libsss_cert.so 2020-04-22T14:17:15.907 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 55560 3591 /usr/lib64/libcollection.so.4.1.1 2020-04-22T14:17:15.907 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 12024 3595 /usr/lib64/libref_array.so.1.2.1 2020-04-22T14:17:15.907 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 11848 3582 /usr/lib64/libbasicobjects.so.0.1.0 2020-04-22T14:17:15.907 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 117048 4305 /usr/lib64/libini_config.so.5.2.1 2020-04-22T14:17:15.907 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 471224 3494 /usr/lib64/libpcre.so.1.2.10 2020-04-22T14:17:15.908 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 133496 3481 /usr/lib64/libtdb.so.1.3.18 2020-04-22T14:17:15.908 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:15.908 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 254736 6611 /usr/lib64/libldb.so.1.5.4 2020-04-22T14:17:15.908 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 55688 3341 /usr/lib64/libpopt.so.0.0.0 2020-04-22T14:17:15.908 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:15.908 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 681936 34717 /usr/lib64/sssd/libsss_util.so 2020-04-22T14:17:15.908 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 16240 3641 /usr/lib64/libkeyutils.so.1.6 2020-04-22T14:17:15.909 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:15.909 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:15.909 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:15.909 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:15.909 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:15.909 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:15.909 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:15.909 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:15.910 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:15.910 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 1286144 65539 /var/lib/sss/db/config.ldb 2020-04-22T14:17:15.910 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:15.910 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:15.910 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:15.911 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:15.911 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:15.911 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:15.911 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root 0r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:15.911 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root 1u unix 0x000000000bfacfd9 0t0 21261 type=STREAM 2020-04-22T14:17:15.911 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root 2u unix 0x000000000bfacfd9 0t0 21261 type=STREAM 2020-04-22T14:17:15.911 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root 3w REG 8,1 0 65554 /var/log/sssd/sssd.log 2020-04-22T14:17:15.911 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root 4u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:15.912 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root 5u REG 8,1 1286144 65539 /var/lib/sss/db/config.ldb 2020-04-22T14:17:15.912 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root 6r REG 8,1 8406312 65728 /var/lib/sss/mc/passwd (deleted) 2020-04-22T14:17:15.912 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root 7u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.912 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:15.912 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root 9u unix 0x00000000994a33b0 0t0 27964 type=DGRAM 2020-04-22T14:17:15.912 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root 10u REG 8,1 3080192 65556 /var/lib/sss/db/cache_implicit_files.ldb 2020-04-22T14:17:15.912 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:15.913 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root 12u REG 8,1 1609728 65559 /var/lib/sss/db/timestamps_implicit_files.ldb 2020-04-22T14:17:15.913 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root 13u unix 0x0000000033f15af3 0t0 27968 /var/lib/sss/pipes/private/sbus-monitor type=STREAM 2020-04-22T14:17:15.913 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root 14u unix 0x00000000f1c2581c 0t0 27969 type=STREAM 2020-04-22T14:17:15.913 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root 15u unix 0x000000003ba654c2 0t0 27970 /var/lib/sss/pipes/private/sbus-monitor type=STREAM 2020-04-22T14:17:15.913 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root 16r REG 8,1 10406312 65679 /var/lib/sss/mc/initgroups (deleted) 2020-04-22T14:17:15.913 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root 17u netlink 0t0 27974 ROUTE 2020-04-22T14:17:15.913 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root 18u unix 0x000000002325688b 0t0 28740 /var/lib/sss/pipes/private/sbus-monitor type=STREAM 2020-04-22T14:17:15.913 INFO:teuthology.orchestra.run.smithi103.stdout:sssd 2419 root 19u unix 0x00000000a7cf6811 0t0 28816 /var/lib/sss/pipes/private/sbus-monitor type=STREAM 2020-04-22T14:17:15.914 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.914 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.914 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root txt REG 8,1 7356504 7081 /usr/sbin/NetworkManager 2020-04-22T14:17:15.914 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 386952 56791 /usr/lib64/NetworkManager/1.20.0-5.el8_1/libnm-settings-plugin-ifcfg-rh.so 2020-04-22T14:17:15.914 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 505672 5398 /usr/lib64/libdbus-1.so.3.19.7 2020-04-22T14:17:15.914 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 65736 3639 /usr/lib64/libjansson.so.4.11.0 2020-04-22T14:17:15.914 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 53632 8746 /usr/lib64/libteamdctl.so.0.1.5 2020-04-22T14:17:15.915 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 66480 59375 /usr/lib64/NetworkManager/1.20.0-5.el8_1/libnm-device-plugin-team.so 2020-04-22T14:17:15.915 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:15.915 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:15.915 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:15.915 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:15.915 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 37336 4572 /usr/lib64/libmodman.so.1.0.0 2020-04-22T14:17:15.915 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 144768 4575 /usr/lib64/libproxy.so.1.0.0 2020-04-22T14:17:15.916 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:15.916 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 142712 3373 /usr/lib64/libcrypt.so.1.1.0 2020-04-22T14:17:15.916 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 131400 4834 /usr/lib64/libbrotlicommon.so.1.0.6 2020-04-22T14:17:15.916 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:15.916 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 149160 4994 /usr/lib64/libsasl2.so.3.0.0 2020-04-22T14:17:15.916 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 16240 3641 /usr/lib64/libkeyutils.so.1.6 2020-04-22T14:17:15.916 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 118728 5304 /usr/lib64/libkrb5support.so.0.1 2020-04-22T14:17:15.916 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 144392 3449 /usr/lib64/libgpg-error.so.0.24.2 2020-04-22T14:17:15.917 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:15.917 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:15.917 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 471224 3494 /usr/lib64/libpcre.so.1.2.10 2020-04-22T14:17:15.917 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:15.917 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:15.917 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 50456 4836 /usr/lib64/libbrotlidec.so.1.0.6 2020-04-22T14:17:15.917 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 97056 5009 /usr/lib64/liblber-2.4.so.2.10.9 2020-04-22T14:17:15.918 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 477472 5011 /usr/lib64/libldap-2.4.so.2.10.9 2020-04-22T14:17:15.918 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 25992 3339 /usr/lib64/libcom_err.so.2.1 2020-04-22T14:17:15.918 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 273488 5296 /usr/lib64/libk5crypto.so.3.1 2020-04-22T14:17:15.918 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 1507952 5302 /usr/lib64/libkrb5.so.3.3 2020-04-22T14:17:15.918 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 603768 5292 /usr/lib64/libgssapi_krb5.so.2.2 2020-04-22T14:17:15.918 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:15.918 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:15.918 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 69720 4984 /usr/lib64/libpsl.so.5.3.1 2020-04-22T14:17:15.919 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 772872 5005 /usr/lib64/libssh.so.4.8.1 2020-04-22T14:17:15.919 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 171424 4862 /usr/lib64/libnghttp2.so.14.17.0 2020-04-22T14:17:15.919 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 25192 3584 /usr/lib64/libcap-ng.so.0.0.0 2020-04-22T14:17:15.919 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:15.919 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 1385560 3654 /usr/lib64/libgcrypt.so.20.2.3 2020-04-22T14:17:15.919 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:15.920 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:15.920 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:15.920 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:15.920 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:15.920 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 1503456 3656 /usr/lib64/libgmp.so.10.3.2 2020-04-22T14:17:15.920 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 248080 3819 /usr/lib64/libhogweed.so.4.5 2020-04-22T14:17:15.920 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 299920 3821 /usr/lib64/libnettle.so.6.5 2020-04-22T14:17:15.921 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 81408 3851 /usr/lib64/libtasn1.so.6.5.5 2020-04-22T14:17:15.921 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 1760264 3670 /usr/lib64/libunistring.so.2.1.0 2020-04-22T14:17:15.921 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 162224 3672 /usr/lib64/libidn2.so.0.3.6 2020-04-22T14:17:15.921 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 1295528 3648 /usr/lib64/libp11-kit.so.0.3.0 2020-04-22T14:17:15.921 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:15.921 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:15.921 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:15.921 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:15.922 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 1471440 6261 /usr/lib64/libglib-2.0.so.0.5600.4 2020-04-22T14:17:15.922 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 18224 6263 /usr/lib64/libgmodule-2.0.so.0.5600.4 2020-04-22T14:17:15.922 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 435432 6265 /usr/lib64/libgobject-2.0.so.0.5600.4 2020-04-22T14:17:15.922 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 2508264 6259 /usr/lib64/libgio-2.0.so.0.5600.4 2020-04-22T14:17:15.922 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 845392 5019 /usr/lib64/libcurl.so.4.5.0 2020-04-22T14:17:15.922 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 141392 3586 /usr/lib64/libaudit.so.1.0.0 2020-04-22T14:17:15.922 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:15.922 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 74872 4860 /usr/lib64/libndp.so.0.1.1 2020-04-22T14:17:15.923 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 1637336 5512 /usr/lib64/libsystemd.so.0.23.0 2020-04-22T14:17:15.923 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:15.923 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 2521184 6329 /usr/lib64/libgnutls.so.30.24.0 2020-04-22T14:17:15.923 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:15.923 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:15.923 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:15.923 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:15.924 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:15.924 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:15.924 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:15.924 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:15.924 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:15.924 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:15.924 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:15.924 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:15.925 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:15.925 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:15.925 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.925 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root 1u unix 0x00000000f0bfee79 0t0 26093 type=STREAM 2020-04-22T14:17:15.925 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root 2u unix 0x00000000f0bfee79 0t0 26093 type=STREAM 2020-04-22T14:17:15.925 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root 3u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.925 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root 4u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.926 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root 5u unix 0x00000000907544fe 0t0 26349 type=DGRAM 2020-04-22T14:17:15.926 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root 6u unix 0x0000000054976e8f 0t0 26350 type=STREAM 2020-04-22T14:17:15.926 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root 7u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.926 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root 8r REG 0,3 0 4026532000 net 2020-04-22T14:17:15.926 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root 9r REG 0,3 0 4026532497 mnt 2020-04-22T14:17:15.926 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root 10u netlink 0t0 28683 KOBJECT_UEVENT 2020-04-22T14:17:15.926 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root 11u netlink 0t0 28684 GENERIC 2020-04-22T14:17:15.926 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root 12u netlink 0t0 28685 ROUTE 2020-04-22T14:17:15.927 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root 13u unix 0x000000003c567817 0t0 305199 type=STREAM 2020-04-22T14:17:15.927 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root 14r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:15.927 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root 15r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:15.927 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root 16u netlink 0t0 27966 KOBJECT_UEVENT 2020-04-22T14:17:15.927 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root 17u unix 0x00000000bc3aaf79 0t0 30410 type=STREAM 2020-04-22T14:17:15.927 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root 18u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:15.928 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root 19u IPv4 34605 0t0 UDP smithi103:bootpc 2020-04-22T14:17:15.928 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root 20w FIFO 0,24 0t0 27150 /run/systemd/inhibit/1.ref 2020-04-22T14:17:15.928 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root 21u a_inode 0,14 0 2063 [timerfd] 2020-04-22T14:17:15.928 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root 22r REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:15.928 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root 23u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:15.928 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root 24u a_inode 0,14 0 2063 [timerfd] 2020-04-22T14:17:15.928 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root 25u pack 341848 0t0 ARP type=SOCK_DGRAM 2020-04-22T14:17:15.928 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 root 26u raw6 0t0 341853 00000000000000000000000000000000:003A->00000000000000000000000000000000:0000 st=07 2020-04-22T14:17:15.929 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.929 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.929 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root txt REG 8,1 7356504 7081 /usr/sbin/NetworkManager 2020-04-22T14:17:15.929 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 386952 56791 /usr/lib64/NetworkManager/1.20.0-5.el8_1/libnm-settings-plugin-ifcfg-rh.so 2020-04-22T14:17:15.929 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 505672 5398 /usr/lib64/libdbus-1.so.3.19.7 2020-04-22T14:17:15.929 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 65736 3639 /usr/lib64/libjansson.so.4.11.0 2020-04-22T14:17:15.929 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 53632 8746 /usr/lib64/libteamdctl.so.0.1.5 2020-04-22T14:17:15.930 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 66480 59375 /usr/lib64/NetworkManager/1.20.0-5.el8_1/libnm-device-plugin-team.so 2020-04-22T14:17:15.930 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:15.930 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:15.930 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:15.930 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:15.930 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 37336 4572 /usr/lib64/libmodman.so.1.0.0 2020-04-22T14:17:15.930 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 144768 4575 /usr/lib64/libproxy.so.1.0.0 2020-04-22T14:17:15.931 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:15.931 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 142712 3373 /usr/lib64/libcrypt.so.1.1.0 2020-04-22T14:17:15.931 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 131400 4834 /usr/lib64/libbrotlicommon.so.1.0.6 2020-04-22T14:17:15.931 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:15.931 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 149160 4994 /usr/lib64/libsasl2.so.3.0.0 2020-04-22T14:17:15.931 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 16240 3641 /usr/lib64/libkeyutils.so.1.6 2020-04-22T14:17:15.931 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 118728 5304 /usr/lib64/libkrb5support.so.0.1 2020-04-22T14:17:15.931 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 144392 3449 /usr/lib64/libgpg-error.so.0.24.2 2020-04-22T14:17:15.932 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:15.932 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:15.932 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 471224 3494 /usr/lib64/libpcre.so.1.2.10 2020-04-22T14:17:15.932 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:15.932 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:15.932 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 50456 4836 /usr/lib64/libbrotlidec.so.1.0.6 2020-04-22T14:17:15.932 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 97056 5009 /usr/lib64/liblber-2.4.so.2.10.9 2020-04-22T14:17:15.933 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 477472 5011 /usr/lib64/libldap-2.4.so.2.10.9 2020-04-22T14:17:15.933 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 25992 3339 /usr/lib64/libcom_err.so.2.1 2020-04-22T14:17:15.933 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 273488 5296 /usr/lib64/libk5crypto.so.3.1 2020-04-22T14:17:15.933 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 1507952 5302 /usr/lib64/libkrb5.so.3.3 2020-04-22T14:17:15.933 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 603768 5292 /usr/lib64/libgssapi_krb5.so.2.2 2020-04-22T14:17:15.933 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:15.933 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:15.933 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 69720 4984 /usr/lib64/libpsl.so.5.3.1 2020-04-22T14:17:15.934 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 772872 5005 /usr/lib64/libssh.so.4.8.1 2020-04-22T14:17:15.934 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 171424 4862 /usr/lib64/libnghttp2.so.14.17.0 2020-04-22T14:17:15.934 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 25192 3584 /usr/lib64/libcap-ng.so.0.0.0 2020-04-22T14:17:15.934 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:15.934 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 1385560 3654 /usr/lib64/libgcrypt.so.20.2.3 2020-04-22T14:17:15.934 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:15.934 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:15.935 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:15.935 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:15.935 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:15.935 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 1503456 3656 /usr/lib64/libgmp.so.10.3.2 2020-04-22T14:17:15.935 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 248080 3819 /usr/lib64/libhogweed.so.4.5 2020-04-22T14:17:15.935 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 299920 3821 /usr/lib64/libnettle.so.6.5 2020-04-22T14:17:15.936 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 81408 3851 /usr/lib64/libtasn1.so.6.5.5 2020-04-22T14:17:15.936 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 1760264 3670 /usr/lib64/libunistring.so.2.1.0 2020-04-22T14:17:15.936 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 162224 3672 /usr/lib64/libidn2.so.0.3.6 2020-04-22T14:17:15.936 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 1295528 3648 /usr/lib64/libp11-kit.so.0.3.0 2020-04-22T14:17:15.936 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:15.936 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:15.937 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:15.937 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:15.937 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 1471440 6261 /usr/lib64/libglib-2.0.so.0.5600.4 2020-04-22T14:17:15.937 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 18224 6263 /usr/lib64/libgmodule-2.0.so.0.5600.4 2020-04-22T14:17:15.937 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 435432 6265 /usr/lib64/libgobject-2.0.so.0.5600.4 2020-04-22T14:17:15.937 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 2508264 6259 /usr/lib64/libgio-2.0.so.0.5600.4 2020-04-22T14:17:15.937 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 845392 5019 /usr/lib64/libcurl.so.4.5.0 2020-04-22T14:17:15.937 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 141392 3586 /usr/lib64/libaudit.so.1.0.0 2020-04-22T14:17:15.938 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:15.938 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 74872 4860 /usr/lib64/libndp.so.0.1.1 2020-04-22T14:17:15.938 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 1637336 5512 /usr/lib64/libsystemd.so.0.23.0 2020-04-22T14:17:15.938 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:15.938 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 2521184 6329 /usr/lib64/libgnutls.so.30.24.0 2020-04-22T14:17:15.938 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:15.938 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:15.939 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:15.939 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:15.939 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:15.939 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:15.939 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:15.939 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:15.939 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:15.939 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:15.940 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:15.940 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:15.940 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:15.940 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:15.940 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.940 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root 1u unix 0x00000000f0bfee79 0t0 26093 type=STREAM 2020-04-22T14:17:15.940 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root 2u unix 0x00000000f0bfee79 0t0 26093 type=STREAM 2020-04-22T14:17:15.941 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root 3u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.941 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root 4u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.941 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root 5u unix 0x00000000907544fe 0t0 26349 type=DGRAM 2020-04-22T14:17:15.941 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root 6u unix 0x0000000054976e8f 0t0 26350 type=STREAM 2020-04-22T14:17:15.941 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root 7u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.941 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root 8r REG 0,3 0 4026532000 net 2020-04-22T14:17:15.941 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root 9r REG 0,3 0 4026532497 mnt 2020-04-22T14:17:15.942 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root 10u netlink 0t0 28683 KOBJECT_UEVENT 2020-04-22T14:17:15.942 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root 11u netlink 0t0 28684 GENERIC 2020-04-22T14:17:15.942 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root 12u netlink 0t0 28685 ROUTE 2020-04-22T14:17:15.942 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root 13u unix 0x000000003c567817 0t0 305199 type=STREAM 2020-04-22T14:17:15.942 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root 14r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:15.942 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root 15r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:15.942 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root 16u netlink 0t0 27966 KOBJECT_UEVENT 2020-04-22T14:17:15.942 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root 17u unix 0x00000000bc3aaf79 0t0 30410 type=STREAM 2020-04-22T14:17:15.943 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root 18u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:15.943 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root 19u IPv4 34605 0t0 UDP smithi103:bootpc 2020-04-22T14:17:15.943 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root 20w FIFO 0,24 0t0 27150 /run/systemd/inhibit/1.ref 2020-04-22T14:17:15.943 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root 21u a_inode 0,14 0 2063 [timerfd] 2020-04-22T14:17:15.943 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root 22r REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:15.943 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root 23u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:15.943 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root 24u a_inode 0,14 0 2063 [timerfd] 2020-04-22T14:17:15.944 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root 25u pack 341848 0t0 ARP type=SOCK_DGRAM 2020-04-22T14:17:15.944 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2506 gmain root 26u raw6 0t0 341853 00000000000000000000000000000000:003A->00000000000000000000000000000000:0000 st=07 2020-04-22T14:17:15.944 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.944 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.944 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root txt REG 8,1 7356504 7081 /usr/sbin/NetworkManager 2020-04-22T14:17:15.944 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 386952 56791 /usr/lib64/NetworkManager/1.20.0-5.el8_1/libnm-settings-plugin-ifcfg-rh.so 2020-04-22T14:17:15.945 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 505672 5398 /usr/lib64/libdbus-1.so.3.19.7 2020-04-22T14:17:15.945 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 65736 3639 /usr/lib64/libjansson.so.4.11.0 2020-04-22T14:17:15.945 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 53632 8746 /usr/lib64/libteamdctl.so.0.1.5 2020-04-22T14:17:15.945 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 66480 59375 /usr/lib64/NetworkManager/1.20.0-5.el8_1/libnm-device-plugin-team.so 2020-04-22T14:17:15.945 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:15.945 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:15.945 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:15.946 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:15.946 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 37336 4572 /usr/lib64/libmodman.so.1.0.0 2020-04-22T14:17:15.946 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 144768 4575 /usr/lib64/libproxy.so.1.0.0 2020-04-22T14:17:15.946 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:15.946 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 142712 3373 /usr/lib64/libcrypt.so.1.1.0 2020-04-22T14:17:15.946 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 131400 4834 /usr/lib64/libbrotlicommon.so.1.0.6 2020-04-22T14:17:15.946 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:15.946 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 149160 4994 /usr/lib64/libsasl2.so.3.0.0 2020-04-22T14:17:15.947 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 16240 3641 /usr/lib64/libkeyutils.so.1.6 2020-04-22T14:17:15.947 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 118728 5304 /usr/lib64/libkrb5support.so.0.1 2020-04-22T14:17:15.947 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 144392 3449 /usr/lib64/libgpg-error.so.0.24.2 2020-04-22T14:17:15.947 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:15.947 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:15.947 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 471224 3494 /usr/lib64/libpcre.so.1.2.10 2020-04-22T14:17:15.947 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:15.948 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:15.948 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 50456 4836 /usr/lib64/libbrotlidec.so.1.0.6 2020-04-22T14:17:15.948 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 97056 5009 /usr/lib64/liblber-2.4.so.2.10.9 2020-04-22T14:17:15.948 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 477472 5011 /usr/lib64/libldap-2.4.so.2.10.9 2020-04-22T14:17:15.948 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 25992 3339 /usr/lib64/libcom_err.so.2.1 2020-04-22T14:17:15.948 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 273488 5296 /usr/lib64/libk5crypto.so.3.1 2020-04-22T14:17:15.948 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 1507952 5302 /usr/lib64/libkrb5.so.3.3 2020-04-22T14:17:15.948 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 603768 5292 /usr/lib64/libgssapi_krb5.so.2.2 2020-04-22T14:17:15.949 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:15.949 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:15.949 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 69720 4984 /usr/lib64/libpsl.so.5.3.1 2020-04-22T14:17:15.949 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 772872 5005 /usr/lib64/libssh.so.4.8.1 2020-04-22T14:17:15.949 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 171424 4862 /usr/lib64/libnghttp2.so.14.17.0 2020-04-22T14:17:15.949 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 25192 3584 /usr/lib64/libcap-ng.so.0.0.0 2020-04-22T14:17:15.949 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:15.950 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 1385560 3654 /usr/lib64/libgcrypt.so.20.2.3 2020-04-22T14:17:15.950 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:15.950 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:15.950 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:15.950 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:15.950 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:15.950 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 1503456 3656 /usr/lib64/libgmp.so.10.3.2 2020-04-22T14:17:15.950 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 248080 3819 /usr/lib64/libhogweed.so.4.5 2020-04-22T14:17:15.951 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 299920 3821 /usr/lib64/libnettle.so.6.5 2020-04-22T14:17:15.951 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 81408 3851 /usr/lib64/libtasn1.so.6.5.5 2020-04-22T14:17:15.951 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 1760264 3670 /usr/lib64/libunistring.so.2.1.0 2020-04-22T14:17:15.951 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 162224 3672 /usr/lib64/libidn2.so.0.3.6 2020-04-22T14:17:15.951 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 1295528 3648 /usr/lib64/libp11-kit.so.0.3.0 2020-04-22T14:17:15.951 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:15.951 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:15.952 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:15.952 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:15.952 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 1471440 6261 /usr/lib64/libglib-2.0.so.0.5600.4 2020-04-22T14:17:15.952 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 18224 6263 /usr/lib64/libgmodule-2.0.so.0.5600.4 2020-04-22T14:17:15.952 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 435432 6265 /usr/lib64/libgobject-2.0.so.0.5600.4 2020-04-22T14:17:15.952 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 2508264 6259 /usr/lib64/libgio-2.0.so.0.5600.4 2020-04-22T14:17:15.953 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 845392 5019 /usr/lib64/libcurl.so.4.5.0 2020-04-22T14:17:15.953 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 141392 3586 /usr/lib64/libaudit.so.1.0.0 2020-04-22T14:17:15.953 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:15.953 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 74872 4860 /usr/lib64/libndp.so.0.1.1 2020-04-22T14:17:15.953 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 1637336 5512 /usr/lib64/libsystemd.so.0.23.0 2020-04-22T14:17:15.953 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:15.953 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 2521184 6329 /usr/lib64/libgnutls.so.30.24.0 2020-04-22T14:17:15.953 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:15.954 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:15.954 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:15.954 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:15.954 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:15.954 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:15.954 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:15.954 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:15.955 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:15.955 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:15.955 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:15.955 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:15.955 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:15.955 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:15.955 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.955 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root 1u unix 0x00000000f0bfee79 0t0 26093 type=STREAM 2020-04-22T14:17:15.956 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root 2u unix 0x00000000f0bfee79 0t0 26093 type=STREAM 2020-04-22T14:17:15.956 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root 3u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.956 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root 4u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.956 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root 5u unix 0x00000000907544fe 0t0 26349 type=DGRAM 2020-04-22T14:17:15.956 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root 6u unix 0x0000000054976e8f 0t0 26350 type=STREAM 2020-04-22T14:17:15.956 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root 7u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.956 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root 8r REG 0,3 0 4026532000 net 2020-04-22T14:17:15.957 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root 9r REG 0,3 0 4026532497 mnt 2020-04-22T14:17:15.957 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root 10u netlink 0t0 28683 KOBJECT_UEVENT 2020-04-22T14:17:15.957 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root 11u netlink 0t0 28684 GENERIC 2020-04-22T14:17:15.957 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root 12u netlink 0t0 28685 ROUTE 2020-04-22T14:17:15.957 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root 13u unix 0x000000003c567817 0t0 305199 type=STREAM 2020-04-22T14:17:15.957 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root 14r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:15.957 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root 15r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:15.957 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root 16u netlink 0t0 27966 KOBJECT_UEVENT 2020-04-22T14:17:15.958 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root 17u unix 0x00000000bc3aaf79 0t0 30410 type=STREAM 2020-04-22T14:17:15.958 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root 18u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:15.958 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root 19u IPv4 34605 0t0 UDP smithi103:bootpc 2020-04-22T14:17:15.958 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root 20w FIFO 0,24 0t0 27150 /run/systemd/inhibit/1.ref 2020-04-22T14:17:15.958 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root 21u a_inode 0,14 0 2063 [timerfd] 2020-04-22T14:17:15.958 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root 22r REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:15.958 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root 23u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:15.959 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root 24u a_inode 0,14 0 2063 [timerfd] 2020-04-22T14:17:15.959 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root 25u pack 341848 0t0 ARP type=SOCK_DGRAM 2020-04-22T14:17:15.959 INFO:teuthology.orchestra.run.smithi103.stdout:NetworkMa 2420 2507 gdbus root 26u raw6 0t0 341853 00000000000000000000000000000000:003A->00000000000000000000000000000000:0000 st=07 2020-04-22T14:17:15.959 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.959 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.959 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 root txt REG 8,1 89592 9170 /usr/sbin/irqbalance 2020-04-22T14:17:15.959 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 root mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:15.959 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 root mem REG 8,1 1503456 3656 /usr/lib64/libgmp.so.10.3.2 2020-04-22T14:17:15.960 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 root mem REG 8,1 248080 3819 /usr/lib64/libhogweed.so.4.5 2020-04-22T14:17:15.960 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 root mem REG 8,1 299920 3821 /usr/lib64/libnettle.so.6.5 2020-04-22T14:17:15.960 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 root mem REG 8,1 81408 3851 /usr/lib64/libtasn1.so.6.5.5 2020-04-22T14:17:15.960 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 root mem REG 8,1 1760264 3670 /usr/lib64/libunistring.so.2.1.0 2020-04-22T14:17:15.960 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 root mem REG 8,1 162224 3672 /usr/lib64/libidn2.so.0.3.6 2020-04-22T14:17:15.960 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 root mem REG 8,1 1295528 3648 /usr/lib64/libp11-kit.so.0.3.0 2020-04-22T14:17:15.960 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:15.961 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:15.961 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 root mem REG 8,1 471224 3494 /usr/lib64/libpcre.so.1.2.10 2020-04-22T14:17:15.961 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 root mem REG 8,1 2521184 6329 /usr/lib64/libgnutls.so.30.24.0 2020-04-22T14:17:15.961 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:15.961 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 root mem REG 8,1 208616 3175 /usr/lib64/libtinfo.so.6.1 2020-04-22T14:17:15.961 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 root mem REG 8,1 300104 3167 /usr/lib64/libncursesw.so.6.1 2020-04-22T14:17:15.962 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 root mem REG 8,1 62488 4908 /usr/lib64/libnuma.so.1.0.0 2020-04-22T14:17:15.962 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:15.962 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 root mem REG 8,1 1471440 6261 /usr/lib64/libglib-2.0.so.0.5600.4 2020-04-22T14:17:15.962 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 root mem REG 8,1 25192 3584 /usr/lib64/libcap-ng.so.0.0.0 2020-04-22T14:17:15.962 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:15.962 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.962 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 root 1u unix 0x00000000802cb36a 0t0 21331 type=STREAM 2020-04-22T14:17:15.963 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 root 2u unix 0x00000000802cb36a 0t0 21331 type=STREAM 2020-04-22T14:17:15.963 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 root 3u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.963 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 root 4u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.963 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 root 5u unix 0x000000003f68781d 0t0 21416 @irqbalance2434.sock type=STREAM 2020-04-22T14:17:15.963 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 2445 gmain root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.963 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 2445 gmain root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.963 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 2445 gmain root txt REG 8,1 89592 9170 /usr/sbin/irqbalance 2020-04-22T14:17:15.963 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 2445 gmain root mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:15.964 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 2445 gmain root mem REG 8,1 1503456 3656 /usr/lib64/libgmp.so.10.3.2 2020-04-22T14:17:15.964 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 2445 gmain root mem REG 8,1 248080 3819 /usr/lib64/libhogweed.so.4.5 2020-04-22T14:17:15.964 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 2445 gmain root mem REG 8,1 299920 3821 /usr/lib64/libnettle.so.6.5 2020-04-22T14:17:15.964 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 2445 gmain root mem REG 8,1 81408 3851 /usr/lib64/libtasn1.so.6.5.5 2020-04-22T14:17:15.964 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 2445 gmain root mem REG 8,1 1760264 3670 /usr/lib64/libunistring.so.2.1.0 2020-04-22T14:17:15.964 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 2445 gmain root mem REG 8,1 162224 3672 /usr/lib64/libidn2.so.0.3.6 2020-04-22T14:17:15.964 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 2445 gmain root mem REG 8,1 1295528 3648 /usr/lib64/libp11-kit.so.0.3.0 2020-04-22T14:17:15.965 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 2445 gmain root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:15.965 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 2445 gmain root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:15.965 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 2445 gmain root mem REG 8,1 471224 3494 /usr/lib64/libpcre.so.1.2.10 2020-04-22T14:17:15.965 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 2445 gmain root mem REG 8,1 2521184 6329 /usr/lib64/libgnutls.so.30.24.0 2020-04-22T14:17:15.965 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 2445 gmain root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:15.965 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 2445 gmain root mem REG 8,1 208616 3175 /usr/lib64/libtinfo.so.6.1 2020-04-22T14:17:15.965 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 2445 gmain root mem REG 8,1 300104 3167 /usr/lib64/libncursesw.so.6.1 2020-04-22T14:17:15.966 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 2445 gmain root mem REG 8,1 62488 4908 /usr/lib64/libnuma.so.1.0.0 2020-04-22T14:17:15.966 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 2445 gmain root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:15.966 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 2445 gmain root mem REG 8,1 1471440 6261 /usr/lib64/libglib-2.0.so.0.5600.4 2020-04-22T14:17:15.966 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 2445 gmain root mem REG 8,1 25192 3584 /usr/lib64/libcap-ng.so.0.0.0 2020-04-22T14:17:15.966 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 2445 gmain root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:15.966 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 2445 gmain root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.966 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 2445 gmain root 1u unix 0x00000000802cb36a 0t0 21331 type=STREAM 2020-04-22T14:17:15.966 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 2445 gmain root 2u unix 0x00000000802cb36a 0t0 21331 type=STREAM 2020-04-22T14:17:15.967 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 2445 gmain root 3u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.967 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 2445 gmain root 4u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:15.967 INFO:teuthology.orchestra.run.smithi103.stdout:irqbalanc 2434 2445 gmain root 5u unix 0x000000003f68781d 0t0 21416 @irqbalance2434.sock type=STREAM 2020-04-22T14:17:15.967 INFO:teuthology.orchestra.run.smithi103.stdout:smartd 2435 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.967 INFO:teuthology.orchestra.run.smithi103.stdout:smartd 2435 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.967 INFO:teuthology.orchestra.run.smithi103.stdout:smartd 2435 root txt REG 8,1 817896 9166 /usr/sbin/smartd 2020-04-22T14:17:15.967 INFO:teuthology.orchestra.run.smithi103.stdout:smartd 2435 root mem REG 8,1 144392 3449 /usr/lib64/libgpg-error.so.0.24.2 2020-04-22T14:17:15.967 INFO:teuthology.orchestra.run.smithi103.stdout:smartd 2435 root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:15.968 INFO:teuthology.orchestra.run.smithi103.stdout:smartd 2435 root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:15.968 INFO:teuthology.orchestra.run.smithi103.stdout:smartd 2435 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:15.968 INFO:teuthology.orchestra.run.smithi103.stdout:smartd 2435 root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:15.968 INFO:teuthology.orchestra.run.smithi103.stdout:smartd 2435 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:15.968 INFO:teuthology.orchestra.run.smithi103.stdout:smartd 2435 root mem REG 8,1 1385560 3654 /usr/lib64/libgcrypt.so.20.2.3 2020-04-22T14:17:15.968 INFO:teuthology.orchestra.run.smithi103.stdout:smartd 2435 root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:15.968 INFO:teuthology.orchestra.run.smithi103.stdout:smartd 2435 root mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:15.969 INFO:teuthology.orchestra.run.smithi103.stdout:smartd 2435 root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:15.969 INFO:teuthology.orchestra.run.smithi103.stdout:smartd 2435 root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:15.969 INFO:teuthology.orchestra.run.smithi103.stdout:smartd 2435 root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:15.969 INFO:teuthology.orchestra.run.smithi103.stdout:smartd 2435 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:15.969 INFO:teuthology.orchestra.run.smithi103.stdout:smartd 2435 root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:15.969 INFO:teuthology.orchestra.run.smithi103.stdout:smartd 2435 root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:15.970 INFO:teuthology.orchestra.run.smithi103.stdout:smartd 2435 root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:15.970 INFO:teuthology.orchestra.run.smithi103.stdout:smartd 2435 root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:15.970 INFO:teuthology.orchestra.run.smithi103.stdout:smartd 2435 root mem REG 8,1 1637336 5512 /usr/lib64/libsystemd.so.0.23.0 2020-04-22T14:17:15.970 INFO:teuthology.orchestra.run.smithi103.stdout:smartd 2435 root mem REG 8,1 25192 3584 /usr/lib64/libcap-ng.so.0.0.0 2020-04-22T14:17:15.970 INFO:teuthology.orchestra.run.smithi103.stdout:smartd 2435 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:15.970 INFO:teuthology.orchestra.run.smithi103.stdout:smartd 2435 root 0u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.970 INFO:teuthology.orchestra.run.smithi103.stdout:smartd 2435 root 1u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.971 INFO:teuthology.orchestra.run.smithi103.stdout:smartd 2435 root 2u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.971 INFO:teuthology.orchestra.run.smithi103.stdout:ksmtuned 2446 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.971 INFO:teuthology.orchestra.run.smithi103.stdout:ksmtuned 2446 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.971 INFO:teuthology.orchestra.run.smithi103.stdout:ksmtuned 2446 root txt REG 8,1 1596592 3225 /usr/bin/bash 2020-04-22T14:17:15.971 INFO:teuthology.orchestra.run.smithi103.stdout:ksmtuned 2446 root mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:15.971 INFO:teuthology.orchestra.run.smithi103.stdout:ksmtuned 2446 root DEL REG 8,1 65728 /var/lib/sss/mc/passwd 2020-04-22T14:17:15.971 INFO:teuthology.orchestra.run.smithi103.stdout:ksmtuned 2446 root mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:15.971 INFO:teuthology.orchestra.run.smithi103.stdout:ksmtuned 2446 root mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:15.972 INFO:teuthology.orchestra.run.smithi103.stdout:ksmtuned 2446 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:15.972 INFO:teuthology.orchestra.run.smithi103.stdout:ksmtuned 2446 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:15.972 INFO:teuthology.orchestra.run.smithi103.stdout:ksmtuned 2446 root mem REG 8,1 208616 3175 /usr/lib64/libtinfo.so.6.1 2020-04-22T14:17:15.972 INFO:teuthology.orchestra.run.smithi103.stdout:ksmtuned 2446 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:15.972 INFO:teuthology.orchestra.run.smithi103.stdout:ksmtuned 2446 root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:15.972 INFO:teuthology.orchestra.run.smithi103.stdout:ksmtuned 2446 root mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:15.972 INFO:teuthology.orchestra.run.smithi103.stdout:ksmtuned 2446 root mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:15.973 INFO:teuthology.orchestra.run.smithi103.stdout:ksmtuned 2446 root mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:15.973 INFO:teuthology.orchestra.run.smithi103.stdout:ksmtuned 2446 root mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:15.973 INFO:teuthology.orchestra.run.smithi103.stdout:ksmtuned 2446 root mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:15.973 INFO:teuthology.orchestra.run.smithi103.stdout:ksmtuned 2446 root mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:15.973 INFO:teuthology.orchestra.run.smithi103.stdout:ksmtuned 2446 root mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:15.973 INFO:teuthology.orchestra.run.smithi103.stdout:ksmtuned 2446 root mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:15.973 INFO:teuthology.orchestra.run.smithi103.stdout:ksmtuned 2446 root mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:15.973 INFO:teuthology.orchestra.run.smithi103.stdout:ksmtuned 2446 root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:15.974 INFO:teuthology.orchestra.run.smithi103.stdout:ksmtuned 2446 root mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:15.974 INFO:teuthology.orchestra.run.smithi103.stdout:ksmtuned 2446 root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.974 INFO:teuthology.orchestra.run.smithi103.stdout:ksmtuned 2446 root 1u unix 0x0000000048b8626c 0t0 22340 type=STREAM 2020-04-22T14:17:15.974 INFO:teuthology.orchestra.run.smithi103.stdout:ksmtuned 2446 root 2u unix 0x0000000048b8626c 0t0 22340 type=STREAM 2020-04-22T14:17:15.974 INFO:teuthology.orchestra.run.smithi103.stdout:ksmtuned 2446 root 3r REG 8,1 8406312 65728 /var/lib/sss/mc/passwd (deleted) 2020-04-22T14:17:15.974 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.974 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.975 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root txt REG 8,1 189208 11048 /usr/sbin/gssproxy 2020-04-22T14:17:15.975 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root mem REG 8,1 379136 7146 /usr/lib64/libevent-2.1.so.6.0.2 2020-04-22T14:17:15.975 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root mem REG 8,1 12136 11047 /usr/lib64/libverto-libevent.so.1.0.0 2020-04-22T14:17:15.975 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:15.975 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:15.975 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:15.975 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root mem REG 8,1 16160 4303 /usr/lib64/libpath_utils.so.1.0.1 2020-04-22T14:17:15.975 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:15.976 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:15.976 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root mem REG 8,1 16240 3641 /usr/lib64/libkeyutils.so.1.6 2020-04-22T14:17:15.976 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:15.976 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root mem REG 8,1 118728 5304 /usr/lib64/libkrb5support.so.0.1 2020-04-22T14:17:15.976 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:15.976 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:15.976 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root mem REG 8,1 603768 5292 /usr/lib64/libgssapi_krb5.so.2.2 2020-04-22T14:17:15.977 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root mem REG 8,1 245344 5294 /usr/lib64/libgssrpc.so.4.2 2020-04-22T14:17:15.977 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:15.977 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root mem REG 8,1 55560 3591 /usr/lib64/libcollection.so.4.1.1 2020-04-22T14:17:15.977 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root mem REG 8,1 12024 3595 /usr/lib64/libref_array.so.1.2.1 2020-04-22T14:17:15.977 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root mem REG 8,1 11848 3582 /usr/lib64/libbasicobjects.so.0.1.0 2020-04-22T14:17:15.977 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root mem REG 8,1 117048 4305 /usr/lib64/libini_config.so.5.2.1 2020-04-22T14:17:15.977 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root mem REG 8,1 24872 4904 /usr/lib64/libverto.so.1.0.0 2020-04-22T14:17:15.977 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root mem REG 8,1 25992 3339 /usr/lib64/libcom_err.so.2.1 2020-04-22T14:17:15.978 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root mem REG 8,1 273488 5296 /usr/lib64/libk5crypto.so.3.1 2020-04-22T14:17:15.978 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root mem REG 8,1 1507952 5302 /usr/lib64/libkrb5.so.3.3 2020-04-22T14:17:15.978 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root mem REG 8,1 55688 3341 /usr/lib64/libpopt.so.0.0.0 2020-04-22T14:17:15.978 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:15.978 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:15.978 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:15.979 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:15.979 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:15.979 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:15.979 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:15.979 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:15.979 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:15.979 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:15.979 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:15.980 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:15.980 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:15.980 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.980 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root 1u unix 0x0000000042417cb2 0t0 26952 type=STREAM 2020-04-22T14:17:15.980 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root 2u unix 0x0000000042417cb2 0t0 26952 type=STREAM 2020-04-22T14:17:15.980 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root 3u unix 0x00000000681093b6 0t0 27935 type=DGRAM 2020-04-22T14:17:15.980 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root 4r FIFO 0,13 0t0 26227 pipe 2020-04-22T14:17:15.981 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:15.981 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root 6r FIFO 0,13 0t0 26216 pipe 2020-04-22T14:17:15.981 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root 7w FIFO 0,13 0t0 26216 pipe 2020-04-22T14:17:15.981 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root 8u unix 0x0000000025820d8b 0t0 26222 /var/lib/gssproxy/default.sock type=STREAM 2020-04-22T14:17:15.981 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root 9u unix 0x00000000e934b246 0t0 26223 /run/gssproxy.sock type=STREAM 2020-04-22T14:17:15.981 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 root 10w FIFO 0,13 0t0 26227 pipe 2020-04-22T14:17:15.981 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.981 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.982 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root txt REG 8,1 189208 11048 /usr/sbin/gssproxy 2020-04-22T14:17:15.982 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root mem REG 8,1 379136 7146 /usr/lib64/libevent-2.1.so.6.0.2 2020-04-22T14:17:15.982 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root mem REG 8,1 12136 11047 /usr/lib64/libverto-libevent.so.1.0.0 2020-04-22T14:17:15.982 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:15.982 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:15.982 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:15.982 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root mem REG 8,1 16160 4303 /usr/lib64/libpath_utils.so.1.0.1 2020-04-22T14:17:15.983 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:15.983 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:15.983 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root mem REG 8,1 16240 3641 /usr/lib64/libkeyutils.so.1.6 2020-04-22T14:17:15.983 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:15.983 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root mem REG 8,1 118728 5304 /usr/lib64/libkrb5support.so.0.1 2020-04-22T14:17:15.983 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:15.983 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:15.983 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root mem REG 8,1 603768 5292 /usr/lib64/libgssapi_krb5.so.2.2 2020-04-22T14:17:15.984 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root mem REG 8,1 245344 5294 /usr/lib64/libgssrpc.so.4.2 2020-04-22T14:17:15.984 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:15.984 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root mem REG 8,1 55560 3591 /usr/lib64/libcollection.so.4.1.1 2020-04-22T14:17:15.984 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root mem REG 8,1 12024 3595 /usr/lib64/libref_array.so.1.2.1 2020-04-22T14:17:15.984 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root mem REG 8,1 11848 3582 /usr/lib64/libbasicobjects.so.0.1.0 2020-04-22T14:17:15.984 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root mem REG 8,1 117048 4305 /usr/lib64/libini_config.so.5.2.1 2020-04-22T14:17:15.984 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root mem REG 8,1 24872 4904 /usr/lib64/libverto.so.1.0.0 2020-04-22T14:17:15.985 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root mem REG 8,1 25992 3339 /usr/lib64/libcom_err.so.2.1 2020-04-22T14:17:15.985 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root mem REG 8,1 273488 5296 /usr/lib64/libk5crypto.so.3.1 2020-04-22T14:17:15.985 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root mem REG 8,1 1507952 5302 /usr/lib64/libkrb5.so.3.3 2020-04-22T14:17:15.985 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root mem REG 8,1 55688 3341 /usr/lib64/libpopt.so.0.0.0 2020-04-22T14:17:15.985 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:15.985 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:15.985 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:15.985 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:15.986 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:15.986 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:15.986 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:15.986 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:15.986 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:15.986 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:15.986 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:15.987 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:15.987 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:15.987 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.987 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root 1u unix 0x0000000042417cb2 0t0 26952 type=STREAM 2020-04-22T14:17:15.987 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root 2u unix 0x0000000042417cb2 0t0 26952 type=STREAM 2020-04-22T14:17:15.987 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root 3u unix 0x00000000681093b6 0t0 27935 type=DGRAM 2020-04-22T14:17:15.987 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root 4r FIFO 0,13 0t0 26227 pipe 2020-04-22T14:17:15.987 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:15.988 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root 6r FIFO 0,13 0t0 26216 pipe 2020-04-22T14:17:15.988 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root 7w FIFO 0,13 0t0 26216 pipe 2020-04-22T14:17:15.988 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root 8u unix 0x0000000025820d8b 0t0 26222 /var/lib/gssproxy/default.sock type=STREAM 2020-04-22T14:17:15.988 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root 9u unix 0x00000000e934b246 0t0 26223 /run/gssproxy.sock type=STREAM 2020-04-22T14:17:15.988 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2473 gssproxy root 10w FIFO 0,13 0t0 26227 pipe 2020-04-22T14:17:15.988 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.988 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.989 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root txt REG 8,1 189208 11048 /usr/sbin/gssproxy 2020-04-22T14:17:15.989 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root mem REG 8,1 379136 7146 /usr/lib64/libevent-2.1.so.6.0.2 2020-04-22T14:17:15.989 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root mem REG 8,1 12136 11047 /usr/lib64/libverto-libevent.so.1.0.0 2020-04-22T14:17:15.989 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:15.989 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:15.989 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:15.989 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root mem REG 8,1 16160 4303 /usr/lib64/libpath_utils.so.1.0.1 2020-04-22T14:17:15.989 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:15.990 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:15.990 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root mem REG 8,1 16240 3641 /usr/lib64/libkeyutils.so.1.6 2020-04-22T14:17:15.990 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:15.990 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root mem REG 8,1 118728 5304 /usr/lib64/libkrb5support.so.0.1 2020-04-22T14:17:15.990 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:15.990 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:15.990 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root mem REG 8,1 603768 5292 /usr/lib64/libgssapi_krb5.so.2.2 2020-04-22T14:17:15.991 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root mem REG 8,1 245344 5294 /usr/lib64/libgssrpc.so.4.2 2020-04-22T14:17:15.991 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:15.991 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root mem REG 8,1 55560 3591 /usr/lib64/libcollection.so.4.1.1 2020-04-22T14:17:15.991 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root mem REG 8,1 12024 3595 /usr/lib64/libref_array.so.1.2.1 2020-04-22T14:17:15.991 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root mem REG 8,1 11848 3582 /usr/lib64/libbasicobjects.so.0.1.0 2020-04-22T14:17:15.991 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root mem REG 8,1 117048 4305 /usr/lib64/libini_config.so.5.2.1 2020-04-22T14:17:15.991 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root mem REG 8,1 24872 4904 /usr/lib64/libverto.so.1.0.0 2020-04-22T14:17:15.991 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root mem REG 8,1 25992 3339 /usr/lib64/libcom_err.so.2.1 2020-04-22T14:17:15.992 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root mem REG 8,1 273488 5296 /usr/lib64/libk5crypto.so.3.1 2020-04-22T14:17:15.992 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root mem REG 8,1 1507952 5302 /usr/lib64/libkrb5.so.3.3 2020-04-22T14:17:15.992 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root mem REG 8,1 55688 3341 /usr/lib64/libpopt.so.0.0.0 2020-04-22T14:17:15.992 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:15.992 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:15.992 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:15.992 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:15.993 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:15.993 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:15.993 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:15.993 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:15.993 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:15.993 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:15.993 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:15.994 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:15.994 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:15.994 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:15.994 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root 1u unix 0x0000000042417cb2 0t0 26952 type=STREAM 2020-04-22T14:17:15.994 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root 2u unix 0x0000000042417cb2 0t0 26952 type=STREAM 2020-04-22T14:17:15.994 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root 3u unix 0x00000000681093b6 0t0 27935 type=DGRAM 2020-04-22T14:17:15.994 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root 4r FIFO 0,13 0t0 26227 pipe 2020-04-22T14:17:15.995 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:15.995 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root 6r FIFO 0,13 0t0 26216 pipe 2020-04-22T14:17:15.995 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root 7w FIFO 0,13 0t0 26216 pipe 2020-04-22T14:17:15.995 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root 8u unix 0x0000000025820d8b 0t0 26222 /var/lib/gssproxy/default.sock type=STREAM 2020-04-22T14:17:15.995 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root 9u unix 0x00000000e934b246 0t0 26223 /run/gssproxy.sock type=STREAM 2020-04-22T14:17:15.995 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2474 gssproxy root 10w FIFO 0,13 0t0 26227 pipe 2020-04-22T14:17:15.995 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:15.995 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:15.996 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root txt REG 8,1 189208 11048 /usr/sbin/gssproxy 2020-04-22T14:17:15.996 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root mem REG 8,1 379136 7146 /usr/lib64/libevent-2.1.so.6.0.2 2020-04-22T14:17:15.996 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root mem REG 8,1 12136 11047 /usr/lib64/libverto-libevent.so.1.0.0 2020-04-22T14:17:15.996 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:15.996 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:15.996 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:15.996 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root mem REG 8,1 16160 4303 /usr/lib64/libpath_utils.so.1.0.1 2020-04-22T14:17:15.996 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:15.997 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:15.997 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root mem REG 8,1 16240 3641 /usr/lib64/libkeyutils.so.1.6 2020-04-22T14:17:15.997 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:15.997 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root mem REG 8,1 118728 5304 /usr/lib64/libkrb5support.so.0.1 2020-04-22T14:17:15.997 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:15.997 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:15.997 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root mem REG 8,1 603768 5292 /usr/lib64/libgssapi_krb5.so.2.2 2020-04-22T14:17:15.998 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root mem REG 8,1 245344 5294 /usr/lib64/libgssrpc.so.4.2 2020-04-22T14:17:15.998 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:15.998 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root mem REG 8,1 55560 3591 /usr/lib64/libcollection.so.4.1.1 2020-04-22T14:17:15.998 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root mem REG 8,1 12024 3595 /usr/lib64/libref_array.so.1.2.1 2020-04-22T14:17:15.998 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root mem REG 8,1 11848 3582 /usr/lib64/libbasicobjects.so.0.1.0 2020-04-22T14:17:15.998 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root mem REG 8,1 117048 4305 /usr/lib64/libini_config.so.5.2.1 2020-04-22T14:17:15.998 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root mem REG 8,1 24872 4904 /usr/lib64/libverto.so.1.0.0 2020-04-22T14:17:15.999 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root mem REG 8,1 25992 3339 /usr/lib64/libcom_err.so.2.1 2020-04-22T14:17:15.999 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root mem REG 8,1 273488 5296 /usr/lib64/libk5crypto.so.3.1 2020-04-22T14:17:15.999 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root mem REG 8,1 1507952 5302 /usr/lib64/libkrb5.so.3.3 2020-04-22T14:17:15.999 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root mem REG 8,1 55688 3341 /usr/lib64/libpopt.so.0.0.0 2020-04-22T14:17:15.999 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:15.999 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:15.999 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:15.999 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:16.000 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:16.000 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:16.000 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:16.000 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:16.000 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:16.000 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:16.000 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:16.001 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:16.001 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:16.001 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.001 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root 1u unix 0x0000000042417cb2 0t0 26952 type=STREAM 2020-04-22T14:17:16.001 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root 2u unix 0x0000000042417cb2 0t0 26952 type=STREAM 2020-04-22T14:17:16.001 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root 3u unix 0x00000000681093b6 0t0 27935 type=DGRAM 2020-04-22T14:17:16.001 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root 4r FIFO 0,13 0t0 26227 pipe 2020-04-22T14:17:16.001 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.002 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root 6r FIFO 0,13 0t0 26216 pipe 2020-04-22T14:17:16.002 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root 7w FIFO 0,13 0t0 26216 pipe 2020-04-22T14:17:16.002 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root 8u unix 0x0000000025820d8b 0t0 26222 /var/lib/gssproxy/default.sock type=STREAM 2020-04-22T14:17:16.002 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root 9u unix 0x00000000e934b246 0t0 26223 /run/gssproxy.sock type=STREAM 2020-04-22T14:17:16.002 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2475 gssproxy root 10w FIFO 0,13 0t0 26227 pipe 2020-04-22T14:17:16.002 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.003 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.003 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root txt REG 8,1 189208 11048 /usr/sbin/gssproxy 2020-04-22T14:17:16.003 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root mem REG 8,1 379136 7146 /usr/lib64/libevent-2.1.so.6.0.2 2020-04-22T14:17:16.003 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root mem REG 8,1 12136 11047 /usr/lib64/libverto-libevent.so.1.0.0 2020-04-22T14:17:16.003 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:16.003 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.003 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.003 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root mem REG 8,1 16160 4303 /usr/lib64/libpath_utils.so.1.0.1 2020-04-22T14:17:16.004 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.004 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.004 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root mem REG 8,1 16240 3641 /usr/lib64/libkeyutils.so.1.6 2020-04-22T14:17:16.004 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.004 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root mem REG 8,1 118728 5304 /usr/lib64/libkrb5support.so.0.1 2020-04-22T14:17:16.004 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.004 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.005 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root mem REG 8,1 603768 5292 /usr/lib64/libgssapi_krb5.so.2.2 2020-04-22T14:17:16.005 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root mem REG 8,1 245344 5294 /usr/lib64/libgssrpc.so.4.2 2020-04-22T14:17:16.005 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.005 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root mem REG 8,1 55560 3591 /usr/lib64/libcollection.so.4.1.1 2020-04-22T14:17:16.005 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root mem REG 8,1 12024 3595 /usr/lib64/libref_array.so.1.2.1 2020-04-22T14:17:16.005 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root mem REG 8,1 11848 3582 /usr/lib64/libbasicobjects.so.0.1.0 2020-04-22T14:17:16.005 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root mem REG 8,1 117048 4305 /usr/lib64/libini_config.so.5.2.1 2020-04-22T14:17:16.005 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root mem REG 8,1 24872 4904 /usr/lib64/libverto.so.1.0.0 2020-04-22T14:17:16.006 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root mem REG 8,1 25992 3339 /usr/lib64/libcom_err.so.2.1 2020-04-22T14:17:16.006 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root mem REG 8,1 273488 5296 /usr/lib64/libk5crypto.so.3.1 2020-04-22T14:17:16.006 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root mem REG 8,1 1507952 5302 /usr/lib64/libkrb5.so.3.3 2020-04-22T14:17:16.006 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root mem REG 8,1 55688 3341 /usr/lib64/libpopt.so.0.0.0 2020-04-22T14:17:16.006 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.006 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:16.006 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:16.006 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:16.007 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:16.007 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:16.007 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:16.007 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:16.007 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:16.007 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:16.007 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:16.008 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:16.008 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:16.008 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.008 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root 1u unix 0x0000000042417cb2 0t0 26952 type=STREAM 2020-04-22T14:17:16.008 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root 2u unix 0x0000000042417cb2 0t0 26952 type=STREAM 2020-04-22T14:17:16.008 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root 3u unix 0x00000000681093b6 0t0 27935 type=DGRAM 2020-04-22T14:17:16.008 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root 4r FIFO 0,13 0t0 26227 pipe 2020-04-22T14:17:16.008 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.009 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root 6r FIFO 0,13 0t0 26216 pipe 2020-04-22T14:17:16.009 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root 7w FIFO 0,13 0t0 26216 pipe 2020-04-22T14:17:16.009 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root 8u unix 0x0000000025820d8b 0t0 26222 /var/lib/gssproxy/default.sock type=STREAM 2020-04-22T14:17:16.009 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root 9u unix 0x00000000e934b246 0t0 26223 /run/gssproxy.sock type=STREAM 2020-04-22T14:17:16.009 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2476 gssproxy root 10w FIFO 0,13 0t0 26227 pipe 2020-04-22T14:17:16.009 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.009 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.010 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root txt REG 8,1 189208 11048 /usr/sbin/gssproxy 2020-04-22T14:17:16.010 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root mem REG 8,1 379136 7146 /usr/lib64/libevent-2.1.so.6.0.2 2020-04-22T14:17:16.010 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root mem REG 8,1 12136 11047 /usr/lib64/libverto-libevent.so.1.0.0 2020-04-22T14:17:16.010 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:16.010 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.010 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.010 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root mem REG 8,1 16160 4303 /usr/lib64/libpath_utils.so.1.0.1 2020-04-22T14:17:16.011 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.011 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.011 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root mem REG 8,1 16240 3641 /usr/lib64/libkeyutils.so.1.6 2020-04-22T14:17:16.011 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.011 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root mem REG 8,1 118728 5304 /usr/lib64/libkrb5support.so.0.1 2020-04-22T14:17:16.011 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.011 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.012 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root mem REG 8,1 603768 5292 /usr/lib64/libgssapi_krb5.so.2.2 2020-04-22T14:17:16.012 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root mem REG 8,1 245344 5294 /usr/lib64/libgssrpc.so.4.2 2020-04-22T14:17:16.012 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.012 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root mem REG 8,1 55560 3591 /usr/lib64/libcollection.so.4.1.1 2020-04-22T14:17:16.012 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root mem REG 8,1 12024 3595 /usr/lib64/libref_array.so.1.2.1 2020-04-22T14:17:16.012 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root mem REG 8,1 11848 3582 /usr/lib64/libbasicobjects.so.0.1.0 2020-04-22T14:17:16.012 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root mem REG 8,1 117048 4305 /usr/lib64/libini_config.so.5.2.1 2020-04-22T14:17:16.013 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root mem REG 8,1 24872 4904 /usr/lib64/libverto.so.1.0.0 2020-04-22T14:17:16.013 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root mem REG 8,1 25992 3339 /usr/lib64/libcom_err.so.2.1 2020-04-22T14:17:16.013 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root mem REG 8,1 273488 5296 /usr/lib64/libk5crypto.so.3.1 2020-04-22T14:17:16.013 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root mem REG 8,1 1507952 5302 /usr/lib64/libkrb5.so.3.3 2020-04-22T14:17:16.013 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root mem REG 8,1 55688 3341 /usr/lib64/libpopt.so.0.0.0 2020-04-22T14:17:16.013 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.013 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:16.013 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:16.014 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:16.014 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:16.014 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:16.014 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:16.014 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:16.014 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:16.014 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:16.014 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:16.015 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:16.015 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:16.015 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.015 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root 1u unix 0x0000000042417cb2 0t0 26952 type=STREAM 2020-04-22T14:17:16.015 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root 2u unix 0x0000000042417cb2 0t0 26952 type=STREAM 2020-04-22T14:17:16.015 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root 3u unix 0x00000000681093b6 0t0 27935 type=DGRAM 2020-04-22T14:17:16.015 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root 4r FIFO 0,13 0t0 26227 pipe 2020-04-22T14:17:16.016 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.016 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root 6r FIFO 0,13 0t0 26216 pipe 2020-04-22T14:17:16.016 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root 7w FIFO 0,13 0t0 26216 pipe 2020-04-22T14:17:16.016 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root 8u unix 0x0000000025820d8b 0t0 26222 /var/lib/gssproxy/default.sock type=STREAM 2020-04-22T14:17:16.016 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root 9u unix 0x00000000e934b246 0t0 26223 /run/gssproxy.sock type=STREAM 2020-04-22T14:17:16.016 INFO:teuthology.orchestra.run.smithi103.stdout:gssproxy 2448 2477 gssproxy root 10w FIFO 0,13 0t0 26227 pipe 2020-04-22T14:17:16.016 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.016 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.017 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root txt REG 8,1 1231240 8900 /usr/sbin/sshd 2020-04-22T14:17:16.017 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root DEL REG 8,1 65729 /var/lib/sss/mc/group 2020-04-22T14:17:16.017 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:16.017 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root DEL REG 8,1 65728 /var/lib/sss/mc/passwd 2020-04-22T14:17:16.017 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:16.017 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root mem REG 8,1 144392 3449 /usr/lib64/libgpg-error.so.0.24.2 2020-04-22T14:17:16.017 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.018 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.018 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root mem REG 8,1 16240 3641 /usr/lib64/libkeyutils.so.1.6 2020-04-22T14:17:16.018 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root mem REG 8,1 118728 5304 /usr/lib64/libkrb5support.so.0.1 2020-04-22T14:17:16.018 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.018 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.018 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root mem REG 8,1 1385560 3654 /usr/lib64/libgcrypt.so.20.2.3 2020-04-22T14:17:16.018 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.018 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:16.019 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:16.019 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:16.019 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.019 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.019 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root mem REG 8,1 25192 3584 /usr/lib64/libcap-ng.so.0.0.0 2020-04-22T14:17:16.019 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.020 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root mem REG 8,1 25992 3339 /usr/lib64/libcom_err.so.2.1 2020-04-22T14:17:16.020 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root mem REG 8,1 273488 5296 /usr/lib64/libk5crypto.so.3.1 2020-04-22T14:17:16.020 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root mem REG 8,1 1507952 5302 /usr/lib64/libkrb5.so.3.3 2020-04-22T14:17:16.020 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root mem REG 8,1 603768 5292 /usr/lib64/libgssapi_krb5.so.2.2 2020-04-22T14:17:16.020 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.020 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.020 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root mem REG 8,1 142712 3373 /usr/lib64/libcrypt.so.1.1.0 2020-04-22T14:17:16.020 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.021 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:16.021 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.021 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.021 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root mem REG 8,1 1637336 5512 /usr/lib64/libsystemd.so.0.23.0 2020-04-22T14:17:16.021 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root mem REG 8,1 74600 5752 /usr/lib64/libpam.so.0.84.2 2020-04-22T14:17:16.021 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root mem REG 8,1 141392 3586 /usr/lib64/libaudit.so.1.0.0 2020-04-22T14:17:16.021 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root mem REG 8,1 12200 8350 /usr/lib64/libfipscheck.so.1.2.1 2020-04-22T14:17:16.022 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.022 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.022 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root 1u unix 0x0000000018c974be 0t0 30267 type=STREAM 2020-04-22T14:17:16.022 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root 2u unix 0x0000000018c974be 0t0 30267 type=STREAM 2020-04-22T14:17:16.022 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root 3r REG 8,1 8406312 65728 /var/lib/sss/mc/passwd (deleted) 2020-04-22T14:17:16.022 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root 4u IPv4 25377 0t0 TCP *:ssh (LISTEN) 2020-04-22T14:17:16.022 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root 5r REG 8,1 6406312 65729 /var/lib/sss/mc/group (deleted) 2020-04-22T14:17:16.022 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 2513 root 6u IPv6 25379 0t0 TCP *:ssh (LISTEN) 2020-04-22T14:17:16.023 INFO:teuthology.orchestra.run.smithi103.stdout:rhsmcertd 2520 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.023 INFO:teuthology.orchestra.run.smithi103.stdout:rhsmcertd 2520 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.023 INFO:teuthology.orchestra.run.smithi103.stdout:rhsmcertd 2520 root txt REG 8,1 27920 8468 /usr/bin/rhsmcertd 2020-04-22T14:17:16.023 INFO:teuthology.orchestra.run.smithi103.stdout:rhsmcertd 2520 root mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:16.023 INFO:teuthology.orchestra.run.smithi103.stdout:rhsmcertd 2520 root mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:16.023 INFO:teuthology.orchestra.run.smithi103.stdout:rhsmcertd 2520 root mem REG 8,1 1503456 3656 /usr/lib64/libgmp.so.10.3.2 2020-04-22T14:17:16.023 INFO:teuthology.orchestra.run.smithi103.stdout:rhsmcertd 2520 root mem REG 8,1 248080 3819 /usr/lib64/libhogweed.so.4.5 2020-04-22T14:17:16.024 INFO:teuthology.orchestra.run.smithi103.stdout:rhsmcertd 2520 root mem REG 8,1 299920 3821 /usr/lib64/libnettle.so.6.5 2020-04-22T14:17:16.024 INFO:teuthology.orchestra.run.smithi103.stdout:rhsmcertd 2520 root mem REG 8,1 81408 3851 /usr/lib64/libtasn1.so.6.5.5 2020-04-22T14:17:16.024 INFO:teuthology.orchestra.run.smithi103.stdout:rhsmcertd 2520 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.024 INFO:teuthology.orchestra.run.smithi103.stdout:rhsmcertd 2520 root mem REG 8,1 1760264 3670 /usr/lib64/libunistring.so.2.1.0 2020-04-22T14:17:16.024 INFO:teuthology.orchestra.run.smithi103.stdout:rhsmcertd 2520 root mem REG 8,1 162224 3672 /usr/lib64/libidn2.so.0.3.6 2020-04-22T14:17:16.024 INFO:teuthology.orchestra.run.smithi103.stdout:rhsmcertd 2520 root mem REG 8,1 1295528 3648 /usr/lib64/libp11-kit.so.0.3.0 2020-04-22T14:17:16.024 INFO:teuthology.orchestra.run.smithi103.stdout:rhsmcertd 2520 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.024 INFO:teuthology.orchestra.run.smithi103.stdout:rhsmcertd 2520 root mem REG 8,1 471224 3494 /usr/lib64/libpcre.so.1.2.10 2020-04-22T14:17:16.025 INFO:teuthology.orchestra.run.smithi103.stdout:rhsmcertd 2520 root mem REG 8,1 2521184 6329 /usr/lib64/libgnutls.so.30.24.0 2020-04-22T14:17:16.025 INFO:teuthology.orchestra.run.smithi103.stdout:rhsmcertd 2520 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.025 INFO:teuthology.orchestra.run.smithi103.stdout:rhsmcertd 2520 root mem REG 8,1 1471440 6261 /usr/lib64/libglib-2.0.so.0.5600.4 2020-04-22T14:17:16.025 INFO:teuthology.orchestra.run.smithi103.stdout:rhsmcertd 2520 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.025 INFO:teuthology.orchestra.run.smithi103.stdout:rhsmcertd 2520 root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:16.025 INFO:teuthology.orchestra.run.smithi103.stdout:rhsmcertd 2520 root mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:16.025 INFO:teuthology.orchestra.run.smithi103.stdout:rhsmcertd 2520 root mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:16.026 INFO:teuthology.orchestra.run.smithi103.stdout:rhsmcertd 2520 root mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:16.026 INFO:teuthology.orchestra.run.smithi103.stdout:rhsmcertd 2520 root mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:16.026 INFO:teuthology.orchestra.run.smithi103.stdout:rhsmcertd 2520 root mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:16.026 INFO:teuthology.orchestra.run.smithi103.stdout:rhsmcertd 2520 root mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:16.026 INFO:teuthology.orchestra.run.smithi103.stdout:rhsmcertd 2520 root mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:16.026 INFO:teuthology.orchestra.run.smithi103.stdout:rhsmcertd 2520 root mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:16.026 INFO:teuthology.orchestra.run.smithi103.stdout:rhsmcertd 2520 root mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:16.026 INFO:teuthology.orchestra.run.smithi103.stdout:rhsmcertd 2520 root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:16.027 INFO:teuthology.orchestra.run.smithi103.stdout:rhsmcertd 2520 root mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:16.027 INFO:teuthology.orchestra.run.smithi103.stdout:rhsmcertd 2520 root 0u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.027 INFO:teuthology.orchestra.run.smithi103.stdout:rhsmcertd 2520 root 1u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.027 INFO:teuthology.orchestra.run.smithi103.stdout:rhsmcertd 2520 root 2u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.027 INFO:teuthology.orchestra.run.smithi103.stdout:rhsmcertd 2520 root 3wW REG 0,24 0 28720 /run/lock/subsys/rhsmcertd 2020-04-22T14:17:16.027 INFO:teuthology.orchestra.run.smithi103.stdout:rhsmcertd 2520 root 4u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:16.027 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.028 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.028 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root txt REG 8,1 315208 51618 /usr/libexec/sssd/sssd_be 2020-04-22T14:17:16.028 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 61944 34848 /usr/lib64/sssd/libsss_files.so 2020-04-22T14:17:16.028 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 860880 5511 /usr/lib64/libnss_systemd.so.2 2020-04-22T14:17:16.028 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root DEL REG 8,1 65679 /var/lib/sss/mc/initgroups 2020-04-22T14:17:16.028 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:16.028 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root DEL REG 8,1 65728 /var/lib/sss/mc/passwd 2020-04-22T14:17:16.029 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:16.029 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 1609728 65559 /var/lib/sss/db/timestamps_implicit_files.ldb 2020-04-22T14:17:16.029 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 3080192 65556 /var/lib/sss/db/cache_implicit_files.ldb 2020-04-22T14:17:16.029 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 9216 41912 /usr/lib64/ldb/modules/ldb/tdb.so 2020-04-22T14:17:16.029 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 13408 41911 /usr/lib64/ldb/modules/ldb/skel.so 2020-04-22T14:17:16.029 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 17496 41910 /usr/lib64/ldb/modules/ldb/server_sort.so 2020-04-22T14:17:16.029 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 13584 41909 /usr/lib64/ldb/modules/ldb/sample.so 2020-04-22T14:17:16.029 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 17536 41908 /usr/lib64/ldb/modules/ldb/rdn_name.so 2020-04-22T14:17:16.030 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 17600 41907 /usr/lib64/ldb/modules/ldb/paged_searches.so 2020-04-22T14:17:16.030 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 81312 43861 /usr/lib64/ldb/modules/ldb/memberof.so 2020-04-22T14:17:16.030 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 19200 41900 /usr/lib64/ldb/libldb-tdb-err-map.so 2020-04-22T14:17:16.030 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 33600 41901 /usr/lib64/ldb/libldb-tdb-int.so 2020-04-22T14:17:16.030 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 99352 41899 /usr/lib64/ldb/libldb-key-value.so 2020-04-22T14:17:16.030 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 9232 41906 /usr/lib64/ldb/modules/ldb/ldb.so 2020-04-22T14:17:16.030 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 16240 3641 /usr/lib64/libkeyutils.so.1.6 2020-04-22T14:17:16.031 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 118728 5304 /usr/lib64/libkrb5support.so.0.1 2020-04-22T14:17:16.031 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 25992 3339 /usr/lib64/libcom_err.so.2.1 2020-04-22T14:17:16.031 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 273488 5296 /usr/lib64/libk5crypto.so.3.1 2020-04-22T14:17:16.031 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 1507952 5302 /usr/lib64/libkrb5.so.3.3 2020-04-22T14:17:16.031 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 603768 5292 /usr/lib64/libgssapi_krb5.so.2.2 2020-04-22T14:17:16.031 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:16.031 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 149160 4994 /usr/lib64/libsasl2.so.3.0.0 2020-04-22T14:17:16.031 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.032 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 97056 5009 /usr/lib64/liblber-2.4.so.2.10.9 2020-04-22T14:17:16.032 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 477472 5011 /usr/lib64/libldap-2.4.so.2.10.9 2020-04-22T14:17:16.032 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 35648 41905 /usr/lib64/ldb/modules/ldb/ldap.so 2020-04-22T14:17:16.032 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 17488 41904 /usr/lib64/ldb/modules/ldb/asq.so 2020-04-22T14:17:16.032 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:16.032 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:16.032 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 1503456 3656 /usr/lib64/libgmp.so.10.3.2 2020-04-22T14:17:16.033 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 248080 3819 /usr/lib64/libhogweed.so.4.5 2020-04-22T14:17:16.033 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 299920 3821 /usr/lib64/libnettle.so.6.5 2020-04-22T14:17:16.033 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 81408 3851 /usr/lib64/libtasn1.so.6.5.5 2020-04-22T14:17:16.033 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 1760264 3670 /usr/lib64/libunistring.so.2.1.0 2020-04-22T14:17:16.033 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 162224 3672 /usr/lib64/libidn2.so.0.3.6 2020-04-22T14:17:16.033 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 1295528 3648 /usr/lib64/libp11-kit.so.0.3.0 2020-04-22T14:17:16.033 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 144392 3449 /usr/lib64/libgpg-error.so.0.24.2 2020-04-22T14:17:16.033 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.034 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.034 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 25192 3584 /usr/lib64/libcap-ng.so.0.0.0 2020-04-22T14:17:16.034 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 2521184 6329 /usr/lib64/libgnutls.so.30.24.0 2020-04-22T14:17:16.034 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.034 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 1385560 3654 /usr/lib64/libgcrypt.so.20.2.3 2020-04-22T14:17:16.034 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.034 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:16.035 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:16.035 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:16.035 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.035 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 16160 4303 /usr/lib64/libpath_utils.so.1.0.1 2020-04-22T14:17:16.035 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.035 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 142712 3373 /usr/lib64/libcrypt.so.1.1.0 2020-04-22T14:17:16.035 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.036 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 141392 3586 /usr/lib64/libaudit.so.1.0.0 2020-04-22T14:17:16.036 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.036 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 1471440 6261 /usr/lib64/libglib-2.0.so.0.5600.4 2020-04-22T14:17:16.036 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 505672 5398 /usr/lib64/libdbus-1.so.3.19.7 2020-04-22T14:17:16.036 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 94816 3405 /usr/lib64/libtalloc.so.2.1.16 2020-04-22T14:17:16.036 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 117040 3472 /usr/lib64/libtevent.so.0.9.39 2020-04-22T14:17:16.036 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 16216 3593 /usr/lib64/libdhash.so.1.1.0 2020-04-22T14:17:16.037 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 375248 34713 /usr/lib64/sssd/libsss_sbus.so 2020-04-22T14:17:16.037 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 166344 34849 /usr/lib64/sssd/libsss_iface.so 2020-04-22T14:17:16.037 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 1637336 5512 /usr/lib64/libsystemd.so.0.23.0 2020-04-22T14:17:16.037 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 26800 34847 /usr/lib64/sssd/libsss_debug.so 2020-04-22T14:17:16.037 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.037 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 89680 6613 /usr/lib64/libsss_certmap.so.0.1.0 2020-04-22T14:17:16.037 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 27064 34845 /usr/lib64/sssd/libsss_child.so 2020-04-22T14:17:16.038 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 42104 34846 /usr/lib64/sssd/libsss_crypt.so 2020-04-22T14:17:16.038 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 34408 34704 /usr/lib64/sssd/libsss_cert.so 2020-04-22T14:17:16.038 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 55560 3591 /usr/lib64/libcollection.so.4.1.1 2020-04-22T14:17:16.038 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 12024 3595 /usr/lib64/libref_array.so.1.2.1 2020-04-22T14:17:16.038 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 11848 3582 /usr/lib64/libbasicobjects.so.0.1.0 2020-04-22T14:17:16.038 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 117048 4305 /usr/lib64/libini_config.so.5.2.1 2020-04-22T14:17:16.038 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 471224 3494 /usr/lib64/libpcre.so.1.2.10 2020-04-22T14:17:16.038 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 133496 3481 /usr/lib64/libtdb.so.1.3.18 2020-04-22T14:17:16.039 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.039 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 254736 6611 /usr/lib64/libldb.so.1.5.4 2020-04-22T14:17:16.039 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 55688 3341 /usr/lib64/libpopt.so.0.0.0 2020-04-22T14:17:16.039 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.039 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 681936 34717 /usr/lib64/sssd/libsss_util.so 2020-04-22T14:17:16.039 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 74600 5752 /usr/lib64/libpam.so.0.84.2 2020-04-22T14:17:16.039 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 94472 4840 /usr/lib64/libcares.so.2.2.0 2020-04-22T14:17:16.040 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.040 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.040 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 1286144 65539 /var/lib/sss/db/config.ldb 2020-04-22T14:17:16.040 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:16.040 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:16.040 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:16.040 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:16.040 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:16.041 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:16.041 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:16.041 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:16.041 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:16.041 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:16.041 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:16.041 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:16.042 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root 0u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.042 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root 1u unix 0x000000000bfacfd9 0t0 21261 type=STREAM 2020-04-22T14:17:16.042 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root 2u unix 0x000000000bfacfd9 0t0 21261 type=STREAM 2020-04-22T14:17:16.042 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root 3u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:16.042 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root 4u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.042 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root 5u REG 8,1 1286144 65539 /var/lib/sss/db/config.ldb 2020-04-22T14:17:16.042 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root 6w REG 8,1 218 65560 /var/log/sssd/sssd_implicit_files.log 2020-04-22T14:17:16.043 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root 7u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:16.043 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root 8r FIFO 0,13 0t0 26377 pipe 2020-04-22T14:17:16.043 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root 9w FIFO 0,13 0t0 26377 pipe 2020-04-22T14:17:16.043 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root 10u unix 0x00000000bd907017 0t0 26378 type=DGRAM 2020-04-22T14:17:16.043 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.043 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root 12u REG 8,1 3080192 65556 /var/lib/sss/db/cache_implicit_files.ldb 2020-04-22T14:17:16.043 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root 13u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.044 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root 14u REG 8,1 1609728 65559 /var/lib/sss/db/timestamps_implicit_files.ldb 2020-04-22T14:17:16.044 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root 15u unix 0x000000009482efb9 0t0 26379 /var/lib/sss/pipes/private/sbus-dp_implicit_files.2536 type=STREAM 2020-04-22T14:17:16.044 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root 16u unix 0x00000000268e04f7 0t0 26380 type=STREAM 2020-04-22T14:17:16.044 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root 17u unix 0x00000000d1232ea6 0t0 26381 /var/lib/sss/pipes/private/sbus-dp_implicit_files.2536 type=STREAM 2020-04-22T14:17:16.044 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root 18r REG 8,1 8406312 65728 /var/lib/sss/mc/passwd (deleted) 2020-04-22T14:17:16.044 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root 19r REG 8,1 10406312 65679 /var/lib/sss/mc/initgroups (deleted) 2020-04-22T14:17:16.044 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root 20r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:16.044 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root 21r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:16.045 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root 22u unix 0x000000005fa5a6af 0t0 30784 type=STREAM 2020-04-22T14:17:16.045 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_be 2536 root 23u unix 0x00000000aeb425f0 0t0 30793 /var/lib/sss/pipes/private/sbus-dp_implicit_files.2536 type=STREAM 2020-04-22T14:17:16.045 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.045 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.045 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root txt REG 8,1 411320 51620 /usr/libexec/sssd/sssd_nss 2020-04-22T14:17:16.045 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem-w REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:16.045 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem-w REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:16.045 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem-w REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:16.046 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root DEL REG 8,1 65728 /var/lib/sss/mc/passwd 2020-04-22T14:17:16.046 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:16.046 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:16.046 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 1609728 65559 /var/lib/sss/db/timestamps_implicit_files.ldb 2020-04-22T14:17:16.046 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 3080192 65556 /var/lib/sss/db/cache_implicit_files.ldb 2020-04-22T14:17:16.046 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 9216 41912 /usr/lib64/ldb/modules/ldb/tdb.so 2020-04-22T14:17:16.046 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 13408 41911 /usr/lib64/ldb/modules/ldb/skel.so 2020-04-22T14:17:16.046 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 17496 41910 /usr/lib64/ldb/modules/ldb/server_sort.so 2020-04-22T14:17:16.047 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 13584 41909 /usr/lib64/ldb/modules/ldb/sample.so 2020-04-22T14:17:16.047 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 17536 41908 /usr/lib64/ldb/modules/ldb/rdn_name.so 2020-04-22T14:17:16.047 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 17600 41907 /usr/lib64/ldb/modules/ldb/paged_searches.so 2020-04-22T14:17:16.047 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 81312 43861 /usr/lib64/ldb/modules/ldb/memberof.so 2020-04-22T14:17:16.047 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 19200 41900 /usr/lib64/ldb/libldb-tdb-err-map.so 2020-04-22T14:17:16.047 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 33600 41901 /usr/lib64/ldb/libldb-tdb-int.so 2020-04-22T14:17:16.047 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 99352 41899 /usr/lib64/ldb/libldb-key-value.so 2020-04-22T14:17:16.047 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 9232 41906 /usr/lib64/ldb/modules/ldb/ldb.so 2020-04-22T14:17:16.048 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 16240 3641 /usr/lib64/libkeyutils.so.1.6 2020-04-22T14:17:16.048 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 118728 5304 /usr/lib64/libkrb5support.so.0.1 2020-04-22T14:17:16.048 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 25992 3339 /usr/lib64/libcom_err.so.2.1 2020-04-22T14:17:16.048 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 273488 5296 /usr/lib64/libk5crypto.so.3.1 2020-04-22T14:17:16.048 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 1507952 5302 /usr/lib64/libkrb5.so.3.3 2020-04-22T14:17:16.048 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 603768 5292 /usr/lib64/libgssapi_krb5.so.2.2 2020-04-22T14:17:16.048 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:16.049 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 149160 4994 /usr/lib64/libsasl2.so.3.0.0 2020-04-22T14:17:16.049 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.049 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 97056 5009 /usr/lib64/liblber-2.4.so.2.10.9 2020-04-22T14:17:16.049 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 477472 5011 /usr/lib64/libldap-2.4.so.2.10.9 2020-04-22T14:17:16.049 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 35648 41905 /usr/lib64/ldb/modules/ldb/ldap.so 2020-04-22T14:17:16.049 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 17488 41904 /usr/lib64/ldb/modules/ldb/asq.so 2020-04-22T14:17:16.049 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:16.049 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:16.050 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 1503456 3656 /usr/lib64/libgmp.so.10.3.2 2020-04-22T14:17:16.050 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 248080 3819 /usr/lib64/libhogweed.so.4.5 2020-04-22T14:17:16.050 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 299920 3821 /usr/lib64/libnettle.so.6.5 2020-04-22T14:17:16.050 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 81408 3851 /usr/lib64/libtasn1.so.6.5.5 2020-04-22T14:17:16.050 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 1760264 3670 /usr/lib64/libunistring.so.2.1.0 2020-04-22T14:17:16.050 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 162224 3672 /usr/lib64/libidn2.so.0.3.6 2020-04-22T14:17:16.050 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 1295528 3648 /usr/lib64/libp11-kit.so.0.3.0 2020-04-22T14:17:16.051 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 144392 3449 /usr/lib64/libgpg-error.so.0.24.2 2020-04-22T14:17:16.051 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.051 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.051 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 2521184 6329 /usr/lib64/libgnutls.so.30.24.0 2020-04-22T14:17:16.051 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.051 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 1385560 3654 /usr/lib64/libgcrypt.so.20.2.3 2020-04-22T14:17:16.051 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.052 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:16.052 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:16.052 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:16.052 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.052 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 16160 4303 /usr/lib64/libpath_utils.so.1.0.1 2020-04-22T14:17:16.052 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.052 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 142712 3373 /usr/lib64/libcrypt.so.1.1.0 2020-04-22T14:17:16.052 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.053 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.053 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 1471440 6261 /usr/lib64/libglib-2.0.so.0.5600.4 2020-04-22T14:17:16.053 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 505672 5398 /usr/lib64/libdbus-1.so.3.19.7 2020-04-22T14:17:16.053 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 94816 3405 /usr/lib64/libtalloc.so.2.1.16 2020-04-22T14:17:16.053 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 117040 3472 /usr/lib64/libtevent.so.0.9.39 2020-04-22T14:17:16.053 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 16216 3593 /usr/lib64/libdhash.so.1.1.0 2020-04-22T14:17:16.053 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 375248 34713 /usr/lib64/sssd/libsss_sbus.so 2020-04-22T14:17:16.053 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 166344 34849 /usr/lib64/sssd/libsss_iface.so 2020-04-22T14:17:16.054 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 1637336 5512 /usr/lib64/libsystemd.so.0.23.0 2020-04-22T14:17:16.054 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 26800 34847 /usr/lib64/sssd/libsss_debug.so 2020-04-22T14:17:16.055 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.055 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 89680 6613 /usr/lib64/libsss_certmap.so.0.1.0 2020-04-22T14:17:16.055 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 27064 34845 /usr/lib64/sssd/libsss_child.so 2020-04-22T14:17:16.055 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 42104 34846 /usr/lib64/sssd/libsss_crypt.so 2020-04-22T14:17:16.056 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 55560 3591 /usr/lib64/libcollection.so.4.1.1 2020-04-22T14:17:16.056 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 12024 3595 /usr/lib64/libref_array.so.1.2.1 2020-04-22T14:17:16.056 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 11848 3582 /usr/lib64/libbasicobjects.so.0.1.0 2020-04-22T14:17:16.056 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 117048 4305 /usr/lib64/libini_config.so.5.2.1 2020-04-22T14:17:16.056 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 471224 3494 /usr/lib64/libpcre.so.1.2.10 2020-04-22T14:17:16.056 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 133496 3481 /usr/lib64/libtdb.so.1.3.18 2020-04-22T14:17:16.056 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.057 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 254736 6611 /usr/lib64/libldb.so.1.5.4 2020-04-22T14:17:16.057 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 55688 3341 /usr/lib64/libpopt.so.0.0.0 2020-04-22T14:17:16.057 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.057 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 681936 34717 /usr/lib64/sssd/libsss_util.so 2020-04-22T14:17:16.057 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 34408 34704 /usr/lib64/sssd/libsss_cert.so 2020-04-22T14:17:16.057 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 37560 3659 /usr/lib64/libsss_idmap.so.0.5.1 2020-04-22T14:17:16.057 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.057 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.058 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 1286144 65539 /var/lib/sss/db/config.ldb 2020-04-22T14:17:16.058 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:16.058 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:16.058 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:16.058 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:16.058 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:16.058 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:16.059 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:16.059 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:16.059 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:16.059 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:16.059 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:16.059 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:16.059 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root 0u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.060 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root 1u unix 0x000000000bfacfd9 0t0 21261 type=STREAM 2020-04-22T14:17:16.060 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root 2u unix 0x000000000bfacfd9 0t0 21261 type=STREAM 2020-04-22T14:17:16.060 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root 3u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:16.060 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root 4u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.060 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root 5u REG 8,1 1286144 65539 /var/lib/sss/db/config.ldb 2020-04-22T14:17:16.060 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root 6w REG 8,1 188 65562 /var/log/sssd/sssd_nss.log 2020-04-22T14:17:16.060 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root 7u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:16.061 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root 8r FIFO 0,13 0t0 30425 pipe 2020-04-22T14:17:16.061 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root 9w FIFO 0,13 0t0 30425 pipe 2020-04-22T14:17:16.061 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root 10u unix 0x0000000033f2ab12 0t0 30426 type=DGRAM 2020-04-22T14:17:16.061 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root 11u unix 0x0000000099af050a 0t0 30427 type=STREAM 2020-04-22T14:17:16.061 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root 12u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.061 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root 13u REG 8,1 3080192 65556 /var/lib/sss/db/cache_implicit_files.ldb 2020-04-22T14:17:16.061 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root 14u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.062 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root 15u REG 8,1 1609728 65559 /var/lib/sss/db/timestamps_implicit_files.ldb 2020-04-22T14:17:16.062 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root 16u unix 0x00000000b021ca50 0t0 24432 /var/lib/sss/pipes/nss type=STREAM 2020-04-22T14:17:16.062 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root 17r REG 8,1 8406312 65728 /var/lib/sss/mc/passwd (deleted) 2020-04-22T14:17:16.062 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root 18uw REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:16.062 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root 19uw REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:16.062 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root 20uw REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:16.062 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root 21u unix 0x00000000dc0c809c 0t0 24435 type=STREAM 2020-04-22T14:17:16.063 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root 22u unix 0x00000000bb9d496d 0t0 289557 /var/lib/sss/pipes/nss type=STREAM 2020-04-22T14:17:16.063 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root 23u unix 0x00000000185b8770 0t0 328563 /var/lib/sss/pipes/nss type=STREAM 2020-04-22T14:17:16.063 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root 24u unix 0x00000000cd6f5e1e 0t0 350577 /var/lib/sss/pipes/nss type=STREAM 2020-04-22T14:17:16.063 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root 25u unix 0x0000000047218c3f 0t0 302954 /var/lib/sss/pipes/nss type=STREAM 2020-04-22T14:17:16.063 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root 27u unix 0x0000000036a67cdb 0t0 337911 /var/lib/sss/pipes/nss type=STREAM 2020-04-22T14:17:16.063 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root 28u sock 0,9 0t0 337912 protocol: UNIX 2020-04-22T14:17:16.063 INFO:teuthology.orchestra.run.smithi103.stdout:sssd_nss 2545 root 29u unix 0x00000000e97be9b4 0t0 349274 /var/lib/sss/pipes/nss type=STREAM 2020-04-22T14:17:16.063 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.064 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.064 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root txt REG 8,1 484584 6390 /usr/lib/systemd/systemd-logind 2020-04-22T14:17:16.064 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:16.064 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.064 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.064 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.064 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root mem REG 8,1 766120 3335 /usr/lib64/libsepol.so.1 2020-04-22T14:17:16.064 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root mem REG 8,1 1760264 3670 /usr/lib64/libunistring.so.2.1.0 2020-04-22T14:17:16.065 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.065 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root mem REG 8,1 356920 3798 /usr/lib64/libpcap.so.1.9.0 2020-04-22T14:17:16.065 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.065 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root mem REG 8,1 144392 3449 /usr/lib64/libgpg-error.so.0.24.2 2020-04-22T14:17:16.065 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root mem REG 8,1 70432 3726 /usr/lib64/libjson-c.so.4.0.0 2020-04-22T14:17:16.065 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.065 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:16.065 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root mem REG 8,1 443488 5581 /usr/lib64/libdevmapper.so.1.02 2020-04-22T14:17:16.066 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.066 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root mem REG 8,1 26192 3541 /usr/lib64/libattr.so.1.1.2448 2020-04-22T14:17:16.066 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.066 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.066 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:16.066 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:16.066 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root mem REG 8,1 162224 3672 /usr/lib64/libidn2.so.0.3.6 2020-04-22T14:17:16.067 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.067 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root mem REG 8,1 357336 4307 /usr/lib64/libseccomp.so.2.4.1 2020-04-22T14:17:16.067 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root mem REG 8,1 37824 3807 /usr/lib64/libip4tc.so.0.1.0 2020-04-22T14:17:16.067 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root mem REG 8,1 1385560 3654 /usr/lib64/libgcrypt.so.20.2.3 2020-04-22T14:17:16.067 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root mem REG 8,1 645024 5716 /usr/lib64/libcryptsetup.so.12.5.0 2020-04-22T14:17:16.067 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:16.067 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.067 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.068 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.068 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.068 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root mem REG 8,1 54816 3543 /usr/lib64/libacl.so.1.1.2253 2020-04-22T14:17:16.068 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root mem REG 8,1 5215944 6376 /usr/lib/systemd/libsystemd-shared-239.so 2020-04-22T14:17:16.068 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.068 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root DEL REG 8,1 64856 /etc/selinux/targeted/contexts/files/file_contexts.bin 2020-04-22T14:17:16.069 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root DEL REG 8,1 64857 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2020-04-22T14:17:16.069 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.069 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root 1u unix 0x00000000aa25de2a 0t0 27135 type=STREAM 2020-04-22T14:17:16.069 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root 2u unix 0x00000000aa25de2a 0t0 27135 type=STREAM 2020-04-22T14:17:16.069 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root 3u unix 0x000000005542a628 0t0 27136 type=DGRAM 2020-04-22T14:17:16.069 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root 4u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.069 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root 5u a_inode 0,14 0 2063 [signalfd] 2020-04-22T14:17:16.069 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root 6u a_inode 0,14 0 2063 [timerfd] 2020-04-22T14:17:16.070 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root 7r REG 0,21 4096 20965 /sys/devices/virtual/tty/tty0/active 2020-04-22T14:17:16.070 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root 8u netlink 0t0 27142 KOBJECT_UEVENT 2020-04-22T14:17:16.070 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root 9u netlink 0t0 27143 KOBJECT_UEVENT 2020-04-22T14:17:16.070 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root 10u netlink 0t0 27144 KOBJECT_UEVENT 2020-04-22T14:17:16.070 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root 11u netlink 0t0 27145 KOBJECT_UEVENT 2020-04-22T14:17:16.070 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root 12u unix 0x00000000789349dc 0t0 27146 type=STREAM 2020-04-22T14:17:16.070 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root 13u a_inode 0,14 0 2063 [timerfd] 2020-04-22T14:17:16.071 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root 14u CHR 13,65 0t0 16391 /dev/input/event1 2020-04-22T14:17:16.071 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root 15u CHR 13,64 0t0 16390 /dev/input/event0 2020-04-22T14:17:16.071 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root 16u CHR 13,66 0t0 16503 /dev/input/event2 2020-04-22T14:17:16.071 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root 17u CHR 4,6 0t0 1047 /dev/tty6 2020-04-22T14:17:16.071 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root 18r FIFO 0,24 0t0 27150 /run/systemd/inhibit/1.ref 2020-04-22T14:17:16.071 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root 19u unix 0x00000000cdd8a42c 0t0 110926 type=STREAM 2020-04-22T14:17:16.071 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-l 2582 root 20r FIFO 0,24 0t0 110929 /run/systemd/sessions/8.ref 2020-04-22T14:17:16.071 INFO:teuthology.orchestra.run.smithi103.stdout:crond 2587 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.072 INFO:teuthology.orchestra.run.smithi103.stdout:crond 2587 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.072 INFO:teuthology.orchestra.run.smithi103.stdout:crond 2587 root txt REG 8,1 99584 6689 /usr/sbin/crond 2020-04-22T14:17:16.072 INFO:teuthology.orchestra.run.smithi103.stdout:crond 2587 root mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:16.072 INFO:teuthology.orchestra.run.smithi103.stdout:crond 2587 root mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:16.072 INFO:teuthology.orchestra.run.smithi103.stdout:crond 2587 root mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:16.072 INFO:teuthology.orchestra.run.smithi103.stdout:crond 2587 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.072 INFO:teuthology.orchestra.run.smithi103.stdout:crond 2587 root mem REG 8,1 25192 3584 /usr/lib64/libcap-ng.so.0.0.0 2020-04-22T14:17:16.072 INFO:teuthology.orchestra.run.smithi103.stdout:crond 2587 root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.073 INFO:teuthology.orchestra.run.smithi103.stdout:crond 2587 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.073 INFO:teuthology.orchestra.run.smithi103.stdout:crond 2587 root mem REG 8,1 141392 3586 /usr/lib64/libaudit.so.1.0.0 2020-04-22T14:17:16.073 INFO:teuthology.orchestra.run.smithi103.stdout:crond 2587 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.073 INFO:teuthology.orchestra.run.smithi103.stdout:crond 2587 root mem REG 8,1 74600 5752 /usr/lib64/libpam.so.0.84.2 2020-04-22T14:17:16.073 INFO:teuthology.orchestra.run.smithi103.stdout:crond 2587 root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.073 INFO:teuthology.orchestra.run.smithi103.stdout:crond 2587 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.073 INFO:teuthology.orchestra.run.smithi103.stdout:crond 2587 root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:16.074 INFO:teuthology.orchestra.run.smithi103.stdout:crond 2587 root mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:16.074 INFO:teuthology.orchestra.run.smithi103.stdout:crond 2587 root mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:16.074 INFO:teuthology.orchestra.run.smithi103.stdout:crond 2587 root mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:16.074 INFO:teuthology.orchestra.run.smithi103.stdout:crond 2587 root mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:16.074 INFO:teuthology.orchestra.run.smithi103.stdout:crond 2587 root mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:16.074 INFO:teuthology.orchestra.run.smithi103.stdout:crond 2587 root mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:16.074 INFO:teuthology.orchestra.run.smithi103.stdout:crond 2587 root mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:16.075 INFO:teuthology.orchestra.run.smithi103.stdout:crond 2587 root mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:16.075 INFO:teuthology.orchestra.run.smithi103.stdout:crond 2587 root mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:16.075 INFO:teuthology.orchestra.run.smithi103.stdout:crond 2587 root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:16.075 INFO:teuthology.orchestra.run.smithi103.stdout:crond 2587 root mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:16.075 INFO:teuthology.orchestra.run.smithi103.stdout:crond 2587 root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.075 INFO:teuthology.orchestra.run.smithi103.stdout:crond 2587 root 1u unix 0x00000000c7c2edb3 0t0 30881 type=STREAM 2020-04-22T14:17:16.075 INFO:teuthology.orchestra.run.smithi103.stdout:crond 2587 root 2u unix 0x00000000c7c2edb3 0t0 30881 type=STREAM 2020-04-22T14:17:16.075 INFO:teuthology.orchestra.run.smithi103.stdout:crond 2587 root 3u unix 0x000000009ec779cd 0t0 30882 type=DGRAM 2020-04-22T14:17:16.076 INFO:teuthology.orchestra.run.smithi103.stdout:crond 2587 root 4r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:16.076 INFO:teuthology.orchestra.run.smithi103.stdout:crond 2587 root 5u unix 0x000000002d64c3b6 0t0 113862 type=STREAM 2020-04-22T14:17:16.076 INFO:teuthology.orchestra.run.smithi103.stdout:atd 2589 root cwd DIR 8,1 4096 65221 /var/spool/at 2020-04-22T14:17:16.076 INFO:teuthology.orchestra.run.smithi103.stdout:atd 2589 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.076 INFO:teuthology.orchestra.run.smithi103.stdout:atd 2589 root txt REG 8,1 34144 7746 /usr/sbin/atd 2020-04-22T14:17:16.076 INFO:teuthology.orchestra.run.smithi103.stdout:atd 2589 root DEL REG 8,1 67740 /var/lib/sss/mc/group 2020-04-22T14:17:16.076 INFO:teuthology.orchestra.run.smithi103.stdout:atd 2589 root mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:16.077 INFO:teuthology.orchestra.run.smithi103.stdout:atd 2589 root DEL REG 8,1 67739 /var/lib/sss/mc/passwd 2020-04-22T14:17:16.077 INFO:teuthology.orchestra.run.smithi103.stdout:atd 2589 root mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:16.077 INFO:teuthology.orchestra.run.smithi103.stdout:atd 2589 root mem REG 8,1 25192 3584 /usr/lib64/libcap-ng.so.0.0.0 2020-04-22T14:17:16.077 INFO:teuthology.orchestra.run.smithi103.stdout:atd 2589 root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.077 INFO:teuthology.orchestra.run.smithi103.stdout:atd 2589 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.078 INFO:teuthology.orchestra.run.smithi103.stdout:atd 2589 root mem REG 8,1 141392 3586 /usr/lib64/libaudit.so.1.0.0 2020-04-22T14:17:16.078 INFO:teuthology.orchestra.run.smithi103.stdout:atd 2589 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.078 INFO:teuthology.orchestra.run.smithi103.stdout:atd 2589 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.078 INFO:teuthology.orchestra.run.smithi103.stdout:atd 2589 root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.078 INFO:teuthology.orchestra.run.smithi103.stdout:atd 2589 root mem REG 8,1 16704 5754 /usr/lib64/libpam_misc.so.0.82.1 2020-04-22T14:17:16.078 INFO:teuthology.orchestra.run.smithi103.stdout:atd 2589 root mem REG 8,1 74600 5752 /usr/lib64/libpam.so.0.84.2 2020-04-22T14:17:16.078 INFO:teuthology.orchestra.run.smithi103.stdout:atd 2589 root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.078 INFO:teuthology.orchestra.run.smithi103.stdout:atd 2589 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.079 INFO:teuthology.orchestra.run.smithi103.stdout:atd 2589 root 0u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.079 INFO:teuthology.orchestra.run.smithi103.stdout:atd 2589 root 1u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.079 INFO:teuthology.orchestra.run.smithi103.stdout:atd 2589 root 2u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.079 INFO:teuthology.orchestra.run.smithi103.stdout:atd 2589 root 3r REG 8,1 8406312 67739 /var/lib/sss/mc/passwd (deleted) 2020-04-22T14:17:16.079 INFO:teuthology.orchestra.run.smithi103.stdout:atd 2589 root 4u unix 0x000000003adb27a1 0t0 30526 type=STREAM 2020-04-22T14:17:16.079 INFO:teuthology.orchestra.run.smithi103.stdout:atd 2589 root 5r REG 8,1 6406312 67740 /var/lib/sss/mc/group (deleted) 2020-04-22T14:17:16.079 INFO:teuthology.orchestra.run.smithi103.stdout:atd 2589 root 6uW REG 0,24 5 30529 /run/atd.pid 2020-04-22T14:17:16.080 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.080 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.080 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve txt REG 8,1 869880 6392 /usr/lib/systemd/systemd-resolved 2020-04-22T14:17:16.080 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve DEL REG 8,1 67739 /var/lib/sss/mc/passwd 2020-04-22T14:17:16.080 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:16.080 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.080 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.080 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve mem REG 8,1 766120 3335 /usr/lib64/libsepol.so.1 2020-04-22T14:17:16.081 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:16.081 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.081 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve mem REG 8,1 356920 3798 /usr/lib64/libpcap.so.1.9.0 2020-04-22T14:17:16.081 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve mem REG 8,1 70432 3726 /usr/lib64/libjson-c.so.4.0.0 2020-04-22T14:17:16.081 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.081 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:16.081 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve mem REG 8,1 443488 5581 /usr/lib64/libdevmapper.so.1.02 2020-04-22T14:17:16.082 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.082 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve mem REG 8,1 26192 3541 /usr/lib64/libattr.so.1.1.2448 2020-04-22T14:17:16.082 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve mem REG 8,1 1503456 3656 /usr/lib64/libgmp.so.10.3.2 2020-04-22T14:17:16.082 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve mem REG 8,1 248080 3819 /usr/lib64/libhogweed.so.4.5 2020-04-22T14:17:16.082 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve mem REG 8,1 299920 3821 /usr/lib64/libnettle.so.6.5 2020-04-22T14:17:16.082 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve mem REG 8,1 81408 3851 /usr/lib64/libtasn1.so.6.5.5 2020-04-22T14:17:16.082 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.082 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve mem REG 8,1 1295528 3648 /usr/lib64/libp11-kit.so.0.3.0 2020-04-22T14:17:16.083 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve mem REG 8,1 1760264 3670 /usr/lib64/libunistring.so.2.1.0 2020-04-22T14:17:16.083 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.083 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.083 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:16.083 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:16.083 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.083 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve mem REG 8,1 357336 4307 /usr/lib64/libseccomp.so.2.4.1 2020-04-22T14:17:16.084 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve mem REG 8,1 37824 3807 /usr/lib64/libip4tc.so.0.1.0 2020-04-22T14:17:16.084 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve mem REG 8,1 645024 5716 /usr/lib64/libcryptsetup.so.12.5.0 2020-04-22T14:17:16.084 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve mem REG 8,1 54816 3543 /usr/lib64/libacl.so.1.1.2253 2020-04-22T14:17:16.084 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:16.084 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.084 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.084 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.084 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.085 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve mem REG 8,1 1385560 3654 /usr/lib64/libgcrypt.so.20.2.3 2020-04-22T14:17:16.085 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve mem REG 8,1 2521184 6329 /usr/lib64/libgnutls.so.30.24.0 2020-04-22T14:17:16.085 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve mem REG 8,1 162224 3672 /usr/lib64/libidn2.so.0.3.6 2020-04-22T14:17:16.085 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.085 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve mem REG 8,1 144392 3449 /usr/lib64/libgpg-error.so.0.24.2 2020-04-22T14:17:16.085 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve mem REG 8,1 5215944 6376 /usr/lib/systemd/libsystemd-shared-239.so 2020-04-22T14:17:16.085 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.086 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve DEL REG 8,1 64856 /etc/selinux/targeted/contexts/files/file_contexts.bin 2020-04-22T14:17:16.086 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve DEL REG 8,1 64857 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2020-04-22T14:17:16.086 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.086 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve 1u unix 0x0000000048bb6d05 0t0 30619 type=STREAM 2020-04-22T14:17:16.086 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve 2u unix 0x0000000048bb6d05 0t0 30619 type=STREAM 2020-04-22T14:17:16.086 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve 3u unix 0x00000000f3e08de1 0t0 30658 type=DGRAM 2020-04-22T14:17:16.086 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve 4r REG 8,1 8406312 67739 /var/lib/sss/mc/passwd (deleted) 2020-04-22T14:17:16.087 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.087 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve 6u a_inode 0,14 0 2063 [signalfd] 2020-04-22T14:17:16.087 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve 7u a_inode 0,14 0 2063 [timerfd] 2020-04-22T14:17:16.087 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve 8r REG 0,4 0 16450 /proc/sys/kernel/hostname 2020-04-22T14:17:16.087 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve 9r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:16.087 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve 10u netlink 0t0 30662 ROUTE 2020-04-22T14:17:16.087 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve 11u a_inode 0,14 0 2063 [timerfd] 2020-04-22T14:17:16.087 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve 12u IPv4 30663 0t0 UDP *:hostmon 2020-04-22T14:17:16.088 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve 13u IPv4 30664 0t0 TCP *:hostmon (LISTEN) 2020-04-22T14:17:16.088 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve 14u IPv6 30666 0t0 UDP *:hostmon 2020-04-22T14:17:16.088 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve 15u IPv6 30667 0t0 TCP *:hostmon (LISTEN) 2020-04-22T14:17:16.088 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve 16u a_inode 0,14 0 2063 [timerfd] 2020-04-22T14:17:16.088 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve 17u unix 0x00000000d46500f7 0t0 30668 type=STREAM 2020-04-22T14:17:16.088 INFO:teuthology.orchestra.run.smithi103.stdout:systemd-r 2750 systemd-resolve 18u IPv4 30669 0t0 UDP 127.0.0.53:domain 2020-04-22T14:17:16.088 INFO:teuthology.orchestra.run.smithi103.stdout:agetty 7089 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.088 INFO:teuthology.orchestra.run.smithi103.stdout:agetty 7089 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.089 INFO:teuthology.orchestra.run.smithi103.stdout:agetty 7089 root txt REG 8,1 78464 5896 /usr/sbin/agetty 2020-04-22T14:17:16.089 INFO:teuthology.orchestra.run.smithi103.stdout:agetty 7089 root DEL REG 8,1 67740 /var/lib/sss/mc/group 2020-04-22T14:17:16.089 INFO:teuthology.orchestra.run.smithi103.stdout:agetty 7089 root mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:16.089 INFO:teuthology.orchestra.run.smithi103.stdout:agetty 7089 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.089 INFO:teuthology.orchestra.run.smithi103.stdout:agetty 7089 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.089 INFO:teuthology.orchestra.run.smithi103.stdout:agetty 7089 root mem REG 8,1 337024 17434 /usr/lib/locale/C.utf8/LC_CTYPE 2020-04-22T14:17:16.089 INFO:teuthology.orchestra.run.smithi103.stdout:agetty 7089 root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:16.090 INFO:teuthology.orchestra.run.smithi103.stdout:agetty 7089 root 0u CHR 4,1 0t0 1042 /dev/tty1 2020-04-22T14:17:16.090 INFO:teuthology.orchestra.run.smithi103.stdout:agetty 7089 root 1u CHR 4,1 0t0 1042 /dev/tty1 2020-04-22T14:17:16.090 INFO:teuthology.orchestra.run.smithi103.stdout:agetty 7089 root 2u CHR 4,1 0t0 1042 /dev/tty1 2020-04-22T14:17:16.090 INFO:teuthology.orchestra.run.smithi103.stdout:agetty 7089 root 3r REG 8,1 6406312 67740 /var/lib/sss/mc/group (deleted) 2020-04-22T14:17:16.090 INFO:teuthology.orchestra.run.smithi103.stdout:agetty 7089 root 4u unix 0x000000001688949e 0t0 36174 type=STREAM 2020-04-22T14:17:16.090 INFO:teuthology.orchestra.run.smithi103.stdout:agetty 7089 root 6r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:16.090 INFO:teuthology.orchestra.run.smithi103.stdout:agetty 7090 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.090 INFO:teuthology.orchestra.run.smithi103.stdout:agetty 7090 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.091 INFO:teuthology.orchestra.run.smithi103.stdout:agetty 7090 root txt REG 8,1 78464 5896 /usr/sbin/agetty 2020-04-22T14:17:16.091 INFO:teuthology.orchestra.run.smithi103.stdout:agetty 7090 root DEL REG 8,1 67740 /var/lib/sss/mc/group 2020-04-22T14:17:16.091 INFO:teuthology.orchestra.run.smithi103.stdout:agetty 7090 root mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:16.091 INFO:teuthology.orchestra.run.smithi103.stdout:agetty 7090 root mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:16.091 INFO:teuthology.orchestra.run.smithi103.stdout:agetty 7090 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.091 INFO:teuthology.orchestra.run.smithi103.stdout:agetty 7090 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.091 INFO:teuthology.orchestra.run.smithi103.stdout:agetty 7090 root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:16.092 INFO:teuthology.orchestra.run.smithi103.stdout:agetty 7090 root mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:16.092 INFO:teuthology.orchestra.run.smithi103.stdout:agetty 7090 root mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:16.092 INFO:teuthology.orchestra.run.smithi103.stdout:agetty 7090 root mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:16.092 INFO:teuthology.orchestra.run.smithi103.stdout:agetty 7090 root mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:16.092 INFO:teuthology.orchestra.run.smithi103.stdout:agetty 7090 root mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:16.092 INFO:teuthology.orchestra.run.smithi103.stdout:agetty 7090 root mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:16.092 INFO:teuthology.orchestra.run.smithi103.stdout:agetty 7090 root mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:16.092 INFO:teuthology.orchestra.run.smithi103.stdout:agetty 7090 root mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:16.093 INFO:teuthology.orchestra.run.smithi103.stdout:agetty 7090 root mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:16.093 INFO:teuthology.orchestra.run.smithi103.stdout:agetty 7090 root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:16.093 INFO:teuthology.orchestra.run.smithi103.stdout:agetty 7090 root mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:16.093 INFO:teuthology.orchestra.run.smithi103.stdout:agetty 7090 root 0u CHR 4,65 0t0 1197 /dev/ttyS1 2020-04-22T14:17:16.093 INFO:teuthology.orchestra.run.smithi103.stdout:agetty 7090 root 1u CHR 4,65 0t0 1197 /dev/ttyS1 2020-04-22T14:17:16.093 INFO:teuthology.orchestra.run.smithi103.stdout:agetty 7090 root 2u CHR 4,65 0t0 1197 /dev/ttyS1 2020-04-22T14:17:16.093 INFO:teuthology.orchestra.run.smithi103.stdout:agetty 7090 root 3r REG 8,1 6406312 67740 /var/lib/sss/mc/group (deleted) 2020-04-22T14:17:16.093 INFO:teuthology.orchestra.run.smithi103.stdout:agetty 7090 root 4u unix 0x00000000d22eb939 0t0 29522 type=STREAM 2020-04-22T14:17:16.094 INFO:teuthology.orchestra.run.smithi103.stdout:agetty 7090 root 6r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:16.094 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.094 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.094 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu txt REG 8,1 2523648 6380 /usr/lib/systemd/systemd 2020-04-22T14:17:16.094 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.094 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.094 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu mem REG 8,1 766120 3335 /usr/lib64/libsepol.so.1 2020-04-22T14:17:16.095 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu mem REG 8,1 1760264 3670 /usr/lib64/libunistring.so.2.1.0 2020-04-22T14:17:16.095 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu mem REG 8,1 356920 3798 /usr/lib64/libpcap.so.1.9.0 2020-04-22T14:17:16.095 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu mem REG 8,1 144392 3449 /usr/lib64/libgpg-error.so.0.24.2 2020-04-22T14:17:16.095 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu mem REG 8,1 70432 3726 /usr/lib64/libjson-c.so.4.0.0 2020-04-22T14:17:16.095 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu mem REG 8,1 443488 5581 /usr/lib64/libdevmapper.so.1.02 2020-04-22T14:17:16.095 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu mem REG 8,1 26192 3541 /usr/lib64/libattr.so.1.1.2448 2020-04-22T14:17:16.095 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.095 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:16.096 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.096 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu mem REG 8,1 25192 3584 /usr/lib64/libcap-ng.so.0.0.0 2020-04-22T14:17:16.096 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.096 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.096 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.096 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.096 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:16.096 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:16.097 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu mem REG 8,1 162224 3672 /usr/lib64/libidn2.so.0.3.6 2020-04-22T14:17:16.097 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu mem REG 8,1 37824 3807 /usr/lib64/libip4tc.so.0.1.0 2020-04-22T14:17:16.097 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu mem REG 8,1 1385560 3654 /usr/lib64/libgcrypt.so.20.2.3 2020-04-22T14:17:16.097 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu mem REG 8,1 645024 5716 /usr/lib64/libcryptsetup.so.12.5.0 2020-04-22T14:17:16.097 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu mem REG 8,1 54816 3543 /usr/lib64/libacl.so.1.1.2253 2020-04-22T14:17:16.097 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:16.097 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.098 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.098 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.098 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu mem REG 8,1 228128 5610 /usr/lib64/libkmod.so.2.3.3 2020-04-22T14:17:16.098 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu mem REG 8,1 141392 3586 /usr/lib64/libaudit.so.1.0.0 2020-04-22T14:17:16.098 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu mem REG 8,1 74600 5752 /usr/lib64/libpam.so.0.84.2 2020-04-22T14:17:16.098 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.098 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.098 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu mem REG 8,1 357336 4307 /usr/lib64/libseccomp.so.2.4.1 2020-04-22T14:17:16.099 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.099 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu mem REG 8,1 5215944 6376 /usr/lib/systemd/libsystemd-shared-239.so 2020-04-22T14:17:16.099 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.099 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.099 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu 1u unix 0x00000000efc95c71 0t0 39031 type=STREAM 2020-04-22T14:17:16.099 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu 2u unix 0x00000000efc95c71 0t0 39031 type=STREAM 2020-04-22T14:17:16.099 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu 3u unix 0x000000009ee7e362 0t0 39048 type=DGRAM 2020-04-22T14:17:16.100 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu 4u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.100 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu 5u a_inode 0,14 0 2063 [signalfd] 2020-04-22T14:17:16.100 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu 6r DIR 0,26 0 668 /sys/fs/cgroup/systemd/user.slice/user-1000.slice/user@1000.service 2020-04-22T14:17:16.100 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu 7u a_inode 0,14 0 2063 [timerfd] 2020-04-22T14:17:16.100 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu 8u netlink 0t0 40129 KOBJECT_UEVENT 2020-04-22T14:17:16.100 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu 9u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.100 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu 10r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:16.101 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu 11u unix 0x000000003e85fb74 0t0 40147 /run/user/1000/bus type=STREAM 2020-04-22T14:17:16.101 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu 12r REG 0,4 0 40134 /proc/7434/mountinfo 2020-04-22T14:17:16.101 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu 13r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:16.101 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu 14r REG 0,4 0 4026532079 /proc/swaps 2020-04-22T14:17:16.101 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu 15u unix 0x00000000581de37d 0t0 40135 /run/user/1000/systemd/notify type=DGRAM 2020-04-22T14:17:16.101 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu 16u unix 0x00000000238278df 0t0 40137 type=DGRAM 2020-04-22T14:17:16.101 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu 17u unix 0x000000007200be7c 0t0 40138 type=DGRAM 2020-04-22T14:17:16.102 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu 18u unix 0x000000001efca837 0t0 40139 /run/user/1000/systemd/private type=STREAM 2020-04-22T14:17:16.102 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu 19u unix 0x00000000e60bb360 0t0 40141 type=STREAM 2020-04-22T14:17:16.102 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu 20u a_inode 0,14 0 2063 [timerfd] 2020-04-22T14:17:16.102 INFO:teuthology.orchestra.run.smithi103.stdout:systemd 7434 ubuntu 26u netlink 0t0 40150 SELINUX 2020-04-22T14:17:16.102 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.102 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.103 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu txt REG 8,1 2523648 6380 /usr/lib/systemd/systemd 2020-04-22T14:17:16.103 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 7704 29028 /usr/lib64/security/pam_deny.so 2020-04-22T14:17:16.103 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 16704 5754 /usr/lib64/libpam_misc.so.0.82.1 2020-04-22T14:17:16.103 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 855144 29339 /usr/lib64/security/pam_systemd.so 2020-04-22T14:17:16.103 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 24208 29040 /usr/lib64/security/pam_limits.so 2020-04-22T14:17:16.103 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 11888 29038 /usr/lib64/security/pam_keyinit.so 2020-04-22T14:17:16.103 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 11928 29043 /usr/lib64/security/pam_loginuid.so 2020-04-22T14:17:16.103 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 24328 29055 /usr/lib64/security/pam_selinux.so 2020-04-22T14:17:16.104 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 7808 29049 /usr/lib64/security/pam_permit.so 2020-04-22T14:17:16.104 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 68936 29798 /usr/lib64/security/pam_sss.so 2020-04-22T14:17:16.104 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 16088 29060 /usr/lib64/security/pam_succeed_if.so 2020-04-22T14:17:16.104 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 11912 29042 /usr/lib64/security/pam_localuser.so 2020-04-22T14:17:16.104 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.104 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 16240 3641 /usr/lib64/libkeyutils.so.1.6 2020-04-22T14:17:16.104 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 118728 5304 /usr/lib64/libkrb5support.so.0.1 2020-04-22T14:17:16.105 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 25992 3339 /usr/lib64/libcom_err.so.2.1 2020-04-22T14:17:16.105 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 273488 5296 /usr/lib64/libk5crypto.so.3.1 2020-04-22T14:17:16.105 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 1507952 5302 /usr/lib64/libkrb5.so.3.3 2020-04-22T14:17:16.105 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 603768 5292 /usr/lib64/libgssapi_krb5.so.2.2 2020-04-22T14:17:16.105 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 371032 5313 /usr/lib64/libtirpc.so.3.0.0 2020-04-22T14:17:16.105 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 116408 5315 /usr/lib64/libnsl.so.2.0.0 2020-04-22T14:17:16.105 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 142712 3373 /usr/lib64/libcrypt.so.1.1.0 2020-04-22T14:17:16.105 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 61448 29065 /usr/lib64/security/pam_unix.so 2020-04-22T14:17:16.106 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 860880 5511 /usr/lib64/libnss_systemd.so.2 2020-04-22T14:17:16.106 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:16.106 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu DEL REG 8,1 67741 /var/lib/sss/mc/initgroups 2020-04-22T14:17:16.106 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu DEL REG 8,1 67739 /var/lib/sss/mc/passwd 2020-04-22T14:17:16.106 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:16.106 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.106 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.106 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 766120 3335 /usr/lib64/libsepol.so.1 2020-04-22T14:17:16.107 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 1760264 3670 /usr/lib64/libunistring.so.2.1.0 2020-04-22T14:17:16.107 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 356920 3798 /usr/lib64/libpcap.so.1.9.0 2020-04-22T14:17:16.107 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 144392 3449 /usr/lib64/libgpg-error.so.0.24.2 2020-04-22T14:17:16.107 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 70432 3726 /usr/lib64/libjson-c.so.4.0.0 2020-04-22T14:17:16.107 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 443488 5581 /usr/lib64/libdevmapper.so.1.02 2020-04-22T14:17:16.107 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 26192 3541 /usr/lib64/libattr.so.1.1.2448 2020-04-22T14:17:16.107 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.108 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:16.108 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.108 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 25192 3584 /usr/lib64/libcap-ng.so.0.0.0 2020-04-22T14:17:16.108 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.108 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.108 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.108 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.108 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:16.109 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:16.109 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 162224 3672 /usr/lib64/libidn2.so.0.3.6 2020-04-22T14:17:16.109 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 37824 3807 /usr/lib64/libip4tc.so.0.1.0 2020-04-22T14:17:16.109 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 1385560 3654 /usr/lib64/libgcrypt.so.20.2.3 2020-04-22T14:17:16.109 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 645024 5716 /usr/lib64/libcryptsetup.so.12.5.0 2020-04-22T14:17:16.109 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 54816 3543 /usr/lib64/libacl.so.1.1.2253 2020-04-22T14:17:16.109 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:16.110 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.110 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.110 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.110 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 228128 5610 /usr/lib64/libkmod.so.2.3.3 2020-04-22T14:17:16.110 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 141392 3586 /usr/lib64/libaudit.so.1.0.0 2020-04-22T14:17:16.110 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 74600 5752 /usr/lib64/libpam.so.0.84.2 2020-04-22T14:17:16.110 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.111 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.111 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 357336 4307 /usr/lib64/libseccomp.so.2.4.1 2020-04-22T14:17:16.111 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.111 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 5215944 6376 /usr/lib/systemd/libsystemd-shared-239.so 2020-04-22T14:17:16.111 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.111 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu DEL REG 8,1 64856 /etc/selinux/targeted/contexts/files/file_contexts.bin 2020-04-22T14:17:16.111 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu DEL REG 8,1 64857 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2020-04-22T14:17:16.112 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.112 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu 1u unix 0x00000000efc95c71 0t0 39031 type=STREAM 2020-04-22T14:17:16.112 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu 2u unix 0x00000000efc95c71 0t0 39031 type=STREAM 2020-04-22T14:17:16.112 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu 3r REG 8,1 8406312 67739 /var/lib/sss/mc/passwd (deleted) 2020-04-22T14:17:16.112 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu 4r REG 8,1 10406312 67741 /var/lib/sss/mc/initgroups (deleted) 2020-04-22T14:17:16.112 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu 5u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:16.112 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu 6u a_inode 0,14 0 2063 [eventfd] 2020-04-22T14:17:16.112 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu 8w FIFO 0,13 0t0 39032 pipe 2020-04-22T14:17:16.113 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu 9u unix 0x0000000082544295 0t0 39044 type=STREAM 2020-04-22T14:17:16.113 INFO:teuthology.orchestra.run.smithi103.stdout:(sd-pam) 7438 ubuntu 10u unix 0x00000000f5d17435 0t0 39045 type=DGRAM 2020-04-22T14:17:16.113 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.113 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.113 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 root txt REG 8,1 912384 8649 /usr/sbin/rsyslogd 2020-04-22T14:17:16.113 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 root mem REG 0,24 16777216 16469 /run/log/journal/6183c63c7b5745e8bb22efdfc11a90bd/system.journal 2020-04-22T14:17:16.113 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 root mem REG 8,1 33304 50883 /usr/lib64/rsyslog/imjournal.so 2020-04-22T14:17:16.113 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 root mem REG 8,1 42192 50890 /usr/lib64/rsyslog/imuxsock.so 2020-04-22T14:17:16.113 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 root mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:16.114 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 root mem REG 8,1 34728 50891 /usr/lib64/rsyslog/lmnet.so 2020-04-22T14:17:16.114 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.114 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 root mem REG 8,1 144392 3449 /usr/lib64/libgpg-error.so.0.24.2 2020-04-22T14:17:16.114 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.114 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.114 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 root mem REG 8,1 1385560 3654 /usr/lib64/libgcrypt.so.20.2.3 2020-04-22T14:17:16.114 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.115 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 root mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:16.115 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:16.115 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:16.115 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.115 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.115 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.115 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 root mem REG 8,1 1637336 5512 /usr/lib64/libsystemd.so.0.23.0 2020-04-22T14:17:16.115 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 root mem REG 8,1 48456 4972 /usr/lib64/libfastjson.so.4.2.0 2020-04-22T14:17:16.116 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 root mem REG 8,1 16448 4970 /usr/lib64/libestr.so.0.0.0 2020-04-22T14:17:16.116 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.116 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.116 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.116 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.116 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.116 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.117 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 root 1w CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.117 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 root 2w CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.117 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 root 3r CHR 1,9 0t0 1033 /dev/urandom 2020-04-22T14:17:16.117 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 root 4r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:16.117 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 root 5u unix 0x0000000023734a38 0t0 37423 type=DGRAM 2020-04-22T14:17:16.117 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 root 6r REG 0,24 16777216 16469 /run/log/journal/6183c63c7b5745e8bb22efdfc11a90bd/system.journal 2020-04-22T14:17:16.117 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 root 7w REG 8,1 1713845 262178 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-04-22T14:17:16.117 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 root 8w REG 8,1 1394419 65352 /var/log/secure 2020-04-22T14:17:16.118 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 root 9w REG 8,1 982889 65351 /var/log/messages 2020-04-22T14:17:16.118 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 root 10w REG 8,1 36604 262177 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-04-22T14:17:16.118 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 root 11w REG 8,1 2637 65397 /var/log/cron 2020-04-22T14:17:16.118 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8144 in:imjour root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.118 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8144 in:imjour root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.118 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8144 in:imjour root txt REG 8,1 912384 8649 /usr/sbin/rsyslogd 2020-04-22T14:17:16.118 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8144 in:imjour root mem REG 0,24 16777216 16469 /run/log/journal/6183c63c7b5745e8bb22efdfc11a90bd/system.journal 2020-04-22T14:17:16.119 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8144 in:imjour root mem REG 8,1 33304 50883 /usr/lib64/rsyslog/imjournal.so 2020-04-22T14:17:16.119 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8144 in:imjour root mem REG 8,1 42192 50890 /usr/lib64/rsyslog/imuxsock.so 2020-04-22T14:17:16.119 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8144 in:imjour root mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:16.119 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8144 in:imjour root mem REG 8,1 34728 50891 /usr/lib64/rsyslog/lmnet.so 2020-04-22T14:17:16.119 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8144 in:imjour root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.119 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8144 in:imjour root mem REG 8,1 144392 3449 /usr/lib64/libgpg-error.so.0.24.2 2020-04-22T14:17:16.119 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8144 in:imjour root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.120 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8144 in:imjour root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.120 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8144 in:imjour root mem REG 8,1 1385560 3654 /usr/lib64/libgcrypt.so.20.2.3 2020-04-22T14:17:16.120 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8144 in:imjour root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.120 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8144 in:imjour root mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:16.120 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8144 in:imjour root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:16.120 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8144 in:imjour root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:16.120 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8144 in:imjour root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.120 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8144 in:imjour root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.121 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8144 in:imjour root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.121 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8144 in:imjour root mem REG 8,1 1637336 5512 /usr/lib64/libsystemd.so.0.23.0 2020-04-22T14:17:16.121 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8144 in:imjour root mem REG 8,1 48456 4972 /usr/lib64/libfastjson.so.4.2.0 2020-04-22T14:17:16.121 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8144 in:imjour root mem REG 8,1 16448 4970 /usr/lib64/libestr.so.0.0.0 2020-04-22T14:17:16.121 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8144 in:imjour root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.121 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8144 in:imjour root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.121 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8144 in:imjour root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.121 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8144 in:imjour root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.122 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8144 in:imjour root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.122 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8144 in:imjour root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.122 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8144 in:imjour root 1w CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.122 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8144 in:imjour root 2w CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.122 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8144 in:imjour root 3r CHR 1,9 0t0 1033 /dev/urandom 2020-04-22T14:17:16.122 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8144 in:imjour root 4r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:16.122 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8144 in:imjour root 5u unix 0x0000000023734a38 0t0 37423 type=DGRAM 2020-04-22T14:17:16.122 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8144 in:imjour root 6r REG 0,24 16777216 16469 /run/log/journal/6183c63c7b5745e8bb22efdfc11a90bd/system.journal 2020-04-22T14:17:16.123 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8144 in:imjour root 7w REG 8,1 1713845 262178 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-04-22T14:17:16.123 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8144 in:imjour root 8w REG 8,1 1394419 65352 /var/log/secure 2020-04-22T14:17:16.123 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8144 in:imjour root 9w REG 8,1 982889 65351 /var/log/messages 2020-04-22T14:17:16.123 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8144 in:imjour root 10w REG 8,1 36604 262177 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-04-22T14:17:16.123 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8144 in:imjour root 11w REG 8,1 2637 65397 /var/log/cron 2020-04-22T14:17:16.123 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8145 rs:main root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.123 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8145 rs:main root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.123 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8145 rs:main root txt REG 8,1 912384 8649 /usr/sbin/rsyslogd 2020-04-22T14:17:16.124 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8145 rs:main root mem REG 0,24 16777216 16469 /run/log/journal/6183c63c7b5745e8bb22efdfc11a90bd/system.journal 2020-04-22T14:17:16.124 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8145 rs:main root mem REG 8,1 33304 50883 /usr/lib64/rsyslog/imjournal.so 2020-04-22T14:17:16.124 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8145 rs:main root mem REG 8,1 42192 50890 /usr/lib64/rsyslog/imuxsock.so 2020-04-22T14:17:16.124 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8145 rs:main root mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:16.124 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8145 rs:main root mem REG 8,1 34728 50891 /usr/lib64/rsyslog/lmnet.so 2020-04-22T14:17:16.124 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8145 rs:main root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.124 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8145 rs:main root mem REG 8,1 144392 3449 /usr/lib64/libgpg-error.so.0.24.2 2020-04-22T14:17:16.124 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8145 rs:main root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.125 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8145 rs:main root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.125 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8145 rs:main root mem REG 8,1 1385560 3654 /usr/lib64/libgcrypt.so.20.2.3 2020-04-22T14:17:16.125 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8145 rs:main root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.125 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8145 rs:main root mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:16.125 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8145 rs:main root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:16.125 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8145 rs:main root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:16.125 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8145 rs:main root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.126 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8145 rs:main root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.126 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8145 rs:main root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.126 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8145 rs:main root mem REG 8,1 1637336 5512 /usr/lib64/libsystemd.so.0.23.0 2020-04-22T14:17:16.126 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8145 rs:main root mem REG 8,1 48456 4972 /usr/lib64/libfastjson.so.4.2.0 2020-04-22T14:17:16.126 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8145 rs:main root mem REG 8,1 16448 4970 /usr/lib64/libestr.so.0.0.0 2020-04-22T14:17:16.126 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8145 rs:main root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.126 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8145 rs:main root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.127 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8145 rs:main root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.127 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8145 rs:main root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.127 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8145 rs:main root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.127 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8145 rs:main root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.127 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8145 rs:main root 1w CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.127 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8145 rs:main root 2w CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.127 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8145 rs:main root 3r CHR 1,9 0t0 1033 /dev/urandom 2020-04-22T14:17:16.128 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8145 rs:main root 4r a_inode 0,14 0 2063 inotify 2020-04-22T14:17:16.128 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8145 rs:main root 5u unix 0x0000000023734a38 0t0 37423 type=DGRAM 2020-04-22T14:17:16.128 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8145 rs:main root 6r REG 0,24 16777216 16469 /run/log/journal/6183c63c7b5745e8bb22efdfc11a90bd/system.journal 2020-04-22T14:17:16.128 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8145 rs:main root 7w REG 8,1 1713845 262178 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-04-22T14:17:16.128 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8145 rs:main root 8w REG 8,1 1394419 65352 /var/log/secure 2020-04-22T14:17:16.128 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8145 rs:main root 9w REG 8,1 982889 65351 /var/log/messages 2020-04-22T14:17:16.128 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8145 rs:main root 10w REG 8,1 36604 262177 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-04-22T14:17:16.129 INFO:teuthology.orchestra.run.smithi103.stdout:rsyslogd 8142 8145 rs:main root 11w REG 8,1 2637 65397 /var/log/cron 2020-04-22T14:17:16.129 INFO:teuthology.orchestra.run.smithi103.stdout:nrpe 16798 nrpe cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.129 INFO:teuthology.orchestra.run.smithi103.stdout:nrpe 16798 nrpe rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.129 INFO:teuthology.orchestra.run.smithi103.stdout:nrpe 16798 nrpe txt REG 8,1 91464 29766 /usr/sbin/nrpe 2020-04-22T14:17:16.129 INFO:teuthology.orchestra.run.smithi103.stdout:nrpe 16798 nrpe DEL REG 8,1 67777 /var/lib/sss/mc/group 2020-04-22T14:17:16.129 INFO:teuthology.orchestra.run.smithi103.stdout:nrpe 16798 nrpe DEL REG 8,1 67774 /var/lib/sss/mc/passwd 2020-04-22T14:17:16.129 INFO:teuthology.orchestra.run.smithi103.stdout:nrpe 16798 nrpe mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:16.129 INFO:teuthology.orchestra.run.smithi103.stdout:nrpe 16798 nrpe mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.130 INFO:teuthology.orchestra.run.smithi103.stdout:nrpe 16798 nrpe mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.130 INFO:teuthology.orchestra.run.smithi103.stdout:nrpe 16798 nrpe mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.130 INFO:teuthology.orchestra.run.smithi103.stdout:nrpe 16798 nrpe mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.130 INFO:teuthology.orchestra.run.smithi103.stdout:nrpe 16798 nrpe mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.130 INFO:teuthology.orchestra.run.smithi103.stdout:nrpe 16798 nrpe mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:16.130 INFO:teuthology.orchestra.run.smithi103.stdout:nrpe 16798 nrpe mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.130 INFO:teuthology.orchestra.run.smithi103.stdout:nrpe 16798 nrpe 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.130 INFO:teuthology.orchestra.run.smithi103.stdout:nrpe 16798 nrpe 1w CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.131 INFO:teuthology.orchestra.run.smithi103.stdout:nrpe 16798 nrpe 2w CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.131 INFO:teuthology.orchestra.run.smithi103.stdout:nrpe 16798 nrpe 3r REG 8,1 8406312 67774 /var/lib/sss/mc/passwd (deleted) 2020-04-22T14:17:16.131 INFO:teuthology.orchestra.run.smithi103.stdout:nrpe 16798 nrpe 4u unix 0x00000000cef0d1ba 0t0 83347 type=DGRAM 2020-04-22T14:17:16.131 INFO:teuthology.orchestra.run.smithi103.stdout:nrpe 16798 nrpe 5r REG 8,1 6406312 67777 /var/lib/sss/mc/group (deleted) 2020-04-22T14:17:16.131 INFO:teuthology.orchestra.run.smithi103.stdout:nrpe 16798 nrpe 6u IPv4 83356 0t0 TCP *:5666 (LISTEN) 2020-04-22T14:17:16.131 INFO:teuthology.orchestra.run.smithi103.stdout:nrpe 16798 nrpe 7u IPv6 83357 0t0 TCP *:5666 (LISTEN) 2020-04-22T14:17:16.131 INFO:teuthology.orchestra.run.smithi103.stdout:kdmflush 21644 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.132 INFO:teuthology.orchestra.run.smithi103.stdout:kdmflush 21644 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.132 INFO:teuthology.orchestra.run.smithi103.stdout:kdmflush 21644 root txt unknown /proc/21644/exe 2020-04-22T14:17:16.132 INFO:teuthology.orchestra.run.smithi103.stdout:kdmflush 21676 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.132 INFO:teuthology.orchestra.run.smithi103.stdout:kdmflush 21676 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.132 INFO:teuthology.orchestra.run.smithi103.stdout:kdmflush 21676 root txt unknown /proc/21676/exe 2020-04-22T14:17:16.132 INFO:teuthology.orchestra.run.smithi103.stdout:kdmflush 21709 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.132 INFO:teuthology.orchestra.run.smithi103.stdout:kdmflush 21709 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.133 INFO:teuthology.orchestra.run.smithi103.stdout:kdmflush 21709 root txt unknown /proc/21709/exe 2020-04-22T14:17:16.133 INFO:teuthology.orchestra.run.smithi103.stdout:kdmflush 21742 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.133 INFO:teuthology.orchestra.run.smithi103.stdout:kdmflush 21742 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.133 INFO:teuthology.orchestra.run.smithi103.stdout:kdmflush 21742 root txt unknown /proc/21742/exe 2020-04-22T14:17:16.133 INFO:teuthology.orchestra.run.smithi103.stdout:kdmflush 21775 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.133 INFO:teuthology.orchestra.run.smithi103.stdout:kdmflush 21775 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.133 INFO:teuthology.orchestra.run.smithi103.stdout:kdmflush 21775 root txt unknown /proc/21775/exe 2020-04-22T14:17:16.133 INFO:teuthology.orchestra.run.smithi103.stdout:xfsalloc 21956 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.134 INFO:teuthology.orchestra.run.smithi103.stdout:xfsalloc 21956 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.134 INFO:teuthology.orchestra.run.smithi103.stdout:xfsalloc 21956 root txt unknown /proc/21956/exe 2020-04-22T14:17:16.134 INFO:teuthology.orchestra.run.smithi103.stdout:xfs_mru_c 21957 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.134 INFO:teuthology.orchestra.run.smithi103.stdout:xfs_mru_c 21957 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.134 INFO:teuthology.orchestra.run.smithi103.stdout:xfs_mru_c 21957 root txt unknown /proc/21957/exe 2020-04-22T14:17:16.134 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-buf/d 21960 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.134 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-buf/d 21960 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.135 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-buf/d 21960 root txt unknown /proc/21960/exe 2020-04-22T14:17:16.135 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-data/ 21961 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.135 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-data/ 21961 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.135 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-data/ 21961 root txt unknown /proc/21961/exe 2020-04-22T14:17:16.135 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-conv/ 21963 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.135 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-conv/ 21963 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.135 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-conv/ 21963 root txt unknown /proc/21963/exe 2020-04-22T14:17:16.135 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-cil/d 21965 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.136 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-cil/d 21965 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.136 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-cil/d 21965 root txt unknown /proc/21965/exe 2020-04-22T14:17:16.136 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-recla 21966 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.136 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-recla 21966 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.136 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-recla 21966 root txt unknown /proc/21966/exe 2020-04-22T14:17:16.136 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-log/d 21967 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.137 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-log/d 21967 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.137 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-log/d 21967 root txt unknown /proc/21967/exe 2020-04-22T14:17:16.137 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-eofbl 21968 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.137 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-eofbl 21968 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.137 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-eofbl 21968 root txt unknown /proc/21968/exe 2020-04-22T14:17:16.137 INFO:teuthology.orchestra.run.smithi103.stdout:xfsaild/d 21969 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.137 INFO:teuthology.orchestra.run.smithi103.stdout:xfsaild/d 21969 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.138 INFO:teuthology.orchestra.run.smithi103.stdout:xfsaild/d 21969 root txt unknown /proc/21969/exe 2020-04-22T14:17:16.138 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.138 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.138 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root txt REG 8,1 1231240 8900 /usr/sbin/sshd 2020-04-22T14:17:16.138 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 860880 5511 /usr/lib64/libnss_systemd.so.2 2020-04-22T14:17:16.138 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:16.138 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root DEL REG 8,1 67784 /var/lib/sss/mc/initgroups 2020-04-22T14:17:16.138 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 16104 29039 /usr/lib64/security/pam_lastlog.so 2020-04-22T14:17:16.139 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 11888 29064 /usr/lib64/security/pam_umask.so 2020-04-22T14:17:16.139 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 16704 5754 /usr/lib64/libpam_misc.so.0.82.1 2020-04-22T14:17:16.139 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 855144 29339 /usr/lib64/security/pam_systemd.so 2020-04-22T14:17:16.139 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 24208 29040 /usr/lib64/security/pam_limits.so 2020-04-22T14:17:16.139 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 12000 29046 /usr/lib64/security/pam_motd.so 2020-04-22T14:17:16.139 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 11888 29038 /usr/lib64/security/pam_keyinit.so 2020-04-22T14:17:16.139 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 41776 29047 /usr/lib64/security/pam_namespace.so 2020-04-22T14:17:16.140 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 11928 29043 /usr/lib64/security/pam_loginuid.so 2020-04-22T14:17:16.140 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 24328 29055 /usr/lib64/security/pam_selinux.so 2020-04-22T14:17:16.140 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 46232 5216 /usr/lib64/libcrack.so.2.9.0 2020-04-22T14:17:16.140 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 25728 5682 /usr/lib64/libpwquality.so.1.0.2 2020-04-22T14:17:16.140 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 11896 29000 /usr/lib64/security/pam_pwquality.so 2020-04-22T14:17:16.140 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 7808 29049 /usr/lib64/security/pam_permit.so 2020-04-22T14:17:16.140 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 11928 29048 /usr/lib64/security/pam_nologin.so 2020-04-22T14:17:16.140 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 16040 29057 /usr/lib64/security/pam_sepermit.so 2020-04-22T14:17:16.141 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 7704 29028 /usr/lib64/security/pam_deny.so 2020-04-22T14:17:16.141 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 68936 29798 /usr/lib64/security/pam_sss.so 2020-04-22T14:17:16.141 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 371032 5313 /usr/lib64/libtirpc.so.3.0.0 2020-04-22T14:17:16.141 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 116408 5315 /usr/lib64/libnsl.so.2.0.0 2020-04-22T14:17:16.141 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 61448 29065 /usr/lib64/security/pam_unix.so 2020-04-22T14:17:16.141 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 11912 29042 /usr/lib64/security/pam_localuser.so 2020-04-22T14:17:16.141 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 16088 29060 /usr/lib64/security/pam_succeed_if.so 2020-04-22T14:17:16.141 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 11880 29032 /usr/lib64/security/pam_faildelay.so 2020-04-22T14:17:16.142 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 20304 29030 /usr/lib64/security/pam_env.so 2020-04-22T14:17:16.142 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root DEL REG 8,1 67777 /var/lib/sss/mc/group 2020-04-22T14:17:16.142 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root DEL REG 8,1 67774 /var/lib/sss/mc/passwd 2020-04-22T14:17:16.142 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:16.142 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 144392 3449 /usr/lib64/libgpg-error.so.0.24.2 2020-04-22T14:17:16.142 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.142 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.143 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 16240 3641 /usr/lib64/libkeyutils.so.1.6 2020-04-22T14:17:16.143 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 118728 5304 /usr/lib64/libkrb5support.so.0.1 2020-04-22T14:17:16.143 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.143 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.143 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 1385560 3654 /usr/lib64/libgcrypt.so.20.2.3 2020-04-22T14:17:16.143 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.143 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:16.143 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:16.144 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:16.144 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.144 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.144 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 25192 3584 /usr/lib64/libcap-ng.so.0.0.0 2020-04-22T14:17:16.144 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.144 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 25992 3339 /usr/lib64/libcom_err.so.2.1 2020-04-22T14:17:16.145 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 273488 5296 /usr/lib64/libk5crypto.so.3.1 2020-04-22T14:17:16.145 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 1507952 5302 /usr/lib64/libkrb5.so.3.3 2020-04-22T14:17:16.145 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 603768 5292 /usr/lib64/libgssapi_krb5.so.2.2 2020-04-22T14:17:16.145 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.145 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.145 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 142712 3373 /usr/lib64/libcrypt.so.1.1.0 2020-04-22T14:17:16.145 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.146 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:16.146 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.146 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.146 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 1637336 5512 /usr/lib64/libsystemd.so.0.23.0 2020-04-22T14:17:16.146 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 74600 5752 /usr/lib64/libpam.so.0.84.2 2020-04-22T14:17:16.146 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 141392 3586 /usr/lib64/libaudit.so.1.0.0 2020-04-22T14:17:16.146 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 12200 8350 /usr/lib64/libfipscheck.so.1.2.1 2020-04-22T14:17:16.146 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.147 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root 0u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.147 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root 1u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.147 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root 2u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.147 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root 3u unix 0x00000000bfada46e 0t0 103874 type=DGRAM 2020-04-22T14:17:16.147 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root 4r REG 8,1 8406312 67774 /var/lib/sss/mc/passwd (deleted) 2020-04-22T14:17:16.147 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root 5u IPv4 102843 0t0 TCP smithi103:ssh->teuthology.front.sepia.ceph.com:50186 (ESTABLISHED) 2020-04-22T14:17:16.147 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root 6u unix 0x00000000d386888c 0t0 103846 type=STREAM 2020-04-22T14:17:16.147 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root 7r REG 8,1 10406312 67784 /var/lib/sss/mc/initgroups (deleted) 2020-04-22T14:17:16.148 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root 8r REG 8,1 6406312 67777 /var/lib/sss/mc/group (deleted) 2020-04-22T14:17:16.148 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root 9u unix 0x000000005b8050a6 0t0 103850 type=STREAM 2020-04-22T14:17:16.148 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root 11w FIFO 0,24 0t0 110929 /run/systemd/sessions/8.ref 2020-04-22T14:17:16.148 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22411 root 12u unix 0x0000000034713870 0t0 103878 type=STREAM 2020-04-22T14:17:16.148 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/4 22413 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.148 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/4 22413 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.148 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/4 22413 root txt unknown /proc/22413/exe 2020-04-22T14:17:16.149 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.149 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.149 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu txt REG 8,1 1231240 8900 /usr/sbin/sshd 2020-04-22T14:17:16.149 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 860880 5511 /usr/lib64/libnss_systemd.so.2 2020-04-22T14:17:16.149 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:16.149 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu DEL REG 8,1 67784 /var/lib/sss/mc/initgroups 2020-04-22T14:17:16.149 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 16104 29039 /usr/lib64/security/pam_lastlog.so 2020-04-22T14:17:16.149 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 11888 29064 /usr/lib64/security/pam_umask.so 2020-04-22T14:17:16.150 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 16704 5754 /usr/lib64/libpam_misc.so.0.82.1 2020-04-22T14:17:16.150 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 855144 29339 /usr/lib64/security/pam_systemd.so 2020-04-22T14:17:16.150 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 24208 29040 /usr/lib64/security/pam_limits.so 2020-04-22T14:17:16.150 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 12000 29046 /usr/lib64/security/pam_motd.so 2020-04-22T14:17:16.150 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 11888 29038 /usr/lib64/security/pam_keyinit.so 2020-04-22T14:17:16.150 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 41776 29047 /usr/lib64/security/pam_namespace.so 2020-04-22T14:17:16.150 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 11928 29043 /usr/lib64/security/pam_loginuid.so 2020-04-22T14:17:16.151 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 24328 29055 /usr/lib64/security/pam_selinux.so 2020-04-22T14:17:16.151 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 46232 5216 /usr/lib64/libcrack.so.2.9.0 2020-04-22T14:17:16.151 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 25728 5682 /usr/lib64/libpwquality.so.1.0.2 2020-04-22T14:17:16.151 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 11896 29000 /usr/lib64/security/pam_pwquality.so 2020-04-22T14:17:16.151 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 7808 29049 /usr/lib64/security/pam_permit.so 2020-04-22T14:17:16.151 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 11928 29048 /usr/lib64/security/pam_nologin.so 2020-04-22T14:17:16.151 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 16040 29057 /usr/lib64/security/pam_sepermit.so 2020-04-22T14:17:16.151 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 7704 29028 /usr/lib64/security/pam_deny.so 2020-04-22T14:17:16.152 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 68936 29798 /usr/lib64/security/pam_sss.so 2020-04-22T14:17:16.152 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 371032 5313 /usr/lib64/libtirpc.so.3.0.0 2020-04-22T14:17:16.152 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 116408 5315 /usr/lib64/libnsl.so.2.0.0 2020-04-22T14:17:16.152 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 61448 29065 /usr/lib64/security/pam_unix.so 2020-04-22T14:17:16.152 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 11912 29042 /usr/lib64/security/pam_localuser.so 2020-04-22T14:17:16.152 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 16088 29060 /usr/lib64/security/pam_succeed_if.so 2020-04-22T14:17:16.152 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 11880 29032 /usr/lib64/security/pam_faildelay.so 2020-04-22T14:17:16.153 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 20304 29030 /usr/lib64/security/pam_env.so 2020-04-22T14:17:16.153 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu DEL REG 8,1 67777 /var/lib/sss/mc/group 2020-04-22T14:17:16.153 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu DEL REG 8,1 67774 /var/lib/sss/mc/passwd 2020-04-22T14:17:16.153 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:16.153 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 144392 3449 /usr/lib64/libgpg-error.so.0.24.2 2020-04-22T14:17:16.153 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.153 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.153 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 16240 3641 /usr/lib64/libkeyutils.so.1.6 2020-04-22T14:17:16.154 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 118728 5304 /usr/lib64/libkrb5support.so.0.1 2020-04-22T14:17:16.154 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.154 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.154 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 1385560 3654 /usr/lib64/libgcrypt.so.20.2.3 2020-04-22T14:17:16.154 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.154 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:16.154 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:16.154 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:16.155 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.155 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.155 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 25192 3584 /usr/lib64/libcap-ng.so.0.0.0 2020-04-22T14:17:16.155 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.155 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 25992 3339 /usr/lib64/libcom_err.so.2.1 2020-04-22T14:17:16.155 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 273488 5296 /usr/lib64/libk5crypto.so.3.1 2020-04-22T14:17:16.155 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 1507952 5302 /usr/lib64/libkrb5.so.3.3 2020-04-22T14:17:16.155 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 603768 5292 /usr/lib64/libgssapi_krb5.so.2.2 2020-04-22T14:17:16.156 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.156 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.156 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 142712 3373 /usr/lib64/libcrypt.so.1.1.0 2020-04-22T14:17:16.156 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.156 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:16.156 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.156 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.157 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 1637336 5512 /usr/lib64/libsystemd.so.0.23.0 2020-04-22T14:17:16.157 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 74600 5752 /usr/lib64/libpam.so.0.84.2 2020-04-22T14:17:16.157 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 141392 3586 /usr/lib64/libaudit.so.1.0.0 2020-04-22T14:17:16.157 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 12200 8350 /usr/lib64/libfipscheck.so.1.2.1 2020-04-22T14:17:16.157 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.157 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 0u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.157 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 1u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.158 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 2u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.158 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 3u unix 0x00000000bfada46e 0t0 103874 type=DGRAM 2020-04-22T14:17:16.158 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 4r REG 8,1 8406312 67774 /var/lib/sss/mc/passwd (deleted) 2020-04-22T14:17:16.158 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 5u IPv4 102843 0t0 TCP smithi103:ssh->teuthology.front.sepia.ceph.com:50186 (ESTABLISHED) 2020-04-22T14:17:16.158 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 6u unix 0x00000000d386888c 0t0 103846 type=STREAM 2020-04-22T14:17:16.158 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 7r REG 8,1 10406312 67784 /var/lib/sss/mc/initgroups (deleted) 2020-04-22T14:17:16.158 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 8r REG 8,1 6406312 67777 /var/lib/sss/mc/group (deleted) 2020-04-22T14:17:16.158 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 9u unix 0x000000005b8050a6 0t0 103850 type=STREAM 2020-04-22T14:17:16.159 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 10u unix 0x000000003527d44f 0t0 103877 type=STREAM 2020-04-22T14:17:16.159 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 11w FIFO 0,24 0t0 110929 /run/systemd/sessions/8.ref 2020-04-22T14:17:16.159 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 12r FIFO 0,13 0t0 109904 pipe 2020-04-22T14:17:16.159 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 13w FIFO 0,13 0t0 109904 pipe 2020-04-22T14:17:16.159 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 17w FIFO 0,13 0t0 132153 pipe 2020-04-22T14:17:16.159 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 18r FIFO 0,13 0t0 132154 pipe 2020-04-22T14:17:16.159 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 19w FIFO 0,13 0t0 134171 pipe 2020-04-22T14:17:16.160 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 20r FIFO 0,13 0t0 132155 pipe 2020-04-22T14:17:16.160 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 21r FIFO 0,13 0t0 134172 pipe 2020-04-22T14:17:16.160 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 22w FIFO 0,13 0t0 133348 pipe 2020-04-22T14:17:16.160 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 23r FIFO 0,13 0t0 134173 pipe 2020-04-22T14:17:16.160 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 24r FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:16.160 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 25w FIFO 0,13 0t0 131270 pipe 2020-04-22T14:17:16.160 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 26r FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:16.160 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 27r FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:16.161 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 28w FIFO 0,13 0t0 132538 pipe 2020-04-22T14:17:16.161 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 29r FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:16.161 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 30r FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:16.161 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 31w FIFO 0,13 0t0 133421 pipe 2020-04-22T14:17:16.161 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 32r FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:16.161 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 33r FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:16.161 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 34w FIFO 0,13 0t0 329721 pipe 2020-04-22T14:17:16.162 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 35r FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:16.162 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 36r FIFO 0,13 0t0 329722 pipe 2020-04-22T14:17:16.162 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 38r FIFO 0,13 0t0 329723 pipe 2020-04-22T14:17:16.162 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 39r FIFO 0,13 0t0 345797 pipe 2020-04-22T14:17:16.162 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 40w FIFO 0,13 0t0 343451 pipe 2020-04-22T14:17:16.162 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 42r FIFO 0,13 0t0 343452 pipe 2020-04-22T14:17:16.162 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 43w FIFO 0,13 0t0 350442 pipe 2020-04-22T14:17:16.162 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 44r FIFO 0,13 0t0 343453 pipe 2020-04-22T14:17:16.163 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 45r FIFO 0,13 0t0 350443 pipe 2020-04-22T14:17:16.163 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 46r FIFO 0,13 0t0 345798 pipe 2020-04-22T14:17:16.163 INFO:teuthology.orchestra.run.smithi103.stdout:sshd 22417 ubuntu 47r FIFO 0,13 0t0 350444 pipe 2020-04-22T14:17:16.163 INFO:teuthology.orchestra.run.smithi103.stdout:chronyd 22492 chrony cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.163 INFO:teuthology.orchestra.run.smithi103.stdout:chronyd 22492 chrony rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.163 INFO:teuthology.orchestra.run.smithi103.stdout:chronyd 22492 chrony txt REG 8,1 366808 8962 /usr/sbin/chronyd 2020-04-22T14:17:16.163 INFO:teuthology.orchestra.run.smithi103.stdout:chronyd 22492 chrony mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.164 INFO:teuthology.orchestra.run.smithi103.stdout:chronyd 22492 chrony mem REG 8,1 41304 3206 /usr/lib64/libnss_dns-2.28.so 2020-04-22T14:17:16.164 INFO:teuthology.orchestra.run.smithi103.stdout:chronyd 22492 chrony mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:16.164 INFO:teuthology.orchestra.run.smithi103.stdout:chronyd 22492 chrony DEL REG 8,1 67774 /var/lib/sss/mc/passwd 2020-04-22T14:17:16.164 INFO:teuthology.orchestra.run.smithi103.stdout:chronyd 22492 chrony mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:16.164 INFO:teuthology.orchestra.run.smithi103.stdout:chronyd 22492 chrony mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.164 INFO:teuthology.orchestra.run.smithi103.stdout:chronyd 22492 chrony mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.164 INFO:teuthology.orchestra.run.smithi103.stdout:chronyd 22492 chrony mem REG 8,1 357336 4307 /usr/lib64/libseccomp.so.2.4.1 2020-04-22T14:17:16.164 INFO:teuthology.orchestra.run.smithi103.stdout:chronyd 22492 chrony mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:16.165 INFO:teuthology.orchestra.run.smithi103.stdout:chronyd 22492 chrony mem REG 8,1 299920 3821 /usr/lib64/libnettle.so.6.5 2020-04-22T14:17:16.165 INFO:teuthology.orchestra.run.smithi103.stdout:chronyd 22492 chrony mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.165 INFO:teuthology.orchestra.run.smithi103.stdout:chronyd 22492 chrony mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.165 INFO:teuthology.orchestra.run.smithi103.stdout:chronyd 22492 chrony 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.165 INFO:teuthology.orchestra.run.smithi103.stdout:chronyd 22492 chrony 1w CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.165 INFO:teuthology.orchestra.run.smithi103.stdout:chronyd 22492 chrony 2u CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.165 INFO:teuthology.orchestra.run.smithi103.stdout:chronyd 22492 chrony 3u unix 0x00000000fbcefaa3 0t0 101984 type=DGRAM 2020-04-22T14:17:16.166 INFO:teuthology.orchestra.run.smithi103.stdout:chronyd 22492 chrony 5r REG 8,1 8406312 67774 /var/lib/sss/mc/passwd (deleted) 2020-04-22T14:17:16.166 INFO:teuthology.orchestra.run.smithi103.stdout:chronyd 22492 chrony 6u unix 0x00000000dd5e3e3f 0t0 101987 type=STREAM 2020-04-22T14:17:16.166 INFO:teuthology.orchestra.run.smithi103.stdout:chronyd 22492 chrony 7u IPv4 101989 0t0 UDP localhost:323 2020-04-22T14:17:16.166 INFO:teuthology.orchestra.run.smithi103.stdout:chronyd 22492 chrony 8u IPv6 101990 0t0 UDP localhost:323 2020-04-22T14:17:16.166 INFO:teuthology.orchestra.run.smithi103.stdout:chronyd 22492 chrony 9u unix 0x000000007a5bdc41 0t0 101991 /var/run/chrony/chronyd.sock type=DGRAM 2020-04-22T14:17:16.166 INFO:teuthology.orchestra.run.smithi103.stdout:chronyd 22492 chrony 10u sock 0,9 0t0 216330 protocol: UDP 2020-04-22T14:17:16.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-cras 22886 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-cras 22886 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-cras 22886 root txt REG 8,1 15496 6602 /usr/libexec/platform-python3.6 2020-04-22T14:17:16.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-cras 22886 root mem REG 8,1 16632 41078 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-cras 22886 root mem REG 8,1 37448 41100 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-cras 22886 root mem REG 8,1 59368 41092 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-cras 22886 root mem REG 8,1 130256 41081 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-cras 22886 root mem REG 8,1 52720 41084 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-cras 22886 root mem REG 8,1 23056 41069 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-cras 22886 root mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:16.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-cras 22886 root DEL REG 8,1 65083 /var/lib/sss/mc/passwd 2020-04-22T14:17:16.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-cras 22886 root mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:16.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-cras 22886 root mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:16.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-cras 22886 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-cras 22886 root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-cras 22886 root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:16.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-cras 22886 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-cras 22886 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-cras 22886 root mem REG 8,1 3371672 6608 /usr/lib64/libpython3.6m.so.1.0 2020-04-22T14:17:16.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-cras 22886 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-cras 22886 root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:16.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-cras 22886 root mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:16.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-cras 22886 root mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:16.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-cras 22886 root mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:16.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-cras 22886 root mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:16.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-cras 22886 root mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:16.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-cras 22886 root mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:16.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-cras 22886 root mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:16.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-cras 22886 root mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:16.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-cras 22886 root mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:16.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-cras 22886 root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:16.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-cras 22886 root mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:16.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-cras 22886 root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-cras 22886 root 1u unix 0x00000000c2aa7d50 0t0 110189 type=STREAM 2020-04-22T14:17:16.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-cras 22886 root 2u unix 0x00000000c2aa7d50 0t0 110189 type=STREAM 2020-04-22T14:17:16.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-cras 22886 root 3r REG 8,1 8406312 65083 /var/lib/sss/mc/passwd (deleted) 2020-04-22T14:17:16.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-cras 22886 root 4u unix 0x00000000756b5917 0t0 110192 type=STREAM 2020-04-22T14:17:16.171 INFO:teuthology.orchestra.run.smithi103.stdout:anacron 23642 root cwd DIR 8,1 4096 65212 /var/spool/anacron 2020-04-22T14:17:16.171 INFO:teuthology.orchestra.run.smithi103.stdout:anacron 23642 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.172 INFO:teuthology.orchestra.run.smithi103.stdout:anacron 23642 root txt REG 8,1 58312 6693 /usr/sbin/anacron 2020-04-22T14:17:16.172 INFO:teuthology.orchestra.run.smithi103.stdout:anacron 23642 root mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:16.172 INFO:teuthology.orchestra.run.smithi103.stdout:anacron 23642 root mem REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:16.172 INFO:teuthology.orchestra.run.smithi103.stdout:anacron 23642 root mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:16.172 INFO:teuthology.orchestra.run.smithi103.stdout:anacron 23642 root mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:16.172 INFO:teuthology.orchestra.run.smithi103.stdout:anacron 23642 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.172 INFO:teuthology.orchestra.run.smithi103.stdout:anacron 23642 root mem REG 8,1 25192 3584 /usr/lib64/libcap-ng.so.0.0.0 2020-04-22T14:17:16.172 INFO:teuthology.orchestra.run.smithi103.stdout:anacron 23642 root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.173 INFO:teuthology.orchestra.run.smithi103.stdout:anacron 23642 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.173 INFO:teuthology.orchestra.run.smithi103.stdout:anacron 23642 root mem REG 8,1 141392 3586 /usr/lib64/libaudit.so.1.0.0 2020-04-22T14:17:16.173 INFO:teuthology.orchestra.run.smithi103.stdout:anacron 23642 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.173 INFO:teuthology.orchestra.run.smithi103.stdout:anacron 23642 root mem REG 8,1 74600 5752 /usr/lib64/libpam.so.0.84.2 2020-04-22T14:17:16.173 INFO:teuthology.orchestra.run.smithi103.stdout:anacron 23642 root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.173 INFO:teuthology.orchestra.run.smithi103.stdout:anacron 23642 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.173 INFO:teuthology.orchestra.run.smithi103.stdout:anacron 23642 root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:16.173 INFO:teuthology.orchestra.run.smithi103.stdout:anacron 23642 root mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:16.174 INFO:teuthology.orchestra.run.smithi103.stdout:anacron 23642 root mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:16.174 INFO:teuthology.orchestra.run.smithi103.stdout:anacron 23642 root mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:16.174 INFO:teuthology.orchestra.run.smithi103.stdout:anacron 23642 root mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:16.174 INFO:teuthology.orchestra.run.smithi103.stdout:anacron 23642 root mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:16.174 INFO:teuthology.orchestra.run.smithi103.stdout:anacron 23642 root mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:16.174 INFO:teuthology.orchestra.run.smithi103.stdout:anacron 23642 root mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:16.174 INFO:teuthology.orchestra.run.smithi103.stdout:anacron 23642 root mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:16.175 INFO:teuthology.orchestra.run.smithi103.stdout:anacron 23642 root mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:16.175 INFO:teuthology.orchestra.run.smithi103.stdout:anacron 23642 root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:16.175 INFO:teuthology.orchestra.run.smithi103.stdout:anacron 23642 root mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:16.175 INFO:teuthology.orchestra.run.smithi103.stdout:anacron 23642 root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.175 INFO:teuthology.orchestra.run.smithi103.stdout:anacron 23642 root 1w CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.175 INFO:teuthology.orchestra.run.smithi103.stdout:anacron 23642 root 2w CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.175 INFO:teuthology.orchestra.run.smithi103.stdout:anacron 23642 root 4u unix 0x00000000efa79c54 0t0 113863 type=DGRAM 2020-04-22T14:17:16.175 INFO:teuthology.orchestra.run.smithi103.stdout:anacron 23642 root 5uW REG 8,1 0 65215 /var/spool/anacron/cron.weekly 2020-04-22T14:17:16.176 INFO:teuthology.orchestra.run.smithi103.stdout:anacron 23642 root 6uW REG 8,1 0 65216 /var/spool/anacron/cron.monthly 2020-04-22T14:17:16.176 INFO:teuthology.orchestra.run.smithi103.stdout:anacron 23642 root 7r REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:16.176 INFO:teuthology.orchestra.run.smithi103.stdout:anacron 23642 root 8u unix 0x00000000303ba065 0t0 293879 type=STREAM 2020-04-22T14:17:16.176 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/6 27917 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.176 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/6 27917 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.176 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/6 27917 root txt unknown /proc/27917/exe 2020-04-22T14:17:16.176 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/3 27919 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.177 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/3 27919 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.177 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/3 27919 root txt unknown /proc/27919/exe 2020-04-22T14:17:16.177 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-buf/d 29216 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.177 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-buf/d 29216 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.177 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-buf/d 29216 root txt unknown /proc/29216/exe 2020-04-22T14:17:16.177 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-data/ 29217 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.177 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-data/ 29217 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.178 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-data/ 29217 root txt unknown /proc/29217/exe 2020-04-22T14:17:16.178 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-conv/ 29218 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.178 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-conv/ 29218 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.178 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-conv/ 29218 root txt unknown /proc/29218/exe 2020-04-22T14:17:16.178 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-cil/d 29219 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.178 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-cil/d 29219 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.178 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-cil/d 29219 root txt unknown /proc/29219/exe 2020-04-22T14:17:16.179 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-recla 29220 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.179 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-recla 29220 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.179 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-recla 29220 root txt unknown /proc/29220/exe 2020-04-22T14:17:16.179 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-log/d 29221 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.179 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-log/d 29221 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.179 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-log/d 29221 root txt unknown /proc/29221/exe 2020-04-22T14:17:16.179 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-eofbl 29222 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.179 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-eofbl 29222 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.180 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-eofbl 29222 root txt unknown /proc/29222/exe 2020-04-22T14:17:16.180 INFO:teuthology.orchestra.run.smithi103.stdout:xfsaild/d 29223 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.180 INFO:teuthology.orchestra.run.smithi103.stdout:xfsaild/d 29223 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.180 INFO:teuthology.orchestra.run.smithi103.stdout:xfsaild/d 29223 root txt unknown /proc/29223/exe 2020-04-22T14:17:16.180 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-buf/d 29356 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.180 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-buf/d 29356 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.180 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-buf/d 29356 root txt unknown /proc/29356/exe 2020-04-22T14:17:16.180 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-data/ 29357 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.181 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-data/ 29357 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.181 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-data/ 29357 root txt unknown /proc/29357/exe 2020-04-22T14:17:16.181 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-conv/ 29358 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.181 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-conv/ 29358 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.181 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-conv/ 29358 root txt unknown /proc/29358/exe 2020-04-22T14:17:16.181 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-cil/d 29359 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.181 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-cil/d 29359 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.181 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-cil/d 29359 root txt unknown /proc/29359/exe 2020-04-22T14:17:16.181 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-recla 29360 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.182 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-recla 29360 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.182 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-recla 29360 root txt unknown /proc/29360/exe 2020-04-22T14:17:16.182 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-log/d 29361 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.182 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-log/d 29361 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.182 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-log/d 29361 root txt unknown /proc/29361/exe 2020-04-22T14:17:16.182 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-eofbl 29362 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.182 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-eofbl 29362 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.182 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-eofbl 29362 root txt unknown /proc/29362/exe 2020-04-22T14:17:16.183 INFO:teuthology.orchestra.run.smithi103.stdout:xfsaild/d 29363 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.183 INFO:teuthology.orchestra.run.smithi103.stdout:xfsaild/d 29363 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.183 INFO:teuthology.orchestra.run.smithi103.stdout:xfsaild/d 29363 root txt unknown /proc/29363/exe 2020-04-22T14:17:16.183 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-buf/d 29496 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.183 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-buf/d 29496 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.183 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-buf/d 29496 root txt unknown /proc/29496/exe 2020-04-22T14:17:16.183 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-data/ 29497 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.183 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-data/ 29497 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.184 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-data/ 29497 root txt unknown /proc/29497/exe 2020-04-22T14:17:16.184 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-conv/ 29498 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.184 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-conv/ 29498 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.184 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-conv/ 29498 root txt unknown /proc/29498/exe 2020-04-22T14:17:16.184 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-cil/d 29499 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.184 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-cil/d 29499 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.184 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-cil/d 29499 root txt unknown /proc/29499/exe 2020-04-22T14:17:16.185 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-recla 29500 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.185 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-recla 29500 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.185 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-recla 29500 root txt unknown /proc/29500/exe 2020-04-22T14:17:16.185 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-log/d 29501 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.185 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-log/d 29501 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.185 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-log/d 29501 root txt unknown /proc/29501/exe 2020-04-22T14:17:16.185 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-eofbl 29502 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.185 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-eofbl 29502 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.186 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-eofbl 29502 root txt unknown /proc/29502/exe 2020-04-22T14:17:16.186 INFO:teuthology.orchestra.run.smithi103.stdout:xfsaild/d 29503 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.186 INFO:teuthology.orchestra.run.smithi103.stdout:xfsaild/d 29503 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.186 INFO:teuthology.orchestra.run.smithi103.stdout:xfsaild/d 29503 root txt unknown /proc/29503/exe 2020-04-22T14:17:16.186 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-buf/d 29636 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.186 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-buf/d 29636 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.186 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-buf/d 29636 root txt unknown /proc/29636/exe 2020-04-22T14:17:16.186 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-data/ 29637 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.187 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-data/ 29637 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.187 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-data/ 29637 root txt unknown /proc/29637/exe 2020-04-22T14:17:16.187 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-conv/ 29638 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.187 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-conv/ 29638 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.187 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-conv/ 29638 root txt unknown /proc/29638/exe 2020-04-22T14:17:16.187 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-cil/d 29639 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.188 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-cil/d 29639 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.188 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-cil/d 29639 root txt unknown /proc/29639/exe 2020-04-22T14:17:16.188 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-recla 29640 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.188 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-recla 29640 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.188 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-recla 29640 root txt unknown /proc/29640/exe 2020-04-22T14:17:16.188 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-log/d 29641 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.188 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-log/d 29641 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.188 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-log/d 29641 root txt unknown /proc/29641/exe 2020-04-22T14:17:16.189 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-eofbl 29642 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.189 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-eofbl 29642 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.189 INFO:teuthology.orchestra.run.smithi103.stdout:xfs-eofbl 29642 root txt unknown /proc/29642/exe 2020-04-22T14:17:16.189 INFO:teuthology.orchestra.run.smithi103.stdout:xfsaild/d 29643 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.189 INFO:teuthology.orchestra.run.smithi103.stdout:xfsaild/d 29643 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.189 INFO:teuthology.orchestra.run.smithi103.stdout:xfsaild/d 29643 root txt unknown /proc/29643/exe 2020-04-22T14:17:16.189 INFO:teuthology.orchestra.run.smithi103.stdout:dio/dm-1 29719 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.189 INFO:teuthology.orchestra.run.smithi103.stdout:dio/dm-1 29719 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.190 INFO:teuthology.orchestra.run.smithi103.stdout:dio/dm-1 29719 root txt unknown /proc/29719/exe 2020-04-22T14:17:16.190 INFO:teuthology.orchestra.run.smithi103.stdout:dio/dm-2 29902 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.190 INFO:teuthology.orchestra.run.smithi103.stdout:dio/dm-2 29902 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.190 INFO:teuthology.orchestra.run.smithi103.stdout:dio/dm-2 29902 root txt unknown /proc/29902/exe 2020-04-22T14:17:16.190 INFO:teuthology.orchestra.run.smithi103.stdout:dio/dm-3 30085 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.190 INFO:teuthology.orchestra.run.smithi103.stdout:dio/dm-3 30085 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.190 INFO:teuthology.orchestra.run.smithi103.stdout:dio/dm-3 30085 root txt unknown /proc/30085/exe 2020-04-22T14:17:16.190 INFO:teuthology.orchestra.run.smithi103.stdout:dio/dm-4 30268 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:16.190 INFO:teuthology.orchestra.run.smithi103.stdout:dio/dm-4 30268 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.191 INFO:teuthology.orchestra.run.smithi103.stdout:dio/dm-4 30268 root txt unknown /proc/30268/exe 2020-04-22T14:17:16.191 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.191 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.191 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root txt REG 8,1 207056 9178 /usr/bin/sudo 2020-04-22T14:17:16.191 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 16704 5754 /usr/lib64/libpam_misc.so.0.82.1 2020-04-22T14:17:16.191 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 855144 29339 /usr/lib64/security/pam_systemd.so 2020-04-22T14:17:16.191 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 24208 29040 /usr/lib64/security/pam_limits.so 2020-04-22T14:17:16.192 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 11888 29038 /usr/lib64/security/pam_keyinit.so 2020-04-22T14:17:16.192 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 46232 5216 /usr/lib64/libcrack.so.2.9.0 2020-04-22T14:17:16.192 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 25728 5682 /usr/lib64/libpwquality.so.1.0.2 2020-04-22T14:17:16.192 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 11896 29000 /usr/lib64/security/pam_pwquality.so 2020-04-22T14:17:16.192 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 7808 29049 /usr/lib64/security/pam_permit.so 2020-04-22T14:17:16.192 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 7704 29028 /usr/lib64/security/pam_deny.so 2020-04-22T14:17:16.192 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 68936 29798 /usr/lib64/security/pam_sss.so 2020-04-22T14:17:16.192 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 371032 5313 /usr/lib64/libtirpc.so.3.0.0 2020-04-22T14:17:16.193 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 116408 5315 /usr/lib64/libnsl.so.2.0.0 2020-04-22T14:17:16.193 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 61448 29065 /usr/lib64/security/pam_unix.so 2020-04-22T14:17:16.193 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 11912 29042 /usr/lib64/security/pam_localuser.so 2020-04-22T14:17:16.193 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 16088 29060 /usr/lib64/security/pam_succeed_if.so 2020-04-22T14:17:16.193 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 11880 29032 /usr/lib64/security/pam_faildelay.so 2020-04-22T14:17:16.193 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 20304 29030 /usr/lib64/security/pam_env.so 2020-04-22T14:17:16.193 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:16.193 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.194 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.194 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.194 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.194 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:16.194 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.194 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 860880 5511 /usr/lib64/libnss_systemd.so.2 2020-04-22T14:17:16.194 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:16.195 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:16.195 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 16240 3641 /usr/lib64/libkeyutils.so.1.6 2020-04-22T14:17:16.195 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 118728 5304 /usr/lib64/libkrb5support.so.0.1 2020-04-22T14:17:16.195 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 25992 3339 /usr/lib64/libcom_err.so.2.1 2020-04-22T14:17:16.195 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 273488 5296 /usr/lib64/libk5crypto.so.3.1 2020-04-22T14:17:16.195 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 1507952 5302 /usr/lib64/libkrb5.so.3.3 2020-04-22T14:17:16.196 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 603768 5292 /usr/lib64/libgssapi_krb5.so.2.2 2020-04-22T14:17:16.196 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 142712 3373 /usr/lib64/libcrypt.so.1.1.0 2020-04-22T14:17:16.196 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.196 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:16.196 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 149160 4994 /usr/lib64/libsasl2.so.3.0.0 2020-04-22T14:17:16.196 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.196 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.196 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 97056 5009 /usr/lib64/liblber-2.4.so.2.10.9 2020-04-22T14:17:16.197 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 477472 5011 /usr/lib64/libldap-2.4.so.2.10.9 2020-04-22T14:17:16.197 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 74600 5752 /usr/lib64/libpam.so.0.84.2 2020-04-22T14:17:16.197 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 549944 16572 /usr/libexec/sudo/sudoers.so 2020-04-22T14:17:16.197 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:16.197 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:16.197 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:16.197 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.198 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 25192 3584 /usr/lib64/libcap-ng.so.0.0.0 2020-04-22T14:17:16.198 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.198 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.198 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.198 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 182296 16569 /usr/libexec/sudo/libsudo_util.so.0.0.0 2020-04-22T14:17:16.198 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:16.198 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.198 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 141392 3586 /usr/lib64/libaudit.so.1.0.0 2020-04-22T14:17:16.199 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.199 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:16.199 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:16.199 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:16.199 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:16.199 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:16.199 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:16.199 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:16.200 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:16.200 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:16.200 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:16.200 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:16.200 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:16.200 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root 0r FIFO 0,13 0t0 132153 pipe 2020-04-22T14:17:16.200 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root 1w FIFO 0,13 0t0 132154 pipe 2020-04-22T14:17:16.200 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root 2w FIFO 0,13 0t0 132155 pipe 2020-04-22T14:17:16.201 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root 3r REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:16.201 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root 4u unix 0x0000000040018ab2 0t0 134155 type=STREAM 2020-04-22T14:17:16.201 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root 5u netlink 0t0 134163 AUDIT 2020-04-22T14:17:16.201 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root 6r REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:16.201 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root 7r REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:16.201 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root 9u unix 0x000000003096891b 0t0 134166 type=DGRAM 2020-04-22T14:17:16.201 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root 10r FIFO 0,13 0t0 134169 pipe 2020-04-22T14:17:16.201 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32190 root 11w FIFO 0,13 0t0 134169 pipe 2020-04-22T14:17:16.202 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32206 root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.202 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32206 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.202 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32206 root txt REG 8,1 15496 6602 /usr/libexec/platform-python3.6 2020-04-22T14:17:16.202 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32206 root mem REG 8,1 59368 41092 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.202 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32206 root mem REG 8,1 16632 41078 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.202 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32206 root mem REG 8,1 52720 41084 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.202 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32206 root mem REG 8,1 37448 41100 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.203 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32206 root mem REG 8,1 19536 41090 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.203 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32206 root mem REG 8,1 23056 41069 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.203 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32206 root mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:16.203 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32206 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.203 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32206 root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.203 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32206 root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:16.204 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32206 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.204 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32206 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.204 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32206 root mem REG 8,1 3371672 6608 /usr/lib64/libpython3.6m.so.1.0 2020-04-22T14:17:16.204 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32206 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.204 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32206 root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:16.204 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32206 root mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:16.204 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32206 root mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:16.205 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32206 root mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:16.205 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32206 root mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:16.205 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32206 root mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:16.205 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32206 root mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:16.205 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32206 root mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:16.205 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32206 root mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:16.205 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32206 root mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:16.205 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32206 root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:16.206 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32206 root mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:16.206 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32206 root 0r FIFO 0,13 0t0 132153 pipe 2020-04-22T14:17:16.206 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32206 root 1w FIFO 0,13 0t0 132154 pipe 2020-04-22T14:17:16.206 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32206 root 2w FIFO 0,13 0t0 132155 pipe 2020-04-22T14:17:16.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root txt REG 8,1 10050864 66359 /usr/bin/ceph-mon 2020-04-22T14:17:16.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:16.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:16.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:16.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:16.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:16.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:16.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:16.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:16.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 1w FIFO 0,13 0t0 132154 pipe 2020-04-22T14:17:16.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 2w FIFO 0,13 0t0 132155 pipe 2020-04-22T14:17:16.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 3r FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 4w FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 5w REG 8,1 39563307 526779 /var/log/ceph/ceph-mon.a.log 2020-04-22T14:17:16.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 6uW REG 0,24 6 127909 /run/ceph/ceph-mon.a.pid 2020-04-22T14:17:16.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 7r FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 8w FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 9u unix 0x000000009e54f7ab 0t0 127911 /var/run/ceph/ceph-mon.a.asok type=STREAM 2020-04-22T14:17:16.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 10r FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 11w FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 12r FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 13w FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 14r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 15uW REG 253,0 0 8388742 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2020-04-22T14:17:16.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 16r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 17u IPv4 337592 0t0 TCP smithi103:3300->192.168.0.1:60288 (ESTABLISHED) 2020-04-22T14:17:16.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 18w REG 253,0 646 8388749 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2020-04-22T14:17:16.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 19r REG 253,0 21382523 8388751 /var/lib/ceph/mon/ceph-a/store.db/000020.sst 2020-04-22T14:17:16.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 20u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 21r FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 22w FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 23u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 24r FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 25w FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 26u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 27r FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 28w FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 29u IPv4 133126 0t0 TCP smithi103:3300 (LISTEN) 2020-04-22T14:17:16.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 30u IPv4 133127 0t0 TCP smithi103:smc-https (LISTEN) 2020-04-22T14:17:16.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 31u IPv4 131148 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48636 (ESTABLISHED) 2020-04-22T14:17:16.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 32r FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 33w FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 34r FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 35w FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 36u IPv4 137349 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48734 (ESTABLISHED) 2020-04-22T14:17:16.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 37u IPv4 131164 0t0 TCP smithi103:59464->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:16.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 38u IPv4 133342 0t0 TCP smithi103:51784->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 39u IPv4 129560 0t0 TCP smithi103:3300->smithi103:46588 (ESTABLISHED) 2020-04-22T14:17:16.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 40u IPv4 129566 0t0 TCP smithi103:3300->smithi103:46590 (ESTABLISHED) 2020-04-22T14:17:16.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 41u IPv4 136443 0t0 TCP smithi103:3300->smithi103:46606 (ESTABLISHED) 2020-04-22T14:17:16.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 42u IPv4 129577 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48898 (ESTABLISHED) 2020-04-22T14:17:16.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 43u IPv4 343020 0t0 TCP smithi103:3300->192.168.0.2:54826 (ESTABLISHED) 2020-04-22T14:17:16.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 root 44w REG 253,0 10355769 8388744 /var/lib/ceph/mon/ceph-a/store.db/000018.log 2020-04-22T14:17:16.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root txt REG 8,1 10050864 66359 /usr/bin/ceph-mon 2020-04-22T14:17:16.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:16.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:16.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:16.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:16.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:16.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:16.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:16.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:16.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 1w FIFO 0,13 0t0 132154 pipe 2020-04-22T14:17:16.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 2w FIFO 0,13 0t0 132155 pipe 2020-04-22T14:17:16.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 3r FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 4w FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 5w REG 8,1 39563307 526779 /var/log/ceph/ceph-mon.a.log 2020-04-22T14:17:16.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 6uW REG 0,24 6 127909 /run/ceph/ceph-mon.a.pid 2020-04-22T14:17:16.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 7r FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 8w FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 9u unix 0x000000009e54f7ab 0t0 127911 /var/run/ceph/ceph-mon.a.asok type=STREAM 2020-04-22T14:17:16.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 10r FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 11w FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 12r FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 13w FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 14r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 15uW REG 253,0 0 8388742 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2020-04-22T14:17:16.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 16r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 17u IPv4 337592 0t0 TCP smithi103:3300->192.168.0.1:60288 (ESTABLISHED) 2020-04-22T14:17:16.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 18w REG 253,0 646 8388749 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2020-04-22T14:17:16.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 19r REG 253,0 21382523 8388751 /var/lib/ceph/mon/ceph-a/store.db/000020.sst 2020-04-22T14:17:16.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 20u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 21r FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 22w FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 23u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 24r FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 25w FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 26u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 27r FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 28w FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 29u IPv4 133126 0t0 TCP smithi103:3300 (LISTEN) 2020-04-22T14:17:16.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 30u IPv4 133127 0t0 TCP smithi103:smc-https (LISTEN) 2020-04-22T14:17:16.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 31u IPv4 131148 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48636 (ESTABLISHED) 2020-04-22T14:17:16.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 32r FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 33w FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 34r FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 35w FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 36u IPv4 137349 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48734 (ESTABLISHED) 2020-04-22T14:17:16.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 37u IPv4 131164 0t0 TCP smithi103:59464->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:16.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 38u IPv4 133342 0t0 TCP smithi103:51784->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 39u IPv4 129560 0t0 TCP smithi103:3300->smithi103:46588 (ESTABLISHED) 2020-04-22T14:17:16.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 40u IPv4 129566 0t0 TCP smithi103:3300->smithi103:46590 (ESTABLISHED) 2020-04-22T14:17:16.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 41u IPv4 136443 0t0 TCP smithi103:3300->smithi103:46606 (ESTABLISHED) 2020-04-22T14:17:16.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 42u IPv4 129577 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48898 (ESTABLISHED) 2020-04-22T14:17:16.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 43u IPv4 343020 0t0 TCP smithi103:3300->192.168.0.2:54826 (ESTABLISHED) 2020-04-22T14:17:16.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32209 log root 44w REG 253,0 10355769 8388744 /var/lib/ceph/mon/ceph-a/store.db/000018.log 2020-04-22T14:17:16.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root txt REG 8,1 10050864 66359 /usr/bin/ceph-mon 2020-04-22T14:17:16.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:16.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:16.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:16.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:16.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:16.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:16.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:16.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:16.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 1w FIFO 0,13 0t0 132154 pipe 2020-04-22T14:17:16.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 2w FIFO 0,13 0t0 132155 pipe 2020-04-22T14:17:16.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 3r FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 4w FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 5w REG 8,1 39563307 526779 /var/log/ceph/ceph-mon.a.log 2020-04-22T14:17:16.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 6uW REG 0,24 6 127909 /run/ceph/ceph-mon.a.pid 2020-04-22T14:17:16.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 7r FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 8w FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 9u unix 0x000000009e54f7ab 0t0 127911 /var/run/ceph/ceph-mon.a.asok type=STREAM 2020-04-22T14:17:16.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 10r FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 11w FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 12r FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 13w FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 14r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 15uW REG 253,0 0 8388742 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2020-04-22T14:17:16.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 16r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 17u IPv4 337592 0t0 TCP smithi103:3300->192.168.0.1:60288 (ESTABLISHED) 2020-04-22T14:17:16.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 18w REG 253,0 646 8388749 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2020-04-22T14:17:16.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 19r REG 253,0 21382523 8388751 /var/lib/ceph/mon/ceph-a/store.db/000020.sst 2020-04-22T14:17:16.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 20u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 21r FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 22w FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 23u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 24r FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 25w FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 26u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 27r FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 28w FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 29u IPv4 133126 0t0 TCP smithi103:3300 (LISTEN) 2020-04-22T14:17:16.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 30u IPv4 133127 0t0 TCP smithi103:smc-https (LISTEN) 2020-04-22T14:17:16.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 31u IPv4 131148 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48636 (ESTABLISHED) 2020-04-22T14:17:16.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 32r FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 33w FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 34r FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 35w FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 36u IPv4 137349 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48734 (ESTABLISHED) 2020-04-22T14:17:16.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 37u IPv4 131164 0t0 TCP smithi103:59464->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:16.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 38u IPv4 133342 0t0 TCP smithi103:51784->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 39u IPv4 129560 0t0 TCP smithi103:3300->smithi103:46588 (ESTABLISHED) 2020-04-22T14:17:16.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 40u IPv4 129566 0t0 TCP smithi103:3300->smithi103:46590 (ESTABLISHED) 2020-04-22T14:17:16.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 41u IPv4 136443 0t0 TCP smithi103:3300->smithi103:46606 (ESTABLISHED) 2020-04-22T14:17:16.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 42u IPv4 129577 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48898 (ESTABLISHED) 2020-04-22T14:17:16.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 43u IPv4 343020 0t0 TCP smithi103:3300->192.168.0.2:54826 (ESTABLISHED) 2020-04-22T14:17:16.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32210 service root 44w REG 253,0 10355769 8388744 /var/lib/ceph/mon/ceph-a/store.db/000018.log 2020-04-22T14:17:16.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root txt REG 8,1 10050864 66359 /usr/bin/ceph-mon 2020-04-22T14:17:16.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:16.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:16.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:16.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:16.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:16.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:16.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:16.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:16.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 1w FIFO 0,13 0t0 132154 pipe 2020-04-22T14:17:16.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 2w FIFO 0,13 0t0 132155 pipe 2020-04-22T14:17:16.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 3r FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 4w FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 5w REG 8,1 39563307 526779 /var/log/ceph/ceph-mon.a.log 2020-04-22T14:17:16.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 6uW REG 0,24 6 127909 /run/ceph/ceph-mon.a.pid 2020-04-22T14:17:16.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 7r FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 8w FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 9u unix 0x000000009e54f7ab 0t0 127911 /var/run/ceph/ceph-mon.a.asok type=STREAM 2020-04-22T14:17:16.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 10r FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 11w FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 12r FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 13w FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 14r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 15uW REG 253,0 0 8388742 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2020-04-22T14:17:16.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 16r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 17u IPv4 337592 0t0 TCP smithi103:3300->192.168.0.1:60288 (ESTABLISHED) 2020-04-22T14:17:16.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 18w REG 253,0 646 8388749 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2020-04-22T14:17:16.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 19r REG 253,0 21382523 8388751 /var/lib/ceph/mon/ceph-a/store.db/000020.sst 2020-04-22T14:17:16.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 20u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 21r FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 22w FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 23u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 24r FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 25w FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 26u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 27r FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 28w FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 29u IPv4 133126 0t0 TCP smithi103:3300 (LISTEN) 2020-04-22T14:17:16.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 30u IPv4 133127 0t0 TCP smithi103:smc-https (LISTEN) 2020-04-22T14:17:16.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 31u IPv4 131148 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48636 (ESTABLISHED) 2020-04-22T14:17:16.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 32r FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 33w FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 34r FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 35w FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 36u IPv4 137349 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48734 (ESTABLISHED) 2020-04-22T14:17:16.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 37u IPv4 131164 0t0 TCP smithi103:59464->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:16.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 38u IPv4 133342 0t0 TCP smithi103:51784->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 39u IPv4 129560 0t0 TCP smithi103:3300->smithi103:46588 (ESTABLISHED) 2020-04-22T14:17:16.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 40u IPv4 129566 0t0 TCP smithi103:3300->smithi103:46590 (ESTABLISHED) 2020-04-22T14:17:16.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 41u IPv4 136443 0t0 TCP smithi103:3300->smithi103:46606 (ESTABLISHED) 2020-04-22T14:17:16.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 42u IPv4 129577 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48898 (ESTABLISHED) 2020-04-22T14:17:16.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 43u IPv4 343020 0t0 TCP smithi103:3300->192.168.0.2:54826 (ESTABLISHED) 2020-04-22T14:17:16.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32211 admin_soc root 44w REG 253,0 10355769 8388744 /var/lib/ceph/mon/ceph-a/store.db/000018.log 2020-04-22T14:17:16.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root txt REG 8,1 10050864 66359 /usr/bin/ceph-mon 2020-04-22T14:17:16.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:16.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:16.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:16.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:16.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:16.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:16.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:16.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:16.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 1w FIFO 0,13 0t0 132154 pipe 2020-04-22T14:17:16.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 2w FIFO 0,13 0t0 132155 pipe 2020-04-22T14:17:16.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 3r FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 4w FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 5w REG 8,1 39563307 526779 /var/log/ceph/ceph-mon.a.log 2020-04-22T14:17:16.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 6uW REG 0,24 6 127909 /run/ceph/ceph-mon.a.pid 2020-04-22T14:17:16.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 7r FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 8w FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 9u unix 0x000000009e54f7ab 0t0 127911 /var/run/ceph/ceph-mon.a.asok type=STREAM 2020-04-22T14:17:16.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 10r FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 11w FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 12r FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 13w FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 14r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 15uW REG 253,0 0 8388742 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2020-04-22T14:17:16.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 16r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 17u IPv4 337592 0t0 TCP smithi103:3300->192.168.0.1:60288 (ESTABLISHED) 2020-04-22T14:17:16.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 18w REG 253,0 646 8388749 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2020-04-22T14:17:16.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 19r REG 253,0 21382523 8388751 /var/lib/ceph/mon/ceph-a/store.db/000020.sst 2020-04-22T14:17:16.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 20u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 21r FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 22w FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 23u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 24r FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 25w FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 26u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 27r FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 28w FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 29u IPv4 133126 0t0 TCP smithi103:3300 (LISTEN) 2020-04-22T14:17:16.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 30u IPv4 133127 0t0 TCP smithi103:smc-https (LISTEN) 2020-04-22T14:17:16.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 31u IPv4 131148 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48636 (ESTABLISHED) 2020-04-22T14:17:16.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 32r FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 33w FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 34r FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 35w FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 36u IPv4 137349 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48734 (ESTABLISHED) 2020-04-22T14:17:16.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 37u IPv4 131164 0t0 TCP smithi103:59464->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:16.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 38u IPv4 133342 0t0 TCP smithi103:51784->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 39u IPv4 129560 0t0 TCP smithi103:3300->smithi103:46588 (ESTABLISHED) 2020-04-22T14:17:16.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 40u IPv4 129566 0t0 TCP smithi103:3300->smithi103:46590 (ESTABLISHED) 2020-04-22T14:17:16.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 41u IPv4 136443 0t0 TCP smithi103:3300->smithi103:46606 (ESTABLISHED) 2020-04-22T14:17:16.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 42u IPv4 129577 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48898 (ESTABLISHED) 2020-04-22T14:17:16.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 43u IPv4 343020 0t0 TCP smithi103:3300->192.168.0.2:54826 (ESTABLISHED) 2020-04-22T14:17:16.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32212 signal_ha root 44w REG 253,0 10355769 8388744 /var/lib/ceph/mon/ceph-a/store.db/000018.log 2020-04-22T14:17:16.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root txt REG 8,1 10050864 66359 /usr/bin/ceph-mon 2020-04-22T14:17:16.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:16.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:16.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:16.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:16.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:16.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:16.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:16.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:16.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 1w FIFO 0,13 0t0 132154 pipe 2020-04-22T14:17:16.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 2w FIFO 0,13 0t0 132155 pipe 2020-04-22T14:17:16.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 3r FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 4w FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 5w REG 8,1 39563307 526779 /var/log/ceph/ceph-mon.a.log 2020-04-22T14:17:16.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 6uW REG 0,24 6 127909 /run/ceph/ceph-mon.a.pid 2020-04-22T14:17:16.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 7r FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 8w FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 9u unix 0x000000009e54f7ab 0t0 127911 /var/run/ceph/ceph-mon.a.asok type=STREAM 2020-04-22T14:17:16.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 10r FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 11w FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 12r FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 13w FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 14r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 15uW REG 253,0 0 8388742 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2020-04-22T14:17:16.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 16r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 17u IPv4 337592 0t0 TCP smithi103:3300->192.168.0.1:60288 (ESTABLISHED) 2020-04-22T14:17:16.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 18w REG 253,0 646 8388749 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2020-04-22T14:17:16.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 19r REG 253,0 21382523 8388751 /var/lib/ceph/mon/ceph-a/store.db/000020.sst 2020-04-22T14:17:16.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 20u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 21r FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 22w FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 23u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 24r FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 25w FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 26u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 27r FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 28w FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 29u IPv4 133126 0t0 TCP smithi103:3300 (LISTEN) 2020-04-22T14:17:16.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 30u IPv4 133127 0t0 TCP smithi103:smc-https (LISTEN) 2020-04-22T14:17:16.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 31u IPv4 131148 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48636 (ESTABLISHED) 2020-04-22T14:17:16.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 32r FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 33w FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 34r FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 35w FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 36u IPv4 137349 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48734 (ESTABLISHED) 2020-04-22T14:17:16.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 37u IPv4 131164 0t0 TCP smithi103:59464->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:16.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 38u IPv4 133342 0t0 TCP smithi103:51784->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 39u IPv4 129560 0t0 TCP smithi103:3300->smithi103:46588 (ESTABLISHED) 2020-04-22T14:17:16.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 40u IPv4 129566 0t0 TCP smithi103:3300->smithi103:46590 (ESTABLISHED) 2020-04-22T14:17:16.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 41u IPv4 136443 0t0 TCP smithi103:3300->smithi103:46606 (ESTABLISHED) 2020-04-22T14:17:16.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 42u IPv4 129577 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48898 (ESTABLISHED) 2020-04-22T14:17:16.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 43u IPv4 343020 0t0 TCP smithi103:3300->192.168.0.2:54826 (ESTABLISHED) 2020-04-22T14:17:16.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32213 rocksdb:l root 44w REG 253,0 10355769 8388744 /var/lib/ceph/mon/ceph-a/store.db/000018.log 2020-04-22T14:17:16.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root txt REG 8,1 10050864 66359 /usr/bin/ceph-mon 2020-04-22T14:17:16.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:16.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:16.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:16.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:16.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:16.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:16.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:16.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:16.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 1w FIFO 0,13 0t0 132154 pipe 2020-04-22T14:17:16.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 2w FIFO 0,13 0t0 132155 pipe 2020-04-22T14:17:16.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 3r FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 4w FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 5w REG 8,1 39563307 526779 /var/log/ceph/ceph-mon.a.log 2020-04-22T14:17:16.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 6uW REG 0,24 6 127909 /run/ceph/ceph-mon.a.pid 2020-04-22T14:17:16.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 7r FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 8w FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 9u unix 0x000000009e54f7ab 0t0 127911 /var/run/ceph/ceph-mon.a.asok type=STREAM 2020-04-22T14:17:16.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 10r FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 11w FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 12r FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 13w FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 14r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 15uW REG 253,0 0 8388742 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2020-04-22T14:17:16.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 16r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 17u IPv4 337592 0t0 TCP smithi103:3300->192.168.0.1:60288 (ESTABLISHED) 2020-04-22T14:17:16.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 18w REG 253,0 646 8388749 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2020-04-22T14:17:16.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 19r REG 253,0 21382523 8388751 /var/lib/ceph/mon/ceph-a/store.db/000020.sst 2020-04-22T14:17:16.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 20u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 21r FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 22w FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 23u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 24r FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 25w FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 26u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 27r FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 28w FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 29u IPv4 133126 0t0 TCP smithi103:3300 (LISTEN) 2020-04-22T14:17:16.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 30u IPv4 133127 0t0 TCP smithi103:smc-https (LISTEN) 2020-04-22T14:17:16.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 31u IPv4 131148 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48636 (ESTABLISHED) 2020-04-22T14:17:16.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 32r FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 33w FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 34r FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 35w FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 36u IPv4 137349 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48734 (ESTABLISHED) 2020-04-22T14:17:16.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 37u IPv4 131164 0t0 TCP smithi103:59464->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:16.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 38u IPv4 133342 0t0 TCP smithi103:51784->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 39u IPv4 129560 0t0 TCP smithi103:3300->smithi103:46588 (ESTABLISHED) 2020-04-22T14:17:16.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 40u IPv4 129566 0t0 TCP smithi103:3300->smithi103:46590 (ESTABLISHED) 2020-04-22T14:17:16.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 41u IPv4 136443 0t0 TCP smithi103:3300->smithi103:46606 (ESTABLISHED) 2020-04-22T14:17:16.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 42u IPv4 129577 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48898 (ESTABLISHED) 2020-04-22T14:17:16.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 43u IPv4 343020 0t0 TCP smithi103:3300->192.168.0.2:54826 (ESTABLISHED) 2020-04-22T14:17:16.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32214 rocksdb:h root 44w REG 253,0 10355769 8388744 /var/lib/ceph/mon/ceph-a/store.db/000018.log 2020-04-22T14:17:16.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root txt REG 8,1 10050864 66359 /usr/bin/ceph-mon 2020-04-22T14:17:16.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:16.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:16.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:16.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:16.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:16.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:16.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:16.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:16.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 1w FIFO 0,13 0t0 132154 pipe 2020-04-22T14:17:16.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 2w FIFO 0,13 0t0 132155 pipe 2020-04-22T14:17:16.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 3r FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 4w FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 5w REG 8,1 39563307 526779 /var/log/ceph/ceph-mon.a.log 2020-04-22T14:17:16.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 6uW REG 0,24 6 127909 /run/ceph/ceph-mon.a.pid 2020-04-22T14:17:16.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 7r FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 8w FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 9u unix 0x000000009e54f7ab 0t0 127911 /var/run/ceph/ceph-mon.a.asok type=STREAM 2020-04-22T14:17:16.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 10r FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 11w FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 12r FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 13w FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 14r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 15uW REG 253,0 0 8388742 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2020-04-22T14:17:16.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 16r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 17u IPv4 337592 0t0 TCP smithi103:3300->192.168.0.1:60288 (ESTABLISHED) 2020-04-22T14:17:16.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 18w REG 253,0 646 8388749 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2020-04-22T14:17:16.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 19r REG 253,0 21382523 8388751 /var/lib/ceph/mon/ceph-a/store.db/000020.sst 2020-04-22T14:17:16.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 20u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 21r FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 22w FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 23u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 24r FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 25w FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 26u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 27r FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 28w FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 29u IPv4 133126 0t0 TCP smithi103:3300 (LISTEN) 2020-04-22T14:17:16.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 30u IPv4 133127 0t0 TCP smithi103:smc-https (LISTEN) 2020-04-22T14:17:16.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 31u IPv4 131148 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48636 (ESTABLISHED) 2020-04-22T14:17:16.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 32r FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 33w FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 34r FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 35w FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 36u IPv4 137349 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48734 (ESTABLISHED) 2020-04-22T14:17:16.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 37u IPv4 131164 0t0 TCP smithi103:59464->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:16.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 38u IPv4 133342 0t0 TCP smithi103:51784->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 39u IPv4 129560 0t0 TCP smithi103:3300->smithi103:46588 (ESTABLISHED) 2020-04-22T14:17:16.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 40u IPv4 129566 0t0 TCP smithi103:3300->smithi103:46590 (ESTABLISHED) 2020-04-22T14:17:16.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 41u IPv4 136443 0t0 TCP smithi103:3300->smithi103:46606 (ESTABLISHED) 2020-04-22T14:17:16.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 42u IPv4 129577 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48898 (ESTABLISHED) 2020-04-22T14:17:16.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 43u IPv4 343020 0t0 TCP smithi103:3300->192.168.0.2:54826 (ESTABLISHED) 2020-04-22T14:17:16.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32215 ceph-mon root 44w REG 253,0 10355769 8388744 /var/lib/ceph/mon/ceph-a/store.db/000018.log 2020-04-22T14:17:16.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root txt REG 8,1 10050864 66359 /usr/bin/ceph-mon 2020-04-22T14:17:16.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:16.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:16.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:16.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:16.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:16.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:16.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:16.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:16.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 1w FIFO 0,13 0t0 132154 pipe 2020-04-22T14:17:16.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 2w FIFO 0,13 0t0 132155 pipe 2020-04-22T14:17:16.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 3r FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 4w FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 5w REG 8,1 39563307 526779 /var/log/ceph/ceph-mon.a.log 2020-04-22T14:17:16.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 6uW REG 0,24 6 127909 /run/ceph/ceph-mon.a.pid 2020-04-22T14:17:16.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 7r FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 8w FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 9u unix 0x000000009e54f7ab 0t0 127911 /var/run/ceph/ceph-mon.a.asok type=STREAM 2020-04-22T14:17:16.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 10r FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 11w FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 12r FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 13w FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 14r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 15uW REG 253,0 0 8388742 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2020-04-22T14:17:16.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 16r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 17u IPv4 337592 0t0 TCP smithi103:3300->192.168.0.1:60288 (ESTABLISHED) 2020-04-22T14:17:16.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 18w REG 253,0 646 8388749 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2020-04-22T14:17:16.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 19r REG 253,0 21382523 8388751 /var/lib/ceph/mon/ceph-a/store.db/000020.sst 2020-04-22T14:17:16.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 20u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 21r FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 22w FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 23u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 24r FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 25w FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 26u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 27r FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 28w FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 29u IPv4 133126 0t0 TCP smithi103:3300 (LISTEN) 2020-04-22T14:17:16.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 30u IPv4 133127 0t0 TCP smithi103:smc-https (LISTEN) 2020-04-22T14:17:16.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 31u IPv4 131148 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48636 (ESTABLISHED) 2020-04-22T14:17:16.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 32r FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 33w FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 34r FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 35w FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 36u IPv4 137349 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48734 (ESTABLISHED) 2020-04-22T14:17:16.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 37u IPv4 131164 0t0 TCP smithi103:59464->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:16.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 38u IPv4 133342 0t0 TCP smithi103:51784->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 39u IPv4 129560 0t0 TCP smithi103:3300->smithi103:46588 (ESTABLISHED) 2020-04-22T14:17:16.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 40u IPv4 129566 0t0 TCP smithi103:3300->smithi103:46590 (ESTABLISHED) 2020-04-22T14:17:16.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 41u IPv4 136443 0t0 TCP smithi103:3300->smithi103:46606 (ESTABLISHED) 2020-04-22T14:17:16.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 42u IPv4 129577 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48898 (ESTABLISHED) 2020-04-22T14:17:16.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 43u IPv4 343020 0t0 TCP smithi103:3300->192.168.0.2:54826 (ESTABLISHED) 2020-04-22T14:17:16.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32231 rocksdb:d root 44w REG 253,0 10355769 8388744 /var/lib/ceph/mon/ceph-a/store.db/000018.log 2020-04-22T14:17:16.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root txt REG 8,1 10050864 66359 /usr/bin/ceph-mon 2020-04-22T14:17:16.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:16.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:16.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:16.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:16.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:16.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:16.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:16.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:16.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 1w FIFO 0,13 0t0 132154 pipe 2020-04-22T14:17:16.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 2w FIFO 0,13 0t0 132155 pipe 2020-04-22T14:17:16.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 3r FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 4w FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 5w REG 8,1 39563307 526779 /var/log/ceph/ceph-mon.a.log 2020-04-22T14:17:16.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 6uW REG 0,24 6 127909 /run/ceph/ceph-mon.a.pid 2020-04-22T14:17:16.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 7r FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 8w FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 9u unix 0x000000009e54f7ab 0t0 127911 /var/run/ceph/ceph-mon.a.asok type=STREAM 2020-04-22T14:17:16.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 10r FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 11w FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 12r FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 13w FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 14r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 15uW REG 253,0 0 8388742 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2020-04-22T14:17:16.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 16r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 17u IPv4 337592 0t0 TCP smithi103:3300->192.168.0.1:60288 (ESTABLISHED) 2020-04-22T14:17:16.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 18w REG 253,0 646 8388749 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2020-04-22T14:17:16.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 19r REG 253,0 21382523 8388751 /var/lib/ceph/mon/ceph-a/store.db/000020.sst 2020-04-22T14:17:16.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 20u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 21r FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 22w FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 23u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 24r FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 25w FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 26u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 27r FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 28w FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 29u IPv4 133126 0t0 TCP smithi103:3300 (LISTEN) 2020-04-22T14:17:16.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 30u IPv4 133127 0t0 TCP smithi103:smc-https (LISTEN) 2020-04-22T14:17:16.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 31u IPv4 131148 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48636 (ESTABLISHED) 2020-04-22T14:17:16.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 32r FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 33w FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 34r FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 35w FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 36u IPv4 137349 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48734 (ESTABLISHED) 2020-04-22T14:17:16.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 37u IPv4 131164 0t0 TCP smithi103:59464->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:16.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 38u IPv4 133342 0t0 TCP smithi103:51784->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 39u IPv4 129560 0t0 TCP smithi103:3300->smithi103:46588 (ESTABLISHED) 2020-04-22T14:17:16.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 40u IPv4 129566 0t0 TCP smithi103:3300->smithi103:46590 (ESTABLISHED) 2020-04-22T14:17:16.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 41u IPv4 136443 0t0 TCP smithi103:3300->smithi103:46606 (ESTABLISHED) 2020-04-22T14:17:16.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 42u IPv4 129577 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48898 (ESTABLISHED) 2020-04-22T14:17:16.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 43u IPv4 343020 0t0 TCP smithi103:3300->192.168.0.2:54826 (ESTABLISHED) 2020-04-22T14:17:16.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32232 rocksdb:p root 44w REG 253,0 10355769 8388744 /var/lib/ceph/mon/ceph-a/store.db/000018.log 2020-04-22T14:17:16.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root txt REG 8,1 10050864 66359 /usr/bin/ceph-mon 2020-04-22T14:17:16.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:16.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:16.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:16.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:16.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:16.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:16.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:16.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:16.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 1w FIFO 0,13 0t0 132154 pipe 2020-04-22T14:17:16.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 2w FIFO 0,13 0t0 132155 pipe 2020-04-22T14:17:16.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 3r FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 4w FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 5w REG 8,1 39563307 526779 /var/log/ceph/ceph-mon.a.log 2020-04-22T14:17:16.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 6uW REG 0,24 6 127909 /run/ceph/ceph-mon.a.pid 2020-04-22T14:17:16.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 7r FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 8w FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 9u unix 0x000000009e54f7ab 0t0 127911 /var/run/ceph/ceph-mon.a.asok type=STREAM 2020-04-22T14:17:16.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 10r FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 11w FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 12r FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 13w FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 14r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 15uW REG 253,0 0 8388742 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2020-04-22T14:17:16.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 16r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 17u IPv4 337592 0t0 TCP smithi103:3300->192.168.0.1:60288 (ESTABLISHED) 2020-04-22T14:17:16.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 18w REG 253,0 646 8388749 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2020-04-22T14:17:16.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 19r REG 253,0 21382523 8388751 /var/lib/ceph/mon/ceph-a/store.db/000020.sst 2020-04-22T14:17:16.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 20u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 21r FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 22w FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 23u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 24r FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 25w FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 26u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 27r FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 28w FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 29u IPv4 133126 0t0 TCP smithi103:3300 (LISTEN) 2020-04-22T14:17:16.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 30u IPv4 133127 0t0 TCP smithi103:smc-https (LISTEN) 2020-04-22T14:17:16.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 31u IPv4 131148 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48636 (ESTABLISHED) 2020-04-22T14:17:16.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 32r FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 33w FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 34r FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 35w FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 36u IPv4 137349 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48734 (ESTABLISHED) 2020-04-22T14:17:16.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 37u IPv4 131164 0t0 TCP smithi103:59464->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:16.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 38u IPv4 133342 0t0 TCP smithi103:51784->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 39u IPv4 129560 0t0 TCP smithi103:3300->smithi103:46588 (ESTABLISHED) 2020-04-22T14:17:16.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 40u IPv4 129566 0t0 TCP smithi103:3300->smithi103:46590 (ESTABLISHED) 2020-04-22T14:17:16.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 41u IPv4 136443 0t0 TCP smithi103:3300->smithi103:46606 (ESTABLISHED) 2020-04-22T14:17:16.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 42u IPv4 129577 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48898 (ESTABLISHED) 2020-04-22T14:17:16.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 43u IPv4 343020 0t0 TCP smithi103:3300->192.168.0.2:54826 (ESTABLISHED) 2020-04-22T14:17:16.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32233 fn_monsto root 44w REG 253,0 10355769 8388744 /var/lib/ceph/mon/ceph-a/store.db/000018.log 2020-04-22T14:17:16.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root txt REG 8,1 10050864 66359 /usr/bin/ceph-mon 2020-04-22T14:17:16.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:16.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:16.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:16.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:16.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:16.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:16.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:16.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:16.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 1w FIFO 0,13 0t0 132154 pipe 2020-04-22T14:17:16.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 2w FIFO 0,13 0t0 132155 pipe 2020-04-22T14:17:16.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 3r FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 4w FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 5w REG 8,1 39563307 526779 /var/log/ceph/ceph-mon.a.log 2020-04-22T14:17:16.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 6uW REG 0,24 6 127909 /run/ceph/ceph-mon.a.pid 2020-04-22T14:17:16.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 7r FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 8w FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 9u unix 0x000000009e54f7ab 0t0 127911 /var/run/ceph/ceph-mon.a.asok type=STREAM 2020-04-22T14:17:16.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 10r FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 11w FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 12r FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 13w FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 14r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 15uW REG 253,0 0 8388742 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2020-04-22T14:17:16.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 16r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 17u IPv4 337592 0t0 TCP smithi103:3300->192.168.0.1:60288 (ESTABLISHED) 2020-04-22T14:17:16.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 18w REG 253,0 646 8388749 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2020-04-22T14:17:16.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 19r REG 253,0 21382523 8388751 /var/lib/ceph/mon/ceph-a/store.db/000020.sst 2020-04-22T14:17:16.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 20u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 21r FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 22w FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 23u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 24r FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 25w FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 26u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 27r FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 28w FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 29u IPv4 133126 0t0 TCP smithi103:3300 (LISTEN) 2020-04-22T14:17:16.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 30u IPv4 133127 0t0 TCP smithi103:smc-https (LISTEN) 2020-04-22T14:17:16.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 31u IPv4 131148 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48636 (ESTABLISHED) 2020-04-22T14:17:16.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 32r FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 33w FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 34r FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 35w FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 36u IPv4 137349 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48734 (ESTABLISHED) 2020-04-22T14:17:16.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 37u IPv4 131164 0t0 TCP smithi103:59464->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:16.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 38u IPv4 133342 0t0 TCP smithi103:51784->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 39u IPv4 129560 0t0 TCP smithi103:3300->smithi103:46588 (ESTABLISHED) 2020-04-22T14:17:16.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 40u IPv4 129566 0t0 TCP smithi103:3300->smithi103:46590 (ESTABLISHED) 2020-04-22T14:17:16.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 41u IPv4 136443 0t0 TCP smithi103:3300->smithi103:46606 (ESTABLISHED) 2020-04-22T14:17:16.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 42u IPv4 129577 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48898 (ESTABLISHED) 2020-04-22T14:17:16.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 43u IPv4 343020 0t0 TCP smithi103:3300->192.168.0.2:54826 (ESTABLISHED) 2020-04-22T14:17:16.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32234 msgr-work root 44w REG 253,0 10355769 8388744 /var/lib/ceph/mon/ceph-a/store.db/000018.log 2020-04-22T14:17:16.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root txt REG 8,1 10050864 66359 /usr/bin/ceph-mon 2020-04-22T14:17:16.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:16.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:16.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:16.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:16.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:16.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:16.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:16.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:16.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 1w FIFO 0,13 0t0 132154 pipe 2020-04-22T14:17:16.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 2w FIFO 0,13 0t0 132155 pipe 2020-04-22T14:17:16.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 3r FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 4w FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 5w REG 8,1 39563307 526779 /var/log/ceph/ceph-mon.a.log 2020-04-22T14:17:16.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 6uW REG 0,24 6 127909 /run/ceph/ceph-mon.a.pid 2020-04-22T14:17:16.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 7r FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 8w FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 9u unix 0x000000009e54f7ab 0t0 127911 /var/run/ceph/ceph-mon.a.asok type=STREAM 2020-04-22T14:17:16.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 10r FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 11w FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 12r FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 13w FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 14r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 15uW REG 253,0 0 8388742 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2020-04-22T14:17:16.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 16r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 17u IPv4 337592 0t0 TCP smithi103:3300->192.168.0.1:60288 (ESTABLISHED) 2020-04-22T14:17:16.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 18w REG 253,0 646 8388749 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2020-04-22T14:17:16.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 19r REG 253,0 21382523 8388751 /var/lib/ceph/mon/ceph-a/store.db/000020.sst 2020-04-22T14:17:16.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 20u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 21r FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 22w FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 23u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 24r FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 25w FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 26u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 27r FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 28w FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 29u IPv4 133126 0t0 TCP smithi103:3300 (LISTEN) 2020-04-22T14:17:16.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 30u IPv4 133127 0t0 TCP smithi103:smc-https (LISTEN) 2020-04-22T14:17:16.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 31u IPv4 131148 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48636 (ESTABLISHED) 2020-04-22T14:17:16.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 32r FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 33w FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 34r FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 35w FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 36u IPv4 137349 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48734 (ESTABLISHED) 2020-04-22T14:17:16.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 37u IPv4 131164 0t0 TCP smithi103:59464->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:16.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 38u IPv4 133342 0t0 TCP smithi103:51784->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 39u IPv4 129560 0t0 TCP smithi103:3300->smithi103:46588 (ESTABLISHED) 2020-04-22T14:17:16.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 40u IPv4 129566 0t0 TCP smithi103:3300->smithi103:46590 (ESTABLISHED) 2020-04-22T14:17:16.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 41u IPv4 136443 0t0 TCP smithi103:3300->smithi103:46606 (ESTABLISHED) 2020-04-22T14:17:16.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 42u IPv4 129577 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48898 (ESTABLISHED) 2020-04-22T14:17:16.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 43u IPv4 343020 0t0 TCP smithi103:3300->192.168.0.2:54826 (ESTABLISHED) 2020-04-22T14:17:16.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32235 msgr-work root 44w REG 253,0 10355769 8388744 /var/lib/ceph/mon/ceph-a/store.db/000018.log 2020-04-22T14:17:16.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root txt REG 8,1 10050864 66359 /usr/bin/ceph-mon 2020-04-22T14:17:16.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:16.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:16.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:16.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:16.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:16.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:16.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:16.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:16.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 1w FIFO 0,13 0t0 132154 pipe 2020-04-22T14:17:16.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 2w FIFO 0,13 0t0 132155 pipe 2020-04-22T14:17:16.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 3r FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 4w FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 5w REG 8,1 39563307 526779 /var/log/ceph/ceph-mon.a.log 2020-04-22T14:17:16.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 6uW REG 0,24 6 127909 /run/ceph/ceph-mon.a.pid 2020-04-22T14:17:16.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 7r FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 8w FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 9u unix 0x000000009e54f7ab 0t0 127911 /var/run/ceph/ceph-mon.a.asok type=STREAM 2020-04-22T14:17:16.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 10r FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 11w FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 12r FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 13w FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 14r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 15uW REG 253,0 0 8388742 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2020-04-22T14:17:16.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 16r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 17u IPv4 337592 0t0 TCP smithi103:3300->192.168.0.1:60288 (ESTABLISHED) 2020-04-22T14:17:16.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 18w REG 253,0 646 8388749 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2020-04-22T14:17:16.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 19r REG 253,0 21382523 8388751 /var/lib/ceph/mon/ceph-a/store.db/000020.sst 2020-04-22T14:17:16.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 20u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 21r FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 22w FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 23u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 24r FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 25w FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 26u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 27r FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 28w FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 29u IPv4 133126 0t0 TCP smithi103:3300 (LISTEN) 2020-04-22T14:17:16.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 30u IPv4 133127 0t0 TCP smithi103:smc-https (LISTEN) 2020-04-22T14:17:16.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 31u IPv4 131148 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48636 (ESTABLISHED) 2020-04-22T14:17:16.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 32r FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 33w FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 34r FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 35w FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 36u IPv4 137349 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48734 (ESTABLISHED) 2020-04-22T14:17:16.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 37u IPv4 131164 0t0 TCP smithi103:59464->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:16.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 38u IPv4 133342 0t0 TCP smithi103:51784->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 39u IPv4 129560 0t0 TCP smithi103:3300->smithi103:46588 (ESTABLISHED) 2020-04-22T14:17:16.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 40u IPv4 129566 0t0 TCP smithi103:3300->smithi103:46590 (ESTABLISHED) 2020-04-22T14:17:16.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 41u IPv4 136443 0t0 TCP smithi103:3300->smithi103:46606 (ESTABLISHED) 2020-04-22T14:17:16.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 42u IPv4 129577 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48898 (ESTABLISHED) 2020-04-22T14:17:16.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 43u IPv4 343020 0t0 TCP smithi103:3300->192.168.0.2:54826 (ESTABLISHED) 2020-04-22T14:17:16.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32236 msgr-work root 44w REG 253,0 10355769 8388744 /var/lib/ceph/mon/ceph-a/store.db/000018.log 2020-04-22T14:17:16.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root txt REG 8,1 10050864 66359 /usr/bin/ceph-mon 2020-04-22T14:17:16.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:16.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:16.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:16.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:16.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:16.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:16.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:16.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:16.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 1w FIFO 0,13 0t0 132154 pipe 2020-04-22T14:17:16.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 2w FIFO 0,13 0t0 132155 pipe 2020-04-22T14:17:16.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 3r FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 4w FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 5w REG 8,1 39563307 526779 /var/log/ceph/ceph-mon.a.log 2020-04-22T14:17:16.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 6uW REG 0,24 6 127909 /run/ceph/ceph-mon.a.pid 2020-04-22T14:17:16.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 7r FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 8w FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 9u unix 0x000000009e54f7ab 0t0 127911 /var/run/ceph/ceph-mon.a.asok type=STREAM 2020-04-22T14:17:16.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 10r FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 11w FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 12r FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 13w FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 14r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 15uW REG 253,0 0 8388742 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2020-04-22T14:17:16.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 16r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 17u IPv4 337592 0t0 TCP smithi103:3300->192.168.0.1:60288 (ESTABLISHED) 2020-04-22T14:17:16.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 18w REG 253,0 646 8388749 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2020-04-22T14:17:16.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 19r REG 253,0 21382523 8388751 /var/lib/ceph/mon/ceph-a/store.db/000020.sst 2020-04-22T14:17:16.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 20u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 21r FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 22w FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 23u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 24r FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 25w FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 26u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 27r FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 28w FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 29u IPv4 133126 0t0 TCP smithi103:3300 (LISTEN) 2020-04-22T14:17:16.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 30u IPv4 133127 0t0 TCP smithi103:smc-https (LISTEN) 2020-04-22T14:17:16.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 31u IPv4 131148 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48636 (ESTABLISHED) 2020-04-22T14:17:16.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 32r FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 33w FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 34r FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 35w FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 36u IPv4 137349 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48734 (ESTABLISHED) 2020-04-22T14:17:16.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 37u IPv4 131164 0t0 TCP smithi103:59464->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:16.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 38u IPv4 133342 0t0 TCP smithi103:51784->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 39u IPv4 129560 0t0 TCP smithi103:3300->smithi103:46588 (ESTABLISHED) 2020-04-22T14:17:16.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 40u IPv4 129566 0t0 TCP smithi103:3300->smithi103:46590 (ESTABLISHED) 2020-04-22T14:17:16.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 41u IPv4 136443 0t0 TCP smithi103:3300->smithi103:46606 (ESTABLISHED) 2020-04-22T14:17:16.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 42u IPv4 129577 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48898 (ESTABLISHED) 2020-04-22T14:17:16.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 43u IPv4 343020 0t0 TCP smithi103:3300->192.168.0.2:54826 (ESTABLISHED) 2020-04-22T14:17:16.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32237 OpHistory root 44w REG 253,0 10355769 8388744 /var/lib/ceph/mon/ceph-a/store.db/000018.log 2020-04-22T14:17:16.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root txt REG 8,1 10050864 66359 /usr/bin/ceph-mon 2020-04-22T14:17:16.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:16.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:16.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:16.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:16.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:16.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:16.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:16.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:16.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 1w FIFO 0,13 0t0 132154 pipe 2020-04-22T14:17:16.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 2w FIFO 0,13 0t0 132155 pipe 2020-04-22T14:17:16.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 3r FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 4w FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 5w REG 8,1 39563307 526779 /var/log/ceph/ceph-mon.a.log 2020-04-22T14:17:16.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 6uW REG 0,24 6 127909 /run/ceph/ceph-mon.a.pid 2020-04-22T14:17:16.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 7r FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 8w FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 9u unix 0x000000009e54f7ab 0t0 127911 /var/run/ceph/ceph-mon.a.asok type=STREAM 2020-04-22T14:17:16.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 10r FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 11w FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 12r FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 13w FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 14r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 15uW REG 253,0 0 8388742 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2020-04-22T14:17:16.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 16r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 17u IPv4 337592 0t0 TCP smithi103:3300->192.168.0.1:60288 (ESTABLISHED) 2020-04-22T14:17:16.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 18w REG 253,0 646 8388749 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2020-04-22T14:17:16.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 19r REG 253,0 21382523 8388751 /var/lib/ceph/mon/ceph-a/store.db/000020.sst 2020-04-22T14:17:16.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 20u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 21r FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 22w FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 23u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 24r FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 25w FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 26u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 27r FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 28w FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 29u IPv4 133126 0t0 TCP smithi103:3300 (LISTEN) 2020-04-22T14:17:16.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 30u IPv4 133127 0t0 TCP smithi103:smc-https (LISTEN) 2020-04-22T14:17:16.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 31u IPv4 131148 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48636 (ESTABLISHED) 2020-04-22T14:17:16.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 32r FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 33w FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 34r FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 35w FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 36u IPv4 137349 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48734 (ESTABLISHED) 2020-04-22T14:17:16.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 37u IPv4 131164 0t0 TCP smithi103:59464->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:16.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 38u IPv4 133342 0t0 TCP smithi103:51784->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 39u IPv4 129560 0t0 TCP smithi103:3300->smithi103:46588 (ESTABLISHED) 2020-04-22T14:17:16.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 40u IPv4 129566 0t0 TCP smithi103:3300->smithi103:46590 (ESTABLISHED) 2020-04-22T14:17:16.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 41u IPv4 136443 0t0 TCP smithi103:3300->smithi103:46606 (ESTABLISHED) 2020-04-22T14:17:16.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 42u IPv4 129577 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48898 (ESTABLISHED) 2020-04-22T14:17:16.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 43u IPv4 343020 0t0 TCP smithi103:3300->192.168.0.2:54826 (ESTABLISHED) 2020-04-22T14:17:16.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32238 fin root 44w REG 253,0 10355769 8388744 /var/lib/ceph/mon/ceph-a/store.db/000018.log 2020-04-22T14:17:16.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root txt REG 8,1 10050864 66359 /usr/bin/ceph-mon 2020-04-22T14:17:16.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:16.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:16.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:16.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:16.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:16.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:16.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:16.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:16.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 1w FIFO 0,13 0t0 132154 pipe 2020-04-22T14:17:16.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 2w FIFO 0,13 0t0 132155 pipe 2020-04-22T14:17:16.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 3r FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 4w FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 5w REG 8,1 39563307 526779 /var/log/ceph/ceph-mon.a.log 2020-04-22T14:17:16.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 6uW REG 0,24 6 127909 /run/ceph/ceph-mon.a.pid 2020-04-22T14:17:16.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 7r FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 8w FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 9u unix 0x000000009e54f7ab 0t0 127911 /var/run/ceph/ceph-mon.a.asok type=STREAM 2020-04-22T14:17:16.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 10r FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 11w FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 12r FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 13w FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 14r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 15uW REG 253,0 0 8388742 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2020-04-22T14:17:16.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 16r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 17u IPv4 337592 0t0 TCP smithi103:3300->192.168.0.1:60288 (ESTABLISHED) 2020-04-22T14:17:16.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 18w REG 253,0 646 8388749 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2020-04-22T14:17:16.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 19r REG 253,0 21382523 8388751 /var/lib/ceph/mon/ceph-a/store.db/000020.sst 2020-04-22T14:17:16.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 20u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 21r FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 22w FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 23u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 24r FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 25w FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 26u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 27r FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 28w FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 29u IPv4 133126 0t0 TCP smithi103:3300 (LISTEN) 2020-04-22T14:17:16.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 30u IPv4 133127 0t0 TCP smithi103:smc-https (LISTEN) 2020-04-22T14:17:16.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 31u IPv4 131148 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48636 (ESTABLISHED) 2020-04-22T14:17:16.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 32r FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 33w FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 34r FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 35w FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 36u IPv4 137349 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48734 (ESTABLISHED) 2020-04-22T14:17:16.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 37u IPv4 131164 0t0 TCP smithi103:59464->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:16.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 38u IPv4 133342 0t0 TCP smithi103:51784->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 39u IPv4 129560 0t0 TCP smithi103:3300->smithi103:46588 (ESTABLISHED) 2020-04-22T14:17:16.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 40u IPv4 129566 0t0 TCP smithi103:3300->smithi103:46590 (ESTABLISHED) 2020-04-22T14:17:16.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 41u IPv4 136443 0t0 TCP smithi103:3300->smithi103:46606 (ESTABLISHED) 2020-04-22T14:17:16.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 42u IPv4 129577 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48898 (ESTABLISHED) 2020-04-22T14:17:16.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 43u IPv4 343020 0t0 TCP smithi103:3300->192.168.0.2:54826 (ESTABLISHED) 2020-04-22T14:17:16.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32239 safe_time root 44w REG 253,0 10355769 8388744 /var/lib/ceph/mon/ceph-a/store.db/000018.log 2020-04-22T14:17:16.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root txt REG 8,1 10050864 66359 /usr/bin/ceph-mon 2020-04-22T14:17:16.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:16.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:16.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:16.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:16.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:16.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:16.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:16.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:16.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 1w FIFO 0,13 0t0 132154 pipe 2020-04-22T14:17:16.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 2w FIFO 0,13 0t0 132155 pipe 2020-04-22T14:17:16.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 3r FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 4w FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 5w REG 8,1 39563307 526779 /var/log/ceph/ceph-mon.a.log 2020-04-22T14:17:16.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 6uW REG 0,24 6 127909 /run/ceph/ceph-mon.a.pid 2020-04-22T14:17:16.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 7r FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 8w FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 9u unix 0x000000009e54f7ab 0t0 127911 /var/run/ceph/ceph-mon.a.asok type=STREAM 2020-04-22T14:17:16.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 10r FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 11w FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 12r FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 13w FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 14r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 15uW REG 253,0 0 8388742 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2020-04-22T14:17:16.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 16r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 17u IPv4 337592 0t0 TCP smithi103:3300->192.168.0.1:60288 (ESTABLISHED) 2020-04-22T14:17:16.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 18w REG 253,0 646 8388749 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2020-04-22T14:17:16.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 19r REG 253,0 21382523 8388751 /var/lib/ceph/mon/ceph-a/store.db/000020.sst 2020-04-22T14:17:16.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 20u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 21r FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 22w FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 23u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 24r FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 25w FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 26u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 27r FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 28w FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 29u IPv4 133126 0t0 TCP smithi103:3300 (LISTEN) 2020-04-22T14:17:16.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 30u IPv4 133127 0t0 TCP smithi103:smc-https (LISTEN) 2020-04-22T14:17:16.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 31u IPv4 131148 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48636 (ESTABLISHED) 2020-04-22T14:17:16.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 32r FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 33w FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 34r FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 35w FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 36u IPv4 137349 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48734 (ESTABLISHED) 2020-04-22T14:17:16.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 37u IPv4 131164 0t0 TCP smithi103:59464->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:16.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 38u IPv4 133342 0t0 TCP smithi103:51784->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 39u IPv4 129560 0t0 TCP smithi103:3300->smithi103:46588 (ESTABLISHED) 2020-04-22T14:17:16.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 40u IPv4 129566 0t0 TCP smithi103:3300->smithi103:46590 (ESTABLISHED) 2020-04-22T14:17:16.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 41u IPv4 136443 0t0 TCP smithi103:3300->smithi103:46606 (ESTABLISHED) 2020-04-22T14:17:16.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 42u IPv4 129577 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48898 (ESTABLISHED) 2020-04-22T14:17:16.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 43u IPv4 343020 0t0 TCP smithi103:3300->192.168.0.2:54826 (ESTABLISHED) 2020-04-22T14:17:16.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32240 cpu_tp root 44w REG 253,0 10355769 8388744 /var/lib/ceph/mon/ceph-a/store.db/000018.log 2020-04-22T14:17:16.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root txt REG 8,1 10050864 66359 /usr/bin/ceph-mon 2020-04-22T14:17:16.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:16.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:16.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:16.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:16.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:16.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:16.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:16.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:16.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 1w FIFO 0,13 0t0 132154 pipe 2020-04-22T14:17:16.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 2w FIFO 0,13 0t0 132155 pipe 2020-04-22T14:17:16.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 3r FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 4w FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 5w REG 8,1 39563307 526779 /var/log/ceph/ceph-mon.a.log 2020-04-22T14:17:16.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 6uW REG 0,24 6 127909 /run/ceph/ceph-mon.a.pid 2020-04-22T14:17:16.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 7r FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 8w FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 9u unix 0x000000009e54f7ab 0t0 127911 /var/run/ceph/ceph-mon.a.asok type=STREAM 2020-04-22T14:17:16.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 10r FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 11w FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 12r FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 13w FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 14r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 15uW REG 253,0 0 8388742 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2020-04-22T14:17:16.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 16r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 17u IPv4 337592 0t0 TCP smithi103:3300->192.168.0.1:60288 (ESTABLISHED) 2020-04-22T14:17:16.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 18w REG 253,0 646 8388749 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2020-04-22T14:17:16.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 19r REG 253,0 21382523 8388751 /var/lib/ceph/mon/ceph-a/store.db/000020.sst 2020-04-22T14:17:16.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 20u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 21r FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 22w FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 23u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 24r FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 25w FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 26u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 27r FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 28w FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 29u IPv4 133126 0t0 TCP smithi103:3300 (LISTEN) 2020-04-22T14:17:16.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 30u IPv4 133127 0t0 TCP smithi103:smc-https (LISTEN) 2020-04-22T14:17:16.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 31u IPv4 131148 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48636 (ESTABLISHED) 2020-04-22T14:17:16.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 32r FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 33w FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 34r FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 35w FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 36u IPv4 137349 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48734 (ESTABLISHED) 2020-04-22T14:17:16.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 37u IPv4 131164 0t0 TCP smithi103:59464->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:16.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 38u IPv4 133342 0t0 TCP smithi103:51784->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 39u IPv4 129560 0t0 TCP smithi103:3300->smithi103:46588 (ESTABLISHED) 2020-04-22T14:17:16.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 40u IPv4 129566 0t0 TCP smithi103:3300->smithi103:46590 (ESTABLISHED) 2020-04-22T14:17:16.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 41u IPv4 136443 0t0 TCP smithi103:3300->smithi103:46606 (ESTABLISHED) 2020-04-22T14:17:16.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 42u IPv4 129577 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48898 (ESTABLISHED) 2020-04-22T14:17:16.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 43u IPv4 343020 0t0 TCP smithi103:3300->192.168.0.2:54826 (ESTABLISHED) 2020-04-22T14:17:16.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32241 cpu_tp root 44w REG 253,0 10355769 8388744 /var/lib/ceph/mon/ceph-a/store.db/000018.log 2020-04-22T14:17:16.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root txt REG 8,1 10050864 66359 /usr/bin/ceph-mon 2020-04-22T14:17:16.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:16.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:16.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:16.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:16.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:16.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:16.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:16.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:16.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 1w FIFO 0,13 0t0 132154 pipe 2020-04-22T14:17:16.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 2w FIFO 0,13 0t0 132155 pipe 2020-04-22T14:17:16.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 3r FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 4w FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 5w REG 8,1 39563307 526779 /var/log/ceph/ceph-mon.a.log 2020-04-22T14:17:16.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 6uW REG 0,24 6 127909 /run/ceph/ceph-mon.a.pid 2020-04-22T14:17:16.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 7r FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 8w FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 9u unix 0x000000009e54f7ab 0t0 127911 /var/run/ceph/ceph-mon.a.asok type=STREAM 2020-04-22T14:17:16.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 10r FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 11w FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 12r FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 13w FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 14r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 15uW REG 253,0 0 8388742 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2020-04-22T14:17:16.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 16r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 17u IPv4 337592 0t0 TCP smithi103:3300->192.168.0.1:60288 (ESTABLISHED) 2020-04-22T14:17:16.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 18w REG 253,0 646 8388749 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2020-04-22T14:17:16.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 19r REG 253,0 21382523 8388751 /var/lib/ceph/mon/ceph-a/store.db/000020.sst 2020-04-22T14:17:16.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 20u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 21r FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 22w FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 23u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 24r FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 25w FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 26u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 27r FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 28w FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 29u IPv4 133126 0t0 TCP smithi103:3300 (LISTEN) 2020-04-22T14:17:16.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 30u IPv4 133127 0t0 TCP smithi103:smc-https (LISTEN) 2020-04-22T14:17:16.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 31u IPv4 131148 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48636 (ESTABLISHED) 2020-04-22T14:17:16.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 32r FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 33w FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 34r FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 35w FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 36u IPv4 137349 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48734 (ESTABLISHED) 2020-04-22T14:17:16.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 37u IPv4 131164 0t0 TCP smithi103:59464->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:16.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 38u IPv4 133342 0t0 TCP smithi103:51784->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 39u IPv4 129560 0t0 TCP smithi103:3300->smithi103:46588 (ESTABLISHED) 2020-04-22T14:17:16.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 40u IPv4 129566 0t0 TCP smithi103:3300->smithi103:46590 (ESTABLISHED) 2020-04-22T14:17:16.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 41u IPv4 136443 0t0 TCP smithi103:3300->smithi103:46606 (ESTABLISHED) 2020-04-22T14:17:16.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 42u IPv4 129577 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48898 (ESTABLISHED) 2020-04-22T14:17:16.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 43u IPv4 343020 0t0 TCP smithi103:3300->192.168.0.2:54826 (ESTABLISHED) 2020-04-22T14:17:16.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32242 cpu_tp root 44w REG 253,0 10355769 8388744 /var/lib/ceph/mon/ceph-a/store.db/000018.log 2020-04-22T14:17:16.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root txt REG 8,1 10050864 66359 /usr/bin/ceph-mon 2020-04-22T14:17:16.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:16.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:16.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:16.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:16.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:16.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:16.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:16.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:16.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 1w FIFO 0,13 0t0 132154 pipe 2020-04-22T14:17:16.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 2w FIFO 0,13 0t0 132155 pipe 2020-04-22T14:17:16.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 3r FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 4w FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 5w REG 8,1 39563307 526779 /var/log/ceph/ceph-mon.a.log 2020-04-22T14:17:16.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 6uW REG 0,24 6 127909 /run/ceph/ceph-mon.a.pid 2020-04-22T14:17:16.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 7r FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 8w FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 9u unix 0x000000009e54f7ab 0t0 127911 /var/run/ceph/ceph-mon.a.asok type=STREAM 2020-04-22T14:17:16.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 10r FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 11w FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 12r FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 13w FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 14r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 15uW REG 253,0 0 8388742 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2020-04-22T14:17:16.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 16r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 17u IPv4 337592 0t0 TCP smithi103:3300->192.168.0.1:60288 (ESTABLISHED) 2020-04-22T14:17:16.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 18w REG 253,0 646 8388749 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2020-04-22T14:17:16.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 19r REG 253,0 21382523 8388751 /var/lib/ceph/mon/ceph-a/store.db/000020.sst 2020-04-22T14:17:16.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 20u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 21r FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 22w FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 23u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 24r FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 25w FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 26u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 27r FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 28w FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 29u IPv4 133126 0t0 TCP smithi103:3300 (LISTEN) 2020-04-22T14:17:16.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 30u IPv4 133127 0t0 TCP smithi103:smc-https (LISTEN) 2020-04-22T14:17:16.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 31u IPv4 131148 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48636 (ESTABLISHED) 2020-04-22T14:17:16.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 32r FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 33w FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 34r FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 35w FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 36u IPv4 137349 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48734 (ESTABLISHED) 2020-04-22T14:17:16.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 37u IPv4 131164 0t0 TCP smithi103:59464->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:16.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 38u IPv4 133342 0t0 TCP smithi103:51784->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 39u IPv4 129560 0t0 TCP smithi103:3300->smithi103:46588 (ESTABLISHED) 2020-04-22T14:17:16.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 40u IPv4 129566 0t0 TCP smithi103:3300->smithi103:46590 (ESTABLISHED) 2020-04-22T14:17:16.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 41u IPv4 136443 0t0 TCP smithi103:3300->smithi103:46606 (ESTABLISHED) 2020-04-22T14:17:16.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 42u IPv4 129577 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48898 (ESTABLISHED) 2020-04-22T14:17:16.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 43u IPv4 343020 0t0 TCP smithi103:3300->192.168.0.2:54826 (ESTABLISHED) 2020-04-22T14:17:16.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32243 cpu_tp root 44w REG 253,0 10355769 8388744 /var/lib/ceph/mon/ceph-a/store.db/000018.log 2020-04-22T14:17:16.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root txt REG 8,1 10050864 66359 /usr/bin/ceph-mon 2020-04-22T14:17:16.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:16.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:16.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:16.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:16.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:16.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:16.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:16.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:16.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 1w FIFO 0,13 0t0 132154 pipe 2020-04-22T14:17:16.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 2w FIFO 0,13 0t0 132155 pipe 2020-04-22T14:17:16.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 3r FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 4w FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 5w REG 8,1 39563307 526779 /var/log/ceph/ceph-mon.a.log 2020-04-22T14:17:16.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 6uW REG 0,24 6 127909 /run/ceph/ceph-mon.a.pid 2020-04-22T14:17:16.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 7r FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 8w FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 9u unix 0x000000009e54f7ab 0t0 127911 /var/run/ceph/ceph-mon.a.asok type=STREAM 2020-04-22T14:17:16.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 10r FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 11w FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 12r FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 13w FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 14r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 15uW REG 253,0 0 8388742 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2020-04-22T14:17:16.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 16r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 17u IPv4 337592 0t0 TCP smithi103:3300->192.168.0.1:60288 (ESTABLISHED) 2020-04-22T14:17:16.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 18w REG 253,0 646 8388749 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2020-04-22T14:17:16.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 19r REG 253,0 21382523 8388751 /var/lib/ceph/mon/ceph-a/store.db/000020.sst 2020-04-22T14:17:16.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 20u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 21r FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 22w FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 23u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 24r FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 25w FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 26u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 27r FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 28w FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 29u IPv4 133126 0t0 TCP smithi103:3300 (LISTEN) 2020-04-22T14:17:16.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 30u IPv4 133127 0t0 TCP smithi103:smc-https (LISTEN) 2020-04-22T14:17:16.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 31u IPv4 131148 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48636 (ESTABLISHED) 2020-04-22T14:17:16.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 32r FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 33w FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 34r FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 35w FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 36u IPv4 137349 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48734 (ESTABLISHED) 2020-04-22T14:17:16.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 37u IPv4 131164 0t0 TCP smithi103:59464->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:16.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 38u IPv4 133342 0t0 TCP smithi103:51784->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 39u IPv4 129560 0t0 TCP smithi103:3300->smithi103:46588 (ESTABLISHED) 2020-04-22T14:17:16.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 40u IPv4 129566 0t0 TCP smithi103:3300->smithi103:46590 (ESTABLISHED) 2020-04-22T14:17:16.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 41u IPv4 136443 0t0 TCP smithi103:3300->smithi103:46606 (ESTABLISHED) 2020-04-22T14:17:16.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 42u IPv4 129577 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48898 (ESTABLISHED) 2020-04-22T14:17:16.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 43u IPv4 343020 0t0 TCP smithi103:3300->192.168.0.2:54826 (ESTABLISHED) 2020-04-22T14:17:16.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32244 ms_dispat root 44w REG 253,0 10355769 8388744 /var/lib/ceph/mon/ceph-a/store.db/000018.log 2020-04-22T14:17:16.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root txt REG 8,1 10050864 66359 /usr/bin/ceph-mon 2020-04-22T14:17:16.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:16.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:16.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:16.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:16.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:16.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:16.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:16.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:16.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 1w FIFO 0,13 0t0 132154 pipe 2020-04-22T14:17:16.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 2w FIFO 0,13 0t0 132155 pipe 2020-04-22T14:17:16.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 3r FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 4w FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 5w REG 8,1 39563307 526779 /var/log/ceph/ceph-mon.a.log 2020-04-22T14:17:16.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 6uW REG 0,24 6 127909 /run/ceph/ceph-mon.a.pid 2020-04-22T14:17:16.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 7r FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 8w FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 9u unix 0x000000009e54f7ab 0t0 127911 /var/run/ceph/ceph-mon.a.asok type=STREAM 2020-04-22T14:17:16.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 10r FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 11w FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 12r FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 13w FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 14r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 15uW REG 253,0 0 8388742 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2020-04-22T14:17:16.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 16r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 17u IPv4 337592 0t0 TCP smithi103:3300->192.168.0.1:60288 (ESTABLISHED) 2020-04-22T14:17:16.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 18w REG 253,0 646 8388749 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2020-04-22T14:17:16.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 19r REG 253,0 21382523 8388751 /var/lib/ceph/mon/ceph-a/store.db/000020.sst 2020-04-22T14:17:16.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 20u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 21r FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 22w FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 23u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 24r FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 25w FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 26u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 27r FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 28w FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 29u IPv4 133126 0t0 TCP smithi103:3300 (LISTEN) 2020-04-22T14:17:16.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 30u IPv4 133127 0t0 TCP smithi103:smc-https (LISTEN) 2020-04-22T14:17:16.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 31u IPv4 131148 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48636 (ESTABLISHED) 2020-04-22T14:17:16.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 32r FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 33w FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 34r FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 35w FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 36u IPv4 137349 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48734 (ESTABLISHED) 2020-04-22T14:17:16.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 37u IPv4 131164 0t0 TCP smithi103:59464->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:16.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 38u IPv4 133342 0t0 TCP smithi103:51784->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 39u IPv4 129560 0t0 TCP smithi103:3300->smithi103:46588 (ESTABLISHED) 2020-04-22T14:17:16.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 40u IPv4 129566 0t0 TCP smithi103:3300->smithi103:46590 (ESTABLISHED) 2020-04-22T14:17:16.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 41u IPv4 136443 0t0 TCP smithi103:3300->smithi103:46606 (ESTABLISHED) 2020-04-22T14:17:16.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 42u IPv4 129577 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48898 (ESTABLISHED) 2020-04-22T14:17:16.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 43u IPv4 343020 0t0 TCP smithi103:3300->192.168.0.2:54826 (ESTABLISHED) 2020-04-22T14:17:16.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32245 ms_local root 44w REG 253,0 10355769 8388744 /var/lib/ceph/mon/ceph-a/store.db/000018.log 2020-04-22T14:17:16.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root txt REG 8,1 10050864 66359 /usr/bin/ceph-mon 2020-04-22T14:17:16.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:16.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:16.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:16.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:16.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:16.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:16.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:16.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:16.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 1w FIFO 0,13 0t0 132154 pipe 2020-04-22T14:17:16.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 2w FIFO 0,13 0t0 132155 pipe 2020-04-22T14:17:16.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 3r FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 4w FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 5w REG 8,1 39563307 526779 /var/log/ceph/ceph-mon.a.log 2020-04-22T14:17:16.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 6uW REG 0,24 6 127909 /run/ceph/ceph-mon.a.pid 2020-04-22T14:17:16.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 7r FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 8w FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 9u unix 0x000000009e54f7ab 0t0 127911 /var/run/ceph/ceph-mon.a.asok type=STREAM 2020-04-22T14:17:16.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 10r FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 11w FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 12r FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 13w FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 14r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 15uW REG 253,0 0 8388742 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2020-04-22T14:17:16.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 16r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 17u IPv4 337592 0t0 TCP smithi103:3300->192.168.0.1:60288 (ESTABLISHED) 2020-04-22T14:17:16.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 18w REG 253,0 646 8388749 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2020-04-22T14:17:16.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 19r REG 253,0 21382523 8388751 /var/lib/ceph/mon/ceph-a/store.db/000020.sst 2020-04-22T14:17:16.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 20u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 21r FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 22w FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 23u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 24r FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 25w FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 26u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 27r FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 28w FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 29u IPv4 133126 0t0 TCP smithi103:3300 (LISTEN) 2020-04-22T14:17:16.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 30u IPv4 133127 0t0 TCP smithi103:smc-https (LISTEN) 2020-04-22T14:17:16.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 31u IPv4 131148 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48636 (ESTABLISHED) 2020-04-22T14:17:16.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 32r FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 33w FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 34r FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 35w FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 36u IPv4 137349 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48734 (ESTABLISHED) 2020-04-22T14:17:16.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 37u IPv4 131164 0t0 TCP smithi103:59464->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:16.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 38u IPv4 133342 0t0 TCP smithi103:51784->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 39u IPv4 129560 0t0 TCP smithi103:3300->smithi103:46588 (ESTABLISHED) 2020-04-22T14:17:16.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 40u IPv4 129566 0t0 TCP smithi103:3300->smithi103:46590 (ESTABLISHED) 2020-04-22T14:17:16.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 41u IPv4 136443 0t0 TCP smithi103:3300->smithi103:46606 (ESTABLISHED) 2020-04-22T14:17:16.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 42u IPv4 129577 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48898 (ESTABLISHED) 2020-04-22T14:17:16.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 43u IPv4 343020 0t0 TCP smithi103:3300->192.168.0.2:54826 (ESTABLISHED) 2020-04-22T14:17:16.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32246 safe_time root 44w REG 253,0 10355769 8388744 /var/lib/ceph/mon/ceph-a/store.db/000018.log 2020-04-22T14:17:16.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root txt REG 8,1 10050864 66359 /usr/bin/ceph-mon 2020-04-22T14:17:16.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:16.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:16.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:16.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:16.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:16.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:16.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:16.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:16.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 1w FIFO 0,13 0t0 132154 pipe 2020-04-22T14:17:16.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 2w FIFO 0,13 0t0 132155 pipe 2020-04-22T14:17:16.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 3r FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 4w FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 5w REG 8,1 39563307 526779 /var/log/ceph/ceph-mon.a.log 2020-04-22T14:17:16.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 6uW REG 0,24 6 127909 /run/ceph/ceph-mon.a.pid 2020-04-22T14:17:16.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 7r FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 8w FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 9u unix 0x000000009e54f7ab 0t0 127911 /var/run/ceph/ceph-mon.a.asok type=STREAM 2020-04-22T14:17:16.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 10r FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 11w FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 12r FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 13w FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 14r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 15uW REG 253,0 0 8388742 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2020-04-22T14:17:16.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 16r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 17u IPv4 337592 0t0 TCP smithi103:3300->192.168.0.1:60288 (ESTABLISHED) 2020-04-22T14:17:16.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 18w REG 253,0 646 8388749 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2020-04-22T14:17:16.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 19r REG 253,0 21382523 8388751 /var/lib/ceph/mon/ceph-a/store.db/000020.sst 2020-04-22T14:17:16.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 20u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 21r FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 22w FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 23u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 24r FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 25w FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 26u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 27r FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 28w FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 29u IPv4 133126 0t0 TCP smithi103:3300 (LISTEN) 2020-04-22T14:17:16.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 30u IPv4 133127 0t0 TCP smithi103:smc-https (LISTEN) 2020-04-22T14:17:16.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 31u IPv4 131148 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48636 (ESTABLISHED) 2020-04-22T14:17:16.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 32r FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 33w FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 34r FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 35w FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 36u IPv4 137349 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48734 (ESTABLISHED) 2020-04-22T14:17:16.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 37u IPv4 131164 0t0 TCP smithi103:59464->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:16.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 38u IPv4 133342 0t0 TCP smithi103:51784->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 39u IPv4 129560 0t0 TCP smithi103:3300->smithi103:46588 (ESTABLISHED) 2020-04-22T14:17:16.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 40u IPv4 129566 0t0 TCP smithi103:3300->smithi103:46590 (ESTABLISHED) 2020-04-22T14:17:16.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 41u IPv4 136443 0t0 TCP smithi103:3300->smithi103:46606 (ESTABLISHED) 2020-04-22T14:17:16.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 42u IPv4 129577 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48898 (ESTABLISHED) 2020-04-22T14:17:16.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 43u IPv4 343020 0t0 TCP smithi103:3300->192.168.0.2:54826 (ESTABLISHED) 2020-04-22T14:17:16.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32247 ms_dispat root 44w REG 253,0 10355769 8388744 /var/lib/ceph/mon/ceph-a/store.db/000018.log 2020-04-22T14:17:16.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root txt REG 8,1 10050864 66359 /usr/bin/ceph-mon 2020-04-22T14:17:16.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:16.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:16.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:16.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:16.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:16.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:16.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:16.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:16.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 1w FIFO 0,13 0t0 132154 pipe 2020-04-22T14:17:16.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 2w FIFO 0,13 0t0 132155 pipe 2020-04-22T14:17:16.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 3r FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 4w FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 5w REG 8,1 39563307 526779 /var/log/ceph/ceph-mon.a.log 2020-04-22T14:17:16.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 6uW REG 0,24 6 127909 /run/ceph/ceph-mon.a.pid 2020-04-22T14:17:16.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 7r FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 8w FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 9u unix 0x000000009e54f7ab 0t0 127911 /var/run/ceph/ceph-mon.a.asok type=STREAM 2020-04-22T14:17:16.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 10r FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 11w FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 12r FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 13w FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 14r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 15uW REG 253,0 0 8388742 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2020-04-22T14:17:16.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 16r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 17u IPv4 337592 0t0 TCP smithi103:3300->192.168.0.1:60288 (ESTABLISHED) 2020-04-22T14:17:16.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 18w REG 253,0 646 8388749 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2020-04-22T14:17:16.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 19r REG 253,0 21382523 8388751 /var/lib/ceph/mon/ceph-a/store.db/000020.sst 2020-04-22T14:17:16.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 20u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 21r FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 22w FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 23u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 24r FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 25w FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 26u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 27r FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 28w FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 29u IPv4 133126 0t0 TCP smithi103:3300 (LISTEN) 2020-04-22T14:17:16.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 30u IPv4 133127 0t0 TCP smithi103:smc-https (LISTEN) 2020-04-22T14:17:16.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 31u IPv4 131148 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48636 (ESTABLISHED) 2020-04-22T14:17:16.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 32r FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 33w FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 34r FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 35w FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 36u IPv4 137349 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48734 (ESTABLISHED) 2020-04-22T14:17:16.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 37u IPv4 131164 0t0 TCP smithi103:59464->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:16.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 38u IPv4 133342 0t0 TCP smithi103:51784->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 39u IPv4 129560 0t0 TCP smithi103:3300->smithi103:46588 (ESTABLISHED) 2020-04-22T14:17:16.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 40u IPv4 129566 0t0 TCP smithi103:3300->smithi103:46590 (ESTABLISHED) 2020-04-22T14:17:16.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 41u IPv4 136443 0t0 TCP smithi103:3300->smithi103:46606 (ESTABLISHED) 2020-04-22T14:17:16.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 42u IPv4 129577 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48898 (ESTABLISHED) 2020-04-22T14:17:16.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 43u IPv4 343020 0t0 TCP smithi103:3300->192.168.0.2:54826 (ESTABLISHED) 2020-04-22T14:17:16.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 32248 ms_local root 44w REG 253,0 10355769 8388744 /var/lib/ceph/mon/ceph-a/store.db/000018.log 2020-04-22T14:17:16.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root txt REG 8,1 10050864 66359 /usr/bin/ceph-mon 2020-04-22T14:17:16.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:16.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:16.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:16.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:16.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:16.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:16.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:16.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:16.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 1w FIFO 0,13 0t0 132154 pipe 2020-04-22T14:17:16.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 2w FIFO 0,13 0t0 132155 pipe 2020-04-22T14:17:16.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 3r FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 4w FIFO 0,13 0t0 127908 pipe 2020-04-22T14:17:16.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 5w REG 8,1 39563307 526779 /var/log/ceph/ceph-mon.a.log 2020-04-22T14:17:16.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 6uW REG 0,24 6 127909 /run/ceph/ceph-mon.a.pid 2020-04-22T14:17:16.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 7r FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 8w FIFO 0,13 0t0 127910 pipe 2020-04-22T14:17:16.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 9u unix 0x000000009e54f7ab 0t0 127911 /var/run/ceph/ceph-mon.a.asok type=STREAM 2020-04-22T14:17:16.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 10r FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 11w FIFO 0,13 0t0 127913 pipe 2020-04-22T14:17:16.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 12r FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 13w FIFO 0,13 0t0 127914 pipe 2020-04-22T14:17:16.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 14r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 15uW REG 253,0 0 8388742 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2020-04-22T14:17:16.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 16r DIR 253,0 152 8388741 /var/lib/ceph/mon/ceph-a/store.db 2020-04-22T14:17:16.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 17u IPv4 337592 0t0 TCP smithi103:3300->192.168.0.1:60288 (ESTABLISHED) 2020-04-22T14:17:16.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 18w REG 253,0 646 8388749 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2020-04-22T14:17:16.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 19r REG 253,0 21382523 8388751 /var/lib/ceph/mon/ceph-a/store.db/000020.sst 2020-04-22T14:17:16.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 20u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 21r FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 22w FIFO 0,13 0t0 132158 pipe 2020-04-22T14:17:16.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 23u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 24r FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 25w FIFO 0,13 0t0 132159 pipe 2020-04-22T14:17:16.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 26u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 27r FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 28w FIFO 0,13 0t0 132160 pipe 2020-04-22T14:17:16.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 29u IPv4 133126 0t0 TCP smithi103:3300 (LISTEN) 2020-04-22T14:17:16.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 30u IPv4 133127 0t0 TCP smithi103:smc-https (LISTEN) 2020-04-22T14:17:16.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 31u IPv4 131148 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48636 (ESTABLISHED) 2020-04-22T14:17:16.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 32r FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 33w FIFO 0,13 0t0 132161 pipe 2020-04-22T14:17:16.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 34r FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 35w FIFO 0,13 0t0 132162 pipe 2020-04-22T14:17:16.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 36u IPv4 137349 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48734 (ESTABLISHED) 2020-04-22T14:17:16.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 37u IPv4 131164 0t0 TCP smithi103:59464->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:16.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 38u IPv4 133342 0t0 TCP smithi103:51784->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 39u IPv4 129560 0t0 TCP smithi103:3300->smithi103:46588 (ESTABLISHED) 2020-04-22T14:17:16.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 40u IPv4 129566 0t0 TCP smithi103:3300->smithi103:46590 (ESTABLISHED) 2020-04-22T14:17:16.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 41u IPv4 136443 0t0 TCP smithi103:3300->smithi103:46606 (ESTABLISHED) 2020-04-22T14:17:16.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 42u IPv4 129577 0t0 TCP smithi103:3300->smithi086.front.sepia.ceph.com:48898 (ESTABLISHED) 2020-04-22T14:17:16.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 43u IPv4 343020 0t0 TCP smithi103:3300->192.168.0.2:54826 (ESTABLISHED) 2020-04-22T14:17:16.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mon 32208 62491 rstore_co root 44w REG 253,0 10355769 8388744 /var/lib/ceph/mon/ceph-a/store.db/000018.log 2020-04-22T14:17:16.514 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.514 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.514 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root txt REG 8,1 207056 9178 /usr/bin/sudo 2020-04-22T14:17:16.514 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 16704 5754 /usr/lib64/libpam_misc.so.0.82.1 2020-04-22T14:17:16.514 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 855144 29339 /usr/lib64/security/pam_systemd.so 2020-04-22T14:17:16.514 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 24208 29040 /usr/lib64/security/pam_limits.so 2020-04-22T14:17:16.515 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 11888 29038 /usr/lib64/security/pam_keyinit.so 2020-04-22T14:17:16.515 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 46232 5216 /usr/lib64/libcrack.so.2.9.0 2020-04-22T14:17:16.515 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 25728 5682 /usr/lib64/libpwquality.so.1.0.2 2020-04-22T14:17:16.515 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 11896 29000 /usr/lib64/security/pam_pwquality.so 2020-04-22T14:17:16.515 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 7808 29049 /usr/lib64/security/pam_permit.so 2020-04-22T14:17:16.515 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 7704 29028 /usr/lib64/security/pam_deny.so 2020-04-22T14:17:16.515 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 68936 29798 /usr/lib64/security/pam_sss.so 2020-04-22T14:17:16.515 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 371032 5313 /usr/lib64/libtirpc.so.3.0.0 2020-04-22T14:17:16.516 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 116408 5315 /usr/lib64/libnsl.so.2.0.0 2020-04-22T14:17:16.516 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 61448 29065 /usr/lib64/security/pam_unix.so 2020-04-22T14:17:16.516 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 11912 29042 /usr/lib64/security/pam_localuser.so 2020-04-22T14:17:16.516 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 16088 29060 /usr/lib64/security/pam_succeed_if.so 2020-04-22T14:17:16.516 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 11880 29032 /usr/lib64/security/pam_faildelay.so 2020-04-22T14:17:16.516 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 20304 29030 /usr/lib64/security/pam_env.so 2020-04-22T14:17:16.516 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:16.517 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.517 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.517 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.517 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.517 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:16.517 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.517 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 860880 5511 /usr/lib64/libnss_systemd.so.2 2020-04-22T14:17:16.518 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:16.518 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:16.518 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 16240 3641 /usr/lib64/libkeyutils.so.1.6 2020-04-22T14:17:16.518 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 118728 5304 /usr/lib64/libkrb5support.so.0.1 2020-04-22T14:17:16.518 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 25992 3339 /usr/lib64/libcom_err.so.2.1 2020-04-22T14:17:16.518 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 273488 5296 /usr/lib64/libk5crypto.so.3.1 2020-04-22T14:17:16.518 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 1507952 5302 /usr/lib64/libkrb5.so.3.3 2020-04-22T14:17:16.519 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 603768 5292 /usr/lib64/libgssapi_krb5.so.2.2 2020-04-22T14:17:16.519 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 142712 3373 /usr/lib64/libcrypt.so.1.1.0 2020-04-22T14:17:16.519 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.519 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:16.519 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 149160 4994 /usr/lib64/libsasl2.so.3.0.0 2020-04-22T14:17:16.519 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.519 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.519 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 97056 5009 /usr/lib64/liblber-2.4.so.2.10.9 2020-04-22T14:17:16.520 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 477472 5011 /usr/lib64/libldap-2.4.so.2.10.9 2020-04-22T14:17:16.520 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 74600 5752 /usr/lib64/libpam.so.0.84.2 2020-04-22T14:17:16.520 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 549944 16572 /usr/libexec/sudo/sudoers.so 2020-04-22T14:17:16.520 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:16.520 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:16.520 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:16.520 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.521 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 25192 3584 /usr/lib64/libcap-ng.so.0.0.0 2020-04-22T14:17:16.521 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.521 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.521 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.521 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 182296 16569 /usr/libexec/sudo/libsudo_util.so.0.0.0 2020-04-22T14:17:16.521 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:16.521 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.521 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 141392 3586 /usr/lib64/libaudit.so.1.0.0 2020-04-22T14:17:16.522 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.522 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:16.522 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:16.522 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:16.522 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:16.522 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:16.522 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:16.522 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:16.523 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:16.523 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:16.523 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:16.523 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:16.523 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:16.523 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root 0r FIFO 0,13 0t0 134171 pipe 2020-04-22T14:17:16.523 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root 1w FIFO 0,13 0t0 134172 pipe 2020-04-22T14:17:16.524 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root 2w FIFO 0,13 0t0 134173 pipe 2020-04-22T14:17:16.524 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root 3r REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:16.524 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root 4u unix 0x00000000c6590fb5 0t0 132207 type=STREAM 2020-04-22T14:17:16.524 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root 5u netlink 0t0 132215 AUDIT 2020-04-22T14:17:16.524 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root 6r REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:16.524 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root 7r REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:16.524 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root 9u unix 0x00000000b39fff4f 0t0 126940 type=DGRAM 2020-04-22T14:17:16.525 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root 10r FIFO 0,13 0t0 126943 pipe 2020-04-22T14:17:16.525 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 32264 root 11w FIFO 0,13 0t0 126943 pipe 2020-04-22T14:17:16.525 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32280 root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.525 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32280 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.525 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32280 root txt REG 8,1 15496 6602 /usr/libexec/platform-python3.6 2020-04-22T14:17:16.525 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32280 root mem REG 8,1 59368 41092 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.525 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32280 root mem REG 8,1 16632 41078 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.525 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32280 root mem REG 8,1 52720 41084 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.526 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32280 root mem REG 8,1 37448 41100 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.526 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32280 root mem REG 8,1 19536 41090 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.526 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32280 root mem REG 8,1 23056 41069 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.526 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32280 root mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:16.526 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32280 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.526 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32280 root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.526 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32280 root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:16.527 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32280 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.527 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32280 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.527 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32280 root mem REG 8,1 3371672 6608 /usr/lib64/libpython3.6m.so.1.0 2020-04-22T14:17:16.527 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32280 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.527 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32280 root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:16.527 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32280 root mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:16.527 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32280 root mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:16.528 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32280 root mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:16.528 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32280 root mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:16.528 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32280 root mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:16.528 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32280 root mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:16.528 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32280 root mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:16.528 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32280 root mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:16.528 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32280 root mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:16.529 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32280 root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:16.529 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32280 root mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:16.529 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32280 root 0r FIFO 0,13 0t0 134171 pipe 2020-04-22T14:17:16.529 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32280 root 1w FIFO 0,13 0t0 134172 pipe 2020-04-22T14:17:16.529 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 32280 root 2w FIFO 0,13 0t0 134173 pipe 2020-04-22T14:17:16.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root txt REG 8,1 5450216 66394 /usr/bin/ceph-mgr 2020-04-22T14:17:16.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 74568 264458 /usr/lib64/python3.6/site-packages/scipy/_lib/_ccallback_c.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 937648 263213 /usr/lib64/python3.6/site-packages/numpy/random/mtrand.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 44512 263056 /usr/lib64/python3.6/site-packages/numpy/fft/fftpack_lite.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 151544 263133 /usr/lib64/python3.6/site-packages/numpy/linalg/_umath_linalg.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 24016 263135 /usr/lib64/python3.6/site-packages/numpy/linalg/lapack_lite.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 1527544 262945 /usr/lib64/python3.6/site-packages/numpy/core/umath.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 991424 47964 /usr/lib64/python3.6/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2020-04-22T14:17:16.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 11952 47963 /usr/lib64/python3.6/site-packages/cryptography/hazmat/bindings/_constant_time.abi3.so 2020-04-22T14:17:16.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 12200 266614 /usr/lib64/python3.6/site-packages/markupsafe/_speedups.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 268408 63177 /usr/lib64/libquadmath.so.0.0.0 2020-04-22T14:17:16.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 2614504 63181 /usr/lib64/libgfortran.so.5.0.0 2020-04-22T14:17:16.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 32253216 63186 /usr/lib64/libopenblas-r0.3.3.so 2020-04-22T14:17:16.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 33058632 63183 /usr/lib64/libopenblasp-r0.3.3.so 2020-04-22T14:17:16.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 1901024 262884 /usr/lib64/python3.6/site-packages/numpy/core/multiarray.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 71912 41066 /usr/lib64/python3.6/lib-dynload/_elementtree.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 8337992 63031 /usr/lib64/librbd.so.1.12.0 2020-04-22T14:17:16.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 1214680 65566 /usr/lib64/python3.6/site-packages/rbd.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 181064 43088 /usr/lib64/python3.6/site-packages/_cffi_backend.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 43352 396955 /usr/lib64/python3.6/site-packages/bcrypt/_bcrypt.abi3.so 2020-04-22T14:17:16.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 311264 41065 /usr/lib64/python3.6/lib-dynload/_decimal.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 19536 41090 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 244736 3491 /usr/lib64/libexpat.so.1.6.7 2020-04-22T14:17:16.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 67064 41097 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 7528 41076 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 903752 41104 /usr/lib64/python3.6/lib-dynload/unicodedata.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 39752 41059 /usr/lib64/python3.6/lib-dynload/_csv.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 133904 4309 /usr/lib64/libyaml-0.so.2.0.5 2020-04-22T14:17:16.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 249472 43072 /usr/lib64/python3.6/site-packages/_yaml.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:16.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 146288 41060 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 16632 41078 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 66144 41086 /usr/lib64/python3.6/lib-dynload/array.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 127440 41077 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 17352 41091 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:16.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 42888 41073 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 74744 3394 /usr/lib64/libbz2.so.1.0.6 2020-04-22T14:17:16.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 23064 41051 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 38576 41106 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 1682152 63156 /usr/lib64/libcephfs.so.2.0.0 2020-04-22T14:17:16.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 396056 63223 /usr/lib64/python3.6/site-packages/cephfs.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 129016 41083 /usr/lib64/python3.6/lib-dynload/_ssl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 17400 41070 /usr/lib64/python3.6/lib-dynload/_hmacopenssl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 30904 41088 /usr/lib64/python3.6/lib-dynload/binascii.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 20592 41079 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 13720 41049 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 102304 41080 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 88440 41050 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:16.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 43896 41068 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 37448 41100 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 130256 41081 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 115392 41063 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 59368 41092 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 1923096 63025 /usr/lib64/librados.so.2.0.0 2020-04-22T14:17:16.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 1248904 63158 /usr/lib64/python3.6/site-packages/rados.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 52720 41084 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 80192 41071 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 23056 41069 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:16.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 3371672 6608 /usr/lib64/libpython3.6m.so.1.0 2020-04-22T14:17:16.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:16.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:16.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root 1w FIFO 0,13 0t0 134172 pipe 2020-04-22T14:17:16.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root 2w FIFO 0,13 0t0 134173 pipe 2020-04-22T14:17:16.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root 3r FIFO 0,13 0t0 127935 pipe 2020-04-22T14:17:16.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root 4w FIFO 0,13 0t0 127935 pipe 2020-04-22T14:17:16.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root 6r FIFO 0,13 0t0 127936 pipe 2020-04-22T14:17:16.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root 7w FIFO 0,13 0t0 127936 pipe 2020-04-22T14:17:16.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root 9r FIFO 0,13 0t0 127937 pipe 2020-04-22T14:17:16.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root 10w FIFO 0,13 0t0 127937 pipe 2020-04-22T14:17:16.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root 12r FIFO 0,13 0t0 127938 pipe 2020-04-22T14:17:16.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root 13w FIFO 0,13 0t0 127938 pipe 2020-04-22T14:17:16.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root 14w REG 8,1 996809 526782 /var/log/ceph/ceph-mgr.y.log 2020-04-22T14:17:16.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root 15uW REG 0,24 6 133183 /run/ceph/ceph-mgr.y.pid 2020-04-22T14:17:16.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root 16r FIFO 0,13 0t0 133184 pipe 2020-04-22T14:17:16.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root 17w FIFO 0,13 0t0 133184 pipe 2020-04-22T14:17:16.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root 18u unix 0x0000000090c454aa 0t0 133185 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2020-04-22T14:17:16.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root 19r FIFO 0,13 0t0 133187 pipe 2020-04-22T14:17:16.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root 20w FIFO 0,13 0t0 133187 pipe 2020-04-22T14:17:16.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root 21r FIFO 0,13 0t0 133188 pipe 2020-04-22T14:17:16.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root 22w FIFO 0,13 0t0 133188 pipe 2020-04-22T14:17:16.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root 23u IPv4 129263 0t0 TCP smithi103:43764->smithi086.front.sepia.ceph.com:3300 (ESTABLISHED) 2020-04-22T14:17:16.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 root 24u IPv4 349330 0t0 TCP smithi103:34020->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root txt REG 8,1 5450216 66394 /usr/bin/ceph-mgr 2020-04-22T14:17:16.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 74568 264458 /usr/lib64/python3.6/site-packages/scipy/_lib/_ccallback_c.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 937648 263213 /usr/lib64/python3.6/site-packages/numpy/random/mtrand.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 44512 263056 /usr/lib64/python3.6/site-packages/numpy/fft/fftpack_lite.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 151544 263133 /usr/lib64/python3.6/site-packages/numpy/linalg/_umath_linalg.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 24016 263135 /usr/lib64/python3.6/site-packages/numpy/linalg/lapack_lite.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 1527544 262945 /usr/lib64/python3.6/site-packages/numpy/core/umath.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 991424 47964 /usr/lib64/python3.6/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2020-04-22T14:17:16.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 11952 47963 /usr/lib64/python3.6/site-packages/cryptography/hazmat/bindings/_constant_time.abi3.so 2020-04-22T14:17:16.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 12200 266614 /usr/lib64/python3.6/site-packages/markupsafe/_speedups.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 268408 63177 /usr/lib64/libquadmath.so.0.0.0 2020-04-22T14:17:16.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 2614504 63181 /usr/lib64/libgfortran.so.5.0.0 2020-04-22T14:17:16.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 32253216 63186 /usr/lib64/libopenblas-r0.3.3.so 2020-04-22T14:17:16.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 33058632 63183 /usr/lib64/libopenblasp-r0.3.3.so 2020-04-22T14:17:16.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 1901024 262884 /usr/lib64/python3.6/site-packages/numpy/core/multiarray.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 71912 41066 /usr/lib64/python3.6/lib-dynload/_elementtree.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 8337992 63031 /usr/lib64/librbd.so.1.12.0 2020-04-22T14:17:16.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 1214680 65566 /usr/lib64/python3.6/site-packages/rbd.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 181064 43088 /usr/lib64/python3.6/site-packages/_cffi_backend.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 43352 396955 /usr/lib64/python3.6/site-packages/bcrypt/_bcrypt.abi3.so 2020-04-22T14:17:16.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 311264 41065 /usr/lib64/python3.6/lib-dynload/_decimal.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 19536 41090 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 244736 3491 /usr/lib64/libexpat.so.1.6.7 2020-04-22T14:17:16.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 67064 41097 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 7528 41076 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 903752 41104 /usr/lib64/python3.6/lib-dynload/unicodedata.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 39752 41059 /usr/lib64/python3.6/lib-dynload/_csv.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 133904 4309 /usr/lib64/libyaml-0.so.2.0.5 2020-04-22T14:17:16.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 249472 43072 /usr/lib64/python3.6/site-packages/_yaml.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:16.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 146288 41060 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 16632 41078 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 66144 41086 /usr/lib64/python3.6/lib-dynload/array.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 127440 41077 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 17352 41091 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:16.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 42888 41073 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 74744 3394 /usr/lib64/libbz2.so.1.0.6 2020-04-22T14:17:16.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 23064 41051 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 38576 41106 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 1682152 63156 /usr/lib64/libcephfs.so.2.0.0 2020-04-22T14:17:16.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 396056 63223 /usr/lib64/python3.6/site-packages/cephfs.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 129016 41083 /usr/lib64/python3.6/lib-dynload/_ssl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 17400 41070 /usr/lib64/python3.6/lib-dynload/_hmacopenssl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 30904 41088 /usr/lib64/python3.6/lib-dynload/binascii.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 20592 41079 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 13720 41049 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 102304 41080 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 88440 41050 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:16.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 43896 41068 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 37448 41100 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 130256 41081 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 115392 41063 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 59368 41092 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 1923096 63025 /usr/lib64/librados.so.2.0.0 2020-04-22T14:17:16.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 1248904 63158 /usr/lib64/python3.6/site-packages/rados.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 52720 41084 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 80192 41071 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 23056 41069 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:16.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 3371672 6608 /usr/lib64/libpython3.6m.so.1.0 2020-04-22T14:17:16.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:16.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:16.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root 1w FIFO 0,13 0t0 134172 pipe 2020-04-22T14:17:16.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root 2w FIFO 0,13 0t0 134173 pipe 2020-04-22T14:17:16.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root 3r FIFO 0,13 0t0 127935 pipe 2020-04-22T14:17:16.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root 4w FIFO 0,13 0t0 127935 pipe 2020-04-22T14:17:16.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root 6r FIFO 0,13 0t0 127936 pipe 2020-04-22T14:17:16.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root 7w FIFO 0,13 0t0 127936 pipe 2020-04-22T14:17:16.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root 9r FIFO 0,13 0t0 127937 pipe 2020-04-22T14:17:16.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root 10w FIFO 0,13 0t0 127937 pipe 2020-04-22T14:17:16.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root 12r FIFO 0,13 0t0 127938 pipe 2020-04-22T14:17:16.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root 13w FIFO 0,13 0t0 127938 pipe 2020-04-22T14:17:16.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root 14w REG 8,1 996809 526782 /var/log/ceph/ceph-mgr.y.log 2020-04-22T14:17:16.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root 15uW REG 0,24 6 133183 /run/ceph/ceph-mgr.y.pid 2020-04-22T14:17:16.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root 16r FIFO 0,13 0t0 133184 pipe 2020-04-22T14:17:16.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root 17w FIFO 0,13 0t0 133184 pipe 2020-04-22T14:17:16.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root 18u unix 0x0000000090c454aa 0t0 133185 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2020-04-22T14:17:16.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root 19r FIFO 0,13 0t0 133187 pipe 2020-04-22T14:17:16.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root 20w FIFO 0,13 0t0 133187 pipe 2020-04-22T14:17:16.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root 21r FIFO 0,13 0t0 133188 pipe 2020-04-22T14:17:16.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root 22w FIFO 0,13 0t0 133188 pipe 2020-04-22T14:17:16.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root 23u IPv4 129263 0t0 TCP smithi103:43764->smithi086.front.sepia.ceph.com:3300 (ESTABLISHED) 2020-04-22T14:17:16.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32298 log root 24u IPv4 349330 0t0 TCP smithi103:34020->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root txt REG 8,1 5450216 66394 /usr/bin/ceph-mgr 2020-04-22T14:17:16.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 74568 264458 /usr/lib64/python3.6/site-packages/scipy/_lib/_ccallback_c.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 937648 263213 /usr/lib64/python3.6/site-packages/numpy/random/mtrand.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 44512 263056 /usr/lib64/python3.6/site-packages/numpy/fft/fftpack_lite.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 151544 263133 /usr/lib64/python3.6/site-packages/numpy/linalg/_umath_linalg.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 24016 263135 /usr/lib64/python3.6/site-packages/numpy/linalg/lapack_lite.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 1527544 262945 /usr/lib64/python3.6/site-packages/numpy/core/umath.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 991424 47964 /usr/lib64/python3.6/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2020-04-22T14:17:16.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 11952 47963 /usr/lib64/python3.6/site-packages/cryptography/hazmat/bindings/_constant_time.abi3.so 2020-04-22T14:17:16.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 12200 266614 /usr/lib64/python3.6/site-packages/markupsafe/_speedups.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 268408 63177 /usr/lib64/libquadmath.so.0.0.0 2020-04-22T14:17:16.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 2614504 63181 /usr/lib64/libgfortran.so.5.0.0 2020-04-22T14:17:16.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 32253216 63186 /usr/lib64/libopenblas-r0.3.3.so 2020-04-22T14:17:16.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 33058632 63183 /usr/lib64/libopenblasp-r0.3.3.so 2020-04-22T14:17:16.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 1901024 262884 /usr/lib64/python3.6/site-packages/numpy/core/multiarray.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 71912 41066 /usr/lib64/python3.6/lib-dynload/_elementtree.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 8337992 63031 /usr/lib64/librbd.so.1.12.0 2020-04-22T14:17:16.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 1214680 65566 /usr/lib64/python3.6/site-packages/rbd.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 181064 43088 /usr/lib64/python3.6/site-packages/_cffi_backend.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 43352 396955 /usr/lib64/python3.6/site-packages/bcrypt/_bcrypt.abi3.so 2020-04-22T14:17:16.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 311264 41065 /usr/lib64/python3.6/lib-dynload/_decimal.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 19536 41090 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 244736 3491 /usr/lib64/libexpat.so.1.6.7 2020-04-22T14:17:16.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 67064 41097 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 7528 41076 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 903752 41104 /usr/lib64/python3.6/lib-dynload/unicodedata.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 39752 41059 /usr/lib64/python3.6/lib-dynload/_csv.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 133904 4309 /usr/lib64/libyaml-0.so.2.0.5 2020-04-22T14:17:16.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 249472 43072 /usr/lib64/python3.6/site-packages/_yaml.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:16.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 146288 41060 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 16632 41078 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 66144 41086 /usr/lib64/python3.6/lib-dynload/array.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 127440 41077 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 17352 41091 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:16.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 42888 41073 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 74744 3394 /usr/lib64/libbz2.so.1.0.6 2020-04-22T14:17:16.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 23064 41051 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 38576 41106 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 1682152 63156 /usr/lib64/libcephfs.so.2.0.0 2020-04-22T14:17:16.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 396056 63223 /usr/lib64/python3.6/site-packages/cephfs.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 129016 41083 /usr/lib64/python3.6/lib-dynload/_ssl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 17400 41070 /usr/lib64/python3.6/lib-dynload/_hmacopenssl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 30904 41088 /usr/lib64/python3.6/lib-dynload/binascii.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 20592 41079 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 13720 41049 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 102304 41080 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 88440 41050 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:16.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 43896 41068 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 37448 41100 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 130256 41081 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 115392 41063 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 59368 41092 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 1923096 63025 /usr/lib64/librados.so.2.0.0 2020-04-22T14:17:16.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 1248904 63158 /usr/lib64/python3.6/site-packages/rados.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 52720 41084 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 80192 41071 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 23056 41069 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:16.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 3371672 6608 /usr/lib64/libpython3.6m.so.1.0 2020-04-22T14:17:16.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:16.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:16.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root 1w FIFO 0,13 0t0 134172 pipe 2020-04-22T14:17:16.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root 2w FIFO 0,13 0t0 134173 pipe 2020-04-22T14:17:16.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root 3r FIFO 0,13 0t0 127935 pipe 2020-04-22T14:17:16.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root 4w FIFO 0,13 0t0 127935 pipe 2020-04-22T14:17:16.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root 6r FIFO 0,13 0t0 127936 pipe 2020-04-22T14:17:16.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root 7w FIFO 0,13 0t0 127936 pipe 2020-04-22T14:17:16.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root 9r FIFO 0,13 0t0 127937 pipe 2020-04-22T14:17:16.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root 10w FIFO 0,13 0t0 127937 pipe 2020-04-22T14:17:16.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root 12r FIFO 0,13 0t0 127938 pipe 2020-04-22T14:17:16.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root 13w FIFO 0,13 0t0 127938 pipe 2020-04-22T14:17:16.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root 14w REG 8,1 996809 526782 /var/log/ceph/ceph-mgr.y.log 2020-04-22T14:17:16.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root 15uW REG 0,24 6 133183 /run/ceph/ceph-mgr.y.pid 2020-04-22T14:17:16.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root 16r FIFO 0,13 0t0 133184 pipe 2020-04-22T14:17:16.577 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root 17w FIFO 0,13 0t0 133184 pipe 2020-04-22T14:17:16.577 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root 18u unix 0x0000000090c454aa 0t0 133185 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2020-04-22T14:17:16.577 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root 19r FIFO 0,13 0t0 133187 pipe 2020-04-22T14:17:16.577 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root 20w FIFO 0,13 0t0 133187 pipe 2020-04-22T14:17:16.577 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root 21r FIFO 0,13 0t0 133188 pipe 2020-04-22T14:17:16.577 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root 22w FIFO 0,13 0t0 133188 pipe 2020-04-22T14:17:16.577 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root 23u IPv4 129263 0t0 TCP smithi103:43764->smithi086.front.sepia.ceph.com:3300 (ESTABLISHED) 2020-04-22T14:17:16.578 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32299 msgr-work root 24u IPv4 349330 0t0 TCP smithi103:34020->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.578 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.578 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.578 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root txt REG 8,1 5450216 66394 /usr/bin/ceph-mgr 2020-04-22T14:17:16.578 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 74568 264458 /usr/lib64/python3.6/site-packages/scipy/_lib/_ccallback_c.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.578 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 937648 263213 /usr/lib64/python3.6/site-packages/numpy/random/mtrand.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.578 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 44512 263056 /usr/lib64/python3.6/site-packages/numpy/fft/fftpack_lite.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.579 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 151544 263133 /usr/lib64/python3.6/site-packages/numpy/linalg/_umath_linalg.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.579 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 24016 263135 /usr/lib64/python3.6/site-packages/numpy/linalg/lapack_lite.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.579 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 1527544 262945 /usr/lib64/python3.6/site-packages/numpy/core/umath.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.579 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 991424 47964 /usr/lib64/python3.6/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2020-04-22T14:17:16.579 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 11952 47963 /usr/lib64/python3.6/site-packages/cryptography/hazmat/bindings/_constant_time.abi3.so 2020-04-22T14:17:16.579 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 12200 266614 /usr/lib64/python3.6/site-packages/markupsafe/_speedups.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.579 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 268408 63177 /usr/lib64/libquadmath.so.0.0.0 2020-04-22T14:17:16.580 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 2614504 63181 /usr/lib64/libgfortran.so.5.0.0 2020-04-22T14:17:16.580 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 32253216 63186 /usr/lib64/libopenblas-r0.3.3.so 2020-04-22T14:17:16.580 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 33058632 63183 /usr/lib64/libopenblasp-r0.3.3.so 2020-04-22T14:17:16.580 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 1901024 262884 /usr/lib64/python3.6/site-packages/numpy/core/multiarray.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.580 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 71912 41066 /usr/lib64/python3.6/lib-dynload/_elementtree.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.580 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 8337992 63031 /usr/lib64/librbd.so.1.12.0 2020-04-22T14:17:16.580 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 1214680 65566 /usr/lib64/python3.6/site-packages/rbd.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.580 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 181064 43088 /usr/lib64/python3.6/site-packages/_cffi_backend.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.581 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 43352 396955 /usr/lib64/python3.6/site-packages/bcrypt/_bcrypt.abi3.so 2020-04-22T14:17:16.581 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 311264 41065 /usr/lib64/python3.6/lib-dynload/_decimal.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.581 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 19536 41090 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.581 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 244736 3491 /usr/lib64/libexpat.so.1.6.7 2020-04-22T14:17:16.581 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 67064 41097 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.581 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 7528 41076 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.581 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 903752 41104 /usr/lib64/python3.6/lib-dynload/unicodedata.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 39752 41059 /usr/lib64/python3.6/lib-dynload/_csv.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 133904 4309 /usr/lib64/libyaml-0.so.2.0.5 2020-04-22T14:17:16.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 249472 43072 /usr/lib64/python3.6/site-packages/_yaml.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:16.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 146288 41060 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 16632 41078 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 66144 41086 /usr/lib64/python3.6/lib-dynload/array.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 127440 41077 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 17352 41091 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:16.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 42888 41073 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 74744 3394 /usr/lib64/libbz2.so.1.0.6 2020-04-22T14:17:16.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 23064 41051 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 38576 41106 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 1682152 63156 /usr/lib64/libcephfs.so.2.0.0 2020-04-22T14:17:16.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 396056 63223 /usr/lib64/python3.6/site-packages/cephfs.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 129016 41083 /usr/lib64/python3.6/lib-dynload/_ssl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 17400 41070 /usr/lib64/python3.6/lib-dynload/_hmacopenssl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 30904 41088 /usr/lib64/python3.6/lib-dynload/binascii.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 20592 41079 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 13720 41049 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 102304 41080 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 88440 41050 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:16.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 43896 41068 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 37448 41100 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 130256 41081 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 115392 41063 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 59368 41092 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 1923096 63025 /usr/lib64/librados.so.2.0.0 2020-04-22T14:17:16.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 1248904 63158 /usr/lib64/python3.6/site-packages/rados.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 52720 41084 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 80192 41071 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 23056 41069 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:16.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 3371672 6608 /usr/lib64/libpython3.6m.so.1.0 2020-04-22T14:17:16.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:16.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:16.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root 1w FIFO 0,13 0t0 134172 pipe 2020-04-22T14:17:16.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root 2w FIFO 0,13 0t0 134173 pipe 2020-04-22T14:17:16.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root 3r FIFO 0,13 0t0 127935 pipe 2020-04-22T14:17:16.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root 4w FIFO 0,13 0t0 127935 pipe 2020-04-22T14:17:16.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root 6r FIFO 0,13 0t0 127936 pipe 2020-04-22T14:17:16.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root 7w FIFO 0,13 0t0 127936 pipe 2020-04-22T14:17:16.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root 9r FIFO 0,13 0t0 127937 pipe 2020-04-22T14:17:16.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root 10w FIFO 0,13 0t0 127937 pipe 2020-04-22T14:17:16.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root 12r FIFO 0,13 0t0 127938 pipe 2020-04-22T14:17:16.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root 13w FIFO 0,13 0t0 127938 pipe 2020-04-22T14:17:16.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root 14w REG 8,1 996809 526782 /var/log/ceph/ceph-mgr.y.log 2020-04-22T14:17:16.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root 15uW REG 0,24 6 133183 /run/ceph/ceph-mgr.y.pid 2020-04-22T14:17:16.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root 16r FIFO 0,13 0t0 133184 pipe 2020-04-22T14:17:16.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root 17w FIFO 0,13 0t0 133184 pipe 2020-04-22T14:17:16.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root 18u unix 0x0000000090c454aa 0t0 133185 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2020-04-22T14:17:16.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root 19r FIFO 0,13 0t0 133187 pipe 2020-04-22T14:17:16.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root 20w FIFO 0,13 0t0 133187 pipe 2020-04-22T14:17:16.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root 21r FIFO 0,13 0t0 133188 pipe 2020-04-22T14:17:16.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root 22w FIFO 0,13 0t0 133188 pipe 2020-04-22T14:17:16.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root 23u IPv4 129263 0t0 TCP smithi103:43764->smithi086.front.sepia.ceph.com:3300 (ESTABLISHED) 2020-04-22T14:17:16.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32300 msgr-work root 24u IPv4 349330 0t0 TCP smithi103:34020->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root txt REG 8,1 5450216 66394 /usr/bin/ceph-mgr 2020-04-22T14:17:16.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 74568 264458 /usr/lib64/python3.6/site-packages/scipy/_lib/_ccallback_c.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 937648 263213 /usr/lib64/python3.6/site-packages/numpy/random/mtrand.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 44512 263056 /usr/lib64/python3.6/site-packages/numpy/fft/fftpack_lite.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 151544 263133 /usr/lib64/python3.6/site-packages/numpy/linalg/_umath_linalg.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 24016 263135 /usr/lib64/python3.6/site-packages/numpy/linalg/lapack_lite.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 1527544 262945 /usr/lib64/python3.6/site-packages/numpy/core/umath.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 991424 47964 /usr/lib64/python3.6/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2020-04-22T14:17:16.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 11952 47963 /usr/lib64/python3.6/site-packages/cryptography/hazmat/bindings/_constant_time.abi3.so 2020-04-22T14:17:16.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 12200 266614 /usr/lib64/python3.6/site-packages/markupsafe/_speedups.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 268408 63177 /usr/lib64/libquadmath.so.0.0.0 2020-04-22T14:17:16.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 2614504 63181 /usr/lib64/libgfortran.so.5.0.0 2020-04-22T14:17:16.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 32253216 63186 /usr/lib64/libopenblas-r0.3.3.so 2020-04-22T14:17:16.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 33058632 63183 /usr/lib64/libopenblasp-r0.3.3.so 2020-04-22T14:17:16.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 1901024 262884 /usr/lib64/python3.6/site-packages/numpy/core/multiarray.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 71912 41066 /usr/lib64/python3.6/lib-dynload/_elementtree.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 8337992 63031 /usr/lib64/librbd.so.1.12.0 2020-04-22T14:17:16.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 1214680 65566 /usr/lib64/python3.6/site-packages/rbd.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 181064 43088 /usr/lib64/python3.6/site-packages/_cffi_backend.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 43352 396955 /usr/lib64/python3.6/site-packages/bcrypt/_bcrypt.abi3.so 2020-04-22T14:17:16.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 311264 41065 /usr/lib64/python3.6/lib-dynload/_decimal.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 19536 41090 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 244736 3491 /usr/lib64/libexpat.so.1.6.7 2020-04-22T14:17:16.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 67064 41097 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 7528 41076 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 903752 41104 /usr/lib64/python3.6/lib-dynload/unicodedata.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 39752 41059 /usr/lib64/python3.6/lib-dynload/_csv.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 133904 4309 /usr/lib64/libyaml-0.so.2.0.5 2020-04-22T14:17:16.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 249472 43072 /usr/lib64/python3.6/site-packages/_yaml.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:16.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 146288 41060 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 16632 41078 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 66144 41086 /usr/lib64/python3.6/lib-dynload/array.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 127440 41077 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 17352 41091 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:16.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 42888 41073 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 74744 3394 /usr/lib64/libbz2.so.1.0.6 2020-04-22T14:17:16.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 23064 41051 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 38576 41106 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 1682152 63156 /usr/lib64/libcephfs.so.2.0.0 2020-04-22T14:17:16.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 396056 63223 /usr/lib64/python3.6/site-packages/cephfs.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 129016 41083 /usr/lib64/python3.6/lib-dynload/_ssl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 17400 41070 /usr/lib64/python3.6/lib-dynload/_hmacopenssl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 30904 41088 /usr/lib64/python3.6/lib-dynload/binascii.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 20592 41079 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 13720 41049 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 102304 41080 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 88440 41050 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:16.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 43896 41068 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 37448 41100 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 130256 41081 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 115392 41063 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 59368 41092 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 1923096 63025 /usr/lib64/librados.so.2.0.0 2020-04-22T14:17:16.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 1248904 63158 /usr/lib64/python3.6/site-packages/rados.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 52720 41084 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 80192 41071 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 23056 41069 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:16.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 3371672 6608 /usr/lib64/libpython3.6m.so.1.0 2020-04-22T14:17:16.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:16.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:16.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root 1w FIFO 0,13 0t0 134172 pipe 2020-04-22T14:17:16.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root 2w FIFO 0,13 0t0 134173 pipe 2020-04-22T14:17:16.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root 3r FIFO 0,13 0t0 127935 pipe 2020-04-22T14:17:16.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root 4w FIFO 0,13 0t0 127935 pipe 2020-04-22T14:17:16.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root 6r FIFO 0,13 0t0 127936 pipe 2020-04-22T14:17:16.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root 7w FIFO 0,13 0t0 127936 pipe 2020-04-22T14:17:16.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root 9r FIFO 0,13 0t0 127937 pipe 2020-04-22T14:17:16.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root 10w FIFO 0,13 0t0 127937 pipe 2020-04-22T14:17:16.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root 12r FIFO 0,13 0t0 127938 pipe 2020-04-22T14:17:16.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root 13w FIFO 0,13 0t0 127938 pipe 2020-04-22T14:17:16.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root 14w REG 8,1 996809 526782 /var/log/ceph/ceph-mgr.y.log 2020-04-22T14:17:16.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root 15uW REG 0,24 6 133183 /run/ceph/ceph-mgr.y.pid 2020-04-22T14:17:16.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root 16r FIFO 0,13 0t0 133184 pipe 2020-04-22T14:17:16.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root 17w FIFO 0,13 0t0 133184 pipe 2020-04-22T14:17:16.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root 18u unix 0x0000000090c454aa 0t0 133185 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2020-04-22T14:17:16.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root 19r FIFO 0,13 0t0 133187 pipe 2020-04-22T14:17:16.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root 20w FIFO 0,13 0t0 133187 pipe 2020-04-22T14:17:16.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root 21r FIFO 0,13 0t0 133188 pipe 2020-04-22T14:17:16.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root 22w FIFO 0,13 0t0 133188 pipe 2020-04-22T14:17:16.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root 23u IPv4 129263 0t0 TCP smithi103:43764->smithi086.front.sepia.ceph.com:3300 (ESTABLISHED) 2020-04-22T14:17:16.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32301 msgr-work root 24u IPv4 349330 0t0 TCP smithi103:34020->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root txt REG 8,1 5450216 66394 /usr/bin/ceph-mgr 2020-04-22T14:17:16.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 74568 264458 /usr/lib64/python3.6/site-packages/scipy/_lib/_ccallback_c.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 937648 263213 /usr/lib64/python3.6/site-packages/numpy/random/mtrand.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 44512 263056 /usr/lib64/python3.6/site-packages/numpy/fft/fftpack_lite.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 151544 263133 /usr/lib64/python3.6/site-packages/numpy/linalg/_umath_linalg.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 24016 263135 /usr/lib64/python3.6/site-packages/numpy/linalg/lapack_lite.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 1527544 262945 /usr/lib64/python3.6/site-packages/numpy/core/umath.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 991424 47964 /usr/lib64/python3.6/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2020-04-22T14:17:16.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 11952 47963 /usr/lib64/python3.6/site-packages/cryptography/hazmat/bindings/_constant_time.abi3.so 2020-04-22T14:17:16.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 12200 266614 /usr/lib64/python3.6/site-packages/markupsafe/_speedups.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 268408 63177 /usr/lib64/libquadmath.so.0.0.0 2020-04-22T14:17:16.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 2614504 63181 /usr/lib64/libgfortran.so.5.0.0 2020-04-22T14:17:16.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 32253216 63186 /usr/lib64/libopenblas-r0.3.3.so 2020-04-22T14:17:16.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 33058632 63183 /usr/lib64/libopenblasp-r0.3.3.so 2020-04-22T14:17:16.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 1901024 262884 /usr/lib64/python3.6/site-packages/numpy/core/multiarray.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 71912 41066 /usr/lib64/python3.6/lib-dynload/_elementtree.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 8337992 63031 /usr/lib64/librbd.so.1.12.0 2020-04-22T14:17:16.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 1214680 65566 /usr/lib64/python3.6/site-packages/rbd.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 181064 43088 /usr/lib64/python3.6/site-packages/_cffi_backend.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 43352 396955 /usr/lib64/python3.6/site-packages/bcrypt/_bcrypt.abi3.so 2020-04-22T14:17:16.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 311264 41065 /usr/lib64/python3.6/lib-dynload/_decimal.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 19536 41090 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 244736 3491 /usr/lib64/libexpat.so.1.6.7 2020-04-22T14:17:16.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 67064 41097 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 7528 41076 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 903752 41104 /usr/lib64/python3.6/lib-dynload/unicodedata.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 39752 41059 /usr/lib64/python3.6/lib-dynload/_csv.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 133904 4309 /usr/lib64/libyaml-0.so.2.0.5 2020-04-22T14:17:16.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 249472 43072 /usr/lib64/python3.6/site-packages/_yaml.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:16.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 146288 41060 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 16632 41078 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 66144 41086 /usr/lib64/python3.6/lib-dynload/array.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 127440 41077 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 17352 41091 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:16.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 42888 41073 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 74744 3394 /usr/lib64/libbz2.so.1.0.6 2020-04-22T14:17:16.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 23064 41051 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 38576 41106 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 1682152 63156 /usr/lib64/libcephfs.so.2.0.0 2020-04-22T14:17:16.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 396056 63223 /usr/lib64/python3.6/site-packages/cephfs.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 129016 41083 /usr/lib64/python3.6/lib-dynload/_ssl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 17400 41070 /usr/lib64/python3.6/lib-dynload/_hmacopenssl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 30904 41088 /usr/lib64/python3.6/lib-dynload/binascii.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 20592 41079 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 13720 41049 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 102304 41080 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 88440 41050 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:16.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 43896 41068 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 37448 41100 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 130256 41081 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 115392 41063 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 59368 41092 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 1923096 63025 /usr/lib64/librados.so.2.0.0 2020-04-22T14:17:16.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 1248904 63158 /usr/lib64/python3.6/site-packages/rados.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 52720 41084 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 80192 41071 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 23056 41069 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:16.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 3371672 6608 /usr/lib64/libpython3.6m.so.1.0 2020-04-22T14:17:16.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:16.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:16.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root 1w FIFO 0,13 0t0 134172 pipe 2020-04-22T14:17:16.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root 2w FIFO 0,13 0t0 134173 pipe 2020-04-22T14:17:16.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root 3r FIFO 0,13 0t0 127935 pipe 2020-04-22T14:17:16.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root 4w FIFO 0,13 0t0 127935 pipe 2020-04-22T14:17:16.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root 6r FIFO 0,13 0t0 127936 pipe 2020-04-22T14:17:16.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root 7w FIFO 0,13 0t0 127936 pipe 2020-04-22T14:17:16.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root 9r FIFO 0,13 0t0 127937 pipe 2020-04-22T14:17:16.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root 10w FIFO 0,13 0t0 127937 pipe 2020-04-22T14:17:16.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root 12r FIFO 0,13 0t0 127938 pipe 2020-04-22T14:17:16.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root 13w FIFO 0,13 0t0 127938 pipe 2020-04-22T14:17:16.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root 14w REG 8,1 996809 526782 /var/log/ceph/ceph-mgr.y.log 2020-04-22T14:17:16.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root 15uW REG 0,24 6 133183 /run/ceph/ceph-mgr.y.pid 2020-04-22T14:17:16.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root 16r FIFO 0,13 0t0 133184 pipe 2020-04-22T14:17:16.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root 17w FIFO 0,13 0t0 133184 pipe 2020-04-22T14:17:16.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root 18u unix 0x0000000090c454aa 0t0 133185 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2020-04-22T14:17:16.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root 19r FIFO 0,13 0t0 133187 pipe 2020-04-22T14:17:16.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root 20w FIFO 0,13 0t0 133187 pipe 2020-04-22T14:17:16.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root 21r FIFO 0,13 0t0 133188 pipe 2020-04-22T14:17:16.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root 22w FIFO 0,13 0t0 133188 pipe 2020-04-22T14:17:16.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root 23u IPv4 129263 0t0 TCP smithi103:43764->smithi086.front.sepia.ceph.com:3300 (ESTABLISHED) 2020-04-22T14:17:16.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32336 service root 24u IPv4 349330 0t0 TCP smithi103:34020->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root txt REG 8,1 5450216 66394 /usr/bin/ceph-mgr 2020-04-22T14:17:16.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 74568 264458 /usr/lib64/python3.6/site-packages/scipy/_lib/_ccallback_c.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 937648 263213 /usr/lib64/python3.6/site-packages/numpy/random/mtrand.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 44512 263056 /usr/lib64/python3.6/site-packages/numpy/fft/fftpack_lite.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 151544 263133 /usr/lib64/python3.6/site-packages/numpy/linalg/_umath_linalg.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 24016 263135 /usr/lib64/python3.6/site-packages/numpy/linalg/lapack_lite.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 1527544 262945 /usr/lib64/python3.6/site-packages/numpy/core/umath.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 991424 47964 /usr/lib64/python3.6/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2020-04-22T14:17:16.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 11952 47963 /usr/lib64/python3.6/site-packages/cryptography/hazmat/bindings/_constant_time.abi3.so 2020-04-22T14:17:16.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 12200 266614 /usr/lib64/python3.6/site-packages/markupsafe/_speedups.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 268408 63177 /usr/lib64/libquadmath.so.0.0.0 2020-04-22T14:17:16.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 2614504 63181 /usr/lib64/libgfortran.so.5.0.0 2020-04-22T14:17:16.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 32253216 63186 /usr/lib64/libopenblas-r0.3.3.so 2020-04-22T14:17:16.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 33058632 63183 /usr/lib64/libopenblasp-r0.3.3.so 2020-04-22T14:17:16.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 1901024 262884 /usr/lib64/python3.6/site-packages/numpy/core/multiarray.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 71912 41066 /usr/lib64/python3.6/lib-dynload/_elementtree.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 8337992 63031 /usr/lib64/librbd.so.1.12.0 2020-04-22T14:17:16.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 1214680 65566 /usr/lib64/python3.6/site-packages/rbd.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 181064 43088 /usr/lib64/python3.6/site-packages/_cffi_backend.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 43352 396955 /usr/lib64/python3.6/site-packages/bcrypt/_bcrypt.abi3.so 2020-04-22T14:17:16.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 311264 41065 /usr/lib64/python3.6/lib-dynload/_decimal.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 19536 41090 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 244736 3491 /usr/lib64/libexpat.so.1.6.7 2020-04-22T14:17:16.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 67064 41097 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 7528 41076 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 903752 41104 /usr/lib64/python3.6/lib-dynload/unicodedata.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 39752 41059 /usr/lib64/python3.6/lib-dynload/_csv.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 133904 4309 /usr/lib64/libyaml-0.so.2.0.5 2020-04-22T14:17:16.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 249472 43072 /usr/lib64/python3.6/site-packages/_yaml.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:16.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 146288 41060 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 16632 41078 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 66144 41086 /usr/lib64/python3.6/lib-dynload/array.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 127440 41077 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 17352 41091 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:16.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 42888 41073 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 74744 3394 /usr/lib64/libbz2.so.1.0.6 2020-04-22T14:17:16.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 23064 41051 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 38576 41106 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 1682152 63156 /usr/lib64/libcephfs.so.2.0.0 2020-04-22T14:17:16.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 396056 63223 /usr/lib64/python3.6/site-packages/cephfs.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 129016 41083 /usr/lib64/python3.6/lib-dynload/_ssl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 17400 41070 /usr/lib64/python3.6/lib-dynload/_hmacopenssl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 30904 41088 /usr/lib64/python3.6/lib-dynload/binascii.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 20592 41079 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 13720 41049 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 102304 41080 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 88440 41050 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:16.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 43896 41068 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 37448 41100 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 130256 41081 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 115392 41063 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 59368 41092 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 1923096 63025 /usr/lib64/librados.so.2.0.0 2020-04-22T14:17:16.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 1248904 63158 /usr/lib64/python3.6/site-packages/rados.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 52720 41084 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 80192 41071 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 23056 41069 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:16.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 3371672 6608 /usr/lib64/libpython3.6m.so.1.0 2020-04-22T14:17:16.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:16.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:16.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root 1w FIFO 0,13 0t0 134172 pipe 2020-04-22T14:17:16.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root 2w FIFO 0,13 0t0 134173 pipe 2020-04-22T14:17:16.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root 3r FIFO 0,13 0t0 127935 pipe 2020-04-22T14:17:16.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root 4w FIFO 0,13 0t0 127935 pipe 2020-04-22T14:17:16.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root 6r FIFO 0,13 0t0 127936 pipe 2020-04-22T14:17:16.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root 7w FIFO 0,13 0t0 127936 pipe 2020-04-22T14:17:16.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root 9r FIFO 0,13 0t0 127937 pipe 2020-04-22T14:17:16.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root 10w FIFO 0,13 0t0 127937 pipe 2020-04-22T14:17:16.641 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.641 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root 12r FIFO 0,13 0t0 127938 pipe 2020-04-22T14:17:16.641 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root 13w FIFO 0,13 0t0 127938 pipe 2020-04-22T14:17:16.641 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root 14w REG 8,1 996809 526782 /var/log/ceph/ceph-mgr.y.log 2020-04-22T14:17:16.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root 15uW REG 0,24 6 133183 /run/ceph/ceph-mgr.y.pid 2020-04-22T14:17:16.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root 16r FIFO 0,13 0t0 133184 pipe 2020-04-22T14:17:16.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root 17w FIFO 0,13 0t0 133184 pipe 2020-04-22T14:17:16.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root 18u unix 0x0000000090c454aa 0t0 133185 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2020-04-22T14:17:16.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root 19r FIFO 0,13 0t0 133187 pipe 2020-04-22T14:17:16.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root 20w FIFO 0,13 0t0 133187 pipe 2020-04-22T14:17:16.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root 21r FIFO 0,13 0t0 133188 pipe 2020-04-22T14:17:16.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root 22w FIFO 0,13 0t0 133188 pipe 2020-04-22T14:17:16.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root 23u IPv4 129263 0t0 TCP smithi103:43764->smithi086.front.sepia.ceph.com:3300 (ESTABLISHED) 2020-04-22T14:17:16.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32337 admin_soc root 24u IPv4 349330 0t0 TCP smithi103:34020->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root txt REG 8,1 5450216 66394 /usr/bin/ceph-mgr 2020-04-22T14:17:16.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 74568 264458 /usr/lib64/python3.6/site-packages/scipy/_lib/_ccallback_c.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 937648 263213 /usr/lib64/python3.6/site-packages/numpy/random/mtrand.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 44512 263056 /usr/lib64/python3.6/site-packages/numpy/fft/fftpack_lite.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 151544 263133 /usr/lib64/python3.6/site-packages/numpy/linalg/_umath_linalg.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 24016 263135 /usr/lib64/python3.6/site-packages/numpy/linalg/lapack_lite.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 1527544 262945 /usr/lib64/python3.6/site-packages/numpy/core/umath.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 991424 47964 /usr/lib64/python3.6/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2020-04-22T14:17:16.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 11952 47963 /usr/lib64/python3.6/site-packages/cryptography/hazmat/bindings/_constant_time.abi3.so 2020-04-22T14:17:16.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 12200 266614 /usr/lib64/python3.6/site-packages/markupsafe/_speedups.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 268408 63177 /usr/lib64/libquadmath.so.0.0.0 2020-04-22T14:17:16.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 2614504 63181 /usr/lib64/libgfortran.so.5.0.0 2020-04-22T14:17:16.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 32253216 63186 /usr/lib64/libopenblas-r0.3.3.so 2020-04-22T14:17:16.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 33058632 63183 /usr/lib64/libopenblasp-r0.3.3.so 2020-04-22T14:17:16.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 1901024 262884 /usr/lib64/python3.6/site-packages/numpy/core/multiarray.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 71912 41066 /usr/lib64/python3.6/lib-dynload/_elementtree.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 8337992 63031 /usr/lib64/librbd.so.1.12.0 2020-04-22T14:17:16.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 1214680 65566 /usr/lib64/python3.6/site-packages/rbd.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 181064 43088 /usr/lib64/python3.6/site-packages/_cffi_backend.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 43352 396955 /usr/lib64/python3.6/site-packages/bcrypt/_bcrypt.abi3.so 2020-04-22T14:17:16.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 311264 41065 /usr/lib64/python3.6/lib-dynload/_decimal.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 19536 41090 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 244736 3491 /usr/lib64/libexpat.so.1.6.7 2020-04-22T14:17:16.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 67064 41097 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 7528 41076 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 903752 41104 /usr/lib64/python3.6/lib-dynload/unicodedata.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 39752 41059 /usr/lib64/python3.6/lib-dynload/_csv.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 133904 4309 /usr/lib64/libyaml-0.so.2.0.5 2020-04-22T14:17:16.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 249472 43072 /usr/lib64/python3.6/site-packages/_yaml.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:16.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 146288 41060 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 16632 41078 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 66144 41086 /usr/lib64/python3.6/lib-dynload/array.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 127440 41077 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 17352 41091 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:16.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 42888 41073 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 74744 3394 /usr/lib64/libbz2.so.1.0.6 2020-04-22T14:17:16.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 23064 41051 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 38576 41106 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 1682152 63156 /usr/lib64/libcephfs.so.2.0.0 2020-04-22T14:17:16.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 396056 63223 /usr/lib64/python3.6/site-packages/cephfs.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 129016 41083 /usr/lib64/python3.6/lib-dynload/_ssl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 17400 41070 /usr/lib64/python3.6/lib-dynload/_hmacopenssl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 30904 41088 /usr/lib64/python3.6/lib-dynload/binascii.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 20592 41079 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 13720 41049 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 102304 41080 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 88440 41050 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:16.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 43896 41068 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 37448 41100 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 130256 41081 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 115392 41063 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 59368 41092 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 1923096 63025 /usr/lib64/librados.so.2.0.0 2020-04-22T14:17:16.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 1248904 63158 /usr/lib64/python3.6/site-packages/rados.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 52720 41084 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 80192 41071 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 23056 41069 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:16.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 3371672 6608 /usr/lib64/libpython3.6m.so.1.0 2020-04-22T14:17:16.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:16.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:16.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root 1w FIFO 0,13 0t0 134172 pipe 2020-04-22T14:17:16.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root 2w FIFO 0,13 0t0 134173 pipe 2020-04-22T14:17:16.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root 3r FIFO 0,13 0t0 127935 pipe 2020-04-22T14:17:16.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root 4w FIFO 0,13 0t0 127935 pipe 2020-04-22T14:17:16.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root 6r FIFO 0,13 0t0 127936 pipe 2020-04-22T14:17:16.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root 7w FIFO 0,13 0t0 127936 pipe 2020-04-22T14:17:16.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root 9r FIFO 0,13 0t0 127937 pipe 2020-04-22T14:17:16.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root 10w FIFO 0,13 0t0 127937 pipe 2020-04-22T14:17:16.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root 12r FIFO 0,13 0t0 127938 pipe 2020-04-22T14:17:16.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root 13w FIFO 0,13 0t0 127938 pipe 2020-04-22T14:17:16.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root 14w REG 8,1 996809 526782 /var/log/ceph/ceph-mgr.y.log 2020-04-22T14:17:16.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root 15uW REG 0,24 6 133183 /run/ceph/ceph-mgr.y.pid 2020-04-22T14:17:16.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root 16r FIFO 0,13 0t0 133184 pipe 2020-04-22T14:17:16.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root 17w FIFO 0,13 0t0 133184 pipe 2020-04-22T14:17:16.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root 18u unix 0x0000000090c454aa 0t0 133185 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2020-04-22T14:17:16.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root 19r FIFO 0,13 0t0 133187 pipe 2020-04-22T14:17:16.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root 20w FIFO 0,13 0t0 133187 pipe 2020-04-22T14:17:16.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root 21r FIFO 0,13 0t0 133188 pipe 2020-04-22T14:17:16.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root 22w FIFO 0,13 0t0 133188 pipe 2020-04-22T14:17:16.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root 23u IPv4 129263 0t0 TCP smithi103:43764->smithi086.front.sepia.ceph.com:3300 (ESTABLISHED) 2020-04-22T14:17:16.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32338 ceph-mgr root 24u IPv4 349330 0t0 TCP smithi103:34020->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root txt REG 8,1 5450216 66394 /usr/bin/ceph-mgr 2020-04-22T14:17:16.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 74568 264458 /usr/lib64/python3.6/site-packages/scipy/_lib/_ccallback_c.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 937648 263213 /usr/lib64/python3.6/site-packages/numpy/random/mtrand.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 44512 263056 /usr/lib64/python3.6/site-packages/numpy/fft/fftpack_lite.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 151544 263133 /usr/lib64/python3.6/site-packages/numpy/linalg/_umath_linalg.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 24016 263135 /usr/lib64/python3.6/site-packages/numpy/linalg/lapack_lite.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 1527544 262945 /usr/lib64/python3.6/site-packages/numpy/core/umath.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 991424 47964 /usr/lib64/python3.6/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2020-04-22T14:17:16.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 11952 47963 /usr/lib64/python3.6/site-packages/cryptography/hazmat/bindings/_constant_time.abi3.so 2020-04-22T14:17:16.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 12200 266614 /usr/lib64/python3.6/site-packages/markupsafe/_speedups.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 268408 63177 /usr/lib64/libquadmath.so.0.0.0 2020-04-22T14:17:16.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 2614504 63181 /usr/lib64/libgfortran.so.5.0.0 2020-04-22T14:17:16.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 32253216 63186 /usr/lib64/libopenblas-r0.3.3.so 2020-04-22T14:17:16.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 33058632 63183 /usr/lib64/libopenblasp-r0.3.3.so 2020-04-22T14:17:16.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 1901024 262884 /usr/lib64/python3.6/site-packages/numpy/core/multiarray.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 71912 41066 /usr/lib64/python3.6/lib-dynload/_elementtree.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 8337992 63031 /usr/lib64/librbd.so.1.12.0 2020-04-22T14:17:16.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 1214680 65566 /usr/lib64/python3.6/site-packages/rbd.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 181064 43088 /usr/lib64/python3.6/site-packages/_cffi_backend.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 43352 396955 /usr/lib64/python3.6/site-packages/bcrypt/_bcrypt.abi3.so 2020-04-22T14:17:16.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 311264 41065 /usr/lib64/python3.6/lib-dynload/_decimal.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 19536 41090 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 244736 3491 /usr/lib64/libexpat.so.1.6.7 2020-04-22T14:17:16.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 67064 41097 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 7528 41076 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 903752 41104 /usr/lib64/python3.6/lib-dynload/unicodedata.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 39752 41059 /usr/lib64/python3.6/lib-dynload/_csv.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 133904 4309 /usr/lib64/libyaml-0.so.2.0.5 2020-04-22T14:17:16.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 249472 43072 /usr/lib64/python3.6/site-packages/_yaml.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:16.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 146288 41060 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 16632 41078 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 66144 41086 /usr/lib64/python3.6/lib-dynload/array.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 127440 41077 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 17352 41091 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:16.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 42888 41073 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 74744 3394 /usr/lib64/libbz2.so.1.0.6 2020-04-22T14:17:16.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 23064 41051 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 38576 41106 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 1682152 63156 /usr/lib64/libcephfs.so.2.0.0 2020-04-22T14:17:16.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 396056 63223 /usr/lib64/python3.6/site-packages/cephfs.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 129016 41083 /usr/lib64/python3.6/lib-dynload/_ssl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 17400 41070 /usr/lib64/python3.6/lib-dynload/_hmacopenssl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 30904 41088 /usr/lib64/python3.6/lib-dynload/binascii.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 20592 41079 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 13720 41049 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 102304 41080 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 88440 41050 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:16.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 43896 41068 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 37448 41100 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 130256 41081 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 115392 41063 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 59368 41092 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 1923096 63025 /usr/lib64/librados.so.2.0.0 2020-04-22T14:17:16.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 1248904 63158 /usr/lib64/python3.6/site-packages/rados.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 52720 41084 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 80192 41071 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 23056 41069 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:16.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 3371672 6608 /usr/lib64/libpython3.6m.so.1.0 2020-04-22T14:17:16.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:16.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:16.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root 1w FIFO 0,13 0t0 134172 pipe 2020-04-22T14:17:16.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root 2w FIFO 0,13 0t0 134173 pipe 2020-04-22T14:17:16.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root 3r FIFO 0,13 0t0 127935 pipe 2020-04-22T14:17:16.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root 4w FIFO 0,13 0t0 127935 pipe 2020-04-22T14:17:16.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root 6r FIFO 0,13 0t0 127936 pipe 2020-04-22T14:17:16.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root 7w FIFO 0,13 0t0 127936 pipe 2020-04-22T14:17:16.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root 9r FIFO 0,13 0t0 127937 pipe 2020-04-22T14:17:16.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root 10w FIFO 0,13 0t0 127937 pipe 2020-04-22T14:17:16.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root 12r FIFO 0,13 0t0 127938 pipe 2020-04-22T14:17:16.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root 13w FIFO 0,13 0t0 127938 pipe 2020-04-22T14:17:16.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root 14w REG 8,1 996809 526782 /var/log/ceph/ceph-mgr.y.log 2020-04-22T14:17:16.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root 15uW REG 0,24 6 133183 /run/ceph/ceph-mgr.y.pid 2020-04-22T14:17:16.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root 16r FIFO 0,13 0t0 133184 pipe 2020-04-22T14:17:16.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root 17w FIFO 0,13 0t0 133184 pipe 2020-04-22T14:17:16.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root 18u unix 0x0000000090c454aa 0t0 133185 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2020-04-22T14:17:16.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root 19r FIFO 0,13 0t0 133187 pipe 2020-04-22T14:17:16.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root 20w FIFO 0,13 0t0 133187 pipe 2020-04-22T14:17:16.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root 21r FIFO 0,13 0t0 133188 pipe 2020-04-22T14:17:16.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root 22w FIFO 0,13 0t0 133188 pipe 2020-04-22T14:17:16.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root 23u IPv4 129263 0t0 TCP smithi103:43764->smithi086.front.sepia.ceph.com:3300 (ESTABLISHED) 2020-04-22T14:17:16.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32339 fn_anonym root 24u IPv4 349330 0t0 TCP smithi103:34020->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root txt REG 8,1 5450216 66394 /usr/bin/ceph-mgr 2020-04-22T14:17:16.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 74568 264458 /usr/lib64/python3.6/site-packages/scipy/_lib/_ccallback_c.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 937648 263213 /usr/lib64/python3.6/site-packages/numpy/random/mtrand.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 44512 263056 /usr/lib64/python3.6/site-packages/numpy/fft/fftpack_lite.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 151544 263133 /usr/lib64/python3.6/site-packages/numpy/linalg/_umath_linalg.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 24016 263135 /usr/lib64/python3.6/site-packages/numpy/linalg/lapack_lite.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 1527544 262945 /usr/lib64/python3.6/site-packages/numpy/core/umath.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 991424 47964 /usr/lib64/python3.6/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2020-04-22T14:17:16.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 11952 47963 /usr/lib64/python3.6/site-packages/cryptography/hazmat/bindings/_constant_time.abi3.so 2020-04-22T14:17:16.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 12200 266614 /usr/lib64/python3.6/site-packages/markupsafe/_speedups.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 268408 63177 /usr/lib64/libquadmath.so.0.0.0 2020-04-22T14:17:16.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 2614504 63181 /usr/lib64/libgfortran.so.5.0.0 2020-04-22T14:17:16.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 32253216 63186 /usr/lib64/libopenblas-r0.3.3.so 2020-04-22T14:17:16.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 33058632 63183 /usr/lib64/libopenblasp-r0.3.3.so 2020-04-22T14:17:16.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 1901024 262884 /usr/lib64/python3.6/site-packages/numpy/core/multiarray.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 71912 41066 /usr/lib64/python3.6/lib-dynload/_elementtree.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 8337992 63031 /usr/lib64/librbd.so.1.12.0 2020-04-22T14:17:16.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 1214680 65566 /usr/lib64/python3.6/site-packages/rbd.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 181064 43088 /usr/lib64/python3.6/site-packages/_cffi_backend.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 43352 396955 /usr/lib64/python3.6/site-packages/bcrypt/_bcrypt.abi3.so 2020-04-22T14:17:16.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 311264 41065 /usr/lib64/python3.6/lib-dynload/_decimal.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 19536 41090 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 244736 3491 /usr/lib64/libexpat.so.1.6.7 2020-04-22T14:17:16.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 67064 41097 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 7528 41076 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 903752 41104 /usr/lib64/python3.6/lib-dynload/unicodedata.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 39752 41059 /usr/lib64/python3.6/lib-dynload/_csv.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 133904 4309 /usr/lib64/libyaml-0.so.2.0.5 2020-04-22T14:17:16.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 249472 43072 /usr/lib64/python3.6/site-packages/_yaml.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:16.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 146288 41060 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 16632 41078 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 66144 41086 /usr/lib64/python3.6/lib-dynload/array.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 127440 41077 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 17352 41091 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:16.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 42888 41073 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 74744 3394 /usr/lib64/libbz2.so.1.0.6 2020-04-22T14:17:16.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 23064 41051 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 38576 41106 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 1682152 63156 /usr/lib64/libcephfs.so.2.0.0 2020-04-22T14:17:16.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 396056 63223 /usr/lib64/python3.6/site-packages/cephfs.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 129016 41083 /usr/lib64/python3.6/lib-dynload/_ssl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 17400 41070 /usr/lib64/python3.6/lib-dynload/_hmacopenssl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 30904 41088 /usr/lib64/python3.6/lib-dynload/binascii.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 20592 41079 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 13720 41049 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 102304 41080 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 88440 41050 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:16.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 43896 41068 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 37448 41100 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 130256 41081 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 115392 41063 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 59368 41092 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 1923096 63025 /usr/lib64/librados.so.2.0.0 2020-04-22T14:17:16.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 1248904 63158 /usr/lib64/python3.6/site-packages/rados.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 52720 41084 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 80192 41071 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 23056 41069 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:16.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 3371672 6608 /usr/lib64/libpython3.6m.so.1.0 2020-04-22T14:17:16.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:16.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:16.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root 1w FIFO 0,13 0t0 134172 pipe 2020-04-22T14:17:16.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root 2w FIFO 0,13 0t0 134173 pipe 2020-04-22T14:17:16.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root 3r FIFO 0,13 0t0 127935 pipe 2020-04-22T14:17:16.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root 4w FIFO 0,13 0t0 127935 pipe 2020-04-22T14:17:16.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root 6r FIFO 0,13 0t0 127936 pipe 2020-04-22T14:17:16.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root 7w FIFO 0,13 0t0 127936 pipe 2020-04-22T14:17:16.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root 9r FIFO 0,13 0t0 127937 pipe 2020-04-22T14:17:16.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root 10w FIFO 0,13 0t0 127937 pipe 2020-04-22T14:17:16.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root 12r FIFO 0,13 0t0 127938 pipe 2020-04-22T14:17:16.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root 13w FIFO 0,13 0t0 127938 pipe 2020-04-22T14:17:16.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root 14w REG 8,1 996809 526782 /var/log/ceph/ceph-mgr.y.log 2020-04-22T14:17:16.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root 15uW REG 0,24 6 133183 /run/ceph/ceph-mgr.y.pid 2020-04-22T14:17:16.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root 16r FIFO 0,13 0t0 133184 pipe 2020-04-22T14:17:16.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root 17w FIFO 0,13 0t0 133184 pipe 2020-04-22T14:17:16.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root 18u unix 0x0000000090c454aa 0t0 133185 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2020-04-22T14:17:16.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root 19r FIFO 0,13 0t0 133187 pipe 2020-04-22T14:17:16.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root 20w FIFO 0,13 0t0 133187 pipe 2020-04-22T14:17:16.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root 21r FIFO 0,13 0t0 133188 pipe 2020-04-22T14:17:16.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root 22w FIFO 0,13 0t0 133188 pipe 2020-04-22T14:17:16.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root 23u IPv4 129263 0t0 TCP smithi103:43764->smithi086.front.sepia.ceph.com:3300 (ESTABLISHED) 2020-04-22T14:17:16.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32340 signal_ha root 24u IPv4 349330 0t0 TCP smithi103:34020->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root txt REG 8,1 5450216 66394 /usr/bin/ceph-mgr 2020-04-22T14:17:16.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 74568 264458 /usr/lib64/python3.6/site-packages/scipy/_lib/_ccallback_c.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 937648 263213 /usr/lib64/python3.6/site-packages/numpy/random/mtrand.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 44512 263056 /usr/lib64/python3.6/site-packages/numpy/fft/fftpack_lite.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 151544 263133 /usr/lib64/python3.6/site-packages/numpy/linalg/_umath_linalg.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 24016 263135 /usr/lib64/python3.6/site-packages/numpy/linalg/lapack_lite.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 1527544 262945 /usr/lib64/python3.6/site-packages/numpy/core/umath.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 991424 47964 /usr/lib64/python3.6/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2020-04-22T14:17:16.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 11952 47963 /usr/lib64/python3.6/site-packages/cryptography/hazmat/bindings/_constant_time.abi3.so 2020-04-22T14:17:16.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 12200 266614 /usr/lib64/python3.6/site-packages/markupsafe/_speedups.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 268408 63177 /usr/lib64/libquadmath.so.0.0.0 2020-04-22T14:17:16.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 2614504 63181 /usr/lib64/libgfortran.so.5.0.0 2020-04-22T14:17:16.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 32253216 63186 /usr/lib64/libopenblas-r0.3.3.so 2020-04-22T14:17:16.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 33058632 63183 /usr/lib64/libopenblasp-r0.3.3.so 2020-04-22T14:17:16.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 1901024 262884 /usr/lib64/python3.6/site-packages/numpy/core/multiarray.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 71912 41066 /usr/lib64/python3.6/lib-dynload/_elementtree.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 8337992 63031 /usr/lib64/librbd.so.1.12.0 2020-04-22T14:17:16.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 1214680 65566 /usr/lib64/python3.6/site-packages/rbd.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 181064 43088 /usr/lib64/python3.6/site-packages/_cffi_backend.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 43352 396955 /usr/lib64/python3.6/site-packages/bcrypt/_bcrypt.abi3.so 2020-04-22T14:17:16.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 311264 41065 /usr/lib64/python3.6/lib-dynload/_decimal.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 19536 41090 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 244736 3491 /usr/lib64/libexpat.so.1.6.7 2020-04-22T14:17:16.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 67064 41097 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 7528 41076 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 903752 41104 /usr/lib64/python3.6/lib-dynload/unicodedata.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 39752 41059 /usr/lib64/python3.6/lib-dynload/_csv.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 133904 4309 /usr/lib64/libyaml-0.so.2.0.5 2020-04-22T14:17:16.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 249472 43072 /usr/lib64/python3.6/site-packages/_yaml.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:16.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 146288 41060 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 16632 41078 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 66144 41086 /usr/lib64/python3.6/lib-dynload/array.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 127440 41077 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 17352 41091 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:16.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 42888 41073 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 74744 3394 /usr/lib64/libbz2.so.1.0.6 2020-04-22T14:17:16.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 23064 41051 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 38576 41106 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 1682152 63156 /usr/lib64/libcephfs.so.2.0.0 2020-04-22T14:17:16.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 396056 63223 /usr/lib64/python3.6/site-packages/cephfs.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 129016 41083 /usr/lib64/python3.6/lib-dynload/_ssl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 17400 41070 /usr/lib64/python3.6/lib-dynload/_hmacopenssl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 30904 41088 /usr/lib64/python3.6/lib-dynload/binascii.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 20592 41079 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 13720 41049 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 102304 41080 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 88440 41050 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:16.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 43896 41068 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 37448 41100 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 130256 41081 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 115392 41063 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 59368 41092 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 1923096 63025 /usr/lib64/librados.so.2.0.0 2020-04-22T14:17:16.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 1248904 63158 /usr/lib64/python3.6/site-packages/rados.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 52720 41084 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 80192 41071 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 23056 41069 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:16.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 3371672 6608 /usr/lib64/libpython3.6m.so.1.0 2020-04-22T14:17:16.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:16.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:16.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root 1w FIFO 0,13 0t0 134172 pipe 2020-04-22T14:17:16.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root 2w FIFO 0,13 0t0 134173 pipe 2020-04-22T14:17:16.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root 3r FIFO 0,13 0t0 127935 pipe 2020-04-22T14:17:16.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root 4w FIFO 0,13 0t0 127935 pipe 2020-04-22T14:17:16.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root 6r FIFO 0,13 0t0 127936 pipe 2020-04-22T14:17:16.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root 7w FIFO 0,13 0t0 127936 pipe 2020-04-22T14:17:16.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root 9r FIFO 0,13 0t0 127937 pipe 2020-04-22T14:17:16.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root 10w FIFO 0,13 0t0 127937 pipe 2020-04-22T14:17:16.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root 12r FIFO 0,13 0t0 127938 pipe 2020-04-22T14:17:16.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root 13w FIFO 0,13 0t0 127938 pipe 2020-04-22T14:17:16.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root 14w REG 8,1 996809 526782 /var/log/ceph/ceph-mgr.y.log 2020-04-22T14:17:16.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root 15uW REG 0,24 6 133183 /run/ceph/ceph-mgr.y.pid 2020-04-22T14:17:16.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root 16r FIFO 0,13 0t0 133184 pipe 2020-04-22T14:17:16.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root 17w FIFO 0,13 0t0 133184 pipe 2020-04-22T14:17:16.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root 18u unix 0x0000000090c454aa 0t0 133185 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2020-04-22T14:17:16.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root 19r FIFO 0,13 0t0 133187 pipe 2020-04-22T14:17:16.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root 20w FIFO 0,13 0t0 133187 pipe 2020-04-22T14:17:16.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root 21r FIFO 0,13 0t0 133188 pipe 2020-04-22T14:17:16.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root 22w FIFO 0,13 0t0 133188 pipe 2020-04-22T14:17:16.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root 23u IPv4 129263 0t0 TCP smithi103:43764->smithi086.front.sepia.ceph.com:3300 (ESTABLISHED) 2020-04-22T14:17:16.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32341 mgrsb-fin root 24u IPv4 349330 0t0 TCP smithi103:34020->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root txt REG 8,1 5450216 66394 /usr/bin/ceph-mgr 2020-04-22T14:17:16.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 74568 264458 /usr/lib64/python3.6/site-packages/scipy/_lib/_ccallback_c.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 937648 263213 /usr/lib64/python3.6/site-packages/numpy/random/mtrand.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 44512 263056 /usr/lib64/python3.6/site-packages/numpy/fft/fftpack_lite.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 151544 263133 /usr/lib64/python3.6/site-packages/numpy/linalg/_umath_linalg.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 24016 263135 /usr/lib64/python3.6/site-packages/numpy/linalg/lapack_lite.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 1527544 262945 /usr/lib64/python3.6/site-packages/numpy/core/umath.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 991424 47964 /usr/lib64/python3.6/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2020-04-22T14:17:16.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 11952 47963 /usr/lib64/python3.6/site-packages/cryptography/hazmat/bindings/_constant_time.abi3.so 2020-04-22T14:17:16.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 12200 266614 /usr/lib64/python3.6/site-packages/markupsafe/_speedups.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 268408 63177 /usr/lib64/libquadmath.so.0.0.0 2020-04-22T14:17:16.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 2614504 63181 /usr/lib64/libgfortran.so.5.0.0 2020-04-22T14:17:16.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 32253216 63186 /usr/lib64/libopenblas-r0.3.3.so 2020-04-22T14:17:16.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 33058632 63183 /usr/lib64/libopenblasp-r0.3.3.so 2020-04-22T14:17:16.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 1901024 262884 /usr/lib64/python3.6/site-packages/numpy/core/multiarray.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 71912 41066 /usr/lib64/python3.6/lib-dynload/_elementtree.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 8337992 63031 /usr/lib64/librbd.so.1.12.0 2020-04-22T14:17:16.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 1214680 65566 /usr/lib64/python3.6/site-packages/rbd.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 181064 43088 /usr/lib64/python3.6/site-packages/_cffi_backend.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 43352 396955 /usr/lib64/python3.6/site-packages/bcrypt/_bcrypt.abi3.so 2020-04-22T14:17:16.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 311264 41065 /usr/lib64/python3.6/lib-dynload/_decimal.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 19536 41090 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 244736 3491 /usr/lib64/libexpat.so.1.6.7 2020-04-22T14:17:16.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 67064 41097 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 7528 41076 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 903752 41104 /usr/lib64/python3.6/lib-dynload/unicodedata.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 39752 41059 /usr/lib64/python3.6/lib-dynload/_csv.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 133904 4309 /usr/lib64/libyaml-0.so.2.0.5 2020-04-22T14:17:16.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 249472 43072 /usr/lib64/python3.6/site-packages/_yaml.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:16.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 146288 41060 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 16632 41078 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 66144 41086 /usr/lib64/python3.6/lib-dynload/array.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 127440 41077 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 17352 41091 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:16.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 42888 41073 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 74744 3394 /usr/lib64/libbz2.so.1.0.6 2020-04-22T14:17:16.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 23064 41051 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 38576 41106 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 1682152 63156 /usr/lib64/libcephfs.so.2.0.0 2020-04-22T14:17:16.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 396056 63223 /usr/lib64/python3.6/site-packages/cephfs.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 129016 41083 /usr/lib64/python3.6/lib-dynload/_ssl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 17400 41070 /usr/lib64/python3.6/lib-dynload/_hmacopenssl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 30904 41088 /usr/lib64/python3.6/lib-dynload/binascii.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 20592 41079 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 13720 41049 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 102304 41080 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 88440 41050 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:16.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 43896 41068 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 37448 41100 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 130256 41081 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 115392 41063 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 59368 41092 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 1923096 63025 /usr/lib64/librados.so.2.0.0 2020-04-22T14:17:16.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 1248904 63158 /usr/lib64/python3.6/site-packages/rados.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 52720 41084 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 80192 41071 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 23056 41069 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:16.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 3371672 6608 /usr/lib64/libpython3.6m.so.1.0 2020-04-22T14:17:16.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:16.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:16.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root 1w FIFO 0,13 0t0 134172 pipe 2020-04-22T14:17:16.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root 2w FIFO 0,13 0t0 134173 pipe 2020-04-22T14:17:16.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root 3r FIFO 0,13 0t0 127935 pipe 2020-04-22T14:17:16.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root 4w FIFO 0,13 0t0 127935 pipe 2020-04-22T14:17:16.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root 6r FIFO 0,13 0t0 127936 pipe 2020-04-22T14:17:16.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root 7w FIFO 0,13 0t0 127936 pipe 2020-04-22T14:17:16.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root 9r FIFO 0,13 0t0 127937 pipe 2020-04-22T14:17:16.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root 10w FIFO 0,13 0t0 127937 pipe 2020-04-22T14:17:16.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root 12r FIFO 0,13 0t0 127938 pipe 2020-04-22T14:17:16.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root 13w FIFO 0,13 0t0 127938 pipe 2020-04-22T14:17:16.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root 14w REG 8,1 996809 526782 /var/log/ceph/ceph-mgr.y.log 2020-04-22T14:17:16.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root 15uW REG 0,24 6 133183 /run/ceph/ceph-mgr.y.pid 2020-04-22T14:17:16.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root 16r FIFO 0,13 0t0 133184 pipe 2020-04-22T14:17:16.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root 17w FIFO 0,13 0t0 133184 pipe 2020-04-22T14:17:16.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root 18u unix 0x0000000090c454aa 0t0 133185 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2020-04-22T14:17:16.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root 19r FIFO 0,13 0t0 133187 pipe 2020-04-22T14:17:16.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root 20w FIFO 0,13 0t0 133187 pipe 2020-04-22T14:17:16.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root 21r FIFO 0,13 0t0 133188 pipe 2020-04-22T14:17:16.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root 22w FIFO 0,13 0t0 133188 pipe 2020-04-22T14:17:16.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root 23u IPv4 129263 0t0 TCP smithi103:43764->smithi086.front.sepia.ceph.com:3300 (ESTABLISHED) 2020-04-22T14:17:16.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32342 ms_dispat root 24u IPv4 349330 0t0 TCP smithi103:34020->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root txt REG 8,1 5450216 66394 /usr/bin/ceph-mgr 2020-04-22T14:17:16.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 74568 264458 /usr/lib64/python3.6/site-packages/scipy/_lib/_ccallback_c.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 937648 263213 /usr/lib64/python3.6/site-packages/numpy/random/mtrand.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 44512 263056 /usr/lib64/python3.6/site-packages/numpy/fft/fftpack_lite.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 151544 263133 /usr/lib64/python3.6/site-packages/numpy/linalg/_umath_linalg.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 24016 263135 /usr/lib64/python3.6/site-packages/numpy/linalg/lapack_lite.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 1527544 262945 /usr/lib64/python3.6/site-packages/numpy/core/umath.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 991424 47964 /usr/lib64/python3.6/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2020-04-22T14:17:16.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 11952 47963 /usr/lib64/python3.6/site-packages/cryptography/hazmat/bindings/_constant_time.abi3.so 2020-04-22T14:17:16.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 12200 266614 /usr/lib64/python3.6/site-packages/markupsafe/_speedups.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 268408 63177 /usr/lib64/libquadmath.so.0.0.0 2020-04-22T14:17:16.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 2614504 63181 /usr/lib64/libgfortran.so.5.0.0 2020-04-22T14:17:16.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 32253216 63186 /usr/lib64/libopenblas-r0.3.3.so 2020-04-22T14:17:16.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 33058632 63183 /usr/lib64/libopenblasp-r0.3.3.so 2020-04-22T14:17:16.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 1901024 262884 /usr/lib64/python3.6/site-packages/numpy/core/multiarray.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 71912 41066 /usr/lib64/python3.6/lib-dynload/_elementtree.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 8337992 63031 /usr/lib64/librbd.so.1.12.0 2020-04-22T14:17:16.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 1214680 65566 /usr/lib64/python3.6/site-packages/rbd.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 181064 43088 /usr/lib64/python3.6/site-packages/_cffi_backend.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 43352 396955 /usr/lib64/python3.6/site-packages/bcrypt/_bcrypt.abi3.so 2020-04-22T14:17:16.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 311264 41065 /usr/lib64/python3.6/lib-dynload/_decimal.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 19536 41090 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 244736 3491 /usr/lib64/libexpat.so.1.6.7 2020-04-22T14:17:16.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 67064 41097 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 7528 41076 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 903752 41104 /usr/lib64/python3.6/lib-dynload/unicodedata.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 39752 41059 /usr/lib64/python3.6/lib-dynload/_csv.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 133904 4309 /usr/lib64/libyaml-0.so.2.0.5 2020-04-22T14:17:16.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 249472 43072 /usr/lib64/python3.6/site-packages/_yaml.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:16.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 146288 41060 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 16632 41078 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 66144 41086 /usr/lib64/python3.6/lib-dynload/array.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 127440 41077 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 17352 41091 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:16.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 42888 41073 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 74744 3394 /usr/lib64/libbz2.so.1.0.6 2020-04-22T14:17:16.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 23064 41051 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 38576 41106 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 1682152 63156 /usr/lib64/libcephfs.so.2.0.0 2020-04-22T14:17:16.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 396056 63223 /usr/lib64/python3.6/site-packages/cephfs.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 129016 41083 /usr/lib64/python3.6/lib-dynload/_ssl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 17400 41070 /usr/lib64/python3.6/lib-dynload/_hmacopenssl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 30904 41088 /usr/lib64/python3.6/lib-dynload/binascii.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 20592 41079 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 13720 41049 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 102304 41080 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 88440 41050 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:16.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 43896 41068 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 37448 41100 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 130256 41081 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 115392 41063 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 59368 41092 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 1923096 63025 /usr/lib64/librados.so.2.0.0 2020-04-22T14:17:16.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 1248904 63158 /usr/lib64/python3.6/site-packages/rados.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 52720 41084 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 80192 41071 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 23056 41069 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:16.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 3371672 6608 /usr/lib64/libpython3.6m.so.1.0 2020-04-22T14:17:16.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:16.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:16.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root 1w FIFO 0,13 0t0 134172 pipe 2020-04-22T14:17:16.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root 2w FIFO 0,13 0t0 134173 pipe 2020-04-22T14:17:16.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root 3r FIFO 0,13 0t0 127935 pipe 2020-04-22T14:17:16.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root 4w FIFO 0,13 0t0 127935 pipe 2020-04-22T14:17:16.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root 6r FIFO 0,13 0t0 127936 pipe 2020-04-22T14:17:16.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root 7w FIFO 0,13 0t0 127936 pipe 2020-04-22T14:17:16.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root 9r FIFO 0,13 0t0 127937 pipe 2020-04-22T14:17:16.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root 10w FIFO 0,13 0t0 127937 pipe 2020-04-22T14:17:16.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root 12r FIFO 0,13 0t0 127938 pipe 2020-04-22T14:17:16.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root 13w FIFO 0,13 0t0 127938 pipe 2020-04-22T14:17:16.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root 14w REG 8,1 996809 526782 /var/log/ceph/ceph-mgr.y.log 2020-04-22T14:17:16.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root 15uW REG 0,24 6 133183 /run/ceph/ceph-mgr.y.pid 2020-04-22T14:17:16.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root 16r FIFO 0,13 0t0 133184 pipe 2020-04-22T14:17:16.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root 17w FIFO 0,13 0t0 133184 pipe 2020-04-22T14:17:16.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root 18u unix 0x0000000090c454aa 0t0 133185 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2020-04-22T14:17:16.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root 19r FIFO 0,13 0t0 133187 pipe 2020-04-22T14:17:16.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root 20w FIFO 0,13 0t0 133187 pipe 2020-04-22T14:17:16.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root 21r FIFO 0,13 0t0 133188 pipe 2020-04-22T14:17:16.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root 22w FIFO 0,13 0t0 133188 pipe 2020-04-22T14:17:16.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root 23u IPv4 129263 0t0 TCP smithi103:43764->smithi086.front.sepia.ceph.com:3300 (ESTABLISHED) 2020-04-22T14:17:16.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32343 ms_local root 24u IPv4 349330 0t0 TCP smithi103:34020->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root txt REG 8,1 5450216 66394 /usr/bin/ceph-mgr 2020-04-22T14:17:16.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 74568 264458 /usr/lib64/python3.6/site-packages/scipy/_lib/_ccallback_c.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 937648 263213 /usr/lib64/python3.6/site-packages/numpy/random/mtrand.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 44512 263056 /usr/lib64/python3.6/site-packages/numpy/fft/fftpack_lite.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 151544 263133 /usr/lib64/python3.6/site-packages/numpy/linalg/_umath_linalg.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 24016 263135 /usr/lib64/python3.6/site-packages/numpy/linalg/lapack_lite.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 1527544 262945 /usr/lib64/python3.6/site-packages/numpy/core/umath.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 991424 47964 /usr/lib64/python3.6/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2020-04-22T14:17:16.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 11952 47963 /usr/lib64/python3.6/site-packages/cryptography/hazmat/bindings/_constant_time.abi3.so 2020-04-22T14:17:16.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 12200 266614 /usr/lib64/python3.6/site-packages/markupsafe/_speedups.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 268408 63177 /usr/lib64/libquadmath.so.0.0.0 2020-04-22T14:17:16.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 2614504 63181 /usr/lib64/libgfortran.so.5.0.0 2020-04-22T14:17:16.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 32253216 63186 /usr/lib64/libopenblas-r0.3.3.so 2020-04-22T14:17:16.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 33058632 63183 /usr/lib64/libopenblasp-r0.3.3.so 2020-04-22T14:17:16.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 1901024 262884 /usr/lib64/python3.6/site-packages/numpy/core/multiarray.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 71912 41066 /usr/lib64/python3.6/lib-dynload/_elementtree.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 8337992 63031 /usr/lib64/librbd.so.1.12.0 2020-04-22T14:17:16.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 1214680 65566 /usr/lib64/python3.6/site-packages/rbd.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 181064 43088 /usr/lib64/python3.6/site-packages/_cffi_backend.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 43352 396955 /usr/lib64/python3.6/site-packages/bcrypt/_bcrypt.abi3.so 2020-04-22T14:17:16.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 311264 41065 /usr/lib64/python3.6/lib-dynload/_decimal.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 19536 41090 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 244736 3491 /usr/lib64/libexpat.so.1.6.7 2020-04-22T14:17:16.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 67064 41097 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 7528 41076 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 903752 41104 /usr/lib64/python3.6/lib-dynload/unicodedata.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 39752 41059 /usr/lib64/python3.6/lib-dynload/_csv.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 133904 4309 /usr/lib64/libyaml-0.so.2.0.5 2020-04-22T14:17:16.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 249472 43072 /usr/lib64/python3.6/site-packages/_yaml.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:16.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 146288 41060 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 16632 41078 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 66144 41086 /usr/lib64/python3.6/lib-dynload/array.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 127440 41077 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 17352 41091 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:16.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 42888 41073 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 74744 3394 /usr/lib64/libbz2.so.1.0.6 2020-04-22T14:17:16.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 23064 41051 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 38576 41106 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 1682152 63156 /usr/lib64/libcephfs.so.2.0.0 2020-04-22T14:17:16.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 396056 63223 /usr/lib64/python3.6/site-packages/cephfs.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 129016 41083 /usr/lib64/python3.6/lib-dynload/_ssl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 17400 41070 /usr/lib64/python3.6/lib-dynload/_hmacopenssl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 30904 41088 /usr/lib64/python3.6/lib-dynload/binascii.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 20592 41079 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 13720 41049 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 102304 41080 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 88440 41050 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:16.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 43896 41068 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 37448 41100 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 130256 41081 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 115392 41063 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 59368 41092 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 1923096 63025 /usr/lib64/librados.so.2.0.0 2020-04-22T14:17:16.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 1248904 63158 /usr/lib64/python3.6/site-packages/rados.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 52720 41084 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 80192 41071 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 23056 41069 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:16.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 3371672 6608 /usr/lib64/libpython3.6m.so.1.0 2020-04-22T14:17:16.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:16.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:16.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root 1w FIFO 0,13 0t0 134172 pipe 2020-04-22T14:17:16.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root 2w FIFO 0,13 0t0 134173 pipe 2020-04-22T14:17:16.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root 3r FIFO 0,13 0t0 127935 pipe 2020-04-22T14:17:16.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root 4w FIFO 0,13 0t0 127935 pipe 2020-04-22T14:17:16.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root 6r FIFO 0,13 0t0 127936 pipe 2020-04-22T14:17:16.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root 7w FIFO 0,13 0t0 127936 pipe 2020-04-22T14:17:16.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root 9r FIFO 0,13 0t0 127937 pipe 2020-04-22T14:17:16.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root 10w FIFO 0,13 0t0 127937 pipe 2020-04-22T14:17:16.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root 12r FIFO 0,13 0t0 127938 pipe 2020-04-22T14:17:16.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root 13w FIFO 0,13 0t0 127938 pipe 2020-04-22T14:17:16.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root 14w REG 8,1 996809 526782 /var/log/ceph/ceph-mgr.y.log 2020-04-22T14:17:16.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root 15uW REG 0,24 6 133183 /run/ceph/ceph-mgr.y.pid 2020-04-22T14:17:16.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root 16r FIFO 0,13 0t0 133184 pipe 2020-04-22T14:17:16.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root 17w FIFO 0,13 0t0 133184 pipe 2020-04-22T14:17:16.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root 18u unix 0x0000000090c454aa 0t0 133185 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2020-04-22T14:17:16.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root 19r FIFO 0,13 0t0 133187 pipe 2020-04-22T14:17:16.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root 20w FIFO 0,13 0t0 133187 pipe 2020-04-22T14:17:16.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root 21r FIFO 0,13 0t0 133188 pipe 2020-04-22T14:17:16.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root 22w FIFO 0,13 0t0 133188 pipe 2020-04-22T14:17:16.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root 23u IPv4 129263 0t0 TCP smithi103:43764->smithi086.front.sepia.ceph.com:3300 (ESTABLISHED) 2020-04-22T14:17:16.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32344 safe_time root 24u IPv4 349330 0t0 TCP smithi103:34020->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root txt REG 8,1 5450216 66394 /usr/bin/ceph-mgr 2020-04-22T14:17:16.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 74568 264458 /usr/lib64/python3.6/site-packages/scipy/_lib/_ccallback_c.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 937648 263213 /usr/lib64/python3.6/site-packages/numpy/random/mtrand.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 44512 263056 /usr/lib64/python3.6/site-packages/numpy/fft/fftpack_lite.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 151544 263133 /usr/lib64/python3.6/site-packages/numpy/linalg/_umath_linalg.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 24016 263135 /usr/lib64/python3.6/site-packages/numpy/linalg/lapack_lite.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 1527544 262945 /usr/lib64/python3.6/site-packages/numpy/core/umath.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 991424 47964 /usr/lib64/python3.6/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2020-04-22T14:17:16.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 11952 47963 /usr/lib64/python3.6/site-packages/cryptography/hazmat/bindings/_constant_time.abi3.so 2020-04-22T14:17:16.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 12200 266614 /usr/lib64/python3.6/site-packages/markupsafe/_speedups.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 268408 63177 /usr/lib64/libquadmath.so.0.0.0 2020-04-22T14:17:16.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 2614504 63181 /usr/lib64/libgfortran.so.5.0.0 2020-04-22T14:17:16.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 32253216 63186 /usr/lib64/libopenblas-r0.3.3.so 2020-04-22T14:17:16.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 33058632 63183 /usr/lib64/libopenblasp-r0.3.3.so 2020-04-22T14:17:16.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 1901024 262884 /usr/lib64/python3.6/site-packages/numpy/core/multiarray.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 71912 41066 /usr/lib64/python3.6/lib-dynload/_elementtree.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 8337992 63031 /usr/lib64/librbd.so.1.12.0 2020-04-22T14:17:16.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 1214680 65566 /usr/lib64/python3.6/site-packages/rbd.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 181064 43088 /usr/lib64/python3.6/site-packages/_cffi_backend.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.902 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 43352 396955 /usr/lib64/python3.6/site-packages/bcrypt/_bcrypt.abi3.so 2020-04-22T14:17:16.902 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 311264 41065 /usr/lib64/python3.6/lib-dynload/_decimal.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.902 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 19536 41090 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.902 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 244736 3491 /usr/lib64/libexpat.so.1.6.7 2020-04-22T14:17:16.902 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 67064 41097 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.903 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 7528 41076 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.903 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 903752 41104 /usr/lib64/python3.6/lib-dynload/unicodedata.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.903 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 39752 41059 /usr/lib64/python3.6/lib-dynload/_csv.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 133904 4309 /usr/lib64/libyaml-0.so.2.0.5 2020-04-22T14:17:16.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 249472 43072 /usr/lib64/python3.6/site-packages/_yaml.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:16.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 146288 41060 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 16632 41078 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 66144 41086 /usr/lib64/python3.6/lib-dynload/array.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 127440 41077 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 17352 41091 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:16.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 42888 41073 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 74744 3394 /usr/lib64/libbz2.so.1.0.6 2020-04-22T14:17:16.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 23064 41051 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 38576 41106 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.906 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 1682152 63156 /usr/lib64/libcephfs.so.2.0.0 2020-04-22T14:17:16.906 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 396056 63223 /usr/lib64/python3.6/site-packages/cephfs.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.906 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 129016 41083 /usr/lib64/python3.6/lib-dynload/_ssl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.906 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 17400 41070 /usr/lib64/python3.6/lib-dynload/_hmacopenssl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.906 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 30904 41088 /usr/lib64/python3.6/lib-dynload/binascii.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.907 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 20592 41079 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.907 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 13720 41049 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.907 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 102304 41080 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.907 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 88440 41050 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.907 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:16.907 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 43896 41068 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 37448 41100 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 130256 41081 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 115392 41063 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 59368 41092 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 1923096 63025 /usr/lib64/librados.so.2.0.0 2020-04-22T14:17:16.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 1248904 63158 /usr/lib64/python3.6/site-packages/rados.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 52720 41084 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 80192 41071 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 23056 41069 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:16.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 3371672 6608 /usr/lib64/libpython3.6m.so.1.0 2020-04-22T14:17:16.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:16.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:16.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root 1w FIFO 0,13 0t0 134172 pipe 2020-04-22T14:17:16.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root 2w FIFO 0,13 0t0 134173 pipe 2020-04-22T14:17:16.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root 3r FIFO 0,13 0t0 127935 pipe 2020-04-22T14:17:16.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root 4w FIFO 0,13 0t0 127935 pipe 2020-04-22T14:17:16.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root 6r FIFO 0,13 0t0 127936 pipe 2020-04-22T14:17:16.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root 7w FIFO 0,13 0t0 127936 pipe 2020-04-22T14:17:16.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root 9r FIFO 0,13 0t0 127937 pipe 2020-04-22T14:17:16.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root 10w FIFO 0,13 0t0 127937 pipe 2020-04-22T14:17:16.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root 12r FIFO 0,13 0t0 127938 pipe 2020-04-22T14:17:16.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root 13w FIFO 0,13 0t0 127938 pipe 2020-04-22T14:17:16.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root 14w REG 8,1 996809 526782 /var/log/ceph/ceph-mgr.y.log 2020-04-22T14:17:16.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root 15uW REG 0,24 6 133183 /run/ceph/ceph-mgr.y.pid 2020-04-22T14:17:16.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root 16r FIFO 0,13 0t0 133184 pipe 2020-04-22T14:17:16.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root 17w FIFO 0,13 0t0 133184 pipe 2020-04-22T14:17:16.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root 18u unix 0x0000000090c454aa 0t0 133185 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2020-04-22T14:17:16.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root 19r FIFO 0,13 0t0 133187 pipe 2020-04-22T14:17:16.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root 20w FIFO 0,13 0t0 133187 pipe 2020-04-22T14:17:16.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root 21r FIFO 0,13 0t0 133188 pipe 2020-04-22T14:17:16.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root 22w FIFO 0,13 0t0 133188 pipe 2020-04-22T14:17:16.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root 23u IPv4 129263 0t0 TCP smithi103:43764->smithi086.front.sepia.ceph.com:3300 (ESTABLISHED) 2020-04-22T14:17:16.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32345 fn_anonym root 24u IPv4 349330 0t0 TCP smithi103:34020->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root txt REG 8,1 5450216 66394 /usr/bin/ceph-mgr 2020-04-22T14:17:16.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 74568 264458 /usr/lib64/python3.6/site-packages/scipy/_lib/_ccallback_c.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 937648 263213 /usr/lib64/python3.6/site-packages/numpy/random/mtrand.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 44512 263056 /usr/lib64/python3.6/site-packages/numpy/fft/fftpack_lite.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 151544 263133 /usr/lib64/python3.6/site-packages/numpy/linalg/_umath_linalg.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 24016 263135 /usr/lib64/python3.6/site-packages/numpy/linalg/lapack_lite.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 1527544 262945 /usr/lib64/python3.6/site-packages/numpy/core/umath.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 991424 47964 /usr/lib64/python3.6/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2020-04-22T14:17:16.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 11952 47963 /usr/lib64/python3.6/site-packages/cryptography/hazmat/bindings/_constant_time.abi3.so 2020-04-22T14:17:16.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 12200 266614 /usr/lib64/python3.6/site-packages/markupsafe/_speedups.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 268408 63177 /usr/lib64/libquadmath.so.0.0.0 2020-04-22T14:17:16.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 2614504 63181 /usr/lib64/libgfortran.so.5.0.0 2020-04-22T14:17:16.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 32253216 63186 /usr/lib64/libopenblas-r0.3.3.so 2020-04-22T14:17:16.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 33058632 63183 /usr/lib64/libopenblasp-r0.3.3.so 2020-04-22T14:17:16.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 1901024 262884 /usr/lib64/python3.6/site-packages/numpy/core/multiarray.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 71912 41066 /usr/lib64/python3.6/lib-dynload/_elementtree.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 8337992 63031 /usr/lib64/librbd.so.1.12.0 2020-04-22T14:17:16.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 1214680 65566 /usr/lib64/python3.6/site-packages/rbd.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 181064 43088 /usr/lib64/python3.6/site-packages/_cffi_backend.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 43352 396955 /usr/lib64/python3.6/site-packages/bcrypt/_bcrypt.abi3.so 2020-04-22T14:17:16.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 311264 41065 /usr/lib64/python3.6/lib-dynload/_decimal.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 19536 41090 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 244736 3491 /usr/lib64/libexpat.so.1.6.7 2020-04-22T14:17:16.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 67064 41097 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 7528 41076 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 903752 41104 /usr/lib64/python3.6/lib-dynload/unicodedata.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 39752 41059 /usr/lib64/python3.6/lib-dynload/_csv.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 133904 4309 /usr/lib64/libyaml-0.so.2.0.5 2020-04-22T14:17:16.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 249472 43072 /usr/lib64/python3.6/site-packages/_yaml.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:16.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 146288 41060 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 16632 41078 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 66144 41086 /usr/lib64/python3.6/lib-dynload/array.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 127440 41077 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 17352 41091 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:16.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 42888 41073 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 74744 3394 /usr/lib64/libbz2.so.1.0.6 2020-04-22T14:17:16.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 23064 41051 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 38576 41106 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 1682152 63156 /usr/lib64/libcephfs.so.2.0.0 2020-04-22T14:17:16.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 396056 63223 /usr/lib64/python3.6/site-packages/cephfs.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 129016 41083 /usr/lib64/python3.6/lib-dynload/_ssl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 17400 41070 /usr/lib64/python3.6/lib-dynload/_hmacopenssl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 30904 41088 /usr/lib64/python3.6/lib-dynload/binascii.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 20592 41079 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 13720 41049 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 102304 41080 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 88440 41050 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:16.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 43896 41068 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 37448 41100 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 130256 41081 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 115392 41063 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 59368 41092 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 1923096 63025 /usr/lib64/librados.so.2.0.0 2020-04-22T14:17:16.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 1248904 63158 /usr/lib64/python3.6/site-packages/rados.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 52720 41084 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 80192 41071 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 23056 41069 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:16.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 3371672 6608 /usr/lib64/libpython3.6m.so.1.0 2020-04-22T14:17:16.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:16.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:16.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root 1w FIFO 0,13 0t0 134172 pipe 2020-04-22T14:17:16.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root 2w FIFO 0,13 0t0 134173 pipe 2020-04-22T14:17:16.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root 3r FIFO 0,13 0t0 127935 pipe 2020-04-22T14:17:16.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root 4w FIFO 0,13 0t0 127935 pipe 2020-04-22T14:17:16.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root 6r FIFO 0,13 0t0 127936 pipe 2020-04-22T14:17:16.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root 7w FIFO 0,13 0t0 127936 pipe 2020-04-22T14:17:16.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root 9r FIFO 0,13 0t0 127937 pipe 2020-04-22T14:17:16.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root 10w FIFO 0,13 0t0 127937 pipe 2020-04-22T14:17:16.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root 12r FIFO 0,13 0t0 127938 pipe 2020-04-22T14:17:16.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root 13w FIFO 0,13 0t0 127938 pipe 2020-04-22T14:17:16.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root 14w REG 8,1 996809 526782 /var/log/ceph/ceph-mgr.y.log 2020-04-22T14:17:16.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root 15uW REG 0,24 6 133183 /run/ceph/ceph-mgr.y.pid 2020-04-22T14:17:16.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root 16r FIFO 0,13 0t0 133184 pipe 2020-04-22T14:17:16.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root 17w FIFO 0,13 0t0 133184 pipe 2020-04-22T14:17:16.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root 18u unix 0x0000000090c454aa 0t0 133185 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2020-04-22T14:17:16.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root 19r FIFO 0,13 0t0 133187 pipe 2020-04-22T14:17:16.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root 20w FIFO 0,13 0t0 133187 pipe 2020-04-22T14:17:16.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root 21r FIFO 0,13 0t0 133188 pipe 2020-04-22T14:17:16.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root 22w FIFO 0,13 0t0 133188 pipe 2020-04-22T14:17:16.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root 23u IPv4 129263 0t0 TCP smithi103:43764->smithi086.front.sepia.ceph.com:3300 (ESTABLISHED) 2020-04-22T14:17:16.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32347 safe_time root 24u IPv4 349330 0t0 TCP smithi103:34020->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root txt REG 8,1 5450216 66394 /usr/bin/ceph-mgr 2020-04-22T14:17:16.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 74568 264458 /usr/lib64/python3.6/site-packages/scipy/_lib/_ccallback_c.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 937648 263213 /usr/lib64/python3.6/site-packages/numpy/random/mtrand.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 44512 263056 /usr/lib64/python3.6/site-packages/numpy/fft/fftpack_lite.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 151544 263133 /usr/lib64/python3.6/site-packages/numpy/linalg/_umath_linalg.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 24016 263135 /usr/lib64/python3.6/site-packages/numpy/linalg/lapack_lite.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 1527544 262945 /usr/lib64/python3.6/site-packages/numpy/core/umath.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 991424 47964 /usr/lib64/python3.6/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2020-04-22T14:17:16.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 11952 47963 /usr/lib64/python3.6/site-packages/cryptography/hazmat/bindings/_constant_time.abi3.so 2020-04-22T14:17:16.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 12200 266614 /usr/lib64/python3.6/site-packages/markupsafe/_speedups.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 268408 63177 /usr/lib64/libquadmath.so.0.0.0 2020-04-22T14:17:16.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 2614504 63181 /usr/lib64/libgfortran.so.5.0.0 2020-04-22T14:17:16.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 32253216 63186 /usr/lib64/libopenblas-r0.3.3.so 2020-04-22T14:17:16.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 33058632 63183 /usr/lib64/libopenblasp-r0.3.3.so 2020-04-22T14:17:16.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 1901024 262884 /usr/lib64/python3.6/site-packages/numpy/core/multiarray.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 71912 41066 /usr/lib64/python3.6/lib-dynload/_elementtree.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 8337992 63031 /usr/lib64/librbd.so.1.12.0 2020-04-22T14:17:16.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 1214680 65566 /usr/lib64/python3.6/site-packages/rbd.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 181064 43088 /usr/lib64/python3.6/site-packages/_cffi_backend.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 43352 396955 /usr/lib64/python3.6/site-packages/bcrypt/_bcrypt.abi3.so 2020-04-22T14:17:16.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 311264 41065 /usr/lib64/python3.6/lib-dynload/_decimal.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 19536 41090 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 244736 3491 /usr/lib64/libexpat.so.1.6.7 2020-04-22T14:17:16.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 67064 41097 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 7528 41076 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 903752 41104 /usr/lib64/python3.6/lib-dynload/unicodedata.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 39752 41059 /usr/lib64/python3.6/lib-dynload/_csv.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 133904 4309 /usr/lib64/libyaml-0.so.2.0.5 2020-04-22T14:17:16.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 249472 43072 /usr/lib64/python3.6/site-packages/_yaml.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:16.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 146288 41060 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 16632 41078 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 66144 41086 /usr/lib64/python3.6/lib-dynload/array.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 127440 41077 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 17352 41091 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:16.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 42888 41073 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 74744 3394 /usr/lib64/libbz2.so.1.0.6 2020-04-22T14:17:16.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 23064 41051 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 38576 41106 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 1682152 63156 /usr/lib64/libcephfs.so.2.0.0 2020-04-22T14:17:16.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 396056 63223 /usr/lib64/python3.6/site-packages/cephfs.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 129016 41083 /usr/lib64/python3.6/lib-dynload/_ssl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 17400 41070 /usr/lib64/python3.6/lib-dynload/_hmacopenssl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 30904 41088 /usr/lib64/python3.6/lib-dynload/binascii.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 20592 41079 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 13720 41049 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 102304 41080 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 88440 41050 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:16.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 43896 41068 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 37448 41100 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 130256 41081 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 115392 41063 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 59368 41092 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 1923096 63025 /usr/lib64/librados.so.2.0.0 2020-04-22T14:17:16.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 1248904 63158 /usr/lib64/python3.6/site-packages/rados.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 52720 41084 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 80192 41071 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 23056 41069 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:16.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 3371672 6608 /usr/lib64/libpython3.6m.so.1.0 2020-04-22T14:17:16.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:16.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:16.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root 1w FIFO 0,13 0t0 134172 pipe 2020-04-22T14:17:16.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root 2w FIFO 0,13 0t0 134173 pipe 2020-04-22T14:17:16.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root 3r FIFO 0,13 0t0 127935 pipe 2020-04-22T14:17:16.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root 4w FIFO 0,13 0t0 127935 pipe 2020-04-22T14:17:16.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root 6r FIFO 0,13 0t0 127936 pipe 2020-04-22T14:17:16.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root 7w FIFO 0,13 0t0 127936 pipe 2020-04-22T14:17:16.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root 9r FIFO 0,13 0t0 127937 pipe 2020-04-22T14:17:16.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root 10w FIFO 0,13 0t0 127937 pipe 2020-04-22T14:17:16.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root 12r FIFO 0,13 0t0 127938 pipe 2020-04-22T14:17:16.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root 13w FIFO 0,13 0t0 127938 pipe 2020-04-22T14:17:16.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root 14w REG 8,1 996809 526782 /var/log/ceph/ceph-mgr.y.log 2020-04-22T14:17:16.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root 15uW REG 0,24 6 133183 /run/ceph/ceph-mgr.y.pid 2020-04-22T14:17:16.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root 16r FIFO 0,13 0t0 133184 pipe 2020-04-22T14:17:16.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root 17w FIFO 0,13 0t0 133184 pipe 2020-04-22T14:17:16.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root 18u unix 0x0000000090c454aa 0t0 133185 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2020-04-22T14:17:16.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root 19r FIFO 0,13 0t0 133187 pipe 2020-04-22T14:17:16.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root 20w FIFO 0,13 0t0 133187 pipe 2020-04-22T14:17:16.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root 21r FIFO 0,13 0t0 133188 pipe 2020-04-22T14:17:16.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root 22w FIFO 0,13 0t0 133188 pipe 2020-04-22T14:17:16.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root 23u IPv4 129263 0t0 TCP smithi103:43764->smithi086.front.sepia.ceph.com:3300 (ESTABLISHED) 2020-04-22T14:17:16.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32353 safe_time root 24u IPv4 349330 0t0 TCP smithi103:34020->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root txt REG 8,1 5450216 66394 /usr/bin/ceph-mgr 2020-04-22T14:17:16.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 74568 264458 /usr/lib64/python3.6/site-packages/scipy/_lib/_ccallback_c.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 937648 263213 /usr/lib64/python3.6/site-packages/numpy/random/mtrand.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 44512 263056 /usr/lib64/python3.6/site-packages/numpy/fft/fftpack_lite.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 151544 263133 /usr/lib64/python3.6/site-packages/numpy/linalg/_umath_linalg.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 24016 263135 /usr/lib64/python3.6/site-packages/numpy/linalg/lapack_lite.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 1527544 262945 /usr/lib64/python3.6/site-packages/numpy/core/umath.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 991424 47964 /usr/lib64/python3.6/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2020-04-22T14:17:16.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 11952 47963 /usr/lib64/python3.6/site-packages/cryptography/hazmat/bindings/_constant_time.abi3.so 2020-04-22T14:17:16.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 12200 266614 /usr/lib64/python3.6/site-packages/markupsafe/_speedups.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 268408 63177 /usr/lib64/libquadmath.so.0.0.0 2020-04-22T14:17:16.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 2614504 63181 /usr/lib64/libgfortran.so.5.0.0 2020-04-22T14:17:16.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 32253216 63186 /usr/lib64/libopenblas-r0.3.3.so 2020-04-22T14:17:16.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 33058632 63183 /usr/lib64/libopenblasp-r0.3.3.so 2020-04-22T14:17:16.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 1901024 262884 /usr/lib64/python3.6/site-packages/numpy/core/multiarray.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 71912 41066 /usr/lib64/python3.6/lib-dynload/_elementtree.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 8337992 63031 /usr/lib64/librbd.so.1.12.0 2020-04-22T14:17:16.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 1214680 65566 /usr/lib64/python3.6/site-packages/rbd.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 181064 43088 /usr/lib64/python3.6/site-packages/_cffi_backend.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 43352 396955 /usr/lib64/python3.6/site-packages/bcrypt/_bcrypt.abi3.so 2020-04-22T14:17:16.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 311264 41065 /usr/lib64/python3.6/lib-dynload/_decimal.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 19536 41090 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 244736 3491 /usr/lib64/libexpat.so.1.6.7 2020-04-22T14:17:16.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 67064 41097 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 7528 41076 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 903752 41104 /usr/lib64/python3.6/lib-dynload/unicodedata.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 39752 41059 /usr/lib64/python3.6/lib-dynload/_csv.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 133904 4309 /usr/lib64/libyaml-0.so.2.0.5 2020-04-22T14:17:16.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 249472 43072 /usr/lib64/python3.6/site-packages/_yaml.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:16.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 146288 41060 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 16632 41078 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 66144 41086 /usr/lib64/python3.6/lib-dynload/array.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 127440 41077 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 17352 41091 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:16.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 42888 41073 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 74744 3394 /usr/lib64/libbz2.so.1.0.6 2020-04-22T14:17:16.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 23064 41051 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 38576 41106 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 1682152 63156 /usr/lib64/libcephfs.so.2.0.0 2020-04-22T14:17:16.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 396056 63223 /usr/lib64/python3.6/site-packages/cephfs.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 129016 41083 /usr/lib64/python3.6/lib-dynload/_ssl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 17400 41070 /usr/lib64/python3.6/lib-dynload/_hmacopenssl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 30904 41088 /usr/lib64/python3.6/lib-dynload/binascii.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 20592 41079 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 13720 41049 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 102304 41080 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 88440 41050 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:16.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 43896 41068 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 37448 41100 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 130256 41081 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 115392 41063 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 59368 41092 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 1923096 63025 /usr/lib64/librados.so.2.0.0 2020-04-22T14:17:16.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 1248904 63158 /usr/lib64/python3.6/site-packages/rados.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 52720 41084 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 80192 41071 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 23056 41069 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:16.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:16.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:16.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:16.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:16.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:16.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:16.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:16.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:16.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:16.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:16.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:16.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:16.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:16.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:16.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:16.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 3371672 6608 /usr/lib64/libpython3.6m.so.1.0 2020-04-22T14:17:16.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:16.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:16.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:16.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:16.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:16.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root 1w FIFO 0,13 0t0 134172 pipe 2020-04-22T14:17:16.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root 2w FIFO 0,13 0t0 134173 pipe 2020-04-22T14:17:16.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root 3r FIFO 0,13 0t0 127935 pipe 2020-04-22T14:17:16.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root 4w FIFO 0,13 0t0 127935 pipe 2020-04-22T14:17:16.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root 6r FIFO 0,13 0t0 127936 pipe 2020-04-22T14:17:16.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root 7w FIFO 0,13 0t0 127936 pipe 2020-04-22T14:17:16.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root 9r FIFO 0,13 0t0 127937 pipe 2020-04-22T14:17:16.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root 10w FIFO 0,13 0t0 127937 pipe 2020-04-22T14:17:16.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:16.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root 12r FIFO 0,13 0t0 127938 pipe 2020-04-22T14:17:16.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root 13w FIFO 0,13 0t0 127938 pipe 2020-04-22T14:17:16.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root 14w REG 8,1 996809 526782 /var/log/ceph/ceph-mgr.y.log 2020-04-22T14:17:16.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root 15uW REG 0,24 6 133183 /run/ceph/ceph-mgr.y.pid 2020-04-22T14:17:16.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root 16r FIFO 0,13 0t0 133184 pipe 2020-04-22T14:17:16.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root 17w FIFO 0,13 0t0 133184 pipe 2020-04-22T14:17:16.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root 18u unix 0x0000000090c454aa 0t0 133185 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2020-04-22T14:17:16.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root 19r FIFO 0,13 0t0 133187 pipe 2020-04-22T14:17:16.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root 20w FIFO 0,13 0t0 133187 pipe 2020-04-22T14:17:16.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root 21r FIFO 0,13 0t0 133188 pipe 2020-04-22T14:17:16.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root 22w FIFO 0,13 0t0 133188 pipe 2020-04-22T14:17:16.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root 23u IPv4 129263 0t0 TCP smithi103:43764->smithi086.front.sepia.ceph.com:3300 (ESTABLISHED) 2020-04-22T14:17:16.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32354 fn_anonym root 24u IPv4 349330 0t0 TCP smithi103:34020->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:16.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:16.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:16.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root txt REG 8,1 5450216 66394 /usr/bin/ceph-mgr 2020-04-22T14:17:16.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 74568 264458 /usr/lib64/python3.6/site-packages/scipy/_lib/_ccallback_c.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 937648 263213 /usr/lib64/python3.6/site-packages/numpy/random/mtrand.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 44512 263056 /usr/lib64/python3.6/site-packages/numpy/fft/fftpack_lite.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 151544 263133 /usr/lib64/python3.6/site-packages/numpy/linalg/_umath_linalg.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 24016 263135 /usr/lib64/python3.6/site-packages/numpy/linalg/lapack_lite.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 1527544 262945 /usr/lib64/python3.6/site-packages/numpy/core/umath.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 991424 47964 /usr/lib64/python3.6/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2020-04-22T14:17:16.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 11952 47963 /usr/lib64/python3.6/site-packages/cryptography/hazmat/bindings/_constant_time.abi3.so 2020-04-22T14:17:16.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 12200 266614 /usr/lib64/python3.6/site-packages/markupsafe/_speedups.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 268408 63177 /usr/lib64/libquadmath.so.0.0.0 2020-04-22T14:17:16.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 2614504 63181 /usr/lib64/libgfortran.so.5.0.0 2020-04-22T14:17:16.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 32253216 63186 /usr/lib64/libopenblas-r0.3.3.so 2020-04-22T14:17:16.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 33058632 63183 /usr/lib64/libopenblasp-r0.3.3.so 2020-04-22T14:17:16.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 1901024 262884 /usr/lib64/python3.6/site-packages/numpy/core/multiarray.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 71912 41066 /usr/lib64/python3.6/lib-dynload/_elementtree.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 8337992 63031 /usr/lib64/librbd.so.1.12.0 2020-04-22T14:17:16.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 1214680 65566 /usr/lib64/python3.6/site-packages/rbd.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 181064 43088 /usr/lib64/python3.6/site-packages/_cffi_backend.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 43352 396955 /usr/lib64/python3.6/site-packages/bcrypt/_bcrypt.abi3.so 2020-04-22T14:17:16.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 311264 41065 /usr/lib64/python3.6/lib-dynload/_decimal.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 19536 41090 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 244736 3491 /usr/lib64/libexpat.so.1.6.7 2020-04-22T14:17:16.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 67064 41097 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 7528 41076 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 903752 41104 /usr/lib64/python3.6/lib-dynload/unicodedata.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 39752 41059 /usr/lib64/python3.6/lib-dynload/_csv.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 133904 4309 /usr/lib64/libyaml-0.so.2.0.5 2020-04-22T14:17:16.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 249472 43072 /usr/lib64/python3.6/site-packages/_yaml.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:16.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 146288 41060 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 16632 41078 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 66144 41086 /usr/lib64/python3.6/lib-dynload/array.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 127440 41077 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 17352 41091 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:16.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 42888 41073 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 74744 3394 /usr/lib64/libbz2.so.1.0.6 2020-04-22T14:17:16.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 23064 41051 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 38576 41106 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 1682152 63156 /usr/lib64/libcephfs.so.2.0.0 2020-04-22T14:17:16.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 396056 63223 /usr/lib64/python3.6/site-packages/cephfs.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 129016 41083 /usr/lib64/python3.6/lib-dynload/_ssl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 17400 41070 /usr/lib64/python3.6/lib-dynload/_hmacopenssl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 30904 41088 /usr/lib64/python3.6/lib-dynload/binascii.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 20592 41079 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 13720 41049 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 102304 41080 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 88440 41050 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:16.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 43896 41068 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 37448 41100 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 130256 41081 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 115392 41063 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 59368 41092 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 1923096 63025 /usr/lib64/librados.so.2.0.0 2020-04-22T14:17:16.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 1248904 63158 /usr/lib64/python3.6/site-packages/rados.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 52720 41084 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 80192 41071 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 23056 41069 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:16.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:16.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:16.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:16.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:16.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:16.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:16.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:16.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:16.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:16.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:16.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:16.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:17.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 3371672 6608 /usr/lib64/libpython3.6m.so.1.0 2020-04-22T14:17:17.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:17.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:17.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:17.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root 1w FIFO 0,13 0t0 134172 pipe 2020-04-22T14:17:17.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root 2w FIFO 0,13 0t0 134173 pipe 2020-04-22T14:17:17.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root 3r FIFO 0,13 0t0 127935 pipe 2020-04-22T14:17:17.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root 4w FIFO 0,13 0t0 127935 pipe 2020-04-22T14:17:17.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root 6r FIFO 0,13 0t0 127936 pipe 2020-04-22T14:17:17.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root 7w FIFO 0,13 0t0 127936 pipe 2020-04-22T14:17:17.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root 9r FIFO 0,13 0t0 127937 pipe 2020-04-22T14:17:17.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root 10w FIFO 0,13 0t0 127937 pipe 2020-04-22T14:17:17.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root 12r FIFO 0,13 0t0 127938 pipe 2020-04-22T14:17:17.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root 13w FIFO 0,13 0t0 127938 pipe 2020-04-22T14:17:17.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root 14w REG 8,1 996809 526782 /var/log/ceph/ceph-mgr.y.log 2020-04-22T14:17:17.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root 15uW REG 0,24 6 133183 /run/ceph/ceph-mgr.y.pid 2020-04-22T14:17:17.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root 16r FIFO 0,13 0t0 133184 pipe 2020-04-22T14:17:17.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root 17w FIFO 0,13 0t0 133184 pipe 2020-04-22T14:17:17.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root 18u unix 0x0000000090c454aa 0t0 133185 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2020-04-22T14:17:17.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root 19r FIFO 0,13 0t0 133187 pipe 2020-04-22T14:17:17.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root 20w FIFO 0,13 0t0 133187 pipe 2020-04-22T14:17:17.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root 21r FIFO 0,13 0t0 133188 pipe 2020-04-22T14:17:17.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root 22w FIFO 0,13 0t0 133188 pipe 2020-04-22T14:17:17.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root 23u IPv4 129263 0t0 TCP smithi103:43764->smithi086.front.sepia.ceph.com:3300 (ESTABLISHED) 2020-04-22T14:17:17.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32355 flusher root 24u IPv4 349330 0t0 TCP smithi103:34020->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root txt REG 8,1 5450216 66394 /usr/bin/ceph-mgr 2020-04-22T14:17:17.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 74568 264458 /usr/lib64/python3.6/site-packages/scipy/_lib/_ccallback_c.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 937648 263213 /usr/lib64/python3.6/site-packages/numpy/random/mtrand.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 44512 263056 /usr/lib64/python3.6/site-packages/numpy/fft/fftpack_lite.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 151544 263133 /usr/lib64/python3.6/site-packages/numpy/linalg/_umath_linalg.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 24016 263135 /usr/lib64/python3.6/site-packages/numpy/linalg/lapack_lite.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 1527544 262945 /usr/lib64/python3.6/site-packages/numpy/core/umath.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 991424 47964 /usr/lib64/python3.6/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2020-04-22T14:17:17.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 11952 47963 /usr/lib64/python3.6/site-packages/cryptography/hazmat/bindings/_constant_time.abi3.so 2020-04-22T14:17:17.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 12200 266614 /usr/lib64/python3.6/site-packages/markupsafe/_speedups.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 268408 63177 /usr/lib64/libquadmath.so.0.0.0 2020-04-22T14:17:17.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 2614504 63181 /usr/lib64/libgfortran.so.5.0.0 2020-04-22T14:17:17.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 32253216 63186 /usr/lib64/libopenblas-r0.3.3.so 2020-04-22T14:17:17.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 33058632 63183 /usr/lib64/libopenblasp-r0.3.3.so 2020-04-22T14:17:17.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 1901024 262884 /usr/lib64/python3.6/site-packages/numpy/core/multiarray.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 71912 41066 /usr/lib64/python3.6/lib-dynload/_elementtree.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 8337992 63031 /usr/lib64/librbd.so.1.12.0 2020-04-22T14:17:17.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 1214680 65566 /usr/lib64/python3.6/site-packages/rbd.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 181064 43088 /usr/lib64/python3.6/site-packages/_cffi_backend.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 43352 396955 /usr/lib64/python3.6/site-packages/bcrypt/_bcrypt.abi3.so 2020-04-22T14:17:17.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 311264 41065 /usr/lib64/python3.6/lib-dynload/_decimal.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 19536 41090 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 244736 3491 /usr/lib64/libexpat.so.1.6.7 2020-04-22T14:17:17.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 67064 41097 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 7528 41076 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 903752 41104 /usr/lib64/python3.6/lib-dynload/unicodedata.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 39752 41059 /usr/lib64/python3.6/lib-dynload/_csv.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 133904 4309 /usr/lib64/libyaml-0.so.2.0.5 2020-04-22T14:17:17.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 249472 43072 /usr/lib64/python3.6/site-packages/_yaml.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 51808 3644 /usr/lib64/libffi.so.6.0.2 2020-04-22T14:17:17.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 146288 41060 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 16632 41078 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 66144 41086 /usr/lib64/python3.6/lib-dynload/array.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 127440 41077 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 17352 41091 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 192016 3369 /usr/lib64/liblzma.so.5.2.4 2020-04-22T14:17:17.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 42888 41073 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 74744 3394 /usr/lib64/libbz2.so.1.0.6 2020-04-22T14:17:17.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 23064 41051 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 38576 41106 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 1682152 63156 /usr/lib64/libcephfs.so.2.0.0 2020-04-22T14:17:17.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 396056 63223 /usr/lib64/python3.6/site-packages/cephfs.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 129016 41083 /usr/lib64/python3.6/lib-dynload/_ssl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 17400 41070 /usr/lib64/python3.6/lib-dynload/_hmacopenssl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 30904 41088 /usr/lib64/python3.6/lib-dynload/binascii.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 20592 41079 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 13720 41049 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 102304 41080 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 88440 41050 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:17.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 43896 41068 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 37448 41100 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 130256 41081 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 115392 41063 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 59368 41092 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 1923096 63025 /usr/lib64/librados.so.2.0.0 2020-04-22T14:17:17.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 1248904 63158 /usr/lib64/python3.6/site-packages/rados.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 52720 41084 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 80192 41071 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 23056 41069 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:17.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 3371672 6608 /usr/lib64/libpython3.6m.so.1.0 2020-04-22T14:17:17.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:17.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:17.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:17.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root 1w FIFO 0,13 0t0 134172 pipe 2020-04-22T14:17:17.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root 2w FIFO 0,13 0t0 134173 pipe 2020-04-22T14:17:17.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root 3r FIFO 0,13 0t0 127935 pipe 2020-04-22T14:17:17.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root 4w FIFO 0,13 0t0 127935 pipe 2020-04-22T14:17:17.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root 6r FIFO 0,13 0t0 127936 pipe 2020-04-22T14:17:17.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root 7w FIFO 0,13 0t0 127936 pipe 2020-04-22T14:17:17.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root 9r FIFO 0,13 0t0 127937 pipe 2020-04-22T14:17:17.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root 10w FIFO 0,13 0t0 127937 pipe 2020-04-22T14:17:17.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root 12r FIFO 0,13 0t0 127938 pipe 2020-04-22T14:17:17.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root 13w FIFO 0,13 0t0 127938 pipe 2020-04-22T14:17:17.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root 14w REG 8,1 996809 526782 /var/log/ceph/ceph-mgr.y.log 2020-04-22T14:17:17.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root 15uW REG 0,24 6 133183 /run/ceph/ceph-mgr.y.pid 2020-04-22T14:17:17.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root 16r FIFO 0,13 0t0 133184 pipe 2020-04-22T14:17:17.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root 17w FIFO 0,13 0t0 133184 pipe 2020-04-22T14:17:17.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root 18u unix 0x0000000090c454aa 0t0 133185 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2020-04-22T14:17:17.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root 19r FIFO 0,13 0t0 133187 pipe 2020-04-22T14:17:17.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root 20w FIFO 0,13 0t0 133187 pipe 2020-04-22T14:17:17.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root 21r FIFO 0,13 0t0 133188 pipe 2020-04-22T14:17:17.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root 22w FIFO 0,13 0t0 133188 pipe 2020-04-22T14:17:17.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root 23u IPv4 129263 0t0 TCP smithi103:43764->smithi086.front.sepia.ceph.com:3300 (ESTABLISHED) 2020-04-22T14:17:17.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mgr 32282 32356 safe_time root 24u IPv4 349330 0t0 TCP smithi103:34020->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.030 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.030 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.031 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root txt REG 8,1 207056 9178 /usr/bin/sudo 2020-04-22T14:17:17.031 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 16704 5754 /usr/lib64/libpam_misc.so.0.82.1 2020-04-22T14:17:17.031 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 855144 29339 /usr/lib64/security/pam_systemd.so 2020-04-22T14:17:17.031 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 24208 29040 /usr/lib64/security/pam_limits.so 2020-04-22T14:17:17.032 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 11888 29038 /usr/lib64/security/pam_keyinit.so 2020-04-22T14:17:17.032 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 46232 5216 /usr/lib64/libcrack.so.2.9.0 2020-04-22T14:17:17.032 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 25728 5682 /usr/lib64/libpwquality.so.1.0.2 2020-04-22T14:17:17.032 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 11896 29000 /usr/lib64/security/pam_pwquality.so 2020-04-22T14:17:17.032 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 7808 29049 /usr/lib64/security/pam_permit.so 2020-04-22T14:17:17.032 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 7704 29028 /usr/lib64/security/pam_deny.so 2020-04-22T14:17:17.033 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 68936 29798 /usr/lib64/security/pam_sss.so 2020-04-22T14:17:17.033 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 371032 5313 /usr/lib64/libtirpc.so.3.0.0 2020-04-22T14:17:17.033 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 116408 5315 /usr/lib64/libnsl.so.2.0.0 2020-04-22T14:17:17.033 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 61448 29065 /usr/lib64/security/pam_unix.so 2020-04-22T14:17:17.033 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 11912 29042 /usr/lib64/security/pam_localuser.so 2020-04-22T14:17:17.033 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 16088 29060 /usr/lib64/security/pam_succeed_if.so 2020-04-22T14:17:17.033 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 11880 29032 /usr/lib64/security/pam_faildelay.so 2020-04-22T14:17:17.033 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 20304 29030 /usr/lib64/security/pam_env.so 2020-04-22T14:17:17.034 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:17.034 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.034 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.034 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.034 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.035 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:17.035 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.036 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 860880 5511 /usr/lib64/libnss_systemd.so.2 2020-04-22T14:17:17.036 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:17.036 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:17.036 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 16240 3641 /usr/lib64/libkeyutils.so.1.6 2020-04-22T14:17:17.036 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 118728 5304 /usr/lib64/libkrb5support.so.0.1 2020-04-22T14:17:17.036 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 25992 3339 /usr/lib64/libcom_err.so.2.1 2020-04-22T14:17:17.036 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 273488 5296 /usr/lib64/libk5crypto.so.3.1 2020-04-22T14:17:17.037 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 1507952 5302 /usr/lib64/libkrb5.so.3.3 2020-04-22T14:17:17.037 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 603768 5292 /usr/lib64/libgssapi_krb5.so.2.2 2020-04-22T14:17:17.037 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 142712 3373 /usr/lib64/libcrypt.so.1.1.0 2020-04-22T14:17:17.037 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.037 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:17.037 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 149160 4994 /usr/lib64/libsasl2.so.3.0.0 2020-04-22T14:17:17.037 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.038 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.038 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 97056 5009 /usr/lib64/liblber-2.4.so.2.10.9 2020-04-22T14:17:17.038 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 477472 5011 /usr/lib64/libldap-2.4.so.2.10.9 2020-04-22T14:17:17.038 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 74600 5752 /usr/lib64/libpam.so.0.84.2 2020-04-22T14:17:17.038 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 549944 16572 /usr/libexec/sudo/sudoers.so 2020-04-22T14:17:17.038 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:17.038 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:17.039 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:17.039 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.039 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 25192 3584 /usr/lib64/libcap-ng.so.0.0.0 2020-04-22T14:17:17.039 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.039 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.039 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.039 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 182296 16569 /usr/libexec/sudo/libsudo_util.so.0.0.0 2020-04-22T14:17:17.040 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:17.040 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.040 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 141392 3586 /usr/lib64/libaudit.so.1.0.0 2020-04-22T14:17:17.040 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.040 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:17.040 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:17.040 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:17.041 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:17.041 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:17.041 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:17.041 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:17.041 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:17.041 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:17.041 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:17.042 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:17.042 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:17.042 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root 0r FIFO 0,13 0t0 133348 pipe 2020-04-22T14:17:17.042 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.042 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.042 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root 3r REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:17.042 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root 4u unix 0x0000000086ec15fa 0t0 132508 type=STREAM 2020-04-22T14:17:17.042 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root 5u netlink 0t0 132516 AUDIT 2020-04-22T14:17:17.043 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root 6r REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:17.043 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root 7r REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:17.043 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root 9u unix 0x000000002e2130c8 0t0 132519 type=DGRAM 2020-04-22T14:17:17.043 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root 10r FIFO 0,13 0t0 132522 pipe 2020-04-22T14:17:17.043 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33021 root 11w FIFO 0,13 0t0 132522 pipe 2020-04-22T14:17:17.043 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33052 root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.043 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33052 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.044 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33052 root txt REG 8,1 15496 6602 /usr/libexec/platform-python3.6 2020-04-22T14:17:17.044 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33052 root mem REG 8,1 59368 41092 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.044 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33052 root mem REG 8,1 16632 41078 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.044 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33052 root mem REG 8,1 52720 41084 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.044 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33052 root mem REG 8,1 37448 41100 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.044 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33052 root mem REG 8,1 19536 41090 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.044 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33052 root mem REG 8,1 23056 41069 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:17.044 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33052 root mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:17.045 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33052 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.045 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33052 root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.045 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33052 root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:17.045 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33052 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.045 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33052 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.045 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33052 root mem REG 8,1 3371672 6608 /usr/lib64/libpython3.6m.so.1.0 2020-04-22T14:17:17.045 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33052 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.045 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33052 root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:17.046 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33052 root mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:17.046 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33052 root mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:17.046 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33052 root mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:17.046 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33052 root mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:17.046 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33052 root mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:17.046 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33052 root mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:17.046 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33052 root mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:17.047 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33052 root mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:17.047 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33052 root mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:17.047 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33052 root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:17.047 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33052 root mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:17.047 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33052 root 0r FIFO 0,13 0t0 133348 pipe 2020-04-22T14:17:17.047 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33052 root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.047 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33052 root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.048 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.048 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.048 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root txt REG 8,1 207056 9178 /usr/bin/sudo 2020-04-22T14:17:17.048 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 16704 5754 /usr/lib64/libpam_misc.so.0.82.1 2020-04-22T14:17:17.048 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 855144 29339 /usr/lib64/security/pam_systemd.so 2020-04-22T14:17:17.048 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 24208 29040 /usr/lib64/security/pam_limits.so 2020-04-22T14:17:17.048 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 11888 29038 /usr/lib64/security/pam_keyinit.so 2020-04-22T14:17:17.048 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 46232 5216 /usr/lib64/libcrack.so.2.9.0 2020-04-22T14:17:17.049 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 25728 5682 /usr/lib64/libpwquality.so.1.0.2 2020-04-22T14:17:17.049 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 11896 29000 /usr/lib64/security/pam_pwquality.so 2020-04-22T14:17:17.049 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 7808 29049 /usr/lib64/security/pam_permit.so 2020-04-22T14:17:17.049 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 7704 29028 /usr/lib64/security/pam_deny.so 2020-04-22T14:17:17.049 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 68936 29798 /usr/lib64/security/pam_sss.so 2020-04-22T14:17:17.049 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 371032 5313 /usr/lib64/libtirpc.so.3.0.0 2020-04-22T14:17:17.049 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 116408 5315 /usr/lib64/libnsl.so.2.0.0 2020-04-22T14:17:17.050 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 61448 29065 /usr/lib64/security/pam_unix.so 2020-04-22T14:17:17.050 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 11912 29042 /usr/lib64/security/pam_localuser.so 2020-04-22T14:17:17.050 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 16088 29060 /usr/lib64/security/pam_succeed_if.so 2020-04-22T14:17:17.050 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 11880 29032 /usr/lib64/security/pam_faildelay.so 2020-04-22T14:17:17.050 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 20304 29030 /usr/lib64/security/pam_env.so 2020-04-22T14:17:17.050 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:17.050 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.050 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.051 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.051 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.051 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:17.051 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.051 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 860880 5511 /usr/lib64/libnss_systemd.so.2 2020-04-22T14:17:17.051 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:17.051 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:17.052 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 16240 3641 /usr/lib64/libkeyutils.so.1.6 2020-04-22T14:17:17.052 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 118728 5304 /usr/lib64/libkrb5support.so.0.1 2020-04-22T14:17:17.052 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 25992 3339 /usr/lib64/libcom_err.so.2.1 2020-04-22T14:17:17.052 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 273488 5296 /usr/lib64/libk5crypto.so.3.1 2020-04-22T14:17:17.052 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 1507952 5302 /usr/lib64/libkrb5.so.3.3 2020-04-22T14:17:17.052 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 603768 5292 /usr/lib64/libgssapi_krb5.so.2.2 2020-04-22T14:17:17.052 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 142712 3373 /usr/lib64/libcrypt.so.1.1.0 2020-04-22T14:17:17.052 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.053 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:17.053 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 149160 4994 /usr/lib64/libsasl2.so.3.0.0 2020-04-22T14:17:17.053 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.053 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.053 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 97056 5009 /usr/lib64/liblber-2.4.so.2.10.9 2020-04-22T14:17:17.053 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 477472 5011 /usr/lib64/libldap-2.4.so.2.10.9 2020-04-22T14:17:17.053 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 74600 5752 /usr/lib64/libpam.so.0.84.2 2020-04-22T14:17:17.053 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 549944 16572 /usr/libexec/sudo/sudoers.so 2020-04-22T14:17:17.054 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:17.054 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:17.054 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:17.054 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.054 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 25192 3584 /usr/lib64/libcap-ng.so.0.0.0 2020-04-22T14:17:17.054 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.054 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.055 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.055 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 182296 16569 /usr/libexec/sudo/libsudo_util.so.0.0.0 2020-04-22T14:17:17.055 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:17.055 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.055 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 141392 3586 /usr/lib64/libaudit.so.1.0.0 2020-04-22T14:17:17.055 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.055 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:17.056 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:17.056 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:17.056 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:17.056 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:17.056 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:17.056 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:17.056 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:17.056 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:17.057 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:17.057 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:17.057 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:17.057 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root 0r FIFO 0,13 0t0 131270 pipe 2020-04-22T14:17:17.057 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:17.057 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:17.057 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root 3r REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:17.058 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root 4u unix 0x000000002c9e76e0 0t0 137481 type=STREAM 2020-04-22T14:17:17.058 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root 5u netlink 0t0 134874 AUDIT 2020-04-22T14:17:17.058 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root 6r REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:17.058 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root 7r REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:17.058 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root 9u unix 0x00000000ca121092 0t0 134877 type=DGRAM 2020-04-22T14:17:17.058 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root 10r FIFO 0,13 0t0 134880 pipe 2020-04-22T14:17:17.058 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33054 root 11w FIFO 0,13 0t0 134880 pipe 2020-04-22T14:17:17.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 14w REG 8,1 135814872 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.077 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.077 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.077 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.077 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.077 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.077 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.077 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.078 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.078 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.078 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.078 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.079 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.085 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.085 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.085 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.085 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.085 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.085 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.085 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 14w REG 8,1 135814404 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33086 log root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 14w REG 8,1 135814404 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33087 msgr-work root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 14w REG 8,1 135814404 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.136 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.136 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.137 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.137 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.138 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.138 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.138 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.138 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.138 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.139 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.139 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.139 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.139 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.139 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.139 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.139 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.140 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.140 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.140 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.140 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.140 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.141 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.141 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33088 msgr-work root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 14w REG 8,1 135814404 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33089 msgr-work root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 14w REG 8,1 135814404 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33094 service root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 14w REG 8,1 135814404 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33095 admin_soc root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 14w REG 8,1 135814638 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33198 signal_ha root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 14w REG 8,1 135814638 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33210 OpHistory root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 14w REG 8,1 135814638 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33211 ceph-osd root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 14w REG 8,1 135814638 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33212 safe_time root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 14w REG 8,1 135814638 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33213 safe_time root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 14w REG 8,1 135814638 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33214 safe_time root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 14w REG 8,1 135814638 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33215 safe_time root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 14w REG 8,1 135814638 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33216 fn_anonym root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 14w REG 8,1 135814638 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33221 rocksdb:l root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 14w REG 8,1 135814638 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33222 rocksdb:l root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 14w REG 8,1 135814638 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33223 rocksdb:h root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 14w REG 8,1 135814638 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33388 bstore_ai root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 14w REG 8,1 135814638 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33389 bstore_di root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 14w REG 8,1 135814638 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33470 bstore_ai root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.526 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.526 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.526 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.526 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.526 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.526 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.526 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 14w REG 8,1 135814638 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.526 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33471 bstore_di root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 14w REG 8,1 135814638 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33472 ceph-osd root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 14w REG 8,1 135814638 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.577 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.577 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.577 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.577 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.577 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.577 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.577 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.577 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.578 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.578 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.578 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.578 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.578 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.578 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.578 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.579 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.579 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.579 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.579 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.579 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.579 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.579 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.580 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.580 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.580 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.580 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.580 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.580 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.580 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.580 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.581 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33488 rocksdb:d root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.581 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.581 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.581 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.581 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.581 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.581 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 14w REG 8,1 135814638 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33489 rocksdb:p root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 14w REG 8,1 135814638 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33490 cfin root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 14w REG 8,1 135814638 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.641 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.641 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.641 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.641 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.641 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.641 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.641 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.642 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.642 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.642 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.642 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.642 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.642 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.642 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.642 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.643 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.643 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.643 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.643 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.643 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.643 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.643 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.643 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.644 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.644 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.644 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.644 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.644 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.644 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.644 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.645 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.645 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.645 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.645 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33491 bstore_kv root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.645 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.645 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.645 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.646 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.646 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.646 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.646 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.646 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.646 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.646 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.647 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.647 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.647 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.647 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.647 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.647 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.647 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.647 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.648 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.648 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.648 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.648 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.648 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.648 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.648 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.649 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.649 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.649 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.649 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.649 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.649 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.649 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.650 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.650 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.650 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.650 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.650 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.650 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.650 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.651 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.651 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.651 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.651 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.651 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.651 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.651 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.651 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.652 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.652 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.652 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.652 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.652 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.652 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.652 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.653 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.653 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.653 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.653 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.653 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.653 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.653 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.653 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.654 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.654 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.654 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.654 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.654 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.654 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.654 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.655 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.655 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.655 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.655 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 14w REG 8,1 135814638 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.655 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.655 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.655 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.655 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.656 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.656 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.656 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.656 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.656 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.656 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.656 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.657 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.657 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.657 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.657 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.657 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.657 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.657 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.658 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.658 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.658 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.658 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.658 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.658 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.658 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.658 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.659 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.659 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.659 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.659 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.659 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.659 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.659 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.660 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.660 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.660 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.660 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.660 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.660 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.660 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.661 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.661 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.661 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.661 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.661 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.661 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.661 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.661 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.662 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.662 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.662 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.662 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.662 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.662 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.662 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.663 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.663 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.663 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.663 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.663 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.663 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.663 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.663 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.664 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.664 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.664 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.664 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.664 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.664 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.664 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.665 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.665 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.665 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.665 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.665 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.665 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.665 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.666 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.666 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.666 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.666 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.666 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.666 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.666 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33492 bstore_kv root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.667 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.667 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.667 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.667 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.667 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.667 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.667 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.667 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.668 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.668 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.668 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.668 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.668 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.668 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.668 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.669 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.669 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.669 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.669 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.669 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.669 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.669 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.670 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.670 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.670 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.670 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.670 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.670 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.670 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.671 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.671 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.671 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.671 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.671 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.671 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.671 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.671 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.672 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.672 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.672 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.672 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.672 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.672 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.672 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.673 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.673 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.673 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.673 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.673 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.673 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.673 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 14w REG 8,1 135814638 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.681 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.681 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.681 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.681 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.681 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.681 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.681 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33493 bstore_me root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.689 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.689 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.689 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.689 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.689 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 14w REG 8,1 135814638 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.705 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.705 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.705 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.705 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.705 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.705 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33494 ms_dispat root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 14w REG 8,1 135814638 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.724 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.724 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.724 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.724 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.724 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.724 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.724 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.731 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.731 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33495 ms_local root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.731 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.731 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.731 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.731 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.731 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 14w REG 8,1 135814638 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.745 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.745 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.745 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.745 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.745 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.745 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.745 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.752 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.752 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33496 safe_time root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.752 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.752 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.752 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.752 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.752 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.752 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.753 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.753 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.753 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.753 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.753 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.753 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.753 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.754 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.754 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.754 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.754 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.754 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.754 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.754 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.754 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.755 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.755 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.755 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.755 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.755 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.755 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.755 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.756 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.756 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.756 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.756 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.756 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.756 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.756 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.757 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.757 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.757 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.757 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.757 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.757 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.757 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.757 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.758 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.758 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.758 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.758 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.758 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.758 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.758 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.759 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.759 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.759 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.759 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.759 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.759 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.759 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.760 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.760 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.760 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.760 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.760 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.760 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.760 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.760 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.761 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.761 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.761 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.761 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.761 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.761 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.761 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.761 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 14w REG 8,1 135814638 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.762 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.762 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.762 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.762 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.762 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.762 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.762 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.763 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.763 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.763 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.763 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.763 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.763 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.763 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.763 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.764 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.764 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.764 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.764 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.764 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.764 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.764 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.765 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.765 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.765 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.765 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.765 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.765 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.765 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.765 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.766 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.766 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.766 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.766 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.766 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.766 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.766 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.766 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.767 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.767 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.767 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.767 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.767 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.767 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.767 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.768 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.768 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.768 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.768 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.768 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.768 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.768 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.769 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.769 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.769 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.769 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.769 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.769 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.769 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.770 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.770 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.770 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.770 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.770 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.770 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.770 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.771 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.771 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.771 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.771 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.771 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.771 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.771 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.771 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.772 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.772 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.772 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.772 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.772 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.772 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.772 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.773 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.773 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.773 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33497 fn_anonym root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.773 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.773 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.773 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.773 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.773 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.774 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.774 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.774 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.774 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.774 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.774 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.774 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.775 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.775 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.775 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.775 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.775 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.775 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.775 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.776 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.776 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.776 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.776 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.776 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.776 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.776 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.776 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.777 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.777 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.777 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.777 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.777 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.777 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.777 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 14w REG 8,1 135814638 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33498 safe_time root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 14w REG 8,1 135814638 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33499 ms_dispat root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 14w REG 8,1 135814638 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33500 ms_local root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 14w REG 8,1 135814638 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33501 ms_dispat root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 14w REG 8,1 135814638 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33502 ms_local root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 14w REG 8,1 135814638 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33503 ms_dispat root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 14w REG 8,1 135814638 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33504 ms_local root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 14w REG 8,1 135814638 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33505 ms_dispat root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:17.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:17.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:17.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:17.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:17.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:17.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:17.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:17.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:17.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:17.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:17.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:17.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:17.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:17.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:17.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:17.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:17.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:17.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:17.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:17.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:17.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:17.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:17.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:17.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:17.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:17.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:17.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:17.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:17.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:17.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:17.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:17.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:17.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:17.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:17.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:17.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:17.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:17.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:17.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:17.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:17.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:17.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:17.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:17.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:17.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:17.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:17.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:17.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:17.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:17.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:17.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 14w REG 8,1 135814872 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:17.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:17.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:17.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:17.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:17.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:17.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:17.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:17.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:17.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:17.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:17.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:17.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:17.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:17.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:17.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:17.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:17.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:17.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:17.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:17.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:17.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:17.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:17.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:17.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:17.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:17.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:17.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:17.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:17.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:17.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:17.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:17.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:17.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:17.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:17.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:17.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:17.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:17.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:17.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:17.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:17.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:17.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:17.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:17.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:17.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:17.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:17.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:17.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:17.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:17.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:17.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:17.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:17.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:17.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:17.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:17.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33506 ms_local root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:17.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:17.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:17.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:17.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:17.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:17.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:17.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:17.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:17.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:17.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:17.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:17.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:17.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:17.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:17.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:17.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:18.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:18.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:18.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:18.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 14w REG 8,1 135814872 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:18.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:18.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:18.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:18.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:18.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:18.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:18.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:18.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:18.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:18.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:18.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:18.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:18.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:18.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:18.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:18.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:18.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:18.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:18.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:18.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:18.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:18.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:18.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:18.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:18.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:18.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:18.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:18.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:18.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:18.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:18.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:18.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:18.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:18.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33507 ms_dispat root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:18.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:18.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:18.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:18.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 14w REG 8,1 135814872 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:18.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:18.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:18.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:18.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:18.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:18.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:18.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:18.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:18.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:18.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:18.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:18.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:18.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:18.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:18.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:18.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:18.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:18.036 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:18.036 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:18.036 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.036 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.036 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.036 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.036 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:18.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:18.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:18.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:18.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:18.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:18.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:18.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:18.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:18.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:18.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:18.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:18.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:18.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:18.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33508 ms_local root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:18.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:18.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:18.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:18.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 14w REG 8,1 135814872 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:18.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:18.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:18.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:18.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:18.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:18.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:18.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:18.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:18.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:18.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:18.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:18.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:18.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:18.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:18.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:18.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:18.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:18.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:18.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:18.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:18.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:18.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:18.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:18.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:18.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:18.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:18.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:18.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:18.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:18.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:18.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:18.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:18.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:18.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33509 ms_dispat root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:18.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:18.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:18.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:18.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 14w REG 8,1 135814872 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:18.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:18.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:18.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:18.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:18.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:18.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:18.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:18.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:18.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:18.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:18.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:18.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:18.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.077 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.077 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.077 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.077 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.077 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.077 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.078 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.078 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.078 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.078 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.078 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.078 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:18.078 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:18.078 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:18.079 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:18.079 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:18.079 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:18.079 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:18.079 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.079 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.079 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:18.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:18.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:18.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:18.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:18.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:18.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:18.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:18.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:18.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:18.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:18.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:18.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:18.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:18.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33510 ms_local root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.085 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.085 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.085 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.085 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.085 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.085 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.085 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:18.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:18.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:18.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:18.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 14w REG 8,1 135814872 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:18.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:18.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:18.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:18.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:18.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:18.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:18.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:18.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:18.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:18.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:18.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:18.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:18.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:18.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:18.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:18.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:18.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:18.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:18.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:18.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:18.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:18.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:18.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:18.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:18.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:18.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:18.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:18.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:18.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:18.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:18.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:18.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:18.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:18.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33511 fn_anonym root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:18.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:18.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:18.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:18.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 14w REG 8,1 135814872 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:18.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:18.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:18.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:18.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:18.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:18.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:18.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:18.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:18.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:18.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:18.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:18.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:18.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:18.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:18.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:18.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:18.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:18.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:18.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:18.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:18.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:18.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:18.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:18.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:18.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:18.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:18.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:18.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:18.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:18.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:18.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:18.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:18.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:18.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33512 finisher root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:18.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:18.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:18.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:18.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.136 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.136 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.136 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 14w REG 8,1 135814872 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:18.136 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:18.136 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.136 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.136 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:18.136 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:18.137 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:18.137 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:18.137 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:18.137 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:18.137 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:18.137 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:18.137 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:18.138 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.138 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.138 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.138 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.138 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:18.138 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:18.138 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.139 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.139 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.139 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.139 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.139 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.139 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.139 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.139 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.140 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.140 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.140 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.140 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.140 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.140 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.141 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.141 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.141 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.141 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.141 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.141 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.141 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.141 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:18.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:18.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:18.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:18.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:18.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:18.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:18.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:18.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:18.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:18.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:18.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:18.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:18.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:18.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:18.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:18.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:18.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:18.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:18.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:18.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:18.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33513 safe_time root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:18.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:18.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:18.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:18.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 14w REG 8,1 135814872 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:18.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:18.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:18.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:18.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:18.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:18.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:18.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:18.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:18.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:18.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:18.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:18.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:18.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:18.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:18.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:18.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:18.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:18.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:18.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:18.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:18.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:18.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:18.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:18.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:18.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:18.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:18.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:18.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:18.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:18.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:18.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:18.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:18.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:18.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33514 safe_time root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:18.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:18.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:18.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:18.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 14w REG 8,1 135814872 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:18.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:18.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:18.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:18.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:18.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:18.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:18.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:18.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:18.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:18.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:18.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:18.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:18.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:18.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:18.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:18.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:18.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:18.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:18.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:18.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:18.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:18.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:18.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:18.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:18.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:18.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:18.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:18.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:18.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:18.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:18.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:18.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:18.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:18.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33515 ceph-osd root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:18.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:18.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:18.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:18.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 14w REG 8,1 135814872 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:18.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:18.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:18.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:18.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:18.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:18.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:18.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:18.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:18.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:18.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:18.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:18.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:18.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:18.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:18.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:18.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:18.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:18.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:18.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:18.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:18.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:18.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:18.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:18.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:18.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:18.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:18.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:18.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:18.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:18.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:18.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:18.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:18.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:18.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33516 osd_srv_a root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:18.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:18.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:18.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:18.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 14w REG 8,1 135814872 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:18.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:18.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:18.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:18.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:18.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:18.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:18.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:18.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:18.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:18.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:18.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:18.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:18.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:18.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:18.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:18.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:18.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:18.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:18.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:18.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:18.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:18.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:18.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:18.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:18.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:18.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:18.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:18.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:18.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:18.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:18.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:18.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:18.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:18.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33517 tp_osd_tp root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:18.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:18.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:18.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:18.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 14w REG 8,1 135814872 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:18.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:18.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:18.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:18.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:18.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:18.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:18.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:18.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:18.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:18.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:18.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:18.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:18.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:18.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:18.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:18.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:18.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:18.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:18.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:18.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:18.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:18.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:18.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:18.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:18.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:18.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:18.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:18.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:18.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:18.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:18.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:18.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:18.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:18.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33518 tp_osd_tp root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:18.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:18.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:18.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:18.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 14w REG 8,1 135814872 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:18.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:18.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:18.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:18.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:18.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:18.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:18.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:18.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:18.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:18.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:18.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:18.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:18.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:18.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:18.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:18.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:18.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:18.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:18.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:18.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:18.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:18.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:18.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:18.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:18.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:18.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:18.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:18.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:18.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:18.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:18.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:18.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:18.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:18.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33519 tp_osd_tp root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:18.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:18.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:18.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:18.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 14w REG 8,1 135814872 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:18.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:18.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:18.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:18.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:18.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:18.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:18.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:18.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:18.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:18.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:18.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:18.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:18.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:18.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:18.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:18.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:18.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:18.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:18.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:18.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:18.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:18.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:18.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:18.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:18.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:18.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:18.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:18.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:18.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:18.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:18.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:18.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:18.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:18.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33520 tp_osd_tp root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:18.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:18.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:18.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:18.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 14w REG 8,1 135814872 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:18.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:18.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:18.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:18.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:18.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:18.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:18.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:18.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:18.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:18.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:18.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:18.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:18.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:18.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:18.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:18.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:18.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:18.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:18.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:18.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:18.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:18.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:18.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:18.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:18.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:18.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:18.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:18.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:18.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:18.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:18.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:18.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:18.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:18.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33521 tp_osd_tp root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:18.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:18.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:18.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:18.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 14w REG 8,1 135814872 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:18.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:18.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:18.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:18.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:18.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:18.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:18.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:18.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:18.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:18.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:18.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:18.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:18.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:18.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:18.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:18.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:18.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:18.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:18.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:18.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:18.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:18.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:18.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:18.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:18.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:18.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:18.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:18.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:18.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:18.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:18.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:18.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:18.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:18.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33522 tp_osd_tp root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:18.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:18.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:18.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:18.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 14w REG 8,1 135814872 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:18.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:18.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:18.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:18.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:18.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:18.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:18.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:18.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:18.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:18.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:18.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:18.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:18.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:18.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:18.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:18.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:18.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:18.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:18.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:18.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:18.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:18.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:18.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:18.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:18.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:18.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:18.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:18.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:18.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:18.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:18.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:18.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:18.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:18.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33523 tp_osd_tp root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:18.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:18.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:18.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:18.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 14w REG 8,1 135814872 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:18.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:18.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:18.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:18.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:18.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:18.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:18.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:18.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:18.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:18.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:18.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:18.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:18.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:18.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:18.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:18.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:18.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:18.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:18.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:18.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:18.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:18.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:18.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:18.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:18.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:18.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:18.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:18.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:18.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:18.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:18.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:18.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:18.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:18.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33524 tp_osd_tp root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:18.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:18.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:18.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:18.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 14w REG 8,1 135814872 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:18.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:18.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:18.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:18.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:18.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:18.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:18.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:18.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:18.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:18.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:18.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:18.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:18.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:18.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:18.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:18.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:18.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:18.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:18.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:18.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:18.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:18.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:18.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:18.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:18.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:18.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:18.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:18.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:18.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:18.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:18.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:18.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:18.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:18.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33525 tp_osd_tp root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:18.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:18.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:18.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:18.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 14w REG 8,1 135814872 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:18.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:18.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:18.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:18.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:18.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:18.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:18.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:18.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:18.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:18.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:18.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:18.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:18.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:18.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:18.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:18.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:18.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:18.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:18.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:18.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:18.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:18.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:18.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:18.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:18.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:18.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:18.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:18.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:18.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:18.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:18.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:18.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:18.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:18.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33526 tp_osd_tp root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:18.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:18.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:18.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:18.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 14w REG 8,1 135814872 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:18.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:18.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:18.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:18.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:18.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:18.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:18.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:18.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:18.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:18.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:18.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:18.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:18.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:18.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:18.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:18.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:18.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:18.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:18.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:18.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:18.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:18.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:18.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:18.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:18.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:18.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:18.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:18.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:18.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:18.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:18.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:18.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:18.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:18.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33527 tp_osd_tp root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:18.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:18.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:18.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:18.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 14w REG 8,1 135814872 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:18.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:18.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:18.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:18.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:18.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:18.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:18.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:18.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:18.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:18.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:18.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:18.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:18.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:18.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:18.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:18.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:18.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:18.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:18.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:18.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:18.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:18.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:18.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:18.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:18.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:18.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:18.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:18.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:18.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:18.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:18.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:18.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:18.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:18.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33528 tp_osd_tp root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:18.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:18.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:18.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:18.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 14w REG 8,1 135814872 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:18.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:18.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:18.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:18.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:18.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:18.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:18.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:18.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:18.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:18.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:18.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:18.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:18.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:18.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:18.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:18.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:18.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:18.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:18.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:18.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:18.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:18.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:18.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:18.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:18.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:18.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:18.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:18.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:18.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:18.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:18.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:18.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:18.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:18.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33529 tp_osd_tp root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:18.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:18.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:18.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:18.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 14w REG 8,1 135814872 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:18.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:18.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:18.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:18.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:18.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:18.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:18.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:18.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:18.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:18.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:18.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:18.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:18.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:18.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:18.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:18.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:18.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:18.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:18.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:18.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:18.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:18.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:18.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:18.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:18.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:18.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:18.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:18.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:18.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:18.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:18.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:18.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:18.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:18.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33530 tp_osd_tp root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:18.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:18.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:18.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:18.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 14w REG 8,1 135814872 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:18.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:18.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:18.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:18.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:18.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:18.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:18.526 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:18.526 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:18.526 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:18.526 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:18.526 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.526 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.526 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.526 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:18.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:18.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:18.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:18.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:18.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:18.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:18.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:18.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:18.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:18.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:18.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:18.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:18.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:18.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:18.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:18.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:18.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:18.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:18.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:18.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:18.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:18.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:18.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33531 tp_osd_tp root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:18.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:18.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:18.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:18.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 14w REG 8,1 135814872 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:18.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:18.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:18.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:18.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:18.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:18.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:18.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:18.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:18.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:18.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:18.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:18.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:18.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:18.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:18.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:18.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:18.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:18.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:18.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:18.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:18.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:18.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:18.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:18.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:18.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:18.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:18.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:18.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:18.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:18.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:18.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:18.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:18.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:18.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33532 tp_osd_tp root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root DEL REG 0,18 129559 /[aio] 2020-04-22T14:17:18.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root DEL REG 0,18 136438 /[aio] 2020-04-22T14:17:18.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 1w FIFO 0,13 0t0 133349 pipe 2020-04-22T14:17:18.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 2w FIFO 0,13 0t0 133350 pipe 2020-04-22T14:17:18.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 3r FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 4w FIFO 0,13 0t0 131277 pipe 2020-04-22T14:17:18.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 6r FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 7w FIFO 0,13 0t0 131278 pipe 2020-04-22T14:17:18.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 9r FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 10w FIFO 0,13 0t0 131279 pipe 2020-04-22T14:17:18.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 12r FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 13w FIFO 0,13 0t0 131280 pipe 2020-04-22T14:17:18.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 14w REG 8,1 135814872 526775 /var/log/ceph/ceph-osd.0.log 2020-04-22T14:17:18.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 15uW REG 0,24 6 131281 /run/ceph/ceph-osd.0.pid 2020-04-22T14:17:18.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 16r FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 17w FIFO 0,13 0t0 131282 pipe 2020-04-22T14:17:18.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 18u unix 0x00000000309dabe6 0t0 131283 /var/run/ceph/ceph-osd.0.asok type=STREAM 2020-04-22T14:17:18.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 19u IPv4 134883 0t0 TCP *:6800 (LISTEN) 2020-04-22T14:17:18.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 20u IPv4 134885 0t0 TCP *:acnet (LISTEN) 2020-04-22T14:17:18.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 21u IPv4 134888 0t0 TCP *:6802 (LISTEN) 2020-04-22T14:17:18.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 22u IPv4 134892 0t0 TCP *:6803 (LISTEN) 2020-04-22T14:17:18.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 23u IPv4 134897 0t0 TCP *:6804 (LISTEN) 2020-04-22T14:17:18.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 24u IPv4 134903 0t0 TCP *:6805 (LISTEN) 2020-04-22T14:17:18.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 25u IPv4 134910 0t0 TCP *:6806 (LISTEN) 2020-04-22T14:17:18.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 26u IPv4 134918 0t0 TCP *:6807 (LISTEN) 2020-04-22T14:17:18.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 27r FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 28w FIFO 0,13 0t0 131361 pipe 2020-04-22T14:17:18.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 29r FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 30w FIFO 0,13 0t0 131362 pipe 2020-04-22T14:17:18.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 31r DIR 253,1 191 64 /var/lib/ceph/osd/ceph-0 2020-04-22T14:17:18.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 32uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-0/fsid 2020-04-22T14:17:18.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 33uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 34uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 35uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 36uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 37uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 38uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 39uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 40uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 41uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 42uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 43uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 44uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 45uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 46uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 47uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 48uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 49uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 50uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 51uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 52uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 53uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 54uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 55uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 56uW REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2020-04-22T14:17:18.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 57r FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 58w FIFO 0,13 0t0 132577 pipe 2020-04-22T14:17:18.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 59u IPv4 135830 0t0 TCP smithi103:46588->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 60r FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 61w FIFO 0,13 0t0 132578 pipe 2020-04-22T14:17:18.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 62u IPv4 131558 0t0 TCP smithi103:6804->smithi103:43776 (ESTABLISHED) 2020-04-22T14:17:18.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 63u IPv4 131559 0t0 TCP smithi103:6804->smithi103:43780 (ESTABLISHED) 2020-04-22T14:17:18.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 64u IPv4 131561 0t0 TCP smithi103:51506->smithi103:6810 (ESTABLISHED) 2020-04-22T14:17:18.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 65u IPv4 135839 0t0 TCP smithi103:54358->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:18.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 66u IPv4 131564 0t0 TCP smithi103:6806->smithi103:46386 (ESTABLISHED) 2020-04-22T14:17:18.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 67u IPv4 131565 0t0 TCP smithi103:6806->smithi103:46400 (ESTABLISHED) 2020-04-22T14:17:18.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 68u IPv4 131568 0t0 TCP smithi103:55978->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:18.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 69u IPv4 131569 0t0 TCP smithi103:43808->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 70u IPv4 135842 0t0 TCP smithi103:43348->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 71u IPv4 131570 0t0 TCP smithi103:51900->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 72u IPv4 133468 0t0 TCP smithi103:41304->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 73u IPv4 133469 0t0 TCP smithi103:43302->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 74u IPv4 131571 0t0 TCP smithi103:6804->smithi103:43820 (ESTABLISHED) 2020-04-22T14:17:18.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 75u IPv4 136538 0t0 TCP smithi103:6806->smithi103:46438 (ESTABLISHED) 2020-04-22T14:17:18.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 76u IPv4 133487 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54688 (ESTABLISHED) 2020-04-22T14:17:18.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 77u IPv4 133490 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34796 (ESTABLISHED) 2020-04-22T14:17:18.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 78u IPv4 131575 0t0 TCP smithi103:41680->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 79u IPv4 137589 0t0 TCP smithi103:36696->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 80u IPv4 132603 0t0 TCP smithi103:47830->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 81u IPv4 131576 0t0 TCP smithi103:56186->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 82u IPv4 132604 0t0 TCP smithi103:52750->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 83u IPv4 137590 0t0 TCP smithi103:53964->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 84u IPv4 131577 0t0 TCP smithi103:60182->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 85u IPv4 137591 0t0 TCP smithi103:46810->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 86u IPv4 132605 0t0 TCP smithi103:53292->smithi086.front.sepia.ceph.com:6828 (ESTABLISHED) 2020-04-22T14:17:18.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 87u IPv4 136543 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34808 (ESTABLISHED) 2020-04-22T14:17:18.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 88u IPv4 133496 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54722 (ESTABLISHED) 2020-04-22T14:17:18.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 89u IPv4 131581 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34838 (ESTABLISHED) 2020-04-22T14:17:18.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 90u IPv4 131584 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54734 (ESTABLISHED) 2020-04-22T14:17:18.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 91u IPv4 131593 0t0 TCP smithi103:6804->smithi086.front.sepia.ceph.com:54764 (ESTABLISHED) 2020-04-22T14:17:18.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 92u IPv4 131599 0t0 TCP smithi103:6806->smithi086.front.sepia.ceph.com:34890 (ESTABLISHED) 2020-04-22T14:17:18.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 94u IPv4 135863 0t0 TCP smithi103:54042->smithi086.front.sepia.ceph.com:6820 (ESTABLISHED) 2020-04-22T14:17:18.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 95u IPv4 135856 0t0 TCP smithi103:49368->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 96u IPv4 135857 0t0 TCP smithi103:48236->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 98u IPv4 135859 0t0 TCP smithi103:6802->smithi086.front.sepia.ceph.com:59146 (ESTABLISHED) 2020-04-22T14:17:18.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 99u IPv4 310187 0t0 TCP smithi103:6800->192.168.0.2:45440 (ESTABLISHED) 2020-04-22T14:17:18.577 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33072 33533 osd_srv_h root 101u IPv4 135029 0t0 TCP smithi103:34932->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.577 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33100 root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.577 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33100 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.577 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33100 root txt REG 8,1 15496 6602 /usr/libexec/platform-python3.6 2020-04-22T14:17:18.577 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33100 root mem REG 8,1 59368 41092 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:18.577 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33100 root mem REG 8,1 16632 41078 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:18.577 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33100 root mem REG 8,1 52720 41084 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:18.578 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33100 root mem REG 8,1 37448 41100 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:18.578 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33100 root mem REG 8,1 19536 41090 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:18.578 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33100 root mem REG 8,1 23056 41069 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:18.578 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33100 root mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:18.578 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33100 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.578 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33100 root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.578 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33100 root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:18.578 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33100 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.579 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33100 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.579 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33100 root mem REG 8,1 3371672 6608 /usr/lib64/libpython3.6m.so.1.0 2020-04-22T14:17:18.579 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33100 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.579 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33100 root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:18.579 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33100 root mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:18.579 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33100 root mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:18.579 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33100 root mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:18.579 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33100 root mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:18.580 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33100 root mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:18.580 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33100 root mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:18.580 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33100 root mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:18.580 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33100 root mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:18.580 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33100 root mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:18.580 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33100 root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:18.580 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33100 root mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:18.580 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33100 root 0r FIFO 0,13 0t0 131270 pipe 2020-04-22T14:17:18.581 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33100 root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:18.581 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33100 root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:18.581 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.581 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.581 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root txt REG 8,1 207056 9178 /usr/bin/sudo 2020-04-22T14:17:18.581 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 16704 5754 /usr/lib64/libpam_misc.so.0.82.1 2020-04-22T14:17:18.581 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 855144 29339 /usr/lib64/security/pam_systemd.so 2020-04-22T14:17:18.582 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 24208 29040 /usr/lib64/security/pam_limits.so 2020-04-22T14:17:18.582 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 11888 29038 /usr/lib64/security/pam_keyinit.so 2020-04-22T14:17:18.582 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 46232 5216 /usr/lib64/libcrack.so.2.9.0 2020-04-22T14:17:18.582 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 25728 5682 /usr/lib64/libpwquality.so.1.0.2 2020-04-22T14:17:18.582 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 11896 29000 /usr/lib64/security/pam_pwquality.so 2020-04-22T14:17:18.582 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 7808 29049 /usr/lib64/security/pam_permit.so 2020-04-22T14:17:18.582 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 7704 29028 /usr/lib64/security/pam_deny.so 2020-04-22T14:17:18.582 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 68936 29798 /usr/lib64/security/pam_sss.so 2020-04-22T14:17:18.583 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 371032 5313 /usr/lib64/libtirpc.so.3.0.0 2020-04-22T14:17:18.583 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 116408 5315 /usr/lib64/libnsl.so.2.0.0 2020-04-22T14:17:18.583 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 61448 29065 /usr/lib64/security/pam_unix.so 2020-04-22T14:17:18.583 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 11912 29042 /usr/lib64/security/pam_localuser.so 2020-04-22T14:17:18.583 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 16088 29060 /usr/lib64/security/pam_succeed_if.so 2020-04-22T14:17:18.583 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 11880 29032 /usr/lib64/security/pam_faildelay.so 2020-04-22T14:17:18.583 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 20304 29030 /usr/lib64/security/pam_env.so 2020-04-22T14:17:18.583 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:18.584 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.584 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.584 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.584 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.584 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:18.584 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.584 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 860880 5511 /usr/lib64/libnss_systemd.so.2 2020-04-22T14:17:18.585 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:18.585 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:18.585 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 16240 3641 /usr/lib64/libkeyutils.so.1.6 2020-04-22T14:17:18.585 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 118728 5304 /usr/lib64/libkrb5support.so.0.1 2020-04-22T14:17:18.585 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 25992 3339 /usr/lib64/libcom_err.so.2.1 2020-04-22T14:17:18.585 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 273488 5296 /usr/lib64/libk5crypto.so.3.1 2020-04-22T14:17:18.585 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 1507952 5302 /usr/lib64/libkrb5.so.3.3 2020-04-22T14:17:18.586 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 603768 5292 /usr/lib64/libgssapi_krb5.so.2.2 2020-04-22T14:17:18.586 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 142712 3373 /usr/lib64/libcrypt.so.1.1.0 2020-04-22T14:17:18.586 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.586 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:18.586 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 149160 4994 /usr/lib64/libsasl2.so.3.0.0 2020-04-22T14:17:18.586 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.586 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.586 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 97056 5009 /usr/lib64/liblber-2.4.so.2.10.9 2020-04-22T14:17:18.587 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 477472 5011 /usr/lib64/libldap-2.4.so.2.10.9 2020-04-22T14:17:18.587 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 74600 5752 /usr/lib64/libpam.so.0.84.2 2020-04-22T14:17:18.587 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 549944 16572 /usr/libexec/sudo/sudoers.so 2020-04-22T14:17:18.587 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:18.587 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:18.587 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:18.587 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.588 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 25192 3584 /usr/lib64/libcap-ng.so.0.0.0 2020-04-22T14:17:18.588 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.588 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.588 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.588 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 182296 16569 /usr/libexec/sudo/libsudo_util.so.0.0.0 2020-04-22T14:17:18.588 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:18.588 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.589 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 141392 3586 /usr/lib64/libaudit.so.1.0.0 2020-04-22T14:17:18.589 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.589 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:18.589 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:18.589 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:18.589 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:18.589 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:18.589 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:18.590 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:18.590 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:18.590 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:18.590 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:18.590 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:18.590 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:18.590 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root 0r FIFO 0,13 0t0 132538 pipe 2020-04-22T14:17:18.591 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:18.591 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:18.591 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root 3r REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:18.591 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root 4u unix 0x000000001dedc034 0t0 133405 type=STREAM 2020-04-22T14:17:18.591 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root 5u netlink 0t0 133413 AUDIT 2020-04-22T14:17:18.591 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root 6r REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:18.591 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root 7r REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:18.591 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root 9u unix 0x00000000bf7ae1d1 0t0 133416 type=DGRAM 2020-04-22T14:17:18.592 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root 10r FIFO 0,13 0t0 133419 pipe 2020-04-22T14:17:18.592 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33102 root 11w FIFO 0,13 0t0 133419 pipe 2020-04-22T14:17:18.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:18.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:18.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:18.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:18.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:18.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:18.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:18.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:18.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:18.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:18.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:18.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:18.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 14w REG 8,1 140036833 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:18.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:18.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:18.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:18.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:18.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:18.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:18.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:18.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:18.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:18.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:18.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:18.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:18.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:18.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:18.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:18.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:18.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:18.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:18.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:18.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:18.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:18.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:18.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:18.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:18.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:18.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:18.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:18.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:18.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:18.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:18.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:18.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:18.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:18.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:18.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:18.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:18.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:18.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:18.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:18.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:18.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:18.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:18.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:18.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:18.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:18.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:18.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:18.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:18.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:18.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:18.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:18.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:18.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:18.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:18.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:18.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 14w REG 8,1 140036365 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:18.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:18.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:18.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:18.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:18.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:18.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:18.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:18.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:18.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:18.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:18.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:18.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:18.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:18.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:18.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:18.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:18.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:18.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:18.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:18.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:18.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:18.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:18.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:18.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:18.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:18.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:18.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:18.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:18.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:18.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:18.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:18.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:18.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:18.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:18.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:18.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:18.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:18.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:18.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:18.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:18.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:18.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:18.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33133 log root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:18.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.641 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.641 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.641 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.641 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.641 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.641 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.641 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.642 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.642 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.642 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.642 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.642 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.642 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.642 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.643 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.643 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.643 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:18.643 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:18.643 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.643 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:18.643 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:18.644 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:18.644 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:18.644 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.644 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:18.644 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:18.644 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.644 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:18.644 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:18.645 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.645 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:18.645 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:18.645 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 14w REG 8,1 140036365 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:18.645 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:18.645 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:18.645 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:18.646 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:18.646 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:18.646 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:18.646 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:18.646 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:18.646 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:18.646 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:18.646 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:18.647 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:18.647 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:18.647 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:18.647 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:18.647 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:18.647 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:18.647 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:18.648 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.648 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.648 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.648 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.648 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.648 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.648 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.648 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.649 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.649 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.649 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.649 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.649 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.649 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.650 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.650 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.650 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.650 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.650 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.650 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.650 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.651 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.651 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.651 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.651 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.651 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:18.651 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:18.651 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:18.651 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:18.652 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:18.652 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.652 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.652 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:18.652 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.652 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.652 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.653 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:18.653 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:18.653 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:18.653 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:18.653 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:18.653 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:18.653 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:18.654 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:18.654 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:18.654 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:18.654 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:18.654 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:18.654 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:18.654 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:18.654 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:18.655 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:18.655 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.655 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.655 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.655 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.655 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.655 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.656 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.656 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.656 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:18.656 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.656 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:18.656 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.657 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.657 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33134 msgr-work root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:18.657 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.657 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.657 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.657 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.657 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.657 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.658 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.658 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.658 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.658 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.658 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.658 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.658 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.659 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.659 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.659 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.659 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.659 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.659 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.659 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.660 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.660 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.660 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.660 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.660 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.660 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.660 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.660 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.661 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.661 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.661 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.661 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.661 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.661 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.661 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.662 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.662 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.662 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.662 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.662 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.662 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.662 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.662 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.663 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.663 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.663 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.663 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.663 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.663 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.663 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.663 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.664 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.664 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.664 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.664 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.664 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.664 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:18.664 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:18.665 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.665 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:18.665 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:18.665 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:18.665 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:18.665 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.665 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:18.665 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:18.666 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.666 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:18.666 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:18.666 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.666 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:18.666 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:18.666 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 14w REG 8,1 140036365 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:18.666 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:18.667 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:18.667 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:18.667 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:18.667 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:18.667 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:18.667 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:18.667 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:18.667 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:18.668 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:18.668 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:18.668 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:18.668 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:18.668 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:18.668 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:18.668 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:18.668 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:18.669 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:18.669 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.669 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.669 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.669 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.669 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.669 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.670 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.670 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.670 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.670 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.670 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.670 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.670 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.670 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.671 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.671 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.671 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.671 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.671 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.671 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.671 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.671 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.672 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.672 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.672 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.672 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:18.672 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:18.672 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:18.672 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:18.673 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:18.673 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.673 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.673 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:18.673 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.673 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.673 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.673 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:18.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:18.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:18.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:18.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:18.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:18.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:18.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:18.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:18.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:18.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:18.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:18.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:18.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:18.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:18.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:18.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:18.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:18.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33135 msgr-work root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:18.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.681 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.681 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.681 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.681 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.681 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.681 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.681 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:18.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:18.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:18.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:18.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:18.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:18.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:18.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:18.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:18.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:18.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:18.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:18.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 14w REG 8,1 140036365 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:18.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:18.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:18.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:18.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:18.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:18.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:18.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:18.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:18.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:18.689 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:18.689 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:18.689 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:18.689 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:18.689 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:18.689 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:18.689 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:18.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:18.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:18.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:18.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:18.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:18.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:18.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:18.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:18.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:18.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:18.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:18.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:18.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:18.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:18.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:18.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:18.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:18.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:18.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:18.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:18.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:18.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:18.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:18.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:18.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:18.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:18.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33136 msgr-work root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:18.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.705 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.705 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.705 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.705 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.705 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.705 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.705 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:18.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:18.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:18.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:18.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:18.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:18.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:18.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:18.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:18.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:18.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:18.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:18.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 14w REG 8,1 140036365 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:18.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:18.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:18.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:18.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:18.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:18.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:18.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:18.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:18.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:18.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:18.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:18.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:18.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:18.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:18.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:18.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:18.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:18.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:18.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:18.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:18.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:18.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:18.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:18.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:18.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:18.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:18.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:18.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:18.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:18.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:18.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:18.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:18.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:18.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:18.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:18.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:18.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:18.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:18.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:18.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:18.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:18.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:18.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33141 service root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:18.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.724 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.724 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.724 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.724 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.724 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.724 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.724 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:18.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:18.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:18.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:18.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:18.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:18.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:18.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:18.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:18.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:18.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:18.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:18.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 14w REG 8,1 140036365 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:18.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:18.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:18.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:18.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:18.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:18.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:18.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:18.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:18.731 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:18.731 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:18.731 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:18.731 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:18.731 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:18.731 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:18.731 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:18.731 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:18.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:18.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:18.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:18.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:18.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:18.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:18.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:18.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:18.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:18.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:18.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:18.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:18.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:18.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:18.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:18.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:18.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:18.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:18.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:18.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:18.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:18.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:18.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:18.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:18.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:18.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:18.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33142 admin_soc root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:18.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.745 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.745 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.745 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.745 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.745 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.745 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.745 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:18.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:18.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:18.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:18.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:18.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:18.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:18.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:18.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:18.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:18.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:18.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:18.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 14w REG 8,1 140036365 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:18.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:18.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:18.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:18.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:18.752 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:18.752 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:18.752 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:18.752 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:18.752 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:18.752 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:18.752 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:18.753 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:18.753 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:18.753 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:18.753 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:18.753 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:18.753 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:18.753 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:18.754 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.754 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.754 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.754 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.754 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.754 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.754 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.754 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.755 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.755 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.755 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.755 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.755 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.755 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.755 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.756 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.756 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.756 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.756 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.756 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.756 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.756 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.757 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.757 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.757 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.757 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:18.757 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:18.757 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:18.757 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:18.757 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:18.758 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.758 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.758 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:18.758 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.758 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.758 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.758 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:18.759 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:18.759 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:18.759 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:18.759 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:18.759 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:18.759 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:18.759 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:18.760 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:18.760 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:18.760 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:18.760 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:18.760 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:18.760 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:18.760 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:18.761 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:18.761 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.761 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.761 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.761 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.761 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.761 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.762 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.762 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.762 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:18.762 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.762 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:18.762 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.762 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.762 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33201 signal_ha root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:18.763 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.763 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.763 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.763 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.763 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.763 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.763 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.764 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.764 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.764 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.764 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.764 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.764 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.764 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.765 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.765 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.765 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.765 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.765 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.765 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.765 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.765 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.766 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.766 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.766 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.766 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.766 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.767 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.767 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.767 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.767 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.767 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.767 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.767 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.768 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.768 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.768 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.768 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.768 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.768 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.768 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.768 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.769 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.769 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.769 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.769 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.769 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.769 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.769 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.770 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.770 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.770 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.770 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.770 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.770 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.770 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.770 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:18.771 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:18.771 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.771 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:18.771 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:18.771 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:18.771 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:18.771 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.772 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:18.772 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:18.772 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.772 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:18.772 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:18.772 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.772 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:18.773 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:18.773 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 14w REG 8,1 140036365 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:18.773 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:18.773 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:18.773 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:18.773 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:18.773 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:18.773 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:18.774 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:18.774 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:18.774 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:18.774 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:18.774 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:18.774 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:18.774 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:18.774 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:18.775 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:18.775 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:18.775 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:18.775 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:18.775 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.775 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.775 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.776 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.776 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.776 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.776 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.776 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.776 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.776 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.777 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.777 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.777 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.777 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.777 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.777 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.777 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:18.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:18.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:18.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:18.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:18.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:18.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:18.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:18.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:18.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:18.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:18.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:18.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:18.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:18.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:18.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:18.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:18.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:18.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:18.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:18.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:18.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:18.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:18.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:18.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33241 OpHistory root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:18.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:18.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:18.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:18.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:18.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:18.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:18.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:18.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:18.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:18.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:18.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:18.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:18.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 14w REG 8,1 140036365 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:18.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:18.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:18.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:18.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:18.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:18.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:18.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:18.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:18.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:18.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:18.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:18.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:18.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:18.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:18.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:18.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:18.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:18.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:18.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:18.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:18.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:18.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:18.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:18.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:18.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:18.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:18.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:18.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:18.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:18.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:18.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:18.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:18.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:18.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:18.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:18.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:18.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:18.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:18.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:18.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:18.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:18.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:18.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33242 ceph-osd root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:18.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:18.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:18.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:18.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:18.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:18.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:18.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:18.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:18.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:18.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:18.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:18.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:18.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 14w REG 8,1 140036365 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:18.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:18.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:18.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:18.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:18.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:18.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:18.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:18.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:18.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:18.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:18.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:18.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:18.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:18.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:18.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:18.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:18.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:18.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:18.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:18.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:18.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:18.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:18.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:18.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:18.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:18.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:18.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:18.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:18.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:18.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:18.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:18.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:18.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:18.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:18.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:18.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:18.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:18.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:18.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:18.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:18.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:18.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:18.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33243 safe_time root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:18.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:18.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:18.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:18.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:18.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:18.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:18.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:18.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:18.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:18.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:18.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:18.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:18.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 14w REG 8,1 140036365 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:18.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:18.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:18.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:18.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:18.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:18.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:18.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:18.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:18.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:18.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:18.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:18.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:18.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:18.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:18.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:18.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:18.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:18.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:18.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:18.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:18.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:18.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:18.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:18.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:18.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:18.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:18.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:18.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:18.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:18.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:18.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:18.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:18.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:18.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:18.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:18.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:18.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:18.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:18.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:18.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:18.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:18.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:18.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33244 safe_time root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:18.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:18.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:18.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:18.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:18.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:18.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:18.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:18.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:18.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:18.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:18.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:18.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:18.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 14w REG 8,1 140036365 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:18.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:18.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:18.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:18.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:18.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:18.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:18.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:18.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:18.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:18.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:18.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:18.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:18.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:18.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:18.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:18.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:18.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:18.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:18.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:18.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:18.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:18.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:18.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:18.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:18.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:18.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:18.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:18.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:18.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:18.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:18.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:18.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:18.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:18.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:18.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:18.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:18.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:18.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:18.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:18.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:18.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:18.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:18.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33245 safe_time root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:18.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:18.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:18.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:18.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:18.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:18.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:18.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:18.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:18.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:18.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:18.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:18.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:18.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 14w REG 8,1 140036365 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:18.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:18.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:18.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:18.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:18.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:18.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:18.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:18.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:18.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:18.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:18.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:18.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:18.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:18.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:18.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:18.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:18.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:18.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:18.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:18.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:18.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:18.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:18.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:18.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:18.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:18.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:18.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:18.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:18.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:18.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:18.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:18.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:18.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:18.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:18.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:18.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:18.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:18.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:18.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:18.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:18.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:18.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:18.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33246 safe_time root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:18.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:18.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:18.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:18.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:18.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:18.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:18.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:18.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:18.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:18.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:18.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:18.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:18.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 14w REG 8,1 140036365 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:18.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:18.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:18.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:18.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:18.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:18.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:18.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:18.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:18.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:18.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:18.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:18.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:18.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:18.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:18.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:18.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:18.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:18.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:18.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.902 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.902 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.902 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.902 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.902 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.902 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.902 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.903 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.903 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.903 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.903 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.903 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.903 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.903 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:18.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:18.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:18.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:18.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:18.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:18.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.906 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.906 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.906 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:18.906 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:18.906 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:18.906 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:18.906 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:18.907 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:18.907 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:18.907 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:18.907 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:18.907 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:18.907 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:18.907 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:18.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:18.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:18.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:18.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:18.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:18.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:18.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33247 fn_anonym root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:18.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:18.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:18.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:18.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:18.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:18.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:18.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:18.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:18.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:18.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:18.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:18.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:18.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 14w REG 8,1 140036599 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:18.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:18.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:18.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:18.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:18.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:18.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:18.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:18.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:18.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:18.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:18.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:18.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:18.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:18.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:18.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:18.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:18.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:18.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:18.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:18.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:18.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:18.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:18.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:18.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:18.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:18.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:18.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:18.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:18.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:18.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:18.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:18.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:18.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:18.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:18.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:18.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:18.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:18.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:18.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:18.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:18.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:18.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:18.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33252 rocksdb:l root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:18.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:18.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:18.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:18.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:18.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:18.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:18.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:18.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:18.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:18.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:18.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:18.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:18.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 14w REG 8,1 140036599 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:18.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:18.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:18.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:18.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:18.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:18.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:18.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:18.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:18.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:18.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:18.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:18.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:18.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:18.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:18.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:18.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:18.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:18.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:18.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:18.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:18.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:18.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:18.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:18.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:18.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:18.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:18.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:18.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:18.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:18.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:18.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:18.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:18.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:18.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:18.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:18.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:18.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:18.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:18.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:18.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:18.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:18.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:18.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33253 rocksdb:l root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:18.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:18.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:18.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:18.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:18.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:18.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:18.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:18.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:18.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:18.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:18.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:18.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:18.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 14w REG 8,1 140036599 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:18.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:18.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:18.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:18.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:18.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:18.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:18.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:18.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:18.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:18.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:18.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:18.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:18.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:18.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:18.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:18.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:18.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:18.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:18.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:18.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:18.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:18.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:18.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:18.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:18.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:18.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:18.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:18.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:18.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:18.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:18.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:18.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:18.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:18.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:18.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:18.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:18.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:18.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:18.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:18.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:18.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:18.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:18.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33254 rocksdb:h root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:18.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:18.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:18.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:18.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:18.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:18.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:18.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:18.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:18.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:18.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:18.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:18.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:18.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:18.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:18.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:18.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:18.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:18.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:18.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:18.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:18.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:18.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:18.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:18.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:18.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:18.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:18.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:18.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:18.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:18.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:18.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 14w REG 8,1 140036599 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:18.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:18.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:18.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:18.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:18.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:18.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:18.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:18.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:18.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:18.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:18.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:18.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:18.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:18.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:18.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:18.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:18.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:18.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:18.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:18.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:18.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:18.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:18.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:18.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:18.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:18.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:18.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:18.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:18.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:18.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:18.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:18.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:18.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:18.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:18.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:18.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:18.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:18.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:18.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:18.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:18.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:18.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:18.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:18.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:18.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:18.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:18.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:18.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:18.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:18.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:18.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:18.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:18.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:18.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:18.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:18.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:18.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:18.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:18.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:18.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:18.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33408 bstore_ai root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:18.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:18.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:18.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:18.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:18.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:18.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:18.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:18.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:18.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:18.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:18.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:18.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:18.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:18.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:18.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:18.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:18.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:18.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:18.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:18.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:18.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:18.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:18.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:18.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:18.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:18.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:18.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:18.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:18.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:18.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:18.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:18.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:18.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:18.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:18.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:18.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:18.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:18.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:18.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:18.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:18.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 14w REG 8,1 140036599 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33409 bstore_di root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 14w REG 8,1 140036599 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33534 bstore_ai root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.036 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.036 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.036 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.036 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.036 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.036 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.036 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 14w REG 8,1 140036599 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33535 bstore_di root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 14w REG 8,1 140036599 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.077 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.077 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.077 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.077 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.077 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.077 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.077 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.078 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.078 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.078 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.078 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.078 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.078 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33536 ceph-osd root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.078 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.079 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.079 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.079 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.079 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.079 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.079 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.079 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.079 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.085 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.085 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.085 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.085 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.085 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.085 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.085 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 14w REG 8,1 140036599 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33552 rocksdb:d root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 14w REG 8,1 140036599 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33553 rocksdb:p root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 14w REG 8,1 140036599 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.136 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.136 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.136 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.136 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.136 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.136 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.136 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.136 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.137 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.137 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.137 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.137 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.137 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.137 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.137 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.138 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.138 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.138 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.138 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.138 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.138 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.138 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.139 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.139 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.139 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.139 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.139 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.139 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.139 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.140 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.140 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.140 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.140 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.140 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.140 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.140 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.140 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.141 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.141 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.141 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.141 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.141 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.141 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.141 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33554 cfin root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 14w REG 8,1 140036599 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33555 bstore_kv root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 14w REG 8,1 140036599 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33556 bstore_kv root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 14w REG 8,1 140036599 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33557 bstore_me root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 14w REG 8,1 140036599 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33558 ms_dispat root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 14w REG 8,1 140036599 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33559 ms_local root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 14w REG 8,1 140036599 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33560 safe_time root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 14w REG 8,1 140036599 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33561 fn_anonym root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 14w REG 8,1 140036599 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33562 safe_time root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 14w REG 8,1 140036599 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33563 ms_dispat root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 14w REG 8,1 140036599 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33564 ms_local root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 14w REG 8,1 140036599 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33565 ms_dispat root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 14w REG 8,1 140036599 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33566 ms_local root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 14w REG 8,1 140036599 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33567 ms_dispat root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 14w REG 8,1 140036599 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33568 ms_local root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 14w REG 8,1 140036599 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33569 ms_dispat root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 14w REG 8,1 140036599 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33570 ms_local root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 14w REG 8,1 140036599 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33571 ms_dispat root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 14w REG 8,1 140036599 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33572 ms_local root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.526 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 14w REG 8,1 140036599 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33573 ms_dispat root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 14w REG 8,1 140036599 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33574 ms_local root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 14w REG 8,1 140036599 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.577 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.577 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.577 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.577 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.577 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.577 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.577 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.577 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.578 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.578 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.578 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.578 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.578 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.578 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.579 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.579 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.579 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.579 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.579 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.579 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.579 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.580 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.580 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.580 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.580 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.580 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.580 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.580 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.580 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.581 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.581 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.581 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.581 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.581 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.581 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.581 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33575 fn_anonym root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 14w REG 8,1 140036599 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33576 finisher root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 14w REG 8,1 140036599 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33577 safe_time root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 14w REG 8,1 140036833 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.641 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.641 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.641 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.641 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.641 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.641 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.641 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.641 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.642 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.642 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.642 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.642 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.642 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.642 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.642 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.642 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.643 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.643 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.643 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.643 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.643 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.643 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.643 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.643 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.644 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.644 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.644 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.644 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.644 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.644 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.644 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.644 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.645 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.645 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.645 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.645 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.645 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.645 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.645 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33578 safe_time root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.646 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.646 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.646 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.646 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.646 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.646 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.646 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.646 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.647 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.647 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.647 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.647 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.647 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.647 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.647 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.647 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.648 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.648 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.648 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.648 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.648 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.648 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.648 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.649 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.649 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.649 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.649 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.649 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.649 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.649 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.649 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.650 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.650 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.650 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.650 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.650 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.650 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.650 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.650 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.651 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.651 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.651 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.651 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.651 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.651 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.651 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.651 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.652 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.652 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.652 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.652 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.652 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.652 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.652 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.652 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.653 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.653 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.653 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.653 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.653 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.653 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.653 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.654 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.654 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.654 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.654 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.654 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.654 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.654 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.654 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.655 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.655 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.655 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 14w REG 8,1 140036833 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.655 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.655 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.655 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.655 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.655 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.656 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.656 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.656 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.656 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.656 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.656 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.656 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.656 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.657 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.657 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.657 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.657 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.657 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.657 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.657 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.657 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.658 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.658 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.658 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.658 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.658 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.658 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.658 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.659 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.659 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.659 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.659 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.659 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.659 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.659 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.659 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.660 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.660 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.660 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.660 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.660 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.660 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.660 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.660 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.661 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.661 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.661 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.661 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.661 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.661 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.661 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.662 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.662 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.662 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.662 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.662 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.662 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.662 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.662 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.663 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.663 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.663 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.663 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.663 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.663 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.663 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.664 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.664 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.664 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.664 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.664 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.664 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.664 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.664 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.665 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.665 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.665 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.665 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.665 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.665 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.665 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.666 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.666 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.666 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33579 ceph-osd root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.666 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.666 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.666 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.666 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.666 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.667 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.667 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.667 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.667 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.667 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.667 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.667 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.668 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.668 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.668 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.668 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.668 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.668 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.668 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.669 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.669 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.669 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.669 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.669 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.669 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.669 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.669 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.670 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.670 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.670 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.670 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.670 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.670 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.670 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.671 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.671 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.671 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.671 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.671 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.671 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.671 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.671 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.672 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.672 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.672 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.672 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.672 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.672 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.672 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.672 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.673 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.673 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.673 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.673 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.673 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.673 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.673 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.673 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 14w REG 8,1 140036833 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.681 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.681 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.681 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.681 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.681 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.681 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.681 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33580 osd_srv_a root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.689 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.689 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.689 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.689 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.689 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.689 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.689 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.689 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 14w REG 8,1 140036833 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.705 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.705 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.705 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.705 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.705 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.705 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.705 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33581 tp_osd_tp root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 14w REG 8,1 140036833 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.724 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.724 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.724 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.724 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.724 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.724 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.724 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33582 tp_osd_tp root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.731 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.731 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.731 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.731 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 14w REG 8,1 140036833 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.745 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.745 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.745 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.745 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.745 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.745 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.745 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33583 tp_osd_tp root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.752 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 14w REG 8,1 140036833 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33584 tp_osd_tp root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 14w REG 8,1 140036833 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33585 tp_osd_tp root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 14w REG 8,1 140036833 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33586 tp_osd_tp root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 14w REG 8,1 140036833 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33587 tp_osd_tp root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 14w REG 8,1 140036833 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33588 tp_osd_tp root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 14w REG 8,1 140036833 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.902 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.902 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.902 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.902 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.902 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.902 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.903 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.903 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.903 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.903 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.903 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.903 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.903 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.903 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.906 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.906 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.906 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.906 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.906 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.906 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.906 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.907 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.907 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.907 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.907 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.907 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.907 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.907 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.907 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33589 tp_osd_tp root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 14w REG 8,1 140036833 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33590 tp_osd_tp root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 14w REG 8,1 140036833 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33591 tp_osd_tp root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 14w REG 8,1 140036833 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33592 tp_osd_tp root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:19.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:19.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:19.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:19.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:19.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:19.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:19.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:19.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:19.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:19.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 14w REG 8,1 140036833 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:19.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:19.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:19.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:19.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:19.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:19.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:19.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:19.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:19.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:19.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:19.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:19.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:19.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:19.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:19.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:19.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:19.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:19.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:19.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:19.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:19.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:19.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:19.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:19.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:19.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:19.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:19.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:19.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:19.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:19.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:19.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:19.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:19.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:19.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:19.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:19.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:19.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:19.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:19.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:19.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:19.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:19.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:19.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:19.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:19.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:19.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:19.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:19.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:19.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:19.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:19.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:19.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:19.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:19.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:19.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:19.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33593 tp_osd_tp root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:19.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:19.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:19.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:19.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:19.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:19.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:19.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:19.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:19.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:19.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:19.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:19.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:19.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:19.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:19.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:19.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:19.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:19.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:19.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:19.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:19.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:19.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:19.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:19.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:19.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:19.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:19.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:19.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:19.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:19.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:19.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:19.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:19.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:19.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:19.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:19.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:19.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:19.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:19.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:19.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:19.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:19.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:19.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:19.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:19.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:19.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:19.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:19.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:19.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:19.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:19.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:19.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:19.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:19.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:19.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:19.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:19.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:20.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:20.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:20.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:20.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:20.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:20.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:20.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:20.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:20.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:20.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:20.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:20.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 14w REG 8,1 140036833 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:20.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:20.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:20.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:20.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:20.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:20.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:20.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:20.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:20.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:20.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:20.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:20.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:20.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:20.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:20.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:20.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:20.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:20.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:20.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:20.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:20.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:20.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:20.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:20.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:20.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:20.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:20.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:20.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:20.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:20.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:20.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:20.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:20.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:20.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:20.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:20.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:20.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:20.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:20.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:20.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:20.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:20.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:20.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:20.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:20.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33594 tp_osd_tp root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:20.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:20.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:20.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:20.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:20.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:20.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:20.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:20.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:20.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:20.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:20.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:20.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:20.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 14w REG 8,1 140036833 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:20.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:20.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:20.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:20.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:20.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:20.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:20.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:20.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:20.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:20.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:20.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:20.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:20.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:20.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:20.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:20.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:20.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:20.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:20.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:20.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:20.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:20.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:20.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:20.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:20.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:20.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:20.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:20.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:20.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:20.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:20.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:20.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:20.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:20.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:20.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:20.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:20.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:20.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:20.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:20.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:20.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:20.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:20.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:20.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:20.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33595 tp_osd_tp root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:20.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.036 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.036 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.036 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.036 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.036 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.036 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.036 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:20.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:20.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:20.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:20.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:20.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:20.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:20.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:20.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:20.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:20.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:20.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:20.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 14w REG 8,1 140036833 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:20.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:20.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:20.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:20.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:20.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:20.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:20.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:20.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:20.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:20.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:20.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:20.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:20.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:20.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:20.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:20.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:20.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:20.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:20.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:20.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:20.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:20.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:20.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:20.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:20.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:20.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:20.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:20.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:20.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:20.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:20.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:20.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:20.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:20.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:20.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:20.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:20.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:20.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:20.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:20.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:20.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:20.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:20.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:20.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:20.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33596 tp_osd_tp root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:20.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root DEL REG 0,18 135831 /[aio] 2020-04-22T14:17:20.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root DEL REG 0,18 135828 /[aio] 2020-04-22T14:17:20.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 1w FIFO 0,13 0t0 131271 pipe 2020-04-22T14:17:20.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 2w FIFO 0,13 0t0 131272 pipe 2020-04-22T14:17:20.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 3r FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:20.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 4w FIFO 0,13 0t0 136380 pipe 2020-04-22T14:17:20.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 6r FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:20.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 7w FIFO 0,13 0t0 136381 pipe 2020-04-22T14:17:20.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 9r FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:20.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 10w FIFO 0,13 0t0 136382 pipe 2020-04-22T14:17:20.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 12r FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:20.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 13w FIFO 0,13 0t0 136383 pipe 2020-04-22T14:17:20.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 14w REG 8,1 140036833 526776 /var/log/ceph/ceph-osd.1.log 2020-04-22T14:17:20.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 15uW REG 0,24 6 135428 /run/ceph/ceph-osd.1.pid 2020-04-22T14:17:20.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 16r FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:20.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 17w FIFO 0,13 0t0 135429 pipe 2020-04-22T14:17:20.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 18u unix 0x00000000bc9fb057 0t0 135430 /var/run/ceph/ceph-osd.1.asok type=STREAM 2020-04-22T14:17:20.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 19u IPv4 131372 0t0 TCP *:6808 (LISTEN) 2020-04-22T14:17:20.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 20u IPv4 131382 0t0 TCP *:6809 (LISTEN) 2020-04-22T14:17:20.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 21u IPv4 131393 0t0 TCP *:6810 (LISTEN) 2020-04-22T14:17:20.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 22u IPv4 131405 0t0 TCP *:6811 (LISTEN) 2020-04-22T14:17:20.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 23u IPv4 131418 0t0 TCP *:6812 (LISTEN) 2020-04-22T14:17:20.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 24u IPv4 131432 0t0 TCP *:6813 (LISTEN) 2020-04-22T14:17:20.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 25u IPv4 131447 0t0 TCP *:6814 (LISTEN) 2020-04-22T14:17:20.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 26u IPv4 131463 0t0 TCP *:6815 (LISTEN) 2020-04-22T14:17:20.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 27r FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:20.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 28w FIFO 0,13 0t0 133448 pipe 2020-04-22T14:17:20.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 29r FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:20.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 30w FIFO 0,13 0t0 133449 pipe 2020-04-22T14:17:20.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 31r DIR 253,2 191 64 /var/lib/ceph/osd/ceph-1 2020-04-22T14:17:20.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 32uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-1/fsid 2020-04-22T14:17:20.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 33uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 34uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 35uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 36uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 37uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 38uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 39uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 40uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 41uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 42uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 43uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 44uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 45uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 46uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 47uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 48uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 49uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 50uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 51uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 52uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 53uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 54uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 55uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 56uW REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2020-04-22T14:17:20.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 57u IPv4 134927 0t0 TCP smithi103:46590->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:20.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 58r FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:20.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 59w FIFO 0,13 0t0 136449 pipe 2020-04-22T14:17:20.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 60r FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:20.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 61w FIFO 0,13 0t0 136450 pipe 2020-04-22T14:17:20.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 62u IPv4 136521 0t0 TCP smithi103:43780->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 63u IPv4 135834 0t0 TCP smithi103:43312->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:20.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 64u IPv4 136522 0t0 TCP smithi103:41268->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 65u IPv4 135836 0t0 TCP smithi103:46400->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 66u IPv4 135835 0t0 TCP smithi103:43784->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 67u IPv4 135840 0t0 TCP smithi103:43274->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:20.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 68u IPv4 135841 0t0 TCP smithi103:51878->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 69u IPv4 136527 0t0 TCP smithi103:6814->smithi103:55948 (ESTABLISHED) 2020-04-22T14:17:20.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 70u IPv4 136528 0t0 TCP smithi103:6814->smithi103:55956 (ESTABLISHED) 2020-04-22T14:17:20.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 71u IPv4 136531 0t0 TCP smithi103:6812->smithi103:54350 (ESTABLISHED) 2020-04-22T14:17:20.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 72u IPv4 132580 0t0 TCP smithi103:6812->smithi103:54358 (ESTABLISHED) 2020-04-22T14:17:20.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 73u IPv4 132581 0t0 TCP smithi103:6812->smithi103:54362 (ESTABLISHED) 2020-04-22T14:17:20.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 74u IPv4 132584 0t0 TCP smithi103:6810->smithi103:51506 (ESTABLISHED) 2020-04-22T14:17:20.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 75u IPv4 132587 0t0 TCP smithi103:6814->smithi103:55978 (ESTABLISHED) 2020-04-22T14:17:20.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 76u IPv4 135008 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:53950 (ESTABLISHED) 2020-04-22T14:17:20.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 77u IPv4 129682 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34372 (ESTABLISHED) 2020-04-22T14:17:20.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 78u IPv4 135017 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54004 (ESTABLISHED) 2020-04-22T14:17:20.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 79u IPv4 133500 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34408 (ESTABLISHED) 2020-04-22T14:17:20.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 80u IPv4 133503 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54020 (ESTABLISHED) 2020-04-22T14:17:20.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 81u IPv4 136549 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34432 (ESTABLISHED) 2020-04-22T14:17:20.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 82u IPv4 131602 0t0 TCP smithi103:6812->smithi086.front.sepia.ceph.com:34436 (ESTABLISHED) 2020-04-22T14:17:20.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 83u IPv4 137608 0t0 TCP smithi103:6814->smithi086.front.sepia.ceph.com:54052 (ESTABLISHED) 2020-04-22T14:17:20.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 84u IPv4 137611 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50908 (ESTABLISHED) 2020-04-22T14:17:20.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 85u IPv4 137616 0t0 TCP smithi103:60188->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 86u IPv4 132616 0t0 TCP smithi103:46816->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 87u IPv4 137617 0t0 TCP smithi103:52764->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 88u IPv4 132617 0t0 TCP smithi103:41704->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 89u IPv4 135027 0t0 TCP smithi103:53980->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 90u IPv4 135028 0t0 TCP smithi103:36722->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 91u IPv4 137618 0t0 TCP smithi103:47856->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 92u IPv4 132618 0t0 TCP smithi103:56212->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 93u IPv4 338969 0t0 TCP smithi103:6808->smithi086.front.sepia.ceph.com:37748 (ESTABLISHED) 2020-04-22T14:17:20.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 94u IPv4 133532 0t0 TCP smithi103:48248->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 97u IPv4 132624 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50920 (ESTABLISHED) 2020-04-22T14:17:20.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 98u IPv4 132627 0t0 TCP smithi103:49384->smithi103:6818 (ESTABLISHED) 2020-04-22T14:17:20.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 99u IPv4 132628 0t0 TCP smithi103:34944->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33103 33597 osd_srv_h root 101u IPv4 132629 0t0 TCP smithi103:6810->smithi086.front.sepia.ceph.com:50922 (ESTABLISHED) 2020-04-22T14:17:20.075 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33148 root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.075 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33148 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.075 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33148 root txt REG 8,1 15496 6602 /usr/libexec/platform-python3.6 2020-04-22T14:17:20.075 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33148 root mem REG 8,1 59368 41092 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:20.075 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33148 root mem REG 8,1 16632 41078 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:20.075 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33148 root mem REG 8,1 52720 41084 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:20.075 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33148 root mem REG 8,1 37448 41100 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:20.075 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33148 root mem REG 8,1 19536 41090 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:20.076 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33148 root mem REG 8,1 23056 41069 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:20.076 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33148 root mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:20.076 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33148 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.076 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33148 root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.076 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33148 root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:20.076 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33148 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.076 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33148 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.077 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33148 root mem REG 8,1 3371672 6608 /usr/lib64/libpython3.6m.so.1.0 2020-04-22T14:17:20.077 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33148 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.077 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33148 root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:20.077 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33148 root mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:20.077 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33148 root mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:20.077 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33148 root mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:20.077 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33148 root mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:20.077 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33148 root mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:20.078 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33148 root mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:20.078 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33148 root mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:20.078 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33148 root mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:20.078 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33148 root mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:20.078 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33148 root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:20.078 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33148 root mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:20.079 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33148 root 0r FIFO 0,13 0t0 132538 pipe 2020-04-22T14:17:20.079 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33148 root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.079 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33148 root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.079 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.079 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.079 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root txt REG 8,1 207056 9178 /usr/bin/sudo 2020-04-22T14:17:20.079 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 16704 5754 /usr/lib64/libpam_misc.so.0.82.1 2020-04-22T14:17:20.080 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 855144 29339 /usr/lib64/security/pam_systemd.so 2020-04-22T14:17:20.080 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 24208 29040 /usr/lib64/security/pam_limits.so 2020-04-22T14:17:20.080 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 11888 29038 /usr/lib64/security/pam_keyinit.so 2020-04-22T14:17:20.080 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 46232 5216 /usr/lib64/libcrack.so.2.9.0 2020-04-22T14:17:20.080 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 25728 5682 /usr/lib64/libpwquality.so.1.0.2 2020-04-22T14:17:20.080 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 11896 29000 /usr/lib64/security/pam_pwquality.so 2020-04-22T14:17:20.080 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 7808 29049 /usr/lib64/security/pam_permit.so 2020-04-22T14:17:20.080 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 7704 29028 /usr/lib64/security/pam_deny.so 2020-04-22T14:17:20.081 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 68936 29798 /usr/lib64/security/pam_sss.so 2020-04-22T14:17:20.081 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 371032 5313 /usr/lib64/libtirpc.so.3.0.0 2020-04-22T14:17:20.081 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 116408 5315 /usr/lib64/libnsl.so.2.0.0 2020-04-22T14:17:20.081 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 61448 29065 /usr/lib64/security/pam_unix.so 2020-04-22T14:17:20.081 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 11912 29042 /usr/lib64/security/pam_localuser.so 2020-04-22T14:17:20.081 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 16088 29060 /usr/lib64/security/pam_succeed_if.so 2020-04-22T14:17:20.081 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 11880 29032 /usr/lib64/security/pam_faildelay.so 2020-04-22T14:17:20.082 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 20304 29030 /usr/lib64/security/pam_env.so 2020-04-22T14:17:20.082 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:20.082 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.082 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.082 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.082 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.082 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:20.082 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.083 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 860880 5511 /usr/lib64/libnss_systemd.so.2 2020-04-22T14:17:20.083 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:20.083 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:20.083 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 16240 3641 /usr/lib64/libkeyutils.so.1.6 2020-04-22T14:17:20.083 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 118728 5304 /usr/lib64/libkrb5support.so.0.1 2020-04-22T14:17:20.083 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 25992 3339 /usr/lib64/libcom_err.so.2.1 2020-04-22T14:17:20.083 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 273488 5296 /usr/lib64/libk5crypto.so.3.1 2020-04-22T14:17:20.083 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 1507952 5302 /usr/lib64/libkrb5.so.3.3 2020-04-22T14:17:20.083 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 603768 5292 /usr/lib64/libgssapi_krb5.so.2.2 2020-04-22T14:17:20.084 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 142712 3373 /usr/lib64/libcrypt.so.1.1.0 2020-04-22T14:17:20.084 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.084 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:20.084 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 149160 4994 /usr/lib64/libsasl2.so.3.0.0 2020-04-22T14:17:20.084 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.084 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.084 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 97056 5009 /usr/lib64/liblber-2.4.so.2.10.9 2020-04-22T14:17:20.084 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 477472 5011 /usr/lib64/libldap-2.4.so.2.10.9 2020-04-22T14:17:20.085 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 74600 5752 /usr/lib64/libpam.so.0.84.2 2020-04-22T14:17:20.085 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 549944 16572 /usr/libexec/sudo/sudoers.so 2020-04-22T14:17:20.085 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:20.085 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:20.085 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:20.085 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.085 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 25192 3584 /usr/lib64/libcap-ng.so.0.0.0 2020-04-22T14:17:20.086 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.086 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.086 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.086 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 182296 16569 /usr/libexec/sudo/libsudo_util.so.0.0.0 2020-04-22T14:17:20.086 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:20.086 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.086 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 141392 3586 /usr/lib64/libaudit.so.1.0.0 2020-04-22T14:17:20.087 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.087 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:20.087 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:20.087 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:20.087 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:20.087 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:20.087 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:20.087 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:20.088 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:20.088 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:20.088 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:20.088 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:20.088 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:20.088 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root 0r FIFO 0,13 0t0 133421 pipe 2020-04-22T14:17:20.088 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:20.089 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:20.089 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root 3r REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:20.089 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root 4u unix 0x00000000630562af 0t0 131329 type=STREAM 2020-04-22T14:17:20.089 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root 5u netlink 0t0 131337 AUDIT 2020-04-22T14:17:20.089 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root 6r REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:20.089 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root 7r REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:20.089 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root 9u unix 0x00000000c9753adc 0t0 131340 type=DGRAM 2020-04-22T14:17:20.090 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root 10r FIFO 0,13 0t0 131343 pipe 2020-04-22T14:17:20.090 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 33150 root 11w FIFO 0,13 0t0 131343 pipe 2020-04-22T14:17:20.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 14w REG 8,1 124646225 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 14w REG 8,1 124624277 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33166 log root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.136 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.136 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.136 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.136 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.136 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.136 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.136 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.137 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.137 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.137 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.137 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.137 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.137 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.137 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.138 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.138 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.139 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.139 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.139 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.139 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.140 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.140 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.140 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.140 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.140 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.140 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.140 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.141 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.141 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.141 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.141 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.141 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.141 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.141 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.141 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 14w REG 8,1 124624277 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33167 msgr-work root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 14w REG 8,1 124624277 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33168 msgr-work root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 14w REG 8,1 124624277 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33169 msgr-work root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 14w REG 8,1 124624277 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33174 service root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 14w REG 8,1 124624277 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33175 admin_soc root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 14w REG 8,1 124624277 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33204 signal_ha root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 14w REG 8,1 124624277 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33272 OpHistory root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 14w REG 8,1 124624277 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33273 ceph-osd root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 14w REG 8,1 124624277 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33274 safe_time root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 14w REG 8,1 124624277 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33275 safe_time root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 14w REG 8,1 124624277 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33276 safe_time root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 14w REG 8,1 124624277 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33277 safe_time root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 14w REG 8,1 124624277 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33278 fn_anonym root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 14w REG 8,1 124624277 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33283 rocksdb:l root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 14w REG 8,1 124624277 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33284 rocksdb:l root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 14w REG 8,1 124624277 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33285 rocksdb:h root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 14w REG 8,1 124624277 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33428 bstore_ai root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 14w REG 8,1 124624277 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33429 bstore_di root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 14w REG 8,1 124624277 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.526 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.526 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.526 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.526 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.526 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.526 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.526 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.526 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33598 bstore_ai root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 14w REG 8,1 124624277 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33599 bstore_di root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 14w REG 8,1 124624277 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33600 ceph-osd root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.577 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.577 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.577 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.577 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.577 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.577 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.577 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.578 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.578 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.578 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.578 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.578 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.578 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.578 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.578 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.579 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.579 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.579 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.579 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.579 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.579 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.579 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.579 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.580 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.580 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.580 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.580 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.580 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.580 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.580 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.581 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.581 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.581 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.581 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.581 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.581 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.581 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.581 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 14w REG 8,1 124624277 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33616 rocksdb:d root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 14w REG 8,1 124624511 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33617 rocksdb:p root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 14w REG 8,1 124624511 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33618 cfin root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.641 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.641 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.641 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.641 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.641 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.641 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.641 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.642 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.642 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.642 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.642 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.642 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.642 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.642 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.643 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.643 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.643 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.643 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.643 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.643 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.643 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.643 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.644 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.644 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.644 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.644 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.644 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.644 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.644 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.645 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.645 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.645 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.645 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.645 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.645 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.645 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.645 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.646 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.646 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.646 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.646 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.646 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.646 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.646 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.646 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.647 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.647 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.647 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.647 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.647 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 14w REG 8,1 124624511 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.647 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.647 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.648 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.648 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.648 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.648 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.648 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.648 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.648 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.649 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.649 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.649 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.649 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.649 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.649 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.649 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.649 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.650 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.650 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.650 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.650 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.650 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.650 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.650 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.650 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.651 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.651 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.651 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.651 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.651 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.651 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.651 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.652 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.652 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.652 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.652 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.652 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.652 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.652 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.652 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.653 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.653 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.653 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.653 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.653 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.653 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.653 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.654 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.654 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.654 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.654 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.654 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.654 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.654 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.655 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.655 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.655 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.655 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.655 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.655 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.655 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.656 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.656 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.656 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.656 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.656 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.656 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.656 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.656 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.657 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.657 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.657 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.657 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.657 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.657 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.657 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.658 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.658 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.658 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.658 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.658 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.658 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.658 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.658 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33619 bstore_kv root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.659 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.659 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.659 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.659 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.659 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.659 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.659 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.660 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.660 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.660 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.660 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.660 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.660 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.660 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.660 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.661 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.661 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.661 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.661 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.661 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.661 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.661 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.662 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.662 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.662 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.662 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.662 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.662 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.662 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.663 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.663 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.663 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.663 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.663 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.663 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.663 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.664 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.664 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.664 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.664 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.664 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.664 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.664 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.665 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.665 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.665 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.665 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.665 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.665 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.665 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.666 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.666 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.666 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.666 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.666 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.666 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.666 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.666 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.667 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.667 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.667 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.667 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.667 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.667 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.667 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.667 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.668 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.668 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.668 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.668 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.668 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.668 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.668 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 14w REG 8,1 124624511 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.669 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.669 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.669 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.669 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.669 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.669 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.669 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.669 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.670 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.670 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.670 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.670 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.670 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.670 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.670 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.671 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.671 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.671 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.671 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.671 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.671 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.671 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.672 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.672 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.672 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.672 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.672 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.672 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.672 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.672 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.673 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.673 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.673 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.673 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.673 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.673 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.673 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33620 bstore_kv root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.681 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.681 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.681 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.681 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.681 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.681 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.681 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.689 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.689 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.689 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.689 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.689 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.689 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 14w REG 8,1 124624511 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.689 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.689 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33621 bstore_me root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.705 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.705 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.705 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.705 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.705 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.705 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.705 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 14w REG 8,1 124624511 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33622 ms_dispat root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.724 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.724 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.724 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.724 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.724 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.724 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.724 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.731 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.731 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.731 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.731 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 14w REG 8,1 124624511 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.731 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.731 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.731 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33623 ms_local root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.745 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.745 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.745 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.745 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.745 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.745 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.745 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.752 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.752 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 14w REG 8,1 124624511 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.752 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.752 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.752 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.752 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.752 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.753 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.753 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.753 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.753 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.753 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.753 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.753 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.753 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.754 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.754 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.754 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.754 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.754 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.754 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.754 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.755 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.755 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.755 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.755 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.755 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.755 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.755 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.755 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.756 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.756 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.756 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.756 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.756 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.756 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.756 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.757 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.757 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.757 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.757 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.757 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.757 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.757 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.758 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.758 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.758 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.758 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.758 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.758 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.758 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.758 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.759 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.759 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.759 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.759 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.759 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.759 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.759 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.759 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.760 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.760 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.760 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.760 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.760 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.760 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.760 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.760 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.761 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.761 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.761 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.761 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.761 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.761 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.761 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.762 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.762 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.762 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.762 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.762 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.762 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.762 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.762 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.763 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.763 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.763 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33624 safe_time root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.763 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.763 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.763 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.764 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.764 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.764 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.764 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.764 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.764 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.764 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.764 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.765 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.765 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.765 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.765 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.765 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.765 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.765 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.765 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.766 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.766 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.766 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.766 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.766 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.766 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.766 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.766 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.767 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.767 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.767 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.767 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.767 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.767 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.767 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.767 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.768 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.768 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.768 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.768 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.768 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.768 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.768 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.769 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.769 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.769 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.769 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.769 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.769 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.769 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.770 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.770 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.770 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.770 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.770 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.770 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.770 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.771 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.771 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.771 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.771 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.771 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.771 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.771 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.771 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.772 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.772 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.772 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.772 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.772 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.772 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.772 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.773 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.773 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 14w REG 8,1 124624511 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.773 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.773 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.773 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.773 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.773 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.773 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.774 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.774 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.774 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.774 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.774 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.774 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.774 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.774 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.775 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.775 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.775 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.775 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.775 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.775 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.775 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.775 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.776 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.776 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.776 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.776 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.776 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.776 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.776 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.776 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.777 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.777 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.777 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.777 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.777 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.777 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.777 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33625 fn_anonym root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 14w REG 8,1 124624511 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33626 safe_time root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 14w REG 8,1 124624511 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33627 ms_dispat root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 14w REG 8,1 124624511 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33628 ms_local root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 14w REG 8,1 124624511 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33629 ms_dispat root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 14w REG 8,1 124624511 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33630 ms_local root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 14w REG 8,1 124624511 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.902 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.902 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.902 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.902 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.902 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.902 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.902 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.902 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.903 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.903 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.903 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.903 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.903 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.903 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.903 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.903 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.906 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.906 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.906 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.906 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.906 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.906 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.906 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.906 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.907 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.907 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.907 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.907 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.907 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.907 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.907 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33631 ms_dispat root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 14w REG 8,1 124624511 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33632 ms_local root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 14w REG 8,1 124624511 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33633 ms_dispat root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 14w REG 8,1 124645991 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33634 ms_local root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:20.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:20.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:20.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:20.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:20.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:20.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:20.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:20.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:20.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:20.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:20.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:20.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:20.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:20.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:20.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:20.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:20.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:20.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:20.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:20.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:20.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:20.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:20.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:20.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:20.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:20.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:20.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:20.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:20.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:20.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:20.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:20.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:20.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:20.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:20.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:20.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 14w REG 8,1 124645991 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:20.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:20.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:20.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:20.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:20.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:20.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:20.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:20.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:20.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:20.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:20.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:20.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:20.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:20.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:20.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:20.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:20.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:20.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:20.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:20.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:20.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:20.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:20.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:20.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:20.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:20.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:20.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:20.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:20.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:20.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:20.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:20.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:20.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:20.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:20.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:20.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:20.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:20.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:20.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:20.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:20.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:20.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:20.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:20.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:20.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:20.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:20.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:20.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:20.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:20.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:20.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:20.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:20.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:20.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:20.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:20.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33635 ms_dispat root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:20.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:20.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:20.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:20.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:20.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:20.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:20.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:20.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:20.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:20.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:20.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:20.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:20.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:20.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:20.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:20.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:20.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:20.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:20.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:20.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:20.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:20.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:20.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:20.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:20.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:20.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:20.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:20.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:20.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:20.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:20.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:21.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:21.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:21.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:21.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 14w REG 8,1 124645991 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:21.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:21.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:21.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:21.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:21.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:21.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:21.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:21.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:21.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:21.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:21.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:21.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:21.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:21.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:21.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:21.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:21.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:21.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:21.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:21.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:21.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:21.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:21.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:21.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:21.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:21.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:21.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:21.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:21.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:21.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:21.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:21.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:21.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:21.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:21.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:21.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33636 ms_local root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:21.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:21.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:21.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:21.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:21.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 14w REG 8,1 124645991 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:21.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:21.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:21.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:21.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:21.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:21.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:21.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:21.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:21.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:21.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:21.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:21.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:21.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:21.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:21.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:21.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:21.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:21.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:21.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:21.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:21.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:21.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.036 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.036 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.036 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:21.036 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:21.036 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:21.036 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:21.036 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:21.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:21.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:21.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:21.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:21.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:21.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:21.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:21.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:21.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:21.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33637 ms_dispat root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:21.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:21.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:21.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:21.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:21.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 14w REG 8,1 124645991 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:21.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:21.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:21.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:21.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:21.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:21.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:21.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:21.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:21.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:21.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:21.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:21.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:21.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:21.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:21.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:21.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:21.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:21.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:21.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:21.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:21.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:21.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:21.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:21.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:21.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:21.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:21.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:21.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:21.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:21.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:21.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:21.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:21.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:21.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:21.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:21.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33638 ms_local root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:21.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:21.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:21.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:21.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:21.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 14w REG 8,1 124645991 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:21.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:21.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:21.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:21.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:21.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:21.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:21.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:21.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:21.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:21.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:21.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:21.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:21.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:21.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:21.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:21.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:21.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:21.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:21.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.077 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:21.077 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.077 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:21.077 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:21.077 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.077 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.077 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.078 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.078 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.078 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.078 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.078 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.078 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.078 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:21.079 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:21.079 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:21.079 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:21.079 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:21.079 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:21.079 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:21.079 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:21.079 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:21.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:21.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:21.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:21.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:21.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:21.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33639 fn_anonym root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:21.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.085 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.085 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.085 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.085 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.085 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.085 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.085 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:21.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:21.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:21.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:21.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 14w REG 8,1 124645991 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:21.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:21.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:21.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:21.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:21.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:21.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:21.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:21.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:21.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:21.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:21.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:21.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:21.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:21.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:21.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:21.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:21.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:21.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:21.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:21.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:21.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:21.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:21.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:21.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:21.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:21.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:21.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:21.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:21.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:21.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:21.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:21.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:21.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:21.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:21.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:21.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33640 finisher root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:21.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:21.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:21.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:21.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:21.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 14w REG 8,1 124645991 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:21.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:21.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:21.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:21.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:21.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:21.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:21.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:21.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:21.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:21.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:21.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:21.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:21.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:21.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:21.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:21.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:21.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:21.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:21.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:21.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:21.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:21.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:21.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:21.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:21.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:21.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:21.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:21.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:21.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:21.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:21.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:21.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:21.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:21.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:21.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:21.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33641 safe_time root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:21.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:21.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:21.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:21.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:21.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 14w REG 8,1 124645991 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:21.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:21.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:21.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:21.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:21.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:21.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:21.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:21.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:21.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:21.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:21.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:21.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:21.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.136 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.136 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.136 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.136 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.136 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.136 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.136 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.136 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.137 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.137 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.137 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.137 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.137 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.137 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.137 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.138 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.138 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.138 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:21.138 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.138 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.138 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.138 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.139 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:21.139 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.139 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.139 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:21.139 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:21.139 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:21.139 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:21.139 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.140 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:21.140 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.140 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:21.140 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:21.140 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.140 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.140 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.141 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.141 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.141 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.141 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.141 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.141 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.141 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:21.141 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:21.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:21.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:21.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:21.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:21.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:21.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:21.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:21.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:21.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:21.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:21.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:21.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:21.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33642 safe_time root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:21.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:21.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:21.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:21.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:21.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 14w REG 8,1 124645991 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:21.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:21.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:21.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:21.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:21.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:21.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:21.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:21.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:21.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:21.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:21.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:21.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:21.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:21.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:21.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:21.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:21.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:21.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:21.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:21.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:21.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:21.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:21.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:21.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:21.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:21.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:21.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:21.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:21.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:21.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:21.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:21.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:21.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:21.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:21.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:21.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33643 ceph-osd root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:21.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:21.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:21.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:21.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:21.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 14w REG 8,1 124645991 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:21.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:21.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:21.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:21.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:21.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:21.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:21.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:21.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:21.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:21.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:21.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:21.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:21.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:21.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:21.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:21.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:21.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:21.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:21.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:21.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:21.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:21.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:21.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:21.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:21.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:21.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:21.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:21.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:21.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:21.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:21.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:21.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:21.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:21.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:21.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:21.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33644 osd_srv_a root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:21.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:21.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:21.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:21.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:21.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 14w REG 8,1 124645991 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:21.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:21.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:21.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:21.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:21.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:21.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:21.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:21.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:21.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:21.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:21.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:21.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:21.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:21.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:21.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:21.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:21.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:21.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:21.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:21.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:21.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:21.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:21.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:21.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:21.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:21.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:21.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:21.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:21.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:21.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:21.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:21.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:21.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:21.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:21.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:21.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33645 tp_osd_tp root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:21.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:21.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:21.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:21.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:21.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 14w REG 8,1 124645991 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:21.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:21.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:21.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:21.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:21.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:21.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:21.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:21.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:21.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:21.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:21.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:21.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:21.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:21.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:21.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:21.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:21.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:21.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:21.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:21.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:21.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:21.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:21.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:21.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:21.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:21.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:21.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:21.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:21.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:21.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:21.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:21.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:21.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:21.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:21.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:21.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33646 tp_osd_tp root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:21.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:21.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:21.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:21.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:21.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 14w REG 8,1 124645991 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:21.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:21.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:21.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:21.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:21.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:21.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:21.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:21.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:21.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:21.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:21.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:21.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:21.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:21.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:21.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:21.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:21.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:21.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:21.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:21.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:21.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:21.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:21.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:21.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:21.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:21.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:21.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:21.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:21.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:21.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:21.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:21.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:21.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:21.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:21.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:21.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33647 tp_osd_tp root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:21.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:21.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:21.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:21.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:21.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 14w REG 8,1 124645991 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:21.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:21.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:21.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:21.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:21.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:21.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:21.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:21.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:21.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:21.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:21.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:21.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:21.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:21.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:21.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:21.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:21.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:21.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:21.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:21.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:21.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:21.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:21.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:21.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:21.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:21.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:21.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:21.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:21.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:21.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:21.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:21.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:21.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:21.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:21.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:21.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33648 tp_osd_tp root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:21.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:21.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:21.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:21.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:21.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 14w REG 8,1 124645991 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:21.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:21.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:21.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:21.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:21.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:21.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:21.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:21.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:21.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:21.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:21.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:21.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:21.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:21.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:21.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:21.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:21.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:21.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:21.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:21.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:21.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:21.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:21.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:21.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:21.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:21.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:21.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:21.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:21.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:21.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:21.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:21.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:21.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:21.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:21.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:21.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33649 tp_osd_tp root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:21.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:21.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:21.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:21.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:21.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 14w REG 8,1 124645991 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:21.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:21.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:21.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:21.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:21.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:21.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:21.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:21.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:21.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:21.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:21.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:21.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:21.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:21.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:21.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:21.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:21.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:21.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:21.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:21.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:21.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:21.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:21.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:21.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:21.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:21.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:21.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:21.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:21.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:21.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:21.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:21.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:21.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:21.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:21.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:21.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33650 tp_osd_tp root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:21.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:21.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:21.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:21.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:21.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 14w REG 8,1 124646225 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:21.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:21.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:21.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:21.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:21.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:21.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:21.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:21.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:21.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:21.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:21.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:21.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:21.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:21.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:21.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:21.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:21.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:21.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:21.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:21.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:21.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:21.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:21.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:21.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:21.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:21.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:21.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:21.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:21.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:21.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:21.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:21.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:21.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:21.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:21.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:21.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33651 tp_osd_tp root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:21.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:21.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:21.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:21.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:21.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 14w REG 8,1 124646225 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:21.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:21.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:21.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:21.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:21.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:21.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:21.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:21.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:21.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:21.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:21.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:21.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:21.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:21.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:21.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:21.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:21.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:21.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:21.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:21.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:21.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:21.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:21.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:21.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:21.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:21.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:21.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:21.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:21.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:21.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:21.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:21.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:21.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:21.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:21.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:21.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33652 tp_osd_tp root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:21.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:21.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:21.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:21.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:21.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 14w REG 8,1 124646225 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:21.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:21.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:21.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:21.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:21.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:21.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:21.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:21.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:21.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:21.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:21.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:21.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:21.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:21.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:21.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:21.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:21.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:21.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:21.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:21.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:21.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:21.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:21.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:21.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:21.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:21.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:21.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:21.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:21.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:21.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:21.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:21.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:21.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:21.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:21.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:21.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33653 tp_osd_tp root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:21.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:21.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:21.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:21.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:21.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 14w REG 8,1 124646225 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:21.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:21.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:21.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:21.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:21.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:21.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:21.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:21.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:21.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:21.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:21.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:21.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:21.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:21.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:21.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:21.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:21.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:21.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:21.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:21.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:21.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:21.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:21.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:21.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:21.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:21.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:21.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:21.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:21.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:21.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:21.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:21.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:21.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:21.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:21.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:21.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33654 tp_osd_tp root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:21.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:21.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:21.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:21.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:21.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 14w REG 8,1 124646225 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:21.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:21.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:21.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:21.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:21.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:21.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:21.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:21.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:21.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:21.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:21.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:21.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:21.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:21.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:21.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:21.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:21.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:21.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:21.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:21.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:21.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:21.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:21.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:21.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:21.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:21.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:21.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:21.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:21.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:21.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:21.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:21.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:21.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:21.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:21.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:21.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33655 tp_osd_tp root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:21.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:21.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:21.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:21.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:21.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 14w REG 8,1 124646225 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:21.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:21.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:21.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:21.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:21.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:21.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:21.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:21.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:21.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:21.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:21.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:21.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:21.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:21.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:21.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:21.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:21.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:21.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:21.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:21.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:21.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:21.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:21.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:21.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:21.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:21.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:21.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:21.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:21.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:21.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:21.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:21.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:21.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:21.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:21.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:21.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33656 tp_osd_tp root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:21.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:21.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:21.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:21.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:21.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 14w REG 8,1 124646225 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:21.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:21.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:21.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:21.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:21.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:21.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:21.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:21.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:21.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:21.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:21.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:21.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:21.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:21.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:21.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:21.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:21.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:21.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:21.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:21.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:21.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:21.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:21.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:21.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:21.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:21.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:21.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:21.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:21.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:21.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:21.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:21.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:21.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:21.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:21.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:21.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33657 tp_osd_tp root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:21.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:21.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:21.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:21.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:21.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 14w REG 8,1 124646225 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:21.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:21.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:21.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:21.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:21.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:21.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:21.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:21.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:21.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:21.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:21.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:21.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:21.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:21.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:21.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:21.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:21.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:21.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:21.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:21.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:21.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:21.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:21.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:21.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:21.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:21.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:21.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:21.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:21.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:21.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:21.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:21.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:21.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:21.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:21.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:21.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33658 tp_osd_tp root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:21.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:21.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:21.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:21.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:21.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 14w REG 8,1 124646225 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:21.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:21.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:21.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:21.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:21.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:21.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:21.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:21.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:21.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:21.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:21.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:21.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:21.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.526 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.526 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.526 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.526 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.526 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.526 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.526 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:21.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:21.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:21.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:21.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:21.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:21.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:21.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:21.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:21.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:21.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:21.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:21.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:21.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:21.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:21.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:21.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:21.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:21.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:21.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:21.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:21.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:21.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:21.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33659 tp_osd_tp root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:21.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:21.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:21.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:21.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:21.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 14w REG 8,1 124646225 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:21.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:21.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:21.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:21.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:21.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:21.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:21.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:21.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:21.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:21.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:21.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:21.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:21.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:21.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:21.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:21.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:21.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:21.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:21.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:21.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:21.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:21.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:21.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:21.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:21.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:21.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:21.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:21.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:21.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:21.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:21.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:21.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:21.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:21.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:21.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:21.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33660 tp_osd_tp root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:21.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root DEL REG 0,18 133466 /[aio] 2020-04-22T14:17:21.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root DEL REG 0,18 133463 /[aio] 2020-04-22T14:17:21.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 1w FIFO 0,13 0t0 132539 pipe 2020-04-22T14:17:21.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 2w FIFO 0,13 0t0 132540 pipe 2020-04-22T14:17:21.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 3r FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 4w FIFO 0,13 0t0 136391 pipe 2020-04-22T14:17:21.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 6r FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 7w FIFO 0,13 0t0 136392 pipe 2020-04-22T14:17:21.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 9r FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 10w FIFO 0,13 0t0 136393 pipe 2020-04-22T14:17:21.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 12r FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 13w FIFO 0,13 0t0 136394 pipe 2020-04-22T14:17:21.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 14w REG 8,1 124646225 526777 /var/log/ceph/ceph-osd.2.log 2020-04-22T14:17:21.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 15uW REG 0,24 6 137514 /run/ceph/ceph-osd.2.pid 2020-04-22T14:17:21.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 16r FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 17w FIFO 0,13 0t0 137515 pipe 2020-04-22T14:17:21.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 18u unix 0x00000000dc1ab5f5 0t0 137516 /var/run/ceph/ceph-osd.2.asok type=STREAM 2020-04-22T14:17:21.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 19u IPv4 135454 0t0 TCP *:6816 (LISTEN) 2020-04-22T14:17:21.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 20u IPv4 135472 0t0 TCP *:pentbox-sim (LISTEN) 2020-04-22T14:17:21.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 21u IPv4 135491 0t0 TCP *:6818 (LISTEN) 2020-04-22T14:17:21.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 22u IPv4 135511 0t0 TCP *:6819 (LISTEN) 2020-04-22T14:17:21.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 23u IPv4 135532 0t0 TCP *:6820 (LISTEN) 2020-04-22T14:17:21.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 24u IPv4 135554 0t0 TCP *:6821 (LISTEN) 2020-04-22T14:17:21.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 25u IPv4 135577 0t0 TCP *:6822 (LISTEN) 2020-04-22T14:17:21.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 26u IPv4 135601 0t0 TCP *:6823 (LISTEN) 2020-04-22T14:17:21.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 27r FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 28w FIFO 0,13 0t0 137522 pipe 2020-04-22T14:17:21.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 29r FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 30w FIFO 0,13 0t0 137523 pipe 2020-04-22T14:17:21.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 31r DIR 253,3 191 64 /var/lib/ceph/osd/ceph-2 2020-04-22T14:17:21.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 32uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-2/fsid 2020-04-22T14:17:21.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 33uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 34uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 35uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 36uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 37uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 38uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 39uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 40uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 41uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 42uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 43uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 44uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 45uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 46uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 47uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 48uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 49uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 50uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 51uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 52uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 53uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 54uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 55uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 56uW REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2020-04-22T14:17:21.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 57u IPv4 129569 0t0 TCP smithi103:59606->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:21.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 58r FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 59w FIFO 0,13 0t0 137580 pipe 2020-04-22T14:17:21.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 60r FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 61w FIFO 0,13 0t0 137581 pipe 2020-04-22T14:17:21.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 62u IPv4 136523 0t0 TCP smithi103:6822->smithi103:43312 (ESTABLISHED) 2020-04-22T14:17:21.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 63u IPv4 135837 0t0 TCP smithi103:55948->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 64u IPv4 131562 0t0 TCP smithi103:54362->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 65u IPv4 135838 0t0 TCP smithi103:43800->smithi103:6828 (ESTABLISHED) 2020-04-22T14:17:21.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 66u IPv4 129659 0t0 TCP smithi103:41286->smithi103:6830 (ESTABLISHED) 2020-04-22T14:17:21.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 67u IPv4 136534 0t0 TCP smithi103:6822->smithi103:43316 (ESTABLISHED) 2020-04-22T14:17:21.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 68u IPv4 136537 0t0 TCP smithi103:6820->smithi103:43264 (ESTABLISHED) 2020-04-22T14:17:21.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 69u IPv4 129666 0t0 TCP smithi103:43820->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 70u IPv4 129667 0t0 TCP smithi103:6820->smithi103:43274 (ESTABLISHED) 2020-04-22T14:17:21.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 71u IPv4 129670 0t0 TCP smithi103:51906->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 72u IPv4 129671 0t0 TCP smithi103:6822->smithi103:43348 (ESTABLISHED) 2020-04-22T14:17:21.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 73u IPv4 129674 0t0 TCP smithi103:6820->smithi103:43302 (ESTABLISHED) 2020-04-22T14:17:21.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 74u IPv4 129677 0t0 TCP smithi103:46438->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 75u IPv4 135843 0t0 TCP smithi103:53938->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 76u IPv4 133493 0t0 TCP smithi103:52728->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 77u IPv4 135006 0t0 TCP smithi103:60158->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 78u IPv4 135844 0t0 TCP smithi103:46786->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 79u IPv4 133494 0t0 TCP smithi103:41672->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 80u IPv4 135007 0t0 TCP smithi103:36688->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 81u IPv4 135845 0t0 TCP smithi103:47822->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 82u IPv4 133495 0t0 TCP smithi103:56178->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 83u IPv4 137592 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46230 (ESTABLISHED) 2020-04-22T14:17:21.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 84u IPv4 137595 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52324 (ESTABLISHED) 2020-04-22T14:17:21.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 85u IPv4 131578 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52330 (ESTABLISHED) 2020-04-22T14:17:21.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 86u IPv4 131587 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52356 (ESTABLISHED) 2020-04-22T14:17:21.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 87u IPv4 131590 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46276 (ESTABLISHED) 2020-04-22T14:17:21.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 88u IPv4 136546 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46292 (ESTABLISHED) 2020-04-22T14:17:21.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 89u IPv4 131596 0t0 TCP smithi103:6820->smithi086.front.sepia.ceph.com:46298 (ESTABLISHED) 2020-04-22T14:17:21.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 90u IPv4 133506 0t0 TCP smithi103:6822->smithi086.front.sepia.ceph.com:52400 (ESTABLISHED) 2020-04-22T14:17:21.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 91u IPv4 335214 0t0 TCP smithi103:6816->smithi086.front.sepia.ceph.com:35160 (ESTABLISHED) 2020-04-22T14:17:21.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 92u IPv4 131605 0t0 TCP smithi103:6818->smithi103:49368 (ESTABLISHED) 2020-04-22T14:17:21.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 93u IPv4 131608 0t0 TCP smithi103:6818->smithi103:49384 (ESTABLISHED) 2020-04-22T14:17:21.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 95u IPv4 133534 0t0 TCP smithi103:34952->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 96u IPv4 136597 0t0 TCP smithi103:48262->smithi103:6826 (ESTABLISHED) 2020-04-22T14:17:21.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 97u IPv4 136598 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56440 (ESTABLISHED) 2020-04-22T14:17:21.577 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 98u IPv4 136599 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56442 (ESTABLISHED) 2020-04-22T14:17:21.577 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33153 33661 osd_srv_h root 100u IPv4 136600 0t0 TCP smithi103:6818->smithi086.front.sepia.ceph.com:56444 (ESTABLISHED) 2020-04-22T14:17:21.577 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33181 root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.577 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33181 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.577 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33181 root txt REG 8,1 15496 6602 /usr/libexec/platform-python3.6 2020-04-22T14:17:21.577 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33181 root mem REG 8,1 59368 41092 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:21.577 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33181 root mem REG 8,1 16632 41078 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:21.577 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33181 root mem REG 8,1 52720 41084 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:21.578 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33181 root mem REG 8,1 37448 41100 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:21.578 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33181 root mem REG 8,1 19536 41090 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:21.578 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33181 root mem REG 8,1 23056 41069 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:21.578 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33181 root mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:21.578 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33181 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.578 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33181 root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.578 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33181 root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:21.579 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33181 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.579 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33181 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.579 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33181 root mem REG 8,1 3371672 6608 /usr/lib64/libpython3.6m.so.1.0 2020-04-22T14:17:21.579 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33181 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.579 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33181 root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:21.579 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33181 root mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:21.579 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33181 root mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:21.580 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33181 root mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:21.580 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33181 root mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:21.580 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33181 root mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:21.580 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33181 root mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:21.580 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33181 root mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:21.580 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33181 root mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:21.580 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33181 root mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:21.581 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33181 root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:21.581 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33181 root mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:21.581 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33181 root 0r FIFO 0,13 0t0 133421 pipe 2020-04-22T14:17:21.581 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33181 root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:21.581 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 33181 root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:21.581 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.581 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:21.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:21.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:21.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:21.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:21.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:21.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:21.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:21.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:21.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:21.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:21.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:21.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 14w REG 8,1 126203324 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:21.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:21.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:21.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:21.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:21.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:21.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:21.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:21.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:21.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:21.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:21.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:21.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:21.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:21.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:21.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:21.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:21.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:21.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:21.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:21.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:21.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:21.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:21.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:21.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:21.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:21.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:21.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:21.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:21.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:21.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:21.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:21.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:21.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:21.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:21.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:21.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:21.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:21.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:21.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:21.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:21.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:21.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:21.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:21.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:21.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:21.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:21.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:21.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:21.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:21.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:21.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:21.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:21.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:21.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:21.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:21.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:21.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:21.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:21.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 14w REG 8,1 126202856 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:21.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:21.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:21.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:21.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:21.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:21.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:21.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:21.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:21.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:21.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:21.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:21.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:21.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:21.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:21.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:21.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:21.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:21.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:21.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:21.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:21.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:21.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:21.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:21.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:21.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:21.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:21.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:21.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:21.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:21.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:21.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:21.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:21.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:21.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:21.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:21.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:21.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:21.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:21.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:21.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:21.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:21.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:21.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:21.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:21.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:21.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33184 log root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:21.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:21.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:21.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:21.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:21.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:21.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:21.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:21.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:21.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:21.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:21.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:21.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:21.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 14w REG 8,1 126202856 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:21.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:21.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:21.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:21.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:21.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:21.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:21.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:21.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:21.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:21.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:21.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:21.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:21.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:21.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:21.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:21.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:21.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:21.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:21.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:21.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:21.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:21.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:21.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:21.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:21.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:21.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:21.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:21.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:21.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:21.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:21.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:21.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:21.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:21.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:21.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:21.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:21.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:21.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:21.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:21.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:21.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:21.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:21.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:21.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:21.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:21.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33185 msgr-work root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:21.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.681 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.681 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.681 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.681 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.681 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.681 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:21.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:21.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:21.689 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:21.689 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:21.689 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:21.689 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.689 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:21.689 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:21.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:21.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:21.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:21.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:21.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 14w REG 8,1 126202856 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:21.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:21.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:21.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:21.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:21.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:21.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:21.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:21.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:21.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:21.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:21.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:21.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:21.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:21.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:21.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:21.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:21.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:21.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:21.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:21.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:21.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:21.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:21.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:21.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:21.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:21.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:21.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:21.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:21.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:21.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:21.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:21.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:21.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:21.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:21.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:21.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:21.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:21.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:21.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:21.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:21.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:21.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:21.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:21.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:21.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:21.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33186 msgr-work root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:21.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.705 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.705 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.705 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.705 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.705 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.705 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:21.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:21.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:21.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:21.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:21.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:21.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:21.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:21.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:21.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:21.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:21.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:21.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 14w REG 8,1 126202856 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:21.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:21.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:21.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:21.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:21.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:21.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:21.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:21.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:21.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:21.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:21.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:21.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:21.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:21.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:21.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:21.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:21.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:21.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:21.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:21.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:21.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:21.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:21.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:21.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:21.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:21.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:21.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:21.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:21.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:21.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:21.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:21.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:21.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:21.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:21.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:21.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:21.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:21.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:21.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:21.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:21.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:21.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:21.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:21.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:21.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:21.724 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.724 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33187 msgr-work root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:21.724 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.724 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.724 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.724 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.724 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.731 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.731 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.731 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.731 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.731 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.731 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.731 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.731 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:21.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:21.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:21.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:21.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:21.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:21.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:21.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:21.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:21.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:21.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:21.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:21.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 14w REG 8,1 126202856 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:21.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:21.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:21.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:21.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:21.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:21.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:21.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:21.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:21.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:21.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:21.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:21.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:21.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:21.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:21.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:21.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:21.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:21.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:21.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:21.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:21.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:21.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:21.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:21.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:21.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:21.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:21.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:21.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:21.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:21.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:21.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:21.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:21.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:21.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:21.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:21.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:21.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:21.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:21.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:21.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:21.745 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:21.745 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:21.745 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:21.745 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:21.745 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:21.745 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33192 service root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:21.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.752 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.752 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.752 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.752 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.752 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.752 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.752 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.753 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.753 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.753 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.753 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.753 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.753 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:21.754 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:21.754 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.754 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:21.754 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:21.754 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:21.754 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:21.754 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.755 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:21.755 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:21.755 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.755 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:21.755 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:21.755 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.755 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:21.755 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:21.756 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 14w REG 8,1 126202856 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:21.756 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:21.756 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:21.756 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:21.756 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:21.756 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:21.756 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:21.757 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:21.757 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:21.757 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:21.757 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:21.757 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:21.757 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:21.757 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:21.758 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:21.758 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:21.758 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:21.758 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:21.758 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:21.758 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.758 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.758 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.759 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.759 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.759 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.759 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.759 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.759 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.759 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.760 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.760 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.760 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.760 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.760 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.760 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.760 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.760 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.761 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.761 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.761 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.761 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.761 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.761 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.761 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:21.762 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:21.762 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:21.762 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:21.762 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:21.762 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.762 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.763 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:21.763 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:21.763 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.763 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.763 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.763 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:21.763 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:21.764 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:21.764 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:21.764 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:21.764 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:21.764 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.764 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.764 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.764 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.765 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.765 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.765 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.765 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.765 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:21.765 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:21.765 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:21.766 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:21.766 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:21.766 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:21.766 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:21.766 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:21.766 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:21.766 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:21.767 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:21.767 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:21.767 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:21.767 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:21.767 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.767 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33193 admin_soc root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:21.767 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.767 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.768 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.768 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.768 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.768 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.768 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.768 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.768 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.769 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.769 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.769 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.769 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.769 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.769 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.769 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.770 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.770 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.770 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.770 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.770 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.770 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.771 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.771 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.771 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.771 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.771 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.771 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.771 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.771 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.772 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.772 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.772 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.772 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.772 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.772 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.772 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.773 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.773 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.773 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.773 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.773 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.773 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.773 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.773 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.774 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.774 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.774 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.774 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.774 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.774 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.774 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.775 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.775 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.775 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.775 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.775 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:21.775 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:21.775 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.776 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:21.776 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:21.776 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:21.776 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:21.776 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.776 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:21.776 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:21.777 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.777 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:21.777 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:21.777 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.777 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:21.777 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:21.777 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 14w REG 8,1 126202856 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:21.777 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:21.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:21.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:21.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:21.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:21.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:21.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:21.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:21.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:21.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:21.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:21.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:21.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:21.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:21.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:21.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:21.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:21.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:21.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:21.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:21.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:21.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:21.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:21.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:21.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:21.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:21.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:21.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:21.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:21.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:21.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:21.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:21.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:21.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:21.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:21.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:21.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:21.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:21.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:21.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:21.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:21.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:21.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:21.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:21.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:21.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33207 signal_ha root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:21.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:21.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:21.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:21.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:21.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:21.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:21.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:21.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:21.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:21.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:21.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:21.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:21.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 14w REG 8,1 126202856 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:21.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:21.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:21.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:21.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:21.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:21.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:21.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:21.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:21.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:21.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:21.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:21.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:21.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:21.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:21.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:21.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:21.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:21.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:21.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:21.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:21.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:21.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:21.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:21.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:21.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:21.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:21.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:21.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:21.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:21.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:21.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:21.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:21.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:21.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:21.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:21.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:21.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:21.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:21.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:21.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:21.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:21.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:21.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:21.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:21.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:21.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33303 OpHistory root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:21.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:21.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:21.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:21.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:21.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:21.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:21.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:21.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:21.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:21.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:21.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:21.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:21.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 14w REG 8,1 126202856 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:21.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:21.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:21.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:21.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:21.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:21.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:21.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:21.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:21.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:21.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:21.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:21.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:21.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:21.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:21.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:21.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:21.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:21.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:21.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:21.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:21.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:21.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:21.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:21.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:21.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:21.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:21.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:21.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:21.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:21.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:21.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:21.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:21.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:21.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:21.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:21.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:21.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:21.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:21.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:21.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:21.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:21.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:21.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:21.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:21.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:21.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33304 ceph-osd root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:21.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:21.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:21.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:21.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:21.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:21.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:21.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:21.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:21.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:21.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:21.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:21.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:21.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 14w REG 8,1 126202856 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:21.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:21.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:21.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:21.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:21.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:21.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:21.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:21.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:21.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:21.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:21.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:21.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:21.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:21.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:21.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:21.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:21.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:21.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:21.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:21.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:21.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:21.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:21.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:21.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:21.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:21.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:21.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:21.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:21.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:21.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:21.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:21.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:21.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:21.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:21.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:21.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:21.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:21.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:21.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:21.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:21.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:21.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:21.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:21.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:21.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:21.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33305 safe_time root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:21.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:21.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:21.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:21.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:21.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:21.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:21.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:21.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:21.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:21.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:21.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:21.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:21.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 14w REG 8,1 126202856 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:21.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:21.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:21.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:21.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:21.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:21.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:21.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:21.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:21.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:21.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:21.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:21.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:21.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:21.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:21.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:21.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:21.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:21.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:21.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:21.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:21.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:21.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:21.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:21.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:21.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:21.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:21.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:21.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:21.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:21.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:21.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:21.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:21.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:21.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:21.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:21.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:21.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:21.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:21.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:21.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:21.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:21.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:21.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:21.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:21.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:21.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33306 safe_time root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:21.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:21.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:21.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:21.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:21.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:21.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:21.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:21.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:21.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:21.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:21.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:21.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:21.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 14w REG 8,1 126202856 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:21.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:21.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:21.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:21.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:21.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:21.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:21.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:21.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:21.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:21.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:21.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:21.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:21.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:21.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:21.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:21.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:21.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:21.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:21.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:21.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:21.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:21.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:21.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:21.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:21.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:21.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:21.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:21.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:21.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:21.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:21.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:21.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:21.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:21.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:21.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:21.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:21.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:21.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:21.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:21.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:21.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:21.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:21.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:21.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:21.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:21.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33307 safe_time root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:21.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.902 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.902 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.902 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.902 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.902 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.902 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.902 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.903 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.903 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.903 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.903 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.903 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.903 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.903 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.903 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.906 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.906 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.906 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.906 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:21.906 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:21.906 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.906 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:21.907 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:21.907 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:21.907 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:21.907 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.907 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:21.907 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:21.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:21.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:21.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:21.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:21.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 14w REG 8,1 126202856 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:21.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:21.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:21.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:21.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:21.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:21.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:21.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:21.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:21.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:21.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:21.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:21.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:21.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:21.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:21.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:21.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:21.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:21.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:21.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:21.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:21.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:21.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:21.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:21.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:21.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:21.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:21.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:21.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:21.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:21.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:21.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:21.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:21.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:21.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:21.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:21.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:21.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:21.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:21.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:21.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:21.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:21.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:21.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:21.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:21.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:21.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33308 safe_time root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:21.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:21.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:21.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:21.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:21.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:21.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:21.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:21.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:21.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:21.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:21.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:21.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:21.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 14w REG 8,1 126202856 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:21.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:21.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:21.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:21.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:21.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:21.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:21.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:21.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:21.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:21.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:21.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:21.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:21.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:21.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:21.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:21.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:21.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:21.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:21.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:21.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:21.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:21.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:21.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:21.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:21.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:21.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:21.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:21.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:21.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:21.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:21.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:21.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:21.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:21.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:21.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:21.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:21.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:21.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:21.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:21.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:21.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:21.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:21.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:21.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:21.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:21.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33309 fn_anonym root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:21.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:21.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:21.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:21.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:21.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:21.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:21.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:21.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:21.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:21.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:21.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:21.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:21.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 14w REG 8,1 126202856 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:21.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:21.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:21.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:21.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:21.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:21.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:21.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:21.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:21.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:21.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:21.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:21.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:21.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:21.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:21.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:21.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:21.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:21.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:21.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:21.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:21.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:21.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:21.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:21.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:21.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:21.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:21.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:21.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:21.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:21.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:21.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:21.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:21.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:21.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:21.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:21.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:21.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:21.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:21.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:21.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:21.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:21.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:21.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:21.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:21.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:21.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33314 rocksdb:l root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:21.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:21.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:21.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:21.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:21.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:21.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:21.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:21.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:21.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:21.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:21.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:21.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:21.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 14w REG 8,1 126202856 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:21.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:21.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:21.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:21.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:21.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:21.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:21.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:21.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:21.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:21.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:21.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:21.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:21.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:21.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:21.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:21.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:21.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:21.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:21.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:21.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:21.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:21.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:21.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:21.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:21.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:21.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:21.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:21.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:21.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:21.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:21.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:21.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:21.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:21.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:21.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:21.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:21.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:21.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:21.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:21.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:21.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:21.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:21.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:21.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:21.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:21.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:21.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:21.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:21.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:21.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:21.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:21.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:21.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:21.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:21.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:21.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:21.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:21.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:21.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:21.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33315 rocksdb:l root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:21.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:21.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:21.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:21.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:21.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:21.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:21.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:21.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:21.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:21.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:21.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:21.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:21.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:21.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:21.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:21.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:21.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:21.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:21.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:21.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:21.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:21.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:21.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:21.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:21.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:21.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:21.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:21.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:21.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:21.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:21.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:21.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:21.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:21.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:21.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:21.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:21.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:21.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:21.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:21.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:21.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:21.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:21.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:21.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:21.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:21.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:21.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:21.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:21.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:21.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:21.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:21.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:21.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:21.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:21.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:21.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:21.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:21.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:21.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:21.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:21.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:21.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:21.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:21.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:21.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:21.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:21.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:21.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:21.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:21.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:21.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 14w REG 8,1 126202856 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:21.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:21.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:21.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:21.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:21.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:21.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:21.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:21.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:21.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:21.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:21.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:21.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:21.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:21.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:21.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:21.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:21.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:21.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:21.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:21.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33316 rocksdb:h root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 14w REG 8,1 126202856 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33450 bstore_ai root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.036 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.036 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.036 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.036 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.036 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 14w REG 8,1 126202856 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33451 bstore_di root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 14w REG 8,1 126202856 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33662 bstore_ai root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.077 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.077 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.077 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.077 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.077 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.077 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.077 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.078 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.078 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.078 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.078 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.078 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.078 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.078 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.079 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.079 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.079 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.079 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.079 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.079 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.079 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.079 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 14w REG 8,1 126203090 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.085 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.085 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.085 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.085 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.085 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.085 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33663 bstore_di root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 14w REG 8,1 126203090 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33664 ceph-osd root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.123 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.124 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.125 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.126 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 14w REG 8,1 126203090 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.127 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.128 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.129 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.130 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.131 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.132 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.133 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.134 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.135 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.136 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.136 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.136 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.136 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.136 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.136 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.136 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.136 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.137 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.137 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.137 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.137 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.137 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.137 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.137 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.138 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.138 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.138 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.138 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.138 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.138 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.138 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.138 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.139 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.139 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33680 rocksdb:d root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.139 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.139 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.139 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.139 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.139 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.140 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.140 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.140 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.140 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.140 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.140 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.140 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.141 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.141 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.141 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.141 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.141 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.141 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.142 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.143 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.144 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.145 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.146 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.147 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.148 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 14w REG 8,1 126203090 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.149 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.150 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.151 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33681 rocksdb:p root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 14w REG 8,1 126203090 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33682 cfin root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 14w REG 8,1 126203090 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33683 bstore_kv root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 14w REG 8,1 126203090 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33684 bstore_kv root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 14w REG 8,1 126203090 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33685 bstore_me root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 14w REG 8,1 126203090 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33686 ms_dispat root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 14w REG 8,1 126203090 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.282 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.283 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.284 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.285 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.286 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.287 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.288 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.289 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.290 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.291 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33687 ms_local root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.292 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.293 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.294 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.295 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.297 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.298 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.299 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.300 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.301 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 14w REG 8,1 126203090 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.302 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.303 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.304 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.305 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.306 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.307 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.308 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.309 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.310 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.311 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33688 safe_time root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 14w REG 8,1 126203090 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33689 fn_anonym root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 14w REG 8,1 126203090 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33690 safe_time root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 14w REG 8,1 126203090 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33691 ms_dispat root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 14w REG 8,1 126203090 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33692 ms_local root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 14w REG 8,1 126203090 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33693 ms_dispat root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 14w REG 8,1 126203090 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33694 ms_local root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 14w REG 8,1 126203090 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33695 ms_dispat root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 14w REG 8,1 126203090 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33696 ms_local root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 14w REG 8,1 126203090 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.503 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.505 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.506 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.507 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.508 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.509 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.510 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33697 ms_dispat root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.511 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.512 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.514 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.515 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.516 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.517 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.519 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 14w REG 8,1 126203090 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.521 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.522 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.523 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.524 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.525 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.526 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.526 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.526 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.526 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.526 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.526 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.526 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.527 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.528 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.529 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.530 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.531 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.532 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33698 ms_local root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.533 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.534 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.535 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.537 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.538 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.539 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.540 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.541 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.542 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 14w REG 8,1 126203090 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.543 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.544 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.545 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.547 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.549 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.550 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.551 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.552 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.553 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.554 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33699 ms_dispat root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.555 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.556 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.557 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.558 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.559 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.561 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.562 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.563 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.564 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 14w REG 8,1 126203090 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.565 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.566 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.567 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.568 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.569 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.570 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.571 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.572 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.573 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.574 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.575 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.576 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.577 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.577 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33700 ms_local root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.577 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.577 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.577 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.577 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.577 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.578 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.578 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.578 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.578 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.578 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.578 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.578 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.579 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.579 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.579 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.579 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.579 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.579 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.579 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.580 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.580 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.580 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.580 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.580 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.580 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.580 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.580 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.581 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.581 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.581 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.581 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.581 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.581 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.581 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.582 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.583 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.584 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.585 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.586 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 14w REG 8,1 126203090 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.587 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.588 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.589 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.590 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.591 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.592 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.593 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.594 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.595 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.596 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.597 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.598 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33701 ms_dispat root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.600 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.601 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.602 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.604 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.605 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.606 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.607 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.608 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 14w REG 8,1 126203090 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.609 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.611 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.612 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.613 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.614 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.615 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.616 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.617 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.618 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.619 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.620 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33702 ms_local root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.621 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.622 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.623 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.624 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.625 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.626 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.627 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.628 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.629 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.630 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 14w REG 8,1 126203090 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.631 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.632 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.633 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.634 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.635 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.636 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.637 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.638 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.639 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.640 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.641 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.641 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.641 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.641 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.641 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.641 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.641 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.642 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.642 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.642 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.642 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.642 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33703 fn_anonym root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.642 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.642 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.642 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.643 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.643 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.643 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.643 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.643 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.643 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.644 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.644 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.644 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.644 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.644 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.644 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.644 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.645 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.645 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.645 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.645 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.645 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.645 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.645 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.645 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.646 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.646 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.646 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.646 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.646 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.646 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.646 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.647 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.647 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.647 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.647 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.647 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.647 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.647 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.648 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.648 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.648 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.648 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.648 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.648 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.648 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.649 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.649 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.649 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.649 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.649 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.649 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.649 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.650 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.650 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.650 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.650 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.650 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.650 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.650 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.650 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.651 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.651 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.651 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.651 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.651 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.651 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.652 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.652 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.652 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.652 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.652 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.652 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.652 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 14w REG 8,1 126203090 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.652 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.653 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.653 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.653 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.653 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.653 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.653 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.653 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.654 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.654 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.654 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.654 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.654 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.654 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.654 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.655 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.655 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.655 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.655 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.655 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.655 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.655 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.655 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.656 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.656 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.656 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.656 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.656 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.656 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.656 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.657 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.657 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.657 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.657 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.657 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.657 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.657 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.658 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.658 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.658 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.658 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.658 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.658 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.658 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.659 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.659 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.659 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.659 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.659 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.659 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.659 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.659 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.660 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.660 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.660 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.660 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.660 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.660 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.661 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.661 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.661 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.661 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.661 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.661 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.661 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.662 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.662 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.662 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.662 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.662 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.662 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.662 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.662 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.663 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.663 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.663 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.663 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.663 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.663 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.663 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.664 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.664 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.664 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.664 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33704 finisher root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.664 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.664 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.664 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.665 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.665 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.665 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.665 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.665 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.665 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.665 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.666 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.666 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.666 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.666 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.666 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.666 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.666 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.666 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.667 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.667 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.667 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.667 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.667 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.667 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.668 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.668 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.668 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.668 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.668 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.668 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.668 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.668 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.669 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.669 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.669 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.669 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.669 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.669 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.669 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.670 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.670 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.670 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.670 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.670 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.670 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.670 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.670 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.671 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.671 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.671 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.671 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.671 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.671 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.671 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.672 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.672 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.672 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.672 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.672 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.672 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.672 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.673 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.673 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.673 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.673 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.673 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.673 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.673 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 14w REG 8,1 126203090 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.674 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.675 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.676 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.677 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.678 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.679 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.680 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.681 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.681 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.681 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.681 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.681 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.681 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.681 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.682 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.683 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.684 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.685 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33705 safe_time root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.686 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.687 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.689 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.689 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.689 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.689 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.689 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.689 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.689 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.690 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.691 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.692 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.693 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.695 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 14w REG 8,1 126203090 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.696 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.697 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.698 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.699 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.700 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.701 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.702 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.703 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.704 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.705 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.705 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.705 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.705 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.705 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.705 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.705 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.705 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.706 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.707 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33706 safe_time root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.708 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.710 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.711 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.712 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.713 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.714 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.715 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.716 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.717 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 14w REG 8,1 126203090 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.718 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.719 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.720 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.721 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.722 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.723 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.724 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.724 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.724 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.724 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.724 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.724 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.725 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.726 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.727 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.728 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33707 ceph-osd root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.729 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.730 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.731 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.731 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.731 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.731 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.731 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.731 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.732 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.733 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.734 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.735 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.736 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.738 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 14w REG 8,1 126203090 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.739 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.740 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.741 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.742 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.744 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.745 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.745 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.745 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.745 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.745 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.745 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.745 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.746 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.747 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.748 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.749 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.750 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33708 osd_srv_a root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.751 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.752 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.752 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.752 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.752 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.752 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.752 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.752 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.752 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.753 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.753 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.753 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.753 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.753 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.753 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.753 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.754 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.754 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.754 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.754 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.754 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.754 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.754 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.755 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.755 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.755 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.755 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.755 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.755 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.755 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.756 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.756 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.756 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.756 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.756 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.756 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.756 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.757 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.757 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.757 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.757 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.757 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.757 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.757 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.757 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.758 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.758 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.758 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.758 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.758 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.758 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.758 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.759 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.759 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.759 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.759 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.759 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.759 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.759 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.759 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.760 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.760 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.760 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.760 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.760 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.760 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.760 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.761 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.761 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.761 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.761 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.761 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 14w REG 8,1 126203090 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.761 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.761 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.762 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.762 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.762 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.762 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.762 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.762 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.762 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.762 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.763 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.763 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.763 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.763 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.763 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.763 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.763 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.764 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.764 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.764 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.764 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.764 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.764 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.765 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.765 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.765 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.765 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.765 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.765 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.765 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.766 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.766 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.766 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.766 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.766 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.766 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.766 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.767 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.767 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.767 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.767 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.767 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.767 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.767 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.768 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.768 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.768 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.768 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.768 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.768 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.768 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.768 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.769 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.769 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.769 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.769 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.769 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.769 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.769 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.770 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.770 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.770 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.770 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.770 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.770 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.770 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.771 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.771 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.771 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.771 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.771 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.771 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.771 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.771 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.772 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.772 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.772 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.772 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.772 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.772 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.773 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.773 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.773 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.773 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33709 tp_osd_tp root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.773 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.773 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.773 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.774 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.774 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.774 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.774 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.774 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.774 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.774 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.774 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.775 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.775 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.775 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.775 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.775 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.775 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.775 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.776 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.776 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.776 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.776 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.776 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.776 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.776 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.777 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.777 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.777 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.777 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.777 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.777 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.777 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.778 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.779 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.780 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.781 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.782 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 14w REG 8,1 126203090 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.783 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.784 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.785 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.786 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.787 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.788 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.789 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.790 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.791 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.792 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.793 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.794 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.795 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33710 tp_osd_tp root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.796 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.797 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.798 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.799 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.800 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.801 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.802 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.803 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.804 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.805 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 14w REG 8,1 126203090 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.806 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.807 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.808 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.809 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.810 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.811 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.812 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.813 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.814 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.815 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.816 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.817 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33711 tp_osd_tp root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.818 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.819 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.820 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.821 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.822 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.823 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.824 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.825 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.826 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.827 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 14w REG 8,1 126203090 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.828 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.829 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.830 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.831 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.832 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.833 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.834 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.835 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.836 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.837 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.838 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33712 tp_osd_tp root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.840 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.841 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.842 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.843 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.845 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.846 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.847 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.848 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.849 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 14w REG 8,1 126203324 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.850 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.851 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.852 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.854 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.855 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.856 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.857 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.858 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.859 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.860 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33713 tp_osd_tp root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.861 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.862 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.863 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.864 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.865 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.866 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.867 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.868 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.869 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.870 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.871 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 14w REG 8,1 126203324 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.872 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.873 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.874 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.875 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.876 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.877 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.878 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.879 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.880 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.881 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.882 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33714 tp_osd_tp root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.883 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.884 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.885 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.886 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.887 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.888 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.889 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.890 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.892 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 14w REG 8,1 126203324 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.893 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.894 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.895 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.896 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.897 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.898 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.899 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.900 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.901 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.902 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.902 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.902 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.902 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.902 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.902 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.902 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.903 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.903 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.903 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.903 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.903 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.903 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.903 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.904 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33715 tp_osd_tp root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.905 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.906 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.906 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.906 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.906 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.906 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.906 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.906 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.907 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.907 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.907 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.907 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.907 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.907 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.907 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.908 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.909 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.910 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.911 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.912 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.913 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.914 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 14w REG 8,1 126203324 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.915 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.916 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.917 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.919 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.920 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.922 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.923 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.924 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.925 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.926 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33716 tp_osd_tp root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.927 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.928 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.929 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.930 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.931 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.932 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.934 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.935 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.936 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 14w REG 8,1 126203324 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.937 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.939 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.940 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.941 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.942 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.943 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.944 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.945 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.946 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.947 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33717 tp_osd_tp root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.948 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.949 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.950 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.951 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.952 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.953 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.954 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.955 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.956 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.957 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 14w REG 8,1 126203324 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.958 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.959 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.960 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.961 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.962 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.963 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.965 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.966 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.967 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.968 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.969 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33718 tp_osd_tp root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.970 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.971 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.972 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.973 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.974 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.975 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.976 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:22.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:22.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:22.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.978 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:22.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:22.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:22.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:22.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:22.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 14w REG 8,1 126203324 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:22.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:22.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:22.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:22.980 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:22.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:22.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:22.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:22.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:22.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:22.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:22.981 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:22.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:22.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:22.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:22.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:22.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.983 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.984 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.985 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:22.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:22.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:22.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:22.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:22.986 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:22.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:22.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:22.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:22.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:22.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:22.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:22.987 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:22.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:22.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:22.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:22.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:22.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:22.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:22.988 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:22.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:22.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:22.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:22.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:22.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:22.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:22.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:22.989 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:22.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:22.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:22.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:22.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:22.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:22.990 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:22.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:22.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:22.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:22.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:22.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:22.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:22.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33719 tp_osd_tp root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:22.991 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:22.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:22.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:22.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:22.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:22.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:22.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:22.992 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:22.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:22.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:22.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:22.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:22.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:22.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:22.993 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:22.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:22.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:22.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:22.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:22.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:22.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:22.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:22.994 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:22.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:22.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:22.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:22.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:22.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:22.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:22.995 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:22.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:22.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:22.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:22.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:22.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:22.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:22.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:22.996 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:22.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:22.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:22.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:22.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:22.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:22.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:22.997 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:22.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:22.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:22.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:22.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:22.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:22.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:22.998 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:22.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:22.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:22.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:22.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:22.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:22.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:22.999 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:23.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:23.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:23.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:23.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:23.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:23.000 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:23.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:23.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:23.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:23.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 14w REG 8,1 126203324 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:23.001 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:23.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:23.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:23.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:23.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:23.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:23.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:23.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:23.002 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:23.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:23.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:23.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:23.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:23.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:23.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:23.003 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:23.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:23.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:23.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.004 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.005 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.006 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:23.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:23.007 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:23.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:23.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:23.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:23.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:23.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:23.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:23.008 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:23.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:23.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:23.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:23.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:23.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:23.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:23.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:23.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:23.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:23.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:23.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:23.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:23.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:23.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:23.010 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:23.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:23.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:23.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:23.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:23.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:23.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:23.011 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:23.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:23.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:23.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:23.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:23.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:23.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:23.012 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:23.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:23.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:23.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33720 tp_osd_tp root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:23.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:23.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:23.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:23.013 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:23.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:23.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:23.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:23.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:23.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:23.014 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:23.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:23.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:23.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:23.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:23.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:23.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:23.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:23.015 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:23.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:23.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:23.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:23.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:23.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:23.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.016 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.017 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:23.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.018 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.019 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:23.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:23.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:23.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:23.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:23.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:23.020 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:23.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:23.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:23.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:23.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:23.021 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:23.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:23.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:23.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:23.022 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:23.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:23.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:23.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 14w REG 8,1 126203324 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:23.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:23.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:23.023 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:23.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:23.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:23.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:23.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:23.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:23.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:23.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:23.024 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:23.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:23.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:23.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:23.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:23.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:23.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:23.025 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:23.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.026 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.027 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.028 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:23.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:23.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:23.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:23.029 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:23.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:23.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:23.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:23.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:23.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:23.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:23.030 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:23.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:23.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:23.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:23.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:23.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:23.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:23.031 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:23.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:23.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:23.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:23.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:23.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:23.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:23.032 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:23.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:23.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:23.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:23.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:23.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:23.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:23.033 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:23.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:23.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:23.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:23.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:23.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:23.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:23.034 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:23.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:23.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33721 tp_osd_tp root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:23.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:23.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:23.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:23.035 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:23.036 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:23.036 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:23.036 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:23.036 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:23.036 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:23.036 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:23.036 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:23.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:23.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:23.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:23.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:23.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:23.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:23.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:23.037 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:23.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:23.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:23.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:23.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:23.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.038 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.039 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:23.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.040 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:23.041 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:23.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:23.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:23.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:23.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:23.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:23.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:23.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:23.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:23.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:23.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:23.043 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:23.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:23.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:23.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:23.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.044 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:23.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:23.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 14w REG 8,1 126203324 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:23.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:23.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:23.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:23.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:23.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:23.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:23.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:23.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:23.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:23.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:23.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:23.046 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:23.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:23.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:23.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:23.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:23.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:23.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:23.047 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.048 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.049 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.050 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:23.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:23.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:23.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:23.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:23.051 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:23.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:23.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:23.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:23.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:23.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:23.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:23.052 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:23.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:23.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:23.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:23.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:23.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:23.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:23.053 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:23.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:23.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:23.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:23.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:23.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:23.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:23.054 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:23.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:23.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:23.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:23.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:23.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:23.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:23.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:23.055 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:23.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:23.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:23.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:23.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:23.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:23.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:23.056 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33722 tp_osd_tp root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:23.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:23.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:23.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:23.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:23.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:23.057 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:23.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:23.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:23.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:23.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:23.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:23.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:23.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:23.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:23.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:23.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:23.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:23.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:23.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:23.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:23.059 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:23.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:23.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:23.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.060 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:23.061 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.062 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:23.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:23.063 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:23.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:23.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:23.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:23.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.064 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:23.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:23.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:23.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:23.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:23.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:23.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.065 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:23.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:23.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:23.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:23.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:23.066 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:23.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 14w REG 8,1 126203324 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:23.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:23.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:23.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:23.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:23.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:23.067 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:23.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:23.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:23.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:23.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:23.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:23.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:23.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:23.068 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:23.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:23.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:23.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:23.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:23.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.069 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.070 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.071 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.072 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:23.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:23.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:23.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:23.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:23.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:23.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:23.073 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:23.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:23.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:23.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:23.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:23.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:23.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:23.074 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:23.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:23.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:23.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:23.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:23.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:23.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:23.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:23.075 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:23.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:23.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:23.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:23.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:23.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:23.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:23.076 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:23.077 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:23.077 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:23.077 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:23.077 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:23.077 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:23.077 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:23.077 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:23.078 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:23.078 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:23.078 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:23.078 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:23.078 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33723 tp_osd_tp root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:23.078 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:23.078 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.079 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:23.079 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:23.079 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:23.079 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:23.079 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:23.079 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:23.079 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:23.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:23.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:23.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:23.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:23.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:23.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:23.080 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:23.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:23.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:23.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:23.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:23.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:23.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:23.081 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:23.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:23.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.082 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:23.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.083 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.084 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.085 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.085 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.085 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:23.085 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:23.085 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.085 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:23.085 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:23.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:23.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:23.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:23.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:23.086 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:23.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:23.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:23.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:23.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:23.087 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:23.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:23.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:23.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:23.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:23.088 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 14w REG 8,1 126203324 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:23.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:23.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:23.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:23.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:23.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:23.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:23.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:23.089 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:23.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:23.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:23.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:23.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:23.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:23.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:23.090 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:23.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:23.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:23.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:23.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.091 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.092 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.093 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:23.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:23.094 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:23.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:23.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:23.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:23.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:23.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:23.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:23.095 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:23.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:23.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:23.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:23.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:23.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:23.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:23.096 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:23.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:23.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:23.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:23.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:23.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:23.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:23.097 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:23.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:23.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:23.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:23.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:23.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:23.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:23.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:23.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:23.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:23.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:23.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:23.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:23.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:23.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:23.099 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:23.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:23.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:23.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33724 tp_osd_tp root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:23.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:23.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root txt REG 8,1 28290512 66372 /usr/bin/ceph-osd 2020-04-22T14:17:23.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 48608 525277 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2020-04-22T14:17:23.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 555704 525304 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2020-04-22T14:17:23.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 52512 525289 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2020-04-22T14:17:23.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 43424 525325 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2020-04-22T14:17:23.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 2100248 525310 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2020-04-22T14:17:23.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 101232 63100 /usr/lib64/liboath.so.0.1.3 2020-04-22T14:17:23.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 78272 525298 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2020-04-22T14:17:23.101 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 82208 525322 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2020-04-22T14:17:23.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 1683264 525307 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2020-04-22T14:17:23.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 108512 525280 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2020-04-22T14:17:23.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 53600 525271 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2020-04-22T14:17:23.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 80352 525286 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2020-04-22T14:17:23.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 28544 525295 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2020-04-22T14:17:23.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 40576 525319 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2020-04-22T14:17:23.102 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 347536 525313 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2020-04-22T14:17:23.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 69008 525274 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2020-04-22T14:17:23.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 61904 525268 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2020-04-22T14:17:23.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 32336 525238 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2020-04-22T14:17:23.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 231672 525252 /usr/lib64/ceph/erasure-code/libec_isa.so 2020-04-22T14:17:23.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 2508176 525257 /usr/lib64/ceph/erasure-code/libec_lrc.so 2020-04-22T14:17:23.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 446880 525253 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2020-04-22T14:17:23.103 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:23.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.105 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:23.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 34208 3796 /usr/lib64/libaio.so.1.0.1 2020-04-22T14:17:23.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 95728 3805 /usr/lib64/liblz4.so.1.8.1 2020-04-22T14:17:23.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 42168 4603 /usr/lib64/libsnappy.so.1.1.7 2020-04-22T14:17:23.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 576160 63103 /usr/lib64/libleveldb.so.1.22.0 2020-04-22T14:17:23.107 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:23.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root DEL REG 0,18 132575 /[aio] 2020-04-22T14:17:23.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root DEL REG 0,18 132573 /[aio] 2020-04-22T14:17:23.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 1w FIFO 0,13 0t0 133422 pipe 2020-04-22T14:17:23.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 2w FIFO 0,13 0t0 133423 pipe 2020-04-22T14:17:23.108 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 3r FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:23.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 4w FIFO 0,13 0t0 131355 pipe 2020-04-22T14:17:23.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 6r FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:23.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 7w FIFO 0,13 0t0 131356 pipe 2020-04-22T14:17:23.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 9r FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:23.109 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 10w FIFO 0,13 0t0 131357 pipe 2020-04-22T14:17:23.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 12r FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:23.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 13w FIFO 0,13 0t0 131358 pipe 2020-04-22T14:17:23.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 14w REG 8,1 126203324 526778 /var/log/ceph/ceph-osd.3.log 2020-04-22T14:17:23.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 15uW REG 0,24 6 136402 /run/ceph/ceph-osd.3.pid 2020-04-22T14:17:23.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 16r FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:23.110 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 17w FIFO 0,13 0t0 136403 pipe 2020-04-22T14:17:23.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 18u unix 0x000000004f26b3cd 0t0 136404 /var/run/ceph/ceph-osd.3.asok type=STREAM 2020-04-22T14:17:23.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 19u IPv4 135626 0t0 TCP *:6824 (LISTEN) 2020-04-22T14:17:23.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 20u IPv4 135652 0t0 TCP *:6825 (LISTEN) 2020-04-22T14:17:23.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 21u IPv4 135679 0t0 TCP *:6826 (LISTEN) 2020-04-22T14:17:23.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 22u IPv4 135707 0t0 TCP *:6827 (LISTEN) 2020-04-22T14:17:23.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 23u IPv4 135736 0t0 TCP *:6828 (LISTEN) 2020-04-22T14:17:23.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 24u IPv4 135766 0t0 TCP *:6829 (LISTEN) 2020-04-22T14:17:23.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 25u IPv4 135797 0t0 TCP *:6830 (LISTEN) 2020-04-22T14:17:23.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 26u IPv4 131470 0t0 TCP *:ambit-lm (LISTEN) 2020-04-22T14:17:23.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 27r FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:23.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 28w FIFO 0,13 0t0 136410 pipe 2020-04-22T14:17:23.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 29r FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:23.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 30w FIFO 0,13 0t0 136411 pipe 2020-04-22T14:17:23.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 31r DIR 253,4 191 64 /var/lib/ceph/osd/ceph-3 2020-04-22T14:17:23.112 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 32uW REG 253,4 37 69 /var/lib/ceph/osd/ceph-3/fsid 2020-04-22T14:17:23.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 33uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 34uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 35uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 36uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 37uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 38uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.113 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 39uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 40uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 41uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 42uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 43uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 44uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 45uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.114 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 46uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 47uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 48uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 49uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 50uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 51uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 52uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 53uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.115 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 54uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 55uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 56uW REG 253,4 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2020-04-22T14:17:23.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 57r FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:23.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 58w FIFO 0,13 0t0 134928 pipe 2020-04-22T14:17:23.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 59u IPv4 129573 0t0 TCP smithi103:46606->smithi103:3300 (ESTABLISHED) 2020-04-22T14:17:23.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 60r FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:23.116 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 61w FIFO 0,13 0t0 134929 pipe 2020-04-22T14:17:23.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 62u IPv4 135000 0t0 TCP smithi103:43776->smithi103:6804 (ESTABLISHED) 2020-04-22T14:17:23.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 63u IPv4 137583 0t0 TCP smithi103:46386->smithi103:6806 (ESTABLISHED) 2020-04-22T14:17:23.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 64u IPv4 137584 0t0 TCP smithi103:43316->smithi103:6822 (ESTABLISHED) 2020-04-22T14:17:23.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 65u IPv4 135001 0t0 TCP smithi103:43264->smithi103:6820 (ESTABLISHED) 2020-04-22T14:17:23.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 66u IPv4 136526 0t0 TCP smithi103:55956->smithi103:6814 (ESTABLISHED) 2020-04-22T14:17:23.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 67u IPv4 137585 0t0 TCP smithi103:54350->smithi103:6812 (ESTABLISHED) 2020-04-22T14:17:23.117 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 68u IPv4 135002 0t0 TCP smithi103:51880->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:23.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 69u IPv4 129660 0t0 TCP smithi103:6828->smithi103:43784 (ESTABLISHED) 2020-04-22T14:17:23.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 70u IPv4 129663 0t0 TCP smithi103:6830->smithi103:41268 (ESTABLISHED) 2020-04-22T14:17:23.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 71u IPv4 132590 0t0 TCP smithi103:6830->smithi103:41286 (ESTABLISHED) 2020-04-22T14:17:23.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 72u IPv4 132591 0t0 TCP smithi103:6830->smithi103:41304 (ESTABLISHED) 2020-04-22T14:17:23.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 73u IPv4 132594 0t0 TCP smithi103:6828->smithi103:43800 (ESTABLISHED) 2020-04-22T14:17:23.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 74u IPv4 132595 0t0 TCP smithi103:6828->smithi103:43808 (ESTABLISHED) 2020-04-22T14:17:23.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 75u IPv4 129678 0t0 TCP smithi103:53922->smithi086.front.sepia.ceph.com:6808 (ESTABLISHED) 2020-04-22T14:17:23.118 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 76u IPv4 137586 0t0 TCP smithi103:52712->smithi086.front.sepia.ceph.com:6806 (ESTABLISHED) 2020-04-22T14:17:23.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 77u IPv4 129679 0t0 TCP smithi103:36666->smithi086.front.sepia.ceph.com:6822 (ESTABLISHED) 2020-04-22T14:17:23.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 78u IPv4 137587 0t0 TCP smithi103:60144->smithi086.front.sepia.ceph.com:6816 (ESTABLISHED) 2020-04-22T14:17:23.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 79u IPv4 136541 0t0 TCP smithi103:41656->smithi086.front.sepia.ceph.com:6824 (ESTABLISHED) 2020-04-22T14:17:23.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 80u IPv4 136542 0t0 TCP smithi103:46774->smithi086.front.sepia.ceph.com:6814 (ESTABLISHED) 2020-04-22T14:17:23.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 81u IPv4 137588 0t0 TCP smithi103:bacnet->smithi086.front.sepia.ceph.com:6832 (ESTABLISHED) 2020-04-22T14:17:23.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 82u IPv4 132602 0t0 TCP smithi103:56160->smithi086.front.sepia.ceph.com:6830 (ESTABLISHED) 2020-04-22T14:17:23.119 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 83u IPv4 137598 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47440 (ESTABLISHED) 2020-04-22T14:17:23.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 84u IPv4 137601 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47446 (ESTABLISHED) 2020-04-22T14:17:23.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 85u IPv4 135011 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44066 (ESTABLISHED) 2020-04-22T14:17:23.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 86u IPv4 135014 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47460 (ESTABLISHED) 2020-04-22T14:17:23.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 87u IPv4 135020 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44090 (ESTABLISHED) 2020-04-22T14:17:23.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 88u IPv4 132606 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44098 (ESTABLISHED) 2020-04-22T14:17:23.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 89u IPv4 135846 0t0 TCP smithi103:6828->smithi086.front.sepia.ceph.com:47516 (ESTABLISHED) 2020-04-22T14:17:23.120 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 90u IPv4 132609 0t0 TCP smithi103:6830->smithi086.front.sepia.ceph.com:44138 (ESTABLISHED) 2020-04-22T14:17:23.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 91u IPv4 338050 0t0 TCP smithi103:6824->smithi086.front.sepia.ceph.com:38832 (ESTABLISHED) 2020-04-22T14:17:23.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 92u IPv4 137620 0t0 TCP smithi103:6826->smithi103:48236 (ESTABLISHED) 2020-04-22T14:17:23.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 93u IPv4 129693 0t0 TCP smithi103:6826->smithi103:48248 (ESTABLISHED) 2020-04-22T14:17:23.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 94u IPv4 137623 0t0 TCP smithi103:6826->smithi103:48262 (ESTABLISHED) 2020-04-22T14:17:23.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 96u IPv4 132634 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54420 (ESTABLISHED) 2020-04-22T14:17:23.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 97u IPv4 132635 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54422 (ESTABLISHED) 2020-04-22T14:17:23.121 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 98u IPv4 135031 0t0 TCP smithi103:profinet-cm->smithi086.front.sepia.ceph.com:6804 (ESTABLISHED) 2020-04-22T14:17:23.122 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-osd 33183 33725 osd_srv_h root 100u IPv4 132638 0t0 TCP smithi103:6826->smithi086.front.sepia.ceph.com:54424 (ESTABLISHED) 2020-04-22T14:17:23.122 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/6 40200 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:23.122 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/6 40200 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.122 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/6 40200 root txt unknown /proc/40200/exe 2020-04-22T14:17:23.122 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/1 45789 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:23.122 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/1 45789 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.122 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/1 45789 root txt unknown /proc/45789/exe 2020-04-22T14:17:23.122 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/4 49006 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:23.123 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/4 49006 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.123 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/4 49006 root txt unknown /proc/49006/exe 2020-04-22T14:17:23.123 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/0 51693 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:23.123 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/0 51693 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.123 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/0 51693 root txt unknown /proc/51693/exe 2020-04-22T14:17:23.123 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/5 52341 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:23.123 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/5 52341 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.124 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/5 52341 root txt unknown /proc/52341/exe 2020-04-22T14:17:23.124 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/2 54585 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:23.124 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/2 54585 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.124 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/2 54585 root txt unknown /proc/54585/exe 2020-04-22T14:17:23.124 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/7 57770 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:23.124 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/7 57770 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.124 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/7 57770 root txt unknown /proc/57770/exe 2020-04-22T14:17:23.125 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/1 62721 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:23.125 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/1 62721 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.125 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/1 62721 root txt unknown /proc/62721/exe 2020-04-22T14:17:23.125 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/u 62892 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:23.125 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/u 62892 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.125 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/u 62892 root txt unknown /proc/62892/exe 2020-04-22T14:17:23.125 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/1 63219 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:23.125 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/1 63219 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.126 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/1 63219 root txt unknown /proc/63219/exe 2020-04-22T14:17:23.126 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/5 64404 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:23.126 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/5 64404 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.126 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/5 64404 root txt unknown /proc/64404/exe 2020-04-22T14:17:23.126 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/6 66732 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:23.126 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/6 66732 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.126 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/6 66732 root txt unknown /proc/66732/exe 2020-04-22T14:17:23.127 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/4 68513 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:23.127 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/4 68513 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.127 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/4 68513 root txt unknown /proc/68513/exe 2020-04-22T14:17:23.127 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/3 68965 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:23.127 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/3 68965 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.127 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/3 68965 root txt unknown /proc/68965/exe 2020-04-22T14:17:23.127 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/2 70879 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:23.128 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/2 70879 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.128 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/2 70879 root txt unknown /proc/70879/exe 2020-04-22T14:17:23.128 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/2 74008 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:23.128 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/2 74008 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.128 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/2 74008 root txt unknown /proc/74008/exe 2020-04-22T14:17:23.128 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/4 75352 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:23.128 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/4 75352 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.129 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/4 75352 root txt unknown /proc/75352/exe 2020-04-22T14:17:23.129 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/0 75354 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:23.129 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/0 75354 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.129 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/0 75354 root txt unknown /proc/75354/exe 2020-04-22T14:17:23.129 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/0 79786 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:23.129 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/0 79786 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.129 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/0 79786 root txt unknown /proc/79786/exe 2020-04-22T14:17:23.129 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/7 85990 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:23.130 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/7 85990 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.130 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/7 85990 root txt unknown /proc/85990/exe 2020-04-22T14:17:23.130 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/7 85991 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:23.130 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/7 85991 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.130 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/7 85991 root txt unknown /proc/85991/exe 2020-04-22T14:17:23.130 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/6 92817 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:23.130 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/6 92817 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.131 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/6 92817 root txt unknown /proc/92817/exe 2020-04-22T14:17:23.131 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/6 92818 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:23.131 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/6 92818 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.131 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/6 92818 root txt unknown /proc/92818/exe 2020-04-22T14:17:23.131 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/6 92819 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:23.131 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/6 92819 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.131 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/6 92819 root txt unknown /proc/92819/exe 2020-04-22T14:17:23.131 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/6 92820 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:23.132 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/6 92820 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.132 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/6 92820 root txt unknown /proc/92820/exe 2020-04-22T14:17:23.132 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/u 97105 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:23.132 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/u 97105 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.132 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/u 97105 root txt unknown /proc/97105/exe 2020-04-22T14:17:23.132 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/1 98606 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:23.132 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/1 98606 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.133 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/1 98606 root txt unknown /proc/98606/exe 2020-04-22T14:17:23.133 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/3 98938 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:23.133 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/3 98938 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.133 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/3 98938 root txt unknown /proc/98938/exe 2020-04-22T14:17:23.133 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/5 100052 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:23.133 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/5 100052 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.133 INFO:teuthology.orchestra.run.smithi103.stdout:kworker/5 100052 root txt unknown /proc/100052/exe 2020-04-22T14:17:23.134 INFO:teuthology.orchestra.run.smithi103.stdout:sleep 104472 root cwd DIR 8,1 4096 2 / 2020-04-22T14:17:23.134 INFO:teuthology.orchestra.run.smithi103.stdout:sleep 104472 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.134 INFO:teuthology.orchestra.run.smithi103.stdout:sleep 104472 root txt REG 8,1 91120 5480 /usr/bin/sleep 2020-04-22T14:17:23.134 INFO:teuthology.orchestra.run.smithi103.stdout:sleep 104472 root mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:23.134 INFO:teuthology.orchestra.run.smithi103.stdout:sleep 104472 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.134 INFO:teuthology.orchestra.run.smithi103.stdout:sleep 104472 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.134 INFO:teuthology.orchestra.run.smithi103.stdout:sleep 104472 root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:23.134 INFO:teuthology.orchestra.run.smithi103.stdout:sleep 104472 root mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:23.135 INFO:teuthology.orchestra.run.smithi103.stdout:sleep 104472 root mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:23.135 INFO:teuthology.orchestra.run.smithi103.stdout:sleep 104472 root mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:23.135 INFO:teuthology.orchestra.run.smithi103.stdout:sleep 104472 root mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:23.135 INFO:teuthology.orchestra.run.smithi103.stdout:sleep 104472 root mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:23.135 INFO:teuthology.orchestra.run.smithi103.stdout:sleep 104472 root mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:23.135 INFO:teuthology.orchestra.run.smithi103.stdout:sleep 104472 root mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:23.135 INFO:teuthology.orchestra.run.smithi103.stdout:sleep 104472 root mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:23.136 INFO:teuthology.orchestra.run.smithi103.stdout:sleep 104472 root mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:23.136 INFO:teuthology.orchestra.run.smithi103.stdout:sleep 104472 root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:23.136 INFO:teuthology.orchestra.run.smithi103.stdout:sleep 104472 root mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:23.136 INFO:teuthology.orchestra.run.smithi103.stdout:sleep 104472 root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.136 INFO:teuthology.orchestra.run.smithi103.stdout:sleep 104472 root 1u unix 0x0000000048b8626c 0t0 22340 type=STREAM 2020-04-22T14:17:23.136 INFO:teuthology.orchestra.run.smithi103.stdout:sleep 104472 root 2u unix 0x0000000048b8626c 0t0 22340 type=STREAM 2020-04-22T14:17:23.136 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:23.137 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.137 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root txt REG 8,1 207056 9178 /usr/bin/sudo 2020-04-22T14:17:23.137 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 16704 5754 /usr/lib64/libpam_misc.so.0.82.1 2020-04-22T14:17:23.137 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 855144 29339 /usr/lib64/security/pam_systemd.so 2020-04-22T14:17:23.137 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 24208 29040 /usr/lib64/security/pam_limits.so 2020-04-22T14:17:23.137 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 11888 29038 /usr/lib64/security/pam_keyinit.so 2020-04-22T14:17:23.137 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 46232 5216 /usr/lib64/libcrack.so.2.9.0 2020-04-22T14:17:23.138 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 25728 5682 /usr/lib64/libpwquality.so.1.0.2 2020-04-22T14:17:23.138 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 11896 29000 /usr/lib64/security/pam_pwquality.so 2020-04-22T14:17:23.138 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 7808 29049 /usr/lib64/security/pam_permit.so 2020-04-22T14:17:23.138 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 7704 29028 /usr/lib64/security/pam_deny.so 2020-04-22T14:17:23.138 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 68936 29798 /usr/lib64/security/pam_sss.so 2020-04-22T14:17:23.138 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 371032 5313 /usr/lib64/libtirpc.so.3.0.0 2020-04-22T14:17:23.138 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 116408 5315 /usr/lib64/libnsl.so.2.0.0 2020-04-22T14:17:23.139 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 61448 29065 /usr/lib64/security/pam_unix.so 2020-04-22T14:17:23.139 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 11912 29042 /usr/lib64/security/pam_localuser.so 2020-04-22T14:17:23.139 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 16088 29060 /usr/lib64/security/pam_succeed_if.so 2020-04-22T14:17:23.139 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 11880 29032 /usr/lib64/security/pam_faildelay.so 2020-04-22T14:17:23.139 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 20304 29030 /usr/lib64/security/pam_env.so 2020-04-22T14:17:23.139 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:23.139 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.139 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.140 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.140 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.140 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:23.140 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.140 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 860880 5511 /usr/lib64/libnss_systemd.so.2 2020-04-22T14:17:23.140 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:23.140 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:23.141 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 16240 3641 /usr/lib64/libkeyutils.so.1.6 2020-04-22T14:17:23.141 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 118728 5304 /usr/lib64/libkrb5support.so.0.1 2020-04-22T14:17:23.141 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 25992 3339 /usr/lib64/libcom_err.so.2.1 2020-04-22T14:17:23.141 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 273488 5296 /usr/lib64/libk5crypto.so.3.1 2020-04-22T14:17:23.141 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 1507952 5302 /usr/lib64/libkrb5.so.3.3 2020-04-22T14:17:23.141 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 603768 5292 /usr/lib64/libgssapi_krb5.so.2.2 2020-04-22T14:17:23.141 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 142712 3373 /usr/lib64/libcrypt.so.1.1.0 2020-04-22T14:17:23.141 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.142 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:23.142 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 149160 4994 /usr/lib64/libsasl2.so.3.0.0 2020-04-22T14:17:23.142 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.142 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.142 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 97056 5009 /usr/lib64/liblber-2.4.so.2.10.9 2020-04-22T14:17:23.142 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 477472 5011 /usr/lib64/libldap-2.4.so.2.10.9 2020-04-22T14:17:23.142 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 74600 5752 /usr/lib64/libpam.so.0.84.2 2020-04-22T14:17:23.143 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 549944 16572 /usr/libexec/sudo/sudoers.so 2020-04-22T14:17:23.143 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:23.143 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:23.143 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:23.143 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.143 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 25192 3584 /usr/lib64/libcap-ng.so.0.0.0 2020-04-22T14:17:23.143 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.143 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.144 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.144 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 182296 16569 /usr/libexec/sudo/libsudo_util.so.0.0.0 2020-04-22T14:17:23.144 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:23.144 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.144 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 141392 3586 /usr/lib64/libaudit.so.1.0.0 2020-04-22T14:17:23.144 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.144 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:23.145 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:23.145 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:23.145 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:23.145 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:23.145 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:23.145 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:23.145 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:23.146 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:23.146 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:23.146 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:23.146 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:23.146 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root 0r FIFO 0,13 0t0 329721 pipe 2020-04-22T14:17:23.146 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root 1w FIFO 0,13 0t0 329722 pipe 2020-04-22T14:17:23.146 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root 2w FIFO 0,13 0t0 329723 pipe 2020-04-22T14:17:23.147 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root 3r REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:23.147 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root 4u unix 0x0000000037048345 0t0 336039 type=STREAM 2020-04-22T14:17:23.147 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root 5u netlink 0t0 336047 AUDIT 2020-04-22T14:17:23.147 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root 6r REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:23.147 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root 7r REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:23.147 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root 9u unix 0x000000007122f023 0t0 336050 type=DGRAM 2020-04-22T14:17:23.147 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root 10r FIFO 0,13 0t0 336053 pipe 2020-04-22T14:17:23.147 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 104667 root 11w FIFO 0,13 0t0 336053 pipe 2020-04-22T14:17:23.148 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 104698 root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:23.148 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 104698 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.148 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 104698 root txt REG 8,1 15496 6602 /usr/libexec/platform-python3.6 2020-04-22T14:17:23.148 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 104698 root mem REG 8,1 59368 41092 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:23.148 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 104698 root mem REG 8,1 16632 41078 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:23.148 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 104698 root mem REG 8,1 52720 41084 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:23.148 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 104698 root mem REG 8,1 37448 41100 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:23.149 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 104698 root mem REG 8,1 19536 41090 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:23.149 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 104698 root mem REG 8,1 23056 41069 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:23.149 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 104698 root mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:23.149 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 104698 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.149 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 104698 root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.149 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 104698 root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:23.149 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 104698 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.150 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 104698 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.150 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 104698 root mem REG 8,1 3371672 6608 /usr/lib64/libpython3.6m.so.1.0 2020-04-22T14:17:23.150 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 104698 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.150 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 104698 root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:23.150 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 104698 root mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:23.150 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 104698 root mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:23.150 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 104698 root mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:23.150 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 104698 root mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:23.151 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 104698 root mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:23.151 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 104698 root mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:23.151 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 104698 root mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:23.151 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 104698 root mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:23.151 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 104698 root mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:23.151 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 104698 root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:23.151 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 104698 root mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:23.152 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 104698 root 0r FIFO 0,13 0t0 329721 pipe 2020-04-22T14:17:23.152 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 104698 root 1w FIFO 0,13 0t0 329722 pipe 2020-04-22T14:17:23.152 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 104698 root 2w FIFO 0,13 0t0 329723 pipe 2020-04-22T14:17:23.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:23.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root txt REG 8,1 7692408 10520 /usr/bin/ceph-mds 2020-04-22T14:17:23.152 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.153 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:23.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.154 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.155 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:23.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:23.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.156 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root 1w FIFO 0,13 0t0 329722 pipe 2020-04-22T14:17:23.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root 2w FIFO 0,13 0t0 329723 pipe 2020-04-22T14:17:23.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root 3r FIFO 0,13 0t0 332649 pipe 2020-04-22T14:17:23.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root 4w FIFO 0,13 0t0 332649 pipe 2020-04-22T14:17:23.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root 6r FIFO 0,13 0t0 332650 pipe 2020-04-22T14:17:23.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root 7w FIFO 0,13 0t0 332650 pipe 2020-04-22T14:17:23.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.157 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root 9r FIFO 0,13 0t0 332651 pipe 2020-04-22T14:17:23.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root 10w FIFO 0,13 0t0 332651 pipe 2020-04-22T14:17:23.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root 12r FIFO 0,13 0t0 332652 pipe 2020-04-22T14:17:23.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root 13w FIFO 0,13 0t0 332652 pipe 2020-04-22T14:17:23.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root 14w REG 8,1 15361376 526800 /var/log/ceph/ceph-mds.a.log 2020-04-22T14:17:23.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root 15uW REG 0,24 7 133049 /run/ceph/ceph-mds.a.pid 2020-04-22T14:17:23.158 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root 16r FIFO 0,13 0t0 333529 pipe 2020-04-22T14:17:23.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root 17w FIFO 0,13 0t0 333529 pipe 2020-04-22T14:17:23.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root 18u unix 0x0000000083fca076 0t0 333530 /var/run/ceph/ceph-mds.a.asok type=STREAM 2020-04-22T14:17:23.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root 19u IPv4 336087 0t0 TCP *:6832 (LISTEN) 2020-04-22T14:17:23.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root 20u IPv4 336121 0t0 TCP *:6833 (LISTEN) 2020-04-22T14:17:23.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root 21r FIFO 0,13 0t0 333533 pipe 2020-04-22T14:17:23.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root 22w FIFO 0,13 0t0 333533 pipe 2020-04-22T14:17:23.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root 23r FIFO 0,13 0t0 333534 pipe 2020-04-22T14:17:23.159 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root 24w FIFO 0,13 0t0 333534 pipe 2020-04-22T14:17:23.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root 25u IPv4 335090 0t0 TCP smithi103:41274->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:23.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root 26r FIFO 0,13 0t0 333535 pipe 2020-04-22T14:17:23.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root 27w FIFO 0,13 0t0 333535 pipe 2020-04-22T14:17:23.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root 28r FIFO 0,13 0t0 333536 pipe 2020-04-22T14:17:23.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root 29w FIFO 0,13 0t0 333536 pipe 2020-04-22T14:17:23.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 root 30u IPv4 332657 0t0 TCP smithi103:33522->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:23.160 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:23.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root txt REG 8,1 7692408 10520 /usr/bin/ceph-mds 2020-04-22T14:17:23.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.161 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.162 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:23.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.163 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:23.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:23.164 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root 1w FIFO 0,13 0t0 329722 pipe 2020-04-22T14:17:23.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root 2w FIFO 0,13 0t0 329723 pipe 2020-04-22T14:17:23.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root 3r FIFO 0,13 0t0 332649 pipe 2020-04-22T14:17:23.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root 4w FIFO 0,13 0t0 332649 pipe 2020-04-22T14:17:23.165 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root 6r FIFO 0,13 0t0 332650 pipe 2020-04-22T14:17:23.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root 7w FIFO 0,13 0t0 332650 pipe 2020-04-22T14:17:23.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root 9r FIFO 0,13 0t0 332651 pipe 2020-04-22T14:17:23.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root 10w FIFO 0,13 0t0 332651 pipe 2020-04-22T14:17:23.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root 12r FIFO 0,13 0t0 332652 pipe 2020-04-22T14:17:23.166 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root 13w FIFO 0,13 0t0 332652 pipe 2020-04-22T14:17:23.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root 14w REG 8,1 15361376 526800 /var/log/ceph/ceph-mds.a.log 2020-04-22T14:17:23.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root 15uW REG 0,24 7 133049 /run/ceph/ceph-mds.a.pid 2020-04-22T14:17:23.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root 16r FIFO 0,13 0t0 333529 pipe 2020-04-22T14:17:23.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root 17w FIFO 0,13 0t0 333529 pipe 2020-04-22T14:17:23.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root 18u unix 0x0000000083fca076 0t0 333530 /var/run/ceph/ceph-mds.a.asok type=STREAM 2020-04-22T14:17:23.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root 19u IPv4 336087 0t0 TCP *:6832 (LISTEN) 2020-04-22T14:17:23.167 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root 20u IPv4 336121 0t0 TCP *:6833 (LISTEN) 2020-04-22T14:17:23.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root 21r FIFO 0,13 0t0 333533 pipe 2020-04-22T14:17:23.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root 22w FIFO 0,13 0t0 333533 pipe 2020-04-22T14:17:23.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root 23r FIFO 0,13 0t0 333534 pipe 2020-04-22T14:17:23.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root 24w FIFO 0,13 0t0 333534 pipe 2020-04-22T14:17:23.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root 25u IPv4 335090 0t0 TCP smithi103:41274->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:23.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root 26r FIFO 0,13 0t0 333535 pipe 2020-04-22T14:17:23.168 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root 27w FIFO 0,13 0t0 333535 pipe 2020-04-22T14:17:23.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root 28r FIFO 0,13 0t0 333536 pipe 2020-04-22T14:17:23.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root 29w FIFO 0,13 0t0 333536 pipe 2020-04-22T14:17:23.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104712 log root 30u IPv4 332657 0t0 TCP smithi103:33522->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:23.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:23.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root txt REG 8,1 7692408 10520 /usr/bin/ceph-mds 2020-04-22T14:17:23.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.169 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.170 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:23.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.171 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.172 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:23.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:23.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root 1w FIFO 0,13 0t0 329722 pipe 2020-04-22T14:17:23.173 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root 2w FIFO 0,13 0t0 329723 pipe 2020-04-22T14:17:23.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root 3r FIFO 0,13 0t0 332649 pipe 2020-04-22T14:17:23.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root 4w FIFO 0,13 0t0 332649 pipe 2020-04-22T14:17:23.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root 6r FIFO 0,13 0t0 332650 pipe 2020-04-22T14:17:23.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root 7w FIFO 0,13 0t0 332650 pipe 2020-04-22T14:17:23.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.174 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root 9r FIFO 0,13 0t0 332651 pipe 2020-04-22T14:17:23.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root 10w FIFO 0,13 0t0 332651 pipe 2020-04-22T14:17:23.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root 12r FIFO 0,13 0t0 332652 pipe 2020-04-22T14:17:23.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root 13w FIFO 0,13 0t0 332652 pipe 2020-04-22T14:17:23.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root 14w REG 8,1 15361376 526800 /var/log/ceph/ceph-mds.a.log 2020-04-22T14:17:23.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root 15uW REG 0,24 7 133049 /run/ceph/ceph-mds.a.pid 2020-04-22T14:17:23.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root 16r FIFO 0,13 0t0 333529 pipe 2020-04-22T14:17:23.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root 17w FIFO 0,13 0t0 333529 pipe 2020-04-22T14:17:23.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root 18u unix 0x0000000083fca076 0t0 333530 /var/run/ceph/ceph-mds.a.asok type=STREAM 2020-04-22T14:17:23.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root 19u IPv4 336087 0t0 TCP *:6832 (LISTEN) 2020-04-22T14:17:23.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root 20u IPv4 336121 0t0 TCP *:6833 (LISTEN) 2020-04-22T14:17:23.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root 21r FIFO 0,13 0t0 333533 pipe 2020-04-22T14:17:23.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root 22w FIFO 0,13 0t0 333533 pipe 2020-04-22T14:17:23.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root 23r FIFO 0,13 0t0 333534 pipe 2020-04-22T14:17:23.176 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root 24w FIFO 0,13 0t0 333534 pipe 2020-04-22T14:17:23.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root 25u IPv4 335090 0t0 TCP smithi103:41274->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:23.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root 26r FIFO 0,13 0t0 333535 pipe 2020-04-22T14:17:23.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root 27w FIFO 0,13 0t0 333535 pipe 2020-04-22T14:17:23.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root 28r FIFO 0,13 0t0 333536 pipe 2020-04-22T14:17:23.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root 29w FIFO 0,13 0t0 333536 pipe 2020-04-22T14:17:23.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104713 msgr-work root 30u IPv4 332657 0t0 TCP smithi103:33522->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:23.177 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:23.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root txt REG 8,1 7692408 10520 /usr/bin/ceph-mds 2020-04-22T14:17:23.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:23.179 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.180 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:23.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:23.181 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root 1w FIFO 0,13 0t0 329722 pipe 2020-04-22T14:17:23.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root 2w FIFO 0,13 0t0 329723 pipe 2020-04-22T14:17:23.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root 3r FIFO 0,13 0t0 332649 pipe 2020-04-22T14:17:23.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root 4w FIFO 0,13 0t0 332649 pipe 2020-04-22T14:17:23.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.182 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root 6r FIFO 0,13 0t0 332650 pipe 2020-04-22T14:17:23.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root 7w FIFO 0,13 0t0 332650 pipe 2020-04-22T14:17:23.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root 9r FIFO 0,13 0t0 332651 pipe 2020-04-22T14:17:23.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root 10w FIFO 0,13 0t0 332651 pipe 2020-04-22T14:17:23.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root 12r FIFO 0,13 0t0 332652 pipe 2020-04-22T14:17:23.183 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root 13w FIFO 0,13 0t0 332652 pipe 2020-04-22T14:17:23.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root 14w REG 8,1 15361376 526800 /var/log/ceph/ceph-mds.a.log 2020-04-22T14:17:23.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root 15uW REG 0,24 7 133049 /run/ceph/ceph-mds.a.pid 2020-04-22T14:17:23.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root 16r FIFO 0,13 0t0 333529 pipe 2020-04-22T14:17:23.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root 17w FIFO 0,13 0t0 333529 pipe 2020-04-22T14:17:23.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root 18u unix 0x0000000083fca076 0t0 333530 /var/run/ceph/ceph-mds.a.asok type=STREAM 2020-04-22T14:17:23.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root 19u IPv4 336087 0t0 TCP *:6832 (LISTEN) 2020-04-22T14:17:23.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root 20u IPv4 336121 0t0 TCP *:6833 (LISTEN) 2020-04-22T14:17:23.184 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root 21r FIFO 0,13 0t0 333533 pipe 2020-04-22T14:17:23.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root 22w FIFO 0,13 0t0 333533 pipe 2020-04-22T14:17:23.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root 23r FIFO 0,13 0t0 333534 pipe 2020-04-22T14:17:23.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root 24w FIFO 0,13 0t0 333534 pipe 2020-04-22T14:17:23.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root 25u IPv4 335090 0t0 TCP smithi103:41274->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:23.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root 26r FIFO 0,13 0t0 333535 pipe 2020-04-22T14:17:23.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root 27w FIFO 0,13 0t0 333535 pipe 2020-04-22T14:17:23.185 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root 28r FIFO 0,13 0t0 333536 pipe 2020-04-22T14:17:23.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root 29w FIFO 0,13 0t0 333536 pipe 2020-04-22T14:17:23.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104714 msgr-work root 30u IPv4 332657 0t0 TCP smithi103:33522->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:23.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:23.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root txt REG 8,1 7692408 10520 /usr/bin/ceph-mds 2020-04-22T14:17:23.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.186 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.187 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:23.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.188 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.189 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:23.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:23.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root 1w FIFO 0,13 0t0 329722 pipe 2020-04-22T14:17:23.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root 2w FIFO 0,13 0t0 329723 pipe 2020-04-22T14:17:23.190 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root 3r FIFO 0,13 0t0 332649 pipe 2020-04-22T14:17:23.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root 4w FIFO 0,13 0t0 332649 pipe 2020-04-22T14:17:23.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root 6r FIFO 0,13 0t0 332650 pipe 2020-04-22T14:17:23.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root 7w FIFO 0,13 0t0 332650 pipe 2020-04-22T14:17:23.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root 9r FIFO 0,13 0t0 332651 pipe 2020-04-22T14:17:23.191 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root 10w FIFO 0,13 0t0 332651 pipe 2020-04-22T14:17:23.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root 12r FIFO 0,13 0t0 332652 pipe 2020-04-22T14:17:23.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root 13w FIFO 0,13 0t0 332652 pipe 2020-04-22T14:17:23.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root 14w REG 8,1 15361376 526800 /var/log/ceph/ceph-mds.a.log 2020-04-22T14:17:23.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root 15uW REG 0,24 7 133049 /run/ceph/ceph-mds.a.pid 2020-04-22T14:17:23.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root 16r FIFO 0,13 0t0 333529 pipe 2020-04-22T14:17:23.192 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root 17w FIFO 0,13 0t0 333529 pipe 2020-04-22T14:17:23.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root 18u unix 0x0000000083fca076 0t0 333530 /var/run/ceph/ceph-mds.a.asok type=STREAM 2020-04-22T14:17:23.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root 19u IPv4 336087 0t0 TCP *:6832 (LISTEN) 2020-04-22T14:17:23.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root 20u IPv4 336121 0t0 TCP *:6833 (LISTEN) 2020-04-22T14:17:23.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root 21r FIFO 0,13 0t0 333533 pipe 2020-04-22T14:17:23.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root 22w FIFO 0,13 0t0 333533 pipe 2020-04-22T14:17:23.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root 23r FIFO 0,13 0t0 333534 pipe 2020-04-22T14:17:23.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root 24w FIFO 0,13 0t0 333534 pipe 2020-04-22T14:17:23.193 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root 25u IPv4 335090 0t0 TCP smithi103:41274->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:23.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root 26r FIFO 0,13 0t0 333535 pipe 2020-04-22T14:17:23.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root 27w FIFO 0,13 0t0 333535 pipe 2020-04-22T14:17:23.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root 28r FIFO 0,13 0t0 333536 pipe 2020-04-22T14:17:23.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root 29w FIFO 0,13 0t0 333536 pipe 2020-04-22T14:17:23.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104715 msgr-work root 30u IPv4 332657 0t0 TCP smithi103:33522->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:23.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:23.194 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root txt REG 8,1 7692408 10520 /usr/bin/ceph-mds 2020-04-22T14:17:23.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.195 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:23.196 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.197 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:23.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:23.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.198 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root 1w FIFO 0,13 0t0 329722 pipe 2020-04-22T14:17:23.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root 2w FIFO 0,13 0t0 329723 pipe 2020-04-22T14:17:23.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root 3r FIFO 0,13 0t0 332649 pipe 2020-04-22T14:17:23.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root 4w FIFO 0,13 0t0 332649 pipe 2020-04-22T14:17:23.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root 6r FIFO 0,13 0t0 332650 pipe 2020-04-22T14:17:23.199 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root 7w FIFO 0,13 0t0 332650 pipe 2020-04-22T14:17:23.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root 9r FIFO 0,13 0t0 332651 pipe 2020-04-22T14:17:23.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root 10w FIFO 0,13 0t0 332651 pipe 2020-04-22T14:17:23.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root 12r FIFO 0,13 0t0 332652 pipe 2020-04-22T14:17:23.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root 13w FIFO 0,13 0t0 332652 pipe 2020-04-22T14:17:23.200 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root 14w REG 8,1 15361376 526800 /var/log/ceph/ceph-mds.a.log 2020-04-22T14:17:23.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root 15uW REG 0,24 7 133049 /run/ceph/ceph-mds.a.pid 2020-04-22T14:17:23.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root 16r FIFO 0,13 0t0 333529 pipe 2020-04-22T14:17:23.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root 17w FIFO 0,13 0t0 333529 pipe 2020-04-22T14:17:23.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root 18u unix 0x0000000083fca076 0t0 333530 /var/run/ceph/ceph-mds.a.asok type=STREAM 2020-04-22T14:17:23.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root 19u IPv4 336087 0t0 TCP *:6832 (LISTEN) 2020-04-22T14:17:23.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root 20u IPv4 336121 0t0 TCP *:6833 (LISTEN) 2020-04-22T14:17:23.201 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root 21r FIFO 0,13 0t0 333533 pipe 2020-04-22T14:17:23.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root 22w FIFO 0,13 0t0 333533 pipe 2020-04-22T14:17:23.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root 23r FIFO 0,13 0t0 333534 pipe 2020-04-22T14:17:23.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root 24w FIFO 0,13 0t0 333534 pipe 2020-04-22T14:17:23.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root 25u IPv4 335090 0t0 TCP smithi103:41274->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:23.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root 26r FIFO 0,13 0t0 333535 pipe 2020-04-22T14:17:23.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root 27w FIFO 0,13 0t0 333535 pipe 2020-04-22T14:17:23.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root 28r FIFO 0,13 0t0 333536 pipe 2020-04-22T14:17:23.202 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root 29w FIFO 0,13 0t0 333536 pipe 2020-04-22T14:17:23.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104722 service root 30u IPv4 332657 0t0 TCP smithi103:33522->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:23.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:23.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root txt REG 8,1 7692408 10520 /usr/bin/ceph-mds 2020-04-22T14:17:23.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.203 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.204 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:23.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.205 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.206 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:23.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:23.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root 1w FIFO 0,13 0t0 329722 pipe 2020-04-22T14:17:23.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root 2w FIFO 0,13 0t0 329723 pipe 2020-04-22T14:17:23.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root 3r FIFO 0,13 0t0 332649 pipe 2020-04-22T14:17:23.207 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root 4w FIFO 0,13 0t0 332649 pipe 2020-04-22T14:17:23.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root 6r FIFO 0,13 0t0 332650 pipe 2020-04-22T14:17:23.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root 7w FIFO 0,13 0t0 332650 pipe 2020-04-22T14:17:23.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root 9r FIFO 0,13 0t0 332651 pipe 2020-04-22T14:17:23.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root 10w FIFO 0,13 0t0 332651 pipe 2020-04-22T14:17:23.208 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root 12r FIFO 0,13 0t0 332652 pipe 2020-04-22T14:17:23.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root 13w FIFO 0,13 0t0 332652 pipe 2020-04-22T14:17:23.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root 14w REG 8,1 15361376 526800 /var/log/ceph/ceph-mds.a.log 2020-04-22T14:17:23.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root 15uW REG 0,24 7 133049 /run/ceph/ceph-mds.a.pid 2020-04-22T14:17:23.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root 16r FIFO 0,13 0t0 333529 pipe 2020-04-22T14:17:23.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root 17w FIFO 0,13 0t0 333529 pipe 2020-04-22T14:17:23.209 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root 18u unix 0x0000000083fca076 0t0 333530 /var/run/ceph/ceph-mds.a.asok type=STREAM 2020-04-22T14:17:23.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root 19u IPv4 336087 0t0 TCP *:6832 (LISTEN) 2020-04-22T14:17:23.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root 20u IPv4 336121 0t0 TCP *:6833 (LISTEN) 2020-04-22T14:17:23.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root 21r FIFO 0,13 0t0 333533 pipe 2020-04-22T14:17:23.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root 22w FIFO 0,13 0t0 333533 pipe 2020-04-22T14:17:23.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root 23r FIFO 0,13 0t0 333534 pipe 2020-04-22T14:17:23.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root 24w FIFO 0,13 0t0 333534 pipe 2020-04-22T14:17:23.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root 25u IPv4 335090 0t0 TCP smithi103:41274->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:23.210 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root 26r FIFO 0,13 0t0 333535 pipe 2020-04-22T14:17:23.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root 27w FIFO 0,13 0t0 333535 pipe 2020-04-22T14:17:23.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root 28r FIFO 0,13 0t0 333536 pipe 2020-04-22T14:17:23.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root 29w FIFO 0,13 0t0 333536 pipe 2020-04-22T14:17:23.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104723 admin_soc root 30u IPv4 332657 0t0 TCP smithi103:33522->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:23.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:23.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.211 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root txt REG 8,1 7692408 10520 /usr/bin/ceph-mds 2020-04-22T14:17:23.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.212 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:23.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.213 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.214 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:23.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:23.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.215 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root 1w FIFO 0,13 0t0 329722 pipe 2020-04-22T14:17:23.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root 2w FIFO 0,13 0t0 329723 pipe 2020-04-22T14:17:23.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root 3r FIFO 0,13 0t0 332649 pipe 2020-04-22T14:17:23.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root 4w FIFO 0,13 0t0 332649 pipe 2020-04-22T14:17:23.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root 6r FIFO 0,13 0t0 332650 pipe 2020-04-22T14:17:23.216 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root 7w FIFO 0,13 0t0 332650 pipe 2020-04-22T14:17:23.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root 9r FIFO 0,13 0t0 332651 pipe 2020-04-22T14:17:23.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root 10w FIFO 0,13 0t0 332651 pipe 2020-04-22T14:17:23.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root 12r FIFO 0,13 0t0 332652 pipe 2020-04-22T14:17:23.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root 13w FIFO 0,13 0t0 332652 pipe 2020-04-22T14:17:23.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root 14w REG 8,1 15361376 526800 /var/log/ceph/ceph-mds.a.log 2020-04-22T14:17:23.217 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root 15uW REG 0,24 7 133049 /run/ceph/ceph-mds.a.pid 2020-04-22T14:17:23.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root 16r FIFO 0,13 0t0 333529 pipe 2020-04-22T14:17:23.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root 17w FIFO 0,13 0t0 333529 pipe 2020-04-22T14:17:23.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root 18u unix 0x0000000083fca076 0t0 333530 /var/run/ceph/ceph-mds.a.asok type=STREAM 2020-04-22T14:17:23.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root 19u IPv4 336087 0t0 TCP *:6832 (LISTEN) 2020-04-22T14:17:23.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root 20u IPv4 336121 0t0 TCP *:6833 (LISTEN) 2020-04-22T14:17:23.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root 21r FIFO 0,13 0t0 333533 pipe 2020-04-22T14:17:23.218 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root 22w FIFO 0,13 0t0 333533 pipe 2020-04-22T14:17:23.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root 23r FIFO 0,13 0t0 333534 pipe 2020-04-22T14:17:23.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root 24w FIFO 0,13 0t0 333534 pipe 2020-04-22T14:17:23.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root 25u IPv4 335090 0t0 TCP smithi103:41274->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:23.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root 26r FIFO 0,13 0t0 333535 pipe 2020-04-22T14:17:23.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root 27w FIFO 0,13 0t0 333535 pipe 2020-04-22T14:17:23.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root 28r FIFO 0,13 0t0 333536 pipe 2020-04-22T14:17:23.219 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root 29w FIFO 0,13 0t0 333536 pipe 2020-04-22T14:17:23.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104726 signal_ha root 30u IPv4 332657 0t0 TCP smithi103:33522->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:23.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:23.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root txt REG 8,1 7692408 10520 /usr/bin/ceph-mds 2020-04-22T14:17:23.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.220 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.221 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.222 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:23.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.223 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.224 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:23.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:23.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.225 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root 1w FIFO 0,13 0t0 329722 pipe 2020-04-22T14:17:23.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root 2w FIFO 0,13 0t0 329723 pipe 2020-04-22T14:17:23.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root 3r FIFO 0,13 0t0 332649 pipe 2020-04-22T14:17:23.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root 4w FIFO 0,13 0t0 332649 pipe 2020-04-22T14:17:23.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root 6r FIFO 0,13 0t0 332650 pipe 2020-04-22T14:17:23.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root 7w FIFO 0,13 0t0 332650 pipe 2020-04-22T14:17:23.226 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root 9r FIFO 0,13 0t0 332651 pipe 2020-04-22T14:17:23.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root 10w FIFO 0,13 0t0 332651 pipe 2020-04-22T14:17:23.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root 12r FIFO 0,13 0t0 332652 pipe 2020-04-22T14:17:23.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root 13w FIFO 0,13 0t0 332652 pipe 2020-04-22T14:17:23.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root 14w REG 8,1 15361376 526800 /var/log/ceph/ceph-mds.a.log 2020-04-22T14:17:23.227 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root 15uW REG 0,24 7 133049 /run/ceph/ceph-mds.a.pid 2020-04-22T14:17:23.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root 16r FIFO 0,13 0t0 333529 pipe 2020-04-22T14:17:23.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root 17w FIFO 0,13 0t0 333529 pipe 2020-04-22T14:17:23.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root 18u unix 0x0000000083fca076 0t0 333530 /var/run/ceph/ceph-mds.a.asok type=STREAM 2020-04-22T14:17:23.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root 19u IPv4 336087 0t0 TCP *:6832 (LISTEN) 2020-04-22T14:17:23.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root 20u IPv4 336121 0t0 TCP *:6833 (LISTEN) 2020-04-22T14:17:23.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root 21r FIFO 0,13 0t0 333533 pipe 2020-04-22T14:17:23.228 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root 22w FIFO 0,13 0t0 333533 pipe 2020-04-22T14:17:23.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root 23r FIFO 0,13 0t0 333534 pipe 2020-04-22T14:17:23.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root 24w FIFO 0,13 0t0 333534 pipe 2020-04-22T14:17:23.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root 25u IPv4 335090 0t0 TCP smithi103:41274->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:23.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root 26r FIFO 0,13 0t0 333535 pipe 2020-04-22T14:17:23.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root 27w FIFO 0,13 0t0 333535 pipe 2020-04-22T14:17:23.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root 28r FIFO 0,13 0t0 333536 pipe 2020-04-22T14:17:23.229 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root 29w FIFO 0,13 0t0 333536 pipe 2020-04-22T14:17:23.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104727 ms_dispat root 30u IPv4 332657 0t0 TCP smithi103:33522->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:23.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:23.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root txt REG 8,1 7692408 10520 /usr/bin/ceph-mds 2020-04-22T14:17:23.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.230 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.231 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:23.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.232 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.233 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:23.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:23.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root 1w FIFO 0,13 0t0 329722 pipe 2020-04-22T14:17:23.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root 2w FIFO 0,13 0t0 329723 pipe 2020-04-22T14:17:23.234 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root 3r FIFO 0,13 0t0 332649 pipe 2020-04-22T14:17:23.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root 4w FIFO 0,13 0t0 332649 pipe 2020-04-22T14:17:23.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root 6r FIFO 0,13 0t0 332650 pipe 2020-04-22T14:17:23.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root 7w FIFO 0,13 0t0 332650 pipe 2020-04-22T14:17:23.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root 9r FIFO 0,13 0t0 332651 pipe 2020-04-22T14:17:23.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root 10w FIFO 0,13 0t0 332651 pipe 2020-04-22T14:17:23.235 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root 12r FIFO 0,13 0t0 332652 pipe 2020-04-22T14:17:23.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root 13w FIFO 0,13 0t0 332652 pipe 2020-04-22T14:17:23.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root 14w REG 8,1 15361376 526800 /var/log/ceph/ceph-mds.a.log 2020-04-22T14:17:23.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root 15uW REG 0,24 7 133049 /run/ceph/ceph-mds.a.pid 2020-04-22T14:17:23.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root 16r FIFO 0,13 0t0 333529 pipe 2020-04-22T14:17:23.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root 17w FIFO 0,13 0t0 333529 pipe 2020-04-22T14:17:23.236 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root 18u unix 0x0000000083fca076 0t0 333530 /var/run/ceph/ceph-mds.a.asok type=STREAM 2020-04-22T14:17:23.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root 19u IPv4 336087 0t0 TCP *:6832 (LISTEN) 2020-04-22T14:17:23.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root 20u IPv4 336121 0t0 TCP *:6833 (LISTEN) 2020-04-22T14:17:23.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root 21r FIFO 0,13 0t0 333533 pipe 2020-04-22T14:17:23.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root 22w FIFO 0,13 0t0 333533 pipe 2020-04-22T14:17:23.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root 23r FIFO 0,13 0t0 333534 pipe 2020-04-22T14:17:23.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root 24w FIFO 0,13 0t0 333534 pipe 2020-04-22T14:17:23.237 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root 25u IPv4 335090 0t0 TCP smithi103:41274->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:23.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root 26r FIFO 0,13 0t0 333535 pipe 2020-04-22T14:17:23.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root 27w FIFO 0,13 0t0 333535 pipe 2020-04-22T14:17:23.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root 28r FIFO 0,13 0t0 333536 pipe 2020-04-22T14:17:23.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root 29w FIFO 0,13 0t0 333536 pipe 2020-04-22T14:17:23.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104728 ms_local root 30u IPv4 332657 0t0 TCP smithi103:33522->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:23.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:23.238 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root txt REG 8,1 7692408 10520 /usr/bin/ceph-mds 2020-04-22T14:17:23.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.239 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:23.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.240 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.241 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:23.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:23.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.242 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root 1w FIFO 0,13 0t0 329722 pipe 2020-04-22T14:17:23.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root 2w FIFO 0,13 0t0 329723 pipe 2020-04-22T14:17:23.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root 3r FIFO 0,13 0t0 332649 pipe 2020-04-22T14:17:23.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root 4w FIFO 0,13 0t0 332649 pipe 2020-04-22T14:17:23.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.243 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root 6r FIFO 0,13 0t0 332650 pipe 2020-04-22T14:17:23.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root 7w FIFO 0,13 0t0 332650 pipe 2020-04-22T14:17:23.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root 9r FIFO 0,13 0t0 332651 pipe 2020-04-22T14:17:23.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root 10w FIFO 0,13 0t0 332651 pipe 2020-04-22T14:17:23.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root 12r FIFO 0,13 0t0 332652 pipe 2020-04-22T14:17:23.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root 13w FIFO 0,13 0t0 332652 pipe 2020-04-22T14:17:23.244 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root 14w REG 8,1 15361376 526800 /var/log/ceph/ceph-mds.a.log 2020-04-22T14:17:23.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root 15uW REG 0,24 7 133049 /run/ceph/ceph-mds.a.pid 2020-04-22T14:17:23.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root 16r FIFO 0,13 0t0 333529 pipe 2020-04-22T14:17:23.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root 17w FIFO 0,13 0t0 333529 pipe 2020-04-22T14:17:23.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root 18u unix 0x0000000083fca076 0t0 333530 /var/run/ceph/ceph-mds.a.asok type=STREAM 2020-04-22T14:17:23.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root 19u IPv4 336087 0t0 TCP *:6832 (LISTEN) 2020-04-22T14:17:23.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root 20u IPv4 336121 0t0 TCP *:6833 (LISTEN) 2020-04-22T14:17:23.245 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root 21r FIFO 0,13 0t0 333533 pipe 2020-04-22T14:17:23.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root 22w FIFO 0,13 0t0 333533 pipe 2020-04-22T14:17:23.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root 23r FIFO 0,13 0t0 333534 pipe 2020-04-22T14:17:23.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root 24w FIFO 0,13 0t0 333534 pipe 2020-04-22T14:17:23.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root 25u IPv4 335090 0t0 TCP smithi103:41274->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:23.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root 26r FIFO 0,13 0t0 333535 pipe 2020-04-22T14:17:23.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root 27w FIFO 0,13 0t0 333535 pipe 2020-04-22T14:17:23.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root 28r FIFO 0,13 0t0 333536 pipe 2020-04-22T14:17:23.246 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root 29w FIFO 0,13 0t0 333536 pipe 2020-04-22T14:17:23.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104729 safe_time root 30u IPv4 332657 0t0 TCP smithi103:33522->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:23.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:23.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root txt REG 8,1 7692408 10520 /usr/bin/ceph-mds 2020-04-22T14:17:23.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.247 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:23.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.249 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.250 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:23.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:23.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root 1w FIFO 0,13 0t0 329722 pipe 2020-04-22T14:17:23.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root 2w FIFO 0,13 0t0 329723 pipe 2020-04-22T14:17:23.251 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root 3r FIFO 0,13 0t0 332649 pipe 2020-04-22T14:17:23.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root 4w FIFO 0,13 0t0 332649 pipe 2020-04-22T14:17:23.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root 6r FIFO 0,13 0t0 332650 pipe 2020-04-22T14:17:23.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root 7w FIFO 0,13 0t0 332650 pipe 2020-04-22T14:17:23.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root 9r FIFO 0,13 0t0 332651 pipe 2020-04-22T14:17:23.252 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root 10w FIFO 0,13 0t0 332651 pipe 2020-04-22T14:17:23.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root 12r FIFO 0,13 0t0 332652 pipe 2020-04-22T14:17:23.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root 13w FIFO 0,13 0t0 332652 pipe 2020-04-22T14:17:23.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root 14w REG 8,1 15361376 526800 /var/log/ceph/ceph-mds.a.log 2020-04-22T14:17:23.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root 15uW REG 0,24 7 133049 /run/ceph/ceph-mds.a.pid 2020-04-22T14:17:23.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root 16r FIFO 0,13 0t0 333529 pipe 2020-04-22T14:17:23.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root 17w FIFO 0,13 0t0 333529 pipe 2020-04-22T14:17:23.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root 18u unix 0x0000000083fca076 0t0 333530 /var/run/ceph/ceph-mds.a.asok type=STREAM 2020-04-22T14:17:23.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root 19u IPv4 336087 0t0 TCP *:6832 (LISTEN) 2020-04-22T14:17:23.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root 20u IPv4 336121 0t0 TCP *:6833 (LISTEN) 2020-04-22T14:17:23.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root 21r FIFO 0,13 0t0 333533 pipe 2020-04-22T14:17:23.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root 22w FIFO 0,13 0t0 333533 pipe 2020-04-22T14:17:23.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root 23r FIFO 0,13 0t0 333534 pipe 2020-04-22T14:17:23.254 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root 24w FIFO 0,13 0t0 333534 pipe 2020-04-22T14:17:23.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root 25u IPv4 335090 0t0 TCP smithi103:41274->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:23.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root 26r FIFO 0,13 0t0 333535 pipe 2020-04-22T14:17:23.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root 27w FIFO 0,13 0t0 333535 pipe 2020-04-22T14:17:23.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root 28r FIFO 0,13 0t0 333536 pipe 2020-04-22T14:17:23.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root 29w FIFO 0,13 0t0 333536 pipe 2020-04-22T14:17:23.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104730 fn_anonym root 30u IPv4 332657 0t0 TCP smithi103:33522->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:23.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:23.255 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root txt REG 8,1 7692408 10520 /usr/bin/ceph-mds 2020-04-22T14:17:23.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.256 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:23.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.258 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:23.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:23.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.259 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root 1w FIFO 0,13 0t0 329722 pipe 2020-04-22T14:17:23.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root 2w FIFO 0,13 0t0 329723 pipe 2020-04-22T14:17:23.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root 3r FIFO 0,13 0t0 332649 pipe 2020-04-22T14:17:23.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root 4w FIFO 0,13 0t0 332649 pipe 2020-04-22T14:17:23.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.260 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root 6r FIFO 0,13 0t0 332650 pipe 2020-04-22T14:17:23.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root 7w FIFO 0,13 0t0 332650 pipe 2020-04-22T14:17:23.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root 9r FIFO 0,13 0t0 332651 pipe 2020-04-22T14:17:23.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root 10w FIFO 0,13 0t0 332651 pipe 2020-04-22T14:17:23.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root 12r FIFO 0,13 0t0 332652 pipe 2020-04-22T14:17:23.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root 13w FIFO 0,13 0t0 332652 pipe 2020-04-22T14:17:23.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root 14w REG 8,1 15361376 526800 /var/log/ceph/ceph-mds.a.log 2020-04-22T14:17:23.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root 15uW REG 0,24 7 133049 /run/ceph/ceph-mds.a.pid 2020-04-22T14:17:23.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root 16r FIFO 0,13 0t0 333529 pipe 2020-04-22T14:17:23.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root 17w FIFO 0,13 0t0 333529 pipe 2020-04-22T14:17:23.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root 18u unix 0x0000000083fca076 0t0 333530 /var/run/ceph/ceph-mds.a.asok type=STREAM 2020-04-22T14:17:23.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root 19u IPv4 336087 0t0 TCP *:6832 (LISTEN) 2020-04-22T14:17:23.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root 20u IPv4 336121 0t0 TCP *:6833 (LISTEN) 2020-04-22T14:17:23.262 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root 21r FIFO 0,13 0t0 333533 pipe 2020-04-22T14:17:23.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root 22w FIFO 0,13 0t0 333533 pipe 2020-04-22T14:17:23.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root 23r FIFO 0,13 0t0 333534 pipe 2020-04-22T14:17:23.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root 24w FIFO 0,13 0t0 333534 pipe 2020-04-22T14:17:23.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root 25u IPv4 335090 0t0 TCP smithi103:41274->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:23.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root 26r FIFO 0,13 0t0 333535 pipe 2020-04-22T14:17:23.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root 27w FIFO 0,13 0t0 333535 pipe 2020-04-22T14:17:23.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root 28r FIFO 0,13 0t0 333536 pipe 2020-04-22T14:17:23.263 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root 29w FIFO 0,13 0t0 333536 pipe 2020-04-22T14:17:23.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104731 safe_time root 30u IPv4 332657 0t0 TCP smithi103:33522->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:23.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:23.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root txt REG 8,1 7692408 10520 /usr/bin/ceph-mds 2020-04-22T14:17:23.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.264 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.265 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:23.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.266 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.267 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:23.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:23.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root 1w FIFO 0,13 0t0 329722 pipe 2020-04-22T14:17:23.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root 2w FIFO 0,13 0t0 329723 pipe 2020-04-22T14:17:23.268 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root 3r FIFO 0,13 0t0 332649 pipe 2020-04-22T14:17:23.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root 4w FIFO 0,13 0t0 332649 pipe 2020-04-22T14:17:23.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root 6r FIFO 0,13 0t0 332650 pipe 2020-04-22T14:17:23.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root 7w FIFO 0,13 0t0 332650 pipe 2020-04-22T14:17:23.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root 9r FIFO 0,13 0t0 332651 pipe 2020-04-22T14:17:23.269 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root 10w FIFO 0,13 0t0 332651 pipe 2020-04-22T14:17:23.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root 12r FIFO 0,13 0t0 332652 pipe 2020-04-22T14:17:23.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root 13w FIFO 0,13 0t0 332652 pipe 2020-04-22T14:17:23.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root 14w REG 8,1 15361376 526800 /var/log/ceph/ceph-mds.a.log 2020-04-22T14:17:23.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root 15uW REG 0,24 7 133049 /run/ceph/ceph-mds.a.pid 2020-04-22T14:17:23.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root 16r FIFO 0,13 0t0 333529 pipe 2020-04-22T14:17:23.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root 17w FIFO 0,13 0t0 333529 pipe 2020-04-22T14:17:23.270 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root 18u unix 0x0000000083fca076 0t0 333530 /var/run/ceph/ceph-mds.a.asok type=STREAM 2020-04-22T14:17:23.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root 19u IPv4 336087 0t0 TCP *:6832 (LISTEN) 2020-04-22T14:17:23.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root 20u IPv4 336121 0t0 TCP *:6833 (LISTEN) 2020-04-22T14:17:23.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root 21r FIFO 0,13 0t0 333533 pipe 2020-04-22T14:17:23.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root 22w FIFO 0,13 0t0 333533 pipe 2020-04-22T14:17:23.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root 23r FIFO 0,13 0t0 333534 pipe 2020-04-22T14:17:23.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root 24w FIFO 0,13 0t0 333534 pipe 2020-04-22T14:17:23.271 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root 25u IPv4 335090 0t0 TCP smithi103:41274->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:23.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root 26r FIFO 0,13 0t0 333535 pipe 2020-04-22T14:17:23.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root 27w FIFO 0,13 0t0 333535 pipe 2020-04-22T14:17:23.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root 28r FIFO 0,13 0t0 333536 pipe 2020-04-22T14:17:23.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root 29w FIFO 0,13 0t0 333536 pipe 2020-04-22T14:17:23.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104732 ceph-mds root 30u IPv4 332657 0t0 TCP smithi103:33522->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:23.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:23.272 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root txt REG 8,1 7692408 10520 /usr/bin/ceph-mds 2020-04-22T14:17:23.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.273 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root mem REG 8,1 76752 66190 /usr/lib64/libunwind.so.8.0.1 2020-04-22T14:17:23.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.275 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root mem REG 8,1 386864 66200 /usr/lib64/libtcmalloc.so.4.5.3 2020-04-22T14:17:23.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:23.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.276 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root 1w FIFO 0,13 0t0 329722 pipe 2020-04-22T14:17:23.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root 2w FIFO 0,13 0t0 329723 pipe 2020-04-22T14:17:23.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root 3r FIFO 0,13 0t0 332649 pipe 2020-04-22T14:17:23.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root 4w FIFO 0,13 0t0 332649 pipe 2020-04-22T14:17:23.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root 5u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root 6r FIFO 0,13 0t0 332650 pipe 2020-04-22T14:17:23.277 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root 7w FIFO 0,13 0t0 332650 pipe 2020-04-22T14:17:23.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root 8u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root 9r FIFO 0,13 0t0 332651 pipe 2020-04-22T14:17:23.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root 10w FIFO 0,13 0t0 332651 pipe 2020-04-22T14:17:23.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root 11u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root 12r FIFO 0,13 0t0 332652 pipe 2020-04-22T14:17:23.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root 13w FIFO 0,13 0t0 332652 pipe 2020-04-22T14:17:23.278 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root 14w REG 8,1 15361376 526800 /var/log/ceph/ceph-mds.a.log 2020-04-22T14:17:23.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root 15uW REG 0,24 7 133049 /run/ceph/ceph-mds.a.pid 2020-04-22T14:17:23.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root 16r FIFO 0,13 0t0 333529 pipe 2020-04-22T14:17:23.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root 17w FIFO 0,13 0t0 333529 pipe 2020-04-22T14:17:23.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root 18u unix 0x0000000083fca076 0t0 333530 /var/run/ceph/ceph-mds.a.asok type=STREAM 2020-04-22T14:17:23.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root 19u IPv4 336087 0t0 TCP *:6832 (LISTEN) 2020-04-22T14:17:23.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root 20u IPv4 336121 0t0 TCP *:6833 (LISTEN) 2020-04-22T14:17:23.279 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root 21r FIFO 0,13 0t0 333533 pipe 2020-04-22T14:17:23.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root 22w FIFO 0,13 0t0 333533 pipe 2020-04-22T14:17:23.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root 23r FIFO 0,13 0t0 333534 pipe 2020-04-22T14:17:23.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root 24w FIFO 0,13 0t0 333534 pipe 2020-04-22T14:17:23.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root 25u IPv4 335090 0t0 TCP smithi103:41274->smithi086.front.sepia.ceph.com:3301 (ESTABLISHED) 2020-04-22T14:17:23.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root 26r FIFO 0,13 0t0 333535 pipe 2020-04-22T14:17:23.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root 27w FIFO 0,13 0t0 333535 pipe 2020-04-22T14:17:23.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root 28r FIFO 0,13 0t0 333536 pipe 2020-04-22T14:17:23.280 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root 29w FIFO 0,13 0t0 333536 pipe 2020-04-22T14:17:23.281 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-mds 104700 104761 safe_time root 30u IPv4 332657 0t0 TCP smithi103:33522->smithi086.front.sepia.ceph.com:6800 (ESTABLISHED) 2020-04-22T14:17:23.281 INFO:teuthology.orchestra.run.smithi103.stdout:bash 108430 ubuntu cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:23.281 INFO:teuthology.orchestra.run.smithi103.stdout:bash 108430 ubuntu rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.281 INFO:teuthology.orchestra.run.smithi103.stdout:bash 108430 ubuntu txt REG 8,1 1596592 3225 /usr/bin/bash 2020-04-22T14:17:23.281 INFO:teuthology.orchestra.run.smithi103.stdout:bash 108430 ubuntu mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:23.281 INFO:teuthology.orchestra.run.smithi103.stdout:bash 108430 ubuntu mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.281 INFO:teuthology.orchestra.run.smithi103.stdout:bash 108430 ubuntu mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.282 INFO:teuthology.orchestra.run.smithi103.stdout:bash 108430 ubuntu mem REG 8,1 208616 3175 /usr/lib64/libtinfo.so.6.1 2020-04-22T14:17:23.282 INFO:teuthology.orchestra.run.smithi103.stdout:bash 108430 ubuntu mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.282 INFO:teuthology.orchestra.run.smithi103.stdout:bash 108430 ubuntu mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:23.282 INFO:teuthology.orchestra.run.smithi103.stdout:bash 108430 ubuntu mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:23.282 INFO:teuthology.orchestra.run.smithi103.stdout:bash 108430 ubuntu mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:23.282 INFO:teuthology.orchestra.run.smithi103.stdout:bash 108430 ubuntu mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:23.282 INFO:teuthology.orchestra.run.smithi103.stdout:bash 108430 ubuntu mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:23.283 INFO:teuthology.orchestra.run.smithi103.stdout:bash 108430 ubuntu mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:23.283 INFO:teuthology.orchestra.run.smithi103.stdout:bash 108430 ubuntu mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:23.283 INFO:teuthology.orchestra.run.smithi103.stdout:bash 108430 ubuntu mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:23.283 INFO:teuthology.orchestra.run.smithi103.stdout:bash 108430 ubuntu mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:23.283 INFO:teuthology.orchestra.run.smithi103.stdout:bash 108430 ubuntu mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:23.283 INFO:teuthology.orchestra.run.smithi103.stdout:bash 108430 ubuntu mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:23.283 INFO:teuthology.orchestra.run.smithi103.stdout:bash 108430 ubuntu mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:23.284 INFO:teuthology.orchestra.run.smithi103.stdout:bash 108430 ubuntu 0r FIFO 0,13 0t0 343451 pipe 2020-04-22T14:17:23.284 INFO:teuthology.orchestra.run.smithi103.stdout:bash 108430 ubuntu 1w FIFO 0,13 0t0 343452 pipe 2020-04-22T14:17:23.284 INFO:teuthology.orchestra.run.smithi103.stdout:bash 108430 ubuntu 2w FIFO 0,13 0t0 343453 pipe 2020-04-22T14:17:23.284 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root cwd DIR 8,1 4096 262169 /home/ubuntu/cephtest 2020-04-22T14:17:23.284 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.284 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root txt REG 8,1 207056 9178 /usr/bin/sudo 2020-04-22T14:17:23.284 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 16704 5754 /usr/lib64/libpam_misc.so.0.82.1 2020-04-22T14:17:23.284 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 855144 29339 /usr/lib64/security/pam_systemd.so 2020-04-22T14:17:23.285 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 24208 29040 /usr/lib64/security/pam_limits.so 2020-04-22T14:17:23.285 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 11888 29038 /usr/lib64/security/pam_keyinit.so 2020-04-22T14:17:23.285 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 46232 5216 /usr/lib64/libcrack.so.2.9.0 2020-04-22T14:17:23.285 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 25728 5682 /usr/lib64/libpwquality.so.1.0.2 2020-04-22T14:17:23.285 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 11896 29000 /usr/lib64/security/pam_pwquality.so 2020-04-22T14:17:23.285 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 7808 29049 /usr/lib64/security/pam_permit.so 2020-04-22T14:17:23.285 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 7704 29028 /usr/lib64/security/pam_deny.so 2020-04-22T14:17:23.286 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 68936 29798 /usr/lib64/security/pam_sss.so 2020-04-22T14:17:23.286 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 371032 5313 /usr/lib64/libtirpc.so.3.0.0 2020-04-22T14:17:23.286 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 116408 5315 /usr/lib64/libnsl.so.2.0.0 2020-04-22T14:17:23.286 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 61448 29065 /usr/lib64/security/pam_unix.so 2020-04-22T14:17:23.286 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 11912 29042 /usr/lib64/security/pam_localuser.so 2020-04-22T14:17:23.286 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 16088 29060 /usr/lib64/security/pam_succeed_if.so 2020-04-22T14:17:23.286 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 11880 29032 /usr/lib64/security/pam_faildelay.so 2020-04-22T14:17:23.287 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 20304 29030 /usr/lib64/security/pam_env.so 2020-04-22T14:17:23.287 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:23.287 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.287 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.287 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.287 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.287 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:23.288 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.288 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 860880 5511 /usr/lib64/libnss_systemd.so.2 2020-04-22T14:17:23.288 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:23.288 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:23.288 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 16240 3641 /usr/lib64/libkeyutils.so.1.6 2020-04-22T14:17:23.288 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 118728 5304 /usr/lib64/libkrb5support.so.0.1 2020-04-22T14:17:23.288 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 25992 3339 /usr/lib64/libcom_err.so.2.1 2020-04-22T14:17:23.289 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 273488 5296 /usr/lib64/libk5crypto.so.3.1 2020-04-22T14:17:23.289 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 1507952 5302 /usr/lib64/libkrb5.so.3.3 2020-04-22T14:17:23.289 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 603768 5292 /usr/lib64/libgssapi_krb5.so.2.2 2020-04-22T14:17:23.289 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 142712 3373 /usr/lib64/libcrypt.so.1.1.0 2020-04-22T14:17:23.289 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.289 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:23.289 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 149160 4994 /usr/lib64/libsasl2.so.3.0.0 2020-04-22T14:17:23.289 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.290 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.290 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 97056 5009 /usr/lib64/liblber-2.4.so.2.10.9 2020-04-22T14:17:23.290 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 477472 5011 /usr/lib64/libldap-2.4.so.2.10.9 2020-04-22T14:17:23.290 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 74600 5752 /usr/lib64/libpam.so.0.84.2 2020-04-22T14:17:23.290 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 549944 16572 /usr/libexec/sudo/sudoers.so 2020-04-22T14:17:23.290 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:23.290 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:23.291 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:23.291 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.291 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 25192 3584 /usr/lib64/libcap-ng.so.0.0.0 2020-04-22T14:17:23.291 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.291 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.291 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.291 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 182296 16569 /usr/libexec/sudo/libsudo_util.so.0.0.0 2020-04-22T14:17:23.292 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:23.292 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.292 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 141392 3586 /usr/lib64/libaudit.so.1.0.0 2020-04-22T14:17:23.292 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.292 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:23.292 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:23.292 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:23.293 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:23.293 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:23.293 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:23.293 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:23.293 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:23.293 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:23.293 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:23.294 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:23.294 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:23.294 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root 0r FIFO 0,13 0t0 343451 pipe 2020-04-22T14:17:23.294 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root 1w FIFO 0,13 0t0 343452 pipe 2020-04-22T14:17:23.294 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root 2w FIFO 0,13 0t0 343453 pipe 2020-04-22T14:17:23.294 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root 3r REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:23.294 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root 4u unix 0x0000000075d656cd 0t0 346473 type=STREAM 2020-04-22T14:17:23.295 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root 5u netlink 0t0 346481 AUDIT 2020-04-22T14:17:23.295 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root 6r REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:23.295 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root 7r REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:23.295 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root 9u unix 0x0000000008502665 0t0 346484 type=DGRAM 2020-04-22T14:17:23.295 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root 10r FIFO 0,13 0t0 346487 pipe 2020-04-22T14:17:23.295 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108458 root 11w FIFO 0,13 0t0 346487 pipe 2020-04-22T14:17:23.295 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root cwd DIR 8,1 4096 262169 /home/ubuntu/cephtest 2020-04-22T14:17:23.296 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.296 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root txt REG 8,1 207056 9178 /usr/bin/sudo 2020-04-22T14:17:23.296 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 16704 5754 /usr/lib64/libpam_misc.so.0.82.1 2020-04-22T14:17:23.296 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 855144 29339 /usr/lib64/security/pam_systemd.so 2020-04-22T14:17:23.296 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 24208 29040 /usr/lib64/security/pam_limits.so 2020-04-22T14:17:23.296 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 11888 29038 /usr/lib64/security/pam_keyinit.so 2020-04-22T14:17:23.296 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 46232 5216 /usr/lib64/libcrack.so.2.9.0 2020-04-22T14:17:23.296 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 25728 5682 /usr/lib64/libpwquality.so.1.0.2 2020-04-22T14:17:23.297 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 11896 29000 /usr/lib64/security/pam_pwquality.so 2020-04-22T14:17:23.297 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 7808 29049 /usr/lib64/security/pam_permit.so 2020-04-22T14:17:23.297 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 7704 29028 /usr/lib64/security/pam_deny.so 2020-04-22T14:17:23.297 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 68936 29798 /usr/lib64/security/pam_sss.so 2020-04-22T14:17:23.297 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 371032 5313 /usr/lib64/libtirpc.so.3.0.0 2020-04-22T14:17:23.297 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 116408 5315 /usr/lib64/libnsl.so.2.0.0 2020-04-22T14:17:23.297 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 61448 29065 /usr/lib64/security/pam_unix.so 2020-04-22T14:17:23.298 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 11912 29042 /usr/lib64/security/pam_localuser.so 2020-04-22T14:17:23.298 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 16088 29060 /usr/lib64/security/pam_succeed_if.so 2020-04-22T14:17:23.298 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 11880 29032 /usr/lib64/security/pam_faildelay.so 2020-04-22T14:17:23.298 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 20304 29030 /usr/lib64/security/pam_env.so 2020-04-22T14:17:23.298 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:23.298 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.298 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.298 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.299 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.299 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:23.299 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.299 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 860880 5511 /usr/lib64/libnss_systemd.so.2 2020-04-22T14:17:23.299 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:23.300 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 16240 3641 /usr/lib64/libkeyutils.so.1.6 2020-04-22T14:17:23.300 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 118728 5304 /usr/lib64/libkrb5support.so.0.1 2020-04-22T14:17:23.300 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 25992 3339 /usr/lib64/libcom_err.so.2.1 2020-04-22T14:17:23.300 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 273488 5296 /usr/lib64/libk5crypto.so.3.1 2020-04-22T14:17:23.300 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 1507952 5302 /usr/lib64/libkrb5.so.3.3 2020-04-22T14:17:23.300 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 603768 5292 /usr/lib64/libgssapi_krb5.so.2.2 2020-04-22T14:17:23.301 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 142712 3373 /usr/lib64/libcrypt.so.1.1.0 2020-04-22T14:17:23.301 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.301 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:23.301 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 149160 4994 /usr/lib64/libsasl2.so.3.0.0 2020-04-22T14:17:23.301 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.301 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.301 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 97056 5009 /usr/lib64/liblber-2.4.so.2.10.9 2020-04-22T14:17:23.302 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 477472 5011 /usr/lib64/libldap-2.4.so.2.10.9 2020-04-22T14:17:23.302 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 74600 5752 /usr/lib64/libpam.so.0.84.2 2020-04-22T14:17:23.302 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 549944 16572 /usr/libexec/sudo/sudoers.so 2020-04-22T14:17:23.302 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:23.302 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:23.302 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:23.302 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:23.303 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.303 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 25192 3584 /usr/lib64/libcap-ng.so.0.0.0 2020-04-22T14:17:23.303 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.303 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.303 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.303 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 182296 16569 /usr/libexec/sudo/libsudo_util.so.0.0.0 2020-04-22T14:17:23.303 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:23.304 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.304 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 141392 3586 /usr/lib64/libaudit.so.1.0.0 2020-04-22T14:17:23.304 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.304 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:23.304 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:23.304 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:23.305 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:23.305 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:23.305 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:23.305 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:23.305 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:23.305 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:23.305 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:23.306 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:23.306 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:23.306 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root 0r FIFO 0,13 0t0 343451 pipe 2020-04-22T14:17:23.306 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root 1w FIFO 0,13 0t0 343452 pipe 2020-04-22T14:17:23.306 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root 2w FIFO 0,13 0t0 343453 pipe 2020-04-22T14:17:23.306 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root 3r REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:23.306 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root 4u sock 0,9 0t0 344378 protocol: UNIX 2020-04-22T14:17:23.307 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root 5u sock 0,9 0t0 344388 protocol: NETLINK 2020-04-22T14:17:23.307 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root 6r REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:23.307 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root 7r REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:23.307 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root 9u sock 0,9 0t0 344391 protocol: UNIX 2020-04-22T14:17:23.307 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root 10r FIFO 0,13 0t0 344394 pipe 2020-04-22T14:17:23.307 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108462 root 11w FIFO 0,13 0t0 344394 pipe 2020-04-22T14:17:23.308 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108464 root cwd DIR 8,1 4096 262169 /home/ubuntu/cephtest 2020-04-22T14:17:23.308 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108464 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.308 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108464 root txt REG 8,1 15496 6602 /usr/libexec/platform-python3.6 2020-04-22T14:17:23.308 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108464 root mem REG 8,1 59368 41092 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:23.308 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108464 root mem REG 8,1 16632 41078 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:23.308 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108464 root mem REG 8,1 52720 41084 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:23.308 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108464 root mem REG 8,1 37448 41100 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:23.309 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108464 root mem REG 8,1 19536 41090 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:23.309 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108464 root mem REG 8,1 23056 41069 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:23.309 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108464 root mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:23.309 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108464 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.309 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108464 root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.309 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108464 root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:23.309 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108464 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.310 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108464 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.310 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108464 root mem REG 8,1 3371672 6608 /usr/lib64/libpython3.6m.so.1.0 2020-04-22T14:17:23.310 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108464 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.310 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108464 root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:23.310 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108464 root mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:23.310 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108464 root mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:23.310 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108464 root mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:23.311 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108464 root mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:23.311 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108464 root mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:23.311 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108464 root mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:23.311 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108464 root mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:23.311 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108464 root mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:23.311 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108464 root mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:23.312 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108464 root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:23.312 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108464 root mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:23.312 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108464 root 0r FIFO 0,13 0t0 343451 pipe 2020-04-22T14:17:23.312 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108464 root 1w FIFO 0,13 0t0 343452 pipe 2020-04-22T14:17:23.312 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108464 root 2w FIFO 0,13 0t0 343453 pipe 2020-04-22T14:17:23.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root cwd DIR 8,1 4096 262169 /home/ubuntu/cephtest 2020-04-22T14:17:23.312 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root txt REG 8,1 1975808 70775 /usr/bin/ceph-fuse 2020-04-22T14:17:23.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.313 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.314 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.315 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:23.316 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:23.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root 1w FIFO 0,13 0t0 343452 pipe 2020-04-22T14:17:23.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root 2w FIFO 0,13 0t0 343453 pipe 2020-04-22T14:17:23.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root 3w REG 8,1 320653 527394 /var/log/ceph/ceph-client.1.108481.log 2020-04-22T14:17:23.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root 4u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.317 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root 5r FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root 6w FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root 7u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root 8r FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root 9w FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root 10u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root 11r FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.318 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root 12w FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root 13r FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root 14w FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root 15u sock 0,9 0t0 349221 protocol: UNIX 2020-04-22T14:17:23.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root 16r FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root 17w FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root 18r FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.319 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root 19w FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root 20u sock 0,9 0t0 343477 protocol: TCP 2020-04-22T14:17:23.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root 21u sock 0,9 0t0 347326 protocol: TCP 2020-04-22T14:17:23.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 root 22u CHR 10,229 0t0 20689 /dev/fuse 2020-04-22T14:17:23.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root cwd DIR 8,1 4096 262169 /home/ubuntu/cephtest 2020-04-22T14:17:23.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.320 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root txt REG 8,1 1975808 70775 /usr/bin/ceph-fuse 2020-04-22T14:17:23.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.321 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.322 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.323 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:23.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:23.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.324 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root 1w FIFO 0,13 0t0 343452 pipe 2020-04-22T14:17:23.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root 2w FIFO 0,13 0t0 343453 pipe 2020-04-22T14:17:23.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root 3w REG 8,1 320653 527394 /var/log/ceph/ceph-client.1.108481.log 2020-04-22T14:17:23.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root 4u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root 5r FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.325 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root 6w FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root 7u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root 8r FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root 9w FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root 10u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root 11r FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root 12w FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root 13r FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root 14w FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root 15u sock 0,9 0t0 349221 protocol: UNIX 2020-04-22T14:17:23.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root 16r FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root 17w FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root 18r FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root 19w FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root 20u sock 0,9 0t0 343477 protocol: TCP 2020-04-22T14:17:23.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root 21u sock 0,9 0t0 347326 protocol: TCP 2020-04-22T14:17:23.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108484 log root 22u CHR 10,229 0t0 20689 /dev/fuse 2020-04-22T14:17:23.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root cwd DIR 8,1 4096 262169 /home/ubuntu/cephtest 2020-04-22T14:17:23.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root txt REG 8,1 1975808 70775 /usr/bin/ceph-fuse 2020-04-22T14:17:23.328 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.329 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.330 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.331 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:23.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:23.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.332 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root 1w FIFO 0,13 0t0 343452 pipe 2020-04-22T14:17:23.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root 2w FIFO 0,13 0t0 343453 pipe 2020-04-22T14:17:23.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root 3w REG 8,1 320653 527394 /var/log/ceph/ceph-client.1.108481.log 2020-04-22T14:17:23.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root 4u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root 5r FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.333 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root 6w FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root 7u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root 8r FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root 9w FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root 10u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root 11r FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root 12w FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.334 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root 13r FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root 14w FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root 15u sock 0,9 0t0 349221 protocol: UNIX 2020-04-22T14:17:23.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root 16r FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root 17w FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root 18r FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root 19w FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.335 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root 20u sock 0,9 0t0 343477 protocol: TCP 2020-04-22T14:17:23.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root 21u sock 0,9 0t0 347326 protocol: TCP 2020-04-22T14:17:23.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108485 msgr-work root 22u CHR 10,229 0t0 20689 /dev/fuse 2020-04-22T14:17:23.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root cwd DIR 8,1 4096 262169 /home/ubuntu/cephtest 2020-04-22T14:17:23.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root txt REG 8,1 1975808 70775 /usr/bin/ceph-fuse 2020-04-22T14:17:23.336 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.337 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.339 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:23.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:23.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.340 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root 1w FIFO 0,13 0t0 343452 pipe 2020-04-22T14:17:23.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root 2w FIFO 0,13 0t0 343453 pipe 2020-04-22T14:17:23.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root 3w REG 8,1 320653 527394 /var/log/ceph/ceph-client.1.108481.log 2020-04-22T14:17:23.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root 4u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root 5r FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.341 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root 6w FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root 7u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root 8r FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root 9w FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root 10u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root 11r FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root 12w FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.342 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root 13r FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root 14w FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root 15u sock 0,9 0t0 349221 protocol: UNIX 2020-04-22T14:17:23.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root 16r FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root 17w FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root 18r FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root 19w FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.343 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root 20u sock 0,9 0t0 343477 protocol: TCP 2020-04-22T14:17:23.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root 21u sock 0,9 0t0 347326 protocol: TCP 2020-04-22T14:17:23.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108486 msgr-work root 22u CHR 10,229 0t0 20689 /dev/fuse 2020-04-22T14:17:23.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root cwd DIR 8,1 4096 262169 /home/ubuntu/cephtest 2020-04-22T14:17:23.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root txt REG 8,1 1975808 70775 /usr/bin/ceph-fuse 2020-04-22T14:17:23.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.344 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.345 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.346 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.347 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:23.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:23.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.348 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root 1w FIFO 0,13 0t0 343452 pipe 2020-04-22T14:17:23.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root 2w FIFO 0,13 0t0 343453 pipe 2020-04-22T14:17:23.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root 3w REG 8,1 320653 527394 /var/log/ceph/ceph-client.1.108481.log 2020-04-22T14:17:23.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root 4u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root 5r FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.349 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root 6w FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root 7u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root 8r FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root 9w FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root 10u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root 11r FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root 12w FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.350 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root 13r FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root 14w FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root 15u sock 0,9 0t0 349221 protocol: UNIX 2020-04-22T14:17:23.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root 16r FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root 17w FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root 18r FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.351 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root 19w FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root 20u sock 0,9 0t0 343477 protocol: TCP 2020-04-22T14:17:23.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root 21u sock 0,9 0t0 347326 protocol: TCP 2020-04-22T14:17:23.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108487 msgr-work root 22u CHR 10,229 0t0 20689 /dev/fuse 2020-04-22T14:17:23.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root cwd DIR 8,1 4096 262169 /home/ubuntu/cephtest 2020-04-22T14:17:23.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root txt REG 8,1 1975808 70775 /usr/bin/ceph-fuse 2020-04-22T14:17:23.352 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.353 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.354 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.355 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:23.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:23.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.356 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root 1w FIFO 0,13 0t0 343452 pipe 2020-04-22T14:17:23.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root 2w FIFO 0,13 0t0 343453 pipe 2020-04-22T14:17:23.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root 3w REG 8,1 320653 527394 /var/log/ceph/ceph-client.1.108481.log 2020-04-22T14:17:23.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root 4u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root 5r FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.357 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root 6w FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root 7u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root 8r FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root 9w FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root 10u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root 11r FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root 12w FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.358 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root 13r FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root 14w FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root 15u sock 0,9 0t0 349221 protocol: UNIX 2020-04-22T14:17:23.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root 16r FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root 17w FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root 18r FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root 19w FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.359 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root 20u sock 0,9 0t0 343477 protocol: TCP 2020-04-22T14:17:23.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root 21u sock 0,9 0t0 347326 protocol: TCP 2020-04-22T14:17:23.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108492 service root 22u CHR 10,229 0t0 20689 /dev/fuse 2020-04-22T14:17:23.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root cwd DIR 8,1 4096 262169 /home/ubuntu/cephtest 2020-04-22T14:17:23.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root txt REG 8,1 1975808 70775 /usr/bin/ceph-fuse 2020-04-22T14:17:23.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.361 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.362 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.363 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:23.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:23.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.364 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root 1w FIFO 0,13 0t0 343452 pipe 2020-04-22T14:17:23.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root 2w FIFO 0,13 0t0 343453 pipe 2020-04-22T14:17:23.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root 3w REG 8,1 320653 527394 /var/log/ceph/ceph-client.1.108481.log 2020-04-22T14:17:23.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root 4u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root 5r FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root 6w FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.365 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root 7u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root 8r FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root 9w FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root 10u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root 11r FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root 12w FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root 13r FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.366 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root 14w FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root 15u sock 0,9 0t0 349221 protocol: UNIX 2020-04-22T14:17:23.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root 16r FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root 17w FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root 18r FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root 19w FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root 20u sock 0,9 0t0 343477 protocol: TCP 2020-04-22T14:17:23.367 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root 21u sock 0,9 0t0 347326 protocol: TCP 2020-04-22T14:17:23.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108493 admin_soc root 22u CHR 10,229 0t0 20689 /dev/fuse 2020-04-22T14:17:23.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root cwd DIR 8,1 4096 262169 /home/ubuntu/cephtest 2020-04-22T14:17:23.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root txt REG 8,1 1975808 70775 /usr/bin/ceph-fuse 2020-04-22T14:17:23.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.368 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.369 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.370 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.371 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:23.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:23.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.372 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root 1w FIFO 0,13 0t0 343452 pipe 2020-04-22T14:17:23.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root 2w FIFO 0,13 0t0 343453 pipe 2020-04-22T14:17:23.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root 3w REG 8,1 320653 527394 /var/log/ceph/ceph-client.1.108481.log 2020-04-22T14:17:23.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root 4u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root 5r FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root 6w FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root 7u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.373 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root 8r FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root 9w FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root 10u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root 11r FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root 12w FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root 13r FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root 14w FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.374 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root 15u sock 0,9 0t0 349221 protocol: UNIX 2020-04-22T14:17:23.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root 16r FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root 17w FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root 18r FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root 19w FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root 20u sock 0,9 0t0 343477 protocol: TCP 2020-04-22T14:17:23.375 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root 21u sock 0,9 0t0 347326 protocol: TCP 2020-04-22T14:17:23.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108494 signal_ha root 22u CHR 10,229 0t0 20689 /dev/fuse 2020-04-22T14:17:23.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root cwd DIR 8,1 4096 262169 /home/ubuntu/cephtest 2020-04-22T14:17:23.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root txt REG 8,1 1975808 70775 /usr/bin/ceph-fuse 2020-04-22T14:17:23.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.376 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.377 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.378 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.379 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:23.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:23.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root 1w FIFO 0,13 0t0 343452 pipe 2020-04-22T14:17:23.380 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root 2w FIFO 0,13 0t0 343453 pipe 2020-04-22T14:17:23.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root 3w REG 8,1 320653 527394 /var/log/ceph/ceph-client.1.108481.log 2020-04-22T14:17:23.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root 4u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root 5r FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root 6w FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root 7u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root 8r FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.381 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root 9w FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root 10u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root 11r FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root 12w FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root 13r FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root 14w FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.382 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root 15u sock 0,9 0t0 349221 protocol: UNIX 2020-04-22T14:17:23.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root 16r FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root 17w FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root 18r FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root 19w FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root 20u sock 0,9 0t0 343477 protocol: TCP 2020-04-22T14:17:23.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root 21u sock 0,9 0t0 347326 protocol: TCP 2020-04-22T14:17:23.383 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108495 ceph-fuse root 22u CHR 10,229 0t0 20689 /dev/fuse 2020-04-22T14:17:23.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root cwd DIR 8,1 4096 262169 /home/ubuntu/cephtest 2020-04-22T14:17:23.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root txt REG 8,1 1975808 70775 /usr/bin/ceph-fuse 2020-04-22T14:17:23.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.384 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.385 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.386 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.387 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:23.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:23.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root 1w FIFO 0,13 0t0 343452 pipe 2020-04-22T14:17:23.388 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root 2w FIFO 0,13 0t0 343453 pipe 2020-04-22T14:17:23.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root 3w REG 8,1 320653 527394 /var/log/ceph/ceph-client.1.108481.log 2020-04-22T14:17:23.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root 4u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root 5r FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root 6w FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root 7u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root 8r FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.389 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root 9w FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root 10u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root 11r FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root 12w FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root 13r FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root 14w FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.390 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root 15u sock 0,9 0t0 349221 protocol: UNIX 2020-04-22T14:17:23.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root 16r FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root 17w FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root 18r FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root 19w FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root 20u sock 0,9 0t0 343477 protocol: TCP 2020-04-22T14:17:23.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root 21u sock 0,9 0t0 347326 protocol: TCP 2020-04-22T14:17:23.391 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108496 fn_anonym root 22u CHR 10,229 0t0 20689 /dev/fuse 2020-04-22T14:17:23.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root cwd DIR 8,1 4096 262169 /home/ubuntu/cephtest 2020-04-22T14:17:23.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root txt REG 8,1 1975808 70775 /usr/bin/ceph-fuse 2020-04-22T14:17:23.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.392 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.393 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.394 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.395 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:23.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:23.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.396 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root 1w FIFO 0,13 0t0 343452 pipe 2020-04-22T14:17:23.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root 2w FIFO 0,13 0t0 343453 pipe 2020-04-22T14:17:23.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root 3w REG 8,1 320653 527394 /var/log/ceph/ceph-client.1.108481.log 2020-04-22T14:17:23.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root 4u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root 5r FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root 6w FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root 7u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.397 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root 8r FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root 9w FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root 10u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root 11r FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root 12w FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root 13r FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.398 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root 14w FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root 15u sock 0,9 0t0 349221 protocol: UNIX 2020-04-22T14:17:23.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root 16r FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root 17w FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root 18r FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root 19w FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root 20u sock 0,9 0t0 343477 protocol: TCP 2020-04-22T14:17:23.399 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root 21u sock 0,9 0t0 347326 protocol: TCP 2020-04-22T14:17:23.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108497 safe_time root 22u CHR 10,229 0t0 20689 /dev/fuse 2020-04-22T14:17:23.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root cwd DIR 8,1 4096 262169 /home/ubuntu/cephtest 2020-04-22T14:17:23.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root txt REG 8,1 1975808 70775 /usr/bin/ceph-fuse 2020-04-22T14:17:23.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.400 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.402 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.403 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:23.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:23.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.404 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root 1w FIFO 0,13 0t0 343452 pipe 2020-04-22T14:17:23.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root 2w FIFO 0,13 0t0 343453 pipe 2020-04-22T14:17:23.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root 3w REG 8,1 320653 527394 /var/log/ceph/ceph-client.1.108481.log 2020-04-22T14:17:23.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root 4u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root 5r FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root 6w FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.405 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root 7u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root 8r FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root 9w FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root 10u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root 11r FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root 12w FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root 13r FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.406 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root 14w FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root 15u sock 0,9 0t0 349221 protocol: UNIX 2020-04-22T14:17:23.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root 16r FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root 17w FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root 18r FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root 19w FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root 20u sock 0,9 0t0 343477 protocol: TCP 2020-04-22T14:17:23.407 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root 21u sock 0,9 0t0 347326 protocol: TCP 2020-04-22T14:17:23.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108498 fn_anonym root 22u CHR 10,229 0t0 20689 /dev/fuse 2020-04-22T14:17:23.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root cwd DIR 8,1 4096 262169 /home/ubuntu/cephtest 2020-04-22T14:17:23.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root txt REG 8,1 1975808 70775 /usr/bin/ceph-fuse 2020-04-22T14:17:23.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.408 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.409 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.411 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:23.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:23.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.412 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root 1w FIFO 0,13 0t0 343452 pipe 2020-04-22T14:17:23.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root 2w FIFO 0,13 0t0 343453 pipe 2020-04-22T14:17:23.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root 3w REG 8,1 320653 527394 /var/log/ceph/ceph-client.1.108481.log 2020-04-22T14:17:23.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root 4u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root 5r FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root 6w FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root 7u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.413 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root 8r FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root 9w FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root 10u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root 11r FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root 12w FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root 13r FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root 14w FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.414 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root 15u sock 0,9 0t0 349221 protocol: UNIX 2020-04-22T14:17:23.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root 16r FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root 17w FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root 18r FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root 19w FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root 20u sock 0,9 0t0 343477 protocol: TCP 2020-04-22T14:17:23.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root 21u sock 0,9 0t0 347326 protocol: TCP 2020-04-22T14:17:23.415 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108499 flusher root 22u CHR 10,229 0t0 20689 /dev/fuse 2020-04-22T14:17:23.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root cwd DIR 8,1 4096 262169 /home/ubuntu/cephtest 2020-04-22T14:17:23.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root txt REG 8,1 1975808 70775 /usr/bin/ceph-fuse 2020-04-22T14:17:23.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.416 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.417 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.418 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.419 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:23.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:23.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root 1w FIFO 0,13 0t0 343452 pipe 2020-04-22T14:17:23.420 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root 2w FIFO 0,13 0t0 343453 pipe 2020-04-22T14:17:23.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root 3w REG 8,1 320653 527394 /var/log/ceph/ceph-client.1.108481.log 2020-04-22T14:17:23.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root 4u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root 5r FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root 6w FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root 7u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root 8r FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.421 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root 9w FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root 10u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root 11r FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root 12w FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root 13r FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root 14w FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root 15u sock 0,9 0t0 349221 protocol: UNIX 2020-04-22T14:17:23.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root 16r FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root 17w FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root 18r FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root 19w FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root 20u sock 0,9 0t0 343477 protocol: TCP 2020-04-22T14:17:23.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root 21u sock 0,9 0t0 347326 protocol: TCP 2020-04-22T14:17:23.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108500 ms_dispat root 22u CHR 10,229 0t0 20689 /dev/fuse 2020-04-22T14:17:23.423 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root cwd DIR 8,1 4096 262169 /home/ubuntu/cephtest 2020-04-22T14:17:23.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root txt REG 8,1 1975808 70775 /usr/bin/ceph-fuse 2020-04-22T14:17:23.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.424 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.425 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.426 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.427 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:23.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:23.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root 1w FIFO 0,13 0t0 343452 pipe 2020-04-22T14:17:23.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root 2w FIFO 0,13 0t0 343453 pipe 2020-04-22T14:17:23.428 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root 3w REG 8,1 320653 527394 /var/log/ceph/ceph-client.1.108481.log 2020-04-22T14:17:23.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root 4u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root 5r FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root 6w FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root 7u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root 8r FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root 9w FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.429 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root 10u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root 11r FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root 12w FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root 13r FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root 14w FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root 15u sock 0,9 0t0 349221 protocol: UNIX 2020-04-22T14:17:23.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root 16r FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.430 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root 17w FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root 18r FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root 19w FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root 20u sock 0,9 0t0 343477 protocol: TCP 2020-04-22T14:17:23.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root 21u sock 0,9 0t0 347326 protocol: TCP 2020-04-22T14:17:23.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108501 ms_local root 22u CHR 10,229 0t0 20689 /dev/fuse 2020-04-22T14:17:23.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root cwd DIR 8,1 4096 262169 /home/ubuntu/cephtest 2020-04-22T14:17:23.431 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root txt REG 8,1 1975808 70775 /usr/bin/ceph-fuse 2020-04-22T14:17:23.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.432 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.433 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.434 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:23.435 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:23.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root 1w FIFO 0,13 0t0 343452 pipe 2020-04-22T14:17:23.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root 2w FIFO 0,13 0t0 343453 pipe 2020-04-22T14:17:23.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root 3w REG 8,1 320653 527394 /var/log/ceph/ceph-client.1.108481.log 2020-04-22T14:17:23.436 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root 4u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root 5r FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root 6w FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root 7u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root 8r FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root 9w FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root 10u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.437 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root 11r FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root 12w FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root 13r FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root 14w FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root 15u sock 0,9 0t0 349221 protocol: UNIX 2020-04-22T14:17:23.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root 16r FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root 17w FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.438 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root 18r FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root 19w FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root 20u sock 0,9 0t0 343477 protocol: TCP 2020-04-22T14:17:23.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root 21u sock 0,9 0t0 347326 protocol: TCP 2020-04-22T14:17:23.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108502 safe_time root 22u CHR 10,229 0t0 20689 /dev/fuse 2020-04-22T14:17:23.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root cwd DIR 8,1 4096 262169 /home/ubuntu/cephtest 2020-04-22T14:17:23.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root txt REG 8,1 1975808 70775 /usr/bin/ceph-fuse 2020-04-22T14:17:23.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.440 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.441 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.442 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:23.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:23.443 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root 1w FIFO 0,13 0t0 343452 pipe 2020-04-22T14:17:23.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root 2w FIFO 0,13 0t0 343453 pipe 2020-04-22T14:17:23.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root 3w REG 8,1 320653 527394 /var/log/ceph/ceph-client.1.108481.log 2020-04-22T14:17:23.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root 4u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.444 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root 5r FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root 6w FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root 7u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root 8r FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root 9w FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root 10u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root 11r FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.445 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root 12w FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root 13r FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root 14w FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root 15u sock 0,9 0t0 349221 protocol: UNIX 2020-04-22T14:17:23.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root 16r FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root 17w FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root 18r FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root 19w FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root 20u sock 0,9 0t0 343477 protocol: TCP 2020-04-22T14:17:23.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root 21u sock 0,9 0t0 347326 protocol: TCP 2020-04-22T14:17:23.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108503 fn_anonym root 22u CHR 10,229 0t0 20689 /dev/fuse 2020-04-22T14:17:23.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root cwd DIR 8,1 4096 262169 /home/ubuntu/cephtest 2020-04-22T14:17:23.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root txt REG 8,1 1975808 70775 /usr/bin/ceph-fuse 2020-04-22T14:17:23.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.448 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.449 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.450 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:23.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:23.451 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root 1w FIFO 0,13 0t0 343452 pipe 2020-04-22T14:17:23.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root 2w FIFO 0,13 0t0 343453 pipe 2020-04-22T14:17:23.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root 3w REG 8,1 320653 527394 /var/log/ceph/ceph-client.1.108481.log 2020-04-22T14:17:23.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root 4u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root 5r FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.452 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root 6w FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root 7u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root 8r FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root 9w FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root 10u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root 11r FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.453 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root 12w FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root 13r FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root 14w FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root 15u sock 0,9 0t0 349221 protocol: UNIX 2020-04-22T14:17:23.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root 16r FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root 17w FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root 18r FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.454 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root 19w FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root 20u sock 0,9 0t0 343477 protocol: TCP 2020-04-22T14:17:23.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root 21u sock 0,9 0t0 347326 protocol: TCP 2020-04-22T14:17:23.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108505 fn_anonym root 22u CHR 10,229 0t0 20689 /dev/fuse 2020-04-22T14:17:23.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root cwd DIR 8,1 4096 262169 /home/ubuntu/cephtest 2020-04-22T14:17:23.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root txt REG 8,1 1975808 70775 /usr/bin/ceph-fuse 2020-04-22T14:17:23.455 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.456 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.457 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.458 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:23.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:23.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root 1w FIFO 0,13 0t0 343452 pipe 2020-04-22T14:17:23.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root 2w FIFO 0,13 0t0 343453 pipe 2020-04-22T14:17:23.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root 3w REG 8,1 320653 527394 /var/log/ceph/ceph-client.1.108481.log 2020-04-22T14:17:23.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root 4u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root 5r FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.460 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root 6w FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root 7u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root 8r FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root 9w FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root 10u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root 11r FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root 12w FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.461 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root 13r FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root 14w FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root 15u sock 0,9 0t0 349221 protocol: UNIX 2020-04-22T14:17:23.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root 16r FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root 17w FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root 18r FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root 19w FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root 20u sock 0,9 0t0 343477 protocol: TCP 2020-04-22T14:17:23.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root 21u sock 0,9 0t0 347326 protocol: TCP 2020-04-22T14:17:23.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108506 fn_anonym root 22u CHR 10,229 0t0 20689 /dev/fuse 2020-04-22T14:17:23.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root cwd DIR 8,1 4096 262169 /home/ubuntu/cephtest 2020-04-22T14:17:23.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root txt REG 8,1 1975808 70775 /usr/bin/ceph-fuse 2020-04-22T14:17:23.463 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.464 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.465 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.466 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:23.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:23.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.467 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root 1w FIFO 0,13 0t0 343452 pipe 2020-04-22T14:17:23.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root 2w FIFO 0,13 0t0 343453 pipe 2020-04-22T14:17:23.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root 3w REG 8,1 320653 527394 /var/log/ceph/ceph-client.1.108481.log 2020-04-22T14:17:23.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root 4u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root 5r FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root 6w FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.468 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root 7u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root 8r FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root 9w FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root 10u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root 11r FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root 12w FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.469 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root 13r FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root 14w FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root 15u sock 0,9 0t0 349221 protocol: UNIX 2020-04-22T14:17:23.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root 16r FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root 17w FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root 18r FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root 19w FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.470 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root 20u sock 0,9 0t0 343477 protocol: TCP 2020-04-22T14:17:23.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root 21u sock 0,9 0t0 347326 protocol: TCP 2020-04-22T14:17:23.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108507 fn_anonym root 22u CHR 10,229 0t0 20689 /dev/fuse 2020-04-22T14:17:23.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root cwd DIR 8,1 4096 262169 /home/ubuntu/cephtest 2020-04-22T14:17:23.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root txt REG 8,1 1975808 70775 /usr/bin/ceph-fuse 2020-04-22T14:17:23.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.471 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.472 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:23.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:23.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root 1w FIFO 0,13 0t0 343452 pipe 2020-04-22T14:17:23.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root 2w FIFO 0,13 0t0 343453 pipe 2020-04-22T14:17:23.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root 3w REG 8,1 320653 527394 /var/log/ceph/ceph-client.1.108481.log 2020-04-22T14:17:23.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root 4u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root 5r FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root 6w FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.476 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root 7u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root 8r FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root 9w FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root 10u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root 11r FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root 12w FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root 13r FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.477 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root 14w FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root 15u sock 0,9 0t0 349221 protocol: UNIX 2020-04-22T14:17:23.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root 16r FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root 17w FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root 18r FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root 19w FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root 20u sock 0,9 0t0 343477 protocol: TCP 2020-04-22T14:17:23.478 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root 21u sock 0,9 0t0 347326 protocol: TCP 2020-04-22T14:17:23.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108508 fn_anonym root 22u CHR 10,229 0t0 20689 /dev/fuse 2020-04-22T14:17:23.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root cwd DIR 8,1 4096 262169 /home/ubuntu/cephtest 2020-04-22T14:17:23.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root txt REG 8,1 1975808 70775 /usr/bin/ceph-fuse 2020-04-22T14:17:23.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.479 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.480 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.481 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.482 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:23.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:23.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root 1w FIFO 0,13 0t0 343452 pipe 2020-04-22T14:17:23.483 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root 2w FIFO 0,13 0t0 343453 pipe 2020-04-22T14:17:23.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root 3w REG 8,1 320653 527394 /var/log/ceph/ceph-client.1.108481.log 2020-04-22T14:17:23.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root 4u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root 5r FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root 6w FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root 7u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root 8r FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.484 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root 9w FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root 10u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root 11r FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root 12w FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root 13r FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root 14w FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root 15u sock 0,9 0t0 349221 protocol: UNIX 2020-04-22T14:17:23.485 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root 16r FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root 17w FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root 18r FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root 19w FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root 20u sock 0,9 0t0 343477 protocol: TCP 2020-04-22T14:17:23.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root 21u sock 0,9 0t0 347326 protocol: TCP 2020-04-22T14:17:23.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108510 ceph-fuse root 22u CHR 10,229 0t0 20689 /dev/fuse 2020-04-22T14:17:23.486 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root cwd DIR 8,1 4096 262169 /home/ubuntu/cephtest 2020-04-22T14:17:23.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root txt REG 8,1 1975808 70775 /usr/bin/ceph-fuse 2020-04-22T14:17:23.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.487 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.488 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.489 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.490 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:23.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:23.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root 1w FIFO 0,13 0t0 343452 pipe 2020-04-22T14:17:23.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root 2w FIFO 0,13 0t0 343453 pipe 2020-04-22T14:17:23.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root 3w REG 8,1 320653 527394 /var/log/ceph/ceph-client.1.108481.log 2020-04-22T14:17:23.491 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root 4u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root 5r FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root 6w FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root 7u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root 8r FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root 9w FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root 10u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.492 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root 11r FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root 12w FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root 13r FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root 14w FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root 15u sock 0,9 0t0 349221 protocol: UNIX 2020-04-22T14:17:23.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root 16r FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.493 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root 17w FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root 18r FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root 19w FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root 20u sock 0,9 0t0 343477 protocol: TCP 2020-04-22T14:17:23.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root 21u sock 0,9 0t0 347326 protocol: TCP 2020-04-22T14:17:23.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108511 ceph-fuse root 22u CHR 10,229 0t0 20689 /dev/fuse 2020-04-22T14:17:23.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root cwd DIR 8,1 4096 262169 /home/ubuntu/cephtest 2020-04-22T14:17:23.494 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root txt REG 8,1 1975808 70775 /usr/bin/ceph-fuse 2020-04-22T14:17:23.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root mem REG 8,1 21256 11023 /usr/lib64/liburcu-common.so.6.0.0 2020-04-22T14:17:23.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root mem REG 8,1 44128 11021 /usr/lib64/liburcu-cds.so.6.0.0 2020-04-22T14:17:23.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root mem REG 8,1 34696 11019 /usr/lib64/liburcu-bp.so.6.0.0 2020-04-22T14:17:23.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root mem REG 8,1 63616 63134 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2020-04-22T14:17:23.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.495 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root mem REG 8,1 202248 3728 /usr/lib64/libnl-3.so.200.26.0 2020-04-22T14:17:23.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root mem REG 8,1 773288 3736 /usr/lib64/libnl-route-3.so.200.26.0 2020-04-22T14:17:23.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.496 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root mem REG 8,1 1662872 3386 /usr/lib64/libstdc++.so.6.0.25 2020-04-22T14:17:23.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root mem REG 8,1 117408 11279 /usr/lib64/librdmacm.so.1.1.22.3 2020-04-22T14:17:23.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root mem REG 8,1 179800 11266 /usr/lib64/libibverbs.so.1.5.22.3 2020-04-22T14:17:23.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root mem REG 8,1 513000 5513 /usr/lib64/libudev.so.1.6.11 2020-04-22T14:17:23.497 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root mem REG 8,1 13722736 262688 /usr/lib64/ceph/libceph-common.so.2 2020-04-22T14:17:23.498 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root mem REG 8,1 269368 4850 /usr/lib64/libfuse.so.2.9.7 2020-04-22T14:17:23.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root 1w FIFO 0,13 0t0 343452 pipe 2020-04-22T14:17:23.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root 2w FIFO 0,13 0t0 343453 pipe 2020-04-22T14:17:23.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root 3w REG 8,1 320653 527394 /var/log/ceph/ceph-client.1.108481.log 2020-04-22T14:17:23.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root 4u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.499 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root 5r FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root 6w FIFO 0,13 0t0 349217 pipe 2020-04-22T14:17:23.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root 7u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root 8r FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root 9w FIFO 0,13 0t0 349218 pipe 2020-04-22T14:17:23.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root 10u a_inode 0,14 0 2063 [eventpoll] 2020-04-22T14:17:23.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root 11r FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.500 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root 12w FIFO 0,13 0t0 349219 pipe 2020-04-22T14:17:23.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root 13r FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root 14w FIFO 0,13 0t0 349220 pipe 2020-04-22T14:17:23.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root 15u sock 0,9 0t0 349221 protocol: UNIX 2020-04-22T14:17:23.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root 16r FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root 17w FIFO 0,13 0t0 349223 pipe 2020-04-22T14:17:23.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root 18r FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.501 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root 19w FIFO 0,13 0t0 349224 pipe 2020-04-22T14:17:23.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root 20u sock 0,9 0t0 343477 protocol: TCP 2020-04-22T14:17:23.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root 21u sock 0,9 0t0 347326 protocol: TCP 2020-04-22T14:17:23.502 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-fuse 108481 108901 ceph-fuse root 22u CHR 10,229 0t0 20689 /dev/fuse 2020-04-22T14:17:23.502 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:23.502 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.502 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root txt REG 8,1 207056 9178 /usr/bin/sudo 2020-04-22T14:17:23.502 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 16704 5754 /usr/lib64/libpam_misc.so.0.82.1 2020-04-22T14:17:23.503 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 855144 29339 /usr/lib64/security/pam_systemd.so 2020-04-22T14:17:23.503 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 24208 29040 /usr/lib64/security/pam_limits.so 2020-04-22T14:17:23.503 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 11888 29038 /usr/lib64/security/pam_keyinit.so 2020-04-22T14:17:23.503 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 46232 5216 /usr/lib64/libcrack.so.2.9.0 2020-04-22T14:17:23.503 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 25728 5682 /usr/lib64/libpwquality.so.1.0.2 2020-04-22T14:17:23.503 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 11896 29000 /usr/lib64/security/pam_pwquality.so 2020-04-22T14:17:23.503 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 7808 29049 /usr/lib64/security/pam_permit.so 2020-04-22T14:17:23.504 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 7704 29028 /usr/lib64/security/pam_deny.so 2020-04-22T14:17:23.504 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 68936 29798 /usr/lib64/security/pam_sss.so 2020-04-22T14:17:23.504 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 371032 5313 /usr/lib64/libtirpc.so.3.0.0 2020-04-22T14:17:23.504 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 116408 5315 /usr/lib64/libnsl.so.2.0.0 2020-04-22T14:17:23.504 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 61448 29065 /usr/lib64/security/pam_unix.so 2020-04-22T14:17:23.504 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 11912 29042 /usr/lib64/security/pam_localuser.so 2020-04-22T14:17:23.505 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 16088 29060 /usr/lib64/security/pam_succeed_if.so 2020-04-22T14:17:23.505 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 11880 29032 /usr/lib64/security/pam_faildelay.so 2020-04-22T14:17:23.505 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 20304 29030 /usr/lib64/security/pam_env.so 2020-04-22T14:17:23.505 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:23.505 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.505 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.505 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.506 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.506 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:23.506 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.506 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 860880 5511 /usr/lib64/libnss_systemd.so.2 2020-04-22T14:17:23.506 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:23.506 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:23.506 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 16240 3641 /usr/lib64/libkeyutils.so.1.6 2020-04-22T14:17:23.507 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 118728 5304 /usr/lib64/libkrb5support.so.0.1 2020-04-22T14:17:23.507 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 25992 3339 /usr/lib64/libcom_err.so.2.1 2020-04-22T14:17:23.507 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 273488 5296 /usr/lib64/libk5crypto.so.3.1 2020-04-22T14:17:23.507 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 1507952 5302 /usr/lib64/libkrb5.so.3.3 2020-04-22T14:17:23.507 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 603768 5292 /usr/lib64/libgssapi_krb5.so.2.2 2020-04-22T14:17:23.507 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 142712 3373 /usr/lib64/libcrypt.so.1.1.0 2020-04-22T14:17:23.507 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.508 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:23.508 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 149160 4994 /usr/lib64/libsasl2.so.3.0.0 2020-04-22T14:17:23.508 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.508 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.508 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 97056 5009 /usr/lib64/liblber-2.4.so.2.10.9 2020-04-22T14:17:23.508 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 477472 5011 /usr/lib64/libldap-2.4.so.2.10.9 2020-04-22T14:17:23.508 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 74600 5752 /usr/lib64/libpam.so.0.84.2 2020-04-22T14:17:23.509 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 549944 16572 /usr/libexec/sudo/sudoers.so 2020-04-22T14:17:23.509 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:23.509 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:23.509 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:23.509 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.509 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 25192 3584 /usr/lib64/libcap-ng.so.0.0.0 2020-04-22T14:17:23.509 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.510 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.510 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.510 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 182296 16569 /usr/libexec/sudo/libsudo_util.so.0.0.0 2020-04-22T14:17:23.510 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:23.510 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.510 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 141392 3586 /usr/lib64/libaudit.so.1.0.0 2020-04-22T14:17:23.510 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.511 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:23.511 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:23.511 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:23.511 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:23.511 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:23.511 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:23.512 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:23.512 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:23.512 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:23.512 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:23.512 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:23.512 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:23.512 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root 0r FIFO 0,13 0t0 350442 pipe 2020-04-22T14:17:23.513 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root 1w FIFO 0,13 0t0 350443 pipe 2020-04-22T14:17:23.513 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root 2w FIFO 0,13 0t0 350444 pipe 2020-04-22T14:17:23.513 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root 3r REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:23.513 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root 4u unix 0x000000009096bdc1 0t0 347385 type=STREAM 2020-04-22T14:17:23.513 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root 5u netlink 0t0 347393 AUDIT 2020-04-22T14:17:23.513 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root 6r REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:23.513 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root 7r REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:23.514 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root 9u unix 0x000000002651083b 0t0 347396 type=DGRAM 2020-04-22T14:17:23.514 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root 10r FIFO 0,13 0t0 347399 pipe 2020-04-22T14:17:23.514 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 108817 root 11w FIFO 0,13 0t0 347399 pipe 2020-04-22T14:17:23.514 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108848 root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:23.514 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108848 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.514 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108848 root txt REG 8,1 15496 6602 /usr/libexec/platform-python3.6 2020-04-22T14:17:23.515 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108848 root mem REG 8,1 59368 41092 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:23.515 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108848 root mem REG 8,1 16632 41078 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:23.515 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108848 root mem REG 8,1 52720 41084 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:23.515 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108848 root mem REG 8,1 37448 41100 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:23.515 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108848 root mem REG 8,1 19536 41090 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:23.515 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108848 root mem REG 8,1 23056 41069 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:23.515 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108848 root mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:23.516 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108848 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.516 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108848 root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.516 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108848 root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:23.516 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108848 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.516 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108848 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.516 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108848 root mem REG 8,1 3371672 6608 /usr/lib64/libpython3.6m.so.1.0 2020-04-22T14:17:23.516 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108848 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.517 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108848 root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:23.517 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108848 root mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:23.517 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108848 root mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:23.517 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108848 root mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:23.517 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108848 root mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:23.517 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108848 root mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:23.517 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108848 root mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:23.518 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108848 root mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:23.518 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108848 root mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:23.518 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108848 root mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:23.518 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108848 root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:23.518 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108848 root mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:23.518 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108848 root 0r FIFO 0,13 0t0 350442 pipe 2020-04-22T14:17:23.518 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108848 root 1w FIFO 0,13 0t0 350443 pipe 2020-04-22T14:17:23.519 INFO:teuthology.orchestra.run.smithi103.stdout:daemon-he 108848 root 2w FIFO 0,13 0t0 350444 pipe 2020-04-22T14:17:23.519 INFO:teuthology.orchestra.run.smithi103.stdout:python3 108852 root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:23.519 INFO:teuthology.orchestra.run.smithi103.stdout:python3 108852 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.519 INFO:teuthology.orchestra.run.smithi103.stdout:python3 108852 root txt REG 8,1 15496 6602 /usr/libexec/platform-python3.6 2020-04-22T14:17:23.519 INFO:teuthology.orchestra.run.smithi103.stdout:python3 108852 root mem REG 8,1 52720 41084 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:23.519 INFO:teuthology.orchestra.run.smithi103.stdout:python3 108852 root mem REG 8,1 19536 41090 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:23.520 INFO:teuthology.orchestra.run.smithi103.stdout:python3 108852 root mem REG 8,1 23056 41069 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2020-04-22T14:17:23.520 INFO:teuthology.orchestra.run.smithi103.stdout:python3 108852 root mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:23.520 INFO:teuthology.orchestra.run.smithi103.stdout:python3 108852 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.520 INFO:teuthology.orchestra.run.smithi103.stdout:python3 108852 root mem REG 8,1 3692320 3201 /usr/lib64/libm-2.28.so 2020-04-22T14:17:23.520 INFO:teuthology.orchestra.run.smithi103.stdout:python3 108852 root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:23.520 INFO:teuthology.orchestra.run.smithi103.stdout:python3 108852 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.520 INFO:teuthology.orchestra.run.smithi103.stdout:python3 108852 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.521 INFO:teuthology.orchestra.run.smithi103.stdout:python3 108852 root mem REG 8,1 3371672 6608 /usr/lib64/libpython3.6m.so.1.0 2020-04-22T14:17:23.521 INFO:teuthology.orchestra.run.smithi103.stdout:python3 108852 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.521 INFO:teuthology.orchestra.run.smithi103.stdout:python3 108852 root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:23.521 INFO:teuthology.orchestra.run.smithi103.stdout:python3 108852 root mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:23.521 INFO:teuthology.orchestra.run.smithi103.stdout:python3 108852 root mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:23.521 INFO:teuthology.orchestra.run.smithi103.stdout:python3 108852 root mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:23.521 INFO:teuthology.orchestra.run.smithi103.stdout:python3 108852 root mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:23.522 INFO:teuthology.orchestra.run.smithi103.stdout:python3 108852 root mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:23.522 INFO:teuthology.orchestra.run.smithi103.stdout:python3 108852 root mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:23.522 INFO:teuthology.orchestra.run.smithi103.stdout:python3 108852 root mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:23.522 INFO:teuthology.orchestra.run.smithi103.stdout:python3 108852 root mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:23.522 INFO:teuthology.orchestra.run.smithi103.stdout:python3 108852 root mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:23.522 INFO:teuthology.orchestra.run.smithi103.stdout:python3 108852 root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:23.522 INFO:teuthology.orchestra.run.smithi103.stdout:python3 108852 root mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:23.523 INFO:teuthology.orchestra.run.smithi103.stdout:python3 108852 root 0r CHR 1,3 0t0 1028 /dev/null 2020-04-22T14:17:23.523 INFO:teuthology.orchestra.run.smithi103.stdout:python3 108852 root 1w FIFO 0,13 0t0 350443 pipe 2020-04-22T14:17:23.523 INFO:teuthology.orchestra.run.smithi103.stdout:python3 108852 root 2w FIFO 0,13 0t0 350444 pipe 2020-04-22T14:17:23.523 INFO:teuthology.orchestra.run.smithi103.stdout:python3 108852 root 3w unknown /home/ubuntu/cephtest/mnt.0/background_file-1 (stat: Transport endpoint is not connected) 2020-04-22T14:17:23.523 INFO:teuthology.orchestra.run.smithi103.stdout:python3 108852 root 4w unknown /home/ubuntu/cephtest/mnt.0/background_file-2 (stat: Transport endpoint is not connected) 2020-04-22T14:17:23.523 INFO:teuthology.orchestra.run.smithi103.stdout:bash 109173 ubuntu cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:23.523 INFO:teuthology.orchestra.run.smithi103.stdout:bash 109173 ubuntu rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.524 INFO:teuthology.orchestra.run.smithi103.stdout:bash 109173 ubuntu txt REG 8,1 1596592 3225 /usr/bin/bash 2020-04-22T14:17:23.524 INFO:teuthology.orchestra.run.smithi103.stdout:bash 109173 ubuntu mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:23.524 INFO:teuthology.orchestra.run.smithi103.stdout:bash 109173 ubuntu mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.524 INFO:teuthology.orchestra.run.smithi103.stdout:bash 109173 ubuntu mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.524 INFO:teuthology.orchestra.run.smithi103.stdout:bash 109173 ubuntu mem REG 8,1 208616 3175 /usr/lib64/libtinfo.so.6.1 2020-04-22T14:17:23.524 INFO:teuthology.orchestra.run.smithi103.stdout:bash 109173 ubuntu mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.525 INFO:teuthology.orchestra.run.smithi103.stdout:bash 109173 ubuntu mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:23.525 INFO:teuthology.orchestra.run.smithi103.stdout:bash 109173 ubuntu mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:23.525 INFO:teuthology.orchestra.run.smithi103.stdout:bash 109173 ubuntu mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:23.525 INFO:teuthology.orchestra.run.smithi103.stdout:bash 109173 ubuntu mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:23.525 INFO:teuthology.orchestra.run.smithi103.stdout:bash 109173 ubuntu mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:23.525 INFO:teuthology.orchestra.run.smithi103.stdout:bash 109173 ubuntu mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:23.525 INFO:teuthology.orchestra.run.smithi103.stdout:bash 109173 ubuntu mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:23.526 INFO:teuthology.orchestra.run.smithi103.stdout:bash 109173 ubuntu mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:23.526 INFO:teuthology.orchestra.run.smithi103.stdout:bash 109173 ubuntu mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:23.526 INFO:teuthology.orchestra.run.smithi103.stdout:bash 109173 ubuntu mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:23.526 INFO:teuthology.orchestra.run.smithi103.stdout:bash 109173 ubuntu mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:23.526 INFO:teuthology.orchestra.run.smithi103.stdout:bash 109173 ubuntu mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:23.526 INFO:teuthology.orchestra.run.smithi103.stdout:bash 109173 ubuntu 0r FIFO 0,13 0t0 345796 pipe 2020-04-22T14:17:23.526 INFO:teuthology.orchestra.run.smithi103.stdout:bash 109173 ubuntu 1w FIFO 0,13 0t0 345797 pipe 2020-04-22T14:17:23.527 INFO:teuthology.orchestra.run.smithi103.stdout:bash 109173 ubuntu 2w FIFO 0,13 0t0 345798 pipe 2020-04-22T14:17:23.527 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:23.527 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.527 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root txt REG 8,1 207056 9178 /usr/bin/sudo 2020-04-22T14:17:23.527 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 16704 5754 /usr/lib64/libpam_misc.so.0.82.1 2020-04-22T14:17:23.527 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 855144 29339 /usr/lib64/security/pam_systemd.so 2020-04-22T14:17:23.527 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 24208 29040 /usr/lib64/security/pam_limits.so 2020-04-22T14:17:23.528 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 11888 29038 /usr/lib64/security/pam_keyinit.so 2020-04-22T14:17:23.528 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 46232 5216 /usr/lib64/libcrack.so.2.9.0 2020-04-22T14:17:23.528 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 25728 5682 /usr/lib64/libpwquality.so.1.0.2 2020-04-22T14:17:23.528 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 11896 29000 /usr/lib64/security/pam_pwquality.so 2020-04-22T14:17:23.528 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 7808 29049 /usr/lib64/security/pam_permit.so 2020-04-22T14:17:23.528 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 7704 29028 /usr/lib64/security/pam_deny.so 2020-04-22T14:17:23.528 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 68936 29798 /usr/lib64/security/pam_sss.so 2020-04-22T14:17:23.529 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 371032 5313 /usr/lib64/libtirpc.so.3.0.0 2020-04-22T14:17:23.529 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 116408 5315 /usr/lib64/libnsl.so.2.0.0 2020-04-22T14:17:23.529 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 61448 29065 /usr/lib64/security/pam_unix.so 2020-04-22T14:17:23.529 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 11912 29042 /usr/lib64/security/pam_localuser.so 2020-04-22T14:17:23.529 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 16088 29060 /usr/lib64/security/pam_succeed_if.so 2020-04-22T14:17:23.529 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 11880 29032 /usr/lib64/security/pam_faildelay.so 2020-04-22T14:17:23.529 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 20304 29030 /usr/lib64/security/pam_env.so 2020-04-22T14:17:23.530 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:23.530 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 61432 3403 /usr/lib64/libuuid.so.1.3.0 2020-04-22T14:17:23.530 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 616416 5580 /usr/lib64/libblkid.so.1.1.0 2020-04-22T14:17:23.530 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 104256 754 /usr/lib64/libgcc_s-8-20190507.so.1 2020-04-22T14:17:23.530 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 519904 5396 /usr/lib64/libmount.so.1.1.0 2020-04-22T14:17:23.530 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 26888 3396 /usr/lib64/libcap.so.2.26 2020-04-22T14:17:23.531 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 142608 3210 /usr/lib64/librt-2.28.so 2020-04-22T14:17:23.531 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 860880 5511 /usr/lib64/libnss_systemd.so.2 2020-04-22T14:17:23.531 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:23.531 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 110520 3207 /usr/lib64/libnss_files-2.28.so 2020-04-22T14:17:23.531 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 16240 3641 /usr/lib64/libkeyutils.so.1.6 2020-04-22T14:17:23.531 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 118728 5304 /usr/lib64/libkrb5support.so.0.1 2020-04-22T14:17:23.531 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 25992 3339 /usr/lib64/libcom_err.so.2.1 2020-04-22T14:17:23.532 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 273488 5296 /usr/lib64/libk5crypto.so.3.1 2020-04-22T14:17:23.532 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 1507952 5302 /usr/lib64/libkrb5.so.3.3 2020-04-22T14:17:23.532 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 603768 5292 /usr/lib64/libgssapi_krb5.so.2.2 2020-04-22T14:17:23.532 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 142712 3373 /usr/lib64/libcrypt.so.1.1.0 2020-04-22T14:17:23.532 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.532 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 774104 6122 /usr/lib64/libssl.so.1.1.1c 2020-04-22T14:17:23.532 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 149160 4994 /usr/lib64/libsasl2.so.3.0.0 2020-04-22T14:17:23.533 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.533 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.533 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 97056 5009 /usr/lib64/liblber-2.4.so.2.10.9 2020-04-22T14:17:23.533 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 477472 5011 /usr/lib64/libldap-2.4.so.2.10.9 2020-04-22T14:17:23.533 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 74600 5752 /usr/lib64/libpam.so.0.84.2 2020-04-22T14:17:23.533 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 549944 16572 /usr/libexec/sudo/sudoers.so 2020-04-22T14:17:23.533 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:23.534 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 62608 10522 /usr/lib64/libnss_sss.so.2 2020-04-22T14:17:23.534 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 2586930 17389 /usr/lib/locale/en_US.utf8/LC_COLLATE 2020-04-22T14:17:23.534 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.534 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 25192 3584 /usr/lib64/libcap-ng.so.0.0.0 2020-04-22T14:17:23.534 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.534 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.534 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.535 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 182296 16569 /usr/libexec/sudo/libsudo_util.so.0.0.0 2020-04-22T14:17:23.535 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 34616 3213 /usr/lib64/libutil-2.28.so 2020-04-22T14:17:23.535 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.535 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 141392 3586 /usr/lib64/libaudit.so.1.0.0 2020-04-22T14:17:23.535 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.535 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:23.536 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 54 24694 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2020-04-22T14:17:23.536 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 3316 24689 /usr/lib/locale/en_US.utf8/LC_TIME 2020-04-22T14:17:23.536 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 286 24687 /usr/lib/locale/en_US.utf8/LC_MONETARY 2020-04-22T14:17:23.536 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 57 17390 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2020-04-22T14:17:23.536 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 34 17404 /usr/lib/locale/en_US.utf8/LC_PAPER 2020-04-22T14:17:23.536 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 77 24693 /usr/lib/locale/en_US.utf8/LC_NAME 2020-04-22T14:17:23.536 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 167 17346 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2020-04-22T14:17:23.537 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 59 24688 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2020-04-22T14:17:23.537 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 23 24686 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2020-04-22T14:17:23.537 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:23.537 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root mem REG 8,1 368 24685 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2020-04-22T14:17:23.537 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root 0r FIFO 0,13 0t0 345796 pipe 2020-04-22T14:17:23.537 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root 1w FIFO 0,13 0t0 345797 pipe 2020-04-22T14:17:23.537 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root 2w FIFO 0,13 0t0 345798 pipe 2020-04-22T14:17:23.538 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root 3r REG 8,1 8406312 66234 /var/lib/sss/mc/passwd 2020-04-22T14:17:23.538 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root 4u unix 0x00000000546b24c4 0t0 348337 type=STREAM 2020-04-22T14:17:23.538 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root 5u netlink 0t0 348345 AUDIT 2020-04-22T14:17:23.538 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root 6r REG 8,1 10406312 66392 /var/lib/sss/mc/initgroups 2020-04-22T14:17:23.538 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root 7r REG 8,1 6406312 64852 /var/lib/sss/mc/group 2020-04-22T14:17:23.538 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root 9u unix 0x00000000a7704686 0t0 348348 type=DGRAM 2020-04-22T14:17:23.539 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root 10r FIFO 0,13 0t0 348351 pipe 2020-04-22T14:17:23.539 INFO:teuthology.orchestra.run.smithi103.stdout:sudo 109188 root 11w FIFO 0,13 0t0 348351 pipe 2020-04-22T14:17:23.539 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109190 root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:23.539 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109190 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.539 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109190 root txt REG 8,1 184584 9326 /usr/bin/lsof 2020-04-22T14:17:23.539 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109190 root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.539 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109190 root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.540 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109190 root mem REG 8,1 16240 3641 /usr/lib64/libkeyutils.so.1.6 2020-04-22T14:17:23.540 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109190 root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.540 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109190 root mem REG 8,1 118728 5304 /usr/lib64/libkrb5support.so.0.1 2020-04-22T14:17:23.540 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109190 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.540 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109190 root mem REG 8,1 25992 3339 /usr/lib64/libcom_err.so.2.1 2020-04-22T14:17:23.540 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109190 root mem REG 8,1 273488 5296 /usr/lib64/libk5crypto.so.3.1 2020-04-22T14:17:23.540 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109190 root mem REG 8,1 1507952 5302 /usr/lib64/libkrb5.so.3.3 2020-04-22T14:17:23.541 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109190 root mem REG 8,1 603768 5292 /usr/lib64/libgssapi_krb5.so.2.2 2020-04-22T14:17:23.541 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109190 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.541 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109190 root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.541 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109190 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.541 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109190 root mem REG 8,1 371032 5313 /usr/lib64/libtirpc.so.3.0.0 2020-04-22T14:17:23.541 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109190 root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.541 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109190 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.542 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109190 root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:23.542 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109190 root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:23.542 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109190 root 0r FIFO 0,13 0t0 345796 pipe 2020-04-22T14:17:23.542 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109190 root 1w FIFO 0,13 0t0 345797 pipe 2020-04-22T14:17:23.542 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109190 root 2w FIFO 0,13 0t0 345798 pipe 2020-04-22T14:17:23.542 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109190 root 3r DIR 0,4 0 1 /proc 2020-04-22T14:17:23.542 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109190 root 4r DIR 0,4 0 347522 /proc/109190/fd 2020-04-22T14:17:23.543 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109190 root 5w FIFO 0,13 0t0 347532 pipe 2020-04-22T14:17:23.543 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109190 root 6r FIFO 0,13 0t0 347533 pipe 2020-04-22T14:17:23.543 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109191 root cwd DIR 8,1 4096 695 /home/ubuntu 2020-04-22T14:17:23.543 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109191 root rtd DIR 8,1 4096 2 / 2020-04-22T14:17:23.543 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109191 root txt REG 8,1 184584 9326 /usr/bin/lsof 2020-04-22T14:17:23.543 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109191 root mem REG 8,1 99776 3337 /usr/lib64/libz.so.1.2.11 2020-04-22T14:17:23.544 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109191 root mem REG 8,1 168368 3209 /usr/lib64/libresolv-2.28.so 2020-04-22T14:17:23.544 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109191 root mem REG 8,1 16240 3641 /usr/lib64/libkeyutils.so.1.6 2020-04-22T14:17:23.544 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109191 root mem REG 8,1 4681248 6121 /usr/lib64/libcrypto.so.1.1.1c 2020-04-22T14:17:23.544 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109191 root mem REG 8,1 118728 5304 /usr/lib64/libkrb5support.so.0.1 2020-04-22T14:17:23.544 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109191 root mem REG 8,1 754552 3208 /usr/lib64/libpthread-2.28.so 2020-04-22T14:17:23.544 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109191 root mem REG 8,1 25992 3339 /usr/lib64/libcom_err.so.2.1 2020-04-22T14:17:23.544 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109191 root mem REG 8,1 273488 5296 /usr/lib64/libk5crypto.so.3.1 2020-04-22T14:17:23.545 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109191 root mem REG 8,1 1507952 5302 /usr/lib64/libkrb5.so.3.3 2020-04-22T14:17:23.545 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109191 root mem REG 8,1 603768 5292 /usr/lib64/libgssapi_krb5.so.2.2 2020-04-22T14:17:23.545 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109191 root mem REG 8,1 52328 3200 /usr/lib64/libdl-2.28.so 2020-04-22T14:17:23.545 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109191 root mem REG 8,1 553480 3151 /usr/lib64/libpcre2-8.so.0.7.1 2020-04-22T14:17:23.545 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109191 root mem REG 8,1 5993088 3199 /usr/lib64/libc-2.28.so 2020-04-22T14:17:23.545 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109191 root mem REG 8,1 371032 5313 /usr/lib64/libtirpc.so.3.0.0 2020-04-22T14:17:23.545 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109191 root mem REG 8,1 304856 3155 /usr/lib64/libselinux.so.1 2020-04-22T14:17:23.546 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109191 root mem REG 8,1 385384 3193 /usr/lib64/ld-2.28.so 2020-04-22T14:17:23.546 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109191 root mem REG 8,1 337024 24691 /usr/lib/locale/en_US.utf8/LC_CTYPE 2020-04-22T14:17:23.546 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109191 root mem REG 8,1 26998 13610 /usr/lib64/gconv/gconv-modules.cache 2020-04-22T14:17:23.546 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109191 root 4r FIFO 0,13 0t0 347532 pipe 2020-04-22T14:17:23.546 INFO:teuthology.orchestra.run.smithi103.stdout:lsof 109191 root 7w FIFO 0,13 0t0 347533 pipe 2020-04-22T14:17:23.546 INFO:teuthology.orchestra.run.smithi103.stdout:USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND 2020-04-22T14:17:23.546 INFO:teuthology.orchestra.run.smithi103.stdout:root 2 0.0 0.0 0 0 ? S 13:53 0:00 [kthreadd] 2020-04-22T14:17:23.547 INFO:teuthology.orchestra.run.smithi103.stdout:root 3 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [rcu_gp] 2020-04-22T14:17:23.547 INFO:teuthology.orchestra.run.smithi103.stdout:root 4 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [rcu_par_gp] 2020-04-22T14:17:23.547 INFO:teuthology.orchestra.run.smithi103.stdout:root 6 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [kworker/0:0H-kblockd] 2020-04-22T14:17:23.547 INFO:teuthology.orchestra.run.smithi103.stdout:root 7 0.0 0.0 0 0 ? I 13:53 0:00 \_ [kworker/u16:0-ixgbe] 2020-04-22T14:17:23.547 INFO:teuthology.orchestra.run.smithi103.stdout:root 8 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [mm_percpu_wq] 2020-04-22T14:17:23.547 INFO:teuthology.orchestra.run.smithi103.stdout:root 9 0.0 0.0 0 0 ? S 13:53 0:00 \_ [ksoftirqd/0] 2020-04-22T14:17:23.547 INFO:teuthology.orchestra.run.smithi103.stdout:root 10 0.0 0.0 0 0 ? I 13:53 0:00 \_ [rcu_sched] 2020-04-22T14:17:23.548 INFO:teuthology.orchestra.run.smithi103.stdout:root 11 0.0 0.0 0 0 ? S 13:53 0:00 \_ [migration/0] 2020-04-22T14:17:23.548 INFO:teuthology.orchestra.run.smithi103.stdout:root 12 0.0 0.0 0 0 ? S 13:53 0:00 \_ [watchdog/0] 2020-04-22T14:17:23.548 INFO:teuthology.orchestra.run.smithi103.stdout:root 13 0.0 0.0 0 0 ? S 13:53 0:00 \_ [cpuhp/0] 2020-04-22T14:17:23.548 INFO:teuthology.orchestra.run.smithi103.stdout:root 14 0.0 0.0 0 0 ? S 13:53 0:00 \_ [cpuhp/1] 2020-04-22T14:17:23.548 INFO:teuthology.orchestra.run.smithi103.stdout:root 15 0.0 0.0 0 0 ? S 13:53 0:00 \_ [watchdog/1] 2020-04-22T14:17:23.548 INFO:teuthology.orchestra.run.smithi103.stdout:root 16 0.0 0.0 0 0 ? S 13:53 0:00 \_ [migration/1] 2020-04-22T14:17:23.549 INFO:teuthology.orchestra.run.smithi103.stdout:root 17 0.0 0.0 0 0 ? S 13:53 0:00 \_ [ksoftirqd/1] 2020-04-22T14:17:23.549 INFO:teuthology.orchestra.run.smithi103.stdout:root 19 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [kworker/1:0H-kblockd] 2020-04-22T14:17:23.549 INFO:teuthology.orchestra.run.smithi103.stdout:root 20 0.0 0.0 0 0 ? S 13:53 0:00 \_ [cpuhp/2] 2020-04-22T14:17:23.549 INFO:teuthology.orchestra.run.smithi103.stdout:root 21 0.0 0.0 0 0 ? S 13:53 0:00 \_ [watchdog/2] 2020-04-22T14:17:23.549 INFO:teuthology.orchestra.run.smithi103.stdout:root 22 0.0 0.0 0 0 ? S 13:53 0:00 \_ [migration/2] 2020-04-22T14:17:23.549 INFO:teuthology.orchestra.run.smithi103.stdout:root 23 0.0 0.0 0 0 ? S 13:53 0:00 \_ [ksoftirqd/2] 2020-04-22T14:17:23.549 INFO:teuthology.orchestra.run.smithi103.stdout:root 25 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [kworker/2:0H-kblockd] 2020-04-22T14:17:23.550 INFO:teuthology.orchestra.run.smithi103.stdout:root 26 0.0 0.0 0 0 ? S 13:53 0:00 \_ [cpuhp/3] 2020-04-22T14:17:23.550 INFO:teuthology.orchestra.run.smithi103.stdout:root 27 0.0 0.0 0 0 ? S 13:53 0:00 \_ [watchdog/3] 2020-04-22T14:17:23.550 INFO:teuthology.orchestra.run.smithi103.stdout:root 28 0.0 0.0 0 0 ? S 13:53 0:00 \_ [migration/3] 2020-04-22T14:17:23.550 INFO:teuthology.orchestra.run.smithi103.stdout:root 29 0.0 0.0 0 0 ? S 13:53 0:00 \_ [ksoftirqd/3] 2020-04-22T14:17:23.550 INFO:teuthology.orchestra.run.smithi103.stdout:root 31 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [kworker/3:0H-kblockd] 2020-04-22T14:17:23.550 INFO:teuthology.orchestra.run.smithi103.stdout:root 32 0.0 0.0 0 0 ? S 13:53 0:00 \_ [cpuhp/4] 2020-04-22T14:17:23.550 INFO:teuthology.orchestra.run.smithi103.stdout:root 33 0.0 0.0 0 0 ? S 13:53 0:00 \_ [watchdog/4] 2020-04-22T14:17:23.551 INFO:teuthology.orchestra.run.smithi103.stdout:root 34 0.0 0.0 0 0 ? S 13:53 0:00 \_ [migration/4] 2020-04-22T14:17:23.551 INFO:teuthology.orchestra.run.smithi103.stdout:root 35 0.0 0.0 0 0 ? S 13:53 0:00 \_ [ksoftirqd/4] 2020-04-22T14:17:23.551 INFO:teuthology.orchestra.run.smithi103.stdout:root 37 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [kworker/4:0H-kblockd] 2020-04-22T14:17:23.551 INFO:teuthology.orchestra.run.smithi103.stdout:root 38 0.0 0.0 0 0 ? S 13:53 0:00 \_ [cpuhp/5] 2020-04-22T14:17:23.551 INFO:teuthology.orchestra.run.smithi103.stdout:root 39 0.0 0.0 0 0 ? S 13:53 0:00 \_ [watchdog/5] 2020-04-22T14:17:23.551 INFO:teuthology.orchestra.run.smithi103.stdout:root 40 0.0 0.0 0 0 ? S 13:53 0:00 \_ [migration/5] 2020-04-22T14:17:23.551 INFO:teuthology.orchestra.run.smithi103.stdout:root 41 0.0 0.0 0 0 ? S 13:53 0:00 \_ [ksoftirqd/5] 2020-04-22T14:17:23.552 INFO:teuthology.orchestra.run.smithi103.stdout:root 43 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [kworker/5:0H-kblockd] 2020-04-22T14:17:23.552 INFO:teuthology.orchestra.run.smithi103.stdout:root 44 0.0 0.0 0 0 ? S 13:53 0:00 \_ [cpuhp/6] 2020-04-22T14:17:23.552 INFO:teuthology.orchestra.run.smithi103.stdout:root 45 0.0 0.0 0 0 ? S 13:53 0:00 \_ [watchdog/6] 2020-04-22T14:17:23.552 INFO:teuthology.orchestra.run.smithi103.stdout:root 46 0.0 0.0 0 0 ? S 13:53 0:00 \_ [migration/6] 2020-04-22T14:17:23.552 INFO:teuthology.orchestra.run.smithi103.stdout:root 47 0.0 0.0 0 0 ? S 13:53 0:00 \_ [ksoftirqd/6] 2020-04-22T14:17:23.552 INFO:teuthology.orchestra.run.smithi103.stdout:root 49 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [kworker/6:0H-kblockd] 2020-04-22T14:17:23.552 INFO:teuthology.orchestra.run.smithi103.stdout:root 50 0.0 0.0 0 0 ? S 13:53 0:00 \_ [cpuhp/7] 2020-04-22T14:17:23.553 INFO:teuthology.orchestra.run.smithi103.stdout:root 51 0.0 0.0 0 0 ? S 13:53 0:00 \_ [watchdog/7] 2020-04-22T14:17:23.553 INFO:teuthology.orchestra.run.smithi103.stdout:root 52 0.0 0.0 0 0 ? S 13:53 0:00 \_ [migration/7] 2020-04-22T14:17:23.553 INFO:teuthology.orchestra.run.smithi103.stdout:root 53 0.0 0.0 0 0 ? S 13:53 0:00 \_ [ksoftirqd/7] 2020-04-22T14:17:23.553 INFO:teuthology.orchestra.run.smithi103.stdout:root 55 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [kworker/7:0H-kblockd] 2020-04-22T14:17:23.553 INFO:teuthology.orchestra.run.smithi103.stdout:root 57 0.0 0.0 0 0 ? S 13:53 0:00 \_ [kdevtmpfs] 2020-04-22T14:17:23.553 INFO:teuthology.orchestra.run.smithi103.stdout:root 58 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [netns] 2020-04-22T14:17:23.554 INFO:teuthology.orchestra.run.smithi103.stdout:root 59 0.0 0.0 0 0 ? S 13:53 0:00 \_ [kauditd] 2020-04-22T14:17:23.554 INFO:teuthology.orchestra.run.smithi103.stdout:root 61 0.0 0.0 0 0 ? S 13:53 0:00 \_ [khungtaskd] 2020-04-22T14:17:23.554 INFO:teuthology.orchestra.run.smithi103.stdout:root 62 0.0 0.0 0 0 ? S 13:53 0:00 \_ [oom_reaper] 2020-04-22T14:17:23.554 INFO:teuthology.orchestra.run.smithi103.stdout:root 63 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [writeback] 2020-04-22T14:17:23.554 INFO:teuthology.orchestra.run.smithi103.stdout:root 64 0.0 0.0 0 0 ? S 13:53 0:00 \_ [kcompactd0] 2020-04-22T14:17:23.554 INFO:teuthology.orchestra.run.smithi103.stdout:root 65 0.0 0.0 0 0 ? SN 13:53 0:00 \_ [ksmd] 2020-04-22T14:17:23.554 INFO:teuthology.orchestra.run.smithi103.stdout:root 66 0.0 0.0 0 0 ? SN 13:53 0:00 \_ [khugepaged] 2020-04-22T14:17:23.555 INFO:teuthology.orchestra.run.smithi103.stdout:root 67 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [crypto] 2020-04-22T14:17:23.555 INFO:teuthology.orchestra.run.smithi103.stdout:root 68 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [kintegrityd] 2020-04-22T14:17:23.555 INFO:teuthology.orchestra.run.smithi103.stdout:root 69 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [kblockd] 2020-04-22T14:17:23.555 INFO:teuthology.orchestra.run.smithi103.stdout:root 72 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [tpm_dev_wq] 2020-04-22T14:17:23.555 INFO:teuthology.orchestra.run.smithi103.stdout:root 73 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [md] 2020-04-22T14:17:23.555 INFO:teuthology.orchestra.run.smithi103.stdout:root 74 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [edac-poller] 2020-04-22T14:17:23.555 INFO:teuthology.orchestra.run.smithi103.stdout:root 75 0.0 0.0 0 0 ? S 13:53 0:00 \_ [watchdogd] 2020-04-22T14:17:23.556 INFO:teuthology.orchestra.run.smithi103.stdout:root 102 0.0 0.0 0 0 ? S 13:53 0:00 \_ [kswapd0] 2020-04-22T14:17:23.556 INFO:teuthology.orchestra.run.smithi103.stdout:root 196 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [kthrotld] 2020-04-22T14:17:23.556 INFO:teuthology.orchestra.run.smithi103.stdout:root 197 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [acpi_thermal_pm] 2020-04-22T14:17:23.556 INFO:teuthology.orchestra.run.smithi103.stdout:root 198 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [kmpath_rdacd] 2020-04-22T14:17:23.556 INFO:teuthology.orchestra.run.smithi103.stdout:root 199 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [kaluad] 2020-04-22T14:17:23.556 INFO:teuthology.orchestra.run.smithi103.stdout:root 200 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [ipv6_addrconf] 2020-04-22T14:17:23.556 INFO:teuthology.orchestra.run.smithi103.stdout:root 201 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [kstrp] 2020-04-22T14:17:23.557 INFO:teuthology.orchestra.run.smithi103.stdout:root 202 0.0 0.0 0 0 ? I 13:53 0:00 \_ [kworker/0:3-rcu_gp] 2020-04-22T14:17:23.557 INFO:teuthology.orchestra.run.smithi103.stdout:root 331 0.0 0.0 0 0 ? I 13:53 0:00 \_ [kworker/6:2-dio/dm-3] 2020-04-22T14:17:23.557 INFO:teuthology.orchestra.run.smithi103.stdout:root 480 0.0 0.0 0 0 ? I 13:53 0:00 \_ [kworker/7:3-mm_percpu_wq] 2020-04-22T14:17:23.557 INFO:teuthology.orchestra.run.smithi103.stdout:root 488 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [nvme-wq] 2020-04-22T14:17:23.557 INFO:teuthology.orchestra.run.smithi103.stdout:root 489 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [ata_sff] 2020-04-22T14:17:23.557 INFO:teuthology.orchestra.run.smithi103.stdout:root 490 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [nvme-reset-wq] 2020-04-22T14:17:23.557 INFO:teuthology.orchestra.run.smithi103.stdout:root 491 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [nvme-delete-wq] 2020-04-22T14:17:23.558 INFO:teuthology.orchestra.run.smithi103.stdout:root 493 0.0 0.0 0 0 ? S 13:53 0:00 \_ [scsi_eh_0] 2020-04-22T14:17:23.558 INFO:teuthology.orchestra.run.smithi103.stdout:root 494 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [scsi_tmf_0] 2020-04-22T14:17:23.558 INFO:teuthology.orchestra.run.smithi103.stdout:root 495 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [ixgbe] 2020-04-22T14:17:23.558 INFO:teuthology.orchestra.run.smithi103.stdout:root 516 0.0 0.0 0 0 ? S 13:53 0:00 \_ [scsi_eh_1] 2020-04-22T14:17:23.558 INFO:teuthology.orchestra.run.smithi103.stdout:root 527 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [scsi_tmf_1] 2020-04-22T14:17:23.558 INFO:teuthology.orchestra.run.smithi103.stdout:root 529 0.0 0.0 0 0 ? S 13:53 0:00 \_ [scsi_eh_2] 2020-04-22T14:17:23.558 INFO:teuthology.orchestra.run.smithi103.stdout:root 543 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [scsi_tmf_2] 2020-04-22T14:17:23.559 INFO:teuthology.orchestra.run.smithi103.stdout:root 577 0.0 0.0 0 0 ? S 13:53 0:00 \_ [scsi_eh_3] 2020-04-22T14:17:23.559 INFO:teuthology.orchestra.run.smithi103.stdout:root 632 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [scsi_tmf_3] 2020-04-22T14:17:23.559 INFO:teuthology.orchestra.run.smithi103.stdout:root 684 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [ttm_swap] 2020-04-22T14:17:23.559 INFO:teuthology.orchestra.run.smithi103.stdout:root 1036 0.0 0.0 0 0 ? S 13:53 0:00 \_ [scsi_eh_4] 2020-04-22T14:17:23.559 INFO:teuthology.orchestra.run.smithi103.stdout:root 1037 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [scsi_tmf_4] 2020-04-22T14:17:23.559 INFO:teuthology.orchestra.run.smithi103.stdout:root 1044 0.0 0.0 0 0 ? S 13:53 0:00 \_ [scsi_eh_5] 2020-04-22T14:17:23.559 INFO:teuthology.orchestra.run.smithi103.stdout:root 1046 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [scsi_tmf_5] 2020-04-22T14:17:23.560 INFO:teuthology.orchestra.run.smithi103.stdout:root 1051 0.0 0.0 0 0 ? S 13:53 0:00 \_ [scsi_eh_6] 2020-04-22T14:17:23.560 INFO:teuthology.orchestra.run.smithi103.stdout:root 1068 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [scsi_tmf_6] 2020-04-22T14:17:23.560 INFO:teuthology.orchestra.run.smithi103.stdout:root 1072 0.0 0.0 0 0 ? S 13:53 0:00 \_ [scsi_eh_7] 2020-04-22T14:17:23.560 INFO:teuthology.orchestra.run.smithi103.stdout:root 1130 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [scsi_tmf_7] 2020-04-22T14:17:23.560 INFO:teuthology.orchestra.run.smithi103.stdout:root 1156 0.0 0.0 0 0 ? S 13:53 0:00 \_ [scsi_eh_8] 2020-04-22T14:17:23.560 INFO:teuthology.orchestra.run.smithi103.stdout:root 1188 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [scsi_tmf_8] 2020-04-22T14:17:23.560 INFO:teuthology.orchestra.run.smithi103.stdout:root 1193 0.0 0.0 0 0 ? S 13:53 0:00 \_ [scsi_eh_9] 2020-04-22T14:17:23.561 INFO:teuthology.orchestra.run.smithi103.stdout:root 1211 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [scsi_tmf_9] 2020-04-22T14:17:23.561 INFO:teuthology.orchestra.run.smithi103.stdout:root 1287 0.0 0.0 0 0 ? I 13:53 0:00 \_ [kworker/u16:5-events_unbound] 2020-04-22T14:17:23.561 INFO:teuthology.orchestra.run.smithi103.stdout:root 1308 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [kworker/1:1H-xfs-log/dm-0] 2020-04-22T14:17:23.561 INFO:teuthology.orchestra.run.smithi103.stdout:root 1318 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [kworker/2:1H-xfs-log/dm-0] 2020-04-22T14:17:23.561 INFO:teuthology.orchestra.run.smithi103.stdout:root 1319 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [kworker/7:1H-xfs-log/dm-0] 2020-04-22T14:17:23.561 INFO:teuthology.orchestra.run.smithi103.stdout:root 1331 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [kworker/0:1H-xfs-log/dm-1] 2020-04-22T14:17:23.561 INFO:teuthology.orchestra.run.smithi103.stdout:root 1334 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [kworker/6:1H-xfs-log/dm-0] 2020-04-22T14:17:23.562 INFO:teuthology.orchestra.run.smithi103.stdout:root 1335 0.0 0.0 0 0 ? S 13:53 0:00 \_ [jbd2/sda1-8] 2020-04-22T14:17:23.562 INFO:teuthology.orchestra.run.smithi103.stdout:root 1336 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [ext4-rsv-conver] 2020-04-22T14:17:23.562 INFO:teuthology.orchestra.run.smithi103.stdout:root 1414 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [kworker/3:1H-kblockd] 2020-04-22T14:17:23.562 INFO:teuthology.orchestra.run.smithi103.stdout:root 1432 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [kworker/4:1H-xfs-log/dm-0] 2020-04-22T14:17:23.562 INFO:teuthology.orchestra.run.smithi103.stdout:root 1434 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [kworker/5:1H-kblockd] 2020-04-22T14:17:23.562 INFO:teuthology.orchestra.run.smithi103.stdout:root 1453 0.0 0.0 0 0 ? S 13:53 0:00 \_ [ext4lazyinit] 2020-04-22T14:17:23.563 INFO:teuthology.orchestra.run.smithi103.stdout:root 1507 0.0 0.0 0 0 ? SN 13:53 0:00 \_ [kipmi0] 2020-04-22T14:17:23.563 INFO:teuthology.orchestra.run.smithi103.stdout:root 2380 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [rpciod] 2020-04-22T14:17:23.563 INFO:teuthology.orchestra.run.smithi103.stdout:root 2381 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [kworker/u17:0] 2020-04-22T14:17:23.563 INFO:teuthology.orchestra.run.smithi103.stdout:root 2382 0.0 0.0 0 0 ? I< 13:53 0:00 \_ [xprtiod] 2020-04-22T14:17:23.563 INFO:teuthology.orchestra.run.smithi103.stdout:root 21644 0.0 0.0 0 0 ? I< 13:59 0:00 \_ [kdmflush] 2020-04-22T14:17:23.563 INFO:teuthology.orchestra.run.smithi103.stdout:root 21676 0.0 0.0 0 0 ? I< 13:59 0:00 \_ [kdmflush] 2020-04-22T14:17:23.563 INFO:teuthology.orchestra.run.smithi103.stdout:root 21709 0.0 0.0 0 0 ? I< 13:59 0:00 \_ [kdmflush] 2020-04-22T14:17:23.564 INFO:teuthology.orchestra.run.smithi103.stdout:root 21742 0.0 0.0 0 0 ? I< 13:59 0:00 \_ [kdmflush] 2020-04-22T14:17:23.564 INFO:teuthology.orchestra.run.smithi103.stdout:root 21775 0.0 0.0 0 0 ? I< 13:59 0:00 \_ [kdmflush] 2020-04-22T14:17:23.564 INFO:teuthology.orchestra.run.smithi103.stdout:root 21956 0.0 0.0 0 0 ? I< 13:59 0:00 \_ [xfsalloc] 2020-04-22T14:17:23.564 INFO:teuthology.orchestra.run.smithi103.stdout:root 21957 0.0 0.0 0 0 ? I< 13:59 0:00 \_ [xfs_mru_cache] 2020-04-22T14:17:23.564 INFO:teuthology.orchestra.run.smithi103.stdout:root 21960 0.0 0.0 0 0 ? I< 13:59 0:00 \_ [xfs-buf/dm-0] 2020-04-22T14:17:23.564 INFO:teuthology.orchestra.run.smithi103.stdout:root 21961 0.0 0.0 0 0 ? I< 13:59 0:00 \_ [xfs-data/dm-0] 2020-04-22T14:17:23.564 INFO:teuthology.orchestra.run.smithi103.stdout:root 21963 0.0 0.0 0 0 ? I< 13:59 0:00 \_ [xfs-conv/dm-0] 2020-04-22T14:17:23.565 INFO:teuthology.orchestra.run.smithi103.stdout:root 21965 0.0 0.0 0 0 ? I< 13:59 0:00 \_ [xfs-cil/dm-0] 2020-04-22T14:17:23.565 INFO:teuthology.orchestra.run.smithi103.stdout:root 21966 0.0 0.0 0 0 ? I< 13:59 0:00 \_ [xfs-reclaim/dm-] 2020-04-22T14:17:23.565 INFO:teuthology.orchestra.run.smithi103.stdout:root 21967 0.0 0.0 0 0 ? I< 13:59 0:00 \_ [xfs-log/dm-0] 2020-04-22T14:17:23.565 INFO:teuthology.orchestra.run.smithi103.stdout:root 21968 0.0 0.0 0 0 ? I< 13:59 0:00 \_ [xfs-eofblocks/d] 2020-04-22T14:17:23.565 INFO:teuthology.orchestra.run.smithi103.stdout:root 21969 0.0 0.0 0 0 ? S 13:59 0:00 \_ [xfsaild/dm-0] 2020-04-22T14:17:23.565 INFO:teuthology.orchestra.run.smithi103.stdout:root 22413 0.0 0.0 0 0 ? I 13:59 0:00 \_ [kworker/4:0-events] 2020-04-22T14:17:23.565 INFO:teuthology.orchestra.run.smithi103.stdout:root 27917 0.0 0.0 0 0 ? I 14:01 0:00 \_ [kworker/6:0-dio/dm-3] 2020-04-22T14:17:23.566 INFO:teuthology.orchestra.run.smithi103.stdout:root 27919 0.0 0.0 0 0 ? I 14:01 0:00 \_ [kworker/3:3-events] 2020-04-22T14:17:23.566 INFO:teuthology.orchestra.run.smithi103.stdout:root 29216 0.0 0.0 0 0 ? I< 14:01 0:00 \_ [xfs-buf/dm-1] 2020-04-22T14:17:23.566 INFO:teuthology.orchestra.run.smithi103.stdout:root 29217 0.0 0.0 0 0 ? I< 14:01 0:00 \_ [xfs-data/dm-1] 2020-04-22T14:17:23.566 INFO:teuthology.orchestra.run.smithi103.stdout:root 29218 0.0 0.0 0 0 ? I< 14:01 0:00 \_ [xfs-conv/dm-1] 2020-04-22T14:17:23.566 INFO:teuthology.orchestra.run.smithi103.stdout:root 29219 0.0 0.0 0 0 ? I< 14:01 0:00 \_ [xfs-cil/dm-1] 2020-04-22T14:17:23.566 INFO:teuthology.orchestra.run.smithi103.stdout:root 29220 0.0 0.0 0 0 ? I< 14:01 0:00 \_ [xfs-reclaim/dm-] 2020-04-22T14:17:23.566 INFO:teuthology.orchestra.run.smithi103.stdout:root 29221 0.0 0.0 0 0 ? I< 14:01 0:00 \_ [xfs-log/dm-1] 2020-04-22T14:17:23.567 INFO:teuthology.orchestra.run.smithi103.stdout:root 29222 0.0 0.0 0 0 ? I< 14:01 0:00 \_ [xfs-eofblocks/d] 2020-04-22T14:17:23.567 INFO:teuthology.orchestra.run.smithi103.stdout:root 29223 0.0 0.0 0 0 ? S 14:01 0:00 \_ [xfsaild/dm-1] 2020-04-22T14:17:23.567 INFO:teuthology.orchestra.run.smithi103.stdout:root 29356 0.0 0.0 0 0 ? I< 14:01 0:00 \_ [xfs-buf/dm-2] 2020-04-22T14:17:23.567 INFO:teuthology.orchestra.run.smithi103.stdout:root 29357 0.0 0.0 0 0 ? I< 14:01 0:00 \_ [xfs-data/dm-2] 2020-04-22T14:17:23.567 INFO:teuthology.orchestra.run.smithi103.stdout:root 29358 0.0 0.0 0 0 ? I< 14:01 0:00 \_ [xfs-conv/dm-2] 2020-04-22T14:17:23.567 INFO:teuthology.orchestra.run.smithi103.stdout:root 29359 0.0 0.0 0 0 ? I< 14:01 0:00 \_ [xfs-cil/dm-2] 2020-04-22T14:17:23.567 INFO:teuthology.orchestra.run.smithi103.stdout:root 29360 0.0 0.0 0 0 ? I< 14:01 0:00 \_ [xfs-reclaim/dm-] 2020-04-22T14:17:23.568 INFO:teuthology.orchestra.run.smithi103.stdout:root 29361 0.0 0.0 0 0 ? I< 14:01 0:00 \_ [xfs-log/dm-2] 2020-04-22T14:17:23.568 INFO:teuthology.orchestra.run.smithi103.stdout:root 29362 0.0 0.0 0 0 ? I< 14:01 0:00 \_ [xfs-eofblocks/d] 2020-04-22T14:17:23.568 INFO:teuthology.orchestra.run.smithi103.stdout:root 29363 0.0 0.0 0 0 ? S 14:01 0:00 \_ [xfsaild/dm-2] 2020-04-22T14:17:23.568 INFO:teuthology.orchestra.run.smithi103.stdout:root 29496 0.0 0.0 0 0 ? I< 14:01 0:00 \_ [xfs-buf/dm-3] 2020-04-22T14:17:23.568 INFO:teuthology.orchestra.run.smithi103.stdout:root 29497 0.0 0.0 0 0 ? I< 14:01 0:00 \_ [xfs-data/dm-3] 2020-04-22T14:17:23.568 INFO:teuthology.orchestra.run.smithi103.stdout:root 29498 0.0 0.0 0 0 ? I< 14:01 0:00 \_ [xfs-conv/dm-3] 2020-04-22T14:17:23.569 INFO:teuthology.orchestra.run.smithi103.stdout:root 29499 0.0 0.0 0 0 ? I< 14:01 0:00 \_ [xfs-cil/dm-3] 2020-04-22T14:17:23.569 INFO:teuthology.orchestra.run.smithi103.stdout:root 29500 0.0 0.0 0 0 ? I< 14:01 0:00 \_ [xfs-reclaim/dm-] 2020-04-22T14:17:23.569 INFO:teuthology.orchestra.run.smithi103.stdout:root 29501 0.0 0.0 0 0 ? I< 14:01 0:00 \_ [xfs-log/dm-3] 2020-04-22T14:17:23.569 INFO:teuthology.orchestra.run.smithi103.stdout:root 29502 0.0 0.0 0 0 ? I< 14:01 0:00 \_ [xfs-eofblocks/d] 2020-04-22T14:17:23.569 INFO:teuthology.orchestra.run.smithi103.stdout:root 29503 0.0 0.0 0 0 ? S 14:01 0:00 \_ [xfsaild/dm-3] 2020-04-22T14:17:23.569 INFO:teuthology.orchestra.run.smithi103.stdout:root 29636 0.0 0.0 0 0 ? I< 14:01 0:00 \_ [xfs-buf/dm-4] 2020-04-22T14:17:23.569 INFO:teuthology.orchestra.run.smithi103.stdout:root 29637 0.0 0.0 0 0 ? I< 14:01 0:00 \_ [xfs-data/dm-4] 2020-04-22T14:17:23.570 INFO:teuthology.orchestra.run.smithi103.stdout:root 29638 0.0 0.0 0 0 ? I< 14:01 0:00 \_ [xfs-conv/dm-4] 2020-04-22T14:17:23.570 INFO:teuthology.orchestra.run.smithi103.stdout:root 29639 0.0 0.0 0 0 ? I< 14:01 0:00 \_ [xfs-cil/dm-4] 2020-04-22T14:17:23.570 INFO:teuthology.orchestra.run.smithi103.stdout:root 29640 0.0 0.0 0 0 ? I< 14:01 0:00 \_ [xfs-reclaim/dm-] 2020-04-22T14:17:23.570 INFO:teuthology.orchestra.run.smithi103.stdout:root 29641 0.0 0.0 0 0 ? I< 14:01 0:00 \_ [xfs-log/dm-4] 2020-04-22T14:17:23.570 INFO:teuthology.orchestra.run.smithi103.stdout:root 29642 0.0 0.0 0 0 ? I< 14:01 0:00 \_ [xfs-eofblocks/d] 2020-04-22T14:17:23.570 INFO:teuthology.orchestra.run.smithi103.stdout:root 29643 0.0 0.0 0 0 ? S 14:01 0:00 \_ [xfsaild/dm-4] 2020-04-22T14:17:23.570 INFO:teuthology.orchestra.run.smithi103.stdout:root 29719 0.0 0.0 0 0 ? I< 14:01 0:00 \_ [dio/dm-1] 2020-04-22T14:17:23.571 INFO:teuthology.orchestra.run.smithi103.stdout:root 29902 0.0 0.0 0 0 ? I< 14:01 0:00 \_ [dio/dm-2] 2020-04-22T14:17:23.571 INFO:teuthology.orchestra.run.smithi103.stdout:root 30085 0.0 0.0 0 0 ? I< 14:01 0:00 \_ [dio/dm-3] 2020-04-22T14:17:23.571 INFO:teuthology.orchestra.run.smithi103.stdout:root 30268 0.0 0.0 0 0 ? I< 14:01 0:00 \_ [dio/dm-4] 2020-04-22T14:17:23.571 INFO:teuthology.orchestra.run.smithi103.stdout:root 40200 0.0 0.0 0 0 ? I 14:03 0:00 \_ [kworker/6:3-dio/dm-3] 2020-04-22T14:17:23.571 INFO:teuthology.orchestra.run.smithi103.stdout:root 45789 0.0 0.0 0 0 ? I 14:03 0:00 \_ [kworker/1:1-events] 2020-04-22T14:17:23.571 INFO:teuthology.orchestra.run.smithi103.stdout:root 51693 0.1 0.0 0 0 ? I 14:05 0:00 \_ [kworker/0:0-rcu_gp] 2020-04-22T14:17:23.571 INFO:teuthology.orchestra.run.smithi103.stdout:root 52341 0.0 0.0 0 0 ? I 14:05 0:00 \_ [kworker/5:2-rcu_gp] 2020-04-22T14:17:23.572 INFO:teuthology.orchestra.run.smithi103.stdout:root 54585 0.0 0.0 0 0 ? I 14:06 0:00 \_ [kworker/2:1-mm_percpu_wq] 2020-04-22T14:17:23.572 INFO:teuthology.orchestra.run.smithi103.stdout:root 57770 0.0 0.0 0 0 ? I 14:07 0:00 \_ [kworker/7:2-events] 2020-04-22T14:17:23.572 INFO:teuthology.orchestra.run.smithi103.stdout:root 62721 0.0 0.0 0 0 ? I 14:10 0:00 \_ [kworker/1:2-rcu_gp] 2020-04-22T14:17:23.572 INFO:teuthology.orchestra.run.smithi103.stdout:root 62892 0.0 0.0 0 0 ? I 14:10 0:00 \_ [kworker/u16:1-events_unbound] 2020-04-22T14:17:23.572 INFO:teuthology.orchestra.run.smithi103.stdout:root 63219 0.0 0.0 0 0 ? I 14:10 0:00 \_ [kworker/1:3-cgroup_pidlist_destroy] 2020-04-22T14:17:23.572 INFO:teuthology.orchestra.run.smithi103.stdout:root 64404 0.0 0.0 0 0 ? I 14:10 0:00 \_ [kworker/5:3-events] 2020-04-22T14:17:23.572 INFO:teuthology.orchestra.run.smithi103.stdout:root 66732 0.0 0.0 0 0 ? I 14:10 0:00 \_ [kworker/6:1-dio/dm-3] 2020-04-22T14:17:23.573 INFO:teuthology.orchestra.run.smithi103.stdout:root 68513 0.0 0.0 0 0 ? I 14:10 0:00 \_ [kworker/4:2-events] 2020-04-22T14:17:23.573 INFO:teuthology.orchestra.run.smithi103.stdout:root 68965 0.0 0.0 0 0 ? I 14:10 0:00 \_ [kworker/3:1-mm_percpu_wq] 2020-04-22T14:17:23.573 INFO:teuthology.orchestra.run.smithi103.stdout:root 70879 0.0 0.0 0 0 ? I 14:11 0:00 \_ [kworker/2:2-xfs-cil/dm-4] 2020-04-22T14:17:23.573 INFO:teuthology.orchestra.run.smithi103.stdout:root 74008 0.0 0.0 0 0 ? I 14:12 0:00 \_ [kworker/2:3-rcu_gp] 2020-04-22T14:17:23.573 INFO:teuthology.orchestra.run.smithi103.stdout:root 75352 0.0 0.0 0 0 ? I 14:12 0:00 \_ [kworker/4:3-events] 2020-04-22T14:17:23.573 INFO:teuthology.orchestra.run.smithi103.stdout:root 75354 0.2 0.0 0 0 ? I 14:12 0:00 \_ [kworker/0:1-events] 2020-04-22T14:17:23.573 INFO:teuthology.orchestra.run.smithi103.stdout:root 79786 0.0 0.0 0 0 ? I 14:12 0:00 \_ [kworker/0:2-xfs-data/dm-0] 2020-04-22T14:17:23.574 INFO:teuthology.orchestra.run.smithi103.stdout:root 85990 0.0 0.0 0 0 ? I 14:13 0:00 \_ [kworker/7:0-cgroup_pidlist_destroy] 2020-04-22T14:17:23.574 INFO:teuthology.orchestra.run.smithi103.stdout:root 85991 0.0 0.0 0 0 ? I 14:13 0:00 \_ [kworker/7:1-events] 2020-04-22T14:17:23.574 INFO:teuthology.orchestra.run.smithi103.stdout:root 92817 0.0 0.0 0 0 ? I 14:15 0:00 \_ [kworker/6:4-dio/dm-3] 2020-04-22T14:17:23.574 INFO:teuthology.orchestra.run.smithi103.stdout:root 92818 0.0 0.0 0 0 ? I 14:15 0:00 \_ [kworker/6:5-events_power_efficient] 2020-04-22T14:17:23.574 INFO:teuthology.orchestra.run.smithi103.stdout:root 92819 0.0 0.0 0 0 ? I 14:15 0:00 \_ [kworker/6:6-dio/dm-2] 2020-04-22T14:17:23.574 INFO:teuthology.orchestra.run.smithi103.stdout:root 92820 0.0 0.0 0 0 ? I 14:15 0:00 \_ [kworker/6:7-events] 2020-04-22T14:17:23.574 INFO:teuthology.orchestra.run.smithi103.stdout:root 97105 0.0 0.0 0 0 ? I 14:15 0:00 \_ [kworker/u16:2-events_unbound] 2020-04-22T14:17:23.575 INFO:teuthology.orchestra.run.smithi103.stdout:root 98606 0.0 0.0 0 0 ? I 14:16 0:00 \_ [kworker/1:0-xfs-cil/dm-0] 2020-04-22T14:17:23.575 INFO:teuthology.orchestra.run.smithi103.stdout:root 98938 0.0 0.0 0 0 ? I 14:16 0:00 \_ [kworker/3:0] 2020-04-22T14:17:23.575 INFO:teuthology.orchestra.run.smithi103.stdout:root 100052 0.0 0.0 0 0 ? I 14:16 0:00 \_ [kworker/5:0-mm_percpu_wq] 2020-04-22T14:17:23.575 INFO:teuthology.orchestra.run.smithi103.stdout:root 1 0.2 0.0 244880 14228 ? Ss 13:53 0:03 /usr/lib/systemd/systemd --switched-root --system --deserialize 17 2020-04-22T14:17:23.575 INFO:teuthology.orchestra.run.smithi103.stdout:root 1438 0.1 0.0 110216 30080 ? Ss 13:53 0:01 /usr/lib/systemd/systemd-journald 2020-04-22T14:17:23.575 INFO:teuthology.orchestra.run.smithi103.stdout:root 1476 0.0 0.0 110548 12556 ? Ss 13:53 0:01 /usr/lib/systemd/systemd-udevd 2020-04-22T14:17:23.575 INFO:teuthology.orchestra.run.smithi103.stdout:rpc 2373 0.0 0.0 66468 5292 ? Ss 13:53 0:00 /usr/bin/rpcbind -w -f 2020-04-22T14:17:23.576 INFO:teuthology.orchestra.run.smithi103.stdout:root 2376 0.1 0.0 149452 2872 ? S true 2020-04-22T14:17:23.603 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-04-22T14:17:23.603 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:17:23.603 INFO:teuthology.orchestra.run.smithi103:> path = "/sys/fs/fuse/connections/47/abort" 2020-04-22T14:17:23.603 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists(path): 2020-04-22T14:17:23.603 INFO:teuthology.orchestra.run.smithi103:> open(path, "w").write("1") 2020-04-22T14:17:23.604 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:17:23.913 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:23.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:17:23.974 INFO:teuthology.orchestra.run.smithi103:> sudo umount -l -f /home/ubuntu/cephtest/mnt.0 2020-04-22T14:17:24.052 INFO:teuthology.orchestra.run:waiting for 900 2020-04-22T14:17:24.052 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:17:24.053 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:17:24.053 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:24.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:24.104 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:17:24.178 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:24.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:24.230 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down brx.0' 2020-04-22T14:17:24.389 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.0' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/48) 2020-04-22T14:17:24.389 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:24.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:24.412 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete brx.0' 2020-04-22T14:17:24.432 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:17:24.449 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:17:24.492 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:24.509 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:17:24.520 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.0' (f5d72895-9193-44bf-a626-dbcf79496abe) successfully deleted. 2020-04-22T14:17:24.520 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:24.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:24.567 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:17:24.679 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:24.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:24.731 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:17:24.789 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:17:24.790 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:17:24.790 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:17:24.790 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:24.790 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:17:24.791 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:24.791 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:17:24.791 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:17:24.791 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:17:24.792 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:17:24.792 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:17:24.796 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:17:24.796 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:17:24.796 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:17:24.796 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:17:24.796 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 41795sec preferred_lft 41795sec 2020-04-22T14:17:24.797 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:17:24.797 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:24.797 INFO:teuthology.orchestra.run.smithi103.stdout:34: brx.1@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:17:24.797 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether d2:98:d4:1b:2c:0d brd ff:ff:ff:ff:ff:ff link-netnsid 1 2020-04-22T14:17:24.797 INFO:teuthology.orchestra.run.smithi103.stdout:37: brx.2@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:17:24.798 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether a6:ff:ab:51:83:b6 brd ff:ff:ff:ff:ff:ff link-netnsid 2 2020-04-22T14:17:24.798 INFO:teuthology.orchestra.run.smithi103.stdout:38: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:17:24.798 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether de:47:69:02:b1:ec brd ff:ff:ff:ff:ff:ff 2020-04-22T14:17:24.798 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:17:24.798 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:24.798 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::1004:4d67:a829:aff9/64 scope link noprefixroute 2020-04-22T14:17:24.798 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:24.799 INFO:teuthology.orchestra.run.smithi103.stdout:39: brx.0@if2: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:17:24.799 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 12:89:28:89:ea:00 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:17:24.799 INFO:teuthology.orchestra.run.smithi103.stdout:40: brx.3@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-04-22T14:17:24.799 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether de:47:69:02:b1:ec brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2020-04-22T14:17:24.800 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:24.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:24.839 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:17:24.947 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:24.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:24.967 INFO:teuthology.orchestra.run.smithi103:> nmcli connection show 2020-04-22T14:17:25.041 INFO:teuthology.orchestra.run.smithi103.stdout:NAME UUID TYPE DEVICE 2020-04-22T14:17:25.042 INFO:teuthology.orchestra.run.smithi103.stdout:System enp3s0f1 b0a308d1-bd90-60af-eb7c-0183bb425a1a ethernet enp3s0f1 2020-04-22T14:17:25.042 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-brx 6b3d6d40-16fd-49ac-9259-f712ca031e42 bridge ceph-brx 2020-04-22T14:17:25.042 INFO:teuthology.orchestra.run.smithi103.stdout:brx.3 fd906f59-a0ad-45fa-a791-2515cf159a7a ethernet brx.3 2020-04-22T14:17:25.042 INFO:teuthology.orchestra.run.smithi103.stdout:eno1 206ad60d-195e-4d4b-a9fe-a5dd1f33a67d ethernet -- 2020-04-22T14:17:25.042 INFO:teuthology.orchestra.run.smithi103.stdout:eno2 894a7dd2-d329-4985-9ef9-84a92c6e1c6c ethernet -- 2020-04-22T14:17:25.042 INFO:teuthology.orchestra.run.smithi103.stdout:enp3s0f0 5a3237ce-06ab-4ae0-818b-45bdf036cb08 ethernet -- 2020-04-22T14:17:25.043 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:25.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:25.090 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:17:25.148 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:25.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:25.197 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:17:25.253 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-04-22T14:17:25.258 INFO:teuthology.orchestra.run.smithi103.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2020-04-22T14:17:25.259 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:25.306 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:17:25.454 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.451+0000 7f20cfbd4700 1 Processor -- start 2020-04-22T14:17:25.454 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.451+0000 7f20cfbd4700 1 -- start start 2020-04-22T14:17:25.457 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.452+0000 7f20cfbd4700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f20c80ac740 0x7f20c80b5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:25.457 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.452+0000 7f20cfbd4700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f20c8064a10 0x7f20c81421f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:25.457 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.452+0000 7f20cfbd4700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20c80b51e0 con 0x7f20c81282c0 2020-04-22T14:17:25.457 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.452+0000 7f20cfbd4700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20c81286a0 con 0x7f20c80ac740 2020-04-22T14:17:25.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.452+0000 7f20cfbd4700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20c80b6020 con 0x7f20c8064a10 2020-04-22T14:17:25.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.452+0000 7f20ce171700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f20c8064a10 0x7f20c81421f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:25.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.452+0000 7f20ce171700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f20c8064a10 0x7f20c81421f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57046/0 (socket says 172.21.15.103:57046) 2020-04-22T14:17:25.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.452+0000 7f20ce171700 1 -- 172.21.15.103:0/1963963167 learned_addr learned my addr 172.21.15.103:0/1963963167 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:25.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.452+0000 7f20ce171700 1 -- 172.21.15.103:0/1963963167 >> v2:172.21.15.86:3300/0 conn(0x7f20c80ac740 msgr2=0x7f20c80b5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:25.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.452+0000 7f20cd16f700 1 --2- 172.21.15.103:0/1963963167 >> v2:172.21.15.86:3300/0 conn(0x7f20c80ac740 0x7f20c80b5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:25.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.452+0000 7f20ce171700 1 --2- 172.21.15.103:0/1963963167 >> v2:172.21.15.86:3300/0 conn(0x7f20c80ac740 0x7f20c80b5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:25.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.452+0000 7f20ce171700 1 -- 172.21.15.103:0/1963963167 >> v1:172.21.15.86:6789/0 conn(0x7f20c81282c0 legacy=0x7f20c805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:25.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.452+0000 7f20ce171700 1 -- 172.21.15.103:0/1963963167 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c80b5480 con 0x7f20c8064a10 2020-04-22T14:17:25.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.453+0000 7f20cd16f700 1 --2- 172.21.15.103:0/1963963167 >> v2:172.21.15.86:3300/0 conn(0x7f20c80ac740 0x7f20c80b5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:17:25.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.453+0000 7f20ce171700 1 --2- 172.21.15.103:0/1963963167 >> v2:172.21.15.103:3300/0 conn(0x7f20c8064a10 0x7f20c81421f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f20c8064680 tx=0x7f20c0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:25.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.453+0000 7f20ce171700 1 --2- 172.21.15.103:0/1963963167 >> v2:172.21.15.103:3300/0 conn(0x7f20c8064a10 0x7f20c81421f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f20c8064680 tx=0x7f20c0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:25.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.453+0000 7f20ce171700 1 --2- 172.21.15.103:0/1963963167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20c8064a10 0x7f20c81421f0 secure :-1 s=READY pgs=1815 cs=0 l=1 rx=0x7f20c8064680 tx=0x7f20c0007dc0).ready entity=mon.1 client_cookie=2d007638bea1c74a server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:25.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.453+0000 7f20ce171700 1 --2- 172.21.15.103:0/1963963167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20c8064a10 0x7f20c81421f0 secure :-1 s=THROTTLE_DONE pgs=1815 cs=0 l=1 rx=0x7f20c8064680 tx=0x7f20c0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:25.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.453+0000 7f20cc96e700 1 -- 172.21.15.103:0/1963963167 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20c000c370 con 0x7f20c8064a10 2020-04-22T14:17:25.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.453+0000 7f20ce171700 1 --2- 172.21.15.103:0/1963963167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20c8064a10 0x7f20c81421f0 secure :-1 s=THROTTLE_DONE pgs=1815 cs=0 l=1 rx=0x7f20c8064680 tx=0x7f20c0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:25.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.453+0000 7f20ce171700 1 --2- 172.21.15.103:0/1963963167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20c8064a10 0x7f20c81421f0 secure :-1 s=THROTTLE_DONE pgs=1815 cs=0 l=1 rx=0x7f20c8064680 tx=0x7f20c0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:25.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.453+0000 7f20cc96e700 1 -- 172.21.15.103:0/1963963167 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c000c4d0 con 0x7f20c8064a10 2020-04-22T14:17:25.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.453+0000 7f20cc96e700 1 -- 172.21.15.103:0/1963963167 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20c000c870 con 0x7f20c8064a10 2020-04-22T14:17:25.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.453+0000 7f20cfbd4700 1 -- 172.21.15.103:0/1963963167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20c8064a10 msgr2=0x7f20c81421f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:25.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.453+0000 7f20cfbd4700 1 --2- 172.21.15.103:0/1963963167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20c8064a10 0x7f20c81421f0 secure :-1 s=READY pgs=1815 cs=0 l=1 rx=0x7f20c8064680 tx=0x7f20c0007dc0).stop 2020-04-22T14:17:25.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.453+0000 7f20cfbd4700 1 -- 172.21.15.103:0/1963963167 shutdown_connections 2020-04-22T14:17:25.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.453+0000 7f20cfbd4700 1 --2- 172.21.15.103:0/1963963167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20c8064a10 0x7f20c81421f0 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:25.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.453+0000 7f20cfbd4700 1 --2- 172.21.15.103:0/1963963167 >> v2:172.21.15.86:3300/0 conn(0x7f20c80ac740 0x7f20c80b5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:25.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.453+0000 7f20cfbd4700 1 -- 172.21.15.103:0/1963963167 >> 172.21.15.103:0/1963963167 conn(0x7f20c80b9160 msgr2=0x7f20c805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:25.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.453+0000 7f20cfbd4700 1 -- 172.21.15.103:0/1963963167 shutdown_connections 2020-04-22T14:17:25.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.453+0000 7f20cfbd4700 1 -- 172.21.15.103:0/1963963167 wait complete. 2020-04-22T14:17:25.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.454+0000 7f20cfbd4700 1 Processor -- start 2020-04-22T14:17:25.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.454+0000 7f20cfbd4700 1 -- start start 2020-04-22T14:17:25.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.455+0000 7f20cfbd4700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f20c8064a10 0x7f20c81448b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:25.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.455+0000 7f20cfbd4700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f20c80ac740 0x7f20c81579b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:25.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.455+0000 7f20cfbd4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f20c81282c0 0x7f20c8150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:25.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.455+0000 7f20cfbd4700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20c8144d10 con 0x7f20c8064a10 2020-04-22T14:17:25.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.455+0000 7f20cfbd4700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20c8153d50 con 0x7f20c80ac740 2020-04-22T14:17:25.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.455+0000 7f20cfbd4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c8153ff0 con 0x7f20c81282c0 2020-04-22T14:17:25.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.455+0000 7f20cd16f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f20c80ac740 0x7f20c81579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:25.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.455+0000 7f20cd16f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f20c80ac740 0x7f20c81579b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57052/0 (socket says 172.21.15.103:57052) 2020-04-22T14:17:25.466 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.455+0000 7f20cd16f700 1 -- 172.21.15.103:0/2199366064 learned_addr learned my addr 172.21.15.103:0/2199366064 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:25.466 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.455+0000 7f20ce171700 1 --2- 172.21.15.103:0/2199366064 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f20c81282c0 0x7f20c8150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:25.466 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.455+0000 7f20cd970700 1 --2- 172.21.15.103:0/2199366064 >> v2:172.21.15.86:3300/0 conn(0x7f20c8064a10 0x7f20c81448b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:25.466 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.456+0000 7f20cd16f700 1 -- 172.21.15.103:0/2199366064 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f20c81282c0 msgr2=0x7f20c8150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:25.466 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.456+0000 7f20cd16f700 1 --2- 172.21.15.103:0/2199366064 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f20c81282c0 0x7f20c8150bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:25.466 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.456+0000 7f20cd16f700 1 -- 172.21.15.103:0/2199366064 >> v2:172.21.15.86:3300/0 conn(0x7f20c8064a10 msgr2=0x7f20c81448b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:25.466 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.456+0000 7f20cd16f700 1 --2- 172.21.15.103:0/2199366064 >> v2:172.21.15.86:3300/0 conn(0x7f20c8064a10 0x7f20c81448b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:25.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.456+0000 7f20cd16f700 1 -- 172.21.15.103:0/2199366064 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c8154290 con 0x7f20c80ac740 2020-04-22T14:17:25.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.456+0000 7f20cd16f700 1 --2- 172.21.15.103:0/2199366064 >> v2:172.21.15.103:3300/0 conn(0x7f20c80ac740 0x7f20c81579b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f20b8002f30 tx=0x7f20b8010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:25.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.456+0000 7f20cd16f700 1 --2- 172.21.15.103:0/2199366064 >> v2:172.21.15.103:3300/0 conn(0x7f20c80ac740 0x7f20c81579b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f20b8002f30 tx=0x7f20b8010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:25.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.456+0000 7f20cd16f700 1 --2- 172.21.15.103:0/2199366064 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20c80ac740 0x7f20c81579b0 secure :-1 s=READY pgs=1816 cs=0 l=1 rx=0x7f20b8002f30 tx=0x7f20b8010af0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:25.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.456+0000 7f20cd16f700 1 --2- 172.21.15.103:0/2199366064 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20c80ac740 0x7f20c81579b0 secure :-1 s=THROTTLE_DONE pgs=1816 cs=0 l=1 rx=0x7f20b8002f30 tx=0x7f20b8010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:25.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.456+0000 7f20b6ffd700 1 -- 172.21.15.103:0/2199366064 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20b800a370 con 0x7f20c80ac740 2020-04-22T14:17:25.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.456+0000 7f20cd16f700 1 --2- 172.21.15.103:0/2199366064 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20c80ac740 0x7f20c81579b0 secure :-1 s=THROTTLE_DONE pgs=1816 cs=0 l=1 rx=0x7f20b8002f30 tx=0x7f20b8010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:25.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.456+0000 7f20cd16f700 1 --2- 172.21.15.103:0/2199366064 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20c80ac740 0x7f20c81579b0 secure :-1 s=THROTTLE_DONE pgs=1816 cs=0 l=1 rx=0x7f20b8002f30 tx=0x7f20b8010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:25.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.456+0000 7f20b6ffd700 1 -- 172.21.15.103:0/2199366064 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b800a4d0 con 0x7f20c80ac740 2020-04-22T14:17:25.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.456+0000 7f20cfbd4700 1 -- 172.21.15.103:0/2199366064 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20c8157e10 con 0x7f20c80ac740 2020-04-22T14:17:25.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.456+0000 7f20b6ffd700 1 -- 172.21.15.103:0/2199366064 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20b800a8f0 con 0x7f20c80ac740 2020-04-22T14:17:25.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.456+0000 7f20cfbd4700 1 -- 172.21.15.103:0/2199366064 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20c8153990 con 0x7f20c80ac740 2020-04-22T14:17:25.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.457+0000 7f20cd16f700 1 --2- 172.21.15.103:0/2199366064 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20c80ac740 0x7f20c81579b0 secure :-1 s=THROTTLE_DONE pgs=1816 cs=0 l=1 rx=0x7f20b8002f30 tx=0x7f20b8010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:25.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.457+0000 7f20b6ffd700 1 -- 172.21.15.103:0/2199366064 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f20b800ab60 con 0x7f20c80ac740 2020-04-22T14:17:25.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.457+0000 7f20cd16f700 1 --2- 172.21.15.103:0/2199366064 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20c80ac740 0x7f20c81579b0 secure :-1 s=THROTTLE_DONE pgs=1816 cs=0 l=1 rx=0x7f20b8002f30 tx=0x7f20b8010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:25.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.457+0000 7f20cfbd4700 1 -- 172.21.15.103:0/2199366064 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20c8056c90 con 0x7f20c80ac740 2020-04-22T14:17:25.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.457+0000 7f20b6ffd700 1 --2- 172.21.15.103:0/2199366064 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f20a804daf0 0x7f20a804ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:25.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.457+0000 7f20b6ffd700 1 -- 172.21.15.103:0/2199366064 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f20b8061660 con 0x7f20c80ac740 2020-04-22T14:17:25.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.457+0000 7f20cd970700 1 --2- 172.21.15.103:0/2199366064 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f20a804daf0 0x7f20a804ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:25.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.458+0000 7f20cd970700 1 --2- 172.21.15.103:0/2199366064 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f20a804daf0 0x7f20a804ffb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f20c4001f50 tx=0x7f20c4003980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:25.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.458+0000 7f20cd970700 1 --2- 172.21.15.103:0/2199366064 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f20a804daf0 0x7f20a804ffb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f20c4001f50 tx=0x7f20c4003980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:25.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.458+0000 7f20cd970700 1 --2- 172.21.15.103:0/2199366064 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f20a804daf0 0x7f20a804ffb0 secure :-1 s=READY pgs=665 cs=0 l=1 rx=0x7f20c4001f50 tx=0x7f20c4003980).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:25.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.461+0000 7f20cd16f700 1 --2- 172.21.15.103:0/2199366064 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20c80ac740 0x7f20c81579b0 secure :-1 s=THROTTLE_DONE pgs=1816 cs=0 l=1 rx=0x7f20b8002f30 tx=0x7f20b8010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:25.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.461+0000 7f20b6ffd700 1 -- 172.21.15.103:0/2199366064 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f20b803ca40 con 0x7f20c80ac740 2020-04-22T14:17:25.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.609+0000 7f20cfbd4700 1 -- 172.21.15.103:0/2199366064 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20c80b4eb0 con 0x7f20c80ac740 2020-04-22T14:17:25.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.610+0000 7f20cd16f700 1 --2- 172.21.15.103:0/2199366064 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20c80ac740 0x7f20c81579b0 secure :-1 s=THROTTLE_DONE pgs=1816 cs=0 l=1 rx=0x7f20b8002f30 tx=0x7f20b8010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:25.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.610+0000 7f20b6ffd700 1 -- 172.21.15.103:0/2199366064 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+16162 (secure 0 0 0) 0x7f20b8040060 con 0x7f20c80ac740 2020-04-22T14:17:25.614 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:17:25.614 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":125,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:17:09.473738+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:16:44.031424+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2020-04-22T14:16:45.073910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"192.168.0.1:0/546260275":"2020-04-22T15:17:09.024514+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:17:25.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.612+0000 7f20cfbd4700 1 -- 172.21.15.103:0/2199366064 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f20a804daf0 msgr2=0x7f20a804ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:25.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.612+0000 7f20cfbd4700 1 --2- 172.21.15.103:0/2199366064 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f20a804daf0 0x7f20a804ffb0 secure :-1 s=READY pgs=665 cs=0 l=1 rx=0x7f20c4001f50 tx=0x7f20c4003980).stop 2020-04-22T14:17:25.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.612+0000 7f20cfbd4700 1 -- 172.21.15.103:0/2199366064 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20c80ac740 msgr2=0x7f20c81579b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:25.615 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.612+0000 7f20cfbd4700 1 --2- 172.21.15.103:0/2199366064 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20c80ac740 0x7f20c81579b0 secure :-1 s=READY pgs=1816 cs=0 l=1 rx=0x7f20b8002f30 tx=0x7f20b8010af0).stop 2020-04-22T14:17:25.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.612+0000 7f20cfbd4700 1 -- 172.21.15.103:0/2199366064 shutdown_connections 2020-04-22T14:17:25.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.612+0000 7f20cfbd4700 1 --2- 172.21.15.103:0/2199366064 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f20a804daf0 0x7f20a804ffb0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:25.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.612+0000 7f20cfbd4700 1 --2- 172.21.15.103:0/2199366064 >> v2:172.21.15.86:3300/0 conn(0x7f20c8064a10 0x7f20c81448b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:25.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.612+0000 7f20cfbd4700 1 --2- 172.21.15.103:0/2199366064 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f20c81282c0 0x7f20c8150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:25.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.612+0000 7f20cfbd4700 1 --2- 172.21.15.103:0/2199366064 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20c80ac740 0x7f20c81579b0 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:25.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.612+0000 7f20cfbd4700 1 -- 172.21.15.103:0/2199366064 >> 172.21.15.103:0/2199366064 conn(0x7f20c80b9160 msgr2=0x7f20c8062a10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:25.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.612+0000 7f20cfbd4700 1 -- 172.21.15.103:0/2199366064 shutdown_connections 2020-04-22T14:17:25.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.612+0000 7f20cfbd4700 1 -- 172.21.15.103:0/2199366064 wait complete. 2020-04-22T14:17:25.626 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:16:44.031424+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 21, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'123', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:16:45.073910+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 22, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'124', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:17:25.626 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:25.639 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:17:25.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.787+0000 7f312aab7700 1 Processor -- start 2020-04-22T14:17:25.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.787+0000 7f312aab7700 1 -- start start 2020-04-22T14:17:25.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.788+0000 7f312aab7700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f31240b9140 0x7f312412b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:25.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.788+0000 7f312aab7700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f312412b670 0x7f3124143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:25.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.788+0000 7f312aab7700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31241467e0 con 0x7f31240ac950 2020-04-22T14:17:25.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.788+0000 7f312aab7700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31240602f0 con 0x7f312412b670 2020-04-22T14:17:25.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.788+0000 7f312aab7700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3124060050 con 0x7f31240b9140 2020-04-22T14:17:25.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.788+0000 7f3129054700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f312412b670 0x7f3124143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:25.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.788+0000 7f3129054700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f312412b670 0x7f3124143090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57062/0 (socket says 172.21.15.103:57062) 2020-04-22T14:17:25.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.788+0000 7f3129054700 1 -- 172.21.15.103:0/64960305 learned_addr learned my addr 172.21.15.103:0/64960305 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:25.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.788+0000 7f3128853700 1 --2- 172.21.15.103:0/64960305 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f31240b9140 0x7f312412b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:25.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.788+0000 7f3129054700 1 -- 172.21.15.103:0/64960305 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f31240b9140 msgr2=0x7f312412b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:25.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.788+0000 7f3129054700 1 --2- 172.21.15.103:0/64960305 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f31240b9140 0x7f312412b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:25.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.788+0000 7f3129054700 1 -- 172.21.15.103:0/64960305 >> v1:172.21.15.86:6789/0 conn(0x7f31240ac950 legacy=0x7f3124146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:25.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.788+0000 7f3129054700 1 -- 172.21.15.103:0/64960305 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31240b9520 con 0x7f312412b670 2020-04-22T14:17:25.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.788+0000 7f3128853700 1 --2- 172.21.15.103:0/64960305 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f31240b9140 0x7f312412b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:17:25.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.788+0000 7f3129054700 1 --2- 172.21.15.103:0/64960305 >> v2:172.21.15.103:3300/0 conn(0x7f312412b670 0x7f3124143090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3124060f70 tx=0x7f3114007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:25.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.788+0000 7f3129054700 1 --2- 172.21.15.103:0/64960305 >> v2:172.21.15.103:3300/0 conn(0x7f312412b670 0x7f3124143090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3124060f70 tx=0x7f3114007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:25.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.788+0000 7f3129054700 1 --2- 172.21.15.103:0/64960305 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f312412b670 0x7f3124143090 secure :-1 s=READY pgs=1817 cs=0 l=1 rx=0x7f3124060f70 tx=0x7f3114007a40).ready entity=mon.1 client_cookie=55ef8c9c6c34197c server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:25.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.788+0000 7f3129054700 1 --2- 172.21.15.103:0/64960305 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f312412b670 0x7f3124143090 secure :-1 s=THROTTLE_DONE pgs=1817 cs=0 l=1 rx=0x7f3124060f70 tx=0x7f3114007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:25.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.788+0000 7f31237fe700 1 -- 172.21.15.103:0/64960305 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31140116e0 con 0x7f312412b670 2020-04-22T14:17:25.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.788+0000 7f3129054700 1 --2- 172.21.15.103:0/64960305 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f312412b670 0x7f3124143090 secure :-1 s=THROTTLE_DONE pgs=1817 cs=0 l=1 rx=0x7f3124060f70 tx=0x7f3114007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:25.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.788+0000 7f3129054700 1 --2- 172.21.15.103:0/64960305 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f312412b670 0x7f3124143090 secure :-1 s=THROTTLE_DONE pgs=1817 cs=0 l=1 rx=0x7f3124060f70 tx=0x7f3114007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:25.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.788+0000 7f31237fe700 1 -- 172.21.15.103:0/64960305 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3114011840 con 0x7f312412b670 2020-04-22T14:17:25.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.788+0000 7f31237fe700 1 -- 172.21.15.103:0/64960305 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3114011c60 con 0x7f312412b670 2020-04-22T14:17:25.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.788+0000 7f312aab7700 1 -- 172.21.15.103:0/64960305 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f312412b670 msgr2=0x7f3124143090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:25.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.788+0000 7f312aab7700 1 --2- 172.21.15.103:0/64960305 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f312412b670 0x7f3124143090 secure :-1 s=READY pgs=1817 cs=0 l=1 rx=0x7f3124060f70 tx=0x7f3114007a40).stop 2020-04-22T14:17:25.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.789+0000 7f312aab7700 1 -- 172.21.15.103:0/64960305 shutdown_connections 2020-04-22T14:17:25.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.789+0000 7f312aab7700 1 --2- 172.21.15.103:0/64960305 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f312412b670 0x7f3124143090 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:25.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.789+0000 7f312aab7700 1 --2- 172.21.15.103:0/64960305 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f31240b9140 0x7f312412b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:25.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.789+0000 7f312aab7700 1 -- 172.21.15.103:0/64960305 >> 172.21.15.103:0/64960305 conn(0x7f312405b7b0 msgr2=0x7f31240b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:25.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.789+0000 7f312aab7700 1 -- 172.21.15.103:0/64960305 shutdown_connections 2020-04-22T14:17:25.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.789+0000 7f312aab7700 1 -- 172.21.15.103:0/64960305 wait complete. 2020-04-22T14:17:25.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.790+0000 7f312aab7700 1 Processor -- start 2020-04-22T14:17:25.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.790+0000 7f312aab7700 1 -- start start 2020-04-22T14:17:25.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.791+0000 7f312aab7700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f31240ac950 0x7f31241427a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:25.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.791+0000 7f312aab7700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3124153b30 con 0x7f31240b9140 2020-04-22T14:17:25.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.791+0000 7f312aab7700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3124153860 con 0x7f312412b670 2020-04-22T14:17:25.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.791+0000 7f312aab7700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31240b2930 con 0x7f31240ac950 2020-04-22T14:17:25.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.791+0000 7f3129054700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f312412b670 0x7f31240b2220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49258/0 (socket says 172.21.15.103:49258) 2020-04-22T14:17:25.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.791+0000 7f3129054700 1 -- 172.21.15.103:0/2934629692 learned_addr learned my addr 172.21.15.103:0/2934629692 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:17:25.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.791+0000 7f3128853700 1 --2- 172.21.15.103:0/2934629692 >> v2:172.21.15.86:3300/0 conn(0x7f31240ac950 0x7f31241427a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:25.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.791+0000 7f3121ffb700 1 -- 172.21.15.103:0/2934629692 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3257495175 0 0) 0x7f3124153860 con 0x7f312412b670 2020-04-22T14:17:25.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.791+0000 7f3121ffb700 1 -- 172.21.15.103:0/2934629692 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3108002fe0 con 0x7f312412b670 2020-04-22T14:17:25.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.791+0000 7f3121ffb700 1 -- 172.21.15.103:0/2934629692 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3995577485 0 0) 0x7f3108002fe0 con 0x7f312412b670 2020-04-22T14:17:25.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.791+0000 7f3121ffb700 1 -- 172.21.15.103:0/2934629692 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3124153860 con 0x7f312412b670 2020-04-22T14:17:25.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.791+0000 7f3121ffb700 1 -- 172.21.15.103:0/2934629692 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f31140085e0 con 0x7f312412b670 2020-04-22T14:17:25.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.791+0000 7f3121ffb700 1 -- 172.21.15.103:0/2934629692 >> v2:172.21.15.86:3300/0 conn(0x7f31240ac950 msgr2=0x7f31241427a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:25.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.791+0000 7f3121ffb700 1 --2- 172.21.15.103:0/2934629692 >> v2:172.21.15.86:3300/0 conn(0x7f31240ac950 0x7f31241427a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:25.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.791+0000 7f3121ffb700 1 -- 172.21.15.103:0/2934629692 >> v1:172.21.15.103:6789/0 conn(0x7f312412b670 legacy=0x7f31240b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:25.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.791+0000 7f3121ffb700 1 -- 172.21.15.103:0/2934629692 >> v1:172.21.15.86:6789/0 conn(0x7f31240b9140 legacy=0x7f3124154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:25.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.791+0000 7f3121ffb700 1 --2- 172.21.15.103:0/2934629692 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f31080049b0 0x7f3108004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:25.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.791+0000 7f3121ffb700 1 --2- 172.21.15.103:0/2934629692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3108003920 0x7f3108003d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:25.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.791+0000 7f3121ffb700 1 --2- 172.21.15.103:0/2934629692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31080041e0 0x7f310800b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:25.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.791+0000 7f3121ffb700 1 -- 172.21.15.103:0/2934629692 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31240b2930 con 0x7f3108003920 2020-04-22T14:17:25.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.791+0000 7f3121ffb700 1 -- 172.21.15.103:0/2934629692 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310800bbb0 con 0x7f31080041e0 2020-04-22T14:17:25.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.791+0000 7f3121ffb700 1 -- 172.21.15.103:0/2934629692 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f310800bcf0 con 0x7f31080049b0 2020-04-22T14:17:25.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.792+0000 7f3123fff700 1 --2- 172.21.15.103:0/2934629692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3108003920 0x7f3108003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:25.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.792+0000 7f3128853700 1 --2- 172.21.15.103:0/2934629692 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f31080049b0 0x7f3108004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:25.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.792+0000 7f3129054700 1 --2- 172.21.15.103:0/2934629692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31080041e0 0x7f310800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:25.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.792+0000 7f3123fff700 1 -- 172.21.15.103:0/2934629692 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f31080049b0 msgr2=0x7f3108004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:25.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.792+0000 7f3123fff700 1 --2- 172.21.15.103:0/2934629692 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f31080049b0 0x7f3108004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:25.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.792+0000 7f3123fff700 1 -- 172.21.15.103:0/2934629692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31080041e0 msgr2=0x7f310800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:25.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.792+0000 7f3123fff700 1 --2- 172.21.15.103:0/2934629692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31080041e0 0x7f310800b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:25.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.792+0000 7f3123fff700 1 -- 172.21.15.103:0/2934629692 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31240b2a70 con 0x7f3108003920 2020-04-22T14:17:25.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.792+0000 7f3129054700 1 -- 172.21.15.103:0/2934629692 reap_dead start 2020-04-22T14:17:25.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.792+0000 7f312aab7700 1 -- 172.21.15.103:0/2934629692 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31241427a0 con 0x7f3108003920 2020-04-22T14:17:25.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.792+0000 7f3123fff700 1 --2- 172.21.15.103:0/2934629692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3108003920 0x7f3108003d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3108005650 tx=0x7f310c010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:25.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.792+0000 7f312aab7700 1 -- 172.21.15.103:0/2934629692 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3124061cd0 con 0x7f3108003920 2020-04-22T14:17:25.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.792+0000 7f3123fff700 1 --2- 172.21.15.103:0/2934629692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3108003920 0x7f3108003d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3108005650 tx=0x7f310c010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:25.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.792+0000 7f3123fff700 1 --2- 172.21.15.103:0/2934629692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3108003920 0x7f3108003d80 secure :-1 s=READY pgs=968 cs=0 l=1 rx=0x7f3108005650 tx=0x7f310c010870).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:25.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.792+0000 7f3123fff700 1 --2- 172.21.15.103:0/2934629692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3108003920 0x7f3108003d80 secure :-1 s=THROTTLE_DONE pgs=968 cs=0 l=1 rx=0x7f3108005650 tx=0x7f310c010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:25.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.792+0000 7f3121ffb700 1 -- 172.21.15.103:0/2934629692 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f310c006cc0 con 0x7f3108003920 2020-04-22T14:17:25.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.792+0000 7f3123fff700 1 --2- 172.21.15.103:0/2934629692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3108003920 0x7f3108003d80 secure :-1 s=THROTTLE_DONE pgs=968 cs=0 l=1 rx=0x7f3108005650 tx=0x7f310c010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:25.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.792+0000 7f3123fff700 1 --2- 172.21.15.103:0/2934629692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3108003920 0x7f3108003d80 secure :-1 s=THROTTLE_DONE pgs=968 cs=0 l=1 rx=0x7f3108005650 tx=0x7f310c010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:25.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.792+0000 7f3121ffb700 1 -- 172.21.15.103:0/2934629692 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310c006e60 con 0x7f3108003920 2020-04-22T14:17:25.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.792+0000 7f3121ffb700 1 -- 172.21.15.103:0/2934629692 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f310c00a4a0 con 0x7f3108003920 2020-04-22T14:17:25.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.793+0000 7f312aab7700 1 -- 172.21.15.103:0/2934629692 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30fc003340 con 0x7f3108003920 2020-04-22T14:17:25.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.793+0000 7f3123fff700 1 --2- 172.21.15.103:0/2934629692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3108003920 0x7f3108003d80 secure :-1 s=THROTTLE_DONE pgs=968 cs=0 l=1 rx=0x7f3108005650 tx=0x7f310c010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:25.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.793+0000 7f3121ffb700 1 -- 172.21.15.103:0/2934629692 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f310c00a600 con 0x7f3108003920 2020-04-22T14:17:25.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.794+0000 7f3123fff700 1 --2- 172.21.15.103:0/2934629692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3108003920 0x7f3108003d80 secure :-1 s=THROTTLE_DONE pgs=968 cs=0 l=1 rx=0x7f3108005650 tx=0x7f310c010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:25.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.794+0000 7f3121ffb700 1 --2- 172.21.15.103:0/2934629692 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3108051980 0x7f3108053e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:25.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.794+0000 7f3121ffb700 1 -- 172.21.15.103:0/2934629692 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f310c061230 con 0x7f3108003920 2020-04-22T14:17:25.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.794+0000 7f3128853700 1 --2- 172.21.15.103:0/2934629692 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3108051980 0x7f3108053e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:25.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.794+0000 7f3128853700 1 --2- 172.21.15.103:0/2934629692 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3108051980 0x7f3108053e40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f311c0032b0 tx=0x7f311c00cd50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:25.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.794+0000 7f3128853700 1 --2- 172.21.15.103:0/2934629692 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3108051980 0x7f3108053e40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f311c0032b0 tx=0x7f311c00cd50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:25.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.794+0000 7f3128853700 1 --2- 172.21.15.103:0/2934629692 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3108051980 0x7f3108053e40 secure :-1 s=READY pgs=666 cs=0 l=1 rx=0x7f311c0032b0 tx=0x7f311c00cd50).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:25.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.797+0000 7f3123fff700 1 --2- 172.21.15.103:0/2934629692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3108003920 0x7f3108003d80 secure :-1 s=THROTTLE_DONE pgs=968 cs=0 l=1 rx=0x7f3108005650 tx=0x7f310c010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:25.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.797+0000 7f3121ffb700 1 -- 172.21.15.103:0/2934629692 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f310c03c610 con 0x7f3108003920 2020-04-22T14:17:25.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.942+0000 7f312aab7700 1 -- 172.21.15.103:0/2934629692 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f30fc002220 con 0x7f3108003920 2020-04-22T14:17:25.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.943+0000 7f3123fff700 1 --2- 172.21.15.103:0/2934629692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3108003920 0x7f3108003d80 secure :-1 s=THROTTLE_DONE pgs=968 cs=0 l=1 rx=0x7f3108005650 tx=0x7f310c010870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:25.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.943+0000 7f3121ffb700 1 -- 172.21.15.103:0/2934629692 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v125) v1 ==== 110+0+10 (secure 0 0 0) 0x7f310c03fc30 con 0x7f3108003920 2020-04-22T14:17:25.946 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:17:25.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.944+0000 7f312aab7700 1 -- 172.21.15.103:0/2934629692 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3108051980 msgr2=0x7f3108053e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:25.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.944+0000 7f312aab7700 1 --2- 172.21.15.103:0/2934629692 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3108051980 0x7f3108053e40 secure :-1 s=READY pgs=666 cs=0 l=1 rx=0x7f311c0032b0 tx=0x7f311c00cd50).stop 2020-04-22T14:17:25.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.944+0000 7f312aab7700 1 -- 172.21.15.103:0/2934629692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3108003920 msgr2=0x7f3108003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:25.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.944+0000 7f312aab7700 1 --2- 172.21.15.103:0/2934629692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3108003920 0x7f3108003d80 secure :-1 s=READY pgs=968 cs=0 l=1 rx=0x7f3108005650 tx=0x7f310c010870).stop 2020-04-22T14:17:25.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.944+0000 7f312aab7700 1 -- 172.21.15.103:0/2934629692 shutdown_connections 2020-04-22T14:17:25.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.944+0000 7f312aab7700 1 --2- 172.21.15.103:0/2934629692 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3108051980 0x7f3108053e40 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:25.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.944+0000 7f312aab7700 1 --2- 172.21.15.103:0/2934629692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3108003920 0x7f3108003d80 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:25.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.944+0000 7f312aab7700 1 -- 172.21.15.103:0/2934629692 >> 172.21.15.103:0/2934629692 conn(0x7f312405b7b0 msgr2=0x7f312412a260 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:25.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.944+0000 7f312aab7700 1 -- 172.21.15.103:0/2934629692 shutdown_connections 2020-04-22T14:17:25.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:25.944+0000 7f312aab7700 1 -- 172.21.15.103:0/2934629692 wait complete. 2020-04-22T14:17:25.958 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:25.970 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:17:26.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.119+0000 7f89579bc700 1 Processor -- start 2020-04-22T14:17:26.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.119+0000 7f89579bc700 1 -- start start 2020-04-22T14:17:26.125 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.120+0000 7f89579bc700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8950061a30 0x7f89500b4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:26.125 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.120+0000 7f89579bc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f89500acb10 0x7f89500ae920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:26.125 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.120+0000 7f89579bc700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8950060250 con 0x7f89500aed80 2020-04-22T14:17:26.125 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.120+0000 7f89579bc700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89500623c0 con 0x7f89500acb10 2020-04-22T14:17:26.126 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.120+0000 7f89579bc700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8950062660 con 0x7f8950061a30 2020-04-22T14:17:26.126 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.120+0000 7f8954f57700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f89500acb10 0x7f89500ae920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:26.126 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.120+0000 7f8954f57700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f89500acb10 0x7f89500ae920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57080/0 (socket says 172.21.15.103:57080) 2020-04-22T14:17:26.126 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.120+0000 7f8955758700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8950061a30 0x7f89500b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:26.126 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.120+0000 7f8954f57700 1 -- 172.21.15.103:0/3650296757 learned_addr learned my addr 172.21.15.103:0/3650296757 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:26.126 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.120+0000 7f8954f57700 1 -- 172.21.15.103:0/3650296757 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8950061a30 msgr2=0x7f89500b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:26.126 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.120+0000 7f8954f57700 1 --2- 172.21.15.103:0/3650296757 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8950061a30 0x7f89500b4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:26.127 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.120+0000 7f893ffff700 1 -- 172.21.15.103:0/3650296757 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1226696690 0 0) 0x7f8950060250 con 0x7f89500aed80 2020-04-22T14:17:26.127 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.120+0000 7f8954f57700 1 -- 172.21.15.103:0/3650296757 >> v1:172.21.15.86:6789/0 conn(0x7f89500aed80 legacy=0x7f89500b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:26.127 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.120+0000 7f8954f57700 1 -- 172.21.15.103:0/3650296757 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8950061e10 con 0x7f89500acb10 2020-04-22T14:17:26.127 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.120+0000 7f8954f57700 1 --2- 172.21.15.103:0/3650296757 >> v2:172.21.15.103:3300/0 conn(0x7f89500acb10 0x7f89500ae920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8940002f30 tx=0x7f8940007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.127 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.120+0000 7f8954f57700 1 --2- 172.21.15.103:0/3650296757 >> v2:172.21.15.103:3300/0 conn(0x7f89500acb10 0x7f89500ae920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8940002f30 tx=0x7f8940007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.127 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.120+0000 7f8954f57700 1 --2- 172.21.15.103:0/3650296757 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89500acb10 0x7f89500ae920 secure :-1 s=READY pgs=1819 cs=0 l=1 rx=0x7f8940002f30 tx=0x7f8940007a40).ready entity=mon.1 client_cookie=34261e65149330fc server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:26.127 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.120+0000 7f8954f57700 1 --2- 172.21.15.103:0/3650296757 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89500acb10 0x7f89500ae920 secure :-1 s=THROTTLE_DONE pgs=1819 cs=0 l=1 rx=0x7f8940002f30 tx=0x7f8940007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.128 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.120+0000 7f893ffff700 1 -- 172.21.15.103:0/3650296757 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8940009e40 con 0x7f89500acb10 2020-04-22T14:17:26.128 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.120+0000 7f8954f57700 1 --2- 172.21.15.103:0/3650296757 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89500acb10 0x7f89500ae920 secure :-1 s=THROTTLE_DONE pgs=1819 cs=0 l=1 rx=0x7f8940002f30 tx=0x7f8940007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.128 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.120+0000 7f893ffff700 1 -- 172.21.15.103:0/3650296757 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8940009690 con 0x7f89500acb10 2020-04-22T14:17:26.128 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.120+0000 7f8954f57700 1 --2- 172.21.15.103:0/3650296757 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89500acb10 0x7f89500ae920 secure :-1 s=THROTTLE_DONE pgs=1819 cs=0 l=1 rx=0x7f8940002f30 tx=0x7f8940007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.128 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.120+0000 7f893ffff700 1 -- 172.21.15.103:0/3650296757 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f894000b180 con 0x7f89500acb10 2020-04-22T14:17:26.128 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.120+0000 7f89579bc700 1 -- 172.21.15.103:0/3650296757 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89500acb10 msgr2=0x7f89500ae920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:26.128 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.120+0000 7f89579bc700 1 --2- 172.21.15.103:0/3650296757 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89500acb10 0x7f89500ae920 secure :-1 s=READY pgs=1819 cs=0 l=1 rx=0x7f8940002f30 tx=0x7f8940007a40).stop 2020-04-22T14:17:26.129 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.121+0000 7f89579bc700 1 -- 172.21.15.103:0/3650296757 shutdown_connections 2020-04-22T14:17:26.129 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.121+0000 7f89579bc700 1 --2- 172.21.15.103:0/3650296757 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8950061a30 0x7f89500b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:26.129 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.121+0000 7f89579bc700 1 --2- 172.21.15.103:0/3650296757 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89500acb10 0x7f89500ae920 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:26.129 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.121+0000 7f89579bc700 1 -- 172.21.15.103:0/3650296757 >> 172.21.15.103:0/3650296757 conn(0x7f895005b7b0 msgr2=0x7f89500b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:26.129 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.121+0000 7f89579bc700 1 -- 172.21.15.103:0/3650296757 shutdown_connections 2020-04-22T14:17:26.129 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.121+0000 7f89579bc700 1 -- 172.21.15.103:0/3650296757 wait complete. 2020-04-22T14:17:26.129 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.122+0000 7f89579bc700 1 Processor -- start 2020-04-22T14:17:26.130 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.122+0000 7f89579bc700 1 -- start start 2020-04-22T14:17:26.133 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.123+0000 7f89579bc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8950061a30 0x7f8950062860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:26.133 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.123+0000 7f89579bc700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8950157790 con 0x7f89500acb10 2020-04-22T14:17:26.133 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.123+0000 7f89579bc700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8950157a30 con 0x7f89500aed80 2020-04-22T14:17:26.133 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.123+0000 7f89579bc700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89500668d0 con 0x7f8950061a30 2020-04-22T14:17:26.133 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.123+0000 7f8955758700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8950061a30 0x7f8950062860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:26.133 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.123+0000 7f8955758700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8950061a30 0x7f8950062860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57084/0 (socket says 172.21.15.103:57084) 2020-04-22T14:17:26.134 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.123+0000 7f8955f59700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f89500aed80 0x7f89500af7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49278/0 (socket says 172.21.15.103:49278) 2020-04-22T14:17:26.134 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.123+0000 7f8955758700 1 -- 172.21.15.103:0/2390591790 learned_addr learned my addr 172.21.15.103:0/2390591790 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:26.134 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.123+0000 7f8955758700 1 -- 172.21.15.103:0/2390591790 >> v1:172.21.15.103:6789/0 conn(0x7f89500aed80 legacy=0x7f89500af7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:26.134 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.123+0000 7f8955758700 1 -- 172.21.15.103:0/2390591790 >> v1:172.21.15.86:6789/0 conn(0x7f89500acb10 legacy=0x7f8950156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:26.134 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.123+0000 7f893e7fc700 1 -- 172.21.15.103:0/2390591790 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1544602285 0 0) 0x7f8950157a30 con 0x7f89500aed80 2020-04-22T14:17:26.134 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.123+0000 7f8955758700 1 -- 172.21.15.103:0/2390591790 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8950157cd0 con 0x7f8950061a30 2020-04-22T14:17:26.135 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.123+0000 7f8955758700 1 --2- 172.21.15.103:0/2390591790 >> v2:172.21.15.103:3300/0 conn(0x7f8950061a30 0x7f8950062860 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8940007ed0 tx=0x7f894c010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.135 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.123+0000 7f8955758700 1 --2- 172.21.15.103:0/2390591790 >> v2:172.21.15.103:3300/0 conn(0x7f8950061a30 0x7f8950062860 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8940007ed0 tx=0x7f894c010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.135 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.123+0000 7f8955758700 1 --2- 172.21.15.103:0/2390591790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8950061a30 0x7f8950062860 secure :-1 s=READY pgs=1821 cs=0 l=1 rx=0x7f8940007ed0 tx=0x7f894c010d40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:26.135 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.123+0000 7f8955758700 1 --2- 172.21.15.103:0/2390591790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8950061a30 0x7f8950062860 secure :-1 s=THROTTLE_DONE pgs=1821 cs=0 l=1 rx=0x7f8940007ed0 tx=0x7f894c010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.135 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.123+0000 7f893e7fc700 1 -- 172.21.15.103:0/2390591790 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f894c007180 con 0x7f8950061a30 2020-04-22T14:17:26.135 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.123+0000 7f8955758700 1 --2- 172.21.15.103:0/2390591790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8950061a30 0x7f8950062860 secure :-1 s=THROTTLE_DONE pgs=1821 cs=0 l=1 rx=0x7f8940007ed0 tx=0x7f894c010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.123+0000 7f8955758700 1 --2- 172.21.15.103:0/2390591790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8950061a30 0x7f8950062860 secure :-1 s=THROTTLE_DONE pgs=1821 cs=0 l=1 rx=0x7f8940007ed0 tx=0x7f894c010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.123+0000 7f89579bc700 1 -- 172.21.15.103:0/2390591790 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89500aff00 con 0x7f8950061a30 2020-04-22T14:17:26.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.124+0000 7f893e7fc700 1 -- 172.21.15.103:0/2390591790 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894c0072e0 con 0x7f8950061a30 2020-04-22T14:17:26.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.124+0000 7f893e7fc700 1 -- 172.21.15.103:0/2390591790 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f894c0122a0 con 0x7f8950061a30 2020-04-22T14:17:26.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.124+0000 7f89579bc700 1 -- 172.21.15.103:0/2390591790 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89500b2520 con 0x7f8950061a30 2020-04-22T14:17:26.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.125+0000 7f89579bc700 1 -- 172.21.15.103:0/2390591790 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8950138450 con 0x7f8950061a30 2020-04-22T14:17:26.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.125+0000 7f8955758700 1 --2- 172.21.15.103:0/2390591790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8950061a30 0x7f8950062860 secure :-1 s=THROTTLE_DONE pgs=1821 cs=0 l=1 rx=0x7f8940007ed0 tx=0x7f894c010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.125+0000 7f893e7fc700 1 -- 172.21.15.103:0/2390591790 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f894c012510 con 0x7f8950061a30 2020-04-22T14:17:26.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.125+0000 7f8955758700 1 --2- 172.21.15.103:0/2390591790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8950061a30 0x7f8950062860 secure :-1 s=THROTTLE_DONE pgs=1821 cs=0 l=1 rx=0x7f8940007ed0 tx=0x7f894c010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.125+0000 7f893e7fc700 1 --2- 172.21.15.103:0/2390591790 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f893004d880 0x7f893004fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:26.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.125+0000 7f893e7fc700 1 -- 172.21.15.103:0/2390591790 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f894c0616f0 con 0x7f8950061a30 2020-04-22T14:17:26.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.126+0000 7f8954f57700 1 --2- 172.21.15.103:0/2390591790 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f893004d880 0x7f893004fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:26.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.126+0000 7f8954f57700 1 --2- 172.21.15.103:0/2390591790 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f893004d880 0x7f893004fd40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f89400084c0 tx=0x7f8940007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.126+0000 7f8954f57700 1 --2- 172.21.15.103:0/2390591790 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f893004d880 0x7f893004fd40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f89400084c0 tx=0x7f8940007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.126+0000 7f8954f57700 1 --2- 172.21.15.103:0/2390591790 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f893004d880 0x7f893004fd40 secure :-1 s=READY pgs=667 cs=0 l=1 rx=0x7f89400084c0 tx=0x7f8940007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:26.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.129+0000 7f8955758700 1 --2- 172.21.15.103:0/2390591790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8950061a30 0x7f8950062860 secure :-1 s=THROTTLE_DONE pgs=1821 cs=0 l=1 rx=0x7f8940007ed0 tx=0x7f894c010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.129+0000 7f893e7fc700 1 -- 172.21.15.103:0/2390591790 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f894c03ca70 con 0x7f8950061a30 2020-04-22T14:17:26.297 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.293+0000 7f89579bc700 1 -- 172.21.15.103:0/2390591790 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8950138450 con 0x7f8950061a30 2020-04-22T14:17:26.297 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.294+0000 7f8955758700 1 --2- 172.21.15.103:0/2390591790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8950061a30 0x7f8950062860 secure :-1 s=THROTTLE_DONE pgs=1821 cs=0 l=1 rx=0x7f8940007ed0 tx=0x7f894c010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.297 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.294+0000 7f893e7fc700 1 -- 172.21.15.103:0/2390591790 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v125) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8950138450 con 0x7f8950061a30 2020-04-22T14:17:26.297 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:17:26.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.295+0000 7f89579bc700 1 -- 172.21.15.103:0/2390591790 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f893004d880 msgr2=0x7f893004fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:26.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.295+0000 7f89579bc700 1 --2- 172.21.15.103:0/2390591790 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f893004d880 0x7f893004fd40 secure :-1 s=READY pgs=667 cs=0 l=1 rx=0x7f89400084c0 tx=0x7f8940007a40).stop 2020-04-22T14:17:26.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.295+0000 7f89579bc700 1 -- 172.21.15.103:0/2390591790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8950061a30 msgr2=0x7f8950062860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:26.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.295+0000 7f89579bc700 1 --2- 172.21.15.103:0/2390591790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8950061a30 0x7f8950062860 secure :-1 s=READY pgs=1821 cs=0 l=1 rx=0x7f8940007ed0 tx=0x7f894c010d40).stop 2020-04-22T14:17:26.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.296+0000 7f89579bc700 1 -- 172.21.15.103:0/2390591790 shutdown_connections 2020-04-22T14:17:26.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.296+0000 7f89579bc700 1 --2- 172.21.15.103:0/2390591790 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f893004d880 0x7f893004fd40 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:26.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.296+0000 7f89579bc700 1 --2- 172.21.15.103:0/2390591790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8950061a30 0x7f8950062860 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:26.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.296+0000 7f89579bc700 1 -- 172.21.15.103:0/2390591790 >> 172.21.15.103:0/2390591790 conn(0x7f895005b7b0 msgr2=0x7f89500b3130 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:26.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.296+0000 7f89579bc700 1 -- 172.21.15.103:0/2390591790 shutdown_connections 2020-04-22T14:17:26.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.296+0000 7f89579bc700 1 -- 172.21.15.103:0/2390591790 wait complete. 2020-04-22T14:17:26.310 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:26.324 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-22T14:17:26.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.480+0000 7fd8ed535700 1 Processor -- start 2020-04-22T14:17:26.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.480+0000 7fd8ed535700 1 -- start start 2020-04-22T14:17:26.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.481+0000 7fd8ed535700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd8e80ac950 0x7fd8e8146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:26.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.481+0000 7fd8ed535700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd8e81470a0 0x7fd8e8143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:26.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.481+0000 7fd8ed535700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8e81467e0 con 0x7fd8e80b9140 2020-04-22T14:17:26.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.481+0000 7fd8ed535700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8e80602f0 con 0x7fd8e81470a0 2020-04-22T14:17:26.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.481+0000 7fd8ed535700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e8060050 con 0x7fd8e80ac950 2020-04-22T14:17:26.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.481+0000 7fd8e6ffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd8e80b9140 0x7fd8e812b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49282/0 (socket says 172.21.15.103:49282) 2020-04-22T14:17:26.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.481+0000 7fd8e6ffd700 1 -- 172.21.15.103:0/534844814 learned_addr learned my addr 172.21.15.103:0/534844814 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:17:26.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.481+0000 7fd8e77fe700 1 --2- 172.21.15.103:0/534844814 >> v2:172.21.15.86:3300/0 conn(0x7fd8e81470a0 0x7fd8e8143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:26.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.481+0000 7fd8e67fc700 1 --2- 172.21.15.103:0/534844814 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd8e80ac950 0x7fd8e8146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:26.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.481+0000 7fd8e5ffb700 1 -- 172.21.15.103:0/534844814 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 141518762 0 0) 0x7fd8e81467e0 con 0x7fd8e80b9140 2020-04-22T14:17:26.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.481+0000 7fd8e5ffb700 1 -- 172.21.15.103:0/534844814 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8cc003230 con 0x7fd8e80b9140 2020-04-22T14:17:26.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.482+0000 7fd8e77fe700 1 -- 172.21.15.103:0/534844814 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd8e80ac950 msgr2=0x7fd8e8146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:26.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.482+0000 7fd8e77fe700 1 --2- 172.21.15.103:0/534844814 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd8e80ac950 0x7fd8e8146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:26.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.482+0000 7fd8e77fe700 1 -- 172.21.15.103:0/534844814 >> v1:172.21.15.103:6789/0 conn(0x7fd8e80b9140 legacy=0x7fd8e812b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:26.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.482+0000 7fd8e77fe700 1 -- 172.21.15.103:0/534844814 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e80b9520 con 0x7fd8e81470a0 2020-04-22T14:17:26.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.482+0000 7fd8e77fe700 1 --2- 172.21.15.103:0/534844814 >> v2:172.21.15.86:3300/0 conn(0x7fd8e81470a0 0x7fd8e8143090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd8e00032b0 tx=0x7fd8e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.482+0000 7fd8e77fe700 1 --2- 172.21.15.103:0/534844814 >> v2:172.21.15.86:3300/0 conn(0x7fd8e81470a0 0x7fd8e8143090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd8e00032b0 tx=0x7fd8e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.482+0000 7fd8e77fe700 1 --2- 172.21.15.103:0/534844814 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8e81470a0 0x7fd8e8143090 secure :-1 s=READY pgs=971 cs=0 l=1 rx=0x7fd8e00032b0 tx=0x7fd8e0007dc0).ready entity=mon.0 client_cookie=11b3d92c261e9e87 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:26.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.482+0000 7fd8e77fe700 1 --2- 172.21.15.103:0/534844814 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8e81470a0 0x7fd8e8143090 secure :-1 s=THROTTLE_DONE pgs=971 cs=0 l=1 rx=0x7fd8e00032b0 tx=0x7fd8e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.482+0000 7fd8e5ffb700 1 -- 172.21.15.103:0/534844814 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8e0011d70 con 0x7fd8e81470a0 2020-04-22T14:17:26.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.482+0000 7fd8e77fe700 1 --2- 172.21.15.103:0/534844814 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8e81470a0 0x7fd8e8143090 secure :-1 s=THROTTLE_DONE pgs=971 cs=0 l=1 rx=0x7fd8e00032b0 tx=0x7fd8e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.482+0000 7fd8e5ffb700 1 -- 172.21.15.103:0/534844814 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e000a180 con 0x7fd8e81470a0 2020-04-22T14:17:26.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.482+0000 7fd8e77fe700 1 --2- 172.21.15.103:0/534844814 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8e81470a0 0x7fd8e8143090 secure :-1 s=THROTTLE_DONE pgs=971 cs=0 l=1 rx=0x7fd8e00032b0 tx=0x7fd8e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.482+0000 7fd8e5ffb700 1 -- 172.21.15.103:0/534844814 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8e000a560 con 0x7fd8e81470a0 2020-04-22T14:17:26.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.482+0000 7fd8ed535700 1 -- 172.21.15.103:0/534844814 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8e81470a0 msgr2=0x7fd8e8143090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:26.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.482+0000 7fd8ed535700 1 --2- 172.21.15.103:0/534844814 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8e81470a0 0x7fd8e8143090 secure :-1 s=READY pgs=971 cs=0 l=1 rx=0x7fd8e00032b0 tx=0x7fd8e0007dc0).stop 2020-04-22T14:17:26.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.482+0000 7fd8ed535700 1 -- 172.21.15.103:0/534844814 shutdown_connections 2020-04-22T14:17:26.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.482+0000 7fd8ed535700 1 --2- 172.21.15.103:0/534844814 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8e81470a0 0x7fd8e8143090 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:26.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.482+0000 7fd8ed535700 1 --2- 172.21.15.103:0/534844814 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd8e80ac950 0x7fd8e8146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:26.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.482+0000 7fd8ed535700 1 -- 172.21.15.103:0/534844814 >> 172.21.15.103:0/534844814 conn(0x7fd8e805b7b0 msgr2=0x7fd8e80b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:26.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.483+0000 7fd8ed535700 1 -- 172.21.15.103:0/534844814 shutdown_connections 2020-04-22T14:17:26.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.483+0000 7fd8ed535700 1 -- 172.21.15.103:0/534844814 wait complete. 2020-04-22T14:17:26.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.483+0000 7fd8ed535700 1 Processor -- start 2020-04-22T14:17:26.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.483+0000 7fd8ed535700 1 -- start start 2020-04-22T14:17:26.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.484+0000 7fd8ed535700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd8e80b9140 0x7fd8e80b83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:26.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.484+0000 7fd8ed535700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd8e81470a0 0x7fd8e8061c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:26.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.484+0000 7fd8ed535700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8e80b8830 con 0x7fd8e80ac950 2020-04-22T14:17:26.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.484+0000 7fd8ed535700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8e8143ab0 con 0x7fd8e81470a0 2020-04-22T14:17:26.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.484+0000 7fd8ed535700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e80b5e50 con 0x7fd8e80b9140 2020-04-22T14:17:26.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.484+0000 7fd8e77fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd8e81470a0 0x7fd8e8061c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:26.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.484+0000 7fd8e77fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd8e81470a0 0x7fd8e8061c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57102/0 (socket says 172.21.15.103:57102) 2020-04-22T14:17:26.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.484+0000 7fd8e77fe700 1 -- 172.21.15.103:0/2686947218 learned_addr learned my addr 172.21.15.103:0/2686947218 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:26.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.484+0000 7fd8e67fc700 1 --2- 172.21.15.103:0/2686947218 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd8e80b9140 0x7fd8e80b83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:26.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.484+0000 7fd8e77fe700 1 -- 172.21.15.103:0/2686947218 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd8e80b9140 msgr2=0x7fd8e80b83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:26.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.484+0000 7fd8e77fe700 1 --2- 172.21.15.103:0/2686947218 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd8e80b9140 0x7fd8e80b83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:26.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.484+0000 7fd8e77fe700 1 -- 172.21.15.103:0/2686947218 >> v1:172.21.15.86:6789/0 conn(0x7fd8e80ac950 legacy=0x7fd8e8129c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:26.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.485+0000 7fd8e77fe700 1 -- 172.21.15.103:0/2686947218 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e8143730 con 0x7fd8e81470a0 2020-04-22T14:17:26.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.485+0000 7fd8d7fff700 1 -- 172.21.15.103:0/2686947218 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2314207321 0 0) 0x7fd8cc003230 con 0x7fd8e80ac950 2020-04-22T14:17:26.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.485+0000 7fd8e77fe700 1 --2- 172.21.15.103:0/2686947218 >> v2:172.21.15.103:3300/0 conn(0x7fd8e81470a0 0x7fd8e8061c60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd8e00032b0 tx=0x7fd8e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.485+0000 7fd8e77fe700 1 --2- 172.21.15.103:0/2686947218 >> v2:172.21.15.103:3300/0 conn(0x7fd8e81470a0 0x7fd8e8061c60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd8e00032b0 tx=0x7fd8e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.485+0000 7fd8e77fe700 1 --2- 172.21.15.103:0/2686947218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8e81470a0 0x7fd8e8061c60 secure :-1 s=READY pgs=1823 cs=0 l=1 rx=0x7fd8e00032b0 tx=0x7fd8e0007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:26.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.485+0000 7fd8e77fe700 1 --2- 172.21.15.103:0/2686947218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8e81470a0 0x7fd8e8061c60 secure :-1 s=THROTTLE_DONE pgs=1823 cs=0 l=1 rx=0x7fd8e00032b0 tx=0x7fd8e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.485+0000 7fd8d7fff700 1 -- 172.21.15.103:0/2686947218 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8e0010440 con 0x7fd8e81470a0 2020-04-22T14:17:26.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.485+0000 7fd8e77fe700 1 --2- 172.21.15.103:0/2686947218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8e81470a0 0x7fd8e8061c60 secure :-1 s=THROTTLE_DONE pgs=1823 cs=0 l=1 rx=0x7fd8e00032b0 tx=0x7fd8e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.485+0000 7fd8d7fff700 1 -- 172.21.15.103:0/2686947218 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e0005c30 con 0x7fd8e81470a0 2020-04-22T14:17:26.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.485+0000 7fd8e77fe700 1 --2- 172.21.15.103:0/2686947218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8e81470a0 0x7fd8e8061c60 secure :-1 s=THROTTLE_DONE pgs=1823 cs=0 l=1 rx=0x7fd8e00032b0 tx=0x7fd8e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.485+0000 7fd8d7fff700 1 -- 172.21.15.103:0/2686947218 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8e0007170 con 0x7fd8e81470a0 2020-04-22T14:17:26.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.485+0000 7fd8ed535700 1 -- 172.21.15.103:0/2686947218 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8e8143d50 con 0x7fd8e81470a0 2020-04-22T14:17:26.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.485+0000 7fd8ed535700 1 -- 172.21.15.103:0/2686947218 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8e8062300 con 0x7fd8e81470a0 2020-04-22T14:17:26.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.486+0000 7fd8e77fe700 1 --2- 172.21.15.103:0/2686947218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8e81470a0 0x7fd8e8061c60 secure :-1 s=THROTTLE_DONE pgs=1823 cs=0 l=1 rx=0x7fd8e00032b0 tx=0x7fd8e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.486+0000 7fd8ed535700 1 -- 172.21.15.103:0/2686947218 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8e8143920 con 0x7fd8e81470a0 2020-04-22T14:17:26.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.486+0000 7fd8d7fff700 1 -- 172.21.15.103:0/2686947218 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fd8e0007370 con 0x7fd8e81470a0 2020-04-22T14:17:26.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.486+0000 7fd8e77fe700 1 --2- 172.21.15.103:0/2686947218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8e81470a0 0x7fd8e8061c60 secure :-1 s=THROTTLE_DONE pgs=1823 cs=0 l=1 rx=0x7fd8e00032b0 tx=0x7fd8e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.486+0000 7fd8d7fff700 1 --2- 172.21.15.103:0/2686947218 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd8c404d8c0 0x7fd8c404fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:26.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.486+0000 7fd8d7fff700 1 -- 172.21.15.103:0/2686947218 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fd8e0062310 con 0x7fd8e81470a0 2020-04-22T14:17:26.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.486+0000 7fd8e6ffd700 1 --2- 172.21.15.103:0/2686947218 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd8c404d8c0 0x7fd8c404fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:26.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.487+0000 7fd8e6ffd700 1 --2- 172.21.15.103:0/2686947218 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd8c404d8c0 0x7fd8c404fd80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd8dc001050 tx=0x7fd8dc001650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.487+0000 7fd8e6ffd700 1 --2- 172.21.15.103:0/2686947218 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd8c404d8c0 0x7fd8c404fd80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd8dc001050 tx=0x7fd8dc001650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.487+0000 7fd8e6ffd700 1 --2- 172.21.15.103:0/2686947218 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd8c404d8c0 0x7fd8c404fd80 secure :-1 s=READY pgs=668 cs=0 l=1 rx=0x7fd8dc001050 tx=0x7fd8dc001650).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:26.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.490+0000 7fd8e77fe700 1 --2- 172.21.15.103:0/2686947218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8e81470a0 0x7fd8e8061c60 secure :-1 s=THROTTLE_DONE pgs=1823 cs=0 l=1 rx=0x7fd8e00032b0 tx=0x7fd8e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.490+0000 7fd8d7fff700 1 -- 172.21.15.103:0/2686947218 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fd8e003d810 con 0x7fd8e81470a0 2020-04-22T14:17:26.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.635+0000 7fd8ed535700 1 -- 172.21.15.103:0/2686947218 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd8e8056c90 con 0x7fd8e81470a0 2020-04-22T14:17:26.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.636+0000 7fd8e77fe700 1 --2- 172.21.15.103:0/2686947218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8e81470a0 0x7fd8e8061c60 secure :-1 s=THROTTLE_DONE pgs=1823 cs=0 l=1 rx=0x7fd8e00032b0 tx=0x7fd8e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.636+0000 7fd8d7fff700 1 -- 172.21.15.103:0/2686947218 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v125) v1 ==== 104+0+10 (secure 0 0 0) 0x7fd8e0040e30 con 0x7fd8e81470a0 2020-04-22T14:17:26.639 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:17:26.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.637+0000 7fd8ed535700 1 -- 172.21.15.103:0/2686947218 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd8c404d8c0 msgr2=0x7fd8c404fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:26.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.637+0000 7fd8ed535700 1 --2- 172.21.15.103:0/2686947218 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd8c404d8c0 0x7fd8c404fd80 secure :-1 s=READY pgs=668 cs=0 l=1 rx=0x7fd8dc001050 tx=0x7fd8dc001650).stop 2020-04-22T14:17:26.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.637+0000 7fd8ed535700 1 -- 172.21.15.103:0/2686947218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8e81470a0 msgr2=0x7fd8e8061c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:26.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.637+0000 7fd8ed535700 1 --2- 172.21.15.103:0/2686947218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8e81470a0 0x7fd8e8061c60 secure :-1 s=READY pgs=1823 cs=0 l=1 rx=0x7fd8e00032b0 tx=0x7fd8e0007dc0).stop 2020-04-22T14:17:26.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.637+0000 7fd8ed535700 1 -- 172.21.15.103:0/2686947218 shutdown_connections 2020-04-22T14:17:26.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.637+0000 7fd8ed535700 1 --2- 172.21.15.103:0/2686947218 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd8c404d8c0 0x7fd8c404fd80 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:26.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.637+0000 7fd8ed535700 1 --2- 172.21.15.103:0/2686947218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8e81470a0 0x7fd8e8061c60 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:26.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.637+0000 7fd8ed535700 1 --2- 172.21.15.103:0/2686947218 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd8e80b9140 0x7fd8e80b83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:26.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.637+0000 7fd8ed535700 1 -- 172.21.15.103:0/2686947218 >> 172.21.15.103:0/2686947218 conn(0x7fd8e805b7b0 msgr2=0x7fd8e80b67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:26.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.637+0000 7fd8ed535700 1 -- 172.21.15.103:0/2686947218 shutdown_connections 2020-04-22T14:17:26.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.637+0000 7fd8ed535700 1 -- 172.21.15.103:0/2686947218 wait complete. 2020-04-22T14:17:26.650 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:26.663 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-22T14:17:26.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.809+0000 7f8a81bf6700 1 Processor -- start 2020-04-22T14:17:26.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.809+0000 7f8a81bf6700 1 -- start start 2020-04-22T14:17:26.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.810+0000 7f8a81bf6700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8a7c143090 0x7f8a7c143520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:26.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.810+0000 7f8a81bf6700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a7c1467e0 con 0x7f8a7c0b9140 2020-04-22T14:17:26.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.810+0000 7f8a81bf6700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a7c060050 con 0x7f8a7c0ac950 2020-04-22T14:17:26.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.810+0000 7f8a81bf6700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a7c0602f0 con 0x7f8a7c143090 2020-04-22T14:17:26.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.810+0000 7f8a7affd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f8a7c0ac950 0x7f8a7c146c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49296/0 (socket says 172.21.15.103:49296) 2020-04-22T14:17:26.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.810+0000 7f8a7affd700 1 -- 172.21.15.103:0/2244597589 learned_addr learned my addr 172.21.15.103:0/2244597589 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:17:26.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.810+0000 7f8a7a7fc700 1 -- 172.21.15.103:0/2244597589 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4058806574 0 0) 0x7f8a7c060050 con 0x7f8a7c0ac950 2020-04-22T14:17:26.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.811+0000 7f8a7bfff700 1 --2- 172.21.15.103:0/2244597589 >> v2:172.21.15.86:3300/0 conn(0x7f8a7c143090 0x7f8a7c143520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:26.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.811+0000 7f8a7a7fc700 1 -- 172.21.15.103:0/2244597589 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a68003230 con 0x7f8a7c0ac950 2020-04-22T14:17:26.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.811+0000 7f8a7a7fc700 1 -- 172.21.15.103:0/2244597589 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2101788350 0 0) 0x7f8a68003230 con 0x7f8a7c0ac950 2020-04-22T14:17:26.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.811+0000 7f8a7a7fc700 1 -- 172.21.15.103:0/2244597589 >> v2:172.21.15.86:3300/0 conn(0x7f8a7c143090 msgr2=0x7f8a7c143520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:26.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.811+0000 7f8a7a7fc700 1 --2- 172.21.15.103:0/2244597589 >> v2:172.21.15.86:3300/0 conn(0x7f8a7c143090 0x7f8a7c143520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:26.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.811+0000 7f8a7a7fc700 1 -- 172.21.15.103:0/2244597589 >> v1:172.21.15.86:6789/0 conn(0x7f8a7c0b9140 legacy=0x7f8a7c12b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:26.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.811+0000 7f8a7a7fc700 1 -- 172.21.15.103:0/2244597589 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a7c0b9520 con 0x7f8a7c0ac950 2020-04-22T14:17:26.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.811+0000 7f8a7a7fc700 1 -- 172.21.15.103:0/2244597589 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f8a70001710 con 0x7f8a7c0ac950 2020-04-22T14:17:26.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.811+0000 7f8a7a7fc700 1 -- 172.21.15.103:0/2244597589 >> v1:172.21.15.103:6789/0 conn(0x7f8a7c0ac950 legacy=0x7f8a7c146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:26.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.811+0000 7f8a7a7fc700 1 --2- 172.21.15.103:0/2244597589 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8a68003720 0x7f8a68003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:26.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.811+0000 7f8a7a7fc700 1 --2- 172.21.15.103:0/2244597589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a680044d0 0x7f8a68004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:26.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.811+0000 7f8a7a7fc700 1 --2- 172.21.15.103:0/2244597589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a68004db0 0x7f8a6800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:26.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.811+0000 7f8a7a7fc700 1 -- 172.21.15.103:0/2244597589 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7c0602f0 con 0x7f8a680044d0 2020-04-22T14:17:26.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.811+0000 7f8a7a7fc700 1 -- 172.21.15.103:0/2244597589 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a680041c0 con 0x7f8a68004db0 2020-04-22T14:17:26.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.811+0000 7f8a7a7fc700 1 -- 172.21.15.103:0/2244597589 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6800bb80 con 0x7f8a68003720 2020-04-22T14:17:26.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.811+0000 7f8a7bfff700 1 --2- 172.21.15.103:0/2244597589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a68004db0 0x7f8a6800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:26.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.811+0000 7f8a7affd700 1 --2- 172.21.15.103:0/2244597589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a680044d0 0x7f8a68004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:26.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.811+0000 7f8a7b7fe700 1 --2- 172.21.15.103:0/2244597589 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8a68003720 0x7f8a68003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:26.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.811+0000 7f8a7bfff700 1 -- 172.21.15.103:0/2244597589 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8a68003720 msgr2=0x7f8a68003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:26.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.811+0000 7f8a7bfff700 1 --2- 172.21.15.103:0/2244597589 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8a68003720 0x7f8a68003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:26.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.811+0000 7f8a7bfff700 1 -- 172.21.15.103:0/2244597589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a680044d0 msgr2=0x7f8a68004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:26.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.811+0000 7f8a7bfff700 1 --2- 172.21.15.103:0/2244597589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a680044d0 0x7f8a68004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:26.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.811+0000 7f8a7bfff700 1 -- 172.21.15.103:0/2244597589 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a68003230 con 0x7f8a68004db0 2020-04-22T14:17:26.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.811+0000 7f8a7bfff700 1 --2- 172.21.15.103:0/2244597589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a68004db0 0x7f8a6800b720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8a680054a0 tx=0x7f8a740103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.811+0000 7f8a7bfff700 1 -- 172.21.15.103:0/2244597589 reap_dead start 2020-04-22T14:17:26.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.811+0000 7f8a7bfff700 1 --2- 172.21.15.103:0/2244597589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a68004db0 0x7f8a6800b720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8a680054a0 tx=0x7f8a740103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.811+0000 7f8a7bfff700 1 --2- 172.21.15.103:0/2244597589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a68004db0 0x7f8a6800b720 secure :-1 s=READY pgs=1825 cs=0 l=1 rx=0x7f8a680054a0 tx=0x7f8a740103d0).ready entity=mon.1 client_cookie=5e9799a0eb71332a server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:26.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.812+0000 7f8a7bfff700 1 --2- 172.21.15.103:0/2244597589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a68004db0 0x7f8a6800b720 secure :-1 s=THROTTLE_DONE pgs=1825 cs=0 l=1 rx=0x7f8a680054a0 tx=0x7f8a740103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.812+0000 7f8a7a7fc700 1 -- 172.21.15.103:0/2244597589 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a74005a40 con 0x7f8a68004db0 2020-04-22T14:17:26.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.812+0000 7f8a7bfff700 1 --2- 172.21.15.103:0/2244597589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a68004db0 0x7f8a6800b720 secure :-1 s=THROTTLE_DONE pgs=1825 cs=0 l=1 rx=0x7f8a680054a0 tx=0x7f8a740103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.812+0000 7f8a7bfff700 1 --2- 172.21.15.103:0/2244597589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a68004db0 0x7f8a6800b720 secure :-1 s=THROTTLE_DONE pgs=1825 cs=0 l=1 rx=0x7f8a680054a0 tx=0x7f8a740103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.812+0000 7f8a7a7fc700 1 -- 172.21.15.103:0/2244597589 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a74005ba0 con 0x7f8a68004db0 2020-04-22T14:17:26.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.812+0000 7f8a7a7fc700 1 -- 172.21.15.103:0/2244597589 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a740110d0 con 0x7f8a68004db0 2020-04-22T14:17:26.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.812+0000 7f8a81bf6700 1 -- 172.21.15.103:0/2244597589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a68004db0 msgr2=0x7f8a6800b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:26.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.812+0000 7f8a81bf6700 1 --2- 172.21.15.103:0/2244597589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a68004db0 0x7f8a6800b720 secure :-1 s=READY pgs=1825 cs=0 l=1 rx=0x7f8a680054a0 tx=0x7f8a740103d0).stop 2020-04-22T14:17:26.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.812+0000 7f8a81bf6700 1 -- 172.21.15.103:0/2244597589 shutdown_connections 2020-04-22T14:17:26.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.812+0000 7f8a81bf6700 1 --2- 172.21.15.103:0/2244597589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a68004db0 0x7f8a6800b720 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:26.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.812+0000 7f8a81bf6700 1 -- 172.21.15.103:0/2244597589 >> 172.21.15.103:0/2244597589 conn(0x7f8a7c05b7b0 msgr2=0x7f8a7c0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:26.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.812+0000 7f8a81bf6700 1 -- 172.21.15.103:0/2244597589 shutdown_connections 2020-04-22T14:17:26.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.812+0000 7f8a81bf6700 1 -- 172.21.15.103:0/2244597589 wait complete. 2020-04-22T14:17:26.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.813+0000 7f8a81bf6700 1 Processor -- start 2020-04-22T14:17:26.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.813+0000 7f8a81bf6700 1 -- start start 2020-04-22T14:17:26.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.814+0000 7f8a81bf6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8a68004db0 0x7f8a7c061630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:26.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.814+0000 7f8a81bf6700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8a7c0b0c00 0x7f8a7c0b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:26.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.814+0000 7f8a81bf6700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a7c0b2a90 con 0x7f8a7c126d10 2020-04-22T14:17:26.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.814+0000 7f8a81bf6700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a7c0b10a0 con 0x7f8a7c0b0c00 2020-04-22T14:17:26.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.814+0000 7f8a81bf6700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7c0b1340 con 0x7f8a68004db0 2020-04-22T14:17:26.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.814+0000 7f8a7affd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8a7c0b0c00 0x7f8a7c0b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:26.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.814+0000 7f8a7affd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8a7c0b0c00 0x7f8a7c0b4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57118/0 (socket says 172.21.15.103:57118) 2020-04-22T14:17:26.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.814+0000 7f8a7affd700 1 -- 172.21.15.103:0/360184130 learned_addr learned my addr 172.21.15.103:0/360184130 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:26.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.814+0000 7f8a7b7fe700 1 --2- 172.21.15.103:0/360184130 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8a68004db0 0x7f8a7c061630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:26.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.814+0000 7f8a7affd700 1 -- 172.21.15.103:0/360184130 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8a68004db0 msgr2=0x7f8a7c061630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:26.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.814+0000 7f8a7affd700 1 --2- 172.21.15.103:0/360184130 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8a68004db0 0x7f8a7c061630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:26.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.814+0000 7f8a7affd700 1 -- 172.21.15.103:0/360184130 >> v1:172.21.15.86:6789/0 conn(0x7f8a7c126d10 legacy=0x7f8a7c0af7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:26.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.814+0000 7f8a7affd700 1 -- 172.21.15.103:0/360184130 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a7c0b15e0 con 0x7f8a7c0b0c00 2020-04-22T14:17:26.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.814+0000 7f8a7affd700 1 --2- 172.21.15.103:0/360184130 >> v2:172.21.15.103:3300/0 conn(0x7f8a7c0b0c00 0x7f8a7c0b4d20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8a700011f0 tx=0x7f8a7c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.814+0000 7f8a7affd700 1 --2- 172.21.15.103:0/360184130 >> v2:172.21.15.103:3300/0 conn(0x7f8a7c0b0c00 0x7f8a7c0b4d20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8a700011f0 tx=0x7f8a7c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.814+0000 7f8a7affd700 1 --2- 172.21.15.103:0/360184130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a7c0b0c00 0x7f8a7c0b4d20 secure :-1 s=READY pgs=1826 cs=0 l=1 rx=0x7f8a700011f0 tx=0x7f8a7c0b96b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:26.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.814+0000 7f8a7affd700 1 --2- 172.21.15.103:0/360184130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a7c0b0c00 0x7f8a7c0b4d20 secure :-1 s=THROTTLE_DONE pgs=1826 cs=0 l=1 rx=0x7f8a700011f0 tx=0x7f8a7c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.814+0000 7f8a7affd700 1 --2- 172.21.15.103:0/360184130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a7c0b0c00 0x7f8a7c0b4d20 secure :-1 s=THROTTLE_DONE pgs=1826 cs=0 l=1 rx=0x7f8a700011f0 tx=0x7f8a7c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.814+0000 7f8a78ff9700 1 -- 172.21.15.103:0/360184130 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a70007460 con 0x7f8a7c0b0c00 2020-04-22T14:17:26.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.814+0000 7f8a7affd700 1 --2- 172.21.15.103:0/360184130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a7c0b0c00 0x7f8a7c0b4d20 secure :-1 s=THROTTLE_DONE pgs=1826 cs=0 l=1 rx=0x7f8a700011f0 tx=0x7f8a7c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.814+0000 7f8a78ff9700 1 -- 172.21.15.103:0/360184130 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a70004b90 con 0x7f8a7c0b0c00 2020-04-22T14:17:26.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.814+0000 7f8a81bf6700 1 -- 172.21.15.103:0/360184130 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a7c1286e0 con 0x7f8a7c0b0c00 2020-04-22T14:17:26.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.814+0000 7f8a78ff9700 1 -- 172.21.15.103:0/360184130 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a70012440 con 0x7f8a7c0b0c00 2020-04-22T14:17:26.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.815+0000 7f8a81bf6700 1 -- 172.21.15.103:0/360184130 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a7c1271a0 con 0x7f8a7c0b0c00 2020-04-22T14:17:26.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.815+0000 7f8a7affd700 1 --2- 172.21.15.103:0/360184130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a7c0b0c00 0x7f8a7c0b4d20 secure :-1 s=THROTTLE_DONE pgs=1826 cs=0 l=1 rx=0x7f8a700011f0 tx=0x7f8a7c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.815+0000 7f8a81bf6700 1 -- 172.21.15.103:0/360184130 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a7c056c90 con 0x7f8a7c0b0c00 2020-04-22T14:17:26.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.815+0000 7f8a78ff9700 1 -- 172.21.15.103:0/360184130 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f8a7000e9e0 con 0x7f8a7c0b0c00 2020-04-22T14:17:26.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.815+0000 7f8a7affd700 1 --2- 172.21.15.103:0/360184130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a7c0b0c00 0x7f8a7c0b4d20 secure :-1 s=THROTTLE_DONE pgs=1826 cs=0 l=1 rx=0x7f8a700011f0 tx=0x7f8a7c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.816+0000 7f8a78ff9700 1 --2- 172.21.15.103:0/360184130 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8a5c04d930 0x7f8a5c04fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:26.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.816+0000 7f8a78ff9700 1 -- 172.21.15.103:0/360184130 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f8a70061180 con 0x7f8a7c0b0c00 2020-04-22T14:17:26.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.816+0000 7f8a7b7fe700 1 --2- 172.21.15.103:0/360184130 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8a5c04d930 0x7f8a5c04fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:26.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.816+0000 7f8a7b7fe700 1 --2- 172.21.15.103:0/360184130 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8a5c04d930 0x7f8a5c04fdf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8a7c0b6250 tx=0x7f8a6c00c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.816+0000 7f8a7b7fe700 1 --2- 172.21.15.103:0/360184130 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8a5c04d930 0x7f8a5c04fdf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8a7c0b6250 tx=0x7f8a6c00c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.816+0000 7f8a7b7fe700 1 --2- 172.21.15.103:0/360184130 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8a5c04d930 0x7f8a5c04fdf0 secure :-1 s=READY pgs=669 cs=0 l=1 rx=0x7f8a7c0b6250 tx=0x7f8a6c00c820).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:26.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.820+0000 7f8a7affd700 1 --2- 172.21.15.103:0/360184130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a7c0b0c00 0x7f8a7c0b4d20 secure :-1 s=THROTTLE_DONE pgs=1826 cs=0 l=1 rx=0x7f8a700011f0 tx=0x7f8a7c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.820+0000 7f8a78ff9700 1 -- 172.21.15.103:0/360184130 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f8a7003c680 con 0x7f8a7c0b0c00 2020-04-22T14:17:26.965 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.962+0000 7f8a81bf6700 1 -- 172.21.15.103:0/360184130 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8a7c06a960 con 0x7f8a7c0b0c00 2020-04-22T14:17:26.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.962+0000 7f8a7affd700 1 --2- 172.21.15.103:0/360184130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a7c0b0c00 0x7f8a7c0b4d20 secure :-1 s=THROTTLE_DONE pgs=1826 cs=0 l=1 rx=0x7f8a700011f0 tx=0x7f8a7c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:26.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.962+0000 7f8a78ff9700 1 -- 172.21.15.103:0/360184130 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v125) v1 ==== 100+0+10 (secure 0 0 0) 0x7f8a7003fca0 con 0x7f8a7c0b0c00 2020-04-22T14:17:26.966 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:17:26.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.963+0000 7f8a81bf6700 1 -- 172.21.15.103:0/360184130 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8a5c04d930 msgr2=0x7f8a5c04fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:26.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.963+0000 7f8a81bf6700 1 --2- 172.21.15.103:0/360184130 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8a5c04d930 0x7f8a5c04fdf0 secure :-1 s=READY pgs=669 cs=0 l=1 rx=0x7f8a7c0b6250 tx=0x7f8a6c00c820).stop 2020-04-22T14:17:26.967 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.963+0000 7f8a81bf6700 1 -- 172.21.15.103:0/360184130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a7c0b0c00 msgr2=0x7f8a7c0b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:26.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.963+0000 7f8a81bf6700 1 --2- 172.21.15.103:0/360184130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a7c0b0c00 0x7f8a7c0b4d20 secure :-1 s=READY pgs=1826 cs=0 l=1 rx=0x7f8a700011f0 tx=0x7f8a7c0b96b0).stop 2020-04-22T14:17:26.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.963+0000 7f8a81bf6700 1 -- 172.21.15.103:0/360184130 shutdown_connections 2020-04-22T14:17:26.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.963+0000 7f8a81bf6700 1 --2- 172.21.15.103:0/360184130 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8a5c04d930 0x7f8a5c04fdf0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:26.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.963+0000 7f8a81bf6700 1 --2- 172.21.15.103:0/360184130 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8a68004db0 0x7f8a7c061630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:26.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.963+0000 7f8a81bf6700 1 --2- 172.21.15.103:0/360184130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a7c0b0c00 0x7f8a7c0b4d20 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:26.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.963+0000 7f8a81bf6700 1 -- 172.21.15.103:0/360184130 >> 172.21.15.103:0/360184130 conn(0x7f8a7c05b7b0 msgr2=0x7f8a7c0665d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:26.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.964+0000 7f8a81bf6700 1 -- 172.21.15.103:0/360184130 shutdown_connections 2020-04-22T14:17:26.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:26.964+0000 7f8a81bf6700 1 -- 172.21.15.103:0/360184130 wait complete. 2020-04-22T14:17:26.977 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-04-22T14:17:26.977 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:26.990 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:17:27.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.133+0000 7f1dcabb9700 1 Processor -- start 2020-04-22T14:17:27.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.133+0000 7f1dcabb9700 1 -- start start 2020-04-22T14:17:27.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.134+0000 7f1dcabb9700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1dc40b6040 0x7f1dc40ac740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:27.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.134+0000 7f1dcabb9700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1dc41426d0 0x7f1dc4142b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:27.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.134+0000 7f1dcabb9700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dc4064ec0 con 0x7f1dc4067170 2020-04-22T14:17:27.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.134+0000 7f1dcabb9700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dc4065af0 con 0x7f1dc41426d0 2020-04-22T14:17:27.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.134+0000 7f1dcabb9700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dc4146870 con 0x7f1dc40b6040 2020-04-22T14:17:27.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.134+0000 7f1dc3fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1dc40b6040 0x7f1dc40ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:27.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.134+0000 7f1dc8955700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f1dc4067170 0x7f1dc413c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49314/0 (socket says 172.21.15.103:49314) 2020-04-22T14:17:27.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.134+0000 7f1dc8955700 1 -- 172.21.15.103:0/1644828749 learned_addr learned my addr 172.21.15.103:0/1644828749 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:17:27.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.134+0000 7f1dc9156700 1 --2- 172.21.15.103:0/1644828749 >> v2:172.21.15.86:3300/0 conn(0x7f1dc41426d0 0x7f1dc4142b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:27.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.135+0000 7f1dc3fff700 1 -- 172.21.15.103:0/1644828749 >> v2:172.21.15.86:3300/0 conn(0x7f1dc41426d0 msgr2=0x7f1dc4142b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:27.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.135+0000 7f1dc3fff700 1 --2- 172.21.15.103:0/1644828749 >> v2:172.21.15.86:3300/0 conn(0x7f1dc41426d0 0x7f1dc4142b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:27.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.135+0000 7f1dc3fff700 1 -- 172.21.15.103:0/1644828749 >> v1:172.21.15.103:6789/0 conn(0x7f1dc4067170 legacy=0x7f1dc413c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:27.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.135+0000 7f1dc3fff700 1 -- 172.21.15.103:0/1644828749 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc4067550 con 0x7f1dc40b6040 2020-04-22T14:17:27.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.135+0000 7f1dc37fe700 1 -- 172.21.15.103:0/1644828749 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2670780463 0 0) 0x7f1dc4064ec0 con 0x7f1dc4067170 2020-04-22T14:17:27.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.135+0000 7f1dc3fff700 1 --2- 172.21.15.103:0/1644828749 >> v2:172.21.15.103:3300/0 conn(0x7f1dc40b6040 0x7f1dc40ac740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1dc4066db0 tx=0x7f1db8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:27.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.135+0000 7f1dc3fff700 1 --2- 172.21.15.103:0/1644828749 >> v2:172.21.15.103:3300/0 conn(0x7f1dc40b6040 0x7f1dc40ac740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1dc4066db0 tx=0x7f1db8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:27.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.135+0000 7f1dc3fff700 1 --2- 172.21.15.103:0/1644828749 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1dc40b6040 0x7f1dc40ac740 secure :-1 s=READY pgs=1828 cs=0 l=1 rx=0x7f1dc4066db0 tx=0x7f1db8007a40).ready entity=mon.1 client_cookie=d2f87e32246bfcb server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:27.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.135+0000 7f1dc3fff700 1 --2- 172.21.15.103:0/1644828749 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1dc40b6040 0x7f1dc40ac740 secure :-1 s=THROTTLE_DONE pgs=1828 cs=0 l=1 rx=0x7f1dc4066db0 tx=0x7f1db8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:27.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.135+0000 7f1dc37fe700 1 -- 172.21.15.103:0/1644828749 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1db8011430 con 0x7f1dc40b6040 2020-04-22T14:17:27.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.135+0000 7f1dc3fff700 1 --2- 172.21.15.103:0/1644828749 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1dc40b6040 0x7f1dc40ac740 secure :-1 s=THROTTLE_DONE pgs=1828 cs=0 l=1 rx=0x7f1dc4066db0 tx=0x7f1db8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:27.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.135+0000 7f1dc3fff700 1 --2- 172.21.15.103:0/1644828749 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1dc40b6040 0x7f1dc40ac740 secure :-1 s=THROTTLE_DONE pgs=1828 cs=0 l=1 rx=0x7f1dc4066db0 tx=0x7f1db8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:27.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.135+0000 7f1dc37fe700 1 -- 172.21.15.103:0/1644828749 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db80115d0 con 0x7f1dc40b6040 2020-04-22T14:17:27.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.135+0000 7f1dc37fe700 1 -- 172.21.15.103:0/1644828749 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1db80119b0 con 0x7f1dc40b6040 2020-04-22T14:17:27.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.135+0000 7f1dcabb9700 1 -- 172.21.15.103:0/1644828749 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1dc40b6040 msgr2=0x7f1dc40ac740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:27.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.135+0000 7f1dcabb9700 1 --2- 172.21.15.103:0/1644828749 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1dc40b6040 0x7f1dc40ac740 secure :-1 s=READY pgs=1828 cs=0 l=1 rx=0x7f1dc4066db0 tx=0x7f1db8007a40).stop 2020-04-22T14:17:27.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.135+0000 7f1dcabb9700 1 -- 172.21.15.103:0/1644828749 shutdown_connections 2020-04-22T14:17:27.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.135+0000 7f1dcabb9700 1 --2- 172.21.15.103:0/1644828749 >> v2:172.21.15.86:3300/0 conn(0x7f1dc41426d0 0x7f1dc4142b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:27.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.135+0000 7f1dcabb9700 1 --2- 172.21.15.103:0/1644828749 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1dc40b6040 0x7f1dc40ac740 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:27.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.135+0000 7f1dcabb9700 1 -- 172.21.15.103:0/1644828749 >> 172.21.15.103:0/1644828749 conn(0x7f1dc40b9160 msgr2=0x7f1dc405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:27.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.135+0000 7f1dcabb9700 1 -- 172.21.15.103:0/1644828749 shutdown_connections 2020-04-22T14:17:27.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.135+0000 7f1dcabb9700 1 -- 172.21.15.103:0/1644828749 wait complete. 2020-04-22T14:17:27.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.136+0000 7f1dcabb9700 1 Processor -- start 2020-04-22T14:17:27.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.136+0000 7f1dcabb9700 1 -- start start 2020-04-22T14:17:27.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.137+0000 7f1dcabb9700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1dc4067170 0x7f1dc414c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:27.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.137+0000 7f1dcabb9700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1dc40b6040 0x7f1dc41402e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:27.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.137+0000 7f1dcabb9700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dc4140740 con 0x7f1dc41426d0 2020-04-22T14:17:27.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.137+0000 7f1dcabb9700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dc4063a00 con 0x7f1dc4067170 2020-04-22T14:17:27.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.137+0000 7f1dcabb9700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc4063ca0 con 0x7f1dc40b6040 2020-04-22T14:17:27.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.137+0000 7f1dc8955700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1dc4067170 0x7f1dc414c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:27.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.137+0000 7f1dc8955700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1dc4067170 0x7f1dc414c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57126/0 (socket says 172.21.15.103:57126) 2020-04-22T14:17:27.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.137+0000 7f1dc8955700 1 -- 172.21.15.103:0/2717262454 learned_addr learned my addr 172.21.15.103:0/2717262454 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:27.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.137+0000 7f1dc3fff700 1 --2- 172.21.15.103:0/2717262454 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1dc40b6040 0x7f1dc41402e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:27.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.138+0000 7f1dc8955700 1 -- 172.21.15.103:0/2717262454 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1dc40b6040 msgr2=0x7f1dc41402e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:27.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.138+0000 7f1dc8955700 1 --2- 172.21.15.103:0/2717262454 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1dc40b6040 0x7f1dc41402e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:27.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.138+0000 7f1dc8955700 1 -- 172.21.15.103:0/2717262454 >> v1:172.21.15.86:6789/0 conn(0x7f1dc41426d0 legacy=0x7f1dc413f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:27.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.138+0000 7f1dc8955700 1 -- 172.21.15.103:0/2717262454 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc4063f40 con 0x7f1dc4067170 2020-04-22T14:17:27.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.138+0000 7f1dc8955700 1 --2- 172.21.15.103:0/2717262454 >> v2:172.21.15.103:3300/0 conn(0x7f1dc4067170 0x7f1dc414c8e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1db4000b80 tx=0x7f1db4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:27.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.138+0000 7f1dc8955700 1 --2- 172.21.15.103:0/2717262454 >> v2:172.21.15.103:3300/0 conn(0x7f1dc4067170 0x7f1dc414c8e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1db4000b80 tx=0x7f1db4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:27.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.138+0000 7f1dc8955700 1 --2- 172.21.15.103:0/2717262454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1dc4067170 0x7f1dc414c8e0 secure :-1 s=READY pgs=1829 cs=0 l=1 rx=0x7f1db4000b80 tx=0x7f1db4010a10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:27.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.138+0000 7f1dc8955700 1 --2- 172.21.15.103:0/2717262454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1dc4067170 0x7f1dc414c8e0 secure :-1 s=THROTTLE_DONE pgs=1829 cs=0 l=1 rx=0x7f1db4000b80 tx=0x7f1db4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:27.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.138+0000 7f1dc1ffb700 1 -- 172.21.15.103:0/2717262454 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1db4005ca0 con 0x7f1dc4067170 2020-04-22T14:17:27.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.138+0000 7f1dc8955700 1 --2- 172.21.15.103:0/2717262454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1dc4067170 0x7f1dc414c8e0 secure :-1 s=THROTTLE_DONE pgs=1829 cs=0 l=1 rx=0x7f1db4000b80 tx=0x7f1db4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:27.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.138+0000 7f1dc8955700 1 --2- 172.21.15.103:0/2717262454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1dc4067170 0x7f1dc414c8e0 secure :-1 s=THROTTLE_DONE pgs=1829 cs=0 l=1 rx=0x7f1db4000b80 tx=0x7f1db4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:27.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.138+0000 7f1dc1ffb700 1 -- 172.21.15.103:0/2717262454 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db4005e00 con 0x7f1dc4067170 2020-04-22T14:17:27.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.138+0000 7f1dc1ffb700 1 -- 172.21.15.103:0/2717262454 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1db40062c0 con 0x7f1dc4067170 2020-04-22T14:17:27.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.138+0000 7f1dcabb9700 1 -- 172.21.15.103:0/2717262454 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dc413d210 con 0x7f1dc4067170 2020-04-22T14:17:27.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.138+0000 7f1dcabb9700 1 -- 172.21.15.103:0/2717262454 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dc413b2a0 con 0x7f1dc4067170 2020-04-22T14:17:27.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.139+0000 7f1dc8955700 1 --2- 172.21.15.103:0/2717262454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1dc4067170 0x7f1dc414c8e0 secure :-1 s=THROTTLE_DONE pgs=1829 cs=0 l=1 rx=0x7f1db4000b80 tx=0x7f1db4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:27.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.139+0000 7f1dcabb9700 1 -- 172.21.15.103:0/2717262454 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dc4056c90 con 0x7f1dc4067170 2020-04-22T14:17:27.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.139+0000 7f1dc1ffb700 1 -- 172.21.15.103:0/2717262454 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f1db4006500 con 0x7f1dc4067170 2020-04-22T14:17:27.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.139+0000 7f1dc8955700 1 --2- 172.21.15.103:0/2717262454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1dc4067170 0x7f1dc414c8e0 secure :-1 s=THROTTLE_DONE pgs=1829 cs=0 l=1 rx=0x7f1db4000b80 tx=0x7f1db4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:27.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.139+0000 7f1dc1ffb700 1 --2- 172.21.15.103:0/2717262454 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1da404d930 0x7f1da404fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:27.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.139+0000 7f1dc1ffb700 1 -- 172.21.15.103:0/2717262454 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f1db40090c0 con 0x7f1dc4067170 2020-04-22T14:17:27.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.140+0000 7f1dc3fff700 1 --2- 172.21.15.103:0/2717262454 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1da404d930 0x7f1da404fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:27.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.140+0000 7f1dc3fff700 1 --2- 172.21.15.103:0/2717262454 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1da404d930 0x7f1da404fdf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1dc4066db0 tx=0x7f1db8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:27.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.140+0000 7f1dc3fff700 1 --2- 172.21.15.103:0/2717262454 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1da404d930 0x7f1da404fdf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1dc4066db0 tx=0x7f1db8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:27.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.140+0000 7f1dc3fff700 1 --2- 172.21.15.103:0/2717262454 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1da404d930 0x7f1da404fdf0 secure :-1 s=READY pgs=670 cs=0 l=1 rx=0x7f1dc4066db0 tx=0x7f1db8007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:27.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.143+0000 7f1dc8955700 1 --2- 172.21.15.103:0/2717262454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1dc4067170 0x7f1dc414c8e0 secure :-1 s=THROTTLE_DONE pgs=1829 cs=0 l=1 rx=0x7f1db4000b80 tx=0x7f1db4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:27.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.143+0000 7f1dc1ffb700 1 -- 172.21.15.103:0/2717262454 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f1db403ca00 con 0x7f1dc4067170 2020-04-22T14:17:27.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.331+0000 7f1dcabb9700 1 -- 172.21.15.103:0/2717262454 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1dc40b40c0 con 0x7f1dc4067170 2020-04-22T14:17:27.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.332+0000 7f1dc8955700 1 --2- 172.21.15.103:0/2717262454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1dc4067170 0x7f1dc414c8e0 secure :-1 s=THROTTLE_DONE pgs=1829 cs=0 l=1 rx=0x7f1db4000b80 tx=0x7f1db4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:27.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.332+0000 7f1dc1ffb700 1 -- 172.21.15.103:0/2717262454 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+2145 (secure 0 0 0) 0x7f1db4040020 con 0x7f1dc4067170 2020-04-22T14:17:27.336 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:17:27.336 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":94,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6380,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/1697822737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1697822737},{"type":"v1","addr":"172.21.15.103:6833","nonce":1697822737}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":91}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:16:46.111567+0000","modified":"2020-04-22T14:16:48.114069+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8142},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8142":{"gid":8142,"name":"b","rank":0,"incarnation":92,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/3334539524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3334539524},{"type":"v1","addr":"172.21.15.86:6835","nonce":3334539524}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2020-04-22T14:17:27.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.333+0000 7f1dcabb9700 1 -- 172.21.15.103:0/2717262454 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1da404d930 msgr2=0x7f1da404fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:27.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.333+0000 7f1dcabb9700 1 --2- 172.21.15.103:0/2717262454 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1da404d930 0x7f1da404fdf0 secure :-1 s=READY pgs=670 cs=0 l=1 rx=0x7f1dc4066db0 tx=0x7f1db8007a40).stop 2020-04-22T14:17:27.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.333+0000 7f1dcabb9700 1 -- 172.21.15.103:0/2717262454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1dc4067170 msgr2=0x7f1dc414c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:27.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.333+0000 7f1dcabb9700 1 --2- 172.21.15.103:0/2717262454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1dc4067170 0x7f1dc414c8e0 secure :-1 s=READY pgs=1829 cs=0 l=1 rx=0x7f1db4000b80 tx=0x7f1db4010a10).stop 2020-04-22T14:17:27.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.333+0000 7f1dcabb9700 1 -- 172.21.15.103:0/2717262454 shutdown_connections 2020-04-22T14:17:27.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.333+0000 7f1dcabb9700 1 --2- 172.21.15.103:0/2717262454 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1da404d930 0x7f1da404fdf0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:27.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.333+0000 7f1dcabb9700 1 --2- 172.21.15.103:0/2717262454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1dc4067170 0x7f1dc414c8e0 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:27.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.333+0000 7f1dcabb9700 1 --2- 172.21.15.103:0/2717262454 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1dc40b6040 0x7f1dc41402e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:27.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.333+0000 7f1dcabb9700 1 -- 172.21.15.103:0/2717262454 >> 172.21.15.103:0/2717262454 conn(0x7f1dc40b9160 msgr2=0x7f1dc4143070 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:27.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.334+0000 7f1dcabb9700 1 -- 172.21.15.103:0/2717262454 shutdown_connections 2020-04-22T14:17:27.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:27.334+0000 7f1dcabb9700 1 -- 172.21.15.103:0/2717262454 wait complete. 2020-04-22T14:17:27.339 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 94 2020-04-22T14:17:27.548 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 8142}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 21, u'failed': [], u'epoch': 94, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [22], u'info': {u'gid_8142': {u'export_targets': [], u'name': u'b', u'incarnation': 92, u'state_seq': 3, u'state': u'up:active', u'gid': 8142, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 3334539524, u'type': u'v2', u'addr': u'172.21.15.86:6834'}, {u'nonce': 3334539524, u'type': u'v1', u'addr': u'172.21.15.86:6835'}]}, u'addr': u'172.21.15.86:6835/3334539524'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:16:46.111567+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:16:48.114069+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:17:27.549 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:17:27.549 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:17:27.565 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2020-04-22T14:17:27.741 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2020-04-22T14:17:27.741 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:17:27.741 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 0, 2020-04-22T14:17:27.741 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 8142, 2020-04-22T14:17:27.742 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2020-04-22T14:17:27.742 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2020-04-22T14:17:27.742 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 41.626414803000003, 2020-04-22T14:17:27.742 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 94, 2020-04-22T14:17:27.742 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 125, 2020-04-22T14:17:27.742 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 125, 2020-04-22T14:17:27.742 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 46.824891823999998 2020-04-22T14:17:27.743 INFO:teuthology.orchestra.run.smithi086.stdout:} 2020-04-22T14:17:27.749 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 8142, "want_state": "up:active", "state": "up:active", "rank_uptime": 41.626414803000003, "mdsmap_epoch": 94, "osdmap_epoch": 125, "osdmap_epoch_barrier": 125, "uptime": 46.824891823999998 } 2020-04-22T14:17:27.750 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-04-22T14:17:27.750 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:17:27.750 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:27.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:27.765 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:17:27.824 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:17:27.824 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:17:27.824 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:17:27.824 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:27.824 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:17:27.825 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:27.825 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:17:27.825 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:17:27.825 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:17:27.825 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:17:27.825 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:17:27.825 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:17:27.825 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:17:27.826 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:17:27.826 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:17:27.826 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 41792sec preferred_lft 41792sec 2020-04-22T14:17:27.826 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:17:27.826 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:27.826 INFO:teuthology.orchestra.run.smithi103.stdout:34: brx.1@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:17:27.827 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether d2:98:d4:1b:2c:0d brd ff:ff:ff:ff:ff:ff link-netnsid 1 2020-04-22T14:17:27.827 INFO:teuthology.orchestra.run.smithi103.stdout:37: brx.2@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:17:27.827 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether a6:ff:ab:51:83:b6 brd ff:ff:ff:ff:ff:ff link-netnsid 2 2020-04-22T14:17:27.827 INFO:teuthology.orchestra.run.smithi103.stdout:38: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:17:27.827 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether de:47:69:02:b1:ec brd ff:ff:ff:ff:ff:ff 2020-04-22T14:17:27.827 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:17:27.827 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:27.828 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::1004:4d67:a829:aff9/64 scope link noprefixroute 2020-04-22T14:17:27.828 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:27.828 INFO:teuthology.orchestra.run.smithi103.stdout:39: brx.0@if2: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:17:27.828 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 12:89:28:89:ea:00 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:17:27.828 INFO:teuthology.orchestra.run.smithi103.stdout:40: brx.3@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-04-22T14:17:27.828 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether de:47:69:02:b1:ec brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2020-04-22T14:17:27.829 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:27.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:27.873 INFO:teuthology.orchestra.run.smithi103:> ip netns list 2020-04-22T14:17:27.933 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 3) 2020-04-22T14:17:27.933 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:27.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:27.981 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:17:28.041 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 2020-04-22T14:17:28.041 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 1 2020-04-22T14:17:28.041 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 2 2020-04-22T14:17:28.041 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 3 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2020-04-22T14:17:28.042 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:28.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:28.090 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:17:28.149 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 2020-04-22T14:17:28.149 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 1 2020-04-22T14:17:28.149 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 2 2020-04-22T14:17:28.149 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 3 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2020-04-22T14:17:28.150 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:28.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:28.197 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:17:28.256 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 2020-04-22T14:17:28.256 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 1 2020-04-22T14:17:28.256 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 2 2020-04-22T14:17:28.256 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 3 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2020-04-22T14:17:28.257 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:28.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:28.304 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:17:28.362 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 2020-04-22T14:17:28.362 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 1 2020-04-22T14:17:28.362 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 2 2020-04-22T14:17:28.362 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 3 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2020-04-22T14:17:28.364 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:28.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:28.414 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:17:28.474 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 2020-04-22T14:17:28.474 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 1 2020-04-22T14:17:28.474 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 2 2020-04-22T14:17:28.474 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 3 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2020-04-22T14:17:28.475 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:28.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:28.522 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:17:28.604 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:28.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:28.651 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 4' 2020-04-22T14:17:28.725 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:28.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:28.776 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr' 2020-04-22T14:17:28.886 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:17:28.886 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:17:28.886 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:17:28.886 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:28.886 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:17:28.887 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:28.887 INFO:teuthology.orchestra.run.smithi103.stdout:2: veth0@if40: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:17:28.887 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether be:da:f1:31:9c:55 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:17:28.887 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.0.2/16 brd 192.168.255.255 scope global veth0 2020-04-22T14:17:28.887 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:28.887 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::bcda:f1ff:fe31:9c55/64 scope link 2020-04-22T14:17:28.887 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:28.888 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-04-22T14:17:28.888 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:28.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:28.932 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.4' 2020-04-22T14:17:29.007 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:29.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:29.063 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0' 2020-04-22T14:17:29.170 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:29.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:29.184 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up' 2020-04-22T14:17:29.292 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:29.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:29.305 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up' 2020-04-22T14:17:29.416 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:29.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:29.429 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254' 2020-04-22T14:17:29.538 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:29.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:29.552 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:17:29.631 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:29.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:29.682 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge-slave con-name brx.4 ifname brx.4 master ceph-brx' 2020-04-22T14:17:29.790 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.4' (d1026ee4-790a-463b-bf1c-999cf55f575d) successfully added. 2020-04-22T14:17:29.791 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:29.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:29.822 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up brx.4' 2020-04-22T14:17:29.980 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/50) 2020-04-22T14:17:30.031 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-04-22T14:17:30.032 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi103.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-04-22T14:17:30.032 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:30.046 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:17:30.047 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:17:30.119 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:30.167 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:17:30.167 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:17:30.235 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:17:30.242 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:17:30.242 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:30.289 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:17:30.289 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:17:30.348 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:17:30.348 INFO:teuthology.orchestra.run.smithi103.stdout:49 2020-04-22T14:17:30.348 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [47, 49] 2020-04-22T14:17:30.349 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:30.397 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:17:30.439 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:30.452 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:17:30.452 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:17:30.521 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:17:30.530 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:17:30.530 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:30.531 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:2020-04-22T14:17:30.526+0000 7f1399c031c0 -1 init, newargv = 0x55aa2d83e3c0 newargc=9 2020-04-22T14:17:30.531 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[110815]: starting ceph client 2020-04-22T14:17:30.533 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[110815]: starting fuse 2020-04-22T14:17:30.550 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:17:30.550 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:17:30.609 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:17:30.609 INFO:teuthology.orchestra.run.smithi103.stdout:49 2020-04-22T14:17:30.609 INFO:teuthology.orchestra.run.smithi103.stdout:50 2020-04-22T14:17:30.609 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47, 49, 50] 2020-04-22T14:17:30.610 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:30.669 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:17:30.669 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:17:30.670 INFO:teuthology.orchestra.run.smithi103:> import glob 2020-04-22T14:17:30.670 INFO:teuthology.orchestra.run.smithi103:> import re 2020-04-22T14:17:30.670 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:17:30.670 INFO:teuthology.orchestra.run.smithi103:> import subprocess 2020-04-22T14:17:30.670 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:17:30.670 INFO:teuthology.orchestra.run.smithi103:> def find_socket(client_name): 2020-04-22T14:17:30.670 INFO:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-04-22T14:17:30.670 INFO:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2020-04-22T14:17:30.671 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:17:30.671 INFO:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2020-04-22T14:17:30.671 INFO:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2020-04-22T14:17:30.671 INFO:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2020-04-22T14:17:30.671 INFO:teuthology.orchestra.run.smithi103:> return files[0] 2020-04-22T14:17:30.671 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:17:30.671 INFO:teuthology.orchestra.run.smithi103:> for f in files: 2020-04-22T14:17:30.671 INFO:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:17:30.671 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:17:30.672 INFO:teuthology.orchestra.run.smithi103:> return f 2020-04-22T14:17:30.672 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:17:30.672 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:17:30.672 INFO:teuthology.orchestra.run.smithi103:> print(find_socket("client.0")) 2020-04-22T14:17:30.672 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:17:30.779 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.0.110815.asok 2020-04-22T14:17:30.779 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.110815.asok 2020-04-22T14:17:30.779 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:30.793 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:17:30.793 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.110815.asok status 2020-04-22T14:17:30.956 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:17:30.956 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2020-04-22T14:17:30.957 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:17:30.957 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:17:30.957 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "0", 2020-04-22T14:17:30.957 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:17:30.957 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-04-22T14:17:30.957 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "110815", 2020-04-22T14:17:30.957 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:17:30.958 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:30.958 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2020-04-22T14:17:30.958 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2020-04-22T14:17:30.958 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 9190, 2020-04-22T14:17:30.958 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2020-04-22T14:17:30.958 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:17:30.959 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:17:30.959 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 9190 2020-04-22T14:17:30.959 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:30.959 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:17:30.959 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:17:30.959 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:17:30.959 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 3782782632 2020-04-22T14:17:30.959 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:30.960 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:30.960 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:17:30.960 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:17:30.960 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:17:30.960 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 3782782632 2020-04-22T14:17:30.960 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:30.960 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.9190 192.168.0.1:0/3782782632", 2020-04-22T14:17:30.961 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.1:0/3782782632", 2020-04-22T14:17:30.961 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2020-04-22T14:17:30.961 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 94, 2020-04-22T14:17:30.961 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 125, 2020-04-22T14:17:30.961 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2020-04-22T14:17:30.961 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklisted": false 2020-04-22T14:17:30.961 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:17:30.962 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:30.975 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:17:30.976 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-22T14:17:30.976 INFO:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:17:31.034 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2020-04-22T14:17:31.035 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-04-22T14:17:31.035 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:31.084 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:17:31.084 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:17:31.159 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-04-22T14:17:31.159 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:17:31.175 INFO:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:17:31.276 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:31.289 INFO:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:17:31.383 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-04-22T14:17:31.383 INFO:tasks.cephfs.mount:Terminating background process 2020-04-22T14:17:31.400 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2020-04-22T14:17:31.400 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:31.445 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-04-22T14:17:31.445 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:17:31.519 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[110815]: fuse finished with error 0 and tester_r 0 2020-04-22T14:17:31.662 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:17:31.662 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:17:31.662 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:31.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:31.715 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:17:31.790 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:31.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:31.840 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down brx.4' 2020-04-22T14:17:31.998 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.4' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/50) 2020-04-22T14:17:31.998 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:32.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:32.012 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete brx.4' 2020-04-22T14:17:32.119 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.4' (d1026ee4-790a-463b-bf1c-999cf55f575d) successfully deleted. 2020-04-22T14:17:32.120 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:32.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:32.133 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:17:32.240 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:32.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:32.266 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:17:32.324 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:17:32.324 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:17:32.324 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:17:32.324 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:32.325 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:17:32.325 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:32.325 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:17:32.325 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:17:32.325 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:17:32.325 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:17:32.325 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:17:32.326 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:17:32.326 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:17:32.326 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:17:32.326 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:17:32.326 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 41788sec preferred_lft 41788sec 2020-04-22T14:17:32.326 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:17:32.326 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:32.326 INFO:teuthology.orchestra.run.smithi103.stdout:34: brx.1@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:17:32.327 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether d2:98:d4:1b:2c:0d brd ff:ff:ff:ff:ff:ff link-netnsid 1 2020-04-22T14:17:32.327 INFO:teuthology.orchestra.run.smithi103.stdout:37: brx.2@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:17:32.327 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether a6:ff:ab:51:83:b6 brd ff:ff:ff:ff:ff:ff link-netnsid 2 2020-04-22T14:17:32.327 INFO:teuthology.orchestra.run.smithi103.stdout:38: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:17:32.327 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether de:47:69:02:b1:ec brd ff:ff:ff:ff:ff:ff 2020-04-22T14:17:32.327 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:17:32.327 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:32.328 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::1004:4d67:a829:aff9/64 scope link noprefixroute 2020-04-22T14:17:32.328 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:32.328 INFO:teuthology.orchestra.run.smithi103.stdout:39: brx.0@if2: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:17:32.328 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 12:89:28:89:ea:00 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:17:32.328 INFO:teuthology.orchestra.run.smithi103.stdout:40: brx.3@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-04-22T14:17:32.328 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether de:47:69:02:b1:ec brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2020-04-22T14:17:32.328 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:32.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:32.379 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:17:32.454 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:32.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:32.504 INFO:teuthology.orchestra.run.smithi103:> nmcli connection show 2020-04-22T14:17:32.578 INFO:teuthology.orchestra.run.smithi103.stdout:NAME UUID TYPE DEVICE 2020-04-22T14:17:32.578 INFO:teuthology.orchestra.run.smithi103.stdout:System enp3s0f1 b0a308d1-bd90-60af-eb7c-0183bb425a1a ethernet enp3s0f1 2020-04-22T14:17:32.579 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-brx 6b3d6d40-16fd-49ac-9259-f712ca031e42 bridge ceph-brx 2020-04-22T14:17:32.579 INFO:teuthology.orchestra.run.smithi103.stdout:brx.3 fd906f59-a0ad-45fa-a791-2515cf159a7a ethernet brx.3 2020-04-22T14:17:32.579 INFO:teuthology.orchestra.run.smithi103.stdout:eno1 206ad60d-195e-4d4b-a9fe-a5dd1f33a67d ethernet -- 2020-04-22T14:17:32.579 INFO:teuthology.orchestra.run.smithi103.stdout:eno2 894a7dd2-d329-4985-9ef9-84a92c6e1c6c ethernet -- 2020-04-22T14:17:32.579 INFO:teuthology.orchestra.run.smithi103.stdout:enp3s0f0 5a3237ce-06ab-4ae0-818b-45bdf036cb08 ethernet -- 2020-04-22T14:17:32.579 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:32.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:32.627 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:17:32.686 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2020-04-22T14:17:32.686 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:32.734 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-04-22T14:17:32.734 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:17:32.810 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[108481]: fuse finished with error 0 and tester_r 0 2020-04-22T14:17:32.952 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-04-22T14:17:32.952 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:17:32.952 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:33.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:33.006 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:17:33.081 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:33.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:33.132 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down brx.3' 2020-04-22T14:17:33.290 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.3' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/49) 2020-04-22T14:17:33.290 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:33.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:33.304 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete brx.3' 2020-04-22T14:17:33.414 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.3' (fd906f59-a0ad-45fa-a791-2515cf159a7a) successfully deleted. 2020-04-22T14:17:33.414 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:33.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:33.427 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:17:33.535 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:33.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:33.559 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:17:33.618 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:17:33.686 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:17:33.686 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:17:33.686 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:33.686 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:17:33.686 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:33.686 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:17:33.687 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:17:33.687 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:17:33.687 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:17:33.687 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:17:33.687 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:17:33.687 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:17:33.687 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:17:33.688 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:17:33.688 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 41787sec preferred_lft 41787sec 2020-04-22T14:17:33.688 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:17:33.688 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:33.688 INFO:teuthology.orchestra.run.smithi103.stdout:34: brx.1@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:17:33.688 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether d2:98:d4:1b:2c:0d brd ff:ff:ff:ff:ff:ff link-netnsid 1 2020-04-22T14:17:33.688 INFO:teuthology.orchestra.run.smithi103.stdout:37: brx.2@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:17:33.689 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether a6:ff:ab:51:83:b6 brd ff:ff:ff:ff:ff:ff link-netnsid 2 2020-04-22T14:17:33.689 INFO:teuthology.orchestra.run.smithi103.stdout:38: ceph-brx: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:17:33.689 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:17:33.689 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:17:33.689 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:33.689 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::1004:4d67:a829:aff9/64 scope link noprefixroute 2020-04-22T14:17:33.689 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:33.689 INFO:teuthology.orchestra.run.smithi103.stdout:39: brx.0@if2: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:17:33.690 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 12:89:28:89:ea:00 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:17:33.690 INFO:teuthology.orchestra.run.smithi103.stdout:40: brx.3@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:17:33.690 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether de:47:69:02:b1:ec brd ff:ff:ff:ff:ff:ff link-netnsid 3 2020-04-22T14:17:33.690 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:33.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:33.710 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:17:33.793 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:33.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:33.840 INFO:teuthology.orchestra.run.smithi103:> nmcli connection show 2020-04-22T14:17:33.921 INFO:teuthology.orchestra.run.smithi103.stdout:NAME UUID TYPE DEVICE 2020-04-22T14:17:33.921 INFO:teuthology.orchestra.run.smithi103.stdout:System enp3s0f1 b0a308d1-bd90-60af-eb7c-0183bb425a1a ethernet enp3s0f1 2020-04-22T14:17:33.921 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-brx 6b3d6d40-16fd-49ac-9259-f712ca031e42 bridge ceph-brx 2020-04-22T14:17:33.921 INFO:teuthology.orchestra.run.smithi103.stdout:eno1 206ad60d-195e-4d4b-a9fe-a5dd1f33a67d ethernet -- 2020-04-22T14:17:33.921 INFO:teuthology.orchestra.run.smithi103.stdout:eno2 894a7dd2-d329-4985-9ef9-84a92c6e1c6c ethernet -- 2020-04-22T14:17:33.921 INFO:teuthology.orchestra.run.smithi103.stdout:enp3s0f0 5a3237ce-06ab-4ae0-818b-45bdf036cb08 ethernet -- 2020-04-22T14:17:33.922 INFO:tasks.cephfs.mount:Removing the 'ceph-brx' 2020-04-22T14:17:33.922 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:33.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:33.962 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down ceph-brx' 2020-04-22T14:17:34.121 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/47) 2020-04-22T14:17:34.121 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:34.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:34.135 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete ceph-brx' 2020-04-22T14:17:34.244 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' (6b3d6d40-16fd-49ac-9259-f712ca031e42) successfully deleted. 2020-04-22T14:17:34.244 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:34.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:34.258 INFO:teuthology.orchestra.run.smithi103:> route 2020-04-22T14:17:34.317 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2020-04-22T14:17:34.317 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-04-22T14:17:34.317 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 102 0 0 enp3s0f1 2020-04-22T14:17:34.317 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 102 0 0 enp3s0f1 2020-04-22T14:17:34.318 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:34.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:34.369 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -D FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-04-22T14:17:34.451 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:34.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:34.498 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -D FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-04-22T14:17:34.609 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:34.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:34.633 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -t nat -D POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-04-22T14:17:34.740 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:34.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:34.764 INFO:teuthology.orchestra.run.smithi103:> cat /tmp/python-ceph-brx 2020-04-22T14:17:34.823 INFO:teuthology.orchestra.run.smithi103.stdout:0 2020-04-22T14:17:34.823 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:34.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:34.871 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 0 > /proc/sys/net/ipv4/ip_forward' 2020-04-22T14:17:34.946 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:34.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:34.991 INFO:teuthology.orchestra.run.smithi103:> rm -f /tmp/python-ceph-brx 2020-04-22T14:17:35.052 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:35.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:35.097 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:17:35.156 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.2' netns for '/home/ubuntu/cephtest/mnt.2' 2020-04-22T14:17:35.156 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:17:35.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:35.172 INFO:teuthology.orchestra.run.smithi086:> ip addr 2020-04-22T14:17:35.254 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:17:35.254 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:17:35.254 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:17:35.254 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:35.254 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2020-04-22T14:17:35.254 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:35.255 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:17:35.255 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:17:35.255 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:17:35.255 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:17:35.255 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:17:35.255 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:17:35.255 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:17:35.256 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:17:35.256 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:17:35.256 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 41759sec preferred_lft 41759sec 2020-04-22T14:17:35.256 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2020-04-22T14:17:35.256 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:35.256 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:17:35.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:35.293 INFO:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.2) 2020-04-22T14:17:35.353 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.3' netns for '/home/ubuntu/cephtest/mnt.3' 2020-04-22T14:17:35.353 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:17:35.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:35.405 INFO:teuthology.orchestra.run.smithi086:> ip addr 2020-04-22T14:17:35.473 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:17:35.473 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:17:35.474 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:17:35.474 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:35.474 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2020-04-22T14:17:35.474 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:35.474 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:17:35.474 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:17:35.474 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:17:35.475 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:17:35.475 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:17:35.475 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:17:35.475 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:17:35.475 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:17:35.475 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:17:35.475 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 41759sec preferred_lft 41759sec 2020-04-22T14:17:35.475 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2020-04-22T14:17:35.476 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:35.476 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:17:35.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:35.542 INFO:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.3) 2020-04-22T14:17:35.628 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:35.653 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_filelock_eviction' 2020-04-22T14:17:35.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.811+0000 7fa162d89700 1 Processor -- start 2020-04-22T14:17:35.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.811+0000 7fa162d89700 1 -- start start 2020-04-22T14:17:35.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.812+0000 7fa162d89700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa15c12c0d0 0x7fa15c1464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:35.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.812+0000 7fa162d89700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa15c063e30 0x7fa15c0642a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:35.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.812+0000 7fa162d89700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa15c143300 con 0x7fa15c065fe0 2020-04-22T14:17:35.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.812+0000 7fa162d89700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa15c1435a0 con 0x7fa15c063e30 2020-04-22T14:17:35.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.812+0000 7fa162d89700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa15c143840 con 0x7fa15c12c0d0 2020-04-22T14:17:35.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.812+0000 7fa15bfff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa15c065fe0 0x7fa15c05b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49344/0 (socket says 172.21.15.103:49344) 2020-04-22T14:17:35.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.812+0000 7fa15bfff700 1 -- 172.21.15.103:0/3851780632 learned_addr learned my addr 172.21.15.103:0/3851780632 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:17:35.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.812+0000 7fa161326700 1 --2- 172.21.15.103:0/3851780632 >> v2:172.21.15.103:3300/0 conn(0x7fa15c063e30 0x7fa15c0642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:35.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.812+0000 7fa15b7fe700 1 -- 172.21.15.103:0/3851780632 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2009460954 0 0) 0x7fa15c143300 con 0x7fa15c065fe0 2020-04-22T14:17:35.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.812+0000 7fa15b7fe700 1 -- 172.21.15.103:0/3851780632 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa148003230 con 0x7fa15c065fe0 2020-04-22T14:17:35.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.812+0000 7fa160b25700 1 --2- 172.21.15.103:0/3851780632 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa15c12c0d0 0x7fa15c1464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:35.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.813+0000 7fa161326700 1 -- 172.21.15.103:0/3851780632 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa15c12c0d0 msgr2=0x7fa15c1464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:35.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.813+0000 7fa161326700 1 --2- 172.21.15.103:0/3851780632 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa15c12c0d0 0x7fa15c1464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:35.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.813+0000 7fa161326700 1 -- 172.21.15.103:0/3851780632 >> v1:172.21.15.103:6789/0 conn(0x7fa15c065fe0 legacy=0x7fa15c05b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:35.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.813+0000 7fa15b7fe700 1 -- 172.21.15.103:0/3851780632 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 541456448 0 0) 0x7fa148003230 con 0x7fa15c065fe0 2020-04-22T14:17:35.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.813+0000 7fa161326700 1 -- 172.21.15.103:0/3851780632 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa15c05bb50 con 0x7fa15c063e30 2020-04-22T14:17:35.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.813+0000 7fa161326700 1 --2- 172.21.15.103:0/3851780632 >> v2:172.21.15.103:3300/0 conn(0x7fa15c063e30 0x7fa15c0642a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa150001870 tx=0x7fa154007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:35.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.813+0000 7fa161326700 1 --2- 172.21.15.103:0/3851780632 >> v2:172.21.15.103:3300/0 conn(0x7fa15c063e30 0x7fa15c0642a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa150001870 tx=0x7fa154007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:35.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.813+0000 7fa161326700 1 --2- 172.21.15.103:0/3851780632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa15c063e30 0x7fa15c0642a0 secure :-1 s=READY pgs=1834 cs=0 l=1 rx=0x7fa150001870 tx=0x7fa154007dc0).ready entity=mon.1 client_cookie=87cda9467f1458b9 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:35.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.813+0000 7fa161326700 1 --2- 172.21.15.103:0/3851780632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa15c063e30 0x7fa15c0642a0 secure :-1 s=THROTTLE_DONE pgs=1834 cs=0 l=1 rx=0x7fa150001870 tx=0x7fa154007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:35.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.813+0000 7fa15b7fe700 1 -- 172.21.15.103:0/3851780632 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1500016d0 con 0x7fa15c063e30 2020-04-22T14:17:35.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.813+0000 7fa161326700 1 --2- 172.21.15.103:0/3851780632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa15c063e30 0x7fa15c0642a0 secure :-1 s=THROTTLE_DONE pgs=1834 cs=0 l=1 rx=0x7fa150001870 tx=0x7fa154007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:35.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.813+0000 7fa161326700 1 --2- 172.21.15.103:0/3851780632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa15c063e30 0x7fa15c0642a0 secure :-1 s=THROTTLE_DONE pgs=1834 cs=0 l=1 rx=0x7fa150001870 tx=0x7fa154007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:35.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.813+0000 7fa15b7fe700 1 -- 172.21.15.103:0/3851780632 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa154010a10 con 0x7fa15c063e30 2020-04-22T14:17:35.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.813+0000 7fa15b7fe700 1 -- 172.21.15.103:0/3851780632 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa154010df0 con 0x7fa15c063e30 2020-04-22T14:17:35.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.813+0000 7fa162d89700 1 -- 172.21.15.103:0/3851780632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa15c063e30 msgr2=0x7fa15c0642a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:35.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.813+0000 7fa162d89700 1 --2- 172.21.15.103:0/3851780632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa15c063e30 0x7fa15c0642a0 secure :-1 s=READY pgs=1834 cs=0 l=1 rx=0x7fa150001870 tx=0x7fa154007dc0).stop 2020-04-22T14:17:35.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.813+0000 7fa162d89700 1 -- 172.21.15.103:0/3851780632 shutdown_connections 2020-04-22T14:17:35.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.813+0000 7fa162d89700 1 --2- 172.21.15.103:0/3851780632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa15c063e30 0x7fa15c0642a0 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:35.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.813+0000 7fa162d89700 1 --2- 172.21.15.103:0/3851780632 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa15c12c0d0 0x7fa15c1464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:35.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.813+0000 7fa162d89700 1 -- 172.21.15.103:0/3851780632 >> 172.21.15.103:0/3851780632 conn(0x7fa15c0b9160 msgr2=0x7fa15c05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:35.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.813+0000 7fa162d89700 1 -- 172.21.15.103:0/3851780632 shutdown_connections 2020-04-22T14:17:35.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.813+0000 7fa162d89700 1 -- 172.21.15.103:0/3851780632 wait complete. 2020-04-22T14:17:35.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.814+0000 7fa162d89700 1 Processor -- start 2020-04-22T14:17:35.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.814+0000 7fa162d89700 1 -- start start 2020-04-22T14:17:35.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.815+0000 7fa162d89700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa15c12c0d0 0x7fa15c1259f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:35.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.815+0000 7fa162d89700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa15c125e50 con 0x7fa15c063e30 2020-04-22T14:17:35.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.815+0000 7fa162d89700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa15c1260d0 con 0x7fa15c065fe0 2020-04-22T14:17:35.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.815+0000 7fa162d89700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa15c126370 con 0x7fa15c12c0d0 2020-04-22T14:17:35.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.815+0000 7fa15bfff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa15c065fe0 0x7fa15c154180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49352/0 (socket says 172.21.15.103:49352) 2020-04-22T14:17:35.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.815+0000 7fa15bfff700 1 -- 172.21.15.103:0/3085570313 learned_addr learned my addr 172.21.15.103:0/3085570313 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:17:35.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.815+0000 7fa159ffb700 1 -- 172.21.15.103:0/3085570313 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2033770556 0 0) 0x7fa15c1260d0 con 0x7fa15c065fe0 2020-04-22T14:17:35.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.815+0000 7fa159ffb700 1 -- 172.21.15.103:0/3085570313 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa13c002fe0 con 0x7fa15c065fe0 2020-04-22T14:17:35.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.815+0000 7fa161326700 1 --2- 172.21.15.103:0/3085570313 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa15c12c0d0 0x7fa15c1259f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:35.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.816+0000 7fa159ffb700 1 -- 172.21.15.103:0/3085570313 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 546910322 0 0) 0x7fa13c002fe0 con 0x7fa15c065fe0 2020-04-22T14:17:35.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.816+0000 7fa159ffb700 1 -- 172.21.15.103:0/3085570313 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa15c1260d0 con 0x7fa15c065fe0 2020-04-22T14:17:35.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.816+0000 7fa159ffb700 1 -- 172.21.15.103:0/3085570313 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fa150001310 con 0x7fa15c065fe0 2020-04-22T14:17:35.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.816+0000 7fa159ffb700 1 -- 172.21.15.103:0/3085570313 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa15c12c0d0 msgr2=0x7fa15c1259f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:35.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.816+0000 7fa159ffb700 1 --2- 172.21.15.103:0/3085570313 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa15c12c0d0 0x7fa15c1259f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:35.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.816+0000 7fa159ffb700 1 -- 172.21.15.103:0/3085570313 >> v1:172.21.15.103:6789/0 conn(0x7fa15c065fe0 legacy=0x7fa15c154180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:35.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.816+0000 7fa159ffb700 1 -- 172.21.15.103:0/3085570313 >> v1:172.21.15.86:6789/0 conn(0x7fa15c063e30 legacy=0x7fa15c142100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:35.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.816+0000 7fa159ffb700 1 --2- 172.21.15.103:0/3085570313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa13c0049b0 0x7fa13c004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:35.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.816+0000 7fa159ffb700 1 --2- 172.21.15.103:0/3085570313 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa13c003920 0x7fa13c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:35.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.816+0000 7fa159ffb700 1 --2- 172.21.15.103:0/3085570313 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa15c12c0d0 0x7fa13c0041e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:35.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.816+0000 7fa159ffb700 1 -- 172.21.15.103:0/3085570313 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15c126370 con 0x7fa13c003920 2020-04-22T14:17:35.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.816+0000 7fa159ffb700 1 -- 172.21.15.103:0/3085570313 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa13c005510 con 0x7fa13c0049b0 2020-04-22T14:17:35.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.816+0000 7fa159ffb700 1 -- 172.21.15.103:0/3085570313 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa13c0046c0 con 0x7fa15c12c0d0 2020-04-22T14:17:35.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.816+0000 7fa160b25700 1 --2- 172.21.15.103:0/3085570313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa13c0049b0 0x7fa13c004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:35.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.816+0000 7fa15bfff700 1 --2- 172.21.15.103:0/3085570313 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa13c003920 0x7fa13c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:35.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.816+0000 7fa161326700 1 --2- 172.21.15.103:0/3085570313 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa15c12c0d0 0x7fa13c0041e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:35.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.816+0000 7fa160b25700 1 -- 172.21.15.103:0/3085570313 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa15c12c0d0 msgr2=0x7fa13c0041e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:35.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.816+0000 7fa160b25700 1 --2- 172.21.15.103:0/3085570313 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa15c12c0d0 0x7fa13c0041e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:35.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.816+0000 7fa160b25700 1 -- 172.21.15.103:0/3085570313 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa13c003920 msgr2=0x7fa13c003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:35.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.816+0000 7fa160b25700 1 --2- 172.21.15.103:0/3085570313 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa13c003920 0x7fa13c003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:35.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.816+0000 7fa160b25700 1 -- 172.21.15.103:0/3085570313 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa15c126610 con 0x7fa13c0049b0 2020-04-22T14:17:35.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.816+0000 7fa162d89700 1 -- 172.21.15.103:0/3085570313 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa15c142810 con 0x7fa13c0049b0 2020-04-22T14:17:35.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.816+0000 7fa160b25700 1 --2- 172.21.15.103:0/3085570313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa13c0049b0 0x7fa13c004dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa15c145cc0 tx=0x7fa14c010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:35.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.816+0000 7fa162d89700 1 -- 172.21.15.103:0/3085570313 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa15c154a50 con 0x7fa13c0049b0 2020-04-22T14:17:35.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.816+0000 7fa160b25700 1 --2- 172.21.15.103:0/3085570313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa13c0049b0 0x7fa13c004dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa15c145cc0 tx=0x7fa14c010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:35.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.816+0000 7fa160b25700 1 --2- 172.21.15.103:0/3085570313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa13c0049b0 0x7fa13c004dd0 secure :-1 s=READY pgs=1836 cs=0 l=1 rx=0x7fa15c145cc0 tx=0x7fa14c010b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:35.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.816+0000 7fa160b25700 1 --2- 172.21.15.103:0/3085570313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa13c0049b0 0x7fa13c004dd0 secure :-1 s=THROTTLE_DONE pgs=1836 cs=0 l=1 rx=0x7fa15c145cc0 tx=0x7fa14c010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:35.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.816+0000 7fa159ffb700 1 -- 172.21.15.103:0/3085570313 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa14c007570 con 0x7fa13c0049b0 2020-04-22T14:17:35.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.816+0000 7fa160b25700 1 --2- 172.21.15.103:0/3085570313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa13c0049b0 0x7fa13c004dd0 secure :-1 s=THROTTLE_DONE pgs=1836 cs=0 l=1 rx=0x7fa15c145cc0 tx=0x7fa14c010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:35.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.816+0000 7fa160b25700 1 --2- 172.21.15.103:0/3085570313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa13c0049b0 0x7fa13c004dd0 secure :-1 s=THROTTLE_DONE pgs=1836 cs=0 l=1 rx=0x7fa15c145cc0 tx=0x7fa14c010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:35.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.816+0000 7fa159ffb700 1 -- 172.21.15.103:0/3085570313 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14c0056c0 con 0x7fa13c0049b0 2020-04-22T14:17:35.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.816+0000 7fa159ffb700 1 -- 172.21.15.103:0/3085570313 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa14c005ae0 con 0x7fa13c0049b0 2020-04-22T14:17:35.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.817+0000 7fa160b25700 1 --2- 172.21.15.103:0/3085570313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa13c0049b0 0x7fa13c004dd0 secure :-1 s=THROTTLE_DONE pgs=1836 cs=0 l=1 rx=0x7fa15c145cc0 tx=0x7fa14c010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:35.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.817+0000 7fa162d89700 1 -- 172.21.15.103:0/3085570313 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa138003340 con 0x7fa13c0049b0 2020-04-22T14:17:35.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.817+0000 7fa159ffb700 1 -- 172.21.15.103:0/3085570313 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fa14c005c40 con 0x7fa13c0049b0 2020-04-22T14:17:35.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.817+0000 7fa160b25700 1 --2- 172.21.15.103:0/3085570313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa13c0049b0 0x7fa13c004dd0 secure :-1 s=THROTTLE_DONE pgs=1836 cs=0 l=1 rx=0x7fa15c145cc0 tx=0x7fa14c010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:35.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.818+0000 7fa159ffb700 1 --2- 172.21.15.103:0/3085570313 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa13c055c80 0x7fa13c058140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:35.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.818+0000 7fa159ffb700 1 -- 172.21.15.103:0/3085570313 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fa14c00d0c0 con 0x7fa13c0049b0 2020-04-22T14:17:35.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.818+0000 7fa15bfff700 1 --2- 172.21.15.103:0/3085570313 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa13c055c80 0x7fa13c058140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:35.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.818+0000 7fa15bfff700 1 --2- 172.21.15.103:0/3085570313 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa13c055c80 0x7fa13c058140 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa150001e60 tx=0x7fa150000ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:35.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.818+0000 7fa15bfff700 1 --2- 172.21.15.103:0/3085570313 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa13c055c80 0x7fa13c058140 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa150001e60 tx=0x7fa150000ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:35.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.818+0000 7fa15bfff700 1 --2- 172.21.15.103:0/3085570313 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa13c055c80 0x7fa13c058140 secure :-1 s=READY pgs=671 cs=0 l=1 rx=0x7fa150001e60 tx=0x7fa150000ef0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:35.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.822+0000 7fa160b25700 1 --2- 172.21.15.103:0/3085570313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa13c0049b0 0x7fa13c004dd0 secure :-1 s=THROTTLE_DONE pgs=1836 cs=0 l=1 rx=0x7fa15c145cc0 tx=0x7fa14c010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:35.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:35.822+0000 7fa159ffb700 1 -- 172.21.15.103:0/3085570313 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fa14c03c720 con 0x7fa13c0049b0 2020-04-22T14:17:36.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.014+0000 7fa162d89700 1 -- 172.21.15.103:0/3085570313 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_filelock_eviction"]} v 0) v1 -- 0x7fa138002280 con 0x7fa13c0049b0 2020-04-22T14:17:36.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.539+0000 7fa160b25700 1 --2- 172.21.15.103:0/3085570313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa13c0049b0 0x7fa13c004dd0 secure :-1 s=THROTTLE_DONE pgs=1836 cs=0 l=1 rx=0x7fa15c145cc0 tx=0x7fa14c010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:36.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.539+0000 7fa159ffb700 1 -- 172.21.15.103:0/3085570313 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_filelock_eviction"]}]=0 v652) v1 ==== 154+0+0 (secure 0 0 0) 0x7fa14c03fd40 con 0x7fa13c0049b0 2020-04-22T14:17:36.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.541+0000 7fa162d89700 1 -- 172.21.15.103:0/3085570313 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa13c055c80 msgr2=0x7fa13c058140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:36.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.541+0000 7fa162d89700 1 --2- 172.21.15.103:0/3085570313 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa13c055c80 0x7fa13c058140 secure :-1 s=READY pgs=671 cs=0 l=1 rx=0x7fa150001e60 tx=0x7fa150000ef0).stop 2020-04-22T14:17:36.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.541+0000 7fa162d89700 1 -- 172.21.15.103:0/3085570313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa13c0049b0 msgr2=0x7fa13c004dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:36.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.541+0000 7fa162d89700 1 --2- 172.21.15.103:0/3085570313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa13c0049b0 0x7fa13c004dd0 secure :-1 s=READY pgs=1836 cs=0 l=1 rx=0x7fa15c145cc0 tx=0x7fa14c010b90).stop 2020-04-22T14:17:36.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.541+0000 7fa161326700 1 -- 172.21.15.103:0/3085570313 reap_dead start 2020-04-22T14:17:36.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.541+0000 7fa161326700 1 -- 172.21.15.103:0/3085570313 reap_dead start 2020-04-22T14:17:36.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.541+0000 7fa162d89700 1 -- 172.21.15.103:0/3085570313 shutdown_connections 2020-04-22T14:17:36.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.541+0000 7fa162d89700 1 -- 172.21.15.103:0/3085570313 >> 172.21.15.103:0/3085570313 conn(0x7fa15c0b9160 msgr2=0x7fa15c0b65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:36.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.541+0000 7fa162d89700 1 -- 172.21.15.103:0/3085570313 shutdown_connections 2020-04-22T14:17:36.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.541+0000 7fa162d89700 1 -- 172.21.15.103:0/3085570313 wait complete. 2020-04-22T14:17:36.556 INFO:tasks.cephfs_test_runner:test_filelock_eviction (tasks.cephfs.test_client_recovery.TestClientRecovery) ... ok 2020-04-22T14:17:36.556 INFO:tasks.cephfs_test_runner:Starting test: test_reconnect_after_blacklisted (tasks.cephfs.test_client_recovery.TestClientRecovery) 2020-04-22T14:17:36.556 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:36.570 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_reconnect_after_blacklisted' 2020-04-22T14:17:36.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.716+0000 7f0ea01d7700 1 Processor -- start 2020-04-22T14:17:36.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.716+0000 7f0ea01d7700 1 -- start start 2020-04-22T14:17:36.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.716+0000 7f0ea01d7700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0e9812c0d0 0x7f0e981464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:36.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.716+0000 7f0ea01d7700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e98065fe0 0x7f0e9805b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:36.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.716+0000 7f0ea01d7700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e98143300 con 0x7f0e9805b8a0 2020-04-22T14:17:36.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.716+0000 7f0ea01d7700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e9812c4b0 con 0x7f0e9812c0d0 2020-04-22T14:17:36.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.716+0000 7f0ea01d7700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e981435a0 con 0x7f0e98065fe0 2020-04-22T14:17:36.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.717+0000 7f0e9df73700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0e9812c0d0 0x7f0e981464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:36.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.717+0000 7f0e9d772700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e98065fe0 0x7f0e9805b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:36.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.717+0000 7f0e9df73700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0e9812c0d0 0x7f0e981464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:54406/0 (socket says 172.21.15.103:54406) 2020-04-22T14:17:36.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.717+0000 7f0e9e774700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f0e9805b8a0 0x7f0e98062ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:38288/0 (socket says 172.21.15.103:38288) 2020-04-22T14:17:36.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.717+0000 7f0e9df73700 1 -- 172.21.15.103:0/4126484002 learned_addr learned my addr 172.21.15.103:0/4126484002 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:36.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.717+0000 7f0e9df73700 1 -- 172.21.15.103:0/4126484002 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e98065fe0 msgr2=0x7f0e9805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:36.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.717+0000 7f0e9df73700 1 --2- 172.21.15.103:0/4126484002 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e98065fe0 0x7f0e9805b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:36.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.717+0000 7f0e9df73700 1 -- 172.21.15.103:0/4126484002 >> v1:172.21.15.86:6789/0 conn(0x7f0e9805b8a0 legacy=0x7f0e98062ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:36.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.717+0000 7f0e9df73700 1 -- 172.21.15.103:0/4126484002 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e98143840 con 0x7f0e9812c0d0 2020-04-22T14:17:36.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.717+0000 7f0e9cf71700 1 -- 172.21.15.103:0/4126484002 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3302686063 0 0) 0x7f0e98143300 con 0x7f0e9805b8a0 2020-04-22T14:17:36.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.717+0000 7f0e9d772700 1 --2- 172.21.15.103:0/4126484002 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e98065fe0 0x7f0e9805b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:17:36.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.717+0000 7f0e9df73700 1 --2- 172.21.15.103:0/4126484002 >> v2:172.21.15.86:3300/0 conn(0x7f0e9812c0d0 0x7f0e981464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0e94002f30 tx=0x7f0e94007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:36.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.717+0000 7f0e9df73700 1 --2- 172.21.15.103:0/4126484002 >> v2:172.21.15.86:3300/0 conn(0x7f0e9812c0d0 0x7f0e981464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0e94002f30 tx=0x7f0e94007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:36.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.717+0000 7f0e9df73700 1 --2- 172.21.15.103:0/4126484002 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e9812c0d0 0x7f0e981464e0 secure :-1 s=READY pgs=979 cs=0 l=1 rx=0x7f0e94002f30 tx=0x7f0e94007a40).ready entity=mon.0 client_cookie=7f2c58ff745e430c server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:36.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.718+0000 7f0e9df73700 1 --2- 172.21.15.103:0/4126484002 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e9812c0d0 0x7f0e981464e0 secure :-1 s=THROTTLE_DONE pgs=979 cs=0 l=1 rx=0x7f0e94002f30 tx=0x7f0e94007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:36.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.718+0000 7f0e9cf71700 1 -- 172.21.15.103:0/4126484002 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e94011670 con 0x7f0e9812c0d0 2020-04-22T14:17:36.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.718+0000 7f0e9df73700 1 --2- 172.21.15.103:0/4126484002 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e9812c0d0 0x7f0e981464e0 secure :-1 s=THROTTLE_DONE pgs=979 cs=0 l=1 rx=0x7f0e94002f30 tx=0x7f0e94007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:36.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.718+0000 7f0e9cf71700 1 -- 172.21.15.103:0/4126484002 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e94011810 con 0x7f0e9812c0d0 2020-04-22T14:17:36.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.718+0000 7f0e9df73700 1 --2- 172.21.15.103:0/4126484002 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e9812c0d0 0x7f0e981464e0 secure :-1 s=THROTTLE_DONE pgs=979 cs=0 l=1 rx=0x7f0e94002f30 tx=0x7f0e94007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:36.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.718+0000 7f0e9cf71700 1 -- 172.21.15.103:0/4126484002 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e94011bf0 con 0x7f0e9812c0d0 2020-04-22T14:17:36.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.718+0000 7f0ea01d7700 1 -- 172.21.15.103:0/4126484002 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e9812c0d0 msgr2=0x7f0e981464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:36.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.718+0000 7f0ea01d7700 1 --2- 172.21.15.103:0/4126484002 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e9812c0d0 0x7f0e981464e0 secure :-1 s=READY pgs=979 cs=0 l=1 rx=0x7f0e94002f30 tx=0x7f0e94007a40).stop 2020-04-22T14:17:36.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.718+0000 7f0ea01d7700 1 -- 172.21.15.103:0/4126484002 shutdown_connections 2020-04-22T14:17:36.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.718+0000 7f0ea01d7700 1 --2- 172.21.15.103:0/4126484002 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e9812c0d0 0x7f0e981464e0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:36.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.718+0000 7f0ea01d7700 1 --2- 172.21.15.103:0/4126484002 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e98065fe0 0x7f0e9805b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:36.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.718+0000 7f0ea01d7700 1 -- 172.21.15.103:0/4126484002 >> 172.21.15.103:0/4126484002 conn(0x7f0e980b9160 msgr2=0x7f0e9805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:36.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.718+0000 7f0ea01d7700 1 -- 172.21.15.103:0/4126484002 shutdown_connections 2020-04-22T14:17:36.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.718+0000 7f0ea01d7700 1 -- 172.21.15.103:0/4126484002 wait complete. 2020-04-22T14:17:36.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.719+0000 7f0ea01d7700 1 Processor -- start 2020-04-22T14:17:36.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.719+0000 7f0ea01d7700 1 -- start start 2020-04-22T14:17:36.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.720+0000 7f0ea01d7700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0e98065fe0 0x7f0e98126e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:36.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.720+0000 7f0ea01d7700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e9812c0d0 0x7f0e980655d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:36.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.720+0000 7f0ea01d7700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e98065a30 con 0x7f0e9805b8a0 2020-04-22T14:17:36.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.720+0000 7f0ea01d7700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e98157e40 con 0x7f0e98065fe0 2020-04-22T14:17:36.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.720+0000 7f0ea01d7700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e980b0b50 con 0x7f0e9812c0d0 2020-04-22T14:17:36.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.720+0000 7f0e9df73700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f0e9805b8a0 0x7f0e98127920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49372/0 (socket says 172.21.15.103:49372) 2020-04-22T14:17:36.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.720+0000 7f0e9df73700 1 -- 172.21.15.103:0/1282142604 learned_addr learned my addr 172.21.15.103:0/1282142604 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:17:36.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.720+0000 7f0e9d772700 1 --2- 172.21.15.103:0/1282142604 >> v2:172.21.15.86:3300/0 conn(0x7f0e98065fe0 0x7f0e98126e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:36.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.720+0000 7f0e9e774700 1 --2- 172.21.15.103:0/1282142604 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e9812c0d0 0x7f0e980655d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:36.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.720+0000 7f0e86ffd700 1 -- 172.21.15.103:0/1282142604 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1272613602 0 0) 0x7f0e98143840 con 0x7f0e9805b8a0 2020-04-22T14:17:36.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.720+0000 7f0e86ffd700 1 -- 172.21.15.103:0/1282142604 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e78002fe0 con 0x7f0e9805b8a0 2020-04-22T14:17:36.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.720+0000 7f0e86ffd700 1 -- 172.21.15.103:0/1282142604 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1276177739 0 0) 0x7f0e78002fe0 con 0x7f0e9805b8a0 2020-04-22T14:17:36.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.720+0000 7f0e86ffd700 1 -- 172.21.15.103:0/1282142604 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0e98143840 con 0x7f0e9805b8a0 2020-04-22T14:17:36.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.720+0000 7f0e86ffd700 1 -- 172.21.15.103:0/1282142604 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f0e94011e70 con 0x7f0e9805b8a0 2020-04-22T14:17:36.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.720+0000 7f0e86ffd700 1 -- 172.21.15.103:0/1282142604 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e9812c0d0 msgr2=0x7f0e980655d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:36.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.720+0000 7f0e86ffd700 1 --2- 172.21.15.103:0/1282142604 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e9812c0d0 0x7f0e980655d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:36.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.720+0000 7f0e86ffd700 1 -- 172.21.15.103:0/1282142604 >> v2:172.21.15.86:3300/0 conn(0x7f0e98065fe0 msgr2=0x7f0e98126e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:36.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.720+0000 7f0e86ffd700 1 --2- 172.21.15.103:0/1282142604 >> v2:172.21.15.86:3300/0 conn(0x7f0e98065fe0 0x7f0e98126e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:36.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.720+0000 7f0e86ffd700 1 -- 172.21.15.103:0/1282142604 >> v1:172.21.15.103:6789/0 conn(0x7f0e9805b8a0 legacy=0x7f0e98127920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:36.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.720+0000 7f0e86ffd700 1 --2- 172.21.15.103:0/1282142604 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e780049b0 0x7f0e78004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:36.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.721+0000 7f0e86ffd700 1 --2- 172.21.15.103:0/1282142604 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e9812c0d0 0x7f0e78003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:36.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.721+0000 7f0e86ffd700 1 --2- 172.21.15.103:0/1282142604 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e78003d80 0x7f0e78004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:36.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.721+0000 7f0e86ffd700 1 -- 172.21.15.103:0/1282142604 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e98157e40 con 0x7f0e78003d80 2020-04-22T14:17:36.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.721+0000 7f0e86ffd700 1 -- 172.21.15.103:0/1282142604 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e980b0b50 con 0x7f0e780049b0 2020-04-22T14:17:36.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.721+0000 7f0e86ffd700 1 -- 172.21.15.103:0/1282142604 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e78005340 con 0x7f0e9812c0d0 2020-04-22T14:17:36.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.721+0000 7f0e9df73700 1 --2- 172.21.15.103:0/1282142604 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e780049b0 0x7f0e78004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:36.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.721+0000 7f0e9d772700 1 --2- 172.21.15.103:0/1282142604 >> v2:172.21.15.86:3300/0 conn(0x7f0e98065fe0 0x7f0e98126e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:17:36.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.721+0000 7f0e9e774700 1 --2- 172.21.15.103:0/1282142604 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e78003d80 0x7f0e78004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:36.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.721+0000 7f0e9d772700 1 --2- 172.21.15.103:0/1282142604 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e9812c0d0 0x7f0e78003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:36.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.721+0000 7f0e9df73700 1 -- 172.21.15.103:0/1282142604 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e9812c0d0 msgr2=0x7f0e78003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:36.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.721+0000 7f0e9df73700 1 --2- 172.21.15.103:0/1282142604 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e9812c0d0 0x7f0e78003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:36.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.721+0000 7f0e9df73700 1 -- 172.21.15.103:0/1282142604 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e78003d80 msgr2=0x7f0e78004200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:36.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.721+0000 7f0e9df73700 1 --2- 172.21.15.103:0/1282142604 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e78003d80 0x7f0e78004200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:36.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.721+0000 7f0e9df73700 1 -- 172.21.15.103:0/1282142604 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e98128030 con 0x7f0e780049b0 2020-04-22T14:17:36.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.721+0000 7f0ea01d7700 1 -- 172.21.15.103:0/1282142604 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e98157ac0 con 0x7f0e780049b0 2020-04-22T14:17:36.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.721+0000 7f0e9d772700 1 --2- 172.21.15.103:0/1282142604 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e9812c0d0 0x7f0e78003920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:17:36.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.721+0000 7f0e9df73700 1 --2- 172.21.15.103:0/1282142604 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e780049b0 0x7f0e78004dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0e94010210 tx=0x7f0e940078c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:36.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.721+0000 7f0ea01d7700 1 -- 172.21.15.103:0/1282142604 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e98124ed0 con 0x7f0e780049b0 2020-04-22T14:17:36.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.721+0000 7f0e9df73700 1 --2- 172.21.15.103:0/1282142604 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e780049b0 0x7f0e78004dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0e94010210 tx=0x7f0e940078c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:36.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.721+0000 7f0e9df73700 1 --2- 172.21.15.103:0/1282142604 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e780049b0 0x7f0e78004dd0 secure :-1 s=READY pgs=1838 cs=0 l=1 rx=0x7f0e94010210 tx=0x7f0e940078c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:36.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.721+0000 7f0e9df73700 1 --2- 172.21.15.103:0/1282142604 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e780049b0 0x7f0e78004dd0 secure :-1 s=THROTTLE_DONE pgs=1838 cs=0 l=1 rx=0x7f0e94010210 tx=0x7f0e940078c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:36.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.721+0000 7f0e86ffd700 1 -- 172.21.15.103:0/1282142604 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e9400f900 con 0x7f0e780049b0 2020-04-22T14:17:36.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.721+0000 7f0e9df73700 1 --2- 172.21.15.103:0/1282142604 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e780049b0 0x7f0e78004dd0 secure :-1 s=THROTTLE_DONE pgs=1838 cs=0 l=1 rx=0x7f0e94010210 tx=0x7f0e940078c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:36.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.721+0000 7f0e9df73700 1 --2- 172.21.15.103:0/1282142604 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e780049b0 0x7f0e78004dd0 secure :-1 s=THROTTLE_DONE pgs=1838 cs=0 l=1 rx=0x7f0e94010210 tx=0x7f0e940078c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:36.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.721+0000 7f0e86ffd700 1 -- 172.21.15.103:0/1282142604 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e94007550 con 0x7f0e780049b0 2020-04-22T14:17:36.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.721+0000 7f0e86ffd700 1 -- 172.21.15.103:0/1282142604 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e9400abb0 con 0x7f0e780049b0 2020-04-22T14:17:36.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.722+0000 7f0e9df73700 1 --2- 172.21.15.103:0/1282142604 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e780049b0 0x7f0e78004dd0 secure :-1 s=THROTTLE_DONE pgs=1838 cs=0 l=1 rx=0x7f0e94010210 tx=0x7f0e940078c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:36.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.722+0000 7f0ea01d7700 1 -- 172.21.15.103:0/1282142604 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e98056c90 con 0x7f0e780049b0 2020-04-22T14:17:36.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.722+0000 7f0e86ffd700 1 -- 172.21.15.103:0/1282142604 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f0e9400ad10 con 0x7f0e780049b0 2020-04-22T14:17:36.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.722+0000 7f0e9df73700 1 --2- 172.21.15.103:0/1282142604 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e780049b0 0x7f0e78004dd0 secure :-1 s=THROTTLE_DONE pgs=1838 cs=0 l=1 rx=0x7f0e94010210 tx=0x7f0e940078c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:36.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.722+0000 7f0e86ffd700 1 --2- 172.21.15.103:0/1282142604 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0e78055b60 0x7f0e78058020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:36.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.722+0000 7f0e86ffd700 1 -- 172.21.15.103:0/1282142604 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f0e940620b0 con 0x7f0e780049b0 2020-04-22T14:17:36.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.723+0000 7f0e9d772700 1 --2- 172.21.15.103:0/1282142604 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0e78055b60 0x7f0e78058020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:36.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.723+0000 7f0e9d772700 1 --2- 172.21.15.103:0/1282142604 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0e78055b60 0x7f0e78058020 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0e88002f30 tx=0x7f0e8800b8c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:36.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.723+0000 7f0e9d772700 1 --2- 172.21.15.103:0/1282142604 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0e78055b60 0x7f0e78058020 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0e88002f30 tx=0x7f0e8800b8c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:36.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.723+0000 7f0e9d772700 1 --2- 172.21.15.103:0/1282142604 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0e78055b60 0x7f0e78058020 secure :-1 s=READY pgs=672 cs=0 l=1 rx=0x7f0e88002f30 tx=0x7f0e8800b8c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:36.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.726+0000 7f0e9df73700 1 --2- 172.21.15.103:0/1282142604 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e780049b0 0x7f0e78004dd0 secure :-1 s=THROTTLE_DONE pgs=1838 cs=0 l=1 rx=0x7f0e94010210 tx=0x7f0e940078c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:36.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.726+0000 7f0e86ffd700 1 -- 172.21.15.103:0/1282142604 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f0e9403d5b0 con 0x7f0e780049b0 2020-04-22T14:17:36.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:36.921+0000 7f0ea01d7700 1 -- 172.21.15.103:0/1282142604 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_reconnect_after_blacklisted"]} v 0) v1 -- 0x7f0e98147360 con 0x7f0e780049b0 2020-04-22T14:17:37.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.541+0000 7f0e9df73700 1 --2- 172.21.15.103:0/1282142604 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e780049b0 0x7f0e78004dd0 secure :-1 s=THROTTLE_DONE pgs=1838 cs=0 l=1 rx=0x7f0e94010210 tx=0x7f0e940078c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:37.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.541+0000 7f0e86ffd700 1 -- 172.21.15.103:0/1282142604 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_reconnect_after_blacklisted"]}]=0 v653) v1 ==== 167+0+0 (secure 0 0 0) 0x7f0e94040bd0 con 0x7f0e780049b0 2020-04-22T14:17:37.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.543+0000 7f0ea01d7700 1 -- 172.21.15.103:0/1282142604 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0e78055b60 msgr2=0x7f0e78058020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:37.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.543+0000 7f0ea01d7700 1 --2- 172.21.15.103:0/1282142604 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0e78055b60 0x7f0e78058020 secure :-1 s=READY pgs=672 cs=0 l=1 rx=0x7f0e88002f30 tx=0x7f0e8800b8c0).stop 2020-04-22T14:17:37.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.543+0000 7f0ea01d7700 1 -- 172.21.15.103:0/1282142604 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e780049b0 msgr2=0x7f0e78004dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:37.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.543+0000 7f0ea01d7700 1 --2- 172.21.15.103:0/1282142604 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e780049b0 0x7f0e78004dd0 secure :-1 s=READY pgs=1838 cs=0 l=1 rx=0x7f0e94010210 tx=0x7f0e940078c0).stop 2020-04-22T14:17:37.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.543+0000 7f0e9e774700 1 -- 172.21.15.103:0/1282142604 reap_dead start 2020-04-22T14:17:37.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.543+0000 7f0e9e774700 1 -- 172.21.15.103:0/1282142604 reap_dead start 2020-04-22T14:17:37.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.543+0000 7f0ea01d7700 1 -- 172.21.15.103:0/1282142604 shutdown_connections 2020-04-22T14:17:37.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.543+0000 7f0ea01d7700 1 -- 172.21.15.103:0/1282142604 >> 172.21.15.103:0/1282142604 conn(0x7f0e980b9160 msgr2=0x7f0e9812afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:37.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.543+0000 7f0ea01d7700 1 -- 172.21.15.103:0/1282142604 shutdown_connections 2020-04-22T14:17:37.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.543+0000 7f0ea01d7700 1 -- 172.21.15.103:0/1282142604 wait complete. 2020-04-22T14:17:37.557 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-04-22T14:17:37.557 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:17:37.574 INFO:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:17:37.667 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:37.681 INFO:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:17:37.766 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-04-22T14:17:37.766 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:37.780 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2020-04-22T14:17:37.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.924+0000 7faf246f5700 1 Processor -- start 2020-04-22T14:17:37.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.924+0000 7faf246f5700 1 -- start start 2020-04-22T14:17:37.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.925+0000 7faf246f5700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faf1c065fe0 0x7faf1c1464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:37.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.925+0000 7faf246f5700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf1c143300 con 0x7faf1c12c0d0 2020-04-22T14:17:37.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.925+0000 7faf246f5700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf1c1435a0 con 0x7faf1c063e30 2020-04-22T14:17:37.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.925+0000 7faf246f5700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf1c143840 con 0x7faf1c065fe0 2020-04-22T14:17:37.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.925+0000 7faf22c92700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7faf1c063e30 0x7faf1c0642a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49384/0 (socket says 172.21.15.103:49384) 2020-04-22T14:17:37.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.925+0000 7faf22c92700 1 -- 172.21.15.103:0/2681507046 learned_addr learned my addr 172.21.15.103:0/2681507046 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:17:37.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.925+0000 7faf2148f700 1 -- 172.21.15.103:0/2681507046 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3774914711 0 0) 0x7faf1c1435a0 con 0x7faf1c063e30 2020-04-22T14:17:37.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.925+0000 7faf2148f700 1 -- 172.21.15.103:0/2681507046 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf04003230 con 0x7faf1c063e30 2020-04-22T14:17:37.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.925+0000 7faf21c90700 1 --2- 172.21.15.103:0/2681507046 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faf1c065fe0 0x7faf1c1464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:37.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.926+0000 7faf2148f700 1 -- 172.21.15.103:0/2681507046 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3695076266 0 0) 0x7faf04003230 con 0x7faf1c063e30 2020-04-22T14:17:37.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.926+0000 7faf2148f700 1 -- 172.21.15.103:0/2681507046 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faf1c065fe0 msgr2=0x7faf1c1464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:37.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.926+0000 7faf2148f700 1 --2- 172.21.15.103:0/2681507046 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faf1c065fe0 0x7faf1c1464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:37.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.926+0000 7faf2148f700 1 -- 172.21.15.103:0/2681507046 >> v1:172.21.15.86:6789/0 conn(0x7faf1c12c0d0 legacy=0x7faf1c05b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:37.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.926+0000 7faf2148f700 1 -- 172.21.15.103:0/2681507046 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf1c05bb50 con 0x7faf1c063e30 2020-04-22T14:17:37.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.926+0000 7faf2148f700 1 -- 172.21.15.103:0/2681507046 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7faf14001a90 con 0x7faf1c063e30 2020-04-22T14:17:37.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.926+0000 7faf2148f700 1 -- 172.21.15.103:0/2681507046 >> v1:172.21.15.103:6789/0 conn(0x7faf1c063e30 legacy=0x7faf1c0642a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:37.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.926+0000 7faf2148f700 1 --2- 172.21.15.103:0/2681507046 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faf1c065fe0 0x7faf04003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:37.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.926+0000 7faf2148f700 1 --2- 172.21.15.103:0/2681507046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf04003b80 0x7faf04003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:37.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.926+0000 7faf2148f700 1 --2- 172.21.15.103:0/2681507046 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf040045c0 0x7faf04004a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:37.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.926+0000 7faf2148f700 1 -- 172.21.15.103:0/2681507046 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf1c143840 con 0x7faf040045c0 2020-04-22T14:17:37.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.926+0000 7faf2148f700 1 -- 172.21.15.103:0/2681507046 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf04005000 con 0x7faf04003b80 2020-04-22T14:17:37.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.926+0000 7faf2148f700 1 -- 172.21.15.103:0/2681507046 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf040051c0 con 0x7faf1c065fe0 2020-04-22T14:17:37.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.926+0000 7faf21c90700 1 --2- 172.21.15.103:0/2681507046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf04003b80 0x7faf04003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:37.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.926+0000 7faf22491700 1 --2- 172.21.15.103:0/2681507046 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faf1c065fe0 0x7faf04003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:37.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.926+0000 7faf22c92700 1 --2- 172.21.15.103:0/2681507046 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf040045c0 0x7faf04004a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:37.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.926+0000 7faf21c90700 1 -- 172.21.15.103:0/2681507046 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faf1c065fe0 msgr2=0x7faf04003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:37.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.926+0000 7faf21c90700 1 --2- 172.21.15.103:0/2681507046 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faf1c065fe0 0x7faf04003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:37.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.926+0000 7faf21c90700 1 -- 172.21.15.103:0/2681507046 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf040045c0 msgr2=0x7faf04004a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:37.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.926+0000 7faf21c90700 1 --2- 172.21.15.103:0/2681507046 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf040045c0 0x7faf04004a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:37.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.926+0000 7faf21c90700 1 -- 172.21.15.103:0/2681507046 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf04003230 con 0x7faf04003b80 2020-04-22T14:17:37.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.926+0000 7faf21c90700 1 --2- 172.21.15.103:0/2681507046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf04003b80 0x7faf04003fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7faf18002f30 tx=0x7faf180121e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:37.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.926+0000 7faf21c90700 1 --2- 172.21.15.103:0/2681507046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf04003b80 0x7faf04003fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7faf18002f30 tx=0x7faf180121e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:37.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.926+0000 7faf21c90700 1 --2- 172.21.15.103:0/2681507046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf04003b80 0x7faf04003fe0 secure :-1 s=READY pgs=1840 cs=0 l=1 rx=0x7faf18002f30 tx=0x7faf180121e0).ready entity=mon.1 client_cookie=f239f7cd2e9352db server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:37.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.926+0000 7faf21c90700 1 --2- 172.21.15.103:0/2681507046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf04003b80 0x7faf04003fe0 secure :-1 s=THROTTLE_DONE pgs=1840 cs=0 l=1 rx=0x7faf18002f30 tx=0x7faf180121e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:37.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.926+0000 7faf2148f700 1 -- 172.21.15.103:0/2681507046 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf18012ea0 con 0x7faf04003b80 2020-04-22T14:17:37.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.926+0000 7faf21c90700 1 --2- 172.21.15.103:0/2681507046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf04003b80 0x7faf04003fe0 secure :-1 s=THROTTLE_DONE pgs=1840 cs=0 l=1 rx=0x7faf18002f30 tx=0x7faf180121e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:37.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.926+0000 7faf21c90700 1 --2- 172.21.15.103:0/2681507046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf04003b80 0x7faf04003fe0 secure :-1 s=THROTTLE_DONE pgs=1840 cs=0 l=1 rx=0x7faf18002f30 tx=0x7faf180121e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:37.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.926+0000 7faf2148f700 1 -- 172.21.15.103:0/2681507046 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf18008950 con 0x7faf04003b80 2020-04-22T14:17:37.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.926+0000 7faf2148f700 1 -- 172.21.15.103:0/2681507046 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf18008cb0 con 0x7faf04003b80 2020-04-22T14:17:37.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.926+0000 7faf246f5700 1 -- 172.21.15.103:0/2681507046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf04003b80 msgr2=0x7faf04003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:37.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.926+0000 7faf246f5700 1 --2- 172.21.15.103:0/2681507046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf04003b80 0x7faf04003fe0 secure :-1 s=READY pgs=1840 cs=0 l=1 rx=0x7faf18002f30 tx=0x7faf180121e0).stop 2020-04-22T14:17:37.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.926+0000 7faf22c92700 1 -- 172.21.15.103:0/2681507046 reap_dead start 2020-04-22T14:17:37.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.927+0000 7faf246f5700 1 -- 172.21.15.103:0/2681507046 shutdown_connections 2020-04-22T14:17:37.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.927+0000 7faf246f5700 1 -- 172.21.15.103:0/2681507046 >> 172.21.15.103:0/2681507046 conn(0x7faf1c0b9160 msgr2=0x7faf1c05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:37.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.927+0000 7faf246f5700 1 -- 172.21.15.103:0/2681507046 shutdown_connections 2020-04-22T14:17:37.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.927+0000 7faf246f5700 1 -- 172.21.15.103:0/2681507046 wait complete. 2020-04-22T14:17:37.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.928+0000 7faf246f5700 1 Processor -- start 2020-04-22T14:17:37.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.928+0000 7faf246f5700 1 -- start start 2020-04-22T14:17:37.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.928+0000 7faf246f5700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7faf1c1279a0 0x7faf1c0b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:37.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.928+0000 7faf246f5700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faf1c0b1040 0x7faf1c0aed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:37.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.928+0000 7faf246f5700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7faf1c0af180 0x7faf1c151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:37.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.928+0000 7faf246f5700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf1c0b1560 con 0x7faf1c0af180 2020-04-22T14:17:37.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.928+0000 7faf246f5700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf1c0b1800 con 0x7faf1c1279a0 2020-04-22T14:17:37.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.928+0000 7faf246f5700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf1c127d80 con 0x7faf1c0b1040 2020-04-22T14:17:37.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.929+0000 7faf22491700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7faf1c1279a0 0x7faf1c0b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:37.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.929+0000 7faf22491700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7faf1c1279a0 0x7faf1c0b0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57208/0 (socket says 172.21.15.103:57208) 2020-04-22T14:17:37.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.929+0000 7faf22491700 1 -- 172.21.15.103:0/2564666330 learned_addr learned my addr 172.21.15.103:0/2564666330 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:37.942 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.929+0000 7faf22c92700 1 --2- 172.21.15.103:0/2564666330 >> v2:172.21.15.86:3300/0 conn(0x7faf1c0af180 0x7faf1c151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:37.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.929+0000 7faf21c90700 1 --2- 172.21.15.103:0/2564666330 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faf1c0b1040 0x7faf1c0aed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:37.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.929+0000 7faf22491700 1 -- 172.21.15.103:0/2564666330 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faf1c0b1040 msgr2=0x7faf1c0aed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:37.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.929+0000 7faf22491700 1 --2- 172.21.15.103:0/2564666330 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faf1c0b1040 0x7faf1c0aed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:37.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.929+0000 7faf22491700 1 -- 172.21.15.103:0/2564666330 >> v2:172.21.15.86:3300/0 conn(0x7faf1c0af180 msgr2=0x7faf1c151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:37.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.929+0000 7faf22491700 1 --2- 172.21.15.103:0/2564666330 >> v2:172.21.15.86:3300/0 conn(0x7faf1c0af180 0x7faf1c151bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:37.943 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.929+0000 7faf22491700 1 -- 172.21.15.103:0/2564666330 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf1c127ef0 con 0x7faf1c1279a0 2020-04-22T14:17:37.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.929+0000 7faf22491700 1 --2- 172.21.15.103:0/2564666330 >> v2:172.21.15.103:3300/0 conn(0x7faf1c1279a0 0x7faf1c0b0be0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faf1c0613e0 tx=0x7faf0c010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:37.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.929+0000 7faf22491700 1 --2- 172.21.15.103:0/2564666330 >> v2:172.21.15.103:3300/0 conn(0x7faf1c1279a0 0x7faf1c0b0be0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faf1c0613e0 tx=0x7faf0c010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:37.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.929+0000 7faf22491700 1 --2- 172.21.15.103:0/2564666330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf1c1279a0 0x7faf1c0b0be0 secure :-1 s=READY pgs=1841 cs=0 l=1 rx=0x7faf1c0613e0 tx=0x7faf0c010c80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:37.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.929+0000 7faf22491700 1 --2- 172.21.15.103:0/2564666330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf1c1279a0 0x7faf1c0b0be0 secure :-1 s=THROTTLE_DONE pgs=1841 cs=0 l=1 rx=0x7faf1c0613e0 tx=0x7faf0c010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:37.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.929+0000 7faf22491700 1 --2- 172.21.15.103:0/2564666330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf1c1279a0 0x7faf1c0b0be0 secure :-1 s=THROTTLE_DONE pgs=1841 cs=0 l=1 rx=0x7faf1c0613e0 tx=0x7faf0c010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:37.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.929+0000 7faf0b7fe700 1 -- 172.21.15.103:0/2564666330 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf0c001e60 con 0x7faf1c1279a0 2020-04-22T14:17:37.944 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.929+0000 7faf22491700 1 --2- 172.21.15.103:0/2564666330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf1c1279a0 0x7faf1c0b0be0 secure :-1 s=THROTTLE_DONE pgs=1841 cs=0 l=1 rx=0x7faf1c0613e0 tx=0x7faf0c010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:37.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.929+0000 7faf0b7fe700 1 -- 172.21.15.103:0/2564666330 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0c00c840 con 0x7faf1c1279a0 2020-04-22T14:17:37.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.929+0000 7faf246f5700 1 -- 172.21.15.103:0/2564666330 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf1c152f10 con 0x7faf1c1279a0 2020-04-22T14:17:37.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.929+0000 7faf0b7fe700 1 -- 172.21.15.103:0/2564666330 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf0c00cc20 con 0x7faf1c1279a0 2020-04-22T14:17:37.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.929+0000 7faf246f5700 1 -- 172.21.15.103:0/2564666330 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf1c1521e0 con 0x7faf1c1279a0 2020-04-22T14:17:37.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.930+0000 7faf22491700 1 --2- 172.21.15.103:0/2564666330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf1c1279a0 0x7faf1c0b0be0 secure :-1 s=THROTTLE_DONE pgs=1841 cs=0 l=1 rx=0x7faf1c0613e0 tx=0x7faf0c010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:37.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.930+0000 7faf0b7fe700 1 -- 172.21.15.103:0/2564666330 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7faf0c0064e0 con 0x7faf1c1279a0 2020-04-22T14:17:37.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.930+0000 7faf22491700 1 --2- 172.21.15.103:0/2564666330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf1c1279a0 0x7faf1c0b0be0 secure :-1 s=THROTTLE_DONE pgs=1841 cs=0 l=1 rx=0x7faf1c0613e0 tx=0x7faf0c010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:37.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.930+0000 7faf246f5700 1 -- 172.21.15.103:0/2564666330 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf1c056c90 con 0x7faf1c1279a0 2020-04-22T14:17:37.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.930+0000 7faf0b7fe700 1 --2- 172.21.15.103:0/2564666330 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faefc04d8b0 0x7faefc04fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:37.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.930+0000 7faf0b7fe700 1 -- 172.21.15.103:0/2564666330 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6116+0+0 (secure 0 0 0) 0x7faf0c0613c0 con 0x7faf1c1279a0 2020-04-22T14:17:37.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.931+0000 7faf21c90700 1 --2- 172.21.15.103:0/2564666330 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faefc04d8b0 0x7faefc04fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:37.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.931+0000 7faf21c90700 1 --2- 172.21.15.103:0/2564666330 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faefc04d8b0 0x7faefc04fd70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faf18002f30 tx=0x7faf180121e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:37.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.931+0000 7faf21c90700 1 --2- 172.21.15.103:0/2564666330 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faefc04d8b0 0x7faefc04fd70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faf18002f30 tx=0x7faf180121e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:37.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.931+0000 7faf21c90700 1 --2- 172.21.15.103:0/2564666330 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faefc04d8b0 0x7faefc04fd70 secure :-1 s=READY pgs=673 cs=0 l=1 rx=0x7faf18002f30 tx=0x7faf180121e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:37.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.935+0000 7faf22491700 1 --2- 172.21.15.103:0/2564666330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf1c1279a0 0x7faf1c0b0be0 secure :-1 s=THROTTLE_DONE pgs=1841 cs=0 l=1 rx=0x7faf1c0613e0 tx=0x7faf0c010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:37.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:37.935+0000 7faf0b7fe700 1 -- 172.21.15.103:0/2564666330 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7faf0c03c7a0 con 0x7faf1c1279a0 2020-04-22T14:17:38.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.076+0000 7faf246f5700 1 -- 172.21.15.103:0/2564666330 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7faf1c147360 con 0x7faf1c1279a0 2020-04-22T14:17:38.081 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.077+0000 7faf22491700 1 --2- 172.21.15.103:0/2564666330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf1c1279a0 0x7faf1c0b0be0 secure :-1 s=THROTTLE_DONE pgs=1841 cs=0 l=1 rx=0x7faf1c0613e0 tx=0x7faf0c010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:38.081 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.077+0000 7faf0b7fe700 1 -- 172.21.15.103:0/2564666330 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v125) v1 ==== 81+0+33784 (secure 0 0 0) 0x7faf0c03fdc0 con 0x7faf1c1279a0 2020-04-22T14:17:38.081 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:17:38.081 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:17:38.081 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 125, 2020-04-22T14:17:38.081 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:17:38.082 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2020-04-22T14:02:06.484738+0000", 2020-04-22T14:17:38.082 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2020-04-22T14:17:09.473738+0000", 2020-04-22T14:17:38.082 INFO:teuthology.orchestra.run.smithi103.stdout: "last_up_change": "2020-04-22T14:02:18.623774+0000", 2020-04-22T14:17:38.082 INFO:teuthology.orchestra.run.smithi103.stdout: "last_in_change": "2020-04-22T14:02:18.623774+0000", 2020-04-22T14:17:38.082 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-04-22T14:17:38.082 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_num": 5799936, 2020-04-22T14:17:38.083 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_set": [ 2020-04-22T14:17:38.083 INFO:teuthology.orchestra.run.smithi103.stdout: "pglog_hardlimit", 2020-04-22T14:17:38.083 INFO:teuthology.orchestra.run.smithi103.stdout: "purged_snapdirs", 2020-04-22T14:17:38.083 INFO:teuthology.orchestra.run.smithi103.stdout: "recovery_deletes", 2020-04-22T14:17:38.083 INFO:teuthology.orchestra.run.smithi103.stdout: "sortbitwise" 2020-04-22T14:17:38.083 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:17:38.084 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_version": 5, 2020-04-22T14:17:38.084 INFO:teuthology.orchestra.run.smithi103.stdout: "full_ratio": 0.94999998807907104, 2020-04-22T14:17:38.084 INFO:teuthology.orchestra.run.smithi103.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-04-22T14:17:38.084 INFO:teuthology.orchestra.run.smithi103.stdout: "nearfull_ratio": 0.85000002384185791, 2020-04-22T14:17:38.084 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_snapshot": "", 2020-04-22T14:17:38.084 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_max": 22, 2020-04-22T14:17:38.084 INFO:teuthology.orchestra.run.smithi103.stdout: "max_osd": 8, 2020-04-22T14:17:38.085 INFO:teuthology.orchestra.run.smithi103.stdout: "require_min_compat_client": "luminous", 2020-04-22T14:17:38.085 INFO:teuthology.orchestra.run.smithi103.stdout: "min_compat_client": "jewel", 2020-04-22T14:17:38.085 INFO:teuthology.orchestra.run.smithi103.stdout: "require_osd_release": "pacific", 2020-04-22T14:17:38.085 INFO:teuthology.orchestra.run.smithi103.stdout: "pools": [ 2020-04-22T14:17:38.085 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.085 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 1, 2020-04-22T14:17:38.086 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "device_health_metrics", 2020-04-22T14:17:38.089 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:02:09.565655+0000", 2020-04-22T14:17:38.089 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:17:38.089 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:17:38.089 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:17:38.089 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:17:38.089 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:17:38.090 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:17:38.090 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:17:38.090 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:17:38.090 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 1, 2020-04-22T14:17:38.091 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 1, 2020-04-22T14:17:38.091 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 1, 2020-04-22T14:17:38.091 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 1, 2020-04-22T14:17:38.092 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 1, 2020-04-22T14:17:38.092 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:17:38.093 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:17:38.094 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:17:38.095 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:17:38.095 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:17:38.096 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:17:38.096 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:17:38.098 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.098 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "17", 2020-04-22T14:17:38.099 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:17:38.099 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:17:38.099 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:17:38.099 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:17:38.099 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:17:38.100 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:17:38.100 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:17:38.100 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:17:38.100 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:17:38.100 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:17:38.100 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:17:38.101 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:17:38.101 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:17:38.101 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:17:38.101 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:17:38.101 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:17:38.101 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:17:38.101 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:17:38.102 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:17:38.102 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:17:38.102 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:17:38.102 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:17:38.102 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:17:38.102 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:17:38.102 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:17:38.103 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:17:38.103 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.103 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:17:38.103 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:17:38.103 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:17:38.103 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:17:38.104 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:17:38.104 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:17:38.104 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:17:38.104 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:17:38.104 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:17:38.104 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:17:38.105 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:17:38.105 INFO:teuthology.orchestra.run.smithi103.stdout: "options": { 2020-04-22T14:17:38.105 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_min": 1 2020-04-22T14:17:38.105 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.106 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:17:38.106 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_devicehealth": {} 2020-04-22T14:17:38.106 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.106 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.106 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.106 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 2, 2020-04-22T14:17:38.107 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "rbd", 2020-04-22T14:17:38.107 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:02:22.733031+0000", 2020-04-22T14:17:38.107 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:17:38.107 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:17:38.107 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:17:38.107 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:17:38.107 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:17:38.108 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:17:38.108 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:17:38.108 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:17:38.108 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 8, 2020-04-22T14:17:38.108 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 8, 2020-04-22T14:17:38.108 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 8, 2020-04-22T14:17:38.108 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 8, 2020-04-22T14:17:38.109 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 8, 2020-04-22T14:17:38.109 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:17:38.109 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:17:38.109 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:17:38.109 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:17:38.109 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:17:38.109 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:17:38.110 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:17:38.110 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.110 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "20", 2020-04-22T14:17:38.111 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:17:38.112 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:17:38.112 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:17:38.112 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:17:38.113 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:17:38.113 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:17:38.113 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:17:38.113 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:17:38.113 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:17:38.113 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:17:38.113 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:17:38.114 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:17:38.114 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:17:38.114 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:17:38.114 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:17:38.114 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:17:38.114 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:17:38.115 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:17:38.115 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:17:38.115 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:17:38.115 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:17:38.115 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:17:38.115 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:17:38.116 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:17:38.116 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:17:38.116 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:17:38.116 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.117 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:17:38.117 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:17:38.117 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:17:38.117 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:17:38.118 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:17:38.118 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:17:38.118 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:17:38.118 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:17:38.118 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:17:38.118 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:17:38.119 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:17:38.119 INFO:teuthology.orchestra.run.smithi103.stdout: "options": {}, 2020-04-22T14:17:38.119 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:17:38.119 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd": {} 2020-04-22T14:17:38.119 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.119 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.119 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.120 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 21, 2020-04-22T14:17:38.120 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "cephfs_metadata", 2020-04-22T14:17:38.120 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:16:44.031424+0000", 2020-04-22T14:17:38.120 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:17:38.120 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:17:38.120 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:17:38.120 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:17:38.121 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:17:38.121 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:17:38.121 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:17:38.121 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:17:38.121 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 8, 2020-04-22T14:17:38.121 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 8, 2020-04-22T14:17:38.121 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 8, 2020-04-22T14:17:38.122 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 8, 2020-04-22T14:17:38.122 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 8, 2020-04-22T14:17:38.122 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:17:38.122 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:17:38.122 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:17:38.122 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:17:38.122 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:17:38.122 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:17:38.123 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:17:38.123 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.123 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "123", 2020-04-22T14:17:38.123 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:17:38.123 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:17:38.123 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:17:38.123 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:17:38.124 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:17:38.124 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:17:38.124 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:17:38.124 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:17:38.124 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:17:38.124 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:17:38.124 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:17:38.125 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:17:38.125 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:17:38.125 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:17:38.125 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:17:38.125 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:17:38.125 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:17:38.125 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:17:38.126 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:17:38.126 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:17:38.126 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:17:38.126 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:17:38.126 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:17:38.126 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:17:38.126 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:17:38.127 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:17:38.127 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.127 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:17:38.127 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:17:38.127 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:17:38.127 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:17:38.128 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:17:38.128 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:17:38.128 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:17:38.129 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:17:38.129 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:17:38.129 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:17:38.130 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:17:38.130 INFO:teuthology.orchestra.run.smithi103.stdout: "options": { 2020-04-22T14:17:38.131 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_bias": 4, 2020-04-22T14:17:38.131 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_min": 16, 2020-04-22T14:17:38.132 INFO:teuthology.orchestra.run.smithi103.stdout: "recovery_priority": 5 2020-04-22T14:17:38.132 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.132 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:17:38.132 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs": { 2020-04-22T14:17:38.132 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": "cephfs" 2020-04-22T14:17:38.133 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.133 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.133 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.134 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.134 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 22, 2020-04-22T14:17:38.135 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "cephfs_data", 2020-04-22T14:17:38.135 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:16:45.073910+0000", 2020-04-22T14:17:38.135 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:17:38.135 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:17:38.135 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:17:38.135 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:17:38.135 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:17:38.135 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:17:38.136 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:17:38.136 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:17:38.136 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 8, 2020-04-22T14:17:38.136 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 8, 2020-04-22T14:17:38.136 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 8, 2020-04-22T14:17:38.136 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 8, 2020-04-22T14:17:38.136 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 8, 2020-04-22T14:17:38.137 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:17:38.137 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:17:38.137 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:17:38.137 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:17:38.137 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:17:38.137 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:17:38.137 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:17:38.138 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.138 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "124", 2020-04-22T14:17:38.139 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:17:38.139 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:17:38.139 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:17:38.139 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:17:38.140 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:17:38.140 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:17:38.140 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:17:38.140 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:17:38.141 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:17:38.141 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:17:38.141 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:17:38.141 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:17:38.141 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:17:38.142 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:17:38.142 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:17:38.142 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:17:38.142 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:17:38.142 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:17:38.143 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:17:38.143 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:17:38.143 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:17:38.143 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:17:38.143 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:17:38.143 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:17:38.143 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:17:38.144 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:17:38.144 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.144 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:17:38.144 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:17:38.144 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:17:38.144 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:17:38.144 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:17:38.145 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:17:38.145 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:17:38.145 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:17:38.145 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:17:38.145 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:17:38.145 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:17:38.146 INFO:teuthology.orchestra.run.smithi103.stdout: "options": {}, 2020-04-22T14:17:38.146 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:17:38.146 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs": { 2020-04-22T14:17:38.146 INFO:teuthology.orchestra.run.smithi103.stdout: "data": "cephfs" 2020-04-22T14:17:38.146 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.146 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.146 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.146 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:17:38.147 INFO:teuthology.orchestra.run.smithi103.stdout: "osds": [ 2020-04-22T14:17:38.147 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.147 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 0, 2020-04-22T14:17:38.147 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "3546145b-bd93-4a79-b6fe-3158153b8f05", 2020-04-22T14:17:38.147 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:17:38.147 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:17:38.147 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:17:38.148 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:17:38.148 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:17:38.148 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:17:38.148 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:17:38.148 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 111, 2020-04-22T14:17:38.148 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:17:38.149 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:17:38.149 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:17:38.149 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:17:38.149 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.149 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:17:38.149 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6800", 2020-04-22T14:17:38.149 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:17:38.150 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.150 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.150 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:17:38.150 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6801", 2020-04-22T14:17:38.150 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:17:38.150 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.150 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:38.150 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.151 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:17:38.151 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:17:38.151 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.151 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:17:38.151 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6802", 2020-04-22T14:17:38.151 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:17:38.152 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.152 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.152 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:17:38.152 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6803", 2020-04-22T14:17:38.152 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:17:38.152 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.152 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:38.153 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.153 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:17:38.153 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:17:38.153 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.153 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:17:38.153 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6806", 2020-04-22T14:17:38.154 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:17:38.154 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.154 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.154 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:17:38.154 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6807", 2020-04-22T14:17:38.154 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:17:38.154 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.155 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:38.155 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.155 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:17:38.155 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:17:38.155 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.155 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:17:38.155 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6804", 2020-04-22T14:17:38.155 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:17:38.156 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.156 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.156 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:17:38.156 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6805", 2020-04-22T14:17:38.156 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:17:38.156 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.157 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:38.157 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.157 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6801/33072", 2020-04-22T14:17:38.157 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6803/33072", 2020-04-22T14:17:38.157 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6807/33072", 2020-04-22T14:17:38.157 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6805/33072", 2020-04-22T14:17:38.157 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:17:38.158 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:17:38.158 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:17:38.158 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:38.158 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.158 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.158 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 1, 2020-04-22T14:17:38.158 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "65ca5f7d-2ea6-4de6-a034-08a0a99aa80d", 2020-04-22T14:17:38.158 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:17:38.159 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:17:38.159 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:17:38.159 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:17:38.159 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:17:38.159 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:17:38.159 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:17:38.159 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 122, 2020-04-22T14:17:38.160 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:17:38.160 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:17:38.160 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:17:38.160 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:17:38.160 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.160 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:17:38.161 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6808", 2020-04-22T14:17:38.161 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:17:38.161 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.161 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.161 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:17:38.161 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6809", 2020-04-22T14:17:38.161 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:17:38.162 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.162 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:38.162 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.162 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:17:38.162 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:17:38.162 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.162 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:17:38.163 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6810", 2020-04-22T14:17:38.163 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:17:38.163 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.163 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.163 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:17:38.164 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6811", 2020-04-22T14:17:38.164 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:17:38.164 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.164 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:38.164 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.164 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:17:38.165 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:17:38.165 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.165 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:17:38.165 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6814", 2020-04-22T14:17:38.165 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:17:38.165 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.165 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.166 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:17:38.166 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6815", 2020-04-22T14:17:38.166 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:17:38.166 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.166 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:38.166 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.167 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:17:38.167 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:17:38.167 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.167 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:17:38.167 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6812", 2020-04-22T14:17:38.167 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:17:38.168 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.168 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.168 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:17:38.168 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6813", 2020-04-22T14:17:38.168 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:17:38.169 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.169 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:38.169 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.169 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6809/33103", 2020-04-22T14:17:38.169 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6811/33103", 2020-04-22T14:17:38.169 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6815/33103", 2020-04-22T14:17:38.169 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6813/33103", 2020-04-22T14:17:38.170 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:17:38.170 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:17:38.170 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:17:38.170 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:38.170 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.170 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.170 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 2, 2020-04-22T14:17:38.171 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "f2e9bf44-c844-48d7-b6c2-f08ea71189b4", 2020-04-22T14:17:38.171 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:17:38.171 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:17:38.172 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:17:38.172 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:17:38.172 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:17:38.172 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:17:38.173 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:17:38.173 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 121, 2020-04-22T14:17:38.173 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:17:38.173 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:17:38.174 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:17:38.174 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:17:38.174 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.174 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:17:38.174 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6816", 2020-04-22T14:17:38.174 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:17:38.174 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.175 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.175 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:17:38.175 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6817", 2020-04-22T14:17:38.175 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:17:38.175 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.175 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:38.175 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.176 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:17:38.176 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:17:38.176 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.176 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:17:38.176 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6818", 2020-04-22T14:17:38.176 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:17:38.177 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.177 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.177 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:17:38.177 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6819", 2020-04-22T14:17:38.177 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:17:38.177 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.177 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:38.177 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.178 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:17:38.178 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:17:38.178 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.178 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:17:38.178 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6822", 2020-04-22T14:17:38.178 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:17:38.178 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.179 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.179 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:17:38.179 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6823", 2020-04-22T14:17:38.179 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:17:38.179 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.179 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:38.179 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.180 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:17:38.180 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:17:38.180 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.180 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:17:38.180 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6820", 2020-04-22T14:17:38.180 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:17:38.180 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.180 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.181 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:17:38.181 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6821", 2020-04-22T14:17:38.181 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:17:38.181 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.181 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:38.181 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.181 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6817/33153", 2020-04-22T14:17:38.182 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6819/33153", 2020-04-22T14:17:38.182 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6823/33153", 2020-04-22T14:17:38.182 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6821/33153", 2020-04-22T14:17:38.182 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:17:38.182 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:17:38.182 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:17:38.182 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:38.183 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.183 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.183 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 3, 2020-04-22T14:17:38.183 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "0ab87fee-a427-4906-851a-b9bd8c2e5645", 2020-04-22T14:17:38.183 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:17:38.183 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:17:38.183 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:17:38.183 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:17:38.184 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:17:38.184 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:17:38.184 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:17:38.184 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 122, 2020-04-22T14:17:38.184 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:17:38.184 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:17:38.184 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:17:38.185 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:17:38.185 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.185 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:17:38.185 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6824", 2020-04-22T14:17:38.185 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:17:38.185 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.185 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.186 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:17:38.186 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6825", 2020-04-22T14:17:38.186 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:17:38.186 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.186 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:38.186 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.186 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:17:38.186 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:17:38.187 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.187 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:17:38.187 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6826", 2020-04-22T14:17:38.187 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:17:38.187 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.187 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.187 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:17:38.188 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6827", 2020-04-22T14:17:38.188 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:17:38.188 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.188 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:38.188 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.188 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:17:38.188 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:17:38.189 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.189 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:17:38.189 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6830", 2020-04-22T14:17:38.189 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:17:38.189 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.189 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.189 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:17:38.189 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6831", 2020-04-22T14:17:38.190 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:17:38.190 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.190 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:38.190 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.190 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:17:38.190 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:17:38.190 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.191 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:17:38.191 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6828", 2020-04-22T14:17:38.191 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:17:38.191 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.191 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.191 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:17:38.192 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6829", 2020-04-22T14:17:38.192 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:17:38.192 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.192 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:38.192 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.192 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6825/33183", 2020-04-22T14:17:38.192 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6827/33183", 2020-04-22T14:17:38.193 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6831/33183", 2020-04-22T14:17:38.193 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6829/33183", 2020-04-22T14:17:38.193 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:17:38.193 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:17:38.193 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:17:38.193 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:38.193 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.194 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.194 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 4, 2020-04-22T14:17:38.194 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "2565df7d-2eff-484b-a3cd-ed7715e5d875", 2020-04-22T14:17:38.194 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:17:38.194 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:17:38.194 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:17:38.194 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:17:38.194 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:17:38.195 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:17:38.195 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:17:38.195 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 122, 2020-04-22T14:17:38.195 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:17:38.195 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:17:38.195 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:17:38.195 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:17:38.196 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.196 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:17:38.196 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6802", 2020-04-22T14:17:38.196 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:17:38.196 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.196 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.196 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:17:38.196 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6803", 2020-04-22T14:17:38.197 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:17:38.197 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.197 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:38.197 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.197 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:17:38.197 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:17:38.197 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.198 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:17:38.198 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6804", 2020-04-22T14:17:38.198 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:17:38.198 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.198 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.198 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:17:38.198 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6805", 2020-04-22T14:17:38.198 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:17:38.199 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.199 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:38.199 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.199 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:17:38.199 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:17:38.199 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.199 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:17:38.200 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6808", 2020-04-22T14:17:38.200 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:17:38.200 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.200 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.200 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:17:38.200 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6809", 2020-04-22T14:17:38.200 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:17:38.201 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.201 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:38.201 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.201 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:17:38.201 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:17:38.201 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.201 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:17:38.201 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6806", 2020-04-22T14:17:38.202 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:17:38.202 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.202 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.202 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:17:38.202 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6807", 2020-04-22T14:17:38.202 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:17:38.202 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.203 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:38.203 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.203 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6803/33506", 2020-04-22T14:17:38.203 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6805/33506", 2020-04-22T14:17:38.203 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6809/33506", 2020-04-22T14:17:38.203 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6807/33506", 2020-04-22T14:17:38.203 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:17:38.203 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:17:38.204 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:17:38.204 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:38.204 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.204 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.204 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 5, 2020-04-22T14:17:38.204 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "bcfd7a16-6914-4152-8647-a481917fe19d", 2020-04-22T14:17:38.204 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:17:38.205 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:17:38.205 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:17:38.205 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:17:38.205 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:17:38.205 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:17:38.205 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:17:38.205 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 122, 2020-04-22T14:17:38.205 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:17:38.206 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:17:38.206 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:17:38.206 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:17:38.206 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.206 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:17:38.206 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6810", 2020-04-22T14:17:38.206 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:17:38.207 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.207 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.207 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:17:38.207 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6811", 2020-04-22T14:17:38.207 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:17:38.207 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.207 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:38.207 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.208 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:17:38.208 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:17:38.208 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.208 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:17:38.208 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6812", 2020-04-22T14:17:38.208 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:17:38.208 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.209 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.209 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:17:38.209 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6813", 2020-04-22T14:17:38.209 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:17:38.209 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.209 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:38.209 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.209 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:17:38.210 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:17:38.210 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.210 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:17:38.210 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6816", 2020-04-22T14:17:38.210 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:17:38.210 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.210 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.211 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:17:38.211 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6817", 2020-04-22T14:17:38.211 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:17:38.211 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.211 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:38.211 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.211 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:17:38.211 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:17:38.212 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.212 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:17:38.212 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6814", 2020-04-22T14:17:38.212 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:17:38.212 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.212 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.212 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:17:38.213 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6815", 2020-04-22T14:17:38.213 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:17:38.213 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.213 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:38.213 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.213 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6811/33554", 2020-04-22T14:17:38.213 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6813/33554", 2020-04-22T14:17:38.213 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6817/33554", 2020-04-22T14:17:38.214 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6815/33554", 2020-04-22T14:17:38.214 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:17:38.214 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:17:38.214 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:17:38.214 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:38.214 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.214 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.215 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 6, 2020-04-22T14:17:38.215 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050", 2020-04-22T14:17:38.215 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:17:38.215 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:17:38.215 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:17:38.215 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:17:38.215 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:17:38.215 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:17:38.216 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:17:38.216 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 122, 2020-04-22T14:17:38.216 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:17:38.216 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:17:38.216 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:17:38.216 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:17:38.216 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.217 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:17:38.217 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6818", 2020-04-22T14:17:38.217 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:17:38.217 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.217 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.217 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:17:38.217 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6819", 2020-04-22T14:17:38.217 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:17:38.218 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.218 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:38.218 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.218 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:17:38.218 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:17:38.218 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.218 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:17:38.219 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6820", 2020-04-22T14:17:38.219 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:17:38.219 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.219 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.219 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:17:38.219 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6821", 2020-04-22T14:17:38.219 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:17:38.219 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.220 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:38.220 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.220 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:17:38.220 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:17:38.220 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.220 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:17:38.220 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6824", 2020-04-22T14:17:38.221 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:17:38.221 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.221 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.221 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:17:38.221 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6825", 2020-04-22T14:17:38.221 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:17:38.221 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.222 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:38.222 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.222 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:17:38.222 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:17:38.222 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.222 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:17:38.222 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6822", 2020-04-22T14:17:38.222 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:17:38.223 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.223 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.223 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:17:38.223 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6823", 2020-04-22T14:17:38.223 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:17:38.223 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.223 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:38.224 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.224 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6819/33601", 2020-04-22T14:17:38.224 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6821/33601", 2020-04-22T14:17:38.224 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6825/33601", 2020-04-22T14:17:38.224 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6823/33601", 2020-04-22T14:17:38.224 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:17:38.224 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:17:38.225 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:17:38.225 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:38.225 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.225 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.225 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 7, 2020-04-22T14:17:38.225 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "340eece1-4c39-47cd-b95f-9cfa5dcfe361", 2020-04-22T14:17:38.225 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:17:38.226 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:17:38.226 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:17:38.226 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:17:38.226 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:17:38.226 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:17:38.226 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:17:38.226 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 121, 2020-04-22T14:17:38.226 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:17:38.227 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:17:38.227 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:17:38.227 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:17:38.227 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.227 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:17:38.227 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6826", 2020-04-22T14:17:38.227 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:17:38.228 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.228 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.228 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:17:38.228 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6827", 2020-04-22T14:17:38.228 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:17:38.228 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.228 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:38.229 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.229 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:17:38.229 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:17:38.229 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.229 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:17:38.229 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6828", 2020-04-22T14:17:38.229 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:17:38.229 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.230 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.230 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:17:38.230 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6829", 2020-04-22T14:17:38.230 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:17:38.230 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.230 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:38.230 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.231 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:17:38.231 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:17:38.231 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.231 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:17:38.231 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6832", 2020-04-22T14:17:38.231 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:17:38.231 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.231 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.232 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:17:38.232 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6833", 2020-04-22T14:17:38.232 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:17:38.232 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.232 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:38.232 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.232 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:17:38.233 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:17:38.233 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.233 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:17:38.233 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6830", 2020-04-22T14:17:38.233 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:17:38.233 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.233 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.233 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:17:38.234 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6831", 2020-04-22T14:17:38.234 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:17:38.234 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.234 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:38.234 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.234 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6827/33629", 2020-04-22T14:17:38.234 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6829/33629", 2020-04-22T14:17:38.235 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6833/33629", 2020-04-22T14:17:38.235 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6831/33629", 2020-04-22T14:17:38.235 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:17:38.235 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:17:38.235 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:17:38.235 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:38.235 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.236 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:17:38.236 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_xinfo": [ 2020-04-22T14:17:38.236 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.236 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 0, 2020-04-22T14:17:38.236 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:17:38.236 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:17:38.237 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:17:38.237 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:17:38.237 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:17:38.237 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.384360+0000", 2020-04-22T14:17:38.237 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:17:38.237 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.237 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.238 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 1, 2020-04-22T14:17:38.238 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:17:38.238 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:17:38.238 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:17:38.238 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:17:38.238 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:17:38.238 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.503590+0000", 2020-04-22T14:17:38.238 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:17:38.239 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.239 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.239 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 2, 2020-04-22T14:17:38.239 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:17:38.239 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:17:38.239 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:17:38.239 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:17:38.240 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:17:38.240 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.525058+0000", 2020-04-22T14:17:38.240 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:17:38.240 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.240 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.240 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 3, 2020-04-22T14:17:38.240 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:17:38.240 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:17:38.241 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:17:38.241 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:17:38.241 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:17:38.241 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.599729+0000", 2020-04-22T14:17:38.241 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:17:38.241 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.241 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.242 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 4, 2020-04-22T14:17:38.242 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:17:38.242 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:17:38.242 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:17:38.242 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:17:38.242 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:17:38.243 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.600919+0000", 2020-04-22T14:17:38.243 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:17:38.243 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.243 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.243 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 5, 2020-04-22T14:17:38.243 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:17:38.244 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:17:38.244 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:17:38.244 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:17:38.244 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:17:38.244 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.654718+0000", 2020-04-22T14:17:38.244 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:17:38.244 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.245 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.245 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 6, 2020-04-22T14:17:38.245 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:17:38.245 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:17:38.245 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:17:38.245 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:17:38.245 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:17:38.246 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.718342+0000", 2020-04-22T14:17:38.246 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:17:38.246 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.246 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:38.246 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 7, 2020-04-22T14:17:38.246 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:17:38.246 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:17:38.247 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:17:38.247 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:17:38.247 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:17:38.247 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.839089+0000", 2020-04-22T14:17:38.247 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:17:38.247 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.247 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:17:38.247 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_upmap": [], 2020-04-22T14:17:38.248 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_upmap_items": [], 2020-04-22T14:17:38.248 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_temp": [], 2020-04-22T14:17:38.248 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_temp": [], 2020-04-22T14:17:38.248 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklist": { 2020-04-22T14:17:38.248 INFO:teuthology.orchestra.run.smithi103.stdout: "192.168.0.1:0/546260275": "2020-04-22T15:17:09.024514+0000" 2020-04-22T14:17:38.248 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.248 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profiles": { 2020-04-22T14:17:38.249 INFO:teuthology.orchestra.run.smithi103.stdout: "default": { 2020-04-22T14:17:38.249 INFO:teuthology.orchestra.run.smithi103.stdout: "crush-failure-domain": "osd", 2020-04-22T14:17:38.249 INFO:teuthology.orchestra.run.smithi103.stdout: "k": "2", 2020-04-22T14:17:38.249 INFO:teuthology.orchestra.run.smithi103.stdout: "m": "1", 2020-04-22T14:17:38.249 INFO:teuthology.orchestra.run.smithi103.stdout: "plugin": "jerasure", 2020-04-22T14:17:38.249 INFO:teuthology.orchestra.run.smithi103.stdout: "ruleset-failure-domain": "osd", 2020-04-22T14:17:38.249 INFO:teuthology.orchestra.run.smithi103.stdout: "technique": "reed_sol_van" 2020-04-22T14:17:38.249 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:38.250 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:38.250 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps_queue": [], 2020-04-22T14:17:38.250 INFO:teuthology.orchestra.run.smithi103.stdout: "new_removed_snaps": [], 2020-04-22T14:17:38.250 INFO:teuthology.orchestra.run.smithi103.stdout: "new_purged_snaps": [], 2020-04-22T14:17:38.250 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_node_flags": {}, 2020-04-22T14:17:38.250 INFO:teuthology.orchestra.run.smithi103.stdout: "device_class_flags": {} 2020-04-22T14:17:38.250 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:17:38.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.078+0000 7faf246f5700 1 -- 172.21.15.103:0/2564666330 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faefc04d8b0 msgr2=0x7faefc04fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:38.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.078+0000 7faf246f5700 1 --2- 172.21.15.103:0/2564666330 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faefc04d8b0 0x7faefc04fd70 secure :-1 s=READY pgs=673 cs=0 l=1 rx=0x7faf18002f30 tx=0x7faf180121e0).stop 2020-04-22T14:17:38.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.078+0000 7faf246f5700 1 -- 172.21.15.103:0/2564666330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf1c1279a0 msgr2=0x7faf1c0b0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:38.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.078+0000 7faf246f5700 1 --2- 172.21.15.103:0/2564666330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf1c1279a0 0x7faf1c0b0be0 secure :-1 s=READY pgs=1841 cs=0 l=1 rx=0x7faf1c0613e0 tx=0x7faf0c010c80).stop 2020-04-22T14:17:38.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.078+0000 7faf246f5700 1 -- 172.21.15.103:0/2564666330 shutdown_connections 2020-04-22T14:17:38.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.078+0000 7faf246f5700 1 --2- 172.21.15.103:0/2564666330 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faefc04d8b0 0x7faefc04fd70 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:38.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.078+0000 7faf246f5700 1 --2- 172.21.15.103:0/2564666330 >> v2:172.21.15.86:3300/0 conn(0x7faf1c0af180 0x7faf1c151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:38.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.078+0000 7faf246f5700 1 --2- 172.21.15.103:0/2564666330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf1c1279a0 0x7faf1c0b0be0 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:38.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.078+0000 7faf246f5700 1 --2- 172.21.15.103:0/2564666330 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faf1c0b1040 0x7faf1c0aed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:38.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.078+0000 7faf246f5700 1 -- 172.21.15.103:0/2564666330 >> 172.21.15.103:0/2564666330 conn(0x7faf1c0b9160 msgr2=0x7faf1c064260 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:38.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.079+0000 7faf246f5700 1 -- 172.21.15.103:0/2564666330 shutdown_connections 2020-04-22T14:17:38.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.079+0000 7faf246f5700 1 -- 172.21.15.103:0/2564666330 wait complete. 2020-04-22T14:17:38.255 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:38.268 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:17:38.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.413+0000 7f6986f0d700 1 Processor -- start 2020-04-22T14:17:38.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.413+0000 7f6986f0d700 1 -- start start 2020-04-22T14:17:38.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.414+0000 7f6986f0d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6980065fe0 0x7f69801464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:38.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.414+0000 7f6986f0d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6980143300 con 0x7f698012c0d0 2020-04-22T14:17:38.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.414+0000 7f6986f0d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69801435a0 con 0x7f6980063e30 2020-04-22T14:17:38.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.414+0000 7f6986f0d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6980143840 con 0x7f6980065fe0 2020-04-22T14:17:38.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.414+0000 7f69854aa700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f6980063e30 0x7f69800642a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49402/0 (socket says 172.21.15.103:49402) 2020-04-22T14:17:38.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.414+0000 7f69854aa700 1 -- 172.21.15.103:0/2423143240 learned_addr learned my addr 172.21.15.103:0/2423143240 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:17:38.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.414+0000 7f697ffff700 1 --2- 172.21.15.103:0/2423143240 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6980065fe0 0x7f69801464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:38.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.414+0000 7f697f7fe700 1 -- 172.21.15.103:0/2423143240 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2257886953 0 0) 0x7f69801435a0 con 0x7f6980063e30 2020-04-22T14:17:38.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.414+0000 7f697f7fe700 1 -- 172.21.15.103:0/2423143240 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f696c003230 con 0x7f6980063e30 2020-04-22T14:17:38.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.415+0000 7f697f7fe700 1 -- 172.21.15.103:0/2423143240 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2835571921 0 0) 0x7f696c003230 con 0x7f6980063e30 2020-04-22T14:17:38.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.415+0000 7f697f7fe700 1 -- 172.21.15.103:0/2423143240 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6980065fe0 msgr2=0x7f69801464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:38.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.415+0000 7f697f7fe700 1 --2- 172.21.15.103:0/2423143240 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6980065fe0 0x7f69801464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:38.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.415+0000 7f697f7fe700 1 -- 172.21.15.103:0/2423143240 >> v1:172.21.15.86:6789/0 conn(0x7f698012c0d0 legacy=0x7f698005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:38.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.415+0000 7f697f7fe700 1 -- 172.21.15.103:0/2423143240 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f698005bb50 con 0x7f6980063e30 2020-04-22T14:17:38.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.415+0000 7f697f7fe700 1 -- 172.21.15.103:0/2423143240 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f6978001a90 con 0x7f6980063e30 2020-04-22T14:17:38.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.415+0000 7f697f7fe700 1 -- 172.21.15.103:0/2423143240 >> v1:172.21.15.103:6789/0 conn(0x7f6980063e30 legacy=0x7f69800642a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:38.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.415+0000 7f697f7fe700 1 --2- 172.21.15.103:0/2423143240 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6980065fe0 0x7f696c003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:38.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.415+0000 7f697f7fe700 1 --2- 172.21.15.103:0/2423143240 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f696c003b80 0x7f696c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:38.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.415+0000 7f697f7fe700 1 --2- 172.21.15.103:0/2423143240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f696c0045c0 0x7f696c004a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:38.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.415+0000 7f697f7fe700 1 -- 172.21.15.103:0/2423143240 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6980143840 con 0x7f696c003b80 2020-04-22T14:17:38.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.415+0000 7f697f7fe700 1 -- 172.21.15.103:0/2423143240 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696c005000 con 0x7f696c0045c0 2020-04-22T14:17:38.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.415+0000 7f697f7fe700 1 -- 172.21.15.103:0/2423143240 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696c0051c0 con 0x7f6980065fe0 2020-04-22T14:17:38.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.415+0000 7f69854aa700 1 --2- 172.21.15.103:0/2423143240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f696c0045c0 0x7f696c004a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:38.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.415+0000 7f6984ca9700 1 --2- 172.21.15.103:0/2423143240 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6980065fe0 0x7f696c003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:38.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.415+0000 7f697ffff700 1 --2- 172.21.15.103:0/2423143240 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f696c003b80 0x7f696c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:38.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.415+0000 7f69854aa700 1 -- 172.21.15.103:0/2423143240 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6980065fe0 msgr2=0x7f696c003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:38.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.415+0000 7f69854aa700 1 --2- 172.21.15.103:0/2423143240 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6980065fe0 0x7f696c003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:38.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.415+0000 7f69854aa700 1 -- 172.21.15.103:0/2423143240 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f696c003b80 msgr2=0x7f696c003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:38.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.415+0000 7f69854aa700 1 --2- 172.21.15.103:0/2423143240 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f696c003b80 0x7f696c003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:38.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.415+0000 7f69854aa700 1 -- 172.21.15.103:0/2423143240 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696c003230 con 0x7f696c0045c0 2020-04-22T14:17:38.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.415+0000 7f697ffff700 1 --2- 172.21.15.103:0/2423143240 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f696c003b80 0x7f696c003fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:17:38.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.415+0000 7f69854aa700 1 --2- 172.21.15.103:0/2423143240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f696c0045c0 0x7f696c004a50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f69780017a0 tx=0x7f698005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:38.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.415+0000 7f69854aa700 1 --2- 172.21.15.103:0/2423143240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f696c0045c0 0x7f696c004a50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f69780017a0 tx=0x7f698005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:38.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.415+0000 7f69854aa700 1 --2- 172.21.15.103:0/2423143240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f696c0045c0 0x7f696c004a50 secure :-1 s=READY pgs=1843 cs=0 l=1 rx=0x7f69780017a0 tx=0x7f698005bce0).ready entity=mon.1 client_cookie=63ded27d64207dd1 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:38.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.415+0000 7f69854aa700 1 --2- 172.21.15.103:0/2423143240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f696c0045c0 0x7f696c004a50 secure :-1 s=THROTTLE_DONE pgs=1843 cs=0 l=1 rx=0x7f69780017a0 tx=0x7f698005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:38.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.415+0000 7f697f7fe700 1 -- 172.21.15.103:0/2423143240 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6978005d40 con 0x7f696c0045c0 2020-04-22T14:17:38.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.415+0000 7f69854aa700 1 --2- 172.21.15.103:0/2423143240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f696c0045c0 0x7f696c004a50 secure :-1 s=THROTTLE_DONE pgs=1843 cs=0 l=1 rx=0x7f69780017a0 tx=0x7f698005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:38.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.415+0000 7f69854aa700 1 --2- 172.21.15.103:0/2423143240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f696c0045c0 0x7f696c004a50 secure :-1 s=THROTTLE_DONE pgs=1843 cs=0 l=1 rx=0x7f69780017a0 tx=0x7f698005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:38.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.415+0000 7f697f7fe700 1 -- 172.21.15.103:0/2423143240 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6978004d20 con 0x7f696c0045c0 2020-04-22T14:17:38.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.415+0000 7f697f7fe700 1 -- 172.21.15.103:0/2423143240 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6978005100 con 0x7f696c0045c0 2020-04-22T14:17:38.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.415+0000 7f6986f0d700 1 -- 172.21.15.103:0/2423143240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f696c0045c0 msgr2=0x7f696c004a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:38.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.415+0000 7f6986f0d700 1 --2- 172.21.15.103:0/2423143240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f696c0045c0 0x7f696c004a50 secure :-1 s=READY pgs=1843 cs=0 l=1 rx=0x7f69780017a0 tx=0x7f698005bce0).stop 2020-04-22T14:17:38.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.415+0000 7f69854aa700 1 -- 172.21.15.103:0/2423143240 reap_dead start 2020-04-22T14:17:38.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.416+0000 7f6986f0d700 1 -- 172.21.15.103:0/2423143240 shutdown_connections 2020-04-22T14:17:38.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.416+0000 7f6986f0d700 1 -- 172.21.15.103:0/2423143240 >> 172.21.15.103:0/2423143240 conn(0x7f69800b9160 msgr2=0x7f698005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:38.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.416+0000 7f6986f0d700 1 -- 172.21.15.103:0/2423143240 shutdown_connections 2020-04-22T14:17:38.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.416+0000 7f6986f0d700 1 -- 172.21.15.103:0/2423143240 wait complete. 2020-04-22T14:17:38.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.417+0000 7f6986f0d700 1 Processor -- start 2020-04-22T14:17:38.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.417+0000 7f6986f0d700 1 -- start start 2020-04-22T14:17:38.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.418+0000 7f6986f0d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f698012a7b0 0x7f698011e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:38.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.418+0000 7f6986f0d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6980157e60 con 0x7f698012d4b0 2020-04-22T14:17:38.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.418+0000 7f6986f0d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f698011ef00 con 0x7f69801579b0 2020-04-22T14:17:38.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.418+0000 7f6986f0d700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69801428b0 con 0x7f698012a7b0 2020-04-22T14:17:38.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.418+0000 7f6984ca9700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f698012a7b0 0x7f698011e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:38.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.418+0000 7f697ffff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f69801579b0 0x7f6980128e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49416/0 (socket says 172.21.15.103:49416) 2020-04-22T14:17:38.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.418+0000 7f6984ca9700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f698012a7b0 0x7f698011e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57224/0 (socket says 172.21.15.103:57224) 2020-04-22T14:17:38.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.418+0000 7f697ffff700 1 -- 172.21.15.103:0/2830599833 learned_addr learned my addr 172.21.15.103:0/2830599833 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:17:38.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.418+0000 7f6984ca9700 1 -- 172.21.15.103:0/2830599833 >> v1:172.21.15.103:6789/0 conn(0x7f69801579b0 legacy=0x7f6980128e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:38.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.418+0000 7f697dffb700 1 -- 172.21.15.103:0/2830599833 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2701885313 0 0) 0x7f698011ef00 con 0x7f69801579b0 2020-04-22T14:17:38.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.418+0000 7f6984ca9700 1 -- 172.21.15.103:0/2830599833 >> v1:172.21.15.86:6789/0 conn(0x7f698012d4b0 legacy=0x7f698012d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:38.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.418+0000 7f6984ca9700 1 -- 172.21.15.103:0/2830599833 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f698011f1a0 con 0x7f698012a7b0 2020-04-22T14:17:38.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.418+0000 7f6984ca9700 1 --2- 172.21.15.103:0/2830599833 >> v2:172.21.15.103:3300/0 conn(0x7f698012a7b0 0x7f698011e980 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f69800613e0 tx=0x7f6970003e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:38.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.418+0000 7f6984ca9700 1 --2- 172.21.15.103:0/2830599833 >> v2:172.21.15.103:3300/0 conn(0x7f698012a7b0 0x7f698011e980 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f69800613e0 tx=0x7f6970003e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:38.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.418+0000 7f6984ca9700 1 --2- 172.21.15.103:0/2830599833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f698012a7b0 0x7f698011e980 secure :-1 s=READY pgs=1845 cs=0 l=1 rx=0x7f69800613e0 tx=0x7f6970003e90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:38.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.418+0000 7f6984ca9700 1 --2- 172.21.15.103:0/2830599833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f698012a7b0 0x7f698011e980 secure :-1 s=THROTTLE_DONE pgs=1845 cs=0 l=1 rx=0x7f69800613e0 tx=0x7f6970003e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:38.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.418+0000 7f697dffb700 1 -- 172.21.15.103:0/2830599833 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6970001e70 con 0x7f698012a7b0 2020-04-22T14:17:38.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.418+0000 7f6984ca9700 1 --2- 172.21.15.103:0/2830599833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f698012a7b0 0x7f698011e980 secure :-1 s=THROTTLE_DONE pgs=1845 cs=0 l=1 rx=0x7f69800613e0 tx=0x7f6970003e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:38.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.418+0000 7f697dffb700 1 -- 172.21.15.103:0/2830599833 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6970012600 con 0x7f698012a7b0 2020-04-22T14:17:38.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.418+0000 7f6984ca9700 1 --2- 172.21.15.103:0/2830599833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f698012a7b0 0x7f698011e980 secure :-1 s=THROTTLE_DONE pgs=1845 cs=0 l=1 rx=0x7f69800613e0 tx=0x7f6970003e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:38.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.418+0000 7f6986f0d700 1 -- 172.21.15.103:0/2830599833 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f698012ab90 con 0x7f698012a7b0 2020-04-22T14:17:38.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.418+0000 7f697dffb700 1 -- 172.21.15.103:0/2830599833 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69700129a0 con 0x7f698012a7b0 2020-04-22T14:17:38.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.418+0000 7f6986f0d700 1 -- 172.21.15.103:0/2830599833 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6980129730 con 0x7f698012a7b0 2020-04-22T14:17:38.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.419+0000 7f6984ca9700 1 --2- 172.21.15.103:0/2830599833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f698012a7b0 0x7f698011e980 secure :-1 s=THROTTLE_DONE pgs=1845 cs=0 l=1 rx=0x7f69800613e0 tx=0x7f6970003e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:38.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.419+0000 7f6986f0d700 1 -- 172.21.15.103:0/2830599833 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6980056c90 con 0x7f698012a7b0 2020-04-22T14:17:38.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.419+0000 7f697dffb700 1 -- 172.21.15.103:0/2830599833 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f6970012ba0 con 0x7f698012a7b0 2020-04-22T14:17:38.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.419+0000 7f6984ca9700 1 --2- 172.21.15.103:0/2830599833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f698012a7b0 0x7f698011e980 secure :-1 s=THROTTLE_DONE pgs=1845 cs=0 l=1 rx=0x7f69800613e0 tx=0x7f6970003e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:38.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.420+0000 7f697dffb700 1 --2- 172.21.15.103:0/2830599833 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f696004d740 0x7f696004fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:38.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.420+0000 7f697dffb700 1 -- 172.21.15.103:0/2830599833 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f6970060f70 con 0x7f698012a7b0 2020-04-22T14:17:38.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.420+0000 7f697ffff700 1 --2- 172.21.15.103:0/2830599833 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f696004d740 0x7f696004fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:38.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.420+0000 7f697ffff700 1 --2- 172.21.15.103:0/2830599833 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f696004d740 0x7f696004fc00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6974007ed0 tx=0x7f697400c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:38.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.420+0000 7f697ffff700 1 --2- 172.21.15.103:0/2830599833 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f696004d740 0x7f696004fc00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6974007ed0 tx=0x7f697400c820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:38.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.420+0000 7f697ffff700 1 --2- 172.21.15.103:0/2830599833 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f696004d740 0x7f696004fc00 secure :-1 s=READY pgs=674 cs=0 l=1 rx=0x7f6974007ed0 tx=0x7f697400c820).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:38.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.424+0000 7f6984ca9700 1 --2- 172.21.15.103:0/2830599833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f698012a7b0 0x7f698011e980 secure :-1 s=THROTTLE_DONE pgs=1845 cs=0 l=1 rx=0x7f69800613e0 tx=0x7f6970003e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:38.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.424+0000 7f697dffb700 1 -- 172.21.15.103:0/2830599833 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f697003c350 con 0x7f698012a7b0 2020-04-22T14:17:38.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.614+0000 7f6986f0d700 1 -- 172.21.15.103:0/2830599833 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6980147360 con 0x7f698012a7b0 2020-04-22T14:17:38.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.614+0000 7f6984ca9700 1 --2- 172.21.15.103:0/2830599833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f698012a7b0 0x7f698011e980 secure :-1 s=THROTTLE_DONE pgs=1845 cs=0 l=1 rx=0x7f69800613e0 tx=0x7f6970003e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:38.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.614+0000 7f697dffb700 1 -- 172.21.15.103:0/2830599833 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+2145 (secure 0 0 0) 0x7f6970012080 con 0x7f698012a7b0 2020-04-22T14:17:38.618 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:17:38.618 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":94,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6380,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/1697822737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1697822737},{"type":"v1","addr":"172.21.15.103:6833","nonce":1697822737}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":91}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:16:46.111567+0000","modified":"2020-04-22T14:16:48.114069+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8142},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8142":{"gid":8142,"name":"b","rank":0,"incarnation":92,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/3334539524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3334539524},{"type":"v1","addr":"172.21.15.86:6835","nonce":3334539524}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2020-04-22T14:17:38.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.616+0000 7f6986f0d700 1 -- 172.21.15.103:0/2830599833 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f696004d740 msgr2=0x7f696004fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:38.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.616+0000 7f6986f0d700 1 --2- 172.21.15.103:0/2830599833 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f696004d740 0x7f696004fc00 secure :-1 s=READY pgs=674 cs=0 l=1 rx=0x7f6974007ed0 tx=0x7f697400c820).stop 2020-04-22T14:17:38.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.616+0000 7f6986f0d700 1 -- 172.21.15.103:0/2830599833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f698012a7b0 msgr2=0x7f698011e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:38.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.616+0000 7f6986f0d700 1 --2- 172.21.15.103:0/2830599833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f698012a7b0 0x7f698011e980 secure :-1 s=READY pgs=1845 cs=0 l=1 rx=0x7f69800613e0 tx=0x7f6970003e90).stop 2020-04-22T14:17:38.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.616+0000 7f6986f0d700 1 -- 172.21.15.103:0/2830599833 shutdown_connections 2020-04-22T14:17:38.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.616+0000 7f6986f0d700 1 --2- 172.21.15.103:0/2830599833 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f696004d740 0x7f696004fc00 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:38.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.616+0000 7f6986f0d700 1 --2- 172.21.15.103:0/2830599833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f698012a7b0 0x7f698011e980 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:38.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.616+0000 7f6986f0d700 1 -- 172.21.15.103:0/2830599833 >> 172.21.15.103:0/2830599833 conn(0x7f69800b9160 msgr2=0x7f6980064c50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:38.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.616+0000 7f6986f0d700 1 -- 172.21.15.103:0/2830599833 shutdown_connections 2020-04-22T14:17:38.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.616+0000 7f6986f0d700 1 -- 172.21.15.103:0/2830599833 wait complete. 2020-04-22T14:17:38.621 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 94 2020-04-22T14:17:38.629 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:38.642 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2020-04-22T14:17:38.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.787+0000 7f1c44ad3700 1 Processor -- start 2020-04-22T14:17:38.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.787+0000 7f1c44ad3700 1 -- start start 2020-04-22T14:17:38.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.787+0000 7f1c44ad3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1c400b2530 0x7f1c400b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:38.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.787+0000 7f1c44ad3700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c400b0e90 con 0x7f1c400b4320 2020-04-22T14:17:38.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.787+0000 7f1c44ad3700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c400b1130 con 0x7f1c400b4700 2020-04-22T14:17:38.791 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.787+0000 7f1c44ad3700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c400b2a90 con 0x7f1c400b2530 2020-04-22T14:17:38.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.788+0000 7f1c3ed9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1c400b2530 0x7f1c400b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:38.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.788+0000 7f1c3dd9b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f1c400b4700 0x7f1c400afa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49422/0 (socket says 172.21.15.103:49422) 2020-04-22T14:17:38.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.788+0000 7f1c3dd9b700 1 -- 172.21.15.103:0/2045042823 learned_addr learned my addr 172.21.15.103:0/2045042823 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:17:38.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.788+0000 7f1c3ed9d700 1 -- 172.21.15.103:0/2045042823 >> v1:172.21.15.103:6789/0 conn(0x7f1c400b4700 legacy=0x7f1c400afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:38.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.788+0000 7f1c3ed9d700 1 -- 172.21.15.103:0/2045042823 >> v1:172.21.15.86:6789/0 conn(0x7f1c400b4320 legacy=0x7f1c400b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:38.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.788+0000 7f1c3ed9d700 1 -- 172.21.15.103:0/2045042823 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c400b1ce0 con 0x7f1c400b2530 2020-04-22T14:17:38.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.788+0000 7f1c3ed9d700 1 --2- 172.21.15.103:0/2045042823 >> v2:172.21.15.103:3300/0 conn(0x7f1c400b2530 0x7f1c400b0170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1c400af970 tx=0x7f1c38007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:38.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.788+0000 7f1c3ed9d700 1 --2- 172.21.15.103:0/2045042823 >> v2:172.21.15.103:3300/0 conn(0x7f1c400b2530 0x7f1c400b0170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1c400af970 tx=0x7f1c38007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:38.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.788+0000 7f1c3ed9d700 1 --2- 172.21.15.103:0/2045042823 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c400b2530 0x7f1c400b0170 secure :-1 s=READY pgs=1847 cs=0 l=1 rx=0x7f1c400af970 tx=0x7f1c38007dc0).ready entity=mon.1 client_cookie=63e40b7a91ce399 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:38.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.788+0000 7f1c3ed9d700 1 --2- 172.21.15.103:0/2045042823 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c400b2530 0x7f1c400b0170 secure :-1 s=THROTTLE_DONE pgs=1847 cs=0 l=1 rx=0x7f1c400af970 tx=0x7f1c38007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:38.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.788+0000 7f1c3d59a700 1 -- 172.21.15.103:0/2045042823 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c38011e90 con 0x7f1c400b2530 2020-04-22T14:17:38.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.788+0000 7f1c3ed9d700 1 --2- 172.21.15.103:0/2045042823 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c400b2530 0x7f1c400b0170 secure :-1 s=THROTTLE_DONE pgs=1847 cs=0 l=1 rx=0x7f1c400af970 tx=0x7f1c38007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:38.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.788+0000 7f1c3d59a700 1 -- 172.21.15.103:0/2045042823 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3800a180 con 0x7f1c400b2530 2020-04-22T14:17:38.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.788+0000 7f1c3ed9d700 1 --2- 172.21.15.103:0/2045042823 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c400b2530 0x7f1c400b0170 secure :-1 s=THROTTLE_DONE pgs=1847 cs=0 l=1 rx=0x7f1c400af970 tx=0x7f1c38007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:38.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.789+0000 7f1c3d59a700 1 -- 172.21.15.103:0/2045042823 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c3800a5a0 con 0x7f1c400b2530 2020-04-22T14:17:38.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.789+0000 7f1c44ad3700 1 -- 172.21.15.103:0/2045042823 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c400b2530 msgr2=0x7f1c400b0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:38.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.789+0000 7f1c44ad3700 1 --2- 172.21.15.103:0/2045042823 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c400b2530 0x7f1c400b0170 secure :-1 s=READY pgs=1847 cs=0 l=1 rx=0x7f1c400af970 tx=0x7f1c38007dc0).stop 2020-04-22T14:17:38.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.789+0000 7f1c44ad3700 1 -- 172.21.15.103:0/2045042823 shutdown_connections 2020-04-22T14:17:38.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.789+0000 7f1c44ad3700 1 --2- 172.21.15.103:0/2045042823 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c400b2530 0x7f1c400b0170 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:38.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.789+0000 7f1c44ad3700 1 -- 172.21.15.103:0/2045042823 >> 172.21.15.103:0/2045042823 conn(0x7f1c400b86b0 msgr2=0x7f1c400b8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:38.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.789+0000 7f1c44ad3700 1 -- 172.21.15.103:0/2045042823 shutdown_connections 2020-04-22T14:17:38.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.789+0000 7f1c44ad3700 1 -- 172.21.15.103:0/2045042823 wait complete. 2020-04-22T14:17:38.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.790+0000 7f1c44ad3700 1 Processor -- start 2020-04-22T14:17:38.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.790+0000 7f1c44ad3700 1 -- start start 2020-04-22T14:17:38.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.791+0000 7f1c44ad3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c400b2530 0x7f1c40137ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:38.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.791+0000 7f1c44ad3700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c40138cb0 con 0x7f1c400b4700 2020-04-22T14:17:38.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.791+0000 7f1c44ad3700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c40138f50 con 0x7f1c400b4320 2020-04-22T14:17:38.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.791+0000 7f1c44ad3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c401391f0 con 0x7f1c400b2530 2020-04-22T14:17:38.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.791+0000 7f1c3dd9b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f1c400b4320 0x7f1c4013a140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49430/0 (socket says 172.21.15.103:49430) 2020-04-22T14:17:38.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.791+0000 7f1c3dd9b700 1 -- 172.21.15.103:0/1378519962 learned_addr learned my addr 172.21.15.103:0/1378519962 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:17:38.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.791+0000 7f1c2f7fe700 1 -- 172.21.15.103:0/1378519962 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4195835642 0 0) 0x7f1c40138f50 con 0x7f1c400b4320 2020-04-22T14:17:38.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.791+0000 7f1c2f7fe700 1 -- 172.21.15.103:0/1378519962 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c1c002fe0 con 0x7f1c400b4320 2020-04-22T14:17:38.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.791+0000 7f1c3e59c700 1 --2- 172.21.15.103:0/1378519962 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c400b2530 0x7f1c40137ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:38.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.791+0000 7f1c2f7fe700 1 -- 172.21.15.103:0/1378519962 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 949276208 0 0) 0x7f1c1c002fe0 con 0x7f1c400b4320 2020-04-22T14:17:38.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.791+0000 7f1c2f7fe700 1 -- 172.21.15.103:0/1378519962 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1c40138f50 con 0x7f1c400b4320 2020-04-22T14:17:38.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.791+0000 7f1c2f7fe700 1 -- 172.21.15.103:0/1378519962 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f1c30001960 con 0x7f1c400b4320 2020-04-22T14:17:38.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.791+0000 7f1c2f7fe700 1 -- 172.21.15.103:0/1378519962 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c400b2530 msgr2=0x7f1c40137ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:38.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.791+0000 7f1c2f7fe700 1 --2- 172.21.15.103:0/1378519962 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c400b2530 0x7f1c40137ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:38.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.791+0000 7f1c2f7fe700 1 -- 172.21.15.103:0/1378519962 >> v1:172.21.15.103:6789/0 conn(0x7f1c400b4320 legacy=0x7f1c4013a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:38.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.791+0000 7f1c2f7fe700 1 -- 172.21.15.103:0/1378519962 >> v1:172.21.15.86:6789/0 conn(0x7f1c400b4700 legacy=0x7f1c400656e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:38.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.791+0000 7f1c2f7fe700 1 --2- 172.21.15.103:0/1378519962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c1c0049b0 0x7f1c1c004db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:38.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.791+0000 7f1c2f7fe700 1 --2- 172.21.15.103:0/1378519962 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c1c003920 0x7f1c1c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:38.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.791+0000 7f1c2f7fe700 1 --2- 172.21.15.103:0/1378519962 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c400b2530 0x7f1c1c0041e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:38.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.791+0000 7f1c2f7fe700 1 -- 172.21.15.103:0/1378519962 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c401391f0 con 0x7f1c1c003920 2020-04-22T14:17:38.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.791+0000 7f1c2f7fe700 1 -- 172.21.15.103:0/1378519962 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c004670 con 0x7f1c1c0049b0 2020-04-22T14:17:38.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.791+0000 7f1c2f7fe700 1 -- 172.21.15.103:0/1378519962 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c00b750 con 0x7f1c400b2530 2020-04-22T14:17:38.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.791+0000 7f1c3e59c700 1 --2- 172.21.15.103:0/1378519962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c1c0049b0 0x7f1c1c004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:38.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.791+0000 7f1c3dd9b700 1 --2- 172.21.15.103:0/1378519962 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c1c003920 0x7f1c1c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:38.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.792+0000 7f1c3ed9d700 1 --2- 172.21.15.103:0/1378519962 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c400b2530 0x7f1c1c0041e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:38.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.792+0000 7f1c3e59c700 1 -- 172.21.15.103:0/1378519962 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c400b2530 msgr2=0x7f1c1c0041e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:38.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.792+0000 7f1c3e59c700 1 --2- 172.21.15.103:0/1378519962 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c400b2530 0x7f1c1c0041e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:38.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.792+0000 7f1c3e59c700 1 -- 172.21.15.103:0/1378519962 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c1c003920 msgr2=0x7f1c1c003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:38.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.792+0000 7f1c3e59c700 1 --2- 172.21.15.103:0/1378519962 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c1c003920 0x7f1c1c003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:38.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.792+0000 7f1c3e59c700 1 -- 172.21.15.103:0/1378519962 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c401389a0 con 0x7f1c1c0049b0 2020-04-22T14:17:38.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.792+0000 7f1c44ad3700 1 -- 172.21.15.103:0/1378519962 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c4013a850 con 0x7f1c1c0049b0 2020-04-22T14:17:38.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.792+0000 7f1c3e59c700 1 --2- 172.21.15.103:0/1378519962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c1c0049b0 0x7f1c1c004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1c34001f50 tx=0x7f1c34010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:38.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.792+0000 7f1c44ad3700 1 -- 172.21.15.103:0/1378519962 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c40064380 con 0x7f1c1c0049b0 2020-04-22T14:17:38.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.792+0000 7f1c3e59c700 1 --2- 172.21.15.103:0/1378519962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c1c0049b0 0x7f1c1c004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1c34001f50 tx=0x7f1c34010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:38.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.792+0000 7f1c3e59c700 1 --2- 172.21.15.103:0/1378519962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c1c0049b0 0x7f1c1c004db0 secure :-1 s=READY pgs=1849 cs=0 l=1 rx=0x7f1c34001f50 tx=0x7f1c34010b70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:38.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.792+0000 7f1c3e59c700 1 --2- 172.21.15.103:0/1378519962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c1c0049b0 0x7f1c1c004db0 secure :-1 s=THROTTLE_DONE pgs=1849 cs=0 l=1 rx=0x7f1c34001f50 tx=0x7f1c34010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:38.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.792+0000 7f1c2f7fe700 1 -- 172.21.15.103:0/1378519962 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c34012980 con 0x7f1c1c0049b0 2020-04-22T14:17:38.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.792+0000 7f1c3e59c700 1 --2- 172.21.15.103:0/1378519962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c1c0049b0 0x7f1c1c004db0 secure :-1 s=THROTTLE_DONE pgs=1849 cs=0 l=1 rx=0x7f1c34001f50 tx=0x7f1c34010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:38.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.792+0000 7f1c3e59c700 1 --2- 172.21.15.103:0/1378519962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c1c0049b0 0x7f1c1c004db0 secure :-1 s=THROTTLE_DONE pgs=1849 cs=0 l=1 rx=0x7f1c34001f50 tx=0x7f1c34010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:38.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.792+0000 7f1c2f7fe700 1 -- 172.21.15.103:0/1378519962 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c34012ae0 con 0x7f1c1c0049b0 2020-04-22T14:17:38.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.792+0000 7f1c2f7fe700 1 -- 172.21.15.103:0/1378519962 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c34012e40 con 0x7f1c1c0049b0 2020-04-22T14:17:38.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.793+0000 7f1c3e59c700 1 --2- 172.21.15.103:0/1378519962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c1c0049b0 0x7f1c1c004db0 secure :-1 s=THROTTLE_DONE pgs=1849 cs=0 l=1 rx=0x7f1c34001f50 tx=0x7f1c34010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:38.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.793+0000 7f1c44ad3700 1 -- 172.21.15.103:0/1378519962 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c400660a0 con 0x7f1c1c0049b0 2020-04-22T14:17:38.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.793+0000 7f1c2f7fe700 1 -- 172.21.15.103:0/1378519962 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f1c3400c510 con 0x7f1c1c0049b0 2020-04-22T14:17:38.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.793+0000 7f1c3e59c700 1 --2- 172.21.15.103:0/1378519962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c1c0049b0 0x7f1c1c004db0 secure :-1 s=THROTTLE_DONE pgs=1849 cs=0 l=1 rx=0x7f1c34001f50 tx=0x7f1c34010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:38.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.793+0000 7f1c2f7fe700 1 --2- 172.21.15.103:0/1378519962 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1c1c055de0 0x7f1c1c0582a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:38.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.793+0000 7f1c2f7fe700 1 -- 172.21.15.103:0/1378519962 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f1c34061140 con 0x7f1c1c0049b0 2020-04-22T14:17:38.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.793+0000 7f1c3dd9b700 1 --2- 172.21.15.103:0/1378519962 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1c1c055de0 0x7f1c1c0582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:38.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.794+0000 7f1c3dd9b700 1 --2- 172.21.15.103:0/1378519962 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1c1c055de0 0x7f1c1c0582a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1c30001670 tx=0x7f1c30001e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:38.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.794+0000 7f1c3dd9b700 1 --2- 172.21.15.103:0/1378519962 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1c1c055de0 0x7f1c1c0582a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1c30001670 tx=0x7f1c30001e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:38.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.794+0000 7f1c3dd9b700 1 --2- 172.21.15.103:0/1378519962 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1c1c055de0 0x7f1c1c0582a0 secure :-1 s=READY pgs=675 cs=0 l=1 rx=0x7f1c30001670 tx=0x7f1c30001e20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:38.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.798+0000 7f1c3e59c700 1 --2- 172.21.15.103:0/1378519962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c1c0049b0 0x7f1c1c004db0 secure :-1 s=THROTTLE_DONE pgs=1849 cs=0 l=1 rx=0x7f1c34001f50 tx=0x7f1c34010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:38.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.798+0000 7f1c2f7fe700 1 -- 172.21.15.103:0/1378519962 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f1c400660a0 con 0x7f1c1c0049b0 2020-04-22T14:17:38.990 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:38.987+0000 7f1c44ad3700 1 -- 172.21.15.103:0/1378519962 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1c400660a0 con 0x7f1c1c0049b0 2020-04-22T14:17:39.547 INFO:tasks.ceph.mon.b.smithi086.stderr:2020-04-22T14:17:39.544+0000 7fbdbf880700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-04-22T14:17:39.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.547+0000 7f1c3e59c700 1 --2- 172.21.15.103:0/1378519962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c1c0049b0 0x7f1c1c004db0 secure :-1 s=THROTTLE_DONE pgs=1849 cs=0 l=1 rx=0x7f1c34001f50 tx=0x7f1c34010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:39.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.547+0000 7f1c2f7fe700 1 -- 172.21.15.103:0/1378519962 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v95) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1c400660a0 con 0x7f1c1c0049b0 2020-04-22T14:17:39.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.550+0000 7f1c44ad3700 1 -- 172.21.15.103:0/1378519962 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1c1c055de0 msgr2=0x7f1c1c0582a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:39.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.550+0000 7f1c44ad3700 1 --2- 172.21.15.103:0/1378519962 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1c1c055de0 0x7f1c1c0582a0 secure :-1 s=READY pgs=675 cs=0 l=1 rx=0x7f1c30001670 tx=0x7f1c30001e20).stop 2020-04-22T14:17:39.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.550+0000 7f1c44ad3700 1 -- 172.21.15.103:0/1378519962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c1c0049b0 msgr2=0x7f1c1c004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:39.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.550+0000 7f1c44ad3700 1 --2- 172.21.15.103:0/1378519962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c1c0049b0 0x7f1c1c004db0 secure :-1 s=READY pgs=1849 cs=0 l=1 rx=0x7f1c34001f50 tx=0x7f1c34010b70).stop 2020-04-22T14:17:39.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.550+0000 7f1c3ed9d700 1 -- 172.21.15.103:0/1378519962 reap_dead start 2020-04-22T14:17:39.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.550+0000 7f1c3ed9d700 1 -- 172.21.15.103:0/1378519962 reap_dead start 2020-04-22T14:17:39.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.550+0000 7f1c44ad3700 1 -- 172.21.15.103:0/1378519962 shutdown_connections 2020-04-22T14:17:39.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.550+0000 7f1c44ad3700 1 -- 172.21.15.103:0/1378519962 >> 172.21.15.103:0/1378519962 conn(0x7f1c400b86b0 msgr2=0x7f1c400b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:39.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.550+0000 7f1c44ad3700 1 -- 172.21.15.103:0/1378519962 shutdown_connections 2020-04-22T14:17:39.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.550+0000 7f1c44ad3700 1 -- 172.21.15.103:0/1378519962 wait complete. 2020-04-22T14:17:39.554 INFO:teuthology.orchestra.run.smithi103.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2020-04-22T14:17:39.564 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:39.578 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:17:39.580 INFO:tasks.ceph.mds.b.smithi086.stdout:starting mds.b at 2020-04-22T14:17:39.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.726+0000 7fdb7d5b5700 1 Processor -- start 2020-04-22T14:17:39.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.726+0000 7fdb7d5b5700 1 -- start start 2020-04-22T14:17:39.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.727+0000 7fdb7d5b5700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdb7812c0d0 0x7fdb781464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:39.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.727+0000 7fdb7d5b5700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdb78065fe0 0x7fdb7805b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:39.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.727+0000 7fdb7d5b5700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdb7805b8a0 0x7fdb78062ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:39.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.727+0000 7fdb7d5b5700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb7812c4b0 con 0x7fdb7812c0d0 2020-04-22T14:17:39.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.727+0000 7fdb7d5b5700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb78143300 con 0x7fdb7805b8a0 2020-04-22T14:17:39.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.727+0000 7fdb7d5b5700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb781435a0 con 0x7fdb78065fe0 2020-04-22T14:17:39.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.727+0000 7fdb777fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdb7805b8a0 0x7fdb78062ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:39.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.727+0000 7fdb777fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdb7805b8a0 0x7fdb78062ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57252/0 (socket says 172.21.15.103:57252) 2020-04-22T14:17:39.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.727+0000 7fdb777fe700 1 -- 172.21.15.103:0/795737226 learned_addr learned my addr 172.21.15.103:0/795737226 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:39.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.727+0000 7fdb76ffd700 1 --2- 172.21.15.103:0/795737226 >> v2:172.21.15.86:3300/0 conn(0x7fdb7812c0d0 0x7fdb781464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:39.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.727+0000 7fdb6ffff700 1 --2- 172.21.15.103:0/795737226 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdb78065fe0 0x7fdb7805b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:39.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.727+0000 7fdb777fe700 1 -- 172.21.15.103:0/795737226 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdb78065fe0 msgr2=0x7fdb7805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:39.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.727+0000 7fdb777fe700 1 --2- 172.21.15.103:0/795737226 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdb78065fe0 0x7fdb7805b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:39.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.727+0000 7fdb777fe700 1 -- 172.21.15.103:0/795737226 >> v2:172.21.15.86:3300/0 conn(0x7fdb7812c0d0 msgr2=0x7fdb781464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:39.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.727+0000 7fdb777fe700 1 --2- 172.21.15.103:0/795737226 >> v2:172.21.15.86:3300/0 conn(0x7fdb7812c0d0 0x7fdb781464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:39.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.727+0000 7fdb777fe700 1 -- 172.21.15.103:0/795737226 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb78143840 con 0x7fdb7805b8a0 2020-04-22T14:17:39.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.727+0000 7fdb76ffd700 1 --2- 172.21.15.103:0/795737226 >> v2:172.21.15.86:3300/0 conn(0x7fdb7812c0d0 0x7fdb781464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:17:39.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.727+0000 7fdb777fe700 1 --2- 172.21.15.103:0/795737226 >> v2:172.21.15.103:3300/0 conn(0x7fdb7805b8a0 0x7fdb78062ab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdb700032b0 tx=0x7fdb70007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:39.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.727+0000 7fdb777fe700 1 --2- 172.21.15.103:0/795737226 >> v2:172.21.15.103:3300/0 conn(0x7fdb7805b8a0 0x7fdb78062ab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdb700032b0 tx=0x7fdb70007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:39.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.727+0000 7fdb777fe700 1 --2- 172.21.15.103:0/795737226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb7805b8a0 0x7fdb78062ab0 secure :-1 s=READY pgs=1851 cs=0 l=1 rx=0x7fdb700032b0 tx=0x7fdb70007dc0).ready entity=mon.1 client_cookie=cfcdab85d03c8c61 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:39.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.727+0000 7fdb777fe700 1 --2- 172.21.15.103:0/795737226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb7805b8a0 0x7fdb78062ab0 secure :-1 s=THROTTLE_DONE pgs=1851 cs=0 l=1 rx=0x7fdb700032b0 tx=0x7fdb70007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:39.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.727+0000 7fdb767fc700 1 -- 172.21.15.103:0/795737226 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb7000a180 con 0x7fdb7805b8a0 2020-04-22T14:17:39.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.727+0000 7fdb777fe700 1 --2- 172.21.15.103:0/795737226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb7805b8a0 0x7fdb78062ab0 secure :-1 s=THROTTLE_DONE pgs=1851 cs=0 l=1 rx=0x7fdb700032b0 tx=0x7fdb70007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:39.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.727+0000 7fdb767fc700 1 -- 172.21.15.103:0/795737226 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb7000a2e0 con 0x7fdb7805b8a0 2020-04-22T14:17:39.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.727+0000 7fdb777fe700 1 --2- 172.21.15.103:0/795737226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb7805b8a0 0x7fdb78062ab0 secure :-1 s=THROTTLE_DONE pgs=1851 cs=0 l=1 rx=0x7fdb700032b0 tx=0x7fdb70007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:39.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.727+0000 7fdb767fc700 1 -- 172.21.15.103:0/795737226 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb7000a700 con 0x7fdb7805b8a0 2020-04-22T14:17:39.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.727+0000 7fdb7d5b5700 1 -- 172.21.15.103:0/795737226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb7805b8a0 msgr2=0x7fdb78062ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:39.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.727+0000 7fdb7d5b5700 1 --2- 172.21.15.103:0/795737226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb7805b8a0 0x7fdb78062ab0 secure :-1 s=READY pgs=1851 cs=0 l=1 rx=0x7fdb700032b0 tx=0x7fdb70007dc0).stop 2020-04-22T14:17:39.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.728+0000 7fdb7d5b5700 1 -- 172.21.15.103:0/795737226 shutdown_connections 2020-04-22T14:17:39.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.728+0000 7fdb7d5b5700 1 --2- 172.21.15.103:0/795737226 >> v2:172.21.15.86:3300/0 conn(0x7fdb7812c0d0 0x7fdb781464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:39.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.728+0000 7fdb7d5b5700 1 --2- 172.21.15.103:0/795737226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb7805b8a0 0x7fdb78062ab0 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:39.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.728+0000 7fdb7d5b5700 1 --2- 172.21.15.103:0/795737226 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdb78065fe0 0x7fdb7805b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:39.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.728+0000 7fdb7d5b5700 1 -- 172.21.15.103:0/795737226 >> 172.21.15.103:0/795737226 conn(0x7fdb780b9160 msgr2=0x7fdb7805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:39.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.728+0000 7fdb7d5b5700 1 -- 172.21.15.103:0/795737226 shutdown_connections 2020-04-22T14:17:39.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.728+0000 7fdb7d5b5700 1 -- 172.21.15.103:0/795737226 wait complete. 2020-04-22T14:17:39.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.729+0000 7fdb7d5b5700 1 Processor -- start 2020-04-22T14:17:39.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.729+0000 7fdb7d5b5700 1 -- start start 2020-04-22T14:17:39.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.730+0000 7fdb7d5b5700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdb7805b8a0 0x7fdb780b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:39.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.730+0000 7fdb7d5b5700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdb78065fe0 0x7fdb780b3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:39.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.730+0000 7fdb7d5b5700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb780b0b50 con 0x7fdb7812c0d0 2020-04-22T14:17:39.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.730+0000 7fdb7d5b5700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb78144e90 con 0x7fdb7805b8a0 2020-04-22T14:17:39.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.730+0000 7fdb7d5b5700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb7813ff60 con 0x7fdb78065fe0 2020-04-22T14:17:39.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.730+0000 7fdb6ffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdb78065fe0 0x7fdb780b3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:39.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.730+0000 7fdb6ffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdb78065fe0 0x7fdb780b3f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57260/0 (socket says 172.21.15.103:57260) 2020-04-22T14:17:39.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.730+0000 7fdb6ffff700 1 -- 172.21.15.103:0/3126387146 learned_addr learned my addr 172.21.15.103:0/3126387146 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:39.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.730+0000 7fdb76ffd700 1 --2- 172.21.15.103:0/3126387146 >> v2:172.21.15.86:3300/0 conn(0x7fdb7805b8a0 0x7fdb780b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:39.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.730+0000 7fdb6ffff700 1 -- 172.21.15.103:0/3126387146 >> v2:172.21.15.86:3300/0 conn(0x7fdb7805b8a0 msgr2=0x7fdb780b27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:39.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.730+0000 7fdb6ffff700 1 --2- 172.21.15.103:0/3126387146 >> v2:172.21.15.86:3300/0 conn(0x7fdb7805b8a0 0x7fdb780b27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:39.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.730+0000 7fdb6ffff700 1 -- 172.21.15.103:0/3126387146 >> v1:172.21.15.86:6789/0 conn(0x7fdb7812c0d0 legacy=0x7fdb7812a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:39.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.730+0000 7fdb6ffff700 1 -- 172.21.15.103:0/3126387146 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb780b4370 con 0x7fdb78065fe0 2020-04-22T14:17:39.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.730+0000 7fdb6ffff700 1 --2- 172.21.15.103:0/3126387146 >> v2:172.21.15.103:3300/0 conn(0x7fdb78065fe0 0x7fdb780b3f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdb60002f30 tx=0x7fdb60010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:39.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.730+0000 7fdb6ffff700 1 --2- 172.21.15.103:0/3126387146 >> v2:172.21.15.103:3300/0 conn(0x7fdb78065fe0 0x7fdb780b3f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdb60002f30 tx=0x7fdb60010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:39.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.730+0000 7fdb6ffff700 1 --2- 172.21.15.103:0/3126387146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb78065fe0 0x7fdb780b3f10 secure :-1 s=READY pgs=1852 cs=0 l=1 rx=0x7fdb60002f30 tx=0x7fdb60010c70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:39.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.730+0000 7fdb6ffff700 1 --2- 172.21.15.103:0/3126387146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb78065fe0 0x7fdb780b3f10 secure :-1 s=THROTTLE_DONE pgs=1852 cs=0 l=1 rx=0x7fdb60002f30 tx=0x7fdb60010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:39.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.730+0000 7fdb6ffff700 1 --2- 172.21.15.103:0/3126387146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb78065fe0 0x7fdb780b3f10 secure :-1 s=THROTTLE_DONE pgs=1852 cs=0 l=1 rx=0x7fdb60002f30 tx=0x7fdb60010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:39.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.730+0000 7fdb74ff9700 1 -- 172.21.15.103:0/3126387146 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb600128b0 con 0x7fdb78065fe0 2020-04-22T14:17:39.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.730+0000 7fdb6ffff700 1 --2- 172.21.15.103:0/3126387146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb78065fe0 0x7fdb780b3f10 secure :-1 s=THROTTLE_DONE pgs=1852 cs=0 l=1 rx=0x7fdb60002f30 tx=0x7fdb60010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:39.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.730+0000 7fdb74ff9700 1 -- 172.21.15.103:0/3126387146 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb60012a10 con 0x7fdb78065fe0 2020-04-22T14:17:39.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.730+0000 7fdb74ff9700 1 -- 172.21.15.103:0/3126387146 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb60012df0 con 0x7fdb78065fe0 2020-04-22T14:17:39.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.730+0000 7fdb7d5b5700 1 -- 172.21.15.103:0/3126387146 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb7813f860 con 0x7fdb78065fe0 2020-04-22T14:17:39.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.730+0000 7fdb7d5b5700 1 -- 172.21.15.103:0/3126387146 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb7812a970 con 0x7fdb78065fe0 2020-04-22T14:17:39.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.731+0000 7fdb6ffff700 1 --2- 172.21.15.103:0/3126387146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb78065fe0 0x7fdb780b3f10 secure :-1 s=THROTTLE_DONE pgs=1852 cs=0 l=1 rx=0x7fdb60002f30 tx=0x7fdb60010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:39.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.731+0000 7fdb7d5b5700 1 -- 172.21.15.103:0/3126387146 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb78056c90 con 0x7fdb78065fe0 2020-04-22T14:17:39.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.731+0000 7fdb74ff9700 1 -- 172.21.15.103:0/3126387146 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fdb60007190 con 0x7fdb78065fe0 2020-04-22T14:17:39.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.731+0000 7fdb6ffff700 1 --2- 172.21.15.103:0/3126387146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb78065fe0 0x7fdb780b3f10 secure :-1 s=THROTTLE_DONE pgs=1852 cs=0 l=1 rx=0x7fdb60002f30 tx=0x7fdb60010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:39.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.732+0000 7fdb74ff9700 1 --2- 172.21.15.103:0/3126387146 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdb5c04d9e0 0x7fdb5c04fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:39.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.732+0000 7fdb74ff9700 1 -- 172.21.15.103:0/3126387146 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6202+0+0 (secure 0 0 0) 0x7fdb60061430 con 0x7fdb78065fe0 2020-04-22T14:17:39.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.732+0000 7fdb76ffd700 1 --2- 172.21.15.103:0/3126387146 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdb5c04d9e0 0x7fdb5c04fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:39.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.732+0000 7fdb76ffd700 1 --2- 172.21.15.103:0/3126387146 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdb5c04d9e0 0x7fdb5c04fea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdb68002f30 tx=0x7fdb6800f0d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:39.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.732+0000 7fdb76ffd700 1 --2- 172.21.15.103:0/3126387146 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdb5c04d9e0 0x7fdb5c04fea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdb68002f30 tx=0x7fdb6800f0d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:39.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.732+0000 7fdb76ffd700 1 --2- 172.21.15.103:0/3126387146 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdb5c04d9e0 0x7fdb5c04fea0 secure :-1 s=READY pgs=676 cs=0 l=1 rx=0x7fdb68002f30 tx=0x7fdb6800f0d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:39.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.736+0000 7fdb6ffff700 1 --2- 172.21.15.103:0/3126387146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb78065fe0 0x7fdb780b3f10 secure :-1 s=THROTTLE_DONE pgs=1852 cs=0 l=1 rx=0x7fdb60002f30 tx=0x7fdb60010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:39.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.736+0000 7fdb74ff9700 1 -- 172.21.15.103:0/3126387146 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fdb6003c870 con 0x7fdb78065fe0 2020-04-22T14:17:39.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.927+0000 7fdb7d5b5700 1 -- 172.21.15.103:0/3126387146 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdb780b4f20 con 0x7fdb78065fe0 2020-04-22T14:17:39.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.928+0000 7fdb6ffff700 1 --2- 172.21.15.103:0/3126387146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb78065fe0 0x7fdb780b3f10 secure :-1 s=THROTTLE_DONE pgs=1852 cs=0 l=1 rx=0x7fdb60002f30 tx=0x7fdb60010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:39.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.928+0000 7fdb74ff9700 1 -- 172.21.15.103:0/3126387146 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+1785 (secure 0 0 0) 0x7fdb6003fe90 con 0x7fdb78065fe0 2020-04-22T14:17:39.931 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:17:39.931 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":95,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6380,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/1697822737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1697822737},{"type":"v1","addr":"172.21.15.103:6833","nonce":1697822737}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":91}],"filesystems":[{"mdsmap":{"epoch":95,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:16:46.111567+0000","modified":"2020-04-22T14:17:39.545451+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":126,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2020-04-22T14:17:39.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.929+0000 7fdb7d5b5700 1 -- 172.21.15.103:0/3126387146 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdb5c04d9e0 msgr2=0x7fdb5c04fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:39.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.929+0000 7fdb7d5b5700 1 --2- 172.21.15.103:0/3126387146 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdb5c04d9e0 0x7fdb5c04fea0 secure :-1 s=READY pgs=676 cs=0 l=1 rx=0x7fdb68002f30 tx=0x7fdb6800f0d0).stop 2020-04-22T14:17:39.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.929+0000 7fdb7d5b5700 1 -- 172.21.15.103:0/3126387146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb78065fe0 msgr2=0x7fdb780b3f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:39.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.929+0000 7fdb7d5b5700 1 --2- 172.21.15.103:0/3126387146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb78065fe0 0x7fdb780b3f10 secure :-1 s=READY pgs=1852 cs=0 l=1 rx=0x7fdb60002f30 tx=0x7fdb60010c70).stop 2020-04-22T14:17:39.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.929+0000 7fdb7d5b5700 1 -- 172.21.15.103:0/3126387146 shutdown_connections 2020-04-22T14:17:39.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.929+0000 7fdb7d5b5700 1 --2- 172.21.15.103:0/3126387146 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdb5c04d9e0 0x7fdb5c04fea0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:39.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.930+0000 7fdb7d5b5700 1 --2- 172.21.15.103:0/3126387146 >> v2:172.21.15.86:3300/0 conn(0x7fdb7805b8a0 0x7fdb780b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:39.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.930+0000 7fdb7d5b5700 1 --2- 172.21.15.103:0/3126387146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb78065fe0 0x7fdb780b3f10 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:39.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.930+0000 7fdb7d5b5700 1 -- 172.21.15.103:0/3126387146 >> 172.21.15.103:0/3126387146 conn(0x7fdb780b9160 msgr2=0x7fdb78146330 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:39.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.930+0000 7fdb7d5b5700 1 -- 172.21.15.103:0/3126387146 shutdown_connections 2020-04-22T14:17:39.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:39.930+0000 7fdb7d5b5700 1 -- 172.21.15.103:0/3126387146 wait complete. 2020-04-22T14:17:39.934 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 95 2020-04-22T14:17:39.942 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:39.955 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-04-22T14:17:40.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.101+0000 7fccf8625700 1 Processor -- start 2020-04-22T14:17:40.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.101+0000 7fccf8625700 1 -- start start 2020-04-22T14:17:40.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.101+0000 7fccf8625700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fccf00ac950 0x7fccf0146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:40.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.101+0000 7fccf8625700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fccf01470a0 0x7fccf0143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:40.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.102+0000 7fccf8625700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccf01467e0 con 0x7fccf00b9140 2020-04-22T14:17:40.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.102+0000 7fccf8625700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccf0147530 con 0x7fccf01470a0 2020-04-22T14:17:40.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.102+0000 7fccf8625700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccf00602f0 con 0x7fccf00ac950 2020-04-22T14:17:40.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.102+0000 7fccf5bc0700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fccf00ac950 0x7fccf0146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:40.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.102+0000 7fccf5bc0700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fccf00ac950 0x7fccf0146c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57266/0 (socket says 172.21.15.103:57266) 2020-04-22T14:17:40.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.102+0000 7fccf5bc0700 1 -- 172.21.15.103:0/1686341352 learned_addr learned my addr 172.21.15.103:0/1686341352 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:40.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.102+0000 7fccf6bc2700 1 --2- 172.21.15.103:0/1686341352 >> v2:172.21.15.86:3300/0 conn(0x7fccf01470a0 0x7fccf0143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:40.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.102+0000 7fccf5bc0700 1 -- 172.21.15.103:0/1686341352 >> v2:172.21.15.86:3300/0 conn(0x7fccf01470a0 msgr2=0x7fccf0143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:40.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.102+0000 7fccf5bc0700 1 --2- 172.21.15.103:0/1686341352 >> v2:172.21.15.86:3300/0 conn(0x7fccf01470a0 0x7fccf0143090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:40.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.102+0000 7fccf5bc0700 1 -- 172.21.15.103:0/1686341352 >> v1:172.21.15.86:6789/0 conn(0x7fccf00b9140 legacy=0x7fccf012b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:40.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.102+0000 7fccf5bc0700 1 -- 172.21.15.103:0/1686341352 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf0060050 con 0x7fccf00ac950 2020-04-22T14:17:40.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.102+0000 7fccf6bc2700 1 --2- 172.21.15.103:0/1686341352 >> v2:172.21.15.86:3300/0 conn(0x7fccf01470a0 0x7fccf0143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:17:40.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.102+0000 7fccf5bc0700 1 --2- 172.21.15.103:0/1686341352 >> v2:172.21.15.103:3300/0 conn(0x7fccf00ac950 0x7fccf0146c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcce4002f30 tx=0x7fcce4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:40.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.102+0000 7fccf5bc0700 1 --2- 172.21.15.103:0/1686341352 >> v2:172.21.15.103:3300/0 conn(0x7fccf00ac950 0x7fccf0146c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcce4002f30 tx=0x7fcce4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:40.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.102+0000 7fccf5bc0700 1 --2- 172.21.15.103:0/1686341352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fccf00ac950 0x7fccf0146c40 secure :-1 s=READY pgs=1853 cs=0 l=1 rx=0x7fcce4002f30 tx=0x7fcce4007a40).ready entity=mon.1 client_cookie=2eac1e319134c1fb server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:40.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.102+0000 7fccf5bc0700 1 --2- 172.21.15.103:0/1686341352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fccf00ac950 0x7fccf0146c40 secure :-1 s=THROTTLE_DONE pgs=1853 cs=0 l=1 rx=0x7fcce4002f30 tx=0x7fcce4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:40.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.102+0000 7fccf53bf700 1 -- 172.21.15.103:0/1686341352 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcce4011720 con 0x7fccf00ac950 2020-04-22T14:17:40.108 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.102+0000 7fccf5bc0700 1 --2- 172.21.15.103:0/1686341352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fccf00ac950 0x7fccf0146c40 secure :-1 s=THROTTLE_DONE pgs=1853 cs=0 l=1 rx=0x7fcce4002f30 tx=0x7fcce4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:40.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.102+0000 7fccf5bc0700 1 --2- 172.21.15.103:0/1686341352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fccf00ac950 0x7fccf0146c40 secure :-1 s=THROTTLE_DONE pgs=1853 cs=0 l=1 rx=0x7fcce4002f30 tx=0x7fcce4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:40.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.102+0000 7fccf53bf700 1 -- 172.21.15.103:0/1686341352 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce4011880 con 0x7fccf00ac950 2020-04-22T14:17:40.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.102+0000 7fccf53bf700 1 -- 172.21.15.103:0/1686341352 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcce4011ca0 con 0x7fccf00ac950 2020-04-22T14:17:40.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.102+0000 7fccf8625700 1 -- 172.21.15.103:0/1686341352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fccf00ac950 msgr2=0x7fccf0146c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:40.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.102+0000 7fccf8625700 1 --2- 172.21.15.103:0/1686341352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fccf00ac950 0x7fccf0146c40 secure :-1 s=READY pgs=1853 cs=0 l=1 rx=0x7fcce4002f30 tx=0x7fcce4007a40).stop 2020-04-22T14:17:40.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.103+0000 7fccf8625700 1 -- 172.21.15.103:0/1686341352 shutdown_connections 2020-04-22T14:17:40.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.103+0000 7fccf8625700 1 --2- 172.21.15.103:0/1686341352 >> v2:172.21.15.86:3300/0 conn(0x7fccf01470a0 0x7fccf0143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:40.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.103+0000 7fccf8625700 1 --2- 172.21.15.103:0/1686341352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fccf00ac950 0x7fccf0146c40 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:40.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.103+0000 7fccf8625700 1 -- 172.21.15.103:0/1686341352 >> 172.21.15.103:0/1686341352 conn(0x7fccf005b7b0 msgr2=0x7fccf00b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:40.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.103+0000 7fccf8625700 1 -- 172.21.15.103:0/1686341352 shutdown_connections 2020-04-22T14:17:40.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.103+0000 7fccf8625700 1 -- 172.21.15.103:0/1686341352 wait complete. 2020-04-22T14:17:40.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.104+0000 7fccf8625700 1 Processor -- start 2020-04-22T14:17:40.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.104+0000 7fccf8625700 1 -- start start 2020-04-22T14:17:40.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.104+0000 7fccf8625700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fccf01470a0 0x7fccf00623b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:40.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.104+0000 7fccf8625700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccf0140340 con 0x7fccf00ac950 2020-04-22T14:17:40.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.104+0000 7fccf8625700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccf01405e0 con 0x7fccf00b9140 2020-04-22T14:17:40.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.104+0000 7fccf8625700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccf0064d80 con 0x7fccf01470a0 2020-04-22T14:17:40.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.105+0000 7fccf5bc0700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fccf00b9140 0x7fccf0064670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49464/0 (socket says 172.21.15.103:49464) 2020-04-22T14:17:40.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.105+0000 7fccf5bc0700 1 -- 172.21.15.103:0/2737371876 learned_addr learned my addr 172.21.15.103:0/2737371876 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:17:40.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.105+0000 7fccf6bc2700 1 --2- 172.21.15.103:0/2737371876 >> v2:172.21.15.103:3300/0 conn(0x7fccf01470a0 0x7fccf00623b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:40.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.105+0000 7fcce37fe700 1 -- 172.21.15.103:0/2737371876 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 47997348 0 0) 0x7fccf01405e0 con 0x7fccf00b9140 2020-04-22T14:17:40.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.105+0000 7fcce37fe700 1 -- 172.21.15.103:0/2737371876 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccd0002fe0 con 0x7fccf00b9140 2020-04-22T14:17:40.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.105+0000 7fcce37fe700 1 -- 172.21.15.103:0/2737371876 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2001123280 0 0) 0x7fccf0140340 con 0x7fccf00ac950 2020-04-22T14:17:40.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.105+0000 7fccf6bc2700 1 -- 172.21.15.103:0/2737371876 >> v1:172.21.15.103:6789/0 conn(0x7fccf00b9140 legacy=0x7fccf0064670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:40.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.105+0000 7fccf6bc2700 1 -- 172.21.15.103:0/2737371876 >> v1:172.21.15.86:6789/0 conn(0x7fccf00ac950 legacy=0x7fccf0063f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:40.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.105+0000 7fccf6bc2700 1 -- 172.21.15.103:0/2737371876 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf0140880 con 0x7fccf01470a0 2020-04-22T14:17:40.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.105+0000 7fccf6bc2700 1 --2- 172.21.15.103:0/2737371876 >> v2:172.21.15.103:3300/0 conn(0x7fccf01470a0 0x7fccf00623b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcce80032b0 tx=0x7fcce8010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:40.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.105+0000 7fccf6bc2700 1 --2- 172.21.15.103:0/2737371876 >> v2:172.21.15.103:3300/0 conn(0x7fccf01470a0 0x7fccf00623b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcce80032b0 tx=0x7fcce8010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:40.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.105+0000 7fccf6bc2700 1 --2- 172.21.15.103:0/2737371876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fccf01470a0 0x7fccf00623b0 secure :-1 s=READY pgs=1855 cs=0 l=1 rx=0x7fcce80032b0 tx=0x7fcce8010da0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:40.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.105+0000 7fccf6bc2700 1 --2- 172.21.15.103:0/2737371876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fccf01470a0 0x7fccf00623b0 secure :-1 s=THROTTLE_DONE pgs=1855 cs=0 l=1 rx=0x7fcce80032b0 tx=0x7fcce8010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:40.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.105+0000 7fcce37fe700 1 -- 172.21.15.103:0/2737371876 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcce8005e30 con 0x7fccf01470a0 2020-04-22T14:17:40.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.105+0000 7fccf6bc2700 1 --2- 172.21.15.103:0/2737371876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fccf01470a0 0x7fccf00623b0 secure :-1 s=THROTTLE_DONE pgs=1855 cs=0 l=1 rx=0x7fcce80032b0 tx=0x7fcce8010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:40.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.105+0000 7fccf6bc2700 1 --2- 172.21.15.103:0/2737371876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fccf01470a0 0x7fccf00623b0 secure :-1 s=THROTTLE_DONE pgs=1855 cs=0 l=1 rx=0x7fcce80032b0 tx=0x7fcce8010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:40.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.105+0000 7fcce37fe700 1 -- 172.21.15.103:0/2737371876 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce8007560 con 0x7fccf01470a0 2020-04-22T14:17:40.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.105+0000 7fccf8625700 1 -- 172.21.15.103:0/2737371876 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccf0062990 con 0x7fccf01470a0 2020-04-22T14:17:40.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.105+0000 7fcce37fe700 1 -- 172.21.15.103:0/2737371876 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcce80078c0 con 0x7fccf01470a0 2020-04-22T14:17:40.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.105+0000 7fccf8625700 1 -- 172.21.15.103:0/2737371876 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccf00b54e0 con 0x7fccf01470a0 2020-04-22T14:17:40.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.106+0000 7fccf6bc2700 1 --2- 172.21.15.103:0/2737371876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fccf01470a0 0x7fccf00623b0 secure :-1 s=THROTTLE_DONE pgs=1855 cs=0 l=1 rx=0x7fcce80032b0 tx=0x7fcce8010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:40.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.106+0000 7fcce37fe700 1 -- 172.21.15.103:0/2737371876 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fcce8010190 con 0x7fccf01470a0 2020-04-22T14:17:40.117 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.106+0000 7fccf6bc2700 1 --2- 172.21.15.103:0/2737371876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fccf01470a0 0x7fccf00623b0 secure :-1 s=THROTTLE_DONE pgs=1855 cs=0 l=1 rx=0x7fcce80032b0 tx=0x7fcce8010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:40.117 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.106+0000 7fccf8625700 1 -- 172.21.15.103:0/2737371876 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccf0056c90 con 0x7fccf01470a0 2020-04-22T14:17:40.117 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.106+0000 7fcce37fe700 1 --2- 172.21.15.103:0/2737371876 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fccd004dc20 0x7fccd00500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:40.117 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.107+0000 7fcce37fe700 1 -- 172.21.15.103:0/2737371876 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6202+0+0 (secure 0 0 0) 0x7fcce80614b0 con 0x7fccf01470a0 2020-04-22T14:17:40.117 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.107+0000 7fccf63c1700 1 --2- 172.21.15.103:0/2737371876 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fccd004dc20 0x7fccd00500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:40.117 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.107+0000 7fccf63c1700 1 --2- 172.21.15.103:0/2737371876 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fccd004dc20 0x7fccd00500e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fccec002170 tx=0x7fccec002720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:40.117 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.107+0000 7fccf63c1700 1 --2- 172.21.15.103:0/2737371876 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fccd004dc20 0x7fccd00500e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fccec002170 tx=0x7fccec002720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:40.117 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.107+0000 7fccf63c1700 1 --2- 172.21.15.103:0/2737371876 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fccd004dc20 0x7fccd00500e0 secure :-1 s=READY pgs=677 cs=0 l=1 rx=0x7fccec002170 tx=0x7fccec002720).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:40.118 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.110+0000 7fccf6bc2700 1 --2- 172.21.15.103:0/2737371876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fccf01470a0 0x7fccf00623b0 secure :-1 s=THROTTLE_DONE pgs=1855 cs=0 l=1 rx=0x7fcce80032b0 tx=0x7fcce8010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:40.118 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.110+0000 7fcce37fe700 1 -- 172.21.15.103:0/2737371876 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fcce803c830 con 0x7fccf01470a0 2020-04-22T14:17:40.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.299+0000 7fccf8625700 1 -- 172.21.15.103:0/2737371876 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fccf00acf40 con 0x7fccf01470a0 2020-04-22T14:17:40.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.569+0000 7fccf6bc2700 1 --2- 172.21.15.103:0/2737371876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fccf01470a0 0x7fccf00623b0 secure :-1 s=THROTTLE_DONE pgs=1855 cs=0 l=1 rx=0x7fcce80032b0 tx=0x7fcce8010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:40.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.569+0000 7fcce37fe700 1 -- 172.21.15.103:0/2737371876 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v96) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcce803fe50 con 0x7fccf01470a0 2020-04-22T14:17:40.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.570+0000 7fccf8625700 1 -- 172.21.15.103:0/2737371876 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fccd004dc20 msgr2=0x7fccd00500e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:40.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.570+0000 7fccf8625700 1 --2- 172.21.15.103:0/2737371876 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fccd004dc20 0x7fccd00500e0 secure :-1 s=READY pgs=677 cs=0 l=1 rx=0x7fccec002170 tx=0x7fccec002720).stop 2020-04-22T14:17:40.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.570+0000 7fccf8625700 1 -- 172.21.15.103:0/2737371876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fccf01470a0 msgr2=0x7fccf00623b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:40.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.570+0000 7fccf8625700 1 --2- 172.21.15.103:0/2737371876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fccf01470a0 0x7fccf00623b0 secure :-1 s=READY pgs=1855 cs=0 l=1 rx=0x7fcce80032b0 tx=0x7fcce8010da0).stop 2020-04-22T14:17:40.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.570+0000 7fccf8625700 1 -- 172.21.15.103:0/2737371876 shutdown_connections 2020-04-22T14:17:40.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.570+0000 7fccf8625700 1 --2- 172.21.15.103:0/2737371876 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fccd004dc20 0x7fccd00500e0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:40.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.570+0000 7fccf8625700 1 --2- 172.21.15.103:0/2737371876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fccf01470a0 0x7fccf00623b0 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:40.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.570+0000 7fccf8625700 1 -- 172.21.15.103:0/2737371876 >> 172.21.15.103:0/2737371876 conn(0x7fccf005b7b0 msgr2=0x7fccf013f200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:40.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.571+0000 7fccf8625700 1 -- 172.21.15.103:0/2737371876 shutdown_connections 2020-04-22T14:17:40.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.571+0000 7fccf8625700 1 -- 172.21.15.103:0/2737371876 wait complete. 2020-04-22T14:17:40.583 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:40.597 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-04-22T14:17:40.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.745+0000 7ffaef3c7700 1 Processor -- start 2020-04-22T14:17:40.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.746+0000 7ffaef3c7700 1 -- start start 2020-04-22T14:17:40.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.746+0000 7ffaef3c7700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffae80b9140 0x7ffae812b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:40.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.746+0000 7ffaef3c7700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffae812b670 0x7ffae8143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:40.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.746+0000 7ffaef3c7700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffae81467e0 con 0x7ffae80ac950 2020-04-22T14:17:40.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.746+0000 7ffaef3c7700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffae80602f0 con 0x7ffae80b9140 2020-04-22T14:17:40.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.746+0000 7ffaef3c7700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffae8060050 con 0x7ffae812b670 2020-04-22T14:17:40.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.746+0000 7ffaed163700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffae80b9140 0x7ffae812b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:40.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.746+0000 7ffaec962700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ffae80ac950 0x7ffae8146c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49470/0 (socket says 172.21.15.103:49470) 2020-04-22T14:17:40.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.746+0000 7ffaed163700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffae80b9140 0x7ffae812b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57280/0 (socket says 172.21.15.103:57280) 2020-04-22T14:17:40.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.746+0000 7ffaec962700 1 -- 172.21.15.103:0/1853966947 learned_addr learned my addr 172.21.15.103:0/1853966947 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:17:40.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.747+0000 7ffaed964700 1 --2- 172.21.15.103:0/1853966947 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffae812b670 0x7ffae8143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:40.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.747+0000 7ffaed163700 1 -- 172.21.15.103:0/1853966947 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffae812b670 msgr2=0x7ffae8143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:40.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.747+0000 7ffaed163700 1 --2- 172.21.15.103:0/1853966947 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffae812b670 0x7ffae8143090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:40.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.747+0000 7ffaed163700 1 -- 172.21.15.103:0/1853966947 >> v1:172.21.15.103:6789/0 conn(0x7ffae80ac950 legacy=0x7ffae8146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:40.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.747+0000 7ffaed163700 1 -- 172.21.15.103:0/1853966947 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae80b9520 con 0x7ffae80b9140 2020-04-22T14:17:40.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.747+0000 7ffad7fff700 1 -- 172.21.15.103:0/1853966947 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 85265713 0 0) 0x7ffae81467e0 con 0x7ffae80ac950 2020-04-22T14:17:40.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.747+0000 7ffaed163700 1 --2- 172.21.15.103:0/1853966947 >> v2:172.21.15.103:3300/0 conn(0x7ffae80b9140 0x7ffae812b210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ffad8002f30 tx=0x7ffad8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:40.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.747+0000 7ffaed163700 1 --2- 172.21.15.103:0/1853966947 >> v2:172.21.15.103:3300/0 conn(0x7ffae80b9140 0x7ffae812b210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ffad8002f30 tx=0x7ffad8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:40.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.747+0000 7ffaed163700 1 --2- 172.21.15.103:0/1853966947 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffae80b9140 0x7ffae812b210 secure :-1 s=READY pgs=1857 cs=0 l=1 rx=0x7ffad8002f30 tx=0x7ffad8007a40).ready entity=mon.1 client_cookie=7461e6f8bd7fee9a server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:40.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.747+0000 7ffaed163700 1 --2- 172.21.15.103:0/1853966947 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffae80b9140 0x7ffae812b210 secure :-1 s=THROTTLE_DONE pgs=1857 cs=0 l=1 rx=0x7ffad8002f30 tx=0x7ffad8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:40.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.747+0000 7ffad7fff700 1 -- 172.21.15.103:0/1853966947 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffad80113c0 con 0x7ffae80b9140 2020-04-22T14:17:40.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.747+0000 7ffaed163700 1 --2- 172.21.15.103:0/1853966947 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffae80b9140 0x7ffae812b210 secure :-1 s=THROTTLE_DONE pgs=1857 cs=0 l=1 rx=0x7ffad8002f30 tx=0x7ffad8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:40.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.747+0000 7ffaed163700 1 --2- 172.21.15.103:0/1853966947 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffae80b9140 0x7ffae812b210 secure :-1 s=THROTTLE_DONE pgs=1857 cs=0 l=1 rx=0x7ffad8002f30 tx=0x7ffad8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:40.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.747+0000 7ffad7fff700 1 -- 172.21.15.103:0/1853966947 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad8011560 con 0x7ffae80b9140 2020-04-22T14:17:40.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.747+0000 7ffad7fff700 1 -- 172.21.15.103:0/1853966947 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffad8011940 con 0x7ffae80b9140 2020-04-22T14:17:40.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.747+0000 7ffaef3c7700 1 -- 172.21.15.103:0/1853966947 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffae80b9140 msgr2=0x7ffae812b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:40.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.747+0000 7ffaef3c7700 1 --2- 172.21.15.103:0/1853966947 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffae80b9140 0x7ffae812b210 secure :-1 s=READY pgs=1857 cs=0 l=1 rx=0x7ffad8002f30 tx=0x7ffad8007a40).stop 2020-04-22T14:17:40.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.748+0000 7ffaef3c7700 1 -- 172.21.15.103:0/1853966947 shutdown_connections 2020-04-22T14:17:40.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.748+0000 7ffaef3c7700 1 --2- 172.21.15.103:0/1853966947 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffae812b670 0x7ffae8143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:40.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.748+0000 7ffaef3c7700 1 --2- 172.21.15.103:0/1853966947 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffae80b9140 0x7ffae812b210 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:40.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.748+0000 7ffaef3c7700 1 -- 172.21.15.103:0/1853966947 >> 172.21.15.103:0/1853966947 conn(0x7ffae805b7b0 msgr2=0x7ffae80b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:40.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.748+0000 7ffaef3c7700 1 -- 172.21.15.103:0/1853966947 shutdown_connections 2020-04-22T14:17:40.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.748+0000 7ffaef3c7700 1 -- 172.21.15.103:0/1853966947 wait complete. 2020-04-22T14:17:40.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.749+0000 7ffaef3c7700 1 Processor -- start 2020-04-22T14:17:40.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.749+0000 7ffaef3c7700 1 -- start start 2020-04-22T14:17:40.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.749+0000 7ffaef3c7700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ffae80ac950 0x7ffae8144e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:40.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.749+0000 7ffaef3c7700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffae80b9140 0x7ffae8153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:40.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.749+0000 7ffaef3c7700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffae81452c0 con 0x7ffae812b670 2020-04-22T14:17:40.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.749+0000 7ffaef3c7700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffae8154580 con 0x7ffae80ac950 2020-04-22T14:17:40.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.749+0000 7ffaef3c7700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffae8154820 con 0x7ffae80b9140 2020-04-22T14:17:40.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.749+0000 7ffaec962700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffae80b9140 0x7ffae8153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:40.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.749+0000 7ffaec962700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffae80b9140 0x7ffae8153c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57288/0 (socket says 172.21.15.103:57288) 2020-04-22T14:17:40.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.749+0000 7ffaec962700 1 -- 172.21.15.103:0/3754665953 learned_addr learned my addr 172.21.15.103:0/3754665953 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:40.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.749+0000 7ffaed163700 1 --2- 172.21.15.103:0/3754665953 >> v2:172.21.15.86:3300/0 conn(0x7ffae80ac950 0x7ffae8144e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:40.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.750+0000 7ffaec962700 1 -- 172.21.15.103:0/3754665953 >> v2:172.21.15.86:3300/0 conn(0x7ffae80ac950 msgr2=0x7ffae8144e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:40.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.750+0000 7ffaec962700 1 --2- 172.21.15.103:0/3754665953 >> v2:172.21.15.86:3300/0 conn(0x7ffae80ac950 0x7ffae8144e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:40.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.750+0000 7ffaec962700 1 -- 172.21.15.103:0/3754665953 >> v1:172.21.15.86:6789/0 conn(0x7ffae812b670 legacy=0x7ffae80b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:40.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.750+0000 7ffaec962700 1 -- 172.21.15.103:0/3754665953 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae8154ac0 con 0x7ffae80b9140 2020-04-22T14:17:40.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.750+0000 7ffaec962700 1 --2- 172.21.15.103:0/3754665953 >> v2:172.21.15.103:3300/0 conn(0x7ffae80b9140 0x7ffae8153c70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffae4000b80 tx=0x7ffae4001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:40.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.750+0000 7ffaec962700 1 --2- 172.21.15.103:0/3754665953 >> v2:172.21.15.103:3300/0 conn(0x7ffae80b9140 0x7ffae8153c70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffae4000b80 tx=0x7ffae4001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:40.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.750+0000 7ffaec962700 1 --2- 172.21.15.103:0/3754665953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffae80b9140 0x7ffae8153c70 secure :-1 s=READY pgs=1858 cs=0 l=1 rx=0x7ffae4000b80 tx=0x7ffae4001e40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:40.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.750+0000 7ffaec962700 1 --2- 172.21.15.103:0/3754665953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffae80b9140 0x7ffae8153c70 secure :-1 s=THROTTLE_DONE pgs=1858 cs=0 l=1 rx=0x7ffae4000b80 tx=0x7ffae4001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:40.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.750+0000 7ffad67fc700 1 -- 172.21.15.103:0/3754665953 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffae400ca40 con 0x7ffae80b9140 2020-04-22T14:17:40.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.750+0000 7ffaec962700 1 --2- 172.21.15.103:0/3754665953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffae80b9140 0x7ffae8153c70 secure :-1 s=THROTTLE_DONE pgs=1858 cs=0 l=1 rx=0x7ffae4000b80 tx=0x7ffae4001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:40.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.750+0000 7ffaec962700 1 --2- 172.21.15.103:0/3754665953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffae80b9140 0x7ffae8153c70 secure :-1 s=THROTTLE_DONE pgs=1858 cs=0 l=1 rx=0x7ffae4000b80 tx=0x7ffae4001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:40.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.750+0000 7ffad67fc700 1 -- 172.21.15.103:0/3754665953 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae400cba0 con 0x7ffae80b9140 2020-04-22T14:17:40.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.750+0000 7ffaef3c7700 1 -- 172.21.15.103:0/3754665953 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffae80b8630 con 0x7ffae80b9140 2020-04-22T14:17:40.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.750+0000 7ffad67fc700 1 -- 172.21.15.103:0/3754665953 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffae400d0d0 con 0x7ffae80b9140 2020-04-22T14:17:40.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.750+0000 7ffaef3c7700 1 -- 172.21.15.103:0/3754665953 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffae81540d0 con 0x7ffae80b9140 2020-04-22T14:17:40.777 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.751+0000 7ffaec962700 1 --2- 172.21.15.103:0/3754665953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffae80b9140 0x7ffae8153c70 secure :-1 s=THROTTLE_DONE pgs=1858 cs=0 l=1 rx=0x7ffae4000b80 tx=0x7ffae4001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:40.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.751+0000 7ffad67fc700 1 -- 172.21.15.103:0/3754665953 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ffae40055c0 con 0x7ffae80b9140 2020-04-22T14:17:40.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.751+0000 7ffaec962700 1 --2- 172.21.15.103:0/3754665953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffae80b9140 0x7ffae8153c70 secure :-1 s=THROTTLE_DONE pgs=1858 cs=0 l=1 rx=0x7ffae4000b80 tx=0x7ffae4001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:40.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.751+0000 7ffaef3c7700 1 -- 172.21.15.103:0/3754665953 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffae81543e0 con 0x7ffae80b9140 2020-04-22T14:17:40.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.751+0000 7ffad67fc700 1 --2- 172.21.15.103:0/3754665953 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffac804d990 0x7ffac804fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:40.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.751+0000 7ffad67fc700 1 -- 172.21.15.103:0/3754665953 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6202+0+0 (secure 0 0 0) 0x7ffae40100c0 con 0x7ffae80b9140 2020-04-22T14:17:40.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.751+0000 7ffaed163700 1 --2- 172.21.15.103:0/3754665953 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffac804d990 0x7ffac804fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:40.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.752+0000 7ffaed163700 1 --2- 172.21.15.103:0/3754665953 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffac804d990 0x7ffac804fe50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffad8002f30 tx=0x7ffad8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:40.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.752+0000 7ffaed163700 1 --2- 172.21.15.103:0/3754665953 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffac804d990 0x7ffac804fe50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffad8002f30 tx=0x7ffad8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:40.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.752+0000 7ffaed163700 1 --2- 172.21.15.103:0/3754665953 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffac804d990 0x7ffac804fe50 secure :-1 s=READY pgs=679 cs=0 l=1 rx=0x7ffad8002f30 tx=0x7ffad8007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:40.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.755+0000 7ffaec962700 1 --2- 172.21.15.103:0/3754665953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffae80b9140 0x7ffae8153c70 secure :-1 s=THROTTLE_DONE pgs=1858 cs=0 l=1 rx=0x7ffae4000b80 tx=0x7ffae4001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:40.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.755+0000 7ffad67fc700 1 -- 172.21.15.103:0/3754665953 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ffae81543e0 con 0x7ffae80b9140 2020-04-22T14:17:40.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:40.897+0000 7ffaef3c7700 1 -- 172.21.15.103:0/3754665953 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ffae81543e0 con 0x7ffae80b9140 2020-04-22T14:17:41.590 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.588+0000 7ffaec962700 1 --2- 172.21.15.103:0/3754665953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffae80b9140 0x7ffae8153c70 secure :-1 s=THROTTLE_DONE pgs=1858 cs=0 l=1 rx=0x7ffae4000b80 tx=0x7ffae4001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:41.590 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.588+0000 7ffad67fc700 1 -- 172.21.15.103:0/3754665953 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v127) v1 ==== 185+0+0 (secure 0 0 0) 0x7ffae81543e0 con 0x7ffae80b9140 2020-04-22T14:17:41.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.590+0000 7ffaef3c7700 1 -- 172.21.15.103:0/3754665953 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffac804d990 msgr2=0x7ffac804fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:41.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.590+0000 7ffaef3c7700 1 --2- 172.21.15.103:0/3754665953 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffac804d990 0x7ffac804fe50 secure :-1 s=READY pgs=679 cs=0 l=1 rx=0x7ffad8002f30 tx=0x7ffad8007a40).stop 2020-04-22T14:17:41.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.590+0000 7ffaef3c7700 1 -- 172.21.15.103:0/3754665953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffae80b9140 msgr2=0x7ffae8153c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:41.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.590+0000 7ffaef3c7700 1 --2- 172.21.15.103:0/3754665953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffae80b9140 0x7ffae8153c70 secure :-1 s=READY pgs=1858 cs=0 l=1 rx=0x7ffae4000b80 tx=0x7ffae4001e40).stop 2020-04-22T14:17:41.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.590+0000 7ffaef3c7700 1 -- 172.21.15.103:0/3754665953 shutdown_connections 2020-04-22T14:17:41.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.590+0000 7ffaef3c7700 1 --2- 172.21.15.103:0/3754665953 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffac804d990 0x7ffac804fe50 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:41.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.590+0000 7ffaef3c7700 1 --2- 172.21.15.103:0/3754665953 >> v2:172.21.15.86:3300/0 conn(0x7ffae80ac950 0x7ffae8144e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:41.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.590+0000 7ffaef3c7700 1 --2- 172.21.15.103:0/3754665953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffae80b9140 0x7ffae8153c70 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:41.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.590+0000 7ffaef3c7700 1 -- 172.21.15.103:0/3754665953 >> 172.21.15.103:0/3754665953 conn(0x7ffae805b7b0 msgr2=0x7ffae8145a60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:41.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.590+0000 7ffaef3c7700 1 -- 172.21.15.103:0/3754665953 shutdown_connections 2020-04-22T14:17:41.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.590+0000 7ffaef3c7700 1 -- 172.21.15.103:0/3754665953 wait complete. 2020-04-22T14:17:41.594 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' removed 2020-04-22T14:17:41.605 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:41.620 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2020-04-22T14:17:41.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.776+0000 7f00904ed700 1 Processor -- start 2020-04-22T14:17:41.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.776+0000 7f00904ed700 1 -- start start 2020-04-22T14:17:41.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.777+0000 7f00904ed700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00880b6560 0x7f0088066b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:41.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.777+0000 7f00904ed700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f00880ac860 0x7f00881478d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:41.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.777+0000 7f00904ed700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0088148050 con 0x7f00880ad110 2020-04-22T14:17:41.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.777+0000 7f00904ed700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00881482f0 con 0x7f00880ac860 2020-04-22T14:17:41.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.777+0000 7f00904ed700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0088148590 con 0x7f00880b6560 2020-04-22T14:17:41.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.777+0000 7f008ea8a700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f00880ad110 0x7f008813da40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49484/0 (socket says 172.21.15.103:49484) 2020-04-22T14:17:41.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.777+0000 7f008ea8a700 1 -- 172.21.15.103:0/1036575034 learned_addr learned my addr 172.21.15.103:0/1036575034 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:17:41.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.778+0000 7f008da88700 1 --2- 172.21.15.103:0/1036575034 >> v2:172.21.15.86:3300/0 conn(0x7f00880ac860 0x7f00881478d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:41.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.778+0000 7f008e289700 1 --2- 172.21.15.103:0/1036575034 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00880b6560 0x7f0088066b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:41.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.778+0000 7f008d287700 1 -- 172.21.15.103:0/1036575034 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 381424656 0 0) 0x7f0088148050 con 0x7f00880ad110 2020-04-22T14:17:41.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.778+0000 7f008d287700 1 -- 172.21.15.103:0/1036575034 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0070003230 con 0x7f00880ad110 2020-04-22T14:17:41.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.778+0000 7f008d287700 1 -- 172.21.15.103:0/1036575034 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4290579628 0 0) 0x7f0070003230 con 0x7f00880ad110 2020-04-22T14:17:41.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.778+0000 7f008d287700 1 -- 172.21.15.103:0/1036575034 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00880b6560 msgr2=0x7f0088066b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:41.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.778+0000 7f008d287700 1 --2- 172.21.15.103:0/1036575034 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00880b6560 0x7f0088066b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:41.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.778+0000 7f008d287700 1 -- 172.21.15.103:0/1036575034 >> v2:172.21.15.86:3300/0 conn(0x7f00880ac860 msgr2=0x7f00881478d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:41.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.778+0000 7f008d287700 1 --2- 172.21.15.103:0/1036575034 >> v2:172.21.15.86:3300/0 conn(0x7f00880ac860 0x7f00881478d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:41.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.778+0000 7f008d287700 1 -- 172.21.15.103:0/1036575034 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00880b6940 con 0x7f00880ad110 2020-04-22T14:17:41.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.778+0000 7f008d287700 1 -- 172.21.15.103:0/1036575034 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f0080001a50 con 0x7f00880ad110 2020-04-22T14:17:41.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.778+0000 7f008d287700 1 -- 172.21.15.103:0/1036575034 >> v1:172.21.15.103:6789/0 conn(0x7f00880ad110 legacy=0x7f008813da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:41.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.778+0000 7f008d287700 1 --2- 172.21.15.103:0/1036575034 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00880b6560 0x7f0070003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:41.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.778+0000 7f008d287700 1 --2- 172.21.15.103:0/1036575034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0070003b80 0x7f0070003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:41.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.778+0000 7f008d287700 1 --2- 172.21.15.103:0/1036575034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00700045c0 0x7f0070004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:41.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.778+0000 7f008d287700 1 -- 172.21.15.103:0/1036575034 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00881482f0 con 0x7f00700045c0 2020-04-22T14:17:41.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.778+0000 7f008d287700 1 -- 172.21.15.103:0/1036575034 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0088148590 con 0x7f0070003b80 2020-04-22T14:17:41.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.778+0000 7f008d287700 1 -- 172.21.15.103:0/1036575034 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0070005050 con 0x7f00880b6560 2020-04-22T14:17:41.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.778+0000 7f008da88700 1 --2- 172.21.15.103:0/1036575034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0070003b80 0x7f0070003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:41.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.778+0000 7f008e289700 1 --2- 172.21.15.103:0/1036575034 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00880b6560 0x7f0070003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:41.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.778+0000 7f008ea8a700 1 --2- 172.21.15.103:0/1036575034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00700045c0 0x7f0070004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:41.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.778+0000 7f008da88700 1 -- 172.21.15.103:0/1036575034 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00880b6560 msgr2=0x7f0070003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:41.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.778+0000 7f008da88700 1 --2- 172.21.15.103:0/1036575034 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00880b6560 0x7f0070003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:41.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.778+0000 7f008da88700 1 -- 172.21.15.103:0/1036575034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00700045c0 msgr2=0x7f0070004a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:41.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.778+0000 7f008da88700 1 --2- 172.21.15.103:0/1036575034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00700045c0 0x7f0070004a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:41.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.778+0000 7f008da88700 1 -- 172.21.15.103:0/1036575034 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0070003230 con 0x7f0070003b80 2020-04-22T14:17:41.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.778+0000 7f008da88700 1 --2- 172.21.15.103:0/1036575034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0070003b80 0x7f0070003fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0084002f30 tx=0x7f0084010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:41.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.778+0000 7f008da88700 1 --2- 172.21.15.103:0/1036575034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0070003b80 0x7f0070003fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0084002f30 tx=0x7f0084010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:41.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.778+0000 7f008da88700 1 --2- 172.21.15.103:0/1036575034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0070003b80 0x7f0070003fe0 secure :-1 s=READY pgs=1860 cs=0 l=1 rx=0x7f0084002f30 tx=0x7f0084010020).ready entity=mon.1 client_cookie=a850819fd99cd071 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:41.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.779+0000 7f008da88700 1 --2- 172.21.15.103:0/1036575034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0070003b80 0x7f0070003fe0 secure :-1 s=THROTTLE_DONE pgs=1860 cs=0 l=1 rx=0x7f0084002f30 tx=0x7f0084010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:41.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.779+0000 7f008d287700 1 -- 172.21.15.103:0/1036575034 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0084008df0 con 0x7f0070003b80 2020-04-22T14:17:41.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.779+0000 7f008da88700 1 --2- 172.21.15.103:0/1036575034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0070003b80 0x7f0070003fe0 secure :-1 s=THROTTLE_DONE pgs=1860 cs=0 l=1 rx=0x7f0084002f30 tx=0x7f0084010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:41.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.779+0000 7f008da88700 1 --2- 172.21.15.103:0/1036575034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0070003b80 0x7f0070003fe0 secure :-1 s=THROTTLE_DONE pgs=1860 cs=0 l=1 rx=0x7f0084002f30 tx=0x7f0084010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:41.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.779+0000 7f008d287700 1 -- 172.21.15.103:0/1036575034 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00840108a0 con 0x7f0070003b80 2020-04-22T14:17:41.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.779+0000 7f008d287700 1 -- 172.21.15.103:0/1036575034 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0084010c40 con 0x7f0070003b80 2020-04-22T14:17:41.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.779+0000 7f00904ed700 1 -- 172.21.15.103:0/1036575034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0070003b80 msgr2=0x7f0070003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:41.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.779+0000 7f00904ed700 1 --2- 172.21.15.103:0/1036575034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0070003b80 0x7f0070003fe0 secure :-1 s=READY pgs=1860 cs=0 l=1 rx=0x7f0084002f30 tx=0x7f0084010020).stop 2020-04-22T14:17:41.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.779+0000 7f008ea8a700 1 -- 172.21.15.103:0/1036575034 reap_dead start 2020-04-22T14:17:41.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.779+0000 7f00904ed700 1 -- 172.21.15.103:0/1036575034 shutdown_connections 2020-04-22T14:17:41.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.779+0000 7f00904ed700 1 -- 172.21.15.103:0/1036575034 >> 172.21.15.103:0/1036575034 conn(0x7f00880610c0 msgr2=0x7f008805f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:41.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.779+0000 7f00904ed700 1 -- 172.21.15.103:0/1036575034 shutdown_connections 2020-04-22T14:17:41.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.779+0000 7f00904ed700 1 -- 172.21.15.103:0/1036575034 wait complete. 2020-04-22T14:17:41.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.780+0000 7f00904ed700 1 Processor -- start 2020-04-22T14:17:41.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.780+0000 7f00904ed700 1 -- start start 2020-04-22T14:17:41.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.781+0000 7f00904ed700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0088154c20 0x7f0088151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:41.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.781+0000 7f00904ed700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0088151dd0 con 0x7f00880af4c0 2020-04-22T14:17:41.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.781+0000 7f00904ed700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0088152070 con 0x7f0088146130 2020-04-22T14:17:41.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.781+0000 7f00904ed700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0088140c30 con 0x7f0088154c20 2020-04-22T14:17:41.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.781+0000 7f008ea8a700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f0088146130 0x7f0088146560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49496/0 (socket says 172.21.15.103:49496) 2020-04-22T14:17:41.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.781+0000 7f008ea8a700 1 -- 172.21.15.103:0/4271010626 learned_addr learned my addr 172.21.15.103:0/4271010626 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:17:41.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.781+0000 7f008da88700 1 --2- 172.21.15.103:0/4271010626 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0088154c20 0x7f0088151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:41.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.781+0000 7f007b7fe700 1 -- 172.21.15.103:0/4271010626 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 757881236 0 0) 0x7f0088152070 con 0x7f0088146130 2020-04-22T14:17:41.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.781+0000 7f007b7fe700 1 -- 172.21.15.103:0/4271010626 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0068002fe0 con 0x7f0088146130 2020-04-22T14:17:41.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.781+0000 7f007b7fe700 1 -- 172.21.15.103:0/4271010626 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3371949096 0 0) 0x7f0088151dd0 con 0x7f00880af4c0 2020-04-22T14:17:41.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.781+0000 7f007b7fe700 1 -- 172.21.15.103:0/4271010626 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0088152070 con 0x7f00880af4c0 2020-04-22T14:17:41.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.781+0000 7f008da88700 1 -- 172.21.15.103:0/4271010626 >> v1:172.21.15.103:6789/0 conn(0x7f0088146130 legacy=0x7f0088146560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:41.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.781+0000 7f008da88700 1 -- 172.21.15.103:0/4271010626 >> v1:172.21.15.86:6789/0 conn(0x7f00880af4c0 legacy=0x7f0088155330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:41.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.781+0000 7f007b7fe700 1 -- 172.21.15.103:0/4271010626 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 184437891 0 0) 0x7f0068002fe0 con 0x7f0088146130 2020-04-22T14:17:41.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.781+0000 7f008da88700 1 -- 172.21.15.103:0/4271010626 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0088152310 con 0x7f0088154c20 2020-04-22T14:17:41.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.781+0000 7f008da88700 1 --2- 172.21.15.103:0/4271010626 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0088154c20 0x7f0088151650 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0080001cb0 tx=0x7f0084010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:41.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.781+0000 7f008da88700 1 --2- 172.21.15.103:0/4271010626 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0088154c20 0x7f0088151650 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0080001cb0 tx=0x7f0084010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:41.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.781+0000 7f008da88700 1 --2- 172.21.15.103:0/4271010626 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0088154c20 0x7f0088151650 secure :-1 s=READY pgs=173 cs=0 l=1 rx=0x7f0080001cb0 tx=0x7f0084010020).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:41.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.782+0000 7f008da88700 1 --2- 172.21.15.103:0/4271010626 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0088154c20 0x7f0088151650 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f0080001cb0 tx=0x7f0084010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:41.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.782+0000 7f007b7fe700 1 -- 172.21.15.103:0/4271010626 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f008000eeb0 con 0x7f0088154c20 2020-04-22T14:17:41.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.782+0000 7f008da88700 1 --2- 172.21.15.103:0/4271010626 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0088154c20 0x7f0088151650 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f0080001cb0 tx=0x7f0084010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:41.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.782+0000 7f008da88700 1 --2- 172.21.15.103:0/4271010626 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0088154c20 0x7f0088151650 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f0080001cb0 tx=0x7f0084010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:41.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.782+0000 7f007b7fe700 1 -- 172.21.15.103:0/4271010626 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0084007170 con 0x7f0088154c20 2020-04-22T14:17:41.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.782+0000 7f00904ed700 1 -- 172.21.15.103:0/4271010626 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00880af8a0 con 0x7f0088154c20 2020-04-22T14:17:41.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.782+0000 7f007b7fe700 1 -- 172.21.15.103:0/4271010626 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00840074d0 con 0x7f0088154c20 2020-04-22T14:17:41.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.782+0000 7f00904ed700 1 -- 172.21.15.103:0/4271010626 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0088151ab0 con 0x7f0088154c20 2020-04-22T14:17:41.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.782+0000 7f008da88700 1 --2- 172.21.15.103:0/4271010626 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0088154c20 0x7f0088151650 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f0080001cb0 tx=0x7f0084010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:41.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.783+0000 7f00904ed700 1 -- 172.21.15.103:0/4271010626 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0088056c90 con 0x7f0088154c20 2020-04-22T14:17:41.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.783+0000 7f007b7fe700 1 -- 172.21.15.103:0/4271010626 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f00840056c0 con 0x7f0088154c20 2020-04-22T14:17:41.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.783+0000 7f008da88700 1 --2- 172.21.15.103:0/4271010626 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0088154c20 0x7f0088151650 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f0080001cb0 tx=0x7f0084010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:41.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.783+0000 7f007b7fe700 1 --2- 172.21.15.103:0/4271010626 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f006804dde0 0x7f00680502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:41.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.783+0000 7f007b7fe700 1 -- 172.21.15.103:0/4271010626 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5764+0+0 (secure 0 0 0) 0x7f0084060b40 con 0x7f0088154c20 2020-04-22T14:17:41.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.783+0000 7f008e289700 1 --2- 172.21.15.103:0/4271010626 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f006804dde0 0x7f00680502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:41.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.783+0000 7f008e289700 1 --2- 172.21.15.103:0/4271010626 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f006804dde0 0x7f00680502a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f007c003070 tx=0x7f007c007c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:41.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.783+0000 7f008e289700 1 --2- 172.21.15.103:0/4271010626 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f006804dde0 0x7f00680502a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f007c003070 tx=0x7f007c007c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:41.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.783+0000 7f008e289700 1 --2- 172.21.15.103:0/4271010626 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f006804dde0 0x7f00680502a0 secure :-1 s=READY pgs=680 cs=0 l=1 rx=0x7f007c003070 tx=0x7f007c007c80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:41.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.787+0000 7f008da88700 1 --2- 172.21.15.103:0/4271010626 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0088154c20 0x7f0088151650 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f0080001cb0 tx=0x7f0084010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:41.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.787+0000 7f007b7fe700 1 -- 172.21.15.103:0/4271010626 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f008403c040 con 0x7f0088154c20 2020-04-22T14:17:41.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:41.928+0000 7f00904ed700 1 -- 172.21.15.103:0/4271010626 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f00880b5fc0 con 0x7f0088154c20 2020-04-22T14:17:42.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.600+0000 7f008da88700 1 --2- 172.21.15.103:0/4271010626 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0088154c20 0x7f0088151650 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f0080001cb0 tx=0x7f0084010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:42.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.600+0000 7f007b7fe700 1 -- 172.21.15.103:0/4271010626 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v128) v1 ==== 173+0+0 (secure 0 0 0) 0x7f008403f660 con 0x7f0088154c20 2020-04-22T14:17:42.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.601+0000 7f00904ed700 1 -- 172.21.15.103:0/4271010626 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f006804dde0 msgr2=0x7f00680502a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:42.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.601+0000 7f00904ed700 1 --2- 172.21.15.103:0/4271010626 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f006804dde0 0x7f00680502a0 secure :-1 s=READY pgs=680 cs=0 l=1 rx=0x7f007c003070 tx=0x7f007c007c80).stop 2020-04-22T14:17:42.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.601+0000 7f00904ed700 1 -- 172.21.15.103:0/4271010626 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0088154c20 msgr2=0x7f0088151650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:42.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.601+0000 7f00904ed700 1 --2- 172.21.15.103:0/4271010626 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0088154c20 0x7f0088151650 secure :-1 s=READY pgs=173 cs=0 l=1 rx=0x7f0080001cb0 tx=0x7f0084010020).stop 2020-04-22T14:17:42.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.601+0000 7f00904ed700 1 -- 172.21.15.103:0/4271010626 shutdown_connections 2020-04-22T14:17:42.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.601+0000 7f00904ed700 1 --2- 172.21.15.103:0/4271010626 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f006804dde0 0x7f00680502a0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:42.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.601+0000 7f00904ed700 1 --2- 172.21.15.103:0/4271010626 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0088154c20 0x7f0088151650 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:42.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.601+0000 7f00904ed700 1 -- 172.21.15.103:0/4271010626 >> 172.21.15.103:0/4271010626 conn(0x7f00880610c0 msgr2=0x7f0088143400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:42.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.601+0000 7f00904ed700 1 -- 172.21.15.103:0/4271010626 shutdown_connections 2020-04-22T14:17:42.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.601+0000 7f00904ed700 1 -- 172.21.15.103:0/4271010626 wait complete. 2020-04-22T14:17:42.605 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' removed 2020-04-22T14:17:42.614 INFO:tasks.ceph.mds.a:Restarting daemon 2020-04-22T14:17:42.614 INFO:tasks.ceph.mds.a:Stopping old one... 2020-04-22T14:17:42.614 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-04-22T14:17:42.615 INFO:teuthology.orchestra.run:waiting for 300 2020-04-22T14:17:42.615 INFO:tasks.ceph.mds.b:Restarting daemon 2020-04-22T14:17:42.615 INFO:tasks.ceph.mds.b:Stopping old one... 2020-04-22T14:17:42.615 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-04-22T14:17:42.615 INFO:teuthology.orchestra.run:waiting for 300 2020-04-22T14:17:42.623 INFO:tasks.ceph.mds.a:Stopped 2020-04-22T14:17:42.623 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:42.625 INFO:tasks.ceph.mds.b:Stopped 2020-04-22T14:17:42.625 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:17:42.677 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-04-22T14:17:42.681 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-04-22T14:17:42.721 INFO:tasks.ceph.mds.a:Started 2020-04-22T14:17:42.721 DEBUG:teuthology.parallel:result is None 2020-04-22T14:17:42.723 INFO:tasks.ceph.mds.b:Started 2020-04-22T14:17:42.724 DEBUG:teuthology.parallel:result is None 2020-04-22T14:17:42.724 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:42.736 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2020-04-22T14:17:42.794 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2020-04-22T14:17:42.805 INFO:tasks.ceph.mds.b.smithi086.stdout:starting mds.b at 2020-04-22T14:17:42.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.885+0000 7fcaa85ca700 1 Processor -- start 2020-04-22T14:17:42.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.885+0000 7fcaa85ca700 1 -- start start 2020-04-22T14:17:42.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.886+0000 7fcaa85ca700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcaa005b0b0 0x7fcaa00b86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:42.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.886+0000 7fcaa85ca700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcaa005b490 0x7fcaa005f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:42.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.886+0000 7fcaa85ca700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaa005b920 con 0x7fcaa005fc60 2020-04-22T14:17:42.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.886+0000 7fcaa85ca700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaa0146830 con 0x7fcaa005b0b0 2020-04-22T14:17:42.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.886+0000 7fcaa85ca700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaa014ab90 con 0x7fcaa005b490 2020-04-22T14:17:42.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.886+0000 7fcaa5b65700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcaa005b490 0x7fcaa005f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:42.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.886+0000 7fcaa5b65700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcaa005b490 0x7fcaa005f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57324/0 (socket says 172.21.15.103:57324) 2020-04-22T14:17:42.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.886+0000 7fcaa6b67700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fcaa005fc60 0x7fcaa0143a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49512/0 (socket says 172.21.15.103:49512) 2020-04-22T14:17:42.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.886+0000 7fcaa5b65700 1 -- 172.21.15.103:0/3042112244 learned_addr learned my addr 172.21.15.103:0/3042112244 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:42.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.886+0000 7fcaa6366700 1 --2- 172.21.15.103:0/3042112244 >> v2:172.21.15.86:3300/0 conn(0x7fcaa005b0b0 0x7fcaa00b86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:42.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.886+0000 7fcaa5b65700 1 -- 172.21.15.103:0/3042112244 >> v2:172.21.15.86:3300/0 conn(0x7fcaa005b0b0 msgr2=0x7fcaa00b86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:42.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.886+0000 7fcaa5b65700 1 --2- 172.21.15.103:0/3042112244 >> v2:172.21.15.86:3300/0 conn(0x7fcaa005b0b0 0x7fcaa00b86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:42.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.886+0000 7fcaa5b65700 1 -- 172.21.15.103:0/3042112244 >> v1:172.21.15.103:6789/0 conn(0x7fcaa005fc60 legacy=0x7fcaa0143a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:42.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.886+0000 7fcaa5b65700 1 -- 172.21.15.103:0/3042112244 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa0146a20 con 0x7fcaa005b490 2020-04-22T14:17:42.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.886+0000 7fcaa5364700 1 -- 172.21.15.103:0/3042112244 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1266496040 0 0) 0x7fcaa005b920 con 0x7fcaa005fc60 2020-04-22T14:17:42.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.887+0000 7fcaa5b65700 1 --2- 172.21.15.103:0/3042112244 >> v2:172.21.15.103:3300/0 conn(0x7fcaa005b490 0x7fcaa005f800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcaa0060ab0 tx=0x7fca9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:42.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.887+0000 7fcaa5b65700 1 --2- 172.21.15.103:0/3042112244 >> v2:172.21.15.103:3300/0 conn(0x7fcaa005b490 0x7fcaa005f800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcaa0060ab0 tx=0x7fca9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:42.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.887+0000 7fcaa5b65700 1 --2- 172.21.15.103:0/3042112244 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaa005b490 0x7fcaa005f800 secure :-1 s=READY pgs=1866 cs=0 l=1 rx=0x7fcaa0060ab0 tx=0x7fca9c007a40).ready entity=mon.1 client_cookie=55be088b874f395f server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:42.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.887+0000 7fcaa5b65700 1 --2- 172.21.15.103:0/3042112244 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaa005b490 0x7fcaa005f800 secure :-1 s=THROTTLE_DONE pgs=1866 cs=0 l=1 rx=0x7fcaa0060ab0 tx=0x7fca9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:42.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.887+0000 7fcaa5364700 1 -- 172.21.15.103:0/3042112244 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca9c0116e0 con 0x7fcaa005b490 2020-04-22T14:17:42.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.887+0000 7fcaa5b65700 1 --2- 172.21.15.103:0/3042112244 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaa005b490 0x7fcaa005f800 secure :-1 s=THROTTLE_DONE pgs=1866 cs=0 l=1 rx=0x7fcaa0060ab0 tx=0x7fca9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:42.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.887+0000 7fcaa5364700 1 -- 172.21.15.103:0/3042112244 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9c011880 con 0x7fcaa005b490 2020-04-22T14:17:42.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.887+0000 7fcaa5b65700 1 --2- 172.21.15.103:0/3042112244 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaa005b490 0x7fcaa005f800 secure :-1 s=THROTTLE_DONE pgs=1866 cs=0 l=1 rx=0x7fcaa0060ab0 tx=0x7fca9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:42.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.887+0000 7fcaa5364700 1 -- 172.21.15.103:0/3042112244 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca9c011c60 con 0x7fcaa005b490 2020-04-22T14:17:42.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.887+0000 7fcaa85ca700 1 -- 172.21.15.103:0/3042112244 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaa005b490 msgr2=0x7fcaa005f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:42.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.887+0000 7fcaa85ca700 1 --2- 172.21.15.103:0/3042112244 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaa005b490 0x7fcaa005f800 secure :-1 s=READY pgs=1866 cs=0 l=1 rx=0x7fcaa0060ab0 tx=0x7fca9c007a40).stop 2020-04-22T14:17:42.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.887+0000 7fcaa85ca700 1 -- 172.21.15.103:0/3042112244 shutdown_connections 2020-04-22T14:17:42.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.887+0000 7fcaa85ca700 1 --2- 172.21.15.103:0/3042112244 >> v2:172.21.15.86:3300/0 conn(0x7fcaa005b0b0 0x7fcaa00b86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:42.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.887+0000 7fcaa85ca700 1 --2- 172.21.15.103:0/3042112244 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaa005b490 0x7fcaa005f800 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:42.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.887+0000 7fcaa85ca700 1 -- 172.21.15.103:0/3042112244 >> 172.21.15.103:0/3042112244 conn(0x7fcaa00bcae0 msgr2=0x7fcaa00bcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:42.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.887+0000 7fcaa85ca700 1 -- 172.21.15.103:0/3042112244 shutdown_connections 2020-04-22T14:17:42.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.887+0000 7fcaa85ca700 1 -- 172.21.15.103:0/3042112244 wait complete. 2020-04-22T14:17:42.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.888+0000 7fcaa85ca700 1 Processor -- start 2020-04-22T14:17:42.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.888+0000 7fcaa85ca700 1 -- start start 2020-04-22T14:17:42.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.889+0000 7fcaa85ca700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcaa005b0b0 0x7fcaa00bbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:42.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.889+0000 7fcaa85ca700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcaa005b490 0x7fcaa01477b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:42.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.889+0000 7fcaa85ca700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcaa005fc60 0x7fcaa0154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:42.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.889+0000 7fcaa85ca700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaa00bc1d0 con 0x7fcaa005b0b0 2020-04-22T14:17:42.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.889+0000 7fcaa85ca700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaa0147c10 con 0x7fcaa005b490 2020-04-22T14:17:42.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.889+0000 7fcaa85ca700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa00ae010 con 0x7fcaa005fc60 2020-04-22T14:17:42.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.889+0000 7fcaa5b65700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcaa005b490 0x7fcaa01477b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:42.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.889+0000 7fcaa5b65700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcaa005b490 0x7fcaa01477b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57328/0 (socket says 172.21.15.103:57328) 2020-04-22T14:17:42.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.889+0000 7fcaa5b65700 1 -- 172.21.15.103:0/2178105855 learned_addr learned my addr 172.21.15.103:0/2178105855 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:42.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.889+0000 7fcaa6366700 1 --2- 172.21.15.103:0/2178105855 >> v2:172.21.15.86:3300/0 conn(0x7fcaa005b0b0 0x7fcaa00bbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:42.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.889+0000 7fcaa6b67700 1 --2- 172.21.15.103:0/2178105855 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcaa005fc60 0x7fcaa0154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:42.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.889+0000 7fcaa5b65700 1 -- 172.21.15.103:0/2178105855 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcaa005fc60 msgr2=0x7fcaa0154240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:42.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.889+0000 7fcaa5b65700 1 --2- 172.21.15.103:0/2178105855 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcaa005fc60 0x7fcaa0154240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:42.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.889+0000 7fcaa5b65700 1 -- 172.21.15.103:0/2178105855 >> v2:172.21.15.86:3300/0 conn(0x7fcaa005b0b0 msgr2=0x7fcaa00bbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:42.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.889+0000 7fcaa5b65700 1 --2- 172.21.15.103:0/2178105855 >> v2:172.21.15.86:3300/0 conn(0x7fcaa005b0b0 0x7fcaa00bbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:42.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.889+0000 7fcaa5b65700 1 -- 172.21.15.103:0/2178105855 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa00ae2b0 con 0x7fcaa005b490 2020-04-22T14:17:42.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.889+0000 7fcaa5b65700 1 --2- 172.21.15.103:0/2178105855 >> v2:172.21.15.103:3300/0 conn(0x7fcaa005b490 0x7fcaa01477b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcaa0060ab0 tx=0x7fca9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:42.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.889+0000 7fcaa5b65700 1 --2- 172.21.15.103:0/2178105855 >> v2:172.21.15.103:3300/0 conn(0x7fcaa005b490 0x7fcaa01477b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcaa0060ab0 tx=0x7fca9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:42.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.889+0000 7fcaa5b65700 1 --2- 172.21.15.103:0/2178105855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaa005b490 0x7fcaa01477b0 secure :-1 s=READY pgs=1867 cs=0 l=1 rx=0x7fcaa0060ab0 tx=0x7fca9c007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:42.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.890+0000 7fcaa5b65700 1 --2- 172.21.15.103:0/2178105855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaa005b490 0x7fcaa01477b0 secure :-1 s=THROTTLE_DONE pgs=1867 cs=0 l=1 rx=0x7fcaa0060ab0 tx=0x7fca9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:42.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.890+0000 7fca8f7fe700 1 -- 172.21.15.103:0/2178105855 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca9c007170 con 0x7fcaa005b490 2020-04-22T14:17:42.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.890+0000 7fcaa5b65700 1 --2- 172.21.15.103:0/2178105855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaa005b490 0x7fcaa01477b0 secure :-1 s=THROTTLE_DONE pgs=1867 cs=0 l=1 rx=0x7fcaa0060ab0 tx=0x7fca9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:42.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.890+0000 7fcaa5b65700 1 --2- 172.21.15.103:0/2178105855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaa005b490 0x7fcaa01477b0 secure :-1 s=THROTTLE_DONE pgs=1867 cs=0 l=1 rx=0x7fcaa0060ab0 tx=0x7fca9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:42.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.890+0000 7fca8f7fe700 1 -- 172.21.15.103:0/2178105855 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9c0072d0 con 0x7fcaa005b490 2020-04-22T14:17:42.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.890+0000 7fca8f7fe700 1 -- 172.21.15.103:0/2178105855 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca9c0056c0 con 0x7fcaa005b490 2020-04-22T14:17:42.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.890+0000 7fcaa85ca700 1 -- 172.21.15.103:0/2178105855 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa01495a0 con 0x7fcaa005b490 2020-04-22T14:17:42.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.890+0000 7fcaa85ca700 1 -- 172.21.15.103:0/2178105855 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa0153b40 con 0x7fcaa005b490 2020-04-22T14:17:42.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.890+0000 7fcaa5b65700 1 --2- 172.21.15.103:0/2178105855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaa005b490 0x7fcaa01477b0 secure :-1 s=THROTTLE_DONE pgs=1867 cs=0 l=1 rx=0x7fcaa0060ab0 tx=0x7fca9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:42.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.891+0000 7fca8f7fe700 1 -- 172.21.15.103:0/2178105855 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fca9c005820 con 0x7fcaa005b490 2020-04-22T14:17:42.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.891+0000 7fcaa5b65700 1 --2- 172.21.15.103:0/2178105855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaa005b490 0x7fcaa01477b0 secure :-1 s=THROTTLE_DONE pgs=1867 cs=0 l=1 rx=0x7fcaa0060ab0 tx=0x7fca9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:42.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.891+0000 7fcaa85ca700 1 -- 172.21.15.103:0/2178105855 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaa00ae440 con 0x7fcaa005b490 2020-04-22T14:17:42.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.891+0000 7fca8f7fe700 1 --2- 172.21.15.103:0/2178105855 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fca8004d940 0x7fca8004fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:42.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.891+0000 7fca8f7fe700 1 -- 172.21.15.103:0/2178105855 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fca9c061a40 con 0x7fcaa005b490 2020-04-22T14:17:42.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.891+0000 7fcaa6366700 1 --2- 172.21.15.103:0/2178105855 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fca8004d940 0x7fca8004fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:42.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.891+0000 7fcaa6366700 1 --2- 172.21.15.103:0/2178105855 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fca8004d940 0x7fca8004fe00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fca90002f30 tx=0x7fca9000d710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:42.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.891+0000 7fcaa6366700 1 --2- 172.21.15.103:0/2178105855 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fca8004d940 0x7fca8004fe00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fca90002f30 tx=0x7fca9000d710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:42.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.891+0000 7fcaa6366700 1 --2- 172.21.15.103:0/2178105855 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fca8004d940 0x7fca8004fe00 secure :-1 s=READY pgs=681 cs=0 l=1 rx=0x7fca90002f30 tx=0x7fca9000d710).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:42.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.895+0000 7fcaa5b65700 1 --2- 172.21.15.103:0/2178105855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaa005b490 0x7fcaa01477b0 secure :-1 s=THROTTLE_DONE pgs=1867 cs=0 l=1 rx=0x7fcaa0060ab0 tx=0x7fca9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:42.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:42.895+0000 7fca8f7fe700 1 -- 172.21.15.103:0/2178105855 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fca9c03cee0 con 0x7fcaa005b490 2020-04-22T14:17:43.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:43.055+0000 7fcaa85ca700 1 -- 172.21.15.103:0/2178105855 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fcaa0056c90 con 0x7fcaa005b490 2020-04-22T14:17:43.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:43.837+0000 7fcaa5b65700 1 --2- 172.21.15.103:0/2178105855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaa005b490 0x7fcaa01477b0 secure :-1 s=THROTTLE_DONE pgs=1867 cs=0 l=1 rx=0x7fcaa0060ab0 tx=0x7fca9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:43.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:43.837+0000 7fca8f7fe700 1 -- 172.21.15.103:0/2178105855 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v131) v1 ==== 97+0+0 (secure 0 0 0) 0x7fca9c040500 con 0x7fcaa005b490 2020-04-22T14:17:43.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:43.838+0000 7fcaa85ca700 1 -- 172.21.15.103:0/2178105855 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fca8004d940 msgr2=0x7fca8004fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:43.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:43.838+0000 7fcaa85ca700 1 --2- 172.21.15.103:0/2178105855 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fca8004d940 0x7fca8004fe00 secure :-1 s=READY pgs=681 cs=0 l=1 rx=0x7fca90002f30 tx=0x7fca9000d710).stop 2020-04-22T14:17:43.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:43.838+0000 7fcaa85ca700 1 -- 172.21.15.103:0/2178105855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaa005b490 msgr2=0x7fcaa01477b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:43.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:43.838+0000 7fcaa85ca700 1 --2- 172.21.15.103:0/2178105855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaa005b490 0x7fcaa01477b0 secure :-1 s=READY pgs=1867 cs=0 l=1 rx=0x7fcaa0060ab0 tx=0x7fca9c007a40).stop 2020-04-22T14:17:43.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:43.839+0000 7fcaa85ca700 1 -- 172.21.15.103:0/2178105855 shutdown_connections 2020-04-22T14:17:43.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:43.839+0000 7fcaa85ca700 1 --2- 172.21.15.103:0/2178105855 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fca8004d940 0x7fca8004fe00 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:43.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:43.839+0000 7fcaa85ca700 1 --2- 172.21.15.103:0/2178105855 >> v2:172.21.15.86:3300/0 conn(0x7fcaa005b0b0 0x7fcaa00bbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:43.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:43.839+0000 7fcaa85ca700 1 --2- 172.21.15.103:0/2178105855 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcaa005fc60 0x7fcaa0154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:43.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:43.839+0000 7fcaa85ca700 1 --2- 172.21.15.103:0/2178105855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaa005b490 0x7fcaa01477b0 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:43.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:43.839+0000 7fcaa85ca700 1 -- 172.21.15.103:0/2178105855 >> 172.21.15.103:0/2178105855 conn(0x7fcaa00bcae0 msgr2=0x7fcaa0146040 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:43.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:43.839+0000 7fcaa85ca700 1 -- 172.21.15.103:0/2178105855 shutdown_connections 2020-04-22T14:17:43.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:43.839+0000 7fcaa85ca700 1 -- 172.21.15.103:0/2178105855 wait complete. 2020-04-22T14:17:43.843 INFO:teuthology.orchestra.run.smithi103.stderr: removed all blacklist entries 2020-04-22T14:17:43.852 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2020-04-22T14:17:43.852 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:43.907 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2020-04-22T14:17:44.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.052+0000 7f6908e66700 1 Processor -- start 2020-04-22T14:17:44.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.052+0000 7f6908e66700 1 -- start start 2020-04-22T14:17:44.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.053+0000 7f6908e66700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f690412c0d0 0x7f69041464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:44.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.053+0000 7f6908e66700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6904065fe0 0x7f690405b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:44.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.053+0000 7f6908e66700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f690405b8a0 0x7f6904062ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:44.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.053+0000 7f6908e66700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f690412c4b0 con 0x7f690412c0d0 2020-04-22T14:17:44.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.053+0000 7f6908e66700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6904143300 con 0x7f6904065fe0 2020-04-22T14:17:44.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.053+0000 7f6908e66700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69041435a0 con 0x7f690405b8a0 2020-04-22T14:17:44.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.053+0000 7f6901d9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6904065fe0 0x7f690405b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:44.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.053+0000 7f6901d9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6904065fe0 0x7f690405b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57340/0 (socket says 172.21.15.103:57340) 2020-04-22T14:17:44.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.053+0000 7f6901d9b700 1 -- 172.21.15.103:0/657447759 learned_addr learned my addr 172.21.15.103:0/657447759 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:44.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.054+0000 7f6902d9d700 1 --2- 172.21.15.103:0/657447759 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f690405b8a0 0x7f6904062ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:44.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.054+0000 7f6901d9b700 1 -- 172.21.15.103:0/657447759 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f690405b8a0 msgr2=0x7f6904062ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:44.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.054+0000 7f690259c700 1 --2- 172.21.15.103:0/657447759 >> v2:172.21.15.86:3300/0 conn(0x7f690412c0d0 0x7f69041464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:44.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.054+0000 7f6901d9b700 1 --2- 172.21.15.103:0/657447759 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f690405b8a0 0x7f6904062ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:44.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.054+0000 7f6901d9b700 1 -- 172.21.15.103:0/657447759 >> v2:172.21.15.86:3300/0 conn(0x7f690412c0d0 msgr2=0x7f69041464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:44.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.054+0000 7f6901d9b700 1 --2- 172.21.15.103:0/657447759 >> v2:172.21.15.86:3300/0 conn(0x7f690412c0d0 0x7f69041464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:44.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.054+0000 7f6901d9b700 1 -- 172.21.15.103:0/657447759 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6904143840 con 0x7f6904065fe0 2020-04-22T14:17:44.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.054+0000 7f6901d9b700 1 --2- 172.21.15.103:0/657447759 >> v2:172.21.15.103:3300/0 conn(0x7f6904065fe0 0x7f690405b440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f68f4002f30 tx=0x7f68f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.054+0000 7f6901d9b700 1 --2- 172.21.15.103:0/657447759 >> v2:172.21.15.103:3300/0 conn(0x7f6904065fe0 0x7f690405b440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f68f4002f30 tx=0x7f68f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.054+0000 7f6901d9b700 1 --2- 172.21.15.103:0/657447759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6904065fe0 0x7f690405b440 secure :-1 s=READY pgs=1868 cs=0 l=1 rx=0x7f68f4002f30 tx=0x7f68f4007a40).ready entity=mon.1 client_cookie=9e7c5ddcf3fda6fe server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:44.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.054+0000 7f6901d9b700 1 --2- 172.21.15.103:0/657447759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6904065fe0 0x7f690405b440 secure :-1 s=THROTTLE_DONE pgs=1868 cs=0 l=1 rx=0x7f68f4002f30 tx=0x7f68f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.054+0000 7f690159a700 1 -- 172.21.15.103:0/657447759 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68f4011720 con 0x7f6904065fe0 2020-04-22T14:17:44.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.054+0000 7f6901d9b700 1 --2- 172.21.15.103:0/657447759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6904065fe0 0x7f690405b440 secure :-1 s=THROTTLE_DONE pgs=1868 cs=0 l=1 rx=0x7f68f4002f30 tx=0x7f68f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.054+0000 7f6901d9b700 1 --2- 172.21.15.103:0/657447759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6904065fe0 0x7f690405b440 secure :-1 s=THROTTLE_DONE pgs=1868 cs=0 l=1 rx=0x7f68f4002f30 tx=0x7f68f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.054+0000 7f690159a700 1 -- 172.21.15.103:0/657447759 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f4011880 con 0x7f6904065fe0 2020-04-22T14:17:44.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.054+0000 7f690159a700 1 -- 172.21.15.103:0/657447759 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68f4011ca0 con 0x7f6904065fe0 2020-04-22T14:17:44.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.054+0000 7f6908e66700 1 -- 172.21.15.103:0/657447759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6904065fe0 msgr2=0x7f690405b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:44.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.054+0000 7f6908e66700 1 --2- 172.21.15.103:0/657447759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6904065fe0 0x7f690405b440 secure :-1 s=READY pgs=1868 cs=0 l=1 rx=0x7f68f4002f30 tx=0x7f68f4007a40).stop 2020-04-22T14:17:44.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.055+0000 7f6908e66700 1 -- 172.21.15.103:0/657447759 shutdown_connections 2020-04-22T14:17:44.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.055+0000 7f6908e66700 1 --2- 172.21.15.103:0/657447759 >> v2:172.21.15.86:3300/0 conn(0x7f690412c0d0 0x7f69041464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:44.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.055+0000 7f6908e66700 1 --2- 172.21.15.103:0/657447759 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f690405b8a0 0x7f6904062ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:44.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.055+0000 7f6908e66700 1 --2- 172.21.15.103:0/657447759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6904065fe0 0x7f690405b440 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:44.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.055+0000 7f6908e66700 1 -- 172.21.15.103:0/657447759 >> 172.21.15.103:0/657447759 conn(0x7f69040b9160 msgr2=0x7f690405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:44.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.055+0000 7f6908e66700 1 -- 172.21.15.103:0/657447759 shutdown_connections 2020-04-22T14:17:44.069 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.055+0000 7f6908e66700 1 -- 172.21.15.103:0/657447759 wait complete. 2020-04-22T14:17:44.070 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.056+0000 7f6908e66700 1 Processor -- start 2020-04-22T14:17:44.070 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.056+0000 7f6908e66700 1 -- start start 2020-04-22T14:17:44.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.057+0000 7f6908e66700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f690405b8a0 0x7f6904148850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:44.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.057+0000 7f6908e66700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6904065fe0 0x7f690412ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:44.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.057+0000 7f6908e66700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f690412c0d0 0x7f690412b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:44.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.057+0000 7f6908e66700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6904149c20 con 0x7f690412c0d0 2020-04-22T14:17:44.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.057+0000 7f6908e66700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6904149ec0 con 0x7f690405b8a0 2020-04-22T14:17:44.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.057+0000 7f6908e66700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f690414a160 con 0x7f6904065fe0 2020-04-22T14:17:44.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.057+0000 7f690259c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f690405b8a0 0x7f6904148850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:44.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.057+0000 7f690259c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f690405b8a0 0x7f6904148850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57342/0 (socket says 172.21.15.103:57342) 2020-04-22T14:17:44.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.057+0000 7f690259c700 1 -- 172.21.15.103:0/3384178585 learned_addr learned my addr 172.21.15.103:0/3384178585 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:44.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.057+0000 7f6902d9d700 1 --2- 172.21.15.103:0/3384178585 >> v2:172.21.15.86:3300/0 conn(0x7f690412c0d0 0x7f690412b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:44.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.057+0000 7f6901d9b700 1 --2- 172.21.15.103:0/3384178585 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6904065fe0 0x7f690412ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:44.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.057+0000 7f690259c700 1 -- 172.21.15.103:0/3384178585 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6904065fe0 msgr2=0x7f690412ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:44.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.057+0000 7f690259c700 1 --2- 172.21.15.103:0/3384178585 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6904065fe0 0x7f690412ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:44.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.057+0000 7f690259c700 1 -- 172.21.15.103:0/3384178585 >> v2:172.21.15.86:3300/0 conn(0x7f690412c0d0 msgr2=0x7f690412b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:44.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.057+0000 7f690259c700 1 --2- 172.21.15.103:0/3384178585 >> v2:172.21.15.86:3300/0 conn(0x7f690412c0d0 0x7f690412b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:44.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.057+0000 7f690259c700 1 -- 172.21.15.103:0/3384178585 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6904148cb0 con 0x7f690405b8a0 2020-04-22T14:17:44.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.057+0000 7f690259c700 1 --2- 172.21.15.103:0/3384178585 >> v2:172.21.15.103:3300/0 conn(0x7f690405b8a0 0x7f6904148850 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f68f8002f30 tx=0x7f68f8010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.057+0000 7f690259c700 1 --2- 172.21.15.103:0/3384178585 >> v2:172.21.15.103:3300/0 conn(0x7f690405b8a0 0x7f6904148850 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f68f8002f30 tx=0x7f68f8010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.057+0000 7f690259c700 1 --2- 172.21.15.103:0/3384178585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f690405b8a0 0x7f6904148850 secure :-1 s=READY pgs=1869 cs=0 l=1 rx=0x7f68f8002f30 tx=0x7f68f8010a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:44.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.057+0000 7f690259c700 1 --2- 172.21.15.103:0/3384178585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f690405b8a0 0x7f6904148850 secure :-1 s=THROTTLE_DONE pgs=1869 cs=0 l=1 rx=0x7f68f8002f30 tx=0x7f68f8010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.057+0000 7f68f37fe700 1 -- 172.21.15.103:0/3384178585 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68f800a370 con 0x7f690405b8a0 2020-04-22T14:17:44.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.058+0000 7f690259c700 1 --2- 172.21.15.103:0/3384178585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f690405b8a0 0x7f6904148850 secure :-1 s=THROTTLE_DONE pgs=1869 cs=0 l=1 rx=0x7f68f8002f30 tx=0x7f68f8010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.058+0000 7f690259c700 1 --2- 172.21.15.103:0/3384178585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f690405b8a0 0x7f6904148850 secure :-1 s=THROTTLE_DONE pgs=1869 cs=0 l=1 rx=0x7f68f8002f30 tx=0x7f68f8010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.058+0000 7f68f37fe700 1 -- 172.21.15.103:0/3384178585 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f800a4d0 con 0x7f690405b8a0 2020-04-22T14:17:44.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.058+0000 7f6908e66700 1 -- 172.21.15.103:0/3384178585 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69040b40c0 con 0x7f690405b8a0 2020-04-22T14:17:44.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.058+0000 7f68f37fe700 1 -- 172.21.15.103:0/3384178585 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68f800a8f0 con 0x7f690405b8a0 2020-04-22T14:17:44.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.058+0000 7f6908e66700 1 -- 172.21.15.103:0/3384178585 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f690415ba30 con 0x7f690405b8a0 2020-04-22T14:17:44.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.058+0000 7f690259c700 1 --2- 172.21.15.103:0/3384178585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f690405b8a0 0x7f6904148850 secure :-1 s=THROTTLE_DONE pgs=1869 cs=0 l=1 rx=0x7f68f8002f30 tx=0x7f68f8010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.059+0000 7f68f37fe700 1 -- 172.21.15.103:0/3384178585 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f68f800ab60 con 0x7f690405b8a0 2020-04-22T14:17:44.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.059+0000 7f690259c700 1 --2- 172.21.15.103:0/3384178585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f690405b8a0 0x7f6904148850 secure :-1 s=THROTTLE_DONE pgs=1869 cs=0 l=1 rx=0x7f68f8002f30 tx=0x7f68f8010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.059+0000 7f6908e66700 1 -- 172.21.15.103:0/3384178585 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6904056c90 con 0x7f690405b8a0 2020-04-22T14:17:44.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.059+0000 7f68f37fe700 1 --2- 172.21.15.103:0/3384178585 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f68e004d970 0x7f68e004fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:44.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.059+0000 7f68f37fe700 1 -- 172.21.15.103:0/3384178585 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f68f8061530 con 0x7f690405b8a0 2020-04-22T14:17:44.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.059+0000 7f6901d9b700 1 --2- 172.21.15.103:0/3384178585 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f68e004d970 0x7f68e004fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:44.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.060+0000 7f6901d9b700 1 --2- 172.21.15.103:0/3384178585 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f68e004d970 0x7f68e004fe30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f68f4002f30 tx=0x7f68f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.060+0000 7f6901d9b700 1 --2- 172.21.15.103:0/3384178585 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f68e004d970 0x7f68e004fe30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f68f4002f30 tx=0x7f68f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.060+0000 7f6901d9b700 1 --2- 172.21.15.103:0/3384178585 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f68e004d970 0x7f68e004fe30 secure :-1 s=READY pgs=684 cs=0 l=1 rx=0x7f68f4002f30 tx=0x7f68f4007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:44.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.063+0000 7f690259c700 1 --2- 172.21.15.103:0/3384178585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f690405b8a0 0x7f6904148850 secure :-1 s=THROTTLE_DONE pgs=1869 cs=0 l=1 rx=0x7f68f8002f30 tx=0x7f68f8010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.063+0000 7f68f37fe700 1 -- 172.21.15.103:0/3384178585 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f68f803c970 con 0x7f690405b8a0 2020-04-22T14:17:44.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.254+0000 7f6908e66700 1 -- 172.21.15.103:0/3384178585 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f690414bfb0 con 0x7f690405b8a0 2020-04-22T14:17:44.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.254+0000 7f690259c700 1 --2- 172.21.15.103:0/3384178585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f690405b8a0 0x7f6904148850 secure :-1 s=THROTTLE_DONE pgs=1869 cs=0 l=1 rx=0x7f68f8002f30 tx=0x7f68f8010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.254+0000 7f68f37fe700 1 -- 172.21.15.103:0/3384178585 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v48) v1 ==== 80+0+4513 (secure 0 0 0) 0x7f68f803ff90 con 0x7f690405b8a0 2020-04-22T14:17:44.257 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:17:44.257 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:17:44.257 INFO:teuthology.orchestra.run.smithi103.stdout: "auth_dump": [ 2020-04-22T14:17:44.257 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:44.257 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.a", 2020-04-22T14:17:44.257 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBeliD5IBAAjC7UikdEP8FeE2rKs/ympw==", 2020-04-22T14:17:44.258 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:17:44.258 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:17:44.258 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:17:44.258 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:17:44.258 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:17:44.258 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:44.258 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:44.259 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:44.259 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.b", 2020-04-22T14:17:44.259 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBepkqQLBAA4aMKXxROQugglhm4aBd1Iw==", 2020-04-22T14:17:44.259 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:17:44.259 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:17:44.259 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:17:44.259 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:17:44.260 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:17:44.260 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:44.260 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:44.260 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:44.260 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.0", 2020-04-22T14:17:44.260 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA2TqBehMJiBxAARaWo32QGx49PxImGafnOFw==", 2020-04-22T14:17:44.260 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:17:44.261 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:17:44.261 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:17:44.261 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:17:44.261 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:44.261 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:44.261 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:44.261 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.1", 2020-04-22T14:17:44.261 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA4TqBeiAAcKRAAEHuaqbsB+NLUTSgFOCOFZg==", 2020-04-22T14:17:44.262 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:17:44.262 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:17:44.262 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:17:44.262 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:17:44.262 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:44.262 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:44.262 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:44.263 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.2", 2020-04-22T14:17:44.263 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA7TqBebeRzDxAAsjRyvJektq7MQ+334kU+UQ==", 2020-04-22T14:17:44.263 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:17:44.263 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:17:44.263 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:17:44.263 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:17:44.264 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:44.264 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:44.264 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:44.264 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.3", 2020-04-22T14:17:44.264 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA9TqBehxmSMRAATZ0o/ZnxHp2m/tqLmv6JwA==", 2020-04-22T14:17:44.264 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:17:44.265 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:17:44.265 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:17:44.265 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:17:44.265 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:44.266 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:44.266 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:44.266 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.4", 2020-04-22T14:17:44.266 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBETqBePwJSBRAAXgMKuX3EILi3gy8QzR4cig==", 2020-04-22T14:17:44.266 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:17:44.266 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:17:44.267 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:17:44.267 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:17:44.267 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:44.267 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:44.267 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:44.267 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.5", 2020-04-22T14:17:44.267 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBGTqBe5l++KRAAHIWG6bBnru2EVXv/drAL0g==", 2020-04-22T14:17:44.267 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:17:44.268 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:17:44.268 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:17:44.268 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:17:44.268 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:44.269 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:44.269 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:44.269 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.6", 2020-04-22T14:17:44.269 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBJTqBe88rTEBAAO2Z78NZLTYIbBpYovBSHVQ==", 2020-04-22T14:17:44.270 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:17:44.270 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:17:44.270 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:17:44.270 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:17:44.271 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:44.271 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:44.271 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:44.271 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.7", 2020-04-22T14:17:44.272 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBLTqBeGNFIMxAARIXhPNM6xurdnDv8+xZqUw==", 2020-04-22T14:17:44.272 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:17:44.272 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:17:44.275 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:17:44.275 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:17:44.275 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:44.275 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:44.275 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:44.275 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.0", 2020-04-22T14:17:44.275 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBe5ooUNxAA9zBtv6+i3Xl9iYtRl4xKGg==", 2020-04-22T14:17:44.276 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:17:44.276 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:17:44.276 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:17:44.276 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:17:44.276 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:44.276 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:44.276 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:44.277 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.1", 2020-04-22T14:17:44.277 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAyTqBe0bioBBAAVpoQouA/QICwqRoaFbjkiA==", 2020-04-22T14:17:44.277 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:17:44.277 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:17:44.277 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:17:44.277 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:17:44.277 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:44.278 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:44.278 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:44.278 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.2", 2020-04-22T14:17:44.278 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAyTqBemwpXCxAAObNL96zS67nMEe4MLjrEtw==", 2020-04-22T14:17:44.278 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:17:44.278 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:17:44.278 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:17:44.278 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:17:44.279 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:44.279 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:44.279 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:44.279 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.3", 2020-04-22T14:17:44.279 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAyTqBemGxNFBAAlqvB8FeZbMRwvzVjBpH/tA==", 2020-04-22T14:17:44.279 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:17:44.279 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:17:44.280 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:17:44.280 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:17:44.280 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:44.280 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:44.280 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:44.280 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.admin", 2020-04-22T14:17:44.280 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAwTqBeSx5dHxAAH0jPkaiWEwpr66ROWwbU8Q==", 2020-04-22T14:17:44.281 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:17:44.281 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2020-04-22T14:17:44.281 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:17:44.281 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:17:44.281 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:17:44.281 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:44.281 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:44.282 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:44.282 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mgr.x", 2020-04-22T14:17:44.282 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBe3YVhGhAAWAf6f9sV3bzoucBBPS3j2g==", 2020-04-22T14:17:44.282 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:17:44.282 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2020-04-22T14:17:44.282 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile mgr", 2020-04-22T14:17:44.282 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:17:44.283 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:44.283 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:44.283 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:44.283 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mgr.y", 2020-04-22T14:17:44.283 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBeX8AXExAAhh/N+/ogdKlxmkveSM60+g==", 2020-04-22T14:17:44.283 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:17:44.283 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2020-04-22T14:17:44.283 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile mgr", 2020-04-22T14:17:44.284 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:17:44.284 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:44.284 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:44.284 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:17:44.285 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:17:44.289 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.255+0000 7f6908e66700 1 -- 172.21.15.103:0/3384178585 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f68e004d970 msgr2=0x7f68e004fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:44.289 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.255+0000 7f6908e66700 1 --2- 172.21.15.103:0/3384178585 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f68e004d970 0x7f68e004fe30 secure :-1 s=READY pgs=684 cs=0 l=1 rx=0x7f68f4002f30 tx=0x7f68f4007a40).stop 2020-04-22T14:17:44.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.255+0000 7f6908e66700 1 -- 172.21.15.103:0/3384178585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f690405b8a0 msgr2=0x7f6904148850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:44.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.255+0000 7f6908e66700 1 --2- 172.21.15.103:0/3384178585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f690405b8a0 0x7f6904148850 secure :-1 s=READY pgs=1869 cs=0 l=1 rx=0x7f68f8002f30 tx=0x7f68f8010a40).stop 2020-04-22T14:17:44.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.255+0000 7f6908e66700 1 -- 172.21.15.103:0/3384178585 shutdown_connections 2020-04-22T14:17:44.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.255+0000 7f6908e66700 1 --2- 172.21.15.103:0/3384178585 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f68e004d970 0x7f68e004fe30 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:44.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.255+0000 7f6908e66700 1 --2- 172.21.15.103:0/3384178585 >> v2:172.21.15.86:3300/0 conn(0x7f690412c0d0 0x7f690412b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:44.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.255+0000 7f6908e66700 1 --2- 172.21.15.103:0/3384178585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f690405b8a0 0x7f6904148850 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:44.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.255+0000 7f6908e66700 1 --2- 172.21.15.103:0/3384178585 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6904065fe0 0x7f690412ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:44.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.255+0000 7f6908e66700 1 -- 172.21.15.103:0/3384178585 >> 172.21.15.103:0/3384178585 conn(0x7f69040b9160 msgr2=0x7f6904061910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:44.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.256+0000 7f6908e66700 1 -- 172.21.15.103:0/3384178585 shutdown_connections 2020-04-22T14:17:44.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.256+0000 7f6908e66700 1 -- 172.21.15.103:0/3384178585 wait complete. 2020-04-22T14:17:44.292 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:44.306 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:17:44.453 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.451+0000 7f2299a8c700 1 Processor -- start 2020-04-22T14:17:44.453 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.451+0000 7f2299a8c700 1 -- start start 2020-04-22T14:17:44.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.451+0000 7f2299a8c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f22941441f0 0x7f2294144820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:44.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.451+0000 7f2299a8c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2294144c80 0x7f22940ad850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:44.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.451+0000 7f2299a8c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22940b5900 con 0x7f229405b7c0 2020-04-22T14:17:44.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.451+0000 7f2299a8c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22940b5ba0 con 0x7f22941441f0 2020-04-22T14:17:44.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.451+0000 7f2299a8c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22940b5e40 con 0x7f2294144c80 2020-04-22T14:17:44.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.451+0000 7f22937fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f229405b7c0 0x7f22940b50d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49540/0 (socket says 172.21.15.103:49540) 2020-04-22T14:17:44.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.452+0000 7f22937fe700 1 -- 172.21.15.103:0/4194402038 learned_addr learned my addr 172.21.15.103:0/4194402038 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:17:44.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.452+0000 7f2292ffd700 1 --2- 172.21.15.103:0/4194402038 >> v2:172.21.15.86:3300/0 conn(0x7f22941441f0 0x7f2294144820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:44.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.452+0000 7f2293fff700 1 --2- 172.21.15.103:0/4194402038 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2294144c80 0x7f22940ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:44.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.452+0000 7f22927fc700 1 -- 172.21.15.103:0/4194402038 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2241143003 0 0) 0x7f22940b5900 con 0x7f229405b7c0 2020-04-22T14:17:44.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.452+0000 7f22927fc700 1 -- 172.21.15.103:0/4194402038 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2280003230 con 0x7f229405b7c0 2020-04-22T14:17:44.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.452+0000 7f22927fc700 1 -- 172.21.15.103:0/4194402038 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2954917766 0 0) 0x7f2280003230 con 0x7f229405b7c0 2020-04-22T14:17:44.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.452+0000 7f2292ffd700 1 -- 172.21.15.103:0/4194402038 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2294144c80 msgr2=0x7f22940ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:44.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.452+0000 7f2292ffd700 1 --2- 172.21.15.103:0/4194402038 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2294144c80 0x7f22940ad850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:44.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.452+0000 7f2292ffd700 1 -- 172.21.15.103:0/4194402038 >> v1:172.21.15.103:6789/0 conn(0x7f229405b7c0 legacy=0x7f22940b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:44.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.452+0000 7f2292ffd700 1 -- 172.21.15.103:0/4194402038 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f229405bba0 con 0x7f22941441f0 2020-04-22T14:17:44.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.452+0000 7f2292ffd700 1 --2- 172.21.15.103:0/4194402038 >> v2:172.21.15.86:3300/0 conn(0x7f22941441f0 0x7f2294144820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2284001870 tx=0x7f2288007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.452+0000 7f2292ffd700 1 --2- 172.21.15.103:0/4194402038 >> v2:172.21.15.86:3300/0 conn(0x7f22941441f0 0x7f2294144820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2284001870 tx=0x7f2288007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.466 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.452+0000 7f2292ffd700 1 --2- 172.21.15.103:0/4194402038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22941441f0 0x7f2294144820 secure :-1 s=READY pgs=999 cs=0 l=1 rx=0x7f2284001870 tx=0x7f2288007dc0).ready entity=mon.0 client_cookie=7237d939184eb2e1 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:44.466 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.452+0000 7f2292ffd700 1 --2- 172.21.15.103:0/4194402038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22941441f0 0x7f2294144820 secure :-1 s=THROTTLE_DONE pgs=999 cs=0 l=1 rx=0x7f2284001870 tx=0x7f2288007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.466 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.452+0000 7f22927fc700 1 -- 172.21.15.103:0/4194402038 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22840016d0 con 0x7f22941441f0 2020-04-22T14:17:44.466 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.452+0000 7f2292ffd700 1 --2- 172.21.15.103:0/4194402038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22941441f0 0x7f2294144820 secure :-1 s=THROTTLE_DONE pgs=999 cs=0 l=1 rx=0x7f2284001870 tx=0x7f2288007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.466 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.452+0000 7f22927fc700 1 -- 172.21.15.103:0/4194402038 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2288010a10 con 0x7f22941441f0 2020-04-22T14:17:44.466 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.452+0000 7f2292ffd700 1 --2- 172.21.15.103:0/4194402038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22941441f0 0x7f2294144820 secure :-1 s=THROTTLE_DONE pgs=999 cs=0 l=1 rx=0x7f2284001870 tx=0x7f2288007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.452+0000 7f22927fc700 1 -- 172.21.15.103:0/4194402038 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2288010db0 con 0x7f22941441f0 2020-04-22T14:17:44.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.452+0000 7f2299a8c700 1 -- 172.21.15.103:0/4194402038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22941441f0 msgr2=0x7f2294144820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:44.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.452+0000 7f2299a8c700 1 --2- 172.21.15.103:0/4194402038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22941441f0 0x7f2294144820 secure :-1 s=READY pgs=999 cs=0 l=1 rx=0x7f2284001870 tx=0x7f2288007dc0).stop 2020-04-22T14:17:44.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.453+0000 7f2299a8c700 1 -- 172.21.15.103:0/4194402038 shutdown_connections 2020-04-22T14:17:44.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.453+0000 7f2299a8c700 1 --2- 172.21.15.103:0/4194402038 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2294144c80 0x7f22940ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:44.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.453+0000 7f2299a8c700 1 --2- 172.21.15.103:0/4194402038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22941441f0 0x7f2294144820 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:44.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.453+0000 7f2299a8c700 1 -- 172.21.15.103:0/4194402038 >> 172.21.15.103:0/4194402038 conn(0x7f22940b9160 msgr2=0x7f229405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:44.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.453+0000 7f2299a8c700 1 -- 172.21.15.103:0/4194402038 shutdown_connections 2020-04-22T14:17:44.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.453+0000 7f2299a8c700 1 -- 172.21.15.103:0/4194402038 wait complete. 2020-04-22T14:17:44.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.454+0000 7f2299a8c700 1 Processor -- start 2020-04-22T14:17:44.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.454+0000 7f2299a8c700 1 -- start start 2020-04-22T14:17:44.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.455+0000 7f2299a8c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f229405b7c0 0x7f22940b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:44.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.455+0000 7f2299a8c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2294144c80 0x7f22940ae100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:44.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.455+0000 7f2299a8c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22940b7e50 con 0x7f22941441f0 2020-04-22T14:17:44.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.455+0000 7f2299a8c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22940b80f0 con 0x7f229405b7c0 2020-04-22T14:17:44.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.455+0000 7f2299a8c700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22940b4720 con 0x7f2294144c80 2020-04-22T14:17:44.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.455+0000 7f2293fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2294144c80 0x7f22940ae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:44.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.455+0000 7f2292ffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f22941441f0 0x7f22940b6920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49548/0 (socket says 172.21.15.103:49548) 2020-04-22T14:17:44.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.455+0000 7f2292ffd700 1 -- 172.21.15.103:0/534312934 learned_addr learned my addr 172.21.15.103:0/534312934 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:17:44.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.455+0000 7f2293fff700 1 --2- 172.21.15.103:0/534312934 >> v2:172.21.15.103:3300/0 conn(0x7f2294144c80 0x7f22940ae100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57360/0 (socket says 172.21.15.103:57360) 2020-04-22T14:17:44.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.455+0000 7f22937fe700 1 --2- 172.21.15.103:0/534312934 >> v2:172.21.15.86:3300/0 conn(0x7f229405b7c0 0x7f22940b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:44.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.455+0000 7f2293fff700 1 -- 172.21.15.103:0/534312934 >> v2:172.21.15.86:3300/0 conn(0x7f229405b7c0 msgr2=0x7f22940b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:44.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.455+0000 7f2293fff700 1 --2- 172.21.15.103:0/534312934 >> v2:172.21.15.86:3300/0 conn(0x7f229405b7c0 0x7f22940b42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:44.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.455+0000 7f2293fff700 1 -- 172.21.15.103:0/534312934 >> v1:172.21.15.103:6789/0 conn(0x7f22941441f0 legacy=0x7f22940b6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:44.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.455+0000 7f2290ff9700 1 -- 172.21.15.103:0/534312934 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 106217046 0 0) 0x7f22940b7e50 con 0x7f22941441f0 2020-04-22T14:17:44.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.455+0000 7f2293fff700 1 -- 172.21.15.103:0/534312934 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22940b73c0 con 0x7f2294144c80 2020-04-22T14:17:44.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.455+0000 7f2293fff700 1 --2- 172.21.15.103:0/534312934 >> v2:172.21.15.103:3300/0 conn(0x7f2294144c80 0x7f22940ae100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f228c002f30 tx=0x7f228c010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.455+0000 7f2293fff700 1 --2- 172.21.15.103:0/534312934 >> v2:172.21.15.103:3300/0 conn(0x7f2294144c80 0x7f22940ae100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f228c002f30 tx=0x7f228c010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.455+0000 7f2293fff700 1 --2- 172.21.15.103:0/534312934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2294144c80 0x7f22940ae100 secure :-1 s=READY pgs=1872 cs=0 l=1 rx=0x7f228c002f30 tx=0x7f228c010bf0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:44.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.455+0000 7f2293fff700 1 --2- 172.21.15.103:0/534312934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2294144c80 0x7f22940ae100 secure :-1 s=THROTTLE_DONE pgs=1872 cs=0 l=1 rx=0x7f228c002f30 tx=0x7f228c010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.455+0000 7f2290ff9700 1 -- 172.21.15.103:0/534312934 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f228c007550 con 0x7f2294144c80 2020-04-22T14:17:44.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.455+0000 7f2293fff700 1 --2- 172.21.15.103:0/534312934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2294144c80 0x7f22940ae100 secure :-1 s=THROTTLE_DONE pgs=1872 cs=0 l=1 rx=0x7f228c002f30 tx=0x7f228c010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.455+0000 7f2293fff700 1 --2- 172.21.15.103:0/534312934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2294144c80 0x7f22940ae100 secure :-1 s=THROTTLE_DONE pgs=1872 cs=0 l=1 rx=0x7f228c002f30 tx=0x7f228c010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.455+0000 7f2290ff9700 1 -- 172.21.15.103:0/534312934 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228c0056c0 con 0x7f2294144c80 2020-04-22T14:17:44.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.455+0000 7f2290ff9700 1 -- 172.21.15.103:0/534312934 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f228c005a60 con 0x7f2294144c80 2020-04-22T14:17:44.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.455+0000 7f2299a8c700 1 -- 172.21.15.103:0/534312934 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22940b3ef0 con 0x7f2294144c80 2020-04-22T14:17:44.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.455+0000 7f2299a8c700 1 -- 172.21.15.103:0/534312934 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22940ae720 con 0x7f2294144c80 2020-04-22T14:17:44.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.456+0000 7f2293fff700 1 --2- 172.21.15.103:0/534312934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2294144c80 0x7f22940ae100 secure :-1 s=THROTTLE_DONE pgs=1872 cs=0 l=1 rx=0x7f228c002f30 tx=0x7f228c010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.456+0000 7f2299a8c700 1 -- 172.21.15.103:0/534312934 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22940b8290 con 0x7f2294144c80 2020-04-22T14:17:44.475 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.456+0000 7f2290ff9700 1 -- 172.21.15.103:0/534312934 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f228c005bc0 con 0x7f2294144c80 2020-04-22T14:17:44.475 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.456+0000 7f2293fff700 1 --2- 172.21.15.103:0/534312934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2294144c80 0x7f22940ae100 secure :-1 s=THROTTLE_DONE pgs=1872 cs=0 l=1 rx=0x7f228c002f30 tx=0x7f228c010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.475 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.457+0000 7f2290ff9700 1 --2- 172.21.15.103:0/534312934 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f227404d7e0 0x7f227404fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:44.475 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.457+0000 7f2290ff9700 1 -- 172.21.15.103:0/534312934 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f228c00d0d0 con 0x7f2294144c80 2020-04-22T14:17:44.475 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.457+0000 7f22937fe700 1 --2- 172.21.15.103:0/534312934 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f227404d7e0 0x7f227404fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:44.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.457+0000 7f22937fe700 1 --2- 172.21.15.103:0/534312934 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f227404d7e0 0x7f227404fca0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2284001930 tx=0x7f2284001ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.457+0000 7f22937fe700 1 --2- 172.21.15.103:0/534312934 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f227404d7e0 0x7f227404fca0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2284001930 tx=0x7f2284001ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.457+0000 7f22937fe700 1 --2- 172.21.15.103:0/534312934 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f227404d7e0 0x7f227404fca0 secure :-1 s=READY pgs=685 cs=0 l=1 rx=0x7f2284001930 tx=0x7f2284001ae0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:44.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.461+0000 7f2293fff700 1 --2- 172.21.15.103:0/534312934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2294144c80 0x7f22940ae100 secure :-1 s=THROTTLE_DONE pgs=1872 cs=0 l=1 rx=0x7f228c002f30 tx=0x7f228c010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.461+0000 7f2290ff9700 1 -- 172.21.15.103:0/534312934 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f228c03c980 con 0x7f2294144c80 2020-04-22T14:17:44.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.605+0000 7f2299a8c700 1 -- 172.21.15.103:0/534312934 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2294056c90 con 0x7f2294144c80 2020-04-22T14:17:44.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.606+0000 7f2293fff700 1 --2- 172.21.15.103:0/534312934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2294144c80 0x7f22940ae100 secure :-1 s=THROTTLE_DONE pgs=1872 cs=0 l=1 rx=0x7f228c002f30 tx=0x7f228c010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.608 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.606+0000 7f2290ff9700 1 -- 172.21.15.103:0/534312934 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) v1 ==== 74+0+13242 (secure 0 0 0) 0x7f228c03ffa0 con 0x7f2294144c80 2020-04-22T14:17:44.608 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:17:44.609 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":131,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:17:43.833656+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:17:44.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.607+0000 7f2299a8c700 1 -- 172.21.15.103:0/534312934 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f227404d7e0 msgr2=0x7f227404fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:44.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.607+0000 7f2299a8c700 1 --2- 172.21.15.103:0/534312934 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f227404d7e0 0x7f227404fca0 secure :-1 s=READY pgs=685 cs=0 l=1 rx=0x7f2284001930 tx=0x7f2284001ae0).stop 2020-04-22T14:17:44.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.607+0000 7f2299a8c700 1 -- 172.21.15.103:0/534312934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2294144c80 msgr2=0x7f22940ae100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:44.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.607+0000 7f2299a8c700 1 --2- 172.21.15.103:0/534312934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2294144c80 0x7f22940ae100 secure :-1 s=READY pgs=1872 cs=0 l=1 rx=0x7f228c002f30 tx=0x7f228c010bf0).stop 2020-04-22T14:17:44.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.607+0000 7f2299a8c700 1 -- 172.21.15.103:0/534312934 shutdown_connections 2020-04-22T14:17:44.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.607+0000 7f2299a8c700 1 --2- 172.21.15.103:0/534312934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2294144c80 0x7f22940ae100 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:44.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.607+0000 7f2299a8c700 1 --2- 172.21.15.103:0/534312934 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f227404d7e0 0x7f227404fca0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:44.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.607+0000 7f2299a8c700 1 --2- 172.21.15.103:0/534312934 >> v2:172.21.15.86:3300/0 conn(0x7f229405b7c0 0x7f22940b42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:44.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.607+0000 7f2299a8c700 1 -- 172.21.15.103:0/534312934 >> 172.21.15.103:0/534312934 conn(0x7f22940b9160 msgr2=0x7f22940669c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:44.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.608+0000 7f2299a8c700 1 -- 172.21.15.103:0/534312934 shutdown_connections 2020-04-22T14:17:44.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.608+0000 7f2299a8c700 1 -- 172.21.15.103:0/534312934 wait complete. 2020-04-22T14:17:44.621 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:17:44.621 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:44.635 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:17:44.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.781+0000 7f2f23ed6700 1 Processor -- start 2020-04-22T14:17:44.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.782+0000 7f2f23ed6700 1 -- start start 2020-04-22T14:17:44.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.782+0000 7f2f23ed6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2f1c0b9670 0x7f2f1c0b6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:44.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.782+0000 7f2f23ed6700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2f1c14a480 0x7f2f1c1468f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:44.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.782+0000 7f2f23ed6700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f1c0b4420 con 0x7f2f1c14a020 2020-04-22T14:17:44.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.782+0000 7f2f23ed6700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f1c1498e0 con 0x7f2f1c14a480 2020-04-22T14:17:44.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.782+0000 7f2f23ed6700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c149b80 con 0x7f2f1c0b9670 2020-04-22T14:17:44.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.782+0000 7f2f22473700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2f1c14a480 0x7f2f1c1468f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:44.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.783+0000 7f2f22473700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2f1c14a480 0x7f2f1c1468f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57368/0 (socket says 172.21.15.103:57368) 2020-04-22T14:17:44.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.783+0000 7f2f22473700 1 -- 172.21.15.103:0/3628218171 learned_addr learned my addr 172.21.15.103:0/3628218171 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:44.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.783+0000 7f2f21c72700 1 --2- 172.21.15.103:0/3628218171 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2f1c0b9670 0x7f2f1c0b6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:44.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.783+0000 7f2f22473700 1 -- 172.21.15.103:0/3628218171 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2f1c0b9670 msgr2=0x7f2f1c0b6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:44.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.783+0000 7f2f22473700 1 --2- 172.21.15.103:0/3628218171 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2f1c0b9670 0x7f2f1c0b6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:44.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.783+0000 7f2f22473700 1 -- 172.21.15.103:0/3628218171 >> v1:172.21.15.86:6789/0 conn(0x7f2f1c14a020 legacy=0x7f2f1c0663c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:44.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.783+0000 7f2f22473700 1 -- 172.21.15.103:0/3628218171 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f1c0b9a50 con 0x7f2f1c14a480 2020-04-22T14:17:44.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.783+0000 7f2f22473700 1 --2- 172.21.15.103:0/3628218171 >> v2:172.21.15.103:3300/0 conn(0x7f2f1c14a480 0x7f2f1c1468f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2f140032b0 tx=0x7f2f14007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.783+0000 7f2f22473700 1 --2- 172.21.15.103:0/3628218171 >> v2:172.21.15.103:3300/0 conn(0x7f2f1c14a480 0x7f2f1c1468f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2f140032b0 tx=0x7f2f14007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.783+0000 7f2f22473700 1 --2- 172.21.15.103:0/3628218171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2f1c14a480 0x7f2f1c1468f0 secure :-1 s=READY pgs=1873 cs=0 l=1 rx=0x7f2f140032b0 tx=0x7f2f14007dc0).ready entity=mon.1 client_cookie=8fa743de1e169711 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:44.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.783+0000 7f2f22473700 1 --2- 172.21.15.103:0/3628218171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2f1c14a480 0x7f2f1c1468f0 secure :-1 s=THROTTLE_DONE pgs=1873 cs=0 l=1 rx=0x7f2f140032b0 tx=0x7f2f14007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.783+0000 7f2f22473700 1 --2- 172.21.15.103:0/3628218171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2f1c14a480 0x7f2f1c1468f0 secure :-1 s=THROTTLE_DONE pgs=1873 cs=0 l=1 rx=0x7f2f140032b0 tx=0x7f2f14007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.783+0000 7f2f20c70700 1 -- 172.21.15.103:0/3628218171 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f1400a180 con 0x7f2f1c14a480 2020-04-22T14:17:44.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.783+0000 7f2f22473700 1 --2- 172.21.15.103:0/3628218171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2f1c14a480 0x7f2f1c1468f0 secure :-1 s=THROTTLE_DONE pgs=1873 cs=0 l=1 rx=0x7f2f140032b0 tx=0x7f2f14007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.783+0000 7f2f20c70700 1 -- 172.21.15.103:0/3628218171 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1400a320 con 0x7f2f1c14a480 2020-04-22T14:17:44.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.783+0000 7f2f20c70700 1 -- 172.21.15.103:0/3628218171 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f1400a740 con 0x7f2f1c14a480 2020-04-22T14:17:44.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.783+0000 7f2f23ed6700 1 -- 172.21.15.103:0/3628218171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2f1c14a480 msgr2=0x7f2f1c1468f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:44.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.783+0000 7f2f23ed6700 1 --2- 172.21.15.103:0/3628218171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2f1c14a480 0x7f2f1c1468f0 secure :-1 s=READY pgs=1873 cs=0 l=1 rx=0x7f2f140032b0 tx=0x7f2f14007dc0).stop 2020-04-22T14:17:44.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.784+0000 7f2f23ed6700 1 -- 172.21.15.103:0/3628218171 shutdown_connections 2020-04-22T14:17:44.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.784+0000 7f2f23ed6700 1 --2- 172.21.15.103:0/3628218171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2f1c14a480 0x7f2f1c1468f0 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:44.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.784+0000 7f2f23ed6700 1 --2- 172.21.15.103:0/3628218171 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2f1c0b9670 0x7f2f1c0b6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:44.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.784+0000 7f2f23ed6700 1 -- 172.21.15.103:0/3628218171 >> 172.21.15.103:0/3628218171 conn(0x7f2f1c05ad30 msgr2=0x7f2f1c05b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:44.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.784+0000 7f2f23ed6700 1 -- 172.21.15.103:0/3628218171 shutdown_connections 2020-04-22T14:17:44.790 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.784+0000 7f2f23ed6700 1 -- 172.21.15.103:0/3628218171 wait complete. 2020-04-22T14:17:44.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.785+0000 7f2f23ed6700 1 Processor -- start 2020-04-22T14:17:44.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.785+0000 7f2f23ed6700 1 -- start start 2020-04-22T14:17:44.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.785+0000 7f2f23ed6700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2f1c0b9670 0x7f2f1c0afa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:44.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.785+0000 7f2f23ed6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2f1c14a480 0x7f2f1c0b8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:44.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.785+0000 7f2f23ed6700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f1c0b85b0 con 0x7f2f1c14a020 2020-04-22T14:17:44.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.785+0000 7f2f23ed6700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f1c0af5a0 con 0x7f2f1c0b9670 2020-04-22T14:17:44.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.785+0000 7f2f23ed6700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c0af840 con 0x7f2f1c14a480 2020-04-22T14:17:44.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.785+0000 7f2f21471700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f2f1c14a020 0x7f2f1c1329b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49562/0 (socket says 172.21.15.103:49562) 2020-04-22T14:17:44.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.786+0000 7f2f21471700 1 -- 172.21.15.103:0/1628328042 learned_addr learned my addr 172.21.15.103:0/1628328042 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:17:44.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.786+0000 7f2f21c72700 1 --2- 172.21.15.103:0/1628328042 >> v2:172.21.15.86:3300/0 conn(0x7f2f1c0b9670 0x7f2f1c0afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:44.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.786+0000 7f2f22473700 1 --2- 172.21.15.103:0/1628328042 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2f1c14a480 0x7f2f1c0b8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:44.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.786+0000 7f2f0affd700 1 -- 172.21.15.103:0/1628328042 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 180835114 0 0) 0x7f2f1c0b4420 con 0x7f2f1c14a020 2020-04-22T14:17:44.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.786+0000 7f2f0affd700 1 -- 172.21.15.103:0/1628328042 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2efc002fe0 con 0x7f2f1c14a020 2020-04-22T14:17:44.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.786+0000 7f2f21c72700 1 -- 172.21.15.103:0/1628328042 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2f1c14a480 msgr2=0x7f2f1c0b8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:44.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.786+0000 7f2f21c72700 1 --2- 172.21.15.103:0/1628328042 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2f1c14a480 0x7f2f1c0b8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:44.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.786+0000 7f2f21c72700 1 -- 172.21.15.103:0/1628328042 >> v1:172.21.15.103:6789/0 conn(0x7f2f1c14a020 legacy=0x7f2f1c1329b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:44.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.786+0000 7f2f21c72700 1 -- 172.21.15.103:0/1628328042 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f1c143180 con 0x7f2f1c0b9670 2020-04-22T14:17:44.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.786+0000 7f2f22473700 1 --2- 172.21.15.103:0/1628328042 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2f1c14a480 0x7f2f1c0b8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:17:44.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.786+0000 7f2f21c72700 1 --2- 172.21.15.103:0/1628328042 >> v2:172.21.15.86:3300/0 conn(0x7f2f1c0b9670 0x7f2f1c0afa60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2f0c002f30 tx=0x7f2f0c010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.786+0000 7f2f21c72700 1 --2- 172.21.15.103:0/1628328042 >> v2:172.21.15.86:3300/0 conn(0x7f2f1c0b9670 0x7f2f1c0afa60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2f0c002f30 tx=0x7f2f0c010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.786+0000 7f2f21c72700 1 --2- 172.21.15.103:0/1628328042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f1c0b9670 0x7f2f1c0afa60 secure :-1 s=READY pgs=1001 cs=0 l=1 rx=0x7f2f0c002f30 tx=0x7f2f0c010b70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:44.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.786+0000 7f2f21c72700 1 --2- 172.21.15.103:0/1628328042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f1c0b9670 0x7f2f1c0afa60 secure :-1 s=THROTTLE_DONE pgs=1001 cs=0 l=1 rx=0x7f2f0c002f30 tx=0x7f2f0c010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.786+0000 7f2f0affd700 1 -- 172.21.15.103:0/1628328042 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f0c005e90 con 0x7f2f1c0b9670 2020-04-22T14:17:44.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.786+0000 7f2f21c72700 1 --2- 172.21.15.103:0/1628328042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f1c0b9670 0x7f2f1c0afa60 secure :-1 s=THROTTLE_DONE pgs=1001 cs=0 l=1 rx=0x7f2f0c002f30 tx=0x7f2f0c010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.786+0000 7f2f0affd700 1 -- 172.21.15.103:0/1628328042 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0c007180 con 0x7f2f1c0b9670 2020-04-22T14:17:44.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.786+0000 7f2f21c72700 1 --2- 172.21.15.103:0/1628328042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f1c0b9670 0x7f2f1c0afa60 secure :-1 s=THROTTLE_DONE pgs=1001 cs=0 l=1 rx=0x7f2f0c002f30 tx=0x7f2f0c010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.786+0000 7f2f23ed6700 1 -- 172.21.15.103:0/1628328042 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f1c1330c0 con 0x7f2f1c0b9670 2020-04-22T14:17:44.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.786+0000 7f2f0affd700 1 -- 172.21.15.103:0/1628328042 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f0c007560 con 0x7f2f1c0b9670 2020-04-22T14:17:44.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.786+0000 7f2f23ed6700 1 -- 172.21.15.103:0/1628328042 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f1c153c40 con 0x7f2f1c0b9670 2020-04-22T14:17:44.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.787+0000 7f2f21c72700 1 --2- 172.21.15.103:0/1628328042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f1c0b9670 0x7f2f1c0afa60 secure :-1 s=THROTTLE_DONE pgs=1001 cs=0 l=1 rx=0x7f2f0c002f30 tx=0x7f2f0c010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.787+0000 7f2f23ed6700 1 -- 172.21.15.103:0/1628328042 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f1c056c90 con 0x7f2f1c0b9670 2020-04-22T14:17:44.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.787+0000 7f2f0affd700 1 -- 172.21.15.103:0/1628328042 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f2f0c00e200 con 0x7f2f1c0b9670 2020-04-22T14:17:44.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.787+0000 7f2f21c72700 1 --2- 172.21.15.103:0/1628328042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f1c0b9670 0x7f2f1c0afa60 secure :-1 s=THROTTLE_DONE pgs=1001 cs=0 l=1 rx=0x7f2f0c002f30 tx=0x7f2f0c010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.788+0000 7f2f0affd700 1 --2- 172.21.15.103:0/1628328042 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2efc04dcb0 0x7f2efc050170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:44.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.788+0000 7f2f0affd700 1 -- 172.21.15.103:0/1628328042 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f2f0c061690 con 0x7f2f1c0b9670 2020-04-22T14:17:44.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.788+0000 7f2f21471700 1 --2- 172.21.15.103:0/1628328042 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2efc04dcb0 0x7f2efc050170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:44.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.788+0000 7f2f21471700 1 --2- 172.21.15.103:0/1628328042 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2efc04dcb0 0x7f2efc050170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2f180010d0 tx=0x7f2f180017c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.788+0000 7f2f21471700 1 --2- 172.21.15.103:0/1628328042 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2efc04dcb0 0x7f2efc050170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2f180010d0 tx=0x7f2f180017c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.788+0000 7f2f21471700 1 --2- 172.21.15.103:0/1628328042 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2efc04dcb0 0x7f2efc050170 secure :-1 s=READY pgs=686 cs=0 l=1 rx=0x7f2f180010d0 tx=0x7f2f180017c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:44.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.791+0000 7f2f21c72700 1 --2- 172.21.15.103:0/1628328042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f1c0b9670 0x7f2f1c0afa60 secure :-1 s=THROTTLE_DONE pgs=1001 cs=0 l=1 rx=0x7f2f0c002f30 tx=0x7f2f0c010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.791+0000 7f2f0affd700 1 -- 172.21.15.103:0/1628328042 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f2f0c03ca10 con 0x7f2f1c0b9670 2020-04-22T14:17:44.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.932+0000 7f2f23ed6700 1 -- 172.21.15.103:0/1628328042 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f2f1c0b47e0 con 0x7f2f1c0b9670 2020-04-22T14:17:44.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.933+0000 7f2f21c72700 1 --2- 172.21.15.103:0/1628328042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f1c0b9670 0x7f2f1c0afa60 secure :-1 s=THROTTLE_DONE pgs=1001 cs=0 l=1 rx=0x7f2f0c002f30 tx=0x7f2f0c010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:44.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.933+0000 7f2f0affd700 1 -- 172.21.15.103:0/1628328042 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v131) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2f0c040030 con 0x7f2f1c0b9670 2020-04-22T14:17:44.935 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:17:44.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.934+0000 7f2f23ed6700 1 -- 172.21.15.103:0/1628328042 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2efc04dcb0 msgr2=0x7f2efc050170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:44.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.934+0000 7f2f23ed6700 1 --2- 172.21.15.103:0/1628328042 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2efc04dcb0 0x7f2efc050170 secure :-1 s=READY pgs=686 cs=0 l=1 rx=0x7f2f180010d0 tx=0x7f2f180017c0).stop 2020-04-22T14:17:44.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.934+0000 7f2f23ed6700 1 -- 172.21.15.103:0/1628328042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f1c0b9670 msgr2=0x7f2f1c0afa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:44.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.934+0000 7f2f23ed6700 1 --2- 172.21.15.103:0/1628328042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f1c0b9670 0x7f2f1c0afa60 secure :-1 s=READY pgs=1001 cs=0 l=1 rx=0x7f2f0c002f30 tx=0x7f2f0c010b70).stop 2020-04-22T14:17:44.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.934+0000 7f2f23ed6700 1 -- 172.21.15.103:0/1628328042 shutdown_connections 2020-04-22T14:17:44.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.934+0000 7f2f23ed6700 1 --2- 172.21.15.103:0/1628328042 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2f1c14a480 0x7f2f1c0b8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:44.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.934+0000 7f2f23ed6700 1 --2- 172.21.15.103:0/1628328042 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2efc04dcb0 0x7f2efc050170 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:44.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.934+0000 7f2f23ed6700 1 --2- 172.21.15.103:0/1628328042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f1c0b9670 0x7f2f1c0afa60 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:44.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.934+0000 7f2f23ed6700 1 -- 172.21.15.103:0/1628328042 >> 172.21.15.103:0/1628328042 conn(0x7f2f1c05ad30 msgr2=0x7f2f1c1456b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:44.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.934+0000 7f2f23ed6700 1 -- 172.21.15.103:0/1628328042 shutdown_connections 2020-04-22T14:17:44.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:44.934+0000 7f2f23ed6700 1 -- 172.21.15.103:0/1628328042 wait complete. 2020-04-22T14:17:44.948 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:44.961 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:17:45.109 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.107+0000 7f5880e43700 1 Processor -- start 2020-04-22T14:17:45.110 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.107+0000 7f5880e43700 1 -- start start 2020-04-22T14:17:45.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.108+0000 7f5880e43700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f587c0b0ed0 0x7f587c05b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:45.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.108+0000 7f5880e43700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f587c1435f0 0x7f587c143a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:45.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.108+0000 7f5880e43700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f587c05f2c0 con 0x7f587c0b7120 2020-04-22T14:17:45.112 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.108+0000 7f5880e43700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f587c143ed0 con 0x7f587c0b0ed0 2020-04-22T14:17:45.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.108+0000 7f5880e43700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f587c149e40 con 0x7f587c1435f0 2020-04-22T14:17:45.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.108+0000 7f587affd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f587c1435f0 0x7f587c143a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:45.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.108+0000 7f587affd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f587c1435f0 0x7f587c143a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57378/0 (socket says 172.21.15.103:57378) 2020-04-22T14:17:45.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.108+0000 7f587affd700 1 -- 172.21.15.103:0/583924702 learned_addr learned my addr 172.21.15.103:0/583924702 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:45.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.109+0000 7f587b7fe700 1 --2- 172.21.15.103:0/583924702 >> v2:172.21.15.86:3300/0 conn(0x7f587c0b0ed0 0x7f587c05b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:45.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.109+0000 7f587affd700 1 -- 172.21.15.103:0/583924702 >> v2:172.21.15.86:3300/0 conn(0x7f587c0b0ed0 msgr2=0x7f587c05b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:45.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.109+0000 7f587affd700 1 --2- 172.21.15.103:0/583924702 >> v2:172.21.15.86:3300/0 conn(0x7f587c0b0ed0 0x7f587c05b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:45.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.109+0000 7f587affd700 1 -- 172.21.15.103:0/583924702 >> v1:172.21.15.86:6789/0 conn(0x7f587c0b7120 legacy=0x7f587c0b75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:45.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.109+0000 7f587affd700 1 -- 172.21.15.103:0/583924702 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f587c14a0e0 con 0x7f587c1435f0 2020-04-22T14:17:45.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.109+0000 7f587b7fe700 1 --2- 172.21.15.103:0/583924702 >> v2:172.21.15.86:3300/0 conn(0x7f587c0b0ed0 0x7f587c05b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:17:45.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.109+0000 7f587affd700 1 --2- 172.21.15.103:0/583924702 >> v2:172.21.15.103:3300/0 conn(0x7f587c1435f0 0x7f587c143a70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f587c06ae90 tx=0x7f5864007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.109+0000 7f587affd700 1 --2- 172.21.15.103:0/583924702 >> v2:172.21.15.103:3300/0 conn(0x7f587c1435f0 0x7f587c143a70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f587c06ae90 tx=0x7f5864007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.109+0000 7f587affd700 1 --2- 172.21.15.103:0/583924702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f587c1435f0 0x7f587c143a70 secure :-1 s=READY pgs=1875 cs=0 l=1 rx=0x7f587c06ae90 tx=0x7f5864007a40).ready entity=mon.1 client_cookie=901de21af3598c2d server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:45.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.109+0000 7f587affd700 1 --2- 172.21.15.103:0/583924702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f587c1435f0 0x7f587c143a70 secure :-1 s=THROTTLE_DONE pgs=1875 cs=0 l=1 rx=0x7f587c06ae90 tx=0x7f5864007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.109+0000 7f587a7fc700 1 -- 172.21.15.103:0/583924702 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58640116e0 con 0x7f587c1435f0 2020-04-22T14:17:45.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.109+0000 7f587affd700 1 --2- 172.21.15.103:0/583924702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f587c1435f0 0x7f587c143a70 secure :-1 s=THROTTLE_DONE pgs=1875 cs=0 l=1 rx=0x7f587c06ae90 tx=0x7f5864007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.109+0000 7f587a7fc700 1 -- 172.21.15.103:0/583924702 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5864011840 con 0x7f587c1435f0 2020-04-22T14:17:45.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.109+0000 7f587affd700 1 --2- 172.21.15.103:0/583924702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f587c1435f0 0x7f587c143a70 secure :-1 s=THROTTLE_DONE pgs=1875 cs=0 l=1 rx=0x7f587c06ae90 tx=0x7f5864007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.109+0000 7f5880e43700 1 -- 172.21.15.103:0/583924702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f587c1435f0 msgr2=0x7f587c143a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:45.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.109+0000 7f587a7fc700 1 -- 172.21.15.103:0/583924702 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5864011c20 con 0x7f587c1435f0 2020-04-22T14:17:45.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.109+0000 7f5880e43700 1 --2- 172.21.15.103:0/583924702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f587c1435f0 0x7f587c143a70 secure :-1 s=READY pgs=1875 cs=0 l=1 rx=0x7f587c06ae90 tx=0x7f5864007a40).stop 2020-04-22T14:17:45.115 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.109+0000 7f5880e43700 1 -- 172.21.15.103:0/583924702 shutdown_connections 2020-04-22T14:17:45.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.109+0000 7f5880e43700 1 --2- 172.21.15.103:0/583924702 >> v2:172.21.15.86:3300/0 conn(0x7f587c0b0ed0 0x7f587c05b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:45.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.109+0000 7f5880e43700 1 --2- 172.21.15.103:0/583924702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f587c1435f0 0x7f587c143a70 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:45.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.109+0000 7f5880e43700 1 -- 172.21.15.103:0/583924702 >> 172.21.15.103:0/583924702 conn(0x7f587c0614d0 msgr2=0x7f587c0618e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:45.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.109+0000 7f5880e43700 1 -- 172.21.15.103:0/583924702 shutdown_connections 2020-04-22T14:17:45.116 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.109+0000 7f5880e43700 1 -- 172.21.15.103:0/583924702 wait complete. 2020-04-22T14:17:45.120 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.110+0000 7f5880e43700 1 Processor -- start 2020-04-22T14:17:45.120 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.111+0000 7f5880e43700 1 -- start start 2020-04-22T14:17:45.120 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.111+0000 7f5880e43700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f587c0b0ed0 0x7f587c157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:45.121 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.111+0000 7f5880e43700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f587c1435f0 0x7f587c141970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:45.121 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.111+0000 7f5880e43700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f587c155550 con 0x7f587c0b7120 2020-04-22T14:17:45.121 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.111+0000 7f5880e43700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f587c0b35e0 con 0x7f587c0b0ed0 2020-04-22T14:17:45.121 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.111+0000 7f5880e43700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587c0b3880 con 0x7f587c1435f0 2020-04-22T14:17:45.121 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.111+0000 7f587b7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f587c0b0ed0 0x7f587c157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:45.121 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.111+0000 7f587b7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f587c0b0ed0 0x7f587c157240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57384/0 (socket says 172.21.15.103:57384) 2020-04-22T14:17:45.121 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.111+0000 7f587b7fe700 1 -- 172.21.15.103:0/2321726440 learned_addr learned my addr 172.21.15.103:0/2321726440 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:45.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.112+0000 7f587bfff700 1 --2- 172.21.15.103:0/2321726440 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f587c1435f0 0x7f587c141970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:45.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.112+0000 7f587b7fe700 1 -- 172.21.15.103:0/2321726440 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f587c1435f0 msgr2=0x7f587c141970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:45.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.112+0000 7f587b7fe700 1 --2- 172.21.15.103:0/2321726440 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f587c1435f0 0x7f587c141970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:45.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.112+0000 7f587b7fe700 1 -- 172.21.15.103:0/2321726440 >> v1:172.21.15.86:6789/0 conn(0x7f587c0b7120 legacy=0x7f587c154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:45.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.112+0000 7f587b7fe700 1 -- 172.21.15.103:0/2321726440 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f587c0b3b20 con 0x7f587c0b0ed0 2020-04-22T14:17:45.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.112+0000 7f587b7fe700 1 --2- 172.21.15.103:0/2321726440 >> v2:172.21.15.103:3300/0 conn(0x7f587c0b0ed0 0x7f587c157240 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f586c002f30 tx=0x7f586c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.112+0000 7f587b7fe700 1 --2- 172.21.15.103:0/2321726440 >> v2:172.21.15.103:3300/0 conn(0x7f587c0b0ed0 0x7f587c157240 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f586c002f30 tx=0x7f586c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.112+0000 7f587b7fe700 1 --2- 172.21.15.103:0/2321726440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f587c0b0ed0 0x7f587c157240 secure :-1 s=READY pgs=1876 cs=0 l=1 rx=0x7f586c002f30 tx=0x7f586c010ac0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:45.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.112+0000 7f587b7fe700 1 --2- 172.21.15.103:0/2321726440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f587c0b0ed0 0x7f587c157240 secure :-1 s=THROTTLE_DONE pgs=1876 cs=0 l=1 rx=0x7f586c002f30 tx=0x7f586c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.112+0000 7f587b7fe700 1 --2- 172.21.15.103:0/2321726440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f587c0b0ed0 0x7f587c157240 secure :-1 s=THROTTLE_DONE pgs=1876 cs=0 l=1 rx=0x7f586c002f30 tx=0x7f586c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.112+0000 7f5878ff9700 1 -- 172.21.15.103:0/2321726440 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f586c008e80 con 0x7f587c0b0ed0 2020-04-22T14:17:45.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.112+0000 7f587b7fe700 1 --2- 172.21.15.103:0/2321726440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f587c0b0ed0 0x7f587c157240 secure :-1 s=THROTTLE_DONE pgs=1876 cs=0 l=1 rx=0x7f586c002f30 tx=0x7f586c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.112+0000 7f5878ff9700 1 -- 172.21.15.103:0/2321726440 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586c007180 con 0x7f587c0b0ed0 2020-04-22T14:17:45.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.112+0000 7f5880e43700 1 -- 172.21.15.103:0/2321726440 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f587c0b31f0 con 0x7f587c0b0ed0 2020-04-22T14:17:45.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.112+0000 7f5878ff9700 1 -- 172.21.15.103:0/2321726440 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f586c0075a0 con 0x7f587c0b0ed0 2020-04-22T14:17:45.124 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.112+0000 7f5880e43700 1 -- 172.21.15.103:0/2321726440 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f587c0b1dd0 con 0x7f587c0b0ed0 2020-04-22T14:17:45.124 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.113+0000 7f587b7fe700 1 --2- 172.21.15.103:0/2321726440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f587c0b0ed0 0x7f587c157240 secure :-1 s=THROTTLE_DONE pgs=1876 cs=0 l=1 rx=0x7f586c002f30 tx=0x7f586c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.124 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.113+0000 7f5880e43700 1 -- 172.21.15.103:0/2321726440 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f587c0b3cb0 con 0x7f587c0b0ed0 2020-04-22T14:17:45.124 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.113+0000 7f5878ff9700 1 -- 172.21.15.103:0/2321726440 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f586c0059c0 con 0x7f587c0b0ed0 2020-04-22T14:17:45.124 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.113+0000 7f587b7fe700 1 --2- 172.21.15.103:0/2321726440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f587c0b0ed0 0x7f587c157240 secure :-1 s=THROTTLE_DONE pgs=1876 cs=0 l=1 rx=0x7f586c002f30 tx=0x7f586c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.125 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.113+0000 7f5878ff9700 1 --2- 172.21.15.103:0/2321726440 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f586004da50 0x7f586004ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:45.125 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.113+0000 7f5878ff9700 1 -- 172.21.15.103:0/2321726440 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f586c061280 con 0x7f587c0b0ed0 2020-04-22T14:17:45.125 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.114+0000 7f587affd700 1 --2- 172.21.15.103:0/2321726440 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f586004da50 0x7f586004ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:45.125 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.114+0000 7f587affd700 1 --2- 172.21.15.103:0/2321726440 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f586004da50 0x7f586004ff10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f587c1431d0 tx=0x7f5864007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.125 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.114+0000 7f587affd700 1 --2- 172.21.15.103:0/2321726440 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f586004da50 0x7f586004ff10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f587c1431d0 tx=0x7f5864007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.125 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.114+0000 7f587affd700 1 --2- 172.21.15.103:0/2321726440 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f586004da50 0x7f586004ff10 secure :-1 s=READY pgs=687 cs=0 l=1 rx=0x7f587c1431d0 tx=0x7f5864007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:45.125 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.117+0000 7f587b7fe700 1 --2- 172.21.15.103:0/2321726440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f587c0b0ed0 0x7f587c157240 secure :-1 s=THROTTLE_DONE pgs=1876 cs=0 l=1 rx=0x7f586c002f30 tx=0x7f586c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.125 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.117+0000 7f5878ff9700 1 -- 172.21.15.103:0/2321726440 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f586c03c600 con 0x7f587c0b0ed0 2020-04-22T14:17:45.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.260+0000 7f5880e43700 1 -- 172.21.15.103:0/2321726440 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f587c056c90 con 0x7f587c0b0ed0 2020-04-22T14:17:45.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.260+0000 7f587b7fe700 1 --2- 172.21.15.103:0/2321726440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f587c0b0ed0 0x7f587c157240 secure :-1 s=THROTTLE_DONE pgs=1876 cs=0 l=1 rx=0x7f586c002f30 tx=0x7f586c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.263 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.260+0000 7f5878ff9700 1 -- 172.21.15.103:0/2321726440 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v131) v1 ==== 92+0+10 (secure 0 0 0) 0x7f586c03fc20 con 0x7f587c0b0ed0 2020-04-22T14:17:45.263 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:17:45.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.261+0000 7f5880e43700 1 -- 172.21.15.103:0/2321726440 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f586004da50 msgr2=0x7f586004ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:45.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.261+0000 7f5880e43700 1 --2- 172.21.15.103:0/2321726440 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f586004da50 0x7f586004ff10 secure :-1 s=READY pgs=687 cs=0 l=1 rx=0x7f587c1431d0 tx=0x7f5864007a40).stop 2020-04-22T14:17:45.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.261+0000 7f5880e43700 1 -- 172.21.15.103:0/2321726440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f587c0b0ed0 msgr2=0x7f587c157240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:45.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.261+0000 7f5880e43700 1 --2- 172.21.15.103:0/2321726440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f587c0b0ed0 0x7f587c157240 secure :-1 s=READY pgs=1876 cs=0 l=1 rx=0x7f586c002f30 tx=0x7f586c010ac0).stop 2020-04-22T14:17:45.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.261+0000 7f5880e43700 1 -- 172.21.15.103:0/2321726440 shutdown_connections 2020-04-22T14:17:45.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.261+0000 7f5880e43700 1 --2- 172.21.15.103:0/2321726440 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f586004da50 0x7f586004ff10 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:45.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.261+0000 7f5880e43700 1 --2- 172.21.15.103:0/2321726440 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f587c1435f0 0x7f587c141970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:45.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.261+0000 7f5880e43700 1 --2- 172.21.15.103:0/2321726440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f587c0b0ed0 0x7f587c157240 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:45.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.261+0000 7f5880e43700 1 -- 172.21.15.103:0/2321726440 >> 172.21.15.103:0/2321726440 conn(0x7f587c0614d0 msgr2=0x7f587c0b7570 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:45.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.261+0000 7f5880e43700 1 -- 172.21.15.103:0/2321726440 shutdown_connections 2020-04-22T14:17:45.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.261+0000 7f5880e43700 1 -- 172.21.15.103:0/2321726440 wait complete. 2020-04-22T14:17:45.274 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:45.287 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-04-22T14:17:45.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.439+0000 7f3b4c177700 1 Processor -- start 2020-04-22T14:17:45.442 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.440+0000 7f3b4c177700 1 -- start start 2020-04-22T14:17:45.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.440+0000 7f3b4c177700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3b440b6040 0x7f3b440ac740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:45.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.440+0000 7f3b4c177700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b44064ec0 con 0x7f3b441426d0 2020-04-22T14:17:45.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.440+0000 7f3b4c177700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b44146870 con 0x7f3b44067170 2020-04-22T14:17:45.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.440+0000 7f3b4c177700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b44065af0 con 0x7f3b440b6040 2020-04-22T14:17:45.445 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.441+0000 7f3b49712700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3b440b6040 0x7f3b440ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:45.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.441+0000 7f3b49712700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3b440b6040 0x7f3b440ac740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57392/0 (socket says 172.21.15.103:57392) 2020-04-22T14:17:45.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.441+0000 7f3b49f13700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f3b44067170 0x7f3b4413c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49582/0 (socket says 172.21.15.103:49582) 2020-04-22T14:17:45.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.441+0000 7f3b49712700 1 -- 172.21.15.103:0/3148163368 learned_addr learned my addr 172.21.15.103:0/3148163368 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:45.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.441+0000 7f3b49712700 1 -- 172.21.15.103:0/3148163368 >> v1:172.21.15.103:6789/0 conn(0x7f3b44067170 legacy=0x7f3b4413c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:45.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.441+0000 7f3b49712700 1 -- 172.21.15.103:0/3148163368 >> v1:172.21.15.86:6789/0 conn(0x7f3b441426d0 legacy=0x7f3b44142b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:45.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.441+0000 7f3b49712700 1 -- 172.21.15.103:0/3148163368 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b44067550 con 0x7f3b440b6040 2020-04-22T14:17:45.446 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.441+0000 7f3b49712700 1 --2- 172.21.15.103:0/3148163368 >> v2:172.21.15.103:3300/0 conn(0x7f3b440b6040 0x7f3b440ac740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3b44066c90 tx=0x7f3b400088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.441+0000 7f3b49712700 1 --2- 172.21.15.103:0/3148163368 >> v2:172.21.15.103:3300/0 conn(0x7f3b440b6040 0x7f3b440ac740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3b44066c90 tx=0x7f3b400088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.441+0000 7f3b49712700 1 --2- 172.21.15.103:0/3148163368 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b440b6040 0x7f3b440ac740 secure :-1 s=READY pgs=1878 cs=0 l=1 rx=0x7f3b44066c90 tx=0x7f3b400088e0).ready entity=mon.1 client_cookie=b3c0a40709a1c498 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:45.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.441+0000 7f3b49712700 1 --2- 172.21.15.103:0/3148163368 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b440b6040 0x7f3b440ac740 secure :-1 s=THROTTLE_DONE pgs=1878 cs=0 l=1 rx=0x7f3b44066c90 tx=0x7f3b400088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.441+0000 7f3b49712700 1 --2- 172.21.15.103:0/3148163368 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b440b6040 0x7f3b440ac740 secure :-1 s=THROTTLE_DONE pgs=1878 cs=0 l=1 rx=0x7f3b44066c90 tx=0x7f3b400088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.441+0000 7f3b48f11700 1 -- 172.21.15.103:0/3148163368 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b40008e10 con 0x7f3b440b6040 2020-04-22T14:17:45.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.441+0000 7f3b49712700 1 --2- 172.21.15.103:0/3148163368 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b440b6040 0x7f3b440ac740 secure :-1 s=THROTTLE_DONE pgs=1878 cs=0 l=1 rx=0x7f3b44066c90 tx=0x7f3b400088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.447 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.441+0000 7f3b48f11700 1 -- 172.21.15.103:0/3148163368 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b400118b0 con 0x7f3b440b6040 2020-04-22T14:17:45.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.441+0000 7f3b48f11700 1 -- 172.21.15.103:0/3148163368 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b40011c10 con 0x7f3b440b6040 2020-04-22T14:17:45.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.441+0000 7f3b4c177700 1 -- 172.21.15.103:0/3148163368 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b440b6040 msgr2=0x7f3b440ac740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:45.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.441+0000 7f3b4c177700 1 --2- 172.21.15.103:0/3148163368 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b440b6040 0x7f3b440ac740 secure :-1 s=READY pgs=1878 cs=0 l=1 rx=0x7f3b44066c90 tx=0x7f3b400088e0).stop 2020-04-22T14:17:45.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.442+0000 7f3b4c177700 1 -- 172.21.15.103:0/3148163368 shutdown_connections 2020-04-22T14:17:45.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.442+0000 7f3b4c177700 1 --2- 172.21.15.103:0/3148163368 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b440b6040 0x7f3b440ac740 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:45.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.442+0000 7f3b4c177700 1 -- 172.21.15.103:0/3148163368 >> 172.21.15.103:0/3148163368 conn(0x7f3b440b9160 msgr2=0x7f3b4405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:45.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.442+0000 7f3b4c177700 1 -- 172.21.15.103:0/3148163368 shutdown_connections 2020-04-22T14:17:45.448 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.442+0000 7f3b4c177700 1 -- 172.21.15.103:0/3148163368 wait complete. 2020-04-22T14:17:45.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.443+0000 7f3b4c177700 1 Processor -- start 2020-04-22T14:17:45.449 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.443+0000 7f3b4c177700 1 -- start start 2020-04-22T14:17:45.454 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.443+0000 7f3b4c177700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3b440b6040 0x7f3b4413fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:45.454 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.443+0000 7f3b4c177700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b44143840 con 0x7f3b44067170 2020-04-22T14:17:45.455 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.443+0000 7f3b4c177700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b44143ae0 con 0x7f3b441426d0 2020-04-22T14:17:45.455 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.443+0000 7f3b4c177700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b44145230 con 0x7f3b440b6040 2020-04-22T14:17:45.455 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.443+0000 7f3b4a714700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f3b441426d0 0x7f3b4413c1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49592/0 (socket says 172.21.15.103:49592) 2020-04-22T14:17:45.455 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.443+0000 7f3b4a714700 1 -- 172.21.15.103:0/3626203125 learned_addr learned my addr 172.21.15.103:0/3626203125 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:17:45.456 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.444+0000 7f3b32ffd700 1 -- 172.21.15.103:0/3626203125 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3280549342 0 0) 0x7f3b44143ae0 con 0x7f3b441426d0 2020-04-22T14:17:45.456 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.444+0000 7f3b32ffd700 1 -- 172.21.15.103:0/3626203125 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b24002fe0 con 0x7f3b441426d0 2020-04-22T14:17:45.456 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.444+0000 7f3b49712700 1 --2- 172.21.15.103:0/3626203125 >> v2:172.21.15.86:3300/0 conn(0x7f3b440b6040 0x7f3b4413fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:45.456 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.444+0000 7f3b32ffd700 1 -- 172.21.15.103:0/3626203125 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 620640363 0 0) 0x7f3b24002fe0 con 0x7f3b441426d0 2020-04-22T14:17:45.456 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.444+0000 7f3b32ffd700 1 -- 172.21.15.103:0/3626203125 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3b44143ae0 con 0x7f3b441426d0 2020-04-22T14:17:45.456 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.444+0000 7f3b32ffd700 1 -- 172.21.15.103:0/3626203125 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f3b3c002c10 con 0x7f3b441426d0 2020-04-22T14:17:45.456 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.444+0000 7f3b32ffd700 1 -- 172.21.15.103:0/3626203125 >> v2:172.21.15.86:3300/0 conn(0x7f3b440b6040 msgr2=0x7f3b4413fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:45.457 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.444+0000 7f3b32ffd700 1 --2- 172.21.15.103:0/3626203125 >> v2:172.21.15.86:3300/0 conn(0x7f3b440b6040 0x7f3b4413fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:45.457 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.444+0000 7f3b32ffd700 1 -- 172.21.15.103:0/3626203125 >> v1:172.21.15.103:6789/0 conn(0x7f3b441426d0 legacy=0x7f3b4413c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:45.457 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.444+0000 7f3b32ffd700 1 -- 172.21.15.103:0/3626203125 >> v1:172.21.15.86:6789/0 conn(0x7f3b44067170 legacy=0x7f3b4413ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:45.457 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.444+0000 7f3b32ffd700 1 --2- 172.21.15.103:0/3626203125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b240049b0 0x7f3b24004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:45.457 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.444+0000 7f3b32ffd700 1 --2- 172.21.15.103:0/3626203125 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3b24003920 0x7f3b24003da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:45.457 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.444+0000 7f3b32ffd700 1 --2- 172.21.15.103:0/3626203125 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b24004200 0x7f3b2400b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:45.457 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.444+0000 7f3b32ffd700 1 -- 172.21.15.103:0/3626203125 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b44145230 con 0x7f3b24004200 2020-04-22T14:17:45.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.444+0000 7f3b32ffd700 1 -- 172.21.15.103:0/3626203125 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b24004680 con 0x7f3b240049b0 2020-04-22T14:17:45.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.444+0000 7f3b32ffd700 1 -- 172.21.15.103:0/3626203125 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2400bbb0 con 0x7f3b24003920 2020-04-22T14:17:45.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.444+0000 7f3b49f13700 1 --2- 172.21.15.103:0/3626203125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b240049b0 0x7f3b24004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:45.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.444+0000 7f3b4a714700 1 --2- 172.21.15.103:0/3626203125 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b24004200 0x7f3b2400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:45.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.444+0000 7f3b49712700 1 --2- 172.21.15.103:0/3626203125 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3b24003920 0x7f3b24003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:45.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.444+0000 7f3b49f13700 1 -- 172.21.15.103:0/3626203125 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3b24003920 msgr2=0x7f3b24003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:45.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.444+0000 7f3b49f13700 1 --2- 172.21.15.103:0/3626203125 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3b24003920 0x7f3b24003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:45.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.444+0000 7f3b49f13700 1 -- 172.21.15.103:0/3626203125 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b24004200 msgr2=0x7f3b2400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:45.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.444+0000 7f3b49f13700 1 --2- 172.21.15.103:0/3626203125 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b24004200 0x7f3b2400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:45.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.444+0000 7f3b49f13700 1 -- 172.21.15.103:0/3626203125 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b44143d80 con 0x7f3b240049b0 2020-04-22T14:17:45.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.444+0000 7f3b4a714700 1 -- 172.21.15.103:0/3626203125 reap_dead start 2020-04-22T14:17:45.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.444+0000 7f3b49712700 1 --2- 172.21.15.103:0/3626203125 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3b24003920 0x7f3b24003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:17:45.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.444+0000 7f3b4c177700 1 -- 172.21.15.103:0/3626203125 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b4413fb80 con 0x7f3b240049b0 2020-04-22T14:17:45.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.444+0000 7f3b49f13700 1 --2- 172.21.15.103:0/3626203125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b240049b0 0x7f3b24004d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3b24005650 tx=0x7f3b34010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.444+0000 7f3b4c177700 1 -- 172.21.15.103:0/3626203125 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b4413e260 con 0x7f3b240049b0 2020-04-22T14:17:45.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.445+0000 7f3b49f13700 1 --2- 172.21.15.103:0/3626203125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b240049b0 0x7f3b24004d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3b24005650 tx=0x7f3b34010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.445+0000 7f3b49f13700 1 --2- 172.21.15.103:0/3626203125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b240049b0 0x7f3b24004d90 secure :-1 s=READY pgs=1880 cs=0 l=1 rx=0x7f3b24005650 tx=0x7f3b34010ac0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:45.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.445+0000 7f3b49f13700 1 --2- 172.21.15.103:0/3626203125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b240049b0 0x7f3b24004d90 secure :-1 s=THROTTLE_DONE pgs=1880 cs=0 l=1 rx=0x7f3b24005650 tx=0x7f3b34010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.445+0000 7f3b32ffd700 1 -- 172.21.15.103:0/3626203125 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b3400c590 con 0x7f3b240049b0 2020-04-22T14:17:45.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.445+0000 7f3b49f13700 1 --2- 172.21.15.103:0/3626203125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b240049b0 0x7f3b24004d90 secure :-1 s=THROTTLE_DONE pgs=1880 cs=0 l=1 rx=0x7f3b24005650 tx=0x7f3b34010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.445+0000 7f3b49f13700 1 --2- 172.21.15.103:0/3626203125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b240049b0 0x7f3b24004d90 secure :-1 s=THROTTLE_DONE pgs=1880 cs=0 l=1 rx=0x7f3b24005650 tx=0x7f3b34010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.445+0000 7f3b32ffd700 1 -- 172.21.15.103:0/3626203125 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b3400c730 con 0x7f3b240049b0 2020-04-22T14:17:45.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.445+0000 7f3b32ffd700 1 -- 172.21.15.103:0/3626203125 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b3400cb10 con 0x7f3b240049b0 2020-04-22T14:17:45.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.445+0000 7f3b49f13700 1 --2- 172.21.15.103:0/3626203125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b240049b0 0x7f3b24004d90 secure :-1 s=THROTTLE_DONE pgs=1880 cs=0 l=1 rx=0x7f3b24005650 tx=0x7f3b34010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.446+0000 7f3b4c177700 1 -- 172.21.15.103:0/3626203125 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b44056c90 con 0x7f3b240049b0 2020-04-22T14:17:45.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.446+0000 7f3b32ffd700 1 -- 172.21.15.103:0/3626203125 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f3b3400cc70 con 0x7f3b240049b0 2020-04-22T14:17:45.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.446+0000 7f3b49f13700 1 --2- 172.21.15.103:0/3626203125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b240049b0 0x7f3b24004d90 secure :-1 s=THROTTLE_DONE pgs=1880 cs=0 l=1 rx=0x7f3b24005650 tx=0x7f3b34010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.446+0000 7f3b32ffd700 1 --2- 172.21.15.103:0/3626203125 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3b24053a80 0x7f3b24055f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:45.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.446+0000 7f3b32ffd700 1 -- 172.21.15.103:0/3626203125 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f3b34060e10 con 0x7f3b240049b0 2020-04-22T14:17:45.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.446+0000 7f3b49712700 1 --2- 172.21.15.103:0/3626203125 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3b24053a80 0x7f3b24055f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:45.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.446+0000 7f3b49712700 1 --2- 172.21.15.103:0/3626203125 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3b24053a80 0x7f3b24055f40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3b44066c90 tx=0x7f3b440676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.446+0000 7f3b49712700 1 --2- 172.21.15.103:0/3626203125 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3b24053a80 0x7f3b24055f40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3b44066c90 tx=0x7f3b440676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.446+0000 7f3b49712700 1 --2- 172.21.15.103:0/3626203125 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3b24053a80 0x7f3b24055f40 secure :-1 s=READY pgs=688 cs=0 l=1 rx=0x7f3b44066c90 tx=0x7f3b440676e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:45.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.450+0000 7f3b49f13700 1 --2- 172.21.15.103:0/3626203125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b240049b0 0x7f3b24004d90 secure :-1 s=THROTTLE_DONE pgs=1880 cs=0 l=1 rx=0x7f3b24005650 tx=0x7f3b34010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.450+0000 7f3b32ffd700 1 -- 172.21.15.103:0/3626203125 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f3b3403c310 con 0x7f3b240049b0 2020-04-22T14:17:45.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.593+0000 7f3b4c177700 1 -- 172.21.15.103:0/3626203125 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3b44065480 con 0x7f3b240049b0 2020-04-22T14:17:45.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.593+0000 7f3b49f13700 1 --2- 172.21.15.103:0/3626203125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b240049b0 0x7f3b24004d90 secure :-1 s=THROTTLE_DONE pgs=1880 cs=0 l=1 rx=0x7f3b24005650 tx=0x7f3b34010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.594+0000 7f3b32ffd700 1 -- 172.21.15.103:0/3626203125 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v131) v1 ==== 84+0+143 (secure 0 0 0) 0x7f3b3403f930 con 0x7f3b240049b0 2020-04-22T14:17:45.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.595+0000 7f3b4c177700 1 -- 172.21.15.103:0/3626203125 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3b24053a80 msgr2=0x7f3b24055f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:45.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.595+0000 7f3b4c177700 1 --2- 172.21.15.103:0/3626203125 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3b24053a80 0x7f3b24055f40 secure :-1 s=READY pgs=688 cs=0 l=1 rx=0x7f3b44066c90 tx=0x7f3b440676e0).stop 2020-04-22T14:17:45.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.595+0000 7f3b4c177700 1 -- 172.21.15.103:0/3626203125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b240049b0 msgr2=0x7f3b24004d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:45.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.595+0000 7f3b4c177700 1 --2- 172.21.15.103:0/3626203125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b240049b0 0x7f3b24004d90 secure :-1 s=READY pgs=1880 cs=0 l=1 rx=0x7f3b24005650 tx=0x7f3b34010ac0).stop 2020-04-22T14:17:45.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.595+0000 7f3b4c177700 1 -- 172.21.15.103:0/3626203125 shutdown_connections 2020-04-22T14:17:45.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.595+0000 7f3b4c177700 1 --2- 172.21.15.103:0/3626203125 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3b24053a80 0x7f3b24055f40 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:45.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.595+0000 7f3b4c177700 1 --2- 172.21.15.103:0/3626203125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b240049b0 0x7f3b24004d90 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:45.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.595+0000 7f3b4c177700 1 -- 172.21.15.103:0/3626203125 >> 172.21.15.103:0/3626203125 conn(0x7f3b440b9160 msgr2=0x7f3b440b7520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:45.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.595+0000 7f3b4c177700 1 -- 172.21.15.103:0/3626203125 shutdown_connections 2020-04-22T14:17:45.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.595+0000 7f3b4c177700 1 -- 172.21.15.103:0/3626203125 wait complete. 2020-04-22T14:17:45.602 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:17:45.602 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2020-04-22T14:17:45.602 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:45.602 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 1, 2020-04-22T14:17:45.602 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": "device_health_metrics" 2020-04-22T14:17:45.602 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:45.602 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:17:45.602 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 2, 2020-04-22T14:17:45.603 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": "rbd" 2020-04-22T14:17:45.603 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:45.603 INFO:teuthology.orchestra.run.smithi103.stdout:] 2020-04-22T14:17:45.610 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-04-22T14:17:45.611 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:45.625 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-04-22T14:17:45.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.773+0000 7fa2eaa2b700 1 Processor -- start 2020-04-22T14:17:45.775 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.773+0000 7fa2eaa2b700 1 -- start start 2020-04-22T14:17:45.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.773+0000 7fa2eaa2b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa2e414e4c0 0x7fa2e40b4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:45.778 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.773+0000 7fa2eaa2b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e40b49d0 con 0x7fa2e40b9140 2020-04-22T14:17:45.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.773+0000 7fa2eaa2b700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e4061830 con 0x7fa2e40af390 2020-04-22T14:17:45.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.773+0000 7fa2eaa2b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e4061ad0 con 0x7fa2e414e4c0 2020-04-22T14:17:45.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.774+0000 7fa2dbfff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa2e40af390 0x7fa2e414ddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49604/0 (socket says 172.21.15.103:49604) 2020-04-22T14:17:45.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.774+0000 7fa2dbfff700 1 -- 172.21.15.103:0/12950461 learned_addr learned my addr 172.21.15.103:0/12950461 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:17:45.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.774+0000 7fa2e8fc8700 1 --2- 172.21.15.103:0/12950461 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa2e414e4c0 0x7fa2e40b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:45.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.774+0000 7fa2e37fe700 1 -- 172.21.15.103:0/12950461 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2700835805 0 0) 0x7fa2e4061830 con 0x7fa2e40af390 2020-04-22T14:17:45.779 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.774+0000 7fa2e37fe700 1 -- 172.21.15.103:0/12950461 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2c4003230 con 0x7fa2e40af390 2020-04-22T14:17:45.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.774+0000 7fa2e37fe700 1 -- 172.21.15.103:0/12950461 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 152534734 0 0) 0x7fa2c4003230 con 0x7fa2e40af390 2020-04-22T14:17:45.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.774+0000 7fa2e37fe700 1 -- 172.21.15.103:0/12950461 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa2e414e4c0 msgr2=0x7fa2e40b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:45.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.774+0000 7fa2e37fe700 1 --2- 172.21.15.103:0/12950461 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa2e414e4c0 0x7fa2e40b4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:45.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.774+0000 7fa2e37fe700 1 -- 172.21.15.103:0/12950461 >> v1:172.21.15.86:6789/0 conn(0x7fa2e40b9140 legacy=0x7fa2e4061f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:45.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.774+0000 7fa2e37fe700 1 -- 172.21.15.103:0/12950461 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e40b9520 con 0x7fa2e40af390 2020-04-22T14:17:45.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.774+0000 7fa2e37fe700 1 -- 172.21.15.103:0/12950461 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fa2cc0016d0 con 0x7fa2e40af390 2020-04-22T14:17:45.780 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.774+0000 7fa2e37fe700 1 -- 172.21.15.103:0/12950461 >> v1:172.21.15.103:6789/0 conn(0x7fa2e40af390 legacy=0x7fa2e414ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:45.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.774+0000 7fa2e37fe700 1 --2- 172.21.15.103:0/12950461 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa2e414e4c0 0x7fa2c4003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:45.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.774+0000 7fa2e37fe700 1 --2- 172.21.15.103:0/12950461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2c4003b80 0x7fa2c4003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:45.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.774+0000 7fa2e37fe700 1 --2- 172.21.15.103:0/12950461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2c40045c0 0x7fa2c4004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:45.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.774+0000 7fa2e37fe700 1 -- 172.21.15.103:0/12950461 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e4061ad0 con 0x7fa2c4003b80 2020-04-22T14:17:45.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.774+0000 7fa2e37fe700 1 -- 172.21.15.103:0/12950461 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c4004fd0 con 0x7fa2c40045c0 2020-04-22T14:17:45.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.774+0000 7fa2e37fe700 1 -- 172.21.15.103:0/12950461 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c4005190 con 0x7fa2e414e4c0 2020-04-22T14:17:45.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.774+0000 7fa2e8fc8700 1 --2- 172.21.15.103:0/12950461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2c40045c0 0x7fa2c4004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:45.781 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.774+0000 7fa2dbfff700 1 --2- 172.21.15.103:0/12950461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2c4003b80 0x7fa2c4003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:45.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.774+0000 7fa2e3fff700 1 --2- 172.21.15.103:0/12950461 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa2e414e4c0 0x7fa2c4003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:45.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.775+0000 7fa2e8fc8700 1 -- 172.21.15.103:0/12950461 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa2e414e4c0 msgr2=0x7fa2c4003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:45.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.775+0000 7fa2e8fc8700 1 --2- 172.21.15.103:0/12950461 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa2e414e4c0 0x7fa2c4003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:45.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.775+0000 7fa2e8fc8700 1 -- 172.21.15.103:0/12950461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2c4003b80 msgr2=0x7fa2c4003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:45.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.775+0000 7fa2e8fc8700 1 --2- 172.21.15.103:0/12950461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2c4003b80 0x7fa2c4003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:45.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.775+0000 7fa2e8fc8700 1 -- 172.21.15.103:0/12950461 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c4003230 con 0x7fa2c40045c0 2020-04-22T14:17:45.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.775+0000 7fa2e8fc8700 1 --2- 172.21.15.103:0/12950461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2c40045c0 0x7fa2c4004a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa2dc008c90 tx=0x7fa2dc0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.775+0000 7fa2e8fc8700 1 --2- 172.21.15.103:0/12950461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2c40045c0 0x7fa2c4004a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa2dc008c90 tx=0x7fa2dc0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.775+0000 7fa2e8fc8700 1 --2- 172.21.15.103:0/12950461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2c40045c0 0x7fa2c4004a20 secure :-1 s=READY pgs=1882 cs=0 l=1 rx=0x7fa2dc008c90 tx=0x7fa2dc0103d0).ready entity=mon.1 client_cookie=5882bcf6fc7e65c9 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:45.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.775+0000 7fa2e8fc8700 1 --2- 172.21.15.103:0/12950461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2c40045c0 0x7fa2c4004a20 secure :-1 s=THROTTLE_DONE pgs=1882 cs=0 l=1 rx=0x7fa2dc008c90 tx=0x7fa2dc0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.775+0000 7fa2e37fe700 1 -- 172.21.15.103:0/12950461 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2dc005a40 con 0x7fa2c40045c0 2020-04-22T14:17:45.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.775+0000 7fa2e8fc8700 1 --2- 172.21.15.103:0/12950461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2c40045c0 0x7fa2c4004a20 secure :-1 s=THROTTLE_DONE pgs=1882 cs=0 l=1 rx=0x7fa2dc008c90 tx=0x7fa2dc0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.775+0000 7fa2e37fe700 1 -- 172.21.15.103:0/12950461 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2dc005ba0 con 0x7fa2c40045c0 2020-04-22T14:17:45.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.775+0000 7fa2e8fc8700 1 --2- 172.21.15.103:0/12950461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2c40045c0 0x7fa2c4004a20 secure :-1 s=THROTTLE_DONE pgs=1882 cs=0 l=1 rx=0x7fa2dc008c90 tx=0x7fa2dc0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.783 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.775+0000 7fa2e37fe700 1 -- 172.21.15.103:0/12950461 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2dc0110d0 con 0x7fa2c40045c0 2020-04-22T14:17:45.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.775+0000 7fa2eaa2b700 1 -- 172.21.15.103:0/12950461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2c40045c0 msgr2=0x7fa2c4004a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:45.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.775+0000 7fa2eaa2b700 1 --2- 172.21.15.103:0/12950461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2c40045c0 0x7fa2c4004a20 secure :-1 s=READY pgs=1882 cs=0 l=1 rx=0x7fa2dc008c90 tx=0x7fa2dc0103d0).stop 2020-04-22T14:17:45.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.775+0000 7fa2e8fc8700 1 -- 172.21.15.103:0/12950461 reap_dead start 2020-04-22T14:17:45.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.775+0000 7fa2eaa2b700 1 -- 172.21.15.103:0/12950461 shutdown_connections 2020-04-22T14:17:45.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.775+0000 7fa2eaa2b700 1 -- 172.21.15.103:0/12950461 >> 172.21.15.103:0/12950461 conn(0x7fa2e405b7b0 msgr2=0x7fa2e40b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:45.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.775+0000 7fa2eaa2b700 1 -- 172.21.15.103:0/12950461 shutdown_connections 2020-04-22T14:17:45.784 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.775+0000 7fa2eaa2b700 1 -- 172.21.15.103:0/12950461 wait complete. 2020-04-22T14:17:45.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.776+0000 7fa2eaa2b700 1 Processor -- start 2020-04-22T14:17:45.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.776+0000 7fa2eaa2b700 1 -- start start 2020-04-22T14:17:45.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.777+0000 7fa2eaa2b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa2e41466f0 0x7fa2e415bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:45.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.777+0000 7fa2eaa2b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa2e40b1240 0x7fa2e40b1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:45.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.777+0000 7fa2eaa2b700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e4112a70 con 0x7fa2e414d1e0 2020-04-22T14:17:45.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.777+0000 7fa2eaa2b700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2e4112d10 con 0x7fa2e41466f0 2020-04-22T14:17:45.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.777+0000 7fa2eaa2b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e4112fb0 con 0x7fa2e40b1240 2020-04-22T14:17:45.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.777+0000 7fa2e3fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa2e41466f0 0x7fa2e415bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:45.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.777+0000 7fa2e3fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa2e41466f0 0x7fa2e415bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57424/0 (socket says 172.21.15.103:57424) 2020-04-22T14:17:45.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.777+0000 7fa2dbfff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa2e414d1e0 0x7fa2e4113450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49616/0 (socket says 172.21.15.103:49616) 2020-04-22T14:17:45.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.777+0000 7fa2e3fff700 1 -- 172.21.15.103:0/3078654098 learned_addr learned my addr 172.21.15.103:0/3078654098 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:45.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.777+0000 7fa2e8fc8700 1 --2- 172.21.15.103:0/3078654098 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa2e40b1240 0x7fa2e40b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:45.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.777+0000 7fa2e1ffb700 1 -- 172.21.15.103:0/3078654098 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 553902310 0 0) 0x7fa2e4112a70 con 0x7fa2e414d1e0 2020-04-22T14:17:45.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.777+0000 7fa2e3fff700 1 -- 172.21.15.103:0/3078654098 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa2e40b1240 msgr2=0x7fa2e40b1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:45.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.777+0000 7fa2e3fff700 1 --2- 172.21.15.103:0/3078654098 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa2e40b1240 0x7fa2e40b1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:45.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.777+0000 7fa2e3fff700 1 -- 172.21.15.103:0/3078654098 >> v1:172.21.15.103:6789/0 conn(0x7fa2e414d1e0 legacy=0x7fa2e4113450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:45.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.777+0000 7fa2e3fff700 1 -- 172.21.15.103:0/3078654098 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e415c1d0 con 0x7fa2e41466f0 2020-04-22T14:17:45.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.777+0000 7fa2e3fff700 1 --2- 172.21.15.103:0/3078654098 >> v2:172.21.15.103:3300/0 conn(0x7fa2e41466f0 0x7fa2e415bd70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa2e40b6250 tx=0x7fa2d4010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.778+0000 7fa2e3fff700 1 --2- 172.21.15.103:0/3078654098 >> v2:172.21.15.103:3300/0 conn(0x7fa2e41466f0 0x7fa2e415bd70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa2e40b6250 tx=0x7fa2d4010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.778+0000 7fa2e3fff700 1 --2- 172.21.15.103:0/3078654098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2e41466f0 0x7fa2e415bd70 secure :-1 s=READY pgs=1884 cs=0 l=1 rx=0x7fa2e40b6250 tx=0x7fa2d4010b70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:45.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.778+0000 7fa2e3fff700 1 --2- 172.21.15.103:0/3078654098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2e41466f0 0x7fa2e415bd70 secure :-1 s=THROTTLE_DONE pgs=1884 cs=0 l=1 rx=0x7fa2e40b6250 tx=0x7fa2d4010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.778+0000 7fa2e1ffb700 1 -- 172.21.15.103:0/3078654098 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2d4001e60 con 0x7fa2e41466f0 2020-04-22T14:17:45.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.778+0000 7fa2e3fff700 1 --2- 172.21.15.103:0/3078654098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2e41466f0 0x7fa2e415bd70 secure :-1 s=THROTTLE_DONE pgs=1884 cs=0 l=1 rx=0x7fa2e40b6250 tx=0x7fa2d4010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.778+0000 7fa2e3fff700 1 --2- 172.21.15.103:0/3078654098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2e41466f0 0x7fa2e415bd70 secure :-1 s=THROTTLE_DONE pgs=1884 cs=0 l=1 rx=0x7fa2e40b6250 tx=0x7fa2d4010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.778+0000 7fa2e1ffb700 1 -- 172.21.15.103:0/3078654098 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d400c840 con 0x7fa2e41466f0 2020-04-22T14:17:45.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.778+0000 7fa2eaa2b700 1 -- 172.21.15.103:0/3078654098 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2e4146ad0 con 0x7fa2e41466f0 2020-04-22T14:17:45.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.778+0000 7fa2e1ffb700 1 -- 172.21.15.103:0/3078654098 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2d400cc20 con 0x7fa2e41466f0 2020-04-22T14:17:45.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.778+0000 7fa2eaa2b700 1 -- 172.21.15.103:0/3078654098 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2e414b420 con 0x7fa2e41466f0 2020-04-22T14:17:45.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.778+0000 7fa2e3fff700 1 --2- 172.21.15.103:0/3078654098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2e41466f0 0x7fa2e415bd70 secure :-1 s=THROTTLE_DONE pgs=1884 cs=0 l=1 rx=0x7fa2e40b6250 tx=0x7fa2d4010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.779+0000 7fa2eaa2b700 1 -- 172.21.15.103:0/3078654098 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2e4056c90 con 0x7fa2e41466f0 2020-04-22T14:17:45.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.779+0000 7fa2e1ffb700 1 -- 172.21.15.103:0/3078654098 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fa2d40064e0 con 0x7fa2e41466f0 2020-04-22T14:17:45.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.779+0000 7fa2e3fff700 1 --2- 172.21.15.103:0/3078654098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2e41466f0 0x7fa2e415bd70 secure :-1 s=THROTTLE_DONE pgs=1884 cs=0 l=1 rx=0x7fa2e40b6250 tx=0x7fa2d4010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.779+0000 7fa2e1ffb700 1 --2- 172.21.15.103:0/3078654098 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa2c804d760 0x7fa2c804fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:45.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.779+0000 7fa2e1ffb700 1 -- 172.21.15.103:0/3078654098 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fa2d40610f0 con 0x7fa2e41466f0 2020-04-22T14:17:45.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.779+0000 7fa2dbfff700 1 --2- 172.21.15.103:0/3078654098 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa2c804d760 0x7fa2c804fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:45.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.780+0000 7fa2dbfff700 1 --2- 172.21.15.103:0/3078654098 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa2c804d760 0x7fa2c804fc20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa2cc000b80 tx=0x7fa2e40b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.780+0000 7fa2dbfff700 1 --2- 172.21.15.103:0/3078654098 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa2c804d760 0x7fa2c804fc20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa2cc000b80 tx=0x7fa2e40b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.780+0000 7fa2dbfff700 1 --2- 172.21.15.103:0/3078654098 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa2c804d760 0x7fa2c804fc20 secure :-1 s=READY pgs=689 cs=0 l=1 rx=0x7fa2cc000b80 tx=0x7fa2e40b96b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:45.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.783+0000 7fa2e3fff700 1 --2- 172.21.15.103:0/3078654098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2e41466f0 0x7fa2e415bd70 secure :-1 s=THROTTLE_DONE pgs=1884 cs=0 l=1 rx=0x7fa2e40b6250 tx=0x7fa2d4010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:45.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.783+0000 7fa2e1ffb700 1 -- 172.21.15.103:0/3078654098 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fa2d403c4d0 con 0x7fa2e41466f0 2020-04-22T14:17:45.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:45.926+0000 7fa2eaa2b700 1 -- 172.21.15.103:0/3078654098 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fa2e4113120 con 0x7fa2e41466f0 2020-04-22T14:17:46.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.611+0000 7fa2e3fff700 1 --2- 172.21.15.103:0/3078654098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2e41466f0 0x7fa2e415bd70 secure :-1 s=THROTTLE_DONE pgs=1884 cs=0 l=1 rx=0x7fa2e40b6250 tx=0x7fa2d4010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:46.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.611+0000 7fa2e1ffb700 1 -- 172.21.15.103:0/3078654098 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v132) v1 ==== 133+0+0 (secure 0 0 0) 0x7fa2d403faf0 con 0x7fa2e41466f0 2020-04-22T14:17:46.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.614+0000 7fa2eaa2b700 1 -- 172.21.15.103:0/3078654098 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa2c804d760 msgr2=0x7fa2c804fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:46.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.614+0000 7fa2eaa2b700 1 --2- 172.21.15.103:0/3078654098 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa2c804d760 0x7fa2c804fc20 secure :-1 s=READY pgs=689 cs=0 l=1 rx=0x7fa2cc000b80 tx=0x7fa2e40b96b0).stop 2020-04-22T14:17:46.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.614+0000 7fa2eaa2b700 1 -- 172.21.15.103:0/3078654098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2e41466f0 msgr2=0x7fa2e415bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:46.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.614+0000 7fa2eaa2b700 1 --2- 172.21.15.103:0/3078654098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2e41466f0 0x7fa2e415bd70 secure :-1 s=READY pgs=1884 cs=0 l=1 rx=0x7fa2e40b6250 tx=0x7fa2d4010b70).stop 2020-04-22T14:17:46.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.614+0000 7fa2eaa2b700 1 -- 172.21.15.103:0/3078654098 shutdown_connections 2020-04-22T14:17:46.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.614+0000 7fa2eaa2b700 1 --2- 172.21.15.103:0/3078654098 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa2c804d760 0x7fa2c804fc20 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:46.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.614+0000 7fa2eaa2b700 1 --2- 172.21.15.103:0/3078654098 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa2e40b1240 0x7fa2e40b1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:46.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.614+0000 7fa2eaa2b700 1 --2- 172.21.15.103:0/3078654098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2e41466f0 0x7fa2e415bd70 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:46.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.614+0000 7fa2eaa2b700 1 -- 172.21.15.103:0/3078654098 >> 172.21.15.103:0/3078654098 conn(0x7fa2e405b7b0 msgr2=0x7fa2e40b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:46.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.614+0000 7fa2eaa2b700 1 -- 172.21.15.103:0/3078654098 shutdown_connections 2020-04-22T14:17:46.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.614+0000 7fa2eaa2b700 1 -- 172.21.15.103:0/3078654098 wait complete. 2020-04-22T14:17:46.618 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' created 2020-04-22T14:17:46.629 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:46.643 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-04-22T14:17:46.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.794+0000 7fc6c9b89700 1 Processor -- start 2020-04-22T14:17:46.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.794+0000 7fc6c9b89700 1 -- start start 2020-04-22T14:17:46.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.794+0000 7fc6c9b89700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc6c40b9140 0x7fc6c40aed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:46.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.794+0000 7fc6c9b89700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc6c40b3bd0 0x7fc6c40af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:46.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.795+0000 7fc6c9b89700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c4148310 con 0x7fc6c40616b0 2020-04-22T14:17:46.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.795+0000 7fc6c9b89700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6c40af650 con 0x7fc6c40b3bd0 2020-04-22T14:17:46.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.795+0000 7fc6c9b89700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6c41485b0 con 0x7fc6c40b9140 2020-04-22T14:17:46.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.795+0000 7fc6c37fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc6c40b9140 0x7fc6c40aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:46.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.795+0000 7fc6c3fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc6c40616b0 0x7fc6c4061b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49622/0 (socket says 172.21.15.103:49622) 2020-04-22T14:17:46.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.795+0000 7fc6c3fff700 1 -- 172.21.15.103:0/4251029581 learned_addr learned my addr 172.21.15.103:0/4251029581 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:17:46.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.795+0000 7fc6c2ffd700 1 --2- 172.21.15.103:0/4251029581 >> v2:172.21.15.86:3300/0 conn(0x7fc6c40b3bd0 0x7fc6c40af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:46.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.795+0000 7fc6c37fe700 1 -- 172.21.15.103:0/4251029581 >> v2:172.21.15.86:3300/0 conn(0x7fc6c40b3bd0 msgr2=0x7fc6c40af1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:46.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.795+0000 7fc6c37fe700 1 --2- 172.21.15.103:0/4251029581 >> v2:172.21.15.86:3300/0 conn(0x7fc6c40b3bd0 0x7fc6c40af1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:46.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.795+0000 7fc6c37fe700 1 -- 172.21.15.103:0/4251029581 >> v1:172.21.15.103:6789/0 conn(0x7fc6c40616b0 legacy=0x7fc6c4061b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:46.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.795+0000 7fc6c27fc700 1 -- 172.21.15.103:0/4251029581 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 244117412 0 0) 0x7fc6c4148310 con 0x7fc6c40616b0 2020-04-22T14:17:46.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.795+0000 7fc6c37fe700 1 -- 172.21.15.103:0/4251029581 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c40b9520 con 0x7fc6c40b9140 2020-04-22T14:17:46.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.795+0000 7fc6c37fe700 1 --2- 172.21.15.103:0/4251029581 >> v2:172.21.15.103:3300/0 conn(0x7fc6c40b9140 0x7fc6c40aed90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc6bc0032b0 tx=0x7fc6bc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:46.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.795+0000 7fc6c37fe700 1 --2- 172.21.15.103:0/4251029581 >> v2:172.21.15.103:3300/0 conn(0x7fc6c40b9140 0x7fc6c40aed90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc6bc0032b0 tx=0x7fc6bc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:46.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.795+0000 7fc6c37fe700 1 --2- 172.21.15.103:0/4251029581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6c40b9140 0x7fc6c40aed90 secure :-1 s=READY pgs=1886 cs=0 l=1 rx=0x7fc6bc0032b0 tx=0x7fc6bc007dc0).ready entity=mon.1 client_cookie=f64b100c9aecd7e2 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:46.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.795+0000 7fc6c37fe700 1 --2- 172.21.15.103:0/4251029581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6c40b9140 0x7fc6c40aed90 secure :-1 s=THROTTLE_DONE pgs=1886 cs=0 l=1 rx=0x7fc6bc0032b0 tx=0x7fc6bc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:46.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.795+0000 7fc6c27fc700 1 -- 172.21.15.103:0/4251029581 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6bc00a180 con 0x7fc6c40b9140 2020-04-22T14:17:46.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.795+0000 7fc6c37fe700 1 --2- 172.21.15.103:0/4251029581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6c40b9140 0x7fc6c40aed90 secure :-1 s=THROTTLE_DONE pgs=1886 cs=0 l=1 rx=0x7fc6bc0032b0 tx=0x7fc6bc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:46.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.795+0000 7fc6c37fe700 1 --2- 172.21.15.103:0/4251029581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6c40b9140 0x7fc6c40aed90 secure :-1 s=THROTTLE_DONE pgs=1886 cs=0 l=1 rx=0x7fc6bc0032b0 tx=0x7fc6bc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:46.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.795+0000 7fc6c27fc700 1 -- 172.21.15.103:0/4251029581 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6bc00a2e0 con 0x7fc6c40b9140 2020-04-22T14:17:46.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.795+0000 7fc6c27fc700 1 -- 172.21.15.103:0/4251029581 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6bc00a6c0 con 0x7fc6c40b9140 2020-04-22T14:17:46.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.795+0000 7fc6c9b89700 1 -- 172.21.15.103:0/4251029581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6c40b9140 msgr2=0x7fc6c40aed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:46.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.795+0000 7fc6c9b89700 1 --2- 172.21.15.103:0/4251029581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6c40b9140 0x7fc6c40aed90 secure :-1 s=READY pgs=1886 cs=0 l=1 rx=0x7fc6bc0032b0 tx=0x7fc6bc007dc0).stop 2020-04-22T14:17:46.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.796+0000 7fc6c9b89700 1 -- 172.21.15.103:0/4251029581 shutdown_connections 2020-04-22T14:17:46.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.796+0000 7fc6c9b89700 1 --2- 172.21.15.103:0/4251029581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6c40b9140 0x7fc6c40aed90 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:46.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.796+0000 7fc6c9b89700 1 --2- 172.21.15.103:0/4251029581 >> v2:172.21.15.86:3300/0 conn(0x7fc6c40b3bd0 0x7fc6c40af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:46.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.796+0000 7fc6c9b89700 1 -- 172.21.15.103:0/4251029581 >> 172.21.15.103:0/4251029581 conn(0x7fc6c405b7b0 msgr2=0x7fc6c40b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:46.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.796+0000 7fc6c9b89700 1 -- 172.21.15.103:0/4251029581 shutdown_connections 2020-04-22T14:17:46.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.796+0000 7fc6c9b89700 1 -- 172.21.15.103:0/4251029581 wait complete. 2020-04-22T14:17:46.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.797+0000 7fc6c9b89700 1 Processor -- start 2020-04-22T14:17:46.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.797+0000 7fc6c9b89700 1 -- start start 2020-04-22T14:17:46.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.798+0000 7fc6c9b89700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc6c40b3bd0 0x7fc6c4144bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:46.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.798+0000 7fc6c9b89700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6c40b9140 0x7fc6c40ac8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:46.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.798+0000 7fc6c9b89700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c40acf20 con 0x7fc6c40616b0 2020-04-22T14:17:46.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.798+0000 7fc6c9b89700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6c40ad1c0 con 0x7fc6c40b3bd0 2020-04-22T14:17:46.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.798+0000 7fc6c9b89700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c40ad460 con 0x7fc6c40b9140 2020-04-22T14:17:46.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.798+0000 7fc6c37fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc6c40616b0 0x7fc6c4145f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49626/0 (socket says 172.21.15.103:49626) 2020-04-22T14:17:46.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.798+0000 7fc6c37fe700 1 -- 172.21.15.103:0/4177513125 learned_addr learned my addr 172.21.15.103:0/4177513125 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:17:46.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.798+0000 7fc6c3fff700 1 --2- 172.21.15.103:0/4177513125 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6c40b9140 0x7fc6c40ac8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:46.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.798+0000 7fc6c2ffd700 1 --2- 172.21.15.103:0/4177513125 >> v2:172.21.15.86:3300/0 conn(0x7fc6c40b3bd0 0x7fc6c4144bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:46.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.798+0000 7fc6c0ff9700 1 -- 172.21.15.103:0/4177513125 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 208885746 0 0) 0x7fc6c40acf20 con 0x7fc6c40616b0 2020-04-22T14:17:46.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.798+0000 7fc6c0ff9700 1 -- 172.21.15.103:0/4177513125 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6a4002fe0 con 0x7fc6c40616b0 2020-04-22T14:17:46.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.798+0000 7fc6c0ff9700 1 -- 172.21.15.103:0/4177513125 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2627855223 0 0) 0x7fc6a4002fe0 con 0x7fc6c40616b0 2020-04-22T14:17:46.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.798+0000 7fc6c0ff9700 1 -- 172.21.15.103:0/4177513125 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc6c40acf20 con 0x7fc6c40616b0 2020-04-22T14:17:46.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.798+0000 7fc6c0ff9700 1 -- 172.21.15.103:0/4177513125 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fc6bc008960 con 0x7fc6c40616b0 2020-04-22T14:17:46.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.798+0000 7fc6c0ff9700 1 -- 172.21.15.103:0/4177513125 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6c40b9140 msgr2=0x7fc6c40ac8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:46.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.798+0000 7fc6c0ff9700 1 --2- 172.21.15.103:0/4177513125 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6c40b9140 0x7fc6c40ac8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:46.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.798+0000 7fc6c0ff9700 1 -- 172.21.15.103:0/4177513125 >> v2:172.21.15.86:3300/0 conn(0x7fc6c40b3bd0 msgr2=0x7fc6c4144bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:46.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.798+0000 7fc6c0ff9700 1 --2- 172.21.15.103:0/4177513125 >> v2:172.21.15.86:3300/0 conn(0x7fc6c40b3bd0 0x7fc6c4144bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:46.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.798+0000 7fc6c0ff9700 1 -- 172.21.15.103:0/4177513125 >> v1:172.21.15.103:6789/0 conn(0x7fc6c40616b0 legacy=0x7fc6c4145f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:46.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.798+0000 7fc6c0ff9700 1 --2- 172.21.15.103:0/4177513125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6a40049b0 0x7fc6a4004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:46.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.798+0000 7fc6c0ff9700 1 --2- 172.21.15.103:0/4177513125 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6a4003920 0x7fc6a4003d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:46.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.798+0000 7fc6c0ff9700 1 --2- 172.21.15.103:0/4177513125 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6a40041c0 0x7fc6a400b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:46.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.798+0000 7fc6c0ff9700 1 -- 172.21.15.103:0/4177513125 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c40ad1c0 con 0x7fc6a40041c0 2020-04-22T14:17:46.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.798+0000 7fc6c0ff9700 1 -- 172.21.15.103:0/4177513125 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c40ad460 con 0x7fc6a40049b0 2020-04-22T14:17:46.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.798+0000 7fc6c0ff9700 1 -- 172.21.15.103:0/4177513125 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a40046c0 con 0x7fc6a4003920 2020-04-22T14:17:46.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.798+0000 7fc6c3fff700 1 --2- 172.21.15.103:0/4177513125 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6c40b9140 0x7fc6c40ac8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:17:46.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.798+0000 7fc6c37fe700 1 --2- 172.21.15.103:0/4177513125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6a40049b0 0x7fc6a4004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:46.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.798+0000 7fc6c2ffd700 1 --2- 172.21.15.103:0/4177513125 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6a4003920 0x7fc6a4003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:46.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.798+0000 7fc6c3fff700 1 --2- 172.21.15.103:0/4177513125 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6a40041c0 0x7fc6a400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:46.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.799+0000 7fc6c37fe700 1 -- 172.21.15.103:0/4177513125 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6a4003920 msgr2=0x7fc6a4003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:46.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.799+0000 7fc6c37fe700 1 --2- 172.21.15.103:0/4177513125 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6a4003920 0x7fc6a4003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:46.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.799+0000 7fc6c37fe700 1 -- 172.21.15.103:0/4177513125 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6a40041c0 msgr2=0x7fc6a400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:46.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.799+0000 7fc6c37fe700 1 --2- 172.21.15.103:0/4177513125 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6a40041c0 0x7fc6a400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:46.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.799+0000 7fc6c37fe700 1 -- 172.21.15.103:0/4177513125 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c4146640 con 0x7fc6a40049b0 2020-04-22T14:17:46.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.799+0000 7fc6c9b89700 1 -- 172.21.15.103:0/4177513125 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c40ac8f0 con 0x7fc6a40049b0 2020-04-22T14:17:46.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.799+0000 7fc6c3fff700 1 --2- 172.21.15.103:0/4177513125 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6a40041c0 0x7fc6a400b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:17:46.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.799+0000 7fc6c37fe700 1 --2- 172.21.15.103:0/4177513125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6a40049b0 0x7fc6a4004dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc6a4005650 tx=0x7fc6bc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:46.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.799+0000 7fc6c9b89700 1 -- 172.21.15.103:0/4177513125 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c4142800 con 0x7fc6a40049b0 2020-04-22T14:17:46.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.799+0000 7fc6c37fe700 1 --2- 172.21.15.103:0/4177513125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6a40049b0 0x7fc6a4004dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc6a4005650 tx=0x7fc6bc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:46.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.799+0000 7fc6c37fe700 1 --2- 172.21.15.103:0/4177513125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6a40049b0 0x7fc6a4004dd0 secure :-1 s=READY pgs=1888 cs=0 l=1 rx=0x7fc6a4005650 tx=0x7fc6bc007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:46.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.799+0000 7fc6c37fe700 1 --2- 172.21.15.103:0/4177513125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6a40049b0 0x7fc6a4004dd0 secure :-1 s=THROTTLE_DONE pgs=1888 cs=0 l=1 rx=0x7fc6a4005650 tx=0x7fc6bc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:46.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.799+0000 7fc6c0ff9700 1 -- 172.21.15.103:0/4177513125 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6bc007f50 con 0x7fc6a40049b0 2020-04-22T14:17:46.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.799+0000 7fc6c37fe700 1 --2- 172.21.15.103:0/4177513125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6a40049b0 0x7fc6a4004dd0 secure :-1 s=THROTTLE_DONE pgs=1888 cs=0 l=1 rx=0x7fc6a4005650 tx=0x7fc6bc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:46.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.799+0000 7fc6c37fe700 1 --2- 172.21.15.103:0/4177513125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6a40049b0 0x7fc6a4004dd0 secure :-1 s=THROTTLE_DONE pgs=1888 cs=0 l=1 rx=0x7fc6a4005650 tx=0x7fc6bc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:46.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.799+0000 7fc6c0ff9700 1 -- 172.21.15.103:0/4177513125 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6bc011e30 con 0x7fc6a40049b0 2020-04-22T14:17:46.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.799+0000 7fc6c0ff9700 1 -- 172.21.15.103:0/4177513125 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6bc00fb90 con 0x7fc6a40049b0 2020-04-22T14:17:46.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.799+0000 7fc6c37fe700 1 --2- 172.21.15.103:0/4177513125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6a40049b0 0x7fc6a4004dd0 secure :-1 s=THROTTLE_DONE pgs=1888 cs=0 l=1 rx=0x7fc6a4005650 tx=0x7fc6bc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:46.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.800+0000 7fc6c9b89700 1 -- 172.21.15.103:0/4177513125 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6a0003340 con 0x7fc6a40049b0 2020-04-22T14:17:46.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.800+0000 7fc6c0ff9700 1 -- 172.21.15.103:0/4177513125 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fc6bc007360 con 0x7fc6a40049b0 2020-04-22T14:17:46.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.800+0000 7fc6c37fe700 1 --2- 172.21.15.103:0/4177513125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6a40049b0 0x7fc6a4004dd0 secure :-1 s=THROTTLE_DONE pgs=1888 cs=0 l=1 rx=0x7fc6a4005650 tx=0x7fc6bc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:46.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.800+0000 7fc6c0ff9700 1 --2- 172.21.15.103:0/4177513125 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc6a4056030 0x7fc6a40584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:46.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.800+0000 7fc6c0ff9700 1 -- 172.21.15.103:0/4177513125 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fc6bc062c00 con 0x7fc6a40049b0 2020-04-22T14:17:46.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.800+0000 7fc6c2ffd700 1 --2- 172.21.15.103:0/4177513125 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc6a4056030 0x7fc6a40584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:46.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.800+0000 7fc6c2ffd700 1 --2- 172.21.15.103:0/4177513125 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc6a4056030 0x7fc6a40584f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc6b8002f30 tx=0x7fc6b80066f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:46.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.800+0000 7fc6c2ffd700 1 --2- 172.21.15.103:0/4177513125 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc6a4056030 0x7fc6a40584f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc6b8002f30 tx=0x7fc6b80066f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:46.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.800+0000 7fc6c2ffd700 1 --2- 172.21.15.103:0/4177513125 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc6a4056030 0x7fc6a40584f0 secure :-1 s=READY pgs=690 cs=0 l=1 rx=0x7fc6b8002f30 tx=0x7fc6b80066f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:46.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.804+0000 7fc6c37fe700 1 --2- 172.21.15.103:0/4177513125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6a40049b0 0x7fc6a4004dd0 secure :-1 s=THROTTLE_DONE pgs=1888 cs=0 l=1 rx=0x7fc6a4005650 tx=0x7fc6bc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:46.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.804+0000 7fc6c0ff9700 1 -- 172.21.15.103:0/4177513125 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fc6bc03e100 con 0x7fc6a40049b0 2020-04-22T14:17:46.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:46.947+0000 7fc6c9b89700 1 -- 172.21.15.103:0/4177513125 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fc6a0002200 con 0x7fc6a40049b0 2020-04-22T14:17:47.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.616+0000 7fc6c37fe700 1 --2- 172.21.15.103:0/4177513125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6a40049b0 0x7fc6a4004dd0 secure :-1 s=THROTTLE_DONE pgs=1888 cs=0 l=1 rx=0x7fc6a4005650 tx=0x7fc6bc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:47.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.617+0000 7fc6c0ff9700 1 -- 172.21.15.103:0/4177513125 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v133) v1 ==== 125+0+0 (secure 0 0 0) 0x7fc6bc041720 con 0x7fc6a40049b0 2020-04-22T14:17:47.625 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.623+0000 7fc6c9b89700 1 -- 172.21.15.103:0/4177513125 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc6a4056030 msgr2=0x7fc6a40584f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:47.625 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.623+0000 7fc6c9b89700 1 --2- 172.21.15.103:0/4177513125 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc6a4056030 0x7fc6a40584f0 secure :-1 s=READY pgs=690 cs=0 l=1 rx=0x7fc6b8002f30 tx=0x7fc6b80066f0).stop 2020-04-22T14:17:47.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.623+0000 7fc6c9b89700 1 -- 172.21.15.103:0/4177513125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6a40049b0 msgr2=0x7fc6a4004dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:47.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.623+0000 7fc6c9b89700 1 --2- 172.21.15.103:0/4177513125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6a40049b0 0x7fc6a4004dd0 secure :-1 s=READY pgs=1888 cs=0 l=1 rx=0x7fc6a4005650 tx=0x7fc6bc007dc0).stop 2020-04-22T14:17:47.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.623+0000 7fc6c3fff700 1 -- 172.21.15.103:0/4177513125 reap_dead start 2020-04-22T14:17:47.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.623+0000 7fc6c9b89700 1 -- 172.21.15.103:0/4177513125 shutdown_connections 2020-04-22T14:17:47.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.623+0000 7fc6c9b89700 1 --2- 172.21.15.103:0/4177513125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6a40049b0 0x7fc6a4004dd0 secure :-1 s=CLOSED pgs=1888 cs=0 l=1 rx=0x7fc6a4005650 tx=0x7fc6bc007dc0).stop 2020-04-22T14:17:47.626 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.623+0000 7fc6c9b89700 1 -- 172.21.15.103:0/4177513125 >> 172.21.15.103:0/4177513125 conn(0x7fc6c405b7b0 msgr2=0x7fc6c413f120 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:47.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.625+0000 7fc6c9b89700 1 -- 172.21.15.103:0/4177513125 shutdown_connections 2020-04-22T14:17:47.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.625+0000 7fc6c9b89700 1 -- 172.21.15.103:0/4177513125 wait complete. 2020-04-22T14:17:47.633 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' created 2020-04-22T14:17:47.639 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:47.653 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-04-22T14:17:47.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.804+0000 7f40c0f4e700 1 Processor -- start 2020-04-22T14:17:47.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.804+0000 7f40c0f4e700 1 -- start start 2020-04-22T14:17:47.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.805+0000 7f40c0f4e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f40bc0b9140 0x7f40bc12b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:47.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.805+0000 7f40c0f4e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f40bc12b670 0x7f40bc143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:47.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.805+0000 7f40c0f4e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40bc1467e0 con 0x7f40bc0ac950 2020-04-22T14:17:47.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.805+0000 7f40c0f4e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40bc0602f0 con 0x7f40bc0b9140 2020-04-22T14:17:47.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.805+0000 7f40c0f4e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40bc060050 con 0x7f40bc12b670 2020-04-22T14:17:47.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.805+0000 7f40bad9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f40bc12b670 0x7f40bc143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:47.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.805+0000 7f40bad9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f40bc12b670 0x7f40bc143090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57450/0 (socket says 172.21.15.103:57450) 2020-04-22T14:17:47.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.805+0000 7f40bad9d700 1 -- 172.21.15.103:0/1294209603 learned_addr learned my addr 172.21.15.103:0/1294209603 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:47.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.805+0000 7f40b9d9b700 1 --1- 172.21.15.103:0/1294209603 >> v1:172.21.15.103:6789/0 conn(0x7f40bc0ac950 0x7f40bc146c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49640/0 (socket says 172.21.15.103:49640) 2020-04-22T14:17:47.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.805+0000 7f40ba59c700 1 --2- 172.21.15.103:0/1294209603 >> v2:172.21.15.86:3300/0 conn(0x7f40bc0b9140 0x7f40bc12b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:47.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.805+0000 7f40bad9d700 1 -- 172.21.15.103:0/1294209603 >> v2:172.21.15.86:3300/0 conn(0x7f40bc0b9140 msgr2=0x7f40bc12b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:47.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.805+0000 7f40bad9d700 1 --2- 172.21.15.103:0/1294209603 >> v2:172.21.15.86:3300/0 conn(0x7f40bc0b9140 0x7f40bc12b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:47.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.806+0000 7f40bad9d700 1 -- 172.21.15.103:0/1294209603 >> v1:172.21.15.103:6789/0 conn(0x7f40bc0ac950 legacy=0x7f40bc146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:47.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.806+0000 7f40bad9d700 1 -- 172.21.15.103:0/1294209603 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40bc0b9520 con 0x7f40bc12b670 2020-04-22T14:17:47.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.806+0000 7f40bad9d700 1 --2- 172.21.15.103:0/1294209603 >> v2:172.21.15.103:3300/0 conn(0x7f40bc12b670 0x7f40bc143090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f40ac0010d0 tx=0x7f40b4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:47.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.806+0000 7f40bad9d700 1 --2- 172.21.15.103:0/1294209603 >> v2:172.21.15.103:3300/0 conn(0x7f40bc12b670 0x7f40bc143090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f40ac0010d0 tx=0x7f40b4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:47.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.806+0000 7f40bad9d700 1 --2- 172.21.15.103:0/1294209603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40bc12b670 0x7f40bc143090 secure :-1 s=READY pgs=1890 cs=0 l=1 rx=0x7f40ac0010d0 tx=0x7f40b4007dc0).ready entity=mon.1 client_cookie=7fee849188cad3ad server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:47.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.806+0000 7f40bad9d700 1 --2- 172.21.15.103:0/1294209603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40bc12b670 0x7f40bc143090 secure :-1 s=THROTTLE_DONE pgs=1890 cs=0 l=1 rx=0x7f40ac0010d0 tx=0x7f40b4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:47.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.806+0000 7f40b959a700 1 -- 172.21.15.103:0/1294209603 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40b4010e20 con 0x7f40bc12b670 2020-04-22T14:17:47.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.806+0000 7f40bad9d700 1 --2- 172.21.15.103:0/1294209603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40bc12b670 0x7f40bc143090 secure :-1 s=THROTTLE_DONE pgs=1890 cs=0 l=1 rx=0x7f40ac0010d0 tx=0x7f40b4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:47.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.806+0000 7f40b959a700 1 -- 172.21.15.103:0/1294209603 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b40110d0 con 0x7f40bc12b670 2020-04-22T14:17:47.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.806+0000 7f40bad9d700 1 --2- 172.21.15.103:0/1294209603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40bc12b670 0x7f40bc143090 secure :-1 s=THROTTLE_DONE pgs=1890 cs=0 l=1 rx=0x7f40ac0010d0 tx=0x7f40b4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:47.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.806+0000 7f40b959a700 1 -- 172.21.15.103:0/1294209603 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40b40114b0 con 0x7f40bc12b670 2020-04-22T14:17:47.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.806+0000 7f40c0f4e700 1 -- 172.21.15.103:0/1294209603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40bc12b670 msgr2=0x7f40bc143090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:47.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.806+0000 7f40c0f4e700 1 --2- 172.21.15.103:0/1294209603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40bc12b670 0x7f40bc143090 secure :-1 s=READY pgs=1890 cs=0 l=1 rx=0x7f40ac0010d0 tx=0x7f40b4007dc0).stop 2020-04-22T14:17:47.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.806+0000 7f40c0f4e700 1 -- 172.21.15.103:0/1294209603 shutdown_connections 2020-04-22T14:17:47.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.806+0000 7f40c0f4e700 1 --2- 172.21.15.103:0/1294209603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40bc12b670 0x7f40bc143090 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:47.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.806+0000 7f40c0f4e700 1 --2- 172.21.15.103:0/1294209603 >> v2:172.21.15.86:3300/0 conn(0x7f40bc0b9140 0x7f40bc12b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:47.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.806+0000 7f40c0f4e700 1 -- 172.21.15.103:0/1294209603 >> 172.21.15.103:0/1294209603 conn(0x7f40bc05b7b0 msgr2=0x7f40bc0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:47.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.806+0000 7f40c0f4e700 1 -- 172.21.15.103:0/1294209603 shutdown_connections 2020-04-22T14:17:47.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.806+0000 7f40c0f4e700 1 -- 172.21.15.103:0/1294209603 wait complete. 2020-04-22T14:17:47.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.807+0000 7f40c0f4e700 1 Processor -- start 2020-04-22T14:17:47.814 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.807+0000 7f40c0f4e700 1 -- start start 2020-04-22T14:17:47.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.808+0000 7f40c0f4e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f40bc0b9140 0x7f40bc127400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:47.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.808+0000 7f40c0f4e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f40bc12b670 0x7f40bc066810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:47.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.808+0000 7f40c0f4e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40bc154560 con 0x7f40bc0ac950 2020-04-22T14:17:47.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.808+0000 7f40c0f4e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40bc145ef0 con 0x7f40bc0b9140 2020-04-22T14:17:47.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.808+0000 7f40c0f4e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc154800 con 0x7f40bc12b670 2020-04-22T14:17:47.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.808+0000 7f40ba59c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f40bc0ac950 0x7f40bc061790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49646/0 (socket says 172.21.15.103:49646) 2020-04-22T14:17:47.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.808+0000 7f40ba59c700 1 -- 172.21.15.103:0/3187395165 learned_addr learned my addr 172.21.15.103:0/3187395165 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:17:47.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.808+0000 7f40ab7fe700 1 -- 172.21.15.103:0/3187395165 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3101877050 0 0) 0x7f40bc154560 con 0x7f40bc0ac950 2020-04-22T14:17:47.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.808+0000 7f40ab7fe700 1 -- 172.21.15.103:0/3187395165 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4098002fe0 con 0x7f40bc0ac950 2020-04-22T14:17:47.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.808+0000 7f40bad9d700 1 --2- 172.21.15.103:0/3187395165 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f40bc12b670 0x7f40bc066810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:47.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.808+0000 7f40b9d9b700 1 --2- 172.21.15.103:0/3187395165 >> v2:172.21.15.86:3300/0 conn(0x7f40bc0b9140 0x7f40bc127400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:47.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.809+0000 7f40ab7fe700 1 -- 172.21.15.103:0/3187395165 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1569237338 0 0) 0x7f4098002fe0 con 0x7f40bc0ac950 2020-04-22T14:17:47.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.809+0000 7f40ab7fe700 1 -- 172.21.15.103:0/3187395165 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f40bc154560 con 0x7f40bc0ac950 2020-04-22T14:17:47.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.809+0000 7f40ab7fe700 1 -- 172.21.15.103:0/3187395165 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f40b00015a0 con 0x7f40bc0ac950 2020-04-22T14:17:47.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.809+0000 7f40ab7fe700 1 -- 172.21.15.103:0/3187395165 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f40bc12b670 msgr2=0x7f40bc066810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:47.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.809+0000 7f40ab7fe700 1 --2- 172.21.15.103:0/3187395165 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f40bc12b670 0x7f40bc066810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:47.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.809+0000 7f40ab7fe700 1 -- 172.21.15.103:0/3187395165 >> v2:172.21.15.86:3300/0 conn(0x7f40bc0b9140 msgr2=0x7f40bc127400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:47.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.809+0000 7f40ab7fe700 1 --2- 172.21.15.103:0/3187395165 >> v2:172.21.15.86:3300/0 conn(0x7f40bc0b9140 0x7f40bc127400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:47.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.809+0000 7f40ab7fe700 1 -- 172.21.15.103:0/3187395165 >> v1:172.21.15.103:6789/0 conn(0x7f40bc0ac950 legacy=0x7f40bc061790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:47.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.809+0000 7f40ab7fe700 1 --2- 172.21.15.103:0/3187395165 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f40980049b0 0x7f4098004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:47.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.809+0000 7f40ab7fe700 1 --2- 172.21.15.103:0/3187395165 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f40bc12b670 0x7f4098003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:47.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.809+0000 7f40ab7fe700 1 --2- 172.21.15.103:0/3187395165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4098003d80 0x7f4098004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:47.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.809+0000 7f40ab7fe700 1 -- 172.21.15.103:0/3187395165 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc145ef0 con 0x7f40980049b0 2020-04-22T14:17:47.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.809+0000 7f40ab7fe700 1 -- 172.21.15.103:0/3187395165 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc154800 con 0x7f4098003d80 2020-04-22T14:17:47.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.809+0000 7f40ab7fe700 1 -- 172.21.15.103:0/3187395165 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4098005340 con 0x7f40bc12b670 2020-04-22T14:17:47.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.809+0000 7f40bad9d700 1 --2- 172.21.15.103:0/3187395165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4098003d80 0x7f4098004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:47.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.809+0000 7f40ba59c700 1 --2- 172.21.15.103:0/3187395165 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f40980049b0 0x7f4098004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:47.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.809+0000 7f40b9d9b700 1 --2- 172.21.15.103:0/3187395165 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f40bc12b670 0x7f4098003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:47.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.809+0000 7f40bad9d700 1 -- 172.21.15.103:0/3187395165 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f40bc12b670 msgr2=0x7f4098003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:47.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.809+0000 7f40bad9d700 1 --2- 172.21.15.103:0/3187395165 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f40bc12b670 0x7f4098003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:47.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.809+0000 7f40bad9d700 1 -- 172.21.15.103:0/3187395165 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f40980049b0 msgr2=0x7f4098004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:47.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.809+0000 7f40bad9d700 1 --2- 172.21.15.103:0/3187395165 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f40980049b0 0x7f4098004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:47.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.809+0000 7f40bad9d700 1 -- 172.21.15.103:0/3187395165 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40bc064100 con 0x7f4098003d80 2020-04-22T14:17:47.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.809+0000 7f40c0f4e700 1 -- 172.21.15.103:0/3187395165 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40bc061ea0 con 0x7f4098003d80 2020-04-22T14:17:47.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.809+0000 7f40bad9d700 1 --2- 172.21.15.103:0/3187395165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4098003d80 0x7f4098004200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f40ac0010d0 tx=0x7f40b4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:47.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.809+0000 7f40c0f4e700 1 -- 172.21.15.103:0/3187395165 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40bc066a50 con 0x7f4098003d80 2020-04-22T14:17:47.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.809+0000 7f40bad9d700 1 --2- 172.21.15.103:0/3187395165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4098003d80 0x7f4098004200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f40ac0010d0 tx=0x7f40b4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:47.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.809+0000 7f40bad9d700 1 --2- 172.21.15.103:0/3187395165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4098003d80 0x7f4098004200 secure :-1 s=READY pgs=1892 cs=0 l=1 rx=0x7f40ac0010d0 tx=0x7f40b4007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:47.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.809+0000 7f40bad9d700 1 --2- 172.21.15.103:0/3187395165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4098003d80 0x7f4098004200 secure :-1 s=THROTTLE_DONE pgs=1892 cs=0 l=1 rx=0x7f40ac0010d0 tx=0x7f40b4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:47.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.809+0000 7f40ab7fe700 1 -- 172.21.15.103:0/3187395165 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40b4008a90 con 0x7f4098003d80 2020-04-22T14:17:47.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.809+0000 7f40bad9d700 1 --2- 172.21.15.103:0/3187395165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4098003d80 0x7f4098004200 secure :-1 s=THROTTLE_DONE pgs=1892 cs=0 l=1 rx=0x7f40ac0010d0 tx=0x7f40b4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:47.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.809+0000 7f40ab7fe700 1 -- 172.21.15.103:0/3187395165 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b4005c30 con 0x7f4098003d80 2020-04-22T14:17:47.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.809+0000 7f40bad9d700 1 --2- 172.21.15.103:0/3187395165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4098003d80 0x7f4098004200 secure :-1 s=THROTTLE_DONE pgs=1892 cs=0 l=1 rx=0x7f40ac0010d0 tx=0x7f40b4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:47.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.809+0000 7f40ab7fe700 1 -- 172.21.15.103:0/3187395165 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40b4005da0 con 0x7f4098003d80 2020-04-22T14:17:47.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.810+0000 7f40bad9d700 1 --2- 172.21.15.103:0/3187395165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4098003d80 0x7f4098004200 secure :-1 s=THROTTLE_DONE pgs=1892 cs=0 l=1 rx=0x7f40ac0010d0 tx=0x7f40b4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:47.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.811+0000 7f40c0f4e700 1 -- 172.21.15.103:0/3187395165 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40bc056c90 con 0x7f4098003d80 2020-04-22T14:17:47.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.811+0000 7f40ab7fe700 1 -- 172.21.15.103:0/3187395165 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f40b4002640 con 0x7f4098003d80 2020-04-22T14:17:47.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.811+0000 7f40bad9d700 1 --2- 172.21.15.103:0/3187395165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4098003d80 0x7f4098004200 secure :-1 s=THROTTLE_DONE pgs=1892 cs=0 l=1 rx=0x7f40ac0010d0 tx=0x7f40b4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:47.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.811+0000 7f40ab7fe700 1 --2- 172.21.15.103:0/3187395165 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4098055ab0 0x7f4098057f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:47.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.811+0000 7f40ab7fe700 1 -- 172.21.15.103:0/3187395165 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f40b4061a30 con 0x7f4098003d80 2020-04-22T14:17:47.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.811+0000 7f40ba59c700 1 --2- 172.21.15.103:0/3187395165 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4098055ab0 0x7f4098057f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:47.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.811+0000 7f40ba59c700 1 --2- 172.21.15.103:0/3187395165 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4098055ab0 0x7f4098057f70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f40b0001330 tx=0x7f40b000c3c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:47.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.811+0000 7f40ba59c700 1 --2- 172.21.15.103:0/3187395165 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4098055ab0 0x7f4098057f70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f40b0001330 tx=0x7f40b000c3c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:47.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.811+0000 7f40ba59c700 1 --2- 172.21.15.103:0/3187395165 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4098055ab0 0x7f4098057f70 secure :-1 s=READY pgs=691 cs=0 l=1 rx=0x7f40b0001330 tx=0x7f40b000c3c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:47.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.815+0000 7f40bad9d700 1 --2- 172.21.15.103:0/3187395165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4098003d80 0x7f4098004200 secure :-1 s=THROTTLE_DONE pgs=1892 cs=0 l=1 rx=0x7f40ac0010d0 tx=0x7f40b4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:47.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:47.815+0000 7f40ab7fe700 1 -- 172.21.15.103:0/3187395165 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f40b403ced0 con 0x7f4098003d80 2020-04-22T14:17:48.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.004+0000 7f40c0f4e700 1 -- 172.21.15.103:0/3187395165 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f40bc06a960 con 0x7f4098003d80 2020-04-22T14:17:48.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.010+0000 7f40bad9d700 1 --2- 172.21.15.103:0/3187395165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4098003d80 0x7f4098004200 secure :-1 s=THROTTLE_DONE pgs=1892 cs=0 l=1 rx=0x7f40ac0010d0 tx=0x7f40b4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.010+0000 7f40ab7fe700 1 -- 172.21.15.103:0/3187395165 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 23 and data pool 24 v98) v1 ==== 189+0+0 (secure 0 0 0) 0x7f40b40404f0 con 0x7f4098003d80 2020-04-22T14:17:48.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.018+0000 7f40c0f4e700 1 -- 172.21.15.103:0/3187395165 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4098055ab0 msgr2=0x7f4098057f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:48.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.018+0000 7f40c0f4e700 1 --2- 172.21.15.103:0/3187395165 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4098055ab0 0x7f4098057f70 secure :-1 s=READY pgs=691 cs=0 l=1 rx=0x7f40b0001330 tx=0x7f40b000c3c0).stop 2020-04-22T14:17:48.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.018+0000 7f40c0f4e700 1 -- 172.21.15.103:0/3187395165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4098003d80 msgr2=0x7f4098004200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:48.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.018+0000 7f40c0f4e700 1 --2- 172.21.15.103:0/3187395165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4098003d80 0x7f4098004200 secure :-1 s=READY pgs=1892 cs=0 l=1 rx=0x7f40ac0010d0 tx=0x7f40b4007dc0).stop 2020-04-22T14:17:48.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.018+0000 7f40bad9d700 1 -- 172.21.15.103:0/3187395165 reap_dead start 2020-04-22T14:17:48.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.018+0000 7f40bad9d700 1 -- 172.21.15.103:0/3187395165 reap_dead start 2020-04-22T14:17:48.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.020+0000 7f40c0f4e700 1 -- 172.21.15.103:0/3187395165 shutdown_connections 2020-04-22T14:17:48.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.020+0000 7f40c0f4e700 1 -- 172.21.15.103:0/3187395165 >> 172.21.15.103:0/3187395165 conn(0x7f40bc05b7b0 msgr2=0x7f40bc146090 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:48.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.026+0000 7f40c0f4e700 1 -- 172.21.15.103:0/3187395165 shutdown_connections 2020-04-22T14:17:48.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.026+0000 7f40c0f4e700 1 -- 172.21.15.103:0/3187395165 wait complete. 2020-04-22T14:17:48.028 INFO:teuthology.orchestra.run.smithi103.stderr:new fs with metadata pool 23 and data pool 24 2020-04-22T14:17:48.038 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:48.051 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:17:48.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.194+0000 7f0f37acc700 1 Processor -- start 2020-04-22T14:17:48.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.194+0000 7f0f37acc700 1 -- start start 2020-04-22T14:17:48.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.195+0000 7f0f37acc700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f300b6040 0x7f0f300ac740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:48.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.195+0000 7f0f37acc700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f30064ec0 con 0x7f0f30067170 2020-04-22T14:17:48.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.195+0000 7f0f37acc700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f30146870 con 0x7f0f301426d0 2020-04-22T14:17:48.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.195+0000 7f0f37acc700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f30065af0 con 0x7f0f300b6040 2020-04-22T14:17:48.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.195+0000 7f0f36069700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f0f301426d0 0x7f0f30142b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49672/0 (socket says 172.21.15.103:49672) 2020-04-22T14:17:48.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.195+0000 7f0f36069700 1 -- 172.21.15.103:0/2775450491 learned_addr learned my addr 172.21.15.103:0/2775450491 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:17:48.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.195+0000 7f0f35067700 1 --2- 172.21.15.103:0/2775450491 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f300b6040 0x7f0f300ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:48.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.195+0000 7f0f34866700 1 -- 172.21.15.103:0/2775450491 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1440106778 0 0) 0x7f0f30146870 con 0x7f0f301426d0 2020-04-22T14:17:48.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.195+0000 7f0f34866700 1 -- 172.21.15.103:0/2775450491 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f18003230 con 0x7f0f301426d0 2020-04-22T14:17:48.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.195+0000 7f0f34866700 1 -- 172.21.15.103:0/2775450491 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1882309622 0 0) 0x7f0f30064ec0 con 0x7f0f30067170 2020-04-22T14:17:48.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.195+0000 7f0f34866700 1 -- 172.21.15.103:0/2775450491 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f30146870 con 0x7f0f30067170 2020-04-22T14:17:48.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.195+0000 7f0f34866700 1 -- 172.21.15.103:0/2775450491 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1641663897 0 0) 0x7f0f18003230 con 0x7f0f301426d0 2020-04-22T14:17:48.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.195+0000 7f0f35067700 1 -- 172.21.15.103:0/2775450491 >> v1:172.21.15.103:6789/0 conn(0x7f0f301426d0 legacy=0x7f0f30142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:48.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.195+0000 7f0f35067700 1 -- 172.21.15.103:0/2775450491 >> v1:172.21.15.86:6789/0 conn(0x7f0f30067170 legacy=0x7f0f3013c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:48.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.195+0000 7f0f35067700 1 -- 172.21.15.103:0/2775450491 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f30067550 con 0x7f0f300b6040 2020-04-22T14:17:48.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.195+0000 7f0f35067700 1 --2- 172.21.15.103:0/2775450491 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f300b6040 0x7f0f300ac740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0f2c0010d0 tx=0x7f0f240088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.196+0000 7f0f35067700 1 --2- 172.21.15.103:0/2775450491 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f300b6040 0x7f0f300ac740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0f2c0010d0 tx=0x7f0f240088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.196+0000 7f0f35067700 1 --2- 172.21.15.103:0/2775450491 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f300b6040 0x7f0f300ac740 secure :-1 s=READY pgs=176 cs=0 l=1 rx=0x7f0f2c0010d0 tx=0x7f0f240088e0).ready entity=mon.2 client_cookie=9e800ddf581fcf3b server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:48.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.196+0000 7f0f35067700 1 --2- 172.21.15.103:0/2775450491 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f300b6040 0x7f0f300ac740 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7f0f2c0010d0 tx=0x7f0f240088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.196+0000 7f0f34866700 1 -- 172.21.15.103:0/2775450491 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f2c0016d0 con 0x7f0f300b6040 2020-04-22T14:17:48.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.196+0000 7f0f35067700 1 --2- 172.21.15.103:0/2775450491 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f300b6040 0x7f0f300ac740 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7f0f2c0010d0 tx=0x7f0f240088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.196+0000 7f0f35067700 1 --2- 172.21.15.103:0/2775450491 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f300b6040 0x7f0f300ac740 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7f0f2c0010d0 tx=0x7f0f240088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.196+0000 7f0f34866700 1 -- 172.21.15.103:0/2775450491 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f24011210 con 0x7f0f300b6040 2020-04-22T14:17:48.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.196+0000 7f0f34866700 1 -- 172.21.15.103:0/2775450491 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f240115b0 con 0x7f0f300b6040 2020-04-22T14:17:48.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.196+0000 7f0f37acc700 1 -- 172.21.15.103:0/2775450491 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f300b6040 msgr2=0x7f0f300ac740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:48.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.196+0000 7f0f37acc700 1 --2- 172.21.15.103:0/2775450491 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f300b6040 0x7f0f300ac740 secure :-1 s=READY pgs=176 cs=0 l=1 rx=0x7f0f2c0010d0 tx=0x7f0f240088e0).stop 2020-04-22T14:17:48.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.196+0000 7f0f37acc700 1 -- 172.21.15.103:0/2775450491 shutdown_connections 2020-04-22T14:17:48.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.196+0000 7f0f37acc700 1 --2- 172.21.15.103:0/2775450491 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f300b6040 0x7f0f300ac740 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:48.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.196+0000 7f0f37acc700 1 -- 172.21.15.103:0/2775450491 >> 172.21.15.103:0/2775450491 conn(0x7f0f300b9160 msgr2=0x7f0f3005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:48.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.196+0000 7f0f37acc700 1 -- 172.21.15.103:0/2775450491 shutdown_connections 2020-04-22T14:17:48.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.196+0000 7f0f37acc700 1 -- 172.21.15.103:0/2775450491 wait complete. 2020-04-22T14:17:48.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.197+0000 7f0f37acc700 1 Processor -- start 2020-04-22T14:17:48.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.197+0000 7f0f37acc700 1 -- start start 2020-04-22T14:17:48.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.198+0000 7f0f37acc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0f300b6040 0x7f0f300b2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:48.206 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.198+0000 7f0f37acc700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f301426d0 0x7f0f300b1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:48.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.198+0000 7f0f37acc700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f30145e10 con 0x7f0f30067170 2020-04-22T14:17:48.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.198+0000 7f0f37acc700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f300b1a20 con 0x7f0f300b6040 2020-04-22T14:17:48.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.198+0000 7f0f37acc700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f300b1cc0 con 0x7f0f301426d0 2020-04-22T14:17:48.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.198+0000 7f0f35067700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0f300b6040 0x7f0f300b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:48.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.198+0000 7f0f35067700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0f300b6040 0x7f0f300b2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57486/0 (socket says 172.21.15.103:57486) 2020-04-22T14:17:48.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.198+0000 7f0f35067700 1 -- 172.21.15.103:0/1954089133 learned_addr learned my addr 172.21.15.103:0/1954089133 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:48.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.198+0000 7f0f36069700 1 --2- 172.21.15.103:0/1954089133 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f301426d0 0x7f0f300b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:48.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.198+0000 7f0f35067700 1 -- 172.21.15.103:0/1954089133 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f301426d0 msgr2=0x7f0f300b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:48.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.198+0000 7f0f35067700 1 --2- 172.21.15.103:0/1954089133 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f301426d0 0x7f0f300b1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:48.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.198+0000 7f0f35067700 1 -- 172.21.15.103:0/1954089133 >> v1:172.21.15.103:6789/0 conn(0x7f0f30067170 legacy=0x7f0f301444b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:48.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.198+0000 7f0f22ffd700 1 -- 172.21.15.103:0/1954089133 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1407855117 0 0) 0x7f0f30145e10 con 0x7f0f30067170 2020-04-22T14:17:48.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.198+0000 7f0f35067700 1 -- 172.21.15.103:0/1954089133 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f300b1f60 con 0x7f0f300b6040 2020-04-22T14:17:48.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.198+0000 7f0f36069700 1 --2- 172.21.15.103:0/1954089133 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f301426d0 0x7f0f300b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:17:48.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.198+0000 7f0f35067700 1 --2- 172.21.15.103:0/1954089133 >> v2:172.21.15.103:3300/0 conn(0x7f0f300b6040 0x7f0f300b2870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0f2c0010d0 tx=0x7f0f30146770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.198+0000 7f0f35067700 1 --2- 172.21.15.103:0/1954089133 >> v2:172.21.15.103:3300/0 conn(0x7f0f300b6040 0x7f0f300b2870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0f2c0010d0 tx=0x7f0f30146770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.198+0000 7f0f35067700 1 --2- 172.21.15.103:0/1954089133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f300b6040 0x7f0f300b2870 secure :-1 s=READY pgs=1895 cs=0 l=1 rx=0x7f0f2c0010d0 tx=0x7f0f30146770).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:48.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.199+0000 7f0f35067700 1 --2- 172.21.15.103:0/1954089133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f300b6040 0x7f0f300b2870 secure :-1 s=THROTTLE_DONE pgs=1895 cs=0 l=1 rx=0x7f0f2c0010d0 tx=0x7f0f30146770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.199+0000 7f0f22ffd700 1 -- 172.21.15.103:0/1954089133 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f24011c30 con 0x7f0f300b6040 2020-04-22T14:17:48.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.199+0000 7f0f35067700 1 --2- 172.21.15.103:0/1954089133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f300b6040 0x7f0f300b2870 secure :-1 s=THROTTLE_DONE pgs=1895 cs=0 l=1 rx=0x7f0f2c0010d0 tx=0x7f0f30146770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.199+0000 7f0f35067700 1 --2- 172.21.15.103:0/1954089133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f300b6040 0x7f0f300b2870 secure :-1 s=THROTTLE_DONE pgs=1895 cs=0 l=1 rx=0x7f0f2c0010d0 tx=0x7f0f30146770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.199+0000 7f0f22ffd700 1 -- 172.21.15.103:0/1954089133 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f24011d90 con 0x7f0f300b6040 2020-04-22T14:17:48.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.199+0000 7f0f37acc700 1 -- 172.21.15.103:0/1954089133 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f30143c20 con 0x7f0f300b6040 2020-04-22T14:17:48.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.199+0000 7f0f22ffd700 1 -- 172.21.15.103:0/1954089133 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f24007360 con 0x7f0f300b6040 2020-04-22T14:17:48.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.199+0000 7f0f37acc700 1 -- 172.21.15.103:0/1954089133 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f30144d80 con 0x7f0f300b6040 2020-04-22T14:17:48.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.199+0000 7f0f35067700 1 --2- 172.21.15.103:0/1954089133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f300b6040 0x7f0f300b2870 secure :-1 s=THROTTLE_DONE pgs=1895 cs=0 l=1 rx=0x7f0f2c0010d0 tx=0x7f0f30146770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.200+0000 7f0f22ffd700 1 -- 172.21.15.103:0/1954089133 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f0f240056c0 con 0x7f0f300b6040 2020-04-22T14:17:48.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.200+0000 7f0f35067700 1 --2- 172.21.15.103:0/1954089133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f300b6040 0x7f0f300b2870 secure :-1 s=THROTTLE_DONE pgs=1895 cs=0 l=1 rx=0x7f0f2c0010d0 tx=0x7f0f30146770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.200+0000 7f0f37acc700 1 -- 172.21.15.103:0/1954089133 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f30056c90 con 0x7f0f300b6040 2020-04-22T14:17:48.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.200+0000 7f0f22ffd700 1 --2- 172.21.15.103:0/1954089133 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0f1004d7c0 0x7f0f1004fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:48.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.200+0000 7f0f22ffd700 1 -- 172.21.15.103:0/1954089133 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0f24061c70 con 0x7f0f300b6040 2020-04-22T14:17:48.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.200+0000 7f0f35868700 1 --2- 172.21.15.103:0/1954089133 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0f1004d7c0 0x7f0f1004fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:48.213 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.200+0000 7f0f35868700 1 --2- 172.21.15.103:0/1954089133 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0f1004d7c0 0x7f0f1004fc80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0f28002610 tx=0x7f0f28002ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.214 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.200+0000 7f0f35868700 1 --2- 172.21.15.103:0/1954089133 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0f1004d7c0 0x7f0f1004fc80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0f28002610 tx=0x7f0f28002ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.214 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.200+0000 7f0f35868700 1 --2- 172.21.15.103:0/1954089133 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0f1004d7c0 0x7f0f1004fc80 secure :-1 s=READY pgs=692 cs=0 l=1 rx=0x7f0f28002610 tx=0x7f0f28002ad0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:48.214 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.204+0000 7f0f35067700 1 --2- 172.21.15.103:0/1954089133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f300b6040 0x7f0f300b2870 secure :-1 s=THROTTLE_DONE pgs=1895 cs=0 l=1 rx=0x7f0f2c0010d0 tx=0x7f0f30146770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.214 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.204+0000 7f0f22ffd700 1 -- 172.21.15.103:0/1954089133 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f0f2403d050 con 0x7f0f300b6040 2020-04-22T14:17:48.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.346+0000 7f0f37acc700 1 -- 172.21.15.103:0/1954089133 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f300b40c0 con 0x7f0f300b6040 2020-04-22T14:17:48.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.347+0000 7f0f35067700 1 --2- 172.21.15.103:0/1954089133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f300b6040 0x7f0f300b2870 secure :-1 s=THROTTLE_DONE pgs=1895 cs=0 l=1 rx=0x7f0f2c0010d0 tx=0x7f0f30146770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.347+0000 7f0f22ffd700 1 -- 172.21.15.103:0/1954089133 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) v1 ==== 74+0+16116 (secure 0 0 0) 0x7f0f24040670 con 0x7f0f300b6040 2020-04-22T14:17:48.350 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:17:48.351 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":134,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:17:48.006243+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:17:45.940111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2020-04-22T14:17:46.960856+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:17:48.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.349+0000 7f0f37acc700 1 -- 172.21.15.103:0/1954089133 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0f1004d7c0 msgr2=0x7f0f1004fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:48.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.349+0000 7f0f37acc700 1 --2- 172.21.15.103:0/1954089133 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0f1004d7c0 0x7f0f1004fc80 secure :-1 s=READY pgs=692 cs=0 l=1 rx=0x7f0f28002610 tx=0x7f0f28002ad0).stop 2020-04-22T14:17:48.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.349+0000 7f0f37acc700 1 -- 172.21.15.103:0/1954089133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f300b6040 msgr2=0x7f0f300b2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:48.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.349+0000 7f0f37acc700 1 --2- 172.21.15.103:0/1954089133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f300b6040 0x7f0f300b2870 secure :-1 s=READY pgs=1895 cs=0 l=1 rx=0x7f0f2c0010d0 tx=0x7f0f30146770).stop 2020-04-22T14:17:48.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.349+0000 7f0f37acc700 1 -- 172.21.15.103:0/1954089133 shutdown_connections 2020-04-22T14:17:48.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.349+0000 7f0f37acc700 1 --2- 172.21.15.103:0/1954089133 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0f1004d7c0 0x7f0f1004fc80 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:48.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.349+0000 7f0f37acc700 1 --2- 172.21.15.103:0/1954089133 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f301426d0 0x7f0f300b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:48.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.349+0000 7f0f37acc700 1 --2- 172.21.15.103:0/1954089133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f300b6040 0x7f0f300b2870 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:48.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.349+0000 7f0f37acc700 1 -- 172.21.15.103:0/1954089133 >> 172.21.15.103:0/1954089133 conn(0x7f0f300b9160 msgr2=0x7f0f300b7650 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:48.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.349+0000 7f0f37acc700 1 -- 172.21.15.103:0/1954089133 shutdown_connections 2020-04-22T14:17:48.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.349+0000 7f0f37acc700 1 -- 172.21.15.103:0/1954089133 wait complete. 2020-04-22T14:17:48.377 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:48.391 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:17:48.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.535+0000 7f3276b86700 1 Processor -- start 2020-04-22T14:17:48.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.536+0000 7f3276b86700 1 -- start start 2020-04-22T14:17:48.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.536+0000 7f3276b86700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3270067170 0x7f32700b6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:48.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.536+0000 7f3276b86700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f32701426d0 0x7f3270142b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:48.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.536+0000 7f3276b86700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3270064ec0 con 0x7f32700ac740 2020-04-22T14:17:48.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.536+0000 7f3276b86700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3270065af0 con 0x7f32701426d0 2020-04-22T14:17:48.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.536+0000 7f3276b86700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3270146870 con 0x7f3270067170 2020-04-22T14:17:48.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.536+0000 7f3274922700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3270067170 0x7f32700b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:48.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.536+0000 7f326ffff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f32700ac740 0x7f327013c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49684/0 (socket says 172.21.15.103:49684) 2020-04-22T14:17:48.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.536+0000 7f326ffff700 1 -- 172.21.15.103:0/191186459 learned_addr learned my addr 172.21.15.103:0/191186459 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:17:48.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.537+0000 7f3275123700 1 --2- 172.21.15.103:0/191186459 >> v2:172.21.15.86:3300/0 conn(0x7f32701426d0 0x7f3270142b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:48.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.537+0000 7f3274922700 1 -- 172.21.15.103:0/191186459 >> v2:172.21.15.86:3300/0 conn(0x7f32701426d0 msgr2=0x7f3270142b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:48.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.537+0000 7f3274922700 1 --2- 172.21.15.103:0/191186459 >> v2:172.21.15.86:3300/0 conn(0x7f32701426d0 0x7f3270142b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:48.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.537+0000 7f3274922700 1 -- 172.21.15.103:0/191186459 >> v1:172.21.15.103:6789/0 conn(0x7f32700ac740 legacy=0x7f327013c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:48.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.537+0000 7f326f7fe700 1 -- 172.21.15.103:0/191186459 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 312331165 0 0) 0x7f3270064ec0 con 0x7f32700ac740 2020-04-22T14:17:48.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.537+0000 7f3274922700 1 -- 172.21.15.103:0/191186459 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3270067550 con 0x7f3270067170 2020-04-22T14:17:48.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.537+0000 7f3274922700 1 --2- 172.21.15.103:0/191186459 >> v2:172.21.15.103:3300/0 conn(0x7f3270067170 0x7f32700b6040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3260002f30 tx=0x7f3260007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.537+0000 7f3274922700 1 --2- 172.21.15.103:0/191186459 >> v2:172.21.15.103:3300/0 conn(0x7f3270067170 0x7f32700b6040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3260002f30 tx=0x7f3260007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.537+0000 7f3274922700 1 --2- 172.21.15.103:0/191186459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3270067170 0x7f32700b6040 secure :-1 s=READY pgs=1897 cs=0 l=1 rx=0x7f3260002f30 tx=0x7f3260007a40).ready entity=mon.1 client_cookie=cad9f0b3a92ecef3 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:48.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.537+0000 7f3274922700 1 --2- 172.21.15.103:0/191186459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3270067170 0x7f32700b6040 secure :-1 s=THROTTLE_DONE pgs=1897 cs=0 l=1 rx=0x7f3260002f30 tx=0x7f3260007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.537+0000 7f326f7fe700 1 -- 172.21.15.103:0/191186459 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3260011470 con 0x7f3270067170 2020-04-22T14:17:48.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.537+0000 7f3274922700 1 --2- 172.21.15.103:0/191186459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3270067170 0x7f32700b6040 secure :-1 s=THROTTLE_DONE pgs=1897 cs=0 l=1 rx=0x7f3260002f30 tx=0x7f3260007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.537+0000 7f326f7fe700 1 -- 172.21.15.103:0/191186459 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32600115d0 con 0x7f3270067170 2020-04-22T14:17:48.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.537+0000 7f3274922700 1 --2- 172.21.15.103:0/191186459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3270067170 0x7f32700b6040 secure :-1 s=THROTTLE_DONE pgs=1897 cs=0 l=1 rx=0x7f3260002f30 tx=0x7f3260007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.537+0000 7f326f7fe700 1 -- 172.21.15.103:0/191186459 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32600119b0 con 0x7f3270067170 2020-04-22T14:17:48.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.537+0000 7f3276b86700 1 -- 172.21.15.103:0/191186459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3270067170 msgr2=0x7f32700b6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:48.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.537+0000 7f3276b86700 1 --2- 172.21.15.103:0/191186459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3270067170 0x7f32700b6040 secure :-1 s=READY pgs=1897 cs=0 l=1 rx=0x7f3260002f30 tx=0x7f3260007a40).stop 2020-04-22T14:17:48.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.538+0000 7f3276b86700 1 -- 172.21.15.103:0/191186459 shutdown_connections 2020-04-22T14:17:48.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.538+0000 7f3276b86700 1 --2- 172.21.15.103:0/191186459 >> v2:172.21.15.86:3300/0 conn(0x7f32701426d0 0x7f3270142b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:48.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.538+0000 7f3276b86700 1 --2- 172.21.15.103:0/191186459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3270067170 0x7f32700b6040 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:48.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.538+0000 7f3276b86700 1 -- 172.21.15.103:0/191186459 >> 172.21.15.103:0/191186459 conn(0x7f32700b9160 msgr2=0x7f327005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:48.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.538+0000 7f3276b86700 1 -- 172.21.15.103:0/191186459 shutdown_connections 2020-04-22T14:17:48.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.538+0000 7f3276b86700 1 -- 172.21.15.103:0/191186459 wait complete. 2020-04-22T14:17:48.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.538+0000 7f3276b86700 1 Processor -- start 2020-04-22T14:17:48.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.539+0000 7f3276b86700 1 -- start start 2020-04-22T14:17:48.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.539+0000 7f3276b86700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3270067170 0x7f3270145a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:48.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.539+0000 7f3276b86700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3270150370 con 0x7f32700ac740 2020-04-22T14:17:48.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.539+0000 7f3276b86700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3270142c60 con 0x7f32701426d0 2020-04-22T14:17:48.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.539+0000 7f3276b86700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32701448a0 con 0x7f3270067170 2020-04-22T14:17:48.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.539+0000 7f3275123700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f32701426d0 0x7f327014ec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49692/0 (socket says 172.21.15.103:49692) 2020-04-22T14:17:48.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.539+0000 7f3275123700 1 -- 172.21.15.103:0/2997821224 learned_addr learned my addr 172.21.15.103:0/2997821224 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:17:48.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.540+0000 7f326dffb700 1 -- 172.21.15.103:0/2997821224 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4204911207 0 0) 0x7f3270142c60 con 0x7f32701426d0 2020-04-22T14:17:48.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.540+0000 7f326dffb700 1 -- 172.21.15.103:0/2997821224 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3250002fe0 con 0x7f32701426d0 2020-04-22T14:17:48.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.540+0000 7f3274922700 1 --2- 172.21.15.103:0/2997821224 >> v2:172.21.15.86:3300/0 conn(0x7f3270067170 0x7f3270145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:48.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.540+0000 7f326dffb700 1 -- 172.21.15.103:0/2997821224 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 485580752 0 0) 0x7f3250002fe0 con 0x7f32701426d0 2020-04-22T14:17:48.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.540+0000 7f326dffb700 1 -- 172.21.15.103:0/2997821224 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3270142c60 con 0x7f32701426d0 2020-04-22T14:17:48.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.540+0000 7f326dffb700 1 -- 172.21.15.103:0/2997821224 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f3268002a90 con 0x7f32701426d0 2020-04-22T14:17:48.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.540+0000 7f326dffb700 1 -- 172.21.15.103:0/2997821224 >> v2:172.21.15.86:3300/0 conn(0x7f3270067170 msgr2=0x7f3270145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:48.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.540+0000 7f326dffb700 1 --2- 172.21.15.103:0/2997821224 >> v2:172.21.15.86:3300/0 conn(0x7f3270067170 0x7f3270145a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:48.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.540+0000 7f326dffb700 1 -- 172.21.15.103:0/2997821224 >> v1:172.21.15.103:6789/0 conn(0x7f32701426d0 legacy=0x7f327014ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:48.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.540+0000 7f326dffb700 1 -- 172.21.15.103:0/2997821224 >> v1:172.21.15.86:6789/0 conn(0x7f32700ac740 legacy=0x7f3270144190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:48.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.540+0000 7f326dffb700 1 --2- 172.21.15.103:0/2997821224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32500049b0 0x7f3250004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:48.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.540+0000 7f326dffb700 1 --2- 172.21.15.103:0/2997821224 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3250003920 0x7f3250003d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:48.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.540+0000 7f326dffb700 1 --2- 172.21.15.103:0/2997821224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32500041c0 0x7f325000b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:48.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.540+0000 7f326dffb700 1 -- 172.21.15.103:0/2997821224 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32701448a0 con 0x7f32500041c0 2020-04-22T14:17:48.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.540+0000 7f326dffb700 1 -- 172.21.15.103:0/2997821224 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3250004640 con 0x7f32500049b0 2020-04-22T14:17:48.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.540+0000 7f326dffb700 1 -- 172.21.15.103:0/2997821224 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f325000bbb0 con 0x7f3250003920 2020-04-22T14:17:48.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.540+0000 7f3274922700 1 --2- 172.21.15.103:0/2997821224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32500049b0 0x7f3250004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:48.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.540+0000 7f3275123700 1 --2- 172.21.15.103:0/2997821224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32500041c0 0x7f325000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:48.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.540+0000 7f326ffff700 1 --2- 172.21.15.103:0/2997821224 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3250003920 0x7f3250003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:48.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.540+0000 7f3274922700 1 -- 172.21.15.103:0/2997821224 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3250003920 msgr2=0x7f3250003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:48.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.540+0000 7f3274922700 1 --2- 172.21.15.103:0/2997821224 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3250003920 0x7f3250003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:48.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.540+0000 7f3274922700 1 -- 172.21.15.103:0/2997821224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32500041c0 msgr2=0x7f325000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:48.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.540+0000 7f3274922700 1 --2- 172.21.15.103:0/2997821224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32500041c0 0x7f325000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:48.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.540+0000 7f3274922700 1 -- 172.21.15.103:0/2997821224 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3270150060 con 0x7f32500049b0 2020-04-22T14:17:48.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.540+0000 7f3275123700 1 -- 172.21.15.103:0/2997821224 reap_dead start 2020-04-22T14:17:48.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.540+0000 7f326ffff700 1 --2- 172.21.15.103:0/2997821224 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3250003920 0x7f3250003d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:17:48.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.540+0000 7f3276b86700 1 -- 172.21.15.103:0/2997821224 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3270143cf0 con 0x7f32500049b0 2020-04-22T14:17:48.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.540+0000 7f3274922700 1 --2- 172.21.15.103:0/2997821224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32500049b0 0x7f3250004dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3260002f30 tx=0x7f3250005630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.540+0000 7f3276b86700 1 -- 172.21.15.103:0/2997821224 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3270145a90 con 0x7f32500049b0 2020-04-22T14:17:48.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.540+0000 7f3274922700 1 --2- 172.21.15.103:0/2997821224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32500049b0 0x7f3250004dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3260002f30 tx=0x7f3250005630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.540+0000 7f3274922700 1 --2- 172.21.15.103:0/2997821224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32500049b0 0x7f3250004dd0 secure :-1 s=READY pgs=1899 cs=0 l=1 rx=0x7f3260002f30 tx=0x7f3250005630).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:48.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.541+0000 7f3274922700 1 --2- 172.21.15.103:0/2997821224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32500049b0 0x7f3250004dd0 secure :-1 s=THROTTLE_DONE pgs=1899 cs=0 l=1 rx=0x7f3260002f30 tx=0x7f3250005630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.541+0000 7f326dffb700 1 -- 172.21.15.103:0/2997821224 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3260007360 con 0x7f32500049b0 2020-04-22T14:17:48.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.541+0000 7f3274922700 1 --2- 172.21.15.103:0/2997821224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32500049b0 0x7f3250004dd0 secure :-1 s=THROTTLE_DONE pgs=1899 cs=0 l=1 rx=0x7f3260002f30 tx=0x7f3250005630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.541+0000 7f326dffb700 1 -- 172.21.15.103:0/2997821224 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32600074c0 con 0x7f32500049b0 2020-04-22T14:17:48.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.541+0000 7f3274922700 1 --2- 172.21.15.103:0/2997821224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32500049b0 0x7f3250004dd0 secure :-1 s=THROTTLE_DONE pgs=1899 cs=0 l=1 rx=0x7f3260002f30 tx=0x7f3250005630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.541+0000 7f326dffb700 1 -- 172.21.15.103:0/2997821224 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32600058b0 con 0x7f32500049b0 2020-04-22T14:17:48.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.541+0000 7f3274922700 1 --2- 172.21.15.103:0/2997821224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32500049b0 0x7f3250004dd0 secure :-1 s=THROTTLE_DONE pgs=1899 cs=0 l=1 rx=0x7f3260002f30 tx=0x7f3250005630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.541+0000 7f3276b86700 1 -- 172.21.15.103:0/2997821224 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f324c003340 con 0x7f32500049b0 2020-04-22T14:17:48.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.542+0000 7f326dffb700 1 -- 172.21.15.103:0/2997821224 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f3260005a10 con 0x7f32500049b0 2020-04-22T14:17:48.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.542+0000 7f3274922700 1 --2- 172.21.15.103:0/2997821224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32500049b0 0x7f3250004dd0 secure :-1 s=THROTTLE_DONE pgs=1899 cs=0 l=1 rx=0x7f3260002f30 tx=0x7f3250005630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.542+0000 7f326dffb700 1 --2- 172.21.15.103:0/2997821224 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f32500517c0 0x7f3250053c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:48.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.542+0000 7f326dffb700 1 -- 172.21.15.103:0/2997821224 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3260061d20 con 0x7f32500049b0 2020-04-22T14:17:48.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.542+0000 7f326ffff700 1 --2- 172.21.15.103:0/2997821224 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f32500517c0 0x7f3250053c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:48.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.542+0000 7f326ffff700 1 --2- 172.21.15.103:0/2997821224 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f32500517c0 0x7f3250053c80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3270061be0 tx=0x7f3264001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.542+0000 7f326ffff700 1 --2- 172.21.15.103:0/2997821224 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f32500517c0 0x7f3250053c80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3270061be0 tx=0x7f3264001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.542+0000 7f326ffff700 1 --2- 172.21.15.103:0/2997821224 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f32500517c0 0x7f3250053c80 secure :-1 s=READY pgs=693 cs=0 l=1 rx=0x7f3270061be0 tx=0x7f3264001710).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:48.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.546+0000 7f3274922700 1 --2- 172.21.15.103:0/2997821224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32500049b0 0x7f3250004dd0 secure :-1 s=THROTTLE_DONE pgs=1899 cs=0 l=1 rx=0x7f3260002f30 tx=0x7f3250005630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.546+0000 7f326dffb700 1 -- 172.21.15.103:0/2997821224 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f326003d220 con 0x7f32500049b0 2020-04-22T14:17:48.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.689+0000 7f3276b86700 1 -- 172.21.15.103:0/2997821224 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f324c0021d0 con 0x7f32500049b0 2020-04-22T14:17:48.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.690+0000 7f3274922700 1 --2- 172.21.15.103:0/2997821224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32500049b0 0x7f3250004dd0 secure :-1 s=THROTTLE_DONE pgs=1899 cs=0 l=1 rx=0x7f3260002f30 tx=0x7f3250005630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.690+0000 7f326dffb700 1 -- 172.21.15.103:0/2997821224 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) v1 ==== 74+0+16116 (secure 0 0 0) 0x7f3260040840 con 0x7f32500049b0 2020-04-22T14:17:48.694 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:17:48.695 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":134,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:17:48.006243+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:17:45.940111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2020-04-22T14:17:46.960856+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:17:48.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.691+0000 7f3276b86700 1 -- 172.21.15.103:0/2997821224 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f32500517c0 msgr2=0x7f3250053c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:48.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.691+0000 7f3276b86700 1 --2- 172.21.15.103:0/2997821224 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f32500517c0 0x7f3250053c80 secure :-1 s=READY pgs=693 cs=0 l=1 rx=0x7f3270061be0 tx=0x7f3264001710).stop 2020-04-22T14:17:48.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.691+0000 7f3276b86700 1 -- 172.21.15.103:0/2997821224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32500049b0 msgr2=0x7f3250004dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:48.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.691+0000 7f3276b86700 1 --2- 172.21.15.103:0/2997821224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32500049b0 0x7f3250004dd0 secure :-1 s=READY pgs=1899 cs=0 l=1 rx=0x7f3260002f30 tx=0x7f3250005630).stop 2020-04-22T14:17:48.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.691+0000 7f3276b86700 1 -- 172.21.15.103:0/2997821224 shutdown_connections 2020-04-22T14:17:48.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.691+0000 7f3276b86700 1 --2- 172.21.15.103:0/2997821224 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f32500517c0 0x7f3250053c80 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:48.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.691+0000 7f3276b86700 1 --2- 172.21.15.103:0/2997821224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32500049b0 0x7f3250004dd0 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:48.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.691+0000 7f3276b86700 1 -- 172.21.15.103:0/2997821224 >> 172.21.15.103:0/2997821224 conn(0x7f32700b9160 msgr2=0x7f327013b370 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:48.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.691+0000 7f3276b86700 1 -- 172.21.15.103:0/2997821224 shutdown_connections 2020-04-22T14:17:48.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.691+0000 7f3276b86700 1 -- 172.21.15.103:0/2997821224 wait complete. 2020-04-22T14:17:48.704 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:48.717 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-04-22T14:17:48.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.863+0000 7fb936244700 1 Processor -- start 2020-04-22T14:17:48.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.863+0000 7fb936244700 1 -- start start 2020-04-22T14:17:48.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.864+0000 7fb936244700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9300b9140 0x7fb93012b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:48.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.864+0000 7fb936244700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9301467e0 con 0x7fb9300ac950 2020-04-22T14:17:48.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.864+0000 7fb936244700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb930060050 con 0x7fb93012b670 2020-04-22T14:17:48.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.864+0000 7fb936244700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9300602f0 con 0x7fb9300b9140 2020-04-22T14:17:48.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.864+0000 7fb92ffff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb93012b670 0x7fb930143090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49704/0 (socket says 172.21.15.103:49704) 2020-04-22T14:17:48.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.864+0000 7fb92ffff700 1 -- 172.21.15.103:0/2880795183 learned_addr learned my addr 172.21.15.103:0/2880795183 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:17:48.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.864+0000 7fb92f7fe700 1 --2- 172.21.15.103:0/2880795183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9300b9140 0x7fb93012b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:48.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.864+0000 7fb92e7fc700 1 -- 172.21.15.103:0/2880795183 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 536419776 0 0) 0x7fb930060050 con 0x7fb93012b670 2020-04-22T14:17:48.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.864+0000 7fb92e7fc700 1 -- 172.21.15.103:0/2880795183 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb91c003230 con 0x7fb93012b670 2020-04-22T14:17:48.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.864+0000 7fb92e7fc700 1 -- 172.21.15.103:0/2880795183 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1827537084 0 0) 0x7fb91c003230 con 0x7fb93012b670 2020-04-22T14:17:48.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.864+0000 7fb92e7fc700 1 -- 172.21.15.103:0/2880795183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9300b9140 msgr2=0x7fb93012b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:48.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.864+0000 7fb92e7fc700 1 --2- 172.21.15.103:0/2880795183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9300b9140 0x7fb93012b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:48.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.864+0000 7fb92e7fc700 1 -- 172.21.15.103:0/2880795183 >> v1:172.21.15.86:6789/0 conn(0x7fb9300ac950 legacy=0x7fb930146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:48.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.864+0000 7fb92e7fc700 1 -- 172.21.15.103:0/2880795183 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9300b9520 con 0x7fb93012b670 2020-04-22T14:17:48.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.864+0000 7fb92e7fc700 1 -- 172.21.15.103:0/2880795183 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fb928001a50 con 0x7fb93012b670 2020-04-22T14:17:48.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.865+0000 7fb92e7fc700 1 -- 172.21.15.103:0/2880795183 >> v1:172.21.15.103:6789/0 conn(0x7fb93012b670 legacy=0x7fb930143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:48.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.865+0000 7fb92e7fc700 1 --2- 172.21.15.103:0/2880795183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9300b9140 0x7fb91c003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:48.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.865+0000 7fb92e7fc700 1 --2- 172.21.15.103:0/2880795183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb91c003b80 0x7fb91c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:48.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.865+0000 7fb92e7fc700 1 --2- 172.21.15.103:0/2880795183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb91c0044d0 0x7fb91c004930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:48.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.865+0000 7fb92e7fc700 1 -- 172.21.15.103:0/2880795183 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9300602f0 con 0x7fb91c0044d0 2020-04-22T14:17:48.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.865+0000 7fb92e7fc700 1 -- 172.21.15.103:0/2880795183 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c0078f0 con 0x7fb91c003b80 2020-04-22T14:17:48.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.865+0000 7fb92e7fc700 1 -- 172.21.15.103:0/2880795183 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c007ab0 con 0x7fb9300b9140 2020-04-22T14:17:48.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.865+0000 7fb92effd700 1 --2- 172.21.15.103:0/2880795183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb91c003b80 0x7fb91c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:48.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.865+0000 7fb92f7fe700 1 --2- 172.21.15.103:0/2880795183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9300b9140 0x7fb91c003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:48.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.865+0000 7fb92ffff700 1 --2- 172.21.15.103:0/2880795183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb91c0044d0 0x7fb91c004930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:48.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.865+0000 7fb92effd700 1 -- 172.21.15.103:0/2880795183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9300b9140 msgr2=0x7fb91c003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:48.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.865+0000 7fb92effd700 1 --2- 172.21.15.103:0/2880795183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9300b9140 0x7fb91c003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:48.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.865+0000 7fb92effd700 1 -- 172.21.15.103:0/2880795183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb91c0044d0 msgr2=0x7fb91c004930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:48.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.865+0000 7fb92effd700 1 --2- 172.21.15.103:0/2880795183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb91c0044d0 0x7fb91c004930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:48.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.865+0000 7fb92effd700 1 -- 172.21.15.103:0/2880795183 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb91c003230 con 0x7fb91c003b80 2020-04-22T14:17:48.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.865+0000 7fb92effd700 1 --2- 172.21.15.103:0/2880795183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb91c003b80 0x7fb91c003fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb9240010d0 tx=0x7fb92400bed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.865+0000 7fb92effd700 1 --2- 172.21.15.103:0/2880795183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb91c003b80 0x7fb91c003fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb9240010d0 tx=0x7fb92400bed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.865+0000 7fb92effd700 1 --2- 172.21.15.103:0/2880795183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb91c003b80 0x7fb91c003fe0 secure :-1 s=READY pgs=1901 cs=0 l=1 rx=0x7fb9240010d0 tx=0x7fb92400bed0).ready entity=mon.1 client_cookie=e7422a80b4e3c9fe server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:48.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.865+0000 7fb92effd700 1 --2- 172.21.15.103:0/2880795183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb91c003b80 0x7fb91c003fe0 secure :-1 s=THROTTLE_DONE pgs=1901 cs=0 l=1 rx=0x7fb9240010d0 tx=0x7fb92400bed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.865+0000 7fb92e7fc700 1 -- 172.21.15.103:0/2880795183 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9240068c0 con 0x7fb91c003b80 2020-04-22T14:17:48.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.865+0000 7fb92effd700 1 --2- 172.21.15.103:0/2880795183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb91c003b80 0x7fb91c003fe0 secure :-1 s=THROTTLE_DONE pgs=1901 cs=0 l=1 rx=0x7fb9240010d0 tx=0x7fb92400bed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.865+0000 7fb92e7fc700 1 -- 172.21.15.103:0/2880795183 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb924006a60 con 0x7fb91c003b80 2020-04-22T14:17:48.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.865+0000 7fb92effd700 1 --2- 172.21.15.103:0/2880795183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb91c003b80 0x7fb91c003fe0 secure :-1 s=THROTTLE_DONE pgs=1901 cs=0 l=1 rx=0x7fb9240010d0 tx=0x7fb92400bed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.865+0000 7fb936244700 1 -- 172.21.15.103:0/2880795183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb91c003b80 msgr2=0x7fb91c003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:48.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.865+0000 7fb92e7fc700 1 -- 172.21.15.103:0/2880795183 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb924006e40 con 0x7fb91c003b80 2020-04-22T14:17:48.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.865+0000 7fb936244700 1 --2- 172.21.15.103:0/2880795183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb91c003b80 0x7fb91c003fe0 secure :-1 s=READY pgs=1901 cs=0 l=1 rx=0x7fb9240010d0 tx=0x7fb92400bed0).stop 2020-04-22T14:17:48.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.865+0000 7fb92ffff700 1 -- 172.21.15.103:0/2880795183 reap_dead start 2020-04-22T14:17:48.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.866+0000 7fb936244700 1 -- 172.21.15.103:0/2880795183 shutdown_connections 2020-04-22T14:17:48.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.866+0000 7fb936244700 1 -- 172.21.15.103:0/2880795183 >> 172.21.15.103:0/2880795183 conn(0x7fb93005b7b0 msgr2=0x7fb9300b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:48.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.866+0000 7fb936244700 1 -- 172.21.15.103:0/2880795183 shutdown_connections 2020-04-22T14:17:48.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.866+0000 7fb936244700 1 -- 172.21.15.103:0/2880795183 wait complete. 2020-04-22T14:17:48.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.867+0000 7fb936244700 1 Processor -- start 2020-04-22T14:17:48.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.867+0000 7fb936244700 1 -- start start 2020-04-22T14:17:48.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.868+0000 7fb936244700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb9300b5240 0x7fb930123220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:48.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.868+0000 7fb936244700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb930123750 0x7fb930123b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:48.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.868+0000 7fb936244700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9301246d0 con 0x7fb93012a7c0 2020-04-22T14:17:48.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.868+0000 7fb936244700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9300b1530 con 0x7fb9300b5240 2020-04-22T14:17:48.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.868+0000 7fb936244700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9300afbd0 con 0x7fb930123750 2020-04-22T14:17:48.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.868+0000 7fb92effd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb9300b5240 0x7fb930123220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:48.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.868+0000 7fb92effd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb9300b5240 0x7fb930123220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57526/0 (socket says 172.21.15.103:57526) 2020-04-22T14:17:48.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.868+0000 7fb92effd700 1 -- 172.21.15.103:0/299310809 learned_addr learned my addr 172.21.15.103:0/299310809 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:48.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.868+0000 7fb92ffff700 1 --2- 172.21.15.103:0/299310809 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb930123750 0x7fb930123b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:48.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.868+0000 7fb92effd700 1 -- 172.21.15.103:0/299310809 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb930123750 msgr2=0x7fb930123b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:48.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.868+0000 7fb92effd700 1 --2- 172.21.15.103:0/299310809 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb930123750 0x7fb930123b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:48.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.868+0000 7fb92effd700 1 -- 172.21.15.103:0/299310809 >> v1:172.21.15.86:6789/0 conn(0x7fb93012a7c0 legacy=0x7fb930140510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:48.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.868+0000 7fb92effd700 1 -- 172.21.15.103:0/299310809 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9300afe70 con 0x7fb9300b5240 2020-04-22T14:17:48.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.868+0000 7fb92ffff700 1 --2- 172.21.15.103:0/299310809 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb930123750 0x7fb930123b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:17:48.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.868+0000 7fb92effd700 1 --2- 172.21.15.103:0/299310809 >> v2:172.21.15.103:3300/0 conn(0x7fb9300b5240 0x7fb930123220 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb9240010d0 tx=0x7fb92400bed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.868+0000 7fb92effd700 1 --2- 172.21.15.103:0/299310809 >> v2:172.21.15.103:3300/0 conn(0x7fb9300b5240 0x7fb930123220 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb9240010d0 tx=0x7fb92400bed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.868+0000 7fb92effd700 1 --2- 172.21.15.103:0/299310809 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9300b5240 0x7fb930123220 secure :-1 s=READY pgs=1902 cs=0 l=1 rx=0x7fb9240010d0 tx=0x7fb92400bed0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:48.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.868+0000 7fb92effd700 1 --2- 172.21.15.103:0/299310809 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9300b5240 0x7fb930123220 secure :-1 s=THROTTLE_DONE pgs=1902 cs=0 l=1 rx=0x7fb9240010d0 tx=0x7fb92400bed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.868+0000 7fb92cff9700 1 -- 172.21.15.103:0/299310809 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb924009e30 con 0x7fb9300b5240 2020-04-22T14:17:48.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.868+0000 7fb92effd700 1 --2- 172.21.15.103:0/299310809 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9300b5240 0x7fb930123220 secure :-1 s=THROTTLE_DONE pgs=1902 cs=0 l=1 rx=0x7fb9240010d0 tx=0x7fb92400bed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.868+0000 7fb92effd700 1 --2- 172.21.15.103:0/299310809 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9300b5240 0x7fb930123220 secure :-1 s=THROTTLE_DONE pgs=1902 cs=0 l=1 rx=0x7fb9240010d0 tx=0x7fb92400bed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.868+0000 7fb92cff9700 1 -- 172.21.15.103:0/299310809 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9240066d0 con 0x7fb9300b5240 2020-04-22T14:17:48.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.868+0000 7fb936244700 1 -- 172.21.15.103:0/299310809 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb93012aba0 con 0x7fb9300b5240 2020-04-22T14:17:48.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.868+0000 7fb92cff9700 1 -- 172.21.15.103:0/299310809 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb924006a30 con 0x7fb9300b5240 2020-04-22T14:17:48.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.868+0000 7fb936244700 1 -- 172.21.15.103:0/299310809 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb930140c20 con 0x7fb9300b5240 2020-04-22T14:17:48.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.869+0000 7fb92effd700 1 --2- 172.21.15.103:0/299310809 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9300b5240 0x7fb930123220 secure :-1 s=THROTTLE_DONE pgs=1902 cs=0 l=1 rx=0x7fb9240010d0 tx=0x7fb92400bed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.869+0000 7fb936244700 1 -- 172.21.15.103:0/299310809 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9300b0000 con 0x7fb9300b5240 2020-04-22T14:17:48.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.869+0000 7fb92cff9700 1 -- 172.21.15.103:0/299310809 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fb924006ca0 con 0x7fb9300b5240 2020-04-22T14:17:48.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.869+0000 7fb92effd700 1 --2- 172.21.15.103:0/299310809 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9300b5240 0x7fb930123220 secure :-1 s=THROTTLE_DONE pgs=1902 cs=0 l=1 rx=0x7fb9240010d0 tx=0x7fb92400bed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.870+0000 7fb92cff9700 1 --2- 172.21.15.103:0/299310809 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb91004d8d0 0x7fb91004fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:48.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.870+0000 7fb92cff9700 1 -- 172.21.15.103:0/299310809 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb924061a10 con 0x7fb9300b5240 2020-04-22T14:17:48.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.870+0000 7fb92f7fe700 1 --2- 172.21.15.103:0/299310809 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb91004d8d0 0x7fb91004fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:48.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.870+0000 7fb92f7fe700 1 --2- 172.21.15.103:0/299310809 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb91004d8d0 0x7fb91004fd90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb9300b3530 tx=0x7fb920007700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.870+0000 7fb92f7fe700 1 --2- 172.21.15.103:0/299310809 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb91004d8d0 0x7fb91004fd90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb9300b3530 tx=0x7fb920007700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.870+0000 7fb92f7fe700 1 --2- 172.21.15.103:0/299310809 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb91004d8d0 0x7fb91004fd90 secure :-1 s=READY pgs=694 cs=0 l=1 rx=0x7fb9300b3530 tx=0x7fb920007700).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:48.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.874+0000 7fb92effd700 1 --2- 172.21.15.103:0/299310809 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9300b5240 0x7fb930123220 secure :-1 s=THROTTLE_DONE pgs=1902 cs=0 l=1 rx=0x7fb9240010d0 tx=0x7fb92400bed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:48.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:48.874+0000 7fb92cff9700 1 -- 172.21.15.103:0/299310809 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fb92403ceb0 con 0x7fb9300b5240 2020-04-22T14:17:49.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:49.065+0000 7fb936244700 1 -- 172.21.15.103:0/299310809 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb930056c90 con 0x7fb9300b5240 2020-04-22T14:17:49.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:49.868+0000 7fb92effd700 1 --2- 172.21.15.103:0/299310809 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9300b5240 0x7fb930123220 secure :-1 s=READY pgs=1902 cs=0 l=1 rx=0x7fb9240010d0 tx=0x7fb92400bed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.022+0000 7fb92effd700 1 --2- 172.21.15.103:0/299310809 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9300b5240 0x7fb930123220 secure :-1 s=THROTTLE_DONE pgs=1902 cs=0 l=1 rx=0x7fb9240010d0 tx=0x7fb92400bed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.022+0000 7fb92cff9700 1 -- 172.21.15.103:0/299310809 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v101) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb9240404d0 con 0x7fb9300b5240 2020-04-22T14:17:50.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.024+0000 7fb936244700 1 -- 172.21.15.103:0/299310809 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb91004d8d0 msgr2=0x7fb91004fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:50.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.024+0000 7fb936244700 1 --2- 172.21.15.103:0/299310809 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb91004d8d0 0x7fb91004fd90 secure :-1 s=READY pgs=694 cs=0 l=1 rx=0x7fb9300b3530 tx=0x7fb920007700).stop 2020-04-22T14:17:50.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.024+0000 7fb936244700 1 -- 172.21.15.103:0/299310809 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9300b5240 msgr2=0x7fb930123220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:50.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.024+0000 7fb936244700 1 --2- 172.21.15.103:0/299310809 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9300b5240 0x7fb930123220 secure :-1 s=READY pgs=1902 cs=0 l=1 rx=0x7fb9240010d0 tx=0x7fb92400bed0).stop 2020-04-22T14:17:50.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.024+0000 7fb936244700 1 -- 172.21.15.103:0/299310809 shutdown_connections 2020-04-22T14:17:50.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.024+0000 7fb936244700 1 --2- 172.21.15.103:0/299310809 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb91004d8d0 0x7fb91004fd90 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:50.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.024+0000 7fb936244700 1 --2- 172.21.15.103:0/299310809 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb930123750 0x7fb930123b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:50.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.024+0000 7fb936244700 1 --2- 172.21.15.103:0/299310809 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9300b5240 0x7fb930123220 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:50.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.024+0000 7fb936244700 1 -- 172.21.15.103:0/299310809 >> 172.21.15.103:0/299310809 conn(0x7fb93005b7b0 msgr2=0x7fb930144620 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:50.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.024+0000 7fb936244700 1 -- 172.21.15.103:0/299310809 shutdown_connections 2020-04-22T14:17:50.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.024+0000 7fb936244700 1 -- 172.21.15.103:0/299310809 wait complete. 2020-04-22T14:17:50.039 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:50.053 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:17:50.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.203+0000 7f03e3c1d700 1 Processor -- start 2020-04-22T14:17:50.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.203+0000 7f03e3c1d700 1 -- start start 2020-04-22T14:17:50.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.204+0000 7f03e3c1d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03dc0ae1a0 0x7f03dc14a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:50.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.204+0000 7f03e3c1d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f03dc0bd1b0 0x7f03dc0bd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:50.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.204+0000 7f03e3c1d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03dc14a710 con 0x7f03dc140320 2020-04-22T14:17:50.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.204+0000 7f03e3c1d700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03dc1462f0 con 0x7f03dc0bd1b0 2020-04-22T14:17:50.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.204+0000 7f03e3c1d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc146590 con 0x7f03dc0ae1a0 2020-04-22T14:17:50.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.204+0000 7f03e21ba700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f03dc0bd1b0 0x7f03dc0bd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:50.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.204+0000 7f03e19b9700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f03dc140320 0x7f03dc146cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49722/0 (socket says 172.21.15.103:49722) 2020-04-22T14:17:50.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.204+0000 7f03e21ba700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f03dc0bd1b0 0x7f03dc0bd640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57536/0 (socket says 172.21.15.103:57536) 2020-04-22T14:17:50.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.204+0000 7f03e19b9700 1 -- 172.21.15.103:0/2303197927 learned_addr learned my addr 172.21.15.103:0/2303197927 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:17:50.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.204+0000 7f03e21ba700 1 -- 172.21.15.103:0/2303197927 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03dc0ae1a0 msgr2=0x7f03dc14a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:50.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.204+0000 7f03e21ba700 1 --2- 172.21.15.103:0/2303197927 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03dc0ae1a0 0x7f03dc14a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:50.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.204+0000 7f03e21ba700 1 -- 172.21.15.103:0/2303197927 >> v1:172.21.15.103:6789/0 conn(0x7f03dc140320 legacy=0x7f03dc146cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:50.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.204+0000 7f03e21ba700 1 -- 172.21.15.103:0/2303197927 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03dc146830 con 0x7f03dc0bd1b0 2020-04-22T14:17:50.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.204+0000 7f03e09b7700 1 -- 172.21.15.103:0/2303197927 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 292262594 0 0) 0x7f03dc14a710 con 0x7f03dc140320 2020-04-22T14:17:50.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.205+0000 7f03e21ba700 1 --2- 172.21.15.103:0/2303197927 >> v2:172.21.15.103:3300/0 conn(0x7f03dc0bd1b0 0x7f03dc0bd640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f03d40032b0 tx=0x7f03d4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.205+0000 7f03e21ba700 1 --2- 172.21.15.103:0/2303197927 >> v2:172.21.15.103:3300/0 conn(0x7f03dc0bd1b0 0x7f03dc0bd640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f03d40032b0 tx=0x7f03d4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.205+0000 7f03e21ba700 1 --2- 172.21.15.103:0/2303197927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03dc0bd1b0 0x7f03dc0bd640 secure :-1 s=READY pgs=1904 cs=0 l=1 rx=0x7f03d40032b0 tx=0x7f03d4007dc0).ready entity=mon.1 client_cookie=caf7f5530e39c3ad server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:50.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.205+0000 7f03e21ba700 1 --2- 172.21.15.103:0/2303197927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03dc0bd1b0 0x7f03dc0bd640 secure :-1 s=THROTTLE_DONE pgs=1904 cs=0 l=1 rx=0x7f03d40032b0 tx=0x7f03d4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.205+0000 7f03e09b7700 1 -- 172.21.15.103:0/2303197927 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03d400a180 con 0x7f03dc0bd1b0 2020-04-22T14:17:50.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.205+0000 7f03e21ba700 1 --2- 172.21.15.103:0/2303197927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03dc0bd1b0 0x7f03dc0bd640 secure :-1 s=THROTTLE_DONE pgs=1904 cs=0 l=1 rx=0x7f03d40032b0 tx=0x7f03d4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.205+0000 7f03e21ba700 1 --2- 172.21.15.103:0/2303197927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03dc0bd1b0 0x7f03dc0bd640 secure :-1 s=THROTTLE_DONE pgs=1904 cs=0 l=1 rx=0x7f03d40032b0 tx=0x7f03d4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.205+0000 7f03e09b7700 1 -- 172.21.15.103:0/2303197927 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d400a2e0 con 0x7f03dc0bd1b0 2020-04-22T14:17:50.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.205+0000 7f03e09b7700 1 -- 172.21.15.103:0/2303197927 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03d400a6c0 con 0x7f03dc0bd1b0 2020-04-22T14:17:50.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.205+0000 7f03e3c1d700 1 -- 172.21.15.103:0/2303197927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03dc0bd1b0 msgr2=0x7f03dc0bd640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:50.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.205+0000 7f03e3c1d700 1 --2- 172.21.15.103:0/2303197927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03dc0bd1b0 0x7f03dc0bd640 secure :-1 s=READY pgs=1904 cs=0 l=1 rx=0x7f03d40032b0 tx=0x7f03d4007dc0).stop 2020-04-22T14:17:50.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.205+0000 7f03e3c1d700 1 -- 172.21.15.103:0/2303197927 shutdown_connections 2020-04-22T14:17:50.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.205+0000 7f03e3c1d700 1 --2- 172.21.15.103:0/2303197927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03dc0bd1b0 0x7f03dc0bd640 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:50.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.205+0000 7f03e3c1d700 1 --2- 172.21.15.103:0/2303197927 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03dc0ae1a0 0x7f03dc14a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:50.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.205+0000 7f03e3c1d700 1 -- 172.21.15.103:0/2303197927 >> 172.21.15.103:0/2303197927 conn(0x7f03dc05f2c0 msgr2=0x7f03dc0bcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:50.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.205+0000 7f03e3c1d700 1 -- 172.21.15.103:0/2303197927 shutdown_connections 2020-04-22T14:17:50.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.205+0000 7f03e3c1d700 1 -- 172.21.15.103:0/2303197927 wait complete. 2020-04-22T14:17:50.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.206+0000 7f03e3c1d700 1 Processor -- start 2020-04-22T14:17:50.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.206+0000 7f03e3c1d700 1 -- start start 2020-04-22T14:17:50.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.207+0000 7f03e3c1d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03dc0ae1a0 0x7f03dc0b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:50.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.207+0000 7f03e3c1d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f03dc0bd1b0 0x7f03dc13ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:50.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.207+0000 7f03e3c1d700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03dc140a00 con 0x7f03dc140320 2020-04-22T14:17:50.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.207+0000 7f03e3c1d700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03dc0bc360 con 0x7f03dc0bd1b0 2020-04-22T14:17:50.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.207+0000 7f03e3c1d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc140ca0 con 0x7f03dc0ae1a0 2020-04-22T14:17:50.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.207+0000 7f03e11b8700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f03dc0bd1b0 0x7f03dc13ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:50.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.207+0000 7f03e11b8700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f03dc0bd1b0 0x7f03dc13ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57538/0 (socket says 172.21.15.103:57538) 2020-04-22T14:17:50.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.207+0000 7f03e11b8700 1 -- 172.21.15.103:0/2573881505 learned_addr learned my addr 172.21.15.103:0/2573881505 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:50.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.207+0000 7f03e19b9700 1 --2- 172.21.15.103:0/2573881505 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03dc0ae1a0 0x7f03dc0b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:50.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.207+0000 7f03e11b8700 1 -- 172.21.15.103:0/2573881505 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03dc0ae1a0 msgr2=0x7f03dc0b0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:50.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.207+0000 7f03e11b8700 1 --2- 172.21.15.103:0/2573881505 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03dc0ae1a0 0x7f03dc0b0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:50.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.207+0000 7f03e11b8700 1 -- 172.21.15.103:0/2573881505 >> v1:172.21.15.86:6789/0 conn(0x7f03dc140320 legacy=0x7f03dc141680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:50.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.207+0000 7f03e11b8700 1 -- 172.21.15.103:0/2573881505 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03dc140f40 con 0x7f03dc0bd1b0 2020-04-22T14:17:50.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.207+0000 7f03e11b8700 1 --2- 172.21.15.103:0/2573881505 >> v2:172.21.15.103:3300/0 conn(0x7f03dc0bd1b0 0x7f03dc13ceb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f03d8002f30 tx=0x7f03d8010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.207+0000 7f03e11b8700 1 --2- 172.21.15.103:0/2573881505 >> v2:172.21.15.103:3300/0 conn(0x7f03dc0bd1b0 0x7f03dc13ceb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f03d8002f30 tx=0x7f03d8010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.207+0000 7f03e11b8700 1 --2- 172.21.15.103:0/2573881505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03dc0bd1b0 0x7f03dc13ceb0 secure :-1 s=READY pgs=1905 cs=0 l=1 rx=0x7f03d8002f30 tx=0x7f03d8010a70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:50.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.208+0000 7f03e11b8700 1 --2- 172.21.15.103:0/2573881505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03dc0bd1b0 0x7f03dc13ceb0 secure :-1 s=THROTTLE_DONE pgs=1905 cs=0 l=1 rx=0x7f03d8002f30 tx=0x7f03d8010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.208+0000 7f03caffd700 1 -- 172.21.15.103:0/2573881505 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03d8008e10 con 0x7f03dc0bd1b0 2020-04-22T14:17:50.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.208+0000 7f03e11b8700 1 --2- 172.21.15.103:0/2573881505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03dc0bd1b0 0x7f03dc13ceb0 secure :-1 s=THROTTLE_DONE pgs=1905 cs=0 l=1 rx=0x7f03d8002f30 tx=0x7f03d8010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.208+0000 7f03e11b8700 1 --2- 172.21.15.103:0/2573881505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03dc0bd1b0 0x7f03dc13ceb0 secure :-1 s=THROTTLE_DONE pgs=1905 cs=0 l=1 rx=0x7f03d8002f30 tx=0x7f03d8010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.208+0000 7f03caffd700 1 -- 172.21.15.103:0/2573881505 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d8000e90 con 0x7f03dc0bd1b0 2020-04-22T14:17:50.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.208+0000 7f03e3c1d700 1 -- 172.21.15.103:0/2573881505 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03dc1411e0 con 0x7f03dc0bd1b0 2020-04-22T14:17:50.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.208+0000 7f03caffd700 1 -- 172.21.15.103:0/2573881505 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03d8012600 con 0x7f03dc0bd1b0 2020-04-22T14:17:50.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.208+0000 7f03e3c1d700 1 -- 172.21.15.103:0/2573881505 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03dc13d310 con 0x7f03dc0bd1b0 2020-04-22T14:17:50.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.208+0000 7f03e11b8700 1 --2- 172.21.15.103:0/2573881505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03dc0bd1b0 0x7f03dc13ceb0 secure :-1 s=THROTTLE_DONE pgs=1905 cs=0 l=1 rx=0x7f03d8002f30 tx=0x7f03d8010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.209+0000 7f03caffd700 1 -- 172.21.15.103:0/2573881505 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f03d8012760 con 0x7f03dc0bd1b0 2020-04-22T14:17:50.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.209+0000 7f03e11b8700 1 --2- 172.21.15.103:0/2573881505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03dc0bd1b0 0x7f03dc13ceb0 secure :-1 s=THROTTLE_DONE pgs=1905 cs=0 l=1 rx=0x7f03d8002f30 tx=0x7f03d8010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.209+0000 7f03caffd700 1 --2- 172.21.15.103:0/2573881505 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f03bc04d9e0 0x7f03bc04fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:50.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.209+0000 7f03caffd700 1 -- 172.21.15.103:0/2573881505 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f03d8061300 con 0x7f03dc0bd1b0 2020-04-22T14:17:50.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.209+0000 7f03e3c1d700 1 -- 172.21.15.103:0/2573881505 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03dc056c90 con 0x7f03dc0bd1b0 2020-04-22T14:17:50.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.209+0000 7f03e19b9700 1 --2- 172.21.15.103:0/2573881505 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f03bc04d9e0 0x7f03bc04fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:50.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.209+0000 7f03e19b9700 1 --2- 172.21.15.103:0/2573881505 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f03bc04d9e0 0x7f03bc04fea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f03cc000b80 tx=0x7f03cc001730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.209+0000 7f03e19b9700 1 --2- 172.21.15.103:0/2573881505 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f03bc04d9e0 0x7f03bc04fea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f03cc000b80 tx=0x7f03cc001730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.209+0000 7f03e19b9700 1 --2- 172.21.15.103:0/2573881505 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f03bc04d9e0 0x7f03bc04fea0 secure :-1 s=READY pgs=695 cs=0 l=1 rx=0x7f03cc000b80 tx=0x7f03cc001730).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:50.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.213+0000 7f03e11b8700 1 --2- 172.21.15.103:0/2573881505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03dc0bd1b0 0x7f03dc13ceb0 secure :-1 s=THROTTLE_DONE pgs=1905 cs=0 l=1 rx=0x7f03d8002f30 tx=0x7f03d8010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.213+0000 7f03caffd700 1 -- 172.21.15.103:0/2573881505 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f03d803c680 con 0x7f03dc0bd1b0 2020-04-22T14:17:50.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.403+0000 7f03e3c1d700 1 -- 172.21.15.103:0/2573881505 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03dc061690 con 0x7f03dc0bd1b0 2020-04-22T14:17:50.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.404+0000 7f03e11b8700 1 --2- 172.21.15.103:0/2573881505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03dc0bd1b0 0x7f03dc13ceb0 secure :-1 s=THROTTLE_DONE pgs=1905 cs=0 l=1 rx=0x7f03d8002f30 tx=0x7f03d8010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.404+0000 7f03caffd700 1 -- 172.21.15.103:0/2573881505 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+2141 (secure 0 0 0) 0x7f03d803fca0 con 0x7f03dc0bd1b0 2020-04-22T14:17:50.407 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:17:50.407 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":101,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6539,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1045362246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1045362246},{"type":"v1","addr":"172.21.15.86:6835","nonce":1045362246}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":97}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:17:48.006467+0000","modified":"2020-04-22T14:17:50.019789+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9277":{"gid":9277,"name":"a","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/33849566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":33849566},{"type":"v1","addr":"172.21.15.103:6833","nonce":33849566}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2020-04-22T14:17:50.408 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.405+0000 7f03e3c1d700 1 -- 172.21.15.103:0/2573881505 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f03bc04d9e0 msgr2=0x7f03bc04fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:50.408 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.405+0000 7f03e3c1d700 1 --2- 172.21.15.103:0/2573881505 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f03bc04d9e0 0x7f03bc04fea0 secure :-1 s=READY pgs=695 cs=0 l=1 rx=0x7f03cc000b80 tx=0x7f03cc001730).stop 2020-04-22T14:17:50.408 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.405+0000 7f03e3c1d700 1 -- 172.21.15.103:0/2573881505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03dc0bd1b0 msgr2=0x7f03dc13ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:50.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.405+0000 7f03e3c1d700 1 --2- 172.21.15.103:0/2573881505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03dc0bd1b0 0x7f03dc13ceb0 secure :-1 s=READY pgs=1905 cs=0 l=1 rx=0x7f03d8002f30 tx=0x7f03d8010a70).stop 2020-04-22T14:17:50.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.406+0000 7f03e3c1d700 1 -- 172.21.15.103:0/2573881505 shutdown_connections 2020-04-22T14:17:50.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.406+0000 7f03e3c1d700 1 --2- 172.21.15.103:0/2573881505 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f03bc04d9e0 0x7f03bc04fea0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:50.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.406+0000 7f03e3c1d700 1 --2- 172.21.15.103:0/2573881505 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03dc0ae1a0 0x7f03dc0b0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:50.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.406+0000 7f03e3c1d700 1 --2- 172.21.15.103:0/2573881505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03dc0bd1b0 0x7f03dc13ceb0 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:50.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.406+0000 7f03e3c1d700 1 -- 172.21.15.103:0/2573881505 >> 172.21.15.103:0/2573881505 conn(0x7f03dc05f2c0 msgr2=0x7f03dc13ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:50.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.406+0000 7f03e3c1d700 1 -- 172.21.15.103:0/2573881505 shutdown_connections 2020-04-22T14:17:50.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.406+0000 7f03e3c1d700 1 -- 172.21.15.103:0/2573881505 wait complete. 2020-04-22T14:17:50.410 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 101 2020-04-22T14:17:50.418 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:50.432 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:17:50.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.577+0000 7fd642570700 1 Processor -- start 2020-04-22T14:17:50.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.577+0000 7fd642570700 1 -- start start 2020-04-22T14:17:50.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.578+0000 7fd642570700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd63c12c0d0 0x7fd63c1464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:50.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.578+0000 7fd642570700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd63c065fe0 0x7fd63c05b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:50.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.578+0000 7fd642570700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd63c05b8a0 0x7fd63c062ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:50.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.578+0000 7fd642570700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd63c12c4b0 con 0x7fd63c05b8a0 2020-04-22T14:17:50.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.578+0000 7fd642570700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd63c143300 con 0x7fd63c12c0d0 2020-04-22T14:17:50.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.578+0000 7fd642570700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c1435a0 con 0x7fd63c065fe0 2020-04-22T14:17:50.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.578+0000 7fd63bfff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd63c12c0d0 0x7fd63c1464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:50.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.578+0000 7fd63bfff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd63c12c0d0 0x7fd63c1464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57546/0 (socket says 172.21.15.103:57546) 2020-04-22T14:17:50.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.578+0000 7fd63bfff700 1 -- 172.21.15.103:0/3718858011 learned_addr learned my addr 172.21.15.103:0/3718858011 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:50.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.578+0000 7fd640b0d700 1 --2- 172.21.15.103:0/3718858011 >> v2:172.21.15.86:3300/0 conn(0x7fd63c05b8a0 0x7fd63c062ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:50.584 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.578+0000 7fd63b7fe700 1 --2- 172.21.15.103:0/3718858011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd63c065fe0 0x7fd63c05b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:50.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.578+0000 7fd63bfff700 1 -- 172.21.15.103:0/3718858011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd63c065fe0 msgr2=0x7fd63c05b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:50.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.578+0000 7fd63bfff700 1 --2- 172.21.15.103:0/3718858011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd63c065fe0 0x7fd63c05b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:50.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.578+0000 7fd63bfff700 1 -- 172.21.15.103:0/3718858011 >> v2:172.21.15.86:3300/0 conn(0x7fd63c05b8a0 msgr2=0x7fd63c062ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:50.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.578+0000 7fd63bfff700 1 --2- 172.21.15.103:0/3718858011 >> v2:172.21.15.86:3300/0 conn(0x7fd63c05b8a0 0x7fd63c062ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:50.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.578+0000 7fd63bfff700 1 -- 172.21.15.103:0/3718858011 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd63c143840 con 0x7fd63c12c0d0 2020-04-22T14:17:50.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.579+0000 7fd63bfff700 1 --2- 172.21.15.103:0/3718858011 >> v2:172.21.15.103:3300/0 conn(0x7fd63c12c0d0 0x7fd63c1464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd62c002f30 tx=0x7fd62c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.585 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.579+0000 7fd63bfff700 1 --2- 172.21.15.103:0/3718858011 >> v2:172.21.15.103:3300/0 conn(0x7fd63c12c0d0 0x7fd63c1464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd62c002f30 tx=0x7fd62c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.579+0000 7fd63bfff700 1 --2- 172.21.15.103:0/3718858011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd63c12c0d0 0x7fd63c1464e0 secure :-1 s=READY pgs=1906 cs=0 l=1 rx=0x7fd62c002f30 tx=0x7fd62c007a40).ready entity=mon.1 client_cookie=f897c9b3881af984 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:50.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.579+0000 7fd63bfff700 1 --2- 172.21.15.103:0/3718858011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd63c12c0d0 0x7fd63c1464e0 secure :-1 s=THROTTLE_DONE pgs=1906 cs=0 l=1 rx=0x7fd62c002f30 tx=0x7fd62c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.579+0000 7fd63bfff700 1 --2- 172.21.15.103:0/3718858011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd63c12c0d0 0x7fd63c1464e0 secure :-1 s=THROTTLE_DONE pgs=1906 cs=0 l=1 rx=0x7fd62c002f30 tx=0x7fd62c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.579+0000 7fd63affd700 1 -- 172.21.15.103:0/3718858011 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd62c0115c0 con 0x7fd63c12c0d0 2020-04-22T14:17:50.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.579+0000 7fd63bfff700 1 --2- 172.21.15.103:0/3718858011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd63c12c0d0 0x7fd63c1464e0 secure :-1 s=THROTTLE_DONE pgs=1906 cs=0 l=1 rx=0x7fd62c002f30 tx=0x7fd62c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.579+0000 7fd63affd700 1 -- 172.21.15.103:0/3718858011 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62c011720 con 0x7fd63c12c0d0 2020-04-22T14:17:50.586 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.579+0000 7fd63affd700 1 -- 172.21.15.103:0/3718858011 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd62c011b40 con 0x7fd63c12c0d0 2020-04-22T14:17:50.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.579+0000 7fd642570700 1 -- 172.21.15.103:0/3718858011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd63c12c0d0 msgr2=0x7fd63c1464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:50.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.579+0000 7fd642570700 1 --2- 172.21.15.103:0/3718858011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd63c12c0d0 0x7fd63c1464e0 secure :-1 s=READY pgs=1906 cs=0 l=1 rx=0x7fd62c002f30 tx=0x7fd62c007a40).stop 2020-04-22T14:17:50.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.579+0000 7fd642570700 1 -- 172.21.15.103:0/3718858011 shutdown_connections 2020-04-22T14:17:50.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.579+0000 7fd642570700 1 --2- 172.21.15.103:0/3718858011 >> v2:172.21.15.86:3300/0 conn(0x7fd63c05b8a0 0x7fd63c062ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:50.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.579+0000 7fd642570700 1 --2- 172.21.15.103:0/3718858011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd63c12c0d0 0x7fd63c1464e0 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:50.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.579+0000 7fd642570700 1 --2- 172.21.15.103:0/3718858011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd63c065fe0 0x7fd63c05b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:50.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.579+0000 7fd642570700 1 -- 172.21.15.103:0/3718858011 >> 172.21.15.103:0/3718858011 conn(0x7fd63c0b9160 msgr2=0x7fd63c05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:50.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.579+0000 7fd642570700 1 -- 172.21.15.103:0/3718858011 shutdown_connections 2020-04-22T14:17:50.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.579+0000 7fd642570700 1 -- 172.21.15.103:0/3718858011 wait complete. 2020-04-22T14:17:50.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.580+0000 7fd642570700 1 Processor -- start 2020-04-22T14:17:50.588 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.580+0000 7fd642570700 1 -- start start 2020-04-22T14:17:50.591 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.581+0000 7fd642570700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd63c05b8a0 0x7fd63c121f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:50.591 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.581+0000 7fd642570700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd63c065fe0 0x7fd63c124b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:50.591 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.581+0000 7fd642570700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd63c124f70 con 0x7fd63c12c0d0 2020-04-22T14:17:50.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.581+0000 7fd642570700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd63c1245c0 con 0x7fd63c05b8a0 2020-04-22T14:17:50.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.581+0000 7fd642570700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c1495e0 con 0x7fd63c065fe0 2020-04-22T14:17:50.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.581+0000 7fd63bfff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd63c05b8a0 0x7fd63c121f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:50.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.581+0000 7fd63bfff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd63c05b8a0 0x7fd63c121f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57552/0 (socket says 172.21.15.103:57552) 2020-04-22T14:17:50.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.581+0000 7fd63bfff700 1 -- 172.21.15.103:0/2861348997 learned_addr learned my addr 172.21.15.103:0/2861348997 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:50.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.581+0000 7fd63b7fe700 1 --2- 172.21.15.103:0/2861348997 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd63c065fe0 0x7fd63c124b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:50.592 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.581+0000 7fd63bfff700 1 -- 172.21.15.103:0/2861348997 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd63c065fe0 msgr2=0x7fd63c124b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:50.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.581+0000 7fd63bfff700 1 --2- 172.21.15.103:0/2861348997 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd63c065fe0 0x7fd63c124b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:50.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.581+0000 7fd63bfff700 1 -- 172.21.15.103:0/2861348997 >> v1:172.21.15.86:6789/0 conn(0x7fd63c12c0d0 legacy=0x7fd63c141ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:50.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.581+0000 7fd63bfff700 1 -- 172.21.15.103:0/2861348997 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd63c149880 con 0x7fd63c05b8a0 2020-04-22T14:17:50.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.581+0000 7fd63b7fe700 1 --2- 172.21.15.103:0/2861348997 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd63c065fe0 0x7fd63c124b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:17:50.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.581+0000 7fd63bfff700 1 --2- 172.21.15.103:0/2861348997 >> v2:172.21.15.103:3300/0 conn(0x7fd63c05b8a0 0x7fd63c121f50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd62c002f30 tx=0x7fd62c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.582+0000 7fd63bfff700 1 --2- 172.21.15.103:0/2861348997 >> v2:172.21.15.103:3300/0 conn(0x7fd63c05b8a0 0x7fd63c121f50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd62c002f30 tx=0x7fd62c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.593 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.582+0000 7fd63bfff700 1 --2- 172.21.15.103:0/2861348997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd63c05b8a0 0x7fd63c121f50 secure :-1 s=READY pgs=1907 cs=0 l=1 rx=0x7fd62c002f30 tx=0x7fd62c007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:50.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.582+0000 7fd63bfff700 1 --2- 172.21.15.103:0/2861348997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd63c05b8a0 0x7fd63c121f50 secure :-1 s=THROTTLE_DONE pgs=1907 cs=0 l=1 rx=0x7fd62c002f30 tx=0x7fd62c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.582+0000 7fd63bfff700 1 --2- 172.21.15.103:0/2861348997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd63c05b8a0 0x7fd63c121f50 secure :-1 s=THROTTLE_DONE pgs=1907 cs=0 l=1 rx=0x7fd62c002f30 tx=0x7fd62c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.582+0000 7fd6397fa700 1 -- 172.21.15.103:0/2861348997 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd62c007170 con 0x7fd63c05b8a0 2020-04-22T14:17:50.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.582+0000 7fd63bfff700 1 --2- 172.21.15.103:0/2861348997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd63c05b8a0 0x7fd63c121f50 secure :-1 s=THROTTLE_DONE pgs=1907 cs=0 l=1 rx=0x7fd62c002f30 tx=0x7fd62c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.582+0000 7fd6397fa700 1 -- 172.21.15.103:0/2861348997 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62c0072d0 con 0x7fd63c05b8a0 2020-04-22T14:17:50.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.582+0000 7fd642570700 1 -- 172.21.15.103:0/2861348997 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd63c123110 con 0x7fd63c05b8a0 2020-04-22T14:17:50.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.582+0000 7fd6397fa700 1 -- 172.21.15.103:0/2861348997 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd62c0056c0 con 0x7fd63c05b8a0 2020-04-22T14:17:50.594 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.582+0000 7fd642570700 1 -- 172.21.15.103:0/2861348997 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd63c149260 con 0x7fd63c05b8a0 2020-04-22T14:17:50.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.582+0000 7fd63bfff700 1 --2- 172.21.15.103:0/2861348997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd63c05b8a0 0x7fd63c121f50 secure :-1 s=THROTTLE_DONE pgs=1907 cs=0 l=1 rx=0x7fd62c002f30 tx=0x7fd62c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.583+0000 7fd642570700 1 -- 172.21.15.103:0/2861348997 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd63c1232a0 con 0x7fd63c05b8a0 2020-04-22T14:17:50.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.583+0000 7fd6397fa700 1 -- 172.21.15.103:0/2861348997 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fd62c005930 con 0x7fd63c05b8a0 2020-04-22T14:17:50.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.583+0000 7fd63bfff700 1 --2- 172.21.15.103:0/2861348997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd63c05b8a0 0x7fd63c121f50 secure :-1 s=THROTTLE_DONE pgs=1907 cs=0 l=1 rx=0x7fd62c002f30 tx=0x7fd62c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.583+0000 7fd6397fa700 1 --2- 172.21.15.103:0/2861348997 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd61c04da40 0x7fd61c04ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:50.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.583+0000 7fd6397fa700 1 -- 172.21.15.103:0/2861348997 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd62c061f20 con 0x7fd63c05b8a0 2020-04-22T14:17:50.595 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.583+0000 7fd63b7fe700 1 --2- 172.21.15.103:0/2861348997 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd61c04da40 0x7fd61c04ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:50.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.583+0000 7fd63b7fe700 1 --2- 172.21.15.103:0/2861348997 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd61c04da40 0x7fd61c04ff00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd630002f30 tx=0x7fd630007700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.583+0000 7fd63b7fe700 1 --2- 172.21.15.103:0/2861348997 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd61c04da40 0x7fd61c04ff00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd630002f30 tx=0x7fd630007700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.583+0000 7fd63b7fe700 1 --2- 172.21.15.103:0/2861348997 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd61c04da40 0x7fd61c04ff00 secure :-1 s=READY pgs=696 cs=0 l=1 rx=0x7fd630002f30 tx=0x7fd630007700).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:50.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.587+0000 7fd63bfff700 1 --2- 172.21.15.103:0/2861348997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd63c05b8a0 0x7fd63c121f50 secure :-1 s=THROTTLE_DONE pgs=1907 cs=0 l=1 rx=0x7fd62c002f30 tx=0x7fd62c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.587+0000 7fd6397fa700 1 -- 172.21.15.103:0/2861348997 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fd62c03d2a0 con 0x7fd63c05b8a0 2020-04-22T14:17:50.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.731+0000 7fd642570700 1 -- 172.21.15.103:0/2861348997 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd63c056c90 con 0x7fd63c05b8a0 2020-04-22T14:17:50.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.732+0000 7fd63bfff700 1 --2- 172.21.15.103:0/2861348997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd63c05b8a0 0x7fd63c121f50 secure :-1 s=THROTTLE_DONE pgs=1907 cs=0 l=1 rx=0x7fd62c002f30 tx=0x7fd62c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.732+0000 7fd6397fa700 1 -- 172.21.15.103:0/2861348997 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+16103 (secure 0 0 0) 0x7fd62c0408c0 con 0x7fd63c05b8a0 2020-04-22T14:17:50.734 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:17:50.734 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":135,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:17:49.007669+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:17:45.940111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2020-04-22T14:17:46.960856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:17:50.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.733+0000 7fd642570700 1 -- 172.21.15.103:0/2861348997 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd61c04da40 msgr2=0x7fd61c04ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:50.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.733+0000 7fd642570700 1 --2- 172.21.15.103:0/2861348997 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd61c04da40 0x7fd61c04ff00 secure :-1 s=READY pgs=696 cs=0 l=1 rx=0x7fd630002f30 tx=0x7fd630007700).stop 2020-04-22T14:17:50.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.733+0000 7fd642570700 1 -- 172.21.15.103:0/2861348997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd63c05b8a0 msgr2=0x7fd63c121f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:50.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.733+0000 7fd642570700 1 --2- 172.21.15.103:0/2861348997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd63c05b8a0 0x7fd63c121f50 secure :-1 s=READY pgs=1907 cs=0 l=1 rx=0x7fd62c002f30 tx=0x7fd62c007a40).stop 2020-04-22T14:17:50.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.733+0000 7fd642570700 1 -- 172.21.15.103:0/2861348997 shutdown_connections 2020-04-22T14:17:50.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.733+0000 7fd642570700 1 --2- 172.21.15.103:0/2861348997 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd61c04da40 0x7fd61c04ff00 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:50.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.733+0000 7fd642570700 1 --2- 172.21.15.103:0/2861348997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd63c05b8a0 0x7fd63c121f50 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:50.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.733+0000 7fd642570700 1 --2- 172.21.15.103:0/2861348997 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd63c065fe0 0x7fd63c124b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:50.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.733+0000 7fd642570700 1 -- 172.21.15.103:0/2861348997 >> 172.21.15.103:0/2861348997 conn(0x7fd63c0b9160 msgr2=0x7fd63c0b4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:50.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.733+0000 7fd642570700 1 -- 172.21.15.103:0/2861348997 shutdown_connections 2020-04-22T14:17:50.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.733+0000 7fd642570700 1 -- 172.21.15.103:0/2861348997 wait complete. 2020-04-22T14:17:50.746 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:50.760 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:17:50.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.910+0000 7fdc3d0aa700 1 Processor -- start 2020-04-22T14:17:50.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.910+0000 7fdc3d0aa700 1 -- start start 2020-04-22T14:17:50.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.911+0000 7fdc3d0aa700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc380633c0 0x7fdc380b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:50.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.911+0000 7fdc3d0aa700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdc380b6350 0x7fdc380b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:50.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.911+0000 7fdc3d0aa700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc38025b90 con 0x7fdc380666e0 2020-04-22T14:17:50.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.911+0000 7fdc3d0aa700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc38066ac0 con 0x7fdc380b6350 2020-04-22T14:17:50.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.911+0000 7fdc3d0aa700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc38024ea0 con 0x7fdc380633c0 2020-04-22T14:17:50.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.911+0000 7fdc3e30c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdc380b6350 0x7fdc380b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:50.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.911+0000 7fdc3e30c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdc380b6350 0x7fdc380b6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57560/0 (socket says 172.21.15.103:57560) 2020-04-22T14:17:50.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.911+0000 7fdc3e30c700 1 -- 172.21.15.103:0/3377322091 learned_addr learned my addr 172.21.15.103:0/3377322091 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:50.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.911+0000 7fdc37fff700 1 --2- 172.21.15.103:0/3377322091 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc380633c0 0x7fdc380b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:50.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.911+0000 7fdc3e30c700 1 -- 172.21.15.103:0/3377322091 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc380633c0 msgr2=0x7fdc380b5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:50.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.911+0000 7fdc3e30c700 1 --2- 172.21.15.103:0/3377322091 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc380633c0 0x7fdc380b5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:50.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.911+0000 7fdc3e30c700 1 -- 172.21.15.103:0/3377322091 >> v1:172.21.15.86:6789/0 conn(0x7fdc380666e0 legacy=0x7fdc380b9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:50.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.911+0000 7fdc3e30c700 1 -- 172.21.15.103:0/3377322091 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc38155ff0 con 0x7fdc380b6350 2020-04-22T14:17:50.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.911+0000 7fdc3e30c700 1 --2- 172.21.15.103:0/3377322091 >> v2:172.21.15.103:3300/0 conn(0x7fdc380b6350 0x7fdc380b6780 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdc380ba4d0 tx=0x7fdc30007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.911+0000 7fdc3e30c700 1 --2- 172.21.15.103:0/3377322091 >> v2:172.21.15.103:3300/0 conn(0x7fdc380b6350 0x7fdc380b6780 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdc380ba4d0 tx=0x7fdc30007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.911+0000 7fdc3e30c700 1 --2- 172.21.15.103:0/3377322091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc380b6350 0x7fdc380b6780 secure :-1 s=READY pgs=1908 cs=0 l=1 rx=0x7fdc380ba4d0 tx=0x7fdc30007dc0).ready entity=mon.1 client_cookie=f233f59619b489ef server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:50.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.912+0000 7fdc3e30c700 1 --2- 172.21.15.103:0/3377322091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc380b6350 0x7fdc380b6780 secure :-1 s=THROTTLE_DONE pgs=1908 cs=0 l=1 rx=0x7fdc380ba4d0 tx=0x7fdc30007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.912+0000 7fdc377fe700 1 -- 172.21.15.103:0/3377322091 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc3000a180 con 0x7fdc380b6350 2020-04-22T14:17:50.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.912+0000 7fdc3e30c700 1 --2- 172.21.15.103:0/3377322091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc380b6350 0x7fdc380b6780 secure :-1 s=THROTTLE_DONE pgs=1908 cs=0 l=1 rx=0x7fdc380ba4d0 tx=0x7fdc30007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.912+0000 7fdc3e30c700 1 --2- 172.21.15.103:0/3377322091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc380b6350 0x7fdc380b6780 secure :-1 s=THROTTLE_DONE pgs=1908 cs=0 l=1 rx=0x7fdc380ba4d0 tx=0x7fdc30007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.912+0000 7fdc377fe700 1 -- 172.21.15.103:0/3377322091 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc3000a2e0 con 0x7fdc380b6350 2020-04-22T14:17:50.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.912+0000 7fdc377fe700 1 -- 172.21.15.103:0/3377322091 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc3000a700 con 0x7fdc380b6350 2020-04-22T14:17:50.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.912+0000 7fdc3d0aa700 1 -- 172.21.15.103:0/3377322091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc380b6350 msgr2=0x7fdc380b6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:50.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.912+0000 7fdc3d0aa700 1 --2- 172.21.15.103:0/3377322091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc380b6350 0x7fdc380b6780 secure :-1 s=READY pgs=1908 cs=0 l=1 rx=0x7fdc380ba4d0 tx=0x7fdc30007dc0).stop 2020-04-22T14:17:50.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.912+0000 7fdc3d0aa700 1 -- 172.21.15.103:0/3377322091 shutdown_connections 2020-04-22T14:17:50.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.912+0000 7fdc3d0aa700 1 --2- 172.21.15.103:0/3377322091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc380b6350 0x7fdc380b6780 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:50.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.912+0000 7fdc3d0aa700 1 --2- 172.21.15.103:0/3377322091 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc380633c0 0x7fdc380b5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:50.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.912+0000 7fdc3d0aa700 1 -- 172.21.15.103:0/3377322091 >> 172.21.15.103:0/3377322091 conn(0x7fdc38060930 msgr2=0x7fdc38060d40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:50.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.912+0000 7fdc3d0aa700 1 -- 172.21.15.103:0/3377322091 shutdown_connections 2020-04-22T14:17:50.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.912+0000 7fdc3d0aa700 1 -- 172.21.15.103:0/3377322091 wait complete. 2020-04-22T14:17:50.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.913+0000 7fdc3d0aa700 1 Processor -- start 2020-04-22T14:17:50.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.913+0000 7fdc3d0aa700 1 -- start start 2020-04-22T14:17:50.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.914+0000 7fdc3d0aa700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdc380b6350 0x7fdc38128740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:50.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.914+0000 7fdc3d0aa700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc3813aeb0 con 0x7fdc380633c0 2020-04-22T14:17:50.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.914+0000 7fdc3d0aa700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc3813b110 con 0x7fdc380666e0 2020-04-22T14:17:50.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.914+0000 7fdc3d0aa700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc3813b3b0 con 0x7fdc380b6350 2020-04-22T14:17:50.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.914+0000 7fdc3e30c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdc380b6350 0x7fdc38128740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:50.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.914+0000 7fdc37fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fdc380666e0 0x7fdc38137450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49754/0 (socket says 172.21.15.103:49754) 2020-04-22T14:17:50.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.914+0000 7fdc37fff700 1 -- 172.21.15.103:0/1463758682 learned_addr learned my addr 172.21.15.103:0/1463758682 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:17:50.937 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.914+0000 7fdc3e30c700 1 -- 172.21.15.103:0/1463758682 >> v1:172.21.15.103:6789/0 conn(0x7fdc380666e0 legacy=0x7fdc38137450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:50.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.914+0000 7fdc3e30c700 1 -- 172.21.15.103:0/1463758682 >> v1:172.21.15.86:6789/0 conn(0x7fdc380633c0 legacy=0x7fdc38128030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:50.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.915+0000 7fdc3e30c700 1 -- 172.21.15.103:0/1463758682 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc380b8270 con 0x7fdc380b6350 2020-04-22T14:17:50.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.914+0000 7fdc357fa700 1 -- 172.21.15.103:0/1463758682 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2468371761 0 0) 0x7fdc3813b110 con 0x7fdc380666e0 2020-04-22T14:17:50.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.915+0000 7fdc3e30c700 1 --2- 172.21.15.103:0/1463758682 >> v2:172.21.15.103:3300/0 conn(0x7fdc380b6350 0x7fdc38128740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdc380b7aa0 tx=0x7fdc30007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.915+0000 7fdc3e30c700 1 --2- 172.21.15.103:0/1463758682 >> v2:172.21.15.103:3300/0 conn(0x7fdc380b6350 0x7fdc38128740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdc380b7aa0 tx=0x7fdc30007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.915+0000 7fdc3e30c700 1 --2- 172.21.15.103:0/1463758682 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc380b6350 0x7fdc38128740 secure :-1 s=READY pgs=1910 cs=0 l=1 rx=0x7fdc380b7aa0 tx=0x7fdc30007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:50.938 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.915+0000 7fdc3e30c700 1 --2- 172.21.15.103:0/1463758682 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc380b6350 0x7fdc38128740 secure :-1 s=THROTTLE_DONE pgs=1910 cs=0 l=1 rx=0x7fdc380b7aa0 tx=0x7fdc30007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.915+0000 7fdc357fa700 1 -- 172.21.15.103:0/1463758682 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc300115c0 con 0x7fdc380b6350 2020-04-22T14:17:50.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.915+0000 7fdc3e30c700 1 --2- 172.21.15.103:0/1463758682 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc380b6350 0x7fdc38128740 secure :-1 s=THROTTLE_DONE pgs=1910 cs=0 l=1 rx=0x7fdc380b7aa0 tx=0x7fdc30007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.915+0000 7fdc3e30c700 1 --2- 172.21.15.103:0/1463758682 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc380b6350 0x7fdc38128740 secure :-1 s=THROTTLE_DONE pgs=1910 cs=0 l=1 rx=0x7fdc380b7aa0 tx=0x7fdc30007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.915+0000 7fdc357fa700 1 -- 172.21.15.103:0/1463758682 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc30005a40 con 0x7fdc380b6350 2020-04-22T14:17:50.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.915+0000 7fdc3d0aa700 1 -- 172.21.15.103:0/1463758682 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc380b84e0 con 0x7fdc380b6350 2020-04-22T14:17:50.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.915+0000 7fdc357fa700 1 -- 172.21.15.103:0/1463758682 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc30005da0 con 0x7fdc380b6350 2020-04-22T14:17:50.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.915+0000 7fdc3d0aa700 1 -- 172.21.15.103:0/1463758682 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc380b14b0 con 0x7fdc380b6350 2020-04-22T14:17:50.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.915+0000 7fdc3e30c700 1 --2- 172.21.15.103:0/1463758682 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc380b6350 0x7fdc38128740 secure :-1 s=THROTTLE_DONE pgs=1910 cs=0 l=1 rx=0x7fdc380b7aa0 tx=0x7fdc30007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.916+0000 7fdc357fa700 1 -- 172.21.15.103:0/1463758682 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fdc30010700 con 0x7fdc380b6350 2020-04-22T14:17:50.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.916+0000 7fdc3e30c700 1 --2- 172.21.15.103:0/1463758682 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc380b6350 0x7fdc38128740 secure :-1 s=THROTTLE_DONE pgs=1910 cs=0 l=1 rx=0x7fdc380b7aa0 tx=0x7fdc30007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.916+0000 7fdc3d0aa700 1 -- 172.21.15.103:0/1463758682 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc38056c90 con 0x7fdc380b6350 2020-04-22T14:17:50.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.916+0000 7fdc357fa700 1 --2- 172.21.15.103:0/1463758682 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdc1804d820 0x7fdc1804fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:50.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.916+0000 7fdc357fa700 1 -- 172.21.15.103:0/1463758682 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdc30062080 con 0x7fdc380b6350 2020-04-22T14:17:50.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.916+0000 7fdc3c8a9700 1 --2- 172.21.15.103:0/1463758682 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdc1804d820 0x7fdc1804fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:50.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.916+0000 7fdc3c8a9700 1 --2- 172.21.15.103:0/1463758682 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdc1804d820 0x7fdc1804fce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdc38137020 tx=0x7fdc28007b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.917+0000 7fdc3c8a9700 1 --2- 172.21.15.103:0/1463758682 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdc1804d820 0x7fdc1804fce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdc38137020 tx=0x7fdc28007b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.917+0000 7fdc3c8a9700 1 --2- 172.21.15.103:0/1463758682 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdc1804d820 0x7fdc1804fce0 secure :-1 s=READY pgs=697 cs=0 l=1 rx=0x7fdc38137020 tx=0x7fdc28007b40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:50.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.920+0000 7fdc3e30c700 1 --2- 172.21.15.103:0/1463758682 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc380b6350 0x7fdc38128740 secure :-1 s=THROTTLE_DONE pgs=1910 cs=0 l=1 rx=0x7fdc380b7aa0 tx=0x7fdc30007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:50.941 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:50.920+0000 7fdc357fa700 1 -- 172.21.15.103:0/1463758682 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fdc3003d580 con 0x7fdc380b6350 2020-04-22T14:17:51.118 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.116+0000 7fdc3d0aa700 1 -- 172.21.15.103:0/1463758682 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fdc38066140 con 0x7fdc380b6350 2020-04-22T14:17:51.121 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.119+0000 7fdc3e30c700 1 --2- 172.21.15.103:0/1463758682 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc380b6350 0x7fdc38128740 secure :-1 s=THROTTLE_DONE pgs=1910 cs=0 l=1 rx=0x7fdc380b7aa0 tx=0x7fdc30007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:51.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.119+0000 7fdc357fa700 1 -- 172.21.15.103:0/1463758682 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v49) v1 ==== 184+0+0 (secure 0 0 0) 0x7fdc30040ba0 con 0x7fdc380b6350 2020-04-22T14:17:51.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.121+0000 7fdc3d0aa700 1 -- 172.21.15.103:0/1463758682 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdc1804d820 msgr2=0x7fdc1804fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:51.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.121+0000 7fdc3d0aa700 1 --2- 172.21.15.103:0/1463758682 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdc1804d820 0x7fdc1804fce0 secure :-1 s=READY pgs=697 cs=0 l=1 rx=0x7fdc38137020 tx=0x7fdc28007b40).stop 2020-04-22T14:17:51.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.121+0000 7fdc3d0aa700 1 -- 172.21.15.103:0/1463758682 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc380b6350 msgr2=0x7fdc38128740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:51.124 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.121+0000 7fdc3d0aa700 1 --2- 172.21.15.103:0/1463758682 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc380b6350 0x7fdc38128740 secure :-1 s=READY pgs=1910 cs=0 l=1 rx=0x7fdc380b7aa0 tx=0x7fdc30007dc0).stop 2020-04-22T14:17:51.124 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.121+0000 7fdc3d0aa700 1 -- 172.21.15.103:0/1463758682 shutdown_connections 2020-04-22T14:17:51.124 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.121+0000 7fdc3d0aa700 1 --2- 172.21.15.103:0/1463758682 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdc1804d820 0x7fdc1804fce0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:51.124 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.121+0000 7fdc3d0aa700 1 --2- 172.21.15.103:0/1463758682 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc380b6350 0x7fdc38128740 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:51.124 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.121+0000 7fdc3d0aa700 1 -- 172.21.15.103:0/1463758682 >> 172.21.15.103:0/1463758682 conn(0x7fdc38060930 msgr2=0x7fdc38024fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:51.124 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.121+0000 7fdc3d0aa700 1 -- 172.21.15.103:0/1463758682 shutdown_connections 2020-04-22T14:17:51.124 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.121+0000 7fdc3d0aa700 1 -- 172.21.15.103:0/1463758682 wait complete. 2020-04-22T14:17:51.125 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.0 2020-04-22T14:17:51.133 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:51.149 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:17:51.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.298+0000 7f48275ea700 1 Processor -- start 2020-04-22T14:17:51.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.298+0000 7f48275ea700 1 -- start start 2020-04-22T14:17:51.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.299+0000 7f48275ea700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4820152a90 0x7f48200b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:51.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.299+0000 7f48275ea700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4820062170 0x7f48200b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:51.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.299+0000 7f48275ea700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48200b5210 0x7f4820156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:51.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.299+0000 7f48275ea700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48200b5650 con 0x7f4820062170 2020-04-22T14:17:51.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.299+0000 7f48275ea700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48200614f0 con 0x7f4820152a90 2020-04-22T14:17:51.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.299+0000 7f48275ea700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4820061790 con 0x7f48200b5210 2020-04-22T14:17:51.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.299+0000 7f4825b87700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4820152a90 0x7f48200b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:51.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.299+0000 7f4825b87700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4820152a90 0x7f48200b44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57572/0 (socket says 172.21.15.103:57572) 2020-04-22T14:17:51.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.299+0000 7f4825b87700 1 -- 172.21.15.103:0/2402388143 learned_addr learned my addr 172.21.15.103:0/2402388143 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:51.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.300+0000 7f4826388700 1 --2- 172.21.15.103:0/2402388143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48200b5210 0x7f4820156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:51.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.300+0000 7f4825386700 1 --2- 172.21.15.103:0/2402388143 >> v2:172.21.15.86:3300/0 conn(0x7f4820062170 0x7f48200b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:51.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.300+0000 7f4825b87700 1 -- 172.21.15.103:0/2402388143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48200b5210 msgr2=0x7f4820156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:51.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.300+0000 7f4825b87700 1 --2- 172.21.15.103:0/2402388143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48200b5210 0x7f4820156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:51.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.300+0000 7f4825b87700 1 -- 172.21.15.103:0/2402388143 >> v2:172.21.15.86:3300/0 conn(0x7f4820062170 msgr2=0x7f48200b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:51.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.300+0000 7f4825b87700 1 --2- 172.21.15.103:0/2402388143 >> v2:172.21.15.86:3300/0 conn(0x7f4820062170 0x7f48200b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:51.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.300+0000 7f4825b87700 1 -- 172.21.15.103:0/2402388143 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4820061a30 con 0x7f4820152a90 2020-04-22T14:17:51.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.300+0000 7f4825386700 1 --2- 172.21.15.103:0/2402388143 >> v2:172.21.15.86:3300/0 conn(0x7f4820062170 0x7f48200b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:17:51.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.300+0000 7f4825b87700 1 --2- 172.21.15.103:0/2402388143 >> v2:172.21.15.103:3300/0 conn(0x7f4820152a90 0x7f48200b44d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f481c002f30 tx=0x7f481c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:51.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.300+0000 7f4825b87700 1 --2- 172.21.15.103:0/2402388143 >> v2:172.21.15.103:3300/0 conn(0x7f4820152a90 0x7f48200b44d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f481c002f30 tx=0x7f481c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:51.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.300+0000 7f4825b87700 1 --2- 172.21.15.103:0/2402388143 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4820152a90 0x7f48200b44d0 secure :-1 s=READY pgs=1911 cs=0 l=1 rx=0x7f481c002f30 tx=0x7f481c007a40).ready entity=mon.1 client_cookie=8af886575897f5e3 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:51.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.300+0000 7f4825b87700 1 --2- 172.21.15.103:0/2402388143 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4820152a90 0x7f48200b44d0 secure :-1 s=THROTTLE_DONE pgs=1911 cs=0 l=1 rx=0x7f481c002f30 tx=0x7f481c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:51.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.300+0000 7f4824b85700 1 -- 172.21.15.103:0/2402388143 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f481c011720 con 0x7f4820152a90 2020-04-22T14:17:51.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.300+0000 7f4825b87700 1 --2- 172.21.15.103:0/2402388143 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4820152a90 0x7f48200b44d0 secure :-1 s=THROTTLE_DONE pgs=1911 cs=0 l=1 rx=0x7f481c002f30 tx=0x7f481c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:51.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.300+0000 7f4825b87700 1 --2- 172.21.15.103:0/2402388143 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4820152a90 0x7f48200b44d0 secure :-1 s=THROTTLE_DONE pgs=1911 cs=0 l=1 rx=0x7f481c002f30 tx=0x7f481c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:51.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.300+0000 7f4824b85700 1 -- 172.21.15.103:0/2402388143 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f481c011880 con 0x7f4820152a90 2020-04-22T14:17:51.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.300+0000 7f4824b85700 1 -- 172.21.15.103:0/2402388143 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f481c011ca0 con 0x7f4820152a90 2020-04-22T14:17:51.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.300+0000 7f48275ea700 1 -- 172.21.15.103:0/2402388143 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4820152a90 msgr2=0x7f48200b44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:51.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.300+0000 7f48275ea700 1 --2- 172.21.15.103:0/2402388143 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4820152a90 0x7f48200b44d0 secure :-1 s=READY pgs=1911 cs=0 l=1 rx=0x7f481c002f30 tx=0x7f481c007a40).stop 2020-04-22T14:17:51.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.300+0000 7f48275ea700 1 -- 172.21.15.103:0/2402388143 shutdown_connections 2020-04-22T14:17:51.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.300+0000 7f48275ea700 1 --2- 172.21.15.103:0/2402388143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48200b5210 0x7f4820156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:51.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.300+0000 7f48275ea700 1 --2- 172.21.15.103:0/2402388143 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4820152a90 0x7f48200b44d0 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:51.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.300+0000 7f48275ea700 1 --2- 172.21.15.103:0/2402388143 >> v2:172.21.15.86:3300/0 conn(0x7f4820062170 0x7f48200b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:51.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.300+0000 7f48275ea700 1 -- 172.21.15.103:0/2402388143 >> 172.21.15.103:0/2402388143 conn(0x7f482005ad30 msgr2=0x7f482005b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:51.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.300+0000 7f48275ea700 1 -- 172.21.15.103:0/2402388143 shutdown_connections 2020-04-22T14:17:51.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.300+0000 7f48275ea700 1 -- 172.21.15.103:0/2402388143 wait complete. 2020-04-22T14:17:51.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.302+0000 7f48275ea700 1 Processor -- start 2020-04-22T14:17:51.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.302+0000 7f48275ea700 1 -- start start 2020-04-22T14:17:51.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.302+0000 7f48275ea700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4820062170 0x7f4820063790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:51.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.302+0000 7f48275ea700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f48200b5210 0x7f4820063db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:51.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.302+0000 7f48275ea700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4820155c00 con 0x7f4820152a90 2020-04-22T14:17:51.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.302+0000 7f48275ea700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4820062a00 con 0x7f48200b5210 2020-04-22T14:17:51.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.302+0000 7f48275ea700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4820062ca0 con 0x7f4820062170 2020-04-22T14:17:51.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.302+0000 7f4825b87700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4820062170 0x7f4820063790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:51.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.302+0000 7f4825b87700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4820062170 0x7f4820063790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57576/0 (socket says 172.21.15.103:57576) 2020-04-22T14:17:51.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.302+0000 7f4825b87700 1 -- 172.21.15.103:0/682538845 learned_addr learned my addr 172.21.15.103:0/682538845 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:51.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.302+0000 7f4825386700 1 --2- 172.21.15.103:0/682538845 >> v2:172.21.15.86:3300/0 conn(0x7f48200b5210 0x7f4820063db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:51.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.303+0000 7f4825b87700 1 -- 172.21.15.103:0/682538845 >> v2:172.21.15.86:3300/0 conn(0x7f48200b5210 msgr2=0x7f4820063db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:51.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.303+0000 7f4825b87700 1 --2- 172.21.15.103:0/682538845 >> v2:172.21.15.86:3300/0 conn(0x7f48200b5210 0x7f4820063db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:51.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.303+0000 7f4825b87700 1 -- 172.21.15.103:0/682538845 >> v1:172.21.15.103:6789/0 conn(0x7f4820152a90 legacy=0x7f48200adee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:51.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.303+0000 7f48167fc700 1 -- 172.21.15.103:0/682538845 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2642790712 0 0) 0x7f4820155c00 con 0x7f4820152a90 2020-04-22T14:17:51.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.303+0000 7f4825b87700 1 -- 172.21.15.103:0/682538845 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4820062f40 con 0x7f4820062170 2020-04-22T14:17:51.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.303+0000 7f4825b87700 1 --2- 172.21.15.103:0/682538845 >> v2:172.21.15.103:3300/0 conn(0x7f4820062170 0x7f4820063790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f481c002f30 tx=0x7f481c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:51.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.303+0000 7f4825b87700 1 --2- 172.21.15.103:0/682538845 >> v2:172.21.15.103:3300/0 conn(0x7f4820062170 0x7f4820063790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f481c002f30 tx=0x7f481c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:51.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.303+0000 7f4825b87700 1 --2- 172.21.15.103:0/682538845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4820062170 0x7f4820063790 secure :-1 s=READY pgs=1913 cs=0 l=1 rx=0x7f481c002f30 tx=0x7f481c007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:51.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.303+0000 7f4825b87700 1 --2- 172.21.15.103:0/682538845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4820062170 0x7f4820063790 secure :-1 s=THROTTLE_DONE pgs=1913 cs=0 l=1 rx=0x7f481c002f30 tx=0x7f481c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:51.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.303+0000 7f48167fc700 1 -- 172.21.15.103:0/682538845 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f481c007170 con 0x7f4820062170 2020-04-22T14:17:51.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.303+0000 7f4825b87700 1 --2- 172.21.15.103:0/682538845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4820062170 0x7f4820063790 secure :-1 s=THROTTLE_DONE pgs=1913 cs=0 l=1 rx=0x7f481c002f30 tx=0x7f481c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:51.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.303+0000 7f4825b87700 1 --2- 172.21.15.103:0/682538845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4820062170 0x7f4820063790 secure :-1 s=THROTTLE_DONE pgs=1913 cs=0 l=1 rx=0x7f481c002f30 tx=0x7f481c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:51.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.303+0000 7f48167fc700 1 -- 172.21.15.103:0/682538845 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f481c0072d0 con 0x7f4820062170 2020-04-22T14:17:51.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.303+0000 7f48167fc700 1 -- 172.21.15.103:0/682538845 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f481c0056c0 con 0x7f4820062170 2020-04-22T14:17:51.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.303+0000 7f48275ea700 1 -- 172.21.15.103:0/682538845 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4820065610 con 0x7f4820062170 2020-04-22T14:17:51.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.303+0000 7f48275ea700 1 -- 172.21.15.103:0/682538845 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48200b2140 con 0x7f4820062170 2020-04-22T14:17:51.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.303+0000 7f4825b87700 1 --2- 172.21.15.103:0/682538845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4820062170 0x7f4820063790 secure :-1 s=THROTTLE_DONE pgs=1913 cs=0 l=1 rx=0x7f481c002f30 tx=0x7f481c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:51.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.304+0000 7f48167fc700 1 -- 172.21.15.103:0/682538845 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f481c005870 con 0x7f4820062170 2020-04-22T14:17:51.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.304+0000 7f4825b87700 1 --2- 172.21.15.103:0/682538845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4820062170 0x7f4820063790 secure :-1 s=THROTTLE_DONE pgs=1913 cs=0 l=1 rx=0x7f481c002f30 tx=0x7f481c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:51.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.304+0000 7f48275ea700 1 -- 172.21.15.103:0/682538845 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4820056c90 con 0x7f4820062170 2020-04-22T14:17:51.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.304+0000 7f48167fc700 1 --2- 172.21.15.103:0/682538845 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f480804d900 0x7f480804fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:51.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.304+0000 7f48167fc700 1 -- 172.21.15.103:0/682538845 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f481c061c50 con 0x7f4820062170 2020-04-22T14:17:51.324 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.304+0000 7f4825386700 1 --2- 172.21.15.103:0/682538845 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f480804d900 0x7f480804fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:51.324 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.305+0000 7f4825386700 1 --2- 172.21.15.103:0/682538845 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f480804d900 0x7f480804fdc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4810002f30 tx=0x7f482005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:51.324 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.305+0000 7f4825386700 1 --2- 172.21.15.103:0/682538845 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f480804d900 0x7f480804fdc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4810002f30 tx=0x7f482005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:51.324 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.305+0000 7f4825386700 1 --2- 172.21.15.103:0/682538845 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f480804d900 0x7f480804fdc0 secure :-1 s=READY pgs=698 cs=0 l=1 rx=0x7f4810002f30 tx=0x7f482005a720).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:51.324 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.308+0000 7f4825b87700 1 --2- 172.21.15.103:0/682538845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4820062170 0x7f4820063790 secure :-1 s=THROTTLE_DONE pgs=1913 cs=0 l=1 rx=0x7f481c002f30 tx=0x7f481c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:51.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.308+0000 7f48167fc700 1 -- 172.21.15.103:0/682538845 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f481c03d0f0 con 0x7f4820062170 2020-04-22T14:17:51.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.503+0000 7f48275ea700 1 -- 172.21.15.103:0/682538845 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f48200b5910 con 0x7f4820062170 2020-04-22T14:17:51.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.509+0000 7f4825b87700 1 --2- 172.21.15.103:0/682538845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4820062170 0x7f4820063790 secure :-1 s=THROTTLE_DONE pgs=1913 cs=0 l=1 rx=0x7f481c002f30 tx=0x7f481c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:51.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.509+0000 7f48167fc700 1 -- 172.21.15.103:0/682538845 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v50) v1 ==== 184+0+0 (secure 0 0 0) 0x7f481c040710 con 0x7f4820062170 2020-04-22T14:17:51.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.511+0000 7f48275ea700 1 -- 172.21.15.103:0/682538845 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f480804d900 msgr2=0x7f480804fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:51.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.511+0000 7f48275ea700 1 --2- 172.21.15.103:0/682538845 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f480804d900 0x7f480804fdc0 secure :-1 s=READY pgs=698 cs=0 l=1 rx=0x7f4810002f30 tx=0x7f482005a720).stop 2020-04-22T14:17:51.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.511+0000 7f48275ea700 1 -- 172.21.15.103:0/682538845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4820062170 msgr2=0x7f4820063790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:51.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.511+0000 7f48275ea700 1 --2- 172.21.15.103:0/682538845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4820062170 0x7f4820063790 secure :-1 s=READY pgs=1913 cs=0 l=1 rx=0x7f481c002f30 tx=0x7f481c007a40).stop 2020-04-22T14:17:51.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.511+0000 7f48275ea700 1 -- 172.21.15.103:0/682538845 shutdown_connections 2020-04-22T14:17:51.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.511+0000 7f48275ea700 1 --2- 172.21.15.103:0/682538845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4820062170 0x7f4820063790 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:51.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.511+0000 7f48275ea700 1 --2- 172.21.15.103:0/682538845 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f480804d900 0x7f480804fdc0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:51.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.511+0000 7f48275ea700 1 --2- 172.21.15.103:0/682538845 >> v2:172.21.15.86:3300/0 conn(0x7f48200b5210 0x7f4820063db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:51.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.511+0000 7f48275ea700 1 -- 172.21.15.103:0/682538845 >> 172.21.15.103:0/682538845 conn(0x7f482005ad30 msgr2=0x7f48200b31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:51.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.511+0000 7f48275ea700 1 -- 172.21.15.103:0/682538845 shutdown_connections 2020-04-22T14:17:51.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.511+0000 7f48275ea700 1 -- 172.21.15.103:0/682538845 wait complete. 2020-04-22T14:17:51.515 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.1 2020-04-22T14:17:51.534 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:51.550 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:17:51.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.700+0000 7fb22d0e4700 1 Processor -- start 2020-04-22T14:17:51.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.700+0000 7fb22d0e4700 1 -- start start 2020-04-22T14:17:51.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.701+0000 7fb22d0e4700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb228152a90 0x7fb2280b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:51.714 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.701+0000 7fb22d0e4700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb228062170 0x7fb2280b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:51.714 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.701+0000 7fb22d0e4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb2280b5210 0x7fb228156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:51.714 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.701+0000 7fb22d0e4700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2280b5650 con 0x7fb228062170 2020-04-22T14:17:51.714 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.701+0000 7fb22d0e4700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2280614f0 con 0x7fb228152a90 2020-04-22T14:17:51.714 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.701+0000 7fb22d0e4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb228061790 con 0x7fb2280b5210 2020-04-22T14:17:51.714 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.701+0000 7fb22759e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb228152a90 0x7fb2280b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:51.714 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.701+0000 7fb22759e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb228152a90 0x7fb2280b44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57584/0 (socket says 172.21.15.103:57584) 2020-04-22T14:17:51.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.701+0000 7fb22759e700 1 -- 172.21.15.103:0/2578662970 learned_addr learned my addr 172.21.15.103:0/2578662970 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:51.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.701+0000 7fb226d9d700 1 --2- 172.21.15.103:0/2578662970 >> v2:172.21.15.86:3300/0 conn(0x7fb228062170 0x7fb2280b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:51.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.701+0000 7fb22c8e3700 1 --2- 172.21.15.103:0/2578662970 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb2280b5210 0x7fb228156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:51.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.701+0000 7fb22759e700 1 -- 172.21.15.103:0/2578662970 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb2280b5210 msgr2=0x7fb228156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:51.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.701+0000 7fb22759e700 1 --2- 172.21.15.103:0/2578662970 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb2280b5210 0x7fb228156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:51.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.701+0000 7fb22759e700 1 -- 172.21.15.103:0/2578662970 >> v2:172.21.15.86:3300/0 conn(0x7fb228062170 msgr2=0x7fb2280b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:51.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.701+0000 7fb22759e700 1 --2- 172.21.15.103:0/2578662970 >> v2:172.21.15.86:3300/0 conn(0x7fb228062170 0x7fb2280b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:51.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.701+0000 7fb22759e700 1 -- 172.21.15.103:0/2578662970 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb228061a30 con 0x7fb228152a90 2020-04-22T14:17:51.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.701+0000 7fb226d9d700 1 --2- 172.21.15.103:0/2578662970 >> v2:172.21.15.86:3300/0 conn(0x7fb228062170 0x7fb2280b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:17:51.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.701+0000 7fb22c8e3700 1 --2- 172.21.15.103:0/2578662970 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb2280b5210 0x7fb228156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:17:51.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.701+0000 7fb22759e700 1 --2- 172.21.15.103:0/2578662970 >> v2:172.21.15.103:3300/0 conn(0x7fb228152a90 0x7fb2280b44d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb2180032b0 tx=0x7fb218007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:51.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.701+0000 7fb22759e700 1 --2- 172.21.15.103:0/2578662970 >> v2:172.21.15.103:3300/0 conn(0x7fb228152a90 0x7fb2280b44d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb2180032b0 tx=0x7fb218007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:51.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.701+0000 7fb22759e700 1 --2- 172.21.15.103:0/2578662970 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb228152a90 0x7fb2280b44d0 secure :-1 s=READY pgs=1914 cs=0 l=1 rx=0x7fb2180032b0 tx=0x7fb218007dc0).ready entity=mon.1 client_cookie=cbe51c792dd08e4 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:51.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.701+0000 7fb22759e700 1 --2- 172.21.15.103:0/2578662970 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb228152a90 0x7fb2280b44d0 secure :-1 s=THROTTLE_DONE pgs=1914 cs=0 l=1 rx=0x7fb2180032b0 tx=0x7fb218007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:51.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.701+0000 7fb22659c700 1 -- 172.21.15.103:0/2578662970 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb21800a180 con 0x7fb228152a90 2020-04-22T14:17:51.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.701+0000 7fb22759e700 1 --2- 172.21.15.103:0/2578662970 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb228152a90 0x7fb2280b44d0 secure :-1 s=THROTTLE_DONE pgs=1914 cs=0 l=1 rx=0x7fb2180032b0 tx=0x7fb218007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:51.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.701+0000 7fb22759e700 1 --2- 172.21.15.103:0/2578662970 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb228152a90 0x7fb2280b44d0 secure :-1 s=THROTTLE_DONE pgs=1914 cs=0 l=1 rx=0x7fb2180032b0 tx=0x7fb218007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:51.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.701+0000 7fb22659c700 1 -- 172.21.15.103:0/2578662970 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21800a2e0 con 0x7fb228152a90 2020-04-22T14:17:51.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.701+0000 7fb22659c700 1 -- 172.21.15.103:0/2578662970 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb21800a700 con 0x7fb228152a90 2020-04-22T14:17:51.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.701+0000 7fb22d0e4700 1 -- 172.21.15.103:0/2578662970 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb228152a90 msgr2=0x7fb2280b44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:51.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.701+0000 7fb22d0e4700 1 --2- 172.21.15.103:0/2578662970 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb228152a90 0x7fb2280b44d0 secure :-1 s=READY pgs=1914 cs=0 l=1 rx=0x7fb2180032b0 tx=0x7fb218007dc0).stop 2020-04-22T14:17:51.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.702+0000 7fb22d0e4700 1 -- 172.21.15.103:0/2578662970 shutdown_connections 2020-04-22T14:17:51.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.702+0000 7fb22d0e4700 1 --2- 172.21.15.103:0/2578662970 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb2280b5210 0x7fb228156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:51.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.702+0000 7fb22d0e4700 1 --2- 172.21.15.103:0/2578662970 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb228152a90 0x7fb2280b44d0 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:51.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.702+0000 7fb22d0e4700 1 --2- 172.21.15.103:0/2578662970 >> v2:172.21.15.86:3300/0 conn(0x7fb228062170 0x7fb2280b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:51.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.702+0000 7fb22d0e4700 1 -- 172.21.15.103:0/2578662970 >> 172.21.15.103:0/2578662970 conn(0x7fb22805ad30 msgr2=0x7fb22805b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:51.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.702+0000 7fb22d0e4700 1 -- 172.21.15.103:0/2578662970 shutdown_connections 2020-04-22T14:17:51.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.702+0000 7fb22d0e4700 1 -- 172.21.15.103:0/2578662970 wait complete. 2020-04-22T14:17:51.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.703+0000 7fb22d0e4700 1 Processor -- start 2020-04-22T14:17:51.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.703+0000 7fb22d0e4700 1 -- start start 2020-04-22T14:17:51.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.704+0000 7fb22d0e4700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb228062170 0x7fb228062bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:51.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.704+0000 7fb22d0e4700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb228064df0 con 0x7fb2280b5210 2020-04-22T14:17:51.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.704+0000 7fb22d0e4700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb228065090 con 0x7fb228152a90 2020-04-22T14:17:51.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.704+0000 7fb22d0e4700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb228064be0 con 0x7fb228062170 2020-04-22T14:17:51.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.704+0000 7fb22759e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb228062170 0x7fb228062bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:51.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.704+0000 7fb22759e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb228062170 0x7fb228062bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57588/0 (socket says 172.21.15.103:57588) 2020-04-22T14:17:51.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.704+0000 7fb22759e700 1 -- 172.21.15.103:0/2174188326 learned_addr learned my addr 172.21.15.103:0/2174188326 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:51.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.704+0000 7fb22c8e3700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb228152a90 0x7fb2280658d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49782/0 (socket says 172.21.15.103:49782) 2020-04-22T14:17:51.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.704+0000 7fb22759e700 1 -- 172.21.15.103:0/2174188326 >> v1:172.21.15.103:6789/0 conn(0x7fb228152a90 legacy=0x7fb2280658d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:51.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.704+0000 7fb22759e700 1 -- 172.21.15.103:0/2174188326 >> v1:172.21.15.86:6789/0 conn(0x7fb2280b5210 legacy=0x7fb22811ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:51.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.704+0000 7fb20ffff700 1 -- 172.21.15.103:0/2174188326 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1025762812 0 0) 0x7fb228065090 con 0x7fb228152a90 2020-04-22T14:17:51.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.704+0000 7fb22759e700 1 -- 172.21.15.103:0/2174188326 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb228065530 con 0x7fb228062170 2020-04-22T14:17:51.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.704+0000 7fb22759e700 1 --2- 172.21.15.103:0/2174188326 >> v2:172.21.15.103:3300/0 conn(0x7fb228062170 0x7fb228062bc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb2180032b0 tx=0x7fb218007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:51.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.704+0000 7fb22759e700 1 --2- 172.21.15.103:0/2174188326 >> v2:172.21.15.103:3300/0 conn(0x7fb228062170 0x7fb228062bc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb2180032b0 tx=0x7fb218007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:51.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.704+0000 7fb22759e700 1 --2- 172.21.15.103:0/2174188326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb228062170 0x7fb228062bc0 secure :-1 s=READY pgs=1916 cs=0 l=1 rx=0x7fb2180032b0 tx=0x7fb218007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:51.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.704+0000 7fb22759e700 1 --2- 172.21.15.103:0/2174188326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb228062170 0x7fb228062bc0 secure :-1 s=THROTTLE_DONE pgs=1916 cs=0 l=1 rx=0x7fb2180032b0 tx=0x7fb218007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:51.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.704+0000 7fb20ffff700 1 -- 172.21.15.103:0/2174188326 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb218005c30 con 0x7fb228062170 2020-04-22T14:17:51.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.704+0000 7fb22759e700 1 --2- 172.21.15.103:0/2174188326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb228062170 0x7fb228062bc0 secure :-1 s=THROTTLE_DONE pgs=1916 cs=0 l=1 rx=0x7fb2180032b0 tx=0x7fb218007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:51.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.704+0000 7fb22759e700 1 --2- 172.21.15.103:0/2174188326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb228062170 0x7fb228062bc0 secure :-1 s=THROTTLE_DONE pgs=1916 cs=0 l=1 rx=0x7fb2180032b0 tx=0x7fb218007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:51.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.704+0000 7fb20ffff700 1 -- 172.21.15.103:0/2174188326 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb218005d90 con 0x7fb228062170 2020-04-22T14:17:51.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.704+0000 7fb22d0e4700 1 -- 172.21.15.103:0/2174188326 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb228064560 con 0x7fb228062170 2020-04-22T14:17:51.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.704+0000 7fb20ffff700 1 -- 172.21.15.103:0/2174188326 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb218007360 con 0x7fb228062170 2020-04-22T14:17:51.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.705+0000 7fb22d0e4700 1 -- 172.21.15.103:0/2174188326 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb22811f160 con 0x7fb228062170 2020-04-22T14:17:51.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.705+0000 7fb22759e700 1 --2- 172.21.15.103:0/2174188326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb228062170 0x7fb228062bc0 secure :-1 s=THROTTLE_DONE pgs=1916 cs=0 l=1 rx=0x7fb2180032b0 tx=0x7fb218007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:51.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.706+0000 7fb22d0e4700 1 -- 172.21.15.103:0/2174188326 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb228056c90 con 0x7fb228062170 2020-04-22T14:17:51.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.706+0000 7fb20ffff700 1 -- 172.21.15.103:0/2174188326 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fb2180075d0 con 0x7fb228062170 2020-04-22T14:17:51.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.706+0000 7fb22759e700 1 --2- 172.21.15.103:0/2174188326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb228062170 0x7fb228062bc0 secure :-1 s=THROTTLE_DONE pgs=1916 cs=0 l=1 rx=0x7fb2180032b0 tx=0x7fb218007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:51.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.706+0000 7fb20ffff700 1 --2- 172.21.15.103:0/2174188326 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb20804d8a0 0x7fb20804fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:51.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.706+0000 7fb20ffff700 1 -- 172.21.15.103:0/2174188326 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb2180a6340 con 0x7fb228062170 2020-04-22T14:17:51.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.706+0000 7fb226d9d700 1 --2- 172.21.15.103:0/2174188326 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb20804d8a0 0x7fb20804fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:51.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.706+0000 7fb226d9d700 1 --2- 172.21.15.103:0/2174188326 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb20804d8a0 0x7fb20804fd60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb228155ca0 tx=0x7fb22805a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:51.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.707+0000 7fb226d9d700 1 --2- 172.21.15.103:0/2174188326 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb20804d8a0 0x7fb20804fd60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb228155ca0 tx=0x7fb22805a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:51.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.707+0000 7fb226d9d700 1 --2- 172.21.15.103:0/2174188326 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb20804d8a0 0x7fb20804fd60 secure :-1 s=READY pgs=699 cs=0 l=1 rx=0x7fb228155ca0 tx=0x7fb22805a720).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:51.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.710+0000 7fb22759e700 1 --2- 172.21.15.103:0/2174188326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb228062170 0x7fb228062bc0 secure :-1 s=THROTTLE_DONE pgs=1916 cs=0 l=1 rx=0x7fb2180032b0 tx=0x7fb218007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:51.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.710+0000 7fb20ffff700 1 -- 172.21.15.103:0/2174188326 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fb218081840 con 0x7fb228062170 2020-04-22T14:17:51.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.902+0000 7fb22d0e4700 1 -- 172.21.15.103:0/2174188326 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fb228065220 con 0x7fb228062170 2020-04-22T14:17:51.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.908+0000 7fb22759e700 1 --2- 172.21.15.103:0/2174188326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb228062170 0x7fb228062bc0 secure :-1 s=THROTTLE_DONE pgs=1916 cs=0 l=1 rx=0x7fb2180032b0 tx=0x7fb218007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:51.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.909+0000 7fb20ffff700 1 -- 172.21.15.103:0/2174188326 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v51) v1 ==== 184+0+0 (secure 0 0 0) 0x7fb218084e60 con 0x7fb228062170 2020-04-22T14:17:51.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.910+0000 7fb22d0e4700 1 -- 172.21.15.103:0/2174188326 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb20804d8a0 msgr2=0x7fb20804fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:51.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.910+0000 7fb22d0e4700 1 --2- 172.21.15.103:0/2174188326 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb20804d8a0 0x7fb20804fd60 secure :-1 s=READY pgs=699 cs=0 l=1 rx=0x7fb228155ca0 tx=0x7fb22805a720).stop 2020-04-22T14:17:51.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.910+0000 7fb22d0e4700 1 -- 172.21.15.103:0/2174188326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb228062170 msgr2=0x7fb228062bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:51.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.910+0000 7fb22d0e4700 1 --2- 172.21.15.103:0/2174188326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb228062170 0x7fb228062bc0 secure :-1 s=READY pgs=1916 cs=0 l=1 rx=0x7fb2180032b0 tx=0x7fb218007dc0).stop 2020-04-22T14:17:51.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.910+0000 7fb22d0e4700 1 -- 172.21.15.103:0/2174188326 shutdown_connections 2020-04-22T14:17:51.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.910+0000 7fb22d0e4700 1 --2- 172.21.15.103:0/2174188326 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb20804d8a0 0x7fb20804fd60 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:51.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.910+0000 7fb22d0e4700 1 --2- 172.21.15.103:0/2174188326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb228062170 0x7fb228062bc0 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:51.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.910+0000 7fb22d0e4700 1 -- 172.21.15.103:0/2174188326 >> 172.21.15.103:0/2174188326 conn(0x7fb22805ad30 msgr2=0x7fb2280b31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:51.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.910+0000 7fb22d0e4700 1 -- 172.21.15.103:0/2174188326 shutdown_connections 2020-04-22T14:17:51.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:51.910+0000 7fb22d0e4700 1 -- 172.21.15.103:0/2174188326 wait complete. 2020-04-22T14:17:51.914 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.2 2020-04-22T14:17:51.922 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:51.936 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:17:52.092 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.087+0000 7f6bf32a1700 1 Processor -- start 2020-04-22T14:17:52.092 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.087+0000 7f6bf32a1700 1 -- start start 2020-04-22T14:17:52.092 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.088+0000 7f6bf32a1700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6bec152a90 0x7f6bec0b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:52.092 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.088+0000 7f6bf32a1700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6bec062170 0x7f6bec0b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:52.092 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.088+0000 7f6bf32a1700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bec152e70 con 0x7f6bec0b5210 2020-04-22T14:17:52.092 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.088+0000 7f6bf32a1700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bec0b5680 con 0x7f6bec062170 2020-04-22T14:17:52.093 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.088+0000 7f6bf32a1700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bec0614f0 con 0x7f6bec152a90 2020-04-22T14:17:52.093 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.088+0000 7f6bf183e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6bec152a90 0x7f6bec0b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:52.093 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.088+0000 7f6bf183e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6bec152a90 0x7f6bec0b44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57596/0 (socket says 172.21.15.103:57596) 2020-04-22T14:17:52.093 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.088+0000 7f6bf183e700 1 -- 172.21.15.103:0/1590924868 learned_addr learned my addr 172.21.15.103:0/1590924868 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:52.093 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.088+0000 7f6bf103d700 1 --2- 172.21.15.103:0/1590924868 >> v2:172.21.15.86:3300/0 conn(0x7f6bec062170 0x7f6bec0b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:52.093 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.088+0000 7f6bf183e700 1 -- 172.21.15.103:0/1590924868 >> v2:172.21.15.86:3300/0 conn(0x7f6bec062170 msgr2=0x7f6bec0b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:52.094 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.088+0000 7f6bf183e700 1 --2- 172.21.15.103:0/1590924868 >> v2:172.21.15.86:3300/0 conn(0x7f6bec062170 0x7f6bec0b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:52.094 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.088+0000 7f6bf183e700 1 -- 172.21.15.103:0/1590924868 >> v1:172.21.15.86:6789/0 conn(0x7f6bec0b5210 legacy=0x7f6bec156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:52.094 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.088+0000 7f6bf183e700 1 -- 172.21.15.103:0/1590924868 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bec061790 con 0x7f6bec152a90 2020-04-22T14:17:52.094 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.088+0000 7f6bf103d700 1 --2- 172.21.15.103:0/1590924868 >> v2:172.21.15.86:3300/0 conn(0x7f6bec062170 0x7f6bec0b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:17:52.094 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.088+0000 7f6bf183e700 1 --2- 172.21.15.103:0/1590924868 >> v2:172.21.15.103:3300/0 conn(0x7f6bec152a90 0x7f6bec0b44d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6bec0ad5a0 tx=0x7f6be8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:52.094 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.088+0000 7f6bf183e700 1 --2- 172.21.15.103:0/1590924868 >> v2:172.21.15.103:3300/0 conn(0x7f6bec152a90 0x7f6bec0b44d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6bec0ad5a0 tx=0x7f6be8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:52.094 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.088+0000 7f6bf183e700 1 --2- 172.21.15.103:0/1590924868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bec152a90 0x7f6bec0b44d0 secure :-1 s=READY pgs=1917 cs=0 l=1 rx=0x7f6bec0ad5a0 tx=0x7f6be8007dc0).ready entity=mon.1 client_cookie=49088b9e7bebc8d4 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:52.094 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.088+0000 7f6bf183e700 1 --2- 172.21.15.103:0/1590924868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bec152a90 0x7f6bec0b44d0 secure :-1 s=THROTTLE_DONE pgs=1917 cs=0 l=1 rx=0x7f6bec0ad5a0 tx=0x7f6be8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:52.095 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.088+0000 7f6bf083c700 1 -- 172.21.15.103:0/1590924868 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6be800a180 con 0x7f6bec152a90 2020-04-22T14:17:52.095 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.088+0000 7f6bf183e700 1 --2- 172.21.15.103:0/1590924868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bec152a90 0x7f6bec0b44d0 secure :-1 s=THROTTLE_DONE pgs=1917 cs=0 l=1 rx=0x7f6bec0ad5a0 tx=0x7f6be8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:52.095 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.088+0000 7f6bf183e700 1 --2- 172.21.15.103:0/1590924868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bec152a90 0x7f6bec0b44d0 secure :-1 s=THROTTLE_DONE pgs=1917 cs=0 l=1 rx=0x7f6bec0ad5a0 tx=0x7f6be8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:52.095 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.088+0000 7f6bf083c700 1 -- 172.21.15.103:0/1590924868 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be800a2e0 con 0x7f6bec152a90 2020-04-22T14:17:52.095 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.088+0000 7f6bf083c700 1 -- 172.21.15.103:0/1590924868 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6be800a6c0 con 0x7f6bec152a90 2020-04-22T14:17:52.095 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.088+0000 7f6bf32a1700 1 -- 172.21.15.103:0/1590924868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bec152a90 msgr2=0x7f6bec0b44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:52.095 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.088+0000 7f6bf32a1700 1 --2- 172.21.15.103:0/1590924868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bec152a90 0x7f6bec0b44d0 secure :-1 s=READY pgs=1917 cs=0 l=1 rx=0x7f6bec0ad5a0 tx=0x7f6be8007dc0).stop 2020-04-22T14:17:52.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.089+0000 7f6bf32a1700 1 -- 172.21.15.103:0/1590924868 shutdown_connections 2020-04-22T14:17:52.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.089+0000 7f6bf32a1700 1 --2- 172.21.15.103:0/1590924868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bec152a90 0x7f6bec0b44d0 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:52.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.089+0000 7f6bf32a1700 1 --2- 172.21.15.103:0/1590924868 >> v2:172.21.15.86:3300/0 conn(0x7f6bec062170 0x7f6bec0b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:52.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.089+0000 7f6bf32a1700 1 -- 172.21.15.103:0/1590924868 >> 172.21.15.103:0/1590924868 conn(0x7f6bec05ad30 msgr2=0x7f6bec05b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:52.097 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.089+0000 7f6bf32a1700 1 -- 172.21.15.103:0/1590924868 shutdown_connections 2020-04-22T14:17:52.097 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.089+0000 7f6bf32a1700 1 -- 172.21.15.103:0/1590924868 wait complete. 2020-04-22T14:17:52.100 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.090+0000 7f6bf32a1700 1 Processor -- start 2020-04-22T14:17:52.101 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.090+0000 7f6bf32a1700 1 -- start start 2020-04-22T14:17:52.101 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.091+0000 7f6bf32a1700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6bec062170 0x7f6bec1540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:52.101 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.091+0000 7f6bf32a1700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6bec152a90 0x7f6bec0b4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:52.101 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.091+0000 7f6bf32a1700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bec1536d0 con 0x7f6bec0b5210 2020-04-22T14:17:52.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.091+0000 7f6bf32a1700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bec1534c0 con 0x7f6bec152a90 2020-04-22T14:17:52.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.091+0000 7f6bf32a1700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec153970 con 0x7f6bec062170 2020-04-22T14:17:52.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.091+0000 7f6bf103d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f6bec0b5210 0x7f6bec139880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49794/0 (socket says 172.21.15.103:49794) 2020-04-22T14:17:52.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.091+0000 7f6bf103d700 1 -- 172.21.15.103:0/2017773009 learned_addr learned my addr 172.21.15.103:0/2017773009 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:17:52.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.091+0000 7f6bf183e700 1 --2- 172.21.15.103:0/2017773009 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6bec062170 0x7f6bec1540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:52.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.091+0000 7f6bf203f700 1 --2- 172.21.15.103:0/2017773009 >> v2:172.21.15.86:3300/0 conn(0x7f6bec152a90 0x7f6bec0b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:52.102 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.091+0000 7f6be27fc700 1 -- 172.21.15.103:0/2017773009 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2628252789 0 0) 0x7f6bec1536d0 con 0x7f6bec0b5210 2020-04-22T14:17:52.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.091+0000 7f6be27fc700 1 -- 172.21.15.103:0/2017773009 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bd4003230 con 0x7f6bec0b5210 2020-04-22T14:17:52.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.091+0000 7f6be27fc700 1 -- 172.21.15.103:0/2017773009 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2728101611 0 0) 0x7f6bd4003230 con 0x7f6bec0b5210 2020-04-22T14:17:52.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.091+0000 7f6be27fc700 1 -- 172.21.15.103:0/2017773009 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6bec1536d0 con 0x7f6bec0b5210 2020-04-22T14:17:52.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.091+0000 7f6be27fc700 1 -- 172.21.15.103:0/2017773009 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f6bdc0026d0 con 0x7f6bec0b5210 2020-04-22T14:17:52.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.091+0000 7f6bf203f700 1 -- 172.21.15.103:0/2017773009 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6bec062170 msgr2=0x7f6bec1540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:52.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.091+0000 7f6bf203f700 1 --2- 172.21.15.103:0/2017773009 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6bec062170 0x7f6bec1540b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:52.103 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.091+0000 7f6bf203f700 1 -- 172.21.15.103:0/2017773009 >> v1:172.21.15.103:6789/0 conn(0x7f6bec0b5210 legacy=0x7f6bec139880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:52.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.091+0000 7f6bf203f700 1 -- 172.21.15.103:0/2017773009 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bec153c10 con 0x7f6bec152a90 2020-04-22T14:17:52.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.091+0000 7f6bf183e700 1 --2- 172.21.15.103:0/2017773009 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6bec062170 0x7f6bec1540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:17:52.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.091+0000 7f6bf203f700 1 --2- 172.21.15.103:0/2017773009 >> v2:172.21.15.86:3300/0 conn(0x7f6bec152a90 0x7f6bec0b4400 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6be4001f50 tx=0x7f6be40107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:52.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.091+0000 7f6bf203f700 1 --2- 172.21.15.103:0/2017773009 >> v2:172.21.15.86:3300/0 conn(0x7f6bec152a90 0x7f6bec0b4400 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6be4001f50 tx=0x7f6be40107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:52.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.091+0000 7f6bf203f700 1 --2- 172.21.15.103:0/2017773009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bec152a90 0x7f6bec0b4400 secure :-1 s=READY pgs=1016 cs=0 l=1 rx=0x7f6be4001f50 tx=0x7f6be40107d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:52.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.092+0000 7f6bf203f700 1 --2- 172.21.15.103:0/2017773009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bec152a90 0x7f6bec0b4400 secure :-1 s=THROTTLE_DONE pgs=1016 cs=0 l=1 rx=0x7f6be4001f50 tx=0x7f6be40107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:52.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.092+0000 7f6be27fc700 1 -- 172.21.15.103:0/2017773009 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6be40069b0 con 0x7f6bec152a90 2020-04-22T14:17:52.104 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.092+0000 7f6bf203f700 1 --2- 172.21.15.103:0/2017773009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bec152a90 0x7f6bec0b4400 secure :-1 s=THROTTLE_DONE pgs=1016 cs=0 l=1 rx=0x7f6be4001f50 tx=0x7f6be40107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:52.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.092+0000 7f6bf32a1700 1 -- 172.21.15.103:0/2017773009 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bec154510 con 0x7f6bec152a90 2020-04-22T14:17:52.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.092+0000 7f6be27fc700 1 -- 172.21.15.103:0/2017773009 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be4006b10 con 0x7f6bec152a90 2020-04-22T14:17:52.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.092+0000 7f6bf203f700 1 --2- 172.21.15.103:0/2017773009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bec152a90 0x7f6bec0b4400 secure :-1 s=THROTTLE_DONE pgs=1016 cs=0 l=1 rx=0x7f6be4001f50 tx=0x7f6be40107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:52.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.092+0000 7f6be27fc700 1 -- 172.21.15.103:0/2017773009 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6be4008180 con 0x7f6bec152a90 2020-04-22T14:17:52.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.092+0000 7f6bf32a1700 1 -- 172.21.15.103:0/2017773009 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bec0b4860 con 0x7f6bec152a90 2020-04-22T14:17:52.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.092+0000 7f6bf203f700 1 --2- 172.21.15.103:0/2017773009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bec152a90 0x7f6bec0b4400 secure :-1 s=THROTTLE_DONE pgs=1016 cs=0 l=1 rx=0x7f6be4001f50 tx=0x7f6be40107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:52.105 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.093+0000 7f6bf32a1700 1 -- 172.21.15.103:0/2017773009 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bec056c90 con 0x7f6bec152a90 2020-04-22T14:17:52.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.093+0000 7f6be27fc700 1 -- 172.21.15.103:0/2017773009 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f6be4008400 con 0x7f6bec152a90 2020-04-22T14:17:52.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.093+0000 7f6bf203f700 1 --2- 172.21.15.103:0/2017773009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bec152a90 0x7f6bec0b4400 secure :-1 s=THROTTLE_DONE pgs=1016 cs=0 l=1 rx=0x7f6be4001f50 tx=0x7f6be40107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:52.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.093+0000 7f6be27fc700 1 --2- 172.21.15.103:0/2017773009 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6bd404df30 0x7f6bd40503f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:52.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.093+0000 7f6be27fc700 1 -- 172.21.15.103:0/2017773009 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6be4061230 con 0x7f6bec152a90 2020-04-22T14:17:52.106 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.093+0000 7f6bf183e700 1 --2- 172.21.15.103:0/2017773009 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6bd404df30 0x7f6bd40503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:52.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.093+0000 7f6bf183e700 1 --2- 172.21.15.103:0/2017773009 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6bd404df30 0x7f6bd40503f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6bec0ad5a0 tx=0x7f6be8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:52.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.094+0000 7f6bf183e700 1 --2- 172.21.15.103:0/2017773009 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6bd404df30 0x7f6bd40503f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6bec0ad5a0 tx=0x7f6be8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:52.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.094+0000 7f6bf183e700 1 --2- 172.21.15.103:0/2017773009 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6bd404df30 0x7f6bd40503f0 secure :-1 s=READY pgs=700 cs=0 l=1 rx=0x7f6bec0ad5a0 tx=0x7f6be8007dc0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:52.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.097+0000 7f6bf203f700 1 --2- 172.21.15.103:0/2017773009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bec152a90 0x7f6bec0b4400 secure :-1 s=THROTTLE_DONE pgs=1016 cs=0 l=1 rx=0x7f6be4001f50 tx=0x7f6be40107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:52.107 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.097+0000 7f6be27fc700 1 -- 172.21.15.103:0/2017773009 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f6be403c5b0 con 0x7f6bec152a90 2020-04-22T14:17:52.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.288+0000 7f6bf32a1700 1 -- 172.21.15.103:0/2017773009 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f6bec06a8b0 con 0x7f6bec152a90 2020-04-22T14:17:52.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.291+0000 7f6bf203f700 1 --2- 172.21.15.103:0/2017773009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bec152a90 0x7f6bec0b4400 secure :-1 s=THROTTLE_DONE pgs=1016 cs=0 l=1 rx=0x7f6be4001f50 tx=0x7f6be40107d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:52.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.291+0000 7f6be27fc700 1 -- 172.21.15.103:0/2017773009 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v52) v1 ==== 184+0+0 (secure 0 0 0) 0x7f6be403fbd0 con 0x7f6bec152a90 2020-04-22T14:17:52.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.293+0000 7f6bf32a1700 1 -- 172.21.15.103:0/2017773009 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6bd404df30 msgr2=0x7f6bd40503f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:52.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.293+0000 7f6bf32a1700 1 --2- 172.21.15.103:0/2017773009 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6bd404df30 0x7f6bd40503f0 secure :-1 s=READY pgs=700 cs=0 l=1 rx=0x7f6bec0ad5a0 tx=0x7f6be8007dc0).stop 2020-04-22T14:17:52.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.293+0000 7f6bf32a1700 1 -- 172.21.15.103:0/2017773009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bec152a90 msgr2=0x7f6bec0b4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:52.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.293+0000 7f6bf32a1700 1 --2- 172.21.15.103:0/2017773009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bec152a90 0x7f6bec0b4400 secure :-1 s=READY pgs=1016 cs=0 l=1 rx=0x7f6be4001f50 tx=0x7f6be40107d0).stop 2020-04-22T14:17:52.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.293+0000 7f6bf32a1700 1 -- 172.21.15.103:0/2017773009 shutdown_connections 2020-04-22T14:17:52.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.293+0000 7f6bf32a1700 1 --2- 172.21.15.103:0/2017773009 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6bd404df30 0x7f6bd40503f0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:52.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.293+0000 7f6bf32a1700 1 --2- 172.21.15.103:0/2017773009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bec152a90 0x7f6bec0b4400 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:52.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.293+0000 7f6bf32a1700 1 --2- 172.21.15.103:0/2017773009 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6bec062170 0x7f6bec1540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:52.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.293+0000 7f6bf32a1700 1 -- 172.21.15.103:0/2017773009 >> 172.21.15.103:0/2017773009 conn(0x7f6bec05ad30 msgr2=0x7f6bec129ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:52.297 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.293+0000 7f6bf32a1700 1 -- 172.21.15.103:0/2017773009 shutdown_connections 2020-04-22T14:17:52.297 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.293+0000 7f6bf32a1700 1 -- 172.21.15.103:0/2017773009 wait complete. 2020-04-22T14:17:52.297 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.3 2020-04-22T14:17:52.305 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:52.319 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:17:52.464 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.462+0000 7f1ce4d5f700 1 Processor -- start 2020-04-22T14:17:52.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.462+0000 7f1ce4d5f700 1 -- start start 2020-04-22T14:17:52.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.463+0000 7f1ce4d5f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1ce012c0d0 0x7f1ce01464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:52.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.463+0000 7f1ce4d5f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1ce0063e30 0x7f1ce00642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:52.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.463+0000 7f1ce4d5f700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce0143300 con 0x7f1ce0065fe0 2020-04-22T14:17:52.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.463+0000 7f1ce4d5f700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce01435a0 con 0x7f1ce012c0d0 2020-04-22T14:17:52.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.463+0000 7f1ce4d5f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce0143840 con 0x7f1ce0063e30 2020-04-22T14:17:52.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.463+0000 7f1cded9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1ce0063e30 0x7f1ce00642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:52.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.463+0000 7f1cded9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1ce0063e30 0x7f1ce00642c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57610/0 (socket says 172.21.15.103:57610) 2020-04-22T14:17:52.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.463+0000 7f1cded9d700 1 -- 172.21.15.103:0/4280926459 learned_addr learned my addr 172.21.15.103:0/4280926459 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:52.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.464+0000 7f1cde59c700 1 --2- 172.21.15.103:0/4280926459 >> v2:172.21.15.86:3300/0 conn(0x7f1ce012c0d0 0x7f1ce01464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:52.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.464+0000 7f1cded9d700 1 -- 172.21.15.103:0/4280926459 >> v2:172.21.15.86:3300/0 conn(0x7f1ce012c0d0 msgr2=0x7f1ce01464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:52.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.464+0000 7f1cded9d700 1 --2- 172.21.15.103:0/4280926459 >> v2:172.21.15.86:3300/0 conn(0x7f1ce012c0d0 0x7f1ce01464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:52.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.464+0000 7f1cded9d700 1 -- 172.21.15.103:0/4280926459 >> v1:172.21.15.86:6789/0 conn(0x7f1ce0065fe0 legacy=0x7f1ce005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:52.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.464+0000 7f1cded9d700 1 -- 172.21.15.103:0/4280926459 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce005bb50 con 0x7f1ce0063e30 2020-04-22T14:17:52.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.464+0000 7f1cded9d700 1 --2- 172.21.15.103:0/4280926459 >> v2:172.21.15.103:3300/0 conn(0x7f1ce0063e30 0x7f1ce00642c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1ce00669a0 tx=0x7f1cd0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:52.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.464+0000 7f1cded9d700 1 --2- 172.21.15.103:0/4280926459 >> v2:172.21.15.103:3300/0 conn(0x7f1ce0063e30 0x7f1ce00642c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1ce00669a0 tx=0x7f1cd0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:52.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.464+0000 7f1cded9d700 1 --2- 172.21.15.103:0/4280926459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ce0063e30 0x7f1ce00642c0 secure :-1 s=READY pgs=1919 cs=0 l=1 rx=0x7f1ce00669a0 tx=0x7f1cd0007a40).ready entity=mon.1 client_cookie=68bc9c1bca68e620 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:52.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.464+0000 7f1cded9d700 1 --2- 172.21.15.103:0/4280926459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ce0063e30 0x7f1ce00642c0 secure :-1 s=THROTTLE_DONE pgs=1919 cs=0 l=1 rx=0x7f1ce00669a0 tx=0x7f1cd0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:52.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.464+0000 7f1cded9d700 1 --2- 172.21.15.103:0/4280926459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ce0063e30 0x7f1ce00642c0 secure :-1 s=THROTTLE_DONE pgs=1919 cs=0 l=1 rx=0x7f1ce00669a0 tx=0x7f1cd0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:52.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.464+0000 7f1cdd59a700 1 -- 172.21.15.103:0/4280926459 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cd00116e0 con 0x7f1ce0063e30 2020-04-22T14:17:52.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.464+0000 7f1cded9d700 1 --2- 172.21.15.103:0/4280926459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ce0063e30 0x7f1ce00642c0 secure :-1 s=THROTTLE_DONE pgs=1919 cs=0 l=1 rx=0x7f1ce00669a0 tx=0x7f1cd0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:52.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.464+0000 7f1cdd59a700 1 -- 172.21.15.103:0/4280926459 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd0011840 con 0x7f1ce0063e30 2020-04-22T14:17:52.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.464+0000 7f1cdd59a700 1 -- 172.21.15.103:0/4280926459 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cd0011c20 con 0x7f1ce0063e30 2020-04-22T14:17:52.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.464+0000 7f1ce4d5f700 1 -- 172.21.15.103:0/4280926459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ce0063e30 msgr2=0x7f1ce00642c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:52.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.464+0000 7f1ce4d5f700 1 --2- 172.21.15.103:0/4280926459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ce0063e30 0x7f1ce00642c0 secure :-1 s=READY pgs=1919 cs=0 l=1 rx=0x7f1ce00669a0 tx=0x7f1cd0007a40).stop 2020-04-22T14:17:52.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.465+0000 7f1ce4d5f700 1 -- 172.21.15.103:0/4280926459 shutdown_connections 2020-04-22T14:17:52.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.465+0000 7f1ce4d5f700 1 --2- 172.21.15.103:0/4280926459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ce0063e30 0x7f1ce00642c0 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:52.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.465+0000 7f1ce4d5f700 1 --2- 172.21.15.103:0/4280926459 >> v2:172.21.15.86:3300/0 conn(0x7f1ce012c0d0 0x7f1ce01464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:52.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.465+0000 7f1ce4d5f700 1 -- 172.21.15.103:0/4280926459 >> 172.21.15.103:0/4280926459 conn(0x7f1ce00b9160 msgr2=0x7f1ce005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:52.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.465+0000 7f1ce4d5f700 1 -- 172.21.15.103:0/4280926459 shutdown_connections 2020-04-22T14:17:52.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.465+0000 7f1ce4d5f700 1 -- 172.21.15.103:0/4280926459 wait complete. 2020-04-22T14:17:52.476 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.466+0000 7f1ce4d5f700 1 Processor -- start 2020-04-22T14:17:52.476 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.466+0000 7f1ce4d5f700 1 -- start start 2020-04-22T14:17:52.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.466+0000 7f1ce4d5f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1ce0065fe0 0x7f1ce00b5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:52.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.466+0000 7f1ce4d5f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ce012c0d0 0x7f1ce00b55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:52.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.466+0000 7f1ce4d5f700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce0155d80 con 0x7f1ce0063e30 2020-04-22T14:17:52.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.466+0000 7f1ce4d5f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce00afca0 con 0x7f1ce0065fe0 2020-04-22T14:17:52.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.466+0000 7f1ce4d5f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce00af190 con 0x7f1ce012c0d0 2020-04-22T14:17:52.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.466+0000 7f1cddd9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1ce0065fe0 0x7f1ce00b5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:52.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.466+0000 7f1cde59c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f1ce0063e30 0x7f1ce00aea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49802/0 (socket says 172.21.15.103:49802) 2020-04-22T14:17:52.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.466+0000 7f1cddd9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1ce0065fe0 0x7f1ce00b5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57614/0 (socket says 172.21.15.103:57614) 2020-04-22T14:17:52.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.466+0000 7f1cde59c700 1 -- 172.21.15.103:0/2269246937 learned_addr learned my addr 172.21.15.103:0/2269246937 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:17:52.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.466+0000 7f1cded9d700 1 --2- 172.21.15.103:0/2269246937 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ce012c0d0 0x7f1ce00b55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:52.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.467+0000 7f1cddd9b700 1 -- 172.21.15.103:0/2269246937 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ce012c0d0 msgr2=0x7f1ce00b55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:52.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.467+0000 7f1cddd9b700 1 --2- 172.21.15.103:0/2269246937 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ce012c0d0 0x7f1ce00b55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:52.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.467+0000 7f1cddd9b700 1 -- 172.21.15.103:0/2269246937 >> v1:172.21.15.103:6789/0 conn(0x7f1ce0063e30 legacy=0x7f1ce00aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:52.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.467+0000 7f1cd77fe700 1 -- 172.21.15.103:0/2269246937 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1009235788 0 0) 0x7f1ce0155d80 con 0x7f1ce0063e30 2020-04-22T14:17:52.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.467+0000 7f1cddd9b700 1 -- 172.21.15.103:0/2269246937 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce0155ae0 con 0x7f1ce0065fe0 2020-04-22T14:17:52.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.467+0000 7f1cddd9b700 1 --2- 172.21.15.103:0/2269246937 >> v2:172.21.15.103:3300/0 conn(0x7f1ce0065fe0 0x7f1ce00b5140 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1cc8001f50 tx=0x7f1cc8010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:52.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.467+0000 7f1cddd9b700 1 --2- 172.21.15.103:0/2269246937 >> v2:172.21.15.103:3300/0 conn(0x7f1ce0065fe0 0x7f1ce00b5140 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1cc8001f50 tx=0x7f1cc8010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:52.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.467+0000 7f1cddd9b700 1 --2- 172.21.15.103:0/2269246937 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ce0065fe0 0x7f1ce00b5140 secure :-1 s=READY pgs=1921 cs=0 l=1 rx=0x7f1cc8001f50 tx=0x7f1cc8010900).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:52.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.467+0000 7f1cddd9b700 1 --2- 172.21.15.103:0/2269246937 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ce0065fe0 0x7f1ce00b5140 secure :-1 s=THROTTLE_DONE pgs=1921 cs=0 l=1 rx=0x7f1cc8001f50 tx=0x7f1cc8010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:52.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.467+0000 7f1cd77fe700 1 -- 172.21.15.103:0/2269246937 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cc8006bc0 con 0x7f1ce0065fe0 2020-04-22T14:17:52.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.467+0000 7f1cddd9b700 1 --2- 172.21.15.103:0/2269246937 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ce0065fe0 0x7f1ce00b5140 secure :-1 s=THROTTLE_DONE pgs=1921 cs=0 l=1 rx=0x7f1cc8001f50 tx=0x7f1cc8010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:52.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.467+0000 7f1cd77fe700 1 -- 172.21.15.103:0/2269246937 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc8006d20 con 0x7f1ce0065fe0 2020-04-22T14:17:52.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.467+0000 7f1ce4d5f700 1 -- 172.21.15.103:0/2269246937 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce0127930 con 0x7f1ce0065fe0 2020-04-22T14:17:52.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.467+0000 7f1cddd9b700 1 --2- 172.21.15.103:0/2269246937 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ce0065fe0 0x7f1ce00b5140 secure :-1 s=THROTTLE_DONE pgs=1921 cs=0 l=1 rx=0x7f1cc8001f50 tx=0x7f1cc8010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:52.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.467+0000 7f1cd77fe700 1 -- 172.21.15.103:0/2269246937 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cc8006e90 con 0x7f1ce0065fe0 2020-04-22T14:17:52.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.467+0000 7f1ce4d5f700 1 -- 172.21.15.103:0/2269246937 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce0155760 con 0x7f1ce0065fe0 2020-04-22T14:17:52.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.468+0000 7f1cddd9b700 1 --2- 172.21.15.103:0/2269246937 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ce0065fe0 0x7f1ce00b5140 secure :-1 s=THROTTLE_DONE pgs=1921 cs=0 l=1 rx=0x7f1cc8001f50 tx=0x7f1cc8010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:52.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.468+0000 7f1cd77fe700 1 -- 172.21.15.103:0/2269246937 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f1cc8008370 con 0x7f1ce0065fe0 2020-04-22T14:17:52.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.468+0000 7f1cddd9b700 1 --2- 172.21.15.103:0/2269246937 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ce0065fe0 0x7f1ce00b5140 secure :-1 s=THROTTLE_DONE pgs=1921 cs=0 l=1 rx=0x7f1cc8001f50 tx=0x7f1cc8010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:52.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.468+0000 7f1ce4d5f700 1 -- 172.21.15.103:0/2269246937 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ce0127ac0 con 0x7f1ce0065fe0 2020-04-22T14:17:52.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.468+0000 7f1cd77fe700 1 --2- 172.21.15.103:0/2269246937 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1cc404d8c0 0x7f1cc404fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:52.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.468+0000 7f1cd77fe700 1 -- 172.21.15.103:0/2269246937 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1cc8061590 con 0x7f1ce0065fe0 2020-04-22T14:17:52.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.468+0000 7f1cde59c700 1 --2- 172.21.15.103:0/2269246937 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1cc404d8c0 0x7f1cc404fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:52.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.469+0000 7f1cde59c700 1 --2- 172.21.15.103:0/2269246937 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1cc404d8c0 0x7f1cc404fd80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1cd8007dc0 tx=0x7f1cd80026e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:52.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.469+0000 7f1cde59c700 1 --2- 172.21.15.103:0/2269246937 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1cc404d8c0 0x7f1cc404fd80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1cd8007dc0 tx=0x7f1cd80026e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:52.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.469+0000 7f1cde59c700 1 --2- 172.21.15.103:0/2269246937 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1cc404d8c0 0x7f1cc404fd80 secure :-1 s=READY pgs=701 cs=0 l=1 rx=0x7f1cd8007dc0 tx=0x7f1cd80026e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:52.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.472+0000 7f1cddd9b700 1 --2- 172.21.15.103:0/2269246937 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ce0065fe0 0x7f1ce00b5140 secure :-1 s=THROTTLE_DONE pgs=1921 cs=0 l=1 rx=0x7f1cc8001f50 tx=0x7f1cc8010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:52.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.472+0000 7f1cd77fe700 1 -- 172.21.15.103:0/2269246937 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f1cc803c910 con 0x7f1ce0065fe0 2020-04-22T14:17:52.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.664+0000 7f1ce4d5f700 1 -- 172.21.15.103:0/2269246937 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ce0056c90 con 0x7f1ce0065fe0 2020-04-22T14:17:52.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.664+0000 7f1cddd9b700 1 --2- 172.21.15.103:0/2269246937 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ce0065fe0 0x7f1ce00b5140 secure :-1 s=THROTTLE_DONE pgs=1921 cs=0 l=1 rx=0x7f1cc8001f50 tx=0x7f1cc8010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:52.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.664+0000 7f1cd77fe700 1 -- 172.21.15.103:0/2269246937 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+2141 (secure 0 0 0) 0x7f1cc803ff30 con 0x7f1ce0065fe0 2020-04-22T14:17:52.667 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:17:52.667 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":101,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6539,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1045362246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1045362246},{"type":"v1","addr":"172.21.15.86:6835","nonce":1045362246}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":97}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:17:48.006467+0000","modified":"2020-04-22T14:17:50.019789+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9277":{"gid":9277,"name":"a","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/33849566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":33849566},{"type":"v1","addr":"172.21.15.103:6833","nonce":33849566}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2020-04-22T14:17:52.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.665+0000 7f1ce4d5f700 1 -- 172.21.15.103:0/2269246937 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1cc404d8c0 msgr2=0x7f1cc404fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:52.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.665+0000 7f1ce4d5f700 1 --2- 172.21.15.103:0/2269246937 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1cc404d8c0 0x7f1cc404fd80 secure :-1 s=READY pgs=701 cs=0 l=1 rx=0x7f1cd8007dc0 tx=0x7f1cd80026e0).stop 2020-04-22T14:17:52.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.665+0000 7f1ce4d5f700 1 -- 172.21.15.103:0/2269246937 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ce0065fe0 msgr2=0x7f1ce00b5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:52.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.665+0000 7f1ce4d5f700 1 --2- 172.21.15.103:0/2269246937 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ce0065fe0 0x7f1ce00b5140 secure :-1 s=READY pgs=1921 cs=0 l=1 rx=0x7f1cc8001f50 tx=0x7f1cc8010900).stop 2020-04-22T14:17:52.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.665+0000 7f1ce4d5f700 1 -- 172.21.15.103:0/2269246937 shutdown_connections 2020-04-22T14:17:52.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.666+0000 7f1ce4d5f700 1 --2- 172.21.15.103:0/2269246937 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1cc404d8c0 0x7f1cc404fd80 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:52.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.666+0000 7f1ce4d5f700 1 --2- 172.21.15.103:0/2269246937 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ce012c0d0 0x7f1ce00b55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:52.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.666+0000 7f1ce4d5f700 1 --2- 172.21.15.103:0/2269246937 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ce0065fe0 0x7f1ce00b5140 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:52.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.666+0000 7f1ce4d5f700 1 -- 172.21.15.103:0/2269246937 >> 172.21.15.103:0/2269246937 conn(0x7f1ce00b9160 msgr2=0x7f1ce0061770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:52.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.666+0000 7f1ce4d5f700 1 -- 172.21.15.103:0/2269246937 shutdown_connections 2020-04-22T14:17:52.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:52.666+0000 7f1ce4d5f700 1 -- 172.21.15.103:0/2269246937 wait complete. 2020-04-22T14:17:52.670 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 101 2020-04-22T14:17:52.883 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 9277}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 23, u'failed': [], u'epoch': 101, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [24], u'info': {u'gid_9277': {u'export_targets': [], u'name': u'a', u'incarnation': 98, u'state_seq': 3, u'state': u'up:active', u'gid': 9277, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 33849566, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 33849566, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/33849566'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:17:48.006467+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:17:50.019789+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:17:52.883 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:17:52.883 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:52.898 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:17:53.058 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:17:53.058 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:17:53.058 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:17:53.058 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 9277, 2020-04-22T14:17:53.058 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:17:53.059 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:17:53.059 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 5.0481906600000004, 2020-04-22T14:17:53.059 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 101, 2020-04-22T14:17:53.059 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 135, 2020-04-22T14:17:53.059 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 135, 2020-04-22T14:17:53.060 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 10.262280709000001 2020-04-22T14:17:53.060 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:17:53.067 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 9277, "want_state": "up:active", "state": "up:active", "rank_uptime": 5.0481906600000004, "mdsmap_epoch": 101, "osdmap_epoch": 135, "osdmap_epoch_barrier": 135, "uptime": 10.262280709000001 } 2020-04-22T14:17:53.067 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:53.080 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:17:53.227 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.224+0000 7f4fceac6700 1 Processor -- start 2020-04-22T14:17:53.227 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.224+0000 7f4fceac6700 1 -- start start 2020-04-22T14:17:53.238 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.225+0000 7f4fceac6700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4fc812c0d0 0x7f4fc81464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:53.238 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.225+0000 7f4fceac6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4fc8065fe0 0x7f4fc805b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:53.238 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.225+0000 7f4fceac6700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4fc805b8a0 0x7f4fc8062ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:53.238 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.225+0000 7f4fceac6700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc812c4b0 con 0x7f4fc812c0d0 2020-04-22T14:17:53.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.225+0000 7f4fceac6700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc8143300 con 0x7f4fc805b8a0 2020-04-22T14:17:53.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.225+0000 7f4fceac6700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc81435a0 con 0x7f4fc8065fe0 2020-04-22T14:17:53.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.225+0000 7f4fcd063700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4fc805b8a0 0x7f4fc8062ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:53.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.225+0000 7f4fcd063700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4fc805b8a0 0x7f4fc8062ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57620/0 (socket says 172.21.15.103:57620) 2020-04-22T14:17:53.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.225+0000 7f4fcd063700 1 -- 172.21.15.103:0/2735536082 learned_addr learned my addr 172.21.15.103:0/2735536082 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:53.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.225+0000 7f4fcc862700 1 --2- 172.21.15.103:0/2735536082 >> v2:172.21.15.86:3300/0 conn(0x7f4fc812c0d0 0x7f4fc81464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:53.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.225+0000 7f4fc7fff700 1 --2- 172.21.15.103:0/2735536082 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4fc8065fe0 0x7f4fc805b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:53.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.225+0000 7f4fcd063700 1 -- 172.21.15.103:0/2735536082 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4fc8065fe0 msgr2=0x7f4fc805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:53.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.225+0000 7f4fcd063700 1 --2- 172.21.15.103:0/2735536082 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4fc8065fe0 0x7f4fc805b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:53.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.225+0000 7f4fcd063700 1 -- 172.21.15.103:0/2735536082 >> v2:172.21.15.86:3300/0 conn(0x7f4fc812c0d0 msgr2=0x7f4fc81464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:53.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.225+0000 7f4fcd063700 1 --2- 172.21.15.103:0/2735536082 >> v2:172.21.15.86:3300/0 conn(0x7f4fc812c0d0 0x7f4fc81464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:53.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.225+0000 7f4fcd063700 1 -- 172.21.15.103:0/2735536082 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc8143840 con 0x7f4fc805b8a0 2020-04-22T14:17:53.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.225+0000 7f4fcc862700 1 --2- 172.21.15.103:0/2735536082 >> v2:172.21.15.86:3300/0 conn(0x7f4fc812c0d0 0x7f4fc81464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:17:53.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.225+0000 7f4fcd063700 1 --2- 172.21.15.103:0/2735536082 >> v2:172.21.15.103:3300/0 conn(0x7f4fc805b8a0 0x7f4fc8062ab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4fb8002f30 tx=0x7f4fb8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.225+0000 7f4fcd063700 1 --2- 172.21.15.103:0/2735536082 >> v2:172.21.15.103:3300/0 conn(0x7f4fc805b8a0 0x7f4fc8062ab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4fb8002f30 tx=0x7f4fb8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.225+0000 7f4fcd063700 1 --2- 172.21.15.103:0/2735536082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fc805b8a0 0x7f4fc8062ab0 secure :-1 s=READY pgs=1922 cs=0 l=1 rx=0x7f4fb8002f30 tx=0x7f4fb8007a40).ready entity=mon.1 client_cookie=39d5bafe1678c60b server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:53.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.225+0000 7f4fcd063700 1 --2- 172.21.15.103:0/2735536082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fc805b8a0 0x7f4fc8062ab0 secure :-1 s=THROTTLE_DONE pgs=1922 cs=0 l=1 rx=0x7f4fb8002f30 tx=0x7f4fb8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.226+0000 7f4fc77fe700 1 -- 172.21.15.103:0/2735536082 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fb8011720 con 0x7f4fc805b8a0 2020-04-22T14:17:53.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.226+0000 7f4fcd063700 1 --2- 172.21.15.103:0/2735536082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fc805b8a0 0x7f4fc8062ab0 secure :-1 s=THROTTLE_DONE pgs=1922 cs=0 l=1 rx=0x7f4fb8002f30 tx=0x7f4fb8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.226+0000 7f4fcd063700 1 --2- 172.21.15.103:0/2735536082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fc805b8a0 0x7f4fc8062ab0 secure :-1 s=THROTTLE_DONE pgs=1922 cs=0 l=1 rx=0x7f4fb8002f30 tx=0x7f4fb8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.226+0000 7f4fc77fe700 1 -- 172.21.15.103:0/2735536082 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb8011880 con 0x7f4fc805b8a0 2020-04-22T14:17:53.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.226+0000 7f4fc77fe700 1 -- 172.21.15.103:0/2735536082 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fb8011ca0 con 0x7f4fc805b8a0 2020-04-22T14:17:53.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.226+0000 7f4fceac6700 1 -- 172.21.15.103:0/2735536082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fc805b8a0 msgr2=0x7f4fc8062ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:53.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.226+0000 7f4fceac6700 1 --2- 172.21.15.103:0/2735536082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fc805b8a0 0x7f4fc8062ab0 secure :-1 s=READY pgs=1922 cs=0 l=1 rx=0x7f4fb8002f30 tx=0x7f4fb8007a40).stop 2020-04-22T14:17:53.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.226+0000 7f4fceac6700 1 -- 172.21.15.103:0/2735536082 shutdown_connections 2020-04-22T14:17:53.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.226+0000 7f4fceac6700 1 --2- 172.21.15.103:0/2735536082 >> v2:172.21.15.86:3300/0 conn(0x7f4fc812c0d0 0x7f4fc81464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:53.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.226+0000 7f4fceac6700 1 --2- 172.21.15.103:0/2735536082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fc805b8a0 0x7f4fc8062ab0 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:53.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.226+0000 7f4fceac6700 1 --2- 172.21.15.103:0/2735536082 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4fc8065fe0 0x7f4fc805b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:53.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.226+0000 7f4fceac6700 1 -- 172.21.15.103:0/2735536082 >> 172.21.15.103:0/2735536082 conn(0x7f4fc80b9160 msgr2=0x7f4fc805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:53.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.226+0000 7f4fceac6700 1 -- 172.21.15.103:0/2735536082 shutdown_connections 2020-04-22T14:17:53.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.226+0000 7f4fceac6700 1 -- 172.21.15.103:0/2735536082 wait complete. 2020-04-22T14:17:53.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.227+0000 7f4fceac6700 1 Processor -- start 2020-04-22T14:17:53.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.227+0000 7f4fceac6700 1 -- start start 2020-04-22T14:17:53.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.228+0000 7f4fceac6700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4fc805b8a0 0x7f4fc80af310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:53.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.228+0000 7f4fceac6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4fc8065fe0 0x7f4fc81508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:53.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.228+0000 7f4fceac6700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc80af770 con 0x7f4fc812c0d0 2020-04-22T14:17:53.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.228+0000 7f4fceac6700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc8151290 con 0x7f4fc805b8a0 2020-04-22T14:17:53.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.228+0000 7f4fceac6700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc8151530 con 0x7f4fc8065fe0 2020-04-22T14:17:53.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.228+0000 7f4fcd063700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f4fc812c0d0 0x7f4fc80ae5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49818/0 (socket says 172.21.15.103:49818) 2020-04-22T14:17:53.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.228+0000 7f4fcd063700 1 -- 172.21.15.103:0/1114712701 learned_addr learned my addr 172.21.15.103:0/1114712701 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:17:53.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.228+0000 7f4fcc862700 1 --2- 172.21.15.103:0/1114712701 >> v2:172.21.15.86:3300/0 conn(0x7f4fc805b8a0 0x7f4fc80af310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:53.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.228+0000 7f4fc7fff700 1 --2- 172.21.15.103:0/1114712701 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4fc8065fe0 0x7f4fc81508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:53.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.228+0000 7f4fc5ffb700 1 -- 172.21.15.103:0/1114712701 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1669300113 0 0) 0x7f4fc8143840 con 0x7f4fc812c0d0 2020-04-22T14:17:53.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.228+0000 7f4fc5ffb700 1 -- 172.21.15.103:0/1114712701 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fa8002fe0 con 0x7f4fc812c0d0 2020-04-22T14:17:53.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.228+0000 7f4fcc862700 1 -- 172.21.15.103:0/1114712701 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4fc8065fe0 msgr2=0x7f4fc81508d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:53.261 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.228+0000 7f4fcc862700 1 --2- 172.21.15.103:0/1114712701 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4fc8065fe0 0x7f4fc81508d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:53.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.228+0000 7f4fcc862700 1 -- 172.21.15.103:0/1114712701 >> v1:172.21.15.103:6789/0 conn(0x7f4fc812c0d0 legacy=0x7f4fc80ae5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:53.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.228+0000 7f4fc5ffb700 1 -- 172.21.15.103:0/1114712701 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 475693654 0 0) 0x7f4fa8002fe0 con 0x7f4fc812c0d0 2020-04-22T14:17:53.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.228+0000 7f4fcc862700 1 -- 172.21.15.103:0/1114712701 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc81517d0 con 0x7f4fc805b8a0 2020-04-22T14:17:53.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.228+0000 7f4fcc862700 1 --2- 172.21.15.103:0/1114712701 >> v2:172.21.15.86:3300/0 conn(0x7f4fc805b8a0 0x7f4fc80af310 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4fb8008780 tx=0x7f4fc0010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.228+0000 7f4fc7fff700 1 --2- 172.21.15.103:0/1114712701 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4fc8065fe0 0x7f4fc81508d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:17:53.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.229+0000 7f4fcc862700 1 --2- 172.21.15.103:0/1114712701 >> v2:172.21.15.86:3300/0 conn(0x7f4fc805b8a0 0x7f4fc80af310 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4fb8008780 tx=0x7f4fc0010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.262 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.229+0000 7f4fcc862700 1 --2- 172.21.15.103:0/1114712701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fc805b8a0 0x7f4fc80af310 secure :-1 s=READY pgs=1018 cs=0 l=1 rx=0x7f4fb8008780 tx=0x7f4fc0010d50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:53.263 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.229+0000 7f4fcc862700 1 --2- 172.21.15.103:0/1114712701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fc805b8a0 0x7f4fc80af310 secure :-1 s=THROTTLE_DONE pgs=1018 cs=0 l=1 rx=0x7f4fb8008780 tx=0x7f4fc0010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.263 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.229+0000 7f4fc5ffb700 1 -- 172.21.15.103:0/1114712701 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fb80085e0 con 0x7f4fc805b8a0 2020-04-22T14:17:53.263 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.229+0000 7f4fcc862700 1 --2- 172.21.15.103:0/1114712701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fc805b8a0 0x7f4fc80af310 secure :-1 s=THROTTLE_DONE pgs=1018 cs=0 l=1 rx=0x7f4fb8008780 tx=0x7f4fc0010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.263 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.229+0000 7f4fceac6700 1 -- 172.21.15.103:0/1114712701 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc80aecb0 con 0x7f4fc805b8a0 2020-04-22T14:17:53.263 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.229+0000 7f4fc5ffb700 1 -- 172.21.15.103:0/1114712701 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc0007180 con 0x7f4fc805b8a0 2020-04-22T14:17:53.263 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.229+0000 7f4fcc862700 1 --2- 172.21.15.103:0/1114712701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fc805b8a0 0x7f4fc80af310 secure :-1 s=THROTTLE_DONE pgs=1018 cs=0 l=1 rx=0x7f4fb8008780 tx=0x7f4fc0010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.263 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.229+0000 7f4fc5ffb700 1 -- 172.21.15.103:0/1114712701 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fc00074e0 con 0x7f4fc805b8a0 2020-04-22T14:17:53.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.229+0000 7f4fceac6700 1 -- 172.21.15.103:0/1114712701 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc8150d30 con 0x7f4fc805b8a0 2020-04-22T14:17:53.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.229+0000 7f4fcc862700 1 --2- 172.21.15.103:0/1114712701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fc805b8a0 0x7f4fc80af310 secure :-1 s=THROTTLE_DONE pgs=1018 cs=0 l=1 rx=0x7f4fb8008780 tx=0x7f4fc0010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.230+0000 7f4fceac6700 1 -- 172.21.15.103:0/1114712701 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc8151090 con 0x7f4fc805b8a0 2020-04-22T14:17:53.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.230+0000 7f4fc5ffb700 1 -- 172.21.15.103:0/1114712701 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f4fc00076e0 con 0x7f4fc805b8a0 2020-04-22T14:17:53.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.230+0000 7f4fcc862700 1 --2- 172.21.15.103:0/1114712701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fc805b8a0 0x7f4fc80af310 secure :-1 s=THROTTLE_DONE pgs=1018 cs=0 l=1 rx=0x7f4fb8008780 tx=0x7f4fc0010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.230+0000 7f4fc5ffb700 1 --2- 172.21.15.103:0/1114712701 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4fa804dc70 0x7f4fa8050130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:53.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.230+0000 7f4fc5ffb700 1 -- 172.21.15.103:0/1114712701 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4fc00614d0 con 0x7f4fc805b8a0 2020-04-22T14:17:53.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.230+0000 7f4fc7fff700 1 --2- 172.21.15.103:0/1114712701 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4fa804dc70 0x7f4fa8050130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:53.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.230+0000 7f4fc7fff700 1 --2- 172.21.15.103:0/1114712701 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4fa804dc70 0x7f4fa8050130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4fbc002f30 tx=0x7f4fbc00b470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.231+0000 7f4fc7fff700 1 --2- 172.21.15.103:0/1114712701 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4fa804dc70 0x7f4fa8050130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4fbc002f30 tx=0x7f4fbc00b470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.231+0000 7f4fc7fff700 1 --2- 172.21.15.103:0/1114712701 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4fa804dc70 0x7f4fa8050130 secure :-1 s=READY pgs=702 cs=0 l=1 rx=0x7f4fbc002f30 tx=0x7f4fbc00b470).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:53.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.234+0000 7f4fcc862700 1 --2- 172.21.15.103:0/1114712701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fc805b8a0 0x7f4fc80af310 secure :-1 s=THROTTLE_DONE pgs=1018 cs=0 l=1 rx=0x7f4fb8008780 tx=0x7f4fc0010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.234+0000 7f4fc5ffb700 1 -- 172.21.15.103:0/1114712701 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f4fc003c850 con 0x7f4fc805b8a0 2020-04-22T14:17:53.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.375+0000 7f4fceac6700 1 -- 172.21.15.103:0/1114712701 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4fc8056c90 con 0x7f4fc805b8a0 2020-04-22T14:17:53.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.376+0000 7f4fcc862700 1 --2- 172.21.15.103:0/1114712701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fc805b8a0 0x7f4fc80af310 secure :-1 s=THROTTLE_DONE pgs=1018 cs=0 l=1 rx=0x7f4fb8008780 tx=0x7f4fc0010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.377+0000 7f4fc5ffb700 1 -- 172.21.15.103:0/1114712701 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+16103 (secure 0 0 0) 0x7f4fc003fe70 con 0x7f4fc805b8a0 2020-04-22T14:17:53.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.378+0000 7f4fceac6700 1 -- 172.21.15.103:0/1114712701 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4fa804dc70 msgr2=0x7f4fa8050130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:53.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.378+0000 7f4fceac6700 1 --2- 172.21.15.103:0/1114712701 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4fa804dc70 0x7f4fa8050130 secure :-1 s=READY pgs=702 cs=0 l=1 rx=0x7f4fbc002f30 tx=0x7f4fbc00b470).stop 2020-04-22T14:17:53.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.378+0000 7f4fceac6700 1 -- 172.21.15.103:0/1114712701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fc805b8a0 msgr2=0x7f4fc80af310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:53.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.378+0000 7f4fceac6700 1 --2- 172.21.15.103:0/1114712701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fc805b8a0 0x7f4fc80af310 secure :-1 s=READY pgs=1018 cs=0 l=1 rx=0x7f4fb8008780 tx=0x7f4fc0010d50).stop 2020-04-22T14:17:53.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.378+0000 7f4fceac6700 1 -- 172.21.15.103:0/1114712701 shutdown_connections 2020-04-22T14:17:53.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.378+0000 7f4fceac6700 1 --2- 172.21.15.103:0/1114712701 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4fa804dc70 0x7f4fa8050130 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:53.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.378+0000 7f4fceac6700 1 --2- 172.21.15.103:0/1114712701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fc805b8a0 0x7f4fc80af310 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:53.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.378+0000 7f4fceac6700 1 --2- 172.21.15.103:0/1114712701 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4fc8065fe0 0x7f4fc81508d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:53.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.378+0000 7f4fceac6700 1 -- 172.21.15.103:0/1114712701 >> 172.21.15.103:0/1114712701 conn(0x7f4fc80b9160 msgr2=0x7f4fc8146330 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:53.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.378+0000 7f4fceac6700 1 -- 172.21.15.103:0/1114712701 shutdown_connections 2020-04-22T14:17:53.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.378+0000 7f4fceac6700 1 -- 172.21.15.103:0/1114712701 wait complete. 2020-04-22T14:17:53.390 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:17:53.390 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":135,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:17:49.007669+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:17:45.940111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2020-04-22T14:17:46.960856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:17:53.397 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:17:45.940111+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 23, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'134', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:17:46.960856+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 24, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'135', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:17:53.398 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:53.425 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:17:53.590 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.584+0000 7fe30f798700 1 Processor -- start 2020-04-22T14:17:53.590 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.585+0000 7fe30f798700 1 -- start start 2020-04-22T14:17:53.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.585+0000 7fe30f798700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe3080b4820 0x7fe3080acb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:53.596 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.585+0000 7fe30f798700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3080af030 con 0x7fe308061a30 2020-04-22T14:17:53.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.585+0000 7fe30f798700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe308060250 con 0x7fe308141f20 2020-04-22T14:17:53.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.585+0000 7fe30f798700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3080623c0 con 0x7fe3080b4820 2020-04-22T14:17:53.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.586+0000 7fe30cd33700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe3080b4820 0x7fe3080acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:53.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.586+0000 7fe30dd35700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe308141f20 0x7fe308142380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49822/0 (socket says 172.21.15.103:49822) 2020-04-22T14:17:53.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.586+0000 7fe30dd35700 1 -- 172.21.15.103:0/1780789195 learned_addr learned my addr 172.21.15.103:0/1780789195 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:17:53.597 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.586+0000 7fe30cd33700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe3080b4820 0x7fe3080acb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57636/0 (socket says 172.21.15.103:57636) 2020-04-22T14:17:53.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.586+0000 7fe30cd33700 1 -- 172.21.15.103:0/1780789195 >> v1:172.21.15.103:6789/0 conn(0x7fe308141f20 legacy=0x7fe308142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:53.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.586+0000 7fe30cd33700 1 -- 172.21.15.103:0/1780789195 >> v1:172.21.15.86:6789/0 conn(0x7fe308061a30 legacy=0x7fe3080ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:53.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.586+0000 7fe30cd33700 1 -- 172.21.15.103:0/1780789195 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe308062660 con 0x7fe3080b4820 2020-04-22T14:17:53.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.586+0000 7fe30cd33700 1 --2- 172.21.15.103:0/1780789195 >> v2:172.21.15.103:3300/0 conn(0x7fe3080b4820 0x7fe3080acb10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe304002f30 tx=0x7fe304007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.598 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.586+0000 7fe30cd33700 1 --2- 172.21.15.103:0/1780789195 >> v2:172.21.15.103:3300/0 conn(0x7fe3080b4820 0x7fe3080acb10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe304002f30 tx=0x7fe304007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.586+0000 7fe30cd33700 1 --2- 172.21.15.103:0/1780789195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3080b4820 0x7fe3080acb10 secure :-1 s=READY pgs=1925 cs=0 l=1 rx=0x7fe304002f30 tx=0x7fe304007a40).ready entity=mon.1 client_cookie=1d9e08236dd8e4cb server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:53.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.586+0000 7fe30cd33700 1 --2- 172.21.15.103:0/1780789195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3080b4820 0x7fe3080acb10 secure :-1 s=THROTTLE_DONE pgs=1925 cs=0 l=1 rx=0x7fe304002f30 tx=0x7fe304007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.586+0000 7fe2f7fff700 1 -- 172.21.15.103:0/1780789195 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe304012770 con 0x7fe3080b4820 2020-04-22T14:17:53.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.586+0000 7fe30cd33700 1 --2- 172.21.15.103:0/1780789195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3080b4820 0x7fe3080acb10 secure :-1 s=THROTTLE_DONE pgs=1925 cs=0 l=1 rx=0x7fe304002f30 tx=0x7fe304007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.586+0000 7fe2f7fff700 1 -- 172.21.15.103:0/1780789195 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe304012910 con 0x7fe3080b4820 2020-04-22T14:17:53.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.586+0000 7fe30cd33700 1 --2- 172.21.15.103:0/1780789195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3080b4820 0x7fe3080acb10 secure :-1 s=THROTTLE_DONE pgs=1925 cs=0 l=1 rx=0x7fe304002f30 tx=0x7fe304007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.599 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.586+0000 7fe2f7fff700 1 -- 172.21.15.103:0/1780789195 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe304012d30 con 0x7fe3080b4820 2020-04-22T14:17:53.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.586+0000 7fe30f798700 1 -- 172.21.15.103:0/1780789195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3080b4820 msgr2=0x7fe3080acb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:53.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.586+0000 7fe30f798700 1 --2- 172.21.15.103:0/1780789195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3080b4820 0x7fe3080acb10 secure :-1 s=READY pgs=1925 cs=0 l=1 rx=0x7fe304002f30 tx=0x7fe304007a40).stop 2020-04-22T14:17:53.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.587+0000 7fe30f798700 1 -- 172.21.15.103:0/1780789195 shutdown_connections 2020-04-22T14:17:53.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.587+0000 7fe30f798700 1 --2- 172.21.15.103:0/1780789195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3080b4820 0x7fe3080acb10 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:53.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.587+0000 7fe30f798700 1 -- 172.21.15.103:0/1780789195 >> 172.21.15.103:0/1780789195 conn(0x7fe30805b7b0 msgr2=0x7fe3080b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:53.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.587+0000 7fe30f798700 1 -- 172.21.15.103:0/1780789195 shutdown_connections 2020-04-22T14:17:53.600 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.587+0000 7fe30f798700 1 -- 172.21.15.103:0/1780789195 wait complete. 2020-04-22T14:17:53.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.588+0000 7fe30f798700 1 Processor -- start 2020-04-22T14:17:53.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.588+0000 7fe30f798700 1 -- start start 2020-04-22T14:17:53.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.588+0000 7fe30f798700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe3080b4820 0x7fe308066540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:53.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.588+0000 7fe30f798700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe308141f20 0x7fe308143940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:53.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.588+0000 7fe30f798700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe308157fc0 con 0x7fe308061a30 2020-04-22T14:17:53.601 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.588+0000 7fe30f798700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe308143da0 con 0x7fe3080b4820 2020-04-22T14:17:53.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.588+0000 7fe30f798700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe308066390 con 0x7fe308141f20 2020-04-22T14:17:53.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.588+0000 7fe30cd33700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe3080b4820 0x7fe308066540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:53.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.588+0000 7fe30cd33700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe3080b4820 0x7fe308066540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57640/0 (socket says 172.21.15.103:57640) 2020-04-22T14:17:53.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.588+0000 7fe30cd33700 1 -- 172.21.15.103:0/3589266037 learned_addr learned my addr 172.21.15.103:0/3589266037 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:53.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.589+0000 7fe30dd35700 1 --2- 172.21.15.103:0/3589266037 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe308141f20 0x7fe308143940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:53.602 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.589+0000 7fe30cd33700 1 -- 172.21.15.103:0/3589266037 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe308141f20 msgr2=0x7fe308143940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:53.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.589+0000 7fe30cd33700 1 --2- 172.21.15.103:0/3589266037 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe308141f20 0x7fe308143940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:53.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.589+0000 7fe30cd33700 1 -- 172.21.15.103:0/3589266037 >> v1:172.21.15.86:6789/0 conn(0x7fe308061a30 legacy=0x7fe308157210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:53.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.589+0000 7fe30cd33700 1 -- 172.21.15.103:0/3589266037 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe308065ef0 con 0x7fe3080b4820 2020-04-22T14:17:53.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.589+0000 7fe30dd35700 1 --2- 172.21.15.103:0/3589266037 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe308141f20 0x7fe308143940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:17:53.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.589+0000 7fe30cd33700 1 --2- 172.21.15.103:0/3589266037 >> v2:172.21.15.103:3300/0 conn(0x7fe3080b4820 0x7fe308066540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe304002f30 tx=0x7fe304012fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.589+0000 7fe30cd33700 1 --2- 172.21.15.103:0/3589266037 >> v2:172.21.15.103:3300/0 conn(0x7fe3080b4820 0x7fe308066540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe304002f30 tx=0x7fe304012fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.603 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.589+0000 7fe30cd33700 1 --2- 172.21.15.103:0/3589266037 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3080b4820 0x7fe308066540 secure :-1 s=READY pgs=1926 cs=0 l=1 rx=0x7fe304002f30 tx=0x7fe304012fa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:53.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.589+0000 7fe30cd33700 1 --2- 172.21.15.103:0/3589266037 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3080b4820 0x7fe308066540 secure :-1 s=THROTTLE_DONE pgs=1926 cs=0 l=1 rx=0x7fe304002f30 tx=0x7fe304012fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.589+0000 7fe2f67fc700 1 -- 172.21.15.103:0/3589266037 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe304007360 con 0x7fe3080b4820 2020-04-22T14:17:53.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.589+0000 7fe30cd33700 1 --2- 172.21.15.103:0/3589266037 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3080b4820 0x7fe308066540 secure :-1 s=THROTTLE_DONE pgs=1926 cs=0 l=1 rx=0x7fe304002f30 tx=0x7fe304012fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.589+0000 7fe30cd33700 1 --2- 172.21.15.103:0/3589266037 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3080b4820 0x7fe308066540 secure :-1 s=THROTTLE_DONE pgs=1926 cs=0 l=1 rx=0x7fe304002f30 tx=0x7fe304012fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.589+0000 7fe2f67fc700 1 -- 172.21.15.103:0/3589266037 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3040074c0 con 0x7fe3080b4820 2020-04-22T14:17:53.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.589+0000 7fe30f798700 1 -- 172.21.15.103:0/3589266037 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe308144630 con 0x7fe3080b4820 2020-04-22T14:17:53.604 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.589+0000 7fe2f67fc700 1 -- 172.21.15.103:0/3589266037 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3040058b0 con 0x7fe3080b4820 2020-04-22T14:17:53.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.589+0000 7fe30f798700 1 -- 172.21.15.103:0/3589266037 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe308157b60 con 0x7fe3080b4820 2020-04-22T14:17:53.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.590+0000 7fe30cd33700 1 --2- 172.21.15.103:0/3589266037 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3080b4820 0x7fe308066540 secure :-1 s=THROTTLE_DONE pgs=1926 cs=0 l=1 rx=0x7fe304002f30 tx=0x7fe304012fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.590+0000 7fe2f67fc700 1 -- 172.21.15.103:0/3589266037 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fe304005b30 con 0x7fe3080b4820 2020-04-22T14:17:53.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.590+0000 7fe30cd33700 1 --2- 172.21.15.103:0/3589266037 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3080b4820 0x7fe308066540 secure :-1 s=THROTTLE_DONE pgs=1926 cs=0 l=1 rx=0x7fe304002f30 tx=0x7fe304012fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.590+0000 7fe2f67fc700 1 --2- 172.21.15.103:0/3589266037 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe2e804d9c0 0x7fe2e804fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:53.605 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.590+0000 7fe30f798700 1 -- 172.21.15.103:0/3589266037 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe308056c90 con 0x7fe3080b4820 2020-04-22T14:17:53.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.590+0000 7fe2f67fc700 1 -- 172.21.15.103:0/3589266037 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe3040621b0 con 0x7fe3080b4820 2020-04-22T14:17:53.606 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.590+0000 7fe30d534700 1 --2- 172.21.15.103:0/3589266037 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe2e804d9c0 0x7fe2e804fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:53.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.591+0000 7fe30d534700 1 --2- 172.21.15.103:0/3589266037 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe2e804d9c0 0x7fe2e804fe80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe3080b2750 tx=0x7fe2f8002560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.591+0000 7fe30d534700 1 --2- 172.21.15.103:0/3589266037 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe2e804d9c0 0x7fe2e804fe80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe3080b2750 tx=0x7fe2f8002560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.591+0000 7fe30d534700 1 --2- 172.21.15.103:0/3589266037 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe2e804d9c0 0x7fe2e804fe80 secure :-1 s=READY pgs=703 cs=0 l=1 rx=0x7fe3080b2750 tx=0x7fe2f8002560).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:53.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.595+0000 7fe30cd33700 1 --2- 172.21.15.103:0/3589266037 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3080b4820 0x7fe308066540 secure :-1 s=THROTTLE_DONE pgs=1926 cs=0 l=1 rx=0x7fe304002f30 tx=0x7fe304012fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.607 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.595+0000 7fe2f67fc700 1 -- 172.21.15.103:0/3589266037 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fe30403d6b0 con 0x7fe3080b4820 2020-04-22T14:17:53.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.737+0000 7fe30f798700 1 -- 172.21.15.103:0/3589266037 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe3081449a0 con 0x7fe3080b4820 2020-04-22T14:17:53.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.737+0000 7fe30cd33700 1 --2- 172.21.15.103:0/3589266037 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3080b4820 0x7fe308066540 secure :-1 s=THROTTLE_DONE pgs=1926 cs=0 l=1 rx=0x7fe304002f30 tx=0x7fe304012fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.737+0000 7fe2f67fc700 1 -- 172.21.15.103:0/3589266037 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v135) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe304040cd0 con 0x7fe3080b4820 2020-04-22T14:17:53.740 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:17:53.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.738+0000 7fe30f798700 1 -- 172.21.15.103:0/3589266037 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe2e804d9c0 msgr2=0x7fe2e804fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:53.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.738+0000 7fe30f798700 1 --2- 172.21.15.103:0/3589266037 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe2e804d9c0 0x7fe2e804fe80 secure :-1 s=READY pgs=703 cs=0 l=1 rx=0x7fe3080b2750 tx=0x7fe2f8002560).stop 2020-04-22T14:17:53.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.738+0000 7fe30f798700 1 -- 172.21.15.103:0/3589266037 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3080b4820 msgr2=0x7fe308066540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:53.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.738+0000 7fe30f798700 1 --2- 172.21.15.103:0/3589266037 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3080b4820 0x7fe308066540 secure :-1 s=READY pgs=1926 cs=0 l=1 rx=0x7fe304002f30 tx=0x7fe304012fa0).stop 2020-04-22T14:17:53.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.738+0000 7fe30f798700 1 -- 172.21.15.103:0/3589266037 shutdown_connections 2020-04-22T14:17:53.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.738+0000 7fe30f798700 1 --2- 172.21.15.103:0/3589266037 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe2e804d9c0 0x7fe2e804fe80 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:53.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.738+0000 7fe30f798700 1 --2- 172.21.15.103:0/3589266037 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe308141f20 0x7fe308143940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:53.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.738+0000 7fe30f798700 1 --2- 172.21.15.103:0/3589266037 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3080b4820 0x7fe308066540 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:53.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.738+0000 7fe30f798700 1 -- 172.21.15.103:0/3589266037 >> 172.21.15.103:0/3589266037 conn(0x7fe30805b7b0 msgr2=0x7fe3080b57f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:53.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.738+0000 7fe30f798700 1 -- 172.21.15.103:0/3589266037 shutdown_connections 2020-04-22T14:17:53.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.738+0000 7fe30f798700 1 -- 172.21.15.103:0/3589266037 wait complete. 2020-04-22T14:17:53.753 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:53.780 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:17:53.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.937+0000 7f6504038700 1 Processor -- start 2020-04-22T14:17:53.940 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.937+0000 7f6504038700 1 -- start start 2020-04-22T14:17:53.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.938+0000 7f6504038700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f64fc143bc0 0x7f64fc146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:53.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.938+0000 7f6504038700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f64fc0b5ea0 0x7f64fc0b6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:53.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.938+0000 7f6504038700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64fc05fbc0 con 0x7f64fc0b9890 2020-04-22T14:17:53.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.938+0000 7f6504038700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64fc05fe60 con 0x7f64fc143bc0 2020-04-22T14:17:53.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.938+0000 7f6504038700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc060100 con 0x7f64fc0b5ea0 2020-04-22T14:17:53.947 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.938+0000 7f65015d3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f64fc143bc0 0x7f64fc146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:53.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.938+0000 7f65015d3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f64fc143bc0 0x7f64fc146fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57646/0 (socket says 172.21.15.103:57646) 2020-04-22T14:17:53.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.938+0000 7f65015d3700 1 -- 172.21.15.103:0/4281108782 learned_addr learned my addr 172.21.15.103:0/4281108782 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:53.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.938+0000 7f65025d5700 1 --2- 172.21.15.103:0/4281108782 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f64fc0b5ea0 0x7f64fc0b6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:53.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.938+0000 7f65015d3700 1 -- 172.21.15.103:0/4281108782 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f64fc0b5ea0 msgr2=0x7f64fc0b6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:53.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.938+0000 7f65015d3700 1 --2- 172.21.15.103:0/4281108782 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f64fc0b5ea0 0x7f64fc0b6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:53.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.938+0000 7f65015d3700 1 -- 172.21.15.103:0/4281108782 >> v1:172.21.15.86:6789/0 conn(0x7f64fc0b9890 legacy=0x7f64fc1434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:53.948 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.938+0000 7f65015d3700 1 -- 172.21.15.103:0/4281108782 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64fc0b9c70 con 0x7f64fc143bc0 2020-04-22T14:17:53.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.938+0000 7f65025d5700 1 --2- 172.21.15.103:0/4281108782 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f64fc0b5ea0 0x7f64fc0b6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:17:53.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.939+0000 7f65015d3700 1 --2- 172.21.15.103:0/4281108782 >> v2:172.21.15.103:3300/0 conn(0x7f64fc143bc0 0x7f64fc146fc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f64ec002f30 tx=0x7f64ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.939+0000 7f65015d3700 1 --2- 172.21.15.103:0/4281108782 >> v2:172.21.15.103:3300/0 conn(0x7f64fc143bc0 0x7f64fc146fc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f64ec002f30 tx=0x7f64ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.939+0000 7f65015d3700 1 --2- 172.21.15.103:0/4281108782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64fc143bc0 0x7f64fc146fc0 secure :-1 s=READY pgs=1927 cs=0 l=1 rx=0x7f64ec002f30 tx=0x7f64ec007a40).ready entity=mon.1 client_cookie=be1861a3ed05f596 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:53.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.939+0000 7f65015d3700 1 --2- 172.21.15.103:0/4281108782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64fc143bc0 0x7f64fc146fc0 secure :-1 s=THROTTLE_DONE pgs=1927 cs=0 l=1 rx=0x7f64ec002f30 tx=0x7f64ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.939+0000 7f6500dd2700 1 -- 172.21.15.103:0/4281108782 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64ec011720 con 0x7f64fc143bc0 2020-04-22T14:17:53.949 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.939+0000 7f65015d3700 1 --2- 172.21.15.103:0/4281108782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64fc143bc0 0x7f64fc146fc0 secure :-1 s=THROTTLE_DONE pgs=1927 cs=0 l=1 rx=0x7f64ec002f30 tx=0x7f64ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.939+0000 7f6500dd2700 1 -- 172.21.15.103:0/4281108782 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ec0118c0 con 0x7f64fc143bc0 2020-04-22T14:17:53.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.939+0000 7f65015d3700 1 --2- 172.21.15.103:0/4281108782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64fc143bc0 0x7f64fc146fc0 secure :-1 s=THROTTLE_DONE pgs=1927 cs=0 l=1 rx=0x7f64ec002f30 tx=0x7f64ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.939+0000 7f6500dd2700 1 -- 172.21.15.103:0/4281108782 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64ec011ce0 con 0x7f64fc143bc0 2020-04-22T14:17:53.950 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.939+0000 7f6504038700 1 -- 172.21.15.103:0/4281108782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64fc143bc0 msgr2=0x7f64fc146fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:53.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.939+0000 7f6504038700 1 --2- 172.21.15.103:0/4281108782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64fc143bc0 0x7f64fc146fc0 secure :-1 s=READY pgs=1927 cs=0 l=1 rx=0x7f64ec002f30 tx=0x7f64ec007a40).stop 2020-04-22T14:17:53.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.939+0000 7f6504038700 1 -- 172.21.15.103:0/4281108782 shutdown_connections 2020-04-22T14:17:53.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.939+0000 7f6504038700 1 --2- 172.21.15.103:0/4281108782 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f64fc0b5ea0 0x7f64fc0b6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:53.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.939+0000 7f6504038700 1 --2- 172.21.15.103:0/4281108782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64fc143bc0 0x7f64fc146fc0 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:53.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.939+0000 7f6504038700 1 -- 172.21.15.103:0/4281108782 >> 172.21.15.103:0/4281108782 conn(0x7f64fc05ad30 msgr2=0x7f64fc05b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:53.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.939+0000 7f6504038700 1 -- 172.21.15.103:0/4281108782 shutdown_connections 2020-04-22T14:17:53.952 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.939+0000 7f6504038700 1 -- 172.21.15.103:0/4281108782 wait complete. 2020-04-22T14:17:53.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.940+0000 7f6504038700 1 Processor -- start 2020-04-22T14:17:53.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.940+0000 7f6504038700 1 -- start start 2020-04-22T14:17:53.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.941+0000 7f6504038700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f64fc0b9890 0x7f64fc145000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:53.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.941+0000 7f6504038700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f64fc143bc0 0x7f64fc156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:53.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.941+0000 7f6504038700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64fc12d230 con 0x7f64fc0b5ea0 2020-04-22T14:17:53.953 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.941+0000 7f6504038700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64fc12d540 con 0x7f64fc143bc0 2020-04-22T14:17:53.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.941+0000 7f6504038700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64fc12d7e0 con 0x7f64fc0b9890 2020-04-22T14:17:53.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.941+0000 7f65015d3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f64fc0b9890 0x7f64fc145000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:53.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.941+0000 7f65015d3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f64fc0b9890 0x7f64fc145000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57654/0 (socket says 172.21.15.103:57654) 2020-04-22T14:17:53.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.941+0000 7f65015d3700 1 -- 172.21.15.103:0/1090561778 learned_addr learned my addr 172.21.15.103:0/1090561778 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:53.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.941+0000 7f65025d5700 1 --2- 172.21.15.103:0/1090561778 >> v2:172.21.15.86:3300/0 conn(0x7f64fc143bc0 0x7f64fc156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:53.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.941+0000 7f65015d3700 1 -- 172.21.15.103:0/1090561778 >> v2:172.21.15.86:3300/0 conn(0x7f64fc143bc0 msgr2=0x7f64fc156df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:53.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.941+0000 7f65015d3700 1 --2- 172.21.15.103:0/1090561778 >> v2:172.21.15.86:3300/0 conn(0x7f64fc143bc0 0x7f64fc156df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:53.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.941+0000 7f65015d3700 1 -- 172.21.15.103:0/1090561778 >> v1:172.21.15.86:6789/0 conn(0x7f64fc0b5ea0 legacy=0x7f64fc0bbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:53.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.941+0000 7f65015d3700 1 -- 172.21.15.103:0/1090561778 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64fc0bc5d0 con 0x7f64fc0b9890 2020-04-22T14:17:53.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.941+0000 7f65015d3700 1 --2- 172.21.15.103:0/1090561778 >> v2:172.21.15.103:3300/0 conn(0x7f64fc0b9890 0x7f64fc145000 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f64ec002f30 tx=0x7f64ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.941+0000 7f65015d3700 1 --2- 172.21.15.103:0/1090561778 >> v2:172.21.15.103:3300/0 conn(0x7f64fc0b9890 0x7f64fc145000 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f64ec002f30 tx=0x7f64ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.941+0000 7f65015d3700 1 --2- 172.21.15.103:0/1090561778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64fc0b9890 0x7f64fc145000 secure :-1 s=READY pgs=1928 cs=0 l=1 rx=0x7f64ec002f30 tx=0x7f64ec007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:53.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.942+0000 7f65015d3700 1 --2- 172.21.15.103:0/1090561778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64fc0b9890 0x7f64fc145000 secure :-1 s=THROTTLE_DONE pgs=1928 cs=0 l=1 rx=0x7f64ec002f30 tx=0x7f64ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.942+0000 7f65015d3700 1 --2- 172.21.15.103:0/1090561778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64fc0b9890 0x7f64fc145000 secure :-1 s=THROTTLE_DONE pgs=1928 cs=0 l=1 rx=0x7f64ec002f30 tx=0x7f64ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.942+0000 7f64eaffd700 1 -- 172.21.15.103:0/1090561778 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64ec007360 con 0x7f64fc0b9890 2020-04-22T14:17:53.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.942+0000 7f65015d3700 1 --2- 172.21.15.103:0/1090561778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64fc0b9890 0x7f64fc145000 secure :-1 s=THROTTLE_DONE pgs=1928 cs=0 l=1 rx=0x7f64ec002f30 tx=0x7f64ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.942+0000 7f64eaffd700 1 -- 172.21.15.103:0/1090561778 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ec0074c0 con 0x7f64fc0b9890 2020-04-22T14:17:53.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.942+0000 7f6504038700 1 -- 172.21.15.103:0/1090561778 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64fc12cae0 con 0x7f64fc0b9890 2020-04-22T14:17:53.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.942+0000 7f64eaffd700 1 -- 172.21.15.103:0/1090561778 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64ec0058b0 con 0x7f64fc0b9890 2020-04-22T14:17:53.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.942+0000 7f6504038700 1 -- 172.21.15.103:0/1090561778 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64fc12d000 con 0x7f64fc0b9890 2020-04-22T14:17:53.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.942+0000 7f65015d3700 1 --2- 172.21.15.103:0/1090561778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64fc0b9890 0x7f64fc145000 secure :-1 s=THROTTLE_DONE pgs=1928 cs=0 l=1 rx=0x7f64ec002f30 tx=0x7f64ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.943+0000 7f64eaffd700 1 -- 172.21.15.103:0/1090561778 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f64ec005a10 con 0x7f64fc0b9890 2020-04-22T14:17:53.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.943+0000 7f65015d3700 1 --2- 172.21.15.103:0/1090561778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64fc0b9890 0x7f64fc145000 secure :-1 s=THROTTLE_DONE pgs=1928 cs=0 l=1 rx=0x7f64ec002f30 tx=0x7f64ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.943+0000 7f6504038700 1 -- 172.21.15.103:0/1090561778 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64fc056c90 con 0x7f64fc0b9890 2020-04-22T14:17:53.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.943+0000 7f64eaffd700 1 --2- 172.21.15.103:0/1090561778 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f64dc04d9e0 0x7f64dc04fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:53.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.943+0000 7f64eaffd700 1 -- 172.21.15.103:0/1090561778 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f64ec061ca0 con 0x7f64fc0b9890 2020-04-22T14:17:53.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.943+0000 7f6501dd4700 1 --2- 172.21.15.103:0/1090561778 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f64dc04d9e0 0x7f64dc04fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:53.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.943+0000 7f6501dd4700 1 --2- 172.21.15.103:0/1090561778 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f64dc04d9e0 0x7f64dc04fea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f64fc12c0d0 tx=0x7f64f8002560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.943+0000 7f6501dd4700 1 --2- 172.21.15.103:0/1090561778 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f64dc04d9e0 0x7f64dc04fea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f64fc12c0d0 tx=0x7f64f8002560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.943+0000 7f6501dd4700 1 --2- 172.21.15.103:0/1090561778 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f64dc04d9e0 0x7f64dc04fea0 secure :-1 s=READY pgs=704 cs=0 l=1 rx=0x7f64fc12c0d0 tx=0x7f64f8002560).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:53.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.947+0000 7f65015d3700 1 --2- 172.21.15.103:0/1090561778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64fc0b9890 0x7f64fc145000 secure :-1 s=THROTTLE_DONE pgs=1928 cs=0 l=1 rx=0x7f64ec002f30 tx=0x7f64ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:53.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:53.947+0000 7f64eaffd700 1 -- 172.21.15.103:0/1090561778 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f64ec03d140 con 0x7f64fc0b9890 2020-04-22T14:17:54.095 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.093+0000 7f6504038700 1 -- 172.21.15.103:0/1090561778 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f64fc0b39e0 con 0x7f64fc0b9890 2020-04-22T14:17:54.095 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.093+0000 7f65015d3700 1 --2- 172.21.15.103:0/1090561778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64fc0b9890 0x7f64fc145000 secure :-1 s=THROTTLE_DONE pgs=1928 cs=0 l=1 rx=0x7f64ec002f30 tx=0x7f64ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:54.095 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.093+0000 7f64eaffd700 1 -- 172.21.15.103:0/1090561778 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v135) v1 ==== 92+0+10 (secure 0 0 0) 0x7f64ec040760 con 0x7f64fc0b9890 2020-04-22T14:17:54.096 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:17:54.097 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.094+0000 7f6504038700 1 -- 172.21.15.103:0/1090561778 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f64dc04d9e0 msgr2=0x7f64dc04fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:54.098 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.094+0000 7f6504038700 1 --2- 172.21.15.103:0/1090561778 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f64dc04d9e0 0x7f64dc04fea0 secure :-1 s=READY pgs=704 cs=0 l=1 rx=0x7f64fc12c0d0 tx=0x7f64f8002560).stop 2020-04-22T14:17:54.098 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.094+0000 7f6504038700 1 -- 172.21.15.103:0/1090561778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64fc0b9890 msgr2=0x7f64fc145000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:54.098 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.094+0000 7f6504038700 1 --2- 172.21.15.103:0/1090561778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64fc0b9890 0x7f64fc145000 secure :-1 s=READY pgs=1928 cs=0 l=1 rx=0x7f64ec002f30 tx=0x7f64ec007a40).stop 2020-04-22T14:17:54.098 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.094+0000 7f6504038700 1 -- 172.21.15.103:0/1090561778 shutdown_connections 2020-04-22T14:17:54.101 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.094+0000 7f6504038700 1 --2- 172.21.15.103:0/1090561778 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f64dc04d9e0 0x7f64dc04fea0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:54.101 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.094+0000 7f6504038700 1 --2- 172.21.15.103:0/1090561778 >> v2:172.21.15.86:3300/0 conn(0x7f64fc143bc0 0x7f64fc156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:54.101 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.094+0000 7f6504038700 1 --2- 172.21.15.103:0/1090561778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64fc0b9890 0x7f64fc145000 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:54.101 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.094+0000 7f6504038700 1 -- 172.21.15.103:0/1090561778 >> 172.21.15.103:0/1090561778 conn(0x7f64fc05ad30 msgr2=0x7f64fc12f410 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:54.101 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.095+0000 7f6504038700 1 -- 172.21.15.103:0/1090561778 shutdown_connections 2020-04-22T14:17:54.101 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.095+0000 7f6504038700 1 -- 172.21.15.103:0/1090561778 wait complete. 2020-04-22T14:17:54.107 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:54.123 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-22T14:17:54.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.270+0000 7fe4815c1700 1 Processor -- start 2020-04-22T14:17:54.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.270+0000 7fe4815c1700 1 -- start start 2020-04-22T14:17:54.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.271+0000 7fe4815c1700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe47c0b4820 0x7fe47c0acb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:54.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.271+0000 7fe4815c1700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe47c141f20 0x7fe47c142380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:54.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.271+0000 7fe4815c1700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe47c0af030 con 0x7fe47c061a30 2020-04-22T14:17:54.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.271+0000 7fe4815c1700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe47c060250 con 0x7fe47c0b4820 2020-04-22T14:17:54.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.271+0000 7fe4815c1700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c0623c0 con 0x7fe47c141f20 2020-04-22T14:17:54.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.271+0000 7fe47a7fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe47c0b4820 0x7fe47c0acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:54.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.271+0000 7fe47a7fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe47c0b4820 0x7fe47c0acb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57660/0 (socket says 172.21.15.103:57660) 2020-04-22T14:17:54.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.271+0000 7fe47affd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe47c061a30 0x7fe47c0ae920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49850/0 (socket says 172.21.15.103:49850) 2020-04-22T14:17:54.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.271+0000 7fe47a7fc700 1 -- 172.21.15.103:0/2280645583 learned_addr learned my addr 172.21.15.103:0/2280645583 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:54.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.272+0000 7fe47b7fe700 1 --2- 172.21.15.103:0/2280645583 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe47c141f20 0x7fe47c142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:54.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.272+0000 7fe47a7fc700 1 -- 172.21.15.103:0/2280645583 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe47c141f20 msgr2=0x7fe47c142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:54.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.272+0000 7fe47a7fc700 1 --2- 172.21.15.103:0/2280645583 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe47c141f20 0x7fe47c142380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:54.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.272+0000 7fe47a7fc700 1 -- 172.21.15.103:0/2280645583 >> v1:172.21.15.103:6789/0 conn(0x7fe47c061a30 legacy=0x7fe47c0ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:54.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.272+0000 7fe47a7fc700 1 -- 172.21.15.103:0/2280645583 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47c062660 con 0x7fe47c0b4820 2020-04-22T14:17:54.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.272+0000 7fe479ffb700 1 -- 172.21.15.103:0/2280645583 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2791295129 0 0) 0x7fe47c0af030 con 0x7fe47c061a30 2020-04-22T14:17:54.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.272+0000 7fe47a7fc700 1 --2- 172.21.15.103:0/2280645583 >> v2:172.21.15.103:3300/0 conn(0x7fe47c0b4820 0x7fe47c0acb10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe46c002f30 tx=0x7fe46c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:54.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.272+0000 7fe47a7fc700 1 --2- 172.21.15.103:0/2280645583 >> v2:172.21.15.103:3300/0 conn(0x7fe47c0b4820 0x7fe47c0acb10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe46c002f30 tx=0x7fe46c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:54.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.272+0000 7fe47a7fc700 1 --2- 172.21.15.103:0/2280645583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe47c0b4820 0x7fe47c0acb10 secure :-1 s=READY pgs=1930 cs=0 l=1 rx=0x7fe46c002f30 tx=0x7fe46c007a40).ready entity=mon.1 client_cookie=e94d41eef9161d88 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:54.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.272+0000 7fe47a7fc700 1 --2- 172.21.15.103:0/2280645583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe47c0b4820 0x7fe47c0acb10 secure :-1 s=THROTTLE_DONE pgs=1930 cs=0 l=1 rx=0x7fe46c002f30 tx=0x7fe46c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:54.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.272+0000 7fe479ffb700 1 -- 172.21.15.103:0/2280645583 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe46c011720 con 0x7fe47c0b4820 2020-04-22T14:17:54.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.272+0000 7fe47a7fc700 1 --2- 172.21.15.103:0/2280645583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe47c0b4820 0x7fe47c0acb10 secure :-1 s=THROTTLE_DONE pgs=1930 cs=0 l=1 rx=0x7fe46c002f30 tx=0x7fe46c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:54.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.272+0000 7fe479ffb700 1 -- 172.21.15.103:0/2280645583 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46c011880 con 0x7fe47c0b4820 2020-04-22T14:17:54.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.272+0000 7fe47a7fc700 1 --2- 172.21.15.103:0/2280645583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe47c0b4820 0x7fe47c0acb10 secure :-1 s=THROTTLE_DONE pgs=1930 cs=0 l=1 rx=0x7fe46c002f30 tx=0x7fe46c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:54.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.272+0000 7fe479ffb700 1 -- 172.21.15.103:0/2280645583 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe46c011be0 con 0x7fe47c0b4820 2020-04-22T14:17:54.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.272+0000 7fe4815c1700 1 -- 172.21.15.103:0/2280645583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe47c0b4820 msgr2=0x7fe47c0acb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:54.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.272+0000 7fe4815c1700 1 --2- 172.21.15.103:0/2280645583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe47c0b4820 0x7fe47c0acb10 secure :-1 s=READY pgs=1930 cs=0 l=1 rx=0x7fe46c002f30 tx=0x7fe46c007a40).stop 2020-04-22T14:17:54.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.272+0000 7fe4815c1700 1 -- 172.21.15.103:0/2280645583 shutdown_connections 2020-04-22T14:17:54.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.272+0000 7fe4815c1700 1 --2- 172.21.15.103:0/2280645583 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe47c141f20 0x7fe47c142380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:54.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.272+0000 7fe4815c1700 1 --2- 172.21.15.103:0/2280645583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe47c0b4820 0x7fe47c0acb10 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:54.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.272+0000 7fe4815c1700 1 -- 172.21.15.103:0/2280645583 >> 172.21.15.103:0/2280645583 conn(0x7fe47c05b7b0 msgr2=0x7fe47c0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:54.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.272+0000 7fe4815c1700 1 -- 172.21.15.103:0/2280645583 shutdown_connections 2020-04-22T14:17:54.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.272+0000 7fe4815c1700 1 -- 172.21.15.103:0/2280645583 wait complete. 2020-04-22T14:17:54.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.273+0000 7fe4815c1700 1 Processor -- start 2020-04-22T14:17:54.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.273+0000 7fe4815c1700 1 -- start start 2020-04-22T14:17:54.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.274+0000 7fe4815c1700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe47c0b4820 0x7fe47c13cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:54.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.274+0000 7fe4815c1700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe47c141f20 0x7fe47c13e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:54.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.274+0000 7fe4815c1700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe47c1418e0 con 0x7fe47c061a30 2020-04-22T14:17:54.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.274+0000 7fe4815c1700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe47c13e6a0 con 0x7fe47c141f20 2020-04-22T14:17:54.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.274+0000 7fe4815c1700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c065b40 con 0x7fe47c0b4820 2020-04-22T14:17:54.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.274+0000 7fe47b7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe47c141f20 0x7fe47c13e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:54.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.274+0000 7fe47b7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe47c141f20 0x7fe47c13e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57668/0 (socket says 172.21.15.103:57668) 2020-04-22T14:17:54.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.274+0000 7fe47b7fe700 1 -- 172.21.15.103:0/2622753051 learned_addr learned my addr 172.21.15.103:0/2622753051 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:54.286 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.274+0000 7fe47a7fc700 1 --2- 172.21.15.103:0/2622753051 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe47c0b4820 0x7fe47c13cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:54.286 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.274+0000 7fe47b7fe700 1 -- 172.21.15.103:0/2622753051 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe47c0b4820 msgr2=0x7fe47c13cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:54.286 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.274+0000 7fe47b7fe700 1 --2- 172.21.15.103:0/2622753051 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe47c0b4820 0x7fe47c13cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:54.286 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.274+0000 7fe47b7fe700 1 -- 172.21.15.103:0/2622753051 >> v1:172.21.15.86:6789/0 conn(0x7fe47c061a30 legacy=0x7fe47c140de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:54.286 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.274+0000 7fe47b7fe700 1 -- 172.21.15.103:0/2622753051 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47c065de0 con 0x7fe47c141f20 2020-04-22T14:17:54.286 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.274+0000 7fe47b7fe700 1 --2- 172.21.15.103:0/2622753051 >> v2:172.21.15.103:3300/0 conn(0x7fe47c141f20 0x7fe47c13e0e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe4740032b0 tx=0x7fe474013140).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:54.286 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.275+0000 7fe47b7fe700 1 --2- 172.21.15.103:0/2622753051 >> v2:172.21.15.103:3300/0 conn(0x7fe47c141f20 0x7fe47c13e0e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe4740032b0 tx=0x7fe474013140).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:54.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.275+0000 7fe47b7fe700 1 --2- 172.21.15.103:0/2622753051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe47c141f20 0x7fe47c13e0e0 secure :-1 s=READY pgs=1931 cs=0 l=1 rx=0x7fe4740032b0 tx=0x7fe474013140).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:54.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.275+0000 7fe47b7fe700 1 --2- 172.21.15.103:0/2622753051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe47c141f20 0x7fe47c13e0e0 secure :-1 s=THROTTLE_DONE pgs=1931 cs=0 l=1 rx=0x7fe4740032b0 tx=0x7fe474013140).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:54.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.275+0000 7fe47b7fe700 1 --2- 172.21.15.103:0/2622753051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe47c141f20 0x7fe47c13e0e0 secure :-1 s=THROTTLE_DONE pgs=1931 cs=0 l=1 rx=0x7fe4740032b0 tx=0x7fe474013140).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:54.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.275+0000 7fe46bfff700 1 -- 172.21.15.103:0/2622753051 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe474005e30 con 0x7fe47c141f20 2020-04-22T14:17:54.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.275+0000 7fe47b7fe700 1 --2- 172.21.15.103:0/2622753051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe47c141f20 0x7fe47c13e0e0 secure :-1 s=THROTTLE_DONE pgs=1931 cs=0 l=1 rx=0x7fe4740032b0 tx=0x7fe474013140).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:54.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.275+0000 7fe46bfff700 1 -- 172.21.15.103:0/2622753051 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe474014b80 con 0x7fe47c141f20 2020-04-22T14:17:54.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.275+0000 7fe4815c1700 1 -- 172.21.15.103:0/2622753051 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe47c0b7db0 con 0x7fe47c141f20 2020-04-22T14:17:54.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.275+0000 7fe46bfff700 1 -- 172.21.15.103:0/2622753051 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe474007180 con 0x7fe47c141f20 2020-04-22T14:17:54.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.275+0000 7fe4815c1700 1 -- 172.21.15.103:0/2622753051 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe47c13f970 con 0x7fe47c141f20 2020-04-22T14:17:54.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.275+0000 7fe47b7fe700 1 --2- 172.21.15.103:0/2622753051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe47c141f20 0x7fe47c13e0e0 secure :-1 s=THROTTLE_DONE pgs=1931 cs=0 l=1 rx=0x7fe4740032b0 tx=0x7fe474013140).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:54.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.276+0000 7fe46bfff700 1 -- 172.21.15.103:0/2622753051 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fe4740101a0 con 0x7fe47c141f20 2020-04-22T14:17:54.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.276+0000 7fe47b7fe700 1 --2- 172.21.15.103:0/2622753051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe47c141f20 0x7fe47c13e0e0 secure :-1 s=THROTTLE_DONE pgs=1931 cs=0 l=1 rx=0x7fe4740032b0 tx=0x7fe474013140).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:54.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.276+0000 7fe4815c1700 1 -- 172.21.15.103:0/2622753051 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe47c065f70 con 0x7fe47c141f20 2020-04-22T14:17:54.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.276+0000 7fe46bfff700 1 --2- 172.21.15.103:0/2622753051 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe45804dad0 0x7fe45804ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:54.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.276+0000 7fe46bfff700 1 -- 172.21.15.103:0/2622753051 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe474063780 con 0x7fe47c141f20 2020-04-22T14:17:54.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.276+0000 7fe47affd700 1 --2- 172.21.15.103:0/2622753051 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe45804dad0 0x7fe45804ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:54.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.276+0000 7fe47affd700 1 --2- 172.21.15.103:0/2622753051 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe45804dad0 0x7fe45804ff90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe47c064d10 tx=0x7fe470001530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:54.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.276+0000 7fe47affd700 1 --2- 172.21.15.103:0/2622753051 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe45804dad0 0x7fe45804ff90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe47c064d10 tx=0x7fe470001530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:54.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.276+0000 7fe47affd700 1 --2- 172.21.15.103:0/2622753051 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe45804dad0 0x7fe45804ff90 secure :-1 s=READY pgs=705 cs=0 l=1 rx=0x7fe47c064d10 tx=0x7fe470001530).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:54.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.280+0000 7fe47b7fe700 1 --2- 172.21.15.103:0/2622753051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe47c141f20 0x7fe47c13e0e0 secure :-1 s=THROTTLE_DONE pgs=1931 cs=0 l=1 rx=0x7fe4740032b0 tx=0x7fe474013140).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:54.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.280+0000 7fe46bfff700 1 -- 172.21.15.103:0/2622753051 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fe47403eb00 con 0x7fe47c141f20 2020-04-22T14:17:54.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.422+0000 7fe4815c1700 1 -- 172.21.15.103:0/2622753051 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe47c056c90 con 0x7fe47c141f20 2020-04-22T14:17:54.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.422+0000 7fe47b7fe700 1 --2- 172.21.15.103:0/2622753051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe47c141f20 0x7fe47c13e0e0 secure :-1 s=THROTTLE_DONE pgs=1931 cs=0 l=1 rx=0x7fe4740032b0 tx=0x7fe474013140).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:54.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.422+0000 7fe46bfff700 1 -- 172.21.15.103:0/2622753051 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v135) v1 ==== 104+0+10 (secure 0 0 0) 0x7fe474042120 con 0x7fe47c141f20 2020-04-22T14:17:54.425 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:17:54.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.424+0000 7fe4815c1700 1 -- 172.21.15.103:0/2622753051 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe45804dad0 msgr2=0x7fe45804ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:54.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.424+0000 7fe4815c1700 1 --2- 172.21.15.103:0/2622753051 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe45804dad0 0x7fe45804ff90 secure :-1 s=READY pgs=705 cs=0 l=1 rx=0x7fe47c064d10 tx=0x7fe470001530).stop 2020-04-22T14:17:54.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.424+0000 7fe4815c1700 1 -- 172.21.15.103:0/2622753051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe47c141f20 msgr2=0x7fe47c13e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:54.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.424+0000 7fe4815c1700 1 --2- 172.21.15.103:0/2622753051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe47c141f20 0x7fe47c13e0e0 secure :-1 s=READY pgs=1931 cs=0 l=1 rx=0x7fe4740032b0 tx=0x7fe474013140).stop 2020-04-22T14:17:54.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.424+0000 7fe4815c1700 1 -- 172.21.15.103:0/2622753051 shutdown_connections 2020-04-22T14:17:54.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.424+0000 7fe4815c1700 1 --2- 172.21.15.103:0/2622753051 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe45804dad0 0x7fe45804ff90 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:54.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.424+0000 7fe4815c1700 1 --2- 172.21.15.103:0/2622753051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe47c141f20 0x7fe47c13e0e0 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:54.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.424+0000 7fe4815c1700 1 --2- 172.21.15.103:0/2622753051 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe47c0b4820 0x7fe47c13cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:54.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.424+0000 7fe4815c1700 1 -- 172.21.15.103:0/2622753051 >> 172.21.15.103:0/2622753051 conn(0x7fe47c05b7b0 msgr2=0x7fe47c0af7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:54.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.424+0000 7fe4815c1700 1 -- 172.21.15.103:0/2622753051 shutdown_connections 2020-04-22T14:17:54.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.424+0000 7fe4815c1700 1 -- 172.21.15.103:0/2622753051 wait complete. 2020-04-22T14:17:54.436 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:54.449 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-22T14:17:54.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.595+0000 7f0bbd939700 1 Processor -- start 2020-04-22T14:17:54.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.595+0000 7f0bbd939700 1 -- start start 2020-04-22T14:17:54.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.596+0000 7f0bbd939700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0bb80b4820 0x7f0bb80acb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:54.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.596+0000 7f0bbd939700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0bb8141f20 0x7f0bb81423d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:54.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.596+0000 7f0bbd939700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bb80af030 con 0x7f0bb8061a30 2020-04-22T14:17:54.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.596+0000 7f0bbd939700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bb8060250 con 0x7f0bb8141f20 2020-04-22T14:17:54.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.596+0000 7f0bbd939700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb80623c0 con 0x7f0bb80b4820 2020-04-22T14:17:54.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.596+0000 7f0bb6ffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f0bb8061a30 0x7f0bb80ae920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49862/0 (socket says 172.21.15.103:49862) 2020-04-22T14:17:54.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.596+0000 7f0bb6ffd700 1 -- 172.21.15.103:0/2805193821 learned_addr learned my addr 172.21.15.103:0/2805193821 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:17:54.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.597+0000 7f0bb5ffb700 1 -- 172.21.15.103:0/2805193821 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 781144213 0 0) 0x7f0bb80af030 con 0x7f0bb8061a30 2020-04-22T14:17:54.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.597+0000 7f0bb5ffb700 1 -- 172.21.15.103:0/2805193821 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b98003230 con 0x7f0bb8061a30 2020-04-22T14:17:54.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.597+0000 7f0bb77fe700 1 --2- 172.21.15.103:0/2805193821 >> v2:172.21.15.86:3300/0 conn(0x7f0bb8141f20 0x7f0bb81423d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:54.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.597+0000 7f0bb67fc700 1 --2- 172.21.15.103:0/2805193821 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0bb80b4820 0x7f0bb80acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:54.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.597+0000 7f0bb5ffb700 1 -- 172.21.15.103:0/2805193821 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 178151222 0 0) 0x7f0b98003230 con 0x7f0bb8061a30 2020-04-22T14:17:54.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.597+0000 7f0bb5ffb700 1 -- 172.21.15.103:0/2805193821 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0bb80b4820 msgr2=0x7f0bb80acb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:54.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.597+0000 7f0bb5ffb700 1 --2- 172.21.15.103:0/2805193821 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0bb80b4820 0x7f0bb80acb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:54.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.597+0000 7f0bb5ffb700 1 -- 172.21.15.103:0/2805193821 >> v2:172.21.15.86:3300/0 conn(0x7f0bb8141f20 msgr2=0x7f0bb81423d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:54.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.597+0000 7f0bb5ffb700 1 --2- 172.21.15.103:0/2805193821 >> v2:172.21.15.86:3300/0 conn(0x7f0bb8141f20 0x7f0bb81423d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:54.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.597+0000 7f0bb5ffb700 1 -- 172.21.15.103:0/2805193821 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb8062660 con 0x7f0bb8061a30 2020-04-22T14:17:54.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.597+0000 7f0bb5ffb700 1 -- 172.21.15.103:0/2805193821 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f0ba00016d0 con 0x7f0bb8061a30 2020-04-22T14:17:54.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.597+0000 7f0bb5ffb700 1 -- 172.21.15.103:0/2805193821 >> v1:172.21.15.103:6789/0 conn(0x7f0bb8061a30 legacy=0x7f0bb80ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:54.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.597+0000 7f0bb5ffb700 1 --2- 172.21.15.103:0/2805193821 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0bb80b4820 0x7f0b98003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:54.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.597+0000 7f0bb5ffb700 1 --2- 172.21.15.103:0/2805193821 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b98003b80 0x7f0b98003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:54.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.597+0000 7f0bb5ffb700 1 --2- 172.21.15.103:0/2805193821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b980045c0 0x7f0b98004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:54.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.597+0000 7f0bb5ffb700 1 -- 172.21.15.103:0/2805193821 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb8060250 con 0x7f0b98003b80 2020-04-22T14:17:54.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.597+0000 7f0bb5ffb700 1 -- 172.21.15.103:0/2805193821 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb80623c0 con 0x7f0b980045c0 2020-04-22T14:17:54.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.597+0000 7f0bb5ffb700 1 -- 172.21.15.103:0/2805193821 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b98005050 con 0x7f0bb80b4820 2020-04-22T14:17:54.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.597+0000 7f0bb77fe700 1 --2- 172.21.15.103:0/2805193821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b980045c0 0x7f0b98004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:54.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.597+0000 7f0bb6ffd700 1 --2- 172.21.15.103:0/2805193821 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0bb80b4820 0x7f0b98003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:54.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.597+0000 7f0bb67fc700 1 --2- 172.21.15.103:0/2805193821 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b98003b80 0x7f0b98003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:54.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.597+0000 7f0bb77fe700 1 -- 172.21.15.103:0/2805193821 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0bb80b4820 msgr2=0x7f0b98003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:54.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.597+0000 7f0bb77fe700 1 --2- 172.21.15.103:0/2805193821 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0bb80b4820 0x7f0b98003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:54.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.597+0000 7f0bb77fe700 1 -- 172.21.15.103:0/2805193821 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b98003b80 msgr2=0x7f0b98003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:54.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.597+0000 7f0bb77fe700 1 --2- 172.21.15.103:0/2805193821 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b98003b80 0x7f0b98003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:54.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.597+0000 7f0bb77fe700 1 -- 172.21.15.103:0/2805193821 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b98003230 con 0x7f0b980045c0 2020-04-22T14:17:54.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.597+0000 7f0bb6ffd700 1 --2- 172.21.15.103:0/2805193821 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0bb80b4820 0x7f0b98003720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:17:54.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.597+0000 7f0bb77fe700 1 --2- 172.21.15.103:0/2805193821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b980045c0 0x7f0b98004a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0bb00032b0 tx=0x7f0bb0010350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:54.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.597+0000 7f0bb77fe700 1 --2- 172.21.15.103:0/2805193821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b980045c0 0x7f0b98004a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0bb00032b0 tx=0x7f0bb0010350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:54.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.597+0000 7f0bb77fe700 1 --2- 172.21.15.103:0/2805193821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b980045c0 0x7f0b98004a20 secure :-1 s=READY pgs=1933 cs=0 l=1 rx=0x7f0bb00032b0 tx=0x7f0bb0010350).ready entity=mon.1 client_cookie=c136cdc2652516c1 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:54.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.598+0000 7f0bb77fe700 1 --2- 172.21.15.103:0/2805193821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b980045c0 0x7f0b98004a20 secure :-1 s=THROTTLE_DONE pgs=1933 cs=0 l=1 rx=0x7f0bb00032b0 tx=0x7f0bb0010350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:54.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.598+0000 7f0bb5ffb700 1 -- 172.21.15.103:0/2805193821 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bb00112c0 con 0x7f0b980045c0 2020-04-22T14:17:54.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.598+0000 7f0bb77fe700 1 --2- 172.21.15.103:0/2805193821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b980045c0 0x7f0b98004a20 secure :-1 s=THROTTLE_DONE pgs=1933 cs=0 l=1 rx=0x7f0bb00032b0 tx=0x7f0bb0010350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:54.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.598+0000 7f0bb77fe700 1 --2- 172.21.15.103:0/2805193821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b980045c0 0x7f0b98004a20 secure :-1 s=THROTTLE_DONE pgs=1933 cs=0 l=1 rx=0x7f0bb00032b0 tx=0x7f0bb0010350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:54.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.598+0000 7f0bb5ffb700 1 -- 172.21.15.103:0/2805193821 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb0011420 con 0x7f0b980045c0 2020-04-22T14:17:54.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.598+0000 7f0bb5ffb700 1 -- 172.21.15.103:0/2805193821 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bb00117c0 con 0x7f0b980045c0 2020-04-22T14:17:54.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.598+0000 7f0bbd939700 1 -- 172.21.15.103:0/2805193821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b980045c0 msgr2=0x7f0b98004a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:54.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.598+0000 7f0bbd939700 1 --2- 172.21.15.103:0/2805193821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b980045c0 0x7f0b98004a20 secure :-1 s=READY pgs=1933 cs=0 l=1 rx=0x7f0bb00032b0 tx=0x7f0bb0010350).stop 2020-04-22T14:17:54.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.598+0000 7f0bb77fe700 1 -- 172.21.15.103:0/2805193821 reap_dead start 2020-04-22T14:17:54.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.598+0000 7f0bbd939700 1 -- 172.21.15.103:0/2805193821 shutdown_connections 2020-04-22T14:17:54.623 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.598+0000 7f0bbd939700 1 -- 172.21.15.103:0/2805193821 >> 172.21.15.103:0/2805193821 conn(0x7f0bb805b7b0 msgr2=0x7f0bb80b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:54.624 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.598+0000 7f0bbd939700 1 -- 172.21.15.103:0/2805193821 shutdown_connections 2020-04-22T14:17:54.624 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.598+0000 7f0bbd939700 1 -- 172.21.15.103:0/2805193821 wait complete. 2020-04-22T14:17:54.624 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.599+0000 7f0bbd939700 1 Processor -- start 2020-04-22T14:17:54.624 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.599+0000 7f0bbd939700 1 -- start start 2020-04-22T14:17:54.624 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.600+0000 7f0bbd939700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0bb8144700 0x7f0bb813e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:54.624 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.600+0000 7f0bbd939700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0bb813d810 0x7f0bb8066090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:54.624 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.600+0000 7f0bbd939700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bb813dcb0 con 0x7f0bb8144ae0 2020-04-22T14:17:54.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.600+0000 7f0bbd939700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bb813df50 con 0x7f0bb8144700 2020-04-22T14:17:54.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.600+0000 7f0bbd939700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb813e1f0 con 0x7f0bb813d810 2020-04-22T14:17:54.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.600+0000 7f0bb6ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0bb8144700 0x7f0bb813e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:54.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.600+0000 7f0bb6ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0bb8144700 0x7f0bb813e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57682/0 (socket says 172.21.15.103:57682) 2020-04-22T14:17:54.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.600+0000 7f0bb6ffd700 1 -- 172.21.15.103:0/912703588 learned_addr learned my addr 172.21.15.103:0/912703588 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:54.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.600+0000 7f0bb77fe700 1 --2- 172.21.15.103:0/912703588 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0bb813d810 0x7f0bb8066090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:54.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.600+0000 7f0bb6ffd700 1 -- 172.21.15.103:0/912703588 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0bb813d810 msgr2=0x7f0bb8066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:54.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.600+0000 7f0bb6ffd700 1 --2- 172.21.15.103:0/912703588 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0bb813d810 0x7f0bb8066090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:54.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.600+0000 7f0bb6ffd700 1 -- 172.21.15.103:0/912703588 >> v1:172.21.15.86:6789/0 conn(0x7f0bb8144ae0 legacy=0x7f0bb8063bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:54.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.600+0000 7f0bb6ffd700 1 -- 172.21.15.103:0/912703588 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb813b270 con 0x7f0bb8144700 2020-04-22T14:17:54.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.600+0000 7f0bb6ffd700 1 --2- 172.21.15.103:0/912703588 >> v2:172.21.15.103:3300/0 conn(0x7f0bb8144700 0x7f0bb813e690 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0ba00011b0 tx=0x7f0bb8067710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:54.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.600+0000 7f0bb6ffd700 1 --2- 172.21.15.103:0/912703588 >> v2:172.21.15.103:3300/0 conn(0x7f0bb8144700 0x7f0bb813e690 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0ba00011b0 tx=0x7f0bb8067710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:54.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.600+0000 7f0bb6ffd700 1 --2- 172.21.15.103:0/912703588 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bb8144700 0x7f0bb813e690 secure :-1 s=READY pgs=1934 cs=0 l=1 rx=0x7f0ba00011b0 tx=0x7f0bb8067710).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:54.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.600+0000 7f0bb6ffd700 1 --2- 172.21.15.103:0/912703588 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bb8144700 0x7f0bb813e690 secure :-1 s=THROTTLE_DONE pgs=1934 cs=0 l=1 rx=0x7f0ba00011b0 tx=0x7f0bb8067710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:54.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.600+0000 7f0baffff700 1 -- 172.21.15.103:0/912703588 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ba0012ad0 con 0x7f0bb8144700 2020-04-22T14:17:54.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.600+0000 7f0bb6ffd700 1 --2- 172.21.15.103:0/912703588 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bb8144700 0x7f0bb813e690 secure :-1 s=THROTTLE_DONE pgs=1934 cs=0 l=1 rx=0x7f0ba00011b0 tx=0x7f0bb8067710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:54.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.600+0000 7f0bbd939700 1 -- 172.21.15.103:0/912703588 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bb80642d0 con 0x7f0bb8144700 2020-04-22T14:17:54.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.600+0000 7f0baffff700 1 -- 172.21.15.103:0/912703588 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba0012c70 con 0x7f0bb8144700 2020-04-22T14:17:54.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.600+0000 7f0bb6ffd700 1 --2- 172.21.15.103:0/912703588 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bb8144700 0x7f0bb813e690 secure :-1 s=THROTTLE_DONE pgs=1934 cs=0 l=1 rx=0x7f0ba00011b0 tx=0x7f0bb8067710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:54.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.600+0000 7f0baffff700 1 -- 172.21.15.103:0/912703588 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ba0012de0 con 0x7f0bb8144700 2020-04-22T14:17:54.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.601+0000 7f0bbd939700 1 -- 172.21.15.103:0/912703588 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bb8064740 con 0x7f0bb8144700 2020-04-22T14:17:54.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.601+0000 7f0bb6ffd700 1 --2- 172.21.15.103:0/912703588 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bb8144700 0x7f0bb813e690 secure :-1 s=THROTTLE_DONE pgs=1934 cs=0 l=1 rx=0x7f0ba00011b0 tx=0x7f0bb8067710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:54.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.601+0000 7f0baffff700 1 -- 172.21.15.103:0/912703588 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f0ba000c820 con 0x7f0bb8144700 2020-04-22T14:17:54.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.601+0000 7f0bb6ffd700 1 --2- 172.21.15.103:0/912703588 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bb8144700 0x7f0bb813e690 secure :-1 s=THROTTLE_DONE pgs=1934 cs=0 l=1 rx=0x7f0ba00011b0 tx=0x7f0bb8067710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:54.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.601+0000 7f0bbd939700 1 -- 172.21.15.103:0/912703588 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bb8056c90 con 0x7f0bb8144700 2020-04-22T14:17:54.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.602+0000 7f0baffff700 1 --2- 172.21.15.103:0/912703588 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0b9c04d8d0 0x7f0b9c04fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:54.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.602+0000 7f0baffff700 1 -- 172.21.15.103:0/912703588 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0ba0061030 con 0x7f0bb8144700 2020-04-22T14:17:54.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.602+0000 7f0bb67fc700 1 --2- 172.21.15.103:0/912703588 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0b9c04d8d0 0x7f0b9c04fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:54.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.602+0000 7f0bb67fc700 1 --2- 172.21.15.103:0/912703588 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0b9c04d8d0 0x7f0b9c04fd90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0bb8144f20 tx=0x7f0ba8007700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:54.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.602+0000 7f0bb67fc700 1 --2- 172.21.15.103:0/912703588 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0b9c04d8d0 0x7f0b9c04fd90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0bb8144f20 tx=0x7f0ba8007700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:54.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.602+0000 7f0bb67fc700 1 --2- 172.21.15.103:0/912703588 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0b9c04d8d0 0x7f0b9c04fd90 secure :-1 s=READY pgs=706 cs=0 l=1 rx=0x7f0bb8144f20 tx=0x7f0ba8007700).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:54.640 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:17:54.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.606+0000 7f0bb6ffd700 1 --2- 172.21.15.103:0/912703588 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bb8144700 0x7f0bb813e690 secure :-1 s=THROTTLE_DONE pgs=1934 cs=0 l=1 rx=0x7f0ba00011b0 tx=0x7f0bb8067710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:54.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.606+0000 7f0baffff700 1 -- 172.21.15.103:0/912703588 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f0ba003c410 con 0x7f0bb8144700 2020-04-22T14:17:54.677 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:17:54.699 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:54.713 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:17:54.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.750+0000 7f0bbd939700 1 -- 172.21.15.103:0/912703588 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0bb813e360 con 0x7f0bb8144700 2020-04-22T14:17:54.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.750+0000 7f0bb6ffd700 1 --2- 172.21.15.103:0/912703588 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bb8144700 0x7f0bb813e690 secure :-1 s=THROTTLE_DONE pgs=1934 cs=0 l=1 rx=0x7f0ba00011b0 tx=0x7f0bb8067710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:54.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.750+0000 7f0baffff700 1 -- 172.21.15.103:0/912703588 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v135) v1 ==== 100+0+10 (secure 0 0 0) 0x7f0ba003fa30 con 0x7f0bb8144700 2020-04-22T14:17:54.753 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:17:54.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.752+0000 7f0bbd939700 1 -- 172.21.15.103:0/912703588 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0b9c04d8d0 msgr2=0x7f0b9c04fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:54.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.752+0000 7f0bbd939700 1 --2- 172.21.15.103:0/912703588 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0b9c04d8d0 0x7f0b9c04fd90 secure :-1 s=READY pgs=706 cs=0 l=1 rx=0x7f0bb8144f20 tx=0x7f0ba8007700).stop 2020-04-22T14:17:54.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.752+0000 7f0bbd939700 1 -- 172.21.15.103:0/912703588 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bb8144700 msgr2=0x7f0bb813e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:54.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.752+0000 7f0bbd939700 1 --2- 172.21.15.103:0/912703588 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bb8144700 0x7f0bb813e690 secure :-1 s=READY pgs=1934 cs=0 l=1 rx=0x7f0ba00011b0 tx=0x7f0bb8067710).stop 2020-04-22T14:17:54.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.752+0000 7f0bbd939700 1 -- 172.21.15.103:0/912703588 shutdown_connections 2020-04-22T14:17:54.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.752+0000 7f0bbd939700 1 --2- 172.21.15.103:0/912703588 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0b9c04d8d0 0x7f0b9c04fd90 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:54.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.752+0000 7f0bbd939700 1 --2- 172.21.15.103:0/912703588 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0bb813d810 0x7f0bb8066090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:54.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.752+0000 7f0bbd939700 1 --2- 172.21.15.103:0/912703588 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bb8144700 0x7f0bb813e690 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:54.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.752+0000 7f0bbd939700 1 -- 172.21.15.103:0/912703588 >> 172.21.15.103:0/912703588 conn(0x7f0bb805b7b0 msgr2=0x7f0bb80b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:54.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.752+0000 7f0bbd939700 1 -- 172.21.15.103:0/912703588 shutdown_connections 2020-04-22T14:17:54.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:54.752+0000 7f0bbd939700 1 -- 172.21.15.103:0/912703588 wait complete. 2020-04-22T14:17:54.764 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-04-22T14:17:54.765 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:54.859 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:17:55.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.003+0000 7f63e7dc0700 1 Processor -- start 2020-04-22T14:17:55.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.003+0000 7f63e7dc0700 1 -- start start 2020-04-22T14:17:55.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.004+0000 7f63e7dc0700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f63e012c0d0 0x7f63e01464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:55.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.004+0000 7f63e7dc0700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f63e0063e30 0x7f63e00642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:17:55.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.004+0000 7f63e7dc0700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63e0143300 con 0x7f63e0065fe0 2020-04-22T14:17:55.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.004+0000 7f63e7dc0700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63e01435a0 con 0x7f63e0063e30 2020-04-22T14:17:55.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.004+0000 7f63e7dc0700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63e0143840 con 0x7f63e012c0d0 2020-04-22T14:17:55.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.004+0000 7f63e5b5c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f63e012c0d0 0x7f63e01464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:55.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.004+0000 7f63e5b5c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f63e012c0d0 0x7f63e01464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57690/0 (socket says 172.21.15.103:57690) 2020-04-22T14:17:55.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.004+0000 7f63e5b5c700 1 -- 172.21.15.103:0/1441583841 learned_addr learned my addr 172.21.15.103:0/1441583841 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:17:55.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.004+0000 7f63e635d700 1 --2- 172.21.15.103:0/1441583841 >> v2:172.21.15.86:3300/0 conn(0x7f63e0063e30 0x7f63e00642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:55.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.004+0000 7f63e5b5c700 1 -- 172.21.15.103:0/1441583841 >> v2:172.21.15.86:3300/0 conn(0x7f63e0063e30 msgr2=0x7f63e00642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:55.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.004+0000 7f63e5b5c700 1 --2- 172.21.15.103:0/1441583841 >> v2:172.21.15.86:3300/0 conn(0x7f63e0063e30 0x7f63e00642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:55.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.004+0000 7f63e5b5c700 1 -- 172.21.15.103:0/1441583841 >> v1:172.21.15.86:6789/0 conn(0x7f63e0065fe0 legacy=0x7f63e005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:17:55.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.005+0000 7f63e5b5c700 1 -- 172.21.15.103:0/1441583841 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e005bb50 con 0x7f63e012c0d0 2020-04-22T14:17:55.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.005+0000 7f63e635d700 1 --2- 172.21.15.103:0/1441583841 >> v2:172.21.15.86:3300/0 conn(0x7f63e0063e30 0x7f63e00642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:17:55.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.005+0000 7f63e5b5c700 1 --2- 172.21.15.103:0/1441583841 >> v2:172.21.15.103:3300/0 conn(0x7f63e012c0d0 0x7f63e01464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f63e00669a0 tx=0x7f63d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:55.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.005+0000 7f63e5b5c700 1 --2- 172.21.15.103:0/1441583841 >> v2:172.21.15.103:3300/0 conn(0x7f63e012c0d0 0x7f63e01464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f63e00669a0 tx=0x7f63d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:55.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.005+0000 7f63e5b5c700 1 --2- 172.21.15.103:0/1441583841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63e012c0d0 0x7f63e01464e0 secure :-1 s=READY pgs=1935 cs=0 l=1 rx=0x7f63e00669a0 tx=0x7f63d0007a40).ready entity=mon.1 client_cookie=d0bce72180e45ac9 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:55.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.005+0000 7f63e5b5c700 1 --2- 172.21.15.103:0/1441583841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63e012c0d0 0x7f63e01464e0 secure :-1 s=THROTTLE_DONE pgs=1935 cs=0 l=1 rx=0x7f63e00669a0 tx=0x7f63d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:55.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.005+0000 7f63e4b5a700 1 -- 172.21.15.103:0/1441583841 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63d00116e0 con 0x7f63e012c0d0 2020-04-22T14:17:55.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.005+0000 7f63e5b5c700 1 --2- 172.21.15.103:0/1441583841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63e012c0d0 0x7f63e01464e0 secure :-1 s=THROTTLE_DONE pgs=1935 cs=0 l=1 rx=0x7f63e00669a0 tx=0x7f63d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:55.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.005+0000 7f63e5b5c700 1 --2- 172.21.15.103:0/1441583841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63e012c0d0 0x7f63e01464e0 secure :-1 s=THROTTLE_DONE pgs=1935 cs=0 l=1 rx=0x7f63e00669a0 tx=0x7f63d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:55.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.005+0000 7f63e4b5a700 1 -- 172.21.15.103:0/1441583841 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d0011840 con 0x7f63e012c0d0 2020-04-22T14:17:55.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.005+0000 7f63e4b5a700 1 -- 172.21.15.103:0/1441583841 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63d0011c20 con 0x7f63e012c0d0 2020-04-22T14:17:55.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.005+0000 7f63e7dc0700 1 -- 172.21.15.103:0/1441583841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63e012c0d0 msgr2=0x7f63e01464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:55.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.005+0000 7f63e7dc0700 1 --2- 172.21.15.103:0/1441583841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63e012c0d0 0x7f63e01464e0 secure :-1 s=READY pgs=1935 cs=0 l=1 rx=0x7f63e00669a0 tx=0x7f63d0007a40).stop 2020-04-22T14:17:55.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.005+0000 7f63e7dc0700 1 -- 172.21.15.103:0/1441583841 shutdown_connections 2020-04-22T14:17:55.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.005+0000 7f63e7dc0700 1 --2- 172.21.15.103:0/1441583841 >> v2:172.21.15.86:3300/0 conn(0x7f63e0063e30 0x7f63e00642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:17:55.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.005+0000 7f63e7dc0700 1 --2- 172.21.15.103:0/1441583841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63e012c0d0 0x7f63e01464e0 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:55.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.005+0000 7f63e7dc0700 1 -- 172.21.15.103:0/1441583841 >> 172.21.15.103:0/1441583841 conn(0x7f63e00b9160 msgr2=0x7f63e005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:55.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.005+0000 7f63e7dc0700 1 -- 172.21.15.103:0/1441583841 shutdown_connections 2020-04-22T14:17:55.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.005+0000 7f63e7dc0700 1 -- 172.21.15.103:0/1441583841 wait complete. 2020-04-22T14:17:55.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.006+0000 7f63e7dc0700 1 Processor -- start 2020-04-22T14:17:55.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.006+0000 7f63e7dc0700 1 -- start start 2020-04-22T14:17:55.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.007+0000 7f63e7dc0700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f63e0065fe0 0x7f63e00ad290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:55.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.007+0000 7f63e7dc0700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63e01550b0 con 0x7f63e012c0d0 2020-04-22T14:17:55.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.007+0000 7f63e7dc0700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63e0155ec0 con 0x7f63e0063e30 2020-04-22T14:17:55.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.007+0000 7f63e7dc0700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e0152910 con 0x7f63e0065fe0 2020-04-22T14:17:55.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.007+0000 7f63e5b5c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f63e0063e30 0x7f63e01557b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49886/0 (socket says 172.21.15.103:49886) 2020-04-22T14:17:55.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.007+0000 7f63e5b5c700 1 -- 172.21.15.103:0/726493737 learned_addr learned my addr 172.21.15.103:0/726493737 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:17:55.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.007+0000 7f63e535b700 1 --2- 172.21.15.103:0/726493737 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f63e0065fe0 0x7f63e00ad290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:55.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.007+0000 7f63ceffd700 1 -- 172.21.15.103:0/726493737 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3361391137 0 0) 0x7f63e0155ec0 con 0x7f63e0063e30 2020-04-22T14:17:55.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.007+0000 7f63ceffd700 1 -- 172.21.15.103:0/726493737 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63c0002fe0 con 0x7f63e0063e30 2020-04-22T14:17:55.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.007+0000 7f63ceffd700 1 -- 172.21.15.103:0/726493737 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 215074345 0 0) 0x7f63c0002fe0 con 0x7f63e0063e30 2020-04-22T14:17:55.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.008+0000 7f63ceffd700 1 -- 172.21.15.103:0/726493737 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f63e0155ec0 con 0x7f63e0063e30 2020-04-22T14:17:55.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.008+0000 7f63ceffd700 1 -- 172.21.15.103:0/726493737 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f63d0011ea0 con 0x7f63e0063e30 2020-04-22T14:17:55.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.008+0000 7f63ceffd700 1 -- 172.21.15.103:0/726493737 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f63e0065fe0 msgr2=0x7f63e00ad290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:55.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.008+0000 7f63ceffd700 1 --2- 172.21.15.103:0/726493737 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f63e0065fe0 0x7f63e00ad290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:55.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.008+0000 7f63ceffd700 1 -- 172.21.15.103:0/726493737 >> v1:172.21.15.103:6789/0 conn(0x7f63e0063e30 legacy=0x7f63e01557b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:55.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.008+0000 7f63ceffd700 1 -- 172.21.15.103:0/726493737 >> v1:172.21.15.86:6789/0 conn(0x7f63e012c0d0 legacy=0x7f63e01249e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:55.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.008+0000 7f63ceffd700 1 --2- 172.21.15.103:0/726493737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63c00049b0 0x7f63c0004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:55.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.008+0000 7f63ceffd700 1 --2- 172.21.15.103:0/726493737 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f63e0065fe0 0x7f63c0003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:55.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.008+0000 7f63ceffd700 1 --2- 172.21.15.103:0/726493737 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63c0003d80 0x7f63c0004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:55.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.008+0000 7f63ceffd700 1 -- 172.21.15.103:0/726493737 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e0152910 con 0x7f63c0003d80 2020-04-22T14:17:55.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.008+0000 7f63ceffd700 1 -- 172.21.15.103:0/726493737 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c00052d0 con 0x7f63c00049b0 2020-04-22T14:17:55.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.008+0000 7f63ceffd700 1 -- 172.21.15.103:0/726493737 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c0005490 con 0x7f63e0065fe0 2020-04-22T14:17:55.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.008+0000 7f63e5b5c700 1 --2- 172.21.15.103:0/726493737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63c00049b0 0x7f63c0004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:55.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.008+0000 7f63e535b700 1 --2- 172.21.15.103:0/726493737 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f63e0065fe0 0x7f63c0003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:55.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.008+0000 7f63e635d700 1 --2- 172.21.15.103:0/726493737 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63c0003d80 0x7f63c0004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:55.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.008+0000 7f63e5b5c700 1 -- 172.21.15.103:0/726493737 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f63e0065fe0 msgr2=0x7f63c0003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:55.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.008+0000 7f63e5b5c700 1 --2- 172.21.15.103:0/726493737 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f63e0065fe0 0x7f63c0003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:55.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.008+0000 7f63e5b5c700 1 -- 172.21.15.103:0/726493737 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63c0003d80 msgr2=0x7f63c0004200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:55.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.008+0000 7f63e5b5c700 1 --2- 172.21.15.103:0/726493737 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63c0003d80 0x7f63c0004200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:17:55.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.008+0000 7f63e5b5c700 1 -- 172.21.15.103:0/726493737 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e01250f0 con 0x7f63c00049b0 2020-04-22T14:17:55.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.008+0000 7f63e7dc0700 1 -- 172.21.15.103:0/726493737 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63e01252e0 con 0x7f63c00049b0 2020-04-22T14:17:55.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.008+0000 7f63e5b5c700 1 --2- 172.21.15.103:0/726493737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63c00049b0 0x7f63c0004d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f63d0007aa0 tx=0x7f63d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:55.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.008+0000 7f63e7dc0700 1 -- 172.21.15.103:0/726493737 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63e00adaa0 con 0x7f63c00049b0 2020-04-22T14:17:55.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.008+0000 7f63e5b5c700 1 --2- 172.21.15.103:0/726493737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63c00049b0 0x7f63c0004d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f63d0007aa0 tx=0x7f63d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:55.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.008+0000 7f63e5b5c700 1 --2- 172.21.15.103:0/726493737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63c00049b0 0x7f63c0004d90 secure :-1 s=READY pgs=1937 cs=0 l=1 rx=0x7f63d0007aa0 tx=0x7f63d0007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:55.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.008+0000 7f63e5b5c700 1 --2- 172.21.15.103:0/726493737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63c00049b0 0x7f63c0004d90 secure :-1 s=THROTTLE_DONE pgs=1937 cs=0 l=1 rx=0x7f63d0007aa0 tx=0x7f63d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:55.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.008+0000 7f63ceffd700 1 -- 172.21.15.103:0/726493737 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63d0002f10 con 0x7f63c00049b0 2020-04-22T14:17:55.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.008+0000 7f63e5b5c700 1 --2- 172.21.15.103:0/726493737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63c00049b0 0x7f63c0004d90 secure :-1 s=THROTTLE_DONE pgs=1937 cs=0 l=1 rx=0x7f63d0007aa0 tx=0x7f63d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:55.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.008+0000 7f63e5b5c700 1 --2- 172.21.15.103:0/726493737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63c00049b0 0x7f63c0004d90 secure :-1 s=THROTTLE_DONE pgs=1937 cs=0 l=1 rx=0x7f63d0007aa0 tx=0x7f63d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:55.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.008+0000 7f63ceffd700 1 -- 172.21.15.103:0/726493737 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d0007550 con 0x7f63c00049b0 2020-04-22T14:17:55.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.008+0000 7f63ceffd700 1 -- 172.21.15.103:0/726493737 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63d000aa30 con 0x7f63c00049b0 2020-04-22T14:17:55.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.009+0000 7f63e5b5c700 1 --2- 172.21.15.103:0/726493737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63c00049b0 0x7f63c0004d90 secure :-1 s=THROTTLE_DONE pgs=1937 cs=0 l=1 rx=0x7f63d0007aa0 tx=0x7f63d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:55.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.009+0000 7f63ceffd700 1 -- 172.21.15.103:0/726493737 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f63d000ab90 con 0x7f63c00049b0 2020-04-22T14:17:55.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.009+0000 7f63e5b5c700 1 --2- 172.21.15.103:0/726493737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63c00049b0 0x7f63c0004d90 secure :-1 s=THROTTLE_DONE pgs=1937 cs=0 l=1 rx=0x7f63d0007aa0 tx=0x7f63d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:55.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.009+0000 7f63e7dc0700 1 -- 172.21.15.103:0/726493737 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63e00ad540 con 0x7f63c00049b0 2020-04-22T14:17:55.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.009+0000 7f63ceffd700 1 --2- 172.21.15.103:0/726493737 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f63c0055c00 0x7f63c00580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:17:55.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.010+0000 7f63ceffd700 1 -- 172.21.15.103:0/726493737 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f63d00623d0 con 0x7f63c00049b0 2020-04-22T14:17:55.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.010+0000 7f63e535b700 1 --2- 172.21.15.103:0/726493737 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f63c0055c00 0x7f63c00580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:17:55.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.010+0000 7f63e535b700 1 --2- 172.21.15.103:0/726493737 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f63c0055c00 0x7f63c00580c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f63dc001f50 tx=0x7f63dc00ca80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:55.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.010+0000 7f63e535b700 1 --2- 172.21.15.103:0/726493737 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f63c0055c00 0x7f63c00580c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f63dc001f50 tx=0x7f63dc00ca80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:55.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.010+0000 7f63e535b700 1 --2- 172.21.15.103:0/726493737 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f63c0055c00 0x7f63c00580c0 secure :-1 s=READY pgs=707 cs=0 l=1 rx=0x7f63dc001f50 tx=0x7f63dc00ca80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:17:55.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.014+0000 7f63e5b5c700 1 --2- 172.21.15.103:0/726493737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63c00049b0 0x7f63c0004d90 secure :-1 s=THROTTLE_DONE pgs=1937 cs=0 l=1 rx=0x7f63d0007aa0 tx=0x7f63d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:55.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.014+0000 7f63ceffd700 1 -- 172.21.15.103:0/726493737 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f63d003d8d0 con 0x7f63c00049b0 2020-04-22T14:17:55.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.205+0000 7f63e7dc0700 1 -- 172.21.15.103:0/726493737 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63e0056c90 con 0x7f63c00049b0 2020-04-22T14:17:55.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.205+0000 7f63e5b5c700 1 --2- 172.21.15.103:0/726493737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63c00049b0 0x7f63c0004d90 secure :-1 s=THROTTLE_DONE pgs=1937 cs=0 l=1 rx=0x7f63d0007aa0 tx=0x7f63d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:17:55.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.205+0000 7f63ceffd700 1 -- 172.21.15.103:0/726493737 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+2141 (secure 0 0 0) 0x7f63d0040ef0 con 0x7f63c00049b0 2020-04-22T14:17:55.208 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:17:55.208 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":101,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6539,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1045362246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1045362246},{"type":"v1","addr":"172.21.15.86:6835","nonce":1045362246}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":97}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:17:48.006467+0000","modified":"2020-04-22T14:17:50.019789+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9277":{"gid":9277,"name":"a","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/33849566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":33849566},{"type":"v1","addr":"172.21.15.103:6833","nonce":33849566}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2020-04-22T14:17:55.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.207+0000 7f63e7dc0700 1 -- 172.21.15.103:0/726493737 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f63c0055c00 msgr2=0x7f63c00580c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:55.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.207+0000 7f63e7dc0700 1 --2- 172.21.15.103:0/726493737 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f63c0055c00 0x7f63c00580c0 secure :-1 s=READY pgs=707 cs=0 l=1 rx=0x7f63dc001f50 tx=0x7f63dc00ca80).stop 2020-04-22T14:17:55.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.207+0000 7f63e7dc0700 1 -- 172.21.15.103:0/726493737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63c00049b0 msgr2=0x7f63c0004d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:17:55.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.207+0000 7f63e7dc0700 1 --2- 172.21.15.103:0/726493737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63c00049b0 0x7f63c0004d90 secure :-1 s=READY pgs=1937 cs=0 l=1 rx=0x7f63d0007aa0 tx=0x7f63d0007a40).stop 2020-04-22T14:17:55.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.207+0000 7f63e635d700 1 -- 172.21.15.103:0/726493737 reap_dead start 2020-04-22T14:17:55.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.207+0000 7f63e635d700 1 -- 172.21.15.103:0/726493737 reap_dead start 2020-04-22T14:17:55.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.207+0000 7f63e7dc0700 1 -- 172.21.15.103:0/726493737 shutdown_connections 2020-04-22T14:17:55.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.207+0000 7f63e7dc0700 1 -- 172.21.15.103:0/726493737 >> 172.21.15.103:0/726493737 conn(0x7f63e00b9160 msgr2=0x7f63e012b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:17:55.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.207+0000 7f63e7dc0700 1 -- 172.21.15.103:0/726493737 shutdown_connections 2020-04-22T14:17:55.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:17:55.207+0000 7f63e7dc0700 1 -- 172.21.15.103:0/726493737 wait complete. 2020-04-22T14:17:55.211 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 101 2020-04-22T14:17:55.420 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 9277}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 23, u'failed': [], u'epoch': 101, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [24], u'info': {u'gid_9277': {u'export_targets': [], u'name': u'a', u'incarnation': 98, u'state_seq': 3, u'state': u'up:active', u'gid': 9277, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 33849566, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 33849566, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/33849566'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:17:48.006467+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:17:50.019789+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:17:55.421 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:17:55.421 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:55.435 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:17:55.593 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:17:55.593 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:17:55.593 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:17:55.593 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 9277, 2020-04-22T14:17:55.594 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:17:55.594 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:17:55.594 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 7.5832942020000003, 2020-04-22T14:17:55.594 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 101, 2020-04-22T14:17:55.594 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 135, 2020-04-22T14:17:55.594 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 135, 2020-04-22T14:17:55.594 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 12.79738431 2020-04-22T14:17:55.595 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:17:55.601 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 9277, "want_state": "up:active", "state": "up:active", "rank_uptime": 7.5832942020000003, "mdsmap_epoch": 101, "osdmap_epoch": 135, "osdmap_epoch_barrier": 135, "uptime": 12.79738431 } 2020-04-22T14:17:55.602 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-04-22T14:17:55.602 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:17:55.602 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:55.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:55.617 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:17:55.682 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:17:55.682 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:17:55.682 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:17:55.682 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:55.682 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:17:55.683 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:55.683 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:17:55.683 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:17:55.683 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:17:55.683 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:17:55.683 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:17:55.683 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:17:55.684 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:17:55.684 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:17:55.684 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:17:55.684 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 41765sec preferred_lft 41765sec 2020-04-22T14:17:55.684 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:17:55.684 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:17:55.684 INFO:teuthology.orchestra.run.smithi103.stdout:37: brx.2@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:17:55.685 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether a6:ff:ab:51:83:b6 brd ff:ff:ff:ff:ff:ff link-netnsid 2 2020-04-22T14:17:55.685 INFO:teuthology.orchestra.run.smithi103.stdout:39: brx.0@if2: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:17:55.685 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 12:89:28:89:ea:00 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:17:55.685 INFO:teuthology.orchestra.run.smithi103.stdout:40: brx.3@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:17:55.685 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether de:47:69:02:b1:ec brd ff:ff:ff:ff:ff:ff link-netnsid 3 2020-04-22T14:17:55.686 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-04-22T14:17:55.686 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:55.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:55.729 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:17:55.814 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:55.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:55.856 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge con-name ceph-brx ifname ceph-brx stp no' 2020-04-22T14:17:55.968 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' (4e449cd8-fab2-459e-9b05-3d27ccd38110) successfully added. 2020-04-22T14:17:55.969 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:55.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:55.990 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection modify ceph-brx ipv4.addresses 192.168.255.254/16 ipv4.method manual' 2020-04-22T14:17:56.098 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:56.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:56.134 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up ceph-brx' 2020-04-22T14:17:56.245 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (master waiting for slaves) (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/52) 2020-04-22T14:17:56.245 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:56.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:56.259 INFO:teuthology.orchestra.run.smithi103:> touch /tmp/python-ceph-brx 2020-04-22T14:17:56.324 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:56.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:56.375 INFO:teuthology.orchestra.run.smithi103:> cat /proc/sys/net/ipv4/ip_forward 2020-04-22T14:17:56.439 INFO:teuthology.orchestra.run.smithi103.stdout:0 2020-04-22T14:17:56.440 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:56.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:56.485 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 0 > /tmp/python-ceph-brx' 2020-04-22T14:17:56.561 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:56.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:56.611 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 1 > /proc/sys/net/ipv4/ip_forward' 2020-04-22T14:17:56.686 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:56.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:56.732 INFO:teuthology.orchestra.run.smithi103:> route 2020-04-22T14:17:56.795 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2020-04-22T14:17:56.795 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-04-22T14:17:56.796 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 102 0 0 enp3s0f1 2020-04-22T14:17:56.796 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 102 0 0 enp3s0f1 2020-04-22T14:17:56.796 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 425 0 0 ceph-brx 2020-04-22T14:17:56.796 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:56.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:56.842 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-04-22T14:17:56.917 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:56.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:56.964 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-04-22T14:17:57.044 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:57.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:57.084 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-04-22T14:17:57.159 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:57.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:57.206 INFO:teuthology.orchestra.run.smithi103:> ip netns list 2020-04-22T14:17:57.264 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:57.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:57.313 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:17:57.373 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 2020-04-22T14:17:57.373 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 2 2020-04-22T14:17:57.373 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 3 2020-04-22T14:17:57.374 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:57.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:57.420 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:17:57.479 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 2020-04-22T14:17:57.479 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 2 2020-04-22T14:17:57.479 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 3 2020-04-22T14:17:57.480 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:57.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:57.527 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:17:57.603 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:57.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:57.650 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 1' 2020-04-22T14:17:57.725 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-04-22T14:17:57.725 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:57.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:57.771 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.1' 2020-04-22T14:17:57.848 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:57.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:57.895 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0' 2020-04-22T14:17:58.003 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:58.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:58.017 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up' 2020-04-22T14:17:58.125 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:58.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:58.138 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up' 2020-04-22T14:17:58.249 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:58.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:58.262 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254' 2020-04-22T14:17:58.378 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:58.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:58.392 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:17:58.471 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:58.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:58.517 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge-slave con-name brx.1 ifname brx.1 master ceph-brx' 2020-04-22T14:17:58.625 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.1' (024dd04c-850f-42e1-8160-b89c78fe30f9) successfully added. 2020-04-22T14:17:58.625 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:58.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:17:58.659 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up brx.1' 2020-04-22T14:17:58.818 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/53) 2020-04-22T14:17:58.920 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-04-22T14:17:58.920 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi103.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-04-22T14:17:58.920 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:58.946 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:17:58.946 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:17:59.005 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:59.053 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:17:59.053 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:17:59.121 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:17:59.128 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:17:59.128 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:59.174 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:17:59.175 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:17:59.234 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-04-22T14:17:59.234 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:59.282 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:17:59.324 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:59.338 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:17:59.338 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:17:59.407 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:17:59.414 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:2020-04-22T14:17:59.412+0000 7fc69aa0a1c0 -1 init, newargv = 0x5639d7e7c3a0 newargc=9 2020-04-22T14:17:59.415 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[115165]: starting ceph client 2020-04-22T14:17:59.416 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:17:59.416 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:59.419 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[115165]: starting fuse 2020-04-22T14:17:59.433 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:17:59.434 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:17:59.493 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:17:59.493 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2020-04-22T14:17:59.493 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:59.542 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:17:59.542 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:17:59.542 INFO:teuthology.orchestra.run.smithi103:> import glob 2020-04-22T14:17:59.542 INFO:teuthology.orchestra.run.smithi103:> import re 2020-04-22T14:17:59.543 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:17:59.543 INFO:teuthology.orchestra.run.smithi103:> import subprocess 2020-04-22T14:17:59.543 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:17:59.543 INFO:teuthology.orchestra.run.smithi103:> def find_socket(client_name): 2020-04-22T14:17:59.543 INFO:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-04-22T14:17:59.543 INFO:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2020-04-22T14:17:59.543 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:17:59.543 INFO:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2020-04-22T14:17:59.543 INFO:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2020-04-22T14:17:59.544 INFO:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2020-04-22T14:17:59.544 INFO:teuthology.orchestra.run.smithi103:> return files[0] 2020-04-22T14:17:59.544 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:17:59.544 INFO:teuthology.orchestra.run.smithi103:> for f in files: 2020-04-22T14:17:59.544 INFO:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:17:59.544 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:17:59.544 INFO:teuthology.orchestra.run.smithi103:> return f 2020-04-22T14:17:59.545 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:17:59.545 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:17:59.545 INFO:teuthology.orchestra.run.smithi103:> print(find_socket("client.0")) 2020-04-22T14:17:59.545 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:17:59.651 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.0.115165.asok 2020-04-22T14:17:59.651 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.115165.asok 2020-04-22T14:17:59.651 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:59.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:17:59.665 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.115165.asok status 2020-04-22T14:17:59.822 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:17:59.822 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2020-04-22T14:17:59.822 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:17:59.823 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:17:59.823 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "0", 2020-04-22T14:17:59.823 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:17:59.823 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-04-22T14:17:59.823 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "115165", 2020-04-22T14:17:59.824 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:17:59.824 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:59.824 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2020-04-22T14:17:59.824 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2020-04-22T14:17:59.824 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 9502, 2020-04-22T14:17:59.824 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2020-04-22T14:17:59.825 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:17:59.825 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:17:59.825 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 9502 2020-04-22T14:17:59.825 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:59.825 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:17:59.825 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:17:59.825 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:17:59.826 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 2252453520 2020-04-22T14:17:59.826 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:17:59.826 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:59.826 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:17:59.826 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:17:59.826 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:17:59.826 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 2252453520 2020-04-22T14:17:59.827 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:17:59.827 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.9502 192.168.0.1:0/2252453520", 2020-04-22T14:17:59.827 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.1:0/2252453520", 2020-04-22T14:17:59.827 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2020-04-22T14:17:59.827 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 101, 2020-04-22T14:17:59.827 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 135, 2020-04-22T14:17:59.828 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2020-04-22T14:17:59.828 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklisted": false 2020-04-22T14:17:59.828 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:17:59.829 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:59.843 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:17:59.843 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-22T14:17:59.843 INFO:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:17:59.907 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2020-04-22T14:17:59.908 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-04-22T14:17:59.908 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:17:59.957 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:17:59.957 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:18:00.035 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:00.090 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:18:00.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.234+0000 7f6e67a1d700 1 Processor -- start 2020-04-22T14:18:00.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.234+0000 7f6e67a1d700 1 -- start start 2020-04-22T14:18:00.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.235+0000 7f6e67a1d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6e60065fe0 0x7f6e601464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:18:00.244 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.235+0000 7f6e67a1d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6e60063e30 0x7f6e600642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:18:00.244 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.235+0000 7f6e67a1d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e60143300 con 0x7f6e6012c0d0 2020-04-22T14:18:00.244 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.235+0000 7f6e67a1d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e601435a0 con 0x7f6e60065fe0 2020-04-22T14:18:00.244 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.235+0000 7f6e67a1d700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e60143840 con 0x7f6e60063e30 2020-04-22T14:18:00.244 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.235+0000 7f6e65fba700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6e60063e30 0x7f6e600642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:00.244 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.235+0000 7f6e657b9700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f6e6012c0d0 0x7f6e6005b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49918/0 (socket says 172.21.15.103:49918) 2020-04-22T14:18:00.244 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.235+0000 7f6e65fba700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6e60063e30 0x7f6e600642c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57728/0 (socket says 172.21.15.103:57728) 2020-04-22T14:18:00.246 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.235+0000 7f6e657b9700 1 -- 172.21.15.103:0/1557769547 learned_addr learned my addr 172.21.15.103:0/1557769547 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:18:00.246 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.235+0000 7f6e64fb8700 1 --2- 172.21.15.103:0/1557769547 >> v2:172.21.15.86:3300/0 conn(0x7f6e60065fe0 0x7f6e601464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:00.246 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.235+0000 7f6e65fba700 1 -- 172.21.15.103:0/1557769547 >> v2:172.21.15.86:3300/0 conn(0x7f6e60065fe0 msgr2=0x7f6e601464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:18:00.247 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.235+0000 7f6e65fba700 1 --2- 172.21.15.103:0/1557769547 >> v2:172.21.15.86:3300/0 conn(0x7f6e60065fe0 0x7f6e601464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:18:00.247 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.235+0000 7f6e65fba700 1 -- 172.21.15.103:0/1557769547 >> v1:172.21.15.103:6789/0 conn(0x7f6e6012c0d0 legacy=0x7f6e6005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:00.247 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.235+0000 7f6e4ffff700 1 -- 172.21.15.103:0/1557769547 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3581386894 0 0) 0x7f6e60143300 con 0x7f6e6012c0d0 2020-04-22T14:18:00.247 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.235+0000 7f6e65fba700 1 -- 172.21.15.103:0/1557769547 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e6005bb50 con 0x7f6e60063e30 2020-04-22T14:18:00.247 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.235+0000 7f6e64fb8700 1 --2- 172.21.15.103:0/1557769547 >> v2:172.21.15.86:3300/0 conn(0x7f6e60065fe0 0x7f6e601464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:18:00.247 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.235+0000 7f6e65fba700 1 --2- 172.21.15.103:0/1557769547 >> v2:172.21.15.103:3300/0 conn(0x7f6e60063e30 0x7f6e600642c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6e580032b0 tx=0x7f6e58007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.247 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.235+0000 7f6e65fba700 1 --2- 172.21.15.103:0/1557769547 >> v2:172.21.15.103:3300/0 conn(0x7f6e60063e30 0x7f6e600642c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6e580032b0 tx=0x7f6e58007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.248 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.235+0000 7f6e65fba700 1 --2- 172.21.15.103:0/1557769547 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e60063e30 0x7f6e600642c0 secure :-1 s=READY pgs=1942 cs=0 l=1 rx=0x7f6e580032b0 tx=0x7f6e58007dc0).ready entity=mon.1 client_cookie=97f6bf773152770 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:18:00.248 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.236+0000 7f6e65fba700 1 --2- 172.21.15.103:0/1557769547 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e60063e30 0x7f6e600642c0 secure :-1 s=THROTTLE_DONE pgs=1942 cs=0 l=1 rx=0x7f6e580032b0 tx=0x7f6e58007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.248 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.236+0000 7f6e4ffff700 1 -- 172.21.15.103:0/1557769547 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e5800a180 con 0x7f6e60063e30 2020-04-22T14:18:00.248 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.236+0000 7f6e65fba700 1 --2- 172.21.15.103:0/1557769547 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e60063e30 0x7f6e600642c0 secure :-1 s=THROTTLE_DONE pgs=1942 cs=0 l=1 rx=0x7f6e580032b0 tx=0x7f6e58007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.248 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.236+0000 7f6e4ffff700 1 -- 172.21.15.103:0/1557769547 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e5800a2e0 con 0x7f6e60063e30 2020-04-22T14:18:00.248 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.236+0000 7f6e65fba700 1 --2- 172.21.15.103:0/1557769547 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e60063e30 0x7f6e600642c0 secure :-1 s=THROTTLE_DONE pgs=1942 cs=0 l=1 rx=0x7f6e580032b0 tx=0x7f6e58007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.248 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.236+0000 7f6e4ffff700 1 -- 172.21.15.103:0/1557769547 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e5800a6c0 con 0x7f6e60063e30 2020-04-22T14:18:00.248 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.236+0000 7f6e67a1d700 1 -- 172.21.15.103:0/1557769547 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e60063e30 msgr2=0x7f6e600642c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:00.249 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.236+0000 7f6e67a1d700 1 --2- 172.21.15.103:0/1557769547 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e60063e30 0x7f6e600642c0 secure :-1 s=READY pgs=1942 cs=0 l=1 rx=0x7f6e580032b0 tx=0x7f6e58007dc0).stop 2020-04-22T14:18:00.249 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.236+0000 7f6e67a1d700 1 -- 172.21.15.103:0/1557769547 shutdown_connections 2020-04-22T14:18:00.249 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.236+0000 7f6e67a1d700 1 --2- 172.21.15.103:0/1557769547 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e60063e30 0x7f6e600642c0 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:00.249 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.236+0000 7f6e67a1d700 1 --2- 172.21.15.103:0/1557769547 >> v2:172.21.15.86:3300/0 conn(0x7f6e60065fe0 0x7f6e601464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:18:00.249 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.236+0000 7f6e67a1d700 1 -- 172.21.15.103:0/1557769547 >> 172.21.15.103:0/1557769547 conn(0x7f6e600b9160 msgr2=0x7f6e6005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:18:00.249 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.236+0000 7f6e67a1d700 1 -- 172.21.15.103:0/1557769547 shutdown_connections 2020-04-22T14:18:00.249 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.236+0000 7f6e67a1d700 1 -- 172.21.15.103:0/1557769547 wait complete. 2020-04-22T14:18:00.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.237+0000 7f6e67a1d700 1 Processor -- start 2020-04-22T14:18:00.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.237+0000 7f6e67a1d700 1 -- start start 2020-04-22T14:18:00.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.238+0000 7f6e67a1d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6e60063e30 0x7f6e600b55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:18:00.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.238+0000 7f6e67a1d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6e60065fe0 0x7f6e601518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:18:00.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.238+0000 7f6e67a1d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e601447f0 con 0x7f6e6012c0d0 2020-04-22T14:18:00.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.238+0000 7f6e67a1d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e60144a90 con 0x7f6e60065fe0 2020-04-22T14:18:00.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.238+0000 7f6e67a1d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e60144d30 con 0x7f6e60063e30 2020-04-22T14:18:00.250 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.238+0000 7f6e65fba700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f6e6012c0d0 0x7f6e601542c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49924/0 (socket says 172.21.15.103:49924) 2020-04-22T14:18:00.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.238+0000 7f6e65fba700 1 -- 172.21.15.103:0/3529768982 learned_addr learned my addr 172.21.15.103:0/3529768982 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:18:00.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.238+0000 7f6e657b9700 1 --2- 172.21.15.103:0/3529768982 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6e60063e30 0x7f6e600b55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:00.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.238+0000 7f6e64fb8700 1 --2- 172.21.15.103:0/3529768982 >> v2:172.21.15.86:3300/0 conn(0x7f6e60065fe0 0x7f6e601518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:00.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.238+0000 7f6e4e7fc700 1 -- 172.21.15.103:0/3529768982 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2454123576 0 0) 0x7f6e601447f0 con 0x7f6e6012c0d0 2020-04-22T14:18:00.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.238+0000 7f6e4e7fc700 1 -- 172.21.15.103:0/3529768982 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e40002fe0 con 0x7f6e6012c0d0 2020-04-22T14:18:00.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.238+0000 7f6e4e7fc700 1 -- 172.21.15.103:0/3529768982 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 160694981 0 0) 0x7f6e40002fe0 con 0x7f6e6012c0d0 2020-04-22T14:18:00.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.238+0000 7f6e4e7fc700 1 -- 172.21.15.103:0/3529768982 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6e601447f0 con 0x7f6e6012c0d0 2020-04-22T14:18:00.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.238+0000 7f6e4e7fc700 1 -- 172.21.15.103:0/3529768982 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f6e580089e0 con 0x7f6e6012c0d0 2020-04-22T14:18:00.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.238+0000 7f6e4e7fc700 1 -- 172.21.15.103:0/3529768982 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6e60063e30 msgr2=0x7f6e600b55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:00.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.238+0000 7f6e4e7fc700 1 --2- 172.21.15.103:0/3529768982 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6e60063e30 0x7f6e600b55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:00.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.238+0000 7f6e4e7fc700 1 -- 172.21.15.103:0/3529768982 >> v2:172.21.15.86:3300/0 conn(0x7f6e60065fe0 msgr2=0x7f6e601518e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:00.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.238+0000 7f6e4e7fc700 1 --2- 172.21.15.103:0/3529768982 >> v2:172.21.15.86:3300/0 conn(0x7f6e60065fe0 0x7f6e601518e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:00.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.238+0000 7f6e4e7fc700 1 -- 172.21.15.103:0/3529768982 >> v1:172.21.15.103:6789/0 conn(0x7f6e6012c0d0 legacy=0x7f6e601542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:00.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.238+0000 7f6e4e7fc700 1 --2- 172.21.15.103:0/3529768982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e400049b0 0x7f6e40004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:18:00.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.238+0000 7f6e4e7fc700 1 --2- 172.21.15.103:0/3529768982 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6e60063e30 0x7f6e40003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:18:00.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.239+0000 7f6e4e7fc700 1 --2- 172.21.15.103:0/3529768982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e40003d80 0x7f6e40004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:18:00.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.239+0000 7f6e4e7fc700 1 -- 172.21.15.103:0/3529768982 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e60144a90 con 0x7f6e40003d80 2020-04-22T14:18:00.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.239+0000 7f6e4e7fc700 1 -- 172.21.15.103:0/3529768982 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e60144d30 con 0x7f6e400049b0 2020-04-22T14:18:00.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.239+0000 7f6e4e7fc700 1 -- 172.21.15.103:0/3529768982 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e400047a0 con 0x7f6e60063e30 2020-04-22T14:18:00.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.239+0000 7f6e657b9700 1 --2- 172.21.15.103:0/3529768982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e400049b0 0x7f6e40004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:00.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.239+0000 7f6e64fb8700 1 --2- 172.21.15.103:0/3529768982 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6e60063e30 0x7f6e40003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:00.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.239+0000 7f6e65fba700 1 --2- 172.21.15.103:0/3529768982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e40003d80 0x7f6e40004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:00.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.239+0000 7f6e657b9700 1 -- 172.21.15.103:0/3529768982 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6e60063e30 msgr2=0x7f6e40003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:00.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.239+0000 7f6e657b9700 1 --2- 172.21.15.103:0/3529768982 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6e60063e30 0x7f6e40003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:00.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.239+0000 7f6e657b9700 1 -- 172.21.15.103:0/3529768982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e40003d80 msgr2=0x7f6e40004200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:00.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.239+0000 7f6e657b9700 1 --2- 172.21.15.103:0/3529768982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e40003d80 0x7f6e40004200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:00.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.239+0000 7f6e657b9700 1 -- 172.21.15.103:0/3529768982 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e60151d40 con 0x7f6e400049b0 2020-04-22T14:18:00.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.239+0000 7f6e65fba700 1 --2- 172.21.15.103:0/3529768982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e40003d80 0x7f6e40004200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:18:00.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.239+0000 7f6e67a1d700 1 -- 172.21.15.103:0/3529768982 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e601444e0 con 0x7f6e400049b0 2020-04-22T14:18:00.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.239+0000 7f6e657b9700 1 --2- 172.21.15.103:0/3529768982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e400049b0 0x7f6e40004dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6e50000b80 tx=0x7f6e50010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.239+0000 7f6e64fb8700 1 --2- 172.21.15.103:0/3529768982 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6e60063e30 0x7f6e40003920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:18:00.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.239+0000 7f6e657b9700 1 --2- 172.21.15.103:0/3529768982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e400049b0 0x7f6e40004dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6e50000b80 tx=0x7f6e50010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.239+0000 7f6e657b9700 1 --2- 172.21.15.103:0/3529768982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e400049b0 0x7f6e40004dd0 secure :-1 s=READY pgs=1944 cs=0 l=1 rx=0x7f6e50000b80 tx=0x7f6e50010d90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:18:00.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.239+0000 7f6e657b9700 1 --2- 172.21.15.103:0/3529768982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e400049b0 0x7f6e40004dd0 secure :-1 s=THROTTLE_DONE pgs=1944 cs=0 l=1 rx=0x7f6e50000b80 tx=0x7f6e50010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.239+0000 7f6e67a1d700 1 -- 172.21.15.103:0/3529768982 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e601549d0 con 0x7f6e400049b0 2020-04-22T14:18:00.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.239+0000 7f6e4e7fc700 1 -- 172.21.15.103:0/3529768982 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e50012780 con 0x7f6e400049b0 2020-04-22T14:18:00.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.239+0000 7f6e657b9700 1 --2- 172.21.15.103:0/3529768982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e400049b0 0x7f6e40004dd0 secure :-1 s=THROTTLE_DONE pgs=1944 cs=0 l=1 rx=0x7f6e50000b80 tx=0x7f6e50010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.239+0000 7f6e4e7fc700 1 -- 172.21.15.103:0/3529768982 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e500128e0 con 0x7f6e400049b0 2020-04-22T14:18:00.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.239+0000 7f6e657b9700 1 --2- 172.21.15.103:0/3529768982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e400049b0 0x7f6e40004dd0 secure :-1 s=THROTTLE_DONE pgs=1944 cs=0 l=1 rx=0x7f6e50000b80 tx=0x7f6e50010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.239+0000 7f6e4e7fc700 1 -- 172.21.15.103:0/3529768982 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e50012d00 con 0x7f6e400049b0 2020-04-22T14:18:00.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.240+0000 7f6e657b9700 1 --2- 172.21.15.103:0/3529768982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e400049b0 0x7f6e40004dd0 secure :-1 s=THROTTLE_DONE pgs=1944 cs=0 l=1 rx=0x7f6e50000b80 tx=0x7f6e50010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.240+0000 7f6e67a1d700 1 -- 172.21.15.103:0/3529768982 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e60056c90 con 0x7f6e400049b0 2020-04-22T14:18:00.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.240+0000 7f6e4e7fc700 1 -- 172.21.15.103:0/3529768982 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f6e5000c630 con 0x7f6e400049b0 2020-04-22T14:18:00.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.240+0000 7f6e657b9700 1 --2- 172.21.15.103:0/3529768982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e400049b0 0x7f6e40004dd0 secure :-1 s=THROTTLE_DONE pgs=1944 cs=0 l=1 rx=0x7f6e50000b80 tx=0x7f6e50010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.240+0000 7f6e4e7fc700 1 --2- 172.21.15.103:0/3529768982 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6e400559a0 0x7f6e40057e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:18:00.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.240+0000 7f6e4e7fc700 1 -- 172.21.15.103:0/3529768982 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6e50061680 con 0x7f6e400049b0 2020-04-22T14:18:00.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.241+0000 7f6e64fb8700 1 --2- 172.21.15.103:0/3529768982 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6e400559a0 0x7f6e40057e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:00.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.241+0000 7f6e64fb8700 1 --2- 172.21.15.103:0/3529768982 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6e400559a0 0x7f6e40057e60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6e5c002f30 tx=0x7f6e5c00d860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.241+0000 7f6e64fb8700 1 --2- 172.21.15.103:0/3529768982 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6e400559a0 0x7f6e40057e60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6e5c002f30 tx=0x7f6e5c00d860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.241+0000 7f6e64fb8700 1 --2- 172.21.15.103:0/3529768982 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6e400559a0 0x7f6e40057e60 secure :-1 s=READY pgs=708 cs=0 l=1 rx=0x7f6e5c002f30 tx=0x7f6e5c00d860).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:18:00.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.244+0000 7f6e657b9700 1 --2- 172.21.15.103:0/3529768982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e400049b0 0x7f6e40004dd0 secure :-1 s=THROTTLE_DONE pgs=1944 cs=0 l=1 rx=0x7f6e50000b80 tx=0x7f6e50010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.244+0000 7f6e4e7fc700 1 -- 172.21.15.103:0/3529768982 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f6e5003cb20 con 0x7f6e400049b0 2020-04-22T14:18:00.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.388+0000 7f6e67a1d700 1 -- 172.21.15.103:0/3529768982 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e6012c610 con 0x7f6e400049b0 2020-04-22T14:18:00.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.389+0000 7f6e657b9700 1 --2- 172.21.15.103:0/3529768982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e400049b0 0x7f6e40004dd0 secure :-1 s=THROTTLE_DONE pgs=1944 cs=0 l=1 rx=0x7f6e50000b80 tx=0x7f6e50010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.389+0000 7f6e4e7fc700 1 -- 172.21.15.103:0/3529768982 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+16103 (secure 0 0 0) 0x7f6e50012e60 con 0x7f6e400049b0 2020-04-22T14:18:00.392 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:18:00.392 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":135,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:17:49.007669+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:17:45.940111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2020-04-22T14:17:46.960856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:18:00.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.391+0000 7f6e67a1d700 1 -- 172.21.15.103:0/3529768982 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6e400559a0 msgr2=0x7f6e40057e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:00.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.391+0000 7f6e67a1d700 1 --2- 172.21.15.103:0/3529768982 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6e400559a0 0x7f6e40057e60 secure :-1 s=READY pgs=708 cs=0 l=1 rx=0x7f6e5c002f30 tx=0x7f6e5c00d860).stop 2020-04-22T14:18:00.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.391+0000 7f6e67a1d700 1 -- 172.21.15.103:0/3529768982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e400049b0 msgr2=0x7f6e40004dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:00.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.391+0000 7f6e67a1d700 1 --2- 172.21.15.103:0/3529768982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e400049b0 0x7f6e40004dd0 secure :-1 s=READY pgs=1944 cs=0 l=1 rx=0x7f6e50000b80 tx=0x7f6e50010d90).stop 2020-04-22T14:18:00.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.391+0000 7f6e65fba700 1 -- 172.21.15.103:0/3529768982 reap_dead start 2020-04-22T14:18:00.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.391+0000 7f6e67a1d700 1 -- 172.21.15.103:0/3529768982 shutdown_connections 2020-04-22T14:18:00.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.391+0000 7f6e67a1d700 1 --2- 172.21.15.103:0/3529768982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e400049b0 0x7f6e40004dd0 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:00.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.391+0000 7f6e67a1d700 1 -- 172.21.15.103:0/3529768982 >> 172.21.15.103:0/3529768982 conn(0x7f6e600b9160 msgr2=0x7f6e6012b040 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:18:00.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.391+0000 7f6e67a1d700 1 -- 172.21.15.103:0/3529768982 shutdown_connections 2020-04-22T14:18:00.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.391+0000 7f6e67a1d700 1 -- 172.21.15.103:0/3529768982 wait complete. 2020-04-22T14:18:00.403 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:17:45.940111+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 23, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'134', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:17:46.960856+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 24, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'135', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:18:00.404 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:00.417 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:18:00.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.565+0000 7f1b61871700 1 Processor -- start 2020-04-22T14:18:00.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.565+0000 7f1b61871700 1 -- start start 2020-04-22T14:18:00.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.566+0000 7f1b61871700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1b5c0b9140 0x7f1b5c12b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:18:00.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.566+0000 7f1b61871700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1b5c0ac950 0x7f1b5c12b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:18:00.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.566+0000 7f1b61871700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1b5c146c40 0x7f1b5c1470f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:18:00.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.566+0000 7f1b61871700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b5c0602f0 con 0x7f1b5c146c40 2020-04-22T14:18:00.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.566+0000 7f1b61871700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b5c1467e0 con 0x7f1b5c0b9140 2020-04-22T14:18:00.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.566+0000 7f1b61871700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5c060050 con 0x7f1b5c0ac950 2020-04-22T14:18:00.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.566+0000 7f1b5affd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1b5c0b9140 0x7f1b5c12b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:00.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.566+0000 7f1b5affd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1b5c0b9140 0x7f1b5c12b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57746/0 (socket says 172.21.15.103:57746) 2020-04-22T14:18:00.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.566+0000 7f1b5affd700 1 -- 172.21.15.103:0/184504183 learned_addr learned my addr 172.21.15.103:0/184504183 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:18:00.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.566+0000 7f1b5b7fe700 1 --2- 172.21.15.103:0/184504183 >> v2:172.21.15.86:3300/0 conn(0x7f1b5c146c40 0x7f1b5c1470f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:00.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.566+0000 7f1b5a7fc700 1 --2- 172.21.15.103:0/184504183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1b5c0ac950 0x7f1b5c12b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:00.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.566+0000 7f1b5affd700 1 -- 172.21.15.103:0/184504183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1b5c0ac950 msgr2=0x7f1b5c12b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:18:00.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.566+0000 7f1b5affd700 1 --2- 172.21.15.103:0/184504183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1b5c0ac950 0x7f1b5c12b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:18:00.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.566+0000 7f1b5affd700 1 -- 172.21.15.103:0/184504183 >> v2:172.21.15.86:3300/0 conn(0x7f1b5c146c40 msgr2=0x7f1b5c1470f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:18:00.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.566+0000 7f1b5affd700 1 --2- 172.21.15.103:0/184504183 >> v2:172.21.15.86:3300/0 conn(0x7f1b5c146c40 0x7f1b5c1470f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:18:00.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.566+0000 7f1b5affd700 1 -- 172.21.15.103:0/184504183 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5c0b9520 con 0x7f1b5c0b9140 2020-04-22T14:18:00.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.566+0000 7f1b5affd700 1 --2- 172.21.15.103:0/184504183 >> v2:172.21.15.103:3300/0 conn(0x7f1b5c0b9140 0x7f1b5c12b210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1b50002f30 tx=0x7f1b50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.567+0000 7f1b5affd700 1 --2- 172.21.15.103:0/184504183 >> v2:172.21.15.103:3300/0 conn(0x7f1b5c0b9140 0x7f1b5c12b210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1b50002f30 tx=0x7f1b50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.567+0000 7f1b5affd700 1 --2- 172.21.15.103:0/184504183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b5c0b9140 0x7f1b5c12b210 secure :-1 s=READY pgs=1945 cs=0 l=1 rx=0x7f1b50002f30 tx=0x7f1b50007a40).ready entity=mon.1 client_cookie=92084b3d74e8999d server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:18:00.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.567+0000 7f1b5affd700 1 --2- 172.21.15.103:0/184504183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b5c0b9140 0x7f1b5c12b210 secure :-1 s=THROTTLE_DONE pgs=1945 cs=0 l=1 rx=0x7f1b50002f30 tx=0x7f1b50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.567+0000 7f1b59ffb700 1 -- 172.21.15.103:0/184504183 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b50011720 con 0x7f1b5c0b9140 2020-04-22T14:18:00.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.567+0000 7f1b5affd700 1 --2- 172.21.15.103:0/184504183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b5c0b9140 0x7f1b5c12b210 secure :-1 s=THROTTLE_DONE pgs=1945 cs=0 l=1 rx=0x7f1b50002f30 tx=0x7f1b50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.567+0000 7f1b59ffb700 1 -- 172.21.15.103:0/184504183 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b50011880 con 0x7f1b5c0b9140 2020-04-22T14:18:00.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.567+0000 7f1b5affd700 1 --2- 172.21.15.103:0/184504183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b5c0b9140 0x7f1b5c12b210 secure :-1 s=THROTTLE_DONE pgs=1945 cs=0 l=1 rx=0x7f1b50002f30 tx=0x7f1b50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.567+0000 7f1b59ffb700 1 -- 172.21.15.103:0/184504183 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b50011ca0 con 0x7f1b5c0b9140 2020-04-22T14:18:00.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.567+0000 7f1b61871700 1 -- 172.21.15.103:0/184504183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b5c0b9140 msgr2=0x7f1b5c12b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:00.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.567+0000 7f1b61871700 1 --2- 172.21.15.103:0/184504183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b5c0b9140 0x7f1b5c12b210 secure :-1 s=READY pgs=1945 cs=0 l=1 rx=0x7f1b50002f30 tx=0x7f1b50007a40).stop 2020-04-22T14:18:00.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.567+0000 7f1b61871700 1 -- 172.21.15.103:0/184504183 shutdown_connections 2020-04-22T14:18:00.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.567+0000 7f1b61871700 1 --2- 172.21.15.103:0/184504183 >> v2:172.21.15.86:3300/0 conn(0x7f1b5c146c40 0x7f1b5c1470f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:18:00.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.567+0000 7f1b61871700 1 --2- 172.21.15.103:0/184504183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b5c0b9140 0x7f1b5c12b210 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:00.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.567+0000 7f1b61871700 1 --2- 172.21.15.103:0/184504183 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1b5c0ac950 0x7f1b5c12b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:18:00.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.567+0000 7f1b61871700 1 -- 172.21.15.103:0/184504183 >> 172.21.15.103:0/184504183 conn(0x7f1b5c05b7b0 msgr2=0x7f1b5c0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:18:00.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.567+0000 7f1b61871700 1 -- 172.21.15.103:0/184504183 shutdown_connections 2020-04-22T14:18:00.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.567+0000 7f1b61871700 1 -- 172.21.15.103:0/184504183 wait complete. 2020-04-22T14:18:00.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.568+0000 7f1b61871700 1 Processor -- start 2020-04-22T14:18:00.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.568+0000 7f1b61871700 1 -- start start 2020-04-22T14:18:00.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.569+0000 7f1b61871700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1b5c0ac950 0x7f1b5c0660b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:18:00.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.569+0000 7f1b61871700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1b5c146c40 0x7f1b5c0b1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:18:00.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.569+0000 7f1b61871700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b5c066bf0 con 0x7f1b5c0b9140 2020-04-22T14:18:00.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.569+0000 7f1b61871700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b5c066a10 con 0x7f1b5c0ac950 2020-04-22T14:18:00.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.569+0000 7f1b61871700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5c154ad0 con 0x7f1b5c146c40 2020-04-22T14:18:00.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.569+0000 7f1b5affd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1b5c0ac950 0x7f1b5c0660b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:00.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.569+0000 7f1b5affd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1b5c0ac950 0x7f1b5c0660b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57750/0 (socket says 172.21.15.103:57750) 2020-04-22T14:18:00.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.569+0000 7f1b5affd700 1 -- 172.21.15.103:0/1160128531 learned_addr learned my addr 172.21.15.103:0/1160128531 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:18:00.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.569+0000 7f1b5b7fe700 1 --2- 172.21.15.103:0/1160128531 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1b5c146c40 0x7f1b5c0b1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:00.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.569+0000 7f1b5affd700 1 -- 172.21.15.103:0/1160128531 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1b5c146c40 msgr2=0x7f1b5c0b1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:00.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.569+0000 7f1b5affd700 1 --2- 172.21.15.103:0/1160128531 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1b5c146c40 0x7f1b5c0b1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:00.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.569+0000 7f1b5affd700 1 -- 172.21.15.103:0/1160128531 >> v1:172.21.15.86:6789/0 conn(0x7f1b5c0b9140 legacy=0x7f1b5c1514d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:00.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.569+0000 7f1b5affd700 1 -- 172.21.15.103:0/1160128531 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5c151be0 con 0x7f1b5c0ac950 2020-04-22T14:18:00.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.569+0000 7f1b5affd700 1 --2- 172.21.15.103:0/1160128531 >> v2:172.21.15.103:3300/0 conn(0x7f1b5c0ac950 0x7f1b5c0660b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1b50002f30 tx=0x7f1b50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.569+0000 7f1b5affd700 1 --2- 172.21.15.103:0/1160128531 >> v2:172.21.15.103:3300/0 conn(0x7f1b5c0ac950 0x7f1b5c0660b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1b50002f30 tx=0x7f1b50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.569+0000 7f1b5affd700 1 --2- 172.21.15.103:0/1160128531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b5c0ac950 0x7f1b5c0660b0 secure :-1 s=READY pgs=1946 cs=0 l=1 rx=0x7f1b50002f30 tx=0x7f1b50007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:18:00.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.570+0000 7f1b5affd700 1 --2- 172.21.15.103:0/1160128531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b5c0ac950 0x7f1b5c0660b0 secure :-1 s=THROTTLE_DONE pgs=1946 cs=0 l=1 rx=0x7f1b50002f30 tx=0x7f1b50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.570+0000 7f1b4bfff700 1 -- 172.21.15.103:0/1160128531 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b50011d50 con 0x7f1b5c0ac950 2020-04-22T14:18:00.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.570+0000 7f1b5affd700 1 --2- 172.21.15.103:0/1160128531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b5c0ac950 0x7f1b5c0660b0 secure :-1 s=THROTTLE_DONE pgs=1946 cs=0 l=1 rx=0x7f1b50002f30 tx=0x7f1b50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.570+0000 7f1b5affd700 1 --2- 172.21.15.103:0/1160128531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b5c0ac950 0x7f1b5c0660b0 secure :-1 s=THROTTLE_DONE pgs=1946 cs=0 l=1 rx=0x7f1b50002f30 tx=0x7f1b50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.570+0000 7f1b4bfff700 1 -- 172.21.15.103:0/1160128531 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b50007360 con 0x7f1b5c0ac950 2020-04-22T14:18:00.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.570+0000 7f1b61871700 1 -- 172.21.15.103:0/1160128531 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b5c066510 con 0x7f1b5c0ac950 2020-04-22T14:18:00.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.570+0000 7f1b4bfff700 1 -- 172.21.15.103:0/1160128531 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b50007510 con 0x7f1b5c0ac950 2020-04-22T14:18:00.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.570+0000 7f1b61871700 1 -- 172.21.15.103:0/1160128531 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b5c0b5ec0 con 0x7f1b5c0ac950 2020-04-22T14:18:00.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.570+0000 7f1b5affd700 1 --2- 172.21.15.103:0/1160128531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b5c0ac950 0x7f1b5c0660b0 secure :-1 s=THROTTLE_DONE pgs=1946 cs=0 l=1 rx=0x7f1b50002f30 tx=0x7f1b50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.571+0000 7f1b61871700 1 -- 172.21.15.103:0/1160128531 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b5c0b2230 con 0x7f1b5c0ac950 2020-04-22T14:18:00.581 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.571+0000 7f1b4bfff700 1 -- 172.21.15.103:0/1160128531 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f1b500058b0 con 0x7f1b5c0ac950 2020-04-22T14:18:00.582 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.571+0000 7f1b5affd700 1 --2- 172.21.15.103:0/1160128531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b5c0ac950 0x7f1b5c0660b0 secure :-1 s=THROTTLE_DONE pgs=1946 cs=0 l=1 rx=0x7f1b50002f30 tx=0x7f1b50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.582 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.571+0000 7f1b4bfff700 1 --2- 172.21.15.103:0/1160128531 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1b3804d9e0 0x7f1b3804fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:18:00.582 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.571+0000 7f1b4bfff700 1 -- 172.21.15.103:0/1160128531 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1b50061bd0 con 0x7f1b5c0ac950 2020-04-22T14:18:00.582 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.571+0000 7f1b5a7fc700 1 --2- 172.21.15.103:0/1160128531 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1b3804d9e0 0x7f1b3804fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:00.582 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.571+0000 7f1b5a7fc700 1 --2- 172.21.15.103:0/1160128531 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1b3804d9e0 0x7f1b3804fea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1b5c0b2940 tx=0x7f1b4c008d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.582 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.572+0000 7f1b5a7fc700 1 --2- 172.21.15.103:0/1160128531 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1b3804d9e0 0x7f1b3804fea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1b5c0b2940 tx=0x7f1b4c008d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.582 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.572+0000 7f1b5a7fc700 1 --2- 172.21.15.103:0/1160128531 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1b3804d9e0 0x7f1b3804fea0 secure :-1 s=READY pgs=709 cs=0 l=1 rx=0x7f1b5c0b2940 tx=0x7f1b4c008d00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:18:00.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.575+0000 7f1b5affd700 1 --2- 172.21.15.103:0/1160128531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b5c0ac950 0x7f1b5c0660b0 secure :-1 s=THROTTLE_DONE pgs=1946 cs=0 l=1 rx=0x7f1b50002f30 tx=0x7f1b50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.583 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.575+0000 7f1b4bfff700 1 -- 172.21.15.103:0/1160128531 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f1b5c0b2230 con 0x7f1b5c0ac950 2020-04-22T14:18:00.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.717+0000 7f1b61871700 1 -- 172.21.15.103:0/1160128531 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f1b5c0b2230 con 0x7f1b5c0ac950 2020-04-22T14:18:00.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.717+0000 7f1b5affd700 1 --2- 172.21.15.103:0/1160128531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b5c0ac950 0x7f1b5c0660b0 secure :-1 s=THROTTLE_DONE pgs=1946 cs=0 l=1 rx=0x7f1b50002f30 tx=0x7f1b50007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.717+0000 7f1b4bfff700 1 -- 172.21.15.103:0/1160128531 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v135) v1 ==== 110+0+10 (secure 0 0 0) 0x7f1b5c0b2230 con 0x7f1b5c0ac950 2020-04-22T14:18:00.720 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:18:00.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.718+0000 7f1b61871700 1 -- 172.21.15.103:0/1160128531 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1b3804d9e0 msgr2=0x7f1b3804fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:00.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.718+0000 7f1b61871700 1 --2- 172.21.15.103:0/1160128531 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1b3804d9e0 0x7f1b3804fea0 secure :-1 s=READY pgs=709 cs=0 l=1 rx=0x7f1b5c0b2940 tx=0x7f1b4c008d00).stop 2020-04-22T14:18:00.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.718+0000 7f1b61871700 1 -- 172.21.15.103:0/1160128531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b5c0ac950 msgr2=0x7f1b5c0660b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:00.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.718+0000 7f1b61871700 1 --2- 172.21.15.103:0/1160128531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b5c0ac950 0x7f1b5c0660b0 secure :-1 s=READY pgs=1946 cs=0 l=1 rx=0x7f1b50002f30 tx=0x7f1b50007a40).stop 2020-04-22T14:18:00.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.718+0000 7f1b61871700 1 -- 172.21.15.103:0/1160128531 shutdown_connections 2020-04-22T14:18:00.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.718+0000 7f1b61871700 1 --2- 172.21.15.103:0/1160128531 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1b3804d9e0 0x7f1b3804fea0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:00.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.718+0000 7f1b61871700 1 --2- 172.21.15.103:0/1160128531 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1b5c146c40 0x7f1b5c0b1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:00.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.718+0000 7f1b61871700 1 --2- 172.21.15.103:0/1160128531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1b5c0ac950 0x7f1b5c0660b0 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:00.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.718+0000 7f1b61871700 1 -- 172.21.15.103:0/1160128531 >> 172.21.15.103:0/1160128531 conn(0x7f1b5c05b7b0 msgr2=0x7f1b5c0b6660 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:18:00.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.718+0000 7f1b61871700 1 -- 172.21.15.103:0/1160128531 shutdown_connections 2020-04-22T14:18:00.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.718+0000 7f1b61871700 1 -- 172.21.15.103:0/1160128531 wait complete. 2020-04-22T14:18:00.730 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:00.743 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:18:00.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.890+0000 7f700f4e4700 1 Processor -- start 2020-04-22T14:18:00.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.890+0000 7f700f4e4700 1 -- start start 2020-04-22T14:18:00.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.891+0000 7f700f4e4700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f70080ac950 0x7f7008146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:18:00.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.891+0000 7f700f4e4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70081470a0 0x7f7008143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:18:00.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.891+0000 7f700f4e4700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70081467e0 con 0x7f70080b9140 2020-04-22T14:18:00.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.891+0000 7f700f4e4700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70080602f0 con 0x7f70080ac950 2020-04-22T14:18:00.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.891+0000 7f700f4e4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7008060050 con 0x7f70081470a0 2020-04-22T14:18:00.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.891+0000 7f700d280700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f70080b9140 0x7f700812b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49948/0 (socket says 172.21.15.103:49948) 2020-04-22T14:18:00.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.891+0000 7f700d280700 1 -- 172.21.15.103:0/2206196391 learned_addr learned my addr 172.21.15.103:0/2206196391 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:18:00.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.891+0000 7f6ffbfff700 1 -- 172.21.15.103:0/2206196391 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 408663669 0 0) 0x7f70081467e0 con 0x7f70080b9140 2020-04-22T14:18:00.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.891+0000 7f700da81700 1 --2- 172.21.15.103:0/2206196391 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70081470a0 0x7f7008143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:00.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.891+0000 7f700ca7f700 1 --2- 172.21.15.103:0/2206196391 >> v2:172.21.15.86:3300/0 conn(0x7f70080ac950 0x7f7008146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:00.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.891+0000 7f6ffbfff700 1 -- 172.21.15.103:0/2206196391 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ff0003230 con 0x7f70080b9140 2020-04-22T14:18:00.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.891+0000 7f6ffbfff700 1 -- 172.21.15.103:0/2206196391 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2549634709 0 0) 0x7f6ff0003230 con 0x7f70080b9140 2020-04-22T14:18:00.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.891+0000 7f6ffbfff700 1 -- 172.21.15.103:0/2206196391 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70081470a0 msgr2=0x7f7008143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:18:00.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.891+0000 7f6ffbfff700 1 --2- 172.21.15.103:0/2206196391 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70081470a0 0x7f7008143090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:18:00.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.891+0000 7f6ffbfff700 1 -- 172.21.15.103:0/2206196391 >> v2:172.21.15.86:3300/0 conn(0x7f70080ac950 msgr2=0x7f7008146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:18:00.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.891+0000 7f6ffbfff700 1 --2- 172.21.15.103:0/2206196391 >> v2:172.21.15.86:3300/0 conn(0x7f70080ac950 0x7f7008146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:18:00.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.891+0000 7f6ffbfff700 1 -- 172.21.15.103:0/2206196391 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70080b9520 con 0x7f70080b9140 2020-04-22T14:18:00.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.891+0000 7f6ffbfff700 1 -- 172.21.15.103:0/2206196391 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f7000001a50 con 0x7f70080b9140 2020-04-22T14:18:00.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.891+0000 7f6ffbfff700 1 -- 172.21.15.103:0/2206196391 >> v1:172.21.15.103:6789/0 conn(0x7f70080b9140 legacy=0x7f700812b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:00.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.892+0000 7f6ffbfff700 1 --2- 172.21.15.103:0/2206196391 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70081470a0 0x7f6ff0003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:18:00.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.892+0000 7f6ffbfff700 1 --2- 172.21.15.103:0/2206196391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ff0003b80 0x7f6ff0003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:18:00.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.892+0000 7f6ffbfff700 1 --2- 172.21.15.103:0/2206196391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ff00045c0 0x7f6ff0004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:18:00.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.892+0000 7f6ffbfff700 1 -- 172.21.15.103:0/2206196391 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70080602f0 con 0x7f6ff0003b80 2020-04-22T14:18:00.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.892+0000 7f6ffbfff700 1 -- 172.21.15.103:0/2206196391 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7008060050 con 0x7f6ff00045c0 2020-04-22T14:18:00.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.892+0000 7f6ffbfff700 1 -- 172.21.15.103:0/2206196391 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff0005050 con 0x7f70081470a0 2020-04-22T14:18:00.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.892+0000 7f700da81700 1 --2- 172.21.15.103:0/2206196391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ff00045c0 0x7f6ff0004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:00.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.892+0000 7f700d280700 1 --2- 172.21.15.103:0/2206196391 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70081470a0 0x7f6ff0003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:00.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.892+0000 7f700ca7f700 1 --2- 172.21.15.103:0/2206196391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ff0003b80 0x7f6ff0003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:00.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.892+0000 7f700da81700 1 -- 172.21.15.103:0/2206196391 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70081470a0 msgr2=0x7f6ff0003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:18:00.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.892+0000 7f700da81700 1 --2- 172.21.15.103:0/2206196391 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f70081470a0 0x7f6ff0003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:18:00.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.892+0000 7f700da81700 1 -- 172.21.15.103:0/2206196391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ff0003b80 msgr2=0x7f6ff0003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:18:00.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.892+0000 7f700da81700 1 --2- 172.21.15.103:0/2206196391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ff0003b80 0x7f6ff0003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:18:00.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.892+0000 7f700da81700 1 -- 172.21.15.103:0/2206196391 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff0003230 con 0x7f6ff00045c0 2020-04-22T14:18:00.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.892+0000 7f700da81700 1 --2- 172.21.15.103:0/2206196391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ff00045c0 0x7f6ff0004a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7004002f30 tx=0x7f7004010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.892+0000 7f700da81700 1 --2- 172.21.15.103:0/2206196391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ff00045c0 0x7f6ff0004a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7004002f30 tx=0x7f7004010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.892+0000 7f700da81700 1 --2- 172.21.15.103:0/2206196391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ff00045c0 0x7f6ff0004a20 secure :-1 s=READY pgs=1948 cs=0 l=1 rx=0x7f7004002f30 tx=0x7f7004010020).ready entity=mon.1 client_cookie=a1c724fcab80999f server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:18:00.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.892+0000 7f700da81700 1 --2- 172.21.15.103:0/2206196391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ff00045c0 0x7f6ff0004a20 secure :-1 s=THROTTLE_DONE pgs=1948 cs=0 l=1 rx=0x7f7004002f30 tx=0x7f7004010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.892+0000 7f6ffbfff700 1 -- 172.21.15.103:0/2206196391 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7004008d30 con 0x7f6ff00045c0 2020-04-22T14:18:00.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.892+0000 7f700da81700 1 --2- 172.21.15.103:0/2206196391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ff00045c0 0x7f6ff0004a20 secure :-1 s=THROTTLE_DONE pgs=1948 cs=0 l=1 rx=0x7f7004002f30 tx=0x7f7004010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.892+0000 7f6ffbfff700 1 -- 172.21.15.103:0/2206196391 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7004008e90 con 0x7f6ff00045c0 2020-04-22T14:18:00.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.892+0000 7f700da81700 1 --2- 172.21.15.103:0/2206196391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ff00045c0 0x7f6ff0004a20 secure :-1 s=THROTTLE_DONE pgs=1948 cs=0 l=1 rx=0x7f7004002f30 tx=0x7f7004010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.892+0000 7f6ffbfff700 1 -- 172.21.15.103:0/2206196391 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7004010a90 con 0x7f6ff00045c0 2020-04-22T14:18:00.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.892+0000 7f700f4e4700 1 -- 172.21.15.103:0/2206196391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ff00045c0 msgr2=0x7f6ff0004a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:00.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.892+0000 7f700f4e4700 1 --2- 172.21.15.103:0/2206196391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ff00045c0 0x7f6ff0004a20 secure :-1 s=READY pgs=1948 cs=0 l=1 rx=0x7f7004002f30 tx=0x7f7004010020).stop 2020-04-22T14:18:00.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.892+0000 7f700da81700 1 -- 172.21.15.103:0/2206196391 reap_dead start 2020-04-22T14:18:00.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.893+0000 7f700f4e4700 1 -- 172.21.15.103:0/2206196391 shutdown_connections 2020-04-22T14:18:00.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.893+0000 7f700f4e4700 1 -- 172.21.15.103:0/2206196391 >> 172.21.15.103:0/2206196391 conn(0x7f700805b7b0 msgr2=0x7f70080b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:18:00.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.893+0000 7f700f4e4700 1 -- 172.21.15.103:0/2206196391 shutdown_connections 2020-04-22T14:18:00.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.893+0000 7f700f4e4700 1 -- 172.21.15.103:0/2206196391 wait complete. 2020-04-22T14:18:00.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.894+0000 7f700f4e4700 1 Processor -- start 2020-04-22T14:18:00.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.894+0000 7f700f4e4700 1 -- start start 2020-04-22T14:18:00.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.894+0000 7f700f4e4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7008155070 0x7f70080b2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:18:00.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.894+0000 7f700f4e4700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7008141ea0 0x7f70081422f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:18:00.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.894+0000 7f700f4e4700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7008151760 con 0x7f7008155450 2020-04-22T14:18:00.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.894+0000 7f700f4e4700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70080b27c0 con 0x7f7008141ea0 2020-04-22T14:18:00.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.894+0000 7f700f4e4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7008065480 con 0x7f7008155070 2020-04-22T14:18:00.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.895+0000 7f700ca7f700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f7008155450 0x7f7008064d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:38886/0 (socket says 172.21.15.103:38886) 2020-04-22T14:18:00.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.895+0000 7f700d280700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7008155070 0x7f70080b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:00.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.895+0000 7f700ca7f700 1 -- 172.21.15.103:0/1246095731 learned_addr learned my addr 172.21.15.103:0/1246095731 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:18:00.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.895+0000 7f700da81700 1 --2- 172.21.15.103:0/1246095731 >> v2:172.21.15.86:3300/0 conn(0x7f7008141ea0 0x7f70081422f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:00.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.895+0000 7f6ffa7fc700 1 -- 172.21.15.103:0/1246095731 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1207137760 0 0) 0x7f7008151760 con 0x7f7008155450 2020-04-22T14:18:00.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.895+0000 7f6ffa7fc700 1 -- 172.21.15.103:0/1246095731 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fe8002fe0 con 0x7f7008155450 2020-04-22T14:18:00.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.895+0000 7f700d280700 1 -- 172.21.15.103:0/1246095731 >> v2:172.21.15.86:3300/0 conn(0x7f7008141ea0 msgr2=0x7f70081422f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:00.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.895+0000 7f700d280700 1 --2- 172.21.15.103:0/1246095731 >> v2:172.21.15.86:3300/0 conn(0x7f7008141ea0 0x7f70081422f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:00.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.895+0000 7f700d280700 1 -- 172.21.15.103:0/1246095731 >> v1:172.21.15.86:6789/0 conn(0x7f7008155450 legacy=0x7f7008064d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:00.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.895+0000 7f700d280700 1 -- 172.21.15.103:0/1246095731 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70080b2a60 con 0x7f7008155070 2020-04-22T14:18:00.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.895+0000 7f700d280700 1 --2- 172.21.15.103:0/1246095731 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7008155070 0x7f70080b2200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7000001760 tx=0x7f70080b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.895+0000 7f700d280700 1 --2- 172.21.15.103:0/1246095731 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7008155070 0x7f70080b2200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7000001760 tx=0x7f70080b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.895+0000 7f700d280700 1 --2- 172.21.15.103:0/1246095731 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7008155070 0x7f70080b2200 secure :-1 s=READY pgs=177 cs=0 l=1 rx=0x7f7000001760 tx=0x7f70080b96b0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:18:00.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.895+0000 7f700d280700 1 --2- 172.21.15.103:0/1246095731 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7008155070 0x7f70080b2200 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f7000001760 tx=0x7f70080b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.895+0000 7f6ffa7fc700 1 -- 172.21.15.103:0/1246095731 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7000011b80 con 0x7f7008155070 2020-04-22T14:18:00.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.895+0000 7f700d280700 1 --2- 172.21.15.103:0/1246095731 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7008155070 0x7f70080b2200 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f7000001760 tx=0x7f70080b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.895+0000 7f700f4e4700 1 -- 172.21.15.103:0/1246095731 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70081558d0 con 0x7f7008155070 2020-04-22T14:18:00.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.895+0000 7f700d280700 1 --2- 172.21.15.103:0/1246095731 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7008155070 0x7f70080b2200 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f7000001760 tx=0x7f70080b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.895+0000 7f6ffa7fc700 1 -- 172.21.15.103:0/1246095731 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7000011ce0 con 0x7f7008155070 2020-04-22T14:18:00.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.895+0000 7f6ffa7fc700 1 -- 172.21.15.103:0/1246095731 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7000011e50 con 0x7f7008155070 2020-04-22T14:18:00.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.896+0000 7f700f4e4700 1 -- 172.21.15.103:0/1246095731 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7008151e00 con 0x7f7008155070 2020-04-22T14:18:00.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.896+0000 7f700d280700 1 --2- 172.21.15.103:0/1246095731 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7008155070 0x7f70080b2200 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f7000001760 tx=0x7f70080b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.896+0000 7f700f4e4700 1 -- 172.21.15.103:0/1246095731 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7008056c90 con 0x7f7008155070 2020-04-22T14:18:00.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.896+0000 7f6ffa7fc700 1 -- 172.21.15.103:0/1246095731 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f7000004930 con 0x7f7008155070 2020-04-22T14:18:00.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.897+0000 7f700d280700 1 --2- 172.21.15.103:0/1246095731 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7008155070 0x7f70080b2200 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f7000001760 tx=0x7f70080b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.897+0000 7f6ffa7fc700 1 --2- 172.21.15.103:0/1246095731 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6fe804dc90 0x7f6fe8050150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:18:00.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.897+0000 7f6ffa7fc700 1 -- 172.21.15.103:0/1246095731 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f70000612e0 con 0x7f7008155070 2020-04-22T14:18:00.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.897+0000 7f700ca7f700 1 --2- 172.21.15.103:0/1246095731 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6fe804dc90 0x7f6fe8050150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:00.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.897+0000 7f700ca7f700 1 --2- 172.21.15.103:0/1246095731 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6fe804dc90 0x7f6fe8050150 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6ffc002f30 tx=0x7f6ffc00c7d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.897+0000 7f700ca7f700 1 --2- 172.21.15.103:0/1246095731 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6fe804dc90 0x7f6fe8050150 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6ffc002f30 tx=0x7f6ffc00c7d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.897+0000 7f700ca7f700 1 --2- 172.21.15.103:0/1246095731 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6fe804dc90 0x7f6fe8050150 secure :-1 s=READY pgs=710 cs=0 l=1 rx=0x7f6ffc002f30 tx=0x7f6ffc00c7d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:18:00.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.900+0000 7f700d280700 1 --2- 172.21.15.103:0/1246095731 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7008155070 0x7f70080b2200 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f7000001760 tx=0x7f70080b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:00.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:00.900+0000 7f6ffa7fc700 1 -- 172.21.15.103:0/1246095731 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f700003c720 con 0x7f7008155070 2020-04-22T14:18:01.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.041+0000 7f700f4e4700 1 -- 172.21.15.103:0/1246095731 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f70081518f0 con 0x7f7008155070 2020-04-22T14:18:01.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.042+0000 7f700d280700 1 --2- 172.21.15.103:0/1246095731 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7008155070 0x7f70080b2200 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f7000001760 tx=0x7f70080b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.042+0000 7f6ffa7fc700 1 -- 172.21.15.103:0/1246095731 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v135) v1 ==== 92+0+10 (secure 0 0 0) 0x7f700003fd40 con 0x7f7008155070 2020-04-22T14:18:01.044 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:18:01.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.043+0000 7f700f4e4700 1 -- 172.21.15.103:0/1246095731 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6fe804dc90 msgr2=0x7f6fe8050150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:01.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.043+0000 7f700f4e4700 1 --2- 172.21.15.103:0/1246095731 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6fe804dc90 0x7f6fe8050150 secure :-1 s=READY pgs=710 cs=0 l=1 rx=0x7f6ffc002f30 tx=0x7f6ffc00c7d0).stop 2020-04-22T14:18:01.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.043+0000 7f700f4e4700 1 -- 172.21.15.103:0/1246095731 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7008155070 msgr2=0x7f70080b2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:01.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.043+0000 7f700f4e4700 1 --2- 172.21.15.103:0/1246095731 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7008155070 0x7f70080b2200 secure :-1 s=READY pgs=177 cs=0 l=1 rx=0x7f7000001760 tx=0x7f70080b96b0).stop 2020-04-22T14:18:01.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.043+0000 7f700f4e4700 1 -- 172.21.15.103:0/1246095731 shutdown_connections 2020-04-22T14:18:01.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.043+0000 7f700f4e4700 1 --2- 172.21.15.103:0/1246095731 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6fe804dc90 0x7f6fe8050150 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:01.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.043+0000 7f700f4e4700 1 --2- 172.21.15.103:0/1246095731 >> v2:172.21.15.86:3300/0 conn(0x7f7008141ea0 0x7f70081422f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:01.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.043+0000 7f700f4e4700 1 --2- 172.21.15.103:0/1246095731 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7008155070 0x7f70080b2200 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:01.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.043+0000 7f700f4e4700 1 -- 172.21.15.103:0/1246095731 >> 172.21.15.103:0/1246095731 conn(0x7f700805b7b0 msgr2=0x7f70080b7380 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:18:01.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.043+0000 7f700f4e4700 1 -- 172.21.15.103:0/1246095731 shutdown_connections 2020-04-22T14:18:01.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.044+0000 7f700f4e4700 1 -- 172.21.15.103:0/1246095731 wait complete. 2020-04-22T14:18:01.056 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:01.069 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-22T14:18:01.218 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.216+0000 7f1732612700 1 Processor -- start 2020-04-22T14:18:01.218 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.216+0000 7f1732612700 1 -- start start 2020-04-22T14:18:01.221 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.216+0000 7f1732612700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f172c0b4820 0x7f172c0acb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:18:01.221 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.216+0000 7f1732612700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f172c141f20 0x7f172c142380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:18:01.221 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.216+0000 7f1732612700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f172c0af030 con 0x7f172c061a30 2020-04-22T14:18:01.221 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.216+0000 7f1732612700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f172c060250 con 0x7f172c0b4820 2020-04-22T14:18:01.221 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.216+0000 7f1732612700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f172c0623c0 con 0x7f172c141f20 2020-04-22T14:18:01.222 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.217+0000 7f172bfff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f172c061a30 0x7f172c0ae920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49968/0 (socket says 172.21.15.103:49968) 2020-04-22T14:18:01.222 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.217+0000 7f172bfff700 1 -- 172.21.15.103:0/2479786711 learned_addr learned my addr 172.21.15.103:0/2479786711 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:18:01.222 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.217+0000 7f172b7fe700 1 --2- 172.21.15.103:0/2479786711 >> v2:172.21.15.86:3300/0 conn(0x7f172c0b4820 0x7f172c0acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:01.222 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.217+0000 7f1730baf700 1 --2- 172.21.15.103:0/2479786711 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f172c141f20 0x7f172c142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:01.222 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.217+0000 7f172affd700 1 -- 172.21.15.103:0/2479786711 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 301675202 0 0) 0x7f172c0af030 con 0x7f172c061a30 2020-04-22T14:18:01.222 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.217+0000 7f172affd700 1 -- 172.21.15.103:0/2479786711 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1718003230 con 0x7f172c061a30 2020-04-22T14:18:01.222 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.217+0000 7f172b7fe700 1 -- 172.21.15.103:0/2479786711 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f172c141f20 msgr2=0x7f172c142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:18:01.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.217+0000 7f172affd700 1 -- 172.21.15.103:0/2479786711 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1451234383 0 0) 0x7f1718003230 con 0x7f172c061a30 2020-04-22T14:18:01.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.217+0000 7f172b7fe700 1 --2- 172.21.15.103:0/2479786711 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f172c141f20 0x7f172c142380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:18:01.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.217+0000 7f172b7fe700 1 -- 172.21.15.103:0/2479786711 >> v1:172.21.15.103:6789/0 conn(0x7f172c061a30 legacy=0x7f172c0ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:01.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.217+0000 7f172b7fe700 1 -- 172.21.15.103:0/2479786711 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f172c062660 con 0x7f172c0b4820 2020-04-22T14:18:01.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.217+0000 7f172b7fe700 1 --2- 172.21.15.103:0/2479786711 >> v2:172.21.15.86:3300/0 conn(0x7f172c0b4820 0x7f172c0acb10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f171c001870 tx=0x7f1720007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.217+0000 7f172b7fe700 1 --2- 172.21.15.103:0/2479786711 >> v2:172.21.15.86:3300/0 conn(0x7f172c0b4820 0x7f172c0acb10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f171c001870 tx=0x7f1720007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.217+0000 7f172b7fe700 1 --2- 172.21.15.103:0/2479786711 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f172c0b4820 0x7f172c0acb10 secure :-1 s=READY pgs=1030 cs=0 l=1 rx=0x7f171c001870 tx=0x7f1720007a40).ready entity=mon.0 client_cookie=882c1ecef0872c0f server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:18:01.223 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.217+0000 7f172b7fe700 1 --2- 172.21.15.103:0/2479786711 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f172c0b4820 0x7f172c0acb10 secure :-1 s=THROTTLE_DONE pgs=1030 cs=0 l=1 rx=0x7f171c001870 tx=0x7f1720007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.217+0000 7f172affd700 1 -- 172.21.15.103:0/2479786711 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f171c0016d0 con 0x7f172c0b4820 2020-04-22T14:18:01.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.217+0000 7f172b7fe700 1 --2- 172.21.15.103:0/2479786711 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f172c0b4820 0x7f172c0acb10 secure :-1 s=THROTTLE_DONE pgs=1030 cs=0 l=1 rx=0x7f171c001870 tx=0x7f1720007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.217+0000 7f172affd700 1 -- 172.21.15.103:0/2479786711 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1720008b40 con 0x7f172c0b4820 2020-04-22T14:18:01.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.217+0000 7f1732612700 1 -- 172.21.15.103:0/2479786711 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f172c0b4820 msgr2=0x7f172c0acb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:01.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.217+0000 7f172b7fe700 1 --2- 172.21.15.103:0/2479786711 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f172c0b4820 0x7f172c0acb10 secure :-1 s=THROTTLE_DONE pgs=1030 cs=0 l=1 rx=0x7f171c001870 tx=0x7f1720007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.218+0000 7f172affd700 1 -- 172.21.15.103:0/2479786711 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1720008ea0 con 0x7f172c0b4820 2020-04-22T14:18:01.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.218+0000 7f1732612700 1 --2- 172.21.15.103:0/2479786711 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f172c0b4820 0x7f172c0acb10 secure :-1 s=READY pgs=1030 cs=0 l=1 rx=0x7f171c001870 tx=0x7f1720007a40).stop 2020-04-22T14:18:01.225 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.218+0000 7f1732612700 1 -- 172.21.15.103:0/2479786711 shutdown_connections 2020-04-22T14:18:01.225 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.218+0000 7f1732612700 1 --2- 172.21.15.103:0/2479786711 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f172c141f20 0x7f172c142380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:18:01.225 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.218+0000 7f1732612700 1 --2- 172.21.15.103:0/2479786711 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f172c0b4820 0x7f172c0acb10 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:01.225 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.218+0000 7f1732612700 1 -- 172.21.15.103:0/2479786711 >> 172.21.15.103:0/2479786711 conn(0x7f172c05b7b0 msgr2=0x7f172c0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:18:01.225 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.218+0000 7f1732612700 1 -- 172.21.15.103:0/2479786711 shutdown_connections 2020-04-22T14:18:01.225 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.218+0000 7f1732612700 1 -- 172.21.15.103:0/2479786711 wait complete. 2020-04-22T14:18:01.225 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.219+0000 7f1732612700 1 Processor -- start 2020-04-22T14:18:01.226 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.219+0000 7f1732612700 1 -- start start 2020-04-22T14:18:01.228 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.220+0000 7f1732612700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f172c061a30 0x7f172c0afba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:18:01.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.220+0000 7f1732612700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f172c0b4820 0x7f172c0638d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:18:01.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.220+0000 7f1732612700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f172c0b0000 con 0x7f172c141f20 2020-04-22T14:18:01.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.220+0000 7f1732612700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f172c0640c0 con 0x7f172c0b4820 2020-04-22T14:18:01.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.220+0000 7f1732612700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f172c064360 con 0x7f172c061a30 2020-04-22T14:18:01.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.220+0000 7f172bfff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f172c061a30 0x7f172c0afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:01.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.220+0000 7f1730baf700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f172c141f20 0x7f172c141210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49978/0 (socket says 172.21.15.103:49978) 2020-04-22T14:18:01.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.220+0000 7f1730baf700 1 -- 172.21.15.103:0/3163889347 learned_addr learned my addr 172.21.15.103:0/3163889347 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:18:01.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.220+0000 7f172b7fe700 1 --2- 172.21.15.103:0/3163889347 >> v2:172.21.15.86:3300/0 conn(0x7f172c0b4820 0x7f172c0638d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:01.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.220+0000 7f172bfff700 1 -- 172.21.15.103:0/3163889347 >> v2:172.21.15.86:3300/0 conn(0x7f172c0b4820 msgr2=0x7f172c0638d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:01.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.220+0000 7f172bfff700 1 --2- 172.21.15.103:0/3163889347 >> v2:172.21.15.86:3300/0 conn(0x7f172c0b4820 0x7f172c0638d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:01.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.220+0000 7f172bfff700 1 -- 172.21.15.103:0/3163889347 >> v1:172.21.15.103:6789/0 conn(0x7f172c141f20 legacy=0x7f172c141210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:01.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.220+0000 7f17297fa700 1 -- 172.21.15.103:0/3163889347 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3689477442 0 0) 0x7f1724001210 con 0x7f172c141f20 2020-04-22T14:18:01.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.220+0000 7f172bfff700 1 -- 172.21.15.103:0/3163889347 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f172c064600 con 0x7f172c061a30 2020-04-22T14:18:01.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.220+0000 7f172b7fe700 1 --2- 172.21.15.103:0/3163889347 >> v2:172.21.15.86:3300/0 conn(0x7f172c0b4820 0x7f172c0638d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:18:01.231 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.220+0000 7f172bfff700 1 --2- 172.21.15.103:0/3163889347 >> v2:172.21.15.103:3300/0 conn(0x7f172c061a30 0x7f172c0afba0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f171c0014a0 tx=0x7f171c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.231 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.220+0000 7f172bfff700 1 --2- 172.21.15.103:0/3163889347 >> v2:172.21.15.103:3300/0 conn(0x7f172c061a30 0x7f172c0afba0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f171c0014a0 tx=0x7f171c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.231 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.220+0000 7f172bfff700 1 --2- 172.21.15.103:0/3163889347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f172c061a30 0x7f172c0afba0 secure :-1 s=READY pgs=1951 cs=0 l=1 rx=0x7f171c0014a0 tx=0x7f171c010cd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:18:01.231 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.220+0000 7f172bfff700 1 --2- 172.21.15.103:0/3163889347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f172c061a30 0x7f172c0afba0 secure :-1 s=THROTTLE_DONE pgs=1951 cs=0 l=1 rx=0x7f171c0014a0 tx=0x7f171c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.231 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.220+0000 7f17297fa700 1 -- 172.21.15.103:0/3163889347 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f171c00c950 con 0x7f172c061a30 2020-04-22T14:18:01.231 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.220+0000 7f172bfff700 1 --2- 172.21.15.103:0/3163889347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f172c061a30 0x7f172c0afba0 secure :-1 s=THROTTLE_DONE pgs=1951 cs=0 l=1 rx=0x7f171c0014a0 tx=0x7f171c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.231 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.220+0000 7f17297fa700 1 -- 172.21.15.103:0/3163889347 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171c00cab0 con 0x7f172c061a30 2020-04-22T14:18:01.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.220+0000 7f172bfff700 1 --2- 172.21.15.103:0/3163889347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f172c061a30 0x7f172c0afba0 secure :-1 s=THROTTLE_DONE pgs=1951 cs=0 l=1 rx=0x7f171c0014a0 tx=0x7f171c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.220+0000 7f1732612700 1 -- 172.21.15.103:0/3163889347 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f172c063d30 con 0x7f172c061a30 2020-04-22T14:18:01.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.220+0000 7f17297fa700 1 -- 172.21.15.103:0/3163889347 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f171c00ce10 con 0x7f172c061a30 2020-04-22T14:18:01.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.221+0000 7f1732612700 1 -- 172.21.15.103:0/3163889347 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f172c0b1530 con 0x7f172c061a30 2020-04-22T14:18:01.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.221+0000 7f172bfff700 1 --2- 172.21.15.103:0/3163889347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f172c061a30 0x7f172c0afba0 secure :-1 s=THROTTLE_DONE pgs=1951 cs=0 l=1 rx=0x7f171c0014a0 tx=0x7f171c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.222+0000 7f17297fa700 1 -- 172.21.15.103:0/3163889347 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f171c012550 con 0x7f172c061a30 2020-04-22T14:18:01.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.222+0000 7f172bfff700 1 --2- 172.21.15.103:0/3163889347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f172c061a30 0x7f172c0afba0 secure :-1 s=THROTTLE_DONE pgs=1951 cs=0 l=1 rx=0x7f171c0014a0 tx=0x7f171c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.222+0000 7f1732612700 1 -- 172.21.15.103:0/3163889347 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f172c056c90 con 0x7f172c061a30 2020-04-22T14:18:01.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.222+0000 7f17297fa700 1 --2- 172.21.15.103:0/3163889347 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f170c04d8b0 0x7f170c04fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:18:01.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.222+0000 7f17297fa700 1 -- 172.21.15.103:0/3163889347 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f171c0614d0 con 0x7f172c061a30 2020-04-22T14:18:01.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.222+0000 7f172b7fe700 1 --2- 172.21.15.103:0/3163889347 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f170c04d8b0 0x7f170c04fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:01.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.222+0000 7f172b7fe700 1 --2- 172.21.15.103:0/3163889347 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f170c04d8b0 0x7f170c04fd70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f171c001870 tx=0x7f1720007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.222+0000 7f172b7fe700 1 --2- 172.21.15.103:0/3163889347 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f170c04d8b0 0x7f170c04fd70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f171c001870 tx=0x7f1720007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.222+0000 7f172b7fe700 1 --2- 172.21.15.103:0/3163889347 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f170c04d8b0 0x7f170c04fd70 secure :-1 s=READY pgs=711 cs=0 l=1 rx=0x7f171c001870 tx=0x7f1720007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:18:01.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.226+0000 7f172bfff700 1 --2- 172.21.15.103:0/3163889347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f172c061a30 0x7f172c0afba0 secure :-1 s=THROTTLE_DONE pgs=1951 cs=0 l=1 rx=0x7f171c0014a0 tx=0x7f171c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.226+0000 7f17297fa700 1 -- 172.21.15.103:0/3163889347 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f171c03c850 con 0x7f172c061a30 2020-04-22T14:18:01.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.366+0000 7f1732612700 1 -- 172.21.15.103:0/3163889347 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f172c064800 con 0x7f172c061a30 2020-04-22T14:18:01.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.367+0000 7f172bfff700 1 --2- 172.21.15.103:0/3163889347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f172c061a30 0x7f172c0afba0 secure :-1 s=THROTTLE_DONE pgs=1951 cs=0 l=1 rx=0x7f171c0014a0 tx=0x7f171c010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.367+0000 7f17297fa700 1 -- 172.21.15.103:0/3163889347 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v135) v1 ==== 104+0+10 (secure 0 0 0) 0x7f172c064800 con 0x7f172c061a30 2020-04-22T14:18:01.369 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:18:01.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.368+0000 7f1732612700 1 -- 172.21.15.103:0/3163889347 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f170c04d8b0 msgr2=0x7f170c04fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:01.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.368+0000 7f1732612700 1 --2- 172.21.15.103:0/3163889347 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f170c04d8b0 0x7f170c04fd70 secure :-1 s=READY pgs=711 cs=0 l=1 rx=0x7f171c001870 tx=0x7f1720007a40).stop 2020-04-22T14:18:01.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.368+0000 7f1732612700 1 -- 172.21.15.103:0/3163889347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f172c061a30 msgr2=0x7f172c0afba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:01.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.368+0000 7f1732612700 1 --2- 172.21.15.103:0/3163889347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f172c061a30 0x7f172c0afba0 secure :-1 s=READY pgs=1951 cs=0 l=1 rx=0x7f171c0014a0 tx=0x7f171c010cd0).stop 2020-04-22T14:18:01.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.368+0000 7f1732612700 1 -- 172.21.15.103:0/3163889347 shutdown_connections 2020-04-22T14:18:01.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.368+0000 7f1732612700 1 --2- 172.21.15.103:0/3163889347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f172c061a30 0x7f172c0afba0 unknown :-1 s=CLOSED pgs=1951 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:01.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.368+0000 7f1732612700 1 --2- 172.21.15.103:0/3163889347 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f170c04d8b0 0x7f170c04fd70 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:01.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.368+0000 7f1732612700 1 --2- 172.21.15.103:0/3163889347 >> v2:172.21.15.86:3300/0 conn(0x7f172c0b4820 0x7f172c0638d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:01.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.368+0000 7f1732612700 1 -- 172.21.15.103:0/3163889347 >> 172.21.15.103:0/3163889347 conn(0x7f172c05b7b0 msgr2=0x7f172c0adde0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:18:01.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.368+0000 7f1732612700 1 -- 172.21.15.103:0/3163889347 shutdown_connections 2020-04-22T14:18:01.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.368+0000 7f1732612700 1 -- 172.21.15.103:0/3163889347 wait complete. 2020-04-22T14:18:01.380 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:01.393 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-22T14:18:01.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.540+0000 7fbcd02f4700 1 Processor -- start 2020-04-22T14:18:01.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.540+0000 7fbcd02f4700 1 -- start start 2020-04-22T14:18:01.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.541+0000 7fbcd02f4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbcc8061a30 0x7fbcc80b4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:18:01.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.541+0000 7fbcd02f4700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbcc8141f20 0x7fbcc81423b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:18:01.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.541+0000 7fbcd02f4700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcc80af030 con 0x7fbcc80acb10 2020-04-22T14:18:01.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.541+0000 7fbcd02f4700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcc8060250 con 0x7fbcc8141f20 2020-04-22T14:18:01.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.541+0000 7fbcd02f4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc80623c0 con 0x7fbcc8061a30 2020-04-22T14:18:01.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.541+0000 7fbcce891700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbcc8141f20 0x7fbcc81423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:01.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.541+0000 7fbcce891700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbcc8141f20 0x7fbcc81423b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57792/0 (socket says 172.21.15.103:57792) 2020-04-22T14:18:01.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.541+0000 7fbcce891700 1 -- 172.21.15.103:0/3272367195 learned_addr learned my addr 172.21.15.103:0/3272367195 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:18:01.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.541+0000 7fbcce090700 1 --2- 172.21.15.103:0/3272367195 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbcc8061a30 0x7fbcc80b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:01.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.541+0000 7fbcce891700 1 -- 172.21.15.103:0/3272367195 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbcc8061a30 msgr2=0x7fbcc80b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:18:01.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.541+0000 7fbcce891700 1 --2- 172.21.15.103:0/3272367195 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbcc8061a30 0x7fbcc80b4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:18:01.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.541+0000 7fbcce891700 1 -- 172.21.15.103:0/3272367195 >> v1:172.21.15.86:6789/0 conn(0x7fbcc80acb10 legacy=0x7fbcc80ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:01.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.541+0000 7fbcce891700 1 -- 172.21.15.103:0/3272367195 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc8062660 con 0x7fbcc8141f20 2020-04-22T14:18:01.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.541+0000 7fbcce891700 1 --2- 172.21.15.103:0/3272367195 >> v2:172.21.15.103:3300/0 conn(0x7fbcc8141f20 0x7fbcc81423b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbcc00032b0 tx=0x7fbcc0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.542+0000 7fbcce891700 1 --2- 172.21.15.103:0/3272367195 >> v2:172.21.15.103:3300/0 conn(0x7fbcc8141f20 0x7fbcc81423b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbcc00032b0 tx=0x7fbcc0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.542+0000 7fbcce891700 1 --2- 172.21.15.103:0/3272367195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcc8141f20 0x7fbcc81423b0 secure :-1 s=READY pgs=1952 cs=0 l=1 rx=0x7fbcc00032b0 tx=0x7fbcc0007dc0).ready entity=mon.1 client_cookie=704c48ae7f400960 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:18:01.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.542+0000 7fbcce891700 1 --2- 172.21.15.103:0/3272367195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcc8141f20 0x7fbcc81423b0 secure :-1 s=THROTTLE_DONE pgs=1952 cs=0 l=1 rx=0x7fbcc00032b0 tx=0x7fbcc0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.542+0000 7fbccd08e700 1 -- 172.21.15.103:0/3272367195 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcc000b180 con 0x7fbcc8141f20 2020-04-22T14:18:01.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.542+0000 7fbcce891700 1 --2- 172.21.15.103:0/3272367195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcc8141f20 0x7fbcc81423b0 secure :-1 s=THROTTLE_DONE pgs=1952 cs=0 l=1 rx=0x7fbcc00032b0 tx=0x7fbcc0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.542+0000 7fbcce891700 1 --2- 172.21.15.103:0/3272367195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcc8141f20 0x7fbcc81423b0 secure :-1 s=THROTTLE_DONE pgs=1952 cs=0 l=1 rx=0x7fbcc00032b0 tx=0x7fbcc0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.542+0000 7fbccd08e700 1 -- 172.21.15.103:0/3272367195 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc000b320 con 0x7fbcc8141f20 2020-04-22T14:18:01.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.542+0000 7fbccd08e700 1 -- 172.21.15.103:0/3272367195 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcc000b740 con 0x7fbcc8141f20 2020-04-22T14:18:01.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.542+0000 7fbcd02f4700 1 -- 172.21.15.103:0/3272367195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcc8141f20 msgr2=0x7fbcc81423b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:01.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.542+0000 7fbcd02f4700 1 --2- 172.21.15.103:0/3272367195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcc8141f20 0x7fbcc81423b0 secure :-1 s=READY pgs=1952 cs=0 l=1 rx=0x7fbcc00032b0 tx=0x7fbcc0007dc0).stop 2020-04-22T14:18:01.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.542+0000 7fbcd02f4700 1 -- 172.21.15.103:0/3272367195 shutdown_connections 2020-04-22T14:18:01.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.542+0000 7fbcd02f4700 1 --2- 172.21.15.103:0/3272367195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcc8141f20 0x7fbcc81423b0 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:01.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.542+0000 7fbcd02f4700 1 --2- 172.21.15.103:0/3272367195 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbcc8061a30 0x7fbcc80b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:18:01.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.542+0000 7fbcd02f4700 1 -- 172.21.15.103:0/3272367195 >> 172.21.15.103:0/3272367195 conn(0x7fbcc805b7b0 msgr2=0x7fbcc80b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:18:01.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.542+0000 7fbcd02f4700 1 -- 172.21.15.103:0/3272367195 shutdown_connections 2020-04-22T14:18:01.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.542+0000 7fbcd02f4700 1 -- 172.21.15.103:0/3272367195 wait complete. 2020-04-22T14:18:01.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.543+0000 7fbcd02f4700 1 Processor -- start 2020-04-22T14:18:01.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.543+0000 7fbcd02f4700 1 -- start start 2020-04-22T14:18:01.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.544+0000 7fbcd02f4700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbcc8061a30 0x7fbcc81517e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:18:01.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.544+0000 7fbcd02f4700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbcc8141f20 0x7fbcc8063d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:18:01.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.544+0000 7fbcd02f4700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcc8151f90 con 0x7fbcc80acb10 2020-04-22T14:18:01.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.544+0000 7fbcd02f4700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcc8151d80 con 0x7fbcc8141f20 2020-04-22T14:18:01.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.544+0000 7fbcd02f4700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcc8152230 con 0x7fbcc8061a30 2020-04-22T14:18:01.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.544+0000 7fbcce090700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbcc8061a30 0x7fbcc81517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:01.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.544+0000 7fbcce090700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbcc8061a30 0x7fbcc81517e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57798/0 (socket says 172.21.15.103:57798) 2020-04-22T14:18:01.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.544+0000 7fbcce090700 1 -- 172.21.15.103:0/2182318737 learned_addr learned my addr 172.21.15.103:0/2182318737 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:18:01.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.544+0000 7fbcce891700 1 --2- 172.21.15.103:0/2182318737 >> v2:172.21.15.86:3300/0 conn(0x7fbcc8141f20 0x7fbcc8063d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:01.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.544+0000 7fbcce090700 1 -- 172.21.15.103:0/2182318737 >> v2:172.21.15.86:3300/0 conn(0x7fbcc8141f20 msgr2=0x7fbcc8063d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:01.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.544+0000 7fbcce090700 1 --2- 172.21.15.103:0/2182318737 >> v2:172.21.15.86:3300/0 conn(0x7fbcc8141f20 0x7fbcc8063d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:01.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.544+0000 7fbcce090700 1 -- 172.21.15.103:0/2182318737 >> v1:172.21.15.86:6789/0 conn(0x7fbcc80acb10 legacy=0x7fbcc81550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:01.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.544+0000 7fbcce090700 1 -- 172.21.15.103:0/2182318737 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc8113550 con 0x7fbcc8061a30 2020-04-22T14:18:01.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.544+0000 7fbcce090700 1 --2- 172.21.15.103:0/2182318737 >> v2:172.21.15.103:3300/0 conn(0x7fbcc8061a30 0x7fbcc81517e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbcc8145580 tx=0x7fbcb8010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.544+0000 7fbcce090700 1 --2- 172.21.15.103:0/2182318737 >> v2:172.21.15.103:3300/0 conn(0x7fbcc8061a30 0x7fbcc81517e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbcc8145580 tx=0x7fbcb8010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.544+0000 7fbcce090700 1 --2- 172.21.15.103:0/2182318737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcc8061a30 0x7fbcc81517e0 secure :-1 s=READY pgs=1953 cs=0 l=1 rx=0x7fbcc8145580 tx=0x7fbcb8010d40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:18:01.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.544+0000 7fbcce090700 1 --2- 172.21.15.103:0/2182318737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcc8061a30 0x7fbcc81517e0 secure :-1 s=THROTTLE_DONE pgs=1953 cs=0 l=1 rx=0x7fbcc8145580 tx=0x7fbcb8010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.544+0000 7fbcb77fe700 1 -- 172.21.15.103:0/2182318737 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcb8005e90 con 0x7fbcc8061a30 2020-04-22T14:18:01.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.544+0000 7fbcce090700 1 --2- 172.21.15.103:0/2182318737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcc8061a30 0x7fbcc81517e0 secure :-1 s=THROTTLE_DONE pgs=1953 cs=0 l=1 rx=0x7fbcc8145580 tx=0x7fbcb8010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.544+0000 7fbcb77fe700 1 -- 172.21.15.103:0/2182318737 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcb8007180 con 0x7fbcc8061a30 2020-04-22T14:18:01.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.544+0000 7fbcce090700 1 --2- 172.21.15.103:0/2182318737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcc8061a30 0x7fbcc81517e0 secure :-1 s=THROTTLE_DONE pgs=1953 cs=0 l=1 rx=0x7fbcc8145580 tx=0x7fbcb8010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.545+0000 7fbcd02f4700 1 -- 172.21.15.103:0/2182318737 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcc81526d0 con 0x7fbcc8061a30 2020-04-22T14:18:01.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.545+0000 7fbcb77fe700 1 -- 172.21.15.103:0/2182318737 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcb8007520 con 0x7fbcc8061a30 2020-04-22T14:18:01.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.545+0000 7fbcd02f4700 1 -- 172.21.15.103:0/2182318737 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcc8144cf0 con 0x7fbcc8061a30 2020-04-22T14:18:01.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.545+0000 7fbcce090700 1 --2- 172.21.15.103:0/2182318737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcc8061a30 0x7fbcc81517e0 secure :-1 s=THROTTLE_DONE pgs=1953 cs=0 l=1 rx=0x7fbcc8145580 tx=0x7fbcb8010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.545+0000 7fbcb77fe700 1 -- 172.21.15.103:0/2182318737 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fbcb8012360 con 0x7fbcc8061a30 2020-04-22T14:18:01.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.545+0000 7fbcce090700 1 --2- 172.21.15.103:0/2182318737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcc8061a30 0x7fbcc81517e0 secure :-1 s=THROTTLE_DONE pgs=1953 cs=0 l=1 rx=0x7fbcc8145580 tx=0x7fbcb8010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.546+0000 7fbcd02f4700 1 -- 172.21.15.103:0/2182318737 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcc8056c90 con 0x7fbcc8061a30 2020-04-22T14:18:01.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.546+0000 7fbcb77fe700 1 --2- 172.21.15.103:0/2182318737 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbca804da10 0x7fbca804fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:18:01.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.546+0000 7fbcb77fe700 1 -- 172.21.15.103:0/2182318737 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbcb80619d0 con 0x7fbcc8061a30 2020-04-22T14:18:01.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.546+0000 7fbccd88f700 1 --2- 172.21.15.103:0/2182318737 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbca804da10 0x7fbca804fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:01.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.546+0000 7fbccd88f700 1 --2- 172.21.15.103:0/2182318737 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbca804da10 0x7fbca804fed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbcc8061130 tx=0x7fbcc4001540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.546+0000 7fbccd88f700 1 --2- 172.21.15.103:0/2182318737 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbca804da10 0x7fbca804fed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbcc8061130 tx=0x7fbcc4001540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.546+0000 7fbccd88f700 1 --2- 172.21.15.103:0/2182318737 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbca804da10 0x7fbca804fed0 secure :-1 s=READY pgs=712 cs=0 l=1 rx=0x7fbcc8061130 tx=0x7fbcc4001540).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:18:01.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.550+0000 7fbcce090700 1 --2- 172.21.15.103:0/2182318737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcc8061a30 0x7fbcc81517e0 secure :-1 s=THROTTLE_DONE pgs=1953 cs=0 l=1 rx=0x7fbcc8145580 tx=0x7fbcb8010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.550+0000 7fbcb77fe700 1 -- 172.21.15.103:0/2182318737 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fbcb803ce10 con 0x7fbcc8061a30 2020-04-22T14:18:01.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.691+0000 7fbcd02f4700 1 -- 172.21.15.103:0/2182318737 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbcc806a960 con 0x7fbcc8061a30 2020-04-22T14:18:01.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.691+0000 7fbcce090700 1 --2- 172.21.15.103:0/2182318737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcc8061a30 0x7fbcc81517e0 secure :-1 s=THROTTLE_DONE pgs=1953 cs=0 l=1 rx=0x7fbcc8145580 tx=0x7fbcb8010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.691+0000 7fbcb77fe700 1 -- 172.21.15.103:0/2182318737 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v135) v1 ==== 100+0+10 (secure 0 0 0) 0x7fbcb8040430 con 0x7fbcc8061a30 2020-04-22T14:18:01.694 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:18:01.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.693+0000 7fbcd02f4700 1 -- 172.21.15.103:0/2182318737 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbca804da10 msgr2=0x7fbca804fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:01.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.693+0000 7fbcd02f4700 1 --2- 172.21.15.103:0/2182318737 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbca804da10 0x7fbca804fed0 secure :-1 s=READY pgs=712 cs=0 l=1 rx=0x7fbcc8061130 tx=0x7fbcc4001540).stop 2020-04-22T14:18:01.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.693+0000 7fbcd02f4700 1 -- 172.21.15.103:0/2182318737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcc8061a30 msgr2=0x7fbcc81517e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:01.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.693+0000 7fbcd02f4700 1 --2- 172.21.15.103:0/2182318737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcc8061a30 0x7fbcc81517e0 secure :-1 s=READY pgs=1953 cs=0 l=1 rx=0x7fbcc8145580 tx=0x7fbcb8010d40).stop 2020-04-22T14:18:01.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.693+0000 7fbcd02f4700 1 -- 172.21.15.103:0/2182318737 shutdown_connections 2020-04-22T14:18:01.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.693+0000 7fbcd02f4700 1 --2- 172.21.15.103:0/2182318737 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbca804da10 0x7fbca804fed0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:01.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.693+0000 7fbcd02f4700 1 --2- 172.21.15.103:0/2182318737 >> v2:172.21.15.86:3300/0 conn(0x7fbcc8141f20 0x7fbcc8063d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:01.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.693+0000 7fbcd02f4700 1 --2- 172.21.15.103:0/2182318737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcc8061a30 0x7fbcc81517e0 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:01.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.693+0000 7fbcd02f4700 1 -- 172.21.15.103:0/2182318737 >> 172.21.15.103:0/2182318737 conn(0x7fbcc805b7b0 msgr2=0x7fbcc80b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:18:01.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.693+0000 7fbcd02f4700 1 -- 172.21.15.103:0/2182318737 shutdown_connections 2020-04-22T14:18:01.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.693+0000 7fbcd02f4700 1 -- 172.21.15.103:0/2182318737 wait complete. 2020-04-22T14:18:01.705 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-04-22T14:18:01.705 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:01.719 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:18:01.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.862+0000 7ff35881b700 1 Processor -- start 2020-04-22T14:18:01.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.862+0000 7ff35881b700 1 -- start start 2020-04-22T14:18:01.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.863+0000 7ff35881b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff35412c0d0 0x7ff3541464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:18:01.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.863+0000 7ff35881b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff354063e30 0x7ff3540642a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:18:01.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.863+0000 7ff35881b700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff354143300 con 0x7ff354065fe0 2020-04-22T14:18:01.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.863+0000 7ff35881b700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3541435a0 con 0x7ff354063e30 2020-04-22T14:18:01.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.863+0000 7ff35881b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff354143840 con 0x7ff35412c0d0 2020-04-22T14:18:01.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.863+0000 7ff352d9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff354063e30 0x7ff3540642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:01.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.863+0000 7ff351d9b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff354065fe0 0x7ff35405b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49994/0 (socket says 172.21.15.103:49994) 2020-04-22T14:18:01.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.863+0000 7ff351d9b700 1 -- 172.21.15.103:0/2927843312 learned_addr learned my addr 172.21.15.103:0/2927843312 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:18:01.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.863+0000 7ff35259c700 1 --2- 172.21.15.103:0/2927843312 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff35412c0d0 0x7ff3541464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:01.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.863+0000 7ff352d9d700 1 -- 172.21.15.103:0/2927843312 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff35412c0d0 msgr2=0x7ff3541464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:18:01.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.863+0000 7ff352d9d700 1 --2- 172.21.15.103:0/2927843312 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff35412c0d0 0x7ff3541464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:18:01.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.863+0000 7ff352d9d700 1 -- 172.21.15.103:0/2927843312 >> v1:172.21.15.103:6789/0 conn(0x7ff354065fe0 legacy=0x7ff35405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:01.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.863+0000 7ff352d9d700 1 -- 172.21.15.103:0/2927843312 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff35405bb50 con 0x7ff354063e30 2020-04-22T14:18:01.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.863+0000 7ff35159a700 1 -- 172.21.15.103:0/2927843312 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 879889693 0 0) 0x7ff354143300 con 0x7ff354065fe0 2020-04-22T14:18:01.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.863+0000 7ff352d9d700 1 --2- 172.21.15.103:0/2927843312 >> v2:172.21.15.103:3300/0 conn(0x7ff354063e30 0x7ff3540642a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff34c0032b0 tx=0x7ff34c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.864+0000 7ff352d9d700 1 --2- 172.21.15.103:0/2927843312 >> v2:172.21.15.103:3300/0 conn(0x7ff354063e30 0x7ff3540642a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff34c0032b0 tx=0x7ff34c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.864+0000 7ff352d9d700 1 --2- 172.21.15.103:0/2927843312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff354063e30 0x7ff3540642a0 secure :-1 s=READY pgs=1955 cs=0 l=1 rx=0x7ff34c0032b0 tx=0x7ff34c007dc0).ready entity=mon.1 client_cookie=7d8b46cc8f7f2748 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:18:01.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.864+0000 7ff352d9d700 1 --2- 172.21.15.103:0/2927843312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff354063e30 0x7ff3540642a0 secure :-1 s=THROTTLE_DONE pgs=1955 cs=0 l=1 rx=0x7ff34c0032b0 tx=0x7ff34c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.864+0000 7ff35159a700 1 -- 172.21.15.103:0/2927843312 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff34c00a180 con 0x7ff354063e30 2020-04-22T14:18:01.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.864+0000 7ff352d9d700 1 --2- 172.21.15.103:0/2927843312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff354063e30 0x7ff3540642a0 secure :-1 s=THROTTLE_DONE pgs=1955 cs=0 l=1 rx=0x7ff34c0032b0 tx=0x7ff34c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.864+0000 7ff352d9d700 1 --2- 172.21.15.103:0/2927843312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff354063e30 0x7ff3540642a0 secure :-1 s=THROTTLE_DONE pgs=1955 cs=0 l=1 rx=0x7ff34c0032b0 tx=0x7ff34c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.864+0000 7ff35159a700 1 -- 172.21.15.103:0/2927843312 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff34c00a320 con 0x7ff354063e30 2020-04-22T14:18:01.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.864+0000 7ff35159a700 1 -- 172.21.15.103:0/2927843312 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff34c00a700 con 0x7ff354063e30 2020-04-22T14:18:01.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.864+0000 7ff35881b700 1 -- 172.21.15.103:0/2927843312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff354063e30 msgr2=0x7ff3540642a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:01.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.864+0000 7ff35881b700 1 --2- 172.21.15.103:0/2927843312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff354063e30 0x7ff3540642a0 secure :-1 s=READY pgs=1955 cs=0 l=1 rx=0x7ff34c0032b0 tx=0x7ff34c007dc0).stop 2020-04-22T14:18:01.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.864+0000 7ff35881b700 1 -- 172.21.15.103:0/2927843312 shutdown_connections 2020-04-22T14:18:01.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.864+0000 7ff35881b700 1 --2- 172.21.15.103:0/2927843312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff354063e30 0x7ff3540642a0 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:01.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.864+0000 7ff35881b700 1 --2- 172.21.15.103:0/2927843312 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff35412c0d0 0x7ff3541464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:18:01.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.864+0000 7ff35881b700 1 -- 172.21.15.103:0/2927843312 >> 172.21.15.103:0/2927843312 conn(0x7ff3540b9160 msgr2=0x7ff35405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:18:01.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.864+0000 7ff35881b700 1 -- 172.21.15.103:0/2927843312 shutdown_connections 2020-04-22T14:18:01.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.864+0000 7ff35881b700 1 -- 172.21.15.103:0/2927843312 wait complete. 2020-04-22T14:18:01.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.865+0000 7ff35881b700 1 Processor -- start 2020-04-22T14:18:01.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.865+0000 7ff35881b700 1 -- start start 2020-04-22T14:18:01.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.866+0000 7ff35881b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff35412c0d0 0x7ff35412a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:18:01.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.866+0000 7ff35881b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff35414d170 con 0x7ff354065fe0 2020-04-22T14:18:01.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.866+0000 7ff35881b700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff354149170 con 0x7ff354063e30 2020-04-22T14:18:01.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.866+0000 7ff35881b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff354142100 con 0x7ff35412c0d0 2020-04-22T14:18:01.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.866+0000 7ff35259c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff354063e30 0x7ff354148a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49998/0 (socket says 172.21.15.103:49998) 2020-04-22T14:18:01.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.866+0000 7ff35259c700 1 -- 172.21.15.103:0/3793000217 learned_addr learned my addr 172.21.15.103:0/3793000217 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:18:01.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.866+0000 7ff3437fe700 1 -- 172.21.15.103:0/3793000217 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 218168566 0 0) 0x7ff354149170 con 0x7ff354063e30 2020-04-22T14:18:01.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.866+0000 7ff3437fe700 1 -- 172.21.15.103:0/3793000217 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff330002fe0 con 0x7ff354063e30 2020-04-22T14:18:01.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.866+0000 7ff352d9d700 1 --2- 172.21.15.103:0/3793000217 >> v2:172.21.15.86:3300/0 conn(0x7ff35412c0d0 0x7ff35412a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:01.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.866+0000 7ff3437fe700 1 -- 172.21.15.103:0/3793000217 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 971466596 0 0) 0x7ff330002fe0 con 0x7ff354063e30 2020-04-22T14:18:01.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.867+0000 7ff3437fe700 1 -- 172.21.15.103:0/3793000217 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff354149170 con 0x7ff354063e30 2020-04-22T14:18:01.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.867+0000 7ff3437fe700 1 -- 172.21.15.103:0/3793000217 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7ff3480025c0 con 0x7ff354063e30 2020-04-22T14:18:01.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.867+0000 7ff3437fe700 1 -- 172.21.15.103:0/3793000217 >> v2:172.21.15.86:3300/0 conn(0x7ff35412c0d0 msgr2=0x7ff35412a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:01.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.867+0000 7ff3437fe700 1 --2- 172.21.15.103:0/3793000217 >> v2:172.21.15.86:3300/0 conn(0x7ff35412c0d0 0x7ff35412a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:01.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.867+0000 7ff3437fe700 1 -- 172.21.15.103:0/3793000217 >> v1:172.21.15.103:6789/0 conn(0x7ff354063e30 legacy=0x7ff354148a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:01.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.867+0000 7ff3437fe700 1 -- 172.21.15.103:0/3793000217 >> v1:172.21.15.86:6789/0 conn(0x7ff354065fe0 legacy=0x7ff354159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:01.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.867+0000 7ff3437fe700 1 --2- 172.21.15.103:0/3793000217 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3300049b0 0x7ff330004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:18:01.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.867+0000 7ff3437fe700 1 --2- 172.21.15.103:0/3793000217 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff330003920 0x7ff330003d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:18:01.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.867+0000 7ff3437fe700 1 --2- 172.21.15.103:0/3793000217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3300041c0 0x7ff33000b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:18:01.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.867+0000 7ff3437fe700 1 -- 172.21.15.103:0/3793000217 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff354142100 con 0x7ff330003920 2020-04-22T14:18:01.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.867+0000 7ff3437fe700 1 -- 172.21.15.103:0/3793000217 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff330004670 con 0x7ff3300041c0 2020-04-22T14:18:01.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.867+0000 7ff3437fe700 1 -- 172.21.15.103:0/3793000217 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff33000bbb0 con 0x7ff3300049b0 2020-04-22T14:18:01.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.867+0000 7ff352d9d700 1 --2- 172.21.15.103:0/3793000217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3300041c0 0x7ff33000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:01.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.867+0000 7ff351d9b700 1 --2- 172.21.15.103:0/3793000217 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff330003920 0x7ff330003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:01.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.867+0000 7ff35259c700 1 --2- 172.21.15.103:0/3793000217 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3300049b0 0x7ff330004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:01.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.867+0000 7ff352d9d700 1 -- 172.21.15.103:0/3793000217 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3300049b0 msgr2=0x7ff330004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:01.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.867+0000 7ff352d9d700 1 --2- 172.21.15.103:0/3793000217 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3300049b0 0x7ff330004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:01.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.867+0000 7ff352d9d700 1 -- 172.21.15.103:0/3793000217 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff330003920 msgr2=0x7ff330003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:01.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.867+0000 7ff352d9d700 1 --2- 172.21.15.103:0/3793000217 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff330003920 0x7ff330003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:01.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.867+0000 7ff352d9d700 1 -- 172.21.15.103:0/3793000217 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff35414afd0 con 0x7ff3300041c0 2020-04-22T14:18:01.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.867+0000 7ff35881b700 1 -- 172.21.15.103:0/3793000217 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff354124fe0 con 0x7ff3300041c0 2020-04-22T14:18:01.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.867+0000 7ff352d9d700 1 --2- 172.21.15.103:0/3793000217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3300041c0 0x7ff33000b750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff34c0032b0 tx=0x7ff34c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.867+0000 7ff35881b700 1 -- 172.21.15.103:0/3793000217 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff35412af80 con 0x7ff3300041c0 2020-04-22T14:18:01.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.867+0000 7ff352d9d700 1 -- 172.21.15.103:0/3793000217 reap_dead start 2020-04-22T14:18:01.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.867+0000 7ff352d9d700 1 --2- 172.21.15.103:0/3793000217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3300041c0 0x7ff33000b750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff34c0032b0 tx=0x7ff34c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.867+0000 7ff352d9d700 1 --2- 172.21.15.103:0/3793000217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3300041c0 0x7ff33000b750 secure :-1 s=READY pgs=1957 cs=0 l=1 rx=0x7ff34c0032b0 tx=0x7ff34c007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:18:01.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.867+0000 7ff352d9d700 1 --2- 172.21.15.103:0/3793000217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3300041c0 0x7ff33000b750 secure :-1 s=THROTTLE_DONE pgs=1957 cs=0 l=1 rx=0x7ff34c0032b0 tx=0x7ff34c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.867+0000 7ff3437fe700 1 -- 172.21.15.103:0/3793000217 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff34c005c30 con 0x7ff3300041c0 2020-04-22T14:18:01.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.867+0000 7ff352d9d700 1 --2- 172.21.15.103:0/3793000217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3300041c0 0x7ff33000b750 secure :-1 s=THROTTLE_DONE pgs=1957 cs=0 l=1 rx=0x7ff34c0032b0 tx=0x7ff34c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.867+0000 7ff3437fe700 1 -- 172.21.15.103:0/3793000217 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff34c005d90 con 0x7ff3300041c0 2020-04-22T14:18:01.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.867+0000 7ff352d9d700 1 --2- 172.21.15.103:0/3793000217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3300041c0 0x7ff33000b750 secure :-1 s=THROTTLE_DONE pgs=1957 cs=0 l=1 rx=0x7ff34c0032b0 tx=0x7ff34c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.867+0000 7ff3437fe700 1 -- 172.21.15.103:0/3793000217 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff34c011270 con 0x7ff3300041c0 2020-04-22T14:18:01.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.868+0000 7ff352d9d700 1 --2- 172.21.15.103:0/3793000217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3300041c0 0x7ff33000b750 secure :-1 s=THROTTLE_DONE pgs=1957 cs=0 l=1 rx=0x7ff34c0032b0 tx=0x7ff34c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.868+0000 7ff35881b700 1 -- 172.21.15.103:0/3793000217 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff354142240 con 0x7ff3300041c0 2020-04-22T14:18:01.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.868+0000 7ff3437fe700 1 -- 172.21.15.103:0/3793000217 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ff34c0113d0 con 0x7ff3300041c0 2020-04-22T14:18:01.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.868+0000 7ff352d9d700 1 --2- 172.21.15.103:0/3793000217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3300041c0 0x7ff33000b750 secure :-1 s=THROTTLE_DONE pgs=1957 cs=0 l=1 rx=0x7ff34c0032b0 tx=0x7ff34c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.868+0000 7ff3437fe700 1 --2- 172.21.15.103:0/3793000217 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff3300517c0 0x7ff330053c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:18:01.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.869+0000 7ff3437fe700 1 -- 172.21.15.103:0/3793000217 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff34c062080 con 0x7ff3300041c0 2020-04-22T14:18:01.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.869+0000 7ff35259c700 1 --2- 172.21.15.103:0/3793000217 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff3300517c0 0x7ff330053c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:01.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.869+0000 7ff35259c700 1 --2- 172.21.15.103:0/3793000217 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff3300517c0 0x7ff330053c80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff348007a60 tx=0x7ff34800d1f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.869+0000 7ff35259c700 1 --2- 172.21.15.103:0/3793000217 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff3300517c0 0x7ff330053c80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff348007a60 tx=0x7ff34800d1f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.869+0000 7ff35259c700 1 --2- 172.21.15.103:0/3793000217 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff3300517c0 0x7ff330053c80 secure :-1 s=READY pgs=713 cs=0 l=1 rx=0x7ff348007a60 tx=0x7ff34800d1f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:18:01.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.873+0000 7ff352d9d700 1 --2- 172.21.15.103:0/3793000217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3300041c0 0x7ff33000b750 secure :-1 s=THROTTLE_DONE pgs=1957 cs=0 l=1 rx=0x7ff34c0032b0 tx=0x7ff34c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:01.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:01.873+0000 7ff3437fe700 1 -- 172.21.15.103:0/3793000217 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ff34c03d580 con 0x7ff3300041c0 2020-04-22T14:18:02.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:02.061+0000 7ff35881b700 1 -- 172.21.15.103:0/3793000217 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff354056c90 con 0x7ff3300041c0 2020-04-22T14:18:02.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:02.062+0000 7ff352d9d700 1 --2- 172.21.15.103:0/3793000217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3300041c0 0x7ff33000b750 secure :-1 s=THROTTLE_DONE pgs=1957 cs=0 l=1 rx=0x7ff34c0032b0 tx=0x7ff34c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:02.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:02.062+0000 7ff3437fe700 1 -- 172.21.15.103:0/3793000217 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+2141 (secure 0 0 0) 0x7ff34c040ba0 con 0x7ff3300041c0 2020-04-22T14:18:02.064 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:18:02.065 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":101,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6539,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1045362246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1045362246},{"type":"v1","addr":"172.21.15.86:6835","nonce":1045362246}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":97}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:17:48.006467+0000","modified":"2020-04-22T14:17:50.019789+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9277":{"gid":9277,"name":"a","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/33849566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":33849566},{"type":"v1","addr":"172.21.15.103:6833","nonce":33849566}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2020-04-22T14:18:02.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:02.063+0000 7ff35881b700 1 -- 172.21.15.103:0/3793000217 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff3300517c0 msgr2=0x7ff330053c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:02.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:02.063+0000 7ff35881b700 1 --2- 172.21.15.103:0/3793000217 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff3300517c0 0x7ff330053c80 secure :-1 s=READY pgs=713 cs=0 l=1 rx=0x7ff348007a60 tx=0x7ff34800d1f0).stop 2020-04-22T14:18:02.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:02.063+0000 7ff35881b700 1 -- 172.21.15.103:0/3793000217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3300041c0 msgr2=0x7ff33000b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:02.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:02.063+0000 7ff35881b700 1 --2- 172.21.15.103:0/3793000217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3300041c0 0x7ff33000b750 secure :-1 s=READY pgs=1957 cs=0 l=1 rx=0x7ff34c0032b0 tx=0x7ff34c007dc0).stop 2020-04-22T14:18:02.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:02.063+0000 7ff35881b700 1 -- 172.21.15.103:0/3793000217 shutdown_connections 2020-04-22T14:18:02.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:02.063+0000 7ff35881b700 1 --2- 172.21.15.103:0/3793000217 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff3300517c0 0x7ff330053c80 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:02.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:02.063+0000 7ff35881b700 1 --2- 172.21.15.103:0/3793000217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3300041c0 0x7ff33000b750 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:02.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:02.063+0000 7ff35881b700 1 -- 172.21.15.103:0/3793000217 >> 172.21.15.103:0/3793000217 conn(0x7ff3540b9160 msgr2=0x7ff354065340 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:18:02.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:02.063+0000 7ff35881b700 1 -- 172.21.15.103:0/3793000217 shutdown_connections 2020-04-22T14:18:02.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:02.063+0000 7ff35881b700 1 -- 172.21.15.103:0/3793000217 wait complete. 2020-04-22T14:18:02.067 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 101 2020-04-22T14:18:02.277 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 9277}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 23, u'failed': [], u'epoch': 101, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [24], u'info': {u'gid_9277': {u'export_targets': [], u'name': u'a', u'incarnation': 98, u'state_seq': 3, u'state': u'up:active', u'gid': 9277, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 33849566, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 33849566, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/33849566'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:17:48.006467+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:17:50.019789+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:18:02.277 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:18:02.277 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:02.291 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:18:02.449 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:18:02.449 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:18:02.449 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:18:02.449 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 9277, 2020-04-22T14:18:02.449 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:18:02.450 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:18:02.450 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 14.439145178, 2020-04-22T14:18:02.450 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 101, 2020-04-22T14:18:02.450 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 135, 2020-04-22T14:18:02.450 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 135, 2020-04-22T14:18:02.450 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 19.653236883999998 2020-04-22T14:18:02.450 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:18:02.461 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 9277, "want_state": "up:active", "state": "up:active", "rank_uptime": 14.439145178, "mdsmap_epoch": 101, "osdmap_epoch": 135, "osdmap_epoch_barrier": 135, "uptime": 19.653236883999998 } 2020-04-22T14:18:02.461 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-04-22T14:18:02.462 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-04-22T14:18:02.462 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:02.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:02.477 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:18:02.549 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:18:02.549 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:18:02.549 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:18:02.549 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:18:02.550 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:18:02.550 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:18:02.550 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:18:02.550 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:18:02.550 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:18:02.550 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:18:02.550 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:18:02.550 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:18:02.551 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:18:02.551 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:18:02.551 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:18:02.551 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 41758sec preferred_lft 41758sec 2020-04-22T14:18:02.551 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:18:02.551 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:18:02.551 INFO:teuthology.orchestra.run.smithi103.stdout:37: brx.2@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:18:02.552 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether a6:ff:ab:51:83:b6 brd ff:ff:ff:ff:ff:ff link-netnsid 2 2020-04-22T14:18:02.552 INFO:teuthology.orchestra.run.smithi103.stdout:39: brx.0@if2: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:18:02.552 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 12:89:28:89:ea:00 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:18:02.552 INFO:teuthology.orchestra.run.smithi103.stdout:40: brx.3@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:18:02.552 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether de:47:69:02:b1:ec brd ff:ff:ff:ff:ff:ff link-netnsid 3 2020-04-22T14:18:02.552 INFO:teuthology.orchestra.run.smithi103.stdout:42: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:18:02.552 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether ca:73:ce:b9:a3:af brd ff:ff:ff:ff:ff:ff 2020-04-22T14:18:02.553 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:18:02.553 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:18:02.553 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::53b7:f2ed:76:1ad6/64 scope link noprefixroute 2020-04-22T14:18:02.553 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:18:02.553 INFO:teuthology.orchestra.run.smithi103.stdout:43: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-04-22T14:18:02.553 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether ca:73:ce:b9:a3:af brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2020-04-22T14:18:02.555 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:02.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:02.596 INFO:teuthology.orchestra.run.smithi103:> ip netns list 2020-04-22T14:18:02.654 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 1) 2020-04-22T14:18:02.654 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:02.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:02.705 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:18:02.769 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 2020-04-22T14:18:02.769 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 1 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2020-04-22T14:18:02.769 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 2 2020-04-22T14:18:02.769 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 3 2020-04-22T14:18:02.770 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:02.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:02.815 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:18:02.873 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 2020-04-22T14:18:02.873 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 1 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2020-04-22T14:18:02.873 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 2 2020-04-22T14:18:02.874 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 3 2020-04-22T14:18:02.874 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:02.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:02.922 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:18:02.981 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 2020-04-22T14:18:02.981 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 1 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2020-04-22T14:18:02.981 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 2 2020-04-22T14:18:02.981 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 3 2020-04-22T14:18:02.982 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:03.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:03.042 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:18:03.101 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 2020-04-22T14:18:03.101 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 1 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2020-04-22T14:18:03.101 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 2 2020-04-22T14:18:03.101 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 3 2020-04-22T14:18:03.101 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:03.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:03.150 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:18:03.209 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 2020-04-22T14:18:03.209 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 1 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2020-04-22T14:18:03.209 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 2 2020-04-22T14:18:03.209 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 3 2020-04-22T14:18:03.209 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:03.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:03.257 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:18:03.332 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:03.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:03.381 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 4' 2020-04-22T14:18:03.457 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:03.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:03.503 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr' 2020-04-22T14:18:03.611 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:18:03.611 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:18:03.611 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:18:03.612 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:18:03.612 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:18:03.612 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:18:03.612 INFO:teuthology.orchestra.run.smithi103.stdout:2: veth0@if43: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:18:03.612 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 4a:12:78:36:1e:6e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:18:03.612 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2020-04-22T14:18:03.613 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:18:03.613 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::4812:78ff:fe36:1e6e/64 scope link 2020-04-22T14:18:03.613 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:18:03.613 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:03.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:03.649 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr' 2020-04-22T14:18:03.757 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:18:03.757 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:18:03.758 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:18:03.758 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:18:03.758 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:18:03.758 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:18:03.758 INFO:teuthology.orchestra.run.smithi103.stdout:2: veth0@if43: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:18:03.758 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 4a:12:78:36:1e:6e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:18:03.758 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2020-04-22T14:18:03.759 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:18:03.759 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::4812:78ff:fe36:1e6e/64 scope link 2020-04-22T14:18:03.759 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:18:03.759 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.2/16 2020-04-22T14:18:03.759 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:03.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:03.796 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.4' 2020-04-22T14:18:03.871 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:03.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:03.921 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0' 2020-04-22T14:18:04.028 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:04.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:04.042 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up' 2020-04-22T14:18:04.149 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:04.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:04.163 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up' 2020-04-22T14:18:04.270 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:04.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:04.300 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254' 2020-04-22T14:18:04.408 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:04.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:04.421 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:18:04.497 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:04.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:04.548 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge-slave con-name brx.4 ifname brx.4 master ceph-brx' 2020-04-22T14:18:04.654 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.4' (bd85cdab-6e66-4759-ae5b-cd65c59bfba2) successfully added. 2020-04-22T14:18:04.655 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:04.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:04.668 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up brx.4' 2020-04-22T14:18:04.826 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/54) 2020-04-22T14:18:04.891 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2020-04-22T14:18:04.891 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi103.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2020-04-22T14:18:04.891 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:04.905 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:18:04.905 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:18:04.964 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:05.013 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:18:05.013 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:18:05.088 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:18:05.095 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:18:05.095 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:05.141 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:18:05.142 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:18:05.202 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:18:05.202 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [47] 2020-04-22T14:18:05.203 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:05.250 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:18:05.292 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:05.306 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:18:05.306 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:18:05.377 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:18:05.384 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:2020-04-22T14:18:05.382+0000 7f46dab671c0 -1 init, newargv = 0x55b1fd881ad0 newargc=9 2020-04-22T14:18:05.384 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[116512]: starting ceph client 2020-04-22T14:18:05.385 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:18:05.386 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:05.388 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[116512]: starting fuse 2020-04-22T14:18:05.401 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:18:05.401 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:18:05.460 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:18:05.460 INFO:teuthology.orchestra.run.smithi103.stdout:49 2020-04-22T14:18:05.460 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47, 49] 2020-04-22T14:18:05.461 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:05.508 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:18:05.509 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:18:05.509 INFO:teuthology.orchestra.run.smithi103:> import glob 2020-04-22T14:18:05.509 INFO:teuthology.orchestra.run.smithi103:> import re 2020-04-22T14:18:05.509 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:18:05.509 INFO:teuthology.orchestra.run.smithi103:> import subprocess 2020-04-22T14:18:05.509 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:18:05.509 INFO:teuthology.orchestra.run.smithi103:> def find_socket(client_name): 2020-04-22T14:18:05.509 INFO:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2020-04-22T14:18:05.510 INFO:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2020-04-22T14:18:05.510 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:18:05.510 INFO:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2020-04-22T14:18:05.510 INFO:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2020-04-22T14:18:05.510 INFO:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2020-04-22T14:18:05.510 INFO:teuthology.orchestra.run.smithi103:> return files[0] 2020-04-22T14:18:05.510 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:18:05.511 INFO:teuthology.orchestra.run.smithi103:> for f in files: 2020-04-22T14:18:05.511 INFO:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:18:05.511 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:18:05.511 INFO:teuthology.orchestra.run.smithi103:> return f 2020-04-22T14:18:05.511 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:18:05.511 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:18:05.511 INFO:teuthology.orchestra.run.smithi103:> print(find_socket("client.1")) 2020-04-22T14:18:05.511 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:18:05.617 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.1.116512.asok 2020-04-22T14:18:05.617 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.116512.asok 2020-04-22T14:18:05.617 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:05.631 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:18:05.631 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.116512.asok status 2020-04-22T14:18:05.788 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:18:05.788 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2020-04-22T14:18:05.789 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:18:05.789 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:18:05.789 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "1", 2020-04-22T14:18:05.789 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:18:05.789 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2020-04-22T14:18:05.789 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "116512", 2020-04-22T14:18:05.789 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:18:05.790 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:18:05.790 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2020-04-22T14:18:05.790 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2020-04-22T14:18:05.790 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 9556, 2020-04-22T14:18:05.790 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2020-04-22T14:18:05.790 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:18:05.790 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:18:05.791 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 9556 2020-04-22T14:18:05.791 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:18:05.791 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:18:05.791 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:18:05.791 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.2:0", 2020-04-22T14:18:05.791 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1851793740 2020-04-22T14:18:05.791 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:18:05.792 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:18:05.792 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:18:05.792 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:18:05.792 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.2:0", 2020-04-22T14:18:05.792 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1851793740 2020-04-22T14:18:05.793 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:18:05.793 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.9556 192.168.0.2:0/1851793740", 2020-04-22T14:18:05.793 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.2:0/1851793740", 2020-04-22T14:18:05.793 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2020-04-22T14:18:05.793 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 101, 2020-04-22T14:18:05.794 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 135, 2020-04-22T14:18:05.794 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2020-04-22T14:18:05.794 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklisted": false 2020-04-22T14:18:05.794 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:18:05.794 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:05.813 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:18:05.814 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-22T14:18:05.814 INFO:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:18:05.872 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2020-04-22T14:18:05.872 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-04-22T14:18:05.873 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:05.921 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:18:05.921 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:18:05.996 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:06.042 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok config get mds_reconnect_timeout 2020-04-22T14:18:06.193 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:18:06.194 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_reconnect_timeout": "45.000000" 2020-04-22T14:18:06.194 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:18:06.202 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_reconnect_timeout": "45.000000" } 2020-04-22T14:18:06.202 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:06.216 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok config get ms_max_backoff 2020-04-22T14:18:06.368 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:18:06.368 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_max_backoff": "15.000000" 2020-04-22T14:18:06.368 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:18:06.377 INFO:tasks.cephfs.filesystem:_json_asok output: { "ms_max_backoff": "15.000000" } 2020-04-22T14:18:06.377 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2020-04-22T14:18:06.378 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:06.391 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-04-22T14:18:06.391 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:18:06.468 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[115165]: fuse finished with error 0 and tester_r 0 2020-04-22T14:18:06.500 INFO:teuthology.orchestra.run:waiting for 900 2020-04-22T14:18:12.602 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:18:12.602 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:18:12.602 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:12.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:12.621 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:18:12.732 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:12.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:12.763 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down brx.1' 2020-04-22T14:18:12.924 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.1' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/53) 2020-04-22T14:18:12.924 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:12.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:12.940 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete brx.1' 2020-04-22T14:18:13.048 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.1' (024dd04c-850f-42e1-8160-b89c78fe30f9) successfully deleted. 2020-04-22T14:18:13.049 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:13.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:13.095 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:18:13.202 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:13.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:13.226 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:18:13.284 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:18:13.285 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:18:13.285 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:18:13.285 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:18:13.285 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:18:13.285 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:18:13.285 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:18:13.286 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:18:13.286 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:18:13.286 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:18:13.286 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:18:13.287 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:18:13.288 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:18:13.289 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:18:13.289 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:18:13.290 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 41747sec preferred_lft 41747sec 2020-04-22T14:18:13.290 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:18:13.290 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:18:13.290 INFO:teuthology.orchestra.run.smithi103.stdout:37: brx.2@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:18:13.290 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether a6:ff:ab:51:83:b6 brd ff:ff:ff:ff:ff:ff link-netnsid 2 2020-04-22T14:18:13.290 INFO:teuthology.orchestra.run.smithi103.stdout:39: brx.0@if2: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:18:13.290 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 12:89:28:89:ea:00 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:18:13.291 INFO:teuthology.orchestra.run.smithi103.stdout:40: brx.3@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:18:13.291 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether de:47:69:02:b1:ec brd ff:ff:ff:ff:ff:ff link-netnsid 3 2020-04-22T14:18:13.291 INFO:teuthology.orchestra.run.smithi103.stdout:42: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:18:13.291 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether ce:62:6d:2c:c1:6d brd ff:ff:ff:ff:ff:ff 2020-04-22T14:18:13.291 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:18:13.292 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:18:13.292 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::53b7:f2ed:76:1ad6/64 scope link noprefixroute 2020-04-22T14:18:13.292 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:18:13.292 INFO:teuthology.orchestra.run.smithi103.stdout:44: brx.4@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-04-22T14:18:13.292 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether ce:62:6d:2c:c1:6d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2020-04-22T14:18:13.293 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:13.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:13.333 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:18:13.412 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:13.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:13.459 INFO:teuthology.orchestra.run.smithi103:> nmcli connection show 2020-04-22T14:18:13.535 INFO:teuthology.orchestra.run.smithi103.stdout:NAME UUID TYPE DEVICE 2020-04-22T14:18:13.536 INFO:teuthology.orchestra.run.smithi103.stdout:System enp3s0f1 b0a308d1-bd90-60af-eb7c-0183bb425a1a ethernet enp3s0f1 2020-04-22T14:18:13.536 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-brx 4e449cd8-fab2-459e-9b05-3d27ccd38110 bridge ceph-brx 2020-04-22T14:18:13.536 INFO:teuthology.orchestra.run.smithi103.stdout:brx.4 bd85cdab-6e66-4759-ae5b-cd65c59bfba2 ethernet brx.4 2020-04-22T14:18:13.536 INFO:teuthology.orchestra.run.smithi103.stdout:eno1 206ad60d-195e-4d4b-a9fe-a5dd1f33a67d ethernet -- 2020-04-22T14:18:13.539 INFO:teuthology.orchestra.run.smithi103.stdout:eno2 894a7dd2-d329-4985-9ef9-84a92c6e1c6c ethernet -- 2020-04-22T14:18:13.539 INFO:teuthology.orchestra.run.smithi103.stdout:enp3s0f0 5a3237ce-06ab-4ae0-818b-45bdf036cb08 ethernet -- 2020-04-22T14:18:13.540 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:13.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:13.584 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:18:13.643 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:13.690 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:18:13.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.835+0000 7f9f39fd9700 1 Processor -- start 2020-04-22T14:18:13.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.835+0000 7f9f39fd9700 1 -- start start 2020-04-22T14:18:13.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.836+0000 7f9f39fd9700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9f340b63d0 0x7f9f340b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:18:13.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.836+0000 7f9f39fd9700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9f34140620 0x7f9f340664d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:18:13.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.836+0000 7f9f39fd9700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f340608e0 con 0x7f9f3414a3a0 2020-04-22T14:18:13.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.836+0000 7f9f39fd9700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f34060b80 con 0x7f9f340b63d0 2020-04-22T14:18:13.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.836+0000 7f9f39fd9700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f34060e20 con 0x7f9f34140620 2020-04-22T14:18:13.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.836+0000 7f9f33fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9f34140620 0x7f9f340664d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:13.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.836+0000 7f9f33fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9f34140620 0x7f9f340664d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57846/0 (socket says 172.21.15.103:57846) 2020-04-22T14:18:13.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.836+0000 7f9f33fff700 1 -- 172.21.15.103:0/2478083857 learned_addr learned my addr 172.21.15.103:0/2478083857 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:18:13.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.836+0000 7f9f32ffd700 1 --1- 172.21.15.103:0/2478083857 >> v1:172.21.15.103:6789/0 conn(0x7f9f3414a3a0 0x7f9f3413ff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50034/0 (socket says 172.21.15.103:50034) 2020-04-22T14:18:13.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.836+0000 7f9f337fe700 1 --2- 172.21.15.103:0/2478083857 >> v2:172.21.15.86:3300/0 conn(0x7f9f340b63d0 0x7f9f340b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:13.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.836+0000 7f9f33fff700 1 -- 172.21.15.103:0/2478083857 >> v2:172.21.15.86:3300/0 conn(0x7f9f340b63d0 msgr2=0x7f9f340b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:18:13.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.836+0000 7f9f33fff700 1 --2- 172.21.15.103:0/2478083857 >> v2:172.21.15.86:3300/0 conn(0x7f9f340b63d0 0x7f9f340b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:18:13.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.836+0000 7f9f33fff700 1 -- 172.21.15.103:0/2478083857 >> v1:172.21.15.103:6789/0 conn(0x7f9f3414a3a0 legacy=0x7f9f3413ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:13.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.836+0000 7f9f33fff700 1 -- 172.21.15.103:0/2478083857 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f340b67b0 con 0x7f9f34140620 2020-04-22T14:18:13.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.836+0000 7f9f33fff700 1 --2- 172.21.15.103:0/2478083857 >> v2:172.21.15.103:3300/0 conn(0x7f9f34140620 0x7f9f340664d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9f240032b0 tx=0x7f9f24007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:13.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.836+0000 7f9f33fff700 1 --2- 172.21.15.103:0/2478083857 >> v2:172.21.15.103:3300/0 conn(0x7f9f34140620 0x7f9f340664d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9f240032b0 tx=0x7f9f24007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:13.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.836+0000 7f9f33fff700 1 --2- 172.21.15.103:0/2478083857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f34140620 0x7f9f340664d0 secure :-1 s=READY pgs=1963 cs=0 l=1 rx=0x7f9f240032b0 tx=0x7f9f24007dc0).ready entity=mon.1 client_cookie=687690fa5e77cb4f server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:18:13.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.836+0000 7f9f33fff700 1 --2- 172.21.15.103:0/2478083857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f34140620 0x7f9f340664d0 secure :-1 s=THROTTLE_DONE pgs=1963 cs=0 l=1 rx=0x7f9f240032b0 tx=0x7f9f24007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:13.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.836+0000 7f9f327fc700 1 -- 172.21.15.103:0/2478083857 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f2400a180 con 0x7f9f34140620 2020-04-22T14:18:13.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.836+0000 7f9f33fff700 1 --2- 172.21.15.103:0/2478083857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f34140620 0x7f9f340664d0 secure :-1 s=THROTTLE_DONE pgs=1963 cs=0 l=1 rx=0x7f9f240032b0 tx=0x7f9f24007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:13.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.836+0000 7f9f33fff700 1 --2- 172.21.15.103:0/2478083857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f34140620 0x7f9f340664d0 secure :-1 s=THROTTLE_DONE pgs=1963 cs=0 l=1 rx=0x7f9f240032b0 tx=0x7f9f24007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:13.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.836+0000 7f9f327fc700 1 -- 172.21.15.103:0/2478083857 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2400a2e0 con 0x7f9f34140620 2020-04-22T14:18:13.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.836+0000 7f9f327fc700 1 -- 172.21.15.103:0/2478083857 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f2400a700 con 0x7f9f34140620 2020-04-22T14:18:13.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.836+0000 7f9f39fd9700 1 -- 172.21.15.103:0/2478083857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f34140620 msgr2=0x7f9f340664d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:13.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.836+0000 7f9f39fd9700 1 --2- 172.21.15.103:0/2478083857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f34140620 0x7f9f340664d0 secure :-1 s=READY pgs=1963 cs=0 l=1 rx=0x7f9f240032b0 tx=0x7f9f24007dc0).stop 2020-04-22T14:18:13.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.837+0000 7f9f39fd9700 1 -- 172.21.15.103:0/2478083857 shutdown_connections 2020-04-22T14:18:13.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.837+0000 7f9f39fd9700 1 --2- 172.21.15.103:0/2478083857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f34140620 0x7f9f340664d0 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:13.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.837+0000 7f9f39fd9700 1 --2- 172.21.15.103:0/2478083857 >> v2:172.21.15.86:3300/0 conn(0x7f9f340b63d0 0x7f9f340b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:18:13.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.837+0000 7f9f39fd9700 1 -- 172.21.15.103:0/2478083857 >> 172.21.15.103:0/2478083857 conn(0x7f9f3405f2c0 msgr2=0x7f9f34066e20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:18:13.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.837+0000 7f9f39fd9700 1 -- 172.21.15.103:0/2478083857 shutdown_connections 2020-04-22T14:18:13.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.837+0000 7f9f39fd9700 1 -- 172.21.15.103:0/2478083857 wait complete. 2020-04-22T14:18:13.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.838+0000 7f9f39fd9700 1 Processor -- start 2020-04-22T14:18:13.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.838+0000 7f9f39fd9700 1 -- start start 2020-04-22T14:18:13.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.839+0000 7f9f39fd9700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9f340b63d0 0x7f9f34153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:18:13.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.839+0000 7f9f39fd9700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f340b2bf0 0x7f9f34139de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:18:13.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.839+0000 7f9f39fd9700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f340b1f70 con 0x7f9f3414a3a0 2020-04-22T14:18:13.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.839+0000 7f9f39fd9700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f340b2210 con 0x7f9f340b63d0 2020-04-22T14:18:13.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.839+0000 7f9f39fd9700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f340b24b0 con 0x7f9f340b2bf0 2020-04-22T14:18:13.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.839+0000 7f9f32ffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f9f3414a3a0 0x7f9f340b0c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50040/0 (socket says 172.21.15.103:50040) 2020-04-22T14:18:13.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.839+0000 7f9f32ffd700 1 -- 172.21.15.103:0/4092155490 learned_addr learned my addr 172.21.15.103:0/4092155490 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:18:13.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.839+0000 7f9f337fe700 1 --2- 172.21.15.103:0/4092155490 >> v2:172.21.15.86:3300/0 conn(0x7f9f340b63d0 0x7f9f34153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:13.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.839+0000 7f9f33fff700 1 --2- 172.21.15.103:0/4092155490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f340b2bf0 0x7f9f34139de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:13.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.839+0000 7f9f30ff9700 1 -- 172.21.15.103:0/4092155490 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1089841432 0 0) 0x7f9f340b1f70 con 0x7f9f3414a3a0 2020-04-22T14:18:13.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.839+0000 7f9f30ff9700 1 -- 172.21.15.103:0/4092155490 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f14002fe0 con 0x7f9f3414a3a0 2020-04-22T14:18:13.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.839+0000 7f9f30ff9700 1 -- 172.21.15.103:0/4092155490 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1023000107 0 0) 0x7f9f14002fe0 con 0x7f9f3414a3a0 2020-04-22T14:18:13.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.839+0000 7f9f30ff9700 1 -- 172.21.15.103:0/4092155490 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9f340b1f70 con 0x7f9f3414a3a0 2020-04-22T14:18:13.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.839+0000 7f9f30ff9700 1 -- 172.21.15.103:0/4092155490 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f9f28001960 con 0x7f9f3414a3a0 2020-04-22T14:18:13.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.839+0000 7f9f33fff700 1 -- 172.21.15.103:0/4092155490 >> v2:172.21.15.86:3300/0 conn(0x7f9f340b63d0 msgr2=0x7f9f34153f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:13.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.839+0000 7f9f33fff700 1 --2- 172.21.15.103:0/4092155490 >> v2:172.21.15.86:3300/0 conn(0x7f9f340b63d0 0x7f9f34153f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:13.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.839+0000 7f9f33fff700 1 -- 172.21.15.103:0/4092155490 >> v1:172.21.15.103:6789/0 conn(0x7f9f3414a3a0 legacy=0x7f9f340b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:13.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.839+0000 7f9f33fff700 1 -- 172.21.15.103:0/4092155490 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f340b2750 con 0x7f9f340b2bf0 2020-04-22T14:18:13.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.839+0000 7f9f337fe700 1 --2- 172.21.15.103:0/4092155490 >> v2:172.21.15.86:3300/0 conn(0x7f9f340b63d0 0x7f9f34153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:18:13.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.839+0000 7f9f33fff700 1 --2- 172.21.15.103:0/4092155490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f340b2bf0 0x7f9f34139de0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9f240032b0 tx=0x7f9f24007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:13.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.839+0000 7f9f33fff700 1 --2- 172.21.15.103:0/4092155490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f340b2bf0 0x7f9f34139de0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9f240032b0 tx=0x7f9f24007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:13.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.839+0000 7f9f33fff700 1 --2- 172.21.15.103:0/4092155490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f340b2bf0 0x7f9f34139de0 secure :-1 s=READY pgs=178 cs=0 l=1 rx=0x7f9f240032b0 tx=0x7f9f24007dc0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:18:13.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.840+0000 7f9f33fff700 1 --2- 172.21.15.103:0/4092155490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f340b2bf0 0x7f9f34139de0 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7f9f240032b0 tx=0x7f9f24007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:13.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.840+0000 7f9f30ff9700 1 -- 172.21.15.103:0/4092155490 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f24005a40 con 0x7f9f340b2bf0 2020-04-22T14:18:13.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.840+0000 7f9f33fff700 1 --2- 172.21.15.103:0/4092155490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f340b2bf0 0x7f9f34139de0 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7f9f240032b0 tx=0x7f9f24007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:13.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.840+0000 7f9f30ff9700 1 -- 172.21.15.103:0/4092155490 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f24005ba0 con 0x7f9f340b2bf0 2020-04-22T14:18:13.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.840+0000 7f9f33fff700 1 --2- 172.21.15.103:0/4092155490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f340b2bf0 0x7f9f34139de0 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7f9f240032b0 tx=0x7f9f24007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:13.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.840+0000 7f9f39fd9700 1 -- 172.21.15.103:0/4092155490 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f340b1310 con 0x7f9f340b2bf0 2020-04-22T14:18:13.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.840+0000 7f9f30ff9700 1 -- 172.21.15.103:0/4092155490 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f240110d0 con 0x7f9f340b2bf0 2020-04-22T14:18:13.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.840+0000 7f9f39fd9700 1 -- 172.21.15.103:0/4092155490 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f340b37c0 con 0x7f9f340b2bf0 2020-04-22T14:18:13.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.840+0000 7f9f33fff700 1 --2- 172.21.15.103:0/4092155490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f340b2bf0 0x7f9f34139de0 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7f9f240032b0 tx=0x7f9f24007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:13.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.841+0000 7f9f39fd9700 1 -- 172.21.15.103:0/4092155490 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f340b28e0 con 0x7f9f340b2bf0 2020-04-22T14:18:13.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.841+0000 7f9f30ff9700 1 -- 172.21.15.103:0/4092155490 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f9f240112d0 con 0x7f9f340b2bf0 2020-04-22T14:18:13.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.841+0000 7f9f33fff700 1 --2- 172.21.15.103:0/4092155490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f340b2bf0 0x7f9f34139de0 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7f9f240032b0 tx=0x7f9f24007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:13.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.841+0000 7f9f30ff9700 1 --2- 172.21.15.103:0/4092155490 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9f1404dff0 0x7f9f140504b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:18:13.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.841+0000 7f9f30ff9700 1 -- 172.21.15.103:0/4092155490 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9f240619d0 con 0x7f9f340b2bf0 2020-04-22T14:18:13.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.841+0000 7f9f337fe700 1 --2- 172.21.15.103:0/4092155490 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9f1404dff0 0x7f9f140504b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:13.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.841+0000 7f9f337fe700 1 --2- 172.21.15.103:0/4092155490 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9f1404dff0 0x7f9f140504b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9f2c002f30 tx=0x7f9f2c00b460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:13.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.842+0000 7f9f337fe700 1 --2- 172.21.15.103:0/4092155490 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9f1404dff0 0x7f9f140504b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9f2c002f30 tx=0x7f9f2c00b460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:13.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.842+0000 7f9f337fe700 1 --2- 172.21.15.103:0/4092155490 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9f1404dff0 0x7f9f140504b0 secure :-1 s=READY pgs=714 cs=0 l=1 rx=0x7f9f2c002f30 tx=0x7f9f2c00b460).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:18:13.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.845+0000 7f9f33fff700 1 --2- 172.21.15.103:0/4092155490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f340b2bf0 0x7f9f34139de0 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7f9f240032b0 tx=0x7f9f24007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:13.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.845+0000 7f9f30ff9700 1 -- 172.21.15.103:0/4092155490 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f9f2403ced0 con 0x7f9f340b2bf0 2020-04-22T14:18:13.991 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.988+0000 7f9f39fd9700 1 -- 172.21.15.103:0/4092155490 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f340b14a0 con 0x7f9f340b2bf0 2020-04-22T14:18:13.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.990+0000 7f9f33fff700 1 --2- 172.21.15.103:0/4092155490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f340b2bf0 0x7f9f34139de0 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7f9f240032b0 tx=0x7f9f24007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:13.993 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.990+0000 7f9f30ff9700 1 -- 172.21.15.103:0/4092155490 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+16103 (secure 0 0 0) 0x7f9f240404f0 con 0x7f9f340b2bf0 2020-04-22T14:18:13.993 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:18:13.994 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":135,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:17:49.007669+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:17:45.940111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2020-04-22T14:17:46.960856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:18:13.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.991+0000 7f9f39fd9700 1 -- 172.21.15.103:0/4092155490 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9f1404dff0 msgr2=0x7f9f140504b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:13.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.991+0000 7f9f39fd9700 1 --2- 172.21.15.103:0/4092155490 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9f1404dff0 0x7f9f140504b0 secure :-1 s=READY pgs=714 cs=0 l=1 rx=0x7f9f2c002f30 tx=0x7f9f2c00b460).stop 2020-04-22T14:18:13.996 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.991+0000 7f9f39fd9700 1 -- 172.21.15.103:0/4092155490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f340b2bf0 msgr2=0x7f9f34139de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:13.996 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.991+0000 7f9f39fd9700 1 --2- 172.21.15.103:0/4092155490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f340b2bf0 0x7f9f34139de0 secure :-1 s=READY pgs=178 cs=0 l=1 rx=0x7f9f240032b0 tx=0x7f9f24007dc0).stop 2020-04-22T14:18:13.996 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.991+0000 7f9f39fd9700 1 -- 172.21.15.103:0/4092155490 shutdown_connections 2020-04-22T14:18:13.997 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.991+0000 7f9f39fd9700 1 --2- 172.21.15.103:0/4092155490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f340b2bf0 0x7f9f34139de0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:13.997 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.991+0000 7f9f39fd9700 1 --2- 172.21.15.103:0/4092155490 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9f1404dff0 0x7f9f140504b0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:13.997 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.991+0000 7f9f39fd9700 1 --2- 172.21.15.103:0/4092155490 >> v2:172.21.15.86:3300/0 conn(0x7f9f340b63d0 0x7f9f34153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:13.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.991+0000 7f9f39fd9700 1 -- 172.21.15.103:0/4092155490 >> 172.21.15.103:0/4092155490 conn(0x7f9f3405f2c0 msgr2=0x7f9f3413e820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:18:13.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.991+0000 7f9f39fd9700 1 -- 172.21.15.103:0/4092155490 shutdown_connections 2020-04-22T14:18:13.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:13.991+0000 7f9f39fd9700 1 -- 172.21.15.103:0/4092155490 wait complete. 2020-04-22T14:18:14.006 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:17:45.940111+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 23, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'134', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:17:46.960856+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 24, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'135', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:18:14.007 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:14.021 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:18:14.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.167+0000 7f689844c700 1 Processor -- start 2020-04-22T14:18:14.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.167+0000 7f689844c700 1 -- start start 2020-04-22T14:18:14.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.168+0000 7f689844c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f68900ac950 0x7f6890146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:18:14.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.168+0000 7f689844c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f68901470a0 0x7f6890143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:18:14.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.168+0000 7f689844c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68901467e0 con 0x7f68900b9140 2020-04-22T14:18:14.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.168+0000 7f689844c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68900602f0 con 0x7f68901470a0 2020-04-22T14:18:14.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.168+0000 7f689844c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6890060050 con 0x7f68900ac950 2020-04-22T14:18:14.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.168+0000 7f68961e8700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f68900b9140 0x7f689012b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50046/0 (socket says 172.21.15.103:50046) 2020-04-22T14:18:14.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.168+0000 7f68961e8700 1 -- 172.21.15.103:0/2815955019 learned_addr learned my addr 172.21.15.103:0/2815955019 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:18:14.181 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.168+0000 7f68959e7700 1 --2- 172.21.15.103:0/2815955019 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f68900ac950 0x7f6890146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:14.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.168+0000 7f68969e9700 1 --2- 172.21.15.103:0/2815955019 >> v2:172.21.15.86:3300/0 conn(0x7f68901470a0 0x7f6890143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:14.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.169+0000 7f68951e6700 1 -- 172.21.15.103:0/2815955019 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1450665425 0 0) 0x7f68901467e0 con 0x7f68900b9140 2020-04-22T14:18:14.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.169+0000 7f68951e6700 1 -- 172.21.15.103:0/2815955019 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6878003230 con 0x7f68900b9140 2020-04-22T14:18:14.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.169+0000 7f68951e6700 1 -- 172.21.15.103:0/2815955019 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1113893183 0 0) 0x7f6878003230 con 0x7f68900b9140 2020-04-22T14:18:14.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.169+0000 7f68969e9700 1 -- 172.21.15.103:0/2815955019 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f68900ac950 msgr2=0x7f6890146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:18:14.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.169+0000 7f68969e9700 1 --2- 172.21.15.103:0/2815955019 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f68900ac950 0x7f6890146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:18:14.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.169+0000 7f68969e9700 1 -- 172.21.15.103:0/2815955019 >> v1:172.21.15.103:6789/0 conn(0x7f68900b9140 legacy=0x7f689012b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:14.183 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.169+0000 7f68969e9700 1 -- 172.21.15.103:0/2815955019 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68900b9520 con 0x7f68901470a0 2020-04-22T14:18:14.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.169+0000 7f68959e7700 1 --2- 172.21.15.103:0/2815955019 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f68900ac950 0x7f6890146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:18:14.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.169+0000 7f68969e9700 1 --2- 172.21.15.103:0/2815955019 >> v2:172.21.15.86:3300/0 conn(0x7f68901470a0 0x7f6890143090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6880001870 tx=0x7f6888007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.169+0000 7f68969e9700 1 --2- 172.21.15.103:0/2815955019 >> v2:172.21.15.86:3300/0 conn(0x7f68901470a0 0x7f6890143090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6880001870 tx=0x7f6888007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.169+0000 7f68969e9700 1 --2- 172.21.15.103:0/2815955019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68901470a0 0x7f6890143090 secure :-1 s=READY pgs=1035 cs=0 l=1 rx=0x7f6880001870 tx=0x7f6888007dc0).ready entity=mon.0 client_cookie=cc7c95795c83c3dd server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:18:14.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.169+0000 7f68969e9700 1 --2- 172.21.15.103:0/2815955019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68901470a0 0x7f6890143090 secure :-1 s=THROTTLE_DONE pgs=1035 cs=0 l=1 rx=0x7f6880001870 tx=0x7f6888007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.169+0000 7f68951e6700 1 -- 172.21.15.103:0/2815955019 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68800016d0 con 0x7f68901470a0 2020-04-22T14:18:14.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.169+0000 7f68969e9700 1 --2- 172.21.15.103:0/2815955019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68901470a0 0x7f6890143090 secure :-1 s=THROTTLE_DONE pgs=1035 cs=0 l=1 rx=0x7f6880001870 tx=0x7f6888007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.169+0000 7f68951e6700 1 -- 172.21.15.103:0/2815955019 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6888010a10 con 0x7f68901470a0 2020-04-22T14:18:14.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.169+0000 7f68969e9700 1 --2- 172.21.15.103:0/2815955019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68901470a0 0x7f6890143090 secure :-1 s=THROTTLE_DONE pgs=1035 cs=0 l=1 rx=0x7f6880001870 tx=0x7f6888007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.169+0000 7f68951e6700 1 -- 172.21.15.103:0/2815955019 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6888010df0 con 0x7f68901470a0 2020-04-22T14:18:14.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.169+0000 7f689844c700 1 -- 172.21.15.103:0/2815955019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68901470a0 msgr2=0x7f6890143090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:14.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.169+0000 7f689844c700 1 --2- 172.21.15.103:0/2815955019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68901470a0 0x7f6890143090 secure :-1 s=READY pgs=1035 cs=0 l=1 rx=0x7f6880001870 tx=0x7f6888007dc0).stop 2020-04-22T14:18:14.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.170+0000 7f689844c700 1 -- 172.21.15.103:0/2815955019 shutdown_connections 2020-04-22T14:18:14.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.170+0000 7f689844c700 1 --2- 172.21.15.103:0/2815955019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68901470a0 0x7f6890143090 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:14.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.170+0000 7f689844c700 1 --2- 172.21.15.103:0/2815955019 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f68900ac950 0x7f6890146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:18:14.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.170+0000 7f689844c700 1 -- 172.21.15.103:0/2815955019 >> 172.21.15.103:0/2815955019 conn(0x7f689005b7b0 msgr2=0x7f68900b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:18:14.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.170+0000 7f689844c700 1 -- 172.21.15.103:0/2815955019 shutdown_connections 2020-04-22T14:18:14.188 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.170+0000 7f689844c700 1 -- 172.21.15.103:0/2815955019 wait complete. 2020-04-22T14:18:14.188 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.171+0000 7f689844c700 1 Processor -- start 2020-04-22T14:18:14.188 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.171+0000 7f689844c700 1 -- start start 2020-04-22T14:18:14.188 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.171+0000 7f689844c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f68900ac950 0x7f68900b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:18:14.188 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.171+0000 7f689844c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f68901470a0 0x7f68901416d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:18:14.188 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.171+0000 7f689844c700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6890066ae0 con 0x7f68900b9140 2020-04-22T14:18:14.188 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.171+0000 7f689844c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6890066100 con 0x7f68901470a0 2020-04-22T14:18:14.189 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.171+0000 7f689844c700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68900663a0 con 0x7f68900ac950 2020-04-22T14:18:14.189 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.172+0000 7f68961e8700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f68900ac950 0x7f68900b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:14.189 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.172+0000 7f68961e8700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f68900ac950 0x7f68900b54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57862/0 (socket says 172.21.15.103:57862) 2020-04-22T14:18:14.189 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.172+0000 7f68961e8700 1 -- 172.21.15.103:0/1851480291 learned_addr learned my addr 172.21.15.103:0/1851480291 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:18:14.189 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.172+0000 7f68969e9700 1 --2- 172.21.15.103:0/1851480291 >> v2:172.21.15.86:3300/0 conn(0x7f68901470a0 0x7f68901416d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:14.190 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.172+0000 7f68961e8700 1 -- 172.21.15.103:0/1851480291 >> v2:172.21.15.86:3300/0 conn(0x7f68901470a0 msgr2=0x7f68901416d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:14.190 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.172+0000 7f68961e8700 1 --2- 172.21.15.103:0/1851480291 >> v2:172.21.15.86:3300/0 conn(0x7f68901470a0 0x7f68901416d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:14.190 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.172+0000 7f68961e8700 1 -- 172.21.15.103:0/1851480291 >> v1:172.21.15.86:6789/0 conn(0x7f68900b9140 legacy=0x7f6890065880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:14.190 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.172+0000 7f68961e8700 1 -- 172.21.15.103:0/1851480291 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6890066640 con 0x7f68900ac950 2020-04-22T14:18:14.190 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.172+0000 7f68969e9700 1 --2- 172.21.15.103:0/1851480291 >> v2:172.21.15.86:3300/0 conn(0x7f68901470a0 0x7f68901416d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:18:14.190 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.172+0000 7f68961e8700 1 --2- 172.21.15.103:0/1851480291 >> v2:172.21.15.103:3300/0 conn(0x7f68900ac950 0x7f68900b54e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6890150850 tx=0x7f6880010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.191 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.172+0000 7f68961e8700 1 --2- 172.21.15.103:0/1851480291 >> v2:172.21.15.103:3300/0 conn(0x7f68900ac950 0x7f68900b54e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6890150850 tx=0x7f6880010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.191 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.172+0000 7f68961e8700 1 --2- 172.21.15.103:0/1851480291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68900ac950 0x7f68900b54e0 secure :-1 s=READY pgs=1966 cs=0 l=1 rx=0x7f6890150850 tx=0x7f6880010d60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:18:14.191 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.172+0000 7f68961e8700 1 --2- 172.21.15.103:0/1851480291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68900ac950 0x7f68900b54e0 secure :-1 s=THROTTLE_DONE pgs=1966 cs=0 l=1 rx=0x7f6890150850 tx=0x7f6880010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.191 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.172+0000 7f687f7fe700 1 -- 172.21.15.103:0/1851480291 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6880012a20 con 0x7f68900ac950 2020-04-22T14:18:14.192 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.172+0000 7f68961e8700 1 --2- 172.21.15.103:0/1851480291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68900ac950 0x7f68900b54e0 secure :-1 s=THROTTLE_DONE pgs=1966 cs=0 l=1 rx=0x7f6890150850 tx=0x7f6880010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.192 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.172+0000 7f68961e8700 1 --2- 172.21.15.103:0/1851480291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68900ac950 0x7f68900b54e0 secure :-1 s=THROTTLE_DONE pgs=1966 cs=0 l=1 rx=0x7f6890150850 tx=0x7f6880010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.192 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.172+0000 7f687f7fe700 1 -- 172.21.15.103:0/1851480291 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6880012b80 con 0x7f68900ac950 2020-04-22T14:18:14.192 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.172+0000 7f689844c700 1 -- 172.21.15.103:0/1851480291 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6890064690 con 0x7f68900ac950 2020-04-22T14:18:14.193 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.172+0000 7f687f7fe700 1 -- 172.21.15.103:0/1851480291 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f688000c570 con 0x7f68900ac950 2020-04-22T14:18:14.193 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.172+0000 7f689844c700 1 -- 172.21.15.103:0/1851480291 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6890141d70 con 0x7f68900ac950 2020-04-22T14:18:14.193 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.173+0000 7f68961e8700 1 --2- 172.21.15.103:0/1851480291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68900ac950 0x7f68900b54e0 secure :-1 s=THROTTLE_DONE pgs=1966 cs=0 l=1 rx=0x7f6890150850 tx=0x7f6880010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.194 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.173+0000 7f687f7fe700 1 -- 172.21.15.103:0/1851480291 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f688000c7e0 con 0x7f68900ac950 2020-04-22T14:18:14.194 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.173+0000 7f689844c700 1 -- 172.21.15.103:0/1851480291 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6890056c90 con 0x7f68900ac950 2020-04-22T14:18:14.194 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.174+0000 7f68961e8700 1 --2- 172.21.15.103:0/1851480291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68900ac950 0x7f68900b54e0 secure :-1 s=THROTTLE_DONE pgs=1966 cs=0 l=1 rx=0x7f6890150850 tx=0x7f6880010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.194 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.174+0000 7f687f7fe700 1 --2- 172.21.15.103:0/1851480291 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f687004da20 0x7f687004fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:18:14.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.174+0000 7f687f7fe700 1 -- 172.21.15.103:0/1851480291 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f68800615c0 con 0x7f68900ac950 2020-04-22T14:18:14.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.174+0000 7f68959e7700 1 --2- 172.21.15.103:0/1851480291 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f687004da20 0x7f687004fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:14.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.174+0000 7f68959e7700 1 --2- 172.21.15.103:0/1851480291 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f687004da20 0x7f687004fee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f688c002f30 tx=0x7f688c00ca30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.174+0000 7f68959e7700 1 --2- 172.21.15.103:0/1851480291 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f687004da20 0x7f687004fee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f688c002f30 tx=0x7f688c00ca30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.174+0000 7f68959e7700 1 --2- 172.21.15.103:0/1851480291 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f687004da20 0x7f687004fee0 secure :-1 s=READY pgs=715 cs=0 l=1 rx=0x7f688c002f30 tx=0x7f688c00ca30).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:18:14.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.178+0000 7f68961e8700 1 --2- 172.21.15.103:0/1851480291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68900ac950 0x7f68900b54e0 secure :-1 s=THROTTLE_DONE pgs=1966 cs=0 l=1 rx=0x7f6890150850 tx=0x7f6880010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.178+0000 7f687f7fe700 1 -- 172.21.15.103:0/1851480291 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f688003c940 con 0x7f68900ac950 2020-04-22T14:18:14.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.317+0000 7f689844c700 1 -- 172.21.15.103:0/1851480291 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f689006a960 con 0x7f68900ac950 2020-04-22T14:18:14.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.318+0000 7f68961e8700 1 --2- 172.21.15.103:0/1851480291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68900ac950 0x7f68900b54e0 secure :-1 s=THROTTLE_DONE pgs=1966 cs=0 l=1 rx=0x7f6890150850 tx=0x7f6880010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.318+0000 7f687f7fe700 1 -- 172.21.15.103:0/1851480291 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v135) v1 ==== 110+0+10 (secure 0 0 0) 0x7f688003ff60 con 0x7f68900ac950 2020-04-22T14:18:14.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.319+0000 7f689844c700 1 -- 172.21.15.103:0/1851480291 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f687004da20 msgr2=0x7f687004fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:14.323 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.319+0000 7f689844c700 1 --2- 172.21.15.103:0/1851480291 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f687004da20 0x7f687004fee0 secure :-1 s=READY pgs=715 cs=0 l=1 rx=0x7f688c002f30 tx=0x7f688c00ca30).stop 2020-04-22T14:18:14.324 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.319+0000 7f689844c700 1 -- 172.21.15.103:0/1851480291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68900ac950 msgr2=0x7f68900b54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:14.324 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.319+0000 7f689844c700 1 --2- 172.21.15.103:0/1851480291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68900ac950 0x7f68900b54e0 secure :-1 s=READY pgs=1966 cs=0 l=1 rx=0x7f6890150850 tx=0x7f6880010d60).stop 2020-04-22T14:18:14.324 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.319+0000 7f689844c700 1 -- 172.21.15.103:0/1851480291 shutdown_connections 2020-04-22T14:18:14.324 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.319+0000 7f689844c700 1 --2- 172.21.15.103:0/1851480291 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f687004da20 0x7f687004fee0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:14.324 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.319+0000 7f689844c700 1 --2- 172.21.15.103:0/1851480291 >> v2:172.21.15.86:3300/0 conn(0x7f68901470a0 0x7f68901416d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:14.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.319+0000 7f689844c700 1 --2- 172.21.15.103:0/1851480291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68900ac950 0x7f68900b54e0 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:14.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.319+0000 7f689844c700 1 -- 172.21.15.103:0/1851480291 >> 172.21.15.103:0/1851480291 conn(0x7f689005b7b0 msgr2=0x7f68900b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:18:14.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.319+0000 7f689844c700 1 -- 172.21.15.103:0/1851480291 shutdown_connections 2020-04-22T14:18:14.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.319+0000 7f689844c700 1 -- 172.21.15.103:0/1851480291 wait complete. 2020-04-22T14:18:14.325 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:18:14.332 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:14.348 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:18:14.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.494+0000 7f658b125700 1 Processor -- start 2020-04-22T14:18:14.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.494+0000 7f658b125700 1 -- start start 2020-04-22T14:18:14.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.495+0000 7f658b125700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65840ac950 0x7f6584146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:18:14.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.495+0000 7f658b125700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65841467e0 con 0x7f65841470a0 2020-04-22T14:18:14.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.495+0000 7f658b125700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6584060050 con 0x7f65840b9140 2020-04-22T14:18:14.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.495+0000 7f658b125700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65840602f0 con 0x7f65840ac950 2020-04-22T14:18:14.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.495+0000 7f6588ec1700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f65840b9140 0x7f658412b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50060/0 (socket says 172.21.15.103:50060) 2020-04-22T14:18:14.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.495+0000 7f6588ec1700 1 -- 172.21.15.103:0/1447897261 learned_addr learned my addr 172.21.15.103:0/1447897261 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:18:14.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.495+0000 7f65837fe700 1 -- 172.21.15.103:0/1447897261 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 518347083 0 0) 0x7f6584060050 con 0x7f65840b9140 2020-04-22T14:18:14.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.495+0000 7f6583fff700 1 --2- 172.21.15.103:0/1447897261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65840ac950 0x7f6584146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:14.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.495+0000 7f65837fe700 1 -- 172.21.15.103:0/1447897261 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6564003230 con 0x7f65840b9140 2020-04-22T14:18:14.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.495+0000 7f65837fe700 1 -- 172.21.15.103:0/1447897261 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 996542678 0 0) 0x7f6564003230 con 0x7f65840b9140 2020-04-22T14:18:14.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.495+0000 7f65837fe700 1 -- 172.21.15.103:0/1447897261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65840ac950 msgr2=0x7f6584146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:18:14.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.495+0000 7f65837fe700 1 --2- 172.21.15.103:0/1447897261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65840ac950 0x7f6584146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:18:14.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.496+0000 7f65837fe700 1 -- 172.21.15.103:0/1447897261 >> v1:172.21.15.86:6789/0 conn(0x7f65841470a0 legacy=0x7f6584143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:14.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.496+0000 7f65837fe700 1 -- 172.21.15.103:0/1447897261 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65840b9520 con 0x7f65840b9140 2020-04-22T14:18:14.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.496+0000 7f65837fe700 1 -- 172.21.15.103:0/1447897261 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f656c0016d0 con 0x7f65840b9140 2020-04-22T14:18:14.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.496+0000 7f65837fe700 1 -- 172.21.15.103:0/1447897261 >> v1:172.21.15.103:6789/0 conn(0x7f65840b9140 legacy=0x7f658412b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:14.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.496+0000 7f65837fe700 1 --2- 172.21.15.103:0/1447897261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6564003720 0x7f6564003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:18:14.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.496+0000 7f65837fe700 1 --2- 172.21.15.103:0/1447897261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65840ac950 0x7f6564003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:18:14.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.496+0000 7f65837fe700 1 --2- 172.21.15.103:0/1447897261 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6564004520 0x7f65640049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:18:14.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.496+0000 7f65837fe700 1 -- 172.21.15.103:0/1447897261 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65840602f0 con 0x7f6564004520 2020-04-22T14:18:14.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.496+0000 7f65837fe700 1 -- 172.21.15.103:0/1447897261 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6564004ef0 con 0x7f6564003720 2020-04-22T14:18:14.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.496+0000 7f65837fe700 1 -- 172.21.15.103:0/1447897261 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65640050b0 con 0x7f65840ac950 2020-04-22T14:18:14.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.496+0000 7f6588ec1700 1 --2- 172.21.15.103:0/1447897261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6564003720 0x7f6564003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:14.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.496+0000 7f6583fff700 1 --2- 172.21.15.103:0/1447897261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65840ac950 0x7f6564003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:14.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.496+0000 7f65896c2700 1 --2- 172.21.15.103:0/1447897261 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6564004520 0x7f65640049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:14.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.496+0000 7f6588ec1700 1 -- 172.21.15.103:0/1447897261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65840ac950 msgr2=0x7f6564003ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:18:14.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.496+0000 7f6588ec1700 1 --2- 172.21.15.103:0/1447897261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65840ac950 0x7f6564003ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:18:14.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.496+0000 7f6588ec1700 1 -- 172.21.15.103:0/1447897261 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6564004520 msgr2=0x7f65640049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:18:14.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.496+0000 7f6588ec1700 1 --2- 172.21.15.103:0/1447897261 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6564004520 0x7f65640049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:18:14.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.496+0000 7f6588ec1700 1 -- 172.21.15.103:0/1447897261 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6564003230 con 0x7f6564003720 2020-04-22T14:18:14.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.496+0000 7f65896c2700 1 --2- 172.21.15.103:0/1447897261 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6564004520 0x7f65640049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:18:14.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.496+0000 7f6588ec1700 1 --2- 172.21.15.103:0/1447897261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6564003720 0x7f6564003b00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f656c0013e0 tx=0x7f65840b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.496+0000 7f6588ec1700 1 --2- 172.21.15.103:0/1447897261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6564003720 0x7f6564003b00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f656c0013e0 tx=0x7f65840b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.496+0000 7f6588ec1700 1 --2- 172.21.15.103:0/1447897261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6564003720 0x7f6564003b00 secure :-1 s=READY pgs=1968 cs=0 l=1 rx=0x7f656c0013e0 tx=0x7f65840b96b0).ready entity=mon.1 client_cookie=cb311fbc5f7402e7 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:18:14.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.496+0000 7f6588ec1700 1 --2- 172.21.15.103:0/1447897261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6564003720 0x7f6564003b00 secure :-1 s=THROTTLE_DONE pgs=1968 cs=0 l=1 rx=0x7f656c0013e0 tx=0x7f65840b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.496+0000 7f65837fe700 1 -- 172.21.15.103:0/1447897261 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f656c010d90 con 0x7f6564003720 2020-04-22T14:18:14.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.496+0000 7f6588ec1700 1 --2- 172.21.15.103:0/1447897261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6564003720 0x7f6564003b00 secure :-1 s=THROTTLE_DONE pgs=1968 cs=0 l=1 rx=0x7f656c0013e0 tx=0x7f65840b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.496+0000 7f6588ec1700 1 --2- 172.21.15.103:0/1447897261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6564003720 0x7f6564003b00 secure :-1 s=THROTTLE_DONE pgs=1968 cs=0 l=1 rx=0x7f656c0013e0 tx=0x7f65840b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.496+0000 7f65837fe700 1 -- 172.21.15.103:0/1447897261 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f656c0055e0 con 0x7f6564003720 2020-04-22T14:18:14.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.496+0000 7f65837fe700 1 -- 172.21.15.103:0/1447897261 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f656c005980 con 0x7f6564003720 2020-04-22T14:18:14.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.496+0000 7f658b125700 1 -- 172.21.15.103:0/1447897261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6564003720 msgr2=0x7f6564003b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:14.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.496+0000 7f658b125700 1 --2- 172.21.15.103:0/1447897261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6564003720 0x7f6564003b00 secure :-1 s=READY pgs=1968 cs=0 l=1 rx=0x7f656c0013e0 tx=0x7f65840b96b0).stop 2020-04-22T14:18:14.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.496+0000 7f65896c2700 1 -- 172.21.15.103:0/1447897261 reap_dead start 2020-04-22T14:18:14.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.497+0000 7f658b125700 1 -- 172.21.15.103:0/1447897261 shutdown_connections 2020-04-22T14:18:14.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.497+0000 7f658b125700 1 -- 172.21.15.103:0/1447897261 >> 172.21.15.103:0/1447897261 conn(0x7f658405b7b0 msgr2=0x7f65840b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:18:14.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.497+0000 7f658b125700 1 -- 172.21.15.103:0/1447897261 shutdown_connections 2020-04-22T14:18:14.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.497+0000 7f658b125700 1 -- 172.21.15.103:0/1447897261 wait complete. 2020-04-22T14:18:14.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.498+0000 7f658b125700 1 Processor -- start 2020-04-22T14:18:14.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.498+0000 7f658b125700 1 -- start start 2020-04-22T14:18:14.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.499+0000 7f658b125700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65840b3050 0x7f65841504b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:18:14.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.499+0000 7f658b125700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65840b80f0 con 0x7f6584151020 2020-04-22T14:18:14.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.499+0000 7f658b125700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6584151400 con 0x7f6584064510 2020-04-22T14:18:14.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.499+0000 7f658b125700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65841410d0 con 0x7f65840b3050 2020-04-22T14:18:14.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.499+0000 7f65896c2700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f6584064510 0x7f65840649a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50076/0 (socket says 172.21.15.103:50076) 2020-04-22T14:18:14.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.499+0000 7f65896c2700 1 -- 172.21.15.103:0/2579803968 learned_addr learned my addr 172.21.15.103:0/2579803968 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:18:14.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.499+0000 7f6583fff700 1 --2- 172.21.15.103:0/2579803968 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65840b3050 0x7f65841504b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:14.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.499+0000 7f6581ffb700 1 -- 172.21.15.103:0/2579803968 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1630605151 0 0) 0x7f6584151400 con 0x7f6584064510 2020-04-22T14:18:14.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.499+0000 7f6581ffb700 1 -- 172.21.15.103:0/2579803968 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6568002fe0 con 0x7f6584064510 2020-04-22T14:18:14.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.499+0000 7f6581ffb700 1 -- 172.21.15.103:0/2579803968 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2271914970 0 0) 0x7f65840b80f0 con 0x7f6584151020 2020-04-22T14:18:14.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.499+0000 7f6581ffb700 1 -- 172.21.15.103:0/2579803968 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6584151400 con 0x7f6584151020 2020-04-22T14:18:14.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.499+0000 7f6581ffb700 1 -- 172.21.15.103:0/2579803968 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1296903723 0 0) 0x7f6568002fe0 con 0x7f6584064510 2020-04-22T14:18:14.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.499+0000 7f6583fff700 1 -- 172.21.15.103:0/2579803968 >> v1:172.21.15.103:6789/0 conn(0x7f6584064510 legacy=0x7f65840649a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:14.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.499+0000 7f6583fff700 1 -- 172.21.15.103:0/2579803968 >> v1:172.21.15.86:6789/0 conn(0x7f6584151020 legacy=0x7f65840b7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:14.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.499+0000 7f6583fff700 1 -- 172.21.15.103:0/2579803968 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65840b35d0 con 0x7f65840b3050 2020-04-22T14:18:14.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.499+0000 7f6583fff700 1 --2- 172.21.15.103:0/2579803968 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65840b3050 0x7f65841504b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f657c000fe0 tx=0x7f657400c780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.499+0000 7f6583fff700 1 --2- 172.21.15.103:0/2579803968 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65840b3050 0x7f65841504b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f657c000fe0 tx=0x7f657400c780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.499+0000 7f6583fff700 1 --2- 172.21.15.103:0/2579803968 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65840b3050 0x7f65841504b0 secure :-1 s=READY pgs=179 cs=0 l=1 rx=0x7f657c000fe0 tx=0x7f657400c780).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:18:14.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.499+0000 7f6583fff700 1 --2- 172.21.15.103:0/2579803968 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65840b3050 0x7f65841504b0 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f657c000fe0 tx=0x7f657400c780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.499+0000 7f6581ffb700 1 -- 172.21.15.103:0/2579803968 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f657c001ec0 con 0x7f65840b3050 2020-04-22T14:18:14.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.499+0000 7f6583fff700 1 --2- 172.21.15.103:0/2579803968 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65840b3050 0x7f65841504b0 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f657c000fe0 tx=0x7f657400c780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.499+0000 7f6583fff700 1 --2- 172.21.15.103:0/2579803968 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65840b3050 0x7f65841504b0 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f657c000fe0 tx=0x7f657400c780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.499+0000 7f6581ffb700 1 -- 172.21.15.103:0/2579803968 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6574005e30 con 0x7f65840b3050 2020-04-22T14:18:14.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.499+0000 7f658b125700 1 -- 172.21.15.103:0/2579803968 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65840b3870 con 0x7f65840b3050 2020-04-22T14:18:14.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.499+0000 7f6581ffb700 1 -- 172.21.15.103:0/2579803968 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6574008b70 con 0x7f65840b3050 2020-04-22T14:18:14.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.500+0000 7f658b125700 1 -- 172.21.15.103:0/2579803968 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65840b3fb0 con 0x7f65840b3050 2020-04-22T14:18:14.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.500+0000 7f6583fff700 1 --2- 172.21.15.103:0/2579803968 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65840b3050 0x7f65841504b0 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f657c000fe0 tx=0x7f657400c780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.501+0000 7f658b125700 1 -- 172.21.15.103:0/2579803968 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65840b3cd0 con 0x7f65840b3050 2020-04-22T14:18:14.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.501+0000 7f6581ffb700 1 -- 172.21.15.103:0/2579803968 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f6574008d70 con 0x7f65840b3050 2020-04-22T14:18:14.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.501+0000 7f6583fff700 1 --2- 172.21.15.103:0/2579803968 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65840b3050 0x7f65841504b0 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f657c000fe0 tx=0x7f657400c780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.501+0000 7f6581ffb700 1 --2- 172.21.15.103:0/2579803968 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f656804dde0 0x7f65680502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:18:14.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.501+0000 7f6581ffb700 1 -- 172.21.15.103:0/2579803968 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6574061010 con 0x7f65840b3050 2020-04-22T14:18:14.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.501+0000 7f6588ec1700 1 --2- 172.21.15.103:0/2579803968 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f656804dde0 0x7f65680502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:14.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.501+0000 7f6588ec1700 1 --2- 172.21.15.103:0/2579803968 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f656804dde0 0x7f65680502a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f656c00bae0 tx=0x7f65840b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.501+0000 7f6588ec1700 1 --2- 172.21.15.103:0/2579803968 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f656804dde0 0x7f65680502a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f656c00bae0 tx=0x7f65840b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.501+0000 7f6588ec1700 1 --2- 172.21.15.103:0/2579803968 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f656804dde0 0x7f65680502a0 secure :-1 s=READY pgs=716 cs=0 l=1 rx=0x7f656c00bae0 tx=0x7f65840b96b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:18:14.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.505+0000 7f6583fff700 1 --2- 172.21.15.103:0/2579803968 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65840b3050 0x7f65841504b0 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f657c000fe0 tx=0x7f657400c780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.505+0000 7f6581ffb700 1 -- 172.21.15.103:0/2579803968 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f657403c450 con 0x7f65840b3050 2020-04-22T14:18:14.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.649+0000 7f658b125700 1 -- 172.21.15.103:0/2579803968 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6584056c90 con 0x7f65840b3050 2020-04-22T14:18:14.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.649+0000 7f6583fff700 1 --2- 172.21.15.103:0/2579803968 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65840b3050 0x7f65841504b0 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f657c000fe0 tx=0x7f657400c780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.649+0000 7f6581ffb700 1 -- 172.21.15.103:0/2579803968 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v135) v1 ==== 92+0+10 (secure 0 0 0) 0x7f657403fa70 con 0x7f65840b3050 2020-04-22T14:18:14.653 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:18:14.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.651+0000 7f658b125700 1 -- 172.21.15.103:0/2579803968 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f656804dde0 msgr2=0x7f65680502a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:14.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.651+0000 7f658b125700 1 --2- 172.21.15.103:0/2579803968 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f656804dde0 0x7f65680502a0 secure :-1 s=READY pgs=716 cs=0 l=1 rx=0x7f656c00bae0 tx=0x7f65840b96b0).stop 2020-04-22T14:18:14.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.651+0000 7f658b125700 1 -- 172.21.15.103:0/2579803968 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65840b3050 msgr2=0x7f65841504b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:14.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.651+0000 7f658b125700 1 --2- 172.21.15.103:0/2579803968 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65840b3050 0x7f65841504b0 secure :-1 s=READY pgs=179 cs=0 l=1 rx=0x7f657c000fe0 tx=0x7f657400c780).stop 2020-04-22T14:18:14.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.651+0000 7f658b125700 1 -- 172.21.15.103:0/2579803968 shutdown_connections 2020-04-22T14:18:14.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.651+0000 7f658b125700 1 --2- 172.21.15.103:0/2579803968 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f656804dde0 0x7f65680502a0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:14.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.651+0000 7f658b125700 1 --2- 172.21.15.103:0/2579803968 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65840b3050 0x7f65841504b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:14.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.651+0000 7f658b125700 1 -- 172.21.15.103:0/2579803968 >> 172.21.15.103:0/2579803968 conn(0x7f658405b7b0 msgr2=0x7f65841427d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:18:14.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.651+0000 7f658b125700 1 -- 172.21.15.103:0/2579803968 shutdown_connections 2020-04-22T14:18:14.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.651+0000 7f658b125700 1 -- 172.21.15.103:0/2579803968 wait complete. 2020-04-22T14:18:14.664 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:14.678 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-22T14:18:14.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.823+0000 7fd366bf4700 1 Processor -- start 2020-04-22T14:18:14.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.823+0000 7fd366bf4700 1 -- start start 2020-04-22T14:18:14.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.824+0000 7fd366bf4700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd3600b9140 0x7fd36012b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:18:14.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.824+0000 7fd366bf4700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3601467e0 con 0x7fd36012b670 2020-04-22T14:18:14.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.824+0000 7fd366bf4700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd360060050 con 0x7fd3600ac950 2020-04-22T14:18:14.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.824+0000 7fd366bf4700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3600602f0 con 0x7fd3600b9140 2020-04-22T14:18:14.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.824+0000 7fd35ffff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd3600ac950 0x7fd360146c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50080/0 (socket says 172.21.15.103:50080) 2020-04-22T14:18:14.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.824+0000 7fd35ffff700 1 -- 172.21.15.103:0/3769221490 learned_addr learned my addr 172.21.15.103:0/3769221490 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:18:14.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.824+0000 7fd364990700 1 --2- 172.21.15.103:0/3769221490 >> v2:172.21.15.86:3300/0 conn(0x7fd3600b9140 0x7fd36012b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:14.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.824+0000 7fd35f7fe700 1 -- 172.21.15.103:0/3769221490 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 930991602 0 0) 0x7fd360060050 con 0x7fd3600ac950 2020-04-22T14:18:14.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.825+0000 7fd35f7fe700 1 -- 172.21.15.103:0/3769221490 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd34c003230 con 0x7fd3600ac950 2020-04-22T14:18:14.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.825+0000 7fd35f7fe700 1 -- 172.21.15.103:0/3769221490 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2981432826 0 0) 0x7fd3601467e0 con 0x7fd36012b670 2020-04-22T14:18:14.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.825+0000 7fd35f7fe700 1 -- 172.21.15.103:0/3769221490 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd360060050 con 0x7fd36012b670 2020-04-22T14:18:14.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.825+0000 7fd364990700 1 -- 172.21.15.103:0/3769221490 >> v1:172.21.15.103:6789/0 conn(0x7fd3600ac950 legacy=0x7fd360146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:14.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.825+0000 7fd364990700 1 -- 172.21.15.103:0/3769221490 >> v1:172.21.15.86:6789/0 conn(0x7fd36012b670 legacy=0x7fd360143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:14.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.825+0000 7fd364990700 1 -- 172.21.15.103:0/3769221490 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3600b9520 con 0x7fd3600b9140 2020-04-22T14:18:14.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.825+0000 7fd364990700 1 --2- 172.21.15.103:0/3769221490 >> v2:172.21.15.86:3300/0 conn(0x7fd3600b9140 0x7fd36012b210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd350002f30 tx=0x7fd350007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.825+0000 7fd364990700 1 --2- 172.21.15.103:0/3769221490 >> v2:172.21.15.86:3300/0 conn(0x7fd3600b9140 0x7fd36012b210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd350002f30 tx=0x7fd350007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.825+0000 7fd364990700 1 --2- 172.21.15.103:0/3769221490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3600b9140 0x7fd36012b210 secure :-1 s=READY pgs=1039 cs=0 l=1 rx=0x7fd350002f30 tx=0x7fd350007a40).ready entity=mon.0 client_cookie=22532f3cfd388524 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:18:14.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.825+0000 7fd364990700 1 --2- 172.21.15.103:0/3769221490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3600b9140 0x7fd36012b210 secure :-1 s=THROTTLE_DONE pgs=1039 cs=0 l=1 rx=0x7fd350002f30 tx=0x7fd350007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.825+0000 7fd35f7fe700 1 -- 172.21.15.103:0/3769221490 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd350011310 con 0x7fd3600b9140 2020-04-22T14:18:14.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.825+0000 7fd364990700 1 --2- 172.21.15.103:0/3769221490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3600b9140 0x7fd36012b210 secure :-1 s=THROTTLE_DONE pgs=1039 cs=0 l=1 rx=0x7fd350002f30 tx=0x7fd350007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.825+0000 7fd364990700 1 --2- 172.21.15.103:0/3769221490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3600b9140 0x7fd36012b210 secure :-1 s=THROTTLE_DONE pgs=1039 cs=0 l=1 rx=0x7fd350002f30 tx=0x7fd350007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.825+0000 7fd35f7fe700 1 -- 172.21.15.103:0/3769221490 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd350011470 con 0x7fd3600b9140 2020-04-22T14:18:14.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.825+0000 7fd35f7fe700 1 -- 172.21.15.103:0/3769221490 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3500117d0 con 0x7fd3600b9140 2020-04-22T14:18:14.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.825+0000 7fd366bf4700 1 -- 172.21.15.103:0/3769221490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3600b9140 msgr2=0x7fd36012b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:14.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.825+0000 7fd366bf4700 1 --2- 172.21.15.103:0/3769221490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3600b9140 0x7fd36012b210 secure :-1 s=READY pgs=1039 cs=0 l=1 rx=0x7fd350002f30 tx=0x7fd350007a40).stop 2020-04-22T14:18:14.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.826+0000 7fd366bf4700 1 -- 172.21.15.103:0/3769221490 shutdown_connections 2020-04-22T14:18:14.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.826+0000 7fd366bf4700 1 --2- 172.21.15.103:0/3769221490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3600b9140 0x7fd36012b210 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:14.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.826+0000 7fd366bf4700 1 -- 172.21.15.103:0/3769221490 >> 172.21.15.103:0/3769221490 conn(0x7fd36005b7b0 msgr2=0x7fd3600b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:18:14.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.826+0000 7fd366bf4700 1 -- 172.21.15.103:0/3769221490 shutdown_connections 2020-04-22T14:18:14.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.826+0000 7fd366bf4700 1 -- 172.21.15.103:0/3769221490 wait complete. 2020-04-22T14:18:14.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.827+0000 7fd366bf4700 1 Processor -- start 2020-04-22T14:18:14.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.827+0000 7fd366bf4700 1 -- start start 2020-04-22T14:18:14.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.827+0000 7fd366bf4700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd36012b670 0x7fd36012a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:18:14.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.827+0000 7fd366bf4700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3601551e0 con 0x7fd3600ac950 2020-04-22T14:18:14.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.827+0000 7fd366bf4700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd360155480 con 0x7fd3600b9140 2020-04-22T14:18:14.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.827+0000 7fd366bf4700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd360127510 con 0x7fd36012b670 2020-04-22T14:18:14.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.828+0000 7fd35ffff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd3600b9140 0x7fd360126e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50088/0 (socket says 172.21.15.103:50088) 2020-04-22T14:18:14.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.828+0000 7fd35ffff700 1 -- 172.21.15.103:0/2810260133 learned_addr learned my addr 172.21.15.103:0/2810260133 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:18:14.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.828+0000 7fd365191700 1 --2- 172.21.15.103:0/2810260133 >> v2:172.21.15.103:3300/0 conn(0x7fd36012b670 0x7fd36012a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:14.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.828+0000 7fd35dffb700 1 -- 172.21.15.103:0/2810260133 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1673748830 0 0) 0x7fd360155480 con 0x7fd3600b9140 2020-04-22T14:18:14.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.828+0000 7fd35dffb700 1 -- 172.21.15.103:0/2810260133 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd340002fe0 con 0x7fd3600b9140 2020-04-22T14:18:14.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.828+0000 7fd365191700 1 -- 172.21.15.103:0/2810260133 >> v1:172.21.15.103:6789/0 conn(0x7fd3600b9140 legacy=0x7fd360126e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:14.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.828+0000 7fd365191700 1 -- 172.21.15.103:0/2810260133 >> v1:172.21.15.86:6789/0 conn(0x7fd3600ac950 legacy=0x7fd360155920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:14.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.828+0000 7fd365191700 1 -- 172.21.15.103:0/2810260133 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd360127650 con 0x7fd36012b670 2020-04-22T14:18:14.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.828+0000 7fd365191700 1 --2- 172.21.15.103:0/2810260133 >> v2:172.21.15.103:3300/0 conn(0x7fd36012b670 0x7fd36012a560 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd358001450 tx=0x7fd358010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.828+0000 7fd365191700 1 --2- 172.21.15.103:0/2810260133 >> v2:172.21.15.103:3300/0 conn(0x7fd36012b670 0x7fd36012a560 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd358001450 tx=0x7fd358010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.828+0000 7fd365191700 1 --2- 172.21.15.103:0/2810260133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd36012b670 0x7fd36012a560 secure :-1 s=READY pgs=1972 cs=0 l=1 rx=0x7fd358001450 tx=0x7fd358010c00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:18:14.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.828+0000 7fd365191700 1 --2- 172.21.15.103:0/2810260133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd36012b670 0x7fd36012a560 secure :-1 s=THROTTLE_DONE pgs=1972 cs=0 l=1 rx=0x7fd358001450 tx=0x7fd358010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.828+0000 7fd35dffb700 1 -- 172.21.15.103:0/2810260133 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3580122a0 con 0x7fd36012b670 2020-04-22T14:18:14.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.828+0000 7fd365191700 1 --2- 172.21.15.103:0/2810260133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd36012b670 0x7fd36012a560 secure :-1 s=THROTTLE_DONE pgs=1972 cs=0 l=1 rx=0x7fd358001450 tx=0x7fd358010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.828+0000 7fd35dffb700 1 -- 172.21.15.103:0/2810260133 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd358012440 con 0x7fd36012b670 2020-04-22T14:18:14.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.828+0000 7fd365191700 1 --2- 172.21.15.103:0/2810260133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd36012b670 0x7fd36012a560 secure :-1 s=THROTTLE_DONE pgs=1972 cs=0 l=1 rx=0x7fd358001450 tx=0x7fd358010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.828+0000 7fd366bf4700 1 -- 172.21.15.103:0/2810260133 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3600b7020 con 0x7fd36012b670 2020-04-22T14:18:14.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.828+0000 7fd35dffb700 1 -- 172.21.15.103:0/2810260133 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd358012820 con 0x7fd36012b670 2020-04-22T14:18:14.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.828+0000 7fd366bf4700 1 -- 172.21.15.103:0/2810260133 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3600b55e0 con 0x7fd36012b670 2020-04-22T14:18:14.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.829+0000 7fd365191700 1 --2- 172.21.15.103:0/2810260133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd36012b670 0x7fd36012a560 secure :-1 s=THROTTLE_DONE pgs=1972 cs=0 l=1 rx=0x7fd358001450 tx=0x7fd358010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.842 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.829+0000 7fd35dffb700 1 -- 172.21.15.103:0/2810260133 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fd358012aa0 con 0x7fd36012b670 2020-04-22T14:18:14.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.829+0000 7fd365191700 1 --2- 172.21.15.103:0/2810260133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd36012b670 0x7fd36012a560 secure :-1 s=THROTTLE_DONE pgs=1972 cs=0 l=1 rx=0x7fd358001450 tx=0x7fd358010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.829+0000 7fd366bf4700 1 -- 172.21.15.103:0/2810260133 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd360056c90 con 0x7fd36012b670 2020-04-22T14:18:14.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.829+0000 7fd35dffb700 1 --2- 172.21.15.103:0/2810260133 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd34004dca0 0x7fd340050160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:18:14.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.829+0000 7fd35dffb700 1 -- 172.21.15.103:0/2810260133 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd358061a70 con 0x7fd36012b670 2020-04-22T14:18:14.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.830+0000 7fd364990700 1 --2- 172.21.15.103:0/2810260133 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd34004dca0 0x7fd340050160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:14.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.830+0000 7fd364990700 1 --2- 172.21.15.103:0/2810260133 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd34004dca0 0x7fd340050160 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd3600b6090 tx=0x7fd350007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.830+0000 7fd364990700 1 --2- 172.21.15.103:0/2810260133 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd34004dca0 0x7fd340050160 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd3600b6090 tx=0x7fd350007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.830+0000 7fd364990700 1 --2- 172.21.15.103:0/2810260133 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd34004dca0 0x7fd340050160 secure :-1 s=READY pgs=717 cs=0 l=1 rx=0x7fd3600b6090 tx=0x7fd350007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:18:14.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.834+0000 7fd365191700 1 --2- 172.21.15.103:0/2810260133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd36012b670 0x7fd36012a560 secure :-1 s=THROTTLE_DONE pgs=1972 cs=0 l=1 rx=0x7fd358001450 tx=0x7fd358010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.834+0000 7fd35dffb700 1 -- 172.21.15.103:0/2810260133 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fd35803ceb0 con 0x7fd36012b670 2020-04-22T14:18:14.979 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.976+0000 7fd366bf4700 1 -- 172.21.15.103:0/2810260133 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd360066ce0 con 0x7fd36012b670 2020-04-22T14:18:14.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.976+0000 7fd365191700 1 --2- 172.21.15.103:0/2810260133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd36012b670 0x7fd36012a560 secure :-1 s=THROTTLE_DONE pgs=1972 cs=0 l=1 rx=0x7fd358001450 tx=0x7fd358010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:14.980 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.976+0000 7fd35dffb700 1 -- 172.21.15.103:0/2810260133 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v135) v1 ==== 104+0+10 (secure 0 0 0) 0x7fd3580404d0 con 0x7fd36012b670 2020-04-22T14:18:14.980 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:18:14.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.977+0000 7fd366bf4700 1 -- 172.21.15.103:0/2810260133 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd34004dca0 msgr2=0x7fd340050160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:14.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.977+0000 7fd366bf4700 1 --2- 172.21.15.103:0/2810260133 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd34004dca0 0x7fd340050160 secure :-1 s=READY pgs=717 cs=0 l=1 rx=0x7fd3600b6090 tx=0x7fd350007a40).stop 2020-04-22T14:18:14.981 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.977+0000 7fd366bf4700 1 -- 172.21.15.103:0/2810260133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd36012b670 msgr2=0x7fd36012a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:14.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.977+0000 7fd366bf4700 1 --2- 172.21.15.103:0/2810260133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd36012b670 0x7fd36012a560 secure :-1 s=READY pgs=1972 cs=0 l=1 rx=0x7fd358001450 tx=0x7fd358010c00).stop 2020-04-22T14:18:14.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.978+0000 7fd366bf4700 1 -- 172.21.15.103:0/2810260133 shutdown_connections 2020-04-22T14:18:14.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.978+0000 7fd366bf4700 1 --2- 172.21.15.103:0/2810260133 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd34004dca0 0x7fd340050160 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:14.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.978+0000 7fd366bf4700 1 --2- 172.21.15.103:0/2810260133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd36012b670 0x7fd36012a560 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:14.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.978+0000 7fd366bf4700 1 -- 172.21.15.103:0/2810260133 >> 172.21.15.103:0/2810260133 conn(0x7fd36005b7b0 msgr2=0x7fd3600ae640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:18:14.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.978+0000 7fd366bf4700 1 -- 172.21.15.103:0/2810260133 shutdown_connections 2020-04-22T14:18:14.982 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:14.978+0000 7fd366bf4700 1 -- 172.21.15.103:0/2810260133 wait complete. 2020-04-22T14:18:14.991 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:15.005 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-22T14:18:15.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.150+0000 7f3d0c3e1700 1 Processor -- start 2020-04-22T14:18:15.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.150+0000 7f3d0c3e1700 1 -- start start 2020-04-22T14:18:15.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.151+0000 7f3d0c3e1700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3d040b9890 0x7f3d04146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:18:15.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.151+0000 7f3d0c3e1700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3d041434b0 0x7f3d04143910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:18:15.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.151+0000 7f3d0c3e1700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d040b6eb0 con 0x7f3d041499f0 2020-04-22T14:18:15.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.151+0000 7f3d0c3e1700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d0405fbc0 con 0x7f3d041434b0 2020-04-22T14:18:15.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.151+0000 7f3d0c3e1700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d0405fe60 con 0x7f3d040b9890 2020-04-22T14:18:15.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.151+0000 7f3d0a17d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3d040b9890 0x7f3d04146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:15.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.151+0000 7f3d0a17d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3d040b9890 0x7f3d04146fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57904/0 (socket says 172.21.15.103:57904) 2020-04-22T14:18:15.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.151+0000 7f3d0a17d700 1 -- 172.21.15.103:0/3114901422 learned_addr learned my addr 172.21.15.103:0/3114901422 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:18:15.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.151+0000 7f3d0997c700 1 --2- 172.21.15.103:0/3114901422 >> v2:172.21.15.86:3300/0 conn(0x7f3d041434b0 0x7f3d04143910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:15.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.151+0000 7f3d0a17d700 1 -- 172.21.15.103:0/3114901422 >> v2:172.21.15.86:3300/0 conn(0x7f3d041434b0 msgr2=0x7f3d04143910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:18:15.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.151+0000 7f3d0a17d700 1 --2- 172.21.15.103:0/3114901422 >> v2:172.21.15.86:3300/0 conn(0x7f3d041434b0 0x7f3d04143910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:18:15.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.151+0000 7f3d0a17d700 1 -- 172.21.15.103:0/3114901422 >> v1:172.21.15.86:6789/0 conn(0x7f3d041499f0 legacy=0x7f3d04149e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:15.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.151+0000 7f3d0a17d700 1 -- 172.21.15.103:0/3114901422 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d04060100 con 0x7f3d040b9890 2020-04-22T14:18:15.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.151+0000 7f3d0997c700 1 --2- 172.21.15.103:0/3114901422 >> v2:172.21.15.86:3300/0 conn(0x7f3d041434b0 0x7f3d04143910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:18:15.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.152+0000 7f3d0a17d700 1 --2- 172.21.15.103:0/3114901422 >> v2:172.21.15.103:3300/0 conn(0x7f3d040b9890 0x7f3d04146fc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3d00002f30 tx=0x7f3d00007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:15.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.152+0000 7f3d0a17d700 1 --2- 172.21.15.103:0/3114901422 >> v2:172.21.15.103:3300/0 conn(0x7f3d040b9890 0x7f3d04146fc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3d00002f30 tx=0x7f3d00007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:15.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.152+0000 7f3d0a17d700 1 --2- 172.21.15.103:0/3114901422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d040b9890 0x7f3d04146fc0 secure :-1 s=READY pgs=1973 cs=0 l=1 rx=0x7f3d00002f30 tx=0x7f3d00007a40).ready entity=mon.1 client_cookie=f0194be3592922ae server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:18:15.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.152+0000 7f3d0a17d700 1 --2- 172.21.15.103:0/3114901422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d040b9890 0x7f3d04146fc0 secure :-1 s=THROTTLE_DONE pgs=1973 cs=0 l=1 rx=0x7f3d00002f30 tx=0x7f3d00007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:15.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.152+0000 7f3d0917b700 1 -- 172.21.15.103:0/3114901422 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d00011720 con 0x7f3d040b9890 2020-04-22T14:18:15.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.152+0000 7f3d0a17d700 1 --2- 172.21.15.103:0/3114901422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d040b9890 0x7f3d04146fc0 secure :-1 s=THROTTLE_DONE pgs=1973 cs=0 l=1 rx=0x7f3d00002f30 tx=0x7f3d00007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:15.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.152+0000 7f3d0a17d700 1 --2- 172.21.15.103:0/3114901422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d040b9890 0x7f3d04146fc0 secure :-1 s=THROTTLE_DONE pgs=1973 cs=0 l=1 rx=0x7f3d00002f30 tx=0x7f3d00007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:15.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.152+0000 7f3d0917b700 1 -- 172.21.15.103:0/3114901422 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d00011880 con 0x7f3d040b9890 2020-04-22T14:18:15.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.152+0000 7f3d0917b700 1 -- 172.21.15.103:0/3114901422 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d00011ca0 con 0x7f3d040b9890 2020-04-22T14:18:15.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.152+0000 7f3d0c3e1700 1 -- 172.21.15.103:0/3114901422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d040b9890 msgr2=0x7f3d04146fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:15.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.152+0000 7f3d0c3e1700 1 --2- 172.21.15.103:0/3114901422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d040b9890 0x7f3d04146fc0 secure :-1 s=READY pgs=1973 cs=0 l=1 rx=0x7f3d00002f30 tx=0x7f3d00007a40).stop 2020-04-22T14:18:15.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.152+0000 7f3d0c3e1700 1 -- 172.21.15.103:0/3114901422 shutdown_connections 2020-04-22T14:18:15.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.152+0000 7f3d0c3e1700 1 --2- 172.21.15.103:0/3114901422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d040b9890 0x7f3d04146fc0 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:15.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.152+0000 7f3d0c3e1700 1 --2- 172.21.15.103:0/3114901422 >> v2:172.21.15.86:3300/0 conn(0x7f3d041434b0 0x7f3d04143910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:18:15.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.152+0000 7f3d0c3e1700 1 -- 172.21.15.103:0/3114901422 >> 172.21.15.103:0/3114901422 conn(0x7f3d0405ad30 msgr2=0x7f3d0405b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:18:15.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.152+0000 7f3d0c3e1700 1 -- 172.21.15.103:0/3114901422 shutdown_connections 2020-04-22T14:18:15.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.152+0000 7f3d0c3e1700 1 -- 172.21.15.103:0/3114901422 wait complete. 2020-04-22T14:18:15.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.153+0000 7f3d0c3e1700 1 Processor -- start 2020-04-22T14:18:15.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.153+0000 7f3d0c3e1700 1 -- start start 2020-04-22T14:18:15.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.154+0000 7f3d0c3e1700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3d040b9890 0x7f3d041572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:18:15.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.154+0000 7f3d0c3e1700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3d041434b0 0x7f3d040ae580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:18:15.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.154+0000 7f3d0c3e1700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d040adba0 con 0x7f3d041499f0 2020-04-22T14:18:15.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.154+0000 7f3d0c3e1700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d040ade40 con 0x7f3d040b9890 2020-04-22T14:18:15.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.154+0000 7f3d0c3e1700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d040ae0e0 con 0x7f3d041434b0 2020-04-22T14:18:15.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.154+0000 7f3d0997c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3d041434b0 0x7f3d040ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:15.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.154+0000 7f3d0a17d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3d040b9890 0x7f3d041572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:15.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.154+0000 7f3d0997c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3d041434b0 0x7f3d040ae580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:42690/0 (socket says 172.21.15.103:42690) 2020-04-22T14:18:15.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.154+0000 7f3d0a97e700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f3d041499f0 0x7f3d0412e2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:39028/0 (socket says 172.21.15.103:39028) 2020-04-22T14:18:15.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.154+0000 7f3d0a17d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3d040b9890 0x7f3d041572c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:55142/0 (socket says 172.21.15.103:55142) 2020-04-22T14:18:15.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.154+0000 7f3d0997c700 1 -- 172.21.15.103:0/1462021577 learned_addr learned my addr 172.21.15.103:0/1462021577 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:18:15.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.155+0000 7f3d0997c700 1 -- 172.21.15.103:0/1462021577 >> v2:172.21.15.86:3300/0 conn(0x7f3d040b9890 msgr2=0x7f3d041572c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:15.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.155+0000 7f3d0997c700 1 --2- 172.21.15.103:0/1462021577 >> v2:172.21.15.86:3300/0 conn(0x7f3d040b9890 0x7f3d041572c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:15.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.155+0000 7f3d0997c700 1 -- 172.21.15.103:0/1462021577 >> v1:172.21.15.86:6789/0 conn(0x7f3d041499f0 legacy=0x7f3d0412e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:15.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.155+0000 7f3d0997c700 1 -- 172.21.15.103:0/1462021577 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d04143910 con 0x7f3d041434b0 2020-04-22T14:18:15.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.155+0000 7f3cf77fe700 1 -- 172.21.15.103:0/1462021577 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2580176804 0 0) 0x7f3d040adba0 con 0x7f3d041499f0 2020-04-22T14:18:15.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.155+0000 7f3d0a17d700 1 --2- 172.21.15.103:0/1462021577 >> v2:172.21.15.86:3300/0 conn(0x7f3d040b9890 0x7f3d041572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:18:15.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.155+0000 7f3d0997c700 1 --2- 172.21.15.103:0/1462021577 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3d041434b0 0x7f3d040ae580 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3cf8007920 tx=0x7f3cf8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:15.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.155+0000 7f3d0997c700 1 --2- 172.21.15.103:0/1462021577 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3d041434b0 0x7f3d040ae580 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3cf8007920 tx=0x7f3cf8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:15.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.155+0000 7f3d0997c700 1 --2- 172.21.15.103:0/1462021577 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3d041434b0 0x7f3d040ae580 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7f3cf8007920 tx=0x7f3cf8010b90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:18:15.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.155+0000 7f3d0997c700 1 --2- 172.21.15.103:0/1462021577 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3d041434b0 0x7f3d040ae580 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f3cf8007920 tx=0x7f3cf8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:15.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.155+0000 7f3cf77fe700 1 -- 172.21.15.103:0/1462021577 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3cf8005e90 con 0x7f3d041434b0 2020-04-22T14:18:15.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.155+0000 7f3d0997c700 1 --2- 172.21.15.103:0/1462021577 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3d041434b0 0x7f3d040ae580 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f3cf8007920 tx=0x7f3cf8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:15.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.155+0000 7f3d0c3e1700 1 -- 172.21.15.103:0/1462021577 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d040ad7b0 con 0x7f3d041434b0 2020-04-22T14:18:15.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.155+0000 7f3cf77fe700 1 -- 172.21.15.103:0/1462021577 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf8007180 con 0x7f3d041434b0 2020-04-22T14:18:15.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.155+0000 7f3d0997c700 1 --2- 172.21.15.103:0/1462021577 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3d041434b0 0x7f3d040ae580 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f3cf8007920 tx=0x7f3cf8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:15.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.155+0000 7f3cf77fe700 1 -- 172.21.15.103:0/1462021577 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3cf8007560 con 0x7f3d041434b0 2020-04-22T14:18:15.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.155+0000 7f3d0c3e1700 1 -- 172.21.15.103:0/1462021577 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d0412eba0 con 0x7f3d041434b0 2020-04-22T14:18:15.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.156+0000 7f3d0997c700 1 --2- 172.21.15.103:0/1462021577 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3d041434b0 0x7f3d040ae580 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f3cf8007920 tx=0x7f3cf8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:15.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.156+0000 7f3d0c3e1700 1 -- 172.21.15.103:0/1462021577 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d04056c90 con 0x7f3d041434b0 2020-04-22T14:18:15.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.156+0000 7f3cf77fe700 1 -- 172.21.15.103:0/1462021577 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f3cf800e2c0 con 0x7f3d041434b0 2020-04-22T14:18:15.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.156+0000 7f3d0997c700 1 --2- 172.21.15.103:0/1462021577 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3d041434b0 0x7f3d040ae580 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f3cf8007920 tx=0x7f3cf8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:15.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.156+0000 7f3cf77fe700 1 --2- 172.21.15.103:0/1462021577 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3ce404d880 0x7f3ce404fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:18:15.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.156+0000 7f3cf77fe700 1 -- 172.21.15.103:0/1462021577 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3cf8007e40 con 0x7f3d041434b0 2020-04-22T14:18:15.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.157+0000 7f3d0a17d700 1 --2- 172.21.15.103:0/1462021577 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3ce404d880 0x7f3ce404fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:15.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.157+0000 7f3d0a17d700 1 --2- 172.21.15.103:0/1462021577 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3ce404d880 0x7f3ce404fd40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3d00002f30 tx=0x7f3d00007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:15.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.157+0000 7f3d0a17d700 1 --2- 172.21.15.103:0/1462021577 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3ce404d880 0x7f3ce404fd40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3d00002f30 tx=0x7f3d00007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:15.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.157+0000 7f3d0a17d700 1 --2- 172.21.15.103:0/1462021577 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3ce404d880 0x7f3ce404fd40 secure :-1 s=READY pgs=718 cs=0 l=1 rx=0x7f3d00002f30 tx=0x7f3d00007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:18:15.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.160+0000 7f3d0997c700 1 --2- 172.21.15.103:0/1462021577 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3d041434b0 0x7f3d040ae580 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f3cf8007920 tx=0x7f3cf8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:15.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.160+0000 7f3cf77fe700 1 -- 172.21.15.103:0/1462021577 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f3cf803c960 con 0x7f3d041434b0 2020-04-22T14:18:15.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.301+0000 7f3d0c3e1700 1 -- 172.21.15.103:0/1462021577 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3d04143aa0 con 0x7f3d041434b0 2020-04-22T14:18:15.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.301+0000 7f3d0997c700 1 --2- 172.21.15.103:0/1462021577 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3d041434b0 0x7f3d040ae580 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f3cf8007920 tx=0x7f3cf8010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:15.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.301+0000 7f3cf77fe700 1 -- 172.21.15.103:0/1462021577 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v135) v1 ==== 100+0+10 (secure 0 0 0) 0x7f3cf803ff80 con 0x7f3d041434b0 2020-04-22T14:18:15.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.303+0000 7f3d0c3e1700 1 -- 172.21.15.103:0/1462021577 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3ce404d880 msgr2=0x7f3ce404fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:15.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.303+0000 7f3d0c3e1700 1 --2- 172.21.15.103:0/1462021577 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3ce404d880 0x7f3ce404fd40 secure :-1 s=READY pgs=718 cs=0 l=1 rx=0x7f3d00002f30 tx=0x7f3d00007a40).stop 2020-04-22T14:18:15.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.303+0000 7f3d0c3e1700 1 -- 172.21.15.103:0/1462021577 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3d041434b0 msgr2=0x7f3d040ae580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:15.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.303+0000 7f3d0c3e1700 1 --2- 172.21.15.103:0/1462021577 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3d041434b0 0x7f3d040ae580 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7f3cf8007920 tx=0x7f3cf8010b90).stop 2020-04-22T14:18:15.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.303+0000 7f3d0c3e1700 1 -- 172.21.15.103:0/1462021577 shutdown_connections 2020-04-22T14:18:15.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.303+0000 7f3d0c3e1700 1 --2- 172.21.15.103:0/1462021577 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f3ce404d880 0x7f3ce404fd40 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:15.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.303+0000 7f3d0c3e1700 1 --2- 172.21.15.103:0/1462021577 >> v2:172.21.15.86:3300/0 conn(0x7f3d040b9890 0x7f3d041572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:15.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.303+0000 7f3d0c3e1700 1 --2- 172.21.15.103:0/1462021577 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3d041434b0 0x7f3d040ae580 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:15.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.303+0000 7f3d0c3e1700 1 -- 172.21.15.103:0/1462021577 >> 172.21.15.103:0/1462021577 conn(0x7f3d0405ad30 msgr2=0x7f3d0405b110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:18:15.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.303+0000 7f3d0c3e1700 1 -- 172.21.15.103:0/1462021577 shutdown_connections 2020-04-22T14:18:15.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.303+0000 7f3d0c3e1700 1 -- 172.21.15.103:0/1462021577 wait complete. 2020-04-22T14:18:15.312 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:18:15.316 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-04-22T14:18:15.317 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:15.330 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:18:15.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.474+0000 7f321b898700 1 Processor -- start 2020-04-22T14:18:15.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.474+0000 7f321b898700 1 -- start start 2020-04-22T14:18:15.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.475+0000 7f321b898700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f32140b41b0 0x7f321414a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:18:15.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.475+0000 7f321b898700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3214060b80 con 0x7f32140b63d0 2020-04-22T14:18:15.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.475+0000 7f321b898700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3214060e20 con 0x7f3214140620 2020-04-22T14:18:15.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.475+0000 7f321b898700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3214060970 con 0x7f32140b41b0 2020-04-22T14:18:15.480 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.475+0000 7f3219e35700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f32140b41b0 0x7f321414a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:15.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.475+0000 7f3219e35700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f32140b41b0 0x7f321414a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57922/0 (socket says 172.21.15.103:57922) 2020-04-22T14:18:15.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.475+0000 7f3218e33700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f3214140620 0x7f3214146370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50110/0 (socket says 172.21.15.103:50110) 2020-04-22T14:18:15.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.475+0000 7f3219e35700 1 -- 172.21.15.103:0/198336760 learned_addr learned my addr 172.21.15.103:0/198336760 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:18:15.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.475+0000 7f3219e35700 1 -- 172.21.15.103:0/198336760 >> v1:172.21.15.103:6789/0 conn(0x7f3214140620 legacy=0x7f3214146370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:15.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.475+0000 7f3219e35700 1 -- 172.21.15.103:0/198336760 >> v1:172.21.15.86:6789/0 conn(0x7f32140b63d0 legacy=0x7f321413ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:18:15.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.475+0000 7f3219e35700 1 -- 172.21.15.103:0/198336760 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f321414a800 con 0x7f32140b41b0 2020-04-22T14:18:15.481 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.475+0000 7f3219e35700 1 --2- 172.21.15.103:0/198336760 >> v2:172.21.15.103:3300/0 conn(0x7f32140b41b0 0x7f321414a3a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f32140b6010 tx=0x7f320c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:15.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.475+0000 7f3219e35700 1 --2- 172.21.15.103:0/198336760 >> v2:172.21.15.103:3300/0 conn(0x7f32140b41b0 0x7f321414a3a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f32140b6010 tx=0x7f320c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:15.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.475+0000 7f3219e35700 1 --2- 172.21.15.103:0/198336760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32140b41b0 0x7f321414a3a0 secure :-1 s=READY pgs=1975 cs=0 l=1 rx=0x7f32140b6010 tx=0x7f320c007dc0).ready entity=mon.1 client_cookie=1b9d1a265fcba09b server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:18:15.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.475+0000 7f3219e35700 1 --2- 172.21.15.103:0/198336760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32140b41b0 0x7f321414a3a0 secure :-1 s=THROTTLE_DONE pgs=1975 cs=0 l=1 rx=0x7f32140b6010 tx=0x7f320c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:15.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.475+0000 7f3203fff700 1 -- 172.21.15.103:0/198336760 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f320c00a180 con 0x7f32140b41b0 2020-04-22T14:18:15.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.475+0000 7f3219e35700 1 --2- 172.21.15.103:0/198336760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32140b41b0 0x7f321414a3a0 secure :-1 s=THROTTLE_DONE pgs=1975 cs=0 l=1 rx=0x7f32140b6010 tx=0x7f320c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:15.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.475+0000 7f3219e35700 1 --2- 172.21.15.103:0/198336760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32140b41b0 0x7f321414a3a0 secure :-1 s=THROTTLE_DONE pgs=1975 cs=0 l=1 rx=0x7f32140b6010 tx=0x7f320c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:15.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.475+0000 7f3203fff700 1 -- 172.21.15.103:0/198336760 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f320c00a2e0 con 0x7f32140b41b0 2020-04-22T14:18:15.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.475+0000 7f3203fff700 1 -- 172.21.15.103:0/198336760 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f320c00a700 con 0x7f32140b41b0 2020-04-22T14:18:15.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.475+0000 7f321b898700 1 -- 172.21.15.103:0/198336760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32140b41b0 msgr2=0x7f321414a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:15.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.475+0000 7f321b898700 1 --2- 172.21.15.103:0/198336760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32140b41b0 0x7f321414a3a0 secure :-1 s=READY pgs=1975 cs=0 l=1 rx=0x7f32140b6010 tx=0x7f320c007dc0).stop 2020-04-22T14:18:15.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.476+0000 7f321b898700 1 -- 172.21.15.103:0/198336760 shutdown_connections 2020-04-22T14:18:15.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.476+0000 7f321b898700 1 --2- 172.21.15.103:0/198336760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32140b41b0 0x7f321414a3a0 unknown :-1 s=CLOSED pgs=1975 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:15.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.476+0000 7f321b898700 1 -- 172.21.15.103:0/198336760 >> 172.21.15.103:0/198336760 conn(0x7f321405f2c0 msgr2=0x7f3214066e20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:18:15.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.476+0000 7f321b898700 1 -- 172.21.15.103:0/198336760 shutdown_connections 2020-04-22T14:18:15.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.476+0000 7f321b898700 1 -- 172.21.15.103:0/198336760 wait complete. 2020-04-22T14:18:15.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.477+0000 7f321b898700 1 Processor -- start 2020-04-22T14:18:15.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.477+0000 7f321b898700 1 -- start start 2020-04-22T14:18:15.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.477+0000 7f321b898700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f32140b41b0 0x7f3214143f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:18:15.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.477+0000 7f321b898700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f32140b63d0 0x7f3214141010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:18:15.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.478+0000 7f321b898700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3214157200 con 0x7f3214153eb0 2020-04-22T14:18:15.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.478+0000 7f321b898700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32140b2400 con 0x7f32140b41b0 2020-04-22T14:18:15.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.478+0000 7f321b898700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32140b26a0 con 0x7f32140b63d0 2020-04-22T14:18:15.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.478+0000 7f3219634700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f32140b41b0 0x7f3214143f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:15.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.478+0000 7f3219634700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f32140b41b0 0x7f3214143f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57924/0 (socket says 172.21.15.103:57924) 2020-04-22T14:18:15.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.478+0000 7f3219634700 1 -- 172.21.15.103:0/1475994840 learned_addr learned my addr 172.21.15.103:0/1475994840 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:18:15.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.478+0000 7f3218e33700 1 --2- 172.21.15.103:0/1475994840 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f32140b63d0 0x7f3214141010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:15.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.478+0000 7f3219634700 1 -- 172.21.15.103:0/1475994840 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f32140b63d0 msgr2=0x7f3214141010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:15.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.478+0000 7f3219634700 1 --2- 172.21.15.103:0/1475994840 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f32140b63d0 0x7f3214141010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:15.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.478+0000 7f3219634700 1 -- 172.21.15.103:0/1475994840 >> v1:172.21.15.86:6789/0 conn(0x7f3214153eb0 legacy=0x7f321413cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:15.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.478+0000 7f3219634700 1 -- 172.21.15.103:0/1475994840 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f321405aff0 con 0x7f32140b41b0 2020-04-22T14:18:15.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.478+0000 7f3219634700 1 --2- 172.21.15.103:0/1475994840 >> v2:172.21.15.103:3300/0 conn(0x7f32140b41b0 0x7f3214143f70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f32100023d0 tx=0x7f3210010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:15.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.478+0000 7f3219634700 1 --2- 172.21.15.103:0/1475994840 >> v2:172.21.15.103:3300/0 conn(0x7f32140b41b0 0x7f3214143f70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f32100023d0 tx=0x7f3210010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:15.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.478+0000 7f3219634700 1 --2- 172.21.15.103:0/1475994840 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32140b41b0 0x7f3214143f70 secure :-1 s=READY pgs=1976 cs=0 l=1 rx=0x7f32100023d0 tx=0x7f3210010990).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:18:15.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.478+0000 7f3219634700 1 --2- 172.21.15.103:0/1475994840 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32140b41b0 0x7f3214143f70 secure :-1 s=THROTTLE_DONE pgs=1976 cs=0 l=1 rx=0x7f32100023d0 tx=0x7f3210010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:15.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.478+0000 7f3219634700 1 --2- 172.21.15.103:0/1475994840 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32140b41b0 0x7f3214143f70 secure :-1 s=THROTTLE_DONE pgs=1976 cs=0 l=1 rx=0x7f32100023d0 tx=0x7f3210010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:15.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.478+0000 7f3219634700 1 --2- 172.21.15.103:0/1475994840 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32140b41b0 0x7f3214143f70 secure :-1 s=THROTTLE_DONE pgs=1976 cs=0 l=1 rx=0x7f32100023d0 tx=0x7f3210010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:15.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.478+0000 7f32027fc700 1 -- 172.21.15.103:0/1475994840 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f321000cc20 con 0x7f32140b41b0 2020-04-22T14:18:15.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.478+0000 7f32027fc700 1 -- 172.21.15.103:0/1475994840 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f321000cd80 con 0x7f32140b41b0 2020-04-22T14:18:15.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.478+0000 7f32027fc700 1 -- 172.21.15.103:0/1475994840 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f321000e370 con 0x7f32140b41b0 2020-04-22T14:18:15.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.478+0000 7f321b898700 1 -- 172.21.15.103:0/1475994840 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f321405b2a0 con 0x7f32140b41b0 2020-04-22T14:18:15.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.478+0000 7f321b898700 1 -- 172.21.15.103:0/1475994840 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f321405b770 con 0x7f32140b41b0 2020-04-22T14:18:15.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.479+0000 7f3219634700 1 --2- 172.21.15.103:0/1475994840 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32140b41b0 0x7f3214143f70 secure :-1 s=THROTTLE_DONE pgs=1976 cs=0 l=1 rx=0x7f32100023d0 tx=0x7f3210010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:15.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.479+0000 7f32027fc700 1 -- 172.21.15.103:0/1475994840 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f32100064e0 con 0x7f32140b41b0 2020-04-22T14:18:15.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.479+0000 7f3219634700 1 --2- 172.21.15.103:0/1475994840 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32140b41b0 0x7f3214143f70 secure :-1 s=THROTTLE_DONE pgs=1976 cs=0 l=1 rx=0x7f32100023d0 tx=0x7f3210010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:15.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.479+0000 7f321b898700 1 -- 172.21.15.103:0/1475994840 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32141542c0 con 0x7f32140b41b0 2020-04-22T14:18:15.492 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.479+0000 7f32027fc700 1 --2- 172.21.15.103:0/1475994840 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f31f404da20 0x7f31f404fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:18:15.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.480+0000 7f32027fc700 1 -- 172.21.15.103:0/1475994840 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3210061100 con 0x7f32140b41b0 2020-04-22T14:18:15.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.480+0000 7f3218e33700 1 --2- 172.21.15.103:0/1475994840 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f31f404da20 0x7f31f404fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:18:15.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.480+0000 7f3218e33700 1 --2- 172.21.15.103:0/1475994840 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f31f404da20 0x7f31f404fee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f32140b6bf0 tx=0x7f3204001e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:15.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.480+0000 7f3218e33700 1 --2- 172.21.15.103:0/1475994840 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f31f404da20 0x7f31f404fee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f32140b6bf0 tx=0x7f3204001e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:15.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.480+0000 7f3218e33700 1 --2- 172.21.15.103:0/1475994840 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f31f404da20 0x7f31f404fee0 secure :-1 s=READY pgs=719 cs=0 l=1 rx=0x7f32140b6bf0 tx=0x7f3204001e50).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:18:15.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.484+0000 7f3219634700 1 --2- 172.21.15.103:0/1475994840 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32140b41b0 0x7f3214143f70 secure :-1 s=THROTTLE_DONE pgs=1976 cs=0 l=1 rx=0x7f32100023d0 tx=0x7f3210010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:15.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.484+0000 7f32027fc700 1 -- 172.21.15.103:0/1475994840 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f32141542c0 con 0x7f32140b41b0 2020-04-22T14:18:15.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.672+0000 7f321b898700 1 -- 172.21.15.103:0/1475994840 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f32141542c0 con 0x7f32140b41b0 2020-04-22T14:18:15.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.673+0000 7f3219634700 1 --2- 172.21.15.103:0/1475994840 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32140b41b0 0x7f3214143f70 secure :-1 s=THROTTLE_DONE pgs=1976 cs=0 l=1 rx=0x7f32100023d0 tx=0x7f3210010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:18:15.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.673+0000 7f32027fc700 1 -- 172.21.15.103:0/1475994840 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+2141 (secure 0 0 0) 0x7f32141542c0 con 0x7f32140b41b0 2020-04-22T14:18:15.677 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:18:15.677 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":101,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6539,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1045362246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1045362246},{"type":"v1","addr":"172.21.15.86:6835","nonce":1045362246}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":97}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:17:48.006467+0000","modified":"2020-04-22T14:17:50.019789+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9277":{"gid":9277,"name":"a","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/33849566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":33849566},{"type":"v1","addr":"172.21.15.103:6833","nonce":33849566}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2020-04-22T14:18:15.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.674+0000 7f321b898700 1 -- 172.21.15.103:0/1475994840 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f31f404da20 msgr2=0x7f31f404fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:15.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.674+0000 7f321b898700 1 --2- 172.21.15.103:0/1475994840 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f31f404da20 0x7f31f404fee0 secure :-1 s=READY pgs=719 cs=0 l=1 rx=0x7f32140b6bf0 tx=0x7f3204001e50).stop 2020-04-22T14:18:15.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.674+0000 7f321b898700 1 -- 172.21.15.103:0/1475994840 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32140b41b0 msgr2=0x7f3214143f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:18:15.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.674+0000 7f321b898700 1 --2- 172.21.15.103:0/1475994840 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32140b41b0 0x7f3214143f70 secure :-1 s=READY pgs=1976 cs=0 l=1 rx=0x7f32100023d0 tx=0x7f3210010990).stop 2020-04-22T14:18:15.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.674+0000 7f321b898700 1 -- 172.21.15.103:0/1475994840 shutdown_connections 2020-04-22T14:18:15.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.674+0000 7f321b898700 1 --2- 172.21.15.103:0/1475994840 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f31f404da20 0x7f31f404fee0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:15.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.674+0000 7f321b898700 1 --2- 172.21.15.103:0/1475994840 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32140b41b0 0x7f3214143f70 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:15.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.674+0000 7f321b898700 1 --2- 172.21.15.103:0/1475994840 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f32140b63d0 0x7f3214141010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:18:15.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.674+0000 7f321b898700 1 -- 172.21.15.103:0/1475994840 >> 172.21.15.103:0/1475994840 conn(0x7f321405f2c0 msgr2=0x7f3214064bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:18:15.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.674+0000 7f321b898700 1 -- 172.21.15.103:0/1475994840 shutdown_connections 2020-04-22T14:18:15.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:18:15.675+0000 7f321b898700 1 -- 172.21.15.103:0/1475994840 wait complete. 2020-04-22T14:18:15.680 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 101 2020-04-22T14:18:15.890 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 9277}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 23, u'failed': [], u'epoch': 101, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [24], u'info': {u'gid_9277': {u'export_targets': [], u'name': u'a', u'incarnation': 98, u'state_seq': 3, u'state': u'up:active', u'gid': 9277, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 33849566, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 33849566, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/33849566'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:17:48.006467+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:17:50.019789+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:18:15.890 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:18:15.891 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:15.904 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:18:16.063 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:18:16.064 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:18:16.064 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:18:16.064 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 9277, 2020-04-22T14:18:16.065 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:18:16.065 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:18:16.065 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 28.053789102, 2020-04-22T14:18:16.065 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 101, 2020-04-22T14:18:16.066 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 135, 2020-04-22T14:18:16.066 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 135, 2020-04-22T14:18:16.066 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 33.267879708000002 2020-04-22T14:18:16.066 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:18:16.072 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 9277, "want_state": "up:active", "state": "up:active", "rank_uptime": 28.053789102, "mdsmap_epoch": 101, "osdmap_epoch": 135, "osdmap_epoch_barrier": 135, "uptime": 33.267879708000002 } 2020-04-22T14:18:16.072 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-04-22T14:18:16.073 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:18:16.073 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:16.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:16.087 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:18:16.146 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:18:16.146 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:18:16.146 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:18:16.146 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:18:16.147 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:18:16.147 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:18:16.147 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:18:16.147 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:18:16.147 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:18:16.148 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:18:16.148 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:18:16.148 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:18:16.148 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:18:16.149 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:18:16.149 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:18:16.149 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 41744sec preferred_lft 41744sec 2020-04-22T14:18:16.149 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:18:16.150 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:18:16.150 INFO:teuthology.orchestra.run.smithi103.stdout:37: brx.2@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:18:16.150 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether a6:ff:ab:51:83:b6 brd ff:ff:ff:ff:ff:ff link-netnsid 2 2020-04-22T14:18:16.150 INFO:teuthology.orchestra.run.smithi103.stdout:39: brx.0@if2: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:18:16.150 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 12:89:28:89:ea:00 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:18:16.150 INFO:teuthology.orchestra.run.smithi103.stdout:40: brx.3@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:18:16.150 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether de:47:69:02:b1:ec brd ff:ff:ff:ff:ff:ff link-netnsid 3 2020-04-22T14:18:16.151 INFO:teuthology.orchestra.run.smithi103.stdout:42: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:18:16.151 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether ce:62:6d:2c:c1:6d brd ff:ff:ff:ff:ff:ff 2020-04-22T14:18:16.151 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:18:16.151 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:18:16.151 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::53b7:f2ed:76:1ad6/64 scope link noprefixroute 2020-04-22T14:18:16.151 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:18:16.151 INFO:teuthology.orchestra.run.smithi103.stdout:44: brx.4@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-04-22T14:18:16.152 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether ce:62:6d:2c:c1:6d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2020-04-22T14:18:16.152 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:16.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:16.194 INFO:teuthology.orchestra.run.smithi103:> ip netns list 2020-04-22T14:18:16.253 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 4) 2020-04-22T14:18:16.253 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:16.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:16.302 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:18:16.361 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 2020-04-22T14:18:16.361 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 2 2020-04-22T14:18:16.361 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 3 2020-04-22T14:18:16.362 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 4 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2020-04-22T14:18:16.362 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:16.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:16.409 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:18:16.470 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 2020-04-22T14:18:16.470 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 2 2020-04-22T14:18:16.470 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 3 2020-04-22T14:18:16.470 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 4 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2020-04-22T14:18:16.471 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:16.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:16.517 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:18:16.593 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:16.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:16.640 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 1' 2020-04-22T14:18:16.717 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:16.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:16.762 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr' 2020-04-22T14:18:16.869 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:18:16.869 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:18:16.870 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:18:16.870 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:18:16.870 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:18:16.870 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:18:16.871 INFO:teuthology.orchestra.run.smithi103.stdout:2: veth0@if44: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:18:16.871 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether c2:c4:a1:d1:d3:8d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:18:16.871 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.0.2/16 brd 192.168.255.255 scope global veth0 2020-04-22T14:18:16.871 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:18:16.872 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::c0c4:a1ff:fed1:d38d/64 scope link 2020-04-22T14:18:16.872 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:18:16.872 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-04-22T14:18:16.872 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:16.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:16.901 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.1' 2020-04-22T14:18:16.978 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:17.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:17.025 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0' 2020-04-22T14:18:17.132 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:17.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:17.145 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up' 2020-04-22T14:18:17.255 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:17.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:17.268 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up' 2020-04-22T14:18:17.376 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:17.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:17.390 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254' 2020-04-22T14:18:17.498 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:17.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:17.512 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:18:17.589 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:17.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:17.639 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge-slave con-name brx.1 ifname brx.1 master ceph-brx' 2020-04-22T14:18:17.747 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.1' (49d72504-2a08-4d95-8411-f715cdb06558) successfully added. 2020-04-22T14:18:17.747 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:17.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:18:17.761 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up brx.1' 2020-04-22T14:18:17.919 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/55) 2020-04-22T14:18:17.985 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-04-22T14:18:17.986 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi103.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-04-22T14:18:17.986 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:17.999 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:18:17.999 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:18:18.059 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:18.107 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:18:18.107 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:18:18.174 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:18:18.182 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:18:18.182 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:18.229 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:18:18.229 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:18:18.289 INFO:teuthology.orchestra.run.smithi103.stdout:49 2020-04-22T14:18:18.289 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [49] 2020-04-22T14:18:18.289 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:18.338 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --client_reconnect_stale=1 --fuse_disable_pagecache=1 --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:18:18.380 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:18.393 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:18:18.393 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:18:18.463 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:18:18.468 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:18:18.469 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:18.469 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:2020-04-22T14:18:18.466+0000 7f71bb3081c0 -1 init, newargv = 0x5571fcb2f6c0 newargc=9 2020-04-22T14:18:18.470 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[118109]: starting ceph client 2020-04-22T14:18:18.473 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[118109]: starting fuse 2020-04-22T14:18:18.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:18:18.485 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:18:18.545 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:18:18.545 INFO:teuthology.orchestra.run.smithi103.stdout:49 2020-04-22T14:18:18.546 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47, 49] 2020-04-22T14:18:18.546 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:18.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:18:18.592 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:18:18.592 INFO:teuthology.orchestra.run.smithi103:> import glob 2020-04-22T14:18:18.593 INFO:teuthology.orchestra.run.smithi103:> import re 2020-04-22T14:18:18.593 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:18:18.593 INFO:teuthology.orchestra.run.smithi103:> import subprocess 2020-04-22T14:18:18.593 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:18:18.594 INFO:teuthology.orchestra.run.smithi103:> def find_socket(client_name): 2020-04-22T14:18:18.594 INFO:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-04-22T14:18:18.596 INFO:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2020-04-22T14:18:18.596 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:18:18.596 INFO:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2020-04-22T14:18:18.596 INFO:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2020-04-22T14:18:18.597 INFO:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2020-04-22T14:18:18.597 INFO:teuthology.orchestra.run.smithi103:> return files[0] 2020-04-22T14:18:18.597 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:18:18.597 INFO:teuthology.orchestra.run.smithi103:> for f in files: 2020-04-22T14:18:18.597 INFO:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:18:18.597 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:18:18.597 INFO:teuthology.orchestra.run.smithi103:> return f 2020-04-22T14:18:18.597 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:18:18.598 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:18:18.598 INFO:teuthology.orchestra.run.smithi103:> print(find_socket("client.0")) 2020-04-22T14:18:18.598 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:18:18.699 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.0.118109.asok 2020-04-22T14:18:18.700 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.118109.asok 2020-04-22T14:18:18.700 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:18.714 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:18:18.714 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.118109.asok status 2020-04-22T14:18:18.896 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:18:18.897 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2020-04-22T14:18:18.897 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:18:18.897 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:18:18.897 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "0", 2020-04-22T14:18:18.897 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:18:18.898 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-04-22T14:18:18.898 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "118109", 2020-04-22T14:18:18.898 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:18:18.898 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:18:18.898 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2020-04-22T14:18:18.898 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2020-04-22T14:18:18.899 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 9604, 2020-04-22T14:18:18.899 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2020-04-22T14:18:18.899 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:18:18.899 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:18:18.899 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 9604 2020-04-22T14:18:18.899 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:18:18.900 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:18:18.900 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:18:18.900 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:18:18.900 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1609098406 2020-04-22T14:18:18.900 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:18:18.900 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:18:18.900 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:18:18.901 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:18:18.901 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:18:18.901 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1609098406 2020-04-22T14:18:18.901 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:18:18.901 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.9604 192.168.0.1:0/1609098406", 2020-04-22T14:18:18.901 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.1:0/1609098406", 2020-04-22T14:18:18.901 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2020-04-22T14:18:18.901 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 101, 2020-04-22T14:18:18.902 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 135, 2020-04-22T14:18:18.902 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2020-04-22T14:18:18.902 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklisted": false 2020-04-22T14:18:18.902 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:18:18.902 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:18.917 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:18:18.917 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-22T14:18:18.917 INFO:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:18:18.976 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2020-04-22T14:18:18.976 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-04-22T14:18:18.977 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:19.027 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:18:19.027 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:18:19.106 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:19.148 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:18:19.148 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:18:19.149 INFO:teuthology.orchestra.run.smithi103:> import sys 2020-04-22T14:18:19.149 INFO:teuthology.orchestra.run.smithi103:> import fcntl 2020-04-22T14:18:19.149 INFO:teuthology.orchestra.run.smithi103:> import errno 2020-04-22T14:18:19.149 INFO:teuthology.orchestra.run.smithi103:> import time 2020-04-22T14:18:19.149 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:18:19.150 INFO:teuthology.orchestra.run.smithi103:> fd1 = os.open("/home/ubuntu/cephtest/mnt.0/testfile_reconnect_after_blacklisted.1", os.O_RDWR | os.O_CREAT, 0O666) 2020-04-22T14:18:19.150 INFO:teuthology.orchestra.run.smithi103:> fd2 = os.open("/home/ubuntu/cephtest/mnt.0/testfile_reconnect_after_blacklisted.1", os.O_RDONLY) 2020-04-22T14:18:19.151 INFO:teuthology.orchestra.run.smithi103:> fd3 = os.open("/home/ubuntu/cephtest/mnt.0/testfile_reconnect_after_blacklisted.2", os.O_RDWR | os.O_CREAT, 0O666) 2020-04-22T14:18:19.151 INFO:teuthology.orchestra.run.smithi103:> fd4 = os.open("/home/ubuntu/cephtest/mnt.0/testfile_reconnect_after_blacklisted.2", os.O_RDONLY) 2020-04-22T14:18:19.151 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:18:19.151 INFO:teuthology.orchestra.run.smithi103:> os.write(fd1, b'"'"'content'"'"') 2020-04-22T14:18:19.151 INFO:teuthology.orchestra.run.smithi103:> os.read(fd2, 1); 2020-04-22T14:18:19.151 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:18:19.151 INFO:teuthology.orchestra.run.smithi103:> os.write(fd3, b'"'"'content'"'"') 2020-04-22T14:18:19.152 INFO:teuthology.orchestra.run.smithi103:> os.read(fd4, 1); 2020-04-22T14:18:19.152 INFO:teuthology.orchestra.run.smithi103:> fcntl.flock(fd4, fcntl.LOCK_SH | fcntl.LOCK_NB) 2020-04-22T14:18:19.152 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:18:19.152 INFO:teuthology.orchestra.run.smithi103:> print("blacklist") 2020-04-22T14:18:19.152 INFO:teuthology.orchestra.run.smithi103:> sys.stdout.flush() 2020-04-22T14:18:19.152 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:18:19.152 INFO:teuthology.orchestra.run.smithi103:> sys.stdin.readline() 2020-04-22T14:18:19.152 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:18:19.153 INFO:teuthology.orchestra.run.smithi103:> # wait for mds to close session 2020-04-22T14:18:19.153 INFO:teuthology.orchestra.run.smithi103:> time.sleep(10); 2020-04-22T14:18:19.153 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:18:19.153 INFO:teuthology.orchestra.run.smithi103:> # trigger '"'"'open session'"'"' message. kclient relies on '"'"'session reject'"'"' message 2020-04-22T14:18:19.153 INFO:teuthology.orchestra.run.smithi103:> # to detect if itself is blacklisted 2020-04-22T14:18:19.153 INFO:teuthology.orchestra.run.smithi103:> try: 2020-04-22T14:18:19.153 INFO:teuthology.orchestra.run.smithi103:> os.stat("/home/ubuntu/cephtest/mnt.0/testfile_reconnect_after_blacklisted.1") 2020-04-22T14:18:19.153 INFO:teuthology.orchestra.run.smithi103:> except: 2020-04-22T14:18:19.154 INFO:teuthology.orchestra.run.smithi103:> pass 2020-04-22T14:18:19.154 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:18:19.154 INFO:teuthology.orchestra.run.smithi103:> # wait for auto reconnect 2020-04-22T14:18:19.154 INFO:teuthology.orchestra.run.smithi103:> time.sleep(10); 2020-04-22T14:18:19.154 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:18:19.154 INFO:teuthology.orchestra.run.smithi103:> try: 2020-04-22T14:18:19.154 INFO:teuthology.orchestra.run.smithi103:> os.write(fd1, b'"'"'content'"'"') 2020-04-22T14:18:19.154 INFO:teuthology.orchestra.run.smithi103:> except OSError as e: 2020-04-22T14:18:19.155 INFO:teuthology.orchestra.run.smithi103:> if e.errno != errno.EBADF: 2020-04-22T14:18:19.155 INFO:teuthology.orchestra.run.smithi103:> raise 2020-04-22T14:18:19.155 INFO:teuthology.orchestra.run.smithi103:> else: 2020-04-22T14:18:19.155 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("write() failed to raise error") 2020-04-22T14:18:19.155 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:18:19.155 INFO:teuthology.orchestra.run.smithi103:> os.read(fd2, 1); 2020-04-22T14:18:19.155 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:18:19.155 INFO:teuthology.orchestra.run.smithi103:> try: 2020-04-22T14:18:19.156 INFO:teuthology.orchestra.run.smithi103:> os.read(fd4, 1) 2020-04-22T14:18:19.156 INFO:teuthology.orchestra.run.smithi103:> except OSError as e: 2020-04-22T14:18:19.156 INFO:teuthology.orchestra.run.smithi103:> if e.errno != errno.EIO: 2020-04-22T14:18:19.156 INFO:teuthology.orchestra.run.smithi103:> raise 2020-04-22T14:18:19.156 INFO:teuthology.orchestra.run.smithi103:> else: 2020-04-22T14:18:19.156 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("read() failed to raise error") 2020-04-22T14:18:19.156 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:18:24.807 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:18:24.825 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:18:24.867 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:24.885 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:18:54.992 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:18:55.015 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:18:55.061 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:18:55.081 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:19:07.810 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:07.828 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:19:07.835 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:19:07.836 INFO:teuthology.orchestra.run.smithi103:> import glob 2020-04-22T14:19:07.836 INFO:teuthology.orchestra.run.smithi103:> import re 2020-04-22T14:19:07.836 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:19:07.836 INFO:teuthology.orchestra.run.smithi103:> import subprocess 2020-04-22T14:19:07.836 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:19:07.836 INFO:teuthology.orchestra.run.smithi103:> def find_socket(client_name): 2020-04-22T14:19:07.836 INFO:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-04-22T14:19:07.836 INFO:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2020-04-22T14:19:07.836 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:19:07.837 INFO:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2020-04-22T14:19:07.837 INFO:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2020-04-22T14:19:07.837 INFO:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2020-04-22T14:19:07.837 INFO:teuthology.orchestra.run.smithi103:> return files[0] 2020-04-22T14:19:07.837 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:19:07.837 INFO:teuthology.orchestra.run.smithi103:> for f in files: 2020-04-22T14:19:07.837 INFO:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:19:07.837 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:19:07.838 INFO:teuthology.orchestra.run.smithi103:> return f 2020-04-22T14:19:07.838 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:19:07.838 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:19:07.838 INFO:teuthology.orchestra.run.smithi103:> print(find_socket("client.0")) 2020-04-22T14:19:07.838 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:19:07.947 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.0.118109.asok 2020-04-22T14:19:07.947 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.118109.asok 2020-04-22T14:19:07.948 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:07.962 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:19:07.962 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.118109.asok mds_sessions 2020-04-22T14:19:08.122 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:19:08.122 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 9604, 2020-04-22T14:19:08.122 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2020-04-22T14:19:08.122 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:19:08.122 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:19:08.123 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 9604 2020-04-22T14:19:08.123 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:08.123 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:19:08.123 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:19:08.123 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:19:08.123 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1609098406 2020-04-22T14:19:08.123 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:08.124 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:08.124 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.9604 v1:192.168.0.1:0/1609098406", 2020-04-22T14:19:08.131 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "v1:192.168.0.1:0/1609098406", 2020-04-22T14:19:08.132 INFO:teuthology.orchestra.run.smithi103.stdout: "sessions": [ 2020-04-22T14:19:08.132 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:08.132 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": 0, 2020-04-22T14:19:08.132 INFO:teuthology.orchestra.run.smithi103.stdout: "addrs": { 2020-04-22T14:19:08.132 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:19:08.132 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:08.132 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:19:08.133 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6832", 2020-04-22T14:19:08.133 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33849566 2020-04-22T14:19:08.133 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:08.133 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:08.133 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:19:08.133 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6833", 2020-04-22T14:19:08.133 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33849566 2020-04-22T14:19:08.134 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:08.134 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:08.134 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:08.134 INFO:teuthology.orchestra.run.smithi103.stdout: "seq": 0, 2020-04-22T14:19:08.134 INFO:teuthology.orchestra.run.smithi103.stdout: "cap_gen": 0, 2020-04-22T14:19:08.134 INFO:teuthology.orchestra.run.smithi103.stdout: "cap_ttl": "2020-04-22T14:19:59.473828+0000", 2020-04-22T14:19:08.134 INFO:teuthology.orchestra.run.smithi103.stdout: "last_cap_renew_request": "2020-04-22T14:18:59.473828+0000", 2020-04-22T14:19:08.135 INFO:teuthology.orchestra.run.smithi103.stdout: "cap_renew_seq": 4, 2020-04-22T14:19:08.138 INFO:teuthology.orchestra.run.smithi103.stdout: "num_caps": 3, 2020-04-22T14:19:08.138 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "open" 2020-04-22T14:19:08.138 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:08.139 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:19:08.139 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 101 2020-04-22T14:19:08.139 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:19:08.140 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:08.155 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:19:08.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.298+0000 7fdc73715700 1 Processor -- start 2020-04-22T14:19:08.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.298+0000 7fdc73715700 1 -- start start 2020-04-22T14:19:08.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.299+0000 7fdc73715700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdc6c0665a0 0x7fdc6c14a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:08.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.299+0000 7fdc73715700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdc6c0b4ec0 0x7fdc6c0b5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:08.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.299+0000 7fdc73715700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc6c0651f0 con 0x7fdc6c05b7c0 2020-04-22T14:19:08.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.299+0000 7fdc73715700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc6c066b90 con 0x7fdc6c0b4ec0 2020-04-22T14:19:08.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.299+0000 7fdc73715700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc6c066e30 con 0x7fdc6c0665a0 2020-04-22T14:19:08.315 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.299+0000 7fdc70cb0700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdc6c0665a0 0x7fdc6c14a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:08.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.299+0000 7fdc714b1700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fdc6c05b7c0 0x7fdc6c1336b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50156/0 (socket says 172.21.15.103:50156) 2020-04-22T14:19:08.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.299+0000 7fdc714b1700 1 -- 172.21.15.103:0/697232694 learned_addr learned my addr 172.21.15.103:0/697232694 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:08.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.299+0000 7fdc71cb2700 1 --2- 172.21.15.103:0/697232694 >> v2:172.21.15.86:3300/0 conn(0x7fdc6c0b4ec0 0x7fdc6c0b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:08.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.299+0000 7fdc70cb0700 1 -- 172.21.15.103:0/697232694 >> v2:172.21.15.86:3300/0 conn(0x7fdc6c0b4ec0 msgr2=0x7fdc6c0b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:08.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.299+0000 7fdc70cb0700 1 --2- 172.21.15.103:0/697232694 >> v2:172.21.15.86:3300/0 conn(0x7fdc6c0b4ec0 0x7fdc6c0b5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:08.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.299+0000 7fdc70cb0700 1 -- 172.21.15.103:0/697232694 >> v1:172.21.15.103:6789/0 conn(0x7fdc6c05b7c0 legacy=0x7fdc6c1336b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:08.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.299+0000 7fdc57fff700 1 -- 172.21.15.103:0/697232694 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1181268871 0 0) 0x7fdc6c0651f0 con 0x7fdc6c05b7c0 2020-04-22T14:19:08.316 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.299+0000 7fdc70cb0700 1 -- 172.21.15.103:0/697232694 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6c0670d0 con 0x7fdc6c0665a0 2020-04-22T14:19:08.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.299+0000 7fdc70cb0700 1 --2- 172.21.15.103:0/697232694 >> v2:172.21.15.103:3300/0 conn(0x7fdc6c0665a0 0x7fdc6c14a640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdc60002f30 tx=0x7fdc60007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:08.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.300+0000 7fdc70cb0700 1 --2- 172.21.15.103:0/697232694 >> v2:172.21.15.103:3300/0 conn(0x7fdc6c0665a0 0x7fdc6c14a640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdc60002f30 tx=0x7fdc60007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:08.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.300+0000 7fdc70cb0700 1 --2- 172.21.15.103:0/697232694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc6c0665a0 0x7fdc6c14a640 secure :-1 s=READY pgs=1981 cs=0 l=1 rx=0x7fdc60002f30 tx=0x7fdc60007a40).ready entity=mon.1 client_cookie=2f587288722da8d2 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:08.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.300+0000 7fdc70cb0700 1 --2- 172.21.15.103:0/697232694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc6c0665a0 0x7fdc6c14a640 secure :-1 s=THROTTLE_DONE pgs=1981 cs=0 l=1 rx=0x7fdc60002f30 tx=0x7fdc60007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:08.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.300+0000 7fdc57fff700 1 -- 172.21.15.103:0/697232694 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc60011470 con 0x7fdc6c0665a0 2020-04-22T14:19:08.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.300+0000 7fdc70cb0700 1 --2- 172.21.15.103:0/697232694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc6c0665a0 0x7fdc6c14a640 secure :-1 s=THROTTLE_DONE pgs=1981 cs=0 l=1 rx=0x7fdc60002f30 tx=0x7fdc60007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:08.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.300+0000 7fdc70cb0700 1 --2- 172.21.15.103:0/697232694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc6c0665a0 0x7fdc6c14a640 secure :-1 s=THROTTLE_DONE pgs=1981 cs=0 l=1 rx=0x7fdc60002f30 tx=0x7fdc60007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:08.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.300+0000 7fdc57fff700 1 -- 172.21.15.103:0/697232694 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc600115d0 con 0x7fdc6c0665a0 2020-04-22T14:19:08.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.300+0000 7fdc57fff700 1 -- 172.21.15.103:0/697232694 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc600119b0 con 0x7fdc6c0665a0 2020-04-22T14:19:08.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.300+0000 7fdc73715700 1 -- 172.21.15.103:0/697232694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc6c0665a0 msgr2=0x7fdc6c14a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:08.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.300+0000 7fdc73715700 1 --2- 172.21.15.103:0/697232694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc6c0665a0 0x7fdc6c14a640 secure :-1 s=READY pgs=1981 cs=0 l=1 rx=0x7fdc60002f30 tx=0x7fdc60007a40).stop 2020-04-22T14:19:08.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.300+0000 7fdc73715700 1 -- 172.21.15.103:0/697232694 shutdown_connections 2020-04-22T14:19:08.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.300+0000 7fdc73715700 1 --2- 172.21.15.103:0/697232694 >> v2:172.21.15.86:3300/0 conn(0x7fdc6c0b4ec0 0x7fdc6c0b5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:08.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.300+0000 7fdc73715700 1 --2- 172.21.15.103:0/697232694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc6c0665a0 0x7fdc6c14a640 unknown :-1 s=CLOSED pgs=1981 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:08.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.300+0000 7fdc73715700 1 -- 172.21.15.103:0/697232694 >> 172.21.15.103:0/697232694 conn(0x7fdc6c0b9160 msgr2=0x7fdc6c05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:08.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.300+0000 7fdc73715700 1 -- 172.21.15.103:0/697232694 shutdown_connections 2020-04-22T14:19:08.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.300+0000 7fdc73715700 1 -- 172.21.15.103:0/697232694 wait complete. 2020-04-22T14:19:08.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.301+0000 7fdc73715700 1 Processor -- start 2020-04-22T14:19:08.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.301+0000 7fdc73715700 1 -- start start 2020-04-22T14:19:08.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.302+0000 7fdc73715700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdc6c0665a0 0x7fdc6c0af390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:08.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.302+0000 7fdc73715700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdc6c0b4ec0 0x7fdc6c0ae350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:08.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.302+0000 7fdc73715700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc6c0af7f0 con 0x7fdc6c05b7c0 2020-04-22T14:19:08.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.302+0000 7fdc73715700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc6c0b14b0 con 0x7fdc6c0b4ec0 2020-04-22T14:19:08.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.302+0000 7fdc73715700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc6c0b1690 con 0x7fdc6c0665a0 2020-04-22T14:19:08.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.302+0000 7fdc70cb0700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdc6c0665a0 0x7fdc6c0af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:08.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.302+0000 7fdc714b1700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fdc6c05b7c0 0x7fdc6c0b0d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50162/0 (socket says 172.21.15.103:50162) 2020-04-22T14:19:08.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.302+0000 7fdc714b1700 1 -- 172.21.15.103:0/1801154220 learned_addr learned my addr 172.21.15.103:0/1801154220 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:08.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.302+0000 7fdc71cb2700 1 --2- 172.21.15.103:0/1801154220 >> v2:172.21.15.86:3300/0 conn(0x7fdc6c0b4ec0 0x7fdc6c0ae350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:08.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.302+0000 7fdc70cb0700 1 -- 172.21.15.103:0/1801154220 >> v2:172.21.15.86:3300/0 conn(0x7fdc6c0b4ec0 msgr2=0x7fdc6c0ae350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:08.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.302+0000 7fdc70cb0700 1 --2- 172.21.15.103:0/1801154220 >> v2:172.21.15.86:3300/0 conn(0x7fdc6c0b4ec0 0x7fdc6c0ae350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:08.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.302+0000 7fdc70cb0700 1 -- 172.21.15.103:0/1801154220 >> v1:172.21.15.103:6789/0 conn(0x7fdc6c05b7c0 legacy=0x7fdc6c0b0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:08.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.302+0000 7fdc5effd700 1 -- 172.21.15.103:0/1801154220 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4070588717 0 0) 0x7fdc64001370 con 0x7fdc6c05b7c0 2020-04-22T14:19:08.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.302+0000 7fdc70cb0700 1 -- 172.21.15.103:0/1801154220 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6c0b1930 con 0x7fdc6c0665a0 2020-04-22T14:19:08.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.302+0000 7fdc71cb2700 1 --2- 172.21.15.103:0/1801154220 >> v2:172.21.15.86:3300/0 conn(0x7fdc6c0b4ec0 0x7fdc6c0ae350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:19:08.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.302+0000 7fdc70cb0700 1 --2- 172.21.15.103:0/1801154220 >> v2:172.21.15.103:3300/0 conn(0x7fdc6c0665a0 0x7fdc6c0af390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdc60002f30 tx=0x7fdc60007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:08.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.303+0000 7fdc70cb0700 1 --2- 172.21.15.103:0/1801154220 >> v2:172.21.15.103:3300/0 conn(0x7fdc6c0665a0 0x7fdc6c0af390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdc60002f30 tx=0x7fdc60007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:08.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.303+0000 7fdc70cb0700 1 --2- 172.21.15.103:0/1801154220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc6c0665a0 0x7fdc6c0af390 secure :-1 s=READY pgs=1983 cs=0 l=1 rx=0x7fdc60002f30 tx=0x7fdc60007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:08.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.303+0000 7fdc70cb0700 1 --2- 172.21.15.103:0/1801154220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc6c0665a0 0x7fdc6c0af390 secure :-1 s=THROTTLE_DONE pgs=1983 cs=0 l=1 rx=0x7fdc60002f30 tx=0x7fdc60007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:08.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.303+0000 7fdc5effd700 1 -- 172.21.15.103:0/1801154220 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc6000f860 con 0x7fdc6c0665a0 2020-04-22T14:19:08.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.303+0000 7fdc70cb0700 1 --2- 172.21.15.103:0/1801154220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc6c0665a0 0x7fdc6c0af390 secure :-1 s=THROTTLE_DONE pgs=1983 cs=0 l=1 rx=0x7fdc60002f30 tx=0x7fdc60007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:08.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.303+0000 7fdc70cb0700 1 --2- 172.21.15.103:0/1801154220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc6c0665a0 0x7fdc6c0af390 secure :-1 s=THROTTLE_DONE pgs=1983 cs=0 l=1 rx=0x7fdc60002f30 tx=0x7fdc60007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:08.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.303+0000 7fdc5effd700 1 -- 172.21.15.103:0/1801154220 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc60007360 con 0x7fdc6c0665a0 2020-04-22T14:19:08.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.303+0000 7fdc73715700 1 -- 172.21.15.103:0/1801154220 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc6c0b1bd0 con 0x7fdc6c0665a0 2020-04-22T14:19:08.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.303+0000 7fdc5effd700 1 -- 172.21.15.103:0/1801154220 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc60007590 con 0x7fdc6c0665a0 2020-04-22T14:19:08.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.303+0000 7fdc73715700 1 -- 172.21.15.103:0/1801154220 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc6c0ae7b0 con 0x7fdc6c0665a0 2020-04-22T14:19:08.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.303+0000 7fdc70cb0700 1 --2- 172.21.15.103:0/1801154220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc6c0665a0 0x7fdc6c0af390 secure :-1 s=THROTTLE_DONE pgs=1983 cs=0 l=1 rx=0x7fdc60002f30 tx=0x7fdc60007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:08.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.304+0000 7fdc73715700 1 -- 172.21.15.103:0/1801154220 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc6c056c90 con 0x7fdc6c0665a0 2020-04-22T14:19:08.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.304+0000 7fdc5effd700 1 -- 172.21.15.103:0/1801154220 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fdc600058b0 con 0x7fdc6c0665a0 2020-04-22T14:19:08.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.304+0000 7fdc70cb0700 1 --2- 172.21.15.103:0/1801154220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc6c0665a0 0x7fdc6c0af390 secure :-1 s=THROTTLE_DONE pgs=1983 cs=0 l=1 rx=0x7fdc60002f30 tx=0x7fdc60007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:08.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.304+0000 7fdc5effd700 1 --2- 172.21.15.103:0/1801154220 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdc4804d880 0x7fdc4804fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:08.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.304+0000 7fdc5effd700 1 -- 172.21.15.103:0/1801154220 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdc60061d20 con 0x7fdc6c0665a0 2020-04-22T14:19:08.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.304+0000 7fdc714b1700 1 --2- 172.21.15.103:0/1801154220 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdc4804d880 0x7fdc4804fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:08.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.305+0000 7fdc714b1700 1 --2- 172.21.15.103:0/1801154220 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdc4804d880 0x7fdc4804fd40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdc64005880 tx=0x7fdc64001bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:08.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.305+0000 7fdc714b1700 1 --2- 172.21.15.103:0/1801154220 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdc4804d880 0x7fdc4804fd40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdc64005880 tx=0x7fdc64001bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:08.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.305+0000 7fdc714b1700 1 --2- 172.21.15.103:0/1801154220 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdc4804d880 0x7fdc4804fd40 secure :-1 s=READY pgs=720 cs=0 l=1 rx=0x7fdc64005880 tx=0x7fdc64001bf0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:08.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.308+0000 7fdc70cb0700 1 --2- 172.21.15.103:0/1801154220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc6c0665a0 0x7fdc6c0af390 secure :-1 s=THROTTLE_DONE pgs=1983 cs=0 l=1 rx=0x7fdc60002f30 tx=0x7fdc60007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:08.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.308+0000 7fdc5effd700 1 -- 172.21.15.103:0/1801154220 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fdc6003d1c0 con 0x7fdc6c0665a0 2020-04-22T14:19:08.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.498+0000 7fdc73715700 1 -- 172.21.15.103:0/1801154220 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc6c05a640 con 0x7fdc6c0665a0 2020-04-22T14:19:08.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.499+0000 7fdc70cb0700 1 --2- 172.21.15.103:0/1801154220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc6c0665a0 0x7fdc6c0af390 secure :-1 s=THROTTLE_DONE pgs=1983 cs=0 l=1 rx=0x7fdc60002f30 tx=0x7fdc60007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:08.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.499+0000 7fdc5effd700 1 -- 172.21.15.103:0/1801154220 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+2141 (secure 0 0 0) 0x7fdc600407e0 con 0x7fdc6c0665a0 2020-04-22T14:19:08.502 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:19:08.503 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":101,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6539,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1045362246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1045362246},{"type":"v1","addr":"172.21.15.86:6835","nonce":1045362246}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":97}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:17:48.006467+0000","modified":"2020-04-22T14:17:50.019789+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9277":{"gid":9277,"name":"a","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/33849566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":33849566},{"type":"v1","addr":"172.21.15.103:6833","nonce":33849566}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2020-04-22T14:19:08.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.500+0000 7fdc73715700 1 -- 172.21.15.103:0/1801154220 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdc4804d880 msgr2=0x7fdc4804fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:08.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.500+0000 7fdc73715700 1 --2- 172.21.15.103:0/1801154220 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdc4804d880 0x7fdc4804fd40 secure :-1 s=READY pgs=720 cs=0 l=1 rx=0x7fdc64005880 tx=0x7fdc64001bf0).stop 2020-04-22T14:19:08.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.500+0000 7fdc73715700 1 -- 172.21.15.103:0/1801154220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc6c0665a0 msgr2=0x7fdc6c0af390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:08.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.500+0000 7fdc73715700 1 --2- 172.21.15.103:0/1801154220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc6c0665a0 0x7fdc6c0af390 secure :-1 s=READY pgs=1983 cs=0 l=1 rx=0x7fdc60002f30 tx=0x7fdc60007a40).stop 2020-04-22T14:19:08.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.500+0000 7fdc73715700 1 -- 172.21.15.103:0/1801154220 shutdown_connections 2020-04-22T14:19:08.504 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.500+0000 7fdc73715700 1 --2- 172.21.15.103:0/1801154220 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdc4804d880 0x7fdc4804fd40 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:08.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.500+0000 7fdc73715700 1 --2- 172.21.15.103:0/1801154220 >> v2:172.21.15.86:3300/0 conn(0x7fdc6c0b4ec0 0x7fdc6c0ae350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:08.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.500+0000 7fdc73715700 1 --2- 172.21.15.103:0/1801154220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc6c0665a0 0x7fdc6c0af390 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:08.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.500+0000 7fdc73715700 1 -- 172.21.15.103:0/1801154220 >> 172.21.15.103:0/1801154220 conn(0x7fdc6c0b9160 msgr2=0x7fdc6c132770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:08.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.500+0000 7fdc73715700 1 -- 172.21.15.103:0/1801154220 shutdown_connections 2020-04-22T14:19:08.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:08.500+0000 7fdc73715700 1 -- 172.21.15.103:0/1801154220 wait complete. 2020-04-22T14:19:08.505 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 101 2020-04-22T14:19:08.513 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:08.526 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok session evict 9604 2020-04-22T14:19:09.604 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:2020-04-22T14:19:09.601+0000 7f71a37fe700 -1 client.9604 I was blacklisted at osd epoch 136 2020-04-22T14:19:09.604 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:2020-04-22T14:19:09.601+0000 7f71a37fe700 -1 client.9604 remove_session_caps still has dirty|flushing caps on 0x10000000000.head(faked_ino=0 ref=8 ll_ref=2 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={1=1,3=1} mode=100644 size=7/4194304 nlink=1 btime=2020-04-22T14:18:19.231678+0000 mtime=2020-04-22T14:19:07.807438+0000 ctime=2020-04-22T14:19:07.807438+0000 caps=- dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 7] parents=0x1.head["testfile_reconnect_after_blacklisted.1"] 0x7f718c0069f0) 2020-04-22T14:19:09.605 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:2020-04-22T14:19:09.601+0000 7f71a37fe700 -1 client.9604 remove_session_caps still has dirty data on 0x10000000000.head(faked_ino=0 ref=7 ll_ref=2 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={1=1,3=1} mode=100644 size=7/4194304 nlink=1 btime=2020-04-22T14:18:19.231678+0000 mtime=2020-04-22T14:19:07.807438+0000 ctime=2020-04-22T14:19:07.807438+0000 caps=- objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 7] parents=0x1.head["testfile_reconnect_after_blacklisted.1"] 0x7f718c0069f0) 2020-04-22T14:19:09.605 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:2020-04-22T14:19:09.601+0000 7f71a37fe700 -1 client.9604 remove_session_caps still has dirty|flushing caps on 0x10000000001.head(faked_ino=0 ref=8 ll_ref=2 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={1=1,3=1} mode=100644 size=7/4194304 nlink=1 btime=2020-04-22T14:19:07.803630+0000 mtime=2020-04-22T14:19:07.807648+0000 ctime=2020-04-22T14:19:07.807648+0000 caps=- dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 7] parents=0x1.head["testfile_reconnect_after_blacklisted.2"] 0x7f718c009480) 2020-04-22T14:19:09.605 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:2020-04-22T14:19:09.601+0000 7f71a37fe700 -1 client.9604 remove_session_caps still has dirty data on 0x10000000001.head(faked_ino=0 ref=7 ll_ref=2 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={1=1,3=1} mode=100644 size=7/4194304 nlink=1 btime=2020-04-22T14:19:07.803630+0000 mtime=2020-04-22T14:19:07.807648+0000 ctime=2020-04-22T14:19:07.807648+0000 caps=- objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 7] parents=0x1.head["testfile_reconnect_after_blacklisted.2"] 0x7f718c009480) 2020-04-22T14:19:09.617 INFO:tasks.cephfs.filesystem:_json_asok output: 2020-04-22T14:19:25.198 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:19:25.217 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:19:25.260 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:25.277 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:19:29.643 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-04-22T14:19:29.643 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:19:29.660 INFO:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:19:29.751 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:29.767 INFO:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:19:29.865 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-04-22T14:19:29.865 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2020-04-22T14:19:29.865 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:29.880 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-04-22T14:19:29.880 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:19:29.959 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[118109]: fuse finished with error 0 and tester_r 0 2020-04-22T14:19:30.098 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:19:30.098 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:19:30.099 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:30.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:30.155 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:19:30.230 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:30.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:30.285 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down brx.1' 2020-04-22T14:19:30.442 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.1' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/55) 2020-04-22T14:19:30.443 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:30.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:30.467 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete brx.1' 2020-04-22T14:19:30.576 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.1' (49d72504-2a08-4d95-8411-f715cdb06558) successfully deleted. 2020-04-22T14:19:30.577 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:30.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:30.604 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:19:30.711 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:30.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:30.736 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:19:30.791 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:19:30.792 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:19:30.792 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:19:30.792 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:19:30.792 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:19:30.792 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:19:30.792 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:19:30.792 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:19:30.793 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:19:30.793 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:19:30.793 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:19:30.793 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:19:30.793 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:19:30.793 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:19:30.793 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:19:30.793 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 41669sec preferred_lft 41669sec 2020-04-22T14:19:30.794 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:19:30.794 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:19:30.794 INFO:teuthology.orchestra.run.smithi103.stdout:42: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:19:30.794 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether ce:62:6d:2c:c1:6d brd ff:ff:ff:ff:ff:ff 2020-04-22T14:19:30.794 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:19:30.794 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:19:30.794 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::53b7:f2ed:76:1ad6/64 scope link noprefixroute 2020-04-22T14:19:30.795 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:19:30.795 INFO:teuthology.orchestra.run.smithi103.stdout:44: brx.4@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-04-22T14:19:30.795 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether ce:62:6d:2c:c1:6d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2020-04-22T14:19:30.795 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:30.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:30.843 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:19:30.920 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:30.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:30.970 INFO:teuthology.orchestra.run.smithi103:> nmcli connection show 2020-04-22T14:19:31.057 INFO:teuthology.orchestra.run.smithi103.stdout:NAME UUID TYPE DEVICE 2020-04-22T14:19:31.058 INFO:teuthology.orchestra.run.smithi103.stdout:System enp3s0f1 b0a308d1-bd90-60af-eb7c-0183bb425a1a ethernet enp3s0f1 2020-04-22T14:19:31.058 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-brx 4e449cd8-fab2-459e-9b05-3d27ccd38110 bridge ceph-brx 2020-04-22T14:19:31.058 INFO:teuthology.orchestra.run.smithi103.stdout:brx.4 bd85cdab-6e66-4759-ae5b-cd65c59bfba2 ethernet brx.4 2020-04-22T14:19:31.058 INFO:teuthology.orchestra.run.smithi103.stdout:eno1 206ad60d-195e-4d4b-a9fe-a5dd1f33a67d ethernet -- 2020-04-22T14:19:31.058 INFO:teuthology.orchestra.run.smithi103.stdout:eno2 894a7dd2-d329-4985-9ef9-84a92c6e1c6c ethernet -- 2020-04-22T14:19:31.058 INFO:teuthology.orchestra.run.smithi103.stdout:enp3s0f0 5a3237ce-06ab-4ae0-818b-45bdf036cb08 ethernet -- 2020-04-22T14:19:31.059 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:31.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:31.105 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:19:31.160 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2020-04-22T14:19:31.161 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:31.214 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-04-22T14:19:31.214 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:19:31.289 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[116512]: fuse finished with error 0 and tester_r 0 2020-04-22T14:19:31.406 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-04-22T14:19:31.406 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:19:31.406 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:31.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:31.460 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:19:31.537 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:31.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:31.590 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down brx.4' 2020-04-22T14:19:31.759 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.4' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/54) 2020-04-22T14:19:31.759 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:31.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:31.774 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete brx.4' 2020-04-22T14:19:31.888 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.4' (bd85cdab-6e66-4759-ae5b-cd65c59bfba2) successfully deleted. 2020-04-22T14:19:31.888 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:31.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:31.913 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:19:32.025 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:32.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:32.044 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:19:32.103 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:19:32.103 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:19:32.103 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:19:32.104 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:19:32.104 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:19:32.104 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:19:32.104 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:19:32.104 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:19:32.104 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:19:32.105 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:19:32.105 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:19:32.105 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:19:32.105 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:19:32.105 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:19:32.105 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:19:32.105 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 41668sec preferred_lft 41668sec 2020-04-22T14:19:32.106 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:19:32.106 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:19:32.106 INFO:teuthology.orchestra.run.smithi103.stdout:42: ceph-brx: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:19:32.106 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:19:32.106 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:19:32.106 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:19:32.106 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::53b7:f2ed:76:1ad6/64 scope link noprefixroute 2020-04-22T14:19:32.106 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:19:32.107 INFO:teuthology.orchestra.run.smithi103.stdout:44: brx.4@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:19:32.107 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether ce:62:6d:2c:c1:6d brd ff:ff:ff:ff:ff:ff link-netnsid 4 2020-04-22T14:19:32.107 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:32.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:32.154 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:19:32.235 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:32.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:32.284 INFO:teuthology.orchestra.run.smithi103:> nmcli connection show 2020-04-22T14:19:32.359 INFO:teuthology.orchestra.run.smithi103.stdout:NAME UUID TYPE DEVICE 2020-04-22T14:19:32.359 INFO:teuthology.orchestra.run.smithi103.stdout:System enp3s0f1 b0a308d1-bd90-60af-eb7c-0183bb425a1a ethernet enp3s0f1 2020-04-22T14:19:32.360 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-brx 4e449cd8-fab2-459e-9b05-3d27ccd38110 bridge ceph-brx 2020-04-22T14:19:32.360 INFO:teuthology.orchestra.run.smithi103.stdout:eno1 206ad60d-195e-4d4b-a9fe-a5dd1f33a67d ethernet -- 2020-04-22T14:19:32.360 INFO:teuthology.orchestra.run.smithi103.stdout:eno2 894a7dd2-d329-4985-9ef9-84a92c6e1c6c ethernet -- 2020-04-22T14:19:32.360 INFO:teuthology.orchestra.run.smithi103.stdout:enp3s0f0 5a3237ce-06ab-4ae0-818b-45bdf036cb08 ethernet -- 2020-04-22T14:19:32.360 INFO:tasks.cephfs.mount:Removing the 'ceph-brx' 2020-04-22T14:19:32.360 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:32.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:32.406 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down ceph-brx' 2020-04-22T14:19:32.564 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/52) 2020-04-22T14:19:32.564 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:32.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:32.579 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete ceph-brx' 2020-04-22T14:19:32.691 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' (4e449cd8-fab2-459e-9b05-3d27ccd38110) successfully deleted. 2020-04-22T14:19:32.691 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:32.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:32.716 INFO:teuthology.orchestra.run.smithi103:> route 2020-04-22T14:19:32.781 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2020-04-22T14:19:32.781 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-04-22T14:19:32.781 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 102 0 0 enp3s0f1 2020-04-22T14:19:32.781 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 102 0 0 enp3s0f1 2020-04-22T14:19:32.782 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:32.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:32.827 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -D FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-04-22T14:19:32.903 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:32.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:32.954 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -D FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-04-22T14:19:33.033 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:33.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:33.085 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -t nat -D POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-04-22T14:19:33.193 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:33.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:33.229 INFO:teuthology.orchestra.run.smithi103:> cat /tmp/python-ceph-brx 2020-04-22T14:19:33.288 INFO:teuthology.orchestra.run.smithi103.stdout:0 2020-04-22T14:19:33.289 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:33.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:33.341 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 0 > /proc/sys/net/ipv4/ip_forward' 2020-04-22T14:19:33.416 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:33.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:33.463 INFO:teuthology.orchestra.run.smithi103:> rm -f /tmp/python-ceph-brx 2020-04-22T14:19:33.521 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:33.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:33.570 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:19:33.632 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.2' netns for '/home/ubuntu/cephtest/mnt.2' 2020-04-22T14:19:33.633 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:19:33.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:33.651 INFO:teuthology.orchestra.run.smithi086:> ip addr 2020-04-22T14:19:33.711 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:19:33.712 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:19:33.712 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:19:33.712 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:19:33.712 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2020-04-22T14:19:33.712 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:19:33.713 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:19:33.713 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:19:33.713 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:19:33.713 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:19:33.713 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:19:33.713 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:19:33.713 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:19:33.714 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:19:33.714 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:19:33.714 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 41640sec preferred_lft 41640sec 2020-04-22T14:19:33.714 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2020-04-22T14:19:33.714 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:19:33.714 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:19:33.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:33.764 INFO:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.2) 2020-04-22T14:19:33.826 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.3' netns for '/home/ubuntu/cephtest/mnt.3' 2020-04-22T14:19:33.827 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:19:33.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:33.876 INFO:teuthology.orchestra.run.smithi086:> ip addr 2020-04-22T14:19:33.935 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:19:33.936 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:19:33.936 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:19:33.936 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:19:33.936 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2020-04-22T14:19:33.937 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:19:33.937 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:19:33.937 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:19:33.937 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:19:33.938 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:19:33.938 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:19:33.938 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:19:33.938 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:19:33.939 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:19:33.939 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:19:33.939 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 41640sec preferred_lft 41640sec 2020-04-22T14:19:33.939 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2020-04-22T14:19:33.939 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:19:33.940 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:19:33.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:33.988 INFO:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.3) 2020-04-22T14:19:34.050 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:34.066 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_reconnect_after_blacklisted' 2020-04-22T14:19:34.228 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.215+0000 7f923f448700 1 Processor -- start 2020-04-22T14:19:34.228 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.216+0000 7f923f448700 1 -- start start 2020-04-22T14:19:34.228 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.216+0000 7f923f448700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9238065fe0 0x7f92381464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:34.228 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.216+0000 7f923f448700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9238063e30 0x7f92380642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:34.228 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.216+0000 7f923f448700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9238143300 con 0x7f923812c0d0 2020-04-22T14:19:34.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.216+0000 7f923f448700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92381435a0 con 0x7f9238063e30 2020-04-22T14:19:34.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.216+0000 7f923f448700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9238143840 con 0x7f9238065fe0 2020-04-22T14:19:34.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.216+0000 7f923c9e3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9238065fe0 0x7f92381464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:34.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.216+0000 7f923d1e4700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f923812c0d0 0x7f923805b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50186/0 (socket says 172.21.15.103:50186) 2020-04-22T14:19:34.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.217+0000 7f923c9e3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9238065fe0 0x7f92381464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57994/0 (socket says 172.21.15.103:57994) 2020-04-22T14:19:34.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.217+0000 7f923d1e4700 1 -- 172.21.15.103:0/1209380883 learned_addr learned my addr 172.21.15.103:0/1209380883 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:34.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.217+0000 7f923d9e5700 1 --2- 172.21.15.103:0/1209380883 >> v2:172.21.15.86:3300/0 conn(0x7f9238063e30 0x7f92380642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:34.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.217+0000 7f923c9e3700 1 -- 172.21.15.103:0/1209380883 >> v2:172.21.15.86:3300/0 conn(0x7f9238063e30 msgr2=0x7f92380642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:34.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.217+0000 7f923c9e3700 1 --2- 172.21.15.103:0/1209380883 >> v2:172.21.15.86:3300/0 conn(0x7f9238063e30 0x7f92380642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:34.231 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.217+0000 7f923c9e3700 1 -- 172.21.15.103:0/1209380883 >> v1:172.21.15.103:6789/0 conn(0x7f923812c0d0 legacy=0x7f923805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:34.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.217+0000 7f923c9e3700 1 -- 172.21.15.103:0/1209380883 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f923805bb50 con 0x7f9238065fe0 2020-04-22T14:19:34.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.217+0000 7f9227fff700 1 -- 172.21.15.103:0/1209380883 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1331857683 0 0) 0x7f9238143300 con 0x7f923812c0d0 2020-04-22T14:19:34.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.217+0000 7f923c9e3700 1 --2- 172.21.15.103:0/1209380883 >> v2:172.21.15.103:3300/0 conn(0x7f9238065fe0 0x7f92381464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9234002f30 tx=0x7f9234007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:34.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.217+0000 7f923c9e3700 1 --2- 172.21.15.103:0/1209380883 >> v2:172.21.15.103:3300/0 conn(0x7f9238065fe0 0x7f92381464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9234002f30 tx=0x7f9234007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:34.238 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.217+0000 7f923c9e3700 1 --2- 172.21.15.103:0/1209380883 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9238065fe0 0x7f92381464e0 secure :-1 s=READY pgs=1986 cs=0 l=1 rx=0x7f9234002f30 tx=0x7f9234007a40).ready entity=mon.1 client_cookie=8a82566fbbea6459 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:34.238 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.217+0000 7f923c9e3700 1 --2- 172.21.15.103:0/1209380883 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9238065fe0 0x7f92381464e0 secure :-1 s=THROTTLE_DONE pgs=1986 cs=0 l=1 rx=0x7f9234002f30 tx=0x7f9234007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:34.238 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.217+0000 7f9227fff700 1 -- 172.21.15.103:0/1209380883 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f923400ae80 con 0x7f9238065fe0 2020-04-22T14:19:34.238 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.217+0000 7f923c9e3700 1 --2- 172.21.15.103:0/1209380883 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9238065fe0 0x7f92381464e0 secure :-1 s=THROTTLE_DONE pgs=1986 cs=0 l=1 rx=0x7f9234002f30 tx=0x7f9234007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:34.238 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.217+0000 7f923c9e3700 1 --2- 172.21.15.103:0/1209380883 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9238065fe0 0x7f92381464e0 secure :-1 s=THROTTLE_DONE pgs=1986 cs=0 l=1 rx=0x7f9234002f30 tx=0x7f9234007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:34.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.217+0000 7f9227fff700 1 -- 172.21.15.103:0/1209380883 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9234013a60 con 0x7f9238065fe0 2020-04-22T14:19:34.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.217+0000 7f9227fff700 1 -- 172.21.15.103:0/1209380883 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9234013e40 con 0x7f9238065fe0 2020-04-22T14:19:34.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.217+0000 7f923f448700 1 -- 172.21.15.103:0/1209380883 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9238065fe0 msgr2=0x7f92381464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:34.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.217+0000 7f923f448700 1 --2- 172.21.15.103:0/1209380883 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9238065fe0 0x7f92381464e0 secure :-1 s=READY pgs=1986 cs=0 l=1 rx=0x7f9234002f30 tx=0x7f9234007a40).stop 2020-04-22T14:19:34.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.218+0000 7f923f448700 1 -- 172.21.15.103:0/1209380883 shutdown_connections 2020-04-22T14:19:34.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.218+0000 7f923f448700 1 --2- 172.21.15.103:0/1209380883 >> v2:172.21.15.86:3300/0 conn(0x7f9238063e30 0x7f92380642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:34.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.218+0000 7f923f448700 1 --2- 172.21.15.103:0/1209380883 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9238065fe0 0x7f92381464e0 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:34.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.218+0000 7f923f448700 1 -- 172.21.15.103:0/1209380883 >> 172.21.15.103:0/1209380883 conn(0x7f92380b9160 msgr2=0x7f923805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:34.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.218+0000 7f923f448700 1 -- 172.21.15.103:0/1209380883 shutdown_connections 2020-04-22T14:19:34.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.218+0000 7f923f448700 1 -- 172.21.15.103:0/1209380883 wait complete. 2020-04-22T14:19:34.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.219+0000 7f923f448700 1 Processor -- start 2020-04-22T14:19:34.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.219+0000 7f923f448700 1 -- start start 2020-04-22T14:19:34.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.219+0000 7f923f448700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9238063e30 0x7f92380b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:34.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.220+0000 7f923f448700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f923805b240 con 0x7f9238065fe0 2020-04-22T14:19:34.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.220+0000 7f923f448700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f923805b4e0 con 0x7f923812c0d0 2020-04-22T14:19:34.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.220+0000 7f923f448700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9238153b10 con 0x7f9238063e30 2020-04-22T14:19:34.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.220+0000 7f923d1e4700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9238063e30 0x7f92380b0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:34.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.220+0000 7f923d9e5700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f923812c0d0 0x7f9238145560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50190/0 (socket says 172.21.15.103:50190) 2020-04-22T14:19:34.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.220+0000 7f923d9e5700 1 -- 172.21.15.103:0/905484229 learned_addr learned my addr 172.21.15.103:0/905484229 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:34.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.220+0000 7f923d1e4700 1 -- 172.21.15.103:0/905484229 >> v1:172.21.15.103:6789/0 conn(0x7f923812c0d0 legacy=0x7f9238145560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:34.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.220+0000 7f923d1e4700 1 -- 172.21.15.103:0/905484229 >> v1:172.21.15.86:6789/0 conn(0x7f9238065fe0 legacy=0x7f92381570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:34.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.220+0000 7f92267fc700 1 -- 172.21.15.103:0/905484229 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2892516063 0 0) 0x7f923805b4e0 con 0x7f923812c0d0 2020-04-22T14:19:34.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.220+0000 7f923d1e4700 1 -- 172.21.15.103:0/905484229 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f923805af30 con 0x7f9238063e30 2020-04-22T14:19:34.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.220+0000 7f923d1e4700 1 --2- 172.21.15.103:0/905484229 >> v2:172.21.15.103:3300/0 conn(0x7f9238063e30 0x7f92380b0b50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9228000b80 tx=0x7f92280109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:34.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.220+0000 7f923d1e4700 1 --2- 172.21.15.103:0/905484229 >> v2:172.21.15.103:3300/0 conn(0x7f9238063e30 0x7f92380b0b50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9228000b80 tx=0x7f92280109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:34.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.220+0000 7f923d1e4700 1 --2- 172.21.15.103:0/905484229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9238063e30 0x7f92380b0b50 secure :-1 s=READY pgs=1988 cs=0 l=1 rx=0x7f9228000b80 tx=0x7f92280109b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:34.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.220+0000 7f923d1e4700 1 --2- 172.21.15.103:0/905484229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9238063e30 0x7f92380b0b50 secure :-1 s=THROTTLE_DONE pgs=1988 cs=0 l=1 rx=0x7f9228000b80 tx=0x7f92280109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:34.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.220+0000 7f92267fc700 1 -- 172.21.15.103:0/905484229 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9228005ca0 con 0x7f9238063e30 2020-04-22T14:19:34.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.220+0000 7f923d1e4700 1 --2- 172.21.15.103:0/905484229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9238063e30 0x7f92380b0b50 secure :-1 s=THROTTLE_DONE pgs=1988 cs=0 l=1 rx=0x7f9228000b80 tx=0x7f92280109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:34.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.220+0000 7f923d1e4700 1 --2- 172.21.15.103:0/905484229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9238063e30 0x7f92380b0b50 secure :-1 s=THROTTLE_DONE pgs=1988 cs=0 l=1 rx=0x7f9228000b80 tx=0x7f92280109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:34.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.220+0000 7f92267fc700 1 -- 172.21.15.103:0/905484229 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9228005e00 con 0x7f9238063e30 2020-04-22T14:19:34.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.220+0000 7f923f448700 1 -- 172.21.15.103:0/905484229 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9238143d50 con 0x7f9238063e30 2020-04-22T14:19:34.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.220+0000 7f92267fc700 1 -- 172.21.15.103:0/905484229 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92280062c0 con 0x7f9238063e30 2020-04-22T14:19:34.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.220+0000 7f923f448700 1 -- 172.21.15.103:0/905484229 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9238145e30 con 0x7f9238063e30 2020-04-22T14:19:34.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.221+0000 7f923d1e4700 1 --2- 172.21.15.103:0/905484229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9238063e30 0x7f92380b0b50 secure :-1 s=THROTTLE_DONE pgs=1988 cs=0 l=1 rx=0x7f9228000b80 tx=0x7f92280109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:34.251 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.221+0000 7f92267fc700 1 -- 172.21.15.103:0/905484229 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f92280064f0 con 0x7f9238063e30 2020-04-22T14:19:34.252 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.221+0000 7f923d1e4700 1 --2- 172.21.15.103:0/905484229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9238063e30 0x7f92380b0b50 secure :-1 s=THROTTLE_DONE pgs=1988 cs=0 l=1 rx=0x7f9228000b80 tx=0x7f92280109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:34.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.221+0000 7f923f448700 1 -- 172.21.15.103:0/905484229 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9238056c90 con 0x7f9238063e30 2020-04-22T14:19:34.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.221+0000 7f92267fc700 1 --2- 172.21.15.103:0/905484229 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f921804d860 0x7f921804fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:34.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.222+0000 7f92267fc700 1 -- 172.21.15.103:0/905484229 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f92280090c0 con 0x7f9238063e30 2020-04-22T14:19:34.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.222+0000 7f923c9e3700 1 --2- 172.21.15.103:0/905484229 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f921804d860 0x7f921804fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:34.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.222+0000 7f923c9e3700 1 --2- 172.21.15.103:0/905484229 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f921804d860 0x7f921804fd20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f92381269e0 tx=0x7f9234007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:34.256 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.222+0000 7f923c9e3700 1 --2- 172.21.15.103:0/905484229 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f921804d860 0x7f921804fd20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f92381269e0 tx=0x7f9234007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:34.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.222+0000 7f923c9e3700 1 --2- 172.21.15.103:0/905484229 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f921804d860 0x7f921804fd20 secure :-1 s=READY pgs=721 cs=0 l=1 rx=0x7f92381269e0 tx=0x7f9234007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:34.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.226+0000 7f923d1e4700 1 --2- 172.21.15.103:0/905484229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9238063e30 0x7f92380b0b50 secure :-1 s=THROTTLE_DONE pgs=1988 cs=0 l=1 rx=0x7f9228000b80 tx=0x7f92280109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:34.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.226+0000 7f92267fc700 1 -- 172.21.15.103:0/905484229 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f922803c970 con 0x7f9238063e30 2020-04-22T14:19:34.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.420+0000 7f923f448700 1 -- 172.21.15.103:0/905484229 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_reconnect_after_blacklisted"]} v 0) v1 -- 0x7f923812c610 con 0x7f9238063e30 2020-04-22T14:19:34.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.641+0000 7f923d1e4700 1 --2- 172.21.15.103:0/905484229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9238063e30 0x7f92380b0b50 secure :-1 s=THROTTLE_DONE pgs=1988 cs=0 l=1 rx=0x7f9228000b80 tx=0x7f92280109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:34.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.641+0000 7f92267fc700 1 -- 172.21.15.103:0/905484229 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_reconnect_after_blacklisted"]}]=0 v727) v1 ==== 164+0+0 (secure 0 0 0) 0x7f922803ff90 con 0x7f9238063e30 2020-04-22T14:19:34.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.643+0000 7f923f448700 1 -- 172.21.15.103:0/905484229 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f921804d860 msgr2=0x7f921804fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:34.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.643+0000 7f923f448700 1 --2- 172.21.15.103:0/905484229 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f921804d860 0x7f921804fd20 secure :-1 s=READY pgs=721 cs=0 l=1 rx=0x7f92381269e0 tx=0x7f9234007a40).stop 2020-04-22T14:19:34.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.643+0000 7f923f448700 1 -- 172.21.15.103:0/905484229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9238063e30 msgr2=0x7f92380b0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:34.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.643+0000 7f923f448700 1 --2- 172.21.15.103:0/905484229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9238063e30 0x7f92380b0b50 secure :-1 s=READY pgs=1988 cs=0 l=1 rx=0x7f9228000b80 tx=0x7f92280109b0).stop 2020-04-22T14:19:34.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.643+0000 7f923f448700 1 -- 172.21.15.103:0/905484229 shutdown_connections 2020-04-22T14:19:34.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.643+0000 7f923f448700 1 --2- 172.21.15.103:0/905484229 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f921804d860 0x7f921804fd20 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:34.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.643+0000 7f923f448700 1 --2- 172.21.15.103:0/905484229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9238063e30 0x7f92380b0b50 unknown :-1 s=CLOSED pgs=1988 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:34.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.643+0000 7f923f448700 1 -- 172.21.15.103:0/905484229 >> 172.21.15.103:0/905484229 conn(0x7f92380b9160 msgr2=0x7f92380643e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:34.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.643+0000 7f923f448700 1 -- 172.21.15.103:0/905484229 shutdown_connections 2020-04-22T14:19:34.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.643+0000 7f923f448700 1 -- 172.21.15.103:0/905484229 wait complete. 2020-04-22T14:19:34.656 INFO:tasks.cephfs_test_runner:test_reconnect_after_blacklisted (tasks.cephfs.test_client_recovery.TestClientRecovery) ... ok 2020-04-22T14:19:34.656 INFO:tasks.cephfs_test_runner:Starting test: test_reconnect_eviction (tasks.cephfs.test_client_recovery.TestClientRecovery) 2020-04-22T14:19:34.657 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:34.670 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_reconnect_eviction' 2020-04-22T14:19:34.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.814+0000 7fb94d097700 1 Processor -- start 2020-04-22T14:19:34.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.814+0000 7fb94d097700 1 -- start start 2020-04-22T14:19:34.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.815+0000 7fb94d097700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb94812c0d0 0x7fb9481464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:34.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.815+0000 7fb94d097700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb948063e30 0x7fb9480642a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:34.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.815+0000 7fb94d097700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb948143300 con 0x7fb948065fe0 2020-04-22T14:19:34.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.815+0000 7fb94d097700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9481435a0 con 0x7fb948063e30 2020-04-22T14:19:34.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.815+0000 7fb94d097700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb948143840 con 0x7fb94812c0d0 2020-04-22T14:19:34.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.815+0000 7fb94759e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb948063e30 0x7fb9480642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:34.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.815+0000 7fb94759e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb948063e30 0x7fb9480642a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58006/0 (socket says 172.21.15.103:58006) 2020-04-22T14:19:34.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.815+0000 7fb94759e700 1 -- 172.21.15.103:0/1972724165 learned_addr learned my addr 172.21.15.103:0/1972724165 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:19:34.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.815+0000 7fb946d9d700 1 --2- 172.21.15.103:0/1972724165 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb94812c0d0 0x7fb9481464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:34.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.815+0000 7fb94759e700 1 -- 172.21.15.103:0/1972724165 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb94812c0d0 msgr2=0x7fb9481464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:34.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.815+0000 7fb94759e700 1 --2- 172.21.15.103:0/1972724165 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb94812c0d0 0x7fb9481464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:34.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.815+0000 7fb94759e700 1 -- 172.21.15.103:0/1972724165 >> v1:172.21.15.86:6789/0 conn(0x7fb948065fe0 legacy=0x7fb94805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:34.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.815+0000 7fb94759e700 1 -- 172.21.15.103:0/1972724165 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb94805bb50 con 0x7fb948063e30 2020-04-22T14:19:34.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.815+0000 7fb94759e700 1 --2- 172.21.15.103:0/1972724165 >> v2:172.21.15.103:3300/0 conn(0x7fb948063e30 0x7fb9480642a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb938002f30 tx=0x7fb938007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:34.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.815+0000 7fb94759e700 1 --2- 172.21.15.103:0/1972724165 >> v2:172.21.15.103:3300/0 conn(0x7fb948063e30 0x7fb9480642a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb938002f30 tx=0x7fb938007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:34.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.815+0000 7fb94759e700 1 --2- 172.21.15.103:0/1972724165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb948063e30 0x7fb9480642a0 secure :-1 s=READY pgs=1989 cs=0 l=1 rx=0x7fb938002f30 tx=0x7fb938007a40).ready entity=mon.1 client_cookie=962e2c808a21043c server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:34.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.816+0000 7fb94759e700 1 --2- 172.21.15.103:0/1972724165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb948063e30 0x7fb9480642a0 secure :-1 s=THROTTLE_DONE pgs=1989 cs=0 l=1 rx=0x7fb938002f30 tx=0x7fb938007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:34.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.816+0000 7fb945d9b700 1 -- 172.21.15.103:0/1972724165 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb938011670 con 0x7fb948063e30 2020-04-22T14:19:34.821 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.816+0000 7fb94759e700 1 --2- 172.21.15.103:0/1972724165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb948063e30 0x7fb9480642a0 secure :-1 s=THROTTLE_DONE pgs=1989 cs=0 l=1 rx=0x7fb938002f30 tx=0x7fb938007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:34.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.816+0000 7fb94759e700 1 --2- 172.21.15.103:0/1972724165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb948063e30 0x7fb9480642a0 secure :-1 s=THROTTLE_DONE pgs=1989 cs=0 l=1 rx=0x7fb938002f30 tx=0x7fb938007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:34.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.816+0000 7fb945d9b700 1 -- 172.21.15.103:0/1972724165 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb938011810 con 0x7fb948063e30 2020-04-22T14:19:34.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.816+0000 7fb945d9b700 1 -- 172.21.15.103:0/1972724165 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb938011c30 con 0x7fb948063e30 2020-04-22T14:19:34.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.816+0000 7fb94d097700 1 -- 172.21.15.103:0/1972724165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb948063e30 msgr2=0x7fb9480642a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:34.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.816+0000 7fb94d097700 1 --2- 172.21.15.103:0/1972724165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb948063e30 0x7fb9480642a0 secure :-1 s=READY pgs=1989 cs=0 l=1 rx=0x7fb938002f30 tx=0x7fb938007a40).stop 2020-04-22T14:19:34.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.816+0000 7fb94d097700 1 -- 172.21.15.103:0/1972724165 shutdown_connections 2020-04-22T14:19:34.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.816+0000 7fb94d097700 1 --2- 172.21.15.103:0/1972724165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb948063e30 0x7fb9480642a0 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:34.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.816+0000 7fb94d097700 1 --2- 172.21.15.103:0/1972724165 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb94812c0d0 0x7fb9481464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:34.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.816+0000 7fb94d097700 1 -- 172.21.15.103:0/1972724165 >> 172.21.15.103:0/1972724165 conn(0x7fb9480b9160 msgr2=0x7fb94805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:34.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.816+0000 7fb94d097700 1 -- 172.21.15.103:0/1972724165 shutdown_connections 2020-04-22T14:19:34.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.816+0000 7fb94d097700 1 -- 172.21.15.103:0/1972724165 wait complete. 2020-04-22T14:19:34.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.817+0000 7fb94d097700 1 Processor -- start 2020-04-22T14:19:34.823 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.817+0000 7fb94d097700 1 -- start start 2020-04-22T14:19:34.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.818+0000 7fb94d097700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb948063e30 0x7fb9480acfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:34.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.818+0000 7fb94d097700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb948065fe0 0x7fb9480b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:34.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.818+0000 7fb94d097700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9480b4620 con 0x7fb94812c0d0 2020-04-22T14:19:34.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.818+0000 7fb94d097700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9481559f0 con 0x7fb948065fe0 2020-04-22T14:19:34.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.818+0000 7fb94d097700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb948155c40 con 0x7fb948063e30 2020-04-22T14:19:34.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.818+0000 7fb946d9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb948063e30 0x7fb9480acfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:34.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.818+0000 7fb94759e700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb94812c0d0 0x7fb9481552c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50206/0 (socket says 172.21.15.103:50206) 2020-04-22T14:19:34.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.818+0000 7fb94759e700 1 -- 172.21.15.103:0/3738124079 learned_addr learned my addr 172.21.15.103:0/3738124079 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:34.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.818+0000 7fb94659c700 1 --2- 172.21.15.103:0/3738124079 >> v2:172.21.15.86:3300/0 conn(0x7fb948065fe0 0x7fb9480b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:34.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.818+0000 7fb946d9d700 1 -- 172.21.15.103:0/3738124079 >> v2:172.21.15.86:3300/0 conn(0x7fb948065fe0 msgr2=0x7fb9480b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:34.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.818+0000 7fb946d9d700 1 --2- 172.21.15.103:0/3738124079 >> v2:172.21.15.86:3300/0 conn(0x7fb948065fe0 0x7fb9480b41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:34.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.818+0000 7fb93ffff700 1 -- 172.21.15.103:0/3738124079 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2733532367 0 0) 0x7fb94805bb50 con 0x7fb94812c0d0 2020-04-22T14:19:34.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.818+0000 7fb946d9d700 1 -- 172.21.15.103:0/3738124079 >> v1:172.21.15.103:6789/0 conn(0x7fb94812c0d0 legacy=0x7fb9481552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:34.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.818+0000 7fb946d9d700 1 -- 172.21.15.103:0/3738124079 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb948155ee0 con 0x7fb948063e30 2020-04-22T14:19:34.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.818+0000 7fb946d9d700 1 --2- 172.21.15.103:0/3738124079 >> v2:172.21.15.103:3300/0 conn(0x7fb948063e30 0x7fb9480acfe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb940002f30 tx=0x7fb940010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:34.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.818+0000 7fb946d9d700 1 --2- 172.21.15.103:0/3738124079 >> v2:172.21.15.103:3300/0 conn(0x7fb948063e30 0x7fb9480acfe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb940002f30 tx=0x7fb940010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:34.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.818+0000 7fb946d9d700 1 --2- 172.21.15.103:0/3738124079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb948063e30 0x7fb9480acfe0 secure :-1 s=READY pgs=1991 cs=0 l=1 rx=0x7fb940002f30 tx=0x7fb940010b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:34.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.818+0000 7fb946d9d700 1 --2- 172.21.15.103:0/3738124079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb948063e30 0x7fb9480acfe0 secure :-1 s=THROTTLE_DONE pgs=1991 cs=0 l=1 rx=0x7fb940002f30 tx=0x7fb940010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:34.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.818+0000 7fb93ffff700 1 -- 172.21.15.103:0/3738124079 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb940007550 con 0x7fb948063e30 2020-04-22T14:19:34.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.818+0000 7fb946d9d700 1 --2- 172.21.15.103:0/3738124079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb948063e30 0x7fb9480acfe0 secure :-1 s=THROTTLE_DONE pgs=1991 cs=0 l=1 rx=0x7fb940002f30 tx=0x7fb940010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:34.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.818+0000 7fb946d9d700 1 --2- 172.21.15.103:0/3738124079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb948063e30 0x7fb9480acfe0 secure :-1 s=THROTTLE_DONE pgs=1991 cs=0 l=1 rx=0x7fb940002f30 tx=0x7fb940010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:34.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.818+0000 7fb93ffff700 1 -- 172.21.15.103:0/3738124079 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9400056c0 con 0x7fb948063e30 2020-04-22T14:19:34.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.818+0000 7fb93ffff700 1 -- 172.21.15.103:0/3738124079 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb940005a20 con 0x7fb948063e30 2020-04-22T14:19:34.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.818+0000 7fb94d097700 1 -- 172.21.15.103:0/3738124079 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9480acbc0 con 0x7fb948063e30 2020-04-22T14:19:34.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.818+0000 7fb94d097700 1 -- 172.21.15.103:0/3738124079 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb948127100 con 0x7fb948063e30 2020-04-22T14:19:34.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.819+0000 7fb946d9d700 1 --2- 172.21.15.103:0/3738124079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb948063e30 0x7fb9480acfe0 secure :-1 s=THROTTLE_DONE pgs=1991 cs=0 l=1 rx=0x7fb940002f30 tx=0x7fb940010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:34.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.819+0000 7fb94d097700 1 -- 172.21.15.103:0/3738124079 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb948056c90 con 0x7fb948063e30 2020-04-22T14:19:34.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.819+0000 7fb93ffff700 1 -- 172.21.15.103:0/3738124079 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fb940005bd0 con 0x7fb948063e30 2020-04-22T14:19:34.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.819+0000 7fb946d9d700 1 --2- 172.21.15.103:0/3738124079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb948063e30 0x7fb9480acfe0 secure :-1 s=THROTTLE_DONE pgs=1991 cs=0 l=1 rx=0x7fb940002f30 tx=0x7fb940010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:34.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.820+0000 7fb93ffff700 1 --2- 172.21.15.103:0/3738124079 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb92c04d820 0x7fb92c04fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:34.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.820+0000 7fb93ffff700 1 -- 172.21.15.103:0/3738124079 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fb94000d0d0 con 0x7fb948063e30 2020-04-22T14:19:34.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.820+0000 7fb94659c700 1 --2- 172.21.15.103:0/3738124079 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb92c04d820 0x7fb92c04fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:34.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.820+0000 7fb94659c700 1 --2- 172.21.15.103:0/3738124079 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb92c04d820 0x7fb92c04fce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb9480669a0 tx=0x7fb93000cba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:34.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.820+0000 7fb94659c700 1 --2- 172.21.15.103:0/3738124079 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb92c04d820 0x7fb92c04fce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb9480669a0 tx=0x7fb93000cba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:34.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.820+0000 7fb94659c700 1 --2- 172.21.15.103:0/3738124079 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb92c04d820 0x7fb92c04fce0 secure :-1 s=READY pgs=722 cs=0 l=1 rx=0x7fb9480669a0 tx=0x7fb93000cba0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:34.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.824+0000 7fb946d9d700 1 --2- 172.21.15.103:0/3738124079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb948063e30 0x7fb9480acfe0 secure :-1 s=THROTTLE_DONE pgs=1991 cs=0 l=1 rx=0x7fb940002f30 tx=0x7fb940010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:34.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:34.824+0000 7fb93ffff700 1 -- 172.21.15.103:0/3738124079 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fb94003c940 con 0x7fb948063e30 2020-04-22T14:19:35.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:35.021+0000 7fb94d097700 1 -- 172.21.15.103:0/3738124079 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_reconnect_eviction"]} v 0) v1 -- 0x7fb948147360 con 0x7fb948063e30 2020-04-22T14:19:35.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:35.642+0000 7fb946d9d700 1 --2- 172.21.15.103:0/3738124079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb948063e30 0x7fb9480acfe0 secure :-1 s=THROTTLE_DONE pgs=1991 cs=0 l=1 rx=0x7fb940002f30 tx=0x7fb940010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:35.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:35.642+0000 7fb93ffff700 1 -- 172.21.15.103:0/3738124079 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_reconnect_eviction"]}]=0 v728) v1 ==== 158+0+0 (secure 0 0 0) 0x7fb940005e60 con 0x7fb948063e30 2020-04-22T14:19:35.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:35.644+0000 7fb94d097700 1 -- 172.21.15.103:0/3738124079 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb92c04d820 msgr2=0x7fb92c04fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:35.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:35.644+0000 7fb94d097700 1 --2- 172.21.15.103:0/3738124079 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb92c04d820 0x7fb92c04fce0 secure :-1 s=READY pgs=722 cs=0 l=1 rx=0x7fb9480669a0 tx=0x7fb93000cba0).stop 2020-04-22T14:19:35.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:35.644+0000 7fb94d097700 1 -- 172.21.15.103:0/3738124079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb948063e30 msgr2=0x7fb9480acfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:35.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:35.644+0000 7fb94d097700 1 --2- 172.21.15.103:0/3738124079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb948063e30 0x7fb9480acfe0 secure :-1 s=READY pgs=1991 cs=0 l=1 rx=0x7fb940002f30 tx=0x7fb940010b90).stop 2020-04-22T14:19:35.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:35.644+0000 7fb94d097700 1 -- 172.21.15.103:0/3738124079 shutdown_connections 2020-04-22T14:19:35.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:35.644+0000 7fb94d097700 1 --2- 172.21.15.103:0/3738124079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb948063e30 0x7fb9480acfe0 unknown :-1 s=CLOSED pgs=1991 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:35.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:35.644+0000 7fb94d097700 1 --2- 172.21.15.103:0/3738124079 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb92c04d820 0x7fb92c04fce0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:35.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:35.644+0000 7fb94d097700 1 --2- 172.21.15.103:0/3738124079 >> v2:172.21.15.86:3300/0 conn(0x7fb948065fe0 0x7fb9480b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:35.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:35.644+0000 7fb94d097700 1 -- 172.21.15.103:0/3738124079 >> 172.21.15.103:0/3738124079 conn(0x7fb9480b9160 msgr2=0x7fb948147580 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:35.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:35.644+0000 7fb94d097700 1 -- 172.21.15.103:0/3738124079 shutdown_connections 2020-04-22T14:19:35.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:35.644+0000 7fb94d097700 1 -- 172.21.15.103:0/3738124079 wait complete. 2020-04-22T14:19:35.659 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-04-22T14:19:35.659 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:19:35.678 INFO:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:19:35.771 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:35.788 INFO:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:19:35.882 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-04-22T14:19:35.883 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:35.898 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2020-04-22T14:19:36.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.050+0000 7f9b80942700 1 Processor -- start 2020-04-22T14:19:36.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.050+0000 7f9b80942700 1 -- start start 2020-04-22T14:19:36.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.051+0000 7f9b80942700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9b7c0620a0 0x7f9b7c142e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:36.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.051+0000 7f9b80942700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b7c143810 con 0x7f9b7c0ad900 2020-04-22T14:19:36.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.051+0000 7f9b80942700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b7c143ab0 con 0x7f9b7c143280 2020-04-22T14:19:36.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.051+0000 7f9b80942700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b7c143d50 con 0x7f9b7c0620a0 2020-04-22T14:19:36.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.051+0000 7f9b7affd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f9b7c143280 0x7f9b7c146ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50214/0 (socket says 172.21.15.103:50214) 2020-04-22T14:19:36.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.051+0000 7f9b7affd700 1 -- 172.21.15.103:0/59227715 learned_addr learned my addr 172.21.15.103:0/59227715 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:36.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.051+0000 7f9b7b7fe700 1 --2- 172.21.15.103:0/59227715 >> v2:172.21.15.86:3300/0 conn(0x7f9b7c0620a0 0x7f9b7c142e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:36.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.051+0000 7f9b7a7fc700 1 -- 172.21.15.103:0/59227715 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3916418134 0 0) 0x7f9b7c143ab0 con 0x7f9b7c143280 2020-04-22T14:19:36.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.051+0000 7f9b7a7fc700 1 -- 172.21.15.103:0/59227715 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b5c003230 con 0x7f9b7c143280 2020-04-22T14:19:36.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.051+0000 7f9b7a7fc700 1 -- 172.21.15.103:0/59227715 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2870517458 0 0) 0x7f9b5c003230 con 0x7f9b7c143280 2020-04-22T14:19:36.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.051+0000 7f9b7b7fe700 1 -- 172.21.15.103:0/59227715 >> v1:172.21.15.103:6789/0 conn(0x7f9b7c143280 legacy=0x7f9b7c146ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:36.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.051+0000 7f9b7b7fe700 1 -- 172.21.15.103:0/59227715 >> v1:172.21.15.86:6789/0 conn(0x7f9b7c0ad900 legacy=0x7f9b7c0add90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:36.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.051+0000 7f9b7b7fe700 1 -- 172.21.15.103:0/59227715 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b7c062480 con 0x7f9b7c0620a0 2020-04-22T14:19:36.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.051+0000 7f9b7b7fe700 1 --2- 172.21.15.103:0/59227715 >> v2:172.21.15.86:3300/0 conn(0x7f9b7c0620a0 0x7f9b7c142e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9b64001bf0 tx=0x7f9b74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.051+0000 7f9b7b7fe700 1 --2- 172.21.15.103:0/59227715 >> v2:172.21.15.86:3300/0 conn(0x7f9b7c0620a0 0x7f9b7c142e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9b64001bf0 tx=0x7f9b74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.051+0000 7f9b7b7fe700 1 --2- 172.21.15.103:0/59227715 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b7c0620a0 0x7f9b7c142e20 secure :-1 s=READY pgs=1050 cs=0 l=1 rx=0x7f9b64001bf0 tx=0x7f9b74007a40).ready entity=mon.0 client_cookie=27f43eaa88ac0911 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:36.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.052+0000 7f9b7b7fe700 1 --2- 172.21.15.103:0/59227715 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b7c0620a0 0x7f9b7c142e20 secure :-1 s=THROTTLE_DONE pgs=1050 cs=0 l=1 rx=0x7f9b64001bf0 tx=0x7f9b74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.052+0000 7f9b7a7fc700 1 -- 172.21.15.103:0/59227715 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b64001a50 con 0x7f9b7c0620a0 2020-04-22T14:19:36.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.052+0000 7f9b7b7fe700 1 --2- 172.21.15.103:0/59227715 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b7c0620a0 0x7f9b7c142e20 secure :-1 s=THROTTLE_DONE pgs=1050 cs=0 l=1 rx=0x7f9b64001bf0 tx=0x7f9b74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.052+0000 7f9b7a7fc700 1 -- 172.21.15.103:0/59227715 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b74008b40 con 0x7f9b7c0620a0 2020-04-22T14:19:36.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.052+0000 7f9b7b7fe700 1 --2- 172.21.15.103:0/59227715 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b7c0620a0 0x7f9b7c142e20 secure :-1 s=THROTTLE_DONE pgs=1050 cs=0 l=1 rx=0x7f9b64001bf0 tx=0x7f9b74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.052+0000 7f9b80942700 1 -- 172.21.15.103:0/59227715 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b7c0620a0 msgr2=0x7f9b7c142e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:36.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.052+0000 7f9b80942700 1 --2- 172.21.15.103:0/59227715 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b7c0620a0 0x7f9b7c142e20 secure :-1 s=READY pgs=1050 cs=0 l=1 rx=0x7f9b64001bf0 tx=0x7f9b74007a40).stop 2020-04-22T14:19:36.080 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.052+0000 7f9b7a7fc700 1 -- 172.21.15.103:0/59227715 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b74011740 con 0x7f9b7c0620a0 2020-04-22T14:19:36.081 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.052+0000 7f9b80942700 1 -- 172.21.15.103:0/59227715 shutdown_connections 2020-04-22T14:19:36.081 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.052+0000 7f9b80942700 1 --2- 172.21.15.103:0/59227715 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b7c0620a0 0x7f9b7c142e20 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:36.082 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.052+0000 7f9b80942700 1 -- 172.21.15.103:0/59227715 >> 172.21.15.103:0/59227715 conn(0x7f9b7c05b7c0 msgr2=0x7f9b7c061610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:36.082 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.052+0000 7f9b80942700 1 -- 172.21.15.103:0/59227715 shutdown_connections 2020-04-22T14:19:36.082 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.052+0000 7f9b80942700 1 -- 172.21.15.103:0/59227715 wait complete. 2020-04-22T14:19:36.082 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.053+0000 7f9b80942700 1 Processor -- start 2020-04-22T14:19:36.082 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.053+0000 7f9b80942700 1 -- start start 2020-04-22T14:19:36.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.054+0000 7f9b80942700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b7c0620a0 0x7f9b7c0b4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:36.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.054+0000 7f9b80942700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9b7c0ad900 0x7f9b7c13cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:36.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.054+0000 7f9b80942700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b7c13cf30 con 0x7f9b7c143280 2020-04-22T14:19:36.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.054+0000 7f9b80942700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b7c150c30 con 0x7f9b7c0ad900 2020-04-22T14:19:36.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.054+0000 7f9b80942700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7c150ed0 con 0x7f9b7c0620a0 2020-04-22T14:19:36.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.054+0000 7f9b7affd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9b7c0ad900 0x7f9b7c13cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:36.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.054+0000 7f9b7b7fe700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b7c0620a0 0x7f9b7c0b4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:36.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.054+0000 7f9b7b7fe700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b7c0620a0 0x7f9b7c0b4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:42804/0 (socket says 172.21.15.103:42804) 2020-04-22T14:19:36.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.054+0000 7f9b7b7fe700 1 -- 172.21.15.103:0/4074687008 learned_addr learned my addr 172.21.15.103:0/4074687008 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:19:36.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.055+0000 7f9b7b7fe700 1 -- 172.21.15.103:0/4074687008 >> v2:172.21.15.86:3300/0 conn(0x7f9b7c0ad900 msgr2=0x7f9b7c13cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:36.093 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.055+0000 7f9b7b7fe700 1 --2- 172.21.15.103:0/4074687008 >> v2:172.21.15.86:3300/0 conn(0x7f9b7c0ad900 0x7f9b7c13cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:36.093 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.055+0000 7f9b7b7fe700 1 -- 172.21.15.103:0/4074687008 >> v1:172.21.15.86:6789/0 conn(0x7f9b7c143280 legacy=0x7f9b7c0b1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:36.093 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.055+0000 7f9b78ff9700 1 -- 172.21.15.103:0/4074687008 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 686731719 0 0) 0x7f9b7c143810 con 0x7f9b7c143280 2020-04-22T14:19:36.093 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.055+0000 7f9b7b7fe700 1 -- 172.21.15.103:0/4074687008 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b7c151170 con 0x7f9b7c0620a0 2020-04-22T14:19:36.093 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.055+0000 7f9b7affd700 1 --2- 172.21.15.103:0/4074687008 >> v2:172.21.15.86:3300/0 conn(0x7f9b7c0ad900 0x7f9b7c13cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:19:36.093 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.055+0000 7f9b7b7fe700 1 --2- 172.21.15.103:0/4074687008 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b7c0620a0 0x7f9b7c0b4150 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9b64001bf0 tx=0x7f9b74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.094 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.055+0000 7f9b7b7fe700 1 --2- 172.21.15.103:0/4074687008 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b7c0620a0 0x7f9b7c0b4150 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9b64001bf0 tx=0x7f9b74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.094 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.055+0000 7f9b7b7fe700 1 --2- 172.21.15.103:0/4074687008 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b7c0620a0 0x7f9b7c0b4150 secure :-1 s=READY pgs=182 cs=0 l=1 rx=0x7f9b64001bf0 tx=0x7f9b74007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:36.094 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.055+0000 7f9b7b7fe700 1 --2- 172.21.15.103:0/4074687008 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b7c0620a0 0x7f9b7c0b4150 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f9b64001bf0 tx=0x7f9b74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.094 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.055+0000 7f9b78ff9700 1 -- 172.21.15.103:0/4074687008 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b74007360 con 0x7f9b7c0620a0 2020-04-22T14:19:36.094 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.055+0000 7f9b7b7fe700 1 --2- 172.21.15.103:0/4074687008 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b7c0620a0 0x7f9b7c0b4150 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f9b64001bf0 tx=0x7f9b74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.094 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.055+0000 7f9b78ff9700 1 -- 172.21.15.103:0/4074687008 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b740074c0 con 0x7f9b7c0620a0 2020-04-22T14:19:36.094 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.055+0000 7f9b7b7fe700 1 --2- 172.21.15.103:0/4074687008 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b7c0620a0 0x7f9b7c0b4150 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f9b64001bf0 tx=0x7f9b74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.095 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.055+0000 7f9b80942700 1 -- 172.21.15.103:0/4074687008 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b7c0b2b90 con 0x7f9b7c0620a0 2020-04-22T14:19:36.095 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.055+0000 7f9b78ff9700 1 -- 172.21.15.103:0/4074687008 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b740058b0 con 0x7f9b7c0620a0 2020-04-22T14:19:36.095 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.055+0000 7f9b80942700 1 -- 172.21.15.103:0/4074687008 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b7c150a00 con 0x7f9b7c0620a0 2020-04-22T14:19:36.095 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.056+0000 7f9b7b7fe700 1 --2- 172.21.15.103:0/4074687008 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b7c0620a0 0x7f9b7c0b4150 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f9b64001bf0 tx=0x7f9b74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.095 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.056+0000 7f9b80942700 1 -- 172.21.15.103:0/4074687008 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b7c151370 con 0x7f9b7c0620a0 2020-04-22T14:19:36.095 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.056+0000 7f9b78ff9700 1 -- 172.21.15.103:0/4074687008 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f9b74012070 con 0x7f9b7c0620a0 2020-04-22T14:19:36.095 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.056+0000 7f9b7b7fe700 1 --2- 172.21.15.103:0/4074687008 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b7c0620a0 0x7f9b7c0b4150 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f9b64001bf0 tx=0x7f9b74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.095 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.056+0000 7f9b78ff9700 1 --2- 172.21.15.103:0/4074687008 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9b6004d870 0x7f9b6004fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:36.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.057+0000 7f9b78ff9700 1 -- 172.21.15.103:0/4074687008 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f9b74061b00 con 0x7f9b7c0620a0 2020-04-22T14:19:36.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.057+0000 7f9b7affd700 1 --2- 172.21.15.103:0/4074687008 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9b6004d870 0x7f9b6004fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:36.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.057+0000 7f9b7affd700 1 --2- 172.21.15.103:0/4074687008 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9b6004d870 0x7f9b6004fd30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9b64001cb0 tx=0x7f9b6400d290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.057+0000 7f9b7affd700 1 --2- 172.21.15.103:0/4074687008 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9b6004d870 0x7f9b6004fd30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9b64001cb0 tx=0x7f9b6400d290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.057+0000 7f9b7affd700 1 --2- 172.21.15.103:0/4074687008 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9b6004d870 0x7f9b6004fd30 secure :-1 s=READY pgs=723 cs=0 l=1 rx=0x7f9b64001cb0 tx=0x7f9b6400d290).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:36.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.060+0000 7f9b7b7fe700 1 --2- 172.21.15.103:0/4074687008 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b7c0620a0 0x7f9b7c0b4150 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f9b64001bf0 tx=0x7f9b74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.060+0000 7f9b78ff9700 1 -- 172.21.15.103:0/4074687008 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f9b7c151370 con 0x7f9b7c0620a0 2020-04-22T14:19:36.204 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.202+0000 7f9b80942700 1 -- 172.21.15.103:0/4074687008 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f9b7c151370 con 0x7f9b7c0620a0 2020-04-22T14:19:36.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.203+0000 7f9b7b7fe700 1 --2- 172.21.15.103:0/4074687008 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b7c0620a0 0x7f9b7c0b4150 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f9b64001bf0 tx=0x7f9b74007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.203+0000 7f9b78ff9700 1 -- 172.21.15.103:0/4074687008 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v136) v1 ==== 81+0+33785 (secure 0 0 0) 0x7f9b7c151370 con 0x7f9b7c0620a0 2020-04-22T14:19:36.208 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:19:36.208 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:19:36.208 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 136, 2020-04-22T14:19:36.209 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:19:36.209 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2020-04-22T14:02:06.484738+0000", 2020-04-22T14:19:36.209 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2020-04-22T14:19:09.589431+0000", 2020-04-22T14:19:36.209 INFO:teuthology.orchestra.run.smithi103.stdout: "last_up_change": "2020-04-22T14:02:18.623774+0000", 2020-04-22T14:19:36.209 INFO:teuthology.orchestra.run.smithi103.stdout: "last_in_change": "2020-04-22T14:02:18.623774+0000", 2020-04-22T14:19:36.209 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-04-22T14:19:36.209 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_num": 5799936, 2020-04-22T14:19:36.210 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_set": [ 2020-04-22T14:19:36.210 INFO:teuthology.orchestra.run.smithi103.stdout: "pglog_hardlimit", 2020-04-22T14:19:36.210 INFO:teuthology.orchestra.run.smithi103.stdout: "purged_snapdirs", 2020-04-22T14:19:36.210 INFO:teuthology.orchestra.run.smithi103.stdout: "recovery_deletes", 2020-04-22T14:19:36.210 INFO:teuthology.orchestra.run.smithi103.stdout: "sortbitwise" 2020-04-22T14:19:36.210 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:19:36.210 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_version": 5, 2020-04-22T14:19:36.211 INFO:teuthology.orchestra.run.smithi103.stdout: "full_ratio": 0.94999998807907104, 2020-04-22T14:19:36.211 INFO:teuthology.orchestra.run.smithi103.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-04-22T14:19:36.212 INFO:teuthology.orchestra.run.smithi103.stdout: "nearfull_ratio": 0.85000002384185791, 2020-04-22T14:19:36.212 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_snapshot": "", 2020-04-22T14:19:36.212 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_max": 24, 2020-04-22T14:19:36.213 INFO:teuthology.orchestra.run.smithi103.stdout: "max_osd": 8, 2020-04-22T14:19:36.213 INFO:teuthology.orchestra.run.smithi103.stdout: "require_min_compat_client": "luminous", 2020-04-22T14:19:36.214 INFO:teuthology.orchestra.run.smithi103.stdout: "min_compat_client": "jewel", 2020-04-22T14:19:36.214 INFO:teuthology.orchestra.run.smithi103.stdout: "require_osd_release": "pacific", 2020-04-22T14:19:36.214 INFO:teuthology.orchestra.run.smithi103.stdout: "pools": [ 2020-04-22T14:19:36.214 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.214 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 1, 2020-04-22T14:19:36.215 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "device_health_metrics", 2020-04-22T14:19:36.215 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:02:09.565655+0000", 2020-04-22T14:19:36.215 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:19:36.215 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:19:36.215 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:19:36.215 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:19:36.216 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:19:36.216 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:19:36.216 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:19:36.216 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:19:36.216 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 1, 2020-04-22T14:19:36.216 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 1, 2020-04-22T14:19:36.217 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 1, 2020-04-22T14:19:36.217 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 1, 2020-04-22T14:19:36.217 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 1, 2020-04-22T14:19:36.217 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:19:36.217 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:19:36.217 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:19:36.218 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:19:36.218 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:19:36.218 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:19:36.218 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:19:36.218 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.218 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "17", 2020-04-22T14:19:36.218 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:19:36.219 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:19:36.219 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:19:36.219 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:19:36.219 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:19:36.219 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:19:36.219 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:19:36.219 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:19:36.220 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:19:36.220 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:19:36.220 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:19:36.220 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:19:36.220 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:19:36.220 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:19:36.220 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:19:36.221 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:19:36.221 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:19:36.221 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:19:36.221 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:19:36.221 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:19:36.222 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:19:36.222 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:19:36.222 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:19:36.222 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:19:36.222 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:19:36.222 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:19:36.222 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.223 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:19:36.223 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:19:36.223 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:19:36.223 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:19:36.223 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:19:36.223 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:19:36.224 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:19:36.224 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:19:36.224 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:19:36.224 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:19:36.224 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:19:36.224 INFO:teuthology.orchestra.run.smithi103.stdout: "options": { 2020-04-22T14:19:36.225 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_min": 1 2020-04-22T14:19:36.225 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.225 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:19:36.225 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_devicehealth": {} 2020-04-22T14:19:36.225 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.225 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.225 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.226 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 2, 2020-04-22T14:19:36.226 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "rbd", 2020-04-22T14:19:36.226 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:02:22.733031+0000", 2020-04-22T14:19:36.226 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:19:36.226 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:19:36.226 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:19:36.226 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:19:36.227 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:19:36.227 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:19:36.227 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:19:36.227 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:19:36.227 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 8, 2020-04-22T14:19:36.227 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 8, 2020-04-22T14:19:36.228 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 8, 2020-04-22T14:19:36.228 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 8, 2020-04-22T14:19:36.228 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 8, 2020-04-22T14:19:36.228 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:19:36.228 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:19:36.228 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:19:36.228 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:19:36.229 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:19:36.229 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:19:36.229 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:19:36.229 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.229 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "20", 2020-04-22T14:19:36.229 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:19:36.230 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:19:36.230 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:19:36.230 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:19:36.230 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:19:36.230 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:19:36.230 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:19:36.231 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:19:36.231 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:19:36.231 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:19:36.231 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:19:36.231 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:19:36.231 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:19:36.232 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:19:36.232 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:19:36.232 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:19:36.233 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:19:36.233 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:19:36.233 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:19:36.233 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:19:36.233 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:19:36.234 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:19:36.234 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:19:36.234 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:19:36.234 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:19:36.234 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:19:36.234 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.234 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:19:36.235 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:19:36.235 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:19:36.235 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:19:36.235 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:19:36.235 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:19:36.235 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:19:36.236 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:19:36.236 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:19:36.236 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:19:36.236 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:19:36.236 INFO:teuthology.orchestra.run.smithi103.stdout: "options": {}, 2020-04-22T14:19:36.237 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:19:36.237 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd": {} 2020-04-22T14:19:36.237 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.237 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.237 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.237 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 23, 2020-04-22T14:19:36.238 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "cephfs_metadata", 2020-04-22T14:19:36.238 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:17:45.940111+0000", 2020-04-22T14:19:36.238 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:19:36.238 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:19:36.238 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:19:36.238 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:19:36.239 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:19:36.239 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:19:36.239 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:19:36.239 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:19:36.239 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 8, 2020-04-22T14:19:36.239 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 8, 2020-04-22T14:19:36.239 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 8, 2020-04-22T14:19:36.240 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 8, 2020-04-22T14:19:36.240 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 8, 2020-04-22T14:19:36.240 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:19:36.240 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:19:36.240 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:19:36.240 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:19:36.240 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:19:36.241 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:19:36.241 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:19:36.241 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.241 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "134", 2020-04-22T14:19:36.241 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:19:36.241 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:19:36.241 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:19:36.242 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:19:36.242 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:19:36.242 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:19:36.243 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:19:36.243 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:19:36.243 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:19:36.243 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:19:36.243 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:19:36.243 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:19:36.244 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:19:36.244 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:19:36.244 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:19:36.244 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:19:36.244 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:19:36.244 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:19:36.245 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:19:36.245 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:19:36.245 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:19:36.245 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:19:36.245 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:19:36.245 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:19:36.245 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:19:36.246 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:19:36.246 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.246 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:19:36.246 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:19:36.246 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:19:36.247 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:19:36.247 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:19:36.247 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:19:36.247 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:19:36.247 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:19:36.247 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:19:36.247 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:19:36.248 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:19:36.248 INFO:teuthology.orchestra.run.smithi103.stdout: "options": { 2020-04-22T14:19:36.248 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_bias": 4, 2020-04-22T14:19:36.248 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_min": 16, 2020-04-22T14:19:36.248 INFO:teuthology.orchestra.run.smithi103.stdout: "recovery_priority": 5 2020-04-22T14:19:36.248 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.248 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:19:36.249 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs": { 2020-04-22T14:19:36.249 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": "cephfs" 2020-04-22T14:19:36.249 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.249 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.249 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.249 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.250 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 24, 2020-04-22T14:19:36.250 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "cephfs_data", 2020-04-22T14:19:36.250 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:17:46.960856+0000", 2020-04-22T14:19:36.250 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:19:36.250 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:19:36.250 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:19:36.250 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:19:36.251 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:19:36.251 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:19:36.251 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:19:36.251 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:19:36.251 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 8, 2020-04-22T14:19:36.251 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 8, 2020-04-22T14:19:36.252 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 8, 2020-04-22T14:19:36.252 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 8, 2020-04-22T14:19:36.252 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 8, 2020-04-22T14:19:36.252 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:19:36.253 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:19:36.253 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:19:36.253 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:19:36.253 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:19:36.253 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:19:36.253 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:19:36.254 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.254 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "135", 2020-04-22T14:19:36.254 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:19:36.254 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:19:36.254 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:19:36.255 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:19:36.255 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:19:36.255 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:19:36.255 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:19:36.255 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:19:36.255 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:19:36.255 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:19:36.256 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:19:36.256 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:19:36.256 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:19:36.256 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:19:36.256 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:19:36.256 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:19:36.257 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:19:36.257 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:19:36.257 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:19:36.257 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:19:36.257 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:19:36.257 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:19:36.257 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:19:36.258 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:19:36.258 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:19:36.258 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:19:36.258 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.258 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:19:36.258 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:19:36.258 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:19:36.258 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:19:36.259 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:19:36.259 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:19:36.259 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:19:36.259 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:19:36.259 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:19:36.259 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:19:36.259 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:19:36.260 INFO:teuthology.orchestra.run.smithi103.stdout: "options": {}, 2020-04-22T14:19:36.260 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:19:36.260 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs": { 2020-04-22T14:19:36.260 INFO:teuthology.orchestra.run.smithi103.stdout: "data": "cephfs" 2020-04-22T14:19:36.260 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.260 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.260 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.261 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:19:36.261 INFO:teuthology.orchestra.run.smithi103.stdout: "osds": [ 2020-04-22T14:19:36.261 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.261 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 0, 2020-04-22T14:19:36.261 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "3546145b-bd93-4a79-b6fe-3158153b8f05", 2020-04-22T14:19:36.261 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:19:36.262 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:19:36.262 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:19:36.262 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:19:36.262 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:19:36.262 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:19:36.262 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:19:36.262 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 133, 2020-04-22T14:19:36.262 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:19:36.263 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:19:36.263 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:19:36.264 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:19:36.264 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.264 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:19:36.264 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6800", 2020-04-22T14:19:36.264 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:19:36.264 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.264 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.265 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:19:36.265 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6801", 2020-04-22T14:19:36.266 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:19:36.269 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.269 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:36.269 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.269 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:19:36.269 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:19:36.269 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.270 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:19:36.270 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6802", 2020-04-22T14:19:36.270 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:19:36.270 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.270 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.270 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:19:36.270 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6803", 2020-04-22T14:19:36.271 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:19:36.271 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.271 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:36.271 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.271 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:19:36.271 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:19:36.271 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.271 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:19:36.272 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6806", 2020-04-22T14:19:36.272 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:19:36.272 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.272 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.272 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:19:36.272 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6807", 2020-04-22T14:19:36.273 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:19:36.273 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.273 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:36.273 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.273 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:19:36.273 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:19:36.273 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.273 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:19:36.274 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6804", 2020-04-22T14:19:36.274 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:19:36.274 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.274 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.274 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:19:36.274 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6805", 2020-04-22T14:19:36.274 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:19:36.274 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.275 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:36.275 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.275 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6801/33072", 2020-04-22T14:19:36.275 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6803/33072", 2020-04-22T14:19:36.275 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6807/33072", 2020-04-22T14:19:36.275 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6805/33072", 2020-04-22T14:19:36.275 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:19:36.276 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:19:36.276 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:19:36.276 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:36.276 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.276 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.276 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 1, 2020-04-22T14:19:36.276 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "65ca5f7d-2ea6-4de6-a034-08a0a99aa80d", 2020-04-22T14:19:36.277 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:19:36.277 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:19:36.277 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:19:36.277 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:19:36.277 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:19:36.277 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:19:36.277 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:19:36.277 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 133, 2020-04-22T14:19:36.278 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:19:36.278 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:19:36.278 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:19:36.278 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:19:36.278 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.278 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:19:36.278 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6808", 2020-04-22T14:19:36.279 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:19:36.280 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.280 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.280 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:19:36.280 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6809", 2020-04-22T14:19:36.280 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:19:36.280 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.280 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:36.281 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.281 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:19:36.281 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:19:36.281 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.281 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:19:36.281 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6810", 2020-04-22T14:19:36.281 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:19:36.282 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.282 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.282 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:19:36.282 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6811", 2020-04-22T14:19:36.282 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:19:36.282 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.282 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:36.282 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.283 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:19:36.283 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:19:36.283 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.283 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:19:36.283 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6814", 2020-04-22T14:19:36.283 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:19:36.283 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.284 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.284 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:19:36.284 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6815", 2020-04-22T14:19:36.284 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:19:36.284 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.284 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:36.284 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.284 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:19:36.285 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:19:36.285 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.285 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:19:36.285 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6812", 2020-04-22T14:19:36.285 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:19:36.285 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.285 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.286 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:19:36.286 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6813", 2020-04-22T14:19:36.286 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:19:36.286 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.286 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:36.286 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.286 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6809/33103", 2020-04-22T14:19:36.286 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6811/33103", 2020-04-22T14:19:36.287 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6815/33103", 2020-04-22T14:19:36.287 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6813/33103", 2020-04-22T14:19:36.287 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:19:36.287 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:19:36.287 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:19:36.287 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:36.287 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.287 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.288 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 2, 2020-04-22T14:19:36.288 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "f2e9bf44-c844-48d7-b6c2-f08ea71189b4", 2020-04-22T14:19:36.288 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:19:36.288 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:19:36.288 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:19:36.288 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:19:36.288 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:19:36.289 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:19:36.289 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:19:36.289 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 132, 2020-04-22T14:19:36.289 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:19:36.289 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:19:36.289 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:19:36.289 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:19:36.290 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.290 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:19:36.290 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6816", 2020-04-22T14:19:36.291 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:19:36.291 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.291 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.291 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:19:36.291 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6817", 2020-04-22T14:19:36.291 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:19:36.291 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.291 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:36.292 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.292 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:19:36.292 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:19:36.292 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.292 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:19:36.293 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6818", 2020-04-22T14:19:36.293 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:19:36.293 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.293 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.293 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:19:36.293 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6819", 2020-04-22T14:19:36.293 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:19:36.294 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.294 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:36.294 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.294 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:19:36.294 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:19:36.294 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.294 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:19:36.294 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6822", 2020-04-22T14:19:36.295 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:19:36.295 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.295 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.295 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:19:36.295 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6823", 2020-04-22T14:19:36.295 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:19:36.295 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.296 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:36.296 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.296 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:19:36.296 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:19:36.296 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.296 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:19:36.296 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6820", 2020-04-22T14:19:36.296 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:19:36.297 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.297 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.297 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:19:36.297 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6821", 2020-04-22T14:19:36.297 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:19:36.297 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.297 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:36.298 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.298 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6817/33153", 2020-04-22T14:19:36.298 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6819/33153", 2020-04-22T14:19:36.298 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6823/33153", 2020-04-22T14:19:36.298 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6821/33153", 2020-04-22T14:19:36.298 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:19:36.298 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:19:36.299 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:19:36.299 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:36.299 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.299 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.299 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 3, 2020-04-22T14:19:36.299 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "0ab87fee-a427-4906-851a-b9bd8c2e5645", 2020-04-22T14:19:36.299 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:19:36.299 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:19:36.300 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:19:36.300 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:19:36.300 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:19:36.300 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:19:36.300 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:19:36.300 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 133, 2020-04-22T14:19:36.300 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:19:36.301 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:19:36.301 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:19:36.301 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:19:36.301 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.301 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:19:36.301 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6824", 2020-04-22T14:19:36.301 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:19:36.301 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.302 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.302 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:19:36.302 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6825", 2020-04-22T14:19:36.302 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:19:36.302 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.302 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:36.302 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.303 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:19:36.303 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:19:36.303 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.303 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:19:36.303 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6826", 2020-04-22T14:19:36.303 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:19:36.303 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.303 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.304 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:19:36.304 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6827", 2020-04-22T14:19:36.304 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:19:36.304 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.304 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:36.304 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.304 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:19:36.305 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:19:36.305 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.305 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:19:36.305 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6830", 2020-04-22T14:19:36.305 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:19:36.305 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.305 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.306 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:19:36.306 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6831", 2020-04-22T14:19:36.306 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:19:36.306 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.306 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:36.306 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.306 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:19:36.306 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:19:36.307 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.307 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:19:36.307 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6828", 2020-04-22T14:19:36.307 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:19:36.307 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.307 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.307 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:19:36.308 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6829", 2020-04-22T14:19:36.308 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:19:36.308 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.308 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:36.308 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.308 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6825/33183", 2020-04-22T14:19:36.308 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6827/33183", 2020-04-22T14:19:36.309 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6831/33183", 2020-04-22T14:19:36.309 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6829/33183", 2020-04-22T14:19:36.309 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:19:36.309 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:19:36.309 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:19:36.309 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:36.309 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.309 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.310 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 4, 2020-04-22T14:19:36.310 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "2565df7d-2eff-484b-a3cd-ed7715e5d875", 2020-04-22T14:19:36.310 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:19:36.310 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:19:36.310 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:19:36.310 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:19:36.310 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:19:36.310 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:19:36.311 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:19:36.311 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 132, 2020-04-22T14:19:36.311 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:19:36.311 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:19:36.311 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:19:36.311 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:19:36.311 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.312 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:19:36.312 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6802", 2020-04-22T14:19:36.312 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:19:36.312 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.312 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.312 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:19:36.312 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6803", 2020-04-22T14:19:36.312 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:19:36.313 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.313 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:36.313 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.313 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:19:36.313 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:19:36.313 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.313 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:19:36.314 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6804", 2020-04-22T14:19:36.314 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:19:36.314 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.314 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.314 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:19:36.314 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6805", 2020-04-22T14:19:36.314 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:19:36.314 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.315 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:36.315 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.315 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:19:36.315 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:19:36.315 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.315 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:19:36.315 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6808", 2020-04-22T14:19:36.316 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:19:36.316 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.316 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.316 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:19:36.316 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6809", 2020-04-22T14:19:36.316 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:19:36.316 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.316 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:36.317 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.317 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:19:36.317 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:19:36.317 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.317 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:19:36.317 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6806", 2020-04-22T14:19:36.317 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:19:36.318 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.318 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.318 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:19:36.318 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6807", 2020-04-22T14:19:36.318 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:19:36.318 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.318 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:36.318 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.319 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6803/33506", 2020-04-22T14:19:36.319 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6805/33506", 2020-04-22T14:19:36.319 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6809/33506", 2020-04-22T14:19:36.319 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6807/33506", 2020-04-22T14:19:36.319 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:19:36.319 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:19:36.319 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:19:36.320 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:36.320 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.320 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.320 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 5, 2020-04-22T14:19:36.320 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "bcfd7a16-6914-4152-8647-a481917fe19d", 2020-04-22T14:19:36.320 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:19:36.320 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:19:36.320 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:19:36.321 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:19:36.321 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:19:36.321 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:19:36.321 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:19:36.321 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 133, 2020-04-22T14:19:36.321 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:19:36.321 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:19:36.322 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:19:36.322 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:19:36.322 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.322 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:19:36.322 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6810", 2020-04-22T14:19:36.322 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:19:36.322 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.322 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.323 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:19:36.323 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6811", 2020-04-22T14:19:36.323 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:19:36.323 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.323 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:36.323 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.323 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:19:36.324 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:19:36.324 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.324 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:19:36.324 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6812", 2020-04-22T14:19:36.324 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:19:36.324 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.324 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.324 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:19:36.325 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6813", 2020-04-22T14:19:36.325 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:19:36.325 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.325 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:36.325 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.325 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:19:36.325 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:19:36.326 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.326 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:19:36.326 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6816", 2020-04-22T14:19:36.326 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:19:36.326 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.326 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.326 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:19:36.326 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6817", 2020-04-22T14:19:36.327 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:19:36.327 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.327 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:36.327 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.327 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:19:36.327 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:19:36.327 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.328 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:19:36.328 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6814", 2020-04-22T14:19:36.328 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:19:36.328 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.328 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.328 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:19:36.328 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6815", 2020-04-22T14:19:36.328 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:19:36.329 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.329 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:36.329 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.329 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6811/33554", 2020-04-22T14:19:36.329 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6813/33554", 2020-04-22T14:19:36.329 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6817/33554", 2020-04-22T14:19:36.329 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6815/33554", 2020-04-22T14:19:36.330 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:19:36.330 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:19:36.330 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:19:36.330 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:36.330 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.330 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.330 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 6, 2020-04-22T14:19:36.330 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050", 2020-04-22T14:19:36.331 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:19:36.331 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:19:36.331 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:19:36.331 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:19:36.331 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:19:36.331 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:19:36.331 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:19:36.332 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 133, 2020-04-22T14:19:36.332 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:19:36.332 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:19:36.332 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:19:36.332 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:19:36.332 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.332 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:19:36.333 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6818", 2020-04-22T14:19:36.333 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:19:36.333 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.333 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.333 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:19:36.333 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6819", 2020-04-22T14:19:36.333 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:19:36.333 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.334 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:36.334 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.334 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:19:36.334 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:19:36.334 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.334 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:19:36.334 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6820", 2020-04-22T14:19:36.335 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:19:36.335 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.335 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.335 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:19:36.335 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6821", 2020-04-22T14:19:36.335 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:19:36.335 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.335 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:36.336 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.336 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:19:36.336 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:19:36.336 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.336 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:19:36.336 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6824", 2020-04-22T14:19:36.336 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:19:36.337 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.337 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.337 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:19:36.337 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6825", 2020-04-22T14:19:36.337 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:19:36.337 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.337 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:36.337 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.338 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:19:36.338 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:19:36.338 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.338 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:19:36.338 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6822", 2020-04-22T14:19:36.338 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:19:36.338 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.339 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.339 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:19:36.339 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6823", 2020-04-22T14:19:36.339 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:19:36.339 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.339 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:36.339 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.339 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6819/33601", 2020-04-22T14:19:36.340 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6821/33601", 2020-04-22T14:19:36.340 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6825/33601", 2020-04-22T14:19:36.340 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6823/33601", 2020-04-22T14:19:36.340 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:19:36.340 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:19:36.340 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:19:36.340 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:36.341 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.341 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.341 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 7, 2020-04-22T14:19:36.341 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "340eece1-4c39-47cd-b95f-9cfa5dcfe361", 2020-04-22T14:19:36.341 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:19:36.341 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:19:36.341 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:19:36.341 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:19:36.342 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:19:36.342 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:19:36.342 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:19:36.342 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 133, 2020-04-22T14:19:36.342 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:19:36.342 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:19:36.342 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:19:36.343 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:19:36.343 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.343 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:19:36.343 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6826", 2020-04-22T14:19:36.343 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:19:36.343 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.343 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.343 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:19:36.344 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6827", 2020-04-22T14:19:36.344 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:19:36.344 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.344 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:36.344 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.344 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:19:36.344 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:19:36.345 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.345 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:19:36.345 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6828", 2020-04-22T14:19:36.345 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:19:36.345 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.345 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.345 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:19:36.345 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6829", 2020-04-22T14:19:36.346 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:19:36.346 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.346 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:36.346 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.346 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:19:36.346 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:19:36.346 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.347 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:19:36.347 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6832", 2020-04-22T14:19:36.347 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:19:36.347 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.347 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.347 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:19:36.347 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6833", 2020-04-22T14:19:36.347 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:19:36.348 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.348 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:36.348 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.348 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:19:36.348 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:19:36.348 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.348 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:19:36.349 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6830", 2020-04-22T14:19:36.349 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:19:36.349 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.349 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.349 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:19:36.349 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6831", 2020-04-22T14:19:36.349 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:19:36.349 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.350 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:36.350 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.350 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6827/33629", 2020-04-22T14:19:36.350 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6829/33629", 2020-04-22T14:19:36.350 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6833/33629", 2020-04-22T14:19:36.350 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6831/33629", 2020-04-22T14:19:36.350 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:19:36.351 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:19:36.351 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:19:36.351 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:36.351 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.351 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:19:36.351 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_xinfo": [ 2020-04-22T14:19:36.351 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.351 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 0, 2020-04-22T14:19:36.352 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:19:36.352 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:19:36.352 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:19:36.352 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:19:36.352 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:19:36.352 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.384360+0000", 2020-04-22T14:19:36.352 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:19:36.353 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.353 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.353 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 1, 2020-04-22T14:19:36.353 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:19:36.353 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:19:36.353 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:19:36.353 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:19:36.353 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:19:36.354 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.503590+0000", 2020-04-22T14:19:36.354 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:19:36.354 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.354 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.354 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 2, 2020-04-22T14:19:36.354 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:19:36.354 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:19:36.355 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:19:36.355 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:19:36.355 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:19:36.355 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.525058+0000", 2020-04-22T14:19:36.355 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:19:36.355 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.355 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.355 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 3, 2020-04-22T14:19:36.356 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:19:36.356 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:19:36.356 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:19:36.356 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:19:36.356 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:19:36.356 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.599729+0000", 2020-04-22T14:19:36.356 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:19:36.357 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.357 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.357 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 4, 2020-04-22T14:19:36.357 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:19:36.357 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:19:36.357 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:19:36.357 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:19:36.357 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:19:36.358 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.600919+0000", 2020-04-22T14:19:36.358 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:19:36.358 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.358 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.358 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 5, 2020-04-22T14:19:36.358 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:19:36.358 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:19:36.358 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:19:36.359 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:19:36.359 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:19:36.359 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.654718+0000", 2020-04-22T14:19:36.359 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:19:36.359 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.359 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.359 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 6, 2020-04-22T14:19:36.360 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:19:36.360 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:19:36.360 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:19:36.360 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:19:36.360 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:19:36.360 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.718342+0000", 2020-04-22T14:19:36.360 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:19:36.361 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.361 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:36.361 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 7, 2020-04-22T14:19:36.361 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:19:36.361 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:19:36.361 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:19:36.361 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:19:36.361 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:19:36.362 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.839089+0000", 2020-04-22T14:19:36.362 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:19:36.362 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.362 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:19:36.362 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_upmap": [], 2020-04-22T14:19:36.362 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_upmap_items": [], 2020-04-22T14:19:36.362 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_temp": [], 2020-04-22T14:19:36.362 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_temp": [], 2020-04-22T14:19:36.363 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklist": { 2020-04-22T14:19:36.363 INFO:teuthology.orchestra.run.smithi103.stdout: "192.168.0.1:0/1609098406": "2020-04-22T15:19:08.684170+0000" 2020-04-22T14:19:36.363 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.363 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profiles": { 2020-04-22T14:19:36.363 INFO:teuthology.orchestra.run.smithi103.stdout: "default": { 2020-04-22T14:19:36.363 INFO:teuthology.orchestra.run.smithi103.stdout: "crush-failure-domain": "osd", 2020-04-22T14:19:36.363 INFO:teuthology.orchestra.run.smithi103.stdout: "k": "2", 2020-04-22T14:19:36.364 INFO:teuthology.orchestra.run.smithi103.stdout: "m": "1", 2020-04-22T14:19:36.364 INFO:teuthology.orchestra.run.smithi103.stdout: "plugin": "jerasure", 2020-04-22T14:19:36.364 INFO:teuthology.orchestra.run.smithi103.stdout: "ruleset-failure-domain": "osd", 2020-04-22T14:19:36.364 INFO:teuthology.orchestra.run.smithi103.stdout: "technique": "reed_sol_van" 2020-04-22T14:19:36.364 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:36.364 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:36.364 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps_queue": [], 2020-04-22T14:19:36.365 INFO:teuthology.orchestra.run.smithi103.stdout: "new_removed_snaps": [], 2020-04-22T14:19:36.365 INFO:teuthology.orchestra.run.smithi103.stdout: "new_purged_snaps": [], 2020-04-22T14:19:36.365 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_node_flags": {}, 2020-04-22T14:19:36.365 INFO:teuthology.orchestra.run.smithi103.stdout: "device_class_flags": {} 2020-04-22T14:19:36.365 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:19:36.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.205+0000 7f9b80942700 1 -- 172.21.15.103:0/4074687008 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9b6004d870 msgr2=0x7f9b6004fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:36.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.205+0000 7f9b80942700 1 --2- 172.21.15.103:0/4074687008 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9b6004d870 0x7f9b6004fd30 secure :-1 s=READY pgs=723 cs=0 l=1 rx=0x7f9b64001cb0 tx=0x7f9b6400d290).stop 2020-04-22T14:19:36.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.205+0000 7f9b80942700 1 -- 172.21.15.103:0/4074687008 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b7c0620a0 msgr2=0x7f9b7c0b4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:36.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.205+0000 7f9b80942700 1 --2- 172.21.15.103:0/4074687008 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b7c0620a0 0x7f9b7c0b4150 secure :-1 s=READY pgs=182 cs=0 l=1 rx=0x7f9b64001bf0 tx=0x7f9b74007a40).stop 2020-04-22T14:19:36.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.205+0000 7f9b80942700 1 -- 172.21.15.103:0/4074687008 shutdown_connections 2020-04-22T14:19:36.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.205+0000 7f9b80942700 1 --2- 172.21.15.103:0/4074687008 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b7c0620a0 0x7f9b7c0b4150 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:36.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.205+0000 7f9b80942700 1 --2- 172.21.15.103:0/4074687008 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9b6004d870 0x7f9b6004fd30 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:36.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.205+0000 7f9b80942700 1 --2- 172.21.15.103:0/4074687008 >> v2:172.21.15.86:3300/0 conn(0x7f9b7c0ad900 0x7f9b7c13cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:36.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.205+0000 7f9b80942700 1 -- 172.21.15.103:0/4074687008 >> 172.21.15.103:0/4074687008 conn(0x7f9b7c05b7c0 msgr2=0x7f9b7c0b7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:36.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.205+0000 7f9b80942700 1 -- 172.21.15.103:0/4074687008 shutdown_connections 2020-04-22T14:19:36.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.205+0000 7f9b80942700 1 -- 172.21.15.103:0/4074687008 wait complete. 2020-04-22T14:19:36.369 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:36.383 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:19:36.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.528+0000 7ffb2f0a4700 1 Processor -- start 2020-04-22T14:19:36.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.528+0000 7ffb2f0a4700 1 -- start start 2020-04-22T14:19:36.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.529+0000 7ffb2f0a4700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffb28140320 0x7ffb280ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:36.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.529+0000 7ffb2f0a4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb280bd1b0 0x7ffb280bd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:36.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.529+0000 7ffb2f0a4700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb2814a740 con 0x7ffb2814a2b0 2020-04-22T14:19:36.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.529+0000 7ffb2f0a4700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb281462f0 con 0x7ffb28140320 2020-04-22T14:19:36.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.529+0000 7ffb2f0a4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb28146590 con 0x7ffb280bd1b0 2020-04-22T14:19:36.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.529+0000 7ffb2ce40700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffb28140320 0x7ffb280ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:36.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.529+0000 7ffb2ce40700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffb28140320 0x7ffb280ae1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58034/0 (socket says 172.21.15.103:58034) 2020-04-22T14:19:36.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.529+0000 7ffb2ce40700 1 -- 172.21.15.103:0/2341941448 learned_addr learned my addr 172.21.15.103:0/2341941448 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:19:36.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.529+0000 7ffb2d641700 1 --2- 172.21.15.103:0/2341941448 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb280bd1b0 0x7ffb280bd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:36.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.529+0000 7ffb2ce40700 1 -- 172.21.15.103:0/2341941448 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb280bd1b0 msgr2=0x7ffb280bd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:36.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.529+0000 7ffb2ce40700 1 --2- 172.21.15.103:0/2341941448 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb280bd1b0 0x7ffb280bd640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:36.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.529+0000 7ffb2ce40700 1 -- 172.21.15.103:0/2341941448 >> v1:172.21.15.86:6789/0 conn(0x7ffb2814a2b0 legacy=0x7ffb28146cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:36.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.529+0000 7ffb2ce40700 1 -- 172.21.15.103:0/2341941448 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb28146830 con 0x7ffb28140320 2020-04-22T14:19:36.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.529+0000 7ffb2ce40700 1 --2- 172.21.15.103:0/2341941448 >> v2:172.21.15.103:3300/0 conn(0x7ffb28140320 0x7ffb280ae1a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ffb28061590 tx=0x7ffb20007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.529+0000 7ffb2ce40700 1 --2- 172.21.15.103:0/2341941448 >> v2:172.21.15.103:3300/0 conn(0x7ffb28140320 0x7ffb280ae1a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ffb28061590 tx=0x7ffb20007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.529+0000 7ffb2ce40700 1 --2- 172.21.15.103:0/2341941448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb28140320 0x7ffb280ae1a0 secure :-1 s=READY pgs=1993 cs=0 l=1 rx=0x7ffb28061590 tx=0x7ffb20007dc0).ready entity=mon.1 client_cookie=6ed9545040f90912 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:36.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.529+0000 7ffb2ce40700 1 --2- 172.21.15.103:0/2341941448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb28140320 0x7ffb280ae1a0 secure :-1 s=THROTTLE_DONE pgs=1993 cs=0 l=1 rx=0x7ffb28061590 tx=0x7ffb20007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.529+0000 7ffb277fe700 1 -- 172.21.15.103:0/2341941448 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb2000a180 con 0x7ffb28140320 2020-04-22T14:19:36.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.529+0000 7ffb2ce40700 1 --2- 172.21.15.103:0/2341941448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb28140320 0x7ffb280ae1a0 secure :-1 s=THROTTLE_DONE pgs=1993 cs=0 l=1 rx=0x7ffb28061590 tx=0x7ffb20007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.529+0000 7ffb2ce40700 1 --2- 172.21.15.103:0/2341941448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb28140320 0x7ffb280ae1a0 secure :-1 s=THROTTLE_DONE pgs=1993 cs=0 l=1 rx=0x7ffb28061590 tx=0x7ffb20007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.529+0000 7ffb277fe700 1 -- 172.21.15.103:0/2341941448 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2000a2e0 con 0x7ffb28140320 2020-04-22T14:19:36.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.529+0000 7ffb277fe700 1 -- 172.21.15.103:0/2341941448 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb2000a700 con 0x7ffb28140320 2020-04-22T14:19:36.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.529+0000 7ffb2f0a4700 1 -- 172.21.15.103:0/2341941448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb28140320 msgr2=0x7ffb280ae1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:36.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.529+0000 7ffb2f0a4700 1 --2- 172.21.15.103:0/2341941448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb28140320 0x7ffb280ae1a0 secure :-1 s=READY pgs=1993 cs=0 l=1 rx=0x7ffb28061590 tx=0x7ffb20007dc0).stop 2020-04-22T14:19:36.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.530+0000 7ffb2f0a4700 1 -- 172.21.15.103:0/2341941448 shutdown_connections 2020-04-22T14:19:36.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.530+0000 7ffb2f0a4700 1 --2- 172.21.15.103:0/2341941448 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb280bd1b0 0x7ffb280bd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:36.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.530+0000 7ffb2f0a4700 1 --2- 172.21.15.103:0/2341941448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb28140320 0x7ffb280ae1a0 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:36.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.530+0000 7ffb2f0a4700 1 -- 172.21.15.103:0/2341941448 >> 172.21.15.103:0/2341941448 conn(0x7ffb2805f2c0 msgr2=0x7ffb280bcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:36.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.530+0000 7ffb2f0a4700 1 -- 172.21.15.103:0/2341941448 shutdown_connections 2020-04-22T14:19:36.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.530+0000 7ffb2f0a4700 1 -- 172.21.15.103:0/2341941448 wait complete. 2020-04-22T14:19:36.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.531+0000 7ffb2f0a4700 1 Processor -- start 2020-04-22T14:19:36.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.531+0000 7ffb2f0a4700 1 -- start start 2020-04-22T14:19:36.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.532+0000 7ffb2f0a4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb280bd1b0 0x7ffb28143710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:36.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.532+0000 7ffb2f0a4700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ffb2814a2b0 0x7ffb28140a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:36.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.532+0000 7ffb2f0a4700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb281581a0 con 0x7ffb28140320 2020-04-22T14:19:36.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.532+0000 7ffb2f0a4700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb28140ee0 con 0x7ffb2814a2b0 2020-04-22T14:19:36.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.532+0000 7ffb2f0a4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb280af990 con 0x7ffb280bd1b0 2020-04-22T14:19:36.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.532+0000 7ffb2d641700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ffb2814a2b0 0x7ffb28140a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:36.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.532+0000 7ffb2ce40700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb280bd1b0 0x7ffb28143710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:36.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.532+0000 7ffb2ce40700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb280bd1b0 0x7ffb28143710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:42818/0 (socket says 172.21.15.103:42818) 2020-04-22T14:19:36.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.532+0000 7ffb2ce40700 1 -- 172.21.15.103:0/3912477770 learned_addr learned my addr 172.21.15.103:0/3912477770 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:19:36.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.532+0000 7ffb2ce40700 1 -- 172.21.15.103:0/3912477770 >> v2:172.21.15.86:3300/0 conn(0x7ffb2814a2b0 msgr2=0x7ffb28140a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:36.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.532+0000 7ffb2ce40700 1 --2- 172.21.15.103:0/3912477770 >> v2:172.21.15.86:3300/0 conn(0x7ffb2814a2b0 0x7ffb28140a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:36.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.532+0000 7ffb2ce40700 1 -- 172.21.15.103:0/3912477770 >> v1:172.21.15.86:6789/0 conn(0x7ffb28140320 legacy=0x7ffb280b00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:36.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.532+0000 7ffb2ce40700 1 -- 172.21.15.103:0/3912477770 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb280afc30 con 0x7ffb280bd1b0 2020-04-22T14:19:36.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.532+0000 7ffb2ce40700 1 --2- 172.21.15.103:0/3912477770 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb280bd1b0 0x7ffb28143710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffb28061590 tx=0x7ffb20007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.532+0000 7ffb2ce40700 1 --2- 172.21.15.103:0/3912477770 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb280bd1b0 0x7ffb28143710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffb28061590 tx=0x7ffb20007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.532+0000 7ffb2ce40700 1 --2- 172.21.15.103:0/3912477770 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb280bd1b0 0x7ffb28143710 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7ffb28061590 tx=0x7ffb20007dc0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:36.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.532+0000 7ffb2ce40700 1 --2- 172.21.15.103:0/3912477770 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb280bd1b0 0x7ffb28143710 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7ffb28061590 tx=0x7ffb20007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.533+0000 7ffb25ffb700 1 -- 172.21.15.103:0/3912477770 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb20005c30 con 0x7ffb280bd1b0 2020-04-22T14:19:36.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.533+0000 7ffb2ce40700 1 --2- 172.21.15.103:0/3912477770 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb280bd1b0 0x7ffb28143710 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7ffb28061590 tx=0x7ffb20007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.533+0000 7ffb2ce40700 1 --2- 172.21.15.103:0/3912477770 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb280bd1b0 0x7ffb28143710 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7ffb28061590 tx=0x7ffb20007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.533+0000 7ffb25ffb700 1 -- 172.21.15.103:0/3912477770 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb20005d90 con 0x7ffb280bd1b0 2020-04-22T14:19:36.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.533+0000 7ffb25ffb700 1 -- 172.21.15.103:0/3912477770 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb20007360 con 0x7ffb280bd1b0 2020-04-22T14:19:36.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.533+0000 7ffb2f0a4700 1 -- 172.21.15.103:0/3912477770 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb280b07e0 con 0x7ffb280bd1b0 2020-04-22T14:19:36.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.533+0000 7ffb2f0a4700 1 -- 172.21.15.103:0/3912477770 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb28157d00 con 0x7ffb280bd1b0 2020-04-22T14:19:36.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.533+0000 7ffb2ce40700 1 --2- 172.21.15.103:0/3912477770 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb280bd1b0 0x7ffb28143710 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7ffb28061590 tx=0x7ffb20007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.534+0000 7ffb2f0a4700 1 -- 172.21.15.103:0/3912477770 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb28056c90 con 0x7ffb280bd1b0 2020-04-22T14:19:36.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.534+0000 7ffb25ffb700 1 -- 172.21.15.103:0/3912477770 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ffb20007560 con 0x7ffb280bd1b0 2020-04-22T14:19:36.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.534+0000 7ffb2ce40700 1 --2- 172.21.15.103:0/3912477770 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb280bd1b0 0x7ffb28143710 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7ffb28061590 tx=0x7ffb20007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.534+0000 7ffb25ffb700 1 --2- 172.21.15.103:0/3912477770 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffb0804d900 0x7ffb0804fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:36.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.534+0000 7ffb25ffb700 1 -- 172.21.15.103:0/3912477770 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6116+0+0 (secure 0 0 0) 0x7ffb20062370 con 0x7ffb280bd1b0 2020-04-22T14:19:36.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.534+0000 7ffb27fff700 1 --2- 172.21.15.103:0/3912477770 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffb0804d900 0x7ffb0804fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:36.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.534+0000 7ffb27fff700 1 --2- 172.21.15.103:0/3912477770 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffb0804d900 0x7ffb0804fdc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffb280b1ec0 tx=0x7ffb1c001530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.534+0000 7ffb27fff700 1 --2- 172.21.15.103:0/3912477770 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffb0804d900 0x7ffb0804fdc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffb280b1ec0 tx=0x7ffb1c001530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.534+0000 7ffb27fff700 1 --2- 172.21.15.103:0/3912477770 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffb0804d900 0x7ffb0804fdc0 secure :-1 s=READY pgs=724 cs=0 l=1 rx=0x7ffb280b1ec0 tx=0x7ffb1c001530).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:36.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.538+0000 7ffb2ce40700 1 --2- 172.21.15.103:0/3912477770 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb280bd1b0 0x7ffb28143710 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7ffb28061590 tx=0x7ffb20007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.538+0000 7ffb25ffb700 1 -- 172.21.15.103:0/3912477770 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ffb2003d870 con 0x7ffb280bd1b0 2020-04-22T14:19:36.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.735+0000 7ffb2f0a4700 1 -- 172.21.15.103:0/3912477770 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb2805cc80 con 0x7ffb280bd1b0 2020-04-22T14:19:36.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.736+0000 7ffb2ce40700 1 --2- 172.21.15.103:0/3912477770 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb280bd1b0 0x7ffb28143710 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7ffb28061590 tx=0x7ffb20007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.738 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.736+0000 7ffb25ffb700 1 -- 172.21.15.103:0/3912477770 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+2141 (secure 0 0 0) 0x7ffb20040e90 con 0x7ffb280bd1b0 2020-04-22T14:19:36.738 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:19:36.739 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":101,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6539,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1045362246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1045362246},{"type":"v1","addr":"172.21.15.86:6835","nonce":1045362246}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":97}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:17:48.006467+0000","modified":"2020-04-22T14:17:50.019789+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9277":{"gid":9277,"name":"a","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/33849566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":33849566},{"type":"v1","addr":"172.21.15.103:6833","nonce":33849566}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2020-04-22T14:19:36.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.737+0000 7ffb2f0a4700 1 -- 172.21.15.103:0/3912477770 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffb0804d900 msgr2=0x7ffb0804fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:36.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.737+0000 7ffb2f0a4700 1 --2- 172.21.15.103:0/3912477770 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffb0804d900 0x7ffb0804fdc0 secure :-1 s=READY pgs=724 cs=0 l=1 rx=0x7ffb280b1ec0 tx=0x7ffb1c001530).stop 2020-04-22T14:19:36.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.737+0000 7ffb2f0a4700 1 -- 172.21.15.103:0/3912477770 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb280bd1b0 msgr2=0x7ffb28143710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:36.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.737+0000 7ffb2f0a4700 1 --2- 172.21.15.103:0/3912477770 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb280bd1b0 0x7ffb28143710 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7ffb28061590 tx=0x7ffb20007dc0).stop 2020-04-22T14:19:36.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.738+0000 7ffb2f0a4700 1 -- 172.21.15.103:0/3912477770 shutdown_connections 2020-04-22T14:19:36.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.738+0000 7ffb2f0a4700 1 --2- 172.21.15.103:0/3912477770 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffb0804d900 0x7ffb0804fdc0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:36.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.738+0000 7ffb2f0a4700 1 --2- 172.21.15.103:0/3912477770 >> v2:172.21.15.86:3300/0 conn(0x7ffb2814a2b0 0x7ffb28140a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:36.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.738+0000 7ffb2f0a4700 1 --2- 172.21.15.103:0/3912477770 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffb280bd1b0 0x7ffb28143710 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:36.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.738+0000 7ffb2f0a4700 1 -- 172.21.15.103:0/3912477770 >> 172.21.15.103:0/3912477770 conn(0x7ffb2805f2c0 msgr2=0x7ffb280acaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:36.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.738+0000 7ffb2f0a4700 1 -- 172.21.15.103:0/3912477770 shutdown_connections 2020-04-22T14:19:36.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.738+0000 7ffb2f0a4700 1 -- 172.21.15.103:0/3912477770 wait complete. 2020-04-22T14:19:36.742 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 101 2020-04-22T14:19:36.754 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:36.767 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2020-04-22T14:19:36.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.912+0000 7fd62b112700 1 Processor -- start 2020-04-22T14:19:36.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.912+0000 7fd62b112700 1 -- start start 2020-04-22T14:19:36.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.913+0000 7fd62b112700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd624067110 0x7fd6240aee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:36.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.913+0000 7fd62b112700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd624142690 0x7fd624142af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:36.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.913+0000 7fd62b112700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd6240ac740 0x7fd6240acbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:36.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.913+0000 7fd62b112700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd624142f50 con 0x7fd6240ac740 2020-04-22T14:19:36.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.913+0000 7fd62b112700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6240afb20 con 0x7fd624142690 2020-04-22T14:19:36.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.913+0000 7fd62b112700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6240afdc0 con 0x7fd624067110 2020-04-22T14:19:36.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.914+0000 7fd62990f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd624142690 0x7fd624142af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:36.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.914+0000 7fd62990f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd624142690 0x7fd624142af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58050/0 (socket says 172.21.15.103:58050) 2020-04-22T14:19:36.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.914+0000 7fd62990f700 1 -- 172.21.15.103:0/712810756 learned_addr learned my addr 172.21.15.103:0/712810756 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:19:36.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.914+0000 7fd62a911700 1 --2- 172.21.15.103:0/712810756 >> v2:172.21.15.86:3300/0 conn(0x7fd6240ac740 0x7fd6240acbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:36.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.914+0000 7fd62a110700 1 --2- 172.21.15.103:0/712810756 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd624067110 0x7fd6240aee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:36.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.914+0000 7fd62990f700 1 -- 172.21.15.103:0/712810756 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd624067110 msgr2=0x7fd6240aee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:36.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.914+0000 7fd62990f700 1 --2- 172.21.15.103:0/712810756 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd624067110 0x7fd6240aee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:36.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.914+0000 7fd62990f700 1 -- 172.21.15.103:0/712810756 >> v2:172.21.15.86:3300/0 conn(0x7fd6240ac740 msgr2=0x7fd6240acbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:36.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.914+0000 7fd62990f700 1 --2- 172.21.15.103:0/712810756 >> v2:172.21.15.86:3300/0 conn(0x7fd6240ac740 0x7fd6240acbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:36.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.914+0000 7fd62990f700 1 -- 172.21.15.103:0/712810756 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6240b0060 con 0x7fd624142690 2020-04-22T14:19:36.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.914+0000 7fd62990f700 1 --2- 172.21.15.103:0/712810756 >> v2:172.21.15.103:3300/0 conn(0x7fd624142690 0x7fd624142af0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd620002f30 tx=0x7fd620007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.914+0000 7fd62990f700 1 --2- 172.21.15.103:0/712810756 >> v2:172.21.15.103:3300/0 conn(0x7fd624142690 0x7fd624142af0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd620002f30 tx=0x7fd620007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.914+0000 7fd62990f700 1 --2- 172.21.15.103:0/712810756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd624142690 0x7fd624142af0 secure :-1 s=READY pgs=1994 cs=0 l=1 rx=0x7fd620002f30 tx=0x7fd620007a40).ready entity=mon.1 client_cookie=3165a5bacb314f06 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:36.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.914+0000 7fd62990f700 1 --2- 172.21.15.103:0/712810756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd624142690 0x7fd624142af0 secure :-1 s=THROTTLE_DONE pgs=1994 cs=0 l=1 rx=0x7fd620002f30 tx=0x7fd620007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.914+0000 7fd62990f700 1 --2- 172.21.15.103:0/712810756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd624142690 0x7fd624142af0 secure :-1 s=THROTTLE_DONE pgs=1994 cs=0 l=1 rx=0x7fd620002f30 tx=0x7fd620007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.914+0000 7fd62910e700 1 -- 172.21.15.103:0/712810756 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd620011720 con 0x7fd624142690 2020-04-22T14:19:36.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.914+0000 7fd62990f700 1 --2- 172.21.15.103:0/712810756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd624142690 0x7fd624142af0 secure :-1 s=THROTTLE_DONE pgs=1994 cs=0 l=1 rx=0x7fd620002f30 tx=0x7fd620007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.914+0000 7fd62910e700 1 -- 172.21.15.103:0/712810756 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd620011880 con 0x7fd624142690 2020-04-22T14:19:36.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.914+0000 7fd62910e700 1 -- 172.21.15.103:0/712810756 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd620011ca0 con 0x7fd624142690 2020-04-22T14:19:36.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.914+0000 7fd62b112700 1 -- 172.21.15.103:0/712810756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd624142690 msgr2=0x7fd624142af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:36.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.914+0000 7fd62b112700 1 --2- 172.21.15.103:0/712810756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd624142690 0x7fd624142af0 secure :-1 s=READY pgs=1994 cs=0 l=1 rx=0x7fd620002f30 tx=0x7fd620007a40).stop 2020-04-22T14:19:36.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.915+0000 7fd62b112700 1 -- 172.21.15.103:0/712810756 shutdown_connections 2020-04-22T14:19:36.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.915+0000 7fd62b112700 1 --2- 172.21.15.103:0/712810756 >> v2:172.21.15.86:3300/0 conn(0x7fd6240ac740 0x7fd6240acbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:36.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.915+0000 7fd62b112700 1 --2- 172.21.15.103:0/712810756 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd624067110 0x7fd6240aee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:36.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.915+0000 7fd62b112700 1 --2- 172.21.15.103:0/712810756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd624142690 0x7fd624142af0 unknown :-1 s=CLOSED pgs=1994 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:36.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.915+0000 7fd62b112700 1 -- 172.21.15.103:0/712810756 >> 172.21.15.103:0/712810756 conn(0x7fd62405ad30 msgr2=0x7fd62405b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:36.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.915+0000 7fd62b112700 1 -- 172.21.15.103:0/712810756 shutdown_connections 2020-04-22T14:19:36.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.915+0000 7fd62b112700 1 -- 172.21.15.103:0/712810756 wait complete. 2020-04-22T14:19:36.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.916+0000 7fd62b112700 1 Processor -- start 2020-04-22T14:19:36.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.916+0000 7fd62b112700 1 -- start start 2020-04-22T14:19:36.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.916+0000 7fd62b112700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd624067110 0x7fd624143090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:36.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.916+0000 7fd62b112700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd624142690 0x7fd624144000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:36.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.916+0000 7fd62b112700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd62413e580 con 0x7fd6240ac740 2020-04-22T14:19:36.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.916+0000 7fd62b112700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd624144460 con 0x7fd624067110 2020-04-22T14:19:36.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.916+0000 7fd62b112700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd62413e820 con 0x7fd624142690 2020-04-22T14:19:36.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.917+0000 7fd62990f700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd6240ac740 0x7fd6241457f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50244/0 (socket says 172.21.15.103:50244) 2020-04-22T14:19:36.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.917+0000 7fd62990f700 1 -- 172.21.15.103:0/1373974364 learned_addr learned my addr 172.21.15.103:0/1373974364 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:36.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.917+0000 7fd62a911700 1 --2- 172.21.15.103:0/1373974364 >> v2:172.21.15.103:3300/0 conn(0x7fd624142690 0x7fd624144000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:36.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.917+0000 7fd62a110700 1 --2- 172.21.15.103:0/1373974364 >> v2:172.21.15.86:3300/0 conn(0x7fd624067110 0x7fd624143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:36.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.917+0000 7fd6137fe700 1 -- 172.21.15.103:0/1373974364 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2140675856 0 0) 0x7fd62413e580 con 0x7fd6240ac740 2020-04-22T14:19:36.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.917+0000 7fd6137fe700 1 -- 172.21.15.103:0/1373974364 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd604002fe0 con 0x7fd6240ac740 2020-04-22T14:19:36.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.917+0000 7fd62a911700 1 -- 172.21.15.103:0/1373974364 >> v2:172.21.15.86:3300/0 conn(0x7fd624067110 msgr2=0x7fd624143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:36.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.917+0000 7fd62a911700 1 --2- 172.21.15.103:0/1373974364 >> v2:172.21.15.86:3300/0 conn(0x7fd624067110 0x7fd624143090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:36.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.917+0000 7fd62a911700 1 -- 172.21.15.103:0/1373974364 >> v1:172.21.15.103:6789/0 conn(0x7fd6240ac740 legacy=0x7fd6241457f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:36.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.917+0000 7fd62a911700 1 -- 172.21.15.103:0/1373974364 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd62413eac0 con 0x7fd624142690 2020-04-22T14:19:36.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.917+0000 7fd62a911700 1 --2- 172.21.15.103:0/1373974364 >> v2:172.21.15.103:3300/0 conn(0x7fd624142690 0x7fd624144000 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd61c0032b0 tx=0x7fd61c010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.917+0000 7fd62a911700 1 --2- 172.21.15.103:0/1373974364 >> v2:172.21.15.103:3300/0 conn(0x7fd624142690 0x7fd624144000 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd61c0032b0 tx=0x7fd61c010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.917+0000 7fd62a911700 1 --2- 172.21.15.103:0/1373974364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd624142690 0x7fd624144000 secure :-1 s=READY pgs=1996 cs=0 l=1 rx=0x7fd61c0032b0 tx=0x7fd61c010dd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:36.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.917+0000 7fd62a911700 1 --2- 172.21.15.103:0/1373974364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd624142690 0x7fd624144000 secure :-1 s=THROTTLE_DONE pgs=1996 cs=0 l=1 rx=0x7fd61c0032b0 tx=0x7fd61c010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.917+0000 7fd6137fe700 1 -- 172.21.15.103:0/1373974364 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd61c005e30 con 0x7fd624142690 2020-04-22T14:19:36.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.917+0000 7fd62a911700 1 --2- 172.21.15.103:0/1373974364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd624142690 0x7fd624144000 secure :-1 s=THROTTLE_DONE pgs=1996 cs=0 l=1 rx=0x7fd61c0032b0 tx=0x7fd61c010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.917+0000 7fd62a911700 1 --2- 172.21.15.103:0/1373974364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd624142690 0x7fd624144000 secure :-1 s=THROTTLE_DONE pgs=1996 cs=0 l=1 rx=0x7fd61c0032b0 tx=0x7fd61c010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.917+0000 7fd6137fe700 1 -- 172.21.15.103:0/1373974364 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd61c007560 con 0x7fd624142690 2020-04-22T14:19:36.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.917+0000 7fd62b112700 1 -- 172.21.15.103:0/1373974364 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd624145f00 con 0x7fd624142690 2020-04-22T14:19:36.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.917+0000 7fd6137fe700 1 -- 172.21.15.103:0/1373974364 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd61c007900 con 0x7fd624142690 2020-04-22T14:19:36.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.917+0000 7fd62b112700 1 -- 172.21.15.103:0/1373974364 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd62413adf0 con 0x7fd624142690 2020-04-22T14:19:36.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.918+0000 7fd62a911700 1 --2- 172.21.15.103:0/1373974364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd624142690 0x7fd624144000 secure :-1 s=THROTTLE_DONE pgs=1996 cs=0 l=1 rx=0x7fd61c0032b0 tx=0x7fd61c010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.918+0000 7fd6137fe700 1 -- 172.21.15.103:0/1373974364 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fd61c0101a0 con 0x7fd624142690 2020-04-22T14:19:36.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.918+0000 7fd62a911700 1 --2- 172.21.15.103:0/1373974364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd624142690 0x7fd624144000 secure :-1 s=THROTTLE_DONE pgs=1996 cs=0 l=1 rx=0x7fd61c0032b0 tx=0x7fd61c010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.918+0000 7fd62b112700 1 -- 172.21.15.103:0/1373974364 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd624056c90 con 0x7fd624142690 2020-04-22T14:19:36.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.918+0000 7fd6137fe700 1 --2- 172.21.15.103:0/1373974364 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd60404dd10 0x7fd6040501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:36.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.918+0000 7fd6137fe700 1 -- 172.21.15.103:0/1373974364 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fd61c0615d0 con 0x7fd624142690 2020-04-22T14:19:36.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.919+0000 7fd62a110700 1 --2- 172.21.15.103:0/1373974364 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd60404dd10 0x7fd6040501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:36.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.919+0000 7fd62a110700 1 --2- 172.21.15.103:0/1373974364 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd60404dd10 0x7fd6040501d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd614002f30 tx=0x7fd61400d680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.919+0000 7fd62a110700 1 --2- 172.21.15.103:0/1373974364 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd60404dd10 0x7fd6040501d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd614002f30 tx=0x7fd61400d680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.919+0000 7fd62a110700 1 --2- 172.21.15.103:0/1373974364 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd60404dd10 0x7fd6040501d0 secure :-1 s=READY pgs=725 cs=0 l=1 rx=0x7fd614002f30 tx=0x7fd61400d680).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:36.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.923+0000 7fd62a911700 1 --2- 172.21.15.103:0/1373974364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd624142690 0x7fd624144000 secure :-1 s=THROTTLE_DONE pgs=1996 cs=0 l=1 rx=0x7fd61c0032b0 tx=0x7fd61c010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:36.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:36.923+0000 7fd6137fe700 1 -- 172.21.15.103:0/1373974364 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fd61c03c9b0 con 0x7fd624142690 2020-04-22T14:19:37.114 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.112+0000 7fd62b112700 1 -- 172.21.15.103:0/1373974364 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd6240b2950 con 0x7fd624142690 2020-04-22T14:19:37.646 INFO:tasks.ceph.mon.b.smithi086.stderr:2020-04-22T14:19:37.643+0000 7fbdbf880700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-04-22T14:19:37.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.650+0000 7fd62a911700 1 --2- 172.21.15.103:0/1373974364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd624142690 0x7fd624144000 secure :-1 s=THROTTLE_DONE pgs=1996 cs=0 l=1 rx=0x7fd61c0032b0 tx=0x7fd61c010dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:37.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.650+0000 7fd6137fe700 1 -- 172.21.15.103:0/1373974364 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v102) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd61c03ffd0 con 0x7fd624142690 2020-04-22T14:19:37.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.652+0000 7fd62b112700 1 -- 172.21.15.103:0/1373974364 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd60404dd10 msgr2=0x7fd6040501d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:37.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.652+0000 7fd62b112700 1 --2- 172.21.15.103:0/1373974364 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd60404dd10 0x7fd6040501d0 secure :-1 s=READY pgs=725 cs=0 l=1 rx=0x7fd614002f30 tx=0x7fd61400d680).stop 2020-04-22T14:19:37.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.652+0000 7fd62b112700 1 -- 172.21.15.103:0/1373974364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd624142690 msgr2=0x7fd624144000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:37.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.652+0000 7fd62b112700 1 --2- 172.21.15.103:0/1373974364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd624142690 0x7fd624144000 secure :-1 s=READY pgs=1996 cs=0 l=1 rx=0x7fd61c0032b0 tx=0x7fd61c010dd0).stop 2020-04-22T14:19:37.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.652+0000 7fd62b112700 1 -- 172.21.15.103:0/1373974364 shutdown_connections 2020-04-22T14:19:37.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.652+0000 7fd62b112700 1 --2- 172.21.15.103:0/1373974364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd624142690 0x7fd624144000 unknown :-1 s=CLOSED pgs=1996 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:37.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.652+0000 7fd62b112700 1 --2- 172.21.15.103:0/1373974364 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd60404dd10 0x7fd6040501d0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:37.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.652+0000 7fd62b112700 1 --2- 172.21.15.103:0/1373974364 >> v2:172.21.15.86:3300/0 conn(0x7fd624067110 0x7fd624143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:37.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.653+0000 7fd62b112700 1 -- 172.21.15.103:0/1373974364 >> 172.21.15.103:0/1373974364 conn(0x7fd62405ad30 msgr2=0x7fd6240b3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:37.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.653+0000 7fd62b112700 1 -- 172.21.15.103:0/1373974364 shutdown_connections 2020-04-22T14:19:37.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.653+0000 7fd62b112700 1 -- 172.21.15.103:0/1373974364 wait complete. 2020-04-22T14:19:37.657 INFO:teuthology.orchestra.run.smithi103.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2020-04-22T14:19:37.668 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:37.680 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2020-04-22T14:19:37.684 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:19:37.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.832+0000 7f452ee0f700 1 Processor -- start 2020-04-22T14:19:37.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.832+0000 7f452ee0f700 1 -- start start 2020-04-22T14:19:37.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.832+0000 7f452ee0f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f45280b6040 0x7f45280ac740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:37.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.832+0000 7f452ee0f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f45281426d0 0x7f4528142b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:37.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.832+0000 7f452ee0f700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4528064ec0 con 0x7f4528067170 2020-04-22T14:19:37.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.832+0000 7f452ee0f700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4528065af0 con 0x7f45281426d0 2020-04-22T14:19:37.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.832+0000 7f452ee0f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4528146870 con 0x7f45280b6040 2020-04-22T14:19:37.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.833+0000 7f4527fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f45280b6040 0x7f45280ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:37.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.833+0000 7f452cbab700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f4528067170 0x7f452813c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50268/0 (socket says 172.21.15.103:50268) 2020-04-22T14:19:37.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.833+0000 7f452cbab700 1 -- 172.21.15.103:0/2585509325 learned_addr learned my addr 172.21.15.103:0/2585509325 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:37.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.833+0000 7f452d3ac700 1 --2- 172.21.15.103:0/2585509325 >> v2:172.21.15.86:3300/0 conn(0x7f45281426d0 0x7f4528142b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:37.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.833+0000 7f4527fff700 1 -- 172.21.15.103:0/2585509325 >> v2:172.21.15.86:3300/0 conn(0x7f45281426d0 msgr2=0x7f4528142b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:37.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.833+0000 7f4527fff700 1 --2- 172.21.15.103:0/2585509325 >> v2:172.21.15.86:3300/0 conn(0x7f45281426d0 0x7f4528142b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:37.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.833+0000 7f4527fff700 1 -- 172.21.15.103:0/2585509325 >> v1:172.21.15.103:6789/0 conn(0x7f4528067170 legacy=0x7f452813c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:37.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.833+0000 7f4527fff700 1 -- 172.21.15.103:0/2585509325 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4528067550 con 0x7f45280b6040 2020-04-22T14:19:37.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.833+0000 7f45277fe700 1 -- 172.21.15.103:0/2585509325 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3569019358 0 0) 0x7f4528064ec0 con 0x7f4528067170 2020-04-22T14:19:37.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.833+0000 7f4527fff700 1 --2- 172.21.15.103:0/2585509325 >> v2:172.21.15.103:3300/0 conn(0x7f45280b6040 0x7f45280ac740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4528066db0 tx=0x7f451c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:37.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.833+0000 7f4527fff700 1 --2- 172.21.15.103:0/2585509325 >> v2:172.21.15.103:3300/0 conn(0x7f45280b6040 0x7f45280ac740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4528066db0 tx=0x7f451c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:37.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.833+0000 7f4527fff700 1 --2- 172.21.15.103:0/2585509325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45280b6040 0x7f45280ac740 secure :-1 s=READY pgs=2002 cs=0 l=1 rx=0x7f4528066db0 tx=0x7f451c007a40).ready entity=mon.1 client_cookie=8ef5f0e22d5da583 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:37.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.833+0000 7f4527fff700 1 --2- 172.21.15.103:0/2585509325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45280b6040 0x7f45280ac740 secure :-1 s=THROTTLE_DONE pgs=2002 cs=0 l=1 rx=0x7f4528066db0 tx=0x7f451c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:37.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.833+0000 7f45277fe700 1 -- 172.21.15.103:0/2585509325 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f451c011430 con 0x7f45280b6040 2020-04-22T14:19:37.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.833+0000 7f4527fff700 1 --2- 172.21.15.103:0/2585509325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45280b6040 0x7f45280ac740 secure :-1 s=THROTTLE_DONE pgs=2002 cs=0 l=1 rx=0x7f4528066db0 tx=0x7f451c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:37.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.833+0000 7f45277fe700 1 -- 172.21.15.103:0/2585509325 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451c0115d0 con 0x7f45280b6040 2020-04-22T14:19:37.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.833+0000 7f4527fff700 1 --2- 172.21.15.103:0/2585509325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45280b6040 0x7f45280ac740 secure :-1 s=THROTTLE_DONE pgs=2002 cs=0 l=1 rx=0x7f4528066db0 tx=0x7f451c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:37.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.833+0000 7f452ee0f700 1 -- 172.21.15.103:0/2585509325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45280b6040 msgr2=0x7f45280ac740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:37.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.833+0000 7f45277fe700 1 -- 172.21.15.103:0/2585509325 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f451c0119b0 con 0x7f45280b6040 2020-04-22T14:19:37.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.833+0000 7f452ee0f700 1 --2- 172.21.15.103:0/2585509325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45280b6040 0x7f45280ac740 secure :-1 s=READY pgs=2002 cs=0 l=1 rx=0x7f4528066db0 tx=0x7f451c007a40).stop 2020-04-22T14:19:37.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.834+0000 7f452ee0f700 1 -- 172.21.15.103:0/2585509325 shutdown_connections 2020-04-22T14:19:37.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.834+0000 7f452ee0f700 1 --2- 172.21.15.103:0/2585509325 >> v2:172.21.15.86:3300/0 conn(0x7f45281426d0 0x7f4528142b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:37.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.834+0000 7f452ee0f700 1 --2- 172.21.15.103:0/2585509325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45280b6040 0x7f45280ac740 unknown :-1 s=CLOSED pgs=2002 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:37.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.834+0000 7f452ee0f700 1 -- 172.21.15.103:0/2585509325 >> 172.21.15.103:0/2585509325 conn(0x7f45280b9160 msgr2=0x7f452805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:37.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.834+0000 7f452ee0f700 1 -- 172.21.15.103:0/2585509325 shutdown_connections 2020-04-22T14:19:37.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.834+0000 7f452ee0f700 1 -- 172.21.15.103:0/2585509325 wait complete. 2020-04-22T14:19:37.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.835+0000 7f452ee0f700 1 Processor -- start 2020-04-22T14:19:37.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.835+0000 7f452ee0f700 1 -- start start 2020-04-22T14:19:37.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.835+0000 7f452ee0f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4528067170 0x7f452814c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:37.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.836+0000 7f452ee0f700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4528063a00 con 0x7f45280b6040 2020-04-22T14:19:37.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.836+0000 7f452ee0f700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4528063ca0 con 0x7f45281426d0 2020-04-22T14:19:37.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.836+0000 7f452ee0f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4528063f40 con 0x7f4528067170 2020-04-22T14:19:37.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.836+0000 7f452d3ac700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f45281426d0 0x7f452813faf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50278/0 (socket says 172.21.15.103:50278) 2020-04-22T14:19:37.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.836+0000 7f452d3ac700 1 -- 172.21.15.103:0/4244315401 learned_addr learned my addr 172.21.15.103:0/4244315401 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:37.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.836+0000 7f452cbab700 1 --2- 172.21.15.103:0/4244315401 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4528067170 0x7f452814c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:37.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.836+0000 7f4525ffb700 1 -- 172.21.15.103:0/4244315401 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3598096721 0 0) 0x7f4528063ca0 con 0x7f45281426d0 2020-04-22T14:19:37.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.836+0000 7f4525ffb700 1 -- 172.21.15.103:0/4244315401 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4508002fe0 con 0x7f45281426d0 2020-04-22T14:19:37.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.836+0000 7f4525ffb700 1 -- 172.21.15.103:0/4244315401 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3215085831 0 0) 0x7f4528063a00 con 0x7f45280b6040 2020-04-22T14:19:37.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.836+0000 7f4525ffb700 1 -- 172.21.15.103:0/4244315401 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4528063ca0 con 0x7f45280b6040 2020-04-22T14:19:37.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.836+0000 7f4525ffb700 1 -- 172.21.15.103:0/4244315401 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4125638523 0 0) 0x7f4508002fe0 con 0x7f45281426d0 2020-04-22T14:19:37.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.836+0000 7f4525ffb700 1 -- 172.21.15.103:0/4244315401 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4528063a00 con 0x7f45281426d0 2020-04-22T14:19:37.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.836+0000 7f4525ffb700 1 -- 172.21.15.103:0/4244315401 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f45200018e0 con 0x7f45281426d0 2020-04-22T14:19:37.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.836+0000 7f452cbab700 1 -- 172.21.15.103:0/4244315401 >> v1:172.21.15.103:6789/0 conn(0x7f45281426d0 legacy=0x7f452813faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:37.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.836+0000 7f452cbab700 1 -- 172.21.15.103:0/4244315401 >> v1:172.21.15.86:6789/0 conn(0x7f45280b6040 legacy=0x7f452813f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:37.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.836+0000 7f452cbab700 1 -- 172.21.15.103:0/4244315401 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f452813d210 con 0x7f4528067170 2020-04-22T14:19:37.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.836+0000 7f452cbab700 1 --2- 172.21.15.103:0/4244315401 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4528067170 0x7f452814c8e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4518000b80 tx=0x7f4518010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:37.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.836+0000 7f452cbab700 1 --2- 172.21.15.103:0/4244315401 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4528067170 0x7f452814c8e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4518000b80 tx=0x7f4518010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:37.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.836+0000 7f452cbab700 1 --2- 172.21.15.103:0/4244315401 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4528067170 0x7f452814c8e0 secure :-1 s=READY pgs=184 cs=0 l=1 rx=0x7f4518000b80 tx=0x7f4518010880).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:37.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.836+0000 7f452cbab700 1 --2- 172.21.15.103:0/4244315401 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4528067170 0x7f452814c8e0 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f4518000b80 tx=0x7f4518010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:37.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.836+0000 7f4525ffb700 1 -- 172.21.15.103:0/4244315401 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4518005a90 con 0x7f4528067170 2020-04-22T14:19:37.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.836+0000 7f452cbab700 1 --2- 172.21.15.103:0/4244315401 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4528067170 0x7f452814c8e0 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f4518000b80 tx=0x7f4518010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:37.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.836+0000 7f4525ffb700 1 -- 172.21.15.103:0/4244315401 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4518005bf0 con 0x7f4528067170 2020-04-22T14:19:37.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.836+0000 7f452cbab700 1 --2- 172.21.15.103:0/4244315401 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4528067170 0x7f452814c8e0 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f4518000b80 tx=0x7f4518010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:37.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.836+0000 7f452ee0f700 1 -- 172.21.15.103:0/4244315401 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4528146da0 con 0x7f4528067170 2020-04-22T14:19:37.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.837+0000 7f4525ffb700 1 -- 172.21.15.103:0/4244315401 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45180060d0 con 0x7f4528067170 2020-04-22T14:19:37.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.837+0000 7f452ee0f700 1 -- 172.21.15.103:0/4244315401 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4528140520 con 0x7f4528067170 2020-04-22T14:19:37.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.837+0000 7f452cbab700 1 --2- 172.21.15.103:0/4244315401 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4528067170 0x7f452814c8e0 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f4518000b80 tx=0x7f4518010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:37.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.837+0000 7f452ee0f700 1 -- 172.21.15.103:0/4244315401 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4528146f90 con 0x7f4528067170 2020-04-22T14:19:37.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.838+0000 7f4525ffb700 1 -- 172.21.15.103:0/4244315401 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f451800a360 con 0x7f4528067170 2020-04-22T14:19:37.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.838+0000 7f452cbab700 1 --2- 172.21.15.103:0/4244315401 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4528067170 0x7f452814c8e0 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f4518000b80 tx=0x7f4518010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:37.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.838+0000 7f4525ffb700 1 --2- 172.21.15.103:0/4244315401 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f450804e050 0x7f4508050510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:37.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.838+0000 7f4525ffb700 1 -- 172.21.15.103:0/4244315401 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f45180090c0 con 0x7f4528067170 2020-04-22T14:19:37.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.838+0000 7f4527fff700 1 --2- 172.21.15.103:0/4244315401 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f450804e050 0x7f4508050510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:37.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.838+0000 7f4527fff700 1 --2- 172.21.15.103:0/4244315401 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f450804e050 0x7f4508050510 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f451c007ed0 tx=0x7f451c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:37.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.838+0000 7f4527fff700 1 --2- 172.21.15.103:0/4244315401 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f450804e050 0x7f4508050510 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f451c007ed0 tx=0x7f451c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:37.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.838+0000 7f4527fff700 1 --2- 172.21.15.103:0/4244315401 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f450804e050 0x7f4508050510 secure :-1 s=READY pgs=726 cs=0 l=1 rx=0x7f451c007ed0 tx=0x7f451c007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:37.854 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.841+0000 7f452cbab700 1 --2- 172.21.15.103:0/4244315401 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4528067170 0x7f452814c8e0 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f4518000b80 tx=0x7f4518010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:37.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:37.841+0000 7f4525ffb700 1 -- 172.21.15.103:0/4244315401 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f4528146f90 con 0x7f4528067170 2020-04-22T14:19:38.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.037+0000 7f452ee0f700 1 -- 172.21.15.103:0/4244315401 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f452813d3a0 con 0x7f4528067170 2020-04-22T14:19:38.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.037+0000 7f452cbab700 1 --2- 172.21.15.103:0/4244315401 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4528067170 0x7f452814c8e0 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f4518000b80 tx=0x7f4518010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:38.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.037+0000 7f4525ffb700 1 -- 172.21.15.103:0/4244315401 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) v1 ==== 95+0+1784 (secure 0 0 0) 0x7f451803c560 con 0x7f4528067170 2020-04-22T14:19:38.040 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:19:38.040 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":102,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6539,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/1045362246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":1045362246},{"type":"v1","addr":"172.21.15.86:6835","nonce":1045362246}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":97}],"filesystems":[{"mdsmap":{"epoch":102,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:17:48.006467+0000","modified":"2020-04-22T14:19:37.645000+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":137,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2020-04-22T14:19:38.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.039+0000 7f452ee0f700 1 -- 172.21.15.103:0/4244315401 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f450804e050 msgr2=0x7f4508050510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:38.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.039+0000 7f452ee0f700 1 --2- 172.21.15.103:0/4244315401 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f450804e050 0x7f4508050510 secure :-1 s=READY pgs=726 cs=0 l=1 rx=0x7f451c007ed0 tx=0x7f451c007a40).stop 2020-04-22T14:19:38.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.039+0000 7f452ee0f700 1 -- 172.21.15.103:0/4244315401 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4528067170 msgr2=0x7f452814c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:38.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.039+0000 7f452ee0f700 1 --2- 172.21.15.103:0/4244315401 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4528067170 0x7f452814c8e0 secure :-1 s=READY pgs=184 cs=0 l=1 rx=0x7f4518000b80 tx=0x7f4518010880).stop 2020-04-22T14:19:38.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.039+0000 7f452ee0f700 1 -- 172.21.15.103:0/4244315401 shutdown_connections 2020-04-22T14:19:38.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.039+0000 7f452ee0f700 1 --2- 172.21.15.103:0/4244315401 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f450804e050 0x7f4508050510 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:38.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.039+0000 7f452ee0f700 1 --2- 172.21.15.103:0/4244315401 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4528067170 0x7f452814c8e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:38.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.039+0000 7f452ee0f700 1 -- 172.21.15.103:0/4244315401 >> 172.21.15.103:0/4244315401 conn(0x7f45280b9160 msgr2=0x7f4528143070 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:38.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.039+0000 7f452ee0f700 1 -- 172.21.15.103:0/4244315401 shutdown_connections 2020-04-22T14:19:38.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.039+0000 7f452ee0f700 1 -- 172.21.15.103:0/4244315401 wait complete. 2020-04-22T14:19:38.045 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 102 2020-04-22T14:19:38.052 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:38.066 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-04-22T14:19:38.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.213+0000 7f4f4c2e6700 1 Processor -- start 2020-04-22T14:19:38.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.213+0000 7f4f4c2e6700 1 -- start start 2020-04-22T14:19:38.217 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.214+0000 7f4f4c2e6700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4f440ac950 0x7f4f44146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:38.218 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.214+0000 7f4f4c2e6700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4f441470a0 0x7f4f44143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:38.218 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.214+0000 7f4f4c2e6700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f441467e0 con 0x7f4f440b9140 2020-04-22T14:19:38.219 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.214+0000 7f4f4c2e6700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f44147530 con 0x7f4f440ac950 2020-04-22T14:19:38.219 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.214+0000 7f4f4c2e6700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f440602f0 con 0x7f4f441470a0 2020-04-22T14:19:38.219 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.214+0000 7f4f4a883700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4f441470a0 0x7f4f44143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:38.219 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.214+0000 7f4f4a883700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4f441470a0 0x7f4f44143090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58096/0 (socket says 172.21.15.103:58096) 2020-04-22T14:19:38.219 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.214+0000 7f4f4a883700 1 -- 172.21.15.103:0/1848650280 learned_addr learned my addr 172.21.15.103:0/1848650280 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:19:38.219 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.214+0000 7f4f49881700 1 --2- 172.21.15.103:0/1848650280 >> v2:172.21.15.86:3300/0 conn(0x7f4f440ac950 0x7f4f44146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:38.219 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.214+0000 7f4f4a883700 1 -- 172.21.15.103:0/1848650280 >> v2:172.21.15.86:3300/0 conn(0x7f4f440ac950 msgr2=0x7f4f44146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:38.220 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.214+0000 7f4f4a883700 1 --2- 172.21.15.103:0/1848650280 >> v2:172.21.15.86:3300/0 conn(0x7f4f440ac950 0x7f4f44146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:38.220 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.214+0000 7f4f4a883700 1 -- 172.21.15.103:0/1848650280 >> v1:172.21.15.103:6789/0 conn(0x7f4f440b9140 legacy=0x7f4f4412b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:38.220 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.214+0000 7f4f49080700 1 -- 172.21.15.103:0/1848650280 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 351801869 0 0) 0x7f4f441467e0 con 0x7f4f440b9140 2020-04-22T14:19:38.220 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.214+0000 7f4f4a883700 1 -- 172.21.15.103:0/1848650280 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f44060050 con 0x7f4f441470a0 2020-04-22T14:19:38.220 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.214+0000 7f4f49881700 1 --2- 172.21.15.103:0/1848650280 >> v2:172.21.15.86:3300/0 conn(0x7f4f440ac950 0x7f4f44146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:19:38.220 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.214+0000 7f4f4a883700 1 --2- 172.21.15.103:0/1848650280 >> v2:172.21.15.103:3300/0 conn(0x7f4f441470a0 0x7f4f44143090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4f3c0032b0 tx=0x7f4f3c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:38.220 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.214+0000 7f4f4a883700 1 --2- 172.21.15.103:0/1848650280 >> v2:172.21.15.103:3300/0 conn(0x7f4f441470a0 0x7f4f44143090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4f3c0032b0 tx=0x7f4f3c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:38.221 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.214+0000 7f4f4a883700 1 --2- 172.21.15.103:0/1848650280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f441470a0 0x7f4f44143090 secure :-1 s=READY pgs=2005 cs=0 l=1 rx=0x7f4f3c0032b0 tx=0x7f4f3c007dc0).ready entity=mon.1 client_cookie=c0ce6e13de032265 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:38.221 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.214+0000 7f4f4a883700 1 --2- 172.21.15.103:0/1848650280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f441470a0 0x7f4f44143090 secure :-1 s=THROTTLE_DONE pgs=2005 cs=0 l=1 rx=0x7f4f3c0032b0 tx=0x7f4f3c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:38.221 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.214+0000 7f4f49080700 1 -- 172.21.15.103:0/1848650280 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f3c00a180 con 0x7f4f441470a0 2020-04-22T14:19:38.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.214+0000 7f4f4a883700 1 --2- 172.21.15.103:0/1848650280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f441470a0 0x7f4f44143090 secure :-1 s=THROTTLE_DONE pgs=2005 cs=0 l=1 rx=0x7f4f3c0032b0 tx=0x7f4f3c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:38.225 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.214+0000 7f4f49080700 1 -- 172.21.15.103:0/1848650280 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3c00a2e0 con 0x7f4f441470a0 2020-04-22T14:19:38.226 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.214+0000 7f4f4a883700 1 --2- 172.21.15.103:0/1848650280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f441470a0 0x7f4f44143090 secure :-1 s=THROTTLE_DONE pgs=2005 cs=0 l=1 rx=0x7f4f3c0032b0 tx=0x7f4f3c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:38.226 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.214+0000 7f4f49080700 1 -- 172.21.15.103:0/1848650280 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f3c00a6c0 con 0x7f4f441470a0 2020-04-22T14:19:38.226 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.214+0000 7f4f4c2e6700 1 -- 172.21.15.103:0/1848650280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f441470a0 msgr2=0x7f4f44143090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:38.227 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.214+0000 7f4f4c2e6700 1 --2- 172.21.15.103:0/1848650280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f441470a0 0x7f4f44143090 secure :-1 s=READY pgs=2005 cs=0 l=1 rx=0x7f4f3c0032b0 tx=0x7f4f3c007dc0).stop 2020-04-22T14:19:38.227 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.215+0000 7f4f4c2e6700 1 -- 172.21.15.103:0/1848650280 shutdown_connections 2020-04-22T14:19:38.228 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.215+0000 7f4f4c2e6700 1 --2- 172.21.15.103:0/1848650280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f441470a0 0x7f4f44143090 unknown :-1 s=CLOSED pgs=2005 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:38.228 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.215+0000 7f4f4c2e6700 1 --2- 172.21.15.103:0/1848650280 >> v2:172.21.15.86:3300/0 conn(0x7f4f440ac950 0x7f4f44146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:38.228 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.215+0000 7f4f4c2e6700 1 -- 172.21.15.103:0/1848650280 >> 172.21.15.103:0/1848650280 conn(0x7f4f4405b7b0 msgr2=0x7f4f440b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:38.228 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.215+0000 7f4f4c2e6700 1 -- 172.21.15.103:0/1848650280 shutdown_connections 2020-04-22T14:19:38.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.215+0000 7f4f4c2e6700 1 -- 172.21.15.103:0/1848650280 wait complete. 2020-04-22T14:19:38.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.216+0000 7f4f4c2e6700 1 Processor -- start 2020-04-22T14:19:38.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.216+0000 7f4f4c2e6700 1 -- start start 2020-04-22T14:19:38.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.216+0000 7f4f4c2e6700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4f440ac950 0x7f4f44154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:38.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.216+0000 7f4f4c2e6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f440b9140 0x7f4f44143230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:38.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.216+0000 7f4f4c2e6700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4f441470a0 0x7f4f44141310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:38.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.216+0000 7f4f4c2e6700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f44142850 con 0x7f4f440ac950 2020-04-22T14:19:38.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.216+0000 7f4f4c2e6700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f44142af0 con 0x7f4f441470a0 2020-04-22T14:19:38.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.216+0000 7f4f4c2e6700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f44142d90 con 0x7f4f440b9140 2020-04-22T14:19:38.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.217+0000 7f4f4a883700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4f441470a0 0x7f4f44141310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:38.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.217+0000 7f4f4a883700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4f441470a0 0x7f4f44141310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58102/0 (socket says 172.21.15.103:58102) 2020-04-22T14:19:38.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.217+0000 7f4f4a883700 1 -- 172.21.15.103:0/4105358362 learned_addr learned my addr 172.21.15.103:0/4105358362 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:19:38.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.217+0000 7f4f4a082700 1 --2- 172.21.15.103:0/4105358362 >> v2:172.21.15.86:3300/0 conn(0x7f4f440ac950 0x7f4f44154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:38.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.217+0000 7f4f49881700 1 --2- 172.21.15.103:0/4105358362 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f440b9140 0x7f4f44143230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:38.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.217+0000 7f4f4a883700 1 -- 172.21.15.103:0/4105358362 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f440b9140 msgr2=0x7f4f44143230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:38.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.217+0000 7f4f4a883700 1 --2- 172.21.15.103:0/4105358362 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f440b9140 0x7f4f44143230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:38.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.217+0000 7f4f4a883700 1 -- 172.21.15.103:0/4105358362 >> v2:172.21.15.86:3300/0 conn(0x7f4f440ac950 msgr2=0x7f4f44154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:38.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.217+0000 7f4f4a883700 1 --2- 172.21.15.103:0/4105358362 >> v2:172.21.15.86:3300/0 conn(0x7f4f440ac950 0x7f4f44154f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:38.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.217+0000 7f4f4a883700 1 -- 172.21.15.103:0/4105358362 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f44142460 con 0x7f4f441470a0 2020-04-22T14:19:38.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.217+0000 7f4f49881700 1 --2- 172.21.15.103:0/4105358362 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f440b9140 0x7f4f44143230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:19:38.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.217+0000 7f4f4a883700 1 --2- 172.21.15.103:0/4105358362 >> v2:172.21.15.103:3300/0 conn(0x7f4f441470a0 0x7f4f44141310 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4f3c0032b0 tx=0x7f4f3c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:38.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.217+0000 7f4f4a883700 1 --2- 172.21.15.103:0/4105358362 >> v2:172.21.15.103:3300/0 conn(0x7f4f441470a0 0x7f4f44141310 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4f3c0032b0 tx=0x7f4f3c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:38.253 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.217+0000 7f4f4a883700 1 --2- 172.21.15.103:0/4105358362 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f441470a0 0x7f4f44141310 secure :-1 s=READY pgs=2006 cs=0 l=1 rx=0x7f4f3c0032b0 tx=0x7f4f3c007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:38.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.217+0000 7f4f4a883700 1 --2- 172.21.15.103:0/4105358362 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f441470a0 0x7f4f44141310 secure :-1 s=THROTTLE_DONE pgs=2006 cs=0 l=1 rx=0x7f4f3c0032b0 tx=0x7f4f3c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:38.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.217+0000 7f4f4a883700 1 --2- 172.21.15.103:0/4105358362 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f441470a0 0x7f4f44141310 secure :-1 s=THROTTLE_DONE pgs=2006 cs=0 l=1 rx=0x7f4f3c0032b0 tx=0x7f4f3c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:38.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.217+0000 7f4f337fe700 1 -- 172.21.15.103:0/4105358362 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f3c00a760 con 0x7f4f441470a0 2020-04-22T14:19:38.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.217+0000 7f4f4a883700 1 --2- 172.21.15.103:0/4105358362 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f441470a0 0x7f4f44141310 secure :-1 s=THROTTLE_DONE pgs=2006 cs=0 l=1 rx=0x7f4f3c0032b0 tx=0x7f4f3c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:38.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.217+0000 7f4f337fe700 1 -- 172.21.15.103:0/4105358362 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3c005c30 con 0x7f4f441470a0 2020-04-22T14:19:38.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.217+0000 7f4f337fe700 1 -- 172.21.15.103:0/4105358362 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f3c00f5b0 con 0x7f4f441470a0 2020-04-22T14:19:38.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.217+0000 7f4f4c2e6700 1 -- 172.21.15.103:0/4105358362 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f440b1bd0 con 0x7f4f441470a0 2020-04-22T14:19:38.254 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.217+0000 7f4f4c2e6700 1 -- 172.21.15.103:0/4105358362 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f44126d60 con 0x7f4f441470a0 2020-04-22T14:19:38.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.218+0000 7f4f4a883700 1 --2- 172.21.15.103:0/4105358362 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f441470a0 0x7f4f44141310 secure :-1 s=THROTTLE_DONE pgs=2006 cs=0 l=1 rx=0x7f4f3c0032b0 tx=0x7f4f3c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:38.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.218+0000 7f4f337fe700 1 -- 172.21.15.103:0/4105358362 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f4f3c00f820 con 0x7f4f441470a0 2020-04-22T14:19:38.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.218+0000 7f4f4a883700 1 --2- 172.21.15.103:0/4105358362 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f441470a0 0x7f4f44141310 secure :-1 s=THROTTLE_DONE pgs=2006 cs=0 l=1 rx=0x7f4f3c0032b0 tx=0x7f4f3c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:38.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.218+0000 7f4f4c2e6700 1 -- 172.21.15.103:0/4105358362 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f44142650 con 0x7f4f441470a0 2020-04-22T14:19:38.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.218+0000 7f4f337fe700 1 --2- 172.21.15.103:0/4105358362 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4f2404da70 0x7f4f2404ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:38.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.219+0000 7f4f337fe700 1 -- 172.21.15.103:0/4105358362 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f4f3c0623f0 con 0x7f4f441470a0 2020-04-22T14:19:38.255 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.219+0000 7f4f4a082700 1 --2- 172.21.15.103:0/4105358362 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4f2404da70 0x7f4f2404ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:38.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.219+0000 7f4f4a082700 1 --2- 172.21.15.103:0/4105358362 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4f2404da70 0x7f4f2404ff30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4f40000b80 tx=0x7f4f40003960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:38.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.219+0000 7f4f4a082700 1 --2- 172.21.15.103:0/4105358362 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4f2404da70 0x7f4f2404ff30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4f40000b80 tx=0x7f4f40003960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:38.257 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.219+0000 7f4f4a082700 1 --2- 172.21.15.103:0/4105358362 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4f2404da70 0x7f4f2404ff30 secure :-1 s=READY pgs=727 cs=0 l=1 rx=0x7f4f40000b80 tx=0x7f4f40003960).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:38.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.223+0000 7f4f4a883700 1 --2- 172.21.15.103:0/4105358362 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f441470a0 0x7f4f44141310 secure :-1 s=THROTTLE_DONE pgs=2006 cs=0 l=1 rx=0x7f4f3c0032b0 tx=0x7f4f3c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:38.258 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.223+0000 7f4f337fe700 1 -- 172.21.15.103:0/4105358362 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f4f3c03d8f0 con 0x7f4f441470a0 2020-04-22T14:19:38.416 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.414+0000 7f4f4c2e6700 1 -- 172.21.15.103:0/4105358362 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4f44056c90 con 0x7f4f441470a0 2020-04-22T14:19:38.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.652+0000 7f4f4a883700 1 --2- 172.21.15.103:0/4105358362 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f441470a0 0x7f4f44141310 secure :-1 s=THROTTLE_DONE pgs=2006 cs=0 l=1 rx=0x7f4f3c0032b0 tx=0x7f4f3c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:38.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.652+0000 7f4f337fe700 1 -- 172.21.15.103:0/4105358362 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v103) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4f3c040f10 con 0x7f4f441470a0 2020-04-22T14:19:38.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.653+0000 7f4f4c2e6700 1 -- 172.21.15.103:0/4105358362 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4f2404da70 msgr2=0x7f4f2404ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:38.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.653+0000 7f4f4c2e6700 1 --2- 172.21.15.103:0/4105358362 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4f2404da70 0x7f4f2404ff30 secure :-1 s=READY pgs=727 cs=0 l=1 rx=0x7f4f40000b80 tx=0x7f4f40003960).stop 2020-04-22T14:19:38.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.653+0000 7f4f4c2e6700 1 -- 172.21.15.103:0/4105358362 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f441470a0 msgr2=0x7f4f44141310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:38.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.653+0000 7f4f4c2e6700 1 --2- 172.21.15.103:0/4105358362 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f441470a0 0x7f4f44141310 secure :-1 s=READY pgs=2006 cs=0 l=1 rx=0x7f4f3c0032b0 tx=0x7f4f3c007dc0).stop 2020-04-22T14:19:38.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.654+0000 7f4f4c2e6700 1 -- 172.21.15.103:0/4105358362 shutdown_connections 2020-04-22T14:19:38.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.654+0000 7f4f4c2e6700 1 --2- 172.21.15.103:0/4105358362 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4f2404da70 0x7f4f2404ff30 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:38.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.654+0000 7f4f4c2e6700 1 --2- 172.21.15.103:0/4105358362 >> v2:172.21.15.86:3300/0 conn(0x7f4f440ac950 0x7f4f44154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:38.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.654+0000 7f4f4c2e6700 1 --2- 172.21.15.103:0/4105358362 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4f441470a0 0x7f4f44141310 unknown :-1 s=CLOSED pgs=2006 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:38.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.654+0000 7f4f4c2e6700 1 --2- 172.21.15.103:0/4105358362 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f440b9140 0x7f4f44143230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:38.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.654+0000 7f4f4c2e6700 1 -- 172.21.15.103:0/4105358362 >> 172.21.15.103:0/4105358362 conn(0x7f4f4405b7b0 msgr2=0x7f4f44128320 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:38.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.654+0000 7f4f4c2e6700 1 -- 172.21.15.103:0/4105358362 shutdown_connections 2020-04-22T14:19:38.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.654+0000 7f4f4c2e6700 1 -- 172.21.15.103:0/4105358362 wait complete. 2020-04-22T14:19:38.667 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:38.681 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-04-22T14:19:38.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.829+0000 7f2ab93a0700 1 Processor -- start 2020-04-22T14:19:38.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.829+0000 7f2ab93a0700 1 -- start start 2020-04-22T14:19:38.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.830+0000 7f2ab93a0700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2ab40b9140 0x7f2ab412b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:38.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.830+0000 7f2ab93a0700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2ab40ac950 0x7f2ab412b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:38.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.830+0000 7f2ab93a0700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2ab4146c40 0x7f2ab41470f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:38.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.830+0000 7f2ab93a0700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ab40602f0 con 0x7f2ab40ac950 2020-04-22T14:19:38.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.830+0000 7f2ab93a0700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ab41467e0 con 0x7f2ab40b9140 2020-04-22T14:19:38.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.830+0000 7f2ab93a0700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab4060050 con 0x7f2ab4146c40 2020-04-22T14:19:38.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.830+0000 7f2ab2ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2ab40b9140 0x7f2ab412b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:38.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.830+0000 7f2ab2ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2ab40b9140 0x7f2ab412b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58108/0 (socket says 172.21.15.103:58108) 2020-04-22T14:19:38.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.830+0000 7f2ab2ffd700 1 -- 172.21.15.103:0/2678083633 learned_addr learned my addr 172.21.15.103:0/2678083633 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:19:38.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.830+0000 7f2ab27fc700 1 --2- 172.21.15.103:0/2678083633 >> v2:172.21.15.86:3300/0 conn(0x7f2ab40ac950 0x7f2ab412b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:38.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.830+0000 7f2ab37fe700 1 --2- 172.21.15.103:0/2678083633 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2ab4146c40 0x7f2ab41470f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:38.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.830+0000 7f2ab2ffd700 1 -- 172.21.15.103:0/2678083633 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2ab4146c40 msgr2=0x7f2ab41470f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:38.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.830+0000 7f2ab2ffd700 1 --2- 172.21.15.103:0/2678083633 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2ab4146c40 0x7f2ab41470f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:38.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.830+0000 7f2ab2ffd700 1 -- 172.21.15.103:0/2678083633 >> v2:172.21.15.86:3300/0 conn(0x7f2ab40ac950 msgr2=0x7f2ab412b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:38.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.830+0000 7f2ab2ffd700 1 --2- 172.21.15.103:0/2678083633 >> v2:172.21.15.86:3300/0 conn(0x7f2ab40ac950 0x7f2ab412b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:38.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.830+0000 7f2ab2ffd700 1 -- 172.21.15.103:0/2678083633 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab40b9520 con 0x7f2ab40b9140 2020-04-22T14:19:38.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.831+0000 7f2ab2ffd700 1 --2- 172.21.15.103:0/2678083633 >> v2:172.21.15.103:3300/0 conn(0x7f2ab40b9140 0x7f2ab412b210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2aa4002f30 tx=0x7f2aa4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:38.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.831+0000 7f2ab2ffd700 1 --2- 172.21.15.103:0/2678083633 >> v2:172.21.15.103:3300/0 conn(0x7f2ab40b9140 0x7f2ab412b210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2aa4002f30 tx=0x7f2aa4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:38.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.831+0000 7f2ab2ffd700 1 --2- 172.21.15.103:0/2678083633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ab40b9140 0x7f2ab412b210 secure :-1 s=READY pgs=2007 cs=0 l=1 rx=0x7f2aa4002f30 tx=0x7f2aa4007a40).ready entity=mon.1 client_cookie=c3625f3fd1305fc2 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:38.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.831+0000 7f2ab2ffd700 1 --2- 172.21.15.103:0/2678083633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ab40b9140 0x7f2ab412b210 secure :-1 s=THROTTLE_DONE pgs=2007 cs=0 l=1 rx=0x7f2aa4002f30 tx=0x7f2aa4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:38.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.831+0000 7f2ab2ffd700 1 --2- 172.21.15.103:0/2678083633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ab40b9140 0x7f2ab412b210 secure :-1 s=THROTTLE_DONE pgs=2007 cs=0 l=1 rx=0x7f2aa4002f30 tx=0x7f2aa4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:38.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.831+0000 7f2ab1ffb700 1 -- 172.21.15.103:0/2678083633 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2aa40115c0 con 0x7f2ab40b9140 2020-04-22T14:19:38.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.831+0000 7f2ab2ffd700 1 --2- 172.21.15.103:0/2678083633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ab40b9140 0x7f2ab412b210 secure :-1 s=THROTTLE_DONE pgs=2007 cs=0 l=1 rx=0x7f2aa4002f30 tx=0x7f2aa4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:38.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.831+0000 7f2ab1ffb700 1 -- 172.21.15.103:0/2678083633 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa4011720 con 0x7f2ab40b9140 2020-04-22T14:19:38.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.831+0000 7f2ab1ffb700 1 -- 172.21.15.103:0/2678083633 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2aa4011b40 con 0x7f2ab40b9140 2020-04-22T14:19:38.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.831+0000 7f2ab93a0700 1 -- 172.21.15.103:0/2678083633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ab40b9140 msgr2=0x7f2ab412b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:38.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.831+0000 7f2ab93a0700 1 --2- 172.21.15.103:0/2678083633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ab40b9140 0x7f2ab412b210 secure :-1 s=READY pgs=2007 cs=0 l=1 rx=0x7f2aa4002f30 tx=0x7f2aa4007a40).stop 2020-04-22T14:19:38.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.831+0000 7f2ab93a0700 1 -- 172.21.15.103:0/2678083633 shutdown_connections 2020-04-22T14:19:38.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.831+0000 7f2ab93a0700 1 --2- 172.21.15.103:0/2678083633 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2ab4146c40 0x7f2ab41470f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:38.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.831+0000 7f2ab93a0700 1 --2- 172.21.15.103:0/2678083633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ab40b9140 0x7f2ab412b210 unknown :-1 s=CLOSED pgs=2007 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:38.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.831+0000 7f2ab93a0700 1 --2- 172.21.15.103:0/2678083633 >> v2:172.21.15.86:3300/0 conn(0x7f2ab40ac950 0x7f2ab412b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:38.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.831+0000 7f2ab93a0700 1 -- 172.21.15.103:0/2678083633 >> 172.21.15.103:0/2678083633 conn(0x7f2ab405b7b0 msgr2=0x7f2ab40b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:38.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.831+0000 7f2ab93a0700 1 -- 172.21.15.103:0/2678083633 shutdown_connections 2020-04-22T14:19:38.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.831+0000 7f2ab93a0700 1 -- 172.21.15.103:0/2678083633 wait complete. 2020-04-22T14:19:38.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.832+0000 7f2ab93a0700 1 Processor -- start 2020-04-22T14:19:38.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.832+0000 7f2ab93a0700 1 -- start start 2020-04-22T14:19:38.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.833+0000 7f2ab93a0700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2ab40ac950 0x7f2ab41461a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:38.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.833+0000 7f2ab93a0700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2ab40b9140 0x7f2ab4147a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:38.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.833+0000 7f2ab93a0700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ab40653b0 con 0x7f2ab4146c40 2020-04-22T14:19:38.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.833+0000 7f2ab93a0700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ab4065650 con 0x7f2ab40b9140 2020-04-22T14:19:38.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.833+0000 7f2ab93a0700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ab40645b0 con 0x7f2ab40ac950 2020-04-22T14:19:38.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.833+0000 7f2ab2ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2ab40ac950 0x7f2ab41461a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:38.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.833+0000 7f2ab2ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2ab40ac950 0x7f2ab41461a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58112/0 (socket says 172.21.15.103:58112) 2020-04-22T14:19:38.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.833+0000 7f2ab2ffd700 1 -- 172.21.15.103:0/3864902800 learned_addr learned my addr 172.21.15.103:0/3864902800 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:19:38.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.833+0000 7f2ab2ffd700 1 -- 172.21.15.103:0/3864902800 >> v2:172.21.15.86:3300/0 conn(0x7f2ab40b9140 msgr2=0x7f2ab4147a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:38.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.833+0000 7f2ab27fc700 1 --2- 172.21.15.103:0/3864902800 >> v2:172.21.15.86:3300/0 conn(0x7f2ab40b9140 0x7f2ab4147a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:38.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.833+0000 7f2aabfff700 1 -- 172.21.15.103:0/3864902800 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4040445734 0 0) 0x7f2ab40653b0 con 0x7f2ab4146c40 2020-04-22T14:19:38.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.833+0000 7f2ab2ffd700 1 --2- 172.21.15.103:0/3864902800 >> v2:172.21.15.86:3300/0 conn(0x7f2ab40b9140 0x7f2ab4147a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:38.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.833+0000 7f2ab2ffd700 1 -- 172.21.15.103:0/3864902800 >> v1:172.21.15.103:6789/0 conn(0x7f2ab4146c40 legacy=0x7f2ab40b1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:38.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.833+0000 7f2ab2ffd700 1 -- 172.21.15.103:0/3864902800 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab4148710 con 0x7f2ab40ac950 2020-04-22T14:19:38.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.833+0000 7f2ab2ffd700 1 --2- 172.21.15.103:0/3864902800 >> v2:172.21.15.103:3300/0 conn(0x7f2ab40ac950 0x7f2ab41461a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2aa4002f30 tx=0x7f2aa4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:38.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.833+0000 7f2ab2ffd700 1 --2- 172.21.15.103:0/3864902800 >> v2:172.21.15.103:3300/0 conn(0x7f2ab40ac950 0x7f2ab41461a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2aa4002f30 tx=0x7f2aa4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:38.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.834+0000 7f2ab2ffd700 1 --2- 172.21.15.103:0/3864902800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ab40ac950 0x7f2ab41461a0 secure :-1 s=READY pgs=2009 cs=0 l=1 rx=0x7f2aa4002f30 tx=0x7f2aa4007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:38.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.834+0000 7f2ab2ffd700 1 --2- 172.21.15.103:0/3864902800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ab40ac950 0x7f2ab41461a0 secure :-1 s=THROTTLE_DONE pgs=2009 cs=0 l=1 rx=0x7f2aa4002f30 tx=0x7f2aa4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:38.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.834+0000 7f2aabfff700 1 -- 172.21.15.103:0/3864902800 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2aa4011ea0 con 0x7f2ab40ac950 2020-04-22T14:19:38.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.834+0000 7f2ab2ffd700 1 --2- 172.21.15.103:0/3864902800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ab40ac950 0x7f2ab41461a0 secure :-1 s=THROTTLE_DONE pgs=2009 cs=0 l=1 rx=0x7f2aa4002f30 tx=0x7f2aa4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:38.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.834+0000 7f2ab2ffd700 1 --2- 172.21.15.103:0/3864902800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ab40ac950 0x7f2ab41461a0 secure :-1 s=THROTTLE_DONE pgs=2009 cs=0 l=1 rx=0x7f2aa4002f30 tx=0x7f2aa4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:38.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.834+0000 7f2aabfff700 1 -- 172.21.15.103:0/3864902800 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa4007170 con 0x7f2ab40ac950 2020-04-22T14:19:38.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.834+0000 7f2ab93a0700 1 -- 172.21.15.103:0/3864902800 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ab4147ee0 con 0x7f2ab40ac950 2020-04-22T14:19:38.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.834+0000 7f2aabfff700 1 -- 172.21.15.103:0/3864902800 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2aa40074d0 con 0x7f2ab40ac950 2020-04-22T14:19:38.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.834+0000 7f2ab93a0700 1 -- 172.21.15.103:0/3864902800 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ab41483b0 con 0x7f2ab40ac950 2020-04-22T14:19:38.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.834+0000 7f2ab2ffd700 1 --2- 172.21.15.103:0/3864902800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ab40ac950 0x7f2ab41461a0 secure :-1 s=THROTTLE_DONE pgs=2009 cs=0 l=1 rx=0x7f2aa4002f30 tx=0x7f2aa4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:38.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.835+0000 7f2ab93a0700 1 -- 172.21.15.103:0/3864902800 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ab40647b0 con 0x7f2ab40ac950 2020-04-22T14:19:38.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.835+0000 7f2aabfff700 1 -- 172.21.15.103:0/3864902800 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f2aa40056c0 con 0x7f2ab40ac950 2020-04-22T14:19:38.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.835+0000 7f2ab2ffd700 1 --2- 172.21.15.103:0/3864902800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ab40ac950 0x7f2ab41461a0 secure :-1 s=THROTTLE_DONE pgs=2009 cs=0 l=1 rx=0x7f2aa4002f30 tx=0x7f2aa4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:38.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.835+0000 7f2aabfff700 1 --2- 172.21.15.103:0/3864902800 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2a9804d8c0 0x7f2a9804fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:38.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.835+0000 7f2aabfff700 1 -- 172.21.15.103:0/3864902800 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f2aa4061dd0 con 0x7f2ab40ac950 2020-04-22T14:19:38.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.835+0000 7f2ab27fc700 1 --2- 172.21.15.103:0/3864902800 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2a9804d8c0 0x7f2a9804fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:38.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.835+0000 7f2ab27fc700 1 --2- 172.21.15.103:0/3864902800 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2a9804d8c0 0x7f2a9804fd80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2a9c002f30 tx=0x7f2a9c009840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:38.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.836+0000 7f2ab27fc700 1 --2- 172.21.15.103:0/3864902800 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2a9804d8c0 0x7f2a9804fd80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2a9c002f30 tx=0x7f2a9c009840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:38.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.836+0000 7f2ab27fc700 1 --2- 172.21.15.103:0/3864902800 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2a9804d8c0 0x7f2a9804fd80 secure :-1 s=READY pgs=729 cs=0 l=1 rx=0x7f2a9c002f30 tx=0x7f2a9c009840).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:38.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.839+0000 7f2ab2ffd700 1 --2- 172.21.15.103:0/3864902800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ab40ac950 0x7f2ab41461a0 secure :-1 s=THROTTLE_DONE pgs=2009 cs=0 l=1 rx=0x7f2aa4002f30 tx=0x7f2aa4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:38.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.839+0000 7f2aabfff700 1 -- 172.21.15.103:0/3864902800 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f2ab40647b0 con 0x7f2ab40ac950 2020-04-22T14:19:38.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:38.982+0000 7f2ab93a0700 1 -- 172.21.15.103:0/3864902800 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2ab41488a0 con 0x7f2ab40ac950 2020-04-22T14:19:39.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.702+0000 7f2ab2ffd700 1 --2- 172.21.15.103:0/3864902800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ab40ac950 0x7f2ab41461a0 secure :-1 s=THROTTLE_DONE pgs=2009 cs=0 l=1 rx=0x7f2aa4002f30 tx=0x7f2aa4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:39.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.702+0000 7f2aabfff700 1 -- 172.21.15.103:0/3864902800 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v138) v1 ==== 185+0+0 (secure 0 0 0) 0x7f2aa403d210 con 0x7f2ab40ac950 2020-04-22T14:19:39.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.704+0000 7f2ab93a0700 1 -- 172.21.15.103:0/3864902800 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2a9804d8c0 msgr2=0x7f2a9804fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:39.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.704+0000 7f2ab93a0700 1 --2- 172.21.15.103:0/3864902800 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2a9804d8c0 0x7f2a9804fd80 secure :-1 s=READY pgs=729 cs=0 l=1 rx=0x7f2a9c002f30 tx=0x7f2a9c009840).stop 2020-04-22T14:19:39.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.704+0000 7f2ab93a0700 1 -- 172.21.15.103:0/3864902800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ab40ac950 msgr2=0x7f2ab41461a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:39.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.704+0000 7f2ab93a0700 1 --2- 172.21.15.103:0/3864902800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ab40ac950 0x7f2ab41461a0 secure :-1 s=READY pgs=2009 cs=0 l=1 rx=0x7f2aa4002f30 tx=0x7f2aa4007a40).stop 2020-04-22T14:19:39.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.704+0000 7f2ab93a0700 1 -- 172.21.15.103:0/3864902800 shutdown_connections 2020-04-22T14:19:39.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.704+0000 7f2ab93a0700 1 --2- 172.21.15.103:0/3864902800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ab40ac950 0x7f2ab41461a0 unknown :-1 s=CLOSED pgs=2009 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:39.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.704+0000 7f2ab93a0700 1 --2- 172.21.15.103:0/3864902800 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2a9804d8c0 0x7f2a9804fd80 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:39.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.704+0000 7f2ab93a0700 1 --2- 172.21.15.103:0/3864902800 >> v2:172.21.15.86:3300/0 conn(0x7f2ab40b9140 0x7f2ab4147a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:39.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.704+0000 7f2ab93a0700 1 -- 172.21.15.103:0/3864902800 >> 172.21.15.103:0/3864902800 conn(0x7f2ab405b7b0 msgr2=0x7f2ab41298b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:39.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.704+0000 7f2ab93a0700 1 -- 172.21.15.103:0/3864902800 shutdown_connections 2020-04-22T14:19:39.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.704+0000 7f2ab93a0700 1 -- 172.21.15.103:0/3864902800 wait complete. 2020-04-22T14:19:39.708 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' removed 2020-04-22T14:19:39.719 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:39.735 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2020-04-22T14:19:39.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.892+0000 7fedc5596700 1 Processor -- start 2020-04-22T14:19:39.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.892+0000 7fedc5596700 1 -- start start 2020-04-22T14:19:39.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.893+0000 7fedc5596700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fedc0061a30 0x7fedc00b4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:39.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.893+0000 7fedc5596700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fedc00acb10 0x7fedc00ae920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:39.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.893+0000 7fedc5596700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fedc00aed80 0x7fedc00b3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:39.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.893+0000 7fedc5596700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedc0060250 con 0x7fedc00aed80 2020-04-22T14:19:39.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.893+0000 7fedc5596700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedc00623c0 con 0x7fedc0061a30 2020-04-22T14:19:39.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.893+0000 7fedc5596700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc0062660 con 0x7fedc00acb10 2020-04-22T14:19:39.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.893+0000 7fedbeffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fedc0061a30 0x7fedc00b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:39.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.893+0000 7fedbeffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fedc0061a30 0x7fedc00b4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58120/0 (socket says 172.21.15.103:58120) 2020-04-22T14:19:39.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.893+0000 7fedbeffd700 1 -- 172.21.15.103:0/312715238 learned_addr learned my addr 172.21.15.103:0/312715238 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:19:39.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.893+0000 7fedbf7fe700 1 --2- 172.21.15.103:0/312715238 >> v2:172.21.15.86:3300/0 conn(0x7fedc00aed80 0x7fedc00b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:39.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.893+0000 7fedbe7fc700 1 --2- 172.21.15.103:0/312715238 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fedc00acb10 0x7fedc00ae920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:39.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.894+0000 7fedbeffd700 1 -- 172.21.15.103:0/312715238 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fedc00acb10 msgr2=0x7fedc00ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:39.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.894+0000 7fedbeffd700 1 --2- 172.21.15.103:0/312715238 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fedc00acb10 0x7fedc00ae920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:39.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.894+0000 7fedbeffd700 1 -- 172.21.15.103:0/312715238 >> v2:172.21.15.86:3300/0 conn(0x7fedc00aed80 msgr2=0x7fedc00b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:39.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.894+0000 7fedbeffd700 1 --2- 172.21.15.103:0/312715238 >> v2:172.21.15.86:3300/0 conn(0x7fedc00aed80 0x7fedc00b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:39.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.894+0000 7fedbeffd700 1 -- 172.21.15.103:0/312715238 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc0061e10 con 0x7fedc0061a30 2020-04-22T14:19:39.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.894+0000 7fedbf7fe700 1 --2- 172.21.15.103:0/312715238 >> v2:172.21.15.86:3300/0 conn(0x7fedc00aed80 0x7fedc00b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:19:39.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.894+0000 7fedbe7fc700 1 --2- 172.21.15.103:0/312715238 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fedc00acb10 0x7fedc00ae920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:19:39.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.894+0000 7fedbeffd700 1 --2- 172.21.15.103:0/312715238 >> v2:172.21.15.103:3300/0 conn(0x7fedc0061a30 0x7fedc00b4820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fedb4002f30 tx=0x7fedb4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:39.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.894+0000 7fedbeffd700 1 --2- 172.21.15.103:0/312715238 >> v2:172.21.15.103:3300/0 conn(0x7fedc0061a30 0x7fedc00b4820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fedb4002f30 tx=0x7fedb4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:39.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.894+0000 7fedbeffd700 1 --2- 172.21.15.103:0/312715238 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedc0061a30 0x7fedc00b4820 secure :-1 s=READY pgs=2010 cs=0 l=1 rx=0x7fedb4002f30 tx=0x7fedb4007a40).ready entity=mon.1 client_cookie=fb9473462fea3a13 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:39.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.894+0000 7fedbeffd700 1 --2- 172.21.15.103:0/312715238 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedc0061a30 0x7fedc00b4820 secure :-1 s=THROTTLE_DONE pgs=2010 cs=0 l=1 rx=0x7fedb4002f30 tx=0x7fedb4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:39.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.894+0000 7fedbeffd700 1 --2- 172.21.15.103:0/312715238 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedc0061a30 0x7fedc00b4820 secure :-1 s=THROTTLE_DONE pgs=2010 cs=0 l=1 rx=0x7fedb4002f30 tx=0x7fedb4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:39.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.894+0000 7fedbeffd700 1 --2- 172.21.15.103:0/312715238 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedc0061a30 0x7fedc00b4820 secure :-1 s=THROTTLE_DONE pgs=2010 cs=0 l=1 rx=0x7fedb4002f30 tx=0x7fedb4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:39.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.894+0000 7fedbdffb700 1 -- 172.21.15.103:0/312715238 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedb4009a10 con 0x7fedc0061a30 2020-04-22T14:19:39.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.894+0000 7fedbdffb700 1 -- 172.21.15.103:0/312715238 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb4009b70 con 0x7fedc0061a30 2020-04-22T14:19:39.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.894+0000 7fedbdffb700 1 -- 172.21.15.103:0/312715238 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedb400a430 con 0x7fedc0061a30 2020-04-22T14:19:39.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.895+0000 7fedc5596700 1 -- 172.21.15.103:0/312715238 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedc0061a30 msgr2=0x7fedc00b4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:39.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.895+0000 7fedc5596700 1 --2- 172.21.15.103:0/312715238 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedc0061a30 0x7fedc00b4820 secure :-1 s=READY pgs=2010 cs=0 l=1 rx=0x7fedb4002f30 tx=0x7fedb4007a40).stop 2020-04-22T14:19:39.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.897+0000 7fedc5596700 1 -- 172.21.15.103:0/312715238 shutdown_connections 2020-04-22T14:19:39.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.897+0000 7fedc5596700 1 --2- 172.21.15.103:0/312715238 >> v2:172.21.15.86:3300/0 conn(0x7fedc00aed80 0x7fedc00b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:39.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.897+0000 7fedc5596700 1 --2- 172.21.15.103:0/312715238 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedc0061a30 0x7fedc00b4820 unknown :-1 s=CLOSED pgs=2010 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:39.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.897+0000 7fedc5596700 1 --2- 172.21.15.103:0/312715238 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fedc00acb10 0x7fedc00ae920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:39.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.897+0000 7fedc5596700 1 -- 172.21.15.103:0/312715238 >> 172.21.15.103:0/312715238 conn(0x7fedc005b7b0 msgr2=0x7fedc00b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:39.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.898+0000 7fedc5596700 1 -- 172.21.15.103:0/312715238 shutdown_connections 2020-04-22T14:19:39.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.898+0000 7fedc5596700 1 -- 172.21.15.103:0/312715238 wait complete. 2020-04-22T14:19:39.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.899+0000 7fedc5596700 1 Processor -- start 2020-04-22T14:19:39.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.899+0000 7fedc5596700 1 -- start start 2020-04-22T14:19:39.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.900+0000 7fedc5596700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fedc00acb10 0x7fedc013fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:39.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.900+0000 7fedc5596700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fedc00aed80 0x7fedc00afe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:39.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.900+0000 7fedc5596700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedc014f690 con 0x7fedc0061a30 2020-04-22T14:19:39.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.900+0000 7fedc5596700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedc014f930 con 0x7fedc00aed80 2020-04-22T14:19:39.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.900+0000 7fedc5596700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc014fbd0 con 0x7fedc00acb10 2020-04-22T14:19:39.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.900+0000 7fedbf7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fedc00aed80 0x7fedc00afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:39.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.900+0000 7fedbf7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fedc00aed80 0x7fedc00afe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58128/0 (socket says 172.21.15.103:58128) 2020-04-22T14:19:39.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.900+0000 7fedbf7fe700 1 -- 172.21.15.103:0/1782855250 learned_addr learned my addr 172.21.15.103:0/1782855250 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:19:39.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.900+0000 7fedbe7fc700 1 --2- 172.21.15.103:0/1782855250 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fedc00acb10 0x7fedc013fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:39.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.901+0000 7fedbf7fe700 1 -- 172.21.15.103:0/1782855250 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fedc00acb10 msgr2=0x7fedc013fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:39.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.901+0000 7fedbf7fe700 1 --2- 172.21.15.103:0/1782855250 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fedc00acb10 0x7fedc013fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:39.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.901+0000 7fedbf7fe700 1 -- 172.21.15.103:0/1782855250 >> v1:172.21.15.86:6789/0 conn(0x7fedc0061a30 legacy=0x7fedc0150070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:39.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.901+0000 7fedbf7fe700 1 -- 172.21.15.103:0/1782855250 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc00b0290 con 0x7fedc00aed80 2020-04-22T14:19:39.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.901+0000 7fedbf7fe700 1 --2- 172.21.15.103:0/1782855250 >> v2:172.21.15.103:3300/0 conn(0x7fedc00aed80 0x7fedc00afe30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fedb8007ca0 tx=0x7fedb800c5b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:39.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.901+0000 7fedbf7fe700 1 --2- 172.21.15.103:0/1782855250 >> v2:172.21.15.103:3300/0 conn(0x7fedc00aed80 0x7fedc00afe30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fedb8007ca0 tx=0x7fedb800c5b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:39.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.901+0000 7fedbf7fe700 1 --2- 172.21.15.103:0/1782855250 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedc00aed80 0x7fedc00afe30 secure :-1 s=READY pgs=2011 cs=0 l=1 rx=0x7fedb8007ca0 tx=0x7fedb800c5b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:39.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.901+0000 7fedbf7fe700 1 --2- 172.21.15.103:0/1782855250 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedc00aed80 0x7fedc00afe30 secure :-1 s=THROTTLE_DONE pgs=2011 cs=0 l=1 rx=0x7fedb8007ca0 tx=0x7fedb800c5b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:39.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.901+0000 7fedaffff700 1 -- 172.21.15.103:0/1782855250 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedb8005e20 con 0x7fedc00aed80 2020-04-22T14:19:39.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.901+0000 7fedbf7fe700 1 --2- 172.21.15.103:0/1782855250 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedc00aed80 0x7fedc00afe30 secure :-1 s=THROTTLE_DONE pgs=2011 cs=0 l=1 rx=0x7fedb8007ca0 tx=0x7fedb800c5b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:39.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.901+0000 7fedbf7fe700 1 --2- 172.21.15.103:0/1782855250 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedc00aed80 0x7fedc00afe30 secure :-1 s=THROTTLE_DONE pgs=2011 cs=0 l=1 rx=0x7fedb8007ca0 tx=0x7fedb800c5b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:39.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.901+0000 7fedaffff700 1 -- 172.21.15.103:0/1782855250 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb8007180 con 0x7fedc00aed80 2020-04-22T14:19:39.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.901+0000 7fedc5596700 1 -- 172.21.15.103:0/1782855250 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedc00b0500 con 0x7fedc00aed80 2020-04-22T14:19:39.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.901+0000 7fedaffff700 1 -- 172.21.15.103:0/1782855250 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedb8007560 con 0x7fedc00aed80 2020-04-22T14:19:39.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.901+0000 7fedc5596700 1 -- 172.21.15.103:0/1782855250 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc01533d0 con 0x7fedc00aed80 2020-04-22T14:19:39.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.902+0000 7fedbf7fe700 1 --2- 172.21.15.103:0/1782855250 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedc00aed80 0x7fedc00afe30 secure :-1 s=THROTTLE_DONE pgs=2011 cs=0 l=1 rx=0x7fedb8007ca0 tx=0x7fedb800c5b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:39.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.902+0000 7fedaffff700 1 -- 172.21.15.103:0/1782855250 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fedb80077d0 con 0x7fedc00aed80 2020-04-22T14:19:39.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.902+0000 7fedbf7fe700 1 --2- 172.21.15.103:0/1782855250 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedc00aed80 0x7fedc00afe30 secure :-1 s=THROTTLE_DONE pgs=2011 cs=0 l=1 rx=0x7fedb8007ca0 tx=0x7fedb800c5b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:39.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.902+0000 7fedc5596700 1 -- 172.21.15.103:0/1782855250 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedc0056c90 con 0x7fedc00aed80 2020-04-22T14:19:39.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.902+0000 7fedaffff700 1 --2- 172.21.15.103:0/1782855250 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fed9c04da10 0x7fed9c04fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:39.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.902+0000 7fedaffff700 1 -- 172.21.15.103:0/1782855250 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5764+0+0 (secure 0 0 0) 0x7fedb8065a10 con 0x7fedc00aed80 2020-04-22T14:19:39.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.902+0000 7fedbeffd700 1 --2- 172.21.15.103:0/1782855250 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fed9c04da10 0x7fed9c04fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:39.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.903+0000 7fedbeffd700 1 --2- 172.21.15.103:0/1782855250 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fed9c04da10 0x7fed9c04fed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fedc00b0cd0 tx=0x7fedb4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:39.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.903+0000 7fedbeffd700 1 --2- 172.21.15.103:0/1782855250 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fed9c04da10 0x7fed9c04fed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fedc00b0cd0 tx=0x7fedb4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:39.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.903+0000 7fedbeffd700 1 --2- 172.21.15.103:0/1782855250 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fed9c04da10 0x7fed9c04fed0 secure :-1 s=READY pgs=730 cs=0 l=1 rx=0x7fedc00b0cd0 tx=0x7fedb4007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:39.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.906+0000 7fedbf7fe700 1 --2- 172.21.15.103:0/1782855250 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedc00aed80 0x7fedc00afe30 secure :-1 s=THROTTLE_DONE pgs=2011 cs=0 l=1 rx=0x7fedb8007ca0 tx=0x7fedb800c5b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:39.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:39.906+0000 7fedaffff700 1 -- 172.21.15.103:0/1782855250 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fedb8040df0 con 0x7fedc00aed80 2020-04-22T14:19:40.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:40.048+0000 7fedc5596700 1 -- 172.21.15.103:0/1782855250 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fedc00b2b30 con 0x7fedc00aed80 2020-04-22T14:19:40.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:40.706+0000 7fedbf7fe700 1 --2- 172.21.15.103:0/1782855250 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedc00aed80 0x7fedc00afe30 secure :-1 s=THROTTLE_DONE pgs=2011 cs=0 l=1 rx=0x7fedb8007ca0 tx=0x7fedb800c5b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:40.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:40.706+0000 7fedaffff700 1 -- 172.21.15.103:0/1782855250 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v139) v1 ==== 173+0+0 (secure 0 0 0) 0x7fedb8044410 con 0x7fedc00aed80 2020-04-22T14:19:40.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:40.708+0000 7fedc5596700 1 -- 172.21.15.103:0/1782855250 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fed9c04da10 msgr2=0x7fed9c04fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:40.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:40.708+0000 7fedc5596700 1 --2- 172.21.15.103:0/1782855250 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fed9c04da10 0x7fed9c04fed0 secure :-1 s=READY pgs=730 cs=0 l=1 rx=0x7fedc00b0cd0 tx=0x7fedb4007a40).stop 2020-04-22T14:19:40.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:40.708+0000 7fedc5596700 1 -- 172.21.15.103:0/1782855250 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedc00aed80 msgr2=0x7fedc00afe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:40.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:40.708+0000 7fedc5596700 1 --2- 172.21.15.103:0/1782855250 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedc00aed80 0x7fedc00afe30 secure :-1 s=READY pgs=2011 cs=0 l=1 rx=0x7fedb8007ca0 tx=0x7fedb800c5b0).stop 2020-04-22T14:19:40.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:40.708+0000 7fedc5596700 1 -- 172.21.15.103:0/1782855250 shutdown_connections 2020-04-22T14:19:40.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:40.708+0000 7fedc5596700 1 --2- 172.21.15.103:0/1782855250 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fed9c04da10 0x7fed9c04fed0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:40.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:40.708+0000 7fedc5596700 1 --2- 172.21.15.103:0/1782855250 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedc00aed80 0x7fedc00afe30 unknown :-1 s=CLOSED pgs=2011 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:40.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:40.708+0000 7fedc5596700 1 --2- 172.21.15.103:0/1782855250 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fedc00acb10 0x7fedc013fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:40.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:40.708+0000 7fedc5596700 1 -- 172.21.15.103:0/1782855250 >> 172.21.15.103:0/1782855250 conn(0x7fedc005b7b0 msgr2=0x7fedc00b78f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:40.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:40.708+0000 7fedc5596700 1 -- 172.21.15.103:0/1782855250 shutdown_connections 2020-04-22T14:19:40.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:40.708+0000 7fedc5596700 1 -- 172.21.15.103:0/1782855250 wait complete. 2020-04-22T14:19:40.712 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' removed 2020-04-22T14:19:40.721 INFO:tasks.ceph.mds.a:Restarting daemon 2020-04-22T14:19:40.721 INFO:tasks.ceph.mds.a:Stopping old one... 2020-04-22T14:19:40.722 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-04-22T14:19:40.722 INFO:teuthology.orchestra.run:waiting for 300 2020-04-22T14:19:40.722 INFO:tasks.ceph.mds.b:Restarting daemon 2020-04-22T14:19:40.722 INFO:tasks.ceph.mds.b:Stopping old one... 2020-04-22T14:19:40.722 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-04-22T14:19:40.722 INFO:teuthology.orchestra.run:waiting for 300 2020-04-22T14:19:40.730 INFO:tasks.ceph.mds.a:Stopped 2020-04-22T14:19:40.730 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:40.732 INFO:tasks.ceph.mds.b:Stopped 2020-04-22T14:19:40.742 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:19:40.786 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-04-22T14:19:40.789 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-04-22T14:19:40.828 INFO:tasks.ceph.mds.a:Started 2020-04-22T14:19:40.829 DEBUG:teuthology.parallel:result is None 2020-04-22T14:19:40.831 INFO:tasks.ceph.mds.b:Started 2020-04-22T14:19:40.832 DEBUG:teuthology.parallel:result is None 2020-04-22T14:19:40.832 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:40.846 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2020-04-22T14:19:40.903 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2020-04-22T14:19:40.913 INFO:tasks.ceph.mds.b.smithi086.stdout:starting mds.b at 2020-04-22T14:19:41.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:40.998+0000 7fc095a98700 1 Processor -- start 2020-04-22T14:19:41.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:40.998+0000 7fc095a98700 1 -- start start 2020-04-22T14:19:41.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:40.999+0000 7fc095a98700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc0900b4880 0x7fc090060910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:41.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:40.999+0000 7fc095a98700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc090060d70 0x7fc09014a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:41.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:40.999+0000 7fc095a98700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc09014a5d0 0x7fc0900b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:41.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:40.999+0000 7fc095a98700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc090149a70 con 0x7fc0900b4880 2020-04-22T14:19:41.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:40.999+0000 7fc095a98700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc090149cd0 con 0x7fc09014a5d0 2020-04-22T14:19:41.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:40.999+0000 7fc095a98700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0900b4c60 con 0x7fc090060d70 2020-04-22T14:19:41.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:40.999+0000 7fc08ffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc09014a5d0 0x7fc0900b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:41.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:40.999+0000 7fc08ffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc09014a5d0 0x7fc0900b0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58146/0 (socket says 172.21.15.103:58146) 2020-04-22T14:19:41.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:40.999+0000 7fc08ffff700 1 -- 172.21.15.103:0/1354917505 learned_addr learned my addr 172.21.15.103:0/1354917505 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:19:41.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:40.999+0000 7fc08effd700 1 --2- 172.21.15.103:0/1354917505 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc090060d70 0x7fc09014a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:41.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:40.999+0000 7fc08f7fe700 1 --2- 172.21.15.103:0/1354917505 >> v2:172.21.15.86:3300/0 conn(0x7fc0900b4880 0x7fc090060910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:41.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:40.999+0000 7fc08ffff700 1 -- 172.21.15.103:0/1354917505 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc090060d70 msgr2=0x7fc09014a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:41.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:40.999+0000 7fc08ffff700 1 --2- 172.21.15.103:0/1354917505 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc090060d70 0x7fc09014a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:41.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:40.999+0000 7fc08ffff700 1 -- 172.21.15.103:0/1354917505 >> v2:172.21.15.86:3300/0 conn(0x7fc0900b4880 msgr2=0x7fc090060910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:41.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:40.999+0000 7fc08ffff700 1 --2- 172.21.15.103:0/1354917505 >> v2:172.21.15.86:3300/0 conn(0x7fc0900b4880 0x7fc090060910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:41.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:40.999+0000 7fc08ffff700 1 -- 172.21.15.103:0/1354917505 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc090061290 con 0x7fc09014a5d0 2020-04-22T14:19:41.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:40.999+0000 7fc08ffff700 1 --2- 172.21.15.103:0/1354917505 >> v2:172.21.15.103:3300/0 conn(0x7fc09014a5d0 0x7fc0900b0d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc088002f30 tx=0x7fc088007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:41.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.000+0000 7fc08ffff700 1 --2- 172.21.15.103:0/1354917505 >> v2:172.21.15.103:3300/0 conn(0x7fc09014a5d0 0x7fc0900b0d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc088002f30 tx=0x7fc088007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:41.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.000+0000 7fc08ffff700 1 --2- 172.21.15.103:0/1354917505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc09014a5d0 0x7fc0900b0d80 secure :-1 s=READY pgs=2016 cs=0 l=1 rx=0x7fc088002f30 tx=0x7fc088007a40).ready entity=mon.1 client_cookie=18f3d4cffc624f5f server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:41.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.000+0000 7fc08ffff700 1 --2- 172.21.15.103:0/1354917505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc09014a5d0 0x7fc0900b0d80 secure :-1 s=THROTTLE_DONE pgs=2016 cs=0 l=1 rx=0x7fc088002f30 tx=0x7fc088007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:41.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.000+0000 7fc08e7fc700 1 -- 172.21.15.103:0/1354917505 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc088008e10 con 0x7fc09014a5d0 2020-04-22T14:19:41.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.000+0000 7fc08ffff700 1 --2- 172.21.15.103:0/1354917505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc09014a5d0 0x7fc0900b0d80 secure :-1 s=THROTTLE_DONE pgs=2016 cs=0 l=1 rx=0x7fc088002f30 tx=0x7fc088007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:41.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.000+0000 7fc08e7fc700 1 -- 172.21.15.103:0/1354917505 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc088011760 con 0x7fc09014a5d0 2020-04-22T14:19:41.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.000+0000 7fc08ffff700 1 --2- 172.21.15.103:0/1354917505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc09014a5d0 0x7fc0900b0d80 secure :-1 s=THROTTLE_DONE pgs=2016 cs=0 l=1 rx=0x7fc088002f30 tx=0x7fc088007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:41.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.000+0000 7fc08e7fc700 1 -- 172.21.15.103:0/1354917505 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc088011b80 con 0x7fc09014a5d0 2020-04-22T14:19:41.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.000+0000 7fc095a98700 1 -- 172.21.15.103:0/1354917505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc09014a5d0 msgr2=0x7fc0900b0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:41.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.000+0000 7fc095a98700 1 --2- 172.21.15.103:0/1354917505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc09014a5d0 0x7fc0900b0d80 secure :-1 s=READY pgs=2016 cs=0 l=1 rx=0x7fc088002f30 tx=0x7fc088007a40).stop 2020-04-22T14:19:41.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.000+0000 7fc095a98700 1 -- 172.21.15.103:0/1354917505 shutdown_connections 2020-04-22T14:19:41.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.000+0000 7fc095a98700 1 --2- 172.21.15.103:0/1354917505 >> v2:172.21.15.86:3300/0 conn(0x7fc0900b4880 0x7fc090060910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:41.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.000+0000 7fc095a98700 1 --2- 172.21.15.103:0/1354917505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc09014a5d0 0x7fc0900b0d80 unknown :-1 s=CLOSED pgs=2016 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:41.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.000+0000 7fc095a98700 1 --2- 172.21.15.103:0/1354917505 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc090060d70 0x7fc09014a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:41.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.000+0000 7fc095a98700 1 -- 172.21.15.103:0/1354917505 >> 172.21.15.103:0/1354917505 conn(0x7fc0900ba8d0 msgr2=0x7fc0900bace0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:41.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.000+0000 7fc095a98700 1 -- 172.21.15.103:0/1354917505 shutdown_connections 2020-04-22T14:19:41.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.000+0000 7fc095a98700 1 -- 172.21.15.103:0/1354917505 wait complete. 2020-04-22T14:19:41.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.001+0000 7fc095a98700 1 Processor -- start 2020-04-22T14:19:41.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.001+0000 7fc095a98700 1 -- start start 2020-04-22T14:19:41.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.002+0000 7fc095a98700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc090060d70 0x7fc0900b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:41.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.002+0000 7fc095a98700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc09014a5d0 0x7fc09013f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:41.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.002+0000 7fc095a98700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0900b6510 con 0x7fc0900b4880 2020-04-22T14:19:41.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.002+0000 7fc095a98700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0900b3d80 con 0x7fc090060d70 2020-04-22T14:19:41.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.002+0000 7fc095a98700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc090064a00 con 0x7fc09014a5d0 2020-04-22T14:19:41.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.002+0000 7fc08f7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc090060d70 0x7fc0900b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:41.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.002+0000 7fc08f7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc090060d70 0x7fc0900b60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:55382/0 (socket says 172.21.15.103:55382) 2020-04-22T14:19:41.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.002+0000 7fc08f7fe700 1 -- 172.21.15.103:0/1388132528 learned_addr learned my addr 172.21.15.103:0/1388132528 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:19:41.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.002+0000 7fc08ffff700 1 --2- 172.21.15.103:0/1388132528 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc09014a5d0 0x7fc09013f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:41.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.002+0000 7fc08f7fe700 1 -- 172.21.15.103:0/1388132528 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc09014a5d0 msgr2=0x7fc09013f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:41.016 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.002+0000 7fc08f7fe700 1 --2- 172.21.15.103:0/1388132528 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc09014a5d0 0x7fc09013f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:41.016 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.002+0000 7fc08f7fe700 1 -- 172.21.15.103:0/1388132528 >> v1:172.21.15.86:6789/0 conn(0x7fc0900b4880 legacy=0x7fc090065940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:41.016 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.002+0000 7fc08cff9700 1 -- 172.21.15.103:0/1388132528 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1984752024 0 0) 0x7fc084001ec0 con 0x7fc0900b4880 2020-04-22T14:19:41.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.002+0000 7fc08f7fe700 1 -- 172.21.15.103:0/1388132528 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc090064ca0 con 0x7fc090060d70 2020-04-22T14:19:41.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.002+0000 7fc08ffff700 1 --2- 172.21.15.103:0/1388132528 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc09014a5d0 0x7fc09013f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:19:41.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.003+0000 7fc08f7fe700 1 --2- 172.21.15.103:0/1388132528 >> v2:172.21.15.86:3300/0 conn(0x7fc090060d70 0x7fc0900b60b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc090063db0 tx=0x7fc080011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:41.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.003+0000 7fc08f7fe700 1 --2- 172.21.15.103:0/1388132528 >> v2:172.21.15.86:3300/0 conn(0x7fc090060d70 0x7fc0900b60b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc090063db0 tx=0x7fc080011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:41.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.003+0000 7fc08f7fe700 1 --2- 172.21.15.103:0/1388132528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc090060d70 0x7fc0900b60b0 secure :-1 s=READY pgs=1060 cs=0 l=1 rx=0x7fc090063db0 tx=0x7fc080011040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:41.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.003+0000 7fc08f7fe700 1 --2- 172.21.15.103:0/1388132528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc090060d70 0x7fc0900b60b0 secure :-1 s=THROTTLE_DONE pgs=1060 cs=0 l=1 rx=0x7fc090063db0 tx=0x7fc080011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:41.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.003+0000 7fc08cff9700 1 -- 172.21.15.103:0/1388132528 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc080005e30 con 0x7fc090060d70 2020-04-22T14:19:41.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.003+0000 7fc08f7fe700 1 --2- 172.21.15.103:0/1388132528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc090060d70 0x7fc0900b60b0 secure :-1 s=THROTTLE_DONE pgs=1060 cs=0 l=1 rx=0x7fc090063db0 tx=0x7fc080011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:41.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.003+0000 7fc08cff9700 1 -- 172.21.15.103:0/1388132528 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc080007560 con 0x7fc090060d70 2020-04-22T14:19:41.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.003+0000 7fc095a98700 1 -- 172.21.15.103:0/1388132528 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0900b1ac0 con 0x7fc090060d70 2020-04-22T14:19:41.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.003+0000 7fc08f7fe700 1 --2- 172.21.15.103:0/1388132528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc090060d70 0x7fc0900b60b0 secure :-1 s=THROTTLE_DONE pgs=1060 cs=0 l=1 rx=0x7fc090063db0 tx=0x7fc080011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:41.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.003+0000 7fc08cff9700 1 -- 172.21.15.103:0/1388132528 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc080012660 con 0x7fc090060d70 2020-04-22T14:19:41.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.003+0000 7fc095a98700 1 -- 172.21.15.103:0/1388132528 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc09013f630 con 0x7fc090060d70 2020-04-22T14:19:41.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.003+0000 7fc08f7fe700 1 --2- 172.21.15.103:0/1388132528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc090060d70 0x7fc0900b60b0 secure :-1 s=THROTTLE_DONE pgs=1060 cs=0 l=1 rx=0x7fc090063db0 tx=0x7fc080011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:41.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.004+0000 7fc095a98700 1 -- 172.21.15.103:0/1388132528 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0900b2070 con 0x7fc090060d70 2020-04-22T14:19:41.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.004+0000 7fc08cff9700 1 -- 172.21.15.103:0/1388132528 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fc08000e1a0 con 0x7fc090060d70 2020-04-22T14:19:41.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.004+0000 7fc08f7fe700 1 --2- 172.21.15.103:0/1388132528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc090060d70 0x7fc0900b60b0 secure :-1 s=THROTTLE_DONE pgs=1060 cs=0 l=1 rx=0x7fc090063db0 tx=0x7fc080011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:41.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.004+0000 7fc08cff9700 1 --2- 172.21.15.103:0/1388132528 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc07004d8b0 0x7fc07004fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:41.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.004+0000 7fc08cff9700 1 -- 172.21.15.103:0/1388132528 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fc080061450 con 0x7fc090060d70 2020-04-22T14:19:41.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.004+0000 7fc08effd700 1 --2- 172.21.15.103:0/1388132528 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc07004d8b0 0x7fc07004fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:41.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.005+0000 7fc08effd700 1 --2- 172.21.15.103:0/1388132528 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc07004d8b0 0x7fc07004fd70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc084007920 tx=0x7fc084002950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:41.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.005+0000 7fc08effd700 1 --2- 172.21.15.103:0/1388132528 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc07004d8b0 0x7fc07004fd70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc084007920 tx=0x7fc084002950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:41.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.005+0000 7fc08effd700 1 --2- 172.21.15.103:0/1388132528 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc07004d8b0 0x7fc07004fd70 secure :-1 s=READY pgs=731 cs=0 l=1 rx=0x7fc084007920 tx=0x7fc084002950).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:41.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.008+0000 7fc08f7fe700 1 --2- 172.21.15.103:0/1388132528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc090060d70 0x7fc0900b60b0 secure :-1 s=THROTTLE_DONE pgs=1060 cs=0 l=1 rx=0x7fc090063db0 tx=0x7fc080011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:41.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.008+0000 7fc08cff9700 1 -- 172.21.15.103:0/1388132528 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fc08003c830 con 0x7fc090060d70 2020-04-22T14:19:41.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.166+0000 7fc095a98700 1 -- 172.21.15.103:0/1388132528 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fc0900b3ec0 con 0x7fc090060d70 2020-04-22T14:19:41.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.937+0000 7fc08f7fe700 1 --2- 172.21.15.103:0/1388132528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc090060d70 0x7fc0900b60b0 secure :-1 s=THROTTLE_DONE pgs=1060 cs=0 l=1 rx=0x7fc090063db0 tx=0x7fc080011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:41.939 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.937+0000 7fc08cff9700 1 -- 172.21.15.103:0/1388132528 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v142) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc08003fe50 con 0x7fc090060d70 2020-04-22T14:19:41.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.939+0000 7fc095a98700 1 -- 172.21.15.103:0/1388132528 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc07004d8b0 msgr2=0x7fc07004fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:41.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.939+0000 7fc095a98700 1 --2- 172.21.15.103:0/1388132528 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc07004d8b0 0x7fc07004fd70 secure :-1 s=READY pgs=731 cs=0 l=1 rx=0x7fc084007920 tx=0x7fc084002950).stop 2020-04-22T14:19:41.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.939+0000 7fc095a98700 1 -- 172.21.15.103:0/1388132528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc090060d70 msgr2=0x7fc0900b60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:41.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.939+0000 7fc095a98700 1 --2- 172.21.15.103:0/1388132528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc090060d70 0x7fc0900b60b0 secure :-1 s=READY pgs=1060 cs=0 l=1 rx=0x7fc090063db0 tx=0x7fc080011040).stop 2020-04-22T14:19:41.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.939+0000 7fc095a98700 1 -- 172.21.15.103:0/1388132528 shutdown_connections 2020-04-22T14:19:41.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.939+0000 7fc095a98700 1 --2- 172.21.15.103:0/1388132528 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc09014a5d0 0x7fc09013f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:41.945 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.939+0000 7fc095a98700 1 --2- 172.21.15.103:0/1388132528 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc07004d8b0 0x7fc07004fd70 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:41.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.939+0000 7fc095a98700 1 --2- 172.21.15.103:0/1388132528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc090060d70 0x7fc0900b60b0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:41.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.939+0000 7fc095a98700 1 -- 172.21.15.103:0/1388132528 >> 172.21.15.103:0/1388132528 conn(0x7fc0900ba8d0 msgr2=0x7fc0900b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:41.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.939+0000 7fc095a98700 1 -- 172.21.15.103:0/1388132528 shutdown_connections 2020-04-22T14:19:41.946 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:41.939+0000 7fc095a98700 1 -- 172.21.15.103:0/1388132528 wait complete. 2020-04-22T14:19:41.946 INFO:teuthology.orchestra.run.smithi103.stderr: removed all blacklist entries 2020-04-22T14:19:41.955 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2020-04-22T14:19:41.956 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:42.012 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2020-04-22T14:19:42.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.162+0000 7f0961284700 1 Processor -- start 2020-04-22T14:19:42.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.162+0000 7f0961284700 1 -- start start 2020-04-22T14:19:42.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.163+0000 7f0961284700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f095c12c0d0 0x7f095c1464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:42.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.163+0000 7f0961284700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f095c065fe0 0x7f095c05b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:42.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.163+0000 7f0961284700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f095c143300 con 0x7f095c05b8a0 2020-04-22T14:19:42.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.163+0000 7f0961284700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f095c12c4b0 con 0x7f095c12c0d0 2020-04-22T14:19:42.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.163+0000 7f0961284700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f095c1435a0 con 0x7f095c065fe0 2020-04-22T14:19:42.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.163+0000 7f095a7fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f095c065fe0 0x7f095c05b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:42.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.163+0000 7f095b7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f095c05b8a0 0x7f095c062ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50350/0 (socket says 172.21.15.103:50350) 2020-04-22T14:19:42.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.163+0000 7f095b7fe700 1 -- 172.21.15.103:0/3085316041 learned_addr learned my addr 172.21.15.103:0/3085316041 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:42.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.163+0000 7f095affd700 1 --2- 172.21.15.103:0/3085316041 >> v2:172.21.15.86:3300/0 conn(0x7f095c12c0d0 0x7f095c1464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:42.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.163+0000 7f095a7fc700 1 -- 172.21.15.103:0/3085316041 >> v2:172.21.15.86:3300/0 conn(0x7f095c12c0d0 msgr2=0x7f095c1464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:42.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.163+0000 7f095a7fc700 1 --2- 172.21.15.103:0/3085316041 >> v2:172.21.15.86:3300/0 conn(0x7f095c12c0d0 0x7f095c1464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:42.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.163+0000 7f095a7fc700 1 -- 172.21.15.103:0/3085316041 >> v1:172.21.15.103:6789/0 conn(0x7f095c05b8a0 legacy=0x7f095c062ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:42.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.163+0000 7f0959ffb700 1 -- 172.21.15.103:0/3085316041 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1593743360 0 0) 0x7f095c143300 con 0x7f095c05b8a0 2020-04-22T14:19:42.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.163+0000 7f095a7fc700 1 -- 172.21.15.103:0/3085316041 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f095c143840 con 0x7f095c065fe0 2020-04-22T14:19:42.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.164+0000 7f095a7fc700 1 --2- 172.21.15.103:0/3085316041 >> v2:172.21.15.103:3300/0 conn(0x7f095c065fe0 0x7f095c05b440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f094c002f30 tx=0x7f094c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.164+0000 7f095a7fc700 1 --2- 172.21.15.103:0/3085316041 >> v2:172.21.15.103:3300/0 conn(0x7f095c065fe0 0x7f095c05b440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f094c002f30 tx=0x7f094c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.164+0000 7f095a7fc700 1 --2- 172.21.15.103:0/3085316041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f095c065fe0 0x7f095c05b440 secure :-1 s=READY pgs=2018 cs=0 l=1 rx=0x7f094c002f30 tx=0x7f094c007a40).ready entity=mon.1 client_cookie=4909d1b72328956a server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:42.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.164+0000 7f095a7fc700 1 --2- 172.21.15.103:0/3085316041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f095c065fe0 0x7f095c05b440 secure :-1 s=THROTTLE_DONE pgs=2018 cs=0 l=1 rx=0x7f094c002f30 tx=0x7f094c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.164+0000 7f0959ffb700 1 -- 172.21.15.103:0/3085316041 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f094c011470 con 0x7f095c065fe0 2020-04-22T14:19:42.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.164+0000 7f095a7fc700 1 --2- 172.21.15.103:0/3085316041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f095c065fe0 0x7f095c05b440 secure :-1 s=THROTTLE_DONE pgs=2018 cs=0 l=1 rx=0x7f094c002f30 tx=0x7f094c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.164+0000 7f095a7fc700 1 --2- 172.21.15.103:0/3085316041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f095c065fe0 0x7f095c05b440 secure :-1 s=THROTTLE_DONE pgs=2018 cs=0 l=1 rx=0x7f094c002f30 tx=0x7f094c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.164+0000 7f0959ffb700 1 -- 172.21.15.103:0/3085316041 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094c0115d0 con 0x7f095c065fe0 2020-04-22T14:19:42.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.164+0000 7f0959ffb700 1 -- 172.21.15.103:0/3085316041 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f094c0119b0 con 0x7f095c065fe0 2020-04-22T14:19:42.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.164+0000 7f0961284700 1 -- 172.21.15.103:0/3085316041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f095c065fe0 msgr2=0x7f095c05b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:42.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.164+0000 7f0961284700 1 --2- 172.21.15.103:0/3085316041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f095c065fe0 0x7f095c05b440 secure :-1 s=READY pgs=2018 cs=0 l=1 rx=0x7f094c002f30 tx=0x7f094c007a40).stop 2020-04-22T14:19:42.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.164+0000 7f0961284700 1 -- 172.21.15.103:0/3085316041 shutdown_connections 2020-04-22T14:19:42.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.164+0000 7f0961284700 1 --2- 172.21.15.103:0/3085316041 >> v2:172.21.15.86:3300/0 conn(0x7f095c12c0d0 0x7f095c1464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:42.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.164+0000 7f0961284700 1 --2- 172.21.15.103:0/3085316041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f095c065fe0 0x7f095c05b440 unknown :-1 s=CLOSED pgs=2018 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:42.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.164+0000 7f0961284700 1 -- 172.21.15.103:0/3085316041 >> 172.21.15.103:0/3085316041 conn(0x7f095c0b9160 msgr2=0x7f095c05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:42.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.164+0000 7f0961284700 1 -- 172.21.15.103:0/3085316041 shutdown_connections 2020-04-22T14:19:42.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.164+0000 7f0961284700 1 -- 172.21.15.103:0/3085316041 wait complete. 2020-04-22T14:19:42.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.165+0000 7f0961284700 1 Processor -- start 2020-04-22T14:19:42.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.165+0000 7f0961284700 1 -- start start 2020-04-22T14:19:42.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.166+0000 7f0961284700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f095c065fe0 0x7f095c142550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:42.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.166+0000 7f0961284700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f095c12c0d0 0x7f095c062db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:42.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.166+0000 7f0961284700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f095c128e00 con 0x7f095c05b8a0 2020-04-22T14:19:42.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.166+0000 7f0961284700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f095c063210 con 0x7f095c12c0d0 2020-04-22T14:19:42.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.166+0000 7f0961284700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f095c129080 con 0x7f095c065fe0 2020-04-22T14:19:42.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.166+0000 7f095a7fc700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f095c065fe0 0x7f095c142550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:42.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.166+0000 7f095b7fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f095c12c0d0 0x7f095c062db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:42.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.166+0000 7f095a7fc700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f095c065fe0 0x7f095c142550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:42944/0 (socket says 172.21.15.103:42944) 2020-04-22T14:19:42.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.166+0000 7f095a7fc700 1 -- 172.21.15.103:0/1406247102 learned_addr learned my addr 172.21.15.103:0/1406247102 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:19:42.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.166+0000 7f095affd700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f095c05b8a0 0x7f095c141e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:39278/0 (socket says 172.21.15.103:39278) 2020-04-22T14:19:42.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.167+0000 7f095a7fc700 1 -- 172.21.15.103:0/1406247102 >> v2:172.21.15.86:3300/0 conn(0x7f095c12c0d0 msgr2=0x7f095c062db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:42.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.167+0000 7f095a7fc700 1 --2- 172.21.15.103:0/1406247102 >> v2:172.21.15.86:3300/0 conn(0x7f095c12c0d0 0x7f095c062db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:42.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.167+0000 7f095a7fc700 1 -- 172.21.15.103:0/1406247102 >> v1:172.21.15.86:6789/0 conn(0x7f095c05b8a0 legacy=0x7f095c141e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:42.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.167+0000 7f095a7fc700 1 -- 172.21.15.103:0/1406247102 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f095c0b3fb0 con 0x7f095c065fe0 2020-04-22T14:19:42.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.167+0000 7f095a7fc700 1 --2- 172.21.15.103:0/1406247102 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f095c065fe0 0x7f095c142550 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f094c002f30 tx=0x7f094c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.167+0000 7f095a7fc700 1 --2- 172.21.15.103:0/1406247102 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f095c065fe0 0x7f095c142550 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f094c002f30 tx=0x7f094c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.167+0000 7f095a7fc700 1 --2- 172.21.15.103:0/1406247102 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f095c065fe0 0x7f095c142550 secure :-1 s=READY pgs=187 cs=0 l=1 rx=0x7f094c002f30 tx=0x7f094c007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:42.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.167+0000 7f095a7fc700 1 --2- 172.21.15.103:0/1406247102 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f095c065fe0 0x7f095c142550 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7f094c002f30 tx=0x7f094c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.167+0000 7f094bfff700 1 -- 172.21.15.103:0/1406247102 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f094c011a70 con 0x7f095c065fe0 2020-04-22T14:19:42.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.167+0000 7f095a7fc700 1 --2- 172.21.15.103:0/1406247102 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f095c065fe0 0x7f095c142550 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7f094c002f30 tx=0x7f094c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.167+0000 7f094bfff700 1 -- 172.21.15.103:0/1406247102 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094c007170 con 0x7f095c065fe0 2020-04-22T14:19:42.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.167+0000 7f095a7fc700 1 --2- 172.21.15.103:0/1406247102 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f095c065fe0 0x7f095c142550 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7f094c002f30 tx=0x7f094c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.167+0000 7f0961284700 1 -- 172.21.15.103:0/1406247102 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f095c0b4250 con 0x7f095c065fe0 2020-04-22T14:19:42.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.167+0000 7f094bfff700 1 -- 172.21.15.103:0/1406247102 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f094c007550 con 0x7f095c065fe0 2020-04-22T14:19:42.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.167+0000 7f0961284700 1 -- 172.21.15.103:0/1406247102 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f095c0b2bc0 con 0x7f095c065fe0 2020-04-22T14:19:42.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.168+0000 7f095a7fc700 1 --2- 172.21.15.103:0/1406247102 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f095c065fe0 0x7f095c142550 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7f094c002f30 tx=0x7f094c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.168+0000 7f0961284700 1 -- 172.21.15.103:0/1406247102 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f095c056c90 con 0x7f095c065fe0 2020-04-22T14:19:42.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.168+0000 7f095a7fc700 1 --2- 172.21.15.103:0/1406247102 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f095c065fe0 0x7f095c142550 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7f094c002f30 tx=0x7f094c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.168+0000 7f094bfff700 1 -- 172.21.15.103:0/1406247102 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f094c0056c0 con 0x7f095c065fe0 2020-04-22T14:19:42.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.168+0000 7f094bfff700 1 --2- 172.21.15.103:0/1406247102 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f093804d960 0x7f093804fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:42.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.168+0000 7f094bfff700 1 -- 172.21.15.103:0/1406247102 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f094c061d60 con 0x7f095c065fe0 2020-04-22T14:19:42.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.169+0000 7f095affd700 1 --2- 172.21.15.103:0/1406247102 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f093804d960 0x7f093804fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:42.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.169+0000 7f095affd700 1 --2- 172.21.15.103:0/1406247102 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f093804d960 0x7f093804fe20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f095c063570 tx=0x7f0950008d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.169+0000 7f095affd700 1 --2- 172.21.15.103:0/1406247102 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f093804d960 0x7f093804fe20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f095c063570 tx=0x7f0950008d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.169+0000 7f095affd700 1 --2- 172.21.15.103:0/1406247102 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f093804d960 0x7f093804fe20 secure :-1 s=READY pgs=734 cs=0 l=1 rx=0x7f095c063570 tx=0x7f0950008d10).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:42.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.172+0000 7f095a7fc700 1 --2- 172.21.15.103:0/1406247102 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f095c065fe0 0x7f095c142550 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7f094c002f30 tx=0x7f094c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.172+0000 7f094bfff700 1 -- 172.21.15.103:0/1406247102 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f094c03d0a0 con 0x7f095c065fe0 2020-04-22T14:19:42.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.365+0000 7f0961284700 1 -- 172.21.15.103:0/1406247102 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f095c0638a0 con 0x7f095c065fe0 2020-04-22T14:19:42.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.365+0000 7f095a7fc700 1 --2- 172.21.15.103:0/1406247102 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f095c065fe0 0x7f095c142550 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7f094c002f30 tx=0x7f094c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.365+0000 7f094bfff700 1 -- 172.21.15.103:0/1406247102 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v52) v1 ==== 80+0+4513 (secure 0 0 0) 0x7f094c0406c0 con 0x7f095c065fe0 2020-04-22T14:19:42.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.367+0000 7f0961284700 1 -- 172.21.15.103:0/1406247102 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f093804d960 msgr2=0x7f093804fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:42.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.367+0000 7f0961284700 1 --2- 172.21.15.103:0/1406247102 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f093804d960 0x7f093804fe20 secure :-1 s=READY pgs=734 cs=0 l=1 rx=0x7f095c063570 tx=0x7f0950008d10).stop 2020-04-22T14:19:42.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.367+0000 7f0961284700 1 -- 172.21.15.103:0/1406247102 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f095c065fe0 msgr2=0x7f095c142550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:42.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.367+0000 7f0961284700 1 --2- 172.21.15.103:0/1406247102 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f095c065fe0 0x7f095c142550 secure :-1 s=READY pgs=187 cs=0 l=1 rx=0x7f094c002f30 tx=0x7f094c007a40).stop 2020-04-22T14:19:42.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.367+0000 7f0961284700 1 -- 172.21.15.103:0/1406247102 shutdown_connections 2020-04-22T14:19:42.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.367+0000 7f0961284700 1 --2- 172.21.15.103:0/1406247102 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f093804d960 0x7f093804fe20 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:42.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.367+0000 7f0961284700 1 --2- 172.21.15.103:0/1406247102 >> v2:172.21.15.86:3300/0 conn(0x7f095c12c0d0 0x7f095c062db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:42.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.367+0000 7f0961284700 1 --2- 172.21.15.103:0/1406247102 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f095c065fe0 0x7f095c142550 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:42.371 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.367+0000 7f0961284700 1 -- 172.21.15.103:0/1406247102 >> 172.21.15.103:0/1406247102 conn(0x7f095c0b9160 msgr2=0x7f095c05ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:42.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.367+0000 7f0961284700 1 -- 172.21.15.103:0/1406247102 shutdown_connections 2020-04-22T14:19:42.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.367+0000 7f0961284700 1 -- 172.21.15.103:0/1406247102 wait complete. 2020-04-22T14:19:42.372 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:19:42.372 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:19:42.372 INFO:teuthology.orchestra.run.smithi103.stdout: "auth_dump": [ 2020-04-22T14:19:42.372 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:42.373 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.a", 2020-04-22T14:19:42.373 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBeliD5IBAAjC7UikdEP8FeE2rKs/ympw==", 2020-04-22T14:19:42.373 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:19:42.373 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:19:42.373 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:19:42.373 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:19:42.373 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:19:42.373 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:42.374 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:42.374 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:42.374 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.b", 2020-04-22T14:19:42.374 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBepkqQLBAA4aMKXxROQugglhm4aBd1Iw==", 2020-04-22T14:19:42.374 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:19:42.374 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:19:42.374 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:19:42.375 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:19:42.375 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:19:42.375 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:42.375 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:42.375 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:42.375 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.0", 2020-04-22T14:19:42.375 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA2TqBehMJiBxAARaWo32QGx49PxImGafnOFw==", 2020-04-22T14:19:42.375 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:19:42.376 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:19:42.376 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:19:42.376 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:19:42.376 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:42.376 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:42.376 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:42.376 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.1", 2020-04-22T14:19:42.377 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA4TqBeiAAcKRAAEHuaqbsB+NLUTSgFOCOFZg==", 2020-04-22T14:19:42.377 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:19:42.377 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:19:42.377 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:19:42.377 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:19:42.377 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:42.377 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:42.378 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:42.378 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.2", 2020-04-22T14:19:42.378 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA7TqBebeRzDxAAsjRyvJektq7MQ+334kU+UQ==", 2020-04-22T14:19:42.378 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:19:42.378 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:19:42.378 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:19:42.378 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:19:42.379 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:42.379 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:42.379 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:42.379 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.3", 2020-04-22T14:19:42.379 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA9TqBehxmSMRAATZ0o/ZnxHp2m/tqLmv6JwA==", 2020-04-22T14:19:42.379 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:19:42.379 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:19:42.379 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:19:42.380 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:19:42.380 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:42.380 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:42.380 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:42.380 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.4", 2020-04-22T14:19:42.380 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBETqBePwJSBRAAXgMKuX3EILi3gy8QzR4cig==", 2020-04-22T14:19:42.380 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:19:42.384 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:19:42.384 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:19:42.384 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:19:42.384 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:42.384 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:42.385 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:42.385 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.5", 2020-04-22T14:19:42.385 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBGTqBe5l++KRAAHIWG6bBnru2EVXv/drAL0g==", 2020-04-22T14:19:42.385 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:19:42.385 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:19:42.385 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:19:42.385 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:19:42.385 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:42.386 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:42.386 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:42.386 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.6", 2020-04-22T14:19:42.386 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBJTqBe88rTEBAAO2Z78NZLTYIbBpYovBSHVQ==", 2020-04-22T14:19:42.386 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:19:42.386 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:19:42.386 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:19:42.387 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:19:42.387 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:42.387 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:42.387 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:42.387 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.7", 2020-04-22T14:19:42.387 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBLTqBeGNFIMxAARIXhPNM6xurdnDv8+xZqUw==", 2020-04-22T14:19:42.387 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:19:42.387 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:19:42.388 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:19:42.388 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:19:42.388 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:42.388 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:42.388 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:42.388 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.0", 2020-04-22T14:19:42.388 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBe5ooUNxAA9zBtv6+i3Xl9iYtRl4xKGg==", 2020-04-22T14:19:42.388 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:19:42.389 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:19:42.389 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:19:42.389 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:19:42.389 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:42.389 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:42.389 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:42.389 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.1", 2020-04-22T14:19:42.390 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAyTqBe0bioBBAAVpoQouA/QICwqRoaFbjkiA==", 2020-04-22T14:19:42.390 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:19:42.390 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:19:42.390 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:19:42.390 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:19:42.390 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:42.390 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:42.390 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:42.391 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.2", 2020-04-22T14:19:42.391 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAyTqBemwpXCxAAObNL96zS67nMEe4MLjrEtw==", 2020-04-22T14:19:42.391 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:19:42.391 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:19:42.391 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:19:42.391 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:19:42.391 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:42.391 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:42.392 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:42.392 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.3", 2020-04-22T14:19:42.392 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAyTqBemGxNFBAAlqvB8FeZbMRwvzVjBpH/tA==", 2020-04-22T14:19:42.392 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:19:42.392 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:19:42.392 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:19:42.392 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:19:42.393 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:42.393 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:42.393 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:42.393 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.admin", 2020-04-22T14:19:42.393 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAwTqBeSx5dHxAAH0jPkaiWEwpr66ROWwbU8Q==", 2020-04-22T14:19:42.393 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:19:42.393 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2020-04-22T14:19:42.393 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:19:42.394 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:19:42.394 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:19:42.394 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:42.394 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:42.394 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:42.394 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mgr.x", 2020-04-22T14:19:42.394 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBe3YVhGhAAWAf6f9sV3bzoucBBPS3j2g==", 2020-04-22T14:19:42.395 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:19:42.395 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2020-04-22T14:19:42.395 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile mgr", 2020-04-22T14:19:42.395 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:19:42.395 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:42.395 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:42.395 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:42.395 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mgr.y", 2020-04-22T14:19:42.396 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBeX8AXExAAhh/N+/ogdKlxmkveSM60+g==", 2020-04-22T14:19:42.396 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:19:42.396 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2020-04-22T14:19:42.396 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile mgr", 2020-04-22T14:19:42.396 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:19:42.396 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:42.396 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:42.396 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:19:42.397 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:19:42.398 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:42.411 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:19:42.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.556+0000 7f0ac40ae700 1 Processor -- start 2020-04-22T14:19:42.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.556+0000 7f0ac40ae700 1 -- start start 2020-04-22T14:19:42.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.557+0000 7f0ac40ae700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0abc065fe0 0x7f0abc1464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:42.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.557+0000 7f0ac40ae700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0abc063e30 0x7f0abc0642a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:42.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.557+0000 7f0ac40ae700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0abc143300 con 0x7f0abc12c0d0 2020-04-22T14:19:42.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.557+0000 7f0ac40ae700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0abc1435a0 con 0x7f0abc063e30 2020-04-22T14:19:42.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.557+0000 7f0ac40ae700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc143840 con 0x7f0abc065fe0 2020-04-22T14:19:42.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.557+0000 7f0ac264b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0abc063e30 0x7f0abc0642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:42.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.557+0000 7f0ac264b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0abc063e30 0x7f0abc0642a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58172/0 (socket says 172.21.15.103:58172) 2020-04-22T14:19:42.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.557+0000 7f0ac264b700 1 -- 172.21.15.103:0/4125238601 learned_addr learned my addr 172.21.15.103:0/4125238601 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:19:42.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.557+0000 7f0ac1649700 1 --2- 172.21.15.103:0/4125238601 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0abc065fe0 0x7f0abc1464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:42.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.557+0000 7f0ac264b700 1 -- 172.21.15.103:0/4125238601 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0abc065fe0 msgr2=0x7f0abc1464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:42.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.557+0000 7f0ac264b700 1 --2- 172.21.15.103:0/4125238601 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0abc065fe0 0x7f0abc1464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:42.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.557+0000 7f0ac264b700 1 -- 172.21.15.103:0/4125238601 >> v1:172.21.15.86:6789/0 conn(0x7f0abc12c0d0 legacy=0x7f0abc05b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:42.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.557+0000 7f0ac264b700 1 -- 172.21.15.103:0/4125238601 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0abc05bb50 con 0x7f0abc063e30 2020-04-22T14:19:42.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.557+0000 7f0ac1649700 1 --2- 172.21.15.103:0/4125238601 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0abc065fe0 0x7f0abc1464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:19:42.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.557+0000 7f0ac264b700 1 --2- 172.21.15.103:0/4125238601 >> v2:172.21.15.103:3300/0 conn(0x7f0abc063e30 0x7f0abc0642a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0abc0613e0 tx=0x7f0ab4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.557+0000 7f0ac264b700 1 --2- 172.21.15.103:0/4125238601 >> v2:172.21.15.103:3300/0 conn(0x7f0abc063e30 0x7f0abc0642a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0abc0613e0 tx=0x7f0ab4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.557+0000 7f0ac264b700 1 --2- 172.21.15.103:0/4125238601 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0abc063e30 0x7f0abc0642a0 secure :-1 s=READY pgs=2019 cs=0 l=1 rx=0x7f0abc0613e0 tx=0x7f0ab4007dc0).ready entity=mon.1 client_cookie=8470cde181f83b14 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:42.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.557+0000 7f0ac264b700 1 --2- 172.21.15.103:0/4125238601 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0abc063e30 0x7f0abc0642a0 secure :-1 s=THROTTLE_DONE pgs=2019 cs=0 l=1 rx=0x7f0abc0613e0 tx=0x7f0ab4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.557+0000 7f0ac264b700 1 --2- 172.21.15.103:0/4125238601 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0abc063e30 0x7f0abc0642a0 secure :-1 s=THROTTLE_DONE pgs=2019 cs=0 l=1 rx=0x7f0abc0613e0 tx=0x7f0ab4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.557+0000 7f0ac0e48700 1 -- 172.21.15.103:0/4125238601 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ab400a180 con 0x7f0abc063e30 2020-04-22T14:19:42.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.557+0000 7f0ac264b700 1 --2- 172.21.15.103:0/4125238601 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0abc063e30 0x7f0abc0642a0 secure :-1 s=THROTTLE_DONE pgs=2019 cs=0 l=1 rx=0x7f0abc0613e0 tx=0x7f0ab4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.557+0000 7f0ac0e48700 1 -- 172.21.15.103:0/4125238601 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab400a2e0 con 0x7f0abc063e30 2020-04-22T14:19:42.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.557+0000 7f0ac0e48700 1 -- 172.21.15.103:0/4125238601 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ab400a700 con 0x7f0abc063e30 2020-04-22T14:19:42.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.558+0000 7f0ac40ae700 1 -- 172.21.15.103:0/4125238601 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0abc063e30 msgr2=0x7f0abc0642a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:42.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.558+0000 7f0ac40ae700 1 --2- 172.21.15.103:0/4125238601 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0abc063e30 0x7f0abc0642a0 secure :-1 s=READY pgs=2019 cs=0 l=1 rx=0x7f0abc0613e0 tx=0x7f0ab4007dc0).stop 2020-04-22T14:19:42.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.558+0000 7f0ac40ae700 1 -- 172.21.15.103:0/4125238601 shutdown_connections 2020-04-22T14:19:42.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.558+0000 7f0ac40ae700 1 --2- 172.21.15.103:0/4125238601 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0abc063e30 0x7f0abc0642a0 unknown :-1 s=CLOSED pgs=2019 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:42.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.558+0000 7f0ac40ae700 1 --2- 172.21.15.103:0/4125238601 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0abc065fe0 0x7f0abc1464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:42.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.558+0000 7f0ac40ae700 1 -- 172.21.15.103:0/4125238601 >> 172.21.15.103:0/4125238601 conn(0x7f0abc0b9160 msgr2=0x7f0abc05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:42.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.558+0000 7f0ac40ae700 1 -- 172.21.15.103:0/4125238601 shutdown_connections 2020-04-22T14:19:42.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.558+0000 7f0ac40ae700 1 -- 172.21.15.103:0/4125238601 wait complete. 2020-04-22T14:19:42.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.559+0000 7f0ac40ae700 1 Processor -- start 2020-04-22T14:19:42.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.559+0000 7f0ac40ae700 1 -- start start 2020-04-22T14:19:42.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.560+0000 7f0ac40ae700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0abc065fe0 0x7f0abc0b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:42.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.560+0000 7f0ac40ae700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0abc12c0d0 0x7f0abc141eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:42.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.560+0000 7f0ac40ae700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0abc0b4700 con 0x7f0abc063e30 2020-04-22T14:19:42.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.560+0000 7f0ac40ae700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0abc152e00 con 0x7f0abc12c0d0 2020-04-22T14:19:42.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.560+0000 7f0ac40ae700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc0b5a90 con 0x7f0abc065fe0 2020-04-22T14:19:42.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.560+0000 7f0ac1e4a700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f0abc063e30 0x7f0abc0b5380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50368/0 (socket says 172.21.15.103:50368) 2020-04-22T14:19:42.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.560+0000 7f0ac1e4a700 1 -- 172.21.15.103:0/2518416901 learned_addr learned my addr 172.21.15.103:0/2518416901 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:42.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.560+0000 7f0ac264b700 1 --2- 172.21.15.103:0/2518416901 >> v2:172.21.15.86:3300/0 conn(0x7f0abc12c0d0 0x7f0abc141eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:42.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.560+0000 7f0ac1649700 1 --2- 172.21.15.103:0/2518416901 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0abc065fe0 0x7f0abc0b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:42.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.560+0000 7f0aaaffd700 1 -- 172.21.15.103:0/2518416901 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 578027486 0 0) 0x7f0aac0020d0 con 0x7f0abc063e30 2020-04-22T14:19:42.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.560+0000 7f0aaaffd700 1 -- 172.21.15.103:0/2518416901 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a9c002fe0 con 0x7f0abc063e30 2020-04-22T14:19:42.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.560+0000 7f0aaaffd700 1 -- 172.21.15.103:0/2518416901 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 14935572 0 0) 0x7f0a9c002fe0 con 0x7f0abc063e30 2020-04-22T14:19:42.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.560+0000 7f0ac1649700 1 -- 172.21.15.103:0/2518416901 >> v2:172.21.15.86:3300/0 conn(0x7f0abc12c0d0 msgr2=0x7f0abc141eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:42.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.560+0000 7f0ac1649700 1 --2- 172.21.15.103:0/2518416901 >> v2:172.21.15.86:3300/0 conn(0x7f0abc12c0d0 0x7f0abc141eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:42.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.560+0000 7f0ac1649700 1 -- 172.21.15.103:0/2518416901 >> v1:172.21.15.103:6789/0 conn(0x7f0abc063e30 legacy=0x7f0abc0b5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:42.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.560+0000 7f0ac1649700 1 -- 172.21.15.103:0/2518416901 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0abc1557a0 con 0x7f0abc065fe0 2020-04-22T14:19:42.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.560+0000 7f0ac1649700 1 --2- 172.21.15.103:0/2518416901 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0abc065fe0 0x7f0abc0b42a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0aac002c40 tx=0x7f0ab8010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.560+0000 7f0ac1649700 1 --2- 172.21.15.103:0/2518416901 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0abc065fe0 0x7f0abc0b42a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0aac002c40 tx=0x7f0ab8010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.560+0000 7f0ac1649700 1 --2- 172.21.15.103:0/2518416901 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0abc065fe0 0x7f0abc0b42a0 secure :-1 s=READY pgs=188 cs=0 l=1 rx=0x7f0aac002c40 tx=0x7f0ab8010a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:42.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.561+0000 7f0ac1649700 1 --2- 172.21.15.103:0/2518416901 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0abc065fe0 0x7f0abc0b42a0 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f0aac002c40 tx=0x7f0ab8010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.561+0000 7f0aaaffd700 1 -- 172.21.15.103:0/2518416901 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0aac002aa0 con 0x7f0abc065fe0 2020-04-22T14:19:42.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.561+0000 7f0ac1649700 1 --2- 172.21.15.103:0/2518416901 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0abc065fe0 0x7f0abc0b42a0 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f0aac002c40 tx=0x7f0ab8010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.561+0000 7f0aaaffd700 1 -- 172.21.15.103:0/2518416901 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab8009dd0 con 0x7f0abc065fe0 2020-04-22T14:19:42.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.561+0000 7f0ac1649700 1 --2- 172.21.15.103:0/2518416901 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0abc065fe0 0x7f0abc0b42a0 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f0aac002c40 tx=0x7f0ab8010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.561+0000 7f0ac40ae700 1 -- 172.21.15.103:0/2518416901 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0abc155a40 con 0x7f0abc065fe0 2020-04-22T14:19:42.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.561+0000 7f0aaaffd700 1 -- 172.21.15.103:0/2518416901 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ab80093b0 con 0x7f0abc065fe0 2020-04-22T14:19:42.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.561+0000 7f0ac40ae700 1 -- 172.21.15.103:0/2518416901 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0abc156180 con 0x7f0abc065fe0 2020-04-22T14:19:42.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.561+0000 7f0ac1649700 1 --2- 172.21.15.103:0/2518416901 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0abc065fe0 0x7f0abc0b42a0 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f0aac002c40 tx=0x7f0ab8010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.562+0000 7f0ac40ae700 1 -- 172.21.15.103:0/2518416901 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0abc056c90 con 0x7f0abc065fe0 2020-04-22T14:19:42.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.562+0000 7f0aaaffd700 1 -- 172.21.15.103:0/2518416901 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f0ab8007190 con 0x7f0abc065fe0 2020-04-22T14:19:42.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.562+0000 7f0ac1649700 1 --2- 172.21.15.103:0/2518416901 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0abc065fe0 0x7f0abc0b42a0 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f0aac002c40 tx=0x7f0ab8010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.562+0000 7f0aaaffd700 1 --2- 172.21.15.103:0/2518416901 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0a9c04dc70 0x7f0a9c050130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:42.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.562+0000 7f0aaaffd700 1 -- 172.21.15.103:0/2518416901 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f0ab80609e0 con 0x7f0abc065fe0 2020-04-22T14:19:42.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.562+0000 7f0ac1e4a700 1 --2- 172.21.15.103:0/2518416901 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0a9c04dc70 0x7f0a9c050130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:42.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.563+0000 7f0ac1e4a700 1 --2- 172.21.15.103:0/2518416901 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0a9c04dc70 0x7f0a9c050130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0aac002e20 tx=0x7f0aac0096e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.563+0000 7f0ac1e4a700 1 --2- 172.21.15.103:0/2518416901 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0a9c04dc70 0x7f0a9c050130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0aac002e20 tx=0x7f0aac0096e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.563+0000 7f0ac1e4a700 1 --2- 172.21.15.103:0/2518416901 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0a9c04dc70 0x7f0a9c050130 secure :-1 s=READY pgs=735 cs=0 l=1 rx=0x7f0aac002e20 tx=0x7f0aac0096e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:42.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.566+0000 7f0ac1649700 1 --2- 172.21.15.103:0/2518416901 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0abc065fe0 0x7f0abc0b42a0 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f0aac002c40 tx=0x7f0ab8010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.566+0000 7f0aaaffd700 1 -- 172.21.15.103:0/2518416901 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f0ab803be20 con 0x7f0abc065fe0 2020-04-22T14:19:42.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.714+0000 7f0ac40ae700 1 -- 172.21.15.103:0/2518416901 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0abc05b930 con 0x7f0abc065fe0 2020-04-22T14:19:42.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.717+0000 7f0ac1649700 1 --2- 172.21.15.103:0/2518416901 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0abc065fe0 0x7f0abc0b42a0 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f0aac002c40 tx=0x7f0ab8010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.717+0000 7f0aaaffd700 1 -- 172.21.15.103:0/2518416901 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+13242 (secure 0 0 0) 0x7f0ab803f440 con 0x7f0abc065fe0 2020-04-22T14:19:42.720 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:19:42.720 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":142,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:19:41.933910+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:19:42.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.719+0000 7f0ac40ae700 1 -- 172.21.15.103:0/2518416901 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0a9c04dc70 msgr2=0x7f0a9c050130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:42.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.719+0000 7f0ac40ae700 1 --2- 172.21.15.103:0/2518416901 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0a9c04dc70 0x7f0a9c050130 secure :-1 s=READY pgs=735 cs=0 l=1 rx=0x7f0aac002e20 tx=0x7f0aac0096e0).stop 2020-04-22T14:19:42.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.719+0000 7f0ac40ae700 1 -- 172.21.15.103:0/2518416901 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0abc065fe0 msgr2=0x7f0abc0b42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:42.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.719+0000 7f0ac40ae700 1 --2- 172.21.15.103:0/2518416901 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0abc065fe0 0x7f0abc0b42a0 secure :-1 s=READY pgs=188 cs=0 l=1 rx=0x7f0aac002c40 tx=0x7f0ab8010a40).stop 2020-04-22T14:19:42.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.719+0000 7f0ac40ae700 1 -- 172.21.15.103:0/2518416901 shutdown_connections 2020-04-22T14:19:42.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.719+0000 7f0ac40ae700 1 --2- 172.21.15.103:0/2518416901 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0a9c04dc70 0x7f0a9c050130 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:42.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.719+0000 7f0ac40ae700 1 --2- 172.21.15.103:0/2518416901 >> v2:172.21.15.86:3300/0 conn(0x7f0abc12c0d0 0x7f0abc141eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:42.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.719+0000 7f0ac40ae700 1 --2- 172.21.15.103:0/2518416901 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0abc065fe0 0x7f0abc0b42a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:42.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.719+0000 7f0ac40ae700 1 -- 172.21.15.103:0/2518416901 >> 172.21.15.103:0/2518416901 conn(0x7f0abc0b9160 msgr2=0x7f0abc062a90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:42.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.719+0000 7f0ac40ae700 1 -- 172.21.15.103:0/2518416901 shutdown_connections 2020-04-22T14:19:42.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.719+0000 7f0ac40ae700 1 -- 172.21.15.103:0/2518416901 wait complete. 2020-04-22T14:19:42.732 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:19:42.732 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:42.745 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:19:42.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.891+0000 7ff058eda700 1 Processor -- start 2020-04-22T14:19:42.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.891+0000 7ff058eda700 1 -- start start 2020-04-22T14:19:42.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.892+0000 7ff058eda700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0540b9140 0x7ff05412b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:42.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.892+0000 7ff058eda700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff05412b670 0x7ff054143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:42.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.892+0000 7ff058eda700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0541467e0 con 0x7ff0540ac950 2020-04-22T14:19:42.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.892+0000 7ff058eda700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0540602f0 con 0x7ff05412b670 2020-04-22T14:19:42.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.892+0000 7ff058eda700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff054060050 con 0x7ff0540b9140 2020-04-22T14:19:42.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.892+0000 7ff052d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff05412b670 0x7ff054143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:42.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.892+0000 7ff05259c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0540b9140 0x7ff05412b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:42.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.892+0000 7ff052d9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff05412b670 0x7ff054143090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:55418/0 (socket says 172.21.15.103:55418) 2020-04-22T14:19:42.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.892+0000 7ff052d9d700 1 -- 172.21.15.103:0/225343374 learned_addr learned my addr 172.21.15.103:0/225343374 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:19:42.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.893+0000 7ff052d9d700 1 -- 172.21.15.103:0/225343374 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0540b9140 msgr2=0x7ff05412b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:42.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.893+0000 7ff052d9d700 1 --2- 172.21.15.103:0/225343374 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0540b9140 0x7ff05412b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:42.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.893+0000 7ff052d9d700 1 -- 172.21.15.103:0/225343374 >> v1:172.21.15.86:6789/0 conn(0x7ff0540ac950 legacy=0x7ff054146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:42.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.893+0000 7ff052d9d700 1 -- 172.21.15.103:0/225343374 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0540b9520 con 0x7ff05412b670 2020-04-22T14:19:42.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.893+0000 7ff05259c700 1 --2- 172.21.15.103:0/225343374 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0540b9140 0x7ff05412b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:19:42.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.893+0000 7ff052d9d700 1 --2- 172.21.15.103:0/225343374 >> v2:172.21.15.86:3300/0 conn(0x7ff05412b670 0x7ff054143090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff04c0032b0 tx=0x7ff04c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.893+0000 7ff052d9d700 1 --2- 172.21.15.103:0/225343374 >> v2:172.21.15.86:3300/0 conn(0x7ff05412b670 0x7ff054143090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff04c0032b0 tx=0x7ff04c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.893+0000 7ff052d9d700 1 --2- 172.21.15.103:0/225343374 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff05412b670 0x7ff054143090 secure :-1 s=READY pgs=1064 cs=0 l=1 rx=0x7ff04c0032b0 tx=0x7ff04c007dc0).ready entity=mon.0 client_cookie=ec823e8c83abbed9 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:42.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.893+0000 7ff052d9d700 1 --2- 172.21.15.103:0/225343374 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff05412b670 0x7ff054143090 secure :-1 s=THROTTLE_DONE pgs=1064 cs=0 l=1 rx=0x7ff04c0032b0 tx=0x7ff04c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.893+0000 7ff05159a700 1 -- 172.21.15.103:0/225343374 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff04c00a180 con 0x7ff05412b670 2020-04-22T14:19:42.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.893+0000 7ff052d9d700 1 --2- 172.21.15.103:0/225343374 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff05412b670 0x7ff054143090 secure :-1 s=THROTTLE_DONE pgs=1064 cs=0 l=1 rx=0x7ff04c0032b0 tx=0x7ff04c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.893+0000 7ff052d9d700 1 --2- 172.21.15.103:0/225343374 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff05412b670 0x7ff054143090 secure :-1 s=THROTTLE_DONE pgs=1064 cs=0 l=1 rx=0x7ff04c0032b0 tx=0x7ff04c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.893+0000 7ff05159a700 1 -- 172.21.15.103:0/225343374 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04c00a320 con 0x7ff05412b670 2020-04-22T14:19:42.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.893+0000 7ff05159a700 1 -- 172.21.15.103:0/225343374 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff04c00a740 con 0x7ff05412b670 2020-04-22T14:19:42.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.893+0000 7ff058eda700 1 -- 172.21.15.103:0/225343374 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff05412b670 msgr2=0x7ff054143090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:42.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.893+0000 7ff058eda700 1 --2- 172.21.15.103:0/225343374 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff05412b670 0x7ff054143090 secure :-1 s=READY pgs=1064 cs=0 l=1 rx=0x7ff04c0032b0 tx=0x7ff04c007dc0).stop 2020-04-22T14:19:42.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.893+0000 7ff058eda700 1 -- 172.21.15.103:0/225343374 shutdown_connections 2020-04-22T14:19:42.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.893+0000 7ff058eda700 1 --2- 172.21.15.103:0/225343374 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff05412b670 0x7ff054143090 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:42.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.893+0000 7ff058eda700 1 --2- 172.21.15.103:0/225343374 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0540b9140 0x7ff05412b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:42.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.893+0000 7ff058eda700 1 -- 172.21.15.103:0/225343374 >> 172.21.15.103:0/225343374 conn(0x7ff05405b7b0 msgr2=0x7ff0540b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:42.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.893+0000 7ff058eda700 1 -- 172.21.15.103:0/225343374 shutdown_connections 2020-04-22T14:19:42.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.893+0000 7ff058eda700 1 -- 172.21.15.103:0/225343374 wait complete. 2020-04-22T14:19:42.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.894+0000 7ff058eda700 1 Processor -- start 2020-04-22T14:19:42.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.894+0000 7ff058eda700 1 -- start start 2020-04-22T14:19:42.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.895+0000 7ff058eda700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff0540b9140 0x7ff05414dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:42.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.895+0000 7ff058eda700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0540b09d0 con 0x7ff05412b670 2020-04-22T14:19:42.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.895+0000 7ff058eda700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0540b0c30 con 0x7ff0540ac950 2020-04-22T14:19:42.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.895+0000 7ff058eda700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0540b4f90 con 0x7ff0540b9140 2020-04-22T14:19:42.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.895+0000 7ff05259c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff0540ac950 0x7ff054145a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50380/0 (socket says 172.21.15.103:50380) 2020-04-22T14:19:42.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.895+0000 7ff05259c700 1 -- 172.21.15.103:0/1965673337 learned_addr learned my addr 172.21.15.103:0/1965673337 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:42.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.895+0000 7ff051d9b700 1 --2- 172.21.15.103:0/1965673337 >> v2:172.21.15.86:3300/0 conn(0x7ff0540b9140 0x7ff05414dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:42.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.895+0000 7ff04b7fe700 1 -- 172.21.15.103:0/1965673337 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3658658086 0 0) 0x7ff0540b0c30 con 0x7ff0540ac950 2020-04-22T14:19:42.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.895+0000 7ff04b7fe700 1 -- 172.21.15.103:0/1965673337 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff038002fe0 con 0x7ff0540ac950 2020-04-22T14:19:42.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.896+0000 7ff04b7fe700 1 -- 172.21.15.103:0/1965673337 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3187329019 0 0) 0x7ff0540b09d0 con 0x7ff05412b670 2020-04-22T14:19:42.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.896+0000 7ff04b7fe700 1 -- 172.21.15.103:0/1965673337 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0540b0c30 con 0x7ff05412b670 2020-04-22T14:19:42.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.896+0000 7ff04b7fe700 1 -- 172.21.15.103:0/1965673337 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 659627160 0 0) 0x7ff038002fe0 con 0x7ff0540ac950 2020-04-22T14:19:42.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.896+0000 7ff04b7fe700 1 -- 172.21.15.103:0/1965673337 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff0540b09d0 con 0x7ff0540ac950 2020-04-22T14:19:42.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.896+0000 7ff04b7fe700 1 -- 172.21.15.103:0/1965673337 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7ff03c0024c0 con 0x7ff0540ac950 2020-04-22T14:19:42.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.896+0000 7ff04b7fe700 1 -- 172.21.15.103:0/1965673337 >> v2:172.21.15.86:3300/0 conn(0x7ff0540b9140 msgr2=0x7ff05414dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:42.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.896+0000 7ff04b7fe700 1 --2- 172.21.15.103:0/1965673337 >> v2:172.21.15.86:3300/0 conn(0x7ff0540b9140 0x7ff05414dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:42.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.896+0000 7ff04b7fe700 1 -- 172.21.15.103:0/1965673337 >> v1:172.21.15.103:6789/0 conn(0x7ff0540ac950 legacy=0x7ff054145a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:42.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.896+0000 7ff04b7fe700 1 -- 172.21.15.103:0/1965673337 >> v1:172.21.15.86:6789/0 conn(0x7ff05412b670 legacy=0x7ff0540b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:42.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.896+0000 7ff04b7fe700 1 --2- 172.21.15.103:0/1965673337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff038004b20 0x7ff038004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:42.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.896+0000 7ff04b7fe700 1 --2- 172.21.15.103:0/1965673337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff038003ab0 0x7ff038003f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:42.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.896+0000 7ff04b7fe700 1 --2- 172.21.15.103:0/1965673337 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff038004390 0x7ff03800b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:42.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.896+0000 7ff04b7fe700 1 -- 172.21.15.103:0/1965673337 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0540b4f90 con 0x7ff038003ab0 2020-04-22T14:19:42.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.896+0000 7ff04b7fe700 1 -- 172.21.15.103:0/1965673337 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff038004970 con 0x7ff038004b20 2020-04-22T14:19:42.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.896+0000 7ff04b7fe700 1 -- 172.21.15.103:0/1965673337 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff03800bc30 con 0x7ff038004390 2020-04-22T14:19:42.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.896+0000 7ff051d9b700 1 --2- 172.21.15.103:0/1965673337 >> v2:172.21.15.86:3300/0 conn(0x7ff0540b9140 0x7ff05414dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:19:42.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.896+0000 7ff05259c700 1 --2- 172.21.15.103:0/1965673337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff038004b20 0x7ff038004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:42.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.896+0000 7ff052d9d700 1 --2- 172.21.15.103:0/1965673337 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff038004390 0x7ff03800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:42.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.896+0000 7ff051d9b700 1 --2- 172.21.15.103:0/1965673337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff038003ab0 0x7ff038003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:42.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.896+0000 7ff05259c700 1 -- 172.21.15.103:0/1965673337 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff038004390 msgr2=0x7ff03800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:42.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.896+0000 7ff05259c700 1 --2- 172.21.15.103:0/1965673337 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff038004390 0x7ff03800b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:42.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.896+0000 7ff05259c700 1 -- 172.21.15.103:0/1965673337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff038003ab0 msgr2=0x7ff038003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:42.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.896+0000 7ff05259c700 1 --2- 172.21.15.103:0/1965673337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff038003ab0 0x7ff038003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:42.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.896+0000 7ff05259c700 1 -- 172.21.15.103:0/1965673337 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0540b0ed0 con 0x7ff038004b20 2020-04-22T14:19:42.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.896+0000 7ff051d9b700 1 --2- 172.21.15.103:0/1965673337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff038003ab0 0x7ff038003f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:19:42.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.896+0000 7ff058eda700 1 -- 172.21.15.103:0/1965673337 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff054066780 con 0x7ff038004b20 2020-04-22T14:19:42.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.896+0000 7ff052d9d700 1 --2- 172.21.15.103:0/1965673337 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff038004390 0x7ff03800b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:19:42.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.896+0000 7ff052d9d700 1 -- 172.21.15.103:0/1965673337 reap_dead start 2020-04-22T14:19:42.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.896+0000 7ff05259c700 1 --2- 172.21.15.103:0/1965673337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff038004b20 0x7ff038004f00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff03c007ac0 tx=0x7ff03c002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.896+0000 7ff058eda700 1 -- 172.21.15.103:0/1965673337 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0540afca0 con 0x7ff038004b20 2020-04-22T14:19:42.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.896+0000 7ff05259c700 1 --2- 172.21.15.103:0/1965673337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff038004b20 0x7ff038004f00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff03c007ac0 tx=0x7ff03c002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.896+0000 7ff05259c700 1 --2- 172.21.15.103:0/1965673337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff038004b20 0x7ff038004f00 secure :-1 s=READY pgs=2022 cs=0 l=1 rx=0x7ff03c007ac0 tx=0x7ff03c002e70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:42.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.896+0000 7ff05259c700 1 --2- 172.21.15.103:0/1965673337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff038004b20 0x7ff038004f00 secure :-1 s=THROTTLE_DONE pgs=2022 cs=0 l=1 rx=0x7ff03c007ac0 tx=0x7ff03c002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.896+0000 7ff04b7fe700 1 -- 172.21.15.103:0/1965673337 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff03c007560 con 0x7ff038004b20 2020-04-22T14:19:42.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.896+0000 7ff05259c700 1 --2- 172.21.15.103:0/1965673337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff038004b20 0x7ff038004f00 secure :-1 s=THROTTLE_DONE pgs=2022 cs=0 l=1 rx=0x7ff03c007ac0 tx=0x7ff03c002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.896+0000 7ff04b7fe700 1 -- 172.21.15.103:0/1965673337 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03c005a60 con 0x7ff038004b20 2020-04-22T14:19:42.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.896+0000 7ff05259c700 1 --2- 172.21.15.103:0/1965673337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff038004b20 0x7ff038004f00 secure :-1 s=THROTTLE_DONE pgs=2022 cs=0 l=1 rx=0x7ff03c007ac0 tx=0x7ff03c002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.896+0000 7ff04b7fe700 1 -- 172.21.15.103:0/1965673337 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff03c005e40 con 0x7ff038004b20 2020-04-22T14:19:42.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.897+0000 7ff05259c700 1 --2- 172.21.15.103:0/1965673337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff038004b20 0x7ff038004f00 secure :-1 s=THROTTLE_DONE pgs=2022 cs=0 l=1 rx=0x7ff03c007ac0 tx=0x7ff03c002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.897+0000 7ff058eda700 1 -- 172.21.15.103:0/1965673337 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff054056c90 con 0x7ff038004b20 2020-04-22T14:19:42.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.897+0000 7ff04b7fe700 1 -- 172.21.15.103:0/1965673337 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ff03c00f4b0 con 0x7ff038004b20 2020-04-22T14:19:42.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.897+0000 7ff05259c700 1 --2- 172.21.15.103:0/1965673337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff038004b20 0x7ff038004f00 secure :-1 s=THROTTLE_DONE pgs=2022 cs=0 l=1 rx=0x7ff03c007ac0 tx=0x7ff03c002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.898+0000 7ff04b7fe700 1 --2- 172.21.15.103:0/1965673337 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff038051a70 0x7ff038053f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:42.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.898+0000 7ff04b7fe700 1 -- 172.21.15.103:0/1965673337 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5253+0+0 (secure 0 0 0) 0x7ff03c062450 con 0x7ff038004b20 2020-04-22T14:19:42.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.898+0000 7ff051d9b700 1 --2- 172.21.15.103:0/1965673337 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff038051a70 0x7ff038053f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:42.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.898+0000 7ff051d9b700 1 --2- 172.21.15.103:0/1965673337 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff038051a70 0x7ff038053f30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff054060f70 tx=0x7ff0440010d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.898+0000 7ff051d9b700 1 --2- 172.21.15.103:0/1965673337 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff038051a70 0x7ff038053f30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff054060f70 tx=0x7ff0440010d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.898+0000 7ff051d9b700 1 --2- 172.21.15.103:0/1965673337 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff038051a70 0x7ff038053f30 secure :-1 s=READY pgs=736 cs=0 l=1 rx=0x7ff054060f70 tx=0x7ff0440010d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:42.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.902+0000 7ff05259c700 1 --2- 172.21.15.103:0/1965673337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff038004b20 0x7ff038004f00 secure :-1 s=THROTTLE_DONE pgs=2022 cs=0 l=1 rx=0x7ff03c007ac0 tx=0x7ff03c002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:42.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:42.902+0000 7ff04b7fe700 1 -- 172.21.15.103:0/1965673337 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ff03c065e60 con 0x7ff038004b20 2020-04-22T14:19:43.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.044+0000 7ff058eda700 1 -- 172.21.15.103:0/1965673337 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff054066ce0 con 0x7ff038004b20 2020-04-22T14:19:43.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.044+0000 7ff05259c700 1 --2- 172.21.15.103:0/1965673337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff038004b20 0x7ff038004f00 secure :-1 s=THROTTLE_DONE pgs=2022 cs=0 l=1 rx=0x7ff03c007ac0 tx=0x7ff03c002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.044+0000 7ff04b7fe700 1 -- 172.21.15.103:0/1965673337 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v142) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff03c03d830 con 0x7ff038004b20 2020-04-22T14:19:43.047 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:19:43.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.045+0000 7ff058eda700 1 -- 172.21.15.103:0/1965673337 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff038051a70 msgr2=0x7ff038053f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:43.049 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.045+0000 7ff058eda700 1 --2- 172.21.15.103:0/1965673337 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff038051a70 0x7ff038053f30 secure :-1 s=READY pgs=736 cs=0 l=1 rx=0x7ff054060f70 tx=0x7ff0440010d0).stop 2020-04-22T14:19:43.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.045+0000 7ff058eda700 1 -- 172.21.15.103:0/1965673337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff038004b20 msgr2=0x7ff038004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:43.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.045+0000 7ff058eda700 1 --2- 172.21.15.103:0/1965673337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff038004b20 0x7ff038004f00 secure :-1 s=READY pgs=2022 cs=0 l=1 rx=0x7ff03c007ac0 tx=0x7ff03c002e70).stop 2020-04-22T14:19:43.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.046+0000 7ff058eda700 1 -- 172.21.15.103:0/1965673337 shutdown_connections 2020-04-22T14:19:43.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.046+0000 7ff058eda700 1 --2- 172.21.15.103:0/1965673337 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff038051a70 0x7ff038053f30 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:43.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.046+0000 7ff058eda700 1 --2- 172.21.15.103:0/1965673337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff038004b20 0x7ff038004f00 unknown :-1 s=CLOSED pgs=2022 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:43.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.046+0000 7ff058eda700 1 -- 172.21.15.103:0/1965673337 >> 172.21.15.103:0/1965673337 conn(0x7ff05405b7b0 msgr2=0x7ff054129090 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:43.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.046+0000 7ff058eda700 1 -- 172.21.15.103:0/1965673337 shutdown_connections 2020-04-22T14:19:43.051 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.046+0000 7ff058eda700 1 -- 172.21.15.103:0/1965673337 wait complete. 2020-04-22T14:19:43.058 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:43.071 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:19:43.220 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.218+0000 7f5a8990f700 1 Processor -- start 2020-04-22T14:19:43.220 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.218+0000 7f5a8990f700 1 -- start start 2020-04-22T14:19:43.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.219+0000 7f5a8990f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5a840b91e0 0x7f5a840af010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:43.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.219+0000 7f5a8990f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a8405fed0 0x7f5a840b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:43.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.219+0000 7f5a8990f700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a840b29b0 con 0x7f5a840b8e00 2020-04-22T14:19:43.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.219+0000 7f5a8990f700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a840b4270 con 0x7f5a840b91e0 2020-04-22T14:19:43.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.219+0000 7f5a8990f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a840b4510 con 0x7f5a8405fed0 2020-04-22T14:19:43.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.219+0000 7f5a8890d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f5a840b8e00 0x7f5a84142f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50392/0 (socket says 172.21.15.103:50392) 2020-04-22T14:19:43.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.219+0000 7f5a8890d700 1 -- 172.21.15.103:0/2324375951 learned_addr learned my addr 172.21.15.103:0/2324375951 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:43.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.219+0000 7f5a837fe700 1 -- 172.21.15.103:0/2324375951 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3721247370 0 0) 0x7f5a840b29b0 con 0x7f5a840b8e00 2020-04-22T14:19:43.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.219+0000 7f5a8910e700 1 --2- 172.21.15.103:0/2324375951 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a8405fed0 0x7f5a840b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:43.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.219+0000 7f5a83fff700 1 --2- 172.21.15.103:0/2324375951 >> v2:172.21.15.86:3300/0 conn(0x7f5a840b91e0 0x7f5a840af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:43.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.219+0000 7f5a837fe700 1 -- 172.21.15.103:0/2324375951 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a70003230 con 0x7f5a840b8e00 2020-04-22T14:19:43.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.219+0000 7f5a837fe700 1 -- 172.21.15.103:0/2324375951 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2770056391 0 0) 0x7f5a70003230 con 0x7f5a840b8e00 2020-04-22T14:19:43.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.219+0000 7f5a837fe700 1 -- 172.21.15.103:0/2324375951 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a8405fed0 msgr2=0x7f5a840b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:43.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.219+0000 7f5a837fe700 1 --2- 172.21.15.103:0/2324375951 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a8405fed0 0x7f5a840b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:43.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.219+0000 7f5a837fe700 1 -- 172.21.15.103:0/2324375951 >> v2:172.21.15.86:3300/0 conn(0x7f5a840b91e0 msgr2=0x7f5a840af010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:43.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.219+0000 7f5a837fe700 1 --2- 172.21.15.103:0/2324375951 >> v2:172.21.15.86:3300/0 conn(0x7f5a840b91e0 0x7f5a840af010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:43.237 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.219+0000 7f5a837fe700 1 -- 172.21.15.103:0/2324375951 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a840b2020 con 0x7f5a840b8e00 2020-04-22T14:19:43.238 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.219+0000 7f5a837fe700 1 -- 172.21.15.103:0/2324375951 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f5a740016d0 con 0x7f5a840b8e00 2020-04-22T14:19:43.238 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.219+0000 7f5a837fe700 1 -- 172.21.15.103:0/2324375951 >> v1:172.21.15.103:6789/0 conn(0x7f5a840b8e00 legacy=0x7f5a84142f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:43.238 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.219+0000 7f5a837fe700 1 --2- 172.21.15.103:0/2324375951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a70003720 0x7f5a70003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:43.238 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.219+0000 7f5a837fe700 1 --2- 172.21.15.103:0/2324375951 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a70004060 0x7f5a70004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:43.238 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.219+0000 7f5a837fe700 1 --2- 172.21.15.103:0/2324375951 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a8405fed0 0x7f5a70004ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:43.238 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.219+0000 7f5a837fe700 1 -- 172.21.15.103:0/2324375951 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a840b4270 con 0x7f5a70004060 2020-04-22T14:19:43.238 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.219+0000 7f5a837fe700 1 -- 172.21.15.103:0/2324375951 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a840b4510 con 0x7f5a70003720 2020-04-22T14:19:43.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.219+0000 7f5a837fe700 1 -- 172.21.15.103:0/2324375951 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a70004ff0 con 0x7f5a8405fed0 2020-04-22T14:19:43.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.220+0000 7f5a8890d700 1 --2- 172.21.15.103:0/2324375951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a70003720 0x7f5a70003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:43.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.220+0000 7f5a8910e700 1 --2- 172.21.15.103:0/2324375951 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a8405fed0 0x7f5a70004ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:43.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.220+0000 7f5a83fff700 1 --2- 172.21.15.103:0/2324375951 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a70004060 0x7f5a70004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:43.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.220+0000 7f5a8890d700 1 -- 172.21.15.103:0/2324375951 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a8405fed0 msgr2=0x7f5a70004ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:43.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.220+0000 7f5a8890d700 1 --2- 172.21.15.103:0/2324375951 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a8405fed0 0x7f5a70004ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:43.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.220+0000 7f5a8890d700 1 -- 172.21.15.103:0/2324375951 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a70004060 msgr2=0x7f5a70004530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:43.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.220+0000 7f5a8890d700 1 --2- 172.21.15.103:0/2324375951 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a70004060 0x7f5a70004530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:43.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.220+0000 7f5a8890d700 1 -- 172.21.15.103:0/2324375951 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a70003230 con 0x7f5a70003720 2020-04-22T14:19:43.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.220+0000 7f5a8890d700 1 --2- 172.21.15.103:0/2324375951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a70003720 0x7f5a70003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5a740013e0 tx=0x7f5a840b2210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.220+0000 7f5a8890d700 1 --2- 172.21.15.103:0/2324375951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a70003720 0x7f5a70003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5a740013e0 tx=0x7f5a840b2210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.220+0000 7f5a8890d700 1 --2- 172.21.15.103:0/2324375951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a70003720 0x7f5a70003b40 secure :-1 s=READY pgs=2024 cs=0 l=1 rx=0x7f5a740013e0 tx=0x7f5a840b2210).ready entity=mon.1 client_cookie=ba00b882a2a32ada server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:43.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.220+0000 7f5a8890d700 1 --2- 172.21.15.103:0/2324375951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a70003720 0x7f5a70003b40 secure :-1 s=THROTTLE_DONE pgs=2024 cs=0 l=1 rx=0x7f5a740013e0 tx=0x7f5a840b2210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.240 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.220+0000 7f5a8890d700 1 --2- 172.21.15.103:0/2324375951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a70003720 0x7f5a70003b40 secure :-1 s=THROTTLE_DONE pgs=2024 cs=0 l=1 rx=0x7f5a740013e0 tx=0x7f5a840b2210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.220+0000 7f5a837fe700 1 -- 172.21.15.103:0/2324375951 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a7400e180 con 0x7f5a70003720 2020-04-22T14:19:43.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.220+0000 7f5a8890d700 1 --2- 172.21.15.103:0/2324375951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a70003720 0x7f5a70003b40 secure :-1 s=THROTTLE_DONE pgs=2024 cs=0 l=1 rx=0x7f5a740013e0 tx=0x7f5a840b2210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.220+0000 7f5a837fe700 1 -- 172.21.15.103:0/2324375951 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a7400e320 con 0x7f5a70003720 2020-04-22T14:19:43.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.220+0000 7f5a837fe700 1 -- 172.21.15.103:0/2324375951 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a740100c0 con 0x7f5a70003720 2020-04-22T14:19:43.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.220+0000 7f5a8990f700 1 -- 172.21.15.103:0/2324375951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a70003720 msgr2=0x7f5a70003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:43.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.220+0000 7f5a8990f700 1 --2- 172.21.15.103:0/2324375951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a70003720 0x7f5a70003b40 secure :-1 s=READY pgs=2024 cs=0 l=1 rx=0x7f5a740013e0 tx=0x7f5a840b2210).stop 2020-04-22T14:19:43.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.220+0000 7f5a8910e700 1 -- 172.21.15.103:0/2324375951 reap_dead start 2020-04-22T14:19:43.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.221+0000 7f5a8990f700 1 -- 172.21.15.103:0/2324375951 shutdown_connections 2020-04-22T14:19:43.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.221+0000 7f5a8990f700 1 -- 172.21.15.103:0/2324375951 >> 172.21.15.103:0/2324375951 conn(0x7f5a8405b780 msgr2=0x7f5a840b8530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:43.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.221+0000 7f5a8990f700 1 -- 172.21.15.103:0/2324375951 shutdown_connections 2020-04-22T14:19:43.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.221+0000 7f5a8990f700 1 -- 172.21.15.103:0/2324375951 wait complete. 2020-04-22T14:19:43.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.221+0000 7f5a8990f700 1 Processor -- start 2020-04-22T14:19:43.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.222+0000 7f5a8990f700 1 -- start start 2020-04-22T14:19:43.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.222+0000 7f5a8990f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5a8413cf30 0x7f5a84065210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:43.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.222+0000 7f5a8990f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5a8413d310 0x7f5a840b0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:43.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.222+0000 7f5a8990f700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a84064170 con 0x7f5a84151890 2020-04-22T14:19:43.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.222+0000 7f5a8990f700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a840643a0 con 0x7f5a8413d310 2020-04-22T14:19:43.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.222+0000 7f5a8990f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a84064640 con 0x7f5a8413cf30 2020-04-22T14:19:43.244 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.222+0000 7f5a8890d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5a8413cf30 0x7f5a84065210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:43.244 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.222+0000 7f5a8890d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5a8413cf30 0x7f5a84065210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58214/0 (socket says 172.21.15.103:58214) 2020-04-22T14:19:43.244 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.222+0000 7f5a8890d700 1 -- 172.21.15.103:0/1673463687 learned_addr learned my addr 172.21.15.103:0/1673463687 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:19:43.244 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.223+0000 7f5a8910e700 1 --2- 172.21.15.103:0/1673463687 >> v2:172.21.15.86:3300/0 conn(0x7f5a8413d310 0x7f5a840b0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:43.244 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.223+0000 7f5a8890d700 1 -- 172.21.15.103:0/1673463687 >> v2:172.21.15.86:3300/0 conn(0x7f5a8413d310 msgr2=0x7f5a840b0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:43.244 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.223+0000 7f5a8890d700 1 --2- 172.21.15.103:0/1673463687 >> v2:172.21.15.86:3300/0 conn(0x7f5a8413d310 0x7f5a840b0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:43.244 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.223+0000 7f5a8890d700 1 -- 172.21.15.103:0/1673463687 >> v1:172.21.15.86:6789/0 conn(0x7f5a84151890 legacy=0x7f5a8413adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:43.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.223+0000 7f5a8890d700 1 -- 172.21.15.103:0/1673463687 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a8413d760 con 0x7f5a8413cf30 2020-04-22T14:19:43.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.223+0000 7f5a8890d700 1 --2- 172.21.15.103:0/1673463687 >> v2:172.21.15.103:3300/0 conn(0x7f5a8413cf30 0x7f5a84065210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5a740013e0 tx=0x7f5a840b2210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.223+0000 7f5a8890d700 1 --2- 172.21.15.103:0/1673463687 >> v2:172.21.15.103:3300/0 conn(0x7f5a8413cf30 0x7f5a84065210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5a740013e0 tx=0x7f5a840b2210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.223+0000 7f5a8890d700 1 --2- 172.21.15.103:0/1673463687 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a8413cf30 0x7f5a84065210 secure :-1 s=READY pgs=2025 cs=0 l=1 rx=0x7f5a740013e0 tx=0x7f5a840b2210).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:43.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.223+0000 7f5a8890d700 1 --2- 172.21.15.103:0/1673463687 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a8413cf30 0x7f5a84065210 secure :-1 s=THROTTLE_DONE pgs=2025 cs=0 l=1 rx=0x7f5a740013e0 tx=0x7f5a840b2210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.223+0000 7f5a81ffb700 1 -- 172.21.15.103:0/1673463687 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a740104c0 con 0x7f5a8413cf30 2020-04-22T14:19:43.245 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.223+0000 7f5a8890d700 1 --2- 172.21.15.103:0/1673463687 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a8413cf30 0x7f5a84065210 secure :-1 s=THROTTLE_DONE pgs=2025 cs=0 l=1 rx=0x7f5a740013e0 tx=0x7f5a840b2210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.246 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.223+0000 7f5a8890d700 1 --2- 172.21.15.103:0/1673463687 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a8413cf30 0x7f5a84065210 secure :-1 s=THROTTLE_DONE pgs=2025 cs=0 l=1 rx=0x7f5a740013e0 tx=0x7f5a840b2210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.246 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.223+0000 7f5a81ffb700 1 -- 172.21.15.103:0/1673463687 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a74010620 con 0x7f5a8413cf30 2020-04-22T14:19:43.246 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.223+0000 7f5a8990f700 1 -- 172.21.15.103:0/1673463687 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a8413b4d0 con 0x7f5a8413cf30 2020-04-22T14:19:43.246 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.223+0000 7f5a81ffb700 1 -- 172.21.15.103:0/1673463687 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a74010980 con 0x7f5a8413cf30 2020-04-22T14:19:43.246 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.223+0000 7f5a8990f700 1 -- 172.21.15.103:0/1673463687 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a840b0a80 con 0x7f5a8413cf30 2020-04-22T14:19:43.246 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.224+0000 7f5a8890d700 1 --2- 172.21.15.103:0/1673463687 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a8413cf30 0x7f5a84065210 secure :-1 s=THROTTLE_DONE pgs=2025 cs=0 l=1 rx=0x7f5a740013e0 tx=0x7f5a840b2210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.246 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.224+0000 7f5a8990f700 1 -- 172.21.15.103:0/1673463687 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a84151ca0 con 0x7f5a8413cf30 2020-04-22T14:19:43.247 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.224+0000 7f5a81ffb700 1 -- 172.21.15.103:0/1673463687 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f5a740045b0 con 0x7f5a8413cf30 2020-04-22T14:19:43.247 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.224+0000 7f5a8890d700 1 --2- 172.21.15.103:0/1673463687 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a8413cf30 0x7f5a84065210 secure :-1 s=THROTTLE_DONE pgs=2025 cs=0 l=1 rx=0x7f5a740013e0 tx=0x7f5a840b2210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.247 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.224+0000 7f5a81ffb700 1 --2- 172.21.15.103:0/1673463687 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5a6404d980 0x7f5a6404fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:43.247 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.224+0000 7f5a81ffb700 1 -- 172.21.15.103:0/1673463687 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f5a740619a0 con 0x7f5a8413cf30 2020-04-22T14:19:43.247 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.225+0000 7f5a83fff700 1 --2- 172.21.15.103:0/1673463687 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5a6404d980 0x7f5a6404fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:43.247 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.225+0000 7f5a83fff700 1 --2- 172.21.15.103:0/1673463687 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5a6404d980 0x7f5a6404fe40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5a840b15b0 tx=0x7f5a78008080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.247 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.225+0000 7f5a83fff700 1 --2- 172.21.15.103:0/1673463687 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5a6404d980 0x7f5a6404fe40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5a840b15b0 tx=0x7f5a78008080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.247 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.225+0000 7f5a83fff700 1 --2- 172.21.15.103:0/1673463687 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5a6404d980 0x7f5a6404fe40 secure :-1 s=READY pgs=737 cs=0 l=1 rx=0x7f5a840b15b0 tx=0x7f5a78008080).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:43.248 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.228+0000 7f5a8890d700 1 --2- 172.21.15.103:0/1673463687 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a8413cf30 0x7f5a84065210 secure :-1 s=THROTTLE_DONE pgs=2025 cs=0 l=1 rx=0x7f5a740013e0 tx=0x7f5a840b2210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.248 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.228+0000 7f5a81ffb700 1 -- 172.21.15.103:0/1673463687 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f5a84151ca0 con 0x7f5a8413cf30 2020-04-22T14:19:43.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.370+0000 7f5a8990f700 1 -- 172.21.15.103:0/1673463687 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5a84151ca0 con 0x7f5a8413cf30 2020-04-22T14:19:43.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.370+0000 7f5a8890d700 1 --2- 172.21.15.103:0/1673463687 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a8413cf30 0x7f5a84065210 secure :-1 s=THROTTLE_DONE pgs=2025 cs=0 l=1 rx=0x7f5a740013e0 tx=0x7f5a840b2210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.370+0000 7f5a81ffb700 1 -- 172.21.15.103:0/1673463687 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v142) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5a84151ca0 con 0x7f5a8413cf30 2020-04-22T14:19:43.373 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:19:43.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.371+0000 7f5a8990f700 1 -- 172.21.15.103:0/1673463687 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5a6404d980 msgr2=0x7f5a6404fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:43.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.371+0000 7f5a8990f700 1 --2- 172.21.15.103:0/1673463687 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5a6404d980 0x7f5a6404fe40 secure :-1 s=READY pgs=737 cs=0 l=1 rx=0x7f5a840b15b0 tx=0x7f5a78008080).stop 2020-04-22T14:19:43.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.371+0000 7f5a8990f700 1 -- 172.21.15.103:0/1673463687 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a8413cf30 msgr2=0x7f5a84065210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:43.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.371+0000 7f5a8990f700 1 --2- 172.21.15.103:0/1673463687 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a8413cf30 0x7f5a84065210 secure :-1 s=READY pgs=2025 cs=0 l=1 rx=0x7f5a740013e0 tx=0x7f5a840b2210).stop 2020-04-22T14:19:43.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.371+0000 7f5a8990f700 1 -- 172.21.15.103:0/1673463687 shutdown_connections 2020-04-22T14:19:43.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.371+0000 7f5a8990f700 1 --2- 172.21.15.103:0/1673463687 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5a6404d980 0x7f5a6404fe40 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:43.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.371+0000 7f5a8990f700 1 --2- 172.21.15.103:0/1673463687 >> v2:172.21.15.86:3300/0 conn(0x7f5a8413d310 0x7f5a840b0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:43.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.371+0000 7f5a8990f700 1 --2- 172.21.15.103:0/1673463687 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a8413cf30 0x7f5a84065210 unknown :-1 s=CLOSED pgs=2025 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:43.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.371+0000 7f5a8990f700 1 -- 172.21.15.103:0/1673463687 >> 172.21.15.103:0/1673463687 conn(0x7f5a8405b780 msgr2=0x7f5a840614b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:43.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.372+0000 7f5a8990f700 1 -- 172.21.15.103:0/1673463687 shutdown_connections 2020-04-22T14:19:43.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.372+0000 7f5a8990f700 1 -- 172.21.15.103:0/1673463687 wait complete. 2020-04-22T14:19:43.384 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:43.398 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-04-22T14:19:43.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.542+0000 7f90d49c3700 1 Processor -- start 2020-04-22T14:19:43.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.542+0000 7f90d49c3700 1 -- start start 2020-04-22T14:19:43.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.543+0000 7f90d49c3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90d0146ad0 0x7f90d0146f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:43.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.543+0000 7f90d49c3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f90d00ad900 0x7f90d00addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:43.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.543+0000 7f90d49c3700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90d0143810 con 0x7f90d00620a0 2020-04-22T14:19:43.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.543+0000 7f90d49c3700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90d01473b0 con 0x7f90d00ad900 2020-04-22T14:19:43.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.543+0000 7f90d49c3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d0143ab0 con 0x7f90d0146ad0 2020-04-22T14:19:43.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.543+0000 7f90cf7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f90d00620a0 0x7f90d0142e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50412/0 (socket says 172.21.15.103:50412) 2020-04-22T14:19:43.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.543+0000 7f90cf7fe700 1 -- 172.21.15.103:0/2434057116 learned_addr learned my addr 172.21.15.103:0/2434057116 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:43.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.543+0000 7f90ceffd700 1 -- 172.21.15.103:0/2434057116 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1097380989 0 0) 0x7f90d0143810 con 0x7f90d00620a0 2020-04-22T14:19:43.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.543+0000 7f90ceffd700 1 -- 172.21.15.103:0/2434057116 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90b0003230 con 0x7f90d00620a0 2020-04-22T14:19:43.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.543+0000 7f90cffff700 1 --2- 172.21.15.103:0/2434057116 >> v2:172.21.15.86:3300/0 conn(0x7f90d00ad900 0x7f90d00addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:43.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.543+0000 7f90c7fff700 1 --2- 172.21.15.103:0/2434057116 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90d0146ad0 0x7f90d0146f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:43.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.543+0000 7f90ceffd700 1 -- 172.21.15.103:0/2434057116 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2852322085 0 0) 0x7f90b0003230 con 0x7f90d00620a0 2020-04-22T14:19:43.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.543+0000 7f90ceffd700 1 -- 172.21.15.103:0/2434057116 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90d0146ad0 msgr2=0x7f90d0146f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:43.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.543+0000 7f90ceffd700 1 --2- 172.21.15.103:0/2434057116 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90d0146ad0 0x7f90d0146f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:43.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.543+0000 7f90ceffd700 1 -- 172.21.15.103:0/2434057116 >> v2:172.21.15.86:3300/0 conn(0x7f90d00ad900 msgr2=0x7f90d00addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:43.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.543+0000 7f90ceffd700 1 --2- 172.21.15.103:0/2434057116 >> v2:172.21.15.86:3300/0 conn(0x7f90d00ad900 0x7f90d00addb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:43.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.543+0000 7f90ceffd700 1 -- 172.21.15.103:0/2434057116 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d0143d50 con 0x7f90d00620a0 2020-04-22T14:19:43.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.543+0000 7f90ceffd700 1 -- 172.21.15.103:0/2434057116 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f90c00016d0 con 0x7f90d00620a0 2020-04-22T14:19:43.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.543+0000 7f90ceffd700 1 -- 172.21.15.103:0/2434057116 >> v1:172.21.15.103:6789/0 conn(0x7f90d00620a0 legacy=0x7f90d0142e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:43.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.543+0000 7f90ceffd700 1 --2- 172.21.15.103:0/2434057116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90b0003720 0x7f90b0003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:43.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.543+0000 7f90ceffd700 1 --2- 172.21.15.103:0/2434057116 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90d0146ad0 0x7f90b00044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:43.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.543+0000 7f90ceffd700 1 --2- 172.21.15.103:0/2434057116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90b0004930 0x7f90b0004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:43.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.543+0000 7f90ceffd700 1 -- 172.21.15.103:0/2434057116 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d01473b0 con 0x7f90b0003720 2020-04-22T14:19:43.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.543+0000 7f90ceffd700 1 -- 172.21.15.103:0/2434057116 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d0143ab0 con 0x7f90b0004930 2020-04-22T14:19:43.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.543+0000 7f90ceffd700 1 -- 172.21.15.103:0/2434057116 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90b0005380 con 0x7f90d0146ad0 2020-04-22T14:19:43.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.544+0000 7f90cffff700 1 --2- 172.21.15.103:0/2434057116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90b0004930 0x7f90b0004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:43.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.544+0000 7f90cf7fe700 1 --2- 172.21.15.103:0/2434057116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90b0003720 0x7f90b0003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:43.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.544+0000 7f90c7fff700 1 --2- 172.21.15.103:0/2434057116 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90d0146ad0 0x7f90b00044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:43.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.544+0000 7f90cffff700 1 -- 172.21.15.103:0/2434057116 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90d0146ad0 msgr2=0x7f90b00044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:43.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.544+0000 7f90cffff700 1 --2- 172.21.15.103:0/2434057116 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90d0146ad0 0x7f90b00044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:43.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.544+0000 7f90cffff700 1 -- 172.21.15.103:0/2434057116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90b0003720 msgr2=0x7f90b0003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:43.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.544+0000 7f90cffff700 1 --2- 172.21.15.103:0/2434057116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90b0003720 0x7f90b0003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:43.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.544+0000 7f90cffff700 1 -- 172.21.15.103:0/2434057116 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b0003230 con 0x7f90b0004930 2020-04-22T14:19:43.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.544+0000 7f90cffff700 1 --2- 172.21.15.103:0/2434057116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90b0004930 0x7f90b0004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f90c80032b0 tx=0x7f90c80103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.544+0000 7f90cffff700 1 --2- 172.21.15.103:0/2434057116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90b0004930 0x7f90b0004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f90c80032b0 tx=0x7f90c80103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.544+0000 7f90cffff700 1 --2- 172.21.15.103:0/2434057116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90b0004930 0x7f90b0004db0 secure :-1 s=READY pgs=2027 cs=0 l=1 rx=0x7f90c80032b0 tx=0x7f90c80103a0).ready entity=mon.1 client_cookie=190254b36c06bef server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:43.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.544+0000 7f90cffff700 1 --2- 172.21.15.103:0/2434057116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90b0004930 0x7f90b0004db0 secure :-1 s=THROTTLE_DONE pgs=2027 cs=0 l=1 rx=0x7f90c80032b0 tx=0x7f90c80103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.544+0000 7f90ceffd700 1 -- 172.21.15.103:0/2434057116 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90c80112c0 con 0x7f90b0004930 2020-04-22T14:19:43.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.544+0000 7f90cffff700 1 --2- 172.21.15.103:0/2434057116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90b0004930 0x7f90b0004db0 secure :-1 s=THROTTLE_DONE pgs=2027 cs=0 l=1 rx=0x7f90c80032b0 tx=0x7f90c80103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.544+0000 7f90cffff700 1 --2- 172.21.15.103:0/2434057116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90b0004930 0x7f90b0004db0 secure :-1 s=THROTTLE_DONE pgs=2027 cs=0 l=1 rx=0x7f90c80032b0 tx=0x7f90c80103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.544+0000 7f90ceffd700 1 -- 172.21.15.103:0/2434057116 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c8011420 con 0x7f90b0004930 2020-04-22T14:19:43.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.544+0000 7f90ceffd700 1 -- 172.21.15.103:0/2434057116 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90c8011800 con 0x7f90b0004930 2020-04-22T14:19:43.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.544+0000 7f90d49c3700 1 -- 172.21.15.103:0/2434057116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90b0004930 msgr2=0x7f90b0004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:43.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.544+0000 7f90d49c3700 1 --2- 172.21.15.103:0/2434057116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90b0004930 0x7f90b0004db0 secure :-1 s=READY pgs=2027 cs=0 l=1 rx=0x7f90c80032b0 tx=0x7f90c80103a0).stop 2020-04-22T14:19:43.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.544+0000 7f90cffff700 1 -- 172.21.15.103:0/2434057116 reap_dead start 2020-04-22T14:19:43.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.544+0000 7f90d49c3700 1 -- 172.21.15.103:0/2434057116 shutdown_connections 2020-04-22T14:19:43.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.544+0000 7f90d49c3700 1 -- 172.21.15.103:0/2434057116 >> 172.21.15.103:0/2434057116 conn(0x7f90d005b7c0 msgr2=0x7f90d0061610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:43.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.545+0000 7f90d49c3700 1 -- 172.21.15.103:0/2434057116 shutdown_connections 2020-04-22T14:19:43.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.545+0000 7f90d49c3700 1 -- 172.21.15.103:0/2434057116 wait complete. 2020-04-22T14:19:43.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.546+0000 7f90d49c3700 1 Processor -- start 2020-04-22T14:19:43.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.546+0000 7f90d49c3700 1 -- start start 2020-04-22T14:19:43.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.546+0000 7f90d49c3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f90d013cbb0 0x7f90d0154e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:43.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.546+0000 7f90d49c3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90d013da20 0x7f90d0155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:43.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.546+0000 7f90d49c3700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90d0065bc0 con 0x7f90d0130970 2020-04-22T14:19:43.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.546+0000 7f90d49c3700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90d0065ff0 con 0x7f90d013cbb0 2020-04-22T14:19:43.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.546+0000 7f90d49c3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d00657d0 con 0x7f90d013da20 2020-04-22T14:19:43.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.546+0000 7f90cffff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f90d0130970 0x7f90d01556f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50428/0 (socket says 172.21.15.103:50428) 2020-04-22T14:19:43.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.546+0000 7f90cffff700 1 -- 172.21.15.103:0/1710363795 learned_addr learned my addr 172.21.15.103:0/1710363795 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:43.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.546+0000 7f90cf7fe700 1 --2- 172.21.15.103:0/1710363795 >> v2:172.21.15.86:3300/0 conn(0x7f90d013cbb0 0x7f90d0154e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:43.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.546+0000 7f90cd7fa700 1 -- 172.21.15.103:0/1710363795 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1014492374 0 0) 0x7f90d0065bc0 con 0x7f90d0130970 2020-04-22T14:19:43.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.546+0000 7f90cd7fa700 1 -- 172.21.15.103:0/1710363795 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90b4002fe0 con 0x7f90d0130970 2020-04-22T14:19:43.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.546+0000 7f90c7fff700 1 --2- 172.21.15.103:0/1710363795 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90d013da20 0x7f90d0155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:43.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.547+0000 7f90cd7fa700 1 -- 172.21.15.103:0/1710363795 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3825579730 0 0) 0x7f90b4002fe0 con 0x7f90d0130970 2020-04-22T14:19:43.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.547+0000 7f90cd7fa700 1 -- 172.21.15.103:0/1710363795 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f90d0065bc0 con 0x7f90d0130970 2020-04-22T14:19:43.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.547+0000 7f90cd7fa700 1 -- 172.21.15.103:0/1710363795 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f90c8007c20 con 0x7f90d0130970 2020-04-22T14:19:43.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.547+0000 7f90cf7fe700 1 -- 172.21.15.103:0/1710363795 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90d013da20 msgr2=0x7f90d0155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:43.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.547+0000 7f90cf7fe700 1 --2- 172.21.15.103:0/1710363795 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90d013da20 0x7f90d0155290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:43.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.547+0000 7f90cf7fe700 1 -- 172.21.15.103:0/1710363795 >> v1:172.21.15.103:6789/0 conn(0x7f90d0130970 legacy=0x7f90d01556f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:43.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.547+0000 7f90cf7fe700 1 -- 172.21.15.103:0/1710363795 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d013cf90 con 0x7f90d013cbb0 2020-04-22T14:19:43.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.547+0000 7f90cf7fe700 1 --2- 172.21.15.103:0/1710363795 >> v2:172.21.15.86:3300/0 conn(0x7f90d013cbb0 0x7f90d0154e30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f90c00013e0 tx=0x7f90c0009540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.547+0000 7f90cf7fe700 1 --2- 172.21.15.103:0/1710363795 >> v2:172.21.15.86:3300/0 conn(0x7f90d013cbb0 0x7f90d0154e30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f90c00013e0 tx=0x7f90c0009540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.547+0000 7f90cf7fe700 1 --2- 172.21.15.103:0/1710363795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90d013cbb0 0x7f90d0154e30 secure :-1 s=READY pgs=1067 cs=0 l=1 rx=0x7f90c00013e0 tx=0x7f90c0009540).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:43.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.547+0000 7f90cf7fe700 1 --2- 172.21.15.103:0/1710363795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90d013cbb0 0x7f90d0154e30 secure :-1 s=THROTTLE_DONE pgs=1067 cs=0 l=1 rx=0x7f90c00013e0 tx=0x7f90c0009540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.547+0000 7f90cd7fa700 1 -- 172.21.15.103:0/1710363795 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90c000fdf0 con 0x7f90d013cbb0 2020-04-22T14:19:43.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.547+0000 7f90cf7fe700 1 --2- 172.21.15.103:0/1710363795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90d013cbb0 0x7f90d0154e30 secure :-1 s=THROTTLE_DONE pgs=1067 cs=0 l=1 rx=0x7f90c00013e0 tx=0x7f90c0009540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.547+0000 7f90cf7fe700 1 --2- 172.21.15.103:0/1710363795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90d013cbb0 0x7f90d0154e30 secure :-1 s=THROTTLE_DONE pgs=1067 cs=0 l=1 rx=0x7f90c00013e0 tx=0x7f90c0009540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.547+0000 7f90cd7fa700 1 -- 172.21.15.103:0/1710363795 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c000c9e0 con 0x7f90d013cbb0 2020-04-22T14:19:43.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.547+0000 7f90cd7fa700 1 -- 172.21.15.103:0/1710363795 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90c000cd80 con 0x7f90d013cbb0 2020-04-22T14:19:43.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.547+0000 7f90d49c3700 1 -- 172.21.15.103:0/1710363795 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d013eb50 con 0x7f90d013cbb0 2020-04-22T14:19:43.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.547+0000 7f90d49c3700 1 -- 172.21.15.103:0/1710363795 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d0062cf0 con 0x7f90d013cbb0 2020-04-22T14:19:43.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.548+0000 7f90cf7fe700 1 --2- 172.21.15.103:0/1710363795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90d013cbb0 0x7f90d0154e30 secure :-1 s=THROTTLE_DONE pgs=1067 cs=0 l=1 rx=0x7f90c00013e0 tx=0x7f90c0009540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.548+0000 7f90d49c3700 1 -- 172.21.15.103:0/1710363795 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90d0065630 con 0x7f90d013cbb0 2020-04-22T14:19:43.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.548+0000 7f90cd7fa700 1 -- 172.21.15.103:0/1710363795 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f90c000e1b0 con 0x7f90d013cbb0 2020-04-22T14:19:43.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.548+0000 7f90cf7fe700 1 --2- 172.21.15.103:0/1710363795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90d013cbb0 0x7f90d0154e30 secure :-1 s=THROTTLE_DONE pgs=1067 cs=0 l=1 rx=0x7f90c00013e0 tx=0x7f90c0009540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.548+0000 7f90cd7fa700 1 --2- 172.21.15.103:0/1710363795 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f90b404df70 0x7f90b4050430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:43.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.549+0000 7f90cd7fa700 1 -- 172.21.15.103:0/1710363795 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f90c0060e70 con 0x7f90d013cbb0 2020-04-22T14:19:43.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.549+0000 7f90c7fff700 1 --2- 172.21.15.103:0/1710363795 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f90b404df70 0x7f90b4050430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:43.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.549+0000 7f90c7fff700 1 --2- 172.21.15.103:0/1710363795 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f90b404df70 0x7f90b4050430 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f90b8002f30 tx=0x7f90b800cb20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.549+0000 7f90c7fff700 1 --2- 172.21.15.103:0/1710363795 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f90b404df70 0x7f90b4050430 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f90b8002f30 tx=0x7f90b800cb20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.549+0000 7f90c7fff700 1 --2- 172.21.15.103:0/1710363795 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f90b404df70 0x7f90b4050430 secure :-1 s=READY pgs=738 cs=0 l=1 rx=0x7f90b8002f30 tx=0x7f90b800cb20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:43.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.552+0000 7f90cf7fe700 1 --2- 172.21.15.103:0/1710363795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90d013cbb0 0x7f90d0154e30 secure :-1 s=THROTTLE_DONE pgs=1067 cs=0 l=1 rx=0x7f90c00013e0 tx=0x7f90c0009540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.552+0000 7f90cd7fa700 1 -- 172.21.15.103:0/1710363795 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f90d0065630 con 0x7f90d013cbb0 2020-04-22T14:19:43.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.696+0000 7f90d49c3700 1 -- 172.21.15.103:0/1710363795 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f90d0065940 con 0x7f90d013cbb0 2020-04-22T14:19:43.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.696+0000 7f90cf7fe700 1 --2- 172.21.15.103:0/1710363795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90d013cbb0 0x7f90d0154e30 secure :-1 s=THROTTLE_DONE pgs=1067 cs=0 l=1 rx=0x7f90c00013e0 tx=0x7f90c0009540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.696+0000 7f90cd7fa700 1 -- 172.21.15.103:0/1710363795 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v142) v1 ==== 84+0+143 (secure 0 0 0) 0x7f90d0065940 con 0x7f90d013cbb0 2020-04-22T14:19:43.699 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:19:43.699 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2020-04-22T14:19:43.699 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:43.699 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 1, 2020-04-22T14:19:43.700 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": "device_health_metrics" 2020-04-22T14:19:43.700 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:43.700 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:19:43.700 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 2, 2020-04-22T14:19:43.700 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": "rbd" 2020-04-22T14:19:43.700 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:43.701 INFO:teuthology.orchestra.run.smithi103.stdout:] 2020-04-22T14:19:43.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.697+0000 7f90d49c3700 1 -- 172.21.15.103:0/1710363795 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f90b404df70 msgr2=0x7f90b4050430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:43.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.697+0000 7f90d49c3700 1 --2- 172.21.15.103:0/1710363795 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f90b404df70 0x7f90b4050430 secure :-1 s=READY pgs=738 cs=0 l=1 rx=0x7f90b8002f30 tx=0x7f90b800cb20).stop 2020-04-22T14:19:43.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.697+0000 7f90d49c3700 1 -- 172.21.15.103:0/1710363795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90d013cbb0 msgr2=0x7f90d0154e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:43.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.697+0000 7f90d49c3700 1 --2- 172.21.15.103:0/1710363795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90d013cbb0 0x7f90d0154e30 secure :-1 s=READY pgs=1067 cs=0 l=1 rx=0x7f90c00013e0 tx=0x7f90c0009540).stop 2020-04-22T14:19:43.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.697+0000 7f90d49c3700 1 -- 172.21.15.103:0/1710363795 shutdown_connections 2020-04-22T14:19:43.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.697+0000 7f90d49c3700 1 --2- 172.21.15.103:0/1710363795 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f90b404df70 0x7f90b4050430 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:43.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.697+0000 7f90d49c3700 1 --2- 172.21.15.103:0/1710363795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90d013cbb0 0x7f90d0154e30 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:43.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.697+0000 7f90d49c3700 1 --2- 172.21.15.103:0/1710363795 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f90d013da20 0x7f90d0155290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:43.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.697+0000 7f90d49c3700 1 -- 172.21.15.103:0/1710363795 >> 172.21.15.103:0/1710363795 conn(0x7f90d005b7c0 msgr2=0x7f90d00b3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:43.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.698+0000 7f90d49c3700 1 -- 172.21.15.103:0/1710363795 shutdown_connections 2020-04-22T14:19:43.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.698+0000 7f90d49c3700 1 -- 172.21.15.103:0/1710363795 wait complete. 2020-04-22T14:19:43.710 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-04-22T14:19:43.710 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:43.724 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-04-22T14:19:43.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.870+0000 7f5581e1e700 1 Processor -- start 2020-04-22T14:19:43.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.871+0000 7f5581e1e700 1 -- start start 2020-04-22T14:19:43.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.871+0000 7f5581e1e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f557c0ac950 0x7f557c146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:43.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.871+0000 7f5581e1e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f557c1467e0 con 0x7f557c1470a0 2020-04-22T14:19:43.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.871+0000 7f5581e1e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f557c060050 con 0x7f557c0b9140 2020-04-22T14:19:43.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.871+0000 7f5581e1e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f557c0602f0 con 0x7f557c0ac950 2020-04-22T14:19:43.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.871+0000 7f557b7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f557c0b9140 0x7f557c12b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50432/0 (socket says 172.21.15.103:50432) 2020-04-22T14:19:43.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.871+0000 7f557b7fe700 1 -- 172.21.15.103:0/3235381976 learned_addr learned my addr 172.21.15.103:0/3235381976 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:43.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.872+0000 7f557affd700 1 --2- 172.21.15.103:0/3235381976 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f557c0ac950 0x7f557c146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:43.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.872+0000 7f557a7fc700 1 -- 172.21.15.103:0/3235381976 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1301362287 0 0) 0x7f557c060050 con 0x7f557c0b9140 2020-04-22T14:19:43.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.872+0000 7f557a7fc700 1 -- 172.21.15.103:0/3235381976 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5568003230 con 0x7f557c0b9140 2020-04-22T14:19:43.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.872+0000 7f557a7fc700 1 -- 172.21.15.103:0/3235381976 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 49176096 0 0) 0x7f5568003230 con 0x7f557c0b9140 2020-04-22T14:19:43.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.872+0000 7f557a7fc700 1 -- 172.21.15.103:0/3235381976 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f557c0ac950 msgr2=0x7f557c146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:43.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.872+0000 7f557a7fc700 1 --2- 172.21.15.103:0/3235381976 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f557c0ac950 0x7f557c146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:43.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.872+0000 7f557a7fc700 1 -- 172.21.15.103:0/3235381976 >> v1:172.21.15.86:6789/0 conn(0x7f557c1470a0 legacy=0x7f557c143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:43.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.872+0000 7f557a7fc700 1 -- 172.21.15.103:0/3235381976 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f557c0b9520 con 0x7f557c0b9140 2020-04-22T14:19:43.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.872+0000 7f557a7fc700 1 -- 172.21.15.103:0/3235381976 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f556c0016d0 con 0x7f557c0b9140 2020-04-22T14:19:43.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.872+0000 7f557a7fc700 1 -- 172.21.15.103:0/3235381976 >> v1:172.21.15.103:6789/0 conn(0x7f557c0b9140 legacy=0x7f557c12b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:43.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.872+0000 7f557a7fc700 1 --2- 172.21.15.103:0/3235381976 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f557c0ac950 0x7f5568003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:43.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.872+0000 7f557a7fc700 1 --2- 172.21.15.103:0/3235381976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5568003b80 0x7f5568003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:43.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.872+0000 7f557a7fc700 1 --2- 172.21.15.103:0/3235381976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55680045c0 0x7f5568004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:43.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.872+0000 7f557a7fc700 1 -- 172.21.15.103:0/3235381976 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557c0602f0 con 0x7f5568003b80 2020-04-22T14:19:43.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.872+0000 7f557a7fc700 1 -- 172.21.15.103:0/3235381976 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5568004fd0 con 0x7f55680045c0 2020-04-22T14:19:43.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.872+0000 7f557a7fc700 1 -- 172.21.15.103:0/3235381976 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5568005190 con 0x7f557c0ac950 2020-04-22T14:19:43.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.872+0000 7f557bfff700 1 --2- 172.21.15.103:0/3235381976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55680045c0 0x7f5568004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:43.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.872+0000 7f557b7fe700 1 --2- 172.21.15.103:0/3235381976 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f557c0ac950 0x7f5568003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:43.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.872+0000 7f557affd700 1 --2- 172.21.15.103:0/3235381976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5568003b80 0x7f5568003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:43.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.872+0000 7f557bfff700 1 -- 172.21.15.103:0/3235381976 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f557c0ac950 msgr2=0x7f5568003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:43.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.872+0000 7f557bfff700 1 --2- 172.21.15.103:0/3235381976 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f557c0ac950 0x7f5568003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:43.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.872+0000 7f557bfff700 1 -- 172.21.15.103:0/3235381976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5568003b80 msgr2=0x7f5568003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:43.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.872+0000 7f557bfff700 1 --2- 172.21.15.103:0/3235381976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5568003b80 0x7f5568003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:43.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.872+0000 7f557bfff700 1 -- 172.21.15.103:0/3235381976 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5568003230 con 0x7f55680045c0 2020-04-22T14:19:43.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.872+0000 7f557bfff700 1 --2- 172.21.15.103:0/3235381976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55680045c0 0x7f5568004a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5574001360 tx=0x7f5574010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.872+0000 7f557bfff700 1 --2- 172.21.15.103:0/3235381976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55680045c0 0x7f5568004a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5574001360 tx=0x7f5574010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.873+0000 7f557bfff700 1 --2- 172.21.15.103:0/3235381976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55680045c0 0x7f5568004a20 secure :-1 s=READY pgs=2030 cs=0 l=1 rx=0x7f5574001360 tx=0x7f5574010160).ready entity=mon.1 client_cookie=391a85de942c4bb0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:43.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.873+0000 7f557bfff700 1 --2- 172.21.15.103:0/3235381976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55680045c0 0x7f5568004a20 secure :-1 s=THROTTLE_DONE pgs=2030 cs=0 l=1 rx=0x7f5574001360 tx=0x7f5574010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.873+0000 7f557a7fc700 1 -- 172.21.15.103:0/3235381976 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5574006c40 con 0x7f55680045c0 2020-04-22T14:19:43.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.873+0000 7f557bfff700 1 --2- 172.21.15.103:0/3235381976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55680045c0 0x7f5568004a20 secure :-1 s=THROTTLE_DONE pgs=2030 cs=0 l=1 rx=0x7f5574001360 tx=0x7f5574010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.873+0000 7f557bfff700 1 --2- 172.21.15.103:0/3235381976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55680045c0 0x7f5568004a20 secure :-1 s=THROTTLE_DONE pgs=2030 cs=0 l=1 rx=0x7f5574001360 tx=0x7f5574010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.873+0000 7f557a7fc700 1 -- 172.21.15.103:0/3235381976 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5574006de0 con 0x7f55680045c0 2020-04-22T14:19:43.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.873+0000 7f557a7fc700 1 -- 172.21.15.103:0/3235381976 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5574002730 con 0x7f55680045c0 2020-04-22T14:19:43.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.873+0000 7f5581e1e700 1 -- 172.21.15.103:0/3235381976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55680045c0 msgr2=0x7f5568004a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:43.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.873+0000 7f5581e1e700 1 --2- 172.21.15.103:0/3235381976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55680045c0 0x7f5568004a20 secure :-1 s=READY pgs=2030 cs=0 l=1 rx=0x7f5574001360 tx=0x7f5574010160).stop 2020-04-22T14:19:43.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.873+0000 7f557bfff700 1 -- 172.21.15.103:0/3235381976 reap_dead start 2020-04-22T14:19:43.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.873+0000 7f5581e1e700 1 -- 172.21.15.103:0/3235381976 shutdown_connections 2020-04-22T14:19:43.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.873+0000 7f5581e1e700 1 -- 172.21.15.103:0/3235381976 >> 172.21.15.103:0/3235381976 conn(0x7f557c05b7b0 msgr2=0x7f557c0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:43.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.873+0000 7f5581e1e700 1 -- 172.21.15.103:0/3235381976 shutdown_connections 2020-04-22T14:19:43.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.873+0000 7f5581e1e700 1 -- 172.21.15.103:0/3235381976 wait complete. 2020-04-22T14:19:43.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.874+0000 7f5581e1e700 1 Processor -- start 2020-04-22T14:19:43.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.874+0000 7f5581e1e700 1 -- start start 2020-04-22T14:19:43.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.875+0000 7f5581e1e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f557c0b1f00 0x7f557c0612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:43.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.875+0000 7f5581e1e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f557c14f260 0x7f557c0b4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:43.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.875+0000 7f5581e1e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f557c0b4ba0 con 0x7f557c0b46f0 2020-04-22T14:19:43.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.875+0000 7f5581e1e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f557c061b20 con 0x7f557c14f260 2020-04-22T14:19:43.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.875+0000 7f5581e1e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f557c061dc0 con 0x7f557c0b1f00 2020-04-22T14:19:43.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.875+0000 7f557affd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f557c14f260 0x7f557c0b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:43.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.875+0000 7f557affd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f557c14f260 0x7f557c0b4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:55488/0 (socket says 172.21.15.103:55488) 2020-04-22T14:19:43.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.875+0000 7f557b7fe700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f557c0b1f00 0x7f557c0612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:43.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.875+0000 7f557bfff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f557c0b46f0 0x7f557c1526e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:39370/0 (socket says 172.21.15.103:39370) 2020-04-22T14:19:43.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.875+0000 7f557affd700 1 -- 172.21.15.103:0/2432384496 learned_addr learned my addr 172.21.15.103:0/2432384496 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:19:43.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.875+0000 7f557affd700 1 -- 172.21.15.103:0/2432384496 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f557c0b1f00 msgr2=0x7f557c0612f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:43.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.875+0000 7f557affd700 1 --2- 172.21.15.103:0/2432384496 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f557c0b1f00 0x7f557c0612f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:43.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.876+0000 7f557affd700 1 -- 172.21.15.103:0/2432384496 >> v1:172.21.15.86:6789/0 conn(0x7f557c0b46f0 legacy=0x7f557c1526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:43.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.876+0000 7f557affd700 1 -- 172.21.15.103:0/2432384496 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f557c062060 con 0x7f557c14f260 2020-04-22T14:19:43.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.876+0000 7f5578ff9700 1 -- 172.21.15.103:0/2432384496 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3453282357 0 0) 0x7f557c0b4ba0 con 0x7f557c0b46f0 2020-04-22T14:19:43.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.876+0000 7f557affd700 1 --2- 172.21.15.103:0/2432384496 >> v2:172.21.15.86:3300/0 conn(0x7f557c14f260 0x7f557c0b4290 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5570007ed0 tx=0x7f5570010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.876+0000 7f557affd700 1 --2- 172.21.15.103:0/2432384496 >> v2:172.21.15.86:3300/0 conn(0x7f557c14f260 0x7f557c0b4290 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5570007ed0 tx=0x7f5570010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.876+0000 7f557affd700 1 --2- 172.21.15.103:0/2432384496 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f557c14f260 0x7f557c0b4290 secure :-1 s=READY pgs=1070 cs=0 l=1 rx=0x7f5570007ed0 tx=0x7f5570010b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:43.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.876+0000 7f557affd700 1 --2- 172.21.15.103:0/2432384496 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f557c14f260 0x7f557c0b4290 secure :-1 s=THROTTLE_DONE pgs=1070 cs=0 l=1 rx=0x7f5570007ed0 tx=0x7f5570010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.876+0000 7f5578ff9700 1 -- 172.21.15.103:0/2432384496 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5570007560 con 0x7f557c14f260 2020-04-22T14:19:43.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.876+0000 7f557affd700 1 --2- 172.21.15.103:0/2432384496 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f557c14f260 0x7f557c0b4290 secure :-1 s=THROTTLE_DONE pgs=1070 cs=0 l=1 rx=0x7f5570007ed0 tx=0x7f5570010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.876+0000 7f557affd700 1 --2- 172.21.15.103:0/2432384496 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f557c14f260 0x7f557c0b4290 secure :-1 s=THROTTLE_DONE pgs=1070 cs=0 l=1 rx=0x7f5570007ed0 tx=0x7f5570010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.876+0000 7f5578ff9700 1 -- 172.21.15.103:0/2432384496 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55700059c0 con 0x7f557c14f260 2020-04-22T14:19:43.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.876+0000 7f5581e1e700 1 -- 172.21.15.103:0/2432384496 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f557c0b22e0 con 0x7f557c14f260 2020-04-22T14:19:43.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.876+0000 7f5578ff9700 1 -- 172.21.15.103:0/2432384496 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5570005da0 con 0x7f557c14f260 2020-04-22T14:19:43.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.876+0000 7f5581e1e700 1 -- 172.21.15.103:0/2432384496 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f557c0b0990 con 0x7f557c14f260 2020-04-22T14:19:43.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.877+0000 7f557affd700 1 --2- 172.21.15.103:0/2432384496 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f557c14f260 0x7f557c0b4290 secure :-1 s=THROTTLE_DONE pgs=1070 cs=0 l=1 rx=0x7f5570007ed0 tx=0x7f5570010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.877+0000 7f5581e1e700 1 -- 172.21.15.103:0/2432384496 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f557c061990 con 0x7f557c14f260 2020-04-22T14:19:43.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.877+0000 7f5578ff9700 1 -- 172.21.15.103:0/2432384496 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f5570008330 con 0x7f557c14f260 2020-04-22T14:19:43.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.877+0000 7f557affd700 1 --2- 172.21.15.103:0/2432384496 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f557c14f260 0x7f557c0b4290 secure :-1 s=THROTTLE_DONE pgs=1070 cs=0 l=1 rx=0x7f5570007ed0 tx=0x7f5570010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.877+0000 7f5578ff9700 1 --2- 172.21.15.103:0/2432384496 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f555c04d900 0x7f555c04fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:43.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.877+0000 7f5578ff9700 1 -- 172.21.15.103:0/2432384496 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f5570013070 con 0x7f557c14f260 2020-04-22T14:19:43.908 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.877+0000 7f557b7fe700 1 --2- 172.21.15.103:0/2432384496 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f555c04d900 0x7f555c04fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:43.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.878+0000 7f557b7fe700 1 --2- 172.21.15.103:0/2432384496 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f555c04d900 0x7f555c04fdc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f556c0013e0 tx=0x7f557c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.878+0000 7f557b7fe700 1 --2- 172.21.15.103:0/2432384496 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f555c04d900 0x7f555c04fdc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f556c0013e0 tx=0x7f557c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.909 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.878+0000 7f557b7fe700 1 --2- 172.21.15.103:0/2432384496 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f555c04d900 0x7f555c04fdc0 secure :-1 s=READY pgs=739 cs=0 l=1 rx=0x7f556c0013e0 tx=0x7f557c0b96b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:43.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.881+0000 7f557affd700 1 --2- 172.21.15.103:0/2432384496 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f557c14f260 0x7f557c0b4290 secure :-1 s=THROTTLE_DONE pgs=1070 cs=0 l=1 rx=0x7f5570007ed0 tx=0x7f5570010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:43.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:43.881+0000 7f5578ff9700 1 -- 172.21.15.103:0/2432384496 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f557003c620 con 0x7f557c14f260 2020-04-22T14:19:44.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.022+0000 7f5581e1e700 1 -- 172.21.15.103:0/2432384496 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f557c056c90 con 0x7f557c14f260 2020-04-22T14:19:44.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.727+0000 7f557affd700 1 --2- 172.21.15.103:0/2432384496 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f557c14f260 0x7f557c0b4290 secure :-1 s=THROTTLE_DONE pgs=1070 cs=0 l=1 rx=0x7f5570007ed0 tx=0x7f5570010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:44.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.727+0000 7f5578ff9700 1 -- 172.21.15.103:0/2432384496 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v143) v1 ==== 133+0+0 (secure 0 0 0) 0x7f557000b280 con 0x7f557c14f260 2020-04-22T14:19:44.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.729+0000 7f5581e1e700 1 -- 172.21.15.103:0/2432384496 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f555c04d900 msgr2=0x7f555c04fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:44.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.729+0000 7f5581e1e700 1 --2- 172.21.15.103:0/2432384496 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f555c04d900 0x7f555c04fdc0 secure :-1 s=READY pgs=739 cs=0 l=1 rx=0x7f556c0013e0 tx=0x7f557c0b96b0).stop 2020-04-22T14:19:44.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.729+0000 7f5581e1e700 1 -- 172.21.15.103:0/2432384496 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f557c14f260 msgr2=0x7f557c0b4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:44.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.729+0000 7f5581e1e700 1 --2- 172.21.15.103:0/2432384496 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f557c14f260 0x7f557c0b4290 secure :-1 s=READY pgs=1070 cs=0 l=1 rx=0x7f5570007ed0 tx=0x7f5570010b30).stop 2020-04-22T14:19:44.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.729+0000 7f5581e1e700 1 -- 172.21.15.103:0/2432384496 shutdown_connections 2020-04-22T14:19:44.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.729+0000 7f5581e1e700 1 --2- 172.21.15.103:0/2432384496 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f557c0b1f00 0x7f557c0612f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:44.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.729+0000 7f5581e1e700 1 --2- 172.21.15.103:0/2432384496 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f555c04d900 0x7f555c04fdc0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:44.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.729+0000 7f5581e1e700 1 --2- 172.21.15.103:0/2432384496 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f557c14f260 0x7f557c0b4290 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:44.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.729+0000 7f5581e1e700 1 -- 172.21.15.103:0/2432384496 >> 172.21.15.103:0/2432384496 conn(0x7f557c05b7b0 msgr2=0x7f557c128d90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:44.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.729+0000 7f5581e1e700 1 -- 172.21.15.103:0/2432384496 shutdown_connections 2020-04-22T14:19:44.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.729+0000 7f5581e1e700 1 -- 172.21.15.103:0/2432384496 wait complete. 2020-04-22T14:19:44.733 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' created 2020-04-22T14:19:44.742 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:44.761 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-04-22T14:19:44.910 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.908+0000 7f15e79e3700 1 Processor -- start 2020-04-22T14:19:44.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.909+0000 7f15e79e3700 1 -- start start 2020-04-22T14:19:44.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.909+0000 7f15e79e3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f15e00b9890 0x7f15e0146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:44.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.909+0000 7f15e79e3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15e01434b0 0x7f15e0143910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:44.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.909+0000 7f15e79e3700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e00b6eb0 con 0x7f15e01499f0 2020-04-22T14:19:44.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.909+0000 7f15e79e3700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15e005fbc0 con 0x7f15e00b9890 2020-04-22T14:19:44.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.909+0000 7f15e79e3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e005fe60 con 0x7f15e01434b0 2020-04-22T14:19:44.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.909+0000 7f15e5f80700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f15e01499f0 0x7f15e0149e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50456/0 (socket says 172.21.15.103:50456) 2020-04-22T14:19:44.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.909+0000 7f15e5f80700 1 -- 172.21.15.103:0/2302323219 learned_addr learned my addr 172.21.15.103:0/2302323219 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:44.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.910+0000 7f15d3fff700 1 -- 172.21.15.103:0/2302323219 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1048401630 0 0) 0x7f15e00b6eb0 con 0x7f15e01499f0 2020-04-22T14:19:44.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.910+0000 7f15e577f700 1 --2- 172.21.15.103:0/2302323219 >> v2:172.21.15.86:3300/0 conn(0x7f15e00b9890 0x7f15e0146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:44.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.910+0000 7f15e4f7e700 1 --2- 172.21.15.103:0/2302323219 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15e01434b0 0x7f15e0143910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:44.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.910+0000 7f15d3fff700 1 -- 172.21.15.103:0/2302323219 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15c8003230 con 0x7f15e01499f0 2020-04-22T14:19:44.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.910+0000 7f15d3fff700 1 -- 172.21.15.103:0/2302323219 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2163405625 0 0) 0x7f15c8003230 con 0x7f15e01499f0 2020-04-22T14:19:44.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.910+0000 7f15d3fff700 1 -- 172.21.15.103:0/2302323219 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15e01434b0 msgr2=0x7f15e0143910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:44.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.910+0000 7f15d3fff700 1 --2- 172.21.15.103:0/2302323219 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15e01434b0 0x7f15e0143910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:44.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.910+0000 7f15d3fff700 1 -- 172.21.15.103:0/2302323219 >> v2:172.21.15.86:3300/0 conn(0x7f15e00b9890 msgr2=0x7f15e0146fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:44.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.910+0000 7f15d3fff700 1 --2- 172.21.15.103:0/2302323219 >> v2:172.21.15.86:3300/0 conn(0x7f15e00b9890 0x7f15e0146fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:44.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.910+0000 7f15d3fff700 1 -- 172.21.15.103:0/2302323219 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e0060100 con 0x7f15e01499f0 2020-04-22T14:19:44.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.910+0000 7f15d3fff700 1 -- 172.21.15.103:0/2302323219 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f15d8001a50 con 0x7f15e01499f0 2020-04-22T14:19:44.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.910+0000 7f15d3fff700 1 -- 172.21.15.103:0/2302323219 >> v1:172.21.15.103:6789/0 conn(0x7f15e01499f0 legacy=0x7f15e0149e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:44.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.910+0000 7f15d3fff700 1 --2- 172.21.15.103:0/2302323219 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15e01434b0 0x7f15c8003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:44.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.910+0000 7f15d3fff700 1 --2- 172.21.15.103:0/2302323219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15c8003b80 0x7f15c8003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:44.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.910+0000 7f15d3fff700 1 --2- 172.21.15.103:0/2302323219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15c80045c0 0x7f15c8004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:44.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.910+0000 7f15d3fff700 1 -- 172.21.15.103:0/2302323219 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e005fbc0 con 0x7f15c80045c0 2020-04-22T14:19:44.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.910+0000 7f15d3fff700 1 -- 172.21.15.103:0/2302323219 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e005fe60 con 0x7f15c8003b80 2020-04-22T14:19:44.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.910+0000 7f15d3fff700 1 -- 172.21.15.103:0/2302323219 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c8005050 con 0x7f15e01434b0 2020-04-22T14:19:44.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.910+0000 7f15e4f7e700 1 --2- 172.21.15.103:0/2302323219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15c8003b80 0x7f15c8003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:44.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.910+0000 7f15e577f700 1 --2- 172.21.15.103:0/2302323219 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15e01434b0 0x7f15c8003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:44.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.910+0000 7f15e5f80700 1 --2- 172.21.15.103:0/2302323219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15c80045c0 0x7f15c8004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:44.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.910+0000 7f15e4f7e700 1 -- 172.21.15.103:0/2302323219 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15e01434b0 msgr2=0x7f15c8003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:44.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.910+0000 7f15e4f7e700 1 --2- 172.21.15.103:0/2302323219 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15e01434b0 0x7f15c8003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:44.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.910+0000 7f15e4f7e700 1 -- 172.21.15.103:0/2302323219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15c80045c0 msgr2=0x7f15c8004a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:44.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.910+0000 7f15e4f7e700 1 --2- 172.21.15.103:0/2302323219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15c80045c0 0x7f15c8004a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:44.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.910+0000 7f15e4f7e700 1 -- 172.21.15.103:0/2302323219 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c8003230 con 0x7f15c8003b80 2020-04-22T14:19:44.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.910+0000 7f15e577f700 1 --2- 172.21.15.103:0/2302323219 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15e01434b0 0x7f15c8003720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:19:44.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.910+0000 7f15e4f7e700 1 --2- 172.21.15.103:0/2302323219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15c8003b80 0x7f15c8003fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f15d4008910 tx=0x7f15d4010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:44.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.911+0000 7f15e4f7e700 1 --2- 172.21.15.103:0/2302323219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15c8003b80 0x7f15c8003fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f15d4008910 tx=0x7f15d4010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:44.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.911+0000 7f15e4f7e700 1 --2- 172.21.15.103:0/2302323219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15c8003b80 0x7f15c8003fe0 secure :-1 s=READY pgs=2032 cs=0 l=1 rx=0x7f15d4008910 tx=0x7f15d4010050).ready entity=mon.1 client_cookie=ce7b3bb9bf329468 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:44.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.911+0000 7f15e4f7e700 1 --2- 172.21.15.103:0/2302323219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15c8003b80 0x7f15c8003fe0 secure :-1 s=THROTTLE_DONE pgs=2032 cs=0 l=1 rx=0x7f15d4008910 tx=0x7f15d4010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:44.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.911+0000 7f15d3fff700 1 -- 172.21.15.103:0/2302323219 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15d4008d30 con 0x7f15c8003b80 2020-04-22T14:19:44.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.911+0000 7f15e4f7e700 1 --2- 172.21.15.103:0/2302323219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15c8003b80 0x7f15c8003fe0 secure :-1 s=THROTTLE_DONE pgs=2032 cs=0 l=1 rx=0x7f15d4008910 tx=0x7f15d4010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:44.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.911+0000 7f15e4f7e700 1 --2- 172.21.15.103:0/2302323219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15c8003b80 0x7f15c8003fe0 secure :-1 s=THROTTLE_DONE pgs=2032 cs=0 l=1 rx=0x7f15d4008910 tx=0x7f15d4010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:44.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.911+0000 7f15d3fff700 1 -- 172.21.15.103:0/2302323219 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d4008e90 con 0x7f15c8003b80 2020-04-22T14:19:44.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.911+0000 7f15d3fff700 1 -- 172.21.15.103:0/2302323219 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15d4010b30 con 0x7f15c8003b80 2020-04-22T14:19:44.923 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.911+0000 7f15e79e3700 1 -- 172.21.15.103:0/2302323219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15c8003b80 msgr2=0x7f15c8003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:44.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.911+0000 7f15e79e3700 1 --2- 172.21.15.103:0/2302323219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15c8003b80 0x7f15c8003fe0 secure :-1 s=READY pgs=2032 cs=0 l=1 rx=0x7f15d4008910 tx=0x7f15d4010050).stop 2020-04-22T14:19:44.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.911+0000 7f15e5f80700 1 -- 172.21.15.103:0/2302323219 reap_dead start 2020-04-22T14:19:44.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.911+0000 7f15e79e3700 1 -- 172.21.15.103:0/2302323219 shutdown_connections 2020-04-22T14:19:44.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.911+0000 7f15e79e3700 1 -- 172.21.15.103:0/2302323219 >> 172.21.15.103:0/2302323219 conn(0x7f15e005ad30 msgr2=0x7f15e005b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:44.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.911+0000 7f15e79e3700 1 -- 172.21.15.103:0/2302323219 shutdown_connections 2020-04-22T14:19:44.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.911+0000 7f15e79e3700 1 -- 172.21.15.103:0/2302323219 wait complete. 2020-04-22T14:19:44.924 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.912+0000 7f15e79e3700 1 Processor -- start 2020-04-22T14:19:44.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.912+0000 7f15e79e3700 1 -- start start 2020-04-22T14:19:44.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.913+0000 7f15e79e3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f15e0144ac0 0x7f15e0144ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:44.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.913+0000 7f15e79e3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15e0157e10 0x7f15e00bc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:44.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.913+0000 7f15e79e3700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e00bc7b0 con 0x7f15e0143eb0 2020-04-22T14:19:44.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.913+0000 7f15e79e3700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15e00bca20 con 0x7f15e0144ac0 2020-04-22T14:19:44.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.913+0000 7f15e79e3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e00bccc0 con 0x7f15e0157e10 2020-04-22T14:19:44.925 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.913+0000 7f15e577f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f15e0144ac0 0x7f15e0144ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:44.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.913+0000 7f15e5f80700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f15e0143eb0 0x7f15e0129b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50466/0 (socket says 172.21.15.103:50466) 2020-04-22T14:19:44.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.913+0000 7f15e5f80700 1 -- 172.21.15.103:0/3007258346 learned_addr learned my addr 172.21.15.103:0/3007258346 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:44.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.913+0000 7f15e4f7e700 1 --2- 172.21.15.103:0/3007258346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15e0157e10 0x7f15e00bc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:44.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.913+0000 7f15e577f700 1 -- 172.21.15.103:0/3007258346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15e0157e10 msgr2=0x7f15e00bc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:44.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.913+0000 7f15e577f700 1 --2- 172.21.15.103:0/3007258346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15e0157e10 0x7f15e00bc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:44.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.913+0000 7f15e577f700 1 -- 172.21.15.103:0/3007258346 >> v1:172.21.15.103:6789/0 conn(0x7f15e0143eb0 legacy=0x7f15e0129b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:44.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.913+0000 7f15d27fc700 1 -- 172.21.15.103:0/3007258346 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2629346396 0 0) 0x7f15e00bc7b0 con 0x7f15e0143eb0 2020-04-22T14:19:44.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.913+0000 7f15e577f700 1 -- 172.21.15.103:0/3007258346 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e012a2a0 con 0x7f15e0144ac0 2020-04-22T14:19:44.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.913+0000 7f15e577f700 1 --2- 172.21.15.103:0/3007258346 >> v2:172.21.15.103:3300/0 conn(0x7f15e0144ac0 0x7f15e0144ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f15dc002f30 tx=0x7f15dc010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:44.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.913+0000 7f15e577f700 1 --2- 172.21.15.103:0/3007258346 >> v2:172.21.15.103:3300/0 conn(0x7f15e0144ac0 0x7f15e0144ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f15dc002f30 tx=0x7f15dc010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:44.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.913+0000 7f15e577f700 1 --2- 172.21.15.103:0/3007258346 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15e0144ac0 0x7f15e0144ea0 secure :-1 s=READY pgs=2034 cs=0 l=1 rx=0x7f15dc002f30 tx=0x7f15dc010b60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:44.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.913+0000 7f15e577f700 1 --2- 172.21.15.103:0/3007258346 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15e0144ac0 0x7f15e0144ea0 secure :-1 s=THROTTLE_DONE pgs=2034 cs=0 l=1 rx=0x7f15dc002f30 tx=0x7f15dc010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:44.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.913+0000 7f15d27fc700 1 -- 172.21.15.103:0/3007258346 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15dc007550 con 0x7f15e0144ac0 2020-04-22T14:19:44.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.913+0000 7f15e577f700 1 --2- 172.21.15.103:0/3007258346 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15e0144ac0 0x7f15e0144ea0 secure :-1 s=THROTTLE_DONE pgs=2034 cs=0 l=1 rx=0x7f15dc002f30 tx=0x7f15dc010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:44.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.913+0000 7f15e577f700 1 --2- 172.21.15.103:0/3007258346 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15e0144ac0 0x7f15e0144ea0 secure :-1 s=THROTTLE_DONE pgs=2034 cs=0 l=1 rx=0x7f15dc002f30 tx=0x7f15dc010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:44.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.913+0000 7f15d27fc700 1 -- 172.21.15.103:0/3007258346 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15dc0056c0 con 0x7f15e0144ac0 2020-04-22T14:19:44.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.913+0000 7f15e79e3700 1 -- 172.21.15.103:0/3007258346 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15e0144320 con 0x7f15e0144ac0 2020-04-22T14:19:44.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.914+0000 7f15d27fc700 1 -- 172.21.15.103:0/3007258346 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15dc005a20 con 0x7f15e0144ac0 2020-04-22T14:19:44.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.914+0000 7f15e79e3700 1 -- 172.21.15.103:0/3007258346 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15e0145830 con 0x7f15e0144ac0 2020-04-22T14:19:44.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.914+0000 7f15e577f700 1 --2- 172.21.15.103:0/3007258346 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15e0144ac0 0x7f15e0144ea0 secure :-1 s=THROTTLE_DONE pgs=2034 cs=0 l=1 rx=0x7f15dc002f30 tx=0x7f15dc010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:44.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.915+0000 7f15d27fc700 1 -- 172.21.15.103:0/3007258346 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f15dc005c90 con 0x7f15e0144ac0 2020-04-22T14:19:44.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.915+0000 7f15e577f700 1 --2- 172.21.15.103:0/3007258346 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15e0144ac0 0x7f15e0144ea0 secure :-1 s=THROTTLE_DONE pgs=2034 cs=0 l=1 rx=0x7f15dc002f30 tx=0x7f15dc010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:44.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.915+0000 7f15e79e3700 1 -- 172.21.15.103:0/3007258346 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15e00bce30 con 0x7f15e0144ac0 2020-04-22T14:19:44.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.915+0000 7f15d27fc700 1 --2- 172.21.15.103:0/3007258346 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f15c004d8f0 0x7f15c004fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:44.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.915+0000 7f15d27fc700 1 -- 172.21.15.103:0/3007258346 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f15dc061550 con 0x7f15e0144ac0 2020-04-22T14:19:44.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.915+0000 7f15e4f7e700 1 --2- 172.21.15.103:0/3007258346 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f15c004d8f0 0x7f15c004fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:44.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.915+0000 7f15e4f7e700 1 --2- 172.21.15.103:0/3007258346 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f15c004d8f0 0x7f15c004fdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f15d4008910 tx=0x7f15d4010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:44.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.915+0000 7f15e4f7e700 1 --2- 172.21.15.103:0/3007258346 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f15c004d8f0 0x7f15c004fdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f15d4008910 tx=0x7f15d4010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:44.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.915+0000 7f15e4f7e700 1 --2- 172.21.15.103:0/3007258346 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f15c004d8f0 0x7f15c004fdb0 secure :-1 s=READY pgs=740 cs=0 l=1 rx=0x7f15d4008910 tx=0x7f15d4010050).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:44.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.919+0000 7f15e577f700 1 --2- 172.21.15.103:0/3007258346 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15e0144ac0 0x7f15e0144ea0 secure :-1 s=THROTTLE_DONE pgs=2034 cs=0 l=1 rx=0x7f15dc002f30 tx=0x7f15dc010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:44.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:44.919+0000 7f15d27fc700 1 -- 172.21.15.103:0/3007258346 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f15e00bce30 con 0x7f15e0144ac0 2020-04-22T14:19:45.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.066+0000 7f15e79e3700 1 -- 172.21.15.103:0/3007258346 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f15e00bce30 con 0x7f15e0144ac0 2020-04-22T14:19:45.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.730+0000 7f15e577f700 1 --2- 172.21.15.103:0/3007258346 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15e0144ac0 0x7f15e0144ea0 secure :-1 s=THROTTLE_DONE pgs=2034 cs=0 l=1 rx=0x7f15dc002f30 tx=0x7f15dc010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:45.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.730+0000 7f15d27fc700 1 -- 172.21.15.103:0/3007258346 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v144) v1 ==== 125+0+0 (secure 0 0 0) 0x7f15e00bce30 con 0x7f15e0144ac0 2020-04-22T14:19:45.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.733+0000 7f15e79e3700 1 -- 172.21.15.103:0/3007258346 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f15c004d8f0 msgr2=0x7f15c004fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:45.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.733+0000 7f15e79e3700 1 --2- 172.21.15.103:0/3007258346 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f15c004d8f0 0x7f15c004fdb0 secure :-1 s=READY pgs=740 cs=0 l=1 rx=0x7f15d4008910 tx=0x7f15d4010050).stop 2020-04-22T14:19:45.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.733+0000 7f15e79e3700 1 -- 172.21.15.103:0/3007258346 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15e0144ac0 msgr2=0x7f15e0144ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:45.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.733+0000 7f15e79e3700 1 --2- 172.21.15.103:0/3007258346 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15e0144ac0 0x7f15e0144ea0 secure :-1 s=READY pgs=2034 cs=0 l=1 rx=0x7f15dc002f30 tx=0x7f15dc010b60).stop 2020-04-22T14:19:45.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.733+0000 7f15e79e3700 1 -- 172.21.15.103:0/3007258346 shutdown_connections 2020-04-22T14:19:45.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.733+0000 7f15e79e3700 1 --2- 172.21.15.103:0/3007258346 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f15c004d8f0 0x7f15c004fdb0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:45.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.733+0000 7f15e79e3700 1 --2- 172.21.15.103:0/3007258346 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15e0144ac0 0x7f15e0144ea0 unknown :-1 s=CLOSED pgs=2034 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:45.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.733+0000 7f15e79e3700 1 --2- 172.21.15.103:0/3007258346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15e0157e10 0x7f15e00bc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:45.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.733+0000 7f15e79e3700 1 -- 172.21.15.103:0/3007258346 >> 172.21.15.103:0/3007258346 conn(0x7f15e005ad30 msgr2=0x7f15e012b900 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:45.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.733+0000 7f15e79e3700 1 -- 172.21.15.103:0/3007258346 shutdown_connections 2020-04-22T14:19:45.737 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.733+0000 7f15e79e3700 1 -- 172.21.15.103:0/3007258346 wait complete. 2020-04-22T14:19:45.737 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' created 2020-04-22T14:19:45.749 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:45.763 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-04-22T14:19:45.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.912+0000 7f5671c25700 1 Processor -- start 2020-04-22T14:19:45.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.912+0000 7f5671c25700 1 -- start start 2020-04-22T14:19:45.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.913+0000 7f5671c25700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f566c0ac950 0x7f566c146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:45.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.913+0000 7f5671c25700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f566c1470a0 0x7f566c143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:45.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.913+0000 7f5671c25700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f566c1467e0 con 0x7f566c0b9140 2020-04-22T14:19:45.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.913+0000 7f5671c25700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f566c147530 con 0x7f566c0ac950 2020-04-22T14:19:45.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.913+0000 7f5671c25700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f566c0602f0 con 0x7f566c1470a0 2020-04-22T14:19:45.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.913+0000 7f566bfff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f566c1470a0 0x7f566c143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:45.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.913+0000 7f566b7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f566c0b9140 0x7f566c12b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50472/0 (socket says 172.21.15.103:50472) 2020-04-22T14:19:45.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.913+0000 7f566b7fe700 1 -- 172.21.15.103:0/2647459100 learned_addr learned my addr 172.21.15.103:0/2647459100 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:45.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.913+0000 7f566bfff700 1 -- 172.21.15.103:0/2647459100 >> v2:172.21.15.86:3300/0 conn(0x7f566c0ac950 msgr2=0x7f566c146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:45.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.913+0000 7f566affd700 1 --2- 172.21.15.103:0/2647459100 >> v2:172.21.15.86:3300/0 conn(0x7f566c0ac950 0x7f566c146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:45.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.913+0000 7f566bfff700 1 --2- 172.21.15.103:0/2647459100 >> v2:172.21.15.86:3300/0 conn(0x7f566c0ac950 0x7f566c146c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:45.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.913+0000 7f566bfff700 1 -- 172.21.15.103:0/2647459100 >> v1:172.21.15.103:6789/0 conn(0x7f566c0b9140 legacy=0x7f566c12b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:45.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.913+0000 7f566a7fc700 1 -- 172.21.15.103:0/2647459100 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2194168934 0 0) 0x7f566c1467e0 con 0x7f566c0b9140 2020-04-22T14:19:45.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.913+0000 7f566bfff700 1 -- 172.21.15.103:0/2647459100 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f566c060050 con 0x7f566c1470a0 2020-04-22T14:19:45.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.913+0000 7f566bfff700 1 --2- 172.21.15.103:0/2647459100 >> v2:172.21.15.103:3300/0 conn(0x7f566c1470a0 0x7f566c143090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f56640032b0 tx=0x7f5664007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:45.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.913+0000 7f566bfff700 1 --2- 172.21.15.103:0/2647459100 >> v2:172.21.15.103:3300/0 conn(0x7f566c1470a0 0x7f566c143090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f56640032b0 tx=0x7f5664007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:45.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.913+0000 7f566bfff700 1 --2- 172.21.15.103:0/2647459100 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f566c1470a0 0x7f566c143090 secure :-1 s=READY pgs=2036 cs=0 l=1 rx=0x7f56640032b0 tx=0x7f5664007dc0).ready entity=mon.1 client_cookie=feacb6717f4ca8ad server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:45.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.913+0000 7f566bfff700 1 --2- 172.21.15.103:0/2647459100 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f566c1470a0 0x7f566c143090 secure :-1 s=THROTTLE_DONE pgs=2036 cs=0 l=1 rx=0x7f56640032b0 tx=0x7f5664007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:45.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.913+0000 7f566a7fc700 1 -- 172.21.15.103:0/2647459100 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f566400c370 con 0x7f566c1470a0 2020-04-22T14:19:45.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.913+0000 7f566bfff700 1 --2- 172.21.15.103:0/2647459100 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f566c1470a0 0x7f566c143090 secure :-1 s=THROTTLE_DONE pgs=2036 cs=0 l=1 rx=0x7f56640032b0 tx=0x7f5664007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:45.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.913+0000 7f566bfff700 1 --2- 172.21.15.103:0/2647459100 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f566c1470a0 0x7f566c143090 secure :-1 s=THROTTLE_DONE pgs=2036 cs=0 l=1 rx=0x7f56640032b0 tx=0x7f5664007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:45.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.913+0000 7f566a7fc700 1 -- 172.21.15.103:0/2647459100 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566400c4d0 con 0x7f566c1470a0 2020-04-22T14:19:45.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.913+0000 7f566a7fc700 1 -- 172.21.15.103:0/2647459100 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f566400c8b0 con 0x7f566c1470a0 2020-04-22T14:19:45.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.913+0000 7f5671c25700 1 -- 172.21.15.103:0/2647459100 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f566c1470a0 msgr2=0x7f566c143090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:45.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.913+0000 7f5671c25700 1 --2- 172.21.15.103:0/2647459100 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f566c1470a0 0x7f566c143090 secure :-1 s=READY pgs=2036 cs=0 l=1 rx=0x7f56640032b0 tx=0x7f5664007dc0).stop 2020-04-22T14:19:45.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.914+0000 7f5671c25700 1 -- 172.21.15.103:0/2647459100 shutdown_connections 2020-04-22T14:19:45.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.914+0000 7f5671c25700 1 --2- 172.21.15.103:0/2647459100 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f566c1470a0 0x7f566c143090 unknown :-1 s=CLOSED pgs=2036 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:45.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.914+0000 7f5671c25700 1 --2- 172.21.15.103:0/2647459100 >> v2:172.21.15.86:3300/0 conn(0x7f566c0ac950 0x7f566c146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:45.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.914+0000 7f5671c25700 1 -- 172.21.15.103:0/2647459100 >> 172.21.15.103:0/2647459100 conn(0x7f566c05b7b0 msgr2=0x7f566c0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:45.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.914+0000 7f5671c25700 1 -- 172.21.15.103:0/2647459100 shutdown_connections 2020-04-22T14:19:45.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.914+0000 7f5671c25700 1 -- 172.21.15.103:0/2647459100 wait complete. 2020-04-22T14:19:45.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.915+0000 7f5671c25700 1 Processor -- start 2020-04-22T14:19:45.922 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.915+0000 7f5671c25700 1 -- start start 2020-04-22T14:19:45.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.916+0000 7f5671c25700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f566c0ac950 0x7f566c0b1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:45.926 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.916+0000 7f5671c25700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f566c0b9140 0x7f566c141450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:45.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.916+0000 7f5671c25700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f566c0b1ec0 con 0x7f566c1470a0 2020-04-22T14:19:45.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.916+0000 7f5671c25700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f566c141d60 con 0x7f566c0b9140 2020-04-22T14:19:45.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.916+0000 7f5671c25700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f566c153080 con 0x7f566c0ac950 2020-04-22T14:19:45.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.916+0000 7f566bfff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f566c1470a0 0x7f566c0b35a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50482/0 (socket says 172.21.15.103:50482) 2020-04-22T14:19:45.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.916+0000 7f566bfff700 1 -- 172.21.15.103:0/4218592987 learned_addr learned my addr 172.21.15.103:0/4218592987 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:45.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.916+0000 7f5668ff9700 1 -- 172.21.15.103:0/4218592987 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 351348599 0 0) 0x7f566c060050 con 0x7f566c1470a0 2020-04-22T14:19:45.927 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.916+0000 7f5668ff9700 1 -- 172.21.15.103:0/4218592987 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f564c002fe0 con 0x7f566c1470a0 2020-04-22T14:19:45.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.916+0000 7f566affd700 1 --2- 172.21.15.103:0/4218592987 >> v2:172.21.15.86:3300/0 conn(0x7f566c0b9140 0x7f566c141450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:45.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.916+0000 7f566b7fe700 1 --2- 172.21.15.103:0/4218592987 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f566c0ac950 0x7f566c0b1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:45.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.916+0000 7f5668ff9700 1 -- 172.21.15.103:0/4218592987 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1386024490 0 0) 0x7f564c002fe0 con 0x7f566c1470a0 2020-04-22T14:19:45.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.916+0000 7f5668ff9700 1 -- 172.21.15.103:0/4218592987 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f566c060050 con 0x7f566c1470a0 2020-04-22T14:19:45.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.916+0000 7f5668ff9700 1 -- 172.21.15.103:0/4218592987 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f56640089e0 con 0x7f566c1470a0 2020-04-22T14:19:45.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.916+0000 7f5668ff9700 1 -- 172.21.15.103:0/4218592987 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f566c0ac950 msgr2=0x7f566c0b1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:45.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.916+0000 7f5668ff9700 1 --2- 172.21.15.103:0/4218592987 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f566c0ac950 0x7f566c0b1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:45.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.916+0000 7f5668ff9700 1 -- 172.21.15.103:0/4218592987 >> v2:172.21.15.86:3300/0 conn(0x7f566c0b9140 msgr2=0x7f566c141450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:45.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.916+0000 7f5668ff9700 1 --2- 172.21.15.103:0/4218592987 >> v2:172.21.15.86:3300/0 conn(0x7f566c0b9140 0x7f566c141450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:45.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.916+0000 7f5668ff9700 1 -- 172.21.15.103:0/4218592987 >> v1:172.21.15.103:6789/0 conn(0x7f566c1470a0 legacy=0x7f566c0b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:45.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.916+0000 7f5668ff9700 1 --2- 172.21.15.103:0/4218592987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f564c0049b0 0x7f564c004db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:45.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.916+0000 7f5668ff9700 1 --2- 172.21.15.103:0/4218592987 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f566c0ac950 0x7f564c003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:45.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.916+0000 7f5668ff9700 1 --2- 172.21.15.103:0/4218592987 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f564c003d80 0x7f564c004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:45.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.916+0000 7f5668ff9700 1 -- 172.21.15.103:0/4218592987 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566c141d60 con 0x7f564c003d80 2020-04-22T14:19:45.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.916+0000 7f5668ff9700 1 -- 172.21.15.103:0/4218592987 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566c153080 con 0x7f564c0049b0 2020-04-22T14:19:45.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.916+0000 7f5668ff9700 1 -- 172.21.15.103:0/4218592987 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f564c0047a0 con 0x7f566c0ac950 2020-04-22T14:19:45.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.916+0000 7f566b7fe700 1 --2- 172.21.15.103:0/4218592987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f564c0049b0 0x7f564c004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:45.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.916+0000 7f566affd700 1 --2- 172.21.15.103:0/4218592987 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f566c0ac950 0x7f564c003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:45.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.916+0000 7f566bfff700 1 --2- 172.21.15.103:0/4218592987 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f564c003d80 0x7f564c004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:45.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.917+0000 7f566b7fe700 1 -- 172.21.15.103:0/4218592987 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f566c0ac950 msgr2=0x7f564c003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:45.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.917+0000 7f566b7fe700 1 --2- 172.21.15.103:0/4218592987 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f566c0ac950 0x7f564c003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:45.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.917+0000 7f566b7fe700 1 -- 172.21.15.103:0/4218592987 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f564c003d80 msgr2=0x7f564c004200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:45.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.917+0000 7f566b7fe700 1 --2- 172.21.15.103:0/4218592987 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f564c003d80 0x7f564c004200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:45.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.917+0000 7f566b7fe700 1 -- 172.21.15.103:0/4218592987 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f566c0b3cb0 con 0x7f564c0049b0 2020-04-22T14:19:45.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.917+0000 7f5671c25700 1 -- 172.21.15.103:0/4218592987 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f566c0b3210 con 0x7f564c0049b0 2020-04-22T14:19:45.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.917+0000 7f566b7fe700 1 --2- 172.21.15.103:0/4218592987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f564c0049b0 0x7f564c004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f565c000b80 tx=0x7f565c010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:45.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.917+0000 7f566bfff700 1 --2- 172.21.15.103:0/4218592987 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f564c003d80 0x7f564c004200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:19:45.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.917+0000 7f5671c25700 1 -- 172.21.15.103:0/4218592987 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f566c141a70 con 0x7f564c0049b0 2020-04-22T14:19:45.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.917+0000 7f566b7fe700 1 --2- 172.21.15.103:0/4218592987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f564c0049b0 0x7f564c004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f565c000b80 tx=0x7f565c010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:45.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.917+0000 7f566b7fe700 1 --2- 172.21.15.103:0/4218592987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f564c0049b0 0x7f564c004db0 secure :-1 s=READY pgs=2038 cs=0 l=1 rx=0x7f565c000b80 tx=0x7f565c010ce0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:45.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.917+0000 7f566b7fe700 1 --2- 172.21.15.103:0/4218592987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f564c0049b0 0x7f564c004db0 secure :-1 s=THROTTLE_DONE pgs=2038 cs=0 l=1 rx=0x7f565c000b80 tx=0x7f565c010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:45.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.917+0000 7f566b7fe700 1 --2- 172.21.15.103:0/4218592987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f564c0049b0 0x7f564c004db0 secure :-1 s=THROTTLE_DONE pgs=2038 cs=0 l=1 rx=0x7f565c000b80 tx=0x7f565c010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:45.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.917+0000 7f566b7fe700 1 --2- 172.21.15.103:0/4218592987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f564c0049b0 0x7f564c004db0 secure :-1 s=THROTTLE_DONE pgs=2038 cs=0 l=1 rx=0x7f565c000b80 tx=0x7f565c010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:45.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.917+0000 7f5668ff9700 1 -- 172.21.15.103:0/4218592987 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f565c0126d0 con 0x7f564c0049b0 2020-04-22T14:19:45.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.917+0000 7f5668ff9700 1 -- 172.21.15.103:0/4218592987 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565c012830 con 0x7f564c0049b0 2020-04-22T14:19:45.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.917+0000 7f5668ff9700 1 -- 172.21.15.103:0/4218592987 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f565c012c50 con 0x7f564c0049b0 2020-04-22T14:19:45.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.917+0000 7f566b7fe700 1 --2- 172.21.15.103:0/4218592987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f564c0049b0 0x7f564c004db0 secure :-1 s=THROTTLE_DONE pgs=2038 cs=0 l=1 rx=0x7f565c000b80 tx=0x7f565c010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:45.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.918+0000 7f5671c25700 1 -- 172.21.15.103:0/4218592987 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5648003340 con 0x7f564c0049b0 2020-04-22T14:19:45.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.918+0000 7f5668ff9700 1 -- 172.21.15.103:0/4218592987 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f565c00c630 con 0x7f564c0049b0 2020-04-22T14:19:45.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.918+0000 7f566b7fe700 1 --2- 172.21.15.103:0/4218592987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f564c0049b0 0x7f564c004db0 secure :-1 s=THROTTLE_DONE pgs=2038 cs=0 l=1 rx=0x7f565c000b80 tx=0x7f565c010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:45.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.918+0000 7f5668ff9700 1 --2- 172.21.15.103:0/4218592987 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f564c0559f0 0x7f564c057eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:45.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.918+0000 7f5668ff9700 1 -- 172.21.15.103:0/4218592987 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f565c061430 con 0x7f564c0049b0 2020-04-22T14:19:45.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.918+0000 7f566affd700 1 --2- 172.21.15.103:0/4218592987 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f564c0559f0 0x7f564c057eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:45.933 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.919+0000 7f566affd700 1 --2- 172.21.15.103:0/4218592987 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f564c0559f0 0x7f564c057eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5660002f30 tx=0x7f56600076e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:45.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.919+0000 7f566affd700 1 --2- 172.21.15.103:0/4218592987 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f564c0559f0 0x7f564c057eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5660002f30 tx=0x7f56600076e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:45.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.919+0000 7f566affd700 1 --2- 172.21.15.103:0/4218592987 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f564c0559f0 0x7f564c057eb0 secure :-1 s=READY pgs=741 cs=0 l=1 rx=0x7f5660002f30 tx=0x7f56600076e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:45.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.922+0000 7f566b7fe700 1 --2- 172.21.15.103:0/4218592987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f564c0049b0 0x7f564c004db0 secure :-1 s=THROTTLE_DONE pgs=2038 cs=0 l=1 rx=0x7f565c000b80 tx=0x7f565c010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:45.934 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:45.922+0000 7f5668ff9700 1 -- 172.21.15.103:0/4218592987 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f565c03c8f0 con 0x7f564c0049b0 2020-04-22T14:19:46.113 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.111+0000 7f5671c25700 1 -- 172.21.15.103:0/4218592987 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f5648002260 con 0x7f564c0049b0 2020-04-22T14:19:46.120 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.117+0000 7f566b7fe700 1 --2- 172.21.15.103:0/4218592987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f564c0049b0 0x7f564c004db0 secure :-1 s=THROTTLE_DONE pgs=2038 cs=0 l=1 rx=0x7f565c000b80 tx=0x7f565c010ce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:46.120 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.117+0000 7f5668ff9700 1 -- 172.21.15.103:0/4218592987 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 25 and data pool 26 v105) v1 ==== 189+0+0 (secure 0 0 0) 0x7f565c03ff10 con 0x7f564c0049b0 2020-04-22T14:19:46.124 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.122+0000 7f5671c25700 1 -- 172.21.15.103:0/4218592987 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f564c0559f0 msgr2=0x7f564c057eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:46.125 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.122+0000 7f5671c25700 1 --2- 172.21.15.103:0/4218592987 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f564c0559f0 0x7f564c057eb0 secure :-1 s=READY pgs=741 cs=0 l=1 rx=0x7f5660002f30 tx=0x7f56600076e0).stop 2020-04-22T14:19:46.125 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.122+0000 7f5671c25700 1 -- 172.21.15.103:0/4218592987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f564c0049b0 msgr2=0x7f564c004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:46.125 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.122+0000 7f5671c25700 1 --2- 172.21.15.103:0/4218592987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f564c0049b0 0x7f564c004db0 secure :-1 s=READY pgs=2038 cs=0 l=1 rx=0x7f565c000b80 tx=0x7f565c010ce0).stop 2020-04-22T14:19:46.125 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.122+0000 7f566bfff700 1 -- 172.21.15.103:0/4218592987 reap_dead start 2020-04-22T14:19:46.127 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.125+0000 7f5671c25700 1 -- 172.21.15.103:0/4218592987 shutdown_connections 2020-04-22T14:19:46.127 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.125+0000 7f5671c25700 1 -- 172.21.15.103:0/4218592987 >> 172.21.15.103:0/4218592987 conn(0x7f566c05b7b0 msgr2=0x7f566c062130 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:46.130 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.127+0000 7f5671c25700 1 -- 172.21.15.103:0/4218592987 shutdown_connections 2020-04-22T14:19:46.130 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.127+0000 7f5671c25700 1 -- 172.21.15.103:0/4218592987 wait complete. 2020-04-22T14:19:46.131 INFO:teuthology.orchestra.run.smithi103.stderr:new fs with metadata pool 25 and data pool 26 2020-04-22T14:19:46.141 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:46.155 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:19:46.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.299+0000 7effe4d3b700 1 Processor -- start 2020-04-22T14:19:46.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.299+0000 7effe4d3b700 1 -- start start 2020-04-22T14:19:46.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.300+0000 7effe4d3b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7effe012c0d0 0x7effe01464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:46.304 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.300+0000 7effe4d3b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7effe0065fe0 0x7effe005b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:46.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.300+0000 7effe4d3b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7effe005b8a0 0x7effe0062ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:46.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.300+0000 7effe4d3b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effe012c4b0 con 0x7effe005b8a0 2020-04-22T14:19:46.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.300+0000 7effe4d3b700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effe0143300 con 0x7effe012c0d0 2020-04-22T14:19:46.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.300+0000 7effe4d3b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe01435a0 con 0x7effe0065fe0 2020-04-22T14:19:46.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.300+0000 7effde59c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7effe012c0d0 0x7effe01464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:46.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.300+0000 7effde59c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7effe012c0d0 0x7effe01464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58312/0 (socket says 172.21.15.103:58312) 2020-04-22T14:19:46.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.300+0000 7effde59c700 1 -- 172.21.15.103:0/2276155769 learned_addr learned my addr 172.21.15.103:0/2276155769 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:19:46.305 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.300+0000 7effded9d700 1 --2- 172.21.15.103:0/2276155769 >> v2:172.21.15.86:3300/0 conn(0x7effe005b8a0 0x7effe0062ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:46.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.300+0000 7effddd9b700 1 --2- 172.21.15.103:0/2276155769 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7effe0065fe0 0x7effe005b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:46.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.300+0000 7effde59c700 1 -- 172.21.15.103:0/2276155769 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7effe0065fe0 msgr2=0x7effe005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:46.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.300+0000 7effde59c700 1 --2- 172.21.15.103:0/2276155769 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7effe0065fe0 0x7effe005b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:46.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.300+0000 7effde59c700 1 -- 172.21.15.103:0/2276155769 >> v2:172.21.15.86:3300/0 conn(0x7effe005b8a0 msgr2=0x7effe0062ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:46.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.300+0000 7effde59c700 1 --2- 172.21.15.103:0/2276155769 >> v2:172.21.15.86:3300/0 conn(0x7effe005b8a0 0x7effe0062ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:46.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.300+0000 7effde59c700 1 -- 172.21.15.103:0/2276155769 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe0143840 con 0x7effe012c0d0 2020-04-22T14:19:46.306 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.300+0000 7effddd9b700 1 --2- 172.21.15.103:0/2276155769 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7effe0065fe0 0x7effe005b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:19:46.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.300+0000 7effde59c700 1 --2- 172.21.15.103:0/2276155769 >> v2:172.21.15.103:3300/0 conn(0x7effe012c0d0 0x7effe01464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7effd4002f30 tx=0x7effd4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:46.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.300+0000 7effde59c700 1 --2- 172.21.15.103:0/2276155769 >> v2:172.21.15.103:3300/0 conn(0x7effe012c0d0 0x7effe01464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7effd4002f30 tx=0x7effd4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:46.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.301+0000 7effde59c700 1 --2- 172.21.15.103:0/2276155769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effe012c0d0 0x7effe01464e0 secure :-1 s=READY pgs=2039 cs=0 l=1 rx=0x7effd4002f30 tx=0x7effd4007a40).ready entity=mon.1 client_cookie=4aa466fcb43a4da6 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:46.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.301+0000 7effde59c700 1 --2- 172.21.15.103:0/2276155769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effe012c0d0 0x7effe01464e0 secure :-1 s=THROTTLE_DONE pgs=2039 cs=0 l=1 rx=0x7effd4002f30 tx=0x7effd4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:46.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.301+0000 7effde59c700 1 --2- 172.21.15.103:0/2276155769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effe012c0d0 0x7effe01464e0 secure :-1 s=THROTTLE_DONE pgs=2039 cs=0 l=1 rx=0x7effd4002f30 tx=0x7effd4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:46.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.301+0000 7effdd59a700 1 -- 172.21.15.103:0/2276155769 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effd4011670 con 0x7effe012c0d0 2020-04-22T14:19:46.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.301+0000 7effde59c700 1 --2- 172.21.15.103:0/2276155769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effe012c0d0 0x7effe01464e0 secure :-1 s=THROTTLE_DONE pgs=2039 cs=0 l=1 rx=0x7effd4002f30 tx=0x7effd4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:46.307 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.301+0000 7effdd59a700 1 -- 172.21.15.103:0/2276155769 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd40117d0 con 0x7effe012c0d0 2020-04-22T14:19:46.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.301+0000 7effdd59a700 1 -- 172.21.15.103:0/2276155769 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effd4011bf0 con 0x7effe012c0d0 2020-04-22T14:19:46.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.301+0000 7effe4d3b700 1 -- 172.21.15.103:0/2276155769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effe012c0d0 msgr2=0x7effe01464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:46.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.301+0000 7effe4d3b700 1 --2- 172.21.15.103:0/2276155769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effe012c0d0 0x7effe01464e0 secure :-1 s=READY pgs=2039 cs=0 l=1 rx=0x7effd4002f30 tx=0x7effd4007a40).stop 2020-04-22T14:19:46.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.301+0000 7effe4d3b700 1 -- 172.21.15.103:0/2276155769 shutdown_connections 2020-04-22T14:19:46.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.301+0000 7effe4d3b700 1 --2- 172.21.15.103:0/2276155769 >> v2:172.21.15.86:3300/0 conn(0x7effe005b8a0 0x7effe0062ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:46.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.301+0000 7effe4d3b700 1 --2- 172.21.15.103:0/2276155769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effe012c0d0 0x7effe01464e0 unknown :-1 s=CLOSED pgs=2039 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:46.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.301+0000 7effe4d3b700 1 --2- 172.21.15.103:0/2276155769 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7effe0065fe0 0x7effe005b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:46.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.301+0000 7effe4d3b700 1 -- 172.21.15.103:0/2276155769 >> 172.21.15.103:0/2276155769 conn(0x7effe00b9160 msgr2=0x7effe005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:46.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.301+0000 7effe4d3b700 1 -- 172.21.15.103:0/2276155769 shutdown_connections 2020-04-22T14:19:46.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.301+0000 7effe4d3b700 1 -- 172.21.15.103:0/2276155769 wait complete. 2020-04-22T14:19:46.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.302+0000 7effe4d3b700 1 Processor -- start 2020-04-22T14:19:46.318 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.302+0000 7effe4d3b700 1 -- start start 2020-04-22T14:19:46.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.303+0000 7effe4d3b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7effe005b8a0 0x7effe014f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:46.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.303+0000 7effe4d3b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7effe012c0d0 0x7effe01425c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:46.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.303+0000 7effe4d3b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effe0150000 con 0x7effe0065fe0 2020-04-22T14:19:46.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.303+0000 7effe4d3b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effe01502a0 con 0x7effe005b8a0 2020-04-22T14:19:46.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.303+0000 7effe4d3b700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effe0148730 con 0x7effe012c0d0 2020-04-22T14:19:46.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.303+0000 7effded9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7effe012c0d0 0x7effe01425c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:46.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.303+0000 7effded9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7effe012c0d0 0x7effe01425c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58320/0 (socket says 172.21.15.103:58320) 2020-04-22T14:19:46.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.303+0000 7effded9d700 1 -- 172.21.15.103:0/3485052672 learned_addr learned my addr 172.21.15.103:0/3485052672 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:19:46.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.303+0000 7effde59c700 1 --2- 172.21.15.103:0/3485052672 >> v2:172.21.15.86:3300/0 conn(0x7effe005b8a0 0x7effe014f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:46.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.303+0000 7effded9d700 1 -- 172.21.15.103:0/3485052672 >> v2:172.21.15.86:3300/0 conn(0x7effe005b8a0 msgr2=0x7effe014f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:46.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.303+0000 7effded9d700 1 --2- 172.21.15.103:0/3485052672 >> v2:172.21.15.86:3300/0 conn(0x7effe005b8a0 0x7effe014f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:46.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.303+0000 7effded9d700 1 -- 172.21.15.103:0/3485052672 >> v1:172.21.15.86:6789/0 conn(0x7effe0065fe0 legacy=0x7effe0141eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:46.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.303+0000 7effded9d700 1 -- 172.21.15.103:0/3485052672 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe01488a0 con 0x7effe012c0d0 2020-04-22T14:19:46.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.303+0000 7effded9d700 1 --2- 172.21.15.103:0/3485052672 >> v2:172.21.15.103:3300/0 conn(0x7effe012c0d0 0x7effe01425c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7effe0063dc0 tx=0x7effd8011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:46.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.303+0000 7effded9d700 1 --2- 172.21.15.103:0/3485052672 >> v2:172.21.15.103:3300/0 conn(0x7effe012c0d0 0x7effe01425c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7effe0063dc0 tx=0x7effd8011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:46.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.303+0000 7effded9d700 1 --2- 172.21.15.103:0/3485052672 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effe012c0d0 0x7effe01425c0 secure :-1 s=READY pgs=2040 cs=0 l=1 rx=0x7effe0063dc0 tx=0x7effd8011060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:46.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.304+0000 7effded9d700 1 --2- 172.21.15.103:0/3485052672 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effe012c0d0 0x7effe01425c0 secure :-1 s=THROTTLE_DONE pgs=2040 cs=0 l=1 rx=0x7effe0063dc0 tx=0x7effd8011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:46.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.304+0000 7effded9d700 1 --2- 172.21.15.103:0/3485052672 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effe012c0d0 0x7effe01425c0 secure :-1 s=THROTTLE_DONE pgs=2040 cs=0 l=1 rx=0x7effe0063dc0 tx=0x7effd8011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:46.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.304+0000 7effded9d700 1 --2- 172.21.15.103:0/3485052672 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effe012c0d0 0x7effe01425c0 secure :-1 s=THROTTLE_DONE pgs=2040 cs=0 l=1 rx=0x7effe0063dc0 tx=0x7effd8011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:46.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.304+0000 7effcf7fe700 1 -- 172.21.15.103:0/3485052672 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effd8005e30 con 0x7effe012c0d0 2020-04-22T14:19:46.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.304+0000 7effcf7fe700 1 -- 172.21.15.103:0/3485052672 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd8007560 con 0x7effe012c0d0 2020-04-22T14:19:46.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.304+0000 7effe4d3b700 1 -- 172.21.15.103:0/3485052672 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effe0148a90 con 0x7effe012c0d0 2020-04-22T14:19:46.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.304+0000 7effcf7fe700 1 -- 172.21.15.103:0/3485052672 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effd8007900 con 0x7effe012c0d0 2020-04-22T14:19:46.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.304+0000 7effe4d3b700 1 -- 172.21.15.103:0/3485052672 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effe0149ac0 con 0x7effe012c0d0 2020-04-22T14:19:46.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.304+0000 7effded9d700 1 --2- 172.21.15.103:0/3485052672 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effe012c0d0 0x7effe01425c0 secure :-1 s=THROTTLE_DONE pgs=2040 cs=0 l=1 rx=0x7effe0063dc0 tx=0x7effd8011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:46.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.305+0000 7effcf7fe700 1 -- 172.21.15.103:0/3485052672 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7effd800e1a0 con 0x7effe012c0d0 2020-04-22T14:19:46.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.305+0000 7effded9d700 1 --2- 172.21.15.103:0/3485052672 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effe012c0d0 0x7effe01425c0 secure :-1 s=THROTTLE_DONE pgs=2040 cs=0 l=1 rx=0x7effe0063dc0 tx=0x7effd8011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:46.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.305+0000 7effe4d3b700 1 -- 172.21.15.103:0/3485052672 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effe0056c90 con 0x7effe012c0d0 2020-04-22T14:19:46.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.305+0000 7effcf7fe700 1 --2- 172.21.15.103:0/3485052672 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7effbc04da70 0x7effbc04ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:46.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.305+0000 7effcf7fe700 1 -- 172.21.15.103:0/3485052672 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6073+0+0 (secure 0 0 0) 0x7effd8061440 con 0x7effe012c0d0 2020-04-22T14:19:46.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.305+0000 7effde59c700 1 --2- 172.21.15.103:0/3485052672 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7effbc04da70 0x7effbc04ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:46.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.305+0000 7effde59c700 1 --2- 172.21.15.103:0/3485052672 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7effbc04da70 0x7effbc04ff30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7effd4002f30 tx=0x7effd4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:46.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.305+0000 7effde59c700 1 --2- 172.21.15.103:0/3485052672 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7effbc04da70 0x7effbc04ff30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7effd4002f30 tx=0x7effd4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:46.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.305+0000 7effde59c700 1 --2- 172.21.15.103:0/3485052672 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7effbc04da70 0x7effbc04ff30 secure :-1 s=READY pgs=742 cs=0 l=1 rx=0x7effd4002f30 tx=0x7effd4007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:46.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.309+0000 7effded9d700 1 --2- 172.21.15.103:0/3485052672 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effe012c0d0 0x7effe01425c0 secure :-1 s=THROTTLE_DONE pgs=2040 cs=0 l=1 rx=0x7effe0063dc0 tx=0x7effd8011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:46.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.309+0000 7effcf7fe700 1 -- 172.21.15.103:0/3485052672 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7effd803c820 con 0x7effe012c0d0 2020-04-22T14:19:46.455 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.453+0000 7effe4d3b700 1 -- 172.21.15.103:0/3485052672 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7effe014c480 con 0x7effe012c0d0 2020-04-22T14:19:46.456 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.454+0000 7effded9d700 1 --2- 172.21.15.103:0/3485052672 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effe012c0d0 0x7effe01425c0 secure :-1 s=THROTTLE_DONE pgs=2040 cs=0 l=1 rx=0x7effe0063dc0 tx=0x7effd8011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:46.456 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.454+0000 7effcf7fe700 1 -- 172.21.15.103:0/3485052672 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) v1 ==== 74+0+16116 (secure 0 0 0) 0x7effd803fe40 con 0x7effe012c0d0 2020-04-22T14:19:46.457 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:19:46.457 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":145,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:19:46.112426+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:19:44.035980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2020-04-22T14:19:45.079896+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:19:46.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.455+0000 7effe4d3b700 1 -- 172.21.15.103:0/3485052672 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7effbc04da70 msgr2=0x7effbc04ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:46.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.455+0000 7effe4d3b700 1 --2- 172.21.15.103:0/3485052672 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7effbc04da70 0x7effbc04ff30 secure :-1 s=READY pgs=742 cs=0 l=1 rx=0x7effd4002f30 tx=0x7effd4007a40).stop 2020-04-22T14:19:46.458 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.455+0000 7effe4d3b700 1 -- 172.21.15.103:0/3485052672 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effe012c0d0 msgr2=0x7effe01425c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:46.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.455+0000 7effe4d3b700 1 --2- 172.21.15.103:0/3485052672 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effe012c0d0 0x7effe01425c0 secure :-1 s=READY pgs=2040 cs=0 l=1 rx=0x7effe0063dc0 tx=0x7effd8011060).stop 2020-04-22T14:19:46.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.455+0000 7effe4d3b700 1 -- 172.21.15.103:0/3485052672 shutdown_connections 2020-04-22T14:19:46.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.455+0000 7effe4d3b700 1 --2- 172.21.15.103:0/3485052672 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effe012c0d0 0x7effe01425c0 unknown :-1 s=CLOSED pgs=2040 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:46.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.455+0000 7effe4d3b700 1 --2- 172.21.15.103:0/3485052672 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7effbc04da70 0x7effbc04ff30 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:46.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.455+0000 7effe4d3b700 1 --2- 172.21.15.103:0/3485052672 >> v2:172.21.15.86:3300/0 conn(0x7effe005b8a0 0x7effe014f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:46.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.455+0000 7effe4d3b700 1 -- 172.21.15.103:0/3485052672 >> 172.21.15.103:0/3485052672 conn(0x7effe00b9160 msgr2=0x7effe00b7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:46.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.455+0000 7effe4d3b700 1 -- 172.21.15.103:0/3485052672 shutdown_connections 2020-04-22T14:19:46.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.456+0000 7effe4d3b700 1 -- 172.21.15.103:0/3485052672 wait complete. 2020-04-22T14:19:46.469 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:46.484 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:19:46.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.628+0000 7f96cc292700 1 Processor -- start 2020-04-22T14:19:46.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.628+0000 7f96cc292700 1 -- start start 2020-04-22T14:19:46.633 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.629+0000 7f96cc292700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f96c40b0ed0 0x7f96c40b70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:46.633 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.629+0000 7f96cc292700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96c40b7540 0x7f96c4145960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:46.633 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.629+0000 7f96cc292700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96c4146270 con 0x7f96c4145dc0 2020-04-22T14:19:46.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.629+0000 7f96cc292700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96c40b79f0 con 0x7f96c40b0ed0 2020-04-22T14:19:46.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.629+0000 7f96cc292700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c40b7c90 con 0x7f96c40b7540 2020-04-22T14:19:46.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.629+0000 7f96ca02e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f96c40b0ed0 0x7f96c40b70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:46.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.629+0000 7f96ca02e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f96c40b0ed0 0x7f96c40b70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58324/0 (socket says 172.21.15.103:58324) 2020-04-22T14:19:46.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.629+0000 7f96ca02e700 1 -- 172.21.15.103:0/708839174 learned_addr learned my addr 172.21.15.103:0/708839174 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:19:46.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.629+0000 7f96ca02e700 1 -- 172.21.15.103:0/708839174 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96c40b7540 msgr2=0x7f96c4145960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:46.634 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.629+0000 7f96ca02e700 1 --2- 172.21.15.103:0/708839174 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96c40b7540 0x7f96c4145960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:46.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.629+0000 7f96ca02e700 1 -- 172.21.15.103:0/708839174 >> v1:172.21.15.86:6789/0 conn(0x7f96c4145dc0 legacy=0x7f96c405fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:46.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.629+0000 7f96ca02e700 1 -- 172.21.15.103:0/708839174 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c40b7f30 con 0x7f96c40b0ed0 2020-04-22T14:19:46.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.629+0000 7f96ca02e700 1 --2- 172.21.15.103:0/708839174 >> v2:172.21.15.103:3300/0 conn(0x7f96c40b0ed0 0x7f96c40b70e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f96c40b82b0 tx=0x7f96b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:46.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.630+0000 7f96ca02e700 1 --2- 172.21.15.103:0/708839174 >> v2:172.21.15.103:3300/0 conn(0x7f96c40b0ed0 0x7f96c40b70e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f96c40b82b0 tx=0x7f96b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:46.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.630+0000 7f96ca02e700 1 --2- 172.21.15.103:0/708839174 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96c40b0ed0 0x7f96c40b70e0 secure :-1 s=READY pgs=2041 cs=0 l=1 rx=0x7f96c40b82b0 tx=0x7f96b4007a40).ready entity=mon.1 client_cookie=b7f3b46a61c7702a server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:46.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.630+0000 7f96ca02e700 1 --2- 172.21.15.103:0/708839174 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96c40b0ed0 0x7f96c40b70e0 secure :-1 s=THROTTLE_DONE pgs=2041 cs=0 l=1 rx=0x7f96c40b82b0 tx=0x7f96b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:46.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.630+0000 7f96ca02e700 1 --2- 172.21.15.103:0/708839174 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96c40b0ed0 0x7f96c40b70e0 secure :-1 s=THROTTLE_DONE pgs=2041 cs=0 l=1 rx=0x7f96c40b82b0 tx=0x7f96b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:46.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.630+0000 7f96c902c700 1 -- 172.21.15.103:0/708839174 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96b40116e0 con 0x7f96c40b0ed0 2020-04-22T14:19:46.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.630+0000 7f96ca02e700 1 --2- 172.21.15.103:0/708839174 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96c40b0ed0 0x7f96c40b70e0 secure :-1 s=THROTTLE_DONE pgs=2041 cs=0 l=1 rx=0x7f96c40b82b0 tx=0x7f96b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:46.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.630+0000 7f96c902c700 1 -- 172.21.15.103:0/708839174 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b4011840 con 0x7f96c40b0ed0 2020-04-22T14:19:46.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.630+0000 7f96c902c700 1 -- 172.21.15.103:0/708839174 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96b4011c60 con 0x7f96c40b0ed0 2020-04-22T14:19:46.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.630+0000 7f96cc292700 1 -- 172.21.15.103:0/708839174 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96c40b0ed0 msgr2=0x7f96c40b70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:46.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.630+0000 7f96cc292700 1 --2- 172.21.15.103:0/708839174 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96c40b0ed0 0x7f96c40b70e0 secure :-1 s=READY pgs=2041 cs=0 l=1 rx=0x7f96c40b82b0 tx=0x7f96b4007a40).stop 2020-04-22T14:19:46.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.630+0000 7f96cc292700 1 -- 172.21.15.103:0/708839174 shutdown_connections 2020-04-22T14:19:46.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.630+0000 7f96cc292700 1 --2- 172.21.15.103:0/708839174 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96c40b0ed0 0x7f96c40b70e0 unknown :-1 s=CLOSED pgs=2041 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:46.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.630+0000 7f96cc292700 1 --2- 172.21.15.103:0/708839174 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96c40b7540 0x7f96c4145960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:46.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.630+0000 7f96cc292700 1 -- 172.21.15.103:0/708839174 >> 172.21.15.103:0/708839174 conn(0x7f96c405f2c0 msgr2=0x7f96c4061fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:46.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.630+0000 7f96cc292700 1 -- 172.21.15.103:0/708839174 shutdown_connections 2020-04-22T14:19:46.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.630+0000 7f96cc292700 1 -- 172.21.15.103:0/708839174 wait complete. 2020-04-22T14:19:46.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.631+0000 7f96cc292700 1 Processor -- start 2020-04-22T14:19:46.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.631+0000 7f96cc292700 1 -- start start 2020-04-22T14:19:46.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.632+0000 7f96cc292700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f96c4145dc0 0x7f96c40b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:46.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.632+0000 7f96cc292700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96c40b3ba0 con 0x7f96c40b0ed0 2020-04-22T14:19:46.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.632+0000 7f96cc292700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96c4157440 con 0x7f96c40b7540 2020-04-22T14:19:46.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.632+0000 7f96cc292700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96c4147960 con 0x7f96c4145dc0 2020-04-22T14:19:46.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.632+0000 7f96c982d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f96c40b7540 0x7f96c4141e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50522/0 (socket says 172.21.15.103:50522) 2020-04-22T14:19:46.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.632+0000 7f96c982d700 1 -- 172.21.15.103:0/4173678657 learned_addr learned my addr 172.21.15.103:0/4173678657 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:46.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.632+0000 7f96ca82f700 1 --2- 172.21.15.103:0/4173678657 >> v2:172.21.15.103:3300/0 conn(0x7f96c4145dc0 0x7f96c40b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:46.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.632+0000 7f96b37fe700 1 -- 172.21.15.103:0/4173678657 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3768506057 0 0) 0x7f96c4157440 con 0x7f96c40b7540 2020-04-22T14:19:46.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.632+0000 7f96b37fe700 1 -- 172.21.15.103:0/4173678657 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96a4002fe0 con 0x7f96c40b7540 2020-04-22T14:19:46.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.632+0000 7f96b37fe700 1 -- 172.21.15.103:0/4173678657 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 551106977 0 0) 0x7f96c40b3ba0 con 0x7f96c40b0ed0 2020-04-22T14:19:46.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.632+0000 7f96ca82f700 1 -- 172.21.15.103:0/4173678657 >> v1:172.21.15.103:6789/0 conn(0x7f96c40b7540 legacy=0x7f96c4141e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:46.642 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.632+0000 7f96ca82f700 1 -- 172.21.15.103:0/4173678657 >> v1:172.21.15.86:6789/0 conn(0x7f96c40b0ed0 legacy=0x7f96c41578e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:46.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.632+0000 7f96ca82f700 1 -- 172.21.15.103:0/4173678657 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c4157ff0 con 0x7f96c4145dc0 2020-04-22T14:19:46.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.632+0000 7f96ca82f700 1 --2- 172.21.15.103:0/4173678657 >> v2:172.21.15.103:3300/0 conn(0x7f96c4145dc0 0x7f96c40b41c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f96bc0022d0 tx=0x7f96bc010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:46.643 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.632+0000 7f96ca82f700 1 --2- 172.21.15.103:0/4173678657 >> v2:172.21.15.103:3300/0 conn(0x7f96c4145dc0 0x7f96c40b41c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f96bc0022d0 tx=0x7f96bc010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:46.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.632+0000 7f96ca82f700 1 --2- 172.21.15.103:0/4173678657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96c4145dc0 0x7f96c40b41c0 secure :-1 s=READY pgs=2043 cs=0 l=1 rx=0x7f96bc0022d0 tx=0x7f96bc010b70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:46.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.632+0000 7f96ca82f700 1 --2- 172.21.15.103:0/4173678657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96c4145dc0 0x7f96c40b41c0 secure :-1 s=THROTTLE_DONE pgs=2043 cs=0 l=1 rx=0x7f96bc0022d0 tx=0x7f96bc010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:46.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.633+0000 7f96b37fe700 1 -- 172.21.15.103:0/4173678657 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96bc012210 con 0x7f96c4145dc0 2020-04-22T14:19:46.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.633+0000 7f96ca82f700 1 --2- 172.21.15.103:0/4173678657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96c4145dc0 0x7f96c40b41c0 secure :-1 s=THROTTLE_DONE pgs=2043 cs=0 l=1 rx=0x7f96bc0022d0 tx=0x7f96bc010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:46.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.633+0000 7f96ca82f700 1 --2- 172.21.15.103:0/4173678657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96c4145dc0 0x7f96c40b41c0 secure :-1 s=THROTTLE_DONE pgs=2043 cs=0 l=1 rx=0x7f96bc0022d0 tx=0x7f96bc010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:46.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.633+0000 7f96b37fe700 1 -- 172.21.15.103:0/4173678657 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96bc012370 con 0x7f96c4145dc0 2020-04-22T14:19:46.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.633+0000 7f96cc292700 1 -- 172.21.15.103:0/4173678657 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96c4142550 con 0x7f96c4145dc0 2020-04-22T14:19:46.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.633+0000 7f96b37fe700 1 -- 172.21.15.103:0/4173678657 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96bc012790 con 0x7f96c4145dc0 2020-04-22T14:19:46.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.633+0000 7f96cc292700 1 -- 172.21.15.103:0/4173678657 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96c40b3810 con 0x7f96c4145dc0 2020-04-22T14:19:46.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.633+0000 7f96ca82f700 1 --2- 172.21.15.103:0/4173678657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96c4145dc0 0x7f96c40b41c0 secure :-1 s=THROTTLE_DONE pgs=2043 cs=0 l=1 rx=0x7f96bc0022d0 tx=0x7f96bc010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:46.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.634+0000 7f96b37fe700 1 -- 172.21.15.103:0/4173678657 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f96bc012a00 con 0x7f96c4145dc0 2020-04-22T14:19:46.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.634+0000 7f96ca82f700 1 --2- 172.21.15.103:0/4173678657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96c4145dc0 0x7f96c40b41c0 secure :-1 s=THROTTLE_DONE pgs=2043 cs=0 l=1 rx=0x7f96bc0022d0 tx=0x7f96bc010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:46.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.634+0000 7f96cc292700 1 -- 172.21.15.103:0/4173678657 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96c41572a0 con 0x7f96c4145dc0 2020-04-22T14:19:46.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.634+0000 7f96b37fe700 1 --2- 172.21.15.103:0/4173678657 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f96a404dc20 0x7f96a40500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:46.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.634+0000 7f96b37fe700 1 -- 172.21.15.103:0/4173678657 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f96bc061890 con 0x7f96c4145dc0 2020-04-22T14:19:46.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.634+0000 7f96ca02e700 1 --2- 172.21.15.103:0/4173678657 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f96a404dc20 0x7f96a40500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:46.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.634+0000 7f96ca02e700 1 --2- 172.21.15.103:0/4173678657 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f96a404dc20 0x7f96a40500e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f96b40088e0 tx=0x7f96b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:46.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.634+0000 7f96ca02e700 1 --2- 172.21.15.103:0/4173678657 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f96a404dc20 0x7f96a40500e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f96b40088e0 tx=0x7f96b4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:46.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.634+0000 7f96ca02e700 1 --2- 172.21.15.103:0/4173678657 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f96a404dc20 0x7f96a40500e0 secure :-1 s=READY pgs=743 cs=0 l=1 rx=0x7f96b40088e0 tx=0x7f96b4007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:46.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.638+0000 7f96ca82f700 1 --2- 172.21.15.103:0/4173678657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96c4145dc0 0x7f96c40b41c0 secure :-1 s=THROTTLE_DONE pgs=2043 cs=0 l=1 rx=0x7f96bc0022d0 tx=0x7f96bc010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:46.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.638+0000 7f96b37fe700 1 -- 172.21.15.103:0/4173678657 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f96c41572a0 con 0x7f96c4145dc0 2020-04-22T14:19:46.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.783+0000 7f96cc292700 1 -- 172.21.15.103:0/4173678657 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96c41572a0 con 0x7f96c4145dc0 2020-04-22T14:19:46.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.783+0000 7f96ca82f700 1 --2- 172.21.15.103:0/4173678657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96c4145dc0 0x7f96c40b41c0 secure :-1 s=THROTTLE_DONE pgs=2043 cs=0 l=1 rx=0x7f96bc0022d0 tx=0x7f96bc010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:46.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.783+0000 7f96b37fe700 1 -- 172.21.15.103:0/4173678657 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) v1 ==== 74+0+16116 (secure 0 0 0) 0x7f96c41572a0 con 0x7f96c4145dc0 2020-04-22T14:19:46.786 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:19:46.786 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":145,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:19:46.112426+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:19:44.035980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2020-04-22T14:19:45.079896+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:19:46.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.785+0000 7f96cc292700 1 -- 172.21.15.103:0/4173678657 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f96a404dc20 msgr2=0x7f96a40500e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:46.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.785+0000 7f96cc292700 1 --2- 172.21.15.103:0/4173678657 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f96a404dc20 0x7f96a40500e0 secure :-1 s=READY pgs=743 cs=0 l=1 rx=0x7f96b40088e0 tx=0x7f96b4007a40).stop 2020-04-22T14:19:46.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.785+0000 7f96cc292700 1 -- 172.21.15.103:0/4173678657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96c4145dc0 msgr2=0x7f96c40b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:46.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.785+0000 7f96cc292700 1 --2- 172.21.15.103:0/4173678657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96c4145dc0 0x7f96c40b41c0 secure :-1 s=READY pgs=2043 cs=0 l=1 rx=0x7f96bc0022d0 tx=0x7f96bc010b70).stop 2020-04-22T14:19:46.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.785+0000 7f96cc292700 1 -- 172.21.15.103:0/4173678657 shutdown_connections 2020-04-22T14:19:46.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.785+0000 7f96cc292700 1 --2- 172.21.15.103:0/4173678657 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f96a404dc20 0x7f96a40500e0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:46.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.785+0000 7f96cc292700 1 --2- 172.21.15.103:0/4173678657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96c4145dc0 0x7f96c40b41c0 unknown :-1 s=CLOSED pgs=2043 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:46.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.785+0000 7f96cc292700 1 -- 172.21.15.103:0/4173678657 >> 172.21.15.103:0/4173678657 conn(0x7f96c405f2c0 msgr2=0x7f96c4143280 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:46.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.785+0000 7f96cc292700 1 -- 172.21.15.103:0/4173678657 shutdown_connections 2020-04-22T14:19:46.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.785+0000 7f96cc292700 1 -- 172.21.15.103:0/4173678657 wait complete. 2020-04-22T14:19:46.799 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:46.831 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-04-22T14:19:46.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.992+0000 7fb6f4e09700 1 Processor -- start 2020-04-22T14:19:46.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.992+0000 7fb6f4e09700 1 -- start start 2020-04-22T14:19:46.997 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.993+0000 7fb6f4e09700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb6f00b9140 0x7fb6f00aed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:46.997 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.993+0000 7fb6f4e09700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb6f00af1f0 0x7fb6f0144660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:46.997 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.993+0000 7fb6f4e09700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f0144ac0 con 0x7fb6f00b3bd0 2020-04-22T14:19:46.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.993+0000 7fb6f4e09700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6f0148310 con 0x7fb6f00af1f0 2020-04-22T14:19:46.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.993+0000 7fb6f4e09700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6f01485b0 con 0x7fb6f00b9140 2020-04-22T14:19:46.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.993+0000 7fb6ee59c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb6f00b9140 0x7fb6f00aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:46.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.993+0000 7fb6edd9b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb6f00b3bd0 0x7fb6f00616b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50528/0 (socket says 172.21.15.103:50528) 2020-04-22T14:19:46.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.993+0000 7fb6edd9b700 1 -- 172.21.15.103:0/2076870424 learned_addr learned my addr 172.21.15.103:0/2076870424 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:46.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.994+0000 7fb6eed9d700 1 --2- 172.21.15.103:0/2076870424 >> v2:172.21.15.86:3300/0 conn(0x7fb6f00af1f0 0x7fb6f0144660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:46.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.994+0000 7fb6ee59c700 1 -- 172.21.15.103:0/2076870424 >> v2:172.21.15.86:3300/0 conn(0x7fb6f00af1f0 msgr2=0x7fb6f0144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:46.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.994+0000 7fb6ee59c700 1 --2- 172.21.15.103:0/2076870424 >> v2:172.21.15.86:3300/0 conn(0x7fb6f00af1f0 0x7fb6f0144660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:46.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.994+0000 7fb6ee59c700 1 -- 172.21.15.103:0/2076870424 >> v1:172.21.15.103:6789/0 conn(0x7fb6f00b3bd0 legacy=0x7fb6f00616b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:46.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.994+0000 7fb6ed59a700 1 -- 172.21.15.103:0/2076870424 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1537349976 0 0) 0x7fb6f0144ac0 con 0x7fb6f00b3bd0 2020-04-22T14:19:46.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.994+0000 7fb6ee59c700 1 -- 172.21.15.103:0/2076870424 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f00b9520 con 0x7fb6f00b9140 2020-04-22T14:19:46.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.994+0000 7fb6ee59c700 1 --2- 172.21.15.103:0/2076870424 >> v2:172.21.15.103:3300/0 conn(0x7fb6f00b9140 0x7fb6f00aed90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb6e0002f30 tx=0x7fb6e0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:46.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.994+0000 7fb6ee59c700 1 --2- 172.21.15.103:0/2076870424 >> v2:172.21.15.103:3300/0 conn(0x7fb6f00b9140 0x7fb6f00aed90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb6e0002f30 tx=0x7fb6e0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:46.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.994+0000 7fb6ee59c700 1 --2- 172.21.15.103:0/2076870424 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6f00b9140 0x7fb6f00aed90 secure :-1 s=READY pgs=2045 cs=0 l=1 rx=0x7fb6e0002f30 tx=0x7fb6e0007a40).ready entity=mon.1 client_cookie=831ca05d8c58858f server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:46.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.994+0000 7fb6ee59c700 1 --2- 172.21.15.103:0/2076870424 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6f00b9140 0x7fb6f00aed90 secure :-1 s=THROTTLE_DONE pgs=2045 cs=0 l=1 rx=0x7fb6e0002f30 tx=0x7fb6e0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:47.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.994+0000 7fb6ed59a700 1 -- 172.21.15.103:0/2076870424 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6e0011470 con 0x7fb6f00b9140 2020-04-22T14:19:47.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.994+0000 7fb6ee59c700 1 --2- 172.21.15.103:0/2076870424 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6f00b9140 0x7fb6f00aed90 secure :-1 s=THROTTLE_DONE pgs=2045 cs=0 l=1 rx=0x7fb6e0002f30 tx=0x7fb6e0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:47.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.994+0000 7fb6ed59a700 1 -- 172.21.15.103:0/2076870424 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e00115d0 con 0x7fb6f00b9140 2020-04-22T14:19:47.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.994+0000 7fb6ee59c700 1 --2- 172.21.15.103:0/2076870424 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6f00b9140 0x7fb6f00aed90 secure :-1 s=THROTTLE_DONE pgs=2045 cs=0 l=1 rx=0x7fb6e0002f30 tx=0x7fb6e0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:47.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.994+0000 7fb6f4e09700 1 -- 172.21.15.103:0/2076870424 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6f00b9140 msgr2=0x7fb6f00aed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:47.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.994+0000 7fb6ed59a700 1 -- 172.21.15.103:0/2076870424 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6e00119b0 con 0x7fb6f00b9140 2020-04-22T14:19:47.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.994+0000 7fb6f4e09700 1 --2- 172.21.15.103:0/2076870424 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6f00b9140 0x7fb6f00aed90 secure :-1 s=READY pgs=2045 cs=0 l=1 rx=0x7fb6e0002f30 tx=0x7fb6e0007a40).stop 2020-04-22T14:19:47.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.994+0000 7fb6f4e09700 1 -- 172.21.15.103:0/2076870424 shutdown_connections 2020-04-22T14:19:47.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.994+0000 7fb6f4e09700 1 --2- 172.21.15.103:0/2076870424 >> v2:172.21.15.86:3300/0 conn(0x7fb6f00af1f0 0x7fb6f0144660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:47.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.994+0000 7fb6f4e09700 1 --2- 172.21.15.103:0/2076870424 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6f00b9140 0x7fb6f00aed90 unknown :-1 s=CLOSED pgs=2045 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:47.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.994+0000 7fb6f4e09700 1 -- 172.21.15.103:0/2076870424 >> 172.21.15.103:0/2076870424 conn(0x7fb6f005b7b0 msgr2=0x7fb6f00b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:47.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.994+0000 7fb6f4e09700 1 -- 172.21.15.103:0/2076870424 shutdown_connections 2020-04-22T14:19:47.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.995+0000 7fb6f4e09700 1 -- 172.21.15.103:0/2076870424 wait complete. 2020-04-22T14:19:47.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.995+0000 7fb6f4e09700 1 Processor -- start 2020-04-22T14:19:47.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.995+0000 7fb6f4e09700 1 -- start start 2020-04-22T14:19:47.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.996+0000 7fb6f4e09700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb6f00b3bd0 0x7fb6f01457b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:47.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.996+0000 7fb6f4e09700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb6f00b9140 0x7fb6f0146ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:47.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.996+0000 7fb6f4e09700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f0064d10 con 0x7fb6f00af1f0 2020-04-22T14:19:47.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.996+0000 7fb6f4e09700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6f0064b10 con 0x7fb6f00b9140 2020-04-22T14:19:47.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.996+0000 7fb6f4e09700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f01467a0 con 0x7fb6f00b3bd0 2020-04-22T14:19:47.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.996+0000 7fb6ee59c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb6f00af1f0 0x7fb6f0064400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50534/0 (socket says 172.21.15.103:50534) 2020-04-22T14:19:47.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.996+0000 7fb6ee59c700 1 -- 172.21.15.103:0/571256414 learned_addr learned my addr 172.21.15.103:0/571256414 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:47.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.996+0000 7fb6eed9d700 1 --2- 172.21.15.103:0/571256414 >> v2:172.21.15.103:3300/0 conn(0x7fb6f00b9140 0x7fb6f0146ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:47.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.996+0000 7fb6e77fe700 1 -- 172.21.15.103:0/571256414 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2213418841 0 0) 0x7fb6f0064d10 con 0x7fb6f00af1f0 2020-04-22T14:19:47.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.996+0000 7fb6e77fe700 1 -- 172.21.15.103:0/571256414 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6d4002fe0 con 0x7fb6f00af1f0 2020-04-22T14:19:47.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.996+0000 7fb6edd9b700 1 --2- 172.21.15.103:0/571256414 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb6f00b3bd0 0x7fb6f01457b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:47.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.996+0000 7fb6eed9d700 1 -- 172.21.15.103:0/571256414 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb6f00b3bd0 msgr2=0x7fb6f01457b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:47.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.996+0000 7fb6eed9d700 1 --2- 172.21.15.103:0/571256414 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb6f00b3bd0 0x7fb6f01457b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:47.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.997+0000 7fb6eed9d700 1 -- 172.21.15.103:0/571256414 >> v1:172.21.15.103:6789/0 conn(0x7fb6f00af1f0 legacy=0x7fb6f0064400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:47.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.997+0000 7fb6eed9d700 1 -- 172.21.15.103:0/571256414 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f0146a40 con 0x7fb6f00b9140 2020-04-22T14:19:47.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.997+0000 7fb6eed9d700 1 --2- 172.21.15.103:0/571256414 >> v2:172.21.15.103:3300/0 conn(0x7fb6f00b9140 0x7fb6f0146ee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb6e80032b0 tx=0x7fb6e8010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:47.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.997+0000 7fb6eed9d700 1 --2- 172.21.15.103:0/571256414 >> v2:172.21.15.103:3300/0 conn(0x7fb6f00b9140 0x7fb6f0146ee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb6e80032b0 tx=0x7fb6e8010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:47.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.997+0000 7fb6eed9d700 1 --2- 172.21.15.103:0/571256414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6f00b9140 0x7fb6f0146ee0 secure :-1 s=READY pgs=2047 cs=0 l=1 rx=0x7fb6e80032b0 tx=0x7fb6e8010e40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:47.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.997+0000 7fb6eed9d700 1 --2- 172.21.15.103:0/571256414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6f00b9140 0x7fb6f0146ee0 secure :-1 s=THROTTLE_DONE pgs=2047 cs=0 l=1 rx=0x7fb6e80032b0 tx=0x7fb6e8010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:47.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.997+0000 7fb6e77fe700 1 -- 172.21.15.103:0/571256414 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6e8005e20 con 0x7fb6f00b9140 2020-04-22T14:19:47.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.997+0000 7fb6eed9d700 1 --2- 172.21.15.103:0/571256414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6f00b9140 0x7fb6f0146ee0 secure :-1 s=THROTTLE_DONE pgs=2047 cs=0 l=1 rx=0x7fb6e80032b0 tx=0x7fb6e8010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:47.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.997+0000 7fb6eed9d700 1 --2- 172.21.15.103:0/571256414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6f00b9140 0x7fb6f0146ee0 secure :-1 s=THROTTLE_DONE pgs=2047 cs=0 l=1 rx=0x7fb6e80032b0 tx=0x7fb6e8010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:47.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.997+0000 7fb6e77fe700 1 -- 172.21.15.103:0/571256414 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e80128d0 con 0x7fb6f00b9140 2020-04-22T14:19:47.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.997+0000 7fb6f4e09700 1 -- 172.21.15.103:0/571256414 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6f0147340 con 0x7fb6f00b9140 2020-04-22T14:19:47.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.997+0000 7fb6e77fe700 1 -- 172.21.15.103:0/571256414 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6e8012cb0 con 0x7fb6f00b9140 2020-04-22T14:19:47.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.997+0000 7fb6f4e09700 1 -- 172.21.15.103:0/571256414 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6f00665b0 con 0x7fb6f00b9140 2020-04-22T14:19:47.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.997+0000 7fb6eed9d700 1 --2- 172.21.15.103:0/571256414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6f00b9140 0x7fb6f0146ee0 secure :-1 s=THROTTLE_DONE pgs=2047 cs=0 l=1 rx=0x7fb6e80032b0 tx=0x7fb6e8010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:47.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.998+0000 7fb6e77fe700 1 -- 172.21.15.103:0/571256414 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fb6e8010190 con 0x7fb6f00b9140 2020-04-22T14:19:47.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.998+0000 7fb6eed9d700 1 --2- 172.21.15.103:0/571256414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6f00b9140 0x7fb6f0146ee0 secure :-1 s=THROTTLE_DONE pgs=2047 cs=0 l=1 rx=0x7fb6e80032b0 tx=0x7fb6e8010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:47.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.998+0000 7fb6f4e09700 1 -- 172.21.15.103:0/571256414 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6f0056c90 con 0x7fb6f00b9140 2020-04-22T14:19:47.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.998+0000 7fb6e77fe700 1 --2- 172.21.15.103:0/571256414 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb6d404dd30 0x7fb6d40501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:47.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.998+0000 7fb6e77fe700 1 -- 172.21.15.103:0/571256414 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb6e8061590 con 0x7fb6f00b9140 2020-04-22T14:19:47.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.998+0000 7fb6ee59c700 1 --2- 172.21.15.103:0/571256414 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb6d404dd30 0x7fb6d40501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:47.025 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.999+0000 7fb6ee59c700 1 --2- 172.21.15.103:0/571256414 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb6d404dd30 0x7fb6d40501f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb6e0000b80 tx=0x7fb6e0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:47.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.999+0000 7fb6ee59c700 1 --2- 172.21.15.103:0/571256414 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb6d404dd30 0x7fb6d40501f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb6e0000b80 tx=0x7fb6e0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:47.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:46.999+0000 7fb6ee59c700 1 --2- 172.21.15.103:0/571256414 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb6d404dd30 0x7fb6d40501f0 secure :-1 s=READY pgs=744 cs=0 l=1 rx=0x7fb6e0000b80 tx=0x7fb6e0007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:47.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:47.002+0000 7fb6eed9d700 1 --2- 172.21.15.103:0/571256414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6f00b9140 0x7fb6f0146ee0 secure :-1 s=THROTTLE_DONE pgs=2047 cs=0 l=1 rx=0x7fb6e80032b0 tx=0x7fb6e8010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:47.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:47.002+0000 7fb6e77fe700 1 -- 172.21.15.103:0/571256414 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fb6e803c910 con 0x7fb6f00b9140 2020-04-22T14:19:47.194 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:47.192+0000 7fb6f4e09700 1 -- 172.21.15.103:0/571256414 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb6f01430b0 con 0x7fb6f00b9140 2020-04-22T14:19:47.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:47.996+0000 7fb6eed9d700 1 --2- 172.21.15.103:0/571256414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6f00b9140 0x7fb6f0146ee0 secure :-1 s=READY pgs=2047 cs=0 l=1 rx=0x7fb6e80032b0 tx=0x7fb6e8010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:48.120 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.118+0000 7fb6eed9d700 1 --2- 172.21.15.103:0/571256414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6f00b9140 0x7fb6f0146ee0 secure :-1 s=THROTTLE_DONE pgs=2047 cs=0 l=1 rx=0x7fb6e80032b0 tx=0x7fb6e8010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:48.120 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.118+0000 7fb6e77fe700 1 -- 172.21.15.103:0/571256414 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v107) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb6e803ff30 con 0x7fb6f00b9140 2020-04-22T14:19:48.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.120+0000 7fb6f4e09700 1 -- 172.21.15.103:0/571256414 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb6d404dd30 msgr2=0x7fb6d40501f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:48.122 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.120+0000 7fb6f4e09700 1 --2- 172.21.15.103:0/571256414 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb6d404dd30 0x7fb6d40501f0 secure :-1 s=READY pgs=744 cs=0 l=1 rx=0x7fb6e0000b80 tx=0x7fb6e0007a40).stop 2020-04-22T14:19:48.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.120+0000 7fb6f4e09700 1 -- 172.21.15.103:0/571256414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6f00b9140 msgr2=0x7fb6f0146ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:48.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.120+0000 7fb6f4e09700 1 --2- 172.21.15.103:0/571256414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6f00b9140 0x7fb6f0146ee0 secure :-1 s=READY pgs=2047 cs=0 l=1 rx=0x7fb6e80032b0 tx=0x7fb6e8010e40).stop 2020-04-22T14:19:48.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.120+0000 7fb6f4e09700 1 -- 172.21.15.103:0/571256414 shutdown_connections 2020-04-22T14:19:48.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.120+0000 7fb6f4e09700 1 --2- 172.21.15.103:0/571256414 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb6d404dd30 0x7fb6d40501f0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:48.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.120+0000 7fb6f4e09700 1 --2- 172.21.15.103:0/571256414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6f00b9140 0x7fb6f0146ee0 unknown :-1 s=CLOSED pgs=2047 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:48.123 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.120+0000 7fb6f4e09700 1 --2- 172.21.15.103:0/571256414 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb6f00b3bd0 0x7fb6f01457b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:48.124 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.120+0000 7fb6f4e09700 1 -- 172.21.15.103:0/571256414 >> 172.21.15.103:0/571256414 conn(0x7fb6f005b7b0 msgr2=0x7fb6f00b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:48.124 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.120+0000 7fb6f4e09700 1 -- 172.21.15.103:0/571256414 shutdown_connections 2020-04-22T14:19:48.124 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.120+0000 7fb6f4e09700 1 -- 172.21.15.103:0/571256414 wait complete. 2020-04-22T14:19:48.135 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:48.150 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:19:48.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.301+0000 7f420ab8b700 1 Processor -- start 2020-04-22T14:19:48.303 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.301+0000 7f420ab8b700 1 -- start start 2020-04-22T14:19:48.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.302+0000 7f420ab8b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f42040ad150 0x7f42040664a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:48.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.302+0000 7f420ab8b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4204141c10 0x7f4204142070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:48.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.302+0000 7f420ab8b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4204066a20 con 0x7f42041424d0 2020-04-22T14:19:48.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.302+0000 7f420ab8b700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42040adf30 con 0x7f42040ad150 2020-04-22T14:19:48.308 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.302+0000 7f420ab8b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42040ad7f0 con 0x7f4204141c10 2020-04-22T14:19:48.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.302+0000 7f4209b89700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f42040ad150 0x7f42040664a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:48.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.302+0000 7f4209b89700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f42040ad150 0x7f42040664a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58352/0 (socket says 172.21.15.103:58352) 2020-04-22T14:19:48.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.302+0000 7f4209b89700 1 -- 172.21.15.103:0/3746004489 learned_addr learned my addr 172.21.15.103:0/3746004489 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:19:48.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.302+0000 7f4209388700 1 --2- 172.21.15.103:0/3746004489 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4204141c10 0x7f4204142070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:48.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.302+0000 7f4209b89700 1 -- 172.21.15.103:0/3746004489 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4204141c10 msgr2=0x7f4204142070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:48.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.302+0000 7f4209b89700 1 --2- 172.21.15.103:0/3746004489 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4204141c10 0x7f4204142070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:48.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.302+0000 7f4209b89700 1 -- 172.21.15.103:0/3746004489 >> v1:172.21.15.86:6789/0 conn(0x7f42041424d0 legacy=0x7f4204063340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:48.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.302+0000 7f4209b89700 1 -- 172.21.15.103:0/3746004489 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42040ada90 con 0x7f42040ad150 2020-04-22T14:19:48.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.302+0000 7f4209b89700 1 --2- 172.21.15.103:0/3746004489 >> v2:172.21.15.103:3300/0 conn(0x7f42040ad150 0x7f42040664a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f420406a000 tx=0x7f4200007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:48.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.302+0000 7f4209b89700 1 --2- 172.21.15.103:0/3746004489 >> v2:172.21.15.103:3300/0 conn(0x7f42040ad150 0x7f42040664a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f420406a000 tx=0x7f4200007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:48.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.302+0000 7f4209b89700 1 --2- 172.21.15.103:0/3746004489 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42040ad150 0x7f42040664a0 secure :-1 s=READY pgs=2048 cs=0 l=1 rx=0x7f420406a000 tx=0x7f4200007a40).ready entity=mon.1 client_cookie=2bdb745979fa1ea8 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:48.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.302+0000 7f4209b89700 1 --2- 172.21.15.103:0/3746004489 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42040ad150 0x7f42040664a0 secure :-1 s=THROTTLE_DONE pgs=2048 cs=0 l=1 rx=0x7f420406a000 tx=0x7f4200007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:48.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.302+0000 7f4208b87700 1 -- 172.21.15.103:0/3746004489 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42000116e0 con 0x7f42040ad150 2020-04-22T14:19:48.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.302+0000 7f4209b89700 1 --2- 172.21.15.103:0/3746004489 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42040ad150 0x7f42040664a0 secure :-1 s=THROTTLE_DONE pgs=2048 cs=0 l=1 rx=0x7f420406a000 tx=0x7f4200007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:48.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.302+0000 7f4209b89700 1 --2- 172.21.15.103:0/3746004489 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42040ad150 0x7f42040664a0 secure :-1 s=THROTTLE_DONE pgs=2048 cs=0 l=1 rx=0x7f420406a000 tx=0x7f4200007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:48.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.302+0000 7f4208b87700 1 -- 172.21.15.103:0/3746004489 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4200011840 con 0x7f42040ad150 2020-04-22T14:19:48.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.302+0000 7f4208b87700 1 -- 172.21.15.103:0/3746004489 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4200011c60 con 0x7f42040ad150 2020-04-22T14:19:48.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.302+0000 7f420ab8b700 1 -- 172.21.15.103:0/3746004489 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42040ad150 msgr2=0x7f42040664a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:48.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.302+0000 7f420ab8b700 1 --2- 172.21.15.103:0/3746004489 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42040ad150 0x7f42040664a0 secure :-1 s=READY pgs=2048 cs=0 l=1 rx=0x7f420406a000 tx=0x7f4200007a40).stop 2020-04-22T14:19:48.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.303+0000 7f420ab8b700 1 -- 172.21.15.103:0/3746004489 shutdown_connections 2020-04-22T14:19:48.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.303+0000 7f420ab8b700 1 --2- 172.21.15.103:0/3746004489 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42040ad150 0x7f42040664a0 unknown :-1 s=CLOSED pgs=2048 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:48.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.303+0000 7f420ab8b700 1 --2- 172.21.15.103:0/3746004489 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4204141c10 0x7f4204142070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:48.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.303+0000 7f420ab8b700 1 -- 172.21.15.103:0/3746004489 >> 172.21.15.103:0/3746004489 conn(0x7f420405b7c0 msgr2=0x7f4204061610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:48.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.303+0000 7f420ab8b700 1 -- 172.21.15.103:0/3746004489 shutdown_connections 2020-04-22T14:19:48.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.303+0000 7f420ab8b700 1 -- 172.21.15.103:0/3746004489 wait complete. 2020-04-22T14:19:48.317 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.304+0000 7f420ab8b700 1 Processor -- start 2020-04-22T14:19:48.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.304+0000 7f420ab8b700 1 -- start start 2020-04-22T14:19:48.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.305+0000 7f420ab8b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4204141c10 0x7f420412eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:48.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.305+0000 7f420ab8b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f42041424d0 0x7f42041339d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:48.319 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.305+0000 7f420ab8b700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4204133e30 con 0x7f42040ad150 2020-04-22T14:19:48.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.305+0000 7f420ab8b700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42040af930 con 0x7f42041424d0 2020-04-22T14:19:48.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.305+0000 7f420ab8b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42040afbd0 con 0x7f4204141c10 2020-04-22T14:19:48.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.305+0000 7f4209b89700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f42040ad150 0x7f4204153df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50548/0 (socket says 172.21.15.103:50548) 2020-04-22T14:19:48.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.305+0000 7f4209b89700 1 -- 172.21.15.103:0/1643255880 learned_addr learned my addr 172.21.15.103:0/1643255880 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:48.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.305+0000 7f420a38a700 1 --2- 172.21.15.103:0/1643255880 >> v2:172.21.15.103:3300/0 conn(0x7f42041424d0 0x7f42041339d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:48.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.305+0000 7f4209388700 1 --2- 172.21.15.103:0/1643255880 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4204141c10 0x7f420412eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:48.320 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.305+0000 7f41f6ffd700 1 -- 172.21.15.103:0/1643255880 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2477803674 0 0) 0x7f42040ada90 con 0x7f42040ad150 2020-04-22T14:19:48.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.305+0000 7f41f6ffd700 1 -- 172.21.15.103:0/1643255880 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41e4002fe0 con 0x7f42040ad150 2020-04-22T14:19:48.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.305+0000 7f420a38a700 1 -- 172.21.15.103:0/1643255880 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4204141c10 msgr2=0x7f420412eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:48.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.305+0000 7f420a38a700 1 --2- 172.21.15.103:0/1643255880 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4204141c10 0x7f420412eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:48.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.305+0000 7f420a38a700 1 -- 172.21.15.103:0/1643255880 >> v1:172.21.15.103:6789/0 conn(0x7f42040ad150 legacy=0x7f4204153df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:48.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.305+0000 7f420a38a700 1 -- 172.21.15.103:0/1643255880 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4204131760 con 0x7f42041424d0 2020-04-22T14:19:48.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.305+0000 7f420a38a700 1 --2- 172.21.15.103:0/1643255880 >> v2:172.21.15.103:3300/0 conn(0x7f42041424d0 0x7f42041339d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f41fc0022d0 tx=0x7f41fc010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:48.321 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.305+0000 7f420a38a700 1 --2- 172.21.15.103:0/1643255880 >> v2:172.21.15.103:3300/0 conn(0x7f42041424d0 0x7f42041339d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f41fc0022d0 tx=0x7f41fc010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:48.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.305+0000 7f420a38a700 1 --2- 172.21.15.103:0/1643255880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42041424d0 0x7f42041339d0 secure :-1 s=READY pgs=2050 cs=0 l=1 rx=0x7f41fc0022d0 tx=0x7f41fc010b50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:48.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.305+0000 7f420a38a700 1 --2- 172.21.15.103:0/1643255880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42041424d0 0x7f42041339d0 secure :-1 s=THROTTLE_DONE pgs=2050 cs=0 l=1 rx=0x7f41fc0022d0 tx=0x7f41fc010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:48.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.305+0000 7f41f6ffd700 1 -- 172.21.15.103:0/1643255880 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41fc008180 con 0x7f42041424d0 2020-04-22T14:19:48.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.305+0000 7f420a38a700 1 --2- 172.21.15.103:0/1643255880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42041424d0 0x7f42041339d0 secure :-1 s=THROTTLE_DONE pgs=2050 cs=0 l=1 rx=0x7f41fc0022d0 tx=0x7f41fc010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:48.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.305+0000 7f420a38a700 1 --2- 172.21.15.103:0/1643255880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42041424d0 0x7f42041339d0 secure :-1 s=THROTTLE_DONE pgs=2050 cs=0 l=1 rx=0x7f41fc0022d0 tx=0x7f41fc010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:48.324 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.305+0000 7f41f6ffd700 1 -- 172.21.15.103:0/1643255880 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41fc013070 con 0x7f42041424d0 2020-04-22T14:19:48.324 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.305+0000 7f420ab8b700 1 -- 172.21.15.103:0/1643255880 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f420412f300 con 0x7f42041424d0 2020-04-22T14:19:48.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.305+0000 7f41f6ffd700 1 -- 172.21.15.103:0/1643255880 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41fc008510 con 0x7f42041424d0 2020-04-22T14:19:48.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.305+0000 7f420ab8b700 1 -- 172.21.15.103:0/1643255880 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4204154500 con 0x7f42041424d0 2020-04-22T14:19:48.326 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.306+0000 7f420a38a700 1 --2- 172.21.15.103:0/1643255880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42041424d0 0x7f42041339d0 secure :-1 s=THROTTLE_DONE pgs=2050 cs=0 l=1 rx=0x7f41fc0022d0 tx=0x7f41fc010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:48.326 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.306+0000 7f41f6ffd700 1 -- 172.21.15.103:0/1643255880 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f41fc008740 con 0x7f42041424d0 2020-04-22T14:19:48.326 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.306+0000 7f420a38a700 1 --2- 172.21.15.103:0/1643255880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42041424d0 0x7f42041339d0 secure :-1 s=THROTTLE_DONE pgs=2050 cs=0 l=1 rx=0x7f41fc0022d0 tx=0x7f41fc010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:48.326 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.306+0000 7f420ab8b700 1 -- 172.21.15.103:0/1643255880 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42040af740 con 0x7f42041424d0 2020-04-22T14:19:48.326 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.307+0000 7f41f6ffd700 1 --2- 172.21.15.103:0/1643255880 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f41e404dce0 0x7f41e40501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:48.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.307+0000 7f41f6ffd700 1 -- 172.21.15.103:0/1643255880 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f41fc0616b0 con 0x7f42041424d0 2020-04-22T14:19:48.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.307+0000 7f4209b89700 1 --2- 172.21.15.103:0/1643255880 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f41e404dce0 0x7f41e40501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:48.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.307+0000 7f4209b89700 1 --2- 172.21.15.103:0/1643255880 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f41e404dce0 0x7f41e40501a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f42000088e0 tx=0x7f4200007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:48.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.307+0000 7f4209b89700 1 --2- 172.21.15.103:0/1643255880 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f41e404dce0 0x7f41e40501a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f42000088e0 tx=0x7f4200007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:48.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.307+0000 7f4209b89700 1 --2- 172.21.15.103:0/1643255880 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f41e404dce0 0x7f41e40501a0 secure :-1 s=READY pgs=745 cs=0 l=1 rx=0x7f42000088e0 tx=0x7f4200007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:48.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.311+0000 7f420a38a700 1 --2- 172.21.15.103:0/1643255880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42041424d0 0x7f42041339d0 secure :-1 s=THROTTLE_DONE pgs=2050 cs=0 l=1 rx=0x7f41fc0022d0 tx=0x7f41fc010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:48.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.311+0000 7f41f6ffd700 1 -- 172.21.15.103:0/1643255880 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f41fc03ca30 con 0x7f42041424d0 2020-04-22T14:19:48.505 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.503+0000 7f420ab8b700 1 -- 172.21.15.103:0/1643255880 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4204056c90 con 0x7f42041424d0 2020-04-22T14:19:48.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.504+0000 7f420a38a700 1 --2- 172.21.15.103:0/1643255880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42041424d0 0x7f42041339d0 secure :-1 s=THROTTLE_DONE pgs=2050 cs=0 l=1 rx=0x7f41fc0022d0 tx=0x7f41fc010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:48.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.504+0000 7f41f6ffd700 1 -- 172.21.15.103:0/1643255880 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) v1 ==== 95+0+2146 (secure 0 0 0) 0x7f41fc040050 con 0x7f42041424d0 2020-04-22T14:19:48.506 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:19:48.507 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":107,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6743,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2675694784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2675694784},{"type":"v1","addr":"172.21.15.86:6835","nonce":2675694784}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":104}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:19:46.112631+0000","modified":"2020-04-22T14:19:48.115224+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9703},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9703":{"gid":9703,"name":"a","rank":0,"incarnation":105,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/839133818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":839133818},{"type":"v1","addr":"172.21.15.103:6833","nonce":839133818}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-04-22T14:19:48.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.505+0000 7f420ab8b700 1 -- 172.21.15.103:0/1643255880 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f41e404dce0 msgr2=0x7f41e40501a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:48.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.505+0000 7f420ab8b700 1 --2- 172.21.15.103:0/1643255880 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f41e404dce0 0x7f41e40501a0 secure :-1 s=READY pgs=745 cs=0 l=1 rx=0x7f42000088e0 tx=0x7f4200007a40).stop 2020-04-22T14:19:48.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.505+0000 7f420ab8b700 1 -- 172.21.15.103:0/1643255880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42041424d0 msgr2=0x7f42041339d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:48.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.505+0000 7f420ab8b700 1 --2- 172.21.15.103:0/1643255880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42041424d0 0x7f42041339d0 secure :-1 s=READY pgs=2050 cs=0 l=1 rx=0x7f41fc0022d0 tx=0x7f41fc010b50).stop 2020-04-22T14:19:48.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.505+0000 7f420ab8b700 1 -- 172.21.15.103:0/1643255880 shutdown_connections 2020-04-22T14:19:48.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.505+0000 7f420ab8b700 1 --2- 172.21.15.103:0/1643255880 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f41e404dce0 0x7f41e40501a0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:48.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.505+0000 7f420ab8b700 1 --2- 172.21.15.103:0/1643255880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42041424d0 0x7f42041339d0 unknown :-1 s=CLOSED pgs=2050 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:48.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.505+0000 7f420ab8b700 1 --2- 172.21.15.103:0/1643255880 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4204141c10 0x7f420412eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:48.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.505+0000 7f420ab8b700 1 -- 172.21.15.103:0/1643255880 >> 172.21.15.103:0/1643255880 conn(0x7f420405b7c0 msgr2=0x7f42040b6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:48.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.505+0000 7f420ab8b700 1 -- 172.21.15.103:0/1643255880 shutdown_connections 2020-04-22T14:19:48.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.505+0000 7f420ab8b700 1 -- 172.21.15.103:0/1643255880 wait complete. 2020-04-22T14:19:48.511 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 107 2020-04-22T14:19:48.520 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:48.543 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:19:48.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.689+0000 7f41b7829700 1 Processor -- start 2020-04-22T14:19:48.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.689+0000 7f41b7829700 1 -- start start 2020-04-22T14:19:48.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.690+0000 7f41b7829700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41b01464e0 0x7f41b0064540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:48.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.690+0000 7f41b7829700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41b0143300 con 0x7f41b0065fe0 2020-04-22T14:19:48.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.690+0000 7f41b7829700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41b01435a0 con 0x7f41b012c0d0 2020-04-22T14:19:48.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.690+0000 7f41b7829700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b0143840 con 0x7f41b01464e0 2020-04-22T14:19:48.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.690+0000 7f41b55c5700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f41b012c0d0 0x7f41b005b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50556/0 (socket says 172.21.15.103:50556) 2020-04-22T14:19:48.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.690+0000 7f41b55c5700 1 -- 172.21.15.103:0/4191599148 learned_addr learned my addr 172.21.15.103:0/4191599148 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:48.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.690+0000 7f419ffff700 1 -- 172.21.15.103:0/4191599148 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2300099498 0 0) 0x7f41b01435a0 con 0x7f41b012c0d0 2020-04-22T14:19:48.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.690+0000 7f419ffff700 1 -- 172.21.15.103:0/4191599148 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4198003230 con 0x7f41b012c0d0 2020-04-22T14:19:48.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.690+0000 7f41b5dc6700 1 --2- 172.21.15.103:0/4191599148 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41b01464e0 0x7f41b0064540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:48.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.691+0000 7f419ffff700 1 -- 172.21.15.103:0/4191599148 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 445932263 0 0) 0x7f4198003230 con 0x7f41b012c0d0 2020-04-22T14:19:48.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.691+0000 7f419ffff700 1 -- 172.21.15.103:0/4191599148 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41b01464e0 msgr2=0x7f41b0064540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:48.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.691+0000 7f419ffff700 1 --2- 172.21.15.103:0/4191599148 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41b01464e0 0x7f41b0064540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:48.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.691+0000 7f419ffff700 1 -- 172.21.15.103:0/4191599148 >> v1:172.21.15.86:6789/0 conn(0x7f41b0065fe0 legacy=0x7f41b0063e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:48.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.691+0000 7f419ffff700 1 -- 172.21.15.103:0/4191599148 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b005bb50 con 0x7f41b012c0d0 2020-04-22T14:19:48.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.691+0000 7f419ffff700 1 -- 172.21.15.103:0/4191599148 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f41a00016d0 con 0x7f41b012c0d0 2020-04-22T14:19:48.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.691+0000 7f419ffff700 1 -- 172.21.15.103:0/4191599148 >> v1:172.21.15.103:6789/0 conn(0x7f41b012c0d0 legacy=0x7f41b005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:48.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.691+0000 7f419ffff700 1 --2- 172.21.15.103:0/4191599148 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4198003750 0x7f4198003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:48.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.691+0000 7f419ffff700 1 --2- 172.21.15.103:0/4191599148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4198004090 0x7f4198004570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:48.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.691+0000 7f419ffff700 1 --2- 172.21.15.103:0/4191599148 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41b01464e0 0x7f4198004b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:48.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.691+0000 7f419ffff700 1 -- 172.21.15.103:0/4191599148 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b0143840 con 0x7f4198003750 2020-04-22T14:19:48.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.691+0000 7f419ffff700 1 -- 172.21.15.103:0/4191599148 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4198004fe0 con 0x7f4198004090 2020-04-22T14:19:48.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.691+0000 7f419ffff700 1 -- 172.21.15.103:0/4191599148 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41980051a0 con 0x7f41b01464e0 2020-04-22T14:19:48.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.691+0000 7f41b4dc4700 1 --2- 172.21.15.103:0/4191599148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4198004090 0x7f4198004570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:48.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.691+0000 7f41b55c5700 1 --2- 172.21.15.103:0/4191599148 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4198003750 0x7f4198003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:48.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.691+0000 7f41b5dc6700 1 --2- 172.21.15.103:0/4191599148 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41b01464e0 0x7f4198004b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:48.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.691+0000 7f41b4dc4700 1 -- 172.21.15.103:0/4191599148 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41b01464e0 msgr2=0x7f4198004b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:48.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.691+0000 7f41b4dc4700 1 --2- 172.21.15.103:0/4191599148 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41b01464e0 0x7f4198004b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:48.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.691+0000 7f41b4dc4700 1 -- 172.21.15.103:0/4191599148 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4198003750 msgr2=0x7f4198003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:48.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.691+0000 7f41b4dc4700 1 --2- 172.21.15.103:0/4191599148 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4198003750 0x7f4198003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:48.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.691+0000 7f41b4dc4700 1 -- 172.21.15.103:0/4191599148 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4198003230 con 0x7f4198004090 2020-04-22T14:19:48.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.691+0000 7f41b4dc4700 1 --2- 172.21.15.103:0/4191599148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4198004090 0x7f4198004570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f41b00b85b0 tx=0x7f41ac00fce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:48.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.691+0000 7f41b4dc4700 1 --2- 172.21.15.103:0/4191599148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4198004090 0x7f4198004570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f41b00b85b0 tx=0x7f41ac00fce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:48.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.691+0000 7f41b4dc4700 1 --2- 172.21.15.103:0/4191599148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4198004090 0x7f4198004570 secure :-1 s=READY pgs=2052 cs=0 l=1 rx=0x7f41b00b85b0 tx=0x7f41ac00fce0).ready entity=mon.1 client_cookie=2e562acafccef282 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:48.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.691+0000 7f41b4dc4700 1 --2- 172.21.15.103:0/4191599148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4198004090 0x7f4198004570 secure :-1 s=THROTTLE_DONE pgs=2052 cs=0 l=1 rx=0x7f41b00b85b0 tx=0x7f41ac00fce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:48.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.691+0000 7f419ffff700 1 -- 172.21.15.103:0/4191599148 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41ac003560 con 0x7f4198004090 2020-04-22T14:19:48.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.691+0000 7f41b4dc4700 1 --2- 172.21.15.103:0/4191599148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4198004090 0x7f4198004570 secure :-1 s=THROTTLE_DONE pgs=2052 cs=0 l=1 rx=0x7f41b00b85b0 tx=0x7f41ac00fce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:48.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.691+0000 7f41b4dc4700 1 --2- 172.21.15.103:0/4191599148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4198004090 0x7f4198004570 secure :-1 s=THROTTLE_DONE pgs=2052 cs=0 l=1 rx=0x7f41b00b85b0 tx=0x7f41ac00fce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:48.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.691+0000 7f419ffff700 1 -- 172.21.15.103:0/4191599148 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41ac003700 con 0x7f4198004090 2020-04-22T14:19:48.704 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.691+0000 7f419ffff700 1 -- 172.21.15.103:0/4191599148 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41ac003b20 con 0x7f4198004090 2020-04-22T14:19:48.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.691+0000 7f41b7829700 1 -- 172.21.15.103:0/4191599148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4198004090 msgr2=0x7f4198004570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:48.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.691+0000 7f41b7829700 1 --2- 172.21.15.103:0/4191599148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4198004090 0x7f4198004570 secure :-1 s=READY pgs=2052 cs=0 l=1 rx=0x7f41b00b85b0 tx=0x7f41ac00fce0).stop 2020-04-22T14:19:48.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.691+0000 7f41b5dc6700 1 -- 172.21.15.103:0/4191599148 reap_dead start 2020-04-22T14:19:48.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.692+0000 7f41b7829700 1 -- 172.21.15.103:0/4191599148 shutdown_connections 2020-04-22T14:19:48.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.692+0000 7f41b7829700 1 -- 172.21.15.103:0/4191599148 >> 172.21.15.103:0/4191599148 conn(0x7f41b00b9160 msgr2=0x7f41b005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:48.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.692+0000 7f41b7829700 1 -- 172.21.15.103:0/4191599148 shutdown_connections 2020-04-22T14:19:48.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.692+0000 7f41b7829700 1 -- 172.21.15.103:0/4191599148 wait complete. 2020-04-22T14:19:48.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.693+0000 7f41b7829700 1 Processor -- start 2020-04-22T14:19:48.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.693+0000 7f41b7829700 1 -- start start 2020-04-22T14:19:48.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.694+0000 7f41b7829700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f41b0145590 0x7f41b0142520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:48.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.694+0000 7f41b7829700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41b0148670 0x7f41b0145970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:48.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.694+0000 7f41b7829700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41b014b7c0 con 0x7f41b0141dc0 2020-04-22T14:19:48.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.694+0000 7f41b7829700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41b0145dd0 con 0x7f41b0145590 2020-04-22T14:19:48.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.694+0000 7f41b7829700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b014ba60 con 0x7f41b0148670 2020-04-22T14:19:48.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.694+0000 7f41b55c5700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f41b0145590 0x7f41b0142520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:48.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.694+0000 7f41b5dc6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41b0148670 0x7f41b0145970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:48.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.694+0000 7f41b55c5700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f41b0145590 0x7f41b0142520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:55608/0 (socket says 172.21.15.103:55608) 2020-04-22T14:19:48.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.694+0000 7f41b55c5700 1 -- 172.21.15.103:0/913342451 learned_addr learned my addr 172.21.15.103:0/913342451 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:19:48.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.694+0000 7f41b5dc6700 1 -- 172.21.15.103:0/913342451 >> v2:172.21.15.86:3300/0 conn(0x7f41b0145590 msgr2=0x7f41b0142520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:48.707 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.694+0000 7f41b5dc6700 1 --2- 172.21.15.103:0/913342451 >> v2:172.21.15.86:3300/0 conn(0x7f41b0145590 0x7f41b0142520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:48.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.694+0000 7f41b5dc6700 1 -- 172.21.15.103:0/913342451 >> v1:172.21.15.86:6789/0 conn(0x7f41b0141dc0 legacy=0x7f41b011e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:48.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.694+0000 7f41b5dc6700 1 -- 172.21.15.103:0/913342451 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b014bd00 con 0x7f41b0148670 2020-04-22T14:19:48.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.694+0000 7f41b55c5700 1 --2- 172.21.15.103:0/913342451 >> v2:172.21.15.86:3300/0 conn(0x7f41b0145590 0x7f41b0142520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:19:48.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.694+0000 7f41b5dc6700 1 --2- 172.21.15.103:0/913342451 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41b0148670 0x7f41b0145970 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f41a00010d0 tx=0x7f41a8010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:48.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.694+0000 7f41b5dc6700 1 --2- 172.21.15.103:0/913342451 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41b0148670 0x7f41b0145970 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f41a00010d0 tx=0x7f41a8010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:48.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.694+0000 7f41b5dc6700 1 --2- 172.21.15.103:0/913342451 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41b0148670 0x7f41b0145970 secure :-1 s=READY pgs=189 cs=0 l=1 rx=0x7f41a00010d0 tx=0x7f41a8010b40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:48.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.694+0000 7f41b5dc6700 1 --2- 172.21.15.103:0/913342451 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41b0148670 0x7f41b0145970 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f41a00010d0 tx=0x7f41a8010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:48.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.695+0000 7f419e7fc700 1 -- 172.21.15.103:0/913342451 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41a8005e20 con 0x7f41b0148670 2020-04-22T14:19:48.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.695+0000 7f41b5dc6700 1 --2- 172.21.15.103:0/913342451 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41b0148670 0x7f41b0145970 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f41a00010d0 tx=0x7f41a8010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:48.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.695+0000 7f41b7829700 1 -- 172.21.15.103:0/913342451 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41b012b6c0 con 0x7f41b0148670 2020-04-22T14:19:48.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.695+0000 7f419e7fc700 1 -- 172.21.15.103:0/913342451 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a80124b0 con 0x7f41b0148670 2020-04-22T14:19:48.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.695+0000 7f41b5dc6700 1 --2- 172.21.15.103:0/913342451 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41b0148670 0x7f41b0145970 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f41a00010d0 tx=0x7f41a8010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:48.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.695+0000 7f419e7fc700 1 -- 172.21.15.103:0/913342451 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41a8012890 con 0x7f41b0148670 2020-04-22T14:19:48.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.695+0000 7f41b7829700 1 -- 172.21.15.103:0/913342451 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41b011f0e0 con 0x7f41b0148670 2020-04-22T14:19:48.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.695+0000 7f41b5dc6700 1 --2- 172.21.15.103:0/913342451 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41b0148670 0x7f41b0145970 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f41a00010d0 tx=0x7f41a8010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:48.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.696+0000 7f41b7829700 1 -- 172.21.15.103:0/913342451 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41b014be90 con 0x7f41b0148670 2020-04-22T14:19:48.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.696+0000 7f419e7fc700 1 -- 172.21.15.103:0/913342451 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f41a80129f0 con 0x7f41b0148670 2020-04-22T14:19:48.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.696+0000 7f41b5dc6700 1 --2- 172.21.15.103:0/913342451 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41b0148670 0x7f41b0145970 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f41a00010d0 tx=0x7f41a8010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:48.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.696+0000 7f419e7fc700 1 --2- 172.21.15.103:0/913342451 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f419004d900 0x7f419004fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:48.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.696+0000 7f419e7fc700 1 -- 172.21.15.103:0/913342451 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f41a8061030 con 0x7f41b0148670 2020-04-22T14:19:48.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.696+0000 7f41b55c5700 1 --2- 172.21.15.103:0/913342451 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f419004d900 0x7f419004fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:48.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.697+0000 7f41b55c5700 1 --2- 172.21.15.103:0/913342451 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f419004d900 0x7f419004fdc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f41a00013e0 tx=0x7f41b005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:48.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.697+0000 7f41b55c5700 1 --2- 172.21.15.103:0/913342451 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f419004d900 0x7f419004fdc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f41a00013e0 tx=0x7f41b005bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:48.714 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.697+0000 7f41b55c5700 1 --2- 172.21.15.103:0/913342451 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f419004d900 0x7f419004fdc0 secure :-1 s=READY pgs=746 cs=0 l=1 rx=0x7f41a00013e0 tx=0x7f41b005bce0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:48.714 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.700+0000 7f41b5dc6700 1 --2- 172.21.15.103:0/913342451 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41b0148670 0x7f41b0145970 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f41a00010d0 tx=0x7f41a8010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:48.714 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.700+0000 7f419e7fc700 1 -- 172.21.15.103:0/913342451 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f41a803c410 con 0x7f41b0148670 2020-04-22T14:19:48.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.845+0000 7f41b7829700 1 -- 172.21.15.103:0/913342451 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41b0056c90 con 0x7f41b0148670 2020-04-22T14:19:48.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.846+0000 7f41b5dc6700 1 --2- 172.21.15.103:0/913342451 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41b0148670 0x7f41b0145970 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f41a00010d0 tx=0x7f41a8010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:48.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.846+0000 7f419e7fc700 1 -- 172.21.15.103:0/913342451 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) v1 ==== 74+0+16103 (secure 0 0 0) 0x7f41a803fa30 con 0x7f41b0148670 2020-04-22T14:19:48.848 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:19:48.848 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":146,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:19:47.113833+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:19:44.035980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2020-04-22T14:19:45.079896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:19:48.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.847+0000 7f41b7829700 1 -- 172.21.15.103:0/913342451 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f419004d900 msgr2=0x7f419004fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:48.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.847+0000 7f41b7829700 1 --2- 172.21.15.103:0/913342451 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f419004d900 0x7f419004fdc0 secure :-1 s=READY pgs=746 cs=0 l=1 rx=0x7f41a00013e0 tx=0x7f41b005bce0).stop 2020-04-22T14:19:48.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.847+0000 7f41b7829700 1 -- 172.21.15.103:0/913342451 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41b0148670 msgr2=0x7f41b0145970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:48.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.847+0000 7f41b7829700 1 --2- 172.21.15.103:0/913342451 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41b0148670 0x7f41b0145970 secure :-1 s=READY pgs=189 cs=0 l=1 rx=0x7f41a00010d0 tx=0x7f41a8010b40).stop 2020-04-22T14:19:48.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.847+0000 7f41b7829700 1 -- 172.21.15.103:0/913342451 shutdown_connections 2020-04-22T14:19:48.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.847+0000 7f41b7829700 1 --2- 172.21.15.103:0/913342451 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41b0148670 0x7f41b0145970 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:48.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.847+0000 7f41b7829700 1 --2- 172.21.15.103:0/913342451 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f419004d900 0x7f419004fdc0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:48.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.847+0000 7f41b7829700 1 --2- 172.21.15.103:0/913342451 >> v2:172.21.15.86:3300/0 conn(0x7f41b0145590 0x7f41b0142520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:48.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.847+0000 7f41b7829700 1 -- 172.21.15.103:0/913342451 >> 172.21.15.103:0/913342451 conn(0x7f41b00b9160 msgr2=0x7f41b0120e00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:48.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.847+0000 7f41b7829700 1 -- 172.21.15.103:0/913342451 shutdown_connections 2020-04-22T14:19:48.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:48.847+0000 7f41b7829700 1 -- 172.21.15.103:0/913342451 wait complete. 2020-04-22T14:19:48.860 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:48.874 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:19:49.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.024+0000 7f68e8ee3700 1 Processor -- start 2020-04-22T14:19:49.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.025+0000 7f68e8ee3700 1 -- start start 2020-04-22T14:19:49.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.025+0000 7f68e8ee3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f68e4062170 0x7f68e40b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:49.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.025+0000 7f68e8ee3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f68e40b5210 0x7f68e40adf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:49.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.025+0000 7f68e8ee3700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68e40b5650 con 0x7f68e4152a90 2020-04-22T14:19:49.030 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.025+0000 7f68e8ee3700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68e40614f0 con 0x7f68e40b5210 2020-04-22T14:19:49.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.025+0000 7f68e8ee3700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68e4061790 con 0x7f68e4062170 2020-04-22T14:19:49.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.026+0000 7f68e259c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f68e4062170 0x7f68e40b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:49.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.026+0000 7f68e259c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f68e4062170 0x7f68e40b4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58384/0 (socket says 172.21.15.103:58384) 2020-04-22T14:19:49.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.026+0000 7f68e259c700 1 -- 172.21.15.103:0/3826033552 learned_addr learned my addr 172.21.15.103:0/3826033552 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:19:49.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.026+0000 7f68e359e700 1 --2- 172.21.15.103:0/3826033552 >> v2:172.21.15.86:3300/0 conn(0x7f68e40b5210 0x7f68e40adf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:49.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.026+0000 7f68e259c700 1 -- 172.21.15.103:0/3826033552 >> v2:172.21.15.86:3300/0 conn(0x7f68e40b5210 msgr2=0x7f68e40adf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:49.031 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.026+0000 7f68e259c700 1 --2- 172.21.15.103:0/3826033552 >> v2:172.21.15.86:3300/0 conn(0x7f68e40b5210 0x7f68e40adf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:49.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.026+0000 7f68e259c700 1 -- 172.21.15.103:0/3826033552 >> v1:172.21.15.86:6789/0 conn(0x7f68e4152a90 legacy=0x7f68e40b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:49.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.026+0000 7f68e259c700 1 -- 172.21.15.103:0/3826033552 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e4061a30 con 0x7f68e4062170 2020-04-22T14:19:49.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.026+0000 7f68e359e700 1 --2- 172.21.15.103:0/3826033552 >> v2:172.21.15.86:3300/0 conn(0x7f68e40b5210 0x7f68e40adf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:19:49.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.026+0000 7f68e259c700 1 --2- 172.21.15.103:0/3826033552 >> v2:172.21.15.103:3300/0 conn(0x7f68e4062170 0x7f68e40b4db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f68d8002f30 tx=0x7f68e405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.026+0000 7f68e259c700 1 --2- 172.21.15.103:0/3826033552 >> v2:172.21.15.103:3300/0 conn(0x7f68e4062170 0x7f68e40b4db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f68d8002f30 tx=0x7f68e405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.026+0000 7f68e259c700 1 --2- 172.21.15.103:0/3826033552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68e4062170 0x7f68e40b4db0 secure :-1 s=READY pgs=2053 cs=0 l=1 rx=0x7f68d8002f30 tx=0x7f68e405a720).ready entity=mon.1 client_cookie=27e4253546fd8c89 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:49.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.026+0000 7f68e259c700 1 --2- 172.21.15.103:0/3826033552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68e4062170 0x7f68e40b4db0 secure :-1 s=THROTTLE_DONE pgs=2053 cs=0 l=1 rx=0x7f68d8002f30 tx=0x7f68e405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.032 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.026+0000 7f68e1d9b700 1 -- 172.21.15.103:0/3826033552 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68d8011720 con 0x7f68e4062170 2020-04-22T14:19:49.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.026+0000 7f68e259c700 1 --2- 172.21.15.103:0/3826033552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68e4062170 0x7f68e40b4db0 secure :-1 s=THROTTLE_DONE pgs=2053 cs=0 l=1 rx=0x7f68d8002f30 tx=0x7f68e405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.026+0000 7f68e259c700 1 --2- 172.21.15.103:0/3826033552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68e4062170 0x7f68e40b4db0 secure :-1 s=THROTTLE_DONE pgs=2053 cs=0 l=1 rx=0x7f68d8002f30 tx=0x7f68e405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.026+0000 7f68e1d9b700 1 -- 172.21.15.103:0/3826033552 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d8011880 con 0x7f68e4062170 2020-04-22T14:19:49.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.026+0000 7f68e1d9b700 1 -- 172.21.15.103:0/3826033552 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68d8011ca0 con 0x7f68e4062170 2020-04-22T14:19:49.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.026+0000 7f68e8ee3700 1 -- 172.21.15.103:0/3826033552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68e4062170 msgr2=0x7f68e40b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:49.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.026+0000 7f68e8ee3700 1 --2- 172.21.15.103:0/3826033552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68e4062170 0x7f68e40b4db0 secure :-1 s=READY pgs=2053 cs=0 l=1 rx=0x7f68d8002f30 tx=0x7f68e405a720).stop 2020-04-22T14:19:49.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.027+0000 7f68e8ee3700 1 -- 172.21.15.103:0/3826033552 shutdown_connections 2020-04-22T14:19:49.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.027+0000 7f68e8ee3700 1 --2- 172.21.15.103:0/3826033552 >> v2:172.21.15.86:3300/0 conn(0x7f68e40b5210 0x7f68e40adf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:49.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.027+0000 7f68e8ee3700 1 --2- 172.21.15.103:0/3826033552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68e4062170 0x7f68e40b4db0 unknown :-1 s=CLOSED pgs=2053 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:49.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.027+0000 7f68e8ee3700 1 -- 172.21.15.103:0/3826033552 >> 172.21.15.103:0/3826033552 conn(0x7f68e405ad30 msgr2=0x7f68e405b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:49.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.027+0000 7f68e8ee3700 1 -- 172.21.15.103:0/3826033552 shutdown_connections 2020-04-22T14:19:49.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.027+0000 7f68e8ee3700 1 -- 172.21.15.103:0/3826033552 wait complete. 2020-04-22T14:19:49.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.028+0000 7f68e8ee3700 1 Processor -- start 2020-04-22T14:19:49.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.028+0000 7f68e8ee3700 1 -- start start 2020-04-22T14:19:49.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.029+0000 7f68e8ee3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f68e4062170 0x7f68e4064470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:49.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.029+0000 7f68e8ee3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f68e40b5210 0x7f68e412cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:49.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.029+0000 7f68e8ee3700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68e4140000 con 0x7f68e4152a90 2020-04-22T14:19:49.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.029+0000 7f68e8ee3700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68e412d340 con 0x7f68e40b5210 2020-04-22T14:19:49.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.029+0000 7f68e8ee3700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68e4153010 con 0x7f68e4062170 2020-04-22T14:19:49.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.029+0000 7f68e2d9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f68e4062170 0x7f68e4064470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:49.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.029+0000 7f68e2d9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f68e4062170 0x7f68e4064470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58390/0 (socket says 172.21.15.103:58390) 2020-04-22T14:19:49.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.029+0000 7f68e2d9d700 1 -- 172.21.15.103:0/3791481438 learned_addr learned my addr 172.21.15.103:0/3791481438 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:19:49.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.029+0000 7f68e259c700 1 --2- 172.21.15.103:0/3791481438 >> v2:172.21.15.86:3300/0 conn(0x7f68e40b5210 0x7f68e412cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:49.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.029+0000 7f68e2d9d700 1 -- 172.21.15.103:0/3791481438 >> v2:172.21.15.86:3300/0 conn(0x7f68e40b5210 msgr2=0x7f68e412cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:49.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.029+0000 7f68e2d9d700 1 --2- 172.21.15.103:0/3791481438 >> v2:172.21.15.86:3300/0 conn(0x7f68e40b5210 0x7f68e412cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:49.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.029+0000 7f68e2d9d700 1 -- 172.21.15.103:0/3791481438 >> v1:172.21.15.86:6789/0 conn(0x7f68e4152a90 legacy=0x7f68e4125ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:49.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.029+0000 7f68e2d9d700 1 -- 172.21.15.103:0/3791481438 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e41532b0 con 0x7f68e4062170 2020-04-22T14:19:49.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.029+0000 7f68e2d9d700 1 --2- 172.21.15.103:0/3791481438 >> v2:172.21.15.103:3300/0 conn(0x7f68e4062170 0x7f68e4064470 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f68e40ad5a0 tx=0x7f68d400c7e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.029+0000 7f68e2d9d700 1 --2- 172.21.15.103:0/3791481438 >> v2:172.21.15.103:3300/0 conn(0x7f68e4062170 0x7f68e4064470 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f68e40ad5a0 tx=0x7f68d400c7e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.029+0000 7f68e2d9d700 1 --2- 172.21.15.103:0/3791481438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68e4062170 0x7f68e4064470 secure :-1 s=READY pgs=2054 cs=0 l=1 rx=0x7f68e40ad5a0 tx=0x7f68d400c7e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:49.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.029+0000 7f68e2d9d700 1 --2- 172.21.15.103:0/3791481438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68e4062170 0x7f68e4064470 secure :-1 s=THROTTLE_DONE pgs=2054 cs=0 l=1 rx=0x7f68e40ad5a0 tx=0x7f68d400c7e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.029+0000 7f68d37fe700 1 -- 172.21.15.103:0/3791481438 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68d40101e0 con 0x7f68e4062170 2020-04-22T14:19:49.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.029+0000 7f68e2d9d700 1 --2- 172.21.15.103:0/3791481438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68e4062170 0x7f68e4064470 secure :-1 s=THROTTLE_DONE pgs=2054 cs=0 l=1 rx=0x7f68e40ad5a0 tx=0x7f68d400c7e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.029+0000 7f68e2d9d700 1 --2- 172.21.15.103:0/3791481438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68e4062170 0x7f68e4064470 secure :-1 s=THROTTLE_DONE pgs=2054 cs=0 l=1 rx=0x7f68e40ad5a0 tx=0x7f68d400c7e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.029+0000 7f68d37fe700 1 -- 172.21.15.103:0/3791481438 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d4010340 con 0x7f68e4062170 2020-04-22T14:19:49.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.029+0000 7f68e8ee3700 1 -- 172.21.15.103:0/3791481438 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68e40b3aa0 con 0x7f68e4062170 2020-04-22T14:19:49.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.029+0000 7f68d37fe700 1 -- 172.21.15.103:0/3791481438 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68d4010760 con 0x7f68e4062170 2020-04-22T14:19:49.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.029+0000 7f68e8ee3700 1 -- 172.21.15.103:0/3791481438 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68e413f910 con 0x7f68e4062170 2020-04-22T14:19:49.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.030+0000 7f68e2d9d700 1 --2- 172.21.15.103:0/3791481438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68e4062170 0x7f68e4064470 secure :-1 s=THROTTLE_DONE pgs=2054 cs=0 l=1 rx=0x7f68e40ad5a0 tx=0x7f68d400c7e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.030+0000 7f68d37fe700 1 -- 172.21.15.103:0/3791481438 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f68d4006860 con 0x7f68e4062170 2020-04-22T14:19:49.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.030+0000 7f68e2d9d700 1 --2- 172.21.15.103:0/3791481438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68e4062170 0x7f68e4064470 secure :-1 s=THROTTLE_DONE pgs=2054 cs=0 l=1 rx=0x7f68e40ad5a0 tx=0x7f68d400c7e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.030+0000 7f68e8ee3700 1 -- 172.21.15.103:0/3791481438 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68e4056c90 con 0x7f68e4062170 2020-04-22T14:19:49.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.031+0000 7f68d37fe700 1 --2- 172.21.15.103:0/3791481438 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f68c804d9e0 0x7f68c804fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:49.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.031+0000 7f68d37fe700 1 -- 172.21.15.103:0/3791481438 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f68d40617c0 con 0x7f68e4062170 2020-04-22T14:19:49.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.031+0000 7f68e259c700 1 --2- 172.21.15.103:0/3791481438 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f68c804d9e0 0x7f68c804fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:49.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.031+0000 7f68e259c700 1 --2- 172.21.15.103:0/3791481438 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f68c804d9e0 0x7f68c804fea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f68d8002f30 tx=0x7f68e405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.031+0000 7f68e259c700 1 --2- 172.21.15.103:0/3791481438 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f68c804d9e0 0x7f68c804fea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f68d8002f30 tx=0x7f68e405a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.031+0000 7f68e259c700 1 --2- 172.21.15.103:0/3791481438 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f68c804d9e0 0x7f68c804fea0 secure :-1 s=READY pgs=747 cs=0 l=1 rx=0x7f68d8002f30 tx=0x7f68e405a720).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:49.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.035+0000 7f68e2d9d700 1 --2- 172.21.15.103:0/3791481438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68e4062170 0x7f68e4064470 secure :-1 s=THROTTLE_DONE pgs=2054 cs=0 l=1 rx=0x7f68e40ad5a0 tx=0x7f68d400c7e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.035+0000 7f68d37fe700 1 -- 172.21.15.103:0/3791481438 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f68d403cc00 con 0x7f68e4062170 2020-04-22T14:19:49.228 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.226+0000 7f68e8ee3700 1 -- 172.21.15.103:0/3791481438 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f68e413fde0 con 0x7f68e4062170 2020-04-22T14:19:49.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.230+0000 7f68e2d9d700 1 --2- 172.21.15.103:0/3791481438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68e4062170 0x7f68e4064470 secure :-1 s=THROTTLE_DONE pgs=2054 cs=0 l=1 rx=0x7f68e40ad5a0 tx=0x7f68d400c7e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.230+0000 7f68d37fe700 1 -- 172.21.15.103:0/3791481438 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v53) v1 ==== 184+0+0 (secure 0 0 0) 0x7f68d4040220 con 0x7f68e4062170 2020-04-22T14:19:49.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.231+0000 7f68e8ee3700 1 -- 172.21.15.103:0/3791481438 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f68c804d9e0 msgr2=0x7f68c804fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:49.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.231+0000 7f68e8ee3700 1 --2- 172.21.15.103:0/3791481438 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f68c804d9e0 0x7f68c804fea0 secure :-1 s=READY pgs=747 cs=0 l=1 rx=0x7f68d8002f30 tx=0x7f68e405a720).stop 2020-04-22T14:19:49.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.231+0000 7f68e8ee3700 1 -- 172.21.15.103:0/3791481438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68e4062170 msgr2=0x7f68e4064470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:49.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.231+0000 7f68e8ee3700 1 --2- 172.21.15.103:0/3791481438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68e4062170 0x7f68e4064470 secure :-1 s=READY pgs=2054 cs=0 l=1 rx=0x7f68e40ad5a0 tx=0x7f68d400c7e0).stop 2020-04-22T14:19:49.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.231+0000 7f68e8ee3700 1 -- 172.21.15.103:0/3791481438 shutdown_connections 2020-04-22T14:19:49.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.231+0000 7f68e8ee3700 1 --2- 172.21.15.103:0/3791481438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68e4062170 0x7f68e4064470 unknown :-1 s=CLOSED pgs=2054 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:49.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.231+0000 7f68e8ee3700 1 --2- 172.21.15.103:0/3791481438 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f68c804d9e0 0x7f68c804fea0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:49.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.231+0000 7f68e8ee3700 1 --2- 172.21.15.103:0/3791481438 >> v2:172.21.15.86:3300/0 conn(0x7f68e40b5210 0x7f68e412cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:49.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.231+0000 7f68e8ee3700 1 -- 172.21.15.103:0/3791481438 >> 172.21.15.103:0/3791481438 conn(0x7f68e405ad30 msgr2=0x7f68e40b7630 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:49.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.231+0000 7f68e8ee3700 1 -- 172.21.15.103:0/3791481438 shutdown_connections 2020-04-22T14:19:49.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.231+0000 7f68e8ee3700 1 -- 172.21.15.103:0/3791481438 wait complete. 2020-04-22T14:19:49.236 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.0 2020-04-22T14:19:49.244 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:49.259 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:19:49.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.408+0000 7f7c07c12700 1 Processor -- start 2020-04-22T14:19:49.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.408+0000 7f7c07c12700 1 -- start start 2020-04-22T14:19:49.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.409+0000 7f7c07c12700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7c00062170 0x7f7c000b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:49.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.409+0000 7f7c07c12700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c000b5210 0x7f7c000adf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:49.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.409+0000 7f7c07c12700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c000b5680 con 0x7f7c00152a90 2020-04-22T14:19:49.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.409+0000 7f7c07c12700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c000614f0 con 0x7f7c00062170 2020-04-22T14:19:49.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.409+0000 7f7c07c12700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c00061790 con 0x7f7c000b5210 2020-04-22T14:19:49.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.409+0000 7f7c061af700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f7c00152a90 0x7f7c000b44d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50588/0 (socket says 172.21.15.103:50588) 2020-04-22T14:19:49.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.409+0000 7f7c061af700 1 -- 172.21.15.103:0/4004536527 learned_addr learned my addr 172.21.15.103:0/4004536527 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:49.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.409+0000 7f7c051ad700 1 -- 172.21.15.103:0/4004536527 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1456643783 0 0) 0x7f7c000b5680 con 0x7f7c00152a90 2020-04-22T14:19:49.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.409+0000 7f7c051ad700 1 -- 172.21.15.103:0/4004536527 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bec003230 con 0x7f7c00152a90 2020-04-22T14:19:49.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.409+0000 7f7c059ae700 1 --2- 172.21.15.103:0/4004536527 >> v2:172.21.15.86:3300/0 conn(0x7f7c00062170 0x7f7c000b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:49.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.409+0000 7f7c069b0700 1 --2- 172.21.15.103:0/4004536527 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c000b5210 0x7f7c000adf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:49.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.409+0000 7f7c051ad700 1 -- 172.21.15.103:0/4004536527 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3954270081 0 0) 0x7f7bec003230 con 0x7f7c00152a90 2020-04-22T14:19:49.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.409+0000 7f7c051ad700 1 -- 172.21.15.103:0/4004536527 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c000b5210 msgr2=0x7f7c000adf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:49.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.409+0000 7f7c051ad700 1 --2- 172.21.15.103:0/4004536527 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c000b5210 0x7f7c000adf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:49.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.409+0000 7f7c051ad700 1 -- 172.21.15.103:0/4004536527 >> v2:172.21.15.86:3300/0 conn(0x7f7c00062170 msgr2=0x7f7c000b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:49.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.409+0000 7f7c051ad700 1 --2- 172.21.15.103:0/4004536527 >> v2:172.21.15.86:3300/0 conn(0x7f7c00062170 0x7f7c000b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:49.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.409+0000 7f7c051ad700 1 -- 172.21.15.103:0/4004536527 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c00061a30 con 0x7f7c00152a90 2020-04-22T14:19:49.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.409+0000 7f7c051ad700 1 -- 172.21.15.103:0/4004536527 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f7bfc001a50 con 0x7f7c00152a90 2020-04-22T14:19:49.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.409+0000 7f7c051ad700 1 -- 172.21.15.103:0/4004536527 >> v1:172.21.15.103:6789/0 conn(0x7f7c00152a90 legacy=0x7f7c000b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:49.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.410+0000 7f7c051ad700 1 --2- 172.21.15.103:0/4004536527 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c000b5210 0x7f7bec003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:49.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.410+0000 7f7c051ad700 1 --2- 172.21.15.103:0/4004536527 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7bec003b80 0x7f7bec003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:49.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.410+0000 7f7c051ad700 1 --2- 172.21.15.103:0/4004536527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bec0045c0 0x7f7bec004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:49.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.410+0000 7f7c051ad700 1 -- 172.21.15.103:0/4004536527 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c000614f0 con 0x7f7bec003b80 2020-04-22T14:19:49.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.410+0000 7f7c051ad700 1 -- 172.21.15.103:0/4004536527 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c00061790 con 0x7f7bec0045c0 2020-04-22T14:19:49.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.410+0000 7f7c051ad700 1 -- 172.21.15.103:0/4004536527 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bec005050 con 0x7f7c000b5210 2020-04-22T14:19:49.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.410+0000 7f7c069b0700 1 --2- 172.21.15.103:0/4004536527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bec0045c0 0x7f7bec004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:49.426 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.410+0000 7f7c061af700 1 --2- 172.21.15.103:0/4004536527 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c000b5210 0x7f7bec003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:49.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.410+0000 7f7c059ae700 1 --2- 172.21.15.103:0/4004536527 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7bec003b80 0x7f7bec003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:49.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.410+0000 7f7c069b0700 1 -- 172.21.15.103:0/4004536527 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c000b5210 msgr2=0x7f7bec003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:49.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.410+0000 7f7c069b0700 1 --2- 172.21.15.103:0/4004536527 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c000b5210 0x7f7bec003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:49.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.410+0000 7f7c069b0700 1 -- 172.21.15.103:0/4004536527 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7bec003b80 msgr2=0x7f7bec003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:49.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.410+0000 7f7c069b0700 1 --2- 172.21.15.103:0/4004536527 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7bec003b80 0x7f7bec003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:49.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.410+0000 7f7c069b0700 1 -- 172.21.15.103:0/4004536527 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bec003230 con 0x7f7bec0045c0 2020-04-22T14:19:49.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.410+0000 7f7c069b0700 1 --2- 172.21.15.103:0/4004536527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bec0045c0 0x7f7bec004a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7bf8002f30 tx=0x7f7bf8010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.427 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.410+0000 7f7c069b0700 1 --2- 172.21.15.103:0/4004536527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bec0045c0 0x7f7bec004a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7bf8002f30 tx=0x7f7bf8010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.410+0000 7f7c069b0700 1 --2- 172.21.15.103:0/4004536527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bec0045c0 0x7f7bec004a20 secure :-1 s=READY pgs=2056 cs=0 l=1 rx=0x7f7bf8002f30 tx=0x7f7bf8010020).ready entity=mon.1 client_cookie=85bbeacbd17a560b server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:49.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.410+0000 7f7c069b0700 1 --2- 172.21.15.103:0/4004536527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bec0045c0 0x7f7bec004a20 secure :-1 s=THROTTLE_DONE pgs=2056 cs=0 l=1 rx=0x7f7bf8002f30 tx=0x7f7bf8010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.410+0000 7f7c051ad700 1 -- 172.21.15.103:0/4004536527 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bf8008d30 con 0x7f7bec0045c0 2020-04-22T14:19:49.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.410+0000 7f7c069b0700 1 --2- 172.21.15.103:0/4004536527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bec0045c0 0x7f7bec004a20 secure :-1 s=THROTTLE_DONE pgs=2056 cs=0 l=1 rx=0x7f7bf8002f30 tx=0x7f7bf8010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.410+0000 7f7c051ad700 1 -- 172.21.15.103:0/4004536527 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf8008e90 con 0x7f7bec0045c0 2020-04-22T14:19:49.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.410+0000 7f7c069b0700 1 --2- 172.21.15.103:0/4004536527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bec0045c0 0x7f7bec004a20 secure :-1 s=THROTTLE_DONE pgs=2056 cs=0 l=1 rx=0x7f7bf8002f30 tx=0x7f7bf8010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.410+0000 7f7c051ad700 1 -- 172.21.15.103:0/4004536527 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bf8010a90 con 0x7f7bec0045c0 2020-04-22T14:19:49.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.410+0000 7f7c07c12700 1 -- 172.21.15.103:0/4004536527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bec0045c0 msgr2=0x7f7bec004a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:49.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.410+0000 7f7c07c12700 1 --2- 172.21.15.103:0/4004536527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bec0045c0 0x7f7bec004a20 secure :-1 s=READY pgs=2056 cs=0 l=1 rx=0x7f7bf8002f30 tx=0x7f7bf8010020).stop 2020-04-22T14:19:49.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.410+0000 7f7c069b0700 1 -- 172.21.15.103:0/4004536527 reap_dead start 2020-04-22T14:19:49.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.411+0000 7f7c07c12700 1 -- 172.21.15.103:0/4004536527 shutdown_connections 2020-04-22T14:19:49.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.411+0000 7f7c07c12700 1 -- 172.21.15.103:0/4004536527 >> 172.21.15.103:0/4004536527 conn(0x7f7c0005ad30 msgr2=0x7f7c0005b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:49.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.411+0000 7f7c07c12700 1 -- 172.21.15.103:0/4004536527 shutdown_connections 2020-04-22T14:19:49.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.411+0000 7f7c07c12700 1 -- 172.21.15.103:0/4004536527 wait complete. 2020-04-22T14:19:49.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.412+0000 7f7c07c12700 1 Processor -- start 2020-04-22T14:19:49.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.412+0000 7f7c07c12700 1 -- start start 2020-04-22T14:19:49.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.412+0000 7f7c07c12700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c00122240 0x7f7c001268d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:49.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.412+0000 7f7c07c12700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c00113700 con 0x7f7c000b84c0 2020-04-22T14:19:49.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.412+0000 7f7c07c12700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c001228b0 con 0x7f7c00113260 2020-04-22T14:19:49.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.412+0000 7f7c07c12700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c001226b0 con 0x7f7c00122240 2020-04-22T14:19:49.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.413+0000 7f7c059ae700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f7c00113260 0x7f7c00122ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50602/0 (socket says 172.21.15.103:50602) 2020-04-22T14:19:49.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.413+0000 7f7c059ae700 1 -- 172.21.15.103:0/3561280605 learned_addr learned my addr 172.21.15.103:0/3561280605 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:49.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.413+0000 7f7c061af700 1 --2- 172.21.15.103:0/3561280605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c00122240 0x7f7c001268d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:49.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.413+0000 7f7bf6ffd700 1 -- 172.21.15.103:0/3561280605 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 404636446 0 0) 0x7f7c001228b0 con 0x7f7c00113260 2020-04-22T14:19:49.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.413+0000 7f7bf6ffd700 1 -- 172.21.15.103:0/3561280605 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7be8003230 con 0x7f7c00113260 2020-04-22T14:19:49.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.413+0000 7f7bf6ffd700 1 -- 172.21.15.103:0/3561280605 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3119164329 0 0) 0x7f7c00113700 con 0x7f7c000b84c0 2020-04-22T14:19:49.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.413+0000 7f7bf6ffd700 1 -- 172.21.15.103:0/3561280605 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c001228b0 con 0x7f7c000b84c0 2020-04-22T14:19:49.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.413+0000 7f7bf6ffd700 1 -- 172.21.15.103:0/3561280605 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2458650700 0 0) 0x7f7be8003230 con 0x7f7c00113260 2020-04-22T14:19:49.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.413+0000 7f7c061af700 1 -- 172.21.15.103:0/3561280605 >> v1:172.21.15.103:6789/0 conn(0x7f7c00113260 legacy=0x7f7c00122ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:49.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.413+0000 7f7c061af700 1 -- 172.21.15.103:0/3561280605 >> v1:172.21.15.86:6789/0 conn(0x7f7c000b84c0 legacy=0x7f7c001116d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:49.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.413+0000 7f7c061af700 1 -- 172.21.15.103:0/3561280605 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c00122b50 con 0x7f7c00122240 2020-04-22T14:19:49.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.413+0000 7f7c061af700 1 --2- 172.21.15.103:0/3561280605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c00122240 0x7f7c001268d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7bf0002f30 tx=0x7f7c000680c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.413+0000 7f7c061af700 1 --2- 172.21.15.103:0/3561280605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c00122240 0x7f7c001268d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7bf0002f30 tx=0x7f7c000680c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.413+0000 7f7c061af700 1 --2- 172.21.15.103:0/3561280605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c00122240 0x7f7c001268d0 secure :-1 s=READY pgs=190 cs=0 l=1 rx=0x7f7bf0002f30 tx=0x7f7c000680c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:49.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.413+0000 7f7c061af700 1 --2- 172.21.15.103:0/3561280605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c00122240 0x7f7c001268d0 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7f7bf0002f30 tx=0x7f7c000680c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.413+0000 7f7bf6ffd700 1 -- 172.21.15.103:0/3561280605 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bf0001490 con 0x7f7c00122240 2020-04-22T14:19:49.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.413+0000 7f7c061af700 1 --2- 172.21.15.103:0/3561280605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c00122240 0x7f7c001268d0 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7f7bf0002f30 tx=0x7f7c000680c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.413+0000 7f7c07c12700 1 -- 172.21.15.103:0/3561280605 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c00123700 con 0x7f7c00122240 2020-04-22T14:19:49.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.413+0000 7f7bf6ffd700 1 -- 172.21.15.103:0/3561280605 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bfc00cd70 con 0x7f7c00122240 2020-04-22T14:19:49.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.413+0000 7f7c061af700 1 --2- 172.21.15.103:0/3561280605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c00122240 0x7f7c001268d0 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7f7bf0002f30 tx=0x7f7c000680c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.413+0000 7f7bf6ffd700 1 -- 172.21.15.103:0/3561280605 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bfc011bc0 con 0x7f7c00122240 2020-04-22T14:19:49.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.413+0000 7f7c07c12700 1 -- 172.21.15.103:0/3561280605 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c00111de0 con 0x7f7c00122240 2020-04-22T14:19:49.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.414+0000 7f7c061af700 1 --2- 172.21.15.103:0/3561280605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c00122240 0x7f7c001268d0 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7f7bf0002f30 tx=0x7f7c000680c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.415+0000 7f7bf6ffd700 1 -- 172.21.15.103:0/3561280605 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f7bfc004930 con 0x7f7c00122240 2020-04-22T14:19:49.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.415+0000 7f7c061af700 1 --2- 172.21.15.103:0/3561280605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c00122240 0x7f7c001268d0 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7f7bf0002f30 tx=0x7f7c000680c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.415+0000 7f7c07c12700 1 -- 172.21.15.103:0/3561280605 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c00122ce0 con 0x7f7c00122240 2020-04-22T14:19:49.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.415+0000 7f7bf6ffd700 1 --2- 172.21.15.103:0/3561280605 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7be804ddb0 0x7f7be8050270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:49.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.415+0000 7f7bf6ffd700 1 -- 172.21.15.103:0/3561280605 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7bfc0652a0 con 0x7f7c00122240 2020-04-22T14:19:49.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.415+0000 7f7c059ae700 1 --2- 172.21.15.103:0/3561280605 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7be804ddb0 0x7f7be8050270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:49.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.415+0000 7f7c059ae700 1 --2- 172.21.15.103:0/3561280605 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7be804ddb0 0x7f7be8050270 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7bf0008220 tx=0x7f7c0005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.415+0000 7f7c059ae700 1 --2- 172.21.15.103:0/3561280605 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7be804ddb0 0x7f7be8050270 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7bf0008220 tx=0x7f7c0005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.415+0000 7f7c059ae700 1 --2- 172.21.15.103:0/3561280605 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7be804ddb0 0x7f7be8050270 secure :-1 s=READY pgs=748 cs=0 l=1 rx=0x7f7bf0008220 tx=0x7f7c0005a720).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:49.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.419+0000 7f7c061af700 1 --2- 172.21.15.103:0/3561280605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c00122240 0x7f7c001268d0 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7f7bf0002f30 tx=0x7f7c000680c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.435 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.419+0000 7f7bf6ffd700 1 -- 172.21.15.103:0/3561280605 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f7bfc040620 con 0x7f7c00122240 2020-04-22T14:19:49.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.609+0000 7f7c07c12700 1 -- 172.21.15.103:0/3561280605 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f7c00056c90 con 0x7f7c00122240 2020-04-22T14:19:49.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.615+0000 7f7c061af700 1 --2- 172.21.15.103:0/3561280605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c00122240 0x7f7c001268d0 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7f7bf0002f30 tx=0x7f7c000680c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.615+0000 7f7bf6ffd700 1 -- 172.21.15.103:0/3561280605 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v54) v1 ==== 184+0+0 (secure 0 0 0) 0x7f7bfc043c40 con 0x7f7c00122240 2020-04-22T14:19:49.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.617+0000 7f7c07c12700 1 -- 172.21.15.103:0/3561280605 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7be804ddb0 msgr2=0x7f7be8050270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:49.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.617+0000 7f7c07c12700 1 --2- 172.21.15.103:0/3561280605 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7be804ddb0 0x7f7be8050270 secure :-1 s=READY pgs=748 cs=0 l=1 rx=0x7f7bf0008220 tx=0x7f7c0005a720).stop 2020-04-22T14:19:49.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.617+0000 7f7c07c12700 1 -- 172.21.15.103:0/3561280605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c00122240 msgr2=0x7f7c001268d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:49.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.617+0000 7f7c07c12700 1 --2- 172.21.15.103:0/3561280605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c00122240 0x7f7c001268d0 secure :-1 s=READY pgs=190 cs=0 l=1 rx=0x7f7bf0002f30 tx=0x7f7c000680c0).stop 2020-04-22T14:19:49.621 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.617+0000 7f7c07c12700 1 -- 172.21.15.103:0/3561280605 shutdown_connections 2020-04-22T14:19:49.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.617+0000 7f7c07c12700 1 --2- 172.21.15.103:0/3561280605 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7be804ddb0 0x7f7be8050270 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:49.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.617+0000 7f7c07c12700 1 --2- 172.21.15.103:0/3561280605 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c00122240 0x7f7c001268d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:49.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.617+0000 7f7c07c12700 1 -- 172.21.15.103:0/3561280605 >> 172.21.15.103:0/3561280605 conn(0x7f7c0005ad30 msgr2=0x7f7c000b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:49.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.617+0000 7f7c07c12700 1 -- 172.21.15.103:0/3561280605 shutdown_connections 2020-04-22T14:19:49.622 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.617+0000 7f7c07c12700 1 -- 172.21.15.103:0/3561280605 wait complete. 2020-04-22T14:19:49.622 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.1 2020-04-22T14:19:49.630 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:49.644 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:19:49.803 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.796+0000 7fd517414700 1 Processor -- start 2020-04-22T14:19:49.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.796+0000 7fd517414700 1 -- start start 2020-04-22T14:19:49.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.797+0000 7fd517414700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd510152a90 0x7fd5100b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:49.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.797+0000 7fd517414700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd510152e70 con 0x7fd5100adf50 2020-04-22T14:19:49.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.797+0000 7fd517414700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5100614f0 con 0x7fd510062170 2020-04-22T14:19:49.804 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.797+0000 7fd517414700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd510061790 con 0x7fd510152a90 2020-04-22T14:19:49.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.797+0000 7fd5151b0700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd510062170 0x7fd5100b4db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50608/0 (socket says 172.21.15.103:50608) 2020-04-22T14:19:49.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.797+0000 7fd5151b0700 1 -- 172.21.15.103:0/3099158436 learned_addr learned my addr 172.21.15.103:0/3099158436 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:49.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.797+0000 7fd5159b1700 1 --2- 172.21.15.103:0/3099158436 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd510152a90 0x7fd5100b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:49.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.797+0000 7fd5149af700 1 -- 172.21.15.103:0/3099158436 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 594585237 0 0) 0x7fd5100614f0 con 0x7fd510062170 2020-04-22T14:19:49.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.797+0000 7fd5149af700 1 -- 172.21.15.103:0/3099158436 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4fc003230 con 0x7fd510062170 2020-04-22T14:19:49.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.798+0000 7fd5149af700 1 -- 172.21.15.103:0/3099158436 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2120303995 0 0) 0x7fd4fc003230 con 0x7fd510062170 2020-04-22T14:19:49.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.798+0000 7fd5149af700 1 -- 172.21.15.103:0/3099158436 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd510152a90 msgr2=0x7fd5100b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:49.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.798+0000 7fd5149af700 1 --2- 172.21.15.103:0/3099158436 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd510152a90 0x7fd5100b44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:49.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.798+0000 7fd5149af700 1 -- 172.21.15.103:0/3099158436 >> v1:172.21.15.86:6789/0 conn(0x7fd5100adf50 legacy=0x7fd5100ae3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:49.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.798+0000 7fd5149af700 1 -- 172.21.15.103:0/3099158436 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd510061a30 con 0x7fd510062170 2020-04-22T14:19:49.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.798+0000 7fd5149af700 1 -- 172.21.15.103:0/3099158436 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fd500001850 con 0x7fd510062170 2020-04-22T14:19:49.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.798+0000 7fd5149af700 1 -- 172.21.15.103:0/3099158436 >> v1:172.21.15.103:6789/0 conn(0x7fd510062170 legacy=0x7fd5100b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:49.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.798+0000 7fd5149af700 1 --2- 172.21.15.103:0/3099158436 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd510152a90 0x7fd4fc003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:49.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.798+0000 7fd5149af700 1 --2- 172.21.15.103:0/3099158436 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4fc003b80 0x7fd4fc003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:49.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.798+0000 7fd5149af700 1 --2- 172.21.15.103:0/3099158436 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4fc004570 0x7fd4fc0049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:49.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.798+0000 7fd5149af700 1 -- 172.21.15.103:0/3099158436 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd510061790 con 0x7fd4fc003b80 2020-04-22T14:19:49.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.798+0000 7fd5149af700 1 -- 172.21.15.103:0/3099158436 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc004f80 con 0x7fd4fc004570 2020-04-22T14:19:49.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.798+0000 7fd5149af700 1 -- 172.21.15.103:0/3099158436 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc005140 con 0x7fd510152a90 2020-04-22T14:19:49.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.798+0000 7fd5161b2700 1 --2- 172.21.15.103:0/3099158436 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4fc004570 0x7fd4fc0049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:49.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.798+0000 7fd5151b0700 1 --2- 172.21.15.103:0/3099158436 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4fc003b80 0x7fd4fc003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:49.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.798+0000 7fd5159b1700 1 --2- 172.21.15.103:0/3099158436 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd510152a90 0x7fd4fc003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:49.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.798+0000 7fd5161b2700 1 -- 172.21.15.103:0/3099158436 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd510152a90 msgr2=0x7fd4fc003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:49.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.798+0000 7fd5161b2700 1 --2- 172.21.15.103:0/3099158436 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd510152a90 0x7fd4fc003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:49.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.798+0000 7fd5161b2700 1 -- 172.21.15.103:0/3099158436 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4fc003b80 msgr2=0x7fd4fc003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:49.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.798+0000 7fd5161b2700 1 --2- 172.21.15.103:0/3099158436 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4fc003b80 0x7fd4fc003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:49.808 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.798+0000 7fd5161b2700 1 -- 172.21.15.103:0/3099158436 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4fc003230 con 0x7fd4fc004570 2020-04-22T14:19:49.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.798+0000 7fd5151b0700 1 --2- 172.21.15.103:0/3099158436 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4fc003b80 0x7fd4fc003fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:19:49.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.798+0000 7fd5161b2700 1 --2- 172.21.15.103:0/3099158436 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4fc004570 0x7fd4fc0049d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd508001360 tx=0x7fd508010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.798+0000 7fd5161b2700 1 --2- 172.21.15.103:0/3099158436 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4fc004570 0x7fd4fc0049d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd508001360 tx=0x7fd508010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.798+0000 7fd5161b2700 1 --2- 172.21.15.103:0/3099158436 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4fc004570 0x7fd4fc0049d0 secure :-1 s=READY pgs=2059 cs=0 l=1 rx=0x7fd508001360 tx=0x7fd508010160).ready entity=mon.1 client_cookie=6e4a5781ec468af4 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:49.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.798+0000 7fd5161b2700 1 --2- 172.21.15.103:0/3099158436 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4fc004570 0x7fd4fc0049d0 secure :-1 s=THROTTLE_DONE pgs=2059 cs=0 l=1 rx=0x7fd508001360 tx=0x7fd508010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.798+0000 7fd5149af700 1 -- 172.21.15.103:0/3099158436 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd508006c40 con 0x7fd4fc004570 2020-04-22T14:19:49.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.798+0000 7fd5161b2700 1 --2- 172.21.15.103:0/3099158436 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4fc004570 0x7fd4fc0049d0 secure :-1 s=THROTTLE_DONE pgs=2059 cs=0 l=1 rx=0x7fd508001360 tx=0x7fd508010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.798+0000 7fd5161b2700 1 --2- 172.21.15.103:0/3099158436 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4fc004570 0x7fd4fc0049d0 secure :-1 s=THROTTLE_DONE pgs=2059 cs=0 l=1 rx=0x7fd508001360 tx=0x7fd508010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.798+0000 7fd5149af700 1 -- 172.21.15.103:0/3099158436 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd508006da0 con 0x7fd4fc004570 2020-04-22T14:19:49.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.798+0000 7fd5149af700 1 -- 172.21.15.103:0/3099158436 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd508002730 con 0x7fd4fc004570 2020-04-22T14:19:49.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.798+0000 7fd517414700 1 -- 172.21.15.103:0/3099158436 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4fc004570 msgr2=0x7fd4fc0049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:49.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.798+0000 7fd517414700 1 --2- 172.21.15.103:0/3099158436 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4fc004570 0x7fd4fc0049d0 secure :-1 s=READY pgs=2059 cs=0 l=1 rx=0x7fd508001360 tx=0x7fd508010160).stop 2020-04-22T14:19:49.811 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.798+0000 7fd5161b2700 1 -- 172.21.15.103:0/3099158436 reap_dead start 2020-04-22T14:19:49.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.799+0000 7fd517414700 1 -- 172.21.15.103:0/3099158436 shutdown_connections 2020-04-22T14:19:49.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.799+0000 7fd517414700 1 -- 172.21.15.103:0/3099158436 >> 172.21.15.103:0/3099158436 conn(0x7fd51005ad30 msgr2=0x7fd51005b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:49.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.799+0000 7fd517414700 1 -- 172.21.15.103:0/3099158436 shutdown_connections 2020-04-22T14:19:49.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.799+0000 7fd517414700 1 -- 172.21.15.103:0/3099158436 wait complete. 2020-04-22T14:19:49.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.800+0000 7fd517414700 1 Processor -- start 2020-04-22T14:19:49.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.800+0000 7fd517414700 1 -- start start 2020-04-22T14:19:49.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.801+0000 7fd517414700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd5100b7100 0x7fd510062f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:49.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.801+0000 7fd517414700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd510120b00 0x7fd510120f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:49.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.801+0000 7fd517414700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd510112b90 con 0x7fd510066060 2020-04-22T14:19:49.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.801+0000 7fd517414700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5101213f0 con 0x7fd5100b7100 2020-04-22T14:19:49.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.801+0000 7fd517414700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd510112e30 con 0x7fd510120b00 2020-04-22T14:19:49.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.801+0000 7fd5161b2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd510120b00 0x7fd510120f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:49.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.801+0000 7fd5161b2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd510120b00 0x7fd510120f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58432/0 (socket says 172.21.15.103:58432) 2020-04-22T14:19:49.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.801+0000 7fd5161b2700 1 -- 172.21.15.103:0/256130598 learned_addr learned my addr 172.21.15.103:0/256130598 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:19:49.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.801+0000 7fd5159b1700 1 --2- 172.21.15.103:0/256130598 >> v2:172.21.15.86:3300/0 conn(0x7fd5100b7100 0x7fd510062f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:49.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.801+0000 7fd5161b2700 1 -- 172.21.15.103:0/256130598 >> v2:172.21.15.86:3300/0 conn(0x7fd5100b7100 msgr2=0x7fd510062f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:49.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.801+0000 7fd5161b2700 1 --2- 172.21.15.103:0/256130598 >> v2:172.21.15.86:3300/0 conn(0x7fd5100b7100 0x7fd510062f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:49.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.801+0000 7fd5161b2700 1 -- 172.21.15.103:0/256130598 >> v1:172.21.15.86:6789/0 conn(0x7fd510066060 legacy=0x7fd510113570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:49.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.801+0000 7fd5161b2700 1 -- 172.21.15.103:0/256130598 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5101130d0 con 0x7fd510120b00 2020-04-22T14:19:49.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.801+0000 7fd5161b2700 1 --2- 172.21.15.103:0/256130598 >> v2:172.21.15.103:3300/0 conn(0x7fd510120b00 0x7fd510120f90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd5100b8440 tx=0x7fd508010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.801+0000 7fd5161b2700 1 --2- 172.21.15.103:0/256130598 >> v2:172.21.15.103:3300/0 conn(0x7fd510120b00 0x7fd510120f90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd5100b8440 tx=0x7fd508010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.801+0000 7fd5161b2700 1 --2- 172.21.15.103:0/256130598 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd510120b00 0x7fd510120f90 secure :-1 s=READY pgs=2060 cs=0 l=1 rx=0x7fd5100b8440 tx=0x7fd508010160).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:49.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.801+0000 7fd5161b2700 1 --2- 172.21.15.103:0/256130598 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd510120b00 0x7fd510120f90 secure :-1 s=THROTTLE_DONE pgs=2060 cs=0 l=1 rx=0x7fd5100b8440 tx=0x7fd508010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.801+0000 7fd5067fc700 1 -- 172.21.15.103:0/256130598 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd508001940 con 0x7fd510120b00 2020-04-22T14:19:49.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.801+0000 7fd5161b2700 1 --2- 172.21.15.103:0/256130598 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd510120b00 0x7fd510120f90 secure :-1 s=THROTTLE_DONE pgs=2060 cs=0 l=1 rx=0x7fd5100b8440 tx=0x7fd508010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.801+0000 7fd5161b2700 1 --2- 172.21.15.103:0/256130598 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd510120b00 0x7fd510120f90 secure :-1 s=THROTTLE_DONE pgs=2060 cs=0 l=1 rx=0x7fd5100b8440 tx=0x7fd508010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.801+0000 7fd5067fc700 1 -- 172.21.15.103:0/256130598 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5080112c0 con 0x7fd510120b00 2020-04-22T14:19:49.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.801+0000 7fd517414700 1 -- 172.21.15.103:0/256130598 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5100b74e0 con 0x7fd510120b00 2020-04-22T14:19:49.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.801+0000 7fd5067fc700 1 -- 172.21.15.103:0/256130598 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd508011620 con 0x7fd510120b00 2020-04-22T14:19:49.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.802+0000 7fd517414700 1 -- 172.21.15.103:0/256130598 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd510063370 con 0x7fd510120b00 2020-04-22T14:19:49.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.802+0000 7fd5161b2700 1 --2- 172.21.15.103:0/256130598 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd510120b00 0x7fd510120f90 secure :-1 s=THROTTLE_DONE pgs=2060 cs=0 l=1 rx=0x7fd5100b8440 tx=0x7fd508010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.802+0000 7fd5067fc700 1 -- 172.21.15.103:0/256130598 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fd508010690 con 0x7fd510120b00 2020-04-22T14:19:49.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.802+0000 7fd5161b2700 1 --2- 172.21.15.103:0/256130598 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd510120b00 0x7fd510120f90 secure :-1 s=THROTTLE_DONE pgs=2060 cs=0 l=1 rx=0x7fd5100b8440 tx=0x7fd508010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.803+0000 7fd517414700 1 -- 172.21.15.103:0/256130598 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5100635f0 con 0x7fd510120b00 2020-04-22T14:19:49.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.803+0000 7fd5067fc700 1 --2- 172.21.15.103:0/256130598 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd4f804d980 0x7fd4f804fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:49.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.803+0000 7fd5067fc700 1 -- 172.21.15.103:0/256130598 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd50800b0b0 con 0x7fd510120b00 2020-04-22T14:19:49.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.803+0000 7fd5159b1700 1 --2- 172.21.15.103:0/256130598 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd4f804d980 0x7fd4f804fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:49.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.803+0000 7fd5159b1700 1 --2- 172.21.15.103:0/256130598 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd4f804d980 0x7fd4f804fe40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd50c002f30 tx=0x7fd50c00ca90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.803+0000 7fd5159b1700 1 --2- 172.21.15.103:0/256130598 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd4f804d980 0x7fd4f804fe40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd50c002f30 tx=0x7fd50c00ca90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.803+0000 7fd5159b1700 1 --2- 172.21.15.103:0/256130598 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd4f804d980 0x7fd4f804fe40 secure :-1 s=READY pgs=749 cs=0 l=1 rx=0x7fd50c002f30 tx=0x7fd50c00ca90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:49.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.807+0000 7fd5161b2700 1 --2- 172.21.15.103:0/256130598 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd510120b00 0x7fd510120f90 secure :-1 s=THROTTLE_DONE pgs=2060 cs=0 l=1 rx=0x7fd5100b8440 tx=0x7fd508010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:49.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.807+0000 7fd5067fc700 1 -- 172.21.15.103:0/256130598 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fd5100635f0 con 0x7fd510120b00 2020-04-22T14:19:50.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:49.997+0000 7fd517414700 1 -- 172.21.15.103:0/256130598 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fd5100635f0 con 0x7fd510120b00 2020-04-22T14:19:50.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.001+0000 7fd5161b2700 1 --2- 172.21.15.103:0/256130598 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd510120b00 0x7fd510120f90 secure :-1 s=THROTTLE_DONE pgs=2060 cs=0 l=1 rx=0x7fd5100b8440 tx=0x7fd508010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:50.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.001+0000 7fd5067fc700 1 -- 172.21.15.103:0/256130598 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v55) v1 ==== 184+0+0 (secure 0 0 0) 0x7fd5100635f0 con 0x7fd510120b00 2020-04-22T14:19:50.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.003+0000 7fd517414700 1 -- 172.21.15.103:0/256130598 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd4f804d980 msgr2=0x7fd4f804fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:50.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.003+0000 7fd517414700 1 --2- 172.21.15.103:0/256130598 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd4f804d980 0x7fd4f804fe40 secure :-1 s=READY pgs=749 cs=0 l=1 rx=0x7fd50c002f30 tx=0x7fd50c00ca90).stop 2020-04-22T14:19:50.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.003+0000 7fd517414700 1 -- 172.21.15.103:0/256130598 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd510120b00 msgr2=0x7fd510120f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:50.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.003+0000 7fd517414700 1 --2- 172.21.15.103:0/256130598 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd510120b00 0x7fd510120f90 secure :-1 s=READY pgs=2060 cs=0 l=1 rx=0x7fd5100b8440 tx=0x7fd508010160).stop 2020-04-22T14:19:50.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.003+0000 7fd517414700 1 -- 172.21.15.103:0/256130598 shutdown_connections 2020-04-22T14:19:50.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.003+0000 7fd517414700 1 --2- 172.21.15.103:0/256130598 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd510120b00 0x7fd510120f90 unknown :-1 s=CLOSED pgs=2060 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:50.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.003+0000 7fd517414700 1 --2- 172.21.15.103:0/256130598 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd4f804d980 0x7fd4f804fe40 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:50.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.003+0000 7fd517414700 1 --2- 172.21.15.103:0/256130598 >> v2:172.21.15.86:3300/0 conn(0x7fd5100b7100 0x7fd510062f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:50.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.003+0000 7fd517414700 1 -- 172.21.15.103:0/256130598 >> 172.21.15.103:0/256130598 conn(0x7fd51005ad30 msgr2=0x7fd510135700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:50.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.003+0000 7fd517414700 1 -- 172.21.15.103:0/256130598 shutdown_connections 2020-04-22T14:19:50.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.003+0000 7fd517414700 1 -- 172.21.15.103:0/256130598 wait complete. 2020-04-22T14:19:50.009 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.2 2020-04-22T14:19:50.017 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:50.031 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:19:50.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.180+0000 7f8bc5fde700 1 Processor -- start 2020-04-22T14:19:50.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.180+0000 7f8bc5fde700 1 -- start start 2020-04-22T14:19:50.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.181+0000 7f8bc5fde700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8bc00633c0 0x7f8bc00b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:50.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.181+0000 7f8bc5fde700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8bc00b6350 0x7f8bc00b6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:50.188 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.181+0000 7f8bc5fde700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bc0025b90 con 0x7f8bc00666e0 2020-04-22T14:19:50.188 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.181+0000 7f8bc5fde700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bc0066ac0 con 0x7f8bc00633c0 2020-04-22T14:19:50.188 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.181+0000 7f8bc5fde700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bc0024ea0 con 0x7f8bc00b6350 2020-04-22T14:19:50.188 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.181+0000 7f8bc7240700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8bc00b6350 0x7f8bc00b6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:50.188 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.181+0000 7f8bc57dd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f8bc00666e0 0x7f8bc00b9880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50626/0 (socket says 172.21.15.103:50626) 2020-04-22T14:19:50.188 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.181+0000 7f8bc57dd700 1 -- 172.21.15.103:0/36957588 learned_addr learned my addr 172.21.15.103:0/36957588 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:50.189 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.181+0000 7f8bc4fdc700 1 --2- 172.21.15.103:0/36957588 >> v2:172.21.15.86:3300/0 conn(0x7f8bc00633c0 0x7f8bc00b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:50.189 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.181+0000 7f8bc7240700 1 -- 172.21.15.103:0/36957588 >> v2:172.21.15.86:3300/0 conn(0x7f8bc00633c0 msgr2=0x7f8bc00b5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:50.189 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.181+0000 7f8bc7240700 1 --2- 172.21.15.103:0/36957588 >> v2:172.21.15.86:3300/0 conn(0x7f8bc00633c0 0x7f8bc00b5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:50.189 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.181+0000 7f8bc7240700 1 -- 172.21.15.103:0/36957588 >> v1:172.21.15.103:6789/0 conn(0x7f8bc00666e0 legacy=0x7f8bc00b9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:50.189 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.181+0000 7f8bc7240700 1 -- 172.21.15.103:0/36957588 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc0155ff0 con 0x7f8bc00b6350 2020-04-22T14:19:50.189 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.181+0000 7f8bb7fff700 1 -- 172.21.15.103:0/36957588 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 64648165 0 0) 0x7f8bc0025b90 con 0x7f8bc00666e0 2020-04-22T14:19:50.189 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.181+0000 7f8bc4fdc700 1 --2- 172.21.15.103:0/36957588 >> v2:172.21.15.86:3300/0 conn(0x7f8bc00633c0 0x7f8bc00b5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:19:50.190 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.181+0000 7f8bc7240700 1 --2- 172.21.15.103:0/36957588 >> v2:172.21.15.103:3300/0 conn(0x7f8bc00b6350 0x7f8bc00b6770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8bb80032b0 tx=0x7f8bb8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:50.190 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.181+0000 7f8bc7240700 1 --2- 172.21.15.103:0/36957588 >> v2:172.21.15.103:3300/0 conn(0x7f8bc00b6350 0x7f8bc00b6770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8bb80032b0 tx=0x7f8bb8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:50.190 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.181+0000 7f8bc7240700 1 --2- 172.21.15.103:0/36957588 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bc00b6350 0x7f8bc00b6770 secure :-1 s=READY pgs=2062 cs=0 l=1 rx=0x7f8bb80032b0 tx=0x7f8bb8007dc0).ready entity=mon.1 client_cookie=4a6c9ef618bf280c server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:50.190 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.181+0000 7f8bc7240700 1 --2- 172.21.15.103:0/36957588 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bc00b6350 0x7f8bc00b6770 secure :-1 s=THROTTLE_DONE pgs=2062 cs=0 l=1 rx=0x7f8bb80032b0 tx=0x7f8bb8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:50.190 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.181+0000 7f8bb7fff700 1 -- 172.21.15.103:0/36957588 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8bb800a180 con 0x7f8bc00b6350 2020-04-22T14:19:50.190 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.181+0000 7f8bc7240700 1 --2- 172.21.15.103:0/36957588 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bc00b6350 0x7f8bc00b6770 secure :-1 s=THROTTLE_DONE pgs=2062 cs=0 l=1 rx=0x7f8bb80032b0 tx=0x7f8bb8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:50.190 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.181+0000 7f8bb7fff700 1 -- 172.21.15.103:0/36957588 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb800a2e0 con 0x7f8bc00b6350 2020-04-22T14:19:50.191 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.181+0000 7f8bc7240700 1 --2- 172.21.15.103:0/36957588 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bc00b6350 0x7f8bc00b6770 secure :-1 s=THROTTLE_DONE pgs=2062 cs=0 l=1 rx=0x7f8bb80032b0 tx=0x7f8bb8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:50.191 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.181+0000 7f8bb7fff700 1 -- 172.21.15.103:0/36957588 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8bb800a6c0 con 0x7f8bc00b6350 2020-04-22T14:19:50.191 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.181+0000 7f8bc5fde700 1 -- 172.21.15.103:0/36957588 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bc00b6350 msgr2=0x7f8bc00b6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:50.191 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.181+0000 7f8bc5fde700 1 --2- 172.21.15.103:0/36957588 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bc00b6350 0x7f8bc00b6770 secure :-1 s=READY pgs=2062 cs=0 l=1 rx=0x7f8bb80032b0 tx=0x7f8bb8007dc0).stop 2020-04-22T14:19:50.191 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.182+0000 7f8bc5fde700 1 -- 172.21.15.103:0/36957588 shutdown_connections 2020-04-22T14:19:50.191 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.182+0000 7f8bc5fde700 1 --2- 172.21.15.103:0/36957588 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bc00b6350 0x7f8bc00b6770 unknown :-1 s=CLOSED pgs=2062 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:50.191 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.182+0000 7f8bc5fde700 1 --2- 172.21.15.103:0/36957588 >> v2:172.21.15.86:3300/0 conn(0x7f8bc00633c0 0x7f8bc00b5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:50.192 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.182+0000 7f8bc5fde700 1 -- 172.21.15.103:0/36957588 >> 172.21.15.103:0/36957588 conn(0x7f8bc0060930 msgr2=0x7f8bc0060d40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:50.192 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.182+0000 7f8bc5fde700 1 -- 172.21.15.103:0/36957588 shutdown_connections 2020-04-22T14:19:50.192 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.182+0000 7f8bc5fde700 1 -- 172.21.15.103:0/36957588 wait complete. 2020-04-22T14:19:50.192 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.183+0000 7f8bc5fde700 1 Processor -- start 2020-04-22T14:19:50.192 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.183+0000 7f8bc5fde700 1 -- start start 2020-04-22T14:19:50.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.184+0000 7f8bc5fde700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8bc00633c0 0x7f8bc005b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:50.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.184+0000 7f8bc5fde700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8bc00666e0 0x7f8bc00ac740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:50.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.184+0000 7f8bc5fde700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bc00acba0 con 0x7f8bc00b6350 2020-04-22T14:19:50.197 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.184+0000 7f8bc5fde700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bc00b8e90 con 0x7f8bc00633c0 2020-04-22T14:19:50.197 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.184+0000 7f8bc5fde700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bc00b9130 con 0x7f8bc00666e0 2020-04-22T14:19:50.197 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.184+0000 7f8bc4fdc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8bc00666e0 0x7f8bc00ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:50.197 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.184+0000 7f8bc7240700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f8bc00b6350 0x7f8bc00af810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50634/0 (socket says 172.21.15.103:50634) 2020-04-22T14:19:50.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.184+0000 7f8bc7240700 1 -- 172.21.15.103:0/3457055222 learned_addr learned my addr 172.21.15.103:0/3457055222 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:50.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.184+0000 7f8bc4fdc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8bc00666e0 0x7f8bc00ac740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58446/0 (socket says 172.21.15.103:58446) 2020-04-22T14:19:50.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.184+0000 7f8bc57dd700 1 --2- 172.21.15.103:0/3457055222 >> v2:172.21.15.86:3300/0 conn(0x7f8bc00633c0 0x7f8bc005b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:50.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.184+0000 7f8bc4fdc700 1 -- 172.21.15.103:0/3457055222 >> v2:172.21.15.86:3300/0 conn(0x7f8bc00633c0 msgr2=0x7f8bc005b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:50.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.184+0000 7f8bc4fdc700 1 --2- 172.21.15.103:0/3457055222 >> v2:172.21.15.86:3300/0 conn(0x7f8bc00633c0 0x7f8bc005b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:50.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.184+0000 7f8bc4fdc700 1 -- 172.21.15.103:0/3457055222 >> v1:172.21.15.103:6789/0 conn(0x7f8bc00b6350 legacy=0x7f8bc00af810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:50.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.184+0000 7f8bb5ffb700 1 -- 172.21.15.103:0/3457055222 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 286304897 0 0) 0x7f8bc00acba0 con 0x7f8bc00b6350 2020-04-22T14:19:50.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.184+0000 7f8bc4fdc700 1 -- 172.21.15.103:0/3457055222 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc00b8b80 con 0x7f8bc00666e0 2020-04-22T14:19:50.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.185+0000 7f8bc4fdc700 1 --2- 172.21.15.103:0/3457055222 >> v2:172.21.15.103:3300/0 conn(0x7f8bc00666e0 0x7f8bc00ac740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8bbc002f30 tx=0x7f8bbc010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:50.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.185+0000 7f8bc4fdc700 1 --2- 172.21.15.103:0/3457055222 >> v2:172.21.15.103:3300/0 conn(0x7f8bc00666e0 0x7f8bc00ac740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8bbc002f30 tx=0x7f8bbc010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:50.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.185+0000 7f8bc4fdc700 1 --2- 172.21.15.103:0/3457055222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bc00666e0 0x7f8bc00ac740 secure :-1 s=READY pgs=2064 cs=0 l=1 rx=0x7f8bbc002f30 tx=0x7f8bbc010af0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:50.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.185+0000 7f8bc4fdc700 1 --2- 172.21.15.103:0/3457055222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bc00666e0 0x7f8bc00ac740 secure :-1 s=THROTTLE_DONE pgs=2064 cs=0 l=1 rx=0x7f8bbc002f30 tx=0x7f8bbc010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:50.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.185+0000 7f8bb5ffb700 1 -- 172.21.15.103:0/3457055222 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8bbc0091c0 con 0x7f8bc00666e0 2020-04-22T14:19:50.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.185+0000 7f8bc4fdc700 1 --2- 172.21.15.103:0/3457055222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bc00666e0 0x7f8bc00ac740 secure :-1 s=THROTTLE_DONE pgs=2064 cs=0 l=1 rx=0x7f8bbc002f30 tx=0x7f8bbc010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:50.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.185+0000 7f8bc4fdc700 1 --2- 172.21.15.103:0/3457055222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bc00666e0 0x7f8bc00ac740 secure :-1 s=THROTTLE_DONE pgs=2064 cs=0 l=1 rx=0x7f8bbc002f30 tx=0x7f8bbc010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:50.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.185+0000 7f8bb5ffb700 1 -- 172.21.15.103:0/3457055222 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bbc009320 con 0x7f8bc00666e0 2020-04-22T14:19:50.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.185+0000 7f8bc5fde700 1 -- 172.21.15.103:0/3457055222 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bc00af300 con 0x7f8bc00666e0 2020-04-22T14:19:50.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.185+0000 7f8bb5ffb700 1 -- 172.21.15.103:0/3457055222 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8bbc0096c0 con 0x7f8bc00666e0 2020-04-22T14:19:50.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.185+0000 7f8bc5fde700 1 -- 172.21.15.103:0/3457055222 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bc0120420 con 0x7f8bc00666e0 2020-04-22T14:19:50.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.185+0000 7f8bc4fdc700 1 --2- 172.21.15.103:0/3457055222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bc00666e0 0x7f8bc00ac740 secure :-1 s=THROTTLE_DONE pgs=2064 cs=0 l=1 rx=0x7f8bbc002f30 tx=0x7f8bbc010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:50.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.186+0000 7f8bc5fde700 1 -- 172.21.15.103:0/3457055222 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bc0056c90 con 0x7f8bc00666e0 2020-04-22T14:19:50.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.186+0000 7f8bb5ffb700 1 -- 172.21.15.103:0/3457055222 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f8bbc0098c0 con 0x7f8bc00666e0 2020-04-22T14:19:50.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.186+0000 7f8bc4fdc700 1 --2- 172.21.15.103:0/3457055222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bc00666e0 0x7f8bc00ac740 secure :-1 s=THROTTLE_DONE pgs=2064 cs=0 l=1 rx=0x7f8bbc002f30 tx=0x7f8bbc010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:50.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.186+0000 7f8bb5ffb700 1 --2- 172.21.15.103:0/3457055222 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8ba004d840 0x7f8ba004fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:50.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.186+0000 7f8bb5ffb700 1 -- 172.21.15.103:0/3457055222 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8bbc061050 con 0x7f8bc00666e0 2020-04-22T14:19:50.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.186+0000 7f8bc57dd700 1 --2- 172.21.15.103:0/3457055222 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8ba004d840 0x7f8ba004fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:50.201 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.186+0000 7f8bc57dd700 1 --2- 172.21.15.103:0/3457055222 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8ba004d840 0x7f8ba004fd00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8bb0000b80 tx=0x7f8bb0001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:50.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.187+0000 7f8bc57dd700 1 --2- 172.21.15.103:0/3457055222 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8ba004d840 0x7f8ba004fd00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8bb0000b80 tx=0x7f8bb0001710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:50.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.187+0000 7f8bc57dd700 1 --2- 172.21.15.103:0/3457055222 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8ba004d840 0x7f8ba004fd00 secure :-1 s=READY pgs=750 cs=0 l=1 rx=0x7f8bb0000b80 tx=0x7f8bb0001710).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:50.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.190+0000 7f8bc4fdc700 1 --2- 172.21.15.103:0/3457055222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bc00666e0 0x7f8bc00ac740 secure :-1 s=THROTTLE_DONE pgs=2064 cs=0 l=1 rx=0x7f8bbc002f30 tx=0x7f8bbc010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:50.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.190+0000 7f8bb5ffb700 1 -- 172.21.15.103:0/3457055222 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f8bbc03c490 con 0x7f8bc00666e0 2020-04-22T14:19:50.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.383+0000 7f8bc5fde700 1 -- 172.21.15.103:0/3457055222 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f8bc00af490 con 0x7f8bc00666e0 2020-04-22T14:19:50.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.387+0000 7f8bc4fdc700 1 --2- 172.21.15.103:0/3457055222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bc00666e0 0x7f8bc00ac740 secure :-1 s=THROTTLE_DONE pgs=2064 cs=0 l=1 rx=0x7f8bbc002f30 tx=0x7f8bbc010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:50.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.387+0000 7f8bb5ffb700 1 -- 172.21.15.103:0/3457055222 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v56) v1 ==== 184+0+0 (secure 0 0 0) 0x7f8bbc03fab0 con 0x7f8bc00666e0 2020-04-22T14:19:50.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.388+0000 7f8bc5fde700 1 -- 172.21.15.103:0/3457055222 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8ba004d840 msgr2=0x7f8ba004fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:50.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.388+0000 7f8bc5fde700 1 --2- 172.21.15.103:0/3457055222 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8ba004d840 0x7f8ba004fd00 secure :-1 s=READY pgs=750 cs=0 l=1 rx=0x7f8bb0000b80 tx=0x7f8bb0001710).stop 2020-04-22T14:19:50.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.388+0000 7f8bc5fde700 1 -- 172.21.15.103:0/3457055222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bc00666e0 msgr2=0x7f8bc00ac740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:50.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.388+0000 7f8bc5fde700 1 --2- 172.21.15.103:0/3457055222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bc00666e0 0x7f8bc00ac740 secure :-1 s=READY pgs=2064 cs=0 l=1 rx=0x7f8bbc002f30 tx=0x7f8bbc010af0).stop 2020-04-22T14:19:50.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.388+0000 7f8bc5fde700 1 -- 172.21.15.103:0/3457055222 shutdown_connections 2020-04-22T14:19:50.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.388+0000 7f8bc5fde700 1 --2- 172.21.15.103:0/3457055222 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8ba004d840 0x7f8ba004fd00 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:50.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.388+0000 7f8bc5fde700 1 --2- 172.21.15.103:0/3457055222 >> v2:172.21.15.86:3300/0 conn(0x7f8bc00633c0 0x7f8bc005b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:50.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.388+0000 7f8bc5fde700 1 --2- 172.21.15.103:0/3457055222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bc00666e0 0x7f8bc00ac740 unknown :-1 s=CLOSED pgs=2064 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:50.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.388+0000 7f8bc5fde700 1 -- 172.21.15.103:0/3457055222 >> 172.21.15.103:0/3457055222 conn(0x7f8bc0060930 msgr2=0x7f8bc00b9940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:50.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.389+0000 7f8bc5fde700 1 -- 172.21.15.103:0/3457055222 shutdown_connections 2020-04-22T14:19:50.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.389+0000 7f8bc5fde700 1 -- 172.21.15.103:0/3457055222 wait complete. 2020-04-22T14:19:50.394 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.3 2020-04-22T14:19:50.402 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:50.416 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:19:50.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.558+0000 7f67cedf2700 1 Processor -- start 2020-04-22T14:19:50.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.558+0000 7f67cedf2700 1 -- start start 2020-04-22T14:19:50.569 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.559+0000 7f67cedf2700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f67c805b7c0 0x7f67c80b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:50.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.559+0000 7f67cedf2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f67c81441f0 0x7f67c8144820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:50.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.559+0000 7f67cedf2700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67c80ae860 con 0x7f67c8144c80 2020-04-22T14:19:50.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.559+0000 7f67cedf2700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67c80b5900 con 0x7f67c81441f0 2020-04-22T14:19:50.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.559+0000 7f67cedf2700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c80b5ba0 con 0x7f67c805b7c0 2020-04-22T14:19:50.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.559+0000 7f67c7fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f67c81441f0 0x7f67c8144820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:50.570 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.559+0000 7f67c7fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f67c81441f0 0x7f67c8144820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58450/0 (socket says 172.21.15.103:58450) 2020-04-22T14:19:50.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.559+0000 7f67c7fff700 1 -- 172.21.15.103:0/1453494770 learned_addr learned my addr 172.21.15.103:0/1453494770 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:19:50.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.559+0000 7f67ccb8e700 1 --2- 172.21.15.103:0/1453494770 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f67c805b7c0 0x7f67c80b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:50.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.560+0000 7f67c7fff700 1 -- 172.21.15.103:0/1453494770 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f67c805b7c0 msgr2=0x7f67c80b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:50.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.560+0000 7f67c7fff700 1 --2- 172.21.15.103:0/1453494770 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f67c805b7c0 0x7f67c80b50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:50.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.560+0000 7f67c7fff700 1 -- 172.21.15.103:0/1453494770 >> v1:172.21.15.86:6789/0 conn(0x7f67c8144c80 legacy=0x7f67c8147670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:50.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.560+0000 7f67c7fff700 1 -- 172.21.15.103:0/1453494770 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c80b5e40 con 0x7f67c81441f0 2020-04-22T14:19:50.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.560+0000 7f67ccb8e700 1 --2- 172.21.15.103:0/1453494770 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f67c805b7c0 0x7f67c80b50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:19:50.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.560+0000 7f67c7fff700 1 --2- 172.21.15.103:0/1453494770 >> v2:172.21.15.103:3300/0 conn(0x7f67c81441f0 0x7f67c8144820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f67c80613e0 tx=0x7f67bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:50.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.560+0000 7f67c7fff700 1 --2- 172.21.15.103:0/1453494770 >> v2:172.21.15.103:3300/0 conn(0x7f67c81441f0 0x7f67c8144820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f67c80613e0 tx=0x7f67bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:50.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.560+0000 7f67c7fff700 1 --2- 172.21.15.103:0/1453494770 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67c81441f0 0x7f67c8144820 secure :-1 s=READY pgs=2065 cs=0 l=1 rx=0x7f67c80613e0 tx=0x7f67bc007a40).ready entity=mon.1 client_cookie=19e0210d2bb3d299 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:50.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.560+0000 7f67c7fff700 1 --2- 172.21.15.103:0/1453494770 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67c81441f0 0x7f67c8144820 secure :-1 s=THROTTLE_DONE pgs=2065 cs=0 l=1 rx=0x7f67c80613e0 tx=0x7f67bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:50.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.560+0000 7f67c77fe700 1 -- 172.21.15.103:0/1453494770 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67bc008e10 con 0x7f67c81441f0 2020-04-22T14:19:50.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.560+0000 7f67c7fff700 1 --2- 172.21.15.103:0/1453494770 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67c81441f0 0x7f67c8144820 secure :-1 s=THROTTLE_DONE pgs=2065 cs=0 l=1 rx=0x7f67c80613e0 tx=0x7f67bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:50.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.560+0000 7f67c7fff700 1 --2- 172.21.15.103:0/1453494770 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67c81441f0 0x7f67c8144820 secure :-1 s=THROTTLE_DONE pgs=2065 cs=0 l=1 rx=0x7f67c80613e0 tx=0x7f67bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:50.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.560+0000 7f67c77fe700 1 -- 172.21.15.103:0/1453494770 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67bc010780 con 0x7f67c81441f0 2020-04-22T14:19:50.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.560+0000 7f67c77fe700 1 -- 172.21.15.103:0/1453494770 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67bc010b60 con 0x7f67c81441f0 2020-04-22T14:19:50.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.560+0000 7f67cedf2700 1 -- 172.21.15.103:0/1453494770 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67c81441f0 msgr2=0x7f67c8144820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:50.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.560+0000 7f67cedf2700 1 --2- 172.21.15.103:0/1453494770 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67c81441f0 0x7f67c8144820 secure :-1 s=READY pgs=2065 cs=0 l=1 rx=0x7f67c80613e0 tx=0x7f67bc007a40).stop 2020-04-22T14:19:50.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.560+0000 7f67cedf2700 1 -- 172.21.15.103:0/1453494770 shutdown_connections 2020-04-22T14:19:50.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.560+0000 7f67cedf2700 1 --2- 172.21.15.103:0/1453494770 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f67c805b7c0 0x7f67c80b50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:50.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.560+0000 7f67cedf2700 1 --2- 172.21.15.103:0/1453494770 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67c81441f0 0x7f67c8144820 unknown :-1 s=CLOSED pgs=2065 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:50.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.560+0000 7f67cedf2700 1 -- 172.21.15.103:0/1453494770 >> 172.21.15.103:0/1453494770 conn(0x7f67c80b9160 msgr2=0x7f67c805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:50.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.560+0000 7f67cedf2700 1 -- 172.21.15.103:0/1453494770 shutdown_connections 2020-04-22T14:19:50.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.560+0000 7f67cedf2700 1 -- 172.21.15.103:0/1453494770 wait complete. 2020-04-22T14:19:50.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.561+0000 7f67cedf2700 1 Processor -- start 2020-04-22T14:19:50.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.561+0000 7f67cedf2700 1 -- start start 2020-04-22T14:19:50.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.562+0000 7f67cedf2700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f67c805b7c0 0x7f67c813cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:50.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.562+0000 7f67cedf2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f67c81441f0 0x7f67c80b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:50.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.562+0000 7f67cedf2700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67c80b1390 con 0x7f67c8144c80 2020-04-22T14:19:50.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.562+0000 7f67cedf2700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67c80b1190 con 0x7f67c805b7c0 2020-04-22T14:19:50.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.562+0000 7f67cedf2700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67c813d930 con 0x7f67c81441f0 2020-04-22T14:19:50.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.562+0000 7f67c7fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f67c81441f0 0x7f67c80b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:50.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.562+0000 7f67c7fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f67c81441f0 0x7f67c80b0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58458/0 (socket says 172.21.15.103:58458) 2020-04-22T14:19:50.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.562+0000 7f67c7fff700 1 -- 172.21.15.103:0/368887292 learned_addr learned my addr 172.21.15.103:0/368887292 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:19:50.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.563+0000 7f67c7fff700 1 -- 172.21.15.103:0/368887292 >> v2:172.21.15.86:3300/0 conn(0x7f67c805b7c0 msgr2=0x7f67c813cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:50.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.563+0000 7f67c7fff700 1 --2- 172.21.15.103:0/368887292 >> v2:172.21.15.86:3300/0 conn(0x7f67c805b7c0 0x7f67c813cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:50.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.563+0000 7f67c7fff700 1 -- 172.21.15.103:0/368887292 >> v1:172.21.15.103:6789/0 conn(0x7f67c8144c80 legacy=0x7f67c8146740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:50.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.563+0000 7f67c7fff700 1 -- 172.21.15.103:0/368887292 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c8145060 con 0x7f67c81441f0 2020-04-22T14:19:50.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.563+0000 7f67c5ffb700 1 -- 172.21.15.103:0/368887292 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2798387646 0 0) 0x7f67c80b1390 con 0x7f67c8144c80 2020-04-22T14:19:50.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.563+0000 7f67c7fff700 1 --2- 172.21.15.103:0/368887292 >> v2:172.21.15.103:3300/0 conn(0x7f67c81441f0 0x7f67c80b0d30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f67c80613e0 tx=0x7f67bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:50.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.563+0000 7f67c7fff700 1 --2- 172.21.15.103:0/368887292 >> v2:172.21.15.103:3300/0 conn(0x7f67c81441f0 0x7f67c80b0d30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f67c80613e0 tx=0x7f67bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:50.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.563+0000 7f67c7fff700 1 --2- 172.21.15.103:0/368887292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67c81441f0 0x7f67c80b0d30 secure :-1 s=READY pgs=2067 cs=0 l=1 rx=0x7f67c80613e0 tx=0x7f67bc007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:50.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.563+0000 7f67c7fff700 1 --2- 172.21.15.103:0/368887292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67c81441f0 0x7f67c80b0d30 secure :-1 s=THROTTLE_DONE pgs=2067 cs=0 l=1 rx=0x7f67c80613e0 tx=0x7f67bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:50.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.563+0000 7f67c5ffb700 1 -- 172.21.15.103:0/368887292 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67bc007170 con 0x7f67c81441f0 2020-04-22T14:19:50.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.563+0000 7f67c7fff700 1 --2- 172.21.15.103:0/368887292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67c81441f0 0x7f67c80b0d30 secure :-1 s=THROTTLE_DONE pgs=2067 cs=0 l=1 rx=0x7f67c80613e0 tx=0x7f67bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:50.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.563+0000 7f67c7fff700 1 --2- 172.21.15.103:0/368887292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67c81441f0 0x7f67c80b0d30 secure :-1 s=THROTTLE_DONE pgs=2067 cs=0 l=1 rx=0x7f67c80613e0 tx=0x7f67bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:50.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.563+0000 7f67c5ffb700 1 -- 172.21.15.103:0/368887292 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67bc0072d0 con 0x7f67c81441f0 2020-04-22T14:19:50.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.563+0000 7f67cedf2700 1 -- 172.21.15.103:0/368887292 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67c8145300 con 0x7f67c81441f0 2020-04-22T14:19:50.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.563+0000 7f67c5ffb700 1 -- 172.21.15.103:0/368887292 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67bc0056c0 con 0x7f67c81441f0 2020-04-22T14:19:50.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.563+0000 7f67cedf2700 1 -- 172.21.15.103:0/368887292 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67c8142f10 con 0x7f67c81441f0 2020-04-22T14:19:50.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.564+0000 7f67c7fff700 1 --2- 172.21.15.103:0/368887292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67c81441f0 0x7f67c80b0d30 secure :-1 s=THROTTLE_DONE pgs=2067 cs=0 l=1 rx=0x7f67c80613e0 tx=0x7f67bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:50.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.564+0000 7f67cedf2700 1 -- 172.21.15.103:0/368887292 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67c8145490 con 0x7f67c81441f0 2020-04-22T14:19:50.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.564+0000 7f67c5ffb700 1 -- 172.21.15.103:0/368887292 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f67bc005930 con 0x7f67c81441f0 2020-04-22T14:19:50.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.564+0000 7f67c7fff700 1 --2- 172.21.15.103:0/368887292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67c81441f0 0x7f67c80b0d30 secure :-1 s=THROTTLE_DONE pgs=2067 cs=0 l=1 rx=0x7f67c80613e0 tx=0x7f67bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:50.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.564+0000 7f67c5ffb700 1 --2- 172.21.15.103:0/368887292 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f67a804d830 0x7f67a804fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:50.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.564+0000 7f67c5ffb700 1 -- 172.21.15.103:0/368887292 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f67bc0617d0 con 0x7f67c81441f0 2020-04-22T14:19:50.579 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.565+0000 7f67ccb8e700 1 --2- 172.21.15.103:0/368887292 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f67a804d830 0x7f67a804fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:50.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.565+0000 7f67ccb8e700 1 --2- 172.21.15.103:0/368887292 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f67a804d830 0x7f67a804fcf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f67b8002f30 tx=0x7f67b8008ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:50.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.565+0000 7f67ccb8e700 1 --2- 172.21.15.103:0/368887292 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f67a804d830 0x7f67a804fcf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f67b8002f30 tx=0x7f67b8008ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:50.580 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.565+0000 7f67ccb8e700 1 --2- 172.21.15.103:0/368887292 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f67a804d830 0x7f67a804fcf0 secure :-1 s=READY pgs=751 cs=0 l=1 rx=0x7f67b8002f30 tx=0x7f67b8008ac0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:50.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.568+0000 7f67c7fff700 1 --2- 172.21.15.103:0/368887292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67c81441f0 0x7f67c80b0d30 secure :-1 s=THROTTLE_DONE pgs=2067 cs=0 l=1 rx=0x7f67c80613e0 tx=0x7f67bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:50.587 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.568+0000 7f67c5ffb700 1 -- 172.21.15.103:0/368887292 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f67bc03cbb0 con 0x7f67c81441f0 2020-04-22T14:19:50.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.758+0000 7f67cedf2700 1 -- 172.21.15.103:0/368887292 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67c8056c90 con 0x7f67c81441f0 2020-04-22T14:19:50.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.759+0000 7f67c7fff700 1 --2- 172.21.15.103:0/368887292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67c81441f0 0x7f67c80b0d30 secure :-1 s=THROTTLE_DONE pgs=2067 cs=0 l=1 rx=0x7f67c80613e0 tx=0x7f67bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:50.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.759+0000 7f67c5ffb700 1 -- 172.21.15.103:0/368887292 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) v1 ==== 95+0+2146 (secure 0 0 0) 0x7f67bc0401d0 con 0x7f67c81441f0 2020-04-22T14:19:50.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.760+0000 7f67cedf2700 1 -- 172.21.15.103:0/368887292 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f67a804d830 msgr2=0x7f67a804fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:50.767 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.760+0000 7f67cedf2700 1 --2- 172.21.15.103:0/368887292 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f67a804d830 0x7f67a804fcf0 secure :-1 s=READY pgs=751 cs=0 l=1 rx=0x7f67b8002f30 tx=0x7f67b8008ac0).stop 2020-04-22T14:19:50.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.760+0000 7f67cedf2700 1 -- 172.21.15.103:0/368887292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67c81441f0 msgr2=0x7f67c80b0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:50.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.760+0000 7f67cedf2700 1 --2- 172.21.15.103:0/368887292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67c81441f0 0x7f67c80b0d30 secure :-1 s=READY pgs=2067 cs=0 l=1 rx=0x7f67c80613e0 tx=0x7f67bc007a40).stop 2020-04-22T14:19:50.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.760+0000 7f67cedf2700 1 -- 172.21.15.103:0/368887292 shutdown_connections 2020-04-22T14:19:50.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.760+0000 7f67cedf2700 1 --2- 172.21.15.103:0/368887292 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f67a804d830 0x7f67a804fcf0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:50.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.760+0000 7f67cedf2700 1 --2- 172.21.15.103:0/368887292 >> v2:172.21.15.86:3300/0 conn(0x7f67c805b7c0 0x7f67c813cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:50.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.760+0000 7f67cedf2700 1 --2- 172.21.15.103:0/368887292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67c81441f0 0x7f67c80b0d30 unknown :-1 s=CLOSED pgs=2067 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:50.768 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.760+0000 7f67cedf2700 1 -- 172.21.15.103:0/368887292 >> 172.21.15.103:0/368887292 conn(0x7f67c80b9160 msgr2=0x7f67c80663b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:50.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.760+0000 7f67cedf2700 1 -- 172.21.15.103:0/368887292 shutdown_connections 2020-04-22T14:19:50.769 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:50.760+0000 7f67cedf2700 1 -- 172.21.15.103:0/368887292 wait complete. 2020-04-22T14:19:50.769 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 107 2020-04-22T14:19:50.769 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:19:50.769 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":107,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6743,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2675694784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2675694784},{"type":"v1","addr":"172.21.15.86:6835","nonce":2675694784}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":104}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:19:46.112631+0000","modified":"2020-04-22T14:19:48.115224+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9703},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9703":{"gid":9703,"name":"a","rank":0,"incarnation":105,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/839133818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":839133818},{"type":"v1","addr":"172.21.15.103:6833","nonce":839133818}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-04-22T14:19:50.985 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 9703}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 25, u'failed': [], u'epoch': 107, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [26], u'info': {u'gid_9703': {u'export_targets': [], u'name': u'a', u'incarnation': 105, u'state_seq': 3, u'state': u'up:active', u'gid': 9703, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 839133818, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 839133818, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/839133818'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:19:46.112631+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:19:48.115224+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:19:50.986 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:19:50.986 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:50.999 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:19:51.158 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:19:51.159 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:19:51.159 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:19:51.159 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 9703, 2020-04-22T14:19:51.159 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:19:51.160 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:19:51.160 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 5.0426810489999996, 2020-04-22T14:19:51.160 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 107, 2020-04-22T14:19:51.161 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 146, 2020-04-22T14:19:51.161 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 146, 2020-04-22T14:19:51.161 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 10.253804426 2020-04-22T14:19:51.161 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:19:51.167 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 9703, "want_state": "up:active", "state": "up:active", "rank_uptime": 5.0426810489999996, "mdsmap_epoch": 107, "osdmap_epoch": 146, "osdmap_epoch_barrier": 146, "uptime": 10.253804426 } 2020-04-22T14:19:51.169 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:51.190 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:19:51.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.338+0000 7f9cfdd0a700 1 Processor -- start 2020-04-22T14:19:51.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.338+0000 7f9cfdd0a700 1 -- start start 2020-04-22T14:19:51.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.338+0000 7f9cfdd0a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9cf8065fe0 0x7f9cf81464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:51.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.338+0000 7f9cfdd0a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9cf8063e30 0x7f9cf80642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:51.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.338+0000 7f9cfdd0a700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cf8143300 con 0x7f9cf812c0d0 2020-04-22T14:19:51.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.338+0000 7f9cfdd0a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cf81435a0 con 0x7f9cf8063e30 2020-04-22T14:19:51.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.338+0000 7f9cfdd0a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cf8143840 con 0x7f9cf8065fe0 2020-04-22T14:19:51.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.338+0000 7f9cf6ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9cf8065fe0 0x7f9cf81464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:51.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.338+0000 7f9cf77fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f9cf812c0d0 0x7f9cf805b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50652/0 (socket says 172.21.15.103:50652) 2020-04-22T14:19:51.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.338+0000 7f9cf77fe700 1 -- 172.21.15.103:0/2715168368 learned_addr learned my addr 172.21.15.103:0/2715168368 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:51.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.339+0000 7f9cf7fff700 1 --2- 172.21.15.103:0/2715168368 >> v2:172.21.15.86:3300/0 conn(0x7f9cf8063e30 0x7f9cf80642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:51.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.339+0000 7f9cf6ffd700 1 -- 172.21.15.103:0/2715168368 >> v2:172.21.15.86:3300/0 conn(0x7f9cf8063e30 msgr2=0x7f9cf80642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:51.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.339+0000 7f9cf6ffd700 1 --2- 172.21.15.103:0/2715168368 >> v2:172.21.15.86:3300/0 conn(0x7f9cf8063e30 0x7f9cf80642c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:51.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.339+0000 7f9cf6ffd700 1 -- 172.21.15.103:0/2715168368 >> v1:172.21.15.103:6789/0 conn(0x7f9cf812c0d0 legacy=0x7f9cf805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:51.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.339+0000 7f9cf67fc700 1 -- 172.21.15.103:0/2715168368 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3511217668 0 0) 0x7f9cf8143300 con 0x7f9cf812c0d0 2020-04-22T14:19:51.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.339+0000 7f9cf6ffd700 1 -- 172.21.15.103:0/2715168368 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf805bb50 con 0x7f9cf8065fe0 2020-04-22T14:19:51.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.339+0000 7f9cf6ffd700 1 --2- 172.21.15.103:0/2715168368 >> v2:172.21.15.103:3300/0 conn(0x7f9cf8065fe0 0x7f9cf81464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9cec002f30 tx=0x7f9cec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:51.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.339+0000 7f9cf6ffd700 1 --2- 172.21.15.103:0/2715168368 >> v2:172.21.15.103:3300/0 conn(0x7f9cf8065fe0 0x7f9cf81464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9cec002f30 tx=0x7f9cec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:51.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.339+0000 7f9cf6ffd700 1 --2- 172.21.15.103:0/2715168368 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cf8065fe0 0x7f9cf81464e0 secure :-1 s=READY pgs=2069 cs=0 l=1 rx=0x7f9cec002f30 tx=0x7f9cec007a40).ready entity=mon.1 client_cookie=72aa878168a42dcc server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:51.372 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.339+0000 7f9cf6ffd700 1 --2- 172.21.15.103:0/2715168368 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cf8065fe0 0x7f9cf81464e0 secure :-1 s=THROTTLE_DONE pgs=2069 cs=0 l=1 rx=0x7f9cec002f30 tx=0x7f9cec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:51.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.339+0000 7f9cf67fc700 1 -- 172.21.15.103:0/2715168368 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9cec011470 con 0x7f9cf8065fe0 2020-04-22T14:19:51.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.339+0000 7f9cf6ffd700 1 --2- 172.21.15.103:0/2715168368 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cf8065fe0 0x7f9cf81464e0 secure :-1 s=THROTTLE_DONE pgs=2069 cs=0 l=1 rx=0x7f9cec002f30 tx=0x7f9cec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:51.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.339+0000 7f9cf67fc700 1 -- 172.21.15.103:0/2715168368 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cec0115d0 con 0x7f9cf8065fe0 2020-04-22T14:19:51.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.339+0000 7f9cf6ffd700 1 --2- 172.21.15.103:0/2715168368 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cf8065fe0 0x7f9cf81464e0 secure :-1 s=THROTTLE_DONE pgs=2069 cs=0 l=1 rx=0x7f9cec002f30 tx=0x7f9cec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:51.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.339+0000 7f9cf67fc700 1 -- 172.21.15.103:0/2715168368 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9cec011970 con 0x7f9cf8065fe0 2020-04-22T14:19:51.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.339+0000 7f9cfdd0a700 1 -- 172.21.15.103:0/2715168368 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cf8065fe0 msgr2=0x7f9cf81464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:51.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.339+0000 7f9cfdd0a700 1 --2- 172.21.15.103:0/2715168368 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cf8065fe0 0x7f9cf81464e0 secure :-1 s=READY pgs=2069 cs=0 l=1 rx=0x7f9cec002f30 tx=0x7f9cec007a40).stop 2020-04-22T14:19:51.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.340+0000 7f9cfdd0a700 1 -- 172.21.15.103:0/2715168368 shutdown_connections 2020-04-22T14:19:51.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.340+0000 7f9cfdd0a700 1 --2- 172.21.15.103:0/2715168368 >> v2:172.21.15.86:3300/0 conn(0x7f9cf8063e30 0x7f9cf80642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:51.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.340+0000 7f9cfdd0a700 1 --2- 172.21.15.103:0/2715168368 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cf8065fe0 0x7f9cf81464e0 unknown :-1 s=CLOSED pgs=2069 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:51.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.340+0000 7f9cfdd0a700 1 -- 172.21.15.103:0/2715168368 >> 172.21.15.103:0/2715168368 conn(0x7f9cf80b9160 msgr2=0x7f9cf805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:51.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.340+0000 7f9cfdd0a700 1 -- 172.21.15.103:0/2715168368 shutdown_connections 2020-04-22T14:19:51.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.340+0000 7f9cfdd0a700 1 -- 172.21.15.103:0/2715168368 wait complete. 2020-04-22T14:19:51.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.341+0000 7f9cfdd0a700 1 Processor -- start 2020-04-22T14:19:51.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.341+0000 7f9cfdd0a700 1 -- start start 2020-04-22T14:19:51.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.341+0000 7f9cfdd0a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9cf8063e30 0x7f9cf8142590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:51.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.341+0000 7f9cfdd0a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9cf8065fe0 0x7f9cf8125d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:51.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.341+0000 7f9cfdd0a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9cf812c0d0 0x7f9cf8144260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:51.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.341+0000 7f9cfdd0a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cf81261e0 con 0x7f9cf8063e30 2020-04-22T14:19:51.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.341+0000 7f9cfdd0a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cf8120a60 con 0x7f9cf812c0d0 2020-04-22T14:19:51.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.341+0000 7f9cfdd0a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf8120d00 con 0x7f9cf8065fe0 2020-04-22T14:19:51.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.341+0000 7f9cf7fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9cf812c0d0 0x7f9cf8144260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:51.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.342+0000 7f9cf7fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9cf812c0d0 0x7f9cf8144260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58472/0 (socket says 172.21.15.103:58472) 2020-04-22T14:19:51.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.342+0000 7f9cf7fff700 1 -- 172.21.15.103:0/535983102 learned_addr learned my addr 172.21.15.103:0/535983102 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:19:51.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.342+0000 7f9cf77fe700 1 --2- 172.21.15.103:0/535983102 >> v2:172.21.15.86:3300/0 conn(0x7f9cf8063e30 0x7f9cf8142590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:51.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.342+0000 7f9cf6ffd700 1 --2- 172.21.15.103:0/535983102 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9cf8065fe0 0x7f9cf8125d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:51.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.342+0000 7f9cf7fff700 1 -- 172.21.15.103:0/535983102 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9cf8065fe0 msgr2=0x7f9cf8125d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:51.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.342+0000 7f9cf7fff700 1 --2- 172.21.15.103:0/535983102 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9cf8065fe0 0x7f9cf8125d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:51.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.342+0000 7f9cf7fff700 1 -- 172.21.15.103:0/535983102 >> v2:172.21.15.86:3300/0 conn(0x7f9cf8063e30 msgr2=0x7f9cf8142590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:51.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.342+0000 7f9cf7fff700 1 --2- 172.21.15.103:0/535983102 >> v2:172.21.15.86:3300/0 conn(0x7f9cf8063e30 0x7f9cf8142590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:51.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.342+0000 7f9cf7fff700 1 -- 172.21.15.103:0/535983102 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf8127050 con 0x7f9cf812c0d0 2020-04-22T14:19:51.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.342+0000 7f9cf7fff700 1 --2- 172.21.15.103:0/535983102 >> v2:172.21.15.103:3300/0 conn(0x7f9cf812c0d0 0x7f9cf8144260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9cf0002f30 tx=0x7f9cf0010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:51.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.342+0000 7f9cf7fff700 1 --2- 172.21.15.103:0/535983102 >> v2:172.21.15.103:3300/0 conn(0x7f9cf812c0d0 0x7f9cf8144260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9cf0002f30 tx=0x7f9cf0010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:51.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.342+0000 7f9cf7fff700 1 --2- 172.21.15.103:0/535983102 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cf812c0d0 0x7f9cf8144260 secure :-1 s=READY pgs=2070 cs=0 l=1 rx=0x7f9cf0002f30 tx=0x7f9cf0010a30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:51.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.342+0000 7f9cf7fff700 1 --2- 172.21.15.103:0/535983102 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cf812c0d0 0x7f9cf8144260 secure :-1 s=THROTTLE_DONE pgs=2070 cs=0 l=1 rx=0x7f9cf0002f30 tx=0x7f9cf0010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:51.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.342+0000 7f9cf7fff700 1 --2- 172.21.15.103:0/535983102 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cf812c0d0 0x7f9cf8144260 secure :-1 s=THROTTLE_DONE pgs=2070 cs=0 l=1 rx=0x7f9cf0002f30 tx=0x7f9cf0010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:51.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.342+0000 7f9cf4ff9700 1 -- 172.21.15.103:0/535983102 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9cf000a370 con 0x7f9cf812c0d0 2020-04-22T14:19:51.403 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.342+0000 7f9cf7fff700 1 --2- 172.21.15.103:0/535983102 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cf812c0d0 0x7f9cf8144260 secure :-1 s=THROTTLE_DONE pgs=2070 cs=0 l=1 rx=0x7f9cf0002f30 tx=0x7f9cf0010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:51.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.342+0000 7f9cf4ff9700 1 -- 172.21.15.103:0/535983102 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf000a510 con 0x7f9cf812c0d0 2020-04-22T14:19:51.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.342+0000 7f9cfdd0a700 1 -- 172.21.15.103:0/535983102 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cf81446c0 con 0x7f9cf812c0d0 2020-04-22T14:19:51.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.342+0000 7f9cf4ff9700 1 -- 172.21.15.103:0/535983102 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9cf000a930 con 0x7f9cf812c0d0 2020-04-22T14:19:51.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.342+0000 7f9cfdd0a700 1 -- 172.21.15.103:0/535983102 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cf81213f0 con 0x7f9cf812c0d0 2020-04-22T14:19:51.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.343+0000 7f9cf7fff700 1 --2- 172.21.15.103:0/535983102 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cf812c0d0 0x7f9cf8144260 secure :-1 s=THROTTLE_DONE pgs=2070 cs=0 l=1 rx=0x7f9cf0002f30 tx=0x7f9cf0010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:51.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.343+0000 7f9cfdd0a700 1 -- 172.21.15.103:0/535983102 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cf8056c90 con 0x7f9cf812c0d0 2020-04-22T14:19:51.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.343+0000 7f9cf4ff9700 1 -- 172.21.15.103:0/535983102 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f9cf000aba0 con 0x7f9cf812c0d0 2020-04-22T14:19:51.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.343+0000 7f9cf7fff700 1 --2- 172.21.15.103:0/535983102 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cf812c0d0 0x7f9cf8144260 secure :-1 s=THROTTLE_DONE pgs=2070 cs=0 l=1 rx=0x7f9cf0002f30 tx=0x7f9cf0010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:51.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.343+0000 7f9cf4ff9700 1 --2- 172.21.15.103:0/535983102 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9cd804d9d0 0x7f9cd804fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:51.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.343+0000 7f9cf4ff9700 1 -- 172.21.15.103:0/535983102 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9cf0061600 con 0x7f9cf812c0d0 2020-04-22T14:19:51.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.344+0000 7f9cf77fe700 1 --2- 172.21.15.103:0/535983102 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9cd804d9d0 0x7f9cd804fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:51.405 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.344+0000 7f9cf77fe700 1 --2- 172.21.15.103:0/535983102 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9cd804d9d0 0x7f9cd804fe90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9ce8000f00 tx=0x7f9ce8001a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:51.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.344+0000 7f9cf77fe700 1 --2- 172.21.15.103:0/535983102 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9cd804d9d0 0x7f9cd804fe90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9ce8000f00 tx=0x7f9ce8001a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:51.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.344+0000 7f9cf77fe700 1 --2- 172.21.15.103:0/535983102 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9cd804d9d0 0x7f9cd804fe90 secure :-1 s=READY pgs=752 cs=0 l=1 rx=0x7f9ce8000f00 tx=0x7f9ce8001a90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:51.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.347+0000 7f9cf7fff700 1 --2- 172.21.15.103:0/535983102 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cf812c0d0 0x7f9cf8144260 secure :-1 s=THROTTLE_DONE pgs=2070 cs=0 l=1 rx=0x7f9cf0002f30 tx=0x7f9cf0010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:51.406 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.347+0000 7f9cf4ff9700 1 -- 172.21.15.103:0/535983102 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f9cf0033440 con 0x7f9cf812c0d0 2020-04-22T14:19:51.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.492+0000 7f9cfdd0a700 1 -- 172.21.15.103:0/535983102 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9cf8147360 con 0x7f9cf812c0d0 2020-04-22T14:19:51.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.493+0000 7f9cf7fff700 1 --2- 172.21.15.103:0/535983102 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cf812c0d0 0x7f9cf8144260 secure :-1 s=THROTTLE_DONE pgs=2070 cs=0 l=1 rx=0x7f9cf0002f30 tx=0x7f9cf0010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:51.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.493+0000 7f9cf4ff9700 1 -- 172.21.15.103:0/535983102 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) v1 ==== 74+0+16103 (secure 0 0 0) 0x7f9cf003c9e0 con 0x7f9cf812c0d0 2020-04-22T14:19:51.497 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:19:51.497 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":146,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:19:47.113833+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:19:44.035980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2020-04-22T14:19:45.079896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:19:51.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.494+0000 7f9cfdd0a700 1 -- 172.21.15.103:0/535983102 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9cd804d9d0 msgr2=0x7f9cd804fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:51.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.494+0000 7f9cfdd0a700 1 --2- 172.21.15.103:0/535983102 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9cd804d9d0 0x7f9cd804fe90 secure :-1 s=READY pgs=752 cs=0 l=1 rx=0x7f9ce8000f00 tx=0x7f9ce8001a90).stop 2020-04-22T14:19:51.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.494+0000 7f9cfdd0a700 1 -- 172.21.15.103:0/535983102 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cf812c0d0 msgr2=0x7f9cf8144260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:51.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.494+0000 7f9cfdd0a700 1 --2- 172.21.15.103:0/535983102 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cf812c0d0 0x7f9cf8144260 secure :-1 s=READY pgs=2070 cs=0 l=1 rx=0x7f9cf0002f30 tx=0x7f9cf0010a30).stop 2020-04-22T14:19:51.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.494+0000 7f9cfdd0a700 1 -- 172.21.15.103:0/535983102 shutdown_connections 2020-04-22T14:19:51.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.494+0000 7f9cfdd0a700 1 --2- 172.21.15.103:0/535983102 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9cd804d9d0 0x7f9cd804fe90 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:51.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.494+0000 7f9cfdd0a700 1 --2- 172.21.15.103:0/535983102 >> v2:172.21.15.86:3300/0 conn(0x7f9cf8063e30 0x7f9cf8142590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:51.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.494+0000 7f9cfdd0a700 1 --2- 172.21.15.103:0/535983102 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cf812c0d0 0x7f9cf8144260 unknown :-1 s=CLOSED pgs=2070 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:51.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.494+0000 7f9cfdd0a700 1 --2- 172.21.15.103:0/535983102 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9cf8065fe0 0x7f9cf8125d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:51.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.494+0000 7f9cfdd0a700 1 -- 172.21.15.103:0/535983102 >> 172.21.15.103:0/535983102 conn(0x7f9cf80b9160 msgr2=0x7f9cf80b5230 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:51.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.495+0000 7f9cfdd0a700 1 -- 172.21.15.103:0/535983102 shutdown_connections 2020-04-22T14:19:51.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.495+0000 7f9cfdd0a700 1 -- 172.21.15.103:0/535983102 wait complete. 2020-04-22T14:19:51.509 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:19:44.035980+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 25, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'145', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:19:45.079896+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 26, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'146', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:19:51.510 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:51.523 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:19:51.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.669+0000 7fd3583c3700 1 Processor -- start 2020-04-22T14:19:51.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.669+0000 7fd3583c3700 1 -- start start 2020-04-22T14:19:51.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.670+0000 7fd3583c3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd3500ac950 0x7fd350146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:51.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.670+0000 7fd3583c3700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3501467e0 con 0x7fd3500b9140 2020-04-22T14:19:51.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.670+0000 7fd3583c3700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd350060050 con 0x7fd3501470a0 2020-04-22T14:19:51.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.670+0000 7fd3583c3700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd350147530 con 0x7fd3500ac950 2020-04-22T14:19:51.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.670+0000 7fd356960700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd3501470a0 0x7fd350143090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50666/0 (socket says 172.21.15.103:50666) 2020-04-22T14:19:51.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.670+0000 7fd356960700 1 -- 172.21.15.103:0/1494940352 learned_addr learned my addr 172.21.15.103:0/1494940352 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:51.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.670+0000 7fd35515d700 1 -- 172.21.15.103:0/1494940352 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4071010978 0 0) 0x7fd350060050 con 0x7fd3501470a0 2020-04-22T14:19:51.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.670+0000 7fd35515d700 1 -- 172.21.15.103:0/1494940352 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd338003230 con 0x7fd3501470a0 2020-04-22T14:19:51.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.671+0000 7fd35595e700 1 --2- 172.21.15.103:0/1494940352 >> v2:172.21.15.86:3300/0 conn(0x7fd3500ac950 0x7fd350146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:51.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.671+0000 7fd35515d700 1 -- 172.21.15.103:0/1494940352 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2347962847 0 0) 0x7fd338003230 con 0x7fd3501470a0 2020-04-22T14:19:51.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.671+0000 7fd35515d700 1 -- 172.21.15.103:0/1494940352 >> v2:172.21.15.86:3300/0 conn(0x7fd3500ac950 msgr2=0x7fd350146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:51.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.671+0000 7fd35515d700 1 --2- 172.21.15.103:0/1494940352 >> v2:172.21.15.86:3300/0 conn(0x7fd3500ac950 0x7fd350146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:51.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.671+0000 7fd35515d700 1 -- 172.21.15.103:0/1494940352 >> v1:172.21.15.86:6789/0 conn(0x7fd3500b9140 legacy=0x7fd35012b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:51.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.671+0000 7fd35515d700 1 -- 172.21.15.103:0/1494940352 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3500b9520 con 0x7fd3501470a0 2020-04-22T14:19:51.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.671+0000 7fd35515d700 1 -- 172.21.15.103:0/1494940352 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fd348001a90 con 0x7fd3501470a0 2020-04-22T14:19:51.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.671+0000 7fd35515d700 1 -- 172.21.15.103:0/1494940352 >> v1:172.21.15.103:6789/0 conn(0x7fd3501470a0 legacy=0x7fd350143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:51.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.671+0000 7fd35515d700 1 --2- 172.21.15.103:0/1494940352 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd338003720 0x7fd338003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:51.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.671+0000 7fd35515d700 1 --2- 172.21.15.103:0/1494940352 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3380044d0 0x7fd338004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:51.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.671+0000 7fd35515d700 1 --2- 172.21.15.103:0/1494940352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd338004db0 0x7fd33800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:51.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.671+0000 7fd35515d700 1 -- 172.21.15.103:0/1494940352 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3380041c0 con 0x7fd3380044d0 2020-04-22T14:19:51.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.671+0000 7fd35515d700 1 -- 172.21.15.103:0/1494940352 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd338004330 con 0x7fd338004db0 2020-04-22T14:19:51.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.671+0000 7fd35515d700 1 -- 172.21.15.103:0/1494940352 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33800bbd0 con 0x7fd338003720 2020-04-22T14:19:51.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.671+0000 7fd356960700 1 --2- 172.21.15.103:0/1494940352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd338004db0 0x7fd33800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:51.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.671+0000 7fd35595e700 1 --2- 172.21.15.103:0/1494940352 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3380044d0 0x7fd338004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:51.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.671+0000 7fd35615f700 1 --2- 172.21.15.103:0/1494940352 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd338003720 0x7fd338003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:51.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.671+0000 7fd356960700 1 -- 172.21.15.103:0/1494940352 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd338003720 msgr2=0x7fd338003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:51.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.671+0000 7fd356960700 1 --2- 172.21.15.103:0/1494940352 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd338003720 0x7fd338003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:51.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.671+0000 7fd356960700 1 -- 172.21.15.103:0/1494940352 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3380044d0 msgr2=0x7fd338004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:51.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.671+0000 7fd356960700 1 --2- 172.21.15.103:0/1494940352 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3380044d0 0x7fd338004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:51.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.671+0000 7fd356960700 1 -- 172.21.15.103:0/1494940352 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd338003230 con 0x7fd338004db0 2020-04-22T14:19:51.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.671+0000 7fd356960700 1 --2- 172.21.15.103:0/1494940352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd338004db0 0x7fd33800b720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd3480017a0 tx=0x7fd3500b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:51.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.671+0000 7fd356960700 1 -- 172.21.15.103:0/1494940352 reap_dead start 2020-04-22T14:19:51.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.671+0000 7fd356960700 1 --2- 172.21.15.103:0/1494940352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd338004db0 0x7fd33800b720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd3480017a0 tx=0x7fd3500b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:51.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.671+0000 7fd356960700 1 --2- 172.21.15.103:0/1494940352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd338004db0 0x7fd33800b720 secure :-1 s=READY pgs=2072 cs=0 l=1 rx=0x7fd3480017a0 tx=0x7fd3500b96b0).ready entity=mon.1 client_cookie=fb48f4eff8717144 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:51.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.671+0000 7fd356960700 1 --2- 172.21.15.103:0/1494940352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd338004db0 0x7fd33800b720 secure :-1 s=THROTTLE_DONE pgs=2072 cs=0 l=1 rx=0x7fd3480017a0 tx=0x7fd3500b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:51.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.671+0000 7fd35515d700 1 -- 172.21.15.103:0/1494940352 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd348005d40 con 0x7fd338004db0 2020-04-22T14:19:51.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.671+0000 7fd356960700 1 --2- 172.21.15.103:0/1494940352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd338004db0 0x7fd33800b720 secure :-1 s=THROTTLE_DONE pgs=2072 cs=0 l=1 rx=0x7fd3480017a0 tx=0x7fd3500b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:51.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.671+0000 7fd356960700 1 --2- 172.21.15.103:0/1494940352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd338004db0 0x7fd33800b720 secure :-1 s=THROTTLE_DONE pgs=2072 cs=0 l=1 rx=0x7fd3480017a0 tx=0x7fd3500b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:51.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.672+0000 7fd35515d700 1 -- 172.21.15.103:0/1494940352 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd348004d20 con 0x7fd338004db0 2020-04-22T14:19:51.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.672+0000 7fd35515d700 1 -- 172.21.15.103:0/1494940352 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd348005ea0 con 0x7fd338004db0 2020-04-22T14:19:51.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.672+0000 7fd3583c3700 1 -- 172.21.15.103:0/1494940352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd338004db0 msgr2=0x7fd33800b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:51.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.672+0000 7fd3583c3700 1 --2- 172.21.15.103:0/1494940352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd338004db0 0x7fd33800b720 secure :-1 s=READY pgs=2072 cs=0 l=1 rx=0x7fd3480017a0 tx=0x7fd3500b96b0).stop 2020-04-22T14:19:51.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.672+0000 7fd3583c3700 1 -- 172.21.15.103:0/1494940352 shutdown_connections 2020-04-22T14:19:51.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.672+0000 7fd3583c3700 1 --2- 172.21.15.103:0/1494940352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd338004db0 0x7fd33800b720 unknown :-1 s=CLOSED pgs=2072 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:51.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.672+0000 7fd3583c3700 1 -- 172.21.15.103:0/1494940352 >> 172.21.15.103:0/1494940352 conn(0x7fd35005b7b0 msgr2=0x7fd3500b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:51.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.672+0000 7fd3583c3700 1 -- 172.21.15.103:0/1494940352 shutdown_connections 2020-04-22T14:19:51.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.672+0000 7fd3583c3700 1 -- 172.21.15.103:0/1494940352 wait complete. 2020-04-22T14:19:51.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.673+0000 7fd3583c3700 1 Processor -- start 2020-04-22T14:19:51.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.673+0000 7fd3583c3700 1 -- start start 2020-04-22T14:19:51.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.674+0000 7fd3583c3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd338004db0 0x7fd350061cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:51.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.674+0000 7fd3583c3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd3500b5980 0x7fd3501405d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:51.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.674+0000 7fd3583c3700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd350141da0 con 0x7fd3501431a0 2020-04-22T14:19:51.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.674+0000 7fd3583c3700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3500b3760 con 0x7fd3500b5980 2020-04-22T14:19:51.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.674+0000 7fd3583c3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd35014f170 con 0x7fd338004db0 2020-04-22T14:19:51.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.674+0000 7fd35595e700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd3501431a0 0x7fd3500b3050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50680/0 (socket says 172.21.15.103:50680) 2020-04-22T14:19:51.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.674+0000 7fd35595e700 1 -- 172.21.15.103:0/1721604256 learned_addr learned my addr 172.21.15.103:0/1721604256 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:51.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.674+0000 7fd35615f700 1 --2- 172.21.15.103:0/1721604256 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd338004db0 0x7fd350061cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:51.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.674+0000 7fd356960700 1 --2- 172.21.15.103:0/1721604256 >> v2:172.21.15.86:3300/0 conn(0x7fd3500b5980 0x7fd3501405d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:51.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.674+0000 7fd33f7fe700 1 -- 172.21.15.103:0/1721604256 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 700799395 0 0) 0x7fd350141da0 con 0x7fd3501431a0 2020-04-22T14:19:51.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.674+0000 7fd33f7fe700 1 -- 172.21.15.103:0/1721604256 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd330002fe0 con 0x7fd3501431a0 2020-04-22T14:19:51.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.674+0000 7fd35615f700 1 -- 172.21.15.103:0/1721604256 >> v2:172.21.15.86:3300/0 conn(0x7fd3500b5980 msgr2=0x7fd3501405d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:51.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.674+0000 7fd35615f700 1 --2- 172.21.15.103:0/1721604256 >> v2:172.21.15.86:3300/0 conn(0x7fd3500b5980 0x7fd3501405d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:51.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.674+0000 7fd35615f700 1 -- 172.21.15.103:0/1721604256 >> v1:172.21.15.103:6789/0 conn(0x7fd3501431a0 legacy=0x7fd3500b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:51.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.674+0000 7fd33f7fe700 1 -- 172.21.15.103:0/1721604256 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 16029106 0 0) 0x7fd330002fe0 con 0x7fd3501431a0 2020-04-22T14:19:51.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.674+0000 7fd35615f700 1 -- 172.21.15.103:0/1721604256 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3500b5df0 con 0x7fd338004db0 2020-04-22T14:19:51.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.674+0000 7fd35615f700 1 --2- 172.21.15.103:0/1721604256 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd338004db0 0x7fd350061cc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd3500b6250 tx=0x7fd34000c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:51.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.674+0000 7fd35615f700 1 --2- 172.21.15.103:0/1721604256 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd338004db0 0x7fd350061cc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd3500b6250 tx=0x7fd34000c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:51.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.674+0000 7fd35615f700 1 --2- 172.21.15.103:0/1721604256 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd338004db0 0x7fd350061cc0 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7fd3500b6250 tx=0x7fd34000c4e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:51.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.674+0000 7fd35615f700 1 --2- 172.21.15.103:0/1721604256 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd338004db0 0x7fd350061cc0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7fd3500b6250 tx=0x7fd34000c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:51.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.674+0000 7fd33f7fe700 1 -- 172.21.15.103:0/1721604256 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd340001e60 con 0x7fd338004db0 2020-04-22T14:19:51.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.674+0000 7fd35615f700 1 --2- 172.21.15.103:0/1721604256 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd338004db0 0x7fd350061cc0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7fd3500b6250 tx=0x7fd34000c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:51.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.674+0000 7fd33f7fe700 1 -- 172.21.15.103:0/1721604256 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34000c930 con 0x7fd338004db0 2020-04-22T14:19:51.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.674+0000 7fd35615f700 1 --2- 172.21.15.103:0/1721604256 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd338004db0 0x7fd350061cc0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7fd3500b6250 tx=0x7fd34000c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:51.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.674+0000 7fd3583c3700 1 -- 172.21.15.103:0/1721604256 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3501418d0 con 0x7fd338004db0 2020-04-22T14:19:51.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.675+0000 7fd33f7fe700 1 -- 172.21.15.103:0/1721604256 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd34000cc90 con 0x7fd338004db0 2020-04-22T14:19:51.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.675+0000 7fd3583c3700 1 -- 172.21.15.103:0/1721604256 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd350140a30 con 0x7fd338004db0 2020-04-22T14:19:51.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.675+0000 7fd35615f700 1 --2- 172.21.15.103:0/1721604256 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd338004db0 0x7fd350061cc0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7fd3500b6250 tx=0x7fd34000c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:51.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.676+0000 7fd33f7fe700 1 -- 172.21.15.103:0/1721604256 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fd3400064e0 con 0x7fd338004db0 2020-04-22T14:19:51.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.676+0000 7fd35615f700 1 --2- 172.21.15.103:0/1721604256 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd338004db0 0x7fd350061cc0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7fd3500b6250 tx=0x7fd34000c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:51.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.676+0000 7fd3583c3700 1 -- 172.21.15.103:0/1721604256 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd35014f310 con 0x7fd338004db0 2020-04-22T14:19:51.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.676+0000 7fd33f7fe700 1 --2- 172.21.15.103:0/1721604256 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd33004dcd0 0x7fd330050190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:51.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.676+0000 7fd33f7fe700 1 -- 172.21.15.103:0/1721604256 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd340060cd0 con 0x7fd338004db0 2020-04-22T14:19:51.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.676+0000 7fd35595e700 1 --2- 172.21.15.103:0/1721604256 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd33004dcd0 0x7fd330050190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:51.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.676+0000 7fd35595e700 1 --2- 172.21.15.103:0/1721604256 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd33004dcd0 0x7fd330050190 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd34c007df0 tx=0x7fd34c007fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:51.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.676+0000 7fd35595e700 1 --2- 172.21.15.103:0/1721604256 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd33004dcd0 0x7fd330050190 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd34c007df0 tx=0x7fd34c007fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:51.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.676+0000 7fd35595e700 1 --2- 172.21.15.103:0/1721604256 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd33004dcd0 0x7fd330050190 secure :-1 s=READY pgs=753 cs=0 l=1 rx=0x7fd34c007df0 tx=0x7fd34c007fa0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:51.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.680+0000 7fd35615f700 1 --2- 172.21.15.103:0/1721604256 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd338004db0 0x7fd350061cc0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7fd3500b6250 tx=0x7fd34000c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:51.703 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.680+0000 7fd33f7fe700 1 -- 172.21.15.103:0/1721604256 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fd35014f310 con 0x7fd338004db0 2020-04-22T14:19:51.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.822+0000 7fd3583c3700 1 -- 172.21.15.103:0/1721604256 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd35014f310 con 0x7fd338004db0 2020-04-22T14:19:51.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.822+0000 7fd35615f700 1 --2- 172.21.15.103:0/1721604256 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd338004db0 0x7fd350061cc0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7fd3500b6250 tx=0x7fd34000c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:51.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.823+0000 7fd33f7fe700 1 -- 172.21.15.103:0/1721604256 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v146) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd35014f310 con 0x7fd338004db0 2020-04-22T14:19:51.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.824+0000 7fd3583c3700 1 -- 172.21.15.103:0/1721604256 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd33004dcd0 msgr2=0x7fd330050190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:51.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.824+0000 7fd3583c3700 1 --2- 172.21.15.103:0/1721604256 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd33004dcd0 0x7fd330050190 secure :-1 s=READY pgs=753 cs=0 l=1 rx=0x7fd34c007df0 tx=0x7fd34c007fa0).stop 2020-04-22T14:19:51.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.824+0000 7fd3583c3700 1 -- 172.21.15.103:0/1721604256 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd338004db0 msgr2=0x7fd350061cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:51.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.824+0000 7fd3583c3700 1 --2- 172.21.15.103:0/1721604256 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd338004db0 0x7fd350061cc0 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7fd3500b6250 tx=0x7fd34000c4e0).stop 2020-04-22T14:19:51.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.824+0000 7fd3583c3700 1 -- 172.21.15.103:0/1721604256 shutdown_connections 2020-04-22T14:19:51.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.824+0000 7fd3583c3700 1 --2- 172.21.15.103:0/1721604256 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd33004dcd0 0x7fd330050190 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:51.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.824+0000 7fd3583c3700 1 --2- 172.21.15.103:0/1721604256 >> v2:172.21.15.86:3300/0 conn(0x7fd3500b5980 0x7fd3501405d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:51.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.824+0000 7fd3583c3700 1 --2- 172.21.15.103:0/1721604256 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd338004db0 0x7fd350061cc0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:51.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.824+0000 7fd3583c3700 1 -- 172.21.15.103:0/1721604256 >> 172.21.15.103:0/1721604256 conn(0x7fd35005b7b0 msgr2=0x7fd350144430 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:51.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.824+0000 7fd3583c3700 1 -- 172.21.15.103:0/1721604256 shutdown_connections 2020-04-22T14:19:51.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:51.824+0000 7fd3583c3700 1 -- 172.21.15.103:0/1721604256 wait complete. 2020-04-22T14:19:51.831 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:19:51.837 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:51.853 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:19:52.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.000+0000 7f353654a700 1 Processor -- start 2020-04-22T14:19:52.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.000+0000 7f353654a700 1 -- start start 2020-04-22T14:19:52.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.001+0000 7f353654a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f35300ac950 0x7f3530146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:52.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.001+0000 7f353654a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35301467e0 con 0x7f35301470a0 2020-04-22T14:19:52.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.001+0000 7f353654a700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3530060050 con 0x7f35300b9140 2020-04-22T14:19:52.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.001+0000 7f353654a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35300602f0 con 0x7f35300ac950 2020-04-22T14:19:52.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.001+0000 7f352ffff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f35300b9140 0x7f353012b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50686/0 (socket says 172.21.15.103:50686) 2020-04-22T14:19:52.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.001+0000 7f352ffff700 1 -- 172.21.15.103:0/1581272617 learned_addr learned my addr 172.21.15.103:0/1581272617 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:52.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.001+0000 7f3527fff700 1 --2- 172.21.15.103:0/1581272617 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f35300ac950 0x7f3530146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:52.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.001+0000 7f352f7fe700 1 -- 172.21.15.103:0/1581272617 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3297604185 0 0) 0x7f3530060050 con 0x7f35300b9140 2020-04-22T14:19:52.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.001+0000 7f352f7fe700 1 -- 172.21.15.103:0/1581272617 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3510003230 con 0x7f35300b9140 2020-04-22T14:19:52.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.001+0000 7f352f7fe700 1 -- 172.21.15.103:0/1581272617 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 828132503 0 0) 0x7f3510003230 con 0x7f35300b9140 2020-04-22T14:19:52.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.001+0000 7f352f7fe700 1 -- 172.21.15.103:0/1581272617 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f35300ac950 msgr2=0x7f3530146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:52.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.001+0000 7f352f7fe700 1 --2- 172.21.15.103:0/1581272617 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f35300ac950 0x7f3530146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:52.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.001+0000 7f352f7fe700 1 -- 172.21.15.103:0/1581272617 >> v1:172.21.15.86:6789/0 conn(0x7f35301470a0 legacy=0x7f3530143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:52.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.001+0000 7f352f7fe700 1 -- 172.21.15.103:0/1581272617 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35300b9520 con 0x7f35300b9140 2020-04-22T14:19:52.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.001+0000 7f352f7fe700 1 -- 172.21.15.103:0/1581272617 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f35200016d0 con 0x7f35300b9140 2020-04-22T14:19:52.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.001+0000 7f352f7fe700 1 -- 172.21.15.103:0/1581272617 >> v1:172.21.15.103:6789/0 conn(0x7f35300b9140 legacy=0x7f353012b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:52.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.001+0000 7f352f7fe700 1 --2- 172.21.15.103:0/1581272617 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f35300ac950 0x7f3510003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:52.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.001+0000 7f352f7fe700 1 --2- 172.21.15.103:0/1581272617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3510003b80 0x7f3510003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:52.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.001+0000 7f352f7fe700 1 --2- 172.21.15.103:0/1581272617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35100045c0 0x7f3510004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:52.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.001+0000 7f352f7fe700 1 -- 172.21.15.103:0/1581272617 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35300602f0 con 0x7f35100045c0 2020-04-22T14:19:52.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.001+0000 7f352f7fe700 1 -- 172.21.15.103:0/1581272617 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3510004fd0 con 0x7f3510003b80 2020-04-22T14:19:52.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.001+0000 7f352f7fe700 1 -- 172.21.15.103:0/1581272617 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3510005190 con 0x7f35300ac950 2020-04-22T14:19:52.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.002+0000 7f3527fff700 1 --2- 172.21.15.103:0/1581272617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3510003b80 0x7f3510003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:52.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.002+0000 7f352ffff700 1 --2- 172.21.15.103:0/1581272617 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f35300ac950 0x7f3510003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:52.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.002+0000 7f3534ae7700 1 --2- 172.21.15.103:0/1581272617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35100045c0 0x7f3510004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:52.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.002+0000 7f3527fff700 1 -- 172.21.15.103:0/1581272617 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f35300ac950 msgr2=0x7f3510003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:52.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.002+0000 7f3527fff700 1 --2- 172.21.15.103:0/1581272617 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f35300ac950 0x7f3510003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:52.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.002+0000 7f3527fff700 1 -- 172.21.15.103:0/1581272617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35100045c0 msgr2=0x7f3510004a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:52.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.002+0000 7f3527fff700 1 --2- 172.21.15.103:0/1581272617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35100045c0 0x7f3510004a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:52.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.002+0000 7f3527fff700 1 -- 172.21.15.103:0/1581272617 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3510003230 con 0x7f3510003b80 2020-04-22T14:19:52.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.002+0000 7f3534ae7700 1 --2- 172.21.15.103:0/1581272617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35100045c0 0x7f3510004a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:19:52.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.002+0000 7f3527fff700 1 --2- 172.21.15.103:0/1581272617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3510003b80 0x7f3510003fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3518008910 tx=0x7f3518010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.002+0000 7f3527fff700 1 --2- 172.21.15.103:0/1581272617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3510003b80 0x7f3510003fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3518008910 tx=0x7f3518010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.002+0000 7f3527fff700 1 --2- 172.21.15.103:0/1581272617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3510003b80 0x7f3510003fe0 secure :-1 s=READY pgs=2075 cs=0 l=1 rx=0x7f3518008910 tx=0x7f3518010050).ready entity=mon.1 client_cookie=83a19ff1c194acd server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:52.015 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.002+0000 7f3527fff700 1 --2- 172.21.15.103:0/1581272617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3510003b80 0x7f3510003fe0 secure :-1 s=THROTTLE_DONE pgs=2075 cs=0 l=1 rx=0x7f3518008910 tx=0x7f3518010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.015 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.002+0000 7f352f7fe700 1 -- 172.21.15.103:0/1581272617 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3518008d30 con 0x7f3510003b80 2020-04-22T14:19:52.015 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.002+0000 7f3527fff700 1 --2- 172.21.15.103:0/1581272617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3510003b80 0x7f3510003fe0 secure :-1 s=THROTTLE_DONE pgs=2075 cs=0 l=1 rx=0x7f3518008910 tx=0x7f3518010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.015 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.002+0000 7f3527fff700 1 --2- 172.21.15.103:0/1581272617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3510003b80 0x7f3510003fe0 secure :-1 s=THROTTLE_DONE pgs=2075 cs=0 l=1 rx=0x7f3518008910 tx=0x7f3518010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.016 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.002+0000 7f352f7fe700 1 -- 172.21.15.103:0/1581272617 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3518008e90 con 0x7f3510003b80 2020-04-22T14:19:52.016 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.002+0000 7f352f7fe700 1 -- 172.21.15.103:0/1581272617 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3518010b30 con 0x7f3510003b80 2020-04-22T14:19:52.016 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.002+0000 7f353654a700 1 -- 172.21.15.103:0/1581272617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3510003b80 msgr2=0x7f3510003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:52.016 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.002+0000 7f353654a700 1 --2- 172.21.15.103:0/1581272617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3510003b80 0x7f3510003fe0 secure :-1 s=READY pgs=2075 cs=0 l=1 rx=0x7f3518008910 tx=0x7f3518010050).stop 2020-04-22T14:19:52.016 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.002+0000 7f3534ae7700 1 -- 172.21.15.103:0/1581272617 reap_dead start 2020-04-22T14:19:52.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.003+0000 7f353654a700 1 -- 172.21.15.103:0/1581272617 shutdown_connections 2020-04-22T14:19:52.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.003+0000 7f353654a700 1 -- 172.21.15.103:0/1581272617 >> 172.21.15.103:0/1581272617 conn(0x7f353005b7b0 msgr2=0x7f35300b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:52.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.003+0000 7f353654a700 1 -- 172.21.15.103:0/1581272617 shutdown_connections 2020-04-22T14:19:52.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.003+0000 7f353654a700 1 -- 172.21.15.103:0/1581272617 wait complete. 2020-04-22T14:19:52.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.004+0000 7f353654a700 1 Processor -- start 2020-04-22T14:19:52.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.004+0000 7f353654a700 1 -- start start 2020-04-22T14:19:52.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.004+0000 7f353654a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f35300b8410 0x7f3530152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:52.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.004+0000 7f353654a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3530062390 con 0x7f3530145580 2020-04-22T14:19:52.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.004+0000 7f353654a700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3530062630 con 0x7f3530063010 2020-04-22T14:19:52.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.004+0000 7f353654a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35300628d0 con 0x7f35300b8410 2020-04-22T14:19:52.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.004+0000 7f352ffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f35300b8410 0x7f3530152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:52.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.004+0000 7f3534ae7700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f3530063010 0x7f3530143630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50702/0 (socket says 172.21.15.103:50702) 2020-04-22T14:19:52.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.004+0000 7f3534ae7700 1 -- 172.21.15.103:0/1434505911 learned_addr learned my addr 172.21.15.103:0/1434505911 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:52.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.005+0000 7f352ffff700 1 -- 172.21.15.103:0/1434505911 >> v1:172.21.15.103:6789/0 conn(0x7f3530063010 legacy=0x7f3530143630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:52.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.005+0000 7f352ffff700 1 -- 172.21.15.103:0/1434505911 >> v1:172.21.15.86:6789/0 conn(0x7f3530145580 legacy=0x7f35301419d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:52.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.005+0000 7f352dffb700 1 -- 172.21.15.103:0/1434505911 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3794949732 0 0) 0x7f3530062630 con 0x7f3530063010 2020-04-22T14:19:52.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.005+0000 7f352ffff700 1 -- 172.21.15.103:0/1434505911 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3530062b70 con 0x7f35300b8410 2020-04-22T14:19:52.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.005+0000 7f352ffff700 1 --2- 172.21.15.103:0/1434505911 >> v2:172.21.15.103:3300/0 conn(0x7f35300b8410 0x7f3530152bf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f35200013e0 tx=0x7f35300b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.005+0000 7f352ffff700 1 --2- 172.21.15.103:0/1434505911 >> v2:172.21.15.103:3300/0 conn(0x7f35300b8410 0x7f3530152bf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f35200013e0 tx=0x7f35300b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.005+0000 7f352ffff700 1 --2- 172.21.15.103:0/1434505911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35300b8410 0x7f3530152bf0 secure :-1 s=READY pgs=2077 cs=0 l=1 rx=0x7f35200013e0 tx=0x7f35300b96b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:52.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.005+0000 7f352ffff700 1 --2- 172.21.15.103:0/1434505911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35300b8410 0x7f3530152bf0 secure :-1 s=THROTTLE_DONE pgs=2077 cs=0 l=1 rx=0x7f35200013e0 tx=0x7f35300b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.005+0000 7f352dffb700 1 -- 172.21.15.103:0/1434505911 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f352000e180 con 0x7f35300b8410 2020-04-22T14:19:52.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.005+0000 7f352ffff700 1 --2- 172.21.15.103:0/1434505911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35300b8410 0x7f3530152bf0 secure :-1 s=THROTTLE_DONE pgs=2077 cs=0 l=1 rx=0x7f35200013e0 tx=0x7f35300b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.005+0000 7f352ffff700 1 --2- 172.21.15.103:0/1434505911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35300b8410 0x7f3530152bf0 secure :-1 s=THROTTLE_DONE pgs=2077 cs=0 l=1 rx=0x7f35200013e0 tx=0x7f35300b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.005+0000 7f352dffb700 1 -- 172.21.15.103:0/1434505911 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352000e2e0 con 0x7f35300b8410 2020-04-22T14:19:52.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.005+0000 7f353654a700 1 -- 172.21.15.103:0/1434505911 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35300b87f0 con 0x7f35300b8410 2020-04-22T14:19:52.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.005+0000 7f352dffb700 1 -- 172.21.15.103:0/1434505911 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f352000e640 con 0x7f35300b8410 2020-04-22T14:19:52.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.005+0000 7f353654a700 1 -- 172.21.15.103:0/1434505911 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35301420e0 con 0x7f35300b8410 2020-04-22T14:19:52.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.005+0000 7f352ffff700 1 --2- 172.21.15.103:0/1434505911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35300b8410 0x7f3530152bf0 secure :-1 s=THROTTLE_DONE pgs=2077 cs=0 l=1 rx=0x7f35200013e0 tx=0x7f35300b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.006+0000 7f353654a700 1 -- 172.21.15.103:0/1434505911 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3530062d00 con 0x7f35300b8410 2020-04-22T14:19:52.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.006+0000 7f352dffb700 1 -- 172.21.15.103:0/1434505911 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f3520007280 con 0x7f35300b8410 2020-04-22T14:19:52.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.006+0000 7f352ffff700 1 --2- 172.21.15.103:0/1434505911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35300b8410 0x7f3530152bf0 secure :-1 s=THROTTLE_DONE pgs=2077 cs=0 l=1 rx=0x7f35200013e0 tx=0x7f35300b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.006+0000 7f352dffb700 1 --2- 172.21.15.103:0/1434505911 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f351404d880 0x7f351404fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:52.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.006+0000 7f352dffb700 1 -- 172.21.15.103:0/1434505911 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f35200613c0 con 0x7f35300b8410 2020-04-22T14:19:52.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.006+0000 7f3527fff700 1 --2- 172.21.15.103:0/1434505911 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f351404d880 0x7f351404fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:52.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.006+0000 7f3527fff700 1 --2- 172.21.15.103:0/1434505911 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f351404d880 0x7f351404fd40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f353012a970 tx=0x7f3518010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.007+0000 7f3527fff700 1 --2- 172.21.15.103:0/1434505911 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f351404d880 0x7f351404fd40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f353012a970 tx=0x7f3518010050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.007+0000 7f3527fff700 1 --2- 172.21.15.103:0/1434505911 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f351404d880 0x7f351404fd40 secure :-1 s=READY pgs=754 cs=0 l=1 rx=0x7f353012a970 tx=0x7f3518010050).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:52.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.010+0000 7f352ffff700 1 --2- 172.21.15.103:0/1434505911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35300b8410 0x7f3530152bf0 secure :-1 s=THROTTLE_DONE pgs=2077 cs=0 l=1 rx=0x7f35200013e0 tx=0x7f35300b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.010+0000 7f352dffb700 1 -- 172.21.15.103:0/1434505911 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f352003c740 con 0x7f35300b8410 2020-04-22T14:19:52.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.152+0000 7f353654a700 1 -- 172.21.15.103:0/1434505911 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3530056c90 con 0x7f35300b8410 2020-04-22T14:19:52.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.152+0000 7f352ffff700 1 --2- 172.21.15.103:0/1434505911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35300b8410 0x7f3530152bf0 secure :-1 s=THROTTLE_DONE pgs=2077 cs=0 l=1 rx=0x7f35200013e0 tx=0x7f35300b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.152+0000 7f352dffb700 1 -- 172.21.15.103:0/1434505911 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v146) v1 ==== 92+0+10 (secure 0 0 0) 0x7f352003fd60 con 0x7f35300b8410 2020-04-22T14:19:52.156 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:19:52.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.153+0000 7f353654a700 1 -- 172.21.15.103:0/1434505911 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f351404d880 msgr2=0x7f351404fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:52.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.153+0000 7f353654a700 1 --2- 172.21.15.103:0/1434505911 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f351404d880 0x7f351404fd40 secure :-1 s=READY pgs=754 cs=0 l=1 rx=0x7f353012a970 tx=0x7f3518010050).stop 2020-04-22T14:19:52.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.153+0000 7f353654a700 1 -- 172.21.15.103:0/1434505911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35300b8410 msgr2=0x7f3530152bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:52.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.153+0000 7f353654a700 1 --2- 172.21.15.103:0/1434505911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35300b8410 0x7f3530152bf0 secure :-1 s=READY pgs=2077 cs=0 l=1 rx=0x7f35200013e0 tx=0x7f35300b96b0).stop 2020-04-22T14:19:52.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.153+0000 7f353654a700 1 -- 172.21.15.103:0/1434505911 shutdown_connections 2020-04-22T14:19:52.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.153+0000 7f353654a700 1 --2- 172.21.15.103:0/1434505911 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f351404d880 0x7f351404fd40 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:52.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.153+0000 7f353654a700 1 --2- 172.21.15.103:0/1434505911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35300b8410 0x7f3530152bf0 unknown :-1 s=CLOSED pgs=2077 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:52.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.153+0000 7f353654a700 1 -- 172.21.15.103:0/1434505911 >> 172.21.15.103:0/1434505911 conn(0x7f353005b7b0 msgr2=0x7f35300b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:52.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.153+0000 7f353654a700 1 -- 172.21.15.103:0/1434505911 shutdown_connections 2020-04-22T14:19:52.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.154+0000 7f353654a700 1 -- 172.21.15.103:0/1434505911 wait complete. 2020-04-22T14:19:52.167 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:52.181 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-22T14:19:52.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.325+0000 7f5755888700 1 Processor -- start 2020-04-22T14:19:52.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.325+0000 7f5755888700 1 -- start start 2020-04-22T14:19:52.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.326+0000 7f5755888700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57500b9140 0x7f575012b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:52.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.326+0000 7f5755888700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f57500ac950 0x7f575012b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:52.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.326+0000 7f5755888700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5750146c40 0x7f57501470d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:52.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.326+0000 7f5755888700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5750147530 con 0x7f5750146c40 2020-04-22T14:19:52.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.326+0000 7f5755888700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57500602f0 con 0x7f57500ac950 2020-04-22T14:19:52.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.326+0000 7f5755888700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57501467e0 con 0x7f57500b9140 2020-04-22T14:19:52.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.326+0000 7f574e7fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f57500ac950 0x7f575012b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:52.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.326+0000 7f574e7fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f57500ac950 0x7f575012b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58516/0 (socket says 172.21.15.103:58516) 2020-04-22T14:19:52.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.326+0000 7f574e7fc700 1 -- 172.21.15.103:0/1446258936 learned_addr learned my addr 172.21.15.103:0/1446258936 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:19:52.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.326+0000 7f574effd700 1 --2- 172.21.15.103:0/1446258936 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57500b9140 0x7f575012b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:52.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.326+0000 7f574f7fe700 1 --2- 172.21.15.103:0/1446258936 >> v2:172.21.15.86:3300/0 conn(0x7f5750146c40 0x7f57501470d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:52.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.326+0000 7f574e7fc700 1 -- 172.21.15.103:0/1446258936 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57500b9140 msgr2=0x7f575012b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:52.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.326+0000 7f574e7fc700 1 --2- 172.21.15.103:0/1446258936 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57500b9140 0x7f575012b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:52.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.327+0000 7f574e7fc700 1 -- 172.21.15.103:0/1446258936 >> v2:172.21.15.86:3300/0 conn(0x7f5750146c40 msgr2=0x7f57501470d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:52.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.327+0000 7f574e7fc700 1 --2- 172.21.15.103:0/1446258936 >> v2:172.21.15.86:3300/0 conn(0x7f5750146c40 0x7f57501470d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:52.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.327+0000 7f574e7fc700 1 -- 172.21.15.103:0/1446258936 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5750060050 con 0x7f57500ac950 2020-04-22T14:19:52.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.327+0000 7f574e7fc700 1 --2- 172.21.15.103:0/1446258936 >> v2:172.21.15.103:3300/0 conn(0x7f57500ac950 0x7f575012b670 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5740002f30 tx=0x7f5740007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.327+0000 7f574e7fc700 1 --2- 172.21.15.103:0/1446258936 >> v2:172.21.15.103:3300/0 conn(0x7f57500ac950 0x7f575012b670 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5740002f30 tx=0x7f5740007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.327+0000 7f574e7fc700 1 --2- 172.21.15.103:0/1446258936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57500ac950 0x7f575012b670 secure :-1 s=READY pgs=2078 cs=0 l=1 rx=0x7f5740002f30 tx=0x7f5740007a40).ready entity=mon.1 client_cookie=d50d5bdf6be35822 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:52.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.327+0000 7f574e7fc700 1 --2- 172.21.15.103:0/1446258936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57500ac950 0x7f575012b670 secure :-1 s=THROTTLE_DONE pgs=2078 cs=0 l=1 rx=0x7f5740002f30 tx=0x7f5740007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.327+0000 7f574dffb700 1 -- 172.21.15.103:0/1446258936 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5740011720 con 0x7f57500ac950 2020-04-22T14:19:52.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.327+0000 7f574e7fc700 1 --2- 172.21.15.103:0/1446258936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57500ac950 0x7f575012b670 secure :-1 s=THROTTLE_DONE pgs=2078 cs=0 l=1 rx=0x7f5740002f30 tx=0x7f5740007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.327+0000 7f574e7fc700 1 --2- 172.21.15.103:0/1446258936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57500ac950 0x7f575012b670 secure :-1 s=THROTTLE_DONE pgs=2078 cs=0 l=1 rx=0x7f5740002f30 tx=0x7f5740007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.327+0000 7f574dffb700 1 -- 172.21.15.103:0/1446258936 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5740011880 con 0x7f57500ac950 2020-04-22T14:19:52.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.327+0000 7f574dffb700 1 -- 172.21.15.103:0/1446258936 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5740011ca0 con 0x7f57500ac950 2020-04-22T14:19:52.340 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.327+0000 7f5755888700 1 -- 172.21.15.103:0/1446258936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57500ac950 msgr2=0x7f575012b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:52.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.327+0000 7f5755888700 1 --2- 172.21.15.103:0/1446258936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57500ac950 0x7f575012b670 secure :-1 s=READY pgs=2078 cs=0 l=1 rx=0x7f5740002f30 tx=0x7f5740007a40).stop 2020-04-22T14:19:52.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.327+0000 7f5755888700 1 -- 172.21.15.103:0/1446258936 shutdown_connections 2020-04-22T14:19:52.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.327+0000 7f5755888700 1 --2- 172.21.15.103:0/1446258936 >> v2:172.21.15.86:3300/0 conn(0x7f5750146c40 0x7f57501470d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:52.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.327+0000 7f5755888700 1 --2- 172.21.15.103:0/1446258936 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57500b9140 0x7f575012b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:52.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.327+0000 7f5755888700 1 --2- 172.21.15.103:0/1446258936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57500ac950 0x7f575012b670 unknown :-1 s=CLOSED pgs=2078 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:52.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.327+0000 7f5755888700 1 -- 172.21.15.103:0/1446258936 >> 172.21.15.103:0/1446258936 conn(0x7f575005b7b0 msgr2=0x7f57500b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:52.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.327+0000 7f5755888700 1 -- 172.21.15.103:0/1446258936 shutdown_connections 2020-04-22T14:19:52.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.328+0000 7f5755888700 1 -- 172.21.15.103:0/1446258936 wait complete. 2020-04-22T14:19:52.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.328+0000 7f5755888700 1 Processor -- start 2020-04-22T14:19:52.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.329+0000 7f5755888700 1 -- start start 2020-04-22T14:19:52.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.329+0000 7f5755888700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57500ac950 0x7f57500b23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:52.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.329+0000 7f5755888700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f57500b9140 0x7f57500b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:52.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.329+0000 7f5755888700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f575013c1a0 con 0x7f5750146c40 2020-04-22T14:19:52.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.329+0000 7f5755888700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f575013c440 con 0x7f57500b9140 2020-04-22T14:19:52.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.329+0000 7f5755888700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f575013be90 con 0x7f57500ac950 2020-04-22T14:19:52.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.329+0000 7f574e7fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f57500b9140 0x7f57500b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:52.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.329+0000 7f574e7fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f57500b9140 0x7f57500b3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58524/0 (socket says 172.21.15.103:58524) 2020-04-22T14:19:52.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.329+0000 7f574e7fc700 1 -- 172.21.15.103:0/1578940423 learned_addr learned my addr 172.21.15.103:0/1578940423 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:19:52.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.329+0000 7f574effd700 1 --2- 172.21.15.103:0/1578940423 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57500ac950 0x7f57500b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:52.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.330+0000 7f574e7fc700 1 -- 172.21.15.103:0/1578940423 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57500ac950 msgr2=0x7f57500b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:52.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.330+0000 7f574e7fc700 1 --2- 172.21.15.103:0/1578940423 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57500ac950 0x7f57500b23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:52.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.330+0000 7f574e7fc700 1 -- 172.21.15.103:0/1578940423 >> v1:172.21.15.86:6789/0 conn(0x7f5750146c40 legacy=0x7f5750145530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:52.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.330+0000 7f574e7fc700 1 -- 172.21.15.103:0/1578940423 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5750145c40 con 0x7f57500b9140 2020-04-22T14:19:52.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.330+0000 7f574e7fc700 1 --2- 172.21.15.103:0/1578940423 >> v2:172.21.15.103:3300/0 conn(0x7f57500b9140 0x7f57500b3bf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5740002f30 tx=0x7f5740007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.346 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.330+0000 7f574e7fc700 1 --2- 172.21.15.103:0/1578940423 >> v2:172.21.15.103:3300/0 conn(0x7f57500b9140 0x7f57500b3bf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5740002f30 tx=0x7f5740007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.330+0000 7f574e7fc700 1 --2- 172.21.15.103:0/1578940423 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57500b9140 0x7f57500b3bf0 secure :-1 s=READY pgs=2079 cs=0 l=1 rx=0x7f5740002f30 tx=0x7f5740007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:52.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.330+0000 7f574e7fc700 1 --2- 172.21.15.103:0/1578940423 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57500b9140 0x7f57500b3bf0 secure :-1 s=THROTTLE_DONE pgs=2079 cs=0 l=1 rx=0x7f5740002f30 tx=0x7f5740007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.330+0000 7f573ffff700 1 -- 172.21.15.103:0/1578940423 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5740007170 con 0x7f57500b9140 2020-04-22T14:19:52.347 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.330+0000 7f574e7fc700 1 --2- 172.21.15.103:0/1578940423 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57500b9140 0x7f57500b3bf0 secure :-1 s=THROTTLE_DONE pgs=2079 cs=0 l=1 rx=0x7f5740002f30 tx=0x7f5740007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.330+0000 7f574e7fc700 1 --2- 172.21.15.103:0/1578940423 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57500b9140 0x7f57500b3bf0 secure :-1 s=THROTTLE_DONE pgs=2079 cs=0 l=1 rx=0x7f5740002f30 tx=0x7f5740007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.330+0000 7f573ffff700 1 -- 172.21.15.103:0/1578940423 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57400072d0 con 0x7f57500b9140 2020-04-22T14:19:52.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.330+0000 7f5755888700 1 -- 172.21.15.103:0/1578940423 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f575013b8a0 con 0x7f57500b9140 2020-04-22T14:19:52.348 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.330+0000 7f573ffff700 1 -- 172.21.15.103:0/1578940423 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57400056c0 con 0x7f57500b9140 2020-04-22T14:19:52.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.330+0000 7f5755888700 1 -- 172.21.15.103:0/1578940423 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57500b5e40 con 0x7f57500b9140 2020-04-22T14:19:52.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.330+0000 7f574e7fc700 1 --2- 172.21.15.103:0/1578940423 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57500b9140 0x7f57500b3bf0 secure :-1 s=THROTTLE_DONE pgs=2079 cs=0 l=1 rx=0x7f5740002f30 tx=0x7f5740007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.331+0000 7f5755888700 1 -- 172.21.15.103:0/1578940423 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f575013c640 con 0x7f57500b9140 2020-04-22T14:19:52.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.331+0000 7f573ffff700 1 -- 172.21.15.103:0/1578940423 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f5740005930 con 0x7f57500b9140 2020-04-22T14:19:52.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.331+0000 7f574e7fc700 1 --2- 172.21.15.103:0/1578940423 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57500b9140 0x7f57500b3bf0 secure :-1 s=THROTTLE_DONE pgs=2079 cs=0 l=1 rx=0x7f5740002f30 tx=0x7f5740007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.331+0000 7f573ffff700 1 --2- 172.21.15.103:0/1578940423 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f572c04da10 0x7f572c04fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:52.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.331+0000 7f573ffff700 1 -- 172.21.15.103:0/1578940423 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5740061ad0 con 0x7f57500b9140 2020-04-22T14:19:52.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.332+0000 7f574effd700 1 --2- 172.21.15.103:0/1578940423 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f572c04da10 0x7f572c04fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:52.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.332+0000 7f574effd700 1 --2- 172.21.15.103:0/1578940423 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f572c04da10 0x7f572c04fed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5744002f30 tx=0x7f574400d710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.332+0000 7f574effd700 1 --2- 172.21.15.103:0/1578940423 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f572c04da10 0x7f572c04fed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5744002f30 tx=0x7f574400d710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.332+0000 7f574effd700 1 --2- 172.21.15.103:0/1578940423 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f572c04da10 0x7f572c04fed0 secure :-1 s=READY pgs=755 cs=0 l=1 rx=0x7f5744002f30 tx=0x7f574400d710).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:52.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.335+0000 7f574e7fc700 1 --2- 172.21.15.103:0/1578940423 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57500b9140 0x7f57500b3bf0 secure :-1 s=THROTTLE_DONE pgs=2079 cs=0 l=1 rx=0x7f5740002f30 tx=0x7f5740007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.335+0000 7f573ffff700 1 -- 172.21.15.103:0/1578940423 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f574003cfd0 con 0x7f57500b9140 2020-04-22T14:19:52.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.480+0000 7f5755888700 1 -- 172.21.15.103:0/1578940423 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f575013bfd0 con 0x7f57500b9140 2020-04-22T14:19:52.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.481+0000 7f574e7fc700 1 --2- 172.21.15.103:0/1578940423 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57500b9140 0x7f57500b3bf0 secure :-1 s=THROTTLE_DONE pgs=2079 cs=0 l=1 rx=0x7f5740002f30 tx=0x7f5740007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.481+0000 7f573ffff700 1 -- 172.21.15.103:0/1578940423 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v146) v1 ==== 104+0+10 (secure 0 0 0) 0x7f57400405f0 con 0x7f57500b9140 2020-04-22T14:19:52.485 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:19:52.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.482+0000 7f5755888700 1 -- 172.21.15.103:0/1578940423 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f572c04da10 msgr2=0x7f572c04fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:52.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.482+0000 7f5755888700 1 --2- 172.21.15.103:0/1578940423 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f572c04da10 0x7f572c04fed0 secure :-1 s=READY pgs=755 cs=0 l=1 rx=0x7f5744002f30 tx=0x7f574400d710).stop 2020-04-22T14:19:52.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.482+0000 7f5755888700 1 -- 172.21.15.103:0/1578940423 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57500b9140 msgr2=0x7f57500b3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:52.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.482+0000 7f5755888700 1 --2- 172.21.15.103:0/1578940423 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57500b9140 0x7f57500b3bf0 secure :-1 s=READY pgs=2079 cs=0 l=1 rx=0x7f5740002f30 tx=0x7f5740007a40).stop 2020-04-22T14:19:52.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.482+0000 7f5755888700 1 -- 172.21.15.103:0/1578940423 shutdown_connections 2020-04-22T14:19:52.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.482+0000 7f5755888700 1 --2- 172.21.15.103:0/1578940423 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f572c04da10 0x7f572c04fed0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:52.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.482+0000 7f5755888700 1 --2- 172.21.15.103:0/1578940423 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57500ac950 0x7f57500b23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:52.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.482+0000 7f5755888700 1 --2- 172.21.15.103:0/1578940423 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57500b9140 0x7f57500b3bf0 unknown :-1 s=CLOSED pgs=2079 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:52.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.482+0000 7f5755888700 1 -- 172.21.15.103:0/1578940423 >> 172.21.15.103:0/1578940423 conn(0x7f575005b7b0 msgr2=0x7f57500b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:52.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.482+0000 7f5755888700 1 -- 172.21.15.103:0/1578940423 shutdown_connections 2020-04-22T14:19:52.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.482+0000 7f5755888700 1 -- 172.21.15.103:0/1578940423 wait complete. 2020-04-22T14:19:52.496 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:52.510 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-22T14:19:52.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.656+0000 7f2dfb889700 1 Processor -- start 2020-04-22T14:19:52.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.656+0000 7f2dfb889700 1 -- start start 2020-04-22T14:19:52.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.657+0000 7f2dfb889700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2df40b4820 0x7f2df40acb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:52.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.657+0000 7f2dfb889700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2df4141f20 0x7f2df41423d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:52.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.657+0000 7f2dfb889700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df40af030 con 0x7f2df4061a30 2020-04-22T14:19:52.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.657+0000 7f2dfb889700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2df4060250 con 0x7f2df4141f20 2020-04-22T14:19:52.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.657+0000 7f2dfb889700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df40623c0 con 0x7f2df40b4820 2020-04-22T14:19:52.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.657+0000 7f2df9e26700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2df4141f20 0x7f2df41423d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:52.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.657+0000 7f2df9625700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f2df4061a30 0x7f2df40ae920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50720/0 (socket says 172.21.15.103:50720) 2020-04-22T14:19:52.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.657+0000 7f2df9625700 1 -- 172.21.15.103:0/1735242961 learned_addr learned my addr 172.21.15.103:0/1735242961 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:52.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.657+0000 7f2df8e24700 1 --2- 172.21.15.103:0/1735242961 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2df40b4820 0x7f2df40acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:52.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.657+0000 7f2df9e26700 1 -- 172.21.15.103:0/1735242961 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2df40b4820 msgr2=0x7f2df40acb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:52.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.657+0000 7f2df9e26700 1 --2- 172.21.15.103:0/1735242961 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2df40b4820 0x7f2df40acb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:52.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.657+0000 7f2df9e26700 1 -- 172.21.15.103:0/1735242961 >> v1:172.21.15.103:6789/0 conn(0x7f2df4061a30 legacy=0x7f2df40ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:52.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.657+0000 7f2de3fff700 1 -- 172.21.15.103:0/1735242961 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2563411619 0 0) 0x7f2df40af030 con 0x7f2df4061a30 2020-04-22T14:19:52.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.657+0000 7f2df9e26700 1 -- 172.21.15.103:0/1735242961 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df4062660 con 0x7f2df4141f20 2020-04-22T14:19:52.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.657+0000 7f2df9e26700 1 --2- 172.21.15.103:0/1735242961 >> v2:172.21.15.103:3300/0 conn(0x7f2df4141f20 0x7f2df41423d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2dec0032b0 tx=0x7f2dec007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.657+0000 7f2df9e26700 1 --2- 172.21.15.103:0/1735242961 >> v2:172.21.15.103:3300/0 conn(0x7f2df4141f20 0x7f2df41423d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2dec0032b0 tx=0x7f2dec007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.657+0000 7f2df9e26700 1 --2- 172.21.15.103:0/1735242961 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2df4141f20 0x7f2df41423d0 secure :-1 s=READY pgs=2081 cs=0 l=1 rx=0x7f2dec0032b0 tx=0x7f2dec007dc0).ready entity=mon.1 client_cookie=74bc628ca4e42219 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:52.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.657+0000 7f2df9e26700 1 --2- 172.21.15.103:0/1735242961 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2df4141f20 0x7f2df41423d0 secure :-1 s=THROTTLE_DONE pgs=2081 cs=0 l=1 rx=0x7f2dec0032b0 tx=0x7f2dec007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.657+0000 7f2de3fff700 1 -- 172.21.15.103:0/1735242961 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dec00a180 con 0x7f2df4141f20 2020-04-22T14:19:52.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.657+0000 7f2df9e26700 1 --2- 172.21.15.103:0/1735242961 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2df4141f20 0x7f2df41423d0 secure :-1 s=THROTTLE_DONE pgs=2081 cs=0 l=1 rx=0x7f2dec0032b0 tx=0x7f2dec007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.657+0000 7f2df9e26700 1 --2- 172.21.15.103:0/1735242961 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2df4141f20 0x7f2df41423d0 secure :-1 s=THROTTLE_DONE pgs=2081 cs=0 l=1 rx=0x7f2dec0032b0 tx=0x7f2dec007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.657+0000 7f2de3fff700 1 -- 172.21.15.103:0/1735242961 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dec00a320 con 0x7f2df4141f20 2020-04-22T14:19:52.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.657+0000 7f2de3fff700 1 -- 172.21.15.103:0/1735242961 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dec00a700 con 0x7f2df4141f20 2020-04-22T14:19:52.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.657+0000 7f2dfb889700 1 -- 172.21.15.103:0/1735242961 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2df4141f20 msgr2=0x7f2df41423d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:52.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.657+0000 7f2dfb889700 1 --2- 172.21.15.103:0/1735242961 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2df4141f20 0x7f2df41423d0 secure :-1 s=READY pgs=2081 cs=0 l=1 rx=0x7f2dec0032b0 tx=0x7f2dec007dc0).stop 2020-04-22T14:19:52.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.658+0000 7f2dfb889700 1 -- 172.21.15.103:0/1735242961 shutdown_connections 2020-04-22T14:19:52.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.658+0000 7f2dfb889700 1 --2- 172.21.15.103:0/1735242961 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2df4141f20 0x7f2df41423d0 unknown :-1 s=CLOSED pgs=2081 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:52.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.658+0000 7f2dfb889700 1 --2- 172.21.15.103:0/1735242961 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2df40b4820 0x7f2df40acb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:52.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.658+0000 7f2dfb889700 1 -- 172.21.15.103:0/1735242961 >> 172.21.15.103:0/1735242961 conn(0x7f2df405b7b0 msgr2=0x7f2df40b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:52.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.658+0000 7f2dfb889700 1 -- 172.21.15.103:0/1735242961 shutdown_connections 2020-04-22T14:19:52.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.658+0000 7f2dfb889700 1 -- 172.21.15.103:0/1735242961 wait complete. 2020-04-22T14:19:52.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.659+0000 7f2dfb889700 1 Processor -- start 2020-04-22T14:19:52.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.659+0000 7f2dfb889700 1 -- start start 2020-04-22T14:19:52.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.659+0000 7f2dfb889700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2df4141f20 0x7f2df41417f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:52.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.660+0000 7f2dfb889700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df4065450 con 0x7f2df4061a30 2020-04-22T14:19:52.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.660+0000 7f2dfb889700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df4063710 con 0x7f2df40b4820 2020-04-22T14:19:52.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.660+0000 7f2dfb889700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df4141490 con 0x7f2df4141f20 2020-04-22T14:19:52.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.660+0000 7f2df8e24700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f2df40b4820 0x7f2df41432c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50724/0 (socket says 172.21.15.103:50724) 2020-04-22T14:19:52.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.660+0000 7f2df8e24700 1 -- 172.21.15.103:0/1739889729 learned_addr learned my addr 172.21.15.103:0/1739889729 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:52.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.660+0000 7f2df9e26700 1 --2- 172.21.15.103:0/1739889729 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2df4141f20 0x7f2df41417f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:52.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.660+0000 7f2de27fc700 1 -- 172.21.15.103:0/1739889729 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3413863311 0 0) 0x7f2df4063710 con 0x7f2df40b4820 2020-04-22T14:19:52.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.660+0000 7f2de27fc700 1 -- 172.21.15.103:0/1739889729 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dd4002fe0 con 0x7f2df40b4820 2020-04-22T14:19:52.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.660+0000 7f2de27fc700 1 -- 172.21.15.103:0/1739889729 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1830841559 0 0) 0x7f2df4065450 con 0x7f2df4061a30 2020-04-22T14:19:52.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.660+0000 7f2de27fc700 1 -- 172.21.15.103:0/1739889729 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2df4063710 con 0x7f2df4061a30 2020-04-22T14:19:52.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.660+0000 7f2de27fc700 1 -- 172.21.15.103:0/1739889729 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 719971662 0 0) 0x7f2dd4002fe0 con 0x7f2df40b4820 2020-04-22T14:19:52.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.660+0000 7f2de27fc700 1 -- 172.21.15.103:0/1739889729 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2df4065450 con 0x7f2df40b4820 2020-04-22T14:19:52.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.660+0000 7f2de27fc700 1 -- 172.21.15.103:0/1739889729 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f2de4001550 con 0x7f2df40b4820 2020-04-22T14:19:52.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.660+0000 7f2df9e26700 1 -- 172.21.15.103:0/1739889729 >> v1:172.21.15.103:6789/0 conn(0x7f2df40b4820 legacy=0x7f2df41432c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:52.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.660+0000 7f2df9e26700 1 -- 172.21.15.103:0/1739889729 >> v1:172.21.15.86:6789/0 conn(0x7f2df4061a30 legacy=0x7f2df4154430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:52.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.660+0000 7f2df9e26700 1 -- 172.21.15.103:0/1739889729 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df41411f0 con 0x7f2df4141f20 2020-04-22T14:19:52.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.660+0000 7f2df9e26700 1 --2- 172.21.15.103:0/1739889729 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2df4141f20 0x7f2df41417f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2df4066760 tx=0x7f2dec007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.660+0000 7f2df9e26700 1 --2- 172.21.15.103:0/1739889729 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2df4141f20 0x7f2df41417f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2df4066760 tx=0x7f2dec007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.660+0000 7f2df9e26700 1 --2- 172.21.15.103:0/1739889729 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2df4141f20 0x7f2df41417f0 secure :-1 s=READY pgs=192 cs=0 l=1 rx=0x7f2df4066760 tx=0x7f2dec007dc0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:52.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.660+0000 7f2df9e26700 1 --2- 172.21.15.103:0/1739889729 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2df4141f20 0x7f2df41417f0 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7f2df4066760 tx=0x7f2dec007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.680 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.660+0000 7f2de27fc700 1 -- 172.21.15.103:0/1739889729 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dec005a40 con 0x7f2df4141f20 2020-04-22T14:19:52.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.660+0000 7f2df9e26700 1 --2- 172.21.15.103:0/1739889729 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2df4141f20 0x7f2df41417f0 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7f2df4066760 tx=0x7f2dec007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.660+0000 7f2de27fc700 1 -- 172.21.15.103:0/1739889729 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dec005ba0 con 0x7f2df4141f20 2020-04-22T14:19:52.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.660+0000 7f2df9e26700 1 --2- 172.21.15.103:0/1739889729 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2df4141f20 0x7f2df41417f0 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7f2df4066760 tx=0x7f2dec007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.681 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.660+0000 7f2dfb889700 1 -- 172.21.15.103:0/1739889729 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df41449e0 con 0x7f2df4141f20 2020-04-22T14:19:52.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.660+0000 7f2de27fc700 1 -- 172.21.15.103:0/1739889729 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dec0110d0 con 0x7f2df4141f20 2020-04-22T14:19:52.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.661+0000 7f2dfb889700 1 -- 172.21.15.103:0/1739889729 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df4154b40 con 0x7f2df4141f20 2020-04-22T14:19:52.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.661+0000 7f2df9e26700 1 --2- 172.21.15.103:0/1739889729 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2df4141f20 0x7f2df41417f0 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7f2df4066760 tx=0x7f2dec007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.661+0000 7f2dfb889700 1 -- 172.21.15.103:0/1739889729 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df4056c90 con 0x7f2df4141f20 2020-04-22T14:19:52.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.661+0000 7f2de27fc700 1 -- 172.21.15.103:0/1739889729 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f2dec0112d0 con 0x7f2df4141f20 2020-04-22T14:19:52.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.661+0000 7f2df9e26700 1 --2- 172.21.15.103:0/1739889729 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2df4141f20 0x7f2df41417f0 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7f2df4066760 tx=0x7f2dec007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.662+0000 7f2de27fc700 1 --2- 172.21.15.103:0/1739889729 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2dd404e0a0 0x7f2dd4050560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:52.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.662+0000 7f2de27fc700 1 -- 172.21.15.103:0/1739889729 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2dec061a80 con 0x7f2df4141f20 2020-04-22T14:19:52.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.662+0000 7f2df9625700 1 --2- 172.21.15.103:0/1739889729 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2dd404e0a0 0x7f2dd4050560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:52.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.662+0000 7f2df9625700 1 --2- 172.21.15.103:0/1739889729 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2dd404e0a0 0x7f2dd4050560 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2df0000ee0 tx=0x7f2df0001650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.662+0000 7f2df9625700 1 --2- 172.21.15.103:0/1739889729 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2dd404e0a0 0x7f2dd4050560 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2df0000ee0 tx=0x7f2df0001650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.662+0000 7f2df9625700 1 --2- 172.21.15.103:0/1739889729 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2dd404e0a0 0x7f2dd4050560 secure :-1 s=READY pgs=756 cs=0 l=1 rx=0x7f2df0000ee0 tx=0x7f2df0001650).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:52.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.665+0000 7f2df9e26700 1 --2- 172.21.15.103:0/1739889729 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2df4141f20 0x7f2df41417f0 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7f2df4066760 tx=0x7f2dec007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.665+0000 7f2de27fc700 1 -- 172.21.15.103:0/1739889729 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f2dec03cf80 con 0x7f2df4141f20 2020-04-22T14:19:52.812 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.809+0000 7f2dfb889700 1 -- 172.21.15.103:0/1739889729 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2df40638a0 con 0x7f2df4141f20 2020-04-22T14:19:52.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.810+0000 7f2df9e26700 1 --2- 172.21.15.103:0/1739889729 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2df4141f20 0x7f2df41417f0 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7f2df4066760 tx=0x7f2dec007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:52.813 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.810+0000 7f2de27fc700 1 -- 172.21.15.103:0/1739889729 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v146) v1 ==== 100+0+10 (secure 0 0 0) 0x7f2dec0405a0 con 0x7f2df4141f20 2020-04-22T14:19:52.813 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:19:52.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.811+0000 7f2dfb889700 1 -- 172.21.15.103:0/1739889729 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2dd404e0a0 msgr2=0x7f2dd4050560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:52.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.811+0000 7f2dfb889700 1 --2- 172.21.15.103:0/1739889729 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2dd404e0a0 0x7f2dd4050560 secure :-1 s=READY pgs=756 cs=0 l=1 rx=0x7f2df0000ee0 tx=0x7f2df0001650).stop 2020-04-22T14:19:52.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.811+0000 7f2dfb889700 1 -- 172.21.15.103:0/1739889729 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2df4141f20 msgr2=0x7f2df41417f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:52.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.811+0000 7f2dfb889700 1 --2- 172.21.15.103:0/1739889729 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2df4141f20 0x7f2df41417f0 secure :-1 s=READY pgs=192 cs=0 l=1 rx=0x7f2df4066760 tx=0x7f2dec007dc0).stop 2020-04-22T14:19:52.815 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.811+0000 7f2dfb889700 1 -- 172.21.15.103:0/1739889729 shutdown_connections 2020-04-22T14:19:52.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.811+0000 7f2dfb889700 1 --2- 172.21.15.103:0/1739889729 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2dd404e0a0 0x7f2dd4050560 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:52.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.811+0000 7f2dfb889700 1 --2- 172.21.15.103:0/1739889729 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2df4141f20 0x7f2df41417f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:52.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.811+0000 7f2dfb889700 1 -- 172.21.15.103:0/1739889729 >> 172.21.15.103:0/1739889729 conn(0x7f2df405b7b0 msgr2=0x7f2df40b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:52.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.812+0000 7f2dfb889700 1 -- 172.21.15.103:0/1739889729 shutdown_connections 2020-04-22T14:19:52.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.812+0000 7f2dfb889700 1 -- 172.21.15.103:0/1739889729 wait complete. 2020-04-22T14:19:52.825 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-04-22T14:19:52.825 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:52.840 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:19:52.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.983+0000 7f087e769700 1 Processor -- start 2020-04-22T14:19:52.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.983+0000 7f087e769700 1 -- start start 2020-04-22T14:19:53.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.984+0000 7f087e769700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f087812c0d0 0x7f08781464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:53.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.984+0000 7f087e769700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0878065fe0 0x7f087805b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:53.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.984+0000 7f087e769700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0878143300 con 0x7f087805b8a0 2020-04-22T14:19:53.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.984+0000 7f087e769700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f087812c4b0 con 0x7f087812c0d0 2020-04-22T14:19:53.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.984+0000 7f087e769700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08781435a0 con 0x7f0878065fe0 2020-04-22T14:19:53.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.984+0000 7f0877fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f087812c0d0 0x7f08781464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:53.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.984+0000 7f087cd06700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f087805b8a0 0x7f0878062ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50732/0 (socket says 172.21.15.103:50732) 2020-04-22T14:19:53.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.984+0000 7f087cd06700 1 -- 172.21.15.103:0/312005755 learned_addr learned my addr 172.21.15.103:0/312005755 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:53.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.984+0000 7f08777fe700 1 --2- 172.21.15.103:0/312005755 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0878065fe0 0x7f087805b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:53.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.984+0000 7f0877fff700 1 -- 172.21.15.103:0/312005755 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0878065fe0 msgr2=0x7f087805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:53.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.984+0000 7f0877fff700 1 --2- 172.21.15.103:0/312005755 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0878065fe0 0x7f087805b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:53.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.984+0000 7f0877fff700 1 -- 172.21.15.103:0/312005755 >> v1:172.21.15.103:6789/0 conn(0x7f087805b8a0 legacy=0x7f0878062ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:53.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.984+0000 7f0877fff700 1 -- 172.21.15.103:0/312005755 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0878143840 con 0x7f087812c0d0 2020-04-22T14:19:53.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.984+0000 7f0876ffd700 1 -- 172.21.15.103:0/312005755 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3120078703 0 0) 0x7f0878143300 con 0x7f087805b8a0 2020-04-22T14:19:53.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.985+0000 7f0877fff700 1 --2- 172.21.15.103:0/312005755 >> v2:172.21.15.103:3300/0 conn(0x7f087812c0d0 0x7f08781464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0868002f30 tx=0x7f0868007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:53.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.985+0000 7f0877fff700 1 --2- 172.21.15.103:0/312005755 >> v2:172.21.15.103:3300/0 conn(0x7f087812c0d0 0x7f08781464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0868002f30 tx=0x7f0868007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:53.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.985+0000 7f0877fff700 1 --2- 172.21.15.103:0/312005755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f087812c0d0 0x7f08781464e0 secure :-1 s=READY pgs=2084 cs=0 l=1 rx=0x7f0868002f30 tx=0x7f0868007a40).ready entity=mon.1 client_cookie=e8dddccbd821b652 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:53.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.985+0000 7f0877fff700 1 --2- 172.21.15.103:0/312005755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f087812c0d0 0x7f08781464e0 secure :-1 s=THROTTLE_DONE pgs=2084 cs=0 l=1 rx=0x7f0868002f30 tx=0x7f0868007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:53.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.985+0000 7f0876ffd700 1 -- 172.21.15.103:0/312005755 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0868011470 con 0x7f087812c0d0 2020-04-22T14:19:53.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.985+0000 7f0877fff700 1 --2- 172.21.15.103:0/312005755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f087812c0d0 0x7f08781464e0 secure :-1 s=THROTTLE_DONE pgs=2084 cs=0 l=1 rx=0x7f0868002f30 tx=0x7f0868007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:53.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.985+0000 7f0877fff700 1 --2- 172.21.15.103:0/312005755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f087812c0d0 0x7f08781464e0 secure :-1 s=THROTTLE_DONE pgs=2084 cs=0 l=1 rx=0x7f0868002f30 tx=0x7f0868007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:53.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.985+0000 7f0876ffd700 1 -- 172.21.15.103:0/312005755 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0868011610 con 0x7f087812c0d0 2020-04-22T14:19:53.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.985+0000 7f0876ffd700 1 -- 172.21.15.103:0/312005755 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08680119f0 con 0x7f087812c0d0 2020-04-22T14:19:53.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.985+0000 7f087e769700 1 -- 172.21.15.103:0/312005755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f087812c0d0 msgr2=0x7f08781464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:53.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.985+0000 7f087e769700 1 --2- 172.21.15.103:0/312005755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f087812c0d0 0x7f08781464e0 secure :-1 s=READY pgs=2084 cs=0 l=1 rx=0x7f0868002f30 tx=0x7f0868007a40).stop 2020-04-22T14:19:53.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.985+0000 7f087e769700 1 -- 172.21.15.103:0/312005755 shutdown_connections 2020-04-22T14:19:53.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.985+0000 7f087e769700 1 --2- 172.21.15.103:0/312005755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f087812c0d0 0x7f08781464e0 unknown :-1 s=CLOSED pgs=2084 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:53.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.985+0000 7f087e769700 1 --2- 172.21.15.103:0/312005755 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0878065fe0 0x7f087805b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:53.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.985+0000 7f087e769700 1 -- 172.21.15.103:0/312005755 >> 172.21.15.103:0/312005755 conn(0x7f08780b9160 msgr2=0x7f087805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:53.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.985+0000 7f087e769700 1 -- 172.21.15.103:0/312005755 shutdown_connections 2020-04-22T14:19:53.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.985+0000 7f087e769700 1 -- 172.21.15.103:0/312005755 wait complete. 2020-04-22T14:19:53.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.986+0000 7f087e769700 1 Processor -- start 2020-04-22T14:19:53.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.986+0000 7f087e769700 1 -- start start 2020-04-22T14:19:53.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.987+0000 7f087e769700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f087805b8a0 0x7f08780b0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:53.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.987+0000 7f087e769700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f087812c0d0 0x7f08780adb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:53.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.987+0000 7f087e769700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08780b0fa0 con 0x7f0878065fe0 2020-04-22T14:19:53.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.987+0000 7f087e769700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08780b1240 con 0x7f087805b8a0 2020-04-22T14:19:53.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.987+0000 7f087e769700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08780ac820 con 0x7f087812c0d0 2020-04-22T14:19:53.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.987+0000 7f08777fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f0878065fe0 0x7f0878142070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50738/0 (socket says 172.21.15.103:50738) 2020-04-22T14:19:53.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.987+0000 7f08777fe700 1 -- 172.21.15.103:0/1039837175 learned_addr learned my addr 172.21.15.103:0/1039837175 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:53.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.987+0000 7f0877fff700 1 --2- 172.21.15.103:0/1039837175 >> v2:172.21.15.86:3300/0 conn(0x7f087805b8a0 0x7f08780b0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:53.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.987+0000 7f08757fa700 1 -- 172.21.15.103:0/1039837175 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3199582575 0 0) 0x7f08780b0fa0 con 0x7f0878065fe0 2020-04-22T14:19:53.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.987+0000 7f087cd06700 1 --2- 172.21.15.103:0/1039837175 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f087812c0d0 0x7f08780adb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:53.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.987+0000 7f08757fa700 1 -- 172.21.15.103:0/1039837175 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0858002fe0 con 0x7f0878065fe0 2020-04-22T14:19:53.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.987+0000 7f08757fa700 1 -- 172.21.15.103:0/1039837175 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2565343498 0 0) 0x7f0858002fe0 con 0x7f0878065fe0 2020-04-22T14:19:53.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.987+0000 7f08757fa700 1 -- 172.21.15.103:0/1039837175 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f08780b0fa0 con 0x7f0878065fe0 2020-04-22T14:19:53.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.987+0000 7f08757fa700 1 -- 172.21.15.103:0/1039837175 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f086c0025c0 con 0x7f0878065fe0 2020-04-22T14:19:53.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.988+0000 7f08757fa700 1 -- 172.21.15.103:0/1039837175 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f087812c0d0 msgr2=0x7f08780adb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:53.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.988+0000 7f08757fa700 1 --2- 172.21.15.103:0/1039837175 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f087812c0d0 0x7f08780adb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:53.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.988+0000 7f08757fa700 1 -- 172.21.15.103:0/1039837175 >> v2:172.21.15.86:3300/0 conn(0x7f087805b8a0 msgr2=0x7f08780b0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:53.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.988+0000 7f08757fa700 1 --2- 172.21.15.103:0/1039837175 >> v2:172.21.15.86:3300/0 conn(0x7f087805b8a0 0x7f08780b0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:53.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.988+0000 7f08757fa700 1 -- 172.21.15.103:0/1039837175 >> v1:172.21.15.103:6789/0 conn(0x7f0878065fe0 legacy=0x7f0878142070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:53.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.988+0000 7f08757fa700 1 --2- 172.21.15.103:0/1039837175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08580049b0 0x7f0858004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:53.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.988+0000 7f08757fa700 1 --2- 172.21.15.103:0/1039837175 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f087812c0d0 0x7f0858003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:53.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.988+0000 7f08757fa700 1 --2- 172.21.15.103:0/1039837175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0858003d80 0x7f0858004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:53.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.988+0000 7f08757fa700 1 -- 172.21.15.103:0/1039837175 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08780b1240 con 0x7f08580049b0 2020-04-22T14:19:53.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.988+0000 7f08757fa700 1 -- 172.21.15.103:0/1039837175 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08780ac820 con 0x7f0858003d80 2020-04-22T14:19:53.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.988+0000 7f08757fa700 1 -- 172.21.15.103:0/1039837175 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0858005340 con 0x7f087812c0d0 2020-04-22T14:19:53.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.988+0000 7f0877fff700 1 --2- 172.21.15.103:0/1039837175 >> v2:172.21.15.86:3300/0 conn(0x7f087805b8a0 0x7f08780b0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:19:53.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.988+0000 7f087cd06700 1 --2- 172.21.15.103:0/1039837175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0858003d80 0x7f0858004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:53.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.988+0000 7f08777fe700 1 --2- 172.21.15.103:0/1039837175 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f087812c0d0 0x7f0858003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:53.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.988+0000 7f0877fff700 1 --2- 172.21.15.103:0/1039837175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08580049b0 0x7f0858004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:53.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.988+0000 7f087cd06700 1 -- 172.21.15.103:0/1039837175 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f087812c0d0 msgr2=0x7f0858003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:53.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.988+0000 7f087cd06700 1 --2- 172.21.15.103:0/1039837175 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f087812c0d0 0x7f0858003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:53.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.988+0000 7f087cd06700 1 -- 172.21.15.103:0/1039837175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08580049b0 msgr2=0x7f0858004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:53.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.988+0000 7f087cd06700 1 --2- 172.21.15.103:0/1039837175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08580049b0 0x7f0858004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:53.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.988+0000 7f087cd06700 1 -- 172.21.15.103:0/1039837175 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0878142780 con 0x7f0858003d80 2020-04-22T14:19:53.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.988+0000 7f0877fff700 1 --2- 172.21.15.103:0/1039837175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08580049b0 0x7f0858004dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:19:53.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.988+0000 7f087e769700 1 -- 172.21.15.103:0/1039837175 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08780adb70 con 0x7f0858003d80 2020-04-22T14:19:53.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.988+0000 7f08777fe700 1 --2- 172.21.15.103:0/1039837175 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f087812c0d0 0x7f0858003920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:19:53.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.988+0000 7f087cd06700 1 --2- 172.21.15.103:0/1039837175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0858003d80 0x7f0858004200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0870001210 tx=0x7f087000c950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:53.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.988+0000 7f087e769700 1 -- 172.21.15.103:0/1039837175 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08780b0960 con 0x7f0858003d80 2020-04-22T14:19:53.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.988+0000 7f087cd06700 1 --2- 172.21.15.103:0/1039837175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0858003d80 0x7f0858004200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0870001210 tx=0x7f087000c950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:53.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.988+0000 7f087cd06700 1 --2- 172.21.15.103:0/1039837175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0858003d80 0x7f0858004200 secure :-1 s=READY pgs=2086 cs=0 l=1 rx=0x7f0870001210 tx=0x7f087000c950).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:53.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.988+0000 7f087cd06700 1 --2- 172.21.15.103:0/1039837175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0858003d80 0x7f0858004200 secure :-1 s=THROTTLE_DONE pgs=2086 cs=0 l=1 rx=0x7f0870001210 tx=0x7f087000c950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:53.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.988+0000 7f08757fa700 1 -- 172.21.15.103:0/1039837175 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f087000cd90 con 0x7f0858003d80 2020-04-22T14:19:53.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.988+0000 7f087cd06700 1 --2- 172.21.15.103:0/1039837175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0858003d80 0x7f0858004200 secure :-1 s=THROTTLE_DONE pgs=2086 cs=0 l=1 rx=0x7f0870001210 tx=0x7f087000c950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:53.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.988+0000 7f08757fa700 1 -- 172.21.15.103:0/1039837175 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0870011960 con 0x7f0858003d80 2020-04-22T14:19:53.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.988+0000 7f087cd06700 1 --2- 172.21.15.103:0/1039837175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0858003d80 0x7f0858004200 secure :-1 s=THROTTLE_DONE pgs=2086 cs=0 l=1 rx=0x7f0870001210 tx=0x7f087000c950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:53.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.988+0000 7f08757fa700 1 -- 172.21.15.103:0/1039837175 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0870011d00 con 0x7f0858003d80 2020-04-22T14:19:53.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.989+0000 7f087cd06700 1 --2- 172.21.15.103:0/1039837175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0858003d80 0x7f0858004200 secure :-1 s=THROTTLE_DONE pgs=2086 cs=0 l=1 rx=0x7f0870001210 tx=0x7f087000c950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:53.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.989+0000 7f087e769700 1 -- 172.21.15.103:0/1039837175 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0854003340 con 0x7f0858003d80 2020-04-22T14:19:53.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.989+0000 7f08757fa700 1 -- 172.21.15.103:0/1039837175 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f0870005940 con 0x7f0858003d80 2020-04-22T14:19:53.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.989+0000 7f087cd06700 1 --2- 172.21.15.103:0/1039837175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0858003d80 0x7f0858004200 secure :-1 s=THROTTLE_DONE pgs=2086 cs=0 l=1 rx=0x7f0870001210 tx=0x7f087000c950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:53.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.990+0000 7f08757fa700 1 --2- 172.21.15.103:0/1039837175 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0858055b20 0x7f0858057fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:53.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.990+0000 7f08757fa700 1 -- 172.21.15.103:0/1039837175 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0870061250 con 0x7f0858003d80 2020-04-22T14:19:53.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.990+0000 7f0877fff700 1 --2- 172.21.15.103:0/1039837175 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0858055b20 0x7f0858057fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:53.015 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.990+0000 7f0877fff700 1 --2- 172.21.15.103:0/1039837175 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0858055b20 0x7f0858057fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0868002f30 tx=0x7f0868007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:53.015 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.990+0000 7f0877fff700 1 --2- 172.21.15.103:0/1039837175 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0858055b20 0x7f0858057fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0868002f30 tx=0x7f0868007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:53.015 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.990+0000 7f0877fff700 1 --2- 172.21.15.103:0/1039837175 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0858055b20 0x7f0858057fe0 secure :-1 s=READY pgs=757 cs=0 l=1 rx=0x7f0868002f30 tx=0x7f0868007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:53.015 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.994+0000 7f087cd06700 1 --2- 172.21.15.103:0/1039837175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0858003d80 0x7f0858004200 secure :-1 s=THROTTLE_DONE pgs=2086 cs=0 l=1 rx=0x7f0870001210 tx=0x7f087000c950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:53.015 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:52.994+0000 7f08757fa700 1 -- 172.21.15.103:0/1039837175 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f087003c690 con 0x7f0858003d80 2020-04-22T14:19:53.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:53.183+0000 7f087e769700 1 -- 172.21.15.103:0/1039837175 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08540036e0 con 0x7f0858003d80 2020-04-22T14:19:53.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:53.184+0000 7f087cd06700 1 --2- 172.21.15.103:0/1039837175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0858003d80 0x7f0858004200 secure :-1 s=THROTTLE_DONE pgs=2086 cs=0 l=1 rx=0x7f0870001210 tx=0x7f087000c950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:53.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:53.184+0000 7f08757fa700 1 -- 172.21.15.103:0/1039837175 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) v1 ==== 95+0+2146 (secure 0 0 0) 0x7f087003fcb0 con 0x7f0858003d80 2020-04-22T14:19:53.188 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:19:53.188 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":107,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6743,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2675694784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2675694784},{"type":"v1","addr":"172.21.15.86:6835","nonce":2675694784}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":104}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:19:46.112631+0000","modified":"2020-04-22T14:19:48.115224+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9703},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9703":{"gid":9703,"name":"a","rank":0,"incarnation":105,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/839133818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":839133818},{"type":"v1","addr":"172.21.15.103:6833","nonce":839133818}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-04-22T14:19:53.189 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:53.185+0000 7f087e769700 1 -- 172.21.15.103:0/1039837175 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0858055b20 msgr2=0x7f0858057fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:53.189 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:53.185+0000 7f087e769700 1 --2- 172.21.15.103:0/1039837175 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0858055b20 0x7f0858057fe0 secure :-1 s=READY pgs=757 cs=0 l=1 rx=0x7f0868002f30 tx=0x7f0868007a40).stop 2020-04-22T14:19:53.190 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:53.185+0000 7f087e769700 1 -- 172.21.15.103:0/1039837175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0858003d80 msgr2=0x7f0858004200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:53.190 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:53.185+0000 7f087e769700 1 --2- 172.21.15.103:0/1039837175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0858003d80 0x7f0858004200 secure :-1 s=READY pgs=2086 cs=0 l=1 rx=0x7f0870001210 tx=0x7f087000c950).stop 2020-04-22T14:19:53.190 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:53.185+0000 7f087cd06700 1 -- 172.21.15.103:0/1039837175 reap_dead start 2020-04-22T14:19:53.191 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:53.185+0000 7f087cd06700 1 -- 172.21.15.103:0/1039837175 reap_dead start 2020-04-22T14:19:53.191 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:53.185+0000 7f087e769700 1 -- 172.21.15.103:0/1039837175 shutdown_connections 2020-04-22T14:19:53.191 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:53.185+0000 7f087e769700 1 -- 172.21.15.103:0/1039837175 >> 172.21.15.103:0/1039837175 conn(0x7f08780b9160 msgr2=0x7f08780b7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:53.191 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:53.185+0000 7f087e769700 1 -- 172.21.15.103:0/1039837175 shutdown_connections 2020-04-22T14:19:53.191 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:53.185+0000 7f087e769700 1 -- 172.21.15.103:0/1039837175 wait complete. 2020-04-22T14:19:53.192 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 107 2020-04-22T14:19:53.402 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 9703}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 25, u'failed': [], u'epoch': 107, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [26], u'info': {u'gid_9703': {u'export_targets': [], u'name': u'a', u'incarnation': 105, u'state_seq': 3, u'state': u'up:active', u'gid': 9703, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 839133818, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 839133818, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/839133818'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:19:46.112631+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:19:48.115224+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:19:53.402 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:19:53.403 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:53.416 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:19:53.576 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:19:53.576 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:19:53.576 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:19:53.576 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 9703, 2020-04-22T14:19:53.576 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:19:53.577 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:19:53.577 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 7.4599042840000003, 2020-04-22T14:19:53.577 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 107, 2020-04-22T14:19:53.577 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 146, 2020-04-22T14:19:53.577 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 146, 2020-04-22T14:19:53.577 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 12.671025918 2020-04-22T14:19:53.577 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:19:53.584 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 9703, "want_state": "up:active", "state": "up:active", "rank_uptime": 7.4599042840000003, "mdsmap_epoch": 107, "osdmap_epoch": 146, "osdmap_epoch_barrier": 146, "uptime": 12.671025918 } 2020-04-22T14:19:53.585 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-04-22T14:19:53.585 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:19:53.585 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:53.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:53.599 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:19:53.658 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:19:53.658 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:19:53.658 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:19:53.659 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:19:53.659 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:19:53.659 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:19:53.659 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:19:53.659 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:19:53.659 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:19:53.659 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:19:53.660 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:19:53.660 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:19:53.660 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:19:53.660 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:19:53.660 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:19:53.660 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 41647sec preferred_lft 41647sec 2020-04-22T14:19:53.660 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:19:53.661 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:19:53.661 INFO:teuthology.orchestra.run.smithi103.stdout:44: brx.4@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:19:53.661 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether ce:62:6d:2c:c1:6d brd ff:ff:ff:ff:ff:ff link-netnsid 4 2020-04-22T14:19:53.661 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-04-22T14:19:53.661 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:53.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:53.717 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:19:53.794 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:53.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:53.844 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge con-name ceph-brx ifname ceph-brx stp no' 2020-04-22T14:19:53.955 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' (ceeb966f-6807-4e5c-804a-9a614abf7ae3) successfully added. 2020-04-22T14:19:53.955 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:53.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:53.977 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection modify ceph-brx ipv4.addresses 192.168.255.254/16 ipv4.method manual' 2020-04-22T14:19:54.097 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:54.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:54.119 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up ceph-brx' 2020-04-22T14:19:54.235 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (master waiting for slaves) (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/57) 2020-04-22T14:19:54.236 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:54.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:54.251 INFO:teuthology.orchestra.run.smithi103:> touch /tmp/python-ceph-brx 2020-04-22T14:19:54.312 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:54.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:54.363 INFO:teuthology.orchestra.run.smithi103:> cat /proc/sys/net/ipv4/ip_forward 2020-04-22T14:19:54.422 INFO:teuthology.orchestra.run.smithi103.stdout:0 2020-04-22T14:19:54.423 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:54.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:54.470 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 0 > /tmp/python-ceph-brx' 2020-04-22T14:19:54.551 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:54.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:54.599 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 1 > /proc/sys/net/ipv4/ip_forward' 2020-04-22T14:19:54.675 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:54.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:54.727 INFO:teuthology.orchestra.run.smithi103:> route 2020-04-22T14:19:54.789 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2020-04-22T14:19:54.789 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-04-22T14:19:54.789 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 102 0 0 enp3s0f1 2020-04-22T14:19:54.789 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 102 0 0 enp3s0f1 2020-04-22T14:19:54.789 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 425 0 0 ceph-brx 2020-04-22T14:19:54.790 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:54.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:54.841 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-04-22T14:19:54.916 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:54.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:54.964 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-04-22T14:19:55.045 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:55.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:55.088 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-04-22T14:19:55.164 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:55.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:55.215 INFO:teuthology.orchestra.run.smithi103:> ip netns list 2020-04-22T14:19:55.270 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:55.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:55.322 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:19:55.382 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 4 2020-04-22T14:19:55.382 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:55.388 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:19:55.405 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:19:55.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:55.430 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:19:55.447 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:55.484 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:19:55.506 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:55.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:55.554 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0' 2020-04-22T14:19:55.630 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-04-22T14:19:55.630 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:55.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:55.699 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0' 2020-04-22T14:19:55.782 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:55.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:55.825 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0' 2020-04-22T14:19:55.933 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:55.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:55.946 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up' 2020-04-22T14:19:56.107 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:56.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:56.121 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up' 2020-04-22T14:19:56.229 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:56.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:56.257 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254' 2020-04-22T14:19:56.365 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:56.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:56.379 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:19:56.459 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:56.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:56.506 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge-slave con-name brx.0 ifname brx.0 master ceph-brx' 2020-04-22T14:19:56.614 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.0' (71512272-2959-448d-9843-f3fe92523303) successfully added. 2020-04-22T14:19:56.615 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:56.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:19:56.645 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up brx.0' 2020-04-22T14:19:56.802 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/58) 2020-04-22T14:19:56.853 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-04-22T14:19:56.853 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi103.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-04-22T14:19:56.853 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:56.881 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:19:56.881 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:19:56.939 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:56.988 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:19:56.988 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:19:57.056 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:19:57.063 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:19:57.064 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:57.109 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:19:57.109 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:19:57.168 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-04-22T14:19:57.168 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:57.216 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:19:57.258 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:57.271 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:19:57.271 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:19:57.341 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:19:57.347 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:2020-04-22T14:19:57.344+0000 7fc2d96ce1c0 -1 init, newargv = 0x560647a6bc10 newargc=9 2020-04-22T14:19:57.347 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[122752]: starting ceph client 2020-04-22T14:19:57.348 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:19:57.349 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:57.351 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[122752]: starting fuse 2020-04-22T14:19:57.364 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:19:57.364 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:19:57.423 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:19:57.423 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2020-04-22T14:19:57.423 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:57.472 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:19:57.472 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:19:57.472 INFO:teuthology.orchestra.run.smithi103:> import glob 2020-04-22T14:19:57.472 INFO:teuthology.orchestra.run.smithi103:> import re 2020-04-22T14:19:57.472 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:19:57.473 INFO:teuthology.orchestra.run.smithi103:> import subprocess 2020-04-22T14:19:57.473 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:19:57.473 INFO:teuthology.orchestra.run.smithi103:> def find_socket(client_name): 2020-04-22T14:19:57.473 INFO:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-04-22T14:19:57.473 INFO:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2020-04-22T14:19:57.473 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:19:57.473 INFO:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2020-04-22T14:19:57.474 INFO:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2020-04-22T14:19:57.474 INFO:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2020-04-22T14:19:57.474 INFO:teuthology.orchestra.run.smithi103:> return files[0] 2020-04-22T14:19:57.474 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:19:57.474 INFO:teuthology.orchestra.run.smithi103:> for f in files: 2020-04-22T14:19:57.474 INFO:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:19:57.475 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:19:57.475 INFO:teuthology.orchestra.run.smithi103:> return f 2020-04-22T14:19:57.475 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:19:57.475 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:19:57.475 INFO:teuthology.orchestra.run.smithi103:> print(find_socket("client.0")) 2020-04-22T14:19:57.475 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:19:57.580 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.0.122752.asok 2020-04-22T14:19:57.580 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.122752.asok 2020-04-22T14:19:57.580 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:57.594 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:19:57.594 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.122752.asok status 2020-04-22T14:19:57.752 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:19:57.752 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2020-04-22T14:19:57.752 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:19:57.752 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:19:57.753 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "0", 2020-04-22T14:19:57.753 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:19:57.753 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-04-22T14:19:57.753 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "122752", 2020-04-22T14:19:57.753 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:19:57.753 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:57.753 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2020-04-22T14:19:57.754 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2020-04-22T14:19:57.754 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 9904, 2020-04-22T14:19:57.754 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2020-04-22T14:19:57.754 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:19:57.754 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:19:57.754 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 9904 2020-04-22T14:19:57.754 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:57.754 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:19:57.755 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:19:57.755 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:19:57.755 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 3303065033 2020-04-22T14:19:57.755 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:19:57.755 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:57.755 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:19:57.755 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:19:57.756 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:19:57.756 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 3303065033 2020-04-22T14:19:57.756 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:19:57.756 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.9904 192.168.0.1:0/3303065033", 2020-04-22T14:19:57.756 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.1:0/3303065033", 2020-04-22T14:19:57.756 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2020-04-22T14:19:57.756 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 107, 2020-04-22T14:19:57.757 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 146, 2020-04-22T14:19:57.757 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2020-04-22T14:19:57.757 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklisted": false 2020-04-22T14:19:57.757 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:19:57.757 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:57.771 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:19:57.771 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-22T14:19:57.771 INFO:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:19:57.829 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2020-04-22T14:19:57.830 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-04-22T14:19:57.830 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:57.879 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:19:57.879 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:19:57.955 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:58.000 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:19:58.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.142+0000 7fe5608c2700 1 Processor -- start 2020-04-22T14:19:58.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.142+0000 7fe5608c2700 1 -- start start 2020-04-22T14:19:58.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.143+0000 7fe5608c2700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe55c12c0d0 0x7fe55c1464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:58.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.143+0000 7fe5608c2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe55c065fe0 0x7fe55c05b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:58.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.143+0000 7fe5608c2700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe55c143300 con 0x7fe55c05b8a0 2020-04-22T14:19:58.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.143+0000 7fe5608c2700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe55c12c4b0 con 0x7fe55c065fe0 2020-04-22T14:19:58.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.143+0000 7fe5608c2700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c1435a0 con 0x7fe55c12c0d0 2020-04-22T14:19:58.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.143+0000 7fe559d9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe55c065fe0 0x7fe55c05b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:58.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.143+0000 7fe559d9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe55c065fe0 0x7fe55c05b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58574/0 (socket says 172.21.15.103:58574) 2020-04-22T14:19:58.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.143+0000 7fe559d9b700 1 -- 172.21.15.103:0/3968518276 learned_addr learned my addr 172.21.15.103:0/3968518276 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:19:58.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.143+0000 7fe55a59c700 1 --2- 172.21.15.103:0/3968518276 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe55c12c0d0 0x7fe55c1464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:58.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.143+0000 7fe559d9b700 1 -- 172.21.15.103:0/3968518276 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe55c12c0d0 msgr2=0x7fe55c1464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:58.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.143+0000 7fe559d9b700 1 --2- 172.21.15.103:0/3968518276 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe55c12c0d0 0x7fe55c1464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:58.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.143+0000 7fe559d9b700 1 -- 172.21.15.103:0/3968518276 >> v1:172.21.15.86:6789/0 conn(0x7fe55c05b8a0 legacy=0x7fe55c062ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:58.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.143+0000 7fe559d9b700 1 -- 172.21.15.103:0/3968518276 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe55c143840 con 0x7fe55c065fe0 2020-04-22T14:19:58.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.143+0000 7fe559d9b700 1 --2- 172.21.15.103:0/3968518276 >> v2:172.21.15.103:3300/0 conn(0x7fe55c065fe0 0x7fe55c05b440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe55c0669a0 tx=0x7fe544007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.144+0000 7fe559d9b700 1 --2- 172.21.15.103:0/3968518276 >> v2:172.21.15.103:3300/0 conn(0x7fe55c065fe0 0x7fe55c05b440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe55c0669a0 tx=0x7fe544007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.144+0000 7fe559d9b700 1 --2- 172.21.15.103:0/3968518276 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe55c065fe0 0x7fe55c05b440 secure :-1 s=READY pgs=2088 cs=0 l=1 rx=0x7fe55c0669a0 tx=0x7fe544007a40).ready entity=mon.1 client_cookie=740a46c1cd2f795a server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:58.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.144+0000 7fe559d9b700 1 --2- 172.21.15.103:0/3968518276 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe55c065fe0 0x7fe55c05b440 secure :-1 s=THROTTLE_DONE pgs=2088 cs=0 l=1 rx=0x7fe55c0669a0 tx=0x7fe544007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.144+0000 7fe559d9b700 1 --2- 172.21.15.103:0/3968518276 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe55c065fe0 0x7fe55c05b440 secure :-1 s=THROTTLE_DONE pgs=2088 cs=0 l=1 rx=0x7fe55c0669a0 tx=0x7fe544007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.144+0000 7fe55959a700 1 -- 172.21.15.103:0/3968518276 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5440116e0 con 0x7fe55c065fe0 2020-04-22T14:19:58.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.144+0000 7fe559d9b700 1 --2- 172.21.15.103:0/3968518276 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe55c065fe0 0x7fe55c05b440 secure :-1 s=THROTTLE_DONE pgs=2088 cs=0 l=1 rx=0x7fe55c0669a0 tx=0x7fe544007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.144+0000 7fe55959a700 1 -- 172.21.15.103:0/3968518276 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe544011840 con 0x7fe55c065fe0 2020-04-22T14:19:58.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.144+0000 7fe55959a700 1 -- 172.21.15.103:0/3968518276 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe544011c60 con 0x7fe55c065fe0 2020-04-22T14:19:58.155 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.144+0000 7fe5608c2700 1 -- 172.21.15.103:0/3968518276 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe55c065fe0 msgr2=0x7fe55c05b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:58.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.144+0000 7fe5608c2700 1 --2- 172.21.15.103:0/3968518276 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe55c065fe0 0x7fe55c05b440 secure :-1 s=READY pgs=2088 cs=0 l=1 rx=0x7fe55c0669a0 tx=0x7fe544007a40).stop 2020-04-22T14:19:58.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.144+0000 7fe5608c2700 1 -- 172.21.15.103:0/3968518276 shutdown_connections 2020-04-22T14:19:58.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.144+0000 7fe5608c2700 1 --2- 172.21.15.103:0/3968518276 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe55c12c0d0 0x7fe55c1464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:58.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.144+0000 7fe5608c2700 1 --2- 172.21.15.103:0/3968518276 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe55c065fe0 0x7fe55c05b440 unknown :-1 s=CLOSED pgs=2088 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:58.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.144+0000 7fe5608c2700 1 -- 172.21.15.103:0/3968518276 >> 172.21.15.103:0/3968518276 conn(0x7fe55c0b9160 msgr2=0x7fe55c05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:58.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.144+0000 7fe5608c2700 1 -- 172.21.15.103:0/3968518276 shutdown_connections 2020-04-22T14:19:58.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.144+0000 7fe5608c2700 1 -- 172.21.15.103:0/3968518276 wait complete. 2020-04-22T14:19:58.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.145+0000 7fe5608c2700 1 Processor -- start 2020-04-22T14:19:58.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.145+0000 7fe5608c2700 1 -- start start 2020-04-22T14:19:58.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.146+0000 7fe5608c2700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe55c05b8a0 0x7fe55c0adad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:58.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.146+0000 7fe5608c2700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe55c12c0d0 0x7fe55c0af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:58.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.146+0000 7fe5608c2700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe55c0af880 con 0x7fe55c065fe0 2020-04-22T14:19:58.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.146+0000 7fe5608c2700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe55c128d00 con 0x7fe55c12c0d0 2020-04-22T14:19:58.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.146+0000 7fe5608c2700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c0afac0 con 0x7fe55c05b8a0 2020-04-22T14:19:58.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.146+0000 7fe559d9b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe55c065fe0 0x7fe55c141f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50772/0 (socket says 172.21.15.103:50772) 2020-04-22T14:19:58.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.146+0000 7fe559d9b700 1 -- 172.21.15.103:0/3854419271 learned_addr learned my addr 172.21.15.103:0/3854419271 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:58.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.146+0000 7fe55ad9d700 1 --2- 172.21.15.103:0/3854419271 >> v2:172.21.15.86:3300/0 conn(0x7fe55c12c0d0 0x7fe55c0af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:58.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.146+0000 7fe55a59c700 1 --2- 172.21.15.103:0/3854419271 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe55c05b8a0 0x7fe55c0adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:58.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.146+0000 7fe5537fe700 1 -- 172.21.15.103:0/3854419271 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 123411409 0 0) 0x7fe55c143840 con 0x7fe55c065fe0 2020-04-22T14:19:58.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.146+0000 7fe5537fe700 1 -- 172.21.15.103:0/3854419271 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe540002fe0 con 0x7fe55c065fe0 2020-04-22T14:19:58.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.146+0000 7fe55a59c700 1 -- 172.21.15.103:0/3854419271 >> v2:172.21.15.86:3300/0 conn(0x7fe55c12c0d0 msgr2=0x7fe55c0af420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:58.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.146+0000 7fe55a59c700 1 --2- 172.21.15.103:0/3854419271 >> v2:172.21.15.86:3300/0 conn(0x7fe55c12c0d0 0x7fe55c0af420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:58.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.146+0000 7fe55a59c700 1 -- 172.21.15.103:0/3854419271 >> v1:172.21.15.103:6789/0 conn(0x7fe55c065fe0 legacy=0x7fe55c141f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:58.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.146+0000 7fe5537fe700 1 -- 172.21.15.103:0/3854419271 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4087647037 0 0) 0x7fe540002fe0 con 0x7fe55c065fe0 2020-04-22T14:19:58.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.146+0000 7fe55a59c700 1 -- 172.21.15.103:0/3854419271 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe55c0afd60 con 0x7fe55c05b8a0 2020-04-22T14:19:58.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.147+0000 7fe55ad9d700 1 --2- 172.21.15.103:0/3854419271 >> v2:172.21.15.86:3300/0 conn(0x7fe55c12c0d0 0x7fe55c0af420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:19:58.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.147+0000 7fe55a59c700 1 --2- 172.21.15.103:0/3854419271 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe55c05b8a0 0x7fe55c0adad0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe5440087c0 tx=0x7fe54c010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.147+0000 7fe55a59c700 1 --2- 172.21.15.103:0/3854419271 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe55c05b8a0 0x7fe55c0adad0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe5440087c0 tx=0x7fe54c010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.147+0000 7fe55a59c700 1 --2- 172.21.15.103:0/3854419271 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe55c05b8a0 0x7fe55c0adad0 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7fe5440087c0 tx=0x7fe54c010980).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:58.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.147+0000 7fe55a59c700 1 --2- 172.21.15.103:0/3854419271 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe55c05b8a0 0x7fe55c0adad0 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7fe5440087c0 tx=0x7fe54c010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.147+0000 7fe5537fe700 1 -- 172.21.15.103:0/3854419271 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe544008660 con 0x7fe55c05b8a0 2020-04-22T14:19:58.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.147+0000 7fe5608c2700 1 -- 172.21.15.103:0/3854419271 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe55c0b0000 con 0x7fe55c05b8a0 2020-04-22T14:19:58.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.147+0000 7fe55a59c700 1 --2- 172.21.15.103:0/3854419271 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe55c05b8a0 0x7fe55c0adad0 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7fe5440087c0 tx=0x7fe54c010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.147+0000 7fe5537fe700 1 -- 172.21.15.103:0/3854419271 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54c007370 con 0x7fe55c05b8a0 2020-04-22T14:19:58.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.147+0000 7fe55a59c700 1 --2- 172.21.15.103:0/3854419271 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe55c05b8a0 0x7fe55c0adad0 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7fe5440087c0 tx=0x7fe54c010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.147+0000 7fe5537fe700 1 -- 172.21.15.103:0/3854419271 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe54c0059c0 con 0x7fe55c05b8a0 2020-04-22T14:19:58.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.147+0000 7fe5608c2700 1 -- 172.21.15.103:0/3854419271 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe55c142620 con 0x7fe55c05b8a0 2020-04-22T14:19:58.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.148+0000 7fe55a59c700 1 --2- 172.21.15.103:0/3854419271 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe55c05b8a0 0x7fe55c0adad0 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7fe5440087c0 tx=0x7fe54c010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.148+0000 7fe5608c2700 1 -- 172.21.15.103:0/3854419271 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe55c056c90 con 0x7fe55c05b8a0 2020-04-22T14:19:58.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.148+0000 7fe5537fe700 1 -- 172.21.15.103:0/3854419271 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fe54c005b70 con 0x7fe55c05b8a0 2020-04-22T14:19:58.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.148+0000 7fe55a59c700 1 --2- 172.21.15.103:0/3854419271 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe55c05b8a0 0x7fe55c0adad0 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7fe5440087c0 tx=0x7fe54c010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.148+0000 7fe5537fe700 1 --2- 172.21.15.103:0/3854419271 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe54004dc50 0x7fe540050110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:58.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.148+0000 7fe5537fe700 1 -- 172.21.15.103:0/3854419271 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe54c060c50 con 0x7fe55c05b8a0 2020-04-22T14:19:58.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.148+0000 7fe559d9b700 1 --2- 172.21.15.103:0/3854419271 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe54004dc50 0x7fe540050110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:58.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.149+0000 7fe559d9b700 1 --2- 172.21.15.103:0/3854419271 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe54004dc50 0x7fe540050110 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe544008800 tx=0x7fe544007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.149+0000 7fe559d9b700 1 --2- 172.21.15.103:0/3854419271 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe54004dc50 0x7fe540050110 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe544008800 tx=0x7fe544007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.149+0000 7fe559d9b700 1 --2- 172.21.15.103:0/3854419271 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe54004dc50 0x7fe540050110 secure :-1 s=READY pgs=758 cs=0 l=1 rx=0x7fe544008800 tx=0x7fe544007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:58.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.152+0000 7fe55a59c700 1 --2- 172.21.15.103:0/3854419271 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe55c05b8a0 0x7fe55c0adad0 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7fe5440087c0 tx=0x7fe54c010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.152+0000 7fe5537fe700 1 -- 172.21.15.103:0/3854419271 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fe54c03bfd0 con 0x7fe55c05b8a0 2020-04-22T14:19:58.297 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.294+0000 7fe5608c2700 1 -- 172.21.15.103:0/3854419271 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe55c147360 con 0x7fe55c05b8a0 2020-04-22T14:19:58.298 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.295+0000 7fe55a59c700 1 --2- 172.21.15.103:0/3854419271 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe55c05b8a0 0x7fe55c0adad0 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7fe5440087c0 tx=0x7fe54c010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.298 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.295+0000 7fe5537fe700 1 -- 172.21.15.103:0/3854419271 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) v1 ==== 74+0+16103 (secure 0 0 0) 0x7fe54c005e00 con 0x7fe55c05b8a0 2020-04-22T14:19:58.299 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:19:58.299 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":146,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:19:47.113833+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:19:44.035980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2020-04-22T14:19:45.079896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:19:58.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.296+0000 7fe5608c2700 1 -- 172.21.15.103:0/3854419271 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe54004dc50 msgr2=0x7fe540050110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:58.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.296+0000 7fe5608c2700 1 --2- 172.21.15.103:0/3854419271 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe54004dc50 0x7fe540050110 secure :-1 s=READY pgs=758 cs=0 l=1 rx=0x7fe544008800 tx=0x7fe544007a40).stop 2020-04-22T14:19:58.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.296+0000 7fe5608c2700 1 -- 172.21.15.103:0/3854419271 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe55c05b8a0 msgr2=0x7fe55c0adad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:58.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.296+0000 7fe5608c2700 1 --2- 172.21.15.103:0/3854419271 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe55c05b8a0 0x7fe55c0adad0 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7fe5440087c0 tx=0x7fe54c010980).stop 2020-04-22T14:19:58.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.296+0000 7fe5608c2700 1 -- 172.21.15.103:0/3854419271 shutdown_connections 2020-04-22T14:19:58.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.296+0000 7fe5608c2700 1 --2- 172.21.15.103:0/3854419271 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe54004dc50 0x7fe540050110 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:58.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.296+0000 7fe5608c2700 1 --2- 172.21.15.103:0/3854419271 >> v2:172.21.15.86:3300/0 conn(0x7fe55c12c0d0 0x7fe55c0af420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:58.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.296+0000 7fe5608c2700 1 --2- 172.21.15.103:0/3854419271 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe55c05b8a0 0x7fe55c0adad0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:58.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.296+0000 7fe5608c2700 1 -- 172.21.15.103:0/3854419271 >> 172.21.15.103:0/3854419271 conn(0x7fe55c0b9160 msgr2=0x7fe55c064ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:58.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.296+0000 7fe5608c2700 1 -- 172.21.15.103:0/3854419271 shutdown_connections 2020-04-22T14:19:58.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.296+0000 7fe5608c2700 1 -- 172.21.15.103:0/3854419271 wait complete. 2020-04-22T14:19:58.310 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:19:44.035980+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 25, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'145', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:19:45.079896+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 26, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'146', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:19:58.311 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:58.324 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:19:58.475 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.472+0000 7fc30d1c1700 1 Processor -- start 2020-04-22T14:19:58.475 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.472+0000 7fc30d1c1700 1 -- start start 2020-04-22T14:19:58.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.473+0000 7fc30d1c1700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc308061a30 0x7fc3080b4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:58.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.473+0000 7fc30d1c1700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3080af030 con 0x7fc3080acb10 2020-04-22T14:19:58.477 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.473+0000 7fc30d1c1700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc308060250 con 0x7fc308141f20 2020-04-22T14:19:58.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.473+0000 7fc30d1c1700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3080623c0 con 0x7fc308061a30 2020-04-22T14:19:58.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.473+0000 7fc30759e700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc308141f20 0x7fc3081423b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50782/0 (socket says 172.21.15.103:50782) 2020-04-22T14:19:58.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.473+0000 7fc30759e700 1 -- 172.21.15.103:0/967614862 learned_addr learned my addr 172.21.15.103:0/967614862 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:58.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.473+0000 7fc306d9d700 1 --2- 172.21.15.103:0/967614862 >> v2:172.21.15.86:3300/0 conn(0x7fc308061a30 0x7fc3080b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:58.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.473+0000 7fc306d9d700 1 -- 172.21.15.103:0/967614862 >> v1:172.21.15.103:6789/0 conn(0x7fc308141f20 legacy=0x7fc3081423b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:58.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.473+0000 7fc306d9d700 1 -- 172.21.15.103:0/967614862 >> v1:172.21.15.86:6789/0 conn(0x7fc3080acb10 legacy=0x7fc3080ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:58.478 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.473+0000 7fc306d9d700 1 -- 172.21.15.103:0/967614862 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc308062660 con 0x7fc308061a30 2020-04-22T14:19:58.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.473+0000 7fc306d9d700 1 --2- 172.21.15.103:0/967614862 >> v2:172.21.15.86:3300/0 conn(0x7fc308061a30 0x7fc3080b4820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc2fc002f30 tx=0x7fc2fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.473+0000 7fc306d9d700 1 --2- 172.21.15.103:0/967614862 >> v2:172.21.15.86:3300/0 conn(0x7fc308061a30 0x7fc3080b4820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc2fc002f30 tx=0x7fc2fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.479 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.473+0000 7fc306d9d700 1 --2- 172.21.15.103:0/967614862 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc308061a30 0x7fc3080b4820 secure :-1 s=READY pgs=1092 cs=0 l=1 rx=0x7fc2fc002f30 tx=0x7fc2fc007a40).ready entity=mon.0 client_cookie=ca674054d7c777ad server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:58.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.475+0000 7fc306d9d700 1 --2- 172.21.15.103:0/967614862 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc308061a30 0x7fc3080b4820 secure :-1 s=THROTTLE_DONE pgs=1092 cs=0 l=1 rx=0x7fc2fc002f30 tx=0x7fc2fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.475+0000 7fc305d9b700 1 -- 172.21.15.103:0/967614862 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2fc011470 con 0x7fc308061a30 2020-04-22T14:19:58.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.475+0000 7fc306d9d700 1 --2- 172.21.15.103:0/967614862 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc308061a30 0x7fc3080b4820 secure :-1 s=THROTTLE_DONE pgs=1092 cs=0 l=1 rx=0x7fc2fc002f30 tx=0x7fc2fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.475+0000 7fc306d9d700 1 --2- 172.21.15.103:0/967614862 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc308061a30 0x7fc3080b4820 secure :-1 s=THROTTLE_DONE pgs=1092 cs=0 l=1 rx=0x7fc2fc002f30 tx=0x7fc2fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.475+0000 7fc305d9b700 1 -- 172.21.15.103:0/967614862 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2fc0115d0 con 0x7fc308061a30 2020-04-22T14:19:58.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.475+0000 7fc305d9b700 1 -- 172.21.15.103:0/967614862 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2fc0119f0 con 0x7fc308061a30 2020-04-22T14:19:58.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.475+0000 7fc30d1c1700 1 -- 172.21.15.103:0/967614862 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc308061a30 msgr2=0x7fc3080b4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:58.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.475+0000 7fc30d1c1700 1 --2- 172.21.15.103:0/967614862 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc308061a30 0x7fc3080b4820 secure :-1 s=READY pgs=1092 cs=0 l=1 rx=0x7fc2fc002f30 tx=0x7fc2fc007a40).stop 2020-04-22T14:19:58.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.475+0000 7fc30d1c1700 1 -- 172.21.15.103:0/967614862 shutdown_connections 2020-04-22T14:19:58.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.475+0000 7fc30d1c1700 1 --2- 172.21.15.103:0/967614862 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc308061a30 0x7fc3080b4820 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:58.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.475+0000 7fc30d1c1700 1 -- 172.21.15.103:0/967614862 >> 172.21.15.103:0/967614862 conn(0x7fc30805b7b0 msgr2=0x7fc3080b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:58.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.475+0000 7fc30d1c1700 1 -- 172.21.15.103:0/967614862 shutdown_connections 2020-04-22T14:19:58.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.475+0000 7fc30d1c1700 1 -- 172.21.15.103:0/967614862 wait complete. 2020-04-22T14:19:58.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.476+0000 7fc30d1c1700 1 Processor -- start 2020-04-22T14:19:58.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.476+0000 7fc30d1c1700 1 -- start start 2020-04-22T14:19:58.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.477+0000 7fc30d1c1700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3080acb10 0x7fc3081456f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:58.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.477+0000 7fc30d1c1700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc308143340 con 0x7fc308061a30 2020-04-22T14:19:58.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.477+0000 7fc30d1c1700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3081435e0 con 0x7fc308141f20 2020-04-22T14:19:58.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.477+0000 7fc30d1c1700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc308143880 con 0x7fc3080acb10 2020-04-22T14:19:58.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.477+0000 7fc30759e700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc308141f20 0x7fc308065670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50786/0 (socket says 172.21.15.103:50786) 2020-04-22T14:19:58.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.477+0000 7fc30759e700 1 -- 172.21.15.103:0/13227202 learned_addr learned my addr 172.21.15.103:0/13227202 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:58.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.477+0000 7fc30659c700 1 --2- 172.21.15.103:0/13227202 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3080acb10 0x7fc3081456f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:58.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.477+0000 7fc2f7fff700 1 -- 172.21.15.103:0/13227202 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3385626874 0 0) 0x7fc308143340 con 0x7fc308061a30 2020-04-22T14:19:58.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.477+0000 7fc2f7fff700 1 -- 172.21.15.103:0/13227202 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2e4002fe0 con 0x7fc308061a30 2020-04-22T14:19:58.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.478+0000 7fc30659c700 1 -- 172.21.15.103:0/13227202 >> v1:172.21.15.103:6789/0 conn(0x7fc308141f20 legacy=0x7fc308065670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:58.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.478+0000 7fc30659c700 1 -- 172.21.15.103:0/13227202 >> v1:172.21.15.86:6789/0 conn(0x7fc308061a30 legacy=0x7fc308143d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:58.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.478+0000 7fc30659c700 1 -- 172.21.15.103:0/13227202 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc30812f820 con 0x7fc3080acb10 2020-04-22T14:19:58.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.478+0000 7fc30659c700 1 --2- 172.21.15.103:0/13227202 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3080acb10 0x7fc3081456f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc30805bc40 tx=0x7fc2f80108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.478+0000 7fc30659c700 1 --2- 172.21.15.103:0/13227202 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3080acb10 0x7fc3081456f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc30805bc40 tx=0x7fc2f80108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.478+0000 7fc30659c700 1 --2- 172.21.15.103:0/13227202 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3080acb10 0x7fc3081456f0 secure :-1 s=READY pgs=195 cs=0 l=1 rx=0x7fc30805bc40 tx=0x7fc2f80108e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:58.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.479+0000 7fc30659c700 1 --2- 172.21.15.103:0/13227202 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3080acb10 0x7fc3081456f0 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7fc30805bc40 tx=0x7fc2f80108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.479+0000 7fc30659c700 1 --2- 172.21.15.103:0/13227202 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3080acb10 0x7fc3081456f0 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7fc30805bc40 tx=0x7fc2f80108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.479+0000 7fc2f7fff700 1 -- 172.21.15.103:0/13227202 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2f800cc00 con 0x7fc3080acb10 2020-04-22T14:19:58.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.479+0000 7fc30659c700 1 --2- 172.21.15.103:0/13227202 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3080acb10 0x7fc3081456f0 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7fc30805bc40 tx=0x7fc2f80108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.479+0000 7fc2f7fff700 1 -- 172.21.15.103:0/13227202 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f800cda0 con 0x7fc3080acb10 2020-04-22T14:19:58.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.479+0000 7fc2f7fff700 1 -- 172.21.15.103:0/13227202 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2f8011100 con 0x7fc3080acb10 2020-04-22T14:19:58.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.479+0000 7fc30d1c1700 1 -- 172.21.15.103:0/13227202 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3081381c0 con 0x7fc3080acb10 2020-04-22T14:19:58.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.479+0000 7fc30d1c1700 1 -- 172.21.15.103:0/13227202 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3080b2350 con 0x7fc3080acb10 2020-04-22T14:19:58.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.480+0000 7fc30659c700 1 --2- 172.21.15.103:0/13227202 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3080acb10 0x7fc3081456f0 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7fc30805bc40 tx=0x7fc2f80108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.480+0000 7fc30d1c1700 1 -- 172.21.15.103:0/13227202 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc308056c90 con 0x7fc3080acb10 2020-04-22T14:19:58.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.480+0000 7fc2f7fff700 1 -- 172.21.15.103:0/13227202 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fc2f80064e0 con 0x7fc3080acb10 2020-04-22T14:19:58.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.480+0000 7fc30659c700 1 --2- 172.21.15.103:0/13227202 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3080acb10 0x7fc3081456f0 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7fc30805bc40 tx=0x7fc2f80108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.480+0000 7fc2f7fff700 1 --2- 172.21.15.103:0/13227202 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc2e404dcf0 0x7fc2e40501b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:58.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.481+0000 7fc2f7fff700 1 -- 172.21.15.103:0/13227202 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc2f8060e50 con 0x7fc3080acb10 2020-04-22T14:19:58.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.481+0000 7fc306d9d700 1 --2- 172.21.15.103:0/13227202 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc2e404dcf0 0x7fc2e40501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:58.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.481+0000 7fc306d9d700 1 --2- 172.21.15.103:0/13227202 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc2e404dcf0 0x7fc2e40501b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc2fc007ed0 tx=0x7fc2fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.481+0000 7fc306d9d700 1 --2- 172.21.15.103:0/13227202 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc2e404dcf0 0x7fc2e40501b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc2fc007ed0 tx=0x7fc2fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.481+0000 7fc306d9d700 1 --2- 172.21.15.103:0/13227202 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc2e404dcf0 0x7fc2e40501b0 secure :-1 s=READY pgs=759 cs=0 l=1 rx=0x7fc2fc007ed0 tx=0x7fc2fc007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:58.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.484+0000 7fc30659c700 1 --2- 172.21.15.103:0/13227202 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3080acb10 0x7fc3081456f0 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7fc30805bc40 tx=0x7fc2f80108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.494 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.484+0000 7fc2f7fff700 1 -- 172.21.15.103:0/13227202 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fc2f803c230 con 0x7fc3080acb10 2020-04-22T14:19:58.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.625+0000 7fc30d1c1700 1 -- 172.21.15.103:0/13227202 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc3081439c0 con 0x7fc3080acb10 2020-04-22T14:19:58.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.625+0000 7fc30659c700 1 --2- 172.21.15.103:0/13227202 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3080acb10 0x7fc3081456f0 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7fc30805bc40 tx=0x7fc2f80108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.625+0000 7fc2f7fff700 1 -- 172.21.15.103:0/13227202 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v146) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc2f803f850 con 0x7fc3080acb10 2020-04-22T14:19:58.629 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:19:58.630 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.627+0000 7fc30d1c1700 1 -- 172.21.15.103:0/13227202 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc2e404dcf0 msgr2=0x7fc2e40501b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:58.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.627+0000 7fc30d1c1700 1 --2- 172.21.15.103:0/13227202 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc2e404dcf0 0x7fc2e40501b0 secure :-1 s=READY pgs=759 cs=0 l=1 rx=0x7fc2fc007ed0 tx=0x7fc2fc007a40).stop 2020-04-22T14:19:58.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.627+0000 7fc30d1c1700 1 -- 172.21.15.103:0/13227202 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3080acb10 msgr2=0x7fc3081456f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:58.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.627+0000 7fc30d1c1700 1 --2- 172.21.15.103:0/13227202 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3080acb10 0x7fc3081456f0 secure :-1 s=READY pgs=195 cs=0 l=1 rx=0x7fc30805bc40 tx=0x7fc2f80108e0).stop 2020-04-22T14:19:58.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.627+0000 7fc30d1c1700 1 -- 172.21.15.103:0/13227202 shutdown_connections 2020-04-22T14:19:58.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.627+0000 7fc30d1c1700 1 --2- 172.21.15.103:0/13227202 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc2e404dcf0 0x7fc2e40501b0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:58.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.627+0000 7fc30d1c1700 1 --2- 172.21.15.103:0/13227202 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3080acb10 0x7fc3081456f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:58.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.627+0000 7fc30d1c1700 1 -- 172.21.15.103:0/13227202 >> 172.21.15.103:0/13227202 conn(0x7fc30805b7b0 msgr2=0x7fc3080b5000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:58.631 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.627+0000 7fc30d1c1700 1 -- 172.21.15.103:0/13227202 shutdown_connections 2020-04-22T14:19:58.632 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.627+0000 7fc30d1c1700 1 -- 172.21.15.103:0/13227202 wait complete. 2020-04-22T14:19:58.640 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:58.653 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:19:58.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.799+0000 7fbf8131a700 1 Processor -- start 2020-04-22T14:19:58.802 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.799+0000 7fbf8131a700 1 -- start start 2020-04-22T14:19:58.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.800+0000 7fbf8131a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf7c0b9140 0x7fbf7c12b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:58.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.800+0000 7fbf8131a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf7c1467e0 con 0x7fbf7c0ac950 2020-04-22T14:19:58.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.800+0000 7fbf8131a700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf7c060050 con 0x7fbf7c12b670 2020-04-22T14:19:58.805 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.800+0000 7fbf8131a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c0602f0 con 0x7fbf7c0b9140 2020-04-22T14:19:58.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.800+0000 7fbf7b7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fbf7c12b670 0x7fbf7c143090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50792/0 (socket says 172.21.15.103:50792) 2020-04-22T14:19:58.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.800+0000 7fbf7b7fe700 1 -- 172.21.15.103:0/1751258819 learned_addr learned my addr 172.21.15.103:0/1751258819 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:58.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.800+0000 7fbf7affd700 1 --2- 172.21.15.103:0/1751258819 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf7c0b9140 0x7fbf7c12b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:58.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.800+0000 7fbf79ffb700 1 -- 172.21.15.103:0/1751258819 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2812281539 0 0) 0x7fbf7c060050 con 0x7fbf7c12b670 2020-04-22T14:19:58.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.800+0000 7fbf79ffb700 1 -- 172.21.15.103:0/1751258819 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf60003230 con 0x7fbf7c12b670 2020-04-22T14:19:58.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.801+0000 7fbf79ffb700 1 -- 172.21.15.103:0/1751258819 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3296295449 0 0) 0x7fbf7c1467e0 con 0x7fbf7c0ac950 2020-04-22T14:19:58.806 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.801+0000 7fbf79ffb700 1 -- 172.21.15.103:0/1751258819 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf7c060050 con 0x7fbf7c0ac950 2020-04-22T14:19:58.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.801+0000 7fbf79ffb700 1 -- 172.21.15.103:0/1751258819 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3195914213 0 0) 0x7fbf60003230 con 0x7fbf7c12b670 2020-04-22T14:19:58.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.801+0000 7fbf7affd700 1 -- 172.21.15.103:0/1751258819 >> v1:172.21.15.103:6789/0 conn(0x7fbf7c12b670 legacy=0x7fbf7c143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:58.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.801+0000 7fbf7affd700 1 -- 172.21.15.103:0/1751258819 >> v1:172.21.15.86:6789/0 conn(0x7fbf7c0ac950 legacy=0x7fbf7c146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:58.807 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.801+0000 7fbf7affd700 1 -- 172.21.15.103:0/1751258819 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf7c0b9520 con 0x7fbf7c0b9140 2020-04-22T14:19:58.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.801+0000 7fbf7affd700 1 --2- 172.21.15.103:0/1751258819 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf7c0b9140 0x7fbf7c12b210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbf74001450 tx=0x7fbf700088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.801+0000 7fbf7affd700 1 --2- 172.21.15.103:0/1751258819 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf7c0b9140 0x7fbf7c12b210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbf74001450 tx=0x7fbf700088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.801+0000 7fbf7affd700 1 --2- 172.21.15.103:0/1751258819 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf7c0b9140 0x7fbf7c12b210 secure :-1 s=READY pgs=196 cs=0 l=1 rx=0x7fbf74001450 tx=0x7fbf700088e0).ready entity=mon.2 client_cookie=bd52085633fd7be4 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:58.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.801+0000 7fbf7affd700 1 --2- 172.21.15.103:0/1751258819 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf7c0b9140 0x7fbf7c12b210 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7fbf74001450 tx=0x7fbf700088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.801+0000 7fbf79ffb700 1 -- 172.21.15.103:0/1751258819 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf74001a50 con 0x7fbf7c0b9140 2020-04-22T14:19:58.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.801+0000 7fbf7affd700 1 --2- 172.21.15.103:0/1751258819 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf7c0b9140 0x7fbf7c12b210 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7fbf74001450 tx=0x7fbf700088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.801+0000 7fbf79ffb700 1 -- 172.21.15.103:0/1751258819 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf70011210 con 0x7fbf7c0b9140 2020-04-22T14:19:58.809 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.801+0000 7fbf7affd700 1 --2- 172.21.15.103:0/1751258819 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf7c0b9140 0x7fbf7c12b210 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7fbf74001450 tx=0x7fbf700088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.801+0000 7fbf79ffb700 1 -- 172.21.15.103:0/1751258819 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf700115b0 con 0x7fbf7c0b9140 2020-04-22T14:19:58.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.801+0000 7fbf8131a700 1 -- 172.21.15.103:0/1751258819 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf7c0b9140 msgr2=0x7fbf7c12b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:58.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.801+0000 7fbf8131a700 1 --2- 172.21.15.103:0/1751258819 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf7c0b9140 0x7fbf7c12b210 secure :-1 s=READY pgs=196 cs=0 l=1 rx=0x7fbf74001450 tx=0x7fbf700088e0).stop 2020-04-22T14:19:58.810 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.802+0000 7fbf8131a700 1 -- 172.21.15.103:0/1751258819 shutdown_connections 2020-04-22T14:19:58.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.802+0000 7fbf8131a700 1 --2- 172.21.15.103:0/1751258819 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf7c0b9140 0x7fbf7c12b210 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:58.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.802+0000 7fbf8131a700 1 -- 172.21.15.103:0/1751258819 >> 172.21.15.103:0/1751258819 conn(0x7fbf7c05b7b0 msgr2=0x7fbf7c0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:58.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.802+0000 7fbf8131a700 1 -- 172.21.15.103:0/1751258819 shutdown_connections 2020-04-22T14:19:58.816 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.802+0000 7fbf8131a700 1 -- 172.21.15.103:0/1751258819 wait complete. 2020-04-22T14:19:58.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.803+0000 7fbf8131a700 1 Processor -- start 2020-04-22T14:19:58.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.803+0000 7fbf8131a700 1 -- start start 2020-04-22T14:19:58.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.803+0000 7fbf8131a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbf7c0b9140 0x7fbf7c112310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:58.819 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.803+0000 7fbf8131a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf7c12b670 0x7fbf7c142d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:58.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.803+0000 7fbf8131a700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf7c111690 con 0x7fbf7c0ac950 2020-04-22T14:19:58.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.803+0000 7fbf8131a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf7c1431a0 con 0x7fbf7c0b9140 2020-04-22T14:19:58.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.803+0000 7fbf8131a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c111930 con 0x7fbf7c12b670 2020-04-22T14:19:58.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.803+0000 7fbf7a7fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbf7c0b9140 0x7fbf7c112310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:58.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.803+0000 7fbf7affd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fbf7c0ac950 0x7fbf7c061790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50796/0 (socket says 172.21.15.103:50796) 2020-04-22T14:19:58.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.803+0000 7fbf7affd700 1 -- 172.21.15.103:0/3433641392 learned_addr learned my addr 172.21.15.103:0/3433641392 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:58.820 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.803+0000 7fbf7a7fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbf7c0b9140 0x7fbf7c112310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58608/0 (socket says 172.21.15.103:58608) 2020-04-22T14:19:58.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.803+0000 7fbf7b7fe700 1 --2- 172.21.15.103:0/3433641392 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf7c12b670 0x7fbf7c142d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:58.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.804+0000 7fbf7a7fc700 1 -- 172.21.15.103:0/3433641392 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf7c12b670 msgr2=0x7fbf7c142d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:58.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.804+0000 7fbf7a7fc700 1 --2- 172.21.15.103:0/3433641392 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf7c12b670 0x7fbf7c142d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:58.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.804+0000 7fbf7a7fc700 1 -- 172.21.15.103:0/3433641392 >> v1:172.21.15.103:6789/0 conn(0x7fbf7c0ac950 legacy=0x7fbf7c061790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:58.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.804+0000 7fbf6bfff700 1 -- 172.21.15.103:0/3433641392 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2377082794 0 0) 0x7fbf7c111690 con 0x7fbf7c0ac950 2020-04-22T14:19:58.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.804+0000 7fbf7a7fc700 1 -- 172.21.15.103:0/3433641392 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf7c111bd0 con 0x7fbf7c0b9140 2020-04-22T14:19:58.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.804+0000 7fbf7a7fc700 1 --2- 172.21.15.103:0/3433641392 >> v2:172.21.15.103:3300/0 conn(0x7fbf7c0b9140 0x7fbf7c112310 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbf6c0010d0 tx=0x7fbf6c0108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.804+0000 7fbf7a7fc700 1 --2- 172.21.15.103:0/3433641392 >> v2:172.21.15.103:3300/0 conn(0x7fbf7c0b9140 0x7fbf7c112310 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbf6c0010d0 tx=0x7fbf6c0108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.804+0000 7fbf7a7fc700 1 --2- 172.21.15.103:0/3433641392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf7c0b9140 0x7fbf7c112310 secure :-1 s=READY pgs=2094 cs=0 l=1 rx=0x7fbf6c0010d0 tx=0x7fbf6c0108e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:58.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.804+0000 7fbf7a7fc700 1 --2- 172.21.15.103:0/3433641392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf7c0b9140 0x7fbf7c112310 secure :-1 s=THROTTLE_DONE pgs=2094 cs=0 l=1 rx=0x7fbf6c0010d0 tx=0x7fbf6c0108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.804+0000 7fbf6bfff700 1 -- 172.21.15.103:0/3433641392 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf6c00cc20 con 0x7fbf7c0b9140 2020-04-22T14:19:58.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.804+0000 7fbf7a7fc700 1 --2- 172.21.15.103:0/3433641392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf7c0b9140 0x7fbf7c112310 secure :-1 s=THROTTLE_DONE pgs=2094 cs=0 l=1 rx=0x7fbf6c0010d0 tx=0x7fbf6c0108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.804+0000 7fbf6bfff700 1 -- 172.21.15.103:0/3433641392 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf6c00cdc0 con 0x7fbf7c0b9140 2020-04-22T14:19:58.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.804+0000 7fbf7a7fc700 1 --2- 172.21.15.103:0/3433641392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf7c0b9140 0x7fbf7c112310 secure :-1 s=THROTTLE_DONE pgs=2094 cs=0 l=1 rx=0x7fbf6c0010d0 tx=0x7fbf6c0108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.804+0000 7fbf6bfff700 1 -- 172.21.15.103:0/3433641392 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf6c00e370 con 0x7fbf7c0b9140 2020-04-22T14:19:58.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.804+0000 7fbf8131a700 1 -- 172.21.15.103:0/3433641392 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf7c111e70 con 0x7fbf7c0b9140 2020-04-22T14:19:58.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.804+0000 7fbf8131a700 1 -- 172.21.15.103:0/3433641392 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf7c0b1550 con 0x7fbf7c0b9140 2020-04-22T14:19:58.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.805+0000 7fbf7a7fc700 1 --2- 172.21.15.103:0/3433641392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf7c0b9140 0x7fbf7c112310 secure :-1 s=THROTTLE_DONE pgs=2094 cs=0 l=1 rx=0x7fbf6c0010d0 tx=0x7fbf6c0108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.805+0000 7fbf8131a700 1 -- 172.21.15.103:0/3433641392 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf7c112000 con 0x7fbf7c0b9140 2020-04-22T14:19:58.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.805+0000 7fbf6bfff700 1 -- 172.21.15.103:0/3433641392 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fbf6c00e630 con 0x7fbf7c0b9140 2020-04-22T14:19:58.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.805+0000 7fbf7a7fc700 1 --2- 172.21.15.103:0/3433641392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf7c0b9140 0x7fbf7c112310 secure :-1 s=THROTTLE_DONE pgs=2094 cs=0 l=1 rx=0x7fbf6c0010d0 tx=0x7fbf6c0108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.805+0000 7fbf6bfff700 1 --2- 172.21.15.103:0/3433641392 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbf5804d7d0 0x7fbf5804fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:58.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.805+0000 7fbf6bfff700 1 -- 172.21.15.103:0/3433641392 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbf6c0612d0 con 0x7fbf7c0b9140 2020-04-22T14:19:58.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.805+0000 7fbf7affd700 1 --2- 172.21.15.103:0/3433641392 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbf5804d7d0 0x7fbf5804fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:58.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.806+0000 7fbf7affd700 1 --2- 172.21.15.103:0/3433641392 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbf5804d7d0 0x7fbf5804fc90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbf70008320 tx=0x7fbf7c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.806+0000 7fbf7affd700 1 --2- 172.21.15.103:0/3433641392 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbf5804d7d0 0x7fbf5804fc90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbf70008320 tx=0x7fbf7c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.840 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.806+0000 7fbf7affd700 1 --2- 172.21.15.103:0/3433641392 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbf5804d7d0 0x7fbf5804fc90 secure :-1 s=READY pgs=760 cs=0 l=1 rx=0x7fbf70008320 tx=0x7fbf7c0b96b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:58.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.809+0000 7fbf7a7fc700 1 --2- 172.21.15.103:0/3433641392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf7c0b9140 0x7fbf7c112310 secure :-1 s=THROTTLE_DONE pgs=2094 cs=0 l=1 rx=0x7fbf6c0010d0 tx=0x7fbf6c0108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.841 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.809+0000 7fbf6bfff700 1 -- 172.21.15.103:0/3433641392 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fbf6c03c650 con 0x7fbf7c0b9140 2020-04-22T14:19:58.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.952+0000 7fbf8131a700 1 -- 172.21.15.103:0/3433641392 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbf7c056c90 con 0x7fbf7c0b9140 2020-04-22T14:19:58.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.952+0000 7fbf7a7fc700 1 --2- 172.21.15.103:0/3433641392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf7c0b9140 0x7fbf7c112310 secure :-1 s=THROTTLE_DONE pgs=2094 cs=0 l=1 rx=0x7fbf6c0010d0 tx=0x7fbf6c0108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:58.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.952+0000 7fbf6bfff700 1 -- 172.21.15.103:0/3433641392 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v146) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbf6c03fc70 con 0x7fbf7c0b9140 2020-04-22T14:19:58.956 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:19:58.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.953+0000 7fbf8131a700 1 -- 172.21.15.103:0/3433641392 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbf5804d7d0 msgr2=0x7fbf5804fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:58.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.953+0000 7fbf8131a700 1 --2- 172.21.15.103:0/3433641392 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbf5804d7d0 0x7fbf5804fc90 secure :-1 s=READY pgs=760 cs=0 l=1 rx=0x7fbf70008320 tx=0x7fbf7c0b96b0).stop 2020-04-22T14:19:58.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.953+0000 7fbf8131a700 1 -- 172.21.15.103:0/3433641392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf7c0b9140 msgr2=0x7fbf7c112310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:58.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.953+0000 7fbf8131a700 1 --2- 172.21.15.103:0/3433641392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf7c0b9140 0x7fbf7c112310 secure :-1 s=READY pgs=2094 cs=0 l=1 rx=0x7fbf6c0010d0 tx=0x7fbf6c0108e0).stop 2020-04-22T14:19:58.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.953+0000 7fbf8131a700 1 -- 172.21.15.103:0/3433641392 shutdown_connections 2020-04-22T14:19:58.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.953+0000 7fbf8131a700 1 --2- 172.21.15.103:0/3433641392 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fbf5804d7d0 0x7fbf5804fc90 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:58.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.953+0000 7fbf8131a700 1 --2- 172.21.15.103:0/3433641392 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf7c12b670 0x7fbf7c142d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:58.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.953+0000 7fbf8131a700 1 --2- 172.21.15.103:0/3433641392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf7c0b9140 0x7fbf7c112310 unknown :-1 s=CLOSED pgs=2094 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:58.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.953+0000 7fbf8131a700 1 -- 172.21.15.103:0/3433641392 >> 172.21.15.103:0/3433641392 conn(0x7fbf7c05b7b0 msgr2=0x7fbf7c128d90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:58.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.953+0000 7fbf8131a700 1 -- 172.21.15.103:0/3433641392 shutdown_connections 2020-04-22T14:19:58.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:58.953+0000 7fbf8131a700 1 -- 172.21.15.103:0/3433641392 wait complete. 2020-04-22T14:19:58.966 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:58.980 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-22T14:19:59.129 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.125+0000 7fdffb59e700 1 Processor -- start 2020-04-22T14:19:59.129 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.125+0000 7fdffb59e700 1 -- start start 2020-04-22T14:19:59.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.126+0000 7fdffb59e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdffc05fc70 0x7fdffc12c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:59.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.126+0000 7fdffb59e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdffc146560 con 0x7fdffc146f40 2020-04-22T14:19:59.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.126+0000 7fdffb59e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdffc146800 con 0x7fdffc0bcc50 2020-04-22T14:19:59.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.126+0000 7fdffb59e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdffc146370 con 0x7fdffc05fc70 2020-04-22T14:19:59.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.127+0000 7fdff9d9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdffc05fc70 0x7fdffc12c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:59.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.127+0000 7fdffa59c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fdffc0bcc50 0x7fdffc12bec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50804/0 (socket says 172.21.15.103:50804) 2020-04-22T14:19:59.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.127+0000 7fdff9d9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdffc05fc70 0x7fdffc12c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58614/0 (socket says 172.21.15.103:58614) 2020-04-22T14:19:59.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.127+0000 7fdffa59c700 1 -- 172.21.15.103:0/2394002975 learned_addr learned my addr 172.21.15.103:0/2394002975 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:59.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.127+0000 7fdff9d9b700 1 -- 172.21.15.103:0/2394002975 >> v1:172.21.15.103:6789/0 conn(0x7fdffc0bcc50 legacy=0x7fdffc12bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:59.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.127+0000 7fdff9d9b700 1 -- 172.21.15.103:0/2394002975 >> v1:172.21.15.86:6789/0 conn(0x7fdffc146f40 legacy=0x7fdffc0b5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:59.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.127+0000 7fdff959a700 1 -- 172.21.15.103:0/2394002975 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1088896757 0 0) 0x7fdffc146800 con 0x7fdffc0bcc50 2020-04-22T14:19:59.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.127+0000 7fdff9d9b700 1 -- 172.21.15.103:0/2394002975 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdffc146aa0 con 0x7fdffc05fc70 2020-04-22T14:19:59.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.127+0000 7fdff9d9b700 1 --2- 172.21.15.103:0/2394002975 >> v2:172.21.15.103:3300/0 conn(0x7fdffc05fc70 0x7fdffc12c5d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdffc0b8c50 tx=0x7fdfec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.127+0000 7fdff9d9b700 1 --2- 172.21.15.103:0/2394002975 >> v2:172.21.15.103:3300/0 conn(0x7fdffc05fc70 0x7fdffc12c5d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdffc0b8c50 tx=0x7fdfec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.127+0000 7fdff9d9b700 1 --2- 172.21.15.103:0/2394002975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdffc05fc70 0x7fdffc12c5d0 secure :-1 s=READY pgs=2096 cs=0 l=1 rx=0x7fdffc0b8c50 tx=0x7fdfec007a40).ready entity=mon.1 client_cookie=c396cc6cb435f5fa server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:59.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.127+0000 7fdff9d9b700 1 --2- 172.21.15.103:0/2394002975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdffc05fc70 0x7fdffc12c5d0 secure :-1 s=THROTTLE_DONE pgs=2096 cs=0 l=1 rx=0x7fdffc0b8c50 tx=0x7fdfec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.127+0000 7fdff959a700 1 -- 172.21.15.103:0/2394002975 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfec011430 con 0x7fdffc05fc70 2020-04-22T14:19:59.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.127+0000 7fdff9d9b700 1 --2- 172.21.15.103:0/2394002975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdffc05fc70 0x7fdffc12c5d0 secure :-1 s=THROTTLE_DONE pgs=2096 cs=0 l=1 rx=0x7fdffc0b8c50 tx=0x7fdfec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.127+0000 7fdff959a700 1 -- 172.21.15.103:0/2394002975 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfec011590 con 0x7fdffc05fc70 2020-04-22T14:19:59.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.127+0000 7fdff9d9b700 1 --2- 172.21.15.103:0/2394002975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdffc05fc70 0x7fdffc12c5d0 secure :-1 s=THROTTLE_DONE pgs=2096 cs=0 l=1 rx=0x7fdffc0b8c50 tx=0x7fdfec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.127+0000 7fdff959a700 1 -- 172.21.15.103:0/2394002975 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfec011970 con 0x7fdffc05fc70 2020-04-22T14:19:59.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.127+0000 7fdffb59e700 1 -- 172.21.15.103:0/2394002975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdffc05fc70 msgr2=0x7fdffc12c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:59.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.127+0000 7fdffb59e700 1 --2- 172.21.15.103:0/2394002975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdffc05fc70 0x7fdffc12c5d0 secure :-1 s=READY pgs=2096 cs=0 l=1 rx=0x7fdffc0b8c50 tx=0x7fdfec007a40).stop 2020-04-22T14:19:59.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.128+0000 7fdffb59e700 1 -- 172.21.15.103:0/2394002975 shutdown_connections 2020-04-22T14:19:59.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.128+0000 7fdffb59e700 1 --2- 172.21.15.103:0/2394002975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdffc05fc70 0x7fdffc12c5d0 unknown :-1 s=CLOSED pgs=2096 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:59.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.128+0000 7fdffb59e700 1 -- 172.21.15.103:0/2394002975 >> 172.21.15.103:0/2394002975 conn(0x7fdffc065af0 msgr2=0x7fdffc065f00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:59.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.128+0000 7fdffb59e700 1 -- 172.21.15.103:0/2394002975 shutdown_connections 2020-04-22T14:19:59.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.128+0000 7fdffb59e700 1 -- 172.21.15.103:0/2394002975 wait complete. 2020-04-22T14:19:59.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.129+0000 7fdffb59e700 1 Processor -- start 2020-04-22T14:19:59.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.129+0000 7fdffb59e700 1 -- start start 2020-04-22T14:19:59.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.129+0000 7fdffb59e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdffc05fc70 0x7fdffc12c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:59.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.129+0000 7fdffb59e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdffc0bcc50 0x7fdffc12ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:59.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.129+0000 7fdffb59e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdffc12c470 con 0x7fdffc146f40 2020-04-22T14:19:59.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.129+0000 7fdffb59e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdffc0afa90 con 0x7fdffc05fc70 2020-04-22T14:19:59.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.129+0000 7fdffb59e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdffc153b90 con 0x7fdffc0bcc50 2020-04-22T14:19:59.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.130+0000 7fdff9d9b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdffc0bcc50 0x7fdffc12ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:59.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.130+0000 7fdffa59c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdffc05fc70 0x7fdffc12c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:59.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.130+0000 7fdff9d9b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdffc0bcc50 0x7fdffc12ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:43396/0 (socket says 172.21.15.103:43396) 2020-04-22T14:19:59.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.130+0000 7fdff9d9b700 1 -- 172.21.15.103:0/3192931959 learned_addr learned my addr 172.21.15.103:0/3192931959 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:19:59.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.130+0000 7fdffa59c700 1 -- 172.21.15.103:0/3192931959 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdffc0bcc50 msgr2=0x7fdffc12ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:59.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.130+0000 7fdffa59c700 1 --2- 172.21.15.103:0/3192931959 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdffc0bcc50 0x7fdffc12ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:59.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.130+0000 7fdffa59c700 1 -- 172.21.15.103:0/3192931959 >> v1:172.21.15.86:6789/0 conn(0x7fdffc146f40 legacy=0x7fdffc12cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:59.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.130+0000 7fdffa59c700 1 -- 172.21.15.103:0/3192931959 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdffc153e30 con 0x7fdffc05fc70 2020-04-22T14:19:59.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.130+0000 7fdff37fe700 1 -- 172.21.15.103:0/3192931959 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 528960526 0 0) 0x7fdff4002360 con 0x7fdffc146f40 2020-04-22T14:19:59.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.130+0000 7fdff9d9b700 1 --2- 172.21.15.103:0/3192931959 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdffc0bcc50 0x7fdffc12ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:19:59.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.130+0000 7fdffa59c700 1 --2- 172.21.15.103:0/3192931959 >> v2:172.21.15.86:3300/0 conn(0x7fdffc05fc70 0x7fdffc12c010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdfe4000b80 tx=0x7fdfe4010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.130+0000 7fdffa59c700 1 --2- 172.21.15.103:0/3192931959 >> v2:172.21.15.86:3300/0 conn(0x7fdffc05fc70 0x7fdffc12c010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdfe4000b80 tx=0x7fdfe4010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.130+0000 7fdffa59c700 1 --2- 172.21.15.103:0/3192931959 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdffc05fc70 0x7fdffc12c010 secure :-1 s=READY pgs=1097 cs=0 l=1 rx=0x7fdfe4000b80 tx=0x7fdfe4010900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:59.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.130+0000 7fdffa59c700 1 --2- 172.21.15.103:0/3192931959 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdffc05fc70 0x7fdffc12c010 secure :-1 s=THROTTLE_DONE pgs=1097 cs=0 l=1 rx=0x7fdfe4000b80 tx=0x7fdfe4010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.130+0000 7fdff37fe700 1 -- 172.21.15.103:0/3192931959 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfe4005ca0 con 0x7fdffc05fc70 2020-04-22T14:19:59.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.130+0000 7fdffa59c700 1 --2- 172.21.15.103:0/3192931959 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdffc05fc70 0x7fdffc12c010 secure :-1 s=THROTTLE_DONE pgs=1097 cs=0 l=1 rx=0x7fdfe4000b80 tx=0x7fdfe4010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.153 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.130+0000 7fdff37fe700 1 -- 172.21.15.103:0/3192931959 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe4005e00 con 0x7fdffc05fc70 2020-04-22T14:19:59.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.130+0000 7fdffa59c700 1 --2- 172.21.15.103:0/3192931959 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdffc05fc70 0x7fdffc12c010 secure :-1 s=THROTTLE_DONE pgs=1097 cs=0 l=1 rx=0x7fdfe4000b80 tx=0x7fdfe4010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.130+0000 7fdff37fe700 1 -- 172.21.15.103:0/3192931959 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfe40062c0 con 0x7fdffc05fc70 2020-04-22T14:19:59.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.130+0000 7fdffb59e700 1 -- 172.21.15.103:0/3192931959 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdffc1540d0 con 0x7fdffc05fc70 2020-04-22T14:19:59.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.130+0000 7fdffb59e700 1 -- 172.21.15.103:0/3192931959 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdffc0ad0f0 con 0x7fdffc05fc70 2020-04-22T14:19:59.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.131+0000 7fdffa59c700 1 --2- 172.21.15.103:0/3192931959 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdffc05fc70 0x7fdffc12c010 secure :-1 s=THROTTLE_DONE pgs=1097 cs=0 l=1 rx=0x7fdfe4000b80 tx=0x7fdfe4010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.131+0000 7fdffb59e700 1 -- 172.21.15.103:0/3192931959 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdffc154790 con 0x7fdffc05fc70 2020-04-22T14:19:59.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.132+0000 7fdff37fe700 1 -- 172.21.15.103:0/3192931959 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fdfe4006500 con 0x7fdffc05fc70 2020-04-22T14:19:59.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.132+0000 7fdffa59c700 1 --2- 172.21.15.103:0/3192931959 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdffc05fc70 0x7fdffc12c010 secure :-1 s=THROTTLE_DONE pgs=1097 cs=0 l=1 rx=0x7fdfe4000b80 tx=0x7fdfe4010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.132+0000 7fdff37fe700 1 --2- 172.21.15.103:0/3192931959 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdfe004d820 0x7fdfe004fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:59.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.132+0000 7fdff37fe700 1 -- 172.21.15.103:0/3192931959 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdfe40090c0 con 0x7fdffc05fc70 2020-04-22T14:19:59.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.132+0000 7fdff9d9b700 1 --2- 172.21.15.103:0/3192931959 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdfe004d820 0x7fdfe004fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:59.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.132+0000 7fdff9d9b700 1 --2- 172.21.15.103:0/3192931959 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdfe004d820 0x7fdfe004fce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdffc0b8c50 tx=0x7fdfec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.132+0000 7fdff9d9b700 1 --2- 172.21.15.103:0/3192931959 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdfe004d820 0x7fdfe004fce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdffc0b8c50 tx=0x7fdfec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.132+0000 7fdff9d9b700 1 --2- 172.21.15.103:0/3192931959 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdfe004d820 0x7fdfe004fce0 secure :-1 s=READY pgs=761 cs=0 l=1 rx=0x7fdffc0b8c50 tx=0x7fdfec007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:59.161 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.136+0000 7fdffa59c700 1 --2- 172.21.15.103:0/3192931959 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdffc05fc70 0x7fdffc12c010 secure :-1 s=THROTTLE_DONE pgs=1097 cs=0 l=1 rx=0x7fdfe4000b80 tx=0x7fdfe4010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.162 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.136+0000 7fdff37fe700 1 -- 172.21.15.103:0/3192931959 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fdfe403c8a0 con 0x7fdffc05fc70 2020-04-22T14:19:59.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.278+0000 7fdffb59e700 1 -- 172.21.15.103:0/3192931959 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdffc056c90 con 0x7fdffc05fc70 2020-04-22T14:19:59.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.279+0000 7fdffa59c700 1 --2- 172.21.15.103:0/3192931959 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdffc05fc70 0x7fdffc12c010 secure :-1 s=THROTTLE_DONE pgs=1097 cs=0 l=1 rx=0x7fdfe4000b80 tx=0x7fdfe4010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.279+0000 7fdff37fe700 1 -- 172.21.15.103:0/3192931959 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v146) v1 ==== 104+0+10 (secure 0 0 0) 0x7fdfe403fec0 con 0x7fdffc05fc70 2020-04-22T14:19:59.283 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:19:59.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.280+0000 7fdffb59e700 1 -- 172.21.15.103:0/3192931959 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdfe004d820 msgr2=0x7fdfe004fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:59.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.280+0000 7fdffb59e700 1 --2- 172.21.15.103:0/3192931959 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdfe004d820 0x7fdfe004fce0 secure :-1 s=READY pgs=761 cs=0 l=1 rx=0x7fdffc0b8c50 tx=0x7fdfec007a40).stop 2020-04-22T14:19:59.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.280+0000 7fdffb59e700 1 -- 172.21.15.103:0/3192931959 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdffc05fc70 msgr2=0x7fdffc12c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:59.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.280+0000 7fdffb59e700 1 --2- 172.21.15.103:0/3192931959 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdffc05fc70 0x7fdffc12c010 secure :-1 s=READY pgs=1097 cs=0 l=1 rx=0x7fdfe4000b80 tx=0x7fdfe4010900).stop 2020-04-22T14:19:59.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.281+0000 7fdffb59e700 1 -- 172.21.15.103:0/3192931959 shutdown_connections 2020-04-22T14:19:59.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.281+0000 7fdffb59e700 1 --2- 172.21.15.103:0/3192931959 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdfe004d820 0x7fdfe004fce0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:59.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.281+0000 7fdffb59e700 1 --2- 172.21.15.103:0/3192931959 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdffc05fc70 0x7fdffc12c010 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:59.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.281+0000 7fdffb59e700 1 --2- 172.21.15.103:0/3192931959 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdffc0bcc50 0x7fdffc12ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:59.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.281+0000 7fdffb59e700 1 -- 172.21.15.103:0/3192931959 >> 172.21.15.103:0/3192931959 conn(0x7fdffc065af0 msgr2=0x7fdffc0b72e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:59.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.281+0000 7fdffb59e700 1 -- 172.21.15.103:0/3192931959 shutdown_connections 2020-04-22T14:19:59.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.281+0000 7fdffb59e700 1 -- 172.21.15.103:0/3192931959 wait complete. 2020-04-22T14:19:59.294 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:59.307 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-22T14:19:59.456 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.452+0000 7f80dbc1f700 1 Processor -- start 2020-04-22T14:19:59.456 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.453+0000 7f80dbc1f700 1 -- start start 2020-04-22T14:19:59.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.453+0000 7f80dbc1f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f80d40b9890 0x7f80d4146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:59.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.453+0000 7f80dbc1f700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f80d41434b0 0x7f80d4143910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:59.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.453+0000 7f80dbc1f700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d40b6eb0 con 0x7f80d41499f0 2020-04-22T14:19:59.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.453+0000 7f80dbc1f700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d405fbc0 con 0x7f80d40b9890 2020-04-22T14:19:59.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.453+0000 7f80dbc1f700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d405fe60 con 0x7f80d41434b0 2020-04-22T14:19:59.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.454+0000 7f80d99bb700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f80d40b9890 0x7f80d4146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:59.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.454+0000 7f80d91ba700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f80d41434b0 0x7f80d4143910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:59.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.454+0000 7f80d99bb700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f80d40b9890 0x7f80d4146fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:55858/0 (socket says 172.21.15.103:55858) 2020-04-22T14:19:59.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.454+0000 7f80d91ba700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f80d41434b0 0x7f80d4143910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:43406/0 (socket says 172.21.15.103:43406) 2020-04-22T14:19:59.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.454+0000 7f80d99bb700 1 -- 172.21.15.103:0/2749350064 learned_addr learned my addr 172.21.15.103:0/2749350064 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:19:59.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.454+0000 7f80da1bc700 1 --1- 172.21.15.103:0/2749350064 >> v1:172.21.15.86:6789/0 conn(0x7f80d41499f0 0x7f80d4149e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:39744/0 (socket says 172.21.15.103:39744) 2020-04-22T14:19:59.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.454+0000 7f80d99bb700 1 -- 172.21.15.103:0/2749350064 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f80d41434b0 msgr2=0x7f80d4143910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:59.460 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.454+0000 7f80d99bb700 1 --2- 172.21.15.103:0/2749350064 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f80d41434b0 0x7f80d4143910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:59.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.454+0000 7f80d99bb700 1 -- 172.21.15.103:0/2749350064 >> v1:172.21.15.86:6789/0 conn(0x7f80d41499f0 legacy=0x7f80d4149e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:59.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.454+0000 7f80d89b9700 1 -- 172.21.15.103:0/2749350064 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3047302503 0 0) 0x7f80d40b6eb0 con 0x7f80d41499f0 2020-04-22T14:19:59.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.454+0000 7f80d99bb700 1 -- 172.21.15.103:0/2749350064 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d4060100 con 0x7f80d40b9890 2020-04-22T14:19:59.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.454+0000 7f80d91ba700 1 --2- 172.21.15.103:0/2749350064 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f80d41434b0 0x7f80d4143910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:19:59.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.454+0000 7f80d99bb700 1 --2- 172.21.15.103:0/2749350064 >> v2:172.21.15.86:3300/0 conn(0x7f80d40b9890 0x7f80d4146fc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f80d40b4ba0 tx=0x7f80c80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.454+0000 7f80d99bb700 1 --2- 172.21.15.103:0/2749350064 >> v2:172.21.15.86:3300/0 conn(0x7f80d40b9890 0x7f80d4146fc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f80d40b4ba0 tx=0x7f80c80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.461 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.454+0000 7f80d99bb700 1 --2- 172.21.15.103:0/2749350064 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80d40b9890 0x7f80d4146fc0 secure :-1 s=READY pgs=1099 cs=0 l=1 rx=0x7f80d40b4ba0 tx=0x7f80c80088e0).ready entity=mon.0 client_cookie=21a93277cfbc62de server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:59.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.454+0000 7f80d99bb700 1 --2- 172.21.15.103:0/2749350064 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80d40b9890 0x7f80d4146fc0 secure :-1 s=THROTTLE_DONE pgs=1099 cs=0 l=1 rx=0x7f80d40b4ba0 tx=0x7f80c80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.454+0000 7f80d89b9700 1 -- 172.21.15.103:0/2749350064 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80c8011670 con 0x7f80d40b9890 2020-04-22T14:19:59.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.454+0000 7f80d99bb700 1 --2- 172.21.15.103:0/2749350064 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80d40b9890 0x7f80d4146fc0 secure :-1 s=THROTTLE_DONE pgs=1099 cs=0 l=1 rx=0x7f80d40b4ba0 tx=0x7f80c80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.454+0000 7f80d89b9700 1 -- 172.21.15.103:0/2749350064 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c8011810 con 0x7f80d40b9890 2020-04-22T14:19:59.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.454+0000 7f80d99bb700 1 --2- 172.21.15.103:0/2749350064 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80d40b9890 0x7f80d4146fc0 secure :-1 s=THROTTLE_DONE pgs=1099 cs=0 l=1 rx=0x7f80d40b4ba0 tx=0x7f80c80088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.454+0000 7f80d89b9700 1 -- 172.21.15.103:0/2749350064 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80c8011bf0 con 0x7f80d40b9890 2020-04-22T14:19:59.462 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.454+0000 7f80dbc1f700 1 -- 172.21.15.103:0/2749350064 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80d40b9890 msgr2=0x7f80d4146fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:59.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.454+0000 7f80dbc1f700 1 --2- 172.21.15.103:0/2749350064 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80d40b9890 0x7f80d4146fc0 secure :-1 s=READY pgs=1099 cs=0 l=1 rx=0x7f80d40b4ba0 tx=0x7f80c80088e0).stop 2020-04-22T14:19:59.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.455+0000 7f80dbc1f700 1 -- 172.21.15.103:0/2749350064 shutdown_connections 2020-04-22T14:19:59.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.455+0000 7f80dbc1f700 1 --2- 172.21.15.103:0/2749350064 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80d40b9890 0x7f80d4146fc0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:59.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.455+0000 7f80dbc1f700 1 --2- 172.21.15.103:0/2749350064 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f80d41434b0 0x7f80d4143910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:59.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.455+0000 7f80dbc1f700 1 -- 172.21.15.103:0/2749350064 >> 172.21.15.103:0/2749350064 conn(0x7f80d405ad30 msgr2=0x7f80d405b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:59.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.455+0000 7f80dbc1f700 1 -- 172.21.15.103:0/2749350064 shutdown_connections 2020-04-22T14:19:59.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.455+0000 7f80dbc1f700 1 -- 172.21.15.103:0/2749350064 wait complete. 2020-04-22T14:19:59.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.456+0000 7f80dbc1f700 1 Processor -- start 2020-04-22T14:19:59.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.456+0000 7f80dbc1f700 1 -- start start 2020-04-22T14:19:59.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.457+0000 7f80dbc1f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f80d41434b0 0x7f80d40b68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:59.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.457+0000 7f80dbc1f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f80d41499f0 0x7f80d4157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:59.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.457+0000 7f80dbc1f700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d40b6d10 con 0x7f80d40b9890 2020-04-22T14:19:59.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.457+0000 7f80dbc1f700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d41449b0 con 0x7f80d41434b0 2020-04-22T14:19:59.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.457+0000 7f80dbc1f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d4144c50 con 0x7f80d41499f0 2020-04-22T14:19:59.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.457+0000 7f80da1bc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f80d41499f0 0x7f80d4157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:59.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.457+0000 7f80d91ba700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f80d41434b0 0x7f80d40b68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:59.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.457+0000 7f80d91ba700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f80d41434b0 0x7f80d40b68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:55866/0 (socket says 172.21.15.103:55866) 2020-04-22T14:19:59.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.457+0000 7f80d91ba700 1 -- 172.21.15.103:0/3439356971 learned_addr learned my addr 172.21.15.103:0/3439356971 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:19:59.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.457+0000 7f80da1bc700 1 -- 172.21.15.103:0/3439356971 >> v2:172.21.15.86:3300/0 conn(0x7f80d41434b0 msgr2=0x7f80d40b68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:59.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.457+0000 7f80da1bc700 1 --2- 172.21.15.103:0/3439356971 >> v2:172.21.15.86:3300/0 conn(0x7f80d41434b0 0x7f80d40b68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:59.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.457+0000 7f80da1bc700 1 -- 172.21.15.103:0/3439356971 >> v1:172.21.15.86:6789/0 conn(0x7f80d40b9890 legacy=0x7f80d4145390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:59.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.457+0000 7f80c6ffd700 1 -- 172.21.15.103:0/3439356971 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 306864265 0 0) 0x7f80d4060100 con 0x7f80d40b9890 2020-04-22T14:19:59.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.457+0000 7f80da1bc700 1 -- 172.21.15.103:0/3439356971 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d41580a0 con 0x7f80d41499f0 2020-04-22T14:19:59.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.457+0000 7f80d91ba700 1 --2- 172.21.15.103:0/3439356971 >> v2:172.21.15.86:3300/0 conn(0x7f80d41434b0 0x7f80d40b68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:19:59.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.457+0000 7f80da1bc700 1 --2- 172.21.15.103:0/3439356971 >> v2:172.21.15.103:3300/0 conn(0x7f80d41499f0 0x7f80d4157c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f80cc001210 tx=0x7f80cc010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.457+0000 7f80da1bc700 1 --2- 172.21.15.103:0/3439356971 >> v2:172.21.15.103:3300/0 conn(0x7f80d41499f0 0x7f80d4157c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f80cc001210 tx=0x7f80cc010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.457+0000 7f80da1bc700 1 --2- 172.21.15.103:0/3439356971 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80d41499f0 0x7f80d4157c40 secure :-1 s=READY pgs=2097 cs=0 l=1 rx=0x7f80cc001210 tx=0x7f80cc010bc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:59.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.457+0000 7f80da1bc700 1 --2- 172.21.15.103:0/3439356971 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80d41499f0 0x7f80d4157c40 secure :-1 s=THROTTLE_DONE pgs=2097 cs=0 l=1 rx=0x7f80cc001210 tx=0x7f80cc010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.457+0000 7f80c6ffd700 1 -- 172.21.15.103:0/3439356971 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80cc004c50 con 0x7f80d41499f0 2020-04-22T14:19:59.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.457+0000 7f80da1bc700 1 --2- 172.21.15.103:0/3439356971 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80d41499f0 0x7f80d4157c40 secure :-1 s=THROTTLE_DONE pgs=2097 cs=0 l=1 rx=0x7f80cc001210 tx=0x7f80cc010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.457+0000 7f80da1bc700 1 --2- 172.21.15.103:0/3439356971 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80d41499f0 0x7f80d4157c40 secure :-1 s=THROTTLE_DONE pgs=2097 cs=0 l=1 rx=0x7f80cc001210 tx=0x7f80cc010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.457+0000 7f80c6ffd700 1 -- 172.21.15.103:0/3439356971 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80cc004df0 con 0x7f80d41499f0 2020-04-22T14:19:59.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.457+0000 7f80dbc1f700 1 -- 172.21.15.103:0/3439356971 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80d40aeb90 con 0x7f80d41499f0 2020-04-22T14:19:59.471 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.458+0000 7f80c6ffd700 1 -- 172.21.15.103:0/3439356971 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80cc012750 con 0x7f80d41499f0 2020-04-22T14:19:59.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.458+0000 7f80dbc1f700 1 -- 172.21.15.103:0/3439356971 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80d412f3b0 con 0x7f80d41499f0 2020-04-22T14:19:59.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.458+0000 7f80da1bc700 1 --2- 172.21.15.103:0/3439356971 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80d41499f0 0x7f80d4157c40 secure :-1 s=THROTTLE_DONE pgs=2097 cs=0 l=1 rx=0x7f80cc001210 tx=0x7f80cc010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.458+0000 7f80c6ffd700 1 -- 172.21.15.103:0/3439356971 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f80cc013070 con 0x7f80d41499f0 2020-04-22T14:19:59.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.458+0000 7f80da1bc700 1 --2- 172.21.15.103:0/3439356971 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80d41499f0 0x7f80d4157c40 secure :-1 s=THROTTLE_DONE pgs=2097 cs=0 l=1 rx=0x7f80cc001210 tx=0x7f80cc010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.459+0000 7f80dbc1f700 1 -- 172.21.15.103:0/3439356971 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80d4056c90 con 0x7f80d41499f0 2020-04-22T14:19:59.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.459+0000 7f80c6ffd700 1 --2- 172.21.15.103:0/3439356971 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f80b404d900 0x7f80b404fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:59.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.459+0000 7f80c6ffd700 1 -- 172.21.15.103:0/3439356971 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f80cc061450 con 0x7f80d41499f0 2020-04-22T14:19:59.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.459+0000 7f80d99bb700 1 --2- 172.21.15.103:0/3439356971 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f80b404d900 0x7f80b404fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:59.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.459+0000 7f80d99bb700 1 --2- 172.21.15.103:0/3439356971 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f80b404d900 0x7f80b404fdc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f80c8000b80 tx=0x7f80c8011420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.459+0000 7f80d99bb700 1 --2- 172.21.15.103:0/3439356971 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f80b404d900 0x7f80b404fdc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f80c8000b80 tx=0x7f80c8011420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.459+0000 7f80d99bb700 1 --2- 172.21.15.103:0/3439356971 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f80b404d900 0x7f80b404fdc0 secure :-1 s=READY pgs=762 cs=0 l=1 rx=0x7f80c8000b80 tx=0x7f80c8011420).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:59.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.463+0000 7f80da1bc700 1 --2- 172.21.15.103:0/3439356971 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80d41499f0 0x7f80d4157c40 secure :-1 s=THROTTLE_DONE pgs=2097 cs=0 l=1 rx=0x7f80cc001210 tx=0x7f80cc010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.463+0000 7f80c6ffd700 1 -- 172.21.15.103:0/3439356971 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f80cc03c830 con 0x7f80d41499f0 2020-04-22T14:19:59.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.607+0000 7f80dbc1f700 1 -- 172.21.15.103:0/3439356971 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f80d40b39e0 con 0x7f80d41499f0 2020-04-22T14:19:59.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.608+0000 7f80da1bc700 1 --2- 172.21.15.103:0/3439356971 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80d41499f0 0x7f80d4157c40 secure :-1 s=THROTTLE_DONE pgs=2097 cs=0 l=1 rx=0x7f80cc001210 tx=0x7f80cc010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.611 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.608+0000 7f80c6ffd700 1 -- 172.21.15.103:0/3439356971 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v146) v1 ==== 100+0+10 (secure 0 0 0) 0x7f80cc03fe50 con 0x7f80d41499f0 2020-04-22T14:19:59.611 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:19:59.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.609+0000 7f80dbc1f700 1 -- 172.21.15.103:0/3439356971 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f80b404d900 msgr2=0x7f80b404fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:59.612 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.609+0000 7f80dbc1f700 1 --2- 172.21.15.103:0/3439356971 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f80b404d900 0x7f80b404fdc0 secure :-1 s=READY pgs=762 cs=0 l=1 rx=0x7f80c8000b80 tx=0x7f80c8011420).stop 2020-04-22T14:19:59.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.609+0000 7f80dbc1f700 1 -- 172.21.15.103:0/3439356971 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80d41499f0 msgr2=0x7f80d4157c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:59.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.609+0000 7f80dbc1f700 1 --2- 172.21.15.103:0/3439356971 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80d41499f0 0x7f80d4157c40 secure :-1 s=READY pgs=2097 cs=0 l=1 rx=0x7f80cc001210 tx=0x7f80cc010bc0).stop 2020-04-22T14:19:59.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.609+0000 7f80dbc1f700 1 -- 172.21.15.103:0/3439356971 shutdown_connections 2020-04-22T14:19:59.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.609+0000 7f80dbc1f700 1 --2- 172.21.15.103:0/3439356971 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80d41499f0 0x7f80d4157c40 unknown :-1 s=CLOSED pgs=2097 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:59.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.609+0000 7f80dbc1f700 1 --2- 172.21.15.103:0/3439356971 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f80b404d900 0x7f80b404fdc0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:59.613 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.609+0000 7f80dbc1f700 1 --2- 172.21.15.103:0/3439356971 >> v2:172.21.15.86:3300/0 conn(0x7f80d41434b0 0x7f80d40b68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:59.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.609+0000 7f80dbc1f700 1 -- 172.21.15.103:0/3439356971 >> 172.21.15.103:0/3439356971 conn(0x7f80d405ad30 msgr2=0x7f80d40b7480 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:59.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.609+0000 7f80dbc1f700 1 -- 172.21.15.103:0/3439356971 shutdown_connections 2020-04-22T14:19:59.614 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.609+0000 7f80dbc1f700 1 -- 172.21.15.103:0/3439356971 wait complete. 2020-04-22T14:19:59.622 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-04-22T14:19:59.622 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:19:59.635 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:19:59.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.779+0000 7f9ddcc0c700 1 Processor -- start 2020-04-22T14:19:59.782 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.779+0000 7f9ddcc0c700 1 -- start start 2020-04-22T14:19:59.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.780+0000 7f9ddcc0c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9dd80ad150 0x7f9dd80664a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:59.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.780+0000 7f9ddcc0c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9dd80654e0 0x7f9dd8063340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:19:59.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.780+0000 7f9ddcc0c700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dd8066a20 con 0x7f9dd8141c10 2020-04-22T14:19:59.785 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.780+0000 7f9ddcc0c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dd80adf30 con 0x7f9dd80ad150 2020-04-22T14:19:59.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.780+0000 7f9ddcc0c700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dd81427b0 con 0x7f9dd80654e0 2020-04-22T14:19:59.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.780+0000 7f9dd7fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9dd80654e0 0x7f9dd8063340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:59.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.780+0000 7f9dd7fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9dd80654e0 0x7f9dd8063340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58644/0 (socket says 172.21.15.103:58644) 2020-04-22T14:19:59.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.780+0000 7f9dd7fff700 1 -- 172.21.15.103:0/1279866323 learned_addr learned my addr 172.21.15.103:0/1279866323 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:19:59.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.780+0000 7f9dd77fe700 1 --2- 172.21.15.103:0/1279866323 >> v2:172.21.15.86:3300/0 conn(0x7f9dd80ad150 0x7f9dd80664a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:59.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.780+0000 7f9dd7fff700 1 -- 172.21.15.103:0/1279866323 >> v2:172.21.15.86:3300/0 conn(0x7f9dd80ad150 msgr2=0x7f9dd80664a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:59.786 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.780+0000 7f9dd7fff700 1 --2- 172.21.15.103:0/1279866323 >> v2:172.21.15.86:3300/0 conn(0x7f9dd80ad150 0x7f9dd80664a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:59.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.780+0000 7f9dd7fff700 1 -- 172.21.15.103:0/1279866323 >> v1:172.21.15.86:6789/0 conn(0x7f9dd8141c10 legacy=0x7f9dd81420a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:19:59.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.780+0000 7f9dd7fff700 1 -- 172.21.15.103:0/1279866323 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd80ad7f0 con 0x7f9dd80654e0 2020-04-22T14:19:59.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.780+0000 7f9dd7fff700 1 --2- 172.21.15.103:0/1279866323 >> v2:172.21.15.103:3300/0 conn(0x7f9dd80654e0 0x7f9dd8063340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9dd806a000 tx=0x7f9dd0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.780+0000 7f9dd7fff700 1 --2- 172.21.15.103:0/1279866323 >> v2:172.21.15.103:3300/0 conn(0x7f9dd80654e0 0x7f9dd8063340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9dd806a000 tx=0x7f9dd0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.780+0000 7f9dd7fff700 1 --2- 172.21.15.103:0/1279866323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dd80654e0 0x7f9dd8063340 secure :-1 s=READY pgs=2098 cs=0 l=1 rx=0x7f9dd806a000 tx=0x7f9dd0007a40).ready entity=mon.1 client_cookie=8172b3ac1d1b440b server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:59.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.780+0000 7f9dd7fff700 1 --2- 172.21.15.103:0/1279866323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dd80654e0 0x7f9dd8063340 secure :-1 s=THROTTLE_DONE pgs=2098 cs=0 l=1 rx=0x7f9dd806a000 tx=0x7f9dd0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.787 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.780+0000 7f9dd67fc700 1 -- 172.21.15.103:0/1279866323 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9dd00116e0 con 0x7f9dd80654e0 2020-04-22T14:19:59.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.780+0000 7f9dd7fff700 1 --2- 172.21.15.103:0/1279866323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dd80654e0 0x7f9dd8063340 secure :-1 s=THROTTLE_DONE pgs=2098 cs=0 l=1 rx=0x7f9dd806a000 tx=0x7f9dd0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.780+0000 7f9dd7fff700 1 --2- 172.21.15.103:0/1279866323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dd80654e0 0x7f9dd8063340 secure :-1 s=THROTTLE_DONE pgs=2098 cs=0 l=1 rx=0x7f9dd806a000 tx=0x7f9dd0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.780+0000 7f9dd67fc700 1 -- 172.21.15.103:0/1279866323 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd0011840 con 0x7f9dd80654e0 2020-04-22T14:19:59.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.780+0000 7f9dd67fc700 1 -- 172.21.15.103:0/1279866323 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9dd0011c20 con 0x7f9dd80654e0 2020-04-22T14:19:59.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.780+0000 7f9ddcc0c700 1 -- 172.21.15.103:0/1279866323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dd80654e0 msgr2=0x7f9dd8063340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:59.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.780+0000 7f9ddcc0c700 1 --2- 172.21.15.103:0/1279866323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dd80654e0 0x7f9dd8063340 secure :-1 s=READY pgs=2098 cs=0 l=1 rx=0x7f9dd806a000 tx=0x7f9dd0007a40).stop 2020-04-22T14:19:59.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.781+0000 7f9ddcc0c700 1 -- 172.21.15.103:0/1279866323 shutdown_connections 2020-04-22T14:19:59.788 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.781+0000 7f9ddcc0c700 1 --2- 172.21.15.103:0/1279866323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dd80654e0 0x7f9dd8063340 unknown :-1 s=CLOSED pgs=2098 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:59.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.781+0000 7f9ddcc0c700 1 --2- 172.21.15.103:0/1279866323 >> v2:172.21.15.86:3300/0 conn(0x7f9dd80ad150 0x7f9dd80664a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:19:59.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.781+0000 7f9ddcc0c700 1 -- 172.21.15.103:0/1279866323 >> 172.21.15.103:0/1279866323 conn(0x7f9dd805b7c0 msgr2=0x7f9dd8061610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:59.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.781+0000 7f9ddcc0c700 1 -- 172.21.15.103:0/1279866323 shutdown_connections 2020-04-22T14:19:59.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.781+0000 7f9ddcc0c700 1 -- 172.21.15.103:0/1279866323 wait complete. 2020-04-22T14:19:59.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.782+0000 7f9ddcc0c700 1 Processor -- start 2020-04-22T14:19:59.789 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.782+0000 7f9ddcc0c700 1 -- start start 2020-04-22T14:19:59.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.783+0000 7f9ddcc0c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9dd8141c10 0x7f9dd80b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:59.793 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.783+0000 7f9ddcc0c700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dd80aee90 con 0x7f9dd80654e0 2020-04-22T14:19:59.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.783+0000 7f9ddcc0c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dd80b1770 con 0x7f9dd80ad150 2020-04-22T14:19:59.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.783+0000 7f9ddcc0c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dd80b1a10 con 0x7f9dd8141c10 2020-04-22T14:19:59.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.783+0000 7f9dd6ffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f9dd80ad150 0x7f9dd80ae780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50838/0 (socket says 172.21.15.103:50838) 2020-04-22T14:19:59.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.783+0000 7f9dd6ffd700 1 -- 172.21.15.103:0/3294493928 learned_addr learned my addr 172.21.15.103:0/3294493928 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:19:59.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.783+0000 7f9dd7fff700 1 --2- 172.21.15.103:0/3294493928 >> v2:172.21.15.86:3300/0 conn(0x7f9dd8141c10 0x7f9dd80b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:59.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.783+0000 7f9dd4ff9700 1 -- 172.21.15.103:0/3294493928 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3099031519 0 0) 0x7f9dd80b1770 con 0x7f9dd80ad150 2020-04-22T14:19:59.794 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.783+0000 7f9dd4ff9700 1 -- 172.21.15.103:0/3294493928 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dbc002fe0 con 0x7f9dd80ad150 2020-04-22T14:19:59.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.783+0000 7f9dd4ff9700 1 -- 172.21.15.103:0/3294493928 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3704170417 0 0) 0x7f9dbc002fe0 con 0x7f9dd80ad150 2020-04-22T14:19:59.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.783+0000 7f9dd4ff9700 1 -- 172.21.15.103:0/3294493928 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9dd80b1770 con 0x7f9dd80ad150 2020-04-22T14:19:59.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.783+0000 7f9dd4ff9700 1 -- 172.21.15.103:0/3294493928 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f9dc00029a0 con 0x7f9dd80ad150 2020-04-22T14:19:59.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.783+0000 7f9dd4ff9700 1 -- 172.21.15.103:0/3294493928 >> v2:172.21.15.86:3300/0 conn(0x7f9dd8141c10 msgr2=0x7f9dd80b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:59.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.783+0000 7f9dd4ff9700 1 --2- 172.21.15.103:0/3294493928 >> v2:172.21.15.86:3300/0 conn(0x7f9dd8141c10 0x7f9dd80b3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:59.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.783+0000 7f9dd4ff9700 1 -- 172.21.15.103:0/3294493928 >> v1:172.21.15.103:6789/0 conn(0x7f9dd80ad150 legacy=0x7f9dd80ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:59.795 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.783+0000 7f9dd4ff9700 1 -- 172.21.15.103:0/3294493928 >> v1:172.21.15.86:6789/0 conn(0x7f9dd80654e0 legacy=0x7f9dd80ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:59.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.783+0000 7f9dd4ff9700 1 --2- 172.21.15.103:0/3294493928 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9dbc0049b0 0x7f9dbc004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:59.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.783+0000 7f9dd4ff9700 1 --2- 172.21.15.103:0/3294493928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dbc005290 0x7f9dbc0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:59.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.783+0000 7f9dd4ff9700 1 --2- 172.21.15.103:0/3294493928 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9dbc003f10 0x7f9dbc004390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:59.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.783+0000 7f9dd4ff9700 1 -- 172.21.15.103:0/3294493928 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd80b1a10 con 0x7f9dbc0049b0 2020-04-22T14:19:59.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.783+0000 7f9dd4ff9700 1 -- 172.21.15.103:0/3294493928 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc00b890 con 0x7f9dbc005290 2020-04-22T14:19:59.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.783+0000 7f9dd4ff9700 1 -- 172.21.15.103:0/3294493928 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc00ba50 con 0x7f9dbc003f10 2020-04-22T14:19:59.796 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.783+0000 7f9dd7fff700 1 --2- 172.21.15.103:0/3294493928 >> v2:172.21.15.86:3300/0 conn(0x7f9dd8141c10 0x7f9dd80b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:19:59.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.783+0000 7f9dd6ffd700 1 --2- 172.21.15.103:0/3294493928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dbc005290 0x7f9dbc0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:59.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.783+0000 7f9dd77fe700 1 --2- 172.21.15.103:0/3294493928 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9dbc0049b0 0x7f9dbc004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:59.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.784+0000 7f9dd7fff700 1 --2- 172.21.15.103:0/3294493928 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9dbc003f10 0x7f9dbc004390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:59.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.784+0000 7f9dd6ffd700 1 -- 172.21.15.103:0/3294493928 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9dbc003f10 msgr2=0x7f9dbc004390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:59.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.784+0000 7f9dd6ffd700 1 --2- 172.21.15.103:0/3294493928 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9dbc003f10 0x7f9dbc004390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:59.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.784+0000 7f9dd6ffd700 1 -- 172.21.15.103:0/3294493928 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9dbc0049b0 msgr2=0x7f9dbc004d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:59.797 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.784+0000 7f9dd6ffd700 1 --2- 172.21.15.103:0/3294493928 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9dbc0049b0 0x7f9dbc004d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:59.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.784+0000 7f9dd6ffd700 1 -- 172.21.15.103:0/3294493928 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd80b1cb0 con 0x7f9dbc005290 2020-04-22T14:19:59.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.784+0000 7f9dd7fff700 1 -- 172.21.15.103:0/3294493928 reap_dead start 2020-04-22T14:19:59.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.784+0000 7f9ddcc0c700 1 -- 172.21.15.103:0/3294493928 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dd80af650 con 0x7f9dbc005290 2020-04-22T14:19:59.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.784+0000 7f9dd6ffd700 1 --2- 172.21.15.103:0/3294493928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dbc005290 0x7f9dbc0039a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9dc00026b0 tx=0x7f9dc0011460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.784+0000 7f9ddcc0c700 1 -- 172.21.15.103:0/3294493928 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dd8138290 con 0x7f9dbc005290 2020-04-22T14:19:59.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.784+0000 7f9dd6ffd700 1 --2- 172.21.15.103:0/3294493928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dbc005290 0x7f9dbc0039a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9dc00026b0 tx=0x7f9dc0011460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.798 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.784+0000 7f9dd6ffd700 1 --2- 172.21.15.103:0/3294493928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dbc005290 0x7f9dbc0039a0 secure :-1 s=READY pgs=2100 cs=0 l=1 rx=0x7f9dc00026b0 tx=0x7f9dc0011460).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:59.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.784+0000 7f9dd6ffd700 1 --2- 172.21.15.103:0/3294493928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dbc005290 0x7f9dbc0039a0 secure :-1 s=THROTTLE_DONE pgs=2100 cs=0 l=1 rx=0x7f9dc00026b0 tx=0x7f9dc0011460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.784+0000 7f9dd4ff9700 1 -- 172.21.15.103:0/3294493928 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9dc0011dc0 con 0x7f9dbc005290 2020-04-22T14:19:59.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.784+0000 7f9dd6ffd700 1 --2- 172.21.15.103:0/3294493928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dbc005290 0x7f9dbc0039a0 secure :-1 s=THROTTLE_DONE pgs=2100 cs=0 l=1 rx=0x7f9dc00026b0 tx=0x7f9dc0011460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.784+0000 7f9dd6ffd700 1 --2- 172.21.15.103:0/3294493928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dbc005290 0x7f9dbc0039a0 secure :-1 s=THROTTLE_DONE pgs=2100 cs=0 l=1 rx=0x7f9dc00026b0 tx=0x7f9dc0011460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.784+0000 7f9dd4ff9700 1 -- 172.21.15.103:0/3294493928 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc000b080 con 0x7f9dbc005290 2020-04-22T14:19:59.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.784+0000 7f9dd4ff9700 1 -- 172.21.15.103:0/3294493928 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9dc000b420 con 0x7f9dbc005290 2020-04-22T14:19:59.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.785+0000 7f9dd6ffd700 1 --2- 172.21.15.103:0/3294493928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dbc005290 0x7f9dbc0039a0 secure :-1 s=THROTTLE_DONE pgs=2100 cs=0 l=1 rx=0x7f9dc00026b0 tx=0x7f9dc0011460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.799 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.785+0000 7f9ddcc0c700 1 -- 172.21.15.103:0/3294493928 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9db0003340 con 0x7f9dbc005290 2020-04-22T14:19:59.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.785+0000 7f9dd4ff9700 1 -- 172.21.15.103:0/3294493928 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f9dc000a640 con 0x7f9dbc005290 2020-04-22T14:19:59.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.785+0000 7f9dd6ffd700 1 --2- 172.21.15.103:0/3294493928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dbc005290 0x7f9dbc0039a0 secure :-1 s=THROTTLE_DONE pgs=2100 cs=0 l=1 rx=0x7f9dc00026b0 tx=0x7f9dc0011460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.785+0000 7f9dd4ff9700 1 --2- 172.21.15.103:0/3294493928 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9dbc051860 0x7f9dbc053d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:19:59.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.785+0000 7f9dd4ff9700 1 -- 172.21.15.103:0/3294493928 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9dc0061500 con 0x7f9dbc005290 2020-04-22T14:19:59.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.785+0000 7f9dd77fe700 1 --2- 172.21.15.103:0/3294493928 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9dbc051860 0x7f9dbc053d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:19:59.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.786+0000 7f9dd77fe700 1 --2- 172.21.15.103:0/3294493928 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9dbc051860 0x7f9dbc053d20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9dc80033f0 tx=0x7f9dc8003180).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.800 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.786+0000 7f9dd77fe700 1 --2- 172.21.15.103:0/3294493928 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9dbc051860 0x7f9dbc053d20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9dc80033f0 tx=0x7f9dc8003180).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.786+0000 7f9dd77fe700 1 --2- 172.21.15.103:0/3294493928 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9dbc051860 0x7f9dbc053d20 secure :-1 s=READY pgs=763 cs=0 l=1 rx=0x7f9dc80033f0 tx=0x7f9dc8003180).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:19:59.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.789+0000 7f9dd6ffd700 1 --2- 172.21.15.103:0/3294493928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dbc005290 0x7f9dbc0039a0 secure :-1 s=THROTTLE_DONE pgs=2100 cs=0 l=1 rx=0x7f9dc00026b0 tx=0x7f9dc0011460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.801 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.789+0000 7f9dd4ff9700 1 -- 172.21.15.103:0/3294493928 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f9dc003c8e0 con 0x7f9dbc005290 2020-04-22T14:19:59.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.981+0000 7f9ddcc0c700 1 -- 172.21.15.103:0/3294493928 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9db00036e0 con 0x7f9dbc005290 2020-04-22T14:19:59.984 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.981+0000 7f9dd6ffd700 1 --2- 172.21.15.103:0/3294493928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dbc005290 0x7f9dbc0039a0 secure :-1 s=THROTTLE_DONE pgs=2100 cs=0 l=1 rx=0x7f9dc00026b0 tx=0x7f9dc0011460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:19:59.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.981+0000 7f9dd4ff9700 1 -- 172.21.15.103:0/3294493928 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) v1 ==== 95+0+2146 (secure 0 0 0) 0x7f9dc003ff00 con 0x7f9dbc005290 2020-04-22T14:19:59.985 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:19:59.985 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":107,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6743,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2675694784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2675694784},{"type":"v1","addr":"172.21.15.86:6835","nonce":2675694784}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":104}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:19:46.112631+0000","modified":"2020-04-22T14:19:48.115224+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9703},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9703":{"gid":9703,"name":"a","rank":0,"incarnation":105,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/839133818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":839133818},{"type":"v1","addr":"172.21.15.103:6833","nonce":839133818}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-04-22T14:19:59.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.982+0000 7f9ddcc0c700 1 -- 172.21.15.103:0/3294493928 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9dbc051860 msgr2=0x7f9dbc053d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:59.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.982+0000 7f9ddcc0c700 1 --2- 172.21.15.103:0/3294493928 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9dbc051860 0x7f9dbc053d20 secure :-1 s=READY pgs=763 cs=0 l=1 rx=0x7f9dc80033f0 tx=0x7f9dc8003180).stop 2020-04-22T14:19:59.986 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.982+0000 7f9ddcc0c700 1 -- 172.21.15.103:0/3294493928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dbc005290 msgr2=0x7f9dbc0039a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:19:59.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.982+0000 7f9ddcc0c700 1 --2- 172.21.15.103:0/3294493928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dbc005290 0x7f9dbc0039a0 secure :-1 s=READY pgs=2100 cs=0 l=1 rx=0x7f9dc00026b0 tx=0x7f9dc0011460).stop 2020-04-22T14:19:59.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.982+0000 7f9ddcc0c700 1 -- 172.21.15.103:0/3294493928 shutdown_connections 2020-04-22T14:19:59.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.982+0000 7f9ddcc0c700 1 --2- 172.21.15.103:0/3294493928 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9dbc051860 0x7f9dbc053d20 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:59.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.982+0000 7f9ddcc0c700 1 --2- 172.21.15.103:0/3294493928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dbc005290 0x7f9dbc0039a0 unknown :-1 s=CLOSED pgs=2100 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:19:59.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.982+0000 7f9ddcc0c700 1 -- 172.21.15.103:0/3294493928 >> 172.21.15.103:0/3294493928 conn(0x7f9dd805b7c0 msgr2=0x7f9dd81420a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:19:59.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.983+0000 7f9ddcc0c700 1 -- 172.21.15.103:0/3294493928 shutdown_connections 2020-04-22T14:19:59.987 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:19:59.983+0000 7f9ddcc0c700 1 -- 172.21.15.103:0/3294493928 wait complete. 2020-04-22T14:19:59.988 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 107 2020-04-22T14:20:00.198 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 9703}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 25, u'failed': [], u'epoch': 107, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [26], u'info': {u'gid_9703': {u'export_targets': [], u'name': u'a', u'incarnation': 105, u'state_seq': 3, u'state': u'up:active', u'gid': 9703, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 839133818, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 839133818, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/839133818'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:19:46.112631+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:19:48.115224+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:20:00.198 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:20:00.199 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:00.212 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:20:00.372 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:20:00.372 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:20:00.372 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:20:00.372 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 9703, 2020-04-22T14:20:00.372 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:20:00.373 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:20:00.373 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 14.255735552000001, 2020-04-22T14:20:00.373 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 107, 2020-04-22T14:20:00.373 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 146, 2020-04-22T14:20:00.373 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 146, 2020-04-22T14:20:00.373 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 19.466860278999999 2020-04-22T14:20:00.374 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:20:00.380 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 9703, "want_state": "up:active", "state": "up:active", "rank_uptime": 14.255735552000001, "mdsmap_epoch": 107, "osdmap_epoch": 146, "osdmap_epoch_barrier": 146, "uptime": 19.466860278999999 } 2020-04-22T14:20:00.381 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-04-22T14:20:00.381 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-04-22T14:20:00.381 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:00.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:00.394 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:20:00.452 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:20:00.453 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:20:00.453 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:20:00.453 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:00.453 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:20:00.453 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:00.453 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:20:00.453 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:00.453 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:20:00.454 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:00.454 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:20:00.454 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:00.454 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:20:00.454 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:00.454 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:20:00.454 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 41640sec preferred_lft 41640sec 2020-04-22T14:20:00.455 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:20:00.455 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:00.455 INFO:teuthology.orchestra.run.smithi103.stdout:44: brx.4@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:20:00.455 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether ce:62:6d:2c:c1:6d brd ff:ff:ff:ff:ff:ff link-netnsid 4 2020-04-22T14:20:00.455 INFO:teuthology.orchestra.run.smithi103.stdout:46: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:20:00.455 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether f6:69:77:c1:44:bd brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:00.455 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:20:00.456 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:00.456 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::3c5:c758:d319:26f6/64 scope link noprefixroute 2020-04-22T14:20:00.456 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:00.456 INFO:teuthology.orchestra.run.smithi103.stdout:47: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-04-22T14:20:00.456 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether f6:69:77:c1:44:bd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2020-04-22T14:20:00.456 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:00.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:00.501 INFO:teuthology.orchestra.run.smithi103:> ip netns list 2020-04-22T14:20:00.560 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2020-04-22T14:20:00.560 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:00.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:00.608 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:20:00.667 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2020-04-22T14:20:00.667 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 4 2020-04-22T14:20:00.667 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:00.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:00.715 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:20:00.774 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2020-04-22T14:20:00.774 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 4 2020-04-22T14:20:00.774 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:00.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:00.829 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:20:00.906 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:00.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:00.953 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 1' 2020-04-22T14:20:01.029 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:01.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:01.075 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr' 2020-04-22T14:20:01.182 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:20:01.182 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:20:01.183 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:20:01.183 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:01.183 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:20:01.183 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:01.183 INFO:teuthology.orchestra.run.smithi103.stdout:2: veth0@if47: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:20:01.183 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether fa:b9:75:58:8c:a0 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:20:01.183 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2020-04-22T14:20:01.184 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:01.184 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::f8b9:75ff:fe58:8ca0/64 scope link 2020-04-22T14:20:01.184 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:01.184 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:01.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:01.212 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr' 2020-04-22T14:20:01.319 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:20:01.319 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:20:01.319 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:20:01.320 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:01.320 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:20:01.320 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:01.320 INFO:teuthology.orchestra.run.smithi103.stdout:2: veth0@if47: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:20:01.320 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether fa:b9:75:58:8c:a0 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:20:01.320 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2020-04-22T14:20:01.321 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:01.321 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::f8b9:75ff:fe58:8ca0/64 scope link 2020-04-22T14:20:01.321 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:01.321 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.2/16 2020-04-22T14:20:01.321 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:01.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:01.351 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.1' 2020-04-22T14:20:01.431 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:01.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:01.474 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0' 2020-04-22T14:20:01.584 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:01.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:01.613 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up' 2020-04-22T14:20:01.720 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:01.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:01.734 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up' 2020-04-22T14:20:01.842 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:01.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:01.879 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254' 2020-04-22T14:20:01.986 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:02.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:02.000 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:20:02.078 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:02.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:02.126 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge-slave con-name brx.1 ifname brx.1 master ceph-brx' 2020-04-22T14:20:02.241 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.1' (1e2c85a4-f18a-4c67-a6f1-a640d4fc712b) successfully added. 2020-04-22T14:20:02.242 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:02.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:02.256 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up brx.1' 2020-04-22T14:20:02.415 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/59) 2020-04-22T14:20:02.466 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2020-04-22T14:20:02.466 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi103.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2020-04-22T14:20:02.466 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:02.486 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:20:02.486 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:20:02.545 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:02.593 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:20:02.593 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:20:02.662 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:20:02.668 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:20:02.669 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:02.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:20:02.716 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:20:02.775 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:20:02.776 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [47] 2020-04-22T14:20:02.776 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:02.826 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:20:02.868 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:02.881 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:20:02.882 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:20:02.951 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:20:02.956 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:2020-04-22T14:20:02.953+0000 7f10b01c61c0 -1 init, newargv = 0x564ab4a11e10 newargc=9 2020-04-22T14:20:02.956 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[124013]: starting ceph client 2020-04-22T14:20:02.958 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:20:02.958 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:02.969 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[124013]: starting fuse 2020-04-22T14:20:02.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:20:02.973 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:20:03.032 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:20:03.032 INFO:teuthology.orchestra.run.smithi103.stdout:49 2020-04-22T14:20:03.032 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47, 49] 2020-04-22T14:20:03.032 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:03.079 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:20:03.080 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:20:03.080 INFO:teuthology.orchestra.run.smithi103:> import glob 2020-04-22T14:20:03.080 INFO:teuthology.orchestra.run.smithi103:> import re 2020-04-22T14:20:03.081 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:20:03.081 INFO:teuthology.orchestra.run.smithi103:> import subprocess 2020-04-22T14:20:03.081 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:20:03.081 INFO:teuthology.orchestra.run.smithi103:> def find_socket(client_name): 2020-04-22T14:20:03.081 INFO:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2020-04-22T14:20:03.081 INFO:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2020-04-22T14:20:03.082 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:20:03.082 INFO:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2020-04-22T14:20:03.082 INFO:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2020-04-22T14:20:03.082 INFO:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2020-04-22T14:20:03.082 INFO:teuthology.orchestra.run.smithi103:> return files[0] 2020-04-22T14:20:03.082 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:20:03.082 INFO:teuthology.orchestra.run.smithi103:> for f in files: 2020-04-22T14:20:03.082 INFO:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:20:03.082 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:20:03.083 INFO:teuthology.orchestra.run.smithi103:> return f 2020-04-22T14:20:03.083 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:20:03.083 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:20:03.083 INFO:teuthology.orchestra.run.smithi103:> print(find_socket("client.1")) 2020-04-22T14:20:03.083 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:20:03.187 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.1.124013.asok 2020-04-22T14:20:03.187 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.124013.asok 2020-04-22T14:20:03.187 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:03.200 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:20:03.200 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.124013.asok status 2020-04-22T14:20:03.373 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:20:03.373 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2020-04-22T14:20:03.373 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:20:03.373 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:20:03.373 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "1", 2020-04-22T14:20:03.374 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:20:03.374 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2020-04-22T14:20:03.374 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "124013", 2020-04-22T14:20:03.374 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:20:03.374 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:03.374 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2020-04-22T14:20:03.374 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2020-04-22T14:20:03.374 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 9949, 2020-04-22T14:20:03.375 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2020-04-22T14:20:03.375 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:20:03.375 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:20:03.375 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 9949 2020-04-22T14:20:03.375 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:03.375 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:20:03.375 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:20:03.376 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.2:0", 2020-04-22T14:20:03.376 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 379068779 2020-04-22T14:20:03.376 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:03.376 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:03.376 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:20:03.376 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:20:03.376 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.2:0", 2020-04-22T14:20:03.377 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 379068779 2020-04-22T14:20:03.377 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:03.378 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.9949 192.168.0.2:0/379068779", 2020-04-22T14:20:03.378 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.2:0/379068779", 2020-04-22T14:20:03.378 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2020-04-22T14:20:03.379 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 107, 2020-04-22T14:20:03.380 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 146, 2020-04-22T14:20:03.380 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2020-04-22T14:20:03.381 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklisted": false 2020-04-22T14:20:03.381 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:20:03.381 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:03.395 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:20:03.395 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-22T14:20:03.395 INFO:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:20:03.472 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2020-04-22T14:20:03.472 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-04-22T14:20:03.475 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:03.511 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:20:03.511 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:20:03.582 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:03.634 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok config get mds_reconnect_timeout 2020-04-22T14:20:03.787 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:20:03.788 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_reconnect_timeout": "45.000000" 2020-04-22T14:20:03.788 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:20:03.796 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_reconnect_timeout": "45.000000" } 2020-04-22T14:20:03.796 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:03.810 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok config get ms_max_backoff 2020-04-22T14:20:03.964 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:20:03.964 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_max_backoff": "15.000000" 2020-04-22T14:20:03.964 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:20:03.972 INFO:tasks.cephfs.filesystem:_json_asok output: { "ms_max_backoff": "15.000000" } 2020-04-22T14:20:03.972 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:03.985 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:20:03.985 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:20:03.986 INFO:teuthology.orchestra.run.smithi103:> import glob 2020-04-22T14:20:03.986 INFO:teuthology.orchestra.run.smithi103:> import re 2020-04-22T14:20:03.986 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:20:03.986 INFO:teuthology.orchestra.run.smithi103:> import subprocess 2020-04-22T14:20:03.986 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:20:03.986 INFO:teuthology.orchestra.run.smithi103:> def find_socket(client_name): 2020-04-22T14:20:03.986 INFO:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-04-22T14:20:03.986 INFO:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2020-04-22T14:20:03.987 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:20:03.987 INFO:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2020-04-22T14:20:03.987 INFO:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2020-04-22T14:20:03.987 INFO:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2020-04-22T14:20:03.987 INFO:teuthology.orchestra.run.smithi103:> return files[0] 2020-04-22T14:20:03.987 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:20:03.987 INFO:teuthology.orchestra.run.smithi103:> for f in files: 2020-04-22T14:20:03.987 INFO:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:20:03.988 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:20:03.988 INFO:teuthology.orchestra.run.smithi103:> return f 2020-04-22T14:20:03.988 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:20:03.988 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:20:03.988 INFO:teuthology.orchestra.run.smithi103:> print(find_socket("client.0")) 2020-04-22T14:20:03.988 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:20:04.104 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.0.122752.asok 2020-04-22T14:20:04.106 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.122752.asok 2020-04-22T14:20:04.106 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:04.120 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:20:04.120 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.122752.asok mds_sessions 2020-04-22T14:20:04.281 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:20:04.281 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 9904, 2020-04-22T14:20:04.282 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2020-04-22T14:20:04.282 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:20:04.282 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:20:04.282 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 9904 2020-04-22T14:20:04.283 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:04.283 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:20:04.283 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:20:04.283 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:20:04.284 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 3303065033 2020-04-22T14:20:04.284 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:04.284 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:04.284 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.9904 v1:192.168.0.1:0/3303065033", 2020-04-22T14:20:04.287 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "v1:192.168.0.1:0/3303065033", 2020-04-22T14:20:04.287 INFO:teuthology.orchestra.run.smithi103.stdout: "sessions": [ 2020-04-22T14:20:04.288 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:04.288 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": 0, 2020-04-22T14:20:04.288 INFO:teuthology.orchestra.run.smithi103.stdout: "addrs": { 2020-04-22T14:20:04.288 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:20:04.288 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:04.289 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:20:04.289 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6832", 2020-04-22T14:20:04.289 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 839133818 2020-04-22T14:20:04.289 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:04.289 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:04.290 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:20:04.290 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6833", 2020-04-22T14:20:04.290 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 839133818 2020-04-22T14:20:04.290 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:04.291 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:04.291 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:04.291 INFO:teuthology.orchestra.run.smithi103.stdout: "seq": 0, 2020-04-22T14:20:04.291 INFO:teuthology.orchestra.run.smithi103.stdout: "cap_gen": 0, 2020-04-22T14:20:04.291 INFO:teuthology.orchestra.run.smithi103.stdout: "cap_ttl": "2020-04-22T14:20:58.347128+0000", 2020-04-22T14:20:04.291 INFO:teuthology.orchestra.run.smithi103.stdout: "last_cap_renew_request": "2020-04-22T14:19:58.347128+0000", 2020-04-22T14:20:04.291 INFO:teuthology.orchestra.run.smithi103.stdout: "cap_renew_seq": 2, 2020-04-22T14:20:04.292 INFO:teuthology.orchestra.run.smithi103.stdout: "num_caps": 1, 2020-04-22T14:20:04.292 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "open" 2020-04-22T14:20:04.292 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:04.292 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:20:04.292 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 107 2020-04-22T14:20:04.292 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:20:04.315 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-04-22T14:20:04.315 INFO:teuthology.orchestra.run:waiting for 300 2020-04-22T14:20:04.315 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-04-22T14:20:04.316 INFO:teuthology.orchestra.run:waiting for 300 2020-04-22T14:20:04.323 INFO:tasks.ceph.mds.a:Stopped 2020-04-22T14:20:04.323 DEBUG:teuthology.parallel:result is None 2020-04-22T14:20:04.325 INFO:tasks.ceph.mds.b:Stopped 2020-04-22T14:20:04.326 DEBUG:teuthology.parallel:result is None 2020-04-22T14:20:04.326 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:04.326 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:04.377 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mds fail b 2020-04-22T14:20:04.378 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mds fail a 2020-04-22T14:20:04.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.525+0000 7fa512227700 1 Processor -- start 2020-04-22T14:20:04.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.525+0000 7fa512227700 1 -- start start 2020-04-22T14:20:04.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.525+0000 7efdddd21700 1 Processor -- start 2020-04-22T14:20:04.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.525+0000 7efdddd21700 1 -- start start 2020-04-22T14:20:04.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.526+0000 7efdddd21700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7efdd8146210 0x7efdd81465f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:04.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.526+0000 7efdddd21700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efdd8142400 0x7efdd80ac740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:04.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.526+0000 7efdddd21700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdd80b3a60 con 0x7efdd80af280 2020-04-22T14:20:04.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.526+0000 7efdddd21700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdd80b4ea0 con 0x7efdd8146210 2020-04-22T14:20:04.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.526+0000 7efdddd21700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd80adad0 con 0x7efdd8142400 2020-04-22T14:20:04.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.526+0000 7efdd7fff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efdd8142400 0x7efdd80ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:04.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.526+0000 7efdd77fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7efdd8146210 0x7efdd81465f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:04.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.526+0000 7efdd77fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7efdd8146210 0x7efdd81465f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:55918/0 (socket says 172.21.15.103:55918) 2020-04-22T14:20:04.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.526+0000 7efdd7fff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efdd8142400 0x7efdd80ac740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:43468/0 (socket says 172.21.15.103:43468) 2020-04-22T14:20:04.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.526+0000 7efdd77fe700 1 -- 172.21.15.103:0/2255080969 learned_addr learned my addr 172.21.15.103:0/2255080969 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:04.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.526+0000 7efdd77fe700 1 -- 172.21.15.103:0/2255080969 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efdd8142400 msgr2=0x7efdd80ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:04.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.526+0000 7efdd77fe700 1 --2- 172.21.15.103:0/2255080969 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efdd8142400 0x7efdd80ac740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:04.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.526+0000 7efdd77fe700 1 -- 172.21.15.103:0/2255080969 >> v1:172.21.15.86:6789/0 conn(0x7efdd80af280 legacy=0x7efdd8141cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:04.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.526+0000 7efdd77fe700 1 -- 172.21.15.103:0/2255080969 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd80add70 con 0x7efdd8146210 2020-04-22T14:20:04.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.526+0000 7efdd7fff700 1 --2- 172.21.15.103:0/2255080969 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efdd8142400 0x7efdd80ac740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:20:04.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.526+0000 7efdd77fe700 1 --2- 172.21.15.103:0/2255080969 >> v2:172.21.15.86:3300/0 conn(0x7efdd8146210 0x7efdd81465f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efdc8002f30 tx=0x7efdc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:04.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.527+0000 7efdd77fe700 1 --2- 172.21.15.103:0/2255080969 >> v2:172.21.15.86:3300/0 conn(0x7efdd8146210 0x7efdd81465f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efdc8002f30 tx=0x7efdc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:04.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.527+0000 7efdd77fe700 1 --2- 172.21.15.103:0/2255080969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdd8146210 0x7efdd81465f0 secure :-1 s=READY pgs=1105 cs=0 l=1 rx=0x7efdc8002f30 tx=0x7efdc8007a40).ready entity=mon.0 client_cookie=4b64e721ed7289c3 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:04.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.527+0000 7efdd77fe700 1 --2- 172.21.15.103:0/2255080969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdd8146210 0x7efdd81465f0 secure :-1 s=THROTTLE_DONE pgs=1105 cs=0 l=1 rx=0x7efdc8002f30 tx=0x7efdc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:04.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.527+0000 7efdd67fc700 1 -- 172.21.15.103:0/2255080969 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdc8013880 con 0x7efdd8146210 2020-04-22T14:20:04.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.527+0000 7efdd77fe700 1 --2- 172.21.15.103:0/2255080969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdd8146210 0x7efdd81465f0 secure :-1 s=THROTTLE_DONE pgs=1105 cs=0 l=1 rx=0x7efdc8002f30 tx=0x7efdc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:04.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.527+0000 7efdd77fe700 1 --2- 172.21.15.103:0/2255080969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdd8146210 0x7efdd81465f0 secure :-1 s=THROTTLE_DONE pgs=1105 cs=0 l=1 rx=0x7efdc8002f30 tx=0x7efdc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:04.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.527+0000 7efdd67fc700 1 -- 172.21.15.103:0/2255080969 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc8013a20 con 0x7efdd8146210 2020-04-22T14:20:04.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.527+0000 7efdd67fc700 1 -- 172.21.15.103:0/2255080969 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdc8013e40 con 0x7efdd8146210 2020-04-22T14:20:04.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.527+0000 7efdddd21700 1 -- 172.21.15.103:0/2255080969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdd8146210 msgr2=0x7efdd81465f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:04.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.527+0000 7efdddd21700 1 --2- 172.21.15.103:0/2255080969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdd8146210 0x7efdd81465f0 secure :-1 s=READY pgs=1105 cs=0 l=1 rx=0x7efdc8002f30 tx=0x7efdc8007a40).stop 2020-04-22T14:20:04.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.527+0000 7efdddd21700 1 -- 172.21.15.103:0/2255080969 shutdown_connections 2020-04-22T14:20:04.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.527+0000 7efdddd21700 1 --2- 172.21.15.103:0/2255080969 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efdd8142400 0x7efdd80ac740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:04.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.527+0000 7efdddd21700 1 --2- 172.21.15.103:0/2255080969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdd8146210 0x7efdd81465f0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:04.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.527+0000 7efdddd21700 1 -- 172.21.15.103:0/2255080969 >> 172.21.15.103:0/2255080969 conn(0x7efdd80b86b0 msgr2=0x7efdd80b8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:04.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.527+0000 7efdddd21700 1 -- 172.21.15.103:0/2255080969 shutdown_connections 2020-04-22T14:20:04.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.527+0000 7efdddd21700 1 -- 172.21.15.103:0/2255080969 wait complete. 2020-04-22T14:20:04.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.528+0000 7efdddd21700 1 Processor -- start 2020-04-22T14:20:04.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.529+0000 7efdddd21700 1 -- start start 2020-04-22T14:20:04.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.529+0000 7efdddd21700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efdd80af280 0x7efdd8140ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:04.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.529+0000 7efdddd21700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7efdd8146210 0x7efdd8141450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:04.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.529+0000 7efdddd21700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdd8144700 con 0x7efdd8142400 2020-04-22T14:20:04.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.529+0000 7efdddd21700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdd8145170 con 0x7efdd8146210 2020-04-22T14:20:04.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.529+0000 7efdddd21700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd81449a0 con 0x7efdd80af280 2020-04-22T14:20:04.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.530+0000 7efdd6ffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7efdd8142400 0x7efdd8152f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50896/0 (socket says 172.21.15.103:50896) 2020-04-22T14:20:04.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.530+0000 7efdd6ffd700 1 -- 172.21.15.103:0/1767492663 learned_addr learned my addr 172.21.15.103:0/1767492663 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:04.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.530+0000 7efdd77fe700 1 --2- 172.21.15.103:0/1767492663 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efdd80af280 0x7efdd8140ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:04.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.530+0000 7efdd7fff700 1 --2- 172.21.15.103:0/1767492663 >> v2:172.21.15.86:3300/0 conn(0x7efdd8146210 0x7efdd8141450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:04.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.530+0000 7efdd4ff9700 1 -- 172.21.15.103:0/1767492663 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4020367333 0 0) 0x7efdd8144700 con 0x7efdd8142400 2020-04-22T14:20:04.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.530+0000 7efdd4ff9700 1 -- 172.21.15.103:0/1767492663 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdb8002fe0 con 0x7efdd8142400 2020-04-22T14:20:04.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.530+0000 7efdd77fe700 1 -- 172.21.15.103:0/1767492663 >> v2:172.21.15.86:3300/0 conn(0x7efdd8146210 msgr2=0x7efdd8141450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:04.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.530+0000 7efdd77fe700 1 --2- 172.21.15.103:0/1767492663 >> v2:172.21.15.86:3300/0 conn(0x7efdd8146210 0x7efdd8141450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:04.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.530+0000 7efdd77fe700 1 -- 172.21.15.103:0/1767492663 >> v1:172.21.15.103:6789/0 conn(0x7efdd8142400 legacy=0x7efdd8152f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:04.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.530+0000 7efdd77fe700 1 -- 172.21.15.103:0/1767492663 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd8144c40 con 0x7efdd80af280 2020-04-22T14:20:04.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.530+0000 7efdd77fe700 1 --2- 172.21.15.103:0/1767492663 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efdd80af280 0x7efdd8140ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efdc8002f30 tx=0x7efdc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:04.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.530+0000 7efdd77fe700 1 --2- 172.21.15.103:0/1767492663 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efdd80af280 0x7efdd8140ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efdc8002f30 tx=0x7efdc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:04.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.530+0000 7efdd77fe700 1 --2- 172.21.15.103:0/1767492663 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efdd80af280 0x7efdd8140ff0 secure :-1 s=READY pgs=197 cs=0 l=1 rx=0x7efdc8002f30 tx=0x7efdc8007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:04.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.530+0000 7efdd77fe700 1 --2- 172.21.15.103:0/1767492663 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efdd80af280 0x7efdd8140ff0 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7efdc8002f30 tx=0x7efdc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:04.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.530+0000 7efdd4ff9700 1 -- 172.21.15.103:0/1767492663 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdc8007360 con 0x7efdd80af280 2020-04-22T14:20:04.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.530+0000 7efdd77fe700 1 --2- 172.21.15.103:0/1767492663 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efdd80af280 0x7efdd8140ff0 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7efdc8002f30 tx=0x7efdc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:04.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.530+0000 7efdd77fe700 1 --2- 172.21.15.103:0/1767492663 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efdd80af280 0x7efdd8140ff0 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7efdc8002f30 tx=0x7efdc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:04.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.530+0000 7efdd4ff9700 1 -- 172.21.15.103:0/1767492663 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc80074c0 con 0x7efdd80af280 2020-04-22T14:20:04.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.530+0000 7efdd4ff9700 1 -- 172.21.15.103:0/1767492663 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdc80058b0 con 0x7efdd80af280 2020-04-22T14:20:04.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.530+0000 7efdddd21700 1 -- 172.21.15.103:0/1767492663 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdd8063ce0 con 0x7efdd80af280 2020-04-22T14:20:04.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.530+0000 7efdddd21700 1 -- 172.21.15.103:0/1767492663 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdd8063ed0 con 0x7efdd80af280 2020-04-22T14:20:04.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.531+0000 7efdd77fe700 1 --2- 172.21.15.103:0/1767492663 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efdd80af280 0x7efdd8140ff0 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7efdc8002f30 tx=0x7efdc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:04.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.532+0000 7efdddd21700 1 -- 172.21.15.103:0/1767492663 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdd8144dd0 con 0x7efdd80af280 2020-04-22T14:20:04.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.532+0000 7efdd4ff9700 1 -- 172.21.15.103:0/1767492663 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7efdc800fba0 con 0x7efdd80af280 2020-04-22T14:20:04.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.532+0000 7efdd77fe700 1 --2- 172.21.15.103:0/1767492663 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efdd80af280 0x7efdd8140ff0 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7efdc8002f30 tx=0x7efdc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:04.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.532+0000 7efdd4ff9700 1 --2- 172.21.15.103:0/1767492663 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efdb804dd30 0x7efdb80501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:04.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.532+0000 7efdd4ff9700 1 -- 172.21.15.103:0/1767492663 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efdc80612d0 con 0x7efdd80af280 2020-04-22T14:20:04.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.532+0000 7efdd6ffd700 1 --2- 172.21.15.103:0/1767492663 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efdb804dd30 0x7efdb80501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:04.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.533+0000 7efdd6ffd700 1 --2- 172.21.15.103:0/1767492663 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efdb804dd30 0x7efdb80501f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efdcc000ee0 tx=0x7efdcc001760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:04.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.533+0000 7efdd6ffd700 1 --2- 172.21.15.103:0/1767492663 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efdb804dd30 0x7efdb80501f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efdcc000ee0 tx=0x7efdcc001760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:04.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.533+0000 7efdd6ffd700 1 --2- 172.21.15.103:0/1767492663 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efdb804dd30 0x7efdb80501f0 secure :-1 s=READY pgs=765 cs=0 l=1 rx=0x7efdcc000ee0 tx=0x7efdcc001760).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:04.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.536+0000 7efdd77fe700 1 --2- 172.21.15.103:0/1767492663 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efdd80af280 0x7efdd8140ff0 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7efdc8002f30 tx=0x7efdc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:04.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.536+0000 7efdd4ff9700 1 -- 172.21.15.103:0/1767492663 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7efdc803c770 con 0x7efdd80af280 2020-04-22T14:20:04.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.526+0000 7fa512227700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa50c067110 0x7fa50c0aee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:04.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.526+0000 7fa512227700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa50c142690 0x7fa50c142af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:04.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.526+0000 7fa512227700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa50c142f50 con 0x7fa50c0ac740 2020-04-22T14:20:04.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.526+0000 7fa512227700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa50c0afb20 con 0x7fa50c067110 2020-04-22T14:20:04.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.526+0000 7fa512227700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa50c0afdc0 con 0x7fa50c142690 2020-04-22T14:20:04.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.526+0000 7fa510a24700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa50c142690 0x7fa50c142af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:04.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.526+0000 7fa510a24700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa50c142690 0x7fa50c142af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58694/0 (socket says 172.21.15.103:58694) 2020-04-22T14:20:04.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.526+0000 7fa510a24700 1 -- 172.21.15.103:0/3468557041 learned_addr learned my addr 172.21.15.103:0/3468557041 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:04.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.526+0000 7fa511225700 1 --2- 172.21.15.103:0/3468557041 >> v2:172.21.15.86:3300/0 conn(0x7fa50c067110 0x7fa50c0aee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:04.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.526+0000 7fa510a24700 1 -- 172.21.15.103:0/3468557041 >> v2:172.21.15.86:3300/0 conn(0x7fa50c067110 msgr2=0x7fa50c0aee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:04.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.526+0000 7fa510a24700 1 --2- 172.21.15.103:0/3468557041 >> v2:172.21.15.86:3300/0 conn(0x7fa50c067110 0x7fa50c0aee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:04.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.526+0000 7fa510a24700 1 -- 172.21.15.103:0/3468557041 >> v1:172.21.15.103:6789/0 conn(0x7fa50c0ac740 legacy=0x7fa50c0acb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:04.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.526+0000 7fa4fbfff700 1 -- 172.21.15.103:0/3468557041 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 510221790 0 0) 0x7fa50c142f50 con 0x7fa50c0ac740 2020-04-22T14:20:04.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.526+0000 7fa510a24700 1 -- 172.21.15.103:0/3468557041 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50c0b0060 con 0x7fa50c142690 2020-04-22T14:20:04.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.526+0000 7fa510a24700 1 --2- 172.21.15.103:0/3468557041 >> v2:172.21.15.103:3300/0 conn(0x7fa50c142690 0x7fa50c142af0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa4fc002f30 tx=0x7fa4fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:04.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.526+0000 7fa510a24700 1 --2- 172.21.15.103:0/3468557041 >> v2:172.21.15.103:3300/0 conn(0x7fa50c142690 0x7fa50c142af0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa4fc002f30 tx=0x7fa4fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:04.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.526+0000 7fa510a24700 1 --2- 172.21.15.103:0/3468557041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa50c142690 0x7fa50c142af0 secure :-1 s=READY pgs=2106 cs=0 l=1 rx=0x7fa4fc002f30 tx=0x7fa4fc007a40).ready entity=mon.1 client_cookie=7e0419a2064f1855 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:04.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.527+0000 7fa510a24700 1 --2- 172.21.15.103:0/3468557041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa50c142690 0x7fa50c142af0 secure :-1 s=THROTTLE_DONE pgs=2106 cs=0 l=1 rx=0x7fa4fc002f30 tx=0x7fa4fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:04.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.527+0000 7fa510a24700 1 --2- 172.21.15.103:0/3468557041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa50c142690 0x7fa50c142af0 secure :-1 s=THROTTLE_DONE pgs=2106 cs=0 l=1 rx=0x7fa4fc002f30 tx=0x7fa4fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:04.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.527+0000 7fa4fbfff700 1 -- 172.21.15.103:0/3468557041 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4fc013d70 con 0x7fa50c142690 2020-04-22T14:20:04.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.527+0000 7fa510a24700 1 --2- 172.21.15.103:0/3468557041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa50c142690 0x7fa50c142af0 secure :-1 s=THROTTLE_DONE pgs=2106 cs=0 l=1 rx=0x7fa4fc002f30 tx=0x7fa4fc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:04.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.527+0000 7fa4fbfff700 1 -- 172.21.15.103:0/3468557041 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4fc00c180 con 0x7fa50c142690 2020-04-22T14:20:04.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.527+0000 7fa4fbfff700 1 -- 172.21.15.103:0/3468557041 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4fc00c560 con 0x7fa50c142690 2020-04-22T14:20:04.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.527+0000 7fa512227700 1 -- 172.21.15.103:0/3468557041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa50c142690 msgr2=0x7fa50c142af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:04.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.527+0000 7fa512227700 1 --2- 172.21.15.103:0/3468557041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa50c142690 0x7fa50c142af0 secure :-1 s=READY pgs=2106 cs=0 l=1 rx=0x7fa4fc002f30 tx=0x7fa4fc007a40).stop 2020-04-22T14:20:04.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.527+0000 7fa512227700 1 -- 172.21.15.103:0/3468557041 shutdown_connections 2020-04-22T14:20:04.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.527+0000 7fa512227700 1 --2- 172.21.15.103:0/3468557041 >> v2:172.21.15.86:3300/0 conn(0x7fa50c067110 0x7fa50c0aee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:04.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.527+0000 7fa512227700 1 --2- 172.21.15.103:0/3468557041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa50c142690 0x7fa50c142af0 unknown :-1 s=CLOSED pgs=2106 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:04.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.527+0000 7fa512227700 1 -- 172.21.15.103:0/3468557041 >> 172.21.15.103:0/3468557041 conn(0x7fa50c05ad30 msgr2=0x7fa50c05b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:04.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.527+0000 7fa512227700 1 -- 172.21.15.103:0/3468557041 shutdown_connections 2020-04-22T14:20:04.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.527+0000 7fa512227700 1 -- 172.21.15.103:0/3468557041 wait complete. 2020-04-22T14:20:04.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.528+0000 7fa512227700 1 Processor -- start 2020-04-22T14:20:04.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.528+0000 7fa512227700 1 -- start start 2020-04-22T14:20:04.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.529+0000 7fa512227700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa50c142690 0x7fa50c1401f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:04.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.529+0000 7fa512227700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa50c13fc10 con 0x7fa50c067110 2020-04-22T14:20:04.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.529+0000 7fa512227700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa50c140b20 con 0x7fa50c0ac740 2020-04-22T14:20:04.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.529+0000 7fa512227700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa50c1539b0 con 0x7fa50c142690 2020-04-22T14:20:04.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.529+0000 7fa510a24700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa50c0ac740 0x7fa50c0b63f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50890/0 (socket says 172.21.15.103:50890) 2020-04-22T14:20:04.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.529+0000 7fa510a24700 1 -- 172.21.15.103:0/392079496 learned_addr learned my addr 172.21.15.103:0/392079496 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:04.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.529+0000 7fa511a26700 1 --2- 172.21.15.103:0/392079496 >> v2:172.21.15.103:3300/0 conn(0x7fa50c142690 0x7fa50c1401f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:04.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.529+0000 7fa4fa7fc700 1 -- 172.21.15.103:0/392079496 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1174772214 0 0) 0x7fa50c13fc10 con 0x7fa50c067110 2020-04-22T14:20:04.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.529+0000 7fa4fa7fc700 1 -- 172.21.15.103:0/392079496 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4ec002fe0 con 0x7fa50c067110 2020-04-22T14:20:04.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.530+0000 7fa511a26700 1 -- 172.21.15.103:0/392079496 >> v1:172.21.15.103:6789/0 conn(0x7fa50c0ac740 legacy=0x7fa50c0b63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:04.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.530+0000 7fa511a26700 1 -- 172.21.15.103:0/392079496 >> v1:172.21.15.86:6789/0 conn(0x7fa50c067110 legacy=0x7fa50c13f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:04.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.530+0000 7fa511a26700 1 -- 172.21.15.103:0/392079496 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50c140780 con 0x7fa50c142690 2020-04-22T14:20:04.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.530+0000 7fa511a26700 1 --2- 172.21.15.103:0/392079496 >> v2:172.21.15.103:3300/0 conn(0x7fa50c142690 0x7fa50c1401f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa50c13e9d0 tx=0x7fa504010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:04.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.530+0000 7fa511a26700 1 --2- 172.21.15.103:0/392079496 >> v2:172.21.15.103:3300/0 conn(0x7fa50c142690 0x7fa50c1401f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa50c13e9d0 tx=0x7fa504010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:04.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.530+0000 7fa511a26700 1 --2- 172.21.15.103:0/392079496 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa50c142690 0x7fa50c1401f0 secure :-1 s=READY pgs=2109 cs=0 l=1 rx=0x7fa50c13e9d0 tx=0x7fa504010c00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:04.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.530+0000 7fa511a26700 1 --2- 172.21.15.103:0/392079496 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa50c142690 0x7fa50c1401f0 secure :-1 s=THROTTLE_DONE pgs=2109 cs=0 l=1 rx=0x7fa50c13e9d0 tx=0x7fa504010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:04.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.530+0000 7fa4fa7fc700 1 -- 172.21.15.103:0/392079496 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa504012260 con 0x7fa50c142690 2020-04-22T14:20:04.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.530+0000 7fa511a26700 1 --2- 172.21.15.103:0/392079496 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa50c142690 0x7fa50c1401f0 secure :-1 s=THROTTLE_DONE pgs=2109 cs=0 l=1 rx=0x7fa50c13e9d0 tx=0x7fa504010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:04.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.530+0000 7fa511a26700 1 --2- 172.21.15.103:0/392079496 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa50c142690 0x7fa50c1401f0 secure :-1 s=THROTTLE_DONE pgs=2109 cs=0 l=1 rx=0x7fa50c13e9d0 tx=0x7fa504010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:04.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.530+0000 7fa4fa7fc700 1 -- 172.21.15.103:0/392079496 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa504012400 con 0x7fa50c142690 2020-04-22T14:20:04.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.530+0000 7fa4fa7fc700 1 -- 172.21.15.103:0/392079496 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5040127e0 con 0x7fa50c142690 2020-04-22T14:20:04.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.530+0000 7fa512227700 1 -- 172.21.15.103:0/392079496 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa50c145a10 con 0x7fa50c142690 2020-04-22T14:20:04.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.530+0000 7fa512227700 1 -- 172.21.15.103:0/392079496 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa50c0b6d40 con 0x7fa50c142690 2020-04-22T14:20:04.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.531+0000 7fa511a26700 1 --2- 172.21.15.103:0/392079496 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa50c142690 0x7fa50c1401f0 secure :-1 s=THROTTLE_DONE pgs=2109 cs=0 l=1 rx=0x7fa50c13e9d0 tx=0x7fa504010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:04.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.531+0000 7fa4fa7fc700 1 -- 172.21.15.103:0/392079496 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fa504013070 con 0x7fa50c142690 2020-04-22T14:20:04.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.531+0000 7fa511a26700 1 --2- 172.21.15.103:0/392079496 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa50c142690 0x7fa50c1401f0 secure :-1 s=THROTTLE_DONE pgs=2109 cs=0 l=1 rx=0x7fa50c13e9d0 tx=0x7fa504010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:04.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.531+0000 7fa512227700 1 -- 172.21.15.103:0/392079496 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa50c145c00 con 0x7fa50c142690 2020-04-22T14:20:04.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.532+0000 7fa4fa7fc700 1 --2- 172.21.15.103:0/392079496 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa4ec04dcc0 0x7fa4ec050180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:04.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.532+0000 7fa4fa7fc700 1 -- 172.21.15.103:0/392079496 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa5040616d0 con 0x7fa50c142690 2020-04-22T14:20:04.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.532+0000 7fa511225700 1 --2- 172.21.15.103:0/392079496 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa4ec04dcc0 0x7fa4ec050180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:04.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.532+0000 7fa511225700 1 --2- 172.21.15.103:0/392079496 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa4ec04dcc0 0x7fa4ec050180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa508002ef0 tx=0x7fa5080090b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:04.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.532+0000 7fa511225700 1 --2- 172.21.15.103:0/392079496 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa4ec04dcc0 0x7fa4ec050180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa508002ef0 tx=0x7fa5080090b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:04.562 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.532+0000 7fa511225700 1 --2- 172.21.15.103:0/392079496 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa4ec04dcc0 0x7fa4ec050180 secure :-1 s=READY pgs=764 cs=0 l=1 rx=0x7fa508002ef0 tx=0x7fa5080090b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:04.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.536+0000 7fa511a26700 1 --2- 172.21.15.103:0/392079496 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa50c142690 0x7fa50c1401f0 secure :-1 s=THROTTLE_DONE pgs=2109 cs=0 l=1 rx=0x7fa50c13e9d0 tx=0x7fa504010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:04.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.536+0000 7fa4fa7fc700 1 -- 172.21.15.103:0/392079496 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fa50403cb70 con 0x7fa50c142690 2020-04-22T14:20:04.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.737+0000 7efdddd21700 1 -- 172.21.15.103:0/1767492663 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7efdd8063ed0 con 0x7efdd80af280 2020-04-22T14:20:04.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:04.738+0000 7fa512227700 1 -- 172.21.15.103:0/392079496 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7fa50c056c90 con 0x7fa50c142690 2020-04-22T14:20:05.495 INFO:tasks.ceph.mon.b.smithi086.stderr:2020-04-22T14:20:05.493+0000 7fbdbf880700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-04-22T14:20:05.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:05.499+0000 7fa511a26700 1 --2- 172.21.15.103:0/392079496 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa50c142690 0x7fa50c1401f0 secure :-1 s=THROTTLE_DONE pgs=2109 cs=0 l=1 rx=0x7fa50c13e9d0 tx=0x7fa504010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:05.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:05.499+0000 7fa4fa7fc700 1 -- 172.21.15.103:0/392079496 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 6743 v108) v1 ==== 95+0+0 (secure 0 0 0) 0x7fa504040190 con 0x7fa50c142690 2020-04-22T14:20:05.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:05.499+0000 7efdd77fe700 1 --2- 172.21.15.103:0/1767492663 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efdd80af280 0x7efdd8140ff0 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7efdc8002f30 tx=0x7efdc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:05.503 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:05.499+0000 7efdd4ff9700 1 -- 172.21.15.103:0/1767492663 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 9703 v108) v1 ==== 95+0+0 (secure 0 0 0) 0x7efdd8063ed0 con 0x7efdd80af280 2020-04-22T14:20:05.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:05.501+0000 7efdddd21700 1 -- 172.21.15.103:0/1767492663 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efdb804dd30 msgr2=0x7efdb80501f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:05.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:05.501+0000 7efdddd21700 1 --2- 172.21.15.103:0/1767492663 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efdb804dd30 0x7efdb80501f0 secure :-1 s=READY pgs=765 cs=0 l=1 rx=0x7efdcc000ee0 tx=0x7efdcc001760).stop 2020-04-22T14:20:05.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:05.501+0000 7efdddd21700 1 -- 172.21.15.103:0/1767492663 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efdd80af280 msgr2=0x7efdd8140ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:05.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:05.501+0000 7efdddd21700 1 --2- 172.21.15.103:0/1767492663 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efdd80af280 0x7efdd8140ff0 secure :-1 s=READY pgs=197 cs=0 l=1 rx=0x7efdc8002f30 tx=0x7efdc8007a40).stop 2020-04-22T14:20:05.506 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:05.502+0000 7efdddd21700 1 -- 172.21.15.103:0/1767492663 shutdown_connections 2020-04-22T14:20:05.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:05.502+0000 7efdddd21700 1 --2- 172.21.15.103:0/1767492663 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7efdb804dd30 0x7efdb80501f0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:05.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:05.502+0000 7efdddd21700 1 --2- 172.21.15.103:0/1767492663 >> v2:172.21.15.86:3300/0 conn(0x7efdd8146210 0x7efdd8141450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:05.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:05.502+0000 7efdddd21700 1 --2- 172.21.15.103:0/1767492663 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efdd80af280 0x7efdd8140ff0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:05.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:05.502+0000 7efdddd21700 1 -- 172.21.15.103:0/1767492663 >> 172.21.15.103:0/1767492663 conn(0x7efdd80b86b0 msgr2=0x7efdd80b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:05.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:05.502+0000 7efdddd21700 1 -- 172.21.15.103:0/1767492663 shutdown_connections 2020-04-22T14:20:05.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:05.502+0000 7efdddd21700 1 -- 172.21.15.103:0/1767492663 wait complete. 2020-04-22T14:20:05.507 INFO:teuthology.orchestra.run.smithi103.stderr:failed mds gid 9703 2020-04-22T14:20:05.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:05.501+0000 7fa512227700 1 -- 172.21.15.103:0/392079496 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa4ec04dcc0 msgr2=0x7fa4ec050180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:05.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:05.501+0000 7fa512227700 1 --2- 172.21.15.103:0/392079496 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa4ec04dcc0 0x7fa4ec050180 secure :-1 s=READY pgs=764 cs=0 l=1 rx=0x7fa508002ef0 tx=0x7fa5080090b0).stop 2020-04-22T14:20:05.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:05.501+0000 7fa512227700 1 -- 172.21.15.103:0/392079496 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa50c142690 msgr2=0x7fa50c1401f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:05.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:05.501+0000 7fa512227700 1 --2- 172.21.15.103:0/392079496 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa50c142690 0x7fa50c1401f0 secure :-1 s=READY pgs=2109 cs=0 l=1 rx=0x7fa50c13e9d0 tx=0x7fa504010c00).stop 2020-04-22T14:20:05.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:05.502+0000 7fa512227700 1 -- 172.21.15.103:0/392079496 shutdown_connections 2020-04-22T14:20:05.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:05.502+0000 7fa512227700 1 --2- 172.21.15.103:0/392079496 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa4ec04dcc0 0x7fa4ec050180 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:05.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:05.502+0000 7fa512227700 1 --2- 172.21.15.103:0/392079496 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa50c142690 0x7fa50c1401f0 unknown :-1 s=CLOSED pgs=2109 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:05.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:05.502+0000 7fa512227700 1 -- 172.21.15.103:0/392079496 >> 172.21.15.103:0/392079496 conn(0x7fa50c05ad30 msgr2=0x7fa50c061980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:05.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:05.502+0000 7fa512227700 1 -- 172.21.15.103:0/392079496 shutdown_connections 2020-04-22T14:20:05.509 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:05.502+0000 7fa512227700 1 -- 172.21.15.103:0/392079496 wait complete. 2020-04-22T14:20:05.509 INFO:teuthology.orchestra.run.smithi103.stderr:failed mds gid 6743 2020-04-22T14:20:05.522 DEBUG:teuthology.parallel:result is '' 2020-04-22T14:20:05.522 DEBUG:teuthology.parallel:result is '' 2020-04-22T14:20:05.522 INFO:tasks.cephfs.mount:Killing connection on ubuntu@smithi103.front.sepia.ceph.com... 2020-04-22T14:20:05.522 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:20:05.522 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:05.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:05.537 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip link set brx.0 down' 2020-04-22T14:20:10.646 INFO:tasks.ceph.mds.a:Restarting daemon 2020-04-22T14:20:10.646 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:10.647 INFO:tasks.ceph.mds.b:Restarting daemon 2020-04-22T14:20:10.647 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:20:10.664 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-04-22T14:20:10.666 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-04-22T14:20:10.707 INFO:tasks.ceph.mds.a:Started 2020-04-22T14:20:10.707 DEBUG:teuthology.parallel:result is None 2020-04-22T14:20:10.709 INFO:tasks.ceph.mds.b:Started 2020-04-22T14:20:10.709 DEBUG:teuthology.parallel:result is None 2020-04-22T14:20:10.710 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:10.726 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:20:10.792 INFO:tasks.ceph.mds.b.smithi086.stdout:starting mds.b at 2020-04-22T14:20:10.793 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2020-04-22T14:20:10.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.877+0000 7f9dde2f6700 1 Processor -- start 2020-04-22T14:20:10.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.877+0000 7f9dde2f6700 1 -- start start 2020-04-22T14:20:10.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.878+0000 7f9dde2f6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9dd8140320 0x7f9dd80ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:10.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.878+0000 7f9dde2f6700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9dd814a2b0 0x7f9dd8146cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:10.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.878+0000 7f9dde2f6700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dd81462f0 con 0x7f9dd80bd1b0 2020-04-22T14:20:10.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.878+0000 7f9dde2f6700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dd8146590 con 0x7f9dd814a2b0 2020-04-22T14:20:10.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.878+0000 7f9dde2f6700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd8146830 con 0x7f9dd8140320 2020-04-22T14:20:10.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.878+0000 7f9dcffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9dd814a2b0 0x7f9dd8146cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:10.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.879+0000 7f9dd7fff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9dd8140320 0x7f9dd80ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:10.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.879+0000 7f9ddc893700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f9dd80bd1b0 0x7f9dd80ac740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:39846/0 (socket says 172.21.15.103:39846) 2020-04-22T14:20:10.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.879+0000 7f9dcffff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9dd814a2b0 0x7f9dd8146cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:55964/0 (socket says 172.21.15.103:55964) 2020-04-22T14:20:10.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.879+0000 7f9ddc893700 1 -- 172.21.15.103:0/3090950741 learned_addr learned my addr 172.21.15.103:0/3090950741 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:10.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.879+0000 7f9dd7fff700 1 -- 172.21.15.103:0/3090950741 >> v2:172.21.15.86:3300/0 conn(0x7f9dd814a2b0 msgr2=0x7f9dd8146cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:10.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.879+0000 7f9dd7fff700 1 --2- 172.21.15.103:0/3090950741 >> v2:172.21.15.86:3300/0 conn(0x7f9dd814a2b0 0x7f9dd8146cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:10.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.879+0000 7f9dd7fff700 1 -- 172.21.15.103:0/3090950741 >> v1:172.21.15.86:6789/0 conn(0x7f9dd80bd1b0 legacy=0x7f9dd80ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:10.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.879+0000 7f9dd7fff700 1 -- 172.21.15.103:0/3090950741 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd8140700 con 0x7f9dd8140320 2020-04-22T14:20:10.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.879+0000 7f9dcffff700 1 --2- 172.21.15.103:0/3090950741 >> v2:172.21.15.86:3300/0 conn(0x7f9dd814a2b0 0x7f9dd8146cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:20:10.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.879+0000 7f9dd7fff700 1 --2- 172.21.15.103:0/3090950741 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9dd8140320 0x7f9dd80ae1a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9dc8002f30 tx=0x7f9dc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:10.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.879+0000 7f9dd7fff700 1 --2- 172.21.15.103:0/3090950741 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9dd8140320 0x7f9dd80ae1a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9dc8002f30 tx=0x7f9dc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:10.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.879+0000 7f9dd7fff700 1 --2- 172.21.15.103:0/3090950741 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9dd8140320 0x7f9dd80ae1a0 secure :-1 s=READY pgs=199 cs=0 l=1 rx=0x7f9dc8002f30 tx=0x7f9dc8007a40).ready entity=mon.2 client_cookie=8dbe6c02ea531ece server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:10.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.879+0000 7f9dd7fff700 1 --2- 172.21.15.103:0/3090950741 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9dd8140320 0x7f9dd80ae1a0 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f9dc8002f30 tx=0x7f9dc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:10.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.879+0000 7f9dd7fff700 1 --2- 172.21.15.103:0/3090950741 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9dd8140320 0x7f9dd80ae1a0 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f9dc8002f30 tx=0x7f9dc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:10.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.879+0000 7f9dd77fe700 1 -- 172.21.15.103:0/3090950741 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9dc80113c0 con 0x7f9dd8140320 2020-04-22T14:20:10.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.879+0000 7f9dd7fff700 1 --2- 172.21.15.103:0/3090950741 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9dd8140320 0x7f9dd80ae1a0 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f9dc8002f30 tx=0x7f9dc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:10.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.879+0000 7f9dd77fe700 1 -- 172.21.15.103:0/3090950741 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc8011560 con 0x7f9dd8140320 2020-04-22T14:20:10.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.879+0000 7f9dd77fe700 1 -- 172.21.15.103:0/3090950741 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9dc8011980 con 0x7f9dd8140320 2020-04-22T14:20:10.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.879+0000 7f9dde2f6700 1 -- 172.21.15.103:0/3090950741 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9dd8140320 msgr2=0x7f9dd80ae1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:10.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.879+0000 7f9dde2f6700 1 --2- 172.21.15.103:0/3090950741 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9dd8140320 0x7f9dd80ae1a0 secure :-1 s=READY pgs=199 cs=0 l=1 rx=0x7f9dc8002f30 tx=0x7f9dc8007a40).stop 2020-04-22T14:20:10.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.880+0000 7f9dde2f6700 1 -- 172.21.15.103:0/3090950741 shutdown_connections 2020-04-22T14:20:10.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.880+0000 7f9dde2f6700 1 --2- 172.21.15.103:0/3090950741 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9dd8140320 0x7f9dd80ae1a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:10.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.880+0000 7f9dde2f6700 1 --2- 172.21.15.103:0/3090950741 >> v2:172.21.15.86:3300/0 conn(0x7f9dd814a2b0 0x7f9dd8146cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:10.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.880+0000 7f9dde2f6700 1 -- 172.21.15.103:0/3090950741 >> 172.21.15.103:0/3090950741 conn(0x7f9dd805f2c0 msgr2=0x7f9dd80bcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:10.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.880+0000 7f9dde2f6700 1 -- 172.21.15.103:0/3090950741 shutdown_connections 2020-04-22T14:20:10.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.880+0000 7f9dde2f6700 1 -- 172.21.15.103:0/3090950741 wait complete. 2020-04-22T14:20:10.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.881+0000 7f9dde2f6700 1 Processor -- start 2020-04-22T14:20:10.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.881+0000 7f9dde2f6700 1 -- start start 2020-04-22T14:20:10.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.881+0000 7f9dde2f6700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9dd80bd1b0 0x7f9dd8143190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:10.892 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.881+0000 7f9dde2f6700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dd8141340 con 0x7f9dd814a2b0 2020-04-22T14:20:10.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.881+0000 7f9dde2f6700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dd81415e0 con 0x7f9dd8140320 2020-04-22T14:20:10.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.881+0000 7f9dde2f6700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dd8143000 con 0x7f9dd80bd1b0 2020-04-22T14:20:10.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.881+0000 7f9dcffff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f9dd8140320 0x7f9dd8153bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50928/0 (socket says 172.21.15.103:50928) 2020-04-22T14:20:10.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.881+0000 7f9dcffff700 1 -- 172.21.15.103:0/2117909539 learned_addr learned my addr 172.21.15.103:0/2117909539 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:10.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.881+0000 7f9dd7fff700 1 --2- 172.21.15.103:0/2117909539 >> v2:172.21.15.86:3300/0 conn(0x7f9dd80bd1b0 0x7f9dd8143190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:10.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.882+0000 7f9dd5ffb700 1 -- 172.21.15.103:0/2117909539 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1618359365 0 0) 0x7f9dd81415e0 con 0x7f9dd8140320 2020-04-22T14:20:10.893 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.882+0000 7f9dd5ffb700 1 -- 172.21.15.103:0/2117909539 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dbc002fe0 con 0x7f9dd8140320 2020-04-22T14:20:10.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.882+0000 7f9dd7fff700 1 -- 172.21.15.103:0/2117909539 >> v1:172.21.15.103:6789/0 conn(0x7f9dd8140320 legacy=0x7f9dd8153bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:10.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.882+0000 7f9dd5ffb700 1 -- 172.21.15.103:0/2117909539 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 27557307 0 0) 0x7f9dd8141340 con 0x7f9dd814a2b0 2020-04-22T14:20:10.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.882+0000 7f9dd7fff700 1 -- 172.21.15.103:0/2117909539 >> v1:172.21.15.86:6789/0 conn(0x7f9dd814a2b0 legacy=0x7f9dd8141a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:10.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.882+0000 7f9dd7fff700 1 -- 172.21.15.103:0/2117909539 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd80b0970 con 0x7f9dd80bd1b0 2020-04-22T14:20:10.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.882+0000 7f9dd7fff700 1 --2- 172.21.15.103:0/2117909539 >> v2:172.21.15.86:3300/0 conn(0x7f9dd80bd1b0 0x7f9dd8143190 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9dd80b3190 tx=0x7f9dc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:10.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.882+0000 7f9dd7fff700 1 --2- 172.21.15.103:0/2117909539 >> v2:172.21.15.86:3300/0 conn(0x7f9dd80bd1b0 0x7f9dd8143190 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9dd80b3190 tx=0x7f9dc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:10.894 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.882+0000 7f9dd7fff700 1 --2- 172.21.15.103:0/2117909539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9dd80bd1b0 0x7f9dd8143190 secure :-1 s=READY pgs=1111 cs=0 l=1 rx=0x7f9dd80b3190 tx=0x7f9dc8007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:10.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.882+0000 7f9dd7fff700 1 --2- 172.21.15.103:0/2117909539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9dd80bd1b0 0x7f9dd8143190 secure :-1 s=THROTTLE_DONE pgs=1111 cs=0 l=1 rx=0x7f9dd80b3190 tx=0x7f9dc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:10.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.882+0000 7f9dd5ffb700 1 -- 172.21.15.103:0/2117909539 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9dc8011940 con 0x7f9dd80bd1b0 2020-04-22T14:20:10.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.882+0000 7f9dd7fff700 1 --2- 172.21.15.103:0/2117909539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9dd80bd1b0 0x7f9dd8143190 secure :-1 s=THROTTLE_DONE pgs=1111 cs=0 l=1 rx=0x7f9dd80b3190 tx=0x7f9dc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:10.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.882+0000 7f9dd7fff700 1 --2- 172.21.15.103:0/2117909539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9dd80bd1b0 0x7f9dd8143190 secure :-1 s=THROTTLE_DONE pgs=1111 cs=0 l=1 rx=0x7f9dd80b3190 tx=0x7f9dc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:10.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.882+0000 7f9dd5ffb700 1 -- 172.21.15.103:0/2117909539 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc8007170 con 0x7f9dd80bd1b0 2020-04-22T14:20:10.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.882+0000 7f9dd5ffb700 1 -- 172.21.15.103:0/2117909539 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9dc80074d0 con 0x7f9dd80bd1b0 2020-04-22T14:20:10.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.882+0000 7f9dde2f6700 1 -- 172.21.15.103:0/2117909539 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dd81542e0 con 0x7f9dd80bd1b0 2020-04-22T14:20:10.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.882+0000 7f9dde2f6700 1 -- 172.21.15.103:0/2117909539 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dd80afdf0 con 0x7f9dd80bd1b0 2020-04-22T14:20:10.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.883+0000 7f9dd7fff700 1 --2- 172.21.15.103:0/2117909539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9dd80bd1b0 0x7f9dd8143190 secure :-1 s=THROTTLE_DONE pgs=1111 cs=0 l=1 rx=0x7f9dd80b3190 tx=0x7f9dc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:10.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.883+0000 7f9dde2f6700 1 -- 172.21.15.103:0/2117909539 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dd8056c90 con 0x7f9dd80bd1b0 2020-04-22T14:20:10.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.883+0000 7f9dd5ffb700 1 -- 172.21.15.103:0/2117909539 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f9dc80080a0 con 0x7f9dd80bd1b0 2020-04-22T14:20:10.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.883+0000 7f9dd7fff700 1 --2- 172.21.15.103:0/2117909539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9dd80bd1b0 0x7f9dd8143190 secure :-1 s=THROTTLE_DONE pgs=1111 cs=0 l=1 rx=0x7f9dd80b3190 tx=0x7f9dc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:10.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.883+0000 7f9dd5ffb700 1 --2- 172.21.15.103:0/2117909539 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9dbc04dc50 0x7f9dbc050110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:10.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.883+0000 7f9dd5ffb700 1 -- 172.21.15.103:0/2117909539 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f9dc8061a00 con 0x7f9dd80bd1b0 2020-04-22T14:20:10.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.883+0000 7f9dcffff700 1 --2- 172.21.15.103:0/2117909539 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9dbc04dc50 0x7f9dbc050110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:10.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.884+0000 7f9dcffff700 1 --2- 172.21.15.103:0/2117909539 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9dbc04dc50 0x7f9dbc050110 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9dc0002f30 tx=0x7f9dc0008040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:10.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.884+0000 7f9dcffff700 1 --2- 172.21.15.103:0/2117909539 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9dbc04dc50 0x7f9dbc050110 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9dc0002f30 tx=0x7f9dc0008040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:10.920 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.884+0000 7f9dcffff700 1 --2- 172.21.15.103:0/2117909539 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9dbc04dc50 0x7f9dbc050110 secure :-1 s=READY pgs=766 cs=0 l=1 rx=0x7f9dc0002f30 tx=0x7f9dc0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:10.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.887+0000 7f9dd7fff700 1 --2- 172.21.15.103:0/2117909539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9dd80bd1b0 0x7f9dd8143190 secure :-1 s=THROTTLE_DONE pgs=1111 cs=0 l=1 rx=0x7f9dd80b3190 tx=0x7f9dc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:10.921 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:10.887+0000 7f9dd5ffb700 1 -- 172.21.15.103:0/2117909539 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f9dc803cf00 con 0x7f9dd80bd1b0 2020-04-22T14:20:11.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:11.075+0000 7f9dde2f6700 1 -- 172.21.15.103:0/2117909539 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9dd8061690 con 0x7f9dd80bd1b0 2020-04-22T14:20:11.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:11.075+0000 7f9dd7fff700 1 --2- 172.21.15.103:0/2117909539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9dd80bd1b0 0x7f9dd8143190 secure :-1 s=THROTTLE_DONE pgs=1111 cs=0 l=1 rx=0x7f9dd80b3190 tx=0x7f9dc8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:11.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:11.075+0000 7f9dd5ffb700 1 -- 172.21.15.103:0/2117909539 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) v1 ==== 95+0+1432 (secure 0 0 0) 0x7f9dc8040520 con 0x7f9dd80bd1b0 2020-04-22T14:20:11.079 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:20:11.079 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":108,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:19:46.112631+0000","modified":"2020-04-22T14:20:05.494197+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":147,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-04-22T14:20:11.080 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:11.077+0000 7f9dde2f6700 1 -- 172.21.15.103:0/2117909539 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9dbc04dc50 msgr2=0x7f9dbc050110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:11.080 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:11.077+0000 7f9dde2f6700 1 --2- 172.21.15.103:0/2117909539 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9dbc04dc50 0x7f9dbc050110 secure :-1 s=READY pgs=766 cs=0 l=1 rx=0x7f9dc0002f30 tx=0x7f9dc0008040).stop 2020-04-22T14:20:11.080 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:11.077+0000 7f9dde2f6700 1 -- 172.21.15.103:0/2117909539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9dd80bd1b0 msgr2=0x7f9dd8143190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:11.080 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:11.077+0000 7f9dde2f6700 1 --2- 172.21.15.103:0/2117909539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9dd80bd1b0 0x7f9dd8143190 secure :-1 s=READY pgs=1111 cs=0 l=1 rx=0x7f9dd80b3190 tx=0x7f9dc8007a40).stop 2020-04-22T14:20:11.081 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:11.077+0000 7f9dde2f6700 1 -- 172.21.15.103:0/2117909539 shutdown_connections 2020-04-22T14:20:11.081 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:11.077+0000 7f9dde2f6700 1 --2- 172.21.15.103:0/2117909539 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9dbc04dc50 0x7f9dbc050110 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:11.081 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:11.077+0000 7f9dde2f6700 1 --2- 172.21.15.103:0/2117909539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9dd80bd1b0 0x7f9dd8143190 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:11.081 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:11.077+0000 7f9dde2f6700 1 -- 172.21.15.103:0/2117909539 >> 172.21.15.103:0/2117909539 conn(0x7f9dd805f2c0 msgr2=0x7f9dd80adc40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:11.081 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:11.077+0000 7f9dde2f6700 1 -- 172.21.15.103:0/2117909539 shutdown_connections 2020-04-22T14:20:11.081 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:11.077+0000 7f9dde2f6700 1 -- 172.21.15.103:0/2117909539 wait complete. 2020-04-22T14:20:11.081 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 108 2020-04-22T14:20:11.090 INFO:tasks.cephfs.filesystem:mapped states [] to None 2020-04-22T14:20:12.091 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:12.108 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:20:12.263 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.260+0000 7f2e220af700 1 Processor -- start 2020-04-22T14:20:12.263 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.260+0000 7f2e220af700 1 -- start start 2020-04-22T14:20:12.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.261+0000 7f2e220af700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2e1c060e40 0x7f2e1c0bbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:12.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.261+0000 7f2e220af700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e1c14a480 con 0x7f2e1c0bcc00 2020-04-22T14:20:12.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.261+0000 7f2e220af700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e1c060290 con 0x7f2e1c0ae130 2020-04-22T14:20:12.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.261+0000 7f2e220af700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e1c0bcfe0 con 0x7f2e1c060e40 2020-04-22T14:20:12.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.261+0000 7f2e218ae700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2e1c060e40 0x7f2e1c0bbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:12.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.261+0000 7f2e218ae700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2e1c060e40 0x7f2e1c0bbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58748/0 (socket says 172.21.15.103:58748) 2020-04-22T14:20:12.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.261+0000 7f2e208ac700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f2e1c0ae130 0x7f2e1c060730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50936/0 (socket says 172.21.15.103:50936) 2020-04-22T14:20:12.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.261+0000 7f2e218ae700 1 -- 172.21.15.103:0/3543960193 learned_addr learned my addr 172.21.15.103:0/3543960193 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:12.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.261+0000 7f2e218ae700 1 -- 172.21.15.103:0/3543960193 >> v1:172.21.15.103:6789/0 conn(0x7f2e1c0ae130 legacy=0x7f2e1c060730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:12.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.261+0000 7f2e218ae700 1 -- 172.21.15.103:0/3543960193 >> v1:172.21.15.86:6789/0 conn(0x7f2e1c0bcc00 legacy=0x7f2e1c0ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:12.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.261+0000 7f2e0ffff700 1 -- 172.21.15.103:0/3543960193 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2947484929 0 0) 0x7f2e1c060290 con 0x7f2e1c0ae130 2020-04-22T14:20:12.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.261+0000 7f2e218ae700 1 -- 172.21.15.103:0/3543960193 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e1c0ace50 con 0x7f2e1c060e40 2020-04-22T14:20:12.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.261+0000 7f2e218ae700 1 --2- 172.21.15.103:0/3543960193 >> v2:172.21.15.103:3300/0 conn(0x7f2e1c060e40 0x7f2e1c0bbdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2e1c0aea30 tx=0x7f2e18007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:12.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.261+0000 7f2e218ae700 1 --2- 172.21.15.103:0/3543960193 >> v2:172.21.15.103:3300/0 conn(0x7f2e1c060e40 0x7f2e1c0bbdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2e1c0aea30 tx=0x7f2e18007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:12.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.261+0000 7f2e218ae700 1 --2- 172.21.15.103:0/3543960193 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e1c060e40 0x7f2e1c0bbdb0 secure :-1 s=READY pgs=2119 cs=0 l=1 rx=0x7f2e1c0aea30 tx=0x7f2e18007a40).ready entity=mon.1 client_cookie=cb0550f767fb6ec8 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:12.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.261+0000 7f2e218ae700 1 --2- 172.21.15.103:0/3543960193 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e1c060e40 0x7f2e1c0bbdb0 secure :-1 s=THROTTLE_DONE pgs=2119 cs=0 l=1 rx=0x7f2e1c0aea30 tx=0x7f2e18007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:12.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.261+0000 7f2e0ffff700 1 -- 172.21.15.103:0/3543960193 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e180116e0 con 0x7f2e1c060e40 2020-04-22T14:20:12.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.262+0000 7f2e218ae700 1 --2- 172.21.15.103:0/3543960193 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e1c060e40 0x7f2e1c0bbdb0 secure :-1 s=THROTTLE_DONE pgs=2119 cs=0 l=1 rx=0x7f2e1c0aea30 tx=0x7f2e18007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:12.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.262+0000 7f2e218ae700 1 --2- 172.21.15.103:0/3543960193 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e1c060e40 0x7f2e1c0bbdb0 secure :-1 s=THROTTLE_DONE pgs=2119 cs=0 l=1 rx=0x7f2e1c0aea30 tx=0x7f2e18007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:12.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.262+0000 7f2e0ffff700 1 -- 172.21.15.103:0/3543960193 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e18011840 con 0x7f2e1c060e40 2020-04-22T14:20:12.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.262+0000 7f2e0ffff700 1 -- 172.21.15.103:0/3543960193 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e18011c20 con 0x7f2e1c060e40 2020-04-22T14:20:12.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.262+0000 7f2e220af700 1 -- 172.21.15.103:0/3543960193 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e1c060e40 msgr2=0x7f2e1c0bbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:12.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.262+0000 7f2e220af700 1 --2- 172.21.15.103:0/3543960193 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e1c060e40 0x7f2e1c0bbdb0 secure :-1 s=READY pgs=2119 cs=0 l=1 rx=0x7f2e1c0aea30 tx=0x7f2e18007a40).stop 2020-04-22T14:20:12.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.262+0000 7f2e220af700 1 -- 172.21.15.103:0/3543960193 shutdown_connections 2020-04-22T14:20:12.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.262+0000 7f2e220af700 1 --2- 172.21.15.103:0/3543960193 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e1c060e40 0x7f2e1c0bbdb0 unknown :-1 s=CLOSED pgs=2119 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:12.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.262+0000 7f2e220af700 1 -- 172.21.15.103:0/3543960193 >> 172.21.15.103:0/3543960193 conn(0x7f2e1c069f30 msgr2=0x7f2e1c06a340 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:12.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.262+0000 7f2e220af700 1 -- 172.21.15.103:0/3543960193 shutdown_connections 2020-04-22T14:20:12.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.262+0000 7f2e220af700 1 -- 172.21.15.103:0/3543960193 wait complete. 2020-04-22T14:20:12.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.263+0000 7f2e220af700 1 Processor -- start 2020-04-22T14:20:12.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.263+0000 7f2e220af700 1 -- start start 2020-04-22T14:20:12.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.264+0000 7f2e220af700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2e1c0ae130 0x7f2e1c0b8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:12.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.264+0000 7f2e220af700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2e1c0bcc00 0x7f2e1c0b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:12.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.264+0000 7f2e220af700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e1c156d80 con 0x7f2e1c060e40 2020-04-22T14:20:12.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.264+0000 7f2e220af700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e1c157020 con 0x7f2e1c0ae130 2020-04-22T14:20:12.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.264+0000 7f2e220af700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c1572c0 con 0x7f2e1c0bcc00 2020-04-22T14:20:12.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.264+0000 7f2e208ac700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2e1c0ae130 0x7f2e1c0b8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:12.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.264+0000 7f2e210ad700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f2e1c060e40 0x7f2e1c1454c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50940/0 (socket says 172.21.15.103:50940) 2020-04-22T14:20:12.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.264+0000 7f2e210ad700 1 -- 172.21.15.103:0/882343650 learned_addr learned my addr 172.21.15.103:0/882343650 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:12.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.264+0000 7f2e218ae700 1 --2- 172.21.15.103:0/882343650 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2e1c0bcc00 0x7f2e1c0b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:12.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.264+0000 7f2e208ac700 1 -- 172.21.15.103:0/882343650 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2e1c0bcc00 msgr2=0x7f2e1c0b0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:12.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.264+0000 7f2e208ac700 1 --2- 172.21.15.103:0/882343650 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2e1c0bcc00 0x7f2e1c0b0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:12.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.264+0000 7f2e208ac700 1 -- 172.21.15.103:0/882343650 >> v1:172.21.15.103:6789/0 conn(0x7f2e1c060e40 legacy=0x7f2e1c1454c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:12.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.264+0000 7f2e208ac700 1 -- 172.21.15.103:0/882343650 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e1c157560 con 0x7f2e1c0ae130 2020-04-22T14:20:12.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.264+0000 7f2e208ac700 1 --2- 172.21.15.103:0/882343650 >> v2:172.21.15.103:3300/0 conn(0x7f2e1c0ae130 0x7f2e1c0b8790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2e10000b80 tx=0x7f2e10001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:12.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.264+0000 7f2e208ac700 1 --2- 172.21.15.103:0/882343650 >> v2:172.21.15.103:3300/0 conn(0x7f2e1c0ae130 0x7f2e1c0b8790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2e10000b80 tx=0x7f2e10001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:12.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.264+0000 7f2e208ac700 1 --2- 172.21.15.103:0/882343650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e1c0ae130 0x7f2e1c0b8790 secure :-1 s=READY pgs=2121 cs=0 l=1 rx=0x7f2e10000b80 tx=0x7f2e10001e40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:12.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.264+0000 7f2e208ac700 1 --2- 172.21.15.103:0/882343650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e1c0ae130 0x7f2e1c0b8790 secure :-1 s=THROTTLE_DONE pgs=2121 cs=0 l=1 rx=0x7f2e10000b80 tx=0x7f2e10001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:12.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.264+0000 7f2e0e7fc700 1 -- 172.21.15.103:0/882343650 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e10011690 con 0x7f2e1c0ae130 2020-04-22T14:20:12.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.264+0000 7f2e208ac700 1 --2- 172.21.15.103:0/882343650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e1c0ae130 0x7f2e1c0b8790 secure :-1 s=THROTTLE_DONE pgs=2121 cs=0 l=1 rx=0x7f2e10000b80 tx=0x7f2e10001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:12.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.264+0000 7f2e208ac700 1 --2- 172.21.15.103:0/882343650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e1c0ae130 0x7f2e1c0b8790 secure :-1 s=THROTTLE_DONE pgs=2121 cs=0 l=1 rx=0x7f2e10000b80 tx=0x7f2e10001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:12.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.264+0000 7f2e0e7fc700 1 -- 172.21.15.103:0/882343650 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e100117f0 con 0x7f2e1c0ae130 2020-04-22T14:20:12.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.264+0000 7f2e0e7fc700 1 -- 172.21.15.103:0/882343650 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e10011b90 con 0x7f2e1c0ae130 2020-04-22T14:20:12.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.264+0000 7f2e220af700 1 -- 172.21.15.103:0/882343650 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e1c145bd0 con 0x7f2e1c0ae130 2020-04-22T14:20:12.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.265+0000 7f2e220af700 1 -- 172.21.15.103:0/882343650 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e1c147720 con 0x7f2e1c0ae130 2020-04-22T14:20:12.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.265+0000 7f2e208ac700 1 --2- 172.21.15.103:0/882343650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e1c0ae130 0x7f2e1c0b8790 secure :-1 s=THROTTLE_DONE pgs=2121 cs=0 l=1 rx=0x7f2e10000b80 tx=0x7f2e10001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:12.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.266+0000 7f2e220af700 1 -- 172.21.15.103:0/882343650 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e1c1576f0 con 0x7f2e1c0ae130 2020-04-22T14:20:12.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.266+0000 7f2e0e7fc700 1 -- 172.21.15.103:0/882343650 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f2e100071a0 con 0x7f2e1c0ae130 2020-04-22T14:20:12.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.266+0000 7f2e208ac700 1 --2- 172.21.15.103:0/882343650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e1c0ae130 0x7f2e1c0b8790 secure :-1 s=THROTTLE_DONE pgs=2121 cs=0 l=1 rx=0x7f2e10000b80 tx=0x7f2e10001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:12.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.266+0000 7f2e0e7fc700 1 --2- 172.21.15.103:0/882343650 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2dfc04d8d0 0x7f2dfc04fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:12.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.266+0000 7f2e0e7fc700 1 -- 172.21.15.103:0/882343650 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f2e10061030 con 0x7f2e1c0ae130 2020-04-22T14:20:12.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.266+0000 7f2e210ad700 1 --2- 172.21.15.103:0/882343650 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2dfc04d8d0 0x7f2dfc04fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:12.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.267+0000 7f2e210ad700 1 --2- 172.21.15.103:0/882343650 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2dfc04d8d0 0x7f2dfc04fd90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2e1c1499d0 tx=0x7f2e14002990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:12.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.267+0000 7f2e210ad700 1 --2- 172.21.15.103:0/882343650 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2dfc04d8d0 0x7f2dfc04fd90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2e1c1499d0 tx=0x7f2e14002990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:12.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.267+0000 7f2e210ad700 1 --2- 172.21.15.103:0/882343650 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2dfc04d8d0 0x7f2dfc04fd90 secure :-1 s=READY pgs=768 cs=0 l=1 rx=0x7f2e1c1499d0 tx=0x7f2e14002990).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:12.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.270+0000 7f2e208ac700 1 --2- 172.21.15.103:0/882343650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e1c0ae130 0x7f2e1c0b8790 secure :-1 s=THROTTLE_DONE pgs=2121 cs=0 l=1 rx=0x7f2e10000b80 tx=0x7f2e10001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:12.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.271+0000 7f2e0e7fc700 1 -- 172.21.15.103:0/882343650 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f2e1003c3b0 con 0x7f2e1c0ae130 2020-04-22T14:20:12.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.460+0000 7f2e220af700 1 -- 172.21.15.103:0/882343650 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e1c056c90 con 0x7f2e1c0ae130 2020-04-22T14:20:12.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.461+0000 7f2e208ac700 1 --2- 172.21.15.103:0/882343650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e1c0ae130 0x7f2e1c0b8790 secure :-1 s=THROTTLE_DONE pgs=2121 cs=0 l=1 rx=0x7f2e10000b80 tx=0x7f2e10001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:12.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.461+0000 7f2e0e7fc700 1 -- 172.21.15.103:0/882343650 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+1795 (secure 0 0 0) 0x7f2e1003f9d0 con 0x7f2e1c0ae130 2020-04-22T14:20:12.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.462+0000 7f2e220af700 1 -- 172.21.15.103:0/882343650 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2dfc04d8d0 msgr2=0x7f2dfc04fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:12.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.462+0000 7f2e220af700 1 --2- 172.21.15.103:0/882343650 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2dfc04d8d0 0x7f2dfc04fd90 secure :-1 s=READY pgs=768 cs=0 l=1 rx=0x7f2e1c1499d0 tx=0x7f2e14002990).stop 2020-04-22T14:20:12.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.462+0000 7f2e220af700 1 -- 172.21.15.103:0/882343650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e1c0ae130 msgr2=0x7f2e1c0b8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:12.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.462+0000 7f2e220af700 1 --2- 172.21.15.103:0/882343650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e1c0ae130 0x7f2e1c0b8790 secure :-1 s=READY pgs=2121 cs=0 l=1 rx=0x7f2e10000b80 tx=0x7f2e10001e40).stop 2020-04-22T14:20:12.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.462+0000 7f2e220af700 1 -- 172.21.15.103:0/882343650 shutdown_connections 2020-04-22T14:20:12.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.462+0000 7f2e220af700 1 --2- 172.21.15.103:0/882343650 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2dfc04d8d0 0x7f2dfc04fd90 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:12.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.462+0000 7f2e220af700 1 --2- 172.21.15.103:0/882343650 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2e1c0bcc00 0x7f2e1c0b0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:12.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.462+0000 7f2e220af700 1 --2- 172.21.15.103:0/882343650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e1c0ae130 0x7f2e1c0b8790 unknown :-1 s=CLOSED pgs=2121 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:12.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.462+0000 7f2e220af700 1 -- 172.21.15.103:0/882343650 >> 172.21.15.103:0/882343650 conn(0x7f2e1c069f30 msgr2=0x7f2e1c12deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:12.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.462+0000 7f2e220af700 1 -- 172.21.15.103:0/882343650 shutdown_connections 2020-04-22T14:20:12.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:12.462+0000 7f2e220af700 1 -- 172.21.15.103:0/882343650 wait complete. 2020-04-22T14:20:12.723 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 109 2020-04-22T14:20:12.723 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:20:12.723 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":109,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:19:46.112631+0000","modified":"2020-04-22T14:20:11.469554+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":147,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6878},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6878":{"gid":6878,"name":"b","rank":0,"incarnation":109,"state":"up:replay","state_seq":1,"addr":"172.21.15.86:6835/2193157152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2193157152},{"type":"v1","addr":"172.21.15.86:6835","nonce":2193157152}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-04-22T14:20:12.723 INFO:tasks.cephfs.filesystem:mapped states [u'up:replay'] to None 2020-04-22T14:20:13.724 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:13.742 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:20:13.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.895+0000 7f166a770700 1 Processor -- start 2020-04-22T14:20:13.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.895+0000 7f166a770700 1 -- start start 2020-04-22T14:20:13.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.896+0000 7f166a770700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f166412c0d0 0x7f16641464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:13.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.896+0000 7f166a770700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1664065fe0 0x7f166405b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:13.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.896+0000 7f166a770700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1664143300 con 0x7f166405b8a0 2020-04-22T14:20:13.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.896+0000 7f166a770700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f166412c4b0 con 0x7f1664065fe0 2020-04-22T14:20:13.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.896+0000 7f166a770700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16641435a0 con 0x7f166412c0d0 2020-04-22T14:20:13.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.896+0000 7f1663fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f166412c0d0 0x7f16641464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:13.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.896+0000 7f1668d0d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f166405b8a0 0x7f1664062ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50952/0 (socket says 172.21.15.103:50952) 2020-04-22T14:20:13.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.896+0000 7f1668d0d700 1 -- 172.21.15.103:0/4068011020 learned_addr learned my addr 172.21.15.103:0/4068011020 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:13.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.896+0000 7f1663fff700 1 -- 172.21.15.103:0/4068011020 >> v2:172.21.15.86:3300/0 conn(0x7f1664065fe0 msgr2=0x7f166405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:13.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.896+0000 7f16637fe700 1 --2- 172.21.15.103:0/4068011020 >> v2:172.21.15.86:3300/0 conn(0x7f1664065fe0 0x7f166405b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:13.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.896+0000 7f1662ffd700 1 -- 172.21.15.103:0/4068011020 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2416611283 0 0) 0x7f1664143300 con 0x7f166405b8a0 2020-04-22T14:20:13.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.896+0000 7f1663fff700 1 --2- 172.21.15.103:0/4068011020 >> v2:172.21.15.86:3300/0 conn(0x7f1664065fe0 0x7f166405b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:13.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.896+0000 7f1663fff700 1 -- 172.21.15.103:0/4068011020 >> v1:172.21.15.103:6789/0 conn(0x7f166405b8a0 legacy=0x7f1664062ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:13.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.896+0000 7f1663fff700 1 -- 172.21.15.103:0/4068011020 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1664143840 con 0x7f166412c0d0 2020-04-22T14:20:13.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.896+0000 7f16637fe700 1 --2- 172.21.15.103:0/4068011020 >> v2:172.21.15.86:3300/0 conn(0x7f1664065fe0 0x7f166405b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:20:13.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.896+0000 7f1663fff700 1 --2- 172.21.15.103:0/4068011020 >> v2:172.21.15.103:3300/0 conn(0x7f166412c0d0 0x7f16641464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1654002f30 tx=0x7f1654007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:13.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.896+0000 7f1663fff700 1 --2- 172.21.15.103:0/4068011020 >> v2:172.21.15.103:3300/0 conn(0x7f166412c0d0 0x7f16641464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1654002f30 tx=0x7f1654007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:13.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.896+0000 7f1663fff700 1 --2- 172.21.15.103:0/4068011020 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f166412c0d0 0x7f16641464e0 secure :-1 s=READY pgs=2123 cs=0 l=1 rx=0x7f1654002f30 tx=0x7f1654007a40).ready entity=mon.1 client_cookie=5c303262cfb89ec7 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:13.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.896+0000 7f1663fff700 1 --2- 172.21.15.103:0/4068011020 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f166412c0d0 0x7f16641464e0 secure :-1 s=THROTTLE_DONE pgs=2123 cs=0 l=1 rx=0x7f1654002f30 tx=0x7f1654007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:13.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.896+0000 7f1663fff700 1 --2- 172.21.15.103:0/4068011020 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f166412c0d0 0x7f16641464e0 secure :-1 s=THROTTLE_DONE pgs=2123 cs=0 l=1 rx=0x7f1654002f30 tx=0x7f1654007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:13.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.896+0000 7f1662ffd700 1 -- 172.21.15.103:0/4068011020 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1654011470 con 0x7f166412c0d0 2020-04-22T14:20:13.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.896+0000 7f1663fff700 1 --2- 172.21.15.103:0/4068011020 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f166412c0d0 0x7f16641464e0 secure :-1 s=THROTTLE_DONE pgs=2123 cs=0 l=1 rx=0x7f1654002f30 tx=0x7f1654007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:13.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.896+0000 7f1662ffd700 1 -- 172.21.15.103:0/4068011020 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16540115d0 con 0x7f166412c0d0 2020-04-22T14:20:13.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.896+0000 7f1662ffd700 1 -- 172.21.15.103:0/4068011020 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16540119b0 con 0x7f166412c0d0 2020-04-22T14:20:13.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.896+0000 7f166a770700 1 -- 172.21.15.103:0/4068011020 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f166412c0d0 msgr2=0x7f16641464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:13.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.896+0000 7f166a770700 1 --2- 172.21.15.103:0/4068011020 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f166412c0d0 0x7f16641464e0 secure :-1 s=READY pgs=2123 cs=0 l=1 rx=0x7f1654002f30 tx=0x7f1654007a40).stop 2020-04-22T14:20:13.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.896+0000 7f166a770700 1 -- 172.21.15.103:0/4068011020 shutdown_connections 2020-04-22T14:20:13.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.896+0000 7f166a770700 1 --2- 172.21.15.103:0/4068011020 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f166412c0d0 0x7f16641464e0 unknown :-1 s=CLOSED pgs=2123 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:13.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.896+0000 7f166a770700 1 --2- 172.21.15.103:0/4068011020 >> v2:172.21.15.86:3300/0 conn(0x7f1664065fe0 0x7f166405b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:13.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.896+0000 7f166a770700 1 -- 172.21.15.103:0/4068011020 >> 172.21.15.103:0/4068011020 conn(0x7f16640b9160 msgr2=0x7f166405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:13.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.896+0000 7f166a770700 1 -- 172.21.15.103:0/4068011020 shutdown_connections 2020-04-22T14:20:13.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.896+0000 7f166a770700 1 -- 172.21.15.103:0/4068011020 wait complete. 2020-04-22T14:20:13.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.897+0000 7f166a770700 1 Processor -- start 2020-04-22T14:20:13.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.897+0000 7f166a770700 1 -- start start 2020-04-22T14:20:13.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.898+0000 7f166a770700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1664065fe0 0x7f1664142690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:13.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.898+0000 7f166a770700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1664126620 con 0x7f166405b8a0 2020-04-22T14:20:13.911 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.898+0000 7f166a770700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16641268c0 con 0x7f166412c0d0 2020-04-22T14:20:13.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.898+0000 7f166a770700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1664126340 con 0x7f1664065fe0 2020-04-22T14:20:13.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.898+0000 7f1668d0d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f166412c0d0 0x7f1664144540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50960/0 (socket says 172.21.15.103:50960) 2020-04-22T14:20:13.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.898+0000 7f1668d0d700 1 -- 172.21.15.103:0/366808478 learned_addr learned my addr 172.21.15.103:0/366808478 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:13.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.898+0000 7f16637fe700 1 --2- 172.21.15.103:0/366808478 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1664065fe0 0x7f1664142690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:13.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.899+0000 7f16617fa700 1 -- 172.21.15.103:0/366808478 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1505550350 0 0) 0x7f16641268c0 con 0x7f166412c0d0 2020-04-22T14:20:13.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.899+0000 7f16617fa700 1 -- 172.21.15.103:0/366808478 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1644002fe0 con 0x7f166412c0d0 2020-04-22T14:20:13.912 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.899+0000 7f16617fa700 1 -- 172.21.15.103:0/366808478 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 129893011 0 0) 0x7f1664126620 con 0x7f166405b8a0 2020-04-22T14:20:13.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.899+0000 7f16617fa700 1 -- 172.21.15.103:0/366808478 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16641268c0 con 0x7f166405b8a0 2020-04-22T14:20:13.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.899+0000 7f16617fa700 1 -- 172.21.15.103:0/366808478 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2403931300 0 0) 0x7f1644002fe0 con 0x7f166412c0d0 2020-04-22T14:20:13.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.899+0000 7f16617fa700 1 -- 172.21.15.103:0/366808478 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1664126620 con 0x7f166412c0d0 2020-04-22T14:20:13.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.899+0000 7f16617fa700 1 -- 172.21.15.103:0/366808478 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f165c001be0 con 0x7f166412c0d0 2020-04-22T14:20:13.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.899+0000 7f16617fa700 1 -- 172.21.15.103:0/366808478 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1664065fe0 msgr2=0x7f1664142690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:13.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.899+0000 7f16617fa700 1 --2- 172.21.15.103:0/366808478 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1664065fe0 0x7f1664142690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:13.913 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.899+0000 7f16617fa700 1 -- 172.21.15.103:0/366808478 >> v1:172.21.15.103:6789/0 conn(0x7f166412c0d0 legacy=0x7f1664144540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:13.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.899+0000 7f16617fa700 1 -- 172.21.15.103:0/366808478 >> v1:172.21.15.86:6789/0 conn(0x7f166405b8a0 legacy=0x7f1664125c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:13.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.899+0000 7f16617fa700 1 --2- 172.21.15.103:0/366808478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1644004b20 0x7f1644004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:13.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.899+0000 7f16617fa700 1 --2- 172.21.15.103:0/366808478 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1644003800 0x7f1644003c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:13.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.899+0000 7f16617fa700 1 --2- 172.21.15.103:0/366808478 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1664065fe0 0x7f16440040e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:13.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.899+0000 7f16617fa700 1 -- 172.21.15.103:0/366808478 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1664126340 con 0x7f1644003800 2020-04-22T14:20:13.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.899+0000 7f16617fa700 1 -- 172.21.15.103:0/366808478 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1644004540 con 0x7f1644004b20 2020-04-22T14:20:13.914 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.899+0000 7f16617fa700 1 -- 172.21.15.103:0/366808478 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f164400b750 con 0x7f1664065fe0 2020-04-22T14:20:13.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.899+0000 7f1663fff700 1 --2- 172.21.15.103:0/366808478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1644004b20 0x7f1644004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:13.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.899+0000 7f16637fe700 1 --2- 172.21.15.103:0/366808478 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1644003800 0x7f1644003c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:13.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.899+0000 7f1668d0d700 1 --2- 172.21.15.103:0/366808478 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1664065fe0 0x7f16440040e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:13.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.899+0000 7f1663fff700 1 -- 172.21.15.103:0/366808478 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1664065fe0 msgr2=0x7f16440040e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:13.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.899+0000 7f1663fff700 1 --2- 172.21.15.103:0/366808478 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1664065fe0 0x7f16440040e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:13.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.899+0000 7f1663fff700 1 -- 172.21.15.103:0/366808478 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1644003800 msgr2=0x7f1644003c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:13.915 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.899+0000 7f1663fff700 1 --2- 172.21.15.103:0/366808478 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1644003800 0x7f1644003c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:13.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.899+0000 7f1663fff700 1 -- 172.21.15.103:0/366808478 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1664144c50 con 0x7f1644004b20 2020-04-22T14:20:13.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.899+0000 7f166a770700 1 -- 172.21.15.103:0/366808478 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1664157250 con 0x7f1644004b20 2020-04-22T14:20:13.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.899+0000 7f1663fff700 1 --2- 172.21.15.103:0/366808478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1644004b20 0x7f1644004f00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1654007ed0 tx=0x7f1654007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:13.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.899+0000 7f166a770700 1 -- 172.21.15.103:0/366808478 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1664142850 con 0x7f1644004b20 2020-04-22T14:20:13.916 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.899+0000 7f1663fff700 1 --2- 172.21.15.103:0/366808478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1644004b20 0x7f1644004f00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1654007ed0 tx=0x7f1654007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:13.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.899+0000 7f1663fff700 1 --2- 172.21.15.103:0/366808478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1644004b20 0x7f1644004f00 secure :-1 s=READY pgs=2125 cs=0 l=1 rx=0x7f1654007ed0 tx=0x7f1654007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:13.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.900+0000 7f1663fff700 1 --2- 172.21.15.103:0/366808478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1644004b20 0x7f1644004f00 secure :-1 s=THROTTLE_DONE pgs=2125 cs=0 l=1 rx=0x7f1654007ed0 tx=0x7f1654007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:13.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.900+0000 7f16617fa700 1 -- 172.21.15.103:0/366808478 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1654007360 con 0x7f1644004b20 2020-04-22T14:20:13.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.900+0000 7f1663fff700 1 --2- 172.21.15.103:0/366808478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1644004b20 0x7f1644004f00 secure :-1 s=THROTTLE_DONE pgs=2125 cs=0 l=1 rx=0x7f1654007ed0 tx=0x7f1654007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:13.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.900+0000 7f1663fff700 1 --2- 172.21.15.103:0/366808478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1644004b20 0x7f1644004f00 secure :-1 s=THROTTLE_DONE pgs=2125 cs=0 l=1 rx=0x7f1654007ed0 tx=0x7f1654007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:13.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.900+0000 7f16617fa700 1 -- 172.21.15.103:0/366808478 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1654007500 con 0x7f1644004b20 2020-04-22T14:20:13.917 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.900+0000 7f16617fa700 1 -- 172.21.15.103:0/366808478 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16540058b0 con 0x7f1644004b20 2020-04-22T14:20:13.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.900+0000 7f1663fff700 1 --2- 172.21.15.103:0/366808478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1644004b20 0x7f1644004f00 secure :-1 s=THROTTLE_DONE pgs=2125 cs=0 l=1 rx=0x7f1654007ed0 tx=0x7f1654007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:13.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.900+0000 7f166a770700 1 -- 172.21.15.103:0/366808478 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1640003340 con 0x7f1644004b20 2020-04-22T14:20:13.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.901+0000 7f16617fa700 1 -- 172.21.15.103:0/366808478 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f1654005a10 con 0x7f1644004b20 2020-04-22T14:20:13.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.901+0000 7f1663fff700 1 --2- 172.21.15.103:0/366808478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1644004b20 0x7f1644004f00 secure :-1 s=THROTTLE_DONE pgs=2125 cs=0 l=1 rx=0x7f1654007ed0 tx=0x7f1654007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:13.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.901+0000 7f16617fa700 1 --2- 172.21.15.103:0/366808478 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1644055dc0 0x7f1644058280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:13.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.901+0000 7f16617fa700 1 -- 172.21.15.103:0/366808478 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f1654061ae0 con 0x7f1644004b20 2020-04-22T14:20:13.918 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.901+0000 7f16637fe700 1 --2- 172.21.15.103:0/366808478 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1644055dc0 0x7f1644058280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:13.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.901+0000 7f16637fe700 1 --2- 172.21.15.103:0/366808478 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1644055dc0 0x7f1644058280 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1658002f30 tx=0x7f165800cba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:13.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.901+0000 7f16637fe700 1 --2- 172.21.15.103:0/366808478 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1644055dc0 0x7f1644058280 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1658002f30 tx=0x7f165800cba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:13.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.901+0000 7f16637fe700 1 --2- 172.21.15.103:0/366808478 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1644055dc0 0x7f1644058280 secure :-1 s=READY pgs=769 cs=0 l=1 rx=0x7f1658002f30 tx=0x7f165800cba0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:13.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.906+0000 7f1663fff700 1 --2- 172.21.15.103:0/366808478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1644004b20 0x7f1644004f00 secure :-1 s=THROTTLE_DONE pgs=2125 cs=0 l=1 rx=0x7f1654007ed0 tx=0x7f1654007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:13.919 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:13.906+0000 7f16617fa700 1 -- 172.21.15.103:0/366808478 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f165403cfe0 con 0x7f1644004b20 2020-04-22T14:20:14.096 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.093+0000 7f166a770700 1 -- 172.21.15.103:0/366808478 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f16400036e0 con 0x7f1644004b20 2020-04-22T14:20:14.097 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.093+0000 7f1663fff700 1 --2- 172.21.15.103:0/366808478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1644004b20 0x7f1644004f00 secure :-1 s=THROTTLE_DONE pgs=2125 cs=0 l=1 rx=0x7f1654007ed0 tx=0x7f1654007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:14.097 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.093+0000 7f16617fa700 1 -- 172.21.15.103:0/366808478 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) v1 ==== 95+0+1798 (secure 0 0 0) 0x7f1654040600 con 0x7f1644004b20 2020-04-22T14:20:14.097 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:20:14.097 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":110,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:19:46.112631+0000","modified":"2020-04-22T14:20:12.474327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":147,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6878},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6878":{"gid":6878,"name":"b","rank":0,"incarnation":109,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.86:6835/2193157152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2193157152},{"type":"v1","addr":"172.21.15.86:6835","nonce":2193157152}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-04-22T14:20:14.098 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.094+0000 7f166a770700 1 -- 172.21.15.103:0/366808478 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1644055dc0 msgr2=0x7f1644058280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:14.098 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.094+0000 7f166a770700 1 --2- 172.21.15.103:0/366808478 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1644055dc0 0x7f1644058280 secure :-1 s=READY pgs=769 cs=0 l=1 rx=0x7f1658002f30 tx=0x7f165800cba0).stop 2020-04-22T14:20:14.098 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.094+0000 7f166a770700 1 -- 172.21.15.103:0/366808478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1644004b20 msgr2=0x7f1644004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:14.099 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.094+0000 7f166a770700 1 --2- 172.21.15.103:0/366808478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1644004b20 0x7f1644004f00 secure :-1 s=READY pgs=2125 cs=0 l=1 rx=0x7f1654007ed0 tx=0x7f1654007a40).stop 2020-04-22T14:20:14.099 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.094+0000 7f1668d0d700 1 -- 172.21.15.103:0/366808478 reap_dead start 2020-04-22T14:20:14.099 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.095+0000 7f1668d0d700 1 -- 172.21.15.103:0/366808478 reap_dead start 2020-04-22T14:20:14.099 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.095+0000 7f166a770700 1 -- 172.21.15.103:0/366808478 shutdown_connections 2020-04-22T14:20:14.099 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.095+0000 7f166a770700 1 -- 172.21.15.103:0/366808478 >> 172.21.15.103:0/366808478 conn(0x7f16640b9160 msgr2=0x7f1664064410 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:14.099 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.095+0000 7f166a770700 1 -- 172.21.15.103:0/366808478 shutdown_connections 2020-04-22T14:20:14.099 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.095+0000 7f166a770700 1 -- 172.21.15.103:0/366808478 wait complete. 2020-04-22T14:20:14.100 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 110 2020-04-22T14:20:14.108 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to up:reconnect 2020-04-22T14:20:14.108 INFO:tasks.cephfs.filesystem:reached state 'up:reconnect' in 3.39826989174s 2020-04-22T14:20:14.108 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:14.122 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:20:14.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.265+0000 7fb91b65e700 1 Processor -- start 2020-04-22T14:20:14.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.265+0000 7fb91b65e700 1 -- start start 2020-04-22T14:20:14.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.266+0000 7fb91b65e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb9140b6040 0x7fb9140ac740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:14.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.266+0000 7fb91b65e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb914064ec0 con 0x7fb914067170 2020-04-22T14:20:14.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.266+0000 7fb91b65e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb914146870 con 0x7fb9141426d0 2020-04-22T14:20:14.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.266+0000 7fb91b65e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb914065af0 con 0x7fb9140b6040 2020-04-22T14:20:14.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.266+0000 7fb919bfb700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb9141426d0 0x7fb914142b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50970/0 (socket says 172.21.15.103:50970) 2020-04-22T14:20:14.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.266+0000 7fb919bfb700 1 -- 172.21.15.103:0/3411229287 learned_addr learned my addr 172.21.15.103:0/3411229287 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:14.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.267+0000 7fb918bf9700 1 --2- 172.21.15.103:0/3411229287 >> v2:172.21.15.86:3300/0 conn(0x7fb9140b6040 0x7fb9140ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:14.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.267+0000 7fb907fff700 1 -- 172.21.15.103:0/3411229287 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1230197623 0 0) 0x7fb914146870 con 0x7fb9141426d0 2020-04-22T14:20:14.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.267+0000 7fb907fff700 1 -- 172.21.15.103:0/3411229287 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8fc003230 con 0x7fb9141426d0 2020-04-22T14:20:14.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.267+0000 7fb907fff700 1 -- 172.21.15.103:0/3411229287 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 656761286 0 0) 0x7fb8fc003230 con 0x7fb9141426d0 2020-04-22T14:20:14.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.267+0000 7fb907fff700 1 -- 172.21.15.103:0/3411229287 >> v2:172.21.15.86:3300/0 conn(0x7fb9140b6040 msgr2=0x7fb9140ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:14.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.267+0000 7fb907fff700 1 --2- 172.21.15.103:0/3411229287 >> v2:172.21.15.86:3300/0 conn(0x7fb9140b6040 0x7fb9140ac740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:14.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.267+0000 7fb907fff700 1 -- 172.21.15.103:0/3411229287 >> v1:172.21.15.86:6789/0 conn(0x7fb914067170 legacy=0x7fb91413c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:14.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.267+0000 7fb907fff700 1 -- 172.21.15.103:0/3411229287 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb914067550 con 0x7fb9141426d0 2020-04-22T14:20:14.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.267+0000 7fb907fff700 1 -- 172.21.15.103:0/3411229287 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fb90c001a50 con 0x7fb9141426d0 2020-04-22T14:20:14.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.267+0000 7fb907fff700 1 -- 172.21.15.103:0/3411229287 >> v1:172.21.15.103:6789/0 conn(0x7fb9141426d0 legacy=0x7fb914142b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:14.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.267+0000 7fb907fff700 1 --2- 172.21.15.103:0/3411229287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8fc003720 0x7fb8fc003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:14.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.267+0000 7fb907fff700 1 --2- 172.21.15.103:0/3411229287 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb8fc0044d0 0x7fb8fc004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:14.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.267+0000 7fb907fff700 1 --2- 172.21.15.103:0/3411229287 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8fc004db0 0x7fb8fc00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:14.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.267+0000 7fb907fff700 1 -- 172.21.15.103:0/3411229287 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb914065af0 con 0x7fb8fc003720 2020-04-22T14:20:14.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.267+0000 7fb907fff700 1 -- 172.21.15.103:0/3411229287 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8fc0041c0 con 0x7fb8fc004db0 2020-04-22T14:20:14.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.267+0000 7fb907fff700 1 -- 172.21.15.103:0/3411229287 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8fc00bb80 con 0x7fb8fc0044d0 2020-04-22T14:20:14.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.267+0000 7fb919bfb700 1 --2- 172.21.15.103:0/3411229287 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8fc004db0 0x7fb8fc00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:14.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.267+0000 7fb918bf9700 1 --2- 172.21.15.103:0/3411229287 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb8fc0044d0 0x7fb8fc004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:14.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.267+0000 7fb9193fa700 1 --2- 172.21.15.103:0/3411229287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8fc003720 0x7fb8fc003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:14.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.267+0000 7fb919bfb700 1 -- 172.21.15.103:0/3411229287 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb8fc0044d0 msgr2=0x7fb8fc004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:14.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.267+0000 7fb919bfb700 1 --2- 172.21.15.103:0/3411229287 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb8fc0044d0 0x7fb8fc004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:14.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.267+0000 7fb919bfb700 1 -- 172.21.15.103:0/3411229287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8fc003720 msgr2=0x7fb8fc003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:14.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.267+0000 7fb919bfb700 1 --2- 172.21.15.103:0/3411229287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8fc003720 0x7fb8fc003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:14.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.267+0000 7fb919bfb700 1 -- 172.21.15.103:0/3411229287 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8fc003230 con 0x7fb8fc004db0 2020-04-22T14:20:14.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.267+0000 7fb919bfb700 1 --2- 172.21.15.103:0/3411229287 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8fc004db0 0x7fb8fc00b720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb8fc0054a0 tx=0x7fb9140676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:14.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.267+0000 7fb919bfb700 1 -- 172.21.15.103:0/3411229287 reap_dead start 2020-04-22T14:20:14.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.267+0000 7fb919bfb700 1 --2- 172.21.15.103:0/3411229287 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8fc004db0 0x7fb8fc00b720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb8fc0054a0 tx=0x7fb9140676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:14.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.267+0000 7fb919bfb700 1 --2- 172.21.15.103:0/3411229287 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8fc004db0 0x7fb8fc00b720 secure :-1 s=READY pgs=2127 cs=0 l=1 rx=0x7fb8fc0054a0 tx=0x7fb9140676e0).ready entity=mon.1 client_cookie=40eb5656b13681b1 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:14.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.268+0000 7fb919bfb700 1 --2- 172.21.15.103:0/3411229287 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8fc004db0 0x7fb8fc00b720 secure :-1 s=THROTTLE_DONE pgs=2127 cs=0 l=1 rx=0x7fb8fc0054a0 tx=0x7fb9140676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:14.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.268+0000 7fb907fff700 1 -- 172.21.15.103:0/3411229287 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb90c005d40 con 0x7fb8fc004db0 2020-04-22T14:20:14.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.268+0000 7fb919bfb700 1 --2- 172.21.15.103:0/3411229287 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8fc004db0 0x7fb8fc00b720 secure :-1 s=THROTTLE_DONE pgs=2127 cs=0 l=1 rx=0x7fb8fc0054a0 tx=0x7fb9140676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:14.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.268+0000 7fb919bfb700 1 --2- 172.21.15.103:0/3411229287 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8fc004db0 0x7fb8fc00b720 secure :-1 s=THROTTLE_DONE pgs=2127 cs=0 l=1 rx=0x7fb8fc0054a0 tx=0x7fb9140676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:14.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.268+0000 7fb907fff700 1 -- 172.21.15.103:0/3411229287 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb90c010180 con 0x7fb8fc004db0 2020-04-22T14:20:14.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.268+0000 7fb907fff700 1 -- 172.21.15.103:0/3411229287 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb90c0104e0 con 0x7fb8fc004db0 2020-04-22T14:20:14.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.268+0000 7fb91b65e700 1 -- 172.21.15.103:0/3411229287 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8fc004db0 msgr2=0x7fb8fc00b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:14.297 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.268+0000 7fb91b65e700 1 --2- 172.21.15.103:0/3411229287 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8fc004db0 0x7fb8fc00b720 secure :-1 s=READY pgs=2127 cs=0 l=1 rx=0x7fb8fc0054a0 tx=0x7fb9140676e0).stop 2020-04-22T14:20:14.297 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.268+0000 7fb91b65e700 1 -- 172.21.15.103:0/3411229287 shutdown_connections 2020-04-22T14:20:14.297 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.268+0000 7fb91b65e700 1 --2- 172.21.15.103:0/3411229287 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8fc004db0 0x7fb8fc00b720 unknown :-1 s=CLOSED pgs=2127 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:14.297 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.268+0000 7fb91b65e700 1 -- 172.21.15.103:0/3411229287 >> 172.21.15.103:0/3411229287 conn(0x7fb9140b9160 msgr2=0x7fb91405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:14.297 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.268+0000 7fb91b65e700 1 -- 172.21.15.103:0/3411229287 shutdown_connections 2020-04-22T14:20:14.297 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.268+0000 7fb91b65e700 1 -- 172.21.15.103:0/3411229287 wait complete. 2020-04-22T14:20:14.297 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.269+0000 7fb91b65e700 1 Processor -- start 2020-04-22T14:20:14.298 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.269+0000 7fb91b65e700 1 -- start start 2020-04-22T14:20:14.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.270+0000 7fb91b65e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb8fc004db0 0x7fb91412f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:14.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.270+0000 7fb91b65e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb914063c00 0x7fb91413cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:14.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.270+0000 7fb91b65e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb914140dc0 con 0x7fb91413b6e0 2020-04-22T14:20:14.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.270+0000 7fb91b65e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9140640b0 con 0x7fb8fc004db0 2020-04-22T14:20:14.309 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.270+0000 7fb91b65e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb914141010 con 0x7fb914063c00 2020-04-22T14:20:14.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.270+0000 7fb9193fa700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb8fc004db0 0x7fb91412f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:14.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.270+0000 7fb918bf9700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb91413b6e0 0x7fb9141417d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50984/0 (socket says 172.21.15.103:50984) 2020-04-22T14:20:14.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.270+0000 7fb918bf9700 1 -- 172.21.15.103:0/4141884459 learned_addr learned my addr 172.21.15.103:0/4141884459 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:14.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.270+0000 7fb919bfb700 1 --2- 172.21.15.103:0/4141884459 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb914063c00 0x7fb91413cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:14.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.270+0000 7fb9193fa700 1 -- 172.21.15.103:0/4141884459 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb914063c00 msgr2=0x7fb91413cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:14.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.270+0000 7fb9193fa700 1 --2- 172.21.15.103:0/4141884459 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb914063c00 0x7fb91413cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:14.310 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.270+0000 7fb9193fa700 1 -- 172.21.15.103:0/4141884459 >> v1:172.21.15.103:6789/0 conn(0x7fb91413b6e0 legacy=0x7fb9141417d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:14.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.270+0000 7fb9193fa700 1 -- 172.21.15.103:0/4141884459 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9141412b0 con 0x7fb8fc004db0 2020-04-22T14:20:14.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.270+0000 7fb9067fc700 1 -- 172.21.15.103:0/4141884459 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3796219482 0 0) 0x7fb914140dc0 con 0x7fb91413b6e0 2020-04-22T14:20:14.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.270+0000 7fb919bfb700 1 --2- 172.21.15.103:0/4141884459 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb914063c00 0x7fb91413cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:20:14.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.270+0000 7fb9193fa700 1 --2- 172.21.15.103:0/4141884459 >> v2:172.21.15.103:3300/0 conn(0x7fb8fc004db0 0x7fb91412f3b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb914066130 tx=0x7fb90800c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:14.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.270+0000 7fb9193fa700 1 --2- 172.21.15.103:0/4141884459 >> v2:172.21.15.103:3300/0 conn(0x7fb8fc004db0 0x7fb91412f3b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb914066130 tx=0x7fb90800c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:14.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.270+0000 7fb9193fa700 1 --2- 172.21.15.103:0/4141884459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8fc004db0 0x7fb91412f3b0 secure :-1 s=READY pgs=2129 cs=0 l=1 rx=0x7fb914066130 tx=0x7fb90800c4e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:14.311 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.271+0000 7fb9193fa700 1 --2- 172.21.15.103:0/4141884459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8fc004db0 0x7fb91412f3b0 secure :-1 s=THROTTLE_DONE pgs=2129 cs=0 l=1 rx=0x7fb914066130 tx=0x7fb90800c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:14.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.271+0000 7fb9067fc700 1 -- 172.21.15.103:0/4141884459 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb908012350 con 0x7fb8fc004db0 2020-04-22T14:20:14.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.271+0000 7fb9193fa700 1 --2- 172.21.15.103:0/4141884459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8fc004db0 0x7fb91412f3b0 secure :-1 s=THROTTLE_DONE pgs=2129 cs=0 l=1 rx=0x7fb914066130 tx=0x7fb90800c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:14.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.271+0000 7fb9067fc700 1 -- 172.21.15.103:0/4141884459 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9080124b0 con 0x7fb8fc004db0 2020-04-22T14:20:14.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.271+0000 7fb9193fa700 1 --2- 172.21.15.103:0/4141884459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8fc004db0 0x7fb91412f3b0 secure :-1 s=THROTTLE_DONE pgs=2129 cs=0 l=1 rx=0x7fb914066130 tx=0x7fb90800c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:14.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.271+0000 7fb9067fc700 1 -- 172.21.15.103:0/4141884459 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb908012850 con 0x7fb8fc004db0 2020-04-22T14:20:14.312 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.271+0000 7fb91b65e700 1 -- 172.21.15.103:0/4141884459 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb91413c7c0 con 0x7fb8fc004db0 2020-04-22T14:20:14.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.271+0000 7fb91b65e700 1 -- 172.21.15.103:0/4141884459 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb91413d170 con 0x7fb8fc004db0 2020-04-22T14:20:14.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.271+0000 7fb9193fa700 1 --2- 172.21.15.103:0/4141884459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8fc004db0 0x7fb91412f3b0 secure :-1 s=THROTTLE_DONE pgs=2129 cs=0 l=1 rx=0x7fb914066130 tx=0x7fb90800c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:14.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.272+0000 7fb9067fc700 1 -- 172.21.15.103:0/4141884459 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fb908012a50 con 0x7fb8fc004db0 2020-04-22T14:20:14.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.272+0000 7fb9193fa700 1 --2- 172.21.15.103:0/4141884459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8fc004db0 0x7fb91412f3b0 secure :-1 s=THROTTLE_DONE pgs=2129 cs=0 l=1 rx=0x7fb914066130 tx=0x7fb90800c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:14.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.272+0000 7fb91b65e700 1 -- 172.21.15.103:0/4141884459 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb914142510 con 0x7fb8fc004db0 2020-04-22T14:20:14.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.272+0000 7fb9067fc700 1 --2- 172.21.15.103:0/4141884459 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb8f404d7a0 0x7fb8f404fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:14.313 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.272+0000 7fb9067fc700 1 -- 172.21.15.103:0/4141884459 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fb908060d10 con 0x7fb8fc004db0 2020-04-22T14:20:14.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.272+0000 7fb918bf9700 1 --2- 172.21.15.103:0/4141884459 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb8f404d7a0 0x7fb8f404fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:14.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.272+0000 7fb918bf9700 1 --2- 172.21.15.103:0/4141884459 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb8f404d7a0 0x7fb8f404fc60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb910002ed0 tx=0x7fb910007ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:14.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.272+0000 7fb918bf9700 1 --2- 172.21.15.103:0/4141884459 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb8f404d7a0 0x7fb8f404fc60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb910002ed0 tx=0x7fb910007ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:14.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.272+0000 7fb918bf9700 1 --2- 172.21.15.103:0/4141884459 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb8f404d7a0 0x7fb8f404fc60 secure :-1 s=READY pgs=770 cs=0 l=1 rx=0x7fb910002ed0 tx=0x7fb910007ef0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:14.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.276+0000 7fb9193fa700 1 --2- 172.21.15.103:0/4141884459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8fc004db0 0x7fb91412f3b0 secure :-1 s=THROTTLE_DONE pgs=2129 cs=0 l=1 rx=0x7fb914066130 tx=0x7fb90800c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:14.314 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.276+0000 7fb9067fc700 1 -- 172.21.15.103:0/4141884459 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fb90803c150 con 0x7fb8fc004db0 2020-04-22T14:20:14.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.467+0000 7fb91b65e700 1 -- 172.21.15.103:0/4141884459 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb914056c90 con 0x7fb8fc004db0 2020-04-22T14:20:14.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.467+0000 7fb9193fa700 1 --2- 172.21.15.103:0/4141884459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8fc004db0 0x7fb91412f3b0 secure :-1 s=THROTTLE_DONE pgs=2129 cs=0 l=1 rx=0x7fb914066130 tx=0x7fb90800c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:14.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.467+0000 7fb9067fc700 1 -- 172.21.15.103:0/4141884459 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) v1 ==== 95+0+1798 (secure 0 0 0) 0x7fb90803f770 con 0x7fb8fc004db0 2020-04-22T14:20:14.471 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:20:14.471 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":110,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:19:46.112631+0000","modified":"2020-04-22T14:20:12.474327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":147,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6878},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6878":{"gid":6878,"name":"b","rank":0,"incarnation":109,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.86:6835/2193157152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2193157152},{"type":"v1","addr":"172.21.15.86:6835","nonce":2193157152}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-04-22T14:20:14.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.469+0000 7fb91b65e700 1 -- 172.21.15.103:0/4141884459 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb8f404d7a0 msgr2=0x7fb8f404fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:14.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.469+0000 7fb91b65e700 1 --2- 172.21.15.103:0/4141884459 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb8f404d7a0 0x7fb8f404fc60 secure :-1 s=READY pgs=770 cs=0 l=1 rx=0x7fb910002ed0 tx=0x7fb910007ef0).stop 2020-04-22T14:20:14.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.469+0000 7fb91b65e700 1 -- 172.21.15.103:0/4141884459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8fc004db0 msgr2=0x7fb91412f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:14.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.469+0000 7fb91b65e700 1 --2- 172.21.15.103:0/4141884459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8fc004db0 0x7fb91412f3b0 secure :-1 s=READY pgs=2129 cs=0 l=1 rx=0x7fb914066130 tx=0x7fb90800c4e0).stop 2020-04-22T14:20:14.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.469+0000 7fb91b65e700 1 -- 172.21.15.103:0/4141884459 shutdown_connections 2020-04-22T14:20:14.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.469+0000 7fb91b65e700 1 --2- 172.21.15.103:0/4141884459 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb8f404d7a0 0x7fb8f404fc60 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:14.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.469+0000 7fb91b65e700 1 --2- 172.21.15.103:0/4141884459 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb914063c00 0x7fb91413cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:14.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.469+0000 7fb91b65e700 1 --2- 172.21.15.103:0/4141884459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8fc004db0 0x7fb91412f3b0 unknown :-1 s=CLOSED pgs=2129 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:14.473 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.469+0000 7fb91b65e700 1 -- 172.21.15.103:0/4141884459 >> 172.21.15.103:0/4141884459 conn(0x7fb9140b9160 msgr2=0x7fb9140b6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:14.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.469+0000 7fb91b65e700 1 -- 172.21.15.103:0/4141884459 shutdown_connections 2020-04-22T14:20:14.474 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.469+0000 7fb91b65e700 1 -- 172.21.15.103:0/4141884459 wait complete. 2020-04-22T14:20:14.474 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 110 2020-04-22T14:20:14.481 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:20:14.498 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok session ls 2020-04-22T14:20:14.670 INFO:teuthology.orchestra.run.smithi086.stdout:[ 2020-04-22T14:20:14.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2020-04-22T14:20:14.670 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 9949, 2020-04-22T14:20:14.670 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": { 2020-04-22T14:20:14.671 INFO:teuthology.orchestra.run.smithi086.stdout: "name": { 2020-04-22T14:20:14.671 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "client", 2020-04-22T14:20:14.671 INFO:teuthology.orchestra.run.smithi086.stdout: "num": 9949 2020-04-22T14:20:14.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2020-04-22T14:20:14.671 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": { 2020-04-22T14:20:14.671 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "any", 2020-04-22T14:20:14.671 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": "192.168.0.2:0", 2020-04-22T14:20:14.672 INFO:teuthology.orchestra.run.smithi086.stdout: "nonce": 379068779 2020-04-22T14:20:14.672 INFO:teuthology.orchestra.run.smithi086.stdout: } 2020-04-22T14:20:14.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2020-04-22T14:20:14.672 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "open", 2020-04-22T14:20:14.672 INFO:teuthology.orchestra.run.smithi086.stdout: "num_leases": 0, 2020-04-22T14:20:14.673 INFO:teuthology.orchestra.run.smithi086.stdout: "num_caps": 1, 2020-04-22T14:20:14.673 INFO:teuthology.orchestra.run.smithi086.stdout: "request_load_avg": 0, 2020-04-22T14:20:14.673 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 3.1869258459999998, 2020-04-22T14:20:14.673 INFO:teuthology.orchestra.run.smithi086.stdout: "requests_in_flight": 0, 2020-04-22T14:20:14.673 INFO:teuthology.orchestra.run.smithi086.stdout: "completed_requests": 0, 2020-04-22T14:20:14.673 INFO:teuthology.orchestra.run.smithi086.stdout: "reconnecting": false, 2020-04-22T14:20:14.673 INFO:teuthology.orchestra.run.smithi086.stdout: "recall_caps": { 2020-04-22T14:20:14.673 INFO:teuthology.orchestra.run.smithi086.stdout: "value": 0, 2020-04-22T14:20:14.674 INFO:teuthology.orchestra.run.smithi086.stdout: "halflife": 60 2020-04-22T14:20:14.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2020-04-22T14:20:14.674 INFO:teuthology.orchestra.run.smithi086.stdout: "release_caps": { 2020-04-22T14:20:14.674 INFO:teuthology.orchestra.run.smithi086.stdout: "value": 0, 2020-04-22T14:20:14.674 INFO:teuthology.orchestra.run.smithi086.stdout: "halflife": 60 2020-04-22T14:20:14.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2020-04-22T14:20:14.674 INFO:teuthology.orchestra.run.smithi086.stdout: "recall_caps_throttle": { 2020-04-22T14:20:14.675 INFO:teuthology.orchestra.run.smithi086.stdout: "value": 0, 2020-04-22T14:20:14.675 INFO:teuthology.orchestra.run.smithi086.stdout: "halflife": 2.5 2020-04-22T14:20:14.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2020-04-22T14:20:14.675 INFO:teuthology.orchestra.run.smithi086.stdout: "recall_caps_throttle2o": { 2020-04-22T14:20:14.675 INFO:teuthology.orchestra.run.smithi086.stdout: "value": 0, 2020-04-22T14:20:14.675 INFO:teuthology.orchestra.run.smithi086.stdout: "halflife": 0.5 2020-04-22T14:20:14.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2020-04-22T14:20:14.676 INFO:teuthology.orchestra.run.smithi086.stdout: "session_cache_liveness": { 2020-04-22T14:20:14.676 INFO:teuthology.orchestra.run.smithi086.stdout: "value": 0.99494832528906663, 2020-04-22T14:20:14.676 INFO:teuthology.orchestra.run.smithi086.stdout: "halflife": 300 2020-04-22T14:20:14.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2020-04-22T14:20:14.676 INFO:teuthology.orchestra.run.smithi086.stdout: "inst": "client.9949 192.168.0.2:0/379068779", 2020-04-22T14:20:14.676 INFO:teuthology.orchestra.run.smithi086.stdout: "completed_requests": [], 2020-04-22T14:20:14.676 INFO:teuthology.orchestra.run.smithi086.stdout: "prealloc_inos": [], 2020-04-22T14:20:14.677 INFO:teuthology.orchestra.run.smithi086.stdout: "used_inos": [], 2020-04-22T14:20:14.677 INFO:teuthology.orchestra.run.smithi086.stdout: "client_metadata": { 2020-04-22T14:20:14.677 INFO:teuthology.orchestra.run.smithi086.stdout: "client_features": { 2020-04-22T14:20:14.677 INFO:teuthology.orchestra.run.smithi086.stdout: "feature_bits": "0x0000000000003fff" 2020-04-22T14:20:14.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2020-04-22T14:20:14.678 INFO:teuthology.orchestra.run.smithi086.stdout: "metric_spec": { 2020-04-22T14:20:14.679 INFO:teuthology.orchestra.run.smithi086.stdout: "metric_flags": { 2020-04-22T14:20:14.679 INFO:teuthology.orchestra.run.smithi086.stdout: "feature_bits": "0x" 2020-04-22T14:20:14.679 INFO:teuthology.orchestra.run.smithi086.stdout: } 2020-04-22T14:20:14.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2020-04-22T14:20:14.679 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:20:14.679 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:20:14.680 INFO:teuthology.orchestra.run.smithi086.stdout: "entity_id": "1", 2020-04-22T14:20:14.680 INFO:teuthology.orchestra.run.smithi086.stdout: "hostname": "smithi103", 2020-04-22T14:20:14.680 INFO:teuthology.orchestra.run.smithi086.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2020-04-22T14:20:14.680 INFO:teuthology.orchestra.run.smithi086.stdout: "pid": "124013", 2020-04-22T14:20:14.680 INFO:teuthology.orchestra.run.smithi086.stdout: "root": "/" 2020-04-22T14:20:14.680 INFO:teuthology.orchestra.run.smithi086.stdout: } 2020-04-22T14:20:14.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2020-04-22T14:20:14.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2020-04-22T14:20:14.681 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 9904, 2020-04-22T14:20:14.681 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": { 2020-04-22T14:20:14.681 INFO:teuthology.orchestra.run.smithi086.stdout: "name": { 2020-04-22T14:20:14.681 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "client", 2020-04-22T14:20:14.681 INFO:teuthology.orchestra.run.smithi086.stdout: "num": 9904 2020-04-22T14:20:14.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2020-04-22T14:20:14.682 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": { 2020-04-22T14:20:14.682 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "any", 2020-04-22T14:20:14.682 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:20:14.682 INFO:teuthology.orchestra.run.smithi086.stdout: "nonce": 3303065033 2020-04-22T14:20:14.682 INFO:teuthology.orchestra.run.smithi086.stdout: } 2020-04-22T14:20:14.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2020-04-22T14:20:14.682 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "open", 2020-04-22T14:20:14.683 INFO:teuthology.orchestra.run.smithi086.stdout: "num_leases": 0, 2020-04-22T14:20:14.683 INFO:teuthology.orchestra.run.smithi086.stdout: "num_caps": 0, 2020-04-22T14:20:14.683 INFO:teuthology.orchestra.run.smithi086.stdout: "request_load_avg": 0, 2020-04-22T14:20:14.683 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 3.1869258459999998, 2020-04-22T14:20:14.683 INFO:teuthology.orchestra.run.smithi086.stdout: "requests_in_flight": 0, 2020-04-22T14:20:14.683 INFO:teuthology.orchestra.run.smithi086.stdout: "completed_requests": 1, 2020-04-22T14:20:14.683 INFO:teuthology.orchestra.run.smithi086.stdout: "reconnecting": true, 2020-04-22T14:20:14.684 INFO:teuthology.orchestra.run.smithi086.stdout: "recall_caps": { 2020-04-22T14:20:14.684 INFO:teuthology.orchestra.run.smithi086.stdout: "value": 0, 2020-04-22T14:20:14.684 INFO:teuthology.orchestra.run.smithi086.stdout: "halflife": 60 2020-04-22T14:20:14.684 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2020-04-22T14:20:14.684 INFO:teuthology.orchestra.run.smithi086.stdout: "release_caps": { 2020-04-22T14:20:14.684 INFO:teuthology.orchestra.run.smithi086.stdout: "value": 0, 2020-04-22T14:20:14.684 INFO:teuthology.orchestra.run.smithi086.stdout: "halflife": 60 2020-04-22T14:20:14.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2020-04-22T14:20:14.685 INFO:teuthology.orchestra.run.smithi086.stdout: "recall_caps_throttle": { 2020-04-22T14:20:14.685 INFO:teuthology.orchestra.run.smithi086.stdout: "value": 0, 2020-04-22T14:20:14.685 INFO:teuthology.orchestra.run.smithi086.stdout: "halflife": 2.5 2020-04-22T14:20:14.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2020-04-22T14:20:14.685 INFO:teuthology.orchestra.run.smithi086.stdout: "recall_caps_throttle2o": { 2020-04-22T14:20:14.685 INFO:teuthology.orchestra.run.smithi086.stdout: "value": 0, 2020-04-22T14:20:14.686 INFO:teuthology.orchestra.run.smithi086.stdout: "halflife": 0.5 2020-04-22T14:20:14.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2020-04-22T14:20:14.686 INFO:teuthology.orchestra.run.smithi086.stdout: "session_cache_liveness": { 2020-04-22T14:20:14.686 INFO:teuthology.orchestra.run.smithi086.stdout: "value": 0, 2020-04-22T14:20:14.686 INFO:teuthology.orchestra.run.smithi086.stdout: "halflife": 300 2020-04-22T14:20:14.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2020-04-22T14:20:14.686 INFO:teuthology.orchestra.run.smithi086.stdout: "inst": "client.9904 192.168.0.1:0/3303065033", 2020-04-22T14:20:14.687 INFO:teuthology.orchestra.run.smithi086.stdout: "completed_requests": [ 2020-04-22T14:20:14.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2020-04-22T14:20:14.687 INFO:teuthology.orchestra.run.smithi086.stdout: "tid": 2, 2020-04-22T14:20:14.687 INFO:teuthology.orchestra.run.smithi086.stdout: "created_ino": "0x0" 2020-04-22T14:20:14.687 INFO:teuthology.orchestra.run.smithi086.stdout: } 2020-04-22T14:20:14.687 INFO:teuthology.orchestra.run.smithi086.stdout: ], 2020-04-22T14:20:14.687 INFO:teuthology.orchestra.run.smithi086.stdout: "prealloc_inos": [], 2020-04-22T14:20:14.687 INFO:teuthology.orchestra.run.smithi086.stdout: "used_inos": [], 2020-04-22T14:20:14.688 INFO:teuthology.orchestra.run.smithi086.stdout: "client_metadata": { 2020-04-22T14:20:14.688 INFO:teuthology.orchestra.run.smithi086.stdout: "client_features": { 2020-04-22T14:20:14.688 INFO:teuthology.orchestra.run.smithi086.stdout: "feature_bits": "0x0000000000003fff" 2020-04-22T14:20:14.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2020-04-22T14:20:14.688 INFO:teuthology.orchestra.run.smithi086.stdout: "metric_spec": { 2020-04-22T14:20:14.688 INFO:teuthology.orchestra.run.smithi086.stdout: "metric_flags": { 2020-04-22T14:20:14.688 INFO:teuthology.orchestra.run.smithi086.stdout: "feature_bits": "0x" 2020-04-22T14:20:14.689 INFO:teuthology.orchestra.run.smithi086.stdout: } 2020-04-22T14:20:14.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2020-04-22T14:20:14.689 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:20:14.689 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:20:14.689 INFO:teuthology.orchestra.run.smithi086.stdout: "entity_id": "0", 2020-04-22T14:20:14.689 INFO:teuthology.orchestra.run.smithi086.stdout: "hostname": "smithi103", 2020-04-22T14:20:14.690 INFO:teuthology.orchestra.run.smithi086.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-04-22T14:20:14.690 INFO:teuthology.orchestra.run.smithi086.stdout: "pid": "122752", 2020-04-22T14:20:14.690 INFO:teuthology.orchestra.run.smithi086.stdout: "root": "/" 2020-04-22T14:20:14.690 INFO:teuthology.orchestra.run.smithi086.stdout: } 2020-04-22T14:20:14.690 INFO:teuthology.orchestra.run.smithi086.stdout: } 2020-04-22T14:20:14.691 INFO:teuthology.orchestra.run.smithi086.stdout:] 2020-04-22T14:20:14.692 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "id": 9949, "entity": { "name": { "type": "client", "num": 9949 }, "addr": { "type": "any", "addr": "192.168.0.2:0", "nonce": 379068779 } }, "state": "open", "num_leases": 0, "num_caps": 1, "request_load_avg": 0, "uptime": 3.1869258459999998, "requests_in_flight": 0, "completed_requests": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0.99494832528906663, "halflife": 300 }, "inst": "client.9949 192.168.0.2:0/379068779", "completed_requests": [], "prealloc_inos": [], "used_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x0000000000003fff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x" } }, "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", "entity_id": "1", "hostname": "smithi103", "mount_point": "/home/ubuntu/cephtest/mnt.1", "pid": "124013", "root": "/" } }, { "id": 9904, "entity": { "name": { "type": "client", "num": 9904 }, "addr": { "type": "any", "addr": "192.168.0.1:0", "nonce": 3303065033 } }, "state": "open", "num_leases": 0, "num_caps": 0, "request_load_avg": 0, "uptime": 3.1869258459999998, "requests_in_flight": 0, "completed_requests": 1, "reconnecting": true, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0, "halflife": 300 }, "inst": "client.9904 192.168.0.1:0/3303065033", "completed_requests": [ { "tid": 2, "created_ino": "0x0" } ], "prealloc_inos": [], "used_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x0000000000003fff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x" } }, "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", "entity_id": "0", "hostname": "smithi103", "mount_point": "/home/ubuntu/cephtest/mnt.0", "pid": "122752", "root": "/" } } ] 2020-04-22T14:20:14.692 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:14.706 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:20:14.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.850+0000 7faaa4d87700 1 Processor -- start 2020-04-22T14:20:14.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.850+0000 7faaa4d87700 1 -- start start 2020-04-22T14:20:14.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.851+0000 7faaa4d87700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faaa00b6040 0x7faaa00ac740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:14.855 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.851+0000 7faaa4d87700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaa0064ec0 con 0x7faaa0067170 2020-04-22T14:20:14.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.851+0000 7faaa4d87700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaa0146870 con 0x7faaa01426d0 2020-04-22T14:20:14.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.851+0000 7faaa4d87700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa0065af0 con 0x7faaa00b6040 2020-04-22T14:20:14.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.851+0000 7faa9ed9d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7faaa01426d0 0x7faaa0142b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50990/0 (socket says 172.21.15.103:50990) 2020-04-22T14:20:14.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.851+0000 7faa9ed9d700 1 -- 172.21.15.103:0/461525724 learned_addr learned my addr 172.21.15.103:0/461525724 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:14.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.851+0000 7faa9dd9b700 1 --2- 172.21.15.103:0/461525724 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faaa00b6040 0x7faaa00ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:14.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.852+0000 7faa9d59a700 1 -- 172.21.15.103:0/461525724 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3358785751 0 0) 0x7faaa0146870 con 0x7faaa01426d0 2020-04-22T14:20:14.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.852+0000 7faa9d59a700 1 -- 172.21.15.103:0/461525724 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa84003230 con 0x7faaa01426d0 2020-04-22T14:20:14.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.852+0000 7faa9d59a700 1 -- 172.21.15.103:0/461525724 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1429623959 0 0) 0x7faaa0064ec0 con 0x7faaa0067170 2020-04-22T14:20:14.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.852+0000 7faa9d59a700 1 -- 172.21.15.103:0/461525724 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faaa0146870 con 0x7faaa0067170 2020-04-22T14:20:14.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.852+0000 7faa9dd9b700 1 -- 172.21.15.103:0/461525724 >> v1:172.21.15.103:6789/0 conn(0x7faaa01426d0 legacy=0x7faaa0142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:14.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.852+0000 7faa9dd9b700 1 -- 172.21.15.103:0/461525724 >> v1:172.21.15.86:6789/0 conn(0x7faaa0067170 legacy=0x7faaa013c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:14.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.852+0000 7faa9dd9b700 1 -- 172.21.15.103:0/461525724 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa0067550 con 0x7faaa00b6040 2020-04-22T14:20:14.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.852+0000 7faa9dd9b700 1 --2- 172.21.15.103:0/461525724 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faaa00b6040 0x7faaa00ac740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7faa90002f30 tx=0x7faa900088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:14.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.852+0000 7faa9dd9b700 1 --2- 172.21.15.103:0/461525724 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faaa00b6040 0x7faaa00ac740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7faa90002f30 tx=0x7faa900088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:14.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.852+0000 7faa9dd9b700 1 --2- 172.21.15.103:0/461525724 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faaa00b6040 0x7faaa00ac740 secure :-1 s=READY pgs=200 cs=0 l=1 rx=0x7faa90002f30 tx=0x7faa900088e0).ready entity=mon.2 client_cookie=dbccc981d4533787 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:14.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.852+0000 7faa9dd9b700 1 --2- 172.21.15.103:0/461525724 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faaa00b6040 0x7faaa00ac740 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7faa90002f30 tx=0x7faa900088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:14.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.852+0000 7faa9d59a700 1 -- 172.21.15.103:0/461525724 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa90008e40 con 0x7faaa00b6040 2020-04-22T14:20:14.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.852+0000 7faa9dd9b700 1 --2- 172.21.15.103:0/461525724 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faaa00b6040 0x7faaa00ac740 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7faa90002f30 tx=0x7faa900088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:14.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.852+0000 7faa9d59a700 1 -- 172.21.15.103:0/461525724 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa90012650 con 0x7faaa00b6040 2020-04-22T14:20:14.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.852+0000 7faa9dd9b700 1 --2- 172.21.15.103:0/461525724 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faaa00b6040 0x7faaa00ac740 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7faa90002f30 tx=0x7faa900088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:14.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.852+0000 7faa9d59a700 1 -- 172.21.15.103:0/461525724 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa90012a70 con 0x7faaa00b6040 2020-04-22T14:20:14.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.852+0000 7faaa4d87700 1 -- 172.21.15.103:0/461525724 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faaa00b6040 msgr2=0x7faaa00ac740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:14.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.852+0000 7faaa4d87700 1 --2- 172.21.15.103:0/461525724 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faaa00b6040 0x7faaa00ac740 secure :-1 s=READY pgs=200 cs=0 l=1 rx=0x7faa90002f30 tx=0x7faa900088e0).stop 2020-04-22T14:20:14.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.853+0000 7faaa4d87700 1 -- 172.21.15.103:0/461525724 shutdown_connections 2020-04-22T14:20:14.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.853+0000 7faaa4d87700 1 --2- 172.21.15.103:0/461525724 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faaa00b6040 0x7faaa00ac740 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:14.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.853+0000 7faaa4d87700 1 -- 172.21.15.103:0/461525724 >> 172.21.15.103:0/461525724 conn(0x7faaa00b9160 msgr2=0x7faaa005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:14.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.853+0000 7faaa4d87700 1 -- 172.21.15.103:0/461525724 shutdown_connections 2020-04-22T14:20:14.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.853+0000 7faaa4d87700 1 -- 172.21.15.103:0/461525724 wait complete. 2020-04-22T14:20:14.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.854+0000 7faaa4d87700 1 Processor -- start 2020-04-22T14:20:14.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.854+0000 7faaa4d87700 1 -- start start 2020-04-22T14:20:14.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.854+0000 7faaa4d87700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7faaa00b6040 0x7faaa0145bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:14.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.854+0000 7faaa4d87700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7faaa01426d0 0x7faaa0144db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:14.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.854+0000 7faaa4d87700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaa01462b0 con 0x7faaa0067170 2020-04-22T14:20:14.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.854+0000 7faaa4d87700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaa0145210 con 0x7faaa01426d0 2020-04-22T14:20:14.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.854+0000 7faaa4d87700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaa01443d0 con 0x7faaa00b6040 2020-04-22T14:20:14.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.854+0000 7faa9dd9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7faaa00b6040 0x7faaa0145bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:14.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.854+0000 7faa9dd9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7faaa00b6040 0x7faaa0145bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58806/0 (socket says 172.21.15.103:58806) 2020-04-22T14:20:14.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.854+0000 7faa9dd9b700 1 -- 172.21.15.103:0/1874979443 learned_addr learned my addr 172.21.15.103:0/1874979443 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:14.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.854+0000 7faa9e59c700 1 --1- 172.21.15.103:0/1874979443 >> v1:172.21.15.103:6789/0 conn(0x7faaa0067170 0x7faaa013d220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50994/0 (socket says 172.21.15.103:50994) 2020-04-22T14:20:14.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.854+0000 7faa9ed9d700 1 --2- 172.21.15.103:0/1874979443 >> v2:172.21.15.86:3300/0 conn(0x7faaa01426d0 0x7faaa0144db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:14.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.855+0000 7faa9dd9b700 1 -- 172.21.15.103:0/1874979443 >> v2:172.21.15.86:3300/0 conn(0x7faaa01426d0 msgr2=0x7faaa0144db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:14.865 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.855+0000 7faa8f7fe700 1 -- 172.21.15.103:0/1874979443 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2078799842 0 0) 0x7faaa01462b0 con 0x7faaa0067170 2020-04-22T14:20:14.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.855+0000 7faa9dd9b700 1 --2- 172.21.15.103:0/1874979443 >> v2:172.21.15.86:3300/0 conn(0x7faaa01426d0 0x7faaa0144db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:14.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.855+0000 7faa9dd9b700 1 -- 172.21.15.103:0/1874979443 >> v1:172.21.15.103:6789/0 conn(0x7faaa0067170 legacy=0x7faaa013d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:14.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.855+0000 7faa9dd9b700 1 -- 172.21.15.103:0/1874979443 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa0144670 con 0x7faaa00b6040 2020-04-22T14:20:14.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.855+0000 7faa9dd9b700 1 --2- 172.21.15.103:0/1874979443 >> v2:172.21.15.103:3300/0 conn(0x7faaa00b6040 0x7faaa0145bd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faa90002f30 tx=0x7faa90008fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:14.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.855+0000 7faa9dd9b700 1 --2- 172.21.15.103:0/1874979443 >> v2:172.21.15.103:3300/0 conn(0x7faaa00b6040 0x7faaa0145bd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faa90002f30 tx=0x7faa90008fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:14.866 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.855+0000 7faa9dd9b700 1 --2- 172.21.15.103:0/1874979443 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaa00b6040 0x7faaa0145bd0 secure :-1 s=READY pgs=2132 cs=0 l=1 rx=0x7faa90002f30 tx=0x7faa90008fa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:14.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.855+0000 7faa9dd9b700 1 --2- 172.21.15.103:0/1874979443 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaa00b6040 0x7faaa0145bd0 secure :-1 s=THROTTLE_DONE pgs=2132 cs=0 l=1 rx=0x7faa90002f30 tx=0x7faa90008fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:14.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.855+0000 7faa8f7fe700 1 -- 172.21.15.103:0/1874979443 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa90007170 con 0x7faaa00b6040 2020-04-22T14:20:14.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.855+0000 7faa9dd9b700 1 --2- 172.21.15.103:0/1874979443 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaa00b6040 0x7faaa0145bd0 secure :-1 s=THROTTLE_DONE pgs=2132 cs=0 l=1 rx=0x7faa90002f30 tx=0x7faa90008fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:14.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.855+0000 7faa9dd9b700 1 --2- 172.21.15.103:0/1874979443 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaa00b6040 0x7faaa0145bd0 secure :-1 s=THROTTLE_DONE pgs=2132 cs=0 l=1 rx=0x7faa90002f30 tx=0x7faa90008fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:14.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.855+0000 7faa8f7fe700 1 -- 172.21.15.103:0/1874979443 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa90007310 con 0x7faaa00b6040 2020-04-22T14:20:14.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.855+0000 7faaa4d87700 1 -- 172.21.15.103:0/1874979443 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa0144910 con 0x7faaa00b6040 2020-04-22T14:20:14.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.855+0000 7faa8f7fe700 1 -- 172.21.15.103:0/1874979443 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa900056c0 con 0x7faaa00b6040 2020-04-22T14:20:14.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.855+0000 7faaa4d87700 1 -- 172.21.15.103:0/1874979443 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa0133260 con 0x7faaa00b6040 2020-04-22T14:20:14.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.856+0000 7faa9dd9b700 1 --2- 172.21.15.103:0/1874979443 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaa00b6040 0x7faaa0145bd0 secure :-1 s=THROTTLE_DONE pgs=2132 cs=0 l=1 rx=0x7faa90002f30 tx=0x7faa90008fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:14.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.856+0000 7faa8f7fe700 1 -- 172.21.15.103:0/1874979443 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7faa90005820 con 0x7faaa00b6040 2020-04-22T14:20:14.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.856+0000 7faa9dd9b700 1 --2- 172.21.15.103:0/1874979443 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaa00b6040 0x7faaa0145bd0 secure :-1 s=THROTTLE_DONE pgs=2132 cs=0 l=1 rx=0x7faa90002f30 tx=0x7faa90008fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:14.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.856+0000 7faaa4d87700 1 -- 172.21.15.103:0/1874979443 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaa0144aa0 con 0x7faaa00b6040 2020-04-22T14:20:14.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.856+0000 7faa8f7fe700 1 --2- 172.21.15.103:0/1874979443 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faa7c04d770 0x7faa7c04fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:14.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.856+0000 7faa8f7fe700 1 -- 172.21.15.103:0/1874979443 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6159+0+0 (secure 0 0 0) 0x7faa90061ca0 con 0x7faaa00b6040 2020-04-22T14:20:14.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.856+0000 7faa9e59c700 1 --2- 172.21.15.103:0/1874979443 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faa7c04d770 0x7faa7c04fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:14.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.857+0000 7faa9e59c700 1 --2- 172.21.15.103:0/1874979443 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faa7c04d770 0x7faa7c04fc30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faa94001050 tx=0x7faa94002750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:14.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.857+0000 7faa9e59c700 1 --2- 172.21.15.103:0/1874979443 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faa7c04d770 0x7faa7c04fc30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faa94001050 tx=0x7faa94002750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:14.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.857+0000 7faa9e59c700 1 --2- 172.21.15.103:0/1874979443 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faa7c04d770 0x7faa7c04fc30 secure :-1 s=READY pgs=771 cs=0 l=1 rx=0x7faa94001050 tx=0x7faa94002750).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:14.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.860+0000 7faa9dd9b700 1 --2- 172.21.15.103:0/1874979443 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaa00b6040 0x7faaa0145bd0 secure :-1 s=THROTTLE_DONE pgs=2132 cs=0 l=1 rx=0x7faa90002f30 tx=0x7faa90008fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:14.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:14.860+0000 7faa8f7fe700 1 -- 172.21.15.103:0/1874979443 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7faa9003d1a0 con 0x7faaa00b6040 2020-04-22T14:20:15.052 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.050+0000 7faaa4d87700 1 -- 172.21.15.103:0/1874979443 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faaa0056c90 con 0x7faaa00b6040 2020-04-22T14:20:15.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.050+0000 7faa9dd9b700 1 --2- 172.21.15.103:0/1874979443 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaa00b6040 0x7faaa0145bd0 secure :-1 s=THROTTLE_DONE pgs=2132 cs=0 l=1 rx=0x7faa90002f30 tx=0x7faa90008fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:15.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.050+0000 7faa8f7fe700 1 -- 172.21.15.103:0/1874979443 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) v1 ==== 95+0+1798 (secure 0 0 0) 0x7faa900407c0 con 0x7faaa00b6040 2020-04-22T14:20:15.053 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:20:15.053 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":110,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:19:46.112631+0000","modified":"2020-04-22T14:20:12.474327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":147,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6878},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6878":{"gid":6878,"name":"b","rank":0,"incarnation":109,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.86:6835/2193157152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2193157152},{"type":"v1","addr":"172.21.15.86:6835","nonce":2193157152}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-04-22T14:20:15.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.052+0000 7faaa4d87700 1 -- 172.21.15.103:0/1874979443 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faa7c04d770 msgr2=0x7faa7c04fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:15.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.052+0000 7faaa4d87700 1 --2- 172.21.15.103:0/1874979443 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faa7c04d770 0x7faa7c04fc30 secure :-1 s=READY pgs=771 cs=0 l=1 rx=0x7faa94001050 tx=0x7faa94002750).stop 2020-04-22T14:20:15.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.052+0000 7faaa4d87700 1 -- 172.21.15.103:0/1874979443 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaa00b6040 msgr2=0x7faaa0145bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:15.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.052+0000 7faaa4d87700 1 --2- 172.21.15.103:0/1874979443 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaa00b6040 0x7faaa0145bd0 secure :-1 s=READY pgs=2132 cs=0 l=1 rx=0x7faa90002f30 tx=0x7faa90008fa0).stop 2020-04-22T14:20:15.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.052+0000 7faaa4d87700 1 -- 172.21.15.103:0/1874979443 shutdown_connections 2020-04-22T14:20:15.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.052+0000 7faaa4d87700 1 --2- 172.21.15.103:0/1874979443 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7faa7c04d770 0x7faa7c04fc30 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:15.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.052+0000 7faaa4d87700 1 --2- 172.21.15.103:0/1874979443 >> v2:172.21.15.86:3300/0 conn(0x7faaa01426d0 0x7faaa0144db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:15.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.052+0000 7faaa4d87700 1 --2- 172.21.15.103:0/1874979443 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaa00b6040 0x7faaa0145bd0 unknown :-1 s=CLOSED pgs=2132 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:15.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.052+0000 7faaa4d87700 1 -- 172.21.15.103:0/1874979443 >> 172.21.15.103:0/1874979443 conn(0x7faaa00b9160 msgr2=0x7faaa01430a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:15.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.052+0000 7faaa4d87700 1 -- 172.21.15.103:0/1874979443 shutdown_connections 2020-04-22T14:20:15.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.052+0000 7faaa4d87700 1 -- 172.21.15.103:0/1874979443 wait complete. 2020-04-22T14:20:15.056 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 110 2020-04-22T14:20:15.064 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:20:15.078 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok session evict 9904 2020-04-22T14:20:15.823 INFO:tasks.cephfs.filesystem:_json_asok output: 2020-04-22T14:20:15.823 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:15.840 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:20:15.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.993+0000 7fb41260e700 1 Processor -- start 2020-04-22T14:20:15.995 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.993+0000 7fb41260e700 1 -- start start 2020-04-22T14:20:15.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.993+0000 7fb41260e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb40c065fe0 0x7fb40c1464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:15.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.994+0000 7fb41260e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb40c063e30 0x7fb40c0642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:15.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.994+0000 7fb41260e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb40c143300 con 0x7fb40c12c0d0 2020-04-22T14:20:15.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.994+0000 7fb41260e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb40c1435a0 con 0x7fb40c065fe0 2020-04-22T14:20:15.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.994+0000 7fb41260e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb40c143840 con 0x7fb40c063e30 2020-04-22T14:20:15.998 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.994+0000 7fb410bab700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb40c063e30 0x7fb40c0642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:15.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.994+0000 7fb410bab700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb40c063e30 0x7fb40c0642c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58818/0 (socket says 172.21.15.103:58818) 2020-04-22T14:20:15.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.994+0000 7fb410bab700 1 -- 172.21.15.103:0/3949477457 learned_addr learned my addr 172.21.15.103:0/3949477457 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:15.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.994+0000 7fb40b7fe700 1 --2- 172.21.15.103:0/3949477457 >> v2:172.21.15.86:3300/0 conn(0x7fb40c065fe0 0x7fb40c1464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:15.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.994+0000 7fb410bab700 1 -- 172.21.15.103:0/3949477457 >> v2:172.21.15.86:3300/0 conn(0x7fb40c065fe0 msgr2=0x7fb40c1464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:15.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.994+0000 7fb410bab700 1 --2- 172.21.15.103:0/3949477457 >> v2:172.21.15.86:3300/0 conn(0x7fb40c065fe0 0x7fb40c1464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:15.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.994+0000 7fb410bab700 1 -- 172.21.15.103:0/3949477457 >> v1:172.21.15.86:6789/0 conn(0x7fb40c12c0d0 legacy=0x7fb40c05b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:15.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.994+0000 7fb410bab700 1 -- 172.21.15.103:0/3949477457 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb40c05bb50 con 0x7fb40c063e30 2020-04-22T14:20:16.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.994+0000 7fb410bab700 1 --2- 172.21.15.103:0/3949477457 >> v2:172.21.15.103:3300/0 conn(0x7fb40c063e30 0x7fb40c0642c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb4040032b0 tx=0x7fb404007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:16.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.994+0000 7fb410bab700 1 --2- 172.21.15.103:0/3949477457 >> v2:172.21.15.103:3300/0 conn(0x7fb40c063e30 0x7fb40c0642c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb4040032b0 tx=0x7fb404007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:16.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.994+0000 7fb410bab700 1 --2- 172.21.15.103:0/3949477457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb40c063e30 0x7fb40c0642c0 secure :-1 s=READY pgs=2133 cs=0 l=1 rx=0x7fb4040032b0 tx=0x7fb404007dc0).ready entity=mon.1 client_cookie=24a4c4b268489a56 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:16.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.994+0000 7fb410bab700 1 --2- 172.21.15.103:0/3949477457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb40c063e30 0x7fb40c0642c0 secure :-1 s=THROTTLE_DONE pgs=2133 cs=0 l=1 rx=0x7fb4040032b0 tx=0x7fb404007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:16.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.994+0000 7fb40affd700 1 -- 172.21.15.103:0/3949477457 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb40400a180 con 0x7fb40c063e30 2020-04-22T14:20:16.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.994+0000 7fb410bab700 1 --2- 172.21.15.103:0/3949477457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb40c063e30 0x7fb40c0642c0 secure :-1 s=THROTTLE_DONE pgs=2133 cs=0 l=1 rx=0x7fb4040032b0 tx=0x7fb404007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:16.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.994+0000 7fb410bab700 1 --2- 172.21.15.103:0/3949477457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb40c063e30 0x7fb40c0642c0 secure :-1 s=THROTTLE_DONE pgs=2133 cs=0 l=1 rx=0x7fb4040032b0 tx=0x7fb404007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:16.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.994+0000 7fb40affd700 1 -- 172.21.15.103:0/3949477457 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb40400a2e0 con 0x7fb40c063e30 2020-04-22T14:20:16.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.994+0000 7fb40affd700 1 -- 172.21.15.103:0/3949477457 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb40400a700 con 0x7fb40c063e30 2020-04-22T14:20:16.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.994+0000 7fb41260e700 1 -- 172.21.15.103:0/3949477457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb40c063e30 msgr2=0x7fb40c0642c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:16.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.994+0000 7fb41260e700 1 --2- 172.21.15.103:0/3949477457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb40c063e30 0x7fb40c0642c0 secure :-1 s=READY pgs=2133 cs=0 l=1 rx=0x7fb4040032b0 tx=0x7fb404007dc0).stop 2020-04-22T14:20:16.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.995+0000 7fb41260e700 1 -- 172.21.15.103:0/3949477457 shutdown_connections 2020-04-22T14:20:16.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.995+0000 7fb41260e700 1 --2- 172.21.15.103:0/3949477457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb40c063e30 0x7fb40c0642c0 unknown :-1 s=CLOSED pgs=2133 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:16.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.995+0000 7fb41260e700 1 --2- 172.21.15.103:0/3949477457 >> v2:172.21.15.86:3300/0 conn(0x7fb40c065fe0 0x7fb40c1464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:16.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.995+0000 7fb41260e700 1 -- 172.21.15.103:0/3949477457 >> 172.21.15.103:0/3949477457 conn(0x7fb40c0b9160 msgr2=0x7fb40c05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:16.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.995+0000 7fb41260e700 1 -- 172.21.15.103:0/3949477457 shutdown_connections 2020-04-22T14:20:16.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.995+0000 7fb41260e700 1 -- 172.21.15.103:0/3949477457 wait complete. 2020-04-22T14:20:16.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.996+0000 7fb41260e700 1 Processor -- start 2020-04-22T14:20:16.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.996+0000 7fb41260e700 1 -- start start 2020-04-22T14:20:16.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.997+0000 7fb41260e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb40c063e30 0x7fb40c0b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:16.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.997+0000 7fb41260e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb40c12c0d0 0x7fb40c0b2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:16.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.997+0000 7fb41260e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb40c0afc00 con 0x7fb40c065fe0 2020-04-22T14:20:16.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.997+0000 7fb41260e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb40c0b3870 con 0x7fb40c063e30 2020-04-22T14:20:16.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.997+0000 7fb41260e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb40c0b3b10 con 0x7fb40c12c0d0 2020-04-22T14:20:16.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.997+0000 7fb40b7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb40c065fe0 0x7fb40c126e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51012/0 (socket says 172.21.15.103:51012) 2020-04-22T14:20:16.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.997+0000 7fb40b7fe700 1 -- 172.21.15.103:0/711335981 learned_addr learned my addr 172.21.15.103:0/711335981 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:16.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.997+0000 7fb40bfff700 1 --2- 172.21.15.103:0/711335981 >> v2:172.21.15.86:3300/0 conn(0x7fb40c063e30 0x7fb40c0b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:16.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.997+0000 7fb410bab700 1 --2- 172.21.15.103:0/711335981 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb40c12c0d0 0x7fb40c0b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:16.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.997+0000 7fb4097fa700 1 -- 172.21.15.103:0/711335981 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3793877179 0 0) 0x7fb40c0afc00 con 0x7fb40c065fe0 2020-04-22T14:20:16.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.997+0000 7fb4097fa700 1 -- 172.21.15.103:0/711335981 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3ec002fe0 con 0x7fb40c065fe0 2020-04-22T14:20:16.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.998+0000 7fb40bfff700 1 -- 172.21.15.103:0/711335981 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb40c12c0d0 msgr2=0x7fb40c0b2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:16.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.998+0000 7fb40bfff700 1 --2- 172.21.15.103:0/711335981 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb40c12c0d0 0x7fb40c0b2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:16.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.998+0000 7fb40bfff700 1 -- 172.21.15.103:0/711335981 >> v1:172.21.15.103:6789/0 conn(0x7fb40c065fe0 legacy=0x7fb40c126e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:16.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.998+0000 7fb40bfff700 1 -- 172.21.15.103:0/711335981 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb40c0b3db0 con 0x7fb40c063e30 2020-04-22T14:20:16.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.998+0000 7fb410bab700 1 --2- 172.21.15.103:0/711335981 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb40c12c0d0 0x7fb40c0b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:20:16.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.998+0000 7fb40bfff700 1 --2- 172.21.15.103:0/711335981 >> v2:172.21.15.86:3300/0 conn(0x7fb40c063e30 0x7fb40c0b32c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb40c0669a0 tx=0x7fb3fc010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:16.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.998+0000 7fb40bfff700 1 --2- 172.21.15.103:0/711335981 >> v2:172.21.15.86:3300/0 conn(0x7fb40c063e30 0x7fb40c0b32c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb40c0669a0 tx=0x7fb3fc010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:16.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.998+0000 7fb40bfff700 1 --2- 172.21.15.103:0/711335981 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb40c063e30 0x7fb40c0b32c0 secure :-1 s=READY pgs=1117 cs=0 l=1 rx=0x7fb40c0669a0 tx=0x7fb3fc010880).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:16.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.998+0000 7fb40bfff700 1 --2- 172.21.15.103:0/711335981 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb40c063e30 0x7fb40c0b32c0 secure :-1 s=THROTTLE_DONE pgs=1117 cs=0 l=1 rx=0x7fb40c0669a0 tx=0x7fb3fc010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:16.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.998+0000 7fb4097fa700 1 -- 172.21.15.103:0/711335981 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3fc006bc0 con 0x7fb40c063e30 2020-04-22T14:20:16.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.998+0000 7fb40bfff700 1 --2- 172.21.15.103:0/711335981 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb40c063e30 0x7fb40c0b32c0 secure :-1 s=THROTTLE_DONE pgs=1117 cs=0 l=1 rx=0x7fb40c0669a0 tx=0x7fb3fc010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:16.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.998+0000 7fb40bfff700 1 --2- 172.21.15.103:0/711335981 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb40c063e30 0x7fb40c0b32c0 secure :-1 s=THROTTLE_DONE pgs=1117 cs=0 l=1 rx=0x7fb40c0669a0 tx=0x7fb3fc010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:16.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.998+0000 7fb4097fa700 1 -- 172.21.15.103:0/711335981 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3fc006d60 con 0x7fb40c063e30 2020-04-22T14:20:16.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.998+0000 7fb4097fa700 1 -- 172.21.15.103:0/711335981 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3fc010ff0 con 0x7fb40c063e30 2020-04-22T14:20:16.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.998+0000 7fb41260e700 1 -- 172.21.15.103:0/711335981 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb40c127540 con 0x7fb40c063e30 2020-04-22T14:20:16.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.998+0000 7fb41260e700 1 -- 172.21.15.103:0/711335981 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb40c0b5700 con 0x7fb40c063e30 2020-04-22T14:20:16.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.999+0000 7fb40bfff700 1 --2- 172.21.15.103:0/711335981 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb40c063e30 0x7fb40c0b32c0 secure :-1 s=THROTTLE_DONE pgs=1117 cs=0 l=1 rx=0x7fb40c0669a0 tx=0x7fb3fc010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:16.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.999+0000 7fb41260e700 1 -- 172.21.15.103:0/711335981 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb40c056c90 con 0x7fb40c063e30 2020-04-22T14:20:16.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.999+0000 7fb4097fa700 1 -- 172.21.15.103:0/711335981 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fb3fc011260 con 0x7fb40c063e30 2020-04-22T14:20:16.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.999+0000 7fb40bfff700 1 --2- 172.21.15.103:0/711335981 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb40c063e30 0x7fb40c0b32c0 secure :-1 s=THROTTLE_DONE pgs=1117 cs=0 l=1 rx=0x7fb40c0669a0 tx=0x7fb3fc010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:16.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.999+0000 7fb4097fa700 1 --2- 172.21.15.103:0/711335981 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb3ec04dd30 0x7fb3ec0501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:16.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.999+0000 7fb4097fa700 1 -- 172.21.15.103:0/711335981 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6202+0+0 (secure 0 0 0) 0x7fb3fc0613b0 con 0x7fb40c063e30 2020-04-22T14:20:16.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:15.999+0000 7fb40b7fe700 1 --2- 172.21.15.103:0/711335981 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb3ec04dd30 0x7fb3ec0501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:16.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.000+0000 7fb40b7fe700 1 --2- 172.21.15.103:0/711335981 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb3ec04dd30 0x7fb3ec0501f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb400007fe0 tx=0x7fb4000090b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:16.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.000+0000 7fb40b7fe700 1 --2- 172.21.15.103:0/711335981 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb3ec04dd30 0x7fb3ec0501f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb400007fe0 tx=0x7fb4000090b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:16.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.000+0000 7fb40b7fe700 1 --2- 172.21.15.103:0/711335981 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb3ec04dd30 0x7fb3ec0501f0 secure :-1 s=READY pgs=773 cs=0 l=1 rx=0x7fb400007fe0 tx=0x7fb4000090b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:16.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.003+0000 7fb40bfff700 1 --2- 172.21.15.103:0/711335981 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb40c063e30 0x7fb40c0b32c0 secure :-1 s=THROTTLE_DONE pgs=1117 cs=0 l=1 rx=0x7fb40c0669a0 tx=0x7fb3fc010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:16.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.003+0000 7fb4097fa700 1 -- 172.21.15.103:0/711335981 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fb3fc03c730 con 0x7fb40c063e30 2020-04-22T14:20:16.192 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.190+0000 7fb41260e700 1 -- 172.21.15.103:0/711335981 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb40c147360 con 0x7fb40c063e30 2020-04-22T14:20:16.193 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.191+0000 7fb40bfff700 1 --2- 172.21.15.103:0/711335981 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb40c063e30 0x7fb40c0b32c0 secure :-1 s=THROTTLE_DONE pgs=1117 cs=0 l=1 rx=0x7fb40c0669a0 tx=0x7fb3fc010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:16.193 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.191+0000 7fb4097fa700 1 -- 172.21.15.103:0/711335981 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 111 v111) v1 ==== 95+0+2154 (secure 0 0 0) 0x7fb3fc03fd50 con 0x7fb40c063e30 2020-04-22T14:20:16.194 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:20:16.194 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":111,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":9982,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.103:6833/1807533375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1807533375},{"type":"v1","addr":"172.21.15.103:6833","nonce":1807533375}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":111}],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:19:46.112631+0000","modified":"2020-04-22T14:20:12.474327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":147,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6878},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6878":{"gid":6878,"name":"b","rank":0,"incarnation":109,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.86:6835/2193157152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2193157152},{"type":"v1","addr":"172.21.15.86:6835","nonce":2193157152}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-04-22T14:20:16.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.192+0000 7fb41260e700 1 -- 172.21.15.103:0/711335981 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb3ec04dd30 msgr2=0x7fb3ec0501f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:16.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.192+0000 7fb41260e700 1 --2- 172.21.15.103:0/711335981 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb3ec04dd30 0x7fb3ec0501f0 secure :-1 s=READY pgs=773 cs=0 l=1 rx=0x7fb400007fe0 tx=0x7fb4000090b0).stop 2020-04-22T14:20:16.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.192+0000 7fb41260e700 1 -- 172.21.15.103:0/711335981 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb40c063e30 msgr2=0x7fb40c0b32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:16.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.192+0000 7fb41260e700 1 --2- 172.21.15.103:0/711335981 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb40c063e30 0x7fb40c0b32c0 secure :-1 s=READY pgs=1117 cs=0 l=1 rx=0x7fb40c0669a0 tx=0x7fb3fc010880).stop 2020-04-22T14:20:16.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.192+0000 7fb41260e700 1 -- 172.21.15.103:0/711335981 shutdown_connections 2020-04-22T14:20:16.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.192+0000 7fb41260e700 1 --2- 172.21.15.103:0/711335981 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb40c12c0d0 0x7fb40c0b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:16.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.192+0000 7fb41260e700 1 --2- 172.21.15.103:0/711335981 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb3ec04dd30 0x7fb3ec0501f0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:16.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.192+0000 7fb41260e700 1 --2- 172.21.15.103:0/711335981 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb40c063e30 0x7fb40c0b32c0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:16.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.192+0000 7fb41260e700 1 -- 172.21.15.103:0/711335981 >> 172.21.15.103:0/711335981 conn(0x7fb40c0b9160 msgr2=0x7fb40c0615e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:16.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.192+0000 7fb41260e700 1 -- 172.21.15.103:0/711335981 shutdown_connections 2020-04-22T14:20:16.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.192+0000 7fb41260e700 1 -- 172.21.15.103:0/711335981 wait complete. 2020-04-22T14:20:16.196 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 111 2020-04-22T14:20:16.206 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:20:16.221 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok session ls 2020-04-22T14:20:16.389 INFO:teuthology.orchestra.run.smithi086.stdout:[ 2020-04-22T14:20:16.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2020-04-22T14:20:16.389 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 9949, 2020-04-22T14:20:16.389 INFO:teuthology.orchestra.run.smithi086.stdout: "entity": { 2020-04-22T14:20:16.389 INFO:teuthology.orchestra.run.smithi086.stdout: "name": { 2020-04-22T14:20:16.390 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "client", 2020-04-22T14:20:16.390 INFO:teuthology.orchestra.run.smithi086.stdout: "num": 9949 2020-04-22T14:20:16.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2020-04-22T14:20:16.390 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": { 2020-04-22T14:20:16.390 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "any", 2020-04-22T14:20:16.390 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": "192.168.0.2:0", 2020-04-22T14:20:16.390 INFO:teuthology.orchestra.run.smithi086.stdout: "nonce": 379068779 2020-04-22T14:20:16.390 INFO:teuthology.orchestra.run.smithi086.stdout: } 2020-04-22T14:20:16.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2020-04-22T14:20:16.391 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "open", 2020-04-22T14:20:16.391 INFO:teuthology.orchestra.run.smithi086.stdout: "num_leases": 0, 2020-04-22T14:20:16.391 INFO:teuthology.orchestra.run.smithi086.stdout: "num_caps": 1, 2020-04-22T14:20:16.391 INFO:teuthology.orchestra.run.smithi086.stdout: "request_load_avg": 0, 2020-04-22T14:20:16.391 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 4.9058858450000002, 2020-04-22T14:20:16.391 INFO:teuthology.orchestra.run.smithi086.stdout: "requests_in_flight": 0, 2020-04-22T14:20:16.392 INFO:teuthology.orchestra.run.smithi086.stdout: "completed_requests": 0, 2020-04-22T14:20:16.392 INFO:teuthology.orchestra.run.smithi086.stdout: "reconnecting": false, 2020-04-22T14:20:16.392 INFO:teuthology.orchestra.run.smithi086.stdout: "recall_caps": { 2020-04-22T14:20:16.392 INFO:teuthology.orchestra.run.smithi086.stdout: "value": 0, 2020-04-22T14:20:16.392 INFO:teuthology.orchestra.run.smithi086.stdout: "halflife": 60 2020-04-22T14:20:16.392 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2020-04-22T14:20:16.392 INFO:teuthology.orchestra.run.smithi086.stdout: "release_caps": { 2020-04-22T14:20:16.393 INFO:teuthology.orchestra.run.smithi086.stdout: "value": 0, 2020-04-22T14:20:16.393 INFO:teuthology.orchestra.run.smithi086.stdout: "halflife": 60 2020-04-22T14:20:16.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2020-04-22T14:20:16.393 INFO:teuthology.orchestra.run.smithi086.stdout: "recall_caps_throttle": { 2020-04-22T14:20:16.393 INFO:teuthology.orchestra.run.smithi086.stdout: "value": 0, 2020-04-22T14:20:16.393 INFO:teuthology.orchestra.run.smithi086.stdout: "halflife": 2.5 2020-04-22T14:20:16.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2020-04-22T14:20:16.394 INFO:teuthology.orchestra.run.smithi086.stdout: "recall_caps_throttle2o": { 2020-04-22T14:20:16.394 INFO:teuthology.orchestra.run.smithi086.stdout: "value": 0, 2020-04-22T14:20:16.394 INFO:teuthology.orchestra.run.smithi086.stdout: "halflife": 0.5 2020-04-22T14:20:16.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2020-04-22T14:20:16.394 INFO:teuthology.orchestra.run.smithi086.stdout: "session_cache_liveness": { 2020-04-22T14:20:16.394 INFO:teuthology.orchestra.run.smithi086.stdout: "value": 0.99100458454948093, 2020-04-22T14:20:16.394 INFO:teuthology.orchestra.run.smithi086.stdout: "halflife": 300 2020-04-22T14:20:16.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2020-04-22T14:20:16.395 INFO:teuthology.orchestra.run.smithi086.stdout: "inst": "client.9949 192.168.0.2:0/379068779", 2020-04-22T14:20:16.395 INFO:teuthology.orchestra.run.smithi086.stdout: "completed_requests": [], 2020-04-22T14:20:16.395 INFO:teuthology.orchestra.run.smithi086.stdout: "prealloc_inos": [], 2020-04-22T14:20:16.395 INFO:teuthology.orchestra.run.smithi086.stdout: "used_inos": [], 2020-04-22T14:20:16.395 INFO:teuthology.orchestra.run.smithi086.stdout: "client_metadata": { 2020-04-22T14:20:16.395 INFO:teuthology.orchestra.run.smithi086.stdout: "client_features": { 2020-04-22T14:20:16.395 INFO:teuthology.orchestra.run.smithi086.stdout: "feature_bits": "0x0000000000003fff" 2020-04-22T14:20:16.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2020-04-22T14:20:16.396 INFO:teuthology.orchestra.run.smithi086.stdout: "metric_spec": { 2020-04-22T14:20:16.396 INFO:teuthology.orchestra.run.smithi086.stdout: "metric_flags": { 2020-04-22T14:20:16.396 INFO:teuthology.orchestra.run.smithi086.stdout: "feature_bits": "0x" 2020-04-22T14:20:16.396 INFO:teuthology.orchestra.run.smithi086.stdout: } 2020-04-22T14:20:16.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2020-04-22T14:20:16.396 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:20:16.396 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:20:16.397 INFO:teuthology.orchestra.run.smithi086.stdout: "entity_id": "1", 2020-04-22T14:20:16.397 INFO:teuthology.orchestra.run.smithi086.stdout: "hostname": "smithi103", 2020-04-22T14:20:16.397 INFO:teuthology.orchestra.run.smithi086.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2020-04-22T14:20:16.397 INFO:teuthology.orchestra.run.smithi086.stdout: "pid": "124013", 2020-04-22T14:20:16.397 INFO:teuthology.orchestra.run.smithi086.stdout: "root": "/" 2020-04-22T14:20:16.397 INFO:teuthology.orchestra.run.smithi086.stdout: } 2020-04-22T14:20:16.397 INFO:teuthology.orchestra.run.smithi086.stdout: } 2020-04-22T14:20:16.398 INFO:teuthology.orchestra.run.smithi086.stdout:] 2020-04-22T14:20:16.398 INFO:tasks.cephfs.filesystem:_json_asok output: [ { "id": 9949, "entity": { "name": { "type": "client", "num": 9949 }, "addr": { "type": "any", "addr": "192.168.0.2:0", "nonce": 379068779 } }, "state": "open", "num_leases": 0, "num_caps": 1, "request_load_avg": 0, "uptime": 4.9058858450000002, "requests_in_flight": 0, "completed_requests": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 2.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0.99100458454948093, "halflife": 300 }, "inst": "client.9949 192.168.0.2:0/379068779", "completed_requests": [], "prealloc_inos": [], "used_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x0000000000003fff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x" } }, "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", "entity_id": "1", "hostname": "smithi103", "mount_point": "/home/ubuntu/cephtest/mnt.1", "pid": "124013", "root": "/" } } ] 2020-04-22T14:20:16.399 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:16.412 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:20:16.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.558+0000 7f2cb2abb700 1 Processor -- start 2020-04-22T14:20:16.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.558+0000 7f2cb2abb700 1 -- start start 2020-04-22T14:20:16.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.559+0000 7f2cb2abb700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2cac0ad150 0x7f2cac0664a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:16.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.559+0000 7f2cb2abb700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2cac0654e0 0x7f2cac063340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:16.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.559+0000 7f2cb2abb700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cac066a20 con 0x7f2cac141c10 2020-04-22T14:20:16.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.559+0000 7f2cb2abb700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cac0adf30 con 0x7f2cac0ad150 2020-04-22T14:20:16.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.559+0000 7f2cb2abb700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cac1427b0 con 0x7f2cac0654e0 2020-04-22T14:20:16.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.559+0000 7f2cb22ba700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2cac0654e0 0x7f2cac063340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:16.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.559+0000 7f2cb12b8700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f2cac141c10 0x7f2cac1420a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51020/0 (socket says 172.21.15.103:51020) 2020-04-22T14:20:16.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.559+0000 7f2cb12b8700 1 -- 172.21.15.103:0/1253417584 learned_addr learned my addr 172.21.15.103:0/1253417584 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:16.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.559+0000 7f2cb1ab9700 1 --2- 172.21.15.103:0/1253417584 >> v2:172.21.15.86:3300/0 conn(0x7f2cac0ad150 0x7f2cac0664a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:16.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.559+0000 7f2cb22ba700 1 -- 172.21.15.103:0/1253417584 >> v2:172.21.15.86:3300/0 conn(0x7f2cac0ad150 msgr2=0x7f2cac0664a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:16.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.559+0000 7f2cb22ba700 1 --2- 172.21.15.103:0/1253417584 >> v2:172.21.15.86:3300/0 conn(0x7f2cac0ad150 0x7f2cac0664a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:16.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.559+0000 7f2cb22ba700 1 -- 172.21.15.103:0/1253417584 >> v1:172.21.15.103:6789/0 conn(0x7f2cac141c10 legacy=0x7f2cac1420a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:16.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.559+0000 7f2cb22ba700 1 -- 172.21.15.103:0/1253417584 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cac0ad7f0 con 0x7f2cac0654e0 2020-04-22T14:20:16.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.559+0000 7f2cb22ba700 1 --2- 172.21.15.103:0/1253417584 >> v2:172.21.15.103:3300/0 conn(0x7f2cac0654e0 0x7f2cac063340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2c9c0010d0 tx=0x7f2ca4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:16.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.559+0000 7f2cb22ba700 1 --2- 172.21.15.103:0/1253417584 >> v2:172.21.15.103:3300/0 conn(0x7f2cac0654e0 0x7f2cac063340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2c9c0010d0 tx=0x7f2ca4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:16.565 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.559+0000 7f2cb22ba700 1 --2- 172.21.15.103:0/1253417584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cac0654e0 0x7f2cac063340 secure :-1 s=READY pgs=2136 cs=0 l=1 rx=0x7f2c9c0010d0 tx=0x7f2ca4007dc0).ready entity=mon.1 client_cookie=3014070fa567ad98 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:16.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.559+0000 7f2cb22ba700 1 --2- 172.21.15.103:0/1253417584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cac0654e0 0x7f2cac063340 secure :-1 s=THROTTLE_DONE pgs=2136 cs=0 l=1 rx=0x7f2c9c0010d0 tx=0x7f2ca4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:16.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.559+0000 7f2cb22ba700 1 --2- 172.21.15.103:0/1253417584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cac0654e0 0x7f2cac063340 secure :-1 s=THROTTLE_DONE pgs=2136 cs=0 l=1 rx=0x7f2c9c0010d0 tx=0x7f2ca4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:16.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.559+0000 7f2cb0ab7700 1 -- 172.21.15.103:0/1253417584 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ca4010cb0 con 0x7f2cac0654e0 2020-04-22T14:20:16.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.559+0000 7f2cb22ba700 1 --2- 172.21.15.103:0/1253417584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cac0654e0 0x7f2cac063340 secure :-1 s=THROTTLE_DONE pgs=2136 cs=0 l=1 rx=0x7f2c9c0010d0 tx=0x7f2ca4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:16.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.559+0000 7f2cb0ab7700 1 -- 172.21.15.103:0/1253417584 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca4010e10 con 0x7f2cac0654e0 2020-04-22T14:20:16.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.559+0000 7f2cb0ab7700 1 -- 172.21.15.103:0/1253417584 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ca40112c0 con 0x7f2cac0654e0 2020-04-22T14:20:16.566 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.559+0000 7f2cb2abb700 1 -- 172.21.15.103:0/1253417584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cac0654e0 msgr2=0x7f2cac063340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:16.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.559+0000 7f2cb2abb700 1 --2- 172.21.15.103:0/1253417584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cac0654e0 0x7f2cac063340 secure :-1 s=READY pgs=2136 cs=0 l=1 rx=0x7f2c9c0010d0 tx=0x7f2ca4007dc0).stop 2020-04-22T14:20:16.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.560+0000 7f2cb2abb700 1 -- 172.21.15.103:0/1253417584 shutdown_connections 2020-04-22T14:20:16.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.560+0000 7f2cb2abb700 1 --2- 172.21.15.103:0/1253417584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cac0654e0 0x7f2cac063340 unknown :-1 s=CLOSED pgs=2136 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:16.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.560+0000 7f2cb2abb700 1 --2- 172.21.15.103:0/1253417584 >> v2:172.21.15.86:3300/0 conn(0x7f2cac0ad150 0x7f2cac0664a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:16.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.560+0000 7f2cb2abb700 1 -- 172.21.15.103:0/1253417584 >> 172.21.15.103:0/1253417584 conn(0x7f2cac05b7c0 msgr2=0x7f2cac061610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:16.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.560+0000 7f2cb2abb700 1 -- 172.21.15.103:0/1253417584 shutdown_connections 2020-04-22T14:20:16.567 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.560+0000 7f2cb2abb700 1 -- 172.21.15.103:0/1253417584 wait complete. 2020-04-22T14:20:16.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.561+0000 7f2cb2abb700 1 Processor -- start 2020-04-22T14:20:16.568 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.561+0000 7f2cb2abb700 1 -- start start 2020-04-22T14:20:16.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.562+0000 7f2cb2abb700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2cac0ad150 0x7f2cac0af610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:16.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.562+0000 7f2cb2abb700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cac0ae1f0 con 0x7f2cac0654e0 2020-04-22T14:20:16.571 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.562+0000 7f2cb2abb700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cac0ae490 con 0x7f2cac141c10 2020-04-22T14:20:16.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.562+0000 7f2cb2abb700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cac0ae730 con 0x7f2cac0ad150 2020-04-22T14:20:16.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.562+0000 7f2cb22ba700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f2cac141c10 0x7f2cac0afbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51028/0 (socket says 172.21.15.103:51028) 2020-04-22T14:20:16.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.562+0000 7f2cb22ba700 1 -- 172.21.15.103:0/3300991174 learned_addr learned my addr 172.21.15.103:0/3300991174 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:16.572 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.562+0000 7f2cb12b8700 1 --2- 172.21.15.103:0/3300991174 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2cac0ad150 0x7f2cac0af610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:16.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.562+0000 7f2c9affd700 1 -- 172.21.15.103:0/3300991174 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2309512206 0 0) 0x7f2cac0ae490 con 0x7f2cac141c10 2020-04-22T14:20:16.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.562+0000 7f2c9affd700 1 -- 172.21.15.103:0/3300991174 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c8c002fe0 con 0x7f2cac141c10 2020-04-22T14:20:16.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.562+0000 7f2c9affd700 1 -- 172.21.15.103:0/3300991174 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2570539373 0 0) 0x7f2cac0ae1f0 con 0x7f2cac0654e0 2020-04-22T14:20:16.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.562+0000 7f2c9affd700 1 -- 172.21.15.103:0/3300991174 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cac0ae490 con 0x7f2cac0654e0 2020-04-22T14:20:16.573 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.562+0000 7f2cb12b8700 1 -- 172.21.15.103:0/3300991174 >> v1:172.21.15.103:6789/0 conn(0x7f2cac141c10 legacy=0x7f2cac0afbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:16.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.562+0000 7f2cb12b8700 1 -- 172.21.15.103:0/3300991174 >> v1:172.21.15.86:6789/0 conn(0x7f2cac0654e0 legacy=0x7f2cac145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:16.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.562+0000 7f2cb12b8700 1 -- 172.21.15.103:0/3300991174 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cac1461a0 con 0x7f2cac0ad150 2020-04-22T14:20:16.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.562+0000 7f2cb12b8700 1 --2- 172.21.15.103:0/3300991174 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2cac0ad150 0x7f2cac0af610 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2c9c001190 tx=0x7f2c9c010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:16.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.562+0000 7f2cb12b8700 1 --2- 172.21.15.103:0/3300991174 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2cac0ad150 0x7f2cac0af610 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2c9c001190 tx=0x7f2c9c010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:16.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.562+0000 7f2cb12b8700 1 --2- 172.21.15.103:0/3300991174 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2cac0ad150 0x7f2cac0af610 secure :-1 s=READY pgs=201 cs=0 l=1 rx=0x7f2c9c001190 tx=0x7f2c9c010a70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:16.574 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.563+0000 7f2cb12b8700 1 --2- 172.21.15.103:0/3300991174 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2cac0ad150 0x7f2cac0af610 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7f2c9c001190 tx=0x7f2c9c010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:16.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.563+0000 7f2c9affd700 1 -- 172.21.15.103:0/3300991174 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c9c00c950 con 0x7f2cac0ad150 2020-04-22T14:20:16.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.563+0000 7f2cb12b8700 1 --2- 172.21.15.103:0/3300991174 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2cac0ad150 0x7f2cac0af610 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7f2c9c001190 tx=0x7f2c9c010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:16.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.563+0000 7f2cb12b8700 1 --2- 172.21.15.103:0/3300991174 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2cac0ad150 0x7f2cac0af610 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7f2c9c001190 tx=0x7f2c9c010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:16.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.563+0000 7f2c9affd700 1 -- 172.21.15.103:0/3300991174 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9c00cab0 con 0x7f2cac0ad150 2020-04-22T14:20:16.575 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.563+0000 7f2c9affd700 1 -- 172.21.15.103:0/3300991174 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c9c00d0d0 con 0x7f2cac0ad150 2020-04-22T14:20:16.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.563+0000 7f2cb2abb700 1 -- 172.21.15.103:0/3300991174 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cac13e4c0 con 0x7f2cac0ad150 2020-04-22T14:20:16.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.563+0000 7f2cb2abb700 1 -- 172.21.15.103:0/3300991174 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cac0b3ca0 con 0x7f2cac0ad150 2020-04-22T14:20:16.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.563+0000 7f2cb12b8700 1 --2- 172.21.15.103:0/3300991174 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2cac0ad150 0x7f2cac0af610 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7f2c9c001190 tx=0x7f2c9c010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:16.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.564+0000 7f2c9affd700 1 -- 172.21.15.103:0/3300991174 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f2c9c0055c0 con 0x7f2cac0ad150 2020-04-22T14:20:16.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.564+0000 7f2cb12b8700 1 --2- 172.21.15.103:0/3300991174 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2cac0ad150 0x7f2cac0af610 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7f2c9c001190 tx=0x7f2c9c010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:16.576 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.564+0000 7f2cb2abb700 1 -- 172.21.15.103:0/3300991174 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cac056c90 con 0x7f2cac0ad150 2020-04-22T14:20:16.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.564+0000 7f2c9affd700 1 --2- 172.21.15.103:0/3300991174 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2c8c04de50 0x7f2c8c050310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:16.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.564+0000 7f2c9affd700 1 -- 172.21.15.103:0/3300991174 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f2c9c0100c0 con 0x7f2cac0ad150 2020-04-22T14:20:16.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.564+0000 7f2cb1ab9700 1 --2- 172.21.15.103:0/3300991174 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2c8c04de50 0x7f2c8c050310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:16.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.564+0000 7f2cb1ab9700 1 --2- 172.21.15.103:0/3300991174 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2c8c04de50 0x7f2c8c050310 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2ca8002ef0 tx=0x7f2ca80090b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:16.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.565+0000 7f2cb1ab9700 1 --2- 172.21.15.103:0/3300991174 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2c8c04de50 0x7f2c8c050310 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2ca8002ef0 tx=0x7f2ca80090b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:16.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.565+0000 7f2cb1ab9700 1 --2- 172.21.15.103:0/3300991174 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2c8c04de50 0x7f2c8c050310 secure :-1 s=READY pgs=774 cs=0 l=1 rx=0x7f2ca8002ef0 tx=0x7f2ca80090b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:16.577 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.568+0000 7f2cb12b8700 1 --2- 172.21.15.103:0/3300991174 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2cac0ad150 0x7f2cac0af610 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7f2c9c001190 tx=0x7f2c9c010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:16.578 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.568+0000 7f2c9affd700 1 -- 172.21.15.103:0/3300991174 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f2c9c03c2d0 con 0x7f2cac0ad150 2020-04-22T14:20:16.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.758+0000 7f2cb2abb700 1 -- 172.21.15.103:0/3300991174 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2cac0b82c0 con 0x7f2cac0ad150 2020-04-22T14:20:16.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.758+0000 7f2cb12b8700 1 --2- 172.21.15.103:0/3300991174 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2cac0ad150 0x7f2cac0af610 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7f2c9c001190 tx=0x7f2c9c010a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:16.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.758+0000 7f2c9affd700 1 -- 172.21.15.103:0/3300991174 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 111 v111) v1 ==== 95+0+2154 (secure 0 0 0) 0x7f2c9c03f8f0 con 0x7f2cac0ad150 2020-04-22T14:20:16.761 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:20:16.761 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":111,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":9982,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.103:6833/1807533375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1807533375},{"type":"v1","addr":"172.21.15.103:6833","nonce":1807533375}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":111}],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:19:46.112631+0000","modified":"2020-04-22T14:20:12.474327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":147,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6878},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6878":{"gid":6878,"name":"b","rank":0,"incarnation":109,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.86:6835/2193157152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2193157152},{"type":"v1","addr":"172.21.15.86:6835","nonce":2193157152}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-04-22T14:20:16.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.760+0000 7f2cb2abb700 1 -- 172.21.15.103:0/3300991174 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2c8c04de50 msgr2=0x7f2c8c050310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:16.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.760+0000 7f2cb2abb700 1 --2- 172.21.15.103:0/3300991174 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2c8c04de50 0x7f2c8c050310 secure :-1 s=READY pgs=774 cs=0 l=1 rx=0x7f2ca8002ef0 tx=0x7f2ca80090b0).stop 2020-04-22T14:20:16.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.760+0000 7f2cb2abb700 1 -- 172.21.15.103:0/3300991174 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2cac0ad150 msgr2=0x7f2cac0af610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:16.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.760+0000 7f2cb2abb700 1 --2- 172.21.15.103:0/3300991174 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2cac0ad150 0x7f2cac0af610 secure :-1 s=READY pgs=201 cs=0 l=1 rx=0x7f2c9c001190 tx=0x7f2c9c010a70).stop 2020-04-22T14:20:16.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.760+0000 7f2cb2abb700 1 -- 172.21.15.103:0/3300991174 shutdown_connections 2020-04-22T14:20:16.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.760+0000 7f2cb2abb700 1 --2- 172.21.15.103:0/3300991174 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f2c8c04de50 0x7f2c8c050310 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:16.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.760+0000 7f2cb2abb700 1 --2- 172.21.15.103:0/3300991174 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2cac0ad150 0x7f2cac0af610 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:16.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.760+0000 7f2cb2abb700 1 -- 172.21.15.103:0/3300991174 >> 172.21.15.103:0/3300991174 conn(0x7f2cac05b7c0 msgr2=0x7f2cac064530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:16.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.760+0000 7f2cb2abb700 1 -- 172.21.15.103:0/3300991174 shutdown_connections 2020-04-22T14:20:16.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:16.760+0000 7f2cb2abb700 1 -- 172.21.15.103:0/3300991174 wait complete. 2020-04-22T14:20:16.764 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 111 2020-04-22T14:20:16.772 INFO:tasks.cephfs.filesystem:mapped states [u'up:reconnect'] to None 2020-04-22T14:20:17.773 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:17.792 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:20:17.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.949+0000 7fcd33453700 1 Processor -- start 2020-04-22T14:20:17.951 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.949+0000 7fcd33453700 1 -- start start 2020-04-22T14:20:17.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.950+0000 7fcd33453700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcd2c12c0d0 0x7fcd2c1464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:17.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.950+0000 7fcd33453700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcd2c065fe0 0x7fcd2c05b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:17.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.950+0000 7fcd33453700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd2c05b8a0 0x7fcd2c062ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:17.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.950+0000 7fcd33453700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd2c12c4b0 con 0x7fcd2c12c0d0 2020-04-22T14:20:17.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.950+0000 7fcd33453700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd2c143300 con 0x7fcd2c065fe0 2020-04-22T14:20:17.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.950+0000 7fcd33453700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c1435a0 con 0x7fcd2c05b8a0 2020-04-22T14:20:17.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.950+0000 7fcd309ee700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcd2c065fe0 0x7fcd2c05b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:17.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.950+0000 7fcd309ee700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcd2c065fe0 0x7fcd2c05b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58844/0 (socket says 172.21.15.103:58844) 2020-04-22T14:20:17.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.950+0000 7fcd309ee700 1 -- 172.21.15.103:0/1551325617 learned_addr learned my addr 172.21.15.103:0/1551325617 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:17.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.950+0000 7fcd311ef700 1 --2- 172.21.15.103:0/1551325617 >> v2:172.21.15.86:3300/0 conn(0x7fcd2c12c0d0 0x7fcd2c1464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:17.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.950+0000 7fcd319f0700 1 --2- 172.21.15.103:0/1551325617 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd2c05b8a0 0x7fcd2c062ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:17.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.950+0000 7fcd309ee700 1 -- 172.21.15.103:0/1551325617 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd2c05b8a0 msgr2=0x7fcd2c062ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:17.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.950+0000 7fcd309ee700 1 --2- 172.21.15.103:0/1551325617 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd2c05b8a0 0x7fcd2c062ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:17.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.950+0000 7fcd309ee700 1 -- 172.21.15.103:0/1551325617 >> v2:172.21.15.86:3300/0 conn(0x7fcd2c12c0d0 msgr2=0x7fcd2c1464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:17.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.950+0000 7fcd309ee700 1 --2- 172.21.15.103:0/1551325617 >> v2:172.21.15.86:3300/0 conn(0x7fcd2c12c0d0 0x7fcd2c1464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:17.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.950+0000 7fcd309ee700 1 -- 172.21.15.103:0/1551325617 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd2c143840 con 0x7fcd2c065fe0 2020-04-22T14:20:17.956 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.950+0000 7fcd311ef700 1 --2- 172.21.15.103:0/1551325617 >> v2:172.21.15.86:3300/0 conn(0x7fcd2c12c0d0 0x7fcd2c1464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:20:17.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.950+0000 7fcd319f0700 1 --2- 172.21.15.103:0/1551325617 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd2c05b8a0 0x7fcd2c062ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:20:17.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.950+0000 7fcd309ee700 1 --2- 172.21.15.103:0/1551325617 >> v2:172.21.15.103:3300/0 conn(0x7fcd2c065fe0 0x7fcd2c05b440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcd20002f30 tx=0x7fcd20007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:17.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.950+0000 7fcd309ee700 1 --2- 172.21.15.103:0/1551325617 >> v2:172.21.15.103:3300/0 conn(0x7fcd2c065fe0 0x7fcd2c05b440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcd20002f30 tx=0x7fcd20007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:17.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.950+0000 7fcd309ee700 1 --2- 172.21.15.103:0/1551325617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd2c065fe0 0x7fcd2c05b440 secure :-1 s=READY pgs=2138 cs=0 l=1 rx=0x7fcd20002f30 tx=0x7fcd20007a40).ready entity=mon.1 client_cookie=ae18174c26e55fbc server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:17.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.950+0000 7fcd309ee700 1 --2- 172.21.15.103:0/1551325617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd2c065fe0 0x7fcd2c05b440 secure :-1 s=THROTTLE_DONE pgs=2138 cs=0 l=1 rx=0x7fcd20002f30 tx=0x7fcd20007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:17.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.950+0000 7fcd1ffff700 1 -- 172.21.15.103:0/1551325617 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd20011720 con 0x7fcd2c065fe0 2020-04-22T14:20:17.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.950+0000 7fcd309ee700 1 --2- 172.21.15.103:0/1551325617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd2c065fe0 0x7fcd2c05b440 secure :-1 s=THROTTLE_DONE pgs=2138 cs=0 l=1 rx=0x7fcd20002f30 tx=0x7fcd20007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:17.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.950+0000 7fcd309ee700 1 --2- 172.21.15.103:0/1551325617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd2c065fe0 0x7fcd2c05b440 secure :-1 s=THROTTLE_DONE pgs=2138 cs=0 l=1 rx=0x7fcd20002f30 tx=0x7fcd20007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:17.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.950+0000 7fcd1ffff700 1 -- 172.21.15.103:0/1551325617 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd20011880 con 0x7fcd2c065fe0 2020-04-22T14:20:17.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.950+0000 7fcd1ffff700 1 -- 172.21.15.103:0/1551325617 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd20011ca0 con 0x7fcd2c065fe0 2020-04-22T14:20:17.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.950+0000 7fcd33453700 1 -- 172.21.15.103:0/1551325617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd2c065fe0 msgr2=0x7fcd2c05b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:17.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.950+0000 7fcd33453700 1 --2- 172.21.15.103:0/1551325617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd2c065fe0 0x7fcd2c05b440 secure :-1 s=READY pgs=2138 cs=0 l=1 rx=0x7fcd20002f30 tx=0x7fcd20007a40).stop 2020-04-22T14:20:17.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.951+0000 7fcd33453700 1 -- 172.21.15.103:0/1551325617 shutdown_connections 2020-04-22T14:20:17.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.951+0000 7fcd33453700 1 --2- 172.21.15.103:0/1551325617 >> v2:172.21.15.86:3300/0 conn(0x7fcd2c12c0d0 0x7fcd2c1464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:17.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.951+0000 7fcd33453700 1 --2- 172.21.15.103:0/1551325617 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd2c05b8a0 0x7fcd2c062ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:17.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.951+0000 7fcd33453700 1 --2- 172.21.15.103:0/1551325617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd2c065fe0 0x7fcd2c05b440 unknown :-1 s=CLOSED pgs=2138 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:17.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.951+0000 7fcd33453700 1 -- 172.21.15.103:0/1551325617 >> 172.21.15.103:0/1551325617 conn(0x7fcd2c0b9160 msgr2=0x7fcd2c05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:17.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.951+0000 7fcd33453700 1 -- 172.21.15.103:0/1551325617 shutdown_connections 2020-04-22T14:20:17.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.951+0000 7fcd33453700 1 -- 172.21.15.103:0/1551325617 wait complete. 2020-04-22T14:20:17.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.952+0000 7fcd33453700 1 Processor -- start 2020-04-22T14:20:17.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.952+0000 7fcd33453700 1 -- start start 2020-04-22T14:20:17.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.953+0000 7fcd33453700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcd2c065fe0 0x7fcd2c0b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:17.963 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.953+0000 7fcd33453700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd2c12c0d0 0x7fcd2c065420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:17.964 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.953+0000 7fcd33453700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd2c065880 con 0x7fcd2c05b8a0 2020-04-22T14:20:17.965 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.953+0000 7fcd33453700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd2c0ae870 con 0x7fcd2c065fe0 2020-04-22T14:20:17.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.953+0000 7fcd33453700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c0aea60 con 0x7fcd2c12c0d0 2020-04-22T14:20:17.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.953+0000 7fcd309ee700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcd2c065fe0 0x7fcd2c0b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:17.966 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.953+0000 7fcd309ee700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcd2c065fe0 0x7fcd2c0b55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58850/0 (socket says 172.21.15.103:58850) 2020-04-22T14:20:17.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.953+0000 7fcd309ee700 1 -- 172.21.15.103:0/1947957506 learned_addr learned my addr 172.21.15.103:0/1947957506 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:17.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.953+0000 7fcd319f0700 1 --2- 172.21.15.103:0/1947957506 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd2c12c0d0 0x7fcd2c065420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:17.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.953+0000 7fcd309ee700 1 -- 172.21.15.103:0/1947957506 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd2c12c0d0 msgr2=0x7fcd2c065420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:17.969 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.953+0000 7fcd309ee700 1 --2- 172.21.15.103:0/1947957506 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd2c12c0d0 0x7fcd2c065420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:17.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.953+0000 7fcd309ee700 1 -- 172.21.15.103:0/1947957506 >> v1:172.21.15.86:6789/0 conn(0x7fcd2c05b8a0 legacy=0x7fcd2c129740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:17.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.953+0000 7fcd309ee700 1 -- 172.21.15.103:0/1947957506 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd2c0aed00 con 0x7fcd2c065fe0 2020-04-22T14:20:17.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.953+0000 7fcd319f0700 1 --2- 172.21.15.103:0/1947957506 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd2c12c0d0 0x7fcd2c065420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:20:17.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.953+0000 7fcd309ee700 1 --2- 172.21.15.103:0/1947957506 >> v2:172.21.15.103:3300/0 conn(0x7fcd2c065fe0 0x7fcd2c0b55b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcd20002f30 tx=0x7fcd20007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:17.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.953+0000 7fcd309ee700 1 --2- 172.21.15.103:0/1947957506 >> v2:172.21.15.103:3300/0 conn(0x7fcd2c065fe0 0x7fcd2c0b55b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcd20002f30 tx=0x7fcd20007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:17.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.953+0000 7fcd309ee700 1 --2- 172.21.15.103:0/1947957506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd2c065fe0 0x7fcd2c0b55b0 secure :-1 s=READY pgs=2139 cs=0 l=1 rx=0x7fcd20002f30 tx=0x7fcd20007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:17.970 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.953+0000 7fcd309ee700 1 --2- 172.21.15.103:0/1947957506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd2c065fe0 0x7fcd2c0b55b0 secure :-1 s=THROTTLE_DONE pgs=2139 cs=0 l=1 rx=0x7fcd20002f30 tx=0x7fcd20007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:17.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.953+0000 7fcd309ee700 1 --2- 172.21.15.103:0/1947957506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd2c065fe0 0x7fcd2c0b55b0 secure :-1 s=THROTTLE_DONE pgs=2139 cs=0 l=1 rx=0x7fcd20002f30 tx=0x7fcd20007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:17.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.953+0000 7fcd1e7fc700 1 -- 172.21.15.103:0/1947957506 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd20011cf0 con 0x7fcd2c065fe0 2020-04-22T14:20:17.971 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.953+0000 7fcd309ee700 1 --2- 172.21.15.103:0/1947957506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd2c065fe0 0x7fcd2c0b55b0 secure :-1 s=THROTTLE_DONE pgs=2139 cs=0 l=1 rx=0x7fcd20002f30 tx=0x7fcd20007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:17.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.953+0000 7fcd1e7fc700 1 -- 172.21.15.103:0/1947957506 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd20007360 con 0x7fcd2c065fe0 2020-04-22T14:20:17.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.953+0000 7fcd33453700 1 -- 172.21.15.103:0/1947957506 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd2c0ad030 con 0x7fcd2c065fe0 2020-04-22T14:20:17.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.953+0000 7fcd1e7fc700 1 -- 172.21.15.103:0/1947957506 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd200056c0 con 0x7fcd2c065fe0 2020-04-22T14:20:17.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.954+0000 7fcd33453700 1 -- 172.21.15.103:0/1947957506 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd2c154df0 con 0x7fcd2c065fe0 2020-04-22T14:20:17.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.954+0000 7fcd309ee700 1 --2- 172.21.15.103:0/1947957506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd2c065fe0 0x7fcd2c0b55b0 secure :-1 s=THROTTLE_DONE pgs=2139 cs=0 l=1 rx=0x7fcd20002f30 tx=0x7fcd20007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:17.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.954+0000 7fcd309ee700 1 --2- 172.21.15.103:0/1947957506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd2c065fe0 0x7fcd2c0b55b0 secure :-1 s=THROTTLE_DONE pgs=2139 cs=0 l=1 rx=0x7fcd20002f30 tx=0x7fcd20007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:17.972 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.954+0000 7fcd1e7fc700 1 -- 172.21.15.103:0/1947957506 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fcd20005930 con 0x7fcd2c065fe0 2020-04-22T14:20:17.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.955+0000 7fcd33453700 1 -- 172.21.15.103:0/1947957506 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd2c0aee90 con 0x7fcd2c065fe0 2020-04-22T14:20:17.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.955+0000 7fcd1e7fc700 1 --2- 172.21.15.103:0/1947957506 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcd0c04d990 0x7fcd0c04fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:17.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.955+0000 7fcd1e7fc700 1 -- 172.21.15.103:0/1947957506 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6202+0+0 (secure 0 0 0) 0x7fcd20061d60 con 0x7fcd2c065fe0 2020-04-22T14:20:17.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.955+0000 7fcd311ef700 1 --2- 172.21.15.103:0/1947957506 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcd0c04d990 0x7fcd0c04fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:17.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.955+0000 7fcd311ef700 1 --2- 172.21.15.103:0/1947957506 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcd0c04d990 0x7fcd0c04fe50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcd2c146090 tx=0x7fcd24008e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:17.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.955+0000 7fcd311ef700 1 --2- 172.21.15.103:0/1947957506 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcd0c04d990 0x7fcd0c04fe50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcd2c146090 tx=0x7fcd24008e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:17.973 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.955+0000 7fcd311ef700 1 --2- 172.21.15.103:0/1947957506 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcd0c04d990 0x7fcd0c04fe50 secure :-1 s=READY pgs=775 cs=0 l=1 rx=0x7fcd2c146090 tx=0x7fcd24008e20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:17.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.959+0000 7fcd309ee700 1 --2- 172.21.15.103:0/1947957506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd2c065fe0 0x7fcd2c0b55b0 secure :-1 s=THROTTLE_DONE pgs=2139 cs=0 l=1 rx=0x7fcd20002f30 tx=0x7fcd20007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:17.974 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:17.959+0000 7fcd1e7fc700 1 -- 172.21.15.103:0/1947957506 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fcd2003d160 con 0x7fcd2c065fe0 2020-04-22T14:20:18.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:18.146+0000 7fcd33453700 1 -- 172.21.15.103:0/1947957506 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd2c056c90 con 0x7fcd2c065fe0 2020-04-22T14:20:18.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:18.147+0000 7fcd309ee700 1 --2- 172.21.15.103:0/1947957506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd2c065fe0 0x7fcd2c0b55b0 secure :-1 s=THROTTLE_DONE pgs=2139 cs=0 l=1 rx=0x7fcd20002f30 tx=0x7fcd20007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:18.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:18.147+0000 7fcd1e7fc700 1 -- 172.21.15.103:0/1947957506 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) v1 ==== 95+0+2157 (secure 0 0 0) 0x7fcd20040780 con 0x7fcd2c065fe0 2020-04-22T14:20:18.150 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:20:18.150 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":113,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":9982,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.103:6833/1807533375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1807533375},{"type":"v1","addr":"172.21.15.103:6833","nonce":1807533375}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":111}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:19:46.112631+0000","modified":"2020-04-22T14:20:17.804517+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":147,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6878},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6878":{"gid":6878,"name":"b","rank":0,"incarnation":109,"state":"up:clientreplay","state_seq":5,"addr":"172.21.15.86:6835/2193157152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2193157152},{"type":"v1","addr":"172.21.15.86:6835","nonce":2193157152}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-04-22T14:20:18.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:18.148+0000 7fcd33453700 1 -- 172.21.15.103:0/1947957506 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcd0c04d990 msgr2=0x7fcd0c04fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:18.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:18.148+0000 7fcd33453700 1 --2- 172.21.15.103:0/1947957506 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcd0c04d990 0x7fcd0c04fe50 secure :-1 s=READY pgs=775 cs=0 l=1 rx=0x7fcd2c146090 tx=0x7fcd24008e20).stop 2020-04-22T14:20:18.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:18.148+0000 7fcd33453700 1 -- 172.21.15.103:0/1947957506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd2c065fe0 msgr2=0x7fcd2c0b55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:18.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:18.148+0000 7fcd33453700 1 --2- 172.21.15.103:0/1947957506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd2c065fe0 0x7fcd2c0b55b0 secure :-1 s=READY pgs=2139 cs=0 l=1 rx=0x7fcd20002f30 tx=0x7fcd20007a40).stop 2020-04-22T14:20:18.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:18.148+0000 7fcd33453700 1 -- 172.21.15.103:0/1947957506 shutdown_connections 2020-04-22T14:20:18.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:18.148+0000 7fcd33453700 1 --2- 172.21.15.103:0/1947957506 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcd0c04d990 0x7fcd0c04fe50 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:18.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:18.148+0000 7fcd33453700 1 --2- 172.21.15.103:0/1947957506 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd2c12c0d0 0x7fcd2c065420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:18.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:18.148+0000 7fcd33453700 1 --2- 172.21.15.103:0/1947957506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd2c065fe0 0x7fcd2c0b55b0 unknown :-1 s=CLOSED pgs=2139 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:18.152 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:18.148+0000 7fcd33453700 1 -- 172.21.15.103:0/1947957506 >> 172.21.15.103:0/1947957506 conn(0x7fcd2c0b9160 msgr2=0x7fcd2c062260 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:18.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:18.148+0000 7fcd33453700 1 -- 172.21.15.103:0/1947957506 shutdown_connections 2020-04-22T14:20:18.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:18.148+0000 7fcd33453700 1 -- 172.21.15.103:0/1947957506 wait complete. 2020-04-22T14:20:18.164 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 113 2020-04-22T14:20:18.165 INFO:tasks.cephfs.filesystem:mapped states [u'up:clientreplay'] to None 2020-04-22T14:20:19.166 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:19.183 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:20:19.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.336+0000 7f0606c19700 1 Processor -- start 2020-04-22T14:20:19.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.336+0000 7f0606c19700 1 -- start start 2020-04-22T14:20:19.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.336+0000 7f0606c19700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f060012c0d0 0x7f06001464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:19.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.336+0000 7f0606c19700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0600063e30 0x7f06000642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:19.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.336+0000 7f0606c19700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0600143300 con 0x7f0600065fe0 2020-04-22T14:20:19.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.336+0000 7f0606c19700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06001435a0 con 0x7f060012c0d0 2020-04-22T14:20:19.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.336+0000 7f0606c19700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0600143840 con 0x7f0600063e30 2020-04-22T14:20:19.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.337+0000 7f06049b5700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f060012c0d0 0x7f06001464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:19.341 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.337+0000 7f06051b6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0600063e30 0x7f06000642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:19.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.337+0000 7f06049b5700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f060012c0d0 0x7f06001464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:56088/0 (socket says 172.21.15.103:56088) 2020-04-22T14:20:19.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.337+0000 7f06051b6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0600063e30 0x7f06000642c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:43638/0 (socket says 172.21.15.103:43638) 2020-04-22T14:20:19.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.337+0000 7f06049b5700 1 -- 172.21.15.103:0/3616472911 learned_addr learned my addr 172.21.15.103:0/3616472911 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:19.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.337+0000 7f05fffff700 1 --1- 172.21.15.103:0/3616472911 >> v1:172.21.15.86:6789/0 conn(0x7f0600065fe0 0x7f060005b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:39970/0 (socket says 172.21.15.103:39970) 2020-04-22T14:20:19.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.337+0000 7f06049b5700 1 -- 172.21.15.103:0/3616472911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0600063e30 msgr2=0x7f06000642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:19.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.337+0000 7f06049b5700 1 --2- 172.21.15.103:0/3616472911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0600063e30 0x7f06000642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:19.342 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.337+0000 7f06049b5700 1 -- 172.21.15.103:0/3616472911 >> v1:172.21.15.86:6789/0 conn(0x7f0600065fe0 legacy=0x7f060005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:19.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.337+0000 7f06049b5700 1 -- 172.21.15.103:0/3616472911 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f060005bb50 con 0x7f060012c0d0 2020-04-22T14:20:19.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.337+0000 7f06051b6700 1 --2- 172.21.15.103:0/3616472911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0600063e30 0x7f06000642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:20:19.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.337+0000 7f06049b5700 1 --2- 172.21.15.103:0/3616472911 >> v2:172.21.15.86:3300/0 conn(0x7f060012c0d0 0x7f06001464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f05f0002f30 tx=0x7f05f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:19.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.337+0000 7f06049b5700 1 --2- 172.21.15.103:0/3616472911 >> v2:172.21.15.86:3300/0 conn(0x7f060012c0d0 0x7f06001464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f05f0002f30 tx=0x7f05f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:19.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.337+0000 7f06049b5700 1 --2- 172.21.15.103:0/3616472911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f060012c0d0 0x7f06001464e0 secure :-1 s=READY pgs=1121 cs=0 l=1 rx=0x7f05f0002f30 tx=0x7f05f0007a40).ready entity=mon.0 client_cookie=ccb23a59df644e79 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:19.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.337+0000 7f06049b5700 1 --2- 172.21.15.103:0/3616472911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f060012c0d0 0x7f06001464e0 secure :-1 s=THROTTLE_DONE pgs=1121 cs=0 l=1 rx=0x7f05f0002f30 tx=0x7f05f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:19.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.337+0000 7f05ff7fe700 1 -- 172.21.15.103:0/3616472911 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05f0011670 con 0x7f060012c0d0 2020-04-22T14:20:19.343 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.337+0000 7f06049b5700 1 --2- 172.21.15.103:0/3616472911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f060012c0d0 0x7f06001464e0 secure :-1 s=THROTTLE_DONE pgs=1121 cs=0 l=1 rx=0x7f05f0002f30 tx=0x7f05f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:19.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.337+0000 7f06049b5700 1 --2- 172.21.15.103:0/3616472911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f060012c0d0 0x7f06001464e0 secure :-1 s=THROTTLE_DONE pgs=1121 cs=0 l=1 rx=0x7f05f0002f30 tx=0x7f05f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:19.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.337+0000 7f05ff7fe700 1 -- 172.21.15.103:0/3616472911 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f0011810 con 0x7f060012c0d0 2020-04-22T14:20:19.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.337+0000 7f05ff7fe700 1 -- 172.21.15.103:0/3616472911 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05f0011c30 con 0x7f060012c0d0 2020-04-22T14:20:19.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.338+0000 7f0606c19700 1 -- 172.21.15.103:0/3616472911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f060012c0d0 msgr2=0x7f06001464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:19.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.338+0000 7f0606c19700 1 --2- 172.21.15.103:0/3616472911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f060012c0d0 0x7f06001464e0 secure :-1 s=READY pgs=1121 cs=0 l=1 rx=0x7f05f0002f30 tx=0x7f05f0007a40).stop 2020-04-22T14:20:19.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.338+0000 7f0606c19700 1 -- 172.21.15.103:0/3616472911 shutdown_connections 2020-04-22T14:20:19.344 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.338+0000 7f0606c19700 1 --2- 172.21.15.103:0/3616472911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0600063e30 0x7f06000642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:19.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.338+0000 7f0606c19700 1 --2- 172.21.15.103:0/3616472911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f060012c0d0 0x7f06001464e0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:19.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.338+0000 7f0606c19700 1 -- 172.21.15.103:0/3616472911 >> 172.21.15.103:0/3616472911 conn(0x7f06000b9160 msgr2=0x7f060005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:19.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.338+0000 7f0606c19700 1 -- 172.21.15.103:0/3616472911 shutdown_connections 2020-04-22T14:20:19.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.338+0000 7f0606c19700 1 -- 172.21.15.103:0/3616472911 wait complete. 2020-04-22T14:20:19.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.339+0000 7f0606c19700 1 Processor -- start 2020-04-22T14:20:19.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.339+0000 7f0606c19700 1 -- start start 2020-04-22T14:20:19.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.340+0000 7f0606c19700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0600063e30 0x7f06000b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:19.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.340+0000 7f0606c19700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f060012c0d0 0x7f06000ac740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:19.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.340+0000 7f0606c19700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06000b7db0 con 0x7f0600065fe0 2020-04-22T14:20:19.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.340+0000 7f0606c19700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06000acba0 con 0x7f060012c0d0 2020-04-22T14:20:19.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.340+0000 7f0606c19700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06000ae3c0 con 0x7f0600063e30 2020-04-22T14:20:19.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.340+0000 7f06049b5700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0600063e30 0x7f06000b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:19.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.340+0000 7f06049b5700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0600063e30 0x7f06000b7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58862/0 (socket says 172.21.15.103:58862) 2020-04-22T14:20:19.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.340+0000 7f05fffff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f0600065fe0 0x7f06000ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51054/0 (socket says 172.21.15.103:51054) 2020-04-22T14:20:19.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.340+0000 7f06049b5700 1 -- 172.21.15.103:0/3847614018 learned_addr learned my addr 172.21.15.103:0/3847614018 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:19.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.340+0000 7f06051b6700 1 --2- 172.21.15.103:0/3847614018 >> v2:172.21.15.86:3300/0 conn(0x7f060012c0d0 0x7f06000ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:19.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.340+0000 7f06049b5700 1 -- 172.21.15.103:0/3847614018 >> v2:172.21.15.86:3300/0 conn(0x7f060012c0d0 msgr2=0x7f06000ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:19.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.340+0000 7f06049b5700 1 --2- 172.21.15.103:0/3847614018 >> v2:172.21.15.86:3300/0 conn(0x7f060012c0d0 0x7f06000ac740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:19.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.340+0000 7f06049b5700 1 -- 172.21.15.103:0/3847614018 >> v1:172.21.15.103:6789/0 conn(0x7f0600065fe0 legacy=0x7f06000ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:19.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.340+0000 7f06049b5700 1 -- 172.21.15.103:0/3847614018 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06000ae660 con 0x7f0600063e30 2020-04-22T14:20:19.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.340+0000 7f05fdffb700 1 -- 172.21.15.103:0/3847614018 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3073457508 0 0) 0x7f0600143300 con 0x7f0600065fe0 2020-04-22T14:20:19.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.340+0000 7f06049b5700 1 --2- 172.21.15.103:0/3847614018 >> v2:172.21.15.103:3300/0 conn(0x7f0600063e30 0x7f06000b7950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f05f0002f30 tx=0x7f05f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:19.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.340+0000 7f06049b5700 1 --2- 172.21.15.103:0/3847614018 >> v2:172.21.15.103:3300/0 conn(0x7f0600063e30 0x7f06000b7950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f05f0002f30 tx=0x7f05f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:19.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.340+0000 7f06049b5700 1 --2- 172.21.15.103:0/3847614018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0600063e30 0x7f06000b7950 secure :-1 s=READY pgs=2141 cs=0 l=1 rx=0x7f05f0002f30 tx=0x7f05f0007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:19.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.341+0000 7f06049b5700 1 --2- 172.21.15.103:0/3847614018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0600063e30 0x7f06000b7950 secure :-1 s=THROTTLE_DONE pgs=2141 cs=0 l=1 rx=0x7f05f0002f30 tx=0x7f05f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:19.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.341+0000 7f05fdffb700 1 -- 172.21.15.103:0/3847614018 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05f0010210 con 0x7f0600063e30 2020-04-22T14:20:19.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.341+0000 7f06049b5700 1 --2- 172.21.15.103:0/3847614018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0600063e30 0x7f06000b7950 secure :-1 s=THROTTLE_DONE pgs=2141 cs=0 l=1 rx=0x7f05f0002f30 tx=0x7f05f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:19.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.341+0000 7f06049b5700 1 --2- 172.21.15.103:0/3847614018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0600063e30 0x7f06000b7950 secure :-1 s=THROTTLE_DONE pgs=2141 cs=0 l=1 rx=0x7f05f0002f30 tx=0x7f05f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:19.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.341+0000 7f05fdffb700 1 -- 172.21.15.103:0/3847614018 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f0007360 con 0x7f0600063e30 2020-04-22T14:20:19.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.341+0000 7f0606c19700 1 -- 172.21.15.103:0/3847614018 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06000afbc0 con 0x7f0600063e30 2020-04-22T14:20:19.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.341+0000 7f05fdffb700 1 -- 172.21.15.103:0/3847614018 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05f00056c0 con 0x7f0600063e30 2020-04-22T14:20:19.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.341+0000 7f0606c19700 1 -- 172.21.15.103:0/3847614018 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06000ad910 con 0x7f0600063e30 2020-04-22T14:20:19.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.341+0000 7f06049b5700 1 --2- 172.21.15.103:0/3847614018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0600063e30 0x7f06000b7950 secure :-1 s=THROTTLE_DONE pgs=2141 cs=0 l=1 rx=0x7f05f0002f30 tx=0x7f05f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:19.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.342+0000 7f05fdffb700 1 -- 172.21.15.103:0/3847614018 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f05f00058c0 con 0x7f0600063e30 2020-04-22T14:20:19.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.342+0000 7f06049b5700 1 --2- 172.21.15.103:0/3847614018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0600063e30 0x7f06000b7950 secure :-1 s=THROTTLE_DONE pgs=2141 cs=0 l=1 rx=0x7f05f0002f30 tx=0x7f05f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:19.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.342+0000 7f0606c19700 1 -- 172.21.15.103:0/3847614018 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06000ae1b0 con 0x7f0600063e30 2020-04-22T14:20:19.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.342+0000 7f05fdffb700 1 --2- 172.21.15.103:0/3847614018 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f05e004fa30 0x7f05e0051ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:19.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.342+0000 7f05fdffb700 1 -- 172.21.15.103:0/3847614018 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f05f00619a0 con 0x7f0600063e30 2020-04-22T14:20:19.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.342+0000 7f05fffff700 1 --2- 172.21.15.103:0/3847614018 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f05e004fa30 0x7f05e0051ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:19.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.343+0000 7f05fffff700 1 --2- 172.21.15.103:0/3847614018 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f05e004fa30 0x7f05e0051ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f05f4001220 tx=0x7f05f4001750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:19.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.343+0000 7f05fffff700 1 --2- 172.21.15.103:0/3847614018 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f05e004fa30 0x7f05e0051ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f05f4001220 tx=0x7f05f4001750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:19.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.343+0000 7f05fffff700 1 --2- 172.21.15.103:0/3847614018 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f05e004fa30 0x7f05e0051ef0 secure :-1 s=READY pgs=776 cs=0 l=1 rx=0x7f05f4001220 tx=0x7f05f4001750).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:19.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.346+0000 7f06049b5700 1 --2- 172.21.15.103:0/3847614018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0600063e30 0x7f06000b7950 secure :-1 s=THROTTLE_DONE pgs=2141 cs=0 l=1 rx=0x7f05f0002f30 tx=0x7f05f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:19.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.346+0000 7f05fdffb700 1 -- 172.21.15.103:0/3847614018 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f05f003cd20 con 0x7f0600063e30 2020-04-22T14:20:19.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.538+0000 7f0606c19700 1 -- 172.21.15.103:0/3847614018 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0600056c90 con 0x7f0600063e30 2020-04-22T14:20:19.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.538+0000 7f06049b5700 1 --2- 172.21.15.103:0/3847614018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0600063e30 0x7f06000b7950 secure :-1 s=THROTTLE_DONE pgs=2141 cs=0 l=1 rx=0x7f05f0002f30 tx=0x7f05f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:19.541 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.538+0000 7f05fdffb700 1 -- 172.21.15.103:0/3847614018 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+2151 (secure 0 0 0) 0x7f05f0040340 con 0x7f0600063e30 2020-04-22T14:20:19.541 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:20:19.541 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":114,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":9982,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.103:6833/1807533375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1807533375},{"type":"v1","addr":"172.21.15.103:6833","nonce":1807533375}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":111}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:19:46.112631+0000","modified":"2020-04-22T14:20:18.806229+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":147,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6878},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6878":{"gid":6878,"name":"b","rank":0,"incarnation":109,"state":"up:active","state_seq":6,"addr":"172.21.15.86:6835/2193157152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2193157152},{"type":"v1","addr":"172.21.15.86:6835","nonce":2193157152}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-04-22T14:20:19.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.539+0000 7f0606c19700 1 -- 172.21.15.103:0/3847614018 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f05e004fa30 msgr2=0x7f05e0051ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:19.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.539+0000 7f0606c19700 1 --2- 172.21.15.103:0/3847614018 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f05e004fa30 0x7f05e0051ef0 secure :-1 s=READY pgs=776 cs=0 l=1 rx=0x7f05f4001220 tx=0x7f05f4001750).stop 2020-04-22T14:20:19.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.539+0000 7f0606c19700 1 -- 172.21.15.103:0/3847614018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0600063e30 msgr2=0x7f06000b7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:19.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.539+0000 7f0606c19700 1 --2- 172.21.15.103:0/3847614018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0600063e30 0x7f06000b7950 secure :-1 s=READY pgs=2141 cs=0 l=1 rx=0x7f05f0002f30 tx=0x7f05f0007a40).stop 2020-04-22T14:20:19.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.540+0000 7f0606c19700 1 -- 172.21.15.103:0/3847614018 shutdown_connections 2020-04-22T14:20:19.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.540+0000 7f0606c19700 1 --2- 172.21.15.103:0/3847614018 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f05e004fa30 0x7f05e0051ef0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:19.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.540+0000 7f0606c19700 1 --2- 172.21.15.103:0/3847614018 >> v2:172.21.15.86:3300/0 conn(0x7f060012c0d0 0x7f06000ac740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:19.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.540+0000 7f0606c19700 1 --2- 172.21.15.103:0/3847614018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0600063e30 0x7f06000b7950 unknown :-1 s=CLOSED pgs=2141 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:19.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.540+0000 7f0606c19700 1 -- 172.21.15.103:0/3847614018 >> 172.21.15.103:0/3847614018 conn(0x7f06000b9160 msgr2=0x7f060005ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:19.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.540+0000 7f0606c19700 1 -- 172.21.15.103:0/3847614018 shutdown_connections 2020-04-22T14:20:19.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:19.540+0000 7f0606c19700 1 -- 172.21.15.103:0/3847614018 wait complete. 2020-04-22T14:20:19.544 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 114 2020-04-22T14:20:19.559 INFO:tasks.cephfs.filesystem:mapped states [u'up:active'] to up:active 2020-04-22T14:20:19.559 INFO:tasks.cephfs.filesystem:reached state 'up:active' in 3.16061496735s 2020-04-22T14:20:19.560 INFO:tasks.cephfs.mount:Cleaning up killed connection on ubuntu@smithi103.front.sepia.ceph.com 2020-04-22T14:20:19.560 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2020-04-22T14:20:19.560 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:19.576 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-04-22T14:20:19.576 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:20:19.684 INFO:teuthology.orchestra.run:waiting for 900 2020-04-22T14:20:19.684 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:20:19.684 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:20:19.684 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:19.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:19.707 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:20:19.783 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:19.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:19.835 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down brx.0' 2020-04-22T14:20:19.993 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.0' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/58) 2020-04-22T14:20:19.993 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:20.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:20.007 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete brx.0' 2020-04-22T14:20:20.115 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.0' (71512272-2959-448d-9843-f3fe92523303) successfully deleted. 2020-04-22T14:20:20.115 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:20.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:20.147 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:20:20.257 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:20.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:20.285 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:20:20.345 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:20:20.345 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:20:20.345 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:20:20.345 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:20.345 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:20:20.345 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:20.346 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:20:20.346 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:20.346 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:20:20.346 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:20.346 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:20:20.346 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:20.346 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:20:20.347 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:20.347 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:20:20.347 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 41620sec preferred_lft 41620sec 2020-04-22T14:20:20.347 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:20:20.347 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:20.347 INFO:teuthology.orchestra.run.smithi103.stdout:44: brx.4@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:20:20.347 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether ce:62:6d:2c:c1:6d brd ff:ff:ff:ff:ff:ff link-netnsid 4 2020-04-22T14:20:20.348 INFO:teuthology.orchestra.run.smithi103.stdout:46: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:20:20.348 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 56:41:da:23:d7:48 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:20.348 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:20:20.348 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:20.348 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::3c5:c758:d319:26f6/64 scope link noprefixroute 2020-04-22T14:20:20.348 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:20.348 INFO:teuthology.orchestra.run.smithi103.stdout:47: brx.0@if2: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:20:20.349 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether f6:69:77:c1:44:bd brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:20:20.349 INFO:teuthology.orchestra.run.smithi103.stdout:48: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-04-22T14:20:20.349 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 56:41:da:23:d7:48 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2020-04-22T14:20:20.349 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:20.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:20.394 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:20:20.486 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:20.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:20.523 INFO:teuthology.orchestra.run.smithi103:> nmcli connection show 2020-04-22T14:20:20.598 INFO:teuthology.orchestra.run.smithi103.stdout:NAME UUID TYPE DEVICE 2020-04-22T14:20:20.598 INFO:teuthology.orchestra.run.smithi103.stdout:System enp3s0f1 b0a308d1-bd90-60af-eb7c-0183bb425a1a ethernet enp3s0f1 2020-04-22T14:20:20.599 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-brx ceeb966f-6807-4e5c-804a-9a614abf7ae3 bridge ceph-brx 2020-04-22T14:20:20.599 INFO:teuthology.orchestra.run.smithi103.stdout:brx.1 1e2c85a4-f18a-4c67-a6f1-a640d4fc712b ethernet brx.1 2020-04-22T14:20:20.599 INFO:teuthology.orchestra.run.smithi103.stdout:eno1 206ad60d-195e-4d4b-a9fe-a5dd1f33a67d ethernet -- 2020-04-22T14:20:20.599 INFO:teuthology.orchestra.run.smithi103.stdout:eno2 894a7dd2-d329-4985-9ef9-84a92c6e1c6c ethernet -- 2020-04-22T14:20:20.599 INFO:teuthology.orchestra.run.smithi103.stdout:enp3s0f0 5a3237ce-06ab-4ae0-818b-45bdf036cb08 ethernet -- 2020-04-22T14:20:20.600 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:20.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:20.651 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:20:20.711 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:20.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:20.759 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:20:20.813 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-04-22T14:20:20.819 INFO:teuthology.orchestra.run.smithi103.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2020-04-22T14:20:20.819 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:20.867 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:20:21.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.011+0000 7f01ee30c700 1 Processor -- start 2020-04-22T14:20:21.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.011+0000 7f01ee30c700 1 -- start start 2020-04-22T14:20:21.016 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.011+0000 7f01ee30c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f01e812c0d0 0x7f01e81464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:21.016 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.012+0000 7f01ee30c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f01e8065fe0 0x7f01e805b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:21.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.012+0000 7f01ee30c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f01e805b8a0 0x7f01e8062ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:21.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.012+0000 7f01ee30c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01e812c4b0 con 0x7f01e805b8a0 2020-04-22T14:20:21.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.012+0000 7f01ee30c700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01e8143300 con 0x7f01e812c0d0 2020-04-22T14:20:21.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.012+0000 7f01ee30c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01e81435a0 con 0x7f01e8065fe0 2020-04-22T14:20:21.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.012+0000 7f01e7fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f01e812c0d0 0x7f01e81464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:21.017 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.012+0000 7f01e7fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f01e812c0d0 0x7f01e81464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58870/0 (socket says 172.21.15.103:58870) 2020-04-22T14:20:21.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.012+0000 7f01e7fff700 1 -- 172.21.15.103:0/3627289241 learned_addr learned my addr 172.21.15.103:0/3627289241 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:21.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.012+0000 7f01e7fff700 1 -- 172.21.15.103:0/3627289241 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f01e8065fe0 msgr2=0x7f01e805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:21.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.012+0000 7f01ec8a9700 1 --2- 172.21.15.103:0/3627289241 >> v2:172.21.15.86:3300/0 conn(0x7f01e805b8a0 0x7f01e8062ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:21.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.012+0000 7f01e77fe700 1 --2- 172.21.15.103:0/3627289241 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f01e8065fe0 0x7f01e805b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:21.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.012+0000 7f01e7fff700 1 --2- 172.21.15.103:0/3627289241 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f01e8065fe0 0x7f01e805b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:21.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.012+0000 7f01e7fff700 1 -- 172.21.15.103:0/3627289241 >> v2:172.21.15.86:3300/0 conn(0x7f01e805b8a0 msgr2=0x7f01e8062ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:21.018 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.012+0000 7f01e7fff700 1 --2- 172.21.15.103:0/3627289241 >> v2:172.21.15.86:3300/0 conn(0x7f01e805b8a0 0x7f01e8062ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:21.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.012+0000 7f01e7fff700 1 -- 172.21.15.103:0/3627289241 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e8143840 con 0x7f01e812c0d0 2020-04-22T14:20:21.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.012+0000 7f01ec8a9700 1 --2- 172.21.15.103:0/3627289241 >> v2:172.21.15.86:3300/0 conn(0x7f01e805b8a0 0x7f01e8062ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:20:21.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.012+0000 7f01e77fe700 1 --2- 172.21.15.103:0/3627289241 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f01e8065fe0 0x7f01e805b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:20:21.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.012+0000 7f01e7fff700 1 --2- 172.21.15.103:0/3627289241 >> v2:172.21.15.103:3300/0 conn(0x7f01e812c0d0 0x7f01e81464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f01d8002f30 tx=0x7f01d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.012+0000 7f01e7fff700 1 --2- 172.21.15.103:0/3627289241 >> v2:172.21.15.103:3300/0 conn(0x7f01e812c0d0 0x7f01e81464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f01d8002f30 tx=0x7f01d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.012+0000 7f01e7fff700 1 --2- 172.21.15.103:0/3627289241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01e812c0d0 0x7f01e81464e0 secure :-1 s=READY pgs=2142 cs=0 l=1 rx=0x7f01d8002f30 tx=0x7f01d8007a40).ready entity=mon.1 client_cookie=5c7190e8d6074a server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:21.019 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.012+0000 7f01e7fff700 1 --2- 172.21.15.103:0/3627289241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01e812c0d0 0x7f01e81464e0 secure :-1 s=THROTTLE_DONE pgs=2142 cs=0 l=1 rx=0x7f01d8002f30 tx=0x7f01d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.012+0000 7f01e6ffd700 1 -- 172.21.15.103:0/3627289241 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01d8011720 con 0x7f01e812c0d0 2020-04-22T14:20:21.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.012+0000 7f01e7fff700 1 --2- 172.21.15.103:0/3627289241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01e812c0d0 0x7f01e81464e0 secure :-1 s=THROTTLE_DONE pgs=2142 cs=0 l=1 rx=0x7f01d8002f30 tx=0x7f01d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.012+0000 7f01e7fff700 1 --2- 172.21.15.103:0/3627289241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01e812c0d0 0x7f01e81464e0 secure :-1 s=THROTTLE_DONE pgs=2142 cs=0 l=1 rx=0x7f01d8002f30 tx=0x7f01d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.012+0000 7f01e6ffd700 1 -- 172.21.15.103:0/3627289241 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d8011880 con 0x7f01e812c0d0 2020-04-22T14:20:21.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.012+0000 7f01e6ffd700 1 -- 172.21.15.103:0/3627289241 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01d8011ca0 con 0x7f01e812c0d0 2020-04-22T14:20:21.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.012+0000 7f01ee30c700 1 -- 172.21.15.103:0/3627289241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01e812c0d0 msgr2=0x7f01e81464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:21.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.012+0000 7f01ee30c700 1 --2- 172.21.15.103:0/3627289241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01e812c0d0 0x7f01e81464e0 secure :-1 s=READY pgs=2142 cs=0 l=1 rx=0x7f01d8002f30 tx=0x7f01d8007a40).stop 2020-04-22T14:20:21.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.013+0000 7f01ee30c700 1 -- 172.21.15.103:0/3627289241 shutdown_connections 2020-04-22T14:20:21.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.013+0000 7f01ee30c700 1 --2- 172.21.15.103:0/3627289241 >> v2:172.21.15.86:3300/0 conn(0x7f01e805b8a0 0x7f01e8062ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:21.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.013+0000 7f01ee30c700 1 --2- 172.21.15.103:0/3627289241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01e812c0d0 0x7f01e81464e0 unknown :-1 s=CLOSED pgs=2142 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:21.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.013+0000 7f01ee30c700 1 --2- 172.21.15.103:0/3627289241 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f01e8065fe0 0x7f01e805b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:21.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.013+0000 7f01ee30c700 1 -- 172.21.15.103:0/3627289241 >> 172.21.15.103:0/3627289241 conn(0x7f01e80b9160 msgr2=0x7f01e805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:21.021 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.013+0000 7f01ee30c700 1 -- 172.21.15.103:0/3627289241 shutdown_connections 2020-04-22T14:20:21.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.013+0000 7f01ee30c700 1 -- 172.21.15.103:0/3627289241 wait complete. 2020-04-22T14:20:21.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.014+0000 7f01ee30c700 1 Processor -- start 2020-04-22T14:20:21.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.014+0000 7f01ee30c700 1 -- start start 2020-04-22T14:20:21.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.015+0000 7f01ee30c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f01e812c0d0 0x7f01e81454b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:21.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.015+0000 7f01ee30c700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01e8065240 con 0x7f01e805b8a0 2020-04-22T14:20:21.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.015+0000 7f01ee30c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01e8145910 con 0x7f01e8065fe0 2020-04-22T14:20:21.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.015+0000 7f01ee30c700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01e8065470 con 0x7f01e812c0d0 2020-04-22T14:20:21.026 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.015+0000 7f01ec8a9700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f01e812c0d0 0x7f01e81454b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:21.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.015+0000 7f01e77fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f01e8065fe0 0x7f01e81237a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51068/0 (socket says 172.21.15.103:51068) 2020-04-22T14:20:21.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.015+0000 7f01e77fe700 1 -- 172.21.15.103:0/705929383 learned_addr learned my addr 172.21.15.103:0/705929383 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:21.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.015+0000 7f01ec8a9700 1 -- 172.21.15.103:0/705929383 >> v1:172.21.15.103:6789/0 conn(0x7f01e8065fe0 legacy=0x7f01e81237a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:21.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.015+0000 7f01ec8a9700 1 -- 172.21.15.103:0/705929383 >> v1:172.21.15.86:6789/0 conn(0x7f01e805b8a0 legacy=0x7f01e8142070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:21.027 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.015+0000 7f01e57fa700 1 -- 172.21.15.103:0/705929383 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3818963199 0 0) 0x7f01dc001f70 con 0x7f01e8065fe0 2020-04-22T14:20:21.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.015+0000 7f01ec8a9700 1 -- 172.21.15.103:0/705929383 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e81232d0 con 0x7f01e812c0d0 2020-04-22T14:20:21.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.015+0000 7f01ec8a9700 1 --2- 172.21.15.103:0/705929383 >> v2:172.21.15.103:3300/0 conn(0x7f01e812c0d0 0x7f01e81454b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f01e8064fd0 tx=0x7f01e0010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.015+0000 7f01ec8a9700 1 --2- 172.21.15.103:0/705929383 >> v2:172.21.15.103:3300/0 conn(0x7f01e812c0d0 0x7f01e81454b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f01e8064fd0 tx=0x7f01e0010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.015+0000 7f01ec8a9700 1 --2- 172.21.15.103:0/705929383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01e812c0d0 0x7f01e81454b0 secure :-1 s=READY pgs=2144 cs=0 l=1 rx=0x7f01e8064fd0 tx=0x7f01e0010d70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:21.029 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.015+0000 7f01ec8a9700 1 --2- 172.21.15.103:0/705929383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01e812c0d0 0x7f01e81454b0 secure :-1 s=THROTTLE_DONE pgs=2144 cs=0 l=1 rx=0x7f01e8064fd0 tx=0x7f01e0010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.035 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.015+0000 7f01e57fa700 1 -- 172.21.15.103:0/705929383 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01e0012ba0 con 0x7f01e812c0d0 2020-04-22T14:20:21.035 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.015+0000 7f01ec8a9700 1 --2- 172.21.15.103:0/705929383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01e812c0d0 0x7f01e81454b0 secure :-1 s=THROTTLE_DONE pgs=2144 cs=0 l=1 rx=0x7f01e8064fd0 tx=0x7f01e0010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.035 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.015+0000 7f01e57fa700 1 -- 172.21.15.103:0/705929383 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e0009e90 con 0x7f01e812c0d0 2020-04-22T14:20:21.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.015+0000 7f01ee30c700 1 -- 172.21.15.103:0/705929383 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01e8142780 con 0x7f01e812c0d0 2020-04-22T14:20:21.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.015+0000 7f01ec8a9700 1 --2- 172.21.15.103:0/705929383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01e812c0d0 0x7f01e81454b0 secure :-1 s=THROTTLE_DONE pgs=2144 cs=0 l=1 rx=0x7f01e8064fd0 tx=0x7f01e0010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.015+0000 7f01e57fa700 1 -- 172.21.15.103:0/705929383 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01e00091c0 con 0x7f01e812c0d0 2020-04-22T14:20:21.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.015+0000 7f01ee30c700 1 -- 172.21.15.103:0/705929383 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01e8064b70 con 0x7f01e812c0d0 2020-04-22T14:20:21.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.016+0000 7f01ec8a9700 1 --2- 172.21.15.103:0/705929383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01e812c0d0 0x7f01e81454b0 secure :-1 s=THROTTLE_DONE pgs=2144 cs=0 l=1 rx=0x7f01e8064fd0 tx=0x7f01e0010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.016+0000 7f01ee30c700 1 -- 172.21.15.103:0/705929383 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01e81234c0 con 0x7f01e812c0d0 2020-04-22T14:20:21.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.016+0000 7f01e57fa700 1 -- 172.21.15.103:0/705929383 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f01e0005a40 con 0x7f01e812c0d0 2020-04-22T14:20:21.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.016+0000 7f01ec8a9700 1 --2- 172.21.15.103:0/705929383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01e812c0d0 0x7f01e81454b0 secure :-1 s=THROTTLE_DONE pgs=2144 cs=0 l=1 rx=0x7f01e8064fd0 tx=0x7f01e0010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.017+0000 7f01e57fa700 1 --2- 172.21.15.103:0/705929383 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f01c804d880 0x7f01c804fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:21.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.017+0000 7f01e57fa700 1 -- 172.21.15.103:0/705929383 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f01e00617c0 con 0x7f01e812c0d0 2020-04-22T14:20:21.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.017+0000 7f01e7fff700 1 --2- 172.21.15.103:0/705929383 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f01c804d880 0x7f01c804fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:21.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.017+0000 7f01e7fff700 1 --2- 172.21.15.103:0/705929383 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f01c804d880 0x7f01c804fd40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f01d8002f30 tx=0x7f01d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.017+0000 7f01e7fff700 1 --2- 172.21.15.103:0/705929383 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f01c804d880 0x7f01c804fd40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f01d8002f30 tx=0x7f01d8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.017+0000 7f01e7fff700 1 --2- 172.21.15.103:0/705929383 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f01c804d880 0x7f01c804fd40 secure :-1 s=READY pgs=777 cs=0 l=1 rx=0x7f01d8002f30 tx=0x7f01d8007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:21.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.021+0000 7f01ec8a9700 1 --2- 172.21.15.103:0/705929383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01e812c0d0 0x7f01e81454b0 secure :-1 s=THROTTLE_DONE pgs=2144 cs=0 l=1 rx=0x7f01e8064fd0 tx=0x7f01e0010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.021+0000 7f01e57fa700 1 -- 172.21.15.103:0/705929383 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f01e003cba0 con 0x7f01e812c0d0 2020-04-22T14:20:21.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.167+0000 7f01ee30c700 1 -- 172.21.15.103:0/705929383 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01e8056c90 con 0x7f01e812c0d0 2020-04-22T14:20:21.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.168+0000 7f01ec8a9700 1 --2- 172.21.15.103:0/705929383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01e812c0d0 0x7f01e81454b0 secure :-1 s=THROTTLE_DONE pgs=2144 cs=0 l=1 rx=0x7f01e8064fd0 tx=0x7f01e0010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.168+0000 7f01e57fa700 1 -- 172.21.15.103:0/705929383 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v149) v1 ==== 74+0+16293 (secure 0 0 0) 0x7f01e00401c0 con 0x7f01e812c0d0 2020-04-22T14:20:21.171 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:20:21.171 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":149,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:20:15.801693+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:19:44.035980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2020-04-22T14:19:45.079896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"192.168.0.1:0/3303065033":"2020-04-22T15:20:15.236487+0000","172.21.15.103:6833/839133818":"2020-04-23T14:20:04.739433+0000","172.21.15.103:6832/839133818":"2020-04-23T14:20:04.739433+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:20:21.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.169+0000 7f01ee30c700 1 -- 172.21.15.103:0/705929383 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f01c804d880 msgr2=0x7f01c804fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:21.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.169+0000 7f01ee30c700 1 --2- 172.21.15.103:0/705929383 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f01c804d880 0x7f01c804fd40 secure :-1 s=READY pgs=777 cs=0 l=1 rx=0x7f01d8002f30 tx=0x7f01d8007a40).stop 2020-04-22T14:20:21.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.169+0000 7f01ee30c700 1 -- 172.21.15.103:0/705929383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01e812c0d0 msgr2=0x7f01e81454b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:21.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.169+0000 7f01ee30c700 1 --2- 172.21.15.103:0/705929383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01e812c0d0 0x7f01e81454b0 secure :-1 s=READY pgs=2144 cs=0 l=1 rx=0x7f01e8064fd0 tx=0x7f01e0010d70).stop 2020-04-22T14:20:21.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.169+0000 7f01ee30c700 1 -- 172.21.15.103:0/705929383 shutdown_connections 2020-04-22T14:20:21.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.169+0000 7f01ee30c700 1 --2- 172.21.15.103:0/705929383 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f01c804d880 0x7f01c804fd40 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:21.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.169+0000 7f01ee30c700 1 --2- 172.21.15.103:0/705929383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01e812c0d0 0x7f01e81454b0 unknown :-1 s=CLOSED pgs=2144 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:21.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.169+0000 7f01ee30c700 1 -- 172.21.15.103:0/705929383 >> 172.21.15.103:0/705929383 conn(0x7f01e80b9160 msgr2=0x7f01e80b65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:21.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.169+0000 7f01ee30c700 1 -- 172.21.15.103:0/705929383 shutdown_connections 2020-04-22T14:20:21.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.169+0000 7f01ee30c700 1 -- 172.21.15.103:0/705929383 wait complete. 2020-04-22T14:20:21.182 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:19:44.035980+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 25, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'145', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:19:45.079896+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 26, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'146', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:20:21.183 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:21.197 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:20:21.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.343+0000 7fa6b96f2700 1 Processor -- start 2020-04-22T14:20:21.345 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.343+0000 7fa6b96f2700 1 -- start start 2020-04-22T14:20:21.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.344+0000 7fa6b96f2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa6b40b9140 0x7fa6b40aed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:21.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.344+0000 7fa6b96f2700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa6b40b3bd0 0x7fa6b40af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:21.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.344+0000 7fa6b96f2700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa6b40616b0 0x7fa6b4061b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:21.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.344+0000 7fa6b96f2700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6b40af650 con 0x7fa6b40616b0 2020-04-22T14:20:21.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.344+0000 7fa6b96f2700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6b4148310 con 0x7fa6b40b9140 2020-04-22T14:20:21.349 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.344+0000 7fa6b96f2700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b41485b0 con 0x7fa6b40b3bd0 2020-04-22T14:20:21.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.344+0000 7fa6b2ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa6b40b9140 0x7fa6b40aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:21.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.344+0000 7fa6b2ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa6b40b9140 0x7fa6b40aed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58884/0 (socket says 172.21.15.103:58884) 2020-04-22T14:20:21.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.344+0000 7fa6b2ffd700 1 -- 172.21.15.103:0/3406378979 learned_addr learned my addr 172.21.15.103:0/3406378979 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:21.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.344+0000 7fa6b27fc700 1 --2- 172.21.15.103:0/3406378979 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa6b40b3bd0 0x7fa6b40af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:21.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.344+0000 7fa6b37fe700 1 --2- 172.21.15.103:0/3406378979 >> v2:172.21.15.86:3300/0 conn(0x7fa6b40616b0 0x7fa6b4061b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:21.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.345+0000 7fa6b2ffd700 1 -- 172.21.15.103:0/3406378979 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa6b40b3bd0 msgr2=0x7fa6b40af1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:21.350 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.345+0000 7fa6b2ffd700 1 --2- 172.21.15.103:0/3406378979 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa6b40b3bd0 0x7fa6b40af1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:21.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.345+0000 7fa6b2ffd700 1 -- 172.21.15.103:0/3406378979 >> v2:172.21.15.86:3300/0 conn(0x7fa6b40616b0 msgr2=0x7fa6b4061b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:21.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.345+0000 7fa6b2ffd700 1 --2- 172.21.15.103:0/3406378979 >> v2:172.21.15.86:3300/0 conn(0x7fa6b40616b0 0x7fa6b4061b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:21.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.345+0000 7fa6b2ffd700 1 -- 172.21.15.103:0/3406378979 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b40b9520 con 0x7fa6b40b9140 2020-04-22T14:20:21.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.345+0000 7fa6b37fe700 1 --2- 172.21.15.103:0/3406378979 >> v2:172.21.15.86:3300/0 conn(0x7fa6b40616b0 0x7fa6b4061b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:20:21.351 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.345+0000 7fa6b2ffd700 1 --2- 172.21.15.103:0/3406378979 >> v2:172.21.15.103:3300/0 conn(0x7fa6b40b9140 0x7fa6b40aed90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa6a8002f30 tx=0x7fa6a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.345+0000 7fa6b2ffd700 1 --2- 172.21.15.103:0/3406378979 >> v2:172.21.15.103:3300/0 conn(0x7fa6b40b9140 0x7fa6b40aed90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa6a8002f30 tx=0x7fa6a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.345+0000 7fa6b2ffd700 1 --2- 172.21.15.103:0/3406378979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6b40b9140 0x7fa6b40aed90 secure :-1 s=READY pgs=2145 cs=0 l=1 rx=0x7fa6a8002f30 tx=0x7fa6a8007a40).ready entity=mon.1 client_cookie=37dd54ede8711366 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:21.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.345+0000 7fa6b2ffd700 1 --2- 172.21.15.103:0/3406378979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6b40b9140 0x7fa6b40aed90 secure :-1 s=THROTTLE_DONE pgs=2145 cs=0 l=1 rx=0x7fa6a8002f30 tx=0x7fa6a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.345+0000 7fa6b1ffb700 1 -- 172.21.15.103:0/3406378979 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6a8011720 con 0x7fa6b40b9140 2020-04-22T14:20:21.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.345+0000 7fa6b2ffd700 1 --2- 172.21.15.103:0/3406378979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6b40b9140 0x7fa6b40aed90 secure :-1 s=THROTTLE_DONE pgs=2145 cs=0 l=1 rx=0x7fa6a8002f30 tx=0x7fa6a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.345+0000 7fa6b2ffd700 1 --2- 172.21.15.103:0/3406378979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6b40b9140 0x7fa6b40aed90 secure :-1 s=THROTTLE_DONE pgs=2145 cs=0 l=1 rx=0x7fa6a8002f30 tx=0x7fa6a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.352 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.345+0000 7fa6b1ffb700 1 -- 172.21.15.103:0/3406378979 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a8011880 con 0x7fa6b40b9140 2020-04-22T14:20:21.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.345+0000 7fa6b1ffb700 1 -- 172.21.15.103:0/3406378979 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6a8011ca0 con 0x7fa6b40b9140 2020-04-22T14:20:21.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.345+0000 7fa6b96f2700 1 -- 172.21.15.103:0/3406378979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6b40b9140 msgr2=0x7fa6b40aed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:21.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.345+0000 7fa6b96f2700 1 --2- 172.21.15.103:0/3406378979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6b40b9140 0x7fa6b40aed90 secure :-1 s=READY pgs=2145 cs=0 l=1 rx=0x7fa6a8002f30 tx=0x7fa6a8007a40).stop 2020-04-22T14:20:21.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.345+0000 7fa6b96f2700 1 -- 172.21.15.103:0/3406378979 shutdown_connections 2020-04-22T14:20:21.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.345+0000 7fa6b96f2700 1 --2- 172.21.15.103:0/3406378979 >> v2:172.21.15.86:3300/0 conn(0x7fa6b40616b0 0x7fa6b4061b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:21.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.345+0000 7fa6b96f2700 1 --2- 172.21.15.103:0/3406378979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6b40b9140 0x7fa6b40aed90 unknown :-1 s=CLOSED pgs=2145 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:21.353 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.345+0000 7fa6b96f2700 1 --2- 172.21.15.103:0/3406378979 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa6b40b3bd0 0x7fa6b40af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:21.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.345+0000 7fa6b96f2700 1 -- 172.21.15.103:0/3406378979 >> 172.21.15.103:0/3406378979 conn(0x7fa6b405b7b0 msgr2=0x7fa6b40b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:21.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.345+0000 7fa6b96f2700 1 -- 172.21.15.103:0/3406378979 shutdown_connections 2020-04-22T14:20:21.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.345+0000 7fa6b96f2700 1 -- 172.21.15.103:0/3406378979 wait complete. 2020-04-22T14:20:21.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.346+0000 7fa6b96f2700 1 Processor -- start 2020-04-22T14:20:21.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.346+0000 7fa6b96f2700 1 -- start start 2020-04-22T14:20:21.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.347+0000 7fa6b96f2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa6b40616b0 0x7fa6b4066090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:21.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.347+0000 7fa6b96f2700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa6b40b3bd0 0x7fa6b4111a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:21.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.347+0000 7fa6b96f2700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa6b40b9140 0x7fa6b4111e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:21.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.347+0000 7fa6b96f2700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6b40ad4d0 con 0x7fa6b40b3bd0 2020-04-22T14:20:21.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.347+0000 7fa6b96f2700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6b40ad770 con 0x7fa6b40616b0 2020-04-22T14:20:21.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.347+0000 7fa6b96f2700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b40ada10 con 0x7fa6b40b9140 2020-04-22T14:20:21.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.347+0000 7fa6b2ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa6b40616b0 0x7fa6b4066090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:21.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.347+0000 7fa6b2ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa6b40616b0 0x7fa6b4066090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58888/0 (socket says 172.21.15.103:58888) 2020-04-22T14:20:21.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.347+0000 7fa6b2ffd700 1 -- 172.21.15.103:0/1409707199 learned_addr learned my addr 172.21.15.103:0/1409707199 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:21.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.347+0000 7fa6b2ffd700 1 -- 172.21.15.103:0/1409707199 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa6b40b9140 msgr2=0x7fa6b4111e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:21.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.347+0000 7fa6b2ffd700 1 --2- 172.21.15.103:0/1409707199 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa6b40b9140 0x7fa6b4111e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:21.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.347+0000 7fa6b2ffd700 1 -- 172.21.15.103:0/1409707199 >> v2:172.21.15.86:3300/0 conn(0x7fa6b40b3bd0 msgr2=0x7fa6b4111a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:21.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.347+0000 7fa6b2ffd700 1 --2- 172.21.15.103:0/1409707199 >> v2:172.21.15.86:3300/0 conn(0x7fa6b40b3bd0 0x7fa6b4111a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:21.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.347+0000 7fa6b2ffd700 1 -- 172.21.15.103:0/1409707199 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b40adeb0 con 0x7fa6b40616b0 2020-04-22T14:20:21.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.347+0000 7fa6b2ffd700 1 --2- 172.21.15.103:0/1409707199 >> v2:172.21.15.103:3300/0 conn(0x7fa6b40616b0 0x7fa6b4066090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa6a8002f30 tx=0x7fa6a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.348+0000 7fa6b2ffd700 1 --2- 172.21.15.103:0/1409707199 >> v2:172.21.15.103:3300/0 conn(0x7fa6b40616b0 0x7fa6b4066090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa6a8002f30 tx=0x7fa6a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.348+0000 7fa6b2ffd700 1 --2- 172.21.15.103:0/1409707199 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6b40616b0 0x7fa6b4066090 secure :-1 s=READY pgs=2146 cs=0 l=1 rx=0x7fa6a8002f30 tx=0x7fa6a8007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:21.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.348+0000 7fa6b2ffd700 1 --2- 172.21.15.103:0/1409707199 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6b40616b0 0x7fa6b4066090 secure :-1 s=THROTTLE_DONE pgs=2146 cs=0 l=1 rx=0x7fa6a8002f30 tx=0x7fa6a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.348+0000 7fa6a3fff700 1 -- 172.21.15.103:0/1409707199 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6a8007170 con 0x7fa6b40616b0 2020-04-22T14:20:21.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.348+0000 7fa6b2ffd700 1 --2- 172.21.15.103:0/1409707199 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6b40616b0 0x7fa6b4066090 secure :-1 s=THROTTLE_DONE pgs=2146 cs=0 l=1 rx=0x7fa6a8002f30 tx=0x7fa6a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.348+0000 7fa6b2ffd700 1 --2- 172.21.15.103:0/1409707199 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6b40616b0 0x7fa6b4066090 secure :-1 s=THROTTLE_DONE pgs=2146 cs=0 l=1 rx=0x7fa6a8002f30 tx=0x7fa6a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.348+0000 7fa6a3fff700 1 -- 172.21.15.103:0/1409707199 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a80072d0 con 0x7fa6b40616b0 2020-04-22T14:20:21.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.348+0000 7fa6b96f2700 1 -- 172.21.15.103:0/1409707199 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6b40ad110 con 0x7fa6b40616b0 2020-04-22T14:20:21.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.348+0000 7fa6a3fff700 1 -- 172.21.15.103:0/1409707199 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6a80056c0 con 0x7fa6b40616b0 2020-04-22T14:20:21.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.348+0000 7fa6b96f2700 1 -- 172.21.15.103:0/1409707199 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6b4133df0 con 0x7fa6b40616b0 2020-04-22T14:20:21.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.348+0000 7fa6b2ffd700 1 --2- 172.21.15.103:0/1409707199 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6b40616b0 0x7fa6b4066090 secure :-1 s=THROTTLE_DONE pgs=2146 cs=0 l=1 rx=0x7fa6a8002f30 tx=0x7fa6a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.349+0000 7fa6b96f2700 1 -- 172.21.15.103:0/1409707199 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6b40ad330 con 0x7fa6b40616b0 2020-04-22T14:20:21.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.349+0000 7fa6a3fff700 1 -- 172.21.15.103:0/1409707199 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fa6a8005930 con 0x7fa6b40616b0 2020-04-22T14:20:21.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.349+0000 7fa6b2ffd700 1 --2- 172.21.15.103:0/1409707199 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6b40616b0 0x7fa6b4066090 secure :-1 s=THROTTLE_DONE pgs=2146 cs=0 l=1 rx=0x7fa6a8002f30 tx=0x7fa6a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.349+0000 7fa6a3fff700 1 --2- 172.21.15.103:0/1409707199 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa69004d9a0 0x7fa69004fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:21.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.349+0000 7fa6a3fff700 1 -- 172.21.15.103:0/1409707199 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6202+0+0 (secure 0 0 0) 0x7fa6a8061b90 con 0x7fa6b40616b0 2020-04-22T14:20:21.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.349+0000 7fa6b27fc700 1 --2- 172.21.15.103:0/1409707199 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa69004d9a0 0x7fa69004fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:21.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.350+0000 7fa6b27fc700 1 --2- 172.21.15.103:0/1409707199 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa69004d9a0 0x7fa69004fe60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa6a4002f30 tx=0x7fa6a4008c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.350+0000 7fa6b27fc700 1 --2- 172.21.15.103:0/1409707199 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa69004d9a0 0x7fa69004fe60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa6a4002f30 tx=0x7fa6a4008c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.350+0000 7fa6b27fc700 1 --2- 172.21.15.103:0/1409707199 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa69004d9a0 0x7fa69004fe60 secure :-1 s=READY pgs=778 cs=0 l=1 rx=0x7fa6a4002f30 tx=0x7fa6a4008c70).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:21.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.353+0000 7fa6b2ffd700 1 --2- 172.21.15.103:0/1409707199 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6b40616b0 0x7fa6b4066090 secure :-1 s=THROTTLE_DONE pgs=2146 cs=0 l=1 rx=0x7fa6a8002f30 tx=0x7fa6a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.353+0000 7fa6a3fff700 1 -- 172.21.15.103:0/1409707199 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fa6b40ad330 con 0x7fa6b40616b0 2020-04-22T14:20:21.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.494+0000 7fa6b96f2700 1 -- 172.21.15.103:0/1409707199 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fa6b4056c90 con 0x7fa6b40616b0 2020-04-22T14:20:21.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.494+0000 7fa6b2ffd700 1 --2- 172.21.15.103:0/1409707199 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6b40616b0 0x7fa6b4066090 secure :-1 s=THROTTLE_DONE pgs=2146 cs=0 l=1 rx=0x7fa6a8002f30 tx=0x7fa6a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.497 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.495+0000 7fa6a3fff700 1 -- 172.21.15.103:0/1409707199 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v149) v1 ==== 110+0+10 (secure 0 0 0) 0x7fa6a803d090 con 0x7fa6b40616b0 2020-04-22T14:20:21.497 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:20:21.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.496+0000 7fa6b96f2700 1 -- 172.21.15.103:0/1409707199 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa69004d9a0 msgr2=0x7fa69004fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:21.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.496+0000 7fa6b96f2700 1 --2- 172.21.15.103:0/1409707199 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa69004d9a0 0x7fa69004fe60 secure :-1 s=READY pgs=778 cs=0 l=1 rx=0x7fa6a4002f30 tx=0x7fa6a4008c70).stop 2020-04-22T14:20:21.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.496+0000 7fa6b96f2700 1 -- 172.21.15.103:0/1409707199 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6b40616b0 msgr2=0x7fa6b4066090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:21.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.496+0000 7fa6b96f2700 1 --2- 172.21.15.103:0/1409707199 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6b40616b0 0x7fa6b4066090 secure :-1 s=READY pgs=2146 cs=0 l=1 rx=0x7fa6a8002f30 tx=0x7fa6a8007a40).stop 2020-04-22T14:20:21.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.496+0000 7fa6b96f2700 1 -- 172.21.15.103:0/1409707199 shutdown_connections 2020-04-22T14:20:21.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.496+0000 7fa6b96f2700 1 --2- 172.21.15.103:0/1409707199 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa6b40b9140 0x7fa6b4111e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:21.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.496+0000 7fa6b96f2700 1 --2- 172.21.15.103:0/1409707199 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6b40616b0 0x7fa6b4066090 unknown :-1 s=CLOSED pgs=2146 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:21.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.496+0000 7fa6b96f2700 1 --2- 172.21.15.103:0/1409707199 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa69004d9a0 0x7fa69004fe60 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:21.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.496+0000 7fa6b96f2700 1 --2- 172.21.15.103:0/1409707199 >> v2:172.21.15.86:3300/0 conn(0x7fa6b40b3bd0 0x7fa6b4111a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:21.499 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.496+0000 7fa6b96f2700 1 -- 172.21.15.103:0/1409707199 >> 172.21.15.103:0/1409707199 conn(0x7fa6b405b7b0 msgr2=0x7fa6b4140240 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:21.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.496+0000 7fa6b96f2700 1 -- 172.21.15.103:0/1409707199 shutdown_connections 2020-04-22T14:20:21.500 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.496+0000 7fa6b96f2700 1 -- 172.21.15.103:0/1409707199 wait complete. 2020-04-22T14:20:21.508 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:21.521 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:20:21.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.669+0000 7fb45b793700 1 Processor -- start 2020-04-22T14:20:21.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.669+0000 7fb45b793700 1 -- start start 2020-04-22T14:20:21.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.669+0000 7fb45b793700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb4540b9140 0x7fb45412b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:21.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.670+0000 7fb45b793700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4540ac950 0x7fb45412b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:21.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.670+0000 7fb45b793700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb454146c40 0x7fb4541470f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:21.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.670+0000 7fb45b793700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4540602f0 con 0x7fb4540b9140 2020-04-22T14:20:21.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.670+0000 7fb45b793700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4541467e0 con 0x7fb454146c40 2020-04-22T14:20:21.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.670+0000 7fb45b793700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb454060050 con 0x7fb4540ac950 2020-04-22T14:20:21.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.670+0000 7fb459d30700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb454146c40 0x7fb4541470f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:21.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.670+0000 7fb459d30700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb454146c40 0x7fb4541470f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58896/0 (socket says 172.21.15.103:58896) 2020-04-22T14:20:21.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.670+0000 7fb459d30700 1 -- 172.21.15.103:0/3913081684 learned_addr learned my addr 172.21.15.103:0/3913081684 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:21.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.670+0000 7fb45952f700 1 --2- 172.21.15.103:0/3913081684 >> v2:172.21.15.86:3300/0 conn(0x7fb4540b9140 0x7fb45412b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:21.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.670+0000 7fb458d2e700 1 --2- 172.21.15.103:0/3913081684 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4540ac950 0x7fb45412b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:21.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.670+0000 7fb459d30700 1 -- 172.21.15.103:0/3913081684 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4540ac950 msgr2=0x7fb45412b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:21.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.670+0000 7fb459d30700 1 --2- 172.21.15.103:0/3913081684 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4540ac950 0x7fb45412b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:21.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.670+0000 7fb459d30700 1 -- 172.21.15.103:0/3913081684 >> v2:172.21.15.86:3300/0 conn(0x7fb4540b9140 msgr2=0x7fb45412b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:21.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.670+0000 7fb459d30700 1 --2- 172.21.15.103:0/3913081684 >> v2:172.21.15.86:3300/0 conn(0x7fb4540b9140 0x7fb45412b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:21.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.670+0000 7fb459d30700 1 -- 172.21.15.103:0/3913081684 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4540b9520 con 0x7fb454146c40 2020-04-22T14:20:21.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.670+0000 7fb45952f700 1 --2- 172.21.15.103:0/3913081684 >> v2:172.21.15.86:3300/0 conn(0x7fb4540b9140 0x7fb45412b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:20:21.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.670+0000 7fb458d2e700 1 --2- 172.21.15.103:0/3913081684 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4540ac950 0x7fb45412b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:20:21.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.670+0000 7fb459d30700 1 --2- 172.21.15.103:0/3913081684 >> v2:172.21.15.103:3300/0 conn(0x7fb454146c40 0x7fb4541470f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb44c0032b0 tx=0x7fb44c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.670+0000 7fb459d30700 1 --2- 172.21.15.103:0/3913081684 >> v2:172.21.15.103:3300/0 conn(0x7fb454146c40 0x7fb4541470f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb44c0032b0 tx=0x7fb44c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.670+0000 7fb459d30700 1 --2- 172.21.15.103:0/3913081684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb454146c40 0x7fb4541470f0 secure :-1 s=READY pgs=2147 cs=0 l=1 rx=0x7fb44c0032b0 tx=0x7fb44c007dc0).ready entity=mon.1 client_cookie=54102bd3931b4276 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:21.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.670+0000 7fb459d30700 1 --2- 172.21.15.103:0/3913081684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb454146c40 0x7fb4541470f0 secure :-1 s=THROTTLE_DONE pgs=2147 cs=0 l=1 rx=0x7fb44c0032b0 tx=0x7fb44c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.670+0000 7fb443fff700 1 -- 172.21.15.103:0/3913081684 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb44c00a180 con 0x7fb454146c40 2020-04-22T14:20:21.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.670+0000 7fb459d30700 1 --2- 172.21.15.103:0/3913081684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb454146c40 0x7fb4541470f0 secure :-1 s=THROTTLE_DONE pgs=2147 cs=0 l=1 rx=0x7fb44c0032b0 tx=0x7fb44c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.677 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.670+0000 7fb443fff700 1 -- 172.21.15.103:0/3913081684 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44c00a2e0 con 0x7fb454146c40 2020-04-22T14:20:21.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.670+0000 7fb459d30700 1 --2- 172.21.15.103:0/3913081684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb454146c40 0x7fb4541470f0 secure :-1 s=THROTTLE_DONE pgs=2147 cs=0 l=1 rx=0x7fb44c0032b0 tx=0x7fb44c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.670+0000 7fb443fff700 1 -- 172.21.15.103:0/3913081684 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb44c00a700 con 0x7fb454146c40 2020-04-22T14:20:21.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.670+0000 7fb45b793700 1 -- 172.21.15.103:0/3913081684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb454146c40 msgr2=0x7fb4541470f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:21.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.670+0000 7fb45b793700 1 --2- 172.21.15.103:0/3913081684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb454146c40 0x7fb4541470f0 secure :-1 s=READY pgs=2147 cs=0 l=1 rx=0x7fb44c0032b0 tx=0x7fb44c007dc0).stop 2020-04-22T14:20:21.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.671+0000 7fb45b793700 1 -- 172.21.15.103:0/3913081684 shutdown_connections 2020-04-22T14:20:21.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.671+0000 7fb45b793700 1 --2- 172.21.15.103:0/3913081684 >> v2:172.21.15.86:3300/0 conn(0x7fb4540b9140 0x7fb45412b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:21.678 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.671+0000 7fb45b793700 1 --2- 172.21.15.103:0/3913081684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb454146c40 0x7fb4541470f0 unknown :-1 s=CLOSED pgs=2147 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:21.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.671+0000 7fb45b793700 1 --2- 172.21.15.103:0/3913081684 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4540ac950 0x7fb45412b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:21.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.671+0000 7fb45b793700 1 -- 172.21.15.103:0/3913081684 >> 172.21.15.103:0/3913081684 conn(0x7fb45405b7b0 msgr2=0x7fb4540b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:21.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.671+0000 7fb45b793700 1 -- 172.21.15.103:0/3913081684 shutdown_connections 2020-04-22T14:20:21.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.671+0000 7fb45b793700 1 -- 172.21.15.103:0/3913081684 wait complete. 2020-04-22T14:20:21.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.672+0000 7fb45b793700 1 Processor -- start 2020-04-22T14:20:21.679 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.672+0000 7fb45b793700 1 -- start start 2020-04-22T14:20:21.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.672+0000 7fb45b793700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb4540b9140 0x7fb4541538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:21.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.673+0000 7fb45b793700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb454146c40 0x7fb454128120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:21.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.673+0000 7fb45b793700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb454128580 con 0x7fb4540ac950 2020-04-22T14:20:21.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.673+0000 7fb45b793700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb454153f10 con 0x7fb4540b9140 2020-04-22T14:20:21.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.673+0000 7fb45b793700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4541541b0 con 0x7fb454146c40 2020-04-22T14:20:21.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.673+0000 7fb458d2e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb4540b9140 0x7fb4541538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:21.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.673+0000 7fb458d2e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb4540b9140 0x7fb4541538f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58902/0 (socket says 172.21.15.103:58902) 2020-04-22T14:20:21.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.673+0000 7fb458d2e700 1 -- 172.21.15.103:0/2893706807 learned_addr learned my addr 172.21.15.103:0/2893706807 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:21.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.673+0000 7fb45952f700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb4540ac950 0x7fb454061790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51090/0 (socket says 172.21.15.103:51090) 2020-04-22T14:20:21.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.673+0000 7fb459d30700 1 --2- 172.21.15.103:0/2893706807 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb454146c40 0x7fb454128120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:21.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.673+0000 7fb458d2e700 1 -- 172.21.15.103:0/2893706807 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb454146c40 msgr2=0x7fb454128120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:21.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.673+0000 7fb458d2e700 1 --2- 172.21.15.103:0/2893706807 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb454146c40 0x7fb454128120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:21.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.673+0000 7fb458d2e700 1 -- 172.21.15.103:0/2893706807 >> v1:172.21.15.103:6789/0 conn(0x7fb4540ac950 legacy=0x7fb454061790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:21.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.673+0000 7fb4427fc700 1 -- 172.21.15.103:0/2893706807 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3406644976 0 0) 0x7fb444001ec0 con 0x7fb4540ac950 2020-04-22T14:20:21.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.673+0000 7fb458d2e700 1 -- 172.21.15.103:0/2893706807 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4540b6000 con 0x7fb4540b9140 2020-04-22T14:20:21.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.673+0000 7fb458d2e700 1 --2- 172.21.15.103:0/2893706807 >> v2:172.21.15.103:3300/0 conn(0x7fb4540b9140 0x7fb4541538f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb450002f30 tx=0x7fb450010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.673+0000 7fb458d2e700 1 --2- 172.21.15.103:0/2893706807 >> v2:172.21.15.103:3300/0 conn(0x7fb4540b9140 0x7fb4541538f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb450002f30 tx=0x7fb450010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.673+0000 7fb458d2e700 1 --2- 172.21.15.103:0/2893706807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4540b9140 0x7fb4541538f0 secure :-1 s=READY pgs=2149 cs=0 l=1 rx=0x7fb450002f30 tx=0x7fb450010b70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:21.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.673+0000 7fb458d2e700 1 --2- 172.21.15.103:0/2893706807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4540b9140 0x7fb4541538f0 secure :-1 s=THROTTLE_DONE pgs=2149 cs=0 l=1 rx=0x7fb450002f30 tx=0x7fb450010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.673+0000 7fb4427fc700 1 -- 172.21.15.103:0/2893706807 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb450007180 con 0x7fb4540b9140 2020-04-22T14:20:21.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.673+0000 7fb458d2e700 1 --2- 172.21.15.103:0/2893706807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4540b9140 0x7fb4541538f0 secure :-1 s=THROTTLE_DONE pgs=2149 cs=0 l=1 rx=0x7fb450002f30 tx=0x7fb450010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.673+0000 7fb4427fc700 1 -- 172.21.15.103:0/2893706807 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4500072e0 con 0x7fb4540b9140 2020-04-22T14:20:21.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.673+0000 7fb458d2e700 1 --2- 172.21.15.103:0/2893706807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4540b9140 0x7fb4541538f0 secure :-1 s=THROTTLE_DONE pgs=2149 cs=0 l=1 rx=0x7fb450002f30 tx=0x7fb450010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.673+0000 7fb45b793700 1 -- 172.21.15.103:0/2893706807 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb454061ea0 con 0x7fb4540b9140 2020-04-22T14:20:21.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.673+0000 7fb4427fc700 1 -- 172.21.15.103:0/2893706807 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4500059c0 con 0x7fb4540b9140 2020-04-22T14:20:21.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.673+0000 7fb45b793700 1 -- 172.21.15.103:0/2893706807 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb454062340 con 0x7fb4540b9140 2020-04-22T14:20:21.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.674+0000 7fb458d2e700 1 --2- 172.21.15.103:0/2893706807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4540b9140 0x7fb4541538f0 secure :-1 s=THROTTLE_DONE pgs=2149 cs=0 l=1 rx=0x7fb450002f30 tx=0x7fb450010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.674+0000 7fb4427fc700 1 -- 172.21.15.103:0/2893706807 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fb450005c00 con 0x7fb4540b9140 2020-04-22T14:20:21.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.674+0000 7fb458d2e700 1 --2- 172.21.15.103:0/2893706807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4540b9140 0x7fb4541538f0 secure :-1 s=THROTTLE_DONE pgs=2149 cs=0 l=1 rx=0x7fb450002f30 tx=0x7fb450010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.674+0000 7fb45b793700 1 -- 172.21.15.103:0/2893706807 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb454153d50 con 0x7fb4540b9140 2020-04-22T14:20:21.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.675+0000 7fb4427fc700 1 --2- 172.21.15.103:0/2893706807 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb43404d8b0 0x7fb43404fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:21.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.675+0000 7fb4427fc700 1 -- 172.21.15.103:0/2893706807 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6202+0+0 (secure 0 0 0) 0x7fb450061410 con 0x7fb4540b9140 2020-04-22T14:20:21.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.675+0000 7fb45952f700 1 --2- 172.21.15.103:0/2893706807 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb43404d8b0 0x7fb43404fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:21.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.675+0000 7fb45952f700 1 --2- 172.21.15.103:0/2893706807 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb43404d8b0 0x7fb43404fd70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb444003070 tx=0x7fb444002530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.675+0000 7fb45952f700 1 --2- 172.21.15.103:0/2893706807 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb43404d8b0 0x7fb43404fd70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb444003070 tx=0x7fb444002530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.675+0000 7fb45952f700 1 --2- 172.21.15.103:0/2893706807 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb43404d8b0 0x7fb43404fd70 secure :-1 s=READY pgs=779 cs=0 l=1 rx=0x7fb444003070 tx=0x7fb444002530).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:21.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.679+0000 7fb458d2e700 1 --2- 172.21.15.103:0/2893706807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4540b9140 0x7fb4541538f0 secure :-1 s=THROTTLE_DONE pgs=2149 cs=0 l=1 rx=0x7fb450002f30 tx=0x7fb450010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.679+0000 7fb4427fc700 1 -- 172.21.15.103:0/2893706807 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fb45003c790 con 0x7fb4540b9140 2020-04-22T14:20:21.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.821+0000 7fb45b793700 1 -- 172.21.15.103:0/2893706807 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb454154810 con 0x7fb4540b9140 2020-04-22T14:20:21.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.821+0000 7fb458d2e700 1 --2- 172.21.15.103:0/2893706807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4540b9140 0x7fb4541538f0 secure :-1 s=THROTTLE_DONE pgs=2149 cs=0 l=1 rx=0x7fb450002f30 tx=0x7fb450010b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:21.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.822+0000 7fb4427fc700 1 -- 172.21.15.103:0/2893706807 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v149) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb45003fdb0 con 0x7fb4540b9140 2020-04-22T14:20:21.824 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:20:21.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.823+0000 7fb45b793700 1 -- 172.21.15.103:0/2893706807 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb43404d8b0 msgr2=0x7fb43404fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:21.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.823+0000 7fb45b793700 1 --2- 172.21.15.103:0/2893706807 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb43404d8b0 0x7fb43404fd70 secure :-1 s=READY pgs=779 cs=0 l=1 rx=0x7fb444003070 tx=0x7fb444002530).stop 2020-04-22T14:20:21.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.823+0000 7fb45b793700 1 -- 172.21.15.103:0/2893706807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4540b9140 msgr2=0x7fb4541538f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:21.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.823+0000 7fb45b793700 1 --2- 172.21.15.103:0/2893706807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4540b9140 0x7fb4541538f0 secure :-1 s=READY pgs=2149 cs=0 l=1 rx=0x7fb450002f30 tx=0x7fb450010b70).stop 2020-04-22T14:20:21.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.823+0000 7fb45b793700 1 -- 172.21.15.103:0/2893706807 shutdown_connections 2020-04-22T14:20:21.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.823+0000 7fb45b793700 1 --2- 172.21.15.103:0/2893706807 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fb43404d8b0 0x7fb43404fd70 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:21.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.823+0000 7fb45b793700 1 --2- 172.21.15.103:0/2893706807 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb454146c40 0x7fb454128120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:21.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.823+0000 7fb45b793700 1 --2- 172.21.15.103:0/2893706807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4540b9140 0x7fb4541538f0 unknown :-1 s=CLOSED pgs=2149 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:21.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.823+0000 7fb45b793700 1 -- 172.21.15.103:0/2893706807 >> 172.21.15.103:0/2893706807 conn(0x7fb45405b7b0 msgr2=0x7fb454140960 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:21.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.823+0000 7fb45b793700 1 -- 172.21.15.103:0/2893706807 shutdown_connections 2020-04-22T14:20:21.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.823+0000 7fb45b793700 1 -- 172.21.15.103:0/2893706807 wait complete. 2020-04-22T14:20:21.835 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:21.848 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-22T14:20:21.996 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.994+0000 7fcd32230700 1 Processor -- start 2020-04-22T14:20:21.996 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.994+0000 7fcd32230700 1 -- start start 2020-04-22T14:20:22.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.995+0000 7fcd32230700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcd2c143090 0x7fcd2c143520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:22.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.995+0000 7fcd32230700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd2c1467e0 con 0x7fcd2c0ac950 2020-04-22T14:20:22.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.995+0000 7fcd32230700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd2c060050 con 0x7fcd2c0b9140 2020-04-22T14:20:22.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.995+0000 7fcd32230700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd2c0602f0 con 0x7fcd2c143090 2020-04-22T14:20:22.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.995+0000 7fcd2b7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fcd2c0b9140 0x7fcd2c12b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51098/0 (socket says 172.21.15.103:51098) 2020-04-22T14:20:22.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.995+0000 7fcd2b7fe700 1 -- 172.21.15.103:0/1344875267 learned_addr learned my addr 172.21.15.103:0/1344875267 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:22.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.995+0000 7fcd2bfff700 1 --2- 172.21.15.103:0/1344875267 >> v2:172.21.15.86:3300/0 conn(0x7fcd2c143090 0x7fcd2c143520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:22.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.995+0000 7fcd2a7fc700 1 -- 172.21.15.103:0/1344875267 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2819915424 0 0) 0x7fcd2c060050 con 0x7fcd2c0b9140 2020-04-22T14:20:22.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.995+0000 7fcd2a7fc700 1 -- 172.21.15.103:0/1344875267 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd18003230 con 0x7fcd2c0b9140 2020-04-22T14:20:22.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.996+0000 7fcd2a7fc700 1 -- 172.21.15.103:0/1344875267 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2644582793 0 0) 0x7fcd18003230 con 0x7fcd2c0b9140 2020-04-22T14:20:22.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.996+0000 7fcd2a7fc700 1 -- 172.21.15.103:0/1344875267 >> v2:172.21.15.86:3300/0 conn(0x7fcd2c143090 msgr2=0x7fcd2c143520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:22.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.996+0000 7fcd2a7fc700 1 --2- 172.21.15.103:0/1344875267 >> v2:172.21.15.86:3300/0 conn(0x7fcd2c143090 0x7fcd2c143520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:22.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.996+0000 7fcd2a7fc700 1 -- 172.21.15.103:0/1344875267 >> v1:172.21.15.86:6789/0 conn(0x7fcd2c0ac950 legacy=0x7fcd2c146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:22.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.996+0000 7fcd2a7fc700 1 -- 172.21.15.103:0/1344875267 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd2c0b9520 con 0x7fcd2c0b9140 2020-04-22T14:20:22.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.996+0000 7fcd2a7fc700 1 -- 172.21.15.103:0/1344875267 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fcd1c001710 con 0x7fcd2c0b9140 2020-04-22T14:20:22.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.996+0000 7fcd2a7fc700 1 -- 172.21.15.103:0/1344875267 >> v1:172.21.15.103:6789/0 conn(0x7fcd2c0b9140 legacy=0x7fcd2c12b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:22.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.996+0000 7fcd2a7fc700 1 --2- 172.21.15.103:0/1344875267 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd18003720 0x7fcd18003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:22.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.996+0000 7fcd2a7fc700 1 --2- 172.21.15.103:0/1344875267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd180044d0 0x7fcd18004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:22.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.996+0000 7fcd2a7fc700 1 --2- 172.21.15.103:0/1344875267 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd18004db0 0x7fcd1800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:22.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.996+0000 7fcd2a7fc700 1 -- 172.21.15.103:0/1344875267 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c0602f0 con 0x7fcd18004db0 2020-04-22T14:20:22.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.996+0000 7fcd2a7fc700 1 -- 172.21.15.103:0/1344875267 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd180041c0 con 0x7fcd180044d0 2020-04-22T14:20:22.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.996+0000 7fcd2a7fc700 1 -- 172.21.15.103:0/1344875267 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1800bb80 con 0x7fcd18003720 2020-04-22T14:20:22.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.996+0000 7fcd2affd700 1 --2- 172.21.15.103:0/1344875267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd180044d0 0x7fcd18004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:22.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.996+0000 7fcd2bfff700 1 --2- 172.21.15.103:0/1344875267 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd18004db0 0x7fcd1800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:22.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.996+0000 7fcd2b7fe700 1 --2- 172.21.15.103:0/1344875267 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd18003720 0x7fcd18003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:22.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.996+0000 7fcd2affd700 1 -- 172.21.15.103:0/1344875267 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd18003720 msgr2=0x7fcd18003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:22.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.996+0000 7fcd2affd700 1 --2- 172.21.15.103:0/1344875267 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd18003720 0x7fcd18003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:22.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.996+0000 7fcd2affd700 1 -- 172.21.15.103:0/1344875267 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd18004db0 msgr2=0x7fcd1800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:22.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.996+0000 7fcd2affd700 1 --2- 172.21.15.103:0/1344875267 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd18004db0 0x7fcd1800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:22.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.996+0000 7fcd2affd700 1 -- 172.21.15.103:0/1344875267 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd18003230 con 0x7fcd180044d0 2020-04-22T14:20:22.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.996+0000 7fcd2bfff700 1 -- 172.21.15.103:0/1344875267 reap_dead start 2020-04-22T14:20:22.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.996+0000 7fcd2affd700 1 --2- 172.21.15.103:0/1344875267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd180044d0 0x7fcd18004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcd180054a0 tx=0x7fcd2000fd10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.996+0000 7fcd2affd700 1 --2- 172.21.15.103:0/1344875267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd180044d0 0x7fcd18004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcd180054a0 tx=0x7fcd2000fd10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.004 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.996+0000 7fcd2affd700 1 --2- 172.21.15.103:0/1344875267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd180044d0 0x7fcd18004950 secure :-1 s=READY pgs=2151 cs=0 l=1 rx=0x7fcd180054a0 tx=0x7fcd2000fd10).ready entity=mon.1 client_cookie=9e1b82b947db23d8 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:22.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.996+0000 7fcd2affd700 1 --2- 172.21.15.103:0/1344875267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd180044d0 0x7fcd18004950 secure :-1 s=THROTTLE_DONE pgs=2151 cs=0 l=1 rx=0x7fcd180054a0 tx=0x7fcd2000fd10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.996+0000 7fcd2affd700 1 --2- 172.21.15.103:0/1344875267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd180044d0 0x7fcd18004950 secure :-1 s=THROTTLE_DONE pgs=2151 cs=0 l=1 rx=0x7fcd180054a0 tx=0x7fcd2000fd10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.996+0000 7fcd2a7fc700 1 -- 172.21.15.103:0/1344875267 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd20003560 con 0x7fcd180044d0 2020-04-22T14:20:22.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.996+0000 7fcd2affd700 1 --2- 172.21.15.103:0/1344875267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd180044d0 0x7fcd18004950 secure :-1 s=THROTTLE_DONE pgs=2151 cs=0 l=1 rx=0x7fcd180054a0 tx=0x7fcd2000fd10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.996+0000 7fcd2a7fc700 1 -- 172.21.15.103:0/1344875267 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd200036c0 con 0x7fcd180044d0 2020-04-22T14:20:22.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.996+0000 7fcd2a7fc700 1 -- 172.21.15.103:0/1344875267 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd20003aa0 con 0x7fcd180044d0 2020-04-22T14:20:22.005 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.996+0000 7fcd32230700 1 -- 172.21.15.103:0/1344875267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd180044d0 msgr2=0x7fcd18004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:22.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.996+0000 7fcd32230700 1 --2- 172.21.15.103:0/1344875267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd180044d0 0x7fcd18004950 secure :-1 s=READY pgs=2151 cs=0 l=1 rx=0x7fcd180054a0 tx=0x7fcd2000fd10).stop 2020-04-22T14:20:22.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.997+0000 7fcd32230700 1 -- 172.21.15.103:0/1344875267 shutdown_connections 2020-04-22T14:20:22.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.997+0000 7fcd32230700 1 --2- 172.21.15.103:0/1344875267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd180044d0 0x7fcd18004950 unknown :-1 s=CLOSED pgs=2151 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:22.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.997+0000 7fcd32230700 1 -- 172.21.15.103:0/1344875267 >> 172.21.15.103:0/1344875267 conn(0x7fcd2c05b7b0 msgr2=0x7fcd2c0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:22.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.997+0000 7fcd32230700 1 -- 172.21.15.103:0/1344875267 shutdown_connections 2020-04-22T14:20:22.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.997+0000 7fcd32230700 1 -- 172.21.15.103:0/1344875267 wait complete. 2020-04-22T14:20:22.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.998+0000 7fcd32230700 1 Processor -- start 2020-04-22T14:20:22.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.998+0000 7fcd32230700 1 -- start start 2020-04-22T14:20:22.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.999+0000 7fcd32230700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd2c065ba0 0x7fcd2c066020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:22.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.999+0000 7fcd32230700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcd2c13e110 0x7fcd2c13e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:22.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.999+0000 7fcd32230700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd2c153f00 con 0x7fcd180044d0 2020-04-22T14:20:22.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.999+0000 7fcd32230700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd2c154170 con 0x7fcd2c13e110 2020-04-22T14:20:22.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.999+0000 7fcd32230700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c154410 con 0x7fcd2c065ba0 2020-04-22T14:20:22.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.999+0000 7fcd2b7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fcd180044d0 0x7fcd2c1537f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51110/0 (socket says 172.21.15.103:51110) 2020-04-22T14:20:22.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.999+0000 7fcd2b7fe700 1 -- 172.21.15.103:0/1456124948 learned_addr learned my addr 172.21.15.103:0/1456124948 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:22.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.999+0000 7fcd2bfff700 1 --2- 172.21.15.103:0/1456124948 >> v2:172.21.15.103:3300/0 conn(0x7fcd2c13e110 0x7fcd2c13e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:22.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.999+0000 7fcd2affd700 1 --2- 172.21.15.103:0/1456124948 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd2c065ba0 0x7fcd2c066020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:22.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.999+0000 7fcd2bfff700 1 -- 172.21.15.103:0/1456124948 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd2c065ba0 msgr2=0x7fcd2c066020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:22.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.999+0000 7fcd2bfff700 1 --2- 172.21.15.103:0/1456124948 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd2c065ba0 0x7fcd2c066020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:22.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.999+0000 7fcd2bfff700 1 -- 172.21.15.103:0/1456124948 >> v1:172.21.15.103:6789/0 conn(0x7fcd180044d0 legacy=0x7fcd2c1537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:22.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.999+0000 7fcd28ff9700 1 -- 172.21.15.103:0/1456124948 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 711056256 0 0) 0x7fcd2c153f00 con 0x7fcd180044d0 2020-04-22T14:20:22.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.999+0000 7fcd2bfff700 1 -- 172.21.15.103:0/1456124948 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd2c1444b0 con 0x7fcd2c13e110 2020-04-22T14:20:22.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.999+0000 7fcd2bfff700 1 --2- 172.21.15.103:0/1456124948 >> v2:172.21.15.103:3300/0 conn(0x7fcd2c13e110 0x7fcd2c13e5a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcd2c0ae680 tx=0x7fcd24010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.999+0000 7fcd2bfff700 1 --2- 172.21.15.103:0/1456124948 >> v2:172.21.15.103:3300/0 conn(0x7fcd2c13e110 0x7fcd2c13e5a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcd2c0ae680 tx=0x7fcd24010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.999+0000 7fcd2bfff700 1 --2- 172.21.15.103:0/1456124948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd2c13e110 0x7fcd2c13e5a0 secure :-1 s=READY pgs=2153 cs=0 l=1 rx=0x7fcd2c0ae680 tx=0x7fcd24010d10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:22.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.999+0000 7fcd2bfff700 1 --2- 172.21.15.103:0/1456124948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd2c13e110 0x7fcd2c13e5a0 secure :-1 s=THROTTLE_DONE pgs=2153 cs=0 l=1 rx=0x7fcd2c0ae680 tx=0x7fcd24010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.999+0000 7fcd28ff9700 1 -- 172.21.15.103:0/1456124948 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd24005e20 con 0x7fcd2c13e110 2020-04-22T14:20:22.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.999+0000 7fcd2bfff700 1 --2- 172.21.15.103:0/1456124948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd2c13e110 0x7fcd2c13e5a0 secure :-1 s=THROTTLE_DONE pgs=2153 cs=0 l=1 rx=0x7fcd2c0ae680 tx=0x7fcd24010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.999+0000 7fcd2bfff700 1 --2- 172.21.15.103:0/1456124948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd2c13e110 0x7fcd2c13e5a0 secure :-1 s=THROTTLE_DONE pgs=2153 cs=0 l=1 rx=0x7fcd2c0ae680 tx=0x7fcd24010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.999+0000 7fcd28ff9700 1 -- 172.21.15.103:0/1456124948 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd24008700 con 0x7fcd2c13e110 2020-04-22T14:20:22.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.999+0000 7fcd28ff9700 1 -- 172.21.15.103:0/1456124948 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd24008ae0 con 0x7fcd2c13e110 2020-04-22T14:20:22.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:21.999+0000 7fcd32230700 1 -- 172.21.15.103:0/1456124948 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd2c0b2400 con 0x7fcd2c13e110 2020-04-22T14:20:22.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.000+0000 7fcd32230700 1 -- 172.21.15.103:0/1456124948 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd2c0b0b00 con 0x7fcd2c13e110 2020-04-22T14:20:22.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.000+0000 7fcd2bfff700 1 --2- 172.21.15.103:0/1456124948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd2c13e110 0x7fcd2c13e5a0 secure :-1 s=THROTTLE_DONE pgs=2153 cs=0 l=1 rx=0x7fcd2c0ae680 tx=0x7fcd24010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.001+0000 7fcd32230700 1 -- 172.21.15.103:0/1456124948 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd2c154610 con 0x7fcd2c13e110 2020-04-22T14:20:22.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.001+0000 7fcd28ff9700 1 -- 172.21.15.103:0/1456124948 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fcd24008c40 con 0x7fcd2c13e110 2020-04-22T14:20:22.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.001+0000 7fcd2bfff700 1 --2- 172.21.15.103:0/1456124948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd2c13e110 0x7fcd2c13e5a0 secure :-1 s=THROTTLE_DONE pgs=2153 cs=0 l=1 rx=0x7fcd2c0ae680 tx=0x7fcd24010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.001+0000 7fcd28ff9700 1 --2- 172.21.15.103:0/1456124948 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcd0c04d920 0x7fcd0c04fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:22.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.001+0000 7fcd28ff9700 1 -- 172.21.15.103:0/1456124948 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6202+0+0 (secure 0 0 0) 0x7fcd24061320 con 0x7fcd2c13e110 2020-04-22T14:20:22.013 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.001+0000 7fcd2b7fe700 1 --2- 172.21.15.103:0/1456124948 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcd0c04d920 0x7fcd0c04fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:22.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.001+0000 7fcd2b7fe700 1 --2- 172.21.15.103:0/1456124948 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcd0c04d920 0x7fcd0c04fde0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcd1c001970 tx=0x7fcd2c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.001+0000 7fcd2b7fe700 1 --2- 172.21.15.103:0/1456124948 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcd0c04d920 0x7fcd0c04fde0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcd1c001970 tx=0x7fcd2c0b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.001+0000 7fcd2b7fe700 1 --2- 172.21.15.103:0/1456124948 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcd0c04d920 0x7fcd0c04fde0 secure :-1 s=READY pgs=780 cs=0 l=1 rx=0x7fcd1c001970 tx=0x7fcd2c0b96b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:22.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.005+0000 7fcd2bfff700 1 --2- 172.21.15.103:0/1456124948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd2c13e110 0x7fcd2c13e5a0 secure :-1 s=THROTTLE_DONE pgs=2153 cs=0 l=1 rx=0x7fcd2c0ae680 tx=0x7fcd24010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.014 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.005+0000 7fcd28ff9700 1 -- 172.21.15.103:0/1456124948 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fcd2403c6a0 con 0x7fcd2c13e110 2020-04-22T14:20:22.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.145+0000 7fcd32230700 1 -- 172.21.15.103:0/1456124948 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcd2c056c90 con 0x7fcd2c13e110 2020-04-22T14:20:22.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.145+0000 7fcd2bfff700 1 --2- 172.21.15.103:0/1456124948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd2c13e110 0x7fcd2c13e5a0 secure :-1 s=THROTTLE_DONE pgs=2153 cs=0 l=1 rx=0x7fcd2c0ae680 tx=0x7fcd24010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.145+0000 7fcd28ff9700 1 -- 172.21.15.103:0/1456124948 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v149) v1 ==== 104+0+10 (secure 0 0 0) 0x7fcd2403fcc0 con 0x7fcd2c13e110 2020-04-22T14:20:22.148 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:20:22.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.147+0000 7fcd32230700 1 -- 172.21.15.103:0/1456124948 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcd0c04d920 msgr2=0x7fcd0c04fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:22.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.147+0000 7fcd32230700 1 --2- 172.21.15.103:0/1456124948 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcd0c04d920 0x7fcd0c04fde0 secure :-1 s=READY pgs=780 cs=0 l=1 rx=0x7fcd1c001970 tx=0x7fcd2c0b96b0).stop 2020-04-22T14:20:22.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.147+0000 7fcd32230700 1 -- 172.21.15.103:0/1456124948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd2c13e110 msgr2=0x7fcd2c13e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:22.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.147+0000 7fcd32230700 1 --2- 172.21.15.103:0/1456124948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd2c13e110 0x7fcd2c13e5a0 secure :-1 s=READY pgs=2153 cs=0 l=1 rx=0x7fcd2c0ae680 tx=0x7fcd24010d10).stop 2020-04-22T14:20:22.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.147+0000 7fcd32230700 1 -- 172.21.15.103:0/1456124948 shutdown_connections 2020-04-22T14:20:22.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.147+0000 7fcd32230700 1 --2- 172.21.15.103:0/1456124948 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fcd0c04d920 0x7fcd0c04fde0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:22.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.147+0000 7fcd32230700 1 --2- 172.21.15.103:0/1456124948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd2c13e110 0x7fcd2c13e5a0 unknown :-1 s=CLOSED pgs=2153 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:22.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.147+0000 7fcd32230700 1 --2- 172.21.15.103:0/1456124948 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd2c065ba0 0x7fcd2c066020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:22.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.147+0000 7fcd32230700 1 -- 172.21.15.103:0/1456124948 >> 172.21.15.103:0/1456124948 conn(0x7fcd2c05b7b0 msgr2=0x7fcd2c12a600 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:22.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.147+0000 7fcd32230700 1 -- 172.21.15.103:0/1456124948 shutdown_connections 2020-04-22T14:20:22.151 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.147+0000 7fcd32230700 1 -- 172.21.15.103:0/1456124948 wait complete. 2020-04-22T14:20:22.159 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:22.172 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-22T14:20:22.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.320+0000 7f4c2a328700 1 Processor -- start 2020-04-22T14:20:22.322 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.320+0000 7f4c2a328700 1 -- start start 2020-04-22T14:20:22.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.320+0000 7f4c2a328700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4c240b9140 0x7f4c2412b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:22.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.320+0000 7f4c2a328700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4c2412b670 0x7f4c24143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:22.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.320+0000 7f4c2a328700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c241467e0 con 0x7f4c240ac950 2020-04-22T14:20:22.325 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.320+0000 7f4c2a328700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c240602f0 con 0x7f4c240b9140 2020-04-22T14:20:22.326 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.320+0000 7f4c2a328700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c24060050 con 0x7f4c2412b670 2020-04-22T14:20:22.326 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.321+0000 7f4c288c5700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4c2412b670 0x7f4c24143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:22.326 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.321+0000 7f4c288c5700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4c2412b670 0x7f4c24143090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58932/0 (socket says 172.21.15.103:58932) 2020-04-22T14:20:22.326 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.321+0000 7f4c288c5700 1 -- 172.21.15.103:0/2145937010 learned_addr learned my addr 172.21.15.103:0/2145937010 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:22.326 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.321+0000 7f4c23fff700 1 --2- 172.21.15.103:0/2145937010 >> v2:172.21.15.86:3300/0 conn(0x7f4c240b9140 0x7f4c2412b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:22.326 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.321+0000 7f4c288c5700 1 -- 172.21.15.103:0/2145937010 >> v2:172.21.15.86:3300/0 conn(0x7f4c240b9140 msgr2=0x7f4c2412b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:22.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.321+0000 7f4c288c5700 1 --2- 172.21.15.103:0/2145937010 >> v2:172.21.15.86:3300/0 conn(0x7f4c240b9140 0x7f4c2412b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:22.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.321+0000 7f4c288c5700 1 -- 172.21.15.103:0/2145937010 >> v1:172.21.15.86:6789/0 conn(0x7f4c240ac950 legacy=0x7f4c24146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:22.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.321+0000 7f4c288c5700 1 -- 172.21.15.103:0/2145937010 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c240b9520 con 0x7f4c2412b670 2020-04-22T14:20:22.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.321+0000 7f4c23fff700 1 --2- 172.21.15.103:0/2145937010 >> v2:172.21.15.86:3300/0 conn(0x7f4c240b9140 0x7f4c2412b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:20:22.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.321+0000 7f4c288c5700 1 --2- 172.21.15.103:0/2145937010 >> v2:172.21.15.103:3300/0 conn(0x7f4c2412b670 0x7f4c24143090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4c240b6250 tx=0x7f4c1c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.321+0000 7f4c288c5700 1 --2- 172.21.15.103:0/2145937010 >> v2:172.21.15.103:3300/0 conn(0x7f4c2412b670 0x7f4c24143090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4c240b6250 tx=0x7f4c1c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.327 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.321+0000 7f4c288c5700 1 --2- 172.21.15.103:0/2145937010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c2412b670 0x7f4c24143090 secure :-1 s=READY pgs=2154 cs=0 l=1 rx=0x7f4c240b6250 tx=0x7f4c1c007dc0).ready entity=mon.1 client_cookie=e27f24300848c057 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:22.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.321+0000 7f4c288c5700 1 --2- 172.21.15.103:0/2145937010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c2412b670 0x7f4c24143090 secure :-1 s=THROTTLE_DONE pgs=2154 cs=0 l=1 rx=0x7f4c240b6250 tx=0x7f4c1c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.321+0000 7f4c22ffd700 1 -- 172.21.15.103:0/2145937010 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c1c00a180 con 0x7f4c2412b670 2020-04-22T14:20:22.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.321+0000 7f4c288c5700 1 --2- 172.21.15.103:0/2145937010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c2412b670 0x7f4c24143090 secure :-1 s=THROTTLE_DONE pgs=2154 cs=0 l=1 rx=0x7f4c240b6250 tx=0x7f4c1c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.321+0000 7f4c288c5700 1 --2- 172.21.15.103:0/2145937010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c2412b670 0x7f4c24143090 secure :-1 s=THROTTLE_DONE pgs=2154 cs=0 l=1 rx=0x7f4c240b6250 tx=0x7f4c1c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.321+0000 7f4c22ffd700 1 -- 172.21.15.103:0/2145937010 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1c00a2e0 con 0x7f4c2412b670 2020-04-22T14:20:22.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.321+0000 7f4c22ffd700 1 -- 172.21.15.103:0/2145937010 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c1c00a6c0 con 0x7f4c2412b670 2020-04-22T14:20:22.328 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.321+0000 7f4c2a328700 1 -- 172.21.15.103:0/2145937010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c2412b670 msgr2=0x7f4c24143090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:22.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.321+0000 7f4c2a328700 1 --2- 172.21.15.103:0/2145937010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c2412b670 0x7f4c24143090 secure :-1 s=READY pgs=2154 cs=0 l=1 rx=0x7f4c240b6250 tx=0x7f4c1c007dc0).stop 2020-04-22T14:20:22.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.322+0000 7f4c2a328700 1 -- 172.21.15.103:0/2145937010 shutdown_connections 2020-04-22T14:20:22.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.322+0000 7f4c2a328700 1 --2- 172.21.15.103:0/2145937010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c2412b670 0x7f4c24143090 unknown :-1 s=CLOSED pgs=2154 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:22.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.322+0000 7f4c2a328700 1 --2- 172.21.15.103:0/2145937010 >> v2:172.21.15.86:3300/0 conn(0x7f4c240b9140 0x7f4c2412b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:22.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.322+0000 7f4c2a328700 1 -- 172.21.15.103:0/2145937010 >> 172.21.15.103:0/2145937010 conn(0x7f4c2405b7b0 msgr2=0x7f4c240b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:22.329 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.322+0000 7f4c2a328700 1 -- 172.21.15.103:0/2145937010 shutdown_connections 2020-04-22T14:20:22.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.322+0000 7f4c2a328700 1 -- 172.21.15.103:0/2145937010 wait complete. 2020-04-22T14:20:22.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.323+0000 7f4c2a328700 1 Processor -- start 2020-04-22T14:20:22.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.323+0000 7f4c2a328700 1 -- start start 2020-04-22T14:20:22.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.323+0000 7f4c2a328700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4c240b9140 0x7f4c240b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:22.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.323+0000 7f4c2a328700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4c2412b670 0x7f4c24143ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:22.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.323+0000 7f4c2a328700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c240b3b70 con 0x7f4c240ac950 2020-04-22T14:20:22.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.324+0000 7f4c2a328700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c240b3dd0 con 0x7f4c240b9140 2020-04-22T14:20:22.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.324+0000 7f4c2a328700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c24061ea0 con 0x7f4c2412b670 2020-04-22T14:20:22.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.324+0000 7f4c23fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f4c240ac950 0x7f4c24061790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51124/0 (socket says 172.21.15.103:51124) 2020-04-22T14:20:22.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.324+0000 7f4c23fff700 1 -- 172.21.15.103:0/1110713788 learned_addr learned my addr 172.21.15.103:0/1110713788 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:22.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.324+0000 7f4c288c5700 1 --2- 172.21.15.103:0/1110713788 >> v2:172.21.15.103:3300/0 conn(0x7f4c2412b670 0x7f4c24143ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:22.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.324+0000 7f4c237fe700 1 --2- 172.21.15.103:0/1110713788 >> v2:172.21.15.86:3300/0 conn(0x7f4c240b9140 0x7f4c240b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:22.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.324+0000 7f4c288c5700 1 -- 172.21.15.103:0/1110713788 >> v2:172.21.15.86:3300/0 conn(0x7f4c240b9140 msgr2=0x7f4c240b43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:22.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.324+0000 7f4c288c5700 1 --2- 172.21.15.103:0/1110713788 >> v2:172.21.15.86:3300/0 conn(0x7f4c240b9140 0x7f4c240b43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:22.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.324+0000 7f4c217fa700 1 -- 172.21.15.103:0/1110713788 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1457711458 0 0) 0x7f4c240b3b70 con 0x7f4c240ac950 2020-04-22T14:20:22.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.324+0000 7f4c288c5700 1 -- 172.21.15.103:0/1110713788 >> v1:172.21.15.103:6789/0 conn(0x7f4c240ac950 legacy=0x7f4c24061790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:22.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.324+0000 7f4c288c5700 1 -- 172.21.15.103:0/1110713788 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c24127e70 con 0x7f4c2412b670 2020-04-22T14:20:22.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.324+0000 7f4c288c5700 1 --2- 172.21.15.103:0/1110713788 >> v2:172.21.15.103:3300/0 conn(0x7f4c2412b670 0x7f4c24143ae0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4c240b6250 tx=0x7f4c1c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.324+0000 7f4c288c5700 1 --2- 172.21.15.103:0/1110713788 >> v2:172.21.15.103:3300/0 conn(0x7f4c2412b670 0x7f4c24143ae0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4c240b6250 tx=0x7f4c1c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.324+0000 7f4c288c5700 1 --2- 172.21.15.103:0/1110713788 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c2412b670 0x7f4c24143ae0 secure :-1 s=READY pgs=2156 cs=0 l=1 rx=0x7f4c240b6250 tx=0x7f4c1c007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:22.335 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.324+0000 7f4c288c5700 1 --2- 172.21.15.103:0/1110713788 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c2412b670 0x7f4c24143ae0 secure :-1 s=THROTTLE_DONE pgs=2156 cs=0 l=1 rx=0x7f4c240b6250 tx=0x7f4c1c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.324+0000 7f4c217fa700 1 -- 172.21.15.103:0/1110713788 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c1c00a7a0 con 0x7f4c2412b670 2020-04-22T14:20:22.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.324+0000 7f4c288c5700 1 --2- 172.21.15.103:0/1110713788 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c2412b670 0x7f4c24143ae0 secure :-1 s=THROTTLE_DONE pgs=2156 cs=0 l=1 rx=0x7f4c240b6250 tx=0x7f4c1c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.324+0000 7f4c288c5700 1 --2- 172.21.15.103:0/1110713788 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c2412b670 0x7f4c24143ae0 secure :-1 s=THROTTLE_DONE pgs=2156 cs=0 l=1 rx=0x7f4c240b6250 tx=0x7f4c1c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.324+0000 7f4c217fa700 1 -- 172.21.15.103:0/1110713788 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1c005c30 con 0x7f4c2412b670 2020-04-22T14:20:22.336 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.324+0000 7f4c2a328700 1 -- 172.21.15.103:0/1110713788 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c24128060 con 0x7f4c2412b670 2020-04-22T14:20:22.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.324+0000 7f4c217fa700 1 -- 172.21.15.103:0/1110713788 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c1c005e20 con 0x7f4c2412b670 2020-04-22T14:20:22.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.324+0000 7f4c2a328700 1 -- 172.21.15.103:0/1110713788 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c241284c0 con 0x7f4c2412b670 2020-04-22T14:20:22.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.325+0000 7f4c288c5700 1 --2- 172.21.15.103:0/1110713788 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c2412b670 0x7f4c24143ae0 secure :-1 s=THROTTLE_DONE pgs=2156 cs=0 l=1 rx=0x7f4c240b6250 tx=0x7f4c1c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.325+0000 7f4c2a328700 1 -- 172.21.15.103:0/1110713788 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c24056c90 con 0x7f4c2412b670 2020-04-22T14:20:22.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.325+0000 7f4c217fa700 1 -- 172.21.15.103:0/1110713788 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f4c1c00f7a0 con 0x7f4c2412b670 2020-04-22T14:20:22.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.325+0000 7f4c288c5700 1 --2- 172.21.15.103:0/1110713788 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c2412b670 0x7f4c24143ae0 secure :-1 s=THROTTLE_DONE pgs=2156 cs=0 l=1 rx=0x7f4c240b6250 tx=0x7f4c1c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.337 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.325+0000 7f4c217fa700 1 --2- 172.21.15.103:0/1110713788 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4c0404d8c0 0x7f4c0404fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:22.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.326+0000 7f4c217fa700 1 -- 172.21.15.103:0/1110713788 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f4c1c0622b0 con 0x7f4c2412b670 2020-04-22T14:20:22.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.326+0000 7f4c23fff700 1 --2- 172.21.15.103:0/1110713788 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4c0404d8c0 0x7f4c0404fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:22.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.326+0000 7f4c23fff700 1 --2- 172.21.15.103:0/1110713788 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4c0404d8c0 0x7f4c0404fd80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4c14003070 tx=0x7f4c140024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.326+0000 7f4c23fff700 1 --2- 172.21.15.103:0/1110713788 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4c0404d8c0 0x7f4c0404fd80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4c14003070 tx=0x7f4c140024d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.326+0000 7f4c23fff700 1 --2- 172.21.15.103:0/1110713788 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4c0404d8c0 0x7f4c0404fd80 secure :-1 s=READY pgs=781 cs=0 l=1 rx=0x7f4c14003070 tx=0x7f4c140024d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:22.338 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.330+0000 7f4c288c5700 1 --2- 172.21.15.103:0/1110713788 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c2412b670 0x7f4c24143ae0 secure :-1 s=THROTTLE_DONE pgs=2156 cs=0 l=1 rx=0x7f4c240b6250 tx=0x7f4c1c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.339 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.330+0000 7f4c217fa700 1 -- 172.21.15.103:0/1110713788 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f4c1c03d7b0 con 0x7f4c2412b670 2020-04-22T14:20:22.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.472+0000 7f4c2a328700 1 -- 172.21.15.103:0/1110713788 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4c240b3f10 con 0x7f4c2412b670 2020-04-22T14:20:22.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.475+0000 7f4c288c5700 1 --2- 172.21.15.103:0/1110713788 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c2412b670 0x7f4c24143ae0 secure :-1 s=THROTTLE_DONE pgs=2156 cs=0 l=1 rx=0x7f4c240b6250 tx=0x7f4c1c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.475+0000 7f4c217fa700 1 -- 172.21.15.103:0/1110713788 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v149) v1 ==== 100+0+10 (secure 0 0 0) 0x7f4c1c040dd0 con 0x7f4c2412b670 2020-04-22T14:20:22.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.476+0000 7f4c2a328700 1 -- 172.21.15.103:0/1110713788 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4c0404d8c0 msgr2=0x7f4c0404fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:22.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.476+0000 7f4c2a328700 1 --2- 172.21.15.103:0/1110713788 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4c0404d8c0 0x7f4c0404fd80 secure :-1 s=READY pgs=781 cs=0 l=1 rx=0x7f4c14003070 tx=0x7f4c140024d0).stop 2020-04-22T14:20:22.482 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.476+0000 7f4c2a328700 1 -- 172.21.15.103:0/1110713788 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c2412b670 msgr2=0x7f4c24143ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:22.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.476+0000 7f4c2a328700 1 --2- 172.21.15.103:0/1110713788 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c2412b670 0x7f4c24143ae0 secure :-1 s=READY pgs=2156 cs=0 l=1 rx=0x7f4c240b6250 tx=0x7f4c1c007dc0).stop 2020-04-22T14:20:22.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.476+0000 7f4c2a328700 1 -- 172.21.15.103:0/1110713788 shutdown_connections 2020-04-22T14:20:22.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.476+0000 7f4c2a328700 1 --2- 172.21.15.103:0/1110713788 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c2412b670 0x7f4c24143ae0 unknown :-1 s=CLOSED pgs=2156 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:22.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.476+0000 7f4c2a328700 1 --2- 172.21.15.103:0/1110713788 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4c0404d8c0 0x7f4c0404fd80 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:22.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.476+0000 7f4c2a328700 1 --2- 172.21.15.103:0/1110713788 >> v2:172.21.15.86:3300/0 conn(0x7f4c240b9140 0x7f4c240b43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:22.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.476+0000 7f4c2a328700 1 -- 172.21.15.103:0/1110713788 >> 172.21.15.103:0/1110713788 conn(0x7f4c2405b7b0 msgr2=0x7f4c240ae640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:22.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.476+0000 7f4c2a328700 1 -- 172.21.15.103:0/1110713788 shutdown_connections 2020-04-22T14:20:22.484 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.476+0000 7f4c2a328700 1 -- 172.21.15.103:0/1110713788 wait complete. 2020-04-22T14:20:22.484 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:20:22.489 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-04-22T14:20:22.489 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:22.502 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:20:22.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.645+0000 7fadc359e700 1 Processor -- start 2020-04-22T14:20:22.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.645+0000 7fadc359e700 1 -- start start 2020-04-22T14:20:22.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.646+0000 7fadc359e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fadc4146ad0 0x7fadc4146f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:22.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.646+0000 7fadc359e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fadc40ad900 0x7fadc40addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:22.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.646+0000 7fadc359e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc4143810 con 0x7fadc40620a0 2020-04-22T14:20:22.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.646+0000 7fadc359e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadc41473b0 con 0x7fadc40ad900 2020-04-22T14:20:22.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.646+0000 7fadc359e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc4143ab0 con 0x7fadc4146ad0 2020-04-22T14:20:22.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.647+0000 7fadc2d9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fadc40ad900 0x7fadc40addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:22.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.647+0000 7fadc259c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fadc40620a0 0x7fadc4142e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51132/0 (socket says 172.21.15.103:51132) 2020-04-22T14:20:22.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.647+0000 7fadc259c700 1 -- 172.21.15.103:0/275128472 learned_addr learned my addr 172.21.15.103:0/275128472 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:22.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.647+0000 7fadc1d9b700 1 --2- 172.21.15.103:0/275128472 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fadc4146ad0 0x7fadc4146f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:22.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.647+0000 7fadc2d9d700 1 -- 172.21.15.103:0/275128472 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fadc4146ad0 msgr2=0x7fadc4146f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:22.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.647+0000 7fadc2d9d700 1 --2- 172.21.15.103:0/275128472 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fadc4146ad0 0x7fadc4146f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:22.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.647+0000 7fadc2d9d700 1 -- 172.21.15.103:0/275128472 >> v1:172.21.15.103:6789/0 conn(0x7fadc40620a0 legacy=0x7fadc4142e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:22.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.647+0000 7fadc159a700 1 -- 172.21.15.103:0/275128472 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 512874078 0 0) 0x7fadc4143810 con 0x7fadc40620a0 2020-04-22T14:20:22.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.647+0000 7fadc2d9d700 1 -- 172.21.15.103:0/275128472 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc4143d50 con 0x7fadc40ad900 2020-04-22T14:20:22.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.647+0000 7fadc1d9b700 1 --2- 172.21.15.103:0/275128472 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fadc4146ad0 0x7fadc4146f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:20:22.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.647+0000 7fadc2d9d700 1 --2- 172.21.15.103:0/275128472 >> v2:172.21.15.103:3300/0 conn(0x7fadc40ad900 0x7fadc40addb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fadbc0032b0 tx=0x7fadbc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.647+0000 7fadc2d9d700 1 --2- 172.21.15.103:0/275128472 >> v2:172.21.15.103:3300/0 conn(0x7fadc40ad900 0x7fadc40addb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fadbc0032b0 tx=0x7fadbc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.647+0000 7fadc2d9d700 1 --2- 172.21.15.103:0/275128472 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fadc40ad900 0x7fadc40addb0 secure :-1 s=READY pgs=2158 cs=0 l=1 rx=0x7fadbc0032b0 tx=0x7fadbc007dc0).ready entity=mon.1 client_cookie=4b0ffa3a5fab9801 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:22.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.647+0000 7fadc2d9d700 1 --2- 172.21.15.103:0/275128472 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fadc40ad900 0x7fadc40addb0 secure :-1 s=THROTTLE_DONE pgs=2158 cs=0 l=1 rx=0x7fadbc0032b0 tx=0x7fadbc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.647+0000 7fadc159a700 1 -- 172.21.15.103:0/275128472 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadbc010e60 con 0x7fadc40ad900 2020-04-22T14:20:22.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.647+0000 7fadc2d9d700 1 --2- 172.21.15.103:0/275128472 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fadc40ad900 0x7fadc40addb0 secure :-1 s=THROTTLE_DONE pgs=2158 cs=0 l=1 rx=0x7fadbc0032b0 tx=0x7fadbc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.647+0000 7fadc159a700 1 -- 172.21.15.103:0/275128472 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadbc0110d0 con 0x7fadc40ad900 2020-04-22T14:20:22.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.647+0000 7fadc2d9d700 1 --2- 172.21.15.103:0/275128472 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fadc40ad900 0x7fadc40addb0 secure :-1 s=THROTTLE_DONE pgs=2158 cs=0 l=1 rx=0x7fadbc0032b0 tx=0x7fadbc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.647+0000 7fadc359e700 1 -- 172.21.15.103:0/275128472 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fadc40ad900 msgr2=0x7fadc40addb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:22.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.647+0000 7fadc159a700 1 -- 172.21.15.103:0/275128472 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadbc0114b0 con 0x7fadc40ad900 2020-04-22T14:20:22.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.647+0000 7fadc359e700 1 --2- 172.21.15.103:0/275128472 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fadc40ad900 0x7fadc40addb0 secure :-1 s=READY pgs=2158 cs=0 l=1 rx=0x7fadbc0032b0 tx=0x7fadbc007dc0).stop 2020-04-22T14:20:22.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.648+0000 7fadc359e700 1 -- 172.21.15.103:0/275128472 shutdown_connections 2020-04-22T14:20:22.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.648+0000 7fadc359e700 1 --2- 172.21.15.103:0/275128472 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fadc40ad900 0x7fadc40addb0 unknown :-1 s=CLOSED pgs=2158 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:22.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.648+0000 7fadc359e700 1 --2- 172.21.15.103:0/275128472 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fadc4146ad0 0x7fadc4146f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:22.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.648+0000 7fadc359e700 1 -- 172.21.15.103:0/275128472 >> 172.21.15.103:0/275128472 conn(0x7fadc405b7c0 msgr2=0x7fadc4061610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:22.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.648+0000 7fadc359e700 1 -- 172.21.15.103:0/275128472 shutdown_connections 2020-04-22T14:20:22.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.648+0000 7fadc359e700 1 -- 172.21.15.103:0/275128472 wait complete. 2020-04-22T14:20:22.673 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.649+0000 7fadc359e700 1 Processor -- start 2020-04-22T14:20:22.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.649+0000 7fadc359e700 1 -- start start 2020-04-22T14:20:22.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.649+0000 7fadc359e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fadc40ad900 0x7fadc4142d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:22.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.649+0000 7fadc359e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fadc4146ad0 0x7fadc40b73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:22.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.649+0000 7fadc359e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc40b7800 con 0x7fadc40620a0 2020-04-22T14:20:22.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.649+0000 7fadc359e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadc4154ed0 con 0x7fadc40ad900 2020-04-22T14:20:22.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.649+0000 7fadc359e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc4155170 con 0x7fadc4146ad0 2020-04-22T14:20:22.674 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.649+0000 7fadc1d9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fadc40ad900 0x7fadc4142d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:22.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.649+0000 7fadc1d9b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fadc40ad900 0x7fadc4142d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58950/0 (socket says 172.21.15.103:58950) 2020-04-22T14:20:22.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.649+0000 7fadc259c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fadc40620a0 0x7fadc4155610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51138/0 (socket says 172.21.15.103:51138) 2020-04-22T14:20:22.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.650+0000 7fadc1d9b700 1 -- 172.21.15.103:0/471107523 learned_addr learned my addr 172.21.15.103:0/471107523 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:22.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.650+0000 7fadc1d9b700 1 -- 172.21.15.103:0/471107523 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fadc4146ad0 msgr2=0x7fadc40b73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:22.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.650+0000 7fadc1d9b700 1 --2- 172.21.15.103:0/471107523 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fadc4146ad0 0x7fadc40b73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:22.675 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.650+0000 7fadbb7fe700 1 -- 172.21.15.103:0/471107523 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2865898082 0 0) 0x7fadb4000fa0 con 0x7fadc40620a0 2020-04-22T14:20:22.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.650+0000 7fadc1d9b700 1 -- 172.21.15.103:0/471107523 >> v1:172.21.15.103:6789/0 conn(0x7fadc40620a0 legacy=0x7fadc4155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:22.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.650+0000 7fadc1d9b700 1 -- 172.21.15.103:0/471107523 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc413dee0 con 0x7fadc40ad900 2020-04-22T14:20:22.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.650+0000 7fadc1d9b700 1 --2- 172.21.15.103:0/471107523 >> v2:172.21.15.103:3300/0 conn(0x7fadc40ad900 0x7fadc4142d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fadac007920 tx=0x7fadac010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.650+0000 7fadc1d9b700 1 --2- 172.21.15.103:0/471107523 >> v2:172.21.15.103:3300/0 conn(0x7fadc40ad900 0x7fadc4142d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fadac007920 tx=0x7fadac010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.650+0000 7fadc1d9b700 1 --2- 172.21.15.103:0/471107523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fadc40ad900 0x7fadc4142d60 secure :-1 s=READY pgs=2160 cs=0 l=1 rx=0x7fadac007920 tx=0x7fadac010c90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:22.676 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.650+0000 7fadc1d9b700 1 --2- 172.21.15.103:0/471107523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fadc40ad900 0x7fadc4142d60 secure :-1 s=THROTTLE_DONE pgs=2160 cs=0 l=1 rx=0x7fadac007920 tx=0x7fadac010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.650+0000 7fadbb7fe700 1 -- 172.21.15.103:0/471107523 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadac0122f0 con 0x7fadc40ad900 2020-04-22T14:20:22.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.650+0000 7fadc1d9b700 1 --2- 172.21.15.103:0/471107523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fadc40ad900 0x7fadc4142d60 secure :-1 s=THROTTLE_DONE pgs=2160 cs=0 l=1 rx=0x7fadac007920 tx=0x7fadac010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.650+0000 7fadc1d9b700 1 --2- 172.21.15.103:0/471107523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fadc40ad900 0x7fadc4142d60 secure :-1 s=THROTTLE_DONE pgs=2160 cs=0 l=1 rx=0x7fadac007920 tx=0x7fadac010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.650+0000 7fadbb7fe700 1 -- 172.21.15.103:0/471107523 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadac012450 con 0x7fadc40ad900 2020-04-22T14:20:22.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.650+0000 7fadc359e700 1 -- 172.21.15.103:0/471107523 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadc4140210 con 0x7fadc40ad900 2020-04-22T14:20:22.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.650+0000 7fadbb7fe700 1 -- 172.21.15.103:0/471107523 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadac0127b0 con 0x7fadc40ad900 2020-04-22T14:20:22.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.650+0000 7fadc359e700 1 -- 172.21.15.103:0/471107523 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc41370f0 con 0x7fadc40ad900 2020-04-22T14:20:22.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.651+0000 7fadc1d9b700 1 --2- 172.21.15.103:0/471107523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fadc40ad900 0x7fadc4142d60 secure :-1 s=THROTTLE_DONE pgs=2160 cs=0 l=1 rx=0x7fadac007920 tx=0x7fadac010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.651+0000 7fadbb7fe700 1 -- 172.21.15.103:0/471107523 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fadac012a20 con 0x7fadc40ad900 2020-04-22T14:20:22.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.651+0000 7fadc1d9b700 1 --2- 172.21.15.103:0/471107523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fadc40ad900 0x7fadc4142d60 secure :-1 s=THROTTLE_DONE pgs=2160 cs=0 l=1 rx=0x7fadac007920 tx=0x7fadac010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.651+0000 7fadc359e700 1 -- 172.21.15.103:0/471107523 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadc4056c90 con 0x7fadc40ad900 2020-04-22T14:20:22.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.651+0000 7fadbb7fe700 1 --2- 172.21.15.103:0/471107523 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fada804d900 0x7fada804fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:22.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.651+0000 7fadbb7fe700 1 -- 172.21.15.103:0/471107523 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6202+0+0 (secure 0 0 0) 0x7fadac061a40 con 0x7fadc40ad900 2020-04-22T14:20:22.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.652+0000 7fadc259c700 1 --2- 172.21.15.103:0/471107523 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fada804d900 0x7fada804fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:22.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.652+0000 7fadc259c700 1 --2- 172.21.15.103:0/471107523 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fada804d900 0x7fada804fdc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fadb4001170 tx=0x7fadb40017f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.652+0000 7fadc259c700 1 --2- 172.21.15.103:0/471107523 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fada804d900 0x7fada804fdc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fadb4001170 tx=0x7fadb40017f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.652+0000 7fadc259c700 1 --2- 172.21.15.103:0/471107523 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fada804d900 0x7fada804fdc0 secure :-1 s=READY pgs=782 cs=0 l=1 rx=0x7fadb4001170 tx=0x7fadb40017f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:22.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.656+0000 7fadc1d9b700 1 --2- 172.21.15.103:0/471107523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fadc40ad900 0x7fadc4142d60 secure :-1 s=THROTTLE_DONE pgs=2160 cs=0 l=1 rx=0x7fadac007920 tx=0x7fadac010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.656+0000 7fadbb7fe700 1 -- 172.21.15.103:0/471107523 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fadac03ce20 con 0x7fadc40ad900 2020-04-22T14:20:22.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.846+0000 7fadc359e700 1 -- 172.21.15.103:0/471107523 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fadc4066790 con 0x7fadc40ad900 2020-04-22T14:20:22.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.847+0000 7fadc1d9b700 1 --2- 172.21.15.103:0/471107523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fadc40ad900 0x7fadc4142d60 secure :-1 s=THROTTLE_DONE pgs=2160 cs=0 l=1 rx=0x7fadac007920 tx=0x7fadac010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:22.850 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.847+0000 7fadbb7fe700 1 -- 172.21.15.103:0/471107523 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+2151 (secure 0 0 0) 0x7fadac012cb0 con 0x7fadc40ad900 2020-04-22T14:20:22.850 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:20:22.850 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":114,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":9982,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.103:6833/1807533375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1807533375},{"type":"v1","addr":"172.21.15.103:6833","nonce":1807533375}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":111}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:19:46.112631+0000","modified":"2020-04-22T14:20:18.806229+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":147,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6878},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6878":{"gid":6878,"name":"b","rank":0,"incarnation":109,"state":"up:active","state_seq":6,"addr":"172.21.15.86:6835/2193157152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2193157152},{"type":"v1","addr":"172.21.15.86:6835","nonce":2193157152}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-04-22T14:20:22.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.848+0000 7fadc359e700 1 -- 172.21.15.103:0/471107523 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fada804d900 msgr2=0x7fada804fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:22.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.848+0000 7fadc359e700 1 --2- 172.21.15.103:0/471107523 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fada804d900 0x7fada804fdc0 secure :-1 s=READY pgs=782 cs=0 l=1 rx=0x7fadb4001170 tx=0x7fadb40017f0).stop 2020-04-22T14:20:22.851 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.848+0000 7fadc359e700 1 -- 172.21.15.103:0/471107523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fadc40ad900 msgr2=0x7fadc4142d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:22.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.848+0000 7fadc359e700 1 --2- 172.21.15.103:0/471107523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fadc40ad900 0x7fadc4142d60 secure :-1 s=READY pgs=2160 cs=0 l=1 rx=0x7fadac007920 tx=0x7fadac010c90).stop 2020-04-22T14:20:22.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.848+0000 7fadc359e700 1 -- 172.21.15.103:0/471107523 shutdown_connections 2020-04-22T14:20:22.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.848+0000 7fadc359e700 1 --2- 172.21.15.103:0/471107523 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fada804d900 0x7fada804fdc0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:22.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.848+0000 7fadc359e700 1 --2- 172.21.15.103:0/471107523 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fadc4146ad0 0x7fadc40b73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:22.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.848+0000 7fadc359e700 1 --2- 172.21.15.103:0/471107523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fadc40ad900 0x7fadc4142d60 unknown :-1 s=CLOSED pgs=2160 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:22.852 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.848+0000 7fadc359e700 1 -- 172.21.15.103:0/471107523 >> 172.21.15.103:0/471107523 conn(0x7fadc405b7c0 msgr2=0x7fadc413cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:22.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.848+0000 7fadc359e700 1 -- 172.21.15.103:0/471107523 shutdown_connections 2020-04-22T14:20:22.853 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:22.848+0000 7fadc359e700 1 -- 172.21.15.103:0/471107523 wait complete. 2020-04-22T14:20:22.853 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 114 2020-04-22T14:20:23.062 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 6878}, u'last_failure_osd_epoch': 147, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 25, u'failed': [], u'epoch': 114, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [26], u'info': {u'gid_6878': {u'export_targets': [], u'name': u'b', u'incarnation': 109, u'state_seq': 6, u'state': u'up:active', u'gid': 6878, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 2193157152, u'type': u'v2', u'addr': u'172.21.15.86:6834'}, {u'nonce': 2193157152, u'type': u'v1', u'addr': u'172.21.15.86:6835'}]}, u'addr': u'172.21.15.86:6835/2193157152'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:19:46.112631+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:20:18.806229+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:20:23.063 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:20:23.063 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:20:23.080 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2020-04-22T14:20:23.248 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2020-04-22T14:20:23.248 INFO:teuthology.orchestra.run.smithi086.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:20:23.248 INFO:teuthology.orchestra.run.smithi086.stdout: "whoami": 0, 2020-04-22T14:20:23.248 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 6878, 2020-04-22T14:20:23.248 INFO:teuthology.orchestra.run.smithi086.stdout: "want_state": "up:active", 2020-04-22T14:20:23.249 INFO:teuthology.orchestra.run.smithi086.stdout: "state": "up:active", 2020-04-22T14:20:23.249 INFO:teuthology.orchestra.run.smithi086.stdout: "rank_uptime": 11.774654507999999, 2020-04-22T14:20:23.249 INFO:teuthology.orchestra.run.smithi086.stdout: "mdsmap_epoch": 114, 2020-04-22T14:20:23.249 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch": 149, 2020-04-22T14:20:23.249 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_epoch_barrier": 149, 2020-04-22T14:20:23.249 INFO:teuthology.orchestra.run.smithi086.stdout: "uptime": 12.453775587999999 2020-04-22T14:20:23.250 INFO:teuthology.orchestra.run.smithi086.stdout:} 2020-04-22T14:20:23.256 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 6878, "want_state": "up:active", "state": "up:active", "rank_uptime": 11.774654507999999, "mdsmap_epoch": 114, "osdmap_epoch": 149, "osdmap_epoch_barrier": 149, "uptime": 12.453775587999999 } 2020-04-22T14:20:23.256 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-04-22T14:20:23.257 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:20:23.257 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:23.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:23.271 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:20:23.330 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:20:23.330 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:20:23.331 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:20:23.331 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:23.331 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:20:23.331 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:23.331 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:20:23.331 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:23.331 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:20:23.332 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:23.332 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:20:23.332 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:23.332 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:20:23.332 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:23.332 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:20:23.332 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 41617sec preferred_lft 41617sec 2020-04-22T14:20:23.333 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:20:23.333 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:23.333 INFO:teuthology.orchestra.run.smithi103.stdout:44: brx.4@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:20:23.333 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether ce:62:6d:2c:c1:6d brd ff:ff:ff:ff:ff:ff link-netnsid 4 2020-04-22T14:20:23.333 INFO:teuthology.orchestra.run.smithi103.stdout:46: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:20:23.333 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 56:41:da:23:d7:48 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:23.333 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:20:23.334 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:23.334 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::3c5:c758:d319:26f6/64 scope link noprefixroute 2020-04-22T14:20:23.334 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:23.334 INFO:teuthology.orchestra.run.smithi103.stdout:47: brx.0@if2: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:20:23.334 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether f6:69:77:c1:44:bd brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:20:23.334 INFO:teuthology.orchestra.run.smithi103.stdout:48: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-04-22T14:20:23.335 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 56:41:da:23:d7:48 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2020-04-22T14:20:23.335 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:23.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:23.380 INFO:teuthology.orchestra.run.smithi103:> ip netns list 2020-04-22T14:20:23.439 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 1) 2020-04-22T14:20:23.439 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:23.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:23.488 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:20:23.546 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 2020-04-22T14:20:23.546 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 1 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2020-04-22T14:20:23.546 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 4 2020-04-22T14:20:23.547 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:23.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:23.598 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:20:23.657 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 2020-04-22T14:20:23.657 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 1 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2020-04-22T14:20:23.657 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 4 2020-04-22T14:20:23.658 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:23.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:23.706 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:20:23.765 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 2020-04-22T14:20:23.765 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 1 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2020-04-22T14:20:23.765 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 4 2020-04-22T14:20:23.765 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:23.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:23.813 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:20:23.888 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:23.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:23.936 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 2' 2020-04-22T14:20:24.010 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:24.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:24.057 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr' 2020-04-22T14:20:24.145 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:20:24.146 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:20:24.146 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:20:24.146 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:24.146 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:20:24.146 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:24.146 INFO:teuthology.orchestra.run.smithi103.stdout:2: veth0@if48: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:20:24.147 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether fe:bc:4e:7b:8c:f6 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:20:24.147 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.0.2/16 brd 192.168.255.255 scope global veth0 2020-04-22T14:20:24.147 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:24.147 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::fcbc:4eff:fe7b:8cf6/64 scope link 2020-04-22T14:20:24.147 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:24.147 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-04-22T14:20:24.148 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:24.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:24.193 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.2' 2020-04-22T14:20:24.268 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:24.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:24.317 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0' 2020-04-22T14:20:24.425 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:24.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:24.451 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up' 2020-04-22T14:20:24.558 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:24.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:24.571 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up' 2020-04-22T14:20:24.681 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:24.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:24.694 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254' 2020-04-22T14:20:24.804 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:24.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:24.817 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:20:24.903 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:24.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:24.955 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge-slave con-name brx.2 ifname brx.2 master ceph-brx' 2020-04-22T14:20:25.062 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.2' (b3aec065-22a0-494c-a6d1-36da83ceffc8) successfully added. 2020-04-22T14:20:25.063 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:25.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:25.077 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up brx.2' 2020-04-22T14:20:25.238 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/60) 2020-04-22T14:20:25.238 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-04-22T14:20:25.238 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi103.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-04-22T14:20:25.239 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:25.253 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:20:25.253 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:20:25.312 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:25.360 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:20:25.360 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:20:25.428 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:20:25.435 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:20:25.436 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:25.482 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:20:25.483 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:20:25.543 INFO:teuthology.orchestra.run.smithi103.stdout:49 2020-04-22T14:20:25.543 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [49] 2020-04-22T14:20:25.543 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:25.590 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:20:25.632 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:25.645 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:20:25.645 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:20:25.647 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:20:25.664 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:20:25.706 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:25.715 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:20:25.720 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:20:25.721 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:25.721 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:2020-04-22T14:20:25.719+0000 7f178cc511c0 -1 init, newargv = 0x55c92f86b170 newargc=9 2020-04-22T14:20:25.722 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[126440]: starting ceph client 2020-04-22T14:20:25.726 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:20:25.727 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[126440]: starting fuse 2020-04-22T14:20:25.745 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:20:25.746 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:20:25.803 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:20:25.803 INFO:teuthology.orchestra.run.smithi103.stdout:49 2020-04-22T14:20:25.804 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47, 49] 2020-04-22T14:20:25.804 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:25.851 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:20:25.851 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:20:25.852 INFO:teuthology.orchestra.run.smithi103:> import glob 2020-04-22T14:20:25.852 INFO:teuthology.orchestra.run.smithi103:> import re 2020-04-22T14:20:25.852 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:20:25.852 INFO:teuthology.orchestra.run.smithi103:> import subprocess 2020-04-22T14:20:25.852 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:20:25.852 INFO:teuthology.orchestra.run.smithi103:> def find_socket(client_name): 2020-04-22T14:20:25.852 INFO:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-04-22T14:20:25.853 INFO:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2020-04-22T14:20:25.853 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:20:25.853 INFO:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2020-04-22T14:20:25.853 INFO:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2020-04-22T14:20:25.853 INFO:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2020-04-22T14:20:25.853 INFO:teuthology.orchestra.run.smithi103:> return files[0] 2020-04-22T14:20:25.853 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:20:25.853 INFO:teuthology.orchestra.run.smithi103:> for f in files: 2020-04-22T14:20:25.854 INFO:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:20:25.854 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:20:25.854 INFO:teuthology.orchestra.run.smithi103:> return f 2020-04-22T14:20:25.854 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:20:25.854 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:20:25.854 INFO:teuthology.orchestra.run.smithi103:> print(find_socket("client.0")) 2020-04-22T14:20:25.854 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:20:25.960 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.0.126440.asok 2020-04-22T14:20:25.960 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.126440.asok 2020-04-22T14:20:25.960 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:25.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:20:25.974 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.126440.asok status 2020-04-22T14:20:26.151 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:20:26.152 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2020-04-22T14:20:26.152 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:20:26.152 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:20:26.152 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "0", 2020-04-22T14:20:26.152 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:20:26.152 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-04-22T14:20:26.153 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "126440", 2020-04-22T14:20:26.153 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:20:26.153 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:26.153 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2020-04-22T14:20:26.153 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2020-04-22T14:20:26.153 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 6920, 2020-04-22T14:20:26.153 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2020-04-22T14:20:26.154 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:20:26.154 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:20:26.154 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 6920 2020-04-22T14:20:26.154 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:26.154 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:20:26.154 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:20:26.154 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:0", 2020-04-22T14:20:26.155 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 2068037157 2020-04-22T14:20:26.155 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:26.155 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:26.155 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:20:26.155 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:20:26.155 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:0", 2020-04-22T14:20:26.155 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 2068037157 2020-04-22T14:20:26.156 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:26.156 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.6920 172.21.15.103:0/2068037157", 2020-04-22T14:20:26.156 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "172.21.15.103:0/2068037157", 2020-04-22T14:20:26.156 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2020-04-22T14:20:26.156 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 114, 2020-04-22T14:20:26.157 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 149, 2020-04-22T14:20:26.163 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2020-04-22T14:20:26.164 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklisted": false 2020-04-22T14:20:26.164 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:20:26.164 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:26.186 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:20:26.186 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-22T14:20:26.186 INFO:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:20:26.245 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2020-04-22T14:20:26.245 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-04-22T14:20:26.245 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:26.294 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:20:26.294 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:20:26.372 DEBUG:tasks.cephfs.mount:Creating test file 2020-04-22 14:20:26.372942 0 2020-04-22T14:20:26.373 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:26.417 INFO:teuthology.orchestra.run.smithi103:> sudo touch '/home/ubuntu/cephtest/mnt.0/2020-04-22 14:20:26.372942 0' 2020-04-22T14:20:26.490 DEBUG:tasks.cephfs.mount:Deleting test file 2020-04-22 14:20:26.372942 0 2020-04-22T14:20:26.490 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:26.543 INFO:teuthology.orchestra.run.smithi103:> sudo rm -f '/home/ubuntu/cephtest/mnt.0/2020-04-22 14:20:26.372942 0' 2020-04-22T14:20:26.613 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-04-22T14:20:26.613 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:20:26.630 INFO:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:20:26.723 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:26.739 INFO:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:20:26.825 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-04-22T14:20:26.825 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2020-04-22T14:20:26.826 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:26.838 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-04-22T14:20:26.839 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:20:26.916 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[126440]: fuse finished with error 0 and tester_r 0 2020-04-22T14:20:27.057 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:20:27.058 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:20:27.058 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:27.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:27.112 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:20:27.188 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:27.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:27.238 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down brx.2' 2020-04-22T14:20:27.397 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.2' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/60) 2020-04-22T14:20:27.397 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:27.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:27.411 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete brx.2' 2020-04-22T14:20:27.521 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.2' (b3aec065-22a0-494c-a6d1-36da83ceffc8) successfully deleted. 2020-04-22T14:20:27.521 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:27.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:27.535 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:20:27.643 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:27.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:27.669 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:20:27.728 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:20:27.729 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:20:27.729 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:20:27.729 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:27.729 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:20:27.729 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:27.729 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:20:27.729 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:27.730 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:20:27.730 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:27.730 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:20:27.730 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:27.730 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:20:27.731 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:27.731 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:20:27.731 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 41613sec preferred_lft 41613sec 2020-04-22T14:20:27.731 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:20:27.731 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:27.731 INFO:teuthology.orchestra.run.smithi103.stdout:44: brx.4@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:20:27.732 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether ce:62:6d:2c:c1:6d brd ff:ff:ff:ff:ff:ff link-netnsid 4 2020-04-22T14:20:27.732 INFO:teuthology.orchestra.run.smithi103.stdout:46: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:20:27.732 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 56:41:da:23:d7:48 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:27.732 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:20:27.732 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:27.732 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::3c5:c758:d319:26f6/64 scope link noprefixroute 2020-04-22T14:20:27.732 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:27.733 INFO:teuthology.orchestra.run.smithi103.stdout:47: brx.0@if2: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:20:27.733 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether f6:69:77:c1:44:bd brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:20:27.733 INFO:teuthology.orchestra.run.smithi103.stdout:48: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-04-22T14:20:27.733 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 56:41:da:23:d7:48 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2020-04-22T14:20:27.733 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:27.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:27.776 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:20:27.854 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:27.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:27.903 INFO:teuthology.orchestra.run.smithi103:> nmcli connection show 2020-04-22T14:20:27.979 INFO:teuthology.orchestra.run.smithi103.stdout:NAME UUID TYPE DEVICE 2020-04-22T14:20:27.979 INFO:teuthology.orchestra.run.smithi103.stdout:System enp3s0f1 b0a308d1-bd90-60af-eb7c-0183bb425a1a ethernet enp3s0f1 2020-04-22T14:20:27.979 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-brx ceeb966f-6807-4e5c-804a-9a614abf7ae3 bridge ceph-brx 2020-04-22T14:20:27.979 INFO:teuthology.orchestra.run.smithi103.stdout:brx.1 1e2c85a4-f18a-4c67-a6f1-a640d4fc712b ethernet brx.1 2020-04-22T14:20:27.980 INFO:teuthology.orchestra.run.smithi103.stdout:eno1 206ad60d-195e-4d4b-a9fe-a5dd1f33a67d ethernet -- 2020-04-22T14:20:27.980 INFO:teuthology.orchestra.run.smithi103.stdout:eno2 894a7dd2-d329-4985-9ef9-84a92c6e1c6c ethernet -- 2020-04-22T14:20:27.980 INFO:teuthology.orchestra.run.smithi103.stdout:enp3s0f0 5a3237ce-06ab-4ae0-818b-45bdf036cb08 ethernet -- 2020-04-22T14:20:27.980 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:28.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:28.027 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:20:28.086 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2020-04-22T14:20:28.087 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:28.134 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-04-22T14:20:28.134 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:20:28.212 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[124013]: fuse finished with error 0 and tester_r 0 2020-04-22T14:20:28.351 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-04-22T14:20:28.352 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:20:28.352 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:28.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:28.406 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:20:28.480 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:28.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:28.533 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down brx.1' 2020-04-22T14:20:28.692 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.1' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/59) 2020-04-22T14:20:28.693 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:28.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:28.712 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete brx.1' 2020-04-22T14:20:28.819 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.1' (1e2c85a4-f18a-4c67-a6f1-a640d4fc712b) successfully deleted. 2020-04-22T14:20:28.819 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:28.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:28.849 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:20:28.958 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:28.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:28.985 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:20:29.044 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:20:29.044 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:20:29.044 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:20:29.044 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:29.045 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:20:29.045 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:29.045 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:20:29.045 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:29.045 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:20:29.045 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:29.045 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:20:29.046 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:29.046 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:20:29.046 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:29.046 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:20:29.046 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 41611sec preferred_lft 41611sec 2020-04-22T14:20:29.046 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:20:29.046 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:29.047 INFO:teuthology.orchestra.run.smithi103.stdout:44: brx.4@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:20:29.047 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether ce:62:6d:2c:c1:6d brd ff:ff:ff:ff:ff:ff link-netnsid 4 2020-04-22T14:20:29.047 INFO:teuthology.orchestra.run.smithi103.stdout:46: ceph-brx: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:20:29.047 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:29.047 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:20:29.047 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:29.047 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::3c5:c758:d319:26f6/64 scope link noprefixroute 2020-04-22T14:20:29.048 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:29.048 INFO:teuthology.orchestra.run.smithi103.stdout:47: brx.0@if2: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:20:29.048 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether f6:69:77:c1:44:bd brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:20:29.048 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:29.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:29.092 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:20:29.169 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:29.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:29.220 INFO:teuthology.orchestra.run.smithi103:> nmcli connection show 2020-04-22T14:20:29.295 INFO:teuthology.orchestra.run.smithi103.stdout:NAME UUID TYPE DEVICE 2020-04-22T14:20:29.296 INFO:teuthology.orchestra.run.smithi103.stdout:System enp3s0f1 b0a308d1-bd90-60af-eb7c-0183bb425a1a ethernet enp3s0f1 2020-04-22T14:20:29.296 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-brx ceeb966f-6807-4e5c-804a-9a614abf7ae3 bridge ceph-brx 2020-04-22T14:20:29.296 INFO:teuthology.orchestra.run.smithi103.stdout:eno1 206ad60d-195e-4d4b-a9fe-a5dd1f33a67d ethernet -- 2020-04-22T14:20:29.296 INFO:teuthology.orchestra.run.smithi103.stdout:eno2 894a7dd2-d329-4985-9ef9-84a92c6e1c6c ethernet -- 2020-04-22T14:20:29.296 INFO:teuthology.orchestra.run.smithi103.stdout:enp3s0f0 5a3237ce-06ab-4ae0-818b-45bdf036cb08 ethernet -- 2020-04-22T14:20:29.297 INFO:tasks.cephfs.mount:Removing the 'ceph-brx' 2020-04-22T14:20:29.297 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:29.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:29.343 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection down ceph-brx' 2020-04-22T14:20:29.501 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/57) 2020-04-22T14:20:29.501 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:29.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:29.515 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection delete ceph-brx' 2020-04-22T14:20:29.622 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' (ceeb966f-6807-4e5c-804a-9a614abf7ae3) successfully deleted. 2020-04-22T14:20:29.622 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:29.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:29.652 INFO:teuthology.orchestra.run.smithi103:> route 2020-04-22T14:20:29.711 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2020-04-22T14:20:29.711 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-04-22T14:20:29.711 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 102 0 0 enp3s0f1 2020-04-22T14:20:29.711 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 102 0 0 enp3s0f1 2020-04-22T14:20:29.712 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:29.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:29.762 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -D FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-04-22T14:20:29.872 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:29.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:29.895 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -D FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-04-22T14:20:30.002 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:30.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:30.025 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -t nat -D POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-04-22T14:20:30.101 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:30.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:30.154 INFO:teuthology.orchestra.run.smithi103:> cat /tmp/python-ceph-brx 2020-04-22T14:20:30.212 INFO:teuthology.orchestra.run.smithi103.stdout:0 2020-04-22T14:20:30.213 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:30.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:30.265 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 0 > /proc/sys/net/ipv4/ip_forward' 2020-04-22T14:20:30.341 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:30.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:30.386 INFO:teuthology.orchestra.run.smithi103:> rm -f /tmp/python-ceph-brx 2020-04-22T14:20:30.442 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:30.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:30.493 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:20:30.559 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.2' netns for '/home/ubuntu/cephtest/mnt.2' 2020-04-22T14:20:30.560 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:20:30.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:30.581 INFO:teuthology.orchestra.run.smithi086:> ip addr 2020-04-22T14:20:30.645 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:20:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:20:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:20:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2020-04-22T14:20:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:30.646 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:20:30.646 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:30.647 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:20:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:30.647 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:20:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:30.647 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:20:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:30.647 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:20:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 41583sec preferred_lft 41583sec 2020-04-22T14:20:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2020-04-22T14:20:30.648 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:30.648 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:20:30.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:30.697 INFO:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.2) 2020-04-22T14:20:30.755 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--home-ubuntu-cephtest-mnt.3' netns for '/home/ubuntu/cephtest/mnt.3' 2020-04-22T14:20:30.756 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:20:30.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:30.812 INFO:teuthology.orchestra.run.smithi086:> ip addr 2020-04-22T14:20:30.878 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:20:30.878 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:20:30.878 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:20:30.878 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:30.878 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2020-04-22T14:20:30.879 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:30.879 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:20:30.879 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:30.879 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:20:30.879 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:30.879 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:20:30.879 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:30.880 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:20:30.880 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:30.880 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:20:30.880 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 41583sec preferred_lft 41583sec 2020-04-22T14:20:30.880 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2020-04-22T14:20:30.880 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:30.881 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:20:30.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:30.928 INFO:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rm -rf /home/ubuntu/cephtest/mnt.3) 2020-04-22T14:20:30.985 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:31.001 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_reconnect_eviction' 2020-04-22T14:20:31.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.151+0000 7f654b373700 1 Processor -- start 2020-04-22T14:20:31.154 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.152+0000 7f654b373700 1 -- start start 2020-04-22T14:20:31.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.152+0000 7f654b373700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f654412c0d0 0x7f65441464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:31.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.152+0000 7f654b373700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6544063e30 0x7f65440642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:31.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.152+0000 7f654b373700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6544143300 con 0x7f6544065fe0 2020-04-22T14:20:31.156 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.152+0000 7f654b373700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65441435a0 con 0x7f654412c0d0 2020-04-22T14:20:31.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.152+0000 7f654b373700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6544143840 con 0x7f6544063e30 2020-04-22T14:20:31.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.152+0000 7f654910f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f654412c0d0 0x7f65441464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:31.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.152+0000 7f654910f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f654412c0d0 0x7f65441464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58970/0 (socket says 172.21.15.103:58970) 2020-04-22T14:20:31.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.152+0000 7f654910f700 1 -- 172.21.15.103:0/4246721303 learned_addr learned my addr 172.21.15.103:0/4246721303 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:31.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.153+0000 7f6549910700 1 --2- 172.21.15.103:0/4246721303 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6544063e30 0x7f65440642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:31.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.153+0000 7f654910f700 1 -- 172.21.15.103:0/4246721303 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6544063e30 msgr2=0x7f65440642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:31.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.153+0000 7f654910f700 1 --2- 172.21.15.103:0/4246721303 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6544063e30 0x7f65440642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:31.157 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.153+0000 7f654910f700 1 -- 172.21.15.103:0/4246721303 >> v1:172.21.15.103:6789/0 conn(0x7f6544065fe0 legacy=0x7f654405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:31.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.153+0000 7f654910f700 1 -- 172.21.15.103:0/4246721303 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f654405bb50 con 0x7f654412c0d0 2020-04-22T14:20:31.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.153+0000 7f654910f700 1 --2- 172.21.15.103:0/4246721303 >> v2:172.21.15.103:3300/0 conn(0x7f654412c0d0 0x7f65441464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6534002f30 tx=0x7f6534007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:31.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.153+0000 7f654910f700 1 --2- 172.21.15.103:0/4246721303 >> v2:172.21.15.103:3300/0 conn(0x7f654412c0d0 0x7f65441464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6534002f30 tx=0x7f6534007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:31.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.153+0000 7f654910f700 1 --2- 172.21.15.103:0/4246721303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f654412c0d0 0x7f65441464e0 secure :-1 s=READY pgs=2164 cs=0 l=1 rx=0x7f6534002f30 tx=0x7f6534007a40).ready entity=mon.1 client_cookie=90594009e5940080 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:31.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.153+0000 7f654910f700 1 --2- 172.21.15.103:0/4246721303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f654412c0d0 0x7f65441464e0 secure :-1 s=THROTTLE_DONE pgs=2164 cs=0 l=1 rx=0x7f6534002f30 tx=0x7f6534007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:31.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.153+0000 7f6533fff700 1 -- 172.21.15.103:0/4246721303 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6534011720 con 0x7f654412c0d0 2020-04-22T14:20:31.158 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.153+0000 7f654910f700 1 --2- 172.21.15.103:0/4246721303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f654412c0d0 0x7f65441464e0 secure :-1 s=THROTTLE_DONE pgs=2164 cs=0 l=1 rx=0x7f6534002f30 tx=0x7f6534007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:31.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.153+0000 7f654910f700 1 --2- 172.21.15.103:0/4246721303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f654412c0d0 0x7f65441464e0 secure :-1 s=THROTTLE_DONE pgs=2164 cs=0 l=1 rx=0x7f6534002f30 tx=0x7f6534007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:31.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.153+0000 7f6533fff700 1 -- 172.21.15.103:0/4246721303 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65340118c0 con 0x7f654412c0d0 2020-04-22T14:20:31.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.153+0000 7f6533fff700 1 -- 172.21.15.103:0/4246721303 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6534011ce0 con 0x7f654412c0d0 2020-04-22T14:20:31.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.153+0000 7f654b373700 1 -- 172.21.15.103:0/4246721303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f654412c0d0 msgr2=0x7f65441464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:31.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.153+0000 7f654b373700 1 --2- 172.21.15.103:0/4246721303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f654412c0d0 0x7f65441464e0 secure :-1 s=READY pgs=2164 cs=0 l=1 rx=0x7f6534002f30 tx=0x7f6534007a40).stop 2020-04-22T14:20:31.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.154+0000 7f654b373700 1 -- 172.21.15.103:0/4246721303 shutdown_connections 2020-04-22T14:20:31.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.154+0000 7f654b373700 1 --2- 172.21.15.103:0/4246721303 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6544063e30 0x7f65440642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:31.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.154+0000 7f654b373700 1 --2- 172.21.15.103:0/4246721303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f654412c0d0 0x7f65441464e0 unknown :-1 s=CLOSED pgs=2164 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:31.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.154+0000 7f654b373700 1 -- 172.21.15.103:0/4246721303 >> 172.21.15.103:0/4246721303 conn(0x7f65440b9160 msgr2=0x7f654405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:31.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.154+0000 7f654b373700 1 -- 172.21.15.103:0/4246721303 shutdown_connections 2020-04-22T14:20:31.160 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.154+0000 7f654b373700 1 -- 172.21.15.103:0/4246721303 wait complete. 2020-04-22T14:20:31.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.155+0000 7f654b373700 1 Processor -- start 2020-04-22T14:20:31.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.155+0000 7f654b373700 1 -- start start 2020-04-22T14:20:31.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.155+0000 7f654b373700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6544063e30 0x7f6544155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:31.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.155+0000 7f654b373700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6544155420 con 0x7f6544065fe0 2020-04-22T14:20:31.163 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.155+0000 7f654b373700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65441556c0 con 0x7f654412c0d0 2020-04-22T14:20:31.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.155+0000 7f654b373700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6544156260 con 0x7f6544063e30 2020-04-22T14:20:31.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.155+0000 7f654910f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6544063e30 0x7f6544155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:31.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.155+0000 7f654910f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6544063e30 0x7f6544155e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58974/0 (socket says 172.21.15.103:58974) 2020-04-22T14:20:31.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.155+0000 7f654910f700 1 -- 172.21.15.103:0/721857675 learned_addr learned my addr 172.21.15.103:0/721857675 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:31.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.155+0000 7f6549910700 1 --1- 172.21.15.103:0/721857675 >> v1:172.21.15.103:6789/0 conn(0x7f654412c0d0 0x7f6544142100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51168/0 (socket says 172.21.15.103:51168) 2020-04-22T14:20:31.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.156+0000 7f654910f700 1 -- 172.21.15.103:0/721857675 >> v1:172.21.15.103:6789/0 conn(0x7f654412c0d0 legacy=0x7f6544142100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:31.164 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.156+0000 7f654910f700 1 -- 172.21.15.103:0/721857675 >> v1:172.21.15.86:6789/0 conn(0x7f6544065fe0 legacy=0x7f6544126bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:31.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.156+0000 7f654910f700 1 -- 172.21.15.103:0/721857675 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6544155960 con 0x7f6544063e30 2020-04-22T14:20:31.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.156+0000 7f654910f700 1 --2- 172.21.15.103:0/721857675 >> v2:172.21.15.103:3300/0 conn(0x7f6544063e30 0x7f6544155e00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f65440af350 tx=0x7f6534007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:31.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.156+0000 7f654910f700 1 --2- 172.21.15.103:0/721857675 >> v2:172.21.15.103:3300/0 conn(0x7f6544063e30 0x7f6544155e00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f65440af350 tx=0x7f6534007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:31.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.156+0000 7f654910f700 1 --2- 172.21.15.103:0/721857675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6544063e30 0x7f6544155e00 secure :-1 s=READY pgs=2166 cs=0 l=1 rx=0x7f65440af350 tx=0x7f6534007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:31.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.156+0000 7f654910f700 1 --2- 172.21.15.103:0/721857675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6544063e30 0x7f6544155e00 secure :-1 s=THROTTLE_DONE pgs=2166 cs=0 l=1 rx=0x7f65440af350 tx=0x7f6534007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:31.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.156+0000 7f65327fc700 1 -- 172.21.15.103:0/721857675 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65340102c0 con 0x7f6544063e30 2020-04-22T14:20:31.165 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.156+0000 7f654910f700 1 --2- 172.21.15.103:0/721857675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6544063e30 0x7f6544155e00 secure :-1 s=THROTTLE_DONE pgs=2166 cs=0 l=1 rx=0x7f65440af350 tx=0x7f6534007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:31.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.156+0000 7f654910f700 1 --2- 172.21.15.103:0/721857675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6544063e30 0x7f6544155e00 secure :-1 s=THROTTLE_DONE pgs=2166 cs=0 l=1 rx=0x7f65440af350 tx=0x7f6534007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:31.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.156+0000 7f65327fc700 1 -- 172.21.15.103:0/721857675 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6534007170 con 0x7f6544063e30 2020-04-22T14:20:31.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.156+0000 7f65327fc700 1 -- 172.21.15.103:0/721857675 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65340074d0 con 0x7f6544063e30 2020-04-22T14:20:31.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.156+0000 7f654b373700 1 -- 172.21.15.103:0/721857675 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65441272c0 con 0x7f6544063e30 2020-04-22T14:20:31.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.156+0000 7f654b373700 1 -- 172.21.15.103:0/721857675 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65440b54c0 con 0x7f6544063e30 2020-04-22T14:20:31.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.157+0000 7f654910f700 1 --2- 172.21.15.103:0/721857675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6544063e30 0x7f6544155e00 secure :-1 s=THROTTLE_DONE pgs=2166 cs=0 l=1 rx=0x7f65440af350 tx=0x7f6534007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:31.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.157+0000 7f654910f700 1 --2- 172.21.15.103:0/721857675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6544063e30 0x7f6544155e00 secure :-1 s=THROTTLE_DONE pgs=2166 cs=0 l=1 rx=0x7f65440af350 tx=0x7f6534007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:31.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.157+0000 7f65327fc700 1 -- 172.21.15.103:0/721857675 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f65340056c0 con 0x7f6544063e30 2020-04-22T14:20:31.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.157+0000 7f654b373700 1 -- 172.21.15.103:0/721857675 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6544155af0 con 0x7f6544063e30 2020-04-22T14:20:31.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.157+0000 7f65327fc700 1 --2- 172.21.15.103:0/721857675 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f652404d900 0x7f652404fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:31.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.157+0000 7f65327fc700 1 -- 172.21.15.103:0/721857675 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f6534061d00 con 0x7f6544063e30 2020-04-22T14:20:31.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.158+0000 7f654890e700 1 --2- 172.21.15.103:0/721857675 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f652404d900 0x7f652404fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:31.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.158+0000 7f654890e700 1 --2- 172.21.15.103:0/721857675 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f652404d900 0x7f652404fdc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f65440b85b0 tx=0x7f6540001540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:31.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.158+0000 7f654890e700 1 --2- 172.21.15.103:0/721857675 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f652404d900 0x7f652404fdc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f65440b85b0 tx=0x7f6540001540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:31.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.158+0000 7f654890e700 1 --2- 172.21.15.103:0/721857675 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f652404d900 0x7f652404fdc0 secure :-1 s=READY pgs=783 cs=0 l=1 rx=0x7f65440b85b0 tx=0x7f6540001540).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:31.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.161+0000 7f654910f700 1 --2- 172.21.15.103:0/721857675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6544063e30 0x7f6544155e00 secure :-1 s=THROTTLE_DONE pgs=2166 cs=0 l=1 rx=0x7f65440af350 tx=0x7f6534007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:31.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.161+0000 7f65327fc700 1 -- 172.21.15.103:0/721857675 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f653403d100 con 0x7f6544063e30 2020-04-22T14:20:31.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.354+0000 7f654b373700 1 -- 172.21.15.103:0/721857675 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_reconnect_eviction"]} v 0) v1 -- 0x7f6544056c90 con 0x7f6544063e30 2020-04-22T14:20:31.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.483+0000 7f654910f700 1 --2- 172.21.15.103:0/721857675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6544063e30 0x7f6544155e00 secure :-1 s=THROTTLE_DONE pgs=2166 cs=0 l=1 rx=0x7f65440af350 tx=0x7f6534007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:31.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.483+0000 7f65327fc700 1 -- 172.21.15.103:0/721857675 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_reconnect_eviction"]}]=0 v773) v1 ==== 155+0+0 (secure 0 0 0) 0x7f6534040720 con 0x7f6544063e30 2020-04-22T14:20:31.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.485+0000 7f654b373700 1 -- 172.21.15.103:0/721857675 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f652404d900 msgr2=0x7f652404fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:31.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.485+0000 7f654b373700 1 --2- 172.21.15.103:0/721857675 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f652404d900 0x7f652404fdc0 secure :-1 s=READY pgs=783 cs=0 l=1 rx=0x7f65440b85b0 tx=0x7f6540001540).stop 2020-04-22T14:20:31.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.485+0000 7f654b373700 1 -- 172.21.15.103:0/721857675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6544063e30 msgr2=0x7f6544155e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:31.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.485+0000 7f654b373700 1 --2- 172.21.15.103:0/721857675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6544063e30 0x7f6544155e00 secure :-1 s=READY pgs=2166 cs=0 l=1 rx=0x7f65440af350 tx=0x7f6534007a40).stop 2020-04-22T14:20:31.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.485+0000 7f654b373700 1 -- 172.21.15.103:0/721857675 shutdown_connections 2020-04-22T14:20:31.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.485+0000 7f654b373700 1 --2- 172.21.15.103:0/721857675 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f652404d900 0x7f652404fdc0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:31.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.485+0000 7f654b373700 1 --2- 172.21.15.103:0/721857675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6544063e30 0x7f6544155e00 unknown :-1 s=CLOSED pgs=2166 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:31.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.485+0000 7f654b373700 1 -- 172.21.15.103:0/721857675 >> 172.21.15.103:0/721857675 conn(0x7f65440b9160 msgr2=0x7f65440656b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:31.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.485+0000 7f654b373700 1 -- 172.21.15.103:0/721857675 shutdown_connections 2020-04-22T14:20:31.488 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.485+0000 7f654b373700 1 -- 172.21.15.103:0/721857675 wait complete. 2020-04-22T14:20:31.497 INFO:tasks.cephfs_test_runner:test_reconnect_eviction (tasks.cephfs.test_client_recovery.TestClientRecovery) ... ok 2020-04-22T14:20:31.497 INFO:tasks.cephfs_test_runner:Starting test: test_reconnect_timeout (tasks.cephfs.test_client_recovery.TestClientRecovery) 2020-04-22T14:20:31.498 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:31.511 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_reconnect_timeout' 2020-04-22T14:20:31.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.655+0000 7fddb66d6700 1 Processor -- start 2020-04-22T14:20:31.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.655+0000 7fddb66d6700 1 -- start start 2020-04-22T14:20:31.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.655+0000 7fddb66d6700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fddb005b7c0 0x7fddb00665a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:31.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.656+0000 7fddb66d6700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fddb00b4ec0 0x7fddb00b5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:31.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.656+0000 7fddb66d6700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb00651f0 con 0x7fddb014a640 2020-04-22T14:20:31.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.656+0000 7fddb66d6700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddb0066b90 con 0x7fddb005b7c0 2020-04-22T14:20:31.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.656+0000 7fddb66d6700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddb0066e30 con 0x7fddb00b4ec0 2020-04-22T14:20:31.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.656+0000 7fddb4c73700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fddb00b4ec0 0x7fddb00b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:31.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.656+0000 7fddb4c73700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fddb00b4ec0 0x7fddb00b5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58982/0 (socket says 172.21.15.103:58982) 2020-04-22T14:20:31.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.656+0000 7fddb4c73700 1 -- 172.21.15.103:0/1464454328 learned_addr learned my addr 172.21.15.103:0/1464454328 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:31.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.656+0000 7fddaffff700 1 --2- 172.21.15.103:0/1464454328 >> v2:172.21.15.86:3300/0 conn(0x7fddb005b7c0 0x7fddb00665a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:31.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.656+0000 7fddb4c73700 1 -- 172.21.15.103:0/1464454328 >> v2:172.21.15.86:3300/0 conn(0x7fddb005b7c0 msgr2=0x7fddb00665a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:31.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.656+0000 7fddb4c73700 1 --2- 172.21.15.103:0/1464454328 >> v2:172.21.15.86:3300/0 conn(0x7fddb005b7c0 0x7fddb00665a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:31.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.656+0000 7fddb4c73700 1 -- 172.21.15.103:0/1464454328 >> v1:172.21.15.86:6789/0 conn(0x7fddb014a640 legacy=0x7fddb01336b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:31.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.656+0000 7fddb4c73700 1 -- 172.21.15.103:0/1464454328 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb00670d0 con 0x7fddb00b4ec0 2020-04-22T14:20:31.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.656+0000 7fddb4c73700 1 --2- 172.21.15.103:0/1464454328 >> v2:172.21.15.103:3300/0 conn(0x7fddb00b4ec0 0x7fddb00b5330 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fddb00656b0 tx=0x7fdda8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:31.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.656+0000 7fddb4c73700 1 --2- 172.21.15.103:0/1464454328 >> v2:172.21.15.103:3300/0 conn(0x7fddb00b4ec0 0x7fddb00b5330 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fddb00656b0 tx=0x7fdda8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:31.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.656+0000 7fddb4c73700 1 --2- 172.21.15.103:0/1464454328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddb00b4ec0 0x7fddb00b5330 secure :-1 s=READY pgs=2167 cs=0 l=1 rx=0x7fddb00656b0 tx=0x7fdda8007dc0).ready entity=mon.1 client_cookie=a7f4d2bc549dd7d0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:31.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.656+0000 7fddb4c73700 1 --2- 172.21.15.103:0/1464454328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddb00b4ec0 0x7fddb00b5330 secure :-1 s=THROTTLE_DONE pgs=2167 cs=0 l=1 rx=0x7fddb00656b0 tx=0x7fdda8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:31.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.656+0000 7fddaeffd700 1 -- 172.21.15.103:0/1464454328 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdda800a180 con 0x7fddb00b4ec0 2020-04-22T14:20:31.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.656+0000 7fddb4c73700 1 --2- 172.21.15.103:0/1464454328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddb00b4ec0 0x7fddb00b5330 secure :-1 s=THROTTLE_DONE pgs=2167 cs=0 l=1 rx=0x7fddb00656b0 tx=0x7fdda8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:31.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.656+0000 7fddb4c73700 1 --2- 172.21.15.103:0/1464454328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddb00b4ec0 0x7fddb00b5330 secure :-1 s=THROTTLE_DONE pgs=2167 cs=0 l=1 rx=0x7fddb00656b0 tx=0x7fdda8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:31.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.656+0000 7fddaeffd700 1 -- 172.21.15.103:0/1464454328 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda800a2e0 con 0x7fddb00b4ec0 2020-04-22T14:20:31.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.656+0000 7fddaeffd700 1 -- 172.21.15.103:0/1464454328 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdda800a6c0 con 0x7fddb00b4ec0 2020-04-22T14:20:31.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.656+0000 7fddb66d6700 1 -- 172.21.15.103:0/1464454328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddb00b4ec0 msgr2=0x7fddb00b5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:31.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.656+0000 7fddb66d6700 1 --2- 172.21.15.103:0/1464454328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddb00b4ec0 0x7fddb00b5330 secure :-1 s=READY pgs=2167 cs=0 l=1 rx=0x7fddb00656b0 tx=0x7fdda8007dc0).stop 2020-04-22T14:20:31.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.657+0000 7fddb66d6700 1 -- 172.21.15.103:0/1464454328 shutdown_connections 2020-04-22T14:20:31.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.657+0000 7fddb66d6700 1 --2- 172.21.15.103:0/1464454328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddb00b4ec0 0x7fddb00b5330 unknown :-1 s=CLOSED pgs=2167 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:31.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.657+0000 7fddb66d6700 1 --2- 172.21.15.103:0/1464454328 >> v2:172.21.15.86:3300/0 conn(0x7fddb005b7c0 0x7fddb00665a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:31.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.657+0000 7fddb66d6700 1 -- 172.21.15.103:0/1464454328 >> 172.21.15.103:0/1464454328 conn(0x7fddb00b9160 msgr2=0x7fddb005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:31.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.657+0000 7fddb66d6700 1 -- 172.21.15.103:0/1464454328 shutdown_connections 2020-04-22T14:20:31.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.657+0000 7fddb66d6700 1 -- 172.21.15.103:0/1464454328 wait complete. 2020-04-22T14:20:31.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.658+0000 7fddb66d6700 1 Processor -- start 2020-04-22T14:20:31.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.658+0000 7fddb66d6700 1 -- start start 2020-04-22T14:20:31.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.658+0000 7fddb66d6700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fddb005b7c0 0x7fddb0131830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:31.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.659+0000 7fddb66d6700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fddb014a640 0x7fddb00b7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:31.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.659+0000 7fddb66d6700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb0131c90 con 0x7fddb00b4ec0 2020-04-22T14:20:31.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.659+0000 7fddb66d6700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddb00ad320 con 0x7fddb005b7c0 2020-04-22T14:20:31.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.659+0000 7fddb66d6700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb00ad5c0 con 0x7fddb014a640 2020-04-22T14:20:31.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.659+0000 7fddaffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fddb005b7c0 0x7fddb0131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:31.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.659+0000 7fddaffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fddb005b7c0 0x7fddb0131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58988/0 (socket says 172.21.15.103:58988) 2020-04-22T14:20:31.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.659+0000 7fddaffff700 1 -- 172.21.15.103:0/126945534 learned_addr learned my addr 172.21.15.103:0/126945534 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:31.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.659+0000 7fddb4c73700 1 --2- 172.21.15.103:0/126945534 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fddb014a640 0x7fddb00b7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:31.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.659+0000 7fddaffff700 1 -- 172.21.15.103:0/126945534 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fddb014a640 msgr2=0x7fddb00b7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:31.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.659+0000 7fddaffff700 1 --2- 172.21.15.103:0/126945534 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fddb014a640 0x7fddb00b7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:31.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.659+0000 7fddaffff700 1 -- 172.21.15.103:0/126945534 >> v1:172.21.15.86:6789/0 conn(0x7fddb00b4ec0 legacy=0x7fddb00add00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:31.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.659+0000 7fddaffff700 1 -- 172.21.15.103:0/126945534 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb00ad860 con 0x7fddb005b7c0 2020-04-22T14:20:31.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.659+0000 7fddaffff700 1 --2- 172.21.15.103:0/126945534 >> v2:172.21.15.103:3300/0 conn(0x7fddb005b7c0 0x7fddb0131830 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdda0002f30 tx=0x7fdda0010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:31.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.659+0000 7fddaffff700 1 --2- 172.21.15.103:0/126945534 >> v2:172.21.15.103:3300/0 conn(0x7fddb005b7c0 0x7fddb0131830 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdda0002f30 tx=0x7fdda0010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:31.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.659+0000 7fddaffff700 1 --2- 172.21.15.103:0/126945534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddb005b7c0 0x7fddb0131830 secure :-1 s=READY pgs=2168 cs=0 l=1 rx=0x7fdda0002f30 tx=0x7fdda0010af0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:31.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.659+0000 7fddaffff700 1 --2- 172.21.15.103:0/126945534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddb005b7c0 0x7fddb0131830 secure :-1 s=THROTTLE_DONE pgs=2168 cs=0 l=1 rx=0x7fdda0002f30 tx=0x7fdda0010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:31.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.659+0000 7fddad7fa700 1 -- 172.21.15.103:0/126945534 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdda0012380 con 0x7fddb005b7c0 2020-04-22T14:20:31.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.659+0000 7fddaffff700 1 --2- 172.21.15.103:0/126945534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddb005b7c0 0x7fddb0131830 secure :-1 s=THROTTLE_DONE pgs=2168 cs=0 l=1 rx=0x7fdda0002f30 tx=0x7fdda0010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:31.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.659+0000 7fddaffff700 1 --2- 172.21.15.103:0/126945534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddb005b7c0 0x7fddb0131830 secure :-1 s=THROTTLE_DONE pgs=2168 cs=0 l=1 rx=0x7fdda0002f30 tx=0x7fdda0010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:31.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.659+0000 7fddad7fa700 1 -- 172.21.15.103:0/126945534 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda0012520 con 0x7fddb005b7c0 2020-04-22T14:20:31.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.659+0000 7fddb66d6700 1 -- 172.21.15.103:0/126945534 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb014bc30 con 0x7fddb005b7c0 2020-04-22T14:20:31.670 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.659+0000 7fddad7fa700 1 -- 172.21.15.103:0/126945534 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdda0012940 con 0x7fddb005b7c0 2020-04-22T14:20:31.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.659+0000 7fddb66d6700 1 -- 172.21.15.103:0/126945534 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb00b7bb0 con 0x7fddb005b7c0 2020-04-22T14:20:31.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.660+0000 7fddaffff700 1 --2- 172.21.15.103:0/126945534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddb005b7c0 0x7fddb0131830 secure :-1 s=THROTTLE_DONE pgs=2168 cs=0 l=1 rx=0x7fdda0002f30 tx=0x7fdda0010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:31.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.660+0000 7fddb66d6700 1 -- 172.21.15.103:0/126945534 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddb0056c90 con 0x7fddb005b7c0 2020-04-22T14:20:31.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.660+0000 7fddad7fa700 1 -- 172.21.15.103:0/126945534 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fdda0012bb0 con 0x7fddb005b7c0 2020-04-22T14:20:31.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.660+0000 7fddaffff700 1 --2- 172.21.15.103:0/126945534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddb005b7c0 0x7fddb0131830 secure :-1 s=THROTTLE_DONE pgs=2168 cs=0 l=1 rx=0x7fdda0002f30 tx=0x7fdda0010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:31.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.661+0000 7fddad7fa700 1 --2- 172.21.15.103:0/126945534 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdd9004d9e0 0x7fdd9004fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:31.671 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.661+0000 7fddad7fa700 1 -- 172.21.15.103:0/126945534 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6202+0+0 (secure 0 0 0) 0x7fdda0013070 con 0x7fddb005b7c0 2020-04-22T14:20:31.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.661+0000 7fddaf7fe700 1 --2- 172.21.15.103:0/126945534 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdd9004d9e0 0x7fdd9004fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:31.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.661+0000 7fddaf7fe700 1 --2- 172.21.15.103:0/126945534 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdd9004d9e0 0x7fdd9004fea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fddb01323f0 tx=0x7fdda4001530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:31.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.661+0000 7fddaf7fe700 1 --2- 172.21.15.103:0/126945534 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdd9004d9e0 0x7fdd9004fea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fddb01323f0 tx=0x7fdda4001530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:31.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.661+0000 7fddaf7fe700 1 --2- 172.21.15.103:0/126945534 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdd9004d9e0 0x7fdd9004fea0 secure :-1 s=READY pgs=784 cs=0 l=1 rx=0x7fddb01323f0 tx=0x7fdda4001530).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:31.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.665+0000 7fddaffff700 1 --2- 172.21.15.103:0/126945534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddb005b7c0 0x7fddb0131830 secure :-1 s=THROTTLE_DONE pgs=2168 cs=0 l=1 rx=0x7fdda0002f30 tx=0x7fdda0010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:31.672 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.665+0000 7fddad7fa700 1 -- 172.21.15.103:0/126945534 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fdda003cbe0 con 0x7fddb005b7c0 2020-04-22T14:20:31.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:31.859+0000 7fddb66d6700 1 -- 172.21.15.103:0/126945534 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_reconnect_timeout"]} v 0) v1 -- 0x7fddb005bba0 con 0x7fddb005b7c0 2020-04-22T14:20:32.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.491+0000 7fddaffff700 1 --2- 172.21.15.103:0/126945534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddb005b7c0 0x7fddb0131830 secure :-1 s=THROTTLE_DONE pgs=2168 cs=0 l=1 rx=0x7fdda0002f30 tx=0x7fdda0010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:32.493 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.491+0000 7fddad7fa700 1 -- 172.21.15.103:0/126945534 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_reconnect_timeout"]}]=0 v774) v1 ==== 157+0+0 (secure 0 0 0) 0x7fdda0040200 con 0x7fddb005b7c0 2020-04-22T14:20:32.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.492+0000 7fddb66d6700 1 -- 172.21.15.103:0/126945534 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdd9004d9e0 msgr2=0x7fdd9004fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:32.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.492+0000 7fddb66d6700 1 --2- 172.21.15.103:0/126945534 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdd9004d9e0 0x7fdd9004fea0 secure :-1 s=READY pgs=784 cs=0 l=1 rx=0x7fddb01323f0 tx=0x7fdda4001530).stop 2020-04-22T14:20:32.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.492+0000 7fddb66d6700 1 -- 172.21.15.103:0/126945534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddb005b7c0 msgr2=0x7fddb0131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:32.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.492+0000 7fddb66d6700 1 --2- 172.21.15.103:0/126945534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddb005b7c0 0x7fddb0131830 secure :-1 s=READY pgs=2168 cs=0 l=1 rx=0x7fdda0002f30 tx=0x7fdda0010af0).stop 2020-04-22T14:20:32.495 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.493+0000 7fddb66d6700 1 -- 172.21.15.103:0/126945534 shutdown_connections 2020-04-22T14:20:32.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.493+0000 7fddb66d6700 1 --2- 172.21.15.103:0/126945534 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fdd9004d9e0 0x7fdd9004fea0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:32.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.493+0000 7fddb66d6700 1 --2- 172.21.15.103:0/126945534 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fddb014a640 0x7fddb00b7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:32.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.493+0000 7fddb66d6700 1 --2- 172.21.15.103:0/126945534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddb005b7c0 0x7fddb0131830 unknown :-1 s=CLOSED pgs=2168 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:32.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.493+0000 7fddb66d6700 1 -- 172.21.15.103:0/126945534 >> 172.21.15.103:0/126945534 conn(0x7fddb00b9160 msgr2=0x7fddb0132700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:32.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.493+0000 7fddb66d6700 1 -- 172.21.15.103:0/126945534 shutdown_connections 2020-04-22T14:20:32.496 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.493+0000 7fddb66d6700 1 -- 172.21.15.103:0/126945534 wait complete. 2020-04-22T14:20:32.506 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-04-22T14:20:32.507 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:20:32.523 INFO:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:20:32.612 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:32.627 INFO:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-04-22T14:20:32.720 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-04-22T14:20:32.721 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:32.735 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2020-04-22T14:20:32.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.882+0000 7f92c26ea700 1 Processor -- start 2020-04-22T14:20:32.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.882+0000 7f92c26ea700 1 -- start start 2020-04-22T14:20:32.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.883+0000 7f92c26ea700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f92bc0ae130 0x7f92bc0bbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:32.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.883+0000 7f92c26ea700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f92bc060730 0x7f92bc060b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:32.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.883+0000 7f92c26ea700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92bc14a480 con 0x7f92bc0bcc00 2020-04-22T14:20:32.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.883+0000 7f92c26ea700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92bc060290 con 0x7f92bc0ae130 2020-04-22T14:20:32.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.883+0000 7f92c26ea700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92bc0bcfe0 con 0x7f92bc060730 2020-04-22T14:20:32.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.883+0000 7f92c1ee9700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f92bc060730 0x7f92bc060b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:32.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.883+0000 7f92c1ee9700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f92bc060730 0x7f92bc060b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58996/0 (socket says 172.21.15.103:58996) 2020-04-22T14:20:32.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.883+0000 7f92c1ee9700 1 -- 172.21.15.103:0/862329218 learned_addr learned my addr 172.21.15.103:0/862329218 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:32.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.883+0000 7f92c0ee7700 1 --2- 172.21.15.103:0/862329218 >> v2:172.21.15.86:3300/0 conn(0x7f92bc0ae130 0x7f92bc0bbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:32.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.883+0000 7f92c1ee9700 1 -- 172.21.15.103:0/862329218 >> v2:172.21.15.86:3300/0 conn(0x7f92bc0ae130 msgr2=0x7f92bc0bbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:32.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.883+0000 7f92c1ee9700 1 --2- 172.21.15.103:0/862329218 >> v2:172.21.15.86:3300/0 conn(0x7f92bc0ae130 0x7f92bc0bbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:32.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.883+0000 7f92c1ee9700 1 -- 172.21.15.103:0/862329218 >> v1:172.21.15.86:6789/0 conn(0x7f92bc0bcc00 legacy=0x7f92bc0ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:32.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.883+0000 7f92c1ee9700 1 -- 172.21.15.103:0/862329218 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92bc0ace50 con 0x7f92bc060730 2020-04-22T14:20:32.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.883+0000 7f92c0ee7700 1 --2- 172.21.15.103:0/862329218 >> v2:172.21.15.86:3300/0 conn(0x7f92bc0ae130 0x7f92bc0bbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:20:32.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.883+0000 7f92c1ee9700 1 --2- 172.21.15.103:0/862329218 >> v2:172.21.15.103:3300/0 conn(0x7f92bc060730 0x7f92bc060b80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f92bc0bd2a0 tx=0x7f92b4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:32.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.883+0000 7f92c1ee9700 1 --2- 172.21.15.103:0/862329218 >> v2:172.21.15.103:3300/0 conn(0x7f92bc060730 0x7f92bc060b80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f92bc0bd2a0 tx=0x7f92b4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:32.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.883+0000 7f92c1ee9700 1 --2- 172.21.15.103:0/862329218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92bc060730 0x7f92bc060b80 secure :-1 s=READY pgs=2169 cs=0 l=1 rx=0x7f92bc0bd2a0 tx=0x7f92b4007dc0).ready entity=mon.1 client_cookie=301353c4c974ba8f server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:32.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.883+0000 7f92c1ee9700 1 --2- 172.21.15.103:0/862329218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92bc060730 0x7f92bc060b80 secure :-1 s=THROTTLE_DONE pgs=2169 cs=0 l=1 rx=0x7f92bc0bd2a0 tx=0x7f92b4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:32.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.883+0000 7f92abfff700 1 -- 172.21.15.103:0/862329218 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92b400a180 con 0x7f92bc060730 2020-04-22T14:20:32.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.883+0000 7f92c1ee9700 1 --2- 172.21.15.103:0/862329218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92bc060730 0x7f92bc060b80 secure :-1 s=THROTTLE_DONE pgs=2169 cs=0 l=1 rx=0x7f92bc0bd2a0 tx=0x7f92b4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:32.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.883+0000 7f92c1ee9700 1 --2- 172.21.15.103:0/862329218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92bc060730 0x7f92bc060b80 secure :-1 s=THROTTLE_DONE pgs=2169 cs=0 l=1 rx=0x7f92bc0bd2a0 tx=0x7f92b4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:32.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.883+0000 7f92abfff700 1 -- 172.21.15.103:0/862329218 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b400a2e0 con 0x7f92bc060730 2020-04-22T14:20:32.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.883+0000 7f92abfff700 1 -- 172.21.15.103:0/862329218 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92b400a6c0 con 0x7f92bc060730 2020-04-22T14:20:32.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.883+0000 7f92c26ea700 1 -- 172.21.15.103:0/862329218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92bc060730 msgr2=0x7f92bc060b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:32.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.883+0000 7f92c26ea700 1 --2- 172.21.15.103:0/862329218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92bc060730 0x7f92bc060b80 secure :-1 s=READY pgs=2169 cs=0 l=1 rx=0x7f92bc0bd2a0 tx=0x7f92b4007dc0).stop 2020-04-22T14:20:32.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.884+0000 7f92c26ea700 1 -- 172.21.15.103:0/862329218 shutdown_connections 2020-04-22T14:20:32.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.884+0000 7f92c26ea700 1 --2- 172.21.15.103:0/862329218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92bc060730 0x7f92bc060b80 unknown :-1 s=CLOSED pgs=2169 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:32.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.884+0000 7f92c26ea700 1 --2- 172.21.15.103:0/862329218 >> v2:172.21.15.86:3300/0 conn(0x7f92bc0ae130 0x7f92bc0bbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:32.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.884+0000 7f92c26ea700 1 -- 172.21.15.103:0/862329218 >> 172.21.15.103:0/862329218 conn(0x7f92bc069f30 msgr2=0x7f92bc06a340 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:32.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.884+0000 7f92c26ea700 1 -- 172.21.15.103:0/862329218 shutdown_connections 2020-04-22T14:20:32.891 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.884+0000 7f92c26ea700 1 -- 172.21.15.103:0/862329218 wait complete. 2020-04-22T14:20:32.895 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.885+0000 7f92c26ea700 1 Processor -- start 2020-04-22T14:20:32.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.885+0000 7f92c26ea700 1 -- start start 2020-04-22T14:20:32.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.885+0000 7f92c26ea700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f92bc060730 0x7f92bc0b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:32.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.886+0000 7f92c26ea700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f92bc0bcc00 0x7f92bc0b2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:32.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.886+0000 7f92c26ea700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92bc0b3000 con 0x7f92bc0ae130 2020-04-22T14:20:32.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.886+0000 7f92c26ea700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92bc0b32a0 con 0x7f92bc060730 2020-04-22T14:20:32.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.886+0000 7f92c26ea700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92bc0b1890 con 0x7f92bc0bcc00 2020-04-22T14:20:32.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.886+0000 7f92c1ee9700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f92bc0bcc00 0x7f92bc0b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:32.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.886+0000 7f92c1ee9700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f92bc0bcc00 0x7f92bc0b2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59004/0 (socket says 172.21.15.103:59004) 2020-04-22T14:20:32.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.886+0000 7f92c1ee9700 1 -- 172.21.15.103:0/3768651065 learned_addr learned my addr 172.21.15.103:0/3768651065 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:32.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.886+0000 7f92c16e8700 1 --2- 172.21.15.103:0/3768651065 >> v2:172.21.15.86:3300/0 conn(0x7f92bc060730 0x7f92bc0b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:32.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.886+0000 7f92c1ee9700 1 -- 172.21.15.103:0/3768651065 >> v2:172.21.15.86:3300/0 conn(0x7f92bc060730 msgr2=0x7f92bc0b1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:32.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.886+0000 7f92c1ee9700 1 --2- 172.21.15.103:0/3768651065 >> v2:172.21.15.86:3300/0 conn(0x7f92bc060730 0x7f92bc0b1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:32.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.886+0000 7f92c1ee9700 1 -- 172.21.15.103:0/3768651065 >> v1:172.21.15.86:6789/0 conn(0x7f92bc0ae130 legacy=0x7f92bc156f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:32.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.886+0000 7f92c1ee9700 1 -- 172.21.15.103:0/3768651065 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92bc0b2c80 con 0x7f92bc0bcc00 2020-04-22T14:20:32.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.886+0000 7f92c16e8700 1 --2- 172.21.15.103:0/3768651065 >> v2:172.21.15.86:3300/0 conn(0x7f92bc060730 0x7f92bc0b1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:20:32.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.886+0000 7f92c1ee9700 1 --2- 172.21.15.103:0/3768651065 >> v2:172.21.15.103:3300/0 conn(0x7f92bc0bcc00 0x7f92bc0b2190 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f92bc0bd2a0 tx=0x7f92b4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:32.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.886+0000 7f92c1ee9700 1 --2- 172.21.15.103:0/3768651065 >> v2:172.21.15.103:3300/0 conn(0x7f92bc0bcc00 0x7f92bc0b2190 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f92bc0bd2a0 tx=0x7f92b4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:32.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.886+0000 7f92c1ee9700 1 --2- 172.21.15.103:0/3768651065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92bc0bcc00 0x7f92bc0b2190 secure :-1 s=READY pgs=2170 cs=0 l=1 rx=0x7f92bc0bd2a0 tx=0x7f92b4007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:32.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.886+0000 7f92c1ee9700 1 --2- 172.21.15.103:0/3768651065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92bc0bcc00 0x7f92bc0b2190 secure :-1 s=THROTTLE_DONE pgs=2170 cs=0 l=1 rx=0x7f92bc0bd2a0 tx=0x7f92b4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:32.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.886+0000 7f92aa7fc700 1 -- 172.21.15.103:0/3768651065 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92b40115c0 con 0x7f92bc0bcc00 2020-04-22T14:20:32.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.886+0000 7f92c1ee9700 1 --2- 172.21.15.103:0/3768651065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92bc0bcc00 0x7f92bc0b2190 secure :-1 s=THROTTLE_DONE pgs=2170 cs=0 l=1 rx=0x7f92bc0bd2a0 tx=0x7f92b4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:32.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.886+0000 7f92aa7fc700 1 -- 172.21.15.103:0/3768651065 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b4005a40 con 0x7f92bc0bcc00 2020-04-22T14:20:32.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.886+0000 7f92c1ee9700 1 --2- 172.21.15.103:0/3768651065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92bc0bcc00 0x7f92bc0b2190 secure :-1 s=THROTTLE_DONE pgs=2170 cs=0 l=1 rx=0x7f92bc0bd2a0 tx=0x7f92b4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:32.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.886+0000 7f92c26ea700 1 -- 172.21.15.103:0/3768651065 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92bc0b35b0 con 0x7f92bc0bcc00 2020-04-22T14:20:32.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.886+0000 7f92aa7fc700 1 -- 172.21.15.103:0/3768651065 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92b4005e60 con 0x7f92bc0bcc00 2020-04-22T14:20:32.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.886+0000 7f92c26ea700 1 -- 172.21.15.103:0/3768651065 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92bc157850 con 0x7f92bc0bcc00 2020-04-22T14:20:32.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.887+0000 7f92c1ee9700 1 --2- 172.21.15.103:0/3768651065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92bc0bcc00 0x7f92bc0b2190 secure :-1 s=THROTTLE_DONE pgs=2170 cs=0 l=1 rx=0x7f92bc0bd2a0 tx=0x7f92b4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:32.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.887+0000 7f92aa7fc700 1 -- 172.21.15.103:0/3768651065 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f92b4010700 con 0x7f92bc0bcc00 2020-04-22T14:20:32.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.887+0000 7f92c26ea700 1 -- 172.21.15.103:0/3768651065 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92bc0b2e10 con 0x7f92bc0bcc00 2020-04-22T14:20:32.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.887+0000 7f92c1ee9700 1 --2- 172.21.15.103:0/3768651065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92bc0bcc00 0x7f92bc0b2190 secure :-1 s=THROTTLE_DONE pgs=2170 cs=0 l=1 rx=0x7f92bc0bd2a0 tx=0x7f92b4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:32.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.887+0000 7f92aa7fc700 1 --2- 172.21.15.103:0/3768651065 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f929c04d8b0 0x7f929c04fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:32.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.888+0000 7f92aa7fc700 1 -- 172.21.15.103:0/3768651065 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f92b4062020 con 0x7f92bc0bcc00 2020-04-22T14:20:32.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.888+0000 7f92c16e8700 1 --2- 172.21.15.103:0/3768651065 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f929c04d8b0 0x7f929c04fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:32.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.888+0000 7f92c16e8700 1 --2- 172.21.15.103:0/3768651065 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f929c04d8b0 0x7f929c04fd70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f92ac001f50 tx=0x7f92ac0027a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:32.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.888+0000 7f92c16e8700 1 --2- 172.21.15.103:0/3768651065 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f929c04d8b0 0x7f929c04fd70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f92ac001f50 tx=0x7f92ac0027a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:32.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.888+0000 7f92c16e8700 1 --2- 172.21.15.103:0/3768651065 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f929c04d8b0 0x7f929c04fd70 secure :-1 s=READY pgs=785 cs=0 l=1 rx=0x7f92ac001f50 tx=0x7f92ac0027a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:32.901 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.891+0000 7f92c1ee9700 1 --2- 172.21.15.103:0/3768651065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92bc0bcc00 0x7f92bc0b2190 secure :-1 s=THROTTLE_DONE pgs=2170 cs=0 l=1 rx=0x7f92bc0bd2a0 tx=0x7f92b4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:32.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:32.891+0000 7f92aa7fc700 1 -- 172.21.15.103:0/3768651065 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f92b403d520 con 0x7f92bc0bcc00 2020-04-22T14:20:33.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.033+0000 7f92c26ea700 1 -- 172.21.15.103:0/3768651065 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f92bc056c90 con 0x7f92bc0bcc00 2020-04-22T14:20:33.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.035+0000 7f92c1ee9700 1 --2- 172.21.15.103:0/3768651065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92bc0bcc00 0x7f92bc0b2190 secure :-1 s=THROTTLE_DONE pgs=2170 cs=0 l=1 rx=0x7f92bc0bd2a0 tx=0x7f92b4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:33.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.035+0000 7f92aa7fc700 1 -- 172.21.15.103:0/3768651065 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v149) v1 ==== 81+0+33935 (secure 0 0 0) 0x7f92b4040b40 con 0x7f92bc0bcc00 2020-04-22T14:20:33.037 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:20:33.038 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:20:33.038 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 149, 2020-04-22T14:20:33.038 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:20:33.038 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2020-04-22T14:02:06.484738+0000", 2020-04-22T14:20:33.038 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2020-04-22T14:20:15.801693+0000", 2020-04-22T14:20:33.038 INFO:teuthology.orchestra.run.smithi103.stdout: "last_up_change": "2020-04-22T14:02:18.623774+0000", 2020-04-22T14:20:33.038 INFO:teuthology.orchestra.run.smithi103.stdout: "last_in_change": "2020-04-22T14:02:18.623774+0000", 2020-04-22T14:20:33.039 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-04-22T14:20:33.039 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_num": 5799936, 2020-04-22T14:20:33.039 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_set": [ 2020-04-22T14:20:33.039 INFO:teuthology.orchestra.run.smithi103.stdout: "pglog_hardlimit", 2020-04-22T14:20:33.039 INFO:teuthology.orchestra.run.smithi103.stdout: "purged_snapdirs", 2020-04-22T14:20:33.039 INFO:teuthology.orchestra.run.smithi103.stdout: "recovery_deletes", 2020-04-22T14:20:33.039 INFO:teuthology.orchestra.run.smithi103.stdout: "sortbitwise" 2020-04-22T14:20:33.040 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:20:33.040 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_version": 5, 2020-04-22T14:20:33.040 INFO:teuthology.orchestra.run.smithi103.stdout: "full_ratio": 0.94999998807907104, 2020-04-22T14:20:33.040 INFO:teuthology.orchestra.run.smithi103.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-04-22T14:20:33.040 INFO:teuthology.orchestra.run.smithi103.stdout: "nearfull_ratio": 0.85000002384185791, 2020-04-22T14:20:33.040 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_snapshot": "", 2020-04-22T14:20:33.040 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_max": 26, 2020-04-22T14:20:33.040 INFO:teuthology.orchestra.run.smithi103.stdout: "max_osd": 8, 2020-04-22T14:20:33.041 INFO:teuthology.orchestra.run.smithi103.stdout: "require_min_compat_client": "luminous", 2020-04-22T14:20:33.041 INFO:teuthology.orchestra.run.smithi103.stdout: "min_compat_client": "jewel", 2020-04-22T14:20:33.041 INFO:teuthology.orchestra.run.smithi103.stdout: "require_osd_release": "pacific", 2020-04-22T14:20:33.041 INFO:teuthology.orchestra.run.smithi103.stdout: "pools": [ 2020-04-22T14:20:33.041 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.041 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 1, 2020-04-22T14:20:33.041 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "device_health_metrics", 2020-04-22T14:20:33.042 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:02:09.565655+0000", 2020-04-22T14:20:33.042 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:20:33.042 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:20:33.042 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:20:33.042 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:20:33.042 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:20:33.042 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:20:33.042 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:20:33.043 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:20:33.043 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 1, 2020-04-22T14:20:33.043 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 1, 2020-04-22T14:20:33.043 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 1, 2020-04-22T14:20:33.043 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 1, 2020-04-22T14:20:33.043 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 1, 2020-04-22T14:20:33.043 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:20:33.044 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:20:33.044 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:20:33.044 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:20:33.044 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:20:33.044 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:20:33.044 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:20:33.044 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.045 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "17", 2020-04-22T14:20:33.045 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:20:33.045 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:20:33.045 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:20:33.045 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:20:33.045 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:20:33.045 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:20:33.045 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:20:33.046 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:20:33.046 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:20:33.046 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:20:33.046 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:20:33.046 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:20:33.046 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:20:33.046 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:20:33.047 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:20:33.047 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:20:33.047 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:20:33.047 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:20:33.047 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:20:33.047 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:20:33.047 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:20:33.047 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:20:33.048 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:20:33.048 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:20:33.048 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:20:33.048 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:20:33.048 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.048 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:20:33.048 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:20:33.049 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:20:33.049 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:20:33.049 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:20:33.049 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:20:33.049 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:20:33.049 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:20:33.049 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:20:33.050 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:20:33.050 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:20:33.050 INFO:teuthology.orchestra.run.smithi103.stdout: "options": { 2020-04-22T14:20:33.050 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_min": 1 2020-04-22T14:20:33.050 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.050 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:20:33.050 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_devicehealth": {} 2020-04-22T14:20:33.050 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.051 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.051 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.051 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 2, 2020-04-22T14:20:33.051 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "rbd", 2020-04-22T14:20:33.051 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:02:22.733031+0000", 2020-04-22T14:20:33.051 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:20:33.051 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:20:33.052 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:20:33.052 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:20:33.052 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:20:33.052 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:20:33.052 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:20:33.052 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:20:33.052 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 8, 2020-04-22T14:20:33.052 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 8, 2020-04-22T14:20:33.053 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 8, 2020-04-22T14:20:33.053 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 8, 2020-04-22T14:20:33.053 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 8, 2020-04-22T14:20:33.053 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:20:33.053 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:20:33.053 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:20:33.054 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:20:33.054 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:20:33.054 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:20:33.054 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:20:33.054 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.054 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "20", 2020-04-22T14:20:33.054 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:20:33.055 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:20:33.056 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:20:33.056 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:20:33.056 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:20:33.056 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:20:33.056 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:20:33.056 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:20:33.058 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:20:33.058 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:20:33.058 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:20:33.058 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:20:33.059 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:20:33.059 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:20:33.059 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:20:33.059 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:20:33.064 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:20:33.064 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:20:33.064 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:20:33.064 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:20:33.064 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:20:33.064 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:20:33.064 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:20:33.065 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:20:33.065 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:20:33.065 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:20:33.066 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.066 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:20:33.066 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:20:33.066 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:20:33.066 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:20:33.066 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:20:33.066 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:20:33.067 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:20:33.067 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:20:33.067 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:20:33.067 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:20:33.067 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:20:33.067 INFO:teuthology.orchestra.run.smithi103.stdout: "options": {}, 2020-04-22T14:20:33.067 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:20:33.068 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd": {} 2020-04-22T14:20:33.068 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.068 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.068 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.068 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 25, 2020-04-22T14:20:33.068 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "cephfs_metadata", 2020-04-22T14:20:33.068 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:19:44.035980+0000", 2020-04-22T14:20:33.069 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:20:33.069 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:20:33.072 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:20:33.072 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:20:33.072 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:20:33.072 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:20:33.073 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:20:33.073 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:20:33.073 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 8, 2020-04-22T14:20:33.073 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 8, 2020-04-22T14:20:33.073 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 8, 2020-04-22T14:20:33.073 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 8, 2020-04-22T14:20:33.073 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 8, 2020-04-22T14:20:33.073 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:20:33.074 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:20:33.074 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:20:33.074 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:20:33.074 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:20:33.074 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:20:33.074 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:20:33.074 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.075 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "145", 2020-04-22T14:20:33.075 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:20:33.075 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:20:33.075 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:20:33.075 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:20:33.075 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:20:33.075 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:20:33.075 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:20:33.076 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:20:33.076 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:20:33.076 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:20:33.076 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:20:33.076 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:20:33.077 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:20:33.077 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:20:33.077 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:20:33.077 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:20:33.077 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:20:33.078 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:20:33.078 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:20:33.079 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:20:33.080 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:20:33.080 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:20:33.080 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:20:33.080 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:20:33.080 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:20:33.081 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:20:33.081 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.082 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:20:33.082 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:20:33.082 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:20:33.082 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:20:33.082 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:20:33.082 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:20:33.082 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:20:33.083 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:20:33.083 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:20:33.083 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:20:33.083 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:20:33.083 INFO:teuthology.orchestra.run.smithi103.stdout: "options": { 2020-04-22T14:20:33.083 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_bias": 4, 2020-04-22T14:20:33.083 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_min": 16, 2020-04-22T14:20:33.083 INFO:teuthology.orchestra.run.smithi103.stdout: "recovery_priority": 5 2020-04-22T14:20:33.084 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.084 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:20:33.084 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs": { 2020-04-22T14:20:33.084 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": "cephfs" 2020-04-22T14:20:33.084 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.084 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.084 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.085 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.085 INFO:teuthology.orchestra.run.smithi103.stdout: "pool": 26, 2020-04-22T14:20:33.085 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": "cephfs_data", 2020-04-22T14:20:33.085 INFO:teuthology.orchestra.run.smithi103.stdout: "create_time": "2020-04-22T14:19:45.079896+0000", 2020-04-22T14:20:33.085 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2020-04-22T14:20:33.085 INFO:teuthology.orchestra.run.smithi103.stdout: "flags_names": "hashpspool", 2020-04-22T14:20:33.085 INFO:teuthology.orchestra.run.smithi103.stdout: "type": 1, 2020-04-22T14:20:33.085 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 2, 2020-04-22T14:20:33.086 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": 1, 2020-04-22T14:20:33.086 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_rule": 0, 2020-04-22T14:20:33.086 INFO:teuthology.orchestra.run.smithi103.stdout: "object_hash": 2, 2020-04-22T14:20:33.086 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscale_mode": "off", 2020-04-22T14:20:33.086 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": 8, 2020-04-22T14:20:33.086 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num": 8, 2020-04-22T14:20:33.086 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_placement_num_target": 8, 2020-04-22T14:20:33.087 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_target": 8, 2020-04-22T14:20:33.087 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num_pending": 8, 2020-04-22T14:20:33.087 INFO:teuthology.orchestra.run.smithi103.stdout: "last_pg_merge_meta": { 2020-04-22T14:20:33.087 INFO:teuthology.orchestra.run.smithi103.stdout: "source_pgid": "0.0", 2020-04-22T14:20:33.087 INFO:teuthology.orchestra.run.smithi103.stdout: "ready_epoch": 0, 2020-04-22T14:20:33.087 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_started": 0, 2020-04-22T14:20:33.087 INFO:teuthology.orchestra.run.smithi103.stdout: "last_epoch_clean": 0, 2020-04-22T14:20:33.087 INFO:teuthology.orchestra.run.smithi103.stdout: "source_version": "0'0", 2020-04-22T14:20:33.088 INFO:teuthology.orchestra.run.smithi103.stdout: "target_version": "0'0" 2020-04-22T14:20:33.088 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.088 INFO:teuthology.orchestra.run.smithi103.stdout: "last_change": "146", 2020-04-22T14:20:33.088 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend": "0", 2020-04-22T14:20:33.088 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_prenautilus": "0", 2020-04-22T14:20:33.088 INFO:teuthology.orchestra.run.smithi103.stdout: "last_force_op_resend_preluminous": "0", 2020-04-22T14:20:33.088 INFO:teuthology.orchestra.run.smithi103.stdout: "auid": 0, 2020-04-22T14:20:33.089 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_mode": "selfmanaged", 2020-04-22T14:20:33.089 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_seq": 0, 2020-04-22T14:20:33.089 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_epoch": 0, 2020-04-22T14:20:33.089 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_snaps": [], 2020-04-22T14:20:33.089 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps": "[]", 2020-04-22T14:20:33.089 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_bytes": 0, 2020-04-22T14:20:33.089 INFO:teuthology.orchestra.run.smithi103.stdout: "quota_max_objects": 0, 2020-04-22T14:20:33.090 INFO:teuthology.orchestra.run.smithi103.stdout: "tiers": [], 2020-04-22T14:20:33.090 INFO:teuthology.orchestra.run.smithi103.stdout: "tier_of": -1, 2020-04-22T14:20:33.090 INFO:teuthology.orchestra.run.smithi103.stdout: "read_tier": -1, 2020-04-22T14:20:33.090 INFO:teuthology.orchestra.run.smithi103.stdout: "write_tier": -1, 2020-04-22T14:20:33.090 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_mode": "none", 2020-04-22T14:20:33.090 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_bytes": 0, 2020-04-22T14:20:33.090 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_objects": 0, 2020-04-22T14:20:33.090 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-04-22T14:20:33.091 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-04-22T14:20:33.091 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_target_full_ratio_micro": 800000, 2020-04-22T14:20:33.091 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_flush_age": 0, 2020-04-22T14:20:33.091 INFO:teuthology.orchestra.run.smithi103.stdout: "cache_min_evict_age": 0, 2020-04-22T14:20:33.091 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profile": "", 2020-04-22T14:20:33.091 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_params": { 2020-04-22T14:20:33.091 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "none" 2020-04-22T14:20:33.092 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.092 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_period": 0, 2020-04-22T14:20:33.092 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_count": 0, 2020-04-22T14:20:33.092 INFO:teuthology.orchestra.run.smithi103.stdout: "use_gmt_hitset": true, 2020-04-22T14:20:33.092 INFO:teuthology.orchestra.run.smithi103.stdout: "min_read_recency_for_promote": 0, 2020-04-22T14:20:33.092 INFO:teuthology.orchestra.run.smithi103.stdout: "min_write_recency_for_promote": 0, 2020-04-22T14:20:33.092 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_grade_decay_rate": 0, 2020-04-22T14:20:33.092 INFO:teuthology.orchestra.run.smithi103.stdout: "hit_set_search_last_n": 0, 2020-04-22T14:20:33.093 INFO:teuthology.orchestra.run.smithi103.stdout: "grade_table": [], 2020-04-22T14:20:33.093 INFO:teuthology.orchestra.run.smithi103.stdout: "stripe_width": 0, 2020-04-22T14:20:33.093 INFO:teuthology.orchestra.run.smithi103.stdout: "expected_num_objects": 0, 2020-04-22T14:20:33.093 INFO:teuthology.orchestra.run.smithi103.stdout: "fast_read": false, 2020-04-22T14:20:33.093 INFO:teuthology.orchestra.run.smithi103.stdout: "options": {}, 2020-04-22T14:20:33.093 INFO:teuthology.orchestra.run.smithi103.stdout: "application_metadata": { 2020-04-22T14:20:33.093 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs": { 2020-04-22T14:20:33.094 INFO:teuthology.orchestra.run.smithi103.stdout: "data": "cephfs" 2020-04-22T14:20:33.094 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.094 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.094 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.094 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:20:33.094 INFO:teuthology.orchestra.run.smithi103.stdout: "osds": [ 2020-04-22T14:20:33.094 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.094 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 0, 2020-04-22T14:20:33.095 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "3546145b-bd93-4a79-b6fe-3158153b8f05", 2020-04-22T14:20:33.095 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:20:33.095 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:20:33.095 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:20:33.095 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:20:33.095 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:20:33.095 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:20:33.095 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:20:33.096 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 143, 2020-04-22T14:20:33.096 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:20:33.096 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:20:33.096 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:20:33.096 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:20:33.096 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.096 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:20:33.097 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6800", 2020-04-22T14:20:33.097 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:20:33.097 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.097 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.097 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:20:33.097 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6801", 2020-04-22T14:20:33.097 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:20:33.097 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.098 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:33.098 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.098 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:20:33.098 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:20:33.098 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.098 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:20:33.098 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6802", 2020-04-22T14:20:33.099 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:20:33.099 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.099 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.099 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:20:33.099 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6803", 2020-04-22T14:20:33.099 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:20:33.099 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.099 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:33.100 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.100 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:20:33.100 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:20:33.100 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.100 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:20:33.100 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6806", 2020-04-22T14:20:33.100 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:20:33.100 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.101 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.101 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:20:33.101 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6807", 2020-04-22T14:20:33.101 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:20:33.101 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.101 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:33.101 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.102 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:20:33.102 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:20:33.102 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.102 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:20:33.102 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6804", 2020-04-22T14:20:33.102 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:20:33.102 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.102 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.103 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:20:33.103 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6805", 2020-04-22T14:20:33.103 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33072 2020-04-22T14:20:33.103 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.103 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:33.103 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.104 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6801/33072", 2020-04-22T14:20:33.104 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6803/33072", 2020-04-22T14:20:33.104 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6807/33072", 2020-04-22T14:20:33.104 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6805/33072", 2020-04-22T14:20:33.104 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:20:33.105 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:20:33.105 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:20:33.105 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:33.105 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.105 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.105 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 1, 2020-04-22T14:20:33.105 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "65ca5f7d-2ea6-4de6-a034-08a0a99aa80d", 2020-04-22T14:20:33.105 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:20:33.106 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:20:33.106 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:20:33.106 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:20:33.106 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:20:33.106 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:20:33.106 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:20:33.106 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 144, 2020-04-22T14:20:33.107 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:20:33.107 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:20:33.107 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:20:33.107 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:20:33.107 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.107 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:20:33.107 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6808", 2020-04-22T14:20:33.107 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:20:33.108 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.108 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.108 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:20:33.108 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6809", 2020-04-22T14:20:33.108 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:20:33.108 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.108 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:33.108 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.109 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:20:33.109 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:20:33.109 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.109 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:20:33.109 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6810", 2020-04-22T14:20:33.109 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:20:33.109 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.110 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.110 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:20:33.110 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6811", 2020-04-22T14:20:33.111 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:20:33.111 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.111 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:33.112 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.112 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:20:33.112 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:20:33.112 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.112 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:20:33.112 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6814", 2020-04-22T14:20:33.112 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:20:33.113 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.113 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.113 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:20:33.113 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6815", 2020-04-22T14:20:33.113 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:20:33.113 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.113 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:33.113 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.114 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:20:33.114 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:20:33.114 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.114 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:20:33.114 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6812", 2020-04-22T14:20:33.114 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:20:33.114 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.114 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.115 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:20:33.115 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6813", 2020-04-22T14:20:33.115 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33103 2020-04-22T14:20:33.115 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.115 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:33.115 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.115 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6809/33103", 2020-04-22T14:20:33.115 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6811/33103", 2020-04-22T14:20:33.116 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6815/33103", 2020-04-22T14:20:33.116 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6813/33103", 2020-04-22T14:20:33.116 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:20:33.116 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:20:33.116 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:20:33.116 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:33.116 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.117 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.117 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 2, 2020-04-22T14:20:33.117 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "f2e9bf44-c844-48d7-b6c2-f08ea71189b4", 2020-04-22T14:20:33.117 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:20:33.117 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:20:33.117 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:20:33.117 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:20:33.117 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:20:33.118 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:20:33.118 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:20:33.118 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 144, 2020-04-22T14:20:33.118 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:20:33.118 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:20:33.118 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:20:33.118 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:20:33.118 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.119 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:20:33.119 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6816", 2020-04-22T14:20:33.119 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:20:33.119 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.119 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.119 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:20:33.119 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6817", 2020-04-22T14:20:33.120 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:20:33.120 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.120 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:33.121 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.121 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:20:33.121 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:20:33.121 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.122 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:20:33.122 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6818", 2020-04-22T14:20:33.122 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:20:33.122 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.122 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.123 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:20:33.123 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6819", 2020-04-22T14:20:33.123 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:20:33.123 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.123 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:33.123 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.123 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:20:33.124 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:20:33.124 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.124 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:20:33.124 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6822", 2020-04-22T14:20:33.124 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:20:33.124 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.124 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.125 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:20:33.125 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6823", 2020-04-22T14:20:33.125 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:20:33.125 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.125 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:33.125 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.125 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:20:33.125 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:20:33.126 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.126 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:20:33.126 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6820", 2020-04-22T14:20:33.126 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:20:33.126 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.126 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.126 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:20:33.126 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6821", 2020-04-22T14:20:33.127 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33153 2020-04-22T14:20:33.127 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.127 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:33.127 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.127 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6817/33153", 2020-04-22T14:20:33.127 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6819/33153", 2020-04-22T14:20:33.127 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6823/33153", 2020-04-22T14:20:33.128 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6821/33153", 2020-04-22T14:20:33.128 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:20:33.128 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:20:33.128 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:20:33.128 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:33.128 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.128 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.128 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 3, 2020-04-22T14:20:33.129 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "0ab87fee-a427-4906-851a-b9bd8c2e5645", 2020-04-22T14:20:33.129 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:20:33.129 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:20:33.129 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:20:33.129 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:20:33.129 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:20:33.129 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:20:33.130 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 14, 2020-04-22T14:20:33.130 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 143, 2020-04-22T14:20:33.130 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:20:33.130 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:20:33.130 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:20:33.130 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:20:33.130 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.130 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:20:33.131 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6824", 2020-04-22T14:20:33.131 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:20:33.131 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.131 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.131 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:20:33.131 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6825", 2020-04-22T14:20:33.131 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:20:33.131 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.132 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:33.132 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.132 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:20:33.132 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:20:33.132 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.132 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:20:33.132 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6826", 2020-04-22T14:20:33.133 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:20:33.133 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.133 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.133 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:20:33.133 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6827", 2020-04-22T14:20:33.133 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:20:33.133 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.134 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:33.134 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.134 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:20:33.134 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:20:33.134 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.134 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:20:33.134 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6830", 2020-04-22T14:20:33.134 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:20:33.135 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.135 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.135 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:20:33.135 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6831", 2020-04-22T14:20:33.135 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:20:33.135 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.135 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:33.135 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.136 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:20:33.136 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:20:33.136 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.136 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:20:33.136 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6828", 2020-04-22T14:20:33.136 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:20:33.136 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.137 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.137 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:20:33.137 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6829", 2020-04-22T14:20:33.137 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33183 2020-04-22T14:20:33.137 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.137 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:33.137 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.137 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6825/33183", 2020-04-22T14:20:33.138 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.103:6827/33183", 2020-04-22T14:20:33.138 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.103:6831/33183", 2020-04-22T14:20:33.138 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.103:6829/33183", 2020-04-22T14:20:33.138 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:20:33.138 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:20:33.138 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:20:33.138 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:33.139 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.139 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.139 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 4, 2020-04-22T14:20:33.139 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "2565df7d-2eff-484b-a3cd-ed7715e5d875", 2020-04-22T14:20:33.139 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:20:33.139 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:20:33.139 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:20:33.139 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:20:33.140 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:20:33.140 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:20:33.140 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:20:33.140 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 144, 2020-04-22T14:20:33.140 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:20:33.140 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:20:33.140 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:20:33.141 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:20:33.141 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.141 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:20:33.141 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6802", 2020-04-22T14:20:33.141 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:20:33.141 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.141 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.141 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:20:33.142 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6803", 2020-04-22T14:20:33.142 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:20:33.142 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.142 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:33.142 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.142 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:20:33.142 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:20:33.143 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.143 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:20:33.143 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6804", 2020-04-22T14:20:33.143 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:20:33.143 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.143 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.143 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:20:33.143 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6805", 2020-04-22T14:20:33.144 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:20:33.144 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.144 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:33.144 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.144 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:20:33.144 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:20:33.144 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.145 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:20:33.145 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6808", 2020-04-22T14:20:33.145 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:20:33.145 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.145 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.145 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:20:33.145 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6809", 2020-04-22T14:20:33.145 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:20:33.146 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.146 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:33.146 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.146 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:20:33.146 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:20:33.146 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.146 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:20:33.146 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6806", 2020-04-22T14:20:33.147 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:20:33.147 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.147 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.147 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:20:33.147 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6807", 2020-04-22T14:20:33.147 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33506 2020-04-22T14:20:33.147 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.148 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:33.148 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.148 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6803/33506", 2020-04-22T14:20:33.148 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6805/33506", 2020-04-22T14:20:33.148 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6809/33506", 2020-04-22T14:20:33.148 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6807/33506", 2020-04-22T14:20:33.148 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:20:33.148 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:20:33.149 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:20:33.149 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:33.149 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.149 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.149 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 5, 2020-04-22T14:20:33.149 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "bcfd7a16-6914-4152-8647-a481917fe19d", 2020-04-22T14:20:33.149 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:20:33.150 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:20:33.150 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:20:33.150 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:20:33.150 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:20:33.150 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:20:33.150 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:20:33.150 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 133, 2020-04-22T14:20:33.150 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:20:33.151 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:20:33.151 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:20:33.151 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:20:33.151 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.151 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:20:33.151 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6810", 2020-04-22T14:20:33.151 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:20:33.151 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.152 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.152 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:20:33.152 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6811", 2020-04-22T14:20:33.152 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:20:33.152 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.152 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:33.152 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.153 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:20:33.153 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:20:33.153 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.153 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:20:33.153 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6812", 2020-04-22T14:20:33.153 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:20:33.153 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.153 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.154 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:20:33.154 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6813", 2020-04-22T14:20:33.154 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:20:33.154 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.154 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:33.154 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.154 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:20:33.154 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:20:33.155 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.155 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:20:33.155 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6816", 2020-04-22T14:20:33.155 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:20:33.155 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.155 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.155 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:20:33.156 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6817", 2020-04-22T14:20:33.156 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:20:33.156 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.156 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:33.156 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.156 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:20:33.156 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:20:33.157 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.157 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:20:33.157 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6814", 2020-04-22T14:20:33.157 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:20:33.157 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.157 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.158 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:20:33.158 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6815", 2020-04-22T14:20:33.158 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33554 2020-04-22T14:20:33.158 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.158 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:33.158 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.158 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6811/33554", 2020-04-22T14:20:33.158 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6813/33554", 2020-04-22T14:20:33.159 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6817/33554", 2020-04-22T14:20:33.159 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6815/33554", 2020-04-22T14:20:33.159 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:20:33.159 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:20:33.159 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:20:33.159 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:33.159 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.160 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.160 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 6, 2020-04-22T14:20:33.160 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050", 2020-04-22T14:20:33.160 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:20:33.160 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:20:33.160 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:20:33.160 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:20:33.160 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:20:33.161 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:20:33.161 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:20:33.161 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 144, 2020-04-22T14:20:33.161 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:20:33.161 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:20:33.161 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:20:33.161 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:20:33.162 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.162 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:20:33.162 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6818", 2020-04-22T14:20:33.162 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:20:33.162 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.162 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.162 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:20:33.162 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6819", 2020-04-22T14:20:33.163 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:20:33.163 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.163 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:33.163 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.163 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:20:33.163 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:20:33.163 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.164 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:20:33.164 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6820", 2020-04-22T14:20:33.164 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:20:33.164 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.164 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.164 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:20:33.165 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6821", 2020-04-22T14:20:33.165 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:20:33.165 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.165 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:33.165 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.165 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:20:33.165 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:20:33.166 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.166 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:20:33.166 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6824", 2020-04-22T14:20:33.166 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:20:33.166 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.167 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.167 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:20:33.167 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6825", 2020-04-22T14:20:33.167 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:20:33.167 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.167 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:33.167 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.167 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:20:33.168 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:20:33.168 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.168 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:20:33.168 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6822", 2020-04-22T14:20:33.168 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:20:33.168 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.168 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.169 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:20:33.169 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6823", 2020-04-22T14:20:33.169 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33601 2020-04-22T14:20:33.169 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.169 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:33.169 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.169 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6819/33601", 2020-04-22T14:20:33.169 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6821/33601", 2020-04-22T14:20:33.170 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6825/33601", 2020-04-22T14:20:33.170 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6823/33601", 2020-04-22T14:20:33.170 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:20:33.170 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:20:33.170 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:20:33.170 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:33.170 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.171 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.171 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 7, 2020-04-22T14:20:33.171 INFO:teuthology.orchestra.run.smithi103.stdout: "uuid": "340eece1-4c39-47cd-b95f-9cfa5dcfe361", 2020-04-22T14:20:33.171 INFO:teuthology.orchestra.run.smithi103.stdout: "up": 1, 2020-04-22T14:20:33.171 INFO:teuthology.orchestra.run.smithi103.stdout: "in": 1, 2020-04-22T14:20:33.171 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 1, 2020-04-22T14:20:33.171 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_affinity": 1, 2020-04-22T14:20:33.171 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_begin": 0, 2020-04-22T14:20:33.172 INFO:teuthology.orchestra.run.smithi103.stdout: "last_clean_end": 0, 2020-04-22T14:20:33.172 INFO:teuthology.orchestra.run.smithi103.stdout: "up_from": 15, 2020-04-22T14:20:33.172 INFO:teuthology.orchestra.run.smithi103.stdout: "up_thru": 144, 2020-04-22T14:20:33.172 INFO:teuthology.orchestra.run.smithi103.stdout: "down_at": 0, 2020-04-22T14:20:33.172 INFO:teuthology.orchestra.run.smithi103.stdout: "lost_at": 0, 2020-04-22T14:20:33.172 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2020-04-22T14:20:33.173 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:20:33.173 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.173 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:20:33.173 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6826", 2020-04-22T14:20:33.173 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:20:33.173 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.174 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.174 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:20:33.174 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6827", 2020-04-22T14:20:33.174 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:20:33.174 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.174 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:33.174 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.175 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addrs": { 2020-04-22T14:20:33.175 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:20:33.175 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.175 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:20:33.175 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6828", 2020-04-22T14:20:33.175 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:20:33.175 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.175 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.176 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:20:33.176 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6829", 2020-04-22T14:20:33.176 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:20:33.176 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.176 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:33.176 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.176 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addrs": { 2020-04-22T14:20:33.177 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:20:33.177 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.177 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:20:33.177 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6832", 2020-04-22T14:20:33.177 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:20:33.177 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.177 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.177 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:20:33.178 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6833", 2020-04-22T14:20:33.178 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:20:33.178 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.178 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:33.178 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.178 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addrs": { 2020-04-22T14:20:33.178 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:20:33.178 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.179 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:20:33.179 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6830", 2020-04-22T14:20:33.179 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:20:33.179 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.179 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.179 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:20:33.179 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6831", 2020-04-22T14:20:33.180 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 33629 2020-04-22T14:20:33.180 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.180 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:33.180 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.180 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.86:6827/33629", 2020-04-22T14:20:33.180 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "172.21.15.86:6829/33629", 2020-04-22T14:20:33.180 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_back_addr": "172.21.15.86:6833/33629", 2020-04-22T14:20:33.180 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_front_addr": "172.21.15.86:6831/33629", 2020-04-22T14:20:33.181 INFO:teuthology.orchestra.run.smithi103.stdout: "state": [ 2020-04-22T14:20:33.181 INFO:teuthology.orchestra.run.smithi103.stdout: "exists", 2020-04-22T14:20:33.181 INFO:teuthology.orchestra.run.smithi103.stdout: "up" 2020-04-22T14:20:33.181 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:33.181 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.181 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:20:33.181 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_xinfo": [ 2020-04-22T14:20:33.182 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.182 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 0, 2020-04-22T14:20:33.182 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:20:33.182 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:20:33.182 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:20:33.182 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:20:33.182 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:20:33.182 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.384360+0000", 2020-04-22T14:20:33.183 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:20:33.183 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.183 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.183 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 1, 2020-04-22T14:20:33.183 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:20:33.183 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:20:33.183 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:20:33.184 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:20:33.184 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:20:33.184 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.503590+0000", 2020-04-22T14:20:33.184 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:20:33.184 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.184 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.184 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 2, 2020-04-22T14:20:33.184 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:20:33.185 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:20:33.185 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:20:33.185 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:20:33.185 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:20:33.185 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.525058+0000", 2020-04-22T14:20:33.185 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:20:33.185 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.186 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.186 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 3, 2020-04-22T14:20:33.186 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:20:33.186 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:20:33.186 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:20:33.186 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:20:33.186 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:20:33.186 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.599729+0000", 2020-04-22T14:20:33.187 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:20:33.187 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.187 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.187 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 4, 2020-04-22T14:20:33.187 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:20:33.187 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:20:33.187 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:20:33.187 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:20:33.188 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:20:33.188 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.600919+0000", 2020-04-22T14:20:33.188 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:20:33.188 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.188 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.188 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 5, 2020-04-22T14:20:33.188 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:20:33.189 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:20:33.189 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:20:33.189 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:20:33.189 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:20:33.189 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.654718+0000", 2020-04-22T14:20:33.189 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:20:33.189 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.189 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.190 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 6, 2020-04-22T14:20:33.190 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:20:33.190 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:20:33.190 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:20:33.190 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:20:33.190 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:20:33.190 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.718342+0000", 2020-04-22T14:20:33.191 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:20:33.191 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.191 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:33.191 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": 7, 2020-04-22T14:20:33.191 INFO:teuthology.orchestra.run.smithi103.stdout: "down_stamp": "0.000000", 2020-04-22T14:20:33.191 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_probability": 0, 2020-04-22T14:20:33.192 INFO:teuthology.orchestra.run.smithi103.stdout: "laggy_interval": 0, 2020-04-22T14:20:33.192 INFO:teuthology.orchestra.run.smithi103.stdout: "features": 4540138292837744639, 2020-04-22T14:20:33.192 INFO:teuthology.orchestra.run.smithi103.stdout: "old_weight": 0, 2020-04-22T14:20:33.192 INFO:teuthology.orchestra.run.smithi103.stdout: "last_purged_snaps_scrub": "2020-04-22T14:02:16.839089+0000", 2020-04-22T14:20:33.192 INFO:teuthology.orchestra.run.smithi103.stdout: "dead_epoch": 0 2020-04-22T14:20:33.192 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.192 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:20:33.193 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_upmap": [], 2020-04-22T14:20:33.193 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_upmap_items": [], 2020-04-22T14:20:33.193 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_temp": [], 2020-04-22T14:20:33.193 INFO:teuthology.orchestra.run.smithi103.stdout: "primary_temp": [], 2020-04-22T14:20:33.193 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklist": { 2020-04-22T14:20:33.193 INFO:teuthology.orchestra.run.smithi103.stdout: "192.168.0.1:0/3303065033": "2020-04-22T15:20:15.236487+0000", 2020-04-22T14:20:33.193 INFO:teuthology.orchestra.run.smithi103.stdout: "172.21.15.103:6833/839133818": "2020-04-23T14:20:04.739433+0000", 2020-04-22T14:20:33.193 INFO:teuthology.orchestra.run.smithi103.stdout: "172.21.15.103:6832/839133818": "2020-04-23T14:20:04.739433+0000" 2020-04-22T14:20:33.194 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.194 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_profiles": { 2020-04-22T14:20:33.195 INFO:teuthology.orchestra.run.smithi103.stdout: "default": { 2020-04-22T14:20:33.195 INFO:teuthology.orchestra.run.smithi103.stdout: "crush-failure-domain": "osd", 2020-04-22T14:20:33.195 INFO:teuthology.orchestra.run.smithi103.stdout: "k": "2", 2020-04-22T14:20:33.195 INFO:teuthology.orchestra.run.smithi103.stdout: "m": "1", 2020-04-22T14:20:33.195 INFO:teuthology.orchestra.run.smithi103.stdout: "plugin": "jerasure", 2020-04-22T14:20:33.195 INFO:teuthology.orchestra.run.smithi103.stdout: "ruleset-failure-domain": "osd", 2020-04-22T14:20:33.196 INFO:teuthology.orchestra.run.smithi103.stdout: "technique": "reed_sol_van" 2020-04-22T14:20:33.196 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:33.196 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:33.196 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_snaps_queue": [], 2020-04-22T14:20:33.196 INFO:teuthology.orchestra.run.smithi103.stdout: "new_removed_snaps": [], 2020-04-22T14:20:33.196 INFO:teuthology.orchestra.run.smithi103.stdout: "new_purged_snaps": [], 2020-04-22T14:20:33.196 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_node_flags": {}, 2020-04-22T14:20:33.197 INFO:teuthology.orchestra.run.smithi103.stdout: "device_class_flags": {} 2020-04-22T14:20:33.197 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:20:33.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.036+0000 7f92c26ea700 1 -- 172.21.15.103:0/3768651065 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f929c04d8b0 msgr2=0x7f929c04fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:33.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.036+0000 7f92c26ea700 1 --2- 172.21.15.103:0/3768651065 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f929c04d8b0 0x7f929c04fd70 secure :-1 s=READY pgs=785 cs=0 l=1 rx=0x7f92ac001f50 tx=0x7f92ac0027a0).stop 2020-04-22T14:20:33.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.036+0000 7f92c26ea700 1 -- 172.21.15.103:0/3768651065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92bc0bcc00 msgr2=0x7f92bc0b2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:33.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.036+0000 7f92c26ea700 1 --2- 172.21.15.103:0/3768651065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92bc0bcc00 0x7f92bc0b2190 secure :-1 s=READY pgs=2170 cs=0 l=1 rx=0x7f92bc0bd2a0 tx=0x7f92b4007dc0).stop 2020-04-22T14:20:33.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.036+0000 7f92c26ea700 1 -- 172.21.15.103:0/3768651065 shutdown_connections 2020-04-22T14:20:33.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.036+0000 7f92c26ea700 1 --2- 172.21.15.103:0/3768651065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92bc0bcc00 0x7f92bc0b2190 unknown :-1 s=CLOSED pgs=2170 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:33.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.036+0000 7f92c26ea700 1 --2- 172.21.15.103:0/3768651065 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f929c04d8b0 0x7f929c04fd70 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:33.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.036+0000 7f92c26ea700 1 --2- 172.21.15.103:0/3768651065 >> v2:172.21.15.86:3300/0 conn(0x7f92bc060730 0x7f92bc0b1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:33.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.036+0000 7f92c26ea700 1 -- 172.21.15.103:0/3768651065 >> 172.21.15.103:0/3768651065 conn(0x7f92bc069f30 msgr2=0x7f92bc05ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:33.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.036+0000 7f92c26ea700 1 -- 172.21.15.103:0/3768651065 shutdown_connections 2020-04-22T14:20:33.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.036+0000 7f92c26ea700 1 -- 172.21.15.103:0/3768651065 wait complete. 2020-04-22T14:20:33.201 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:33.215 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:20:33.364 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.359+0000 7f98074d7700 1 Processor -- start 2020-04-22T14:20:33.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.360+0000 7f98074d7700 1 -- start start 2020-04-22T14:20:33.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.360+0000 7f98074d7700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f980014a2b0 0x7f98000ac740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:33.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.360+0000 7f98074d7700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f980014a720 con 0x7f9800140320 2020-04-22T14:20:33.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.360+0000 7f98074d7700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98001462f0 con 0x7f98000ae1a0 2020-04-22T14:20:33.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.360+0000 7f98074d7700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9800146590 con 0x7f980014a2b0 2020-04-22T14:20:33.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.360+0000 7f9805a74700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f980014a2b0 0x7f98000ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:33.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.360+0000 7f9805a74700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f980014a2b0 0x7f98000ac740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59008/0 (socket says 172.21.15.103:59008) 2020-04-22T14:20:33.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.360+0000 7f9805a74700 1 -- 172.21.15.103:0/400378094 learned_addr learned my addr 172.21.15.103:0/400378094 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:33.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.361+0000 7f9805a74700 1 -- 172.21.15.103:0/400378094 >> v1:172.21.15.103:6789/0 conn(0x7f98000ae1a0 legacy=0x7f98000bd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:33.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.361+0000 7f9805a74700 1 -- 172.21.15.103:0/400378094 >> v1:172.21.15.86:6789/0 conn(0x7f9800140320 legacy=0x7f9800146cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:33.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.361+0000 7f9805a74700 1 -- 172.21.15.103:0/400378094 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9800146830 con 0x7f980014a2b0 2020-04-22T14:20:33.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.361+0000 7f9805a74700 1 --2- 172.21.15.103:0/400378094 >> v2:172.21.15.103:3300/0 conn(0x7f980014a2b0 0x7f98000ac740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f97f4002f30 tx=0x7f97f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:33.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.361+0000 7f9805a74700 1 --2- 172.21.15.103:0/400378094 >> v2:172.21.15.103:3300/0 conn(0x7f980014a2b0 0x7f98000ac740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f97f4002f30 tx=0x7f97f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:33.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.361+0000 7f9805a74700 1 --2- 172.21.15.103:0/400378094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f980014a2b0 0x7f98000ac740 secure :-1 s=READY pgs=2172 cs=0 l=1 rx=0x7f97f4002f30 tx=0x7f97f4007a40).ready entity=mon.1 client_cookie=41c0f501bf27e0fa server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:33.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.361+0000 7f9805a74700 1 --2- 172.21.15.103:0/400378094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f980014a2b0 0x7f98000ac740 secure :-1 s=THROTTLE_DONE pgs=2172 cs=0 l=1 rx=0x7f97f4002f30 tx=0x7f97f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:33.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.361+0000 7f9805a74700 1 --2- 172.21.15.103:0/400378094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f980014a2b0 0x7f98000ac740 secure :-1 s=THROTTLE_DONE pgs=2172 cs=0 l=1 rx=0x7f97f4002f30 tx=0x7f97f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:33.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.361+0000 7f97f3fff700 1 -- 172.21.15.103:0/400378094 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97f4011720 con 0x7f980014a2b0 2020-04-22T14:20:33.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.361+0000 7f9805a74700 1 --2- 172.21.15.103:0/400378094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f980014a2b0 0x7f98000ac740 secure :-1 s=THROTTLE_DONE pgs=2172 cs=0 l=1 rx=0x7f97f4002f30 tx=0x7f97f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:33.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.361+0000 7f97f3fff700 1 -- 172.21.15.103:0/400378094 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f40118c0 con 0x7f980014a2b0 2020-04-22T14:20:33.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.361+0000 7f97f3fff700 1 -- 172.21.15.103:0/400378094 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97f4011ce0 con 0x7f980014a2b0 2020-04-22T14:20:33.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.361+0000 7f98074d7700 1 -- 172.21.15.103:0/400378094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f980014a2b0 msgr2=0x7f98000ac740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:33.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.361+0000 7f98074d7700 1 --2- 172.21.15.103:0/400378094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f980014a2b0 0x7f98000ac740 secure :-1 s=READY pgs=2172 cs=0 l=1 rx=0x7f97f4002f30 tx=0x7f97f4007a40).stop 2020-04-22T14:20:33.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.361+0000 7f98074d7700 1 -- 172.21.15.103:0/400378094 shutdown_connections 2020-04-22T14:20:33.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.361+0000 7f98074d7700 1 --2- 172.21.15.103:0/400378094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f980014a2b0 0x7f98000ac740 unknown :-1 s=CLOSED pgs=2172 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:33.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.361+0000 7f98074d7700 1 -- 172.21.15.103:0/400378094 >> 172.21.15.103:0/400378094 conn(0x7f980005f2c0 msgr2=0x7f98000bcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:33.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.362+0000 7f98074d7700 1 -- 172.21.15.103:0/400378094 shutdown_connections 2020-04-22T14:20:33.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.362+0000 7f98074d7700 1 -- 172.21.15.103:0/400378094 wait complete. 2020-04-22T14:20:33.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.362+0000 7f98074d7700 1 Processor -- start 2020-04-22T14:20:33.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.363+0000 7f98074d7700 1 -- start start 2020-04-22T14:20:33.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.363+0000 7f98074d7700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9800140320 0x7f98001421c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:33.373 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.363+0000 7f98074d7700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f980014a2b0 0x7f9800153b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:33.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.363+0000 7f98074d7700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9800153fd0 con 0x7f98000ae1a0 2020-04-22T14:20:33.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.363+0000 7f98074d7700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9800142b90 con 0x7f9800140320 2020-04-22T14:20:33.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.363+0000 7f98074d7700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98000b0420 con 0x7f980014a2b0 2020-04-22T14:20:33.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.363+0000 7f9805273700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f98000ae1a0 0x7f980013dd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51202/0 (socket says 172.21.15.103:51202) 2020-04-22T14:20:33.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.363+0000 7f9805273700 1 -- 172.21.15.103:0/296844065 learned_addr learned my addr 172.21.15.103:0/296844065 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:33.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.363+0000 7f9805a74700 1 --2- 172.21.15.103:0/296844065 >> v2:172.21.15.103:3300/0 conn(0x7f980014a2b0 0x7f9800153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:33.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.363+0000 7f9804a72700 1 --2- 172.21.15.103:0/296844065 >> v2:172.21.15.86:3300/0 conn(0x7f9800140320 0x7f98001421c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:33.374 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.364+0000 7f9805a74700 1 -- 172.21.15.103:0/296844065 >> v2:172.21.15.86:3300/0 conn(0x7f9800140320 msgr2=0x7f98001421c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:33.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.364+0000 7f9805a74700 1 --2- 172.21.15.103:0/296844065 >> v2:172.21.15.86:3300/0 conn(0x7f9800140320 0x7f98001421c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:33.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.364+0000 7f9805a74700 1 -- 172.21.15.103:0/296844065 >> v1:172.21.15.103:6789/0 conn(0x7f98000ae1a0 legacy=0x7f980013dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:33.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.364+0000 7f9805a74700 1 -- 172.21.15.103:0/296844065 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98000b06c0 con 0x7f980014a2b0 2020-04-22T14:20:33.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.364+0000 7f97f27fc700 1 -- 172.21.15.103:0/296844065 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4292820901 0 0) 0x7f980014a720 con 0x7f98000ae1a0 2020-04-22T14:20:33.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.364+0000 7f9804a72700 1 --2- 172.21.15.103:0/296844065 >> v2:172.21.15.86:3300/0 conn(0x7f9800140320 0x7f98001421c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:20:33.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.364+0000 7f9805a74700 1 --2- 172.21.15.103:0/296844065 >> v2:172.21.15.103:3300/0 conn(0x7f980014a2b0 0x7f9800153b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f97f4002f30 tx=0x7f97f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:33.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.364+0000 7f9805a74700 1 --2- 172.21.15.103:0/296844065 >> v2:172.21.15.103:3300/0 conn(0x7f980014a2b0 0x7f9800153b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f97f4002f30 tx=0x7f97f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:33.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.364+0000 7f9805a74700 1 --2- 172.21.15.103:0/296844065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f980014a2b0 0x7f9800153b70 secure :-1 s=READY pgs=2174 cs=0 l=1 rx=0x7f97f4002f30 tx=0x7f97f4007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:33.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.364+0000 7f9805a74700 1 --2- 172.21.15.103:0/296844065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f980014a2b0 0x7f9800153b70 secure :-1 s=THROTTLE_DONE pgs=2174 cs=0 l=1 rx=0x7f97f4002f30 tx=0x7f97f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:33.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.364+0000 7f97f27fc700 1 -- 172.21.15.103:0/296844065 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97f40058b0 con 0x7f980014a2b0 2020-04-22T14:20:33.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.364+0000 7f9805a74700 1 --2- 172.21.15.103:0/296844065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f980014a2b0 0x7f9800153b70 secure :-1 s=THROTTLE_DONE pgs=2174 cs=0 l=1 rx=0x7f97f4002f30 tx=0x7f97f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:33.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.364+0000 7f9805a74700 1 --2- 172.21.15.103:0/296844065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f980014a2b0 0x7f9800153b70 secure :-1 s=THROTTLE_DONE pgs=2174 cs=0 l=1 rx=0x7f97f4002f30 tx=0x7f97f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:33.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.364+0000 7f97f27fc700 1 -- 172.21.15.103:0/296844065 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f4005a10 con 0x7f980014a2b0 2020-04-22T14:20:33.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.364+0000 7f97f27fc700 1 -- 172.21.15.103:0/296844065 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97f4005d70 con 0x7f980014a2b0 2020-04-22T14:20:33.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.364+0000 7f98074d7700 1 -- 172.21.15.103:0/296844065 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98000b0960 con 0x7f980014a2b0 2020-04-22T14:20:33.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.364+0000 7f98074d7700 1 -- 172.21.15.103:0/296844065 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f980013f830 con 0x7f980014a2b0 2020-04-22T14:20:33.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.364+0000 7f9805a74700 1 --2- 172.21.15.103:0/296844065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f980014a2b0 0x7f9800153b70 secure :-1 s=THROTTLE_DONE pgs=2174 cs=0 l=1 rx=0x7f97f4002f30 tx=0x7f97f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:33.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.365+0000 7f97f27fc700 1 -- 172.21.15.103:0/296844065 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f97f40103c0 con 0x7f980014a2b0 2020-04-22T14:20:33.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.365+0000 7f9805a74700 1 --2- 172.21.15.103:0/296844065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f980014a2b0 0x7f9800153b70 secure :-1 s=THROTTLE_DONE pgs=2174 cs=0 l=1 rx=0x7f97f4002f30 tx=0x7f97f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:33.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.365+0000 7f98074d7700 1 -- 172.21.15.103:0/296844065 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98000b0b60 con 0x7f980014a2b0 2020-04-22T14:20:33.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.365+0000 7f97f27fc700 1 --2- 172.21.15.103:0/296844065 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f97e004d830 0x7f97e004fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:33.377 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.365+0000 7f97f27fc700 1 -- 172.21.15.103:0/296844065 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f97f4061e20 con 0x7f980014a2b0 2020-04-22T14:20:33.378 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.365+0000 7f9805273700 1 --2- 172.21.15.103:0/296844065 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f97e004d830 0x7f97e004fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:33.378 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.366+0000 7f9805273700 1 --2- 172.21.15.103:0/296844065 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f97e004d830 0x7f97e004fcf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f97f80015e0 tx=0x7f97f8001b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:33.378 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.366+0000 7f9805273700 1 --2- 172.21.15.103:0/296844065 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f97e004d830 0x7f97e004fcf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f97f80015e0 tx=0x7f97f8001b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:33.378 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.366+0000 7f9805273700 1 --2- 172.21.15.103:0/296844065 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f97e004d830 0x7f97e004fcf0 secure :-1 s=READY pgs=786 cs=0 l=1 rx=0x7f97f80015e0 tx=0x7f97f8001b60).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:33.378 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.369+0000 7f9805a74700 1 --2- 172.21.15.103:0/296844065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f980014a2b0 0x7f9800153b70 secure :-1 s=THROTTLE_DONE pgs=2174 cs=0 l=1 rx=0x7f97f4002f30 tx=0x7f97f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:33.378 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.369+0000 7f97f27fc700 1 -- 172.21.15.103:0/296844065 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f97f403d260 con 0x7f980014a2b0 2020-04-22T14:20:33.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.558+0000 7f98074d7700 1 -- 172.21.15.103:0/296844065 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9800056c90 con 0x7f980014a2b0 2020-04-22T14:20:33.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.559+0000 7f9805a74700 1 --2- 172.21.15.103:0/296844065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f980014a2b0 0x7f9800153b70 secure :-1 s=THROTTLE_DONE pgs=2174 cs=0 l=1 rx=0x7f97f4002f30 tx=0x7f97f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:33.561 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.559+0000 7f97f27fc700 1 -- 172.21.15.103:0/296844065 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+2151 (secure 0 0 0) 0x7f97f4040880 con 0x7f980014a2b0 2020-04-22T14:20:33.561 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:20:33.562 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":114,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":9982,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.103:6833/1807533375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1807533375},{"type":"v1","addr":"172.21.15.103:6833","nonce":1807533375}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":111}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:19:46.112631+0000","modified":"2020-04-22T14:20:18.806229+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":147,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6878},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6878":{"gid":6878,"name":"b","rank":0,"incarnation":109,"state":"up:active","state_seq":6,"addr":"172.21.15.86:6835/2193157152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2193157152},{"type":"v1","addr":"172.21.15.86:6835","nonce":2193157152}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-04-22T14:20:33.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.560+0000 7f98074d7700 1 -- 172.21.15.103:0/296844065 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f97e004d830 msgr2=0x7f97e004fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:33.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.560+0000 7f98074d7700 1 --2- 172.21.15.103:0/296844065 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f97e004d830 0x7f97e004fcf0 secure :-1 s=READY pgs=786 cs=0 l=1 rx=0x7f97f80015e0 tx=0x7f97f8001b60).stop 2020-04-22T14:20:33.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.560+0000 7f98074d7700 1 -- 172.21.15.103:0/296844065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f980014a2b0 msgr2=0x7f9800153b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:33.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.560+0000 7f98074d7700 1 --2- 172.21.15.103:0/296844065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f980014a2b0 0x7f9800153b70 secure :-1 s=READY pgs=2174 cs=0 l=1 rx=0x7f97f4002f30 tx=0x7f97f4007a40).stop 2020-04-22T14:20:33.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.560+0000 7f98074d7700 1 -- 172.21.15.103:0/296844065 shutdown_connections 2020-04-22T14:20:33.563 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.560+0000 7f98074d7700 1 --2- 172.21.15.103:0/296844065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f980014a2b0 0x7f9800153b70 unknown :-1 s=CLOSED pgs=2174 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:33.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.560+0000 7f98074d7700 1 --2- 172.21.15.103:0/296844065 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f97e004d830 0x7f97e004fcf0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:33.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.560+0000 7f98074d7700 1 --2- 172.21.15.103:0/296844065 >> v2:172.21.15.86:3300/0 conn(0x7f9800140320 0x7f98001421c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:33.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.560+0000 7f98074d7700 1 -- 172.21.15.103:0/296844065 >> 172.21.15.103:0/296844065 conn(0x7f980005f2c0 msgr2=0x7f980005ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:33.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.560+0000 7f98074d7700 1 -- 172.21.15.103:0/296844065 shutdown_connections 2020-04-22T14:20:33.564 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.560+0000 7f98074d7700 1 -- 172.21.15.103:0/296844065 wait complete. 2020-04-22T14:20:33.564 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 114 2020-04-22T14:20:33.573 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:33.586 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2020-04-22T14:20:33.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.733+0000 7f6bd05bd700 1 Processor -- start 2020-04-22T14:20:33.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.734+0000 7f6bd05bd700 1 -- start start 2020-04-22T14:20:33.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.734+0000 7f6bd05bd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6bc814a170 0x7f6bc814a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:33.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.734+0000 7f6bd05bd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6bc80b0d80 0x7f6bc80b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:33.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.734+0000 7f6bd05bd700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc80b1650 con 0x7f6bc80b4880 2020-04-22T14:20:33.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.734+0000 7f6bd05bd700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc8149a70 con 0x7f6bc80b0d80 2020-04-22T14:20:33.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.734+0000 7f6bd05bd700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc8061020 con 0x7f6bc814a170 2020-04-22T14:20:33.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.735+0000 7f6bceb5a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6bc80b0d80 0x7f6bc80b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:33.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.735+0000 7f6bceb5a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6bc80b0d80 0x7f6bc80b11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59020/0 (socket says 172.21.15.103:59020) 2020-04-22T14:20:33.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.735+0000 7f6bceb5a700 1 -- 172.21.15.103:0/399240523 learned_addr learned my addr 172.21.15.103:0/399240523 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:33.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.735+0000 7f6bcdb58700 1 --2- 172.21.15.103:0/399240523 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6bc814a170 0x7f6bc814a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:33.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.735+0000 7f6bceb5a700 1 -- 172.21.15.103:0/399240523 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6bc814a170 msgr2=0x7f6bc814a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:33.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.735+0000 7f6bceb5a700 1 --2- 172.21.15.103:0/399240523 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6bc814a170 0x7f6bc814a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:33.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.735+0000 7f6bceb5a700 1 -- 172.21.15.103:0/399240523 >> v1:172.21.15.103:6789/0 conn(0x7f6bc80b4880 legacy=0x7f6bc8060910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:33.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.735+0000 7f6bceb5a700 1 -- 172.21.15.103:0/399240523 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc8149cd0 con 0x7f6bc80b0d80 2020-04-22T14:20:33.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.735+0000 7f6bcdb58700 1 --2- 172.21.15.103:0/399240523 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6bc814a170 0x7f6bc814a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:20:33.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.735+0000 7f6bceb5a700 1 --2- 172.21.15.103:0/399240523 >> v2:172.21.15.103:3300/0 conn(0x7f6bc80b0d80 0x7f6bc80b11f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6bc00032b0 tx=0x7f6bc0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:33.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.735+0000 7f6bceb5a700 1 --2- 172.21.15.103:0/399240523 >> v2:172.21.15.103:3300/0 conn(0x7f6bc80b0d80 0x7f6bc80b11f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6bc00032b0 tx=0x7f6bc0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:33.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.735+0000 7f6bceb5a700 1 --2- 172.21.15.103:0/399240523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bc80b0d80 0x7f6bc80b11f0 secure :-1 s=READY pgs=2176 cs=0 l=1 rx=0x7f6bc00032b0 tx=0x7f6bc0007dc0).ready entity=mon.1 client_cookie=9fba1f6c69e40a3f server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:33.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.735+0000 7f6bceb5a700 1 --2- 172.21.15.103:0/399240523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bc80b0d80 0x7f6bc80b11f0 secure :-1 s=THROTTLE_DONE pgs=2176 cs=0 l=1 rx=0x7f6bc00032b0 tx=0x7f6bc0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:33.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.735+0000 7f6bcd357700 1 -- 172.21.15.103:0/399240523 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bc00110d0 con 0x7f6bc80b0d80 2020-04-22T14:20:33.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.735+0000 7f6bceb5a700 1 --2- 172.21.15.103:0/399240523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bc80b0d80 0x7f6bc80b11f0 secure :-1 s=THROTTLE_DONE pgs=2176 cs=0 l=1 rx=0x7f6bc00032b0 tx=0x7f6bc0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:33.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.735+0000 7f6bceb5a700 1 --2- 172.21.15.103:0/399240523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bc80b0d80 0x7f6bc80b11f0 secure :-1 s=THROTTLE_DONE pgs=2176 cs=0 l=1 rx=0x7f6bc00032b0 tx=0x7f6bc0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:33.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.735+0000 7f6bcd357700 1 -- 172.21.15.103:0/399240523 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc0011230 con 0x7f6bc80b0d80 2020-04-22T14:20:33.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.735+0000 7f6bcd357700 1 -- 172.21.15.103:0/399240523 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bc0011650 con 0x7f6bc80b0d80 2020-04-22T14:20:33.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.735+0000 7f6bd05bd700 1 -- 172.21.15.103:0/399240523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bc80b0d80 msgr2=0x7f6bc80b11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:33.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.735+0000 7f6bd05bd700 1 --2- 172.21.15.103:0/399240523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bc80b0d80 0x7f6bc80b11f0 secure :-1 s=READY pgs=2176 cs=0 l=1 rx=0x7f6bc00032b0 tx=0x7f6bc0007dc0).stop 2020-04-22T14:20:33.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.736+0000 7f6bd05bd700 1 -- 172.21.15.103:0/399240523 shutdown_connections 2020-04-22T14:20:33.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.736+0000 7f6bd05bd700 1 --2- 172.21.15.103:0/399240523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bc80b0d80 0x7f6bc80b11f0 unknown :-1 s=CLOSED pgs=2176 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:33.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.736+0000 7f6bd05bd700 1 --2- 172.21.15.103:0/399240523 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6bc814a170 0x7f6bc814a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:33.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.736+0000 7f6bd05bd700 1 -- 172.21.15.103:0/399240523 >> 172.21.15.103:0/399240523 conn(0x7f6bc80ba8d0 msgr2=0x7f6bc80bace0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:33.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.736+0000 7f6bd05bd700 1 -- 172.21.15.103:0/399240523 shutdown_connections 2020-04-22T14:20:33.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.736+0000 7f6bd05bd700 1 -- 172.21.15.103:0/399240523 wait complete. 2020-04-22T14:20:33.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.737+0000 7f6bd05bd700 1 Processor -- start 2020-04-22T14:20:33.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.737+0000 7f6bd05bd700 1 -- start start 2020-04-22T14:20:33.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.737+0000 7f6bd05bd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6bc80b0d80 0x7f6bc8066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:33.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.737+0000 7f6bd05bd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6bc80b4880 0x7f6bc8156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:33.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.737+0000 7f6bd05bd700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc8065e10 con 0x7f6bc814a170 2020-04-22T14:20:33.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.737+0000 7f6bd05bd700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc8065c30 con 0x7f6bc80b4880 2020-04-22T14:20:33.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.737+0000 7f6bd05bd700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc80660b0 con 0x7f6bc80b0d80 2020-04-22T14:20:33.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.738+0000 7f6bcdb58700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6bc80b4880 0x7f6bc8156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:33.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.738+0000 7f6bcdb58700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6bc80b4880 0x7f6bc8156e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59026/0 (socket says 172.21.15.103:59026) 2020-04-22T14:20:33.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.738+0000 7f6bcdb58700 1 -- 172.21.15.103:0/3776144219 learned_addr learned my addr 172.21.15.103:0/3776144219 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:33.747 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.738+0000 7f6bce359700 1 --2- 172.21.15.103:0/3776144219 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6bc80b0d80 0x7f6bc8066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:33.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.738+0000 7f6bcdb58700 1 -- 172.21.15.103:0/3776144219 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6bc80b0d80 msgr2=0x7f6bc8066550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:33.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.738+0000 7f6bcdb58700 1 --2- 172.21.15.103:0/3776144219 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6bc80b0d80 0x7f6bc8066550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:33.748 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.738+0000 7f6bcdb58700 1 -- 172.21.15.103:0/3776144219 >> v1:172.21.15.103:6789/0 conn(0x7f6bc814a170 legacy=0x7f6bc813f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:33.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.738+0000 7f6bbb7fe700 1 -- 172.21.15.103:0/3776144219 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 396150055 0 0) 0x7f6bc8065e10 con 0x7f6bc814a170 2020-04-22T14:20:33.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.738+0000 7f6bcdb58700 1 -- 172.21.15.103:0/3776144219 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc8065780 con 0x7f6bc80b4880 2020-04-22T14:20:33.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.738+0000 7f6bcdb58700 1 --2- 172.21.15.103:0/3776144219 >> v2:172.21.15.103:3300/0 conn(0x7f6bc80b4880 0x7f6bc8156e50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6bbc002f30 tx=0x7f6bbc010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:33.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.738+0000 7f6bcdb58700 1 --2- 172.21.15.103:0/3776144219 >> v2:172.21.15.103:3300/0 conn(0x7f6bc80b4880 0x7f6bc8156e50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6bbc002f30 tx=0x7f6bbc010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:33.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.738+0000 7f6bcdb58700 1 --2- 172.21.15.103:0/3776144219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bc80b4880 0x7f6bc8156e50 secure :-1 s=READY pgs=2178 cs=0 l=1 rx=0x7f6bbc002f30 tx=0x7f6bbc010ac0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:33.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.738+0000 7f6bcdb58700 1 --2- 172.21.15.103:0/3776144219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bc80b4880 0x7f6bc8156e50 secure :-1 s=THROTTLE_DONE pgs=2178 cs=0 l=1 rx=0x7f6bbc002f30 tx=0x7f6bbc010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:33.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.738+0000 7f6bbb7fe700 1 -- 172.21.15.103:0/3776144219 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bbc007180 con 0x7f6bc80b4880 2020-04-22T14:20:33.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.738+0000 7f6bcdb58700 1 --2- 172.21.15.103:0/3776144219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bc80b4880 0x7f6bc8156e50 secure :-1 s=THROTTLE_DONE pgs=2178 cs=0 l=1 rx=0x7f6bbc002f30 tx=0x7f6bbc010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:33.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.738+0000 7f6bcdb58700 1 --2- 172.21.15.103:0/3776144219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bc80b4880 0x7f6bc8156e50 secure :-1 s=THROTTLE_DONE pgs=2178 cs=0 l=1 rx=0x7f6bbc002f30 tx=0x7f6bbc010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:33.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.738+0000 7f6bbb7fe700 1 -- 172.21.15.103:0/3776144219 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bbc0072e0 con 0x7f6bc80b4880 2020-04-22T14:20:33.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.738+0000 7f6bd05bd700 1 -- 172.21.15.103:0/3776144219 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc813f960 con 0x7f6bc80b4880 2020-04-22T14:20:33.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.738+0000 7f6bbb7fe700 1 -- 172.21.15.103:0/3776144219 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bbc0059c0 con 0x7f6bc80b4880 2020-04-22T14:20:33.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.738+0000 7f6bd05bd700 1 -- 172.21.15.103:0/3776144219 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc80642f0 con 0x7f6bc80b4880 2020-04-22T14:20:33.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.739+0000 7f6bcdb58700 1 --2- 172.21.15.103:0/3776144219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bc80b4880 0x7f6bc8156e50 secure :-1 s=THROTTLE_DONE pgs=2178 cs=0 l=1 rx=0x7f6bbc002f30 tx=0x7f6bbc010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:33.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.739+0000 7f6bbb7fe700 1 -- 172.21.15.103:0/3776144219 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f6bbc005bc0 con 0x7f6bc80b4880 2020-04-22T14:20:33.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.739+0000 7f6bcdb58700 1 --2- 172.21.15.103:0/3776144219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bc80b4880 0x7f6bc8156e50 secure :-1 s=THROTTLE_DONE pgs=2178 cs=0 l=1 rx=0x7f6bbc002f30 tx=0x7f6bbc010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:33.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.739+0000 7f6bbb7fe700 1 --2- 172.21.15.103:0/3776144219 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6ba804d880 0x7f6ba804fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:33.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.740+0000 7f6bbb7fe700 1 -- 172.21.15.103:0/3776144219 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f6bbc061240 con 0x7f6bc80b4880 2020-04-22T14:20:33.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.740+0000 7f6bd05bd700 1 -- 172.21.15.103:0/3776144219 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc8056c90 con 0x7f6bc80b4880 2020-04-22T14:20:33.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.740+0000 7f6bce359700 1 --2- 172.21.15.103:0/3776144219 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6ba804d880 0x7f6ba804fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:33.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.740+0000 7f6bce359700 1 --2- 172.21.15.103:0/3776144219 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6ba804d880 0x7f6ba804fd40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6bc805f6a0 tx=0x7f6bc4003e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:33.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.740+0000 7f6bce359700 1 --2- 172.21.15.103:0/3776144219 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6ba804d880 0x7f6ba804fd40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6bc805f6a0 tx=0x7f6bc4003e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:33.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.740+0000 7f6bce359700 1 --2- 172.21.15.103:0/3776144219 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6ba804d880 0x7f6ba804fd40 secure :-1 s=READY pgs=787 cs=0 l=1 rx=0x7f6bc805f6a0 tx=0x7f6bc4003e20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:33.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.744+0000 7f6bcdb58700 1 --2- 172.21.15.103:0/3776144219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bc80b4880 0x7f6bc8156e50 secure :-1 s=THROTTLE_DONE pgs=2178 cs=0 l=1 rx=0x7f6bbc002f30 tx=0x7f6bbc010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:33.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.744+0000 7f6bbb7fe700 1 -- 172.21.15.103:0/3776144219 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f6bbc03c620 con 0x7f6bc80b4880 2020-04-22T14:20:33.935 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:33.933+0000 7f6bd05bd700 1 -- 172.21.15.103:0/3776144219 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6bc80b33c0 con 0x7f6bc80b4880 2020-04-22T14:20:34.494 INFO:tasks.ceph.mon.b.smithi086.stderr:2020-04-22T14:20:34.492+0000 7fbdbf880700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-04-22T14:20:34.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.496+0000 7f6bcdb58700 1 --2- 172.21.15.103:0/3776144219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bc80b4880 0x7f6bc8156e50 secure :-1 s=THROTTLE_DONE pgs=2178 cs=0 l=1 rx=0x7f6bbc002f30 tx=0x7f6bbc010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:34.498 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.496+0000 7f6bbb7fe700 1 -- 172.21.15.103:0/3776144219 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v115) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6bbc03fc40 con 0x7f6bc80b4880 2020-04-22T14:20:34.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.498+0000 7f6bd05bd700 1 -- 172.21.15.103:0/3776144219 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6ba804d880 msgr2=0x7f6ba804fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:34.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.498+0000 7f6bd05bd700 1 --2- 172.21.15.103:0/3776144219 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6ba804d880 0x7f6ba804fd40 secure :-1 s=READY pgs=787 cs=0 l=1 rx=0x7f6bc805f6a0 tx=0x7f6bc4003e20).stop 2020-04-22T14:20:34.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.498+0000 7f6bd05bd700 1 -- 172.21.15.103:0/3776144219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bc80b4880 msgr2=0x7f6bc8156e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:34.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.498+0000 7f6bd05bd700 1 --2- 172.21.15.103:0/3776144219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bc80b4880 0x7f6bc8156e50 secure :-1 s=READY pgs=2178 cs=0 l=1 rx=0x7f6bbc002f30 tx=0x7f6bbc010ac0).stop 2020-04-22T14:20:34.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.498+0000 7f6bd05bd700 1 -- 172.21.15.103:0/3776144219 shutdown_connections 2020-04-22T14:20:34.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.498+0000 7f6bd05bd700 1 --2- 172.21.15.103:0/3776144219 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f6ba804d880 0x7f6ba804fd40 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:34.501 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.498+0000 7f6bd05bd700 1 --2- 172.21.15.103:0/3776144219 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6bc80b0d80 0x7f6bc8066550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:34.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.498+0000 7f6bd05bd700 1 --2- 172.21.15.103:0/3776144219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bc80b4880 0x7f6bc8156e50 unknown :-1 s=CLOSED pgs=2178 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:34.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.498+0000 7f6bd05bd700 1 -- 172.21.15.103:0/3776144219 >> 172.21.15.103:0/3776144219 conn(0x7f6bc80ba8d0 msgr2=0x7f6bc80b66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:34.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.498+0000 7f6bd05bd700 1 -- 172.21.15.103:0/3776144219 shutdown_connections 2020-04-22T14:20:34.502 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.498+0000 7f6bd05bd700 1 -- 172.21.15.103:0/3776144219 wait complete. 2020-04-22T14:20:34.502 INFO:teuthology.orchestra.run.smithi103.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2020-04-22T14:20:34.514 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:34.526 INFO:tasks.ceph.mds.b.smithi086.stdout:starting mds.b at 2020-04-22T14:20:34.528 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:20:34.682 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.680+0000 7f5e1247e700 1 Processor -- start 2020-04-22T14:20:34.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.680+0000 7f5e1247e700 1 -- start start 2020-04-22T14:20:34.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.681+0000 7f5e1247e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e0c12c0d0 0x7f5e0c1464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:34.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.681+0000 7f5e1247e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5e0c063e30 0x7f5e0c0642a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:34.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.681+0000 7f5e1247e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e0c143300 con 0x7f5e0c065fe0 2020-04-22T14:20:34.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.681+0000 7f5e1247e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e0c1435a0 con 0x7f5e0c063e30 2020-04-22T14:20:34.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.681+0000 7f5e1247e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c143840 con 0x7f5e0c12c0d0 2020-04-22T14:20:34.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.681+0000 7f5e0b7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f5e0c065fe0 0x7f5e0c05b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51222/0 (socket says 172.21.15.103:51222) 2020-04-22T14:20:34.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.681+0000 7f5e0b7fe700 1 -- 172.21.15.103:0/1637703834 learned_addr learned my addr 172.21.15.103:0/1637703834 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:34.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.681+0000 7f5e0bfff700 1 --2- 172.21.15.103:0/1637703834 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e0c12c0d0 0x7f5e0c1464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:34.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.681+0000 7f5e0affd700 1 -- 172.21.15.103:0/1637703834 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3963855308 0 0) 0x7f5e0c143300 con 0x7f5e0c065fe0 2020-04-22T14:20:34.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.681+0000 7f5e0affd700 1 -- 172.21.15.103:0/1637703834 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5df8003230 con 0x7f5e0c065fe0 2020-04-22T14:20:34.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.681+0000 7f5e10a1b700 1 --2- 172.21.15.103:0/1637703834 >> v2:172.21.15.86:3300/0 conn(0x7f5e0c063e30 0x7f5e0c0642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:34.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.682+0000 7f5e0affd700 1 -- 172.21.15.103:0/1637703834 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2964608715 0 0) 0x7f5df8003230 con 0x7f5e0c065fe0 2020-04-22T14:20:34.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.682+0000 7f5e0affd700 1 -- 172.21.15.103:0/1637703834 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e0c12c0d0 msgr2=0x7f5e0c1464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:34.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.682+0000 7f5e0affd700 1 --2- 172.21.15.103:0/1637703834 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e0c12c0d0 0x7f5e0c1464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:34.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.682+0000 7f5e0affd700 1 -- 172.21.15.103:0/1637703834 >> v2:172.21.15.86:3300/0 conn(0x7f5e0c063e30 msgr2=0x7f5e0c0642a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:34.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.682+0000 7f5e0affd700 1 --2- 172.21.15.103:0/1637703834 >> v2:172.21.15.86:3300/0 conn(0x7f5e0c063e30 0x7f5e0c0642a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:34.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.682+0000 7f5e0affd700 1 -- 172.21.15.103:0/1637703834 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e0c05bb50 con 0x7f5e0c065fe0 2020-04-22T14:20:34.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.682+0000 7f5e0affd700 1 -- 172.21.15.103:0/1637703834 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f5e000016d0 con 0x7f5e0c065fe0 2020-04-22T14:20:34.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.682+0000 7f5e0affd700 1 -- 172.21.15.103:0/1637703834 >> v1:172.21.15.103:6789/0 conn(0x7f5e0c065fe0 legacy=0x7f5e0c05b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:34.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.682+0000 7f5e0affd700 1 --2- 172.21.15.103:0/1637703834 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e0c12c0d0 0x7f5df8003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:34.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.682+0000 7f5e0affd700 1 --2- 172.21.15.103:0/1637703834 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5df8003b80 0x7f5df8003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:34.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.682+0000 7f5e0affd700 1 --2- 172.21.15.103:0/1637703834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5df80045c0 0x7f5df8004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:34.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.682+0000 7f5e0affd700 1 -- 172.21.15.103:0/1637703834 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c1435a0 con 0x7f5df8003b80 2020-04-22T14:20:34.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.682+0000 7f5e0affd700 1 -- 172.21.15.103:0/1637703834 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c143840 con 0x7f5df80045c0 2020-04-22T14:20:34.691 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.682+0000 7f5e0affd700 1 -- 172.21.15.103:0/1637703834 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df8005050 con 0x7f5e0c12c0d0 2020-04-22T14:20:34.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.682+0000 7f5e10a1b700 1 --2- 172.21.15.103:0/1637703834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5df80045c0 0x7f5df8004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:34.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.682+0000 7f5e0bfff700 1 --2- 172.21.15.103:0/1637703834 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e0c12c0d0 0x7f5df8003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:34.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.682+0000 7f5e0b7fe700 1 --2- 172.21.15.103:0/1637703834 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5df8003b80 0x7f5df8003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:34.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.682+0000 7f5e10a1b700 1 -- 172.21.15.103:0/1637703834 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e0c12c0d0 msgr2=0x7f5df8003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:34.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.682+0000 7f5e10a1b700 1 --2- 172.21.15.103:0/1637703834 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e0c12c0d0 0x7f5df8003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:34.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.682+0000 7f5e10a1b700 1 -- 172.21.15.103:0/1637703834 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5df8003b80 msgr2=0x7f5df8003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:34.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.682+0000 7f5e10a1b700 1 --2- 172.21.15.103:0/1637703834 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5df8003b80 0x7f5df8003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:34.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.682+0000 7f5e10a1b700 1 -- 172.21.15.103:0/1637703834 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df8003230 con 0x7f5df80045c0 2020-04-22T14:20:34.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.682+0000 7f5e0b7fe700 1 --2- 172.21.15.103:0/1637703834 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5df8003b80 0x7f5df8003fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:20:34.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.682+0000 7f5e10a1b700 1 --2- 172.21.15.103:0/1637703834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5df80045c0 0x7f5df8004a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5e040032b0 tx=0x7f5e040103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:34.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.682+0000 7f5e10a1b700 1 --2- 172.21.15.103:0/1637703834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5df80045c0 0x7f5df8004a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5e040032b0 tx=0x7f5e040103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:34.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.682+0000 7f5e10a1b700 1 --2- 172.21.15.103:0/1637703834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5df80045c0 0x7f5df8004a20 secure :-1 s=READY pgs=2180 cs=0 l=1 rx=0x7f5e040032b0 tx=0x7f5e040103a0).ready entity=mon.1 client_cookie=c15455e48a581859 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:34.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.682+0000 7f5e10a1b700 1 --2- 172.21.15.103:0/1637703834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5df80045c0 0x7f5df8004a20 secure :-1 s=THROTTLE_DONE pgs=2180 cs=0 l=1 rx=0x7f5e040032b0 tx=0x7f5e040103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:34.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.682+0000 7f5e0affd700 1 -- 172.21.15.103:0/1637703834 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e040112c0 con 0x7f5df80045c0 2020-04-22T14:20:34.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.682+0000 7f5e10a1b700 1 --2- 172.21.15.103:0/1637703834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5df80045c0 0x7f5df8004a20 secure :-1 s=THROTTLE_DONE pgs=2180 cs=0 l=1 rx=0x7f5e040032b0 tx=0x7f5e040103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:34.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.682+0000 7f5e10a1b700 1 --2- 172.21.15.103:0/1637703834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5df80045c0 0x7f5df8004a20 secure :-1 s=THROTTLE_DONE pgs=2180 cs=0 l=1 rx=0x7f5e040032b0 tx=0x7f5e040103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:34.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.682+0000 7f5e0affd700 1 -- 172.21.15.103:0/1637703834 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e04011420 con 0x7f5df80045c0 2020-04-22T14:20:34.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.682+0000 7f5e0affd700 1 -- 172.21.15.103:0/1637703834 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e04011780 con 0x7f5df80045c0 2020-04-22T14:20:34.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.682+0000 7f5e1247e700 1 -- 172.21.15.103:0/1637703834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5df80045c0 msgr2=0x7f5df8004a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:34.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.682+0000 7f5e1247e700 1 --2- 172.21.15.103:0/1637703834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5df80045c0 0x7f5df8004a20 secure :-1 s=READY pgs=2180 cs=0 l=1 rx=0x7f5e040032b0 tx=0x7f5e040103a0).stop 2020-04-22T14:20:34.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.682+0000 7f5e10a1b700 1 -- 172.21.15.103:0/1637703834 reap_dead start 2020-04-22T14:20:34.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.683+0000 7f5e1247e700 1 -- 172.21.15.103:0/1637703834 shutdown_connections 2020-04-22T14:20:34.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.683+0000 7f5e1247e700 1 -- 172.21.15.103:0/1637703834 >> 172.21.15.103:0/1637703834 conn(0x7f5e0c0b9160 msgr2=0x7f5e0c05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:34.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.683+0000 7f5e1247e700 1 -- 172.21.15.103:0/1637703834 shutdown_connections 2020-04-22T14:20:34.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.683+0000 7f5e1247e700 1 -- 172.21.15.103:0/1637703834 wait complete. 2020-04-22T14:20:34.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.684+0000 7f5e1247e700 1 Processor -- start 2020-04-22T14:20:34.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.684+0000 7f5e1247e700 1 -- start start 2020-04-22T14:20:34.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.685+0000 7f5e1247e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e0c125980 0x7f5e0c129770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:34.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.685+0000 7f5e1247e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5e0c154d50 0x7f5e0c155180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:34.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.685+0000 7f5e1247e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e0c129bd0 con 0x7f5e0c124bc0 2020-04-22T14:20:34.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.685+0000 7f5e1247e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e0c1268a0 con 0x7f5e0c154d50 2020-04-22T14:20:34.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.685+0000 7f5e1247e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c12bb30 con 0x7f5e0c125980 2020-04-22T14:20:34.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.685+0000 7f5e0bfff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f5e0c124bc0 0x7f5e0c142100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51234/0 (socket says 172.21.15.103:51234) 2020-04-22T14:20:34.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.685+0000 7f5e0bfff700 1 -- 172.21.15.103:0/4043272011 learned_addr learned my addr 172.21.15.103:0/4043272011 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:34.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.685+0000 7f5e0b7fe700 1 --2- 172.21.15.103:0/4043272011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e0c125980 0x7f5e0c129770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:34.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.685+0000 7f5e10a1b700 1 --2- 172.21.15.103:0/4043272011 >> v2:172.21.15.86:3300/0 conn(0x7f5e0c154d50 0x7f5e0c155180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:34.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.685+0000 7f5e097fa700 1 -- 172.21.15.103:0/4043272011 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3993174346 0 0) 0x7f5dfc007bd0 con 0x7f5e0c124bc0 2020-04-22T14:20:34.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.685+0000 7f5e097fa700 1 -- 172.21.15.103:0/4043272011 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dec002fe0 con 0x7f5e0c124bc0 2020-04-22T14:20:34.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.685+0000 7f5e0b7fe700 1 -- 172.21.15.103:0/4043272011 >> v2:172.21.15.86:3300/0 conn(0x7f5e0c154d50 msgr2=0x7f5e0c155180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:34.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.685+0000 7f5e0b7fe700 1 --2- 172.21.15.103:0/4043272011 >> v2:172.21.15.86:3300/0 conn(0x7f5e0c154d50 0x7f5e0c155180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:34.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.685+0000 7f5e0b7fe700 1 -- 172.21.15.103:0/4043272011 >> v1:172.21.15.103:6789/0 conn(0x7f5e0c124bc0 legacy=0x7f5e0c142100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:34.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.685+0000 7f5e0b7fe700 1 -- 172.21.15.103:0/4043272011 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e0c127880 con 0x7f5e0c125980 2020-04-22T14:20:34.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.685+0000 7f5e0b7fe700 1 --2- 172.21.15.103:0/4043272011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e0c125980 0x7f5e0c129770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5e000013e0 tx=0x7f5e0c05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:34.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.685+0000 7f5e0b7fe700 1 --2- 172.21.15.103:0/4043272011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e0c125980 0x7f5e0c129770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5e000013e0 tx=0x7f5e0c05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:34.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.685+0000 7f5e0b7fe700 1 --2- 172.21.15.103:0/4043272011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e0c125980 0x7f5e0c129770 secure :-1 s=READY pgs=204 cs=0 l=1 rx=0x7f5e000013e0 tx=0x7f5e0c05bce0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:34.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.685+0000 7f5e0b7fe700 1 --2- 172.21.15.103:0/4043272011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e0c125980 0x7f5e0c129770 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f5e000013e0 tx=0x7f5e0c05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:34.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.685+0000 7f5e097fa700 1 -- 172.21.15.103:0/4043272011 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e0000ca90 con 0x7f5e0c125980 2020-04-22T14:20:34.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.685+0000 7f5e0b7fe700 1 --2- 172.21.15.103:0/4043272011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e0c125980 0x7f5e0c129770 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f5e000013e0 tx=0x7f5e0c05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:34.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.685+0000 7f5e097fa700 1 -- 172.21.15.103:0/4043272011 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e0000cbf0 con 0x7f5e0c125980 2020-04-22T14:20:34.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.685+0000 7f5e0b7fe700 1 --2- 172.21.15.103:0/4043272011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e0c125980 0x7f5e0c129770 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f5e000013e0 tx=0x7f5e0c05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:34.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.685+0000 7f5e1247e700 1 -- 172.21.15.103:0/4043272011 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e0c125ec0 con 0x7f5e0c125980 2020-04-22T14:20:34.698 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.685+0000 7f5e097fa700 1 -- 172.21.15.103:0/4043272011 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e000045b0 con 0x7f5e0c125980 2020-04-22T14:20:34.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.686+0000 7f5e1247e700 1 -- 172.21.15.103:0/4043272011 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e0c126400 con 0x7f5e0c125980 2020-04-22T14:20:34.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.686+0000 7f5e0b7fe700 1 --2- 172.21.15.103:0/4043272011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e0c125980 0x7f5e0c129770 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f5e000013e0 tx=0x7f5e0c05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:34.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.686+0000 7f5e1247e700 1 -- 172.21.15.103:0/4043272011 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e0c126590 con 0x7f5e0c125980 2020-04-22T14:20:34.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.687+0000 7f5e097fa700 1 -- 172.21.15.103:0/4043272011 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f5e000047b0 con 0x7f5e0c125980 2020-04-22T14:20:34.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.687+0000 7f5e0b7fe700 1 --2- 172.21.15.103:0/4043272011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e0c125980 0x7f5e0c129770 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f5e000013e0 tx=0x7f5e0c05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:34.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.687+0000 7f5e097fa700 1 --2- 172.21.15.103:0/4043272011 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5dec04dc60 0x7f5dec050120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:34.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.687+0000 7f5e097fa700 1 -- 172.21.15.103:0/4043272011 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6288+0+0 (secure 0 0 0) 0x7f5e000611a0 con 0x7f5e0c125980 2020-04-22T14:20:34.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.687+0000 7f5e0bfff700 1 --2- 172.21.15.103:0/4043272011 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5dec04dc60 0x7f5dec050120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:34.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.687+0000 7f5e0bfff700 1 --2- 172.21.15.103:0/4043272011 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5dec04dc60 0x7f5dec050120 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5dfc002f30 tx=0x7f5dfc0079c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:34.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.687+0000 7f5e0bfff700 1 --2- 172.21.15.103:0/4043272011 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5dec04dc60 0x7f5dec050120 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5dfc002f30 tx=0x7f5dfc0079c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:34.701 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.687+0000 7f5e0bfff700 1 --2- 172.21.15.103:0/4043272011 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5dec04dc60 0x7f5dec050120 secure :-1 s=READY pgs=788 cs=0 l=1 rx=0x7f5dfc002f30 tx=0x7f5dfc0079c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:34.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.691+0000 7f5e0b7fe700 1 --2- 172.21.15.103:0/4043272011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e0c125980 0x7f5e0c129770 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f5e000013e0 tx=0x7f5e0c05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:34.702 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.691+0000 7f5e097fa700 1 -- 172.21.15.103:0/4043272011 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f5e0003c520 con 0x7f5e0c125980 2020-04-22T14:20:34.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.884+0000 7f5e1247e700 1 -- 172.21.15.103:0/4043272011 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e0c056c90 con 0x7f5e0c125980 2020-04-22T14:20:34.886 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.884+0000 7f5e0b7fe700 1 --2- 172.21.15.103:0/4043272011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e0c125980 0x7f5e0c129770 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f5e000013e0 tx=0x7f5e0c05bce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:34.887 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.884+0000 7f5e097fa700 1 -- 172.21.15.103:0/4043272011 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) v1 ==== 95+0+1788 (secure 0 0 0) 0x7f5e0003fb40 con 0x7f5e0c125980 2020-04-22T14:20:34.887 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:20:34.887 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":115,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":9982,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.103:6833/1807533375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1807533375},{"type":"v1","addr":"172.21.15.103:6833","nonce":1807533375}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":111}],"filesystems":[{"mdsmap":{"epoch":115,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:19:46.112631+0000","modified":"2020-04-22T14:20:34.493130+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":150,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-04-22T14:20:34.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.886+0000 7f5e1247e700 1 -- 172.21.15.103:0/4043272011 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5dec04dc60 msgr2=0x7f5dec050120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:34.888 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.886+0000 7f5e1247e700 1 --2- 172.21.15.103:0/4043272011 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5dec04dc60 0x7f5dec050120 secure :-1 s=READY pgs=788 cs=0 l=1 rx=0x7f5dfc002f30 tx=0x7f5dfc0079c0).stop 2020-04-22T14:20:34.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.886+0000 7f5e1247e700 1 -- 172.21.15.103:0/4043272011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e0c125980 msgr2=0x7f5e0c129770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:34.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.886+0000 7f5e1247e700 1 --2- 172.21.15.103:0/4043272011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e0c125980 0x7f5e0c129770 secure :-1 s=READY pgs=204 cs=0 l=1 rx=0x7f5e000013e0 tx=0x7f5e0c05bce0).stop 2020-04-22T14:20:34.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.886+0000 7f5e1247e700 1 -- 172.21.15.103:0/4043272011 shutdown_connections 2020-04-22T14:20:34.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.886+0000 7f5e1247e700 1 --2- 172.21.15.103:0/4043272011 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5dec04dc60 0x7f5dec050120 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:34.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.886+0000 7f5e1247e700 1 --2- 172.21.15.103:0/4043272011 >> v2:172.21.15.86:3300/0 conn(0x7f5e0c154d50 0x7f5e0c155180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:34.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.886+0000 7f5e1247e700 1 --2- 172.21.15.103:0/4043272011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e0c125980 0x7f5e0c129770 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:34.889 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.886+0000 7f5e1247e700 1 -- 172.21.15.103:0/4043272011 >> 172.21.15.103:0/4043272011 conn(0x7f5e0c0b9160 msgr2=0x7f5e0c0b4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:34.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.886+0000 7f5e1247e700 1 -- 172.21.15.103:0/4043272011 shutdown_connections 2020-04-22T14:20:34.890 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:34.886+0000 7f5e1247e700 1 -- 172.21.15.103:0/4043272011 wait complete. 2020-04-22T14:20:34.890 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 115 2020-04-22T14:20:34.898 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:34.911 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-04-22T14:20:35.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.058+0000 7f38ca6fd700 1 Processor -- start 2020-04-22T14:20:35.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.058+0000 7f38ca6fd700 1 -- start start 2020-04-22T14:20:35.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.059+0000 7f38ca6fd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f38c40b9140 0x7f38c412b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:35.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.059+0000 7f38ca6fd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38c412b670 0x7f38c4143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:35.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.059+0000 7f38ca6fd700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38c41467e0 con 0x7f38c40ac950 2020-04-22T14:20:35.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.059+0000 7f38ca6fd700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c40602f0 con 0x7f38c40b9140 2020-04-22T14:20:35.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.059+0000 7f38ca6fd700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c4060050 con 0x7f38c412b670 2020-04-22T14:20:35.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.059+0000 7f38c3fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f38c40b9140 0x7f38c412b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:35.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.059+0000 7f38c8c9a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38c412b670 0x7f38c4143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:35.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.059+0000 7f38c37fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f38c40ac950 0x7f38c4146c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:40168/0 (socket says 172.21.15.103:40168) 2020-04-22T14:20:35.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.059+0000 7f38c3fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f38c40b9140 0x7f38c412b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:56284/0 (socket says 172.21.15.103:56284) 2020-04-22T14:20:35.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.059+0000 7f38c37fe700 1 -- 172.21.15.103:0/165002379 learned_addr learned my addr 172.21.15.103:0/165002379 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:35.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.059+0000 7f38c8c9a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38c412b670 0x7f38c4143090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:43834/0 (socket says 172.21.15.103:43834) 2020-04-22T14:20:35.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.059+0000 7f38c8c9a700 1 -- 172.21.15.103:0/165002379 >> v2:172.21.15.86:3300/0 conn(0x7f38c40b9140 msgr2=0x7f38c412b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:35.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.059+0000 7f38c8c9a700 1 --2- 172.21.15.103:0/165002379 >> v2:172.21.15.86:3300/0 conn(0x7f38c40b9140 0x7f38c412b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:35.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.059+0000 7f38c8c9a700 1 -- 172.21.15.103:0/165002379 >> v1:172.21.15.86:6789/0 conn(0x7f38c40ac950 legacy=0x7f38c4146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:35.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.059+0000 7f38c8c9a700 1 -- 172.21.15.103:0/165002379 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c40b9520 con 0x7f38c412b670 2020-04-22T14:20:35.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.059+0000 7f38c3fff700 1 --2- 172.21.15.103:0/165002379 >> v2:172.21.15.86:3300/0 conn(0x7f38c40b9140 0x7f38c412b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:20:35.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.059+0000 7f38c8c9a700 1 --2- 172.21.15.103:0/165002379 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38c412b670 0x7f38c4143090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f38bc0032b0 tx=0x7f38bc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:35.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.059+0000 7f38c8c9a700 1 --2- 172.21.15.103:0/165002379 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38c412b670 0x7f38c4143090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f38bc0032b0 tx=0x7f38bc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:35.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.059+0000 7f38c8c9a700 1 --2- 172.21.15.103:0/165002379 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38c412b670 0x7f38c4143090 secure :-1 s=READY pgs=205 cs=0 l=1 rx=0x7f38bc0032b0 tx=0x7f38bc007dc0).ready entity=mon.2 client_cookie=15568d9c757c5c47 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:35.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.059+0000 7f38c8c9a700 1 --2- 172.21.15.103:0/165002379 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38c412b670 0x7f38c4143090 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7f38bc0032b0 tx=0x7f38bc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:35.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.060+0000 7f38c8c9a700 1 --2- 172.21.15.103:0/165002379 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38c412b670 0x7f38c4143090 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7f38bc0032b0 tx=0x7f38bc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:35.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.060+0000 7f38c2ffd700 1 -- 172.21.15.103:0/165002379 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38bc011e20 con 0x7f38c412b670 2020-04-22T14:20:35.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.060+0000 7f38c8c9a700 1 --2- 172.21.15.103:0/165002379 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38c412b670 0x7f38c4143090 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7f38bc0032b0 tx=0x7f38bc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:35.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.060+0000 7f38c2ffd700 1 -- 172.21.15.103:0/165002379 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38bc00a180 con 0x7f38c412b670 2020-04-22T14:20:35.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.060+0000 7f38c2ffd700 1 -- 172.21.15.103:0/165002379 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38bc00a560 con 0x7f38c412b670 2020-04-22T14:20:35.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.060+0000 7f38ca6fd700 1 -- 172.21.15.103:0/165002379 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38c412b670 msgr2=0x7f38c4143090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:35.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.060+0000 7f38ca6fd700 1 --2- 172.21.15.103:0/165002379 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38c412b670 0x7f38c4143090 secure :-1 s=READY pgs=205 cs=0 l=1 rx=0x7f38bc0032b0 tx=0x7f38bc007dc0).stop 2020-04-22T14:20:35.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.060+0000 7f38ca6fd700 1 -- 172.21.15.103:0/165002379 shutdown_connections 2020-04-22T14:20:35.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.060+0000 7f38ca6fd700 1 --2- 172.21.15.103:0/165002379 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38c412b670 0x7f38c4143090 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:35.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.060+0000 7f38ca6fd700 1 --2- 172.21.15.103:0/165002379 >> v2:172.21.15.86:3300/0 conn(0x7f38c40b9140 0x7f38c412b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:35.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.060+0000 7f38ca6fd700 1 -- 172.21.15.103:0/165002379 >> 172.21.15.103:0/165002379 conn(0x7f38c405b7b0 msgr2=0x7f38c40b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:35.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.060+0000 7f38ca6fd700 1 -- 172.21.15.103:0/165002379 shutdown_connections 2020-04-22T14:20:35.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.060+0000 7f38ca6fd700 1 -- 172.21.15.103:0/165002379 wait complete. 2020-04-22T14:20:35.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.061+0000 7f38ca6fd700 1 Processor -- start 2020-04-22T14:20:35.068 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.061+0000 7f38ca6fd700 1 -- start start 2020-04-22T14:20:35.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.062+0000 7f38ca6fd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f38c40ac950 0x7f38c40b2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:35.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.062+0000 7f38ca6fd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38c40b9140 0x7f38c4145ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:35.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.062+0000 7f38ca6fd700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38c4151ba0 con 0x7f38c412b670 2020-04-22T14:20:35.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.062+0000 7f38ca6fd700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c4065a10 con 0x7f38c40ac950 2020-04-22T14:20:35.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.062+0000 7f38ca6fd700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c4151e00 con 0x7f38c40b9140 2020-04-22T14:20:35.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.062+0000 7f38c3fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f38c40ac950 0x7f38c40b2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:35.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.062+0000 7f38c3fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f38c40ac950 0x7f38c40b2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59058/0 (socket says 172.21.15.103:59058) 2020-04-22T14:20:35.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.062+0000 7f38c3fff700 1 -- 172.21.15.103:0/1985075478 learned_addr learned my addr 172.21.15.103:0/1985075478 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:35.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.062+0000 7f38c37fe700 1 --2- 172.21.15.103:0/1985075478 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38c40b9140 0x7f38c4145ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:35.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.062+0000 7f38c3fff700 1 -- 172.21.15.103:0/1985075478 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38c40b9140 msgr2=0x7f38c4145ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:35.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.062+0000 7f38c3fff700 1 --2- 172.21.15.103:0/1985075478 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38c40b9140 0x7f38c4145ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:35.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.062+0000 7f38c3fff700 1 -- 172.21.15.103:0/1985075478 >> v1:172.21.15.103:6789/0 conn(0x7f38c412b670 legacy=0x7f38c4061790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:35.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.062+0000 7f38c3fff700 1 -- 172.21.15.103:0/1985075478 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c4061ea0 con 0x7f38c40ac950 2020-04-22T14:20:35.072 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.062+0000 7f38c3fff700 1 --2- 172.21.15.103:0/1985075478 >> v2:172.21.15.103:3300/0 conn(0x7f38c40ac950 0x7f38c40b2430 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f38c4066ec0 tx=0x7f38b4010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:35.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.062+0000 7f38c3fff700 1 --2- 172.21.15.103:0/1985075478 >> v2:172.21.15.103:3300/0 conn(0x7f38c40ac950 0x7f38c40b2430 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f38c4066ec0 tx=0x7f38b4010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:35.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.062+0000 7f38c3fff700 1 --2- 172.21.15.103:0/1985075478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38c40ac950 0x7f38c40b2430 secure :-1 s=READY pgs=2183 cs=0 l=1 rx=0x7f38c4066ec0 tx=0x7f38b4010ed0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:35.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.062+0000 7f38c3fff700 1 --2- 172.21.15.103:0/1985075478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38c40ac950 0x7f38c40b2430 secure :-1 s=THROTTLE_DONE pgs=2183 cs=0 l=1 rx=0x7f38c4066ec0 tx=0x7f38b4010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:35.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.062+0000 7f38c17fa700 1 -- 172.21.15.103:0/1985075478 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38b4012c20 con 0x7f38c40ac950 2020-04-22T14:20:35.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.062+0000 7f38c3fff700 1 --2- 172.21.15.103:0/1985075478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38c40ac950 0x7f38c40b2430 secure :-1 s=THROTTLE_DONE pgs=2183 cs=0 l=1 rx=0x7f38c4066ec0 tx=0x7f38b4010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:35.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.062+0000 7f38c3fff700 1 --2- 172.21.15.103:0/1985075478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38c40ac950 0x7f38c40b2430 secure :-1 s=THROTTLE_DONE pgs=2183 cs=0 l=1 rx=0x7f38c4066ec0 tx=0x7f38b4010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:35.073 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.063+0000 7f38c17fa700 1 -- 172.21.15.103:0/1985075478 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b4012d80 con 0x7f38c40ac950 2020-04-22T14:20:35.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.063+0000 7f38ca6fd700 1 -- 172.21.15.103:0/1985075478 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38c4065660 con 0x7f38c40ac950 2020-04-22T14:20:35.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.063+0000 7f38c17fa700 1 -- 172.21.15.103:0/1985075478 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38b40058b0 con 0x7f38c40ac950 2020-04-22T14:20:35.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.063+0000 7f38ca6fd700 1 -- 172.21.15.103:0/1985075478 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c40b2030 con 0x7f38c40ac950 2020-04-22T14:20:35.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.063+0000 7f38c3fff700 1 --2- 172.21.15.103:0/1985075478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38c40ac950 0x7f38c40b2430 secure :-1 s=THROTTLE_DONE pgs=2183 cs=0 l=1 rx=0x7f38c4066ec0 tx=0x7f38b4010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:35.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.063+0000 7f38ca6fd700 1 -- 172.21.15.103:0/1985075478 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c41519d0 con 0x7f38c40ac950 2020-04-22T14:20:35.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.064+0000 7f38c17fa700 1 -- 172.21.15.103:0/1985075478 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f38b40071a0 con 0x7f38c40ac950 2020-04-22T14:20:35.074 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.064+0000 7f38c3fff700 1 --2- 172.21.15.103:0/1985075478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38c40ac950 0x7f38c40b2430 secure :-1 s=THROTTLE_DONE pgs=2183 cs=0 l=1 rx=0x7f38c4066ec0 tx=0x7f38b4010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:35.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.064+0000 7f38c17fa700 1 --2- 172.21.15.103:0/1985075478 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f38a404d960 0x7f38a404fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:35.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.064+0000 7f38c17fa700 1 -- 172.21.15.103:0/1985075478 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6288+0+0 (secure 0 0 0) 0x7f38b40618f0 con 0x7f38c40ac950 2020-04-22T14:20:35.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.064+0000 7f38c37fe700 1 --2- 172.21.15.103:0/1985075478 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f38a404d960 0x7f38a404fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:35.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.064+0000 7f38c37fe700 1 --2- 172.21.15.103:0/1985075478 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f38a404d960 0x7f38a404fe20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f38c40b6250 tx=0x7f38b8001dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:35.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.064+0000 7f38c37fe700 1 --2- 172.21.15.103:0/1985075478 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f38a404d960 0x7f38a404fe20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f38c40b6250 tx=0x7f38b8001dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:35.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.064+0000 7f38c37fe700 1 --2- 172.21.15.103:0/1985075478 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f38a404d960 0x7f38a404fe20 secure :-1 s=READY pgs=789 cs=0 l=1 rx=0x7f38c40b6250 tx=0x7f38b8001dc0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:35.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.068+0000 7f38c3fff700 1 --2- 172.21.15.103:0/1985075478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38c40ac950 0x7f38c40b2430 secure :-1 s=THROTTLE_DONE pgs=2183 cs=0 l=1 rx=0x7f38c4066ec0 tx=0x7f38b4010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:35.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.068+0000 7f38c17fa700 1 -- 172.21.15.103:0/1985075478 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f38b403ccd0 con 0x7f38c40ac950 2020-04-22T14:20:35.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.257+0000 7f38ca6fd700 1 -- 172.21.15.103:0/1985075478 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f38c4151fa0 con 0x7f38c40ac950 2020-04-22T14:20:35.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.509+0000 7f38c3fff700 1 --2- 172.21.15.103:0/1985075478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38c40ac950 0x7f38c40b2430 secure :-1 s=THROTTLE_DONE pgs=2183 cs=0 l=1 rx=0x7f38c4066ec0 tx=0x7f38b4010ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:35.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.509+0000 7f38c17fa700 1 -- 172.21.15.103:0/1985075478 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v116) v1 ==== 104+0+0 (secure 0 0 0) 0x7f38b40402f0 con 0x7f38c40ac950 2020-04-22T14:20:35.513 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.510+0000 7f38ca6fd700 1 -- 172.21.15.103:0/1985075478 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f38a404d960 msgr2=0x7f38a404fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:35.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.510+0000 7f38ca6fd700 1 --2- 172.21.15.103:0/1985075478 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f38a404d960 0x7f38a404fe20 secure :-1 s=READY pgs=789 cs=0 l=1 rx=0x7f38c40b6250 tx=0x7f38b8001dc0).stop 2020-04-22T14:20:35.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.510+0000 7f38ca6fd700 1 -- 172.21.15.103:0/1985075478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38c40ac950 msgr2=0x7f38c40b2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:35.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.510+0000 7f38ca6fd700 1 --2- 172.21.15.103:0/1985075478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38c40ac950 0x7f38c40b2430 secure :-1 s=READY pgs=2183 cs=0 l=1 rx=0x7f38c4066ec0 tx=0x7f38b4010ed0).stop 2020-04-22T14:20:35.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.511+0000 7f38ca6fd700 1 -- 172.21.15.103:0/1985075478 shutdown_connections 2020-04-22T14:20:35.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.511+0000 7f38ca6fd700 1 --2- 172.21.15.103:0/1985075478 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f38a404d960 0x7f38a404fe20 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:35.514 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.511+0000 7f38ca6fd700 1 --2- 172.21.15.103:0/1985075478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38c40ac950 0x7f38c40b2430 unknown :-1 s=CLOSED pgs=2183 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:35.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.511+0000 7f38ca6fd700 1 --2- 172.21.15.103:0/1985075478 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38c40b9140 0x7f38c4145ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:35.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.511+0000 7f38ca6fd700 1 -- 172.21.15.103:0/1985075478 >> 172.21.15.103:0/1985075478 conn(0x7f38c405b7b0 msgr2=0x7f38c40b6850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:35.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.511+0000 7f38ca6fd700 1 -- 172.21.15.103:0/1985075478 shutdown_connections 2020-04-22T14:20:35.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.511+0000 7f38ca6fd700 1 -- 172.21.15.103:0/1985075478 wait complete. 2020-04-22T14:20:35.523 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:35.537 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-04-22T14:20:35.699 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.686+0000 7fa1b658b700 1 Processor -- start 2020-04-22T14:20:35.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.686+0000 7fa1b658b700 1 -- start start 2020-04-22T14:20:35.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.687+0000 7fa1b658b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa1b00ac950 0x7fa1b0146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:35.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.687+0000 7fa1b658b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa1b01470a0 0x7fa1b0143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:35.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.687+0000 7fa1b658b700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1b01467e0 con 0x7fa1b00b9140 2020-04-22T14:20:35.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.687+0000 7fa1b658b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1b00602f0 con 0x7fa1b01470a0 2020-04-22T14:20:35.700 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.687+0000 7fa1b658b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b0060050 con 0x7fa1b00ac950 2020-04-22T14:20:35.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.687+0000 7fa1affff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa1b00b9140 0x7fa1b012b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51256/0 (socket says 172.21.15.103:51256) 2020-04-22T14:20:35.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.687+0000 7fa1affff700 1 -- 172.21.15.103:0/2921469084 learned_addr learned my addr 172.21.15.103:0/2921469084 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:35.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.687+0000 7fa1a7fff700 1 --2- 172.21.15.103:0/2921469084 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa1b00ac950 0x7fa1b0146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:35.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.687+0000 7fa1b4b28700 1 --2- 172.21.15.103:0/2921469084 >> v2:172.21.15.86:3300/0 conn(0x7fa1b01470a0 0x7fa1b0143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:35.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.687+0000 7fa1af7fe700 1 -- 172.21.15.103:0/2921469084 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3196541151 0 0) 0x7fa1b01467e0 con 0x7fa1b00b9140 2020-04-22T14:20:35.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.687+0000 7fa1af7fe700 1 -- 172.21.15.103:0/2921469084 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa190003230 con 0x7fa1b00b9140 2020-04-22T14:20:35.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.688+0000 7fa1a7fff700 1 -- 172.21.15.103:0/2921469084 >> v2:172.21.15.86:3300/0 conn(0x7fa1b01470a0 msgr2=0x7fa1b0143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:35.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.688+0000 7fa1a7fff700 1 --2- 172.21.15.103:0/2921469084 >> v2:172.21.15.86:3300/0 conn(0x7fa1b01470a0 0x7fa1b0143090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:35.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.688+0000 7fa1a7fff700 1 -- 172.21.15.103:0/2921469084 >> v1:172.21.15.103:6789/0 conn(0x7fa1b00b9140 legacy=0x7fa1b012b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:35.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.688+0000 7fa1a7fff700 1 -- 172.21.15.103:0/2921469084 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b00b9520 con 0x7fa1b00ac950 2020-04-22T14:20:35.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.688+0000 7fa1b4b28700 1 --2- 172.21.15.103:0/2921469084 >> v2:172.21.15.86:3300/0 conn(0x7fa1b01470a0 0x7fa1b0143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:20:35.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.688+0000 7fa1a7fff700 1 --2- 172.21.15.103:0/2921469084 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa1b00ac950 0x7fa1b0146c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa198002f30 tx=0x7fa198007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:35.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.688+0000 7fa1a7fff700 1 --2- 172.21.15.103:0/2921469084 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa1b00ac950 0x7fa1b0146c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa198002f30 tx=0x7fa198007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:35.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.688+0000 7fa1a7fff700 1 --2- 172.21.15.103:0/2921469084 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa1b00ac950 0x7fa1b0146c40 secure :-1 s=READY pgs=206 cs=0 l=1 rx=0x7fa198002f30 tx=0x7fa198007a40).ready entity=mon.2 client_cookie=7d03bc8c8c92703d server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:35.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.688+0000 7fa1a7fff700 1 --2- 172.21.15.103:0/2921469084 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa1b00ac950 0x7fa1b0146c40 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7fa198002f30 tx=0x7fa198007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:35.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.688+0000 7fa1af7fe700 1 -- 172.21.15.103:0/2921469084 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa198011310 con 0x7fa1b00ac950 2020-04-22T14:20:35.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.688+0000 7fa1a7fff700 1 --2- 172.21.15.103:0/2921469084 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa1b00ac950 0x7fa1b0146c40 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7fa198002f30 tx=0x7fa198007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:35.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.688+0000 7fa1a7fff700 1 --2- 172.21.15.103:0/2921469084 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa1b00ac950 0x7fa1b0146c40 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7fa198002f30 tx=0x7fa198007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:35.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.688+0000 7fa1af7fe700 1 -- 172.21.15.103:0/2921469084 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1980114b0 con 0x7fa1b00ac950 2020-04-22T14:20:35.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.688+0000 7fa1af7fe700 1 -- 172.21.15.103:0/2921469084 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa198011890 con 0x7fa1b00ac950 2020-04-22T14:20:35.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.688+0000 7fa1b658b700 1 -- 172.21.15.103:0/2921469084 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa1b00ac950 msgr2=0x7fa1b0146c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:35.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.688+0000 7fa1b658b700 1 --2- 172.21.15.103:0/2921469084 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa1b00ac950 0x7fa1b0146c40 secure :-1 s=READY pgs=206 cs=0 l=1 rx=0x7fa198002f30 tx=0x7fa198007a40).stop 2020-04-22T14:20:35.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.688+0000 7fa1b658b700 1 -- 172.21.15.103:0/2921469084 shutdown_connections 2020-04-22T14:20:35.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.688+0000 7fa1b658b700 1 --2- 172.21.15.103:0/2921469084 >> v2:172.21.15.86:3300/0 conn(0x7fa1b01470a0 0x7fa1b0143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:35.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.688+0000 7fa1b658b700 1 --2- 172.21.15.103:0/2921469084 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa1b00ac950 0x7fa1b0146c40 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:35.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.688+0000 7fa1b658b700 1 -- 172.21.15.103:0/2921469084 >> 172.21.15.103:0/2921469084 conn(0x7fa1b005b7b0 msgr2=0x7fa1b00b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:35.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.688+0000 7fa1b658b700 1 -- 172.21.15.103:0/2921469084 shutdown_connections 2020-04-22T14:20:35.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.689+0000 7fa1b658b700 1 -- 172.21.15.103:0/2921469084 wait complete. 2020-04-22T14:20:35.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.689+0000 7fa1b658b700 1 Processor -- start 2020-04-22T14:20:35.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.689+0000 7fa1b658b700 1 -- start start 2020-04-22T14:20:35.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.690+0000 7fa1b658b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa1b00ac950 0x7fa1b0064540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:35.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.690+0000 7fa1b658b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa1b01470a0 0x7fa1b012a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:35.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.690+0000 7fa1b658b700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1b012a7e0 con 0x7fa1b00b9140 2020-04-22T14:20:35.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.690+0000 7fa1b658b700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1b0062a00 con 0x7fa1b00ac950 2020-04-22T14:20:35.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.690+0000 7fa1b658b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b0062ca0 con 0x7fa1b01470a0 2020-04-22T14:20:35.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.690+0000 7fa1affff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa1b00ac950 0x7fa1b0064540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:35.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.690+0000 7fa1affff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa1b00ac950 0x7fa1b0064540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59072/0 (socket says 172.21.15.103:59072) 2020-04-22T14:20:35.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.690+0000 7fa1affff700 1 -- 172.21.15.103:0/1589284300 learned_addr learned my addr 172.21.15.103:0/1589284300 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:35.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.690+0000 7fa1b4b28700 1 --2- 172.21.15.103:0/1589284300 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa1b01470a0 0x7fa1b012a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:35.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.690+0000 7fa1affff700 1 -- 172.21.15.103:0/1589284300 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa1b01470a0 msgr2=0x7fa1b012a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:35.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.690+0000 7fa1affff700 1 --2- 172.21.15.103:0/1589284300 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa1b01470a0 0x7fa1b012a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:35.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.690+0000 7fa1affff700 1 -- 172.21.15.103:0/1589284300 >> v1:172.21.15.103:6789/0 conn(0x7fa1b00b9140 legacy=0x7fa1b00633e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:35.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.691+0000 7fa1affff700 1 -- 172.21.15.103:0/1589284300 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b0062f40 con 0x7fa1b00ac950 2020-04-22T14:20:35.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.691+0000 7fa1affff700 1 --2- 172.21.15.103:0/1589284300 >> v2:172.21.15.103:3300/0 conn(0x7fa1b00ac950 0x7fa1b0064540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa1b0065be0 tx=0x7fa1a0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:35.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.691+0000 7fa1affff700 1 --2- 172.21.15.103:0/1589284300 >> v2:172.21.15.103:3300/0 conn(0x7fa1b00ac950 0x7fa1b0064540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa1b0065be0 tx=0x7fa1a0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:35.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.691+0000 7fa1affff700 1 --2- 172.21.15.103:0/1589284300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1b00ac950 0x7fa1b0064540 secure :-1 s=READY pgs=2186 cs=0 l=1 rx=0x7fa1b0065be0 tx=0x7fa1a0010a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:35.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.691+0000 7fa1affff700 1 --2- 172.21.15.103:0/1589284300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1b00ac950 0x7fa1b0064540 secure :-1 s=THROTTLE_DONE pgs=2186 cs=0 l=1 rx=0x7fa1b0065be0 tx=0x7fa1a0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:35.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.691+0000 7fa1adffb700 1 -- 172.21.15.103:0/1589284300 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1a0005cc0 con 0x7fa1b00ac950 2020-04-22T14:20:35.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.691+0000 7fa1affff700 1 --2- 172.21.15.103:0/1589284300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1b00ac950 0x7fa1b0064540 secure :-1 s=THROTTLE_DONE pgs=2186 cs=0 l=1 rx=0x7fa1b0065be0 tx=0x7fa1a0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:35.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.691+0000 7fa1affff700 1 --2- 172.21.15.103:0/1589284300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1b00ac950 0x7fa1b0064540 secure :-1 s=THROTTLE_DONE pgs=2186 cs=0 l=1 rx=0x7fa1b0065be0 tx=0x7fa1a0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:35.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.691+0000 7fa1adffb700 1 -- 172.21.15.103:0/1589284300 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a0005e20 con 0x7fa1b00ac950 2020-04-22T14:20:35.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.691+0000 7fa1b658b700 1 -- 172.21.15.103:0/1589284300 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1b0155640 con 0x7fa1b00ac950 2020-04-22T14:20:35.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.691+0000 7fa1adffb700 1 -- 172.21.15.103:0/1589284300 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1a00062c0 con 0x7fa1b00ac950 2020-04-22T14:20:35.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.691+0000 7fa1b658b700 1 -- 172.21.15.103:0/1589284300 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1b0155a80 con 0x7fa1b00ac950 2020-04-22T14:20:35.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.691+0000 7fa1affff700 1 --2- 172.21.15.103:0/1589284300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1b00ac950 0x7fa1b0064540 secure :-1 s=THROTTLE_DONE pgs=2186 cs=0 l=1 rx=0x7fa1b0065be0 tx=0x7fa1a0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:35.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.692+0000 7fa1b658b700 1 -- 172.21.15.103:0/1589284300 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1b0056c90 con 0x7fa1b00ac950 2020-04-22T14:20:35.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.692+0000 7fa1adffb700 1 -- 172.21.15.103:0/1589284300 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fa1a0006500 con 0x7fa1b00ac950 2020-04-22T14:20:35.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.692+0000 7fa1affff700 1 --2- 172.21.15.103:0/1589284300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1b00ac950 0x7fa1b0064540 secure :-1 s=THROTTLE_DONE pgs=2186 cs=0 l=1 rx=0x7fa1b0065be0 tx=0x7fa1a0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:35.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.692+0000 7fa1adffb700 1 --2- 172.21.15.103:0/1589284300 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa19404d9d0 0x7fa19404fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:35.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.692+0000 7fa1adffb700 1 -- 172.21.15.103:0/1589284300 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6288+0+0 (secure 0 0 0) 0x7fa1a00090c0 con 0x7fa1b00ac950 2020-04-22T14:20:35.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.693+0000 7fa1a7fff700 1 --2- 172.21.15.103:0/1589284300 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa19404d9d0 0x7fa19404fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:35.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.693+0000 7fa1a7fff700 1 --2- 172.21.15.103:0/1589284300 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa19404d9d0 0x7fa19404fe90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa1b00b1980 tx=0x7fa198007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:35.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.693+0000 7fa1a7fff700 1 --2- 172.21.15.103:0/1589284300 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa19404d9d0 0x7fa19404fe90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa1b00b1980 tx=0x7fa198007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:35.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.693+0000 7fa1a7fff700 1 --2- 172.21.15.103:0/1589284300 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa19404d9d0 0x7fa19404fe90 secure :-1 s=READY pgs=790 cs=0 l=1 rx=0x7fa1b00b1980 tx=0x7fa198007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:35.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.696+0000 7fa1affff700 1 --2- 172.21.15.103:0/1589284300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1b00ac950 0x7fa1b0064540 secure :-1 s=THROTTLE_DONE pgs=2186 cs=0 l=1 rx=0x7fa1b0065be0 tx=0x7fa1a0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:35.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.696+0000 7fa1adffb700 1 -- 172.21.15.103:0/1589284300 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fa1a003ca40 con 0x7fa1b00ac950 2020-04-22T14:20:35.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:35.837+0000 7fa1b658b700 1 -- 172.21.15.103:0/1589284300 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa1b006a960 con 0x7fa1b00ac950 2020-04-22T14:20:36.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.521+0000 7fa1affff700 1 --2- 172.21.15.103:0/1589284300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1b00ac950 0x7fa1b0064540 secure :-1 s=THROTTLE_DONE pgs=2186 cs=0 l=1 rx=0x7fa1b0065be0 tx=0x7fa1a0010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:36.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.521+0000 7fa1adffb700 1 -- 172.21.15.103:0/1589284300 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v151) v1 ==== 185+0+0 (secure 0 0 0) 0x7fa1a0040060 con 0x7fa1b00ac950 2020-04-22T14:20:36.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.522+0000 7fa1b658b700 1 -- 172.21.15.103:0/1589284300 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa19404d9d0 msgr2=0x7fa19404fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:36.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.522+0000 7fa1b658b700 1 --2- 172.21.15.103:0/1589284300 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa19404d9d0 0x7fa19404fe90 secure :-1 s=READY pgs=790 cs=0 l=1 rx=0x7fa1b00b1980 tx=0x7fa198007a40).stop 2020-04-22T14:20:36.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.522+0000 7fa1b658b700 1 -- 172.21.15.103:0/1589284300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1b00ac950 msgr2=0x7fa1b0064540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:36.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.522+0000 7fa1b658b700 1 --2- 172.21.15.103:0/1589284300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1b00ac950 0x7fa1b0064540 secure :-1 s=READY pgs=2186 cs=0 l=1 rx=0x7fa1b0065be0 tx=0x7fa1a0010a40).stop 2020-04-22T14:20:36.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.523+0000 7fa1b658b700 1 -- 172.21.15.103:0/1589284300 shutdown_connections 2020-04-22T14:20:36.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.523+0000 7fa1b658b700 1 --2- 172.21.15.103:0/1589284300 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa19404d9d0 0x7fa19404fe90 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:36.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.523+0000 7fa1b658b700 1 --2- 172.21.15.103:0/1589284300 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa1b01470a0 0x7fa1b012a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:36.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.523+0000 7fa1b658b700 1 --2- 172.21.15.103:0/1589284300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1b00ac950 0x7fa1b0064540 unknown :-1 s=CLOSED pgs=2186 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:36.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.523+0000 7fa1b658b700 1 -- 172.21.15.103:0/1589284300 >> 172.21.15.103:0/1589284300 conn(0x7fa1b005b7b0 msgr2=0x7fa1b00b7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:36.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.523+0000 7fa1b658b700 1 -- 172.21.15.103:0/1589284300 shutdown_connections 2020-04-22T14:20:36.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.523+0000 7fa1b658b700 1 -- 172.21.15.103:0/1589284300 wait complete. 2020-04-22T14:20:36.528 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' removed 2020-04-22T14:20:36.537 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:36.551 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2020-04-22T14:20:36.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.703+0000 7f9bdebb1700 1 Processor -- start 2020-04-22T14:20:36.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.703+0000 7f9bdebb1700 1 -- start start 2020-04-22T14:20:36.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.704+0000 7f9bdebb1700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9bd80b5cf0 0x7f9bd80b7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:36.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.704+0000 7f9bdebb1700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bd80b0ed0 con 0x7f9bd8145980 2020-04-22T14:20:36.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.704+0000 7f9bdebb1700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bd80b1170 con 0x7f9bd814da20 2020-04-22T14:20:36.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.704+0000 7f9bdebb1700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bd80b1410 con 0x7f9bd80b5cf0 2020-04-22T14:20:36.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.704+0000 7f9bdc94d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9bd80b5cf0 0x7f9bd80b7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:36.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.704+0000 7f9bdc94d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9bd80b5cf0 0x7f9bd80b7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59080/0 (socket says 172.21.15.103:59080) 2020-04-22T14:20:36.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.704+0000 7f9bdc94d700 1 -- 172.21.15.103:0/3313059336 learned_addr learned my addr 172.21.15.103:0/3313059336 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:36.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.704+0000 7f9bdc94d700 1 -- 172.21.15.103:0/3313059336 >> v1:172.21.15.103:6789/0 conn(0x7f9bd814da20 legacy=0x7f9bd814fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:36.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.704+0000 7f9bdc94d700 1 -- 172.21.15.103:0/3313059336 >> v1:172.21.15.86:6789/0 conn(0x7f9bd8145980 legacy=0x7f9bd8145de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:36.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.704+0000 7f9bdc94d700 1 -- 172.21.15.103:0/3313059336 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd80b60d0 con 0x7f9bd80b5cf0 2020-04-22T14:20:36.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.704+0000 7f9bdc94d700 1 --2- 172.21.15.103:0/3313059336 >> v2:172.21.15.103:3300/0 conn(0x7f9bd80b5cf0 0x7f9bd80b7b50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9bd80635e0 tx=0x7f9bcc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:36.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.704+0000 7f9bdc94d700 1 --2- 172.21.15.103:0/3313059336 >> v2:172.21.15.103:3300/0 conn(0x7f9bd80b5cf0 0x7f9bd80b7b50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9bd80635e0 tx=0x7f9bcc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:36.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.704+0000 7f9bdc94d700 1 --2- 172.21.15.103:0/3313059336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bd80b5cf0 0x7f9bd80b7b50 secure :-1 s=READY pgs=2188 cs=0 l=1 rx=0x7f9bd80635e0 tx=0x7f9bcc007a40).ready entity=mon.1 client_cookie=2b5e0bcf293b069e server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:36.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.704+0000 7f9bdc94d700 1 --2- 172.21.15.103:0/3313059336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bd80b5cf0 0x7f9bd80b7b50 secure :-1 s=THROTTLE_DONE pgs=2188 cs=0 l=1 rx=0x7f9bd80635e0 tx=0x7f9bcc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:36.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.704+0000 7f9bd77fe700 1 -- 172.21.15.103:0/3313059336 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bcc0116e0 con 0x7f9bd80b5cf0 2020-04-22T14:20:36.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.704+0000 7f9bdc94d700 1 --2- 172.21.15.103:0/3313059336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bd80b5cf0 0x7f9bd80b7b50 secure :-1 s=THROTTLE_DONE pgs=2188 cs=0 l=1 rx=0x7f9bd80635e0 tx=0x7f9bcc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:36.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.704+0000 7f9bd77fe700 1 -- 172.21.15.103:0/3313059336 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bcc011840 con 0x7f9bd80b5cf0 2020-04-22T14:20:36.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.704+0000 7f9bdc94d700 1 --2- 172.21.15.103:0/3313059336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bd80b5cf0 0x7f9bd80b7b50 secure :-1 s=THROTTLE_DONE pgs=2188 cs=0 l=1 rx=0x7f9bd80635e0 tx=0x7f9bcc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:36.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.704+0000 7f9bdebb1700 1 -- 172.21.15.103:0/3313059336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bd80b5cf0 msgr2=0x7f9bd80b7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:36.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.704+0000 7f9bd77fe700 1 -- 172.21.15.103:0/3313059336 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bcc011c60 con 0x7f9bd80b5cf0 2020-04-22T14:20:36.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.704+0000 7f9bdebb1700 1 --2- 172.21.15.103:0/3313059336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bd80b5cf0 0x7f9bd80b7b50 secure :-1 s=READY pgs=2188 cs=0 l=1 rx=0x7f9bd80635e0 tx=0x7f9bcc007a40).stop 2020-04-22T14:20:36.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.705+0000 7f9bdebb1700 1 -- 172.21.15.103:0/3313059336 shutdown_connections 2020-04-22T14:20:36.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.705+0000 7f9bdebb1700 1 --2- 172.21.15.103:0/3313059336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bd80b5cf0 0x7f9bd80b7b50 unknown :-1 s=CLOSED pgs=2188 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:36.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.705+0000 7f9bdebb1700 1 -- 172.21.15.103:0/3313059336 >> 172.21.15.103:0/3313059336 conn(0x7f9bd805ad30 msgr2=0x7f9bd805b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:36.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.705+0000 7f9bdebb1700 1 -- 172.21.15.103:0/3313059336 shutdown_connections 2020-04-22T14:20:36.712 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.705+0000 7f9bdebb1700 1 -- 172.21.15.103:0/3313059336 wait complete. 2020-04-22T14:20:36.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.706+0000 7f9bdebb1700 1 Processor -- start 2020-04-22T14:20:36.713 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.706+0000 7f9bdebb1700 1 -- start start 2020-04-22T14:20:36.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.707+0000 7f9bdebb1700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9bd8145980 0x7f9bd80b9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:36.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.707+0000 7f9bdebb1700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9bd814da20 0x7f9bd80650a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:36.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.707+0000 7f9bdebb1700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bd8066ce0 con 0x7f9bd80b5cf0 2020-04-22T14:20:36.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.707+0000 7f9bdebb1700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bd8157470 con 0x7f9bd814da20 2020-04-22T14:20:36.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.707+0000 7f9bdebb1700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bd8065500 con 0x7f9bd8145980 2020-04-22T14:20:36.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.707+0000 7f9bd7fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9bd8145980 0x7f9bd80b9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:36.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.707+0000 7f9bd7fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9bd8145980 0x7f9bd80b9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59086/0 (socket says 172.21.15.103:59086) 2020-04-22T14:20:36.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.707+0000 7f9bd7fff700 1 -- 172.21.15.103:0/1589794157 learned_addr learned my addr 172.21.15.103:0/1589794157 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:36.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.707+0000 7f9bdd14e700 1 --2- 172.21.15.103:0/1589794157 >> v2:172.21.15.86:3300/0 conn(0x7f9bd814da20 0x7f9bd80650a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:36.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.707+0000 7f9bd7fff700 1 -- 172.21.15.103:0/1589794157 >> v2:172.21.15.86:3300/0 conn(0x7f9bd814da20 msgr2=0x7f9bd80650a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:36.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.707+0000 7f9bd7fff700 1 --2- 172.21.15.103:0/1589794157 >> v2:172.21.15.86:3300/0 conn(0x7f9bd814da20 0x7f9bd80650a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:36.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.707+0000 7f9bd7fff700 1 -- 172.21.15.103:0/1589794157 >> v1:172.21.15.86:6789/0 conn(0x7f9bd80b5cf0 legacy=0x7f9bd813bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:36.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.707+0000 7f9bd7fff700 1 -- 172.21.15.103:0/1589794157 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd813c260 con 0x7f9bd8145980 2020-04-22T14:20:36.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.707+0000 7f9bd7fff700 1 --2- 172.21.15.103:0/1589794157 >> v2:172.21.15.103:3300/0 conn(0x7f9bd8145980 0x7f9bd80b9c30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9bd8157390 tx=0x7f9bc4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:36.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.707+0000 7f9bd7fff700 1 --2- 172.21.15.103:0/1589794157 >> v2:172.21.15.103:3300/0 conn(0x7f9bd8145980 0x7f9bd80b9c30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9bd8157390 tx=0x7f9bc4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:36.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.707+0000 7f9bd7fff700 1 --2- 172.21.15.103:0/1589794157 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bd8145980 0x7f9bd80b9c30 secure :-1 s=READY pgs=2189 cs=0 l=1 rx=0x7f9bd8157390 tx=0x7f9bc4010a10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:36.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.707+0000 7f9bd7fff700 1 --2- 172.21.15.103:0/1589794157 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bd8145980 0x7f9bd80b9c30 secure :-1 s=THROTTLE_DONE pgs=2189 cs=0 l=1 rx=0x7f9bd8157390 tx=0x7f9bc4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:36.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.707+0000 7f9bd5ffb700 1 -- 172.21.15.103:0/1589794157 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bc400cd10 con 0x7f9bd8145980 2020-04-22T14:20:36.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.707+0000 7f9bd7fff700 1 --2- 172.21.15.103:0/1589794157 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bd8145980 0x7f9bd80b9c30 secure :-1 s=THROTTLE_DONE pgs=2189 cs=0 l=1 rx=0x7f9bd8157390 tx=0x7f9bc4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:36.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.707+0000 7f9bd7fff700 1 --2- 172.21.15.103:0/1589794157 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bd8145980 0x7f9bd80b9c30 secure :-1 s=THROTTLE_DONE pgs=2189 cs=0 l=1 rx=0x7f9bd8157390 tx=0x7f9bc4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:36.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.707+0000 7f9bd5ffb700 1 -- 172.21.15.103:0/1589794157 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc400ce70 con 0x7f9bd8145980 2020-04-22T14:20:36.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.707+0000 7f9bdebb1700 1 -- 172.21.15.103:0/1589794157 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bd813dac0 con 0x7f9bd8145980 2020-04-22T14:20:36.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.707+0000 7f9bd5ffb700 1 -- 172.21.15.103:0/1589794157 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bc400e370 con 0x7f9bd8145980 2020-04-22T14:20:36.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.707+0000 7f9bdebb1700 1 -- 172.21.15.103:0/1589794157 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bd813a0a0 con 0x7f9bd8145980 2020-04-22T14:20:36.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.708+0000 7f9bd7fff700 1 --2- 172.21.15.103:0/1589794157 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bd8145980 0x7f9bd80b9c30 secure :-1 s=THROTTLE_DONE pgs=2189 cs=0 l=1 rx=0x7f9bd8157390 tx=0x7f9bc4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:36.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.708+0000 7f9bdebb1700 1 -- 172.21.15.103:0/1589794157 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bd8056c90 con 0x7f9bd8145980 2020-04-22T14:20:36.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.708+0000 7f9bd5ffb700 1 -- 172.21.15.103:0/1589794157 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f9bc400e5e0 con 0x7f9bd8145980 2020-04-22T14:20:36.724 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.708+0000 7f9bd7fff700 1 --2- 172.21.15.103:0/1589794157 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bd8145980 0x7f9bd80b9c30 secure :-1 s=THROTTLE_DONE pgs=2189 cs=0 l=1 rx=0x7f9bd8157390 tx=0x7f9bc4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:36.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.709+0000 7f9bd5ffb700 1 --2- 172.21.15.103:0/1589794157 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9bc004d960 0x7f9bc004fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:36.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.709+0000 7f9bd5ffb700 1 -- 172.21.15.103:0/1589794157 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5850+0+0 (secure 0 0 0) 0x7f9bc40611c0 con 0x7f9bd8145980 2020-04-22T14:20:36.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.709+0000 7f9bdc94d700 1 --2- 172.21.15.103:0/1589794157 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9bc004d960 0x7f9bc004fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:36.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.709+0000 7f9bdc94d700 1 --2- 172.21.15.103:0/1589794157 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9bc004d960 0x7f9bc004fe20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9bd80ba440 tx=0x7f9bcc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:36.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.709+0000 7f9bdc94d700 1 --2- 172.21.15.103:0/1589794157 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9bc004d960 0x7f9bc004fe20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9bd80ba440 tx=0x7f9bcc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:36.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.709+0000 7f9bdc94d700 1 --2- 172.21.15.103:0/1589794157 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9bc004d960 0x7f9bc004fe20 secure :-1 s=READY pgs=791 cs=0 l=1 rx=0x7f9bd80ba440 tx=0x7f9bcc007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:36.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.713+0000 7f9bd7fff700 1 --2- 172.21.15.103:0/1589794157 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bd8145980 0x7f9bd80b9c30 secure :-1 s=THROTTLE_DONE pgs=2189 cs=0 l=1 rx=0x7f9bd8157390 tx=0x7f9bc4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:36.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.713+0000 7f9bd5ffb700 1 -- 172.21.15.103:0/1589794157 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f9bc403c600 con 0x7f9bd8145980 2020-04-22T14:20:36.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:36.854+0000 7f9bdebb1700 1 -- 172.21.15.103:0/1589794157 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9bd813d6a0 con 0x7f9bd8145980 2020-04-22T14:20:37.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.519+0000 7f9bd7fff700 1 --2- 172.21.15.103:0/1589794157 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bd8145980 0x7f9bd80b9c30 secure :-1 s=THROTTLE_DONE pgs=2189 cs=0 l=1 rx=0x7f9bd8157390 tx=0x7f9bc4010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:37.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.520+0000 7f9bd5ffb700 1 -- 172.21.15.103:0/1589794157 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v152) v1 ==== 173+0+0 (secure 0 0 0) 0x7f9bc403fc20 con 0x7f9bd8145980 2020-04-22T14:20:37.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.522+0000 7f9bdebb1700 1 -- 172.21.15.103:0/1589794157 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9bc004d960 msgr2=0x7f9bc004fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:37.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.522+0000 7f9bdebb1700 1 --2- 172.21.15.103:0/1589794157 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9bc004d960 0x7f9bc004fe20 secure :-1 s=READY pgs=791 cs=0 l=1 rx=0x7f9bd80ba440 tx=0x7f9bcc007a40).stop 2020-04-22T14:20:37.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.522+0000 7f9bdebb1700 1 -- 172.21.15.103:0/1589794157 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bd8145980 msgr2=0x7f9bd80b9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:37.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.522+0000 7f9bdebb1700 1 --2- 172.21.15.103:0/1589794157 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bd8145980 0x7f9bd80b9c30 secure :-1 s=READY pgs=2189 cs=0 l=1 rx=0x7f9bd8157390 tx=0x7f9bc4010a10).stop 2020-04-22T14:20:37.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.524+0000 7f9bdebb1700 1 -- 172.21.15.103:0/1589794157 shutdown_connections 2020-04-22T14:20:37.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.524+0000 7f9bdebb1700 1 --2- 172.21.15.103:0/1589794157 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f9bc004d960 0x7f9bc004fe20 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:37.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.524+0000 7f9bdebb1700 1 --2- 172.21.15.103:0/1589794157 >> v2:172.21.15.86:3300/0 conn(0x7f9bd814da20 0x7f9bd80650a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:37.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.524+0000 7f9bdebb1700 1 --2- 172.21.15.103:0/1589794157 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bd8145980 0x7f9bd80b9c30 unknown :-1 s=CLOSED pgs=2189 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:37.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.524+0000 7f9bdebb1700 1 -- 172.21.15.103:0/1589794157 >> 172.21.15.103:0/1589794157 conn(0x7f9bd805ad30 msgr2=0x7f9bd80b3a20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:37.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.524+0000 7f9bdebb1700 1 -- 172.21.15.103:0/1589794157 shutdown_connections 2020-04-22T14:20:37.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.524+0000 7f9bdebb1700 1 -- 172.21.15.103:0/1589794157 wait complete. 2020-04-22T14:20:37.527 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' removed 2020-04-22T14:20:37.539 INFO:tasks.ceph.mds.a:Restarting daemon 2020-04-22T14:20:37.539 INFO:tasks.ceph.mds.a:Stopping old one... 2020-04-22T14:20:37.539 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-04-22T14:20:37.540 INFO:teuthology.orchestra.run:waiting for 300 2020-04-22T14:20:37.540 INFO:tasks.ceph.mds.b:Restarting daemon 2020-04-22T14:20:37.540 INFO:tasks.ceph.mds.b:Stopping old one... 2020-04-22T14:20:37.540 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-04-22T14:20:37.540 INFO:teuthology.orchestra.run:waiting for 300 2020-04-22T14:20:37.548 INFO:tasks.ceph.mds.a:Stopped 2020-04-22T14:20:37.548 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:37.549 INFO:tasks.ceph.mds.b:Stopped 2020-04-22T14:20:37.549 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:20:37.603 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-04-22T14:20:37.605 INFO:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-04-22T14:20:37.645 INFO:tasks.ceph.mds.a:Started 2020-04-22T14:20:37.645 DEBUG:teuthology.parallel:result is None 2020-04-22T14:20:37.656 INFO:tasks.ceph.mds.b:Started 2020-04-22T14:20:37.656 DEBUG:teuthology.parallel:result is None 2020-04-22T14:20:37.656 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:37.672 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2020-04-22T14:20:37.726 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2020-04-22T14:20:37.735 INFO:tasks.ceph.mds.b.smithi086.stdout:starting mds.b at 2020-04-22T14:20:37.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.823+0000 7f4b6af3c700 1 Processor -- start 2020-04-22T14:20:37.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.823+0000 7f4b6af3c700 1 -- start start 2020-04-22T14:20:37.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.824+0000 7f4b6af3c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4b640b86a0 0x7f4b6405b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:37.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.824+0000 7f4b6af3c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4b64143a50 0x7f4b64143f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:37.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.824+0000 7f4b6af3c700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b6414ab90 con 0x7f4b6405b0b0 2020-04-22T14:20:37.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.824+0000 7f4b6af3c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b64146830 con 0x7f4b640b86a0 2020-04-22T14:20:37.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.824+0000 7f4b6af3c700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b64146a20 con 0x7f4b64143a50 2020-04-22T14:20:37.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.824+0000 7f4b694d9700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4b64143a50 0x7f4b64143f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:37.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.824+0000 7f4b694d9700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4b64143a50 0x7f4b64143f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59106/0 (socket says 172.21.15.103:59106) 2020-04-22T14:20:37.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.824+0000 7f4b694d9700 1 -- 172.21.15.103:0/2220503067 learned_addr learned my addr 172.21.15.103:0/2220503067 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:37.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.824+0000 7f4b63fff700 1 --2- 172.21.15.103:0/2220503067 >> v2:172.21.15.86:3300/0 conn(0x7f4b640b86a0 0x7f4b6405b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:37.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.824+0000 7f4b694d9700 1 -- 172.21.15.103:0/2220503067 >> v2:172.21.15.86:3300/0 conn(0x7f4b640b86a0 msgr2=0x7f4b6405b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:37.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.824+0000 7f4b694d9700 1 --2- 172.21.15.103:0/2220503067 >> v2:172.21.15.86:3300/0 conn(0x7f4b640b86a0 0x7f4b6405b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:37.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.824+0000 7f4b694d9700 1 -- 172.21.15.103:0/2220503067 >> v1:172.21.15.86:6789/0 conn(0x7f4b6405b0b0 legacy=0x7f4b6405f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:37.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.824+0000 7f4b694d9700 1 -- 172.21.15.103:0/2220503067 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b6405ff10 con 0x7f4b64143a50 2020-04-22T14:20:37.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.825+0000 7f4b694d9700 1 --2- 172.21.15.103:0/2220503067 >> v2:172.21.15.103:3300/0 conn(0x7f4b64143a50 0x7f4b64143f00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4b64060ab0 tx=0x7f4b5c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:37.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.825+0000 7f4b694d9700 1 --2- 172.21.15.103:0/2220503067 >> v2:172.21.15.103:3300/0 conn(0x7f4b64143a50 0x7f4b64143f00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4b64060ab0 tx=0x7f4b5c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:37.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.825+0000 7f4b694d9700 1 --2- 172.21.15.103:0/2220503067 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b64143a50 0x7f4b64143f00 secure :-1 s=READY pgs=2193 cs=0 l=1 rx=0x7f4b64060ab0 tx=0x7f4b5c007dc0).ready entity=mon.1 client_cookie=be34ab20eece2ad5 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:37.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.825+0000 7f4b694d9700 1 --2- 172.21.15.103:0/2220503067 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b64143a50 0x7f4b64143f00 secure :-1 s=THROTTLE_DONE pgs=2193 cs=0 l=1 rx=0x7f4b64060ab0 tx=0x7f4b5c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:37.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.825+0000 7f4b637fe700 1 -- 172.21.15.103:0/2220503067 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b5c011ea0 con 0x7f4b64143a50 2020-04-22T14:20:37.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.825+0000 7f4b694d9700 1 --2- 172.21.15.103:0/2220503067 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b64143a50 0x7f4b64143f00 secure :-1 s=THROTTLE_DONE pgs=2193 cs=0 l=1 rx=0x7f4b64060ab0 tx=0x7f4b5c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:37.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.825+0000 7f4b637fe700 1 -- 172.21.15.103:0/2220503067 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b5c00a180 con 0x7f4b64143a50 2020-04-22T14:20:37.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.825+0000 7f4b694d9700 1 --2- 172.21.15.103:0/2220503067 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b64143a50 0x7f4b64143f00 secure :-1 s=THROTTLE_DONE pgs=2193 cs=0 l=1 rx=0x7f4b64060ab0 tx=0x7f4b5c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:37.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.825+0000 7f4b637fe700 1 -- 172.21.15.103:0/2220503067 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b5c00a560 con 0x7f4b64143a50 2020-04-22T14:20:37.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.825+0000 7f4b6af3c700 1 -- 172.21.15.103:0/2220503067 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b64143a50 msgr2=0x7f4b64143f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:37.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.825+0000 7f4b6af3c700 1 --2- 172.21.15.103:0/2220503067 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b64143a50 0x7f4b64143f00 secure :-1 s=READY pgs=2193 cs=0 l=1 rx=0x7f4b64060ab0 tx=0x7f4b5c007dc0).stop 2020-04-22T14:20:37.838 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.825+0000 7f4b6af3c700 1 -- 172.21.15.103:0/2220503067 shutdown_connections 2020-04-22T14:20:37.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.825+0000 7f4b6af3c700 1 --2- 172.21.15.103:0/2220503067 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b64143a50 0x7f4b64143f00 unknown :-1 s=CLOSED pgs=2193 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:37.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.825+0000 7f4b6af3c700 1 --2- 172.21.15.103:0/2220503067 >> v2:172.21.15.86:3300/0 conn(0x7f4b640b86a0 0x7f4b6405b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:37.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.825+0000 7f4b6af3c700 1 -- 172.21.15.103:0/2220503067 >> 172.21.15.103:0/2220503067 conn(0x7f4b640bcae0 msgr2=0x7f4b640bcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:37.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.825+0000 7f4b6af3c700 1 -- 172.21.15.103:0/2220503067 shutdown_connections 2020-04-22T14:20:37.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.825+0000 7f4b6af3c700 1 -- 172.21.15.103:0/2220503067 wait complete. 2020-04-22T14:20:37.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.826+0000 7f4b6af3c700 1 Processor -- start 2020-04-22T14:20:37.839 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.826+0000 7f4b6af3c700 1 -- start start 2020-04-22T14:20:37.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.827+0000 7f4b6af3c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4b6405b0b0 0x7f4b640ae010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:37.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.827+0000 7f4b6af3c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b64143a50 0x7f4b64142980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:37.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.827+0000 7f4b6af3c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b640b0bc0 con 0x7f4b640b86a0 2020-04-22T14:20:37.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.827+0000 7f4b6af3c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b640ac740 con 0x7f4b6405b0b0 2020-04-22T14:20:37.843 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.827+0000 7f4b6af3c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b640ac9e0 con 0x7f4b64143a50 2020-04-22T14:20:37.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.827+0000 7f4b63fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f4b640b86a0 0x7f4b64142270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51300/0 (socket says 172.21.15.103:51300) 2020-04-22T14:20:37.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.827+0000 7f4b63fff700 1 -- 172.21.15.103:0/1759951402 learned_addr learned my addr 172.21.15.103:0/1759951402 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:37.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.827+0000 7f4b68cd8700 1 --2- 172.21.15.103:0/1759951402 >> v2:172.21.15.86:3300/0 conn(0x7f4b6405b0b0 0x7f4b640ae010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:37.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.827+0000 7f4b694d9700 1 --2- 172.21.15.103:0/1759951402 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b64143a50 0x7f4b64142980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:37.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.827+0000 7f4b61ffb700 1 -- 172.21.15.103:0/1759951402 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2219396050 0 0) 0x7f4b640b0bc0 con 0x7f4b640b86a0 2020-04-22T14:20:37.844 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.827+0000 7f4b61ffb700 1 -- 172.21.15.103:0/1759951402 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b44002fe0 con 0x7f4b640b86a0 2020-04-22T14:20:37.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.828+0000 7f4b61ffb700 1 -- 172.21.15.103:0/1759951402 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 454664533 0 0) 0x7f4b44002fe0 con 0x7f4b640b86a0 2020-04-22T14:20:37.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.828+0000 7f4b61ffb700 1 -- 172.21.15.103:0/1759951402 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4b640b0bc0 con 0x7f4b640b86a0 2020-04-22T14:20:37.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.828+0000 7f4b61ffb700 1 -- 172.21.15.103:0/1759951402 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f4b58001490 con 0x7f4b640b86a0 2020-04-22T14:20:37.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.828+0000 7f4b694d9700 1 -- 172.21.15.103:0/1759951402 >> v2:172.21.15.86:3300/0 conn(0x7f4b6405b0b0 msgr2=0x7f4b640ae010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:37.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.828+0000 7f4b694d9700 1 --2- 172.21.15.103:0/1759951402 >> v2:172.21.15.86:3300/0 conn(0x7f4b6405b0b0 0x7f4b640ae010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:37.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.828+0000 7f4b694d9700 1 -- 172.21.15.103:0/1759951402 >> v1:172.21.15.103:6789/0 conn(0x7f4b640b86a0 legacy=0x7f4b64142270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:37.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.828+0000 7f4b694d9700 1 -- 172.21.15.103:0/1759951402 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b640ae7a0 con 0x7f4b64143a50 2020-04-22T14:20:37.845 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.828+0000 7f4b68cd8700 1 --2- 172.21.15.103:0/1759951402 >> v2:172.21.15.86:3300/0 conn(0x7f4b6405b0b0 0x7f4b640ae010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:20:37.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.828+0000 7f4b694d9700 1 --2- 172.21.15.103:0/1759951402 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b64143a50 0x7f4b64142980 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4b64060ab0 tx=0x7f4b5c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:37.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.828+0000 7f4b694d9700 1 --2- 172.21.15.103:0/1759951402 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b64143a50 0x7f4b64142980 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4b64060ab0 tx=0x7f4b5c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:37.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.828+0000 7f4b694d9700 1 --2- 172.21.15.103:0/1759951402 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b64143a50 0x7f4b64142980 secure :-1 s=READY pgs=208 cs=0 l=1 rx=0x7f4b64060ab0 tx=0x7f4b5c007dc0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:37.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.828+0000 7f4b694d9700 1 --2- 172.21.15.103:0/1759951402 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b64143a50 0x7f4b64142980 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7f4b64060ab0 tx=0x7f4b5c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:37.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.828+0000 7f4b61ffb700 1 -- 172.21.15.103:0/1759951402 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b5c005a40 con 0x7f4b64143a50 2020-04-22T14:20:37.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.828+0000 7f4b694d9700 1 --2- 172.21.15.103:0/1759951402 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b64143a50 0x7f4b64142980 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7f4b64060ab0 tx=0x7f4b5c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:37.846 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.828+0000 7f4b61ffb700 1 -- 172.21.15.103:0/1759951402 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b5c005ba0 con 0x7f4b64143a50 2020-04-22T14:20:37.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.828+0000 7f4b694d9700 1 --2- 172.21.15.103:0/1759951402 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b64143a50 0x7f4b64142980 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7f4b64060ab0 tx=0x7f4b5c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:37.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.828+0000 7f4b61ffb700 1 -- 172.21.15.103:0/1759951402 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b5c007170 con 0x7f4b64143a50 2020-04-22T14:20:37.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.828+0000 7f4b6af3c700 1 -- 172.21.15.103:0/1759951402 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b640b0550 con 0x7f4b64143a50 2020-04-22T14:20:37.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.828+0000 7f4b6af3c700 1 -- 172.21.15.103:0/1759951402 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b640b0e80 con 0x7f4b64143a50 2020-04-22T14:20:37.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.829+0000 7f4b694d9700 1 --2- 172.21.15.103:0/1759951402 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b64143a50 0x7f4b64142980 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7f4b64060ab0 tx=0x7f4b5c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:37.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.829+0000 7f4b61ffb700 1 -- 172.21.15.103:0/1759951402 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f4b5c0073b0 con 0x7f4b64143a50 2020-04-22T14:20:37.847 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.829+0000 7f4b6af3c700 1 -- 172.21.15.103:0/1759951402 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b64056c90 con 0x7f4b64143a50 2020-04-22T14:20:37.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.829+0000 7f4b694d9700 1 --2- 172.21.15.103:0/1759951402 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b64143a50 0x7f4b64142980 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7f4b64060ab0 tx=0x7f4b5c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:37.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.829+0000 7f4b61ffb700 1 --2- 172.21.15.103:0/1759951402 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4b4404df50 0x7f4b44050410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:37.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.829+0000 7f4b61ffb700 1 -- 172.21.15.103:0/1759951402 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f4b5c061db0 con 0x7f4b64143a50 2020-04-22T14:20:37.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.829+0000 7f4b68cd8700 1 --2- 172.21.15.103:0/1759951402 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4b4404df50 0x7f4b44050410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:37.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.830+0000 7f4b68cd8700 1 --2- 172.21.15.103:0/1759951402 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4b4404df50 0x7f4b44050410 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4b64146da0 tx=0x7f4b540013a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:37.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.830+0000 7f4b68cd8700 1 --2- 172.21.15.103:0/1759951402 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4b4404df50 0x7f4b44050410 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4b64146da0 tx=0x7f4b540013a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:37.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.830+0000 7f4b68cd8700 1 --2- 172.21.15.103:0/1759951402 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4b4404df50 0x7f4b44050410 secure :-1 s=READY pgs=792 cs=0 l=1 rx=0x7f4b64146da0 tx=0x7f4b540013a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:37.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.833+0000 7f4b694d9700 1 --2- 172.21.15.103:0/1759951402 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b64143a50 0x7f4b64142980 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7f4b64060ab0 tx=0x7f4b5c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:37.849 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.833+0000 7f4b61ffb700 1 -- 172.21.15.103:0/1759951402 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f4b5c03d2b0 con 0x7f4b64143a50 2020-04-22T14:20:37.996 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:37.994+0000 7f4b6af3c700 1 -- 172.21.15.103:0/1759951402 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f4b64067c80 con 0x7f4b64143a50 2020-04-22T14:20:38.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.759+0000 7f4b694d9700 1 --2- 172.21.15.103:0/1759951402 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b64143a50 0x7f4b64142980 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7f4b64060ab0 tx=0x7f4b5c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:38.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.760+0000 7f4b61ffb700 1 -- 172.21.15.103:0/1759951402 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v154) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4b5c0408d0 con 0x7f4b64143a50 2020-04-22T14:20:38.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.761+0000 7f4b6af3c700 1 -- 172.21.15.103:0/1759951402 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4b4404df50 msgr2=0x7f4b44050410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:38.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.761+0000 7f4b6af3c700 1 --2- 172.21.15.103:0/1759951402 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4b4404df50 0x7f4b44050410 secure :-1 s=READY pgs=792 cs=0 l=1 rx=0x7f4b64146da0 tx=0x7f4b540013a0).stop 2020-04-22T14:20:38.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.761+0000 7f4b6af3c700 1 -- 172.21.15.103:0/1759951402 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b64143a50 msgr2=0x7f4b64142980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:38.764 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.761+0000 7f4b6af3c700 1 --2- 172.21.15.103:0/1759951402 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b64143a50 0x7f4b64142980 secure :-1 s=READY pgs=208 cs=0 l=1 rx=0x7f4b64060ab0 tx=0x7f4b5c007dc0).stop 2020-04-22T14:20:38.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.762+0000 7f4b6af3c700 1 -- 172.21.15.103:0/1759951402 shutdown_connections 2020-04-22T14:20:38.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.762+0000 7f4b6af3c700 1 --2- 172.21.15.103:0/1759951402 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b64143a50 0x7f4b64142980 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:38.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.762+0000 7f4b6af3c700 1 --2- 172.21.15.103:0/1759951402 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f4b4404df50 0x7f4b44050410 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:38.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.762+0000 7f4b6af3c700 1 --2- 172.21.15.103:0/1759951402 >> v2:172.21.15.86:3300/0 conn(0x7f4b6405b0b0 0x7f4b640ae010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:38.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.762+0000 7f4b6af3c700 1 -- 172.21.15.103:0/1759951402 >> 172.21.15.103:0/1759951402 conn(0x7f4b640bcae0 msgr2=0x7f4b640b9fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:38.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.762+0000 7f4b6af3c700 1 -- 172.21.15.103:0/1759951402 shutdown_connections 2020-04-22T14:20:38.765 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.762+0000 7f4b6af3c700 1 -- 172.21.15.103:0/1759951402 wait complete. 2020-04-22T14:20:38.766 INFO:teuthology.orchestra.run.smithi103.stderr: removed all blacklist entries 2020-04-22T14:20:38.775 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2020-04-22T14:20:38.776 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:38.836 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2020-04-22T14:20:38.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.983+0000 7f5c8113b700 1 Processor -- start 2020-04-22T14:20:38.985 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.983+0000 7f5c8113b700 1 -- start start 2020-04-22T14:20:38.988 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.984+0000 7f5c8113b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5c7c065fe0 0x7f5c7c1464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:38.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.984+0000 7f5c8113b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5c7c063e30 0x7f5c7c0642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:38.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.984+0000 7f5c8113b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c7c143300 con 0x7f5c7c12c0d0 2020-04-22T14:20:38.999 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.984+0000 7f5c8113b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c7c1435a0 con 0x7f5c7c065fe0 2020-04-22T14:20:39.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.984+0000 7f5c8113b700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c7c143840 con 0x7f5c7c063e30 2020-04-22T14:20:39.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.984+0000 7f5c7b59e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5c7c063e30 0x7f5c7c0642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:39.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.984+0000 7f5c7b59e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5c7c063e30 0x7f5c7c0642c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59120/0 (socket says 172.21.15.103:59120) 2020-04-22T14:20:39.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.984+0000 7f5c7b59e700 1 -- 172.21.15.103:0/4246991170 learned_addr learned my addr 172.21.15.103:0/4246991170 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:39.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.984+0000 7f5c7a59c700 1 --2- 172.21.15.103:0/4246991170 >> v2:172.21.15.86:3300/0 conn(0x7f5c7c065fe0 0x7f5c7c1464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:39.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.984+0000 7f5c7b59e700 1 -- 172.21.15.103:0/4246991170 >> v2:172.21.15.86:3300/0 conn(0x7f5c7c065fe0 msgr2=0x7f5c7c1464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:39.000 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.984+0000 7f5c7b59e700 1 --2- 172.21.15.103:0/4246991170 >> v2:172.21.15.86:3300/0 conn(0x7f5c7c065fe0 0x7f5c7c1464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:39.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.984+0000 7f5c7b59e700 1 -- 172.21.15.103:0/4246991170 >> v1:172.21.15.86:6789/0 conn(0x7f5c7c12c0d0 legacy=0x7f5c7c05b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:39.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.984+0000 7f5c7b59e700 1 -- 172.21.15.103:0/4246991170 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c7c05bb50 con 0x7f5c7c063e30 2020-04-22T14:20:39.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.984+0000 7f5c7b59e700 1 --2- 172.21.15.103:0/4246991170 >> v2:172.21.15.103:3300/0 conn(0x7f5c7c063e30 0x7f5c7c0642c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5c7c0669a0 tx=0x7f5c74007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.984+0000 7f5c7b59e700 1 --2- 172.21.15.103:0/4246991170 >> v2:172.21.15.103:3300/0 conn(0x7f5c7c063e30 0x7f5c7c0642c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5c7c0669a0 tx=0x7f5c74007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.984+0000 7f5c7b59e700 1 --2- 172.21.15.103:0/4246991170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c7c063e30 0x7f5c7c0642c0 secure :-1 s=READY pgs=2195 cs=0 l=1 rx=0x7f5c7c0669a0 tx=0x7f5c74007dc0).ready entity=mon.1 client_cookie=4e505b22c1de5666 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:39.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.984+0000 7f5c7b59e700 1 --2- 172.21.15.103:0/4246991170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c7c063e30 0x7f5c7c0642c0 secure :-1 s=THROTTLE_DONE pgs=2195 cs=0 l=1 rx=0x7f5c7c0669a0 tx=0x7f5c74007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.001 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.984+0000 7f5c7b59e700 1 --2- 172.21.15.103:0/4246991170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c7c063e30 0x7f5c7c0642c0 secure :-1 s=THROTTLE_DONE pgs=2195 cs=0 l=1 rx=0x7f5c7c0669a0 tx=0x7f5c74007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.984+0000 7f5c7b59e700 1 --2- 172.21.15.103:0/4246991170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c7c063e30 0x7f5c7c0642c0 secure :-1 s=THROTTLE_DONE pgs=2195 cs=0 l=1 rx=0x7f5c7c0669a0 tx=0x7f5c74007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.984+0000 7f5c79d9b700 1 -- 172.21.15.103:0/4246991170 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c7400a180 con 0x7f5c7c063e30 2020-04-22T14:20:39.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.984+0000 7f5c79d9b700 1 -- 172.21.15.103:0/4246991170 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c7400a2e0 con 0x7f5c7c063e30 2020-04-22T14:20:39.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.984+0000 7f5c79d9b700 1 -- 172.21.15.103:0/4246991170 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c7400a6c0 con 0x7f5c7c063e30 2020-04-22T14:20:39.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.984+0000 7f5c8113b700 1 -- 172.21.15.103:0/4246991170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c7c063e30 msgr2=0x7f5c7c0642c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:39.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.984+0000 7f5c8113b700 1 --2- 172.21.15.103:0/4246991170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c7c063e30 0x7f5c7c0642c0 secure :-1 s=READY pgs=2195 cs=0 l=1 rx=0x7f5c7c0669a0 tx=0x7f5c74007dc0).stop 2020-04-22T14:20:39.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.985+0000 7f5c8113b700 1 -- 172.21.15.103:0/4246991170 shutdown_connections 2020-04-22T14:20:39.002 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.985+0000 7f5c8113b700 1 --2- 172.21.15.103:0/4246991170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c7c063e30 0x7f5c7c0642c0 unknown :-1 s=CLOSED pgs=2195 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:39.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.985+0000 7f5c8113b700 1 --2- 172.21.15.103:0/4246991170 >> v2:172.21.15.86:3300/0 conn(0x7f5c7c065fe0 0x7f5c7c1464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:39.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.985+0000 7f5c8113b700 1 -- 172.21.15.103:0/4246991170 >> 172.21.15.103:0/4246991170 conn(0x7f5c7c0b9160 msgr2=0x7f5c7c05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:39.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.985+0000 7f5c8113b700 1 -- 172.21.15.103:0/4246991170 shutdown_connections 2020-04-22T14:20:39.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.985+0000 7f5c8113b700 1 -- 172.21.15.103:0/4246991170 wait complete. 2020-04-22T14:20:39.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.986+0000 7f5c8113b700 1 Processor -- start 2020-04-22T14:20:39.003 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.986+0000 7f5c8113b700 1 -- start start 2020-04-22T14:20:39.006 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.987+0000 7f5c8113b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5c7c063e30 0x7f5c7c0aecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:39.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.987+0000 7f5c8113b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c7c065fe0 0x7f5c7c0b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:39.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.987+0000 7f5c8113b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c7c128ae0 con 0x7f5c7c12c0d0 2020-04-22T14:20:39.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.987+0000 7f5c8113b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c7c128d80 con 0x7f5c7c063e30 2020-04-22T14:20:39.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.987+0000 7f5c8113b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7c129020 con 0x7f5c7c065fe0 2020-04-22T14:20:39.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.987+0000 7f5c7a59c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c7c065fe0 0x7f5c7c0b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:39.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.987+0000 7f5c7ad9d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5c7c063e30 0x7f5c7c0aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:39.007 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.987+0000 7f5c7a59c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c7c065fe0 0x7f5c7c0b02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:43904/0 (socket says 172.21.15.103:43904) 2020-04-22T14:20:39.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.987+0000 7f5c7a59c700 1 -- 172.21.15.103:0/2743680900 learned_addr learned my addr 172.21.15.103:0/2743680900 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:39.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.987+0000 7f5c7a59c700 1 -- 172.21.15.103:0/2743680900 >> v2:172.21.15.86:3300/0 conn(0x7f5c7c063e30 msgr2=0x7f5c7c0aecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:39.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.987+0000 7f5c7a59c700 1 --2- 172.21.15.103:0/2743680900 >> v2:172.21.15.86:3300/0 conn(0x7f5c7c063e30 0x7f5c7c0aecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:39.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.987+0000 7f5c7a59c700 1 -- 172.21.15.103:0/2743680900 >> v1:172.21.15.86:6789/0 conn(0x7f5c7c12c0d0 legacy=0x7f5c7c0ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:39.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.987+0000 7f5c6bfff700 1 -- 172.21.15.103:0/2743680900 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1657800515 0 0) 0x7f5c7c128ae0 con 0x7f5c7c12c0d0 2020-04-22T14:20:39.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.987+0000 7f5c7a59c700 1 -- 172.21.15.103:0/2743680900 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c7c1292c0 con 0x7f5c7c065fe0 2020-04-22T14:20:39.008 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.987+0000 7f5c7ad9d700 1 --2- 172.21.15.103:0/2743680900 >> v2:172.21.15.86:3300/0 conn(0x7f5c7c063e30 0x7f5c7c0aecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:20:39.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.987+0000 7f5c7a59c700 1 --2- 172.21.15.103:0/2743680900 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c7c065fe0 0x7f5c7c0b02f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5c70002f30 tx=0x7f5c70010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.987+0000 7f5c7a59c700 1 --2- 172.21.15.103:0/2743680900 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c7c065fe0 0x7f5c7c0b02f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5c70002f30 tx=0x7f5c70010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.987+0000 7f5c7a59c700 1 --2- 172.21.15.103:0/2743680900 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c7c065fe0 0x7f5c7c0b02f0 secure :-1 s=READY pgs=209 cs=0 l=1 rx=0x7f5c70002f30 tx=0x7f5c70010c00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:39.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.988+0000 7f5c7a59c700 1 --2- 172.21.15.103:0/2743680900 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c7c065fe0 0x7f5c7c0b02f0 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7f5c70002f30 tx=0x7f5c70010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.988+0000 7f5c6bfff700 1 -- 172.21.15.103:0/2743680900 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c70012a30 con 0x7f5c7c065fe0 2020-04-22T14:20:39.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.988+0000 7f5c7a59c700 1 --2- 172.21.15.103:0/2743680900 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c7c065fe0 0x7f5c7c0b02f0 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7f5c70002f30 tx=0x7f5c70010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.009 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.988+0000 7f5c7a59c700 1 --2- 172.21.15.103:0/2743680900 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c7c065fe0 0x7f5c7c0b02f0 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7f5c70002f30 tx=0x7f5c70010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.988+0000 7f5c6bfff700 1 -- 172.21.15.103:0/2743680900 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c70012b90 con 0x7f5c7c065fe0 2020-04-22T14:20:39.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.988+0000 7f5c8113b700 1 -- 172.21.15.103:0/2743680900 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c7c135020 con 0x7f5c7c065fe0 2020-04-22T14:20:39.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.988+0000 7f5c6bfff700 1 -- 172.21.15.103:0/2743680900 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c700091c0 con 0x7f5c7c065fe0 2020-04-22T14:20:39.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.988+0000 7f5c8113b700 1 -- 172.21.15.103:0/2743680900 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c7c141fc0 con 0x7f5c7c065fe0 2020-04-22T14:20:39.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.988+0000 7f5c7a59c700 1 --2- 172.21.15.103:0/2743680900 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c7c065fe0 0x7f5c7c0b02f0 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7f5c70002f30 tx=0x7f5c70010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.988+0000 7f5c8113b700 1 -- 172.21.15.103:0/2743680900 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c7c129450 con 0x7f5c7c065fe0 2020-04-22T14:20:39.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.989+0000 7f5c6bfff700 1 -- 172.21.15.103:0/2743680900 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f5c70013070 con 0x7f5c7c065fe0 2020-04-22T14:20:39.010 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.989+0000 7f5c7a59c700 1 --2- 172.21.15.103:0/2743680900 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c7c065fe0 0x7f5c7c0b02f0 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7f5c70002f30 tx=0x7f5c70010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.989+0000 7f5c6bfff700 1 --2- 172.21.15.103:0/2743680900 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5c5804d890 0x7f5c5804fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:39.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.989+0000 7f5c6bfff700 1 -- 172.21.15.103:0/2743680900 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f5c70061520 con 0x7f5c7c065fe0 2020-04-22T14:20:39.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.989+0000 7f5c7ad9d700 1 --2- 172.21.15.103:0/2743680900 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5c5804d890 0x7f5c5804fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:39.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.989+0000 7f5c7ad9d700 1 --2- 172.21.15.103:0/2743680900 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5c5804d890 0x7f5c5804fd50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5c6c001f50 tx=0x7f5c6c00cbc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.989+0000 7f5c7ad9d700 1 --2- 172.21.15.103:0/2743680900 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5c5804d890 0x7f5c5804fd50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5c6c001f50 tx=0x7f5c6c00cbc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.989+0000 7f5c7ad9d700 1 --2- 172.21.15.103:0/2743680900 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5c5804d890 0x7f5c5804fd50 secure :-1 s=READY pgs=795 cs=0 l=1 rx=0x7f5c6c001f50 tx=0x7f5c6c00cbc0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:39.011 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.993+0000 7f5c7a59c700 1 --2- 172.21.15.103:0/2743680900 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c7c065fe0 0x7f5c7c0b02f0 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7f5c70002f30 tx=0x7f5c70010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.012 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:38.993+0000 7f5c6bfff700 1 -- 172.21.15.103:0/2743680900 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f5c7003c8a0 con 0x7f5c7c065fe0 2020-04-22T14:20:39.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.185+0000 7f5c8113b700 1 -- 172.21.15.103:0/2743680900 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f5c7c056c90 con 0x7f5c7c065fe0 2020-04-22T14:20:39.188 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.185+0000 7f5c7a59c700 1 --2- 172.21.15.103:0/2743680900 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c7c065fe0 0x7f5c7c0b02f0 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7f5c70002f30 tx=0x7f5c70010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.188 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.186+0000 7f5c6bfff700 1 -- 172.21.15.103:0/2743680900 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v56) v1 ==== 80+0+4513 (secure 0 0 0) 0x7f5c7003fec0 con 0x7f5c7c065fe0 2020-04-22T14:20:39.188 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:20:39.188 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:20:39.188 INFO:teuthology.orchestra.run.smithi103.stdout: "auth_dump": [ 2020-04-22T14:20:39.188 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:39.189 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.a", 2020-04-22T14:20:39.189 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBeliD5IBAAjC7UikdEP8FeE2rKs/ympw==", 2020-04-22T14:20:39.189 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:20:39.189 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:20:39.189 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:20:39.189 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:20:39.189 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:20:39.190 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:39.190 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:39.190 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:39.190 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.b", 2020-04-22T14:20:39.190 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBepkqQLBAA4aMKXxROQugglhm4aBd1Iw==", 2020-04-22T14:20:39.190 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:20:39.190 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:20:39.191 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:20:39.191 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:20:39.191 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:20:39.191 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:39.191 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:39.191 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:39.191 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.0", 2020-04-22T14:20:39.192 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA2TqBehMJiBxAARaWo32QGx49PxImGafnOFw==", 2020-04-22T14:20:39.192 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:20:39.192 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:20:39.192 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:20:39.192 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:20:39.192 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:39.192 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:39.192 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:39.193 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.1", 2020-04-22T14:20:39.193 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA4TqBeiAAcKRAAEHuaqbsB+NLUTSgFOCOFZg==", 2020-04-22T14:20:39.193 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:20:39.193 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:20:39.193 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:20:39.193 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:20:39.193 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:39.194 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:39.194 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:39.194 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.2", 2020-04-22T14:20:39.194 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA7TqBebeRzDxAAsjRyvJektq7MQ+334kU+UQ==", 2020-04-22T14:20:39.194 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:20:39.194 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:20:39.194 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:20:39.195 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:20:39.195 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:39.195 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:39.195 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:39.195 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.3", 2020-04-22T14:20:39.195 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQA9TqBehxmSMRAATZ0o/ZnxHp2m/tqLmv6JwA==", 2020-04-22T14:20:39.195 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:20:39.195 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:20:39.196 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:20:39.196 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:20:39.196 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:39.196 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:39.196 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:39.196 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.4", 2020-04-22T14:20:39.197 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBETqBePwJSBRAAXgMKuX3EILi3gy8QzR4cig==", 2020-04-22T14:20:39.197 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:20:39.197 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:20:39.197 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:20:39.197 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:20:39.197 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:39.197 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:39.198 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:39.198 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.5", 2020-04-22T14:20:39.198 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBGTqBe5l++KRAAHIWG6bBnru2EVXv/drAL0g==", 2020-04-22T14:20:39.198 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:20:39.198 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:20:39.198 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:20:39.198 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:20:39.199 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:39.199 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:39.199 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:39.199 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.6", 2020-04-22T14:20:39.199 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBJTqBe88rTEBAAO2Z78NZLTYIbBpYovBSHVQ==", 2020-04-22T14:20:39.199 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:20:39.199 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:20:39.200 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:20:39.200 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:20:39.200 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:39.200 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:39.200 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:39.200 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.7", 2020-04-22T14:20:39.200 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQBLTqBeGNFIMxAARIXhPNM6xurdnDv8+xZqUw==", 2020-04-22T14:20:39.200 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:20:39.201 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:20:39.201 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:20:39.201 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:20:39.201 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:39.201 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:39.201 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:39.201 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.0", 2020-04-22T14:20:39.202 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBe5ooUNxAA9zBtv6+i3Xl9iYtRl4xKGg==", 2020-04-22T14:20:39.202 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:20:39.202 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:20:39.202 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:20:39.202 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:20:39.202 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:39.202 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:39.203 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:39.203 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.1", 2020-04-22T14:20:39.203 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAyTqBe0bioBBAAVpoQouA/QICwqRoaFbjkiA==", 2020-04-22T14:20:39.203 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:20:39.203 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:20:39.203 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:20:39.204 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:20:39.204 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:39.204 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:39.204 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:39.204 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.2", 2020-04-22T14:20:39.204 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAyTqBemwpXCxAAObNL96zS67nMEe4MLjrEtw==", 2020-04-22T14:20:39.204 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:20:39.205 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:20:39.205 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:20:39.205 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:20:39.205 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:39.205 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:39.205 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:39.205 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.3", 2020-04-22T14:20:39.206 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAyTqBemGxNFBAAlqvB8FeZbMRwvzVjBpH/tA==", 2020-04-22T14:20:39.206 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:20:39.206 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2020-04-22T14:20:39.206 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow r", 2020-04-22T14:20:39.206 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rw pool=cephfs_data" 2020-04-22T14:20:39.206 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:39.206 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:39.206 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:39.207 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.admin", 2020-04-22T14:20:39.207 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAwTqBeSx5dHxAAH0jPkaiWEwpr66ROWwbU8Q==", 2020-04-22T14:20:39.207 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:20:39.207 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2020-04-22T14:20:39.207 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2020-04-22T14:20:39.207 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2020-04-22T14:20:39.207 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:20:39.208 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:39.208 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:39.208 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:39.208 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mgr.x", 2020-04-22T14:20:39.208 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBe3YVhGhAAWAf6f9sV3bzoucBBPS3j2g==", 2020-04-22T14:20:39.208 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:20:39.208 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2020-04-22T14:20:39.209 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile mgr", 2020-04-22T14:20:39.209 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:20:39.209 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:39.209 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:39.209 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:39.209 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mgr.y", 2020-04-22T14:20:39.209 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAxTqBeX8AXExAAhh/N+/ogdKlxmkveSM60+g==", 2020-04-22T14:20:39.209 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2020-04-22T14:20:39.210 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2020-04-22T14:20:39.210 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile mgr", 2020-04-22T14:20:39.210 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2020-04-22T14:20:39.210 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:39.210 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:39.210 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:20:39.210 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:20:39.214 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.187+0000 7f5c8113b700 1 -- 172.21.15.103:0/2743680900 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5c5804d890 msgr2=0x7f5c5804fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:39.214 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.187+0000 7f5c8113b700 1 --2- 172.21.15.103:0/2743680900 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5c5804d890 0x7f5c5804fd50 secure :-1 s=READY pgs=795 cs=0 l=1 rx=0x7f5c6c001f50 tx=0x7f5c6c00cbc0).stop 2020-04-22T14:20:39.214 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.187+0000 7f5c8113b700 1 -- 172.21.15.103:0/2743680900 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c7c065fe0 msgr2=0x7f5c7c0b02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:39.214 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.187+0000 7f5c8113b700 1 --2- 172.21.15.103:0/2743680900 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c7c065fe0 0x7f5c7c0b02f0 secure :-1 s=READY pgs=209 cs=0 l=1 rx=0x7f5c70002f30 tx=0x7f5c70010c00).stop 2020-04-22T14:20:39.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.187+0000 7f5c8113b700 1 -- 172.21.15.103:0/2743680900 shutdown_connections 2020-04-22T14:20:39.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.187+0000 7f5c8113b700 1 --2- 172.21.15.103:0/2743680900 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f5c5804d890 0x7f5c5804fd50 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:39.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.187+0000 7f5c8113b700 1 --2- 172.21.15.103:0/2743680900 >> v2:172.21.15.86:3300/0 conn(0x7f5c7c063e30 0x7f5c7c0aecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:39.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.187+0000 7f5c8113b700 1 --2- 172.21.15.103:0/2743680900 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c7c065fe0 0x7f5c7c0b02f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:39.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.187+0000 7f5c8113b700 1 -- 172.21.15.103:0/2743680900 >> 172.21.15.103:0/2743680900 conn(0x7f5c7c0b9160 msgr2=0x7f5c7c05ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:39.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.187+0000 7f5c8113b700 1 -- 172.21.15.103:0/2743680900 shutdown_connections 2020-04-22T14:20:39.215 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.187+0000 7f5c8113b700 1 -- 172.21.15.103:0/2743680900 wait complete. 2020-04-22T14:20:39.216 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:39.229 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:20:39.375 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.373+0000 7f17580a3700 1 Processor -- start 2020-04-22T14:20:39.376 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.373+0000 7f17580a3700 1 -- start start 2020-04-22T14:20:39.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.374+0000 7f17580a3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1750140320 0x7f17500ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:39.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.374+0000 7f17580a3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f175014a2b0 0x7f1750146cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:39.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.374+0000 7f17580a3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f17500bd1b0 0x7f17500bd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:39.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.374+0000 7f17580a3700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f175014a740 con 0x7f175014a2b0 2020-04-22T14:20:39.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.374+0000 7f17580a3700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17501462f0 con 0x7f1750140320 2020-04-22T14:20:39.383 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.374+0000 7f17580a3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1750146590 con 0x7f17500bd1b0 2020-04-22T14:20:39.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.374+0000 7f1755e3f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1750140320 0x7f17500ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:39.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.374+0000 7f1755e3f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1750140320 0x7f17500ae1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59132/0 (socket says 172.21.15.103:59132) 2020-04-22T14:20:39.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.374+0000 7f1755e3f700 1 -- 172.21.15.103:0/2595903896 learned_addr learned my addr 172.21.15.103:0/2595903896 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:39.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.374+0000 7f175563e700 1 --2- 172.21.15.103:0/2595903896 >> v2:172.21.15.86:3300/0 conn(0x7f175014a2b0 0x7f1750146cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:39.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.374+0000 7f1756640700 1 --2- 172.21.15.103:0/2595903896 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f17500bd1b0 0x7f17500bd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:39.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.375+0000 7f1755e3f700 1 -- 172.21.15.103:0/2595903896 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f17500bd1b0 msgr2=0x7f17500bd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:39.384 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.375+0000 7f1755e3f700 1 --2- 172.21.15.103:0/2595903896 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f17500bd1b0 0x7f17500bd640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:39.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.375+0000 7f1755e3f700 1 -- 172.21.15.103:0/2595903896 >> v2:172.21.15.86:3300/0 conn(0x7f175014a2b0 msgr2=0x7f1750146cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:39.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.375+0000 7f1755e3f700 1 --2- 172.21.15.103:0/2595903896 >> v2:172.21.15.86:3300/0 conn(0x7f175014a2b0 0x7f1750146cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:39.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.375+0000 7f1755e3f700 1 -- 172.21.15.103:0/2595903896 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1750146830 con 0x7f1750140320 2020-04-22T14:20:39.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.375+0000 7f1755e3f700 1 --2- 172.21.15.103:0/2595903896 >> v2:172.21.15.103:3300/0 conn(0x7f1750140320 0x7f17500ae1a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f174c002f30 tx=0x7f174c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.375+0000 7f1755e3f700 1 --2- 172.21.15.103:0/2595903896 >> v2:172.21.15.103:3300/0 conn(0x7f1750140320 0x7f17500ae1a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f174c002f30 tx=0x7f174c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.375+0000 7f1755e3f700 1 --2- 172.21.15.103:0/2595903896 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1750140320 0x7f17500ae1a0 secure :-1 s=READY pgs=2196 cs=0 l=1 rx=0x7f174c002f30 tx=0x7f174c007a40).ready entity=mon.1 client_cookie=5bf53b9b92657405 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:39.385 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.375+0000 7f1755e3f700 1 --2- 172.21.15.103:0/2595903896 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1750140320 0x7f17500ae1a0 secure :-1 s=THROTTLE_DONE pgs=2196 cs=0 l=1 rx=0x7f174c002f30 tx=0x7f174c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.375+0000 7f1754e3d700 1 -- 172.21.15.103:0/2595903896 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f174c0115c0 con 0x7f1750140320 2020-04-22T14:20:39.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.375+0000 7f1755e3f700 1 --2- 172.21.15.103:0/2595903896 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1750140320 0x7f17500ae1a0 secure :-1 s=THROTTLE_DONE pgs=2196 cs=0 l=1 rx=0x7f174c002f30 tx=0x7f174c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.375+0000 7f1755e3f700 1 --2- 172.21.15.103:0/2595903896 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1750140320 0x7f17500ae1a0 secure :-1 s=THROTTLE_DONE pgs=2196 cs=0 l=1 rx=0x7f174c002f30 tx=0x7f174c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.375+0000 7f1754e3d700 1 -- 172.21.15.103:0/2595903896 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174c011720 con 0x7f1750140320 2020-04-22T14:20:39.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.375+0000 7f1754e3d700 1 -- 172.21.15.103:0/2595903896 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f174c011b40 con 0x7f1750140320 2020-04-22T14:20:39.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.375+0000 7f17580a3700 1 -- 172.21.15.103:0/2595903896 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1750140320 msgr2=0x7f17500ae1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:39.386 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.375+0000 7f17580a3700 1 --2- 172.21.15.103:0/2595903896 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1750140320 0x7f17500ae1a0 secure :-1 s=READY pgs=2196 cs=0 l=1 rx=0x7f174c002f30 tx=0x7f174c007a40).stop 2020-04-22T14:20:39.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.375+0000 7f17580a3700 1 -- 172.21.15.103:0/2595903896 shutdown_connections 2020-04-22T14:20:39.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.375+0000 7f17580a3700 1 --2- 172.21.15.103:0/2595903896 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f17500bd1b0 0x7f17500bd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:39.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.375+0000 7f17580a3700 1 --2- 172.21.15.103:0/2595903896 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1750140320 0x7f17500ae1a0 unknown :-1 s=CLOSED pgs=2196 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:39.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.375+0000 7f17580a3700 1 --2- 172.21.15.103:0/2595903896 >> v2:172.21.15.86:3300/0 conn(0x7f175014a2b0 0x7f1750146cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:39.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.375+0000 7f17580a3700 1 -- 172.21.15.103:0/2595903896 >> 172.21.15.103:0/2595903896 conn(0x7f175005f2c0 msgr2=0x7f17500bcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:39.387 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.375+0000 7f17580a3700 1 -- 172.21.15.103:0/2595903896 shutdown_connections 2020-04-22T14:20:39.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.375+0000 7f17580a3700 1 -- 172.21.15.103:0/2595903896 wait complete. 2020-04-22T14:20:39.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.376+0000 7f17580a3700 1 Processor -- start 2020-04-22T14:20:39.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.376+0000 7f17580a3700 1 -- start start 2020-04-22T14:20:39.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.377+0000 7f17580a3700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f17500bd1b0 0x7f1750143140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:39.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.377+0000 7f17580a3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1750140320 0x7f1750132280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:39.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.377+0000 7f17580a3700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17501326e0 con 0x7f175014a2b0 2020-04-22T14:20:39.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.377+0000 7f17580a3700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17500b03b0 con 0x7f17500bd1b0 2020-04-22T14:20:39.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.377+0000 7f17580a3700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17500b0650 con 0x7f1750140320 2020-04-22T14:20:39.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.377+0000 7f1755e3f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f17500bd1b0 0x7f1750143140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:39.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.377+0000 7f1755e3f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f17500bd1b0 0x7f1750143140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:56370/0 (socket says 172.21.15.103:56370) 2020-04-22T14:20:39.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.377+0000 7f1755e3f700 1 -- 172.21.15.103:0/838253483 learned_addr learned my addr 172.21.15.103:0/838253483 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:39.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.377+0000 7f175563e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1750140320 0x7f1750132280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:39.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.378+0000 7f175563e700 1 -- 172.21.15.103:0/838253483 >> v2:172.21.15.86:3300/0 conn(0x7f17500bd1b0 msgr2=0x7f1750143140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:39.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.378+0000 7f175563e700 1 --2- 172.21.15.103:0/838253483 >> v2:172.21.15.86:3300/0 conn(0x7f17500bd1b0 0x7f1750143140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:39.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.378+0000 7f175563e700 1 -- 172.21.15.103:0/838253483 >> v1:172.21.15.86:6789/0 conn(0x7f175014a2b0 legacy=0x7f1750131430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:39.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.378+0000 7f1742ffd700 1 -- 172.21.15.103:0/838253483 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4071713152 0 0) 0x7f1748001210 con 0x7f175014a2b0 2020-04-22T14:20:39.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.378+0000 7f175563e700 1 -- 172.21.15.103:0/838253483 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17501328f0 con 0x7f1750140320 2020-04-22T14:20:39.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.378+0000 7f1755e3f700 1 --2- 172.21.15.103:0/838253483 >> v2:172.21.15.86:3300/0 conn(0x7f17500bd1b0 0x7f1750143140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:20:39.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.378+0000 7f175563e700 1 --2- 172.21.15.103:0/838253483 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1750140320 0x7f1750132280 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1744002f30 tx=0x7f1744010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.378+0000 7f175563e700 1 --2- 172.21.15.103:0/838253483 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1750140320 0x7f1750132280 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1744002f30 tx=0x7f1744010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.378+0000 7f175563e700 1 --2- 172.21.15.103:0/838253483 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1750140320 0x7f1750132280 secure :-1 s=READY pgs=210 cs=0 l=1 rx=0x7f1744002f30 tx=0x7f1744010b80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:39.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.378+0000 7f175563e700 1 --2- 172.21.15.103:0/838253483 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1750140320 0x7f1750132280 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7f1744002f30 tx=0x7f1744010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.378+0000 7f1742ffd700 1 -- 172.21.15.103:0/838253483 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1744007550 con 0x7f1750140320 2020-04-22T14:20:39.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.378+0000 7f175563e700 1 --2- 172.21.15.103:0/838253483 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1750140320 0x7f1750132280 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7f1744002f30 tx=0x7f1744010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.378+0000 7f1742ffd700 1 -- 172.21.15.103:0/838253483 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17440056c0 con 0x7f1750140320 2020-04-22T14:20:39.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.378+0000 7f175563e700 1 --2- 172.21.15.103:0/838253483 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1750140320 0x7f1750132280 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7f1744002f30 tx=0x7f1744010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.378+0000 7f17580a3700 1 -- 172.21.15.103:0/838253483 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1750140700 con 0x7f1750140320 2020-04-22T14:20:39.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.378+0000 7f1742ffd700 1 -- 172.21.15.103:0/838253483 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1744005aa0 con 0x7f1750140320 2020-04-22T14:20:39.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.378+0000 7f17580a3700 1 -- 172.21.15.103:0/838253483 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17501438c0 con 0x7f1750140320 2020-04-22T14:20:39.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.379+0000 7f175563e700 1 --2- 172.21.15.103:0/838253483 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1750140320 0x7f1750132280 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7f1744002f30 tx=0x7f1744010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.379+0000 7f17580a3700 1 -- 172.21.15.103:0/838253483 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17500b01e0 con 0x7f1750140320 2020-04-22T14:20:39.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.379+0000 7f1742ffd700 1 -- 172.21.15.103:0/838253483 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f1744005d20 con 0x7f1750140320 2020-04-22T14:20:39.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.379+0000 7f175563e700 1 --2- 172.21.15.103:0/838253483 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1750140320 0x7f1750132280 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7f1744002f30 tx=0x7f1744010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.380+0000 7f1742ffd700 1 --2- 172.21.15.103:0/838253483 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f173004d820 0x7f173004fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:39.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.380+0000 7f1742ffd700 1 -- 172.21.15.103:0/838253483 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f1744061160 con 0x7f1750140320 2020-04-22T14:20:39.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.380+0000 7f1755e3f700 1 --2- 172.21.15.103:0/838253483 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f173004d820 0x7f173004fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:39.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.380+0000 7f1755e3f700 1 --2- 172.21.15.103:0/838253483 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f173004d820 0x7f173004fce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f174c002f30 tx=0x7f174c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.380+0000 7f1755e3f700 1 --2- 172.21.15.103:0/838253483 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f173004d820 0x7f173004fce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f174c002f30 tx=0x7f174c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.380+0000 7f1755e3f700 1 --2- 172.21.15.103:0/838253483 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f173004d820 0x7f173004fce0 secure :-1 s=READY pgs=796 cs=0 l=1 rx=0x7f174c002f30 tx=0x7f174c007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:39.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.383+0000 7f175563e700 1 --2- 172.21.15.103:0/838253483 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1750140320 0x7f1750132280 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7f1744002f30 tx=0x7f1744010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.383+0000 7f1742ffd700 1 -- 172.21.15.103:0/838253483 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f174403c5a0 con 0x7f1750140320 2020-04-22T14:20:39.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.524+0000 7f17580a3700 1 -- 172.21.15.103:0/838253483 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1750143a50 con 0x7f1750140320 2020-04-22T14:20:39.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.526+0000 7f175563e700 1 --2- 172.21.15.103:0/838253483 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1750140320 0x7f1750132280 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7f1744002f30 tx=0x7f1744010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.528 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.526+0000 7f1742ffd700 1 -- 172.21.15.103:0/838253483 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v154) v1 ==== 74+0+13242 (secure 0 0 0) 0x7f174403fbc0 con 0x7f1750140320 2020-04-22T14:20:39.528 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:20:39.528 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":154,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:20:38.750505+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:20:39.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.527+0000 7f17580a3700 1 -- 172.21.15.103:0/838253483 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f173004d820 msgr2=0x7f173004fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:39.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.527+0000 7f17580a3700 1 --2- 172.21.15.103:0/838253483 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f173004d820 0x7f173004fce0 secure :-1 s=READY pgs=796 cs=0 l=1 rx=0x7f174c002f30 tx=0x7f174c007a40).stop 2020-04-22T14:20:39.529 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.527+0000 7f17580a3700 1 -- 172.21.15.103:0/838253483 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1750140320 msgr2=0x7f1750132280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:39.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.527+0000 7f17580a3700 1 --2- 172.21.15.103:0/838253483 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1750140320 0x7f1750132280 secure :-1 s=READY pgs=210 cs=0 l=1 rx=0x7f1744002f30 tx=0x7f1744010b80).stop 2020-04-22T14:20:39.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.527+0000 7f17580a3700 1 -- 172.21.15.103:0/838253483 shutdown_connections 2020-04-22T14:20:39.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.527+0000 7f17580a3700 1 --2- 172.21.15.103:0/838253483 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f173004d820 0x7f173004fce0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:39.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.527+0000 7f17580a3700 1 --2- 172.21.15.103:0/838253483 >> v2:172.21.15.86:3300/0 conn(0x7f17500bd1b0 0x7f1750143140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:39.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.527+0000 7f17580a3700 1 --2- 172.21.15.103:0/838253483 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1750140320 0x7f1750132280 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:39.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.527+0000 7f17580a3700 1 -- 172.21.15.103:0/838253483 >> 172.21.15.103:0/838253483 conn(0x7f175005f2c0 msgr2=0x7f1750148bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:39.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.527+0000 7f17580a3700 1 -- 172.21.15.103:0/838253483 shutdown_connections 2020-04-22T14:20:39.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.527+0000 7f17580a3700 1 -- 172.21.15.103:0/838253483 wait complete. 2020-04-22T14:20:39.540 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:20:39.541 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:39.554 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:20:39.705 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.703+0000 7f26b8351700 1 Processor -- start 2020-04-22T14:20:39.706 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.703+0000 7f26b8351700 1 -- start start 2020-04-22T14:20:39.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.704+0000 7f26b8351700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f26b0143090 0x7f26b0143520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:39.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.704+0000 7f26b8351700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26b01467e0 con 0x7f26b00b9140 2020-04-22T14:20:39.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.704+0000 7f26b8351700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26b0060050 con 0x7f26b00ac950 2020-04-22T14:20:39.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.704+0000 7f26b8351700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26b00602f0 con 0x7f26b0143090 2020-04-22T14:20:39.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.704+0000 7f26b68ee700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f26b0143090 0x7f26b0143520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:39.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.704+0000 7f26b58ec700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f26b00ac950 0x7f26b0146c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51336/0 (socket says 172.21.15.103:51336) 2020-04-22T14:20:39.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.704+0000 7f26b58ec700 1 -- 172.21.15.103:0/2780058821 learned_addr learned my addr 172.21.15.103:0/2780058821 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:39.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.705+0000 7f26b68ee700 1 -- 172.21.15.103:0/2780058821 >> v1:172.21.15.103:6789/0 conn(0x7f26b00ac950 legacy=0x7f26b0146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:39.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.705+0000 7f26b68ee700 1 -- 172.21.15.103:0/2780058821 >> v1:172.21.15.86:6789/0 conn(0x7f26b00b9140 legacy=0x7f26b012b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:39.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.705+0000 7f26b68ee700 1 -- 172.21.15.103:0/2780058821 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b00b9520 con 0x7f26b0143090 2020-04-22T14:20:39.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.705+0000 7f26b68ee700 1 --2- 172.21.15.103:0/2780058821 >> v2:172.21.15.103:3300/0 conn(0x7f26b0143090 0x7f26b0143520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f26b00b6250 tx=0x7f26a8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.705+0000 7f26b68ee700 1 --2- 172.21.15.103:0/2780058821 >> v2:172.21.15.103:3300/0 conn(0x7f26b0143090 0x7f26b0143520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f26b00b6250 tx=0x7f26a8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.705+0000 7f26b68ee700 1 --2- 172.21.15.103:0/2780058821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26b0143090 0x7f26b0143520 secure :-1 s=READY pgs=2198 cs=0 l=1 rx=0x7f26b00b6250 tx=0x7f26a8007dc0).ready entity=mon.1 client_cookie=5391c5624025d24b server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:39.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.705+0000 7f26b68ee700 1 --2- 172.21.15.103:0/2780058821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26b0143090 0x7f26b0143520 secure :-1 s=THROTTLE_DONE pgs=2198 cs=0 l=1 rx=0x7f26b00b6250 tx=0x7f26a8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.705+0000 7f26b50eb700 1 -- 172.21.15.103:0/2780058821 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26a800a370 con 0x7f26b0143090 2020-04-22T14:20:39.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.705+0000 7f26b68ee700 1 --2- 172.21.15.103:0/2780058821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26b0143090 0x7f26b0143520 secure :-1 s=THROTTLE_DONE pgs=2198 cs=0 l=1 rx=0x7f26b00b6250 tx=0x7f26a8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.705+0000 7f26b68ee700 1 --2- 172.21.15.103:0/2780058821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26b0143090 0x7f26b0143520 secure :-1 s=THROTTLE_DONE pgs=2198 cs=0 l=1 rx=0x7f26b00b6250 tx=0x7f26a8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.705+0000 7f26b50eb700 1 -- 172.21.15.103:0/2780058821 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a800a4d0 con 0x7f26b0143090 2020-04-22T14:20:39.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.705+0000 7f26b50eb700 1 -- 172.21.15.103:0/2780058821 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26a800a8f0 con 0x7f26b0143090 2020-04-22T14:20:39.710 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.705+0000 7f26b8351700 1 -- 172.21.15.103:0/2780058821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26b0143090 msgr2=0x7f26b0143520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:39.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.705+0000 7f26b8351700 1 --2- 172.21.15.103:0/2780058821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26b0143090 0x7f26b0143520 secure :-1 s=READY pgs=2198 cs=0 l=1 rx=0x7f26b00b6250 tx=0x7f26a8007dc0).stop 2020-04-22T14:20:39.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.705+0000 7f26b8351700 1 -- 172.21.15.103:0/2780058821 shutdown_connections 2020-04-22T14:20:39.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.705+0000 7f26b8351700 1 --2- 172.21.15.103:0/2780058821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26b0143090 0x7f26b0143520 unknown :-1 s=CLOSED pgs=2198 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:39.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.705+0000 7f26b8351700 1 -- 172.21.15.103:0/2780058821 >> 172.21.15.103:0/2780058821 conn(0x7f26b005b7b0 msgr2=0x7f26b00b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:39.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.705+0000 7f26b8351700 1 -- 172.21.15.103:0/2780058821 shutdown_connections 2020-04-22T14:20:39.711 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.705+0000 7f26b8351700 1 -- 172.21.15.103:0/2780058821 wait complete. 2020-04-22T14:20:39.714 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.706+0000 7f26b8351700 1 Processor -- start 2020-04-22T14:20:39.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.706+0000 7f26b8351700 1 -- start start 2020-04-22T14:20:39.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.707+0000 7f26b8351700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f26b00ac950 0x7f26b0146020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:39.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.707+0000 7f26b8351700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f26b00b9140 0x7f26b0124ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:39.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.707+0000 7f26b8351700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f26b0143090 0x7f26b0140b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:39.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.707+0000 7f26b8351700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26b0146480 con 0x7f26b00ac950 2020-04-22T14:20:39.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.707+0000 7f26b8351700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26b00b1df0 con 0x7f26b00b9140 2020-04-22T14:20:39.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.707+0000 7f26b8351700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26b00b2090 con 0x7f26b0143090 2020-04-22T14:20:39.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.707+0000 7f26b58ec700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f26b00b9140 0x7f26b0124ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:39.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.707+0000 7f26b58ec700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f26b00b9140 0x7f26b0124ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59152/0 (socket says 172.21.15.103:59152) 2020-04-22T14:20:39.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.707+0000 7f26b58ec700 1 -- 172.21.15.103:0/301566657 learned_addr learned my addr 172.21.15.103:0/301566657 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:39.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.707+0000 7f26b68ee700 1 --2- 172.21.15.103:0/301566657 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f26b0143090 0x7f26b0140b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:39.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.707+0000 7f26b60ed700 1 --2- 172.21.15.103:0/301566657 >> v2:172.21.15.86:3300/0 conn(0x7f26b00ac950 0x7f26b0146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:39.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.707+0000 7f26b58ec700 1 -- 172.21.15.103:0/301566657 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f26b0143090 msgr2=0x7f26b0140b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:39.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.707+0000 7f26b58ec700 1 --2- 172.21.15.103:0/301566657 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f26b0143090 0x7f26b0140b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:39.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.708+0000 7f26b58ec700 1 -- 172.21.15.103:0/301566657 >> v2:172.21.15.86:3300/0 conn(0x7f26b00ac950 msgr2=0x7f26b0146020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:39.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.708+0000 7f26b58ec700 1 --2- 172.21.15.103:0/301566657 >> v2:172.21.15.86:3300/0 conn(0x7f26b00ac950 0x7f26b0146020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:39.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.708+0000 7f26b58ec700 1 -- 172.21.15.103:0/301566657 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b00b1b30 con 0x7f26b00b9140 2020-04-22T14:20:39.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.708+0000 7f26b58ec700 1 --2- 172.21.15.103:0/301566657 >> v2:172.21.15.103:3300/0 conn(0x7f26b00b9140 0x7f26b0124ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f26ac000fe0 tx=0x7f26ac0109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.708+0000 7f26b58ec700 1 --2- 172.21.15.103:0/301566657 >> v2:172.21.15.103:3300/0 conn(0x7f26b00b9140 0x7f26b0124ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f26ac000fe0 tx=0x7f26ac0109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.708+0000 7f26b58ec700 1 --2- 172.21.15.103:0/301566657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26b00b9140 0x7f26b0124ea0 secure :-1 s=READY pgs=2199 cs=0 l=1 rx=0x7f26ac000fe0 tx=0x7f26ac0109f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:39.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.708+0000 7f26b58ec700 1 --2- 172.21.15.103:0/301566657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26b00b9140 0x7f26b0124ea0 secure :-1 s=THROTTLE_DONE pgs=2199 cs=0 l=1 rx=0x7f26ac000fe0 tx=0x7f26ac0109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.708+0000 7f26b58ec700 1 --2- 172.21.15.103:0/301566657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26b00b9140 0x7f26b0124ea0 secure :-1 s=THROTTLE_DONE pgs=2199 cs=0 l=1 rx=0x7f26ac000fe0 tx=0x7f26ac0109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.708+0000 7f269f7fe700 1 -- 172.21.15.103:0/301566657 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26ac00c930 con 0x7f26b00b9140 2020-04-22T14:20:39.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.708+0000 7f26b58ec700 1 --2- 172.21.15.103:0/301566657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26b00b9140 0x7f26b0124ea0 secure :-1 s=THROTTLE_DONE pgs=2199 cs=0 l=1 rx=0x7f26ac000fe0 tx=0x7f26ac0109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.708+0000 7f269f7fe700 1 -- 172.21.15.103:0/301566657 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26ac00ca90 con 0x7f26b00b9140 2020-04-22T14:20:39.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.708+0000 7f26b8351700 1 -- 172.21.15.103:0/301566657 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26b0127e40 con 0x7f26b00b9140 2020-04-22T14:20:39.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.708+0000 7f269f7fe700 1 -- 172.21.15.103:0/301566657 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26ac00ce70 con 0x7f26b00b9140 2020-04-22T14:20:39.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.708+0000 7f26b8351700 1 -- 172.21.15.103:0/301566657 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26b0125540 con 0x7f26b00b9140 2020-04-22T14:20:39.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.708+0000 7f26b58ec700 1 --2- 172.21.15.103:0/301566657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26b00b9140 0x7f26b0124ea0 secure :-1 s=THROTTLE_DONE pgs=2199 cs=0 l=1 rx=0x7f26ac000fe0 tx=0x7f26ac0109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.709+0000 7f269f7fe700 1 -- 172.21.15.103:0/301566657 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f26ac0055c0 con 0x7f26b00b9140 2020-04-22T14:20:39.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.709+0000 7f26b58ec700 1 --2- 172.21.15.103:0/301566657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26b00b9140 0x7f26b0124ea0 secure :-1 s=THROTTLE_DONE pgs=2199 cs=0 l=1 rx=0x7f26ac000fe0 tx=0x7f26ac0109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.709+0000 7f26b8351700 1 -- 172.21.15.103:0/301566657 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26b00b2260 con 0x7f26b00b9140 2020-04-22T14:20:39.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.709+0000 7f269f7fe700 1 --2- 172.21.15.103:0/301566657 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f269004da30 0x7f269004fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:39.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.709+0000 7f269f7fe700 1 -- 172.21.15.103:0/301566657 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f26ac0100c0 con 0x7f26b00b9140 2020-04-22T14:20:39.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.709+0000 7f26b60ed700 1 --2- 172.21.15.103:0/301566657 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f269004da30 0x7f269004fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:39.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.709+0000 7f26b60ed700 1 --2- 172.21.15.103:0/301566657 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f269004da30 0x7f269004fef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f26a0001f50 tx=0x7f26a0003960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.710+0000 7f26b60ed700 1 --2- 172.21.15.103:0/301566657 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f269004da30 0x7f269004fef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f26a0001f50 tx=0x7f26a0003960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.710+0000 7f26b60ed700 1 --2- 172.21.15.103:0/301566657 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f269004da30 0x7f269004fef0 secure :-1 s=READY pgs=797 cs=0 l=1 rx=0x7f26a0001f50 tx=0x7f26a0003960).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:39.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.713+0000 7f26b58ec700 1 --2- 172.21.15.103:0/301566657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26b00b9140 0x7f26b0124ea0 secure :-1 s=THROTTLE_DONE pgs=2199 cs=0 l=1 rx=0x7f26ac000fe0 tx=0x7f26ac0109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.713+0000 7f269f7fe700 1 -- 172.21.15.103:0/301566657 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f26ac03c270 con 0x7f26b00b9140 2020-04-22T14:20:39.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.853+0000 7f26b8351700 1 -- 172.21.15.103:0/301566657 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f26b0056c90 con 0x7f26b00b9140 2020-04-22T14:20:39.856 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.853+0000 7f26b58ec700 1 --2- 172.21.15.103:0/301566657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26b00b9140 0x7f26b0124ea0 secure :-1 s=THROTTLE_DONE pgs=2199 cs=0 l=1 rx=0x7f26ac000fe0 tx=0x7f26ac0109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:39.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.853+0000 7f269f7fe700 1 -- 172.21.15.103:0/301566657 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v154) v1 ==== 110+0+10 (secure 0 0 0) 0x7f26ac03f890 con 0x7f26b00b9140 2020-04-22T14:20:39.857 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:20:39.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.855+0000 7f26b8351700 1 -- 172.21.15.103:0/301566657 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f269004da30 msgr2=0x7f269004fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:39.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.855+0000 7f26b8351700 1 --2- 172.21.15.103:0/301566657 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f269004da30 0x7f269004fef0 secure :-1 s=READY pgs=797 cs=0 l=1 rx=0x7f26a0001f50 tx=0x7f26a0003960).stop 2020-04-22T14:20:39.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.855+0000 7f26b8351700 1 -- 172.21.15.103:0/301566657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26b00b9140 msgr2=0x7f26b0124ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:39.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.855+0000 7f26b8351700 1 --2- 172.21.15.103:0/301566657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26b00b9140 0x7f26b0124ea0 secure :-1 s=READY pgs=2199 cs=0 l=1 rx=0x7f26ac000fe0 tx=0x7f26ac0109f0).stop 2020-04-22T14:20:39.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.855+0000 7f26b8351700 1 -- 172.21.15.103:0/301566657 shutdown_connections 2020-04-22T14:20:39.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.855+0000 7f26b8351700 1 --2- 172.21.15.103:0/301566657 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f269004da30 0x7f269004fef0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:39.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.855+0000 7f26b8351700 1 --2- 172.21.15.103:0/301566657 >> v2:172.21.15.86:3300/0 conn(0x7f26b00ac950 0x7f26b0146020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:39.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.855+0000 7f26b8351700 1 --2- 172.21.15.103:0/301566657 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f26b0143090 0x7f26b0140b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:39.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.855+0000 7f26b8351700 1 --2- 172.21.15.103:0/301566657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26b00b9140 0x7f26b0124ea0 unknown :-1 s=CLOSED pgs=2199 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:39.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.855+0000 7f26b8351700 1 -- 172.21.15.103:0/301566657 >> 172.21.15.103:0/301566657 conn(0x7f26b005b7b0 msgr2=0x7f26b0142720 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:39.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.855+0000 7f26b8351700 1 -- 172.21.15.103:0/301566657 shutdown_connections 2020-04-22T14:20:39.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:39.855+0000 7f26b8351700 1 -- 172.21.15.103:0/301566657 wait complete. 2020-04-22T14:20:39.867 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:39.880 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:20:40.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.026+0000 7f943ede1700 1 Processor -- start 2020-04-22T14:20:40.028 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.026+0000 7f943ede1700 1 -- start start 2020-04-22T14:20:40.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.027+0000 7f943ede1700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f94380b9140 0x7f94380aed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:40.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.027+0000 7f943ede1700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f94380b3bd0 0x7f94380af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:40.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.027+0000 7f943ede1700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9438148310 con 0x7f94380616b0 2020-04-22T14:20:40.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.027+0000 7f943ede1700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94380af650 con 0x7f94380b9140 2020-04-22T14:20:40.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.027+0000 7f943ede1700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94381485b0 con 0x7f94380b3bd0 2020-04-22T14:20:40.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.027+0000 7f9437fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f94380b3bd0 0x7f94380af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:40.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.027+0000 7f9437fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f94380b3bd0 0x7f94380af1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59160/0 (socket says 172.21.15.103:59160) 2020-04-22T14:20:40.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.027+0000 7f9437fff700 1 -- 172.21.15.103:0/2893811804 learned_addr learned my addr 172.21.15.103:0/2893811804 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:40.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.027+0000 7f943cb7d700 1 --2- 172.21.15.103:0/2893811804 >> v2:172.21.15.86:3300/0 conn(0x7f94380b9140 0x7f94380aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:40.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.027+0000 7f9437fff700 1 -- 172.21.15.103:0/2893811804 >> v2:172.21.15.86:3300/0 conn(0x7f94380b9140 msgr2=0x7f94380aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:40.035 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.027+0000 7f9437fff700 1 --2- 172.21.15.103:0/2893811804 >> v2:172.21.15.86:3300/0 conn(0x7f94380b9140 0x7f94380aed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:40.035 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.027+0000 7f9437fff700 1 -- 172.21.15.103:0/2893811804 >> v1:172.21.15.86:6789/0 conn(0x7f94380616b0 legacy=0x7f9438061b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:40.035 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.027+0000 7f9437fff700 1 -- 172.21.15.103:0/2893811804 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94380b9520 con 0x7f94380b3bd0 2020-04-22T14:20:40.035 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.027+0000 7f943cb7d700 1 --2- 172.21.15.103:0/2893811804 >> v2:172.21.15.86:3300/0 conn(0x7f94380b9140 0x7f94380aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:20:40.035 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.027+0000 7f9437fff700 1 --2- 172.21.15.103:0/2893811804 >> v2:172.21.15.103:3300/0 conn(0x7f94380b3bd0 0x7f94380af1f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9438067530 tx=0x7f942c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.035 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.027+0000 7f9437fff700 1 --2- 172.21.15.103:0/2893811804 >> v2:172.21.15.103:3300/0 conn(0x7f94380b3bd0 0x7f94380af1f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9438067530 tx=0x7f942c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.027+0000 7f9437fff700 1 --2- 172.21.15.103:0/2893811804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94380b3bd0 0x7f94380af1f0 secure :-1 s=READY pgs=2200 cs=0 l=1 rx=0x7f9438067530 tx=0x7f942c007a40).ready entity=mon.1 client_cookie=f4f0bdaefeab2ef8 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:40.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.027+0000 7f9437fff700 1 --2- 172.21.15.103:0/2893811804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94380b3bd0 0x7f94380af1f0 secure :-1 s=THROTTLE_DONE pgs=2200 cs=0 l=1 rx=0x7f9438067530 tx=0x7f942c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.027+0000 7f94377fe700 1 -- 172.21.15.103:0/2893811804 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f942c0116e0 con 0x7f94380b3bd0 2020-04-22T14:20:40.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.027+0000 7f9437fff700 1 --2- 172.21.15.103:0/2893811804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94380b3bd0 0x7f94380af1f0 secure :-1 s=THROTTLE_DONE pgs=2200 cs=0 l=1 rx=0x7f9438067530 tx=0x7f942c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.027+0000 7f94377fe700 1 -- 172.21.15.103:0/2893811804 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942c011840 con 0x7f94380b3bd0 2020-04-22T14:20:40.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.027+0000 7f9437fff700 1 --2- 172.21.15.103:0/2893811804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94380b3bd0 0x7f94380af1f0 secure :-1 s=THROTTLE_DONE pgs=2200 cs=0 l=1 rx=0x7f9438067530 tx=0x7f942c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.027+0000 7f94377fe700 1 -- 172.21.15.103:0/2893811804 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f942c011c20 con 0x7f94380b3bd0 2020-04-22T14:20:40.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.027+0000 7f943ede1700 1 -- 172.21.15.103:0/2893811804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94380b3bd0 msgr2=0x7f94380af1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:40.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.027+0000 7f943ede1700 1 --2- 172.21.15.103:0/2893811804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94380b3bd0 0x7f94380af1f0 secure :-1 s=READY pgs=2200 cs=0 l=1 rx=0x7f9438067530 tx=0x7f942c007a40).stop 2020-04-22T14:20:40.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.028+0000 7f943ede1700 1 -- 172.21.15.103:0/2893811804 shutdown_connections 2020-04-22T14:20:40.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.028+0000 7f943ede1700 1 --2- 172.21.15.103:0/2893811804 >> v2:172.21.15.86:3300/0 conn(0x7f94380b9140 0x7f94380aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:40.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.028+0000 7f943ede1700 1 --2- 172.21.15.103:0/2893811804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94380b3bd0 0x7f94380af1f0 unknown :-1 s=CLOSED pgs=2200 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:40.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.028+0000 7f943ede1700 1 -- 172.21.15.103:0/2893811804 >> 172.21.15.103:0/2893811804 conn(0x7f943805b7b0 msgr2=0x7f94380b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:40.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.028+0000 7f943ede1700 1 -- 172.21.15.103:0/2893811804 shutdown_connections 2020-04-22T14:20:40.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.028+0000 7f943ede1700 1 -- 172.21.15.103:0/2893811804 wait complete. 2020-04-22T14:20:40.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.029+0000 7f943ede1700 1 Processor -- start 2020-04-22T14:20:40.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.029+0000 7f943ede1700 1 -- start start 2020-04-22T14:20:40.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.030+0000 7f943ede1700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f94380b3bd0 0x7f9438066110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:40.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.030+0000 7f943ede1700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f94380b9140 0x7f94380645d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:40.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.030+0000 7f943ede1700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f943815b630 con 0x7f94380616b0 2020-04-22T14:20:40.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.030+0000 7f943ede1700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f943815b8d0 con 0x7f94380b3bd0 2020-04-22T14:20:40.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.030+0000 7f943ede1700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9438064a30 con 0x7f94380b9140 2020-04-22T14:20:40.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.030+0000 7f943d37e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f94380b9140 0x7f94380645d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:40.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.030+0000 7f943d37e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f94380b9140 0x7f94380645d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59168/0 (socket says 172.21.15.103:59168) 2020-04-22T14:20:40.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.030+0000 7f943d37e700 1 -- 172.21.15.103:0/2719561225 learned_addr learned my addr 172.21.15.103:0/2719561225 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:40.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.030+0000 7f9437fff700 1 --2- 172.21.15.103:0/2719561225 >> v2:172.21.15.86:3300/0 conn(0x7f94380b3bd0 0x7f9438066110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:40.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.030+0000 7f943d37e700 1 -- 172.21.15.103:0/2719561225 >> v2:172.21.15.86:3300/0 conn(0x7f94380b3bd0 msgr2=0x7f9438066110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:40.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.030+0000 7f943d37e700 1 --2- 172.21.15.103:0/2719561225 >> v2:172.21.15.86:3300/0 conn(0x7f94380b3bd0 0x7f9438066110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:40.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.030+0000 7f943d37e700 1 -- 172.21.15.103:0/2719561225 >> v1:172.21.15.86:6789/0 conn(0x7f94380616b0 legacy=0x7f943815bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:40.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.030+0000 7f943d37e700 1 -- 172.21.15.103:0/2719561225 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94380b5400 con 0x7f94380b9140 2020-04-22T14:20:40.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.030+0000 7f943d37e700 1 --2- 172.21.15.103:0/2719561225 >> v2:172.21.15.103:3300/0 conn(0x7f94380b9140 0x7f94380645d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9438066060 tx=0x7f9430010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.030+0000 7f943d37e700 1 --2- 172.21.15.103:0/2719561225 >> v2:172.21.15.103:3300/0 conn(0x7f94380b9140 0x7f94380645d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9438066060 tx=0x7f9430010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.030+0000 7f943d37e700 1 --2- 172.21.15.103:0/2719561225 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94380b9140 0x7f94380645d0 secure :-1 s=READY pgs=2201 cs=0 l=1 rx=0x7f9438066060 tx=0x7f9430010c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:40.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.030+0000 7f943d37e700 1 --2- 172.21.15.103:0/2719561225 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94380b9140 0x7f94380645d0 secure :-1 s=THROTTLE_DONE pgs=2201 cs=0 l=1 rx=0x7f9438066060 tx=0x7f9430010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.041 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.030+0000 7f943d37e700 1 --2- 172.21.15.103:0/2719561225 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94380b9140 0x7f94380645d0 secure :-1 s=THROTTLE_DONE pgs=2201 cs=0 l=1 rx=0x7f9438066060 tx=0x7f9430010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.030+0000 7f9435ffb700 1 -- 172.21.15.103:0/2719561225 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9430012270 con 0x7f94380b9140 2020-04-22T14:20:40.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.030+0000 7f943d37e700 1 --2- 172.21.15.103:0/2719561225 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94380b9140 0x7f94380645d0 secure :-1 s=THROTTLE_DONE pgs=2201 cs=0 l=1 rx=0x7f9438066060 tx=0x7f9430010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.030+0000 7f9435ffb700 1 -- 172.21.15.103:0/2719561225 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94300123d0 con 0x7f94380b9140 2020-04-22T14:20:40.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.030+0000 7f9435ffb700 1 -- 172.21.15.103:0/2719561225 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94300127f0 con 0x7f94380b9140 2020-04-22T14:20:40.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.030+0000 7f943ede1700 1 -- 172.21.15.103:0/2719561225 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94380b5650 con 0x7f94380b9140 2020-04-22T14:20:40.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.030+0000 7f943ede1700 1 -- 172.21.15.103:0/2719561225 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94380b5b20 con 0x7f94380b9140 2020-04-22T14:20:40.042 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.031+0000 7f943d37e700 1 --2- 172.21.15.103:0/2719561225 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94380b9140 0x7f94380645d0 secure :-1 s=THROTTLE_DONE pgs=2201 cs=0 l=1 rx=0x7f9438066060 tx=0x7f9430010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.031+0000 7f943ede1700 1 -- 172.21.15.103:0/2719561225 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9438064ba0 con 0x7f94380b9140 2020-04-22T14:20:40.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.032+0000 7f9435ffb700 1 -- 172.21.15.103:0/2719561225 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f9430012a60 con 0x7f94380b9140 2020-04-22T14:20:40.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.032+0000 7f943d37e700 1 --2- 172.21.15.103:0/2719561225 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94380b9140 0x7f94380645d0 secure :-1 s=THROTTLE_DONE pgs=2201 cs=0 l=1 rx=0x7f9438066060 tx=0x7f9430010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.032+0000 7f9435ffb700 1 --2- 172.21.15.103:0/2719561225 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f941804d8a0 0x7f941804fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:40.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.032+0000 7f9435ffb700 1 -- 172.21.15.103:0/2719561225 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f9430061a90 con 0x7f94380b9140 2020-04-22T14:20:40.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.032+0000 7f943cb7d700 1 --2- 172.21.15.103:0/2719561225 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f941804d8a0 0x7f941804fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:40.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.032+0000 7f943cb7d700 1 --2- 172.21.15.103:0/2719561225 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f941804d8a0 0x7f941804fd60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9438065f40 tx=0x7f9428007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.032+0000 7f943cb7d700 1 --2- 172.21.15.103:0/2719561225 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f941804d8a0 0x7f941804fd60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9438065f40 tx=0x7f9428007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.032+0000 7f943cb7d700 1 --2- 172.21.15.103:0/2719561225 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f941804d8a0 0x7f941804fd60 secure :-1 s=READY pgs=798 cs=0 l=1 rx=0x7f9438065f40 tx=0x7f9428007d50).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:40.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.036+0000 7f943d37e700 1 --2- 172.21.15.103:0/2719561225 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94380b9140 0x7f94380645d0 secure :-1 s=THROTTLE_DONE pgs=2201 cs=0 l=1 rx=0x7f9438066060 tx=0x7f9430010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.036+0000 7f9435ffb700 1 -- 172.21.15.103:0/2719561225 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f943003ce70 con 0x7f94380b9140 2020-04-22T14:20:40.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.180+0000 7f943ede1700 1 -- 172.21.15.103:0/2719561225 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9438056c90 con 0x7f94380b9140 2020-04-22T14:20:40.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.180+0000 7f943d37e700 1 --2- 172.21.15.103:0/2719561225 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94380b9140 0x7f94380645d0 secure :-1 s=THROTTLE_DONE pgs=2201 cs=0 l=1 rx=0x7f9438066060 tx=0x7f9430010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.182 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.180+0000 7f9435ffb700 1 -- 172.21.15.103:0/2719561225 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v154) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9430040490 con 0x7f94380b9140 2020-04-22T14:20:40.183 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:20:40.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.181+0000 7f943ede1700 1 -- 172.21.15.103:0/2719561225 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f941804d8a0 msgr2=0x7f941804fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:40.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.181+0000 7f943ede1700 1 --2- 172.21.15.103:0/2719561225 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f941804d8a0 0x7f941804fd60 secure :-1 s=READY pgs=798 cs=0 l=1 rx=0x7f9438065f40 tx=0x7f9428007d50).stop 2020-04-22T14:20:40.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.181+0000 7f943ede1700 1 -- 172.21.15.103:0/2719561225 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94380b9140 msgr2=0x7f94380645d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:40.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.181+0000 7f943ede1700 1 --2- 172.21.15.103:0/2719561225 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94380b9140 0x7f94380645d0 secure :-1 s=READY pgs=2201 cs=0 l=1 rx=0x7f9438066060 tx=0x7f9430010c10).stop 2020-04-22T14:20:40.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.182+0000 7f943ede1700 1 -- 172.21.15.103:0/2719561225 shutdown_connections 2020-04-22T14:20:40.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.182+0000 7f943ede1700 1 --2- 172.21.15.103:0/2719561225 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94380b9140 0x7f94380645d0 unknown :-1 s=CLOSED pgs=2201 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:40.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.182+0000 7f943ede1700 1 --2- 172.21.15.103:0/2719561225 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f941804d8a0 0x7f941804fd60 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:40.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.182+0000 7f943ede1700 1 --2- 172.21.15.103:0/2719561225 >> v2:172.21.15.86:3300/0 conn(0x7f94380b3bd0 0x7f9438066110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:40.188 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.182+0000 7f943ede1700 1 -- 172.21.15.103:0/2719561225 >> 172.21.15.103:0/2719561225 conn(0x7f943805b7b0 msgr2=0x7f94380b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:40.188 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.182+0000 7f943ede1700 1 -- 172.21.15.103:0/2719561225 shutdown_connections 2020-04-22T14:20:40.188 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.182+0000 7f943ede1700 1 -- 172.21.15.103:0/2719561225 wait complete. 2020-04-22T14:20:40.194 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:40.207 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-04-22T14:20:40.354 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.352+0000 7fa547c05700 1 Processor -- start 2020-04-22T14:20:40.355 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.352+0000 7fa547c05700 1 -- start start 2020-04-22T14:20:40.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.353+0000 7fa547c05700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa540140320 0x7fa5400ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:40.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.353+0000 7fa547c05700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa54014a2b0 0x7fa540146cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:40.357 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.353+0000 7fa547c05700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa5400bd1b0 0x7fa5400bd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:40.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.353+0000 7fa547c05700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa54014a710 con 0x7fa5400bd1b0 2020-04-22T14:20:40.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.353+0000 7fa547c05700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5401462f0 con 0x7fa540140320 2020-04-22T14:20:40.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.353+0000 7fa547c05700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa540146590 con 0x7fa54014a2b0 2020-04-22T14:20:40.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.353+0000 7fa5459a1700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa540140320 0x7fa5400ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:40.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.353+0000 7fa5459a1700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa540140320 0x7fa5400ae1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59172/0 (socket says 172.21.15.103:59172) 2020-04-22T14:20:40.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.353+0000 7fa5459a1700 1 -- 172.21.15.103:0/2335767591 learned_addr learned my addr 172.21.15.103:0/2335767591 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:40.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.353+0000 7fa5461a2700 1 --2- 172.21.15.103:0/2335767591 >> v2:172.21.15.86:3300/0 conn(0x7fa5400bd1b0 0x7fa5400bd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:40.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.353+0000 7fa5451a0700 1 --2- 172.21.15.103:0/2335767591 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa54014a2b0 0x7fa540146cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:40.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.353+0000 7fa5459a1700 1 -- 172.21.15.103:0/2335767591 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa54014a2b0 msgr2=0x7fa540146cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:40.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.353+0000 7fa5459a1700 1 --2- 172.21.15.103:0/2335767591 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa54014a2b0 0x7fa540146cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:40.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.353+0000 7fa5459a1700 1 -- 172.21.15.103:0/2335767591 >> v2:172.21.15.86:3300/0 conn(0x7fa5400bd1b0 msgr2=0x7fa5400bd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:40.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.353+0000 7fa5459a1700 1 --2- 172.21.15.103:0/2335767591 >> v2:172.21.15.86:3300/0 conn(0x7fa5400bd1b0 0x7fa5400bd640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:40.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.353+0000 7fa5459a1700 1 -- 172.21.15.103:0/2335767591 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa540146830 con 0x7fa540140320 2020-04-22T14:20:40.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.353+0000 7fa5459a1700 1 --2- 172.21.15.103:0/2335767591 >> v2:172.21.15.103:3300/0 conn(0x7fa540140320 0x7fa5400ae1a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa53c002f30 tx=0x7fa53c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.354+0000 7fa5459a1700 1 --2- 172.21.15.103:0/2335767591 >> v2:172.21.15.103:3300/0 conn(0x7fa540140320 0x7fa5400ae1a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa53c002f30 tx=0x7fa53c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.354+0000 7fa5459a1700 1 --2- 172.21.15.103:0/2335767591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa540140320 0x7fa5400ae1a0 secure :-1 s=READY pgs=2202 cs=0 l=1 rx=0x7fa53c002f30 tx=0x7fa53c007a40).ready entity=mon.1 client_cookie=1dd592d669e095c2 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:40.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.354+0000 7fa5459a1700 1 --2- 172.21.15.103:0/2335767591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa540140320 0x7fa5400ae1a0 secure :-1 s=THROTTLE_DONE pgs=2202 cs=0 l=1 rx=0x7fa53c002f30 tx=0x7fa53c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.354+0000 7fa54499f700 1 -- 172.21.15.103:0/2335767591 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa53c0115c0 con 0x7fa540140320 2020-04-22T14:20:40.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.354+0000 7fa5459a1700 1 --2- 172.21.15.103:0/2335767591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa540140320 0x7fa5400ae1a0 secure :-1 s=THROTTLE_DONE pgs=2202 cs=0 l=1 rx=0x7fa53c002f30 tx=0x7fa53c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.354+0000 7fa54499f700 1 -- 172.21.15.103:0/2335767591 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53c011720 con 0x7fa540140320 2020-04-22T14:20:40.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.354+0000 7fa5459a1700 1 --2- 172.21.15.103:0/2335767591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa540140320 0x7fa5400ae1a0 secure :-1 s=THROTTLE_DONE pgs=2202 cs=0 l=1 rx=0x7fa53c002f30 tx=0x7fa53c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.354+0000 7fa54499f700 1 -- 172.21.15.103:0/2335767591 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa53c011b40 con 0x7fa540140320 2020-04-22T14:20:40.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.354+0000 7fa547c05700 1 -- 172.21.15.103:0/2335767591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa540140320 msgr2=0x7fa5400ae1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:40.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.354+0000 7fa547c05700 1 --2- 172.21.15.103:0/2335767591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa540140320 0x7fa5400ae1a0 secure :-1 s=READY pgs=2202 cs=0 l=1 rx=0x7fa53c002f30 tx=0x7fa53c007a40).stop 2020-04-22T14:20:40.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.354+0000 7fa547c05700 1 -- 172.21.15.103:0/2335767591 shutdown_connections 2020-04-22T14:20:40.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.354+0000 7fa547c05700 1 --2- 172.21.15.103:0/2335767591 >> v2:172.21.15.86:3300/0 conn(0x7fa5400bd1b0 0x7fa5400bd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:40.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.354+0000 7fa547c05700 1 --2- 172.21.15.103:0/2335767591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa540140320 0x7fa5400ae1a0 unknown :-1 s=CLOSED pgs=2202 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:40.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.354+0000 7fa547c05700 1 --2- 172.21.15.103:0/2335767591 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa54014a2b0 0x7fa540146cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:40.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.354+0000 7fa547c05700 1 -- 172.21.15.103:0/2335767591 >> 172.21.15.103:0/2335767591 conn(0x7fa54005f2c0 msgr2=0x7fa5400bcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:40.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.354+0000 7fa547c05700 1 -- 172.21.15.103:0/2335767591 shutdown_connections 2020-04-22T14:20:40.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.354+0000 7fa547c05700 1 -- 172.21.15.103:0/2335767591 wait complete. 2020-04-22T14:20:40.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.355+0000 7fa547c05700 1 Processor -- start 2020-04-22T14:20:40.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.355+0000 7fa547c05700 1 -- start start 2020-04-22T14:20:40.365 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.356+0000 7fa547c05700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa54014a2b0 0x7fa540143560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:40.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.356+0000 7fa547c05700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa540142540 con 0x7fa540140320 2020-04-22T14:20:40.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.356+0000 7fa547c05700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5400b2630 con 0x7fa5400bd1b0 2020-04-22T14:20:40.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.356+0000 7fa547c05700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5400b2440 con 0x7fa54014a2b0 2020-04-22T14:20:40.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.356+0000 7fa5459a1700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa5400bd1b0 0x7fa540154f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51370/0 (socket says 172.21.15.103:51370) 2020-04-22T14:20:40.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.356+0000 7fa5459a1700 1 -- 172.21.15.103:0/505101587 learned_addr learned my addr 172.21.15.103:0/505101587 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:40.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.356+0000 7fa5461a2700 1 --2- 172.21.15.103:0/505101587 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa54014a2b0 0x7fa540143560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:40.366 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.356+0000 7fa52effd700 1 -- 172.21.15.103:0/505101587 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 664160444 0 0) 0x7fa5400b2630 con 0x7fa5400bd1b0 2020-04-22T14:20:40.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.356+0000 7fa52effd700 1 -- 172.21.15.103:0/505101587 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa520002fe0 con 0x7fa5400bd1b0 2020-04-22T14:20:40.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.356+0000 7fa52effd700 1 -- 172.21.15.103:0/505101587 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4071516164 0 0) 0x7fa540142540 con 0x7fa540140320 2020-04-22T14:20:40.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.356+0000 7fa52effd700 1 -- 172.21.15.103:0/505101587 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5400b2630 con 0x7fa540140320 2020-04-22T14:20:40.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.356+0000 7fa5461a2700 1 -- 172.21.15.103:0/505101587 >> v1:172.21.15.103:6789/0 conn(0x7fa5400bd1b0 legacy=0x7fa540154f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:40.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.356+0000 7fa5461a2700 1 -- 172.21.15.103:0/505101587 >> v1:172.21.15.86:6789/0 conn(0x7fa540140320 legacy=0x7fa5400bb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:40.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.356+0000 7fa5461a2700 1 -- 172.21.15.103:0/505101587 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5401432a0 con 0x7fa54014a2b0 2020-04-22T14:20:40.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.356+0000 7fa5461a2700 1 --2- 172.21.15.103:0/505101587 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa54014a2b0 0x7fa540143560 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa5380032b0 tx=0x7fa538010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.367 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.357+0000 7fa5461a2700 1 --2- 172.21.15.103:0/505101587 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa54014a2b0 0x7fa540143560 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa5380032b0 tx=0x7fa538010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.357+0000 7fa5461a2700 1 --2- 172.21.15.103:0/505101587 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa54014a2b0 0x7fa540143560 secure :-1 s=READY pgs=211 cs=0 l=1 rx=0x7fa5380032b0 tx=0x7fa538010f20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:40.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.357+0000 7fa5461a2700 1 --2- 172.21.15.103:0/505101587 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa54014a2b0 0x7fa540143560 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7fa5380032b0 tx=0x7fa538010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.357+0000 7fa52effd700 1 -- 172.21.15.103:0/505101587 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa53800e370 con 0x7fa54014a2b0 2020-04-22T14:20:40.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.357+0000 7fa5461a2700 1 --2- 172.21.15.103:0/505101587 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa54014a2b0 0x7fa540143560 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7fa5380032b0 tx=0x7fa538010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.357+0000 7fa52effd700 1 -- 172.21.15.103:0/505101587 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa538005c30 con 0x7fa54014a2b0 2020-04-22T14:20:40.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.357+0000 7fa547c05700 1 -- 172.21.15.103:0/505101587 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5400bbeb0 con 0x7fa54014a2b0 2020-04-22T14:20:40.368 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.357+0000 7fa5461a2700 1 --2- 172.21.15.103:0/505101587 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa54014a2b0 0x7fa540143560 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7fa5380032b0 tx=0x7fa538010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.357+0000 7fa52effd700 1 -- 172.21.15.103:0/505101587 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa53800c900 con 0x7fa54014a2b0 2020-04-22T14:20:40.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.357+0000 7fa547c05700 1 -- 172.21.15.103:0/505101587 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa540142260 con 0x7fa54014a2b0 2020-04-22T14:20:40.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.357+0000 7fa5461a2700 1 --2- 172.21.15.103:0/505101587 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa54014a2b0 0x7fa540143560 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7fa5380032b0 tx=0x7fa538010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.358+0000 7fa547c05700 1 -- 172.21.15.103:0/505101587 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa54013fb00 con 0x7fa54014a2b0 2020-04-22T14:20:40.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.358+0000 7fa52effd700 1 -- 172.21.15.103:0/505101587 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fa53800cb00 con 0x7fa54014a2b0 2020-04-22T14:20:40.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.358+0000 7fa5461a2700 1 --2- 172.21.15.103:0/505101587 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa54014a2b0 0x7fa540143560 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7fa5380032b0 tx=0x7fa538010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.369 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.358+0000 7fa52effd700 1 --2- 172.21.15.103:0/505101587 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa52004de00 0x7fa5200502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:40.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.358+0000 7fa52effd700 1 -- 172.21.15.103:0/505101587 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fa5380611f0 con 0x7fa54014a2b0 2020-04-22T14:20:40.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.358+0000 7fa5459a1700 1 --2- 172.21.15.103:0/505101587 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa52004de00 0x7fa5200502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:40.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.358+0000 7fa5459a1700 1 --2- 172.21.15.103:0/505101587 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa52004de00 0x7fa5200502c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa53c000b80 tx=0x7fa53c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.359+0000 7fa5459a1700 1 --2- 172.21.15.103:0/505101587 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa52004de00 0x7fa5200502c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa53c000b80 tx=0x7fa53c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.359+0000 7fa5459a1700 1 --2- 172.21.15.103:0/505101587 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa52004de00 0x7fa5200502c0 secure :-1 s=READY pgs=799 cs=0 l=1 rx=0x7fa53c000b80 tx=0x7fa53c007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:40.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.362+0000 7fa5461a2700 1 --2- 172.21.15.103:0/505101587 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa54014a2b0 0x7fa540143560 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7fa5380032b0 tx=0x7fa538010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.370 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.362+0000 7fa52effd700 1 -- 172.21.15.103:0/505101587 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fa53803c630 con 0x7fa54014a2b0 2020-04-22T14:20:40.507 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.505+0000 7fa547c05700 1 -- 172.21.15.103:0/505101587 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa540056c90 con 0x7fa54014a2b0 2020-04-22T14:20:40.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.505+0000 7fa5461a2700 1 --2- 172.21.15.103:0/505101587 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa54014a2b0 0x7fa540143560 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7fa5380032b0 tx=0x7fa538010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.506+0000 7fa52effd700 1 -- 172.21.15.103:0/505101587 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v154) v1 ==== 84+0+143 (secure 0 0 0) 0x7fa53803fc50 con 0x7fa54014a2b0 2020-04-22T14:20:40.508 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:20:40.508 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2020-04-22T14:20:40.508 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:40.509 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 1, 2020-04-22T14:20:40.509 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": "device_health_metrics" 2020-04-22T14:20:40.509 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:40.509 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:20:40.509 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 2, 2020-04-22T14:20:40.509 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": "rbd" 2020-04-22T14:20:40.509 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:40.510 INFO:teuthology.orchestra.run.smithi103.stdout:] 2020-04-22T14:20:40.510 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.507+0000 7fa547c05700 1 -- 172.21.15.103:0/505101587 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa52004de00 msgr2=0x7fa5200502c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:40.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.507+0000 7fa547c05700 1 --2- 172.21.15.103:0/505101587 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa52004de00 0x7fa5200502c0 secure :-1 s=READY pgs=799 cs=0 l=1 rx=0x7fa53c000b80 tx=0x7fa53c007a40).stop 2020-04-22T14:20:40.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.507+0000 7fa547c05700 1 -- 172.21.15.103:0/505101587 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa54014a2b0 msgr2=0x7fa540143560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:40.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.507+0000 7fa547c05700 1 --2- 172.21.15.103:0/505101587 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa54014a2b0 0x7fa540143560 secure :-1 s=READY pgs=211 cs=0 l=1 rx=0x7fa5380032b0 tx=0x7fa538010f20).stop 2020-04-22T14:20:40.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.507+0000 7fa547c05700 1 -- 172.21.15.103:0/505101587 shutdown_connections 2020-04-22T14:20:40.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.507+0000 7fa547c05700 1 --2- 172.21.15.103:0/505101587 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fa52004de00 0x7fa5200502c0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:40.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.507+0000 7fa547c05700 1 --2- 172.21.15.103:0/505101587 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa54014a2b0 0x7fa540143560 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:40.511 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.507+0000 7fa547c05700 1 -- 172.21.15.103:0/505101587 >> 172.21.15.103:0/505101587 conn(0x7fa54005f2c0 msgr2=0x7fa5400adc40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:40.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.507+0000 7fa547c05700 1 -- 172.21.15.103:0/505101587 shutdown_connections 2020-04-22T14:20:40.512 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.507+0000 7fa547c05700 1 -- 172.21.15.103:0/505101587 wait complete. 2020-04-22T14:20:40.519 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-04-22T14:20:40.519 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:40.532 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-04-22T14:20:40.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.680+0000 7fea05784700 1 Processor -- start 2020-04-22T14:20:40.683 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.681+0000 7fea05784700 1 -- start start 2020-04-22T14:20:40.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.681+0000 7fea05784700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fea000b9140 0x7fea000aed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:40.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.681+0000 7fea05784700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea000624d0 con 0x7fea000b3bd0 2020-04-22T14:20:40.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.681+0000 7fea05784700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea00148310 con 0x7fea000af1f0 2020-04-22T14:20:40.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.681+0000 7fea05784700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea001485b0 con 0x7fea000b9140 2020-04-22T14:20:40.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.682+0000 7fe9feffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fea000b9140 0x7fea000aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:40.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.682+0000 7fe9feffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fea000b9140 0x7fea000aed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59186/0 (socket says 172.21.15.103:59186) 2020-04-22T14:20:40.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.682+0000 7fe9ff7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fea000af1f0 0x7fea00061dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51376/0 (socket says 172.21.15.103:51376) 2020-04-22T14:20:40.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.682+0000 7fe9feffd700 1 -- 172.21.15.103:0/2619075877 learned_addr learned my addr 172.21.15.103:0/2619075877 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:40.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.682+0000 7fe9feffd700 1 -- 172.21.15.103:0/2619075877 >> v1:172.21.15.103:6789/0 conn(0x7fea000af1f0 legacy=0x7fea00061dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:40.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.682+0000 7fe9feffd700 1 -- 172.21.15.103:0/2619075877 >> v1:172.21.15.86:6789/0 conn(0x7fea000b3bd0 legacy=0x7fea000616b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:40.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.682+0000 7fe9feffd700 1 -- 172.21.15.103:0/2619075877 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea000b9520 con 0x7fea000b9140 2020-04-22T14:20:40.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.682+0000 7fe9feffd700 1 --2- 172.21.15.103:0/2619075877 >> v2:172.21.15.103:3300/0 conn(0x7fea000b9140 0x7fea000aed90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fea00067530 tx=0x7fe9f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.682+0000 7fe9feffd700 1 --2- 172.21.15.103:0/2619075877 >> v2:172.21.15.103:3300/0 conn(0x7fea000b9140 0x7fea000aed90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fea00067530 tx=0x7fe9f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.682+0000 7fe9feffd700 1 --2- 172.21.15.103:0/2619075877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea000b9140 0x7fea000aed90 secure :-1 s=READY pgs=2205 cs=0 l=1 rx=0x7fea00067530 tx=0x7fe9f0007a40).ready entity=mon.1 client_cookie=957b1097af12f8d0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:40.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.682+0000 7fe9feffd700 1 --2- 172.21.15.103:0/2619075877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea000b9140 0x7fea000aed90 secure :-1 s=THROTTLE_DONE pgs=2205 cs=0 l=1 rx=0x7fea00067530 tx=0x7fe9f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.682+0000 7fe9fdffb700 1 -- 172.21.15.103:0/2619075877 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9f00116e0 con 0x7fea000b9140 2020-04-22T14:20:40.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.682+0000 7fe9feffd700 1 --2- 172.21.15.103:0/2619075877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea000b9140 0x7fea000aed90 secure :-1 s=THROTTLE_DONE pgs=2205 cs=0 l=1 rx=0x7fea00067530 tx=0x7fe9f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.682+0000 7fe9feffd700 1 --2- 172.21.15.103:0/2619075877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea000b9140 0x7fea000aed90 secure :-1 s=THROTTLE_DONE pgs=2205 cs=0 l=1 rx=0x7fea00067530 tx=0x7fe9f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.682+0000 7fe9fdffb700 1 -- 172.21.15.103:0/2619075877 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f0011840 con 0x7fea000b9140 2020-04-22T14:20:40.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.682+0000 7fe9fdffb700 1 -- 172.21.15.103:0/2619075877 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9f0011c60 con 0x7fea000b9140 2020-04-22T14:20:40.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.682+0000 7fea05784700 1 -- 172.21.15.103:0/2619075877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea000b9140 msgr2=0x7fea000aed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:40.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.682+0000 7fea05784700 1 --2- 172.21.15.103:0/2619075877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea000b9140 0x7fea000aed90 secure :-1 s=READY pgs=2205 cs=0 l=1 rx=0x7fea00067530 tx=0x7fe9f0007a40).stop 2020-04-22T14:20:40.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.683+0000 7fea05784700 1 -- 172.21.15.103:0/2619075877 shutdown_connections 2020-04-22T14:20:40.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.683+0000 7fea05784700 1 --2- 172.21.15.103:0/2619075877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea000b9140 0x7fea000aed90 unknown :-1 s=CLOSED pgs=2205 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:40.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.683+0000 7fea05784700 1 -- 172.21.15.103:0/2619075877 >> 172.21.15.103:0/2619075877 conn(0x7fea0005b7b0 msgr2=0x7fea000b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:40.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.683+0000 7fea05784700 1 -- 172.21.15.103:0/2619075877 shutdown_connections 2020-04-22T14:20:40.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.683+0000 7fea05784700 1 -- 172.21.15.103:0/2619075877 wait complete. 2020-04-22T14:20:40.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.684+0000 7fea05784700 1 Processor -- start 2020-04-22T14:20:40.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.684+0000 7fea05784700 1 -- start start 2020-04-22T14:20:40.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.684+0000 7fea05784700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fea000b3bd0 0x7fea00155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:40.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.684+0000 7fea05784700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fea000b9140 0x7fea001467d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:40.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.684+0000 7fea05784700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea00146c30 con 0x7fea000af1f0 2020-04-22T14:20:40.692 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.684+0000 7fea05784700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea00146e70 con 0x7fea000b9140 2020-04-22T14:20:40.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.684+0000 7fea05784700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea0013f510 con 0x7fea000b3bd0 2020-04-22T14:20:40.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.684+0000 7fe9ff7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fea000b9140 0x7fea001467d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:40.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.684+0000 7fe9ff7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fea000b9140 0x7fea001467d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59194/0 (socket says 172.21.15.103:59194) 2020-04-22T14:20:40.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.684+0000 7fe9ff7fe700 1 -- 172.21.15.103:0/3073210942 learned_addr learned my addr 172.21.15.103:0/3073210942 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:40.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.685+0000 7fe9fe7fc700 1 --2- 172.21.15.103:0/3073210942 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fea000b3bd0 0x7fea00155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:40.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.685+0000 7fe9ff7fe700 1 -- 172.21.15.103:0/3073210942 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fea000b3bd0 msgr2=0x7fea00155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:40.693 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.685+0000 7fe9ff7fe700 1 --2- 172.21.15.103:0/3073210942 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fea000b3bd0 0x7fea00155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:40.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.685+0000 7fe9ff7fe700 1 -- 172.21.15.103:0/3073210942 >> v1:172.21.15.86:6789/0 conn(0x7fea000af1f0 legacy=0x7fea00139ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:40.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.685+0000 7fe9ff7fe700 1 -- 172.21.15.103:0/3073210942 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea00147110 con 0x7fea000b9140 2020-04-22T14:20:40.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.685+0000 7fe9ff7fe700 1 --2- 172.21.15.103:0/3073210942 >> v2:172.21.15.103:3300/0 conn(0x7fea000b9140 0x7fea001467d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fea000611b0 tx=0x7fe9f8010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.685+0000 7fe9ff7fe700 1 --2- 172.21.15.103:0/3073210942 >> v2:172.21.15.103:3300/0 conn(0x7fea000b9140 0x7fea001467d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fea000611b0 tx=0x7fe9f8010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.685+0000 7fe9ff7fe700 1 --2- 172.21.15.103:0/3073210942 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea000b9140 0x7fea001467d0 secure :-1 s=READY pgs=2206 cs=0 l=1 rx=0x7fea000611b0 tx=0x7fe9f8010d20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:40.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.685+0000 7fe9ff7fe700 1 --2- 172.21.15.103:0/3073210942 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea000b9140 0x7fea001467d0 secure :-1 s=THROTTLE_DONE pgs=2206 cs=0 l=1 rx=0x7fea000611b0 tx=0x7fe9f8010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.685+0000 7fe9f7fff700 1 -- 172.21.15.103:0/3073210942 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9f8004c50 con 0x7fea000b9140 2020-04-22T14:20:40.694 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.685+0000 7fe9ff7fe700 1 --2- 172.21.15.103:0/3073210942 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea000b9140 0x7fea001467d0 secure :-1 s=THROTTLE_DONE pgs=2206 cs=0 l=1 rx=0x7fea000611b0 tx=0x7fe9f8010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.685+0000 7fe9ff7fe700 1 --2- 172.21.15.103:0/3073210942 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea000b9140 0x7fea001467d0 secure :-1 s=THROTTLE_DONE pgs=2206 cs=0 l=1 rx=0x7fea000611b0 tx=0x7fe9f8010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.685+0000 7fe9f7fff700 1 -- 172.21.15.103:0/3073210942 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f8004db0 con 0x7fea000b9140 2020-04-22T14:20:40.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.685+0000 7fea05784700 1 -- 172.21.15.103:0/3073210942 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea00144f70 con 0x7fea000b9140 2020-04-22T14:20:40.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.685+0000 7fe9f7fff700 1 -- 172.21.15.103:0/3073210942 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9f80128b0 con 0x7fea000b9140 2020-04-22T14:20:40.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.685+0000 7fea05784700 1 -- 172.21.15.103:0/3073210942 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea001454c0 con 0x7fea000b9140 2020-04-22T14:20:40.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.686+0000 7fe9ff7fe700 1 --2- 172.21.15.103:0/3073210942 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea000b9140 0x7fea001467d0 secure :-1 s=THROTTLE_DONE pgs=2206 cs=0 l=1 rx=0x7fea000611b0 tx=0x7fe9f8010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.695 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.686+0000 7fea05784700 1 -- 172.21.15.103:0/3073210942 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea00056c90 con 0x7fea000b9140 2020-04-22T14:20:40.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.686+0000 7fe9f7fff700 1 -- 172.21.15.103:0/3073210942 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fe9f8012b20 con 0x7fea000b9140 2020-04-22T14:20:40.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.686+0000 7fe9ff7fe700 1 --2- 172.21.15.103:0/3073210942 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea000b9140 0x7fea001467d0 secure :-1 s=THROTTLE_DONE pgs=2206 cs=0 l=1 rx=0x7fea000611b0 tx=0x7fe9f8010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.686+0000 7fe9f7fff700 1 --2- 172.21.15.103:0/3073210942 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe9e404d940 0x7fe9e404fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:40.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.686+0000 7fe9f7fff700 1 -- 172.21.15.103:0/3073210942 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fe9f8061890 con 0x7fea000b9140 2020-04-22T14:20:40.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.686+0000 7fe9feffd700 1 --2- 172.21.15.103:0/3073210942 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe9e404d940 0x7fe9e404fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:40.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.687+0000 7fe9feffd700 1 --2- 172.21.15.103:0/3073210942 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe9e404d940 0x7fe9e404fe00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fea0013b6f0 tx=0x7fe9f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.696 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.687+0000 7fe9feffd700 1 --2- 172.21.15.103:0/3073210942 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe9e404d940 0x7fe9e404fe00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fea0013b6f0 tx=0x7fe9f0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.687+0000 7fe9feffd700 1 --2- 172.21.15.103:0/3073210942 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe9e404d940 0x7fe9e404fe00 secure :-1 s=READY pgs=800 cs=0 l=1 rx=0x7fea0013b6f0 tx=0x7fe9f0007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:40.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.690+0000 7fe9ff7fe700 1 --2- 172.21.15.103:0/3073210942 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea000b9140 0x7fea001467d0 secure :-1 s=THROTTLE_DONE pgs=2206 cs=0 l=1 rx=0x7fea000611b0 tx=0x7fe9f8010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:40.697 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.690+0000 7fe9f7fff700 1 -- 172.21.15.103:0/3073210942 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fe9f803cc70 con 0x7fea000b9140 2020-04-22T14:20:40.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:40.832+0000 7fea05784700 1 -- 172.21.15.103:0/3073210942 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fea001454c0 con 0x7fea000b9140 2020-04-22T14:20:41.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.543+0000 7fe9ff7fe700 1 --2- 172.21.15.103:0/3073210942 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea000b9140 0x7fea001467d0 secure :-1 s=THROTTLE_DONE pgs=2206 cs=0 l=1 rx=0x7fea000611b0 tx=0x7fe9f8010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:41.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.543+0000 7fe9f7fff700 1 -- 172.21.15.103:0/3073210942 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v155) v1 ==== 133+0+0 (secure 0 0 0) 0x7fea001454c0 con 0x7fea000b9140 2020-04-22T14:20:41.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.546+0000 7fea05784700 1 -- 172.21.15.103:0/3073210942 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe9e404d940 msgr2=0x7fe9e404fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:41.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.546+0000 7fea05784700 1 --2- 172.21.15.103:0/3073210942 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe9e404d940 0x7fe9e404fe00 secure :-1 s=READY pgs=800 cs=0 l=1 rx=0x7fea0013b6f0 tx=0x7fe9f0007a40).stop 2020-04-22T14:20:41.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.546+0000 7fea05784700 1 -- 172.21.15.103:0/3073210942 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea000b9140 msgr2=0x7fea001467d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:41.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.546+0000 7fea05784700 1 --2- 172.21.15.103:0/3073210942 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea000b9140 0x7fea001467d0 secure :-1 s=READY pgs=2206 cs=0 l=1 rx=0x7fea000611b0 tx=0x7fe9f8010d20).stop 2020-04-22T14:20:41.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.546+0000 7fea05784700 1 -- 172.21.15.103:0/3073210942 shutdown_connections 2020-04-22T14:20:41.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.546+0000 7fea05784700 1 --2- 172.21.15.103:0/3073210942 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe9e404d940 0x7fe9e404fe00 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:41.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.546+0000 7fea05784700 1 --2- 172.21.15.103:0/3073210942 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea000b9140 0x7fea001467d0 unknown :-1 s=CLOSED pgs=2206 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:41.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.546+0000 7fea05784700 1 --2- 172.21.15.103:0/3073210942 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fea000b3bd0 0x7fea00155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:41.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.546+0000 7fea05784700 1 -- 172.21.15.103:0/3073210942 >> 172.21.15.103:0/3073210942 conn(0x7fea0005b7b0 msgr2=0x7fea000b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:41.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.546+0000 7fea05784700 1 -- 172.21.15.103:0/3073210942 shutdown_connections 2020-04-22T14:20:41.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.546+0000 7fea05784700 1 -- 172.21.15.103:0/3073210942 wait complete. 2020-04-22T14:20:41.551 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' created 2020-04-22T14:20:41.562 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:41.577 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-04-22T14:20:41.729 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.726+0000 7f96944dd700 1 Processor -- start 2020-04-22T14:20:41.730 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.726+0000 7f96944dd700 1 -- start start 2020-04-22T14:20:41.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.727+0000 7f96944dd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f968c0b9140 0x7f968c12b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:41.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.727+0000 7f96944dd700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f968c12b670 0x7f968c143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:41.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.727+0000 7f96944dd700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f968c1467e0 con 0x7f968c0ac950 2020-04-22T14:20:41.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.727+0000 7f96944dd700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f968c0602f0 con 0x7f968c12b670 2020-04-22T14:20:41.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.727+0000 7f96944dd700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f968c060050 con 0x7f968c0b9140 2020-04-22T14:20:41.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.727+0000 7f9692279700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f968c0b9140 0x7f968c12b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:41.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.727+0000 7f9692279700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f968c0b9140 0x7f968c12b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59198/0 (socket says 172.21.15.103:59198) 2020-04-22T14:20:41.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.727+0000 7f9692279700 1 -- 172.21.15.103:0/396541276 learned_addr learned my addr 172.21.15.103:0/396541276 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:41.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.728+0000 7f9692279700 1 -- 172.21.15.103:0/396541276 >> v2:172.21.15.86:3300/0 conn(0x7f968c12b670 msgr2=0x7f968c143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:41.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.728+0000 7f9692279700 1 --2- 172.21.15.103:0/396541276 >> v2:172.21.15.86:3300/0 conn(0x7f968c12b670 0x7f968c143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:41.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.728+0000 7f9692279700 1 -- 172.21.15.103:0/396541276 >> v1:172.21.15.86:6789/0 conn(0x7f968c0ac950 legacy=0x7f968c146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:41.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.728+0000 7f9692279700 1 -- 172.21.15.103:0/396541276 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f968c0b9520 con 0x7f968c0b9140 2020-04-22T14:20:41.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.728+0000 7f9692279700 1 --2- 172.21.15.103:0/396541276 >> v2:172.21.15.103:3300/0 conn(0x7f968c0b9140 0x7f968c12b210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f968c0b6250 tx=0x7f9688007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:41.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.728+0000 7f9692279700 1 --2- 172.21.15.103:0/396541276 >> v2:172.21.15.103:3300/0 conn(0x7f968c0b9140 0x7f968c12b210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f968c0b6250 tx=0x7f9688007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:41.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.728+0000 7f9692279700 1 --2- 172.21.15.103:0/396541276 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f968c0b9140 0x7f968c12b210 secure :-1 s=READY pgs=2207 cs=0 l=1 rx=0x7f968c0b6250 tx=0x7f9688007a40).ready entity=mon.1 client_cookie=ca12a84875851e39 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:41.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.728+0000 7f9692279700 1 --2- 172.21.15.103:0/396541276 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f968c0b9140 0x7f968c12b210 secure :-1 s=THROTTLE_DONE pgs=2207 cs=0 l=1 rx=0x7f968c0b6250 tx=0x7f9688007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:41.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.728+0000 7f9692279700 1 --2- 172.21.15.103:0/396541276 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f968c0b9140 0x7f968c12b210 secure :-1 s=THROTTLE_DONE pgs=2207 cs=0 l=1 rx=0x7f968c0b6250 tx=0x7f9688007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:41.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.728+0000 7f9691277700 1 -- 172.21.15.103:0/396541276 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96880116e0 con 0x7f968c0b9140 2020-04-22T14:20:41.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.728+0000 7f9692279700 1 --2- 172.21.15.103:0/396541276 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f968c0b9140 0x7f968c12b210 secure :-1 s=THROTTLE_DONE pgs=2207 cs=0 l=1 rx=0x7f968c0b6250 tx=0x7f9688007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:41.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.728+0000 7f9691277700 1 -- 172.21.15.103:0/396541276 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9688011840 con 0x7f968c0b9140 2020-04-22T14:20:41.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.728+0000 7f9691277700 1 -- 172.21.15.103:0/396541276 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9688011c20 con 0x7f968c0b9140 2020-04-22T14:20:41.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.728+0000 7f96944dd700 1 -- 172.21.15.103:0/396541276 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f968c0b9140 msgr2=0x7f968c12b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:41.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.728+0000 7f96944dd700 1 --2- 172.21.15.103:0/396541276 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f968c0b9140 0x7f968c12b210 secure :-1 s=READY pgs=2207 cs=0 l=1 rx=0x7f968c0b6250 tx=0x7f9688007a40).stop 2020-04-22T14:20:41.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.728+0000 7f96944dd700 1 -- 172.21.15.103:0/396541276 shutdown_connections 2020-04-22T14:20:41.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.728+0000 7f96944dd700 1 --2- 172.21.15.103:0/396541276 >> v2:172.21.15.86:3300/0 conn(0x7f968c12b670 0x7f968c143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:41.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.728+0000 7f96944dd700 1 --2- 172.21.15.103:0/396541276 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f968c0b9140 0x7f968c12b210 unknown :-1 s=CLOSED pgs=2207 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:41.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.728+0000 7f96944dd700 1 -- 172.21.15.103:0/396541276 >> 172.21.15.103:0/396541276 conn(0x7f968c05b7b0 msgr2=0x7f968c0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:41.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.729+0000 7f96944dd700 1 -- 172.21.15.103:0/396541276 shutdown_connections 2020-04-22T14:20:41.736 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.729+0000 7f96944dd700 1 -- 172.21.15.103:0/396541276 wait complete. 2020-04-22T14:20:41.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.729+0000 7f96944dd700 1 Processor -- start 2020-04-22T14:20:41.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.729+0000 7f96944dd700 1 -- start start 2020-04-22T14:20:41.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.730+0000 7f96944dd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f968c0b9140 0x7f968c157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:41.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.730+0000 7f96944dd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f968c12b670 0x7f968c1272c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:41.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.730+0000 7f96944dd700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f968c154060 con 0x7f968c0ac950 2020-04-22T14:20:41.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.730+0000 7f96944dd700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f968c0644e0 con 0x7f968c0b9140 2020-04-22T14:20:41.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.730+0000 7f96944dd700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f968c154300 con 0x7f968c12b670 2020-04-22T14:20:41.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.730+0000 7f9691a78700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f968c0b9140 0x7f968c157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:41.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.730+0000 7f9691a78700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f968c0b9140 0x7f968c157220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59206/0 (socket says 172.21.15.103:59206) 2020-04-22T14:20:41.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.730+0000 7f9691a78700 1 -- 172.21.15.103:0/147923080 learned_addr learned my addr 172.21.15.103:0/147923080 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:41.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.730+0000 7f9692a7a700 1 --2- 172.21.15.103:0/147923080 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f968c12b670 0x7f968c1272c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:41.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.731+0000 7f9691a78700 1 -- 172.21.15.103:0/147923080 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f968c12b670 msgr2=0x7f968c1272c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:41.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.731+0000 7f9691a78700 1 --2- 172.21.15.103:0/147923080 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f968c12b670 0x7f968c1272c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:41.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.731+0000 7f9691a78700 1 -- 172.21.15.103:0/147923080 >> v1:172.21.15.86:6789/0 conn(0x7f968c0ac950 legacy=0x7f968c126bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:41.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.731+0000 7f9691a78700 1 -- 172.21.15.103:0/147923080 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f968c1545a0 con 0x7f968c0b9140 2020-04-22T14:20:41.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.731+0000 7f9692a7a700 1 --2- 172.21.15.103:0/147923080 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f968c12b670 0x7f968c1272c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:20:41.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.731+0000 7f9691a78700 1 --2- 172.21.15.103:0/147923080 >> v2:172.21.15.103:3300/0 conn(0x7f968c0b9140 0x7f968c157220 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9680002f40 tx=0x7f96800109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:41.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.731+0000 7f9691a78700 1 --2- 172.21.15.103:0/147923080 >> v2:172.21.15.103:3300/0 conn(0x7f968c0b9140 0x7f968c157220 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9680002f40 tx=0x7f96800109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:41.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.731+0000 7f9691a78700 1 --2- 172.21.15.103:0/147923080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f968c0b9140 0x7f968c157220 secure :-1 s=READY pgs=2208 cs=0 l=1 rx=0x7f9680002f40 tx=0x7f96800109a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:41.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.731+0000 7f9691a78700 1 --2- 172.21.15.103:0/147923080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f968c0b9140 0x7f968c157220 secure :-1 s=THROTTLE_DONE pgs=2208 cs=0 l=1 rx=0x7f9680002f40 tx=0x7f96800109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:41.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.731+0000 7f967f7fe700 1 -- 172.21.15.103:0/147923080 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9680008d40 con 0x7f968c0b9140 2020-04-22T14:20:41.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.731+0000 7f9691a78700 1 --2- 172.21.15.103:0/147923080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f968c0b9140 0x7f968c157220 secure :-1 s=THROTTLE_DONE pgs=2208 cs=0 l=1 rx=0x7f9680002f40 tx=0x7f96800109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:41.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.731+0000 7f9691a78700 1 --2- 172.21.15.103:0/147923080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f968c0b9140 0x7f968c157220 secure :-1 s=THROTTLE_DONE pgs=2208 cs=0 l=1 rx=0x7f9680002f40 tx=0x7f96800109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:41.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.731+0000 7f967f7fe700 1 -- 172.21.15.103:0/147923080 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9680012340 con 0x7f968c0b9140 2020-04-22T14:20:41.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.731+0000 7f96944dd700 1 -- 172.21.15.103:0/147923080 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f968c154a40 con 0x7f968c0b9140 2020-04-22T14:20:41.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.731+0000 7f967f7fe700 1 -- 172.21.15.103:0/147923080 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9680012760 con 0x7f968c0b9140 2020-04-22T14:20:41.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.731+0000 7f96944dd700 1 -- 172.21.15.103:0/147923080 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f968c0b3090 con 0x7f968c0b9140 2020-04-22T14:20:41.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.731+0000 7f9691a78700 1 --2- 172.21.15.103:0/147923080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f968c0b9140 0x7f968c157220 secure :-1 s=THROTTLE_DONE pgs=2208 cs=0 l=1 rx=0x7f9680002f40 tx=0x7f96800109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:41.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.732+0000 7f967f7fe700 1 -- 172.21.15.103:0/147923080 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f96800129d0 con 0x7f968c0b9140 2020-04-22T14:20:41.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.732+0000 7f9691a78700 1 --2- 172.21.15.103:0/147923080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f968c0b9140 0x7f968c157220 secure :-1 s=THROTTLE_DONE pgs=2208 cs=0 l=1 rx=0x7f9680002f40 tx=0x7f96800109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:41.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.732+0000 7f96944dd700 1 -- 172.21.15.103:0/147923080 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f968c153eb0 con 0x7f968c0b9140 2020-04-22T14:20:41.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.732+0000 7f967f7fe700 1 --2- 172.21.15.103:0/147923080 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f966c04da20 0x7f966c04fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:41.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.732+0000 7f967f7fe700 1 -- 172.21.15.103:0/147923080 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f96800611f0 con 0x7f968c0b9140 2020-04-22T14:20:41.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.732+0000 7f9692279700 1 --2- 172.21.15.103:0/147923080 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f966c04da20 0x7f966c04fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:41.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.733+0000 7f9692279700 1 --2- 172.21.15.103:0/147923080 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f966c04da20 0x7f966c04fee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f968c062410 tx=0x7f9688007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:41.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.733+0000 7f9692279700 1 --2- 172.21.15.103:0/147923080 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f966c04da20 0x7f966c04fee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f968c062410 tx=0x7f9688007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:41.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.733+0000 7f9692279700 1 --2- 172.21.15.103:0/147923080 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f966c04da20 0x7f966c04fee0 secure :-1 s=READY pgs=801 cs=0 l=1 rx=0x7f968c062410 tx=0x7f9688007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:41.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.736+0000 7f9691a78700 1 --2- 172.21.15.103:0/147923080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f968c0b9140 0x7f968c157220 secure :-1 s=THROTTLE_DONE pgs=2208 cs=0 l=1 rx=0x7f9680002f40 tx=0x7f96800109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:41.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.736+0000 7f967f7fe700 1 -- 172.21.15.103:0/147923080 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f968003c570 con 0x7f968c0b9140 2020-04-22T14:20:41.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:41.879+0000 7f96944dd700 1 -- 172.21.15.103:0/147923080 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f968c056c90 con 0x7f968c0b9140 2020-04-22T14:20:42.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.550+0000 7f9691a78700 1 --2- 172.21.15.103:0/147923080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f968c0b9140 0x7f968c157220 secure :-1 s=THROTTLE_DONE pgs=2208 cs=0 l=1 rx=0x7f9680002f40 tx=0x7f96800109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:42.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.550+0000 7f967f7fe700 1 -- 172.21.15.103:0/147923080 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v156) v1 ==== 125+0+0 (secure 0 0 0) 0x7f968003fb90 con 0x7f968c0b9140 2020-04-22T14:20:42.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.553+0000 7f96944dd700 1 -- 172.21.15.103:0/147923080 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f966c04da20 msgr2=0x7f966c04fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:42.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.553+0000 7f96944dd700 1 --2- 172.21.15.103:0/147923080 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f966c04da20 0x7f966c04fee0 secure :-1 s=READY pgs=801 cs=0 l=1 rx=0x7f968c062410 tx=0x7f9688007a40).stop 2020-04-22T14:20:42.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.553+0000 7f96944dd700 1 -- 172.21.15.103:0/147923080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f968c0b9140 msgr2=0x7f968c157220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:42.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.553+0000 7f96944dd700 1 --2- 172.21.15.103:0/147923080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f968c0b9140 0x7f968c157220 secure :-1 s=READY pgs=2208 cs=0 l=1 rx=0x7f9680002f40 tx=0x7f96800109a0).stop 2020-04-22T14:20:42.557 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.554+0000 7f96944dd700 1 -- 172.21.15.103:0/147923080 shutdown_connections 2020-04-22T14:20:42.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.554+0000 7f96944dd700 1 --2- 172.21.15.103:0/147923080 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f966c04da20 0x7f966c04fee0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:42.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.554+0000 7f96944dd700 1 --2- 172.21.15.103:0/147923080 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f968c12b670 0x7f968c1272c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:42.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.554+0000 7f96944dd700 1 --2- 172.21.15.103:0/147923080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f968c0b9140 0x7f968c157220 unknown :-1 s=CLOSED pgs=2208 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:42.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.554+0000 7f96944dd700 1 -- 172.21.15.103:0/147923080 >> 172.21.15.103:0/147923080 conn(0x7f968c05b7b0 msgr2=0x7f968c0b6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:42.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.554+0000 7f96944dd700 1 -- 172.21.15.103:0/147923080 shutdown_connections 2020-04-22T14:20:42.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.555+0000 7f96944dd700 1 -- 172.21.15.103:0/147923080 wait complete. 2020-04-22T14:20:42.560 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' created 2020-04-22T14:20:42.571 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:42.586 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-04-22T14:20:42.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.735+0000 7fd1fd36b700 1 Processor -- start 2020-04-22T14:20:42.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.735+0000 7fd1fd36b700 1 -- start start 2020-04-22T14:20:42.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.736+0000 7fd1fd36b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd1f80b9140 0x7fd1f812b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:42.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.736+0000 7fd1fd36b700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd1f80ac950 0x7fd1f812b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:42.749 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.736+0000 7fd1fd36b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd1f8146c40 0x7fd1f81470f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:42.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.736+0000 7fd1fd36b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1f80602f0 con 0x7fd1f80b9140 2020-04-22T14:20:42.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.736+0000 7fd1fd36b700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1f81467e0 con 0x7fd1f8146c40 2020-04-22T14:20:42.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.736+0000 7fd1fd36b700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f8060050 con 0x7fd1f80ac950 2020-04-22T14:20:42.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.736+0000 7fd1f77fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd1f8146c40 0x7fd1f81470f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:42.750 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.736+0000 7fd1f77fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd1f8146c40 0x7fd1f81470f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59210/0 (socket says 172.21.15.103:59210) 2020-04-22T14:20:42.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.736+0000 7fd1f77fe700 1 -- 172.21.15.103:0/560769077 learned_addr learned my addr 172.21.15.103:0/560769077 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:42.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.737+0000 7fd1f67fc700 1 --2- 172.21.15.103:0/560769077 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd1f80ac950 0x7fd1f812b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:42.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.737+0000 7fd1f6ffd700 1 --2- 172.21.15.103:0/560769077 >> v2:172.21.15.86:3300/0 conn(0x7fd1f80b9140 0x7fd1f812b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:42.751 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.737+0000 7fd1f77fe700 1 -- 172.21.15.103:0/560769077 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd1f80ac950 msgr2=0x7fd1f812b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:42.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.737+0000 7fd1f77fe700 1 --2- 172.21.15.103:0/560769077 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd1f80ac950 0x7fd1f812b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:42.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.737+0000 7fd1f77fe700 1 -- 172.21.15.103:0/560769077 >> v2:172.21.15.86:3300/0 conn(0x7fd1f80b9140 msgr2=0x7fd1f812b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:42.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.737+0000 7fd1f77fe700 1 --2- 172.21.15.103:0/560769077 >> v2:172.21.15.86:3300/0 conn(0x7fd1f80b9140 0x7fd1f812b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:42.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.737+0000 7fd1f77fe700 1 -- 172.21.15.103:0/560769077 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f80b9520 con 0x7fd1f8146c40 2020-04-22T14:20:42.752 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.737+0000 7fd1f77fe700 1 --2- 172.21.15.103:0/560769077 >> v2:172.21.15.103:3300/0 conn(0x7fd1f8146c40 0x7fd1f81470f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd1f00032b0 tx=0x7fd1f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:42.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.737+0000 7fd1f77fe700 1 --2- 172.21.15.103:0/560769077 >> v2:172.21.15.103:3300/0 conn(0x7fd1f8146c40 0x7fd1f81470f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd1f00032b0 tx=0x7fd1f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:42.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.737+0000 7fd1f77fe700 1 --2- 172.21.15.103:0/560769077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1f8146c40 0x7fd1f81470f0 secure :-1 s=READY pgs=2209 cs=0 l=1 rx=0x7fd1f00032b0 tx=0x7fd1f0007dc0).ready entity=mon.1 client_cookie=ef1846ae09333faf server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:42.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.737+0000 7fd1f77fe700 1 --2- 172.21.15.103:0/560769077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1f8146c40 0x7fd1f81470f0 secure :-1 s=THROTTLE_DONE pgs=2209 cs=0 l=1 rx=0x7fd1f00032b0 tx=0x7fd1f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:42.753 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.737+0000 7fd1f5ffb700 1 -- 172.21.15.103:0/560769077 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1f000a370 con 0x7fd1f8146c40 2020-04-22T14:20:42.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.737+0000 7fd1f77fe700 1 --2- 172.21.15.103:0/560769077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1f8146c40 0x7fd1f81470f0 secure :-1 s=THROTTLE_DONE pgs=2209 cs=0 l=1 rx=0x7fd1f00032b0 tx=0x7fd1f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:42.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.737+0000 7fd1f77fe700 1 --2- 172.21.15.103:0/560769077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1f8146c40 0x7fd1f81470f0 secure :-1 s=THROTTLE_DONE pgs=2209 cs=0 l=1 rx=0x7fd1f00032b0 tx=0x7fd1f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:42.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.737+0000 7fd1f5ffb700 1 -- 172.21.15.103:0/560769077 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f000a4d0 con 0x7fd1f8146c40 2020-04-22T14:20:42.754 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.737+0000 7fd1f5ffb700 1 -- 172.21.15.103:0/560769077 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1f000a8f0 con 0x7fd1f8146c40 2020-04-22T14:20:42.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.737+0000 7fd1fd36b700 1 -- 172.21.15.103:0/560769077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1f8146c40 msgr2=0x7fd1f81470f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:42.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.737+0000 7fd1fd36b700 1 --2- 172.21.15.103:0/560769077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1f8146c40 0x7fd1f81470f0 secure :-1 s=READY pgs=2209 cs=0 l=1 rx=0x7fd1f00032b0 tx=0x7fd1f0007dc0).stop 2020-04-22T14:20:42.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.738+0000 7fd1fd36b700 1 -- 172.21.15.103:0/560769077 shutdown_connections 2020-04-22T14:20:42.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.738+0000 7fd1fd36b700 1 --2- 172.21.15.103:0/560769077 >> v2:172.21.15.86:3300/0 conn(0x7fd1f80b9140 0x7fd1f812b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:42.755 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.738+0000 7fd1fd36b700 1 --2- 172.21.15.103:0/560769077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1f8146c40 0x7fd1f81470f0 unknown :-1 s=CLOSED pgs=2209 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:42.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.738+0000 7fd1fd36b700 1 --2- 172.21.15.103:0/560769077 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd1f80ac950 0x7fd1f812b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:42.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.738+0000 7fd1fd36b700 1 -- 172.21.15.103:0/560769077 >> 172.21.15.103:0/560769077 conn(0x7fd1f805b7b0 msgr2=0x7fd1f80b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:42.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.738+0000 7fd1fd36b700 1 -- 172.21.15.103:0/560769077 shutdown_connections 2020-04-22T14:20:42.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.738+0000 7fd1fd36b700 1 -- 172.21.15.103:0/560769077 wait complete. 2020-04-22T14:20:42.756 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.738+0000 7fd1fd36b700 1 Processor -- start 2020-04-22T14:20:42.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.739+0000 7fd1fd36b700 1 -- start start 2020-04-22T14:20:42.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.739+0000 7fd1fd36b700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd1f80b9140 0x7fd1f80b3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:42.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.739+0000 7fd1fd36b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd1f8146c40 0x7fd1f80b5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:42.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.739+0000 7fd1fd36b700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1f8142b50 con 0x7fd1f80ac950 2020-04-22T14:20:42.757 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.739+0000 7fd1fd36b700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1f80b54d0 con 0x7fd1f80b9140 2020-04-22T14:20:42.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.739+0000 7fd1fd36b700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1f80b5710 con 0x7fd1f8146c40 2020-04-22T14:20:42.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.739+0000 7fd1f77fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd1f8146c40 0x7fd1f80b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:42.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.739+0000 7fd1f77fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd1f8146c40 0x7fd1f80b5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59220/0 (socket says 172.21.15.103:59220) 2020-04-22T14:20:42.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.739+0000 7fd1f77fe700 1 -- 172.21.15.103:0/747305152 learned_addr learned my addr 172.21.15.103:0/747305152 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:42.758 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.739+0000 7fd1f67fc700 1 --2- 172.21.15.103:0/747305152 >> v2:172.21.15.86:3300/0 conn(0x7fd1f80b9140 0x7fd1f80b3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:42.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.739+0000 7fd1f77fe700 1 -- 172.21.15.103:0/747305152 >> v2:172.21.15.86:3300/0 conn(0x7fd1f80b9140 msgr2=0x7fd1f80b3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:42.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.739+0000 7fd1f77fe700 1 --2- 172.21.15.103:0/747305152 >> v2:172.21.15.86:3300/0 conn(0x7fd1f80b9140 0x7fd1f80b3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:42.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.740+0000 7fd1f77fe700 1 -- 172.21.15.103:0/747305152 >> v1:172.21.15.86:6789/0 conn(0x7fd1f80ac950 legacy=0x7fd1f8153e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:42.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.740+0000 7fd1f77fe700 1 -- 172.21.15.103:0/747305152 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f80b59b0 con 0x7fd1f8146c40 2020-04-22T14:20:42.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.740+0000 7fd1f77fe700 1 --2- 172.21.15.103:0/747305152 >> v2:172.21.15.103:3300/0 conn(0x7fd1f8146c40 0x7fd1f80b5070 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd1f80b4180 tx=0x7fd1f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:42.759 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.740+0000 7fd1f77fe700 1 --2- 172.21.15.103:0/747305152 >> v2:172.21.15.103:3300/0 conn(0x7fd1f8146c40 0x7fd1f80b5070 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd1f80b4180 tx=0x7fd1f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:42.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.740+0000 7fd1f77fe700 1 --2- 172.21.15.103:0/747305152 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1f8146c40 0x7fd1f80b5070 secure :-1 s=READY pgs=2210 cs=0 l=1 rx=0x7fd1f80b4180 tx=0x7fd1f0007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:42.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.740+0000 7fd1f77fe700 1 --2- 172.21.15.103:0/747305152 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1f8146c40 0x7fd1f80b5070 secure :-1 s=THROTTLE_DONE pgs=2210 cs=0 l=1 rx=0x7fd1f80b4180 tx=0x7fd1f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:42.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.740+0000 7fd1e7fff700 1 -- 172.21.15.103:0/747305152 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1f0012e40 con 0x7fd1f8146c40 2020-04-22T14:20:42.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.740+0000 7fd1f77fe700 1 --2- 172.21.15.103:0/747305152 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1f8146c40 0x7fd1f80b5070 secure :-1 s=THROTTLE_DONE pgs=2210 cs=0 l=1 rx=0x7fd1f80b4180 tx=0x7fd1f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:42.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.740+0000 7fd1e7fff700 1 -- 172.21.15.103:0/747305152 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f0005a40 con 0x7fd1f8146c40 2020-04-22T14:20:42.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.740+0000 7fd1f77fe700 1 --2- 172.21.15.103:0/747305152 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1f8146c40 0x7fd1f80b5070 secure :-1 s=THROTTLE_DONE pgs=2210 cs=0 l=1 rx=0x7fd1f80b4180 tx=0x7fd1f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:42.760 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.740+0000 7fd1fd36b700 1 -- 172.21.15.103:0/747305152 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1f80b5c50 con 0x7fd1f8146c40 2020-04-22T14:20:42.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.740+0000 7fd1e7fff700 1 -- 172.21.15.103:0/747305152 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1f0005de0 con 0x7fd1f8146c40 2020-04-22T14:20:42.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.740+0000 7fd1fd36b700 1 -- 172.21.15.103:0/747305152 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1f81547b0 con 0x7fd1f8146c40 2020-04-22T14:20:42.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.740+0000 7fd1f77fe700 1 --2- 172.21.15.103:0/747305152 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1f8146c40 0x7fd1f80b5070 secure :-1 s=THROTTLE_DONE pgs=2210 cs=0 l=1 rx=0x7fd1f80b4180 tx=0x7fd1f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:42.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.741+0000 7fd1fd36b700 1 -- 172.21.15.103:0/747305152 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1f80b20c0 con 0x7fd1f8146c40 2020-04-22T14:20:42.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.741+0000 7fd1e7fff700 1 -- 172.21.15.103:0/747305152 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fd1f00130d0 con 0x7fd1f8146c40 2020-04-22T14:20:42.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.741+0000 7fd1f77fe700 1 --2- 172.21.15.103:0/747305152 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1f8146c40 0x7fd1f80b5070 secure :-1 s=THROTTLE_DONE pgs=2210 cs=0 l=1 rx=0x7fd1f80b4180 tx=0x7fd1f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:42.761 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.741+0000 7fd1e7fff700 1 --2- 172.21.15.103:0/747305152 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd1d404d960 0x7fd1d404fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:42.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.741+0000 7fd1e7fff700 1 -- 172.21.15.103:0/747305152 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5957+0+0 (secure 0 0 0) 0x7fd1f0061d20 con 0x7fd1f8146c40 2020-04-22T14:20:42.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.741+0000 7fd1f6ffd700 1 --2- 172.21.15.103:0/747305152 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd1d404d960 0x7fd1d404fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:42.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.741+0000 7fd1f6ffd700 1 --2- 172.21.15.103:0/747305152 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd1d404d960 0x7fd1d404fe20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd1ec002f30 tx=0x7fd1ec008d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:42.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.741+0000 7fd1f6ffd700 1 --2- 172.21.15.103:0/747305152 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd1d404d960 0x7fd1d404fe20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd1ec002f30 tx=0x7fd1ec008d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:42.762 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.742+0000 7fd1f6ffd700 1 --2- 172.21.15.103:0/747305152 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd1d404d960 0x7fd1d404fe20 secure :-1 s=READY pgs=802 cs=0 l=1 rx=0x7fd1ec002f30 tx=0x7fd1ec008d10).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:42.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.745+0000 7fd1f77fe700 1 --2- 172.21.15.103:0/747305152 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1f8146c40 0x7fd1f80b5070 secure :-1 s=THROTTLE_DONE pgs=2210 cs=0 l=1 rx=0x7fd1f80b4180 tx=0x7fd1f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:42.763 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.745+0000 7fd1e7fff700 1 -- 172.21.15.103:0/747305152 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fd1f003d1c0 con 0x7fd1f8146c40 2020-04-22T14:20:42.936 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.933+0000 7fd1fd36b700 1 -- 172.21.15.103:0/747305152 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fd1f8056c90 con 0x7fd1f8146c40 2020-04-22T14:20:42.954 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.949+0000 7fd1f77fe700 1 --2- 172.21.15.103:0/747305152 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1f8146c40 0x7fd1f80b5070 secure :-1 s=THROTTLE_DONE pgs=2210 cs=0 l=1 rx=0x7fd1f80b4180 tx=0x7fd1f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:42.955 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.949+0000 7fd1e7fff700 1 -- 172.21.15.103:0/747305152 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 27 and data pool 28 v118) v1 ==== 189+0+0 (secure 0 0 0) 0x7fd1f00407e0 con 0x7fd1f8146c40 2020-04-22T14:20:42.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.954+0000 7fd1fd36b700 1 -- 172.21.15.103:0/747305152 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd1d404d960 msgr2=0x7fd1d404fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:42.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.954+0000 7fd1fd36b700 1 --2- 172.21.15.103:0/747305152 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd1d404d960 0x7fd1d404fe20 secure :-1 s=READY pgs=802 cs=0 l=1 rx=0x7fd1ec002f30 tx=0x7fd1ec008d10).stop 2020-04-22T14:20:42.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.954+0000 7fd1fd36b700 1 -- 172.21.15.103:0/747305152 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1f8146c40 msgr2=0x7fd1f80b5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:42.958 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.954+0000 7fd1fd36b700 1 --2- 172.21.15.103:0/747305152 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1f8146c40 0x7fd1f80b5070 secure :-1 s=READY pgs=2210 cs=0 l=1 rx=0x7fd1f80b4180 tx=0x7fd1f0007dc0).stop 2020-04-22T14:20:42.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.954+0000 7fd1fd36b700 1 -- 172.21.15.103:0/747305152 shutdown_connections 2020-04-22T14:20:42.959 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.954+0000 7fd1fd36b700 1 --2- 172.21.15.103:0/747305152 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1f8146c40 0x7fd1f80b5070 unknown :-1 s=CLOSED pgs=2210 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:42.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.954+0000 7fd1fd36b700 1 --2- 172.21.15.103:0/747305152 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd1d404d960 0x7fd1d404fe20 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:42.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.954+0000 7fd1fd36b700 1 --2- 172.21.15.103:0/747305152 >> v2:172.21.15.86:3300/0 conn(0x7fd1f80b9140 0x7fd1f80b3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:42.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.954+0000 7fd1fd36b700 1 -- 172.21.15.103:0/747305152 >> 172.21.15.103:0/747305152 conn(0x7fd1f805b7b0 msgr2=0x7fd1f8128410 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:42.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.955+0000 7fd1fd36b700 1 -- 172.21.15.103:0/747305152 shutdown_connections 2020-04-22T14:20:42.961 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:42.955+0000 7fd1fd36b700 1 -- 172.21.15.103:0/747305152 wait complete. 2020-04-22T14:20:42.961 INFO:teuthology.orchestra.run.smithi103.stderr:new fs with metadata pool 27 and data pool 28 2020-04-22T14:20:42.969 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:42.983 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:20:43.128 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.125+0000 7f1cc8029700 1 Processor -- start 2020-04-22T14:20:43.129 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.125+0000 7f1cc8029700 1 -- start start 2020-04-22T14:20:43.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.126+0000 7f1cc8029700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1cc0067170 0x7f1cc00b6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:43.136 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.126+0000 7f1cc8029700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cc00ac740 0x7f1cc013c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:43.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.126+0000 7f1cc8029700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc0064ec0 con 0x7f1cc013c7e0 2020-04-22T14:20:43.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.126+0000 7f1cc8029700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc0065af0 con 0x7f1cc0067170 2020-04-22T14:20:43.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.126+0000 7f1cc8029700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc005bb50 con 0x7f1cc00ac740 2020-04-22T14:20:43.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.126+0000 7f1cc5dc5700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1cc0067170 0x7f1cc00b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:43.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.126+0000 7f1cc65c6700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f1cc013c7e0 0x7f1cc005b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51428/0 (socket says 172.21.15.103:51428) 2020-04-22T14:20:43.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.126+0000 7f1cc5dc5700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1cc0067170 0x7f1cc00b6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59234/0 (socket says 172.21.15.103:59234) 2020-04-22T14:20:43.137 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.126+0000 7f1cc65c6700 1 -- 172.21.15.103:0/256433636 learned_addr learned my addr 172.21.15.103:0/256433636 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:43.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.126+0000 7f1cc55c4700 1 --2- 172.21.15.103:0/256433636 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cc00ac740 0x7f1cc013c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:43.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.126+0000 7f1cc5dc5700 1 -- 172.21.15.103:0/256433636 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cc00ac740 msgr2=0x7f1cc013c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:43.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.126+0000 7f1cc5dc5700 1 --2- 172.21.15.103:0/256433636 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cc00ac740 0x7f1cc013c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:43.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.127+0000 7f1cc5dc5700 1 -- 172.21.15.103:0/256433636 >> v1:172.21.15.103:6789/0 conn(0x7f1cc013c7e0 legacy=0x7f1cc005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:43.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.127+0000 7f1cc5dc5700 1 -- 172.21.15.103:0/256433636 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc0146870 con 0x7f1cc0067170 2020-04-22T14:20:43.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.127+0000 7f1cc4dc3700 1 -- 172.21.15.103:0/256433636 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2321503241 0 0) 0x7f1cc0064ec0 con 0x7f1cc013c7e0 2020-04-22T14:20:43.138 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.127+0000 7f1cc5dc5700 1 --2- 172.21.15.103:0/256433636 >> v2:172.21.15.103:3300/0 conn(0x7f1cc0067170 0x7f1cc00b6040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1cb0002f30 tx=0x7f1cb0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.127+0000 7f1cc5dc5700 1 --2- 172.21.15.103:0/256433636 >> v2:172.21.15.103:3300/0 conn(0x7f1cc0067170 0x7f1cc00b6040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1cb0002f30 tx=0x7f1cb0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.127+0000 7f1cc5dc5700 1 --2- 172.21.15.103:0/256433636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1cc0067170 0x7f1cc00b6040 secure :-1 s=READY pgs=2212 cs=0 l=1 rx=0x7f1cb0002f30 tx=0x7f1cb0007a40).ready entity=mon.1 client_cookie=7842991d579c1ea1 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:43.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.127+0000 7f1cc5dc5700 1 --2- 172.21.15.103:0/256433636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1cc0067170 0x7f1cc00b6040 secure :-1 s=THROTTLE_DONE pgs=2212 cs=0 l=1 rx=0x7f1cb0002f30 tx=0x7f1cb0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.127+0000 7f1cc4dc3700 1 -- 172.21.15.103:0/256433636 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cb0013680 con 0x7f1cc0067170 2020-04-22T14:20:43.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.127+0000 7f1cc5dc5700 1 --2- 172.21.15.103:0/256433636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1cc0067170 0x7f1cc00b6040 secure :-1 s=THROTTLE_DONE pgs=2212 cs=0 l=1 rx=0x7f1cb0002f30 tx=0x7f1cb0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.127+0000 7f1cc4dc3700 1 -- 172.21.15.103:0/256433636 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb0013820 con 0x7f1cc0067170 2020-04-22T14:20:43.139 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.127+0000 7f1cc5dc5700 1 --2- 172.21.15.103:0/256433636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1cc0067170 0x7f1cc00b6040 secure :-1 s=THROTTLE_DONE pgs=2212 cs=0 l=1 rx=0x7f1cb0002f30 tx=0x7f1cb0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.127+0000 7f1cc8029700 1 -- 172.21.15.103:0/256433636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1cc0067170 msgr2=0x7f1cc00b6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:43.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.127+0000 7f1cc4dc3700 1 -- 172.21.15.103:0/256433636 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cb0013c00 con 0x7f1cc0067170 2020-04-22T14:20:43.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.127+0000 7f1cc8029700 1 --2- 172.21.15.103:0/256433636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1cc0067170 0x7f1cc00b6040 secure :-1 s=READY pgs=2212 cs=0 l=1 rx=0x7f1cb0002f30 tx=0x7f1cb0007a40).stop 2020-04-22T14:20:43.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.127+0000 7f1cc8029700 1 -- 172.21.15.103:0/256433636 shutdown_connections 2020-04-22T14:20:43.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.127+0000 7f1cc8029700 1 --2- 172.21.15.103:0/256433636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1cc0067170 0x7f1cc00b6040 unknown :-1 s=CLOSED pgs=2212 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:43.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.127+0000 7f1cc8029700 1 --2- 172.21.15.103:0/256433636 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cc00ac740 0x7f1cc013c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:43.140 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.127+0000 7f1cc8029700 1 -- 172.21.15.103:0/256433636 >> 172.21.15.103:0/256433636 conn(0x7f1cc00b9160 msgr2=0x7f1cc005ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:43.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.127+0000 7f1cc8029700 1 -- 172.21.15.103:0/256433636 shutdown_connections 2020-04-22T14:20:43.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.127+0000 7f1cc8029700 1 -- 172.21.15.103:0/256433636 wait complete. 2020-04-22T14:20:43.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.128+0000 7f1cc8029700 1 Processor -- start 2020-04-22T14:20:43.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.128+0000 7f1cc8029700 1 -- start start 2020-04-22T14:20:43.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.129+0000 7f1cc8029700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cc013c7e0 0x7f1cc0141a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:43.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.129+0000 7f1cc8029700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc0141150 con 0x7f1cc00ac740 2020-04-22T14:20:43.141 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.129+0000 7f1cc8029700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc01503e0 con 0x7f1cc0067170 2020-04-22T14:20:43.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.129+0000 7f1cc8029700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc013fa70 con 0x7f1cc013c7e0 2020-04-22T14:20:43.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.129+0000 7f1cc5dc5700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f1cc0067170 0x7f1cc013df70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51430/0 (socket says 172.21.15.103:51430) 2020-04-22T14:20:43.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.129+0000 7f1cc5dc5700 1 -- 172.21.15.103:0/801864521 learned_addr learned my addr 172.21.15.103:0/801864521 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:43.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.129+0000 7f1cc65c6700 1 --2- 172.21.15.103:0/801864521 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cc013c7e0 0x7f1cc0141a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:43.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.129+0000 7f1caeffd700 1 -- 172.21.15.103:0/801864521 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2687399226 0 0) 0x7f1cc01503e0 con 0x7f1cc0067170 2020-04-22T14:20:43.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.129+0000 7f1caeffd700 1 -- 172.21.15.103:0/801864521 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ca0002fe0 con 0x7f1cc0067170 2020-04-22T14:20:43.142 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.130+0000 7f1caeffd700 1 -- 172.21.15.103:0/801864521 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2847293990 0 0) 0x7f1ca0002fe0 con 0x7f1cc0067170 2020-04-22T14:20:43.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.130+0000 7f1caeffd700 1 -- 172.21.15.103:0/801864521 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1cc01503e0 con 0x7f1cc0067170 2020-04-22T14:20:43.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.130+0000 7f1caeffd700 1 -- 172.21.15.103:0/801864521 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f1cb0013e80 con 0x7f1cc0067170 2020-04-22T14:20:43.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.130+0000 7f1caeffd700 1 -- 172.21.15.103:0/801864521 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cc013c7e0 msgr2=0x7f1cc0141a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:43.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.130+0000 7f1caeffd700 1 --2- 172.21.15.103:0/801864521 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cc013c7e0 0x7f1cc0141a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:43.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.130+0000 7f1caeffd700 1 -- 172.21.15.103:0/801864521 >> v1:172.21.15.103:6789/0 conn(0x7f1cc0067170 legacy=0x7f1cc013df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:43.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.130+0000 7f1caeffd700 1 -- 172.21.15.103:0/801864521 >> v1:172.21.15.86:6789/0 conn(0x7f1cc00ac740 legacy=0x7f1cc0143580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:43.143 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.130+0000 7f1caeffd700 1 --2- 172.21.15.103:0/801864521 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ca00049b0 0x7f1ca0004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:43.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.130+0000 7f1caeffd700 1 --2- 172.21.15.103:0/801864521 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cc013c7e0 0x7f1ca0003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:43.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.130+0000 7f1caeffd700 1 --2- 172.21.15.103:0/801864521 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ca0003d80 0x7f1ca0004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:43.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.130+0000 7f1caeffd700 1 -- 172.21.15.103:0/801864521 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc013fa70 con 0x7f1ca0003d80 2020-04-22T14:20:43.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.130+0000 7f1caeffd700 1 -- 172.21.15.103:0/801864521 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca0004780 con 0x7f1ca00049b0 2020-04-22T14:20:43.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.130+0000 7f1caeffd700 1 -- 172.21.15.103:0/801864521 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca0005300 con 0x7f1cc013c7e0 2020-04-22T14:20:43.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.130+0000 7f1cc5dc5700 1 --2- 172.21.15.103:0/801864521 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ca00049b0 0x7f1ca0004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:43.144 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.130+0000 7f1cc65c6700 1 --2- 172.21.15.103:0/801864521 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ca0003d80 0x7f1ca0004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:43.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.130+0000 7f1cc55c4700 1 --2- 172.21.15.103:0/801864521 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cc013c7e0 0x7f1ca0003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:43.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.130+0000 7f1cc5dc5700 1 -- 172.21.15.103:0/801864521 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cc013c7e0 msgr2=0x7f1ca0003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:43.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.130+0000 7f1cc5dc5700 1 --2- 172.21.15.103:0/801864521 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cc013c7e0 0x7f1ca0003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:43.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.130+0000 7f1cc5dc5700 1 -- 172.21.15.103:0/801864521 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ca0003d80 msgr2=0x7f1ca0004200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:43.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.130+0000 7f1cc5dc5700 1 --2- 172.21.15.103:0/801864521 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ca0003d80 0x7f1ca0004200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:43.145 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.130+0000 7f1cc5dc5700 1 -- 172.21.15.103:0/801864521 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc013fd10 con 0x7f1ca00049b0 2020-04-22T14:20:43.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.130+0000 7f1cc8029700 1 -- 172.21.15.103:0/801864521 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc013e680 con 0x7f1ca00049b0 2020-04-22T14:20:43.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.130+0000 7f1cc65c6700 1 --2- 172.21.15.103:0/801864521 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ca0003d80 0x7f1ca0004200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:20:43.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.130+0000 7f1cc5dc5700 1 --2- 172.21.15.103:0/801864521 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ca00049b0 0x7f1ca0004d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1cb0008320 tx=0x7f1cb0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.130+0000 7f1cc8029700 1 -- 172.21.15.103:0/801864521 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc0141c40 con 0x7f1ca00049b0 2020-04-22T14:20:43.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.130+0000 7f1cc5dc5700 1 --2- 172.21.15.103:0/801864521 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ca00049b0 0x7f1ca0004d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1cb0008320 tx=0x7f1cb0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.130+0000 7f1cc5dc5700 1 --2- 172.21.15.103:0/801864521 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ca00049b0 0x7f1ca0004d90 secure :-1 s=READY pgs=2214 cs=0 l=1 rx=0x7f1cb0008320 tx=0x7f1cb0007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:43.146 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.130+0000 7f1cc5dc5700 1 --2- 172.21.15.103:0/801864521 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ca00049b0 0x7f1ca0004d90 secure :-1 s=THROTTLE_DONE pgs=2214 cs=0 l=1 rx=0x7f1cb0008320 tx=0x7f1cb0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.130+0000 7f1caeffd700 1 -- 172.21.15.103:0/801864521 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cb0007550 con 0x7f1ca00049b0 2020-04-22T14:20:43.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.130+0000 7f1cc5dc5700 1 --2- 172.21.15.103:0/801864521 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ca00049b0 0x7f1ca0004d90 secure :-1 s=THROTTLE_DONE pgs=2214 cs=0 l=1 rx=0x7f1cb0008320 tx=0x7f1cb0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.130+0000 7f1caeffd700 1 -- 172.21.15.103:0/801864521 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb000aa20 con 0x7f1ca00049b0 2020-04-22T14:20:43.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.130+0000 7f1cc5dc5700 1 --2- 172.21.15.103:0/801864521 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ca00049b0 0x7f1ca0004d90 secure :-1 s=THROTTLE_DONE pgs=2214 cs=0 l=1 rx=0x7f1cb0008320 tx=0x7f1cb0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.130+0000 7f1caeffd700 1 -- 172.21.15.103:0/801864521 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cb000ae40 con 0x7f1ca00049b0 2020-04-22T14:20:43.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.131+0000 7f1cc5dc5700 1 --2- 172.21.15.103:0/801864521 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ca00049b0 0x7f1ca0004d90 secure :-1 s=THROTTLE_DONE pgs=2214 cs=0 l=1 rx=0x7f1cb0008320 tx=0x7f1cb0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.147 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.131+0000 7f1cc8029700 1 -- 172.21.15.103:0/801864521 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cc0056c90 con 0x7f1ca00049b0 2020-04-22T14:20:43.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.131+0000 7f1caeffd700 1 -- 172.21.15.103:0/801864521 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f1cb00056c0 con 0x7f1ca00049b0 2020-04-22T14:20:43.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.131+0000 7f1cc5dc5700 1 --2- 172.21.15.103:0/801864521 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ca00049b0 0x7f1ca0004d90 secure :-1 s=THROTTLE_DONE pgs=2214 cs=0 l=1 rx=0x7f1cb0008320 tx=0x7f1cb0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.132+0000 7f1caeffd700 1 --2- 172.21.15.103:0/801864521 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1ca0055ab0 0x7f1ca0057f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:43.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.132+0000 7f1caeffd700 1 -- 172.21.15.103:0/801864521 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1cb0064600 con 0x7f1ca00049b0 2020-04-22T14:20:43.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.132+0000 7f1cc55c4700 1 --2- 172.21.15.103:0/801864521 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1ca0055ab0 0x7f1ca0057f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:43.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.132+0000 7f1cc55c4700 1 --2- 172.21.15.103:0/801864521 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1ca0055ab0 0x7f1ca0057f70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1cbc007920 tx=0x7f1cbc0068e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.148 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.132+0000 7f1cc55c4700 1 --2- 172.21.15.103:0/801864521 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1ca0055ab0 0x7f1ca0057f70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1cbc007920 tx=0x7f1cbc0068e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.132+0000 7f1cc55c4700 1 --2- 172.21.15.103:0/801864521 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1ca0055ab0 0x7f1ca0057f70 secure :-1 s=READY pgs=803 cs=0 l=1 rx=0x7f1cbc007920 tx=0x7f1cbc0068e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:43.149 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.136+0000 7f1cc5dc5700 1 --2- 172.21.15.103:0/801864521 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ca00049b0 0x7f1ca0004d90 secure :-1 s=THROTTLE_DONE pgs=2214 cs=0 l=1 rx=0x7f1cb0008320 tx=0x7f1cb0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.150 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.136+0000 7f1caeffd700 1 -- 172.21.15.103:0/801864521 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f1cb003fb00 con 0x7f1ca00049b0 2020-04-22T14:20:43.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.279+0000 7f1cc8029700 1 -- 172.21.15.103:0/801864521 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1cc00b40c0 con 0x7f1ca00049b0 2020-04-22T14:20:43.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.280+0000 7f1cc5dc5700 1 --2- 172.21.15.103:0/801864521 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ca00049b0 0x7f1ca0004d90 secure :-1 s=THROTTLE_DONE pgs=2214 cs=0 l=1 rx=0x7f1cb0008320 tx=0x7f1cb0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.280+0000 7f1caeffd700 1 -- 172.21.15.103:0/801864521 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v157) v1 ==== 74+0+16116 (secure 0 0 0) 0x7f1cb0043120 con 0x7f1ca00049b0 2020-04-22T14:20:43.284 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:20:43.285 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":157,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:20:42.935798+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:20:40.847124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2020-04-22T14:20:41.893982+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:20:43.286 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.282+0000 7f1cc8029700 1 -- 172.21.15.103:0/801864521 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1ca0055ab0 msgr2=0x7f1ca0057f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:43.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.282+0000 7f1cc8029700 1 --2- 172.21.15.103:0/801864521 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f1ca0055ab0 0x7f1ca0057f70 secure :-1 s=READY pgs=803 cs=0 l=1 rx=0x7f1cbc007920 tx=0x7f1cbc0068e0).stop 2020-04-22T14:20:43.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.282+0000 7f1cc8029700 1 -- 172.21.15.103:0/801864521 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ca00049b0 msgr2=0x7f1ca0004d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:43.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.282+0000 7f1cc8029700 1 --2- 172.21.15.103:0/801864521 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ca00049b0 0x7f1ca0004d90 secure :-1 s=READY pgs=2214 cs=0 l=1 rx=0x7f1cb0008320 tx=0x7f1cb0007a40).stop 2020-04-22T14:20:43.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.282+0000 7f1cc65c6700 1 -- 172.21.15.103:0/801864521 reap_dead start 2020-04-22T14:20:43.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.282+0000 7f1cc65c6700 1 -- 172.21.15.103:0/801864521 reap_dead start 2020-04-22T14:20:43.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.282+0000 7f1cc8029700 1 -- 172.21.15.103:0/801864521 shutdown_connections 2020-04-22T14:20:43.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.282+0000 7f1cc8029700 1 -- 172.21.15.103:0/801864521 >> 172.21.15.103:0/801864521 conn(0x7f1cc00b9160 msgr2=0x7f1cc013b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:43.289 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.282+0000 7f1cc8029700 1 -- 172.21.15.103:0/801864521 shutdown_connections 2020-04-22T14:20:43.289 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.282+0000 7f1cc8029700 1 -- 172.21.15.103:0/801864521 wait complete. 2020-04-22T14:20:43.297 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:43.311 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:20:43.463 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.459+0000 7f0791742700 1 Processor -- start 2020-04-22T14:20:43.610 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.459+0000 7f0791742700 1 -- start start 2020-04-22T14:20:43.627 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.460+0000 7f0791742700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f078c140320 0x7f078c0ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:43.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.460+0000 7f0791742700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f078c14a740 con 0x7f078c0bd1b0 2020-04-22T14:20:43.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.460+0000 7f0791742700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f078c1462f0 con 0x7f078c14a2b0 2020-04-22T14:20:43.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.460+0000 7f0791742700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f078c146590 con 0x7f078c140320 2020-04-22T14:20:43.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.460+0000 7f078a7fc700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f078c14a2b0 0x7f078c146cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51444/0 (socket says 172.21.15.103:51444) 2020-04-22T14:20:43.628 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.460+0000 7f078a7fc700 1 -- 172.21.15.103:0/450511160 learned_addr learned my addr 172.21.15.103:0/450511160 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:43.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.460+0000 7f078affd700 1 --2- 172.21.15.103:0/450511160 >> v2:172.21.15.86:3300/0 conn(0x7f078c140320 0x7f078c0ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:43.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.460+0000 7f0789ffb700 1 -- 172.21.15.103:0/450511160 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 34861509 0 0) 0x7f078c1462f0 con 0x7f078c14a2b0 2020-04-22T14:20:43.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.460+0000 7f0789ffb700 1 -- 172.21.15.103:0/450511160 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0770003230 con 0x7f078c14a2b0 2020-04-22T14:20:43.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.461+0000 7f0789ffb700 1 -- 172.21.15.103:0/450511160 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 912360895 0 0) 0x7f0770003230 con 0x7f078c14a2b0 2020-04-22T14:20:43.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.461+0000 7f0789ffb700 1 -- 172.21.15.103:0/450511160 >> v2:172.21.15.86:3300/0 conn(0x7f078c140320 msgr2=0x7f078c0ae1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:43.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.461+0000 7f0789ffb700 1 --2- 172.21.15.103:0/450511160 >> v2:172.21.15.86:3300/0 conn(0x7f078c140320 0x7f078c0ae1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:43.629 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.461+0000 7f0789ffb700 1 -- 172.21.15.103:0/450511160 >> v1:172.21.15.86:6789/0 conn(0x7f078c0bd1b0 legacy=0x7f078c0ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:43.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.461+0000 7f0789ffb700 1 -- 172.21.15.103:0/450511160 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f078c146830 con 0x7f078c14a2b0 2020-04-22T14:20:43.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.461+0000 7f0789ffb700 1 -- 172.21.15.103:0/450511160 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f077c0016d0 con 0x7f078c14a2b0 2020-04-22T14:20:43.635 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.461+0000 7f0789ffb700 1 -- 172.21.15.103:0/450511160 >> v1:172.21.15.103:6789/0 conn(0x7f078c14a2b0 legacy=0x7f078c146cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:43.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.461+0000 7f0789ffb700 1 --2- 172.21.15.103:0/450511160 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0770003770 0x7f0770003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:43.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.461+0000 7f0789ffb700 1 --2- 172.21.15.103:0/450511160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07700044d0 0x7f0770004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:43.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.461+0000 7f0789ffb700 1 --2- 172.21.15.103:0/450511160 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0770004db0 0x7f077000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:43.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.461+0000 7f0789ffb700 1 -- 172.21.15.103:0/450511160 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078c146590 con 0x7f0770004db0 2020-04-22T14:20:43.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.461+0000 7f0789ffb700 1 -- 172.21.15.103:0/450511160 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0770005260 con 0x7f07700044d0 2020-04-22T14:20:43.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.461+0000 7f0789ffb700 1 -- 172.21.15.103:0/450511160 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077000bb80 con 0x7f0770003770 2020-04-22T14:20:43.636 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.461+0000 7f078a7fc700 1 --2- 172.21.15.103:0/450511160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07700044d0 0x7f0770004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:43.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.461+0000 7f078affd700 1 --2- 172.21.15.103:0/450511160 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0770003770 0x7f0770003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:43.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.461+0000 7f078b7fe700 1 --2- 172.21.15.103:0/450511160 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0770004db0 0x7f077000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:43.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.461+0000 7f078a7fc700 1 -- 172.21.15.103:0/450511160 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0770003770 msgr2=0x7f0770003b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:43.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.461+0000 7f078a7fc700 1 --2- 172.21.15.103:0/450511160 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0770003770 0x7f0770003b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:43.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.461+0000 7f078a7fc700 1 -- 172.21.15.103:0/450511160 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0770004db0 msgr2=0x7f077000b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:43.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.461+0000 7f078a7fc700 1 --2- 172.21.15.103:0/450511160 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0770004db0 0x7f077000b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:43.637 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.461+0000 7f078a7fc700 1 -- 172.21.15.103:0/450511160 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0770003230 con 0x7f07700044d0 2020-04-22T14:20:43.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.461+0000 7f078b7fe700 1 --2- 172.21.15.103:0/450511160 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0770004db0 0x7f077000b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:20:43.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.461+0000 7f078b7fe700 1 -- 172.21.15.103:0/450511160 reap_dead start 2020-04-22T14:20:43.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.461+0000 7f078a7fc700 1 --2- 172.21.15.103:0/450511160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07700044d0 0x7f0770004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f077c0013e0 tx=0x7f078c143ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.461+0000 7f078a7fc700 1 --2- 172.21.15.103:0/450511160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07700044d0 0x7f0770004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f077c0013e0 tx=0x7f078c143ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.461+0000 7f078a7fc700 1 --2- 172.21.15.103:0/450511160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07700044d0 0x7f0770004950 secure :-1 s=READY pgs=2216 cs=0 l=1 rx=0x7f077c0013e0 tx=0x7f078c143ee0).ready entity=mon.1 client_cookie=9c559dd800879457 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:43.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.461+0000 7f078a7fc700 1 --2- 172.21.15.103:0/450511160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07700044d0 0x7f0770004950 secure :-1 s=THROTTLE_DONE pgs=2216 cs=0 l=1 rx=0x7f077c0013e0 tx=0x7f078c143ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.638 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.461+0000 7f0789ffb700 1 -- 172.21.15.103:0/450511160 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f077c00ee40 con 0x7f07700044d0 2020-04-22T14:20:43.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.461+0000 7f078a7fc700 1 --2- 172.21.15.103:0/450511160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07700044d0 0x7f0770004950 secure :-1 s=THROTTLE_DONE pgs=2216 cs=0 l=1 rx=0x7f077c0013e0 tx=0x7f078c143ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.461+0000 7f0789ffb700 1 -- 172.21.15.103:0/450511160 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077c010da0 con 0x7f07700044d0 2020-04-22T14:20:43.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.461+0000 7f078a7fc700 1 --2- 172.21.15.103:0/450511160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07700044d0 0x7f0770004950 secure :-1 s=THROTTLE_DONE pgs=2216 cs=0 l=1 rx=0x7f077c0013e0 tx=0x7f078c143ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.461+0000 7f0791742700 1 -- 172.21.15.103:0/450511160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07700044d0 msgr2=0x7f0770004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:43.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.461+0000 7f0789ffb700 1 -- 172.21.15.103:0/450511160 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f077c0057d0 con 0x7f07700044d0 2020-04-22T14:20:43.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.461+0000 7f0791742700 1 --2- 172.21.15.103:0/450511160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07700044d0 0x7f0770004950 secure :-1 s=READY pgs=2216 cs=0 l=1 rx=0x7f077c0013e0 tx=0x7f078c143ee0).stop 2020-04-22T14:20:43.639 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.462+0000 7f0791742700 1 -- 172.21.15.103:0/450511160 shutdown_connections 2020-04-22T14:20:43.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.462+0000 7f0791742700 1 --2- 172.21.15.103:0/450511160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07700044d0 0x7f0770004950 unknown :-1 s=CLOSED pgs=2216 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:43.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.462+0000 7f0791742700 1 -- 172.21.15.103:0/450511160 >> 172.21.15.103:0/450511160 conn(0x7f078c05f2c0 msgr2=0x7f078c0bcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:43.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.462+0000 7f0791742700 1 -- 172.21.15.103:0/450511160 shutdown_connections 2020-04-22T14:20:43.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.462+0000 7f0791742700 1 -- 172.21.15.103:0/450511160 wait complete. 2020-04-22T14:20:43.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.463+0000 7f0791742700 1 Processor -- start 2020-04-22T14:20:43.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.463+0000 7f0791742700 1 -- start start 2020-04-22T14:20:43.640 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.464+0000 7f0791742700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f078c141100 0x7f078c144260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:43.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.464+0000 7f0791742700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f078c13c150 0x7f078c13aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:43.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.464+0000 7f0791742700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f078c142a70 con 0x7f07700044d0 2020-04-22T14:20:43.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.464+0000 7f0791742700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f078c13aeb0 con 0x7f078c141100 2020-04-22T14:20:43.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.464+0000 7f0791742700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f078c144920 con 0x7f078c13c150 2020-04-22T14:20:43.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.464+0000 7f078affd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f07700044d0 0x7f078c12b100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51456/0 (socket says 172.21.15.103:51456) 2020-04-22T14:20:43.641 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.464+0000 7f078affd700 1 -- 172.21.15.103:0/915325299 learned_addr learned my addr 172.21.15.103:0/915325299 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:43.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.464+0000 7f078b7fe700 1 --2- 172.21.15.103:0/915325299 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f078c13c150 0x7f078c13aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:43.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.464+0000 7f078a7fc700 1 --2- 172.21.15.103:0/915325299 >> v2:172.21.15.86:3300/0 conn(0x7f078c141100 0x7f078c144260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:43.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.464+0000 7f077bfff700 1 -- 172.21.15.103:0/915325299 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 957708265 0 0) 0x7f078c142a70 con 0x7f07700044d0 2020-04-22T14:20:43.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.464+0000 7f077bfff700 1 -- 172.21.15.103:0/915325299 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0768002fe0 con 0x7f07700044d0 2020-04-22T14:20:43.644 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.464+0000 7f077bfff700 1 -- 172.21.15.103:0/915325299 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 659161299 0 0) 0x7f0768002fe0 con 0x7f07700044d0 2020-04-22T14:20:43.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.464+0000 7f077bfff700 1 -- 172.21.15.103:0/915325299 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f078c142a70 con 0x7f07700044d0 2020-04-22T14:20:43.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.464+0000 7f077bfff700 1 -- 172.21.15.103:0/915325299 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f0780001490 con 0x7f07700044d0 2020-04-22T14:20:43.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.464+0000 7f078a7fc700 1 -- 172.21.15.103:0/915325299 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f078c13c150 msgr2=0x7f078c13aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:43.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.464+0000 7f078a7fc700 1 --2- 172.21.15.103:0/915325299 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f078c13c150 0x7f078c13aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:43.645 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.464+0000 7f078a7fc700 1 -- 172.21.15.103:0/915325299 >> v1:172.21.15.103:6789/0 conn(0x7f07700044d0 legacy=0x7f078c12b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:43.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.464+0000 7f078a7fc700 1 -- 172.21.15.103:0/915325299 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f078c144bc0 con 0x7f078c141100 2020-04-22T14:20:43.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.464+0000 7f078b7fe700 1 --2- 172.21.15.103:0/915325299 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f078c13c150 0x7f078c13aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:20:43.646 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.464+0000 7f078a7fc700 1 --2- 172.21.15.103:0/915325299 >> v2:172.21.15.86:3300/0 conn(0x7f078c141100 0x7f078c144260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f077c0013e0 tx=0x7f078c143ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.464+0000 7f078a7fc700 1 --2- 172.21.15.103:0/915325299 >> v2:172.21.15.86:3300/0 conn(0x7f078c141100 0x7f078c144260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f077c0013e0 tx=0x7f078c143ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.464+0000 7f078a7fc700 1 --2- 172.21.15.103:0/915325299 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f078c141100 0x7f078c144260 secure :-1 s=READY pgs=1154 cs=0 l=1 rx=0x7f077c0013e0 tx=0x7f078c143ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:43.647 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.464+0000 7f078a7fc700 1 --2- 172.21.15.103:0/915325299 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f078c141100 0x7f078c144260 secure :-1 s=THROTTLE_DONE pgs=1154 cs=0 l=1 rx=0x7f077c0013e0 tx=0x7f078c143ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.464+0000 7f077bfff700 1 -- 172.21.15.103:0/915325299 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f077c011e90 con 0x7f078c141100 2020-04-22T14:20:43.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.464+0000 7f078a7fc700 1 --2- 172.21.15.103:0/915325299 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f078c141100 0x7f078c144260 secure :-1 s=THROTTLE_DONE pgs=1154 cs=0 l=1 rx=0x7f077c0013e0 tx=0x7f078c143ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.464+0000 7f0791742700 1 -- 172.21.15.103:0/915325299 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f078c142680 con 0x7f078c141100 2020-04-22T14:20:43.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.464+0000 7f077bfff700 1 -- 172.21.15.103:0/915325299 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077c00ee40 con 0x7f078c141100 2020-04-22T14:20:43.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.464+0000 7f078a7fc700 1 --2- 172.21.15.103:0/915325299 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f078c141100 0x7f078c144260 secure :-1 s=THROTTLE_DONE pgs=1154 cs=0 l=1 rx=0x7f077c0013e0 tx=0x7f078c143ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.464+0000 7f077bfff700 1 -- 172.21.15.103:0/915325299 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f077c00c700 con 0x7f078c141100 2020-04-22T14:20:43.648 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.464+0000 7f0791742700 1 -- 172.21.15.103:0/915325299 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f078c12b9d0 con 0x7f078c141100 2020-04-22T14:20:43.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.465+0000 7f078a7fc700 1 --2- 172.21.15.103:0/915325299 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f078c141100 0x7f078c144260 secure :-1 s=THROTTLE_DONE pgs=1154 cs=0 l=1 rx=0x7f077c0013e0 tx=0x7f078c143ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.465+0000 7f0791742700 1 -- 172.21.15.103:0/915325299 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f078c056c90 con 0x7f078c141100 2020-04-22T14:20:43.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.466+0000 7f077bfff700 1 -- 172.21.15.103:0/915325299 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f077c00c940 con 0x7f078c141100 2020-04-22T14:20:43.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.466+0000 7f078a7fc700 1 --2- 172.21.15.103:0/915325299 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f078c141100 0x7f078c144260 secure :-1 s=THROTTLE_DONE pgs=1154 cs=0 l=1 rx=0x7f077c0013e0 tx=0x7f078c143ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.466+0000 7f077bfff700 1 --2- 172.21.15.103:0/915325299 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f076804dee0 0x7f07680503a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:43.649 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.466+0000 7f077bfff700 1 -- 172.21.15.103:0/915325299 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f077c061170 con 0x7f078c141100 2020-04-22T14:20:43.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.466+0000 7f078affd700 1 --2- 172.21.15.103:0/915325299 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f076804dee0 0x7f07680503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:43.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.466+0000 7f078affd700 1 --2- 172.21.15.103:0/915325299 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f076804dee0 0x7f07680503a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0780007fe0 tx=0x7f0780008240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.466+0000 7f078affd700 1 --2- 172.21.15.103:0/915325299 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f076804dee0 0x7f07680503a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0780007fe0 tx=0x7f0780008240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.466+0000 7f078affd700 1 --2- 172.21.15.103:0/915325299 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f076804dee0 0x7f07680503a0 secure :-1 s=READY pgs=804 cs=0 l=1 rx=0x7f0780007fe0 tx=0x7f0780008240).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:43.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.470+0000 7f078a7fc700 1 --2- 172.21.15.103:0/915325299 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f078c141100 0x7f078c144260 secure :-1 s=THROTTLE_DONE pgs=1154 cs=0 l=1 rx=0x7f077c0013e0 tx=0x7f078c143ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.470+0000 7f077bfff700 1 -- 172.21.15.103:0/915325299 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f077c03c610 con 0x7f078c141100 2020-04-22T14:20:43.650 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.613+0000 7f0791742700 1 -- 172.21.15.103:0/915325299 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f078c061690 con 0x7f078c141100 2020-04-22T14:20:43.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.614+0000 7f078a7fc700 1 --2- 172.21.15.103:0/915325299 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f078c141100 0x7f078c144260 secure :-1 s=THROTTLE_DONE pgs=1154 cs=0 l=1 rx=0x7f077c0013e0 tx=0x7f078c143ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.614+0000 7f077bfff700 1 -- 172.21.15.103:0/915325299 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v157) v1 ==== 74+0+16116 (secure 0 0 0) 0x7f077c03fc30 con 0x7f078c141100 2020-04-22T14:20:43.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.615+0000 7f0791742700 1 -- 172.21.15.103:0/915325299 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f076804dee0 msgr2=0x7f07680503a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:43.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.615+0000 7f0791742700 1 --2- 172.21.15.103:0/915325299 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f076804dee0 0x7f07680503a0 secure :-1 s=READY pgs=804 cs=0 l=1 rx=0x7f0780007fe0 tx=0x7f0780008240).stop 2020-04-22T14:20:43.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.615+0000 7f0791742700 1 -- 172.21.15.103:0/915325299 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f078c141100 msgr2=0x7f078c144260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:43.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.615+0000 7f0791742700 1 --2- 172.21.15.103:0/915325299 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f078c141100 0x7f078c144260 secure :-1 s=READY pgs=1154 cs=0 l=1 rx=0x7f077c0013e0 tx=0x7f078c143ee0).stop 2020-04-22T14:20:43.651 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.615+0000 7f0791742700 1 -- 172.21.15.103:0/915325299 shutdown_connections 2020-04-22T14:20:43.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.615+0000 7f0791742700 1 --2- 172.21.15.103:0/915325299 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f078c13c150 0x7f078c13aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:43.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.615+0000 7f0791742700 1 --2- 172.21.15.103:0/915325299 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f076804dee0 0x7f07680503a0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:43.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.615+0000 7f0791742700 1 --2- 172.21.15.103:0/915325299 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f078c141100 0x7f078c144260 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:43.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.615+0000 7f0791742700 1 -- 172.21.15.103:0/915325299 >> 172.21.15.103:0/915325299 conn(0x7f078c05f2c0 msgr2=0x7f078c1437d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:43.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.615+0000 7f0791742700 1 -- 172.21.15.103:0/915325299 shutdown_connections 2020-04-22T14:20:43.652 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.616+0000 7f0791742700 1 -- 172.21.15.103:0/915325299 wait complete. 2020-04-22T14:20:43.653 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:20:43.653 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":157,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:20:42.935798+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:20:40.847124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2020-04-22T14:20:41.893982+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:20:43.655 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:43.668 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-04-22T14:20:43.817 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.814+0000 7f8358f78700 1 Processor -- start 2020-04-22T14:20:43.818 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.814+0000 7f8358f78700 1 -- start start 2020-04-22T14:20:43.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.815+0000 7f8358f78700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f83540ac950 0x7f8354146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:43.824 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.815+0000 7f8358f78700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83541467e0 con 0x7f83541470a0 2020-04-22T14:20:43.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.815+0000 7f8358f78700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8354060050 con 0x7f83540b9140 2020-04-22T14:20:43.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.815+0000 7f8358f78700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8354147530 con 0x7f83540ac950 2020-04-22T14:20:43.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.815+0000 7f835259c700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f83540b9140 0x7f835412b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51464/0 (socket says 172.21.15.103:51464) 2020-04-22T14:20:43.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.815+0000 7f835259c700 1 -- 172.21.15.103:0/401943474 learned_addr learned my addr 172.21.15.103:0/401943474 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:43.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.815+0000 7f835159a700 1 -- 172.21.15.103:0/401943474 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1582542518 0 0) 0x7f8354060050 con 0x7f83540b9140 2020-04-22T14:20:43.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.815+0000 7f835159a700 1 -- 172.21.15.103:0/401943474 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8338003230 con 0x7f83540b9140 2020-04-22T14:20:43.825 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.815+0000 7f8351d9b700 1 --2- 172.21.15.103:0/401943474 >> v2:172.21.15.86:3300/0 conn(0x7f83540ac950 0x7f8354146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:43.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.816+0000 7f835159a700 1 -- 172.21.15.103:0/401943474 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3766059097 0 0) 0x7f8338003230 con 0x7f83540b9140 2020-04-22T14:20:43.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.816+0000 7f835159a700 1 -- 172.21.15.103:0/401943474 >> v2:172.21.15.86:3300/0 conn(0x7f83540ac950 msgr2=0x7f8354146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:43.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.816+0000 7f835159a700 1 --2- 172.21.15.103:0/401943474 >> v2:172.21.15.86:3300/0 conn(0x7f83540ac950 0x7f8354146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:43.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.816+0000 7f835159a700 1 -- 172.21.15.103:0/401943474 >> v1:172.21.15.86:6789/0 conn(0x7f83541470a0 legacy=0x7f8354143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:43.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.816+0000 7f835159a700 1 -- 172.21.15.103:0/401943474 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83540b9520 con 0x7f83540b9140 2020-04-22T14:20:43.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.816+0000 7f835159a700 1 -- 172.21.15.103:0/401943474 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f8348001710 con 0x7f83540b9140 2020-04-22T14:20:43.826 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.816+0000 7f835159a700 1 -- 172.21.15.103:0/401943474 >> v1:172.21.15.103:6789/0 conn(0x7f83540b9140 legacy=0x7f835412b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:43.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.816+0000 7f835159a700 1 --2- 172.21.15.103:0/401943474 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8338003720 0x7f8338003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:43.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.816+0000 7f835159a700 1 --2- 172.21.15.103:0/401943474 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83380044d0 0x7f8338004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:43.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.816+0000 7f835159a700 1 --2- 172.21.15.103:0/401943474 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8338004db0 0x7f833800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:43.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.816+0000 7f835159a700 1 -- 172.21.15.103:0/401943474 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83380041c0 con 0x7f8338004db0 2020-04-22T14:20:43.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.816+0000 7f835159a700 1 -- 172.21.15.103:0/401943474 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8338004330 con 0x7f8338003720 2020-04-22T14:20:43.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.816+0000 7f835159a700 1 -- 172.21.15.103:0/401943474 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f833800bbd0 con 0x7f83380044d0 2020-04-22T14:20:43.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.816+0000 7f835259c700 1 --2- 172.21.15.103:0/401943474 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8338003720 0x7f8338003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:43.827 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.816+0000 7f8352d9d700 1 --2- 172.21.15.103:0/401943474 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8338004db0 0x7f833800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:43.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.816+0000 7f8351d9b700 1 --2- 172.21.15.103:0/401943474 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83380044d0 0x7f8338004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:43.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.816+0000 7f835259c700 1 -- 172.21.15.103:0/401943474 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83380044d0 msgr2=0x7f8338004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:43.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.816+0000 7f835259c700 1 --2- 172.21.15.103:0/401943474 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83380044d0 0x7f8338004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:43.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.816+0000 7f835259c700 1 -- 172.21.15.103:0/401943474 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8338004db0 msgr2=0x7f833800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:43.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.816+0000 7f835259c700 1 --2- 172.21.15.103:0/401943474 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8338004db0 0x7f833800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:43.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.816+0000 7f835259c700 1 -- 172.21.15.103:0/401943474 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8338003230 con 0x7f8338003720 2020-04-22T14:20:43.828 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.816+0000 7f8351d9b700 1 --2- 172.21.15.103:0/401943474 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83380044d0 0x7f8338004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:20:43.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.816+0000 7f8352d9d700 1 --2- 172.21.15.103:0/401943474 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8338004db0 0x7f833800b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:20:43.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.816+0000 7f8352d9d700 1 -- 172.21.15.103:0/401943474 reap_dead start 2020-04-22T14:20:43.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.816+0000 7f835259c700 1 --2- 172.21.15.103:0/401943474 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8338003720 0x7f8338003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8348001420 tx=0x7f83540b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.816+0000 7f835259c700 1 --2- 172.21.15.103:0/401943474 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8338003720 0x7f8338003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8348001420 tx=0x7f83540b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.816+0000 7f835259c700 1 --2- 172.21.15.103:0/401943474 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8338003720 0x7f8338003b40 secure :-1 s=READY pgs=2219 cs=0 l=1 rx=0x7f8348001420 tx=0x7f83540b96b0).ready entity=mon.1 client_cookie=22a5851236f1540a server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:43.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.816+0000 7f835259c700 1 --2- 172.21.15.103:0/401943474 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8338003720 0x7f8338003b40 secure :-1 s=THROTTLE_DONE pgs=2219 cs=0 l=1 rx=0x7f8348001420 tx=0x7f83540b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.829 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.816+0000 7f835159a700 1 -- 172.21.15.103:0/401943474 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8348010370 con 0x7f8338003720 2020-04-22T14:20:43.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.816+0000 7f835259c700 1 --2- 172.21.15.103:0/401943474 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8338003720 0x7f8338003b40 secure :-1 s=THROTTLE_DONE pgs=2219 cs=0 l=1 rx=0x7f8348001420 tx=0x7f83540b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.816+0000 7f835259c700 1 --2- 172.21.15.103:0/401943474 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8338003720 0x7f8338003b40 secure :-1 s=THROTTLE_DONE pgs=2219 cs=0 l=1 rx=0x7f8348001420 tx=0x7f83540b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.816+0000 7f835159a700 1 -- 172.21.15.103:0/401943474 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8348010570 con 0x7f8338003720 2020-04-22T14:20:43.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.816+0000 7f835159a700 1 -- 172.21.15.103:0/401943474 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83480055e0 con 0x7f8338003720 2020-04-22T14:20:43.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.816+0000 7f8358f78700 1 -- 172.21.15.103:0/401943474 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8338003720 msgr2=0x7f8338003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:43.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.816+0000 7f8358f78700 1 --2- 172.21.15.103:0/401943474 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8338003720 0x7f8338003b40 secure :-1 s=READY pgs=2219 cs=0 l=1 rx=0x7f8348001420 tx=0x7f83540b96b0).stop 2020-04-22T14:20:43.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.817+0000 7f8358f78700 1 -- 172.21.15.103:0/401943474 shutdown_connections 2020-04-22T14:20:43.830 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.817+0000 7f8358f78700 1 --2- 172.21.15.103:0/401943474 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8338003720 0x7f8338003b40 unknown :-1 s=CLOSED pgs=2219 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:43.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.817+0000 7f8358f78700 1 -- 172.21.15.103:0/401943474 >> 172.21.15.103:0/401943474 conn(0x7f835405b7b0 msgr2=0x7f83540b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:43.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.817+0000 7f8358f78700 1 -- 172.21.15.103:0/401943474 shutdown_connections 2020-04-22T14:20:43.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.817+0000 7f8358f78700 1 -- 172.21.15.103:0/401943474 wait complete. 2020-04-22T14:20:43.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.818+0000 7f8358f78700 1 Processor -- start 2020-04-22T14:20:43.831 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.818+0000 7f8358f78700 1 -- start start 2020-04-22T14:20:43.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.818+0000 7f8358f78700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8338003720 0x7f8354155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:43.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.819+0000 7f8358f78700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83541510d0 0x7f8354062520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:43.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.819+0000 7f8358f78700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83541519f0 con 0x7f83540b54e0 2020-04-22T14:20:43.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.819+0000 7f8358f78700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83541559e0 con 0x7f8338003720 2020-04-22T14:20:43.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.819+0000 7f8358f78700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8354151c90 con 0x7f83541510d0 2020-04-22T14:20:43.832 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.819+0000 7f8352d9d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83541510d0 0x7f8354062520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:43.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.819+0000 7f835259c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8338003720 0x7f8354155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:43.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.819+0000 7f8352d9d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83541510d0 0x7f8354062520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:44066/0 (socket says 172.21.15.103:44066) 2020-04-22T14:20:43.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.819+0000 7f8351d9b700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f83540b54e0 0x7f83541509c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.103:40400/0 (socket says 172.21.15.103:40400) 2020-04-22T14:20:43.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.819+0000 7f8352d9d700 1 -- 172.21.15.103:0/3430576044 learned_addr learned my addr 172.21.15.103:0/3430576044 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:43.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.819+0000 7f835259c700 1 -- 172.21.15.103:0/3430576044 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83541510d0 msgr2=0x7f8354062520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:43.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.819+0000 7f835259c700 1 --2- 172.21.15.103:0/3430576044 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83541510d0 0x7f8354062520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:43.833 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.819+0000 7f835259c700 1 -- 172.21.15.103:0/3430576044 >> v1:172.21.15.86:6789/0 conn(0x7f83540b54e0 legacy=0x7f83541509c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:43.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.819+0000 7f835259c700 1 -- 172.21.15.103:0/3430576044 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8354151f30 con 0x7f8338003720 2020-04-22T14:20:43.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.819+0000 7f83437fe700 1 -- 172.21.15.103:0/3430576044 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3204268130 0 0) 0x7f83541519f0 con 0x7f83540b54e0 2020-04-22T14:20:43.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.819+0000 7f835259c700 1 --2- 172.21.15.103:0/3430576044 >> v2:172.21.15.86:3300/0 conn(0x7f8338003720 0x7f8354155580 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8348001420 tx=0x7f83540b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.819+0000 7f835259c700 1 --2- 172.21.15.103:0/3430576044 >> v2:172.21.15.86:3300/0 conn(0x7f8338003720 0x7f8354155580 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8348001420 tx=0x7f83540b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.819+0000 7f835259c700 1 --2- 172.21.15.103:0/3430576044 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8338003720 0x7f8354155580 secure :-1 s=READY pgs=1157 cs=0 l=1 rx=0x7f8348001420 tx=0x7f83540b96b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:43.834 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.819+0000 7f835259c700 1 --2- 172.21.15.103:0/3430576044 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8338003720 0x7f8354155580 secure :-1 s=THROTTLE_DONE pgs=1157 cs=0 l=1 rx=0x7f8348001420 tx=0x7f83540b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.819+0000 7f83437fe700 1 -- 172.21.15.103:0/3430576044 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f834800c420 con 0x7f8338003720 2020-04-22T14:20:43.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.819+0000 7f835259c700 1 --2- 172.21.15.103:0/3430576044 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8338003720 0x7f8354155580 secure :-1 s=THROTTLE_DONE pgs=1157 cs=0 l=1 rx=0x7f8348001420 tx=0x7f83540b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.819+0000 7f835259c700 1 --2- 172.21.15.103:0/3430576044 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8338003720 0x7f8354155580 secure :-1 s=THROTTLE_DONE pgs=1157 cs=0 l=1 rx=0x7f8348001420 tx=0x7f83540b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.819+0000 7f83437fe700 1 -- 172.21.15.103:0/3430576044 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8348000e90 con 0x7f8338003720 2020-04-22T14:20:43.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.819+0000 7f83437fe700 1 -- 172.21.15.103:0/3430576044 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8348004ba0 con 0x7f8338003720 2020-04-22T14:20:43.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.819+0000 7f8358f78700 1 -- 172.21.15.103:0/3430576044 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83541523d0 con 0x7f8338003720 2020-04-22T14:20:43.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.819+0000 7f8358f78700 1 -- 172.21.15.103:0/3430576044 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8354151560 con 0x7f8338003720 2020-04-22T14:20:43.835 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.820+0000 7f835259c700 1 --2- 172.21.15.103:0/3430576044 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8338003720 0x7f8354155580 secure :-1 s=THROTTLE_DONE pgs=1157 cs=0 l=1 rx=0x7f8348001420 tx=0x7f83540b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.821+0000 7f8358f78700 1 -- 172.21.15.103:0/3430576044 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83541520c0 con 0x7f8338003720 2020-04-22T14:20:43.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.821+0000 7f83437fe700 1 -- 172.21.15.103:0/3430576044 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f8348004d00 con 0x7f8338003720 2020-04-22T14:20:43.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.821+0000 7f835259c700 1 --2- 172.21.15.103:0/3430576044 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8338003720 0x7f8354155580 secure :-1 s=THROTTLE_DONE pgs=1157 cs=0 l=1 rx=0x7f8348001420 tx=0x7f83540b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.821+0000 7f83437fe700 1 --2- 172.21.15.103:0/3430576044 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f833004d8b0 0x7f833004fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:43.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.821+0000 7f83437fe700 1 -- 172.21.15.103:0/3430576044 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8348061c20 con 0x7f8338003720 2020-04-22T14:20:43.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.821+0000 7f8351d9b700 1 --2- 172.21.15.103:0/3430576044 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f833004d8b0 0x7f833004fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:43.836 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.821+0000 7f8351d9b700 1 --2- 172.21.15.103:0/3430576044 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f833004d8b0 0x7f833004fd70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8344002ed0 tx=0x7f834400c8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.821+0000 7f8351d9b700 1 --2- 172.21.15.103:0/3430576044 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f833004d8b0 0x7f833004fd70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8344002ed0 tx=0x7f834400c8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.821+0000 7f8351d9b700 1 --2- 172.21.15.103:0/3430576044 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f833004d8b0 0x7f833004fd70 secure :-1 s=READY pgs=805 cs=0 l=1 rx=0x7f8344002ed0 tx=0x7f834400c8d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:43.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.824+0000 7f835259c700 1 --2- 172.21.15.103:0/3430576044 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8338003720 0x7f8354155580 secure :-1 s=THROTTLE_DONE pgs=1157 cs=0 l=1 rx=0x7f8348001420 tx=0x7f83540b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:43.837 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:43.824+0000 7f83437fe700 1 -- 172.21.15.103:0/3430576044 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f834803d0c0 con 0x7f8338003720 2020-04-22T14:20:44.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:44.017+0000 7f8358f78700 1 -- 172.21.15.103:0/3430576044 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8354056c90 con 0x7f8338003720 2020-04-22T14:20:44.822 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:44.819+0000 7f835259c700 1 --2- 172.21.15.103:0/3430576044 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8338003720 0x7f8354155580 secure :-1 s=READY pgs=1157 cs=0 l=1 rx=0x7f8348001420 tx=0x7f83540b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:44.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:44.954+0000 7f835259c700 1 --2- 172.21.15.103:0/3430576044 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8338003720 0x7f8354155580 secure :-1 s=THROTTLE_DONE pgs=1157 cs=0 l=1 rx=0x7f8348001420 tx=0x7f83540b96b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:44.957 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:44.954+0000 7f83437fe700 1 -- 172.21.15.103:0/3430576044 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v121) v1 ==== 118+0+0 (secure 0 0 0) 0x7f83480406e0 con 0x7f8338003720 2020-04-22T14:20:44.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:44.956+0000 7f8358f78700 1 -- 172.21.15.103:0/3430576044 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f833004d8b0 msgr2=0x7f833004fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:44.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:44.956+0000 7f8358f78700 1 --2- 172.21.15.103:0/3430576044 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f833004d8b0 0x7f833004fd70 secure :-1 s=READY pgs=805 cs=0 l=1 rx=0x7f8344002ed0 tx=0x7f834400c8d0).stop 2020-04-22T14:20:44.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:44.956+0000 7f8358f78700 1 -- 172.21.15.103:0/3430576044 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8338003720 msgr2=0x7f8354155580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:44.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:44.956+0000 7f8358f78700 1 --2- 172.21.15.103:0/3430576044 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8338003720 0x7f8354155580 secure :-1 s=READY pgs=1157 cs=0 l=1 rx=0x7f8348001420 tx=0x7f83540b96b0).stop 2020-04-22T14:20:44.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:44.956+0000 7f8358f78700 1 -- 172.21.15.103:0/3430576044 shutdown_connections 2020-04-22T14:20:44.960 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:44.956+0000 7f8358f78700 1 --2- 172.21.15.103:0/3430576044 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83541510d0 0x7f8354062520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:44.961 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:44.956+0000 7f8358f78700 1 --2- 172.21.15.103:0/3430576044 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f833004d8b0 0x7f833004fd70 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:44.961 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:44.956+0000 7f8358f78700 1 --2- 172.21.15.103:0/3430576044 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8338003720 0x7f8354155580 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:44.961 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:44.956+0000 7f8358f78700 1 -- 172.21.15.103:0/3430576044 >> 172.21.15.103:0/3430576044 conn(0x7f835405b7b0 msgr2=0x7f8354129570 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:44.961 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:44.956+0000 7f8358f78700 1 -- 172.21.15.103:0/3430576044 shutdown_connections 2020-04-22T14:20:44.968 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:44.956+0000 7f8358f78700 1 -- 172.21.15.103:0/3430576044 wait complete. 2020-04-22T14:20:44.973 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:45.008 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:20:45.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.155+0000 7ffacb77e700 1 Processor -- start 2020-04-22T14:20:45.159 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.156+0000 7ffacb77e700 1 -- start start 2020-04-22T14:20:45.166 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.156+0000 7ffacb77e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ffac412c0d0 0x7ffac41464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:45.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.156+0000 7ffacb77e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffac4063e30 0x7ffac40642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:45.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.156+0000 7ffacb77e700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffac4143300 con 0x7ffac4065fe0 2020-04-22T14:20:45.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.156+0000 7ffacb77e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffac41435a0 con 0x7ffac412c0d0 2020-04-22T14:20:45.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.156+0000 7ffacb77e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffac4143840 con 0x7ffac4063e30 2020-04-22T14:20:45.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.157+0000 7ffac9d1b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffac4063e30 0x7ffac40642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:45.167 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.157+0000 7ffac9d1b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffac4063e30 0x7ffac40642c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59296/0 (socket says 172.21.15.103:59296) 2020-04-22T14:20:45.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.157+0000 7ffac9d1b700 1 -- 172.21.15.103:0/2630350927 learned_addr learned my addr 172.21.15.103:0/2630350927 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:45.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.157+0000 7ffac951a700 1 --2- 172.21.15.103:0/2630350927 >> v2:172.21.15.86:3300/0 conn(0x7ffac412c0d0 0x7ffac41464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:45.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.157+0000 7ffac9d1b700 1 -- 172.21.15.103:0/2630350927 >> v2:172.21.15.86:3300/0 conn(0x7ffac412c0d0 msgr2=0x7ffac41464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:45.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.157+0000 7ffac9d1b700 1 --2- 172.21.15.103:0/2630350927 >> v2:172.21.15.86:3300/0 conn(0x7ffac412c0d0 0x7ffac41464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:45.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.157+0000 7ffac9d1b700 1 -- 172.21.15.103:0/2630350927 >> v1:172.21.15.86:6789/0 conn(0x7ffac4065fe0 legacy=0x7ffac405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:45.168 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.157+0000 7ffac9d1b700 1 -- 172.21.15.103:0/2630350927 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac405bb50 con 0x7ffac4063e30 2020-04-22T14:20:45.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.157+0000 7ffac9d1b700 1 --2- 172.21.15.103:0/2630350927 >> v2:172.21.15.103:3300/0 conn(0x7ffac4063e30 0x7ffac40642c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ffac40669a0 tx=0x7ffabc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.157+0000 7ffac9d1b700 1 --2- 172.21.15.103:0/2630350927 >> v2:172.21.15.103:3300/0 conn(0x7ffac4063e30 0x7ffac40642c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ffac40669a0 tx=0x7ffabc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.157+0000 7ffac9d1b700 1 --2- 172.21.15.103:0/2630350927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffac4063e30 0x7ffac40642c0 secure :-1 s=READY pgs=2220 cs=0 l=1 rx=0x7ffac40669a0 tx=0x7ffabc007dc0).ready entity=mon.1 client_cookie=bd6ebb63ebe92668 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:45.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.157+0000 7ffac9d1b700 1 --2- 172.21.15.103:0/2630350927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffac4063e30 0x7ffac40642c0 secure :-1 s=THROTTLE_DONE pgs=2220 cs=0 l=1 rx=0x7ffac40669a0 tx=0x7ffabc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.157+0000 7ffab3fff700 1 -- 172.21.15.103:0/2630350927 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffabc00a180 con 0x7ffac4063e30 2020-04-22T14:20:45.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.157+0000 7ffac9d1b700 1 --2- 172.21.15.103:0/2630350927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffac4063e30 0x7ffac40642c0 secure :-1 s=THROTTLE_DONE pgs=2220 cs=0 l=1 rx=0x7ffac40669a0 tx=0x7ffabc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.169 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.157+0000 7ffab3fff700 1 -- 172.21.15.103:0/2630350927 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffabc00a2e0 con 0x7ffac4063e30 2020-04-22T14:20:45.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.157+0000 7ffac9d1b700 1 --2- 172.21.15.103:0/2630350927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffac4063e30 0x7ffac40642c0 secure :-1 s=THROTTLE_DONE pgs=2220 cs=0 l=1 rx=0x7ffac40669a0 tx=0x7ffabc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.157+0000 7ffab3fff700 1 -- 172.21.15.103:0/2630350927 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffabc00a6c0 con 0x7ffac4063e30 2020-04-22T14:20:45.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.157+0000 7ffacb77e700 1 -- 172.21.15.103:0/2630350927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffac4063e30 msgr2=0x7ffac40642c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:45.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.157+0000 7ffacb77e700 1 --2- 172.21.15.103:0/2630350927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffac4063e30 0x7ffac40642c0 secure :-1 s=READY pgs=2220 cs=0 l=1 rx=0x7ffac40669a0 tx=0x7ffabc007dc0).stop 2020-04-22T14:20:45.170 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.158+0000 7ffacb77e700 1 -- 172.21.15.103:0/2630350927 shutdown_connections 2020-04-22T14:20:45.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.158+0000 7ffacb77e700 1 --2- 172.21.15.103:0/2630350927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffac4063e30 0x7ffac40642c0 unknown :-1 s=CLOSED pgs=2220 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:45.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.158+0000 7ffacb77e700 1 --2- 172.21.15.103:0/2630350927 >> v2:172.21.15.86:3300/0 conn(0x7ffac412c0d0 0x7ffac41464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:45.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.158+0000 7ffacb77e700 1 -- 172.21.15.103:0/2630350927 >> 172.21.15.103:0/2630350927 conn(0x7ffac40b9160 msgr2=0x7ffac405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:45.171 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.158+0000 7ffacb77e700 1 -- 172.21.15.103:0/2630350927 shutdown_connections 2020-04-22T14:20:45.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.158+0000 7ffacb77e700 1 -- 172.21.15.103:0/2630350927 wait complete. 2020-04-22T14:20:45.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.159+0000 7ffacb77e700 1 Processor -- start 2020-04-22T14:20:45.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.159+0000 7ffacb77e700 1 -- start start 2020-04-22T14:20:45.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.159+0000 7ffacb77e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffac4063e30 0x7ffac40b5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:45.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.159+0000 7ffacb77e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffac4065fe0 0x7ffac40b4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:45.172 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.159+0000 7ffacb77e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ffac412c0d0 0x7ffac40b1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:45.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.159+0000 7ffacb77e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffac40b4670 con 0x7ffac412c0d0 2020-04-22T14:20:45.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.159+0000 7ffacb77e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffac40b3860 con 0x7ffac4065fe0 2020-04-22T14:20:45.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.159+0000 7ffacb77e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac40ac8c0 con 0x7ffac4063e30 2020-04-22T14:20:45.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.159+0000 7ffac8d19700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffac4065fe0 0x7ffac40b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:45.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.159+0000 7ffac8d19700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffac4065fe0 0x7ffac40b4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59300/0 (socket says 172.21.15.103:59300) 2020-04-22T14:20:45.173 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.159+0000 7ffac8d19700 1 -- 172.21.15.103:0/746807821 learned_addr learned my addr 172.21.15.103:0/746807821 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:45.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.160+0000 7ffac9d1b700 1 --2- 172.21.15.103:0/746807821 >> v2:172.21.15.86:3300/0 conn(0x7ffac412c0d0 0x7ffac40b1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:45.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.160+0000 7ffac8d19700 1 -- 172.21.15.103:0/746807821 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffac4063e30 msgr2=0x7ffac40b5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:45.174 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.160+0000 7ffac8d19700 1 --2- 172.21.15.103:0/746807821 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffac4063e30 0x7ffac40b5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:45.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.160+0000 7ffac8d19700 1 -- 172.21.15.103:0/746807821 >> v2:172.21.15.86:3300/0 conn(0x7ffac412c0d0 msgr2=0x7ffac40b1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:45.175 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.160+0000 7ffac8d19700 1 --2- 172.21.15.103:0/746807821 >> v2:172.21.15.86:3300/0 conn(0x7ffac412c0d0 0x7ffac40b1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:45.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.160+0000 7ffac8d19700 1 -- 172.21.15.103:0/746807821 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac40b5a10 con 0x7ffac4065fe0 2020-04-22T14:20:45.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.160+0000 7ffac8d19700 1 --2- 172.21.15.103:0/746807821 >> v2:172.21.15.103:3300/0 conn(0x7ffac4065fe0 0x7ffac40b4210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffac0002f40 tx=0x7ffac0010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.160+0000 7ffac8d19700 1 --2- 172.21.15.103:0/746807821 >> v2:172.21.15.103:3300/0 conn(0x7ffac4065fe0 0x7ffac40b4210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffac0002f40 tx=0x7ffac0010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.160+0000 7ffac8d19700 1 --2- 172.21.15.103:0/746807821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffac4065fe0 0x7ffac40b4210 secure :-1 s=READY pgs=2221 cs=0 l=1 rx=0x7ffac0002f40 tx=0x7ffac0010990).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:45.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.160+0000 7ffac8d19700 1 --2- 172.21.15.103:0/746807821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffac4065fe0 0x7ffac40b4210 secure :-1 s=THROTTLE_DONE pgs=2221 cs=0 l=1 rx=0x7ffac0002f40 tx=0x7ffac0010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.160+0000 7ffac8d19700 1 --2- 172.21.15.103:0/746807821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffac4065fe0 0x7ffac40b4210 secure :-1 s=THROTTLE_DONE pgs=2221 cs=0 l=1 rx=0x7ffac0002f40 tx=0x7ffac0010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.176 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.160+0000 7ffac8d19700 1 --2- 172.21.15.103:0/746807821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffac4065fe0 0x7ffac40b4210 secure :-1 s=THROTTLE_DONE pgs=2221 cs=0 l=1 rx=0x7ffac0002f40 tx=0x7ffac0010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.160+0000 7ffab27fc700 1 -- 172.21.15.103:0/746807821 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffac0008d30 con 0x7ffac4065fe0 2020-04-22T14:20:45.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.160+0000 7ffab27fc700 1 -- 172.21.15.103:0/746807821 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac0008e90 con 0x7ffac4065fe0 2020-04-22T14:20:45.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.160+0000 7ffacb77e700 1 -- 172.21.15.103:0/746807821 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffac40b33a0 con 0x7ffac4065fe0 2020-04-22T14:20:45.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.160+0000 7ffab27fc700 1 -- 172.21.15.103:0/746807821 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffac0012520 con 0x7ffac4065fe0 2020-04-22T14:20:45.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.160+0000 7ffacb77e700 1 -- 172.21.15.103:0/746807821 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffac40b1c40 con 0x7ffac4065fe0 2020-04-22T14:20:45.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.161+0000 7ffac8d19700 1 --2- 172.21.15.103:0/746807821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffac4065fe0 0x7ffac40b4210 secure :-1 s=THROTTLE_DONE pgs=2221 cs=0 l=1 rx=0x7ffac0002f40 tx=0x7ffac0010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.161+0000 7ffab27fc700 1 -- 172.21.15.103:0/746807821 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ffac0012750 con 0x7ffac4065fe0 2020-04-22T14:20:45.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.161+0000 7ffac8d19700 1 --2- 172.21.15.103:0/746807821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffac4065fe0 0x7ffac40b4210 secure :-1 s=THROTTLE_DONE pgs=2221 cs=0 l=1 rx=0x7ffac0002f40 tx=0x7ffac0010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.161+0000 7ffacb77e700 1 -- 172.21.15.103:0/746807821 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffac40b3650 con 0x7ffac4065fe0 2020-04-22T14:20:45.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.161+0000 7ffab27fc700 1 --2- 172.21.15.103:0/746807821 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffaa404da30 0x7ffaa404fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:45.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.161+0000 7ffab27fc700 1 -- 172.21.15.103:0/746807821 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ffac00610a0 con 0x7ffac4065fe0 2020-04-22T14:20:45.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.162+0000 7ffac951a700 1 --2- 172.21.15.103:0/746807821 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffaa404da30 0x7ffaa404fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:45.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.162+0000 7ffac951a700 1 --2- 172.21.15.103:0/746807821 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffaa404da30 0x7ffaa404fef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffab4002f30 tx=0x7ffab4007c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.178 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.162+0000 7ffac951a700 1 --2- 172.21.15.103:0/746807821 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffaa404da30 0x7ffaa404fef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffab4002f30 tx=0x7ffab4007c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.162+0000 7ffac951a700 1 --2- 172.21.15.103:0/746807821 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffaa404da30 0x7ffaa404fef0 secure :-1 s=READY pgs=806 cs=0 l=1 rx=0x7ffab4002f30 tx=0x7ffab4007c20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:45.179 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.166+0000 7ffac8d19700 1 --2- 172.21.15.103:0/746807821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffac4065fe0 0x7ffac40b4210 secure :-1 s=THROTTLE_DONE pgs=2221 cs=0 l=1 rx=0x7ffac0002f40 tx=0x7ffac0010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.180 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.166+0000 7ffab27fc700 1 -- 172.21.15.103:0/746807821 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ffac003c4e0 con 0x7ffac4065fe0 2020-04-22T14:20:45.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.352+0000 7ffacb77e700 1 -- 172.21.15.103:0/746807821 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffac4056c90 con 0x7ffac4065fe0 2020-04-22T14:20:45.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.353+0000 7ffac8d19700 1 --2- 172.21.15.103:0/746807821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffac4065fe0 0x7ffac40b4210 secure :-1 s=THROTTLE_DONE pgs=2221 cs=0 l=1 rx=0x7ffac0002f40 tx=0x7ffac0010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.356 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.353+0000 7ffab27fc700 1 -- 172.21.15.103:0/746807821 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 121 v121) v1 ==== 95+0+2149 (secure 0 0 0) 0x7ffac003fb00 con 0x7ffac4065fe0 2020-04-22T14:20:45.357 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:20:45.357 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":121,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6962,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2216876181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2216876181},{"type":"v1","addr":"172.21.15.86:6835","nonce":2216876181}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":117}],"filesystems":[{"mdsmap":{"epoch":121,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:20:42.936004+0000","modified":"2020-04-22T14:20:44.952601+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10201},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10201":{"gid":10201,"name":"a","rank":0,"incarnation":118,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/591150745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":591150745},{"type":"v1","addr":"172.21.15.103:6833","nonce":591150745}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2020-04-22T14:20:45.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.354+0000 7ffacb77e700 1 -- 172.21.15.103:0/746807821 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffaa404da30 msgr2=0x7ffaa404fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:45.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.354+0000 7ffacb77e700 1 --2- 172.21.15.103:0/746807821 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffaa404da30 0x7ffaa404fef0 secure :-1 s=READY pgs=806 cs=0 l=1 rx=0x7ffab4002f30 tx=0x7ffab4007c20).stop 2020-04-22T14:20:45.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.354+0000 7ffacb77e700 1 -- 172.21.15.103:0/746807821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffac4065fe0 msgr2=0x7ffac40b4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:45.358 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.354+0000 7ffacb77e700 1 --2- 172.21.15.103:0/746807821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffac4065fe0 0x7ffac40b4210 secure :-1 s=READY pgs=2221 cs=0 l=1 rx=0x7ffac0002f40 tx=0x7ffac0010990).stop 2020-04-22T14:20:45.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.354+0000 7ffacb77e700 1 -- 172.21.15.103:0/746807821 shutdown_connections 2020-04-22T14:20:45.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.354+0000 7ffacb77e700 1 --2- 172.21.15.103:0/746807821 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ffaa404da30 0x7ffaa404fef0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:45.359 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.354+0000 7ffacb77e700 1 --2- 172.21.15.103:0/746807821 >> v2:172.21.15.86:3300/0 conn(0x7ffac412c0d0 0x7ffac40b1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:45.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.354+0000 7ffacb77e700 1 --2- 172.21.15.103:0/746807821 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffac4063e30 0x7ffac40b5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:45.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.354+0000 7ffacb77e700 1 --2- 172.21.15.103:0/746807821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffac4065fe0 0x7ffac40b4210 unknown :-1 s=CLOSED pgs=2221 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:45.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.354+0000 7ffacb77e700 1 -- 172.21.15.103:0/746807821 >> 172.21.15.103:0/746807821 conn(0x7ffac40b9160 msgr2=0x7ffac4065780 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:45.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.354+0000 7ffacb77e700 1 -- 172.21.15.103:0/746807821 shutdown_connections 2020-04-22T14:20:45.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.354+0000 7ffacb77e700 1 -- 172.21.15.103:0/746807821 wait complete. 2020-04-22T14:20:45.361 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 121 2020-04-22T14:20:45.368 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:45.382 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:20:45.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.526+0000 7fd4d3970700 1 Processor -- start 2020-04-22T14:20:45.530 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.527+0000 7fd4d3970700 1 -- start start 2020-04-22T14:20:45.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.527+0000 7fd4d3970700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd4cc065fe0 0x7fd4cc1464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:45.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.527+0000 7fd4d3970700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4cc063e30 0x7fd4cc0642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:45.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.527+0000 7fd4d3970700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4cc143300 con 0x7fd4cc12c0d0 2020-04-22T14:20:45.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.527+0000 7fd4d3970700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4cc1435a0 con 0x7fd4cc065fe0 2020-04-22T14:20:45.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.527+0000 7fd4d3970700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4cc143840 con 0x7fd4cc063e30 2020-04-22T14:20:45.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.528+0000 7fd4d0f0b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd4cc065fe0 0x7fd4cc1464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:45.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.528+0000 7fd4d0f0b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd4cc065fe0 0x7fd4cc1464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59308/0 (socket says 172.21.15.103:59308) 2020-04-22T14:20:45.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.528+0000 7fd4d0f0b700 1 -- 172.21.15.103:0/3933449479 learned_addr learned my addr 172.21.15.103:0/3933449479 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:45.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.528+0000 7fd4d1f0d700 1 --2- 172.21.15.103:0/3933449479 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4cc063e30 0x7fd4cc0642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:45.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.528+0000 7fd4d0f0b700 1 -- 172.21.15.103:0/3933449479 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4cc063e30 msgr2=0x7fd4cc0642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:45.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.528+0000 7fd4d0f0b700 1 --2- 172.21.15.103:0/3933449479 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4cc063e30 0x7fd4cc0642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:45.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.528+0000 7fd4d0f0b700 1 -- 172.21.15.103:0/3933449479 >> v1:172.21.15.86:6789/0 conn(0x7fd4cc12c0d0 legacy=0x7fd4cc05b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:45.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.528+0000 7fd4d0f0b700 1 -- 172.21.15.103:0/3933449479 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4cc05bb50 con 0x7fd4cc065fe0 2020-04-22T14:20:45.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.528+0000 7fd4d0f0b700 1 --2- 172.21.15.103:0/3933449479 >> v2:172.21.15.103:3300/0 conn(0x7fd4cc065fe0 0x7fd4cc1464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd4bc002f30 tx=0x7fd4bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.528+0000 7fd4d0f0b700 1 --2- 172.21.15.103:0/3933449479 >> v2:172.21.15.103:3300/0 conn(0x7fd4cc065fe0 0x7fd4cc1464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd4bc002f30 tx=0x7fd4bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.528+0000 7fd4d0f0b700 1 --2- 172.21.15.103:0/3933449479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4cc065fe0 0x7fd4cc1464e0 secure :-1 s=READY pgs=2222 cs=0 l=1 rx=0x7fd4bc002f30 tx=0x7fd4bc007a40).ready entity=mon.1 client_cookie=ca7d63f63269274d server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:45.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.528+0000 7fd4d0f0b700 1 --2- 172.21.15.103:0/3933449479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4cc065fe0 0x7fd4cc1464e0 secure :-1 s=THROTTLE_DONE pgs=2222 cs=0 l=1 rx=0x7fd4bc002f30 tx=0x7fd4bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.528+0000 7fd4bbfff700 1 -- 172.21.15.103:0/3933449479 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4bc011720 con 0x7fd4cc065fe0 2020-04-22T14:20:45.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.528+0000 7fd4d0f0b700 1 --2- 172.21.15.103:0/3933449479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4cc065fe0 0x7fd4cc1464e0 secure :-1 s=THROTTLE_DONE pgs=2222 cs=0 l=1 rx=0x7fd4bc002f30 tx=0x7fd4bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.528+0000 7fd4bbfff700 1 -- 172.21.15.103:0/3933449479 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4bc0118c0 con 0x7fd4cc065fe0 2020-04-22T14:20:45.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.528+0000 7fd4d0f0b700 1 --2- 172.21.15.103:0/3933449479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4cc065fe0 0x7fd4cc1464e0 secure :-1 s=THROTTLE_DONE pgs=2222 cs=0 l=1 rx=0x7fd4bc002f30 tx=0x7fd4bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.528+0000 7fd4bbfff700 1 -- 172.21.15.103:0/3933449479 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4bc011ce0 con 0x7fd4cc065fe0 2020-04-22T14:20:45.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.528+0000 7fd4d3970700 1 -- 172.21.15.103:0/3933449479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4cc065fe0 msgr2=0x7fd4cc1464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:45.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.528+0000 7fd4d3970700 1 --2- 172.21.15.103:0/3933449479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4cc065fe0 0x7fd4cc1464e0 secure :-1 s=READY pgs=2222 cs=0 l=1 rx=0x7fd4bc002f30 tx=0x7fd4bc007a40).stop 2020-04-22T14:20:45.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.529+0000 7fd4d3970700 1 -- 172.21.15.103:0/3933449479 shutdown_connections 2020-04-22T14:20:45.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.529+0000 7fd4d3970700 1 --2- 172.21.15.103:0/3933449479 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4cc063e30 0x7fd4cc0642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:45.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.529+0000 7fd4d3970700 1 --2- 172.21.15.103:0/3933449479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4cc065fe0 0x7fd4cc1464e0 unknown :-1 s=CLOSED pgs=2222 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:45.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.529+0000 7fd4d3970700 1 -- 172.21.15.103:0/3933449479 >> 172.21.15.103:0/3933449479 conn(0x7fd4cc0b9160 msgr2=0x7fd4cc05ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:45.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.529+0000 7fd4d3970700 1 -- 172.21.15.103:0/3933449479 shutdown_connections 2020-04-22T14:20:45.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.529+0000 7fd4d3970700 1 -- 172.21.15.103:0/3933449479 wait complete. 2020-04-22T14:20:45.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.530+0000 7fd4d3970700 1 Processor -- start 2020-04-22T14:20:45.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.530+0000 7fd4d3970700 1 -- start start 2020-04-22T14:20:45.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.530+0000 7fd4d3970700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd4cc063e30 0x7fd4cc1551c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:45.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.530+0000 7fd4d3970700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4cc0aff10 con 0x7fd4cc12c0d0 2020-04-22T14:20:45.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.530+0000 7fd4d3970700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4cc0b01b0 con 0x7fd4cc065fe0 2020-04-22T14:20:45.542 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.530+0000 7fd4d3970700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4cc0b3450 con 0x7fd4cc063e30 2020-04-22T14:20:45.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.530+0000 7fd4d0f0b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd4cc065fe0 0x7fd4cc0b5140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51502/0 (socket says 172.21.15.103:51502) 2020-04-22T14:20:45.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.530+0000 7fd4d0f0b700 1 -- 172.21.15.103:0/1922554710 learned_addr learned my addr 172.21.15.103:0/1922554710 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:45.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.531+0000 7fd4d170c700 1 --2- 172.21.15.103:0/1922554710 >> v2:172.21.15.86:3300/0 conn(0x7fd4cc063e30 0x7fd4cc1551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:45.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.531+0000 7fd4ba7fc700 1 -- 172.21.15.103:0/1922554710 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 251335360 0 0) 0x7fd4cc0b01b0 con 0x7fd4cc065fe0 2020-04-22T14:20:45.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.531+0000 7fd4ba7fc700 1 -- 172.21.15.103:0/1922554710 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4ac002fe0 con 0x7fd4cc065fe0 2020-04-22T14:20:45.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.531+0000 7fd4ba7fc700 1 -- 172.21.15.103:0/1922554710 <== mon.0 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2685976223 0 0) 0x7fd4cc0aff10 con 0x7fd4cc12c0d0 2020-04-22T14:20:45.543 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.531+0000 7fd4ba7fc700 1 -- 172.21.15.103:0/1922554710 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4cc0b01b0 con 0x7fd4cc12c0d0 2020-04-22T14:20:45.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.531+0000 7fd4ba7fc700 1 -- 172.21.15.103:0/1922554710 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1601117669 0 0) 0x7fd4ac002fe0 con 0x7fd4cc065fe0 2020-04-22T14:20:45.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.531+0000 7fd4ba7fc700 1 -- 172.21.15.103:0/1922554710 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd4cc0aff10 con 0x7fd4cc065fe0 2020-04-22T14:20:45.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.531+0000 7fd4ba7fc700 1 -- 172.21.15.103:0/1922554710 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fd4bc0085e0 con 0x7fd4cc065fe0 2020-04-22T14:20:45.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.531+0000 7fd4ba7fc700 1 -- 172.21.15.103:0/1922554710 >> v2:172.21.15.86:3300/0 conn(0x7fd4cc063e30 msgr2=0x7fd4cc1551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:45.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.531+0000 7fd4ba7fc700 1 --2- 172.21.15.103:0/1922554710 >> v2:172.21.15.86:3300/0 conn(0x7fd4cc063e30 0x7fd4cc1551c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:45.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.531+0000 7fd4ba7fc700 1 -- 172.21.15.103:0/1922554710 >> v1:172.21.15.103:6789/0 conn(0x7fd4cc065fe0 legacy=0x7fd4cc0b5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:45.544 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.531+0000 7fd4ba7fc700 1 -- 172.21.15.103:0/1922554710 >> v1:172.21.15.86:6789/0 conn(0x7fd4cc12c0d0 legacy=0x7fd4cc12cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:45.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.531+0000 7fd4ba7fc700 1 --2- 172.21.15.103:0/1922554710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4ac004b20 0x7fd4ac004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:45.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.531+0000 7fd4ba7fc700 1 --2- 172.21.15.103:0/1922554710 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4ac003ab0 0x7fd4ac003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:45.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.531+0000 7fd4ba7fc700 1 --2- 172.21.15.103:0/1922554710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4ac004350 0x7fd4ac00b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:45.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.531+0000 7fd4ba7fc700 1 -- 172.21.15.103:0/1922554710 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4cc0b3450 con 0x7fd4ac004350 2020-04-22T14:20:45.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.531+0000 7fd4ba7fc700 1 -- 172.21.15.103:0/1922554710 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac004880 con 0x7fd4ac004b20 2020-04-22T14:20:45.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.531+0000 7fd4ba7fc700 1 -- 172.21.15.103:0/1922554710 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac00bbb0 con 0x7fd4ac003ab0 2020-04-22T14:20:45.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.531+0000 7fd4d170c700 1 --2- 172.21.15.103:0/1922554710 >> v2:172.21.15.86:3300/0 conn(0x7fd4cc063e30 0x7fd4cc1551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:20:45.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.531+0000 7fd4d170c700 1 --2- 172.21.15.103:0/1922554710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4ac004b20 0x7fd4ac004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:45.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.531+0000 7fd4d1f0d700 1 --2- 172.21.15.103:0/1922554710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4ac004350 0x7fd4ac00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:45.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.531+0000 7fd4d0f0b700 1 --2- 172.21.15.103:0/1922554710 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4ac003ab0 0x7fd4ac003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:45.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.531+0000 7fd4d170c700 1 -- 172.21.15.103:0/1922554710 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4ac003ab0 msgr2=0x7fd4ac003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:45.546 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.531+0000 7fd4d170c700 1 --2- 172.21.15.103:0/1922554710 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4ac003ab0 0x7fd4ac003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:45.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.531+0000 7fd4d170c700 1 -- 172.21.15.103:0/1922554710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4ac004350 msgr2=0x7fd4ac00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:45.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.531+0000 7fd4d170c700 1 --2- 172.21.15.103:0/1922554710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4ac004350 0x7fd4ac00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:45.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.531+0000 7fd4d1f0d700 1 -- 172.21.15.103:0/1922554710 reap_dead start 2020-04-22T14:20:45.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.531+0000 7fd4d170c700 1 -- 172.21.15.103:0/1922554710 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4cc0b0450 con 0x7fd4ac004b20 2020-04-22T14:20:45.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.531+0000 7fd4d3970700 1 -- 172.21.15.103:0/1922554710 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4cc1551c0 con 0x7fd4ac004b20 2020-04-22T14:20:45.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.531+0000 7fd4d170c700 1 --2- 172.21.15.103:0/1922554710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4ac004b20 0x7fd4ac004f40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd4cc0b85b0 tx=0x7fd4c8001c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.547 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.532+0000 7fd4d170c700 1 --2- 172.21.15.103:0/1922554710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4ac004b20 0x7fd4ac004f40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd4cc0b85b0 tx=0x7fd4c8001c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.532+0000 7fd4d170c700 1 --2- 172.21.15.103:0/1922554710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4ac004b20 0x7fd4ac004f40 secure :-1 s=READY pgs=2224 cs=0 l=1 rx=0x7fd4cc0b85b0 tx=0x7fd4c8001c80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:45.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.532+0000 7fd4d170c700 1 --2- 172.21.15.103:0/1922554710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4ac004b20 0x7fd4ac004f40 secure :-1 s=THROTTLE_DONE pgs=2224 cs=0 l=1 rx=0x7fd4cc0b85b0 tx=0x7fd4c8001c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.532+0000 7fd4ba7fc700 1 -- 172.21.15.103:0/1922554710 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4c8002940 con 0x7fd4ac004b20 2020-04-22T14:20:45.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.532+0000 7fd4d170c700 1 --2- 172.21.15.103:0/1922554710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4ac004b20 0x7fd4ac004f40 secure :-1 s=THROTTLE_DONE pgs=2224 cs=0 l=1 rx=0x7fd4cc0b85b0 tx=0x7fd4c8001c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.532+0000 7fd4d3970700 1 -- 172.21.15.103:0/1922554710 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4cc12ab90 con 0x7fd4ac004b20 2020-04-22T14:20:45.548 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.532+0000 7fd4d170c700 1 --2- 172.21.15.103:0/1922554710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4ac004b20 0x7fd4ac004f40 secure :-1 s=THROTTLE_DONE pgs=2224 cs=0 l=1 rx=0x7fd4cc0b85b0 tx=0x7fd4c8001c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.532+0000 7fd4ba7fc700 1 -- 172.21.15.103:0/1922554710 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4c8002aa0 con 0x7fd4ac004b20 2020-04-22T14:20:45.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.532+0000 7fd4ba7fc700 1 -- 172.21.15.103:0/1922554710 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4c8002e80 con 0x7fd4ac004b20 2020-04-22T14:20:45.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.532+0000 7fd4d170c700 1 --2- 172.21.15.103:0/1922554710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4ac004b20 0x7fd4ac004f40 secure :-1 s=THROTTLE_DONE pgs=2224 cs=0 l=1 rx=0x7fd4cc0b85b0 tx=0x7fd4c8001c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.533+0000 7fd4d3970700 1 -- 172.21.15.103:0/1922554710 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4cc056c90 con 0x7fd4ac004b20 2020-04-22T14:20:45.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.533+0000 7fd4ba7fc700 1 -- 172.21.15.103:0/1922554710 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fd4c8012130 con 0x7fd4ac004b20 2020-04-22T14:20:45.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.533+0000 7fd4d170c700 1 --2- 172.21.15.103:0/1922554710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4ac004b20 0x7fd4ac004f40 secure :-1 s=THROTTLE_DONE pgs=2224 cs=0 l=1 rx=0x7fd4cc0b85b0 tx=0x7fd4c8001c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.533+0000 7fd4ba7fc700 1 --2- 172.21.15.103:0/1922554710 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd4ac0518f0 0x7fd4ac053db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:45.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.533+0000 7fd4ba7fc700 1 -- 172.21.15.103:0/1922554710 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd4c8060eb0 con 0x7fd4ac004b20 2020-04-22T14:20:45.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.533+0000 7fd4d0f0b700 1 --2- 172.21.15.103:0/1922554710 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd4ac0518f0 0x7fd4ac053db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:45.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.533+0000 7fd4d0f0b700 1 --2- 172.21.15.103:0/1922554710 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd4ac0518f0 0x7fd4ac053db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd4bc008320 tx=0x7fd4bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.533+0000 7fd4d0f0b700 1 --2- 172.21.15.103:0/1922554710 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd4ac0518f0 0x7fd4ac053db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd4bc008320 tx=0x7fd4bc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.533+0000 7fd4d0f0b700 1 --2- 172.21.15.103:0/1922554710 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd4ac0518f0 0x7fd4ac053db0 secure :-1 s=READY pgs=807 cs=0 l=1 rx=0x7fd4bc008320 tx=0x7fd4bc007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:45.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.537+0000 7fd4d170c700 1 --2- 172.21.15.103:0/1922554710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4ac004b20 0x7fd4ac004f40 secure :-1 s=THROTTLE_DONE pgs=2224 cs=0 l=1 rx=0x7fd4cc0b85b0 tx=0x7fd4c8001c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.537+0000 7fd4ba7fc700 1 -- 172.21.15.103:0/1922554710 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fd4c803c290 con 0x7fd4ac004b20 2020-04-22T14:20:45.684 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.681+0000 7fd4d3970700 1 -- 172.21.15.103:0/1922554710 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4cc147360 con 0x7fd4ac004b20 2020-04-22T14:20:45.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.682+0000 7fd4d170c700 1 --2- 172.21.15.103:0/1922554710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4ac004b20 0x7fd4ac004f40 secure :-1 s=THROTTLE_DONE pgs=2224 cs=0 l=1 rx=0x7fd4cc0b85b0 tx=0x7fd4c8001c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.685 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.682+0000 7fd4ba7fc700 1 -- 172.21.15.103:0/1922554710 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v158) v1 ==== 74+0+16103 (secure 0 0 0) 0x7fd4c803f8b0 con 0x7fd4ac004b20 2020-04-22T14:20:45.685 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:20:45.686 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":158,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:20:43.937239+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:20:40.847124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2020-04-22T14:20:41.893982+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:20:45.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.683+0000 7fd4d3970700 1 -- 172.21.15.103:0/1922554710 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd4ac0518f0 msgr2=0x7fd4ac053db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:45.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.683+0000 7fd4d3970700 1 --2- 172.21.15.103:0/1922554710 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd4ac0518f0 0x7fd4ac053db0 secure :-1 s=READY pgs=807 cs=0 l=1 rx=0x7fd4bc008320 tx=0x7fd4bc007a40).stop 2020-04-22T14:20:45.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.683+0000 7fd4d3970700 1 -- 172.21.15.103:0/1922554710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4ac004b20 msgr2=0x7fd4ac004f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:45.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.683+0000 7fd4d3970700 1 --2- 172.21.15.103:0/1922554710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4ac004b20 0x7fd4ac004f40 secure :-1 s=READY pgs=2224 cs=0 l=1 rx=0x7fd4cc0b85b0 tx=0x7fd4c8001c80).stop 2020-04-22T14:20:45.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.683+0000 7fd4d3970700 1 -- 172.21.15.103:0/1922554710 shutdown_connections 2020-04-22T14:20:45.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.683+0000 7fd4d3970700 1 --2- 172.21.15.103:0/1922554710 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd4ac0518f0 0x7fd4ac053db0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:45.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.683+0000 7fd4d3970700 1 --2- 172.21.15.103:0/1922554710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4ac004b20 0x7fd4ac004f40 unknown :-1 s=CLOSED pgs=2224 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:45.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.683+0000 7fd4d3970700 1 -- 172.21.15.103:0/1922554710 >> 172.21.15.103:0/1922554710 conn(0x7fd4cc0b9160 msgr2=0x7fd4cc0b7900 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:45.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.683+0000 7fd4d3970700 1 -- 172.21.15.103:0/1922554710 shutdown_connections 2020-04-22T14:20:45.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.683+0000 7fd4d3970700 1 -- 172.21.15.103:0/1922554710 wait complete. 2020-04-22T14:20:45.698 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:45.711 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:20:45.867 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.861+0000 7f5186307700 1 Processor -- start 2020-04-22T14:20:45.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.861+0000 7f5186307700 1 -- start start 2020-04-22T14:20:45.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.862+0000 7f5186307700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5180152a90 0x7f51800b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:45.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.862+0000 7f5186307700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5180062170 0x7f51800b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:45.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.862+0000 7f5186307700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5180152e70 con 0x7f51800b5210 2020-04-22T14:20:45.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.862+0000 7f5186307700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51800614f0 con 0x7f5180152a90 2020-04-22T14:20:45.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.862+0000 7f5186307700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5180061790 con 0x7f5180062170 2020-04-22T14:20:45.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.862+0000 7f51848a4700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5180152a90 0x7f51800b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:45.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.862+0000 7f51850a5700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f51800b5210 0x7f5180156500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51516/0 (socket says 172.21.15.103:51516) 2020-04-22T14:20:45.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.862+0000 7f51850a5700 1 -- 172.21.15.103:0/85547868 learned_addr learned my addr 172.21.15.103:0/85547868 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:45.869 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.862+0000 7f5177fff700 1 --2- 172.21.15.103:0/85547868 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5180062170 0x7f51800b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:45.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.862+0000 7f51848a4700 1 -- 172.21.15.103:0/85547868 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5180062170 msgr2=0x7f51800b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:45.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.862+0000 7f51848a4700 1 --2- 172.21.15.103:0/85547868 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5180062170 0x7f51800b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:45.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.862+0000 7f51848a4700 1 -- 172.21.15.103:0/85547868 >> v1:172.21.15.103:6789/0 conn(0x7f51800b5210 legacy=0x7f5180156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:45.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.862+0000 7f51777fe700 1 -- 172.21.15.103:0/85547868 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3709481285 0 0) 0x7f5180152e70 con 0x7f51800b5210 2020-04-22T14:20:45.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.862+0000 7f51848a4700 1 -- 172.21.15.103:0/85547868 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51800b56a0 con 0x7f5180152a90 2020-04-22T14:20:45.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.862+0000 7f51848a4700 1 --2- 172.21.15.103:0/85547868 >> v2:172.21.15.103:3300/0 conn(0x7f5180152a90 0x7f51800b44d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f517c002f30 tx=0x7f517c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.862+0000 7f51848a4700 1 --2- 172.21.15.103:0/85547868 >> v2:172.21.15.103:3300/0 conn(0x7f5180152a90 0x7f51800b44d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f517c002f30 tx=0x7f517c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.862+0000 7f51848a4700 1 --2- 172.21.15.103:0/85547868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5180152a90 0x7f51800b44d0 secure :-1 s=READY pgs=2226 cs=0 l=1 rx=0x7f517c002f30 tx=0x7f517c007a40).ready entity=mon.1 client_cookie=ec61deb5e9454737 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:45.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.862+0000 7f51848a4700 1 --2- 172.21.15.103:0/85547868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5180152a90 0x7f51800b44d0 secure :-1 s=THROTTLE_DONE pgs=2226 cs=0 l=1 rx=0x7f517c002f30 tx=0x7f517c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.862+0000 7f51777fe700 1 -- 172.21.15.103:0/85547868 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f517c0113c0 con 0x7f5180152a90 2020-04-22T14:20:45.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.862+0000 7f51848a4700 1 --2- 172.21.15.103:0/85547868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5180152a90 0x7f51800b44d0 secure :-1 s=THROTTLE_DONE pgs=2226 cs=0 l=1 rx=0x7f517c002f30 tx=0x7f517c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.863+0000 7f51777fe700 1 -- 172.21.15.103:0/85547868 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517c011560 con 0x7f5180152a90 2020-04-22T14:20:45.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.863+0000 7f51848a4700 1 --2- 172.21.15.103:0/85547868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5180152a90 0x7f51800b44d0 secure :-1 s=THROTTLE_DONE pgs=2226 cs=0 l=1 rx=0x7f517c002f30 tx=0x7f517c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.863+0000 7f5186307700 1 -- 172.21.15.103:0/85547868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5180152a90 msgr2=0x7f51800b44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:45.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.863+0000 7f51777fe700 1 -- 172.21.15.103:0/85547868 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f517c011940 con 0x7f5180152a90 2020-04-22T14:20:45.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.863+0000 7f5186307700 1 --2- 172.21.15.103:0/85547868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5180152a90 0x7f51800b44d0 secure :-1 s=READY pgs=2226 cs=0 l=1 rx=0x7f517c002f30 tx=0x7f517c007a40).stop 2020-04-22T14:20:45.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.863+0000 7f5186307700 1 -- 172.21.15.103:0/85547868 shutdown_connections 2020-04-22T14:20:45.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.863+0000 7f5186307700 1 --2- 172.21.15.103:0/85547868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5180152a90 0x7f51800b44d0 unknown :-1 s=CLOSED pgs=2226 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:45.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.863+0000 7f5186307700 1 --2- 172.21.15.103:0/85547868 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5180062170 0x7f51800b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:45.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.863+0000 7f5186307700 1 -- 172.21.15.103:0/85547868 >> 172.21.15.103:0/85547868 conn(0x7f518005ad30 msgr2=0x7f518005b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:45.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.863+0000 7f5186307700 1 -- 172.21.15.103:0/85547868 shutdown_connections 2020-04-22T14:20:45.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.863+0000 7f5186307700 1 -- 172.21.15.103:0/85547868 wait complete. 2020-04-22T14:20:45.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.864+0000 7f5186307700 1 Processor -- start 2020-04-22T14:20:45.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.864+0000 7f5186307700 1 -- start start 2020-04-22T14:20:45.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.865+0000 7f5186307700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5180062170 0x7f5180066260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:45.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.865+0000 7f5186307700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f51800b5210 0x7f51800b25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:45.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.865+0000 7f5186307700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5180152a90 0x7f51800ae260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:45.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.865+0000 7f5186307700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51800667a0 con 0x7f51800b5210 2020-04-22T14:20:45.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.865+0000 7f5186307700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51800ae6c0 con 0x7f5180152a90 2020-04-22T14:20:45.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.865+0000 7f5186307700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51800630f0 con 0x7f5180062170 2020-04-22T14:20:45.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.865+0000 7f51850a5700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5180152a90 0x7f51800ae260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:45.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.865+0000 7f51850a5700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5180152a90 0x7f51800ae260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59336/0 (socket says 172.21.15.103:59336) 2020-04-22T14:20:45.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.865+0000 7f51850a5700 1 -- 172.21.15.103:0/1781565848 learned_addr learned my addr 172.21.15.103:0/1781565848 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:45.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.865+0000 7f5177fff700 1 --2- 172.21.15.103:0/1781565848 >> v2:172.21.15.86:3300/0 conn(0x7f51800b5210 0x7f51800b25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:45.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.865+0000 7f51848a4700 1 --2- 172.21.15.103:0/1781565848 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5180062170 0x7f5180066260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:45.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.865+0000 7f51850a5700 1 -- 172.21.15.103:0/1781565848 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5180062170 msgr2=0x7f5180066260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:45.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.865+0000 7f51850a5700 1 --2- 172.21.15.103:0/1781565848 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5180062170 0x7f5180066260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:45.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.865+0000 7f51850a5700 1 -- 172.21.15.103:0/1781565848 >> v2:172.21.15.86:3300/0 conn(0x7f51800b5210 msgr2=0x7f51800b25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:45.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.865+0000 7f51850a5700 1 --2- 172.21.15.103:0/1781565848 >> v2:172.21.15.86:3300/0 conn(0x7f51800b5210 0x7f51800b25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:45.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.865+0000 7f51850a5700 1 -- 172.21.15.103:0/1781565848 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5180145820 con 0x7f5180152a90 2020-04-22T14:20:45.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.865+0000 7f51850a5700 1 --2- 172.21.15.103:0/1781565848 >> v2:172.21.15.103:3300/0 conn(0x7f5180152a90 0x7f51800ae260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5178001210 tx=0x7f5178010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.866+0000 7f51850a5700 1 --2- 172.21.15.103:0/1781565848 >> v2:172.21.15.103:3300/0 conn(0x7f5180152a90 0x7f51800ae260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5178001210 tx=0x7f5178010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.866+0000 7f51850a5700 1 --2- 172.21.15.103:0/1781565848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5180152a90 0x7f51800ae260 secure :-1 s=READY pgs=2227 cs=0 l=1 rx=0x7f5178001210 tx=0x7f5178010ca0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:45.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.866+0000 7f51850a5700 1 --2- 172.21.15.103:0/1781565848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5180152a90 0x7f51800ae260 secure :-1 s=THROTTLE_DONE pgs=2227 cs=0 l=1 rx=0x7f5178001210 tx=0x7f5178010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.866+0000 7f51757fa700 1 -- 172.21.15.103:0/1781565848 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5178005e30 con 0x7f5180152a90 2020-04-22T14:20:45.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.866+0000 7f51850a5700 1 --2- 172.21.15.103:0/1781565848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5180152a90 0x7f51800ae260 secure :-1 s=THROTTLE_DONE pgs=2227 cs=0 l=1 rx=0x7f5178001210 tx=0x7f5178010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.866+0000 7f51850a5700 1 --2- 172.21.15.103:0/1781565848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5180152a90 0x7f51800ae260 secure :-1 s=THROTTLE_DONE pgs=2227 cs=0 l=1 rx=0x7f5178001210 tx=0x7f5178010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.866+0000 7f51757fa700 1 -- 172.21.15.103:0/1781565848 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5178012480 con 0x7f5180152a90 2020-04-22T14:20:45.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.866+0000 7f5186307700 1 -- 172.21.15.103:0/1781565848 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5180145ac0 con 0x7f5180152a90 2020-04-22T14:20:45.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.866+0000 7f51757fa700 1 -- 172.21.15.103:0/1781565848 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5178012860 con 0x7f5180152a90 2020-04-22T14:20:45.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.866+0000 7f5186307700 1 -- 172.21.15.103:0/1781565848 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5180146210 con 0x7f5180152a90 2020-04-22T14:20:45.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.866+0000 7f51850a5700 1 --2- 172.21.15.103:0/1781565848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5180152a90 0x7f51800ae260 secure :-1 s=THROTTLE_DONE pgs=2227 cs=0 l=1 rx=0x7f5178001210 tx=0x7f5178010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.867+0000 7f5186307700 1 -- 172.21.15.103:0/1781565848 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5180145cc0 con 0x7f5180152a90 2020-04-22T14:20:45.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.867+0000 7f51757fa700 1 -- 172.21.15.103:0/1781565848 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f5178012ad0 con 0x7f5180152a90 2020-04-22T14:20:45.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.867+0000 7f51850a5700 1 --2- 172.21.15.103:0/1781565848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5180152a90 0x7f51800ae260 secure :-1 s=THROTTLE_DONE pgs=2227 cs=0 l=1 rx=0x7f5178001210 tx=0x7f5178010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.867+0000 7f51757fa700 1 --2- 172.21.15.103:0/1781565848 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f516004da00 0x7f516004fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:45.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.867+0000 7f51757fa700 1 -- 172.21.15.103:0/1781565848 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f51780090c0 con 0x7f5180152a90 2020-04-22T14:20:45.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.867+0000 7f51848a4700 1 --2- 172.21.15.103:0/1781565848 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f516004da00 0x7f516004fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:45.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.867+0000 7f51848a4700 1 --2- 172.21.15.103:0/1781565848 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f516004da00 0x7f516004fec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f517c002f30 tx=0x7f517c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.867+0000 7f51848a4700 1 --2- 172.21.15.103:0/1781565848 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f516004da00 0x7f516004fec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f517c002f30 tx=0x7f517c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.868+0000 7f51848a4700 1 --2- 172.21.15.103:0/1781565848 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f516004da00 0x7f516004fec0 secure :-1 s=READY pgs=808 cs=0 l=1 rx=0x7f517c002f30 tx=0x7f517c007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:45.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.871+0000 7f51850a5700 1 --2- 172.21.15.103:0/1781565848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5180152a90 0x7f51800ae260 secure :-1 s=THROTTLE_DONE pgs=2227 cs=0 l=1 rx=0x7f5178001210 tx=0x7f5178010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:45.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:45.871+0000 7f51757fa700 1 -- 172.21.15.103:0/1781565848 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f5180145cc0 con 0x7f5180152a90 2020-04-22T14:20:46.071 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.068+0000 7f5186307700 1 -- 172.21.15.103:0/1781565848 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f5180145e80 con 0x7f5180152a90 2020-04-22T14:20:46.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.072+0000 7f51850a5700 1 --2- 172.21.15.103:0/1781565848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5180152a90 0x7f51800ae260 secure :-1 s=THROTTLE_DONE pgs=2227 cs=0 l=1 rx=0x7f5178001210 tx=0x7f5178010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:46.075 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.072+0000 7f51757fa700 1 -- 172.21.15.103:0/1781565848 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v57) v1 ==== 184+0+0 (secure 0 0 0) 0x7f5180145e80 con 0x7f5180152a90 2020-04-22T14:20:46.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.074+0000 7f5186307700 1 -- 172.21.15.103:0/1781565848 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f516004da00 msgr2=0x7f516004fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:46.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.074+0000 7f5186307700 1 --2- 172.21.15.103:0/1781565848 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f516004da00 0x7f516004fec0 secure :-1 s=READY pgs=808 cs=0 l=1 rx=0x7f517c002f30 tx=0x7f517c007a40).stop 2020-04-22T14:20:46.077 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.074+0000 7f5186307700 1 -- 172.21.15.103:0/1781565848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5180152a90 msgr2=0x7f51800ae260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:46.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.074+0000 7f5186307700 1 --2- 172.21.15.103:0/1781565848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5180152a90 0x7f51800ae260 secure :-1 s=READY pgs=2227 cs=0 l=1 rx=0x7f5178001210 tx=0x7f5178010ca0).stop 2020-04-22T14:20:46.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.074+0000 7f5186307700 1 -- 172.21.15.103:0/1781565848 shutdown_connections 2020-04-22T14:20:46.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.074+0000 7f5186307700 1 --2- 172.21.15.103:0/1781565848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5180152a90 0x7f51800ae260 unknown :-1 s=CLOSED pgs=2227 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:46.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.074+0000 7f5186307700 1 --2- 172.21.15.103:0/1781565848 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5180062170 0x7f5180066260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:46.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.074+0000 7f5186307700 1 --2- 172.21.15.103:0/1781565848 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f516004da00 0x7f516004fec0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:46.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.074+0000 7f5186307700 1 --2- 172.21.15.103:0/1781565848 >> v2:172.21.15.86:3300/0 conn(0x7f51800b5210 0x7f51800b25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:46.078 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.074+0000 7f5186307700 1 -- 172.21.15.103:0/1781565848 >> 172.21.15.103:0/1781565848 conn(0x7f518005ad30 msgr2=0x7f5180131f60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:46.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.074+0000 7f5186307700 1 -- 172.21.15.103:0/1781565848 shutdown_connections 2020-04-22T14:20:46.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.074+0000 7f5186307700 1 -- 172.21.15.103:0/1781565848 wait complete. 2020-04-22T14:20:46.079 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.0 2020-04-22T14:20:46.087 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:46.105 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:20:46.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.253+0000 7fc6faa9f700 1 Processor -- start 2020-04-22T14:20:46.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.253+0000 7fc6faa9f700 1 -- start start 2020-04-22T14:20:46.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.254+0000 7fc6faa9f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc6f40666e0 0x7fc6f40633c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:46.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.254+0000 7fc6faa9f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc6f40b9880 0x7fc6f40b9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:46.264 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.254+0000 7fc6faa9f700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6f4025b90 con 0x7fc6f4154fe0 2020-04-22T14:20:46.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.254+0000 7fc6faa9f700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6f4066ac0 con 0x7fc6f40b9880 2020-04-22T14:20:46.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.254+0000 7fc6faa9f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6f4024ea0 con 0x7fc6f40666e0 2020-04-22T14:20:46.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.254+0000 7fc6fa29e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc6f40666e0 0x7fc6f40633c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:46.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.254+0000 7fc6fbd01700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc6f4154fe0 0x7fc6f41553e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51534/0 (socket says 172.21.15.103:51534) 2020-04-22T14:20:46.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.254+0000 7fc6fa29e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc6f40666e0 0x7fc6f40633c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59340/0 (socket says 172.21.15.103:59340) 2020-04-22T14:20:46.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.254+0000 7fc6fbd01700 1 -- 172.21.15.103:0/772542611 learned_addr learned my addr 172.21.15.103:0/772542611 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:46.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.255+0000 7fc6f9a9d700 1 --2- 172.21.15.103:0/772542611 >> v2:172.21.15.86:3300/0 conn(0x7fc6f40b9880 0x7fc6f40b9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:46.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.255+0000 7fc6fa29e700 1 -- 172.21.15.103:0/772542611 >> v2:172.21.15.86:3300/0 conn(0x7fc6f40b9880 msgr2=0x7fc6f40b9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:46.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.255+0000 7fc6fa29e700 1 --2- 172.21.15.103:0/772542611 >> v2:172.21.15.86:3300/0 conn(0x7fc6f40b9880 0x7fc6f40b9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:46.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.255+0000 7fc6fa29e700 1 -- 172.21.15.103:0/772542611 >> v1:172.21.15.103:6789/0 conn(0x7fc6f4154fe0 legacy=0x7fc6f41553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:46.266 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.255+0000 7fc6f929c700 1 -- 172.21.15.103:0/772542611 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2068059239 0 0) 0x7fc6f4025b90 con 0x7fc6f4154fe0 2020-04-22T14:20:46.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.255+0000 7fc6fa29e700 1 -- 172.21.15.103:0/772542611 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f4024c00 con 0x7fc6f40666e0 2020-04-22T14:20:46.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.255+0000 7fc6fa29e700 1 --2- 172.21.15.103:0/772542611 >> v2:172.21.15.103:3300/0 conn(0x7fc6f40666e0 0x7fc6f40633c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc6f00032b0 tx=0x7fc6f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:46.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.255+0000 7fc6fa29e700 1 --2- 172.21.15.103:0/772542611 >> v2:172.21.15.103:3300/0 conn(0x7fc6f40666e0 0x7fc6f40633c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc6f00032b0 tx=0x7fc6f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:46.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.255+0000 7fc6fa29e700 1 --2- 172.21.15.103:0/772542611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6f40666e0 0x7fc6f40633c0 secure :-1 s=READY pgs=2229 cs=0 l=1 rx=0x7fc6f00032b0 tx=0x7fc6f0007dc0).ready entity=mon.1 client_cookie=8e621798da707ad2 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:46.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.255+0000 7fc6fa29e700 1 --2- 172.21.15.103:0/772542611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6f40666e0 0x7fc6f40633c0 secure :-1 s=THROTTLE_DONE pgs=2229 cs=0 l=1 rx=0x7fc6f00032b0 tx=0x7fc6f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:46.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.255+0000 7fc6f929c700 1 -- 172.21.15.103:0/772542611 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6f000a180 con 0x7fc6f40666e0 2020-04-22T14:20:46.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.255+0000 7fc6fa29e700 1 --2- 172.21.15.103:0/772542611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6f40666e0 0x7fc6f40633c0 secure :-1 s=THROTTLE_DONE pgs=2229 cs=0 l=1 rx=0x7fc6f00032b0 tx=0x7fc6f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:46.267 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.255+0000 7fc6fa29e700 1 --2- 172.21.15.103:0/772542611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6f40666e0 0x7fc6f40633c0 secure :-1 s=THROTTLE_DONE pgs=2229 cs=0 l=1 rx=0x7fc6f00032b0 tx=0x7fc6f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:46.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.255+0000 7fc6f929c700 1 -- 172.21.15.103:0/772542611 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f000a2e0 con 0x7fc6f40666e0 2020-04-22T14:20:46.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.255+0000 7fc6f929c700 1 -- 172.21.15.103:0/772542611 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6f000a6c0 con 0x7fc6f40666e0 2020-04-22T14:20:46.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.255+0000 7fc6faa9f700 1 -- 172.21.15.103:0/772542611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6f40666e0 msgr2=0x7fc6f40633c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:46.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.255+0000 7fc6faa9f700 1 --2- 172.21.15.103:0/772542611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6f40666e0 0x7fc6f40633c0 secure :-1 s=READY pgs=2229 cs=0 l=1 rx=0x7fc6f00032b0 tx=0x7fc6f0007dc0).stop 2020-04-22T14:20:46.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.256+0000 7fc6faa9f700 1 -- 172.21.15.103:0/772542611 shutdown_connections 2020-04-22T14:20:46.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.256+0000 7fc6faa9f700 1 --2- 172.21.15.103:0/772542611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6f40666e0 0x7fc6f40633c0 unknown :-1 s=CLOSED pgs=2229 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:46.268 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.256+0000 7fc6faa9f700 1 --2- 172.21.15.103:0/772542611 >> v2:172.21.15.86:3300/0 conn(0x7fc6f40b9880 0x7fc6f40b9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:46.269 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.256+0000 7fc6faa9f700 1 -- 172.21.15.103:0/772542611 >> 172.21.15.103:0/772542611 conn(0x7fc6f4060930 msgr2=0x7fc6f4060d40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:46.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.256+0000 7fc6faa9f700 1 -- 172.21.15.103:0/772542611 shutdown_connections 2020-04-22T14:20:46.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.256+0000 7fc6faa9f700 1 -- 172.21.15.103:0/772542611 wait complete. 2020-04-22T14:20:46.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.257+0000 7fc6faa9f700 1 Processor -- start 2020-04-22T14:20:46.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.257+0000 7fc6faa9f700 1 -- start start 2020-04-22T14:20:46.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.257+0000 7fc6faa9f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc6f40666e0 0x7fc6f4125040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:46.270 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.257+0000 7fc6faa9f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc6f40b9880 0x7fc6f4126030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:46.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.257+0000 7fc6faa9f700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6f40ad4a0 con 0x7fc6f4154fe0 2020-04-22T14:20:46.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.257+0000 7fc6faa9f700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6f40ad740 con 0x7fc6f40b9880 2020-04-22T14:20:46.272 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.257+0000 7fc6faa9f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6f40ad9e0 con 0x7fc6f40666e0 2020-04-22T14:20:46.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.257+0000 7fc6fa29e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc6f40666e0 0x7fc6f4125040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:46.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.258+0000 7fc6fbd01700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc6f4154fe0 0x7fc6f4121fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51540/0 (socket says 172.21.15.103:51540) 2020-04-22T14:20:46.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.258+0000 7fc6fbd01700 1 -- 172.21.15.103:0/2620854548 learned_addr learned my addr 172.21.15.103:0/2620854548 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:46.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.258+0000 7fc6f9a9d700 1 --2- 172.21.15.103:0/2620854548 >> v2:172.21.15.86:3300/0 conn(0x7fc6f40b9880 0x7fc6f4126030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:46.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.258+0000 7fc6fa29e700 1 -- 172.21.15.103:0/2620854548 >> v2:172.21.15.86:3300/0 conn(0x7fc6f40b9880 msgr2=0x7fc6f4126030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:46.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.258+0000 7fc6fa29e700 1 --2- 172.21.15.103:0/2620854548 >> v2:172.21.15.86:3300/0 conn(0x7fc6f40b9880 0x7fc6f4126030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:46.273 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.258+0000 7fc6fa29e700 1 -- 172.21.15.103:0/2620854548 >> v1:172.21.15.103:6789/0 conn(0x7fc6f4154fe0 legacy=0x7fc6f4121fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:46.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.258+0000 7fc6fa29e700 1 -- 172.21.15.103:0/2620854548 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f4126490 con 0x7fc6f40666e0 2020-04-22T14:20:46.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.258+0000 7fc6eaffd700 1 -- 172.21.15.103:0/2620854548 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 278704289 0 0) 0x7fc6f40ad4a0 con 0x7fc6f4154fe0 2020-04-22T14:20:46.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.258+0000 7fc6fa29e700 1 --2- 172.21.15.103:0/2620854548 >> v2:172.21.15.103:3300/0 conn(0x7fc6f40666e0 0x7fc6f4125040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc6f00032b0 tx=0x7fc6f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:46.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.258+0000 7fc6fa29e700 1 --2- 172.21.15.103:0/2620854548 >> v2:172.21.15.103:3300/0 conn(0x7fc6f40666e0 0x7fc6f4125040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc6f00032b0 tx=0x7fc6f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:46.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.258+0000 7fc6fa29e700 1 --2- 172.21.15.103:0/2620854548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6f40666e0 0x7fc6f4125040 secure :-1 s=READY pgs=2231 cs=0 l=1 rx=0x7fc6f00032b0 tx=0x7fc6f0007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:46.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.258+0000 7fc6fa29e700 1 --2- 172.21.15.103:0/2620854548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6f40666e0 0x7fc6f4125040 secure :-1 s=THROTTLE_DONE pgs=2231 cs=0 l=1 rx=0x7fc6f00032b0 tx=0x7fc6f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:46.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.258+0000 7fc6eaffd700 1 -- 172.21.15.103:0/2620854548 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6f0005c30 con 0x7fc6f40666e0 2020-04-22T14:20:46.274 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.258+0000 7fc6fa29e700 1 --2- 172.21.15.103:0/2620854548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6f40666e0 0x7fc6f4125040 secure :-1 s=THROTTLE_DONE pgs=2231 cs=0 l=1 rx=0x7fc6f00032b0 tx=0x7fc6f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:46.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.258+0000 7fc6fa29e700 1 --2- 172.21.15.103:0/2620854548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6f40666e0 0x7fc6f4125040 secure :-1 s=THROTTLE_DONE pgs=2231 cs=0 l=1 rx=0x7fc6f00032b0 tx=0x7fc6f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:46.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.258+0000 7fc6eaffd700 1 -- 172.21.15.103:0/2620854548 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f0005d90 con 0x7fc6f40666e0 2020-04-22T14:20:46.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.258+0000 7fc6faa9f700 1 -- 172.21.15.103:0/2620854548 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6f40af230 con 0x7fc6f40666e0 2020-04-22T14:20:46.275 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.258+0000 7fc6eaffd700 1 -- 172.21.15.103:0/2620854548 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6f000f7a0 con 0x7fc6f40666e0 2020-04-22T14:20:46.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.258+0000 7fc6faa9f700 1 -- 172.21.15.103:0/2620854548 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6f40b2ed0 con 0x7fc6f40666e0 2020-04-22T14:20:46.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.259+0000 7fc6fa29e700 1 --2- 172.21.15.103:0/2620854548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6f40666e0 0x7fc6f4125040 secure :-1 s=THROTTLE_DONE pgs=2231 cs=0 l=1 rx=0x7fc6f00032b0 tx=0x7fc6f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:46.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.259+0000 7fc6fa29e700 1 --2- 172.21.15.103:0/2620854548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6f40666e0 0x7fc6f4125040 secure :-1 s=THROTTLE_DONE pgs=2231 cs=0 l=1 rx=0x7fc6f00032b0 tx=0x7fc6f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:46.276 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.259+0000 7fc6eaffd700 1 -- 172.21.15.103:0/2620854548 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fc6f000f9d0 con 0x7fc6f40666e0 2020-04-22T14:20:46.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.259+0000 7fc6faa9f700 1 -- 172.21.15.103:0/2620854548 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6f4056c90 con 0x7fc6f40666e0 2020-04-22T14:20:46.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.259+0000 7fc6eaffd700 1 --2- 172.21.15.103:0/2620854548 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc6dc04d920 0x7fc6dc04fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:46.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.259+0000 7fc6eaffd700 1 -- 172.21.15.103:0/2620854548 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc6f0062650 con 0x7fc6f40666e0 2020-04-22T14:20:46.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.260+0000 7fc6f9a9d700 1 --2- 172.21.15.103:0/2620854548 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc6dc04d920 0x7fc6dc04fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:46.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.260+0000 7fc6f9a9d700 1 --2- 172.21.15.103:0/2620854548 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc6dc04d920 0x7fc6dc04fde0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc6e4002f30 tx=0x7fc6e4007ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:46.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.260+0000 7fc6f9a9d700 1 --2- 172.21.15.103:0/2620854548 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc6dc04d920 0x7fc6dc04fde0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc6e4002f30 tx=0x7fc6e4007ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:46.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.260+0000 7fc6f9a9d700 1 --2- 172.21.15.103:0/2620854548 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc6dc04d920 0x7fc6dc04fde0 secure :-1 s=READY pgs=809 cs=0 l=1 rx=0x7fc6e4002f30 tx=0x7fc6e4007ee0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:46.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.263+0000 7fc6fa29e700 1 --2- 172.21.15.103:0/2620854548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6f40666e0 0x7fc6f4125040 secure :-1 s=THROTTLE_DONE pgs=2231 cs=0 l=1 rx=0x7fc6f00032b0 tx=0x7fc6f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:46.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.263+0000 7fc6eaffd700 1 -- 172.21.15.103:0/2620854548 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fc6f003db10 con 0x7fc6f40666e0 2020-04-22T14:20:46.459 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.455+0000 7fc6faa9f700 1 -- 172.21.15.103:0/2620854548 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fc6f405cc80 con 0x7fc6f40666e0 2020-04-22T14:20:46.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.462+0000 7fc6fa29e700 1 --2- 172.21.15.103:0/2620854548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6f40666e0 0x7fc6f4125040 secure :-1 s=THROTTLE_DONE pgs=2231 cs=0 l=1 rx=0x7fc6f00032b0 tx=0x7fc6f0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:46.465 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.462+0000 7fc6eaffd700 1 -- 172.21.15.103:0/2620854548 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v58) v1 ==== 184+0+0 (secure 0 0 0) 0x7fc6f0041130 con 0x7fc6f40666e0 2020-04-22T14:20:46.467 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.464+0000 7fc6faa9f700 1 -- 172.21.15.103:0/2620854548 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc6dc04d920 msgr2=0x7fc6dc04fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:46.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.464+0000 7fc6faa9f700 1 --2- 172.21.15.103:0/2620854548 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc6dc04d920 0x7fc6dc04fde0 secure :-1 s=READY pgs=809 cs=0 l=1 rx=0x7fc6e4002f30 tx=0x7fc6e4007ee0).stop 2020-04-22T14:20:46.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.464+0000 7fc6faa9f700 1 -- 172.21.15.103:0/2620854548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6f40666e0 msgr2=0x7fc6f4125040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:46.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.464+0000 7fc6faa9f700 1 --2- 172.21.15.103:0/2620854548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6f40666e0 0x7fc6f4125040 secure :-1 s=READY pgs=2231 cs=0 l=1 rx=0x7fc6f00032b0 tx=0x7fc6f0007dc0).stop 2020-04-22T14:20:46.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.464+0000 7fc6faa9f700 1 -- 172.21.15.103:0/2620854548 shutdown_connections 2020-04-22T14:20:46.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.464+0000 7fc6faa9f700 1 --2- 172.21.15.103:0/2620854548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6f40666e0 0x7fc6f4125040 unknown :-1 s=CLOSED pgs=2231 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:46.468 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.464+0000 7fc6faa9f700 1 --2- 172.21.15.103:0/2620854548 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc6dc04d920 0x7fc6dc04fde0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:46.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.464+0000 7fc6faa9f700 1 --2- 172.21.15.103:0/2620854548 >> v2:172.21.15.86:3300/0 conn(0x7fc6f40b9880 0x7fc6f4126030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:46.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.464+0000 7fc6faa9f700 1 -- 172.21.15.103:0/2620854548 >> 172.21.15.103:0/2620854548 conn(0x7fc6f4060930 msgr2=0x7fc6f40b5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:46.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.464+0000 7fc6faa9f700 1 -- 172.21.15.103:0/2620854548 shutdown_connections 2020-04-22T14:20:46.469 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.464+0000 7fc6faa9f700 1 -- 172.21.15.103:0/2620854548 wait complete. 2020-04-22T14:20:46.469 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.1 2020-04-22T14:20:46.477 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:46.491 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:20:46.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.641+0000 7f51a1a15700 1 Processor -- start 2020-04-22T14:20:46.653 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.641+0000 7f51a1a15700 1 -- start start 2020-04-22T14:20:46.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.642+0000 7f51a1a15700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f519c0b61b0 0x7f519c152d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:46.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.642+0000 7f51a1a15700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f519c156390 con 0x7f519c061290 2020-04-22T14:20:46.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.642+0000 7f51a1a15700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f519c1565c0 con 0x7f519c0b4a30 2020-04-22T14:20:46.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.642+0000 7f51a1a15700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f519c156860 con 0x7f519c0b61b0 2020-04-22T14:20:46.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.642+0000 7f519affd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f519c0b4a30 0x7f519c07fdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51544/0 (socket says 172.21.15.103:51544) 2020-04-22T14:20:46.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.642+0000 7f519affd700 1 -- 172.21.15.103:0/3113495980 learned_addr learned my addr 172.21.15.103:0/3113495980 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:46.654 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.643+0000 7f519a7fc700 1 -- 172.21.15.103:0/3113495980 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2423896539 0 0) 0x7f519c1565c0 con 0x7f519c0b4a30 2020-04-22T14:20:46.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.643+0000 7f519bfff700 1 --2- 172.21.15.103:0/3113495980 >> v2:172.21.15.86:3300/0 conn(0x7f519c0b61b0 0x7f519c152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:46.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.643+0000 7f519a7fc700 1 -- 172.21.15.103:0/3113495980 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5184003230 con 0x7f519c0b4a30 2020-04-22T14:20:46.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.643+0000 7f519a7fc700 1 -- 172.21.15.103:0/3113495980 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2456789166 0 0) 0x7f5184003230 con 0x7f519c0b4a30 2020-04-22T14:20:46.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.643+0000 7f519a7fc700 1 -- 172.21.15.103:0/3113495980 >> v2:172.21.15.86:3300/0 conn(0x7f519c0b61b0 msgr2=0x7f519c152d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:46.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.643+0000 7f519a7fc700 1 --2- 172.21.15.103:0/3113495980 >> v2:172.21.15.86:3300/0 conn(0x7f519c0b61b0 0x7f519c152d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:46.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.643+0000 7f519a7fc700 1 -- 172.21.15.103:0/3113495980 >> v1:172.21.15.86:6789/0 conn(0x7f519c061290 legacy=0x7f519c156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:46.655 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.643+0000 7f519a7fc700 1 -- 172.21.15.103:0/3113495980 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519c061670 con 0x7f519c0b4a30 2020-04-22T14:20:46.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.643+0000 7f519a7fc700 1 -- 172.21.15.103:0/3113495980 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f51900016d0 con 0x7f519c0b4a30 2020-04-22T14:20:46.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.643+0000 7f519a7fc700 1 -- 172.21.15.103:0/3113495980 >> v1:172.21.15.103:6789/0 conn(0x7f519c0b4a30 legacy=0x7f519c07fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:46.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.643+0000 7f519a7fc700 1 --2- 172.21.15.103:0/3113495980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5184003770 0x7f5184003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:46.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.643+0000 7f519a7fc700 1 --2- 172.21.15.103:0/3113495980 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51840044d0 0x7f5184004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:46.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.643+0000 7f519a7fc700 1 --2- 172.21.15.103:0/3113495980 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5184004db0 0x7f518400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:46.656 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.643+0000 7f519a7fc700 1 -- 172.21.15.103:0/3113495980 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519c156860 con 0x7f51840044d0 2020-04-22T14:20:46.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.643+0000 7f519a7fc700 1 -- 172.21.15.103:0/3113495980 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5184005260 con 0x7f5184003770 2020-04-22T14:20:46.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.643+0000 7f519b7fe700 1 --2- 172.21.15.103:0/3113495980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5184003770 0x7f5184003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:46.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.643+0000 7f519a7fc700 1 -- 172.21.15.103:0/3113495980 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f518404fb90 con 0x7f5184004db0 2020-04-22T14:20:46.657 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.643+0000 7f519affd700 1 --2- 172.21.15.103:0/3113495980 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51840044d0 0x7f5184004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:46.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.643+0000 7f519bfff700 1 --2- 172.21.15.103:0/3113495980 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5184004db0 0x7f518400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:46.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.643+0000 7f519b7fe700 1 -- 172.21.15.103:0/3113495980 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5184004db0 msgr2=0x7f518400b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:46.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.643+0000 7f519b7fe700 1 --2- 172.21.15.103:0/3113495980 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5184004db0 0x7f518400b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:46.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.643+0000 7f519b7fe700 1 -- 172.21.15.103:0/3113495980 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51840044d0 msgr2=0x7f5184004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:46.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.643+0000 7f519b7fe700 1 --2- 172.21.15.103:0/3113495980 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51840044d0 0x7f5184004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:46.658 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.643+0000 7f519b7fe700 1 -- 172.21.15.103:0/3113495980 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5184003230 con 0x7f5184003770 2020-04-22T14:20:46.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.643+0000 7f519bfff700 1 --2- 172.21.15.103:0/3113495980 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5184004db0 0x7f518400b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:20:46.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.643+0000 7f519bfff700 1 -- 172.21.15.103:0/3113495980 reap_dead start 2020-04-22T14:20:46.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.643+0000 7f519b7fe700 1 --2- 172.21.15.103:0/3113495980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5184003770 0x7f5184003b90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f519c05b8d0 tx=0x7f518c010070).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:46.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.643+0000 7f519b7fe700 1 --2- 172.21.15.103:0/3113495980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5184003770 0x7f5184003b90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f519c05b8d0 tx=0x7f518c010070).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:46.659 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.643+0000 7f519b7fe700 1 --2- 172.21.15.103:0/3113495980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5184003770 0x7f5184003b90 secure :-1 s=READY pgs=2233 cs=0 l=1 rx=0x7f519c05b8d0 tx=0x7f518c010070).ready entity=mon.1 client_cookie=a9b4a8ec00ac537c server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:46.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.643+0000 7f519b7fe700 1 --2- 172.21.15.103:0/3113495980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5184003770 0x7f5184003b90 secure :-1 s=THROTTLE_DONE pgs=2233 cs=0 l=1 rx=0x7f519c05b8d0 tx=0x7f518c010070).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:46.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.643+0000 7f519b7fe700 1 --2- 172.21.15.103:0/3113495980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5184003770 0x7f5184003b90 secure :-1 s=THROTTLE_DONE pgs=2233 cs=0 l=1 rx=0x7f519c05b8d0 tx=0x7f518c010070).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:46.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.643+0000 7f519a7fc700 1 -- 172.21.15.103:0/3113495980 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f518c006c40 con 0x7f5184003770 2020-04-22T14:20:46.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.643+0000 7f519b7fe700 1 --2- 172.21.15.103:0/3113495980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5184003770 0x7f5184003b90 secure :-1 s=THROTTLE_DONE pgs=2233 cs=0 l=1 rx=0x7f519c05b8d0 tx=0x7f518c010070).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:46.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.643+0000 7f519a7fc700 1 -- 172.21.15.103:0/3113495980 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f518c006da0 con 0x7f5184003770 2020-04-22T14:20:46.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.643+0000 7f519a7fc700 1 -- 172.21.15.103:0/3113495980 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f518c002730 con 0x7f5184003770 2020-04-22T14:20:46.660 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.643+0000 7f51a1a15700 1 -- 172.21.15.103:0/3113495980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5184003770 msgr2=0x7f5184003b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:46.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.643+0000 7f51a1a15700 1 --2- 172.21.15.103:0/3113495980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5184003770 0x7f5184003b90 secure :-1 s=READY pgs=2233 cs=0 l=1 rx=0x7f519c05b8d0 tx=0x7f518c010070).stop 2020-04-22T14:20:46.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.644+0000 7f51a1a15700 1 -- 172.21.15.103:0/3113495980 shutdown_connections 2020-04-22T14:20:46.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.644+0000 7f51a1a15700 1 --2- 172.21.15.103:0/3113495980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5184003770 0x7f5184003b90 unknown :-1 s=CLOSED pgs=2233 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:46.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.644+0000 7f51a1a15700 1 -- 172.21.15.103:0/3113495980 >> 172.21.15.103:0/3113495980 conn(0x7f519c05ad30 msgr2=0x7f519c05b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:46.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.644+0000 7f51a1a15700 1 -- 172.21.15.103:0/3113495980 shutdown_connections 2020-04-22T14:20:46.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.644+0000 7f51a1a15700 1 -- 172.21.15.103:0/3113495980 wait complete. 2020-04-22T14:20:46.661 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.645+0000 7f51a1a15700 1 Processor -- start 2020-04-22T14:20:46.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.645+0000 7f51a1a15700 1 -- start start 2020-04-22T14:20:46.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.646+0000 7f51a1a15700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f519c0b1a00 0x7f519c141270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:46.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.646+0000 7f51a1a15700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f519c063010 con 0x7f5184003770 2020-04-22T14:20:46.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.646+0000 7f51a1a15700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f519c122f00 con 0x7f519c123360 2020-04-22T14:20:46.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.646+0000 7f51a1a15700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f519c0b1eb0 con 0x7f519c0b1a00 2020-04-22T14:20:46.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.646+0000 7f519affd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f519c0b1a00 0x7f519c141270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:46.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.646+0000 7f519bfff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f519c123360 0x7f519c1237b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51554/0 (socket says 172.21.15.103:51554) 2020-04-22T14:20:46.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.646+0000 7f519bfff700 1 -- 172.21.15.103:0/3933338518 learned_addr learned my addr 172.21.15.103:0/3933338518 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:46.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.646+0000 7f519affd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f519c0b1a00 0x7f519c141270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59366/0 (socket says 172.21.15.103:59366) 2020-04-22T14:20:46.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.646+0000 7f519affd700 1 -- 172.21.15.103:0/3933338518 >> v1:172.21.15.103:6789/0 conn(0x7f519c123360 legacy=0x7f519c1237b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:46.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.646+0000 7f519affd700 1 -- 172.21.15.103:0/3933338518 >> v1:172.21.15.86:6789/0 conn(0x7f5184003770 legacy=0x7f519c062900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:46.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.646+0000 7f5183fff700 1 -- 172.21.15.103:0/3933338518 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 863396511 0 0) 0x7f519c122f00 con 0x7f519c123360 2020-04-22T14:20:46.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.646+0000 7f519affd700 1 -- 172.21.15.103:0/3933338518 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519c1313c0 con 0x7f519c0b1a00 2020-04-22T14:20:46.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.646+0000 7f519affd700 1 --2- 172.21.15.103:0/3933338518 >> v2:172.21.15.103:3300/0 conn(0x7f519c0b1a00 0x7f519c141270 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f51900013e0 tx=0x7f519c061800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:46.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.646+0000 7f519affd700 1 --2- 172.21.15.103:0/3933338518 >> v2:172.21.15.103:3300/0 conn(0x7f519c0b1a00 0x7f519c141270 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f51900013e0 tx=0x7f519c061800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:46.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.646+0000 7f519affd700 1 --2- 172.21.15.103:0/3933338518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f519c0b1a00 0x7f519c141270 secure :-1 s=READY pgs=2235 cs=0 l=1 rx=0x7f51900013e0 tx=0x7f519c061800).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:46.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.647+0000 7f519affd700 1 --2- 172.21.15.103:0/3933338518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f519c0b1a00 0x7f519c141270 secure :-1 s=THROTTLE_DONE pgs=2235 cs=0 l=1 rx=0x7f51900013e0 tx=0x7f519c061800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:46.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.647+0000 7f5183fff700 1 -- 172.21.15.103:0/3933338518 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5190011c80 con 0x7f519c0b1a00 2020-04-22T14:20:46.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.647+0000 7f519affd700 1 --2- 172.21.15.103:0/3933338518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f519c0b1a00 0x7f519c141270 secure :-1 s=THROTTLE_DONE pgs=2235 cs=0 l=1 rx=0x7f51900013e0 tx=0x7f519c061800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:46.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.647+0000 7f519affd700 1 --2- 172.21.15.103:0/3933338518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f519c0b1a00 0x7f519c141270 secure :-1 s=THROTTLE_DONE pgs=2235 cs=0 l=1 rx=0x7f51900013e0 tx=0x7f519c061800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:46.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.647+0000 7f5183fff700 1 -- 172.21.15.103:0/3933338518 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5190011de0 con 0x7f519c0b1a00 2020-04-22T14:20:46.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.647+0000 7f51a1a15700 1 -- 172.21.15.103:0/3933338518 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f519c131660 con 0x7f519c0b1a00 2020-04-22T14:20:46.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.647+0000 7f5183fff700 1 -- 172.21.15.103:0/3933338518 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f519000c8f0 con 0x7f519c0b1a00 2020-04-22T14:20:46.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.647+0000 7f51a1a15700 1 -- 172.21.15.103:0/3933338518 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f519c131010 con 0x7f519c0b1a00 2020-04-22T14:20:46.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.647+0000 7f519affd700 1 --2- 172.21.15.103:0/3933338518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f519c0b1a00 0x7f519c141270 secure :-1 s=THROTTLE_DONE pgs=2235 cs=0 l=1 rx=0x7f51900013e0 tx=0x7f519c061800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:46.665 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.648+0000 7f51a1a15700 1 -- 172.21.15.103:0/3933338518 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f519c056c90 con 0x7f519c0b1a00 2020-04-22T14:20:46.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.648+0000 7f5183fff700 1 -- 172.21.15.103:0/3933338518 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f519000cb20 con 0x7f519c0b1a00 2020-04-22T14:20:46.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.648+0000 7f519affd700 1 --2- 172.21.15.103:0/3933338518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f519c0b1a00 0x7f519c141270 secure :-1 s=THROTTLE_DONE pgs=2235 cs=0 l=1 rx=0x7f51900013e0 tx=0x7f519c061800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:46.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.648+0000 7f5183fff700 1 --2- 172.21.15.103:0/3933338518 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f517c04d7e0 0x7f517c04fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:46.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.648+0000 7f5183fff700 1 -- 172.21.15.103:0/3933338518 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f51900610b0 con 0x7f519c0b1a00 2020-04-22T14:20:46.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.648+0000 7f519b7fe700 1 --2- 172.21.15.103:0/3933338518 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f517c04d7e0 0x7f517c04fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:46.666 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.648+0000 7f519b7fe700 1 --2- 172.21.15.103:0/3933338518 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f517c04d7e0 0x7f517c04fca0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f519c0b2490 tx=0x7f518c010070).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:46.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.649+0000 7f519b7fe700 1 --2- 172.21.15.103:0/3933338518 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f517c04d7e0 0x7f517c04fca0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f519c0b2490 tx=0x7f518c010070).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:46.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.649+0000 7f519b7fe700 1 --2- 172.21.15.103:0/3933338518 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f517c04d7e0 0x7f517c04fca0 secure :-1 s=READY pgs=810 cs=0 l=1 rx=0x7f519c0b2490 tx=0x7f518c010070).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:46.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.652+0000 7f519affd700 1 --2- 172.21.15.103:0/3933338518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f519c0b1a00 0x7f519c141270 secure :-1 s=THROTTLE_DONE pgs=2235 cs=0 l=1 rx=0x7f51900013e0 tx=0x7f519c061800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:46.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.652+0000 7f5183fff700 1 -- 172.21.15.103:0/3933338518 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f519003c430 con 0x7f519c0b1a00 2020-04-22T14:20:46.848 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.844+0000 7f51a1a15700 1 -- 172.21.15.103:0/3933338518 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f519c123090 con 0x7f519c0b1a00 2020-04-22T14:20:46.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.848+0000 7f519affd700 1 --2- 172.21.15.103:0/3933338518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f519c0b1a00 0x7f519c141270 secure :-1 s=THROTTLE_DONE pgs=2235 cs=0 l=1 rx=0x7f51900013e0 tx=0x7f519c061800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:46.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.848+0000 7f5183fff700 1 -- 172.21.15.103:0/3933338518 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v59) v1 ==== 184+0+0 (secure 0 0 0) 0x7f519003fa50 con 0x7f519c0b1a00 2020-04-22T14:20:46.857 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.850+0000 7f51a1a15700 1 -- 172.21.15.103:0/3933338518 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f517c04d7e0 msgr2=0x7f517c04fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:46.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.850+0000 7f51a1a15700 1 --2- 172.21.15.103:0/3933338518 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f517c04d7e0 0x7f517c04fca0 secure :-1 s=READY pgs=810 cs=0 l=1 rx=0x7f519c0b2490 tx=0x7f518c010070).stop 2020-04-22T14:20:46.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.850+0000 7f51a1a15700 1 -- 172.21.15.103:0/3933338518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f519c0b1a00 msgr2=0x7f519c141270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:46.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.850+0000 7f51a1a15700 1 --2- 172.21.15.103:0/3933338518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f519c0b1a00 0x7f519c141270 secure :-1 s=READY pgs=2235 cs=0 l=1 rx=0x7f51900013e0 tx=0x7f519c061800).stop 2020-04-22T14:20:46.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.850+0000 7f51a1a15700 1 -- 172.21.15.103:0/3933338518 shutdown_connections 2020-04-22T14:20:46.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.850+0000 7f51a1a15700 1 --2- 172.21.15.103:0/3933338518 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f517c04d7e0 0x7f517c04fca0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:46.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.850+0000 7f51a1a15700 1 --2- 172.21.15.103:0/3933338518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f519c0b1a00 0x7f519c141270 unknown :-1 s=CLOSED pgs=2235 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:46.858 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.850+0000 7f51a1a15700 1 -- 172.21.15.103:0/3933338518 >> 172.21.15.103:0/3933338518 conn(0x7f519c05ad30 msgr2=0x7f519c156c20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:46.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.850+0000 7f51a1a15700 1 -- 172.21.15.103:0/3933338518 shutdown_connections 2020-04-22T14:20:46.859 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:46.850+0000 7f51a1a15700 1 -- 172.21.15.103:0/3933338518 wait complete. 2020-04-22T14:20:46.859 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.2 2020-04-22T14:20:46.863 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:46.877 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-04-22T14:20:47.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.025+0000 7f0c55051700 1 Processor -- start 2020-04-22T14:20:47.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.025+0000 7f0c55051700 1 -- start start 2020-04-22T14:20:47.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.026+0000 7f0c55051700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0c50062170 0x7f0c500b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:47.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.026+0000 7f0c55051700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c50152e70 con 0x7f0c50152a90 2020-04-22T14:20:47.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.026+0000 7f0c55051700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c500b5650 con 0x7f0c500b5210 2020-04-22T14:20:47.033 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.026+0000 7f0c55051700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c500614f0 con 0x7f0c50062170 2020-04-22T14:20:47.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.026+0000 7f0c54850700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f0c500b5210 0x7f0c500adf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51564/0 (socket says 172.21.15.103:51564) 2020-04-22T14:20:47.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.026+0000 7f0c54850700 1 -- 172.21.15.103:0/2662414456 learned_addr learned my addr 172.21.15.103:0/2662414456 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:47.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.026+0000 7f0c4ed9d700 1 --2- 172.21.15.103:0/2662414456 >> v2:172.21.15.86:3300/0 conn(0x7f0c50062170 0x7f0c500b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:47.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.027+0000 7f0c4e59c700 1 -- 172.21.15.103:0/2662414456 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2828851339 0 0) 0x7f0c500b5650 con 0x7f0c500b5210 2020-04-22T14:20:47.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.027+0000 7f0c4e59c700 1 -- 172.21.15.103:0/2662414456 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c38003230 con 0x7f0c500b5210 2020-04-22T14:20:47.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.027+0000 7f0c4e59c700 1 -- 172.21.15.103:0/2662414456 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3125296297 0 0) 0x7f0c38003230 con 0x7f0c500b5210 2020-04-22T14:20:47.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.027+0000 7f0c4e59c700 1 -- 172.21.15.103:0/2662414456 >> v2:172.21.15.86:3300/0 conn(0x7f0c50062170 msgr2=0x7f0c500b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:47.034 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.027+0000 7f0c4e59c700 1 --2- 172.21.15.103:0/2662414456 >> v2:172.21.15.86:3300/0 conn(0x7f0c50062170 0x7f0c500b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:47.035 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.027+0000 7f0c4e59c700 1 -- 172.21.15.103:0/2662414456 >> v1:172.21.15.86:6789/0 conn(0x7f0c50152a90 legacy=0x7f0c500b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:47.035 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.027+0000 7f0c4e59c700 1 -- 172.21.15.103:0/2662414456 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c50061790 con 0x7f0c500b5210 2020-04-22T14:20:47.035 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.027+0000 7f0c4e59c700 1 -- 172.21.15.103:0/2662414456 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f0c480016d0 con 0x7f0c500b5210 2020-04-22T14:20:47.035 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.027+0000 7f0c4e59c700 1 -- 172.21.15.103:0/2662414456 >> v1:172.21.15.103:6789/0 conn(0x7f0c500b5210 legacy=0x7f0c500adf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:47.035 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.027+0000 7f0c4e59c700 1 --2- 172.21.15.103:0/2662414456 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0c38003720 0x7f0c38003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:47.035 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.027+0000 7f0c4e59c700 1 --2- 172.21.15.103:0/2662414456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c380044d0 0x7f0c38004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:47.035 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.027+0000 7f0c4e59c700 1 --2- 172.21.15.103:0/2662414456 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c38004db0 0x7f0c3800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:47.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.027+0000 7f0c4e59c700 1 -- 172.21.15.103:0/2662414456 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c500614f0 con 0x7f0c38004db0 2020-04-22T14:20:47.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.027+0000 7f0c4e59c700 1 -- 172.21.15.103:0/2662414456 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c380041c0 con 0x7f0c380044d0 2020-04-22T14:20:47.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.027+0000 7f0c4e59c700 1 -- 172.21.15.103:0/2662414456 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3804fb90 con 0x7f0c38003720 2020-04-22T14:20:47.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.027+0000 7f0c4ed9d700 1 --2- 172.21.15.103:0/2662414456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c380044d0 0x7f0c38004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:47.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.027+0000 7f0c54850700 1 --2- 172.21.15.103:0/2662414456 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c38004db0 0x7f0c3800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:47.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.027+0000 7f0c4f59e700 1 --2- 172.21.15.103:0/2662414456 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0c38003720 0x7f0c38003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:47.036 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.027+0000 7f0c4ed9d700 1 -- 172.21.15.103:0/2662414456 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0c38003720 msgr2=0x7f0c38003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:47.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.027+0000 7f0c4ed9d700 1 --2- 172.21.15.103:0/2662414456 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0c38003720 0x7f0c38003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:47.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.027+0000 7f0c4ed9d700 1 -- 172.21.15.103:0/2662414456 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c38004db0 msgr2=0x7f0c3800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:47.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.027+0000 7f0c4ed9d700 1 --2- 172.21.15.103:0/2662414456 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c38004db0 0x7f0c3800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:47.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.027+0000 7f0c4ed9d700 1 -- 172.21.15.103:0/2662414456 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c38003230 con 0x7f0c380044d0 2020-04-22T14:20:47.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.027+0000 7f0c54850700 1 --2- 172.21.15.103:0/2662414456 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c38004db0 0x7f0c3800b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:20:47.037 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.027+0000 7f0c54850700 1 -- 172.21.15.103:0/2662414456 reap_dead start 2020-04-22T14:20:47.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.027+0000 7f0c4ed9d700 1 --2- 172.21.15.103:0/2662414456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c380044d0 0x7f0c38004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0c380054a0 tx=0x7f0c5005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:47.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.027+0000 7f0c4ed9d700 1 --2- 172.21.15.103:0/2662414456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c380044d0 0x7f0c38004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0c380054a0 tx=0x7f0c5005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:47.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.027+0000 7f0c4ed9d700 1 --2- 172.21.15.103:0/2662414456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c380044d0 0x7f0c38004950 secure :-1 s=READY pgs=2237 cs=0 l=1 rx=0x7f0c380054a0 tx=0x7f0c5005a720).ready entity=mon.1 client_cookie=e2575b0ca0db716b server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:47.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.027+0000 7f0c4ed9d700 1 --2- 172.21.15.103:0/2662414456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c380044d0 0x7f0c38004950 secure :-1 s=THROTTLE_DONE pgs=2237 cs=0 l=1 rx=0x7f0c380054a0 tx=0x7f0c5005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:47.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.027+0000 7f0c4e59c700 1 -- 172.21.15.103:0/2662414456 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c44010dc0 con 0x7f0c380044d0 2020-04-22T14:20:47.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.027+0000 7f0c4ed9d700 1 --2- 172.21.15.103:0/2662414456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c380044d0 0x7f0c38004950 secure :-1 s=THROTTLE_DONE pgs=2237 cs=0 l=1 rx=0x7f0c380054a0 tx=0x7f0c5005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:47.038 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.027+0000 7f0c4ed9d700 1 --2- 172.21.15.103:0/2662414456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c380044d0 0x7f0c38004950 secure :-1 s=THROTTLE_DONE pgs=2237 cs=0 l=1 rx=0x7f0c380054a0 tx=0x7f0c5005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:47.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.027+0000 7f0c4e59c700 1 -- 172.21.15.103:0/2662414456 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c44008950 con 0x7f0c380044d0 2020-04-22T14:20:47.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.027+0000 7f0c4e59c700 1 -- 172.21.15.103:0/2662414456 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c44008cb0 con 0x7f0c380044d0 2020-04-22T14:20:47.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.027+0000 7f0c55051700 1 -- 172.21.15.103:0/2662414456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c380044d0 msgr2=0x7f0c38004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:47.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.027+0000 7f0c55051700 1 --2- 172.21.15.103:0/2662414456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c380044d0 0x7f0c38004950 secure :-1 s=READY pgs=2237 cs=0 l=1 rx=0x7f0c380054a0 tx=0x7f0c5005a720).stop 2020-04-22T14:20:47.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.028+0000 7f0c55051700 1 -- 172.21.15.103:0/2662414456 shutdown_connections 2020-04-22T14:20:47.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.028+0000 7f0c55051700 1 --2- 172.21.15.103:0/2662414456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c380044d0 0x7f0c38004950 unknown :-1 s=CLOSED pgs=2237 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:47.039 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.028+0000 7f0c55051700 1 -- 172.21.15.103:0/2662414456 >> 172.21.15.103:0/2662414456 conn(0x7f0c5005ad30 msgr2=0x7f0c5005b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:47.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.028+0000 7f0c55051700 1 -- 172.21.15.103:0/2662414456 shutdown_connections 2020-04-22T14:20:47.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.028+0000 7f0c55051700 1 -- 172.21.15.103:0/2662414456 wait complete. 2020-04-22T14:20:47.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.029+0000 7f0c55051700 1 Processor -- start 2020-04-22T14:20:47.040 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.029+0000 7f0c55051700 1 -- start start 2020-04-22T14:20:47.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.030+0000 7f0c55051700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0c5007fbe0 0x7f0c50134670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:47.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.030+0000 7f0c55051700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0c501329b0 0x7f0c500645a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:47.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.030+0000 7f0c55051700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c50066140 con 0x7f0c380044d0 2020-04-22T14:20:47.043 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.030+0000 7f0c55051700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c500663e0 con 0x7f0c5007fbe0 2020-04-22T14:20:47.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.030+0000 7f0c55051700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c50066680 con 0x7f0c501329b0 2020-04-22T14:20:47.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.030+0000 7f0c4ed9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0c5007fbe0 0x7f0c50134670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:47.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.030+0000 7f0c4ed9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0c5007fbe0 0x7f0c50134670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59384/0 (socket says 172.21.15.103:59384) 2020-04-22T14:20:47.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.030+0000 7f0c4ed9d700 1 -- 172.21.15.103:0/3287659119 learned_addr learned my addr 172.21.15.103:0/3287659119 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:47.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.030+0000 7f0c54850700 1 --2- 172.21.15.103:0/3287659119 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0c501329b0 0x7f0c500645a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:47.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.030+0000 7f0c4ed9d700 1 -- 172.21.15.103:0/3287659119 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0c501329b0 msgr2=0x7f0c500645a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:47.044 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.030+0000 7f0c4ed9d700 1 --2- 172.21.15.103:0/3287659119 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0c501329b0 0x7f0c500645a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:47.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.030+0000 7f0c4ed9d700 1 -- 172.21.15.103:0/3287659119 >> v1:172.21.15.86:6789/0 conn(0x7f0c380044d0 legacy=0x7f0c50132180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:47.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.030+0000 7f0c4ed9d700 1 -- 172.21.15.103:0/3287659119 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c50064a00 con 0x7f0c5007fbe0 2020-04-22T14:20:47.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.030+0000 7f0c4ed9d700 1 --2- 172.21.15.103:0/3287659119 >> v2:172.21.15.103:3300/0 conn(0x7f0c5007fbe0 0x7f0c50134670 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0c380054a0 tx=0x7f0c5005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:47.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.030+0000 7f0c4ed9d700 1 --2- 172.21.15.103:0/3287659119 >> v2:172.21.15.103:3300/0 conn(0x7f0c5007fbe0 0x7f0c50134670 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0c380054a0 tx=0x7f0c5005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:47.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.030+0000 7f0c4ed9d700 1 --2- 172.21.15.103:0/3287659119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c5007fbe0 0x7f0c50134670 secure :-1 s=READY pgs=2238 cs=0 l=1 rx=0x7f0c380054a0 tx=0x7f0c5005a720).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:47.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.030+0000 7f0c4ed9d700 1 --2- 172.21.15.103:0/3287659119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c5007fbe0 0x7f0c50134670 secure :-1 s=THROTTLE_DONE pgs=2238 cs=0 l=1 rx=0x7f0c380054a0 tx=0x7f0c5005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:47.045 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.031+0000 7f0c37fff700 1 -- 172.21.15.103:0/3287659119 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c440104e0 con 0x7f0c5007fbe0 2020-04-22T14:20:47.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.031+0000 7f0c4ed9d700 1 --2- 172.21.15.103:0/3287659119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c5007fbe0 0x7f0c50134670 secure :-1 s=THROTTLE_DONE pgs=2238 cs=0 l=1 rx=0x7f0c380054a0 tx=0x7f0c5005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:47.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.031+0000 7f0c4ed9d700 1 --2- 172.21.15.103:0/3287659119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c5007fbe0 0x7f0c50134670 secure :-1 s=THROTTLE_DONE pgs=2238 cs=0 l=1 rx=0x7f0c380054a0 tx=0x7f0c5005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:47.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.031+0000 7f0c37fff700 1 -- 172.21.15.103:0/3287659119 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c440056c0 con 0x7f0c5007fbe0 2020-04-22T14:20:47.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.031+0000 7f0c55051700 1 -- 172.21.15.103:0/3287659119 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c50064bf0 con 0x7f0c5007fbe0 2020-04-22T14:20:47.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.031+0000 7f0c37fff700 1 -- 172.21.15.103:0/3287659119 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c44005aa0 con 0x7f0c5007fbe0 2020-04-22T14:20:47.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.031+0000 7f0c55051700 1 -- 172.21.15.103:0/3287659119 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c50065090 con 0x7f0c5007fbe0 2020-04-22T14:20:47.046 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.031+0000 7f0c4ed9d700 1 --2- 172.21.15.103:0/3287659119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c5007fbe0 0x7f0c50134670 secure :-1 s=THROTTLE_DONE pgs=2238 cs=0 l=1 rx=0x7f0c380054a0 tx=0x7f0c5005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:47.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.032+0000 7f0c55051700 1 -- 172.21.15.103:0/3287659119 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c500667c0 con 0x7f0c5007fbe0 2020-04-22T14:20:47.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.032+0000 7f0c37fff700 1 -- 172.21.15.103:0/3287659119 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f0c44005ca0 con 0x7f0c5007fbe0 2020-04-22T14:20:47.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.032+0000 7f0c4ed9d700 1 --2- 172.21.15.103:0/3287659119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c5007fbe0 0x7f0c50134670 secure :-1 s=THROTTLE_DONE pgs=2238 cs=0 l=1 rx=0x7f0c380054a0 tx=0x7f0c5005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:47.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.032+0000 7f0c37fff700 1 --2- 172.21.15.103:0/3287659119 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0c3004d9c0 0x7f0c3004fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:47.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.032+0000 7f0c37fff700 1 -- 172.21.15.103:0/3287659119 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0c44061700 con 0x7f0c5007fbe0 2020-04-22T14:20:47.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.032+0000 7f0c4f59e700 1 --2- 172.21.15.103:0/3287659119 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0c3004d9c0 0x7f0c3004fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:47.047 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.032+0000 7f0c4f59e700 1 --2- 172.21.15.103:0/3287659119 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0c3004d9c0 0x7f0c3004fe80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0c500b3e00 tx=0x7f0c40003a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:47.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.033+0000 7f0c4f59e700 1 --2- 172.21.15.103:0/3287659119 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0c3004d9c0 0x7f0c3004fe80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0c500b3e00 tx=0x7f0c40003a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:47.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.033+0000 7f0c4f59e700 1 --2- 172.21.15.103:0/3287659119 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0c3004d9c0 0x7f0c3004fe80 secure :-1 s=READY pgs=811 cs=0 l=1 rx=0x7f0c500b3e00 tx=0x7f0c40003a30).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:47.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.036+0000 7f0c4ed9d700 1 --2- 172.21.15.103:0/3287659119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c5007fbe0 0x7f0c50134670 secure :-1 s=THROTTLE_DONE pgs=2238 cs=0 l=1 rx=0x7f0c380054a0 tx=0x7f0c5005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:47.048 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.036+0000 7f0c37fff700 1 -- 172.21.15.103:0/3287659119 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f0c4403cba0 con 0x7f0c5007fbe0 2020-04-22T14:20:47.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.229+0000 7f0c55051700 1 -- 172.21.15.103:0/3287659119 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f0c50056c90 con 0x7f0c5007fbe0 2020-04-22T14:20:47.238 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.235+0000 7f0c4ed9d700 1 --2- 172.21.15.103:0/3287659119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c5007fbe0 0x7f0c50134670 secure :-1 s=THROTTLE_DONE pgs=2238 cs=0 l=1 rx=0x7f0c380054a0 tx=0x7f0c5005a720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:47.239 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.235+0000 7f0c37fff700 1 -- 172.21.15.103:0/3287659119 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v60) v1 ==== 184+0+0 (secure 0 0 0) 0x7f0c440401c0 con 0x7f0c5007fbe0 2020-04-22T14:20:47.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.237+0000 7f0c55051700 1 -- 172.21.15.103:0/3287659119 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0c3004d9c0 msgr2=0x7f0c3004fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:47.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.237+0000 7f0c55051700 1 --2- 172.21.15.103:0/3287659119 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0c3004d9c0 0x7f0c3004fe80 secure :-1 s=READY pgs=811 cs=0 l=1 rx=0x7f0c500b3e00 tx=0x7f0c40003a30).stop 2020-04-22T14:20:47.241 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.237+0000 7f0c55051700 1 -- 172.21.15.103:0/3287659119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c5007fbe0 msgr2=0x7f0c50134670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:47.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.237+0000 7f0c55051700 1 --2- 172.21.15.103:0/3287659119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c5007fbe0 0x7f0c50134670 secure :-1 s=READY pgs=2238 cs=0 l=1 rx=0x7f0c380054a0 tx=0x7f0c5005a720).stop 2020-04-22T14:20:47.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.237+0000 7f0c55051700 1 -- 172.21.15.103:0/3287659119 shutdown_connections 2020-04-22T14:20:47.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.237+0000 7f0c55051700 1 --2- 172.21.15.103:0/3287659119 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0c3004d9c0 0x7f0c3004fe80 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:47.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.237+0000 7f0c55051700 1 --2- 172.21.15.103:0/3287659119 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0c501329b0 0x7f0c500645a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:47.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.237+0000 7f0c55051700 1 --2- 172.21.15.103:0/3287659119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c5007fbe0 0x7f0c50134670 unknown :-1 s=CLOSED pgs=2238 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:47.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.237+0000 7f0c55051700 1 -- 172.21.15.103:0/3287659119 >> 172.21.15.103:0/3287659119 conn(0x7f0c5005ad30 msgr2=0x7f0c5005c640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:47.242 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.237+0000 7f0c55051700 1 -- 172.21.15.103:0/3287659119 shutdown_connections 2020-04-22T14:20:47.243 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.237+0000 7f0c55051700 1 -- 172.21.15.103:0/3287659119 wait complete. 2020-04-22T14:20:47.243 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.3 2020-04-22T14:20:47.258 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:47.272 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:20:47.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.415+0000 7fc8b7fff700 1 Processor -- start 2020-04-22T14:20:47.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.415+0000 7fc8b7fff700 1 -- start start 2020-04-22T14:20:47.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.416+0000 7fc8b7fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc8b80620a0 0x7fc8b8142e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:47.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.416+0000 7fc8b7fff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8b8143810 con 0x7fc8b8143280 2020-04-22T14:20:47.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.416+0000 7fc8b7fff700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8b8143ab0 con 0x7fc8b80ad900 2020-04-22T14:20:47.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.416+0000 7fc8b7fff700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8b8143d50 con 0x7fc8b80620a0 2020-04-22T14:20:47.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.416+0000 7fc8b6ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc8b80620a0 0x7fc8b8142e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:47.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.416+0000 7fc8b77fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc8b80ad900 0x7fc8b80add90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51580/0 (socket says 172.21.15.103:51580) 2020-04-22T14:20:47.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.416+0000 7fc8b77fe700 1 -- 172.21.15.103:0/3899540292 learned_addr learned my addr 172.21.15.103:0/3899540292 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:47.422 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.416+0000 7fc8b6ffd700 1 -- 172.21.15.103:0/3899540292 >> v1:172.21.15.103:6789/0 conn(0x7fc8b80ad900 legacy=0x7fc8b80add90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:47.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.417+0000 7fc8b6ffd700 1 -- 172.21.15.103:0/3899540292 >> v1:172.21.15.86:6789/0 conn(0x7fc8b8143280 legacy=0x7fc8b8146ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:47.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.417+0000 7fc8b6ffd700 1 -- 172.21.15.103:0/3899540292 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b8062480 con 0x7fc8b80620a0 2020-04-22T14:20:47.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.417+0000 7fc8b6ffd700 1 --2- 172.21.15.103:0/3899540292 >> v2:172.21.15.103:3300/0 conn(0x7fc8b80620a0 0x7fc8b8142e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc8b80ad7e0 tx=0x7fc8ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:47.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.417+0000 7fc8b6ffd700 1 --2- 172.21.15.103:0/3899540292 >> v2:172.21.15.103:3300/0 conn(0x7fc8b80620a0 0x7fc8b8142e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc8b80ad7e0 tx=0x7fc8ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:47.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.417+0000 7fc8b6ffd700 1 --2- 172.21.15.103:0/3899540292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8b80620a0 0x7fc8b8142e20 secure :-1 s=READY pgs=2240 cs=0 l=1 rx=0x7fc8b80ad7e0 tx=0x7fc8ac007a40).ready entity=mon.1 client_cookie=718ffe6d02d30f3d server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:47.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.417+0000 7fc8b6ffd700 1 --2- 172.21.15.103:0/3899540292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8b80620a0 0x7fc8b8142e20 secure :-1 s=THROTTLE_DONE pgs=2240 cs=0 l=1 rx=0x7fc8b80ad7e0 tx=0x7fc8ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:47.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.417+0000 7fc8b5ffb700 1 -- 172.21.15.103:0/3899540292 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8ac008d00 con 0x7fc8b80620a0 2020-04-22T14:20:47.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.417+0000 7fc8b6ffd700 1 --2- 172.21.15.103:0/3899540292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8b80620a0 0x7fc8b8142e20 secure :-1 s=THROTTLE_DONE pgs=2240 cs=0 l=1 rx=0x7fc8b80ad7e0 tx=0x7fc8ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:47.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.417+0000 7fc8b5ffb700 1 -- 172.21.15.103:0/3899540292 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ac008e60 con 0x7fc8b80620a0 2020-04-22T14:20:47.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.417+0000 7fc8b6ffd700 1 --2- 172.21.15.103:0/3899540292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8b80620a0 0x7fc8b8142e20 secure :-1 s=THROTTLE_DONE pgs=2240 cs=0 l=1 rx=0x7fc8b80ad7e0 tx=0x7fc8ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:47.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.417+0000 7fc8b7fff700 1 -- 172.21.15.103:0/3899540292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8b80620a0 msgr2=0x7fc8b8142e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:47.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.417+0000 7fc8b5ffb700 1 -- 172.21.15.103:0/3899540292 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8ac011a30 con 0x7fc8b80620a0 2020-04-22T14:20:47.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.417+0000 7fc8b7fff700 1 --2- 172.21.15.103:0/3899540292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8b80620a0 0x7fc8b8142e20 secure :-1 s=READY pgs=2240 cs=0 l=1 rx=0x7fc8b80ad7e0 tx=0x7fc8ac007a40).stop 2020-04-22T14:20:47.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.417+0000 7fc8b7fff700 1 -- 172.21.15.103:0/3899540292 shutdown_connections 2020-04-22T14:20:47.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.417+0000 7fc8b7fff700 1 --2- 172.21.15.103:0/3899540292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8b80620a0 0x7fc8b8142e20 unknown :-1 s=CLOSED pgs=2240 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:47.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.417+0000 7fc8b7fff700 1 -- 172.21.15.103:0/3899540292 >> 172.21.15.103:0/3899540292 conn(0x7fc8b805b7c0 msgr2=0x7fc8b8061610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:47.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.417+0000 7fc8b7fff700 1 -- 172.21.15.103:0/3899540292 shutdown_connections 2020-04-22T14:20:47.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.417+0000 7fc8b7fff700 1 -- 172.21.15.103:0/3899540292 wait complete. 2020-04-22T14:20:47.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.418+0000 7fc8b7fff700 1 Processor -- start 2020-04-22T14:20:47.425 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.418+0000 7fc8b7fff700 1 -- start start 2020-04-22T14:20:47.428 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.419+0000 7fc8b7fff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc8b80620a0 0x7fc8b812dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:47.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.419+0000 7fc8b7fff700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc8b8143280 0x7fc8b80b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:47.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.419+0000 7fc8b7fff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8b812e150 con 0x7fc8b80ad900 2020-04-22T14:20:47.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.419+0000 7fc8b7fff700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8b812e3f0 con 0x7fc8b8143280 2020-04-22T14:20:47.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.419+0000 7fc8b7fff700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b812e690 con 0x7fc8b80620a0 2020-04-22T14:20:47.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.419+0000 7fc8b6ffd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc8b80620a0 0x7fc8b812dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:47.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.419+0000 7fc8b77fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc8b8143280 0x7fc8b80b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:47.429 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.419+0000 7fc8b77fe700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc8b8143280 0x7fc8b80b3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.103:56630/0 (socket says 172.21.15.103:56630) 2020-04-22T14:20:47.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.419+0000 7fc8b77fe700 1 -- 172.21.15.103:0/3038891481 learned_addr learned my addr 172.21.15.103:0/3038891481 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:47.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.419+0000 7fc8b6ffd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc8b80620a0 0x7fc8b812dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.103:44174/0 (socket says 172.21.15.103:44174) 2020-04-22T14:20:47.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.420+0000 7fc8b6ffd700 1 -- 172.21.15.103:0/3038891481 >> v2:172.21.15.86:3300/0 conn(0x7fc8b8143280 msgr2=0x7fc8b80b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:47.430 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.420+0000 7fc8b6ffd700 1 --2- 172.21.15.103:0/3038891481 >> v2:172.21.15.86:3300/0 conn(0x7fc8b8143280 0x7fc8b80b3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:47.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.420+0000 7fc8b6ffd700 1 -- 172.21.15.103:0/3038891481 >> v1:172.21.15.86:6789/0 conn(0x7fc8b80ad900 legacy=0x7fc8b80b35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:47.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.420+0000 7fc8b6ffd700 1 -- 172.21.15.103:0/3038891481 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b8142fb0 con 0x7fc8b80620a0 2020-04-22T14:20:47.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.420+0000 7fc8b77fe700 1 --2- 172.21.15.103:0/3038891481 >> v2:172.21.15.86:3300/0 conn(0x7fc8b8143280 0x7fc8b80b3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:20:47.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.420+0000 7fc8b6ffd700 1 --2- 172.21.15.103:0/3038891481 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc8b80620a0 0x7fc8b812dc40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc8b80ad7e0 tx=0x7fc8ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:47.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.420+0000 7fc8b6ffd700 1 --2- 172.21.15.103:0/3038891481 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc8b80620a0 0x7fc8b812dc40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc8b80ad7e0 tx=0x7fc8ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:47.431 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.420+0000 7fc8b6ffd700 1 --2- 172.21.15.103:0/3038891481 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc8b80620a0 0x7fc8b812dc40 secure :-1 s=READY pgs=212 cs=0 l=1 rx=0x7fc8b80ad7e0 tx=0x7fc8ac007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:47.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.420+0000 7fc8b6ffd700 1 --2- 172.21.15.103:0/3038891481 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc8b80620a0 0x7fc8b812dc40 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7fc8b80ad7e0 tx=0x7fc8ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:47.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.420+0000 7fc8a7fff700 1 -- 172.21.15.103:0/3038891481 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8ac007170 con 0x7fc8b80620a0 2020-04-22T14:20:47.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.420+0000 7fc8b6ffd700 1 --2- 172.21.15.103:0/3038891481 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc8b80620a0 0x7fc8b812dc40 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7fc8b80ad7e0 tx=0x7fc8ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:47.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.420+0000 7fc8a7fff700 1 -- 172.21.15.103:0/3038891481 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ac0072d0 con 0x7fc8b80620a0 2020-04-22T14:20:47.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.420+0000 7fc8b6ffd700 1 --2- 172.21.15.103:0/3038891481 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc8b80620a0 0x7fc8b812dc40 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7fc8b80ad7e0 tx=0x7fc8ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:47.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.420+0000 7fc8b7fff700 1 -- 172.21.15.103:0/3038891481 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8b812eb30 con 0x7fc8b80620a0 2020-04-22T14:20:47.432 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.420+0000 7fc8a7fff700 1 -- 172.21.15.103:0/3038891481 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8ac0056c0 con 0x7fc8b80620a0 2020-04-22T14:20:47.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.420+0000 7fc8b7fff700 1 -- 172.21.15.103:0/3038891481 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8b8151cd0 con 0x7fc8b80620a0 2020-04-22T14:20:47.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.421+0000 7fc8b6ffd700 1 --2- 172.21.15.103:0/3038891481 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc8b80620a0 0x7fc8b812dc40 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7fc8b80ad7e0 tx=0x7fc8ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:47.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.421+0000 7fc8b7fff700 1 -- 172.21.15.103:0/3038891481 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8b8056c90 con 0x7fc8b80620a0 2020-04-22T14:20:47.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.421+0000 7fc8a7fff700 1 -- 172.21.15.103:0/3038891481 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fc8ac0058c0 con 0x7fc8b80620a0 2020-04-22T14:20:47.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.421+0000 7fc8b6ffd700 1 --2- 172.21.15.103:0/3038891481 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc8b80620a0 0x7fc8b812dc40 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7fc8b80ad7e0 tx=0x7fc8ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:47.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.421+0000 7fc8a7fff700 1 --2- 172.21.15.103:0/3038891481 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc89404da20 0x7fc89404fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:47.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.421+0000 7fc8a7fff700 1 -- 172.21.15.103:0/3038891481 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc8ac061b70 con 0x7fc8b80620a0 2020-04-22T14:20:47.433 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.421+0000 7fc8b67fc700 1 --2- 172.21.15.103:0/3038891481 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc89404da20 0x7fc89404fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:47.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.422+0000 7fc8b67fc700 1 --2- 172.21.15.103:0/3038891481 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc89404da20 0x7fc89404fee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc8b80b16b0 tx=0x7fc8a8008970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:47.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.422+0000 7fc8b67fc700 1 --2- 172.21.15.103:0/3038891481 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc89404da20 0x7fc89404fee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc8b80b16b0 tx=0x7fc8a8008970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:47.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.422+0000 7fc8b67fc700 1 --2- 172.21.15.103:0/3038891481 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc89404da20 0x7fc89404fee0 secure :-1 s=READY pgs=812 cs=0 l=1 rx=0x7fc8b80b16b0 tx=0x7fc8a8008970).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:47.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.425+0000 7fc8b6ffd700 1 --2- 172.21.15.103:0/3038891481 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc8b80620a0 0x7fc8b812dc40 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7fc8b80ad7e0 tx=0x7fc8ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:47.434 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.425+0000 7fc8a7fff700 1 -- 172.21.15.103:0/3038891481 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fc8ac03d070 con 0x7fc8b80620a0 2020-04-22T14:20:47.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.613+0000 7fc8b7fff700 1 -- 172.21.15.103:0/3038891481 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8b80b49e0 con 0x7fc8b80620a0 2020-04-22T14:20:47.616 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.613+0000 7fc8b6ffd700 1 --2- 172.21.15.103:0/3038891481 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc8b80620a0 0x7fc8b812dc40 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7fc8b80ad7e0 tx=0x7fc8ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:47.617 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.613+0000 7fc8a7fff700 1 -- 172.21.15.103:0/3038891481 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 121 v121) v1 ==== 95+0+2149 (secure 0 0 0) 0x7fc8ac040690 con 0x7fc8b80620a0 2020-04-22T14:20:47.617 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:20:47.617 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":121,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6962,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2216876181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2216876181},{"type":"v1","addr":"172.21.15.86:6835","nonce":2216876181}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":117}],"filesystems":[{"mdsmap":{"epoch":121,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:20:42.936004+0000","modified":"2020-04-22T14:20:44.952601+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10201},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10201":{"gid":10201,"name":"a","rank":0,"incarnation":118,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/591150745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":591150745},{"type":"v1","addr":"172.21.15.103:6833","nonce":591150745}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2020-04-22T14:20:47.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.615+0000 7fc8b7fff700 1 -- 172.21.15.103:0/3038891481 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc89404da20 msgr2=0x7fc89404fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:47.618 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.615+0000 7fc8b7fff700 1 --2- 172.21.15.103:0/3038891481 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc89404da20 0x7fc89404fee0 secure :-1 s=READY pgs=812 cs=0 l=1 rx=0x7fc8b80b16b0 tx=0x7fc8a8008970).stop 2020-04-22T14:20:47.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.615+0000 7fc8b7fff700 1 -- 172.21.15.103:0/3038891481 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc8b80620a0 msgr2=0x7fc8b812dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:47.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.615+0000 7fc8b7fff700 1 --2- 172.21.15.103:0/3038891481 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc8b80620a0 0x7fc8b812dc40 secure :-1 s=READY pgs=212 cs=0 l=1 rx=0x7fc8b80ad7e0 tx=0x7fc8ac007a40).stop 2020-04-22T14:20:47.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.615+0000 7fc8b7fff700 1 -- 172.21.15.103:0/3038891481 shutdown_connections 2020-04-22T14:20:47.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.615+0000 7fc8b7fff700 1 --2- 172.21.15.103:0/3038891481 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fc89404da20 0x7fc89404fee0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:47.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.615+0000 7fc8b7fff700 1 --2- 172.21.15.103:0/3038891481 >> v2:172.21.15.86:3300/0 conn(0x7fc8b8143280 0x7fc8b80b3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:47.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.615+0000 7fc8b7fff700 1 --2- 172.21.15.103:0/3038891481 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc8b80620a0 0x7fc8b812dc40 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:47.619 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.615+0000 7fc8b7fff700 1 -- 172.21.15.103:0/3038891481 >> 172.21.15.103:0/3038891481 conn(0x7fc8b805b7c0 msgr2=0x7fc8b80b7020 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:47.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.615+0000 7fc8b7fff700 1 -- 172.21.15.103:0/3038891481 shutdown_connections 2020-04-22T14:20:47.620 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:47.615+0000 7fc8b7fff700 1 -- 172.21.15.103:0/3038891481 wait complete. 2020-04-22T14:20:47.620 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 121 2020-04-22T14:20:47.834 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 10201}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 27, u'failed': [], u'epoch': 121, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [28], u'info': {u'gid_10201': {u'export_targets': [], u'name': u'a', u'incarnation': 118, u'state_seq': 3, u'state': u'up:active', u'gid': 10201, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 591150745, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 591150745, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/591150745'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:20:42.936004+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:20:44.952601+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:20:47.834 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:20:47.834 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:47.848 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:20:48.007 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:20:48.008 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:20:48.008 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:20:48.008 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 10201, 2020-04-22T14:20:48.008 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:20:48.008 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:20:48.008 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 5.0681491469999997, 2020-04-22T14:20:48.009 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 121, 2020-04-22T14:20:48.009 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 158, 2020-04-22T14:20:48.009 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 158, 2020-04-22T14:20:48.009 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 10.279631897 2020-04-22T14:20:48.009 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:20:48.016 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 10201, "want_state": "up:active", "state": "up:active", "rank_uptime": 5.0681491469999997, "mdsmap_epoch": 121, "osdmap_epoch": 158, "osdmap_epoch_barrier": 158, "uptime": 10.279631897 } 2020-04-22T14:20:48.016 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:48.030 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:20:48.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.174+0000 7f66ccbb7700 1 Processor -- start 2020-04-22T14:20:48.177 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.174+0000 7f66ccbb7700 1 -- start start 2020-04-22T14:20:48.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.175+0000 7f66ccbb7700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f66c8067170 0x7f66c80b6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:48.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.175+0000 7f66ccbb7700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66c8064ec0 con 0x7f66c81426d0 2020-04-22T14:20:48.184 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.175+0000 7f66ccbb7700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66c8146870 con 0x7f66c80ac740 2020-04-22T14:20:48.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.175+0000 7f66ccbb7700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66c8065af0 con 0x7f66c8067170 2020-04-22T14:20:48.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.175+0000 7f66c5d9b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f66c80ac740 0x7f66c813c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51594/0 (socket says 172.21.15.103:51594) 2020-04-22T14:20:48.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.175+0000 7f66c5d9b700 1 -- 172.21.15.103:0/3680390556 learned_addr learned my addr 172.21.15.103:0/3680390556 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:48.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.175+0000 7f66c559a700 1 -- 172.21.15.103:0/3680390556 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 358804693 0 0) 0x7f66c8146870 con 0x7f66c80ac740 2020-04-22T14:20:48.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.175+0000 7f66c559a700 1 -- 172.21.15.103:0/3680390556 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66a8003230 con 0x7f66c80ac740 2020-04-22T14:20:48.185 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.175+0000 7f66c659c700 1 --2- 172.21.15.103:0/3680390556 >> v2:172.21.15.86:3300/0 conn(0x7f66c8067170 0x7f66c80b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:48.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.175+0000 7f66c559a700 1 -- 172.21.15.103:0/3680390556 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3530048645 0 0) 0x7f66a8003230 con 0x7f66c80ac740 2020-04-22T14:20:48.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.175+0000 7f66c559a700 1 -- 172.21.15.103:0/3680390556 >> v2:172.21.15.86:3300/0 conn(0x7f66c8067170 msgr2=0x7f66c80b6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:48.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.175+0000 7f66c559a700 1 --2- 172.21.15.103:0/3680390556 >> v2:172.21.15.86:3300/0 conn(0x7f66c8067170 0x7f66c80b6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:48.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.175+0000 7f66c559a700 1 -- 172.21.15.103:0/3680390556 >> v1:172.21.15.86:6789/0 conn(0x7f66c81426d0 legacy=0x7f66c8142b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:48.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.175+0000 7f66c559a700 1 -- 172.21.15.103:0/3680390556 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c8067550 con 0x7f66c80ac740 2020-04-22T14:20:48.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.176+0000 7f66c559a700 1 -- 172.21.15.103:0/3680390556 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f66b00016d0 con 0x7f66c80ac740 2020-04-22T14:20:48.186 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.176+0000 7f66c559a700 1 -- 172.21.15.103:0/3680390556 >> v1:172.21.15.103:6789/0 conn(0x7f66c80ac740 legacy=0x7f66c813c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:48.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.176+0000 7f66c559a700 1 --2- 172.21.15.103:0/3680390556 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66a8003720 0x7f66a8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:48.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.176+0000 7f66c559a700 1 --2- 172.21.15.103:0/3680390556 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66a80044d0 0x7f66a8004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:48.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.176+0000 7f66c559a700 1 --2- 172.21.15.103:0/3680390556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66a8004db0 0x7f66a800c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:48.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.176+0000 7f66c559a700 1 -- 172.21.15.103:0/3680390556 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c8065af0 con 0x7f66a8004db0 2020-04-22T14:20:48.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.176+0000 7f66c559a700 1 -- 172.21.15.103:0/3680390556 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a80041c0 con 0x7f66a8003720 2020-04-22T14:20:48.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.176+0000 7f66c559a700 1 -- 172.21.15.103:0/3680390556 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a800cc90 con 0x7f66a80044d0 2020-04-22T14:20:48.187 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.176+0000 7f66c659c700 1 --2- 172.21.15.103:0/3680390556 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66a8003720 0x7f66a8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:48.188 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.176+0000 7f66c5d9b700 1 --2- 172.21.15.103:0/3680390556 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66a80044d0 0x7f66a8004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:48.188 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.176+0000 7f66c6d9d700 1 --2- 172.21.15.103:0/3680390556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66a8004db0 0x7f66a800c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:48.188 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.176+0000 7f66c659c700 1 -- 172.21.15.103:0/3680390556 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66a80044d0 msgr2=0x7f66a8004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:48.188 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.176+0000 7f66c659c700 1 --2- 172.21.15.103:0/3680390556 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66a80044d0 0x7f66a8004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:48.188 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.176+0000 7f66c659c700 1 -- 172.21.15.103:0/3680390556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66a8004db0 msgr2=0x7f66a800c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:48.188 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.176+0000 7f66c659c700 1 --2- 172.21.15.103:0/3680390556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66a8004db0 0x7f66a800c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:48.188 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.176+0000 7f66c659c700 1 -- 172.21.15.103:0/3680390556 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a8003230 con 0x7f66a8003720 2020-04-22T14:20:48.193 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.176+0000 7f66c6d9d700 1 -- 172.21.15.103:0/3680390556 reap_dead start 2020-04-22T14:20:48.193 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.176+0000 7f66c5d9b700 1 --2- 172.21.15.103:0/3680390556 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66a80044d0 0x7f66a8004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:20:48.193 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.176+0000 7f66c659c700 1 --2- 172.21.15.103:0/3680390556 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66a8003720 0x7f66a8003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f66a80054a0 tx=0x7f66c0010480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.193 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.176+0000 7f66c659c700 1 --2- 172.21.15.103:0/3680390556 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66a8003720 0x7f66a8003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f66a80054a0 tx=0x7f66c0010480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.193 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.176+0000 7f66c659c700 1 --2- 172.21.15.103:0/3680390556 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66a8003720 0x7f66a8003b40 secure :-1 s=READY pgs=2242 cs=0 l=1 rx=0x7f66a80054a0 tx=0x7f66c0010480).ready entity=mon.1 client_cookie=1b72400be5cd0546 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:48.193 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.176+0000 7f66c659c700 1 --2- 172.21.15.103:0/3680390556 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66a8003720 0x7f66a8003b40 secure :-1 s=THROTTLE_DONE pgs=2242 cs=0 l=1 rx=0x7f66a80054a0 tx=0x7f66c0010480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.193 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.176+0000 7f66c559a700 1 -- 172.21.15.103:0/3680390556 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66c0005c30 con 0x7f66a8003720 2020-04-22T14:20:48.194 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.176+0000 7f66c659c700 1 --2- 172.21.15.103:0/3680390556 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66a8003720 0x7f66a8003b40 secure :-1 s=THROTTLE_DONE pgs=2242 cs=0 l=1 rx=0x7f66a80054a0 tx=0x7f66c0010480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.194 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.176+0000 7f66c659c700 1 --2- 172.21.15.103:0/3680390556 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66a8003720 0x7f66a8003b40 secure :-1 s=THROTTLE_DONE pgs=2242 cs=0 l=1 rx=0x7f66a80054a0 tx=0x7f66c0010480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.194 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.176+0000 7f66c559a700 1 -- 172.21.15.103:0/3680390556 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c0005d90 con 0x7f66a8003720 2020-04-22T14:20:48.194 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.176+0000 7f66c559a700 1 -- 172.21.15.103:0/3680390556 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66c00112c0 con 0x7f66a8003720 2020-04-22T14:20:48.194 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.176+0000 7f66ccbb7700 1 -- 172.21.15.103:0/3680390556 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66a8003720 msgr2=0x7f66a8003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:48.194 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.176+0000 7f66ccbb7700 1 --2- 172.21.15.103:0/3680390556 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66a8003720 0x7f66a8003b40 secure :-1 s=READY pgs=2242 cs=0 l=1 rx=0x7f66a80054a0 tx=0x7f66c0010480).stop 2020-04-22T14:20:48.194 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.177+0000 7f66ccbb7700 1 -- 172.21.15.103:0/3680390556 shutdown_connections 2020-04-22T14:20:48.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.177+0000 7f66ccbb7700 1 --2- 172.21.15.103:0/3680390556 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66a8003720 0x7f66a8003b40 unknown :-1 s=CLOSED pgs=2242 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:48.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.177+0000 7f66ccbb7700 1 -- 172.21.15.103:0/3680390556 >> 172.21.15.103:0/3680390556 conn(0x7f66c80b9160 msgr2=0x7f66c805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:48.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.177+0000 7f66ccbb7700 1 -- 172.21.15.103:0/3680390556 shutdown_connections 2020-04-22T14:20:48.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.177+0000 7f66ccbb7700 1 -- 172.21.15.103:0/3680390556 wait complete. 2020-04-22T14:20:48.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.178+0000 7f66ccbb7700 1 Processor -- start 2020-04-22T14:20:48.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.178+0000 7f66ccbb7700 1 -- start start 2020-04-22T14:20:48.195 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.178+0000 7f66ccbb7700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f66a8003720 0x7f66c80aefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:48.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.178+0000 7f66ccbb7700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66c8144cf0 0x7f66c8145140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:48.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.178+0000 7f66ccbb7700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66c814f190 con 0x7f66c8140d70 2020-04-22T14:20:48.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.178+0000 7f66ccbb7700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66c80af7a0 con 0x7f66a8003720 2020-04-22T14:20:48.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.178+0000 7f66ccbb7700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c8140630 con 0x7f66c8144cf0 2020-04-22T14:20:48.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.178+0000 7f66c659c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f66a8003720 0x7f66c80aefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:48.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.178+0000 7f66c5d9b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f66c8140d70 0x7f66c8151d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51608/0 (socket says 172.21.15.103:51608) 2020-04-22T14:20:48.196 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.178+0000 7f66c659c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f66a8003720 0x7f66c80aefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59416/0 (socket says 172.21.15.103:59416) 2020-04-22T14:20:48.197 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.178+0000 7f66c5d9b700 1 -- 172.21.15.103:0/3394527898 learned_addr learned my addr 172.21.15.103:0/3394527898 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:48.197 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.179+0000 7f66c6d9d700 1 --2- 172.21.15.103:0/3394527898 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66c8144cf0 0x7f66c8145140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:48.197 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.179+0000 7f66c659c700 1 -- 172.21.15.103:0/3394527898 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66c8144cf0 msgr2=0x7f66c8145140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:48.197 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.179+0000 7f66c659c700 1 --2- 172.21.15.103:0/3394527898 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66c8144cf0 0x7f66c8145140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:48.197 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.179+0000 7f66c659c700 1 -- 172.21.15.103:0/3394527898 >> v1:172.21.15.103:6789/0 conn(0x7f66c8140d70 legacy=0x7f66c8151d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:48.197 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.179+0000 7f66bf7fe700 1 -- 172.21.15.103:0/3394527898 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 756169914 0 0) 0x7f66c814f190 con 0x7f66c8140d70 2020-04-22T14:20:48.197 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.179+0000 7f66c659c700 1 -- 172.21.15.103:0/3394527898 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c81408d0 con 0x7f66a8003720 2020-04-22T14:20:48.197 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.179+0000 7f66c659c700 1 --2- 172.21.15.103:0/3394527898 >> v2:172.21.15.103:3300/0 conn(0x7f66a8003720 0x7f66c80aefe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f66c8140c50 tx=0x7f66c0010480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.179+0000 7f66c659c700 1 --2- 172.21.15.103:0/3394527898 >> v2:172.21.15.103:3300/0 conn(0x7f66a8003720 0x7f66c80aefe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f66c8140c50 tx=0x7f66c0010480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.179+0000 7f66c659c700 1 --2- 172.21.15.103:0/3394527898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66a8003720 0x7f66c80aefe0 secure :-1 s=READY pgs=2244 cs=0 l=1 rx=0x7f66c8140c50 tx=0x7f66c0010480).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:48.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.179+0000 7f66c659c700 1 --2- 172.21.15.103:0/3394527898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66a8003720 0x7f66c80aefe0 secure :-1 s=THROTTLE_DONE pgs=2244 cs=0 l=1 rx=0x7f66c8140c50 tx=0x7f66c0010480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.179+0000 7f66bf7fe700 1 -- 172.21.15.103:0/3394527898 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66c0010890 con 0x7f66a8003720 2020-04-22T14:20:48.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.179+0000 7f66c659c700 1 --2- 172.21.15.103:0/3394527898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66a8003720 0x7f66c80aefe0 secure :-1 s=THROTTLE_DONE pgs=2244 cs=0 l=1 rx=0x7f66c8140c50 tx=0x7f66c0010480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.179+0000 7f66bf7fe700 1 -- 172.21.15.103:0/3394527898 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c000fbb0 con 0x7f66a8003720 2020-04-22T14:20:48.198 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.179+0000 7f66c659c700 1 --2- 172.21.15.103:0/3394527898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66a8003720 0x7f66c80aefe0 secure :-1 s=THROTTLE_DONE pgs=2244 cs=0 l=1 rx=0x7f66c8140c50 tx=0x7f66c0010480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.179+0000 7f66ccbb7700 1 -- 172.21.15.103:0/3394527898 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66c8152480 con 0x7f66a8003720 2020-04-22T14:20:48.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.179+0000 7f66bf7fe700 1 -- 172.21.15.103:0/3394527898 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66c0005e20 con 0x7f66a8003720 2020-04-22T14:20:48.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.179+0000 7f66ccbb7700 1 -- 172.21.15.103:0/3394527898 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c80b0b60 con 0x7f66a8003720 2020-04-22T14:20:48.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.180+0000 7f66c659c700 1 --2- 172.21.15.103:0/3394527898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66a8003720 0x7f66c80aefe0 secure :-1 s=THROTTLE_DONE pgs=2244 cs=0 l=1 rx=0x7f66c8140c50 tx=0x7f66c0010480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.180+0000 7f66bf7fe700 1 -- 172.21.15.103:0/3394527898 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f66c0011970 con 0x7f66a8003720 2020-04-22T14:20:48.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.180+0000 7f66c659c700 1 --2- 172.21.15.103:0/3394527898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66a8003720 0x7f66c80aefe0 secure :-1 s=THROTTLE_DONE pgs=2244 cs=0 l=1 rx=0x7f66c8140c50 tx=0x7f66c0010480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.199 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.180+0000 7f66ccbb7700 1 -- 172.21.15.103:0/3394527898 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66c8140a60 con 0x7f66a8003720 2020-04-22T14:20:48.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.180+0000 7f66bf7fe700 1 --2- 172.21.15.103:0/3394527898 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f66ac04d8d0 0x7f66ac04fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:48.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.180+0000 7f66bf7fe700 1 -- 172.21.15.103:0/3394527898 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f66c0061f60 con 0x7f66a8003720 2020-04-22T14:20:48.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.181+0000 7f66c5d9b700 1 --2- 172.21.15.103:0/3394527898 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f66ac04d8d0 0x7f66ac04fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:48.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.181+0000 7f66c5d9b700 1 --2- 172.21.15.103:0/3394527898 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f66ac04d8d0 0x7f66ac04fd90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f66b0001e50 tx=0x7f66c80676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.181+0000 7f66c5d9b700 1 --2- 172.21.15.103:0/3394527898 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f66ac04d8d0 0x7f66ac04fd90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f66b0001e50 tx=0x7f66c80676e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.200 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.181+0000 7f66c5d9b700 1 --2- 172.21.15.103:0/3394527898 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f66ac04d8d0 0x7f66ac04fd90 secure :-1 s=READY pgs=813 cs=0 l=1 rx=0x7f66b0001e50 tx=0x7f66c80676e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:48.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.184+0000 7f66c659c700 1 --2- 172.21.15.103:0/3394527898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66a8003720 0x7f66c80aefe0 secure :-1 s=THROTTLE_DONE pgs=2244 cs=0 l=1 rx=0x7f66c8140c50 tx=0x7f66c0010480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.202 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.185+0000 7f66bf7fe700 1 -- 172.21.15.103:0/3394527898 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f66c003d400 con 0x7f66a8003720 2020-04-22T14:20:48.330 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.327+0000 7f66ccbb7700 1 -- 172.21.15.103:0/3394527898 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66c8056c90 con 0x7f66a8003720 2020-04-22T14:20:48.331 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.328+0000 7f66c659c700 1 --2- 172.21.15.103:0/3394527898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66a8003720 0x7f66c80aefe0 secure :-1 s=THROTTLE_DONE pgs=2244 cs=0 l=1 rx=0x7f66c8140c50 tx=0x7f66c0010480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.332 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.328+0000 7f66bf7fe700 1 -- 172.21.15.103:0/3394527898 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v158) v1 ==== 74+0+16103 (secure 0 0 0) 0x7f66c0040a20 con 0x7f66a8003720 2020-04-22T14:20:48.332 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:20:48.332 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":158,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:20:43.937239+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:20:40.847124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2020-04-22T14:20:41.893982+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:20:48.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.329+0000 7f66ccbb7700 1 -- 172.21.15.103:0/3394527898 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f66ac04d8d0 msgr2=0x7f66ac04fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:48.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.329+0000 7f66ccbb7700 1 --2- 172.21.15.103:0/3394527898 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f66ac04d8d0 0x7f66ac04fd90 secure :-1 s=READY pgs=813 cs=0 l=1 rx=0x7f66b0001e50 tx=0x7f66c80676e0).stop 2020-04-22T14:20:48.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.329+0000 7f66ccbb7700 1 -- 172.21.15.103:0/3394527898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66a8003720 msgr2=0x7f66c80aefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:48.333 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.329+0000 7f66ccbb7700 1 --2- 172.21.15.103:0/3394527898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66a8003720 0x7f66c80aefe0 secure :-1 s=READY pgs=2244 cs=0 l=1 rx=0x7f66c8140c50 tx=0x7f66c0010480).stop 2020-04-22T14:20:48.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.329+0000 7f66ccbb7700 1 -- 172.21.15.103:0/3394527898 shutdown_connections 2020-04-22T14:20:48.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.329+0000 7f66ccbb7700 1 --2- 172.21.15.103:0/3394527898 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f66ac04d8d0 0x7f66ac04fd90 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:48.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.329+0000 7f66ccbb7700 1 --2- 172.21.15.103:0/3394527898 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66c8144cf0 0x7f66c8145140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:48.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.329+0000 7f66ccbb7700 1 --2- 172.21.15.103:0/3394527898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66a8003720 0x7f66c80aefe0 unknown :-1 s=CLOSED pgs=2244 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:48.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.329+0000 7f66ccbb7700 1 -- 172.21.15.103:0/3394527898 >> 172.21.15.103:0/3394527898 conn(0x7f66c80b9160 msgr2=0x7f66c80b55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:48.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.329+0000 7f66ccbb7700 1 -- 172.21.15.103:0/3394527898 shutdown_connections 2020-04-22T14:20:48.334 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.329+0000 7f66ccbb7700 1 -- 172.21.15.103:0/3394527898 wait complete. 2020-04-22T14:20:48.343 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:20:40.847124+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 27, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'157', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:20:41.893982+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 28, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'158', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:20:48.345 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:48.358 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:20:48.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.504+0000 7fe53686a700 1 Processor -- start 2020-04-22T14:20:48.508 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.504+0000 7fe53686a700 1 -- start start 2020-04-22T14:20:48.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.505+0000 7fe53686a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe5300ac950 0x7fe530146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:48.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.505+0000 7fe53686a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe5301470a0 0x7fe530143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:48.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.505+0000 7fe53686a700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5301467e0 con 0x7fe5300b9140 2020-04-22T14:20:48.515 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.505+0000 7fe53686a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe530147530 con 0x7fe5301470a0 2020-04-22T14:20:48.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.505+0000 7fe53686a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5300602f0 con 0x7fe5300ac950 2020-04-22T14:20:48.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.505+0000 7fe52f7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe5300ac950 0x7fe530146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:48.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.505+0000 7fe52f7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe5300ac950 0x7fe530146c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59426/0 (socket says 172.21.15.103:59426) 2020-04-22T14:20:48.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.505+0000 7fe52f7fe700 1 -- 172.21.15.103:0/2171102310 learned_addr learned my addr 172.21.15.103:0/2171102310 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:48.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.505+0000 7fe534e07700 1 --2- 172.21.15.103:0/2171102310 >> v2:172.21.15.86:3300/0 conn(0x7fe5301470a0 0x7fe530143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:48.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.505+0000 7fe52f7fe700 1 -- 172.21.15.103:0/2171102310 >> v2:172.21.15.86:3300/0 conn(0x7fe5301470a0 msgr2=0x7fe530143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:48.516 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.505+0000 7fe52f7fe700 1 --2- 172.21.15.103:0/2171102310 >> v2:172.21.15.86:3300/0 conn(0x7fe5301470a0 0x7fe530143090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:48.517 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.505+0000 7fe52f7fe700 1 -- 172.21.15.103:0/2171102310 >> v1:172.21.15.86:6789/0 conn(0x7fe5300b9140 legacy=0x7fe53012b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:48.517 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.505+0000 7fe52f7fe700 1 -- 172.21.15.103:0/2171102310 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe530060050 con 0x7fe5300ac950 2020-04-22T14:20:48.518 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.505+0000 7fe534e07700 1 --2- 172.21.15.103:0/2171102310 >> v2:172.21.15.86:3300/0 conn(0x7fe5301470a0 0x7fe530143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:20:48.518 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.505+0000 7fe52f7fe700 1 --2- 172.21.15.103:0/2171102310 >> v2:172.21.15.103:3300/0 conn(0x7fe5300ac950 0x7fe530146c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe524002f30 tx=0x7fe524007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.518 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.505+0000 7fe52f7fe700 1 --2- 172.21.15.103:0/2171102310 >> v2:172.21.15.103:3300/0 conn(0x7fe5300ac950 0x7fe530146c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe524002f30 tx=0x7fe524007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.518 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.505+0000 7fe52f7fe700 1 --2- 172.21.15.103:0/2171102310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5300ac950 0x7fe530146c40 secure :-1 s=READY pgs=2245 cs=0 l=1 rx=0x7fe524002f30 tx=0x7fe524007a40).ready entity=mon.1 client_cookie=c045206cf3963a92 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:48.518 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.505+0000 7fe52f7fe700 1 --2- 172.21.15.103:0/2171102310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5300ac950 0x7fe530146c40 secure :-1 s=THROTTLE_DONE pgs=2245 cs=0 l=1 rx=0x7fe524002f30 tx=0x7fe524007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.518 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.505+0000 7fe52effd700 1 -- 172.21.15.103:0/2171102310 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe524011720 con 0x7fe5300ac950 2020-04-22T14:20:48.518 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.505+0000 7fe52f7fe700 1 --2- 172.21.15.103:0/2171102310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5300ac950 0x7fe530146c40 secure :-1 s=THROTTLE_DONE pgs=2245 cs=0 l=1 rx=0x7fe524002f30 tx=0x7fe524007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.519 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.505+0000 7fe52f7fe700 1 --2- 172.21.15.103:0/2171102310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5300ac950 0x7fe530146c40 secure :-1 s=THROTTLE_DONE pgs=2245 cs=0 l=1 rx=0x7fe524002f30 tx=0x7fe524007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.519 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.505+0000 7fe52effd700 1 -- 172.21.15.103:0/2171102310 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe524011880 con 0x7fe5300ac950 2020-04-22T14:20:48.519 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.505+0000 7fe52effd700 1 -- 172.21.15.103:0/2171102310 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe524011ca0 con 0x7fe5300ac950 2020-04-22T14:20:48.519 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.505+0000 7fe53686a700 1 -- 172.21.15.103:0/2171102310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5300ac950 msgr2=0x7fe530146c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:48.519 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.505+0000 7fe53686a700 1 --2- 172.21.15.103:0/2171102310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5300ac950 0x7fe530146c40 secure :-1 s=READY pgs=2245 cs=0 l=1 rx=0x7fe524002f30 tx=0x7fe524007a40).stop 2020-04-22T14:20:48.519 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.506+0000 7fe53686a700 1 -- 172.21.15.103:0/2171102310 shutdown_connections 2020-04-22T14:20:48.519 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.506+0000 7fe53686a700 1 --2- 172.21.15.103:0/2171102310 >> v2:172.21.15.86:3300/0 conn(0x7fe5301470a0 0x7fe530143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:48.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.506+0000 7fe53686a700 1 --2- 172.21.15.103:0/2171102310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5300ac950 0x7fe530146c40 unknown :-1 s=CLOSED pgs=2245 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:48.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.506+0000 7fe53686a700 1 -- 172.21.15.103:0/2171102310 >> 172.21.15.103:0/2171102310 conn(0x7fe53005b7b0 msgr2=0x7fe5300b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:48.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.506+0000 7fe53686a700 1 -- 172.21.15.103:0/2171102310 shutdown_connections 2020-04-22T14:20:48.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.506+0000 7fe53686a700 1 -- 172.21.15.103:0/2171102310 wait complete. 2020-04-22T14:20:48.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.507+0000 7fe53686a700 1 Processor -- start 2020-04-22T14:20:48.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.507+0000 7fe53686a700 1 -- start start 2020-04-22T14:20:48.520 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.508+0000 7fe53686a700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe5300b9140 0x7fe530146030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:48.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.508+0000 7fe53686a700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe5301470a0 0x7fe5300b5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:48.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.508+0000 7fe53686a700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe530149d20 con 0x7fe5300ac950 2020-04-22T14:20:48.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.508+0000 7fe53686a700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe530149400 con 0x7fe5300b9140 2020-04-22T14:20:48.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.508+0000 7fe53686a700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe530146490 con 0x7fe5301470a0 2020-04-22T14:20:48.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.508+0000 7fe52ffff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe5300ac950 0x7fe53014c620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51620/0 (socket says 172.21.15.103:51620) 2020-04-22T14:20:48.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.508+0000 7fe52ffff700 1 -- 172.21.15.103:0/3524612510 learned_addr learned my addr 172.21.15.103:0/3524612510 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:48.521 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.508+0000 7fe52f7fe700 1 --2- 172.21.15.103:0/3524612510 >> v2:172.21.15.86:3300/0 conn(0x7fe5300b9140 0x7fe530146030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:48.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.508+0000 7fe534e07700 1 --2- 172.21.15.103:0/3524612510 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe5301470a0 0x7fe5300b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:48.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.508+0000 7fe52d7fa700 1 -- 172.21.15.103:0/3524612510 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2828631989 0 0) 0x7fe530149d20 con 0x7fe5300ac950 2020-04-22T14:20:48.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.508+0000 7fe52d7fa700 1 -- 172.21.15.103:0/3524612510 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe510002fe0 con 0x7fe5300ac950 2020-04-22T14:20:48.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.508+0000 7fe52d7fa700 1 -- 172.21.15.103:0/3524612510 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2269950640 0 0) 0x7fe510002fe0 con 0x7fe5300ac950 2020-04-22T14:20:48.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.508+0000 7fe52d7fa700 1 -- 172.21.15.103:0/3524612510 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe530149d20 con 0x7fe5300ac950 2020-04-22T14:20:48.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.508+0000 7fe52d7fa700 1 -- 172.21.15.103:0/3524612510 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fe520001930 con 0x7fe5300ac950 2020-04-22T14:20:48.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.508+0000 7fe534e07700 1 -- 172.21.15.103:0/3524612510 >> v2:172.21.15.86:3300/0 conn(0x7fe5300b9140 msgr2=0x7fe530146030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:48.522 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.508+0000 7fe534e07700 1 --2- 172.21.15.103:0/3524612510 >> v2:172.21.15.86:3300/0 conn(0x7fe5300b9140 0x7fe530146030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:48.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.508+0000 7fe534e07700 1 -- 172.21.15.103:0/3524612510 >> v1:172.21.15.103:6789/0 conn(0x7fe5300ac950 legacy=0x7fe53014c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:48.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.508+0000 7fe534e07700 1 -- 172.21.15.103:0/3524612510 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe530149f50 con 0x7fe5301470a0 2020-04-22T14:20:48.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.508+0000 7fe52f7fe700 1 --2- 172.21.15.103:0/3524612510 >> v2:172.21.15.86:3300/0 conn(0x7fe5300b9140 0x7fe530146030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:20:48.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.508+0000 7fe534e07700 1 --2- 172.21.15.103:0/3524612510 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe5301470a0 0x7fe5300b5260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe5280032b0 tx=0x7fe528010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.508+0000 7fe534e07700 1 --2- 172.21.15.103:0/3524612510 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe5301470a0 0x7fe5300b5260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe5280032b0 tx=0x7fe528010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.508+0000 7fe534e07700 1 --2- 172.21.15.103:0/3524612510 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe5301470a0 0x7fe5300b5260 secure :-1 s=READY pgs=213 cs=0 l=1 rx=0x7fe5280032b0 tx=0x7fe528010d20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:48.523 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.508+0000 7fe534e07700 1 --2- 172.21.15.103:0/3524612510 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe5301470a0 0x7fe5300b5260 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7fe5280032b0 tx=0x7fe528010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.508+0000 7fe52d7fa700 1 -- 172.21.15.103:0/3524612510 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe528007180 con 0x7fe5301470a0 2020-04-22T14:20:48.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.508+0000 7fe534e07700 1 --2- 172.21.15.103:0/3524612510 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe5301470a0 0x7fe5300b5260 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7fe5280032b0 tx=0x7fe528010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.508+0000 7fe52d7fa700 1 -- 172.21.15.103:0/3524612510 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5280072e0 con 0x7fe5301470a0 2020-04-22T14:20:48.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.508+0000 7fe534e07700 1 --2- 172.21.15.103:0/3524612510 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe5301470a0 0x7fe5300b5260 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7fe5280032b0 tx=0x7fe528010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.508+0000 7fe53686a700 1 -- 172.21.15.103:0/3524612510 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe53014a1f0 con 0x7fe5301470a0 2020-04-22T14:20:48.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.508+0000 7fe52d7fa700 1 -- 172.21.15.103:0/3524612510 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe528007640 con 0x7fe5301470a0 2020-04-22T14:20:48.524 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.509+0000 7fe53686a700 1 -- 172.21.15.103:0/3524612510 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe530147fb0 con 0x7fe5301470a0 2020-04-22T14:20:48.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.509+0000 7fe534e07700 1 --2- 172.21.15.103:0/3524612510 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe5301470a0 0x7fe5300b5260 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7fe5280032b0 tx=0x7fe528010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.509+0000 7fe53686a700 1 -- 172.21.15.103:0/3524612510 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe53014cd30 con 0x7fe5301470a0 2020-04-22T14:20:48.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.510+0000 7fe52d7fa700 1 -- 172.21.15.103:0/3524612510 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fe528007840 con 0x7fe5301470a0 2020-04-22T14:20:48.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.510+0000 7fe534e07700 1 --2- 172.21.15.103:0/3524612510 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe5301470a0 0x7fe5300b5260 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7fe5280032b0 tx=0x7fe528010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.510+0000 7fe52d7fa700 1 --2- 172.21.15.103:0/3524612510 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe51004e060 0x7fe510050520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:48.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.510+0000 7fe52d7fa700 1 -- 172.21.15.103:0/3524612510 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe528061900 con 0x7fe5301470a0 2020-04-22T14:20:48.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.510+0000 7fe52ffff700 1 --2- 172.21.15.103:0/3524612510 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe51004e060 0x7fe510050520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:48.525 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.510+0000 7fe52ffff700 1 --2- 172.21.15.103:0/3524612510 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe51004e060 0x7fe510050520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe520001640 tx=0x7fe520009d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.510+0000 7fe52ffff700 1 --2- 172.21.15.103:0/3524612510 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe51004e060 0x7fe510050520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe520001640 tx=0x7fe520009d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.510+0000 7fe52ffff700 1 --2- 172.21.15.103:0/3524612510 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe51004e060 0x7fe510050520 secure :-1 s=READY pgs=814 cs=0 l=1 rx=0x7fe520001640 tx=0x7fe520009d10).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:48.526 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.514+0000 7fe534e07700 1 --2- 172.21.15.103:0/3524612510 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe5301470a0 0x7fe5300b5260 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7fe5280032b0 tx=0x7fe528010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.527 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.514+0000 7fe52d7fa700 1 -- 172.21.15.103:0/3524612510 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fe52803cc80 con 0x7fe5301470a0 2020-04-22T14:20:48.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.659+0000 7fe53686a700 1 -- 172.21.15.103:0/3524612510 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe5300b5a40 con 0x7fe5301470a0 2020-04-22T14:20:48.662 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.659+0000 7fe534e07700 1 --2- 172.21.15.103:0/3524612510 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe5301470a0 0x7fe5300b5260 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7fe5280032b0 tx=0x7fe528010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.663 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.659+0000 7fe52d7fa700 1 -- 172.21.15.103:0/3524612510 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v158) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe5300b5a40 con 0x7fe5301470a0 2020-04-22T14:20:48.663 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:20:48.664 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.661+0000 7fe53686a700 1 -- 172.21.15.103:0/3524612510 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe51004e060 msgr2=0x7fe510050520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:48.667 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.661+0000 7fe53686a700 1 --2- 172.21.15.103:0/3524612510 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe51004e060 0x7fe510050520 secure :-1 s=READY pgs=814 cs=0 l=1 rx=0x7fe520001640 tx=0x7fe520009d10).stop 2020-04-22T14:20:48.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.661+0000 7fe53686a700 1 -- 172.21.15.103:0/3524612510 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe5301470a0 msgr2=0x7fe5300b5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:48.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.661+0000 7fe53686a700 1 --2- 172.21.15.103:0/3524612510 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe5301470a0 0x7fe5300b5260 secure :-1 s=READY pgs=213 cs=0 l=1 rx=0x7fe5280032b0 tx=0x7fe528010d20).stop 2020-04-22T14:20:48.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.661+0000 7fe53686a700 1 -- 172.21.15.103:0/3524612510 shutdown_connections 2020-04-22T14:20:48.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.661+0000 7fe53686a700 1 --2- 172.21.15.103:0/3524612510 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe5301470a0 0x7fe5300b5260 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:48.668 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.661+0000 7fe53686a700 1 --2- 172.21.15.103:0/3524612510 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fe51004e060 0x7fe510050520 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:48.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.661+0000 7fe53686a700 1 --2- 172.21.15.103:0/3524612510 >> v2:172.21.15.86:3300/0 conn(0x7fe5300b9140 0x7fe530146030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:48.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.661+0000 7fe53686a700 1 -- 172.21.15.103:0/3524612510 >> 172.21.15.103:0/3524612510 conn(0x7fe53005b7b0 msgr2=0x7fe5300b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:48.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.661+0000 7fe53686a700 1 -- 172.21.15.103:0/3524612510 shutdown_connections 2020-04-22T14:20:48.669 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.661+0000 7fe53686a700 1 -- 172.21.15.103:0/3524612510 wait complete. 2020-04-22T14:20:48.674 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:48.707 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:20:48.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.864+0000 7f8d5cb6d700 1 Processor -- start 2020-04-22T14:20:48.868 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.864+0000 7f8d5cb6d700 1 -- start start 2020-04-22T14:20:48.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.865+0000 7f8d5cb6d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8d580b8e00 0x7f8d580af010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:48.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.865+0000 7f8d5cb6d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8d5805fed0 0x7f8d580b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:48.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.865+0000 7f8d5cb6d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d580b29b0 con 0x7f8d580b91e0 2020-04-22T14:20:48.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.865+0000 7f8d5cb6d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d580b4270 con 0x7f8d580b8e00 2020-04-22T14:20:48.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.865+0000 7f8d5cb6d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d580b4510 con 0x7f8d5805fed0 2020-04-22T14:20:48.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.865+0000 7f8d56ffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f8d580b91e0 0x7f8d58142f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51628/0 (socket says 172.21.15.103:51628) 2020-04-22T14:20:48.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.865+0000 7f8d56ffd700 1 -- 172.21.15.103:0/1753912008 learned_addr learned my addr 172.21.15.103:0/1753912008 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:48.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.865+0000 7f8d577fe700 1 --2- 172.21.15.103:0/1753912008 >> v2:172.21.15.86:3300/0 conn(0x7f8d580b8e00 0x7f8d580af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:48.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.865+0000 7f8d57fff700 1 --2- 172.21.15.103:0/1753912008 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8d5805fed0 0x7f8d580b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:48.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.866+0000 7f8d567fc700 1 -- 172.21.15.103:0/1753912008 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1309021974 0 0) 0x7f8d580b29b0 con 0x7f8d580b91e0 2020-04-22T14:20:48.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.866+0000 7f8d567fc700 1 -- 172.21.15.103:0/1753912008 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d44003230 con 0x7f8d580b91e0 2020-04-22T14:20:48.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.866+0000 7f8d567fc700 1 -- 172.21.15.103:0/1753912008 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 729593707 0 0) 0x7f8d44003230 con 0x7f8d580b91e0 2020-04-22T14:20:48.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.866+0000 7f8d567fc700 1 -- 172.21.15.103:0/1753912008 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8d5805fed0 msgr2=0x7f8d580b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:48.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.866+0000 7f8d567fc700 1 --2- 172.21.15.103:0/1753912008 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8d5805fed0 0x7f8d580b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:48.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.866+0000 7f8d567fc700 1 -- 172.21.15.103:0/1753912008 >> v2:172.21.15.86:3300/0 conn(0x7f8d580b8e00 msgr2=0x7f8d580af010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:48.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.866+0000 7f8d567fc700 1 --2- 172.21.15.103:0/1753912008 >> v2:172.21.15.86:3300/0 conn(0x7f8d580b8e00 0x7f8d580af010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:48.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.866+0000 7f8d567fc700 1 -- 172.21.15.103:0/1753912008 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d580b2020 con 0x7f8d580b91e0 2020-04-22T14:20:48.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.866+0000 7f8d567fc700 1 -- 172.21.15.103:0/1753912008 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f8d4c0016d0 con 0x7f8d580b91e0 2020-04-22T14:20:48.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.866+0000 7f8d567fc700 1 -- 172.21.15.103:0/1753912008 >> v1:172.21.15.103:6789/0 conn(0x7f8d580b91e0 legacy=0x7f8d58142f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:48.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.866+0000 7f8d567fc700 1 --2- 172.21.15.103:0/1753912008 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8d5805fed0 0x7f8d44003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:48.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.866+0000 7f8d567fc700 1 --2- 172.21.15.103:0/1753912008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d44003b80 0x7f8d44003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:48.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.866+0000 7f8d567fc700 1 --2- 172.21.15.103:0/1753912008 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d440045c0 0x7f8d44004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:48.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.866+0000 7f8d567fc700 1 -- 172.21.15.103:0/1753912008 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d580b4270 con 0x7f8d44003b80 2020-04-22T14:20:48.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.866+0000 7f8d567fc700 1 -- 172.21.15.103:0/1753912008 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d580b4510 con 0x7f8d440045c0 2020-04-22T14:20:48.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.866+0000 7f8d567fc700 1 -- 172.21.15.103:0/1753912008 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d44005050 con 0x7f8d5805fed0 2020-04-22T14:20:48.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.866+0000 7f8d57fff700 1 --2- 172.21.15.103:0/1753912008 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d440045c0 0x7f8d44004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:48.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.866+0000 7f8d577fe700 1 --2- 172.21.15.103:0/1753912008 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8d5805fed0 0x7f8d44003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:48.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.866+0000 7f8d56ffd700 1 --2- 172.21.15.103:0/1753912008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d44003b80 0x7f8d44003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:48.884 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.866+0000 7f8d57fff700 1 -- 172.21.15.103:0/1753912008 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8d5805fed0 msgr2=0x7f8d44003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:48.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.866+0000 7f8d57fff700 1 --2- 172.21.15.103:0/1753912008 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8d5805fed0 0x7f8d44003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:48.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.866+0000 7f8d57fff700 1 -- 172.21.15.103:0/1753912008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d44003b80 msgr2=0x7f8d44003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:48.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.866+0000 7f8d57fff700 1 --2- 172.21.15.103:0/1753912008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d44003b80 0x7f8d44003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:48.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.866+0000 7f8d57fff700 1 -- 172.21.15.103:0/1753912008 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d44003230 con 0x7f8d440045c0 2020-04-22T14:20:48.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.866+0000 7f8d57fff700 1 --2- 172.21.15.103:0/1753912008 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d440045c0 0x7f8d44004a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8d500032b0 tx=0x7f8d500103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.885 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.866+0000 7f8d57fff700 1 --2- 172.21.15.103:0/1753912008 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d440045c0 0x7f8d44004a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8d500032b0 tx=0x7f8d500103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.866+0000 7f8d57fff700 1 --2- 172.21.15.103:0/1753912008 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d440045c0 0x7f8d44004a20 secure :-1 s=READY pgs=2248 cs=0 l=1 rx=0x7f8d500032b0 tx=0x7f8d500103a0).ready entity=mon.1 client_cookie=3b86e3c5bb8ce998 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:48.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.866+0000 7f8d57fff700 1 --2- 172.21.15.103:0/1753912008 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d440045c0 0x7f8d44004a20 secure :-1 s=THROTTLE_DONE pgs=2248 cs=0 l=1 rx=0x7f8d500032b0 tx=0x7f8d500103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.896 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.866+0000 7f8d567fc700 1 -- 172.21.15.103:0/1753912008 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d50005a40 con 0x7f8d440045c0 2020-04-22T14:20:48.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.866+0000 7f8d57fff700 1 --2- 172.21.15.103:0/1753912008 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d440045c0 0x7f8d44004a20 secure :-1 s=THROTTLE_DONE pgs=2248 cs=0 l=1 rx=0x7f8d500032b0 tx=0x7f8d500103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.867+0000 7f8d57fff700 1 --2- 172.21.15.103:0/1753912008 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d440045c0 0x7f8d44004a20 secure :-1 s=THROTTLE_DONE pgs=2248 cs=0 l=1 rx=0x7f8d500032b0 tx=0x7f8d500103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.867+0000 7f8d567fc700 1 -- 172.21.15.103:0/1753912008 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d50005ba0 con 0x7f8d440045c0 2020-04-22T14:20:48.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.867+0000 7f8d567fc700 1 -- 172.21.15.103:0/1753912008 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d500110d0 con 0x7f8d440045c0 2020-04-22T14:20:48.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.867+0000 7f8d5cb6d700 1 -- 172.21.15.103:0/1753912008 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d440045c0 msgr2=0x7f8d44004a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:48.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.867+0000 7f8d5cb6d700 1 --2- 172.21.15.103:0/1753912008 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d440045c0 0x7f8d44004a20 secure :-1 s=READY pgs=2248 cs=0 l=1 rx=0x7f8d500032b0 tx=0x7f8d500103a0).stop 2020-04-22T14:20:48.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.867+0000 7f8d57fff700 1 -- 172.21.15.103:0/1753912008 reap_dead start 2020-04-22T14:20:48.897 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.867+0000 7f8d5cb6d700 1 -- 172.21.15.103:0/1753912008 shutdown_connections 2020-04-22T14:20:48.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.867+0000 7f8d5cb6d700 1 -- 172.21.15.103:0/1753912008 >> 172.21.15.103:0/1753912008 conn(0x7f8d5805b780 msgr2=0x7f8d580b8530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:48.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.867+0000 7f8d5cb6d700 1 -- 172.21.15.103:0/1753912008 shutdown_connections 2020-04-22T14:20:48.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.867+0000 7f8d5cb6d700 1 -- 172.21.15.103:0/1753912008 wait complete. 2020-04-22T14:20:48.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.868+0000 7f8d5cb6d700 1 Processor -- start 2020-04-22T14:20:48.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.868+0000 7f8d5cb6d700 1 -- start start 2020-04-22T14:20:48.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.869+0000 7f8d5cb6d700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8d58153b90 0x7f8d581505c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:48.898 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.869+0000 7f8d5cb6d700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8d580630e0 0x7f8d58063590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:48.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.869+0000 7f8d5cb6d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d5813dbc0 con 0x7f8d58154690 2020-04-22T14:20:48.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.869+0000 7f8d5cb6d700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d58150cd0 con 0x7f8d580630e0 2020-04-22T14:20:48.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.869+0000 7f8d5cb6d700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d58150f70 con 0x7f8d58153b90 2020-04-22T14:20:48.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.869+0000 7f8d577fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f8d58154690 0x7f8d58140040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51640/0 (socket says 172.21.15.103:51640) 2020-04-22T14:20:48.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.869+0000 7f8d577fe700 1 -- 172.21.15.103:0/2471694360 learned_addr learned my addr 172.21.15.103:0/2471694360 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:48.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.869+0000 7f8d56ffd700 1 --2- 172.21.15.103:0/2471694360 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8d58153b90 0x7f8d581505c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:48.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.869+0000 7f8d57fff700 1 --2- 172.21.15.103:0/2471694360 >> v2:172.21.15.86:3300/0 conn(0x7f8d580630e0 0x7f8d58063590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:48.899 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.869+0000 7f8d54ff9700 1 -- 172.21.15.103:0/2471694360 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3895635266 0 0) 0x7f8d5813dbc0 con 0x7f8d58154690 2020-04-22T14:20:48.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.869+0000 7f8d54ff9700 1 -- 172.21.15.103:0/2471694360 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d38002fe0 con 0x7f8d58154690 2020-04-22T14:20:48.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.869+0000 7f8d57fff700 1 -- 172.21.15.103:0/2471694360 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8d58153b90 msgr2=0x7f8d581505c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:48.900 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.869+0000 7f8d57fff700 1 --2- 172.21.15.103:0/2471694360 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8d58153b90 0x7f8d581505c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:48.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.869+0000 7f8d57fff700 1 -- 172.21.15.103:0/2471694360 >> v1:172.21.15.103:6789/0 conn(0x7f8d58154690 legacy=0x7f8d58140040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:48.902 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.869+0000 7f8d54ff9700 1 -- 172.21.15.103:0/2471694360 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3815751197 0 0) 0x7f8d38002fe0 con 0x7f8d58154690 2020-04-22T14:20:48.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.869+0000 7f8d57fff700 1 -- 172.21.15.103:0/2471694360 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d58151210 con 0x7f8d580630e0 2020-04-22T14:20:48.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.869+0000 7f8d57fff700 1 --2- 172.21.15.103:0/2471694360 >> v2:172.21.15.86:3300/0 conn(0x7f8d580630e0 0x7f8d58063590 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8d480015f0 tx=0x7f8d500103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.870+0000 7f8d57fff700 1 --2- 172.21.15.103:0/2471694360 >> v2:172.21.15.86:3300/0 conn(0x7f8d580630e0 0x7f8d58063590 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8d480015f0 tx=0x7f8d500103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.870+0000 7f8d57fff700 1 --2- 172.21.15.103:0/2471694360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d580630e0 0x7f8d58063590 secure :-1 s=READY pgs=1168 cs=0 l=1 rx=0x7f8d480015f0 tx=0x7f8d500103a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:48.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.870+0000 7f8d57fff700 1 --2- 172.21.15.103:0/2471694360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d580630e0 0x7f8d58063590 secure :-1 s=THROTTLE_DONE pgs=1168 cs=0 l=1 rx=0x7f8d480015f0 tx=0x7f8d500103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.870+0000 7f8d54ff9700 1 -- 172.21.15.103:0/2471694360 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d48001490 con 0x7f8d580630e0 2020-04-22T14:20:48.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.870+0000 7f8d57fff700 1 --2- 172.21.15.103:0/2471694360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d580630e0 0x7f8d58063590 secure :-1 s=THROTTLE_DONE pgs=1168 cs=0 l=1 rx=0x7f8d480015f0 tx=0x7f8d500103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.903 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.870+0000 7f8d54ff9700 1 -- 172.21.15.103:0/2471694360 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d50010e10 con 0x7f8d580630e0 2020-04-22T14:20:48.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.870+0000 7f8d57fff700 1 --2- 172.21.15.103:0/2471694360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d580630e0 0x7f8d58063590 secure :-1 s=THROTTLE_DONE pgs=1168 cs=0 l=1 rx=0x7f8d480015f0 tx=0x7f8d500103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.870+0000 7f8d54ff9700 1 -- 172.21.15.103:0/2471694360 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d50005c30 con 0x7f8d580630e0 2020-04-22T14:20:48.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.870+0000 7f8d5cb6d700 1 -- 172.21.15.103:0/2471694360 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d58150a20 con 0x7f8d580630e0 2020-04-22T14:20:48.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.870+0000 7f8d5cb6d700 1 -- 172.21.15.103:0/2471694360 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d580639f0 con 0x7f8d580630e0 2020-04-22T14:20:48.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.870+0000 7f8d57fff700 1 --2- 172.21.15.103:0/2471694360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d580630e0 0x7f8d58063590 secure :-1 s=THROTTLE_DONE pgs=1168 cs=0 l=1 rx=0x7f8d480015f0 tx=0x7f8d500103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.904 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.871+0000 7f8d5cb6d700 1 -- 172.21.15.103:0/2471694360 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d581513a0 con 0x7f8d580630e0 2020-04-22T14:20:48.905 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.871+0000 7f8d57fff700 1 --2- 172.21.15.103:0/2471694360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d580630e0 0x7f8d58063590 secure :-1 s=THROTTLE_DONE pgs=1168 cs=0 l=1 rx=0x7f8d480015f0 tx=0x7f8d500103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.871+0000 7f8d54ff9700 1 -- 172.21.15.103:0/2471694360 <== mon.0 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f8d5000e410 con 0x7f8d580630e0 2020-04-22T14:20:48.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.871+0000 7f8d54ff9700 1 --2- 172.21.15.103:0/2471694360 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8d3804dcf0 0x7f8d380501b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:48.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.872+0000 7f8d54ff9700 1 -- 172.21.15.103:0/2471694360 <== mon.0 v2:172.21.15.86:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8d50061180 con 0x7f8d580630e0 2020-04-22T14:20:48.906 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.872+0000 7f8d577fe700 1 --2- 172.21.15.103:0/2471694360 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8d3804dcf0 0x7f8d380501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:48.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.872+0000 7f8d577fe700 1 --2- 172.21.15.103:0/2471694360 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8d3804dcf0 0x7f8d380501b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8d480081d0 tx=0x7f8d48007fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.872+0000 7f8d577fe700 1 --2- 172.21.15.103:0/2471694360 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8d3804dcf0 0x7f8d380501b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8d480081d0 tx=0x7f8d48007fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.872+0000 7f8d577fe700 1 --2- 172.21.15.103:0/2471694360 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8d3804dcf0 0x7f8d380501b0 secure :-1 s=READY pgs=815 cs=0 l=1 rx=0x7f8d480081d0 tx=0x7f8d48007fa0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:48.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.875+0000 7f8d57fff700 1 --2- 172.21.15.103:0/2471694360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d580630e0 0x7f8d58063590 secure :-1 s=THROTTLE_DONE pgs=1168 cs=0 l=1 rx=0x7f8d480015f0 tx=0x7f8d500103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:48.907 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:48.875+0000 7f8d54ff9700 1 -- 172.21.15.103:0/2471694360 <== mon.0 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f8d5003c580 con 0x7f8d580630e0 2020-04-22T14:20:49.020 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.017+0000 7f8d5cb6d700 1 -- 172.21.15.103:0/2471694360 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8d58056c90 con 0x7f8d580630e0 2020-04-22T14:20:49.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.018+0000 7f8d57fff700 1 --2- 172.21.15.103:0/2471694360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d580630e0 0x7f8d58063590 secure :-1 s=THROTTLE_DONE pgs=1168 cs=0 l=1 rx=0x7f8d480015f0 tx=0x7f8d500103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.022 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.018+0000 7f8d54ff9700 1 -- 172.21.15.103:0/2471694360 <== mon.0 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v158) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8d50007ca0 con 0x7f8d580630e0 2020-04-22T14:20:49.022 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:20:49.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.019+0000 7f8d5cb6d700 1 -- 172.21.15.103:0/2471694360 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8d3804dcf0 msgr2=0x7f8d380501b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:49.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.019+0000 7f8d5cb6d700 1 --2- 172.21.15.103:0/2471694360 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8d3804dcf0 0x7f8d380501b0 secure :-1 s=READY pgs=815 cs=0 l=1 rx=0x7f8d480081d0 tx=0x7f8d48007fa0).stop 2020-04-22T14:20:49.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.019+0000 7f8d5cb6d700 1 -- 172.21.15.103:0/2471694360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d580630e0 msgr2=0x7f8d58063590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:49.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.019+0000 7f8d5cb6d700 1 --2- 172.21.15.103:0/2471694360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d580630e0 0x7f8d58063590 secure :-1 s=READY pgs=1168 cs=0 l=1 rx=0x7f8d480015f0 tx=0x7f8d500103a0).stop 2020-04-22T14:20:49.023 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.019+0000 7f8d5cb6d700 1 -- 172.21.15.103:0/2471694360 shutdown_connections 2020-04-22T14:20:49.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.019+0000 7f8d5cb6d700 1 --2- 172.21.15.103:0/2471694360 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f8d3804dcf0 0x7f8d380501b0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:49.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.019+0000 7f8d5cb6d700 1 --2- 172.21.15.103:0/2471694360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d580630e0 0x7f8d58063590 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:49.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.019+0000 7f8d5cb6d700 1 --2- 172.21.15.103:0/2471694360 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8d58153b90 0x7f8d581505c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:49.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.019+0000 7f8d5cb6d700 1 -- 172.21.15.103:0/2471694360 >> 172.21.15.103:0/2471694360 conn(0x7f8d5805b780 msgr2=0x7f8d5813f400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:49.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.019+0000 7f8d5cb6d700 1 -- 172.21.15.103:0/2471694360 shutdown_connections 2020-04-22T14:20:49.024 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.019+0000 7f8d5cb6d700 1 -- 172.21.15.103:0/2471694360 wait complete. 2020-04-22T14:20:49.033 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:49.053 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-22T14:20:49.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.202+0000 7fd55965c700 1 Processor -- start 2020-04-22T14:20:49.205 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.202+0000 7fd55965c700 1 -- start start 2020-04-22T14:20:49.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.203+0000 7fd55965c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd5540ac950 0x7fd554146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:49.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.203+0000 7fd55965c700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5541467e0 con 0x7fd5540b9140 2020-04-22T14:20:49.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.203+0000 7fd55965c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd554060050 con 0x7fd5541470a0 2020-04-22T14:20:49.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.203+0000 7fd55965c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd554147530 con 0x7fd5540ac950 2020-04-22T14:20:49.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.203+0000 7fd5537fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd5541470a0 0x7fd554143090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51652/0 (socket says 172.21.15.103:51652) 2020-04-22T14:20:49.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.203+0000 7fd5537fe700 1 -- 172.21.15.103:0/3786837910 learned_addr learned my addr 172.21.15.103:0/3786837910 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:49.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.203+0000 7fd5527fc700 1 --2- 172.21.15.103:0/3786837910 >> v2:172.21.15.86:3300/0 conn(0x7fd5540ac950 0x7fd554146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:49.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.203+0000 7fd551ffb700 1 -- 172.21.15.103:0/3786837910 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3717897350 0 0) 0x7fd554060050 con 0x7fd5541470a0 2020-04-22T14:20:49.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.203+0000 7fd551ffb700 1 -- 172.21.15.103:0/3786837910 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd534003230 con 0x7fd5541470a0 2020-04-22T14:20:49.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.203+0000 7fd551ffb700 1 -- 172.21.15.103:0/3786837910 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1089313613 0 0) 0x7fd534003230 con 0x7fd5541470a0 2020-04-22T14:20:49.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.203+0000 7fd5527fc700 1 -- 172.21.15.103:0/3786837910 >> v1:172.21.15.103:6789/0 conn(0x7fd5541470a0 legacy=0x7fd554143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:49.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.203+0000 7fd5527fc700 1 -- 172.21.15.103:0/3786837910 >> v1:172.21.15.86:6789/0 conn(0x7fd5540b9140 legacy=0x7fd55412b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:49.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.203+0000 7fd5527fc700 1 -- 172.21.15.103:0/3786837910 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5540b9520 con 0x7fd5540ac950 2020-04-22T14:20:49.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.203+0000 7fd5527fc700 1 --2- 172.21.15.103:0/3786837910 >> v2:172.21.15.86:3300/0 conn(0x7fd5540ac950 0x7fd554146c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd54c001450 tx=0x7fd53c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.204+0000 7fd5527fc700 1 --2- 172.21.15.103:0/3786837910 >> v2:172.21.15.86:3300/0 conn(0x7fd5540ac950 0x7fd554146c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd54c001450 tx=0x7fd53c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.204+0000 7fd5527fc700 1 --2- 172.21.15.103:0/3786837910 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5540ac950 0x7fd554146c40 secure :-1 s=READY pgs=1170 cs=0 l=1 rx=0x7fd54c001450 tx=0x7fd53c007a40).ready entity=mon.0 client_cookie=ad79dc6e0108c0ee server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:49.210 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.204+0000 7fd5527fc700 1 --2- 172.21.15.103:0/3786837910 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5540ac950 0x7fd554146c40 secure :-1 s=THROTTLE_DONE pgs=1170 cs=0 l=1 rx=0x7fd54c001450 tx=0x7fd53c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.204+0000 7fd551ffb700 1 -- 172.21.15.103:0/3786837910 <== mon.0 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd544001710 con 0x7fd5540ac950 2020-04-22T14:20:49.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.204+0000 7fd5527fc700 1 --2- 172.21.15.103:0/3786837910 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5540ac950 0x7fd554146c40 secure :-1 s=THROTTLE_DONE pgs=1170 cs=0 l=1 rx=0x7fd54c001450 tx=0x7fd53c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.204+0000 7fd551ffb700 1 -- 172.21.15.103:0/3786837910 <== mon.0 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53c008b40 con 0x7fd5540ac950 2020-04-22T14:20:49.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.204+0000 7fd5527fc700 1 --2- 172.21.15.103:0/3786837910 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5540ac950 0x7fd554146c40 secure :-1 s=THROTTLE_DONE pgs=1170 cs=0 l=1 rx=0x7fd54c001450 tx=0x7fd53c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.204+0000 7fd551ffb700 1 -- 172.21.15.103:0/3786837910 <== mon.0 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd53c008ea0 con 0x7fd5540ac950 2020-04-22T14:20:49.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.204+0000 7fd55965c700 1 -- 172.21.15.103:0/3786837910 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5540ac950 msgr2=0x7fd554146c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:49.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.204+0000 7fd55965c700 1 --2- 172.21.15.103:0/3786837910 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5540ac950 0x7fd554146c40 secure :-1 s=READY pgs=1170 cs=0 l=1 rx=0x7fd54c001450 tx=0x7fd53c007a40).stop 2020-04-22T14:20:49.211 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.204+0000 7fd55965c700 1 -- 172.21.15.103:0/3786837910 shutdown_connections 2020-04-22T14:20:49.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.204+0000 7fd55965c700 1 --2- 172.21.15.103:0/3786837910 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5540ac950 0x7fd554146c40 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:49.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.204+0000 7fd55965c700 1 -- 172.21.15.103:0/3786837910 >> 172.21.15.103:0/3786837910 conn(0x7fd55405b7b0 msgr2=0x7fd5540b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:49.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.204+0000 7fd55965c700 1 -- 172.21.15.103:0/3786837910 shutdown_connections 2020-04-22T14:20:49.212 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.204+0000 7fd55965c700 1 -- 172.21.15.103:0/3786837910 wait complete. 2020-04-22T14:20:49.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.205+0000 7fd55965c700 1 Processor -- start 2020-04-22T14:20:49.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.205+0000 7fd55965c700 1 -- start start 2020-04-22T14:20:49.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.206+0000 7fd55965c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd5540b9140 0x7fd554141c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:49.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.206+0000 7fd55965c700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5540b3fe0 con 0x7fd5541470a0 2020-04-22T14:20:49.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.206+0000 7fd55965c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5540b4210 con 0x7fd5540ac950 2020-04-22T14:20:49.224 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.206+0000 7fd55965c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5540b44b0 con 0x7fd5540b9140 2020-04-22T14:20:49.225 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.206+0000 7fd552ffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd5540ac950 0x7fd5540afe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51654/0 (socket says 172.21.15.103:51654) 2020-04-22T14:20:49.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.206+0000 7fd552ffd700 1 -- 172.21.15.103:0/3906488092 learned_addr learned my addr 172.21.15.103:0/3906488092 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:49.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.206+0000 7fd54bfff700 1 -- 172.21.15.103:0/3906488092 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 810588062 0 0) 0x7fd5540b4210 con 0x7fd5540ac950 2020-04-22T14:20:49.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.206+0000 7fd54bfff700 1 -- 172.21.15.103:0/3906488092 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd538002fe0 con 0x7fd5540ac950 2020-04-22T14:20:49.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.206+0000 7fd5527fc700 1 --2- 172.21.15.103:0/3906488092 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd5540b9140 0x7fd554141c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:49.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.207+0000 7fd54bfff700 1 -- 172.21.15.103:0/3906488092 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2592983825 0 0) 0x7fd538002fe0 con 0x7fd5540ac950 2020-04-22T14:20:49.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.207+0000 7fd54bfff700 1 -- 172.21.15.103:0/3906488092 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd5540b4210 con 0x7fd5540ac950 2020-04-22T14:20:49.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.207+0000 7fd54bfff700 1 -- 172.21.15.103:0/3906488092 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7fd54c001d80 con 0x7fd5540ac950 2020-04-22T14:20:49.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.207+0000 7fd54bfff700 1 -- 172.21.15.103:0/3906488092 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd5540b9140 msgr2=0x7fd554141c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:49.231 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.207+0000 7fd54bfff700 1 --2- 172.21.15.103:0/3906488092 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd5540b9140 0x7fd554141c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:49.231 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.207+0000 7fd54bfff700 1 -- 172.21.15.103:0/3906488092 >> v1:172.21.15.103:6789/0 conn(0x7fd5540ac950 legacy=0x7fd5540afe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:49.231 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.207+0000 7fd54bfff700 1 -- 172.21.15.103:0/3906488092 >> v1:172.21.15.86:6789/0 conn(0x7fd5541470a0 legacy=0x7fd554127ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:49.231 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.207+0000 7fd54bfff700 1 --2- 172.21.15.103:0/3906488092 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5380049b0 0x7fd538004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:49.231 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.207+0000 7fd54bfff700 1 --2- 172.21.15.103:0/3906488092 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd5540b9140 0x7fd538003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:49.231 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.207+0000 7fd54bfff700 1 --2- 172.21.15.103:0/3906488092 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd538003d80 0x7fd538004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:49.231 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.207+0000 7fd54bfff700 1 -- 172.21.15.103:0/3906488092 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5540b44b0 con 0x7fd538003d80 2020-04-22T14:20:49.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.207+0000 7fd54bfff700 1 -- 172.21.15.103:0/3906488092 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5380052d0 con 0x7fd5380049b0 2020-04-22T14:20:49.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.207+0000 7fd54bfff700 1 -- 172.21.15.103:0/3906488092 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd538005490 con 0x7fd5540b9140 2020-04-22T14:20:49.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.207+0000 7fd552ffd700 1 --2- 172.21.15.103:0/3906488092 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5380049b0 0x7fd538004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:49.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.207+0000 7fd5527fc700 1 --2- 172.21.15.103:0/3906488092 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd5540b9140 0x7fd538003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:49.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.207+0000 7fd5537fe700 1 --2- 172.21.15.103:0/3906488092 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd538003d80 0x7fd538004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:49.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.207+0000 7fd552ffd700 1 -- 172.21.15.103:0/3906488092 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd5540b9140 msgr2=0x7fd538003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:49.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.207+0000 7fd552ffd700 1 --2- 172.21.15.103:0/3906488092 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd5540b9140 0x7fd538003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:49.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.207+0000 7fd552ffd700 1 -- 172.21.15.103:0/3906488092 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd538003d80 msgr2=0x7fd538004200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:49.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.207+0000 7fd552ffd700 1 --2- 172.21.15.103:0/3906488092 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd538003d80 0x7fd538004200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:49.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.207+0000 7fd552ffd700 1 -- 172.21.15.103:0/3906488092 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5540b4750 con 0x7fd5380049b0 2020-04-22T14:20:49.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.207+0000 7fd5537fe700 1 --2- 172.21.15.103:0/3906488092 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd538003d80 0x7fd538004200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:20:49.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.207+0000 7fd55965c700 1 -- 172.21.15.103:0/3906488092 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd554128700 con 0x7fd5380049b0 2020-04-22T14:20:49.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.207+0000 7fd552ffd700 1 --2- 172.21.15.103:0/3906488092 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5380049b0 0x7fd538004d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd54c001a90 tx=0x7fd54c0118a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.233 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.207+0000 7fd55965c700 1 -- 172.21.15.103:0/3906488092 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd554141e40 con 0x7fd5380049b0 2020-04-22T14:20:49.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.207+0000 7fd552ffd700 1 --2- 172.21.15.103:0/3906488092 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5380049b0 0x7fd538004d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd54c001a90 tx=0x7fd54c0118a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.207+0000 7fd552ffd700 1 --2- 172.21.15.103:0/3906488092 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5380049b0 0x7fd538004d90 secure :-1 s=READY pgs=2252 cs=0 l=1 rx=0x7fd54c001a90 tx=0x7fd54c0118a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:49.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.207+0000 7fd552ffd700 1 --2- 172.21.15.103:0/3906488092 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5380049b0 0x7fd538004d90 secure :-1 s=THROTTLE_DONE pgs=2252 cs=0 l=1 rx=0x7fd54c001a90 tx=0x7fd54c0118a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.207+0000 7fd54bfff700 1 -- 172.21.15.103:0/3906488092 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd54c008700 con 0x7fd5380049b0 2020-04-22T14:20:49.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.207+0000 7fd552ffd700 1 --2- 172.21.15.103:0/3906488092 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5380049b0 0x7fd538004d90 secure :-1 s=THROTTLE_DONE pgs=2252 cs=0 l=1 rx=0x7fd54c001a90 tx=0x7fd54c0118a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.207+0000 7fd552ffd700 1 --2- 172.21.15.103:0/3906488092 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5380049b0 0x7fd538004d90 secure :-1 s=THROTTLE_DONE pgs=2252 cs=0 l=1 rx=0x7fd54c001a90 tx=0x7fd54c0118a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.234 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.207+0000 7fd54bfff700 1 -- 172.21.15.103:0/3906488092 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54c005850 con 0x7fd5380049b0 2020-04-22T14:20:49.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.207+0000 7fd54bfff700 1 -- 172.21.15.103:0/3906488092 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd54c005bf0 con 0x7fd5380049b0 2020-04-22T14:20:49.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.208+0000 7fd552ffd700 1 --2- 172.21.15.103:0/3906488092 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5380049b0 0x7fd538004d90 secure :-1 s=THROTTLE_DONE pgs=2252 cs=0 l=1 rx=0x7fd54c001a90 tx=0x7fd54c0118a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.208+0000 7fd55965c700 1 -- 172.21.15.103:0/3906488092 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd52c003340 con 0x7fd5380049b0 2020-04-22T14:20:49.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.208+0000 7fd54bfff700 1 -- 172.21.15.103:0/3906488092 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fd54c005d50 con 0x7fd5380049b0 2020-04-22T14:20:49.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.208+0000 7fd552ffd700 1 --2- 172.21.15.103:0/3906488092 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5380049b0 0x7fd538004d90 secure :-1 s=THROTTLE_DONE pgs=2252 cs=0 l=1 rx=0x7fd54c001a90 tx=0x7fd54c0118a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.209+0000 7fd54bfff700 1 --2- 172.21.15.103:0/3906488092 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd538055cf0 0x7fd5380581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:49.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.209+0000 7fd54bfff700 1 -- 172.21.15.103:0/3906488092 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd54c061ed0 con 0x7fd5380049b0 2020-04-22T14:20:49.235 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.209+0000 7fd5527fc700 1 --2- 172.21.15.103:0/3906488092 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd538055cf0 0x7fd5380581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:49.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.209+0000 7fd5527fc700 1 --2- 172.21.15.103:0/3906488092 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd538055cf0 0x7fd5380581b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd54c001450 tx=0x7fd53c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.209+0000 7fd5527fc700 1 --2- 172.21.15.103:0/3906488092 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd538055cf0 0x7fd5380581b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd54c001450 tx=0x7fd53c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.209+0000 7fd5527fc700 1 --2- 172.21.15.103:0/3906488092 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd538055cf0 0x7fd5380581b0 secure :-1 s=READY pgs=816 cs=0 l=1 rx=0x7fd54c001450 tx=0x7fd53c007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:49.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.213+0000 7fd552ffd700 1 --2- 172.21.15.103:0/3906488092 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5380049b0 0x7fd538004d90 secure :-1 s=THROTTLE_DONE pgs=2252 cs=0 l=1 rx=0x7fd54c001a90 tx=0x7fd54c0118a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.236 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.213+0000 7fd54bfff700 1 -- 172.21.15.103:0/3906488092 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fd54c03d2b0 con 0x7fd5380049b0 2020-04-22T14:20:49.360 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.357+0000 7fd55965c700 1 -- 172.21.15.103:0/3906488092 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd52c002200 con 0x7fd5380049b0 2020-04-22T14:20:49.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.357+0000 7fd552ffd700 1 --2- 172.21.15.103:0/3906488092 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5380049b0 0x7fd538004d90 secure :-1 s=THROTTLE_DONE pgs=2252 cs=0 l=1 rx=0x7fd54c001a90 tx=0x7fd54c0118a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.361 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.357+0000 7fd54bfff700 1 -- 172.21.15.103:0/3906488092 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v158) v1 ==== 104+0+10 (secure 0 0 0) 0x7fd54c0408d0 con 0x7fd5380049b0 2020-04-22T14:20:49.361 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:20:49.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.358+0000 7fd55965c700 1 -- 172.21.15.103:0/3906488092 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd538055cf0 msgr2=0x7fd5380581b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:49.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.358+0000 7fd55965c700 1 --2- 172.21.15.103:0/3906488092 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd538055cf0 0x7fd5380581b0 secure :-1 s=READY pgs=816 cs=0 l=1 rx=0x7fd54c001450 tx=0x7fd53c007a40).stop 2020-04-22T14:20:49.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.358+0000 7fd55965c700 1 -- 172.21.15.103:0/3906488092 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5380049b0 msgr2=0x7fd538004d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:49.362 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.358+0000 7fd55965c700 1 --2- 172.21.15.103:0/3906488092 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5380049b0 0x7fd538004d90 secure :-1 s=READY pgs=2252 cs=0 l=1 rx=0x7fd54c001a90 tx=0x7fd54c0118a0).stop 2020-04-22T14:20:49.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.358+0000 7fd5537fe700 1 -- 172.21.15.103:0/3906488092 reap_dead start 2020-04-22T14:20:49.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.358+0000 7fd5537fe700 1 -- 172.21.15.103:0/3906488092 reap_dead start 2020-04-22T14:20:49.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.358+0000 7fd55965c700 1 -- 172.21.15.103:0/3906488092 shutdown_connections 2020-04-22T14:20:49.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.358+0000 7fd55965c700 1 -- 172.21.15.103:0/3906488092 >> 172.21.15.103:0/3906488092 conn(0x7fd55405b7b0 msgr2=0x7fd5540b6690 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:49.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.358+0000 7fd55965c700 1 -- 172.21.15.103:0/3906488092 shutdown_connections 2020-04-22T14:20:49.363 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.358+0000 7fd55965c700 1 -- 172.21.15.103:0/3906488092 wait complete. 2020-04-22T14:20:49.372 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:49.385 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-22T14:20:49.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.530+0000 7f7e448db700 1 Processor -- start 2020-04-22T14:20:49.533 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.530+0000 7f7e448db700 1 -- start start 2020-04-22T14:20:49.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.531+0000 7f7e448db700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7e400b9140 0x7f7e4012b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:49.536 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.531+0000 7f7e448db700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e400ac950 0x7f7e4012b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:49.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.531+0000 7f7e448db700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e401467e0 con 0x7f7e40146c40 2020-04-22T14:20:49.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.531+0000 7f7e448db700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e400602f0 con 0x7f7e400b9140 2020-04-22T14:20:49.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.531+0000 7f7e448db700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e40060050 con 0x7f7e400ac950 2020-04-22T14:20:49.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.531+0000 7f7e3e59c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7e400b9140 0x7f7e4012b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:49.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.531+0000 7f7e3ed9d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f7e40146c40 0x7f7e40143090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51672/0 (socket says 172.21.15.103:51672) 2020-04-22T14:20:49.537 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.531+0000 7f7e3ed9d700 1 -- 172.21.15.103:0/618313088 learned_addr learned my addr 172.21.15.103:0/618313088 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:49.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.531+0000 7f7e3dd9b700 1 --2- 172.21.15.103:0/618313088 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e400ac950 0x7f7e4012b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:49.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.531+0000 7f7e3e59c700 1 -- 172.21.15.103:0/618313088 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e400ac950 msgr2=0x7f7e4012b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:49.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.531+0000 7f7e3e59c700 1 --2- 172.21.15.103:0/618313088 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e400ac950 0x7f7e4012b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:49.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.531+0000 7f7e3e59c700 1 -- 172.21.15.103:0/618313088 >> v1:172.21.15.103:6789/0 conn(0x7f7e40146c40 legacy=0x7f7e40143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:49.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.531+0000 7f7e3d59a700 1 -- 172.21.15.103:0/618313088 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 23696542 0 0) 0x7f7e401467e0 con 0x7f7e40146c40 2020-04-22T14:20:49.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.531+0000 7f7e3e59c700 1 -- 172.21.15.103:0/618313088 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e400b9520 con 0x7f7e400b9140 2020-04-22T14:20:49.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.531+0000 7f7e3dd9b700 1 --2- 172.21.15.103:0/618313088 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e400ac950 0x7f7e4012b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:20:49.538 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.531+0000 7f7e3e59c700 1 --2- 172.21.15.103:0/618313088 >> v2:172.21.15.103:3300/0 conn(0x7f7e400b9140 0x7f7e4012b210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7e28002f30 tx=0x7f7e28007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.532+0000 7f7e3e59c700 1 --2- 172.21.15.103:0/618313088 >> v2:172.21.15.103:3300/0 conn(0x7f7e400b9140 0x7f7e4012b210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7e28002f30 tx=0x7f7e28007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.532+0000 7f7e3e59c700 1 --2- 172.21.15.103:0/618313088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e400b9140 0x7f7e4012b210 secure :-1 s=READY pgs=2254 cs=0 l=1 rx=0x7f7e28002f30 tx=0x7f7e28007a40).ready entity=mon.1 client_cookie=21f6e1a226d3c4f7 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:49.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.532+0000 7f7e3e59c700 1 --2- 172.21.15.103:0/618313088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e400b9140 0x7f7e4012b210 secure :-1 s=THROTTLE_DONE pgs=2254 cs=0 l=1 rx=0x7f7e28002f30 tx=0x7f7e28007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.532+0000 7f7e3d59a700 1 -- 172.21.15.103:0/618313088 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e28011470 con 0x7f7e400b9140 2020-04-22T14:20:49.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.532+0000 7f7e3e59c700 1 --2- 172.21.15.103:0/618313088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e400b9140 0x7f7e4012b210 secure :-1 s=THROTTLE_DONE pgs=2254 cs=0 l=1 rx=0x7f7e28002f30 tx=0x7f7e28007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.532+0000 7f7e3e59c700 1 --2- 172.21.15.103:0/618313088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e400b9140 0x7f7e4012b210 secure :-1 s=THROTTLE_DONE pgs=2254 cs=0 l=1 rx=0x7f7e28002f30 tx=0x7f7e28007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.539 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.532+0000 7f7e3d59a700 1 -- 172.21.15.103:0/618313088 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e28011610 con 0x7f7e400b9140 2020-04-22T14:20:49.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.532+0000 7f7e3d59a700 1 -- 172.21.15.103:0/618313088 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e280119f0 con 0x7f7e400b9140 2020-04-22T14:20:49.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.532+0000 7f7e448db700 1 -- 172.21.15.103:0/618313088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e400b9140 msgr2=0x7f7e4012b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:49.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.532+0000 7f7e448db700 1 --2- 172.21.15.103:0/618313088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e400b9140 0x7f7e4012b210 secure :-1 s=READY pgs=2254 cs=0 l=1 rx=0x7f7e28002f30 tx=0x7f7e28007a40).stop 2020-04-22T14:20:49.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.532+0000 7f7e448db700 1 -- 172.21.15.103:0/618313088 shutdown_connections 2020-04-22T14:20:49.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.532+0000 7f7e448db700 1 --2- 172.21.15.103:0/618313088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e400b9140 0x7f7e4012b210 unknown :-1 s=CLOSED pgs=2254 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:49.540 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.532+0000 7f7e448db700 1 --2- 172.21.15.103:0/618313088 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e400ac950 0x7f7e4012b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:49.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.532+0000 7f7e448db700 1 -- 172.21.15.103:0/618313088 >> 172.21.15.103:0/618313088 conn(0x7f7e4005b7b0 msgr2=0x7f7e400b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:49.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.532+0000 7f7e448db700 1 -- 172.21.15.103:0/618313088 shutdown_connections 2020-04-22T14:20:49.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.532+0000 7f7e448db700 1 -- 172.21.15.103:0/618313088 wait complete. 2020-04-22T14:20:49.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.533+0000 7f7e448db700 1 Processor -- start 2020-04-22T14:20:49.545 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.533+0000 7f7e448db700 1 -- start start 2020-04-22T14:20:49.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.534+0000 7f7e448db700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7e400ac950 0x7f7e40128000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:49.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.534+0000 7f7e448db700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7e400b9140 0x7f7e40112b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:49.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.534+0000 7f7e448db700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e40146c40 0x7f7e40112ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:49.549 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.534+0000 7f7e448db700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e40128a70 con 0x7f7e400b9140 2020-04-22T14:20:49.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.534+0000 7f7e448db700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e40063550 con 0x7f7e400ac950 2020-04-22T14:20:49.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.534+0000 7f7e448db700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e400637f0 con 0x7f7e40146c40 2020-04-22T14:20:49.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.534+0000 7f7e3e59c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7e400ac950 0x7f7e40128000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:49.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.534+0000 7f7e3e59c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7e400ac950 0x7f7e40128000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59484/0 (socket says 172.21.15.103:59484) 2020-04-22T14:20:49.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.534+0000 7f7e3e59c700 1 -- 172.21.15.103:0/3916094057 learned_addr learned my addr 172.21.15.103:0/3916094057 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:49.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.534+0000 7f7e3dd9b700 1 --2- 172.21.15.103:0/3916094057 >> v2:172.21.15.86:3300/0 conn(0x7f7e400b9140 0x7f7e40112b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:49.550 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.534+0000 7f7e3ed9d700 1 --2- 172.21.15.103:0/3916094057 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e40146c40 0x7f7e40112ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:49.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.534+0000 7f7e3e59c700 1 -- 172.21.15.103:0/3916094057 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e40146c40 msgr2=0x7f7e40112ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:49.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.534+0000 7f7e3e59c700 1 --2- 172.21.15.103:0/3916094057 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e40146c40 0x7f7e40112ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:49.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.534+0000 7f7e3e59c700 1 -- 172.21.15.103:0/3916094057 >> v2:172.21.15.86:3300/0 conn(0x7f7e400b9140 msgr2=0x7f7e40112b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:49.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.534+0000 7f7e3e59c700 1 --2- 172.21.15.103:0/3916094057 >> v2:172.21.15.86:3300/0 conn(0x7f7e400b9140 0x7f7e40112b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:49.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.534+0000 7f7e3e59c700 1 -- 172.21.15.103:0/3916094057 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e401286f0 con 0x7f7e400ac950 2020-04-22T14:20:49.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.534+0000 7f7e3ed9d700 1 --2- 172.21.15.103:0/3916094057 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e40146c40 0x7f7e40112ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:20:49.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.534+0000 7f7e3dd9b700 1 --2- 172.21.15.103:0/3916094057 >> v2:172.21.15.86:3300/0 conn(0x7f7e400b9140 0x7f7e40112b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:20:49.551 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.534+0000 7f7e3e59c700 1 --2- 172.21.15.103:0/3916094057 >> v2:172.21.15.103:3300/0 conn(0x7f7e400ac950 0x7f7e40128000 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7e28002f30 tx=0x7f7e28007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.534+0000 7f7e3e59c700 1 --2- 172.21.15.103:0/3916094057 >> v2:172.21.15.103:3300/0 conn(0x7f7e400ac950 0x7f7e40128000 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7e28002f30 tx=0x7f7e28007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.534+0000 7f7e3e59c700 1 --2- 172.21.15.103:0/3916094057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e400ac950 0x7f7e40128000 secure :-1 s=READY pgs=2255 cs=0 l=1 rx=0x7f7e28002f30 tx=0x7f7e28007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:49.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.535+0000 7f7e3e59c700 1 --2- 172.21.15.103:0/3916094057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e400ac950 0x7f7e40128000 secure :-1 s=THROTTLE_DONE pgs=2255 cs=0 l=1 rx=0x7f7e28002f30 tx=0x7f7e28007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.535+0000 7f7e377fe700 1 -- 172.21.15.103:0/3916094057 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e28007170 con 0x7f7e400ac950 2020-04-22T14:20:49.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.535+0000 7f7e3e59c700 1 --2- 172.21.15.103:0/3916094057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e400ac950 0x7f7e40128000 secure :-1 s=THROTTLE_DONE pgs=2255 cs=0 l=1 rx=0x7f7e28002f30 tx=0x7f7e28007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.552 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.535+0000 7f7e377fe700 1 -- 172.21.15.103:0/3916094057 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e280072d0 con 0x7f7e400ac950 2020-04-22T14:20:49.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.535+0000 7f7e3e59c700 1 --2- 172.21.15.103:0/3916094057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e400ac950 0x7f7e40128000 secure :-1 s=THROTTLE_DONE pgs=2255 cs=0 l=1 rx=0x7f7e28002f30 tx=0x7f7e28007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.535+0000 7f7e448db700 1 -- 172.21.15.103:0/3916094057 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e4013d700 con 0x7f7e400ac950 2020-04-22T14:20:49.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.535+0000 7f7e377fe700 1 -- 172.21.15.103:0/3916094057 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e280056c0 con 0x7f7e400ac950 2020-04-22T14:20:49.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.535+0000 7f7e448db700 1 -- 172.21.15.103:0/3916094057 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e400b5e10 con 0x7f7e400ac950 2020-04-22T14:20:49.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.535+0000 7f7e3e59c700 1 --2- 172.21.15.103:0/3916094057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e400ac950 0x7f7e40128000 secure :-1 s=THROTTLE_DONE pgs=2255 cs=0 l=1 rx=0x7f7e28002f30 tx=0x7f7e28007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.536+0000 7f7e377fe700 1 -- 172.21.15.103:0/3916094057 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f7e28005900 con 0x7f7e400ac950 2020-04-22T14:20:49.553 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.536+0000 7f7e3e59c700 1 --2- 172.21.15.103:0/3916094057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e400ac950 0x7f7e40128000 secure :-1 s=THROTTLE_DONE pgs=2255 cs=0 l=1 rx=0x7f7e28002f30 tx=0x7f7e28007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.536+0000 7f7e448db700 1 -- 172.21.15.103:0/3916094057 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e400633c0 con 0x7f7e400ac950 2020-04-22T14:20:49.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.536+0000 7f7e377fe700 1 --2- 172.21.15.103:0/3916094057 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7e2404d990 0x7f7e2404fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:49.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.536+0000 7f7e377fe700 1 -- 172.21.15.103:0/3916094057 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7e28061c80 con 0x7f7e400ac950 2020-04-22T14:20:49.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.536+0000 7f7e3dd9b700 1 --2- 172.21.15.103:0/3916094057 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7e2404d990 0x7f7e2404fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:49.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.537+0000 7f7e3dd9b700 1 --2- 172.21.15.103:0/3916094057 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7e2404d990 0x7f7e2404fe50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7e30002f30 tx=0x7f7e3000ac30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.537+0000 7f7e3dd9b700 1 --2- 172.21.15.103:0/3916094057 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7e2404d990 0x7f7e2404fe50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7e30002f30 tx=0x7f7e3000ac30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.554 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.537+0000 7f7e3dd9b700 1 --2- 172.21.15.103:0/3916094057 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7e2404d990 0x7f7e2404fe50 secure :-1 s=READY pgs=817 cs=0 l=1 rx=0x7f7e30002f30 tx=0x7f7e3000ac30).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:49.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.540+0000 7f7e3e59c700 1 --2- 172.21.15.103:0/3916094057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e400ac950 0x7f7e40128000 secure :-1 s=THROTTLE_DONE pgs=2255 cs=0 l=1 rx=0x7f7e28002f30 tx=0x7f7e28007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.555 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.540+0000 7f7e377fe700 1 -- 172.21.15.103:0/3916094057 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f7e2803d180 con 0x7f7e400ac950 2020-04-22T14:20:49.686 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.683+0000 7f7e448db700 1 -- 172.21.15.103:0/3916094057 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7e40056c90 con 0x7f7e400ac950 2020-04-22T14:20:49.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.683+0000 7f7e3e59c700 1 --2- 172.21.15.103:0/3916094057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e400ac950 0x7f7e40128000 secure :-1 s=THROTTLE_DONE pgs=2255 cs=0 l=1 rx=0x7f7e28002f30 tx=0x7f7e28007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.687 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.683+0000 7f7e377fe700 1 -- 172.21.15.103:0/3916094057 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v158) v1 ==== 100+0+10 (secure 0 0 0) 0x7f7e280407a0 con 0x7f7e400ac950 2020-04-22T14:20:49.687 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:20:49.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.685+0000 7f7e448db700 1 -- 172.21.15.103:0/3916094057 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7e2404d990 msgr2=0x7f7e2404fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:49.688 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.685+0000 7f7e448db700 1 --2- 172.21.15.103:0/3916094057 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7e2404d990 0x7f7e2404fe50 secure :-1 s=READY pgs=817 cs=0 l=1 rx=0x7f7e30002f30 tx=0x7f7e3000ac30).stop 2020-04-22T14:20:49.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.685+0000 7f7e448db700 1 -- 172.21.15.103:0/3916094057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e400ac950 msgr2=0x7f7e40128000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:49.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.685+0000 7f7e448db700 1 --2- 172.21.15.103:0/3916094057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e400ac950 0x7f7e40128000 secure :-1 s=READY pgs=2255 cs=0 l=1 rx=0x7f7e28002f30 tx=0x7f7e28007a40).stop 2020-04-22T14:20:49.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.685+0000 7f7e448db700 1 -- 172.21.15.103:0/3916094057 shutdown_connections 2020-04-22T14:20:49.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.685+0000 7f7e448db700 1 --2- 172.21.15.103:0/3916094057 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e40146c40 0x7f7e40112ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:49.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.685+0000 7f7e448db700 1 --2- 172.21.15.103:0/3916094057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e400ac950 0x7f7e40128000 unknown :-1 s=CLOSED pgs=2255 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:49.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.685+0000 7f7e448db700 1 --2- 172.21.15.103:0/3916094057 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f7e2404d990 0x7f7e2404fe50 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:49.689 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.685+0000 7f7e448db700 1 --2- 172.21.15.103:0/3916094057 >> v2:172.21.15.86:3300/0 conn(0x7f7e400b9140 0x7f7e40112b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:49.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.685+0000 7f7e448db700 1 -- 172.21.15.103:0/3916094057 >> 172.21.15.103:0/3916094057 conn(0x7f7e4005b7b0 msgr2=0x7f7e401299a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:49.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.685+0000 7f7e448db700 1 -- 172.21.15.103:0/3916094057 shutdown_connections 2020-04-22T14:20:49.690 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.685+0000 7f7e448db700 1 -- 172.21.15.103:0/3916094057 wait complete. 2020-04-22T14:20:49.701 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-04-22T14:20:49.702 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:49.715 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:20:49.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.859+0000 7ff3bc426700 1 Processor -- start 2020-04-22T14:20:49.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.860+0000 7ff3bc426700 1 -- start start 2020-04-22T14:20:49.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.860+0000 7ff3bc426700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff3b412c0d0 0x7ff3b41464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:49.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.860+0000 7ff3bc426700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3b4063e30 0x7ff3b40642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:49.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.860+0000 7ff3bc426700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b4143300 con 0x7ff3b4065fe0 2020-04-22T14:20:49.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.860+0000 7ff3bc426700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3b41435a0 con 0x7ff3b412c0d0 2020-04-22T14:20:49.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.860+0000 7ff3bc426700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b4143840 con 0x7ff3b4063e30 2020-04-22T14:20:49.870 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.861+0000 7ff3ba1c2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff3b412c0d0 0x7ff3b41464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:49.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.861+0000 7ff3b99c1700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff3b4065fe0 0x7ff3b405b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51682/0 (socket says 172.21.15.103:51682) 2020-04-22T14:20:49.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.861+0000 7ff3ba1c2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff3b412c0d0 0x7ff3b41464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59492/0 (socket says 172.21.15.103:59492) 2020-04-22T14:20:49.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.861+0000 7ff3b99c1700 1 -- 172.21.15.103:0/41122407 learned_addr learned my addr 172.21.15.103:0/41122407 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:49.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.861+0000 7ff3ba9c3700 1 --2- 172.21.15.103:0/41122407 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3b4063e30 0x7ff3b40642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:49.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.861+0000 7ff3ba1c2700 1 -- 172.21.15.103:0/41122407 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3b4063e30 msgr2=0x7ff3b40642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:49.871 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.861+0000 7ff3ba1c2700 1 --2- 172.21.15.103:0/41122407 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3b4063e30 0x7ff3b40642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:49.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.861+0000 7ff3ba1c2700 1 -- 172.21.15.103:0/41122407 >> v1:172.21.15.103:6789/0 conn(0x7ff3b4065fe0 legacy=0x7ff3b405b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:49.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.861+0000 7ff3ba1c2700 1 -- 172.21.15.103:0/41122407 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b405bb50 con 0x7ff3b412c0d0 2020-04-22T14:20:49.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.861+0000 7ff3b91c0700 1 -- 172.21.15.103:0/41122407 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1637378115 0 0) 0x7ff3b4143300 con 0x7ff3b4065fe0 2020-04-22T14:20:49.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.861+0000 7ff3ba9c3700 1 --2- 172.21.15.103:0/41122407 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3b4063e30 0x7ff3b40642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:20:49.872 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.861+0000 7ff3ba1c2700 1 --2- 172.21.15.103:0/41122407 >> v2:172.21.15.103:3300/0 conn(0x7ff3b412c0d0 0x7ff3b41464e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff3b0002f30 tx=0x7ff3b0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.861+0000 7ff3ba1c2700 1 --2- 172.21.15.103:0/41122407 >> v2:172.21.15.103:3300/0 conn(0x7ff3b412c0d0 0x7ff3b41464e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff3b0002f30 tx=0x7ff3b0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.861+0000 7ff3ba1c2700 1 --2- 172.21.15.103:0/41122407 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3b412c0d0 0x7ff3b41464e0 secure :-1 s=READY pgs=2257 cs=0 l=1 rx=0x7ff3b0002f30 tx=0x7ff3b0007a40).ready entity=mon.1 client_cookie=7fd0551b0dc777cd server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:49.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.861+0000 7ff3ba1c2700 1 --2- 172.21.15.103:0/41122407 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3b412c0d0 0x7ff3b41464e0 secure :-1 s=THROTTLE_DONE pgs=2257 cs=0 l=1 rx=0x7ff3b0002f30 tx=0x7ff3b0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.873 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.861+0000 7ff3b91c0700 1 -- 172.21.15.103:0/41122407 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3b0011470 con 0x7ff3b412c0d0 2020-04-22T14:20:49.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.861+0000 7ff3ba1c2700 1 --2- 172.21.15.103:0/41122407 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3b412c0d0 0x7ff3b41464e0 secure :-1 s=THROTTLE_DONE pgs=2257 cs=0 l=1 rx=0x7ff3b0002f30 tx=0x7ff3b0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.861+0000 7ff3b91c0700 1 -- 172.21.15.103:0/41122407 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b0011610 con 0x7ff3b412c0d0 2020-04-22T14:20:49.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.861+0000 7ff3ba1c2700 1 --2- 172.21.15.103:0/41122407 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3b412c0d0 0x7ff3b41464e0 secure :-1 s=THROTTLE_DONE pgs=2257 cs=0 l=1 rx=0x7ff3b0002f30 tx=0x7ff3b0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.861+0000 7ff3b91c0700 1 -- 172.21.15.103:0/41122407 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3b00119f0 con 0x7ff3b412c0d0 2020-04-22T14:20:49.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.861+0000 7ff3bc426700 1 -- 172.21.15.103:0/41122407 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3b412c0d0 msgr2=0x7ff3b41464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:49.874 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.861+0000 7ff3bc426700 1 --2- 172.21.15.103:0/41122407 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3b412c0d0 0x7ff3b41464e0 secure :-1 s=READY pgs=2257 cs=0 l=1 rx=0x7ff3b0002f30 tx=0x7ff3b0007a40).stop 2020-04-22T14:20:49.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.862+0000 7ff3bc426700 1 -- 172.21.15.103:0/41122407 shutdown_connections 2020-04-22T14:20:49.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.862+0000 7ff3bc426700 1 --2- 172.21.15.103:0/41122407 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3b4063e30 0x7ff3b40642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:49.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.862+0000 7ff3bc426700 1 --2- 172.21.15.103:0/41122407 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3b412c0d0 0x7ff3b41464e0 unknown :-1 s=CLOSED pgs=2257 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:49.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.862+0000 7ff3bc426700 1 -- 172.21.15.103:0/41122407 >> 172.21.15.103:0/41122407 conn(0x7ff3b40b9160 msgr2=0x7ff3b405ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:49.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.862+0000 7ff3bc426700 1 -- 172.21.15.103:0/41122407 shutdown_connections 2020-04-22T14:20:49.875 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.862+0000 7ff3bc426700 1 -- 172.21.15.103:0/41122407 wait complete. 2020-04-22T14:20:49.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.863+0000 7ff3bc426700 1 Processor -- start 2020-04-22T14:20:49.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.863+0000 7ff3bc426700 1 -- start start 2020-04-22T14:20:49.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.863+0000 7ff3bc426700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3b4065fe0 0x7ff3b40b5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:49.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.863+0000 7ff3bc426700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff3b412c0d0 0x7ff3b40b7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:49.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.863+0000 7ff3bc426700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b40b80f0 con 0x7ff3b4063e30 2020-04-22T14:20:49.876 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.863+0000 7ff3bc426700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3b412a7e0 con 0x7ff3b412c0d0 2020-04-22T14:20:49.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.863+0000 7ff3bc426700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b412aa50 con 0x7ff3b4065fe0 2020-04-22T14:20:49.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.863+0000 7ff3ba1c2700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff3b4063e30 0x7ff3b4142010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51688/0 (socket says 172.21.15.103:51688) 2020-04-22T14:20:49.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.863+0000 7ff3ba9c3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff3b412c0d0 0x7ff3b40b7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:49.877 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.863+0000 7ff3ba1c2700 1 -- 172.21.15.103:0/1793288364 learned_addr learned my addr 172.21.15.103:0/1793288364 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:49.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.864+0000 7ff3b99c1700 1 --2- 172.21.15.103:0/1793288364 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3b4065fe0 0x7ff3b40b5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:49.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.864+0000 7ff3ba9c3700 1 -- 172.21.15.103:0/1793288364 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3b4065fe0 msgr2=0x7ff3b40b5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:49.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.864+0000 7ff3ba9c3700 1 --2- 172.21.15.103:0/1793288364 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3b4065fe0 0x7ff3b40b5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:49.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.864+0000 7ff3ba9c3700 1 -- 172.21.15.103:0/1793288364 >> v1:172.21.15.103:6789/0 conn(0x7ff3b4063e30 legacy=0x7ff3b4142010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:49.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.864+0000 7ff3a77fe700 1 -- 172.21.15.103:0/1793288364 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3004027987 0 0) 0x7ff3b405bb50 con 0x7ff3b4063e30 2020-04-22T14:20:49.878 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.864+0000 7ff3ba9c3700 1 -- 172.21.15.103:0/1793288364 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b412acf0 con 0x7ff3b412c0d0 2020-04-22T14:20:49.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.864+0000 7ff3b99c1700 1 --2- 172.21.15.103:0/1793288364 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3b4065fe0 0x7ff3b40b5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:20:49.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.864+0000 7ff3ba9c3700 1 --2- 172.21.15.103:0/1793288364 >> v2:172.21.15.103:3300/0 conn(0x7ff3b412c0d0 0x7ff3b40b7c90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff3ac0032b0 tx=0x7ff3ac010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.864+0000 7ff3ba9c3700 1 --2- 172.21.15.103:0/1793288364 >> v2:172.21.15.103:3300/0 conn(0x7ff3b412c0d0 0x7ff3b40b7c90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff3ac0032b0 tx=0x7ff3ac010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.864+0000 7ff3ba9c3700 1 --2- 172.21.15.103:0/1793288364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3b412c0d0 0x7ff3b40b7c90 secure :-1 s=READY pgs=2259 cs=0 l=1 rx=0x7ff3ac0032b0 tx=0x7ff3ac010d70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:49.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.864+0000 7ff3ba9c3700 1 --2- 172.21.15.103:0/1793288364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3b412c0d0 0x7ff3b40b7c90 secure :-1 s=THROTTLE_DONE pgs=2259 cs=0 l=1 rx=0x7ff3ac0032b0 tx=0x7ff3ac010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.879 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.864+0000 7ff3a77fe700 1 -- 172.21.15.103:0/1793288364 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3ac012be0 con 0x7ff3b412c0d0 2020-04-22T14:20:49.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.864+0000 7ff3ba9c3700 1 --2- 172.21.15.103:0/1793288364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3b412c0d0 0x7ff3b40b7c90 secure :-1 s=THROTTLE_DONE pgs=2259 cs=0 l=1 rx=0x7ff3ac0032b0 tx=0x7ff3ac010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.864+0000 7ff3ba9c3700 1 --2- 172.21.15.103:0/1793288364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3b412c0d0 0x7ff3b40b7c90 secure :-1 s=THROTTLE_DONE pgs=2259 cs=0 l=1 rx=0x7ff3ac0032b0 tx=0x7ff3ac010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.864+0000 7ff3a77fe700 1 -- 172.21.15.103:0/1793288364 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3ac009e90 con 0x7ff3b412c0d0 2020-04-22T14:20:49.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.864+0000 7ff3bc426700 1 -- 172.21.15.103:0/1793288364 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3b4142720 con 0x7ff3b412c0d0 2020-04-22T14:20:49.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.864+0000 7ff3a77fe700 1 -- 172.21.15.103:0/1793288364 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3ac0091c0 con 0x7ff3b412c0d0 2020-04-22T14:20:49.880 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.864+0000 7ff3bc426700 1 -- 172.21.15.103:0/1793288364 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3b40acc50 con 0x7ff3b412c0d0 2020-04-22T14:20:49.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.865+0000 7ff3ba9c3700 1 --2- 172.21.15.103:0/1793288364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3b412c0d0 0x7ff3b40b7c90 secure :-1 s=THROTTLE_DONE pgs=2259 cs=0 l=1 rx=0x7ff3ac0032b0 tx=0x7ff3ac010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.865+0000 7ff3a77fe700 1 -- 172.21.15.103:0/1793288364 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ff3ac005a40 con 0x7ff3b412c0d0 2020-04-22T14:20:49.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.865+0000 7ff3ba9c3700 1 --2- 172.21.15.103:0/1793288364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3b412c0d0 0x7ff3b40b7c90 secure :-1 s=THROTTLE_DONE pgs=2259 cs=0 l=1 rx=0x7ff3ac0032b0 tx=0x7ff3ac010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.865+0000 7ff3bc426700 1 -- 172.21.15.103:0/1793288364 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3b40acf60 con 0x7ff3b412c0d0 2020-04-22T14:20:49.881 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.865+0000 7ff3a77fe700 1 --2- 172.21.15.103:0/1793288364 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff39404d7f0 0x7ff39404fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:49.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.865+0000 7ff3a77fe700 1 -- 172.21.15.103:0/1793288364 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff3ac0613c0 con 0x7ff3b412c0d0 2020-04-22T14:20:49.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.866+0000 7ff3ba1c2700 1 --2- 172.21.15.103:0/1793288364 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff39404d7f0 0x7ff39404fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:49.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.866+0000 7ff3ba1c2700 1 --2- 172.21.15.103:0/1793288364 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff39404d7f0 0x7ff39404fcb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff3b00082e0 tx=0x7ff3b0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.866+0000 7ff3ba1c2700 1 --2- 172.21.15.103:0/1793288364 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff39404d7f0 0x7ff39404fcb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff3b00082e0 tx=0x7ff3b0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.882 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.866+0000 7ff3ba1c2700 1 --2- 172.21.15.103:0/1793288364 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff39404d7f0 0x7ff39404fcb0 secure :-1 s=READY pgs=818 cs=0 l=1 rx=0x7ff3b00082e0 tx=0x7ff3b0007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:49.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.870+0000 7ff3ba9c3700 1 --2- 172.21.15.103:0/1793288364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3b412c0d0 0x7ff3b40b7c90 secure :-1 s=THROTTLE_DONE pgs=2259 cs=0 l=1 rx=0x7ff3ac0032b0 tx=0x7ff3ac010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:49.883 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:49.870+0000 7ff3a77fe700 1 -- 172.21.15.103:0/1793288364 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ff3ac03c7a0 con 0x7ff3b412c0d0 2020-04-22T14:20:50.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:50.057+0000 7ff3bc426700 1 -- 172.21.15.103:0/1793288364 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3b4056c90 con 0x7ff3b412c0d0 2020-04-22T14:20:50.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:50.057+0000 7ff3ba9c3700 1 --2- 172.21.15.103:0/1793288364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3b412c0d0 0x7ff3b40b7c90 secure :-1 s=THROTTLE_DONE pgs=2259 cs=0 l=1 rx=0x7ff3ac0032b0 tx=0x7ff3ac010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:50.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:50.057+0000 7ff3a77fe700 1 -- 172.21.15.103:0/1793288364 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 121 v121) v1 ==== 95+0+2149 (secure 0 0 0) 0x7ff3ac03fdc0 con 0x7ff3b412c0d0 2020-04-22T14:20:50.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:50.058+0000 7ff3bc426700 1 -- 172.21.15.103:0/1793288364 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff39404d7f0 msgr2=0x7ff39404fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:50.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:50.058+0000 7ff3bc426700 1 --2- 172.21.15.103:0/1793288364 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff39404d7f0 0x7ff39404fcb0 secure :-1 s=READY pgs=818 cs=0 l=1 rx=0x7ff3b00082e0 tx=0x7ff3b0007a40).stop 2020-04-22T14:20:50.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:50.058+0000 7ff3bc426700 1 -- 172.21.15.103:0/1793288364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3b412c0d0 msgr2=0x7ff3b40b7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:50.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:50.058+0000 7ff3bc426700 1 --2- 172.21.15.103:0/1793288364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3b412c0d0 0x7ff3b40b7c90 secure :-1 s=READY pgs=2259 cs=0 l=1 rx=0x7ff3ac0032b0 tx=0x7ff3ac010d70).stop 2020-04-22T14:20:50.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:50.059+0000 7ff3bc426700 1 -- 172.21.15.103:0/1793288364 shutdown_connections 2020-04-22T14:20:50.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:50.059+0000 7ff3bc426700 1 --2- 172.21.15.103:0/1793288364 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff39404d7f0 0x7ff39404fcb0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:50.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:50.059+0000 7ff3bc426700 1 --2- 172.21.15.103:0/1793288364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3b412c0d0 0x7ff3b40b7c90 unknown :-1 s=CLOSED pgs=2259 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:50.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:50.059+0000 7ff3bc426700 1 --2- 172.21.15.103:0/1793288364 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3b4065fe0 0x7ff3b40b5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:50.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:50.059+0000 7ff3bc426700 1 -- 172.21.15.103:0/1793288364 >> 172.21.15.103:0/1793288364 conn(0x7ff3b40b9160 msgr2=0x7ff3b405ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:50.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:50.059+0000 7ff3bc426700 1 -- 172.21.15.103:0/1793288364 shutdown_connections 2020-04-22T14:20:50.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:50.059+0000 7ff3bc426700 1 -- 172.21.15.103:0/1793288364 wait complete. 2020-04-22T14:20:50.067 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 121 2020-04-22T14:20:50.067 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:20:50.067 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":121,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6962,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2216876181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2216876181},{"type":"v1","addr":"172.21.15.86:6835","nonce":2216876181}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":117}],"filesystems":[{"mdsmap":{"epoch":121,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:20:42.936004+0000","modified":"2020-04-22T14:20:44.952601+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10201},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10201":{"gid":10201,"name":"a","rank":0,"incarnation":118,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/591150745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":591150745},{"type":"v1","addr":"172.21.15.103:6833","nonce":591150745}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2020-04-22T14:20:50.273 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 10201}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 27, u'failed': [], u'epoch': 121, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [28], u'info': {u'gid_10201': {u'export_targets': [], u'name': u'a', u'incarnation': 118, u'state_seq': 3, u'state': u'up:active', u'gid': 10201, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 591150745, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 591150745, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/591150745'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:20:42.936004+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:20:44.952601+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:20:50.274 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:20:50.274 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:50.287 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:20:50.446 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:20:50.446 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:20:50.447 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:20:50.447 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 10201, 2020-04-22T14:20:50.447 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:20:50.447 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:20:50.447 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 7.5069722780000001, 2020-04-22T14:20:50.447 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 121, 2020-04-22T14:20:50.447 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 158, 2020-04-22T14:20:50.448 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 158, 2020-04-22T14:20:50.448 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 12.718455611 2020-04-22T14:20:50.448 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:20:50.454 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 10201, "want_state": "up:active", "state": "up:active", "rank_uptime": 7.5069722780000001, "mdsmap_epoch": 121, "osdmap_epoch": 158, "osdmap_epoch_barrier": 158, "uptime": 12.718455611 } 2020-04-22T14:20:50.455 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-04-22T14:20:50.455 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2020-04-22T14:20:50.455 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:50.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:50.468 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:20:50.523 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:20:50.523 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:20:50.523 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:20:50.523 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:50.523 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:20:50.524 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:50.524 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:20:50.524 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:50.524 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:20:50.524 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:50.524 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:20:50.525 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:50.525 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:20:50.525 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:50.525 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:20:50.525 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 41590sec preferred_lft 41590sec 2020-04-22T14:20:50.525 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:20:50.525 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:50.525 INFO:teuthology.orchestra.run.smithi103.stdout:44: brx.4@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:20:50.526 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether ce:62:6d:2c:c1:6d brd ff:ff:ff:ff:ff:ff link-netnsid 4 2020-04-22T14:20:50.526 INFO:teuthology.orchestra.run.smithi103.stdout:47: brx.0@if2: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:20:50.526 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether f6:69:77:c1:44:bd brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:20:50.526 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-04-22T14:20:50.526 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:50.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:50.575 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:20:50.650 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:50.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:50.701 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge con-name ceph-brx ifname ceph-brx stp no' 2020-04-22T14:20:50.814 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'ceph-brx' (b8e36dc0-ed15-427b-a4e5-3c48bf16b32d) successfully added. 2020-04-22T14:20:50.814 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:50.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:50.829 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection modify ceph-brx ipv4.addresses 192.168.255.254/16 ipv4.method manual' 2020-04-22T14:20:50.950 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:50.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:50.968 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up ceph-brx' 2020-04-22T14:20:51.081 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (master waiting for slaves) (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/62) 2020-04-22T14:20:51.081 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:51.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:51.095 INFO:teuthology.orchestra.run.smithi103:> touch /tmp/python-ceph-brx 2020-04-22T14:20:51.154 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:51.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:51.202 INFO:teuthology.orchestra.run.smithi103:> cat /proc/sys/net/ipv4/ip_forward 2020-04-22T14:20:51.261 INFO:teuthology.orchestra.run.smithi103.stdout:0 2020-04-22T14:20:51.261 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:51.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:51.309 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 0 > /tmp/python-ceph-brx' 2020-04-22T14:20:51.387 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:51.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:51.431 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'echo 1 > /proc/sys/net/ipv4/ip_forward' 2020-04-22T14:20:51.507 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:51.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:51.551 INFO:teuthology.orchestra.run.smithi103:> route 2020-04-22T14:20:51.609 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2020-04-22T14:20:51.610 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-04-22T14:20:51.610 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 102 0 0 enp3s0f1 2020-04-22T14:20:51.610 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 102 0 0 enp3s0f1 2020-04-22T14:20:51.610 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 425 0 0 ceph-brx 2020-04-22T14:20:51.610 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:51.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:51.660 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT' 2020-04-22T14:20:51.735 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:51.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:51.781 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT' 2020-04-22T14:20:51.857 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:51.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:51.903 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE' 2020-04-22T14:20:52.016 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:52.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:52.038 INFO:teuthology.orchestra.run.smithi103:> ip netns list 2020-04-22T14:20:52.097 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:52.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:52.152 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:20:52.207 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 2020-04-22T14:20:52.207 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 4 2020-04-22T14:20:52.207 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:52.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:52.256 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:20:52.315 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 2020-04-22T14:20:52.315 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 4 2020-04-22T14:20:52.315 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:52.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:52.364 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0' 2020-04-22T14:20:52.439 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:52.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:52.485 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 1' 2020-04-22T14:20:52.561 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-04-22T14:20:52.561 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:52.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:52.607 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.1' 2020-04-22T14:20:52.682 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:52.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:52.732 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0' 2020-04-22T14:20:52.841 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:52.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:52.855 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up' 2020-04-22T14:20:52.962 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:52.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:52.976 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up' 2020-04-22T14:20:53.085 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:53.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:53.098 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254' 2020-04-22T14:20:53.206 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:53.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:53.234 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:20:53.309 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:53.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:53.360 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge-slave con-name brx.1 ifname brx.1 master ceph-brx' 2020-04-22T14:20:53.467 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.1' (a82d4929-d2fe-42a8-9e98-2553f375d119) successfully added. 2020-04-22T14:20:53.468 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:53.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:53.502 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up brx.1' 2020-04-22T14:20:53.660 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/63) 2020-04-22T14:20:53.761 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-04-22T14:20:53.761 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi103.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-04-22T14:20:53.761 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:53.775 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:20:53.776 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:20:53.836 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:53.883 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:20:53.883 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:20:53.951 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:20:53.957 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:20:53.958 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:54.004 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:20:54.005 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:20:54.064 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-04-22T14:20:54.064 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:54.112 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:20:54.154 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:54.167 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:20:54.167 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:20:54.236 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:20:54.242 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:20:54.242 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:54.244 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:2020-04-22T14:20:54.241+0000 7fb6a32141c0 -1 init, newargv = 0x55af4a388b70 newargc=9 2020-04-22T14:20:54.244 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[130855]: starting ceph client 2020-04-22T14:20:54.248 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[130855]: starting fuse 2020-04-22T14:20:54.261 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:20:54.261 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:20:54.321 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:20:54.321 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2020-04-22T14:20:54.322 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:54.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:20:54.369 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:20:54.369 INFO:teuthology.orchestra.run.smithi103:> import glob 2020-04-22T14:20:54.369 INFO:teuthology.orchestra.run.smithi103:> import re 2020-04-22T14:20:54.370 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:20:54.370 INFO:teuthology.orchestra.run.smithi103:> import subprocess 2020-04-22T14:20:54.370 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:20:54.370 INFO:teuthology.orchestra.run.smithi103:> def find_socket(client_name): 2020-04-22T14:20:54.370 INFO:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-04-22T14:20:54.370 INFO:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2020-04-22T14:20:54.370 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:20:54.370 INFO:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2020-04-22T14:20:54.371 INFO:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2020-04-22T14:20:54.371 INFO:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2020-04-22T14:20:54.371 INFO:teuthology.orchestra.run.smithi103:> return files[0] 2020-04-22T14:20:54.371 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:20:54.371 INFO:teuthology.orchestra.run.smithi103:> for f in files: 2020-04-22T14:20:54.371 INFO:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:20:54.371 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:20:54.371 INFO:teuthology.orchestra.run.smithi103:> return f 2020-04-22T14:20:54.372 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:20:54.372 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:20:54.372 INFO:teuthology.orchestra.run.smithi103:> print(find_socket("client.0")) 2020-04-22T14:20:54.372 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:20:54.478 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.0.130855.asok 2020-04-22T14:20:54.478 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.130855.asok 2020-04-22T14:20:54.478 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:54.492 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:20:54.492 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.130855.asok status 2020-04-22T14:20:54.652 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:20:54.652 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2020-04-22T14:20:54.652 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:20:54.652 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:20:54.652 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "0", 2020-04-22T14:20:54.653 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:20:54.653 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-04-22T14:20:54.653 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "130855", 2020-04-22T14:20:54.653 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:20:54.653 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:54.653 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2020-04-22T14:20:54.653 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2020-04-22T14:20:54.654 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 10396, 2020-04-22T14:20:54.654 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2020-04-22T14:20:54.654 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:20:54.654 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:20:54.654 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 10396 2020-04-22T14:20:54.654 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:54.654 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:20:54.654 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:20:54.655 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:20:54.655 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 139457670 2020-04-22T14:20:54.655 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:20:54.655 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:54.655 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:20:54.655 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:20:54.655 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:20:54.656 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 139457670 2020-04-22T14:20:54.656 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:20:54.656 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.10396 192.168.0.1:0/139457670", 2020-04-22T14:20:54.656 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.1:0/139457670", 2020-04-22T14:20:54.656 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2020-04-22T14:20:54.656 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 121, 2020-04-22T14:20:54.656 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 158, 2020-04-22T14:20:54.658 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2020-04-22T14:20:54.658 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklisted": false 2020-04-22T14:20:54.658 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:20:54.658 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:54.673 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:20:54.673 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-22T14:20:54.674 INFO:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:20:54.732 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2020-04-22T14:20:54.732 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-04-22T14:20:54.733 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:54.782 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:20:54.782 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:20:54.862 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:54.904 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-22T14:20:55.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.047+0000 7fd8bb22f700 1 Processor -- start 2020-04-22T14:20:55.050 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.047+0000 7fd8bb22f700 1 -- start start 2020-04-22T14:20:55.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.048+0000 7fd8bb22f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd8b40654e0 0x7fd8b40664a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:55.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.048+0000 7fd8bb22f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd8b4142320 0x7fd8b4063340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:55.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.048+0000 7fd8bb22f700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b4066a20 con 0x7fd8b40ad150 2020-04-22T14:20:55.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.048+0000 7fd8bb22f700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b40adf30 con 0x7fd8b4142320 2020-04-22T14:20:55.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.048+0000 7fd8bb22f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b41427a0 con 0x7fd8b40654e0 2020-04-22T14:20:55.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.048+0000 7fd8b9a2c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd8b40654e0 0x7fd8b40664a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:55.053 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.048+0000 7fd8ba22d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd8b40ad150 0x7fd8b4141c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51710/0 (socket says 172.21.15.103:51710) 2020-04-22T14:20:55.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.048+0000 7fd8ba22d700 1 -- 172.21.15.103:0/591906623 learned_addr learned my addr 172.21.15.103:0/591906623 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:55.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.048+0000 7fd8baa2e700 1 --2- 172.21.15.103:0/591906623 >> v2:172.21.15.86:3300/0 conn(0x7fd8b4142320 0x7fd8b4063340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:55.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.048+0000 7fd8b9a2c700 1 -- 172.21.15.103:0/591906623 >> v2:172.21.15.86:3300/0 conn(0x7fd8b4142320 msgr2=0x7fd8b4063340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:55.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.048+0000 7fd8b9a2c700 1 --2- 172.21.15.103:0/591906623 >> v2:172.21.15.86:3300/0 conn(0x7fd8b4142320 0x7fd8b4063340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:55.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.048+0000 7fd8b9a2c700 1 -- 172.21.15.103:0/591906623 >> v1:172.21.15.103:6789/0 conn(0x7fd8b40ad150 legacy=0x7fd8b4141c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:55.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.048+0000 7fd8b922b700 1 -- 172.21.15.103:0/591906623 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3787587697 0 0) 0x7fd8b4066a20 con 0x7fd8b40ad150 2020-04-22T14:20:55.054 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.048+0000 7fd8b9a2c700 1 -- 172.21.15.103:0/591906623 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b40ad7f0 con 0x7fd8b40654e0 2020-04-22T14:20:55.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.048+0000 7fd8baa2e700 1 --2- 172.21.15.103:0/591906623 >> v2:172.21.15.86:3300/0 conn(0x7fd8b4142320 0x7fd8b4063340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:20:55.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.048+0000 7fd8b9a2c700 1 --2- 172.21.15.103:0/591906623 >> v2:172.21.15.103:3300/0 conn(0x7fd8b40654e0 0x7fd8b40664a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd8a4002f30 tx=0x7fd8a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.048+0000 7fd8b9a2c700 1 --2- 172.21.15.103:0/591906623 >> v2:172.21.15.103:3300/0 conn(0x7fd8b40654e0 0x7fd8b40664a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd8a4002f30 tx=0x7fd8a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.048+0000 7fd8b9a2c700 1 --2- 172.21.15.103:0/591906623 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8b40654e0 0x7fd8b40664a0 secure :-1 s=READY pgs=2265 cs=0 l=1 rx=0x7fd8a4002f30 tx=0x7fd8a4007a40).ready entity=mon.1 client_cookie=1c4349c21a32385e server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:55.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.048+0000 7fd8b9a2c700 1 --2- 172.21.15.103:0/591906623 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8b40654e0 0x7fd8b40664a0 secure :-1 s=THROTTLE_DONE pgs=2265 cs=0 l=1 rx=0x7fd8a4002f30 tx=0x7fd8a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.048+0000 7fd8b922b700 1 -- 172.21.15.103:0/591906623 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8a4011470 con 0x7fd8b40654e0 2020-04-22T14:20:55.055 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.048+0000 7fd8b9a2c700 1 --2- 172.21.15.103:0/591906623 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8b40654e0 0x7fd8b40664a0 secure :-1 s=THROTTLE_DONE pgs=2265 cs=0 l=1 rx=0x7fd8a4002f30 tx=0x7fd8a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.048+0000 7fd8b9a2c700 1 --2- 172.21.15.103:0/591906623 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8b40654e0 0x7fd8b40664a0 secure :-1 s=THROTTLE_DONE pgs=2265 cs=0 l=1 rx=0x7fd8a4002f30 tx=0x7fd8a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.048+0000 7fd8b922b700 1 -- 172.21.15.103:0/591906623 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a40115d0 con 0x7fd8b40654e0 2020-04-22T14:20:55.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.048+0000 7fd8b922b700 1 -- 172.21.15.103:0/591906623 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8a40119b0 con 0x7fd8b40654e0 2020-04-22T14:20:55.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.048+0000 7fd8bb22f700 1 -- 172.21.15.103:0/591906623 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8b40654e0 msgr2=0x7fd8b40664a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:55.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.048+0000 7fd8bb22f700 1 --2- 172.21.15.103:0/591906623 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8b40654e0 0x7fd8b40664a0 secure :-1 s=READY pgs=2265 cs=0 l=1 rx=0x7fd8a4002f30 tx=0x7fd8a4007a40).stop 2020-04-22T14:20:55.056 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.049+0000 7fd8bb22f700 1 -- 172.21.15.103:0/591906623 shutdown_connections 2020-04-22T14:20:55.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.049+0000 7fd8bb22f700 1 --2- 172.21.15.103:0/591906623 >> v2:172.21.15.86:3300/0 conn(0x7fd8b4142320 0x7fd8b4063340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:55.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.049+0000 7fd8bb22f700 1 --2- 172.21.15.103:0/591906623 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8b40654e0 0x7fd8b40664a0 unknown :-1 s=CLOSED pgs=2265 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:55.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.049+0000 7fd8bb22f700 1 -- 172.21.15.103:0/591906623 >> 172.21.15.103:0/591906623 conn(0x7fd8b405b7c0 msgr2=0x7fd8b4061610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:55.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.049+0000 7fd8bb22f700 1 -- 172.21.15.103:0/591906623 shutdown_connections 2020-04-22T14:20:55.057 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.049+0000 7fd8bb22f700 1 -- 172.21.15.103:0/591906623 wait complete. 2020-04-22T14:20:55.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.050+0000 7fd8bb22f700 1 Processor -- start 2020-04-22T14:20:55.060 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.050+0000 7fd8bb22f700 1 -- start start 2020-04-22T14:20:55.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.051+0000 7fd8bb22f700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd8b40ad150 0x7fd8b4137610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:55.061 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.051+0000 7fd8bb22f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd8b4142320 0x7fd8b4151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:55.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.051+0000 7fd8bb22f700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b4151310 con 0x7fd8b40654e0 2020-04-22T14:20:55.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.051+0000 7fd8bb22f700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b41523a0 con 0x7fd8b40ad150 2020-04-22T14:20:55.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.051+0000 7fd8bb22f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b4151560 con 0x7fd8b4142320 2020-04-22T14:20:55.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.051+0000 7fd8baa2e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd8b4142320 0x7fd8b4151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:55.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.051+0000 7fd8baa2e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd8b4142320 0x7fd8b4151f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59530/0 (socket says 172.21.15.103:59530) 2020-04-22T14:20:55.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.051+0000 7fd8baa2e700 1 -- 172.21.15.103:0/3180931663 learned_addr learned my addr 172.21.15.103:0/3180931663 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:55.062 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.051+0000 7fd8b9a2c700 1 --2- 172.21.15.103:0/3180931663 >> v2:172.21.15.86:3300/0 conn(0x7fd8b40ad150 0x7fd8b4137610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:55.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.051+0000 7fd8baa2e700 1 -- 172.21.15.103:0/3180931663 >> v2:172.21.15.86:3300/0 conn(0x7fd8b40ad150 msgr2=0x7fd8b4137610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:55.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.051+0000 7fd8baa2e700 1 --2- 172.21.15.103:0/3180931663 >> v2:172.21.15.86:3300/0 conn(0x7fd8b40ad150 0x7fd8b4137610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:55.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.051+0000 7fd8baa2e700 1 -- 172.21.15.103:0/3180931663 >> v1:172.21.15.86:6789/0 conn(0x7fd8b40654e0 legacy=0x7fd8b4132f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:55.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.051+0000 7fd8baa2e700 1 -- 172.21.15.103:0/3180931663 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b4151800 con 0x7fd8b4142320 2020-04-22T14:20:55.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.051+0000 7fd8b9a2c700 1 --2- 172.21.15.103:0/3180931663 >> v2:172.21.15.86:3300/0 conn(0x7fd8b40ad150 0x7fd8b4137610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:20:55.063 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.051+0000 7fd8baa2e700 1 --2- 172.21.15.103:0/3180931663 >> v2:172.21.15.103:3300/0 conn(0x7fd8b4142320 0x7fd8b4151f40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd8b0002ef0 tx=0x7fd8b0010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.051+0000 7fd8baa2e700 1 --2- 172.21.15.103:0/3180931663 >> v2:172.21.15.103:3300/0 conn(0x7fd8b4142320 0x7fd8b4151f40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd8b0002ef0 tx=0x7fd8b0010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.051+0000 7fd8baa2e700 1 --2- 172.21.15.103:0/3180931663 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8b4142320 0x7fd8b4151f40 secure :-1 s=READY pgs=2266 cs=0 l=1 rx=0x7fd8b0002ef0 tx=0x7fd8b0010af0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:55.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.051+0000 7fd8baa2e700 1 --2- 172.21.15.103:0/3180931663 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8b4142320 0x7fd8b4151f40 secure :-1 s=THROTTLE_DONE pgs=2266 cs=0 l=1 rx=0x7fd8b0002ef0 tx=0x7fd8b0010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.051+0000 7fd8a37fe700 1 -- 172.21.15.103:0/3180931663 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8b0008e80 con 0x7fd8b4142320 2020-04-22T14:20:55.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.051+0000 7fd8baa2e700 1 --2- 172.21.15.103:0/3180931663 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8b4142320 0x7fd8b4151f40 secure :-1 s=THROTTLE_DONE pgs=2266 cs=0 l=1 rx=0x7fd8b0002ef0 tx=0x7fd8b0010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.051+0000 7fd8baa2e700 1 --2- 172.21.15.103:0/3180931663 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8b4142320 0x7fd8b4151f40 secure :-1 s=THROTTLE_DONE pgs=2266 cs=0 l=1 rx=0x7fd8b0002ef0 tx=0x7fd8b0010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.064 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.051+0000 7fd8a37fe700 1 -- 172.21.15.103:0/3180931663 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b0007180 con 0x7fd8b4142320 2020-04-22T14:20:55.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.051+0000 7fd8bb22f700 1 -- 172.21.15.103:0/3180931663 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8b4151aa0 con 0x7fd8b4142320 2020-04-22T14:20:55.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.051+0000 7fd8a37fe700 1 -- 172.21.15.103:0/3180931663 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8b0007560 con 0x7fd8b4142320 2020-04-22T14:20:55.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.051+0000 7fd8bb22f700 1 -- 172.21.15.103:0/3180931663 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b40ae4d0 con 0x7fd8b4142320 2020-04-22T14:20:55.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.052+0000 7fd8baa2e700 1 --2- 172.21.15.103:0/3180931663 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8b4142320 0x7fd8b4151f40 secure :-1 s=THROTTLE_DONE pgs=2266 cs=0 l=1 rx=0x7fd8b0002ef0 tx=0x7fd8b0010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.052+0000 7fd8a37fe700 1 -- 172.21.15.103:0/3180931663 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fd8b0005a10 con 0x7fd8b4142320 2020-04-22T14:20:55.065 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.052+0000 7fd8baa2e700 1 --2- 172.21.15.103:0/3180931663 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8b4142320 0x7fd8b4151f40 secure :-1 s=THROTTLE_DONE pgs=2266 cs=0 l=1 rx=0x7fd8b0002ef0 tx=0x7fd8b0010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.053+0000 7fd8bb22f700 1 -- 172.21.15.103:0/3180931663 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8b4056c90 con 0x7fd8b4142320 2020-04-22T14:20:55.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.053+0000 7fd8a37fe700 1 --2- 172.21.15.103:0/3180931663 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd89404d8d0 0x7fd89404fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:55.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.053+0000 7fd8a37fe700 1 -- 172.21.15.103:0/3180931663 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd8b0061330 con 0x7fd8b4142320 2020-04-22T14:20:55.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.053+0000 7fd8ba22d700 1 --2- 172.21.15.103:0/3180931663 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd89404d8d0 0x7fd89404fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:55.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.053+0000 7fd8ba22d700 1 --2- 172.21.15.103:0/3180931663 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd89404d8d0 0x7fd89404fd90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd8b4133e10 tx=0x7fd8ac0017f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.053+0000 7fd8ba22d700 1 --2- 172.21.15.103:0/3180931663 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd89404d8d0 0x7fd89404fd90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd8b4133e10 tx=0x7fd8ac0017f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.066 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.053+0000 7fd8ba22d700 1 --2- 172.21.15.103:0/3180931663 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd89404d8d0 0x7fd89404fd90 secure :-1 s=READY pgs=819 cs=0 l=1 rx=0x7fd8b4133e10 tx=0x7fd8ac0017f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:55.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.057+0000 7fd8baa2e700 1 --2- 172.21.15.103:0/3180931663 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8b4142320 0x7fd8b4151f40 secure :-1 s=THROTTLE_DONE pgs=2266 cs=0 l=1 rx=0x7fd8b0002ef0 tx=0x7fd8b0010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.067 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.057+0000 7fd8a37fe700 1 -- 172.21.15.103:0/3180931663 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fd8b003c6b0 con 0x7fd8b4142320 2020-04-22T14:20:55.203 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.200+0000 7fd8bb22f700 1 -- 172.21.15.103:0/3180931663 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8b405d360 con 0x7fd8b4142320 2020-04-22T14:20:55.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.201+0000 7fd8baa2e700 1 --2- 172.21.15.103:0/3180931663 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8b4142320 0x7fd8b4151f40 secure :-1 s=THROTTLE_DONE pgs=2266 cs=0 l=1 rx=0x7fd8b0002ef0 tx=0x7fd8b0010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.201+0000 7fd8a37fe700 1 -- 172.21.15.103:0/3180931663 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v158) v1 ==== 74+0+16103 (secure 0 0 0) 0x7fd8b003fcd0 con 0x7fd8b4142320 2020-04-22T14:20:55.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.202+0000 7fd8bb22f700 1 -- 172.21.15.103:0/3180931663 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd89404d8d0 msgr2=0x7fd89404fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:55.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.202+0000 7fd8bb22f700 1 --2- 172.21.15.103:0/3180931663 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd89404d8d0 0x7fd89404fd90 secure :-1 s=READY pgs=819 cs=0 l=1 rx=0x7fd8b4133e10 tx=0x7fd8ac0017f0).stop 2020-04-22T14:20:55.207 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.202+0000 7fd8bb22f700 1 -- 172.21.15.103:0/3180931663 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8b4142320 msgr2=0x7fd8b4151f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:55.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.202+0000 7fd8bb22f700 1 --2- 172.21.15.103:0/3180931663 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8b4142320 0x7fd8b4151f40 secure :-1 s=READY pgs=2266 cs=0 l=1 rx=0x7fd8b0002ef0 tx=0x7fd8b0010af0).stop 2020-04-22T14:20:55.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.203+0000 7fd8bb22f700 1 -- 172.21.15.103:0/3180931663 shutdown_connections 2020-04-22T14:20:55.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.203+0000 7fd8bb22f700 1 --2- 172.21.15.103:0/3180931663 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8b4142320 0x7fd8b4151f40 unknown :-1 s=CLOSED pgs=2266 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:55.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.203+0000 7fd8bb22f700 1 --2- 172.21.15.103:0/3180931663 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fd89404d8d0 0x7fd89404fd90 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:55.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.203+0000 7fd8bb22f700 1 --2- 172.21.15.103:0/3180931663 >> v2:172.21.15.86:3300/0 conn(0x7fd8b40ad150 0x7fd8b4137610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:55.208 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.203+0000 7fd8bb22f700 1 -- 172.21.15.103:0/3180931663 >> 172.21.15.103:0/3180931663 conn(0x7fd8b405b7c0 msgr2=0x7fd8b4062850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:55.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.203+0000 7fd8bb22f700 1 -- 172.21.15.103:0/3180931663 shutdown_connections 2020-04-22T14:20:55.209 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.203+0000 7fd8bb22f700 1 -- 172.21.15.103:0/3180931663 wait complete. 2020-04-22T14:20:55.209 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:20:55.209 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":158,"fsid":"6802606a-35a0-4e54-95ba-51f48cd433bb","created":"2020-04-22T14:02:06.484738+0000","modified":"2020-04-22T14:20:43.937239+0000","last_up_change":"2020-04-22T14:02:18.623774+0000","last_in_change":"2020-04-22T14:02:18.623774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-22T14:02:09.565655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-22T14:02:22.733031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2020-04-22T14:20:40.847124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2020-04-22T14:20:41.893982+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3546145b-bd93-4a79-b6fe-3158153b8f05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":33072},{"type":"v1","addr":"172.21.15.103:6801","nonce":33072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":33072},{"type":"v1","addr":"172.21.15.103:6803","nonce":33072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":33072},{"type":"v1","addr":"172.21.15.103:6807","nonce":33072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":33072},{"type":"v1","addr":"172.21.15.103:6805","nonce":33072}]},"public_addr":"172.21.15.103:6801/33072","cluster_addr":"172.21.15.103:6803/33072","heartbeat_back_addr":"172.21.15.103:6807/33072","heartbeat_front_addr":"172.21.15.103:6805/33072","state":["exists","up"]},{"osd":1,"uuid":"65ca5f7d-2ea6-4de6-a034-08a0a99aa80d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":33103},{"type":"v1","addr":"172.21.15.103:6809","nonce":33103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":33103},{"type":"v1","addr":"172.21.15.103:6811","nonce":33103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":33103},{"type":"v1","addr":"172.21.15.103:6815","nonce":33103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":33103},{"type":"v1","addr":"172.21.15.103:6813","nonce":33103}]},"public_addr":"172.21.15.103:6809/33103","cluster_addr":"172.21.15.103:6811/33103","heartbeat_back_addr":"172.21.15.103:6815/33103","heartbeat_front_addr":"172.21.15.103:6813/33103","state":["exists","up"]},{"osd":2,"uuid":"f2e9bf44-c844-48d7-b6c2-f08ea71189b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":33153},{"type":"v1","addr":"172.21.15.103:6817","nonce":33153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":33153},{"type":"v1","addr":"172.21.15.103:6819","nonce":33153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":33153},{"type":"v1","addr":"172.21.15.103:6823","nonce":33153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":33153},{"type":"v1","addr":"172.21.15.103:6821","nonce":33153}]},"public_addr":"172.21.15.103:6817/33153","cluster_addr":"172.21.15.103:6819/33153","heartbeat_back_addr":"172.21.15.103:6823/33153","heartbeat_front_addr":"172.21.15.103:6821/33153","state":["exists","up"]},{"osd":3,"uuid":"0ab87fee-a427-4906-851a-b9bd8c2e5645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":143,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":33183},{"type":"v1","addr":"172.21.15.103:6825","nonce":33183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":33183},{"type":"v1","addr":"172.21.15.103:6827","nonce":33183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":33183},{"type":"v1","addr":"172.21.15.103:6831","nonce":33183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":33183},{"type":"v1","addr":"172.21.15.103:6829","nonce":33183}]},"public_addr":"172.21.15.103:6825/33183","cluster_addr":"172.21.15.103:6827/33183","heartbeat_back_addr":"172.21.15.103:6831/33183","heartbeat_front_addr":"172.21.15.103:6829/33183","state":["exists","up"]},{"osd":4,"uuid":"2565df7d-2eff-484b-a3cd-ed7715e5d875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":33506},{"type":"v1","addr":"172.21.15.86:6803","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":33506},{"type":"v1","addr":"172.21.15.86:6805","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":33506},{"type":"v1","addr":"172.21.15.86:6809","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":33506},{"type":"v1","addr":"172.21.15.86:6807","nonce":33506}]},"public_addr":"172.21.15.86:6803/33506","cluster_addr":"172.21.15.86:6805/33506","heartbeat_back_addr":"172.21.15.86:6809/33506","heartbeat_front_addr":"172.21.15.86:6807/33506","state":["exists","up"]},{"osd":5,"uuid":"bcfd7a16-6914-4152-8647-a481917fe19d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":33554},{"type":"v1","addr":"172.21.15.86:6811","nonce":33554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":33554},{"type":"v1","addr":"172.21.15.86:6813","nonce":33554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":33554},{"type":"v1","addr":"172.21.15.86:6817","nonce":33554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":33554},{"type":"v1","addr":"172.21.15.86:6815","nonce":33554}]},"public_addr":"172.21.15.86:6811/33554","cluster_addr":"172.21.15.86:6813/33554","heartbeat_back_addr":"172.21.15.86:6817/33554","heartbeat_front_addr":"172.21.15.86:6815/33554","state":["exists","up"]},{"osd":6,"uuid":"8321f5cd-ea2d-4d15-9e0c-dddb7f3b3050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":33601},{"type":"v1","addr":"172.21.15.86:6819","nonce":33601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":33601},{"type":"v1","addr":"172.21.15.86:6821","nonce":33601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":33601},{"type":"v1","addr":"172.21.15.86:6825","nonce":33601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":33601},{"type":"v1","addr":"172.21.15.86:6823","nonce":33601}]},"public_addr":"172.21.15.86:6819/33601","cluster_addr":"172.21.15.86:6821/33601","heartbeat_back_addr":"172.21.15.86:6825/33601","heartbeat_front_addr":"172.21.15.86:6823/33601","state":["exists","up"]},{"osd":7,"uuid":"340eece1-4c39-47cd-b95f-9cfa5dcfe361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":33629},{"type":"v1","addr":"172.21.15.86:6827","nonce":33629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":33629},{"type":"v1","addr":"172.21.15.86:6829","nonce":33629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":33629},{"type":"v1","addr":"172.21.15.86:6833","nonce":33629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":33629},{"type":"v1","addr":"172.21.15.86:6831","nonce":33629}]},"public_addr":"172.21.15.86:6827/33629","cluster_addr":"172.21.15.86:6829/33629","heartbeat_back_addr":"172.21.15.86:6833/33629","heartbeat_front_addr":"172.21.15.86:6831/33629","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.384360+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.503590+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.525058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.599729+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.600919+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.654718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.718342+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-04-22T14:02:16.839089+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-22T14:20:55.217 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:09.565655+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:02:22.733031+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:20:40.847124+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 27, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'157', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-22T14:20:41.893982+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 28, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'158', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-22T14:20:55.217 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:55.232 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-22T14:20:55.380 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.377+0000 7f04e01ef700 1 Processor -- start 2020-04-22T14:20:55.381 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.377+0000 7f04e01ef700 1 -- start start 2020-04-22T14:20:55.388 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.378+0000 7f04e01ef700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f04d80b5cf0 0x7f04d80b7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:55.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.378+0000 7f04e01ef700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f04d814da20 0x7f04d814fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:55.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.378+0000 7f04e01ef700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04d80b0ed0 con 0x7f04d8145980 2020-04-22T14:20:55.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.378+0000 7f04e01ef700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04d80b1170 con 0x7f04d80b5cf0 2020-04-22T14:20:55.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.378+0000 7f04e01ef700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04d80b1410 con 0x7f04d814da20 2020-04-22T14:20:55.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.378+0000 7f04de78c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f04d814da20 0x7f04d814fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:55.389 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.378+0000 7f04de78c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f04d814da20 0x7f04d814fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59534/0 (socket says 172.21.15.103:59534) 2020-04-22T14:20:55.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.378+0000 7f04de78c700 1 -- 172.21.15.103:0/4242105404 learned_addr learned my addr 172.21.15.103:0/4242105404 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:55.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.378+0000 7f04ddf8b700 1 --2- 172.21.15.103:0/4242105404 >> v2:172.21.15.86:3300/0 conn(0x7f04d80b5cf0 0x7f04d80b7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:55.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.379+0000 7f04de78c700 1 -- 172.21.15.103:0/4242105404 >> v2:172.21.15.86:3300/0 conn(0x7f04d80b5cf0 msgr2=0x7f04d80b7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:55.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.379+0000 7f04de78c700 1 --2- 172.21.15.103:0/4242105404 >> v2:172.21.15.86:3300/0 conn(0x7f04d80b5cf0 0x7f04d80b7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:55.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.379+0000 7f04de78c700 1 -- 172.21.15.103:0/4242105404 >> v1:172.21.15.86:6789/0 conn(0x7f04d8145980 legacy=0x7f04d8145de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:55.390 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.379+0000 7f04de78c700 1 -- 172.21.15.103:0/4242105404 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d80b60d0 con 0x7f04d814da20 2020-04-22T14:20:55.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.379+0000 7f04de78c700 1 --2- 172.21.15.103:0/4242105404 >> v2:172.21.15.103:3300/0 conn(0x7f04d814da20 0x7f04d814fe10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f04d00032b0 tx=0x7f04d0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.379+0000 7f04de78c700 1 --2- 172.21.15.103:0/4242105404 >> v2:172.21.15.103:3300/0 conn(0x7f04d814da20 0x7f04d814fe10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f04d00032b0 tx=0x7f04d0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.379+0000 7f04de78c700 1 --2- 172.21.15.103:0/4242105404 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04d814da20 0x7f04d814fe10 secure :-1 s=READY pgs=2267 cs=0 l=1 rx=0x7f04d00032b0 tx=0x7f04d0007dc0).ready entity=mon.1 client_cookie=fff7af53bc5482fa server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:55.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.379+0000 7f04de78c700 1 --2- 172.21.15.103:0/4242105404 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04d814da20 0x7f04d814fe10 secure :-1 s=THROTTLE_DONE pgs=2267 cs=0 l=1 rx=0x7f04d00032b0 tx=0x7f04d0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.379+0000 7f04dcf89700 1 -- 172.21.15.103:0/4242105404 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04d000a180 con 0x7f04d814da20 2020-04-22T14:20:55.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.379+0000 7f04de78c700 1 --2- 172.21.15.103:0/4242105404 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04d814da20 0x7f04d814fe10 secure :-1 s=THROTTLE_DONE pgs=2267 cs=0 l=1 rx=0x7f04d00032b0 tx=0x7f04d0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.391 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.379+0000 7f04de78c700 1 --2- 172.21.15.103:0/4242105404 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04d814da20 0x7f04d814fe10 secure :-1 s=THROTTLE_DONE pgs=2267 cs=0 l=1 rx=0x7f04d00032b0 tx=0x7f04d0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.379+0000 7f04dcf89700 1 -- 172.21.15.103:0/4242105404 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d000a2e0 con 0x7f04d814da20 2020-04-22T14:20:55.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.379+0000 7f04dcf89700 1 -- 172.21.15.103:0/4242105404 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04d000a700 con 0x7f04d814da20 2020-04-22T14:20:55.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.379+0000 7f04e01ef700 1 -- 172.21.15.103:0/4242105404 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04d814da20 msgr2=0x7f04d814fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:55.392 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.379+0000 7f04e01ef700 1 --2- 172.21.15.103:0/4242105404 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04d814da20 0x7f04d814fe10 secure :-1 s=READY pgs=2267 cs=0 l=1 rx=0x7f04d00032b0 tx=0x7f04d0007dc0).stop 2020-04-22T14:20:55.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.379+0000 7f04e01ef700 1 -- 172.21.15.103:0/4242105404 shutdown_connections 2020-04-22T14:20:55.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.379+0000 7f04e01ef700 1 --2- 172.21.15.103:0/4242105404 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04d814da20 0x7f04d814fe10 unknown :-1 s=CLOSED pgs=2267 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:55.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.379+0000 7f04e01ef700 1 --2- 172.21.15.103:0/4242105404 >> v2:172.21.15.86:3300/0 conn(0x7f04d80b5cf0 0x7f04d80b7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:55.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.379+0000 7f04e01ef700 1 -- 172.21.15.103:0/4242105404 >> 172.21.15.103:0/4242105404 conn(0x7f04d805ad30 msgr2=0x7f04d805b140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:55.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.379+0000 7f04e01ef700 1 -- 172.21.15.103:0/4242105404 shutdown_connections 2020-04-22T14:20:55.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.379+0000 7f04e01ef700 1 -- 172.21.15.103:0/4242105404 wait complete. 2020-04-22T14:20:55.393 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.380+0000 7f04e01ef700 1 Processor -- start 2020-04-22T14:20:55.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.380+0000 7f04e01ef700 1 -- start start 2020-04-22T14:20:55.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.381+0000 7f04e01ef700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f04d8145980 0x7f04d8137dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:55.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.381+0000 7f04e01ef700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f04d814da20 0x7f04d8135f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:55.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.381+0000 7f04e01ef700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04d81370f0 con 0x7f04d80b5cf0 2020-04-22T14:20:55.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.381+0000 7f04e01ef700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04d8135a10 con 0x7f04d814da20 2020-04-22T14:20:55.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.381+0000 7f04e01ef700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04d8137320 con 0x7f04d8145980 2020-04-22T14:20:55.394 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.381+0000 7f04ddf8b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f04d80b5cf0 0x7f04d8066670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51728/0 (socket says 172.21.15.103:51728) 2020-04-22T14:20:55.395 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.381+0000 7f04ddf8b700 1 -- 172.21.15.103:0/661200842 learned_addr learned my addr 172.21.15.103:0/661200842 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:55.395 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.381+0000 7f04dd78a700 1 --2- 172.21.15.103:0/661200842 >> v2:172.21.15.103:3300/0 conn(0x7f04d8145980 0x7f04d8137dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:55.395 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.381+0000 7f04de78c700 1 --2- 172.21.15.103:0/661200842 >> v2:172.21.15.86:3300/0 conn(0x7f04d814da20 0x7f04d8135f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:55.395 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.381+0000 7f04c6ffd700 1 -- 172.21.15.103:0/661200842 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4019635509 0 0) 0x7f04d81370f0 con 0x7f04d80b5cf0 2020-04-22T14:20:55.395 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.381+0000 7f04c6ffd700 1 -- 172.21.15.103:0/661200842 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04b8002fe0 con 0x7f04d80b5cf0 2020-04-22T14:20:55.395 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.382+0000 7f04dd78a700 1 -- 172.21.15.103:0/661200842 >> v2:172.21.15.86:3300/0 conn(0x7f04d814da20 msgr2=0x7f04d8135f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:55.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.382+0000 7f04dd78a700 1 --2- 172.21.15.103:0/661200842 >> v2:172.21.15.86:3300/0 conn(0x7f04d814da20 0x7f04d8135f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:55.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.382+0000 7f04dd78a700 1 -- 172.21.15.103:0/661200842 >> v1:172.21.15.103:6789/0 conn(0x7f04d80b5cf0 legacy=0x7f04d8066670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:55.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.382+0000 7f04dd78a700 1 -- 172.21.15.103:0/661200842 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d8064240 con 0x7f04d8145980 2020-04-22T14:20:55.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.382+0000 7f04dd78a700 1 --2- 172.21.15.103:0/661200842 >> v2:172.21.15.103:3300/0 conn(0x7f04d8145980 0x7f04d8137dc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f04d8136eb0 tx=0x7f04d40108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.382+0000 7f04dd78a700 1 --2- 172.21.15.103:0/661200842 >> v2:172.21.15.103:3300/0 conn(0x7f04d8145980 0x7f04d8137dc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f04d8136eb0 tx=0x7f04d40108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.382+0000 7f04dd78a700 1 --2- 172.21.15.103:0/661200842 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04d8145980 0x7f04d8137dc0 secure :-1 s=READY pgs=2269 cs=0 l=1 rx=0x7f04d8136eb0 tx=0x7f04d40108e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:55.396 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.382+0000 7f04dd78a700 1 --2- 172.21.15.103:0/661200842 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04d8145980 0x7f04d8137dc0 secure :-1 s=THROTTLE_DONE pgs=2269 cs=0 l=1 rx=0x7f04d8136eb0 tx=0x7f04d40108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.397 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.382+0000 7f04c6ffd700 1 -- 172.21.15.103:0/661200842 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04d400cc00 con 0x7f04d8145980 2020-04-22T14:20:55.397 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.382+0000 7f04dd78a700 1 --2- 172.21.15.103:0/661200842 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04d8145980 0x7f04d8137dc0 secure :-1 s=THROTTLE_DONE pgs=2269 cs=0 l=1 rx=0x7f04d8136eb0 tx=0x7f04d40108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.397 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.382+0000 7f04c6ffd700 1 -- 172.21.15.103:0/661200842 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d400cda0 con 0x7f04d8145980 2020-04-22T14:20:55.397 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.382+0000 7f04e01ef700 1 -- 172.21.15.103:0/661200842 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04d8064910 con 0x7f04d8145980 2020-04-22T14:20:55.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.382+0000 7f04dd78a700 1 --2- 172.21.15.103:0/661200842 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04d8145980 0x7f04d8137dc0 secure :-1 s=THROTTLE_DONE pgs=2269 cs=0 l=1 rx=0x7f04d8136eb0 tx=0x7f04d40108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.382+0000 7f04c6ffd700 1 -- 172.21.15.103:0/661200842 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04d4010fd0 con 0x7f04d8145980 2020-04-22T14:20:55.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.382+0000 7f04e01ef700 1 -- 172.21.15.103:0/661200842 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d8066f40 con 0x7f04d8145980 2020-04-22T14:20:55.398 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.382+0000 7f04dd78a700 1 --2- 172.21.15.103:0/661200842 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04d8145980 0x7f04d8137dc0 secure :-1 s=THROTTLE_DONE pgs=2269 cs=0 l=1 rx=0x7f04d8136eb0 tx=0x7f04d40108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.383+0000 7f04c6ffd700 1 -- 172.21.15.103:0/661200842 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f04d40064e0 con 0x7f04d8145980 2020-04-22T14:20:55.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.383+0000 7f04dd78a700 1 --2- 172.21.15.103:0/661200842 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04d8145980 0x7f04d8137dc0 secure :-1 s=THROTTLE_DONE pgs=2269 cs=0 l=1 rx=0x7f04d8136eb0 tx=0x7f04d40108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.383+0000 7f04e01ef700 1 -- 172.21.15.103:0/661200842 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04d8056c90 con 0x7f04d8145980 2020-04-22T14:20:55.399 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.383+0000 7f04c6ffd700 1 --2- 172.21.15.103:0/661200842 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f04b804dd20 0x7f04b80501e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:55.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.383+0000 7f04c6ffd700 1 -- 172.21.15.103:0/661200842 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f04d4060f40 con 0x7f04d8145980 2020-04-22T14:20:55.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.384+0000 7f04ddf8b700 1 --2- 172.21.15.103:0/661200842 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f04b804dd20 0x7f04b80501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:55.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.384+0000 7f04ddf8b700 1 --2- 172.21.15.103:0/661200842 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f04b804dd20 0x7f04b80501e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f04c8002f30 tx=0x7f04c8001320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.384+0000 7f04ddf8b700 1 --2- 172.21.15.103:0/661200842 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f04b804dd20 0x7f04b80501e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f04c8002f30 tx=0x7f04c8001320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.400 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.384+0000 7f04ddf8b700 1 --2- 172.21.15.103:0/661200842 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f04b804dd20 0x7f04b80501e0 secure :-1 s=READY pgs=820 cs=0 l=1 rx=0x7f04c8002f30 tx=0x7f04c8001320).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:55.401 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.387+0000 7f04dd78a700 1 --2- 172.21.15.103:0/661200842 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04d8145980 0x7f04d8137dc0 secure :-1 s=THROTTLE_DONE pgs=2269 cs=0 l=1 rx=0x7f04d8136eb0 tx=0x7f04d40108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.402 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.388+0000 7f04c6ffd700 1 -- 172.21.15.103:0/661200842 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f04d403c320 con 0x7f04d8145980 2020-04-22T14:20:55.531 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.528+0000 7f04e01ef700 1 -- 172.21.15.103:0/661200842 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f04d8137460 con 0x7f04d8145980 2020-04-22T14:20:55.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.529+0000 7f04dd78a700 1 --2- 172.21.15.103:0/661200842 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04d8145980 0x7f04d8137dc0 secure :-1 s=THROTTLE_DONE pgs=2269 cs=0 l=1 rx=0x7f04d8136eb0 tx=0x7f04d40108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.532 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.529+0000 7f04c6ffd700 1 -- 172.21.15.103:0/661200842 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v158) v1 ==== 110+0+10 (secure 0 0 0) 0x7f04d8137460 con 0x7f04d8145980 2020-04-22T14:20:55.533 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2020-04-22T14:20:55.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.530+0000 7f04e01ef700 1 -- 172.21.15.103:0/661200842 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f04b804dd20 msgr2=0x7f04b80501e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:55.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.530+0000 7f04e01ef700 1 --2- 172.21.15.103:0/661200842 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f04b804dd20 0x7f04b80501e0 secure :-1 s=READY pgs=820 cs=0 l=1 rx=0x7f04c8002f30 tx=0x7f04c8001320).stop 2020-04-22T14:20:55.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.530+0000 7f04e01ef700 1 -- 172.21.15.103:0/661200842 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04d8145980 msgr2=0x7f04d8137dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:55.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.530+0000 7f04e01ef700 1 --2- 172.21.15.103:0/661200842 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04d8145980 0x7f04d8137dc0 secure :-1 s=READY pgs=2269 cs=0 l=1 rx=0x7f04d8136eb0 tx=0x7f04d40108e0).stop 2020-04-22T14:20:55.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.530+0000 7f04e01ef700 1 -- 172.21.15.103:0/661200842 shutdown_connections 2020-04-22T14:20:55.534 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.530+0000 7f04e01ef700 1 --2- 172.21.15.103:0/661200842 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f04b804dd20 0x7f04b80501e0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:55.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.530+0000 7f04e01ef700 1 --2- 172.21.15.103:0/661200842 >> v2:172.21.15.86:3300/0 conn(0x7f04d814da20 0x7f04d8135f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:55.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.530+0000 7f04e01ef700 1 --2- 172.21.15.103:0/661200842 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04d8145980 0x7f04d8137dc0 unknown :-1 s=CLOSED pgs=2269 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:55.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.530+0000 7f04e01ef700 1 -- 172.21.15.103:0/661200842 >> 172.21.15.103:0/661200842 conn(0x7f04d805ad30 msgr2=0x7f04d80b87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:55.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.530+0000 7f04e01ef700 1 -- 172.21.15.103:0/661200842 shutdown_connections 2020-04-22T14:20:55.535 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.530+0000 7f04e01ef700 1 -- 172.21.15.103:0/661200842 wait complete. 2020-04-22T14:20:55.543 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:55.556 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-22T14:20:55.708 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.705+0000 7f93d948c700 1 Processor -- start 2020-04-22T14:20:55.709 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.705+0000 7f93d948c700 1 -- start start 2020-04-22T14:20:55.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.706+0000 7f93d948c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f93d40b9140 0x7f93d412b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:55.715 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.706+0000 7f93d948c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f93d40ac950 0x7f93d412b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:55.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.706+0000 7f93d948c700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f93d4146c40 0x7f93d41470d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:55.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.706+0000 7f93d948c700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d4147530 con 0x7f93d4146c40 2020-04-22T14:20:55.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.706+0000 7f93d948c700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d40602f0 con 0x7f93d40ac950 2020-04-22T14:20:55.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.706+0000 7f93d948c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d41467e0 con 0x7f93d40b9140 2020-04-22T14:20:55.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.706+0000 7f93d27fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f93d40ac950 0x7f93d412b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:55.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.706+0000 7f93d27fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f93d40ac950 0x7f93d412b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59546/0 (socket says 172.21.15.103:59546) 2020-04-22T14:20:55.716 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.706+0000 7f93d27fc700 1 -- 172.21.15.103:0/1013851455 learned_addr learned my addr 172.21.15.103:0/1013851455 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:55.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.707+0000 7f93d37fe700 1 --2- 172.21.15.103:0/1013851455 >> v2:172.21.15.86:3300/0 conn(0x7f93d4146c40 0x7f93d41470d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:55.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.707+0000 7f93d2ffd700 1 --2- 172.21.15.103:0/1013851455 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f93d40b9140 0x7f93d412b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:55.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.707+0000 7f93d27fc700 1 -- 172.21.15.103:0/1013851455 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f93d40b9140 msgr2=0x7f93d412b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:55.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.707+0000 7f93d27fc700 1 --2- 172.21.15.103:0/1013851455 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f93d40b9140 0x7f93d412b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:55.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.707+0000 7f93d27fc700 1 -- 172.21.15.103:0/1013851455 >> v2:172.21.15.86:3300/0 conn(0x7f93d4146c40 msgr2=0x7f93d41470d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:55.717 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.707+0000 7f93d27fc700 1 --2- 172.21.15.103:0/1013851455 >> v2:172.21.15.86:3300/0 conn(0x7f93d4146c40 0x7f93d41470d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:55.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.707+0000 7f93d27fc700 1 -- 172.21.15.103:0/1013851455 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d4060050 con 0x7f93d40ac950 2020-04-22T14:20:55.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.707+0000 7f93d37fe700 1 --2- 172.21.15.103:0/1013851455 >> v2:172.21.15.86:3300/0 conn(0x7f93d4146c40 0x7f93d41470d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:20:55.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.707+0000 7f93d27fc700 1 --2- 172.21.15.103:0/1013851455 >> v2:172.21.15.103:3300/0 conn(0x7f93d40ac950 0x7f93d412b670 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f93c4002f30 tx=0x7f93c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.707+0000 7f93d27fc700 1 --2- 172.21.15.103:0/1013851455 >> v2:172.21.15.103:3300/0 conn(0x7f93d40ac950 0x7f93d412b670 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f93c4002f30 tx=0x7f93c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.707+0000 7f93d27fc700 1 --2- 172.21.15.103:0/1013851455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93d40ac950 0x7f93d412b670 secure :-1 s=READY pgs=2270 cs=0 l=1 rx=0x7f93c4002f30 tx=0x7f93c4007a40).ready entity=mon.1 client_cookie=5463e41182963eb8 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:55.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.707+0000 7f93d27fc700 1 --2- 172.21.15.103:0/1013851455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93d40ac950 0x7f93d412b670 secure :-1 s=THROTTLE_DONE pgs=2270 cs=0 l=1 rx=0x7f93c4002f30 tx=0x7f93c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.718 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.707+0000 7f93d1ffb700 1 -- 172.21.15.103:0/1013851455 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93c4011720 con 0x7f93d40ac950 2020-04-22T14:20:55.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.707+0000 7f93d27fc700 1 --2- 172.21.15.103:0/1013851455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93d40ac950 0x7f93d412b670 secure :-1 s=THROTTLE_DONE pgs=2270 cs=0 l=1 rx=0x7f93c4002f30 tx=0x7f93c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.707+0000 7f93d27fc700 1 --2- 172.21.15.103:0/1013851455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93d40ac950 0x7f93d412b670 secure :-1 s=THROTTLE_DONE pgs=2270 cs=0 l=1 rx=0x7f93c4002f30 tx=0x7f93c4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.707+0000 7f93d1ffb700 1 -- 172.21.15.103:0/1013851455 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c4011880 con 0x7f93d40ac950 2020-04-22T14:20:55.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.707+0000 7f93d1ffb700 1 -- 172.21.15.103:0/1013851455 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93c4011ca0 con 0x7f93d40ac950 2020-04-22T14:20:55.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.707+0000 7f93d948c700 1 -- 172.21.15.103:0/1013851455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93d40ac950 msgr2=0x7f93d412b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:55.719 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.707+0000 7f93d948c700 1 --2- 172.21.15.103:0/1013851455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93d40ac950 0x7f93d412b670 secure :-1 s=READY pgs=2270 cs=0 l=1 rx=0x7f93c4002f30 tx=0x7f93c4007a40).stop 2020-04-22T14:20:55.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.708+0000 7f93d948c700 1 -- 172.21.15.103:0/1013851455 shutdown_connections 2020-04-22T14:20:55.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.708+0000 7f93d948c700 1 --2- 172.21.15.103:0/1013851455 >> v2:172.21.15.86:3300/0 conn(0x7f93d4146c40 0x7f93d41470d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:55.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.708+0000 7f93d948c700 1 --2- 172.21.15.103:0/1013851455 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f93d40b9140 0x7f93d412b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:55.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.708+0000 7f93d948c700 1 --2- 172.21.15.103:0/1013851455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93d40ac950 0x7f93d412b670 unknown :-1 s=CLOSED pgs=2270 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:55.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.708+0000 7f93d948c700 1 -- 172.21.15.103:0/1013851455 >> 172.21.15.103:0/1013851455 conn(0x7f93d405b7b0 msgr2=0x7f93d40b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:55.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.708+0000 7f93d948c700 1 -- 172.21.15.103:0/1013851455 shutdown_connections 2020-04-22T14:20:55.720 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.708+0000 7f93d948c700 1 -- 172.21.15.103:0/1013851455 wait complete. 2020-04-22T14:20:55.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.708+0000 7f93d948c700 1 Processor -- start 2020-04-22T14:20:55.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.709+0000 7f93d948c700 1 -- start start 2020-04-22T14:20:55.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.709+0000 7f93d948c700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f93d40ac950 0x7f93d413f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:55.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.709+0000 7f93d948c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f93d4146c40 0x7f93d40afec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:55.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.709+0000 7f93d948c700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93d40b2640 con 0x7f93d40b9140 2020-04-22T14:20:55.721 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.709+0000 7f93d948c700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d40b23a0 con 0x7f93d4146c40 2020-04-22T14:20:55.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.709+0000 7f93d948c700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d4156ee0 con 0x7f93d40ac950 2020-04-22T14:20:55.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.709+0000 7f93d37fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f93d4146c40 0x7f93d40afec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:55.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.709+0000 7f93d37fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f93d4146c40 0x7f93d40afec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59554/0 (socket says 172.21.15.103:59554) 2020-04-22T14:20:55.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.709+0000 7f93d37fe700 1 -- 172.21.15.103:0/4250081461 learned_addr learned my addr 172.21.15.103:0/4250081461 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:55.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.709+0000 7f93d2ffd700 1 --2- 172.21.15.103:0/4250081461 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f93d40ac950 0x7f93d413f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:55.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.710+0000 7f93d37fe700 1 -- 172.21.15.103:0/4250081461 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f93d40ac950 msgr2=0x7f93d413f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:55.722 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.710+0000 7f93d37fe700 1 --2- 172.21.15.103:0/4250081461 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f93d40ac950 0x7f93d413f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:55.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.710+0000 7f93d37fe700 1 -- 172.21.15.103:0/4250081461 >> v1:172.21.15.86:6789/0 conn(0x7f93d40b9140 legacy=0x7f93d4153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:55.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.710+0000 7f93d37fe700 1 -- 172.21.15.103:0/4250081461 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d4153f90 con 0x7f93d4146c40 2020-04-22T14:20:55.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.710+0000 7f93d37fe700 1 --2- 172.21.15.103:0/4250081461 >> v2:172.21.15.103:3300/0 conn(0x7f93d4146c40 0x7f93d40afec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f93cc0032b0 tx=0x7f93cc010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.723 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.710+0000 7f93d37fe700 1 --2- 172.21.15.103:0/4250081461 >> v2:172.21.15.103:3300/0 conn(0x7f93d4146c40 0x7f93d40afec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f93cc0032b0 tx=0x7f93cc010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.710+0000 7f93d37fe700 1 --2- 172.21.15.103:0/4250081461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93d4146c40 0x7f93d40afec0 secure :-1 s=READY pgs=2271 cs=0 l=1 rx=0x7f93cc0032b0 tx=0x7f93cc010e90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:55.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.710+0000 7f93d37fe700 1 --2- 172.21.15.103:0/4250081461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93d4146c40 0x7f93d40afec0 secure :-1 s=THROTTLE_DONE pgs=2271 cs=0 l=1 rx=0x7f93cc0032b0 tx=0x7f93cc010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.710+0000 7f93c3fff700 1 -- 172.21.15.103:0/4250081461 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93cc012c10 con 0x7f93d4146c40 2020-04-22T14:20:55.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.710+0000 7f93d37fe700 1 --2- 172.21.15.103:0/4250081461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93d4146c40 0x7f93d40afec0 secure :-1 s=THROTTLE_DONE pgs=2271 cs=0 l=1 rx=0x7f93cc0032b0 tx=0x7f93cc010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.710+0000 7f93d37fe700 1 --2- 172.21.15.103:0/4250081461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93d4146c40 0x7f93d40afec0 secure :-1 s=THROTTLE_DONE pgs=2271 cs=0 l=1 rx=0x7f93cc0032b0 tx=0x7f93cc010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.725 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.710+0000 7f93c3fff700 1 -- 172.21.15.103:0/4250081461 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93cc012d70 con 0x7f93d4146c40 2020-04-22T14:20:55.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.710+0000 7f93d948c700 1 -- 172.21.15.103:0/4250081461 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d40b1c90 con 0x7f93d4146c40 2020-04-22T14:20:55.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.710+0000 7f93c3fff700 1 -- 172.21.15.103:0/4250081461 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93cc00a370 con 0x7f93d4146c40 2020-04-22T14:20:55.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.710+0000 7f93d948c700 1 -- 172.21.15.103:0/4250081461 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d40b2160 con 0x7f93d4146c40 2020-04-22T14:20:55.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.711+0000 7f93d37fe700 1 --2- 172.21.15.103:0/4250081461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93d4146c40 0x7f93d40afec0 secure :-1 s=THROTTLE_DONE pgs=2271 cs=0 l=1 rx=0x7f93cc0032b0 tx=0x7f93cc010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.711+0000 7f93d948c700 1 -- 172.21.15.103:0/4250081461 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93d4056c90 con 0x7f93d4146c40 2020-04-22T14:20:55.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.711+0000 7f93c3fff700 1 -- 172.21.15.103:0/4250081461 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f93cc00a5e0 con 0x7f93d4146c40 2020-04-22T14:20:55.726 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.711+0000 7f93d37fe700 1 --2- 172.21.15.103:0/4250081461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93d4146c40 0x7f93d40afec0 secure :-1 s=THROTTLE_DONE pgs=2271 cs=0 l=1 rx=0x7f93cc0032b0 tx=0x7f93cc010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.711+0000 7f93c3fff700 1 --2- 172.21.15.103:0/4250081461 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f93b004d9e0 0x7f93b004fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:55.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.711+0000 7f93c3fff700 1 -- 172.21.15.103:0/4250081461 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f93cc061b60 con 0x7f93d4146c40 2020-04-22T14:20:55.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.711+0000 7f93d2ffd700 1 --2- 172.21.15.103:0/4250081461 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f93b004d9e0 0x7f93b004fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:55.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.712+0000 7f93d2ffd700 1 --2- 172.21.15.103:0/4250081461 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f93b004d9e0 0x7f93b004fea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f93c8002f30 tx=0x7f93c800d710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.712+0000 7f93d2ffd700 1 --2- 172.21.15.103:0/4250081461 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f93b004d9e0 0x7f93b004fea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f93c8002f30 tx=0x7f93c800d710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.727 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.712+0000 7f93d2ffd700 1 --2- 172.21.15.103:0/4250081461 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f93b004d9e0 0x7f93b004fea0 secure :-1 s=READY pgs=821 cs=0 l=1 rx=0x7f93c8002f30 tx=0x7f93c800d710).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:55.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.715+0000 7f93d37fe700 1 --2- 172.21.15.103:0/4250081461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93d4146c40 0x7f93d40afec0 secure :-1 s=THROTTLE_DONE pgs=2271 cs=0 l=1 rx=0x7f93cc0032b0 tx=0x7f93cc010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.715+0000 7f93c3fff700 1 -- 172.21.15.103:0/4250081461 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f93cc03cfa0 con 0x7f93d4146c40 2020-04-22T14:20:55.788 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:20:55.805 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:20:55.851 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:55.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.857+0000 7f93d948c700 1 -- 172.21.15.103:0/4250081461 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f93d40b2a40 con 0x7f93d4146c40 2020-04-22T14:20:55.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.857+0000 7f93d37fe700 1 --2- 172.21.15.103:0/4250081461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93d4146c40 0x7f93d40afec0 secure :-1 s=THROTTLE_DONE pgs=2271 cs=0 l=1 rx=0x7f93cc0032b0 tx=0x7f93cc010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:55.861 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.857+0000 7f93c3fff700 1 -- 172.21.15.103:0/4250081461 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v158) v1 ==== 92+0+10 (secure 0 0 0) 0x7f93cc0405c0 con 0x7f93d4146c40 2020-04-22T14:20:55.861 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:20:55.862 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.859+0000 7f93d948c700 1 -- 172.21.15.103:0/4250081461 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f93b004d9e0 msgr2=0x7f93b004fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:55.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.859+0000 7f93d948c700 1 --2- 172.21.15.103:0/4250081461 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f93b004d9e0 0x7f93b004fea0 secure :-1 s=READY pgs=821 cs=0 l=1 rx=0x7f93c8002f30 tx=0x7f93c800d710).stop 2020-04-22T14:20:55.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.859+0000 7f93d948c700 1 -- 172.21.15.103:0/4250081461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93d4146c40 msgr2=0x7f93d40afec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:55.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.859+0000 7f93d948c700 1 --2- 172.21.15.103:0/4250081461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93d4146c40 0x7f93d40afec0 secure :-1 s=READY pgs=2271 cs=0 l=1 rx=0x7f93cc0032b0 tx=0x7f93cc010e90).stop 2020-04-22T14:20:55.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.859+0000 7f93d948c700 1 -- 172.21.15.103:0/4250081461 shutdown_connections 2020-04-22T14:20:55.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.859+0000 7f93d948c700 1 --2- 172.21.15.103:0/4250081461 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f93b004d9e0 0x7f93b004fea0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:55.863 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.859+0000 7f93d948c700 1 --2- 172.21.15.103:0/4250081461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93d4146c40 0x7f93d40afec0 unknown :-1 s=CLOSED pgs=2271 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:55.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.859+0000 7f93d948c700 1 --2- 172.21.15.103:0/4250081461 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f93d40ac950 0x7f93d413f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:55.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.859+0000 7f93d948c700 1 -- 172.21.15.103:0/4250081461 >> 172.21.15.103:0/4250081461 conn(0x7f93d405b7b0 msgr2=0x7f93d40b6a50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:55.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.859+0000 7f93d948c700 1 -- 172.21.15.103:0/4250081461 shutdown_connections 2020-04-22T14:20:55.864 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:55.859+0000 7f93d948c700 1 -- 172.21.15.103:0/4250081461 wait complete. 2020-04-22T14:20:55.865 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:20:55.873 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:55.928 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-22T14:20:56.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.073+0000 7ff627bd4700 1 Processor -- start 2020-04-22T14:20:56.076 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.073+0000 7ff627bd4700 1 -- start start 2020-04-22T14:20:56.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.074+0000 7ff627bd4700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff6200b9140 0x7ff6200aed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:56.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.074+0000 7ff627bd4700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff6200b3bd0 0x7ff6200af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:56.079 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.074+0000 7ff627bd4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff6200616b0 0x7ff620061b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:56.080 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.074+0000 7ff627bd4700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6200af650 con 0x7ff6200b9140 2020-04-22T14:20:56.080 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.074+0000 7ff627bd4700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff620148310 con 0x7ff6200b3bd0 2020-04-22T14:20:56.080 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.074+0000 7ff627bd4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6201485b0 con 0x7ff6200616b0 2020-04-22T14:20:56.080 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.074+0000 7ff62516f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff6200b3bd0 0x7ff6200af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:56.080 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.074+0000 7ff62516f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff6200b3bd0 0x7ff6200af1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59560/0 (socket says 172.21.15.103:59560) 2020-04-22T14:20:56.080 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.074+0000 7ff62516f700 1 -- 172.21.15.103:0/3920918957 learned_addr learned my addr 172.21.15.103:0/3920918957 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:56.080 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.074+0000 7ff625970700 1 --2- 172.21.15.103:0/3920918957 >> v2:172.21.15.86:3300/0 conn(0x7ff6200b9140 0x7ff6200aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:56.081 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.074+0000 7ff626171700 1 --2- 172.21.15.103:0/3920918957 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff6200616b0 0x7ff620061b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:56.081 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.074+0000 7ff62516f700 1 -- 172.21.15.103:0/3920918957 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff6200616b0 msgr2=0x7ff620061b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:56.081 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.074+0000 7ff62516f700 1 --2- 172.21.15.103:0/3920918957 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff6200616b0 0x7ff620061b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:56.081 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.074+0000 7ff62516f700 1 -- 172.21.15.103:0/3920918957 >> v2:172.21.15.86:3300/0 conn(0x7ff6200b9140 msgr2=0x7ff6200aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:56.081 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.074+0000 7ff62516f700 1 --2- 172.21.15.103:0/3920918957 >> v2:172.21.15.86:3300/0 conn(0x7ff6200b9140 0x7ff6200aed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:56.081 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.074+0000 7ff62516f700 1 -- 172.21.15.103:0/3920918957 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6200b9520 con 0x7ff6200b3bd0 2020-04-22T14:20:56.081 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.074+0000 7ff626171700 1 --2- 172.21.15.103:0/3920918957 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff6200616b0 0x7ff620061b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-22T14:20:56.082 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.074+0000 7ff62516f700 1 --2- 172.21.15.103:0/3920918957 >> v2:172.21.15.103:3300/0 conn(0x7ff6200b3bd0 0x7ff6200af1f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff61c002f30 tx=0x7ff61c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.082 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.074+0000 7ff62516f700 1 --2- 172.21.15.103:0/3920918957 >> v2:172.21.15.103:3300/0 conn(0x7ff6200b3bd0 0x7ff6200af1f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff61c002f30 tx=0x7ff61c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.082 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.074+0000 7ff62516f700 1 --2- 172.21.15.103:0/3920918957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6200b3bd0 0x7ff6200af1f0 secure :-1 s=READY pgs=2272 cs=0 l=1 rx=0x7ff61c002f30 tx=0x7ff61c007a40).ready entity=mon.1 client_cookie=545316406468cd3d server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:56.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.075+0000 7ff62516f700 1 --2- 172.21.15.103:0/3920918957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6200b3bd0 0x7ff6200af1f0 secure :-1 s=THROTTLE_DONE pgs=2272 cs=0 l=1 rx=0x7ff61c002f30 tx=0x7ff61c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.075+0000 7ff62496e700 1 -- 172.21.15.103:0/3920918957 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff61c011720 con 0x7ff6200b3bd0 2020-04-22T14:20:56.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.075+0000 7ff62516f700 1 --2- 172.21.15.103:0/3920918957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6200b3bd0 0x7ff6200af1f0 secure :-1 s=THROTTLE_DONE pgs=2272 cs=0 l=1 rx=0x7ff61c002f30 tx=0x7ff61c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.075+0000 7ff62516f700 1 --2- 172.21.15.103:0/3920918957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6200b3bd0 0x7ff6200af1f0 secure :-1 s=THROTTLE_DONE pgs=2272 cs=0 l=1 rx=0x7ff61c002f30 tx=0x7ff61c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.075+0000 7ff62496e700 1 -- 172.21.15.103:0/3920918957 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff61c011880 con 0x7ff6200b3bd0 2020-04-22T14:20:56.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.075+0000 7ff62496e700 1 -- 172.21.15.103:0/3920918957 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff61c011ca0 con 0x7ff6200b3bd0 2020-04-22T14:20:56.083 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.075+0000 7ff627bd4700 1 -- 172.21.15.103:0/3920918957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6200b3bd0 msgr2=0x7ff6200af1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:56.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.075+0000 7ff627bd4700 1 --2- 172.21.15.103:0/3920918957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6200b3bd0 0x7ff6200af1f0 secure :-1 s=READY pgs=2272 cs=0 l=1 rx=0x7ff61c002f30 tx=0x7ff61c007a40).stop 2020-04-22T14:20:56.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.075+0000 7ff627bd4700 1 -- 172.21.15.103:0/3920918957 shutdown_connections 2020-04-22T14:20:56.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.075+0000 7ff627bd4700 1 --2- 172.21.15.103:0/3920918957 >> v2:172.21.15.86:3300/0 conn(0x7ff6200b9140 0x7ff6200aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:56.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.075+0000 7ff627bd4700 1 --2- 172.21.15.103:0/3920918957 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff6200616b0 0x7ff620061b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:56.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.075+0000 7ff627bd4700 1 --2- 172.21.15.103:0/3920918957 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6200b3bd0 0x7ff6200af1f0 unknown :-1 s=CLOSED pgs=2272 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:56.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.075+0000 7ff627bd4700 1 -- 172.21.15.103:0/3920918957 >> 172.21.15.103:0/3920918957 conn(0x7ff62005b7b0 msgr2=0x7ff6200b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:56.084 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.075+0000 7ff627bd4700 1 -- 172.21.15.103:0/3920918957 shutdown_connections 2020-04-22T14:20:56.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.075+0000 7ff627bd4700 1 -- 172.21.15.103:0/3920918957 wait complete. 2020-04-22T14:20:56.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.076+0000 7ff627bd4700 1 Processor -- start 2020-04-22T14:20:56.085 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.076+0000 7ff627bd4700 1 -- start start 2020-04-22T14:20:56.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.077+0000 7ff627bd4700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff6200616b0 0x7ff6200b26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:56.088 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.077+0000 7ff627bd4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff6200b9140 0x7ff62013ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:56.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.077+0000 7ff627bd4700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6200b2b10 con 0x7ff6200b3bd0 2020-04-22T14:20:56.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.077+0000 7ff627bd4700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff620145a10 con 0x7ff6200616b0 2020-04-22T14:20:56.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.077+0000 7ff627bd4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff620145cb0 con 0x7ff6200b9140 2020-04-22T14:20:56.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.077+0000 7ff625970700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff6200616b0 0x7ff6200b26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:56.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.077+0000 7ff625970700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff6200616b0 0x7ff6200b26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59564/0 (socket says 172.21.15.103:59564) 2020-04-22T14:20:56.089 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.077+0000 7ff625970700 1 -- 172.21.15.103:0/2777529558 learned_addr learned my addr 172.21.15.103:0/2777529558 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:56.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.077+0000 7ff626171700 1 --2- 172.21.15.103:0/2777529558 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff6200b9140 0x7ff62013ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:56.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.077+0000 7ff625970700 1 -- 172.21.15.103:0/2777529558 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff6200b9140 msgr2=0x7ff62013ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:56.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.077+0000 7ff625970700 1 --2- 172.21.15.103:0/2777529558 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff6200b9140 0x7ff62013ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:56.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.077+0000 7ff625970700 1 -- 172.21.15.103:0/2777529558 >> v1:172.21.15.86:6789/0 conn(0x7ff6200b3bd0 legacy=0x7ff620145020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:56.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.077+0000 7ff625970700 1 -- 172.21.15.103:0/2777529558 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff620145730 con 0x7ff6200616b0 2020-04-22T14:20:56.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.077+0000 7ff625970700 1 --2- 172.21.15.103:0/2777529558 >> v2:172.21.15.103:3300/0 conn(0x7ff6200616b0 0x7ff6200b26b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff610007b00 tx=0x7ff610010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.090 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.077+0000 7ff625970700 1 --2- 172.21.15.103:0/2777529558 >> v2:172.21.15.103:3300/0 conn(0x7ff6200616b0 0x7ff6200b26b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff610007b00 tx=0x7ff610010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.077+0000 7ff625970700 1 --2- 172.21.15.103:0/2777529558 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6200616b0 0x7ff6200b26b0 secure :-1 s=READY pgs=2273 cs=0 l=1 rx=0x7ff610007b00 tx=0x7ff610010bf0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:56.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.077+0000 7ff625970700 1 --2- 172.21.15.103:0/2777529558 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6200616b0 0x7ff6200b26b0 secure :-1 s=THROTTLE_DONE pgs=2273 cs=0 l=1 rx=0x7ff610007b00 tx=0x7ff610010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.077+0000 7ff625970700 1 --2- 172.21.15.103:0/2777529558 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6200616b0 0x7ff6200b26b0 secure :-1 s=THROTTLE_DONE pgs=2273 cs=0 l=1 rx=0x7ff610007b00 tx=0x7ff610010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.077+0000 7ff60effd700 1 -- 172.21.15.103:0/2777529558 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff610005e90 con 0x7ff6200616b0 2020-04-22T14:20:56.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.077+0000 7ff625970700 1 --2- 172.21.15.103:0/2777529558 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6200616b0 0x7ff6200b26b0 secure :-1 s=THROTTLE_DONE pgs=2273 cs=0 l=1 rx=0x7ff610007b00 tx=0x7ff610010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.078+0000 7ff60effd700 1 -- 172.21.15.103:0/2777529558 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff610007180 con 0x7ff6200616b0 2020-04-22T14:20:56.091 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.078+0000 7ff627bd4700 1 -- 172.21.15.103:0/2777529558 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff620155060 con 0x7ff6200616b0 2020-04-22T14:20:56.092 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.078+0000 7ff60effd700 1 -- 172.21.15.103:0/2777529558 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff610007560 con 0x7ff6200616b0 2020-04-22T14:20:56.092 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.078+0000 7ff627bd4700 1 -- 172.21.15.103:0/2777529558 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff62013f5a0 con 0x7ff6200616b0 2020-04-22T14:20:56.092 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.078+0000 7ff625970700 1 --2- 172.21.15.103:0/2777529558 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6200616b0 0x7ff6200b26b0 secure :-1 s=THROTTLE_DONE pgs=2273 cs=0 l=1 rx=0x7ff610007b00 tx=0x7ff610010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.093 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.079+0000 7ff60effd700 1 -- 172.21.15.103:0/2777529558 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7ff61000e310 con 0x7ff6200616b0 2020-04-22T14:20:56.093 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.079+0000 7ff625970700 1 --2- 172.21.15.103:0/2777529558 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6200616b0 0x7ff6200b26b0 secure :-1 s=THROTTLE_DONE pgs=2273 cs=0 l=1 rx=0x7ff610007b00 tx=0x7ff610010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.094 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.079+0000 7ff627bd4700 1 -- 172.21.15.103:0/2777529558 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff620056c90 con 0x7ff6200616b0 2020-04-22T14:20:56.094 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.079+0000 7ff60effd700 1 --2- 172.21.15.103:0/2777529558 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff60004d960 0x7ff60004fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:56.094 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.079+0000 7ff60effd700 1 -- 172.21.15.103:0/2777529558 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff610061870 con 0x7ff6200616b0 2020-04-22T14:20:56.094 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.079+0000 7ff62516f700 1 --2- 172.21.15.103:0/2777529558 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff60004d960 0x7ff60004fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:56.094 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.079+0000 7ff62516f700 1 --2- 172.21.15.103:0/2777529558 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff60004d960 0x7ff60004fe20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff620062a60 tx=0x7ff61c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.094 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.079+0000 7ff62516f700 1 --2- 172.21.15.103:0/2777529558 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff60004d960 0x7ff60004fe20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff620062a60 tx=0x7ff61c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.094 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.079+0000 7ff62516f700 1 --2- 172.21.15.103:0/2777529558 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff60004d960 0x7ff60004fe20 secure :-1 s=READY pgs=822 cs=0 l=1 rx=0x7ff620062a60 tx=0x7ff61c007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:56.095 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.083+0000 7ff625970700 1 --2- 172.21.15.103:0/2777529558 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6200616b0 0x7ff6200b26b0 secure :-1 s=THROTTLE_DONE pgs=2273 cs=0 l=1 rx=0x7ff610007b00 tx=0x7ff610010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.095 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.083+0000 7ff60effd700 1 -- 172.21.15.103:0/2777529558 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7ff61003cbf0 con 0x7ff6200616b0 2020-04-22T14:20:56.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.226+0000 7ff627bd4700 1 -- 172.21.15.103:0/2777529558 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff6200b3960 con 0x7ff6200616b0 2020-04-22T14:20:56.229 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.226+0000 7ff625970700 1 --2- 172.21.15.103:0/2777529558 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6200616b0 0x7ff6200b26b0 secure :-1 s=THROTTLE_DONE pgs=2273 cs=0 l=1 rx=0x7ff610007b00 tx=0x7ff610010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.230 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.226+0000 7ff60effd700 1 -- 172.21.15.103:0/2777529558 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v158) v1 ==== 104+0+10 (secure 0 0 0) 0x7ff610040210 con 0x7ff6200616b0 2020-04-22T14:20:56.230 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:20:56.231 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.227+0000 7ff627bd4700 1 -- 172.21.15.103:0/2777529558 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff60004d960 msgr2=0x7ff60004fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:56.231 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.227+0000 7ff627bd4700 1 --2- 172.21.15.103:0/2777529558 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff60004d960 0x7ff60004fe20 secure :-1 s=READY pgs=822 cs=0 l=1 rx=0x7ff620062a60 tx=0x7ff61c007a40).stop 2020-04-22T14:20:56.231 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.227+0000 7ff627bd4700 1 -- 172.21.15.103:0/2777529558 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6200616b0 msgr2=0x7ff6200b26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:56.231 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.227+0000 7ff627bd4700 1 --2- 172.21.15.103:0/2777529558 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6200616b0 0x7ff6200b26b0 secure :-1 s=READY pgs=2273 cs=0 l=1 rx=0x7ff610007b00 tx=0x7ff610010bf0).stop 2020-04-22T14:20:56.231 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.227+0000 7ff627bd4700 1 -- 172.21.15.103:0/2777529558 shutdown_connections 2020-04-22T14:20:56.231 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.227+0000 7ff627bd4700 1 --2- 172.21.15.103:0/2777529558 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7ff60004d960 0x7ff60004fe20 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:56.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.227+0000 7ff627bd4700 1 --2- 172.21.15.103:0/2777529558 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff6200b9140 0x7ff62013ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:56.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.227+0000 7ff627bd4700 1 --2- 172.21.15.103:0/2777529558 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6200616b0 0x7ff6200b26b0 unknown :-1 s=CLOSED pgs=2273 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:56.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.228+0000 7ff627bd4700 1 -- 172.21.15.103:0/2777529558 >> 172.21.15.103:0/2777529558 conn(0x7ff62005b7b0 msgr2=0x7ff620140240 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:56.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.228+0000 7ff627bd4700 1 -- 172.21.15.103:0/2777529558 shutdown_connections 2020-04-22T14:20:56.232 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.228+0000 7ff627bd4700 1 -- 172.21.15.103:0/2777529558 wait complete. 2020-04-22T14:20:56.241 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:56.255 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-22T14:20:56.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.401+0000 7f250fe72700 1 Processor -- start 2020-04-22T14:20:56.404 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.401+0000 7f250fe72700 1 -- start start 2020-04-22T14:20:56.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.402+0000 7f250fe72700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2508061a30 0x7f25080b4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:56.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.402+0000 7f250fe72700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f25080acb10 0x7f25080ae920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:56.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.402+0000 7f250fe72700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2508060250 con 0x7f25080aed80 2020-04-22T14:20:56.407 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.402+0000 7f250fe72700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25080b94d0 con 0x7f25080acb10 2020-04-22T14:20:56.408 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.402+0000 7f250fe72700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25080623c0 con 0x7f2508061a30 2020-04-22T14:20:56.408 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.402+0000 7f250dc0e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2508061a30 0x7f25080b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:56.408 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.402+0000 7f250dc0e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2508061a30 0x7f25080b4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59572/0 (socket says 172.21.15.103:59572) 2020-04-22T14:20:56.408 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.402+0000 7f250dc0e700 1 -- 172.21.15.103:0/1990773711 learned_addr learned my addr 172.21.15.103:0/1990773711 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:56.408 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.402+0000 7f250d40d700 1 --2- 172.21.15.103:0/1990773711 >> v2:172.21.15.86:3300/0 conn(0x7f25080acb10 0x7f25080ae920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:56.408 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.402+0000 7f250dc0e700 1 -- 172.21.15.103:0/1990773711 >> v2:172.21.15.86:3300/0 conn(0x7f25080acb10 msgr2=0x7f25080ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:56.408 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.402+0000 7f250dc0e700 1 --2- 172.21.15.103:0/1990773711 >> v2:172.21.15.86:3300/0 conn(0x7f25080acb10 0x7f25080ae920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:56.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.402+0000 7f250dc0e700 1 -- 172.21.15.103:0/1990773711 >> v1:172.21.15.86:6789/0 conn(0x7f25080aed80 legacy=0x7f25080b8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:56.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.402+0000 7f250dc0e700 1 -- 172.21.15.103:0/1990773711 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2508062660 con 0x7f2508061a30 2020-04-22T14:20:56.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.402+0000 7f250dc0e700 1 --2- 172.21.15.103:0/1990773711 >> v2:172.21.15.103:3300/0 conn(0x7f2508061a30 0x7f25080b4820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2504002f30 tx=0x7f2504007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.402+0000 7f250dc0e700 1 --2- 172.21.15.103:0/1990773711 >> v2:172.21.15.103:3300/0 conn(0x7f2508061a30 0x7f25080b4820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2504002f30 tx=0x7f2504007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.402+0000 7f250dc0e700 1 --2- 172.21.15.103:0/1990773711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2508061a30 0x7f25080b4820 secure :-1 s=READY pgs=2274 cs=0 l=1 rx=0x7f2504002f30 tx=0x7f2504007a40).ready entity=mon.1 client_cookie=d15edbaf8fd9b67b server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:56.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.402+0000 7f250dc0e700 1 --2- 172.21.15.103:0/1990773711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2508061a30 0x7f25080b4820 secure :-1 s=THROTTLE_DONE pgs=2274 cs=0 l=1 rx=0x7f2504002f30 tx=0x7f2504007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.409 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.402+0000 7f250cc0c700 1 -- 172.21.15.103:0/1990773711 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2504011670 con 0x7f2508061a30 2020-04-22T14:20:56.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.402+0000 7f250dc0e700 1 --2- 172.21.15.103:0/1990773711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2508061a30 0x7f25080b4820 secure :-1 s=THROTTLE_DONE pgs=2274 cs=0 l=1 rx=0x7f2504002f30 tx=0x7f2504007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.402+0000 7f250cc0c700 1 -- 172.21.15.103:0/1990773711 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25040117d0 con 0x7f2508061a30 2020-04-22T14:20:56.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.402+0000 7f250dc0e700 1 --2- 172.21.15.103:0/1990773711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2508061a30 0x7f25080b4820 secure :-1 s=THROTTLE_DONE pgs=2274 cs=0 l=1 rx=0x7f2504002f30 tx=0x7f2504007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.402+0000 7f250cc0c700 1 -- 172.21.15.103:0/1990773711 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2504011bf0 con 0x7f2508061a30 2020-04-22T14:20:56.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.402+0000 7f250fe72700 1 -- 172.21.15.103:0/1990773711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2508061a30 msgr2=0x7f25080b4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:56.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.402+0000 7f250fe72700 1 --2- 172.21.15.103:0/1990773711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2508061a30 0x7f25080b4820 secure :-1 s=READY pgs=2274 cs=0 l=1 rx=0x7f2504002f30 tx=0x7f2504007a40).stop 2020-04-22T14:20:56.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.403+0000 7f250fe72700 1 -- 172.21.15.103:0/1990773711 shutdown_connections 2020-04-22T14:20:56.410 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.403+0000 7f250fe72700 1 --2- 172.21.15.103:0/1990773711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2508061a30 0x7f25080b4820 unknown :-1 s=CLOSED pgs=2274 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:56.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.403+0000 7f250fe72700 1 --2- 172.21.15.103:0/1990773711 >> v2:172.21.15.86:3300/0 conn(0x7f25080acb10 0x7f25080ae920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:56.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.403+0000 7f250fe72700 1 -- 172.21.15.103:0/1990773711 >> 172.21.15.103:0/1990773711 conn(0x7f250805b7b0 msgr2=0x7f25080b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:56.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.403+0000 7f250fe72700 1 -- 172.21.15.103:0/1990773711 shutdown_connections 2020-04-22T14:20:56.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.403+0000 7f250fe72700 1 -- 172.21.15.103:0/1990773711 wait complete. 2020-04-22T14:20:56.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.404+0000 7f250fe72700 1 Processor -- start 2020-04-22T14:20:56.411 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.404+0000 7f250fe72700 1 -- start start 2020-04-22T14:20:56.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.405+0000 7f250fe72700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2508061a30 0x7f2508065730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:56.414 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.405+0000 7f250fe72700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25080aed80 0x7f2508155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:56.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.405+0000 7f250fe72700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2508066290 con 0x7f25080acb10 2020-04-22T14:20:56.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.405+0000 7f250fe72700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2508066530 con 0x7f2508061a30 2020-04-22T14:20:56.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.405+0000 7f250fe72700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25081559f0 con 0x7f25080aed80 2020-04-22T14:20:56.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.405+0000 7f250dc0e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2508061a30 0x7f2508065730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:56.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.405+0000 7f250d40d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f25080acb10 0x7f25080b1a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51768/0 (socket says 172.21.15.103:51768) 2020-04-22T14:20:56.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.405+0000 7f250dc0e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2508061a30 0x7f2508065730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59576/0 (socket says 172.21.15.103:59576) 2020-04-22T14:20:56.415 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.405+0000 7f250d40d700 1 -- 172.21.15.103:0/3782800490 learned_addr learned my addr 172.21.15.103:0/3782800490 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:56.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.405+0000 7f250e40f700 1 --2- 172.21.15.103:0/3782800490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25080aed80 0x7f2508155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:56.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.405+0000 7f250dc0e700 1 -- 172.21.15.103:0/3782800490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25080aed80 msgr2=0x7f2508155590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:56.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.405+0000 7f250dc0e700 1 --2- 172.21.15.103:0/3782800490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25080aed80 0x7f2508155590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:56.418 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.405+0000 7f250dc0e700 1 -- 172.21.15.103:0/3782800490 >> v1:172.21.15.103:6789/0 conn(0x7f25080acb10 legacy=0x7f25080b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:56.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.405+0000 7f250dc0e700 1 -- 172.21.15.103:0/3782800490 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2508065f80 con 0x7f2508061a30 2020-04-22T14:20:56.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.405+0000 7f24f6ffd700 1 -- 172.21.15.103:0/3782800490 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1451531614 0 0) 0x7f2508066290 con 0x7f25080acb10 2020-04-22T14:20:56.419 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.405+0000 7f250e40f700 1 --2- 172.21.15.103:0/3782800490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25080aed80 0x7f2508155590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-22T14:20:56.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.405+0000 7f250dc0e700 1 --2- 172.21.15.103:0/3782800490 >> v2:172.21.15.103:3300/0 conn(0x7f2508061a30 0x7f2508065730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2504002f30 tx=0x7f2504007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.405+0000 7f250dc0e700 1 --2- 172.21.15.103:0/3782800490 >> v2:172.21.15.103:3300/0 conn(0x7f2508061a30 0x7f2508065730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2504002f30 tx=0x7f2504007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.405+0000 7f250dc0e700 1 --2- 172.21.15.103:0/3782800490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2508061a30 0x7f2508065730 secure :-1 s=READY pgs=2276 cs=0 l=1 rx=0x7f2504002f30 tx=0x7f2504007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:56.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.405+0000 7f250dc0e700 1 --2- 172.21.15.103:0/3782800490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2508061a30 0x7f2508065730 secure :-1 s=THROTTLE_DONE pgs=2276 cs=0 l=1 rx=0x7f2504002f30 tx=0x7f2504007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.405+0000 7f24f6ffd700 1 -- 172.21.15.103:0/3782800490 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2504007360 con 0x7f2508061a30 2020-04-22T14:20:56.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.405+0000 7f250dc0e700 1 --2- 172.21.15.103:0/3782800490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2508061a30 0x7f2508065730 secure :-1 s=THROTTLE_DONE pgs=2276 cs=0 l=1 rx=0x7f2504002f30 tx=0x7f2504007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.405+0000 7f250dc0e700 1 --2- 172.21.15.103:0/3782800490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2508061a30 0x7f2508065730 secure :-1 s=THROTTLE_DONE pgs=2276 cs=0 l=1 rx=0x7f2504002f30 tx=0x7f2504007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.420 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.405+0000 7f24f6ffd700 1 -- 172.21.15.103:0/3782800490 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25040074c0 con 0x7f2508061a30 2020-04-22T14:20:56.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.405+0000 7f24f6ffd700 1 -- 172.21.15.103:0/3782800490 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25040058b0 con 0x7f2508061a30 2020-04-22T14:20:56.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.405+0000 7f250fe72700 1 -- 172.21.15.103:0/3782800490 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25080b2110 con 0x7f2508061a30 2020-04-22T14:20:56.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.405+0000 7f250fe72700 1 -- 172.21.15.103:0/3782800490 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2508063510 con 0x7f2508061a30 2020-04-22T14:20:56.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.406+0000 7f250dc0e700 1 --2- 172.21.15.103:0/3782800490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2508061a30 0x7f2508065730 secure :-1 s=THROTTLE_DONE pgs=2276 cs=0 l=1 rx=0x7f2504002f30 tx=0x7f2504007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.406+0000 7f24f6ffd700 1 -- 172.21.15.103:0/3782800490 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f2504005b30 con 0x7f2508061a30 2020-04-22T14:20:56.421 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.406+0000 7f250dc0e700 1 --2- 172.21.15.103:0/3782800490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2508061a30 0x7f2508065730 secure :-1 s=THROTTLE_DONE pgs=2276 cs=0 l=1 rx=0x7f2504002f30 tx=0x7f2504007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.407+0000 7f250fe72700 1 -- 172.21.15.103:0/3782800490 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2508056c90 con 0x7f2508061a30 2020-04-22T14:20:56.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.407+0000 7f24f6ffd700 1 --2- 172.21.15.103:0/3782800490 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f24e804d850 0x7f24e804fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:56.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.407+0000 7f24f6ffd700 1 -- 172.21.15.103:0/3782800490 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2504061ae0 con 0x7f2508061a30 2020-04-22T14:20:56.423 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.407+0000 7f250d40d700 1 --2- 172.21.15.103:0/3782800490 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f24e804d850 0x7f24e804fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:56.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.407+0000 7f250d40d700 1 --2- 172.21.15.103:0/3782800490 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f24e804d850 0x7f24e804fd10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f24f8007fa0 tx=0x7f24f8009920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.407+0000 7f250d40d700 1 --2- 172.21.15.103:0/3782800490 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f24e804d850 0x7f24e804fd10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f24f8007fa0 tx=0x7f24f8009920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.407+0000 7f250d40d700 1 --2- 172.21.15.103:0/3782800490 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f24e804d850 0x7f24e804fd10 secure :-1 s=READY pgs=823 cs=0 l=1 rx=0x7f24f8007fa0 tx=0x7f24f8009920).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:56.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.411+0000 7f250dc0e700 1 --2- 172.21.15.103:0/3782800490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2508061a30 0x7f2508065730 secure :-1 s=THROTTLE_DONE pgs=2276 cs=0 l=1 rx=0x7f2504002f30 tx=0x7f2504007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.424 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.411+0000 7f24f6ffd700 1 -- 172.21.15.103:0/3782800490 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f250403cf20 con 0x7f2508061a30 2020-04-22T14:20:56.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.552+0000 7f250fe72700 1 -- 172.21.15.103:0/3782800490 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f250806a960 con 0x7f2508061a30 2020-04-22T14:20:56.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.553+0000 7f250dc0e700 1 --2- 172.21.15.103:0/3782800490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2508061a30 0x7f2508065730 secure :-1 s=THROTTLE_DONE pgs=2276 cs=0 l=1 rx=0x7f2504002f30 tx=0x7f2504007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.556 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.553+0000 7f24f6ffd700 1 -- 172.21.15.103:0/3782800490 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v158) v1 ==== 100+0+10 (secure 0 0 0) 0x7f2504040540 con 0x7f2508061a30 2020-04-22T14:20:56.557 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 8 2020-04-22T14:20:56.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.554+0000 7f250fe72700 1 -- 172.21.15.103:0/3782800490 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f24e804d850 msgr2=0x7f24e804fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:56.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.554+0000 7f250fe72700 1 --2- 172.21.15.103:0/3782800490 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f24e804d850 0x7f24e804fd10 secure :-1 s=READY pgs=823 cs=0 l=1 rx=0x7f24f8007fa0 tx=0x7f24f8009920).stop 2020-04-22T14:20:56.558 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.554+0000 7f250fe72700 1 -- 172.21.15.103:0/3782800490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2508061a30 msgr2=0x7f2508065730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:56.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.554+0000 7f250fe72700 1 --2- 172.21.15.103:0/3782800490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2508061a30 0x7f2508065730 secure :-1 s=READY pgs=2276 cs=0 l=1 rx=0x7f2504002f30 tx=0x7f2504007a40).stop 2020-04-22T14:20:56.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.554+0000 7f250fe72700 1 -- 172.21.15.103:0/3782800490 shutdown_connections 2020-04-22T14:20:56.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.554+0000 7f250fe72700 1 --2- 172.21.15.103:0/3782800490 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f24e804d850 0x7f24e804fd10 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:56.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.554+0000 7f250fe72700 1 --2- 172.21.15.103:0/3782800490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25080aed80 0x7f2508155590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:56.559 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.554+0000 7f250fe72700 1 --2- 172.21.15.103:0/3782800490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2508061a30 0x7f2508065730 unknown :-1 s=CLOSED pgs=2276 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:56.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.554+0000 7f250fe72700 1 -- 172.21.15.103:0/3782800490 >> 172.21.15.103:0/3782800490 conn(0x7f250805b7b0 msgr2=0x7f2508140c70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:56.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.554+0000 7f250fe72700 1 -- 172.21.15.103:0/3782800490 shutdown_connections 2020-04-22T14:20:56.560 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.554+0000 7f250fe72700 1 -- 172.21.15.103:0/3782800490 wait complete. 2020-04-22T14:20:56.568 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-04-22T14:20:56.569 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:56.582 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-22T14:20:56.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.725+0000 7f094fc74700 1 Processor -- start 2020-04-22T14:20:56.728 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.725+0000 7f094fc74700 1 -- start start 2020-04-22T14:20:56.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.726+0000 7f094fc74700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f094805b7c0 0x7f09480b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:56.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.726+0000 7f094fc74700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f09480ad850 0x7f09480adca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:20:56.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.726+0000 7f094fc74700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09480b5900 con 0x7f09481441f0 2020-04-22T14:20:56.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.726+0000 7f094fc74700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09480b5ba0 con 0x7f094805b7c0 2020-04-22T14:20:56.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.726+0000 7f094fc74700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09480b5e40 con 0x7f09480ad850 2020-04-22T14:20:56.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.726+0000 7f094e211700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f09480ad850 0x7f09480adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:56.731 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.726+0000 7f094e211700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f09480ad850 0x7f09480adca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59588/0 (socket says 172.21.15.103:59588) 2020-04-22T14:20:56.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.726+0000 7f094e211700 1 -- 172.21.15.103:0/2649653124 learned_addr learned my addr 172.21.15.103:0/2649653124 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:20:56.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.726+0000 7f094da10700 1 --2- 172.21.15.103:0/2649653124 >> v2:172.21.15.86:3300/0 conn(0x7f094805b7c0 0x7f09480b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:56.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.726+0000 7f094e211700 1 -- 172.21.15.103:0/2649653124 >> v2:172.21.15.86:3300/0 conn(0x7f094805b7c0 msgr2=0x7f09480b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:56.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.726+0000 7f094e211700 1 --2- 172.21.15.103:0/2649653124 >> v2:172.21.15.86:3300/0 conn(0x7f094805b7c0 0x7f09480b50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:56.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.726+0000 7f094e211700 1 -- 172.21.15.103:0/2649653124 >> v1:172.21.15.86:6789/0 conn(0x7f09481441f0 legacy=0x7f0948144820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:20:56.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.726+0000 7f094e211700 1 -- 172.21.15.103:0/2649653124 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f094805bba0 con 0x7f09480ad850 2020-04-22T14:20:56.732 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.726+0000 7f094e211700 1 --2- 172.21.15.103:0/2649653124 >> v2:172.21.15.103:3300/0 conn(0x7f09480ad850 0x7f09480adca0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f09480613e0 tx=0x7f0940007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.726+0000 7f094e211700 1 --2- 172.21.15.103:0/2649653124 >> v2:172.21.15.103:3300/0 conn(0x7f09480ad850 0x7f09480adca0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f09480613e0 tx=0x7f0940007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.726+0000 7f094e211700 1 --2- 172.21.15.103:0/2649653124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09480ad850 0x7f09480adca0 secure :-1 s=READY pgs=2277 cs=0 l=1 rx=0x7f09480613e0 tx=0x7f0940007dc0).ready entity=mon.1 client_cookie=c9eb4397419b2e41 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:56.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.726+0000 7f094e211700 1 --2- 172.21.15.103:0/2649653124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09480ad850 0x7f09480adca0 secure :-1 s=THROTTLE_DONE pgs=2277 cs=0 l=1 rx=0x7f09480613e0 tx=0x7f0940007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.726+0000 7f094ca0e700 1 -- 172.21.15.103:0/2649653124 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09400110d0 con 0x7f09480ad850 2020-04-22T14:20:56.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.726+0000 7f094e211700 1 --2- 172.21.15.103:0/2649653124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09480ad850 0x7f09480adca0 secure :-1 s=THROTTLE_DONE pgs=2277 cs=0 l=1 rx=0x7f09480613e0 tx=0x7f0940007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.726+0000 7f094ca0e700 1 -- 172.21.15.103:0/2649653124 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0940011230 con 0x7f09480ad850 2020-04-22T14:20:56.733 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.726+0000 7f094e211700 1 --2- 172.21.15.103:0/2649653124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09480ad850 0x7f09480adca0 secure :-1 s=THROTTLE_DONE pgs=2277 cs=0 l=1 rx=0x7f09480613e0 tx=0x7f0940007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.726+0000 7f094fc74700 1 -- 172.21.15.103:0/2649653124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09480ad850 msgr2=0x7f09480adca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:56.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.726+0000 7f094ca0e700 1 -- 172.21.15.103:0/2649653124 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09400115d0 con 0x7f09480ad850 2020-04-22T14:20:56.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.726+0000 7f094fc74700 1 --2- 172.21.15.103:0/2649653124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09480ad850 0x7f09480adca0 secure :-1 s=READY pgs=2277 cs=0 l=1 rx=0x7f09480613e0 tx=0x7f0940007dc0).stop 2020-04-22T14:20:56.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.727+0000 7f094fc74700 1 -- 172.21.15.103:0/2649653124 shutdown_connections 2020-04-22T14:20:56.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.727+0000 7f094fc74700 1 --2- 172.21.15.103:0/2649653124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09480ad850 0x7f09480adca0 unknown :-1 s=CLOSED pgs=2277 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:56.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.727+0000 7f094fc74700 1 --2- 172.21.15.103:0/2649653124 >> v2:172.21.15.86:3300/0 conn(0x7f094805b7c0 0x7f09480b50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:20:56.734 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.727+0000 7f094fc74700 1 -- 172.21.15.103:0/2649653124 >> 172.21.15.103:0/2649653124 conn(0x7f09480b9160 msgr2=0x7f094805ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:56.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.727+0000 7f094fc74700 1 -- 172.21.15.103:0/2649653124 shutdown_connections 2020-04-22T14:20:56.735 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.727+0000 7f094fc74700 1 -- 172.21.15.103:0/2649653124 wait complete. 2020-04-22T14:20:56.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.728+0000 7f094fc74700 1 Processor -- start 2020-04-22T14:20:56.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.728+0000 7f094fc74700 1 -- start start 2020-04-22T14:20:56.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.729+0000 7f094fc74700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f094805b7c0 0x7f09480b3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:56.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.729+0000 7f094fc74700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0948154fd0 con 0x7f09481441f0 2020-04-22T14:20:56.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.729+0000 7f094fc74700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0948155270 con 0x7f09480ad850 2020-04-22T14:20:56.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.729+0000 7f094fc74700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0948155510 con 0x7f094805b7c0 2020-04-22T14:20:56.739 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.729+0000 7f094d20f700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f09480ad850 0x7f094813a590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51782/0 (socket says 172.21.15.103:51782) 2020-04-22T14:20:56.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.729+0000 7f094d20f700 1 -- 172.21.15.103:0/4099638866 learned_addr learned my addr 172.21.15.103:0/4099638866 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:20:56.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.729+0000 7f094da10700 1 --2- 172.21.15.103:0/4099638866 >> v2:172.21.15.86:3300/0 conn(0x7f094805b7c0 0x7f09480b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:56.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.729+0000 7f0936ffd700 1 -- 172.21.15.103:0/4099638866 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 230904833 0 0) 0x7f0948155270 con 0x7f09480ad850 2020-04-22T14:20:56.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.729+0000 7f0936ffd700 1 -- 172.21.15.103:0/4099638866 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0928002fe0 con 0x7f09480ad850 2020-04-22T14:20:56.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.729+0000 7f0936ffd700 1 -- 172.21.15.103:0/4099638866 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4191075216 0 0) 0x7f0928002fe0 con 0x7f09480ad850 2020-04-22T14:20:56.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.729+0000 7f0936ffd700 1 -- 172.21.15.103:0/4099638866 --> v1:172.21.15.103:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0948155270 con 0x7f09480ad850 2020-04-22T14:20:56.740 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.729+0000 7f0936ffd700 1 -- 172.21.15.103:0/4099638866 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f09380029a0 con 0x7f09480ad850 2020-04-22T14:20:56.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.729+0000 7f0936ffd700 1 -- 172.21.15.103:0/4099638866 >> v2:172.21.15.86:3300/0 conn(0x7f094805b7c0 msgr2=0x7f09480b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:56.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.729+0000 7f0936ffd700 1 --2- 172.21.15.103:0/4099638866 >> v2:172.21.15.86:3300/0 conn(0x7f094805b7c0 0x7f09480b3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:56.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.729+0000 7f0936ffd700 1 -- 172.21.15.103:0/4099638866 >> v1:172.21.15.103:6789/0 conn(0x7f09480ad850 legacy=0x7f094813a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:56.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.729+0000 7f0936ffd700 1 -- 172.21.15.103:0/4099638866 >> v1:172.21.15.86:6789/0 conn(0x7f09481441f0 legacy=0x7f09481445f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:56.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.729+0000 7f0936ffd700 1 --2- 172.21.15.103:0/4099638866 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f09280049b0 0x7f0928004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:56.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.729+0000 7f0936ffd700 1 --2- 172.21.15.103:0/4099638866 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0928003920 0x7f0928003d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:56.741 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.729+0000 7f0936ffd700 1 --2- 172.21.15.103:0/4099638866 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09280041c0 0x7f092800b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:56.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.729+0000 7f0936ffd700 1 -- 172.21.15.103:0/4099638866 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0948155510 con 0x7f0928003920 2020-04-22T14:20:56.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.729+0000 7f0936ffd700 1 -- 172.21.15.103:0/4099638866 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0928004730 con 0x7f09280041c0 2020-04-22T14:20:56.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.729+0000 7f0936ffd700 1 -- 172.21.15.103:0/4099638866 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f092800bbb0 con 0x7f09280049b0 2020-04-22T14:20:56.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.729+0000 7f094e211700 1 --2- 172.21.15.103:0/4099638866 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09280041c0 0x7f092800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:56.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.729+0000 7f094da10700 1 --2- 172.21.15.103:0/4099638866 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f09280049b0 0x7f0928004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:56.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.729+0000 7f094d20f700 1 --2- 172.21.15.103:0/4099638866 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0928003920 0x7f0928003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:56.742 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.730+0000 7f094e211700 1 -- 172.21.15.103:0/4099638866 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f09280049b0 msgr2=0x7f0928004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:56.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.730+0000 7f094e211700 1 --2- 172.21.15.103:0/4099638866 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f09280049b0 0x7f0928004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:56.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.730+0000 7f094e211700 1 -- 172.21.15.103:0/4099638866 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0928003920 msgr2=0x7f0928003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:56.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.730+0000 7f094e211700 1 --2- 172.21.15.103:0/4099638866 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0928003920 0x7f0928003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:56.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.730+0000 7f094e211700 1 -- 172.21.15.103:0/4099638866 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f094813aca0 con 0x7f09280041c0 2020-04-22T14:20:56.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.730+0000 7f094fc74700 1 -- 172.21.15.103:0/4099638866 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f094813aef0 con 0x7f09280041c0 2020-04-22T14:20:56.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.730+0000 7f094e211700 1 --2- 172.21.15.103:0/4099638866 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09280041c0 0x7f092800b750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f09280048f0 tx=0x7f0940007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.730+0000 7f094e211700 1 -- 172.21.15.103:0/4099638866 reap_dead start 2020-04-22T14:20:56.743 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.730+0000 7f094fc74700 1 -- 172.21.15.103:0/4099638866 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0948155b70 con 0x7f09280041c0 2020-04-22T14:20:56.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.730+0000 7f094e211700 1 --2- 172.21.15.103:0/4099638866 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09280041c0 0x7f092800b750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f09280048f0 tx=0x7f0940007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.730+0000 7f094e211700 1 --2- 172.21.15.103:0/4099638866 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09280041c0 0x7f092800b750 secure :-1 s=READY pgs=2279 cs=0 l=1 rx=0x7f09280048f0 tx=0x7f0940007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:56.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.730+0000 7f094e211700 1 --2- 172.21.15.103:0/4099638866 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09280041c0 0x7f092800b750 secure :-1 s=THROTTLE_DONE pgs=2279 cs=0 l=1 rx=0x7f09280048f0 tx=0x7f0940007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.730+0000 7f0936ffd700 1 -- 172.21.15.103:0/4099638866 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0940007ec0 con 0x7f09280041c0 2020-04-22T14:20:56.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.730+0000 7f094e211700 1 --2- 172.21.15.103:0/4099638866 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09280041c0 0x7f092800b750 secure :-1 s=THROTTLE_DONE pgs=2279 cs=0 l=1 rx=0x7f09280048f0 tx=0x7f0940007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.744 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.730+0000 7f094e211700 1 --2- 172.21.15.103:0/4099638866 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09280041c0 0x7f092800b750 secure :-1 s=THROTTLE_DONE pgs=2279 cs=0 l=1 rx=0x7f09280048f0 tx=0x7f0940007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.730+0000 7f0936ffd700 1 -- 172.21.15.103:0/4099638866 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0940005a40 con 0x7f09280041c0 2020-04-22T14:20:56.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.730+0000 7f0936ffd700 1 -- 172.21.15.103:0/4099638866 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0940005da0 con 0x7f09280041c0 2020-04-22T14:20:56.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.731+0000 7f094e211700 1 --2- 172.21.15.103:0/4099638866 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09280041c0 0x7f092800b750 secure :-1 s=THROTTLE_DONE pgs=2279 cs=0 l=1 rx=0x7f09280048f0 tx=0x7f0940007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.731+0000 7f0936ffd700 1 -- 172.21.15.103:0/4099638866 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f094000f2b0 con 0x7f09280041c0 2020-04-22T14:20:56.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.731+0000 7f094fc74700 1 -- 172.21.15.103:0/4099638866 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0948056c90 con 0x7f09280041c0 2020-04-22T14:20:56.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.731+0000 7f094e211700 1 --2- 172.21.15.103:0/4099638866 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09280041c0 0x7f092800b750 secure :-1 s=THROTTLE_DONE pgs=2279 cs=0 l=1 rx=0x7f09280048f0 tx=0x7f0940007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.745 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.731+0000 7f0936ffd700 1 --2- 172.21.15.103:0/4099638866 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0928051840 0x7f0928053d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:20:56.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.731+0000 7f0936ffd700 1 -- 172.21.15.103:0/4099638866 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0940061910 con 0x7f09280041c0 2020-04-22T14:20:56.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.731+0000 7f094da10700 1 --2- 172.21.15.103:0/4099638866 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0928051840 0x7f0928053d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:20:56.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.732+0000 7f094da10700 1 --2- 172.21.15.103:0/4099638866 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0928051840 0x7f0928053d00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0944002f30 tx=0x7f094400c780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.732+0000 7f094da10700 1 --2- 172.21.15.103:0/4099638866 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0928051840 0x7f0928053d00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0944002f30 tx=0x7f094400c780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.732+0000 7f094da10700 1 --2- 172.21.15.103:0/4099638866 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0928051840 0x7f0928053d00 secure :-1 s=READY pgs=824 cs=0 l=1 rx=0x7f0944002f30 tx=0x7f094400c780).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:20:56.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.735+0000 7f094e211700 1 --2- 172.21.15.103:0/4099638866 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09280041c0 0x7f092800b750 secure :-1 s=THROTTLE_DONE pgs=2279 cs=0 l=1 rx=0x7f09280048f0 tx=0x7f0940007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.746 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.735+0000 7f0936ffd700 1 -- 172.21.15.103:0/4099638866 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f094003cd50 con 0x7f09280041c0 2020-04-22T14:20:56.928 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.925+0000 7f094fc74700 1 -- 172.21.15.103:0/4099638866 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0948056c90 con 0x7f09280041c0 2020-04-22T14:20:56.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.925+0000 7f094e211700 1 --2- 172.21.15.103:0/4099638866 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09280041c0 0x7f092800b750 secure :-1 s=THROTTLE_DONE pgs=2279 cs=0 l=1 rx=0x7f09280048f0 tx=0x7f0940007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:20:56.929 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.925+0000 7f0936ffd700 1 -- 172.21.15.103:0/4099638866 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 121 v121) v1 ==== 95+0+2149 (secure 0 0 0) 0x7f0940040370 con 0x7f09280041c0 2020-04-22T14:20:56.929 INFO:teuthology.orchestra.run.smithi103.stdout: 2020-04-22T14:20:56.929 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":121,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6962,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2216876181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2216876181},{"type":"v1","addr":"172.21.15.86:6835","nonce":2216876181}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":117}],"filesystems":[{"mdsmap":{"epoch":121,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-22T14:20:42.936004+0000","modified":"2020-04-22T14:20:44.952601+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10201},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10201":{"gid":10201,"name":"a","rank":0,"incarnation":118,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6833/591150745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":591150745},{"type":"v1","addr":"172.21.15.103:6833","nonce":591150745}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2020-04-22T14:20:56.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.926+0000 7f094fc74700 1 -- 172.21.15.103:0/4099638866 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0928051840 msgr2=0x7f0928053d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:56.930 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.926+0000 7f094fc74700 1 --2- 172.21.15.103:0/4099638866 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0928051840 0x7f0928053d00 secure :-1 s=READY pgs=824 cs=0 l=1 rx=0x7f0944002f30 tx=0x7f094400c780).stop 2020-04-22T14:20:56.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.926+0000 7f094fc74700 1 -- 172.21.15.103:0/4099638866 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09280041c0 msgr2=0x7f092800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:20:56.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.926+0000 7f094fc74700 1 --2- 172.21.15.103:0/4099638866 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09280041c0 0x7f092800b750 secure :-1 s=READY pgs=2279 cs=0 l=1 rx=0x7f09280048f0 tx=0x7f0940007dc0).stop 2020-04-22T14:20:56.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.927+0000 7f094fc74700 1 -- 172.21.15.103:0/4099638866 shutdown_connections 2020-04-22T14:20:56.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.927+0000 7f094fc74700 1 --2- 172.21.15.103:0/4099638866 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f0928051840 0x7f0928053d00 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:56.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.927+0000 7f094fc74700 1 --2- 172.21.15.103:0/4099638866 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09280041c0 0x7f092800b750 unknown :-1 s=CLOSED pgs=2279 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:20:56.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.927+0000 7f094fc74700 1 -- 172.21.15.103:0/4099638866 >> 172.21.15.103:0/4099638866 conn(0x7f09480b9160 msgr2=0x7f0948141cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:20:56.931 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.927+0000 7f094fc74700 1 -- 172.21.15.103:0/4099638866 shutdown_connections 2020-04-22T14:20:56.932 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:20:56.927+0000 7f094fc74700 1 -- 172.21.15.103:0/4099638866 wait complete. 2020-04-22T14:20:56.932 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 121 2020-04-22T14:20:57.141 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 10201}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 27, u'failed': [], u'epoch': 121, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [28], u'info': {u'gid_10201': {u'export_targets': [], u'name': u'a', u'incarnation': 118, u'state_seq': 3, u'state': u'up:active', u'gid': 10201, u'features': 4540138292837744639, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 591150745, u'type': u'v2', u'addr': u'172.21.15.103:6832'}, {u'nonce': 591150745, u'type': u'v1', u'addr': u'172.21.15.103:6833'}]}, u'addr': u'172.21.15.103:6833/591150745'}}, u'fs_name': u'cephfs', u'created': u'2020-04-22T14:20:42.936004+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-22T14:20:44.952601+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-22T14:20:57.141 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-22T14:20:57.142 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:57.169 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-22T14:20:57.327 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:20:57.327 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", 2020-04-22T14:20:57.328 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2020-04-22T14:20:57.328 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 10201, 2020-04-22T14:20:57.328 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2020-04-22T14:20:57.328 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2020-04-22T14:20:57.328 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 14.387798801000001, 2020-04-22T14:20:57.328 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 121, 2020-04-22T14:20:57.329 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 158, 2020-04-22T14:20:57.329 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 158, 2020-04-22T14:20:57.329 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 19.599289933000001 2020-04-22T14:20:57.329 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:20:57.335 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "6802606a-35a0-4e54-95ba-51f48cd433bb", "whoami": 0, "id": 10201, "want_state": "up:active", "state": "up:active", "rank_uptime": 14.387798801000001, "mdsmap_epoch": 121, "osdmap_epoch": 158, "osdmap_epoch_barrier": 158, "uptime": 19.599289933000001 } 2020-04-22T14:20:57.336 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-04-22T14:20:57.336 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2020-04-22T14:20:57.336 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:57.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:57.349 INFO:teuthology.orchestra.run.smithi103:> ip addr 2020-04-22T14:20:57.406 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:20:57.407 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:20:57.407 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:20:57.407 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:57.407 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:20:57.407 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:57.407 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:20:57.407 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:57.408 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:20:57.408 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:57.408 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-04-22T14:20:57.408 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:57.408 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-04-22T14:20:57.408 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:57.408 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-04-22T14:20:57.409 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 41583sec preferred_lft 41583sec 2020-04-22T14:20:57.409 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2020-04-22T14:20:57.409 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:57.409 INFO:teuthology.orchestra.run.smithi103.stdout:44: brx.4@if2: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:20:57.409 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether ce:62:6d:2c:c1:6d brd ff:ff:ff:ff:ff:ff link-netnsid 4 2020-04-22T14:20:57.409 INFO:teuthology.orchestra.run.smithi103.stdout:47: brx.0@if2: mtu 1500 qdisc noqueue state DOWN group default qlen 1000 2020-04-22T14:20:57.409 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether f6:69:77:c1:44:bd brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:20:57.409 INFO:teuthology.orchestra.run.smithi103.stdout:50: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:20:57.410 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 76:0b:ab:99:62:bc brd ff:ff:ff:ff:ff:ff 2020-04-22T14:20:57.410 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global noprefixroute ceph-brx 2020-04-22T14:20:57.410 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:57.410 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::509e:125d:ee8e:dc47/64 scope link noprefixroute 2020-04-22T14:20:57.410 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:57.410 INFO:teuthology.orchestra.run.smithi103.stdout:51: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2020-04-22T14:20:57.410 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 76:0b:ab:99:62:bc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2020-04-22T14:20:57.411 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:57.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:57.460 INFO:teuthology.orchestra.run.smithi103:> ip netns list 2020-04-22T14:20:57.520 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 1) 2020-04-22T14:20:57.520 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:57.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:57.568 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:20:57.627 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 2020-04-22T14:20:57.627 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 1 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2020-04-22T14:20:57.627 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 4 2020-04-22T14:20:57.627 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:57.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:57.676 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:20:57.741 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 2020-04-22T14:20:57.742 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 1 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2020-04-22T14:20:57.742 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 4 2020-04-22T14:20:57.742 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:57.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:57.790 INFO:teuthology.orchestra.run.smithi103:> ip netns list-id 2020-04-22T14:20:57.849 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 2020-04-22T14:20:57.849 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 1 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2020-04-22T14:20:57.849 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 4 2020-04-22T14:20:57.849 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:57.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:57.897 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1' 2020-04-22T14:20:57.971 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:58.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:58.024 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 2' 2020-04-22T14:20:58.101 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:58.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:58.145 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr' 2020-04-22T14:20:58.221 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:20:58.229 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:20:58.229 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:20:58.238 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:58.240 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:20:58.240 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:58.240 INFO:teuthology.orchestra.run.smithi103.stdout:2: veth0@if51: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:20:58.242 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether be:13:8b:14:59:b6 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:20:58.242 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2020-04-22T14:20:58.242 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:58.242 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::bc13:8bff:fe14:59b6/64 scope link 2020-04-22T14:20:58.242 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:58.254 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:58.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:58.302 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr' 2020-04-22T14:20:58.410 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-04-22T14:20:58.411 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-04-22T14:20:58.411 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2020-04-22T14:20:58.411 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:58.411 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2020-04-22T14:20:58.411 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:58.411 INFO:teuthology.orchestra.run.smithi103.stdout:2: veth0@if51: mtu 1500 qdisc noqueue state UP group default qlen 1000 2020-04-22T14:20:58.412 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether be:13:8b:14:59:b6 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2020-04-22T14:20:58.412 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2020-04-22T14:20:58.412 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:58.412 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::bc13:8bff:fe14:59b6/64 scope link 2020-04-22T14:20:58.412 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2020-04-22T14:20:58.413 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.2/16 2020-04-22T14:20:58.413 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:58.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:58.443 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.2' 2020-04-22T14:20:58.520 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:58.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:58.570 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0' 2020-04-22T14:20:58.681 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:58.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:58.695 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up' 2020-04-22T14:20:58.803 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:58.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:58.817 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up' 2020-04-22T14:20:58.929 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:58.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:58.953 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254' 2020-04-22T14:20:59.061 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:59.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:59.091 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'systemctl start NetworkManager' 2020-04-22T14:20:59.170 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:59.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:59.220 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection add type bridge-slave con-name brx.2 ifname brx.2 master ceph-brx' 2020-04-22T14:20:59.327 INFO:teuthology.orchestra.run.smithi103.stdout:Connection 'brx.2' (46f15508-8099-48cc-8df5-207cd904c7cf) successfully added. 2020-04-22T14:20:59.328 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:59.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-22T14:20:59.341 INFO:teuthology.orchestra.run.smithi103:> sudo bash -c 'nmcli connection up brx.2' 2020-04-22T14:20:59.502 INFO:teuthology.orchestra.run.smithi103.stdout:Connection successfully activated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/64) 2020-04-22T14:20:59.553 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2020-04-22T14:20:59.553 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi103.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2020-04-22T14:20:59.554 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:59.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:20:59.567 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:20:59.627 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:59.675 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:20:59.675 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:20:59.744 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:20:59.750 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:20:59.751 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:59.798 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:20:59.798 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:20:59.864 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:20:59.864 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [47] 2020-04-22T14:20:59.864 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:59.909 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:20:59.951 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:20:59.964 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:20:59.964 INFO:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-22T14:21:00.034 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-22T14:21:00.040 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:2020-04-22T14:21:00.036+0000 7f35bd0541c0 -1 init, newargv = 0x55a3450a8170 newargc=9 2020-04-22T14:21:00.040 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[132174]: starting ceph client 2020-04-22T14:21:00.041 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-04-22T14:21:00.041 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:21:00.045 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[132174]: starting fuse 2020-04-22T14:21:00.057 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:21:00.057 INFO:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2020-04-22T14:21:00.116 INFO:teuthology.orchestra.run.smithi103.stdout:47 2020-04-22T14:21:00.116 INFO:teuthology.orchestra.run.smithi103.stdout:49 2020-04-22T14:21:00.116 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47, 49] 2020-04-22T14:21:00.116 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:21:00.168 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:21:00.168 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:21:00.168 INFO:teuthology.orchestra.run.smithi103:> import glob 2020-04-22T14:21:00.168 INFO:teuthology.orchestra.run.smithi103:> import re 2020-04-22T14:21:00.168 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:21:00.169 INFO:teuthology.orchestra.run.smithi103:> import subprocess 2020-04-22T14:21:00.169 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:21:00.169 INFO:teuthology.orchestra.run.smithi103:> def find_socket(client_name): 2020-04-22T14:21:00.169 INFO:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2020-04-22T14:21:00.169 INFO:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2020-04-22T14:21:00.169 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:21:00.169 INFO:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2020-04-22T14:21:00.169 INFO:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2020-04-22T14:21:00.170 INFO:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2020-04-22T14:21:00.170 INFO:teuthology.orchestra.run.smithi103:> return files[0] 2020-04-22T14:21:00.170 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:21:00.170 INFO:teuthology.orchestra.run.smithi103:> for f in files: 2020-04-22T14:21:00.170 INFO:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:21:00.170 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:21:00.170 INFO:teuthology.orchestra.run.smithi103:> return f 2020-04-22T14:21:00.170 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:21:00.170 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:21:00.171 INFO:teuthology.orchestra.run.smithi103:> print(find_socket("client.1")) 2020-04-22T14:21:00.171 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:21:00.277 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.1.132174.asok 2020-04-22T14:21:00.278 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.132174.asok 2020-04-22T14:21:00.278 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:21:00.291 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:21:00.291 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.132174.asok status 2020-04-22T14:21:00.449 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:21:00.449 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2020-04-22T14:21:00.450 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "360f904aafdcc5437adf7f1a18be626f09ffd78d", 2020-04-22T14:21:00.450 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 16.0.0-952-g360f904 (360f904aafdcc5437adf7f1a18be626f09ffd78d) pacific (dev)", 2020-04-22T14:21:00.450 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "1", 2020-04-22T14:21:00.450 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2020-04-22T14:21:00.450 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2020-04-22T14:21:00.450 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "132174", 2020-04-22T14:21:00.451 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2020-04-22T14:21:00.451 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:21:00.451 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2020-04-22T14:21:00.451 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2020-04-22T14:21:00.451 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 10459, 2020-04-22T14:21:00.451 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2020-04-22T14:21:00.452 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:21:00.452 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:21:00.452 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 10459 2020-04-22T14:21:00.452 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:21:00.452 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:21:00.452 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:21:00.453 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.2:0", 2020-04-22T14:21:00.453 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 3477056517 2020-04-22T14:21:00.453 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:21:00.453 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:21:00.453 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:21:00.454 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:21:00.454 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.2:0", 2020-04-22T14:21:00.454 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 3477056517 2020-04-22T14:21:00.454 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:21:00.454 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.10459 192.168.0.2:0/3477056517", 2020-04-22T14:21:00.455 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.2:0/3477056517", 2020-04-22T14:21:00.455 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2020-04-22T14:21:00.455 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 121, 2020-04-22T14:21:00.455 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 158, 2020-04-22T14:21:00.455 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2020-04-22T14:21:00.456 INFO:teuthology.orchestra.run.smithi103.stdout: "blacklisted": false 2020-04-22T14:21:00.456 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:21:00.456 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:21:00.470 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:21:00.470 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-22T14:21:00.470 INFO:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:21:00.528 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2020-04-22T14:21:00.529 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-04-22T14:21:00.529 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:21:00.577 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:21:00.578 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2020-04-22T14:21:00.653 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:21:00.699 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok config get mds_reconnect_timeout 2020-04-22T14:21:00.851 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:21:00.851 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_reconnect_timeout": "45.000000" 2020-04-22T14:21:00.851 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:21:00.861 INFO:tasks.cephfs.filesystem:_json_asok output: { "mds_reconnect_timeout": "45.000000" } 2020-04-22T14:21:00.862 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:21:00.885 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok config get ms_max_backoff 2020-04-22T14:21:01.037 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:21:01.037 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_max_backoff": "15.000000" 2020-04-22T14:21:01.037 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:21:01.045 INFO:tasks.cephfs.filesystem:_json_asok output: { "ms_max_backoff": "15.000000" } 2020-04-22T14:21:01.046 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-04-22T14:21:01.046 INFO:teuthology.orchestra.run:waiting for 300 2020-04-22T14:21:01.046 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-04-22T14:21:01.046 INFO:teuthology.orchestra.run:waiting for 300 2020-04-22T14:21:01.053 INFO:tasks.ceph.mds.a:Stopped 2020-04-22T14:21:01.054 DEBUG:teuthology.parallel:result is None 2020-04-22T14:21:01.056 INFO:tasks.ceph.mds.b:Stopped 2020-04-22T14:21:01.056 DEBUG:teuthology.parallel:result is None 2020-04-22T14:21:01.057 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:21:01.061 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:21:01.108 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mds fail a 2020-04-22T14:21:01.109 INFO:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mds fail b 2020-04-22T14:21:01.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.256+0000 7fde236f8700 1 Processor -- start 2020-04-22T14:21:01.259 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.256+0000 7fde236f8700 1 -- start start 2020-04-22T14:21:01.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.256+0000 7f9a0e50e700 1 Processor -- start 2020-04-22T14:21:01.260 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.256+0000 7f9a0e50e700 1 -- start start 2020-04-22T14:21:01.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.256+0000 7f9a0e50e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a080b4320 0x7f9a080b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:21:01.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.256+0000 7f9a0e50e700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9a080b4700 0x7f9a080b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:21:01.277 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.256+0000 7f9a0e50e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a080b0e90 con 0x7f9a080b2530 2020-04-22T14:21:01.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.256+0000 7f9a0e50e700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a080b2a90 con 0x7f9a080b4700 2020-04-22T14:21:01.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.256+0000 7f9a0e50e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a080b1130 con 0x7f9a080b4320 2020-04-22T14:21:01.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.257+0000 7f9a0caab700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f9a080b2530 0x7f9a080afa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51826/0 (socket says 172.21.15.103:51826) 2020-04-22T14:21:01.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.257+0000 7f9a0caab700 1 -- 172.21.15.103:0/3447462246 learned_addr learned my addr 172.21.15.103:0/3447462246 (peer_addr_for_me v1:172.21.15.103:0/0) 2020-04-22T14:21:01.278 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.257+0000 7f9a07fff700 1 --2- 172.21.15.103:0/3447462246 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a080b4320 0x7f9a080b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:21:01.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.257+0000 7f9a077fe700 1 --2- 172.21.15.103:0/3447462246 >> v2:172.21.15.86:3300/0 conn(0x7f9a080b4700 0x7f9a080b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:21:01.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.257+0000 7f9a06ffd700 1 -- 172.21.15.103:0/3447462246 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 5425119 0 0) 0x7f9a080b0e90 con 0x7f9a080b2530 2020-04-22T14:21:01.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.257+0000 7f9a06ffd700 1 -- 172.21.15.103:0/3447462246 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99f4003230 con 0x7f9a080b2530 2020-04-22T14:21:01.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.257+0000 7f9a06ffd700 1 -- 172.21.15.103:0/3447462246 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 967202586 0 0) 0x7f99f4003230 con 0x7f9a080b2530 2020-04-22T14:21:01.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.257+0000 7f9a06ffd700 1 -- 172.21.15.103:0/3447462246 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a080b4320 msgr2=0x7f9a080b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:21:01.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.257+0000 7f9a06ffd700 1 --2- 172.21.15.103:0/3447462246 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a080b4320 0x7f9a080b15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:21:01.279 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.257+0000 7f9a06ffd700 1 -- 172.21.15.103:0/3447462246 >> v2:172.21.15.86:3300/0 conn(0x7f9a080b4700 msgr2=0x7f9a080b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:21:01.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.257+0000 7f9a06ffd700 1 --2- 172.21.15.103:0/3447462246 >> v2:172.21.15.86:3300/0 conn(0x7f9a080b4700 0x7f9a080b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:21:01.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.257+0000 7f9a06ffd700 1 -- 172.21.15.103:0/3447462246 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a080ae500 con 0x7f9a080b2530 2020-04-22T14:21:01.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.257+0000 7f9a06ffd700 1 -- 172.21.15.103:0/3447462246 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 972189848 0 0) 0x7f9a00001a50 con 0x7f9a080b2530 2020-04-22T14:21:01.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.257+0000 7f9a06ffd700 1 -- 172.21.15.103:0/3447462246 >> v1:172.21.15.103:6789/0 conn(0x7f9a080b2530 legacy=0x7f9a080afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:21:01.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.257+0000 7f9a06ffd700 1 --2- 172.21.15.103:0/3447462246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99f4003720 0x7f99f4003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:21:01.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.257+0000 7f9a06ffd700 1 --2- 172.21.15.103:0/3447462246 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a080b4320 0x7f99f40044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:21:01.280 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.257+0000 7f9a06ffd700 1 --2- 172.21.15.103:0/3447462246 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99f40040a0 0x7f99f40049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:21:01.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.257+0000 7f9a06ffd700 1 -- 172.21.15.103:0/3447462246 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a080b2a90 con 0x7f99f40040a0 2020-04-22T14:21:01.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.257+0000 7f9a06ffd700 1 -- 172.21.15.103:0/3447462246 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a080b1130 con 0x7f99f4003720 2020-04-22T14:21:01.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.257+0000 7f9a07fff700 1 --2- 172.21.15.103:0/3447462246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99f4003720 0x7f99f4003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:21:01.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.257+0000 7f9a06ffd700 1 -- 172.21.15.103:0/3447462246 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f4004fa0 con 0x7f9a080b4320 2020-04-22T14:21:01.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.258+0000 7f9a077fe700 1 --2- 172.21.15.103:0/3447462246 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a080b4320 0x7f99f40044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:21:01.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.258+0000 7f9a0caab700 1 --2- 172.21.15.103:0/3447462246 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99f40040a0 0x7f99f40049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:21:01.281 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.258+0000 7f9a07fff700 1 -- 172.21.15.103:0/3447462246 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a080b4320 msgr2=0x7f99f40044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:21:01.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.258+0000 7f9a07fff700 1 --2- 172.21.15.103:0/3447462246 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a080b4320 0x7f99f40044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:21:01.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.258+0000 7f9a07fff700 1 -- 172.21.15.103:0/3447462246 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99f40040a0 msgr2=0x7f99f40049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:21:01.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.258+0000 7f9a07fff700 1 --2- 172.21.15.103:0/3447462246 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99f40040a0 0x7f99f40049d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:21:01.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.258+0000 7f9a07fff700 1 -- 172.21.15.103:0/3447462246 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a080ae500 con 0x7f99f4003720 2020-04-22T14:21:01.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.258+0000 7f9a077fe700 1 --2- 172.21.15.103:0/3447462246 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a080b4320 0x7f99f40044d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:21:01.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.258+0000 7f9a07fff700 1 --2- 172.21.15.103:0/3447462246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99f4003720 0x7f99f4003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f99f8002f30 tx=0x7f99f8010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:21:01.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.258+0000 7f9a07fff700 1 --2- 172.21.15.103:0/3447462246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99f4003720 0x7f99f4003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f99f8002f30 tx=0x7f99f8010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:21:01.282 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.258+0000 7f9a07fff700 1 --2- 172.21.15.103:0/3447462246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99f4003720 0x7f99f4003b40 secure :-1 s=READY pgs=2286 cs=0 l=1 rx=0x7f99f8002f30 tx=0x7f99f8010020).ready entity=mon.1 client_cookie=33dee39a8ce692aa server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:21:01.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.258+0000 7f9a07fff700 1 --2- 172.21.15.103:0/3447462246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99f4003720 0x7f99f4003b40 secure :-1 s=THROTTLE_DONE pgs=2286 cs=0 l=1 rx=0x7f99f8002f30 tx=0x7f99f8010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:21:01.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.258+0000 7f9a06ffd700 1 -- 172.21.15.103:0/3447462246 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99f8008d30 con 0x7f99f4003720 2020-04-22T14:21:01.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.258+0000 7f9a07fff700 1 --2- 172.21.15.103:0/3447462246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99f4003720 0x7f99f4003b40 secure :-1 s=THROTTLE_DONE pgs=2286 cs=0 l=1 rx=0x7f99f8002f30 tx=0x7f99f8010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:21:01.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.258+0000 7f9a07fff700 1 --2- 172.21.15.103:0/3447462246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99f4003720 0x7f99f4003b40 secure :-1 s=THROTTLE_DONE pgs=2286 cs=0 l=1 rx=0x7f99f8002f30 tx=0x7f99f8010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:21:01.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.258+0000 7f9a06ffd700 1 -- 172.21.15.103:0/3447462246 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f8008e90 con 0x7f99f4003720 2020-04-22T14:21:01.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.258+0000 7f9a06ffd700 1 -- 172.21.15.103:0/3447462246 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99f8010a90 con 0x7f99f4003720 2020-04-22T14:21:01.283 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.258+0000 7f9a0e50e700 1 -- 172.21.15.103:0/3447462246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99f4003720 msgr2=0x7f99f4003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:21:01.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.258+0000 7f9a0e50e700 1 --2- 172.21.15.103:0/3447462246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99f4003720 0x7f99f4003b40 secure :-1 s=READY pgs=2286 cs=0 l=1 rx=0x7f99f8002f30 tx=0x7f99f8010020).stop 2020-04-22T14:21:01.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.258+0000 7f9a0caab700 1 -- 172.21.15.103:0/3447462246 reap_dead start 2020-04-22T14:21:01.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.259+0000 7f9a0e50e700 1 -- 172.21.15.103:0/3447462246 shutdown_connections 2020-04-22T14:21:01.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.259+0000 7f9a0e50e700 1 -- 172.21.15.103:0/3447462246 >> 172.21.15.103:0/3447462246 conn(0x7f9a080b86b0 msgr2=0x7f9a080b8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:21:01.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.259+0000 7f9a0e50e700 1 -- 172.21.15.103:0/3447462246 shutdown_connections 2020-04-22T14:21:01.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.259+0000 7f9a0e50e700 1 -- 172.21.15.103:0/3447462246 wait complete. 2020-04-22T14:21:01.284 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.260+0000 7f9a0e50e700 1 Processor -- start 2020-04-22T14:21:01.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.260+0000 7f9a0e50e700 1 -- start start 2020-04-22T14:21:01.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.261+0000 7f9a0e50e700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a08062dd0 0x7f9a081537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:21:01.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.261+0000 7f9a0e50e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9a0813edc0 0x7f9a0813f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:21:01.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.261+0000 7f9a0e50e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a08065f20 con 0x7f9a08065aa0 2020-04-22T14:21:01.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.261+0000 7f9a0e50e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a0814f5e0 con 0x7f9a0813edc0 2020-04-22T14:21:01.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.261+0000 7f9a0e50e700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a080661b0 con 0x7f9a08062dd0 2020-04-22T14:21:01.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.261+0000 7f9a0caab700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9a0813edc0 0x7f9a0813f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:21:01.285 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.261+0000 7f9a07fff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a08062dd0 0x7f9a081537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:21:01.286 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.261+0000 7f9a0caab700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9a0813edc0 0x7f9a0813f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59660/0 (socket says 172.21.15.103:59660) 2020-04-22T14:21:01.286 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.261+0000 7f9a0caab700 1 -- 172.21.15.103:0/1758010989 learned_addr learned my addr 172.21.15.103:0/1758010989 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:21:01.286 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.261+0000 7f9a07fff700 1 -- 172.21.15.103:0/1758010989 >> v2:172.21.15.103:3300/0 conn(0x7f9a0813edc0 msgr2=0x7f9a0813f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:21:01.286 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.261+0000 7f9a07fff700 1 --2- 172.21.15.103:0/1758010989 >> v2:172.21.15.103:3300/0 conn(0x7f9a0813edc0 0x7f9a0813f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:21:01.286 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.261+0000 7f9a07fff700 1 -- 172.21.15.103:0/1758010989 >> v1:172.21.15.103:6789/0 conn(0x7f9a08065aa0 legacy=0x7f9a08141450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:21:01.286 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.261+0000 7f9a07fff700 1 -- 172.21.15.103:0/1758010989 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0814f7d0 con 0x7f9a08062dd0 2020-04-22T14:21:01.286 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.261+0000 7f9a0caab700 1 --2- 172.21.15.103:0/1758010989 >> v2:172.21.15.103:3300/0 conn(0x7f9a0813edc0 0x7f9a0813f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-22T14:21:01.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.261+0000 7f9a07fff700 1 --2- 172.21.15.103:0/1758010989 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a08062dd0 0x7f9a081537c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f99f8002f30 tx=0x7f99f8010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:21:01.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.261+0000 7f9a07fff700 1 --2- 172.21.15.103:0/1758010989 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a08062dd0 0x7f9a081537c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f99f8002f30 tx=0x7f99f8010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:21:01.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.261+0000 7f9a07fff700 1 --2- 172.21.15.103:0/1758010989 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a08062dd0 0x7f9a081537c0 secure :-1 s=READY pgs=214 cs=0 l=1 rx=0x7f99f8002f30 tx=0x7f99f8010020).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:21:01.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.262+0000 7f9a07fff700 1 --2- 172.21.15.103:0/1758010989 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a08062dd0 0x7f9a081537c0 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7f99f8002f30 tx=0x7f99f8010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:21:01.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.262+0000 7f9a057fa700 1 -- 172.21.15.103:0/1758010989 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99f800f6a0 con 0x7f9a08062dd0 2020-04-22T14:21:01.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.262+0000 7f9a07fff700 1 --2- 172.21.15.103:0/1758010989 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a08062dd0 0x7f9a081537c0 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7f99f8002f30 tx=0x7f99f8010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:21:01.287 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.262+0000 7f9a07fff700 1 --2- 172.21.15.103:0/1758010989 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a08062dd0 0x7f9a081537c0 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7f99f8002f30 tx=0x7f99f8010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:21:01.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.262+0000 7f9a057fa700 1 -- 172.21.15.103:0/1758010989 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f800f800 con 0x7f9a08062dd0 2020-04-22T14:21:01.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.262+0000 7f9a057fa700 1 -- 172.21.15.103:0/1758010989 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99f80058b0 con 0x7f9a08062dd0 2020-04-22T14:21:01.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.262+0000 7f9a0e50e700 1 -- 172.21.15.103:0/1758010989 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a0813f670 con 0x7f9a08062dd0 2020-04-22T14:21:01.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.262+0000 7f9a0e50e700 1 -- 172.21.15.103:0/1758010989 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a08141b60 con 0x7f9a08062dd0 2020-04-22T14:21:01.288 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.263+0000 7f9a07fff700 1 --2- 172.21.15.103:0/1758010989 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a08062dd0 0x7f9a081537c0 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7f99f8002f30 tx=0x7f99f8010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:21:01.289 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.263+0000 7f9a057fa700 1 -- 172.21.15.103:0/1758010989 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7f99f8005a10 con 0x7f9a08062dd0 2020-04-22T14:21:01.289 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.263+0000 7f9a07fff700 1 --2- 172.21.15.103:0/1758010989 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a08062dd0 0x7f9a081537c0 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7f99f8002f30 tx=0x7f99f8010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:21:01.289 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.263+0000 7f9a057fa700 1 --2- 172.21.15.103:0/1758010989 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f99e804d9e0 0x7f99e804fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:21:01.289 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.263+0000 7f9a057fa700 1 -- 172.21.15.103:0/1758010989 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f99f8061330 con 0x7f9a08062dd0 2020-04-22T14:21:01.289 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.264+0000 7f9a077fe700 1 --2- 172.21.15.103:0/1758010989 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f99e804d9e0 0x7f99e804fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:21:01.289 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.264+0000 7f9a077fe700 1 --2- 172.21.15.103:0/1758010989 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f99e804d9e0 0x7f99e804fea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9a08063990 tx=0x7f99fc00cb90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:21:01.289 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.264+0000 7f9a077fe700 1 --2- 172.21.15.103:0/1758010989 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f99e804d9e0 0x7f99e804fea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9a08063990 tx=0x7f99fc00cb90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:21:01.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.264+0000 7f9a077fe700 1 --2- 172.21.15.103:0/1758010989 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f99e804d9e0 0x7f99e804fea0 secure :-1 s=READY pgs=826 cs=0 l=1 rx=0x7f9a08063990 tx=0x7f99fc00cb90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:21:01.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.267+0000 7f9a0e50e700 1 -- 172.21.15.103:0/1758010989 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a0814f960 con 0x7f9a08062dd0 2020-04-22T14:21:01.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.270+0000 7f9a07fff700 1 --2- 172.21.15.103:0/1758010989 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a08062dd0 0x7f9a081537c0 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7f99f8002f30 tx=0x7f99f8010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:21:01.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.270+0000 7f9a057fa700 1 -- 172.21.15.103:0/1758010989 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7f99f803c7d0 con 0x7f9a08062dd0 2020-04-22T14:21:01.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.257+0000 7fde236f8700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fde1c0b6580 0x7fde1c143320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:21:01.290 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.257+0000 7fde236f8700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fde1c061020 0x7fde1c062770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:21:01.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.257+0000 7fde236f8700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde1c143ac0 0x7fde1c143f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-22T14:21:01.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.257+0000 7fde236f8700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde1c062fa0 con 0x7fde1c061020 2020-04-22T14:21:01.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.257+0000 7fde236f8700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde1c063240 con 0x7fde1c0b6580 2020-04-22T14:21:01.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.257+0000 7fde236f8700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde1c0634e0 con 0x7fde1c143ac0 2020-04-22T14:21:01.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.257+0000 7fde21494700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fde1c0b6580 0x7fde1c143320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:21:01.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.257+0000 7fde21494700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fde1c0b6580 0x7fde1c143320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59638/0 (socket says 172.21.15.103:59638) 2020-04-22T14:21:01.291 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.257+0000 7fde21494700 1 -- 172.21.15.103:0/752500130 learned_addr learned my addr 172.21.15.103:0/752500130 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:21:01.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.257+0000 7fde20c93700 1 --2- 172.21.15.103:0/752500130 >> v2:172.21.15.86:3300/0 conn(0x7fde1c061020 0x7fde1c062770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:21:01.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.257+0000 7fde21c95700 1 --2- 172.21.15.103:0/752500130 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde1c143ac0 0x7fde1c143f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:21:01.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.257+0000 7fde21494700 1 -- 172.21.15.103:0/752500130 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde1c143ac0 msgr2=0x7fde1c143f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:21:01.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.257+0000 7fde21494700 1 --2- 172.21.15.103:0/752500130 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde1c143ac0 0x7fde1c143f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:21:01.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.257+0000 7fde21494700 1 -- 172.21.15.103:0/752500130 >> v2:172.21.15.86:3300/0 conn(0x7fde1c061020 msgr2=0x7fde1c062770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-22T14:21:01.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.257+0000 7fde21494700 1 --2- 172.21.15.103:0/752500130 >> v2:172.21.15.86:3300/0 conn(0x7fde1c061020 0x7fde1c062770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:21:01.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.257+0000 7fde21494700 1 -- 172.21.15.103:0/752500130 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde1c0b6960 con 0x7fde1c0b6580 2020-04-22T14:21:01.292 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.257+0000 7fde21494700 1 --2- 172.21.15.103:0/752500130 >> v2:172.21.15.103:3300/0 conn(0x7fde1c0b6580 0x7fde1c143320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fde18002f30 tx=0x7fde18007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:21:01.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.257+0000 7fde21494700 1 --2- 172.21.15.103:0/752500130 >> v2:172.21.15.103:3300/0 conn(0x7fde1c0b6580 0x7fde1c143320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fde18002f30 tx=0x7fde18007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:21:01.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.257+0000 7fde21494700 1 --2- 172.21.15.103:0/752500130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde1c0b6580 0x7fde1c143320 secure :-1 s=READY pgs=2285 cs=0 l=1 rx=0x7fde18002f30 tx=0x7fde18007a40).ready entity=mon.1 client_cookie=3131f9284af274f8 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:21:01.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.258+0000 7fde21494700 1 --2- 172.21.15.103:0/752500130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde1c0b6580 0x7fde1c143320 secure :-1 s=THROTTLE_DONE pgs=2285 cs=0 l=1 rx=0x7fde18002f30 tx=0x7fde18007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:21:01.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.258+0000 7fde21494700 1 --2- 172.21.15.103:0/752500130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde1c0b6580 0x7fde1c143320 secure :-1 s=THROTTLE_DONE pgs=2285 cs=0 l=1 rx=0x7fde18002f30 tx=0x7fde18007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:21:01.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.258+0000 7fde21494700 1 --2- 172.21.15.103:0/752500130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde1c0b6580 0x7fde1c143320 secure :-1 s=THROTTLE_DONE pgs=2285 cs=0 l=1 rx=0x7fde18002f30 tx=0x7fde18007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:21:01.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.258+0000 7fde0bfff700 1 -- 172.21.15.103:0/752500130 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde180115c0 con 0x7fde1c0b6580 2020-04-22T14:21:01.293 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.258+0000 7fde0bfff700 1 -- 172.21.15.103:0/752500130 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde18011720 con 0x7fde1c0b6580 2020-04-22T14:21:01.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.258+0000 7fde0bfff700 1 -- 172.21.15.103:0/752500130 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde18011b40 con 0x7fde1c0b6580 2020-04-22T14:21:01.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.258+0000 7fde236f8700 1 -- 172.21.15.103:0/752500130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde1c0b6580 msgr2=0x7fde1c143320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:21:01.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.258+0000 7fde236f8700 1 --2- 172.21.15.103:0/752500130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde1c0b6580 0x7fde1c143320 secure :-1 s=READY pgs=2285 cs=0 l=1 rx=0x7fde18002f30 tx=0x7fde18007a40).stop 2020-04-22T14:21:01.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.258+0000 7fde236f8700 1 -- 172.21.15.103:0/752500130 shutdown_connections 2020-04-22T14:21:01.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.258+0000 7fde236f8700 1 --2- 172.21.15.103:0/752500130 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde1c143ac0 0x7fde1c143f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:21:01.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.258+0000 7fde236f8700 1 --2- 172.21.15.103:0/752500130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde1c0b6580 0x7fde1c143320 unknown :-1 s=CLOSED pgs=2285 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:21:01.294 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.258+0000 7fde236f8700 1 --2- 172.21.15.103:0/752500130 >> v2:172.21.15.86:3300/0 conn(0x7fde1c061020 0x7fde1c062770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-22T14:21:01.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.258+0000 7fde236f8700 1 -- 172.21.15.103:0/752500130 >> 172.21.15.103:0/752500130 conn(0x7fde1c05fd90 msgr2=0x7fde1c060580 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:21:01.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.259+0000 7fde236f8700 1 -- 172.21.15.103:0/752500130 shutdown_connections 2020-04-22T14:21:01.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.259+0000 7fde236f8700 1 -- 172.21.15.103:0/752500130 wait complete. 2020-04-22T14:21:01.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.260+0000 7fde236f8700 1 Processor -- start 2020-04-22T14:21:01.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.260+0000 7fde236f8700 1 -- start start 2020-04-22T14:21:01.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.260+0000 7fde236f8700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde1c061020 0x7fde1c0ae240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:21:01.295 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.260+0000 7fde236f8700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fde1c143ac0 0x7fde1c064a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:21:01.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.260+0000 7fde236f8700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde1c0ada20 con 0x7fde1c0b6580 2020-04-22T14:21:01.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.260+0000 7fde236f8700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde1c0adcc0 con 0x7fde1c143ac0 2020-04-22T14:21:01.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.260+0000 7fde236f8700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde1c065c40 con 0x7fde1c061020 2020-04-22T14:21:01.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.260+0000 7fde21c95700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fde1c143ac0 0x7fde1c064a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:21:01.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.260+0000 7fde21c95700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fde1c143ac0 0x7fde1c064a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59654/0 (socket says 172.21.15.103:59654) 2020-04-22T14:21:01.296 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.260+0000 7fde21c95700 1 -- 172.21.15.103:0/4013208527 learned_addr learned my addr 172.21.15.103:0/4013208527 (peer_addr_for_me v2:172.21.15.103:0/0) 2020-04-22T14:21:01.297 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.260+0000 7fde21494700 1 --2- 172.21.15.103:0/4013208527 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde1c061020 0x7fde1c0ae240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:21:01.297 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.261+0000 7fde21c95700 1 -- 172.21.15.103:0/4013208527 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde1c061020 msgr2=0x7fde1c0ae240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:21:01.297 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.261+0000 7fde21c95700 1 --2- 172.21.15.103:0/4013208527 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde1c061020 0x7fde1c0ae240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:21:01.297 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.261+0000 7fde21c95700 1 -- 172.21.15.103:0/4013208527 >> v1:172.21.15.86:6789/0 conn(0x7fde1c0b6580 legacy=0x7fde1c0aceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:21:01.297 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.261+0000 7fde21c95700 1 -- 172.21.15.103:0/4013208527 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde1c0ad5c0 con 0x7fde1c143ac0 2020-04-22T14:21:01.297 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.261+0000 7fde21c95700 1 --2- 172.21.15.103:0/4013208527 >> v2:172.21.15.103:3300/0 conn(0x7fde1c143ac0 0x7fde1c064a90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fde140032b0 tx=0x7fde14010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:21:01.297 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.261+0000 7fde21c95700 1 --2- 172.21.15.103:0/4013208527 >> v2:172.21.15.103:3300/0 conn(0x7fde1c143ac0 0x7fde1c064a90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fde140032b0 tx=0x7fde14010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:21:01.298 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.261+0000 7fde21c95700 1 --2- 172.21.15.103:0/4013208527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde1c143ac0 0x7fde1c064a90 secure :-1 s=READY pgs=2287 cs=0 l=1 rx=0x7fde140032b0 tx=0x7fde14010ee0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:21:01.298 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.261+0000 7fde21c95700 1 --2- 172.21.15.103:0/4013208527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde1c143ac0 0x7fde1c064a90 secure :-1 s=THROTTLE_DONE pgs=2287 cs=0 l=1 rx=0x7fde140032b0 tx=0x7fde14010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:21:01.298 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.261+0000 7fde21c95700 1 --2- 172.21.15.103:0/4013208527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde1c143ac0 0x7fde1c064a90 secure :-1 s=THROTTLE_DONE pgs=2287 cs=0 l=1 rx=0x7fde140032b0 tx=0x7fde14010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:21:01.298 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.261+0000 7fde21c95700 1 --2- 172.21.15.103:0/4013208527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde1c143ac0 0x7fde1c064a90 secure :-1 s=THROTTLE_DONE pgs=2287 cs=0 l=1 rx=0x7fde140032b0 tx=0x7fde14010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:21:01.298 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.261+0000 7fde0a7fc700 1 -- 172.21.15.103:0/4013208527 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde14005e30 con 0x7fde1c143ac0 2020-04-22T14:21:01.298 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.261+0000 7fde0a7fc700 1 -- 172.21.15.103:0/4013208527 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde14007560 con 0x7fde1c143ac0 2020-04-22T14:21:01.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.261+0000 7fde236f8700 1 -- 172.21.15.103:0/4013208527 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde1c0ad7b0 con 0x7fde1c143ac0 2020-04-22T14:21:01.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.261+0000 7fde0a7fc700 1 -- 172.21.15.103:0/4013208527 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde14012580 con 0x7fde1c143ac0 2020-04-22T14:21:01.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.261+0000 7fde236f8700 1 -- 172.21.15.103:0/4013208527 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde1c065710 con 0x7fde1c143ac0 2020-04-22T14:21:01.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.262+0000 7fde21c95700 1 --2- 172.21.15.103:0/4013208527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde1c143ac0 0x7fde1c064a90 secure :-1 s=THROTTLE_DONE pgs=2287 cs=0 l=1 rx=0x7fde140032b0 tx=0x7fde14010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:21:01.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.262+0000 7fde0a7fc700 1 -- 172.21.15.103:0/4013208527 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) v1 ==== 59679+0+0 (secure 0 0 0) 0x7fde1400e1a0 con 0x7fde1c143ac0 2020-04-22T14:21:01.299 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.262+0000 7fde21c95700 1 --2- 172.21.15.103:0/4013208527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde1c143ac0 0x7fde1c064a90 secure :-1 s=THROTTLE_DONE pgs=2287 cs=0 l=1 rx=0x7fde140032b0 tx=0x7fde14010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:21:01.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.262+0000 7fde236f8700 1 -- 172.21.15.103:0/4013208527 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde1c056c90 con 0x7fde1c143ac0 2020-04-22T14:21:01.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.262+0000 7fde0a7fc700 1 --2- 172.21.15.103:0/4013208527 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fddfc04da30 0x7fddfc04fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-22T14:21:01.300 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.263+0000 7fde0a7fc700 1 -- 172.21.15.103:0/4013208527 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fde14061320 con 0x7fde1c143ac0 2020-04-22T14:21:01.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.263+0000 7fde21494700 1 --2- 172.21.15.103:0/4013208527 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fddfc04da30 0x7fddfc04fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-22T14:21:01.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.263+0000 7fde21494700 1 --2- 172.21.15.103:0/4013208527 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fddfc04da30 0x7fddfc04fef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fde18002f30 tx=0x7fde18007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:21:01.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.263+0000 7fde21494700 1 --2- 172.21.15.103:0/4013208527 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fddfc04da30 0x7fddfc04fef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fde18002f30 tx=0x7fde18007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:21:01.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.263+0000 7fde21494700 1 --2- 172.21.15.103:0/4013208527 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fddfc04da30 0x7fddfc04fef0 secure :-1 s=READY pgs=825 cs=0 l=1 rx=0x7fde18002f30 tx=0x7fde18007a40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-22T14:21:01.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.267+0000 7fde21c95700 1 --2- 172.21.15.103:0/4013208527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde1c143ac0 0x7fde1c064a90 secure :-1 s=THROTTLE_DONE pgs=2287 cs=0 l=1 rx=0x7fde140032b0 tx=0x7fde14010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:21:01.301 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.267+0000 7fde0a7fc700 1 -- 172.21.15.103:0/4013208527 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128047 (secure 0 0 0) 0x7fde1403c6a0 con 0x7fde1c143ac0 2020-04-22T14:21:01.470 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.467+0000 7fde236f8700 1 -- 172.21.15.103:0/4013208527 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7fde1c061420 con 0x7fde1c143ac0 2020-04-22T14:21:01.472 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.469+0000 7f9a0e50e700 1 -- 172.21.15.103:0/1758010989 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7f9a08056c90 con 0x7f9a08062dd0 2020-04-22T14:21:01.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.480+0000 7fde21c95700 1 --2- 172.21.15.103:0/4013208527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde1c143ac0 0x7fde1c064a90 secure :-1 s=THROTTLE_DONE pgs=2287 cs=0 l=1 rx=0x7fde140032b0 tx=0x7fde14010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:21:01.483 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.480+0000 7fde0a7fc700 1 -- 172.21.15.103:0/4013208527 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 10201 v122) v1 ==== 96+0+0 (secure 0 0 0) 0x7fde1403fcc0 con 0x7fde1c143ac0 2020-04-22T14:21:01.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.482+0000 7fde236f8700 1 -- 172.21.15.103:0/4013208527 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fddfc04da30 msgr2=0x7fddfc04fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:21:01.485 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.482+0000 7fde236f8700 1 --2- 172.21.15.103:0/4013208527 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fddfc04da30 0x7fddfc04fef0 secure :-1 s=READY pgs=825 cs=0 l=1 rx=0x7fde18002f30 tx=0x7fde18007a40).stop 2020-04-22T14:21:01.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.482+0000 7fde236f8700 1 -- 172.21.15.103:0/4013208527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde1c143ac0 msgr2=0x7fde1c064a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:21:01.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.482+0000 7fde236f8700 1 --2- 172.21.15.103:0/4013208527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde1c143ac0 0x7fde1c064a90 secure :-1 s=READY pgs=2287 cs=0 l=1 rx=0x7fde140032b0 tx=0x7fde14010ee0).stop 2020-04-22T14:21:01.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.482+0000 7fde236f8700 1 -- 172.21.15.103:0/4013208527 shutdown_connections 2020-04-22T14:21:01.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.482+0000 7fde236f8700 1 --2- 172.21.15.103:0/4013208527 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7fddfc04da30 0x7fddfc04fef0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:21:01.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.482+0000 7fde236f8700 1 --2- 172.21.15.103:0/4013208527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde1c143ac0 0x7fde1c064a90 unknown :-1 s=CLOSED pgs=2287 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:21:01.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.482+0000 7fde236f8700 1 --2- 172.21.15.103:0/4013208527 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde1c061020 0x7fde1c0ae240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:21:01.486 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.482+0000 7fde236f8700 1 -- 172.21.15.103:0/4013208527 >> 172.21.15.103:0/4013208527 conn(0x7fde1c05fd90 msgr2=0x7fde1c1403d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:21:01.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.482+0000 7fde236f8700 1 -- 172.21.15.103:0/4013208527 shutdown_connections 2020-04-22T14:21:01.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:01.482+0000 7fde236f8700 1 -- 172.21.15.103:0/4013208527 wait complete. 2020-04-22T14:21:01.487 INFO:teuthology.orchestra.run.smithi103.stderr:failed mds gid 10201 2020-04-22T14:21:01.496 DEBUG:teuthology.parallel:result is '' 2020-04-22T14:21:02.265 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:02.262+0000 7f9a07fff700 1 --2- 172.21.15.103:0/1758010989 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a08062dd0 0x7f9a081537c0 secure :-1 s=READY pgs=214 cs=0 l=1 rx=0x7f99f8002f30 tx=0x7f99f8010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:21:02.481 INFO:tasks.ceph.mon.b.smithi086.stderr:2020-04-22T14:21:02.478+0000 7fbdbf880700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-04-22T14:21:02.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:02.484+0000 7f9a07fff700 1 --2- 172.21.15.103:0/1758010989 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a08062dd0 0x7f9a081537c0 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7f99f8002f30 tx=0x7f99f8010020).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-22T14:21:02.487 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:02.484+0000 7f9a057fa700 1 -- 172.21.15.103:0/1758010989 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 6962 v123) v1 ==== 95+0+0 (secure 0 0 0) 0x7f99f803fdf0 con 0x7f9a08062dd0 2020-04-22T14:21:02.489 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:02.486+0000 7f9a0e50e700 1 -- 172.21.15.103:0/1758010989 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f99e804d9e0 msgr2=0x7f99e804fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:21:02.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:02.486+0000 7f9a0e50e700 1 --2- 172.21.15.103:0/1758010989 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f99e804d9e0 0x7f99e804fea0 secure :-1 s=READY pgs=826 cs=0 l=1 rx=0x7f9a08063990 tx=0x7f99fc00cb90).stop 2020-04-22T14:21:02.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:02.486+0000 7f9a0e50e700 1 -- 172.21.15.103:0/1758010989 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a08062dd0 msgr2=0x7f9a081537c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-22T14:21:02.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:02.486+0000 7f9a0e50e700 1 --2- 172.21.15.103:0/1758010989 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a08062dd0 0x7f9a081537c0 secure :-1 s=READY pgs=214 cs=0 l=1 rx=0x7f99f8002f30 tx=0x7f99f8010020).stop 2020-04-22T14:21:02.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:02.486+0000 7f9a0e50e700 1 -- 172.21.15.103:0/1758010989 shutdown_connections 2020-04-22T14:21:02.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:02.486+0000 7f9a0e50e700 1 --2- 172.21.15.103:0/1758010989 >> [v2:172.21.15.86:6800/32242,v1:172.21.15.86:6801/32242] conn(0x7f99e804d9e0 0x7f99e804fea0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:21:02.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:02.486+0000 7f9a0e50e700 1 --2- 172.21.15.103:0/1758010989 >> v2:172.21.15.103:3300/0 conn(0x7f9a0813edc0 0x7f9a0813f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:21:02.490 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:02.486+0000 7f9a0e50e700 1 --2- 172.21.15.103:0/1758010989 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a08062dd0 0x7f9a081537c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rx=0 tx=0).stop 2020-04-22T14:21:02.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:02.486+0000 7f9a0e50e700 1 -- 172.21.15.103:0/1758010989 >> 172.21.15.103:0/1758010989 conn(0x7f9a080b86b0 msgr2=0x7f9a080b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-22T14:21:02.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:02.486+0000 7f9a0e50e700 1 -- 172.21.15.103:0/1758010989 shutdown_connections 2020-04-22T14:21:02.491 INFO:teuthology.orchestra.run.smithi103.stderr:2020-04-22T14:21:02.486+0000 7f9a0e50e700 1 -- 172.21.15.103:0/1758010989 wait complete. 2020-04-22T14:21:02.491 INFO:teuthology.orchestra.run.smithi103.stderr:failed mds gid 6962 2020-04-22T14:21:02.502 DEBUG:teuthology.parallel:result is '' 2020-04-22T14:21:02.502 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:21:02.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:21:02.517 INFO:teuthology.orchestra.run.smithi103:> sudo python3 -c ' 2020-04-22T14:21:02.517 INFO:teuthology.orchestra.run.smithi103:> import glob 2020-04-22T14:21:02.518 INFO:teuthology.orchestra.run.smithi103:> import re 2020-04-22T14:21:02.518 INFO:teuthology.orchestra.run.smithi103:> import os 2020-04-22T14:21:02.518 INFO:teuthology.orchestra.run.smithi103:> import subprocess 2020-04-22T14:21:02.518 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:21:02.518 INFO:teuthology.orchestra.run.smithi103:> def find_socket(client_name): 2020-04-22T14:21:02.518 INFO:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-04-22T14:21:02.518 INFO:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2020-04-22T14:21:02.518 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:21:02.519 INFO:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2020-04-22T14:21:02.519 INFO:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2020-04-22T14:21:02.519 INFO:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2020-04-22T14:21:02.519 INFO:teuthology.orchestra.run.smithi103:> return files[0] 2020-04-22T14:21:02.519 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:21:02.519 INFO:teuthology.orchestra.run.smithi103:> for f in files: 2020-04-22T14:21:02.519 INFO:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-22T14:21:02.519 INFO:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-22T14:21:02.520 INFO:teuthology.orchestra.run.smithi103:> return f 2020-04-22T14:21:02.520 INFO:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-22T14:21:02.520 INFO:teuthology.orchestra.run.smithi103:> 2020-04-22T14:21:02.520 INFO:teuthology.orchestra.run.smithi103:> print(find_socket("client.0")) 2020-04-22T14:21:02.520 INFO:teuthology.orchestra.run.smithi103:> ' 2020-04-22T14:21:02.624 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.0.130855.asok 2020-04-22T14:21:02.625 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.130855.asok 2020-04-22T14:21:02.625 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:21:02.639 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:21:02.640 INFO:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.130855.asok mds_sessions 2020-04-22T14:21:02.797 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2020-04-22T14:21:02.797 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 10396, 2020-04-22T14:21:02.798 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2020-04-22T14:21:02.798 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2020-04-22T14:21:02.798 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2020-04-22T14:21:02.798 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 10396 2020-04-22T14:21:02.798 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:21:02.798 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2020-04-22T14:21:02.799 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:21:02.799 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2020-04-22T14:21:02.799 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 139457670 2020-04-22T14:21:02.799 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:21:02.799 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:21:02.799 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.10396 v1:192.168.0.1:0/139457670", 2020-04-22T14:21:02.799 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "v1:192.168.0.1:0/139457670", 2020-04-22T14:21:02.800 INFO:teuthology.orchestra.run.smithi103.stdout: "sessions": [ 2020-04-22T14:21:02.800 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:21:02.800 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": 0, 2020-04-22T14:21:02.800 INFO:teuthology.orchestra.run.smithi103.stdout: "addrs": { 2020-04-22T14:21:02.800 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2020-04-22T14:21:02.800 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:21:02.800 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2020-04-22T14:21:02.801 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6834", 2020-04-22T14:21:02.801 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 2216876181 2020-04-22T14:21:02.801 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:21:02.801 INFO:teuthology.orchestra.run.smithi103.stdout: { 2020-04-22T14:21:02.801 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2020-04-22T14:21:02.801 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.86:6835", 2020-04-22T14:21:02.801 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 2216876181 2020-04-22T14:21:02.802 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:21:02.802 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2020-04-22T14:21:02.802 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2020-04-22T14:21:02.802 INFO:teuthology.orchestra.run.smithi103.stdout: "seq": 0, 2020-04-22T14:21:02.802 INFO:teuthology.orchestra.run.smithi103.stdout: "cap_gen": 0, 2020-04-22T14:21:02.802 INFO:teuthology.orchestra.run.smithi103.stdout: "cap_ttl": "2020-04-22T14:21:55.243872+0000", 2020-04-22T14:21:02.802 INFO:teuthology.orchestra.run.smithi103.stdout: "last_cap_renew_request": "2020-04-22T14:20:55.243872+0000", 2020-04-22T14:21:02.802 INFO:teuthology.orchestra.run.smithi103.stdout: "cap_renew_seq": 2, 2020-04-22T14:21:02.803 INFO:teuthology.orchestra.run.smithi103.stdout: "num_caps": 1, 2020-04-22T14:21:02.803 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "open" 2020-04-22T14:21:02.803 INFO:teuthology.orchestra.run.smithi103.stdout: } 2020-04-22T14:21:02.803 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2020-04-22T14:21:02.803 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 123 2020-04-22T14:21:02.803 INFO:teuthology.orchestra.run.smithi103.stdout:} 2020-04-22T14:21:02.804 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2020-04-22T14:21:02.804 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:21:02.818 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-04-22T14:21:02.818 INFO:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-04-22T14:21:02.885 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-04-22T14:21:02.894 INFO:teuthology.orchestra.run.smithi103.stderr:fusermount: failed to unmount /home/ubuntu/cephtest/mnt.0: Device or resource busy 2020-04-22T14:21:02.894 INFO:tasks.cephfs.fuse_mount:Failed to unmount ceph-fuse on ubuntu@smithi103.front.sepia.ceph.com, aborting... 2020-04-22T14:21:02.894 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:21:02.938 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-22T14:21:02.938 INFO:teuthology.orchestra.run.smithi103:> sudo PATH=/usr/sbin:$PATH lsof ; ps auxf 2020-04-22T14:21:25.981 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:21:25.998 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:21:26.041 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:21:26.059 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:21:56.174 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:21:56.191 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:21:56.233 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:21:56.251 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:22:26.347 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:22:26.365 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:22:26.407 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:22:26.425 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:22:56.512 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:22:56.528 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:22:56.570 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:22:56.587 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:23:26.684 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:23:26.701 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:23:26.743 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:23:26.760 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:23:56.865 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:23:56.883 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:23:56.925 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:23:56.944 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:24:27.080 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:24:27.096 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:24:27.138 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:24:27.155 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:24:57.305 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:24:57.322 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:24:57.364 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:24:57.381 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:25:27.523 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:25:27.539 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:25:27.582 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:25:27.599 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:25:57.698 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:25:57.715 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:25:57.757 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:25:57.774 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:26:27.870 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:26:27.887 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:26:27.930 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:26:27.947 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:26:58.077 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:26:58.094 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:26:58.138 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:26:58.155 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:27:28.305 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:27:28.322 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:27:28.365 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:27:28.381 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:27:58.471 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:27:58.487 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:27:58.530 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:27:58.546 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:28:28.694 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:28:28.713 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:28:28.755 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:28:28.775 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:28:58.874 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:28:58.891 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:28:58.934 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:28:58.951 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:29:29.047 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:29:29.065 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:29:29.106 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:29:29.124 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:29:59.228 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:29:59.244 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:29:59.286 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:29:59.303 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:30:29.400 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:30:29.417 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:30:29.459 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:30:29.476 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:30:59.622 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:30:59.639 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:30:59.682 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:30:59.698 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:31:29.819 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:31:29.840 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:31:29.884 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:31:29.903 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:32:00.017 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:32:00.699 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:32:00.742 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:32:00.759 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:32:30.873 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:32:30.890 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:32:30.933 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:32:30.965 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:33:01.129 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:33:01.145 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:33:01.188 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:33:01.204 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:33:31.317 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:33:31.334 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:33:31.376 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:33:31.393 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:34:01.499 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:34:01.516 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:34:01.558 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:34:01.574 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:34:31.789 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:34:31.805 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:34:31.858 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:34:31.875 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:35:02.011 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:35:02.028 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:35:02.070 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:35:02.086 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:35:32.191 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:35:32.207 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:35:32.250 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:35:32.266 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:36:02.455 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:36:02.472 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:36:02.515 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:36:02.532 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:36:02.985 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 343, in copy_file_to copy_to_log(src, logger, capture=stream) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 275, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/file.py", line 108, in next line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() timeout 2020-04-22T14:36:02.993 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 343, in copy_file_to copy_to_log(src, logger, capture=stream) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 275, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/file.py", line 108, in next line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() timeout 2020-04-22T14:36:32.636 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:36:32.653 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:36:32.695 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:36:32.713 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:37:02.842 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:37:02.860 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:37:02.903 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:37:02.920 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:37:33.014 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:37:33.031 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:37:33.073 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:37:33.090 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:38:03.187 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:38:03.204 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:38:03.247 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:38:03.264 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:38:33.359 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:38:33.376 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:38:33.419 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:38:33.436 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:39:03.606 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:39:03.624 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:39:03.666 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:39:03.683 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:39:33.846 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:39:33.863 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:39:33.906 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:39:33.922 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:40:04.068 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:40:04.085 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:40:04.127 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:40:04.144 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:40:34.249 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:40:34.265 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:40:34.308 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:40:34.324 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:41:04.447 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:41:04.464 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:41:04.507 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:41:04.523 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:41:34.627 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:41:34.644 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:41:34.687 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:41:34.704 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:42:04.858 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:42:04.875 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:42:04.918 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:42:04.934 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:42:35.056 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:42:35.072 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:42:35.115 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:42:35.131 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:43:05.229 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:43:05.246 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:43:05.287 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:43:05.304 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:43:35.468 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:43:35.484 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:43:35.527 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:43:35.543 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:44:05.664 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:44:05.682 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:44:05.724 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:44:05.741 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:44:35.845 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:44:35.862 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:44:35.905 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:44:35.924 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:45:06.085 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:45:06.102 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:45:06.144 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:45:06.161 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:45:36.291 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:45:36.307 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:45:36.350 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:45:36.366 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:46:06.455 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:46:06.471 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:46:06.513 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:46:06.529 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:46:36.727 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:46:36.744 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:46:36.786 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:46:36.803 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:47:06.916 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:47:06.933 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:47:06.976 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:47:06.992 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:47:37.088 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:47:37.109 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:47:37.151 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:47:37.167 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:48:07.344 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:48:07.361 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:48:07.404 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:48:07.420 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:48:37.533 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:48:37.550 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:48:37.592 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:48:37.609 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:49:07.706 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:49:07.723 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:49:07.765 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:49:07.782 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:49:37.953 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:49:37.970 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:49:38.011 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:49:38.028 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:50:08.126 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:50:08.142 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:50:08.185 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:50:08.202 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:50:38.406 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:50:38.423 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:50:38.466 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:50:38.482 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:51:08.637 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:51:08.654 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:51:08.696 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:51:08.712 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:51:38.818 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:51:38.836 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:51:38.879 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:51:38.897 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:52:09.024 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:52:09.040 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:52:09.083 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:52:09.100 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:52:39.263 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:52:39.280 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:52:39.323 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:52:39.340 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:53:09.469 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:53:09.486 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:53:09.528 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:53:09.545 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:53:39.658 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:53:39.676 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:53:39.719 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:53:39.737 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:54:09.854 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:54:09.872 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:54:09.915 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:54:09.932 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:54:40.086 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:54:40.103 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:54:40.146 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:54:40.163 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:55:10.284 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:55:10.301 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:55:10.344 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:55:10.361 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:55:40.458 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:55:40.476 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:55:40.519 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:55:40.535 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:56:10.677 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:56:10.695 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:56:10.737 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:56:10.755 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:56:40.870 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:56:40.888 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:56:40.930 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:56:40.947 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:57:11.068 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:57:11.086 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:57:11.128 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:57:11.145 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:57:41.257 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:57:41.276 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:57:41.319 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:57:41.336 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:58:11.461 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:58:11.478 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:58:11.521 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:58:11.537 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:58:41.692 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:58:41.709 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:58:41.752 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:58:41.769 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:59:11.948 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:59:11.967 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:59:12.010 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:59:12.027 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:59:42.162 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T14:59:42.179 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T14:59:42.222 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T14:59:42.238 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:00:00.002 INFO:tasks.ceph.mon.b.smithi086.stderr:2020-04-22T14:59:59.999+0000 7fbdbf880700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline 2020-04-22T15:00:12.334 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:00:12.351 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:00:12.395 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:00:12.412 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:00:42.516 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:00:42.533 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:00:42.576 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:00:42.592 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:01:12.704 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:01:12.721 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:01:12.764 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:01:12.781 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:01:42.893 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:01:42.913 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:01:42.956 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:01:42.974 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:02:13.117 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:02:13.134 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:02:13.177 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:02:13.194 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:02:43.289 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:02:43.306 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:02:43.349 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:02:43.367 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:03:13.478 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:03:13.496 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:03:13.539 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:03:13.557 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:03:43.727 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:03:43.744 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:03:43.787 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:03:43.804 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:04:13.990 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:04:14.006 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:04:14.049 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:04:14.067 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:04:44.270 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:04:44.287 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:04:44.330 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:04:44.347 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:05:14.468 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:05:14.484 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:05:14.526 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:05:14.543 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:05:44.715 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:05:44.733 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:05:44.776 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:05:44.793 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:06:15.054 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:06:15.070 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:06:15.112 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:06:15.129 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:06:45.251 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:06:45.269 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:06:45.311 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:06:45.328 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:07:15.457 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:07:15.474 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:07:15.516 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:07:15.533 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:07:45.688 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:07:45.705 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:07:45.748 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:07:45.764 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:08:15.893 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:08:15.910 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:08:15.952 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:08:15.968 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:08:46.099 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:08:46.115 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:08:46.158 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:08:46.174 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:09:16.363 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:09:16.380 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:09:16.423 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:09:16.440 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:09:46.569 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:09:46.586 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:09:46.629 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:09:46.645 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:10:16.742 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:10:16.759 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:10:16.801 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:10:16.818 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:10:46.922 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:10:46.939 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:10:46.981 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:10:46.998 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:11:17.100 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:11:17.118 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:11:17.162 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:11:17.180 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:11:47.267 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:11:47.285 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:11:47.327 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:11:47.345 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:12:17.499 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:12:17.515 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:12:17.558 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:12:17.575 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:12:47.870 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:12:47.886 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:12:47.928 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:12:47.945 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:13:18.093 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:13:18.111 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:13:18.154 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:13:18.171 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:13:48.265 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:13:48.283 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:13:48.325 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:13:48.342 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:14:18.445 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:14:18.463 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:14:18.505 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:14:18.522 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:14:48.638 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:14:48.655 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:14:48.697 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:14:48.713 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:15:18.856 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:15:18.872 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:15:18.915 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:15:18.932 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:15:49.050 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:15:49.066 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:15:49.108 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:15:49.124 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:16:19.234 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:16:19.250 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:16:19.293 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:16:19.309 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:16:49.465 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:16:49.482 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:16:49.524 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:16:49.541 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:17:19.654 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:17:19.670 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:17:19.713 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:17:19.730 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:17:49.818 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:17:49.834 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:17:49.877 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:17:49.894 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:18:20.074 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:18:20.090 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:18:20.133 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:18:20.149 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:18:50.296 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:18:50.313 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:18:50.355 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:18:50.371 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:19:20.486 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:19:20.504 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:19:20.546 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:19:20.563 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:19:50.658 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:19:50.675 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:19:50.717 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:19:50.734 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:20:20.838 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:20:20.856 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:20:20.898 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:20:20.915 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:20:51.024 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:20:51.041 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:20:51.084 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:20:51.101 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:21:21.208 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:21:21.226 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:21:21.269 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:21:21.285 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:21:51.394 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:21:51.411 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:21:51.454 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:21:51.471 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:22:21.594 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:22:21.610 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:22:21.652 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:22:21.669 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:22:51.817 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:22:51.836 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:22:51.882 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:22:51.900 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:23:22.013 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:23:22.032 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:23:22.075 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:23:22.092 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:23:52.278 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:23:52.295 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:23:52.337 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:23:52.354 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:24:22.525 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:24:22.542 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:24:22.585 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:24:22.602 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:24:52.731 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:24:52.749 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:24:52.791 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:24:52.808 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:25:22.894 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:25:22.911 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:25:22.954 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:25:22.970 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:25:53.076 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:25:53.093 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:25:53.136 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:25:53.152 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:26:23.281 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:26:23.298 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:26:23.340 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:26:23.357 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:26:53.510 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:26:53.528 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:26:53.570 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:26:53.587 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:27:23.793 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:27:23.810 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:27:23.852 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:27:23.869 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:27:54.006 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:27:54.022 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:27:54.065 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:27:54.081 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:28:24.187 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:28:24.204 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:28:24.247 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:28:24.263 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:28:54.402 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:28:54.419 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:28:54.461 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:28:54.478 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:29:24.658 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:29:24.675 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:29:24.717 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:29:24.734 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:29:54.863 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:29:54.879 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:29:54.922 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:29:54.939 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:30:25.044 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:30:25.061 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:30:25.103 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:30:25.119 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:30:55.233 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:30:55.250 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:30:55.293 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:30:55.310 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:31:25.530 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:31:25.547 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:31:25.590 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:31:25.607 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:31:55.719 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:31:55.738 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:31:55.781 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:31:55.798 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:32:25.917 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:32:25.934 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:32:25.976 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:32:25.993 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:32:56.089 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:32:56.106 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:32:56.148 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:32:56.165 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:33:26.287 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:33:26.305 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:33:26.348 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:33:26.365 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:33:56.492 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:33:56.508 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:33:56.551 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:33:56.568 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:34:26.731 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:34:26.749 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:34:26.791 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:34:26.808 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:34:56.904 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:34:56.921 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:34:56.963 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:34:56.980 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:35:27.102 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:35:27.118 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:35:27.161 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:35:27.177 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:35:57.289 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:35:57.306 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:35:57.348 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:35:57.365 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:36:27.471 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:36:27.487 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:36:27.530 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:36:27.546 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:36:57.676 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:36:57.694 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:36:57.736 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:36:57.753 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:37:27.866 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:37:27.882 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:37:27.924 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:37:27.941 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:37:58.072 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:37:58.090 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:37:58.132 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:37:58.149 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:38:28.243 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:38:28.259 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:38:28.302 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:38:28.319 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:38:58.490 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:38:58.507 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:38:58.549 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:38:58.566 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:39:28.749 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:39:28.766 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:39:28.808 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:39:28.825 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:39:58.970 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:39:58.987 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:39:59.029 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:39:59.046 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:40:29.175 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:40:29.192 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:40:29.234 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:40:29.251 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:40:59.373 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:40:59.390 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:40:59.432 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:40:59.449 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:41:29.536 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:41:29.554 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:41:29.596 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:41:29.613 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:41:59.801 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:41:59.821 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:41:59.864 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:41:59.881 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:42:30.016 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:42:30.034 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:42:30.077 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:42:30.095 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:43:00.212 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:43:00.229 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:43:00.271 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:43:00.288 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:43:30.427 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:43:30.444 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:43:30.486 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:43:30.503 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:44:00.624 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:44:00.641 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:44:00.684 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:44:00.700 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:44:30.830 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:44:30.848 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:44:30.891 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:44:30.908 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:45:01.018 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:45:01.035 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:45:01.077 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:45:01.094 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:45:31.225 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:45:31.242 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:45:31.284 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:45:31.301 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:46:01.505 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:46:01.522 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:46:01.564 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:46:01.581 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:46:31.677 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:46:31.694 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:46:31.736 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:46:31.753 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:47:01.874 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:47:01.893 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:47:01.936 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:47:01.953 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:47:32.097 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:47:32.237 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:47:32.283 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:47:32.301 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:48:02.403 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:48:02.420 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:48:02.463 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:48:02.480 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:48:32.617 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:48:32.633 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:48:32.675 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:48:32.692 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:49:02.780 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:49:02.797 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:49:02.839 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:49:02.856 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:49:33.045 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:49:33.062 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:49:33.104 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:49:33.121 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:50:03.251 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:50:03.267 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:50:03.310 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:50:03.327 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:50:33.441 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:50:33.457 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:50:33.500 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:50:33.517 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:51:03.613 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:51:03.631 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:51:03.673 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:51:03.690 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:51:33.785 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:51:33.802 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:51:33.846 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:51:33.863 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:52:03.982 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:52:04.000 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:52:04.043 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:52:04.061 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:52:34.164 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:52:34.181 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:52:34.223 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:52:34.240 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:53:04.355 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:53:04.372 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:53:04.414 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:53:04.431 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:53:34.568 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:53:34.586 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:53:34.628 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:53:34.645 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:54:04.755 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:54:04.771 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:54:04.813 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:54:04.830 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:54:34.936 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:54:34.953 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:54:34.995 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:54:35.012 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:55:05.125 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:55:05.141 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:55:05.184 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:55:05.201 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:55:35.372 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:55:35.389 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:55:35.431 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:55:35.448 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:56:05.553 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:56:05.569 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:56:05.612 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:56:05.629 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:56:35.725 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:56:35.743 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:56:35.785 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:56:35.802 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:57:06.015 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:57:06.032 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:57:06.074 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:57:06.091 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:57:36.195 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:57:36.212 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:57:36.254 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:57:36.270 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:58:06.368 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:58:06.385 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:58:06.427 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:58:06.444 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:58:36.548 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:58:36.566 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:58:36.608 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:58:36.625 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:59:06.759 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:59:06.789 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:59:06.831 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:59:06.848 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:59:37.018 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T15:59:37.035 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T15:59:37.078 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T15:59:37.095 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:00:00.001 INFO:tasks.ceph.mon.b.smithi086.stderr:2020-04-22T15:59:59.999+0000 7fbdbf880700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline 2020-04-22T16:00:07.249 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:00:07.267 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:00:07.310 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:00:07.326 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:00:37.421 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:00:37.439 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:00:37.482 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:00:37.499 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:01:07.623 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:01:07.640 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:01:07.683 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:01:07.700 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:01:37.800 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:01:37.817 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:01:37.859 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:01:37.876 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:02:07.963 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:02:07.981 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:02:08.023 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:02:08.041 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:02:38.170 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:02:38.187 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:02:38.229 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:02:38.246 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:03:08.408 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:03:08.426 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:03:08.467 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:03:08.484 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:03:38.627 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:03:38.645 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:03:38.687 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:03:38.704 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:04:08.845 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:04:08.862 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:04:08.904 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:04:08.921 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:04:39.026 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:04:39.044 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:04:39.087 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:04:39.103 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:05:09.240 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:05:09.259 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:05:09.300 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:05:09.317 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:05:39.413 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:05:39.430 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:05:39.473 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:05:39.490 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:06:09.602 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:06:09.619 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:06:09.661 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:06:09.677 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:06:39.849 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:06:39.865 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:06:39.907 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:06:39.924 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:07:10.037 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:07:10.060 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:07:11.240 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:07:11.258 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:07:41.574 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:07:41.591 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:07:41.633 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:07:41.649 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:08:11.741 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:08:11.758 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:08:11.801 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:08:11.817 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:08:41.913 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:08:41.930 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:08:41.973 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:08:41.989 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:09:12.153 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:09:12.169 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:09:12.212 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:09:12.228 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:09:42.325 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:09:42.342 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:09:42.385 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:09:42.401 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:10:12.511 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:10:12.528 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:10:12.571 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:10:12.587 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:10:42.691 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:10:42.709 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:10:42.752 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:10:42.771 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:11:12.876 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:11:12.893 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:11:12.936 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:11:12.952 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:11:43.056 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:11:43.074 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:11:43.116 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:11:43.133 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:12:13.295 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:12:13.312 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:12:13.355 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:12:13.372 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:12:43.510 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:12:43.527 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:12:43.570 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:12:43.588 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:13:13.701 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:13:13.719 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:13:13.762 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:13:13.779 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:13:44.111 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:13:44.128 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:13:44.171 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:13:44.187 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:14:14.369 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:14:14.385 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:14:14.428 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:14:14.445 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:14:44.542 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:14:44.559 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:14:44.602 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:14:44.619 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:15:14.761 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:15:14.778 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:15:14.821 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:15:14.838 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:15:44.945 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:15:44.961 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:15:45.004 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:15:45.021 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:16:15.126 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:16:15.143 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:16:15.185 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:16:15.202 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:16:45.315 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:16:45.332 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:16:45.375 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:16:45.391 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:17:15.495 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:17:15.512 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:17:15.555 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:17:15.571 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:17:45.735 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:17:45.751 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:17:45.794 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:17:45.811 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:18:15.972 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:18:15.988 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:18:16.031 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:18:16.048 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:18:46.185 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:18:46.202 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:18:46.245 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:18:46.263 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:19:16.435 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:19:16.452 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:19:16.495 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:19:16.512 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:19:46.691 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:19:46.710 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:19:46.753 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:19:46.770 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:20:16.906 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:20:16.925 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:20:16.968 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:20:16.985 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:20:47.086 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:20:47.103 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:20:47.146 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:20:47.162 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:21:17.289 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:21:17.306 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:21:17.349 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:21:17.366 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:21:47.479 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:21:47.497 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:21:47.539 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:21:47.556 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:22:17.678 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:22:17.697 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:22:17.740 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:22:17.758 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:22:47.876 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:22:47.892 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:22:47.935 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:22:47.952 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:23:18.042 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:23:18.064 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:23:18.106 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:23:18.122 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:23:48.235 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:23:48.262 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:23:48.304 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:23:48.323 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:24:18.498 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:24:18.520 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:24:18.563 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:24:18.580 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:24:48.733 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:24:48.751 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:24:48.794 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:24:48.812 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:25:18.955 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:25:18.977 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:25:19.018 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:25:19.035 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:25:49.135 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:25:49.153 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:25:49.196 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:25:49.215 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:26:19.398 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:26:19.416 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:26:19.458 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:26:19.475 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:26:49.696 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:26:49.713 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:26:49.755 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:26:49.771 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:27:19.952 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:27:19.969 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:27:20.012 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:27:20.029 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:27:50.133 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:27:50.150 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:27:50.193 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:27:50.210 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:28:20.306 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:28:20.323 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:28:20.366 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:28:20.383 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:28:50.570 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:28:50.586 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:28:50.629 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:28:50.646 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:29:20.750 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:29:20.767 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:29:20.809 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:29:20.826 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:29:50.998 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:29:51.017 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:29:51.060 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:29:51.077 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:30:21.240 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:30:21.257 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:30:21.300 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:30:21.317 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:30:51.437 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:30:51.455 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:30:51.497 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:30:51.514 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:31:21.614 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:31:21.631 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:31:21.674 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:31:21.691 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:31:51.808 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:31:51.825 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:31:51.869 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:31:51.886 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:32:21.988 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:32:22.006 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:32:22.048 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:32:22.065 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:32:52.168 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:32:52.186 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:32:52.230 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:32:52.247 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:33:22.350 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:33:22.367 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:33:22.410 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:33:22.428 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:33:52.536 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:33:52.553 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:33:52.595 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:33:52.612 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:34:22.795 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:34:22.813 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:34:22.856 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:34:22.873 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:34:52.993 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:34:53.010 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:34:53.054 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:34:53.071 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:35:23.161 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:35:23.179 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:35:23.222 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:35:23.239 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:35:53.363 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:35:53.381 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:35:53.423 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:35:53.440 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:36:23.560 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:36:23.578 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:36:23.621 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:36:23.638 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:36:53.762 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:36:53.780 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:36:53.823 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:36:53.840 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:37:23.960 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:37:23.978 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:37:24.020 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:37:24.038 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:37:54.173 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:37:54.192 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:37:54.234 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:37:54.251 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:38:24.352 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:38:24.373 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:38:24.416 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:38:24.433 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:38:54.614 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:38:54.632 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:38:54.674 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:38:54.691 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:39:24.904 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:39:24.921 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:39:24.964 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:39:24.981 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:39:55.170 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:39:55.190 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:39:55.234 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:39:55.251 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:40:25.341 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:40:25.359 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:40:25.401 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:40:25.418 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:40:55.648 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:40:55.667 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:40:55.709 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:40:55.726 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:41:25.829 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:41:25.847 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:41:25.890 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:41:25.907 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:41:56.026 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:41:56.043 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:41:56.086 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:41:56.103 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:42:26.198 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:42:26.217 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:42:26.259 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:42:26.276 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:42:56.370 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:42:56.386 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:42:56.429 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:42:56.446 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:43:26.542 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:43:26.559 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:43:26.602 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:43:26.619 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:43:56.727 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:43:56.746 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:43:56.788 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:43:56.805 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:44:26.918 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:44:26.937 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:44:26.981 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:44:26.999 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:44:57.102 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:44:57.118 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:44:57.161 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:44:57.178 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:45:27.283 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:45:27.302 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:45:27.345 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:45:27.361 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:45:57.500 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:45:57.518 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:45:57.561 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:45:57.578 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:46:27.762 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:46:27.778 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:46:27.821 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:46:27.838 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:46:57.961 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:46:57.981 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:46:58.024 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:46:58.041 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:47:28.158 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:47:28.176 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:47:28.219 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:47:28.236 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:47:58.345 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:47:58.362 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:47:58.405 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:47:58.421 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:48:28.526 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:48:28.544 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:48:28.587 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:48:28.605 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:48:58.741 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:48:58.758 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:48:58.801 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:48:58.818 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:49:29.005 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:49:29.023 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:49:29.066 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:49:29.083 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:49:59.236 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:49:59.255 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:49:59.298 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:49:59.316 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:50:29.509 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:50:29.526 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:50:29.568 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:50:29.585 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:50:59.681 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:50:59.698 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:50:59.741 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:50:59.758 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:51:29.878 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:51:29.899 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:51:29.942 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:51:29.959 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:52:00.077 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:52:00.095 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:52:00.138 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:52:00.155 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:52:30.291 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:52:30.309 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:52:30.351 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:52:30.369 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:53:00.472 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:53:00.489 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:53:00.532 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:53:00.550 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:53:30.644 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:53:30.662 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:53:30.705 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:53:30.722 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:54:00.858 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:54:00.876 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:54:00.919 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:54:00.936 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:54:31.189 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:54:31.207 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:54:31.250 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:54:31.267 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:55:01.412 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:55:01.430 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:55:01.474 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:55:01.492 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:55:31.585 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:55:31.602 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:55:31.645 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:55:31.661 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:56:01.764 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:56:01.781 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:56:01.824 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:56:01.840 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:56:31.958 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:56:31.975 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:56:32.017 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:56:32.034 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:57:02.139 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:57:02.164 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:57:02.205 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:57:02.222 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:57:32.325 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:57:32.343 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:57:32.386 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:57:32.404 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:58:02.505 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:58:02.522 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:58:02.565 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:58:02.582 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:58:32.775 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:58:32.792 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:58:32.835 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:58:32.852 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:59:02.952 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:59:02.969 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:59:03.011 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:59:03.028 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:59:33.165 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T16:59:33.182 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T16:59:33.225 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T16:59:33.241 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:00:00.003 INFO:tasks.ceph.mon.b.smithi086.stderr:2020-04-22T16:59:59.998+0000 7fbdbf880700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 filesystem is offline 2020-04-22T17:00:03.387 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:00:03.403 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:00:03.445 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:00:03.462 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:00:33.593 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:00:33.611 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:00:33.654 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:00:33.670 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:01:03.782 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:01:03.800 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:01:03.842 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:01:03.860 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:01:33.972 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:01:33.989 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:01:34.032 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:01:34.048 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:02:04.194 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:02:04.211 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:02:04.253 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:02:04.270 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:02:34.401 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:02:34.419 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:02:34.461 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:02:34.479 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:03:04.623 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:03:04.642 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:03:04.685 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:03:04.703 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:03:34.796 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:03:34.813 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:03:34.856 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:03:34.873 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:04:04.988 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:04:05.006 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:04:05.049 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:04:05.065 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:04:35.166 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:04:35.183 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:04:35.226 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:04:35.242 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:05:05.338 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:05:05.360 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:05:05.402 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:05:05.420 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:05:35.511 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:05:35.528 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:05:35.571 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:05:35.587 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:06:05.725 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:06:05.741 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:06:05.784 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:06:05.801 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:06:35.933 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:06:35.951 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:06:35.994 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:06:36.012 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:07:06.112 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:07:06.129 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:07:06.172 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:07:06.189 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:07:36.311 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:07:36.331 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:07:36.374 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:07:36.391 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:08:06.492 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:08:06.508 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:08:06.551 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:08:06.567 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:08:36.662 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:08:36.679 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:08:36.721 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:08:36.738 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:09:06.869 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:09:06.886 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:09:06.929 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:09:06.945 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:09:37.107 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:09:37.125 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:09:37.168 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:09:37.185 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:10:07.280 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:10:07.297 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:10:07.340 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:10:07.356 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:10:37.520 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:10:37.536 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:10:37.578 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:10:37.595 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:11:07.750 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:11:07.768 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:11:07.811 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:11:07.828 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:11:37.965 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:11:37.983 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:11:38.026 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:11:38.043 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:12:08.145 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:12:08.162 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:12:08.205 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:12:08.221 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:12:38.335 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:12:38.353 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:12:38.396 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:12:38.414 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:13:08.516 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:13:08.533 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:13:08.576 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:13:08.593 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:13:38.680 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:13:38.696 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:13:38.739 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:13:38.756 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:14:08.877 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:14:08.896 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:14:08.938 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:14:08.956 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:14:39.125 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:14:39.142 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:14:39.186 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:14:39.203 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:15:09.423 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:15:09.440 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:15:09.483 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:15:09.500 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:15:39.645 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:15:39.662 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:15:39.705 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:15:39.722 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:16:09.859 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:16:09.876 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:16:09.918 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:16:09.935 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:16:40.032 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:16:40.053 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:16:40.096 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:16:40.114 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:17:10.230 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:17:10.248 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:17:10.290 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:17:10.308 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:17:40.469 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:17:40.487 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:17:40.531 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:17:40.549 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:18:10.668 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:18:10.702 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:18:10.746 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:18:10.762 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:18:40.880 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:18:40.899 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:18:40.942 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:18:40.959 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:19:11.148 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:19:11.174 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:19:11.214 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:19:11.233 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:19:41.392 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:19:41.408 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:19:41.451 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:19:41.468 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:20:11.591 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:20:11.611 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:20:11.655 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:20:11.672 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:20:41.796 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:20:41.814 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:20:41.857 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:20:41.875 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:21:12.013 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:21:12.036 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:21:12.079 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:21:12.097 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:21:42.215 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:21:42.231 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:21:42.274 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:21:42.290 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:22:12.421 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:22:12.439 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:22:12.482 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:22:12.498 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:22:42.618 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:22:42.636 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:22:42.679 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:22:42.696 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:23:12.791 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:23:12.809 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:23:12.852 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:23:12.870 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:23:43.055 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:23:43.075 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:23:43.117 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:23:43.134 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:24:13.311 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:24:13.332 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:24:13.374 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:24:13.391 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:24:43.550 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:24:43.567 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:24:43.610 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:24:43.627 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:25:13.798 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:25:13.815 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:25:13.858 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:25:13.875 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:25:43.978 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:25:43.995 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:25:44.038 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:25:44.054 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:26:14.168 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:26:14.186 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:26:14.228 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:26:14.245 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:26:44.357 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:26:44.374 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:26:44.417 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:26:44.434 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:27:14.546 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:27:14.565 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:27:14.607 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:27:14.624 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:27:44.728 INFO:teuthology.orchestra.run.smithi086:> true 2020-04-22T17:27:44.750 INFO:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:27:44.792 INFO:teuthology.orchestra.run.smithi103:> true 2020-04-22T17:27:44.809 INFO:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-22T17:28:04.699 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2020-04-22T17:28:04.700 DEBUG:teuthology.task.console_log:Killing console logger for smithi086 2020-04-22T17:28:04.700 DEBUG:teuthology.task.console_log:Killing console logger for smithi103 2020-04-22T17:28:04.700 DEBUG:teuthology.task.console_log:Killing console logger for smithi086 2020-04-22T17:28:04.701 DEBUG:teuthology.task.console_log:Killing console logger for smithi103 2020-04-22T17:28:04.701 DEBUG:teuthology.exit:Finished running handlers